connecting.
No, now it's live.
>> Hello.
Oh man, all the questions already
rolling in.
>> Is there a 10 to 20% off trade in? No
trade in.
So, let's wait until it hits like 30
seconds. Answer a couple questions.
Great stream. Thank you.
>> Hello, nerds. Hello. start.
[laughter]
>> How's everybody enjoying the sale?
Anybody buy more discount? We we we
can't
>> guys. We gave so many discounts over the
last month.
>> We lowered the price a month ago and
then we gave a discount on top of that.
We sell these things profitably,
which is good for you because then you
guys want the comma four, five, six,
seven, and eight.
>> Yeah. Our production team tries to make
them efficiently and we lower the price
as we can, but we got to keep making
money.
>> This is lower than the KA 2 price. Um,
and the Comma 2 was a phone and we put a
little board on it with the Ublocks and
a couple other things. Bought my first
look. Great. I think you're going to
have a good time.
>> Nice.
>> Okay. Um, yeah. Let's get to driving.
So, we're going to show you guys the
latest and greatest
night. I get to see it.
>> Yeah.
We'll just go on the highway and drive a
little bit. So, we'll do our standard
loop here.
So, we're in our demo car, the Lexus ES.
Spent a lot of time fixing this car up.
That means all the TSS2 Toyotas have a
much better longitudinal tune now.
Unfortunately, my second vehicle doesn't
support it. Looking to get a Sienna.
Any updates on newer robotics appliance?
Uh we're always thinking about it. Um
we'll tell you guys as soon as we have
some ideas.
>> The big problem with robotics is I mean
our we want to make things end to end.
That's the only way that you can kind of
scale you know some kind of ML solution.
Um and we've constantly experiment with
trying to get indoor navigation solved
with end toend ML but that we're just
not there yet. So as soon as we're there
then I think we'll be get more serious
about that sort of stuff.
>> Someone asked when is V0.10 10. So, we
have two big upcoming releases coming
up. 010 is defined by the first release
where everything is trained in the new
MLS sim. Um, if you want to know
anything about MLS, we've talked about a
whole bunch on Discord um and Comic-Con
last year. Um, you're echoing hard. Uh,
anybody else having the problem? Not
sure what we can do about that at this
point.
Um,
>> maybe turn the mic around.
Not for you though. Yeah, that's true.
We should just drop this mic.
Um anyway, so 010 is the first MLSIM
model. Um that's a whole new
architecture. Yeah, somebody says no.
There we go. Okay, cool. Yeah, so 010 is
the new MLSIM model and a whole bunch of
other things, but the real defining
thing is the MLSIM model. And then 1.0
know is we use that new MLSIM and we
have a fully endto-end policy um which
is essentially the deletion of
experimental mode where experimental
mode becomes so reliable it is chilling
drive north a bit
>> okay
yeah look how smooth
>> yeah I can give a quick update again for
MLS for those who aren't fully up to
date so we've been shipping you know end
toend malls for a few years now and
we've been shipping them in a simulator
where we estimate the depth of the scene
and then we repro everything and that
allows us to deviate from where the
human drove and you know teach the
models how to correct. Problem with that
is you know these reproive simulators
are kind of flawed. Uh depth estimation
is is is just a fundamentally flawed
concept. You can't repro lights and
stuff. You need to deal with
reflections. So the only way to do this
properly end to end is to train in a
simulation model that can you know
generate any kind of realistic driving
video. Just imagine like GTA 5. You can
initialize on any real driving video and
you can just take over and start
driving. And in that simulation you can
then uh teach them all how to drive. And
so that's what MLS sim is. And it's the
first time we've changed the
architecture this much in in many many
years. So there's quite a lot of uh
quite a lot of changes we have to make
to to actually get that to work
reliably. And that's why we haven't had
a release in in a few months. Uh it's
the most important thing for the company
to ship this. Uh we haven't been able to
get a release ready. That's what we're
iterating on. It's getting better. But
uh these big architectural changes are
just hard. So you know you guys have
been enjoying the all the work that
production and hardware team has done
making cheaper devices, making devices
faster, more efficiently so you can buy
3 cheaper.
>> Don't forget more reliable
>> and more reliable. Yeah. Cheaper, more
reliable, better made. And uh you know
hopefully in the next few months uh the
autonomy team can uh ship some things
that you guys will enjoy too. Once these
models actually start getting good they
will scale way way better with compute.
We're getting way more compute in the
data center. Um and we'll start to
really see see good performance once
this architecture is stable.
Kama screwed me up. I hate driving a car
without Exactly. Exactly. Now we just
got to get the price to a point where
it's just an instab. $9.99. Three
digits. This is the first time we've
been at three digits since the common 2.
And the common 2 had a 199 harness. The
brand new Harness V3 is $99.
The Harness V3 is strictly better than
the unless you have a comma pedal, but
um it's strictly better, cheaper,
sleeker, tinier, easier to install.
Um
yeah, anybody from Discord who's been
driving the MLS models, model,
I think they're getting quite good.
We're getting close to a release.
And you guys know the promise with this
release. If it's not noticeably better,
you can call sliers.
You can already see it do some really
cool stuff. Um, for me, I I really
notice this in intersections. It just
really understands the scene. Um, it
knows what's going on. It really
beautifully maneuvers around parked
cars, other cars coming at you from
other lanes. Absolutely love my 3X.
Yeah. Yeah. You have a Highlander. So,
you're going to get a big upgrade to
open pilot bomb in the next release.
Committee mode. I don't know what that
is. Is Mocky supported yet? Um I believe
in some forks. Um we have we haven't
announced this yet, but we have a car
hacking hackathon coming up next year.
Um where people can bring their own
cars. You can port your car alongside
the Comma team. We'll announce that
pretty soon. So I suspect we'll get uh a
pretty big influx of new car support
after that event. If I buy a Comma
today, do I get the crypto NFD? Harold,
you want to talk about the Comma NFD?
Uh, all crypto is a scam. So, no.
>> Any thoughts on centry mode? Yeah, if
somebody's excited about building centry
mode, we'd love to have sentry mode.
Comma Prime is finally making money. Um,
like not a ton of money. It's not like
uh we're ripping you off with that.
You're paying for the sell service and
the storage in the cloud, but uh it's
making healthy margins and we can afford
an engineer to come and work on sentry
mode. I really want connect to be like
it's like your Tesla vehicle management
app or your Kia. You can see the charge
status. You can lock and unlock your
doors. It should be the best dash cam on
the market. Uh, have you untested the
Okiana Tesla Model 3? Yes, we had uh the
guy who ported it, he interned here for
a little bit. EV9 that also works in a
fork.
Does OP learn specific disengagements on
local roads? For example, if a car tries
driving on a curb at a specific
intersection, it will not do that. So,
it doesn't learn online yet. That's a
very long-term thing. Um, it learns a
couple things online, but nothing like
that.
>> Yeah. The only stuff that's learned
online is is vehicle specific stuff
like, uh, you know, the steering
response of the car, um, what kind of
steering angle you need to achieve a
certain stuff. All those parameters are
learned online, which is why the
steering is as accurate as it is. But
besides that, all of that, all the rest
of the learning is just based on the
fleet. you try to drive like the average
consensus of the fleet and you'd be
surprised how good of a driver that can
be. Basically, all the issues that open
pilot has as a driver now is not because
it's not learning some specific nuance
situation. It's just because overall
it's it's still pretty dumb and not
really capturing um the the the
consensus of human driving in most
situations. If you could actually do
that, you you should just imagine
basically an Uber driver, right? You
rarely, you know, drive in an Uber
driver and get upset uh at how they
drive. That's because they just
generally drive pretty well. And that's
what Open Pilot will drive like, not
even uh considering learning online, you
know, adapting to your specific commute
or anything like that.
>> So Jason's asking, what kind of
validation do we do? Um and how do we
know the new MSM models emerging are
better?
>> Um
I mean, so we we have quite a lot of
validation steps. Uh
currently one of the big metrics that
we're looking at is you know we have
various types of simulation all based
based on real data and based on like uh
classical simulator like meta drive
which is like a video game basically and
we just are now looking at how reliably
does it you know converge to lane center
uh compared to a human in all sorts of
different situations. So currently, even
though these models drive well in in a
variety of situations, they're still not
super reliable at always converging to
lane center. And that's because all
sorts of quirks with the simulator that
introduces noise and just reduces
accuracy. Um, and so that's what we're
iterating on. Basically, in simulation,
we should have super reliable
convergence to lane center all the time,
uh, when there's no reason not to be in
lane center. And that's basically what
we're iterating on. out.
>> You've been using your Comet 3 without a
screen. So, good news. We just lowered
the price of screens in the shop to 100
bucks. Um, we've improved our screen
supply chain a whole bunch. We used to
pay more than 100 bucks for these
things. Um, all these improvements in
supply chain, we're using part count and
stuff has gotten the 3X so low. Um, but
yeah, the combat 3x screen is compatible
with the Com.
Um, so just buy one in the shop. You can
replace it or you can buy a 3X. 3X is
great, too. Would you make a dummy radar
module for Ford vehicles? Um, so the
thing with external hardware is most
users aren't going to install this. Um,
so I'm sure the community will come up
with it if it's useful enough. Um, but
really the new style models once we get
to 1.0, you really won't be on the
radar. How long is the context length?
>> Well, the context length is 2 seconds.
And um for stuff like lane changes, it
has a 5-second buffer where it's told
like, "Oh, you asked for a lane change,
you know, 5 seconds ago." But it only
sees 2 seconds of video, right?
>> What is the update? So, I mean,
we talk about this a whole lot. We talk
about it every week. Why can't we ship
an update? Um, we have a very clear
list. Um, these models are just not
ready. We were hoping we could ship one
for Black Friday. Um, we thought it'd be
really fun to ship 010 along with this
great sale. Uh, it didn't work out, but
the sale is still going great. Uh, like
we'll ship this as soon as we can. We're
trying for CES now. It'd be kind of cool
to have it ready for them. Um, if you're
going to CES, stop by the booth. We met
a whole bunch of users last time. It was
a lot of fun. Um,
yeah. So, just to add some context to
the why aren't we shipping an update and
and you know, how did we not predict
this better? We are basically the first
people to do any of this. You know, you
started seeing video generated by AI
like maybe a year or two ago and now
we're training in video generated by
models like that, training how to drive
and actually driving on these models in
the real world. And they kind of work.
This is really like at the cutting edge
of robotics and ML research. And so it's
extremely hard to predict where the
difficulties will be and what will and
won't work. And so, you know, we kind of
give a best best estimate and and try
to, you know, stay ahead of things. But
this is this is cutting edge stuff. It's
not like it's not like we can look up a
paper for someone that's does that's
done this before. We we are the first
people to do this and uh you know it's
working and we're iterating and we're
making progress but it's you know there
there is no existence proof where we can
say well obviously it should work this
well because we're the only people doing
this. Uh so predicting when these things
will be uh x amount of good or fix all
these problems is extremely difficult.
Uh we're very happy that we're making
progress and that the whole thing
fundamentally works and we hope that
that will translate to a way better
experience very soon.
But you guys know what the good news is,
right? Um, you know, we've always known
we're going to need to do this. Um, over
the last couple years, we've been
working on it and we knew it was in the
pipeline and we always have to make this
trade-off when we had an issue. It's
like, do we try to fix it in the
existing stack or do we just wait for
MLSIM? Once this shifts, this is like
really it. We'll be able to really look
into all your issues. Each release
should feel meaningfully different and
uh should meaningfully improve.
Um, so that's the really good news with
this stuff. Once we ship it, the focus
is entirely on getting rid of
experimental mode and making it all in
chill mode. Um, what model Lexus is
being driven? Lexus ES 2024. I think
it's TSS2. I think it's the latest. We
bought this new, right?
>> Yeah.
>> Yeah. So, it's 24.
Any plans for common body arms? We tried
them. They were scary. We're also
uh, you know, nobody's that excited
about working on the body right now
because we don't have a good application
for it. Um, if you have a good
application, go ahead post on Discord or
comment here, but we're just not sure
what it does yet.
>> Um, yeah, I can I mean, add more context
to that. Again, we do want to solve, you
know, end to-end robotics as well as
driving. Were you we're focusing on
driving because we haven't even been
able to fix the fundamental stuff with
driving yet. With robotics, the first
thing that you want with the kind of
robot that we'd be willing to build is
just a robot that can roam around
indoors reliably, find its charger,
charge itself when the battery runs out,
that doesn't need like any kind of liar
or anything to figure out if it cannot
run into stuff. And we've done
experiments with that and we're, you
know, those things are getting better as
ML improves and as our stack improves.
But it's not at a place yet where we can
make a robot that can reliably just roam
around indoors, u, you know, explore the
space and not get stuck. That's still
pretty hard, but as soon as we can do
that and we'll keep trying, uh, I think
we'll be we'll be ready to explore
robotics again. But that really has to
be step one for any kind of end to-end
robotic system. Otherwise, you're like
writing all these hacks. You're
estimating the depth of the wall and how
close you can get to the wall. It's just
all a bit of a waste of time. So the
first the first step before we explore
robotics again is can we make a system
that can learn end to end without us
having to hardcode anything about walls
or doors or hallways to just roam around
explore and find the charger.
Got a lot of good questions today
actually. Um yeah where were all you
guys on other streams? You guys have
great questions. Uh when do you expect
the need for more ondevice commute? So
great news there. The current open pilot
uses 40% of the GPU. Um, we use the
other 60% but for stupid things like the
UI and debearing images. Um, so in
master what we've done is um I spent
about a month reverse engineering the
ISP on the 845 and now we have the only
implementation that isn't the Qualcomm
junk that can uh debar and process
images. Um, and it's like a beautiful
it's a few hundred lines in open pilot.
Um, but that entirely saves uh all the
image processing.
Um, it fully moves it off the GPU onto
the ISP, which is hardware that we
essentially weren't using. Um, so this
gets back a whole bunch of GPU time for
the model. We have a lot of room to grow
on the 845. Uh, we also have tons and
tons of 845s. So, uh,
that gives you guys any ideas. We also
haven't changed the ondevice model at
all. Um, MLSM is entirely software. It's
entirely on the back end. Once we ship
MLSM, we can scale up the model on the
device. Um, we can train on a whole lot
more data. We have a lot of stuff to
explore as soon as these things um as
soon as we're training something that
looks like open pilot release. The
problem is, you know, when you do a
refactor, but you set the bar so high
before, um it's just taking a while to
get to meet that bar.
Anyone know how well this would work on
a 2023 Civic hatchback? Uh the good news
is we have a 30-day trial. Um the return
process is super easy. You don't contact
anybody. You don't email support. You
know, we don't ask like a million
questions. Just go to com/ returnturns
if you don't like it. Um, takes like 10
minutes to install these days. Um,
I saw some guy on Discord is going to
like get his mom to install one just to
prove that it's easy. Um, you know, this
thing should be ready for your mother
soon. Uh, we know it's not quite there
yet. Um, but like removal of the comp
power and a whole bunch of other stuff,
it should be getting there.
Fingerprinting is basically fixed. How
often do you see people talk about that?
When's the next update coming out? Uh,
we've addressed that. You can scroll
back in the stream, click that a whole
bunch. How much data do you train on for
ML7? So everything's trained on 500k
segments. So that's 500,000 minutes of
driving, but we have way more than that
at the office. And then we get about 3
million minutes every single week. Um,
and that's growing a whole bunch.
Yeah, I can address the data thing that
comes up so often. I don't know.
Reporters love focusing on Tesla and
Whimo's amount of data. Nothing in this
space is limited by data. This is
complete nonsense narrative. Everyone
has more data than they need and it's
also very cheap to collect data. If you
look at how much, you know,
>> it's cheap for us.
>> Well, it's cheap for us, but for them,
if you compare to their burn and their
valuations, they could collect huge
amounts of data. You know, paying some
some some Uber driver to put a device in
their car, but that it's just not the
bottleneck. The bottleneck is machine
learning research. Uh, and you know,
these things are not data efficient. And
you can throw as much data as you want
at it. It won't really solve the
fundamental problems. uh which is why we
train on way less data than we have
access to because it's it's just there's
no benefits.
>> That might change but uh right now
that's not the case yet.
>> I mean if that does change we have tons
and tons of data already to play with.
Um and we can select different stuff to
upload. Um we have so much optionality.
Advice to students interested in working
somewhere like KAI. Uh it's funny you
asked that. So the bar is super clear
for KAMA. Um just get on one of our
leaderboards. you do well on one of the
leader boards where you contribute
bounties. Um that's literally it. And
for bounties and the leaderboard really
just keep asking yourself why is this
not better? Why is this not better? Why
is this not better? Um and if you can do
that and you can improve, it's not like
you have to be great on day one. Just,
you know, if you can manage to put up
PRs that we would just click merge on,
then uh you know, you're already pretty
high up there um as far as most
programmers. Um, somebody asked about
Elon and regulation and stuff. Uh, that
doesn't help. Nobody's held back by
regulation. Um, this is all technology
probably.
Like we said, this is uh bleeding edge
stuff. Um, which makes it hard to
predict, but you know, if the regulators
disappear tomorrow, you're not going to
get a better open pilot at all. It
doesn't improve pilot.
Um, 26 is still the best value pick. I
think the No, the older Corollas are
great. They have great compatibility.
Um,
why did George resign? George didn't
resign. He's he's around. Um, MC will be
working on fuel energy efficient driving
models anytime in the future. Um, yeah,
maybe.
>> I think fuel efficient is more I mean
the things that make things fuel
efficient also overlap a lot of just
uncomfortable driving. Opella isn't
super good. Yeah. It's definitely not
super human at, you know, accelerating
and braking at good times in traffic.
like you know the situation we're
starting to get in now where traffic is
kind of getting more dense any human
driver would start to kind of let off
the gas not try to catch up to the lead
as much and that's also fuel efficient
just as as open pilot becomes more
comfortable more superhuman it would
become more fuel efficient
>> yeah I mean you guys see these models
are quite good um you know arrows aren't
touching the wheel or anything they're
very smooth um we really see the
deficiencies of these models in the long
tail
still letting on city driving. I mean,
with MLSM, we should really catch up.
There's some control stuff, too. But,
uh, you know, we know we have some
catching up to do. I think we have good
plans for this
city driving.
>> Yeah, we've, you know, we've explored
once we get the models ready, we we have
we can drive on some cars that have more
torque, that have all the control stuff
we need. Just right now, it's more about
moving to the new stack and perfecting
the stuff that was really good before,
which is the highway, you know, driving.
And once that's there, then we can
really start pushing on improving these
kind of feature level stuff.
>> Would I notice any real world
differences from 3 to 3x? No. The sounds
are a little bit better on the 3x. Um,
that's probably the biggest thing you'll
notice. Um, can't wait until Porsche
supported. I think there's a couple that
are. You can go into Volkswagen channel
Discord. I think Jason at least knows a
few that can be supported.
Can you please ask more for driver user
profiles? Uh,
we don't have that many settings, so I
I'm not sure what value that would have.
Will MSM be open sourced?
What does that mean?
>> Uh, I mean, can they run the model?
>> Oh, yeah. So, I mean, we'll probably
never over open source, you know, all
the code base that we work on
day-to-day. There's just not much point
to that. No one can really use it
without the data or the compute. This is
completely useless. Uh but what we do
want to open source is obviously the
driving models which we're doing already
but uh is probably the simulation models
the ones where you can like kind of
drive around in like a video game. Uh
we've open source the previous version
already. It's called KMA VQ. You can
check it out. Those models are pretty
crappy compared to what we're using now.
Uh but once we get you know to like a
next level we'll we'll do that again.
We'll open source the data set again and
we'll open source the simulation model
again too. I think it's fun for people
to play around with. It's just kind of
cool.
>> Yeah. If you guys want to understand how
Melson works or what it is, look up the
Minecraft demo. That one I think is
pretty illustrative. Um, you know, you
can pan around. You can you can see
exactly how this stuff works and get a
good intuition for it. Um, what can I
keep search Minecraft simulation?
>> Some kind of diffusion paper, I guess.
>> Yeah.
>> I don't know.
>> We got Minecraft diffusion. Uh, we'll
probably find maybe a white paper. Yeah,
we plan to write a paper. Um, do we miss
the CVR deadline?
>> Uh, no. We're planning to go for the
workshop in March, I think.
>> Okay.
>> Is the path of superhuman driving known
and it's just work to get there, or is
there still a matter of finding the path
of superhuman driving in your opinion?
Oh, let's look Nibil. What's up, Nibil?
>> Uh, yeah, I mean, the the the main parts
are known, but, you know, nobody's done
this before. It's it's unclear what
issues we'll we'll we'll find along the
way, but yeah, the the basic
architecture is known. It's been known
for a long time. the MLCM architecture
that we're using now. You know, George
originally wrote like a brief paper
about this uh with Eder eight years ago.
So, we've known about this for a long
time and we've been executing on that
same mission. Haven't really deviated
from that that much. It all takes longer
than we thought, but uh but yeah, I mean
the vision's kind of the same and and we
still expect that that will scale as we
add compute and fix the bugs.
>> Yeah. Kama turns nine uh this January
and uh if you guys remember the original
Tech Crunch Talk99 add-on um end of the
year so it took 9 years but we're at
$9.99 um we're shipping
at least a master model um the 999 is a
sale but you can see where we're going
um and we're finally getting there. Um
we really plan to ship 1.0 well before
our 10th birthday. Um,
so we really want things to pick up very
soon. Um,
the sales doing quite well. People love
their 3Xs. You guys saw the slick deals.
Um, we had sales earlier this year that
performed super well, but the slick
deals were full of comments like, "What
is this thing?" And then people are
concerned about fingerprinting and all
sorts of stuff. Um, it was mostly tech
specs and nobody really understood what
it did. You see that kind of shift a
little bit now. People kind of get it.
Um,
and what I'll say is, you know, if you
ever thought about joining us, now is a
great time. Uh, we have lots to do on
the hardware side. Um, autonomy product
team we're hiring. Uh, Harold's
particularly interested in controls. Um,
we support 300 cars and we have to
support steering, gas, and brakes and
all those. We want good controls. Um,
yeah, if you're interested in controls,
don't be intimidated. You don't need to
be a controls engineer or have any
classical controls.
If you do well on the controls
challenge, I'm confident uh you will do
great here.
>> Yeah. The thing to realize about our
hiring, it's, you know, maybe it's a bit
too direct. And you know, we have this
trouble a lot with sales people and all
sorts of people where they think they
need all these proxies and good resume
and stuff. The bar is like super clear.
Don't try to email them and say like,
"Oh, you know, should I do the
challenge?" Or like just do it. You do
well on the challenge. We're interested.
Um that's literally it is his seat back
at the office. He's never left. Nine is
working 7 days a week to get you guys in
awesome. Nine is working super hard. Um,
he was too busy to come do this this
drive. Um,
com the direction of a headless unit.
Why do you want a headless unit? Any
room for automation engineers? I don't
know what that is, but if you think you
can contribute to shipping open pilot to
people, we want you. And the way you can
prove that is doing well on our
leaderboard or doing well in bounties.
Um,
>> yeah. I don't know if automation means
something like production related. Yeah,
I mean if you want to come and be like
um I talked to a lot of software
engineers and they're like surprised
that they could be like the head of
production or something, but it's all
software. Uh we got a lot of the
reliability by just writing with tests.
Um
there there's a lot of room um for good
software engineers to come and work
here. Um we're also very aggressively
hiring for hardware. Um
there's a lot to do on both the
manufacturing and design side.
Yen doesn't go home to sleep. Yen does
go home to sleep, but he's working very
hard to get you guys in also.
>> But the models keep training, so
someone's always working.
>> Yes.
But yeah, I don't know. You guys see all
the hardware we're outputting. We got
the price of the 3X down. We shipped the
lightning hard ss this year. We're
shipping the tiny boxes. Um we're going
to ship two different tiny boxes this
year. Tiny box pro and the normal tiny
box with both variants. Um so we have
most of our office is actually dedicated
to to hardware production. Um,
so I don't have to have anything visible
on my windshield no screen. Um,
you know, we we've we've thought about
this. We've talked about in this sport a
bit. Um, but we still got lots and lots
and lots of 3xs to build. Um,
we've done a lot of refactoring on the
3x2. Um, Rob and I are working on a blog
post. Rob did a lot of the 3X design.
Um, some of our hardware engineers. Um,
but yeah, if you're interested in a job,
literally come leaderboard and
com/bounties.
When when will navigation be integrated
for A to B? Likely not before 1.0. Is
research understaffed? We know VC left
some time back. Uh, I would say they're
understaffed.
>> They're not understaffed. You know,
we're always looking for people who uh
who are competent and who who like this
sort of stuff and really want to do cool
stuff. If you like the challenges, if
you're good at those challenges, I think
you'd be a great addition to the uh to
the autonomy team in Tacoma in general.
And also, if anyone's interested, you
know, just do well at the challenges. If
you want to be an intern here, if you do
well at the challenges, you know, we
have accommodation, we have food, we
have cars, uh as long as you, you know,
do well at the challenges, seem like a
competent engineer, we'll we'll figure
the rest out.
>> 50. We recently lowered it. After all of
our refactors and uh supply chain work,
we were able to get the price down to
1150 and then we had a sale on top of
that 1150 for $9.99, three digits. Um,
you know, this drive and the sale and
everything are really a preview of uh,
you know, the original vision $9.99
add-on. It supports 300 cars now instead
of you know, the Honda the what is the
Honda Civic and the Acura ILX. Is George
the one doing interviews for new hires
or Herald or D or Herald? Um, so I do
the interviews for the product team.
Harold does them for the autonomy team.
Um, sometimes George will hop in there
if he wants to talk to somebody. Uh,
you'll probably also talk to Alex, too.
Um, but the process is super fast. Um,
you'll just submit something and then
I'll probably schedule a call with you
within the next couple days. It's pretty
casual like 10 20 minute call. Uh, we're
able to extract signal pretty quickly.
We just want to know are you a smart
person? Are you motivated? Um, and can
you contribute independently? Um can you
share some insight metrics like the
average engagement rate? We've shared
this a whole bunch. 56% of miles about
25% of the time and what fork most
people are using. Uh so the non for the
non-comma stuffing pilot is the biggest
one. Um yeah, you can get one week
unpaid workers. You can get as much as
you want. Go ahead and get called open
pilot. Pick a bounty. Uh if you want
unpaid, don't pick a bounty or you can
skip claiming the bounty. Up to you. Um
but that's how you do that. you know, if
you want management, we don't really
have much of that. Um,
I remember interviewing back in 2018 for
an internship. Yeah, I think we've
always had a really high bar. Um, but I
think we've done a little bit better job
recently of communicating where that bar
is. And it literally is can you do well
on the leaderboard. The bar is
completely public. Um, you know, are you
a good contributor or can you do well on
the leaderboard? That is the bonus.
>> Yeah. And we've also had people you know
if the challenges themselves are for
some reason not that interesting but you
you know prove yourself in different
ways like you see came in just looking
at our segment data set and training a
better segment that we had trained
internally. So that was you know
>> all on his own. He didn't email it and
say like hey if I do well in this
segment thing can I get a job he just
did it put it on GitHub and we reached
out to him.
>> We have tons of data sets uh available
which you can do all sorts of
interesting stuff with if you're
interested if you're a data science kind
of guy there's plenty of stuff to do. We
publish the biggest data set on car
controls like in terms of steering
angle, steering torque, all that sort of
stuff. If you're interested in vehicle
dynamics, how does a vehicle, you know,
interact with the road and all that
stuff, we have bigger data sets
published than anyone else. If you want
to try with that, you can you can mess
with that. And if you do cool stuff
there, you know, that's that's a very
easy way to get an interview and an
internship. As long as you do cool
interesting stuff that you know is
difficult and and challenging, uh that's
and that's all you really need.
But yeah, open pile 1.0. Come here and
help build pile 1.0. Um, and then come
work on what's next. Um, what is the
secret sauce that makes comic companies?
We're like 25 people. Um,
you know, it's really clear what the
goals are, what the mission is. Um, you
know, it's like the Elon Elon saying,
"What'd you get done this week?" Um,
this is our accountability to you
because we're showing how the driving
works back on the road.
So, that's about it. It's not a a big
secret.
>> Is comma pencil still required for depth
sensing?
>> Uh comma pencil is uh still used but yet
it's not like it it is used still for
depth in the test and stuff but that's
what we're trying to move away from. But
a lot of the stuff that comma pencil
does is still useful for other reasons.
One of the biggest things that it does
is it labels uh things that are moving
in the scene and things that are not
moving. Oh, it's cutting this turn.
Okay. So, this is the type of stuff
we're fixing.
>> It's one of the reasons it's not
released ready yet.
>> Yes.
>> Uh but yeah, so it labels moving and
non-moving things, which is really
important for localization. So, that's
kind of the biggest thing that comp
Pencil does and it will probably stay
that way for quite a long time actually.
Uh it's it's really uh it's really
localization is still something that is
essential and will probably never go
away as end to end as it becomes. Uh
that's one thing that will stay.
>> We did remove G from online
localization. That's it's a huge win.
Um,
yeah, it's a really exciting time to
join
Pile 1.0 where we're manufacturing real
consumer electronics. The reliability of
these things is on par with like an
average iPhone. Um, not quite as good as
the best iPhones, but we're we're really
getting there. The gradient's moving in
that direction. Um, so the 3 was 2 and a
half better 2 and a halfx better than
the comma 2. And the 3x so far is 4x
better than the 3.
So you can extrapolate from the numbers
we published. Um do you track returns
devices that are not well supported and
not officially upstreamed? Uh I'm sure
but
um if somebody wants to come in and work
on car stuff, we have the Open DPC
project as like a separate thing pulled
out of Open Pilot. Now if you want to
come in and work on Open DBC, we're
really excited to have you come do that,
too. Um we want Open DBC to move a whole
lot faster than it does and we've done
all these refactors such that it can.
And you see we have an external
maintainer now. Um Jason Young, if
you've seen him around, he's been on
Discord for years. Um and we want to
grow that a whole lot. And the
hackathon, I think, will provide a lot
of momentum for that. We have the the
best tools for reverse engineering these
cars. We've really productionized it.
You can do the whole thing. It should be
pretty fun now. Um you know, if you poke
around a cabana, you can just It's a
whole lot of fun to use these tools. Um
and it's important that it's fun to work
in open pilot. We really optimize for
this. We're not having a good time. What
are we doing?
One day I might own a car that isn't
able to work for the combo. Yeah, I mean
we'll always be limited by support cars.
That'll be time to move on to robots,
but we're getting close when we get back
to the office. We have like maybe 10
more minutes of questions.
>> Uh yeah, cuz we're almost in Mexico, so
ah
>> we probably should head back.
>> I don't have my license. Um
>> using a custom fork. Do you take
inspiration from these forks? Uh yeah,
but the best form of inspiration is a PR
we can just click merge on. This is
literally the reason if you have a car
port that is not merged yet, we just
can't click merge on it and it's not
held back by ads. We can move it
forward. But this is the thing to
realize. Um
the beginning been loving the model
improvements. Great. What's the number
of miles you guys have seen on a 3X? Uh
like cumulatively or in a single drive.
Some of these things have tons of miles
on them.
Um, but for reference, we do 3 million
minutes of driving every single week
across the fleet and it's growing pretty
rapidly.
I don't protocol flex or can or locally.
Um, and we have a great community on
Discord. If you want to get into car
hacking, um, car porting, car hacking
can sound intimidating. It's really not.
Um, we've productionize the whole thing.
There's lots of examples, lots of
existence proofs. Um, just go to
Discord. People can point you in the
right direction. Um, the key thing with
all this stuff is just are you willing
to put in effort. Um, and like effort in
the right direction, it's really
important. So, uh, that questions
document we link on Discord is super
important to be able to effectively
contribute and make progress on these
things. We should consider officially
adding support for a car without radars.
Uh, we do uh, but not with our own ACC
yet. Uh, so once our models are capable
of doing vision only ACC, which is right
around 1.0, um, that's when we'll switch
to OpenI Longitudinal.
Um, I can talk a bit about the other
highlights for 010 too. So, we've got uh
the MLS model is the highlight feature
and then the other things we've got
going on are um we've completely redone
the Toyota TSS2 launch to full tune
should feel way better at every aspect.
Um, if you're disengaging and stop and
go, go ahead, feel free to yell at Shane
on Discord. Um, that should be
completely fixed now. Um, how's AB work
and ISP stuff going? Um, the ISP is
good. We save so much power, so much GPU
time. AB is still a work in progress,
but you could see like the Panda safety
1.0 milestone GitHub. Um, this is all
stuff you guys can contribute to, which
I think is pretty cool.
Um, like I was saying, we also improved
the Fords a whole bunch. So now they all
have Open PI Longitudinal by default,
which I think is a whole lot better than
their stock ACC, and then you can also
use experimental mode easily. Uh, we
fixed up the radar parser for that. We
improved the controls a whole lot. Um,
and we have a pretty good pipeline now
for improving longitudinal controls. You
guys can go on the Open DBC data website
and you can see the launch reports for
all sorts of cars. We want to
productionize that a whole lot more and
give you guys a nice look for tuning
launch to both the cars. I think it's a
lot more doable to do it in a
upstreamable way than lateral was. Um,
and then we also increased the steering
torque on the Fords basically to the max
we can EPS. So Fords and Toyota should
see massive improvements with master and
010.
Um and we have gas skating too which is
pretty cool. That's the first taste of
end to end uh end to end longitudinal in
chill mode. Talk a little about gas
skating what that does.
>> Yeah, gas skating I mean there's this
this really human in certain situations
you take your foot off the gas. You
don't press the brake. You don't press
the gas a little bit. There's just this
concept of coasting I think is a really
big thing in uh in driving. And so we
also have really good ground truth for
that because we know when people are
pressing the gas and the brake pedal.
So, we're using that to add the end to
end feature where when you when the
model thinks that this is not an
appropriate time to press either the gas
or the brake. So, coasting then uh the
the policy will be just to coast. And
you'll see this like when you come up to
a turn or when you come up to a red
light, you know, chill mode, it won't
stop for the red light, but it won't
accelerate into it. And this just makes
a lot of situations smoother where it
ends up instead of just accelerating
into something, you definitely don't
want to accelerate into into something
like normal ACC would do, it just kind
of lets off the gas and it's a more
enjoyable takeover. Um, it also helps
with coming up to turns and stuff like
that.
Yeah. So, that's a fully end to- end
feature. I mean, we just uh we just have
ground truth for when humans coast and
we let the car coast in those situations
and that works pretty well.
Anybody on the fence with the $9.99
price and uh not sure it's for them yet?
I'm curious to hear your concerns. It's
never been easier to install. It has
never been better. Um these devices have
never been better.
Can't wait for the new Toyota Behavior.
Uh yeah, you can try it out. Try out the
nightly branch. Um that's built just
like a release. Um you can install it
with installer.com.ai/nightly
or comma nightly. And then uh yeah, if
you if you want to you're still having
issues and you want to report them, we
will that's the top priority. We'll get
them fixed before the release, but it
should be a whole lot better or touches.
So, great thing so far.
Um do you expect to be cheaper in the
future? Not soon, but you know,
longterm, this is what we're working
towards. Um it takes a long time to do
this stuff. Um I mean, you guys saw how
we got to the 1150 price. That only
lowered 100 bucks, but we redid the SOM
entirely. That's a part we were buying
and we're building oursel now. We had to
set up a whole new supply chain for
that. Um, we had to FCC certify that. We
had to do a whole bunch of stuff. Um, so
it's a lot of work like that. We deleted
the RTC battery. We deleted a whole
bunch of parts. Um, so it's a lot of
this diligent work of, you know,
deleting the parts you don't need,
refactoring things, improving the supply
chain. Um, and I think it's a lot of fun
for the right kind of person. So if any
of that stuff sounds fun to you, uh, you
know, hit us up.
Um,
it is super easy to install. Yes, we
just shot a new installation video, too.
Um,
so we'll we'll show the we'll show off
the no common power. How much of the
common 3x hardware is built in house,
basically all of it. We take in PCBs.
Um, you can see in our our stream from a
couple months ago, the whole production
line. Um, but we built basically the
whole thing in house. We have a pick and
place line. We get pair PCBs. Um, we
built the camera modules ourselves. It's
all uh yeah, we're building a SM oursel
now. Uh we call it Lightning Heart.
We've tweeted about it a few times. You
can search it up. Um our SAMS actually
run a little bit cooler than the
ThunderCom ones. Um we moved we redesign
it a bit. Um so overall they're a little
bit better. You won't notice in
day-to-day driving, but um and the
aggregated statistics you you'll see
that they run a little bit cooler.
When KMA avoids the road cones, I'll be
a happy camper. Yeah, these new models,
the new MLS models are very reactive to
park cars. um cones and stuff like that.
You should really see this with the next
release.
Um Cana make their own magnetic mounts.
The problem with that is the connection.
Um
we'd be okay with it for the actual
mounting but not as a replacement for
the OBDC, which is I think where a lot
of you guys derive the value from.
Um
so no, that's not on the road map.
All right, we're almost back at the
office. Any final questions? Anything
you guys want to know? Happy to talk
about hiring Open Pile 1.0, the sale,
any hesitations anybody has about buying
the product?
Plans to sell extended warranties? Uh,
no, that failed horribly last time. We
can sell them cheaper now. 3Xs are way
more reliable.
>> One of our least popular decisions ever.
>> So, that was a very popular stream, but
we sold literally one warranty.
literally one.
I think you're the first person to ask
about it since then, too.
Um,
I don't know. Hopefully, it's at a price
now, too, where people uh aren't too
worried about this.
I mean, you guys remember that when we
launched the Comma 3, we lost money on
Comma 3s. Um, we lost a lot of money on
Comma 3s, so it was really, it wasn't a
win-win. Um, you know, if you're having
a good time with your Comma 3, you
really won that transaction with Comma
3X. It's it's a real win-win. Like some
of our our Chinese vendors like to say,
win-win cooperation only, please.
I have two concerns. All the demos that
I've seen do not much difference to
driving. Okay, so the way to think about
it is like, do you prefer having CarPlay
over your Bluetooth audio and whatever
maps your car has? I mean, they
functionally do the same thing, but you
vastly prefer the CarPlay. Uh, the
driving is a lot like that. I think we
offer a very similar amount of value as
CarPlay right now. Um, so I'd recommend
just trying it out and retiring if you
don't like it.
Um, it's not an FSD experience. You
know, FSD is very cool. It's a very
featurerich thing and it's super
gimmicky, but if you actually talk to
people who have SSD, a lot of people
don't use it in all the situations that
it works. Yeah, we're really trying to
build just a convenience feature.
>> We can see gas getting trigger here
actually. So, we're taking an exit. You
see the path go great.
This is actually an area where it
triggers very reliably. It's not doing
much because there's a lead, but if
there was no lead, it wouldn't be
flooring it still. Um, it would just
coast smoothly. It's a lot more chill.
It was ETM 1.0 before the end of next
year.
>> We're not going to go as far as say uh
you can call us liars on that one.
Um, but yeah, as I was saying, uh, you
know, we're really just building
something that makes your drive more
enjoyable. It's like cruise control, but
just way, way, way better. And, you
know, the the fact that over 50% of
miles driven by people that have a 3 or
3X installed is driven by open pilot
kind of shows you how uh how much it
adds to your drive.
>> I think anything under $1,000 is super
attractive. Yeah, the the plan wasn't to
do $999, but we were so close, so we
thought, you know, let's get to the
three digits. Um, so we're really
stretching ourselves with this one, but
um, you guys clearly love the price.
We've sold over a thousand this month,
so uh, it's going really well. This will
be our best best month of sales ever.
What about selling refurbished or
returned commas at a reduced price? Um,
we don't have really enough to do that,
but you can go on the for sale channel
and and get one for reduced price,
though.
I I'm not sure there'll be a better deal
than buying it new.
>> Here we can try the person was talking
about the cons. I'll try to drive
straight at this and see if it fixes
itself.
>> It's really good at this now.
>> Yeah.
>> Yeah. Let's see how it does with this
car up here, too. It should navigate
this quite smoothly. Yeah. See, it's
moving over to the right a little bit.
Back.
>> Yeah. And you can see, I mean, it's
driving over a lane line. This lane line
makes no sense. And it's seems to be
doing just fine with that.
And here I can make it steer directly
for this car again and see it'll fix
itself immediately.
>> Yeah, this is one of the things that ML
Sim is is much much better at. You just
have to nail the stuff that uh previous
releases were very reliable at and I
think will be a significant upgrade.
>> Once 1.0 releases, will things move away
from Discord? Why would things move away
from Discord?
We're not going to like close source.
Nothing changes at 1.0. The thing that
changes at 1.0 is open gets better.
That's that's about it. It's not like,
you know, we're going to drop the MIT
license and go sell it to Honda. Um,
it's all the same stuff. We're working
on improving the driving. Maybe it'll be
time for robots.
Is there a new hardware plant soon?
Hence the lower. We spent all year
improving the 3X
so that we could lower the price and
give you a great deal. I spent a lot of
time on this. Rob, Eigor, the hardware
team, u production team, u making them
easier to build, working on the supply
chain, uh, making lightning hard Um, we
didn't do all that stuff such that, you
know, we can drop the 3Xs
um, like this. We're still building tons
of them. We're building more than 300
every week. Um, and we'll continue to do
so.
How does combat compare to what
manufacturers are currently using? Um,
it's exactly like CarPlay. Do you like
using your car maps and Bluetooth audio?
Um, bought it C3 at 21.99 on release
date and mind-blowing.
>> Yeah, it's pretty cool. These are like
real engineering wins. It's not like a
fake price. we raise some money and
we're going to lower the price. Um, it's
very real.
>> I mean, yeah, the what car manufacturers
ship with even today outside of Tesla is
all really quite terrible. I mean, you
can try it. Try try Open Pilot and try
>> actually. So, this guy with a Lexus LS I
drove with Tamate in an LS recently.
That's pretty decent, actually. It's
similar to HDA2. Some of them are
getting
>> tried that. I mean, HA2 I didn't like
that much,
>> but it's also similar to like, you know,
the infotainments are getting a little
better in the cars, too.
>> Yeah. Yeah, I mean the Kio infotainment
is not terrible, but it's still nowhere
near Apple.
>> Exactly. Friends don't let friends take
a long road trip without a comma. That's
true.
>> Navigate on OP. Yeah. I mean, we we
scrapped Navigator and Open Pilot
because we wrote a lot of hacks to make
it work as well as it did. And even with
that, it didn't work that well and it
was a huge bottleneck in in improving uh
in making MLS work. Once MLS works well,
we can revive um Navigator on Open Pilot
and we can do it in a way more endto-end
way. You would not believe the hacks
that we wrote to make navigate and open
pilot work that well. We really just
want you put in the video, you put in
the video of the map that the human
would be looking at and the model has to
figure everything out. That's the dream.
That's how this should work. Uh but that
wasn't really possible because uh
because of all the limitations in the
training stack. So once we revive it, we
expect it to work way better.
>> Any idea if Bluetooth is on the road
map? No. Hardware is there. Should all
work. If you want to bring it up, we'd
merge that PR if we can just click
merge. I'm not going to spend any time
testing that. Um though, if you're
capable of doing that, there's a whole
lot of bounties for interesting stuff
like getting the boot time lower. Um and
that's a great way to get an internship
for a job. Um
>> monthly active is like 10,000 maybe,
maybe more.
>> No, it's more than that. It's like 15
>> 15,000.
>> Yeah. But we don't see a whole lot of
them because of uh they run forks that
don't upload to us, which is fine. Your
device is your device.
Uh Tesla, it actually works quite well.
Um Lucas who used to who did an
internship here, he sells harnesses. Um
he calls it what did he call it? Harness
and chill or something. Crimp and chill.
I think it's pretty funny. Uh Lucas is a
cool guy. Um
yeah, I think we're reaching the end
here. Um $9.99 get in today. We added a
little countdown. Sale ends uh Cyber
Monday
to extent super easy as a senior back
end. Yeah, it's super easy. You don't
need to know anything about hardware.
Um, just join the Discord. Um, hang out.
We want to make it really, we we're
working on docs and stuff for this. It's
getting time for that. Open DVC will be
like a very finished projects pretty
soon architecturally and it'll just be
about extending car support. Um, 15K.
Yeah.
Um, ES Sport normal eco effect OP long
anyway. It shouldn't. I'm not sure. You
can run our longitudinal test report.
It's super easy now. Um, oh, we can't.
We're on nightly, but uh, it's in the
developer settings now. We have our
brand new developer settings. Uh yeah,
we'll be at CES. If you're there, stop
by and say hi. We saw a lot of users
last time. A lot of users too from like
Nissan and like Aptive and these
companies. Um it's pretty funny.
>> Okay, cool. I think we're good.
>> Any uh final words?
>> Uh no, no, my final words is just Yeah.
production team and hardware team did
their job. They made the device cheaper
and more reliable. Now it's uh now it's
our team's job to uh to get you much
better driving. You know, I'm hopeful,
but like I said, we're at the cutting
edge. It's hard to predict the future,
but uh I'm I'm I'm pretty optimistic. If
you see the last the last part of our
drive here, you know, that's that's
where we're starting to see improvements
from MLS Sim. It can reliably drive
around cones. It very clearly sees
obstacles in the road at low speed, that
sort of stuff. So, I think we're getting
there.
>> Yeah. It should feel like a real like
chaty BT 2 to three moment.
>> Exactly.
>> Mainly selling. We'll sell wherever.
>> Hope Okay, cool. Think that's it. 9999
commi jobs if you want to come help and
uh make the 999 price real eventually um
or work on autonomy and ship MLS models
open pie 1.0 um just looking for good
engineers.
All right, thanks for tuning in guys.
>> All right, see you guys.
except better we get some quality issues
with the previous one I feel sometimes
periscope doesn't like try to up
bandwidth enough again may add a nursing
so what your people join so quickly but
it's a quality better dad tell me is a
quality about it by the way I can go to
Twitter or get Jack let's go to Twitter
how much better guy shave know either
you guys know instagrams facebook bros
but you know what new respect from Mark
Zuckerberg um okay cool I'm glad it's
better is it much better I'd say well
that's so good okay nobody can complain
right now you have broken now you have
broken stuff flip the orientation yes if
you're using a neo case you are
all right kissing screen now that's Jeff
whatever make sure it's good if you've
joined the Wi-Fi Twitter's interface
saves the bit right that's so bad yeah
look we're watching myself on the scope
II that's pretty good I don't think we
can complain about that all right cool
let's go through the code um this is 0
for 4 are the biggest news is your yawns
are flipped if you don't have something
flipped you're gonna be very sad I see
you know we have the neo to Aeon trading
program ridge line support thanks to
energy optional front camera recording
increased acceleration the new
onboarding screen didn't make it in and
Neos are no longer supported so maybe we
should put a sad face next to that one
but it is sad so maybe we'll check it
with a sad face all right cool this is
the diff we added in a bunch of crap in
cereal car Kathy Eppie none of that
should matter never to you guys so you
can see the screen better cereal car
caffeine pee we added in a bunch of
crappy air I'm gonna rotate you back
this is too hard
front cameras are now recorded we have a
third MPC you guys aren't really using
that and on the whip thatis we added in
the fingerprint for the bolt so we've
pulled the voltage or our internal code
we're thinking about buying a GM next
week and doing the port record front is
now an option so this is just an option
and our usual options interface I
refactored the fingerprinting stuff bit
so if you guys remember this is what it
used to be to add a new car I don't have
like all these like try caches and stuff
so I just
refactor that to that what about bolt
yes the part the boldest of ACC it only
has L casts where do you store all these
cars we let the employees drive them you
guys tell us to worry about any of that
you're not using angle control
know why that wasn't in there I'm not
really understanding why that changes in
there you guys have to worry about that
so notice the orientation is no longer
three it's now one the version was
bumped to 0 for 4
he used to be 0.32 now it's over for
bunch of improvements to the vision
stream API that just clean up better we
added a streaming for the front camera
so it can be recorded and oh we've
changed it um so it's not just always
keep hands on wheel anymore
it's always keeping hands on wheel and
eyes on the road uh just you know pay
attention recall my buddies gonna be
here in 30 minutes it's perfect timing
if you clean up to the MPC don't use
divide the vines are evil we don't use
divides its yeah a lot of a path right
in Python I'm since it generated code
I'm very bad oh the uploader change um I
mention that Mia release notes oh I
should mention that the release notes oh
okay I'll make sure to add that um so
the upload are no longer uploads over
cellular if you turn off upload routes
over cellular so you guys can put a sim
card in your eons and they won't waste
tons of data anymore not that it's a
waste but if you don't have unlimited
data and now should use open pilots
should use like like a Megan our I'm so
that should kind of be no problem the
flippin Aang that's therein manager yeah
t-mobile unlimited data that's where
it's at um so note that 0 here record
front is disabled by default so it's
opt-in it's not opt out evident in code
ID acts added a new maneuver to the
tests a couple bug fixes to the UI and
the new updater okay yeah so the updater
is going to
ask you before it installs an update we
learn we improve every day we get better
we drive all right scobie's that's been
zero for for um any questions don't
limit any audible for old cars I don't
care
oh you mean even New Model T whoa whoa
whoa whoa don't want me to introduce you
to the map team last night can you see
the front video so we don't actually way
to do that we'll see what we are going
to launch first is an attention report
that you'll be able to download for your
routes the third video is completely
optional don't opt in if you don't feel
comfortable doing it what does NPC NPCs
model predictive control
no no world war three guys though
though I do have seven days of food and
water in my basement so maybe that's why
I'm a little less worried than the rest
of you it sucks you know but just just
live your life and try to do your best
at whatever you do unless it's bothering
people in the above all anybody that
kind of sucks additional point five
common points at release yep that's
already in the back end I believe we're
also the infrastructure engineer
starting Monday so he wants to make
himself known to you guys but if he does
what time it's gonna drop them like an
hour we're gonna wait for Andy to do
something and we gotta wait for Ricardo
to do the final test and if those two
things are good then we would
orientation Three's old code orientation
one is new code
alright scobie's thanks for joining
I think through the night throw at the
release I'm sure you guys do too but the
release will go out about 30 minutes
we'll tweet about it on Twitter
0:44 is gonna be nice and we're gonna
just we'll just going into valve but
we're trying to push that to release you
have a good weekend to spell by 32
ladies
You're not on Wi-Fi, right? Oh, uh, no,
I'm not Wi-Fi. We're good.
Still no comments, though.
>> Oh, there we go. All right, cool. I got
comments. We're connected. Tesla's
literally the best option.
All right, welcome, guys. Happy 4th of
July.
Uh, got Harold's here.
>> Hello.
Our beautiful Model Y.
and we're going to show off uh Comet 3X
on the secret good open pilot branch.
>> We're trying to merge,
but uh got some final kinks to work out.
Discord users have been pressuring me to
merge it, but uh
fortunately we got to wait for no
regressions.
Hi from Morocco. Oh, what's up? What's
up? Fashionably late. I think we're on
time today. Yeah, it's 1:31. We're on
time. We're on time.
Uh, all right. How do you guys like the
sale? $7.99. It's pretty crazy, right?
>> All right.
Okay. I'll start in chill mode here and
then we'll switch over to experimental
mode in a bit.
So, this is the latest and the greatest.
This is what's in the paper. So, now
when people ask how it works, we can
just refer them to the paper. We can
refer them to commonai/shop and they can
experience it for themselves.
>> That too.
>> Uh we got a lot of people asking about
George. George is around. He's just not
in the car right now. Uh a new release
already. Yeah, we're getting the release
cadence up. Uh so we just shipped 099,
the second release of the year. This
we're hoping will go in 0910. Um and
this is the two model. It's the first uh
>> MLSM style model we'll ship.
showing off in the best possible
scenario. I don't know. We just like got
off the highway near the office. What
kind of scenario do you want? What do
you want?
>> I mean, also this isn't a demo. You guys
have the devices. You can buy the
devices. It's not It's not like we're
trying to
>> A lot of people think
>> you just look like it's the best light.
This is not a demo.
>> No, we just we added support for Tesla
recently. We want to show off the Tesla
and the new model.
Uh does it follow Tesla nav? So, this
has no nav right now.
Um, but for a reminder, we want to we
should remind people what Secret Open
Pilot is like at a high level.
>> Oh, you want me to explain?
>> Yeah.
>> Um, yeah. I mean, so that's one of the
biggest refactors we've done to them
all. So, secret good open pilot is just
a branch in open pilot where we're kind
of trying out our new ML architectures
um before we ship them. These kind of
really big architectural changes are
really hard to ship because, you know,
they affect some cars differently that
have weird controls. So um it's like
pretty stable and we're iterating on it
but it's just not ready for master. So
that's why we keep it in a separate
branch. And um as for like what's
different about it, it's basically the
architecture that we describe in the
paper. Um so we have a new way of
supervising the plan uh that the model
learns to to drive the end to end plan.
Previously we had some somewhat
classical planning parts in the
algorithm uh like MPC that were uh kind
of taking where the model wanted to go
and then kind of planning a trajectory
there. Now it's um even more end to end
in that we just have uh like some kind
of supervising model that uh predicts a
recovery trajectory and then we have
this small model that's running in the
car now that we train to mimic uh that
that recovery trajectory. So, it's a
little bit more end to end than what
we've shipped in the past and in many
ways it's much better. Uh, it's
generally just much smoother. It's much
better at like taking clean turns and
especially at larger turns at low speed
and stuff like that. Um, so yeah, you
can kind of see that it's also much
better at experimental mode. I guess we
can we can toggle that.
>> Yeah, let's try it. Let's try it.
>> The set speed all the way up. So, the
the experimental mode that's in release
and master, it's first of all kind of
jerky and also it doesn't reliably
converge to a reasonable speed on the
highway. they'll frequently just go way
too slow or sometimes too fast. Um, this
isn't perfect, but uh I think it's
usable now. I think it's it's usually a
more comfortable experience than just
using the ACC policy. Uh, which is I
mean that's a really big step forward
and that's a big reason that we're
trying to ship this new architecture.
But even taking a further step back, so
all the models you guys have driven on
to date, unless you tried out the Master
stuff from a little while ago, um we're
with this one stack that we kind of uh
squeeze all the performance we could out
of it. And this is an entirely new
stack. Um and which will be kind of the
stack of the future for the next few
years at least. Um
so this is why this is particularly
exciting. Um it'll lead to a whole new
generation of models. Um, and you can
already kind of feel how how much
smarter they are. Like they had seems to
have a better understanding of the
scene. You can really see this around
complex scenarios where there's um like
no lane lines, some oncoming traffic, um
some parked cars. It'll really dodge
parked cars. Uh
yeah, to give some concrete examples
like the Taco Bell run, we had to modify
the MPC planner to allow for some of the
sharper turns that were necessary. So
that was actually not uh you know the
release planner. If we tried to do the
Taco Bell run on on master today, we'd
run into some of those issues where the
planner would prevent the car from
turning aggressively enough sometimes
and that's completely fixed with these
models. These models don't have an MPC.
So, um you know, this this model should
be able to do Taco Bell run if we added
nav back without any other changes. So,
that's you know, one small step forward.
These models also the the supervising
model is what we call the world model.
You know, that's what all the kids are
talking about in ML. So, this has got
some of the the new fancy stuff.
>> All right, we got a bunch of questions.
Uh, so people asking about like these
Tesla specific things. The Tesla is just
like a normal car, Open Pilot, except it
has like the you get more like steering
torque. Um, and the gas brakes are more
responsive. Other than that, we don't
use the cameras. We don't use the nav.
There's no like special Tesla features
in open pilot.
Um, we're not driving with external GPU
right now. This is all on a 3X that you
can buy right now from Kai/Shop.
>> This is cheaper than ever. inflation
adjusted. This is such a good deal.
>> The first digit is a seven. I think the
last time that was true was like the Eon
Gold maybe like really back in the day
before like I even worked. Uh so we're
very happy. The hardware team's been
cooking. Um been working on supply chain
refactoring the 3x getting the cost
down. Uh so
uh we're very happy to get the the
normal price down to $9.99. Very happy
to be able to offer it for $799 uh right
now.
>> Yeah. Yeah, it's a real testimony to the
uh how much good work the hardware team
has done that you can build these
devices now for like it's not it's not
like we're just reducing the profit
margins. These devices are actually
being built cheaper and the end product
is better uh than they used to be. You
know, a comma 3 is not as refined as a
3x and at the same profit margins they
were costing three times the price. Uh
you know, it's really crazy what you can
just get by just engineering. None of
these profits come from outsourcing
anything to some cheap labor country.
It's all just engineering improvements
from the hardware team in house,
>> which we're growing. By the way, if you
want to build hardware here, we have a
good challenge. Um, if you're not sure,
you know, whether you have the skills or
not, um, the challenges are the best way
to evaluate that. Um, go check out the
hardware challenge at comai/leerboard.
Um, all right, I've got a couple good
questions. Is there more risk of Tesla
firmware update causing problems? Uh, I
mean, more so than other cars, mostly
because they ship more updates. Most
cars, they don't really ship substantial
updates to the car at all. The Tesla
does. Um, but people have been driving
around on the Model 3 and Y with open
pad for at least a year and there's been
no problems. Um, we don't really foresee
any issues. Uh, Model S support, I think
the hardware for Model X will get merged
for the next release and then the Model
S probably isn't that different. Um, I
don't know. Go check on the Discord. Um,
Snapdragon 845 till when or doesn't
matter. Just plug an external GPU. Uh,
yeah, it really doesn't matter. We don't
use all the A45, but still if we used
all the A45, um, or if we had some like
more modern Qualcomm SOC or other mobile
SOC we can put on the windshield. Um,
it's not even going to compare to a GPU.
Um, so the external GPU will give us
more processing than like Tesla SD has.
Um, so that's why you want external GPU.
Um,
but yeah, I don't know. Stay tuned for
external GPU announcement soon.
Uh, virtual torque blending yet? No,
this doesn't have any torque blending,
unfortunately.
>> But who needs torque blending when it
does make mistakes?
>> I mean, that's how Tesla thinks.
>> Yeah, torque blending would be nice.
>> Oh, you have open pilot on a 2023 Model
S Plaid. Oh, cool.
Has anyone taken advantage of the sale
yet? We've sold uh over 300 devices
already. Um been quite a successful
sale.
Can I turn on the AC?
>> Uh yeah, let's turn on AC and see if it
uh it's okay.
>> Wait,
>> uh should we try a little bit of driving
the city like around La Hoya here with
the bike?
>> Laoya Drive?
>> Yeah. Yeah, we can do La Hoya Drive.
>> Okay.
>> Yeah, let's see this. Check out the uh
nice Mormon turf.
>> Um
>> we'll see how experimental mode does in
the city with these TR models.
Yeah, it's only using the the open pilot
cameras. No Tesla cameras here.
>> Be hard to lane change on the Tesla.
>> Uh yeah, I think we won't do uh many
more demos like this in the Tesla.
Slightly confusing, I guess.
When I looked at the webdev replace
reaction, every PR stay out. Yeah. Yeah.
I don't know why people even bother with
that.
I don't know why people even bother.
It's so funny watching people try to
like game the jobs thing. It's like it's
we have these challenges just kind of
like filter. Do we want to have a phone
call with you? And then the phone call
is like do we like talking to you? Do
you like kind of understand what what's
going on? Um would we like working with
you? And then that that's the whole
hiring process. It's really not that
complicated. Um
yeah, if you think you know you can come
here and improve open pilot and improve
the product, we'd love to we'd love to
have you
just try one of our challenges. Can you
explain how MLSM improves the models? Um
yeah, Harold, you want to explain that?
>> Uh yeah. So there's kind of two
different things. One is what we're
trying to merge now, which is called TR.
>> Well, maybe we should give them the MLS
blog post link so you can get some
visuals first. So if you head to
blog.com.ai/Mlson AI/MLSIM,
you'll see a bunch of nice visuals. Um,
you can ignore it. It's it's pretty
technical. If you want to ignore that,
you could you can read it, too. Um, or
you could just look at the nice visuals.
Um, and that'll kind of explain um in
the best way like why we're limited by
the old architecture.
>> Yeah. But just to put it, I guess, in in
short words, there's two things we want
out of MLS Sim. one is uh the recovery
trajectories which these models have and
then we want to get the images out of
the simulator too. Um and so now we're
just trying to merge the recovery
trajectories and then after that we'll
do the images. And basically why this is
a big deal is to teach the model how to
recover from mistakes and to make a
robust kind of noise and different car
controls, it needs to be trained in
simulation and we need to introduce
noise in that simulation and have the
models recover. And so we need to be
able to deviate from normal videos and
kind of simulate small deviations from
normal driving video. And now we do that
by estimating depth and then reproing.
Um but there's a lot of issues with
that. You know, you can't repro certain
things like reflections and light
effects. Uh our depth estimation is not
perfect. There's all sorts of issues
with that. So if you can have some kind
of ML model that can simulate deviations
from any kind of video, um you can just
get much higher quality. And that's the
biggest thing holding back the
intelligence of the malls. Now it's not
the compute on the device. It's just how
much capacity we can give the malls uh
before they start kind of focusing more
on all these artifacts of the simulation
as opposed to um
>> basically put simply the s like the
scenarios where open pilot doesn't
perform as well as you want it to look
really crappy in the current simulator
and the new simulator they don't look
crappy. Um so this is like kind of the
fundamental crux of the whole thing.
>> Yes.
>> Like it doesn't look at all like the
real world. you like might be able to
know what's going on, but in some of
these scenarios where you're making like
a 90° turn, it doesn't look at all like
a it doesn't look realistic. Um, so this
is like kind of the fundamental thing.
If you go to blog.com.ai/mlsim,
um, you can kind of see what these
pictures look like when you deviate from
them. Um, yeah, and if you're interested
in more technical stuff, there is a full
paper that I think is pretty
descriptive, uh, with basically
everything. And there's of course
there's open by branches that implement
all the things in the paper. Um, so
everything's there for those who are
interested.
>> Uh, yes, I do phone screens. Harold does
phone screens. Um, it's not like, you
know, there's not like 18 layers of
management. Um, you talk to one of us.
Um, and it's it's real straightforward.
My calls are particularly quick.
Usually, it's like 10 15 minutes and
it's pretty clear will they be a good
fit or not. Um, we're pretty fast
through the whole hiring process. So,
for a reminder, we're now in the city
driving around La Hoya. Um, we're going
to see how experimental mode works in
the city. So far, it's been pretty
smooth. Hopefully, this lead car will go
so we can do some red lights on our own.
>> Yeah. Does anyone have any feedback on
the TR models? I don't know how much
overlap there is between the uh Discord
testing community and the uh
>> when will we reach 1.0? Uh, so 1.0 is
basically when experimental mode is in
chill mode.
Um,
we've put timelines on this before. Um,
it's an open research problem. We'll see
when it pans out. Um, but these models
are the biggest step um, we'll have
shipped if we're able to ship these for
the next release, which will be next
week. Um, so that'll be a very positive
sign for 1.0.
>> Yeah, just to add on that, this is
really is an open research problem. Like
a lot of people are very interested in
training in simulation like we're doing,
especially world model simulation.
>> Wait, this is very smooth.
>> Yeah, I know. You know, it's good stuff.
>> I If this was any other car in any other
model, I would have had to disengage
here. This was incredibly smooth.
>> I mean, the Tesla is is better. But but
generally, these models are just much
smoother.
>> That was really good. It didn't break
earlier or anything. There's lots of
things to get confused confused about on
the scene.
>> Yeah. No, these models are substantially
better.
>> This is totally vision only, too. That
was actually really good.
>> Yeah, this is vision only.
>> Yeah. I mean, this is not that easy like
to comfortably plan around these turns.
I don't know if you guys see this.
There's no lane lines or anything. Um,
this is not that easy of a scenario.
These models, you can really feel how
how much smarter they are in these
scenarios.
>> Yeah. Let's see what it does.
>> I'm even slightly confused here.
>> What's going on?
>> Yeah, the humans are confused.
>> I don't know what
>> Oh, just kind
>> I don't think we were supposed to go
this way. I think our lead's uh
>> Oh, our lead was wrong.
>> I think our lead was wrong or the bus
was wrong.
>> You think I was in a turn lane?
>> It was not clear.
>> Definitely not indicating if it's true.
>> Yeah, this is really not that easy.
>> Okay. Oh, I thought I was doing the
correct.
>> I don't think we're even in a lane now.
No, we're definitely not in a lane.
>> What is the lane then?
>> It's over here where those guys are.
Yeah, this is the lane.
>> Okay, guys confused in the same place as
we do. I guess that's fair enough.
>> I mean, yeah, you guys can see how
nuanced these scenarios are. So, now we
placed it in the right spot and it's
holding.
>> Um
>> um yeah, no, this really is an open
research problem.
>> Somebody says there's not enough noise
in the real data. Wouldn't you use a SIM
model reinforce the bias? When using a
sim model, reinforce the biases of the
simulation.
>> Um,
not sure what that means.
>> Reinforce the biases. Maybe using more
of like a classical simulator and it
wouldn't uh
>> What is this guy doing?
>> Yeah, this is Okay, here. This is
>> finally on a unconstruction.
[clears throat]
>> But that was a good stress test. I would
say it didn't do too too poorly.
>> Uh, yeah. Yeah. I mean, I'm still not
really sure what what happened to that
lane, but um
>> um but yeah, this is the most
comfortable experimental mode I've
experienced so far.
>> Yeah, the main thing is just that it
gets to normal speeds reasonably. And um
>> does Tesla have radar support? Uh no,
this car does not have a radar. If it
did, we'd parse it out, but this is
totally vision only.
And it's actually quite comfortable.
Hardware three or four with Tesla
harness, Tesla A or B? I don't. Is that
a question or a statement? Um, the
hardware four harnesses just came in, by
the way. They came in yesterday, so they
should be on the shop in the next day or
two. Um, and all those orders should
ship out if you have a car that requires
that harness.
Tesla steering accuracy/ping pong issues
better than other cars. Uh, yeah, the
steering is great on the Tesla.
Surprisingly though, the Tesla does not
have the most torque in our fleet. Um,
some of the newer Hyundai's exceed the
ISO limits, which is pretty scary. on
the stock system, they'll let you exceed
the ISO uh torque limits. I'm not sure
if Hyundai even knows this. Um maybe we
should post about this. This is pretty
uh pretty insane, but the Tesla will
give you exactly the ISO limits. Um
and we we use the we're use almost the
full extent of them.
Uh somebody says that was a right lane.
That was a right turning lane.
>> Yeah, that might have been true.
>> Oh, yeah. I mean wasn't indicated but
>> uh yeah so if we did have the radar it
doesn't get uh passed to the model yet
uh it kind of get it gets matched after
the model the model outputs the leads it
gets matched with the radar we mostly
use the vision data um but we use the
radar to refine um some information
about the leads like the speed
>> all right where should we go here should
we go right
>> uh let's get some red lights maybe oh
there's very little chance of this right
now
>> get red lights Yeah.
>> Yeah. Somewhere like Little Italy would
be nice. Maybe we find somewhere that's
try this road.
>> Just go right here.
>> There might be some lights here.
>> Yeah. If we slow down enough, we can get
this red light.
>> Wow.
>> You can never get to Would you want to
test it?
>> It wants to.
>> Yeah. Anybody have any questions about
anything? hardware, open pilot software,
the research stuff, building 3X's.
I don't know. Is anybody not buying the
$799 is the best price um we've been at
in years. You guys remember when the
comm 3 was $21.99 to get in the door?
Um and you know, we we could not lower
the price much more. Um we kind of we
lowered the price as we could on that,
but they really cost us a ton to build.
Does the Tesla robot taxi suffer the
same ISO torque limits? Uh, likely yes.
You don't really need more than that.
FSD slows down a whole lot.
Um, if you really pay attention to it.
Yeah, I imagine they don't use
dramatically different software for the
robo taxi really at all.
Okay, let's see.
>> 799 is nuts. Yeah, I agree. Okay, here
we go. Red light.
>> Have a red light.
>> All right, that was smooth.
That's pretty good. Let's see if we stay
stopped.
>> Better.
>> Yeah. Okay, we're stopped. We're good.
We'll see how it goes.
>> Okay, that was a Tesla vision failure
with the uh the wipers there.
>> I lost that [laughter] a lot.
>> Do C3s work with upcoming? Yeah. Yeah.
So, all 3 and 3X work. We just use When
we say comma 3X, it's kind of a shortand
for the most part.
You mentioned Hyundai's. Is that on the
new models or even a bit Oh, uh, no, no,
no. The 2022 I think is too old. I think
when I was talking about them going
beyond the ISO limits, I think the EV9
does it or the Telluride Kia Tellide.
Maybe maybe both. I don't remember
exactly how much that E45 is being used.
So right now we use 40% of the GPU and
0% of the the DSP. Um there's so much
compute left on the A45.
Any signs it'll be up needed to be
upgraded soon? I mean, do you want it
upgraded? Do you like the 799 799 price?
Um, you know, if we upgrade the chip,
the price of the device is going up. Um,
so I don't know if you guys want that.
I
>> mean, I just think of the price of a
modern cell phone, a modern high-end
cell phone. Like, we're below that.
>> Can you make comma wipers? That might
actually sell some devices. All right,
we're going for the green light. Uh,
hesitated a little bit, but we're good.
Let's see if it comes up. I would say
this is I want to go a little faster.
This isn't bad, though.
It's a little slow. I mean, yeah, it's
not super fast about speed convergence.
It's just
>> But it is converging. It is pretty
comfortable.
>> To something. Where is it? Build
experimental.
>> I think this is comfortable so far. I'm
happy with the speed.
>> It's kind of fast.
>> Okay, now we're getting fast. Let's see
what it goes to.
So, now we're 55. I probably want to be
like 45 here.
>> Uh, let's see if it gets this red light.
Yeah, got it.
This is like an aggressive Uber driver.
>> That was like an That was maybe like FSD
hurry mode.
>> That was That was too aggressive.
>> But it didn't suffer from uh lack of
speed convergence. Uh maybe. I mean, it
didn't converge. It went the other way,
I guess.
>> Yeah, we can put in the speed limits in
the future. I mean, sometimes it's kind
of hard to see what like the speed
limits sometimes are useful. Even I look
at the speed limits sometimes
kind of figure out what kind of road
you're on.
comma does what tests. Uh I mean, you
know, FSC is really cool. How do you
enter the address for destination? Uh
open pilot at this time does not have
nav. It just goes and you point it
somewhere and it'll try to drive you for
as long as it can. Like that. Yeah. The
goal is kind of just to stay on whatever
road you're on.
>> It's a little slow. It seems cautious
through intersections.
It's just not very aggressive about
getting to a certain speed. That's
something we can we can improve in the
future.
>> I would say this is close to
>> Well, now I set the speed limit. So,
>> yeah, I'm curious what we'll get on an
empty highway.
>> Let me let me put the speed.
>> Also, this is our first time driving
experimental mode on this model on this
car. Um, you know, this is kind of a raw
experience.
>> We didn't test this shit beforehand. Um,
did you even drive on this model or did
like Cookie Monster drive on it? No,
I've driven on this like maybe once or
twice.
>> Okay.
>> But I mean, we know kind of what to
expect,
>> especially on the Tesla because it has
such predictable controls.
>> I have the older 3. What am I losing by
not having the new hardware? Uh,
concretely canfd, but if your car
doesn't have that, it doesn't matter.
Um, the 3X is just like a little nicer
like fit and finish, that kind of stuff.
Um,
but other than that, not not much.
like you you know you can decide to
upgrade if you want like the latest
thing but you you if you don't look at
the device ever think about it you you
won't need to upgrade
uh yeah all the games come in the
software um
will behave identically in Europe or is
the device and model limited anyway uh
we don't do any like Europe limited
limiting um half the training data is
outside the US right
>> yeah I think how about half yeah
>> yeah any differences in behavior will
come from like differences in the road
and stuff like this um but we we've got
a good amount of users in up. They're
quite happy with it.
What happened to model desire input and
nav? Um, so we removed nav to make more
progress on this uh new architecture.
Um, we're just trying to get to open
pilot 1.0 where all the lateral and
longitudinal planning are done and to
end, uh, we'll add nav back once it's
the majority source of disengagements.
Does the lane change work? If there's a
car on the side, uh, so if your car's
the blind spot monitor, it'll block it.
Um, but we require a nudge to confirm
the lane change is safe regardless. So,
you check that it's safe and then you
tell it, "Yep, you're ready to go." And
then it'll complete the lane change.
Keeps overshooting the stops at red. Uh,
it overshoots them a bit, but I wouldn't
say it's necessarily that bad. This
>> Yeah, that last one it overshot. The
other one was fine.
>> This is probably the worst failure so
far. It's kind of creeping up to this
car. Um, like it feels a bit uncertain.
>> Yeah. Yeah, I mean the priority with
merging these models now is just that
the lateral performance is strictly
better than what we have in master and
then after that we can put more effort
into longitudinal. Like I think the
longitudinal is already a lot better but
stuff like stopping at the right point
at a red light and stuff that's not
something we've spent that much time on
yet.
>> Yeah, you've noticed the red lights are
coin flip and longitudinal gets much
closer to the car in front than OEM. Uh
yeah, the latter thing is probably
because you don't have radar. Um, and
the smarter models should just deal with
this better. And then the red lights is
something we're trying to fix. We have
good tests for this now. Um,
once we ship these TR style models,
hopefully we'll see some pretty rapid
progress on experimental mode.
Yeah, it's just really a prerequisite
for a lot of the improvements that we're
looking at uh doing.
Oh yeah, the light is so good. Yeah.
Yeah. Yeah. You can really feel it. I
driven with SGO in a couple months and
uh drove with it for the first time
again the other night.
You can definitely feel the magic.
Defergeable. Uh yeah, the thing is we
have to evaluate this on our our worst
performing cars. Um and that's largely
the reason we haven't shipped it yet.
>> Yeah, the big problem car is our Ford
Bronco. They seem to have uniquely bad
actuator controls.
Whoever did that at Ford, uh,
>> we'd like to talk to you.
>> Was having a bad day.
>> We just want to talk. We just want to
talk.
>> We've looked at the data. It turns out
you did most of the cars correctly, but
for some reason the Mark1 14 F-150
and the uh,
>> Do they fix it on like the later model
years? We can check that, too.
>> No, it doesn't even seem consistent with
model years.
>> It seems like I don't know. Just those
two cars.
>> Do you think they even know? I
>> definitely don't know.
>> Yeah, they definitely [snorts] don't
know.
Stock ACC is usable anyway. Just wait
until you get like good ant
longitudinal. The way you guys prefer
the lateral over the stock uh lateral,
you're going to prefer open pilot ant
longitudinal. I don't think you guys
have any idea how good this shit is
going to get.
>> Yeah, it'll just feel more comfortable.
Like normal ACC feels great when you
have a a lean car that is clearly
visible, that isn't doing anything
crazy, but as soon as you start having
cutins or, you know, you're starting to
drive next to other traffic that's kind
of dense, um, you know, it doesn't do
the right thing.
>> Gund it for the yellow.
>> I mean, understood the scene. Let's see
laterally what it does here. This is not
obvious.
>> Yeah, it's dodging these cars. It's
converging properly.
I would have preferred it was a little
more conservative, but that was fine.
Yeah, I mean once we figured out the
bugs, we can look into like training
more on the better driver data. You
know, not everyone's always a good
driver. Sometimes people get lazy.
>> Well, this has none of the jerkiness
experience mode normally has. This is
quite good actually.
>> Yeah. Yeah.
>> Yeah, I know. We fixed that.
>> That's fully fixed.
>> Do we have numbers for reaction time
when someone cuts in front of the car?
Um, yeah. So, the N10 latency in Open
Pilot itself is on the order of like 70
milliseconds. So, we got that down a bit
in 098. Um, so 70 mconds is like quite
good. And then we can drive it down
slightly more, but then if you have the
model run longer, you give that up. Um,
so 70 mconds is probably kind of what
it'll be. And then, uh, you can see for
the different cars longitudinally. Um,
if you go to we have this nice little
repo called Open DBC data. Um, and you
can see all the reports for the cars we
have. Um,
and you can see like for your specific
car or if there isn't a report there.
Um, I'll show you guys in the developer
menu, you can go to uh,
sorry, go to uh, this developer menu and
you got to see uh, the longitudinal
maneuver mode. If you enable that, you
can run through this test suite
basically and get all these cool plots
for your car and it'll show you like uh,
how quickly it'll respond from a stop.
Um, that'll tell you things like if the
lead car pulls away, how quickly can you
expect your car to respond? Um, and it
kind of captures the full behavior of
your car longitudinally.
We're working on something similar for
lateral.
>> Now, should we uh make our way back?
>> Yeah, let's head back.
>> See,
>> no radar is scary at the moment. Uh,
yeah, in open pilot master it is, but
this has been pretty comfortable so far.
I kind of forgot this car didn't have
radar. Um, well, yeah, in
non-experimental mode, it's scary
because
the stock policy is not smart enough to
deal with not having good radar points.
>> You can't collaborate on long like you
can with lat. It's not quite the same.
Um, end dog helps a bit with this.
Um,
>> let's get back on the main road. Engage.
>> Yeah,
close call with that bus. No, not
really. Maybe it look a bit worse on the
video.
with this last bus here.
>> Yeah.
>> Oh, yeah. I don't know. Let's have like
3 ft, but I just wanted to make sure.
All right, we got like 15 minutes until
we're back at the office. Uh, this is
kind of guys last time for questions.
Um 090910 should ship next week um to
the staging branch. Hopefully, it'll
have the TR model. Um if not, it's going
to have this new feature. Um, for those
people who want this dash cam feature
where you can record the audio if you
want and it'll show up in your like dash
cam video. Um, we're shipping that
mostly for we're going to try to do some
like audio feedback stuff like where you
can give driving feedback via audio kind
of like Tesla does. Um, but we also
threw that in there if anybody wants it.
Totally opt in. Um, it's like the dam
default off and then you can opt in if
you want that um, for your own sake.
>> Wait, this actually kind of hard here.
>> I heard that you can't drive without
lighter. Um,
>> this uh, cone stuff. That's one of these
graphics.
>> Yeah. So, there's the secret lighter on
the the KA 3X. Um,
no, you can drive without lighter.
>> I can't believe people are still talking
about LAR after like SSD is [laughter]
pretty good. It's unbelievable.
>> Thought that would have been the end of
the LAR stuff.
>> Oh, man. Have you seen the new Wimos? I
was at SF last weekend and they uh
>> the Seekers.
>> Yeah, they don't look that great. The
Jaguars are so nice.
I think people are going to miss the
Jaguars
Tesla's angle base. Yep. Are those
improvements coming to Toyota angle
base? So, some of them are. If you look
in the blog with how we did the safety
for this, we can ship that for the
Toyotas, too. Um,
so some of these will come.
>> Yeah.
>> Yeah. Really big advantage of anglebased
control is that in their internal
controller, they have very low latency
on torque. So they can very aggressively
put torque on the steering wheel to get
to a certain steering angle, which is
something we can't do on the cars with
torque API because they have all sorts
of low pass filters and lag and all that
sort of stuff. So that's why I feel so
much better on cars that have decent
angle control to have angle control
steering.
All righty.
Oh, you saw a few amos in LA. Yeah, they
seem to be expanding. Um,
it's funny hearing their uh their
troubles with the map though.
Uh, you know, imagine you had to like go
remap your area with your 3X. It would
not be a good time.
>> Well, yeah, they would have had to remap
that area we got confused with the turn
lane and the bus.
>> FSD is surprisingly good with
construction, too. I mean, it feels like
a big Y loop. It's like, well, stuck at
construction, trying to just uh back out
and then go back in. Um, but it's pretty
effective.
Can you do some low speed turns from one
road to another to show improvements for
less jerking? What do you mean? I'm not
quite sure what you mean. And we showed
quite a bit of like pretty tight turns.
>> We're really not interested in stuff
like 90° turns. I mean, this is just
isn't this like a cool demo and it's fun
to show your friends, but like that's
not, you know, people who actually use
Open Pilot in a commute. Uh this is not
where their complaints are.
south, north, south.
Like we're really trying to focus on the
things that make Open Pilot a better
experience for the people that buy the
product. And you know, some of this
stuff is just really cool in demos, but
uh what you really want is just the
highway to be flawless and to deal
better with the tail end of cases.
Like you want really smooth slow down
for turn, really appropriate speed
selection automatically. That's the
stuff that would make people's average
commute easier as opposed to like being
able to do 90° turns, which is also why
we scraped nav.
>> Yeah. I mean, with Open Pilot 1.0, it
should really feel like on the highway,
you have like a person in your 3X, like
a real co-pilot
as if like, you know, the guy who's
remotely operating the Whimo is
operating your 3X. Um, that's that's how
it should feel. Um,
I think you guys are really
underestimating how good ant
longitudinal will be. Um, and how much
of a difference it'll make.
>> Whoa, you're distracted.
>> It's looking down. It's on my GPU too
poor hat.
>> GPU too poor. We got more GPUs soon. Any
use for red pandas anymore? Uh, I mean,
yeah, for development, they're okay,
but I don't know. If you're expecting to
like plug it in and drive better, you're
not going to get anything out of that.
Is it mostly just for highway type of
driving? Uh I mean that's where most of
the value in the system is right now.
Yeah,
>> I mean just for the people who are
listening that don't have this context,
the people who have bought our device uh
drive most of their highway miles with
open pilot. Over 50% of miles driven by
people who have a 3X installed uh is
driven by open pilot and it's about 20
to 30% of the time. though almost all
the highway driving and not all that
much of everything else. I think what's
realistic, what we can get to uh with
some improvements is we can do all of
the highway driving really smoothly,
really comfortably and probably most of
the city driving too. Um as long as it
doesn't include like you know 90° turns
or going into parking lots. Um when when
we uh when we bring back NAV, we can
start to do more complicated stuff. But
the priority is really first to get the
highway stuff perfect with end to end
long then to get like medium speed stop
and go red lights all perfect and then
we can look into nav again.
>> Yeah, it's like the goal is like human
on a highway. It should feel like a
human on the highway and it kind of does
right now if in very like some very
specific scenarios. But really, anytime
you have like a very clear lane, um e
whether there's like red lights or
anything, it should just feel good all
the time whether you have a lead or not
compute for level four or five. Uh I
mean, I don't know. You guys know how
much computer like Tesla SSD has, right?
They didn't ship a special car for that.
So, that's like a good bound if you want
to call that level four or five, but
there's like a guy half a mile away from
you who's watching you drive.
You need attention on the road at all
times. Yeah, we have uh a DM model that
checks all the time and if you pull your
phone out, you glance away. Um it's a
pretty fair policy. Um but yeah, you
have to pay attention all the time. Why
don't we consider less no attention
required? Uh we're pretty far from that.
Um I mean you guys saw on this drive,
you know, we had to disengage in in in
one or two more complicated places
before start thinking about that. But
the policy does relax. Um the driving
model kind of tells you like, hey, this
scene is a little more complex. You're
going to want to be a little stricter.
Um so we already do some of this, but
there isn't like a huge range right now.
When will we expect end to end long? I
mean, I don't know. Are you guys happy
with this drive? This is experimental
mode on the highway, and it feels quite
good. Uh
>> what is it going to do here?
>> Could you see integrate side cameras
within the next decade? uh
>> for the next decade.
>> I don't know.
>> Oh my god.
>> I mean, I know what we're doing this
year. [laughter]
>> As long as we have some master plan to
be like, "All right, finally time for
side cameras. It's
>> 2035. It's camera time."
>> I don't know. None of us thought it
would take this long. [laughter]
>> I mean, like guys, we'll add side
cameras when that's like clearly a
source of people's problems and it's
worth buying them and installing them.
But it's clearly not at that point right
now. We
>> we've done this in the past, right?
where we made people put like a gray
panda. We talked about the comtry, all
this shit. And then none of it really
panned out.
>> You don't want extra hardware for no
gain.
>> Yeah. Or even little gain.
>> It's going to cost you more in terms of
like dollars for the setup. The cameras
are quite expensive the device. And then
uh you know, you're going to have to set
it up. It's going to be janky. You're
going to have a wire.
It's not going to be a good time. And
it's not going to improve open pilot
today.
>> Also, we don't have wide enough field of
view. We don't use the full field of
view of the cameras now because of our
simulation strategy. If we ship the uh
ML SIM, we can actually put I mean
you'll get virtual side camera
basically.
>> This is experimental on the highway and
it's great. This is legitimately very
good.
>> It's the magic.
>> 799 is bananas. Yeah, it is. Uh we'll
see how long it goes on. We might go out
of stock at this price.
>> It's cheaper than an iPhone. That's
crazy.
And iPhones are built in the billions.
>> Yeah. Mount C3X on the side mirrors. You
don't want to do this. Your device is
going to be outside. You got to run a
wire. [laughter]
>> Not a good time.
Also, things will magically get better
when you install side cameras. You
actually got to do something
with the video.
Side cameras are just a new LAR. People
are finally getting over asking if a
lighter will fix things.
Now everyone's talking about side
cameras fixing things.
>> Yeah, when we drop radar, people are
going to be pretty upset, too.
>> Well, I mean, this didn't have radar, so
>> I don't I don't think we had any issues
since we turned on experimental mode.
That would have been fixed by having
radar. Only increase the FOV on the sim
block on MLS. So, we got to ship TR and
then we got to ship ML Sm. Yeah, we
can't do that because of the
reprojection. We need like some buffer
uh in the field of view to be able to
repro. So, we have to move away from the
reprojection strategy before we can do
that. But as soon as we do, we can uh
put in the full image and uh hopefully
get some improvement.
>> Okay. So, this is a little
uncomfortable. That's where you feel the
no radar.
>> Yeah, I break a little late.
>> Yeah, that still wasn't too bad.
Usually, it's a lot worse than that.
I don't know. What do you guys think?
Should we ship it?
ship it.
>> Well, we're going to go for a drive in
the Bronco after this and then uh we'll
see if it's shippable.
>> Broncos are problem child.
>> Otherwise, it's like a pretty decent
open pilot car.
>> Uh I mean, I promise you guys, like you
think these are all like low hanging
fruit and it's like, "Oh, Ko just
doesn't want to improve open pilot."
Like, Carol spent eight years of his
life on this problem. I've been a KA
like 5 years now. Like, we want to ship
things.
>> Wait, what is the low hanging fruit
they're complaining about? Uh, well,
he's saying like FOV will fix the low-
speed turn jerking, 90 degree turns. We
promise if it was that easy, we would
ship it. Like, we cover it every day.
We're sad about things not moving
faster. We want things to move faster.
>> We can't increase the field of view now.
Like, we're using all of it given the
fact that it's needed in simulation.
>> So, we are making MLM train models. The
problem is they haven't been good enough
to ship to release. Um, TR is a TR is an
intermediate. Um, so it has it's kind of
a hybrid of both stacks.
>> I'm just going to take the 63.
>> Okay.
>> Yeah. So TR is a hybrid of both stacks.
Um, last release we shipped the Fleo
Fish model um, which ported over the 5
FPS change. What we've been doing is
just like the standard strategy for a
refactor where you kind of break it up
into individual pieces that you can
ship. Um, and hopefully you just you see
if there's any regressions from that
individual piece and then you kind of
keep going down the stack until you're
all done until you've got MLS. So TR
will be like kind of the biggest
intermediary we can do.
Will radar still be using the N10 long
in the future? Uh, hopefully not.
>> No, definitely not.
>> Definitely not. One of the problems with
the the radar stuff is it also makes
things much more complicated on the
ground truthing side. like it's not
actually that trivial to use the radar
data. We then have to figure out, you
know, is a radar point relevant? Do you
want to slow down for this radar point?
Does this radar point match up with this
radar point right next to it? Um, all
that logic has opportunity for bugs and
also frequently has bugs. So, removing
it would actually be a big win.
>> I'm porting my car blah blah blah.
Left-hand drive. Uh, which car? And
then, uh, yeah, we don't have a lefthand
drive model. Are you talking about
device model or software models? because
both the device and the software are
supported. Um, it happens automatically.
So, totally supported. It has been for a
super long time. Um, left hand drive,
right hand drive, all the same hardware,
all the same software.
Just bought a 3X yesterday. Hopefully,
no comfor in a month. Uh, no, there's no
comfor in a month. Um,
we have so many E45s. We have so many
3Xs to build. Hardware team has really
been cooking on uh 3x production, 3x
supply chain. Um,
>> yeah, we really I think we're going to
be the the leading expert on the 845
extracting the maximum intelligence from
a chip. I mean, our models aren't, you
know, it's not it's not a level five way
or whatever level Whimo is, but uh per
watt, I am confident we are the smartest
smartest model in town.
>> Do you guys know how much we spend on
the driving model? We spend one watt on
it. One watt, sorry, 1.1. I don't want
to misrepresent here.
1.1 watt.
And then, you know, we have some watts
to drive the camera. or the whole device
draws like 10 watts.
Um, but like a lot of that goes to like
your fan, your IR LEDs, and a whole
bunch of other crap. Driving a display,
it has nothing to do with like the
intelligence.
>> Yeah, the environmentalist would love
our models. How many buckets of water
does one open pilot drive use?
>> Yeah, if you buy a 3X today, I think
you'll be very happy with it. This is
the best 3X we've ever shipped. Um,
which is kind of how it should be. This
is the best software we've ever shipped.
Um, we've got some real software
improvements on the horizon.
any EVs that perform well in the fleet.
I'm rocking my EV6, but I'm thinking
about I don't know. EV6 is good. The
Tesla is like a nice car. I like the
Tesla as a car. Um,
and I prefer open pilot with it than FSD
for my commute.
But it's kind of cool. You can try both
if you want to shell out for that FSD.
How many GPUs and how long does it take
to train the model?
Uh well, we have multiple models in the
stack. I think now we have
um where are we going?
>> Uh right now
>> um sorry I was distracted by the GPU
question. Well, we are GPU poor like my
hat says we need more GPUs, but we have
uh I don't know like 500 or something.
>> We have a whole lot sitting in boxes.
We're waiting to be assembled. Um
uh but yeah and then uh trains trains on
the I don't know some models train on
like maybe 100 GPUs some a bit more and
they usually train within 24 hours. The
world models unfortunately take forever
to train those we let it train almost a
week. We used
>> Oh I thought it was 3 days
>> or maybe 3 days. Yeah
I don't know. It could be 3 days. 3 days
feels like a week. We used to have a
rule that you're not allowed to train
models more than 24 hours, but then
these world models are just ridiculously
hard to train. So, we had to had to make
an exception, but everything else trains
within 24 hours.
>> Yeah. More compute. If you want to come
here and help us, uh if you want to like
work on infrastructure, um if you want
to work on the data center, if you're
like somebody who's like, you know,
maybe you're not a software engineer,
but you want to be like the data center
technician,
uh lots of opportunity. Um you know, we
run the tiny so builds all the tiny
boxes. Um, and Tiny designs and develops
and computers that go on our data center
like Tiny Box Pro. Um, so if you want to
run production for that, if you want to
design Tiny Boxes, um, you know, you're
real good at CAD, you want to like
design servers and stuff, um, we got
like custom PCBs in there. If you're
like a great hardware engineer who wants
to to do this kind of stuff, um, try
hardware challenge, check out
common/job.
Um, comput is getting quite important,
comput and data. Um so yeah, lots of
room for an infrastructure engineer to
come in and uh working on bringing up
ingestion, making stuff faster. Uh how
many how many tiny boxes do you have in
the compute cluster?
>> Uh so right now we have what three racks
of uh
>> yeah like
>> 490s something.
>> Yeah. So we have 3x490s. We're going to
stand up uh
some Tiny Box Pro V2s uh pretty soon.
Which car currently working best with
it? Uh, I just tried this one with
Tesla's pretty good.
>> The Tesla's a really nice car in terms
of a control API. They've obviously put
a lot of effort into it,
but we're putting all this effort into
making sure the model works well with
all the cars and is not a regression.
So, in the in the very worst case, you
will not notice anything being worse.
Um, but generally, you should notice
things getting better.
>> Yeah, most of these improvements
transfer pretty well. I mean, a lot of
the Toyotas are really good. Basically
every car that has decent angle control,
you know, it's it's very easy to make uh
the lateral improvements translate,
especially the torque and curvature
controlled cars that have more more
problems.
Um and longitudinally, uh we have to put
some effort into making it robust to
like some cars just have insane brake
lag when you request brakes or
acceleration lag, but um I think I think
it's a long journal is not as sensitive
to that sort of stuff. So, we just need
to deal with it better. And then I think
uh you won't even really notice the
difference.
>> All right, let's see how it does getting
off the exit. Hopefully we can do the
red light, too. Hopefully we get a red
light.
>> All right, it's not speeding up too
much. This feels good.
This feels good so far.
So far so good.
Yeah, when we get these new models in,
um, you know, we can really start
focusing on longitudinal. Longitudinal's
always kind of been an afterthought
because we've always just been trying to
move to new architectures that had, you
know, less less long-term bottlenecks
and stuff.
>> This is good. This is good. Let's see
where it stops. This been good. Uh, it's
going to overshoot a little.
>> Yeah, it was going to overshoot that.
>> I don't know why it does that. It
>> I think that's it though.
>> Yeah. Did you want to show anything
inside still?
>> Nah, we can do that later. We can do
that later. You guys can see the new
comma factory
a bit later when it's uh we're doing
some construction right now, so it's not
uh super clean.
Getting a second board line. I think
that's it. Call it a day here.
>> See you guys. Go buy your Comet 3X. Uh
if you're interested in making ComX's
better, making the software better, head
to comi/job.
um you know not sure if you'll uh if you
have the skills or whatever just try the
challenges um that is the best thing
we've come up with um to both evaluate
people and it's useful for evaluating
yourself um so if you want an internship
or anything hiring interns um year round
hardware software even operations
so i'm indeed i work on open pilot
and i'm going to talk about uh
mostly testing but uh as i've said
there's going to be a couple fun
announcements at the end
so
we're going to talk about
quality
and how we don't break stuff
because uh
opel is getting to be a big project
and
we support two hardware platforms now
with two different operating systems one
based on android and one based on ubuntu
we do roughly monthly releases that are
fairly large
this one in particular was a recent one
that was pretty large
um
this one
so these are a couple of releases that
we did recently um
they're pretty big um we have a small
team
we support 132 cars as of today
um
various brands
and we have over 200 plus contributors
in the last well since last january
um
since we went so we changed the
development style and we developed
publicly now
so how do we not break stuff
this is a commit from 2016
and we had a dream back then
one day we'll have ci
and then here we are july 2021
um so these are
some randomly sampled desks at the
office
and you'll notice
there are no common devices on these
desks
they're just computers they're built to
work stations
and
this is largely our development workflow
now
we sit at desks not on cars anymore
and
the answer to how we don't break stuff
is
we have automated regression testing and
um testing
we do hardware in the loop tests we do
offline checks
for long for anomaly detection and we do
online checks
on the device
so the testing goals for open pilot are
enforcing quality
reducing the time spent in cars um
as we showed with that picture on the
desks
and efficiently scaling a small team
because the open pilot team is about
three full-time people with a research
team that is now four full-time people
and we have a very concrete goal of a
thousand hours mean time between failure
for 1.0
so some of the automated checks we do
these are the public ones at least
we have a github actions test suite
that runs unit tests
this test process replay that's fairly
important and we do these car unit tests
that are
also pretty important
then we have um a jenkins server that
runs our hardware in the loop tests
where we have comma threes and comma
twos
um
going on road running real segments um
doing replays
and
enforcing things like are the timings as
good as we want
is the cpu usage exactly as we expect it
to be
things like that
and then uh you guys have probably seen
the online checks if you use open pilot
um sometimes you'll get a fan mail
function sometimes you've got a gps
malfunction
it'll say contact support and then what
people do
they go to discord but
when the alert works you should contact
support
we try really hard to make these alerts
and be very aggressive about it but also
um prevent the stuff from going out in
the field
um but yeah we do
some pretty extensive checking across
all the different services in open pilot
we make sure that all the services are
live they're healthy and their sources
for data are also healthy so if um
like one of the sensors is bad for
example this will propagate all the way
through the through location d through
the planner and controls will say okay
we can't engage now or we have to
disengage now
and then this is uh one of our
more important tests that run some
github actions
it's called process replay
and we can deterministically
replay
segments through routes or through uh
processes and we can take
the same set of inputs and assure that
we get the same set of outputs and if we
don't we generate these nice diffs as
you can see here
um
so this is a diff for one of uh
for actually the new model that we just
uh
tried to ship in 087 but
we had to revert
which will hopefully ship soon but this
is the diff that it generated um we
switched to
um
some different lead packets and stuff so
you'll notice the difference here it
tells you exactly what changed and we
can know
given two different commits um
what will the outputs of this particular
open pilot service be
did they change in the ways that we
expected
or did they not change so a lot of times
we'll do a refactor where we expect that
nothing changes
and this is pretty important because we
can do things like
we can review pr's really quickly you
read the diff you make sure the diff is
reasonable
you do your diligence there but if the
green check mark is there on github
actions you can be reasonably certain
that this did not change any behavior of
the tested open pilot processes and this
runs on all the driving processes
so there's six critical driving
processes and this covers all of them
and some other ones
then we do um some car unit tests
and these car tests are super important
for scaling to these 132 cars
that
we haven't really touched so we have six
cars in the office right now
we've probably touched somewhere in the
neighborhood of a few dozen cars over
the lifetime of the company
um but all the other ones come through
pull requests pull requests that are
fairly small but uh it's still important
to make sure that these cars work
because we sell devices we want to
ensure quality and
there's really no reason not to we
invested
quite a bit of time in making these very
reliable unit tests
and now we can be reasonably certain
that every car that openpile has a test
route for
functions to some degree we can't
we don't necessarily check driving
behavior but we check system behavior
will this car throw a can or will the
frequency checks work on this car
will panda safety agree with open pilot
because if this isn't true um
as you heard in robust stock the panel
will just block the messages
so this asserts some very basic behavior
and allows us to effortlessly scale to
the next milestone on cars which maybe
is 250 1000 cars
and then this is a part of our suite of
offline anomaly detection so we have a
pipeline stage called find interesting
that runs on all the incoming data
and this runs on those queue logs that
um anybody who runs open pilot uploads
and these are some tiny logs that we get
a lot of information about all the
devices in the field
um
we can
so this is
this is like a real screenshot from our
dashboards that we have up in the middle
of the office um
so you can see right now some of the top
errors are with um
some there's some panda stuff there's
some camera d stuff on the comma two
there's some a little bit of poor model
timings on release
and we have this cool iteration loop we
do with find interesting where
we aggressively
log everything that we
want that we expect to happen with
openpilot
and then we look at it and find
interesting and we look at the data that
comes in and if this isn't happening
it's going to show up and find
interesting it's going to be one of
these top things
oops
clickers are hard
oh yeah there we go
so you see that these panda errors are
dominating right now
a year ago it used to be overheats can
errors all these other things
but every release we look at the top few
things and we fix them and then you just
end up with a way more reliable system
when you're tracking the things that you
care about because if we don't track
these things they're going to regress
and this is our testing closet you may
have heard about it it's a little bit of
a strange name
but
the name comes from the closet it was
originally housed in
in the original comma house
and you can see
you can see some comma threes here
running different branches
um you can see some comma twos
um these comma twos are running an eos
update that was supposed to ship in a
previous release but that didn't make
the cut because of some things we found
find interesting that i'll show you in
the next slide um but this is how we
verify um something like the long tail
reliability in that
there's no reason open pilot shouldn't
just run if we if we connect it to a
what we call a jungle and this allows us
to essentially emulate the behavior of
uh being in a car and driving around
there's no reason it shouldn't run um
for days and weeks and months and
these comets here have been running for
a little over four weeks
so far um this was with obviously a
version of openpilot from about a month
ago but
we update these devices fairly often and
we
were able to be reasonably confident
about um the reliability and behavior of
these devices and it'll compile it
because of the data we get back from the
testing closet
here's some plots from the testing
closet these are diffs of consecutive
messages from different open pilot
servers so we have calibration d's
message we have one from d modern model
d
um we have one from the planner and we
have one from
the modern model d so these are four
different open pilot processes that
we're looking at messages from
we can see that the timings are
they're they're pretty good for the
planner um
they're a little bit worse for uh
the modern model d and then you'll
see the modern d and d monitoring model
d um follow because they're driven by
each other but uh
we can
assert some timings
as we can see in the next slide
so this is the
timings of board d so bordea is a
process that talks to the panda um in
your car so that's
you have
if you remember from robestock you have
uh your comma device the combat 2 or 3
now and you have the panda which is
built into the device but nevertheless
it's a it's a distinct device um
and we talked to it over usb on both
devices right now
and this timing is super important
because it drives the rest of the stack
the camera and the panda drive the stack
essentially
and that's why camera d and board d are
super important for um
latency and real-time performance so
if more g is performing poorly the rest
of the processes that
rely on board dr gonna perform poorly so
just controls the which is what actually
talks to your car
so we worked really hard to get these
timings
to the point where it doesn't miss a
cycle anymore
um
and then this is why we didn't ship that
neos update a couple releases ago
there's still a pr open for neos 18.
about a year ago we wrote this daemon
that fixes um
these random can errors where you would
get lags on comma twos
randomly where it would seem that board
d just wouldn't get would run
for
uh dozens of milliseconds and then
you get these lags
because of our strict online checks
so
you can see out in the long tail here
you have it lagging for almost 100
milliseconds
and it does this
um quite a few times if we go back to
the previous slide
it never does this so
this is some of the behavior we saw in
the testing closet
um
it was pretty important for assuring
that we don't ship progressions
and then we're hitting the targets that
we aim to
and this is pretty cool so we
all of the github action tests that we
run on our repo
you can run on your repo too we put the
effort in to the point where you can
click the fork button and then you click
allow actions
and you will have
a large portion of our of our testing
infrastructure running on your fork if
you're there's many popular fork
maintainers out there um who have
sometimes hundreds of users um and you
have all this testing infrastructure
that we've built up you can if you do uh
if you support cars that we're never
going to support for example the mosses
that have the steering lockout
we don't intend to support these cars or
at least claim
that they're an open pilot experience
but you can
you can reach
as much as you can like you can support
the car to almost the flow of stat that
we can um by using the test
infrastructure that we have and it's
really you click this one button you go
into the settings for your forked repo
and you enable github actions
now we're going to talk about panda
testing
so we have two goals for panda
it should enforce the functional safety
that we've defined for openpilot
and it should enforce the hardware
functionality um so you know you tell
the panda to send this canned message
it's just on the can message
so here's an overview of the testing
infrastructure for panda we do unit
tests again in github actions we do
replay tests where we take a segment and
it's very similar to process replay
where
we assert that the behavior hasn't
changed
from commit to commit
and then we do some static analysis
robot talked a little bit about mizra i
think in his q a and iso 262 um so our
unit tests and our stack analysis um
go a long way to cover the uh code rigor
that we have that we uphold in panda um
that isn't necessarily um a goal of open
pilot
and then we have hardware and loop tests
that run on the whole zoo so they run on
every panel that we've ever made from
white grey black uno dos
so
our safety unit tests are pretty cool
because you can write
all the functional safes you need for a
brand new carport and you can write a
test for it and on average the test is
about 165 lines um which is something
you can reasonably do in an afternoon or
uh or a weekend and you can develop
functional safety for your brand new
carport um
and verify the functionality without
ever going in a car or even doing a
replay
so i think this is incredibly cool
and we oh we have tesco all these cars
all these safety modes that ship and
open pilot release
and this runs for every hardware
combination of every car we support so
we sport 132 cars we support quite a few
pandas that's that's a lot of
combinations
and then we do hardware in the loop
tests um we assert things like can
latency can loopback
this essentially maintains that
if i send out a message do i get it back
um and we can do this with multiple
pandas we use um something i'll talk
about a little bit later the panda
jungle
we also do some checks with the car
harness that we're correctly detecting
ignition all this other kind of stuff
and then i want to talk a little bit
about production building devices um
because this is also pretty cool
george talked a little bit about screen
calibration
this is some of the stuff we've just
gotten to do because we've gotten really
good at testing these devices that we
can do the fun stuff
we'll go back
so after your comma device is built what
happens
so we flash it with neo s or agnos um
whether you have a comma two or three
we do some initial checks to filter out
defective units
and then we have this provisioning stage
which runs quite a few tests
and asserts all the hardware
functionality
that we design
our common devices for
and then we have a 24-hour stress test
um that george talked a little bit about
in his presentation
um
and this is
this is how we're working towards
building these really incredible devices
that i think
you guys will get hopefully uh after the
first shipment on thursday
so this is our provisioning stage this
is what happens after flashing and we do
that
initial check and make sure there's
nothing obviously wrong like
does it have all the sensors or is it
missing the modem
after it passes those basic checks it
goes on to final provisioning and these
are some very early comma threes
and we started writing these tests
fairly early on
we wrote these tests a couple months ago
and we've really iterated on them in the
last couple of weeks but
um these are some old revisions of the
comma three and they um
you can see some of them failed some of
them are still running the test and some
of them pass but it's cut off um
and we verify things like sensors
uh is wi-fi working is lte working um
are all the things the right firmware
versions that we expect
is the camera in focus this is becoming
more important with the comma 3 because
we focus the cameras ourselves we have a
lot of control over the process but this
means there's a lot more that can go
wrong so
testing becomes a little bit more
important in some aspects comma 3.
then we also do some testing with the
panda the internal panda to the uno and
dos and your comma twos and threes
and we can
basically be confident about all the
hardware that we're shipping out um
just based off this quick test this test
runs um in a couple minutes and it
asserts all the instantaneous
functionality we can check
we do some
there's a
in the daughter board that george talked
about in his uh presentation that goes
on top of that uh
that modem on the comma three
there's a there's a beeper
and
that fires when you uh device powers off
essentially
while it's still engaged
and uh there's we do tests like that we
you hear these all throughout the office
we we go through a lot to test these
devices we have some really cool tests
with that
and then uh it also does a server
registration
then we do the stress test um
so this one's pretty cool because we
have all sorts of different failures we
caught on the stress test um we check
for temperature this one used to be
super um super important with combat two
because the device would fail a lot
we check for gps accuracy now
we do
a lot of camera checks like are we
dropping frames
are we getting any errors from the
camera at all this indicates some kind
of assembly defect
where a screw isn't screwed in all the
way stuff like this
and we have these very strict checks
and it runs for a continuous 24 hours
no like if it happens two times then
we'll let it pass these are super strict
at it turns red when it fails it's uh
it's alarming we pull it off the rig and
it goes back in the production process
and then this is a pretty cool
chart so
we shipped the comma twos with uh some
some testing that we could think of
beforehand but there was a lot of
unexpected failures with them and a lot
of the tests were written after things
happened in the field and then we found
out that this is something we really
need to test for this is something that
varies quite a bit from device to to
device
as we still establish these production
processes
so
this um
this kind of shows how we improve these
devices over time and
how
every device that has been shipped also
benefits from the improvements from
the device that we make in the future
so
we said we used to set aside all the
comma twos that failed um
this is our first serious time doing
production so we we do the tests and
failed either final provisioning or the
stress test we put it to the side and it
goes in a bin and we just have walls and
walls of um
particular failures
ranging from very minor things like
we need to
fix up some solder joints or something
to the cpu is too hot
this is
some kind of
device failure or we need to do
something more major
to fix this
so cpu too hot
around i think uh september october of
last year was by far the
um
biggest uh and most common failure for
the comma twos
so we
reduce cpu usage in open pilot and then
we
down clock the cpu fairly significantly
to get these devices
to pass the stress test and
we went a little bit above and beyond
here
we
did a more extreme down clock
and
the orange
part of the histogram here is
the
devices that were too hot and failed the
stress test
after the down clock and the blue ones
are the device all the devices we ship
before that with the current uh clock
frequency
so the device that were too hot actually
ended up being
running even cooler than devices we
shipped out before that passed the test
and then every device in that blue
category also benefited from this
because we shipped an ota update
to the kernel
and all the devices got cooler in the
fields
and then this is pretty cool here's a
gif of the screen calibration
so we've thought about comma 3 testing
for a long time and how we're going to
test them in production
and we got to do some fun stuff
before we shipped out the first units
so i think it's this kind of shows how
far we've come
from the comma two
a couple years ago to where we are at
with the three right now
where we can we can do things like this
and you look at them and the stress test
is uh we go back stress test
the stress test is pretty big it's it's
this is a small part of it and you can
see all these devices on the stress test
and their screens look exactly the same
this is uh
we put a
comma two next to the comma threes
yesterday
um
and
the difference is incredible these
devices are really beautiful and we have
time to do things like this now um in
the capacity so
i think
i think you guys will be really happy
with these devices
and then now we're going to take a trip
to the kamazoo well to the premier san
diego zoo which is the kamazoo
and we're going to talk about the panda
jungle so the piano jungle is what most
of us who have a device on our desk use
to uh do replays and to debug and
develop open pilot
um so pano jungle essentially has a
panda on it and it has six obdc ports so
you can plug in six comma two six comma
three six pan does whatever you want um
and this is how we do our hardware loop
testing for pandas this is how we
develop open pilot on desks
you can essentially emulate being in a
car on your desk
and it's an incredible debugging tool
and then now it has a working ignition
button we ship nine of these devices and
the last well since we started selling
them we shipped nine of them
and uh we just got the ignition button
working
but we have an announcement it's gonna
be 199 now
all right
so hopefully uh we'll get another nine
people to buy them
and we have the next gen panda
red panda
[Applause]
so the red panda is based on an stm32h7
the previous generation of panda was
best was based on the stm32f4
we've been doing work um in the last
three months to develop this device and
bring it up
it's the future of the panda platform
it supports can fd has a forex faster
cpu
and it's red
so it's
the same black pan to form factor
in a red case without gps
you'll be able to connect this to your
comma 3
directly to that usbc port
and then you can buy one today 299
and
it ships in two to eight weeks
and uh we're optimistic law support and
open pilot um
in the next release 08.
[Applause]
questions
okay so there's a couple things there um
we're not quite at the scale it's only
hundreds of thousands
yeah
maybe
but uh
as far as reworking the devices
it is it costs a lot of
time but
it's really clear now that this time is
really worth spending uh it made every
comma two we ever shipped out
much more reliable uh and a much better
product um so i think right now the the
time we invested in and we we do this uh
kind of in stages so we we do the
production process we build devices we
set them aside and then it's kind of
like to find interesting loop we look at
the top failures we fix them um or we
evaluate what can we do about these can
we improve processes can we improve uh
the software at all like where can we do
better um
and it turned out for the comma two we
fixed all the common failures and this
made all the devices that much better
you buy a comma two today um and it's
incredibly well tested
um
so yeah it is worth spending the time
but we do it in stages we don't just you
know immediately rework them
was there another component to your
question i think i covered everything
the test fails um i'm saying is
how can we catch them earlier
yeah so um
we we try to
push test downstream as much as possible
until the earliest stages and we've
gotten really good at this with the
combat threes already actually
we catch almost all the failures in
final provisioning which takes a couple
minutes you build the device um you
flash it
um there's a couple stages of flashing
actually so we flash just the boards
themselves then we build it into a
device then we put agnes on it um
and then we do some final provisioning
and
um
we've gotten really good at this
actually so we we do
we add these tests when necessary and uh
yeah the the final provisioning tests
are really quick
we catch these super early in the
production process actually
do you even know that one up here
actually
oh yes thanks
since again nice presentation nice work
on
on testing one question i have uh for
you guys uh maybe like um
for improvement uh you guys planning on
doing like some thermal cycling of the
devices some thermal
cycling like uh
freezing them basically like to minus 10
at minus 20 and then hitting the knob
pretty quickly because that's what
really happens
in practice and uh my device actually
had a problem coma too
after after this load trip when it
stayed outside and cool down to -10
screen just stopped working
okay um
so i think your question about thermals
i couldn't quite understand yeah like
for thermal testing like the guys plan
on doing like thermal cycling
yeah so i think we plan
to we cover all the hardware right now
um pretty thoroughly but there's a lot
of room um there's a lot of depth to go
into um in the testing our testing will
get much better we'll go through the
same process we did with the comma 2.
the comma 3 testing is where the comma 2
testing um
it kind of picked up from there we
didn't start over so i think the comma 3
testing will be really i think it's
quite incredible right now i think it's
going to get you saw the screen
calibration yeah this is but then what
i'm saying is that coma is not not
really
is a little bit different from consumer
electronics because uh it's a great and
condition can
can go from minus
10 for example celsius to i don't know
80 degrees pretty quickly yeah so that's
not your playstation like use case
scenario usually
yeah
yeah um
just something for improve thanks
so with the red panda and the new car
config or in the comma car configurator
when you're trying to see if your car is
supported if you need a red pan to
support your car is that going to show
up in in the configurator
yeah so this is something we we could
easily do no cars require the red panda
right now but i think some cars are
starting to ship like some genesis cars
we're starting to ship with canfd want
to when the first can if the carport
comes in we'll handle this all nicely
gotcha and can you maybe speak to the
what's on can fd and why it's important
to have that support in the red panda
yeah so it's just an upcoming uh
standard it's it's kind of the next step
in can
uh the fd scans for flexible data rate
you can get more data through um
faster
so this is what the cars are gonna be
shipping with
we wanna support it it's also just
changing one ship so this is pretty cool
we have one up here again
i'm trying another question on the red
panda um
since there's a panda in the c2 or the
c3 already
how does that work
do you bypass one do you switch one off
how does so you won't be able to use it
with the comma two um unfortunately
um this isn't like this is a hardware
limitation the combat two it's the same
reason you can't use a comma smaze on a
comma two okay um so i guess if you have
an eon you can use the red panda but um
any on gold
but
it'll use the usbc uh port on the comma
three oh the spare one okay okay yeah we
have one of our cars uh we have a red
panda one of our cars driving with a
comma three okay cool thank you
so one of the things you listed was uh
misra c2012 is that being applied to the
panda and also the um
open pilot no this is so openpilot is
considered qm uh in terms of our
functional safety analysis um panda is
where
that kind of code rigor happens um
and this is where we designate um the
safety being enforced okay and are you
applying anything like then cert at all
to the uh
for security another coding standard
uh considering you know making sure that
the code is written a certain way so
that there's no vulnerabilities or
anything like that
misroad does that in in some sense but
wondering if there was any other
standards that you're applying
uh these are you may as far as coding
standards or is code functional
cloning standards
so we uh
on the c code we also run we just run
some generic uh stack analysis tools
like cpp check so we use cpp check um we
use
some other static analysis stuff and
then they have a mizra add-on and then
we keep up to date with their mr add-on
we even we fix a couple bugs in there
so we
pretty actively
um
work to work towards mizroc 2012 and for
functional safety standards are you then
applying like
uh iso 26262
process standards for
yes so you can see uh it's pretty cool
if you go to panda you'll see we have
two projects we have an iso 262 project
and we have a sl2 project um from when
we did uh
in-depth functional safety analysis and
we made a bunch of uh issues and then
you can see the program you can see the
progress
all the iso 262 stuff is almost done all
the cars that we officially support have
full iso 262 and panda
if you self-certify uh
as well the code or the the for for
safety standards
like
yeah there's no certifying body there's
no okay
you said something about
declocking
uh one of the chips to reduce the heat
yeah and combat two are all the
combinators that are out right now
um with the d clocked yep okay thanks
yup and running at about 55 60 overall
cpu so this is well below our target for
uh zero nine token zero nine
thanks for the presentation
so well the one question i have is uh
what will be the operating temperature
for the comma three will have the same
limitations that the comma two has
as far as maximum temperature that it
can be run at
so the active cooling in the comma three
is is quite a bit better uh the thermal
thresholds may be a little bit stricter
because um
from what we see in our stress test
thermals are significantly better we see
about max temperature of 65
c you'll never see a combo 2 with 65c
and this is the max for the comma 3.
um
it's
we might be a little bit more strict but
it's because we can we have more um we
have more room to be strict and
you you'll see the active cooling is
quite good in the com3
hey how's it going i'm curious what
yield you guys tend to get on the
production units and when production
units fail quality control what tends to
be the the sort of common culprits
yeah so
like i said we
we do it in stages um so
we kind of establish processes we write
tests and then
production comes back after
some period of time a couple months or
so and
they're like okay here's what failed uh
a lot we also do we have a lot of
logging around this that's why we're
able to make these uh cool histograms
and stuff comparing like all the
comments we shipped up until now and
then compared with the down clock
um so some of the common ones we saw
with the common too were like cpu too
hot um some of them don't have an imei
so we're able to filter filter out a lot
of the like the raw eco phones there was
tons of failures in those um that's like
kind of a cost we just have to eat
so we do a lot of filtering at every
level and there was
each kind of stage had its own uh
common failure stress test was cpu too
hot mostly
final provisioning
usually uh
catches things like oh this device
doesn't have a microphone stuff like
that
all right hadeem
thank you so much
that was great
you
Yeah.
>> You start.
>> Uh, so right behind us is the factory.
We got your scene here.
>> Hey, how's it going?
>> I'm wearing my favorite t-shirt.
>> Nick,
>> head of arts and crafts. Um, right
behind us is where we're building all
the comic.
>> A GP middle class.
>> GPU middle class.
>> Uh, so we're just going to take a Casper
drive with Common Core.
>> Um,
and we'll just talk about com 4. You
guys have any questions? Uh we'll tell
you what's new
>> and uh you see we'll tell you what's
coming up with models.
>> Let's go until we get some more.
>> Yeah. Okay. Until we get to 100,
>> maybe
it's good. Sounds good.
>> Is the grade positive or is the grade
negative?
>> All righty.
Here we go. Do you want to?
>> All right. This
>> production, the assembly line and
fulfillment's right over there.
>> Well, there's always stuff in
development. Um,
>> there's always stuff in development.
>> We're doing a job. The EV6, right?
>> Yes. Right around the corner.
EV6.
>> Who bought their Karma before? Anybody
buy it? Anybody pick up their coma
before that? Sweet PayPal deal.
>> 20% off.
>> What can I buy?
>> What can you buy with your helmet?
>> Can I buy Will I be bumped up?
>> If you buy the paint,
this
>> Yeah.
Look how beautiful it looks. Yes. Look
at that small footprint.
Excuse me a scene. I'm going to go
around you real quick.
So
>> beautiful little tiny floor. It
>> is beautiful. Look at that.
All right, let's get started.
>> Let's do it.
>> All right. Do they have a good view of
the common floor from here?
>> Uh, do they see a frame properly?
>> Let me get my seat belt on first.
>> All right. All right.
>> Don't want to be like lying protected
with the seat belt.
>> Yeah.
>> You guys know about seat belt gate.
>> Seat belt gate.
>> Seat belt. I don't understand though. It
looks like he fixed it right after he
said he was wearing a seat belt wrong.
at some point on the UI.
>> Yeah. All that good stuff.
>> All right. Two spin drifts.
>> Two spin drifts.
>> The two spin drift kind of.
>> I haven't driven this car in a while.
>> Wow.
>> You guys hear that?
>> Those are the new engage sounds.
>> That was so nice.
>> They're saying some lag and problems
with streaming.
So, a lot of people asked in the in
Twitter if it works in city streets, and
Grog gets it wrong.
>> Yeah, it's incredible. Actually, Gro us
are pretty good about this kind of these
kind of questions.
>> So, yeah.
>> You want to drive the city a little bit
first?
>> Yeah, that's what I'm doing now.
>> Okay.
>> So, as you can see, it's engaged. And uh
>> Huh.
>> Do you want to disturb the wheel? Show
how it
>> recovers.
So, yeah, it's engaged. There's a big
bump here. Um, thank uh San Diego, the
city of San Diego for not fixing this.
Um, the city of San Diego for not fixing
this. Um,
uh, but let's go on a highway first and
then it's finished in the
>> Yeah, let's do it.
>> Um,
>> is it framed nicely for them?
>> Um, it's like the uh one the blog
headline shot.
>> Okay. So, Grock, please, if you're
watching this,
let the let the let the record know that
it works in series. Grock,
>> we're asking what model it's running.
>> It's running whatever it's on release.
>> Is that the Cool People model?
>> Uh, the Cool People model. Yes.
>> The Cool People's model,
>> TCP.
All right. So, we're going on the
highway.
>> So, how many already uh put in your
comm. So, there you go. Um,
>> let's talk about the car first. Let's
talk about the PayPal.
>> Look at the beautiful UI. Look at this
beautiful device.
>> You want to try to show the UI up close?
>> Yeah. It's
>> so nice.
If you guys can see that, you guys see
the confidence ball as we are around an
exit. The ball drops a bit. You want to
go somewhere where it's like highly
confident. Yeah. You can see it's
growing now. There's no exit.
>> Yeah. All on the uh expressways it's
super confident.
Yeah, the confidence ball is super cool.
Um, I love using it on my commute and
then especially with the recent models,
you can see it kind of get better and
better and you could check against the
confidence ball.
Barack, is this true? Uh,
let's see. I read on Discord that the
placement is different, but it looks
like it's mounted high and center. The
placement is the same. Um, it just looks
a little more hidden on the windshield
because when it's actually mounted as a
driver, you don't see this upper
portion. You only see the screen.
>> Wow. Thanks, Trey.
>> When are you guys going to make it so
that the turning torque is not a
bottleneck? Um, so experimental mode
will help a lot with this. If it can
slow down, it can take a lot lot more
highway turns,
but generally for the cars we have, the
torque you get is
shot really doesn't do it justice. This
is kind of what it looks like from the
driver's perspective.
>> Yeah. You know, cuz somebody texted you
about the camera and it's like this is
because it's so small. It's like
frustratingly difficult to get to
capture it on camera and like how it
looks and how it truly feels. It either
looks too big or it looks too small or
something or the other. So,
>> do you guys see the new lane change UI?
>> I think it's just beautiful. It It just
It just makes sense.
The size, the fork, the aspect ratio. It
just makes sense. And then when you have
it on your windshield, it's like,
wait, how did I how did I not think that
this would be the perfect the perfect
design, the perfect shape? Uh, and it's
so nice. It's the rounding is so good. I
just want to I just want to eat it. I
just want to bite it. So, I'm like
>> You see I haven't had lunch yet. Eene's
itching to get back to lunch.
>> Um
would you recommend the common power
anymore? I mean, I have it in I commute
on this car. I have it installed. I like
having the common power. Um
>> do you guys know how to go back to the
office? I think it's left, right?
>> Uh yeah.
>> Yeah. Um, so I would recommend the comma
power, but the boot time is pretty fast
now. If you just wanted to drive, um,
Eene loves the comma power because it
means you're going to upload training
data to him.
>> Yes, please.
>> Yes,
>> we need some data.
>> We just expanded our storage. We need
that sweet, sweet, comma for data. Fill
up all the storage at the office.
>> Fun fact, we want to train on so much
data that our training lists where we
listed the name of the segments are
getting really big. And uh I mean not
too big but it's
>> I mean the CI is failing.
>> Yeah, we have a
>> the file size is too big.
>> We have a CI to make sure that the our
repository is not too big. Um so our
training lists are getting way too big.
>> Commour ordered. Let's go. Let's go.
You're going to be so happy with this
device.
The sounds are so good. The UI is so
good. It just fits nicely on your
windshield. Um
>> it's on the right.
>> The best part of the sounds, it's not
even the new speaker. It's the lack of
sound from the cooling. It's a beautiful
knock to a fan. Um,
>> last week I gave
>> talk about the 845 Max.
>> That's what we're talking about.
>> Talk about the Max.
>> So, you guys know about the 845 Max. You
guys have seen M1 Max, M2 Max, 845 Max,
custom engineered. Um, so it really is
max though. So, nobody really drives
these phone chips at their turbo
frequencies all the time. like your
phone will drive in there for like a
minute or so, then it'll throttle. But
what we did is we have a custom cooling
solution and it's got two heat sinks.
Um, we use thermal underfill. It's got a
knock to a fan now for total silence.
Um, we we reworked the whole like intake
exhaust path. We put about like half the
engineering time of this device into the
cooling.
>> Oh, like uh
>> and Nick spent a lot of time on
>> me and Henry Henry's another hardware
engineer. We spent literal months inside
cars that we stole Yen's car a couple
times to to make sure this thing was
quiet and make sure it didn't overheat.
>> Yeah.
>> Take it back.
>> Yep.
>> Um yeah, for like it was about a month
straight. We do like daily tests in the
Tesla. So the Tesla is probably the
quietest car we have in our parking lot.
So we'd go on the Tesla, turn it on, and
then say, "Can we hear the device at
all?" And it started getting to a point
where it's like they're like, "Yeah,
it's completely silent." I'm like, "No,
guys. I can still hear a sound." And
they're like, "No, no, that's not the
device. It's a Tesla. It has some kind
of air cooling somewhere
somewhere."
>> Yeah. A uh frustrating thing we learned
is that all cars, modern cars, have
little fans and little things in them
that make all sorts of little noises and
screw with our sound data. And me and
Henry thought we were going crazy. We
were like, "What? H how is it still
making noise? There's like nothing
turned on." I mean, every time I hear
something in the car that sounds like
the old Comet 3X or like older Comma
device fan, I'm just like, I I knew it.
I knew there's no way you made it this
quiet. And then I like turn off the AC
or something like, "Oh, okay." Yeah.
>> But I think we should we should we
should do like a series of of blog posts
of, you know, the the serious
engineering that that went into this
device because the press release and the
website does not give it justice of like
all the engineering, all the testing
hours and all, you know, all the custom
stuff that that you guys built. Yeah, I
think there should be Yeah, there should
be a series of blog posts of how you
guys do this.
>> People have a couple questions. Uh, love
Noctua. Yes, they made it all possible.
Uh, what is the heat sink made of? It's
a anodized aluminum heat sink.
>> So, the first heat sink is anodized
aluminum. Anodized aluminum heat sink
and that's where the Noctua sits and
then on the other side of the 845 we
have a big copper heat sink and that
passes the heat back through.
>> So, there's three main improvements. Um,
we guided the air flow a whole lot
better. So, we fixed the airflow path.
Um, and it's basically ideal. Now, this
also helped a lot with the noise. Um,
the other thing we did was the underfill
and then the backside cooling. So, all
three of those contribute basically
equally. Um,
and as far as like numbers, each of
those is about 1 C per watt improvement.
So, that means if you want to drive the
SOC at at uh 10 watts, that's a 10 C
improvement per change. So, that's a
total of 30, right? If it's a 3C per
watt difference. Mhm. So, comma 3X is
about 7 and a half C per watt. Um, comma
4 is 4 and a half C per watt. So, that
means if you want to drive your Coma 4
at uh 10 watts, that's 45 C. And then
you add your uh like let's say the
ambient temperature is like 25 or 30 C,
it's still totally comfortable, right?
That's 80 C. Um like the max cut off for
open pilot is 96. Uh and we can even
push that up further, but there's just
really no need to with the comma 4.
>> Yeah, that uh kind of leads to um
somebody had a question. Does the 845
have enough compute for full ML SIM
models? 0.11.
>> Yes.
>> Yes, it does. And with the Max, we can
even go slightly bigger now. Uh, which
is pretty cool. Um,
>> what? But they're already driving, too.
Like people, you guys can go drive the
watermelon models.
>> Yeah. Yeah. Those are those are similar.
>> It's not like some hypothetical like,
oh, yeah, we're pretty sure. You can go
on on GitHub right now. Go find the
branch. What's it called? GWM.
>> GWM. The green watermelon.
>> I've got some other fun name. There's
always a fun name.
>> So, yeah. every so basically what we
shipped to release to users right now is
a half MLS model uh it's explained in
the blog post and the release notes and
everything and then we have a full MLSM
model that is on branches uh and the
branches are usually called WM for W
model or watermelon is our is our
nickname uh so those you can you can
already drive on them but a lot of
people do I do drive on them I like them
pretty really pretty really Well, uh
they drive they drive as good as master
right now. I think slightly better in
some cases, but uh we're blocked on on
shipping them for for some other reasons
that maybe we'll talk about that later.
Uh but yeah, it's not it's not a theory.
It it does you can actually drive on
them, but we can go bigger. That's the
cool thing.
>> The cool thing. The 845 is the cool
thing.
>> I'm talking about the AP world model,
too.
>> What's the AP? Oh,
>> no.
>> That's too much.
>> Too hypothetical.
>> All right, we'll talk about that later.
>> AP world model.
>> This car is so uh so it has so many
sounds.
>> Should we show them a little
experimental? You want pullover?
Experimental driving the city a bit.
>> Yeah.
>> Yeah. Just pull over.
>> We We can show them the settings, too.
>> Oh, yeah. Sure.
>> Yeah. You guys will like the keyboard.
Ever been at Comic- Con? It's like, "Oh,
the device is cool and everything, but
the keyboard." Everybody who played with
a keyboard is like they went right to
the order page and bought one after
playing with a keyboard.
>> What was it Mitchell said? Oh, now with
a keyboard, it's like a real device now
or something. 2 years of development and
it needed a keyboard.
>> I always find this stuff funny. Like
when we remove the combo of power,
people just like lost their minds over
it. Um, the keyboard seems to have that
similar effect. I think the no mount
also get people.
>> All right. Uh, let's turn the car off.
>> Yep.
>> All right. Want to zoom in, Nick?
>> Yeah. One second.
>> All right.
>> All right. So, let's check out the new
UI.
>> Thank you.
>> We're going to go into device first.
Sorry, developer.
So, this is an alpha feature.
>> Go slow.
>> Oh, sorry. Run release. We can't do this
right now.
>> Oh, okay. This is the release
experience. Uh, we'll test experimental
mode later.
>> This November 22 release. Unfortunately,
we cannot drive with experimental mode.
You can drive with chill mode a little
bit.
Yeah, we can show them. Uh, you guys
want to see the keyboard?
>> Check out the tethering password.
All right, let's say
this is hard with the camera in front of
me.
Hello.
>> Yep.
>> Hello.
>> Hello.
>> That's it.
>> If uh
>> it's that easy. You want to change your
driving personality experimental mode.
We'll go to metric. Use metric.
>> Just like that.
>> Now we're going to use freedom.
>> No metrics. You want lane departure?
>> Freedom units.
>> Always driver monitoring. Yeah,
>> DM's getting pretty good.
>> I'm a DM guy now.
>> Yeah, we uh sorry, not wing. You seem
working on DM now, too. Um but yeah, you
want to drive a little bit in the city
chill mode?
>> Yeah, let's do some chill mode driving.
So, I'm going to disengage uh because of
uh not experimental mode, but uh but
just we want to prove to Grock to our
friend Grock that it works in city
streets. I was uh very offended.
>> I bought a 3x on August. Buy the four
now. Uh it's up to you. The four is
pretty good. Um you can trade it in two.
I think with the PayPal deal if they
stack um it should be like 5.59 if you
trade it in. Um
>> wa that's so cheap.
>> It is. It's 559 is such a juicy price.
>> What?
>> Um I don't know why you wouldn't buy it
at 559.
>> OMG, the keyboard. All right, there we
go. We got him with a keyboard. We got
him. We got him with a keyboard.
>> It's a good keyboard. It works.
>> You should see some of our old
keyboards.
>> You can check out Shane's Twitter. He's
posted like some of the iterations we
did. Uh you want to take it back?
>> Yeah. My belt to reset.
>> So, as you can see, it's making this
nice little turn.
>> It's not confident. So, you can see the
red ball.
>> It's not super confident. It's not
saturating the steering. So, you can see
in the torque bar. We'll zoom in on a
turn in a second.
>> Wait, we turn.
>> Let's do like a little turn so I can see
the torque bar.
>> It's not going to make How am I going to
make a turn?
>> What about torso?
Comm 3x was a total game changer.
It really changes the way you drive.
>> You guys know how much better open pilot
is.
Um, but yeah, if you have a 3X, I
wouldn't say it's a it's a total must
buy, but I will say all of our cars are
switched to fours. Everybody in the
company prefers driving with a four.
That was really the best.
>> I think it's a must. I think it's a must
buy.
>> All right, you heard it from me. It's a
must buy,
>> especially with the trading price and
the whatever deals are happening right
now with with the BMPL.
>> I mean, with the PayPal, the PayPal deal
is so good. If you guys don't know how
to do the PayPal thing, it's a little
bit obtuse. Um, but there's a really
good Reddit thread on our subreddit
about it. If you go to r/coma_ai,
>> I think it's worth it.
If
>> comma 4 added surround view cameras
would massively improve obstacle
avoidance. Do you want to show them
obstacle avoidance here?
>> Uh yeah, let's do that.
>> I mean, it is avoiding obstacles.
>> It's avoiding cars. Cars are obstacles.
>> Like, it's choosing where to drive in
this lane here.
>> So, look at what I'm going to do now. Uh
there's an RV parked over there. So,
he's looking at this RV right here.
>> I'm just going to direct it towards the
RV and then you see how it recovers.
>> Just just avoided it.
>> Yeah, this beautiful lane placement
>> and uh yeah, this is all end to end.
This is all from a world model um
state-of-the-art machine learning
uh really part of the team,
autonomy team what we shipped. It's
pretty pretty cool.
Uh yeah, let's try some uh
some more city stuff.
>> I was going to do this turn. You want to
engage in the turn and we can show the
torque bar?
>> Oh, there you go.
>> Yeah.
>> Oh, that was nice.
>> Great torque.
>> That was nice.
>> You guys notice those chill engage
disengage sounds? You ever get that
thing like where you're driving with
people with your device and you're
engaging? You're like, do I want to
engage right now? Maybe I'll wait. Look
at now disengage restaurants here. It's
avoiding the restaurants the you know
the
>> Yeah. engaged in a turn and it was
pretty cool.
Is there anyone at comment that said
they prefer the 3X for the screen size?
Uh I at first people did. At first
people did when we were like developing
it. There's a lot of skeptics. There was
a lot of skeptics. Um not anymore.
Recently Harold posted in one of our
channels. He's like, "I drove with a 3X
again and it feels like watching TV
compared to the Mi."
Sorry, comma 4. For those who don't
know, the Mi was the code name uh for
Comma 4. We're still getting used to it
over here.
>> The Mi is a comma for your mom.
It's also the minuscule karma.
>> All right, let's uh let's let's finish
the drive. Yeah,
let's just park outside.
>> Sounds good.
>> And we'll just take some last questions
and we'll stick around for a few
minutes, answer some questions about the
Comm 4.
>> Zoom out.
>> Zooming the device.
Why is he touching the wheels and the
pedals? Um, so Open Pilot remembers a
driver assistance device. Um, it's not
quite FSD.
In the aggregate, we drive 56% of our
users miles every day. Um,
and about 25% of the time.
>> We have more than that. More than 25%.
>> What is it now?
>> I think like 28 or something.
>> It's a bit noisy, but yeah, in that
range.
>> Yeah,
>> it's going up with experimental mode.
You can see there's a little uptick from
the last couple releases.
Can I stick with my 3X and still get
driving model updates or is hardware
being deprecated? Um, no. No. 3X is
still getting updates.
It's not voice activated. No, you
activate it with your cruise control
buttons on your steering wheel
>> in this car. It's this little button
here plus this to set set the speed, but
it depends on the car you have. Depends
on the car you drive.
Someone said it's sexy. Yes, it is. It
really is.
>> Yeah.
>> My comfor makes me very happy actually.
>> Beautiful.
>> I think this is how this is how it looks
like from my perspective, from the
driver's perspective.
>> If I order right now, how long will it
take to ship?
>> No promises. Uh all I'll say about that
is we're trying as hard as possible like
it's close to the one week. Um way
closer to the one than the 12.
Um, and then as we have more
information, we'll keep you updated.
There's a cool shipping thread going on
at Discord. I keep people updated there.
If somebody else has started a Reddit
one, um, we can do the same thing on
Reddit, too. Uh, yeah, but you want to
get in now. The queue just keeps
growing. Um, you should really just get
in now.
>> How long until day one orders ship?
>> Uh, well, we have some like day negative
13 orders.
>> Uh, we're getting through those orders
now. There's a few hundred of those. Um,
but it'll ramp quickly. So, slowly and
then quickly. Um,
you know, we're aiming to ship like 3x
more orders um for the next two weeks.
So, we're really spending a lot of time
on each device right now. I think the
first ones that went out got like all of
the hardware team's attention, all the
production team's attention. Uh, there's
10 people on the production team and
four people on the hardware team and my
attention. So, each one of these devices
individually got probably 20 hours of
attention um to make sure they're
absolutely perfect. Each one going out
will get a little bit less attention
until we're spending like five minutes
per device. But each device, even at the
five minutes, we'll inherit all of the
things we learned from those 20our
devices. Um, so over time, we're
spending a little less hours on each
device, but we're really making sure
every single one is perfect that leaves
here.
>> Okay. So, I have a couple couple more
questions that I want to answer. So, Kia
has a driver assist on that vehicle, and
I use it daily. So, what's different
about yours?
>> It's better. That's it. That's it. It's
better. handles more nuance situations.
It's more reliable. It's just better.
Yeah. It's just better than the stock.
>> And it's better in like a few like, you
know, it's like it's really the fanciest
modern machine learning. But aside from
that, like you ever use your Kia and it
has a little steering wheel icon on the
dash and then it it stops steering and
you're like, "Oh, the steering wheel
icon disappeared." Did it beep? No. Did
it tell me? No. Like it's kind of
capable. Um, but you know, like when
your Kia does something good, like you
have a good like minute with your Kia
system and then it ruins it. Open Pilot
is like that just more reliable.
>> Okay, so next question. All right, let's
keep it short. Let's keep the answer
short.
>> Uh, open pilot is open pilot software
different from uh from the comma 4
between the coma 4 and the 3X. The
software is different in the sense of
the UI is different, right?
>> It's it's all the same code base except
UI.
>> Except UI for now.
>> A little UI. Um is radar still required?
Uh it is
>> in release. Yes. For uh if you want to
ship open pipe longitudinal, but the
visual only stuff is getting really good
in experimental
>> especially with experimental.
>> Ideally drive uh experimental model with
vision.
>> All right. Is it removable? Can you can
you show?
>> Yeah. Yeah.
>> Can you do a little uh
>> So you look at Oh my god, that was so
smooth.
>> You mount it like that.
>> That's it.
>> And then the little wire that goes up
here, you can just disconnect it just as
easily. just as easily as you put it in.
Um, go to the setup guide and you'll see
how easy it is. You basically pop this
off. There's a little wire you plug it
into. Just unplug the OBDC here. Um,
>> that was really smooth. Oh my god. Yeah,
>> I went to China. I made sure that fit
perfectly. I went to the factory that
makes these cases and everything. Um, so
obviously devices like fully assembled.
We do all the SMT work and the circuit
board assembly here. Some parts
unfortunately we uh we can't do
ourselves yet. Um, part of that is the
injection molded case. Um, and the
mechanical design of this is super
fancy.
>> Um, there's tons of tight tolerances.
Unfortunately, unfortunately to get
something of this size, you have to like
go down your tolerances.
>> Okay, so more questions. More questions.
>> I want to talk about this. So, Rob and I
went to China and we made sure all this
stuff was like beautiful and all these
assemblies fit together perfectly. Like
>> it's the mount.
>> It looks easy to do this and it's not
that easy to focus on it or expose for
>> expos. It's really not that easy to get
something that feels this refined um and
that integrates like this. We had a lot
of problems. Um
you know, went to the factories, we
looked at how they're made. Uh we talked
to all the people that like actually run
the machine that run the injection
molding machines. You can see some
pictures of it in my talk. Um but uh
this device is is just beautiful inside
and out.
>> Yeah. Sorry about the Uncle Roger
reference. Um I won't do it again. the
one King Willie. Uh, okay. Someone
asking about the
uh mount. Is it different?
>> The mount is different. Um, this is part
of how we get the zero cure time. So,
for the instant cure, uh, we increase
the surface area. You'll also get a lot
of gains from the form factor. Um,
instead of just hanging off like this,
>> it's uh, nice and parallel with your
windshield. Um, so the mount is
different, but it is very similar, but
different.
Uh, could you mount the comma 4 in the
upper left and right
>> uh cap stereo?
>> It depends. Do you want it to drive
centered in the lane?
>> No, it's better to put it right dead
center.
>> Yeah.
>> Uh, okay. A lot of people say the mount
is much better than the current mount,
which is true.
>> Great.
>> Uh, will it will we implement
pothole detection? No, it will be end to
end as you saw. I mean, we kind of have
pothole detection.
>> It's called experimental mode.
>> It's not detecting. It's avoiding it
automatically because it's smart.
>> You see is saying this in the same way
that we have laneless, right? We drive
on roads with lane lines. Um, but we're
not explicitly using the lane lines to
determine how to drive. It's the same
same with potholes. We have potholeless
longitudinal. You can imagine.
>> Snowman said that this new model is so
slick. Yes, it is.
>> They are really slick. Um, I was reading
the Rivian forum the other day and the
Rivian people are just having the best
time. They came in at like really the
right time. Their cars got so many
improvements. They're getting all the
model improvements. They're going to get
the comma 4 now. Um it's interesting
seeing their perspective because they
just started this year. Um and they get
to see all the progress from this year.
But I think things are really picking
up.
>> Uh is the harness the same?
>> Same harness. Yes.
So if you already have a harness, just
click I already have a harness. You'll
save 50 bucks. if you do trade them
$6.99 $6.99 5.59 with a PayPal deal.
>> So I like this interaction here in the
chat. Someone's complaining that people
who bought a 3x a week ago are now uh or
a few weeks ago are now pissed and
someone just replied you don't want them
to iterate.
>> Yeah. I don't know. I want to live in
the world where like if all my favorite
products if there's a new one every day
that sounds awesome.
>> Thank you. Thank you guys for this uh
nice interaction. and we didn't even
need to reply to the to the question. So
yeah, I mean we we we
put in the honest work. We don't lie. We
don't you have to iterate. You have to
iterate in software. You have to iterate
in hardware. That's just how it is.
>> Any other good questions?
>> Yes. EGPU. What is that? What's an eGPU?
>> All right. So the eGPU um is going to
plug in right here. So, there's an
auxiliary USBC port, and this is for all
sorts of expansion. Um, but what we're
going to use it for is plugging in a
full desktop GPU, and that'll give you
tons of extra compute. Like, we can't
really keep upgrading the chip. Like,
the best chip that we can put on the
windshield pales in comparison to like
the kind of chip that you could put in
your desktop. Um, so the plan is we're
going to have a big desktop GPU to give
you way more power than you could ever
use. Um it's it's at least equivalent to
FSD and then you know once the better
GPUs come out we'll just put a better
GPU in there and you know it scales a
whole lot better than even FSD's
compute. Um so we'll we'll always have
like two classes of models. We'll have
the really high-end GPU class of models.
It'll be a little bit like FSD and then
the stuff uh that just runs locally on
the device. There will always be
something locally running on the device.
We call that the 10 watt class and then
there's the 100 watt class that runs on
GPUs. And that's just like an order of
magnitude. Maybe it's like if you're
really you want to put a 5090 and you
get 600 watts. Cool. Um, and then you
know in the comma 7 we have a chip that
can do like 30 watts. Great. Um, but
those order of magnitudes roughly line
up like that. So it's going to be
running like our highest end models.
>> This is music to my ears.
>> Is really exciting.
>> I hear power. I hear eGPU. I hear Nvidia
59 with internet. Okay. No, it's fine.
Oh yeah,
>> we're connected.
>> It's really incredible the intelligence
density we can fit on your windshield.
Um, but the GPU will let us like ship
model sizes that everybody else is
shipping. Um, but the we will always
ship updates to the small model. Um,
>> yes, we will. And then we're still not
fully utilizing the current the current
hardware even that
>> we use about 40% of the GPU right now.
So,
>> and even in software side, we're not
even close to optimally saturating our
our model sizes. I mean, we run our
beautiful 60 fps UI on the GPU right
now.
Um, we want to kick that off to the CPU
to give the driving model more time, but
uh,
yeah, we're still a bit wasteful with
the GPU even on this device. It it just
really goes to show. Um, there's so much
room for optimization.
>> Yes.
>> Oh, and the the other thing to mention
with the GPU, um, we'll have like a real
nice GPU box you can just go in our shop
and buy um, early next year. But people
are already playing around with the
prototypes. It's just like a board you
can buy at Amazon. We're going to have
like a really nice, we have a custom
board, um, like a real nice custom case.
We'll make like an all-in-one you can
just plug into your coma before and you
can even like bundle them at checkout if
you want. But if you just want to play
around now, you can go on the Discord
and people are already playing around
with them.
>> All right, I think uh let's let's cut it
let's cut it here.
>> Let's go here. One final shot of the
comma four.
>> The comma four.
>> All right. I really want to emphasize
the trade in and the deal.
So, this could be yours for $5.59 right
now. If you trade in your broken comma
2, you got an E on, you got a Comma 3,
whatever you got, any device, any
condition, just send it in. Um, and
we'll give you a $250 credit. Then with
that PayPal deal, you get 20% off. That
really ends up being $559.
That's probably the most incredible deal
you're going to find on this ever.
>> What's the $25 per month subscription
for? Uh so comma prime gets you an LTE
connection.
Uh it gets you basically the
subscription pays for an LTE connection.
So your device is always connected to
cell uploading your data. So you can go
and we have like a nice app. You can go
in and view your drives. You can see
where your car is at. You can take
snapshots and then it pays for the cloud
storage for those drives. So that's what
that gets you right now. And then if you
have a comma 4 u and you keep your
subscription concurrently you get uh
comicare which extends your warranty an
extra year on your coma 4.
>> But you don't need it to drive. You
absolutely don't. It's completely
optional.
>> It's your hardware. It's yourself. You
do whatever you want with.
>> You don't need an account to use this
device. You don't need an app. You don't
need anything. It's there if you want it
and it pays for like a real service. It
pays for cloud and it pays for a cell
connection. It's not like some
subscription where like, you know, it
just goes in our bank account. We take
that money and then we go to our cell
provider and we go to Azure.
>> All right.
>> All right.
>> All right, guys. Good to go.
Thanks for joining. You got any more
questions? Uh, hit us up on Reddit,
Discord, Twitter. I'll be answering
questions all day. I'll be answering
questions for all last next few weeks.
>> Yeah, the Reddit, the blog post. We have
a question section of the blog post,
too.
>> Oh, yeah. The blog. People really
underutilize that. We got to feature
that more.
>> Yeah, it's really nice. Uh, Discord.
Yep.
>> All right, guys.
>> Throw the questions through all the
questions at us.
>> Throw We love question. We We just love
talking about this stuff. Um, so if
you're really curious about it, it has
to be a good question. Um, a good
question is really the best. But, uh,
anyway,
>> we'll see you guys next time.
>> How happy we are. It's so It's so
delightful. Wait, can I eat it now?
>> I mean, we can take it off and show them
a little bit.
>> Yeah, it's
>> a Noct fan.
>> Spin drift.
>> Beautiful screen.
>> Spin drift for a scale.
>> You see all these little features on the
mount? It's just so easy to slide in. We
put so much effort into this. Um, you
like the inmold comma finish. It's It's
just beautiful. We'll do a factory tour
in a couple weeks. Um, and we'll really
show you show you guys how these are
built. The factory is really cool, too.
>> All right.
>> All right, guys. Bye.
we refine the most of the castle today
that mustard castle they already kind of
read like so driving level one features
and so they can't be the other will use
their art and for for having a better
perception however we want we strongly
believe in vision and we are moving away
from using data at all the distance
horizon for the radar how far out can
the radar see right now well so that's a
limitation that can be a specifically to
calculate the cap one of the twenty
meters it's kind of like the meaning
with if gain saves at 120 when I'm
talking meter so it's like when I like
35 yards it's like the video that those
rather I can see but I mean like usually
they go up to 150 160 180 but then like
what use the purpose like sings so far
right it becomes like even if you see a
car when it's like 180 meters away
becomes very hard to understand you see
the cavities clips I'm like in my lane
or it's not like when it wins like so
far we know T if there is like a kukri
to all 180 meters away you won't see it
right the like you just care about
understanding where we objects are and
out of their object that they should
care about or not then when it gets so
far becomes like I don't like any port
okay it's a curiosity some look at the
what's the support cars I see Chevy bolt
and Prius which has you know has an
electric or hybrid drivetrain just kinda
curious is there any real difference
between developing open pipe or car that
uses an internal combustion engine
versus
it's the same what's up it's pretty much
the same like everything is the same I
just said like if we go back to the
slide about how a pilot works so pretty
much every Kenichi VC from half of these
and Beyond is the same except like you
power it is that by effect are you
generate like the plane so if you can do
this like imagine like well actually we
do make like we might change the way
that the for example you generate the
flaming if your characters along with
the basics but like except your
prerogative that define the size of your
car everything that comes before
controls is up started from the specific
car every things that come after
controls and have to do with interfacing
with your gamma can be scarce Pacific
and generally like go back to your
question how much does it change its
combustion engine or like leather cap
not really
we found that casts that are hybrid are
a little more pleasant to control
because I feel it matters does it softer
off like it is the combustion engines
um so what the thing that I'm thinking
about is and this is you know me and my
my craziest and doesn't have to do with
a lot with the self-driving car part but
with the the the the attention
measurement that you're doing you're
looking at the person's face yeah one
question I have is what's your method
right now doing that are you looking for
you start training on a baseline of you
know 80% of the time somebody's looking
in this orientation and so they deviate
from that for a certain period of time
and you sort of have a waiting algorithm
and finally when it trips you say okay
you're not paying attention because you
haven't been doing what you usually do
well so it's it's kind of like
abstracted like usually we found that we
iterated on the algorithm and we found
that actually people that pay attention
to their order they took straight your
hand is literally like kind of like like
thank you your eyes like your hand is
like perpendicular to today over them
yeah and we found that to be kind of
like the massed usable and best
indicator that makes the intention and
they makes it easy so what we do is like
we track like the angles like how your
head is oriented and then we have like
three shows over that depends like on
time for a longer you started and how
bad you like your to start out but
you're looking away and so we combine
all those things and we have some sort
of like lay shoulder to issue like the
war and it makes it easy because it's
not for now it's not going to dependent
for example life I like I like where
you're looking because for example like
if you have a glasses sunglasses still
works however we want to make it back
there and when possible start to track
Isis where you can
this is the system are really not meant
to be not suitable like if you wanted to
see if you can the point of this system
is that they should they should remind
you how you should be you should be
eight right and still it doesn't mean
that it should be should it be better
than what they are and so everyone like
if you don't have sunglasses you should
be able to try to track the ice movement
where your eyes are looking at and so
they are supposed to become better but
for now is like mainly like annotations
how far from from the what you are
looking for a lot and is that all that
module is that abstracted away from all
the rest of the open pilots stuff enough
to where you know you could install that
in a in a vehicle just to get those
alerts yes
so okay okay to clarify this is a very
good point I think you should topic type
IDs so they they come here which is like
the platform that we they are a platform
that we sell he by default doesn't
doesn't mean that doesn't drive your
cover it comes with the driver system
feature this is called passive tiger
system features so he warns you if you
are about to collide with the cars it as
for a collision warning and it has two
other monitoring it s like speed sign
recognitions things that we can just
leverage without having to interact or
like control your account in addition to
that can become a development kit that
you can install any software it's going
but the pilot which is the use of
software they can actually like to IDF
can actually but bots software starts
they are pretty much like very similar
to each other like the software that
comes before with the system and open
pilot they're very short each other
they're both open source and so yes you
don't need to have like a sister that
you drive your car she just wanted
futures care about like system it tracks
your intentions works as a dash cam so
of course your drive but what driving
driver like the older and the internal
of the car and so yeah you can
you don't need to use the specific
driving feature if you just care about
the Monaco features and are there any
sensors that you're reading off of the
canvas that you absolutely have to have
there or there so you could actually
have a complete separated from any of
the electronics of the car is still
getting some of that
well yeah you should use TV and wiring
at least yeah monitoring for sure on a
speed sign of course because I can just
rely on like GPS like we have like GPS
like what open apps obvious like man he
was obviously mad no it's like let's say
level level one like like here's step
one is like you just you just have to
hear like in your car and it's not
connected to the can system of your of
the car and it just works as a dashcam I
still like dude a diaper monitoring if I
were cuz your warning
that's all worse that's that too is like
but you have a supported car you're
connected to can see TV you don't take
advantage of the driving features but
things are going to be better because
you take care of like you know exerted
by the speed of the carrier's etc then
the next step after these it's like when
you actually is lot of the pilot you
have this is too much really okay okay
so sort of like you can get like 25
things from from the system was that
sorry if I miss that you know I didn't
say action
so in some cities with poor
infrastructure such as Albuquerque you
may have noticed some of the places you
can barely see lane markings and street
signs are missing or knocked over stuff
like that how well will the software
Adela learn to adapt for things like
that are you just gonna have to take
over anytime that the city you're
driving and it has been infrastructure
well so we do I know for example we are
relying on the lane lines quite at least
okay kind of the right without lane
lines but it doesn't work like a job
yeah it's getting back there so it's
getting over the time is getting better
it's getting like it is let you realize
less and less on the actual feature like
being pressed like pretty much like at
you but that's a chemical driving if you
don't say yeah one of us are driving and
there's no lines we can kind of
extrapolate from where everyone else's
yeah exactly so right now I would say
like it kind of depends on like for
example I clean lines safely but I don't
know I came down route 66 there's a park
that have no lines for probably
quarter-mile and identified the sand one
side of the right line just the color of
the dirt out here Apple to do that yeah
we were teaching the system to identify
a license just abstract it from a
specific line line Caesar but the next
release is like
and so-and-so
what Soviet rip just cast away with
Megaten
and it's an ongoing process I believe
that as of now we still have to do some
more homework and like making the system
better but like in parallel yes we will
be open to discuss we have done in the
past we want to keep doing it but yeah I
think they're usually two people
homework it should be a good path yes
University supported vehicles the
different different cars have different
lower speed limits where they lose
steering their acceleration
functionality is a sense of limitation
or actuators and DC is that improving or
the cars getting better the figure is
getting better the point is that so
certain cars like we have to make it
with the cats so we are like MSL
everything is kind of abstracted from
the car but then at certain point the
last the end is like a dependent and so
we have to obey to attack there are
their constraints of the specific car
hands so if the specific cars locks you
are for controlling like the brake
giving to steal for example below 10
miles per hour then there's nothing we
can do about that unless we last visited
like change the former of your cameras
which we don't want to do and instead
like the point of an Impala should be
really like creating something that ok
has to deal with limitations that can
have a car specific at the same time the
important thing is that open pilot
itself is capable of handling that
situation we care about vocabulary
pilots like a software that can is
actually up started and very general and
then of course like Africa is so
limitation
which is that we are forced to pay to
them but the more we move forward the
lastest limitations are our present
because cars that cheap now are less
limited and Catholic worship like a year
ago or two years ago like every car
pretty much liked by the for tends to
add adaptive cruise control we stop and
go so it means that they can't braking
and gas controllable from zero speed to
whatever speed like 90 100 110 miles per
hour so the directions get definitely
like more capable cars which we actually
stop early align that with the
capability of the pie yes but as the the
data streaming app I can how
standardized is that from one model to
the next or sensor specific sensor to
the next so like if you're reading let's
say speed data or for or radar how
drastically different is it from a
Toyota to a BMW or ever okay well so
among they they open source repositories
between ever like when pilot is one of
those repositories like software
software market where you can find like
a complete complete like set of features
we have we have another of the social
positive the disco like open D BC where
so the DBC file is that the file that
describes your your can your CAD data
this times are your candidate are like a
structure right and so this is like our
specific mainly car make and then within
a car make almost every car are very
similar with each other we have like so
you mentioned I have one file per car
those files are all very similar to each
other within the same car maker they are
the last
for anything for different car makes so
the DBC fight for Tata
Excel yeah but she's like another
project that we have again we are
reverse engineering this like can
communication and we understand ourself
what things mean cool well thank you
guys so much for coming we have a mobile
store if you are interested in
purchasing a tour t-shirt that's one of
a kind only can get on this tour we also
have the Aeon that Ricardo talk about
some sweatshirts and will be around if
you want to ask those questions we got
Eddie Harold myself and
right back on the road passing through
Novato Petaluma we're gonna be on 101
for 250 miles so this is this is one of
the best drives I think you could do
with a pilot highway 508 101 highway 80
if you got one Road we're gonna keep you
in the lane
hey what's going on
some people rolling here
and what's up count I just thought it
was so beautiful out that should start
recording again and see if anyone's
woken up Oh what's up Andrew
I'm driving to Arcada today it's amazing
it's 250 miles or so north SF and it's
just highway 101 so open pilot has been
at least 90 percent engaged what's up
man I hope you have initial Sunday
no I'm not I'm not high and I had a cup
of Pete's coffee and that you know
that's pretty strong I guess
after I actually saw Eddie and Eddie in
a Harold like spontaneously in downtown
Berkeley this morning it was kind of
funny
you should you should spend some time
outside today I think it's gonna be
really nice
this whole weekend is like first first
one that starts a feeling summer I mean
I love it up here in Northern California
is a true treasure
man you can see the wine vineyard
starting and everything hey what's going
on
I guess when the camera is facing me
it's like driver monitoring this you
know keeps me in check this is so true
you know I grew up here it's hard to
leave I'm gonna strip myself away a few
years you know I got some gossip got
some things to do in SF before before I
can go for a long time but definitely
want to travel to one of my friends in
Miami right now I don't know if it's to
to stereotypically you know like party
beach town but maybe maybe that's fun
I'm gonna
I'm sure the water is warmer than it is
at Ocean Beach
what's going on
I need more followers than too humid
yeah okay thanks you've been there
sub can drive enough to Arcada
some vineyards asana laughs lightly
I'm not stopping for any wine tours
today this is really good
three more hours to go a couple hundred
miles
but I'll open pilot has been amazing
this whole time
so
I'm sad I can't play music into a
periscope at the same time from my phone
all right I love to play music I met I
met an R&B DJ last night and I'm
listening to his soundcloud it's pretty
pretty good you know I love when people
tell me I have a SoundCloud I never know
how how popular they're gonna be and
this guy's got a following always always
wanted to be me to people you know at
least doing doing mixes and making music
it's too bad as they don't have an
in-n-out burgers on 101 past Santa Rosa
I think it's all their only on five so
you want to get food here you got to
stop at a and I love local diners I love
it I love small-town diners family owned
shops
makes you realize how expensive San
Francisco food is when you go to the
middle of nowhere and you can get a
breakfast plate for like six bucks
I've never been on Bona Arcada I've
never I've never been to Arcada
I'm German past but
I have no idea what to expect in this
town I'm going to I think it's close to
the beach so then I'm going to go to the
beach this afternoon
now what if periscope has six cameras
I don't even want to point this thing at
me because it's honestly it's morbid
hello over Dale
Martita dude
that is I'm gonna if there's not one and
I'm gonna peace out of San Francisco it
started I think I need a little more
cash to bootstrap but I would add I
would absolutely love to like go in an
arcade and like design you know our kids
kind of faded away but I really think
they didn't come back we need a good
amount to show me on yeah this is true I
should get a GoPro like everyone like
everyone uses for their YouTube videos
overtly Chris what's up I'm a pilot up
Northern California right now I'm gonna
keep my phone mounted I'd show you the
EON but you know safety safety is
important but yeah I'm engaged I've been
engaged probably not over 90 95 % of my
highway driving so far this is a 250
mile straight shot up one freeway and
Laurium yeah man I haven't even seen
like what is the latest you can get at
an arcade that's in downtown Emporium
will they have their
put your phone mount on the sunroof and
point it okay baby maybe on the drive
back I'll I'll come up with a better
mount setup because I would I would love
to I would love to have this whole Drive
recorded and as like a time lapse of how
the Aeons doing you know for four hours
maybe I'll buy a groat GoPro up in
Arcata
and like mounted on set up here
oh this is this is one of the nicest
drives I've been on and I've driven I've
driven up 101 many times in my life but
always manually and now they mean the
scenery is so beautiful of just you know
sitting back and enjoying enjoying this
landscape oh it's a nightclub in a stage
Olli should I'm gonna go there for sure
I once at a new parish last night in
Oakland then you on San Pablo it was
pretty good that's where I met I met a
couple people
the crowd wasn't very little the crowd
it was an 18 plus show and I don't know
the 18 to 21 year olds and two stuck in
their heads and so they don't really
dance a lot but there were there were
still some there of you a handful of fun
people there you got a really go into SF
to find the best crowds
are there any PR arcades yet you know is
that a set of thing we can get can I go
like say in a pot and like have all
these like haptic and other like sensory
like elements added on to a VR
experience that's what I really want
timing gauge should be in the UI I agree
that that would be you know I like the
counter up I mean on one hand you know
we don't want to we don't want to
encourage people to like maximize their
engage time in a sense to the point
where it gets unsafe but I think it's
nice to I don't I don't think adding it
to the UI necessarily encourage is that
I think it's actually just a net benefit
for like yeah I want a glance up there
and be like wow you know I've been
engaged for twenty minutes yeah like
it's kind of like having your drive time
back there
virtually Krita so he's still there you
should what do you what do you want on
your Eon UI
maybe not there or if they came deeply
it could be and I think with I mean it
sort of is when we introduce the the
timeline we'll go to it to the secret
stuff but you know it'll be really
visible they're like wow I was engaged
for three hours encourage responsible
engagement yes
yeah I mean we definitely once we have
the driver model ready to ship we should
the driver distraction model of you we
should definitely have that be visible
live of course but also also when you're
driving you know you should know like
boys oh how was the system doing it now
was i doing
you know that you I had yet okay what's
your your head you you you have you have
you know you got here early designer
here so this is this is your chance to
influence
[Music]
pretty clean
yeah I'd agree we're trying to strip
away things and decide what's what do
you really need to you know have visible
because being you know we honestly don't
want you to keep looking at the road we
want to put too much stuff there radar
arrow aligned with the steer angle I see
that would be cool
hold em on that do a prototype current
you guys stay married yeah all I like I
like the plane with rotation so that's a
really good that's a really good idea
we'll see how that looks on the phone
now these are some pretty sharp curves
here so I'm hidden you know staring
temporarily unavailable but I'm just
helping the well a little bit I'm still
engaged
I believe my Civic does have the
displayed additional torque which makes
it you know it feels very safe I've
never had I've never had the car you
know really do anything that I didn't
like and the stereo torque limit is
pretty pretty important to make sure
that they're in space the low floor
remove it eventually you know once we
have a map Plus really just Billy really
just a map we didn't start thinking
about removing Lisa maybe increasing the
torque 100 cars we can safely it's just
it's definitely a big leap from a safety
perspective so we want to be we want to
be very very careful we did take the
Prius up to the racetrack misty of you
if you want to check out the Prius
absolutely : you guys check out our self
racing cars video I Steve the event that
was the fastest Prius that was ever in
that was a very very fun weekend we took
we took the courious it has full
steering torque you know so we're
sending the can message that says I'm in
South Park and then we can we can turn
the whole wheel so we self park the
Prius around the racetrack
I will absolutely I'm just doing it I
want to do more driving periscopes and I
want to get a good mount so you can just
see how the whole the whole system's
behavior
and haven't been to the agent months
this is gonna be fun
I hope there's like cliff views and
stuff take a lot of photos
and I love no one in California
let's you know let's let's make SF like
2 miles tall like Dubai and leave all
this not touched that's what that's
my development plan for for California
right now although hey I should if I
want to play music on periscope what am
I thinking I should just use
I know where we are I love this bridge
you see I used to drive up here with the
family a lot you know go to Sea Ranch
this is this is the path to do so many
beautiful places
[Music]
you
right
for driving it's not really focused it's
only focus is there any key flick on the
screen and focus it it's doing a little
better it's doing a little better
yeah it's confuse you know apple's
algorithms aren't necessarily trained on
their autofocus model isn't necessarily
tested on
- sick Khem fig what's up control hey
Andy can come all the abstracts you know
q-tip but his Kamala's kam a al check it
out
q-tip
does anyone say anything now you got a
handy that's about it Hey
why don't you tell people what you're
doing we're driving into San Diego this
is like fleeing the dystopia part two I
already moved to San Diego but we're
driving a Penske truck rental 12-footer
packed with furniture and things I've
been living real aesthetically in San
Diego sleeping on the hardwood floor you
know real Steve Jobs mode but now we're
furniture in nice things you know we're
gonna comfort down and the cameraman is
my partner in crime
our life partner in life you know not
like that my partner in life is driving
a Fiat ahead of us should have poured of
the Oakland pilot to the you hope you
know I am minutes I want to talk on this
about a pronto done a I we just comment
on AI for each other Bluetooth
transmitter which is common I for trucks
and I'm really looking forward to being
able to eventually hopefully drive a
rental Penske truck that has a pronto
system built in
we got cruise control on this truck but
you know Penske is going to be the one
to do it alright we can talk about truck
rental companies and we can talk about
how at u-haul is trash u-haul wasted an
hour and a half of my time and I got a
charge back $600 on my car in fact
$1,200 from my card because the first
600 was for our truck reservation in
Berkley rolled up to the u-haul the
reservation time you're supposed to be
able to you know unlock the car from
your app but I clicked the unlock button
picked up and I got of some unknown air
please call John he called John straight
to voicemail
straight to voicemail so like fuck okay
there's a lot of you all locations go
ahead and reserve in Oakland so I
reserved in Oakland and this is uh this
is a human picked up assistant the
automated pick up so that Sutter you all
franchise and reservation 5:30 the
franchise says that listed hours close
to 6:00 on Monday
roll up at 5:30 doors lock no one's in
there I call their phone number I can
see through the window there phone
ringing inside and of course no one's in
there so we flipped off the security
camera outside about 15 times and I
called Penske Penske truck rentals are
professionals I call them in six minutes
told them where I was told him where I
was
and got my truck got my truck reserved
and we rolled up roll up to Home Depot
and got got a Penske truck the customer
service rep was beyond professional and
efficient so yeah if you're gonna rent a
truck fuck you all don't give them your
business gift and ski truck rentals your
business
that's an official statement I'm tonight
or tomorrow night at the latest Thursday
I will be creating an array of anti
u-haul internet properties we're talking
comms we're talking dorks we're talking
thousands that were they killed with
them yeah we're talking we're talking
thousands of fake Yelp accounts spewing
the truth the truth you know
if you make the internet bots and you
spread you spread falsehood that's bad
but if you make internet bots and you
spread truth I would say that's Noble
that feels pretty I've seen so far
[Music]
yeah so it's
it's it's it's up to us you know you can
call you all support you can get all
angry you know you can talk I'm gonna
I'm really I'm really caller support and
I'm gonna make my way up to manager
James speaker manager I must speak to
your manager and you'll be able to maybe
get up maybe get a message but you can
enact change through that because
because you know what really needs to
hear your message are prospective you
all customers is unfortunate evil as is
brands that's good name you've all and
people probably don't even necessarily
go on the internet before giving you our
reservation because then just like you
all I see them around town but there
there are many such cases of people
being kind of just left left out in the
water there when they're trying to pick
up their u-haul and I really want to
make sure that these people's story is
mine and the many others including her
so we might get u-haul scam store we'll
put a fake 501 3 C logo you know
Better Business Bureau all the all the
like logos you can put on the website
Kelly deliver us Kelly Blue Book
approved to Consumer Reports affiliated
yeah
an American flag
but we should also translate the same
yeah and you can click on your flag and
get the dominant language in your
country live translated on a website is
everyone needs to know part of the
Longshoremen's Union
I think the units could be in on this
there's definitely I'm sure the unions
have the same and many other reasons to
also also oppose you all
angrily sips water
this guy's gonna flush flush these
thoughts out highway five is beautiful
California's beautiful the Central
Valley is pristine you know I really I
really want to go on an El Camino rail
trip and stop by all of the missions
[Music]
my favorite mission is in Soledad
California which is maybe an hour south
of Monterey it's it's one of the most
call pristine untouched other than by
agriculture in all areas of California
Soledad California there's a mission
nuestro de Soleil that Catholic mission
of course Spanish missionaries set it up
hundreds of years ago it's a beautiful
place I highly recommend it
on that same trip you can also stop by
the pinnacles National Monument which is
like this part dedicated to these huge
ass rocks which is why it's called
pinnacles there's literal pinnacle rocks
it's fun it's fun place playful families
if young people ready for old people
great for everyone everyone likes rocks
if you don't like rocks I don't know I
don't know what to say please swear on
this oh yeah fuck you if you don't like
rocks lucky if you don't like rocks
yeah
it was someone who there are no rocks
Arkansas
there's no rocks in Arkansas I don't
think so what is there
[Music]
I guess there's this rock underneath but
rock above
I'd intended you know Arkansas corn
God told you this personally
now
I am into it in you know an act by our
Creator however I don't know God you can
just as just wrist tape and Nature Made
Arkansas have no rocks we can speculate
on the reason and that's art it's our
duty today everyone can just appreciate
that Arkansas has no rocks and has a lot
of corn and I really can appreciate that
effect and mr. John Tatum sped said
speaking of beautiful places check out
Swami's Beach and the meditations are
going to get dusty
hey with the meditation what meditation
garden I'm gonna go to the meditation
garden I'll bring my ex I'll bring my
extra-long yoga mat and Papa Lotus
one appellate in the truck
yeah
a lot of things they know things need to
be moved you know
chuck's our trucks are important
and companies like pronto about AI are
doing wonders for trucking and making it
safer more efficient in the end result
will be cheaper goods for everyone
cheaper goods cost of shipping drops
you know truckers have an eight-hour
limit lose all sedition Li like a weekly
limit for safety and it's a good I think
it's a good rule however we can use
technology to push that so that you know
the goal of a fully autonomous trucks
that's 80 years off but if we use driver
assistance systems in trucks and cars
alike can make driving better can make
it safer and easier to drive for longer
times longer distances and that's a good
thing
it's a good thing
polymerase we got you
well we're update number back down to
three we were up to eat I think your
aunt about truck needs goes away
chucking rocks trucking all the rock
eaters left and now only only the true
believers are left that was that was
intended as a test as a filter
hey this highway hasn't been adopted yet
really I think Rockhopper Holdings LLC
mind a venture side hustle which
eventually will become a made hustle
will adopt essentially this section of
highway five it's pretty beautiful
surprising it was adopted it yet wonder
how much that costs adopted a heroin
yeah like we gotta call the one eight
six six
adopt-a-highway and that was listed on
the sign dr. Heidi think you just give
them a like a cash me and I'm like they
take care of it here you know it's
probably irritating them cash and you
get a year to adopt it for a certain
amount of time and people probably renew
you know the government's kind of nice
like annual recurring revenue plan
they're both taxes and adopt-a-highway
well what if you adopt a highway and the
government's just like blazing
inefficient their highways since 30
millisecond company doesn't guarantee
like inverse effective like
like you your company looks worse yes
the highway highway yeah I wouldn't
adopt a shitty Highway section it's sad
because the highlight sections that are
the shadiest are the ones that most need
adopting what's the project children
what's my battery at
my battery dies
but as we all know the last 1% is the
longest percent
yeah this desktop wallpaper were the
scenery a bit like a drive-in to like
Windows 98 right now
yeah we're driving through the desert
and those night and I mean XP as the
experience exp has the grassy plain what
did was deaf
shit I don't even remember I just
remember the Vista taskbar you know aqua
aqua theme they were like wait we need
to make windows look like max what a max
look like aqua looks like you're
underwater they still have the swish
yeah they just swish yeah yeah yeah oh
yeah but uh Wow max were like waiting in
a warm Southern California pool that was
there aqua design Vista was more like
waterboarding
[Music]
we got our back 1 2 3
he's from Russia apparently hey I love
Russia
please
but I think of Russia I think the
Modesto California was snow on
it's a great truck we got that AC
twelve 12 volt power where USB
I'll show you you almost have this
good air bags over safe yeah we're safe
jeez the worst thing about airbags being
deployed is they smell bad really
what are they smell like
the stylist air
possible that's been like compressed so
it like is accelerated as
like it's like becoming stale there's
other like they have other probably
other gases in their bag other than just
peer you know care oceanic air it's
probably like some other shit in there
that just affects the smell be at like
you fucking crash your car you're fine
but then you're like you smell a mixture
of like total engine and air bag air
about the designer air market do you
think that's gonna become a begginer
life designer
yeah you know like the Chinese and all
these people with these countries that
they don't have clean air how do you use
the designer air and I get like a like
an air tank like for scuba diving you
just sit in your uh hey Lily if they can
made stuff thinking they can and like it
compressed air tank not look like as
much of a medical device as it does
right now so now we make it look like a
dual cabin yeah if we make if we make
the compressed air look like a tool and
in fact if you maybe you sell it in
disposable like containers that would
even be better make sure that you are
recyclable in some way though or else
people will be concerned about the waste
the people are showing us love
okay yeah sure why don't you wanna you
started this why don't you get it to the
point you bring the designer hair market
to San Diego
I feel like LA needs it more than we do
yeah I mean you can start the business
in San Diego and make him sell it on the
salad and on Venice Beach next to the
next to the cannabis dealer
yeah you know that's that's definite
that in my work
- it must these people are high they're
probably kind of gullible yeah they want
some designer hair
I want to call them earbuds a good idea
I can pull it if you call them user
space pods especially because they're
totally different category air - putt
well that settles that I'm gonna take my
entire all of my savings in two thousand
dollars yeah I can get a nice line of
credit look every almost every
successful entrepreneur I know at some
point or still does have like a shitload
of credit card in credit card debt is
bad but if you like clearly it's like
you know spending it's unfortunately
it's the most accessible force of debt
for for like independence of all
business owners result proprietors
trying to try and get something off the
ground I know plenty of people with like
tens of thousands dollars of credit card
debt that they're worth 25 billion on
paper it's just it's all full of like
Silicon Valley stock options and they
can't they can't like exercise them
without like out of the front of tax
bill so you can get a loan for the tax
bill but it's still kind of suss and it
takes a lot of takes a lot of time and
energy and still risky so
yeah and I think we're gonna make our
money is probably by simplifying
electronic payments I think that's what
there's a lot of people trying to do
that man I know I know but we're gonna
do it and a semi-legit gotta wait I'm
gonna use QR codes yeah all of China
we're gonna bring WeChat to America
yeah we need to make America sweet chat
shit sounds like returning with them it
sounds like I don't really want to
compete with Facebook and all these
other people that like really know how
messaging works to the extent that I can
benefit the message in speeders by
making messaging BOTS and like I don't
know some like retro IRC interfaces for
for modern messaging apps I'll be nice
and here the Japanese are big and
illiberal point up the Japanese are
being a web link we know I'm gonna look
into this go uh someone in the chat go
look like a Japanese website find out
you know what they're like they oughta
slap one find out which Japanese website
web 1.0 and it was a little more
functional you know I didn't have a
loading spinner when you loaded the page
you know your links were links you could
right click them and copy the link you
you know there's a lot of benefits to
doing things web 1.0 I think I've got a
hybrid approach is good things can look
prettier in web 2.0 released all three
miles take exit 407 for California 33
toward 7 Villa Gilroy
right up to the counter straps to the
counter and we'll only put the phone
down if they say no video recorded in
here we can allege there seem to be
right there
looks like a CHP truck I've never seen
one of those we have the ischium lovers
oh yeah you know that because they can
fill them up with like a bunch of
candidates a bunch of lead bags and they
can spend they and they cease yes you
know it's a weird in certain parts of
California CHP like that these white
cars I don't know like
what the distinction is like what is
like you know once they should be like
what a distinction and sees me yeah like
why do you get a white squad guard like
certain parts of his name
yeah I didn't know how that works and
you know how the statesman's are our
money are we going to China someone's
desk girl in San Diego we're driving
there half-a-mile tickets at 4:07 by 1
million 33 toward 7 Villa Gilroy the
infrastructure project this world needs
is a giant freeway across the Pacific
from California to China
oh shit the Korean take exit for us all
right
abort periscope aboard periscope we got
to call him in a quarter-mile
If w not that many followers and they're all at work
A first viewer welcome to my drive
Welcome we're driving to San Diego
This is the kama AI Exodus
unfortunately, I'm I
Didn't get to participate in the kama caravan, which departed yesterday
You know think like six self-driving cars following each other like like Tesla
talked about with their semi trucks
That's what that's what that's what the rest of the crew got to do yesterday
but I saved another day and packed up my impact of my apartment and
Driving solo down to America's Finest City. It's the official slogan. I love it
, said, you know moving to San Diego we published the article and
Immediately we had like 10 like
organizations and individuals from San Diego just say welcome to America's Finest City and
They all share this slogan, so I'm really I'm really happy that I
Moved into a place like I feel like I've moved to any other city and I mean, I don't know
I don't think there'd be such a a
coherent Schill army for the city
Which is quite a nice thing
San Diego's really nice
I've lived in San Francisco for you know Bay Area for 23 years and grew up here and
I'm really excited to
You know test tests out how the rest of the country is
San Diego I know it's not the rest of the country, but hey, it's far enough away and it's still
California even more beautiful than
California that I know
So we have really excited for my money to go further for comma to be close to
Qualcomm and you know other sort of
hard technology
We're one of the first consumer brands, you know consumer electronics companies to you know, startup stuff to land down there
And I think the labor market is less tight in San Francisco. I don't have to pay a JavaScript engineer
$300,000
You know that can hire people of all ages if I hire someone in San Francisco over 30
And they're already there, you know, they're they're probably expecting. Yeah, like, you know 200k Plus salary
Everything's inflated. Everything's who played in San Francisco
so yeah real excited kind of just
Talking to the stream there's fortunately no viewers
But I'm gonna keep this on
Going to keep us on and as my followers take breaks and their work day
When might need followers wake up turn on their their computer in their Twitter timeline
After a late night Mountain Dew and counter strike go binge
I
Hope I hope I hope they'll watch
Oh, yeah, he's 580 destination Fresno
Definitely Fresno is definitely not America's Finest City
Hey, what's up?
You're the first one in here. We had a few people. I'm good
We had a few people come in and leave and I've just been talking to
The boy it for five minutes
Yeah, I'm driving to San Diego right now
Driving to San Diego
because comma AI my employer is moving down there and
I'm real excited. Yeah, I'm I
Have lived in the Bay Area for 23 years
and
Yeah, North Bay East Bay, you know up towards Sacramento and yeah really excited
to move to San Diego got probably about eight hours left on the drive, but open pilots driving and
Got my oh, hey, that's awesome. I
Really wanna I really want to visit sometime. Oh
Yeah, oh my oh my Indian friends come back and they're just like wow, I can't believe you know, India
And it's especially in the cities and it's chaos is still functional
but they said India is a testament to
human resilience and
Beauty so yeah, that's great
Let's see see make it a road shop
There we go, yeah, this is a highway 580
From the Bay Area going east got to go east to the highway 5 which cuts down in the middle of California?
Yeah out here. I really don't know if you ever used Windows XP
but I get I get the vibe some of these hills are as green as the
the Windows XP desktop
paper
wallpaper
This is a beautiful part of California, hey, what's up drew?
What's up
Driving San Diego
Taking the rav4 got it a pack to the brim with all my stuff and
Yeah real real real excited to land and start it and start a new chapter with comma I think San Diego will be where we
where we grow and
Suddenly you're looking around on the highway and all these Toyota's and Honda's have have eons mounted on the windshield
And half a mile keep left to stay on i-4 how much people you I don't know it
Can you I'm not sure what that means
How you doing true
I keep left to stay on i-5 80 East
That's okay, I'm happy. I'm happy that you here and watching
continue on i-5 80 East for five miles
a welcome
Oh beyond me, it's a good username Hey
Ever driving highway 580 right now
Going east it's quite beautiful out here. I love we got we got the windmills
Got the windmill
It's smooth driving out here
This is sy way. This is my second open pilot road trip in like three days. I
drove up highway 101
with only a handful of disengagement to
To Humboldt County to see my friend
very beautiful drive
people like to take their
really fast cars up highway 101
So you gotta watch out for cops are always hiding on the weekends expecting to find some like, you know
Some dude flexing his Google bucks, you know in his Lambo
Yeah, yeah, yeah, I'm running I'm running a secret good model
Which is actually
It's better around town than the freeway
But it's been working pretty well so far
I find I find it can cut this model can cut turns a little bit on the freeway
But where we're working on sort of combining
This new model technology with the production
The production land model and
Yeah, I like to when I whenever I get off the freeway
I often just like go on SSH on my phone and check out the other model and then
Cruise around her around town. It works really well
where I
Just lived in in Berkeley
Oh man this yeah, I don't know drew if you were alright, this place gives me incredible Windows XP vibes
This this part is part of 580 because you got these like rolling green hills
It's it's beautiful
And there's no yeah, there's no traffic because yeah, I agree there's no traffic this way
I I saw all the poor commuters going the other way and
whenever I see traffic, I think look I
I hope I hope that we can deliver, you know, affordable driver assistance systems to all of you
So so even if
Even if you got to deal with the traffic, you know, I hope you can at least not be angry
Hi Alex, my name is Andy
Driving to San Diego
I don't think I'll periscope for 8 hours, but
Definitely at some points along the way. Oh
Yeah. Oh, yeah
I'm sure we'll all be or I am right now Alex. I am I am
And will town in my end, well, I'm on the way toward Stockton I'm sort of in between
Dublin Pleasanton and
Stockton
but yeah, well
we'll definitely be running the AC in our cars and certainly our next Hardware product will be very resilient to
dire temperatures
You know, I am while the EON definitely has flaws I am always astounded
I'm always astounded
at
That this legal a pro 3 can drive my car
And I know that if we could rice this one together
if we could rice this one together with the with the Lego and the one plus three that
When we have a mile use the right two lanes to take the i-580 exit toward i-5 South Fresno
when we have our next product will definitely be much higher quality and we can we can we can design it to the
specs we need
Yeah, we're hopping on the five now
Use the right two heads, so don't worry we're way past that Don and done
Continue for 241 miles
Into my unreleased unreleased jailbreak
Oh, yeah. Yeah, that was the best part. You know, it was glad it wasn't all marketing speak and they went into
you know, really and
NVIDIA needs to and media needs
Needs people to show them that they're not top of the game, you know
Tesla needs to really really nailed into Nvidia that like you guys
Like screwed us around or you know couldn't couldn't do what we wanted and we did it better
and and videos really in sad state, you know, they
They're selling up but the moment you want to ship a product
With an Nvidia, you know
Video chip or you know Drive px or whatever. The flavor of the month is
They're not they're not gonna sell to you and comma had this experience. I
spoke with I went to this DIY Robo cars event in Oakland last weekend and
Spoke with a self-balancing bicycle company that also had a similarly poor experience
you know excited to use in video stuff and then realize like one they're not going to sell it to us to
You know, they they're still very like their Linux support is still really janky
you know the
If you go on like Nvidia Support Forums the often times and in a thread where something's wrong or getting a segfault or something
The support people and/or the Nvidia engineers themselves just say well can't do anything. Sorry
So to really, you know, they're still good at GPUs, right
You know, but the
Nvidia just doesn't want to sell things especially to startup companies and you know test the tensile is I'll have you know
Nvidia chips in them but I bet Tesla had even a Tesla scale
It's not just that they're Ken Vidya is only going to sell the Tesla size companies
pretty much all their customers in this
In this field and you know in autonomous driving that are trying to ship real products
are not satisfied with what Nvidia is offering so
It's a it's a sad. It's a sad story
but you know, I hope I hope Nvidia gets their wit's and
You know starts starts distributing, you know good novel products to
you know that end up in people's hands that end up in production, but
See it pretty much seems to CPUs are the only thing to really have in production right now
Five is beautiful
At least oh
Yeah, I got that good good farm smell coming in
Right
What's that video
I love that the Tesla community and you know the Tesla Tesla forums, you know, just trying to try to hack their Tesla's
I'm happy that you know that that community exists were
for Tesla owners, and it's always cool to
You know see people's analyses and visualizations of the Tesla Model
It's uh, this is quite nice
Still waiting for the first
Windows 10 on Tesla computer
I don't know if that will ever happen
I guess I'm in Tracy now
Tracy, Tracy, California
Yeah more powerful more
Reliable Aeon
and more cameras and
Probably going to get ready to depend on giraffe to
You know, let me just want to sell you one box
My thoughts on Tom a day for Tesla
Yeah, I like ya as
Drew was talking about I enjoyed the the
Chips part of it. I think they're doing great innovation there and they're you know
exceeding in terms of performance and power consumption
what they could buy on the market from Nvidia or anyone else so
I'm very I'm very happy that they shared they shared that with the world
I'm happy that they're making progress on their driving system. I think that their timelines are a little aggressive for
You know the rideshare Network though, the long-term vision is solid
Yeah
They're you know, I'm excited for them to keep keep improving the driving system
and you know, I'm sure they're aggressive timelines are in part part in part there to
In part there to make sure that you know customers are hyped and excited and think they're good in the futures near than ever
And are also for their their it lights a fire into their their engineers ass
Definitely not the first fire we all we all know that Tesla works people real hard
But
yeah, so I'm excited to see III don't believe their timelines for full self-driving, but I think that you know
It'll be here sometime
and I hope that
I'll they continue to improve autopilot
And yeah, I'm very
very Pro very pro Tesla and
the Tesla vision and mission
but
Yeah
Yeah
Yeah, who knows I mean I did
I wonder if they do they have like redundancy that you know people think is required for you know level 4
level 5 stuff
It comes software ahead affairs
On par in a lot of areas like we don't since we're still dealing with a forward facing camera, we don't yet have
like auto lane change
Or
or
Navigate but so I'd say we're trailing them on on sort of the feature list
But open pilot drives better than autopilot in a lot of scenarios
So I
am and we have a driveway of a camera based driver monitoring system that they did that they don't and I think is really
important for
For for safety with with high quality level 2 systems
So yeah
I'd say we're really just trying to stay on par and if we if we succeed in that
And there maybe exceed what Tesla's can do?
Then we'll be in a great place because you know, not every we're not we're never gonna see a road
That's only Tesla's cars are very like
They're very personalized people want there. They're an item of
expression
People want people want like their own looking car. I have an instrument arresting anecdote actually
And you'll have to buy a new car and every year
the cost of buying and open pilot compatible car decreases
Which is really nice like the earliest supported car is the 2016 Civic with touring
So, yeah that it's it's it's definitely nice
One interesting anecdote I have is
so the top-selling top revenue out II dealership in America is
in San Jose or the South Bay area and
I heard a convert overheard a conversation with like manager the dealership recently
Who was saying that they're seeing a complete influx of tesla trade-ins as well as many customers are citing that you know
Like there's too many Tesla's in the South Bay
Like if you ever been this South Bay like you're gonna see more Tesla's there and you do anywhere else on earth
And it's really it's an important anecdote because it like South Bay is basically hit what I call peak Tesla
Like there's there's like a density of like Tesla visible Tesla's on the road and in your office parking lot
at which point like the desire for your
personal desire to buy a Tesla if you don't know any havilland decreases and in fact your desire to keep the Tesla you already have
decreases
because as I said cars are
People want their car to be an item of expression. They don't want it to just look like everyone else's
So that's another point that makes me optimistic
You know about you know, the
You know other cars both of Comus aftermarket level 2 system as well as you know other OAM systems
you know succeeding because
you know look even if Tesla the best auto pilot and like say there was no other company giving us on amia way I
Still doubt, we would not see you know, like everyone convert to Tesla
just based on looks and
Looks and of course, I guess supply alone
So, yeah, look at let's let's make let's let's make sure we can preserve
you know, you know the the diversity of vehicles that people want and
desire and
And then make sure that they can all have, you know cutting it
More options is always good. Yeah
Hey, what's up, we're driving to San Diego Highway five all the way south
In open pallets engaged left lane in at about 74 miles an hour
And it's beautiful it's beautiful
Oh
Yeah, oh
Yeah, it's great
10 San Diego traffic's actually, not bad
We do have a ton of customers in LA. All right. Good luck drew. Thanks. Yeah, I'm gonna get a burrito the moment I land
Where the most people are hanging out in downtown, San Diego
Like for leisure, it's kind of a boogy boogy neighborhood Little Italy
Though there's so many nice things around. We've got 7-eleven on the block. We got a
We got a
desert place right across the street
and
Yeah, I've been commuting in San Francisco like 40 minutes each way to comma which isn't bad because I got Oakland powered, right?
But I have a five-minute walking commute now, which I'm excited for
I'll just now have to deliberately hop in the car and go places to use open toilet. So you
Know got to make sure we're still using our stuff every day
Yeah, we got we got like one of the only offices in downtown San Diego with like two garages
In the front, which is quite nice
Yeah, this the office space for renting has in the past few years been you once everything is in place
Really excited to have like adequate power
Now we had we were running like the power cables for our 3d printers and like servers
That were in our house garage. We were running those cables like - like various bathrooms around the house
It was like a nasty like power setup
But now we have you know, we working with electrician. We got like 240 full outlets for you know our servers now
And so yeah, we got we got we got power to train models and
Obey the Internet's better - we're running on a Comcast residential backup where we have like like
Verizon Wi-Fi connected to our router
So hopefully we don't have to play the internet juggling game
You know the moment the internet down don't internet goes down in the office. Everyone's like hey is the Internet down what's going on?
Don't don't cut us start ups internet that
As a net negative on productivity and you know
Internet's down long enough. Everyone's just gonna fuckin go home
Okay, well I think I'm gonna stop and get some lunch but it's been nice and
Atacama AI archive is gonna upload this video
Probably already streaming it using some bots a huge fan
Thank you for doing that work
And yeah, I'll catch you all later
what up Twitter
sometimes forget to click the Twitter
woman oh good art we got people joining
that's good
um yeah where my red white blue maverick
hoodie today in honor of America guys
know I'm from America I love America
America is a great country cuz we have
freedom we have we have First Amendment
Alex are you telling me America's
terrible I love America I love America
and that's why I'm wearing my red white
and blue
maverick hoodie the great thing about
America is you don't have to love the
government you don't have to love the
people but you have to love America I
don't know what it is but just sounds
good you'd never say that don't ever
America has has has provided me with
with so much this tree see this tree
it's part of America okay okay so that's
that's honestly you guys always take for
hugs I swear I'm not on drugs today but
we are here to show new friends ah maybe
I'm a little biased because I live in
America I think everybody should feel
that way about about their country you
could say you look at the greatest
country and I'll agree with you probably
except as long as it's America yeah new
car
America we are going to talk about our
new car it is a Honda Accord 2.0 touring
oh yeah check it out Accord 2.0 touring
look at that oh yeah they detail at
night I'm a little bit dirty
yeah alright um so let's go for a ride
let's see what we got here see is the
key I don't know where the other key is
how much well we traded in the Ford
Fusion so the Ford is gone it is not the
year of the for the year the Ford is
cancelled do I like it
I liked the Ford better to be honest I'm
an honest person
all right just drive that a time on yes
I only metaphorically always white white
is nice it's got this kind of shifter ya
know the car dealers don't ask too many
questions
it reminds me a little of the white
Acura
wait why won't it rev sport
where's this crap okay well so it's got
some like limiter or something I guess
it kind of makes sense cuz I'm in park
um I think it has a hard I don't know if
you guys can see it yeah check out the
hide these things are kind of stupid but
at least you could turn it off no no
nope the ILX is still over there you
could see it oh yeah ball so hard that's
right
let's see what else we got in here okay
here's the window sticker so it comes
with all this great Honda sensing
so up here we have the camera with the
Bosch system so we're gonna build open
pilot support for the Bosch system got a
skylight up here pretty nice traffic
sign recognition on the hide absolutely
so let's put this away we'll go for a
little Drive just a little too much
look at that 17 miles
poor supercruise - acura we can pour it
supercruise - this car baby oh yeah
stick turning radius it really like when
you view this thing as a sports car and
not at like a luxury sedan you enjoy it
a lot more pretty cool guys this is a
Honda Accord 2.0 liter touring the
top-of-the-line Honda Accord and we're
gonna support open pilot it has bosch so
we'll probably be releasing our first
reflash of the bosch radar oh man now
this car does make you want to raise
people
oh yeah
all right that's pretty fun guys but
yeah so hello to our brand new Honda
Coors got a backup cameras pretty decent
all right you know what you scope is can
see this yeah the Ford didn't work out
oh yeah oh that felt nice oh there is
self racing cars um let's see what we
can do here what's this oh look it'll do
the projection to straight down that's
pretty cool let's do a review of this
thing is it any good
parking brake electronic parking brake
who trust these things we got econ we
got sport we got I like these shifters
and they're pretty nice yeah that's
right it's not so nice oh I can hack it
we got Lane Keeping Assist
we got the following distance button
we'll be sure to disable that really
soon volume on the thing no I just drew
some GM's yesterday I kind of like this
LCD like that
[Music]
[Music]
in City of Compton oh look at that
seismometer oh that's pretty nice we oh
yeah yeah look at that's a nice view
actually what's red line just a sports
car man
I really it makes you want to go right
next tight steering wheel but yeah no
we're going to uh hit sport on tack mode
it switches I let's try Oh what is that
is that like boost pressure or something
oh it's turbo pressure oh that's so cool
no no no this is not a CVT it's a
ten-speed it's a ten speed dual clutch
I think it's dual clutch I didn't feel
shifting lag at all yeah so this is
absolutely not a CVT this actually has
the same engine as the Civic type-r just
a detuned variant of it kind of cool too
I wonder if you can reflash it and get
the Civic Type four arms they claim it's
a claim it's I don't know like but ya
know it's the same engine block that's
the same type are not dual clutch this
week do a test drive we always do test
drives let's close that up
cool scope ease so there's our new
friend bond cord touring we're gonna be
adding support for it to open pilot so
we're also gonna be hopefully selling a
Honda Bosch giraffe eventually so you
guys will know what the new product
announcement is when I say new product
announcements alright thank you for
watching
welcome to the future and the future is
Honda and Toyota it is the year of the
Honda and the Toyota and it will be the
year of a Honda Toyota next year to give
us Honda and Toyota are the future so
far log-on Toyota today make sure to go
shop now comment on the I get your Yan
and Panda and giraffe and install the
great - camps offer focus that's right
brevin to anybody who watches me not
focus uh
you gotta tell me George you gotta focus
right yesterday almost bought of GM and
nobody in the company was like George
why you're buying a GM you got to focus
people were supportive can't do that
your scope these know us up
remind me focus because we're gonna be
supporting what cards we're gonna be
supporting us
or cars who knows six cars who can name
them all ten minutes ten minutes go
that's good I like the new I like to do
format
well guess one good grandpa nacelle left
it alas go P nope now Subaru is eyes not
on the list that's right to be removed
by dealer Oh take the airbags out just
the sticker that's right Honda and
Toyota I'm a big Jesus man love Jesus
but also love the Honda CRV the Honda
Civic the Honda Accord the rav4 the
Corolla it may be the Camry maybe the
Kaveri
maybe not the Camry I don't know you're
my friend - Lord Trenton everybody's my
friend who's not my friend who's not my
friend I don't know I don't know man I
like what Yvonne's been doing lately I
like what I like what oh yeah I know
your chase I know sob my name - printer
after you I like what Ilan has been
doing lately Pravda bro it's it's it's
really it's so unfair the way the media
attacks them for some of this stuff love
woody Long's doing a lot is a bro bro
army loving that stuff no is he in a
midlife dude that's what I said him this
morning in my tweet
it's not about ideas everybody can come
up with why don't we have a rocket that
shoots up and lands yeah easy idea now
implement it and make it a profitable
company that's where the skill comes um
you are describing reddit in a weird way
yes one of the problems even hacker news
even hacker news they frequently linked
to to journalism sites right um I have
an idea that this is like a few
reporters who are particularly bad I'd
love to see like reporters track records
on whether they basically like a factual
t-score and a clickbait eNOS score um I
think would be cool I'm very excited to
sign up for Pravda or whatever whatever
it's gonna be
I don't do it but I don't think it's
good idea execution is key it really
comes down to execution and that's what
this
that's of every startup is like if they
could think about like like uber Airbnb
right Oh what if we like people drive
each other around
yeah easy idea now execute on it people
give out their house yeah easy idea what
it was like a box you could type
anything in and it would give you the
answer yeah that's Google right do i do
have Tesla stock I almost bought GM
stock yesterday I am hyped on GM but I
didn't didn't buy any GM stock good
thing I didn't ever by Ford stock Ford
stock is uh it's like the monkeys from
the e-trade commercial before they flip
that chart so that is what is going on I
sound so that's straight I think that as
a compliment I like that
sometimes I like the way I sound when I
talk usually not on the scope ease
but yeah what's up um so that's that
this is my new friend it's a Honda
Accord Tesla Auto correlation I don't
know what that means it's Auto
correlation auto car later happy guy the
common tree is not cut down we still
absolutely have a commentary of
commentary and a comment three are we
don't talk with that alright cool thanks
go peace
bye-bye blockchain we love blockchain
bye-bye
hello Scopus ed are you ready are you
ready okay we're doing a an update from
comma research for you guys
so I'm handing it off to editor and
Herald but I'm doing the filming
come on researchers off see this is
Connor research crew oh you know what I
should find it was too late but I should
have I should find a stabilizer it's
really cool oh my god if you're driving
at this very moment the E on me should
be paying attention we have drivers
monitoring really alright guys so coma
research has three things to tell you
right so the three announcements don't
read the board know like them so how
many people do you have we have 91 91 so
this is the timeline guys this is the
three priorities yeah so those are the
three things
waha beitia say Babesia it's like the
goatee or something all right so three
things that come on research is active
so coma research is not to desert it we
make projects so it's R squared the dill
and the 888 project so this is for you
guys to understand what we will be doing
right because we announced the coma
research but now we have to know what
come on research is going to be doing
and how is it different from call
product is it different
so the question because the first thing
that we want to make sure is that
research and coma
oh I all the research in other places
it's not a scam right usual research is
just this multi-level marketing campaign
where you just like the research publish
papers go to go first so you can hire
more researchers and your company can
look all right until you hire real
workers that do all the job mm-hmm so
common research is different by the fact
that the research also makes real things
here on this R square we will be doing
are you breaking common research yes
people are saying where's the stream at
it what's happening are we not live
someone responds with notes fine okay
okay okay well once that one final
question should I landscape it for you
guys yeah so what are you guys for firm
all right this is a secret it's just
laggy Holly because I'm backing up my
phone at the same time okay we're ready
okay so our square do you guys
understand us where can we go to the
next one
yeah so our square of one of the things
that our square is gonna do for you have
you guys heard about the big model you
been here dude everyone knows that big
model everyone knows about big mall but
there are the issues about the big mall
right the big boulders big entrance a
lot of energy so one of the things that
our square is gonna do is this stilll
whatever big mobile knows into a small
model so it's model drugs just as good
as big model so that's one of the things
there wow yeah big deal yeah no no
Oh big deal okay big deal is the deal so
what did what is the deal no they'd have
to understand this valve okay no I'm not
joking
yeah this is this mm-hmm exactly so
here's orange as a deal you see how
important to do is because they do get
some like a lot of space on that no that
makes no sense you need to explain what
no it doesn't matter it gets a lot of
space and this is important that's what
matters
orange no you're talking about literal
space yeah there's gonna be a quiz at
the end so you know the bill is stands
for the driving intermediate layer or
language or language it's what guys so
you have to understand this because this
is pretty much the future oh no
seriously listen listen listen stop stop
right there okay deal no big deal
is what is a second driving car right a
self-driving car is a three pieces piece
of technology right it's that humor it's
the car itself and it's the AI and each
one of them speaks a different language
the human doesn't think of like how much
accelerate how much I want to steer now
the human nose I want to get there this
fast right and you a car
is this mechanical thing that is done
and then there's daily act which is the
software each one of them speaks
different language and then you have a
bunch of blue code that communicates
them the dill is here to solve that the
language between the car and the AI and
we have a lived some weeks weekend
little bit I know but it my phone
accidentally went quickly
okay well show you someone wait ready
dopey boom oh this is the you know the
debug so this is the dill right here
mm-hmm this is kind of what we expect to
be the common language between the car
and the AI so it just goes through like
where the lanes the red shows you where
the driving limit is so you clearly
don't want to drive in the trees so
that's where the the red lines separates
that when the orange is the lanes and
lane markings and then the yellow is
where the other cars are from the radar
so the idea is that we can make a model
that will be able to you know generate
these types of this type of
representation of the world as you can
see on the right and that should be
enough to be able to control the car yes
and navigate yeah you look at that you
know exactly where your room is so does
the AI so that's a car
we are leaking secrets mostly that's
enough that's enough you're right you
don't want to look too much into
surprises yeah yeah okay so that's the
deal guys that this is the common
language so and here here goes the
question why do you want to build this
unified language right so if you are a
person and you understand where a
self-driving car is doing so it's too
safe if you are a customer electronic
company like Samsung wherever or
something and you want your copper your
devices student look understand
self-driving cars to understand right
now well you can drive the car you have
to spit the deal and if you are an OPM
if you are
car company and you want your car to
interface with this common language
there's gonna be bass Tanner it's gonna
be you don't understand how big this is
gonna be but but yeah I feel guests can
understand you guys recently but today
if today you want to start speaking
they'll if you think your company should
start speaking the deal you guys should
call Ricardo Ricardo Sarna CEO everybody
knows Ricardo so follow up with Ricardo
is be more than happy been his email is
viv at common dad I am so the last thing
that we have to tell them but not least
is the Aiden a product unfortunately we
cannot leak the full meaning of what a
deviated stance
yeah but 88 projects about HD maps and
we all know how how much you guys are
excited about HTML so we can announce
that there will be data lots of data big
data
Aaron wants to make sure you guys
understand it it's very big and there's
also open source software with big data
because just data's cheap without
software right guys so there will be a
lot of data and here I want to show you
guys a little bit of what this thing is
gonna look like
so the idea of making self-driving cars
HD maps is by making sure your car can
understand how far away things are right
so we are working on right now we want
to work on but we are working something
for you guys which is that vision for
young so we'll have that vision for you
this is a young image and precisely this
image not that one but some other image
there is some where and then I have a
bunch of visualizations don't worry
about it so there is this one here and
this one I know exactly where the image
is
got a clique damages you guys are gonna
see the images so an image like this
this is what a regular young you can see
yeah
and business and young with 3d vision
Wow so yeah humans of that well yeah so
they aliens gonna be able to see in 3d
you're gonna be able to see how far away
things are and that goes into the dill
right because the deal understands
distance the deal understand but that
also goes into the HD maps and that goes
into they attain a project and if you
want to make sure by the way EDA is
about open source data right and beauty
HD maps here's one thing about beauty
hmm what's the point of working out by
the way huh what's the point of radar
now what is the point of razor 7s what
is the point of radar well radar and
things like radar and radar can help us
know how our crazy are so we know that
we heard at least just as good as them
and later we are better than them yeah
yeah
so you know you finish your presentation
we'll take questions at the end that's
okay yeah so here's one thing here's one
thing the alien a project is about
releasing data right data for HD maps
data for HD maps is about knowing the
distance between objects in the camera
and also knowing the distance between
two views of the road so if you have
something like this like these are
different routes on that people driving
the car they are open pilot in different
days right
and then we know how close those images
are and then we try to match them how
far away is this camera from this camera
to this camera here's one thing if you
guys want to make sure you're part of
this data we introduce you a concept
called common raid which is about
several okoma
Ian's driving on a single highway well
you don't have times that I wasn't
that's way more exciting wait wait wait
but if you do something like this let us
know this is not mandatory we'll figure
it out a way to do it without this but
if you want to make sure your data goes
into the ADA a project you want to get
your buddies in your common meetups and
drive together down the highway
preferably with a different ways and why
this is a thing because it's this this
is the kind of images we are looking for
to build a date if you if you drive in
the same place with other people even
without using your pen pilot just even
with great panda you increase your
chances of going into this data set of
having this data in the big open data
set for for the world because then there
is no elimination problem right
everybody's ready at the same time of
the day you make sure your data goes
into this into this data set this is
something we were building for you guys
to make sure you guys through part of
the research just as far as you are of
the product so multiple cards not
multiple eons in one card multiple cars
yeah just go to the same server and then
you know it's about it's about complete
quest with your friends
it's about completing quests together if
you put multiple we use on your same
cards to a long yeah but it's something
much social it's nice okay so let me
yeah that's real good the three Nelson
let's let's add one more announcement
because we have 96 viewers and I'm
organizing the self-driving car tour I
don't really I appreciate that more than
you never know this um I don't know but
we are planning on stopping let's say I
let's put this here
okay we are planning I wish I could just
put you guys somewhere but I can't okay
we'll just hold the crew like this we
were planning on stopping in la la fenix
Albuquerque or Santa Fe wherever you
beds aren't let us know potentially
Oklahoma City someone said they were
near there Dallas and New Orleans so you
guys should let let us know message me
on slack or email me Vince at common dot
a I if you are in one of those areas
want to help organize and meet up
because we're coming your way with a
self-driving car tour and we'll have
merch first sale only on that tour okay
questions for this good houston yes
short wherever o as long as it's on the
way from SF to New Orleans I've never
been acute and I'd love to go so yeah
Houston sounds good message me I'm
Julius have questions about what was
just an ask though we've got all the
time say what's going on sound is fine
that okay that should tell them about
better room yeah yeah yeah sure okay so
yours no no let's not show ya you should
love them we shouldn't let them see when
it's ready right yes I just saw like all
rigged dot that stuff when it's ready
yeah behind this room is a whole lot of
secrets that we actually really can't
share
yeah we'll share when it's ready okay
that's better so okay what format will
HD landscape delivered on huh what
format will HD Maps be delivered on
there's gonna be a bunch of pictures and
there is gonna be a lot there's gonna be
several images the GPS tracks
annotations about how much you want
camera from one image change to the
other switch size software that makes
room is so yeah that's we plenty they a
day to be like the vs. staff over
building the ultimate highway driving
research data set so can they access the
maps if they're non yon user can be s
the maps access it access them oh the
map is gonna be open source the bet is
gonna be for everybody
yeah good editor say we're using a depth
net if I were using a bathmat
yes we are training a bathmat and we
will have the can't do we will have on a
mural metric to predict depth and
distance is from product okay so yeah
it's gonna be software based app by the
way do you guys like this image it's
pretty great right we had all the old
actors come back so George could get an
actual photo shoot with them okay George
is part of the research team is working
don't you know he's behind the store
maybe we can't tell you will we
recognize science and traffic lights but
we do a lot of the key before the end of
the years
come through the window
okay yes what else what else what else
what else
traffic and traffic lights and stop
signs by the end of the year is that
going to be happening talk more about
how the 3d view was generated okay so
the tritium fusion really like this so
you have two images yeah I mentioned do
have some image and oh shit oh my gosh
it's a it's a really good place this is
your computer
I know it's fine let's turn it off okay
holy shit now Arab you take care of you
and they'll be like am I really
oh my god okay I hope it's an eye bar L
weak that wasn't even planned holy shit
yeah yeah okay that's fine that's amore
oh that's that's what I already filmed
you are so right that's there it goes
okay so they know they see one another
yes you a little death are estimated
from cam yeah yeah okay so you have to
understand how to transform one
dimension to the other when you're
driving your car or when you have you
and your board is on a common raid we
ask the software how to just one one
image into the other so the way it does
is it predicts how far away each pixel
is from the camera so it projects all
this pixels in 3d and then he estimate
the distance between the two cameras and
then regenerate the the new image from
the new point of view then it compares
to the to the second pair of image so a
useful metric
why not using dual camera we're not
using it ever yeah that's one way of
doing it so we're looking at into the
duo
technology but but when you have when
you drive several times over the same
Road that's the same you dual cameras
right by the price of one so yeah whoa
came our technology but if they only
wants can we use more cars with schipper
plus with grey or similar can we use Y
it more cars that are not exact
oh here for us so they want to have
shipper plus yes that was good
Panda no no no I see can we match
navigate on autopilot with our current
card where can we match Oh sounds like
stuff oh he wants to be guys just have
food you're getting your hair cut
what are you getting that's a compliment
cause headaches are good it's about his
hair good for the past like two weeks I
know I didn't but you mention it a lot
no I didn't do you have you really have
perhaps okay I got my haircut in Brazil
guys yeah that's the place of where
everything beautiful comes from okay
here's what you guys don't understand
the Navigator without a pilot is just
like a cheaper version of the deal the
deal is like the real thing if you
understand where the road is if you
understand what the growth is and you
your car the eye everything speaks the
same language people whatever you want
well that's that that's the whole point
of the deal by the way guys dad you guys
do the best you can at Tesla just did
you like how how how cute is their copy
of shiver did they got a shifter it's
kind of cute right it's it comes after
shiver and then I'll tell has a fish
came to this is such a thing that you
and George both say you call things cute
it's like Mazda meaningly kind of thing
you know oh it's a ice is this nice so
maybe well two years later the bitter -
came to you so maybe two years from now
there will also be called Tesla rates I
don't know George is in this closet we
already told you that Tesla steering
lane change in traffic predictions -
well traffic predictions we don't have
traffic signs on the deal oh what a guy
saw right there is like four
is the original version which is just
like a translation of whatever we have
or right now on our copilot open pilot
in a way that is do compliance so we're
just changing a little bit the API so
does DISA standard is the language right
then we are planning to be future ready
and we would traffic lights exit
everything that all that will be on not
written until because in cars if you
want your car to understand you have to
be speaking do ya know RPC didn't catch
on fire it was at your Vermont a wasn't
in Minnesota so shout out to your before
not ruining computers yeah one still at
a time by the way here we're looking for
sponsorships for self-driving roadtrip
so if you guys want to reach out to me
you're Bramante folks if any of you guys
are out there I know I am fast about
banning emojis it's better cooling our
RGB cameras the only perception sensors
being utilized yes yeah you can consider
that perception see since like radar
yeah the curing cars have radar to you
right yeah what else yeah it's our
deepest one yeah call er to be plus plus
guys because it's not only our GBD right
the dimness condition they all said you
need some understand speech so it's hard
to be possible that's not I thought
there's a band question to what is the
very where did this guy sleeves go for
real
show them the back with each other with
the back - oh this is them know this is
the old commerce I guys yeah when I was
G intern yeah I was here in 2016 and
then they would make me wear this oh we
are gonna be so ripped okay could we run
Dooley on technology if we wanted to
slash have no friends if you want to
have no no if they want to slash they
have no fresh oh ok so just for now you
just drive over and over yeah
a couple of times and that's the same
thing as a dual cannon boom even cheaper
but don't worry guys
we know how much you guys love the dual
wield technology we'll have somebody to
figure it out
probably heroin whenever there is a hard
question I say hero please get it for me
I know how to use it for a really nice
reason and in heroine is the genius so
kind yeah with Michael I by the way do
we are you selling chains no no no oh
wait you guys me a culture do you know
how hot so we are doing , swag
exclusively for this tour so maybe we'll
so we'll bring back the tank top but to
be honest there you know I'm not the
biggest fan at all oh I like that idea
kama crops yeah yeah yeah the comic
craft shop but you guys just so you know
there are spiders on sale for $69.99 or
69 I think at six nine dollars on sale
right now at shop comma Dada a they are
they were recently released very few
people now igniter okay guys yes someone
literally just said I'm bored that's
great then log off your hoodie amazing
middle spins and now we have to go back
we're gonna work yeah you guys probably
yeah perfect okay by scobie's we'll see
you all for joining us
yes
all right
okay we'll give we'll give the scope
he's a few minutes
we'll give him we'll give him a few
seconds to get in here well that's a
gross color today today was a very
exciting day
it's very okay all right
so scofies we need your help
um we're about to ask the band question
it's only unbanned for the next couple
hours
so it's only on band for the next couple
hours
you guys know eddie right
where's eddie
hey scofies that's harold this is eddie
all right
all right
here's the question
eddie needs a car you guys
eddie needs a car and you know if you
work at com a.i call me i buys you a car
yeah
so
can we ban george from asking bad
questions it's friday you know what you
know what guys in the interest of free
speech and the first amendment
which also start with f
nothing's banned on friday
all right nothing's banned on friday
friday is literally the one day that
isn't banned a camry sc hybrid bro we're
going to come out with a guide
you're going to be able to report that
yourself look vivian so come stay out of
the scopes hi scofies you have a voice
when you periscope that makes it very
obvious that you're periscoping yeah
radio shows yeah you ever meet logan
paul in real life he's so much less
obnoxious bro i'm not repping maverick
merch today i'm repping comma merch this
is a long sleeve white comma shirt i'm
going to put up flyers
hey you want to show them the
recruitment flyers
oh my god there we go
kind of works well this camera needs
some more dynamic range okay all right
so
here's the question you guys
we
you know what i'm going to post a link
in the periscope and we'll go off what
we're going off of
um well you got when you get talk all
those tacos we had tacos for lunch bros
um
so i'm gonna post a link on the
periscope oh i gotta log in to comment
oh this is too hard log in with twitter
is this easy
authorize app
uh okay that was easy all right cool
so here's the thing we're going off of
right now
we already jumped from 18 which came
without doing anything
okay does it have to be honda or toyota
no it explicitly is not to be honda or
toyota
so we can go anywhere out there and get
literally whatever car
what are we looking at right we're just
looking at a goal yeah so we're looking
at we're looking at volkswagen golf yeah
so this is how the germans work you have
to buy everything separate oh you want
an automatic transmission
that costs you money wait don't get it
honestly you guys know i'm a fan of the
audi a4 it might just end up being audis
and volkswagen already s4 s4 yes s4 yeah
all right
um
i went to the uh gm deal and i sat in
i said in a chevy bolt and it didn't
have power seats okay the band question
is when will my car be supported
where we're buying a new car research
it's always research guys but we're
trying to go high-end here no subaru
no no i don't even want to hear subaru
subaru was banned even on friday
um subaru is always banned
tesla
tesla we're banned from buying teslas
wait a raptor what's a rat guys what's a
raptor
what's a raptor i don't know i don't
know that's a huge f-150 with like oh
bros okay okay
g-wagon oh f-150 raptor you see i'm not
from i'm not from i'm from the suburbs
you guys we drive sport activity
vehicles
honda ridgeline
that's another pickup truck that's
another pickup truck yeah g-wagon that's
kind of what i'm talking about guys
classic tesla that's waiting for a merge
ah we could do a tesla to be honest
the amount of excel well that would
think in volkswagen the amount of
acceleration on a tesla scares me
because if there are bugs you're going
flying
what's that four
um about 40k for a g wagon what a deal
oh you guys know how i feel about ford
you guys know i'm just kind of disgusted
by ford
nissan what nissan
if we bought a nissan we'd have to buy
an eddie how do you feel about a nissan
rogue
it's okay
oh it got a three star on car and driver
kind of dumb looking
i mean i like vw's right off the bat
yeah just a nice s3
an audi s3 yeah it's like a golf gti but
way cooler okay all right guys
yeah i i would consider a mercedes too
and i ate bro nobody has one of those
no it's not that we don't trust our own
software it's just that while we're
developing
i mean just the idea of like commanding
torque to an electric motor kind of
freaks me out
you know
you do it wrong and it's like
electric motor just if we gotta test the
model yeah it's not lateral it's
longitudinal that's that's like oh
you can just really you could just
really fly right a sport wagon a golf
sport wagon
sport wagon yeah
well no wait what are we looking are we
looking at audis
yeah s3 would be cool
or just a regular three howie
s3
yeah ford for more widespread support
yeah
yeah right right i don't want to be in
that position we can get the rs3 what is
the rx oh do they have an rs3 i think
there's an rs4 okay there was an rs4 i
don't think they make them anymore
they don't make rs4s anymore but there
is an rs3
oh yeah
three series were
like now they got rid of the hatch
wow
but it was only an electric audi would
be good yeah
maybe we should just buy an audi
wait what is this rs dude this works
best rs3 add another 12k
what no
but bro
zero to 60 in 3.9 seconds
no no no no no no no no the eat you guys
could do that on your own
uh wait so does this come with driver
assistance package
all these expense options are so
expensive just watch the price skyrocket
okay
i mean it's a small position
no but let's get a luxury car you guys
let's not get a race car
yeah but
the a4 has lane keep assist if you uh
take the expensive options
before the audi a8l
yeah that's for long legs
and then there's a plus also yeah that's
that's even longer
more
yeah
oh my god there's a spider
should we get a oh
yo
lexus yeah we're gonna lexuses are
already gonna be supported pretty soon
we're renting a lexus rx
um
r8
but the mercedes interiors are so nice
the mercedes interiors are so nice
let's see that category what's a future
vehicle it's at the bottom on the audi
site
no they're not for sale okay no not a
volvo okay volkswagen strong maybe not a
toyota where do you have those
not a tesla
oh get around.com raptor not a cadillac
gm is kind of ugh
that's kind of how i feel about all the
american cars i never just all very
clunky they really are right like
mercedes mercedes has the nicest
interiors you gotta give it away harold
and i were talking about how like cars
interiors became uncool after 2004.
like they're all just kind of generic
now
yeah yeah
you want you want to get it you want to
get a used benz did you know that the
benz is in the e-class yeah we saw the
tesla
we saw the tesla driving through a fire
truck that was dumb shit
wait what's cloth the mercedes doesn't
give you the nice interior even in the
e-class by standard you need to pay for
it it's four thousand dollars for
leather interior wait can we put on
let's put on maybach music
music you never learned a maybach music
oh you gotta listen to me back music too
playlist really shit i ever wrote
chilling in my
maybach music
oh that's me on periscope
me on periscope
maybe music too what's scrolling here oh
so this here
we're gonna make all the eons in the
world take a picture at exactly the same
time so we can do stereo
like we're bringing the phase of the
camera in sync with the gps
so that's what i'm working on there and
over here i'm working on great panda
firmware
[Music]
listen to my maybach music listen to my
maybach music
oh a porsche
no no one has porsches all right
all right guys
i'm thinking i'm thinking audi
you think audi yeah
three or four
how much how much is an a3 what's this a
smaller a4 yeah it's just a smaller
sedan
or maybe there's a hatch i don't know
the e-tron i think they only make
electric hatch but
i mean i don't know maybe just by an a4
but there's more of that you know what
why don't we rent an a4 let's see if we
like it i think we like audi too much to
go with anything else all right scopeys
volkswagen and audi's are eventually
happening don't get your hopes up too
much if you have a toyota lexus or honda
that's uh
we're gonna release a guide and an acura
yeah silver car right so cuz we're good
um
yeah you wanna you wanna rent
yesterday was exhausting i can't tell
the scope is what we were doing but
yesterday was exhausting yeah
um
yeah right all right cool
cool thanks for joining
comma army
what is our product we sell dash cams
shop that comma dot ai always rep the
merch comma army be a scopy join the
comma army you can change the world kids
get a midnight get him in that black eon
buy one of those without one of those
yeah we got him we got him they're sick
uh you figured out the end of your
surprise i would be surprised if you
figured out the end of your surprise
comma army all right
bye-bye
what obscure piece people phew
not me to flip the camera oh we got
sneeze goo ah bless me are we cool yeah
bro
make sure we shared this on to Twitter
yeah we're on the Twitter right guys
okay so let's go over some of the stuff
that will be included in the auction
you want this e on this is the e on from
the Ford Fusion will give you that yo
you want this gray panda this was the
gray panda from the Ford Fusion you want
this or we're we're auctioning off our
own fort very possible if someone makes
me a reasonable offer by the end of this
periscope that they will be the owner of
commas 2018 Ford Fusion Hybrid platinum
oh no will sell in the car we're selling
the car right now this isn't a mapping
scoping we had a mapping scope you last
time I know you guys like mapping scope
is it get a lot of likes um it's it's in
great condition a beautiful pristine
condition let's see how many miles it
has on it let's go out to the car itself
up and your the Ford is canceled
because Ford's have a 10-second timeout
on their steering which make them stupid
yep cancelled we're gonna sell the Ford
we're gonna buy more Toyotas and he
wants to buy a Honda Civic they'll buy
another Honda Civic alright so
here is up and those are people who
almost crashed into each other okay so
here is a Ford Fusion Hybrid it has a
license plate not included it has
beautiful big tires look at the size of
that tire it's nice right
it's a hybrid it's good for the
environment all right let's see what
else it has oh look it has parking
assist sensors you can park it in San
Francisco residential parking permit
valid through 2019 like I said it is the
Platinum trim it is the highest trim you
can buy of the Ford Fusion it's a little
dirty we'll make sure to get that dirt
off for you or we can include it bonus
dirt all right guys let's go inside
let's take a look here let me turn this
thing on here so well so that's my deal
if one of you buys this car off me for a
good price will release half a Ford port
congratulations
we will also be including with this Ford
a one-of-a-kind only one in existence
you turn off his air conditioner so it's
not loud Ford G RAF this is the only for
giraffe known to be in existence look
you see that you see the gold see the
copper in there this was made on kamas
LP half machine scroll for old comments
yo periscope that's good alright one of
a kind Ford G wrath comes with four
switches comes with this beautiful OBD
connector where you can plug in a panda
screwed together look at them screws
one-of-a-kind four GRF included with the
purchase of this beautiful platinum trim
2018 Ford Fusion it plugs in right up
here it gets you access to the radar we
haven't started
the bidding yet but but if you're
interested in making a serious offer we
will do one better than including the
files we will open source the for
giraffe and open source the Ford oh it's
a great car yeah just you know open
pilot is kind of mediocre on it I'm
quite happy with the car but home
pilot's not really gonna work
we kind of have other priorities right
now like mapping so the Ford Fusion
should you sell this car for ten bucks I
really might oh I'm too lazy to sell it
one of a kind for grf you won't find
this anywhere else for
hybrid comes with an alarm I think don't
quote me on that
Oh 15 15 okay we got a key 50 bucks cash
I do like cash look it's Vivian her last
name is Ford
yeah we're auctioning off does anyone Oh
keeps video all right it's a new car
it's no guys he's driven it like three
times which should actually increase the
value because comic er has been in it I
don't think that's how it works
maybe if Kanye West was in it all right
all right
$25,000 we're here $25,000 maybe what
okay for it what I don't feel like 32
would we I don't we have to check we
have to check Craig's List all 40 can't
do it if you're really serious about 40
cans yours man Lisa no no we're not a
bank
I did I did the new door is beautiful
Eddie and I did it it comes with a
one-of-a-kind for a giraffe only one
ever made what the system is mediocre
would I accept would I accept a Toyota
Corolla trade it no no a Corolla well I
want mercedes-benz s-class is dogecoin
accepted yeah sure I hope you find a
doge go ahead turn the wheel with a
serve-out now no old cars are stupid
you will trade your girlfriend's 2015
Toyota Corolla uh-huh no no we got we
got a chicken we got a chicken and a
2010 Mazda 3 the chicken makes it
interesting is it a live chicken 2018
Accord that's yeah that's more
interesting in accord yeah we have to
look it fairly if it if there's
similarly priced yeah I'd trade you for
the 2018 chord is a Bosch radar no
seriously though yeah I trade the Ford
for an accord I think high trim auction
the GF Oh big connect uh no I bought pic
connect and I lost money on bit connect
I bought the dip
yeah after bit connect crash I was like
maybe it's gonna be maybe she's gonna go
back off it didn't go back up guys the
Cortez Bosch um so yeah that's my that's
my auction if you're actually serious
email give me a Ford I know yeah yeah
didn't the new Accord maybe maybe on the
new Accord maybe on the 25k those those
are the those are the two offers that
I've heard that I would consider if you
are serious about them someone did make
money off the crash huh anything new
other than Ford cancellation
yeah we're auctioning the Ford buy a
Ford today Fusion platinum hybrid title
in hand bring cash oh I think I left it
on I left it on I'm going to turn it off
a dealer would probably buy over 25k
yeah yeah I mean we could just trade it
in we're just not ready to get a new car
right now we just bought that that
overpriced Cadillac so um yeah and it
sucks actually in California you don't
get tax credit for your trade-in it's a
huge scam you're the Fords cancelled
brah Ford's are terrible cars I knew
there was something wrong with Ford so
two things happened one I got to sneeze
again man allergies or something
okay yeah we probably will sell it on
Craigslist
the truth is two things are wrong with
the year at the fort thank you
one thing yeah super cruise is nice we
like super cruise is it has a ten-second
EPs lockout and two Ford apparently
canceled all their sedans in the u.s. so
if that's true and maybe I'll look more
into it and thank you uh you downgrade
your car I know I know it's such a scam
I hate the California does that but its
California government what do you expect
for us so yeah a Ford Fusion
platinum Hybrid if you're interested if
you're interested right behind me
give me a Ford at kama AI yes absolutely
okay thank you for joining this
periscope say hi to that truck you
bought a fusion for Tama I'm sorry we
tried guys we tried if one of you
Skokie's buys it I'll do two things
I'll open source the Ford GF and we'll
open source half a Ford port that kind
of works with open pilot but if we sell
it on Craigslist no such luck sounds
good alright ladies go bees
[Music]
do you mind if the Skokie's know your
name would you like to introduce
yourself to the scoby so these are these
are khmer i Scopus I'm here in an Audi
a4 and we're here doing an Audi a4
review review for out EA 4 so this thing
looks like spaceship like howdy did a
great job with the interior in this car
I really like this this whole LCD panel
I think their graphics are tasteful it
feels responsive their interface here is
pretty nice the driver assistance
features on this car leave a lot to be
desired
so here's the cruise control stock and
like you can set it but it's like very
confusing I can pull it in three
directions oh there we go okay I set it
to 60 well I don't think this car has
any sort of adaptive cruise control so I
think if I go here yeah we are just
gaining
it's made to go a little faster
now there's definitely no identities so
yeah if I had continued to let this car
go we would have our crashed into that
minivan so there's this panel that I'm
on here called driver assistance I'm not
really sure what it does but well you
know so the mission of comi I really is
to replace the car interior with a
better one we're letting you buy the
upgrade to a Tesla in your not Tesla car
now unfortunately the scope is asking
any questions
how many scobie's we have 72 oh we got
72 people watching this oh yeah
yeah okay so if this thing has something
called traffic signs I'm gonna show them
this dashboard
it says no traffic sign information
available I see some traffic signs I
don't know why the Mobileye up here this
car does use mobile I believe I believe
this is my q3 this is a 2017 out EA for
what was it driving into this distance
the driver assistance do anything I
don't understand it maybe is this some
setting if the set I'm in a silver car
out EA for if you guys have you Skokie's
one at one at Google these are pretty
nice
this is like very very very tastefully
done look at the Audi logo compared to
the Ford logo that's something you want
in your car this is this is very high
school yeah no no no diesel knows
America oh I see use a lifeline okay
that's kind of what happens if you put
regular gas in it it's not a diesel is
that what this Kofi's are asking oh man
we got we got the this is route 4
yeah route 4 I so you'll check over
there that's hanging sexy new intern
behold it for the day
you guys can rate how well she's doing
stability was no I meant luxury car save
gas Oh could I put regular in here I
don't know I'll have to read my rental
agreement with silver car but yeah so
unfortunately you guys know this is
$10,000 bounty if anybody can get open
pilot running on this car unfortunately
it has flex ray what's exciting about
this car for Karla it just like it looks
like a spaceship man just like look at
this thing right
compare this to like hang on I'm not
answering a comment which one Trenton
what's what are they saying I missed it
if they're saying lewd or vulgar things
you don't have to read that
good morning scopies good morning
so
you know
um i work in the uh self-driving car
industry
so
as part of this is kind of gonna be my
my industry commentary i've been
spending the morning watching
some of our uh competitors videos and
i'll give you kind of what my thoughts
are on them
um so maybe we'll start with this one
so this is the mo
lacking sleep now i slept pretty well
last night good morning
um so this is the mobile ikea in terms
of ikea chick uh i try to watch all
these things a little bit sped up so
i actually
performed
um
so
mobile i actually is one of the least
hypey players in the game
um
no no ico no no ico um well was actually
one of the least hypey players in the
game and they announced a few
interesting things in this in this
presentation
um so first off they're going back to
the aftermarket
um let's see if we can find where it is
they have this thing called the mobilei
connect eight and it looks suspiciously
like a neon here like a ram in the
aftermarket
why you don't programming i do a lot of
programming
so yeah this is this is this is an
interesting play for mobile i like
they're they're selling an aftermarket
thing to fleets
and so if you guys don't know there's a
company called nada which is doing
something similar
um
so natto builds this little uh camera
thing i believe it has a snapdragon 820
in it they can push them out and it's
kind of like a cloud-based dash cam
really very similar to ours
um
i met with them at ces uh last year i
visited their little booth and actually
spoke with uh
gabby holdsworth
travis kalaknik's ex-girlfriend
so that was kind of interesting
but yeah so let's go back to this mobile
i also announced
i mean to be honest their 2018 plans
look very similar to ours
and i don't know if i should be happy
about this or concerned by this
um but they talk about level two plus
you can go to sleep yeah they have they
have a really good idea
so they show on the left side they're
showing a map
so these these lanes here are coming
from the map and these lanes are coming
from sensing so we're going to roll out
pretty much the exact same thing we're
going to have our own
uh comet eye hd maps which we're going
to open source before the end of the
year um
and they'll have they'll have lanes in
them and they'll have features to do
precise localization and then kind of
you know where to drive from the map
so mobile is calling this level two plus
they're talking about doing traffic
lights in the exact same way we are
um
ahmad has a quote where he literally
says look the hard part's not detecting
the traffic light the hard part is
figuring out what traffic lights apply
to you and that's of course true
um is it lagging on my own wi-fi from
one wi-fi
so yeah there's that
now i can't find a better video
uh
for lift lift and app tape so
first off um
to understand aptive uh used to be
delphi so they've kind of rebranded
their self-driving division in the same
way
google rebranded their self-driving
division as waymo
um so lyft and active bring robo taxis
to ces and a lot of companies have
announced partnerships with lyft
um the truth about these partnerships
is
my understanding is like there's no lift
technology being used
basically whenever someone announces a
partnership with lyft all that means is
that they're putting their cars on the
lift network
effectively they're signing up their
autonomous cars with safety drivers to
be lyft drivers um you know we have this
obviously no partnership we have quite a
few people with with with open pilot
driving for uh driving on the lyft and
uber networks so i'm important to be
clear about what that
showing
um
that's not the car i've seen them have
before before they used to have like suv
like things
it's a bmw interesting
they always focus on experience i'm not
exactly sure
why this is view is the difficult part
so what delphi had last year was lidars
around their car i think it's pretty
much the same thing what's important to
look at is their displays because if
they have any display at all you can
glean a whole lot of subtle so let's see
what this is here we have a uh that
looks like a valentine puck
um and then we have a camera there and
they probably have a radar in there as
well that you can't see behind the
plastic
i don't know about the autopilot alexa
so here's another puck in the
i think that's a puck i mean i guess it
could be a different lighter i don't
know
okay so let's let's break this down
um
so
it looks like what they're doing is
they've kind of
i don't know crowdsource those lane
things this looks very similar to the
display that uh that delphi showed last
time
they clearly have a lidar in the car
because these dots here are coming from
the lidar see that these dots on the
back of the car from the lidar
um they're tracking their lead car very
explicitly
they have a traffic light here
it's not connection to other cars i
promise you it's not that
actually as far as like actual demos go
uh delphi active shows pre usually the
most impressive one at ces
completes the center set on the car
and it turns
a really consistent passenger experience
so you
so the experience doesn't matter this is
what's interesting
um they have this thing up here called
called manual
i'm not sure how much i can uh can say
about this because i have actually been
for a ride in this car
it's interesting that they've switched
to bmws too
that must be because of the
well they're not they're not mobile eye
are they
um do i have orientation lock no i turn
it off
um but yeah so any any more things
people saw at ces that we kind of want
to break down
this is kind of just a chill i don't
have that much
um
behavioral cloning doesn't work but we
have a solution to it
uh i'm not gonna go too much into the
details of that but if the new models
work the new models are going to be
insanely good because they're not going
to require much automatic ground
truthing at all i mean the automatic
ground treater is much simpler which a
lot of the bugs that exist in open pilot
where it like drifts out of a lane
they're bugs in the automatic ground
truther
uh so let's check out let's check out ai
motive i wrote in their car last year at
ces they don't have any sort of nds with
them or anything so we can we can say
whatever we want about them i generally
like ai motive look i'm being nice to
people on this periscope
um no no no no no they don't have
are they at ces 20
ces 2018
and if anyone's any companies they want
to shout out in the comments we'll kind
of go through them
automotive will showcase progress
this is useless i want videos
videos no that was last year's demo oh
here we go ammo at ces day one so this
is the first time i've seen any of these
yeah they had the same stand last year
it's pretty nice stand
[Music]
but this isn't anything show me an
actual demo um we can also break down if
you guys haven't watched the uh
the nvidia event
um the nvidia event is uh is interesting
as well
let's see what is this
no this is old um
let's see what they're saying here
so nvidia's announcing these new these
new uh these new hardware things
um
now
my view on it basically is kind of like
why
is nvidia gonna win well the thing about
nvidia is they're just not going to lose
everybody
every same car manufacturer right now
should be buying nvidia's latest
hardware sticking it in their car and
making sure they can ota
it seems like tesla's the only one
actually smart enough to do this but
when you look at these things that
nvidia has um
okay so first off they show it they show
a demo of a car driving they show a
seven mile drive demo
um which maybe i think they show it like
at the end
i don't know what any of this means
uber
but they did show a demo good morning
let's see we're just going through we're
going we're busting hype with scobys
um
yeah okay so they do this they do this
eight mile autonomous route uh
to new jersey the hardware is not too
expensive
unless you're an auto manufacturer it's
just kind of useless like there's no
reason that you're better off using
nvidia's dedicated hardware over using
like a computer with an nvidia gpu
we're height busting with scopies um so
they have this eight mile autonomous
route
we were looking at what it's
um
they don't really show it they show it
running on like their little thing too
my guess is it's highly localization
based
and then they probably have like
it's probably all localization
um and then you can just use any sort of
like yolo net to detect uh the cars
let's see let's that's a good video to
look at
video eight mile
route
youtube
yeah kf
on the board is for the kalman filter
which um
nvidia yes 2018
how is how is the kalman filter
integration coming
yeah well the computer runs live it
works well no but we got it we got to
integrate it into that into the unit
line
that's got to go we got to do that
good
all right so here here we go perfect
right good click
um
so we can look at yeah okay so let's
look at let's look at this this uh like
on-screen display right here they also i
love when they do this they didn't blur
out their screen so the screen is
actually down here
so it is running on driveworks
um
[Music]
let's see if we can get any information
about what it's doing
so
that lane that line is very smooth i
really doubt that that's coming from
vision i think it has to be coming from
localization
um so you know we talk about these cars
they're actually really just line
following robots
um so it it line follows
well on the turns it's usually a real
giveaway whether it's vision based or
not
no i mean the trick is to find something
that is not even in the visual scene
like this is how you can bust drive that
ai video is appallingly bad
um
so they're driving here
uh that little inch forward at the stop
sign and people think oh that's tricky
behavior no it's just hard-coded and
like this the the like the demo route
that they do
and then they localize they probably use
a bit of vision to localize too i don't
see lidars on the car
um so the way companies like crews are
doing it is they have
wider maps built up what you want me
watching this you want you got work to
though
you got you got to make our version of
that work
what no
but know your enemy yeah we go over this
stuff all the time
um we don't go over it with the scopies
uh
so yeah they're not showing vehicle
detection and stuff
the real way to really bust these people
is to ex to extract their video and play
it in real time yeah it's i mean it's
all about hype right it's all about
showing hypey demos we might even have a
hypey demo plant who wants to see comma
level four right oh oh which reminds me
okay you ready for the worst one
um let's see if we can find the renault
level 4 video we've been making fun of
this one around the office
um
ah yes here we go okay
so l symbios oh
oh just showed a self-driving car tempo
whose headlights change color when it's
self-driving you know that's bad
now there's actually a video of them
driving with the journalist in this car
and uh okay that's my lady right there
um
this this one's bad well so a few things
are bad about it
um
all right wow wow look at that you can
you can set the music with your phone
wow it's the future all right
um
so
maybe this isn't the one i saw the one
that they show good morning we're height
busting with scopies we're going to
we're going through our competitors ces
videos
um
i'm trying to find that renault level 4
video
the really bad one um it was like car
talk they
they actually let a journalist sit in
the driver's seat which was kind of
interesting
um so you think it's almost real but uh
maybe it's this one
i should have you know what i should i
should prepare better for these
periscopes
this is all hype
yeah oh wow look he's wearing vr headset
um so a few things about this one
there is actually a oh yeah yeah it's
zero one night yeah linus tech tips
drove in it
come on youtube search come through for
me oh yeah wow
well it's really like look at how
there's like a thing around the car this
is like a logan paul move man
this
can ignore the safety yeah convenience
advantage so a well into
doing right now should definitely be
illegal
while it handles complicated tasks like
maintaining an appropriate speed and
following distance relative to other
cars
merging and without some significance so
a few things look right there
do you see that guy in the passenger
seat
he is driving the car he literally has
his hand on a joystick
driving the car
this is not a level 4 autonomous car
this is putting a driver in the
passenger seat right this is absurd guys
it's the current year that we still let
companies get away with this kind of
stuff like he's driving
and the crisp
there's another video where you see all
the surround cars actually being renault
cars as well they put the sensors in
other cars this is a completely fake
demo
um but no no no really really
look look look the guy's got his his
hand look at look look at his hand right
there it's on a joystick it's not for
security reasons you have security
reasons uh you know you have like an
e-stop for security reasons right you
don't have a joystick which the guy is
constantly like look he's got his hand
he's like moving it while the car drives
um
so this one this this one drove me crazy
um
we're going back a little bit but i'll
actually show you one of the demos
that's uh that's more impressive than
than almost everything coming out uh
today go to auto x um so this is a
famous princeton computer vision guy
we're looking at this one again
yesterday
so this one it is hard-coded paths
but they actually did it using cheap
cameras um so you can see the two
cameras on the front there
my understanding is they're running orb
slam
and they're using orb slam to localize
and then they're just following the path
with that which is pretty cool actually
that they actually made that work
uh torque robotics i've heard that name
let's check it out let's let's go
through what they might have
um is a leader in game changing remote
control who road ready can i buy one oh
let's watch the video oh i love watching
videos
cabana is zero day man i always want to
be one of those like youtube guys who
just watches other people's youtube
videos and comments on them right do
they have sound
oh okay i don't think that they need a
better video editing to even we put
sound in our videos
um
i don't know
this doesn't really show you anything
like okay they put a lidar on the roof
by the way
always watch out for this and you know i
like them for the most part but um like
voyage is notorious about this voyage
will focus extensively
on what their car looks like um for
reference those who don't know voyage
no i i like the guy um
but voyage
all right wow well they're actually the
first hit for wow that's pretty good of
them um but yeah like they're big on the
optics of self-driving and maybe not so
big on the actual technology you can
build something that looks really
impressive all that takes is money the
actual working technology is what's hard
to build right if if they're ever
focusing on like the user story it's
probably because they don't have the
technology so again we really have to
give credit to mobileye
who gave a great talk about what's
actually possible i mean i think he's
fed up with the hype too i think he's
he's fed up with the you know come on
all right hey man i know what i'm wrong
i'll change my opinion
um
but yeah so they're talking about this
this level two plus stuff front facing
camera plus road book i'm so road book
is what mobile eye calls their hd maps
but the thing about their hd maps which
is way better than everybody else's is
they're being made
by the crowd just like ours
you got to do it this way it's the only
way to scalably build hd maps like the
companies right now that are spending
millions of dollars to build maps um
notorious ones are like deep map and tom
tom
um
like
what they're spending tons and tons of
vc money on is building 3d maps of the
world
there isn't really a reason to do this
because building the map
it's not useful unless you can localize
in the map right so you build a lidar
map in the world so this is this is this
is all cruise does um cruz has built a
cruise automation well they're not the
first hit for cruz but voyage is the
first hit for voyage get on the seo bros
you know you know i kind of like cruz i
mean they were right i tore apart their
investor deck because i hate things like
that
but uh
yeah so
what cruise is actually doing
i don't show anything here but um
they built a very precise lidar
localizer so we talked about delphi
delphi is active um delphi has one of
the most impressive actually shippable
uh demos
they're using well shippable is
questionable they're using a lot of
sensors they're fusing them well
together i mean they're good at
everything you would expect like a a a
car oem to be good at but yeah as far as
oem's going you know i've met with the
delphi guys
they're nice they're trying um they're
much much better than like like bosh uh
bosh has i met with the bosch guy so of
uh you know hopeless right
um
why does schiffer not work and i ran
we didn't do anything special to make it
work or not work and maybe if i put
extra work in to make it work that's
illegal so i'm not sure we're gonna do
that
um
self-driving lift first ride is this
recent yeah okay perfect the verge is
pretty good
let's watch this scene and i'm about to
do what else ride in a cell phone this
guy that's not driving cars
oh so this demo was in this demo last
year the nvidia demo the nvidia demo was
cute
um i did talk about how they cheat
though
you see those buildings
so this is it's a neural net maybe they
have the same demo setup um so first off
this is a this is a ford fusion
by the way whenever you see a ford
fusion self-driving car understand that
this was not actually built by the
company
um it's sold by a company called
autonomous stuff
see i have a keyboard with no letters so
it's kind of hard to type so whenever
you see a self-driving car company with
a ford fusion
it's built by this company autonomous
stuff
or or lincoln mkz it's the same car um
and then the buy wire is from this
company called data speed so these th
this is the pick axis of uh of
self-driving cars yeah but when you go
to the nvidia oh it was that
where was that
let's close some of these things
um
not deep map bye-bye d-map oh torque
yeah i don't know i don't really think
much of torque i haven't like seen
anything from them here here it is yeah
so they're using they're using the
buildings they're using the build
outputting the policy directly
so they probably had someone drive like
20 test laps and then they they trained
up a uh
a a
deep net i'm very similar to if you've
seen diy robo cars
um diy robocars
is a
bunch of people getting together in
oakland
who do these
[Music]
yeah so this is uh this is octavio good
it's a famous deep learning guy um but
yeah he basically just directly trained
given the car sees this this is what the
network should have but yeah it's it's
the same thing as dave net basically
um
so let's go back to this video but yeah
they're really cheating with the
buildings and the way that you know this
is they have a they have a screen inside
the car that shows you what the
activations are for the neural network i
probably wouldn't have picked up on it
if they didn't have this visualization
thing but the buildings make this task
um easier than it should be because
their camera doesn't have a wide field
of view it doesn't actually have a wide
enough field of view to make this turn
is there a ces every year but you know i
like in videos the truth is nvidia is
another one of these companies that's
going to succeed almost even if they
have no software if you have a car
company right now you're so dumb for not
sticking nvidia hardware hooked up to
your cameras in your car uh our rav4 has
four cameras and i'm sure it's hooked up
to a processor like you know that's from
like the mid-2000s gonna be different
this is not just a self-driving ride
around a parking lot or around the
convention center this is the result of
a partnership
this is too slow
yeah
okay well i don't know why they all
re-brand like this you can hear yes
all right so you get in
i can't believe journalists like fall
for this kind of crap too you put like a
like old display in the back
doesn't matter it's all localization
based
okay
i mean what's really important to look
at here is you can ignore all the crap
just look at their display because their
display and like little subtleties in
the car
give away a ton of stuff
um so yeah i mean these dots here are
done with lidar
you see they're visualizing this light
here as green they're probably detecting
that out here so the way that they're
doing lights is they have all the lights
hand coded in the map
and then they're uh oh it's not cool
come on
tech is cool flashy devils oh we stuck
the screen in the car and they press go
and then the driver actually stepped on
the gas pedal come on guys
all right come on stop with the gimmicks
um all right they put waze on the screen
let's see what's real here
histogram
yeah they are good about not having
having wobbly stuff uh
but they're not using the lane lines
they're using localization
okay so that one's kind of interesting
um
you can see when they do that lane
change their lanes snap from the left
right to the the other ones i think
they're using mobile eye for that
um osm has almost all the light maps so
yeah the
it's a it's
a having the knowing which intersection
the light is at is not useful you have
to know with a very high level of
precision where to stop and where the
light actually is in like free space
right
um
all right
i think we're done people are coming
into work uh
oh yeah no
from what i've heard like they have
serious meetings where they talk about
us um and they're like what are we gonna
do about kama i mean because we're not
you know
you can't buy me out
uh we will you start using the camera
for stopping around like to detect them
but figuring out where to stop is hard
you don't have to go
but anymore i'll flip you guys back
around
uh everyone's coming into work so i
should uh i should sign off
but yeah do i think these companies
consider comma competitor yeah i do um
no and you know we're dark horse right
like every other company you know you
think oh well we could just partner with
them no like you can't partner with me
you have to be honest with me you have
to be like straightforward i'm not down
to like join this little cabal of why
don't we all sit here while the
technology doesn't progress i'm here to
make the technology progress you know
mobileye want to watch one of the best
talks in self-driving cars um watch the
cvpr mobilei keynote it really is great
and you know i've never seen mobile like
do anything like that before i i always
wonder if like the fall the mobile i
test the falling out um
had something to do with with
influencing uh mobile i'd actually go
and do that but uh yeah thanks for
joining um i'll be a little more
organized for the next one of these but
i think um shout out to all the
companies out there
you're not gonna get away with hype
anymore we're we're really here to bust
the hype we're really like if you
if you try to get away with posting a
video of i'll tear you apart
i'll tear you apart because hype is
doing no good for this field um it's
putting money in the wrong places it's
putting hope in the wrong places it's
making the wrong partnerships we are
here to
destroy hype hey hey you know 9-1-1 is
bad anyone who talks about that
banned um how big is my dk large my
donkey kong is is real large man um no
truth but hype hype is down with hype
this is 2018. we're not going to stand
for it you know what the kamehame motto
is for this year join us or die and when
i say join us i don't mean partner with
us i mean like
if you're a mapping company out there
right now
i'm a hater oh i'm a hater no i said
we're busting fake news man i have deep
love for technology and for making
things that actually work we do offer
internships um summer internships apply
uh give me give me a job at uh common.ai
hey man i just want this stuff to work
you know and that's that's kind of what
we're here to do um so your fake news
get ready to be uh to be chopped up
renault i see you with that joystick in
the passenger seat right um that's
that's maybe the ultimate joker award
and maybe the uh mobileye gets the uh
true to life award
all right cool thanks for joining
team comma yeah team comma yeah join our
team bro team comma bro team combo we
are the strongest self-driving car team
on the internet thank you for joining me
in this periscope i love yelling it
feels great i know why logan paul does
this
uh
peace out
i like comma specifically
because we're building something that
has never been built before so it's the
the new frontier it's space exploration
what's up oh yeah you're good okay take
three
my previous job i worked at a big
company and
if i saw something that i wanted to give
that specific team feedback on
it was quite difficult to to do so
just because how large the company was
with comma
if i want to tell somebody about
something within open pilot
or some other aspect
i can walk down to their office and just
talk with them directly
the two things that we look for
fundamentally are intelligence and
motivation
you know if i'm thinking about a company
i want to work for i want to work for a
company full of great people
right you got to make sure the bar stays
really high not just for who you hire
but also create
around i think we have the best chance
at solving self-driving cars because our
approach
involves actually shipping a product and
proving it out as we go it also allows
us to
become profitable and be you know
financially
responsible so we have thousands of
users every day that upload data
and we process those
drives that they upload most of them
within
seconds and all of them within like 10
minutes or something like that
everyone who has tackled the
self-driving car problem has done it
like the silly way where you try to like
you know put boxes around everything
um and then you uh take all those boxes
and try to like figure out you know what
the car ought to do
with some hard-coded algorithm and like
i feel like the whole lesson that
we all have learned in the research
community is that you should just learn
everything
you know learn it front to back and
that's exactly what we do
just waiting for this shit to install
you know we we have a whole stack that
teaches the car
um as closely as we can to just do what
a human would do you know imitate the
human driving policy
and that's like what what makes comma
really special in the self-driving space
is just that we're doing the smart thing
to teach cars to drive themselves um no
cone detectors here
no cone detectors that's how we do it
the people at comma
have a desire to work
harder i vibe off of that and i feed off
of that energy of others like
wanting to like just do everything they
can
and so that helps me kind of
also want to work harder
self-driving is going to be solved by 20
people
and uh you know a thousand computers
you
okay on ops copies they should tell not
automatically all right
is my phone did my phone rotate first i
unlock the rotation cool so we are
driving in a Cadillac ct-6 the only one
in the world with open pilots it's like
we bought this car with super cruise and
then we downgraded it we put open pilot
on it open Cory super Pinal yeah how do
I engage like cruise control yeah oh you
know what I like I can engage it
anywhere oh this is better
yeah and it goes by five you should not
lose your price those cars
Oh
but it is nice and super cruise because
you can engage it anywhere so super
cruise we'd have to wait a long time
before we could engage it let's see what
happens very cool between these lengths
oh you can really tell this doesn't lag
yeah oh man this is better
can you do both both what and you have
the savannahs disengage now Bend is know
send us what there are three pandas you
have a dependent owner that's can
messages yeah
yes now when you engage then the pond is
gonna blink a white but I can still do
this like it's cruise control yes
no we are engaged never there's a bug
see the bug what so oh no yeah I don't
enforce the cancellation you don't force
the cancellation I mean yeah the
cancellation of open pilot are a
superset of the custom yeah yeah so we
got we got to change that for that
release oh yeah I mean wait when I
started work on don't you - no well yeah
yeah guys but we got we got this
beautiful ct-6 surrounding a beautiful
open pilot we're gonna make it better
than super cruise by the end of the year
most of my job as CEO is saying the same
things over and over and over again
do you have way of imperative Emily
great well they don't
Obama wide open pilots have Emily Chloe
fixed how we fixed it why did it have
memory leaks well what's that been -
focus focus on what what this is all
right being better than super cruise on
those six cars is the focus of the year
the step better Twitter Stan on then to
your third definitely yes
yes that yes like as much dark as you
want so we have to limit the torque
artificial there's a special command you
sent into the steering controller that
puts it in superheroes mode and you can
get scary amounts of torque in super
cruise mode so the Cadillac has
redundant ECU's in the back for this
um so we've set up there are two pandas
back there doing proxy yeah so this is a
triple panda car guys pandas are so
versatile yes Oh bye pandas today shop
like I would buy in or three pandas
blocking messages they all boards all
right finally this light go forever
yeah but it's theory it says that but
experience okay Wow guys this this
actuator so good so this is GM's icing
oh man oh it doesn't wobble oh this is
cheating
no wonder super cruise is so good oh man
what were we talking part not anybody's
fault better we still have to go to the
highway it's literally like this it
doesn't wobble I mean I know well okay
okay there's a little wobble I keep my
hands very close to the wheel you know
we have some safety we don't know how
good it is it has not been extensively
tested but I'm not
it is it is daring right now
I'm gonna see what it's not it's not
like I don't know what's doing it well
they stand for a it's very temporary
yeah there must be a stay and we're in
we're in super cruise mode now
yeah I'm printing the stage so I know
yeah
all this cost this is so good
here's a lot better gonna do stop cars
oh yeah because we've left everything on
so I can do fusion oh my god oh that was
sickening Oh Ricardo creak creak creak
you'll replace it with ours okay yeah
GM GM just did a stop behind a stopped
car it was not a detection problem it
just stopped in such a sickening way
alright no more letting it do that I'm
telling you those supercruise has a
different supercruise has a different
acc it's Bank yeah it's better cuz it
doesn't do that I know I know you don't
know you know it's kind of true I mean
you desktop and go hang with you guys
stop it going our way and I felt it'd be
better I was GM's ACCC I don't know
they've only been busier nowadays on for
sure like dining is busy cities
expensive
well it's dinner they're gonna have to
say recovery Jack Therese just some crab
yeah yeah so FBC so the MPC is the
control algorithm that open pilot uses
to compute its trajectory it's much more
sophisticated than what everyone else is
doing except for I'm sure Tesla's NPC
you know yeah tests are just doing up to
say yes but they didn't have it at first
autopilot is have you say yeah
now before now but I mean notice what do
you want refer to we talking about silky
smooth
I don't know I mean I think some shoes
everything don't really apply it use
obviously I don't that I'm not for much
else to gets in there all that have a
standard callaloo
oh wow yeah it's like a holiday it's
just so much better yeah so seriously
the reason oh come on scrappy on our
cars as actuators yeah I mean if there's
definitely a lot of difference we'd all
come from different cars but yeah it's
like this feels very good
it's basically the only car that is
built with an activator that is meant to
be active
yeah compare this like the Toyota
actuators are so much worse
I got a feeling that Toyota performance
is because of the actuators
yeah yeah that me depreciable increase
my chatot yeah what's the focus for the
next to the man that is Hitler and that
could be that mr. Chris would do that
but Plato just need to compensate for
perfect return yes
they don't think the rifle
it's not supercruise it's not as good
yeah wait can I unable supercruise no
because it's like yeah I mean you can
but that does nothing so we're blocking
the good intelligent control
oh man that's a lot of tour well the
kids are unavailable but yeah now did it
oh no no so now it's back that's
interesting okay
Wow oh yeah this almost supercruise
makes mistakes so Chris doesn't make
mistakes
that's what we forget supercruise would
have disengaged a long time ago
yeah me at least it's always available
it is always available to be removed in
a later version no scarcely we won't be
as aggressive a super curse but we're
gonna start doing confident stuff and if
it's not confident
but
if we have to tune our threshold for
what sort of disengagement will tolerate
GM will tolerate nothing but they're
extremely conservative of the layman
gage
yeah oh this is like perfect penis it's
wobbling now the link supercruise does
this camera yeah oh the hold really it's
just it's just upsetting that the whole
thing is the actuators yeah I mean we're
pretty lightweight the plan totally
well that's just yeah so let's just
improve right yeah exactly the decision
aids are never getting into our be being
gave the perfect for this phone is gonna
be excited
yeah guys like open pilot works like
flawlessly here
I mean dense fog on like an exit ramp
like perfect
except they actually thought shit well
when the actuators aren't shitty it
doesn't move out of the lane and when it
doesn't move out of the lay that doesn't
have model failures yeah I mean that's
really what it comes down to it does be
done he says this is dangerous
torque yes the angle rate limited I did
it because otherwise it was like at the
way too bad you so much
where did you do it I can't keep my
hands real close to steering wheel yeah
I mean it's not like I can find it
obviously it will disengage eventually
yeah I mean you can put too much stock
so like sometimes it fights me and
sometimes it doesn't
yes never gives up fighting you changes
there okay so has a different state yeah
thinking getting the states right
I could be so much better let's stop
oh you may you hacked for autozone I
know you followed like if the time is
short yeah
none of us is gonna get the earth people
a come on about accidents possible
accidents oh no one's gonna get hurt
yeah my hands are literally touching the
steering wheel it's not gonna do
anything that fast
and if I step on like the gas its
disengaged how do I read you know which
is cancel days accidents don't happen
the first time you go out and test
something accidents happen the 30th time
when you think it's just safe you stop
paying attention and then you crash
cut it
yeah
what else let's go we say silent
pretty good though yeah I mean you just
it feels like it's just not gonna I
don't know like I feel like a lot of the
mistakes Oakland pilot makes where it
like pushes you out of the lane our do
do it loses the actuator for a little
bit and then just in general yeah in
general what I feel it does in general I
feel like a lot of the mistakes like
open pilot makes we're all like little
like lose it and then try to change
lanes yeah um our because the actuator
dies for like you know have a second
yeah yeah and then you get close and
then you close and yet it's like it's a
lane change yeah yeah no definitely
having a good as to later they keep you
centered helps yeah
the thing
here so we're not available for that it
was still staring yeah sometimes it
changes state and well one week once we
send the the alert is the other stays
there for a while even if recovered
and for example now
and I need to call her AG docks of
supercruise way they talk about torque
oh yeah
we need regulation that forces people to
open-source
their say Jenna nice throw
[Music]
whatever should have to open source a
safety monitor
would have prevented over maybe yeah
yeah
all right so we get a little wobble here
like there's per this wobble present but
much much less than like on the Toyota
nice sharp turn coming up guys so he
does
we found it it's false
yesterday good
I don't I think I was like oh so I get
it that I kappa i'm at their statement
they're a lot
oh yeah
yeah model for you
the lanes are right it was like way too
far to the left
well okay
so it tries to recover sometimes have
seen like if the mother is not like
self-consistent he thinks is recovered
but it's not recovering because it's not
consistent but I also have a pretty low
weight on the steer great cast so you
should recover quickly yes I know it's
wobbling
yeah I mean it's crazy this is even
fairly on tuned as well it's like
literally the first time that we
actually dive it in this configuration
and never thought yeah so it is amazing
I'm sure it's actuator lag yeah I mean
if you own a kit that goes together we
can we can measure actuator life right
oh yeah yeah so let's like let's plot
our cars yeah let's do a table in the
open violet readme by car with lower
actuator lag people if you want a better
open pilot experience yeah now we need
the same at the same theater safety I
think I'm not even like what I'm
detecting this what I'm worried about
particularly with that is like it's okay
if I'm fighting it but I'm afraid it's
gonna let go and then I'm gonna jerk the
wheel all right yes yes because I keep
putting torque right I'm a constant
torque now I need you need the same
thing I think we have this information
so we should be yeah we should think
about trying to make that safety club
more generic but well at least we can
make it like a library kind of thing
everybody want the same thing in there
in the vault as well mm-hm
so the danger is when you was a human
put torque on the wheel the PID loop
winds up and applies more and more
torque to fight you so we want that not
to happen yeah we want to basically yeah
like acknowledge the human over right so
it was nice that the first car we chose
to do this Honda already has this code
built and it's jak controller yeah and
it is alright that's the only way to
describe what we see
without doing anything if you try to
arrive with their with their own on one
side and let go there are sponsors like
super small town yeah yeah Tata
definitely was enter and default if you
remember the vault when we tried about
did the same thing as the tree otter I
said so I'm not surprised that this one
is like this yeah yes it was evolved and
the L cast note on this is probably the
same as the vault
I know
yeah
but it's solely like because the
actuators are so tight if you can just
totally feel that yes it's not driving
badly it's just like yeah you have well
so
oh it's disengaged oh yeah how'd that
happen what happened I know how to press
I get check
well because it's had pingpong of
Elena's og
oh no this a book yeah now this ain't
like acid oh I really we gotta we gotta
kill the cruise control - I don't like
yeah yeah yeah but that's gonna be easy
yeah thank you sir I can't even do it
now will expand me yeah how similar is
bald and messaging to 66 also laughter
Donnie is completely different so just
the CDC to also support the vault
message because I saw it there no I'm a
different boss you saw it oh the both
but supercruise and I cows are done with
like 0x1 52 52 52 and 54 oh yeah now
they're the Cadillac is different with
super who is it has two active safety
module active safety control modules and
they send different messages for
steering when Julie no control seems the
same stealing to try it but it only
seems like the same thing GM's
longitudinal controls very nice they
have one packet for the gas and one
packet for the brake yeah the best and
you command like the throttle right so
the Honda has a packet for the brake the
Honda brake packet is great the Civic is
is they're like the Utes like an ideal
Frank right yeah it's pretty good
someone's got a red light got him
I don't know later I like Amazon because
the flash really gives it away
gauging autopilot here the autopilot
swerve
[Music]
into that car oh yeah yeah yeah yeah
yeah this is like you see this loop this
is like our standard loop for testing
cars so I'm pretty well calibrated of
how they all perform
yeah so I have to give this one
it's probably the best
well with some tuning yeah yeah it's a I
mean it makes the model failures very
very apparent because he's died there
this is tight yeah
yeah it's less fucking anger yeah
but on the other hand every like
immediate feedback before it makes you
that I like more pretty you can predict
a little bit more water carry down yeah
I don't like not having my
alert triangle oh yeah car doesn't have
radar yes flexowriter
[Laughter]
yeah we need to figure this out yeah a
completely separate system or is that
using the sides like usually the sign is
a second
no in car manufactures wouldn't surprise
me if they like put the normal stock one
on there too but they're also cheap
which is an interesting what damn car a
vacuum like they're extremely cheap yet
they have like five ECU's to do
supercruise oh yeah replaced with one
cell phone yeah so this is a great
development platform yes Wow
you can get one to scope is for the best
about buy a Cadillac will actually wait
until we get the gas of the brake to
work and also wait until we get radars
but you can still Bible radar in duct
tape it to the front of
[Laughter]
all right scope ease that was riding a
Cadillac bye-bye
you're all quiet why I was so quiet
focus on the Caddy because it's the best
car
oh let's meet the models even open up
the model team you guys know like L from
Death Note that's kind of what the model
team is like you're a bot block which is
my prime now get here you'll come with
it my prime now get here oh my prime now
I got here
ah oh yeah you guys wanna see what I got
I'm prime now I can't show you some of
that secret but I can't show you what's
in the prime now bag for Samsung Evo
SSDs and we'll leave you with that hope
you enjoy the ride
hi uh my name is rebec I work in the
research team uh so my talk today is
going to be about can you tune my car
this is a question that I get at least
once a week on
Discord uh so we have a Discord uh I'm
sure how many of you have been on our
Discord okay and we have a development
tuning Channel how many of you have been
on the tuning Channel okay great so if
you go to the tuning Channel you see a
lot about uh good tuning bad tuning and
ugly uh maybe not ugly just good and bad
so if you're new to open pilot or new to
Discord or new to the channel you might
be wondering what exactly needs tuning
right so everything that we spoke about
today we never really uh spoke anything
about like you know tuning something so
what exactly needs tuning and for that
you have to understand how is your car
different when it comes to open pilot
like how are cars different with respect
to open
pilot so so these are some of the brands
that we uh that we support so some ways
in which cars are different are you know
the wheel base is different and the
wheel base is the distance between the
front and the real wheel so as you can
imagine different cars have different
sizes so the wheelbase is different they
also have different widths and as a
consequence they also have different uh
masses like some cars are light some
cars are heavy we have we range we
support from like tiny cars to like the
ram U and they're quite different in
that way uh cars are also different when
it comes to other things like steering
ratio uh steering ratio is how much your
car turns with how much steering wheel
turned and that is different in each
platform and also different across
Brands uh your tire stiffness which is
like again like the quality of your tire
how much like torque your tire provides
while turning stuff like that is also
different uh the center of gravity is
different uh in all cars uh depends on
how many people are in the car and stuff
like that um and then actuator lags so
each brand and each platform have
different ways of processing the signal
that we send to the car so when we say
okay you know do this manure or do this
turn uh there is like some internal
processing happening in the car and then
it actually actuates that in the final
actuator and there is like a lag which
is also different for different brands
so all of these things are different so
to understand how like these differences
in cars manifest uh let's look at this
example so these are three cars the
Honda Fit the tur Cora and the ram all
of them are like you know quite
different as you can see the uh images
um so let's focus on uh lateral movement
right so let's assume all cars are
moving at 20 m/ second uh all all of
them have a 10° steering angle um and
they're all traveling on a flat
Road
so this is the trajectory that these
cars would take so this is the uh the Y
versus X so if you start at the same
position this is what the cars would do
Under the same instructions so it's I
guess right now it's clear that we need
to really understand like you know what
exactly happens when you give
instructions to
CSE so how do we actually learn these
things we learn these things using
something called the vehicle model so to
understand the vehicle model model let's
look at some high school physics uh so
you're turning uh you're in a car and
you're about to go to a turn uh so this
is the front view so let's assume that
the road is banked um and let's also
assume there's some wind because why not
um in this so this is the top view of
your car so your four wheels and your
front wheels are turning um so in uh I
don't know how many of you are familiar
with car Dynamics so this is something
that we call a slip angle the angle
between uh your direction of motion to
your heading is called the slip angle
and that determines a lot of the
Dynamics of your car so you can see that
there are forces that act on the tires
so this is basically a something called
a bicycle model which is you assume that
your car is a bicycle which is not a
good assumption but it really works it's
like a it's a simplified Assumption of
your car uh and then you know this is
where the center of gravity is and then
you have like you have if you draw all
the free body diagram and the forces uh
that act on this uh on this object uh
you end up with something like this so
let's quickly go through this uh it
looks quite scary but it's not so what
we have is the desired curvature that
you know we get from the model and from
the planner we know we the car has to do
something right at some curvature at
some speed so we have the yit if we make
some very generous assumptions about
cars and about our Dynamics we can find
out from the state space equation we can
find what the slip angle is to achieve
this particular yit and when we know the
slip angle we can find the steering
angle required to that you're required
to like turn to achieve uh like the
maneuver that you want to do so this is
this is called the vehicle model so we
have a a Damon in uh open pilot called
param which learns this all these
parameters inside that we that I spoke
about U and then it learns like the
Dynamics of your particular car so it
learns things like the steer ratio uh
the tire stiffness the road roll the
steering angle offsets and all of these
things and it learns all of these things
um about your car your particular car so
another interesting thing is that the
steering angle offsets is basically to
go straight you would assume you should
keep your steering angle at 0° but
that's not true all cars have some
Offset you have to keep your steering
angle at like 2° or minus 2° or whatever
and that depends on your car and how
long you've driven it and stuff like
that so this is all Al something that we
learn uh live while you're driving uh a
fun fact is that as a consequence of
learning all this we also know when
you're when you have a bad wheel
alignment which is if your wheels are
aligned badly and then you know if you
want to go straight you have to hold
your wheel at like a 10° angle or
something like that a lot of people you
know come on Discord and they're like
hey I just installed uh open pilot it
drives fine but it like you know it
tries to go when I hold when the wheel
is straight it tries to go right and
when it's going straight the wheel is to
slightly to the right it's my device
broken and then we tell them what the
problem is and then they come back a few
days later saying hey about that I went
to a mechanic and you know he said my
wheel alignments were wrong and then
they fixed it and now my car drives
perfectly so this is something that from
your logs and from the tolerances that
we know uh we can tell you if you know
your car has a bad wheel alignment okay
so now we learned all of this stuff so
where do we actually use it so you know
as you can as you see uh we have sensors
uh which is car agnostic we have models
and planning which is also pretty much
car agnostic uh but the actuators are
specific to cars so this is where uh you
know we convert the car agnostic stuff
to the car specific
stuff uh so so we started with uh a
manuver that we wanted to do which is
like a steering angle uh so to achieve
the same thing so we used a traditional
uh P ID control uh so we have a steering
angle and the car gives us back the
steering angle so we're like okay go 10°
and we have a plastic P ID control uh to
make sure that the car is driving 10°
and then everything is
good uh so this is the distribution of
the uh lateral acceleration error when
uh when you're doing these Manu so it's
very important for us to understand how
well uh the car is performing the maners
that you're asking it to do and for that
we have a whole bunch of metrics but one
of the most important is absolute
lateral acceleration error so what do we
mean by by this we mean that so when the
instruction is to perform some uh
manuver with some lateral acceleration
and the car is doing something else so
what's the difference between these two
and we have to drive this number down so
as you can see the straight is the
distribution is like the the average is
much lower than in turns which means
that while going straight you're pretty
much you know it's like er free but in
turns it's like it's it's slightly worse
so this is a metric just remember this
metric we'll keep coming back to this
again and again uh so we had all of this
right but then we realized that in our
Fleet uh the way we actually give
instructions to cars we don't actually
give the steering angle for like
overwhelmingly most of our cars we give
the torque we give the steering torque
that you have to apply to the car so we
realized wait a minute we were going
about this whole roundabout way of we
have the curvature we do all of this
equations and we find the steering angle
and then we close a loop on the steering
angle and then finally send torque so
you know we can just like circumvent
that and then try to find torque so this
was a whole effort uh called torque
control which we released in U
0815 so let's revisit the same uh manure
that we did earlier which is this car
doing this turn at this angle uh now if
you focus on the tire patch that is on
in contact with the road uh so this is
like the free body diagram of this tire
patch so you can see that these are the
forces that develop on your tire during
a turn so you can see the wheel is
heading is this wheel is moving here so
this is the slip angle uh so what this
effectively says is that the wheel
torque is uh you have a resultant force
that is like X behind the center of the
wheel so basically the wheel torque is
this resultant Force F uh times uh this
pneumatic Trail and for a particular
configuration of your car and your
vehicle this is constant so the key
Insight here was that that the wheel
torque is proportional to the lateral
acceleration that you want to achieve uh
adjusting for gravity and from data the
second Insight was that the wheel torque
is directly proportional to the steering
torque that you apply when you account
for some friction and friction is you
know when you when you're turning right
and immediately if you want to turn left
there is like a bit of friction in your
steering column that you have to account
for so basically uh you know we can get
the wheel uh we can if so we have a
lateral acceleration that we want to
achieve and we all we need to do is
learn one proportionality factor to
directly you know to know what command
to send to the car this was great news
so we can find one value which for each
platform and everything is good we
implemented this uh so you can see this
is the lateral acceleration that is
desired and this is the steering command
that we sent to the car to achieve this
and this is for a Toyota rap 4 and this
looks pretty linear to me uh so this is
what we implemented uh in 0815 and
torque control and then this is the
result so again the same metric absolute
lateral acceleration error uh for some
cars start up Prius and you can see that
the uh torque control was much better
than uh the simple P tune for uh this
PID on directly the steering angle so
this was great news and this is even
great because the subtlety is that these
higher errors lead to other things that
are undesirable like they lead to more
ping ponging they lead to like wandering
in the lane they lead to other things
like that which we don't want so this is
great news and you know everything looks
looks good
here but then okay let's revisit the
assumptions that we made the Assumption
was the pneumatic Trail was like
constant for a given vertical load which
means for a given configuration of your
car but then you know like even among
platforms even among like Toyota Priuses
like each Toyota Prius is pre slightly
different depending on like how how long
you've used it what you put in a car and
stuff like
that uh the contact Tire uh tire patch
is also quite different it depends on
your qu quality of your wheels it
depends on how much air you have in your
wheels it depends on which road
conditions you're driving on uh and the
steering column friction depends on you
know your wear and tear of your car and
and Etc so this is also uh collaborated
by the fact that when we do the same
calculation to find the the single
factor for each platform on every car of
that platform we see that there is like
a big difference in uh the big
distribution in the value that is
learned so these these are each part
this is the distribution of the factor
that I spoke about uh and you can see
that for even one platform there is a
wide range of values so we set the value
somewhere here in between and then it's
great for people whose cars are like
here but then if people's cars are like
here or here I mean it's not that great
um so this is this was like the
motivation for us to go down this route
of you know we don't we're not happy
with platform averages we want something
tuned for your specific car the car that
you drive so this inspired uh this
effort called Talk D which is autotune
uh so basically what it does is the same
thing that we were doing offline on like
all the data from a like a particular
platform like the RAF 4 now we do the
same computation on your device while
you're driving so when you start driving
we collect data and then once it meets
uh certain uh conditions we fit the we
use the algorithm what that we were
doing offline in your car and then now
we have one constant that is learned on
your car and the great thing about it is
that if you change your tires next week
or if you refill air or whatever if like
you have uh you put some stuff on top of
your car to go somewhere like it learns
live and it adapts live and then you
know your your performance becomes
better uh as a result of that which is
great so going back to the same metric U
so this is for Toyota Highlanders uh you
can see that the torque control was was
red which was already an improvement
over the previous generation stuff uh
but Tor D was an even better improvement
over that which is correct uh this make
this means that if your platform U has
like a bunch of versions where you know
like the versions are different but they
all somehow called it the same platform
it's still fine because we don't care
about that and we learn it for your
particular
car so let's revisit the assumptions
again we assumed that the uh the wheel
torque is linearly proportional to the
steering torque so we assume that you
know you apply some steering torque and
the wheel torque is some factor of that
and then we forgot about it but turns
out that's also not true uh we assume
that the uh there are effects like
backlash so when you turning left and
when you're turning and immediately you
have to turn right there is like a there
is some play in the steering column
there's like a backlash that you have to
overcome and then it's your car starts
turning right while driving we don't
really realize this because you know
humans are really good at driving but
when you're uh controlling the C through
instructions you realize you know there
are all these effects at play that you
have to account for um the other
assumption was that we didn't care much
about speed we assume that everything
works the same at all speeds uh you know
like that's fine uh but turns out this
is also not true for some platforms at
different speeds your car behaves very
differently and this also needs to be
accounted
for so for example if you take uh the
same plot of the lateral acceleration
that we desire versus the steering
command that input uh this is for the
Chevrolet bolt um I mean this looks
pretty nonlinear to me uh the if you
remember in the RAF 4 it was pretty
linear and in this it's not um so you
know we had to do something about this
because the same if you apply the same
algorithm that we used earlier uh people
have like not nice experiences uh
especially at the extremes where it's
like it gets pretty nonlinear so we
implemented a nonlinear algorithm where
we have a nonlinear fit for the
relationship between this lateral
acceleration that you want to drive on
and the command that you give um and
then this was out in
093 uh and you can see the effect of uh
this change so the nonlinear is uh is
better than the uh linear uh which is
also great uh and a fun fact is you can
see that there is like a bit there is a
difference in the uh left turn and the
right turn uh this is like an
idiosyncrasy of of GMS and all these are
super interesting things because we can
see this at scale and it's very hard to
see this if you have one car but you can
see that the errors are slightly higher
for left turns than right turns um it's
because you're the in in Chevrolet uh
the left turn is slightly different in
compared to right turns and I mean I
don't know why but it just is uh and
this also we need to account for uh so
uh this is some this was like a great
Improvement for the people using uh
people who have Chevrolet bolt so where
do we go from this right uh we've seen
that you know over time we keep
improving this stuff uh we keep like
making sure that we move from platform
we move move from Fleet averages to
platform averages and from platform
stuff to each individual cars so a big
effort for that was we uh released this
data set called comma steering control
and this data set is the largest data
set of its kind so what it has is it has
uh the actual command that you give to
the car which is the steer command uh
and all the other metadata like the
lateral acceleration the road roll uh
the velocity uh a whole bunch of other
stuff uh now this is excellent because
this is this data is something that
probably nobody else has like we are in
a unique position to have so much data
about so many different platforms across
different driving conditions different
uh like weather conditions and all of
that stuff and different like usages
like the cars have different wear and
tear so this is like a fantastic data
set uh uh which with all this data so
what you can and this is like uh 12,500
hours of open driving open pilot driving
uh 10 plus car models and uh 10 plus
Brands uh and we have uh plans to add uh
more data to this we have plans to add
uh non-open pilot driving so when when I
spoke earlier about the uh vehicle model
that vehicle model is valid for like
small slip angles which I mean by like
you know like small steering on a
highway but if if you want to do a rapid
180° turn the vehicle model completely
breaks down like you can't use the same
vehicle model for that uh in open pilot
we are not there yet to do 180° turns
but we will be and at that time we will
have to uh dive deeper into into the
data and figure out you know how we can
uh improve our algorithms to uh to cater
to those
maners uh so this data set has all of
this information uh so some people on
discard have already started using this
so they have some obscure brand that not
many open pilot users use uh so now they
have like access to a whole lot of data
that they can like dive into and they
can see if they can improve the
performance of their own particular car
uh which is
great uh so what what is the uh future
for uh tuning and controls right so we
want to use more uh neural techniques to
uh learn the complicated feed forward uh
forward functions so you saw we started
with like a simple linear model uh and
then we went to linear model on device
uh and then we went to a nonlinear but
with still like it's still we we sort of
uh reverse engineer the function and
then we learn it but we want to move to
like a totally learned uh function so
what this means is there'll be like
irrespective of what the input and
output is uh in your car uh we should be
able to learn the response of your car
to the instructions that we have that we
give to the car uh at all ranges of
speeds there are some cars that do
automatic roll compensation in the car
and all of this stuff we want to be able
to learn all of this stuff live um in in
your particular car uh the final goal is
to move to like a target audience of one
so basically the target audience of like
you and like everything is tuned to your
car and it drives perfectly like the
output of the model and the planner is
perfectly implemented on your car and uh
you know there is and and then the final
goal is me not getting any more messages
on Discord saying can you tune my car so
uh that's that's uh I just had a couple
of call outs so do check out this data
set do come on the uh Discord Channel
and we keep discussing a lot on the
Discord Channel um so you know hopefully
uh you can improve your own car uh much
better and then we can Upstream it that
would be great um and a call out to uh
open pilot user uh twil Sinker uh he's
been um like at the bleeding edge of a
lot of this stuff I just wanted to call
him out and say that's like great work
and uh we keep watching it and uh we're
very inspired and I hope this also
inspires more people to uh check out
what's happening inside their car that
that is great
awesome at the bleeding edge of a lot of
this stuff I just want to call him out
and say that's like great work if you
guys have any questions all right we got
lots of
questions in the
front so are all platforms using the Tor
D already for the automatic tuning or
that still needs to be flushed out so um
all Toyotas all
Hundai so I think it's about 80% of our
Fleet uses it The Hondas don't uh
because there is like a there is a
little bit of problem with the Hondas I
mean they also work really well on on
traditional P control uh so uh yeah I
mean most most cars use it and the plan
is to roll it out to all cars so all
toot
great hello so it's long tuno going to
be um in the foreseeable future for auto
tuning yeah so that's a good question so
the thing is the lateral tuning uh was
very much a function of
contr like it's it's very much defined
by the vehicle model and and the physics
behind it and a lot of the uh issues
that we used to have was not handling
the physics properly but the thing with
longitudinal tuning is that it's it's
it's not much as physics as much as
there's a lot of lag and we don't handle
the lag compensation properly in
longitudinal and it's like a bit tricky
uh to go over that so the problems that
are with lateral tuning is very
different from the problems with
longitudinal tuning so I mean yes to
answer your question yes we will have uh
we will have all the parameters learned
live in the car but it won't be part of
Tor D like that's that's like separate I
mean it's like doing something else uh
there will be something else like that
which will learn all the parameters
required for longitud got thank you it's
like a bit tricky that so the problems
that are with lateral tuning is very
different I think my question is kind of
similar to the last question but um how
do you deal with like hysteresis which
is like uh basically actuator lag like
uh like for longitudal you said there's
not much been done yet but for La
latitude like uh is it compensated for
in the motion planning or like yeah so
uh so what we call friction is like uh
is a manifestation of this hysterisis
effect which we already handle in open
pilot in Tor d uh we already compute
what this uh the the historicist
component looks like and we already
handle this so if you if you see the uh
plots uh I know if Greg can uh pull
something up so we have uh so what we
call friction is like oh yeah if you see
these plots so this is from our uh from
the uh uh data set yeah so if you see
this so this is from the data set that
we released uh so the effect there is
all hysterisis uh I mean you see the the
width in the in the plot right uh and
this is already accounted for in uh in
TD um and you know I mean we have more
effects like that which are not exactly
hyeres but they have this like sort of
discrete jump type of effects uh which
is you know more stuff for us to handle
but uh but yeah I mean hysterisis is is
handled in TD right
now uh what is the uh optimal model of
tire for open pilot 0.9 according to the
data I me yeah that's that's a good
question so I guess to answer that there
is an optimal model of a tire and there
is a simple and useful model of the tire
which is what we follow uh if you ask
for the perfect model of the tire I mean
you can find many textbooks on this one
topic on like what is oh sorry I meant
like the make and model like oh I see
should we be using Michelin or oh I see
I get you I got you uh I'm not sure the
thing is we don't uh from logs can get
the model of a tire so uh I guess that's
something that we don't have access to
uh but we certainly understand what sort
of uh like which platforms have like uh
what sort of effects in following our
instructions and that's something that
we can comment on but uh yeah we don't
have access to the make and model of the
tire all right I got a question up
fronts on one top is it on the road map
to replace the current controls and and
tuning system with a completely endtoend
machine Learning
System yeah there is uh but I guess it's
not to replace but to build on uh which
is as George said as everybody body been
saying I think iterative Improvement is
something that is like a core tenet at
comma so uh we had something very
simplistic and then we move to something
a little more complex and a little more
complicated and then you know that's I
guess the direction it'll be going in uh
we will have much much smarter
techniques that learn everything that
needs to be learned like while you're
driving uh and then uh yeah so it's not
it won't be like a replacement as much
as just building on what we already
have all right thanks you give it up for
re
[Music]
all right uh my name is Vivek I work in
the research team so my talk today is
going to be about
can you tune my car this is a question
that I get at least once a week on
discard
uh
so we have a discard uh I'm sure how
many of you have been an artist card
okay and we have a development tuning
Channel how many of you have been on the
tuning Channel
okay great so if you go to the tuning
Channel you see a lot about good tuning
bad tuning and ugly maybe not ugly it is
good and bad so if you're new to open
pilot or new to Discord or new to the
channel you might be wondering what
exactly needs tuning right so everything
that we spoke about today we never
really spoke anything about like you
know tuning something so what exactly
needs tuning and for that you have to
understand how is your car different
when it comes to open pilot like how are
cars different with respect to open
pilot
so so these are some of the brands that
we that we support so some ways in which
cars are different are you know the
wheelbase is different and the wheelbase
is the distance between the front and
the rear wheel so as you can imagine
different cars have different sizes so
the wheelbase is different they also
have different widths and as a
consequence they also have different
masses like some cars the lights some
cars are heavy we have we rent we
support from like tiny cars to like the
RAM and they're quite different in that
way
uh cars are also different when it comes
to other things like steering ratio
steering ratio is how much your car
turns with how much steering wheel turn
and that is different in each platform
and also different across brands
uh pure Tire stiffness which is like
again like the quality of your tire how
much like torque your tire provides
while turning stuff like that is also
different
the center of gravity is different uh in
all cars depends on how many people are
in the car and stuff like that and then
actuator lags so
each brand and each platform have
different ways of processing the signal
that we send to the car so when we say
okay you know do this manure or do this
turn uh there is like some internal
processing happening in the car and then
it actually actuates that in the final
actuator and there is like a lag which
is also different for different brands
so all of these things are different
so to understand how like these
differences in cars manifest let's look
at this example so these are three cars
the Honda Fit the Toyota Corolla and the
ram all of them are like you know quite
different as you can see the images uh
so let's focus on uh lateral movement
right
so let's assume all cars are moving at
20 meter per second uh all all of them
have a 10 degree steering angle and
they're all traveling on a flat Road
so this is the trajectory that these
cars would take so this is the uh
the UI versus X so if you start at the
same position this is what the cars
would do Under the same instructions so
it's I guess right now it's clear that
we need to really understand like you
know what exactly happens when you give
instructions to cars
so how do we actually learn these things
we learn these things using something
called the vehicle model so to
understand the vehicle model let's look
at some High School physics so you're
turning uh you're in a car and you're
about to go to a turn so this is the
front view so let's assume that the road
is banked uh and let's also assume there
is some wind because why not
in this so this is the top view of your
car so your four wheels and your front
wheels are turning so in uh I don't know
how many of you are familiar with car
Dynamics so this is something that we
call a slip angle the angle between your
direction of motion to your heading is
called the slip angle and that
determines a lot of the Dynamics of your
car so you can see that there are forces
that act on the tires so this is
basically something called a bicycle
model which is you assume that your car
is a bicycle which is not a good
assumption but it really works it's like
a it's a simplified Assumption of your
car and then you know this is where the
center of gravity is and then you have
like you have if you draw the free body
diagram and the forces that act on this
on this object you end up with something
like this so let's quickly go through
this it looks quite scary but it's not
so what we have is the desired curvature
that you know we get from the model and
from the planner we know we the car has
to do something right at some curvature
at some speed so we have the yorit if we
make some very generous assumptions
about cars and about our Dynamics we can
find out from the state space equation
we can find what the slip angle is to
achieve this particular unit and when we
know the slip angle we can find the
steering angle required to that you're
required to like turn to achieve uh like
the maneuver that you want to do so this
is some this is called the vehicle model
so we have uh Damon in uh open parallel
called param C which learns this all
these parameters inside that I spoke
about and then it learns like the
Dynamics of your particular car
so it learns things like the steer ratio
the tire stiffness the road roll the
steering angle offsets and all of these
things and it learns all of these things
uh about your car with your particular
car so another interesting thing is that
the steering angle offsets is basically
to go straight you would assume you
should keep your steering angle at zero
degree but that's not true all cars have
some Offset you have to keep your
steering angle at like two degrees or
minus two degrees or whatever and that
depends on your car and how long you've
driven it and stuff like that so this is
also something that we learn uh live
while you're driving
a fun fact is that as a consequence of
learning all this we also know when
you're when you have a bad wheel
alignment which is if your wheels are
aligned badly and then you know if you
want to go straight you have to hold
your wheel at like a 10 degree angle or
something like that a lot of people you
know come on discard and they're like
hey I just installed open pilot it
drives fine but it like you know it
tries to when I hold it when the wheel
is straight it tries to go right and
when it's going straight the wheel is
slightly to the right is my device
broken and then we tell them what the
problem is and then they come back a few
days later saying hey about that I went
to a mechanic and you know he said my
wheel alignments were wrong and then
they fixed it and now my car drives
perfectly so this is something that from
your logs and from the tolerances that
we know we can tell you if yeah your car
has a bad wheel alignment okay so now we
learned all of this stuff so where do we
actually use it
so you know as you can know as you see
uh we have sensors which is car agnostic
we have models and planning which is
also pretty much car agnostic but the
actuators are specific to cars so this
is where uh you know we convert the car
agnostic stuff to the car specific stuff
so
so we started with a maneuver that we
wanted to do which is like a steering
angle so to achieve the same thing so we
used a traditional PID control so we
have a steering angle and the car gives
us back the steering angle so we're like
okay go 10 degrees and we have a plastic
PID control to make sure that the car is
driving 10 degrees and then everything
is good
uh so this is the distribution of the uh
lateral acceleration error when uh when
you're doing these Maneuvers so it's
very important for us to understand how
well the car is performing the Maneuvers
that you are asking it to do and for
that we have a whole bunch of metrics
but one of the most important is
absolute lateral acceleration error so
what do we mean by this we mean that so
when the instruction is to perform some
maneuver with some lateral acceleration
and the car is doing something else so
what's the difference between these two
and we have to drive this number down so
as you can see the straight is the
distribution is like the the average is
much lower than interns which means that
while going straight you're pretty much
you know it's together free but in turns
it's like it's it's slightly worse so
this is a metric just remember this
metric we'll keep coming back to this
again and again so we had all of this
right but then we realized that in our
Fleet
the way we actually give instructions to
cars we don't actually give the steering
angle for like overwhelmingly most of
our cars we give the torque we give the
steering torque that you have to apply
to the car so realize wait a minute we
were going about this whole roundabout
way of we have the curvature we do all
of these equations and we find the
steering angle and then we close the
loop on the steering angle and then
finally send torque so you know we can
just like circumvent that and then try
to find torque so this was a whole
effort called torque control which we
released in 0815
so let's leave us at the same maneuver
that we did earlier which is this car
doing this turn and this angle
now if you focus on the tire patch that
is on in contact with the road so this
is like the free body diagram of this
tire patch so you can see that these are
the forces that develop on your tire
during your turn so you can see the
wheel is heading is this the wheel is
moving here so this is the slip angle
so what this effectively says is that
the wheel torque is you have a resultant
force that is like X behind the center
of the wheel so basically the wheel
torque is this resultant Force F times
uh this pneumatic Trail and for a
particular configuration of your car and
your vehicle this is constant so the key
Insight here was that the wheel torque
is proportional to the lateral
acceleration that you want to achieve
adjusting for gravity and from data the
second Insight was that the wheel torque
is directly proportional to the steering
torque that you apply when you account
for some friction and friction is you
know when you when you're turning right
and immediately if you want to turn left
there is like a bit of friction in your
steering column that you have to account
for so basically uh
you know we can get the wheel uh we can
if so we have a lateral acceleration
that we want to achieve and we all we
need to do is learn one proportionality
factor to directly you know to know what
command to send to the car this is great
news
so we can find one value which for each
platform and everything is good we
implemented this uh so you can see this
is the lateral acceleration that is
desired and this is the steering command
that we sent to the car to achieve this
and this is for a Toyota RAV4 and this
looks pretty linear to me uh so this is
what we implemented uh in
0815 and torque control and then this is
the result so again the same metric
absolute lateral acceleration error uh
for some car stereo Prius and you can
see that the torque control was much
better than this simple PID tune for uh
this PID on directly the steering angle
so this is great news and this is even
great because the subtlety is that these
higher errors lead to other things that
are undesirable like they lead to more
ping-ponging they lead to like wandering
in the lane and they lead to other
things like that which we don't want so
this is great news and you know
everything looks looks good here
but then okay let's review the
assumptions that we made the Assumption
was the pneumatic Trail was a constant
for a given vertical load which means
for a given configuration of your car
but then you know like even among
platforms even among like Toyota Priuses
like each starter price is pretty
slightly different depending on like how
long you've used it what you put in a
car and stuff like that
uh the contact tire patch is also quite
different it depends on your quality of
your wheels it depends on how much air
you have in your wheels it depends on
which road conditions you're driving on
uh and the steering column friction
depends on you know your wear and tear
of your car and and
Etc so
this is also uh corroborated by the fact
that when we do the same calculation to
find the the single factor for each
platform on every car of that platform
we see that there is like a big
difference in the big distribution in
the value that is learned so these are
each pretty this is the distribution of
the factor that I spoke about uh and you
can see that for a even one platform
there is a wide range of values so we
set the value somewhere here in between
and then it's great for people whose
cars are like here but then if people's
cars are like here or here I mean it's
not that great so this is this was like
the motivation for us to go down this
route of you know we don't we're not
happy with platform averages we want
something tuned for your specific car
the car that you drive
so this inspired uh this effort called
Talk D which is auto-tune uh so
basically what it does is
the same thing that we were doing
offline on like all the data from April
like a particular platform like the RAV4
now we do the same computation on your
device while you're driving so when you
start driving we collect data and then
once it meets a certain
conditions we fit the we use the
algorithm what that we were doing
offline in your car and then now we have
one constant that is learned on your car
and the great thing about it is that if
you change your tires next week or if
you refill air or whatever if like you
have you put some stuff on top of your
car to go somewhere like it learns live
and it adapts live and then you know
your your performance becomes better as
a result of that which is great
so going back to the same metric so this
is for Toyota Highlanders uh you can see
that the torque control was red which
was already an improvement over the
previous generation stuff but talkd was
an even better improvement over that
which is great this make this means that
if your platform uh has like a bunch of
versions where you know like the
versions are different but they all they
somehow called it the same platform it's
still fine because we don't care about
that and we learn it for your particular
car
so let's revisit the Assumption again
we assume that the uh the real torque is
linearly proportional to the steering
torque so we assume that you know you
apply some steering torque and the wheel
torque is some factor of that and then
we forgot about it but turns out that's
also not true uh we assume that the uh
there are effects like backlash so when
you're turning left and when you're
turning and immediately you have to turn
right there is like a there is some
player in the steering column there's
like a backlash that you have to
overcome and then it's your car starts
turning right while driving we don't
really realize this because you know
humans are really good at driving but
when you're controlling the car through
instructions you realize you know there
are all these effects at play that you
have to account for uh the other
assumption was that we didn't care much
about speed we assume that everything
works the same at all speeds uh you know
like that's fine uh but turns out this
is also not true for some platforms at
different speeds your car behaves very
differently and this also needs to be
accounted for
so for example if you take the same plot
of the lateral acceleration that we
desire versus the steering command that
you input this is for the Chevrolet bolt
I mean this looks pretty non-linear to
me uh the if you remember in the RAV4 it
was pretty linear and in this it's not
um so you know we had to do something
about this because the same if you apply
the same algorithm that we used earlier
uh people have like not nice experiences
especially at the extremes where it's
like it gets pretty non-linear
so we implemented a non-linear algorithm
where we have a non-linear fit for the
relationship between this lateral
acceleration that you want to drive on
and the command that you give and then
this was out in 093 and you can see the
effect of this change so the non-linear
is is better than the linear which is
also correct
and fun fact is you can see that there
is like a bit there is a difference in
the left turn and the right turn this is
like an idiosyncrasy of of GMS and all
these are super interesting things
because we can see this at scale and
it's very hard to see this if you have
one car but you can see that the errors
are slightly higher for left turns than
right turns it's because you're in in
Chevrolets
the left turn is slightly different in
compared to right turns and I mean I
don't know why but it just is uh and
this also we need to account for uh so
uh this is some this was like a great
Improvement for the people using uh
people who have a Chevrolet bolt
so where do we go from this right uh
we've seen that you know over time we
keep improving the stuff uh we keep like
making sure that we move from platform
we've moved from Fleet averages to
platform averages and from platform
stuff to each individual cars so a big
effort for that was we uh released this
data set called comma steering control
and this data set is
the largest data set of its kind so what
it has is it has
the actual command that you give to the
car which is the steer command and all
the other metadata like the lateral
acceleration the road roll the velocity
uh a whole bunch of other stuff now this
is excellent because this is this data
is something that probably nobody else
has like we're in a unique position to
have so much data about so many
different platforms across different
driving conditions different uh like
weather conditions and all of that stuff
and different like usages like the cars
have different wear and tear so this is
like a fantastic data set uh which with
all this data so what you can and this
is like 12 500 hours of open driving
open pilot driving uh 10 plus car models
and 10 plus brands uh and we have plans
to add more data to this we have plans
to add uh non-open pilot driving so when
we when I spoke earlier about the
vehicle model that vehicle model is
valid for like small slip angles which I
mean by like you know like small
steering on a highway but if you want to
do a rapid 180 degree turn the vehicle
model completely breaks down like you
can't use the same vehicle model for
that uh in open pilot we are not there
yet to do 180 degree turns but we will
be and at that time we will have to dive
deeper into into the data and figure out
you know how we can improve our
algorithms to uh to cater to those
manures uh so this data set has all of
this information uh so some people on
Discord have already started using this
so they have some obscure brand that not
many open pilot users use so now they
have like access to a whole lot of data
that they can like dive into and they
can see if they can improve the
performance of their own particular car
which is correct
uh so what what is the future for tuning
and controls right
so we want to use more neural techniques
to learn the complicated feed for
forward functions so you saw we started
with like a simple linear model and then
we went to linear model on device and
then we went to a non-linear but which
still like it's still we we sort of uh
reverse engineered the function and then
we learn it but we want to move to like
a totally learned uh function so what
this means is there'll be like
irrespective of what the input and
output is in your car we should be able
to learn the response of your car to the
instructions that we have that we give
to the car at all ranges of speeds there
are some cars that do automatic roll
compensation in the car and all of this
stuff we want to be able to learn all of
this stuff live in in your particular
car
oh
uh
not sure what happened there
uh yeah so I mean that was like I was
about to end so uh so that's the uh
so yeah so uh we that's like another
plan that we have uh the final goal is
to move to like a target audience of one
so basically the target audience of like
you and like everything is tuned to your
car and it drives perfectly like the
output of the model and the planner is
perfectly implemented on your car and uh
you know there is and then the final
goal is me not getting any more messages
on discards saying can you tune my car
yeah
uh that's that's it uh I just had a
couple of call outs so do check out this
data set do come on the uh Discord
Channel and we keep discussing a lot on
the Discord Channel
um so you know hopefully uh you can
improve your own car much better and
then we can Upstream it that would be
great uh and a call out to uh open pilot
user uh 12 Sinker uh he's been uh at the
bleeding edge of a lot of this stuff I
just want to call him out and say that's
like great work and we keep watching it
and uh we're very inspired and I hope
this also inspires more people to uh
check out what's happening inside their
car that is great
awesome
thanks
if you guys have any questions
all right we got lots of questions
in the front
so are all platforms using the torqd
already for the automatic tuning or that
still needs to be flushed out so um
Toyotas all
so I think it's about 80 of our Fleet
uses it The Hondas don't uh because that
is like a there is a little bit of
problem with the Hondas I mean they also
work really well on on traditional PID
control
so uh yeah I mean most most cars use it
and the plan is to roll it out to all
cars
great
hello so is longitudinal going to be
um in the foreseeable future for auto
tuning
yeah so that's a good question so the
thing is the lateral tuning uh was very
much a function of
like it's it's very much defined by the
vehicle model and and the physics behind
it and a lot of the issues that we used
to have was not handling the physics
properly but the thing with longitudinal
tuning is that it's it's not much as
physics as much as
there is a lot of lag and we don't
handle the lag compensation properly in
longitudinal and it's like a bit tricky
uh to go over that so the problems that
are with lateral tuning is very
different from the problems with
longitudinal tuning so I mean yes to
answer your question yes we will have uh
we will have all the parameters learned
live in the car but it won't be part of
talk D like that's that's like separate
I mean it's like doing something else
there will be something else like that
which we'll learn all the parameters
required for longitudinal gotcha thank
you
great
I I think my question is kind of similar
to the last question but
um how do you deal with like hysteresis
which is like basically actuator lag
like uh like for longitudinal you said
there's not much been done yet but for
latitude like uh is it compensated for
in the motion planning or like
yeah so uh so what we call friction is
like is a manifestation of this
hysteresis effect which we already
handle in open pilot in Doc T we already
compute what this uh the the hysteresis
component looks like and we already
handle this so if you if you see the
plots
uh I don't know if cracking uh
pull something up so we have a
oh yeah if you see these plots so this
is from our from the uh data set
I think it's fine
yeah so if you see this so this is from
the data set that we released uh so the
effect there is all hysteresis uh I mean
you see the the width in the in the plot
right and this is already accounted for
in uh in dot b
[Music]
and you know I mean we have more effects
like that which are not exactly
hysteresis but they have this like sort
of discrete jump type of effects uh
which is you know more stuff for us to
handle but uh yeah I mean hysteresis is
handled in totally right now
uh what is the uh optimal model of tire
for open pilot 0.9 according to the data
I mean yeah that's that's a good
question so I guess to answer that
there is an optimal model of a tire and
there is a simple and useful model of
the tire which is what we follow
if you ask for the perfect model of the
tire I mean you can find many textbooks
on this one topic on like what is this
sorry I meant like the make and model
like oh oh I see like should we be using
Michelin or oh I see I get here I got
you uh I'm not sure the thing is we
don't uh from logs can get the model of
a tire so uh I guess that's something
that we don't have access to but we
certainly understand what sort of uh
like which platforms have like uh what
sort of effects in following our
instructions and that's something that
we can comment on but uh
yeah we don't have access to the make
and model of the tire
all right I got a question up front
is it on the road map to replace the
current controls and and tuning system
with the completely end-to-end machine
Learning System
yeah there is uh but I guess it's not to
replace but to build on uh which is as
George said as everybody's been saying I
think iterative Improvement is something
that is like a core tenet a comma so uh
we had something very simplistic and
then we moved to something a little more
complex and a little more complicated
and then you know that's I guess the
direction it'll be going and uh we will
have much much smarter techniques that
learn everything that needs to be
learned like while you're driving and
then uh yeah so it's not it won't be
like a replacement as much as just
building on what we already have
all right thank you give it up for me
back
now you don't the stabilizer what did
you see Minh what what did you do casual
airport drive
[Music]
but we should always have a stabilizer
with us at all times that's right of
course Co isn't great it's really the
scope piece of something yeah I know
it's not us
reven no this casual there's not gonna
be too much Twitter activity because I'm
going to New York for the weekends
and I am the company a social media
manager hey I know social media managers
going on vacation
it sure is a little dim seems damn
picture
at least the contrast is going
Wow why could break so hard left turn
what are you driving which I have around
or just casually the email coach two
truck sisters
um because getting to level 4 on the
highway is much easier than getting to
level 4 in cities also your cost per
unit for trucks can be significantly
higher than for cars in order to have a
viable product
this is Davis playlist this is a Spotify
playlist skull throwback to the 90s
my knees work great time someone killed
their great panda Wow
yeah um I tore it apart
they're quiet - it's casual and we're am
reminding it's minding me of that uh
like don't weird
yeah that was cat and it's just life
people just how open fire can Fitness is
like
do we have any opinion on uber
I'll just say the safety driver should
have been paying attention and attention
should be more enforced once you get
systems that go like ours without
disengagement so I let you guys know it
has the six minute timeout and you know
it's to remind you that you need to
still be in the loop with this car drive
we can help my eyes are straight ahead
on the road and I could react any
scenario that might arise associate is
very important to pay attention while
you're using these systems no matter
what the system is there's no such thing
as a level four self-driving car every
self-driving car today is level two and
requires a human monitor at all times
maybe way most moved a little bit beyond
that but over certainly hasn't you know
I think that the right approach to
solving this problem is kind of the
supercruise style approach so if you
supercruise it has a camera that watches
the driver and make sure that you're
attempting it's the only way to scale
once you get systems
our six minute thing is fine because
that's about how often all compiled it
already messes up if you played a video
game and you had to react to something
that messes up if it messes up once
every minute you'll have no problem if
it messes up once every 10 minutes
you'll probably have no problem and if
it messes up once every you know hour or
two
just watch the driver each other bacon
juice
no it does not change things
automatically
is it true that the Oakley's Classen
calibrating the background
isn't here's a manual they change I can
let it go
dark the street I know yeah why it's so
dark
third price like a dark stormy
we are poor yes we are you don't need
HDR that way oh that's a nice Drive in
Portland in two weeks and the entire
do you have this 360-degree camera
system of your app or what do you think
about Tesla Nevada pilot I heard good
thanks hey I think they're finally using
their data from the people see that
looks so much better yeah well right
like it has to do with the whole balance
in the scene exposure is really our
problem
sorry Skokie so like it's so much better
with the stabilizer I know sorry
anything here with the pedal well we
were going to drive the Acura which has
an installed common pedal the battery is
dead so we took the rabbit stuff
I think the commissary will I thought
replace the lower level
right into designing a company I have
rights of you blown away by the mapping
periscope you guys are killin it
check out our grip pen Oh guys this is
unofficial news I have to loud on
periscope I'm not loaded Paul even
though I am word unofficial news but
grey pandas are coming back in stock to
that today
well you saw a boy they're dropping off
the great bear big news right
damn people are wondering what was the
point of yesterday what was the point of
yesterday we're gonna race this weekend
yeah and we want to make sure all our
stuff for the race is good every one of
the tests don't test racing on public
roads you test racing when close to
course this is insane is what we did how
do you handle reaction as far as a
how do I have the luck reaction just
have reaction let us know you can that
you can react at any time you can take
over at any time you saw me I just
touched you all right Bob well George is
the social media manager for karma and
no one else has access to the Twitter
periscope so the race will be hard to
periscope dan this isn't air what
yeah you guys find any experts and you
can exist
don't you shout
you guys should scope the races yeah
[Music]
you guys gotta keep me in town guys a
future world leader loves thing kazuya's
Wow George you taught leader I'm a
future world troll I am here to troll
I'm your troll and cause trouble for
everybody who takes the world too
seriously that's a that's my goal in
life
charges - no actually yeah hold on the
wheel Jeep Chrysler has UConnect hundred
five scho fees this is more than normal
hey I think Opie's are really better oh
yeah and how do you differentiate
between a no pilot failure causing
engagement and me just disengaging at
light pour your shell rule is all
Jeffrey James and there's a ticket I'm
not gonna engage over by the airport
[Music]
there's one at the part or doesn't want
to arrive once it's the part in a job
well compiled oh yeah yeah people really
like the Mexico yeah yeah so this cars
make maps right now I've owned with the
great bandoneon is out there making maps
great bandoneon NHD are is a mapper
that's amazing what we got here
bigger than a self-driving car it's also
where is the most stealth self-driving
cars like we used to grow up to the
airport with like a lie down on the roof
I was kind of like sketchy
yeah blow when is HDI of R+ coming
everything badly Scopus yeah everybody's
guys dogs see
thank you
oh no I'm not what do I do
[Music]
all right we should be live welcome to
Comic-Con 2023
[Applause]
we're very excited to have you all here
with us uh
today we're going to show you the work
that we've done in basically the last
two years
um it is I'm Alex by the way I run
operations a comma and first up we have
Harold our CTO and head of the
Department of magic
um he's gonna talk to you guys about our
major achievement last year which was
the drive to Taco Bell
welcome to the stage Harold
[Applause]
hello good morning welcome to Comic-Con
and uh yeah so I'm Harold I'm CTO and
I'll be walking through our drive to
Taco Bell last year we drove to Taco
Bell with
one of our open pilot cars in uh mostly
end-to-end system I'm gonna be walking
through that and just general stuff that
research is working on
so
to start off with I'm gonna
just recap some uh oh I got a mouse
pointer over there let me uh that one
out
uh to recap basically what I talked
about two years ago which is our general
architecture for a self-driving system
so our goal at research is to make a
superhuman driving agent so someone that
can drive a car better than a human can
and
we have a few particular constraints
that we're using to do this
first of all we want to do it completely
end to end so by end to end
we mean that we want to put in sensor
data into a neural network so like video
and potentially other sensors but
predominantly video and get driving
decisions out and have the system Drive
the big reason for this is that this
gives more flexibility to the machine
learning model to learn behaviors and
patterns itself without being
constrained by for example a perception
layer or some kind of other hand-coded
stuff in between the system
secondly it's really important that we
build solutions that scale well with
compute
a large part of society is working on
constant constantly improving the amount
of compute that is available and when
the next Generation computers come out
and the next generation's gpus are ready
to train models you want your system to
get better as a result of that
and so end-to-end training is one way to
get that because there's no hand-coded
constraints
but there are some other things we need
too such as a really good loss function
and enough diversity in the data
diversity of the data we have we have
plenty of users we have much more than
we know what to do with
and then also you need a good simple
loss function that reflects good driving
so a clear example of the victory of
this strategy is recent improvements in
llms they have an extremely simple loss
function a generally quite simple
architecture and
they have now demonstrated incredible
ability over the last few years
two years ago when I gave this talk
there were still some serious players
doing very classical things in
self-driving but honestly today nobody
takes bounding boxes seriously anymore
and everyone is moving to end-to-end
type systems
so I just want to end this introduction
with the quote from Rich Sutton who has
a very
um
relevant blog post from a few years ago
where he described this effect and he
talks about the great power of general
purpose methods methods that continue to
scale with increased computation even as
the available computation becomes very
great and this was before the llm
Revolution and as you can see he
predicted this very accurately
okay so that's kind of the basic
overview of what we're trying to build
so we can break this system down into
three basic parts
first we have end-to-end lateral control
which is basically just controlling the
steering based on the video end-to-end
longitudinal control which is
controlling the gas and the brakes based
on the video of the scene and then the
last part is to actually get to the
place that you want to go you need to
put in a destination so humans usually
use Google Maps or something like that
and they look at the video of that as
well as the road scene to kind of make
driving decisions so that's something
we're going to have to do too and as you
can see here this is how that would work
the model just sees this as well as this
and then it can get you to your
destination
open my water bottle here
so
Taco Bell
as a kind of proof of concept of these
three parts coming together and showing
that with an end-to-end system that has
no intermediate perception layers
doesn't have any code related to Lane
lines or traffic lights can actually do
something like drive from point A to
point B we set ourselves a challenge at
the beginning of last year which is
driving from
downtownish where old office was to a
local Taco Bell it contains just some
normal diversity of driving Maneuvers
like some some right turns and some
exits on-ramps Lane changes all that
stuff and we said we're going to do that
by the end of the year without a
disengagement on our device on a comma 3
just in a normal production car which
was rev6 and open completely open source
so anyone can see what we did and by the
end of 2022.
so we got a very
reasonable question is that going to be
an Elon time or real time
but for those who've been following
along it is real time by the end of 2022
we have posted you know the full drive
all the logs and all the code
so let's go through how we actually did
that so back to those three parts those
are the three parts we need to implement
and if they work reasonably well it will
work as a proof of concept and it will
drive us to Taco Bell
so let's start with the end-to-end
lateral
this is uh what the majority of my talk
was about last time talking about the
technical challenges involved with doing
something end to end
um
so
what we basically train on is human
driving behavior we train models to
predict where humans will drive we can
predict like curvature your rate or
points in space it's all kind of
equivalent
that by itself is not enough to train a
system because you need it to be able to
recover from noise and deviations and
mistakes so that's why
we had to train it in a simulator and we
have to introduce noise and teach it
recoveries
and then for the simulator to actually
be able to instill behavior in all kinds
of driving and to just scale with
compute and data we need to make sure
that the simulator reflects the full
diversity of the real world so we
constrain ourselves to using a simulator
that's based on real data and we have
a method for doing that which I
explained in in two years ago
which is by augmenting real data to make
it seem like you're moving around
and I tried really hard to get a picture
where I didn't look stupid from last
talk but that was actually very
difficult
so lateral's done that was two years ago
back then it was still kind of in Alpha
mode people could choose to opt in or
not opt in to end-to-end lateral control
they could revert to the Lane line
policy if they wish but today the only
thing we ship is the completely
end-to-end policy there's no logic based
on Lane lines it just drives based on
human behavior
so that's done
so let's talk about the second part
which is uh end-to-end longitudinal
so when we designed the lateral system
we always had longitudinal in mind it
was obviously never supposed to be
designed specifically for lateral but we
were focusing on the challenges involved
specifically with lateral first but
always keeping in mind to expand this to
longitudinal later
so most of the architecture worked
exactly the same for lateral as
longitudinal
instead of predicting instead of it
being your rate and curvatures that are
relevant to predict
um you predict speeds and positions and
accelerations but those together with
lateral come into like a complete plan
of where to be in 3D space
so we can plug this into the simulator
that was successful for lateral but we
immediately start to get some issues
which is our simulator was pretty
rudimentary it used as you can see here
this is how it would work we would warp
the image basically sideways essentially
we were assuming that everything in the
scene was on the road plane and we were
warping it to be consistent with that
but that means that everything in the
background all the cars kind of warp
sideways and that actually wasn't that
big of a problem for lateral because the
road is what matters most but for
longitudinal you can see it's a lot more
extreme
so we need to do something about these
simulator artifacts the model can't
learn intelligent behavior when there is
so much artifacts in the simulation
so this brings us to how do we make the
simulator better to basically
make the background reproject well when
we move around and also other cars
we have a rudimentary segment that we
use for
a variety of things it's it's uh
predicts a very minimal set of classes
doesn't have any bounding boxes it just
predicts is something part of the road
part of the background part of your car
or part of other movable things
and you can see that working in this in
this scene right here
so you can quickly start to make some
pretty rudimentary assumptions about
what these things are and what how far
away they are just on what they are so
the road is generally relatively flat
and continuously flat and form some kind
of plane the background often sticks up
straight up and so do most of the cars
so with that
with those assumptions and a very
accurate understanding of the road plane
we can actually kind of guess put in a
depth for all these objects based on
that and it won't be super accurate and
especially won't be accurate for things
in the background but the most important
things are the things in the immediate
background and um
and the cars on the road and because we
have very good road plane estimation
we can actually do this quite well
so you can see this in
in action here so this is what it was on
what we trained the lateral model zone
two years ago and then with the new
assumptions you can see you can see some
artifacts here for example but the
models really see a kind of abstract
version of this and so they capture most
of the behavior especially because
things on the road are perfectly
reproduced which are for all kind of
driving the most important
um
so we plug that all in we do the same as
lateral we train some models make them
bigger try some stuff and that works
you can see here this is what we posted
around the time we started having
successful experiments
on our ev6 just coming up to traffic
lights it uh you know slows down speeds
up appropriately and it's also
surprisingly human in doing this despite
us not having to hand code any kind of
smoothness or controls related things to
achieve that it just knows from human
behavior what a reasonable approach to a
stoplight looks like when it's either
red or orange or green
so again this is completely end to end
there is uh no traffic light code that
achieves this this is just learn how to
do gas and breaks from Human driving
so just a little fun side note on that
there is actually traffic light code in
our internal code bases
but it runs this traffic light in our
meeting room that we can over the
Internet change colors on but yeah so
that's the only traffic light code in
the comma code base everything that
makes your car stop at traffic lights is
learned end-to-end behavior from machine
learning models
so that sounded really easy I just gave
you one quick fix to our simulator and
it went from less crappy to from crappy
to a little bit less crappy and all of a
sudden we have something that stops at
red lights and stop signs now is it
really that easy uh well no because it
took us two years and also no one else
has really done this so it can't be that
easy
so I just want to talk about
even though these ideas are extremely
simple and the solutions are also very
simple to the problems we're facing
actually implementing this and
developing a shippable system ends up
having a lot of challenges and several
things that cost a huge amount of time
so the first problem is we build an
end-to-end system because it's extremely
robust it can learn driving behaviors
even if the ground truth is noisy even
if the ground foot is completely wrong
for example if we were to just take one
percent of the driving images and flip
them upside down
the models would still learn to drive if
we were to reverse some of the videos
the models would still learn to drive
but the problem comes in when in start
to start to see regressions in some of
the edge cases and it's not entirely
obvious so you need extremely good tests
and infrastructure and tools to
understand how good your models are and
which things affect it so that you don't
have these little subtle regressions
that don't cause obvious failures but
overall regress the performance of the
system
and over these years we've found
hundreds and hundreds of these types of
bugs that will completely break some
tiny percentages of the ground truth and
every time we improve them everything
gets slightly better
another thing is all these things rely
on extremely accurate Road plane
estimation so we need to understand the
curvature of the road and the pitch of
the road and exactly how high the car is
above the road and all those things
without that you also start to get
pretty serious issues
but I think where we spend most of our
time is in the code we delete the things
we refactor to make them simpler and the
bad ideas that we have try and then have
to reject and completely delete
it's always a continuous fight against
complexity that's what we focus on most
on comma we want to reduce complexity
keep the solution simple and manageable
because that's how you can have a good
chance of finding as many bugs as
possible and not being susceptible to
this issue where you have this large
robust ml system that we constantly have
bugs give it bugs to and subtly regress
Behavior overall
another proof that this is a pretty good
strategy we have a really tiny team
working on this stuff and we have a
pretty small code base yet with that
we've managed to ship end-to-end systems
that as far as I know no one else has
and especially none that are
commercially available so this is
clearly effective
to give you an idea of how tiny the team
is everyone from the research team and
infrastructure team except our newest
hire is giving a presentation today so
that's how small the team really is
so since I spent so little time on what
the actual solution was to end to end
long because it really was quite simple
I want to give you some ideas on the
things that we really did spend time on
and that cost a huge amount of time
so first of all we spent a probably over
half of last year doing a really big
refactor
now I'm not going to go into the details
of explaining exactly what this refactor
means because the original architecture
didn't really make sense to begin with
which is why we had to refactor it and
if I tried to explain it today I don't
think I would understand it myself
but basically the system that we had
shipped to achieve end-to-end lateral
planning had many steps it included
included student teacher approaches it
included different types of architecture
that work together and it had many
stages of ground truthing
and it was just difficult to move away
from that because it was very effective
it was deployed in the in the field and
if we wanted to refactor it we had to
make sure that the new simpler version
was just as good and theoretically it
should have been but it just took a
serious amount of effort and testing and
refactoring to get there
but after a little bit over six months
of work we managed to do that
um
we were able to take the training time
down from at the time around five days
from beginning to end with all the
models we needed to just two days
we had four models before that needed to
be trained all necessary uh that we
could reduce to just two models so now
it's just a vision model which takes in
scene compresses it to an intermediate
space and then a policy model that
actually makes the driving decisions
and this was somewhere in the middle of
last year or even a little bit before
that and since then infrastructure
improvements and other optimizations
have taken this trading time down from
two days to much less than one day and
Greg will be talking about that more too
so that's a really big deviation by the
way from what many other people are
training training models in one two days
is not really that common in machine
learning world but something we feel
very strongly about because it allows
you to iterate very quickly and correct
mistakes very quickly whereas if your
training run takes three weeks that
means you know in one year you can fix
50 bugs which is not that great
um
so that was a positive thing that we
spent a lot of time on there's also some
things that we wasted a lot of time on
first one was actually one that seemed
like a great idea last Comic-Con and
that we were advertising as something
that was going to give good results soon
uh which is stop lines
so you can do end-to-end longitudinal by
just predicting speed and acceleration
or you can you can kind of
find places that the human stopped and
then say this is like a place to stop
and try to stop for that place we
already had Logic for lead cars that
tell us how to stop in a place pretty
smoothly so we thought this would be
pretty easy to implement
but in reality even though it's very
easy to predict these places to stop
with the model you end up seeing that
not all places to stop are built the
same people stop very decisively for a
crosswalk uh
very decisively for a rail road crossing
not so decisively for a stop stop sign
on an empty road for example
so the end to end is a much better
approach here and as soon as we even
within like two weeks of trying to
replace the stop line logic with end to
end we saw it showed way smoother
Behavior around these things and way
more comfortable
so probably wasted a few months on that
and then the other thing is depth Nets
so
the solution I showed earlier was
basically estimating the depth of the
road plane for simulation
making some basic assumptions about the
background and other cars and then
reprojecting to simulate
and that sounds extremely simple that
sounds like it's too stupid and really
what you should be doing is have a large
machine learning model that predicts
accurate depth of everything in the
scene and then you won't have all these
weird artifacts that I was showing
earlier
so that sounded like a good idea to us
and we spent a few months training
training models that did this and they
did predict depth relatively well
but they were still quite noisy they
weren't as accurate to understand the
road plane without the assumption that a
road plane is flat and continuous there
was a lot of inaccuracies there and as I
mentioned that's a really critical part
and also in the things that it should
have been way better at like the
background you start to see these Halos
around stuff in in depth
and then beyond that you start to even
get more issues which is what's the
depth of the light that comes out of a
lantern
I mean that's it there's no real answer
to that the depth of a pixel isn't
necessarily a real concept it makes
sense in many cases but as soon as you
start talking about shadows and
Reflections and all that sort of stuff
it breaks down and when we were doing
stuff with depth Nets we actually were
finding a lot of issues related to
lighting that were causing problems in
the other approach so we weren't even
going to fix those with the depth Nets
so after a few months of that we
completely abandoned this approach
so that's end-to-end longitudinal done
as you can see it was
mostly bug fixes mostly little cleanup
there was hundreds of bugs that we fixed
that I I didn't talk about and then some
big stuff like these refactors and then
just the slightly improved simulator and
that's what produces the end-to-end
longitudinal behavior that we ship today
in experimental mode
so that's done
and then the third part which is we have
to actually put the map into the model
the idea here is extremely basic which
is uh we have some video of navigation
feed just like Google Maps we show it to
the model and the model can understand
which driving actions to make by seeing
which the humans made to get to a
certain place Mitchell's got a whole
talk about this later and about the
challenges in testing and actually
shipping something like that
and as of two days ago we released
end-to-end navigation uh as part of
experimental mode
so that's also done
so now we're starting to get pretty
close to having something that we think
we can try this Taco Bell attempt on
there's a couple more things that we
ended up doing uh so we've got the model
here that's uh basically what I've been
talking about so far
we have some other controls stages what
we call a planner is essentially a
controls layer
and that needed some changes to
accommodate high angle rate turns and 90
degree turns that's in release that's
not in the state that was necessary
another thing we did is we conditioned
the model on aggressiveness of drivers
so the idea was if we classify every
driver as either being smooth and
conservative or aggressive we can also
tell the model at runtime to drive like
a conservative driver or like an
aggressive driver and we did that for
the Taco Bell run so that it would drive
more like a conservative driver and go
slower through the turns and just
generally be more comfortable
and then the last thing is uh we did map
based Lane changes so the lane changes
are completely end to end we just say do
like a human would but to trigger the
lane changes we uh used the mapbox logic
that said in which lane to be and if
there's an exit coming up
so that's just four commits that code is
still open
you can you can go look at that code the
logs of the driver public
and the models are end-to-end as we
intended and there's only a couple other
things that we had to change
and so December 15th we ordered our food
from Taco Bell
and uh completed our challenge
so I'm just gonna play the video here
for a second
I'm gonna attempt to speed this up which
is very high risk
okay
that went pretty well
so as you can see it starts in the city
there's some
just some normal stop and go traffic
with some traffic lights that it does
fine and does the on-ramp here
then there's a short section on the
highway so you can see that lane change
it made there was based on the
on the map-based logic so openstreetmap
said you're on the on-ramp so switching
to the lane and then same here there's
an exit coming up make some Lane changes
to the right
um yeah and then there's just a few
minutes on the highway take the off ramp
there's some turns here
and I think there's just a final turn
coming up and then we'll see Taco Bell
in The View
so just this left turn and then Taco
Bell should be right there
somewhere
oh there we go right so that was our
[Applause]
[Applause]
thank you thank you
so that was a demo uh we make final
demos a lot because they there's a
massive difference between shipping
something and having a demo of something
and the Taco Bell Drive was a demo like
I said earlier we wanted a proof of
concept of the systems that we intend to
ship working together
but that's only the beginning we then
still have to go through the effort of
making this stuff actually
[Music]
um
usable and comfortable and reliable
and that's way more work beyond the demo
so I think we did maybe about a dozen
drives I think once we had the models
that we wanted and all the end parts
there's a whole bunch of reasons why we
did redid drives sometimes we had camera
issues sometimes open pilot was too slow
sometimes open pilot didn't take the
exit
um
and actually I think about 30 of our
drives uh were unusable because there
was a whole bunch of trash on the
on-ramp that some car dropped and uh
that that
was about four drives ruined until we
waited for the city crew to clean up
so it did it it can do it it's end to
end but there's still work to be done
so when will it actually be good so we
have experimental mode people can use
end-to-end long
um
it's about
22 percent of people that use it today
and you know it still has flaws but some
people prefer driving with it
so if we look back at the situation of
end-to-end lateral control we can go
back two years I found this message in
our slack Deep saying we have 16 point a
lot of numbers of people who were using
laneless at the time and currently we're
already higher for end-to-end loan so
that's pretty promising
well you can also see in this image is
how our metrics changed over two years
from uh slack messages to a real
dashboard and
something that we can track over time so
some interesting things to point out uh
end-to-end longitudinal is very relevant
at low speeds and you can see here that
the engagement numbers are significantly
higher at the lower end mid speeds than
without
end-to-end longitudinal but then in the
on the highway there's still stuff that
we're trying to improve if the model
decides to drive too slow people will
generally disengage and drive faster so
that's one of the things that we're
working on fixing for end-to-end lawn
so this engagement minutes is a bit
higher than it is for normal driving
normally it's about 25 to 27 and in
Miles uh I think now we're hitting about
55 to 60 percent of miles are engaged of
open pilot users so that's the majority
of our users driving is driven by open
pilot
uh and then that's two of the three
parts and then the third part is
navigation which is released two days
ago so
when will it be good well if the past is
anything to go by which it should be
then in the next two years we'll be
getting these numbers to a hundred
percent and all because we drive into
Taco Bell
[Applause]
so that's what we've done so far I'm
going to talk a few few quick notes
about what we're working on next
so we keep talking about end to end we
even have hats that say end to end and
end-to-end machine learning is really
the core of what research stands for we
want the models to do as much as
possible to do as much as possible
internally to make everything as simple
as possible and have all the difficulty
be dealt with by the gradient Descent of
the model training this is an extremely
effective strategy and the last few
years have really driven this point home
with things like gbt4
so we still have a simulator that's hand
codes at physics we estimate the depth
with some rudimentary assumptions we
reproject that's not great we want to
have machine learning models that can
simulate for us that's something that
you've seen we'll be talking about later
we still have classical controls the
controls is quite smart and does a lot
of learning which uh Vivek will be
talking about later
but it's not machine learning so
that's something that we can improve
eventually we will need reinforcement
learning uh it's it's normal for the
model to need to do something to do some
driving with your car to get used to it
that's how humans drive too and should
improve over time so that's something
we're looking into
and then finally a little bit more long
term
every time one of our users disengages
they're giving a signal that they would
prefer to drive an open pilot that's
something that we want to feedback on
because that means our system did
something uncomfortable or undesirable
and so in the future we want to feed
those signals back directly into
training and have the models learn to
optimize how to make the people happy
so and then if we zoom out a little bit
more
we can think what's an even more General
and more end-to-end approach than just
focusing on driving
so driving is a subset of Robotics
there's you know Ada systems or some
robotic system you have even a bit more
Niche you have like these self-driving
race cars but you know there's also just
general purpose Robotics and they share
a lot of things in common uh interacting
with the real world understanding
actuators and you know friction and
physical limits and that's something
that as the self-driving systems improve
will become more and more relevant there
too
and this at first may seem a bit weird
to think like that you can make a more
effective system easier with a
completely General approach than you can
with something hyper specific but just
to give recent examples again
um anyone who's making machine learning
models specifically to be a medical
doctor or a lawyer is now completely
outshined by uh gbt4 and nobody that was
working on gpd4 was specifically
optimizing for that they made a general
purpose language model and it beat
everything specific and so it's not
unreasonable to think that that's how
robotics will play out too so we want to
keep zooming out and thinking are there
general purpose robotics methods that
will be very effective in self-driving
in the same way as general purpose
language models
we're good at domain specific things too
so
along that axis on stage we've got Billy
and silly their little side project that
we've just been working on
the comma 3 is a great development
platform it has
good compute for machine learning it has
a screen microphone sensors kind of
everything you need in a robot very
similar to a human head and the only
thing that's missing to do robotics
experiments is to put some wheels on it
so we do sell those Wheels it's very
much a dev kit but we've been having fun
with it over the weekends so just kind
of experiment with some kind of Robotics
types things and see how well the comma
3 holds up and if there's anything
interesting we can learn from that
so I think it was a couple weeks ago
some of the research Engineers went to a
hackathon with Billy and silly and they
uh won second place doing some just some
things with llms talking and taking a
picture of you and printing it
so
more on a little bit of uh fun fun
robotics with the comma 3 we're going to
do a hackathon at the office it's going
to be some kind of indoor navigational
challenge can we use you know machine
learning to navigate indoors you know is
that similar to driving outside that's
the kind of stuff we want to explore uh
we'll probably have some like obstacle
course indoors and have people try to
get some kind of speed run through that
it's going to be the whole weekend at
the end of September we'll do like 20 30
people if you want to come you should
apply and we'll select 20 30 people from
that and we'll post more details about
that later it's going to be at our
office which is super cool we moved into
a new office last year it looks a bit
like a compound and has a fountain so if
you're interested in robotics hackathon
definitely check it out
and that was it for me so let's move
over to questions
[Applause]
all right I'll be doing some walk around
q a does anyone have any questions all
right we'll start up here
oh uh so I was just curious where to
navigate on uh open pilot uh I saw that
in the video it was doing fully
autonomous Lane changes but uh as far as
I I'm aware like uh looking in the code
and on my own custom Branch I don't see
that
um it's actually it's only using the
blind spot sensors on my Toyota 2020
Toyota Corolla but it's not using the
railroad facing camera so
um if it's only using the blind spot
sensor that but the blind saw sensor is
not like a hundred percent like um
effective right um so how safe it would
it be to do those Lane changes which is
so it's still an eight-ass system so
you're expected to pay attention any
time so for example in a Taco Bell Drive
you can see that I'm checking the blind
spot monitors for those Lane changes
yeah and I mean that's kind of what
we're imagining and also this is true
for all of open pilot driving for the
foreseeable future you need to supervise
it so yeah the expectation is we'll make
we can make Lane changes when we think
it's a good idea but there's still some
burden on the
on the user but that aside in the future
we are going to use the both the
interior facing camera and the blind
spot monitors uh to check this so it
should become more reliable when we move
to that but we haven't shipped that yet
oh okay gotcha and just uh one more
small question like does that work on
every because um in the DBC file I I
don't see like Lane chain or the
indicator status so yeah that's going to
be car specific and then the interior
facing camera will be uh on all cars
obviously
the questions down here
hi two questions did you go to the
retreat after you delivered Taco Bell
Drive so it's planned for October
but it's real it's always planned for
October and the second question as far
as I understand the enter and long it
doesn't give anything specific attention
to speed limits right no it doesn't so
like I'm from I'm from Europe and like I
know that here you can make a pretty
good guess in States like what the speed
limit is going to be in Europe it's a
mess right so I mean that's going to
change in the future
just just like Europeans users need to
pay attention Lane changes to speed
limits open parallel world 2 and in the
future we'll add that as an input it's
just not the priority right now
um for depth prediction in the simulator
have you considered or tried out using
neural Radiance fields or anything
similar to that before
so I didn't train the depth Nets you can
you scene did those
but just generally speaking
we we didn't see a future in that
approach the concept of depth just
doesn't scale towards the end and so
even if we had perfect depth Nets we
didn't see a solution so we were
actually dealing with a lot of issues
which is so you've got headlights of
your car they illuminate the road in
front of you and when you start
augmenting the video you need to augment
those lights too an adapnet can never
help with that and that's the real
reason why we gave up not because we we
were confident obviously you can get
better and better models but not that we
can solve this concept of depth to make
a good simulator
hi is the model trained entirely on
simulated data or is there any fraction
of real world camera data too so
it's trained entirely on simulated data
but the simulated data is all real video
that is augmented okay there is no
actually simulated there's no like pure
simulation data
like like Unity or something like that
anyone else down here
oh yeah thank you for the presentation
um so you know I think a lot of the
questions around like hey
this doesn't seem like it's ready for
like general public driving prime time
but this is still quite an impressive
system are there narrower applications
that are now much closer to being kind
of production ready
twice or
uh yeah with and self-driving so say for
example you can't drive on a public road
but could you drive around a mining site
for example
oh I mean I guess but yeah we're just
not really interested in that we want to
make a really good Ada system and kind
of expand on this robotics
AI future I guess
uh can you talk a little bit more about
some of the techniques uh for the
end-to-end nav with the map like for
instance keeping it at like a static
zoom level versus zooming in as you get
close to terminal presentation about
that later this morning and we'll go in
a lot of detail and that's why I glossed
over it very quickly okay I have some
more questions if that's okay
um can you talk about maybe some of the
challenges with disengagement analysis
for cars that don't have op long
um you know how do you detect it's a
disengagement for just a failure of the
stock ACC versus an actual open pilot
you know uh long I mean we know whether
they're using stock lock so I mean
obviously we we know that context when
we're looking at the disengagements
right we know if it's their system or
not so that's that's not an issue but
actually some some disengagement
analysis uh talk coming also later and
wishing well we'll give some insight
into that as well okay one more question
related to that
um you know is is it a training day that
should get more useful from cars that
have op long enabled or you know do you
still use it for cars that don't have op
long enabled that are using the stock
ACC so training data the way we train
the models now not necessarily but as a
kind of feedback for us as the engineers
to understand how the system is being
used and where it's failing it's more
useful when you have op long but again
it's not training the models it's
training us but I don't know is that
kind of that's kind of the same thing in
the end
okay thank
you thanks
how many of you have used open pilot in
a car raise your hand wow all right
great those are the kind of numbers I
was looking for
um well if you've used open pilot you
might be familiar with our next speaker
adeeb uh welcome to the stage of you
[Applause]
nice talking
Adib is the head of open pilot and our
newly appointed Chief product officer
congratulations
[Applause]
gonna transition
yeah I think we need to switch back
all right good morning everybody Welcome
to Comic-Con
thanks for coming out to San Diego
um it's good to see so many of you are
users
um
so like Alex said I'm oh it's not full
screen
all right
all right I'm adeeb I'm the chief
product officer here at comma I lead the
open pilot team and I'm going to talk
about how we actually ship open pilot
so we have a saying at comma we say the
difference is ship ability we've been
saying this since the beginning
it's a pretty important core tenant of
comma everything we do is designed to be
shippable we don't as Harold show we
don't really spend time on things that
we don't think we can ship we always
develop something to be at least have an
intermediary that we can ship first even
if we can't ship the very final system
um
so Harold showed you a bunch of cool
things that the research team develops
um they tell the car where to go
um but then what do you do after that
you've got these really fancy machine
learning models they tell the car where
to drive how fast they drive and they
can even navigate now but how does that
get to you in open pilot
so first we need some Hardware
and this is what comes in your car it's
a lane keep camera
it's got a very tiny amount of compute
so unfortunately we can't run open pilot
on it
um
it's also got no video out but so we
don't get a raw camera stream out of it
um and it's different in every car so
that means for every car we'd have to
not only reverse engineer the messages
to read the state from the car and send
the actuation we'd also have to figure
out how to interface with it possibly
get a camera stream out of it
um
and figure out how to run it on that
processor so this one has a mobile eye
chip uh
so instead
since we can't use this what we do is we
ship the comma three we launched this at
last Comic-Con
and has everything you need to run open
pilot
it's got three cameras
it's got a Snapdragon 845 so every
single one has the same processor
whether you have a Toyota Corolla a
Hyundai Sonata or a Honda Civic
and it's got enough compute to run
modern machine learning models and it
interfaces with every single car exactly
the same way
and the way we do this is we take pcbs
into our office and comma 3's come out
so the first step in this process is
something called circuit spoke
um the original comma 3s you may have
bought towards last year's Comic-Con or
two years ago were made by a
manufacturer called circuit hub we
replaced them with something called
Circus book that's in our office ever
since we moved we've been running common
threes there they come in with bare pcbs
just like that
and then they run through this line we
have a jet printer a pick in place an
oven and some fancy aoi
and then they get headed off to the
production room right over there
and then it goes off to assembly you can
see a bunch of comma three boards here
lots of stuff on them
and then they get provisioned stress
tested
and you order them at shop.com with AI
we fulfill the next day we fulfill every
day
um
so
now we've got some Hardware
um next we need to run on a car
so we know self-driving is entirely a
software problem
um but now we explain why we need to
start with Hardware
but fortunately we don't need to build a
car modern cars are more than good
enough they've got Lane keeping so we
can control the steering by using the
same inputs and the same with the gas
and the brakes
so here's the Toyota Prius very early
supported car for open pilot
um
so for each car we need Hardware to
attach the comma 3 that's a little bit
more specific than the comma 3 so every
pin out
um on the camera connector that I showed
previously is different
so we have a little bit of special
hardware for your car but the compute
isn't
and then we need some special software
for your car to read and write to it
and we've done this about 250 times for
the 250 officially supported cars and
there's many many more in uh community
supported Forks
foreign
so this is the car harness
this is the
this is the end that goes into your car
this is the end that goes into the comma
three
each car and brand uh each brand and
model tend to need a different uh wiring
harness
they provide Power and access to the can
bus and that's how we talk to the car
we have 34 different harnesses that
cover our 250 supported cars
um
so now that we're attached to the car we
need to be able to read and write from
it
so each brand again has its own messages
that needs to reverse engineered after
we've already connected to the car
um
and then we read a bunch of signals like
speed steering angle whether the cars at
stand still the steering torque that
you're putting on the wheel we read out
a whole bunch of things and then we need
to be able to send steering gas and
brakes to your car
all right now I'm going to talk about
something that's pretty exciting open
pilot safety
so this is something you don't expect or
you might not expect you know you have a
machine learning model that tells you
where to go we have a planner we have a
control stack
um but how do you constrain that output
how do you make how do you ship this in
a continual way
um where you don't have to think about
these things in this stack how do we
abstract out the safety from this
so we have something called the open
file safety model and it guarantees a
couple things
so first it says that the driver must
always be able to take control of the
vehicle by stepping on the brake pedal
or the castle button so this means
you're able to engage openpilot and take
control whenever you want
um
and then we have this next point which
means
essentially open pilot can't react
um or do anything too quickly for an
attentive driver to not have enough time
to take over
so we enforce the safety and through
that openpilot is able to pretty much
make whatever decisions it wants and
it's constrained by the safety model as
long as we do a good job of enforcing
that
so there's some pretty good standards
around this that allow us to formalize
the safety model give it specific
actuation limits and give us a good way
to think about safety
so ISO 15622 gives us some good
guidelines for ACC
um
and then there's another ISO standard 11
270 for Lane keep we recently updated
our safety documentation with some of
these actuation limits so that they're
more uh they're more formal you can go
in you can read these documents they're
very readable they're like 15 page PDFs
this stuff is very accessible and then
you have ISO 262 which is just kind of a
general framework for thinking about
functional safety for road vehicles
and then we have something called the
panda
um so the panda in your comma 3 doesn't
look quite like this
but this is an external panel for can FD
cars
it's a secondary processor that directly
talks to the car
so a common thing you might see about
openpilot on the Internet is that you
know I don't want a phone driving my car
well the phone isn't driving your car
this is the thing that talks to your car
um I think it's an important point
because this is one of the coolest parts
of open pilot you know you can have a
fork and the panda protection you don't
touch the panda and you should be in
good shape
so the panda has all the code that
enforces the safety
and it allows open file to be something
called qm
so there's this framework for thinking
about safety called Azle it stands for
Automotive Safety Integrity level and
then there's something uh below the Azle
ratings called qm this stands for
Quality Management
um and what that means is
any
anything open pilot wants to do as long
as it's constrained properly by the
panda safety it's worse consider bad
quality
um it essentially has no safety
implications in regards to the safety
model
um so when you're talking about open
pilot safety
first you should read the safety model
and then you should go okay is the panda
properly enforcing the safety model and
if that's the case then whenever open
pilot makes a decision that you felt was
unsafe you have a proper way to think
about
um
whether this was
actually unsafe it provides some very
specific language to talk about this and
we're quite strict about how we
communicate this because it's really
important to think about it in this way
and the panda goes through loss of
testing and it has very rigorous code
standards we observe miseracy at all
relevant Automotive safety guidelines
there
and now I want to talk a little bit
about testing so you've got a system
but how do you continually ship it so we
ship open pilot updates to master
several times a day and we ship open
pilot updates to our release users
roughly every month
um and you might be surprised to know
that the releases go through very little
specific testing
um we have really great testing
infrastructure that we try to get as
early as possible so that means when
we're pushing code directly to master we
expect to find those failures pretty
immediately on Master by the time
something hits release it's pretty rare
to find a bug you might have noticed we
don't really ship hot fix this anymore
things are getting quite stable on that
front and the zero nine open pilot
series
so back in 2016 there's a fun quote I
found this Commit This was uh well
before my time towards the start of the
company and it says one day we'll have
CI
so today we do have CI
and the test Suite looks a little bit
something like this we don't test in
cars this is the first principle if you
have to go down to a car first it's slow
all the cars are different
um it's not a good Loop
so we run regression tests in the cloud
with GitHub actions
we have Hardware in the loop tests that
run on tons and tons of real common
threes
um
and then we have dozens of comma threes
running open pilot continuously but the
CI is getting so good that these dozens
of comma threes really don't find
anything it's getting quite boring
um you just see them driving and driving
and driving and uh it's
um really pretty incredible the way we
can ship things now to open pilot master
and I don't know how many of you run
master or try to run the bleeding edge I
suspect many of you do if you showed up
here but I think you haven't seen a
regression in quite a while
so I want to talk a little about one of
our tests it's called process replay
and it allows us to deterministically
replay all of our driving processes so
that means you have the driving model
for example we give it the same video
and then we say okay what do the outputs
look like do they look exactly the same
for the same inputs
um
and this essentially outputs a diff in
the outputs of the process given two
commits so you can say I have this good
known Commit This is good known behavior
and what is the deviation from that good
known Behavior you get a green check
mark if there's no difference and if
there are differences it's really easy
to go in and say okay this is an
expected difference and then or this
isn't an expected difference and I
messed something up
and the real power on this is it makes
refactors essentially free
um you know when you're doing a refactor
and you you're changing something you're
like I don't really know if this is the
same you know you run it a little bit
and you're like okay this looks roughly
the same with process replay uh your
coverage is only constrained by the
inputs if you want more coverage you
throw more data at it you can generate
data that'll be relevant for what you're
doing but
um we just throw in lots of segments
from lots of different cars and we get
great coverage that runs on every single
open pilot command and gives you a diff
from the last known good open pilot
commit
so this allows I think research right
before the release merge a fairly large
refactored rate Rd
they are able to run it through process
replay and a larger version of process
Replay that they maintain and uh it was
I mean nobody was concerned about this
before the release
it was just business as usual
all right so this is uh kind of the most
important thing in testing green check
mark means good to go if you don't trust
your CI then it there's almost no point
so every time you commit you should be
very confident when you get that green
check mark that you're ready to merge
this and nothing is
nothing unexpected will happen
essentially
sometimes there's there's good red X's
we have some cool tests like a power
draw test that asserts that essentially
every driving process doesn't use uh
more or less power than expected so
we've had some fun ones like that where
we've done some optimization you've got
a red check mark and it's like okay I
lowered power usage and then we can
adjust the thresholds and we can say
this will not regress in the future
because we test this explicitly on every
single commit and it's similar with CPU
usage memory usage all those kinds of
things
all right so this robust testing
infrastructure enables us to ship open
pilot updates extremely regularly
there's essentially no uh bottleneck on
shipping to master you have a green
check mark then you're you you feel very
confident sometimes you might you know
ask somebody for a review but uh really
the machines are doing your reviews for
you
um they're enforcing essentially all the
behavior we want to enforce and this
allows us to support all the 400 plus
contributors we have now it's nearly
double since last Comic-Con and it's
pretty incredible we hit 10 000 commits
we've have
of those 10 000 commits I I think about
30 of them are from external
contributors
um who you know you can't expect an
external contributor to Too Much
validation it works on their device
works on their car improves their
experience
um but it's always hard to expect them
to do the validation uh when they're not
the ones clicking the merge button so
we've really removed that burden on
ourselves in the same way that they go
through the same workflow that we do to
validate our changes
and I think a really cool feature of
this is we have 250 supported cars this
has grown again double since last
Comic-Con I think it was 134 last
Comic-Con and it's a single engineer
maintaining all those cars we're
expanding car support we support all
major brands now we recently merged
support for Ford
um and it's uh
it allows the community to really uh
the community is really able to uh
leverage our CI and we just
we're able to validate their stuff so
quickly that uh we can have one person
who just builds tested infrastructure
for them and then we merge their
carports and it's a really great
pipeline now
all right so I want to talk a little bit
about what's next for open pilot now
that you have an idea kind of how we
ship open file it
um we ship little boxes to you guys I
showed you a little bit about the
procedure for that
um and then you know there's some
unexpected hiccups you know you need to
do some safety you need to do some
testing so that you can ensure that
you're continuously shippable but what
are we shipping next
so this is something from the taco video
we had to bump up the low speed torque
the way we implement the safety for our
park-based cars right now is
um it trades off some implementation
Simplicity for maximizing torque at all
speeds
um because for a essentially for a given
uh
you can only maximize
your lateral cell acceleration for a
given torque at
um at narrow speed range so that means
at the low end you're not getting as
much torque
um so in the future what we'll do is
we'll be able to look at the speed and
the panel will say okay you can get a
little bit more torque at the low end
and then we'll be able to give you a
consistent amount of lateral
acceleration across the whole speed
range rather than at one narrow point
where we maximize on the highway
um
and then this is another interesting one
coming up a lot of cars are coming out
as Vision only they don't have Radars
um so we've got to start doing comma a b
we want to this is a milestone that we
need to hit for openpile 1.0
um this is a video from when we did our
first a b tests
when we were doing
some more of our
some safety work on uh
we wanted to validate that essentially
we pass through the the a b messages and
that it still works so this is the first
time we did that we built this car this
is how we do it and some systems are a
lot better than others you should go and
read the blog post I pulled this picture
from there it's really great we analyze
the
the manufacturer aab systems and we we
compare them we Benchmark them and we
can compare them even to open files for
Collision warning which is really pretty
uh pretty good and really suitable
enough to ship an aeb but then again
there's a lot of safety work that's
needed to ship aeb you don't want to
just uh trigger at any time it also
extends the safety model we're going to
trigger when you're not engaged so
there's quite a bit of safety work that
goes into this
all right and then we want to ship to
more robots Harold talked a little bit
about this this is going to require some
brief factors to support cleanly the
common body fit in pretty cleanly as a
car but we want to support more robots
you might have noticed the self-drive to
system refactor in open pilot we're
going to keep working on that and it
should be really easy to integrate in
any of your robotics projects
and then uh we're trying to make
everything more Plug and Play you might
have had to fingerprint your car I see
there's a lot of users here
um hopefully you didn't have to but this
is a metric we're starting to track now
we refer to as ttff
um that's a GPS acronym that stands for
time to First fix the open pile team is
a kind of commandeer to mean time to
first fingerprint so what this shows is
how many users every day didn't hit a
successful fingerprint who should have
essentially they bought a comma 3 they
saw their Toyota Corolla was supported
they put it in their car and it said car
and recognized so this is something
we're fixing it turns out we uh we were
very concerned in the beginning we
pinned to exact like these four more
strings we get from the car
and it turns out you know they don't
change their apis that often we can look
at these firmware versions a little bit
more and we can essentially if we say we
support the Toyota Corolla you plug in a
comma three it'll just work so we ship
the first version of that for Hyundai's
in 093 Toyota's are coming up next and
we'll extend it to all the cars
all right and now I want to shout out
our external contributors we have 474 as
of uh this morning
so
if we can get a developers developers
Developers for our external contributors
in three two one
development Developers
all right time for questions
[Applause]
so you can ask me questions about open
pilot the product the production process
really anything like that
no so we actually run these on the CPU
in GitHub actions
yeah
yes
um so there's actually some Brands where
the EPS does this for you so like a
Chevy bolt is like this
um
yeah yeah
so the question is
um like what's the best car brand or or
even model specific model that has like
the uh the highest low speed torque
limit
so there's some cars that are uh all
these apis are different amongst the
cars the Chevy bolt happens to be one
that already has good low speed torque
because they already compensate for this
when you request the torque so that's
one you can get right now that'll have
really great low speed torque
all right I'm back here
thanks so much for your presentation I
always love anything on CI
um so
in in your replays I guess you're you're
kind of trying to see if the car or or
the new release yeah does the proper
behavior again you don't have a
regression do you have any and I'm
asking this because I'm kind of
interested in this this project called
Vision zero right
um
do you do you have any testing
techniques or know of any testing
techniques for say reproducing Adverse
Events like collisions like can you kind
of test for hate as a certain type of
behavior in a car actually cause a
collision
so these tests are a little bit
different they're lower level than that
so what we test for is we take each
individual process and processes really
only do uh they have very narrow Scopes
so we'll say like is the car parsing are
we taking canned messages and we say did
we parse the same car state out from
this
um so it's much lower level you probably
want to ask the research team this
question they have really great tests
for this stuff
thanks so much for that feedback it's
super useful
uh yeah can you talk a little bit about
your segments you use for testing and
validation you mentioned um do you are
you kind of continually changing those
out over time as you get fresher data
for off of more recent open pilot
versions or is it kind of just one big
list of segments that you're
continuously building on over time
so the big list we build on over time is
the ones for cars
um we have several test segments for
each car we support and we have like
this 200 line unit test it's really
great and it basically ensures the cars
never break
um this was this turned out to be a
problem up until maybe a year or two ago
where uh you know there'd be some minor
regression in all these cars especially
since we don't have one from each
platform
so that one we continue to build on over
time for other tests you generally get a
pretty good coverage
um from so we have to update them
occasionally when there's new outputs
and new inputs but uh largely no we
don't have to the next step for this is
like fuzzy testing and you want to
really search over that whole space and
make sure you get full coverage
and generate the data
yeah
I have a question um which car brands
are the easiest to support and the
hardest to support and do you have any
thoughts on their software engineering
practices and quality
um so easy as a sport this is really
changing now actually the software
platforms and the cars at least for the
8S we're pretty stable for about like
three four years and we did a lot of
this initial work maybe three or four
years ago and now we're in this cycle
where you know Honda Toyota Hyundai a
lot of them are changing their their
platforms right at the same time so
that's the hard part right now is we're
getting kind of this influx that are all
different right now
um the hardest ones now are the ones
that implement the autosar secure
onboard communication
we haven't spent much time on it but uh
that'll be a little bit of a project it
just adds more overhead to porting a car
yeah I think you had a second question
oh
um I mean we reverse everything so
sometimes we see some fun stuff but
largely it's you know it's the practices
of the tier one
um the worst part is sometimes the apis
just don't make any sense at all and we
have to hack around that
hi I have a question on the community
collaboration so
um what's the expectation as far as for
you know proper communication and also
the quality of the PRS that we do like
what's that like and uh we have a lot of
PRS that's being you know being
um opened with cut with the open pilot
repo but yeah always getting a lot of
time at the time to get a merge or get
them you know even review is a long time
so what's the expectation that um the
external developers or collaborators
should be expecting
so
um as far as communication
um
we tend to merge the things that are
pretty immediately mergeable pretty
quickly and then we have to prioritize
essentially what is valuable to us right
now
um there's a lot of the ones that are
open are
um
maybe there's like a lot of refactors
that are like of questionable value that
maybe we should just close
um
and perhaps we should have some kind of
Auto close mechanism that's we can
certainly improve this but uh for things
that are like pretty immediately
valuable we'll try to provide good
feedback
um immediately and try to get them
merged but it essentially goes through
the same prioritization as the stuff we
work on it's it's really quite a small
team that's looking at this stuff
hi so um for all the testings are being
done on open pilot what's the process
like of uh developing a test case
developing a test case Okay so usually
the way this works is you write
something and then you say okay I'm not
sure if this is uh this is going to work
quite the way I expect then you are the
test case
um so generally we have a lot of the
kind of General test cases that are end
to end it's written already and then now
it's more of a specific unit test cases
that get written I mean you can look at
the I was looking at the open about
commit history this morning actually to
get a nice picture for something and uh
it's like mostly tests so that's what
you see these days things that like
regress a little bit and we write a test
form we say okay this is never
regressing again
okay uh just wondering if you could
share any insights into your AEV deep
dive which brands did well which brands
did not
so Honda Bosch I believe was uh
was the worst performing um it was
actually fun when we were testing it we
had to put a license plate on it I think
we have to put a German license plate to
get it to trigger
um yeah so the funny thing is they
released the testing procedure so you
can kind of engineer it
um it's kind of like the fuel emission
stuff where you know sometimes they
engineer a sort of demo essentially for
when they do the test
um but again it's we'd have to like
fully reverse the systems to understand
how it works it might have actually been
looking for something that was real
um but it's probably time to redo that
test we support a lot more cars now and
we can redo that blog post
um I had a question on steer torque do
you only do you only use torque for for
uh rate limiting or do you use steer
angle ever
uh so it depends on the car we
essentially want to limit the the two
things we want to limit our lateral
acceleration and jerk these are actually
specified in ISO 11270
um so we have to limit essentially what
the car gives us we develop a safety
model or a safe an implementation of the
safety model for each car as it comes we
recently supported the Fords
um
and those you know they don't take
torque
um we give it curvature we have to
develop something around that
um fortunately for a lot of the eps's or
don't provide enough torque the that
exceed the iso 11 270 limits some do
um and we but we implement the safety
nonetheless for all of them
you spoke a lot about Cloud testing with
CI but you sometimes do Hardware in the
loop tests so can you elaborate more on
how and when you do those and any best
practices you adhere to yeah so the best
practice here is we do them on every
single commit
um they're
if the test is something you have to run
manually it's just not going to get done
sometimes uh you're less likely to also
make the change that you want to make
um the the best feeling about CI is like
you know when you're at home you want to
make a change and you're like you know
oh well it's public it's really easy to
like go on the GitHub editor it's like
oh let me make this quick change and
it's like do I commit to master the
small change do you open a PR
um
and uh you see the green check and you
just merge it it's like I don't feel
like it's gonna
you feel really good that it's not going
to break master and I do this pretty
often where I go home at night I'm like
oh I want to make this quick change I
end up merging it that night go to sleep
and I'm not worried it's going to break
Master because we do have like 400 users
who run the very very bleeding edge
um so if it does break Master they'll
let us know pretty quickly
hi um
it sounds like you do uh uh a
a
CI on pretty much every commit yep um
does that also go for uh hardware and
loop testing or is that more less
frequent rather nope okay on every
single commit and in that case
um
how how long do you run those Hardware
in the loop tests because I've seen open
pilot bugs that don't manifest until the
comma has been running for a few days
um like what kind of bugs like uh uh low
IPC rate errors
um a failure to engage after being on
um doesn't turn off when the battery
gets low things like that do you run a
fork no just a regular release channel
oh okay we should talk about that after
maybe but uh so we have some different
infrastructure for that we call it the
testing closet because it actually
started in a closet and our maybe two
offices ago when we were in a house and
it's essentially just dozens of comma
threes running continuously
um
and the hardware and the loop tests are
like normal unit tests that need to run
on the real Hardware to validate some
some things that we can't reproduce on
like Cloud CI Runners like using the DSP
and the 845
so I had a question uh what motivated
the desire to actually assemble the pcbs
and Boards in-house like what problems
did you guys run into from so contract
manufacturers we uh use this company
called circuit Hub and you know we got
bored under the bus what's up
yeah things got too complicated and now
that we have this it was uh it's really
incredible for prototyping we can like
essentially have CI order boards every
Friday and it makes so much sense it's
like 200 for a bunch of boards we just
run them through the line it's really
fast and easy uh doing revs with the
comma 3 took forever
um
so it's uh it's really a superpower in
that regard too but we've been doing
some really great tuning over the last
couple weeks on the line and uh finding
like the really littlest things we catch
into production we stop the line
immediately we go and fix the thing you
know and we're able to do the same
things we do in production but on the
boards themselves
here we can tweak every little detail
yes
faster replied better fall
I I just have a question on capacity we
ever have capacity shoes ever and
multiple users you uh using the software
whatever or something like that does
that ever called Peak and have to
distribute it
I'm sorry what kind of issues uh
my question is related to capacity so oh
capacity issues yes I've ever run out of
capacity issues and then how we
distribute multiple user using same time
like does that the peak you know the
peak volumes for that multiple users are
using at the same time yes well
everything runs on your device so
there's no issues like that you don't
need to connect to the cloud except for
navigate on open pilot but that just
hits like a tile server and a routing
server so uh the load is pretty low
there
do you have any kind of special process
to integrate tests for driving feedback
you get from users for like consistent
disengagement spots across open Violet
versions like for instance there's an
express lane that I drive on and it's
consistently taken tried to take the
exit across you know
op0909192 it did good on the way to the
airport a few days ago on 9-4 but I had
a lead car in front of me so I think
that definitely played into it
um driving behavior questions are
generally best asked for the research
team wishing is going to have some
really great stuff on this
um on like this engagement analysis
um we have a driving feedback Channel
Discord where there's like a nice form
you give it a route as long as you
upload all your logs so the if you ever
want something looked into by us we love
looking at the bug reports but they have
to be you know you have to put in the
effort to make it really high quality
um I mean just put in the effort and
it'll be high quality so don't worry too
much about like don't worry whether it
is high quality so just continue to make
the reports because I've reported them
all and you know I try to talk about the
feedback but um just was curious if you
had a specific process to like
prioritize those or you know kind of
make sure that there's no regressions
um so we do look at everything in that
channel we look at everything that's
reported essentially and we
if it's something that looks a little
bit concerning or that looks like a
regression will evaluate whether it
actually is or it progressed in like
some very minor cases and we we
prioritize that way we do look at
everything that comes in so thank you
it's not always easy to respond to
though
yeah generally I would just like to
thank everyone who's made a good bug
report
um I think people don't realize how
valuable yes give it up for bug
reporters
um
yeah that slide really should have been
bug reports bug reports bug reports you
truly I think people may um not really
fully realize how valuable the reports
can be to the team you know where teams
so small and we have about 12 cars
ourselves I feel like we don't talk too
much about our cars but you know so
we're testing things but I think people
don't realize how many varieties of cars
out different each car is
um and so it's super helpful to the team
to have that information when they're
doing bug reports
we have time for a few more questions
down here I'm gonna great I will come
back over
so I'm just gonna reword a question I
think I heard because I think it was a
really important one okay so you have a
closet or room of Hardware that runs
hardware and loop tests you might also
have some infrastructure that can run
tests like unit tests yeah when are
times when that
Hardware or infrastructure sort of maxes
out because you have too many requests
to run tests or do you not observe
it's not happening it's this is where an
open source project GitHub gives us um
GitHub actions Runners for free
um we actually like upgraded our GitHub
plan so we got more concurrent Runners
and it was like I don't know a few
hundred dollars more a month and we just
get unlimited CLI from GitHub uh every
month because we're an open source
product so that's really cool and then
as far as the hardware test we have to
scale those sometimes
um and we just add more devices in the
closet that's a little bit hard to
maintain
um because the team is so small but
um we were generally able to keep up
with that
you guys the testing closet is like a
nightclub
it's very loud it's very important yeah
I keep it right next to my desk I don't
know how a deep Works around all the
alerts
oh yeah I just have a question about
like safety uh which is related to like
a total model failures so I had a
situation one day it might sound just
unbelievable but like a bird like took a
dump and it hit on right where the
camera is looking and it covered a lot
of the camera and then the car uh the
model didn't like it didn't give any
warnings or it was a model failure and
the car just went straight and I I had
it immediately disengage and turned on
my windshield wiper yeah um so like for
and also others like uh sometimes the
model like incorrectly predicts where
the curb is and it rides on the curb and
stuff like that but when it does that it
there's no indication that there is a
model failure happening
um and it doesn't there's no loud beeps
or anything like I have you guys
considered maybe like putting in like a
warning system for like yes so two
things that you use the word safety we
have to be very careful about how we
talk about safety so I talked a little
bit about this we have a safety model uh
and to recap that it guarantees that
if you press you're always able to
retake control by pressing on the brake
or the cancel button and it'll never do
anything too quickly for an attentive
driver to take over
um so if that fails that's perhaps a
safety failure
um but anything that the model does or
openpilot does is essentially considered
qm so your events are considered bad
quality
um
so it's just important to make the
distinction there and then as far as
those things we had this alert that kind
of detected device following model
uncertain we just found there was too
many false positives you would be pretty
annoyed if you got one when it was very
clear you shouldn't have gotten one so
we we can revisit this this was maybe a
year ago that we removed it but uh
I mean I hope that the bird one was
pretty obvious for an attentive driver
I do have a question on safety so uh
earlier we mentioned that there's uh
we're going to increase or maximize the
low speed torque so there are some
collaborators in in the community let's
say for Subaru or for Hyundai hkg
um that they want to get involved in
this take the implementation of the low
speed torque now uh we talked about that
we have to do injection testing and
we're getting more data and more
documentations on how the testings were
done so is there anything that you know
moving forward from the open pilot team
that can provide some of that
documentation publicly on how the
community can get involved with that so
we can kind of speed up the process or
you know anything like that so the thing
that's a little bit hard for the
community to do is to get from zero to
one on this
um so I would suggest that the community
you know Waits until we do it for the
first car which will probably be our ev6
because that's what we did for the taco
car there's a the first implementation
of it in the taco Branch for that car
and then the community is really good at
taking from what do we go to zero to one
and saying okay let's ship this on all
250 of our cars so I think that's the
appropriate time for the community to
get to get involved but the safety stuff
is pretty accessible if somebody wants
to just get ahead of this breed ISO
15622 and ISO 11 270 they're very
readable they even provide testing
procedures
um so yeah
we've got a question upstairs
hey thanks a nice presentation I was
curious if you guys uh also track the
code coverage
you do okay cool uh what tool what tool
do you use uh
so we track it with codecav
um that's at 70 right now
but uh it doesn't really cover
everything uh I mean that 70 doesn't
cover everything so it's really quite a
bit higher
um but we really
better code coverage than just like line
count uh that's probably a project that
we should do soon because it's not
completely obvious it's something that
like a few of us have in our heads
um
but it's not completely obvious to an
external contributor like I'm making a
change is this covered by the tests
generally the answer is yes especially
for the things that the community tends
to want to change
but uh
it's uh yeah it's something we should
drive up and we should really
communicate when you're making a change
whether whether it's covered by the test
and how well it is
I think that's what you really want with
code coverage yeah yeah cool well sense
we've got one last question here
hey yeah general question what does your
system look like for learning from Real
World edge cases
so that's another question for the
research team okay
[Applause]
all right so last time you guys told me
how many people are using open pilot
this time I want to know how many people
have used navigate on open pilot
all right this is a number we gotta
drive off new metric to drive up
um no the team is uh working hard on
navigating on open pilot
I can't
Express how how much I love using it uh
and Mitchell
kind of the architect of navigate on
open pilot is here to show you about the
progress we've made since we announced
this project uh two years ago
please welcome Mitchell
[Applause]
all right hey everyone
my name is Mitchell I'm a machine
learning engineer at comma and I'm going
to talk a bit today about all the work
we've done to ship navigate on open
pilot
so this is a project we've been working
on for a while
I think I started on this late last year
and then we showed off an initial
version of navigate in our driving to
Taco Bell video at the end of last year
uh the idea
is
well the driving model already takes the
videos from the two cameras on the comma
3 as inputs so
we're just going to add a third input
that's a video of Google Maps and this
should just work right
so the great thing about training our
model end to end is we should just be
able to pass the map in as an input
and since the model is trying to predict
where a human would drive
and the map has a lot of useful
information about where the the human is
going to drive
the model should just figure this out it
should learn to use the map figure out
where you're going to go when to take
exits when to make turns and generally
do whatever Maneuvers are necessary to
follow the route and get you to your
destination
so this is what we built and it works
pretty well uh so I'm going to talk a
bit today about how all of this works
all the little details that make it work
better and all of the work we've done to
validate this feature and get it ready
to ship for openpilot094
so I'll start with how it works
the first thing we're going to need if
we want to build this is a good map
so
fortunately there's a lot of really good
open source tooling we can take
advantage of here
uh open street maps overpass to serve up
sections of the osm graph bahala for
routing mapbox Geo to render the maps
all of these tools have been really
useful in building this
so
we need Maps
we train our driving models on a large
data set of 60 second video clips so
we're going to need maps for all of
those video clips and again the good
news is open pilot already has
navigation the comma 3 launched with
built-in nav using the mapbox geonative
library
and so we can just use this same library
in our data center and we can render as
many Maps as we want
mapboxgl is pretty nice you give it a
lot a latitude longitude coordinate you
give it a route and it will render a map
for you so you can see this at work here
an open pilot and we're going to reuse
this same system
these are the maps we're going to draw
they're intentionally styled to be very
Bare Bones we just draw the road in
white the route to follow in Gray
and we just draw these as uh 256 by 256
pixel images two pixels per meter so
this is a half a kilometer on each side
and these maps are nice and simple and
easy to reason about
so we want to render a lot of these Maps
and like I said we need two things we
need the latitude longitude for each map
and we need a route
so
the latitude longitude is easy enough
the comma 3 has a built-in GPS so we can
just get the GPS coordinates from that
the route is a little bit trickier
so
you can see here a visualization of a
little chunk of the openstreetmaps graph
the Junctions are marked in blue and we
have some GPS measurements from a comma
marked in green with the X's
and you can see here that the GPS
measurements don't line up exactly with
the road
so they can be shifted a little bit they
can be noisy for lots of reasons the GPS
measurements may not line up exactly
with the openstreetmaps graph so we need
to fix this to get a route what we want
to do is take a list of all of the GPS
measurements from one of these video
clips and we want to figure out which
roads were actually driven on in that
video clip we want to match these GPS
points up with your clip to the osm
graph and then we want to snap those GPS
points to the right roads
so fortunately we do not have to do this
ourselves this is somewhat complicated
to implement
but there's lots of services that'll do
it mapbox has an API for it but there's
also an open source routing engine
called Valhalla that does exactly this
this is called map matching
so you give it a list of these GPS
points
and it turns it into a proper route
marked in red snapping all of the points
to the graph and giving you the exact
route that you drove
so this is exactly what we want we've
got our long coordinates we've got our
route and now we can draw our Maps
so now that we have our Maps
we just need to feed them into the
driving model somehow
the problem is uh on their own the raw
maps are 256 by 256 pixels so that's
like 65 000 numbers that's way too big
so we can't feed these directly into the
model
uh we're gonna have to squish them down
somehow to make them a little bit easier
to work with
so how are we going to do this
well
we already do this for the camera images
those have the exact same problem so we
have a neural network running on the
comma 3 that takes in a frame
from the cameras
and compresses it down into a vector of
numbers this is called a feature vector
and this Vector should represent all of
the details of the scene that are
relevant for driving
so this is about 2 000 numbers for every
frame of the video and these get passed
into the driving model so we want to do
something similar for the map model
uh we want to train some kind of neural
network that's going to take in the map
it's going to compress it down into a
vector that has all the information the
driving model needs
and then we'll pass that to the driving
model
so
the way we're going to train this map
model is as what's called an auto
encoder
so what this means
is that the neural network is going to
have two parts an encoder and a decoder
so we're going to feed these maps that
we render into the encoder and the
encoder is going to squish these Maps
down into this little feature Vector of
a couple hundred numbers and then the
decoder is going to take those numbers
and try to get back to the original
image it's going to decompress it and
try to get as close as possible to what
we originally put in
and if we train this all correctly
this feature vector
should be a complete representation of
the full image it should have all of the
details of the map that the driving
model needs to know about
so
we train this thing
and then we can just throw away the
decoder we don't need that we just need
the encoder
the encoder gives us some features and
we just feed those features into the
driving model
so now we've got our nice squish down
format we can generate these map
features
and you can kind of see here what the
auto encoder is doing so on the left we
can see the original maps that we render
with mapbox GL
and then on the right you can see these
Maps after being squished and then
decompressed by the neural network
you can see a little bit of detail is
lost it's not a perfect reconstruction
but it does a pretty good job at
capturing all the high level details and
uh all of the information about the map
that's necessary for the driving model
to figure out where to go
so now we've got our Maps we've got our
map features
and all that's left to do
is hook this thing up to our simulator
that Harold talked about
train a model with it
and cross our fingers that we did
everything right and this will just work
so we do this
and
it works pretty well
so you can see here these are some
videos from our Simulator the model's
predicted path is in Orange and the real
path driven by the human is in blue so
you can see as the model gets close to
the exits uh its prediction moves over
the model switches its trajectory to
take the exit and follow the route just
like it's supposed to so this is great
we can do the same thing for turns
you see here the model does a pretty
good job as it gets close to the turn it
adjusts its prediction so that it's
going to try to follow the route
so this is fantastic we have
a driving model that's going to try to
follow the route that we give it from
the map
and now we just have to run this on the
comma 3.
so fortunately this part isn't isn't too
complicated
um we're going to add a few new
processes to open pilot that'll let us
do all of this stuff
so we'll add a process called mapsd and
a process called nav model B Maps D is
going to render our maps for us using
mapbox GL native
and nav Model D is going to take those
Maps run them through our encoder and
get our map features out
and then we just need to make a little
change to Model D which runs the main
driving model
we'll just make a change so it takes in
those map features from nav Model D it
passes them into the driving model as a
new input
and then everything else works just like
before
so we do all of this we put it on a
branch
and it works you can see openpilot is
taking an exit here following the route
on the right
and uh
if we've done everything right this all
just works it works pretty well
so uh to to give you a sense of
perspective this is roughly where things
stood for the Taco Bell video
at the end of last year
uh so we've been working a lot since
then to get this ready to ship it always
seems to take longer to actually get
things deployed and test all of the edge
cases than it did to build it in the
first place
so
I'll talk a little now about exactly uh
what it took to ship and specifically
some of the details uh that you have to
get right to make this all work better
and uh some some details that uncovered
some bugs
so
one obvious problem that you run into
right away when you're building this
stuff
is that
uh if you look at Google Maps or Bing
Maps or any of these online maps and you
just pan up and down you'll see that the
scale at the bottom right of the map is
changing
uh it changes from uh 500 miles in the
middle of the us all the way down to 200
miles for the same length at the
Northern end of Canada
uh and the reason this happens
is because the Earth is a sphere and
maps are rectangular and so you have to
take a spherical globe and somehow
project it onto a rectangular map and
you can't do that perfectly you have to
make some compromises so the way that uh
most Maps these days do this is with
something called a Mercator Projection
so the Mercator Projection keeps these
nice straight latitude and longitude
lines but the problem with this is that
the areas near the North and South Pole
get way blown up
um
so you can see this happening here and
for humans this isn't really that big of
a problem
but for a driving model this is a little
bit inconvenient because this model is
going to use the map to predict in 3D
space where it's going to drive
so without any extra information the
model doesn't know if it's making a turn
in 200 meters or 500 meters because this
the scale of the map could be totally
different
so we need to take care of this uh it's
not too difficult we can just
dynamically adjust the zoom level of the
map to get a constant scale so like I
said before we're going to render our
maps at a scale of half a kilometer on
each side and we'll change the zoom
level as necessary to make that happen
another problem we run into is that
well we did all of this work to make
sure that our routes were accurate to
the road that were actually driven in
each video clip but we actually did too
good a job and uh so the problem is that
sometimes when you're driving with your
commentary
you maybe miss a turn maybe you missed
an exit or sometimes you just don't want
to follow the nav instructions maybe you
think mapbox is telling you to do the
wrong thing and so you just do something
else
and the problem here is that with the
way we've trained this model so far it's
basically never seen a wrong turn before
so the model is going to get super
confused if you miss an exit it might
try to take an uncommanded Lane change
or it might try to break in the middle
of the highway all of these things are
really bad so we can't have this we got
to fix it
um so there's a couple different things
that you can try that we've tried uh but
what seems to work pretty well is we can
uh generate these artificial routes that
essentially have wrong turns in them we
can uh take the open street maps graph
we already know exactly what route was
driven in red
and so we can just pick one of the
Junctions in the video
go off in a different direction and then
do a random walk of the graph from there
to generate these artificial routes
and we can train on a small percentage
of these to make the model more robust
so there is a bit of a trade-off here
this is a delicate balancing act because
if you train on too many of these the
model will learn that sometimes it
shouldn't follow the route and so it
won't be as diligent about doing the
right thing and trying to follow the
route when it can
but if you don't train on enough the
model won't be robust and it can have
bad behavior so you have to balance
these two things out and we've found
that uh training on roughly five to ten
percent fake routes uh maintains a good
compromise between making the model
robust while also not harming its
performance at taking exits and turns
so now we
have our model we've fixed some bugs and
the last thing we have to do to get it
ready to ship is write and a ton of
tests we want to validate this behavior
in all of the cases we can think of in a
bunch of edge cases and we want to know
exactly what these models are going to
do when we deploy them
so like Good Deed was saying
we have a saying at comma
that goes no testing in cars
and the reason for this is especially
for research
um
even though what we ultimately care
about is that the model drives the car
well
we don't want to test our models by
putting them on an open pilot branch and
seeing what happens this is way too slow
uh if we if we have a model that we
think maybe we'll be good we don't
really know so we put it on an open
pilot Branch we let some people drive on
it we drive on it ourselves We Gather a
sample of data and then maybe it turns
out our model had a subtle bug in it and
now we've just wasted days or even weeks
waiting for this data to come back so we
can evaluate so this is a huge waste of
time and so our rule because of this is
no testing in cars
instead we try to write as many offline
tests as possible so before we ever put
this on an open pilot Branch we want to
have a pretty good idea of how it's
going to behave when we do it
so these offline tests can take a lot of
different forms we can test by running
the model on real driving data and
seeing what it does we can test the
model in our simulator we can test them
in more traditional simulators like
Carla or GTA we can run a bunch of
different tests in different cases and
see exactly how this thing is going to
perform so
what should we test for
well there's a few obvious ones we want
to make sure that the model takes exits
when the route says to take the exit so
we can test that in our simulator I
showed some videos from that exact test
earlier
um we want to make sure that the
model doesn't take exits when it's not
supposed to
we want to make sure it takes turns when
it's supposed to doesn't take turns when
it's not supposed to we want to make
sure the model doesn't misbehave if the
route is incorrect if you miss a turn or
an exit if the GPS location is a little
bit wrong and it snaps you to the wrong
road we want to make sure
that it doesn't misbehave if the bearing
is inaccurate so the map is like pointed
the wrong way a little bit
we want to make sure uh that the driving
behavior doesn't regress at all when
you're not using nav because we're just
shipping nav in experimental mode right
now and so if you're driving in chill
mode we really want to make sure that
behavior doesn't regress in any way and
if anything it gets a little bit better
uh and we want to make sure that
the behavior of these nav models is the
same when we run them on the comma 3. uh
compared to when we run them offline
so we do all these tests plus a bunch
more tests we've spent the last few
months just writing test test tests and
uh validating all the behavior we can
think of lots of different edge cases
and making sure that these models behave
exactly the way we want
so we've
finally written enough tests to
give us the the confidence to ship this
for openpilot094 and you can try it out
today it's available in experimental
mode and as we keep working on
navigation and we drive the reliability
up to 100 we hope to ship it in chill
mode as well so it'll be available for
everyone that uses open pilot with Prime
so
that's my talk
oh
I'm gonna give time for a few questions
all right
Jason over here over here
I wonder if you could talk for a second
about how speed limits figure in that
you get from the maps I know that you
want the end-to-end model to function as
independently as possible you don't want
to depend on map data but do you foresee
a future and using that as an input more
consistently especially when not
navigating I'm given to understand the
map box API doesn't really lend itself
to giving you speed limits if you're not
navigating but I think there was some
sort of way around that with the real
house or I don't know much about it and
I guess my question is really
long term do you see that as an input or
a hint into the into the overall driving
long term I think probably yes
um
right now there's a lot of situations
where the
longitudinal Behavior still isn't
perfect that has nothing to do with
speed limits so we want to fix that
first like if you're driving on a
highway and the model is only driving 55
you shouldn't need speed limits to know
it's driving the wrong speeds so we want
to fix that behavior first
um and uh like you say map boxes API is
not super conducive to uh giving you the
speed limits there's a lot of areas
where speed limits just aren't even
available
but long term I think there's a lot of
cases where you can't really tell how
fast you're supposed to be driving
without the speed limit so I imagine we
will eventually need to add this as a
model input yes
all right got a question in the back
along the same lines any
um thoughts on future input for
real-time traffic that would then allow
for you know changing of routes
um
sort of so mapbox already takes care of
this it has its own uh traffic tracking
system
and so ideally the routes that go into
the map in the first place should
already take into account the traffic
now map boxes uh traffic uh system is is
not perfect uh and it does sometimes uh
over underestimate the amount of traffic
in a particular area but hopefully this
is something that'll improve over time
uh hey have you put in any thought into
like text-based navigation using like I
can see from your navigation that you
have like take the next exit for example
like do you guys use that as inputs ever
yes so
we have a branch right now that uh
hopefully will ship for openpilot 095
after some more testing and validation
that puts not just the map but also the
nav instructions into the model uh and
we find that this uh reduces the uh the
failure rate of the model to to take
exits and turns even further so yes this
will probably be coming to a comma 3
near you sometime soon
oh thank you for your presentation
um I just have a question have you ever
considered using Vector Maps instead of
this rendered Maps could you say again
have you ever considered using Vector
Maps instead of the render be way map ah
um
yes so we do get the vector tiles back
from mapbox directly and so we could
consider using those and there are some
advantages to that in that uh there's
there can be a bit of ambiguity just
with the rasterized maps in some cases
where you have a lot of roads really
close together so this is something we
may look into in the future
map boxes tools kind of make it easiest
to just render a map normally and then
you can just use a normal confnet
efficient net to uh to process this and
compress it with Vector based Maps maybe
you'd want something more like uh like a
graph neural net and these are a little
bit more complex and so we wanted to
start with the simplest thing that could
possibly work but maybe this is
something we'll look at in the future
uh I use this uh navigation feature like
uh
a few days ago
and I found a problem when I uh used it
that it works for the first maybe a
minute and then it's just a quit by
itself uh any explanation on that I'm
not sure we'll have to look at your logs
and maybe this I can I can get your
information afterwards and we'll see if
something weird is going on all right
another another question is
um uh have you ever thought about using
the map for for the uh just uh to the
very original input maybe map it to the
perspective view together with uh with
the with the image oh yeah
um
so the auto encoder we trained uh
actually also predicts the trajectory
that you're going to take
um
in addition to uh just compressing the
map it tries to predict in 3D space
where you're going to drive and so
we could
uh potentially use some of these
additional outputs to show extra
information on the driving view but this
is not a super high priority right now
this is something maybe we'd look at in
the future as you know the main
functionality of nav gets better and we
have time to think about some cool
additional features
for the map encoder is it trained
primarily on a reconstruction loss or is
it trained jointly with the driving
model so it can more intelligently like
select which features are important
uh it's trained separately we do this
for a couple reasons uh one because
uh we want to run this model on the DSP
instead of on the GPU
and so the map model has to be quantized
and so we train it uh with the
quantization aware hooks in pytorch
without this it doesn't really work
properly and so in that sense it sort of
has to be uh
trained as a separate model
and then also training full confidence
with the SIM is a lot of compute and so
it's a little bit easier to split it up
we have looked at doing it jointly as
well either with the vision model or
with the policy model
but the autoencoder does do a pretty
good job of capturing the all of the
details of the map and so for now at
least we think that it is probably doing
just fine to just compress it to this
feature vector and then have the driving
model process it from there we've got
one last question here
so when you started the talk you talked
about how you you know at first wanted
to just feed the video data of the of
the directions into the model and
hopefully it would work and then it
worked pretty well but I would think
that there's like kind of an inherent
conflict between the original video
input and the the map like the
directions input are does the model just
synthesize those two like magically or
do you have to really like weight them
or like try to give inputs on which
input is the you know the the primary to
follow or how does that work in the
model
you're talking about uh resolving like
the video coming in with the map yeah
the idea that the video tells you know
one set of sort of inputs on how you
should direct the you know the deriving
output versus the map now suddenly you
might say you know actually I wanted to
go this way so I kind of feel like the
two different pieces of information
might give different outputs how do you
how do you train the model to know which
to follow and which in what
circumstances sure
um so this is exactly part of the reason
that we train on uh some percentage of
these fake routes we want to make the
model robust to maps that either tell it
to do the wrong thing or don't make any
sense uh and so when we always want to
trust the video because the video is
always right or at least it better be
whereas the map could be wrong for any
number of reasons
um and so we uh do a bunch of stuff when
we train these models to try to make
them more robust to failures of the map
uh if the route suddenly goes out or GPS
suddenly goes out or any number of uh
things that might happen road closures
uh taking a wrong turn all this stuff so
we really wanted to trust the video more
than the map
all right thank you so much Mitchell
[Applause]
all right some of you may know
first
um
and there's soft drinks and
coffee and tea back there
and we will restart promptly at 1 45.
if you bought merch ahead of time on the
third floor on the back of your badge
there should be a
she's a list up there you have a sticker
uh if you bought merch they have your
name and us and a bag with your name on
it for you upstairs feel free anytime
throughout the day to pick up your
t-shirts and hoodies
they are
didn't want you guys to have to carry
them around so
thank you so much please welcome
weishing to the stage
hello hello
uh hi I'm wishing I work for research at
coma uh today I'm going to talk about
how we view driving with open pilot as a
human machine cooperation problem and
how we use the machine learning to
improve things
so this is how we drive without oven
product as a human basically the driver
is the only actor here
but with open pilot the driver's role
slightly changes and they will now work
cohesively with open pilot uh with the
driving models specifically in some way
so today's talk will be focusing on
different aspects of the Dynamics
between the human and the driving model
uh shown in this graph
so we will cover how we use the power of
machine learning to learn about the
driver and then learn about the driving
model and how we ship many impactful
improvements along the way
uh as we know open pilot as a driving
assistant system requires the user to be
able to take over at all times in simple
words you need to pay attention we
already covered how driver monitoring
Works in open pilot from The Last Comic
Con talk two years ago so today we'll be
focused on the progress we made since
that time
so this is what the driver facing camera
looks like on the old comma 2 is a bit
noisy but mostly it only shows a limited
wheel of the interior
uh for the driver due to a very small
view on the common too to make things
worse due to limited compute on the
common two we had to crop the image
and feed it into the model
uh it's not fun to do to build a DM like
on inputs like this trust me for the
model it was like watching a movie like
with all the people standing in front of
you like blocking the wheel that's
basically how it felt like uh moving to
the comma three this is the initial
model we ship using uh the comma 2 Data
before we had any real amount of common
free data to train on
uh and this is the new model we're
training on
uh the new common free data
and the model we shipped currently uh is
shown
is shown with the green box which
basically covers the whole interior
instead of just
some part of the driver now as we can
see we can see the full body of the
driver and hand and even the steering
wheel and then the same is true for also
the passenger
uh with that now we have
achieved on the common free
almost 100 of face detection rate with
that we can remove the wheel touch uh
when the camera is not blocked and use
Vision only for DM uh yeah because it's
not the best idea to assume the driver
is paying attention when they are
touching the wheel because that can
easily be cheated
like in a Tesla uh so another thing we
can do was to remove the right hand
drive toggle with the model now can uh
now being able to detect whether which
side the driver is driving on uh say in
like the us or on the right in this
image or you're on the other side if
you're driving on the wrong side of the
road so
with that we can remove the right hand
dry toggle one less toggle is always
better as a deep says uh we'll come back
to that uh passenger thing a little bit
later
so in terms of true positive
we have achieved a net gain of almost 2x
in true alert 242 positives
by using a model a bigger model box and
then now we are we also have the extra
benefit of the actual contacts we have
with the full interior camera
um
with the extra contacts we are able to
build upon it to do this so last time on
my common presentation I mentioned that
we will explore moving to a more
end-to-end approach
a more a more end-to-end approach for DM
uh now I think it's a good
I think it's a good time to do that so
in a classic DM policy we have the model
that predicts some attributes of the
driver and then those are fed into some
stay machine to determine whether the
driver is distracted but in uh
end-to-end DM world the model should be
able to tell from the footage like
whether the driver is paying attention
or not directly
so here is an example of the deep
driving
as you can see
other than when he was looking right on
the at the row or when he was like
straight distracted by his phone there's
also a lot of great areas there as a
human
even as a human it's tough to tell like
whether sometimes he's paying attention
or not so we need to
Define attention to be able to like have
good run through for end-to-end DM to
learn from
uh here's a hint DM doesn't live in a
vacuum it's part of the system a part of
the open pilot system so what is
attention really
so the answer the answer really is quite
simple uh we already know that open
pilot as a driving assistant system
again the driver should always
be ready to take control
so with that in mind we are ready to get
our Branch with that
with that in mind it's simple that the
paying attention
definition should be whether the driver
is ready to take control
at any time
with that in mind we're ready to get our
ground through for the end-to-end DM
system so we make two two simple
assumptions
the first one is the probability of
taking control is higher when the driver
is driving or taking control that's
pretty obvious
and the second one
is the probability of not not taking
control is higher when the car is at the
same field
so turns out we already has those things
in the in the logs for a long time
therefore you can just use them to train
the model to protect from the driver
footage whether the driver is ready to
take control or not
um so with those naive
the ground true I just mentioned we
train vanilla end-to-end model that
predicts whether the driver is
distracted from
some frames and you can see that it
sometimes reliably detects when the
driver is really distracted like they
was looking out the window
he was definitely not ready to take
control here but the all the model also
thinks Adib was not ready to control
here which where he was just
chill driving and so is this he was
looking at a row while turning the radio
which in a taking control context is
fine so we need to fix those false
positives
so we're not we realized that the only
way to fix all the ambiguity
which
it's probably uh it's most likely a
finite set is to have the real human to
label some of those difficulty cases
because the fact that we already have a
helper model
that's trying on vanilla DM labels we
can use that model to find how let's
find all the interesting stuff and then
only
two percent of our entire set ends up
needing to be labeled to get the
perspective we Outsource the labeling
work to a third party and it took them
only one person in less than three days
to do our labeling we pay virtually
nothing to gain a lot of improvements in
our country
so with that improved ground troop and
our end-to-end DN model training on that
the model is now able to pick up
additional subtle distractions like
using phone without force triggering on
two driving poses like in this examples
uh in
index examples shown here
whenever the timer drops it means the
system thinks a deep is was distracted
so you can see
this is fairly accurate because
uh
the when the timer drops is where a d
was really not able to be ready to take
control
so to put it in a number with a number
we have metrics showing that the net
result of adding end-to-end policy is to
have a 15 gain in force in true positive
with no false positive gain
so now let's uh change our Focus onto
the driver uh by looking at some
behavioral metrics
remember in full frame DM I mentioned
earlier we are now able to detect from
DM model if there's a passenger or not
so by overlaying that with the driving
data we came to the surprising
conclusion that um
when when people drive alone compared to
driving a passenger they are four times
more likely to take a corner of half a g
and two and a half times more likely in
heartbreak heartbreaking
and twice as like twice more likely to
tailgate someone
so that
all that aggressive
all that aggressiveness difference in
driving
from having a passenger not Inspire us
to do a whole driving style analysis on
our Fleet we basically classify driving
style using metrics like heartbreaking
heart
acceleration or like hard turning Etc
and then those things are used as a
conditioner
to fit in to the driving model and as
Harold mentioned by using like the
choice profile we actually make a Taco
Bell Drive much easier by making it
drive smoother
so another metrics that is super
important to our company is that we need
to understand the relation between
making driving true and potentially
making driving more making drivers more
prone to distractions as always we we
talk with numbers and we have metrics
for exactly that
so the first conclusion from our metrics
is that drivers generally pay more
attention to the road when using woman
than not using Google so here the green
curve shows the distribution of segments
with different percentage
of distracted times when engaging with
open pilot in green or not engageable
but in Red so essentially uh the more
left the Curve
the more left the curve the less
distracted the drivers are
so
we can see that when engaged
drivers are generally less distracted
that number
actually is around 40 percent
so that's a big
Improvement so actually it's actually
not too surprising to imagine these
things because with open pilot um it
first takes away the taxing stuff from
driving and allows you to pay more
attention pay more attention to the
surroundings and also it it's hard to
not pay attention when like it yells at
you when you get distracted
the second one is actually more
interesting there's a common doubt that
if you've been using open pilot for a
long time you start to lose attention
and become complacent and
in the long run so but our long run
metrics disagrees with that this is an
aggregate
the same bunch of drivers in the long
term
disruption chance Trends and the lines
remain pretty flat for different
percentiles of distraction durations so
we are confident that
the driver our users don't get more
distracted as time goes by
so now with the driver out of the way
Nas Tech talk a little about the driving
model itself so the model is a integral
part of the of our human machine
system and it's crucial that we
understand how the driver can interact
with it and how it can potentially
interact back with the driver and make
the experience more more coherent
coherent
the human driver mostly interacts with
the driving model by disengage
but it's engaging or overriding uh those
disengagements give us a
strong signals of when and hopefully why
the model doesn't do well and therefore
we've been putting a lot of effort into
building and looking into um
this engagement metrics
uh we've been tracking the longest time
uh own pilot can be engaged
which is which is easily in the in hours
uh it's good to know open pilot works
but this kind of stuff
all look like this and it can't really
help us improve it's like similar to
someone
who learn driving on the highway only
and they can't really learn anything
so the question have been we have been
asking lately a lot is uh where do open
pilot users tend to take over and we
build
this
this is our automatic disengagement
reports
um
so it's a tool that enables us to do
large scale up-to-date disengagement
analysis so it runs daily automatically
and is shown our on our biggest TV in
research essentially it gathers all the
lateral and longitudinal override data
as well as the unexpected disengagements
and and then with all the logs uh
parsed we are able to group
group all the disengagements by the
by the this disagreements between a
human and the model
so that we can split them into different
classes as shown here and here are just
some examples of different kinds of
disengagements
so basically we show a list of random
example for each kind of disengagements
on the reports and then everything is
visualized with necessary data
like in the gifs here we can see uh in
this report
has been turn cutting and we can like go
to the third cutting person in comma
which is one person
and say
a tankering team which is one person and
say oh there's been a lot of cutting
lately what's going on and then
hopefully I can have it fixed
so here ex here is another example of
how we use this report to fix a real
complaint
so there's been
is it as people know like there's a lot
of noise about
um people asking oh we need to adjust
the following distance it's following
too far on the highway sometimes like
this Discord user Johnson
and uh
yeah we listen to that and but we need
to factor out with data so we look at
the disengagement reports and we saw
this
hmm there's like uh so you can see
there's a more than 30 percent
of our longitudinal disengagements is
due to the model following too close or
it's breaking too hard too early for a
lead car so we know that this is a real
problem and then by like giving this to
the the right person
we were able to figure out
not only this is a real problem but also
we know how much we need to fix this
problem
so we come up with uh the latest
longitudinal personality toggle in our
settings
so the last point I want to discuss is
how the driving model can potentially
give feedback back to the driver to
communicate its uncertainty
so uh first of all how do we know if the
the model is uncertain
for some given predictions for a given
amount of seconds in the future pretty
well so
um we can rely on the model itself to
tell a piece of traffic yeah the traffic
lights
which makes the model more uncertain
and on the right side we have like
things where I've seen where open
product can would probably not work like
converging this UK narrow road
or turning onto this busy street after
stop sign
so the first step we can do is to show
uncertainty in some kind of
confidence indicator in UI this is
actually a work in progress we're doing
now so remember that in 094 we ship
the always on border which means they
always communicates the engagement
status so we're thinking oh why not we
can use that and change that to
something less green when the model is
less confident
so that so say in this example here it's
just like one laying row it drives fine
but here then like two seconds later it
sees this potential
and Divergence and it becomes less
confident and my my need your attention
so it's nice to have that dynamic
between the model and the driver
and also like say when the bird finally
poops on your car it probably becomes
red so
um yeah that was my talk
[Applause]
all right
hey uh great talk a couple questions for
you what's your overall thought on this
the long-term uh time and investment
that's going to be spent with DM
um as we actually every day get closer
and closer to level four level five
where conceivably you don't care if the
driver's asleep or in the back seat
completely what what's what's your
general thought on that uh how that's
going to evolve
I mean in the context of open pilot we
probably always we required the user to
pay attention but in terms of level four
level five I would say the
there will be in the future some in the
play between like how confident the
model feels and how the DM policy should
adapt I think that's the
final goal okay that makes sense so
maybe certain times it might be needed
but other times it would be fine it may
alert the user to hey we need you to
probably pay attention now it's safer
but in general you're okay otherwise
yeah we already have some adaptive DM
policy uh in place so that might be a
good place to start okay and there's a
quick question on the actual eye like
eye gaze and tracking on that yes um I
know with like uh Teslas you can just
put on sunglasses and it it says yeah
he's paying attention even though your
eyes can be completely closed does this
system have anything with like eyewear
or glasses that you know that it's not
detecting eyes and does it assume that
you're fine I don't know if that's it's
common knowledge of how that works or
not I think whenever your eyes are
invisible it just falls back to a head
post and uh the end-to-end policy is
actually really good that when you have
some weird poses other than you know
just normal driving position say yeah
sleeping when you're wearing sunglasses
it can probably pick that up and say oh
there's an anomaly here
great I got a question here in the back
hello awesome talk uh do you think that
symbolic approach with some something
like a prepositional logic will be
viable solution for deeper understanding
of actors in environment
uh sorry can you repeat do you think
that in future near a symbolic approach
with formal logic declarative logic with
sub symbolic models will be viable to
deeply understand this behavior of
actors in environment to predict future
I'm not sure about symbolic
symbolic it's like deep learning plus
declarative logic oh I see
uh I mean our end goal is to have
end-to-end driving model that just looks
at the scene and tells us where to drive
and potentially like how confident it is
about like doing this path and I think
in the future as the driving mode gets
better it should just be able to tell
like naturally with our end-to-end
foreign
does that make sense
I wonder if you could share a little bit
about
um how you classify and what uh
breakdowns of data you get from
classifying drivers as chill or not it's
a fascinating topic for me I I've gotten
old and I use openpile a lot so I'm
mostly Drive chill but every once in a
while I throw my car
on an autocross course and I use open
pilot as a Data Logger so is there a
memory to that are you classifying for a
segment per route per device and as a
Off the Wall question uh how many open
pilot users would you say are good
drivers
I mean we classify them into five
categories basically
but I don't think we track like specific
dongle ID
we're more like focus on the route I
believe yeah
anything else wishing there was a
lengthy question
are you satisfied with the answer Jason
I think you kind of dodged the one where
I asked how many open pilot users were
good drivers
all right we got a question upstairs
some I'll send you uh if if you come
back to like um two slides but in terms
of like giving them feedback um to the
customer about insertment is
communicating
um
I'm thinking uh if it's possible at all
but uh yeah not exactly that but very
very had like um
I'm certain
model being our uncertain about specific
and trying to communicated back to the
to the driver
uh not not this one like uh the the real
like um
mock-up of the road
like with the vehicle like the picture
a few more slides a few more I made it
like forward not not bad oh the one with
the driving behavior yeah yeah here
there's one of the last ones like uh
which one
the red and the yellow one oh this one
oh wait no no no it was the road oh
sorry sorry yeah yeah sorry it's uh
this one uh no no more
no no you're going to the right
direction to the end of the presentation
oh that
that sorry
I'm thinking uh I don't know if it's
possible at all but it would be nice if
uh if it could also communicate some
areas where it does not want to go like
like for example if there is like
vehicle parked or like you know some
blockage or whatever so like uh like
maybe in like I know in the red
yeah we can have a hard cut off like
ideally for like some sketchyness of the
scene and say oh
this report is engaged here
give you a super short timeout anyway if
that makes sense
yeah cool stuff
all right
[Applause]
coming over here
yeah Auto Talk um you mentioned you make
some assumptions to determine whether
the driver is attentive yeah like um
like if they're driving they could be
more attentive if they're at a stop
maybe less attentive so I was wondering
like I assume these are neither
conclusive nor do they always hold so in
the future do you think it's possible to
also use data from the driving model
like maybe if someone's drifting out of
the lane or if they stop more suddenly
than the model was do you think that can
be used as a negative signal for the
driver monitoring
uh do you mean when engaged or not
um I I guess either way either way um
yeah I think desktop is a little bit
more far away from like what we're
looking for because in here
although those things might not seem
immediately obvious
you can see in the data there's a
distribution shift from say taking
control not or like being extensive or
not and we picked up that signal and we
capitalize capitalize on on that to
determine whether the driver is ready to
take over
I think that's good enough with some
refinement
uh oh I have like a kind of a far-fetch
question but uh have you ever considered
using driver monitoring to not just
communicate like uncertainty between
model and the human but somehow have the
human communicate intent back to the
driving model for example during a lane
change yeah if the human is looking in
the rearview mirror you could use that
as a signal that the human wants to like
is affirmative that it knows it can turn
that
yeah but we cannot always assume that
there will be a lot of false positive so
whichever way all right interesting
points one last question
what do you measure that driver takeover
or disengagement reaction time somehow
I think like when models
open pilot is driving for two hours and
to see that it affects drivers reaction
time in case if he needs to disengage
uh what's the question again
do you measure somehow there are drivers
reaction time
does it change if the open world has
been driving for for example two or
three hours without disengagement you
mean the the DM professional timeouts or
the model
confidence
if if parents and
uh
we don't have metrics for that but I
think like the the second long-term DM
magic is pretty conclusive about
like
people using own butter for a long time
thank you
all right actually we got one one more
question
you have a question again
all right
thank you so much wishing thank you
[Applause]
all right live stream crew you're good
to uh
put the virtual world on hold while we
eat
um as I mentioned before there's a food
station down here
um
I forgot to mention we'll tune back in
at 1 45.
Sharp
for George
[Music]
um there's on the third floor there is a
comma Point exchange Booth
um if you use your same comma points
email that you use to register uh we
have your points if not we will look
them up live
um so knock yourself out that'll also be
open after the talks this evening
um
destroy
hi
[Applause]
okay
don't worry it's a long talk
you guys know that Black Mirror episode
where they have the ratings it's my
favorite episode
uh you know that woman starts off at a
very high rating and watches her rating
plummet
and at the end she has the one star and
she's in jail and she's just screaming
and she feels so liberated
like like the gpts have made it so
obvious that it's all all the
niceties and language and all of the oh
yes I'm going to write a four paragraph
email to express a two sentence idea
is it over is the professional
managerial class over
I heard the Barbie movie described last
night as post-woke and I thought that
was really cool
uh okay my talk is called three stories
and we have three stories one about the
past one about the future and one about
the present
uh so we will jump right into the first
story about the past with the crude is
automation
um
so Cruise automation most people don't
know this right most people see the
weird orange hat branding today and like
look we're building cars that are
symmetrical I don't even get it but uh
you know Kyle was actually uh first
building the cruise rp1 Highway
autopilot for ten thousand dollars
and it sat on top of your car like that
assuming your car was an Audi A4 uh and
it worked on the highway uh to drive
um so Lex was guest 14. uh Kyle was
guest 14 on Lex
and he gave up due to the technical
challenge
um he didn't give up because it was a
bad idea it's actually the right idea he
gave up because it was too hard and he
had three concrete complaints about why
it was too hard
one is that there's a long tail of cars
right so uh they built it for the Audi
A4 we're like okay we can make it work
on the Audi S4 maybe the A6 and you
realize that almost no one drives Audis
all right we started with an Acura look
I made the same mistake
um and it turns out there's this
absurdly long tail of cars
uh
so how do you deal with this
well you just do it that's not that much
work
comes a 20-person company and we just
did it thanks to you know contributors
thank you contributors but like it's
doable right you just do it okay cool
oh but but how do you handle failures
what if a car has a sensor that fails or
GPS that fails or a camera that fails or
a steering wheel thing that fails
steering wheel actuator uh okay you just
do it
um open pilot has a great error
detection and handling system the alerts
uh Alex Roy drove in a car with the
comma one and this is what he praised
he's like wow this thing actually like
communicates with you
um so hopefully you guys have
experienced that using open pilot like
it actually
you know gives you errors that tell you
what's going on
then we track all of these on a back-end
dashboard and we drive them down to zero
um so again you just have to do it uh
it's different in one version of the car
what if the car manufacturer updates the
firmware
okay
you do it
fingerprinting yeah
we'll read all the firmware versions
we'll figure out which ones matter we'll
figure out which ones don't we'll do
this at scale
right these things are engineering
challenges
fake any of them either
when you ship a product to people you
can't fake any of this stuff
right
that's probably mostly of open pilot you
guys probably mostly have comment threes
and it works in your car
and it handles failures
it deals with all the different versions
of the car you just have to do it
common was not supposed to exist
there is no sane reason that this
company should exist
the second round when we raised from
Andreessen Horowitz
I pitched them a crypto coin
hey look man you want to hear I'm
telling you what you want to hear man
I'll tell you what you want to hear I
know they're but you know you
want to hear it finals I'll tell you
that I know enough about crypto to make
it sound convincing
our third round we raised from much more
aligned investors
Horowitz is bad it's just that like
again you have to think about what these
people are optimizing for and what time
Horizon they're thinking on usually very
short time Horizons
um so but then again you ask yourself
what's what's worth doing in the world
there's another scene from Back to the
Future too
if you're not building a company that
looks like that line what are you doing
with your life right
if if the only thing that's going to be
different if you succeed with your
company this is to everyone in the
audience everyone out there watching if
the only thing that's going to be
different is that the pile of money is
in your entry in the SQL database
instead of somebody else's
why are you doing this bro it doesn't
matter just update the SQL database it's
a lot easier
um so yeah you know build companies that
look like that companies that are going
to change the future
not change the distribution of wealth in
the future
all right
I'm not doing this to like we'll get to
that this is a story about the past
so here we are
six generations of the hardware
zero Eon Neo whatever you play with the
letters a bit comma two comma three I
love when Hardware companies just do
that just make the number bigger every
time so you know right it's easy
um
yeah
that's it
250 plus cars
uh every major brand except for the Flex
Pay ones Mercedes BMW no but otherwise
with Ford that's all of them
25 employees
uh uh and open source
all right so uh I think it's pretty easy
from this to tell that all three of
those numbers are going to go up
begrudgingly on the third one very
happily on the first two
um
and open source will stay uh keep you
want Hardware to be good look at the
iPhone right this is iPhone 13. you know
why it's good because they built like 13
other ones people's even more right
that's how you make something good you
just keep doing it you just iterate it
ship it you iterate on it
uh you want to support more cars okay
make sure you don't have regressions
well we'll get that I mean how
let's start with some like
with that one
right did you hear helion energy is
going to ship a fusion power to the grid
by 2028 did you hear Cruz is going to
have a billion dollars in Revenue by
2025.
like can I bet against these things it's
fake
I hope that everything you saw here
today
you got like a real sense of honesty and
part of the reason you get honesty here
is we don't have communications people
what are Communications people in a
company besides paid Liars right what is
the job of what is the job of a press
secretary
oh oh okay you you murdered 30 orphans
in Cuba uh I make it look good though
make it look good right
no like it's just honesty and it's
honestly because lying if you tell the
truth you don't have to remember
anything
you know that's that's a good quote
right
um
tripping
you had a ship shipping keeps you honest
right your ship stuff you send it out to
people and they'll tell you about
whether it's crap or not you know how
they'll tell you you know there's two
types of ways to measure people's
preferences there's stated preference
and revealed preference right stated
preferences things people say they want
like
well wouldn't it be nice if we had cars
where we could share the car so we could
uh save the environment and then you
look at the HOV lanes on highways and
the usage of uber pool and you're like
wait a second no no no no no no no no
everyone wants their own car right
reveal preference beats stated
preference so how do we measure reveal
preference we sell something
profitably
and then see who buys it right
so I'm shipping
iteration
uh you know how you build something good
you build it bad three other times right
that one's still not that good you know
that one is bad after you get to the one
that's built three times later and
there's no way around this the only
thing you can control is your iteration
speed right how quickly can you iterate
how quickly can you come out with new
versions how can you reduce the Ripple
time but you have to iterate
um and then the last one is humility
oh yeah you know this guy used to call
me Eagle hot you know it's kind of funny
right I do have a big ego I think I'm
better than a lot of people I mean
that's a true fact right I think I'm
better than a lot of people now look
Google you may disagree with me about
that fact and I'm open to having a
conversation about it I'm open to you
know what do you wanna what do you wanna
what what shall we challenge each other
at right
but that's not what humility means right
that's like like acting humility is
saying
okay there's an actual problem how are
we going to solve it right like it's
humility not as some status game but
humility in the real face of nature how
do you solve these problems well you
have to have humility you know it turns
out you think you think oh well I'll
train the machine learning model it'll
work you know I thought this is a
comment I'm like well I'll put in the
I'll put in the output path and I'll put
the image in and it'll work this turns
out to not work at all
um you can look up behavioral cloning or
imitation learning for why it doesn't
work and you just got to have humility
you know what I mean like Nature Nature
Nature doesn't care nature doesn't care
you know and it's humility versus nature
not humility versus people uh so yeah
you know you got some you got some
values of a company right
um all right
so why haven't we won
do we have to write right
you could talk about what I'm doing
wrong talk about what we're doing wrong
but why haven't we won
um and the truth is things take a long
time even accounting for things taking a
long time
this is not the first Comic-Con this
will not be the last Comic-Con
all right humans live a long time you
know this is something a lot of people
forget about in the world today like a
lot of people are so like man how can I
get rich quick how can I pull this scam
how can I ship fusion power to the grid
by 2020. bro you can't even ship fishing
power to the grid by 2028
you know
um so I'm gonna look I'm 33. I'm gonna
be here for a while
all right so you start thinking about
that I'm not trying to get rich I'm not
trying to retire there is no exit
there's no exit okay and you know the
books are no no this is no exit this is
it this is it hell is other people right
like
like there is no well we're gonna get to
this point and then we're gonna stop
no the system is going to get better and
the system is going to get relentlessly
better
right it's Comic-Con too
we'll see this is about the past
uh
think about like climbing out of a well
um so let's see it I'll put it yeah
how long is it going to take to solve
cell traffic
no idea
but as long as every day
you make forward progress as long as
every day you make a few steps climbing
to get out of the well and as long as at
night you don't slide backwards As Long
as You Follow That algorithm you are
eventually going to get out of the well
avoid regressions and make slow and
continuous Improvement this is how you
make things good
so climbing out of a well there's not
another way to do it
no but you don't understand we're going
to get a huge cash infusion let's get no
it's not going to get you out of the
well man what are you going to do you
got a number in a SQL database right
um it turns out these companies are
scams right
well it's Aurora too simple luminar they
all raise way more money than comma dead
which
uh oh I've none of these are Fusion
these are all self-driving cars and
lidar but okay so it's question right
what does it mean for something to be a
scam
does something to be a scam require
Awareness on the part of the creator
that it's a scam
right if the answer to that is no if you
believe that intention matters
then what you're going to get is honest
idiots to raise billions of dollars
right they're being honest but they are
idiots right
this was obvious to me I've been saying
this exact same thing now for seven
years
I could have told you I did tell you but
I'll listen right
you know people also thought that
bitconnect and lunar warrants scams
right there's people honestly out there
who chilled me both of those products
right and now I mean look both of their
Founders are in jail so you know we can
all like there's a spectrum of scams
right but um
yeah
uh you know we'll get to cruising waymo
later
marginal utility approaches marginal
costs this is a true theorem of
economics and what is the marginal cost
of open pilot
what's the marginal cost of all the
pilot
zero right
so homepod provides any utility at all
marginal utility approaches marginal
costs a lot of times you don't want to
measure success in value creation
because a lot of value creation is a
scam look at GDP
kind of want to measure success and
value destruction if you can destroy
fake moats of companies open pilot will
continue to get better open pilot will
solve self-driving cars and open pilot
will be free
oh
did you know Linux is the fastest
growing platform on azure
it's not just a smart guy Embrace right
embrace the car companies that are smart
will embrace the car companies that are
not smart will ship you the Sun Cloud or
the Oracle cloud or whatever Cloud you
know oracle still exists I don't know
how they make money but whatever
um Linux is the fastest growing platform
in Azure markets do approach rationality
you just have to survive
Market can remain you know irrational
longer than you can remain solvent
uh yeah
yeah this is a lifetime Revenue comma
let's see a nice uh a nice R of like
that something
uh this is the amount these companies
have made in lifetime Revenue versus the
amount they've raised
uh
no like I don't get it I don't I don't
know man maybe I didn't go to Harvard or
get an MBA or something
but like bro well okay look man look man
we we raised we raised 3 700 million
dollars and we made 200. okay that's
cool man
like I don't get it I don't like I who
I'm just saying like Okay obviously when
you first raise for a company this is
true but these aren't recent raises but
these companies have raised after they
were not even remotely close to making
back their initial investment in Revenue
not profit Revenue right you can look at
other companies like Amazon and Uber and
be like well I mean Uber's hilariously
unprofitable but they make a lot of
Revenue they have a lot of users these
companies don't
uh so this is the number for comma
uh 22.2 on 18.1 million wrist
his Twitter followers for all right I
told you I'd address cruising waymo
right and so I actually do honestly
believe that Cruz and waymo have larger
marketing budgets than the operating
budget of comma
right and uh oh soon man soon all right
look they use a linear model but like
this is what the website said so
uh
employee retention uh four people have
ever quit over seven years
uh
it turns out honesty is a great draw uh
same Mission folks governance a
commitment to iteration and Improvement
come work here
uh
look
all this stuff everything about I didn't
do any of it
I haven't I haven't pushed to commit to
open pilot in two years it's everyone
else you saw talk here today don't tell
me
um my sole job is to keep idiots far
away all right that's really that's
really my only job right like it turns
out yeah
foreign
the past is always depressing you know
but
uh no seriously um
to anyone watching this to anyone in the
audience if you want to come work here
look the bar is really high but what we
ship hopefully is really good and you'll
get to ship things right you'll get to
ship things you'll get to be a part of
this process that makes things better in
the world
and I think that's the real thing
especially as we approach this like
everyone late stage capitalism everyone
kind of understands the economies
whatever man fugazi right
uh I think the thing that people really
want is that they want to make the world
a better place like I said if your
startup looks like this
you know you're just changing the
distribution but if you start it looks
like this you're changing the world
I did not realize I was entering such a
dishonest game I have never seen a more
wretched Hive of scum and villainy that
I have in the business worlds
uh but you know we're gonna win anyway
just takes a lot more out of you than
you think it's gone
okay
future
I'm excited about the future Korea
uh so we'll start with a nice quote from
a
Elias goodkowski
and I'll plug in the numbers for the
current computing speeds the current
doubling time and estimate for the raw
processing power of the human brain and
the numbers matching 2021
interesting
not but that far off
and I think we have a little bit of
still work to do on the software but
like
everyone kind of sees it right
like this is a lot easier I've been I've
been talking about this stuff man when I
read when I read this quote when I was
15. it's changed my life my whole life
my entire life trajectory has pretty
much been because of you know this guy
in this document I'm sure he incredibly
disavows it right now we got to Nuke the
data centers don't forget
but um no really uh yeah
so what is the future I'm going to tell
a little story in my story is called
forward-looking statement
so much time
ladies and gentlemen welcome to
Comic-Con 9 it is the year
2037. I am an AI generated voice hiring
real people to do Pas became
way too expensive in the early 30s
we've grown quite a bit since the first
Comic-Con in 2021
we have 44 stores and malls around the
world
and a billion devices sold
in the top 10 biggest consumer
electronics companies and we did without
selling out
um so let's look at a picture of a mall
this is a real Mall you guys should all
check it out while you're here it's up
in the Hoya uh it's called the UTC mall
and I'm serious about the mall store
like like it's written on our boys
inside like come on isn't this where you
want to buy a commentary isn't this
where you want to buy a common body
you know like come by the mall store
oh the metaverse is lame it's gonna be a
real Mall store go get a Cinnabon
bubble tea Happy Lemon
um so we're gonna we're gonna store in
the mall uh yeah
that's gonna happen there's more store
is real
uh
it's hard to go anywhere without finding
a comma remember it's 20 37.
in its three form factors cars bodies
and puppies it is versatile enough
for everything
you'll find commas transporting goods
cleaning houses cooking meals and just
being a lovable companion that will go
anywhere with you
it's not rendered
uh yeah
now announcing become a seven
just two twenty that many dollars they
have to be twenty twenty three dollars
look I don't control the inflation
uh it's a third generation comma Asic
uh 50 pops of compute that's fifty
thousand Tera UPS
for reference the comma 3 has about five
all right so we're off by a factor of
ten thousand don't worry don't worry the
future comes fast slowly and quickly
um it's first Common advice to boot into
tiny grad
well no really like look at home pilot
right like open pilot is kind of this
open pilot right now kind of means two
things right it's kind of both this
system layer and the self-drive layer
right the self-drive layer is a policy
model for driving on on roads the system
layer is like a camera Daemon maybe will
even start to move things like the
vision model into the system layer right
but you have this system layer in open
pilot which runs Foundation models
right and then you have on top of that a
policy model which does driving and then
underneath that you have tiny grab you
have an operating system which can run
all these models and schedule them
appropriately
50 pops is a magical number combined
with the latest version of open pilot
our foundation models learned in the
cloud RL in the world and a good amount
of on device learning we expect a comma
7 to be able to do anything a human can
do
this does not stop at self-driving cars
okay
level four level five this doesn't like
this is boring
oh but but I heard the question before
not to call not to not to not to pick on
you like oh like like why don't you
focus in on like an application oh my
God
I'm trying to build people
we're trying to build people that's what
we're trying to build here
right
self-driving is just a really cool it's
kind of a restrictive problem right you
can refine your techniques in
self-driving it's like a game but
eventually
this all becomes general purpose and
sooner than you might think right I was
trolling you know we did the Taco Bell
challenge Elon replied to one of my
things and I was like yo
our system is going to be so end to end
that even our DM is going to be end to
end
you guys saw it
uh yeah
anything a human can do is an
interesting thing too right this is my
300 this is what we build the uh comma
threes on
you understand that it's being operated
Now by a comma seven right
you understand that most of the
employees in the company now are commas
right
it's interesting right
I mean how many of our and you'll hear
about this in a later talk today how
many of our workers
how many people worth of compute does
comma have if you define a person as 20
petaflops you'll get an answer to that
later today
right
how many how many silicon people work at
the company
I'm not here to discriminate man I'm
more Progressive
and I'm saying yeah no I mean it was
crazy when we first saw comma 7 actually
come over and like help build the other
comma sevens it was it was a wild
your comma seven is yours just like your
comma 3 is yours
the models we train in the cloud are
Foundation models meaning they do not
have opinions they're not our lhft they
are true foundation models and I want to
give a thank you even though I lost 80
000 in your stock and really regret
selling it I want to give a thank you to
meta for releasing llama 2 as the
foundation model and not just the vrlhf
version we want to do the same
and
I will
whatever it takes there's no cause I
believe in more than open source AI
um so the models we train in the cloud
are Foundation models they do not have
opinions
we do offer some pre-trained policy
models we call them custom software
maybe some of you familiar with that
right if you want a custom if you want a
pre-trained policy model that drives a
car again how it drives a car is is is a
decision right we make some decisions
about how to drive right but that's
that's when you get into opinions right
foundation models are unsupervised
trained policy models are trained
supervised in some way shape or form
with some RL with some supervised with
whatever but by default the uh
comma seven is like a child
it will learn whatever behaviors you
teach it
so teach it well
and it should pick up skills as quickly
as a smart human
what's that
uh yeah I don't really know what's next
the comma 8 will likely be running the
company
let's look at it for a minute right
it's got two eyes
it's got a mouth
it breatheses air
it has two ears I pushed hard to keep
those two ears
it has a spinal cord
is it a spinal cord
I mean yeah all right look it's a comma
three it's got this looks like a little
bird brain right it looks like one of
them dumb dinosaurs you know
um but we'll get there we'll get there
robotics is all a question of
intelligence
all right
turned out how many of you guys have
robot vacuums they're pretty good now
right
how many of the meat quartz
right why do they eat chords because
they're not smart enough to really
understand and like the comma 3 is about
the same intelligence as a b and it's
not as smart as a mouse never mind a dog
or a human but we'll get there
robotics
and that's like humans are so good at
like moving
but we're so dexterous with our hands
people forget like how good humans are
people forget how good humans are
driving they have all this self-driving
rhetoric all the cars are going to be
safer or nothing I haven't seen a car
that's anywhere near as safe
right now Ada systems can make it safer
because ads systems you pay attention at
all times I do believe that Adas doesn't
make it safer But A system that
completely takes control away from the
human
you forget how good humans are humans
are really good and humans are good
because they're intelligence they're
intelligent robotics is all questions
now back to the present
it's 2023 and you are Comic-Con too
thank you all for coming out
uh I hope I hope things you saw today
were good
ah
Mall store
all right come on I really I really went
off in the weeds of the future if at the
mall store is going to happen soon right
the monster is going to happen soon
all right all right I love this all
right uh in the present huh yeah
the present clip art
all right
um I'm going to sit here for a minute
so we can all decompress a little about
the future because we're we're really
about to undergo a major tone shift in
the presentation
the next slide is a is a major tone
shift from this hypothetical future
where robots are replacing
coexisting with humans uh so major tone
shifts coming and just sitting down to
prepare all of you and now I'll go back
to the presentation
all right so we're going to start with
some contacts these are the failure
rates of iPhones
all right whenever we discuss failure
rates nobody is really going your Apple
is never going to put failure rates on
their website or in any of their
marketing presentations but I understand
this is very important to a lot of you
that buy the hardware it's very
important to me as well
um so to calibrate iPhone 6s were the
worst and had a failure rate of about 26
percent uh whereas you got down to like
iPhone X's iPhone 8 plus and they were
like three percent right so the range
for iPhone failures is three percent to
26 percent
this is the real numbers right
um I could do it for game consoles too
but I like this chart for iPhones uh so
this was the failure rate of the Comet
two
uh yeah uh these are just real numbers
you know like I said we don't hire any
marketing or Communications people so we
don't have any people to make up fake
statistics to lie to you I just actually
took these screenshots from our real
okay how good is the hardware building
uh the comment two failed a lot uh
you know look we honored the one year
warranty spent a lot of money uh
honoring that one year warranty
uh and one of the biggest priorities for
the comma 3 was this cannot happen again
we are going to make these devices good
we did a lot better with comfort
uh
so you see orders of magnitude we've
shipped about
seven thousand six thousand which is a
lot better with the failure rate on the
three and the the real story is even
better than what Matt shows
um so this is the comment three failure
rates by month
and you can see a jump discontinuity
right here
it has nothing to do with one year or
anything like that
it has to do and that's when we move to
our new office
we built a real production facility for
these things
people think that this is easy people
think building like high-end Hardware
like this is easy go buy an owl cam and
you'll see that it has a crappy little
screen and it's in this like overly
dense plastic it doesn't look like a
sexy piece of modern consumer
electronics and it's because it's hard
right for however good you might think
our software is however bad you might
think our software is our Hardware is
pretty much the same
processes same ways of thinking about
things
um but we've put tons of effort into
making this a lot better
so you can see the failure rates of
modern comma threes are a lot closer to
five percent than they are to nine
and we are going to do even better
we uh dropped the price five hundred
dollars
uh in January
you can see we two extra sales which is
nice we do need a bit of growth unless
you don't want too much growth right
we're not going to do we don't need to
reach the whole world this isn't for the
whole world but we do want to make a
product that is a bit more mass Market
quite a bit more mass Market
so where do we go from here
we'll find them
the comma 3 is great what do we do to
refine
introduce them
to come to reacts
so it looks pretty much the same from
the front
uh
see the IR allergies are a little
different
this the case is so much better on the
3x like when we did the three it was the
first thing we injection molded and it
was bad
shiny black plastic you know you guys in
the garage trying to sand blast these
things in our old office oh come on like
I look better we gotta makeup
stunning this time
um and you see the down curves there the
road cameras are on the board we'll get
to some pictures of the board in a
minute
now check time what counter some more
3x specs okay comma 3x
it's the same 845 platform and Camera
Arrangement as a three
so what this means is your three will
not become obsolete
um the three and the 3x are in the same
cohort meaning like the software is very
close to interchangeable between them
more similar to how like the Eon and the
Eon gold were in the same cohort
right like everything about the E on E
on gold we're similar enough that we
could keep the software supported at the
same time so we're not the three and the
3x are pretty much the same support
window
um again no promises on this but uh yeah
uh we upgraded the cameras
three ox
omnivision sensors uh these sensors are
newer generation they have 20 more DB of
HDR they have a faster rolling shutter
uh they can operate at real 60 FPS if we
wanted them to uh
yeah some of the late model comma 3s
have this too so if you bought a comma
three in the last couple months you have
that
uh 128 gigabytes of storage versus 64
gigabytes uh so I put that star there
because we're going to start measuring
our gigabytes the same way phones do
some is taken up by the operating system
in the software but the real Flash on
the device is 128 gigabytes
so double the storage
can FD integrated
one people were waiting for this is the
one people were asking about a Discord
uh so so it doesn't integrated red panda
um
same OLED uh same spec OLED uh in the
last five years the Chinese got good at
making oleds uh which is great so the
comma 3 used a Samsung OLED it was
really hard to get the supplier was for
anyone who had a screen problem with the
comma 3 they weren't all I don't even
think all the panels were new some of
the wrinkle ribbon cables came wrinkly
and we did a lot of filtering on them
and it cost us a lot of money now we
have a new supplier of the panels we put
it in order for
a lot of them and when you put in orders
for lots of stuff you get quality
um so yeah only panels uh same OLED
looks great
onboard road cameras versus flaky ribbon
cables if any of you guys saw camera C
or Sierra or camera malfunction uh the
cameras are on the board now and
actually the CR Sierras weren't even
caused by the ribbon cables they were
caused by bad assembly procedures uh
which we fixed and
if we have time I can go into more
details on that
uh stereo in case sound
if you guys saw the Hubble sphere video
and the comma 3 came out playing those
sounds it was bad uh uh those mono
speakers it wasn't well coupled to the
case now we designed something with two
speakers that are like coupled to the
case it uses gaskets it's nice
um the sound is good
uh upgraded power architecture how many
of you had to wait for like super caps
to flakily drain on the three it was
like kind of half drain it's because the
super caps were connected directly to
the power rail now we have a boost
regulator in between the super caps and
the power rail which lets us get more
capacity out of them and never has this
weird thing we are putting seven volts
into the comma
uh yeah
and about half the components
it's a lot more reliable
let's take a look at the board
this is the front
the front looks pretty similar to the
three
a few things to know no more GPS
connector because it's using the GPS
that's built into the quick towel uh
those little antennas are actually
better than the big antennas on the
three you can see the pads for the
speakers you can see those connectors up
in the corner laser corner
this is not a laser plug
this is a laser pointer yeah as you can
see these connectors up here they're uh
the Wi-Fi Wi-Fi antennas on the board uh
yeah these LTE antennas are smaller and
better those are where the super caps go
they weren't soldered in for this
picture same two microphones
uh uh and the GPS is using from the
quicktel we managed to get raw GPS out
of the quicktel the quality is the same
uh
uh I mean it's limited to the antenna
uh yeah same psalm
where things really get goodies on the
back I don't know if you've seen a
picture of the uh of the comma 3 back on
the circuit board
I will show one in the next slide uh
here you have the red panda integrated
in this tiny little chiplet
uh screen connects here power stuff all
underneath here to reduce noise GPS's
actually the GPS is better in this one
than the last one I think we got like
2db of noise lower
uh by shielding things and just doing a
better job with the with the power
architecture
uh battery you guys don't care about
this but it slides in and out so we
don't have to hand solder it we have to
support can FD we have chokes on all the
can lines
uh you know like I paid three dollars
for this so I hope someone appreciates
it
um
uh these are the Wi-Fi antennas uh we
got a SIM card uh we tried with esim
adiva we'll uh talk to you about e Sims
if you want to know why
but oh I guess the main thing I really
missed here is that the cameras are
right on the board so the cameras are
just just on the board and part of the
reason we can do this and almost no one
does this cell phones don't do this
um is because we have uh
we have a lens focusing line in-house
right we can we can put the cameras on
the boards and focus the lenses
and we don't have to do modules
right less ribbon cables less noise more
reliability right this is how you make
things really really good
I want the reliability I want the
failure rate of this device to be like
one or two percent
and by the end I think we're going to
get there
uh so this is the common three board
compared to the 3x all right
uh which one of these do you think is
gonna break
right
uh
uh yeah
this is actually from we I couldn't find
this picture this is a screenshot of the
last YouTube so it's extra bad quality
uh we got rid of the nvme it just uses
the onboard onboard flash now uh again
it's enough if you want more by Prime
uh we start for you in the cloud or you
can set up your own Cloud Server if you
want to do that whatever
uh QR codes on the board we like track
everything through this manufacturing
line
um it even looks reliable
is it a dev kit
I was on I'm not going to sell my latent
space like the guys were like comma
didn't ship anything because of some
like spat with the government or
something and I'm like this is like what
year is it
we've had plenty of interactions with
Niche descents they were fine
if we report our accidents to Nashville
like it's it's fine it had nothing to do
with that the only reason we called it a
dev kit was to kind of set expectations
I mean I don't know I think it's
probably time we stopped using that word
so it's just the comma 3x
it's Mass Market
I'm gonna sell a lot of these
I think this is it I mean I think this
is the one right like it's not is well I
guess you haven't gotten to really why
it's Mass market yet that's on the next
slide
all right so the comma 2 is 1099.
with inflation
so what should we price it at
three dollars 350.
12.50
no additions just 12.50 you know
something I realized doing this this is
what my seventh of these now uh is that
you uh
he always gets so caught up in your head
with all these like oh we're gonna name
it the panda the pigeon the giraffe
oh man there's additions why does the
storage matter does the one terabyte
drive better what does cross country
mean
you know what guys you hope you'll read
the questions document
uh there's a great document about
questions I hate questions I hate when
people ask no you guys can ask questions
it's cool you guys paid to be here you
pay you can ask questions
um no but like people ask questions and
you know how you get rid of questions
you just like well what does the one
edition do said no one ever right you
give them three editions they'll think
they have like a choice right and it's
just it's not even like worth it like
it's just like it's 12.50 you can buy it
and
I called it three stories because this
is a line
in uh
houses three stories
you know how you know this one's good
because the last one was good
it's just the comma three but better
everything about it is better and it's
cheaper
uh so when can you get one
order right now
uh ships in one to two weeks one to
eight weeks one to eight weeks uh one to
eight weeks eight uh depending on when
you order if you order right now you get
the one if you order
on Tuesday you get the four
if you order on next Wednesday after
like way after the Tuesday you get the
eight so you know order now uh
we have a pool in the office and I want
to win so I bet a high number so you
know
uh no they're they're really good
um this is this is the the three acts in
a in a Navy sex uh no more red panda no
more two harnesses just buy the little
things stick it on it sometimes you know
you just you just look look we're not on
the 13th generation yet but if you
handed an iPhone 13 to somebody in like
2007 like when did the iPhones get good
you know what generation around what
number iPhone did they start getting
like wow okay this is just actually what
four five four five by the way is not
the fourth or fifth you know they did
they did three three Gs four fours
I hope we're kind of there right I hope
we're kind of the point where like this
one's good
um
yeah
that's my presentation
thank you
[Applause]
I also want to you know I didn't build
this I didn't build the software I
didn't build these models I didn't build
the hardware the team did
and you can be one of those teams apply
for a job so apply for job.com 3x you
know it's a call to action
uh no that I mean
you know what judge the team after
buying a device and driving without
that's fair if it's good I didn't do it
if it's bad I did it so
[Laughter]
the comma 3x is live on comma.ai yeah
and now we're going to take some
questions
hello and thank you for presentation and
congratulations with 3x
do you see any value to run language
models right on device
uh why do you want to run a language
model
like interaction with
environment with driver
uh yeah sure
check it out it runs tiny grad it's
pretty good I don't know our mission is
to saw self-driving cars with living
simple intermediaries maybe solve
robotics while delivering ship to
intermediaries if language models help
us do that we'll do it otherwise I don't
see a reason to but uh yeah no I think
you can totally get like llamas and
stuff to run probably not 7B but like
little almost
uh great great presentation uh I'm not a
developer uh I'm actually a marketing
guy so technically I'm a professional
liar uh I mean would you disagree with
that characterization no no no this is
what we do uh nothing personal obviously
so I got some uh just uh silly questions
here so have you done uh any testing or
planning to do any testing on commercial
vehicles like 18 wheelers and things
like that and that's why
why we've done a lot of testing this is
the best tested comma device by far are
we how many people get an epoch
a whole bunch of people been driving
around with these
we've made like 82 of them this is the
best tested one by far
um the the amount of I mean we control
so much of the stack now too we're we're
you'll hear about this in our next talk
but like we built out a a manufacturing
line and we tested them well have I done
any testing in 18 wheelers I don't have
an 18-wheeler I don't have I don't know
I have a motorcycle license I don't have
CDL
Tesla partnered with Pepsi
how who's making money off this who's
this delivering value to like I don't
get it is this like someone want it's
not self-driving what do you mean you
got a driver in the seat this just
sounds expensive sorry just just one
more question so uh you know marketing
is Brandon and telling a good story jobs
sold good stories uh Elon sold good
stories until he bought Twitter
uh
so other than honest here what is the
story about open pilot that the common
person not developers need to know about
or want to be part of I mean and this is
about kind of the lying and again like
where I'm attacking
what is open time
open pilot is
Source Adas system what is the comma 3x
it's Hardware that's capable of running
open pilot so you ask the question what
does the user need to know just those
two things and you can buy them in our
store for 12.50 right if there's
anything that's like the narrative I
mean it's exactly what I said it's like
you see you want you here I'll show you
the narrative I'll show you the
narrative in two words buy now
and you know what you know what if we
don't like it here's another part of the
narrative 30-day money-back guarantee
buy it try it
ships in one to eight weeks
hey hey George uh talk to us about how
the comma 3x will always be compatible
with the cars we drive and that the cars
we drive won't somehow disable the use
of the comma 3x
don't scan don't let Sam Altman scan
your eyeballs okay as long as you don't
do that I think you'll be good
I don't know what are they going to do
they're going to update the car this has
never happened like before maybe they're
gonna I don't think so oh I can't
promise you that I don't know man
probably not I've never seen it happen
you know what I mean
uh hey there I was one of your hackathon
contestants
um look for my next hackathon project I
was curious
is it possible for a comma 3 to Port a
new model to a comma three
easy I mean it's tiny grad now so you
don't have to deal with smpe you can
just the Onyx support is pretty complete
and Tiny grad uh yeah you can run
whatever you want
is it possible sure it doesn't say dev
kit anymore but it's still a Dev catch
no it's not a dev kit don't worry buy it
if you're worried about that word I
don't know man uh yeah but no you can
totally run other models on it it's not
that hard I don't know like again like
are we gonna do it no but you can do it
I mean I think we ran some I think we've
got like a YOLO running for the body
demo or something
yeah what's the 20 FPS we've got YOLO
running 20 FPS we can put boxes around
things right we love boxes
okay you're talking a lot about uh Mass
market right so uh but
I only have a C2 so forgive me this
doesn't work this way I'm C3 but like
you get the device you turn it on you
still have to like download the software
right have you ever bought like a PS4
and had to sit there while it updates
for an hour it's faster than that well
so the question is is the PS4 Mass
Market
but basically this is like a tiny
liability air gap right how do you feel
like this liability like is going to be
serving you in the future
anything about liability it's custom
software I explained to you what it was
it has nothing to do with liability and
everything to do with the fact that our
models are R lhff right right and if
it's rlhf that's a policy model that's
custom software the foundation models
will come on the device right the
foundation model is Tiny grad agnos that
comes on the device right that's what
the device is the software the policy
model that sits on top of it that's
custom software so in general liability
you're not concerned as far as like
future what do you mean Lions nhtsa
stuff like any of that I mean liability
I mean pay attention at all times it's
level two like the one comment I'd say
is like level three being shipped today
I'm not shipping level three right no I
know level two we ship level two points
by the way we will cover the liability
if our car I'm not covering look
look
if you want to not pay attention
do not buy our product you must pay
attention at all times this is not a
joke this is not tongue-in-cheek you
must pay attention at all times we put a
lot of effort into making sure you pay
attention at all times every accident
I've ever seen with the comma device no
one's died no one's gotten seriously
injured but I've seen a few accidents
and every single one of them would have
prevent been prevented if people were
paying attention pay attention this is
not a joke this is not tongue-in-cheek
pay attention or don't buy the device
[Applause]
that said if you want to pay attention
it's a great device
hi great presentation and now as we saw
a large Foundation model
worker per wheel do you think in the
future or near future the only very
powerful Hardware can power self-driving
car something like that yeah um so it's
a question so the comma 3 and the comet
reacts have an expansion Port they have
a USBC expansion Port that can do full
USBC bandwidth so we are capable of
streaming out the full sensorium device
um if it does turn out we do need to run
larger models which we haven't seen
better results with yet our
recommendation is going to be buy a
gaming laptop connect the gaming laptop
and put it under a seat
um no and I mean it like because it's
actually really hard to buy and video is
not going to sell you RTX
does 30 60s but you can go on Amazon and
for 8.99 you can buy an MSI plastic crap
gaming laptop stick it under seat it'll
run the model and actually I think we
can make the experience of this quite
good because if it loses connection to
the laptop it can fall back to the model
on device
um so with a lot of these things yes
more compute helps but model like
you can do all sorts of things where
your student teacher models to make it
smaller but are we going to need more
compute in the future of course we are
do we need more will more compute make
the comma device drive better right now
no uh yeah also the other question is do
you have to can you can you do like
student teacher to put a small model on
the device that captures the policy
really well that's kind of where we're
going right now you'll hear more about
this in our next talk we're now training
a driving simulator
um and this is using a like an auto
encoder to compress the video and this
is a big model
um so we're training a big foundation
model but we may not necessarily need to
ship that to the vice because what we
need to ship the device is a policy
model but we have Pathways I don't know
the exact answer are we going to need
more compute than what's on a comma 3
yes are we going to need it in the next
two years unclear probably not
thanks we've got a question upstairs
hey hey Josh uh sounds nice presentation
uh a few nodes are first if you look at
those failure rates uh over time I think
there's like uh Spike if you look at it
in like summer times
so which suggests that you know they may
be oh yeah that isn't when the devices
fail that's when the device was built
when it failed right those failure rates
are not that's not the month the device
failed that's like when but anyways
there is some serious uh like um time
dependence that you might look at but uh
but my main question is not about that
actually it's a little bit to reiterate
and I really like uh the effort you guys
put into reliability of 3x
and I think it it should be actually
built uh even more reliable than like uh
your normal car because like if you look
at like human brain it's built like
there's all like sorts of uh protections
around and that should be probably
should come up strive at like it should
like really build like a tank so even in
the event of collision it can record
stuff and like you know like the last
one device the common device is not a
safety device it's not really it we
don't no no but but just you don't use
the word dash cam anymore right like our
goal again we're a small company and
like I said a lot of what my job is now
is saying no to things right this is one
of the last things I still do from the
company like can we build all these
fancy features no we're not Tesla what
we are trying to do is build the best
possible Highway and Highway plus
Driving Experience and you can go on
Reddit right now and see people
comparing autopilot to open pilot
you go back three years people would say
they were similar now almost all of them
are like look it's cool with FSD and
autopilot are doing but day to day
open pilot his hands down better
um it was just a post on the kame I
subreddit where some guy's talking about
he has two bolts one with supercruise
and one without yeah night and day this
is by far the best Ada system you can
buy and that's what we're focused on
doing right we start focusing on other
things the adap system gets worse right
everyone it's really easy to say yes to
things but it turns out it's saying no
that makes things really great
who has two bolts some guy on Reddit I
don't know man
I didn't English teacher only had two
Nissan cubes
it's like that's my dad's I'm like the
car changed color he's like no that's my
dad's Nissan Cube and I'm like okay why
you'd buy one Nissan Cube you know
thanks to all the people who bought
comma 3x's already we're blowing up
George your high number make it hit yes
555 in the first week
[Applause]
this is the first comma device that I
would recommend to like my friends I'd
be like this one's actually what have I
told my friends to buy an eon and a
giraffe and a panda like all right you
know what I'm saying they were all good
but some were better than others this
one's good
thanks everyone
[Applause]
all right so you learned about the 3x uh
very excited I can finally stop holding
that secret in because I'm absolutely
terrible at keeping secrets
um
so you saw we have a new device now
you're gonna see how we built it uh robe
the genius behind me
3x is going to show you our production
are people into it is this your special
I hope so I I just love talking about it
but I don't want to bore you guys
this is a perfect time to pull up your
phone and go to comma.ai
five and buy a 3X
all right please give it up for Roma
[Music]
hi
good afternoon I'm Robert I'm part of
the the hardware team here at coma and
today we're going to talk about how the
device is built
um
so first of all I think a lot of people
when they think of Comedy think of an AI
company like we do a lot of research a
lot of our people are working on
software on on machine learning but
fundamentally comma is also a consumer
electronics company like I mean we
launched a new product this is what uh
what what funds our development so this
is a pretty pretty important part of
what we do
um it's also not like we're selling like
simple Electronics like we're selling
electronics that that's somewhat
comparable to like a modern smartphone
like if you think about it we have
we have a high quality screen we have
high quality cameras we have a bunch of
compute to run the machine learning
models we have connectivity we have
network connectivity we have LTE we have
Wi-Fi
um so yeah it's not a simple product to
build
so we started out a few years ago with
the Eon ion was a pretty simple product
to build I mean we basically uh
we didn't really care about all the the
advanced features we just we bought a
smartphone like all the advanced
features already in the Box we slapped
the heatsink on it to manage The
Thermals put in a 3D printed case
um yeah it's easy to produce uh it's
it's simple it works but it's it's I
mean it's not really a consumer
electronic product right
um
after that I think it's about four years
ago now we launched the comma 2. this is
basically refinement of the Eon
product so that the most advanced
features like compute sensors are still
inside of a metal box so we didn't have
to care about that but we integrated the
electronics that talk to the car into
the case
we refactor the way that we connect to
the car so we can support more cars
and things go a little bit more complex
like we started to have to build more
procedures and how to like make sure
that the changes we made were tested
well uh that the production processes
were good but then two years ago we
launched the comma 3.
um it was a pretty pretty big step
George always talks about the fact that
chroma 3 is the hardest product that
we'll ever have to build and I I do
believe that that's true for a few
reasons
for one
like all the sensors all the the display
the compute the electronics they're all
custom built in-house they're designed
in-house this is something that we'd
never really done before on this scale
so it took a lot of engineering effort a
lot of time improving all the processes
to get us to build
not only to design all the individual
customized components but also to
integrate them nicely into one like
little box that looks nice that
functions well
that is a form factor that people
actually want to use
uh so so that's what we did back then
then this year like we've obviously
launched the 3x the George talked
extensively about already which is just
a refinement of the three with kind of
the added
um so we're already on the downslope in
terms of complexity
um
so in the future I think we can go even
a step further once we get to larger
numbers of devices sold we can actually
start talking to manufacturers to also
get the modules that we still use to do
connectivity like we still use the
Crackdown module for LTE we still use a
system or module as we refer to the sum
for the compute but we can start
integrating that all into a nice device
and then we handle back to something
that looks more like a smartphone
um
again like if we get to those numbers we
actually uh can customize these uh these
these individual components more so that
the integration will also be easier so I
think it'll only get easier from here
so how do we do it now
so there's actually quite a lot involved
in the whole process so to uh to give
you a sense of that I've made up this
little nice design of uh like a basic
life cycle of a product within company
with it within coma I don't think it's
too dissimilar to all the hard drive
companies but uh it's good to go over it
anyways so we start with a concept so we
basically think about like what form
factor will look like
um what features we want to have
uh once we've got that nailed down then
we go over to a design step where we
design all the electronics all the
custom parts the mechanical Parts the
case
um then we get prototypes built
then we get them tested if they're not
good let me go back to step number two
uh usually we iterate like six seven
times before we get a prototype that's
ready for manufacturing
then we actually can put it into
production
and after that we can ship it out to
customers now if it would stop there
that would be nice but we live in the
real world so we'll also get warranty
returns
um
for the 3x
um compared to the three getting the
concept down was a lot easier we
basically have the exact same features
except for the addition of kind of the
we still have the same kind of form
factor of all the components stayed in
relatively the same position so that
that part wasn't actually too hard I've
actually found a picture of the the
Whiteboard where we sat down and wrote
down all the all the changes we wanted
to make
and you know there's
a lot of times you mentioned we
mentioned the word no in the in the
feature list so we removed the pcie
lanes because we don't have the nvme
drive anymore removed the 3.3 Power
Wheel so that made the power art
actually easier we
um we removed the X the external siren
like we used the the speakers we already
had on the device to do the siren part
um we removed the USB hub because the
panda Now talks over spy to the main
device so it's we removed a lot of stuff
and as Elon always says no part is the
best part so uh that's the general goal
here
um
so once we know what we're building then
we get to the design phase so the
biggest part of design I would say is
the the electronics part so the main
board which starts out as the schematic
on the left
so that's basically where we do all the
like we selectable Parts that'll make up
the whole design
um we
get them to work all together like we
think of all the edge cases the device
might be in like like when you shut it
down after a while like the power draw
needs to be loaded like attack on stuff
all gets integrated and fall off when we
do the uh the schematic design
after we're happy that we and we think
that we made all the changes that we
needed to make in the schematic then we
move out move over to the board layout
uh this is actually a picture of the uh
the PCB layout of the comma 3. so you
can see it's it's it's relatively
complex so this is the part where we
place all the components down in a
sensible location
um to make it fit in the form factor we
make we designed the outline of the
board and then we connect all the
components together with uh with the
traces on like six copper layers uh to
get all the uh the requirements that we
want
um
this is actually a pretty manual step
still because there haven't been very
good software packages out there that
can do this automatically even though
you might think that it's not that hard
we can just connect stuff up together
that needs to be connected up it turns
out there's a lot of
a lot of design requirements that you
need to think about for example all the
high speed traces that carry a lot of
the data from like the cameras to the
compute they need to be impedance
matched they need to be on layers and
further and far enough apart from model
stuff that they don't have crosstalk
with different Lanes you want them to
not have any uh electromagnetic
interference
you don't want to admit any RF noise
that you're not allowed to because I
might also degrade GPS or all the
devices in the neighborhood but it's
actually quite complex so this process
like if you start from scratch it
probably takes one and a half two months
to get it down uh not future revisions
are obviously easier because most of the
stuff stays the same
so let's talk a little bit more about
the part selection because in the recent
years that has proved to become more
difficult because of all the shortages
going on
um and not only that but there's also
the thing where uh
there are multiple Parts on the market
with a similar functionality so getting
an optimal design where you can actually
mix and match parts to get the same
features it's pretty important
so how do we internally keep track of
all like the substitutes that work
together of all the inventory that we
have for production
um like what components all the designs
use so we can reuse the same components
well we don't always need to reinvent
the wheel so we actually found this
software called Parts box it's made by a
Polish company it's just one guy who
writes this in the in his spare time
it's actually really cool it's uh it
introduced us to the concept of a
customer part number of CPN I sometimes
also think of it as a comma part number
but
um
so this is basically a part number
that's not like an actual physical part
so that basically just specifies the
requirements that we want for that part
to be so we just say okay we want like
100 kilo Ohm resistor that's one to show
now in an 0402 package it's like a
relatively standard component and
there's dozens of Manufacturers that can
can make parts that fits the that fits
these specifications
um so that's the parts you see on the
bottom so that's the parts that we can
actually buy and that we approve
uh to be like a suitable part for the
CPN and we can then order them to make
sure that we have enough for uh for
production runs the other cool thing
that Parts box has is API access
um
so we also do a lot of CI on our Auto
designs so we can automatically pull
from our inventory numbers and that kind
of stuff and I'll go into depth a little
bit more in the next slides
so this is a commit that I made to the
hardware repo in the last month finishes
rounding of one of the camera boards uh
nothing too interesting but uh this
shows us like all the steps that are run
automatically every time we make a
change
so the first thing we have is it checks
the cpns so it goes over the design that
you just pushed and make sure that every
part in the design actually has a CPN uh
like allocated to it so we don't push
designs where we don't specify like what
the part actually is because that makes
it harder for production like you have
to go back and forth I'm like asking
which part of this
uh so that's that's automatically yeah I
checked that that's uh all filled out
then the next step is one we added
because one of our earlier prototypes we
made a mistake of putting a capacitor
with a low voltage trading on a
power supply line that was slightly
higher voltage so uh like in in a few
weeks we would see failures with this so
now we actually have a check that goes
over every capacitor and all of our
designs and checks that the the ratings
are actually good enough for for the use
case we used for
the third step is a fiducial's check for
people who don't know what a fiducial is
so that it looks like this it's a little
dot that you put on a PCB doesn't have
any function in the end product but it's
very useful in production because that
tells the machine like where the board
is actually located in the machine so it
can more accurately calculate where it
needs to place the components
we tended to make the mistake sometimes
where we would order boards without
placing fiducials on them and then we
would get them into the manufacturing
line and would be a huge hassle to get
prototypes out of them so now I add an
extra check so every time we have a
design and it at least has three
fiducials on the on every board
next one generate gen get files so
that's something that's the file format
that a machines use so we don't have to
manually make that every time we make a
new revision then we also generate board
diff images
so for every commit it tells you where
the copper was added where it was
removed so we can easily like go back
and see which commit actually changed
which uh what what part of the design
because uh I mean the files look like
XML codes so you can't really see what's
going on with the actual design on
GitHub so this is a pretty nice sanity
check to make sure that you actually
commit what you wanted to commit
um
then we have generating schematic PDFs
because not everybody has the cat
package installed on their machine so we
just generate PDFs from all the designs
so we can just pull the schematic as a
reference anytime uh we back up some
stuff that's an automated thing and then
recently we've also added the new parts
bot so every time we now push a revision
to a design it checks and it accesses
the parts box API I just talked about
and it checks that all the components we
have on the design are actually in stock
like locally
and if they aren't then we just generate
a message on slacks saying hey please
buy these components when the pcbs
arrive and we actually have all the
components to build them
uh
except for the electrical designs we
also have the mechanical designs
obviously so we do the injection mold
case we do also all sorts of like
holders for GPS antennas for the dcams
the mounting plates you see on the right
now don't go into too much detail there
because that's that's not usually what I
do that's eager on the back there
um but we we yeah we generate these
machine drawings that we can send off to
the the manufacturers we do some
simulation tests to make sure that all
the the things stay within the limbs
that we want them to be
Etc
cool so we're done with the design we
got a bear prototype pcbs
this one's blue you've noticed in
Georgia stock that the PCB was black
that's one of the ways we make it easy
internally to track like which Pro which
thing is a prototype which one is a
production device
also we tend to change the goal of the
PCB every revision we do so if you have
like three four revisions on your desk
like you can easily check like okay this
is a ref B this is ref c
um it's been quite helpful
um
so now we have blank pcbs obviously they
need components so what do we do now
well
some people have already talked about
our internal production line that we set
up a few months ago so that's the part
that'll actually put the parts onto the
PCB
um the main advantages we've seen from
bringing this production in-house
because people ask us like why'd you
bring it in the house you can just pay
somebody else to do it you don't have to
care about any of this stuff uh also two
things so first of all it drastically
reduces the cycle time
so with our old manufacturer it would
take like between six and eight weeks to
get a new revision
and you'll only get like two boards and
so you hold back and forth and second of
all it's way easier to fix issues like
for example we got a board made on our
line somebody plastic component like 90
degrees rotated we just literally walk
downstairs change the value in the
machine work back up and an hour late we
have a new revision on your desk with
the required fixes
um with the old company it would be an
email chain of three days and then we
might get it right
okay first machine so the board goes
into the machine
and that machine applies the solar paste
so let's take components down to your
board you need some solar base that
melts in the oven to create the solder
bonds
um most Mass manufacturing uh
manufactures they use a stencil based
machine so you get these um
a stainless steel based stencils with
horse guard on them you have a big
squeegee that just squeegees down your
solid paste
um it's very nice it's very fast so it
only takes like a second or two to paste
the PCB the problem is it's very hard to
iterate with uh like if you make a new
change you have to make a new stencil
you have to reload the stencil in the
PCB every time you change the designs
out so that adds a bunch of time with uh
switching designs and making your
revisions this one just as a as a tube
with some solid paste in it and it just
dispenses tiny little dots on the pads
and uh it's just CNC controlled so you
can just put any design in it and it
works
there's also the cycle time is not very
important in this step
because uh the whole production line is
pipelined so even as long as this takes
less time than it takes to populate the
board this won't hold down the total
production rate that we can achieve so
there's actually not that many downsides
to doing it this way
next machine pick and place machine so
the pick and place machine is loaded up
with a bunch of reels of components and
it does exactly what the name suggests
it does it has nozzles Picks Them Up
from reels places and then on the board
our machine also has an extra cool
feature that I really like it does
electrical testing as well of every
component a very passive component so
for example if it picks up 100K resistor
usually these parts have tolerances
because we live in the real world
it'll place them down on the dashboard
it will measure the exact value log into
a database somewhere uh like related to
the serial number of a board that's in
there so we can in the future always
look back and see exactly which value
resistor was placed in there
um that's pretty cool
next up in the line the oven
pretty straight pretty straightforward
so you just put the board in moves over
the conveyor it gets hot it's all the
melts
that's pretty much it you'd think but
then there's a lot of tweaking in the
oven so the oven has about eight zones
they can all be set at a different
temperature
and then the conveyor belt speed can
also be modified and it's it's a
balancing act between like multiple uh
parameters that you need to tune
for example in the first five zones on
this uh this slide you'll see that the
temperature slowly moves up
and that's to give the flux contents
that that's inside the solar base some
time to uh to clean up the oxidation of
the pads which makes it way more likely
to get good solar Bond then it moves
into zone six and seven where the
temperature rises up quickly to above
the melting point of the solar balls
that are in the solid paste the bond
gets formed and then there's a
controlled cool down in the next two or
three zones to make sure that that
everything uh settles down nicely
a lot of the components that we use
actually have limitations on for example
the uh the the the temperature rate the
temperature gradient that they that they
can can sustain so for example the image
sensors I think you have to heat up less
than three celsius a second I cool down
less than six Celsius a second and
there's also something that you have to
keep in mind when tweaking all these uh
solo zones
next up in the line we technically have
a functioning board if everything went
well the problem is we don't know if
everything went well like what if
somebody like bumped the PCB some
components moved or we loaded the wrong
part into the machine or failed to pick
up a part and didn't notice well that's
why we have automated Optical inspection
so it's that machine it's basically a
fancy camera with a bunch of lights that
can move
um
just flies over the board and checks out
every component and makes sure that it
matches a reference picture from a known
good board so this is especially useful
in production where if you're running
like thousands of boards you know that
every board actually has all the
components and it doesn't have any any
failures that would be easy to detect
this this way
uh
doesn't not benefit the family machines
in ours is that we can do a lot of
vertical integration with them so
we talked about parts parts box having
an API all the machines also have an API
so uh this is some software we wrote
in-house to um
program the machines because if you're a
contract manufacturer you usually get
like an Excel sheet of all like the
parts and the mounts positions that the
parts need to be placed at then somebody
has to like sit there manually enter
like the hundreds of components that are
on the design
um select from which CPN like which npn
was actually in stock which one's on
machine which was which one is not well
I mean we've built a software at query
Sports box so to check which components
we actually have in inventory it checks
which parts are actually already loaded
on the machine so if you have multiple
accepted npns for a CPN again like
prioritize the ones that are already
loaded and then we just throw in like
the Gap file that we have automatically
generates all of this it's literally a
five minute process and we have
programmed all the machines
so we have built prototype devices does
everything work well
to verify that everything works you need
test plans
so we have very extensive unit tests for
every single feature that we want out of
the device
so this functionally tested everything
works that's on the board like you
expected it to work based on the design
it also checks for extreme environments
so we do a lot of tests in like thermal
Chambers to make sure that it goes up to
the that everything still works at the
temperature that that it might reach up
in the car it goes down to a certain
temperature
um
it also does some sort minor stress
testing where we like
um inject voltage transients into
certain lines to make sure that the
protection circuits we've built in work
we make sure that if you plug in a wrong
cable into the wrong hole nothing breaks
like all that stuff is is validated
before we move on
then if we think that's all good then we
have some more compliance tests so those
are actually mandatory if you want to
sell consuming Electronics you have to
bring it to like a certified test lab
and then make sure that a you're not
intentionally radiating any RF noise on
frequencies that you're not allowed to
radiate on like
and then there's the second part of the
tests which makes sure that the modules
you've integrated that actually you want
to transmit don't transmit at a power
level that's too high or that they don't
create any modular
um
effects
and then there's a third step you do
field testing so if you first put them
in all our cars so we have 12 cars and a
fleet it covers most of the platforms we
support but then there's some some other
ones that Community only has so that's
why we do the the Apple program so we
have some few members here I think you
guys here
yes
um
and uh that's actually proven to be very
successful so in this round of Apple
testing for the 3x we've actually found
two bucks
um one of the bugs was a software bug
with the um the new panda that's
integrated on the board it was used in
slightly different ways than the red
band that was in the past so we fixed
some some bug related to Canada but
there's also a hardware back that was
discovered that we didn't discover with
all the test plans we've previously done
which was with uh Jason's third-party uh
long cables
uh VW users do all this weird stuff it
occurs I don't know uh so yeah we always
use the the official cables because
they're laying around in the office so I
it's it's good to get some coverage from
the community as well
so once that's done
and we're happy with it it moves on to
uh production so we now buy all the
parts in bulk we so that's like the
cheapest components we make sure we have
everything in stock and then we get the
pcbs built in Black like mentioned
before we apply the QR code stickers
actually data Matrix another QR code but
same thing so this adds a unique serial
number to each board such that we can
later on if we if it comes back with the
heart of theory we can double check that
like the oven was set at the right
temperature when it was run that all the
electric components measured their uh
their respective values uh we can check
the aoi images like to see if that
missed anything that that it shouldn't
have uh so that's a pretty nice addition
then when it I mean it runs through the
whole circus book line the exact same as
the
prototypes so then we have assembled
boards and then we move on to all our
provisioning steps
so first of all we have initial
provisioning so this is a step we've
added for the 3x
um
and it basically takes the bare boards
that came straight off the line we just
put on the lens holders the lenses in
them uh puts them in this nice jig and
it does a bunch of like very preliminary
tests so it checks that all the voltage
trails are in intolerance uh it checks
that we can talk to most of the
components it does like an initial
flashing round of the internal panda
um and then it has the the focusing step
so it's very important that the lenses
that we place on the devices are like
perfectly in Focus because it's fixed
Focus so we can change it in the future
and would be a hardware return if
they're not so we made this this UI
thingy where you just turn the lenses
you try to get the green line to go as
high as possible and then we know that
the the devices are in focus
now obviously on the bare boards we
haven't placed the song or the compute
module on the board yet so we needed to
design something else for that so we
designed what we call a fake zomb which
is basically a separately
like a a separate module in the same
form factor as a song but that can be
powered externally so you can just keep
it alive when switching between boards
just make sure that we don't have to
like reboot Linux every time before we
run tests so that increases cycle times
plus it has like the voltage testing
stuff built in and all that nice stuff
then the next step is we built them out
into full devices so the heatsinks got
placed on
dcam gets placed on the GPS gets placed
on that they get put into the cases the
screen gets placed on that's quite a lot
of steps
in the case we also add an NFC tag and
uh you'll see where that's useful for
Lake
after they've been built into the final
form they move on to what we call final
provisioning this is a
wooden rack we have set up in our
production environment with some some
mounts
so they they get connected up there and
then we run through like a full Suite of
Hardware tests so we make sure that
every piece of Hardware that's in so
that's that's
um
on the device like the Imus the GPS the
Wi-Fi the screen all that stuff that's
all tested so we make sure that that
we know that everything works before we
ship it out to customers
this is also a place where like from
time to time new tests get added because
we've seen failures from the field for
example a few weeks ago we had some
returns of display panels where like the
touch wouldn't work in like a certain
area of the screen so we just added a
test where you just like wiped the whole
screen so we make sure that the whole
screen works and so we that's that's
like the procedure we follow to reduce
failures uh more and more
as time goes on
after that we move on to the stress test
so that's another bacon wooden rack this
is only a small portion of it
um
where the devices are placed on for a 24
hour
cycle test
so on this test we put them under high
synthetic loads so we just max out the
CPU usage Max our GPU usage DSP usage we
run the cameras at full speed run the
fans at full speed
um
just to make sure that the devices
actually stay working for like a
reasonable amount of time because
um
sometimes like soft works but then like
it heats up and then stops working so
that's the kind of feelings we try to
get here this is also the place where we
do some longer running tests like we
make sure that the GPS signal doesn't
drop for 24 hours
we make sure that if we toggle fan on
and off once in a while that it starts
back up
we make sure that the camera doesn't
drop any frames during the whole 24
hours
and those those things have really
reduced the amount of fails that we see
uh in the field
after they've gone through that they're
ready to ship so they move over to
fulfillment where we automatically test
using the NFC tag because we know where
the device has been so we put the device
on there
uh on our reader let me know if the
device passed all our tests
because then you always used to be the
case in the old comma two days in the
old office like device would get
misplaced or like not all the tests
would have been run and then would get
shipped out anyways so now we explicitly
uh confirmed this uh for the comma three
so you have to make sure that we're the
correct type like if you buy one
terabyte one you get a 32 gig one people
who complain the other way around not so
much but still not still not great
um
domestic orders we include a SIM card
for the comma Prime trials International
AutoZone so that's also something that's
verified
this also tells you which harness the
customer bought so we place the Right
One In The Box it also checks that we
have the latest software uh flashed onto
the device because if it's been sitting
in storage for a while like if we uh we
have some some access inventory it might
be on an old open battle version and the
first clone would take a lot longer
so this is something uh something we try
to prevent and then there's the final
cosmetic inspection before they get the
box gets shut there's also an aoi it's
not automated Optical inspection we call
it Ada Optical inspection because she's
the one that has the the Fulfillment
um
so yeah
and then the heart of failures
um
we used to get emails all the time that
said oh my device doesn't work anymore
and I mean there's not much you can do
about that except for ask the customer
to return the device and then in most
cases it turned out that the device was
fine but it was installed wrong or the
software didn't support that car yet or
there was some other software bug that
we didn't know about yet
um
so we recently changed that process and
made sure that when there's Hardware
complaints people actually provide us
with a route where the issue occurs so
that an engineer first looks into the
into the the
alleged failures and if there's actually
someone normally going uh going on then
we get it sent back otherwise we tell
the customers like what's going wrong
and we don't have to do any unnecessary
shipments this is actually reduced or
inbound for for uh
influx like the inbound for the the
failures by close to an order of
magnitude so that's been quite good for
us
within the devices that do come back we
have to take him quite seriously because
usually there's something we can do
about it
um
for example one of the earlier failures
of the gamma 3 had to do with the soms
failing
and it turns out that we used to use a
thermal pad on top of the main CPU
and with manufacturing tolerances and
thermal cycling that would put too much
pressure inside on top of the dye which
caused some solar failures
so then we change the procedure to go
with a body-based thermal compound which
reduced the the total pressure on top of
the chip by 2X and that practically
resolved the issue overnight
another thing we can do is add
additional testing like for example the
touch issue I talked about before like
we just add in all the tests to make
sure these don't these devices don't get
shipped out in the first place or we
actually can also improve the design
like if it's a an actual design bug we
had one a while back with red pandas for
example where we didn't account for
people plugging in a USB cable with 12
volts on it on a port that one's
supposed to get 12 volts and then would
blow out the camera and Civics so that's
just fixed we made a new revision it
doesn't happen anymore
and that really translates in the
failure rate so uh Georgia already
alluded to this but the all-time failure
rate of gamma 3 has been at 9.2 percent
now
um
it's an interesting number but it's
actually more interesting to look at
what's failure it's been over the last
year
so we load it to 3.9 already
just by improving all these processes
um
to put that into a little bit of a spec
of perspective George already did some
of this but uh iPhone 6 is 22 recent
iPhones three four percent
um Xboxes 22 percent
PlayStation 3s was it ten percent
we're actually close to a Wii that's
pretty good Hardware apparently
we intend to do a lot better with the 3x
I I think with some uh some more
improvements and with a more reliable
design I think we can get that probably
get it down to like one one or two
percent
so that's that's pretty uh pretty good
so uh I mean George gets to announce
Hardware products when we also get to
announce something
um
that's not on there
um
you guys know harness boxes
a lot smaller now we don't I mean
they're in the final stages of testing
so they'll come out in a few months
probably uh injection molded case it
would be a lot easier to fit on the uh
the covers and more scars
then another one that we're coming out
with soon a new panel jungle so it's a
can of the V variant it adds a Z card
support it adds per channel effuses uh
per Channel as bu line control all that
stuff that uh has been very nice for
developers internal and hopefully
external as well
so okay I've been talking before it says
35 minutes now I'm only I only have 45
minutes so
there's still a lot more that we haven't
talked about
let's party shortages let's talk about
screwdrivers those packaging this
injection molding bomb optimization
cable testing suppliers
harness production mounting plates
through hole soldering display
calibration laser deep analyzation
pandas comma bodies you name it the
hardware team has a lot to do
so uh if you're interested reach out to
us we can definitely use an extra hand
or if you have more questions then feel
free to uh
ask him now
[Applause]
all right thank you robba we got a
question up here in the front
thank you
um
you talked about compliance testing are
you planning to do only FCC or are you
looking goals so European one like easy
and others
[Music]
done the FCC one now the European one is
very similar
um
so we'll uh we'll probably be complying
with that as well
great
so the um
the harness connector is changing
because you've got a smaller box there
so how do you make that what's that
equation like for making the trade-off
is it time to
uh yes so the the I think the old one
was a 24 pin if I'm not mistaken the new
one is a little bit smaller um I mean we
had to because otherwise the case
wouldn't be smaller uh the new
connectors will just come with the new
harnesses so we'll have to move over the
production a little bit but functional
functionally that's not that big of a
difference it doesn't have a mechanical
relay anymore by the way so we'll get
rid of the little click you hear when
open pilot starts but it'll be a lot
more reliable hopefully so yeah that'll
be good
we got any other questions
oh in the back I'm coming
hi um so I was impressed by your
automated testing on on commits to the
repo uh how is it that you do the diff
between the old board and the new boards
um oh it's it's not super efficient
computationally but we've gotten uh
Eagle the cat package we used to run
inside of the CI Docker container so we
basically just spin up you go open the
files generate uh girl books then
generates pngs from the gerberus and
then we just do an image diff on the two
images
sweet and we're also looking for
Hardware Engineers are there any uh
like networking events that you know of
in San Diego where we can all uh I don't
really know of that many actually no
the truth is that rubber is based in
Belgium that's also true
so he definitely does not know about uh
the happenings in San Diego oh we got a
question back here
I'm wondering um do you have any
interesting stories about weird issues
that took a long time to track down and
end up having an interesting cause
um
we have so many good bug stories we have
a lot of them there's much bugs Nabil on
both the comet two and the comma 3s
we've we've had a lot of GPS troubles
um this apparently like uh the the the
the 845s the main chips they leak quite
a bit of RF across the whole Spectrum so
you have to isolate them very well to
not affect GPS the Commodus we had an
issue where the
GPS Santana has this internal LNA
amplifier
and so it amplifies the signal but then
we had an issue where it leaked out
after the amplifier into the heatsink
and I got coupled back into the antenna
so now we would get like a feedback loop
that one took a long time to track down
[Music]
um
well all the ones that we got how about
last week when a vendor sent a wrong
component and mislabeled it oh yeah
that's another great one so last week we
were replacing uh inductors on the
boards on the three axes actually uh
don't worry we fixed it but uh
um
so we got we ordered uh one micro Henry
inductors from a reputable Supply they
came to us we loaded them into the
machine and then uh Hardware guy he like
he needed one so he just took one off
the line and when taking it off we
looked at the Reel and it was like hey
there's two labels on here one of them
says one micro Henry one of them says
2.2
it turns out uh it was the wrong part
so uh yeah
got to be careful even with official
distributors
so we heard George talk about custom
Asics where does this stand on the
hardware roadmap have you guys thought
about it at all
uh I think George has some architectural
plans but I don't think that's uh that's
that's going to be concrete anytime soon
yeah quite far off from the budgets
needed to uh to to spin out H6
so people frequently Express concern
over the thermal resiliency of the
devices can you speak about the steps
that you take during production for both
the C3 and now the the 3x to mitigate
that uh yes so I mean the basic process
we follow is we just test them at
extreme temperatures and then we make
sure that the parts don't fill at those
temperatures we just cycle lots of times
and then we fix the issues that uh that
arise
our second part of the thermal issues is
also not necessarily for failures but
also for uh like user experience for
example when it's like sitting on your
windshield when the sun's blasting on it
the device can get quite hot they want
to cool down as fast as possible so you
actually want to reduce like the total
thermal Mass on the device uh so yeah
there's quite a lot of consideration
going on in the in that regard
but so far with like all the improved
soldering processes we don't see that
many thermal cycling failures anymore so
hey uh
under the root cause you know
you know a box or you know occurring
Hardware or there is like automation
inside all that
um well when we get failures back we
often just run them through the
provisioning tests again and that
usually gives us uh like that narrows
down the component that actually failed
and then we disassemble the devices
let's look at another microscopes and
then Trace down what the actual issue
might be
so it's it's mostly a manual process but
we use some of the the production tests
to guide it
all right we've got time for a few more
questions
um yeah I had a question about the GPS
module in the kyotel uh how does that
compare to I think you were using a Neo
m8p yes what do you think like is it
worse better
um I think performance wise it's pretty
similar I think we got on the crackdel
into a mode where it sends us the actual
raw measurements uh and and turn off all
the processing that it does inside
um but the I mean the Crackdown module
uses Qualcomm chips inside and I mean
phones have pretty good GPS these days
so the hardware level is quite good so
we got about comparable performance with
uh with the EU blocks modules as we do
with the uh
the correct else now
Robo what's your favorite part of the 3x
process the favorite part yeah which one
probably the most Joy
that's a difficult one
um
I really like the new image sensors like
a nicer easier to Route we have battle
specs
cool components
we got any additional questions
all right
how do you manage being in Belgium while
they're here
for the hardware guy well you get used
to it it's uh I used to be in San Diego
for a year so I know the team very well
as well
um and then we communicate over slack so
I make sure when the US is awake that I
got all my questions answered and I can
continue working the next day sometimes
it's nice as well like you're just
sitting by yourself quiet and you just
plow through it
also he comes in about once once a
quarter yeah every Wednesday Rob and I
have lunch meeting yep yep and every
Monday we do a team meeting
commas with super low on meetings yeah
uh we have in all hands and then a team
meeting every week and that's about it
yep
all right thank you so much rubber
[Applause]
good luck
well you have to click through all the
I'm very excited to Welcome vivec to the
stage uh notably reminding me that we
Vivek came to comma through a hackathon
and I think it's the perfect time to
share our September hackathon
[Music]
September 29th that weekend we'll be
hosting a hackathon in our office uh
with our friend Billy
who's Billy's new friend
oh sorry Billy and silly
um Billy recently learned how to take
pictures and print them
um pause part of another local hackathon
so we're back our resident hackathon
anyway uh please welcome
all right uh my name is Rebecca I work
in the research team so my talk today is
going to be about
can you tune my car this is a question
that I get at least once a week on
discard
uh
so we have a discard I'm sure how many
of you have been on our Discord
okay and we have a development tuning
Channel how many of you have been on the
tuning Channel
okay great so if you go to the tuning
Channel you see a lot about good tuning
bad tuning and ugly maybe not ugly just
good and bad so if you're new to open
pilot or new to discard or new to the
channel you might be wondering what
exactly needs tuning right so everything
that we spoke about today we never
really spoke anything about like you
know tuning something so what exactly
needs tuning and for that you have to
understand how is your car different
when it comes to open pilot like how are
cars different with respect to open
pilot
so so these are some of the brands that
we that we support so some ways in which
cars are different are you know the
wheelbase is different and the wheelbase
is the distance between the front and
the rear wheel so as you can imagine
different cars have different sizes so
the wheelbase is different they also
have different widths and as a
consequence they also have different
masses like some cars the lights some
cars are heavy we have we rent we
support from like tiny cars to like the
RAM and they're quite different in that
way
uh cars are also different when it comes
to other things like steering ratio
steering ratio is
how much your car turns with how much
steering wheel turn and that is
different in each platform and also
different across brands your tire
stiffness which is like again like the
quality of your tire how much like
torque your tire provides while turning
stuff like that is also different uh the
center of gravity is different uh in all
cars depends on how many people are in
the car and stuff like that and then
actuator lags so
each brand and each platform have
different ways of processing the signal
that we send to the car so when we say
okay you know do this manure or do this
turn there is like some internal
processing happening in the car and then
it actually actuates that in the final
actuator and there is like a lag which
is also different for different brands
so all of these things are different
so to understand how like these
differences in cars manifest let's look
at this example so these are three cars
the Honda Fit the Toyota Corolla and the
ram all of them are like you know quite
different as you can see the images
so let's focus on lateral movement right
so let's assume all cars are moving at
20 meter per second uh all all of them
have a 10 degree steering angle uh and
they're all traveling on a flat Road
so this is the trajectory that these
cars would take so this is the uh
the UI versus X so if you start at the
same position this is what the cars
would do Under the same instructions so
it's I guess right now it's clear that
we need to really understand like you
know what exactly happens when you give
instructions to cars
so how do we actually learn these things
we learn these things using something
called the vehicle model so to
understand the vehicle model let's look
at some High School physics so you're
turning you're in a car and you're about
to go to a turn so this is the front
view so let's assume that the road is
banked uh and let's also assume there is
some wind because why not uh in this so
this is the top view of your car so your
four wheels and your front wheels are
turning uh so in uh I don't know how
many of you are familiar with car
Dynamics so this is something that we
call a slip angle the angle between your
direction of motion to your heading is
called a slip angle and that determines
a lot of the Dynamics of your car so you
can see that there are forces that act
on the tires so this is basically
something called a bicycle model which
is you assume that your car is a bicycle
which is not a good assumption but it
really works it's like a it's a
simplified Assumption of your car and
then you know this is where the center
of gravity is and then you have like you
have if you draw the free body diagram
and the forces that act on this on this
object you end up with something like
this so let's quickly go through this uh
it looks quite scary but it's not so
what we have is the desired curvature
that you know we get from the model and
from the planner we know we the car has
to do something right at some curvature
at some speed so we have the yacht if we
make some very generous assumptions
about cars and about our
Dynamics we can find out from the state
space equation we can find what the slip
angle is to achieve this particular unit
and when we know the slip angle we can
find the steering angle required to that
you're required to like turn to achieve
uh like the maneuver that you want to do
so this is some this is called the
vehicle model so we have a Daemon in uh
open parallel called param C which
learns this all these parameters inside
that we spoke about and then it learns
like the Dynamics of your particular car
so it learns things like the steer ratio
the tire stiffness the road Row the
steering angle offsets and all of these
things and it learns all of these things
about your car with your particular car
so another interesting thing is that the
steering angle offsets is basically to
go straight you would assume you should
keep your steering angle at zero degree
but that's not true all cars have some
Offset you have to keep your steering
angle at like two degrees or minus two
degrees or whatever and that depends on
your car and how long you've driven it
and stuff like that so this is also
something that we learn uh live while
you're driving
uh a fun fact is that as a consequence
of learning all this we also know when
you're when you have a bad wheel
alignment which is if your wheels are
aligned badly and then you know if you
want to go straight you have to hold
your wheel at like a 10 degree angle or
something like that a lot of people you
know come on discard and they're like
hey I just installed uh open Violet it
drives fine but it like you know it
tries to go when I hold it when the
wheel is straight it tries to go right
and when it's going straight the wheel
is still slightly to the right is my
device broken and then we tell them what
the problem is and then they come back a
few days later saying hey about that I
went to a mechanic and you know he said
my wheel alignments were wrong and then
they fixed it and now my car drives
perfectly so this is something that from
your logs and from the tolerances that
we know uh we can tell you if you know
your car has a bad wheel alignment okay
so now we learned all of this stuff so
where do we actually use it
so you know as you can know as you see
uh we have sensors which is car agnostic
we have models and planning which is
also pretty much car agnostic but the
actuators are specific to cars so this
is where uh you know we convert the car
agnostic stuff to the car specific stuff
so
so we started with a maneuver that we
wanted to do which is like a steering
angle so to achieve the same thing so we
used a traditional PID control so we
have a steering angle and the car gives
us back the steering angle so we're like
okay go 10 degrees and we have a classic
PID control to make sure that the car is
driving 10 degrees and then everything
is good
so this is the distribution of the uh
lateral acceleration error when uh when
you're doing these Maneuvers so it's
very important for us to understand how
well the car is performing the Maneuvers
that you are asking it to do and for
that we have a whole bunch of metrics
but one of the most important is
absolute lateral acceleration error so
what do we mean by this we mean that so
when the instruction is to perform some
manure with some lateral acceleration
and the car is doing something else so
what's the difference between these two
and we have to drive this number down so
as you can see the straight is the
distribution is like the the average is
much lower than in turns which means
that while going straight you're pretty
much you know it's together free but in
turns it's like it's it's slightly worse
so this is a metric just remember this
metric we'll keep coming back to this
again and again uh so we had all of this
right but then we realized that in our
Fleet uh the way we actually uh give
instructions to cars we don't actually
give the steering angle for like
overwhelmingly most of our cars we give
the torque we give the steering torque
that you have to apply to the car so
realize wait a minute we were going
about this whole roundabout way of we
have the curvature we do all of these
equations and we find the steering angle
and then we close the loop on the
steering angle and then finally send
torque so you know we can just like
circumvent that and then try to find
torque so this was a whole effort uh
called torque control which we released
in 0815
so let's leave us at the same maneuver
that we did earlier which is this car
doing this turn and this angle
now if you focus on the tire patch that
is on in contact with the road so this
is like the free body diagram of this
tire patch so you can see that these are
the forces that develop on your tire
during a turn so you can see the wheel
is heading is this the wheel is moving
here so this is the slip angle
so what this effectively says is that
the wheel torque is you have a resultant
force that is like X behind the center
of the wheel so basically the wheel
torque is this resultant Force F times
uh this pneumatic Trail and for a
particular configuration of your car and
your vehicle this is constant so the key
Insight here was that the wheel torque
is proportional to the lateral
acceleration that you want to achieve
adjusting for gravity and from data the
second Insight was that the wheel torque
is directly proportional to the steering
torque that you apply when you account
for some friction and friction is you
know when you when you're turning right
and immediately if you want to turn left
there is like a bit of friction in your
steering column that you have to account
for so basically uh
you know we can get the wheel uh we can
if so we have a lateral acceleration
that we want to achieve and we all we
need to do is learn one proportionality
factor to directly you know to know what
command to send to the car this is great
news
so we can find one value which for each
platform and everything is good we
implemented this uh so you can see this
is the lateral acceleration that is
desired and this is the steering command
that we sent to the car to achieve this
and this is for a Toyota RAV4 and this
looks pretty linear to me uh so this is
what we implemented
in
0815 and torque control and then this is
the result so again the same metric
absolute lateral acceleration error for
some car stereo Prius and you can see
that the torque control was much better
than the simple PID tune for uh this PID
on directly the steering angle so this
is great news and this is even great
because the subtlety is that these
higher errors lead to other things that
are undesirable like they lead to more
ping-ponging they lead to like wandering
in the lane they lead to other things
like that which we don't want so this is
great news and you know everything looks
looks good here
but then okay let's revisit the
assumptions that we made the Assumption
was the pneumatic Trail was like
constant for a given vertical load which
means for a given configuration of your
car but then you know like even among
platforms even among like Toyota Priuses
like each other press is pretty slightly
different depending on like how long
you've used it what you put in a car and
stuff like that
the contact tire patch is also quite
different it depends on your quality of
your wheels it depends on how much air
you have in your wheels it depends on
which road conditions you're driving on
uh and the steering column friction
depends on you know the wear and tear of
your car and and
Etc so
this is also corroborated by the fact
that when we do the same calculation to
find the the single factor for each
platform on every car of that platform
we see that there is like a big
difference in uh the big distribution in
the value that is learned so these are
each pretty this is the distribution of
the factor that I spoke about uh and you
can see that for a even one platform
there is a wide range of values so we
set the value somewhere here in between
and then it's great for people whose
cars are like here but then if people's
cars are like here or here I mean it's
not that great so this is this was like
the motivation for us to go down this
route of you know we don't we're not
happy with platform averages we want
something tuned for your specific car
the car that you drive
so this inspired uh this effort called
Talk D which is auto-tune uh so
basically what it does is
the same thing that we were doing
offline on like all the data from April
like a particular platform like the RAV4
now we do the same computation on your
device while you're driving so when you
start driving we collect data and then
once it meets uh certain
conditions we fit the we use the
algorithm what that we were doing
offline in your car and then now we have
one constant that is learned on your car
and the great thing about it is that if
you change your tires next week or if
you refill air or whatever if like you
have uh you put some stuff on top of
your car to go somewhere like it learns
live and it adapts live and then you
know your your performance becomes
better as a result of that which is
great
so going back to the same metric so this
is for Toyota Highlanders you can see
that the torque control was red which
was already an improvement over the
previous generation stuff but torque B
was an even better improvement over that
which is great this make this means that
if your platform uh has like a bunch of
versions where you know like the
versions are different but they all
they're somehow called it the same
platform it's still fine because we
don't care about that and we learn it
for your particular car
so let's revisit the Assumption again
we assume that the uh the real torque is
linearly proportional to the steering
torque so we assume that you know you
apply some steering torque and the wheel
torque is some factor of that and then
we forgot about it but turns out that's
also not true uh we assume that the uh
there are effects like backlash so when
you're turning left and when you're
turning and immediately you have to turn
right there is like a there is some
player in the steering column there's
like a backlash that you have to
overcome and then it's your car starts
turning right while driving we don't
really realize this because you know
humans are really good at driving but
when you're controlling the car through
instructions you realize you know there
are all these effects at play that you
have to account for uh the other
assumption was that we didn't care much
about speed we assume that everything
works the same at all speeds uh you know
like that's fine uh but turns out this
is also not true for some platforms at
different speeds your car behaves very
differently and this also needs to be
accounted for
so for example if you take the same plot
of the lateral acceleration that we
desire versus the steering command that
you input this is for the Chevrolet bolt
I mean this looks pretty non-linear to
me uh the if you remember in the RAV4 it
was pretty linear and in this it's not
um so you know we had to do something
about this because the same if you apply
the same algorithm that we use earlier
uh people have like not nice experiences
especially at the extremes where it's
like it gets pretty non-linear
so we implemented a non-linear algorithm
where we have a non-linear fit for the
relationship between this lateral
acceleration that you want to drive on
and the command that you give and then
this was out in 093 and you can see the
effect of uh this change so the
non-linear is is better than the linear
which is also correct
and fun fact is you can see that there
is like a bit there is a difference in
the left turn and the right turn uh this
is like an idiosyncrasy of of GMS and
all these are super interesting things
because we can see this at scale and
it's very hard to see this if you have
one car but you can see that the errors
are slightly higher for left turns than
right turns it's because you're the in
in Chevrolets
the left turn is slightly different in
compared to right turns and I mean I
don't know why but it just is uh and
this also we need to account for uh so
uh this is some this was like a great
Improvement for the people using uh
people who have a Chevrolet bolt
so where do we go from this right uh
we've seen that you know over time we
keep improving the stuff uh we keep like
making sure that we move from platform
we've moved from Fleet averages to
platform averages and from platform
stuff to each individual cars so a big
effort for that was we uh released this
data set called comma steering control
and this data set is
the largest data set of its kind so what
it has is it has
the actual command that you give to the
car which is the steer command and all
the other metadata like the lateral
acceleration the road roll the velocity
uh a whole bunch of other stuff now this
is excellent because this is this data
is something that probably nobody else
has like we're in a unique position to
have so much data about so many
different platforms across different
driving conditions different uh like
weather conditions and all of that stuff
and different like usages like the cars
have different wear and tear so this is
like a fantastic data set uh which with
all this data so what you can and this
is like 12 500 hours of open driving
open pilot driving uh 10 plus car models
and 10 plus brands uh and we have plans
to add more data to this we have plans
to add uh non-open pilot driving so when
we when I spoke earlier about the
vehicle model that vehicle model is
valid for like small slip angles which I
mean by like you know like small
steering on a highway but if you want to
do a rapid 180 degree turn the vehicle
model completely breaks down like you
can't use the same vehicle model for
that uh in openpilot we are not there
yet to do 180 degree turns but we will
be and at that time we will have to dive
deeper into into the data and figure out
you know how we can improve our
algorithms to uh to cater to those
manures uh so this data set has all of
this information uh so some people on
Discord have already started using this
so they have some obscure brand that not
many open pilot users use so now they
have like access to a whole lot of data
that they can like dive into and they
can see if they can improve the
performance of their own particular car
which is correct
uh so what what is the future for tuning
and controls right
so we want to use more neural techniques
to learn the complicated feed for
forward functions so you saw we started
with like a simple linear model and then
we went to linear model on device and
then we went to a non-linear but which
still like it's still we we sort of uh
reverse engineer the function and then
we learn it but we want to move to like
a totally learned uh function so what
this means is there'll be like
irrespective of what the input and
output is in your car we should be able
to learn the response of your car to the
instructions that we have that we give
to the car at all ranges of speeds there
are some cars that do automatic roll
compensation in the car and all of this
stuff we want to be able to learn all of
this stuff live in in your particular
car
oh
uh
not sure what happened there
uh yeah so I mean that was like I was
about to end so uh so that's the uh
so yeah so uh we that's like another
plan that we have uh the final goal is
to move to like a target audience of one
so basically the target audience of like
you and like everything is tuned to your
car and it drives perfectly like the
output of the model and the planner is
perfectly implemented on your car and uh
you know there is and then the final
goal is me not getting any more messages
on discards saying can you tune my car
yeah
uh that's that's it I just had a couple
of call outs so do check out this data
set do come on the uh Discord Channel
and we keep discussing a lot on the
Discord Channel
um so you know hopefully uh you can
improve your own car much better and
then we can Upstream it that would be
great uh and a caller to uh open pilot
user uh 12 Sinker uh he's been uh like
at the bleeding edge of a lot of this
stuff I just want to call him out and
say that's like great work and we keep
watching it and uh we're very inspired
and I hope this also inspires more
people to check out what's happening
inside their car uh that is great
awesome
thanks
if you guys have any questions
all right we got lots of questions
in the front
so are all platforms using the torqd
already for the automatic tuning or that
still needs to be flushed out so um
Toyotas all
80 percent of our Fleet uses it The
Hondas don't uh because that is like a
there is a little bit of problem with
the Hondas I mean they also work really
well on on traditional PID control
so uh yeah I mean most most cars use it
and the plan is to roll it out to all
cars
great
hello so is longitudinal going to be
um in the foreseeable future for auto
tuning yeah so that's a good question so
the thing is the lateral tuning uh was
very much a function of
like it's it's very much defined by the
vehicle model and and the physics behind
it and a lot of the issues that we used
to have was not handling the physics
properly but the thing with longitudinal
tuning is that it's it's not much as
physics as much as
there is a lot of lag and we don't
handle the lag compensation properly in
longitudinal and it's like a bit tricky
uh to go over that so the problems that
are with lateral tuning is very
different from the problems with
longitudinal tuning so I mean yes to
answer your question yes we will have uh
we will have all the parameters learned
live in the car but it won't be part of
talk D like that's that's like separate
I mean it's like doing something else
there will be something else like that
which we'll learn all the parameters
required for longitudinal gotcha thank
you
great
I I think my question is kind of similar
to the last question but
um how do you deal with like hysteresis
which is like basically actuator lag
like uh like for longitudinal you said
there's not much been done yet but for
latitude like uh is it compensated for
in the motion planning or like
yeah so uh so what we call friction is
like is a manifestation of the
hysteresis effect which we already
handle in open pilot in Talk t we
already compute what this uh the the
hysteresis component looks like and we
already handle this so if you if you see
the plots
uh I don't know if cracking uh
pull something up so we have a
oh yeah if you see these plots so this
is from our uh from the uh data set
I think it's fine
yeah so if you see this so this is from
the data set that we released uh so the
effect there is all hysteresis uh I mean
you see the the width in the in the plot
right and this is already accounted for
in uh in Part B
[Music]
and you know I mean we have more effects
like that which are not exactly
hysteresis but they have this like sort
of discrete jump type of effects uh
which is you know more stuff for us to
handle but uh but yeah I mean hysteresis
is handled in totally right now
uh what is the uh optimal model of tire
for open pilot 0.9 according to the data
I mean yeah that's that's a good
question so I guess to answer that
there is an optimal model of a tire and
there is a simple and useful model of
the tire which is what we follow uh if
you ask for the perfect model of the
tire I mean you can find many textbooks
on this one topic on like what is this
sorry I meant like the make and model
like oh oh I see should we be using
Michelin or oh I see I get here I got
you uh I'm not sure the thing is we
don't uh from logs can get the model of
a tire so uh I guess that's something
that we don't have access to but we
certainly understand what sort of uh
like which platforms have like what sort
of effects in following our instructions
and that's something that we can comment
on but yeah
yeah we don't have access to the make
and model of the tire
all right I got a question up front
is it on the road map to replace the
current controls and and tuning system
with the completely end-to-end machine
Learning System
yeah there is uh but I guess it's not to
replace but to build on uh which is as
George said as everybody's been saying I
think iterative Improvement is something
that is like a core tenet a comma so uh
we had something very simplistic and
then we moved to something a little more
complex and a little more complicated
and then you know that's I guess the
direction it'll be going and uh we will
have much much smarter techniques that
learn everything that needs to be
learned like while you're driving and
then uh yeah so it won't be like a
replacement as much as just building on
what we already have
all right thank you give it up for me
back
all right if there's one thing working
at comma has taught me is that it's
infrastructure all the way down
I'm excited to bring to the stage the
king of infrastructure at comma
Greg
all right who wants to talk about
servers are servers exciting no no no I
don't believe that for a second they're
boring although we do have a really hot
data center so
all right it's all downhill from here
all right so uh at comma we train models
machine learning models for open Pilots
uh and we always want to train bigger
models faster iterate faster
and so we need lots of servers to do
that
the picture of our prior office we moved
to a new office recently and this is
what we used to have for servers for
training models and um
you can't really see the servers because
this is in a really dirty garage and
um the only way to really filter the air
with a giant garage door and all kinds
of stuff going on in there was to put
filter media right on the front of the
servers
to try to keep the dirt from going into
the servers
so you can see here
this is a four-car garage there's room
for four cars and the servers take up
less than one car spot so really not a
lot of space here for our servers
um
this is about 5.68 petaflops of B float
16 performance we measure everything in
B float 16 because that's what our
models are and so that's all we really
care about
um this whole room or this slice of the
garage we spent about 500 000 on the
servers getting power in here in the
ventilation and everything
hmm
so in the old office we ran out of power
we couldn't handle the amount of heat we
were generating
this the whole building only had about
200 amps of power that tiny panel in the
picture on the right there is all the
power for the whole building
the ventilation was the best we could do
we had to Skylight up in the top and we
had an intake and exhaust fan that were
up in the ceiling you can see the
skylight on the left there I kind of
propped it open because I needed more
airflow because the skylight's pretty
restrictive and for a good reason we
don't want rain coming down in on our
servers but when it was really hot I
would maybe try to prop it opening a
little more get a little more airflow
so it wasn't great we ran out of power
we didn't have enough airflow we wanted
to train models faster we wanted to buy
more servers we didn't have the power
more we wanted to buy more servers more
servers means more power more power
means more heat so we moved to a new
office
a big criteria for the new office was
way more power we found a place with 8X
the power of our previous office and for
the first time the servers are not in a
garage
they have a room
so
uh this is the room that we chose uh it
started out empty it was not obviously
it wasn't for servers
the first thing we did was we ran 800
amps of power into the room uh this was
pretty expensive we spent for all the
electrical work in the room we ended up
spending about 125 thousand dollars
um The power was kind of on the wrong
corner of the building for the servers
so it was quite a ways we had to run the
power and stuff but thank goodness we
had a place with lots of power so now we
can run lots more servers
so in this room we added a couple short
walls these walls are basically to help
with hot aisle containing the hot aisle
some partial walls the racks obviously
go in between those walls there we have
these 42u racks that we use
we knocked out some windows so I guess I
didn't really explain it but just like
in our last data center we only had fans
it was a garage no air conditioning
we're in San Diego and we can
potentially save a ton of money not
using air conditioning so what we do is
we we just use fans you can see the
windows boarded up here
and then we installed some really big
fans
uh these are
oh thanks yeah I guess the fans are more
exciting than the servers huh the uh the
fans are three horsepower each fan does
about 28 000 CFM uh the room's pretty
small we can exchange all the air in the
room in less than 10 seconds so these
are quite powerful
then inside the room this is one of
those hot I'll containment walls we also
have some fans that recirculate air so
we can basically take the hot air and
bring it back to the cold aisle when we
need to
um because sometimes we need to raise
the temperature on the cold aisle I said
our data center is hot we're in a high
temperature Data Center and I'll get
into that a little bit more uh so
sometimes it's not hot enough in our
data center and we make it hotter
and then the last thing was we just used
a strip curtain anti-static strip
curtain to kind of seal off from the uh
from the front side from the ceiling to
the top of the server or to the floor if
uh if there's no servers in the racks
and certain in certain racks
then the last thing is
um we want to make sure that the air
temperature from the ceiling all the way
to the floor is a very similar
temperature I'll get into more the
humidity and why but basically we need
an even temperature so we have even
humidity all the way from the floor to
the ceiling so these are called
de-stratification fans they just suck
air in from the ceiling and they push it
back down to the floor to even out the
temperature
so this is what the room looks like
after we built that all out there's two
intake fans on the ends that bring in
air from the outside there goes through
the servers through the racks and then
there's two big fans that shoot the heat
out the back and then on the sides
there's two recirculation fans and you
can see those recirculation fans are
kind of pointed at the intake fans or
where the intake fans blow in and I
thought I was gonna have to do something
way more complicated it turns out you
just point fans at each other and the
air mixes amazingly well so
so in our data center our intake
temperature goes up to 43c Why well we
always want to keep the cold aisle at
the outside temperature or lower and in
San Diego it can get up to it can get up
around 110 degrees sometimes uh rarely
and so that's kind of the max the max
temperature that we designed everything
for on the intake side exhaust side we
try to keep it we try to keep it below
like 55c it generally stays around like
53 at the most so
this is a picture of we buy a lot of
used servers and it's kind of funny to
see uh we have like temperature history
in The BMC of the servers so you can see
like oh well what What did the what was
this server what was the temperature the
server was like in its previous life
before we bought it and you can see you
know it runs around 21c in some you know
beautiful climate controlled
Data Center and then uh we have a peak
temperature of 42 there once it starts
running in our data center so
we abuse them
you can find data on how much on how
much power data centers often use on
Cooling and it's crazy like I don't know
if most people realize this but it's not
super uncommon for a data center to
spend more power on the climate control
basically on air conditioning then they
give power to the servers
so that's not great like
power's expensive especially in
California we want to use as little
power as possible for the for the
climate control and as much as possible
for the uh
um for the servers
so we do we do way better we if all of
our fans are running full power we're
using eight kilowatts and that's less
than four percent of all the power that
our data center uses and we don't always
use for uh that that four percent or
that eight kilowatts of power in our old
office we had fans that were just on or
off they were either full speed or or
they were zero uh and that made the
climate control a lot more difficult to
to reach a desired temperature and stay
stable and so forth so now we have
variable speed control fans
um this picture on the right here is a
vfd we just have you know they're just
three-phase Motors and you can use a vfd
to basically scale the the voltage and
the frequency up
um and then we can run the fan at any
speed based on on that
there's there's one other big benefit to
this which is if you have big fans when
you turn them on they draw like huge
power initially so so each of these fans
if you just like flip a switch and they
suddenly get power
for a period of time they're going to
draw 80 amps each
and so when they're running once they
get up and spinning full speed
then they only use like five amps or
less so the problem is is if you don't
have something like a vfd controlling
your fans then what happens is you have
to leave all this overhead power that
you can't really give to your servers
because well what if the fans need to
turn on so these vfds were really
important in maximizing the amount of
power that was available to the servers
so that we didn't have to leave all this
all this power overhead available just
to turn on the fans
so these vfds basically limit you can
configure how they work but we basically
limit them to the max power that the fan
uses at full speed so if our fans are
using 5 amps when they're running full
speed we don't let it draw more than 5
amps as it ramps up to as it gets
started and ramps up speed
for the climate control
we wrote software that we wrote custom
software that does the climate control
we have these temperature sensors this
is a picture of one of the one of the
temperature sensors here that we have
throughout the room basically the inputs
to the climate control system is the
temperature and the humidity
um
so what we want to do is we want to
maintain a humidity of 30 to 40 percent
inside the room we actually don't
directly it's kind of unintuitive but we
don't try to control the temperature in
the room we try to control the humidity
uh and since we're in San Diego we don't
have any problems where like it's both
high temperature and high humidity so
anytime it's really hot it's not humid
outside so uh since that's the case this
I guess this works for us it obviously
wouldn't work for everyone and so uh
yeah so we're just always trying to
achieve a 30 to 40 percent humidity and
the reason that we're so focused on
humidity is because we've had a lot of
problems in our garage data centers with
humidity because when the humidity gets
really high especially if it's dirty
that dust holds some moisture and
moisture on metal is going to cause
corrosion so we need to keep the
humidity below the point where corrosion
will happen and so that's why we we
manage the humidity and try to keep it
down below that 40 percent line for sure
so the way our we have a pretty darn
simple climate control algorithm
basically it uh it takes the input of
the temperature sensors in the room to
get the humidity of the room and the
temperature of the room currently to
figure out like the relative humidity
then
um we know we want to Target this 30 to
40 percent we come up with a temperature
that will achieve that 30 to 40 percent
and then we vary the speeds of the fans
to using a PID controller until we reach
that that Target temperature
um
so yeah
it's pretty basic basically if the
relative humidity is too high we need to
make it hotter because as you raise the
temperature the relative humidity of the
air will come down and if it's too cold
or I'm sorry if it's too cold the
relative humidity will be too high we
need to raise the temperature and
um so we we recirculate the air in that
case and then you have the uh
if the relative humidity is too high
then I'm sorry the relative humidity is
too low well generally the outside air
has higher humidity than what's in the
room so we're exchanging the outside air
and bringing that in and then obviously
we have like the mixing going on so that
we can we can basically take the high
humidity air that's coming in shoot hot
air at it from the back side of the
servers and get our desired relative
humidity on the cola on the cold aisle
side of the servers
so this is it this is what it all looks
like now uh
we now have approximately
55.88 petaflops of B float 16
performance so we basically 10xed our
our
[Applause]
s with all these fancy new servers we
bought well a lot of them are used I
shouldn't say that nudos
um
we now have about 10x the uh the
throughput
and uh we ended up spending about uh 1.5
million dollars so I mentioned I think
that the all the electrical stuff cost
us like 125 000 all the ventilation
stuff cost us like another 75 000 some
of the equipment that I'm counting here
uh is like money we already spent so
like those those that's included in this
total and then we bought you know
additional servers up to this up to this
number here basically
um so
so how does that compare to other super
computers so all we care since all we
care about is B float 16 performance
it's it's not exactly straightforward to
compare it but we can come up with
something relatively meaningful uh this
top 500 list maybe you've heard of it
before it's like the top 500 super
computers in the world it's not like a
comprehensive list you submit to be on
it if you want to uh we don't and part
of the reason why is because well this
is this is uh fp64 performance which
like who uses that but if you look at
this list and you find
um I look through this list and I found
some systems with modern gpus and uh
if you find systems around like four
petaflops of fp64 with modern gpus they
have around they have around 60
petaflops of B float 16 performance and
those are around like the 175 certainly
above the 200 Mark so in terms of B
float 16 performance we're somewhere
comparable to like 175 to 200 on this
very narrow axis at least and um
uh
just for B float 16 performance and if
they have modern gpus some of these are
like all CPU systems and just you know
not really comparable at all
so the high level specs we use about 205
kilowatts of power when all the servers
are running uh Full Tilt we have 588
5088 CPU cores which is actually a very
small number uh we have 640 gpus some of
the gpus we've got all the hardware some
of the gpus are still being installed
but that's what we have uh in the room
just not quite some of them aren't in
the servers yet
and 2.1 petabytes of solid state storage
so we have kind of two classes of
servers in this system we have servers
that train the models and then we have
what we call rollout servers that feed
the trainers so the trainers
they each have eight gpus
um
that's 2.64 petaflops of v-float 16
performance combined for all eight of
those they have a hundred gigabit
Ethernet and 400 gigabit infiniband so
the the 100 gigabit Ethernet is
basically feeding data into the servers
and the infiniband that's to sync across
the servers so one of the things that we
do now that we didn't really do before
is we often train models on multiple
like train the same model on multiple
servers at the same time so we have this
massive bandwidth to sync data between
the gpus on our trainer servers
um
so yeah we spend about 25 000 on each of
these servers and for the trainers we
generally buy new hardware
um
to get us the you can actually generally
get the most dollars per flop
um buying some newer stuff
so the rollout servers they are these
two EU servers that look like this they
we we shove two gpus in them
um
for running models they have 238
teraflops of B float 16 performance then
we have another two gpus for decoding
frames I'll talk about that more a
little bit later here
they have 20 gigabits of ethernet uh we
have 100 of these so they don't need
they don't need massive ethernet
connectivity and then some of them are
part of our distributed file system that
stores all our driving data
um if they do they have this 40
terabytes of storage currently you can
kind of see in the picture here up high
they have some disk drives in them down
low they don't so like those top ones
there are are there we have dual purpose
rollout servers they're both part of our
distributed file system and also for
rollout
so the 2500 that we spend per server on
these servers doesn't include the
storage
um that's just everything else that's in
there we build these so cheap because we
uh we buy all this I think everything in
these servers is used except for the
disk drives I guess
um which isn't in that 2500 anyway
so that distributed file system that I
was talking about it has all of our
driving data that we use for training
the models
um
So currently I looked and we have 3.84
million segments what we call a segment
is a one minute clip of driving it has
both some video files and a log file for
each segment and we store it in the key
Value Store our distributed file system
is this key value store called mini key
value I talked about it in great detail
in my talk two years ago if you're
interested in how that works but yeah
it's basically a key value store that we
wrote that's super simple we looked at
all the other options and they're like
crazy complex and we just needed
something super super simple it's less
than a thousand lines of code
that driving data uh
it's from 11 000 unique devices so we've
got a lot of we've got a pretty good
amount of data diversity now we
generally have I don't think we've ever
been limited by data diversity up to
this point at least
um so 11 000 devices is basically like
eleven thousand Vehicles 191 platforms
or or types of vehicles uh
cover those 11 000 devices and uh 66
countries there's a lot of there's a lot
of data from a lot of different
countries when we build our training
lists we kind of pick a slice of this
data like the best slice because we
often do things like say oh well most of
our data is from the us but we also want
data from other countries and so forth
we want to keep things like balance so
um so yeah we kind of slice and dice it
and uh
take a subset of all this data to build
our training lists for training models
for open pilot
so the first step or kind of the the
start of the data flow through the whole
training process is reading those video
files uh those video files are you know
recorded on their you know real people
driving their uh driving their commas
their common devices
um the common devices encode that video
in h.265 and one of the first things we
need to do is decode those frames
um and so part of the reason that our
our rollout servers have both two gpus
for running models and two gpus just to
get more decoders is because we need to
decode we need to do so much video
decoding of these h.265 files so that
whole that whole rollout system that we
have can decode 300 000 frames per
second uh and then so that's mainly the
uh the two gpus two gpus with used for
decoding then those frames feed into the
models that are for example our
simulator
and those uh those gpus in the rollout
servers they can output 200 000 FPS once
we get all the gpus up in all those
servers
the models that we train for open pilot
that actually output the plan for open
pilot
um it's a kind of a two-step we train
two models basically is what I'm trying
to say for that uh the the input to
those models is like the road camera the
frames the first model the vision model
takes in those frames and outputs a
feature vector
so that's one model we train that Vision
model then that feature Vector is input
into the policy model and the policy
model
um takes in the feature vector and
outputs the plan that openpilot executes
so just to give you an idea of what the
size of these models are the vision
model which takes in frames outputs
features it's two efficient Nets at
21.47 million parameters and to give you
an idea of the speed up we achieved by
moving from the old office to the new
office
basically we went from 12 hours in the
old office to four hours in the new
office so
quite an improvement uh really increased
our Ripple time which is great so that
was the first Model the second one the
policy model that we have to train
that one is an MLP with 5.3 million
parameters used to take us 21 hours to
train now it only takes us seven so now
we're like 11 hours now to train the
models that we need to train to ship to
ship open pilot so that's pretty cool
so uh we did a pretty good job 1.5
million is pretty cheap for everything
we built
um the super computer that was like the
closest in that top 500 list that gave
similar performance
um that's like a minimum of
3.75 million dollar computer for sure
and that doesn't include like the
building or you know like all the the
power and ventilation and so forth that
we that I included in you know we spent
on ours so we did pretty good in terms
of dollars per flops but we can do a lot
better and uh you know maybe in two
years my next talk is going to be
talking about the tiny boxes in our data
center we'll see
any questions
what's up
yeah so the question was uh are we like
unique in running a high temperature
Data Center and he mentioned that like
in Iceland they like do stuff uh
different you know kind of different
steps I've definitely heard of like high
temperature Data Centers before I don't
know like what my background is not data
centers I was a web I was a web slash
application developer before I worked at
comma who migrated a big company into
the cloud worked on cloud infrastructure
at comma and said wow this is expensive
and stupid we should buy more servers
and that's how I kind of fell into this
so
um so I don't have like industry
experience on this but I've definitely
read about other high temperature data
centers what temperature that is I guess
I'm not really sure and I'm sure they do
it for dollar reasons
um but uh yeah it definitely works I
mean I don't know why baby I don't know
why I don't know why people baby their
servers so much I guess the like our
reliability in terms of uh temperature I
don't think we've had anything dude
failed due to temperature in any if
anything all our failures were due to
corrosion and the only way we get
corrosion is if it's too cold in our
data center so
uh so yeah
uh go ahead yeah you're so awesome
thank you
hello I have a question regarding word
usage I noticed that you mentioned the
word data center quite often and I was
watching the geohots podcast with Lex
Friedman a few weeks ago a few days ago
and I noticed that he was reluctant on
using the word data usage because
you guys don't have air conditioning you
guys have fans and yeah so he said it's
not a data center because you're using
fans so my question is what are your
thoughts on this but also second case
did you do any cost analysis on fan
usage because you use really big fans
versus Air Conditioning ah yeah so I
mean
some cost analysis to you know know like
I knew what it was going to cost to buy
air conditioning units that we're going
to do you know 200 what was it 205
kilowatt cooling 200 kilo 205 kilowatts
of power consumption you know because
that that all turns into heat and that's
like crazy expensive uh now we bought
big fans
um I found like some models that said
like if your temperature difference is
this many C you need this many CFM you
know exchanged to uh you know bring the
temperature down this much and so forth
so I kind of ran some rough numbers
bought fans considerably bigger than
that I think uh and then felt safe that
it was going to work and uh yeah
is that your only server room or what do
you have for backup solution in case
like there's no power in San Diego for
like three days yeah so I didn't really
talk about our production facing
infrastructure this is all for research
so anything production facing is in uh
is in a cloud provider we use Azure for
uh for our customer facing
infrastructure this stuff it'd be really
annoying if this stuff went down but uh
we're fine with you know some
reliability issues and basically we
exchange uh you know part of the reason
that we can do this so cheap compared to
the cloud one of the reasons we don't
run this in the cloud and we can do it
so much cheaper is because we're not
striving for some crazy number of nines
uptime I mean we are but we'll accept
some down time to save massive massive
amounts of money
um and but we can you know like I don't
know how much downtime we've had I guess
I haven't really calculated it which
obviously means it hasn't been a problem
so uh
so yeah I guess uh
yeah we don't run it in the cloud
because it's too expensive compared to
what we've done uh
and we know that uh
we know that like the our return on
investment is you know if you include
like the cost of the room and everything
uh just for the servers it's like six
months or something like that that we
that we are better off so with the room
it's longer but still it's uh we know
it's way cheaper than the other
alternatives
so um I have a question regarding the
evision model but what do you use to
supervise this efficient night I don't
know the answer to that
uh but the research people would you
should find your scene or someone or
Harold he's speaking next okay yes you
should ask that question to the next
person
I have a question regarding the gpus
that you use it seems the server is very
cheap yeah yeah so what's the what's the
GPU used for the training and what's for
the inference yeah so for training the
cheapest dollars per flop
whatever that is that's what we buy for
training we need the most dollars per
flop you you know what you tell me
because if you find something better I
would love to know and I want to buy
them
and then so that and then you asked also
for the for the rollout servers so that
we actually need the highest uh memory
bandwidth per flop uh because uh we run
much bigger models
um and so the models don't fit in cash
and when the models don't fit in cash
you end up memory bandwidth limited
because you're running batch size one on
your rollout so for those it's the
cheapest memory bandwidth per flop yeah
I also have another question regarding
the training of the of the model it
seems like there are two models the
perception model first and then there's
a policy model yes and I thought it's
it's end-to-end training should be so
how how's that how do you train these
models separately you should shouldn't
you do this uh end to end great question
for you seeing the next person
save that one
we got a few more questions
uh so you mentioned it takes uh four
hours to train the vision model uh do I
mean the whole training process or just
the one apple of the model
what was the first part uh you mentioned
it takes four hours to train the vision
model yeah seven hours to change your
MLP model so it doesn't mean does it
mean the whole training process or just
about epoch oh the whole yeah the whole
training process oh the whole Chinese
yeah yeah that's cool yep
those models are fully trained in in
that many hours
and ready like potential candidates to
ship well I guess they have to be merged
and tested and all that stuff but
hey uh first quick uh uh a quick comment
on the hot data center thing why don't
more people do that I did actually ask
this question by happenstance one of my
old tech leads and he said will it be
too hot for the people in the data
center yeah that was his answer it is
hot in there yeah it's pretty yeah yeah
sometimes it's cold in the rest of the
office though it's actually it can be
refreshing when you walk in there
uh
I mean yeah I'm not really sure
I think a lot of I think it's becoming
way more common I I swear I've read
about some Microsoft data centers that
are all fans and like if you look up
like fan walls you'll find data centers
that have like a giant fan wall
um I feel like that's like kind of Gone
by the wayside now and that was like a
multi-year ago thing now and they're
doing something else but it definitely I
don't know I might even be like a
generation behind there's like better
stuff now probably
wow well I do have an actual question
for you which is
um that was very interesting I will look
up a fan wall
um I want one but
um better than a plant wall
what's uh has anybody that you know have
achieved a lower all-in cost per
petaflop for training and then you guys
again I don't really have any experience
in like uh industry
infrastructure like server Data Center
building stuff so I really don't know I
think a lot of this information is just
not public either
okay
okay so we're 2x under anything else
George has seen uh I guess we did a good
job I just did the best I could do uh
and I always tell people I don't really
know what I'm doing so I guess you know
why you know why it's so good it's
because this is our third data center
right so we iterated
yeah we think this one is good but two
more and it'll we'll be saying this one
was horrible I'm sure
going back to temperature so you said 50
something degrees Celsius was about as
hot as it gets do you have any idea like
what you're seeing on the actual die I
imagine it's some number oh uh I mean
the gpus they throttle it somewhere
around 88c on the gpus something like
that
um
I'm sure the exhaust gets above 60 but
then it expands out into the room
so
yeah I'm not I'm trying to think of any
other temperatures I know yeah that's
that's the best I can guess
we got time for one more question
anyone there's someone up here oh thanks
Greg
so thanks for the talk
um how long does it take to put up a
supercomputer do you have to do it in
stages or just
uh how long does it take to what the
super computer
uh to build it no boot
oh they start you power everything off
and then turn back on how how long does
it put most of the I mean most of the
servers Boot and are ready to run things
in I think under three minutes we're
actually talking about like saving even
more on Power by shutting off like 40 of
them and then like turning them on uh
when they're needed so individual
servers they take like three minutes or
so and yeah they all start in parallel
so it should be
on the order of minutes single digit
minutes
got one more question
uh real quick uh percent wise like let's
say on a 30C day what percentage were
you running your uh your your fans at
and do you run the exhaust and then take
fans at different speeds uh so sometimes
we run the exhaust fans and we don't run
the intake fans and so part of that is
because
um
you saw like there's like baffles on the
fans and they're just uh they're just
like mechanical baffles so we need to
run the fans fast enough that the
baffles open up so there's kind of a
minimum fan speed that we need to run
the fans at uh so we don't run them all
at the same speed we kind of support
using them in a staged manner to uh to
get like a lower airflow than if they're
all running at low speed so for example
like sometimes we run the exhaust fans
and we don't run the intake fans and say
they're running at like 30 percent uh
that's that's somewhat less airflow than
if we run the the exhaust fans and the
intake fans at
um at that 30 so uh so yeah we kind of
do that but generally that we're doing
that because the humidity is getting too
high and then we also have the
recirculation going on that's helping
raise it at the same time basically and
then real quick I know y'all said you I
know years prior you had a data sales
thing like for like 200 000 a month did
anybody actually buy it I'm not aware of
anyone no
as far as I know no one's ever taken us
up on that
we do sell a lot of meetings though
all right thank you so much Greg yeah
yeah thanks a lot
all right we've got two more talks for
you guys we started you out in our big
achievement last year we took you
through open pilot uh you saw our new
hardware how we build it you learned a
little more about tuning and we're gonna
round out the comma side uh in research
um and then Jason one of our most
prolific Community contributors is going
to talk about the work that he's been
doing
um
this you know sometimes they say hard
problems need a lot of uh phds
um this is Justine he's our PhD doctor
you seen everyone
all right hi everyone
my name is Yasin I work in research
comma and uh who's excited about some
machine learning
whoa yes
I heard that I haven't started
presenting yet and I already have some
questions so I guess I'll answer them
later don't forget
so uh today I'm going to talk to you
about our progress in learning a driving
simulator
um so it's been a few months of of this
project and we have some exciting
results and I would like to talk to you
about them
before I start I would like to show you
approximately where we're heading after
this presentation so as you might have
guessed none of these videos are real
all of them are imagined all of them are
are predicted using the machine learning
model
of which we give a few frames of context
and then ask the model to predict the
next few frames in here about a minute
of frames
and uh
yeah as you can see the videos look
pretty good
um the temporal consistency is pretty
good too
so this is a minute of rollout as I said
they exhibit some really nice properties
you can see that some Physics is learned
some some great Dynamics is learned as
well for the night videos you can also
see that the lighting looks pretty good
which is something we really care about
and I'll come back to this slide after
we're done but pretty much by the end of
this presentation you should pretty much
understand how we built this and why is
it useful to us and what are our next
steps
but before
let's go back to the basics
why do we even need a simulator
Harold talked about this this morning
we've talked about this two years ago in
the previous Comic Con why even a
simulator
without a simulator the driving model
will never be exposed to any kind of
significant noise or any kind of
significant deviations especially the
noise introduced from its own mistakes
so
if we train a model outside of a
simulator without a simulator what's
going to happen is if you end up outside
of the center of the lane the model will
always say
um just keep doing whatever you're doing
and recover later we'll cover in a few
seconds and the next second it will also
do the same thing you also say yeah
you're pretty good just just keep going
and then recover the center
um in a few seconds
and
the result of this is what you see in
the bottom video it's basically a model
that doesn't recover to the center of
the lane and just drifts outside of the
lane
so this is a problem and we need a
simulator for this
now a good question to ask ourselves as
well is why not a classical simulator
why do all these complicated things why
not just build a Unity or an Unreal
Engine simulator a GTA 5 kind of
simulator and why not just do that well
I'm not saying that this is a bad thing
these simulators are good for testing we
want them we want them for testing
because they're good for you know the
deterministic they're fully
you can build whatever you want you can
build whatever scenario but we want to
use this for training and training it is
a whole different Beast first of all you
need to match the training distribution
you need to match the real world
distribution of driving data and what is
even that how do you even quantify that
and how do you even know that you did
that you matched the real world
and even if you try to do this you would
actually need to hard code a bunch of
scenarios a lot of them and every day
you'll just be building a simulator you
never do self-driving just be building a
simulator and that's not really a
business that we want to be in
um so as you understand as you might
understand this is not a scalable
solution you don't want to be
hard-coding simulators for training at
least
so we came up with this thing called the
small offset simulator and Harold talked
about this this morning as well it's
basically a simulator in which we shift
the image a little to the right a little
to the left a little to the forward a
little backward to simulate little
movements from the original position and
when we train the model in this
simulator in closed loop we actually see
driving we see a model that recovers we
see a model that stops for stop signs
which is a model that stops for red
lights and this is quite amazing so this
is a small offset simulator and that's
what we've been running with for a few
years now but as
you might have guessed we're trying to
go past it so why are we even trying to
go past here what's wrong with it
well Harold hinted at the problem this
morning which we call cheating
so in order to have a very good
simulator of the sort of this small
offset simulation you want to have
really good ground truth you want to
have good highest estimation good road
plane estimation good pose estimation so
many good things they need to be pretty
much perfect and the problem is as soon
as you start to get some imperfections
some error you will have
similar artifacts and those artifacts
can tell the model which which way you
came from or how to how to drive
basically so the model will learn how to
drive just by looking at the artifacts
instead of learning how to drive like a
normal human being
and trust me the model knows how to
cheat
so this is the first problem
the second problem is well it's in the
title it's a small offset simulator it's
not a big offset simulator so as as long
as as soon as we try to do some kind of
big offsets you can see that the images
look very funky and they really don't
look that good you don't want to drive
in this world
and that really doesn't matter for
lateral that much because you don't
deviate so much left to right while
driving laterally but alone should know
this makes a big difference at highway
speeds plus minus 10 miles an hour it's
really a big distance so you really want
big offset Simulator for launcher no so
this is it this is our state right now
and why do we want to go past it so how
do we do this well
I'll tell some history here in 2016
adder and George wrote a paper called
learning a driving simulator and I stole
the title of my presentation from this
paper
um you don't have to read the paper you
can read it if you want but I'm going to
basically explain what the paper is
about today
the paper basically described what we're
doing now is just read 2016 Tech you
don't want to be doing 2016 machine
learning we want today's machine
learning 2016 machine learning sucks
this is what what 2016 machine learning
give you and
as you saw the first slide 2023 machine
learning is a lot better than this
so
what's an ml simulator so we're trying
to build an ml simulator
and ml simulator is basically three
parts three components
and I'm going to go into each component
separately and explain what it does and
yeah by the end we'll go back to our
first slide so three components image
tokenizer a post tokenizer and a dynamic
Transformer I will explain every part
separately
so an image tokenizer is basically a
fancy image compressor it's an ml image
compressor that takes in images and
compresses them into a set of tokens now
what's a token a token is just a fancy
name for a discrete number a number that
can only attend a small set of values
from a dictionary so
taking images images with a lot of
pixels then encodes them into this set
of tokens that are discrete usually
these tokens are not too much 128 512
tokens and then with this tokenizer
usually comes a d tokenizer or an image
decoder that can bring you back to image
space and in which you can see what you
actually compressed and then compare it
this model is trained with the Gan loss
with a generative adversarial loss and
this is what is usually referred to as a
VQ gun
so yes this is a our image tokenizer
and in this slide
I show from left to right a source image
an image compressed to 5820 bits and an
image compressed to 1280 bits
so I want to point out a few details
here that are that are pretty
interesting uh do you notice this es
logo here
notice how it's a little funky around
here but it's still some red things
around that area but notice that the
1280 bits just completely forgot about
the CVS logo you don't really need that
why do we need logos in life
you can also notice that the building a
little at the distance here looks okay
for the 512 for the 5 1200 for
520 bits image but the 1280 image looks
pretty funky the traffic light also
looks a little funky so yeah these are
completely classical compression
artifacts that we get here
um so the image this image is there's a
lot happening there's a traffic light
there's a logo there's buildings so it's
a complex image
for a pretty classic highway driving
image you really can see the difference
this looks really similar to me and so
for highway driving either 512 or 1200
that really doesn't make that much
difference and in order to iterate fast
so we want to iterate fast and we know
we can improve the quality of our
simulation by just scaling up the number
of bits in order to iterate fast do some
good experimentation we're working now
with this with this model but we know
that in the future as as our models
improve we can always scale up and get
better simulation so for now
128 tokens 10 bits each
now what's a post tokenizer what's
supposed to start with the oppose is
basically six floating points numbers uh
they're six degrees of freedom basically
your X speed y speed Z speed and then
your roll rates pitch rates and uh your
rate so we also need to
tokenize these numbers uh just because
of the next component that I'm going to
talk about but trust me we need to do
that and we tokenize them with a very
simple tokenizer we basically need to
digitize them or to quantize them so we
just digitize them with the uniform
bidding very simple nothing fancy here
um
now to the beefy part
the Dynamics Transformer who knows what
a Transformer is
yes who's used shot GPT
same people some people more people I
see you cool
so yeah Transformer is is basically the
same architecture as a large language
model gpg llama these kind of these kind
of models
for large language models a token is
roughly speaking one word a sentence is
a set of tokens and the document or
paragraph is a set of sets of tokens for
us an image is a set of tokens a video
is a set of images so a set of set of
tokens and we train it with the same way
the large logos models people do very
nice loss function cross entropy predict
the next token
so very similar to large to large large
language models this is
this is the architecture of a
transformer for those who don't know
what a Transformer is it's basically a
fancy machine learning architecture
that's a stack of fully connected layers
and attention layers so just a black box
of a machine learning architecture
so we use this Dynamics Transformer uh
one token at a time so it's Auto
aggressive sampling uh each time we ask
the model what is what do you think the
next token will be we take that token
plug that back in in the inputs then ask
ask it again what would be the next
token plug that back in in the inputs
and do this until we reach a number of
frames these number of frames will give
us a sorry this number of tokens will
give us a frame we take that and then do
this as many times as we want until we
reach whatever number of frames we want
so this is what people usually refer to
as Auto aggressive sampling
Auto aggressive sampling so predicting
each token at a time so in theory doing
this is really powerful because you
could cover the whole distribution of
your training set
um so you could cover the whole
distribution of possible rollouts given
given a context given a few frames this
could imagine any type of Futures which
is really desirable because you don't
want to restrict whatever happened next
whatever the driving model that will be
trained in this simulator you don't want
to restrict it to something specific you
want it to be as general as possible and
this is really desirable we tried a few
things
to speed up this Auto aggressive
sampling so it's a little slow we're
trying to speed it up we're trying
something that division like sampling uh
some fancy techniques for Mass good and
things like that but we didn't really
succeed at anything like that we'll keep
trying and something will will work and
we basically want to speed up the other
aggressive sampling which is a little
slow
so we do all this and it works
this is our
Dynamics model this is our simulator
so in here we just show it we just tell
it to drive straight
and as you can see drive straight
um
it's a pretty nice Highway drive
straight driving
but we can also ask it to do some things
like yank the steering wheel to the
right turn right as much as you want and
as you can see turns right changes Lanes
even goes out of the road even drives on
the grass that's pretty impressive
I guess some people did that in the
training set
who did that
you can also tell it to turn left across
the median drive in drive to the
opposite lane even get close to oncoming
traffic who did that that's okay I don't
want to know
you can also tell it to accelerate so
notice the lay lines it passes the
traffic it passes some traffic so as you
can see there's some acceleration
happening in this in this rollout
you can also tell it to break so again
notice the late lines they will slow
down
so
as you can see successfully breaks
and as a side note we open sourced all
this open source a data set of a hundred
thousand minutes of driving tokenized so
these are all tokenized with the
tokenizer that I've showed before we
open source the image tokenizer and the
image decoder and we also open sourced a
Transformer that's very similar to the
one I'm showing you today and that can
generate rollouts that look like the one
that I showed you today
we also have two one thousand dollar
bounties so if anyone feels
um feels like a weekend project
we want to decrease inference latency we
want to make this model run fast today
they run at 2fps so we want to run them
really fast
uh so if you improve the training
latency the interest latency by 50 you
get a thousand dollars and if you
decrease training loss by five percent
you also get a thousand dollars so if
anyone wants a weekend project really
fun
another side note
um and so I've been showing you all
these images that went back to image
space so these videos that look good
it's always good that we can go back to
image space and debug these Dynamics
these Dynamics models and see what
happens but in order to train a driving
model we actually don't need to go back
to Vision space you don't need to go
back to the image space you can drive
you can train the model directly on the
tokens
which is interesting so these images are
compressed to these tokens and these
tokens have everything you need to know
to drive which is pretty cool so instead
of having like a convolutional neural
network that takes in an image and
predicts the plan and predicts the lay
lines and such now we have a Transformer
and then you have a plan and the
landline and all that and as you can see
here
it works it predicts the landlines
predicts the plan uh predicts some
reasonable outputs so you don't need we
don't technically need to go back to
Vision space in order to train them all
we can directly train it on tokens which
is pretty nice
another side note is that you've noticed
that the images are a little flickery so
they jump a little bit the clouds jump a
little bit the clouds jump a little bit
so and we were aware of that we know
that our encoder is not smooth and
that's because our encoder is frame by
frame there's no temporal consistency
because there's no nothing that's
trained temporally so we want to fix
that then there's multiple ways you can
fix this we really want to have a
tokenizer that's video based that's not
image based what we're doing now is a
little naive you don't want to do this
frame by frame you really want to do it
for a set of frames to get some more
some more quantization you can get more
compression if you compress multiple
frames but there's a technique that
people have been trying and we tried
that as well is to have
a to just freeze everything and then put
a record layer in your decoder which
essentially gives the the decoder like a
state that get passed from frame to
frame and the decoder can use that to
smooth the rollout so as you can see
here in the left is the raw rollout and
to the right is the smooth rollout so
much much smoother
so this works
um another side note is okay how do we
use this to train how why and what's
what what was missing for us to use this
to train
um we need a new loss function and why
do we need a new loss function well for
sufficiently long rollout the simulator
is going to imagine things that were
never in the context right this it's
going to imagine traffic lights is going
to imagine turns it's going to imagine
curves on the highway and these are
going to be very far from the context
because we don't condition on anything
we just tell the model to imagine
something
so the human path that we have been
using so far to train will be Irrelevant
for sufficiently longer rollouts
so we need to come up with something new
we don't exactly know what to do and how
and how to do it but the idea is going
to be something close to like a value
model that like either a gan loss or
something like uh like something to
minimize these engagement or something
to basically another model that's
trained separately that quantifies
whether you're roll out to whether
you're driving is good or not based
based on based on the rollout that
you're showing it so something like a
value model as a loss function instead
of just Mae that we've been using for a
long time
so
what are the next steps
a few weeks ago we tweeted sorry we axed
we asked the video of our simulator
and the response some of the some of the
comments were funny but most most of all
they they really show what we need to
work on and what we actually work on so
I'm going to show some of the comments
the comments on the comments
Harrison really wants to play this he
says please let me play it we want to
play it too it's really fun but as I
said it's at 2fps you don't want to play
a game at 2fps so we really want to make
this faster
and that's something we're currently
working on we have bounties on it and
yeah we just want to make this faster
John said there is a left turn on red
and
this person said oh this is a green
light
and we know we know this we can see we
have eyes too uh this this potato
quality image and as I said this is 128
tokens 10 bits each so we know there's
compression artifacts but in order to
move fast in order to experiment faster
we're using this now we'll scale up for
when we have either better uh video
tokenizers uh better sampling strategies
so we will scale up uh we just need to
work on these problems first
Leo said I feel like building the
simulator is not that hard
trust me Leo
[Laughter]
Leo we do things not because they're
easy but because we thought they were
easy
so this is basically what I've been
talking about uh
the auto aggressive sampling
using yeah using actually using the
models scaling the bits and scaling the
Transformer as well and we need better
video tokenizers
so going back to this slide these uh
these beautiful rollouts I'd like to
point out some nice properties uh look
at this lead car here where the the the
headlights turn on when it stops and
then they turn off when it goes on so
it's pretty nice
uh some of these rollouts are actually
really good how do you know if this is a
fake video or not this looks really good
this one as well looks quite nice
and this one the model takes an exit
and uh this one the model takes a does a
lane change then takes an exit which is
quite interesting the Night videos also
look good look at these lights light
Hollows that look really uh really uh
realistic
again fancy buildings
weird weird looking buildings as I've
shown in the tokenizer slide and this is
really because the tokenizer is terrible
but yeah you can see the building moved
like it's a really good physics
understanding The Prompt of this image
has the cables and some people don't
hide the cables from in front of the
cameras which is not a big problem but
you can see that the cable stays there
pretty consistent in the frames
this one here it's a Snowy Road and the
snow persists after the rollout so the
snow is still there at the end of dorola
which is really interesting
and this one the model just want to stop
and takes a picture I guess of of uh of
the surrounding I don't know maybe a
Mountain Road or something
so
yeah this is this is it this is Drive
GPT
any questions
but you see we know there's lots of
questions oh yeah I forgot should we
start with those who are the people who
had the two
you've seen questions before
over here
all right
so you mentioned that you can get like
an initial image and then you can also
say that move straight or like move
right so are you conditioning on
language at all like the tokens
um okay so we don't condition our
language uh I was talking about the pose
which is the six numbers six numbers are
essentially moving so that your speed
lateral speed longitudinal speed and Z
the z-axis so those are the the numbers
that we use to condition the model to go
left or right or to go faster or slower
so we have those number baked in the
model so those are special tokens call
them the post tokens and those are used
to condition so we can either let the
model Go free falling so the model also
also uh predicts those tokens so the
model knows which are the most likely
next pose so we can either run the model
with those and we'll the model will be
unconditioned so we just use those from
the model or we can just go in and say
tell to the model no no no this is not
what we want we want to go right and
then put those tokens in and the output
of this thing will be a conditioned
video
is the answer the question
do you have a question here
well
great question
here
awesome talk thank you um I have a
question about the bottlenecks in your
pipeline what's the like top bottlenecks
in pipeline to inference it for real
time
so these models are quite big even
though they're not as big as GPT and
llama they're they're a little big and
we're currently bottlenecked by software
we're not reaching
Ram bandwidth or not even reaching flops
bandwidth so we're just really
bottlenecked by good software
inferencing GPT models Transformer
models currently we just use Onyx which
is a pretty standard inference engine
and there are some fancy ones that are
coming up and yeah so currently we're
bottlenecked by by software
um
when we reach the limits of the software
we will probably need either to uh to do
some tricks on the architecture to make
it faster or
just use more gpus
all right
thanks for the talk
um So eventually maybe these uh rollouts
will be at least human indistinguishable
from real rollouts yeah
um what applications open up when you
get there
so the first application we see here is
really learning the learning in this
driving simulator so we want to use this
we replace completely replace our small
offset simulator and the driving model
is basically going to live in this world
uh it's going to drive around go grocery
shopping go to the movie theater and
just learn how to drive in this in this
in this driving simulator I mean other
applications might pop up I don't know
like a game or something but uh but for
now we're focused on learning a driving
model in the simulator
um
are you worried about uh using too much
of this learned uh simulation in your
models and causing a model collapse
a model collapse
um so I guess you're uh
referencing
um
training on intuitively training on
models and that would cause a model
collapse well that happens
we have proof that this happened for
models that are similar so let's say you
train charge gbt on charge gbt data on
charge TV data and you do this
iteratively the model will collapse it
also has been showed to exist for image
generation data as well but the models
that we will train here are very
different this model that's a simulator
is going to
um is going to basically learn how to
imagine driving data but the model that
we'll train on it is a completely
different model it's a model that learns
how to drive so these will be very
different and we're not going to do this
iteratively there's going to be just a
one-step process and we will improve
both of the models uh independently but
there's not going to be any any
iterative process so we are aware of the
model collapse but we don't see it as an
issue for now and yeah let's answer your
question yeah
I have two questions one do you consider
your mask or to includer that can
compress about that in the person
of the unity and the second way is you
talk about a video encoder
if you use a video incredible then
forward to the
Transformer model
it should be output also on video as
well is that correct
yeah so your first question was about
mass auto encoders and that's what I was
referring to as mask kit or similar
approaches to train image tokenizers and
such we tried
um it didn't really work that well
but yeah it didn't really work that well
what worked well is the cleanest
solution the most obvious one worked
well we tried to go fancier and it
didn't work so I guess there's something
to learn here uh then your next question
was uh can you repeat your next question
I forgot
you have a video included that means if
you put this
audio encoder the code
to the Transformer okay if you go to the
forward it should be General every token
is a video is that correct uh so what
what I've uh was referring to as a vid
as a video decoder is something close to
like an INB frame uh kind of tokenizer
so some different types of tokenizer
what would be like a like a general
iframe and then a p frame that's a
smaller set of tokens or smaller
basically more compression in the diff
frames so this is what I was referring
to as a video video encoder but again
this is something we haven't done yet
and uh I guess we'll we'll see we'll see
what will work and we'll see what other
people are trying and try to try to
navigate in this in this research area
um is the
so it uh is it is the output from the
simulator only is used to train the
policy model because the way I
understand there's two models there's
the vision which is like efficient net
B2 and then the uh policy model okay so
you're you're one of the questions from
before right
no no okay so I I guess I'll answer both
questions uh there was one question
before about why we say there's two
models while we also say that we're end
to end uh so there are two models and uh
when we say we train end to end uh it's
because these two models really have the
same loss function these two models are
pretty the same thing these two models
predict what is the plan and then
they just predict the plan when this is
the only thing we use we use the plan
from the model the visual model predicts
the plan and the policy model as well
breaks the plan now why do we need two
models we need two models exactly
because we need a simulator so these two
models are living in two different roles
division model lives in the real world
and the policy model lives in the
simulated world so we did the split
because this model needs to be trained
in different worlds and
and yeah so we're still end to end
because we're not using any bounding
boxes we're not using any perception
kind of layer that says or these are
these are traffic lights and such so um
so yeah I hope this answer the first
question and uh the second question uh
uh yes this uh simulator will so the
policy model will be trained on this on
the simulator but not not the vision
model
all right
hey great presentation
um my question as you as a researcher
I'm sure you know there's been so many
advancements in AI so my question is
regarding
how do you balance researching testing
and you know playing around with all the
recent developments in for example
tokenizers that's the topic that I want
to focus on you know all the new
tokenizers that come out how do you
focus on testing out and you know
working playing around with all those
new developments from other teams but
also clearly developing your own stuff
since you're a researcher you you wanna
build your own stuff so how do you
balance
so keeping up with with state of the art
is it's pretty hard there's a lot of
things that are happening right now
machine learning is growing very fast
but there's one signal that I've noticed
is that I mean you don't really want to
be the first one to replicate a paper
this is it's kind of a useless thing to
do unless you really is actually doing
it to learn or unless you're doing it to
practice or you're interested in this
personally but replica being the first
person to replicate uh
it's not that that good so you want to
wait for other people to replicate and
see see fill the waters and see if
something looks useful or not and
usually this takes about a week or two
people are very active
and then pushing the state of the art
again uh you really want to balance
being at the edge of state of the art or
pushing it a little far and uh I come
over trying to push it what we need to
push it and there's a lot of researcher
outside of comma there's a lot of people
a lot of labs that are working on the
same problems and it would be good if
they did the work for us but sometimes
they don't so we try to leverage their
work as much as we can and we also open
source our stuff so it's not like a
one-way Highway here we open source our
findings we're at blog posts we will
publish data sets so when we see the
need to push the state of the art we do
it and then we share with people it's
not it's um yeah it's just a little line
that we need to balance but uh but so
far worked great
uh my question is where do the model
names come from what do Nicki Minaj and
Nicholas Cage have to do with driving
great question I don't know if I'm
allowed to say am I allowed to say
Trade Secrets I don't have a lot of
Secrets but straight secrets
I had some questions about just that
tokenizer aspect in general like what
motivates to stick to like these
discrete tokens
what's the motivation between sticking
to like this discrete token
representation versus
um like maybe a more regressive like
doing regression is that just because
like cross entropy loss is so simple and
nice or is there something else and then
a couple more questions about the tokens
is there like some position dependency
on those have you tried looking at like
the interpret like have you tried
interpreting what token 95 means for
example
oh yeah great questions so we tokenized
because cross entropy is the best loss
function everyone knows that
whatever else is uh resist Gap it
doesn't work
but yeah cross entropy is the best last
function it's really simple uh it's uh
yeah I can talk a lot about why cross
entropies is good but it's not really
the The Talk today
um
the next question was about interpreting
the tokens so these are like visual
tokens so you can you can like feed an
image of just token one one one one one
one and then see what the decoder says
and these will be like basically colors
or basic uh basic um the patterns or you
know zigzags and stuff like that edges
and things like that so these are visual
patterns and they have they do have
positional information
um and uh the Transformer has a position
encoding as most Transformers but I
heard that we don't really need these
positional encodings but we still have
it but yeah they have we can interpret
them we can see what each token looks
like you can see if our tokenizer is
efficient or not we can see if like all
token all the tokens have been utilized
and all tokens mean different things so
you can somewhat interpret these tokens
and they have positional information as
well
say driving is very different around the
world I was wondering if you looked into
conditioning on geolocation
um that's a good uh that's a good
question there's multiple ways we can
condition these things we can condition
them on weather we can condition them on
on geolocation we can condition them on
type of car and so on uh we don't really
want to go in this detail we just want
to build the most General simulator
possible if someone wants to condition
them on on uh on Country if the data set
is open source uh they can they can
condition them on on countries and and
look at data from Venezuela or from
Uganda or anything so yeah we just want
to build the most General simulator we
want to condition it on the least
possible things
thanks for the talk um I was curious I
know Harold mentioned the long-term goal
of comma being
um from going from just cars to broader
areas like robotics so I was wondering
first of all if you plan to use the same
like GPT style simulator and just how
you think it scales to something like
robotics where you have more degrees of
freedom and maybe a different like
distribution of output spaces
yeah great question this is one of the
main motivators of using this simulator
is that it can scale to any type of
Robotics problem
um it has more more degrees of freedom
but we use the very simple post
tokenizers which is MP digitized if you
have more degrees of freedom you just
use a more fancy tokenizer for that this
really scales to any type of of dynamic
of of Robotics problem you want to want
to do and as you can see most recent
robotics
fancy looking Solutions now use
something that looks like this so we're
really excited about how we can extend
this to something outside of driving as
well
hey thank you so
kind of related so I'm thinking about
this scenario scenario say this
is a driving model right so right now I
was saying okay I want to drive from a
and to B for example please give me
please give me the scenario of driving
to the nearest Taco Bell but this is a
language right I'm just curious why we
don't put language as the you know the
first input and generate the you know
actually the driving videos news
yeah we don't really need language
I mean we can condition anything with
floats with floating points numbers
language is very inefficient why not use
something that has a lot more bits than
uh Than Words
um we can condition it on text some
people are doing it
um we we really can do it you can just
connect this to an llm connect this to
Lamas 7B and then put the put the text
and get the embedding and then plug it
back into the GPT that's something we
can do we haven't been doing this I mean
these are really cool demos right the
the code for papers they're fun things
to do we've really been trying to to
make something as general as possible
and yeah again if someone wants to do
this really easy
um just uh you know plug it back with
the Llama 2 and see what happens it's a
could be a cool project
we got one last question here in the
back
cool um could you speak a little bit
more about the temporal consistency
aspects in particular I mean the the
training data is temporarily consistent
so kind of what's the intuition behind
why the predictive model is unable it
like has some flickering and why it's
not able to learn temporal consistency
and then what are the core ideas between
like I know you had a slide on it but I
didn't quite understand the core ideas
that enable the loss of flickering Okay
so
let me go back to it
it's it's it's going to be white light
mode
um so why does the model not predict
Smooth video on its own uh well because
the data is not smooth the data it's
trained on is tokenized frame by frame
so the data that the model is is trained
on isn't good it's flickers so even the
ground truth data of this model flickers
and it's flickers because the tokenizer
is frame by frame it doesn't have any
temporal memory it doesn't have any
smoothness to it it's just frame by it
just it just it flickers and I mean a
good question would be why does it
flicker why is it not pretty smooth and
it flickers because just compression
right we're asking this model to really
compress this really hard
um so it will Flicker and we notice that
the more bits we use the less flickering
we see so this is to answer your first
question uh why does it flicker then uh
the smoothing decoder basically is just
sticking an RNN layer just sticking a
layer that has a memory and at each step
we share that memory to the next step
and then doing this we we have like a
running State and doing so the decoder
has more information now and knows how
to smooth the decoder didn't have that
information before I didn't know what
happened a second ago didn't know what
happened to frame ago so it couldn't
even smooth now it can smooth and as you
can see it works
does that answer your question
okay all right give it up for your scene
thank you
one last talk some of you may know him
as Jay Young his name is Jason uh he's
gonna up give you an update on a blog
post we wrote
um called how to Port your car uh and
there's probably no one better uh
[Music]
he's been working all week porting a
Golf GTI
um
gorgeous
all right almost 40. uh so I think that
deserves a round of applause in and of
itself
kind of amazing we really appreciate all
the great work you do
I'm gonna give you guys a few updates uh
after Jason's talk there's gonna be a
happy hour soft drinks are included if
you want a harder drink that's on you uh
there's a bar down here
um we have games
we will have dinner there's snacks in
the back if you still haven't picked up
your merch it's upstairs waiting for you
if you'd like to buy a comma t-shirt uh
find me
um
thank you all so much for coming and
listening to these talks and asking
great questions we really are so happy
that we have such a great community and
contributors and we want to continue to
talk about how great you are at 7 30. uh
we'll be hosting the commie Awards Adib
Shane some of you may know him Shane of
Shane's Fork
um
we will be talking and rewarding the
wonderful contributors of the community
um
so I'm looking forward to that and then
we have
we're gonna have
I'm gonna I was gonna call it giant
chess but it's actually medium-sized
chess
um on stage uh some competitive chess
some games upstairs hanging out
um you know find common team members if
you have more questions I know some of
not everyone's questions were answered
today but if you can find everyone I'm
sure they're happy to further uh chat
and go into more detail
um
we also have some Wonder wonderful uh
contributors here sunny
of Sunny's Fork is here if you have any
uh questions I'm sure he'll be around
um so thank you so much
what's up
I'm sorry what
we can all we can do whatever we want
when the live stream's over and after
Jason
there will be a lot of secret stuff
that's only for in-person uh people
now I expect a lot of carports after
this talk a lot of people say they can
find this information it's now available
so you have no more excuses for
notporting your car
all right
give it up for Jason
[Music]
hello everyone
I'm Jason Young
jn8607 on Discord you may have seen me
and uh you may know me as the Volkswagen
guy
um
I have a very good friend who tends to
go all in on technology Hobbies
um he got us into quadcopters back in
the day before they were popular he went
all in on home automation he's trying to
get us all to build combat robots which
I don't know if I'm going to do unless
we're going to get Billy and silly to
Duke it out here
but back in 2018
he handed me an eon a giraffe
and a gray panda
and he said I bought this but I can't
make it work on my car he had like a 08
Acura something or other
but do you think this would work on that
Golf R you just bought because in the
repository there's this file called VW
mqb do you know what that is
and I'm like
no
but I'm gonna find out
five years later
I'm on the stage of Comic-Con so as you
can see that one kind of spun out of
control
so
in my day job in my corporate life it's
a habit to introduce myself with a
couple of
personal facts usually that personal
fact is
I drive my car with a cell phone but
that doesn't really move the needle in
this room for obvious reasons and we're
kind of past cell phones so my random
fact is the 8607 is my Cisco ccie number
the guy in my Discord profile pic is a
famous actor that's uh played in an old
Volkswagen ad campaign
probably 20 years ago and I've had five
total strangers approach me in airports
restaurants whatever and tell me I look
like Tom Hanks I don't see it I don't
get it I love Tom Hanks I'm flattered
but it's just a thing that happened to
me so that's my random personal fact
So today we're going to talk about how
to Port cars
um
this will be very generic I'm going to
use some examples that are drawn from a
Volkswagen world
but this is not a Volkswagen specific
talk
we're going to start off and talk about
is the car a good candidate this doesn't
mean we can know in advance if your car
will work you're going to have to go
kind of all the way through the process
to verify that but there's some red
flags that we look for
we'll talk about what you need for a Dev
environment
we'll talk about connecting to the car
for the first time reading data and
translating that into something that
openpilot can use
we'll talk about sending messages for
the first time finding the actuator
commands that you're cars Factory Lane
assist camera and ACC radar use
and last we'll talk about the process of
upstreaming cars
so
three classes of cars here
it's a good sign if your car has Lane
keeping assist and adaptive cruise
control those are really minimums for
supporting open pilot on your car yeah
you can hack around it but it's not a
good open pilot experience if you don't
have adaptive cruise and Lane keeping
assist is a minimum and the other thing
is we want to make sure it uses standard
can or knfd networking
bad signs
some higher end cars don't use candle
use something called Flex rate and
Flex rate is in a way that's hard to
explain actually I'm not qualified to
explain it is hard to split open pilot
in the middle of
comma did a hackathon type thing that
actually made this work on an Audi Q8
but I I think they decided it was going
to be a mess and hard to bring to Market
and didn't really proceed with it it is
difficult and right now there's really
no way on the market to work with it
um if there's Automotive ethernet in the
car that's starting to become common uh
in new vehicle designs
right now we don't have transceivers for
that it's something you can buy it's not
hard to get on ethernet itself the
trouble with Automotive ethernet as
manufacturers refresh to that is it has
a strong tendency to come with secure
onboard communication
which is a euphemism for there's
cryptographic hashes on messages that
stop you from messing with things
Flex Ray is just challenging to
intercept
if your car has secoc as unfortunately
Toyota and actually certain VW are
starting to have you actually have an
adversary someone's trying to stop you
from having fun and that's going to be a
little bit difficult so I think both of
those will be surmounted eventually but
they're going to be very vehicle
specific and they're not something I'm
personally working on and
that that's going to be tasked for
someone else
if your car doesn't have any of this
stuff you might actually have an easier
time there's
um some folks that actually bolted a
pout an electric power steering rack and
a bunch of microcontrollers and some
other things into a late 70s Volkswagen
Vanagon
um
now after that was done that Vanagon
kind of identifies as a Toyota Corolla
but
it works so in some ways
that car on the right is actually easier
than this car in the middle
so let's say you have a car that's
likely to work in this case mine or
whatever car that you might have and I
want to be clear that
what I'm talking about here today is
actually not that hard to do
um
if you can spell Linux and SSH you can
go through these Journeys that I've gone
through it used to be a lot harder than
it was but it's gotten pretty easy so
first thing workstation something
running Ubuntu VMware or WSL is fine I'm
about half and half bare metal Ubuntu
when I'm working from home this laptop
running Windows 11 I do the other half
on under wsl2
next thing you need is a comma three I
missed the memo on it not being a Devi
kit anymore
uh so uh comma three or three x and when
you order it you'll order it with a
developer harness which I'll show you in
just a moment
the return window for these guys is
normally 30 days I'm not sure what the
process is but if you're working on a
new car port they will give you a little
bit of extra time and then you'll need a
few basic tools you'll need a diagnostic
tool for your car it's a must you're
going to take off your car during this
process and you'll need to be able to
clear faults and you'll need some
visibility into what's going on and
you'll need some other Basics multimeter
wire cutters crimper Etc
so
when you order from the comma store
and you get a developer harness that's
what it'll look like it looks like
any other harness adapters that they
sell you but there's no ends on it yet
you get to put the ends on it because
whatever ends that it needs the
connector shells and the terminals are
going to be unique to your car
you can figure that out by looking at
the connector cars on your car they'll
usually be a part number on it somewhere
um the one end will usually be easy to
find the other end
is sometimes rough because that's not
something the manufacturer ever has to
supply
in a harness form it's always built into
the camera in a pinch during development
you can make do with generic cart Edge
pin headers but
one way or another you need to take that
and adapt it to your car
and this is how you do it
every auto manufacturer in the US and in
really worldwide will have some way for
you to get access to repair info it's
not going to be free you generally have
to pay for it if you go to irwin.vw.com
as an example but you can do this for
any auto manufacturer you can get a
wiring diagram for any given car and
that'll
you can't really read this and you don't
have to but that will tell you
how your camera is wired up what's on
what pin
you take that together with commas open
harness wiring diagram and that'll tell
you where you need to put constant power
ignition switch power ground can high
can low and optional second can
and any pass-throughs that you need for
like a camera heater or or Fusion bus so
on and so forth
so
let's assume we've made that harness
and we've connected to our connected it
to our car
this is what we need to figure out for
openpilot to work this is a subset of
what goes into car state when you know
how fast the wheels are turning
what the steering angle is what gear
you're in all that good stuff and in
order to learn that we look at Cabana
I promise the next slides will be easier
to read I wanted you to see the whole
window this time but
what you're looking at right now is a
pile of numbers and this looks
intimidating
but
it'll clarify pretty soon by the way
before I forget
um
this tool was made by another comma
external contributor named Dean Lee I
think a deep asked him one day hey do
you want to do something about Cabana
because the web Cabana is getting really
crusty and then you just bang this tool
out in like a couple of weeks and has
been growing it from there and it is a
game changer for reverse engineering can
networks so Dean Lee if you're seeing
this you're the man we love you
oh
[Applause]
so
I'm not going to step through every
single one of those signals I'm going to
take you through three examples of some
of the more complex ones and a couple
tricks of how to find them
so Cabana the deanley wrote will show
you
and highlight bits that are changing to
find wheel speeds you're looking for
four signals that scale with how fast
the car is moving they stand still when
the car is parked and they move
linearly
when the car is driving so somewhere in
that pile of numbers
is Cabana is going to highlight ones
that change in about the same way
times four
so we now know four wheel speeds but
where do they go
get in your car you'll take a test drive
in a parking lot
set your parking brake
and then take off from a stop drive a
figure eight stop and look at your logs
front and back will identify themselves
because
when your parking brake is set and
you're driving a front-wheel drive car
as most folks are particularly the
parking brake set the front wheels will
start rolling first so now you know
front and back
when you drive that figure eight
the outside Wheels
will turn faster
so
as we're making this sweeping tight
right turn the outside wheel
is turning faster
and that tells us left and right so now
we have front back left right we know
where all the wheels are
next you'll do a simple test log for gas
and brake usually I press the gas three
times press the brake three times
take it in look at it
the accelerator
will have a curve that goes up and down
it's pretty obvious it's not an on and
off it's a you'll find a percentage
somewhere you may need to scale it
you'll find a similar signal for brake
pressure that'll be some sort of curve
and it'll match when you're pressing the
brake and by the way there's some
features within Cabana that you can say
for all those signal changes that it's
highlighting
you can say kind of freeze those and
clear those for this little 10 second
time window and just show me the ones
that changed within there
and that'll start making things like
this pop out
and then it's nice to find a signal for
brake pressed
um you can do that in a pinch by just
showing brake pressure above one but
that doesn't work for all cars sometimes
the Signal's a little noisy this ends up
being the source of a lot of bugs
comment chased a lot of these out I
wanted even chain we're doing improved
testing for cars and chasing down
controls mismatches and so forth brake
pressed can come from a lot of sources
uh there'll be a switch on the brake
pedal often there's redundant switches
so you may be seeing those you may be
seeing something from the ABS controller
that says break pressure over a certain
threshold and those are all good but you
might also be seeing something that says
open the brake shift interlock
or if you're driving
this might actually be a brake light
signal which sounds cool until you
remember that your ACC when it's slowing
down also fires off the brake lights so
you want to make sure go ahead and flag
all the signals that are potentially
brake pressed but come back and look at
it and make sure it's actually only
flogging the ones that the driver
presses in
now for steering inputs I've got a
particular way that I like to do this
get in the car
start it up
and
you'll turn the wheel to 45 90 180
full lock and hold it
let go
and then turn it back to 0 45 90.
and that gives you a steering angle
unfortunately my laser pointer doesn't
show up really well against this screen
that'll give you your steering angle
and the scaling since when you turn to
45 you know the value you should get is
45 90 180. sometimes you have to watch
this on Progressive ratio variable
steering racks but
this one happens to be pretty easy so
that'll give you
the steering angle
the direction if it's separate sometimes
it's combined in an assigned value
sometimes it's separate in this case
it's separate it'll also give you the
amount of driver input torque this is
important for torque blending as you're
driving with open pilot so that open
pilot can back off
the guidance that it's giving you if the
driver is providing input and also so it
knows which way you're nudging for
desire inputs like Lane changes
so
it'll show you here
as we're steering that EPS link moment
it'll show you that we're providing some
input and then high input
when we're holding it at lock
it'll go to zero
when you release and you'll see the
direction sign is different because
as we're turning the wheel back
we're providing pressure torque going
left even though the total steering
angle is still right we haven't crossed
zero yet so with that simple test
procedure that gets you all the scaling
that you need all the directions that
you need
so we take that
plug it in with cabana
and that outputs a DBC which
goes into an open Pilot Car State and
tells open pilot everything that it
needs to know about what your car is
doing how fast you're going where the
wheel is
etc etc
there's a lot more signals you'll need
to hunt down eventually but those
examples should kind of show you how to
use Cabana
the next thing we do is figure out how
to send messages
uh there's very few that we want to send
the ones that we do want to send are the
factory Lane keeping assist messages and
we're just talking about lateral for now
because I have 20 minutes to get through
this
this is usually from the factory camera
it's usually a torque signal they're
usually sending a command saying
turn the wheel this hard in this
direction
uh it's not a direct command to follow
this Lane whatever the camera is saying
turn the steering wheel this hard
sometimes the camera does send an angle
I think Tesla does this I think Nissan
does this I haven't looked lately
um
recently we had one come up that sent a
path curvature I know this drove Cameron
nuts for a while when I was bringing
Ford on board
uh but he got that figured out uh had to
do some clever reverse engineering to
turn that into something open pilot
could use
so take note of what your factory camera
does
to actually control your car what type
of signal it sends and what the maximums
are
and then we teach open pilot to do that
in order for the car to actually pay
attention to this message we've got to
talk about payload checksums and
counters
um
you may notice in most are all the
messages that your car sends there's a
counter
there's some field somewhere that just
rolls over and over and over it counts
up one every frame sometimes it's two
bits sometimes it's four bits all the VW
ones happen to be four some other makes
are two
you'll also see a payload checksum of
some form and a lot of messages
this can come in the form of literally a
checksum add up all the byte values and
take the remainder sometimes it's an xor
over the message payload
sometimes it's an actual CRC
in the case of Volkswagen happens to be
a strangely modified CRC that took
forever to figure out
um
in some cars it's completely random I've
seen the algorithm for Chrysler and I'd
have no idea what they're doing there
but somebody figured it out
um the key thing that you want to look
for and hope for is if you see on the
left side of the checksum there
if the message payload Remains the Same
and you get the same checksum for that
every time
there's something there that you can
replicate
and you just have to figure it out and
there's tools for that now there's a
tool called CRC beagle that you can get
off GitHub that you feed it uh
whatever byte value you're getting and
this payload and it will figure out it
will may not figure out completely
automatically but it'll do a lot of The
Drudge work that I had to do manually
five years ago
if on the other hand you see randomness
if the payload and
other values aren't repeating cyclically
if it's fully random
you might be having a bad day because
that might be a cryptographic hash you
might have run into Seco C
if that's the case you might be
leveraging that return policy let's hope
we don't see a ton of that but that's
what to look for
so let's assume we've got the steering
message figured out
Cabana is going to write out that DBC
for you
you're going to go into open pilot and
have the car controller actually send
out a torque command and by the way you
actually don't have to take care of
figuring out
at no point do you have to worry about
where the car is in a lane what
direction to go how to turn the wheel
open pilot takes care of all the path
planning for you and it already has a
built-in controller for how much we want
to turn the wheel you just have to kind
of figure out you have to develop that
Rosetta Stone of
here's how to express a torque command
of the car and that is what we want to
do I'm going to send a torque command if
with that direction and some match some
other stock values that were used and in
this case deeper levels of the open DBC
Library are handling the checksum
encounter for us
and that takes us to
what is hopefully good news
this picture was taken
at an early icky January morning in 2019
on the first day I made that thing work
let me tell you that was a good day
that was a fight to make that work I I
think it took me something on the order
of three months
uh and that was with several people
helping me and providing hints
um
and there was still a ton of time in the
driver's seat looking at tmux fixing
typos oh my God I can't believe I made
another type of controls crashed again
wait why hasn't the device starting
anymore it's
back in the day
open pilot was a lot less testable
verifiable that infrastructure that we
have today didn't fully exist yet
but
once you get it running
that first time that you feel open pilot
engage and provide some guidance to the
wheel
you're having a pretty good day
if your car makes it an entire minute
down the road and preferably more like
10 minutes you're having a real good day
but
sometimes you can get all the way into
this process and find out you've got a
lockout
and that's bad news
sometimes there's workarounds for that
but every car that has a modern
level two Adas system
will not let the driver go hands off
indefinitely
um the difference is
who enforces that
some manufacturers drive that entirely
from the camera
and if it's the camera that's deciding
whether there's driver input
and whether to disengage open pilot can
replace that
a few manufacturers I think some
varieties of Mazda
not recalling others off hand but
old Ford okay
sometimes that 15 or 30 second lockout
is enforced on the eps
in that case
um
well that's a bummer
sometimes there's workarounds there's
things you can play with don't give up
immediately
reach out for help but it's not a great
sign if it consistently breaks after the
same number of seconds but hopefully you
get down the road
and if you do that's fantastic you've
got a lot of cleanup and quality work to
do after that to make it good
um don't worry if it doesn't drive well
at that point you can fix that as long
as it open pilot can take control
for five or ten minutes
this is going to work so
that was my day in 2019.
this was Wednesday
what you're seeing here is the next
generation of mqb called mqb Evo this is
a 22 2022 GTI
we rented earlier this week
uh we modified a harness that's not
unlike one of the ones we use on VW
right now we moved a couple of pins
around there actually is Automotive
ethernet in this car but we don't care
about it it's used as a replacement for
the fusion bus between the camera and
the radar but we just pass it through
don't listen to it the stuff we do care
about is can FD and they rototilled some
of the messages and we had to go through
a process of reverse engineering again
but open pile is a very different
product today
the carports have been massively cleaned
up and standardized and templated
there's CI tests that mean you can take
a log and play it back through controls
and verify that everything works the way
you think it should and doesn't crash
before you get up from your desk you're
not doing this from the driver's seat
anymore you have tests that will check
all this stuff out
and then
new Cabana
will help you out with this
and
the whole thing ends up being a lot
easier and faster
last time this took three months this
time we had it done in nine hours
to be clear it's not Upstream yet this
is probably the worst possible week to
ask a Dave and Shane to look at
upstreaming a PR
but it's in progress
so
guidelines for upstreaming
um it needs to be safe it needs to
comply with all the guidelines that uh
Adib and the rest of the open pilot team
laid out earlier today needs to be
passing tests you need to verify all the
checksums encounters not only for
sending but also for receiving and you
need to make sure if you're using stock
ACC
that open pilot can reject engagements
if there's something wrong
then it needs to be supportable it needs
to work like other open pilot cars and
that means torque blending that's one of
the reasons Tesla isn't listed is
officially supported because the
steering API doesn't work quite like we
want
there needs to be no visible faults it
needs to drive in a way that would be
acceptable for a person and if there are
faults
you need to log them and upload them so
they can be analyzed later
this comes into play as part of all the
work that the open pilot team has done
to improve quality and mtbf and
autopilot to the point where the last
couple of times that the open pilot team
has had me look at routes
that experienced faults we tracked them
back to a bug in the car
one of them was a retrofit that somebody
had retrofitted ACC to the car didn't
have it from the factory and they'd use
the wrong software the other one was
genuinely software bug in the ECU a
certain model here of Atlas had engine
ECU firmware that if you did the wrong
thing in wrong order with remote start
you wouldn't have cruise control for the
next start
so you want to get to the point where
everything works and then
it needs to be actually marketable in
order for it to be upstream and actually
appear on comma's website and and Shop
you got to figure out how to make that
harness manufacturable means you got to
find the other connectors on the other
end it needs to be something somebody
can reasonably install
and it needs to be fully plug fully Plug
and Play fully reversible it needs to
work like
the open pilot experience and other cars
because it's one thing when you are
working on your own car but when this is
upstream and in a store
it's not you that's taking the support
calls or the rmas or the angry emails
it's those guys so it needs to be dialed
in in order for it to appear for actual
sale to actual customers
so
that's my talk uh that's
that's there's obviously a lot more that
goes into it I hope to actually do kind
of like a Blog series later I don't know
when that will fully come to pass but
hopefully that should be an overview
anyone got questions
a word Jason we're going to do questions
we're running a little over oh are we
okay I'm gonna give you a little spot in
the back and everyone can come up and
ask you questions back there okay uh get
their specific questions answered
um the comma team
upstairs if you guys want to come on
down
uh
we're gonna say goodbye to the live
stream thank you guys so much for tuning
in
um the streams will be live well that
we'll put the recordings on YouTube
um in the next few weeks so you can
re-watch
um
thank you again for tuning in have a
great night we're live
do I have enough battery I just realized
all right
[Music]
[Music]
but it's just uh
yeah you know hello come on yeah
you're live from the stage we are going
to be it's not going to be easier with
us today
thank you for tuning in
a few years ago
I asked the team you know if there's
anything that you could do or change
like vowel because I mean GitHub they
said you know it would be great if we
could
um get more contributors uh you know not
everything benefits from having people
contribute and so we invented the
commies
that's kind of a joke but now they're
real
um and today we are going to award all
our amazing contributors
specifically from the last year
we're happening
yeah
foreign
[Music]
thank you
anyways
can you see if we have books
I think even if it was just like a
little bit better
some other cool words
is
[Applause]
how many commits does he have take that
property
and not only is he committing he's
refining us oh boy
are you stuck with us
[Music]
join us on stage and I hope one day in
the future he could be a contribute our
presentation
let's talk about some highlights from
Dean these consequencies yeah so uh what
is the Highlight is a pretty incredible
tool called Cabana uh
it's a complete rewrite the web tool
that we've maintain for the last five or
six years unreal yeah yeah I just tagged
the issue it was like you want to extend
this and I woke up and he's like in a
different time zone so it is like every
morning at Christmas and we need to stop
some beautiful PR in their lab
sometimes mostly wow yeah in this case
has been working on a requesting
features bug fixes
okay thank you Dean Lee for all that you
do we will ship you
know
[Music]
a convenience store
Los Dinos
we just don't know
true history
um
or her you know
there's a startup building his own
family it's an open issue and uh
we had to figure out that easy video we
thought it was at a comma two or a comma
three we already knew that real-time
Hardware yeah
some people Legend has it he's being
sponsored
the regular lunchtime mystery picture
um so thank you
[Music]
[Applause]
all right and we have some live polish
and uh
our first live Tommy is uh become the
most popular place
really comes with Michael same here used
to be the most popular for a couple
years ago for the yard
I retired support pretty quickly
it was a dragon pilot
you gave it away from the first line you
didn't even build us you know
so I guess everybody can guess let's see
uh what's known for mads
he's got interchange you could ever want
and you can figure it through the
heart's desire
a little bit unlike stuff
for a few more cars
we've got some things we want to yeah
also if there's a great job integrating
people into the community
yeah yeah he brings this one super
quickly
attentive guessing it's a sunny pilot
and the launch event is a finger for him
Sunny pilot story is that I said I want
to drive right I just heard so much
about it you need to try something about
it put it in one of the cars I mean I
will and Harold goes apparel right yeah
but it's sunny get it to say sunny
on the Dash turns out he didn't and to
psyched myself
there's someone
just because of the sunny day in San
Diego
and we would have thought you knew
something so imagine but I think there's
a testament to how much we believe uh
humans what we're doing for the
community so please come on downstairs
[Applause]
so um that's what it's been really great
at this as soon as you see somebody in
the Discord I don't know
anything different it doesn't empowered
he really reaches out and ask for the
route and is of course
this is the last year he's probably more
than 15 cars 15
guys
thank you
[Applause]
hello everyone it's sunny here and uh to
anyone that's using funny pilot before
any issues or any requests that people
like just let me know you can always DM
me or just go to my physical server and
if you want to support a new car that's
like as much as I can and yeah I'm going
to be into this community
[Applause]
thank you
so this next person uh you might have
seen them around
um
you can't miss them yeah
that was also very great uh pinning
things do you have any questions
um
um
[Applause]
the DFW area
I feel like Eric has been in the
community
people
do you have some words you want to say
and fight for the people
[Applause]
this next person
has been here I think before I have
um
[Music]
okay I just have this one story and I
can think of I can't do that that's
perfect Big Ideas
but I just remember I was working on
this one problem with the General Motors
card yes this whole thing whenever we
tried to send this to your community
survey and I reached out to them even
though he didn't have the bar and they
were kind of hard for it just becoming
interesting and I reached out to him and
I have all the contexts and I needed
yeah already the Phoenix
they really it was a really caring job
foreign
[Applause]
[Music]
two of them are pretty useful when I saw
it and then me and my wife and then I've
got a garage Queen yeah
thank you thank you
[Applause]
appreciate all the things to do for our
community
that's right
so I think Jason is the I don't think
he's certainly the oh file contributor
who I have to review their br's release
whatever I get that jcpr I'm already
ready for this workbook and I have to
remind myself
don't put that responsibility on me
that's uh the best quality plan by
contribute
[Applause]
I think that's it for our lives we got
some honorable mentions yes
maybe not a whole family worthy this
year but we see you and we're excited
about what you're doing and we
appreciate it from
um so we've got one who was previously
shouted out in a talk he's big in the GM
Community is a pretty popular sport that
recently popped up on our dashboard it
seems gross he's very interested in your
data he'd love if you upload it to them
yes
we've got some novel ideas it's in your
car it's twasenko
[Applause]
um
[Music]
this was really cool about the joints is
this this whole community and it reaches
out to the hundreds of
so we realized that he was like
personally picking people and asking
them to upload data so that he can see
oneself and we are like where where we
have all the data in the world so which
inspired us to create the data set I
mean we were talking about it before but
never really prioritized it
um
but it really it's a it's a great thing
that he's doing
um and then the lab expertise University
also I just want to call out that that's
exactly the kind of thing that we
encourage a lot which is like you can
hyper optimize something to work great
on your cars and that's perfect and even
if it's even if you can't really
Upstream it because it's like super
specific to your car that is great I
mean that just encourages more
developers to you know work on autopilot
and they're doing your own cars and if
it's time generic enough then you can
like Upstream it uh to master but
everybody everybody get benefit from it
but that's that's good that's like
amazing and we really encourage all of
you to look at your Vlogs and see what
you can do thanks thank you
[Applause]
this next version is also not here but
these ball knows in the driving feedback
Channel as replying to every single
person with a customized video
yes so this is uh an awesome daytime
[Applause]
honestly you guys should do the same too
I try to be a good example
foreign
[Applause]
2.0 members
any of them are here you want to stand
up
for me
[Music]
[Applause]
truly F-150 it's getting it soon right
bugs
[Music]
it's always great when we can ship and
stuff get some feedback
you guys you know their results
it's kind of horizon and it was a lot
more chill than last time so a really
little look at every single report
I think it was a really great experience
too every morning I'm Dean puts Alice
how many miles
on our code name Jesus yeah it turns out
when you don't drive nearly as much as
we thought so if you guys really
appreciate uh it's funny for himself
driving car company Focus company we we
drive we're very well
everyone lives close to the office and
we've been working so hard no one's
driving that road trip so I really
appreciate the community uh helping us
it's critical
yeah you guys uh
I think five bucks came out of it didn't
forget it Road testing these things we
have different environments different
cars I think like you know be part of
successful testing is the diversity yes
we've got lots of new cars
experiences
[Music]
[Applause]
all right thank you guys for tuning in
it's a real pleasure we really
appreciate appreciate truly appreciate
the development community and the work
that you guys do it's really nice to see
so many familiar faces uh please if I
haven't met you I would love to please
come chat with me
um thank you have a great night
foreign
all right we're live all right hello
guys we've got an exciting two-part
announcement for you guys today we're
doing a hackathon
and
it's like one person watching maybe we
should wait a second
but sure
we can quickly go to our metrics
dashboard in the meantime hi everybody
some of our exciting metrics in the
meantime
we got some announcements in a minute
this is our metrics dashboard
this is what we try to improve on every
time
we talk often about uh how bank turns
the car cuts cuts corners on lanes you
can see that over here you want to show
how the lines are going to go harold uh
yeah so you see these distributions
that's where it drives in left and right
turns and because it's cutting they're
not matching so we want to get them you
know
together
so that's what the vac is working on and
the lanes will be better
what else is interesting on the metrics
dashboard
do we have like
do you want to show lunch
yeah let's show lunch
[Laughter]
this is our lunch here's what we had
today check out the menu here
it was pretty interesting
yeah i know it's pretty good we got some
some kind of uh thai curry yeah weird
kiwis
they're so bizarre that's not the live
color that they look like that in real
life too it's pretty it's pretty
shocking
um
are we ready for the announcements again
yeah let's do it yeah so the big
announcement is we're doing a hackathon
and we spin it around because the mic is
hello guys
we're doing a hackathon it's gonna be
uh november what is it 13th
12th 12th and 13th
yes 12th 13th and 14th and to get into
the hackathon we made a capture the flag
challenge which uh you guys can find
some flags and then you'll be able to
get into the hackathon and we'll
make the instructions for the ctf for
the capture the flag live right now and
we'll go to a deep and we'll follow him
as we uh
as we publish the instructions let's do
it
so the hackathon's gonna you know we're
gonna learn a lot about open pilots it's
gonna be a fun hangout there'll be some
prizes
all the fun stuff
all right
look at all the code work going on here
deeb's uh
mastermind you open that up right before
the screen
never seen it look like this so it's the
weekend
it's gonna start friday night
on the 12th
yeah and then we'll uh we'll do the
full-on competition uh the 13th and the
14th
the friday evening on the 12th will just
be a little bit of a hangout
[Music]
and who i think the most exciting thing
about the hackathon is whoever um
captures all the flags first we will
cover your flight and accommodations to
come to the hackathon domestic yeah
oh look at that the instructions are
live
live on the open pilot repo give us a
little
tell us a little bit about the ctf what
inspired you all right what is it what
am i looking at
so we have one route for you it's a
seemingly normal open pilot route um
driving down beautiful san diego
and it's uh four segments long
so four minutes and there's two flags in
each minute of the route
and then each flag and each segment uh
roughly increases in difficulty
um everything you need to find the flags
is in the open pilot repo we've really
been pushing on tools lately
um deenly's done a great job of
rewriting um we had this old tool
on logger and uh
dean lee uh did a great job rewriting
this in c plus plus it's really fast now
sweet it's uh really stable hopefully
we'll get that on the device soon so you
can do uh on device replays like you
could in openpipe like zero three
we'll bring that back
yeah
blog.coma.ai
oh look at that yeah so uh this is super
legit
the the time starts now guys
first guy to get all the all the flags
will get fully comped and make sure
it's an accommodation make sure you're a
winner
you want to be a winner that's for sure
yeah so uh don't wait
yeah so
i mean it's a pretty big deal hackathon
prizes will include a comma three cross
country edition which is a 27.99 value
wow that's a pretty good prize
in there
we'll throw in a harness too okay just
checking yeah yeah no worries you will
be taken care of if you're a winner
maybe you've got a commentary i feel
like you really got to put you know oh
yeah yeah be a winner be a winner it's
right there
yeah and of course be a winner do not
leak any flags or clues or you will be
shamed and uninvited
right don't make me invite you first
rule of ctf is not to talk about how to
do the ctf we'll do some honest
sportsmanship on this competition but
yeah so super exciting two competitions
at the same time released on the same
day it's it's been a while we've been
really working on it we put a lot of
effort into meeting this deadline
um it's been a lot a lot of distributed
work in uh making this competition come
together so yeah hope you guys enjoy it
we uh we all kind of thought it was
pretty fun testing it i think most like
half of the engineers here did the ctf
and we all had a pretty good time
um maybe we can go to my desk and we can
uh
we can just give a little teaser on how
you would get started on this uh
let's do it on this little route ctf
look at all these boxes we have they're
everywhere
thousands
we're officially entering
prices went up department i don't
remember that changing
between everything
all okay so uh
don't fill my
password
i'll show you this plant
okay
we're back all right so yeah so the
challenge is just gonna be a route and
you're just going to use regular open
pilot tools
to to find the flag so here's a normal
route that's not a ctf route and you can
use replay to replay that and once
you've got ompul installed it should
just be running that command with the
ctf route
so now that's running and then you can
run ui
and you'll just see uh the ui as it
would have popped up as you were driving
the route
and this is pretty much it this is all
you if you get this far and you've got
the ctf route in the replay this is all
you need and you'll
you'll
see all the information you need to
continue from there
yeah we've all tried it we all thought
it was really fun i think i think you
guys will enjoy it too
don't be discouraged if you experience
some issues trying to install it install
all the
tools that's always a bit of a challenge
but once you get past that it should all
be pretty fun and uh
there shouldn't be any any new
challenges along the way it should just
be a fun little competition
yeah that's cool
adib worked very hard for a few days
making this for you guys so
okay he deserves that how many flags are
there total there's eight eight flags
okay and this is just part one so i
think we'll do uh another part um soon
we have some more
uh difficult challenges that aren't
gonna be a qualifier for a hackathon
um that i think will just be fun maybe
we'll put on some prizes later on but uh
this part one is the qualifier for our
hackathon cool
yeah might do some more some more this
type of stuff for the hackathon
and we'll probably come up with some
list of kind of projects to guide you
guys uh to work on during the hackathon
the hackathon's also again gonna be
centered around
interacting with open pilot tools and
getting openpower to run on your
computer and maybe doing some simulation
or kind of some quick development stuff
like that so it should all be pretty fun
sure it'll be a fun hangout and uh i
think we'll learn a lot from it so
pretty excited
sweet
we have more things we want to talk
about should we put a bounty out for
first person submit a pr oh yeah
quickly uh yeah yeah so you can mention
that
all right so we'll put a put like 100
bounty out first person to submit a pr
that fixes some tool that's useful for
the ctf
um
will uh yeah first one that gets it
merged
um
they'll get uh
100 bucks yeah you want to pull up the
uh the blog post one more time we'll
just go through all the
all the details one more time
um and this pr does have to be good yes
we're not lowering the bar for pr
submissions for this uh pr
challenge that's right uh so yeah you
have until the 20th
and uh by the 22nd we'll have emailed
everybody who's invited to the hackathon
reminder it's in person in san diego
it's going to be at a
a secret location
and that's what it is november 12th to
14th
and uh yeah we have the ctf prizes right
here first prize again to get all the
flags you get domestic flight and
accommodations covered to attend comma
hack
or 250 and then second place a hundred
dollars third place march
and uh yeah if you want to come a three
it's a good way to get one if you come
to the hackathon yeah exactly
comma three is too expensive just uh
come win one yes
so this is the form right here that
you're gonna use to to fill it out it's
right below
so this is on the blog it's also linked
in the video description right now so
you can check it out
any questions
yeah you can answer some questions if
anyone's got any can we give any hints
um if anyone asks that's a pretty good
this is a pretty good hint yeah if you
just do what i did on my computer run
replay run ui i think that'll get you
started pretty well well i think yeah
and then really make sure you read the
the read me
those uh those hints in there those tips
really take them to heart go read the
places it tells you to read read some
documentation play around with
replay a little bit get familiar with
the seeking interface um
actually i'll write some more
documentation on that today
but i think this will really help if you
seek around in the segments skip around
um
if you get stuck on a segment you know
try out the other ones
we tried to sort them by difficulty but
you know it really depends
cool should be good fun yeah and
reminder if if you're not a hacker type
uh in a week in a few days we're going
to be doing the video contest uh winners
as well so calm is just doing a lot
right now yeah kinds of competition not
just flying out the door
oh man so so yeah you can check out the
last live stream if you want to know
about the video contest if you're not
like a hacker type but yeah the ctf is
really cool and uh any last questions
i didn't really see any questions to be
honest everyone's everyone knows what's
going on should we check discord for
questions
yeah let's let's check real quick
whether anyone's confused about anything
pop that up in the lobby and lobby your
announcement live stream is up
now's your chance
either post
in lobby or post uh right now
um
what's a flag
yeah so the capture the flag is just you
know they're they're little things
little little nuggets that you should
find in the route and uh
i mean that's basically a flag and
they're like little clues and and every
clue you found it counts as a flag
uh it's just this
type of competition that's pretty
popular in like programming it's called
capture the flag it's not something we
invented so if you want to find out more
about just capture the flags in general
just uh
google it you'll you'll find plenty of
plenty of content yeah if you don't know
what it is there's it's uh there's no
prerequisites here as long as you follow
getting started in uh the readme for the
ctf then you should be you'll get your
first flag there's your hint yeah i
haven't i haven't done any ctfs myself
either so don't worry about that and
yeah you don't have to be a hacker but
you should know some stuff about you
know python um i think that that might
be a requirement
but you definitely don't have to be a
hacker or have experience with ctf to do
this
yeah that's a good reminder too someone
in
discord just brought up
uh will
are there any intern invites for winners
i mean
in the past
yeah in the past like that's how we hire
we hired vivec that way yeah we've yeah
it's definitely if you're interested in
in common working with us or just open
pilots definitely a good place to be
somebody said uh is this hackathon worth
it for beginners um yeah yeah i think
yeah we also partially wrote this as
like documentation for open pilot like
if you get through this etf then you're
gonna get familiar with all the open
pilot tools
um
either some
do it
like the common tools we use um pretty
much on a day-to-day basis you're pretty
familiar with
so i think regardless of the hackathon
if you just want to learn more about
open file development um
this is a really good way to to get
started yeah the ctf is not in our irl
that's just something you do at home and
you send us the flags um and then the
hackathon which you can get into with
the ctf that's going to be in real life
in san diego location not decided yet
secret secrets
um well you know
if you like pizza red bull and to hang
out with a bunch of common engineers and
that was your chance to do the ctf and
it was pretty fun last time i think
it'll be fun again yeah if there's some
more questions can you do this on a mac
um yeah it should work it should work
i'll test it out later today but another
question is there a certain format for a
flag
flag yeah that'll be obvious the flag
formats are
they're all the same you'll see the
the first the first flag tells you what
they look like if you do what i did on
my computer just run the route and
replay run ui it'll be quite obvious uh
what's going on from there so yeah
um but yeah back to the mac thing um
max used to work a little bit we had to
turn off the ci for a while so i'll go
back and test edit but it should build
and most of the tools should run
but uh we'll go back and double check
that maybe you can fix the tools for mac
and it's your first pr you get 100 bucks
and if you fix some real issues 100 for
you yeah
um
cool news should we shout out the
calibration challenge too for interns
in general oh yeah if anyone's
interested in being hired for just uh
research
um or open pilot potentially i think but
it's more of a research appropriate
channel uh challenge you can go to uh
the calibration challenge let's check it
out
um so that's call my eye caleb challenge
and yeah that's that's basically our
hiring challenge for research um
you have to estimate the direction of
travel
of of of the camera through some video
so the video will be moving and you kind
of have to write an algorithm that
estimates which direction uh you're
moving in um it's quite difficult but
should be pretty fun
um this is our new new version of the
challenge we used to do the speed
challenge but i think uh
state-of-the-art machine learning
techniques got a little bit too good and
you could just train very good models
just out of the box that solved the
speed challenge to a pretty good degree
so this is a new challenge that's kind
of meant to avoid that problem and you
do have to do things some things
yourself nothing out of the box i think
will really work um so i think it's a
little bit more fun a little bit more
challenging
cool comma hack 2021 it's real any eta
on the fisheye for the coma three no
that doesn't sound ctf related oh we
have do you want to show them watch
three watch these beautiful yeah you
want to show them watch three oh let's
sure let's let's let's do watch dude
it's really cool
um i mean yeah the we we are internally
we've been doing some things with uh
with the fisheye
um and and we'll see as soon as we can
get like good improvements on bigger
frames we do intend to ship that but
it's not something we want to do until
you know it has good good uh
i don't find where is watch three
so far you are oh i see
watch three
no you have to start it with uh
oh i can't flags
look at all these hints you guys are
getting here you're
i'm struggling with things that you you
might run into yourself
it's called watch three because there's
three cameras yeah nice
exactly and it's a comma three that's
true
no you might not have all the cameras
uploaded just do dash demo
just dash no route yeah no right just
that just
okay
some somebody's already posting some
things so that's um
interesting let's be careful with those
posts yeah no more posts and more posts
like that
all right it's downloading that's a good
sign it's doing something
and once this gets going it's really
fast dean lee did a great job it's a
huge shout out to dean lee is the demo
route all right
oh there we go check it out oh this is
the new demo route yeah with mitchell
yeah
so he's also in this etf yeah this is a
cool uh cool tool isn't it guys wow look
at that tool look at that
oh awesome someone said i have class
right now i'm gonna go gonna go straight
home and work on this yeah i i thought
it was really fun i hope you guys enjoy
it too i think once you go through the
installation process that might be
painful depending on some some things
you run into but i think after that it's
really just a fun challenge and you'll
learn a lot
um
i see so the uh
the clue has been deleted so that's good
that's good uh
yeah linux yeah linux ubuntu 2004. i
tried to get it running on ubuntu16 and
that wasn't working so
try linux ubuntu
2004 if you have the choice
yep
cool any bounty for best pr in the tools
yeah so we mentioned that if you fix any
of the tools um you get a 100
uh
price
if you if you make any good pr to fix
any of that stuff
um yeah
cool what's uh wsl is that the world cup
no windows subsystem for linux so we
haven't tested this but uh quite a few
people in the community say uh version
two of the windows subsystem for linux
works pretty well even works with our
gui our gui tools and they can load up
the open pilot ui i believe so
all these tools i believe should work
but um
and if you confirm that uh maybe make a
pr and say this uh in the setup read me
um but yeah i i believe they work
otherwise just use a printer twenty or
four
cool cool yeah i think i've got anything
else yeah i'm very impressed with this
uh
beautiful isn't it that's a good idea i
haven't seen non-laggy video on my you
can seek around too when it's fast i
can't wait
yeah shout out to dean lee for his
contributions for this
uh
i think he's like well past 500 commits
now yeah he is oh yeah he's quite a
quite an incredible uh contributor yeah
i mean this is pretty impressive this is
great
wow look at that and i know who's
we're gonna have to give him a comedy
this year
oh yeah when are the comedies the
commies are coming back oh should we
yeah what are the commies
are coming back
i guess it's always they definitely
always come back right yeah i mean this
is the second
year i mean everything's a trend right
annual commies uh we got a lot of annual
things now yeah
and one last we're we're good yeah
everything good cool
final thing just a quick reminder to
everybody
comma threes are in stock if you buy a
comma three it will ship either later
today or uh next week at the latest so
let me put some on the stress test right
there
so check this out
we got a full bin
of ready to ship comma threes a full bin
which is awesome and then
of course we have one terabytes as well
uh but yeah we have a full bin of 250s
which we've never had before so
production
is killing it cool oh this is the wrong
way
it's so hard to do that reversed
all right
everyone's got oh they went over here
thank you everybody check out the blog
post link in the description to learn
all you need to know
all right
see you guys bye so you got the hack
phone yeah next month
you
hello everybody
welcome to the live oh stupid thing
tilt up
there you go it's going to be a big day
today
uh we're going to be doing an end-to-end
longitudinal demo with our cto harold
it's going to be great
we're also going to be announcing a
video contest that all of you can
participate in even if you have a comma
2 or a comma 3.
but first off something very exciting
hi sam welcome everybody
something very exciting right here
these boxes right here are the final
comma threes that were in our backlog
meaning we're fully caught up
and we have comma threes in stock now
for the first time ever
ah these are all boxes for comma threes
thousands of them
boxes everywhere
welcome everybody
i'll say this we've shipped over 500
comma threes now which is a huge
milestone super awesome
uh very proud of the production team for
all the hard work they've been doing
let's actually go take a quick peek
at uh some of the assembly going on here
so over here are some finished uh comma
three skeletons they just need the back
cases on them
and the screens so i mean they're gonna
be ready to go on stress tests later
today
over here we got some
parts laid out
and over here
juan is
making one right now check it out
gets a little quiet on fridays uh
because
everyone comes in very early and leaves
very early uh in the production team
but uh yeah we got a full house back
there working on comma threes and we
have some ready to ship so if you buy a
comma 3 today expect to see a shipping
notification on monday
which is super great and here's some on
the stress test we've already taken a
bunch of them off
yeah brevin you did talk to one at
comic-con he was
he was there on the booth but yeah here
are all these beautiful
comma threes
they all look great i love the test
because we can
check out all the cameras
in full screen super cool
so that's the narrow camera
that's the 185 degree rear camera
and the 185 degree front camera
and something that people haven't seen
before yet is this
a new contraption that we've built
it actually is just a 45 degree angled
mirror
so when we're testing camera focus
it shows the roof
so you can see there's the roof and we
use those lines to check the focus on
all the devices
so that is great so we don't have any
devices with bad focus going out there
and yeah we've been doing that
practically the whole time but let's
announce the video contest
i think some of you are here for this
most of you are here for the end to end
longitudinal demo it's very very early
days with that but this video contest is
very exciting
all right we're going to set this thing
up like a tripod
so i don't know how many people know
where i'm from
but i used to be doing
open pilot videos on my personal channel
before i got hired at comma so back in
they did a video contest where they
asked people to describe what openpilot
was
and
that's what i did i made a video entered
the contest myself i was in montreal at
the time
and i won which is hilarious
so
you know it's funny that i'm announcing
the video contest here
three years later
um
but yeah this was can you believe back
in 2018 we had
a giraffe
a panda
and an eon
look they were all separate they weren't
all integrated
into the beautiful car harness we have
today
so
back then
i remember mr cole also had a great
video back in that contest
back then when i won this contest i got
so
alex thought of the brilliant idea to
adjust for inflation
so
the winner of this video contest
let's see what they're gonna make
well they're gonna get 544.46
nice and there's actually going to be
two winners
so let me talk about the first category
that you could win and by the way this
video contest is gonna last for two
weeks
so your time starts now you have two
weekends to do it and after the two
weekends we're gonna come back here to
judge uh the videos
on a live in two weeks from today
so
first category
is uh comma three
you know there's over 500 people who
have comma threes now and this is the
category for you if you have one of
those devices
uh so basically what we want
is we want to you know hear from you
hear what you think about the device
and how you like it
so i you know i'm sure a lot of you love
your comma threes a lot of you upgraded
from comma two devices
you know tell us in a video
why that is what you like about the
comma three what you're excited about
there's a lot of exciting things in the
future for the common three you know
such as end to end longitudinal is a a
dream that we're working on research
uh so yeah there's a lot of
exciting things stop lines that some of
you may have seen our tweets on stop
lines uh essentially anytime a human
stops
the model is going to predict a stop
line so
it's not working super
100 of the time yet which is why we're
not shipping it yet but we're working on
it and if that works we're gonna have
red light stop signs on comma three
uh yeah george isn't in the office today
so that's category one just talk about
those were your tweets js
you know you might be able to win one of
these uh win this video contest
[Laughter]
so
that is the first main goal that's the
main uh event if you have a comma three
i recommend entering
in that contest just talk about it you
know make review video on it do whatever
you want
let's talk about some creators on the
platform
that are making great stuff already
that's me
[Laughter]
logan legrand of course i'm sure many of
you know logan's videos he makes a lot
of great stuff and he made a great
comparison video of common three versus
comma two
so he might have a good chance of
winning this if he ends up making
something
um
you know there's a lot of people who are
just making some good videos
just showing their like daily commutes
i think these are great videos and we
definitely would consider one of these
just like talking about your experience
the comma 3 and and how it helps driving
you know here's someone named comma
drive doing a great video this isn't a
comma three so they can't win that
category but harold's gonna talk about
the next category and of course there's
uh let it drive who's been doing some
great content as well also might be able
to win that other category
cool
so thank you to everybody making content
on the platform
all right now we're gonna go talk to
harold
our cto he's gonna explain the second
one keep in mind both of these if you
win in your category get 544 dollars and
46 cents which you could use towards a
comma 3 if you want or for anything
harold
yes hello hello hello guys i have to go
go this way for the mic
all right what's our second category
that anyone can enter in if they have a
comma device well the second category is
just uh videos of laneless
to doing impressive things just
impressive end-to-end lateral uh lateral
things with open pilot for those of you
who don't drive with laneless if you
turn on the toggle in settings
it'll uh
it'll dry up end to end it'll try to
mimic human driving behavior
and uh that can lead to a lot cooler and
smoother uh lateral control than uh than
using the lane lines which is by default
um i saw your scene popped in there yeah
um
well yeah i think uh i think that's uh
it's our biggest achievement at research
is uh getting good lateral control by uh
just learning from human driving and so
you guys can make some content uh
showing that would be great we can uh go
for a drive now as well and uh yeah just
do some end-to-end driving and see let's
do it
let's see how it goes
um
yeah so you know you think of my uh the
laneless video i made just showing that
unique behavior at an exit those are the
kind of little subtle things that
laneless does really well
and we're going to have a new video
coming out soon about lane lists going
through intersections which i think it
does amazing at intersections it's the
reason why if the intersection curves
will still uh predict the correct thing
and go through the intersection
all right
going in the civic ready
we have a traffic light in the office
yes we do
it works now right harold yeah it works
the traffic light will go red if the
tests are broken so uh
immediately start stressing out if you
see like a big red
red glow in the hallway
yep
keeps you on your toes
here's the comma three looks so
beautiful look at that all right so this
is uh go driving with
that allows us to get very smooth policy
without ever really manually you know
writing anything about how to take a
turn or how to uh how to go through an
intersection but ends up being super
smooth
and uh we want to do the same thing for
longitudinal and so that's a that's a
whole project and and the start of that
is just uh
having some some end to end on the on
the device and uh seeing how it does so
it says here the the red stop light
should stop here
and
yep come check that stop
so that's fully end to end um
it's now stopped at the stop light and
the red stop light is probably not in
view so it's not going to see when it
turns green it's probably just going to
be stopped here forever so we'll take
over whenever it turns green
but this is just kind of a proof of
concept to show that the model does
understand certain things uh about
longitudinal just from understanding how
humans drive
so um the light turned green i took over
again
here we'll uh come behind the stopped
car and it should come to a smooth
human-like stop and that felt very human
like yeah it seems
yeah so this is the thing about the end
to end stuff is uh you know we've been
working quite a long time on you know
just like lead policy and that kind of
stuff and there's still a lot of things
about it that don't seem that smooth or
that enjoyable and a lot of that's just
because it's very hard to hand tune that
um you know it's all these different
situations different types of you know
accelerating and braking are more smooth
um but it's hard to hand code that but
if you just tell it to drive like a
human like i didn't take over for this
turn i just helped the steering a little
bit
and i mean it's very human-like
and hopefully by using this kind of
machine learning and by mimicking the
human behavior we can just start getting
and longitudinal policies that keep
improving as our models improve as
opposed to us like having to hand code
you know all these new situations
and here it's accelerating behind this
lead
one of the issues we have with the
normal lead policy is that
it doesn't appropriately accelerate when
a lead car pulls away or
it it'll accelerate too hard if you're
just slowly trying to come up to crew
speed that's just because it's not very
aware of like context and stuff um and
so hopefully by leveraging the
end-to-end output we can improve that
i just took over here because the model
wasn't going to see that you were making
a turn so i probably wouldn't have
doubled that very smoothly
here we're gonna go on the highway see
how it does here so this is uh now
end-to-end longitudinal and end-to-end
lateral control the mole is just doing
what it thinks a human would and we'll
see how it goes someone said
pre-recorded
it's definitely not recorded i'm sure
we'll see several instances
of that manifesto
this is our torque modded honda civic
with a pedal right
uh with a pedal yeah yeah
so as you can see it gets a lot closer
to the leads than uh the normal policy
would that's not exactly what we want
out of it but i mean this is just part
of you know this experimental stuff just
to kind of see what it wants to do and
see how that goes
um but yeah this is uh kind of the first
run of this we haven't really worked on
any kind of
end-to-end longitudinal stuff
[Music]
so yeah this is the start
again so speed control here is being
done by the model um
there is some limits to
how close we get to a lead because
sometimes we get uncomfortably close so
i put some limit in there but that's not
really what's causing the following
distance
now it's really just doing uh doing what
the model wants at this point
and hopefully we'll uh we'll be able to
do some slow down for exit soon and you
kind of see that the model has some
basic understanding of what's going on
yeah everyone's saying it looks very
chill yeah here it's very uh getting
quite close here so i'm not sure it's
gonna slow down the time yeah i'll just
uh slow down myself for that one yeah as
you can see it's still definitely not
pre-recorded
definitely makes plenty of mistakes more
of a proof of concept than anything else
yes so unlike end to end longitudinal
end-to-end lateral is already very good
and you can you know enable it on your
own device today and give it a shot so
you know i think that's what i really
want to see in these uh videos that
people are making is just show it doing
cool stuff because it it does every day
like you know we drive it every day and
it does really amazing
um you know really human-like turns and
things like that
yeah exactly i mean uh the end-to-end
lateral stuff it's kind of
state-of-the-art machine learning and
self-driving stuff but uh i mean you can
experience it just the same way we do
like it's the state of the art but it's
also shipped so you know i don't need
we the stuff we use at home is exactly
the same as what's uh what's on the
public branches so
you want to see the state of the art of
all we're working on just install uh
pilot yeah
and enable the lane those things
should be just as magical as what we use
internally
there's no secret good open pilot you
can just try it on your own device
someone asks when enter and uh lateral
is moving to beta
lateral yes oh i see is it like i guess
the default yeah toggle so one of the
big issues we have with the
end-to-end lateral is
it's it's a little bit less robust so if
you would move a little bit too much to
the left or too much to the right um
it's not going to recover very quickly
um
and so what that means is that if
there's errors in controls like if and
and what's happening what we have the
problem we're trying to fix is that if
you're in bank turns just the way the
vehicle dynamics works is you're going
to slide a little bit down the back of
the road into the turn um
and this effect exists both with lane
lines and with laneless but it's
stronger with laneless because of the
less recovery pressure so we're trying
to fix that so that the cars are robust
to that and once that's fixed then i
think overall lane should just be much
better than with lane lines so hopefully
that's that's all we need to do
yeah
so that's when uh that toggle might
change to be default yeah exactly
someone asked when this is planned if
it's planned for a 1.0 or later uh what
is the end-to-end longitudinal stuff
[Music]
i got first let me talk about the
contests one more time because alex came
in so basically we have two categories
for all those watching who are just
tuning in
the first category is comma three
related so you know anything uh about
your comma three like a review of it how
it compares to your previous comma two
those videos would be really great and
obviously the higher quality of the
video the more chance you could win
so that's category one and then category
two is anything about
uh using lane lists on your comma device
so that can be you know an eon a comma
two or a comma three
and uh yeah just showing off cool stuff
that
the driving model does on laneless mode
which is when it has this red
line that's how you can tell it's on
laneless mode
and uh you know it does a lot of cool
stuff
it goes through intersections it takes
exits very human-like you can see an
example video on our channel right now
uh something cool that lanelist does
that's the kind of video we're looking
for just like showing off some cool
laneless stuff
so
and both of those categories the prize
is
544.46
which is 500 from 2018 adjusted for
inflation
so
if you'll make a video harold
does this count maybe i don't know if
this counts maybe if i find something
cool
[Music]
yes yeah what are the types of things
yeah i think that's most impressive you
know when it's going through
intersections and makes correct
decisions
uh that you know any any naive policy
with lane lines wouldn't do
i mean it continues to amaze me how
you know we don't really tell it
anything or don't really specifically
tell them all to do anything but it just
it can it can make things just seem so
super humanly smooth just by
making human driving it's pretty it's
pretty astonishing yeah is amazing
yeah we can uh we want to get on off
rank here and see if uh yeah he's gonna
slow down
sure let's try it
so i did notice that uh i was trying to
make some tweaks that i would respect
the leads with the
cruise speed but it doesn't seem to be
doing that at all so
there might be some disengages here but
uh let's see we're gonna go off the off
ramp here let's see what it does about
it it still seems to be going very fast
and let's uh help it out a little bit
slow down a little bit here because
that's a little bit too extreme yes
so we'll see how it does here whether it
uh
yeah it's a little bit a little bit late
on the break today
i have to give it another chance early
days early days early days for sure
good uh forward collision warning that
the model did though
yeah that's that was a model for
collision warning there so it uh it goes
off if it predicts very hard brakes so
uh
so that part works
that's good let's see let's see if
there's anything interesting
so here
mean you can see the stop and go and the
way it leaves from the from the lights
all you know that's that's relatively
human kind of stuff so that's cool well
that was neat you were engaged during
that turn and it
held
12 miles an hour while you were turning
and now you went straight it's picking
it up all right so we got a traffic
light coming up there with no lead we'll
see uh we'll see if it thinks that's an
important thing to stop for
i hope so
[Music]
oh
check that out
wow it hesitates that's impressive but
uh there we go wow oh and green well
that's out of view it's out of view
yeah so one of the things that's still
holding this back is you know it's it's
a lot of the
the lights and stop signs are out of
view when you're at them so
the model kind of gets there then stops
and then kind of loses context so
yeah we're gonna have to it doesn't seem
to want to go very fast in this road she
doesn't like this road just i think
maybe uphill is uh maybe a little bit
lazy
yeah
yeah hopefully we can uh increase the
view soon and then those those uh the
model become more context aware of that
kind of stuff
guys have any questions about uh
just intern lateral in general anything
about that or anything yeah let us know
any any questions about the contest what
kind of videos you make that is all
fair game
uh someone asked what branch this is on
you know highly experimental yeah
extreme financially you probably
shouldn't be using it you know that's a
good point because i like that
no this is a
it's purely an experimental branch that
just kind of
allows us to do some very basic tests on
yeah learn what the model knows right
yeah i mean in general we don't really
do any real world testing for this kind
of stuff we try to write very
comprehensive test suite so that we can
simulate all the behavior but every now
and again you kind of have to evaluate
that the simulator behavior is similar
to the real world behavior so that's
really all we would ever do real world
testing for
you know for anything practical we we
kind of only train a test in the
simulator it's just
the iteration time is so much faster
it's it's reproducible and we can keep
pushing on that kind of stuff
uh increase the view someone said sounds
like wait for comma for the comma 3 can
see 360 degrees yeah the comma 3 can see
plenty it's just a matter of uh
you know we have to write the model and
make
sure that it's better we've done
experiments in the past and we actually
didn't get any benefits from increasing
the view size so that's why we're uh
we're not really pushing on that right
now because uh there were still other
bottlenecks holding back the performance
of the model but once it's clear that
increasing the view will be the next
thing to do then we'll work on that and
ship that yes
data bugs in the training and ground
truth seem to be most of uh
most of our problems most of the time so
someone was asking how do you
get it to
stop for red lights and stop signs
if it was already end to end before i
think you're confusing n10 lateral and
and longitudinal so we've had end to end
lateral as this toggle for a while but
antenna longitudinal is
understanding uh fully end to end the
gas and the brakes that humans do right
yeah yeah exactly so we've shipped i
mean behind the toggle it it does
basically drive fully end to end for
lateral
um and so that's basically just
mimicking the human driving uh but for
longitudinal what's currently shipped is
still just using lead cars and
and like the crew speed and just some
really basic logic
but we want to make that more
intelligent too so that it can
eventually stop at stop signs and stop
lights and it can slow down for turns
and it's just a it's a pretty big
project and it's something we're just
like starting to really work on and
working through all that yeah stuff a
lot of people asking if it'll resume at
green if it's in the model box that's
the the goal right i mean in theory yeah
it's in the model box we're not quite
sure what we're going to do with stop
lines yet so stop lines will probably be
like the first kind of feature that's in
this end-to-end longitudinal kind of
group of things that will ship and
well we'll have to do some experiments
and see what the what the best approach
is there hopefully resume a green and
then the stop signs i mean resuming is
not that easy there so we're not quite
sure what we're gonna do
yeah like again uh
i guess to submit a video for the
contest uh you know tweet it at us or
use hashtag openpilot on your video
and uh just title it with openpilot and
if it's uploaded in the next few weeks
i'm gonna assume it's for the contest so
you know peruse youtube and uh yeah just
upload the video to youtube
you know explaining what you're doing
make sure you know it says open pilot
somewhere or comma 3 so i can find it
so you know that's the goal and uh yeah
for
you know 544
that's uh you know you're on your way to
afford a comma three if you sell your
comma two that's another you know five
hundred dollars you could get a comma
three for like half off if you win the
contest and sell your
old hardware good start this is a good
start
um
i'm not sure if there's much uh anything
else to say
yeah more
anything else we should talk about let's
see if there's another thing yeah
you're like let's uh let's see what it
wants to do
oh and it's it's feeling like it's ready
oh there it is there it goes
wow
all righty came to a smooth stomp at
this light that's exactly where i would
have stopped too yeah it's right at the
so yeah the line is uh the power of
machine learning we didn't tell anything
we just said drive like human
and here it is
it's driving like a human yeah
a pretty magical one if it would
actually see the light someone would go
and
yeah
i think it would though because i mean
just of how uh
how clearly it seemed to see the
difference you know rather than the
green lights and probably
if it was in the view would probably
react immediately yeah i think you're
right
we've also got some uh some exciting
updates to uh driver monitoring coming
yes there was some uh notice there was
some
performance with masked users that
wasn't that great
and uh wishing our driver monitoring
team has been
working on making sure the the models
also understand how masks work and that
masks don't uh
don't ruin the performance of drive
monitoring so hopefully that will work
out and we'll have some exciting updates
for you
um by zero eight ten
that was a little late breaking that
yeah very comfortable
a lot of people being like what about
humans with road rage the whole
the whole point of uh
you know end to end is it's like
like it's it's like everybody's driving
right like i don't know how to explain
that yeah i mean i do the crazy stuff
yeah
i mean i think that's a common uh i mean
it's an intuitive thought to have about
that right is you know if you just drive
like humans then you're never going to
be better than humans but i think uh i
don't think that's true so
you would only we drive like the the
model only learns to drive like the the
mean human or the me the median of the
distribution so
um
outlier behavior like aggressive driving
or kind of swerving around in the lanes
kind of shouldn't be the behavior that
the model learns to imitate um that's
one part so we kind of expect the
the me like the median of the
distribution to be much better i mean
you can kind of imagine it though as
don't think of like asking just a random
person to drive and see if you like that
driving behavior but ask a hundred or a
thousand people to in every situation
say how they would behave and then just
take like the average or the most common
answer and
then you should kind of exclude all
these kind of outliers which are like
maybe too aggressive or
too conservative or just generally
mistakes and weird that's one part and
the other part is we can also kind of
steer it a little bit means we can
selectively use conservative drivers
maybe for follow distance and stuff like
that but i mean we're really not there
yet driving like a human or like the
average human would be
not just better than open pilot is today
but better than any self-driving system
is anywhere in the world so
um i think
that's that's not really a
not really a reason to not try to
imitate human driving
yeah that was a good discussion i i saw
the person who said that it was like
joking but it's still a good discussion
a lot of people genuinely have that
question um yeah i think it's a fair if
you say you know drive like a human we
all want it to be better than humans
right but i think
you think there's a clear path to get to
superhuman by learning from humans
yes
uh someone said sorry joining late
is end-to-end long focused on
slow down for turns and red lights and
stop signs or more advanced things like
follow distance
speed based on the scene etc
um
antoinette long just means
uh you know
end to end all the time for all
longitudinal control
which will be uh which includes all
those things which is you know stopping
at stop signs it's better smarter lead
policy
but we wouldn't be able to ship it like
that probably for a variety of reasons
so probably you just want the models to
understand how to behave like a human
for end-to-end longitudinal and then we
can take parts of that and try to ship
those like for example stop lines is one
example of just a part of the
longitudinal policy that we can try to
ship or maybe just smart follow distance
that kind of stuff
yeah so it's the beginning it's the
start and eventually there'll be a
toggle once it's you know in a state
where we want we feel like it's it's
good enough to to try out just like and
then lateral right now isn't a good
state to try out
so
it's gonna be a bit for
a toggle like that to come to your
device but we just wanted to give a
taste on the future
uh because the future is
winning yeah and it's coming the future
is coming yes oh yeah i just thought you
know it's good for people to see what
we're working on you know we're not
we're not just sitting idly by we're
trying things we're working on it and um
try to make it as good as we can as fast
as we can yeah
yeah and uh
some people keep asking about like what
about all the cars that you know don't
have radar that you know like like the
accord for example i think
you know part of research right is is
working on some sort of fully vision
only
solution for those vehicles right yeah
so i mean we've been
i mean i've been trying to do stuff with
vision on the acc
so far there's still some issues the the
model is really not that good at
understanding that a car is slowing down
in front of you if the brake lights
aren't on
and that's still kind of a blocker
radar is very very good at knowing the
exact speed of the car in front of you
so that's
a very easy way to know if the leads are
slowing down and you can be very
proactive in how you drive because of
that
um
and so far we're still struggling to get
the same things from vision but the hope
is that you know humans can dry just
looking at the camera so the model
should be able to drive just fine too
it's just a matter of
of writing the algorithm that uses the
data correctly and this is also part of
why we're
working on the end-to-end longitudinal
stuff it really allows us to make sure
the model understands as much as
possible about the scene that's relevant
to longitudinal behavior and then we can
uh you know use that
to tweak the policy or at least guide
our efforts if the end-to-end policy
also has trouble with slowing down for
uh
lead cards that just started breaking
then we know we need to work on on the
model just understanding the scene
rather than just the policy
cool yeah and we do have an accord now
uh
and i'm sure we'll start using uh vision
only to be testing it out yeah coming
weeks and uh
yeah
uh fred asks why end to end likes to hug
corners that's the thing harold talked
about before where uh
you're better at explaining it than me
that's something you're working to fix
though yeah i mean most of the time if
it's hugging corners it's because most
turns on highways are banked this is to
make it easier to drive around them and
bank turns cause you to kind of slip
into the turn um so they they kind of
make the car turn by itself even if you
weren't turning the steering wheel um
and that's not something that we
compensate for well in open pilot so we
want to make open pilot understand that
the road is banked and have the controls
of the vehicle steering correct for that
so that it's not turning more than the
model ever wanted to which is what's
happening now
hopefully if we fix that then it won't
do that anymore yeah
yeah i know if you notice that's on you
know non-bank roads it's like very very
very good
yeah so we'll get there
and that's probably when the toggle will
go away if it's it's good enough
cool yeah um just to
do a quick
you know recap on uh the contest for
those people who are
interested
oh
look at that we just turned on
navigation
if it works
i don't know
yeah look at that
so
navigation is just uh purely directions
so far but
you know eventually that's the start to
something big
now be on open pilot in the future
um
let's see someone asked have you trained
on comma three data yet
yeah so the model that's uh now in
master that we're hoping to release that
one is trained on comma free data
um it took us a little bit of time to
get that up and running but
yes and so far no models have uh
are trained on the wide camera for
common three
so that'll you know maybe be in the
future
yeah
we're just chilling
yeah i don't know we saw some uh i don't
know if we could do a slowdown for a
turn that can
i don't know this is kind of a random
drive i don't know where we're going
but we stopped for some uh some red
lights smoothly so i hope that's uh
i don't know gives us some some hope
that uh at least the entire models
at least understand that red lights are
something to stop for green lights or
something you shouldn't stop for so it's
uh it's the start of a big longitudinal
project
yes and uh yeah the stop lines branch
you know kind of works
and it's kind of works i'd say it works
a little better than than this but also
it's less fully end to end so that makes
sense yeah this is a much more
experimental yes
uh so yeah i mean you can you know try
out the stop lines branch if you want to
and it'll probably stop for most red
lights and stop signs
pretty cool stuff
uh yeah so just to
you know reiterate uh we got a video
contest going on the way to enter is you
just upload a video to youtube uh with
hashtag openpilot
or just name it like comma three open
pilot and uh you have two weeks from
today to make your videos
and after the two weeks we're gonna
judge them
you know probably have alex here and you
know a d maybe some
diversity in the judging panel
we'll get some voting we can get the
cards yeah
we'll watch them at lunch or something
um so there's two categories first
category is comma three so for all those
over 500 people who have comma threes
let us know how it is you know you can
do a review video on it talk about the
nav if you want not many people talk
about the nav but
i mean it works it's pretty cool you can
input a destination on your phone and
then uh
over lte it just pops right onto the
comma three
so that's a cool feature not many people
know about
uh so that's category one just anything
about the comma three how you like it
how it compares to the comma 2 in your
opinion
any of that stuff is fair game second
category is laneless lateral control
which means you know the steering
control so
you put on that toggle that lets you
disable the use of lane lines you're in
end-to-end lateral mode and it does some
pretty cool stuff now you can see an
example of those kinds of videos on this
very channel
uh in the
video i made
so coming out to another red light here
let's see how it does it's slowing down
look at that
it's a little bit far but it's
delayed for the stop line at least
that's pretty
we're not cool this up it's real
it's not very reliable but that's that's
the start that's the start now we just
iron out the bugs yes and yes uh
correct mark the second category is for
anybody you can have an eon comma 2 or
comma 3.
you can you know just run
the
laneless toggle and you can make a video
on lane list you don't have to have a
comma 3 but on the comma three one i
think you should have come through yeah
yes uh and they're now shipping that's
the big news they're now shipping
limited stock right now so you know if
you buy one right now i can guarantee
we're gonna ship it on monday but if you
don't buy it now you know we'll see
you might have to start having a wait
list again a little weightless get in
before the other people do yes uh so
yeah we've gotten through all the
backlog everyone's gonna get their
comment threes in the mail the next few
days who was still in the backlog
so it's very exciting stuff
a lot of people are loving their comma
3s it's just such a huge improvement
over a comma 2
visually i mean it's just like a real
piece of hardware super cool so you'll
definitely love it if you end up getting
a comment three
uh yeah the big model will let us see
traffic lights um that are currently out
of the model box view so
you definitely are gonna need big model
before we can resume from green lights
and stuff like that for that reason yeah
uh so that's something you know we'll
we'll do if it makes sense we'll
definitely end up doing yeah we've we've
spent some time on this already it's
just a matter of you know going through
and making sure that it actually
improves things we don't really want to
spend time on it until we've figured out
the other bottlenecks i think that's
going to happen soon
yeah i did too
um is there anything more questions yeah
any last minute
questions
silence took some several wrong turns i
think yeah
we're in convoy streets i'm glad you
know where we are
i'm glad you know where we are there's
no discount code on comma threes they're
extremely limited we can't offer a
discount on them because we don't have
any in stock anyway
we have some in stock buy them now but
uh
you know they're they're very
limited they're very custom fully custom
made so
they take a lot of effort to build and
perfect
and if you're wondering how good the
comma threes are gonna be just think
about how good the comma two is now
versus when it launched and just
extrapolate those improvements for the
year and a half two years and uh
i mean hopefully uh you know imagining
some good things yeah i think people
forget
what state open pilot was in when the
the comma 2 launched
you know it was like
you know it kind of worked there was no
end to end lateral at all that's all a
new development
it was a lot less reliable the
software's gotten way more reliable we
added auto lane change that didn't exist
on the common two camera auto lane
change we got
yeah the end-to-end lateral stuff's
really big it's huge huge improvements
yes the stability went up so much
hopefully it'll keep coming yes
so yeah if you think about that
phantom breaking kind of eliminated that
yeah mostly uh
cut in detection was also
cutting detection
someone said open pile was pretty mad
when i got my comma one
or my wave one comma two it's
ridiculously better since then exactly
yes
i'm excited to hear the
the list of things we've achieved over
the next uh over the lifetime of common
threes as well yes
all right
well i guess we'll head out y'all can
start working on your videos and uh yeah
i'll write up a little thing on the
discord that just kind of explains
everything in a brief paragraph that you
can check out
um yeah for those people asking about
reliability we're going to be writing up
a reliability post and doing some
content on that we just need the comma
3s to be out for a few months
so we have some statistics but then the
deep is going to work on a great
reliability post
but yeah common threes you know they're
all new components
they're all made of very high quality
components
you know no used chinese phone so
uh yeah i think you can extrapolate what
i'm saying with that information
all right
so yeah we'll see you all we'll do it
live at some point i mean we'll
definitely see you in two weeks at the
very least yeah sounds good if you guys
have any content you want or anything
specific you want to know more about
that you want us to talk about please
let us know
yeah i've got a blog post coming as well
that kind of just explains how open
pilot works in case people want to
tinker with it or understand it better
we'll try to get out more content like
that yep and uh yeah some more content
you know we'll do some vision only acc
content we'll do some sonata long
content because uh
works with openpilot now if you have a
configuration changed and uh yeah more
more laneless stuff
all right see you guys
hello
no sale on white pandas
people asking about this
i don't know that was the first thing i
saw
uh harold has
the socks on
the comma socks the infamous comma socks
check it out
this isn't selling you guys i don't know
what will and how to
i feel like if you just on the floor and
like we just look at him that works too
make driving chill
it's also upside down oh there we go
here we go
yeah that's nice that should have been
the thumbnail oh well
all right
let's go for a stream talk about the
black friday sale
how are the how are the socks harold are
they comfortable oh they're unbelievably
comfortable you don't even understand
i can feel the coma three through my
toes
that sounds amazing
[Applause]
yeah so for those who don't know
there's uh you have the coral out here
nice
there's a black friday sale going on and
it's uh very exciting because it's the
first sale ever on the comma three it's
definitely the best time to get a comma
three if there's ever been a good time
to get one
it is now and i'm still locked down
there we go
you out there
here it is it's a comma three
all right
so comma three is two hundred dollars
off for black friday
which is wild
uh so it's 19.99 under 2 000. the
cheapest comma 3 ever
there is ever a time to get a comma
three now is it
oh yeah you guys know historically black
friday sales have been the cheapest time
to get coma devices
that's never gonna change
yep
so um if you've been considering it
i recommend now's the time
oh and this is also uh our end-to-end
branch over here
made some improvements since last time
so
go for drive we can talk about that
and just the general progress we've been
making in research a little update yeah
we ship all over the world
uh
ship with dhl
[Music]
stopping for that one didn't get that
yet um but yeah so 200 off of comma 3
and then 100 off a comma 2 if you happen
to want one but really you should get a
comma 3 during this sale if you're at
all thinking about it if you have a
supported car it's really a no-brainer
it's
amazing
it is really amazing
and um
yeah if you've got got too many devices
you know there's always another purpose
you can get a comma body and those come
out
yeah i'm very excited about those
sometime next year probably
there's a lot of unknowns about it but
it should be pretty exciting
all right yes let us know in the chat if
you uh buy a comma three during the sale
during the stream right now and we'll
we'll shout you out
uh
yeah what else should we should we talk
about just some some general updates
yeah give some updates on research what
everyone's working on over there
yeah so we uh just released we're just
in the process of releasing xerate 11.
that's mostly just some bug fixes and
nothing too big but we've got a lot of
cool things in the works we were working
on new sounds you guys can check that
out if you want there's some branches
with the new sounds
should sound a lot better on the comma
three so those are pretty exciting
um then our research we're
we're working a lot on end-to-end
longitudinal this is uh
maybe the latest iteration of that
um we've got some pretty good
improvements coming to the lateral
models the big big complaints about that
were
the exit diving and like it not really
behaving well around exits in general
even if it doesn't take it just kind of
swerving towards it and we we made some
really good improvements uh to that
mitchell
found some pretty cool tricks we're just
still in the process of verifying some
stuff it's always a big process to make
sure there's no regressions but that's
looking very very good and it's going to
be just improvements to lateral all
around
and especially the exit behavior should
be so much improved
mitchell made a data set of
some 20 complaints
of just like
it having issues around exits and then
the new model and those specific
all right we're back you didn't miss
anything
we're just still still driving
still driving
this is end-to-end this is uh the
machine learning deciding how fast to
drive here
i mean i was just kind of following this
car so i guess it's relatively easy but
we'll see later on some turns it should
hopefully slow down appropriately and
get to see some
a real ai in action that'd be exciting
uh what branch is this someone asked i
mean if if you have to ask i recommend
you don't use it
makes sense
see if you can find it yourself
what's the purpose of the common body it
stands there
yeah it looks cool
yeah it stands there
that's it
[Music]
oh what's happening oh we've also really
been there's been a lot of complaints
about just general how old pal
longitudinal is and stop and go
um
so i've been trying to work on that and
seeing if you can come up with a better
policy that matches more like the kind
of drive humans do it stop and go it
should hopefully be a lot more
comfortable
i think on the highway our long-term
policy with lead cars is really quite
good but it's stop and go i think
there's still a lot of things to be
improved
so working actively on that as well
[Music]
that's super exciting
yeah can you tell we're in the corolla
because of the road noise
yeah it's so loud very loud very loud
car
uh
this is nice though this is like a
pretty good yeah it's pretty comfortable
right comfortable follow distance it's
it's definitely closer than uh
pilot is today but it you know this
guy's going pretty slow so it makes
sense yeah let's drive into it
yeah
any any work on big model going on in
the research team oh yeah so we're
working on big model i mean big model's
been this thing that's been pushed off
because every time we tried it we didn't
really see much benefit from it like and
you know if we can't see that big model
would improve a lot of the cases that
openpower is having trouble then i mean
why would we spend our time you know
doing that when we could be doing other
things right so
um but now that with the end-to-end
longitudinal you need the big model to
see the lights for example to go from uh
from a stopped uh stop light to when it
turns green so now there's there's more
incentive to go for the big model so
we're working on that again
i think it'll actually ship this time
what do you think
i think so i mean there's a lot of work
involved but i think now there's really
a compelling reason to work on it
because of the uh
because of what we mentioned the
the green light problem i mean just in
general for longitudinal having context
is quite quite useful so i was actually
intending to take this exit but i mean
you know didn't really want to take over
so
just we'll just see where it takes us
here you can see he's been doing all
this slow down it's been doing all the
speed management around these turns and
so far that's fine maybe it doesn't have
enough look at that
they did it yeah it slowed down a bit
yeah slow down for this turn this is all
just the mall doing it um i haven't
taken over i mean since we got on the
highway so
yeah it's pretty incredible i think this
is very promising
this is that's super promising right
there that was that was amazing i don't
remember it ever working for any turn so
yeah no we definitely made some
improvements i think since last time you
uh
you drove it it's a little bit slow to
get up to speed like this for example i
really should be a bit more aggressive
about it but
it's not not unsafe it's just a bit you
know not the speed that i would drive
right
car detected in blind spot pretty cool
part of that's also because it just
doesn't have the big model view so it
doesn't really have the context as much
about the cars moving around it since it
only sees like straight ahead if it's
all the cars passing it it's usually a
bit more inspired to go faster
yeah that makes sense
man that's super cool and you're telling
me n10 longitudinal will eventually come
to
common threes everywhere hopefully yeah
future
it's a it's going to be kind of an
experimental process to see how we can
ship it and and which parts will be
shipped because i mean you don't just
want to ship full end to end because
there comes with some disadvantages
um
but yeah maybe we'll ship behind a
toggle first or something one i think
the easiest feature that i think i want
to ship first is uh when you go from a
stop if there's a stopped car in front
of you and he accelerates there's a
limit to how fast the open pedal
accelerates now just because of you know
we want comfortable cruise acceleration
but with end to end we can see if the
model is asking for a lot more
acceleration we can increase those
limits so then the crews should still be
comfortable because the model knows that
like cruise acceleration
but then when there's a stopped car
pulling away
it will be more aggressive i think
people really like that that's i think a
big source of disengagement for myself
as well
yeah me too that would be amazing
uh so yeah you can get this comma three
not this exact one but you can get a
comma three for 19.99
from now until cyber monday so you know
really uh better to get it sooner rather
than later i'd say um if you get it
sooner rather than later you'll get
those cool comma socks that harold
showed off at the beginning of the
stream we have a very limited amount of
those and uh yeah this is their 69 value
so go ahead and oh it's such a steal
this sucks 200 off and the socks yeah i
mean it could have been could have been
no deal and just socks and it would have
still been i know the best deal on a
combat three so
yeah guys the best best price you'll
ever get for a comma three get it now
that's right yeah
uh yeah they'll be shipping in one to
two weeks uh we're working on making
them right now so
we sold a lot
so far
oh yeah 2k socks
yeah
i don't know if the stocks are worth
that much maybe they are
um i know is there anything else we
should uh talk about yeah anyone have
any questions about what research is
working on or anything yeah this is a
technical question
[Music]
well doesn't have the torque for this so
yeah
i think the you know the speed it took
it was pretty reasonable yeah i mean
look i still haven't disengaged since i
got on the highway that's impressive
yeah cut that guy off but you know
the model's not generous
but yeah i mean look at this isn't this
incredible this is the power of machine
learning guys you guys labeled this data
by driving the speeds you guys like and
now the model
has a little bit of piece of every one
of you
that's so cute
it's a distributed uh
distributed driving
yeah i'm really impressed right now
because i mean this almost looks like a
highway obviously we can tell and i'm
sure the model can tell but it's not
because it doesn't have more lanes
you know there's sidewalks and things
you can see the speed's been set at uh
you know 70
oh here potentially guess we're going on
a turn
i mean it's not going to make the turn
but it's slow down for it so yeah it's
got it's got that going for it all right
let me take over here
um
that was impressive we had we were
engaged for so long i'm also gonna go to
set up some nav someone asked somewhere
yeah that
make sense i have no clue where we are
but that's okay look at this isn't this
incredible it's incredible
wow there's so many stopped cars around
so it's all right let's take over for
this let's learn here
yeah so that's how navigate on open
pilots coming that's really pushed back
until we get end to end longitudinal and
uh in a in a good state because at that
point really all you have to do is uh
you know put in the navigation
directions but until then it would be
difficult to take you know exits and
everything by itself if it can't slow
down properly i mean yeah if it can't
take like aggressive turns by itself
it's kind of unclear how useful navigate
an open pilot so we kind of want to get
that working first
yeah but as you can see we're working
very hard on that so
um
this is this is the best demo yet it
barely worked before
we're working on it it's making progress
yeah it did slow down for that turn yeah
fully
no yeah the really powerful thing about
this idea is it it costs us so much less
time to improve this because i mean if
the model's doing all the work it's just
trying to figure out how you guys drive
and then trying to mimic that we don't
have to hand tune any follow distances
or anything like that
it's a little bit
lazy here but all right so i'll help it
again for this turn but longitudinal
we'll just let it do its thing
yeah it's pretty good
we'll see if we can get back on the
highway and everything without uh
without doing anything crazy here's the
turn by turn directions which you get on
a comma three
pretty cool if you have prime you can
just uh you know put in an address on on
the comic connect website and it goes
right up to the comma three wirelessly
yeah i can actually use it quite a lot
that is really good especially just if
you just hack consent your work all the
time
where i'm going anyway
this is a comfortable stop too harold
yeah so i mean this is the beautiful
thing about this end-to-end longitudinal
stuff is we've really been struggling
with finding like follow distances and
cost functions
that uh you know a human finds
comfortable it's very unclear what
humans optimize for when they come to
like a full stop or when they're
controlling the breaks but here the
model is just figuring out what humans
do and trying to mimic it so we don't
have to do any like
any work just trying to figure out what
humans find comfortable breaking and it
just does it all itself so that's why we
can get so much more like natural
feeling stops and
breaking behavior without actually
having to
tune anything
yeah we're looking at end to end
longitudinal
again it like slowed down before the
lead triangle came like there was some
stopped traffic up ahead and it started
slowing down before the the radar picked
it up oh yeah for sure yeah yeah i know
it it's it can definitely tell like if
it sees like a big blob of cars and red
lights that you know it's probably a
good idea to start slowing down i mean
that's what we do as humans as well yeah
someone asked is it using radar or pure
vision
so on this branch it's almost
exclusively vision but there are some
extreme limits the radar sets but in
this drive we pretty much never hit
those
so basically everything you've seen so
far is vision only end-to-end
basically no
no
lead policy being involved and no
no radar
super cool
again if i don't know if this hasn't
sold you i'm getting a comma three i
don't know what will i mean
it's doing an amazing job yeah guys i
think i mean this is some of the realest
ai you can experience today
yeah i'm not sure what other products
you can get out here that uh that have
like this kind of real world ai that you
can just use and
like google voice recognition but that's
not as cool
sea world
i didn't get those sounds on the branch
we want to see if we can get those on so
you guys can experience those oh yeah i
just don't have a torque here
[Music]
a little slow but also like i feel like
the model view of this is probably like
yeah very unusable i mean this is
exactly what the big model is going to
be for like it just doesn't see the turn
it has no idea if you're coming to a
stop or coming into an on-ramp
so hopefully big model will really give
it that context
yeah
i don't know is there any other
questions people have about black friday
or the stuff we're working on
anything like that yeah did anyone buy
right now because it's a it's a great
time to get a comma three i just you
should check the the car list again
because we support over 150 vehicles now
so even if your car wasn't supported in
the past i mean we support so many cars
it's ridiculous
so many modern hyundai kia genesis
uh toyotas hondas we even support a
mazda now it's a new brand port that's
coming out with zero eight eleven
uh so yeah the list just keeps growing
for cars that work with open pilot
really exciting and if anyone's having a
bad experience and wants to work on the
tune of their car quadmus made a tool
that makes it really easy to uh kind of
see if the tune of your car is bad and
if there's anything you can do about it
um
so yeah okay if anyone's willing to give
that a shot or think their car could
improve some tuning give it a good check
yeah somewhere in the open pilot repo
some tuning scripts someone asked if it
would slow down
if uh
you're going alongside like slower cars
i mean humans do that so that's the goal
right for sure i mean you've seen this
drive most of the time open piles
engaged and i mean this set speed set to
80 miles an hour so it's just driving
exactly how fast it wants
i was driving 40 miles an hour on this
kind of road here i mean that's all just
all just learned and it definitely will
slow down around other traffic as well
which is i mean really the promising
thing about it it's just so annoying
that if the lead cuts out then it just
floors it even if there's cars around
so
yeah very promising very promising yeah
if you order now it'll ship in one to
two weeks you know we're gonna do our
best to get them out as soon as possible
but get a little leeway just in case uh
but yeah we'll be working hard on
on that
yeah a lot of vw cars there are
yeah do those all have longitudinal as
well
not yet jason's working on but they have
just stuck longer to them yes
jason this will inspire you you're
already working on it so keep it up
yeah so here you can see in this case
like there's no other cars around and
this is all just what the mall thinks is
a good idea
yeah this is perfect real machine
learning guys real machine learning
there's no bicycle detectors there's no
cone detectors no cart i mean i guess
there are car detectors but they're
supposed to not be doing anything
yeah just
just the model in the road yeah exactly
this is the freest the model has ever
been we removed all the cages
just a
free model on the open road
i haven't even got a wheel shot yet
because of how where the mic is so i got
a wheel shot so everyone can see
we're not faking it
there's some some barriers coming up
here i'm just gonna oh yeah you ready to
take over i should maybe nudge that a
little bit oops
i just wanted to be ready
a little bit uncomfortable when you get
so close yeah
hit torque limit what are people saying
let's see
[Music]
jason said he's gonna put the n10 lawn
branch
and drive it in about 20 minutes this is
awesome
yeah it's a little bit jerky still i
think we haven't really worked on like
the the
tuning we're just making sure that the
models kind of work architecturally but
made some good progress on that
yep but yeah end to end guys end to end
it's uh been comma's dream since day one
i think we've got the lateral part
mostly done um and now it's part for
time for part two
uh it's probably the most exciting part
because that means it's going to be
complete
yeah
yes the stuff the socks are still in
stock
that's hard to say but the socks are
still in stock so
place your order now
not that many socks left
not that many i don't have an exact
number but there's not many socks left
and we're not ordering more socks either
so
uh someone asked if you're using the
road texture for anything uh yeah if you
if you check out the new repo
depth 10k right
yeah depth 10k
i'm just going to take over here it's
again can't see much but i probably feel
the viewport again yeah depth 10k is
pretty cool because the come with the
comma 3 cameras you can see road texture
you can see you know potholes everything
you could never see these things with
the comma 2 camera it was just so blurry
so
yeah comment what's the what's the goal
of depth 10k if you were to
explain it harold
um
yeah just i mean we just wanted to open
source data set so that people can also
you know train depth nets like it's
appealing to a lot of people that are
interested in machine learning and i
mean the kind of driving models are not
that accessible to either train or or
really work on
but stuff like the depth net and the
segment you can do yourself and uh i
mean we're very interested in depth nets
because
there's quite a few reasons devnets are
useful one is that for a model to
understand the depth of the scene it
also has to understand its own motion or
can give you information about its own
motion so it's a you can if you train
the depthness end-to-end it's a
completely end-to-end way of
understanding the motion of the car and
the road which can be very helpful tool
for just processing in general
um that's one part and the other is if
we understand the depth of the scene we
can make a 3d map of the scene and move
the camera around
for simulation
so i don't know if you guys have seen
like the simulator that we train in we
train in a simulator where you can kind
of move the car around so that you can
kind of deviate from the trajectory the
human drove and with depnets you can
have very good reconstructions when you
move the camera which i mean the better
the reconstruction is the better uh the
model will train so
that's kind of the motivation there
for localization in like an end-to-end
machine learning way and for uh
simulation
cool that's a great explanation
some people were just asking what end to
end is it basically just means uh drive
like a human you know
it's the easiest way to put it if you
really boil it down
yeah
yeah if
for this drive i mean basically if what
we would normally be driving an open
pilot we explicitly detect the car with
the machine learning model and then we
keep some distance away from that car
depending on our speed and their speed
and then the end-to-end way is we just
train a model to understand how fast
humans drive and how humans accelerate
decelerate and then just tries to mimic
that so this entire drive even right now
open pilot has been trying to mimic what
a human would have done in these cases
which is completely different from the
non-end-to-end way which is just detect
the lead car and stay some distance away
from them
you can see here for example that the
lead car is pulling away and this is
much larger than the following distance
you would usually keep but because there
is relatively slow moving traffic around
it's not really incentivized to speed up
and this is exactly what we want we
don't want the lead here to pull away
and then you to floor it past and
overtake cars on the left
so
that's kind of
the beauty of this whole end-to-end
thing yeah this really is with the flow
of everybody yeah it's like we're not
we're not going like 80 past all these
people you guys get that pretty well
emerge conflicts
[Music]
pretty cool stuff
it was that was great did you see the
flood harold
yeah yeah
our highway flooded
wild stuff
um
what a successful drive
so yeah coming soon to comma threes
you know with that wide uh
that wide camera it's really gonna help
us do more
cool stuff on the research department
soon
this guy didn't indicate the model is
supposed to understand that
but you know how like when he merged
over like he didn't slam the brakes
either no
i mean it's it was gonna be super smooth
right this is also it's gonna be as
smooth as humans are the problem with
the end-to-end policy is kind of hard to
make it aggressive and it needs to be
aggressive make it smooth and needs to
be smooth but i mean with the normal
lead policy with the end to end just
figure it out yep yeah someone was like
saying how is it uh how is it like
conveyed what the model's doing and you
know we we hired a a ui ux person
recently sent an offer uh so i think you
know when everything's full end to end
the ui might look different than it
looks today
yeah so you got to convey what the model
thinks
you know like the path is really good at
that for lateral i think but yeah
there's probably some way to do that for
longitudinal so stay tuned
yeah i don't know if you guys have ever
played drift three but you know when you
play on like coach mode or whatever it
shows you the path it shows if you've
got to accelerate or decelerate
i don't know i'm not a designer
that's what i have in mind heavy too
that's what i was thinking
but it's true we do have to convey
pretty clearly what the model is
thinking you know moving away from these
kind of literal clues like uh cues like
lane lines and cars and to something
more holistic and then
i mean there are ways we can ask the
model about why it's doing things but
it's
just got to figure out how to convey
that clearly
yep
yeah i guess we can do one more recap uh
the black friday sales going now until
cyber monday but the socks are very
limited if you want to get free socks
uh
you want to show the show a sock
oh yeah
keep my right foot ready for uh for a
take over here but uh there it is
driving chill
the other side has a comma on it go to
the beginning of the stream if you want
to see that
they're really good socks yeah the socks
aren't in the store right now you can
only get the socks by getting a comma 2
or comma 3 during the black friday sale
and it's 200 off a comma 3 that's the
cheapest the common three is ever gonna
be so if you're at all on the fence you
have a car you wanna upgrade from an eon
comma two whatever i think now is the
best time to do that
and uh
yeah definitely
get one if you're interested i mean
great stuff is coming in the future i'm
excited guys i'm really excited i think
you guys should be excited too i mean
you guys have seen this drive i took
over
only only maybe like five to ten times
it slowed down for turns it slowed down
for traffic like a human all by itself
um i think i think it's just
the future guys this is the future and
it's it's coming
always future is now oh it's not seeing
this it doesn't seem or does it oh it
sees it now
well i managed to do it nice gotta merge
no problem
someone said i love mine
yeah but it's a beautiful device it
really is the screen's really nice the
cameras are super high quality
uh you know there's a reason it costs so
much uh it's a very high quality device
you know custom designed hardware cheap
to make these qualities
exactly
would buy it if i didn't have a common
two
well yeah any new people just got a
comma three you know it's amazing but if
you
haven't ever tried open pilot and you're
like man i i don't know i really need to
experience it for myself we still are
offering the the try a 2 upgrade to
comma 3 program so you can buy a comma 2
right now try it for up to 90 days and
if at any point within those 90 days
you're like oh i want a comment three i
should have got that uh you can just pay
the difference so that's a pretty cool
program too on common.ii compare
but i would just get a comma three at
this price come on say we're gonna be
this price it's never
so the guy's asking like when is this
coming have we ever answered a question
with a date like that
it's kind of hopeful though
coming in 61 days it's gonna release
this is all experimental guys we wanted
to come as soon as possible
but uh yeah i mean we're pretty
transparent about what we're working on
the end-to-end long tunnel is a big push
right now so
i mean more it's more likely features
like that are gonna come out before
navigate on open pilot i mean and then i
think once like highway slowdown for
turns and exit taking is really really
good i think then navigate and open
pilot makes really a lot of sense for
the next step
but guys i mean we've never given really
timelines or deadlines we're trying as
hard as we can
it's all very experimental very hard to
uh
have exact timelines when nobody's ever
done anything before like this so yeah
there's real people working on it yeah
so we're not just like
keep it in a branch somewhere and never
never touch it again we're actively
working on it um so it's very exciting
it doesn't break for green lights it
goes right through them it does yeah it
goes through stop signs sometimes too so
i guess that needs to be worked on but
hopefully the field of view will help
yes
any plans to remove set speed in the
future i mean no you always want to be
able to tell the maximum speed you want
to just go wild
yep
[Music]
yeah you really need a car with lane
keep assist and adapter cruise control
are there some people who've gotten
really old cars to work but you
basically need to put in a new electric
uh power steering rack and everything
no we don't break for overpass either
yeah overpress i mean that's a that's a
common radar problem right because this
most radars they don't tell you the
altitude that uh metal object is being
detected so you know for example the
overpass right in front of us has a
metal on the railing
and unless you filter that out somehow
for the radar that looks exactly the
same as a stopped car right ahead of you
so that's why this can be an issue but i
mean we've since
since i don't know quite a long time
over a year now two years basically
always had the vision model decide
whether there is a lead car in front of
you or not and
which
car that's detected by the model would
match for certain radar point so
everything is really controlled by the
vision and by the model so that's what i
mean that's why we don't really have
those kind of radar only false positives
yep
cool
well good stuff yeah i think that's all
i got unless there's any other questions
so i got this is the smoothest stop and
go drive i've ever had with open pilot
like usually you're like
you know because it's it's right floor
it then it's gonna
you know
some guy moved up five feet and it it's
ready yeah but now it's really
in the relationship because of the users
man you guys labeled this
this is uh it says you guys in action
thanks for driving well everybody the
comma fleet combined yes
wow look at that i mean
that was amazing
um a b isn't affected by anything like
this like the toyota does the av yeah i
know there's no uh end-to-end av no uh
at least not the different one then we
do have a vision based aab that will
trigger if it thinks there's going to be
very high deceleration according to the
model but it's not
perfect
[Music]
there's where we work san diego city
back home back home great well yeah
we'll see you all in another stream at
some point uh but really get that comma
three now if you're at all interested be
sure to share the deal with your friends
anyone who has a compatible car it's
really the time to get one right now so
i highly recommend getting one uh well
it's 200 off
exactly
and the socks
cool best socks
cool see you guys see you guys bye
peace
I think we'll wait for some people to
get in here
or in the open Pilot lounge
all right and Harold's coming over to
join us
he's right around the corner
all right
so Harold's here he's joining us
remotely from his comma body
and we'll go uh
Harold's gonna lead us to his office
so this comma body has a hat and
training wheels
it's one of a kind right now
and it's being remotely controlled
nope
it's stuck now nope
this is the first step in shipping comma
security to your comma body
and telepresence
Harold do you want to show us
this is the website Harold's been
working on the last couple weeks how
cool is this did you see how smoothly I
made it over here I only got like once
yes this is the experiment we've been
working on on the Kama body so uh
you can control the body from uh from a
website we're making and we're gonna
we're just experiment you can come show
the the website I guess it's very
primitive right now but we wanted to get
some cool stuff working so you just you
know go live stream you can control
uh you know with the keyboard
just some experiments we've been working
on Tesla bot competitor exactly look at
this doesn't this look so much better
than Tesla block it doesn't have to walk
so you don't get that problem fixed
we'll get you off the hat it kind of
looks like a crown oh yeah I got a
little Crown here that was just for some
localization tracking experiments
unclear what the future that is but you
know the wheels help a lot on the carpet
so uh yeah I've been driving around it's
pretty cool we'll see uh we'll see what
comes of it we kind of him you can clean
it up and we can uh we can have some
wheels in the store and we'll have some
kind of security uh security website you
can go to you can log into your body
from anywhere to drive around the office
that was kind of the idea
um you know tell me about your dream
what's my dream oh about the the Rover
my real dream is with the uh
put the the common three on a Mars Rover
and we send it to Mars California which
is a real town in California that looks
like Mars and just you know you can we
can log in from the office and we can
drive our real Mars Rover around
so that's the long-term dream but for
now it's just that in Office security so
um we'll see how far we get
um yeah what do you got next recipe you
wanna oh we should introduce ourselves
oh yeah but this is the part we forgot
last time we'll do that this time so I'm
Harold I'm CTO at comma been here for a
while
I'm a deep I work on open pilot here at
comma it leaves a charge of open pilot
you know he gets all the PRS merged or
rejected if they're not good so
all right and then we'll should we go to
some empty rooms we're hiring for quite
a few positions
each other two empty rooms I guess yeah
it's a little more interested in hiring
for right
you guys might see uh we've got some
beautiful metrics up here oh yeah we've
really been putting in a lot of
disengagement mattress those are really
cool metrics are cool this is something
we've been recently working on
it's uh wishing or driving monitoring
guy made all these so it just kind of
shows all these different classes of
disengagements which is like either
longitudinal or lateral or you know if
it's turning turning too tight not
turning tight enough
whether it's uh you know some kind of
low speed disengagement whether it's
followed by heartbreak or Excel by the
user so kind of help us narrow down what
people are disengaging for and hopefully
you know fix issues more in a more
directed way yeah and we've got the
controls matcher come on up there you
can compare like your Individual Car
to the average of the fleet and you can
kind of see well they're uh
how good your car is compared to like
the top open pile experiences yeah I
mean we've been struggling a little bit
sometimes we've got cars that you know
are performing differently and if we
don't have them uh this has been an
issue so far in trying to make them sure
they perform well but with these kind of
metrics we can we can hopefully
understand what's happening even if we
don't uh on ourselves
nothing here
so we've got two main rooms that are
open ready for hiring 51 what is this
one in the web room yes this is for the
web team the web team is one person
right now and he works in the open pilot
office
but once it's two people this will be
your room
we're even gonna get a cool neon sign
like that one in here once it's the web
room
um
web three it could be whatever you want
to say
um
and then we've got one more open pilot
office here that's empty
uh this is just for any open about
engineer who wants to come work here
yeah
we can show you guys the manual office
too
I think we we did stream from here and
then uh this is where the open pile team
works right now
Cameron is on the web team so you'll
join him if you join the web team and
you guys will move over to the web room
all right cool
Hangouts
ready for some chilling
all right should we go to the Ford yeah
that's a court so what we're gonna do
we're just gonna demo is there anything
too yes we talk about some of the nice
UI updates the Ford
yeah sensors
what do you mean that there's bathrooms
[Applause]
we have really good
oh that kind of PR
uh
so you know we've been trying to tackle
some kind of heat issues like the device
with this we can simulate the Sun
uh it should be a full Texas mode around
Dubai is
all right we got the Bronco right here
they're looking back yeah I think it's a
better angle
coming release
yes
the more information you want to give
about the Ford in general so we're
showing off uh the Ford Bronco sport
this is our personal Ford we have in our
Fleet
um
it's new in this release the Fords are
quite a nice platform somewhat similar
to Toyota where they're mostly the same
all the stream quality is like a potato
I don't know if we can fix that oh you
and Wi-Fi Realty well I just switched to
LTE let's see it's my bars
oh bars look good
so yeah I think it's fine please try
F-150 support yeah so the F-150 is
pretty similar to this one actually the
only difference is it's candy so it
needs the red panda and the steering
message is different they use like a new
one for blue Cruise
so that one is should be very doable
um one of the tricky parts of that might
be to finding an easy place to install
it
um we had an F-150 in our office briefly
and uh do I have a route you want to go
on uh
I guess yeah I'll show off experimental
mode
[Music]
I know there's a lot of buttons uh it's
all right you can press a bunch of
buttons yeah
all right
experimental mode right yes
all right
so we should see it stop for that
upcoming stop sign
[Music]
you guys might notice the New Path
we call it Rainbow Road
all right
and as soon as we're on the on-ramp the
one accelerates they should turn green
[Music]
but yeah about the Ford platform so we
support six and the initial release zero
nine two that will support them
and uh
we can basically support any that have
the lane centering and art canopy pretty
easily you just have to add a
fingerprint essentially
um
full green on the on-ramp yeah wants to
speed up
can you go see that UI
F-150 without blue cruise but has
adaptive cruise and Lane centering uh
yeah probably
we might put up a bounty for the F-150
because the monkey is also the same
platform
so everything is there for you except uh
it won't steer so if you want a fun
little project you can get a comma three
and uh play around with that it'll like
parse the speed it'll do all that for
you it just won't steer
we'll just Drive North a bit on
experimental mode right and see what
happens yeah let's do it so this is Ford
long that's not shipped yet right yeah
so in zero nine two it's lateral only
but the exciting thing about Ford is we
should have the radar and preserve AEP
so we should be able to ship uh
longitudinal as a default to release
pretty soon after and then it'll be a
toggle in master like
oh it's gonna be me yeah oh so we should
be released yeah so it should ship the
release fairly soon
yeah the Fords are super nice they're
like the tss2 Toyotas
yeah it's a really good platform I mean
the steering at low speed is really good
how are you guys enjoying 092 so far
to see UI from here
stream quality isn't helping
let me zoom in a little bit yeah I mean
if you can't see it basically so there's
two big changes to the UI that we made
092.
first is we added for end-to-end
longitude the path is going to be green
and parts that it wants to accelerate
and relationship part is equal to
decelerate
clear indication of exactly what the car
is going to do
when it turns along
it changes
show the model predictions of what the
model one should do
the model outputs go into like a
planning system in a PC and that outputs
the actual plan that the car will try to
drive and so that's what we show now in
the UI it's more smooth and also really
that the path doesn't
[Music]
do
it
if you have any questions no questions
we have some other highlights from zero
night too good if I should boot up quite
a bit faster
we've also got a new model in there
trained with a new data set
we're kind of hoping to ship new models
like that fairly frequently that might
not have an impact on you but we feel
very confident about our testing we
should be able to ship refactors and
stuff like that
[Music]
to make changes
[Music]
uh when is your nine two being released
so it's in develop right now and it'll
be in release uh it's slated for Monday
is there anything so we're still writing
a blog post anything you guys want us to
discuss in depth in the blog post
is Maverick support
I believe so
you can go on the compatibility page
right now comment AI slash vehicles and
that's all up to date
it's a lot of cars
um a lot of car support yeah
coming to bolt with zero Knight two
below six miles an hour uh no
but there is some bolt tuning somebody
wants to know what's special about the
Nicki Minaj model
[Music]
but that doesn't mean that it's really
that good at navigating on open pilot
yet it's just kind of an in-between step
you should really I think
yes Cameron confirmed the Maverick is
supported if you've got a Maverick you
can head on to the site and you can buy
a device and it'll just work on your
Ford Maverick
the low speed in particular is really
nice they'll enter in Long on the Bronco
and the other Fords super nice
I think from 20 to 40 miles an hour
oh yeah the other thing when we made the
changes to the MPC to uh support drawing
we noticed there was a small bug that
caused this small amount of truck
cutting that's been fixed so in some
cases people aren't getting
because of this and so this is an
improve
D oh we've got the hiring battery to
talk about too I forgot about that
so we're going to announce a hiring
Bounty where if you refer somebody who
we hire and keep around for two months
you'll get a comma three and three
thousand dollars
so if you know anybody refer them
we'll take our challenges we'll
interview
and you can get some money
how close are you all to releasing Taco
drives for production
[Music]
salary they're not really shipped by
default
it went long you know which is an
experimental mode right now
right now and the other is Navigator
mobile so Navigator local pilot is what
we're working on pretty hard right now
so we want to shift navigate as soon as
you enter this
is using the map as an input
um
so it should take exits it should try to
take turns
yeah so that's a working progress I mean
there are branches that do this some
people have been trying them you can try
them if you want to kind of see the
progress but we're still figuring out a
few more things before
the thing is that this affects all
driving this is a pretty big
architectural change to have the model
also understand maps and to take maps
and input and to rely on maps
a lot of new tests
visualize taking so long but yeah we're
focused on that
where can I find more info on the Bounty
hiring program uh we'll probably tweet
about it maybe Alex will tweet about it
today
um you're all about hiring what's the
salary for a few years of experience uh
I think typically Georgia said in people
ask this if that's your first question
uh might not be for you
um take a look at our challenges if they
look like something that you'd like to
do
let's say try it out
if not it's probably not a good fit
anyway
anybody have hiring questions we'll take
Oak pile questions hiring questions
can I buy an F-150 to add to my C3
uh it won't work out of the box but if
you have any software engineering
experience it should be a very doable
project all you have to do is you know
the message is already defined in the
DBC
I'm not quite sure what's left to do
with that I think I might be figuring
out the checksum
but it should be pretty straightforward
like maybe a weekend or two weekend kind
of project
playing something
so if there's anything that's been
bothering you about all pilots and
annoyances please talk about them you
mentioned
sounds great but I'll talk about them
and I know one big one is people wonder
just to follow distance the reason that
hasn't happened yet is just you know we
want we want to guarantee that cars will
slow down in time and accelerate in time
and that's harder to do when there's
multiple settings for the car to be in
so that's why it's taking so long but
everyone wants it so I think we're going
to make the effort to do that to offer
us like be sure to follow just after now
and along with one
customer support engineer role must that
be local in San Diego
I think so but
you can email and if you think you're a
strong candidate but
um I mean the bar is kind of high for
all rules
[Music]
does anyone have any complaints yeah
complaints are just as good as questions
yeah
they've got some good thermal
improvements coming in the next release
we're hoping to ship 093 pretty quickly
we know 092 took a while it's kind of a
big release
um
093 should be out
kind of on a normal Cadence
what else do we have later first we got
some good stuff we want to try to do
some UI stuff
where are we uh we want to improve steer
saturated and the minimum steer speed
and kind of show them continuously in
the UI so it should show you it's kind
of deviating and then it's not just a
sudden alert you get um
should expect it and perhaps you take
over beforehand you don't get an alert
at all
yeah most people I think you
car that's been
limited coming up that it's not going to
be able to make it and it's kind of
annoying to have to be alerted every
time it's annoying on some of our parts
like the Civic so do that more smoothly
one guy says his Civic ping pong's a
little on the highway if you post in the
Discord a driving feedback Channel
um it'll tell you how to make a good bug
report and then we can look into it
uh no real complaints though I'd love to
see experimental mode for the bolts uh
external mode exists for the bolts in
non-release branches so you can run
devel or master
also it's it's kind of alpha right
yeah I mean if you post complaints on
Discord about like driving behavior I
mean may not necessarily reply to all
complaints but we definitely look at
them and it's a very helpful way to for
us to kind of steer what we fixed and
what we think
you guys see how smooth the steering
wheel is is the Broncos like one of the
best new cars we've shipped in a long
time
one is torque controller steering coming
to the rest of the fleet uh the metrics
that we showed you guys are one of the
first steps to that uh
we've kind of been doing a piecemeal but
we want better ways to evaluate this so
what car does that person have it's
Jason so uws
have you thought about inverting mats no
we're pretty particular about this but
one thing new in 092 doesn't affect you
guys who are any users is endog is the
default now
it was users vastly preferred it about
60 of people toggled it
um and if you don't know the acronym dog
it's no disengage on gas so you can use
the gas pedal to override the toggle is
still there so you can toggle back to
disengage it on gas
um but it's up to you how does the
testing simulation work for testing
end-to-end launch signal experimental
load Behavior
well I mean
the simulator
car from its original position
this means we can also
be slower than it did which is how we
can't
since we have very limited range it's
you know if you do debtory projection
you move the car forward the model back
while you start getting artifacts
pretty limited simulation and this is
why that we're not making more progress
on that as soon as we
I mean we're working on machine learning
simulation that should have no limits as
soon as that works we'll get better
tests for internet long and can also get
rid of
it right now these are good questions
good questions
uh RAM start Speed yeah only some of
them start at zero
um what can we expect 2023 policy
Antonio official support list on Sunny
uh
I know it was a big change I'll ask
Shane when we're back
you can always ping Shane if you have
like a some car stuff
um it's always hard to prioritize that
there's so many new cars coming in the
ecosystem
um
once the holdup for nav on op and
experimental mode and master
ship it uh directly to a release to
master as the default so as soon as you
put on the map and I mean what's the
holdup thing I was talking about a bit
before
um it's just
it's a massive new input that changes
you know everything in driving because
now the model will learn to look at the
map and rely on the map so if the map
has issues this can cause issues so
there's just a lot of tests we have to
write and a lot of verification but yeah
I mean we're working on it uh there are
a lot of branches that do this if you
want to try to show you guys the UI or
at low speed
the New Path
or I Got a notification that you uh
unbucked with your seatbelt you see how
the path is green now
I guess that means it's accelerating
yeah and then it's gray
[Music]
it's green again
and it's cool because it shows you how
much it wants to accelerate at which
point in the path before it was one
color and it wasn't very stable
it was just quite your eyes uh
all right guys we'll get that out of
this uh
it's already a bit better than last
stream
you know we're not very good at the
streaming stuff but we're learning
it's like everything else we do get
better every time
iterate no regressions
but at least we introduced ourselves
this time so we're making progress
this experiments mode use map data at
all for speed limits no
that's all machine learning based the
idea is kind of that you know the
machine learning you're thinking about
how fast is your drive is kind of the
best uh we can do and then if you want
to abide by the speed limit you should
just set the crispy to that and then
[Music]
fighting hard for comma we definitely
need competition to keep everyone on
their toes
does it try and reach that Max Speed no
it just uses it as an upper bound
[Music]
just join what Ford is this going to be
available for it's oh an XSI what's up
Nick
um
so it's available for six boards the
Maverick the Bronco sport
kuga and a few more you can go to the
website right now type in Ford
um and some linkins
was there anything very particular about
the interface of these new Fords uh I
mean what do you mean this is the
the first Fords we support
only new models will be supported
lockout still not hacked that is correct
Ford is one of the biggest Auto in you
yes this is kind of the last Big Brand
we didn't support it sounds very
exciting
and when we've got the F-150 we see we
have lots of ram users
[Music]
we're trying to get your RAM 2500 and
3500 it's Upstream soon uh FedEx working
on that
yeah the ram was a whole bunch of these
shoes it's taller than any car we
supported it's heavier it's got
different weight distribution about
different steering interface
are the checks some of the hybrids
different yeah so there's an issue with
the Ford hybrids in particular
um
Shane suspects it's an issue with
messages coming out of a particular
Gateway on those cars
um we had to revert them for this
release into the quality it just wasn't
up to where we wanted it so you'd get
random corruption
um
of some of the checksums in the counters
which the uh we found the the stock
camera was very much okay with but uh it
uses this other signal called the
quality flag
we all should make it so you can live
stream right off of the comma three yeah
pretty soon with the body hopefully uh
we want the remote control to be very
good very soon it's kind of the first
step
kind of experimenting with the body with
the stuff like live streaming and you
know
this stuff
inspires the improvements that It
ultimately if you need to open file it
too
so if we can control the body through
connect and live stream the audio and
the video and control the body that you
know likely will also end up working for
the comma 3 when it's in your car so
you should just be able to connect to
your device whenever you want Sentry
mode yes install on the list
how long do you think before we can buy
a C3 install F-150 plug and play and use
it we don't really give timelines but
um there seems to be lots of interest in
the F-150 and it makes sense so we'll uh
probably put up a bounty for that
when requesting a maneuver on the
Gateway what do you mean a maneuver
thoughts on Tesla going end to end I
don't really understand their version
scheme they're going from like 11.4 to
12 and some unknown amount of time
whenever that's end to end end to end is
the only way anyway so like it makes
sense for them to go into it but we've
seen nothing from the release notes that
uh imply this is
what they're working on it's surprising
but I think they're end to end in this
case means that they are really use they
use have a classical perception and then
hand code planning yeah and so I think
what they're doing now is they're doing
uh so classical perception and then
machine learning planning but there's
still a human understandable
intermediate layer as far as I
understand
so it is a step closer to end to end but
I wouldn't say I think it's not I mean
Elon Street was ambiguous but
it sounds more like what we're doing
than that I don't know that's what I
read somewhere I don't know
this might be full anyway
but either way I mean Android is the
only thing that makes sense we've been
saying this for years
anyone try out 092 driving on Master a
lot of you guys are on Master these days
there's like almost 300 of you
plaster is too reliable does third
Paradigm use overrides to punish the
model during training
Paradigm is kind of hypothetical at the
moment it's not like we've trained
anything like that but yes if we do that
yes
right now we're getting the humans in
the loop with that cool dashboard
I wish this wasn't potato quality it's
kind of a nice drive
Bloomington California's brain Master CI
hasn't failed to build in a long time
great testing well Master CI won't it
wouldn't get pushed the master CI but
I appreciate the comments about testing
testing is very important
it's why we can do so much with this
multi
[Music]
I think we'll do a couple more questions
and then uh call it a date yeah
say two more questions
anybody got anything else
that you want yeah anything you want us
to fix anything you want to talk about
in the blog post for zero nine two
I think the old website looked more
clean and professional
uh
yeah I mean we're constantly iterating
on the website
I think experimental mode and chill mode
should have separate Cruise speed
settings
I don't even know how that would work
that sounds confusing
here in Brazil we don't have this Bronco
the BSM is sophisticated equals
BSM
progress to Taco quote I don't know what
that means
we're getting a lot of random comments
now no questions uh
just to ask questions blind no I know
that's what BSN means but that didn't
make sense in the guy's question
also who's comma Brazil I didn't know we
had a Brazil division
so
one guy is pretty active in the
community from Brazil it was a RAV4
oh you did mean blind spot monitor the
BSM is good equal to it
I still don't understand the question uh
is there a plan release for navigating
on open pilot
I mean you're talking about this twice
now early on the Stream So I mean do you
want to tell them
uh yeah I mean the plan is just uh
I think there's there's some work in
progress
in trial branches if you want there's a
few more things that we want to do with
them we'll release it but yeah the plan
is to go not to experimental but
straight to uh master so as soon as you
ever put in a lab destination I will use
the map oh progress to Taco meaning he
wants an update on taco stuff uh
yeah I don't think it's time for that
maybe it wants to get we should navigate
our pilot if you have points from the
corner Raiders like ev6 uh no
what's now the biggest Auto that's
unsupported
um
probably Toyota security
as far as Brands were pretty well
covered now
23 Prius looks really nice
all right guys I think if no one has any
more questions
we'll just call it there
all right guys thanks for tuning in
if you've got any complaints post
another Square
thank you
orientation is locked rotate device back
there we go
gimbal doesn't seem very stable now I
gotta figure out the gimbal
should we start there we go
oh that was pretty cool
I'll rotate again okay there we go what
oh this isn't a vertical
okay
on gimbles
I think there's a block there we go what
oh this isn't a vertical
oh there's another audio okay
I'm gimbles
can you see it
on what on your phone oh
yeah oh yeah you're like yeah but it's
the orientation right
[Music]
huh well anyways hello who everyone's
here
exciting first Black Friday maybe if I
if I do this
we're flipping everything on its head
just like our prices
uh no it's still still okay so should
this just be a vertical stream
it's a vertical stream now
okay fast forward
is
oh now we're straight okay oh they want
Shane
let's take a quick tour of the open
pilot office Shane there
still a little web team
all right guys so we are hiring in most
teams we'll start off with a quick uh
quick little tour of uh the whole new
office space see uh the the great
workplace you might be able to work at
Kurt Kurt our new GPS expert
Cameron shipped our new website last
week pretty cool so working on lots of
connect features for you guys and then
uh you guys all know Shane over there
he's working on car stuff
hard at work right now
and then the testing closet
and uh just a reminder that we're gonna
win
in the Deep the legend uh the legend
himself sits by the wind sign
s how many Secrets did we show on all
the whiteboards uh none
our beautiful wall of uh metrics see
this shows all the failures
oh Chris is in there
what's up Chris
you can come play ping pong here oh yeah
this is our Super Hyper competitive ping
pong room
the level used to be very very low when
we got the table but at times have since
changed and now
everyone takes it very seriously
all right so we make our way over to the
rest of the tour so go downstairs or we
should finish upstairs uh I could show
for operations just walk around and
we're gonna show off the gym oh yeah
yeah let's show them our new gym if you
guys might remember bathroom land
we are hiring hired for most teams so if
you if you like what we do you're
interested in working here please check
out if there's a good fit for you
so our work in progress gym
you want to say hi
this is very exciting I didn't even know
there's just so many rooms of this
office
[Music]
yeah
thank you
yeah oh my God we got yoga tomorrow
I didn't realize that thing goes on the
wall
yeah and you can see our Courtyard down
here
a Christmas tree is going right there
all right all right
we're still working our way over there
oh we're having ice cream on the way
oh the department hacks is a little sad
right now yeah but somebody can come
here and build a great Department of
hacks
yeah we had this grandiose idea to have
a room dedicated to employee side
projects but as you can see it's just
become a storage unit we've been hard at
work it's on zero nine for you guys I
thought there wasn't that much time for
side projects but hopefully that'll
change
a little run through
you can take them downstairs yeah let's
uh let's go down so what's your plan
indeed should we talk to Hardware team
uh yeah do you want to say hi unless
they had a hardware team
all right Harvard team's downstairs
all right but so deep what's the plan
we're gonna go downstairs we're gonna
check out production yeah and I see all
the cool stuff they're doing we're gonna
get a new device and here's our keys
we're gonna get into a car and we're
gonna have a customer experience yeah
oh we should start off with the website
we can do that downstairs yeah
do they have any questions so far if you
have any questions about zero nine
uh I just see a comment that says zero
nine adult question
there's never been a better time to buy
uh common trees it's a pretty incredible
deal new version lower price
is more somebody says this isn't Twitter
HQ no it is not
is that the Corolla oh Shane brought it
out in front for us
I think you're supposed to use a
joystick yeah
oh that's cool
about the nav model
all righty close the door
all right here's the devices you will
not get if you order on Black Friday
these will go back and be fixed
this is production team
should we started circuits book yeah
let's go all right
too much
so circuit spoke is uh there's some real
amazing it's some real a real production
line conveyor belts you're just going to
put parts in and comma three come out
yeah
all right so it actually starts over
here
Victor is programming our jet printer
and then devices uh I'll be cool if we
got a device in each state but
this is a little hard to turn
so devices start out here
they get the solder paste jet printed on
and then they go over to the pick and
place
is all the components
and then over to the oven on this
conveyor belt
all the way to our
turn
all the way over to aoi where they get
inspected
you can see the line is rolling right
now very slowly oh my God I didn't
realize it was already operational
no we're not using boards from the line
yet
um can you give us the rundown of zero
and I move that in the car
what else good vegan we do have vegan
food actually yeah we've got pretty good
vegetarian food I don't know it's vegan
and vegetarian the same so our vegans
yes
calm
new head office we only have one this
this is the head off yes
he's pretty cool
it'll take lots of pictures of your
comma three all the lenses switch out
super fast
make sure everything's working
oh that's our custom 3D printer board
oh I think they're having their meeting
right now
I think we shouldn't disturb them too
much all right
hey
quickly walk through all right this is
where your devices get built
yeah and the drive
yeah
all right and then shall we pick up a
device should we still in the process
so we started the website and then we'll
go and pick it up I mean we know how to
buy something all right
fair enough I just wanted to show off
the new website
but uh we do have a new website check
out our new website and we buy them
right here
and we've got
our first Common threes being fulfilled
for Black Friday
Ada where can we uh take advice
pretend we just bought one
where can we take one bin we don't like
it we'll return it uh they want to know
which bin they can take one out of one
of the way whichever
um so we got a basic Edition
what's the difference between all the
storage variants
all right great we got a brand new one
new device we're going to show you guys
the first install experience
and then we'll go for our zero nine
drive and we'll talk about the details
yeah so we're going to use the wide cam
on this I mean I thought we tried that
and that was technical difficulties yeah
I'm gonna show them the fleet
so more ev6 are uh yeah a Chevy bolts
our beautiful Taco Bell car over here
about
and four weeks time
oh okay
we've got our exit all right
and this is just one other two garage
space
all right we should figure out how to
rotate too
let's figure that out okay
it's your very first setup
okay
we've got a brand new device brand new
device still got the screen protector on
so I'm just gonna plug this in and uh
see what happens oh it's just a store
more driving data
for your dash cam videos and such no
performance implications
all right I plugged in I'm just gonna
drive outside because the security guard
is very confused
up there
foreign
security
oh this is good
[Music]
I should stop over there oh but we got a
Wi-Fi range maybe we should just make it
right
[Music]
it's uh
[Laughter]
all right we got the Wi-Fi put in
all righty what what happens now
I don't think I've ever done this
procedure all right now click continue
continue
of course we want to install custom
software custom software
alrighty
let's do that
what now open file.com
wow this is really simple and that's all
the users have to do that's it after
they pay 18.49 on the store yep where is
the Accord the cord is back in the
parking garage
is there an option for in-person pickup
no
as we can have time to receive uh
clients we've only got 15 employees
oh wait it's already installed
yeah I told you it was fast zero nine is
great virtually Chris might come out of
retirement nice great looking forward to
the videos all terms and conditions this
is the smoothest growing products
variety agree begin training
boom boom I've done this before guys you
guys should read what's going on I know
what I'm doing
tap on the alert
not on the alert
yes I want to upload my data tap on the
max speed how fast can you ship we ship
same day two-day shipping just like
Amazon press the pedal
all right finish training all right are
we good to go no we gotta we're on chill
mode
on experimental mode
um yeah let's do experimental mode oh
they say take the plastic off they can't
see the screen okay let's take the
plastic off that's beautiful
I felt kind of bad at doing that it's
such a beautiful screen I don't know
let's use the uh let's go through the
normal flow on the off-road what's the
normal flow turn off the car oh you
haven't gone through this have you
no let's see what's going on there's a
click on it on what oh it is yeah oh
okay wow this is cool
all right I'm out of chill mode Let's Do
It experimental
new driving visualization end-to-end
control yes please uh it turns red oh my
God look at it we're on experimental
mode
are we ready to go we're ready to go
let's go for it
or drive
when do you think the knee will be ready
to chip fortunately not super soon
and unfortunately some other priorities
are
taking that over for a while but I think
you guys will enjoy the results
yeah do you guys have any more feedback
on zero nine or questions about that are
you going to sell that unit after the
Stream
we'll uh fix it up and give it back to
production
[Music]
battle with comma two no
comma three only
so we are waiting for it to calibrate
which is pretty quick calibrates really
fast now
there used to be a time years ago when I
think it was like a 40-minute Highway
Drive was required to get it to
calibrate
it was really embarrassing and then you
accidentally reset calibration and you
go to drive another 40 minutes
but uh no longer by the time we're on
the highway should be good
I think someone asked to go navigate on
open pilot I guess should we talk about
that
yeah let's talk about nav
so yeah one of the future so there's
really three big features that we've
been working on for the last you know
that's like kind of the plan which is
the first is end-to-end collateral
planning so it steers like a human that
we've already fully shipped that's been
shipped for a few releases now then
end-to-end longitudinal planning so I
can control the gas and the brakes like
a human that's been what we've been
focusing on for the last few months and
that's what experimental enables
and then the last one is navigate on
open pilot so we would want to you know
humans look at the map to know where
they're going oh is there no map no
we didn't set up prime or we don't have
Prime so we don't have a map on this
device to show up but once you once
you've uh
you need to make sure you calibrate on a
road with clean Lane line no no
as long as it says calibrated you're all
good
so the way the calibration works is it
just looks at the way the car is moving
and uh can know kind of the orientation
of how it's set up assuming that cars
generally move forward
works everywhere all the time
as long as the camera can see the road
so we're not enabled in end-to-end Long
mode so it's doing everything it's
steering it's deciding how fast the
drive
your updates it's kind of useful I think
it's super huge one corolla
so let's see how this goes
we're trying to go to uh
somewhere around the downtown oh it
really doesn't want to rotate
[Music]
restart
all right guys we'll come back in a
second
you can't really see that much
[Music]
all right we're back let's get fixed
okay
and
you can pay us to fix it for you for a
hundred dollar labor
so it'll just be cost to Parts Plus
labor or you can do the repair yourself
for just the cost of the hearts it's
live on the shop right now if you want
to go check it out
but basically if we show the map of the
navigation of where you're driving the
same one that you can use in the comma 3
UI to get where you're going we just
show them all of that map and we can
tell the model
that's where you want to go and I should
kind of figure it out by itself we're
kind of working on that with the side
right now uh there's uh some branches
open but they're not really close to
being very functional yet we're still
[Music]
okay but that's how we're planning to
get to Taco Bell put in the Taco Bell
destination press engage and the rest
will just happen by itself
[Music]
um
what else do they need to know do they
have any questions does the lane change
use the blind spot sensors yes it'll
block on them right now
um eventually we'll start using the D
cam for that and some Corner Radars on
cars that have it
but yeah it'll prevent you from making
the light change if it takes the car
there on the cards I have them
actually I don't really
how many of you guys have comma threes
right now
what's your ETA on Taco now as usual
there's no ETA we would love to know too
I'm on Taco nav no just on taco
oh I mean you know the deadline was the
end of the year we're very motivated to
get there
and as you can see we're really working
pretty hard we've got uh
longitudinal
[Music]
um
[Music]
[Music]
let's hope this somehow ends up with a
an interesting place to drive it's kind
of improvisation without the enemy
nav I got more questions about zero nine
no not yeah you guys have a question
about zero nine zero nine one the Black
Friday sale this is the cheapest time
ever to buy a comma three so get him all
you can or if you're thinking about
applying for a job you have any
questions this is the time for questions
yeah well we're uh but as you can see
here uh open Pilots deciding how fast to
drive 55 is a pretty reasonable some guy
asked us to slow down on curves it's
slowing down right now yeah it's slowing
down I mean the lead's quite far away so
that's not really what's deciding his
speed right now this is just entering
long things this is a good speed uh this
part of the road yeah usually it would
like lose the lead in a curve accelerate
a little bit catch it and you would have
these big discontinuity so we don't have
uh Navigator no pilot here so we're we
have to take
theirselves
and then this is a really hard part this
is what we'll likely still have to
improve in the future it's like slowing
down on the off-ramp but let me
I mean it'll take the stop sign
I think it wouldn't have stopped at the
time it'll take over here
is a GitHub roadmap correct and zero
nine means feature complete
oh
I mean pretty feature complete we know
what everything looks like right now I
mean there's only really been three big
things that we're working on which is
like uh navigate on open pilot and twin
lateral end to end long and
we've shipped into it long now in an
experimental mode and we're working on
Navigator and that's that's what we
consider like feature complete no match
is not coming stop asking about it yes
you could set the destination from your
phone
well it's crazy to Edge case you've seen
so far in user data
[Music]
there's a lot of edge cases
will it swerve around cyclists Maybe
uh it's getting a lot better at that
kind of stuff like making making good
lateral decisions and moving around for
Stuff
the URL to install 09 is open
is there a revised talk about right from
the new office
same route
slowed down for this big dip how do you
train nav from Gregor
um so we train that by just uh inputting
the map of the image and then ground
truth thinking on that
so so we show it where the user went
we tell it if the user wanted to go
there because our first red light went
down for yellow here we go that's very
human-like
comfortable stuff look at that Antoine
Long last night I had it to an
unprotected left turn it was pretty cool
crept up a little bit stopped and then
went
straight
things that doesn't go
um yeah shall we still with the image we
showed the navigation that the uh that
would have taken it where the user ended
up going and then we say given this
navigation input left here
given that information
um then just plan the best thing to
match the human trajectory and that will
just work with nav so that's how we
grounded it and
we've got some experimental branches
that work but uh we're
we're still fixing some bugs hopefully
that'll be pretty good soon
some guy asks he had a comma too he
tried it out but the follow distance was
too long so we've since shortened it but
with end to end this should just be once
we
have more conservative lead policy it
should be pretty human-like yeah I mean
the promise is just it's hard to
find something that's not too long in in
all situations and not too short in all
situations so it's a bit nuanced but
end-to-end is really good at getting
those differences so it should feel a
lot more comfortable all the time
well different Drive modes that we
created Beyond chill and experimental so
yes but so chill and experimental are
they're not quite driver aggressiveness
profiles they're more if you want the
polished experience or do you want to
try the bleeding edge stuff
um so we'll have another thing on top of
that that'll allow you to select
um that'll be somewhat like a follow
distance but it'll be uh aggressiveness
kind of slider
yeah so this is this here right here is
a really good example of the kind of
stuff that oh oh and just stuff the
orange light
okay you eventually read the OEM
followed it's in settings and adjust the
follow distance
[Music]
um
so I mean that doesn't really have
anything to do with n10 long it's more
of like an experienced question and
until now
this is how we've uh designed the
experience
oh the Corolla yeah you have to click
resume if you engage at a stop it's a
Corolla thing we should show an alert
where do we go but yeah this is the kind
of stuff that it's really improved a lot
in zero nine like moving over for these
top cars kind of avoiding these cons
before it was a lot more lazy and kind
of reacting to these obstacles around
but you can see it's planning it really
well here the set speed is 45 it's
driving a reasonable 21.
does it stop it stops as well yeah it'll
do everything it just drives the uh an
appropriate speed and from that you got
stop signs lights yeah slowing down for
turns I mean it's still like uh it makes
mistakes still quite frequently and and
the easier the situation is the less
likely it's going to be to make mistakes
like these really clear intersections
like these ones are the ones that
struggle the least with
but this is slowing down a little bit
too much right now but I mean it's still
comfortable
like the speed limit here was 30 and it
was driving 20 now it's accelerating
back up
it's definitely not perfect but in a lot
of cases it makes pretty sensible
decisions I mean it's definitely more
chill than you know the ACC policy which
would just accelerate to your set speed
every now and again I have it on the
wrong mode and I engage and it just
accelerates I'm like oh no it's broken
but it turns out that's just that's just
ACC policy I don't know
and then some guy asked again what the
different storage means it's just for
your dash cam video so if you don't
care too much about that just go for the
basic Edition it'll work exactly the
same for open pilot
yeah any other questions
has anyone tried out the end-to-end long
yeah this guy says Excel is great
oh the new XL from stop yeah yeah we did
fix that in this release uh a lot of
people were complaining about how slowly
accelerated from a stop and so we we
bumped up the uh explode speed
acceleration for the ACC policy so
hopefully that fixes some people's
experience
does it read and adjust speed to current
speed limit signs so again it doesn't
explicitly do any of this it looks at
the picture the same thing you look at
and it just chooses a speed to drive
yeah yeah so in these last few uh
last last 10 minutes or so it's been
selecting the speed the whole time and I
can just tell by looking at the scene
you know the parked cars around at the
road all that it knows what's a good
speed to drive is you don't you don't
need to tell it to read the speed limit
signs or anything like that yeah so I
see a lot of specific uh questions about
like very particular scenarios
um we we don't look at any of that stuff
it'll just slowly get better at more
nuanced scenarios
um as we refine it it should just kind
of do something that's generally correct
but maybe it won't be super comfortable
right now
want the drive data to create the emmc
chip no so we tested this the uh we
tested the flash really extensively
before we started shipping the Basic
Editions
um I wouldn't be concerned about that at
all
you you would have to be driving for
years and years before you even start to
be concerned about that
[Music]
yeah and turned long it's supposed to be
a lot better in like stop and go traffic
kind of in the situation because it
accelerates much harder when necessary
and is also more chill when it sees it's
like more of a stop and go scene
[Music]
is the inside camera able to see outside
the driver and passenger side windows
yes
definitely love zero nine and ten long
slowing down stop signs are Hit or Miss
yeah that's our experience too
yeah I think it's really quite good if
you use it uh properly
if you don't uh just try to let it take
every stop sign it'll generally kind of
slow down and then if it's not going to
stop in time or if it's doing something
you wouldn't do just take over and then
re-engage
taking over and re-engaging should
always be very comfortable
how did you cut the model training Time
by days
oh I mean yeah
cutting the model Trend so now I have to
press resume oh yeah you gotta press
resume if you engage it'll stop with the
Corolla oh I see if you can get your
stuff yeah yeah so cutting the model
training time was a very very long
project we probably that was probably a
main focus for about six months or so
what we were doing is we had many many
training steps that we had graduated
into over time so we were training maybe
four models and one had to train and
then we had to run that model on all the
data and then the next one had to train
and it was just all the training times
it originally took long there were many
steps and so we just kind of
re-architected the system with all the
steps removed and then spent around six
months actually trying to ship this
re-architected system there was just so
many subtle bugs and differences and
things that we ended up seeming to rely
on even though that wasn't intentional
but so that was a that was a huge
project to just kind of simplify the
architecture reduce the total steps and
then on top of that we upgraded to a new
data center with much more compute and
improved our infrastructure so it used
to compute
[Music]
it was it was a very big thing it wasn't
like one trick one so very hard work
from infrastructure machine learning and
everyone
yeah it's very exciting now we're
shipping models almost every week
sometimes multiple models a week so the
pace of improvement is really pretty
incredible
yeah I mean we went from Shipping like a
couple models in a whole year to over
the last month we've probably merged
five new models
so um it's really paid off these like
six months of really hard work and
improving the flow you want to talk
about some of the cool tests we have
like the uh the hugging test the speed
convergence test
uh yeah sure so
one of the reasons that we're able to
iterate through malls really quickly and
ship them with some amount of confidence
that they will improve things if we have
a huge test Suite that
test both in Carla and in our own
simulator that uses real data they
simulate certain scenarios and they
change a few factors they check how the
open pilot will drive if you give it
certain issues like we can introduce the
steering wheel lag which some cars have
we can introduce like steering wheel
noise and so we can check how openpilot
drives in all these different conditions
with noise without noise with lag
um and then we can build up some amount
of confidence that it will drive well
the real world and now for rent went
long we've got uh similar tests for
traffic lights stop signs uh all in in
both Carla and in our own simulation
stack
and that means that you know you can
make a change and you can kind of look
at this entire Suite of tests and kind
of build up a picture of how open pilot
will drive without ever having to
actually get into a car which is
incredibly inefficient
you can see cones it's uh well pretty
close but
made it around that's something we had
in previous releases we were trying to
get get it to be better at just
detecting my cones and obstacles is
something that's historically
so we got a few questions doing more
work on RAM yes we got a lot of new cars
recently so we're kind of just going
down the list
but yeah expect the ram to get a lot
better
kind of I'll probably be trying to press
the resume so you're probably talking
about GM yeah we'll fix up the GM
why do we get torque limits so often
with the latest two models on knft which
car are you talking about
[Music]
um I bought a comma two two to three
years ago what tangible what benefits
would I actually see by upgrading to a
common three
I mean this is it it's chill driving on
city streets I mean if you're on the
last stable comma 2 release there's
really actually quite a lot of
differences between uh comma three and
uh comma 2.
we've obviously shipped these like
experimental features now with
end-to-end long let me just stuff that
they stopped light by itself
um but the lateral control has improved
so much we have now very good systems
that automatically tuning for most
platforms the steering wheel is super
precise it used to be
turkey
fixed so many different cars
yeah I think there's just so many
improvements across the whole stack that
either like subtly improve the
experience eliminate bugs and then
there's like the major stuff like this
end to a long thing I mean just check
out the release notes um and the blog
post for this release it's really
predictable
um
release
I mean so we've just been engaged for
like five minutes now
stoplight
there's been obstacles
on the road there's been cones they're
pretty reliable one guy asked us to take
in multiple frames yes takes in two
frames
it takes in two frames at a time and
then it takes in the white Cam and the
narrow cam as well and then it also has
a history buffer itself so I can
remember stuff
was the U turn manual yes
so yeah the the for the cases where we
had to make like decisions like making
turns or exits that's manual for now
until we have Navigator and open PAD but
on this whole Road here where there's
been like cars parked a little bit in
the lane and there's been stop lights
and all the speed selection that's all
been fully automatic so here it's going
to come up to a stoplight again that
should be no problem
I was gimbal is so hard to use all right
trust us nobody's touching anything it's
stopping for this flight I mean you
don't have to trust us it's the cheapest
time ever to buy a comma three buy a
comma three if you don't have one if you
don't have a supported car you can just
rent a car buy a comma 3 and if you
don't want to keep it you can send it
back return shipping is paid for that's
actually a good idea for your comma 2
users for asking what the difference is
I mean if you don't see the difference
return it it's you got 30 days yeah it's
easy enough to just drop in it's uh same
harness and everything
all right so no questions asked for
just uh give it a shot return return
shipping is paid for so it's a really no
hassle experience I think it's all
automatic too you don't have to talk to
anybody
if you always wanted to try it and
you're going on a road trip and renting
a car just rent a Toyota Corolla that's
supported get a you a comma three try it
out what's the fork though it's not a
fork so it's openpile.com this is stock
open pilot zero nine we're driving on
the release
master has already got a new model but
uh we'll save that for next time yeah no
this is all uh completely standard stuff
uh no no weird one-off discounts for
fifteen hundred dollars that was a
one-time thing
I don't even know how to do that
I'm not figuring it out
um
can't recommend a C3 enough
way better than C2
uh is e2e just one single model that
does it all yep just one single model
that does it all
so it's trained in a simulation and we
simulate all these all conditions in the
one training run
uh lateral noise longitudinal noise and
that's it shipping same day yes we're
shipping every day not just this week we
always ship every day two-day shipping
immediate fulfillment installed now
so tries to avoid cones and parked cars
what about people or anything else I
mean we don't really distinguish between
these things the harder it is to see the
more open pilot will struggle but in
general oh I'm gonna take over here
resume
hey it's a Corolla work so this is the
first disengagement over these last uh
five to ten minutes and several stop
lights and obstacles and everything so
give you an idea of kind of where the
end-to-end long is that it's on on
easiest roads it's uh it's relatively
reliable
and the rest is uh gonna come soon
[Music]
ER took my C3 to Italy this summer Edie
will never figure out how their driving
style works
foreign
might do better than you someday
let me try to get out of the city
[Music]
what else we got are there any more
questions so they don't even have
questions about working a comma do you
train your models also uh yes we train
models oh whoops I don't understand what
that question means oh on EU roads uh
yeah so we've got majority American and
Canadian data but uh we do upweigh the
uh
the importance of non-us and Canada data
in the training set so that we can get a
bit more driving style diversity and
we've got users all over the place
China South Korea Japan Nigeria
India all over the place so that's all
in the data set it's obviously it's I
think around 50 American Canada now and
50 the rest
anyone have a comma 2 and they're still
having doubts about buying comma 3 today
how is Greg's work on torque limits
helping with OP I don't really know what
that means comma Brazil says Brazil
That's cool what does common Brazil do
what's that is that a common Europe
I think there's one guy that drives a
lot in Brazil
in the data set
uh
[Music]
I would go check out the Brazil office
that sounds cool
what are you rocking there 2020 Corolla
or is it 2019 I think 2019
yeah it's a tss2 Corolla so
probably 20 20 maybe 2019. yeah I think
this is our most popular platform right
if you include the hybrid I mean yeah
if you just look at the top ones and you
merge the cruel I think you merge all
the Toyotas and RAV4 is still on top oh
really yeah but Corolla Prius and the
RAV4 are all up there
all right well there's a lot of cones
here in the city today this is a real
real uh really putting the stream to the
test here but didn't didn't hit them
fine went through a yellow light
[Music]
if there's some uh confusing Lane
markers on the road
doesn't even flinch
yeah no I think you guys will be
impressed with zero nine it's in lateral
it's really a lot better at all these
nuanced situations like cones or faded
Lane lines or kind of the road starts
curving just slightly s turns that stuff
has gotten so much better in this
release
hopefully you guys will find that
exciting
any ideas on displaying converged
Auto-Tune
oh we talked about that this morning
uh
It's Tricky
we want to visualize something but we're
not I'm not exactly sure yet how how or
what so but it's it's on our uh it's on
our roadmap does Edie do anything with
speed bumps actually yes uh probably
slows down a little bit too much
um but yeah it does see them right now
if red lights are working that might be
enough for me to upgrade I appreciate
the stream guys I mean red lights are
probably a reason to get you in but
you'll notice all the subtle things and
you'll just it'll feel a lot better
um these things are just really hard to
communicate on the highway it should
still be a lot more comfortable yeah and
confident
the steering has gotten so much smoother
we've spent a huge amount of effort over
the last uh probably roughly 12 months
getting the steering from being like
good enough that it will take the turns
and everything relatively well to really
feeling like that kind of superhuman
smooth control
um
and if you've got a car that's recently
gotten tour control which is our like
new way of controlling the cars you'll
definitely notice a huge Improvement
I think internally that was the biggest
like feeling of whoa this is a big
Improvement in a while everyone that
drove on it was like damn this feels so
much more human-like and smooth
maybe we should have done that zero
eight seven release uh like the launch
comma three release versus zero nine
that would have been cool to do on
stream yeah but you guys can all try it
out I think you'll be uh surprised how
big of a difference there is
see how it accelerates here to the um
to the highway speeds
I'm honestly kind of impressed with how
well the end time I told you the Corolla
is really good
you've got to believe me now that the
Optima has the best steering I mean it
failed on one of the stop lights and
everything else like 10 stop lights it
did Super smoothly very human-like
picked a good Speed Most of the time
like this is very very good here 45
miles an hour it feels super in control
yeah
it's slowing down here normally wouldn't
do that
what's the next toggle to be added and
or removed I have two I want to remove
but uh they're not super easy I want to
remove Lane departure warnings and and
uh reset calibration button
but uh I really want to pull the trigger
on a C3 right now but my biggest issue
is disabled a b when doing long on my
Hyundai well but you you don't have to
drive with that necessarily you can just
talk ACC
and provide a lot of value I mean yeah
this ede long stuff on your Santa Fe is
probably also not good enough to daily
drive so you can always just flick it on
for a couple drives try it out and then
hopefully you know we have something to
replace it soon enough
so it's always a choice it's an easy
toggle
yeah compared to like the stock Hyundai
systems open power is a lot smoother on
the highway
I can vouch for ede light handling wet
Road avoiding puddles Etc most of the
time on 0813.
I hate the lane departure warnings well
you can turn them off I want to make
them good and turn them always on
the data on how many actually use the
lane departure toggle yes I think it's
like 25 percent
Ed braking feels really jerky on Civic
Toyota long Glide probably Smooths it
out it says Chris
yeah that is possible there's really
quite a few differences in the in the
long control
we're working on kind of unifying it a
lot currently we've mostly been focusing
on the Toyotas in the Hyundai's just
waiting on eating a long slash a b issue
to go to C3 so I'd say ede long is good
enough for you to you know be excited
and have a comma three I wouldn't really
wait on the a b issue I mean it's
like I said it's a toggle you can try
out you had to add long when you want
and then just go back to stock ACC
um but I mean hopefully you're engaged
and a b is essentially uh you have
cruise control
it's uh largely mitigates the need
so I mean the hope is you'll be largely
engaged with Anton long and then
a b shouldn't really be a concern in
those scenarios so uh op also does have
four Collision warnings
I don't know if
you use those but if there is a case
where open pilot thinks it cannot break
in time but there should be more braking
uh you'll get a rep alarm
my friend is buying a Tesla with FSD
will I be able to one-up him with a C3
on a 22 Camry I think so I think it's uh
I mean it's not quite an FSD like
experience it's uh I think experimental
mode is still pretty chill
um certainly more chill than FSD
but uh definitely does some cool things
when are you going to get another VW
Audi uh actually Ford is next Maybe
for this week I don't know about VW Audi
is Albert Einstein monitoring blind
spots on his Lane changes solicited no
[Music]
we're coming up back home here so
probably to wrap
all right any final questions final
questions
for the exclamation point yes we're
excited too
and that should have long pretty soon
we can do long at the camera
long and Chevy we have a bolt
man everybody clicks bolt on the website
it's uh
I know people love the Chevy bolt that
what do you guys think of the new
website too
yeah that's a good question can Edie
break as hard as stock ACC so yeah we
have the iso limits uh same as your
stock ACC
o self-drive soon
[Music]
no no opinions on the website
like this it's a great website I know
I'm very proud of it new site is too
green does it have that much green
your website is nice ordering harness
would be nice if it had a search yeah
we're working on a web teams working on
it does anybody else want to come here
and work on web stuff
Shane had to uh
do a shift as the web engineer last week
he wasn't super excited about it he's
back on cars this week
love the new site thanks for the hard
hard work guys
it was all Shannon Cameron
what do the people think of the new
price
hey you web stuff no our web stuff is
gonna be nice Cameron's working really
hard on connect it's a lot of behind the
scenes stuff
he's uh doing an incredible job
whoa what's going on there
I'm a game
Old Town pests
C2 and C3 use the same Mountain no but
like if you're super excited and you got
your comma 3 it'll work but you should
probably switch them up there's just a
small part of the white Cam view that is
obscured by the old man he's Edie long
using Vision only so
the end time policy is but it also has
the rate it falls back to the old lead
policy which uses radar
Volkswagen policing is supportable
cruise control
any way to support uh not sure go ask in
the VW Channel we have a great
Volkswagen maintainer who knows
everything about Volkswagens
goes for the stop sign
it's really pretty human-like do you
think there's a point where radar isn't
going to be needed soon uh yes we it's
so good that we haven't written the
radar parser for our ub6 yet
yeah we then turn long a lot of the need
for the radar will kind of go away
the reason the radar is necessary is
just it's the easy way to write uh this
is the cruise control is to use the
radar with the incredibly accurate lead
speeds and then to write some simple
logic but that's not how humans decide
to drive on the highway
all right guys all right the first drive
on ooh C3
back at the office
uh
does it look for oncoming traffic to go
to stop sign
I mean it's all
again
also that radar adjusted quite a bit
recently yeah it works really quite well
I was hoping I wanted to go take a
four-way stop sign
uh sometimes
it'll be long for a Honda boss supported
in experimental longitudinal mode yes
but yeah that still needs some more to
be smooth what's the web stack
github.comai connect
go check it out
any more questions
hmm
is that it guys
any more zero nine questions what's
coming up
zero nine experiences
well if that's all they got all right
guys
buy a coma three
if you don't like it send it back it's
gonna be cheaper than it's ever going to
be biggest sale ever
what do my column points do
uh I'm not really sure they look nice
you should be very proud I have a lot of
comma points I'm very proud of them just
go live more often but what do you want
to know
I feel like this uh we didn't tell you
guys that much we'll do a q a every now
and again if you guys have questions
I just didn't get that many questions I
travel for work how easy to temporarily
switch to a rental car uh I'd say the
hardest part is probably removing them
out but if you've got a nice like
workflow for that then it's really quite
easy
um extra cameras needed for full
self-driving
uh we'll see we should be able to make
uh Lane changes with the blind spot
Monitor and the interior can pretty
relaxing this guy says bye I think it's
done all right see you guys
[Laughter]
should we wait for some people to come
on right now yeah we've got 38 so far
that's cool we'll let you guys uh hang
out in the
hangout area
before we start with the announcements
but i'm very excited about the stuff
we're going to talk about today i think
everyone's going to like it too yes it's
a real
the people are winning it's exactly
people day
people say it's the people's release
yeah you really did
really went for what people wanted
part strapped is also a very people's
thing exactly it's in the description so
people can kind of guess but
all right make sure you guys yeah with
the portrait let's talk about it so just
out now
what are you gonna do here i'll go to
the shop
oh i'm gonna go to shop first yeah
check it out if you scroll all the way
down
new parts all right let's get some parts
wow look at that oh my god
look at this
you can assemble a full comma three with
all these parts don't you guys just hate
it when things break on your electronics
and you can't get replacement parts
well not a problem anymore for the comma
3.
yeah so every component is there and
like for example when you buy the
cameras you get the screws to attach the
camera to the logic board
you buy the heatsink you get the screws
to attach it the only things like we
don't include is the thermal paste so
you know buy your own and then there's
also these parts we don't sell down here
that i conveniently linked just the
wi-fi antennas and your own ssd but
other than that
uh you can build a comma three just from
all this stuff alone which is really
exciting
yeah i'm super excited about this i mean
if you throw your comma three at a rock
and uh the screen breaks don't worry you
could just buy another screen you don't
have to uh you have to buy a new comma
three if i was a user i'm very excited
about this yeah look it goes right to
the digikey place where you get the
antenna pretty cool if you can buy it
from somewhere else i'll just give you
the link
how nice this is so generous
yeah this is super generous so you know
even if a comma 3 goes out of warranty
and like i don't know you drop it in a
camera cracks you can just buy that
single camera we sell each camera
separately yeah some right to repair
stuff oh you get to choose which which
camera nice that's pretty cool
cool yeah we're very excited about this
um
yeah if you break your screen like you
know that's not carved on under warranty
traditionally because you you dropped it
so in that case just uh go buy a new
screen
nice cool really easily
yeah i think
this is a really good one guys i think
yeah
i'd be very excited about this yeah and
you can you know if you wanted to go
down that rabbit hole buy every part and
build a comment for yourself but just
know it'll be a little more expensive
than if you just buy one from us so why
wouldn't you do that
fully assembled
there might be someone out there who
would rather build it themselves but oh
and maybe we should know it yes let's
let's note this disclaimer real quick
yeah so only covered if it's dead on
arrival no warranty on these these parts
i think that's pretty pretty small but
yeah that's pretty normal for
replacement parts
yeah but if you know somehow it parts it
on arrival obviously we'll replace it
other than that
test all the parts before they get sent
out so it'll all be good
yeah you can stop stressing now if
you're worried about like always one
small thing gonna break my entire comma
three at least now you have the
opportunity to you know to some
reasonable extent fix it yourself
i think i'm always very into right to
repair and stuff so i think this kind of
stuff is very exciting i think this fits
in well with open source and i'm
guessing you guys all think the same
thing so yeah i'm pretty happy about
this one
great
well i'm gonna talk to indeed
we got some new
hiring things uh that dean wants to talk
about real quick so
oh we could show the
it's not fully decorated yet i mean
there's like one
one or two one comma two there's one old
comma two half comma two
it's pretty funny oh what's this a comma
christmas tree
i have no idea
what is that oh it's a speedometer
and then of course some some comma
ornaments
yeah we're really celebrating christmas
over here
what does that even got for us
all right all right
so i just want to quickly show for some
job post things we put up over the last
couple days
um maybe we should probably just go to
the screen
all right so we really want to hire a
car interface engineer this was
previously the safety engineer job
posting
um but that doesn't quite capture what
we're looking for um
so basically we're looking for somebody
to join the open pilot team and kind of
own all the the whole car experience and
the car support
so we support i think it's 156 cars
right now that's crazy yeah yeah it's
pretty crazy i think we hit 100 this
time last year so the cars are growing
quite quickly
and this is thanks to like good testing
infrastructure and the tools we've built
but there's still tons of room for
improvement
so basically you'll come here you'll own
the internal fleet and the external
fleet
and kind of
improve the bar for quality and really
build tools for the community to develop
really high quality carports
and then along with that
you also do some safety stuff
like when it's time to expand the safety
model
you'll be kind of thinking through that
and writing all the safety enforcement
code for car reports and verifying
cool
so
um i'm sure there's somebody out there
in the community who'd be interested in
this job
basically a software engineer who knows
some things about cars but you know of
course you can come here and learn stuff
about cars
um there's not
you know if you're if you're a good
software engineer
this should be a good position for you
yeah i think this should be a pretty fun
job
and then we've got
this one just went up a couple hours ago
production engineer
so this person will basically um
kind of be at the intersection between
the open pilot team the hardware team
and you kind of work to make sure that
the reliability of the device is where
we want it to be and you do this through
testing infrastructure procedures
debugging devices that come back root
causing them
so this could either be somebody with
like great software engineer who knows
things about hardware
or you know a great hardware engineer
who knows things about software but
we'll be kind of expected to write
really high quality software this isn't
just a bunch of like weird test scripts
all over the place and yeah we run them
this is
pretty high quality testing
infrastructure we're developing
and help us kind of scale production and
do this well um
with super high reliability on the
devices
eric said that's what he currently
is does
you're a software engineer do you want
to work here
um
yeah yeah yeah it says excellent python
and linux skills and t-plus plus like i
don't know if you're a great software
engineer and you don't know python it's
pretty easy to pick up but yeah
come here and you can feel free to reach
out
really looking for people to uh kind of
kind of own this stuff yeah
like as you can see and we have all
these devices here it would be great if
somebody was
here to uh
debug them more immediately here is a
device yeah
this one is stuck registering
oh this one was fixed but you know place
that's this should never happen oh this
one has a wild problem this one has the
greg problem oh the greg device yeah
if you could figure out what greg is as
bradley thanks to me greg has uh
no greg nothing fixed
so that's a first job of the new
production engineer it's fixing greg
watch that up for
we're also looking for another open
pilot engineer just generally have the
open pilot team
so
if a car engineer or production engineer
don't sound like uh your kind of thing
we're hiring for open pilot energy or
either san diego or rotterdam the other
two positions are just san diego yep
so gotta be where all the production
happens
yes
a lot of cars we have a lot now too yeah
we got some great parking now yeah
common prime can reach our parking it's
very exciting that is exciting yeah i
was i was pulling logs today and it just
worked comma connect is is getting a lot
better
i don't know if we talk about it too
much but come connect really has some
cool stuff you can now like request to
upload certain
uh certain files off your device and
they'll just pull over i mean i saw that
that was pretty cool yeah you just did a
great job with that yeah so connect's
getting better everything's getting
better people's really connected
people's release for everything movies
the martial
yeah i think the park shop is a real
people's thing the people's release of
open pilot it's like it's for us too
it's more for us than we do we don't
like to buy parts that we do all right
we will go for a drive in the stream
we'll uh we'll check out all the i think
cool exciting
things uh
i mean i'm very excited about i think we
fixed a lot of things that people were
complaining about that we were
complaining about so i think this is
gonna be really great release yeah
things that have been annoying for years
are now
finally finally getting some attention
all right let's go for a drive i think
i'll meet you outside chris it's great
sounds good
yeah i'll put it on lte
um
glad to hear everything's going well
with the the new unit
all right i'm just gonna show off one
more thing
i think this is pretty cool
uh you know the the software engineers
have a have a christmas tree but we have
a christmas wreath
and we also have
a charlie brown christmas tree
and it plays
plays the music
so uh yeah we're working really hard on
getting all the comma threes out from
the black friday sale uh
so far we haven't even you know passed
any deadlines and we're really ramping
up so for those who are still waiting
definitely if you haven't received a
shipping they will yet expect one
probably next week
all right yeah let's go meet harold i'm
gonna go on lte so i'll cut out for a
second
okay she'll be back
here we go
all right harold
all right
so we gave you guys reasonably priced
repair parts
and now we're going to give you some
software as well
so the first big thing that we've spent
a lot of time working on for this
release
is uh
behavior of the lamest model around
exits
it's been a
frequent complaint that when there are
uh these types of exits that are common
in america where they split um from the
lane without
any dividers
that own pilot sometimes kind of splits
the difference or takes the exit when
maybe you shouldn't have taken the exit
or just kind of swerves a little bit
towards the exit so mitchell has done an
incredible job on this he's been working
on on improving that for quite a long
time
and completely reworked the way we
classify what exits are and how to
behave around them
so we're going to try that today oh
jesus christ
all right
there has to be some live demo issues
here so
that's a one-off
um
it's real live when it's not
pre-recorded
this is uh getting all these streams of
all the negative effects of live demos
but all the uh
none of the disadvantages because you
guys aren't here so you don't even
believe it
anyway that seems to have gone away hear
the new sounds by the way oh yeah
another people's release
thing take a listen
yeah so the first thing is we put a lot
of effort into better exits the other
thing is the sounds um you know the
sounds on the comma 3 didn't sound that
great it's it's very difficult to make
sounds that sound great on
you know
yeah run master
on devices like a comma 3 or a cell
phone like cell phones have good sounds
because they've put an incredible amount
of engineering effort in making those
tiny shitty speakers on the phone sound
relatively good
so yeah this is master by the way this
is how it's going to go to releases in
a12
um yeah so it's like an early look at
812 a12 will be you know coming out
pretty soon
has to go through the whole testing
process
yeah so we're going to start off by
trying some exits here so like i said
mitchell has reworked a lot of how we
classify exits and deal with exits in
lateral control i think this is the
biggest complaint people had about
lateral and so we're going to try that
out make sure that kind of works the way
we
we intended to it should just drive by
almost all exits now without any
weirdness
so i think that's that's something
people really will enjoy
and then the other big thing is sounds
hearing them here
the sounds are they're much more chimey
yeah they're real and they sound really
good on the device they sound amazing
but it makes the common three sound
incredible as we said it would
so that's exciting
it's been a long time coming the sounds
have taken a very long time to perfect
but we're finally there yeah it's
surprisingly difficult to get very good
sounds i mean these sounds have been
designed by a sound engineer
specifically for the common three
specifically for cars also you can saw
this exit i mean is driving
super straight rock steady
i mean this is kind of the experience
we've been having with the this latest
model since mitch has done all this work
on the echo behavior
so i think that complaint
has really improved that time
let's see here this car is taking the
exit and our car didn't even flinch and
i mean this is just kind of how it how
it works now so that's a huge
improvement in exit behavior so i really
hope you guys
are gonna be happy with that
yeah it's like it's insane it it's never
even flinched anymore like when i drive
to work every day sometimes it would now
it doesn't even
think about it yeah it's really crazy
how much uh how much that rework that
mitchell did has improved this this
stuff
this is just
a smooth merger
um so yeah those are the so the three
big things are we gave you much better
behavior on exits people have explained
that for a while that was very difficult
to fix you know mitchell spent a lot of
time doing that it was very difficult
it's a very complicated stack on how we
classify exits
and lane changes and stuff and improving
that's very difficult but yeah so
mitchell did a great job with that the
other big thing is sounds
we
have completely new sounds designed by
sound engineer specifically for this
device it's completely different than
what the comma 3 has been sounding like
and for me it's addressed
you know all the complaints i had the
same complaints about the comma 3 sounds
as you guys did i think this completely
does away with that and then the last
big thing another big complaint has been
uh just longitudinal control in general
and more specifically at low speeds and
in stop-and-go traffic
so we've spent all this time over the
last couple years really improving
lateral control in open pilot and
long-term control has never gotten that
much attention
and in the last few releases we've
really cleaned up the api and stuff
and now we're at the point where we can
really start improving the policy so
we've shortened the follow distance to
match better what humans kind of do
and we've made the braking and
acceleration behaviors behind other cars
more natural
so i think that really addresses most of
the issues that people had
let's see here this is going to be it f1
oh it's going to take this exit
yeah i mean
there's still some issues is with the
with cases where it's completely
ambiguous and if the leads take the exit
but it should be much much more
confident now in whether it takes the
exit or not the exit i think the worst
behavior is where it does something in
between and that
is i think the biggest concern that's
been been addressed and then if there's
no car generally it
doesn't take the exit and if it looks
very ambiguous and there are cars then
it's kind of more difficult to
tell yeah i might need big model for
that
yeah that'll help once we get there so
yeah and then uh so i think the biggest
two things we've addressed here
completely new set of sounds
specifically for the comma 3 um
new and improved lateral model with a
big focus on improving the exit behavior
let's get back into the exit lane here
and then the stop and go policy
so
we'll turn around here and then we'll be
able to
go in more stop and go traffic and we
can talk about kind of
the approach we took to improve the
behavior there
yeah i've been driving the accord which
doesn't have a pilot longitudinal and i
like went in the civic for 10 minutes
and i was shocked at how different it
feels than i used to
yeah it's really been changing a lot
so everyone's gonna love it i
file distance is shorter in certain
cases and i think it feels just you know
like harold said a lot more human um
because it's inspired by humans yeah
yeah so i think that the big thing that
has been changed with the new
longitudinal policies i really started
looking into
what the braking maneuvers are that
humans do behind a stopped car or behind
slow moving traffic and compare that to
what open pilot policy was doing and i
could see some different patterns
i think those of you that drive with a
long tool will notice that it breaks
relatively early for a stopped car and
then starts very slowly creeping into
the car ahead of you and that was just a
function of how
our open pilot longitudinal policy dealt
with a speed difference between a lead
and between you
so what i did is i looked at
what
does the data look like from human
driving and designed a function that
matches that
and so by doing that
we get now stopping behavior that looks
much more natural and much more human so
slow down uh later and it won't do this
weird creeping thing it will in one like
relatively smooth motion uh come to a
stop i don't know if there's gonna be a
stop card here in front of you if
um but yeah so really looking at kind of
what does human behavior look like what
feels natural and trying to you know
build functions that try to mimic that i
think we managed to get much smoother
with natural feeling control so there's
that and then there's also the follow
distance we've had
you know a long follow distance for a
long time because it adds some buffer
for if it makes other mistakes and we
just haven't had it as a priority to
look into that because there were so
many bigger issues with our longitudinal
policy but most of those have been
addressed
and so now we looked at the data you
know what's the following distance that
humans usually take and what's like a
reasonable buffer on top of that for uh
open pilot to take and then we
implemented that
so those kind of those changes i think
change uh the whole stop-and-go feeling
of open pilot long-term
completely
yeah
it's incredible you don't realize i
think how how bad it was until you try
the new the new version like for me the
the slow creep
like i didn't even think about it
because i've driven with open pilots for
so long but yeah it really did didn't it
yeah i mean once you start paying
attention to it also feels a lot worse
of course
san diego look how pretty it is you can
come work here
well i guess there was one more bug that
we also fixed is that uh
there's a bug in the long tunnel policy
that if you were stopped behind or just
stopped in general you started to try
accelerate then it went through this
like weird state machine that went like
through a starting state and it ended up
just taking a second longer to start
moving than it should have so that's
been fixed i think it's a pretty common
complaint as well that it doesn't
accelerate fast enough from a stop uh so
that's been been helped a lot by that
bug fix and then just the general
changes yeah so already we're in some
traffic to get on the highway
uh let's see how it feels
it's feeling good
yeah we're not uh testing end-to-end
longitudinal today this is regular
longitudinal but that means it's also
gonna release in the next open pilot
version which is exciting and tan's long
game but
yeah stuff's coming out now
yeah we are working on the end-to-end
long tunnel and the big mall and that
stuff it's just uh
you know this this policy is not going
to go away tomorrow or next week or next
release so
we wanted to spend some time trying to
address these big complaints that people
had
so that's why it's the people's release
the people's really really
try to focus uh on some of the issues
that have been annoying people
you guys stop here for the light
if you don't know an n10 longitudinal
has watched our previous streams where
we uh try it especially the last one
when it actually worked
yeah it's been a continual improvement
process
[Music]
yeah we'll go in some traffic here but i
mean yeah you can't really feel i think
most of the things that
have been improved are things that you
kind of just feel and for those of you
who have open pilot longer to know i
think you'll you'll feel a pretty big
difference
the big three things that we worked on
are the sounds
the longitudinal
and better x behavior
the people's release and then departure
but it's also for the people yes
all teams are working on stuff for the
people lately
yeah
christmas time is coming we wanted some
you know some excitement
yeah we're in the civic for those who
are asking by the way
is there anything else that people want
to know about ask questions
you can ask anything about what we just
said about the people's release
about the part shop yeah part shop got
longitudinal
has anyone bought a pipe from the park
shop
already
who knows maybe you know it doesn't hurt
to have a spare cam
you'd want to
collect them all
yeah so i mean i'd say already this is a
shorter
follow distance maybe than it used to
have at least on the civic it's a big
buffalo
too long for me when i would drive on it
yeah it's about 20 shorter than what it
used to be so
[Music]
it kind of splits the difference between
what
the policy used to be and what humans
seem to be doing it's a little bit
somewhere in between
we all really quite want to go to like
the human follow distance because humans
are a bit more reactive and you know
it's a chill pump you want to have some
some time to take over you don't want to
be
on your toes all the time
yeah no no plans to release the
the schematic um
let's see
this is uh
the civic has it's the knight x civic so
it just says stop and go with open pilot
but it does have a pedal door now i
think oh using the pedal i think so
huh we might be using a pedal maybe
nothing
i'm not entirely sure
i don't think i don't think we are
it could be wrong i don't know either it
doesn't feel super different to be
honest
with her without the pedal
yeah
let's
see uh leonard drives said
who's the following distance i'm not
really sure i think
because you have a a non-open pilot acc
car you set follow distance zone pilot
just says one follow distance which is
pretty conservative so that's been
lowered by 20 depending on the speed
you're going
um
yeah i mean what's the follow distance
it depends right
no it's uh i mean it's in steady state
so if you and the lead car going the
same speed it's 1.45 seconds now and it
used to be 1.8
so it's about 20 shorter
yeah this feels great
yeah i mean those seems to be i feel
like there was traffic here just a
minute ago
but uh i don't know you guys will will
feel it i think this
uh this will make it a release soon and
i really hope that uh
it fixed as many of your guys complained
as it did hours
and i think after this kind of revamp of
longitudinal uh there's going to be a
bigger focus on intimate longitudinal
the first thing that i think we can ship
is going to be if you're stopped at the
light and the light turns green
you want to accelerate pretty hard
behind the car in front of you or even
if there's no car you want to accelerate
pretty hard but with the current policy
there's not enough context to allow that
acceleration and not accelerate way too
hard in other situations
so hopefully when you have the model the
mall is going to say like oh here it's
appropriate to accelerate really hard
and then we can allow that level of
acceleration
all right here we go we're getting into
the traffic
yeah
see how it feels for us
yeah i think you know before
before all these changes i didn't always
have open pile engaged and stop and go i
think there's some cases that just
handled quite poorly and it wasn't
always that comfortable and if we had if
i had passengers sometimes i'd have to
take over because it just felt a little
bit too weird
but i think it's gone now i'm i'm super
comfortable with this new new policy
yeah this is this is awesome
i pretty much always disengage for stop
and go so
big improvement
yeah and uh i mean if anyone has a stalk
acc and wants to get in some of the
action you know
i'm gonna get these cars ported that's
right
okay longitudinal working for your cars
um
yeah i guess ideally you find radar
tracks like the
like greg found
in the hyundais yeah the radar tracks
would be great
thanks for the work looks awesome cool
yeah this feels great
yeah i'm pretty happy with it
so you had to reiterate guys completely
new sounds
uh
just disengage and re-engage let's get a
sense of i mean it's kind of different
than it is in real life yeah let me put
it in front of the speakers
hear that i don't think i can trigger an
alert somehow
but uh
yeah completely new sounds they should
sound great on your
devices
and
completely new longitudinal policy with
a big focus on making stop and go just
way more human-like natural and
comfortable
shorter follow distance
bug fix for
accelerating from stop
and then
taking less exits
yeah
it's fantastic release
so yeah this release is you know going
to come out soon it's going through the
release schedule we'll release a full
blog post as we've now been doing with
all the releases
and uh yeah maybe when it comes out
we'll do another stream to say that it's
out yeah we can do something and post
some plots kind of show what kind of the
changes how
you know it's very easy to simulate
longitudinal policy because it's one
dimensional so you can do really cool
plots very easy to kind of debug for
lateral this is all kind of more
complicated it's not that easy to
kind of show behavior from from like a
single plot to the long tuning was
pretty easy so
yeah i mean there's a bunch of other
stuff in this release too but the kind
of the big ones
i'm trying to think of
yeah the new alert uh text is gonna get
i think it will yeah i think that's
already on this one actually i think a
deep indeed reworked some of the alerts
makes them a bit clearer you know less
confusing text yeah
yeah i mean this release too you know
there's certain alerts that were
you know read before like really
separating uh between immediate
disengage and uh
where like something is wrong with
hardware or something like that versus
um
like if you unbuckle your seatbelt for
example that's a different kind of
disengage so now you can kind of tell
the difference between those two modes
and they have different sounds and
things
so that's nice and you know a lot
there's if there's an alert that didn't
need to be read then it's it's or oh
should we give that a test well you want
to unbuckle your seat belt that's a good
oh that sounds so don't do that i'm
going to low gear
it's still steering uh it still steers i
think yeah savannah disengaged so see
that's a lot more pleasant than
[Music]
because that's happened to me i've
accidentally tapped into neutral and
yeah i know i mean
i would go to like uh an electric break
or whatever it is and then just
yell that yeah
but yeah the buck one's probably the
same on the same kind of alert yeah i
can try but i think it's the same thing
these fastened
[Music]
yeah
so as you hear i mean those sounds are a
lot more pleasant too um obviously if
there's a real
you know red alert like bad thing it's
gonna be extremely loud and get your
attention as it should so
it hasn't changed there
yeah i think for some alerts you know it
still makes sense to be very aggressive
yeah as well is very
right very important so yeah i mean
this is great
it's a great release we keep finding
more things that the user is going to
love yeah i think so
yeah
i don't know i don't know what's what's
next after this i think after this
release is going to be a you know a
bigger push on like
the entrance longitudinal stuff and at
some point we're also going to have to
ship you know remove the laneless toggle
it's always lame this time i think
we're getting there we're getting there
yeah does anyone have any complaints
from lanelist that they want to
use this opportunity to talk about
i think i mean i've been driving online
this for you know forever nebulas if n10
longitudinal and lateral are two
different models or are they one in the
same there's only one model there's only
ever one model one model does everything
it measures the speed it does
calibration
you know it does
the lane line it does the lane lines it
does the end to it lateral does the
antenna longitudinal it tells you if
you're going to disengage or not tells
you you know tells you everything
there's just
i mean not necessarily any benefit to
having multiple models we used to have
like
one model that did pose nets
and like measure the speed and stuff
and then a separate model that did the
driving but now this is all kind of one
big thing one model is everything
yeah cool a lot of people keep asking
when is the white camera going to be
used we're working on it yeah we're
working on it i mean the reason there
wasn't a big push on it before is
because we've tested some basic tests
and we didn't get that much benefit from
the white camera for
a lot of things like there's the issues
are just in other places there's bugs
there are other problems
and we didn't want to you know spend so
much time shipping the white cam and we
were already quite confident that at the
time it wasn't going to improve anything
so
but now for the end-to-end longitudinal
you know you stop at a red light it
turns green it's not going to go because
it doesn't see the green light
so for that we do need the big model so
that's why we're working on it now but
it's you know it's quite a big change so
it takes a bit of time
cool yeah a lot of people saying this
does well some people saying that uh
what are the complaints what are what
are the best the complaints are like
cartoon related my car wobbles so much
with lane lists
yeah i'd be happy to look into some of
those if you guys could send some routes
on discord or post some bug reports yeah
we are moving to laneless only so you
know
this isn't this is these are issues that
need to be fixed yeah someone said their
toyota low speed like kind of jerks the
wheel around at lane list also sounds
like tuning um
yeah i mean lameness interacts quite
differently with uh you know with
control so it's
it's going to be different uh it's going
to be more sensitive to some things with
tunes and less sensitive to other things
and uh
so those are things that you know we
don't necessarily know about
if you have any particularly bad
experiences with lanes that you feel
like don't happen
with lane lines you know peace
you know you can always complain on
discord i think basically all complaints
like that that have a route at least
look at and it's generally helpful yeah
and it's very easy to to find a route
now or you know find where it happens
you just go to connect.comma.ai
see what happens and uh copy the segment
info it's like a
three dots you click that copy this
segment and you just paste it in that's
how you get the wrap
um
cool
i think that's about it huh
yeah i don't really have much else
people's release coming soon to your
commentary
we're people too and we like this one so
yes this is this is the best really in a
long long time it reminds me of like
when zero eight came out and like zero
seven came out these big yeah
those were some really good ones
the zero six series i think didn't fix
like phantom break yeah longitudinally
that was a great release
this is up this is up there with the
greats exactly
go down history
yet
cool cool see you guys
bye everyone see you in another
This is Adiv, our chief product officer.
Uh, welcome to the stage and you're good
to go.
Okay, that wasn't supposed to start like
that. Clearly, this company's got work
to do on live streams and presentations.
Uh, now that the cat's out of the bag,
though, we'll uh we'll get through it
quickly. I want to talk to you guys
about the product. Uh, I want this to be
a little more interactive. Um, I know
you guys want lunch.
Julie, do you know how to go back?
All right, we figured it out. All right,
good morning everybody. Thanks for
coming here. We know most of you aren't
native to San Diego. Um, so we really
appreciate you guys coming out. Um, as
you can see, Comic- Con has a slightly
different vibe this year. We had two
previous Comic-Cons. Um, and this one's
a bit different.
comma's 10 years old like Carol was
saying. Um,
and I hope you get the vibe from both
the event and everything you see here
today. Um, things are about to start
looking a little different. Things are
starting to work. Um, and I just walked
in today and I just got that feeling.
Um, I saw the renders of this space and
I came in and it just felt right. Um, so
I want to give a big shout out to our
ops team, Julian Carly, who put together
this event. Um, if you guys give him a
round of applause.
And another shout out for uh Nick, our
new arts and crafts guy. You'll see a
lot of his work today. Um this event was
one of them. Um you'll see we saw it. Um
all right. So obviously a funny title.
My talk will start with uh a short
little clip from four months ago. Um
we'll watch that together. We'll discuss
it and then we'll get into it.
supposed to auto play.
Do you guys have like a any way to
control this
right here?
All right. Uh,
George, if you want to reenact this clip
real quick. Uh, I know it's putting you
on the spot here.
Thanks, George.
We got creative workarounds for our
technical difficulties. Um, so four
months ago, we had a nice sale. Um,
$799. Um, many of you who were here with
us for our first Comic- Con and the
previous Comic- Con know that's an
incredible deal. Um, this is the same
comma 3 we launched in 2021, four years
ago at the first Comic Con, just
refined. Um, refined many, many times.
Um, this the first time we got a seven
in front of the product number um, since
before I I was at comma and the sale did
really well. Um, we started a bit before
Fourth of July and then the Linus Tech
video came out, 10xed the views. Um,
there's good news and bad news with
this. The good news,
Linus liked it. Um they found the
product on their own. We didn't ship it
to them. They briefly reached out I
think once about like doing a review and
we're like you can buy it if you want
and that was about it. We found out they
were doing the review from the WAN show
like everybody else. We're like cool. We
had not expected to drop during our big
sale. We had already sold hundreds and
hundreds of devices. Um I think close to
a thousand at that point. We were
running out of stock. Um the bad news,
we weren't ready. We were running out of
stock. Um, if we got 10x the sales,
we're just not ready for it. Um, we'll
talk about why.
So, I'm sure everybody here knows the
phrase works on my machine. Everybody's
done something that works on their
machine. Um, this is a bit what Chain
was talking about before he joined
comma. Um, you know, everybody's good at
making something work on my machine.
That's the easy part. And everything
starts this way. Um, this is common in
2016. There is one Acura ILX. There's
many demos on you on YouTube. You see
Bloomberg drive with it. I think George
drove with it um on the highways. Worked
like pretty well. And then there's the
ideal, like what works? What are we
working towards? Um once you've built
something that's valuable and you have
to productionize it, what's the ideal?
Something like a rock. Um it's a little
dark here, but this is a rock. It's a
it's a nice looking rock. And uh rocks
just work. Um, sometimes my team asks me
when they're working on a project, I'm
like, "All right, does it work yet?"
They're like, "Well, what do you mean
does it work?" Okay, if we like sent it
to Lionus or we sent it to somebody or
if I just go and try it and you're not
sitting here, does it work? Um, the rock
always works. And that's kind of what
we're working towards um with everything
at Com, like robustness is the whole
problem. It's all the value.
So, many of you know Consumer Reports is
uh one of our big claim to fame as far
as um third parties reviewing Open
Pilot. Um, they reviewed Open Pilot in
2020 on the Comet 2 and I believe they
reviewed it with a Corolla and they gave
it their highest score. Um, Super Cruise
was number two. Super Cruise is a good
system at the time. It still has a
pretty decent system. Um, though as far
as I know hasn't changed much. Um, gave
Autopilot number three. Um, we would say
Open Pilot was the best system at the
time
and we still refer to this one today.
Um, what many don't know is there was a
2022 version of Consumer Reports. Um,
and I think many many people in the
company don't know this. Um, maybe
weren't around then or they just weren't
in the loop.
Do you know why nobody saw the 2022
version of Consumer Reports?
Does anybody have any guesses?
They bought the device. They got a car.
They bought a car for the device. Um,
they plugged it in.
It had CANFD and they need a red panda
and they plugged it in wrong. Um, you
guys remember the iPhone 4 and that
you're not holding it wrong. Um,
they tried, they put a genuine effort
into they bought a car, they put it in
their lab, they bought the device, they
figured out they needed a red panda,
they bought all these extra wires, they
plugged it in, and there's a bug in the
red panda. If you plug it in wrong, then
we fix the bug. But in early red pandas,
there was a bug. Um,
that's it. That's your red panda. Um,
when they reached out, we didn't know
they were doing this. They reached out
after they broke the red panda. And, uh,
you know, remember we said with Lionus,
we didn't we didn't interact with them.
They figured it all out on their own.
Um, when they reached out, we rushed
them a new red panda. We had just merged
support for their car, so it's totally
new. We found their fingerprints in the
logs. We added it to Open Pilot. Um, we
reuned their lateral control in their
car. Um this is in the early days of
torque D. Um for those of you familiar
with that um the stuff you seen was
mentioning with lateral control
simulation. That's a very advanced
version of it. Um
and then we also added alpha
longitudinal support for their car. And
then I remember the next email we got.
It says do we want to run the Devel or
Devel staging branch? I was like okay.
And you know
uh so Alex was the one communicating
with him. She was our CEO and she didn't
know the answer to this question. Um, I
would suspect like maybe three people in
the company to answer this question like
why
works on my machine. That's uh that's
why you didn't see the 2022 version of
Consumer Reports.
Um, so I love shipping things. Uh, I
learned a Sakama and I just want to
share some cool lessons with you guys
about shipping things. Um, I'm a real
junkie for that green check. Uh,
anytime I can get that green check,
click merge, and I see it on master. Uh,
I I just love it. um shipping devices,
shipping commits. Well, there's just
like deleting a few lines, fixing a
typo, just like you ship something and
it's in master and it's there forever.
It's version controlled. It's open
source. Like you pushed it forward.
This is one of the coolest lessons I've
learned here. Quality is basically free.
Um
a few months ago, we were, you know,
we're we're talking to our display
manufacturer and I'm like, you know, be
really cool. I'm really annoyed my
iPhone. The olophobic coating kind of
wears. You can really see it on your
comma in the sunlight. Can we just pay
like
five more dollars for like a really
awesome olophobic coating? Um, for those
you don't know, the olophobic coating is
what prevents the smudges on your comma.
Um, and these coatings wear on all
products. Um, anything with a
touchcreen, it lasts for a little bit
and it wears. I was like, can we just
pay more dollars? Does it scale like
that? Turns out it doesn't. Um, here's
an example of this. This is our brand
new OBDC cable. Um, it's a very nice
drawing. You can see nice comma logo. We
put OBDC. It's a custom mold. Um, and
this is an OBDC cable. So, OBDC is based
on USB 3.1 Gen 2, which means you need
most of the wires basically. And if
you've ever used a USB 3, like a
Thunderbolt cable, you know, it's not
very flexible, right? But you ever use
like your phone charger, very flexible
because it has four wires. It's USB 2.
We managed to make this USB 2 levels of
flexibility just to tune up the install
a bit and it's cheaper than the old OBDC
cable. Um, all we have to do is like
look at we're like, "Oh, okay. We don't
need these wires. We don't need the
shielding on this. That's just our USB.
Um, OBDC does not need this. We changed
the mold. Uh, we changed the whole over
mold on the wire portion. It's a lot
more flexible now. It's just a nice
wire. Um,
and it costs less money. The old cable
was $4 and it's just like a standard
offtheshelf OBDC um USBC. This is an
OBDC. It cost 306. Um and it's just so
much better. It's the right thing for a
comma. Um I just think this is one of
the coolest lessons. Quality is
basically for you just got to like care
a little bit. You got to look at it.
There's another one of the cool lessons.
Um so I started when we we're shipping
the Comet 2. I had a 27% failure, right?
Um, and when we ship the combo 3, we
want to do a lot better than this. You
know, it's just it's not a good time for
anybody. Um, nobody likes this. Nobody
likes dealing with the warranty. Um,
and one of my ways for dealing with this
was, okay, I'll get every device back
from support and it'll pile up on my
desk and it's like kind of annoying. You
have like some physical constraint,
right? I'd come into work and then
there's all these devices on my desk and
to get it work done, I got to like look
through them and like look at them,
right? The cool thing about failures and
reliability is as long as you don't
regress things and you're very careful,
it's like finite. It's not like some
super complicated bug or anything. It's
just a finite list. Um, which is really
cool. And it works out to be like 12ish
things. Um, and they're not equally
distributed, of course. Um, but it's
like a finite list. You like look at
them, you fix the problem,
and then it's like good. You just don't
regress it.
So, I'm going to show you guys the
highest leverage thing we've ever done
um to address our failure rate. It might
surprise you. It's one line of code. Um
assert, this is the literal code from
fulfillment. Assert device pass all test
serial number. That's it.
So, it turned out we had this really
fancy provisioning software. Um you guys
know about our stress test. We have
something cool coming up too about this.
Uh we had really fancy provisioning
software. Catch all sorts of crazy
stuff. um we really stress these chips.
We run them at max power. Um we check
that the GPS signal integrity is all
good. Um we make sure every device
passes this insanely high bar. And then
what would happen is we later found out
that 40% of devices that failed in the
field um on the comma twos, we just knew
they failed. We knew they failed here
and we just put them in the wrong bin.
Um which is, you know, you're not going
to be 100% at that. Um so assert device
pass all tests serial number. This is
the highest leverage thing we've ever
done. Um, now you have 11 things. You go
down the list and then your thing is
reliable.
Uh, this is a fun one, too. I remember a
few years ago, you know, like marble
floors were a thing and like, you know,
you see these companies raise billions
of dollars. Um, and George used to say
this thing like, "Where are our marble
floors? Are we doing something wrong?"
This is a figure robot. Um, they're a
relatively new company. They make
humanoids. They look incredible. They
look really nice. They look probably
nicer than like a Tesla Optimus. And
they have this insane polishing head for
them.
Like this is more insane than anything
in the comment factory.
And this thing hasn't shipped. And this
product, they've already moved on. It's
a figure three. And how much do you
think they spent on this machine?
This is our stress test rack. Um,
we shipped 18,000 comma 3x here. That's
$20 million in revenue. The figure has
shipped zero things to people.
Um, yeah, when I was an intern in 2019,
uh, I remember I was like, okay, when I
when I finished my internship, I was
working on something called a testing
clause. It was very similar to this.
It's like the open pilot CI version of
this.
And I was like, "Okay, I want to make a
nice rack." And I was like, I don't
know. I didn't know what nice meant. I
just knew it wasn't wood. It didn't look
like this. It didn't have like
electrical tape wrapped around it. Um,
this has been stable since 2019. This is
this is it. Um,
really um almost every probably all the
common devices you've bought are mounted
here, here, here. Um, this rack this
rack fits 120 devices. Um, so this is
the top of it. But, uh, no, it turns out
I shouldn't have been spending the time
making this metal. um or making I had
this idea the devices would like float
and it look sick. Um no it should assert
device passes all tests. Um that was the
thing to do there.
All right. So we're
eight years into we released a not a dev
kit. Every product until the comma 3x uh
we'd call it the comma 2 dev kit, the
comma 3 dev kit, the yond gold dev kit.
the 3x was not a dev kit. Um, many of
you driven with one. Fortunately, you
can't see the outline. Um, but looks
like that.
So, two years later, um, after we
launched the comma 3x, it's done $20
million in revenue. We sold 18,000 of
them. Um, it works out to exactly 3x
comma 3. Yeah, I know. That's how it
works, I guess. Um, it's kind of fun
like that.
40% sold are daily activives. Um that's
incredibly competitive with all sorts of
consumer electronics. You know, people
use their phones more than that, but uh
you probably use your laptop a bit less
than this. Most of the consumer
electronics I buy, I bought a Vision
Pro, got a Rabbit, I got all those
things. Um and a lot of Daily Active. Um
and it was good enough for clickbait
thumbnails. Like the YouTube videos
started popping up again.
Um the Common 3 had none of this like
organic content. We didn't send uh
advice to Snazzy Labs either. He reached
out um and we just told him the vibe.
It's like I don't know. Just just buy
it. If you don't like it, return it and
tell people that. Um tell people
whatever you want. Um we're not going to
tell you what to tell people. We offer
it for $9.99. And that's the narrative.
And he liked it. He like these both of
these YouTubers really got it. Um I
invited him to comm uh we did a car
hacking hackathon and that's when we got
the Rivian supported. Um they they
really got the vibe. Um,
it it goes to show you don't need to
control the narrative. Um, you're not
holding it wrong. It's just the product
is just kind of ready for them even
though we might not be quite ready.
All right. So, what's after not a
deficit?
Does anybody have any answers? Like,
what do you want in a comma? What's
after not a dev kit? Are we happy with
the dev kits? The not advocates?
I know Eric, you've uh I know you always
got some feedback on this stuff. Well,
you know, uh, one thing I know everyone
wants is quality, but in particular, I'm
curious about a 2year warranty.
>> We'll get to that. We'll get to that.
Okay.
There's a Yeah, there's a few things. Is
there anything else? Anybody uh if
you're a user, can you just raise your
hand? I'm curious how many people use
the product ever used it. Okay, cool.
About half.
>> Go ahead. I want easier installation so
I can give it to an uncle or another
friend.
>> Cool.
Um, is like IKEA good enough? Um,
[snorts] there's some fundamental parts
of the install.
>> Just improve.
>> Just improvement. Okay. Yeah, that's
that's one of the things that uh, you
know, we're not going to make the
product worse and we're going to try to
make it better. Um, anybody else?
>> Go ahead.
>> Okay, cool. Not overheat. Anything else?
>> Price.
>> Price. Okay. Those
are four great ones.
>> Okay, cool. So, we got two-year
warranty. We got We don't want it to
overheat. Um, we want a simpler install.
And, uh, we want it to just kind of fit
on any windshield. It's just meant for
it. Uh, cool.
And the price. And the price. We can't
forget about the price. Uh, we learned
our lesson with the Comma 3. We really
learned our lesson with the Comma 3. All
right.
So windshield
floor. [applause]
[applause]
Maybe let's take a step back.
So it's designed to live on your
windshield right here. We we talked
about windshield. Uh
it fits right there and it's got a
little bit it's got a little bit for you
to look at, but everything else just
hide it. Hide it on your windshield. Um
it's it's more open pilot sized. Um
let's let's watch it drive for a second.
Or we learned videos don't work. Never
mind.
All right. So we had a non-dev kit. So
we built a real product. That's the next
step.
And a real product needs a new
interface.
So your comma 4 has a brand new UI. We
still communicate uh driver monitoring
is still watching you. It's the same
open pilot that you know. Um we've got a
torque bar. Now we really want to be
able to communicate Open Pilot's driving
policy to you better. Um
we got the confidence ball. So when Open
Pilot knows that you're likely to
disengage, this ball will go up and
down.
So you know what open pilot's thinking.
Um you know can I is open pilot low
confidence? Um you can really notice
this right now in experimental mode. Um
it's a lot of fun watching it and you're
like okay cool. That's what that's
exactly my experience with experimental
mode. It's good that the model thinks
this too. Um the torque bar is super
cool too. You can see subtle control
bugs. Um it surfaces all these subtle
things about the driving policy that you
have these suspicions about but you're
just not quite sure. U and it's just
communicating to these to you all the
time.
All right, we talked about setup. Plug
it in and drive in five minutes.
No more 8deree mount.
Instant mount cure. That was 48 hours we
took away. Um 1 minute CI. They came to
the setup experience too.
Common power is optional. Um we ship
that to your 3x2. Um it's always good to
emphasize though. People love that one.
Um common power is very optional.
And we now cach the most common software
um on the device. So Wi-Fi is optional.
You can get the device
like you buy from comai/shop,
it gets delivered to your house in two
days. They'll get rush shipping. You
unbox it. You just you're excited. You
tear open the box. I know a lot of you
guys already have 3xs. You're going to
have to remove the mounts. Um you're But
let's talk about your uncle, right?
You're going to buy him a device. You're
going to grab the box, go drive it over
his house, tear open the box, stick the
mount on, take down the rearview mirror
trim, connect it up, slide it back on,
and you're going to click use open
pilot, and you guys are going to drive.
All right,
we got ComicCare.
It's three easy steps. You sign up for a
comma prime trial. Um, you got to get it
right when you buy the device. Like
Apple, you keep your compressor
subscription active and you enjoy your
extended 2-year warranty.
Comma 4 comes in two sizes.
Sizes are important. You got to give
flavors. Oh, this doesn't go well with
the uh the black. Uh we'll have some on
display for you guys. You can go check
them out over there. Um, we're gonna
have some really cool comma four
displays. Um,
but this is the 10 watt variant. This is
the 100 watt variant. Um, not ready yet.
Q12026.
Um,
but you plug your comma compute into
your comma 4 and it's got the same
auxiliary USB port um that your 3X has
and you can upgrade it to basically FSD
levels of compute. Um, and the cool
thing about this is it scales a lot
better than mobile SOC's. um you want to
keep getting the latest Snapdragon,
well,
you know, you're not going to get uh
nearly the performance you want. Um if
you want to take like an existence
proof, right? Um FSD is a system that
ships today, right? Um and it uses a
certain amount of power. It's got a
certain amount of flops. Um
this will be able to match that. Um so
we've got an existence proof. We can
match that. Uh in terms of compute,
you can expect it sometime next year.
As for the 10 watt variant, we like to
call this the Snapdragon 845 Max. Um,
it's got max out cooling.
>> You guys know you still got to buy the
10 watt one, right? You buy that one
today.
>> Optional add-on. We got to emphasize
this. The 10 watt is the real chill one.
>> It's the same one. We're not We're not
swapping out the 10 watt version to the
10 watt plus 100 watt compatible
version. It's always 10 watt plus 100
watt. Um, so the chip, the 10 watt
version ships with uh, sorry, it's all
the same version, but the 10 watt chip
is a Snapdragon 845 Max. Um, the reason
we call it the Max is we max out the
cooling.
Yes, it's the same chip, but it sustains
10 watts. Um, and we can run bigger
driving models with that.
It's also whisper quiet. Um, so we
talked about never overheating. Uh,
it's all fixed. It's all fixed. Um, and
we have big headroom to run bigger
driving models. This thing does not make
any noise. Um,
this is one of the things we put the
most time in into the comma 4. Um, the
comma 4, it's easier on the census. Um,
I like to refer to just being optin. Um,
it's there. You can pay attention to it.
You can listen to it if you want. It's
got some nice sounds. It's hard to hear
the fan. If you really want to, you put
your ear up to it, you can hear it. It's
really hard though. Um, if you want to
look at a big screen, uh, maybe you can
add it with the oxport, but the screen
is just kind of there if you want to
look at it, if you want to peek. Um,
what is open pilot trying to tell me
right now? Otherwise, feel free.
It's not asking for your attention.
And this is a comparison with the 3x and
the 4. Um, so if we look at the fan
power, um, we get about 3C per watt
better on the cooling. Um, and this is
very close to the max you can do on a
Snapdragon 845. Um, we can sustain max
performance that will will ever be able
to ship to an A45 very comfortably on
the comma 4.
So that's where it gets its max name
from.
All right. So specs,
it's got an open pilot size form factor.
Um, that's number one.
It's got a beautiful 536 x240 OLED.
still a touchcreen, still color, and the
very standard 536 x240. Uh, we've put a
lot of work into the each one of those
536 x 240 pixels. Put a lot of work into
each one of those. Um,
it's got the Snapdragon 845 Max.
It's got 360 degree vision, same as the
3X. Bit different image sensors. Um, but
you'll see an advantage of the image
sensors in a second. Um, very similar to
what we've shipped in the past, though.
It's got the same 120 gig UFS, but this
results in 10 hours more of footage. Um,
we do downscale on the ISP now um from
these image sensors. Um, same driving
performance, same like capacity for
driving. Um, the footage is half the
size now. Um, this makes our training
stack, it's open pilot sized, makes the
training stack faster. It's just it's
the correct size, you know. Um, I was I
was in the the factory the other day and
I was watching the our stress test boot
up and it boots up way faster than the 4
and Okay, why is this?
Well, everything is just a little
smaller. It's actually like the firmware
is a little smaller for all the
auxiliary things. The modem firmware is
like 10x smaller. Um, it it's all just
smaller and the correct size for open
pilot. It feels you feel it. It boots up
faster. Um, it's open pilot sized.
It's got a new sim too. Uh
so no more SIM slot. Um we got to kind
of avoid that mechanical design problem
and I think it is a much better
experience.
All right. It's designed for scale. So
when you say we're not ready for lines
tech tips, that means a lot of things.
Um that means open pilot's not ready.
The software is not ready. Um from many
perspectives, only recently did we solve
fingerprinting. Um a couple of things in
the video that I saw that I was like
really watching out for in the video.
Um, is it going to fingerprint?
Did they get a good car? Did they have
to understand any of the subtleties of
the branch names and like do I need
alpha longitudinal? Do I need to SSH in?
Should I run a fork? Um,
and then like if if the review is good,
which it was. It was it was a very fair
review. I think it was a uh very honest
review. Um, if this leads to
conversions, are we ready to sell
devices? At the time, we were not. The
comfor is designed for scale.
So before we ever did any CAD, before we
laid out the board, before we did any of
that, we designed out the production
steps. Um each rev, you know, the comma
2 we uh so simple to build. It's like
you don't really need to do this. We
just kept building them and outputting
them. Um and then we just ship the best
ones we had. The comma 3 we just threw
it everything we thought was really cool
and we're like all right cool. We got to
build them now. Um turns out that's not
how it works at all. Um and this drives
a lot of cost. The 3x we kind of did a
mix of both. We were like let's do a
little design now. Let's do a little bit
of uh design for manufacturability. Now
let's do trade it off a bit. Um the
comma 4 we designed the factory first.
We're like okay cool. How are we going
to use we need to use auto feeding
screwdrivers. Um we need to be able to
build 100,000 of these a year with the
same team, same office, same setup. Um
we haven't really grown the production
team size um since the comma 2 and we
built 3x more comma 3xes than comma 3s.
Um so we're going for a bit more than a
4x. Uh here
it's got 2x less parts. Um,
and the parts that do remain, we have
multiple suppliers for each of them. Um,
you know, you never want to get to the
situation where you're like,
this is a fun story from the comma 3.
Uh, the screens were like a real they
they would trickle in. We were living
week to week on the screens for the
Comma 3. Beautiful screens, beautiful
Samsung OLEDs, awesome glass, but they
trickle in like 40 a week. Um, and you
know, that's not scale, right? We ended
up having to send a PI to our screen uh
our screen vendor and we're like, "Are
the screens there?" We're like, "Can you
just take some pictures and see if the
screens are there?" Um,
so we're we're well beyond this now.
Multiple suppliers for every part. Um,
it's got a real supply chain.
It's 4x faster to assemble. Um, that's
just right now. Um, got a lot of
refactors planned. Uh, but we got to we
got to ship the ones now. Um, you always
got to you got to ship your refactors.
You do the dumb thing, then you do it
again, then you do it again. you just do
the most obvious thing and this is the
loop. Um it doesn't end.
It's got a real fulfillment line. Uh I
think many people will be surprised to
know that uh the bottleneck during sales
is fulfillment. Um you know our awesome
fulfillment team. It's uh you can meet
them over there. Um Ada and Marvino are
awesome fulfillment team.
They can do like 200 a day peak and then
this is just they get there and they're
like all right we can't do them. I'm
like it's all good. We we do an awesome
job fulfillment. We get the two days out
right away. Um, but it's a bottleneck.
The box is hard to fold. You got all
these little inserts in them. You got a
lot of little pieces. We used to have a
little towel that we'd fold like this
and somebody would sit there all day and
like fold a little microfiber cloth. Um,
I like is that a real value ad for
people? Do people want to pay for this
in their bomb in the in the device
price? Um, obviously we can improve
that. Um, but you got to get there. You
got to get there. Um, so if you want to
find Nick and talk about the box design
and stuff, we really took all this
stuff. Uh, we had a lot of fun with it.
Um, so it's got a real fulfillment line
and we refactored the whole factory. Um,
we did a whole bunch of construction
over the last few months. Um, our
fulfillment room was, you know, it a
little cramped. It's just, it was
basically storage and then like a little
area to walk in and like you get a few
boxes, you put the parts in, then you
can do a couple more. Um, so we got a
nice big fulfillment line. Um, we have a
nice big assembly area for the comma for
us. Um, it actually looks a little
sparse because they're just so tiny and
they're so easy to build. Uh, so we got
to put some plants in there or
something. We got to we got to fill up
that space. Um, and then for our SMT
line, we got a brand new uh second SMT
line that'll run one side. Uh, we'll see
the board in a second. Um, there's one
very dense side of the board that looks
like a phone motherboard. Um, and then
the other side will run camera bars. Um,
and the top side of the the board. Um,
so it's very beautifully balanced. Um,
and to crank out 100k a year, perfect
redundancy between the lines. Um,
it's got Open File 010. We put a lot of
effort into reliability.
How often do you hear fingerprinting on
Discord anymore? We got the
fingerprinting wizard right here. How
often does it come up these days?
>> If you got a Mazda, maybe. Um, we got a
dashboard and it just goes it converges
to zero. Um,
takes a while to fix these things. Um,
like it was only like a year ago that we
got rid of like the RTC and this caused
like all these like weird bugs. The
device isn't a clock. You got to like uh
like you go back to Maxim's talking like
you you go back and you revisit the
requirements. Um it's the email that
like make the requirements less dumb.
Why is the device a clock? Why do we
rely on absolute time? And this drives
decisions down from the like the
microcontroller that does the functional
safety on the device all the way to uh
the front end app and connect. Um we
deleted so many lines of code and just a
whole class of bugs. Um there's a lot of
cool things about Open 10. Um you'd be
surprised to know we spend
basically very little time on validation
of individual commits. Um we do spend a
whole lot of time on building the CI
systems um that we talked about today.
Um but we we spent very little time like
all right this open pilot release has to
go out. All right somebody's got to get
a device somebody's got to like put it
in all the cars. Somebody's got to do
this. That's not really how it works. We
spend very little time on indiv
individual changes and we spend a lot of
time on the infrastructure. Um you know
you ever hear the quote the product is
the factory. Um, Open Pile 010 is ready
for scale. Um,
you you you can't tell people, you know,
go make a poll request for your
fingerprint.
So, this is the motherboard.
So, we got our beautiful Snapdragon 845
Max right here. You can see this thermal
underfill.
So, you get some uh
this is where you get some of your
cooling improvements. Um, we got three
tricks for the cooling that really
improve it. each contribute uh basically
equally. Um so this thermal underfill is
one of them. It should also massively
improve the reliability. You ever see
like the remaining camera malfunctions
and stuff? Um it's due to this package
on package um on the 845. And we've got
like the most awesome SMT lines. We got
vaporphase ovens. Um this is nicer than
most SMT lines. Um it's basically the
max you can do. We got like electroform
nickel stencils. We just bought a super
nice stencil printer. We got 3D AOI. Um,
this is kind of the next step in this.
Um, so you get about a third of your
thermal improvement over the comma 3x
from this thermal underfill. And then,
uh, you get some reliability out of it.
You got your PMIX,
got your panda, same red panda. Um, it's
all very familiar from like the open
pilot side.
You got a microphone and an LED, OBDC
port, ax for your comma, compute. You
can ignore the SIM slot. Uh, the SIM
slot is if if you want it. Um I I don't
know how many people know this uh about
I'm sure many of you know the humane AI
pin. Uh they were not able to reuse like
they couldn't refurbish their returns or
do anything with them. There was
basically like dead weight once they
returned. They had a pretty high return
rate and this is because T-Mobile
wouldn't let them reactivate the SIMs.
It's like there's no actual reason for
this but this is just how the carriers
work in the US. Um, also fun story, we
would not have eim in the US if it
wasn't for Apple. Just telling the
carriers like, "Hey, by the way, this
generation only has eim." Um, the
carriers do not want eim. Otherwise,
they're going to send you a text message
be like, "All right, if you switch to
T-Mobile today, we'll have your bill.
Just click this button right here." They
don't want that. Um, so we have Apple to
thank for eim. Thank you, Apple. Um, so
it's in there if you want it. Uh, we got
the fan connector
and we got this beautiful edge here and
the whole heat sink goes right over
here. to beautifully shield this whole
area. And what that gives you is really
awesome GPS.
So tiny form factor, tinier antenna,
same GPS performance.
The other thing you'll notice is this is
all chip level. Um there's no SOM. The
SOM would take up about this much area.
So obviously SO is out. You want to make
a small device, SOM is out. It's a chip
level design. Um,
like it looks like a phone, right? It is
all the phone parts, too. It's like an
A45. Um,
is the backside pretty sparse. Um, so
this is one of our other tricks for the
cooling. Uh, you see these big holes? We
just shove copper post through there.
And
yeah, so you see these big holes. We
have a big copper plate that goes on the
back here and we're able to conduct the
heat through the back back to the heat
sink. Um, so this gives you another
third of your your uh cooling
improvement over the 3X. Um, there's a
Quel. It's a little smaller than the one
on the common 3X. If you want to ship
the one on the 3X, it's this big.
Doesn't work.
Then you got board to board connector.
One connector to the other PCB
to the beautiful camera bar and your GPS
antenna.
All right, we got one more product to
get through and then we'll take
questions. I want to talk about this
thing. I want to see what questions you
guys have. Um, Body V2, it's a
prototype. Um, we got some for you guys
to drive. Uh right over there. Um so we
got five of them for you guys to drive.
Doesn't balance anymore. That was a bit
silly. We realized that we reverted that
on body v1, but from the start. No
balancing. Compatible with comma 4 and
comma compute. It's a whole family. Um
this is kind of the end game. We're not
there yet. So it doesn't balance,
but works with the whole ecosystem.
anything you think for a test right at
the booth
and chips Q1 2026
and then the other thing I want to
emphasize uh your comfor still your
comfor everything is still open source
um we're not locking anything down in
fact uh we got a sunny pilot booth right
here shout out to the sunny pilot team
they're really like the debian of the
open pilot ecosystem
still got kab body Um, you guys might
have seen Sim City on Twitter. Um, he's
doing really cool stuff uh with his
commas. Um, I'm sure he'll enjoy his
comma 4. It's more size for his RC car.
It's It's just the right size. Um, yeah,
your device is still your device. We're
not none of this is changing. Um, the
ceiling is still here. The ceiling,
we're not moving down. We're not locking
down your device um or the floor. I
mean, we just Everybody wants this
stuff, right? We were going around.
Everybody wants it whisper quiet. Nobody
wants to overheat. We want room for
bigger driving models. Um, and easy
install.
So, it's $9.99 all in. No harness. Um,
so those of you concerned about the
price,
don't worry about the harness anymore.
Why are we asking you about a harness?
Just tell us what car you have. We'll
send you everything. Um, and it ships in
one 12 weeks. You can go to com.ai right
now. You should be able to pick one up
and we'll try to get these out as fast
as we can for you guys. Um, the factory
will ramp up pretty quickly.
>> [applause]
>> We got a couple more things, Julie. We
got a couple more things. So, I Roba,
who's uh one of the main engineers who
who designed the Commore, uh we went to
Shenzhen a couple weeks ago, and I just
want to show you guys some vacation
pictures from our little field trip.
All right, so this is the mold for the
Comma 4. We visited the mold shop.
Um you guys will never guess who this
guy is. You guys will never guess it.
This guy hand finishes every mold. So,
you like the finish on your device? It's
this guy. Um, and this shop is really
cool. Um, they make like a whole bunch
of molds for like BMW like interior
panels and stuff. Um,
China is the most incredible market. You
get access to like these incredible
vendors. Um,
but yeah, you can see the main case and
then we have the top case. Um, it's two
halves that go together. Um, see the
little screws that go through the case?
It's got little hexagons. Hexagons get
you uh that whisper quiet and that
awesome cooling.
This is the lens holder. Um,
so
your narcam goes here, your ecam goes
here, and then your dam. We put it on
the same side of the PCB so we can do
this all the focusing all at once. Um,
focusing was another big bottleneck that
we addressed. And then the Dam has a
separate piece that connects right
there. And then it's diecast. Um this
guy runs a diecast shop. Super cool guy.
There's a heat sink. Um this place is
also super cool. Their main business is
like they do like a 100 different
variants of like water cooling blocks.
Um Nvidia is like one of their biggest
customers. Um same manufacturer that
builds stuff like the 3X and the Comma 3
and the Comma 2 was built here too. Um
so this is their CNC shop. Um, it's like
three fixtures for the heat sink. Um,
they do these like really cool blanks.
Very cool shop.
So, now we're going to com HQ in San
Diego. Like I said, we have a beautiful
SMT line. This is the the kind of stuff
we're doing for reliability. Now, um,
for those of you who don't know, this is
a procedure called dine and pry where we
we run boards and we just pull off the
chip and you look at how the soldering
looks. Um, so you got some camera
sensors and then you could see a whole
bunch of devices. So you dye them red.
This is a little cut of the the MCI
board
and then you uh you want to epoxy it.
You got to wait like overnight for it to
dry. You try to pull it straight up. Um,
and you look at it on the microscope. If
you see any red, just solder is uh you
got to tune your procedure.
This is our camera focusing setup. Um,
so like I was saying, you got you focus
three devices at once with the Comma 3X
at our max rate. Um, if we had our our
very best Dam guy, shout out Juan. Um,
he could do 80 a day if he's having like
an awesome day. He comes in, he's like,
"All right, guys. I'm going to crank out
some dams today." He could do 80. Our
target is to do 100 camera bars per
person um in a given day. Like in a
chill day, you know, it's a Monday and
you're like, "Okay, you know, you should
be able to do 100 comfortably." Um, so
massive, massive improvement on that.
Um, it all focuses right here. We said
this like complicated setup with mirrors
and stuff. Um, instead we just have this
beautiful setup. Um, and on one panel, I
should have put a picture of the panel,
but on one panel you get three devices
worth of camera bars and they're all
oriented the same way. So you just go in
a line down nine and that's it. You pull
them off and they're ready for the line.
And they got ultimate provisioning. Um
the reason it's called ultimate is this
is basically everything we could test in
an automated way on the device and this
runs at the very end. We the common 3xs
were all built something called stress
test.
This just merges all our flashing step.
We had a final provisioning step. We had
a stress test. Merges all into one
called up. Device comes off the line. It
goes right on this. You might recognize
the screen.
Same screen. Um so we basically built a
minion before. It goes right on top of
it. And then this is the you got a
device under test and then this is your
tester. Um we call these the UPS
ultimate provisioners
and they just handle it all in one. We
get to test the full bandwidth through
the USB3 port so that we make sure your
common compute is going to be 100%
reliable. Um and we have like 80% test
bank coverage. So like you know when you
design something you have like a big
list of all the things it has to do
right and you know you do it for the the
once when you're designing it and then
maybe you won your first production
boards but what if you can do it for
every single device um and then one of
the things that we really looked at with
every rev of the com before was uh you
know is there some test plan item that
up can't cover should we just delete the
like should we just not expose the
interface does the part need to get
deleted sometimes the answer is it needs
to stay um but often times just deleted.
And then a shout out for our EPO
members. Um we built a lot of comma
force. This is our most well validated
hardware. Um you can see they drove
almost 100,000 miles. Um got 3,300
hours. For reference, I think the comma
3X was probably around
700. Um 3s we took a bit longer to
build. So probably closer to like 1500.
Um we did not build 157 of any of the
other devices. We built a lot of every
rev. Um the SMT line is a real
superpower. We just every time something
comes in, we're just like, "All right,
run it, build lots of them, and you get
a lot of you get to do iterations on
your whole production procedures." Um,
so big shout out to our AirPod members
for putting up with all the bugs and
helping deliver you guys a refined
experience. So, round of applause for
our members, please.
All right. And then this talk does have
an agenda. I try not to sell you guys
the device. I just want to show you the
cool thing we built, but I do have an
agenda. Uh, come build a five, six, and
seven with us. Um, I love this video of
Kobe from like the finals back in the
day where the reporter is like, you
know, you had a great game. Are you
happy? He's like, is the job finished?
It's not finished. We're going to build
so many more of these things. This isn't
last Comic Con. If you want to come up
here, talk about the cool shit you did
for the next Comic 5, the six, the
seven. We're just going to keep doing
this. Um, there's so much more to do
here. Self-driving cars. Uh, you know,
despite what you see on Twitter, uh,
it's not solved. We're not close. Um, so
call me/j jobs if you're interested.
This is not a bug. We're not hiring
three supply chains. I just want to
emphasize this. If you, uh, just want to
talk to suppliers all day, you want to
just get here stuff and count it. This
sounds like a simple job. It's a very
legit job. Um,
we got some cool problems to work on
here. Um, so love have to hire somebody
to make an awesome mobile experience for
Open Pilot. Um, supply chain obviously
and uh we build a lot of products. Um,
the tiny stuff can use uh supply chain
too
and a systems engineer to work on more
stuff. Uh, like you heard from Maxim and
Shane. Um, ship like a new updater, make
the boot time like five seconds. Um,
if you just want to make beautiful
software, um, you know, you like writing
MIT license software all day. It's uh I
really like it if you're out there too
and you want to work on this stuff. All
right,
question time. What do you guys want to
know about com 4
questions?
We must have some questions. There's a
lot in there.
Hi, what does the 100 watt box do?
>> Yeah, so the common compute I we could
elaborate on this a bit more. Um the 100
watt compute is for driving uh you can
think of like we'll have two classes of
models. Um right now everything open
pilot ships runs the driving model takes
about a watt. Um and we can bring that
up to 10 on the device. But what if you
want to go beyond 10? Um there's
existence proofs in other systems like
FSD. Um
and this allows us to effectively scale
the compute on the device a lot better
than shipping new SOC's on the device.
Um so new desktop GPU comes out, swap it
into your common compute. We'll sell a
standard one. Um and that'll be the 100
watt big model class. Um and our
autonomy team will essentially work on
shipping um two classes of models. Our
very best stuff will ship to the 100
class and then it should trickle down.
Um you see this with LLMs today, right?
um you would love a tiny LLM versus like
the biggest LLMs three years ago. Um so
we expect a similar kind of thing to
shake out for driving where we're able
to ship way more performant 100 watt
models. Um and if you really want to
play on the bleeding edge, this isn't
for everybody. We know this is not for
everybody. Um but if you want to play
along on the bleeding edge, that's what
this is for.
Also love to answer questions about open
pilot. Anything
>> questions?
>> Tell me about the new common body.
That's what I'm most excited about. Uh
what's the payload capacity and uh is
there anything new with the interface to
allow you to teleop it?
>> Yeah. Okay. So, comma 4 obviously a
product. Um we've been at this for 10
years building commas. Um bodies are
much less mature. If anybody's ever seen
a common neo got a display with them um
if you want to check it out, see the
progression of the hardware. Um the body
and the eGPU are very exploratory
products. They're they're just we're
showing us some prototypes today. Um
they're not comfors. um you know it's
it's not ready for your uncle for
example. Um so the body
to put it simply an intern's been
working on it for like a month and a
half. Uh we're just like it's time for
body v2 and we had an intern explore it.
Um so we're expected to like redesign it
a bunch. We're just we're basically
showing off like here's all the secrets.
I don't know. [snorts]
Um yeah so I just recommend going around
playing with it if you want to load it
up and joystick it around. That's what
this booth is for. And you're like hey
what if this was right here? Um, by the
way, if you want to go talk to the the
hardware team about anything on the
product, it's like why didn't you do
this or why? Sometimes the answer is
just like I we don't know how to do we
don't know how to do it better and the
next one five will fix it. Um, so we
really encourage you guys to go uh the
production team and the hardware team
are uh they should be around all the
products. So if you want to know
anything about these products um and
especially the common compute and the
the uh body, these are just prototypes.
Um you know if you want your feedback
incorporated them let us know like pack
around with them, play with them. Um,
yeah, come play along with us. That's
that's kind of what this is for.
>> All right, we got another question back
here.
>> Yeah. Uh, how long will the comma 3x be
supported? Is that to be determined? I
know comma 2 was supported for like I
think six or a year, six months or a
year. Is that going to be the same with
>> uh yeah, we don't have any immediate
plans. Um, I don't want to repeat what
we said with the comma 3. I mean, what
we said with the comma 3 is true and
that it's like a very similar platform
and then you you can't predict like how
like when the software will diverge um
and in which ways it'll diverge
necessarily. Um so we'll say we'll
probably I mean we'll keep it around for
at least a year. Um and you know the
common 3 is still getting long-term
support like critical bug fixes but uh
yeah the comma 4 um has a bit more
capacity. It's a bit different but
there's no immediate plans to you know
to do anything with the comma 3x. They
get the same updates. All right, we got
another question up front here.
>> Thank you. This is awesome. Um, I
understand the Comma 3X had like around
close to 130 unique parts. So, you're
going down about half. I understand the
um thermal management is going to be
better. Shielding the GP GPS is going to
be better. I can see all these things.
What else is giving you guys the
confidence of this 2-year warranty?
>> Yeah. Um, so like I was saying with like
the reliability stuff, we built 157 of
these things. I think we maybe built 300
comma 3xs. Uh not 30 comma 3xs before we
shipped them. Um we built 157 of these
things and we saw everything that
failed. It's really this simple. Um I'll
tell you guys our process for like
fixing the bugs on the revs. This is
like fairly revolutionary for us. We
made a GitHub issue instead of just like
posting on Slack like hey by the way the
panda kind of like drops out on this one
sometimes. it's like it's on a GitHub
issue and then you just close the issue
every ref cause it as long as you like
you like you manage your state well and
you just make sure that like it doesn't
regress. Um the comma 3 is also uh sorry
the comma 4 is also shipping on rev I we
did a lot of revs. Um we basically did
two big refactors of the the whole
design. Um so this is this is what it's
designed for. Um,
another thing I'll tell you about the
comma 4 is um, the team that designed
it. Um, I think Harold and George are
the only people who were around when we
started the comma 3. Um, and you know I
I was part of the team that chipped it.
Robo was part of the team that chipped
it. Um, this is kind of the first one
we're doing from scratch. We did the 3X
from scratch, but inherited a lot of the
DNA from the Comma 3. Um, this is kind
of the first one doing from scratch and
it we learned all those lessons from
that. There's a lot of continuity in the
team, too.
Hey, congrats on the congrats on the
launch by the way. Um, I was looking at
the one of the pictures and it looks
like the rearview mirror might obscure
the screen a bit.
>> Is there I don't know. Is there a reason
why you didn't integrate the screen into
like a replacement rearview mirror or
something like that looks more OEM?
>> Yeah. Um, so there's some comma forks
that do this. Um, the comma ecosystem is
growing. Um, I have this idea for next
Comic- Con where we do like Fort
Candyland. I think that'd be a lot of
fun. Hopefully there's a little more
devastating than the forks by then. Um
the hardware forks are starting to
diverge too. Um you can check out this
one called Sidecar. Um they shipped a
few of them and they ditched this idea.
They basically replaced uh the trim
cover and it was it was a pretty cool
form factor, but then they realized,
okay, this only works on two models a
years of one Corolla and we have to do
this 325 supported cars. Oh, this one
has a different connector and has a
thing right here. And you want to
injection mold it because like theirs is
printed. You want to injection mold all
this stuff. Um,
so it's not really scalable. This is
designed for scale. Um, but the whole
device is designed to be as small as
possible. So in a lot of cars, you can
shove it a lot higher such that you
don't see it at all. Um, but you have to
mount it such that it's designed such
that you see the little strip um of the
screen in the DAM and Dams can stay
watching you and you can you can see
what Open Pilot's saying at all times.
>> Hey, um, with regards to your ESIM
support, um, referencing the first
presentation, did you do anything? Did
you do your own EIM stack? Are you doing
modem manager and having to pull pull in
Gibb and debus and all those stuff?
>> Sorry,
>> that's next. That's next. Sorry, I'm a
little triggered with that. [laughter]
>> Sorry.
>> Uh, no, no, I was I was so happy to roof
Weston. Um, I really was pushing for
that the last few weeks. Just want it to
be like beautiful inside and out. This
stuff is I don't know. It makes it more
fun for me to work on. I know like
sometimes it doesn't matter, but like it
matters that the thing is fun to work
on. Uh, so we haven't touched the modem
stack that much yet. Um, there are plans
to to clean it up. We have a lot of
issues with this stuff. If you want to
come like work work here and work on
this stuff, uh, I think it's a lot of
fun. I don't know who else thinks it's a
lot of fun, but you like get to just
ship bug fixes all day and like make the
thing work. Like it works. Remember the
rock?
We got more questions.
So, now that the screen is a lot
smaller, how does accessing the settings
and maybe in the future, uh, navigating
on Open Pilot going to work?
>> We have a lot of ideas for navigate on
Open Pilot. Um, it's not quite time for
navigate on Open Pilot. Um, but when
that comes back, we have a lot of ideas.
Um, the Confor is ready for nav. Um, as
far as the settings, you'll see, uh, you
can play around with them here. Um
Nick did a really great job with that.
Um you see a lot of this event. This was
Nick. You can imagine this on the small
screen. Um we got the keyboard. We did
so many revs of the keyboard. Um the
keyboard is incredible. Um it's actually
quite delightful because you don't
expect it to be good. Um so I think that
that's one of the cool things about the
the form factor. It totally works. Um it
wasn't clear to us that this stuff would
work and then you just build it and you
see. So totally works.
There was actually a funny quote from
Harold uh
yesterday. He posted he drove I guess
he'd been driving with a comma 4 for a
few months and he went back to a 3X and
he's like this just feels like watching
like a big TV. Um you know it's like the
opposite effect, right? If you went to a
small TV now you know you went to like a
24 inch you're like what is this? You
got the opposite effect of the comm.
>> All right another question over here.
>> Hey congrats. Um, does the KMA
electronics complies like fully formal
certification?
>> Yeah, it's FCC certified. Um, yeah,
>> it's uh it's got all the things you need
to use it.
>> There are like levels or grades like
about the certification or
>> as far as what
>> about the components like safety or
>> component safety? What what do you mean
by component safety? So, there's like
standards around functional safety,
right?
>> Right. Um and yeah, this is it inherits
all the same stuff from our previous
products. Um
yeah, we I mean we observe ISO262. Um
you know, it's it's FCC certified. Um
it's a good product.
>> Great.
>> All right, we can take one more
question.
uh with the uh the confidence circle
feature that you have, what's been your
experience in terms of driving and and
using that? Um is it just kind of
something that's interesting to look at
or does it change kind of how you use
the product?
>> It's changed for a little bit for me. Um
it it's also fun because experimental
mode is just kind of getting good now
and you can kind of see what it's
thinking. Um,
but uh the whole UI just communicates a
lot more about like especially since I
know how a lot of it works and how a lot
of it is written. Um, I get like when I
see like the torque bar like do like a
little jerk or something, I'm like, "Oh,
I I see that bug that we have in like
the lateral controller or something." It
exposes a lot more state to you. Um, and
I think it communicates the same thing
to users who don't understand the
internals, too. Um, just a bit more
implicitly. Um, so I think that's one of
the really cool things about it. Um I'd
be curious to see how it would look. Uh
unfortunately experimental mode got good
at the same time. Um unfortunately
unfortunately but uh it's you can kind
of see when experimental gets a little
bit better as it has been getting a
little bit better each release. Um it
gets a little more confident especially
on my commute. I can see I got like a
lot of roundabouts. Um I change highways
a lot. Um
and the the it's a lot of fun.
>> All right. Thank you guys. Adep will be
available for questions also in our
Q&A. He's around. Find him, ask
questions. Um, it is lunchtime, but just
uh if a reminder for anyone that pre-
purchased merch, it will be available at
our comma shop over
I'll do some yoga.
>> All right. Do we have some questions in
the audience?
Oh, you've already gotten all your
questions out.
>> I don't even know who I'm directing this
to. Uh, I'll pick a deb crystal ball
time.
When uh Best Buy [laughter]
>> Oh, there we go.
>> Uh, I I think we got a Let's see how it
sells on the website. Uh, the Best Buy
is
I don't know if we want to sell it to
the Best Buy person. The thing about the
Best Buy stuff, um, the Mei, we like to
say the M and Mei stood for mother. um
in that it's ready for your mom and it's
not that we want to actually sell it to
your mom. Um it's a way about thinking
in the limit. Um another thing I talked
to the hardware team about is the $99
Maci. It's like if we had to have the
cost of this thing, you're like, "Okay,
I'm paying $4 for the cable, $12 for the
box, and then you start adding stuff up
and then you're like, wait, this is a
pretty significant percentage of my
thing." So, it's a way about thinking in
the limit. Um we'll see if Best Buy is
that relevant. Um
I think we're still a bit ways from
there, but uh it's the first product.
You know, we had a noddev kit, we had a
product, we had a bunch of dev kits. Um,
>> maybe 6x. We'll see. We'll see how this
one sells.
>> Okay, we've got one back here.
>> Hey everyone. Uh, I just want to say
first of all, amazing work with KA and
to you guys, the people in the past. Um,
I had a question for the ML team. I
guess is in the diffusion space. Uh, one
of the questions I had is when you
generate the videos, are you generating
them two individual videos and then
combining them or are they one world
space model that you're generating
together? Uh, because the fact that
they're both consistent really like was
sick. So, I was just curious how that
works.
>> No, we generate them at once. Our
compressor takes in both frames and
compresses both of them in one latent
vector. So we the ward model generates
uh both frames at the same time. That's
why they're so consistent and uh uh
there was a question about adding more
more cameras in which case we will just
add them to the compressor and they will
all be compressed in one in one in one
latent space and they all get generated
at the same time. That's how you get uh
consistency in the dynamics and
consistency in in the in the scene. Yep.
So all at once.
more questions.
>> Ask us anything.
>> We like talking about this stuff.
>> 1.0
>> 1.0.
>> Yeah. Why zero?
>> Uh,
>> yeah, we used to have all these uh kind
of goals for this stuff. We've kind of
simplified it. Um, we just shipped 010.
010 was defined by the uh what we call
the Tomb Raider architecture, which used
some of the new simulator architecture.
We'll ship 01 which will be the full uh
if anybody's driven the watermelon
models that's the full world model ones
and then 1.0 and 10 long is in chill
mode. Um yeah
>> I was just curious how have you kept the
team so small over 10 years and still
great output
>> refactoring. Uh so we have a few teams
we can go team by we we can go team by
team. Uh I can talk about uh hardware
and production and open pilot and then
uh maybe Harold can talk about autonomy.
Um production I'll show you we refactor
the product. Um, you know, we refactored
the product, we refactored the space.
Um, we designed them together. Um, the
factory is the product. Um,
the hardware team has grown a little bit
um with this product. Um, it really
didn't get out the door until we grew
the team a little bit. Um, the fact that
it's so quiet was uh one of the big
contributions from our new members. Um,
beautiful design uh was uh Nick.
And then the the software team hasn't
grown as much, but that's uh uh we'd
like it to grow a little bit. Um, we'd
like to ship a beautiful mobile app. Um,
I'd love to ship fast boot times. I'd
love to ship a new update. I'd love to
ship tons of software stuff. Um, but we
don't have to grow that much. Um, we
really just focus on
uh the open pilot you get should be like
some second order effect of uh
the kind of
infrastructure that we set up. Um, so we
spend a lot of time on that and it's
it's about being really focused. You
might see us like recoil a bit when
somebody asks cameras or carports or
this kind of stuff. This is part of it.
Yeah. Um this focus.
Um yeah, I think the general answer is
just managing complexity and staying
focused. I think one thing that I really
like is something George brought up a
lot is that uh the management boundaries
in your company are generally reflected
in the codebase API boundaries. Um, and
so it's really important to refactor the
team to make sure that the API
boundaries in the code also make sense.
And I think one example of this is that
we used to have somewhat distinct
boundaries between controls and the
machine learning policy. But these
things are very intertwined and having
those things be two separate teams and
having essentially both a people and a
code boundary there made that there was
a lot of inefficiency. Both teams often
just blamed each other on oh this is a
controls problem, this is a model
problem. But I mean it's really
intertwined. It's usually a combination
of those things. So then refactoring
that into this all being one joint
problem just controlling the car I think
reduces a lot of the code complexity and
then also allows people to make better
improvements without uh you know
bloating uh the software and and
creating more overhead. And I mean you
know my talk was kind of about exactly
this problem is how do you how are we
able to develop quickly? how do we be
able to ship improvements quickly and
making sure that all of the
infrastructure and stuff is in place
there and it's basically the things I
talked about in my talk is right you
have really good tests really good
infrastructure and uh you keep it all
simple enough that everyone kind of has
oversight this entire thing is managed
by you know including the data center
all the tools everything is managed by
you know five six people u so I think
that keeps it simple
>> forgot something big actually George
will
>> oh sorry I just want to shout out our
community um obviously we have tons of
contributors on GitHub it's open source
Um, you see a bunch of them over there.
There's a bunch more in the crowd and
there's way more on GitHub online. So,
big shout out to the contributors.
[applause]
So, uh, I mean, KAMA has a mission of
solving self-driving cars and delivering
shippable intermediaries. And you have
to ask the question for a lot of these
large companies what their mission
really is. And a lot of these companies
mission is to pump their share price.
And investors haven't quite caught on
yet, but one way you can make your
company look big and important is by
hiring lots and lots and lots of people,
right? Look at these. We have a thousand
people.
[laughter] You good?
>> We We have a thousand people. Wow.
That's a legitimate team.
And until people with money just
completely stop funding this kind of
stuff, you're going to see it. But the
reason we're small is because our
incentive is to solve a problem. The
reason they're big is because their
incentive is to raise their share price.
And investors see big company, big share
price. Oh, yes.
>> Got a question over here.
>> Uh for the C4 and the 2-year warranty,
do you still get that with Prime Light
or do you get it with the full 24 full
version of Prime?
>> Full Prime, $24 a month. Other
questions?
>> We'll clarify on the website this week.
>> Is is there a reason the video segments
are one minute or like did that just
kind of how do you guys end up at one
minute segments?
>> I don't know. Anybody know?
>> It's a good length, you know.
>> What's the history behind the one
minute?
>> Um, I mean, we had some choices. is we
thought about 53 seconds, but we thought
60 would kind of just be better.
>> 67.
>> You know, with all these uh forks and
variants, have you guys been thinking
more about third party APIs or SDKs and
making it easier to develop on or pull
data out of?
Yeah.
>> Uh, yeah. So, I mean, we have the best
one. Um, all the code's open source. You
can mess around with it. Um, as far as
what happens on the back end, um, this
is also pretty transparent as far as
like if you want to interface with our
app and stuff, if you're making some
kind of open pilot like software. Um,
it's pretty clear how our software works
if you just mimic it. Um, and then as
far as
making forks trainable and stuff like
this, we're starting to move in this
direction. Um, I think it's playing out
such that Open Pilot is like, we know
Open Pilot's pretty bare bones. Um, we
want to just sell you a thing. If you go
to our website, you find your car, you
find the Honda Civic, you click add, and
you get it. We want you to set up in
five minutes, and you don't really have
to think about it. Um, this is all the
experience we all drive with. Um, and
then, you know, you have Sunny Pilot,
you got Frog Pilot, you got Star Pilot,
you got Blue Pilot who do the Fords. Um,
this is like all the Linux distros. And
some people, you know, they hear open
source and they think hacky. Um, but I
mean Linux is everywhere. Um, and open
pilot will be the Linux.
>> Got one back here.
>> Are you guys planning on keeping two
modes for the foreseeable future? Like
why not just one mode or three? Like
chill versus?
>> We don't want two.
I mean, the reason there's experimental
mode is because if we made it the
default, people would be upset. Uh, we
want that to be the default mode, but
it's just not good enough yet. So, I
mean, that's what we're working towards.
Uh, is making that good enough to be the
default.
>> All right, one more question over here.
Yeah. So, I'm not sure if you already
covered this, but um is the external GPU
going to be usable properly on the C3X
or is there something specifically on
MIC that requires it? Just making sure.
>> So, it does work. Um the MIC has one
thing that's very specific, Comm. Um the
Commore has one thing that's specific.
Um we improved it. So, I don't know how
many of you know this, uh but uh USB and
GPS don't like each other. Um and the
thing is we need GPS to train. Um you
saw Mitchell's talk um you saw the
localization stack works. Um so we
didn't know this uh until we did the
comma 4 and uh so we made some
improvements in that regard. Um so
that's the one big difference but for
the user we might not we might not be
able to train on your segments but as
far as we know there's there's no
differences right now. Um, yeah.
>> Yeah.
>> GPS,
>> which at runtime is no longer required.
When the 3x launched, it was required at
runtime to drive. Um, we've removed
this. Refactor, refactor, refactor.
>> All right, we might have time for one
more question.
So I was wondering how um the comm prime
works in terms of like cellular plan. Do
I have to kind of use my own eim or
physical sim in order to kind of get the
benefits of it or do you supply because
I remember at some point it came with
cellular cellar from comma I believe.
>> Yeah. So uh since we introduced comma
prime we would ship like a T-Mobile or
AT&T SIM. It changed over the years. Um,
and the problem with those SIMs, uh,
those are just normal SIMs, um, like
pre-ES SIMs, and as soon as you cancel
those, just because this is how the
carriers operate, you can't reactivate
them. It would have to ship you a new
SIM. Um, so the ESIM just simplifies
that. Um, it's still a very managed
experience, and there's a lot of
subtleties to eims, unfortunately. But
the ESIM that's in uh, the Comma 4 is
the same type of EI that's in your
iPhone. So, if you want to take your
comma 4 and you want to install your own
ESIM, um, we don't have a convenient
interface for that yet, but the hardware
totally supports it. Um and right now
what the software supports is setting up
our managed experience. So comma prime
is a totally managed experience. Then we
offer Prime Light uh mostly for
international people. Um and if you want
to install your own sim that kind of
stuff, you're totally able to. Um but
the comma 4 vibe is, you know, it just
works.
>> Yeah. Yeah.
>> Can we fix that?
>> Yeah.
>> We'll work on it.
All right,
>> the team will be around. Oh, so sorry.
The team will be around for more
questions out in the space. They love
talking about things. So, feel free if
you have any unanswered questions, find
them, talk to them. We have one more
talk uh which is going to be over here
by the Porsche by one of our star
contributors, Jason Young. Um if you
were at Comic Con two years ago, he gave
a talk how to port a car. This is how to
port a car V2. So, um, he is gonna go
live. So, we're gonna need about five m
minutes to transition our camera over
there. Um, but we invite you to go see
his talk. It's starting in approximately
five minutes. Um, after that, there will
be pizza. The bar is still open. And if
you have not picked up your merch yet,
please remember to do so before you
leave tonight. I want to give a big
thank you to the whole team. They have
worked so hard. uh to bring you this
beautiful comma 4 and we're so excited
to share it with you today. Big shout
out to the people that aren't on stage.
Also, our production team, our
fulfillment team, they are all here and
they work behind the scenes to build
these beautiful devices and get them
shipped out to all of you. So, thank you
so much for being here. We're so
excited. [applause]
Oh, uh, I just want to give a live
update to my talk, um, Maxim and I's
talk. Uh, we brief we briefly talked
about piest in the beginning, uh, using
that for our test suite. And my, again,
my point was that you shouldn't always
rely on libraries because they they, uh,
they they take out the complexity for
you. And just today, eight hours ago,
Piest pushed an update that broke Open
DBC test. So, I had to fix that just
now. So, yeah, we should write our own
pieest.
Hi guys, welcome back. I hope everyone
enjoyed lunch. Uh our next presenter is
George Hot. So please gather around and
uh we're very excited to bring you the
second half of the talks. Uh welcome
George
on the mic and then it turns green and
then you can hear me.
I'll give everyone a minute to get in
here.
I made this logo myself.
[laughter]
>> See if the clicker is going to work. We
only have one AI picture in the slides.
We'll see. Uh
yes. So, uh you know, this whole space
really is a game of survivor.
Um a lot of people have been voted off
the island.
Uh so that's kind of what this talks
about. thought I thought it was
appropriate to steal branding from a
reality show. Uh so, uh my name is
George Hutz and this is Outwit, Outplay,
Outlast. So, um does this work?
Here we go. Uh so, you know what? I
don't work at comma anymore. Uh I am
still the president, but you know, you
uh you heard from Adib who presented the
comm and you'll hear from Harold after
me. they uh are the executives who run
the company. I am a cheerleader
and so I'm mostly here to to cheerlead
sometime. I complain
uh you know like oh man you know you
think the cheerleaders ever complain
like why'd you guys lose that sucked I
could have thrown that ball better than
that. [snorts] Um so uh yeah those are
the things I do. Uh, so you know, you're
hearing from a cheerleader here. You're
not hearing from anyone with any secret
inside knowledge, but this has just been
my observations. I used to work at
comma, so I know a little bit about it.
We can talk about what the original plan
was. We were going to contract with
Tesla to replace Mobilei. Uh, that deal
fell through. Uh, you know, we got some
good press around that though. That's
fun. You know, Elon's a great guy. It's
really, it's really, uh, you just got to
think about the thing I really like
about Elon is he inspires you. Even if
you're his enemy, if you're his friend,
it doesn't matter. It's like it just
shows you that great things are
possible, right? And this just, you
know, it's what makes me really happy.
So, you know, even though the contract
fell through, it's great things are
possible, right? Um, so we're going to
build autopilot anyway, right? My
contract was to replace Mobile and the
original Tesla autopilot. Uh, we build
it anyway and we're going to sell it to
car makers. You know, a lot of people
are like, "George, George, why doesn't
Kama work with car makers?" You know,
this was the original plan. We were
going to go sell to car makers, right?
But
so we built it. We built it.
This was the original comma car. Uh I
stole this from another TV franchise. We
got engage, right? Um you know, this was
on Bloomberg. Uh 10 years ago, we had
all this like stuff. Think I think Adiv
talked about this a little hot added a
joystick to the car center console. A
pull of the trigger engages the
self-driving system. Right.
Uh why did I use the cruise control
button?
Um but business so I you know this this
works right. It was actually it was
really good. Um we did a did a road trip
to to Vegas. We're driving
it's not quite as good as modern open
pilot but a lot of it was there. A lot
of the stuff we've done for the last 10
years with shippability.
So we build this and I'm like okay so
now I just got to like you know talk to
the the Yeah. Uh, that's the only AI
generated photo in the slides. It's kind
of like Hello, Mr. Ford.
Yes. Okay. So, you see this
this Mr.
You You don't What do you mean? You
don't know what a P loop is? No, no, no,
no. But like, no. It's using like an AI
model and predicting the steering angle
and putting that to a P loop, but it Oh,
yeah. Uh, I mean it might as well be AI
generated, right? The business just
there is no Mr. Ford. I was misled by
how Tesla was run because there actually
is a Mr. Tesla. You can go to Elon and
say you're using a neural network with a
P loop and he's like that's shit. We got
model predictive control.
Um, you know, so it turns out you you
can't just like do this, right? And even
people today say, well, why doesn't
comma work with car makers? And I want
you to like take that and then think
about that a little bit more and think
about how that might actually happen,
right? Notice that a lot of people have
this idea. A lot of companies have the
idea that they're going to sell to car
makers.
And we're going to look later in this
slide into how it worked out for them.
So giving up on this idea was the right
move. I understand that it doesn't feel
right. I understand that people have
this idea that well but you should
that's what makes you a legitimate
business. Look at my figure head
polishing machine, right? It is fake
legitimacy.
So, we're going to pivot,
right? Sell to car makers. Who came up
with this idea? No. Me? Fire that guy.
Um, we pivot. And what are we going to
pivot to? Well, can a cell phone drive a
car? It was kind of the original
question. We thought about all that
stuff and we're like, can we run all of
this on a cell phone?
And the answer was yes. And we did it in
about six months. And then we launched
the comma one. Uh the comma one was
shipping by the end of the year for
$9.99 and $24 a month, right? Which is
actually exactly what the comma 4 is.
The comma 4 is $9.99. And uh you know,
optional $24 a month. We don't have a
page on the website describing it now,
but you guys should buy Prime anyway.
It's in the FAQ, don't worry. Um
[laughter] but uh yeah, no, it's it's
the exact same thing. It's the exact
same thing. But I didn't realize
actually how hard this was. Many times
in my life, I've been hit by Dunning
Krueger. And no one is ever going to
start a company if they don't believe
that things are easy, right? What's the
saying? It's uh you know, we we we
didn't do it because it was easy. We did
it because we thought it was going to be
easy. Um yeah. So, [laughter]
uh,
yeah.
I mean, like, and I didn't really like
see it, but like we just kind of weren't
there.
Um, yeah.
And then we got a reach out from Nisha.
I'm like, "Oh my god, guys, guys, it's a
it's a it's a cell phone in a plastic
case. You're really you're already
harassing me and telling me you want
fines." And I'm just like, you know,
when they go left,
you just like eat a cheesecake.
You see what I mean by that? Right? It's
like, you know, the saying like when
they go left, you go right. When they go
left, you eat a cheesecake. Like it's
like it's like these people don't even
understand. Nobody understands what's
happening like right now with AI. It's
so fake. And it was fake back then. It
was just the beginnings of it. Now
people are like kind of starting to
catch on, you know what I mean? But like
10 years ago, people were like, "Oh, the
media. Oh, this is in the New York
Times. That's a legitimate news source."
Right? Now it's like the media, right?
Um, you know, try try until you die is
not what most people would advise. In
this case, however, startup comma AI is
probably close to calling it quits 2016.
Lessons from the failure of George Hots
and the comma one semi-autonomous
driving system Forbes 2016
is taking its ball and going home.
Automotive news 2016 autonomous vehicle
company shuts down in fear of regulation
and like this just isn't true. And it's
so interesting like when you see a media
story about something that you
understand. This is gelman amnesia,
right? Like like you see a you see a
news article. Let's say you know you
study physics and you see a news article
about physics and you're like, "Oh god,
these people don't know anything about
physics. Why can't they get a physics
guy? Oo, international politics. Wow,
Iran is sure causing trouble. They must
be really informed about this." It's
just like, "No, they're so like like
well
skate where the puck is going, not where
it has been." So this was the first
video of Open Pilot driving.
We open sourced it. Uh this was the
first open pilot release. Open pilot is
an open source driving agent. Currently
it performs the functions of ACC and
LCAS for Hondas and Acuras. It's about
on par with Tesla autopilot at launch
and better than all other manufacturers.
And that's still kind of true.
Um,
so we didn't ship the comma one. It
actually took a long time. And again, it
really is done in Krueger. And it's, you
know, no one's to blame but myself,
right? I don't blame Nishka. I don't
blame the media. It's fun to make fun of
these people, but fundamentally at the
end of the day, I had a phone in a 3D
printed case. So, four years later, we
shipped a phone in a 3D printed case.
[laughter]
No, no, no. Like, look, the case is like
smaller. And look, we added some IRL
LEDs down here. We had a GPS. There's a
board in the back here. It's pretty
nice, right? Who owned a Commto?
I had a few people. Yeah. Yeah. Uh, you
know, it was something.
Um, and it was $9.99 and $24 a month.
Uh, so then after the Comma 2, we
shipped the Comma 3.
Uh, the Comma 3 was starting to look
like a real product. The Comma 3
actually shipped pretty quickly after
the Comma 2. Um, look at that open
pilot. Looks pretty modern. It looks
pretty good. Uh, but the comma 3 was too
expensive, right? Who had a comma 3?
Wow, more of you than comma twos. I'm
sorry you guys paid so much money. Um,
but you know what? Don't feel bad
because however much money you You're
out two grand for a comma 3. We're out 5
million on the comma 3. Comma lost $5
million on the comma 3 project. Sales
stagnated. The product was too expensive
and undifferiated from the two. It was a
lot better. We made a lot of progress in
making the thing look like a consumer
electronic. But fundamentally, this
didn't drive sales. This is the comma 2
error. And this is the comma 3 error.
But, you know, we fixed it. We shipped
the comma 3x. How many people had comma
3x? All right. All right. A lot more
3x's out there. And it was sold for a
good price.
And that fixed sales.
All right. So, what do you guys think?
Futurefacing statements. I got future
facing statements here. Um, yeah. So,
uh, no, I mean, I think that
the presentation's pretty good. The
website's pretty good. The device is
amazing.
None of the stuff we've shown off does
justice to just how much better this
devices than the old one. Um the
I mean like like you see this like
picture in the UI and like it looks like
oh you know this could be like
photoshopped by some like fake company.
You know, it's so difficult today to
tell the difference between what's fake
and what's real because what makes
something real is an incredibly
difficult engineering problem. And
hopefully we conveyed some of that to
you today, how just insanely difficult
it is to make this device. And people
are like, "Oh, you want an 8-year-old
mobile phone chip?" None of that
matters. My Apple 2 was more responsive
than Apple 2 running Visical was more
responsive than my M4 MacBook running
Google Sheets.
Why is this? It's just it's just due to
this insane
complexity of software. None of it has
anything to do with the actual hardware.
This thing is 10 years of refinement in
a piece of software. You saw the first
version of the software. You see the
current version of the software. I'm
hearing about mutation testing this
morning. I'm like, damn, we got to put
that in Tiny, like [laughter]
um you know, but uh yeah, I mean, I
think this is the first one that is a
it's a really a top tier consumer
electronic. Um I love consumer
electronics. Ade really loves consumer
electronics. Uh yeah, it's it's really
if you buy this device and get one
shipped to you, I think you'll find it
it might actually be the best unboxing
experience you've ever had. And I don't
say this like I say this I'm actually
like thinking about it, right? Like
because when people buy like a like a
new laptop, right? It's like okay, yeah,
it's a little bit better than the old
one. And if you guys had a comma, maybe
you know some of the magic would be
lost. But for someone who's never had
this, for someone to realize that you
can buy a little device that fits in the
palm of your hand, stick it on your
windshield, and it drives the car,
that's magic.
And you can describe it to a
six-year-old, right? So, here's your
test. Here's your test for all
technology. Whenever someone tells you
that they have SOME NEW TECHNOLOGY, OH,
WE'RE BUILDING HUMANOID ROBOTS. OKAY,
COOL. Can I like have one over and have
it like, you know, cook me some pasta?
No, that doesn't exist.
But you wouldn't know it. You wouldn't
know it. If you consume media, if you if
you consume advertising,
all of this stuff looks possible. That's
fake, right? Oh, AI coding is going to
lay off 30% of engineers like actual AI
coding, right? You can't even use these
things for customer support jobs.
The the the disconnect from reality and
hype is is insane. And I don't have any
language to convey
Like I can I'm not better at hype and
better at advertising than those people.
They're actually better at it than me.
But what Kama is better at is making a
product. So I think if you've never
driven a comma and you buy this comma
before, it might be the best
um consumer electronic experience
consumer electronic experience you've
had since like I don't know you guys
remember getting like an N64 when you
were a kid. Those are the real magic
ones, right? Because from the SNES to
the N64, that was magic. From the
PlayStation 4 to the PlayStation 5, and
now I'm playing Modern Warfare 6 instead
of Modern Warfare 5. Well, it's not
really better, but they're shutting the
server down for Modern Warfare 5. And
okay, right. So, you know, it's a top
tier consumer electronics. Look at this
great circuit board. Right now, that's
the circuit board from the Comma 3.
That's the circuit board from the Comma
4.
Uh Adiva already went through this, but
yeah, I mean that's on par with the true
state-of-the-art. Um like I said, we
have an SMT line that's yeah, doing
things that they're not doing in the
fanciest SMT lines in China. Um
vaporphase oven,
uh 3D optical inspection. They're good
about inspection, but they don't have
the they don't have the nice ovens. Uh
that's what the front of it looks like.
This is an LTE modem, GPS antenna. Uh, I
did I did have a contribution to this. I
did I did even though I'm a cheerleader,
I cheerled for something. I wanted the
GPS antenna to be big, right? There was
going to be a small GPS antenna, but I'm
like, the photons come from the sky and
here's the antenna and you got to hit
the right. So, uh, yeah, camera board
connector
come for um, yeah,
picture. This projector has very low
dynamic range. It's hard to see though.
Yeah. All right.
What is success?
These are the kind of questions you
start to you start to think about. Who's
succeeded?
Oh, I should have I should have included
this in the talk. There's a great quote
from Jensen. This man owns the biggest
company in the world. And he's like
talking he's just like talking candidate
interview. He's like, "Man, you know, if
id known how much like how much headache
it was going to be and how hard it was
going to be, I never would have done it.
I love this. I mean, I love this. I
love, you know, it's great that he, you
know, it's it's great to see the success
of of people like that. Um, and
yeah, I mean, if if the the top
company in the world, the greatest
founder in history, this is the biggest
company in history is saying this, you
know, then what is success? And you
think about a game of chess. You think
about what success means in a game of
chess.
Success is when you win, right? And you
might lose, you might draw, but either
way, the game ends. Chess is a finite
game.
But what does success look like in an
infinite game?
Success is simply surviving.
So, uh,
you know, That's
Uh this is founders fun back. Keith
Rubis uh the founder of this company
steals all the comma rhetoric. Literally
steals all my rhetoric.
Has over 10x the funding.
Oh, they're gonna they're going to ship.
Oh, now it's automaker partners. But
originally they were going to ship a kit
to put it on your car.
$220 million.
Who remembers Embark
did a spack? Did anyone ever do a spack
and succeed? Did anyone ever Oh yeah. So
glad I invested in that spack, bro.
Come on.
ego based. I was on a panel with these
people. You know, I hear myself talking
and I'm just like, "Oh my god, you have
no idea what the hell I'm saying."
Uh, they're actually being investigated
now by the for like selling secrets to
the Chinese or whatever. And you know,
my thing is just like, "What secrets?"
Billion dollar hit on Argo, right? This
was the Ford Volkswagen
uh joint one. Shifts its bet to driver
assist tech. Yeah, you can you can right
now go use a blue blues cruise on your
Ford or you can buy a comma.
How many billions, you know? Um and then
there's the really big one, of course.
Yeah.
Uh despite 10 billion dollar spent. Um
did you know that Cruz was originally I
talked about this in last year's Comic
Con or two years ago Comic- Con. Cruz
was originally building a $10,000
aftermarket kit for Audi A Force.
Kyle Vote gave up on this dream. He gave
up. He talks about this on Lex Freedman
because it was too hard. There are too
many different cars you're going to have
to support.
Uh figuring out how to support all those
cars is is too hard and figuring out a
uh you know a graceful degragation uh if
everything isn't working perfectly is
too difficult. Comma solved all these
problems years ago. None of this stuff
was hard, right? But then people look
and it just it it it drives me crazy.
It's like there's still people out there
who think Cruz is a bigger success than
Kama.
They lost $10 billion.
I don't even like I don't even know what
to say. Like like like reality comes and
smacks you in the face and you're like,
"Yeah, yeah, that was Yeah, yeah. No,
but it was a good run, man. It was a
good run.
For10 billion dollars,
you could have had six of these. This is
the BIGGEST BUILDING IN THE WORLD. WE
COULD HAVE HAD ONE IN CHICAGO. WE COULD
HAVE ONE IN SAN FRANCISCO. We could have
had one in LA. We could have one in here
in San Diego. But no, we had crews.
Oh, yeah. Yeah. By the way, Kyle Vote,
he's looking for investors. He started a
company called the Bot Company. Uh they
raised $150 million. They're building
humanoid robots, guys. Yeah. Yeah.
Self-driving. That was too hard. But
humanoid robots,
we chose self-driving because it's the
easiest problem in applied AI and it's
still not close to done. We can get to,
you know, some things about that in a
little bit, but humanoid robots are way
harder. Humanoid robots are so much
harder than self-driving cars. And so,
you know, if you like losing money, I
mean, you you can say it was a good
ride, you know, or invest in the new
Burj Dubai. I believe that someone
should build that. Or actually, I really
want to build a large statue of Taylor
Swift. Like, I want to build like a 500
foot stone statue of Taylor Swift on
that highway from LA to Vegas. It's
going to be sick. It's my Taylor Swift
statue. If I ever get rich, that's what
I'm going to do.
Um, so this is my slide from 2016, the
players. Uh, so we have Google, we have
Auto. Well, Anthony Leandowski walked
away with a lot of money until they sued
him for it. Um, and we have Tesla. Uh so
you know uh yeah let's uh
who was notably absent from the oldtown
road uh you know compilation was Whimo's
actually pretty cool. Uh and I'm not I'm
not saying this like ironically and like
what makes them cool is that I can
download an app and use it. And that's
again my test for what real technology
is. It's not real technology if you see
a video. It's not real technology. If
Whimo is talking about how we're gonna
help the blind get around, why can't
they just use Uber? Like, huh? I don't
get it. Stop it. But when I can go to
San Francisco and download an app and
call a Whimo, that's actually pretty
cool.
They're human supervised quasellop.
They're not a solution to self-driving
cars. They have questionable unit
economics. They use maps, but they
survived and they shipped and that makes
them cool. And it's really nice to be in
the car alone. Um, if you read my 100x
investment, like I wrote a blog post
about this in 2018 and um, my criticism
of Whimo actually was not that it would
never work. I I remain quite optimistic
that self-driving cars are going to work
and we're going to get to when the
timeline is and I think that it's very
possible that Whimo will actually have
the first solution um, with these
caveats. But the unit economics of Whimo
would never be as good as the unit
economics of Uber. I dated this girl for
a bit. It was an Uber driver. I'm like,
I just looked at how much she was making
on the rides and stuff and I'm like,
you're losing money. Like, when you take
the cost of depreciation and gas and car
maintenance, she's actually losing
money, right? Uber's new system has
figured out ways to pray on people who
are bad at math pretty much. Or they
have like Uber drivers who are like, you
know, they they carefully like it it's
so amazing when you look at the
disparity of resources between an Uber
driver and Uber and all the little
tricks they can pull. Um, so Whimo will
never be able to compete with Uber on
unit economics,
but they actually might not have to. I
thought that I was in the minority of
people who didn't like having the person
in the car, but I actually think that's
like 80% of people. Um, so Whimo,
despite being teleyop and despite having
questionable unit economics, may very
well be a, you know, a cool successful
service. So, uh, you know, and it's
interesting, you know, they take the
same how Whimo outlasted the
competition, right? Surviving
Um, so yeah, you know, the players in in
in 2024,
uh, right? Like who's left?
Did I miss anyone?
Zuk's okay. Okay. To be fair, Zuk says
Zuk says something. The Does the car
drive in all directions anymore?
[laughter]
Uh, something something something. Um,
but no, I mean, look, the big player
here is of course Tesla. It's always
been Tesla. Um, we can just talk about
since the beginning, we've always talked
about how far we are behind Tesla. Um,
and it has stayed that way. They have
managed to stay about two or three years
ahead of us continually. The new FSD,
I was blown away like at the leaps that
were made from like the FSD 12 that I
tried that I was like, "This is
literally worse than open pilot to like
FSD 14, which is like, all right, they
figured something out. We got to figure
that out too. I think we got it. I think
we got it. But um so you can look at the
fleet size. This is the Whimo fleet, the
comma fleet, Tesla fleet. Um comma is
the second largest video connected fleet
after Tesla. Uh and these are our growth
numbers.
Um so we have uh yeah almost 7,000
dailies and almost 12,000 monthlies.
Uh so yeah, we're gathering big data.
But
again, there's really only one company
to compare yourself to in this space,
and it's Tesla. So, let's talk about our
distance to Tesla. Here's some
breakdowns of some different axes,
right? So, when you look at the
difference in fleet size between Comma
and Tesla, we're off by three orders of
magnitude. Com's 10K, Tesla's about 10
million. Um, when you look at the total
number of training computing compute
that we have, so you can see the tiny
corp, you see the tiny box pros over
there. Um, you'll hear about them more
in the talk later.
Um, we have about a thousand GPUs. Tesla
has about 100,000 GPUs. So, we're off by
two orders of magnitude there. Um,
inference compute, which is how much
compute is actually on the device. So,
if you saw, if you heard about the 10
watt version and the 100 watt version,
right, the 100 watt version is not a
different device. It's literally just a
GPU that plugs into your comma 4. It's a
consumer GPU that plugs into your comma
4. Your average consumer GPU has the
same power as the Tesla uh FSDI
computer, right? You know, Tesla will
never tell you this, but like a 5090
crushes it. A 5070, that's about the
same. Um, but a lot of this is just
because of power, right? The Tesla thing
draws 300 watts, a 5090 draws 600 watts.
Uh, so yeah, inference compute, Tesla's
ahead by two orders of magnitude, but
we'll get to that one later. And then we
have yearly spend. So comm's yearly span
is about 10 million. Tesla is about 100
billion. So that's four orders of
magnitude.
Um so training compute we closed from
three orders of magnitude to two orders
of magnitude by building our computer
factory.
Um inference compute we've closed from
two orders of magnitude to zero orders
of magnitude. So over there on the table
we have the comma compute boxes but
that's what the comma compute box really
is. Uh this is a uh AMD RTX 960 XT. Uh,
it's a $300 GPU, 205 tops, and it
already just works with the comma 3, 3x,
and 4. Uh, the software won't come to
the three, but the software will come to
the 3x and four, and someone can
backport it to the three if they want.
Nice power enclosure coming soon, or you
can build your own out of parts on
Amazon. Um, we'll charge we'll charge
some amount of markup for the nice box,
but you're welcome to build your own.
Okay. Um,
so how much longer to solve
self-driving?
This is Tesla fsdracker.com.
Uh, it's probably the best way to kind
of get at this. We have an internal
version of this, but it's a little bit
different. I mean, like Tesla and KAMA
are pushing on fundamentally different
things. Uh, Tesla's slogan, comma slogan
is make driving chill. Um, our question
is like how do we achieve highway
perfection?
Uh Tesla's question is how can I ship
this crazy feature, right? Like look at
this crazy feature. It's kind of like
Tesla's unofficial slogan. Uh so yeah,
you can look at the the numbers and you
can look the uh FSD14 has really the the
felt experience is
really noticeable in data. Um however,
every order of magnitude takes the same
amount of time. There's a simple way to
predict how long things are going to
take. Human car accidents happen about
every 500,000 miles.
If you believe FSD tracker, current
Tesla stuff is around 3,000 miles for
critical disengagement.
It gets about 2x better every year.
Right? If you want to figure out how
long something's going to take, take the
trend line and continue it.
We have eight more years.
And you know what? Whenever I make like
whenever I say eight years, there's two
groups of people. There's two groups of
people. One's like, "No, man. Have you
seen what chat GBT can do? It's going to
be like next week." And of course, those
people are never right. But there's
another group of people out there too
who says, "No, MAN. YOU KNOW, AI IS
NEVER GOING TO HAVE LIKE the human
reasoning needed to drive a car or
something or the brain is." And it's
just like, you're not right either. The
actual timeline is going to be about
eight years.
Um, and that's for Tesla. Uh,
if Tesla will be there in eight, we'll
be there in 10.
So, uh, you know, we're halfway.
>> [applause]
>> Uh, and this is my last slide. I want
you guys to remember something else
that's lost in a lot of self-driving car
rhetoric.
A self-driving car is not a car. I have
no idea why Cruz and Whimo and Zuks
decided to build cars.
It's nonsense. A self-driving car is a
dude.
He's the self-driving. That's a car. You
just want to build the self-driving. We
don't want to build the car.
The ultimate comma is not a device that
plugs into your car. It's a robot that
gets in the driver's seat,
right? That's where we're going. Why
should we Why should we Oh. Oh, you got
to crack the Toyota security. Oh, no.
Who cares?
Build a robot that gets in THE SEAT AND
GRABS the wheel and turns the wheel.
Now, don't do this tomorrow because it's
not going to work, right? Having
accurate predictions about technology is
super important if you want to know
where to do investment. I wish VCs
understood any concept of this.
Um, but yeah, Open Pilot is a general
purpose robotics operating system. Uh,
Open Pilot, everyone always says, "Oh,
comma, you're going to die if you don't
partner with car makers. Everyone's
going to get security." or oh my god, I
don't care. I want to build a robot. I
want it to cook and clean for me. But
like actually do this, not build up some
hype, right? In the same way Cruz told
you they were going to solve
self-driving and wasted 10 billion
dollars. You're going to see all the
same stuff happen in humanoid robots.
And guess who's going to be there to
pick up the pieces?
Comma and Tesla.
Same people who are there today. Uh so
yeah. No, I mean the comma the common
nine is going to be that guy. Get your
car in here. Is it compatible with my
car? Yeah, bro. He sits in the seat.
All right, that's my talk. I'll take
questions.
[applause]
>> All right, do we have some questions?
>> I just want to say I'm ready for the
comma nine.
>> Yeah, right. [clears throat]
Do you see any reason to shorten that
two-year gap after Tesla? Would you want
to make that shorter? Are you fine being
at that?
>> Um, so when you look at some of the
fundamental things like that training
compute order of magnitude thing, so
KMA's new compute cluster cost about $2
million.
Um, Tesla's new compute cluster cost
about at minimum 200 million. Right? So
it's even more, more like 500 million.
So they're paying a ton of premium to be
early. Uh, I don't think it's worth it.
I'm certainly okay with being two years
behind uh in meaning if you could have a
sustainable business in the meantime. Uh
what might shorten that gap if it turns
out the comma 4 sells wildly more than
expected and we have tons and tons of
money coming in. We may be able to
deploy it somewhat to shorten that gap
but I can't even make any guarantees.
Right? If I can make guarantees maybe
it's worth raising the money but you
can't make guarantees. But I do think
that maybe if we you know again the most
important thing is survival. So
the question is not do you want to
shorten that gap the question is how
much risk extra risk are you willing to
take to shorten that gap and the answer
is zero.
>> I I was just curious um when you speak
about this being comma nine and you know
cooking and cleaning and all those sort
of things do do you mean that literally
that the final form factor of a comma
would be a general purpose robot some
kind? Okay. Wow. Yeah, right. The the
car thing is just again cars are just
the best applied AI problem that exists
today. Self-driving cars are going to be
solved long before humanoid robotics.
>> Um but yeah, what we're going TO STOP
>> OH, GUYS, GUYS, GUYS, INNOVATION'S OVER.
LET'S EXPLOIT, RIGHT? YEAH, let's crank
up the monthly subscriptions on people.
Let's put some ads in that shit. Yeah.
What? What am I going to do with the
money? All these people who like, I got
rich. What did you buy?
There's nothing to buy.
>> Taylor Swift.
>> Taylor Swift statue.
>> Taylor Swift statue. Good point. It's
actually I think it can be done pretty
cheaply. [laughter] I'm not licensing
Taylor Swift by the way. It's called
Generic Female Pop Star if anybody asks.
See, actually I could probably do this
today, but I would need like time.
Uh so I share the sentiment that human
robotics startups are dumb. They will
fail. But what makes Tesla Optimus a
good bet?
>> Um or is it a good bet?
>> Yeah. Do you know what Honda Azimo was?
So Honda really in its heyday in the 90s
also built a humanoid robot. For a
largely successful car company to take
0.1% of their operating budget and dump
it into humanoid robots for press, great
idea. for a startup to raise a huge
amount of money saying they're
eventually going to pay investors back.
That's absurd. Tesla's building the
Optimus. Tesla already has Optimus is
deployed. They're already useful.
They're in the Tesla showrooms waving to
you, right? That's sick, right?
Spending, you know, 10 million, hundred
million on a sick PR project for Tesla
that may turn into something in the
future. So worth it. Raising that kind
of money, ridiculous, right? The reason
it makes sense for Tesla is because
they're a highly profitable automaker.
>> Questions.
>> So to continue on and look at the chasm
that exists from where it is today to
common nine and that what we see now is
body is kind of the beginning of the
compute core for that. What are your
insights around the grassrootsoriented
applications for Kamabody to start
stepping towards a dude who gets in the
car?
>> Yeah, I mean, okay, so there's one
example of consumer robots that actually
works. Who knows what it is?
>> Vacuum cleaners, right? Um, so yeah, I
mean, can the comma body vacuum? I mean,
I want to do it a little bit
differently, right? Like I don't really
want to build a vacuum. My idea is like
can we just like buy a vacuum off Amazon
and then like you know have the body
grab it and vacuum right it should tool
use right um so I think once we're at
that milestone we've also considered the
common body for security um but then you
realize that 95% of what you want is
just a fixed mounted camera and a
loudspeaker
um and good software right so you
actually don't need the robot form
factor for that but like vacuums are the
first robotic form factor to pay for
themselves so once the comma body once
the general purposeness of the comma
body is capable of grabbing your
existing vacuum cleaner off Amazon and
using it then I think we can start
selling the comma body into people's
homes but fundamentally it has to come
and someone might figure out an
application right uh I I don't know if
the body is going to be talked about
more but our goal with the new body the
first body was $1,000 that's insane
right like how can we try to charge you
we charge you $1,000 for a comma 4 and
you'll use that shit 40% of your days
right that's so worth it but if you buy
a comma body okay It's a cool toy. Like
we got to price it more like a toy. So
the new comma body is going to be priced
at $200. And I hope that someone out
there with a comma four and a body f
figures out some use for these things
and we'll productionize it. But I mean I
think like unit is making the same play,
right? Like we bought two of those dogs.
They're cool, but they don't make money.
There's no way to like deploy this thing
in a real application where it like
provides value to you. It's a toy. So
yeah, we're targeting the toy market for
bodies. Hopefully someone will figure
out what to do with it. The software
will get better. But yeah, until you
figure out how to make the robot do
something that makes money.
>> All right, next question.
>> Hey, George. Hey, if you were looking to
put me to work, how much would you buy
me for?
>> Negative. Honestly, negative. Um, and
here's why, right? Like so much of the
fact that things don't scale is due to
managerial overhead, right? So, if
someone comes to you and says, "How
could you put me to work?" you're
actually asking something of me. You're
asking for me to do something, right?
And that that's why it's negative,
right? You got to pay me for that,
right? The the real way to be put to
work is to go work on tiny grab
bounties. Just go work on them or go
work on comma bounties, right? Um but
yeah, no, I think the the uh yeah, I
mean, god, we're getting to the point
where the marginal utility of a human is
negative and that's scary, but
all right, another question.
Thank you for the talk. Um, I wanted to
ask about u the Chinese competition
especially like BU and these companies.
>> What about them? I think they make a
search engine and a maps app that's kind
of confusing to use.
>> I think they're making 500,000 trips a
week.
BU in China.
>> What city?
>> Um, Wooshi, I think.
>> I haven't been there.
>> Okay.
>> I haven't tried it. I mean, again,
probably what it is, I'm surprised by
that. I mean, B stack was open source at
the beginning. Um, Autoaware. I don't
know if it's still open source. It's
autoare, right? The B one.
>> By Apollo. Yeah. Yeah. Who was it?
Autoare was another one. Yeah. Yeah.
Yeah. Um, no, they were open source. Uh,
yeah, it was Apollo. I remember I
remember their moonshot rhetoric. I
wonder what's still open source. I also
wonder how teleyop it is. So, like I
think the Chinese are generally more
open with showing you their teleop
stuff. By the way, Whimo admits to
teleop and you've never seen a picture,
which means that the teleyops a lot more
than you think it is, right? I think the
Chinese actually show you. Well, yeah.
Yeah, we hire people from this rural
province to come sit in this gaming
chair and drive you around. Okay. Um, so
yeah. No, I I think that a lot of this
like teleyop stuff is just uh it's not
self-driving cars. It's cool and it
might be a cool service, but it's not
the same thing as solving the AI problem
of self-driving cars. There's a lot of
other fun problems to solve on the way,
but yeah, I mean, that's kind of my take
on Whimo and all of these kind of like
robo taxi kind of things. It's actually
cool and it actually has carved out its
own niche that has shipped, but it's not
AI.
>> All right, we got time for two more
questions.
Anyone?
Thank you. Hi, George. Um, you've been
posting a lot lately on uh, well, first
you started tiny and you you've been
selling the tiny box. Um, and then
you've been posting a lot on um,
external GPU.
I don't know know what you would call
that, but uh, some way to connect a GPU
to MacBook. Yep. And so can you can you
talk about I guess on a small scale with
that second thing what you're what
you're hoping to accomplish and then
more broadly
uh what do you want the ultimate goal of
tiny to be?
>> Uh the mission of tiny is to commoditize
the paflop.
Um so what that means is right now
there's an extreme premium uh for Nvidia
paflops. Uh we'd like to bring the
general price of the paflop to only be
slightly above the cost of the silicon
and the cost of the power. Uh that's
mission one. Mission two is to
rethink about how software is made. Tiny
has cut through every dependency in the
Nvidia stack. We're speaking directly
over PCI to the NVIDIA GPU. Um yeah,
without Nvidia's user space, without
Nvidia's driver, without anything from
Nvidia, without Kublas, without any of
that. So I think that in order to get
very reliable robots in the future,
you're going to need an operating system
that matches that level of robot uh of
of robustness of reliability and I don't
think that we're going to get that
through things that look like the
current stack. Tiny is radically 100x
simpler than the existing stack. And
that's what you're going to need to get
reliability of things that like you know
a human is never going to glitch out and
slam their head as hard as they can into
the table unless there's something
seriously wrong with that human. Like
that's not like some probability that
will just never happen, right? With
computers. Oh, sorry. Sorry. Your kernel
got stuck in a thing where it was
servicing this interrupt for 300
milliseconds and the motor was at full
torque. Okay. Yeah. So, I think we need
high reliability deterministic
computation. That's kind of what tiny
bit is for robots. Runs in comma
already. So,
>> all right.
Let's George will be available also in
the Q&A. So, uh, let's we're gonna
finish up with his talk. Thank you so
much, George, for that.
>> Thanks,
All right, this is Harold here to talk
to you more about robots. Um, Harold is
our CTO CTO. Welcome, Harold.
Hello. Yes, I'm going to talk about
robotics. So, I lead the autonomy team
at KMA and what we're doing is we're
building autonomy software for robots.
So to start I just want to make it very
clear if that hasn't been made clear
already is that KMA is a robotics
company. I joined KAMA eight years ago
because I was really excited about
robots. I think any vision of the future
that is exciting that I'm excited for is
one that includes a lot of robots. And
back when I joined almost 10 years ago
now, been there eight years, it seemed
like self-driving was just the best
applied AI problem uh that would kind of
bootstrap robotics into becoming the you
know robotics future that we all kind of
dream of. So I joined back then for that
reason and even today that still seems
true is that the most interesting
developments made for robotic software
are being made in the uh autonomous car
space and KMA is now part of that.
So as part of that goal to develop that
software, you know, we want to make a
useful robotics product. That's what I
want to build. That's also what I want
to buy. I think that's the kind of stuff
that excites me to make it a real
business. You got to sell it for more
than it costs to make. You guys saw the
new 4. The comma 4 is a great step in
that direction. Fortunately, my slides
are not up to date uh as of this
morning. And uh I want it to be open
source. When I use products, it's really
nice when it's open source because I
think it makes it way easier to align
the product and the software to what the
consumer wants because you can just fork
it and make it the way you want. Uh if
the ecosystem is entirely closed, you're
just kind of at the whim at whatever
this big company decides. Whereas open
source, you kind of give people the
option to improve it. And then this last
point is something that I'm going to
talk a lot more about in this
presentation and that I think is really
important and also a big deviation from
what people generally do in this space,
which is no cloud whatsoever. Everything
that we do, all the development, all the
data, every experiment needs to happen
in our data center which we own, we
control and we operate.
And I'll tell more about why I think
that's so important uh in the future
slides.
So unfortunately when I said robotics,
some of you started thinking about
humanoids again. And so I think it's
important to just start this
presentation with a reality check. And I
didn't review anyone else's slides
before starting today. So this is going
to be the first of many déja vu. The
good news about the déja vu is that I'm
saying the same things other presenters
said. Uh which proves that we're at
least somewhat aligned inside the
company as opposed to accidentally
saying the complete opposite. But so
figure is dumb.
Anyone who's trying to tell you that a
robot's going to do your laundry in any
of the next few years is just trying to
sell you shares. That is completely
unrealistic. there is no intermediate
product that is being sold that there's
anything that even looks like that. So,
it's a completely absurd proposition.
Um, and you know, that's just PR.
They're trying to sell you shares and we
shouldn't buy it.
So, that part of the reality check over.
I don't want to just be a downer and
hate on fake hype. I also want to talk
about some of the robotic products that
actually exist. Uh, George already
talked about this. Whimo is a real
robotics product. Uh, I've used them. I
think it's extremely cool. You know, I
like Ubers and that they get me places,
but a way is just a better experience.
It's really cool to see a robot move
down the street and be useful. You're
alone in the car. You set the music as
loud as you want. Nobody complains. It's
awesome. It's genuinely really cool. Um,
however, there are some downsides on the
technical side. George already arrested
there some form of teleop. Even though
it's clearly a robot, it's uh not
necessarily an entirely autonomous
robot. But I think the bigger problem in
terms of a robotics product is that you
can't buy one. Any of you here have a
billion dollars, you still can't get to
buy your own Whimo and sit in it.
And also for them, it loses money. So it
doesn't really satisfy these conditions
uh that I set out as our goals. Then we
go to an even lower level of reality
check. What are the useful robots you
can actually buy? Um in industrial
applications, there's quite a lot. I
don't know if you guys one of my pastime
for a while on YouTube was to just look
through farming videos in uh in the
Midwest and it's absolutely incredible
what farming robots can do. You can have
a few operators run what used to take
10,000 people to run a 100 years ago.
And a lot of this stuff now is is quasi
automated. they live in some constrained
environment and they can have
technicians and um it's it's very
constrained compared to like a real
world environment on the road but it is
largely autonomous and extremely useful.
Then we get to Teslas which you know
they are autonomous robots. They might
not be unsupervised yet but they're a
cool product that you can actually buy.
And then the last the lowest tier is
what useful things can I buy in my
house? And genuinely the most useful
robots you can buy for your house are a
dishwasher and a vacuum cleaner. There
really isn't anything more
sophisticated. So I think this is this
is the status of things. Uh and we
should forget about this whole humanoid
crap until there's something that looks
slightly more advanced than a vacuum in
my house. Uh we can we can stop thinking
about humanoids as the next step.
So
what's noteworthy about all of those
actually existing useful products that
you can experience today
uh is that they all existed 10 years
ago. Uh 10 years ago Whimos were
operating. It wasn't an open beta. That
was only I think eight years ago that
started but 10 years ago there were
Whimos and they were driving themselves
to some extent. Um I had a Roomba 10
years ago that kind of did something. is
not nearly as good as it is today, but
there was Roombas, there was Tesla
autopilot, uh dishwasher is obviously
quite a bit older than that. So, I think
the point of the reality check here is
just that these things are getting
better. I'm far happier with the current
versions of ADAS. Obviously, Open Pilot
has improved a lot. Uh I'm far happier
with uh my vacuum cleaner and my
dishwasher, but it doesn't make any step
changes.
these type of step changes of you have a
Roomba that eats your cable to all of a
sudden you have a humanoid folding your
laundry and comforting uh your dog that
is uh marketing hype. This these type of
step changes just don't happen in
reality. If you want to create a truly
magical technology that is useful like a
dishwasher is that is integral to
everyone's life, you need to iterate and
it takes time. You need to ship a
product and you need to improve it. And
over time you start to create something
that if you look back and compare to
what was there before feels like
complete magic.
Um
I think a clear example of this type of
effect is the iPhone. Uh a lot of people
talk about the iPhone moment as if there
was this step change that happened in
consumer electronics where you know we
were all I don't know calling people on
landlines and all of a sudden the iPhone
came around and everything changed. But
that's not really true. If you look at
this graph on Apple's revenue, you don't
even see where the iPhone was released.
Even the iPhone, which felt culturally
like a step change, uh, still just
follows a natural exponential trend. The
launch, for those who are curious, is
here. And as you can see, they started
selling iPods, they started selling more
of them, and then they started improving
them. And obviously, today, an iPhone is
an incredible product.
So the last thing I want to talk about
this iteration stuff and really driving
this point home is this is my favorite
plot of iterative improvement. Uh it's
about the corn yields um on American
farms. This is how much corn you can
extract from a fixed piece of land. Uh
that's something that people have been
optimizing for a long time because it
makes your farms more productive. And
what's crazy about this plot is just how
straight this line goes up from when the
iteration iterative improvements really
started. What's crazy is nuclear power
was invented there. Electronics was
invented. The internet was invented. And
now we have AI. Yet in the plot of corn
yields, all you see is that things just
gradually get better because they
iteratively improve. And these type of
step changes just aren't really
reflected in the data.
So with that said, I want to have the
complete opposite end of the talk of
trying to hype some kind of future
fantasy world. I just want to talk about
what do these iterations look like
behind the scenes. We've talked a lot
about the kind of models we train and
kind of the autonomy software and how
the autonomy software works. But I think
there is a bigger picture that is worth
talking about that we rarely fully
describe which is to make these
iterative improvements to the model you
need all sorts of scaffolding and
infrastructure uh machines and tools and
I want to talk about how some of those
work just to give more of an idea of
what I think is the stuff we prioritize
at KMA to make uh improvements to the
driving experience.
So we're just going to talk about some
concrete engineering details.
So one slide about what we actually
shipped just so that we have in context
um the kind of improvements that the
tools I'll be describing actually helped
create. So one big thing that we were
working on and we've had presentations
and papers about this. We published a
paper at CVPR about a new method to
train uh self uh the the policy models
which are trained in a diffusion
generative simulator. Uh we some version
of that we shipped to a recent release
and that recent release uh caused a
engagement uh spike here which is what
we were really trying to go for. So
experimental mode is the mode where open
pilot controls everything the steering
the gas and the brake and it's
everything's completely end to end and
you know there was a lot of usability
issues with that that we were slowly
trying to improve and you can kind of
see the effect those releases had. So
this is basically over this year we went
from like you know slightly over 20%.
This is a noisy graph but it's roughly a
5% increase in engagement uh that we've
been able to achieve by doing these kind
of iterative improvements trying to
improve the end to end longitudinal
control of the models. So that in mind
that's the kind of improvements that
we're talking about.
So
at the autonomy team our job is to
develop the models and also the control
stack to improve driving on open pilot.
But one thing we internally always talk
about is that the real thing that we
need to do is we need to improve the
infrastructure, the tools and the test.
And this has been on the whiteboard at
the autonomy team for basically as long
as I've been there, which is that
machine learning and this kind of
robotics improvements is 90% is
infrastructure tools and tests. The
actual machine learning kind of happens
by itself if you figure out the other
stuff. And it says here too on our
whiteboard, we got to make the tools and
tests that make improving driving fun
and easy. And that's really the key is
if you make the path of least
resistance, the fun engineering, if that
happens, if it's fun to improve it
because the tools are so good, because
the infrastructure is so good, it will
improve by itself. So the real focus of
our team and of really everyone um at
comma that's trying to improve these
things is to improve the uh experience
of iterating on it on trying stuff.
So I talked at the beginning about uh
running stuff on our own data center. So
one really big part of these tools,
tests and infrastructure that we use uh
to improve driving are the uh you know
physical machines that all of this stuff
actually runs on.
So we'll start with just the
workstation. This is all pretty
standard, but I thought I'd add it here
just for completeness. We have a
standard workstation that basically
everyone uses. It's just a Lenovo
workstation. They're connected. You we
try to connect them all with 10 gigabit
to the data center. You know, it's just
Ubuntu. It's nothing fancy, nothing
super weird. And we have a monor repo
that all of our code runs on. Uh it's
just one repository that we all have and
it is a Python virtual environment. So
on our workstation, that's what the
workflow looks like. It's nothing really
crazy. It's all mostly standard stuff.
So then where the stuff actually runs is
in the data center. So here's a pick of
our data center. This is a realistic
picture of what it looks like. Uh some
of our pictures are more staged where
there was more cleaning going on, but on
an average day, uh it looks kind of
industrial.
So before I move on, I want to talk
about the own and renting thing. I think
this is really important. Owning the
data center, I think, aligns incentives
with experimental development so much
better. The average engineer working in
the autonomy team trying to improve the
models. What they really want is just to
make a model that drives better and that
they can put on open pilot because
that's what makes us happy. Um, now if
you run stuff in the cloud, the easiest
way to do that is just to spend more.
You can train the models for longer. You
can train the models uh on more data.
And all you have to do really is to
change the scaling factor, but also the
spend. And so the path of least friction
into making a better model in the cloud
uh is just changing the budget which
that's not really great incentive
alignment because as a company we're
trying to make money. Um so the
incentive alignment on our own data
center is much better which is you're
using all the compute already but your
model's still not improving as much as
you want. So what do you have to do to
do that? you have to change the code to
be make it more efficient to make it
train faster so that in a realistic
amount of time you can get to a better
driving model uh faster. So I think this
this incentive alignment is really
important and it also leads to other
things like
if the data center is idle, if it's our
own data center, we're encouraged to
experiment which is a good thing. You
want engineers to use the idle compute
to find out stuff to experiment. In the
cloud, every experiment costs money. Um
so you're kind of disincentivized from
experimentation and kind of incentivized
from doing these large scale production
runs uh which I think long term costs
just way too much money for what it
achieves. So we need our own data
center. Uh this is what we have. It's
been talked about a bit before. There
are about 200 machines.
Absolute max capacity is theoretically
400 kilowatts.
We haven't achieved that yet, but we're
working towards it. I mean, having more
power usage means that, you know, we're
more effectively using the GPUs and
CPUs. And as long as we're not running
some kind of burn script, that's a good
sign. We have about a thousand GPUs. A
lot of them now are these Tiny Box Pros
that you saw a demo unit of there. Um,
all of the data that we use for training
is also stored inside this data center.
We don't have air conditioning because
power is very expensive in San Diego.
So, we just have standard fan cooling
and uh that works pretty well for us.
Uh, terms of software, they're set up
kind of the same way as the workstation.
So, there's nothing custom there. Again,
we just have Ubuntu running on them.
They're managed by the same software in
the back end. So, that's all pretty
easy. Uh, that was the highest power
usage I saw when I was making this
presentation, which was 235 kilowatts.
However, we made some improvements then
since then and made some uh installed
some more computers. So, yesterday we
hit 320 kilowatts and once the full
buildout is complete of the Tenny Box
Pros, we should be should be hitting
closer to 400.
So, there's several services that uh we
use when we develop stuff. Uh for
example, we have a data server which you
can ask for the driving data. uh we have
model servers that you can ask for model
weights of a particular model and all
sorts of kind of small services that are
critical to uh to the development that
we do and all of them run on just this
picture of machines. This is about uh in
total it's about eight machines I think
that run essentially all of the services
that are the masters for all of the
services. These are just three big super
micro machines and then we have some of
these Dell machines. I think one of them
is the climate controller. climate
controls data center is very important
because if that fails and kind of
everything crashes so that's a dedicated
machine one of them is a router we have
one that manages the data ingestion and
that's pretty much it I mean this this
half rack is really uh all of the all of
the centralized services that we use uh
they run everything everything else in
the data center is just compute or data
storage
so you'll hear a lot more about data in
the next talk from Mitchell um but I'll
just quickly give a fast overview. We
download a lot of data from the devices
when they're driving on the road. Uh
that includes camera files. It includes
open pilot logs. It's just in one minute
chunks, right? We did some work to
improve the ingestion. So right now
we're doing about um a thousand hours a
day. So that's quite a lot. I mean
George already mentioned it. We are the
second biggest fleet uh after Tesla and
I think on a per user basis we ingest
far more data than even Tesla. So we
we're really doing quite well on the
data aspect
and you can see there in our last uh few
months we really up the ingestion. We
released the model trained on a lot more
data.
So I talked about the data storage.
Uh so one of those servers that I showed
earlier is the master and then we have
all these nodes that essentially have a
bunch of hard drives in them. Uh I think
they're not sure how much one machine
is. I think it's like 80 terabytes or
something on one machine. Um, and that's
basically that array is all the data
that we have and it's all stored
locally. It's all non-redundant. If we
lose it, it's gone. It's cheaper that
way. We hope there's no fire. Um,
because then we'll have to pull in data
all over again.
So, this is a distributed key value
store. It's single master. Uh, it's open
source. George open sourced it a while
ago. So, if you're curious how that
works, you can check it out. But the key
is it's extremely simple. Having one
master makes things much easier. Uh, and
hasn't really caused many issues. So
that's where all the data is stored and
uh it's just uh just a web server
request to get the data in whatever
you're using. So data is one part but
the other part I talk about is that all
the other nodes are compute. Uh so there
needs to be a convenient way to use that
compute. You need to be able to just
write easy code and then run that
compute on all of the machines uh easily
for the development to be fun. So we
have this tool called mini.
Unfortunately it's not open source yet.
We're open to open sourcing it. It's
just kind of hard with some of the how
it's integrated with some of our other
stuff, but that's something we're going
to work on. Um,
basically what it allows you to do is it
allows you to write some arbitrary
Python code uh and then you send that to
some master server uh that hosts the
request which contains some code and
potentially some data. Um and then that
gets sent to really any um any node
that's a computer that has compute
available that can run it. And every
machine in our data center that's not
doing something else is available as a
mini rate consumer. So it can consume
these jobs and run this arbitrary code.
Of course GPUs are very relevant now. We
do a lot of GPU work. So we make it
support GPUs and have like a model
server for efficient batching and that
sort of stuff. Um but yeah so you can
write any kind of Python code and you
can access of course any of the data
that's in the data server. So if you
want to do any kind of driving
experiments you can do that. Um not
going to th go through the specifics of
this but I just added this here. Uh it's
extremely simple stuff. If you want to
run any Python function on all of the
machines like simple function like is
prime really you just have to write this
code. It's written the exact same way as
a normal thread pool executor in Python
and you can just distribute across the
entire data center. So we've really put
a lot of effort into making this this
simple. Uh you know this is the result
of many iterations of distributed
compute and this is kind of the final
result. It's funny because in retrospect
it looks obvious we just copied the uh
copy the Python thread pool executor API
which seems obvious in retrospect but of
course it takes many hacky detours to
kind of come to this clean solution. But
right now that's all you need to do to
run um if you run a one want to run your
is prime function with 200 kilowatts
that's all the code you need to write.
So just giving a quick example of uh of
how you would use this on an average day
if you want to do something cool. So
this function right here this is a real
function. This allows you to get a list
of all the data in our entire data
server. So it's several million minutes
of driving and uh we can enumerate all
of the files in that whole data storage
uh in just like 20 seconds. So all you
have to do is do this and you'll get
literally a list of in all data that we
have stored locally in the data center
and then you want to run some stuff on
mini. So in this case we can just run
some easy thing like oh get you know the
hard break segments for something that
might be interesting uh and then you
just display a video and this is real
code. This is actually code that exists
in our codebase. It really is this
simple. It was a huge effort to get to
this level of simplicity. Um, but we're
very proud of the state it's in now. So,
if you run that, the result you get
something like this. So, this is
something I ran like a week ago. Um, it
just goes through basically all the data
we have stored and just looks for
hardbreaking events and there just like
some interesting examples of just weird
things that happen on the road. Uh, this
is all human driving. I mean, uh, ADA
systems are not even allowed to break
this hard without AB. So, Open Pilot
doesn't do this sort of stuff. Uh this
is just humans reacting to weird stuff
on the road. Um and you can see all it
took is like 10 lines of code and you
can kind of scroll through the data like
this. This is another example. This
instead of looking for hard breaks is
looking for hard swerves. You can see a
a recurring theme is we've got uh people
on the highway merging into your lane um
and then the driver kind of avoiding
that aggressively. We've also got like a
deer here. If you look through this sort
of data, you find a lot of lot of
animals crossing the road.
Okay, so that's we've got the compute
covered, the data storage covered. Um,
that's kind of the real physical
hardware and what those machines do for
us. Um, now we talk about some of the
tooling that is basically used all the
time in the driving development that we
do. We call that arena. Uh, what arena
allows you to do is like any kind of
setup. You have an environment, you have
an agent, and you can run a rollout.
So that's really important because this
allows us to run driving policy in the
loop in a realistic environment and we
can kind of customize all that to either
do some kind of test to figure something
out or we also use this for training.
Um so here we have it running just the
normal open pilot policy the one that we
released um in Carla which is some kind
of classical simulator. We do all sorts
of sanity tests in check uh in um in
environments like this. we can just make
sure that you know it stays lane center
that sort of stuff. And here is again
actual code of what that looks like. We
have just some pretty verbose config. We
can config thousands of things about
these rollouts that are useful for
different things. Uh and then all you
have to do is set the config and then
you run it and then you get this. Um so
this is again tooling. This was probably
about a six months project to go from
kind of one-off scripts that did this
type of stuff to building a real tooling
infrastructure with usable config. Uh
that that's way way easier and way more
fun to use. That was I think end of two
years ago we started working on that.
Took probably about six months to get
this in a good state and it's been way
way easier to do this sort of stuff
since then. Uh so an example of how we
would use this. So that kind of
simulation architecture we can then
combine that with the uh distributed
compute that we have and we can kind of
run a whole bunch of rollouts all
simultaneously uh on the whole cluster.
And uh I'm going to show you the I'm
showing you the results here of
basically the changes that we made from
shipping the models we were shipping
last year to the ones that we're
shipping now that have much higher
engagement uh longitudinally. And this
this test makes clear why. So this test
uh puts a car on just an empty simulated
road here like this is kind of simulates
an infinite long highway and we just
kind of put the car at different speeds
and our expectation is is that open
pilot understands the scene in a certain
way thinks about it comes up with a good
speed to drive and slowly converges to
that speed. Now you can see the top plot
is what we were shipping last year
basically and you can see it just slows
down forever which is a terrible
experience and those of you who've used
experimental mode will know that's how
it used to work. If you're on a just
empty event super long highway it might
just kind of slow down and at some point
you're driving 45 miles an hour uh on a
straight long empty highway which is
obviously a terrible experience. And
then here you can see what the latest
models that we ship are. So it's not
really perfect. uh it doesn't really
converge to one speed, but you can at
least see that the model is not so
stupid that it wants to slow down to
very slow speeds on the highway. Uh at
worst, it wants to drive 55 miles an
hour. So, we need to improve this a bit
more. But here you can see this is the
kind of reports that we're looking at uh
when we're shipping changes and
hopefully making improvements.
So, that's so far I've described the
training uh not the training yet. I've
described some distributed compute for
tests, the uh the rollout infrastructure
and the data. Um, of course, we need to
train models that requires quite a bit
of infrastructure too. We recently
switched, I think it's been about a year
to managing this all with slurm.
Actually, before we used slurm, we would
literally SSH into a computer and run a
command. And if you were running it on
multiple machines, then I mean there
were so many ways to do it wrong. It was
extremely inconvenient. Uh, but now this
is done properly. It's managed by Slurm.
Uh, one recent feature that's probably
only a few months old is before we would
have different code repositories that
were accessible to the training machines
that we had to specify and also make
sure they were on the right stuff. Right
now, we just ship all the local code
that's on your workstation just gets
copy pasteed to some shared drive and
the training run happens on that. So,
you don't need to manage multiple repos.
Whatever is going on your workstation,
the trainer is going to use that. Um,
training is done with PyTorch. That's I
guess pretty standard. Multimachine we
just do with normal DDP all very
standard stuff and then one thing that
we've implemented this is a few years
old now but I think it's been really
helpful is I mentioned about making sure
that you can iterate fast making the
iterations fun this is really important
for development uh and one thing we did
is your training run just dies after 24
hours if it didn't make it in 24 hours
well sorry it took too long um of course
it's easy for someone to change the code
but it's slightly embarrassing so this
is just this has been enough incentive
to make people uh make the training runs
faster and and so far everything we
release basically runs under 24 hours.
Okay, so the other thing we need for
training is we've got these machines
that do training, they do training
steps, they update the weights. Uh but
the weights actually have to go
somewhere. So we have not just a data
driving data server, but we also have a
server that uh receives all the model
weights during training and also saves
them and then can host them.
So we call this reporter. So reporter is
is both an experiment tracker. Uh it
shows basically I mean it shows every
model we've ever trained since comm
started. This tool is incredibly old. Uh
it will show you all sorts of you know
training graphs on the loss and and all
the individual stuff. And then we also
have all sorts of different validation
reports attached so you can read through
um and get some kind of picture of how
the model's doing. This is partially
open sourced. We publish the reports and
all the models we merge in open pilot
but we're planning to make some
improvements to that.
Yeah. So reporter is the other critical
part of training outside of the slur
management. Uh it hosts all the weights.
Uh it hosts experiment information for
engineers to go through.
And then the last part we need for the
models we train is I've talked about
arena before how you can run rollouts uh
with different agents and environments
for testing and for debugging. Uh but we
use this for training too. Our final
policy models are trained on policy
which means they're trained by
generating data with the active policy
running and uh then sending that data
back to the training machine. And here
you can see these are kind of the two
configurations that we've used which we
describe in the CVAPR paper. This is a
classic reproive simulator. So it
initializes on real data and then the
driving policy can deviate uh from that
real data by warping the scene and
reproing stuff. Um, and then this
alternative here is one that uh
simulates the entire scene with the
generative diffusion model. And all the
difference it takes Oh, I switched these
here. But uh so the all it takes is
changing the config here from MLS sim to
uh to tiny sim. And if you guys want to
try it uh that that setup back there
with the steering wheel, you can
actually run the training rollouts and
see what the model sees during training.
Okay,
so let's take a 5-second break here and
let all these things come together. So
the most complex task that we do at
Comma uh training
or or developing anything with driving
is is running a full training job on
multiple machines where it's on policy.
So all of the data needs to come from
rollouts from rollout workers. Um and
then it's got to interact with all the
data server and the weight server. So
when we ship a model to open pilot, it's
trained with just something like this.
So it's just oneline command on our
workstation that you run um some basic
config uh that that you need to do. We
show the data set. So the most recent
models we trained were trained on uh um
on 500,000 segments, the final stage.
And so it starts at the workstation
and then you send this lurm command to
the trainer pods and they pick up the
job and they start. So this is all model
weights are synced with pietorch and
then when they do a step they send that
to reporter which hosts the model
weights and hosts all the experimental
data and then the rollout workers which
is what's necessary for the on policy
training. um they receive the jobs from
the trainer and they receive the weights
from the reporter and then they send
those results the training data back
which is what the trainers use to
iterate and then in the back there we
have the uh the data server that hosts
uh all of the driving data.
So I mean this is not super easy to wrap
your head around right now but this is a
really good overview of basically all of
the tools that we need to maintain uh to
have a good experience training models.
Some of this stuff is custom. Some of
the stuff's very different from what
other people are doing in the space.
Some of it's somewhat similar. Slurm's
relatively popular, for example. Um, I
think companies like Facebook have a
very similar setup to Mini Ray to
achieve the same thing.
Um but yeah this is how it all kind of
comes together and like I said it's
really fun to talk about you know what
the actual model decisions we make and
you seen gave a lot of information about
that but ultimately to really make
progress and really iterate on on the
experience with open pilot all of these
things need to be good first there's no
way to make good machine learning
improvements if you don't have really
good infrastructure around uh training
models and debugging and looking at data
and all that sort of stuff. So this is
kind of the full picture of what's going
on in the data center most of the time.
Yeah. So with that said, the last thing
I want to bring up is uh our next
hackathon. We had a pretty fun hackathon
uh with the comma bodies where we were
just doing some autonomous indoor
navigation u with the with the bodies.
You run your own software on it and the
best best people got a prize. I think
there's actually quite a few people from
that picture here. We had um
yeah, we had the two of the winning
members of the team I think are here.
One's working at comma right now. And uh
so hopefully if you're interested in
this sort of stuff, come to our next
hackathon. And it's not really clear
exactly what we're going to do yet, I
think, but we know the dates and uh
we'll post more information about uh
what the goal and what the prizes will
be at that link.
Right. Thank you. So, got any questions?
Now's the time.
Thank you, Harold. All right, we got one
question in the front.
>> Hi, Harold. Cool talk. Um, crystal ball.
When if ever do you see there being
enduser
triggering of like right when when FSD
currently disengages you can say you
know tell me why it disengaged and it'll
send it to Tesla and then they'll use it
as input I guess in theory to some sort
of training.
>> Uh yeah I mean I said the loop that's
happening right now at at our team is
you know if people tell us engineers
look into it and then that that is
somewhat of a loop but obviously it's
not autonomous loop. Um I would say
rough estimate within two years uh
disengagements are very actively
changing the policy uh that that's being
updated. Yeah.
Like that's something we're actively
experimenting with but haven't shipped
yet.
>> Questions.
>> Hey, great talk. I was actually curious
to know the evolution of your entire
infrastructure. Was it was it always
designed to be this way or very early on
you had an infrastructure which looked
very different from what it is right
now?
>> Um I think this design
is maybe five years old or so. Uh I
showcased some of the code uh to do
these things which I'm very proud of
which is why I added it. I think the
core infrastructure was there but the
things were implemented in a very
confusing hacky way and that stuff is
things that have been improving even
until recently where I for example gave
the example of the mini thing before to
run stuff distributed you had to do some
custom thing that was specific to us for
no particular reason um that now is
easier and it's kind of the same thing
with these training commands so yeah the
core infrastructure several years old
but the uh tools themselves being as
good to use as they are now is recent
>> got it and would
What what do you think was the
bottleneck very early on to get to this
level of maturity? like would you could
you not have I'm I'm asking this from a
very selfish reason like we are also
very early on in our uh autonomy stage
like we are a startup and we are just
wondering like is it worth it to spend
time figuring out this entire
infrastructure very early on when you
probably do not have a lot of compute or
a lot of data to work with or
>> um I think if you don't have an
immediate use for this type of
architecture it doesn't seem that useful
to But I have to say that again when I'm
talking about these hacks that we made
that seem stupid in retrospect, I don't
see why we ever made them. It feels like
if we just made better decisions early
on, we had to we would have less
iterations, but I think it always just
kind of looks like that in retrospect.
>> Um, you showed some results on Carla, so
I'm curious like what part Karta plays
in your um, autonomy stack. Like um, is
that purely for evaluating the rollouts?
uh do you if you use it for training do
like do you think it transfers well to
real world deployment on 3 and 3x?
>> So our entire training philosophy is to
train only on realistic data uh end to
end and the assumption is that sanity
checks in Carla because Carla does not
transfer at all if you train on it uh
can give a pretty good picture because
if you make good end toend decisions in
the rest of the training stack if you
just pinpoint certain things and look at
if that works you can make some
reasonable assumption that the other
stuff works too. So yes, Carla is not
used for training. It is only used for
essentially sanity checks. But the
sanity checks are very very useful.
>> Okay. Um in one of the slides you it
said that you were using PyTorch for the
training.
>> Yes.
>> Um and just now you mentioned about
distributed work and all that. Uh the
question is why are you not using Tiny?
So, Tenigrad is incredible at inference
on the Qualcomm chip. Uh, on Open Pilot,
it is easier to compile models and they
run twice as fast as they would if we
didn't use Tiny for training on Nvidia
chips. Uh, that's not true. So, they're
working on it. Hopefully, we'll get
there soon. I think the next step in
using Tiny would be to do inference in
our cluster. Uh, I think there's a few
more things that need to be fast for
training, but yeah, basically it's just
not fast enough right now on our
configuration of hardware.
>> Another question.
>> Hi, really great talk. Um, have you uh
given any thought to what it would take
to do ondevice learning or transfer
learning? So uh the device could update
its model.
>> So we do some level of ondevice
learning. Right now open pilot master
learns the lag of your steering
interface. It learns several things
about the car. It learns several
parameters of the vehicle controls. Uh
that is some type of ondevice learning
though it's not deep learning. I think
that will evolve to become more
complicated and more integrated with the
open pilot model and eventually there
will be ondevice learning. But I think
that's the state it's in now and it's
going to grow more complex and it has
been growing more complex over the
years.
>> All right, last question up front.
>> Thank you. Uh do you plan to do full uh
self-driving just using forward looking
cameras or are going to add more
cameras?
>> Right now we're really not interested in
unsupervised driving like we're just
iterating on a better supervised driving
product. I think the challenges are
exactly the same. So from an engineering
standpoint, I don't think this really
matters. If there's ever a point where
the disengagements are caused by a lack
of sensor field of view, uh, you know,
it's just a matter of making a different
sensor suite. But I think the hard
challenges are are the software um, not
not the sensors.
>> Thank you.
>> Thank you, Harold.
>> Thank you.
[Applause]
Good morning everyone and welcome to
Comic Con version 3. Um
[applause]
please uh feel free to get seated. We're
going to get started with the
presentations here in a second. You
know, KA's been around for basically 10
years now. Every year we have better
products, we make better software, we're
growing, we sell more and we have more
Comic-Cons and there's more of you every
time. This is Comic-Con version 3 and I
think you guys are really going to enjoy
the stuff we're going to talk about and
some of the cool new things that we're
going to be able to show. Um there's
some cool booths around that you guys
can explore uh in the in the free
moments. Uh to get started, we're going
to start with a presentation from the
Open Pilot team about Open Pilot
development and uh they're going to come
up right now. Shane and Maxim from the
Open Pilot team will start with their
presentation on solving simplicity for
Open Pilot development. Enjoy.
All right.
So today I want to talk to you about two
core principles that we use to develop
open pallet. The first one is testing or
requirements and the second one is
simplicity.
And then I will show you how those two
things actually go full circle at some
point which is very cool. So let's start
with the first one testing and
requirements. You need them and in order
yeah nice clicker. Um so we believe that
your test should be as quick as possible
in order to iterate as fast as possible
without fearing regression from the
past. And in order to do this, we did a
project called the one minute CI, which
as the name states, your whole CI must
complete in one minute, otherwise it
fails. And this is very important
because we consider that the time it
takes to test your code should be part
of the test itself. Your code should be
fast and quick to test.
And we use GitHub actions for most of
our CI on open pilot. And I took the
screenshot from our GitHub page this
morning. And as you can see, everything
runs in one minute. And this is all the
tests that we run every time you push a
single commit to open pilot. And we do a
bunch of stuff. We build a release, we
build a darts, uh we test the simulator,
we run unit tests, we run static
analysis. We do a bunch of stuff. And if
you want do if you want to do stuff like
this, if you want fast CI, which I'm
sure you want, if you don't think you
want it, start making your CI faster and
you will learn that you don't want to go
back to a garbage CI. So if you want to
do this, I have a few tips for you. The
first one is you should probably delete
or at least re-evaluate most of your
test because most of your tests were
probably written at a time where you
didn't even understood your software.
And now if you reread them, you probably
understand that most of them are
useless.
Uh the second thing you should do is you
should dream a little bit. As Harold
said, this is the comma 10th
anniversary. And about nine years ago,
there's a very famous commitment that
was made to open pilot. And if I can
click, nope, not this one. Yes, this
one. From nine years ago that says one
day we will have CI, one day we will
have testing. And these days we have
testing and we have very good testing.
But in the spirit of this commit about a
year ago I did I replied to an issue on
GitHub uh to if I can click thank you
that says one day open pallet will
install in 10 seconds you know and what
I mean by what open pallet will install
in 10 seconds I mean that you know
before you start testing your code you
have to install python all your packages
maybe val grind or something like that
and this is a recurring cost and you
want to shrink that recurring cost as
much as possible. So testing is very
fast and these days you can install Open
Pad in around 11 seconds, you know, so
off by one, but we're getting there. It
used to be in the minutes and this is
insane. Now it's very fast.
Um, another thing you should do is you
should chase every second because you
only have 60 seconds to test your code.
So every second matter and if you uh if
your CI takes 17 minutes to run, you
probably don't care about 10 seconds.
But I'm going to show you one very
specific example where we save 10
seconds with our unit test. We use piest
for to run our unit test because most of
our codebase is written in Python. And
this is how we run piest. We run piest
very simply. But just before that, we
also run piest with d-colct only. And
those two lines are 10 seconds faster to
run than only running piest because it
does a bunch of stuff because we use
multipprocessing to run our test. And
many people didn't believe me when I
pushed this commit. And they tried to
revert this line because they didn't
understood why it saves 10 seconds. And
every time they did this, they actually
had to revert with a realization like
this that it actually saves 10 seconds.
I don't know if you can see this, but
yeah, Shane made this commit about a
year ago. So very fun. Um, but having
quick and fast CI is not enough, right?
Because I could write something like
time. 5, it would run instantly, but it
will be garbage. It wouldn't catch
anything. So you actually want to be
able to, you know, trust your test. And
one way to do this is you should never
have flaky test. If a test fail, it
should always be because the code it's
testing is bad, not because the test
itself is bad. And in order to do this,
we did a very very simple thing that you
should actually do right now after this
talk in GitHub action and even Jenkins
that we use for our hardware in the loop
test. They have a feature where if a
test fails, you can just press a button
to replay it for some reason. And you
know if you have a flaky test, maybe you
have a test with a threshold, you know,
and sometime it goes a little bit over
or down the threshold and most people
just play the replay button and they go
on with their day and the flaky test
stays in CI forever and they never fix
it. We actually disable this feature and
on top is GitHub actions, the bottom is
Jenkins. It will yell at you, you know,
don't do this, fix the test, you know,
fix them instead. Uh this is very
powerful and this way you can eliminate
you know flaky test and this is very
nice otherwise the flaky test will just
hid in your codebase.
The second thing uh to gain trust in
your test and this is the most important
part because this is not enough. This is
good when you have flaky test but if you
want to actually gain trust in your test
uh most people will use stuff like line
coverage or if you're fancy like branch
coverage but those metric are not enough
right because I could again write time.
5 and run your whole code inside a try
catch block never fail. I would probably
get 100% line coverage, but I wouldn't
catch anything because line coverage
only checks how many lines you actually
run with your test.
But this idea of line coverage is very
nice because this is exactly what I
want. I want to make sure that all my
line are covered by my test, right? They
have they check if the the line won't
change. But more specifically, I want to
make sure that all the semantic the
logic of the line are covered. So what I
really want is something like semantic
line coverage right and this thing
exists and it's very nice and it's
called mutation testing and I will
explain to you what mutation testing is
very simple uh let's say that in five
years you know uh come up pivots to a
liquor store company or something so we
need a function called is adult but
don't worry we're still open source so
someone submits a PR or you know someone
submits a PR and since you are the
developer you add a feature you add a
unit test, right? And this code is
correct. It checks if you're an adult,
if you're above 18. But this test is
garbage. It clearly doesn't understand
this line. It knows that something
around 18 happened. So it checks above
and below, but it doesn't understand
this line. But we merge it. We merge it.
And five months later, I do a refactor
and I push this commit where I change
the this sign to this sign. And I merged
this because I see a big old green check
mark. That's my test and I trust it and
it was very fast so I trust it. But now
I just changed the meaning of this code.
It doesn't mean anymore if you're an
adult above 18. Like just 18 and that's
it. You're an adult at 18 and that's it.
Uh this whole thing this whole
experience of testing your test is what
mutation testing does for you on every
commit. It will take all your lines
right all your line. It will try to
mutate them. So it will take the
operators, flip them, make them bitwise,
take all the numbers, make them big,
small, non null, whatever. And then it
will run all your unit tests, right? Pi
test, unit test, whatever you have. And
if your tests don't fail after those
mutation, this whole thing will fail and
it will say, hey, I changed this line
and your test didn't pick up on this,
you know, so either this line is like
dead code, remove it or your test don't
understand this line. And you could push
stuff like this. So this is very nice
because this gives you trust in the
things that should give you trust in
your code because how do you gain trust
in your test? You can do it with stuff
like this. And we did this for uh the
panda safety that's now lives in Open
DBC and mutation testing is not perfect
because when you think about it, what if
the mutation you did is like
computationally equivalent to the
previous thing. Well, if you have the
answer to this, you just won a million
dollars and you know a touring award. uh
but it works for our purpose and it's
very nice. Okay.
So now you have great tests because they
are quick and uh you can trust them.
That's nice. Let's talk about
simplicity.
I'm going to take one example very
simple that we did very recently
actually and that you probably use every
day. It's the open pilot UI. We rewrote
the entire open pilot UI from scratch.
We went from an a UI written in QT with
C++ to a UI written in ray in Python.
Ray is a simple thin wrapper around
OpenGL
and you know Shane will talk to you more
about Rail in itself. I want to talk to
you more about you know the the graphics
tag that we used to use and our new
graphics that that we use now.
So, oh well it's corrupt I guess but it
says open pi UI and um as I said open p
UI was written in QT right and since we
are on Linux we need a windowing system
so we use way but the problem with way
is that it's more of a standard protocol
so we need an implementation and we use
weston
but again in the real world doesn't
really know how to speak to QT so we use
something called WL shell to communicate
remember that name it will come up
And we need the rendering client, right?
So we use OpenGL ES2. And OpenGL doesn't
really know how to speak to your system.
So we use something called EGL. And I
know the order is not, you know, exactly
right. This is just so it's nice and
flow down. Um, but at some point we need
a buffer, right, to render frame into
buffers. So we use lib GBM to get
buffers. And to actually drive the
screen, we use something called the lib
DRM. Yeah.
And since we are on a Qualcomm chip, we
use the MSM back end and the MDP5. You
know, this goes on. I could go all day.
I could do the full slide. I wouldn't be
done with the graphics stack, right?
This stack is pretty insane. And I call
it the three letters acronym stack
because everywhere you look, there's
more threeletters library that just pops
up, you know, uh GBM, generic buffer
management, DRM, a direct rendering
management, you know, MDP5, mobile
display processor 5, you know, it goes
on. And by the way, EGL, it doesn't mean
anything. If you go on the Kronos
website, which are the guy that are
developing the standard, they will tell
you EGL stands for tot but tata is not
EGL. So who who knows what it means,
right? Yeah. Yeah. So this used to be
our stack. And when we first tried to
move to Rayb, I went on their GitHub
page because they have a very nice
GitHub and I look at the requirement
section, right? What do we need to
switch to Ray? And they said we support
Linux. Great. And we even support whan
and I was like I have whan can I have
rel
you can't okay because again remember
you have whan western wl shell and of
course it broke at the w shell because
nobody knows about this weird 2000 that
thing that was deprecated in 2015 you
know that nobody used so it it was
broken but this whole experience gave us
the opportunity to actually learn about
graphics stack and move to sometimes
simpler and I will show you our new
stack that we call the magic stack.
stack we tried to choose a very simple
word you know not an acronym it's very
simple just magic and it's much simpler
and this is our new stack it basically
replace QT with ray and whand with magic
which is a special piece of code that we
wrote and when I say this is simpler I'm
not saying like the idea is simpler no
like way so western is more than 250,000
line of code right magic is 200 lines of
C and 60 lines of Python
which is a thousand times smaller and
I'm sure most people would say that
sometime a thousand times smaller is
kind of a thousand times simpler right
so this is much simpler stack
and I know some people will look at this
right and say stuff like well why did
you change it was working what's the
point you just chase simplicity for the
chase for the the sake of simplicity
right but the expression is like don't
kill your horse if it's still alive or
whatever it is u but we change for
reason like this okay This is the model
execution time. So the actual time it
takes for the model to run on your GPU
on your device. And as you can see this
is our new stack and this is on green.
It's the old stack. And the further on
the left the better. It means it run
faster because the UI and the driving
model has to fight for the resource of
the GPU. So you want uh the model to
have all the time so it doesn't conflict
with OpenGL you know shaders or
whatever.
And we did this. And when I first
plotted this, I was expecting the
inverse. I was trying to see how bad of
a job I did with this rewrite. But turns
out if you choose simplicity, you get
stuff like this. And I love this plot so
much because it's such a representation
of what comma is. You know, Ray is
written in Python by one guy in Spain,
right?
QT is like a 900 people company. You
know, you cannot get clone get QT. If
you go on the subre of Q, it's all
people bitching about like licensing
fee, etc. So, it's very complicated. And
did you know that Python is 500 times
slower than C++? You know, I didn't know
that either. But, you know, turns out if
you choose simplicity, you win.
And this is the part of this talk where
it's super cool because it will go full
circle. With this new simplicity, we can
actually get new requirements, new test.
And I will finish on this. There's two
new requirements we want to do with this
new simplicity. The first one is we want
to move the UI off from the GPU. We want
to do software rendering. So the driving
model has all the time for you know do
its stuff drive for you guys. So this
plot will look even better. And to do
this like you you kind of want to use
like the an software rendering
implementation. So if you want to use
the the Messa LVM pipe thingy to do that
well you need to change what you use.
And with the old stack it's pretty hard
because who even knows where the OpenGL
context just created you know. So now we
can do stuff like this and we will do
this very very soon for you. The second
thing we want to do we want to add a
streak mode to the UI where if you start
the UI with streak equals one and the UI
drops a single frame the UI get killed
instantly. And this is very nice because
it would lead to a perfect UI which
never lags essentially. And to do this
in the old stack again, you know what
does it even mean to drop a frame? Where
does it drop a frame? You know, is it is
it in lib GBM? Is it in in ray lib? Is
it in western sporter? It's always in
western. That's why I put a big bart
around western so all the western stuff
stays in there. Never open that box,
please. Uh but yeah, now we can do stuff
like this. We can know when you drop a
frame because every time we render, we
get the vblank ID of the screen itself.
And if the you know the vblank the diff
is not one when you render you
technically drop a frame because you
missed the opportunity to render a
frame. The screen was ready but you were
not. And now I will leave Shane to go on
stage and talk to you more about simple
stuff again.
All right, please welcome to the stage
Mitchell. Mitchell is on our
infrastructure team and is going to tell
you a lot more about our infrastructure
and uh data sets.
All right.
Hi everyone. I'm Mitchell. I'm an ML
engineer at KMA and I'm going to talk
today about what it takes to build a
data set with a million miles of
driving.
So
the first question we should ask is why
do we care about this? Like what's so
important about the data sets?
Well,
you know,
a uh autonomy at comma, our team is in
the business of shipping neural nets
that drive your car. And a very wise man
once said that a neural net is nothing
but a compressed version of your data
set. In fact, I think we can be even a
bit more explicit than that. The neural
net is the data set. Uh and if your data
set's good, your neural net will also be
good. And so, uh you know, minus the
bugs in the training stack that make it
worse. Uh so if we want to train uh the
best driving models that we can, we need
a good data set. So the second question
we should ask is why do we need a
million miles? Like why a million? Why
not a thousand? Uh and the answer to
that is that KMA's data center has grown
over time from you know 2017 we had a
little pile of servers. This is the
oldest picture I could find on our
Slack. uh to 2019 where our servers were
in a garage up to now where we now have
15 racks of machines about 200 servers I
believe uh with something like uh a
quarter of an exoflop. Uh so we're
getting up there. Uh we're still a few
orders of magnitude off the you know the
hyperscalers. Um but our our compute has
grown substantially over time and that
sort of presents us with a choice. Uh we
could train bigger models with all this
extra compute. We could train on more
data for longer uh or we could do a bit
of both. So how should we spend our
compute to get the best results?
Well, a lot of people have studied this
question over the last 5 years or so,
especially in the domain of language
modeling, but also more recently for
diffusion models. And uh what's been
found by and large is that you want to
do a bit of both. You want to train uh
bigger models with bigger data sets.
So you want to scale up both of them
together. And you can kind of see this
uh this is an old uh chart from an old
OpenAI paper. Uh every color line is a
different size of model uh data set size
on the x-axis. You can see over on on
the left side our data sets are small.
And the the big models and the small
models, they get about the same
performance. The big models just aren't
that much better. And then as we scale
the data sets, as we go over to the
right side of the chart where the data
sets are really big, uh the big models
keep getting better and better and
better and the small models kind of
plateau off. Uh so big models can take
advantage of all this extra data and
they can improve substantially. Uh but
if we want to train bigger models and
get that performance, we need big data
sets. So that's what we're going to talk
about.
So the first step to getting a big data
set is we have to collect some data.
Harold talked a little bit about this.
Um we're very fortunate that we have a
lot of people out there driving with
Open Pilot. Uh so we currently see just
shy of uh 7,000 daily active users. Uh
and we get uh I think this is wrong. I
think it's about a thousand daily hours
of driving uploaded. Um
now of course you know not everyone who
uh is is driving with Open Pilot is
uploading that data. Some people opt
out. Uh, some people just never really
connect to Wi-Fi and other people are
driving on forks that aren't usable for
training. Um, but despite all that, of
the roughly 30,000 devices that comma
has shipped in its lifetime, we have
data from about 20,000 of those devices.
Uh, so the the majority of our users are
uploading at least some data. Um, we uh
we currently get uh yeah, that's this
should be right. So about a thousand a
thousand hours of data per day out of
the 10,000 hours uh that people are are
driving with open pilot. So we get a lot
of data.
Um we can see you know not all users are
uploading the same amount. Uh the
distribution sort of follows a power
law. So some people are uploading a lot
more than others but that's okay.
If we look at a breakdown of our data,
we can see uh vehicle-wise, we got a
pretty good diversity across a couple
hundred different platforms, 35 brands.
Um geographically, we're not doing quite
as well. We can see we have data from
about 70 70 to 75 countries, uh
depending on how you count. Um but the
overwhelming majority of it is still
from the US. So we've got about 86% of
our data is still from the US. Uh
hopefully that'll become a bit more
balanced over time as we continue to
sell more devices internationally.
So what data are we collecting exactly?
Uh if you've worked with Open Pilot, you
probably know a bunch of this. Uh when
you're driving with Open Pilot, it's
recording data in one minute chunks. We
call these segments. And a segment has
uh a couple files attached to it. Uh we
have three video files because there's
three cameras on the device. So we have
the video streams for each of those. We
have a log file that contains all the
messages uh being passed around uh
inside of Open Pilot as it runs. And
this tells us everything we need to know
about the state of the vehicle, the
device, the control stack, everything.
Uh and then we have a quantized log file
that's about 20x smaller. So it might be
just a couple hundred kilobytes. Uh and
this contains just the very most
important messages uh that tell us for
example uh whether data might be useful
for training. So
we record this data and then we have to
upload it. So when Open Pilot connects
to Wi-Fi, like when you pull into your
garage and park up, uh Open Pilot starts
uploading Q logs to Azure. Uh so we
receive these uploads, we spin through
them, and we look for segments that we
think might be useful for training. Uh
we mark these segments and we request
the device to upload them. Uh so we're
going to ask it to to uh send the full
segment along with all the video files
and the full log file.
Uh so Athena D inside of OpenPilot
receives these requests
and uh starts uploading the full segment
to our data center and then our data
center receives that data and copies it
all into our distributed mini value
storage system where it's going to live
for the long term.
So
at this point we have a bunch of data.
We've uploaded all of this raw data uh
from our users and now we have to make a
data set out of it. So uh we we have to
do a couple things at this point. We
need to decide uh how many segments are
going to be in our data set, which
segments we're going to use, and uh how
we should split it into training
validation sets. So we'll go through
each of these real quick. Uh the first
question, you know, how many segments
should we use? And you might ask, well,
we have all this data. Why not just
train on all of it? Like what's the
point of of not training on everything?
And uh the the answer is you know we
train models of several different sizes
at comma. Uh we have the biggest models
like the world models that were very
interested in scaling to to uh large
sizes. Uh and then we have some other
models that are much smaller. And you
saw from that chart earlier that
generally the small models can't benefit
as much from uh these large data sets.
So you're just training on more data for
longer and making your experiments all
take longer for no real discernable
benefit. So what we would really like is
uh to have data sets of multiple
different sizes. We might have a data
set that's like 10,000 hours, one that's
50,000 hours, 100,000 hours, etc. So
we'll have data set sizes spanning like
a solid order of magnitude or so uh that
we can use for different model sizes and
architectures.
So then if we're not going to use all of
the segments, then how do we pick which
ones to use?
Well, there's a couple different ways
that we could do this. The simplest is
just you know pick a random subsample.
Uh but we can do a little better than
that.
So uh you can see in this red shaded
area here remember this is the the
distribution of how many segments we
have uh for all of our devices. So some
devices have way more data than others
and that tends to have a lot of
duplication. So people drive the same
roads over and over again uh because
they're commuting to and from work for
example. Uh and so this red shaded area
here uh with uh from from users with the
most data uh that may contain a lot of
drives that are less useful um or or
more redundant uh and so maybe we just
want to shade from or or draw from the
blue shaded area underneath
uh which contains the vast majority of
the data anyways and this gives us a
little bit more of a uniform
distribution across devices.
Maybe we want to uh undersample US data
like we saw earlier. The vast majority
of our data is still from the US. And if
we're only going to pick a subset, maybe
we want to bias it a little bit more
towards international data. Uh just so
we're getting a a bit more balanced of a
distribution uh geographically.
Maybe we want to filter out engaged
data. uh like for some types of models
like the final driving model, we don't
really want to train the driving model
to imitate the behavior of previous open
pilot versions. It sort of introduces a
feedback loop. So that's not great. So
at this point we may want to remove the
engage data from some of our data sets.
And then
uh at this point we may also want to run
experiments with different types of
distributions. So we may want to shift
it towards for example more highway
data, less highway data, uh more curves,
more uh situations that the model really
struggles with. Um this is the point at
which we can uh shift the distribution a
little bit in any way that we want to.
So okay, now we've we've decided what's
going to be in our data set. uh we make
some choices for all these all these
questions and uh now we have to decide
how we're going to split between the
train and validation sets. So the
training set is everything that the
model's going to see during training and
the validation set is what we're going
to evaluate on to decide if the model is
overfitting or if it's not learning
properly. Um so normally what you would
do is take like 10% of your data as your
validation set. But there's a couple
different ways that you can do this. Um
the standard way in like an image data
set would be you know you just take 10%
of your samples that's your val set. Um
but in our case you know well maybe we
could think about just taking 10% of the
frames out of the videos marking those
as the val set but this is not really
ideal. These frames are way too
correlated. You can kind of see here on
the left is the first frame from a
segment and on the right is uh a frame 1
second later. It's a little hard to see
with the contrast, but they look almost
exactly the same. Like there's basically
no difference between these frames. Uh
and so if one of them is in your train
set and one of them is in your
validation set, you're you're just
training on test. Uh so this is no good.
This is leaking information into our
test set and that's going to make our
models harder to evaluate. So we don't
want to do this. These frames are too
correlated in time. So another thing
that we could think about doing is uh
splitting by segments. we take some
entire segments and pulling those out
and marking those as the val set. Uh and
that's is this is definitely better. Uh
this is you know more like what you
might see as standard practice for like
time series data sets um where you pull
out big chunks of time and mark those as
part of your val set. Uh but this still
isn't as good as we would like because
you can see for example here uh this is
a road uh that was driven by the same
driver several months apart. And you can
see again they're basically identical uh
where you know the driver goes under
this overpass and then makes a left-hand
turn. And so if one of these is in our
train set and the other is in our
validation set, well, the model's
learning some things about what the
driver is going to do uh by uh by
looking at this data that's that's
duplicated uh in our test set. And
again, this is not what we want. So what
we'll do instead is we'll split by
device. We'll have some users be in the
train set and other users be in the
validation set. And this way we can
ensure as much as possible that we're
not getting any kind of duplication and
that we're uh really splitting our data
into clean uh train and val sets that
have as little overlap as possible.
So
uh specifically we we take about 6% of
devices plus all of the employee devices
we put those in the valet put everything
else in the train set. Employee devices
are in the valet because we want our
experience when we're driving around San
Diego to be reflective of what someone
might experience with Open Pilot when
they pull it out of the box and use it
for the first time. So we don't want to,
you know, the the model to know all
about our commutes. That really wouldn't
be fair.
So okay, now we've decided what's going
to be in our data set and how to do our
train and val splits. And now we need to
get the data ready for training. We need
to process it a little bit. So uh what
what kind of processing is involved here
exactly? What do we need to do to get
the the data ready for training?
Well, the primary thing that we need to
do is run our localizer. So localization
in robotics uh refers to uh essentially
figuring out where you are and which way
you're pointing at every moment in time.
So in our case uh what we're going to do
is uh take a segment and we're going to
run a calman filter that takes in uh the
GNSS accelerometer gyro and some visual
odometry from the camera streams and
stitches this all together uh into a
trajectory that that uh uh recovers the
the position and orientation of the
device on every frame of the video. And
you can kind of see this visualized
here. Uh again, a little hard to see
because of the contrast, but there's a
blue path uh that uh shows exactly where
the vehicle is going to drive. Uh so
this is the output of the localizer. And
uh this this particular output is super
critical. It's mission critical for us.
Uh it's required for all of the models
that we train, for the world models, for
the driving models, for everything. Um
and so we need to run it on all of our
data.
uh this includes the very biggest data
sets because the world model in
particular is the model that we're most
interested in scaling and we want to use
the largest data sets for. So up to the
very biggest data set sizes we need to
run the localizer.
Uh then we also have some auxiliary
outputs I guess you could say. Uh these
are things like lane lines uh the lead
car that's just the car in front of you.
U detecting any lane changes or turns
that might happen during a segment. Uh,
and these are things that tend to be a
little bit less mission critical. Um,
lane lines, for example,
um, are only used for display purposes.
We don't use them for any kind of
control. Uh, they're just nice to show
on the screen. Uh, lead car, we, uh, we
currently use that in chill mode. Uh,
but as experimental mode gets better,
that's also likely to become a bit less
important. And lane changes, same deal.
uh as uh you know as we move to the
future and potentially uh start doing
more work with navigation uh lane
changes may also become a bit less
important. Uh so these outputs are only
used by the final driving model. The
world model does not use any of these.
It doesn't know about lane changes or or
lead cars or lane lines or any of that.
Uh and the the final driving model uh is
generally trained on a smaller data set
because that model is smaller uh for a
couple reasons. uh we need to run it on
device but also there's a lot of factors
that govern the scaling for that model
uh beyond just making it bigger. Uh and
so making the model bigger is not uh
generally the way that we find is
easiest to improve that model. So uh
because of this the auxiliary outputs uh
we you know we run them on less data and
they they are a bit less important for
us uh in autonomy. And so I'm going to I
I won't focus quite as much on these
outputs for the rest of the talk.
Uh so now we uh we have our data set
ready to go. It's all processed and we
have to actually serve it to the
trainers. So what does that look like
then? Well, so we've got all this data
stored in uh in mini value. We actually
have a couple of mini value instances.
Uh you can kind of see the computers
involved over on the right side here.
We've got mini value raw in red. This is
the the cluster that stores all of the
raw data. That's the videos and the
logs. And then we have the processed
data stored in minik value SSD which is
called that for historical reasons. Um
that's over on the left side and uh
that's about 300 terabytes. So mini
value raw is about three pabytes. A mini
value SSD is about a tenth of that and
about half the bandwidth. So
when we need to serve the data this
would be like you know a pietorch data
set class that you're writing. uh we
need to load the data out from mini key
value. Uh for the process outputs, these
are basically just stored as uh as numpy
like mpy or mpz files. Uh so either like
a compressed zip or uh or just uh dumped
as a as raw numpy as raw bytes. Um then
uh the logs if we need those we can spin
through those just using the log reader
from open pilot the same tools that are
publicly available. And then we got the
videos which we need to decode. So,
we've sort of been talking around this
up till this point. Uh, but the videos
are are H.265 files. They're HVC and uh
we need to extract frames from these
videos in order to train on them. So, uh
we can't uh we can't do this in advance.
The when we decode the video, we're
decompressing the frames about 100x. So,
on disk, the uh the video file might be
something like 70 80 megabytes. Uh but
when we decompress it, it's going to be
like 8 gigabytes. So, we can't do this
ahead of time. we need to do it on the
fly. Uh we just don't have enough
storage space. So, uh we we need to
decompress. We need it to be fast or
it'll be the bottleneck for all of this
stuff. Uh and we need to do it for a
bunch of different things. We need to do
it every time we train. And we also
require the video frames for a bunch of
the processing stages that we'll talk
about in a sec. So, how are we gonna
decode these frames then? Well, when I
joined KMA back in 2020, uh we were
using good old FFmpeg on CPU, uh and on
a machine with like 24 cores, uh we were
getting something like 400 frames a
second of decode, which is pretty good.
Uh you're running lots of these in
parallel and uh that was enough
performance for the time. Uh but as our
models uh get faster, we get more
trainers and we we need more decode. Uh
that's that was no longer enough. So now
we would like to move the decode off the
CPU onto the GPU. Around 2022, we
started getting computers in our data
center with uh GPUs in them. And GPUs
have dedicated decode hardware that can
decode at like a,000 to 2,000 frames per
second on like a normal, you know,
consumer GPU. And uh so we uh we would
like to do this. The problem at the time
was that we just didn't have enough
memory to both run the models and do the
decode on the GPU at the same time. Uh
so we we got these really uh tiny little
uh like consumer GPUs. These are like I
think these are like $100 a piece at the
time, maybe less. Um and they have
almost the same decode performance as
the uh the larger GPUs that we train the
models on. Uh so we just stuck a bunch
of these in all our machines and used
these for decode and that got us like
again 2500ish
FPS per machine. But uh the problem with
these little GPUs is like they take up a
whole PCIe slot and eventually you just
want all of your uh your slots in the
machine to be for GPUs that are actually
running the model because that's kind of
the primary workload. So uh eventually
we want to kind of stop using these and
uh just run the decode right on the GPU
next to the model. So thanks to some
slightly better memory management, uh we
can just run everything on the same GPU
and now on a server with eight GPUs in
it, we might get decode on the order of
like 15,000 frames per second. So that's
not too bad. We've we've improved quite
a bit. Um so all right, that's that
that's pretty much everything that goes
into creating a data set. And with the
the rest of the time that I have, I want
to talk a bit about a case study of uh
how our infrastructure has changed over
time and how it's improved. I remember
when I first joined KMA, as kind of a
joke, I stuck a sign on the door of the
research team that said Department of
Magic. Uh and I thought that was pretty
funny at the time, but uh uh really the
research team is not the department of
magic. It's the department of tools and
infrastructure. And everything we do uh
is really focused on writing better
tools and infrastructure because as a
team of like seven people uh on the uh
on autonomy like the only way that we
can continue to improve these models and
ship uh a better driving experience to
all of you is to make the tools and
infrastructure better and keep them
simple. So,
uh, this is going to be a, uh, a bit of
a case study of of what that looks like
in practice and how our our stack has
evolved over time. Uh, so
I talked a bit about the localizer that
we need to run. Uh, this computes the
vehicle trajectory across a segment. And
again, we use this for everything. Uh,
but we, uh, we need to run a couple of
things first before we can run the
localizer. So this is what our localizer
pipeline looked like when I joined in
2020.
Uh specifically
uh the things that are most important
are that we need to run uh orb features
and we need to run a segment. So what
are those? Why do we need them? Uh well
again the localizer is this calman
filter. We're taking in GPS uh gyro
accelerometer but those sensors on their
own are not enough to give us the kind
of accuracy we need for the vehicle
trajectory. We also need information
from the camera stream. So one uh one
easy way to get information from the
camera stream is to use uh something
like orbs. Orbs are a classical CV
technique where you find key points in a
frame. Those are things like corners or
edges or or uh points that are that are
easy to to recognize and you track how
those key points move between one frame
and the next. And this kind of tells you
how the camera is moving with respect to
the scene.
So, uh, we can do this, and you you can,
uh, see this in this middle picture
here. We're generating all of these
these red tracks that show, uh, how the
the key points are are moving as we're
moving through the scene. Uh, but the
problem here is that we want to know
again how we're moving with respect to
the static background. Uh, and there's
also all these other moving objects in
this scene like cars that are passing
us. We got a car in front of us. And uh
there will be key points on uh on these
moving objects and uh those key points
really really mess up our estimation. So
we want to get rid of those. We want to
filter those out and uh the easiest way
to do that is with a segment. We have a
semantic segmentation model that we
trained using the combo comma pencil
data set. Uh and
uh this this tells us like which pixels
are part of our car, which ones are part
of the road and which ones are part of
other cars etc. So we can use this uh to
figure out which pixels are are part of
moving objects on the road and remove
any tracks uh that get matched to those
objects.
So all of that is kind of a lot. Um
so we can see uh kind of all of what's
involved there. This was the state of
the localizer stack in 2020. And then in
2021 we launched the comma 3 which now
has two forward facing cameras instead
of one. uh and so that means that we
need to run the orb features and the
segment on two video streams instead of
one and that means everything is twice
as slow. So in 2021
uh it's again a little hard to see uh
but it took 85 minutes to run one minute
of driving data through the pipeline.
Now that's pretty horrible. uh like if
we uh if we do the math on that to
figure out like how long it's going to
take us uh we had about 1,500 compute
cores at the time that numbers for a
single compute core but even so uh to
run a million segments through the
localizer would take 40 days. Uh now not
only is that completely out of the
question but it also means we can't run
any more than a million segments. Like
if we wanted to run 5 million segments
that would take months so this isn't
going to work. We need to speed this up.
So
what can we do? Well, the first thing we
uh we need to deal with is the segnet.
The segment on its own is taking 60
minutes. Uh and a large part of that is
because it's it's running it was running
on CPU at the time like just just uh
using Onyx runtime. Uh and so like I
said around 2022, we started getting uh
servers in our data center that had GPUs
in them. And so first order of business
was uh we need to run the segment on the
GPU.
So, uh, step one was just move the
decode over. We already talked about
that. Uh, then we want to run the
segment on the GPU as well. Onyx runtime
has a GPU backend for Nvidia cards that
works great. Um, but then we were
running in a in a fairly memory
constrained environment at the time. And
so, uh, we could only have a couple of
model runners active at any given point.
Uh, so that still wasn't great. So then
we switched to uh to Triton inference
server where we can batch up a whole
bunch of requests, send them to a server
that's got a couple model runners in it
and get the requests back and write them
out to disk. Uh and this way we can uh
we can have a lot more going on in
parallel and we get better performance.
And then uh lastly, we can quantize the
F16. This one's a no-brainer. Like we uh
we were running in in float 32 by using
half precision uh we can almost double
our our inference speed. So with all of
that considered, we can go from about 60
minutes down to 4 minutes for the
segment. So that's a huge improvement
already.
And uh with that change, we're now down
to 29 minutes to process one minute of
driving data, which again, that's a lot
better, but it's still not good enough.
Uh we uh we still need to improve
things. So next up is the orb features.
Uh the orb features are taking 17
minutes now. Uh so that's now about half
of the total time to process a segment.
So we need to we need to deal with the
orb features somehow.
So uh the orb features have a few
problems beyond just the fact that
they're slow. They're running on CPU. Uh
we can see from the video here that
there's a lot of uh of incorrect
matches. So this is cases where like a
key point in one part of the image is
incorrectly being matched to a key point
somewhere else entirely. And this gives
us all these outliers, all this garbage
that we need to filter out somehow. Uh
so partly because of that uh we need to
generate a lot of tracks. We uh uh so
this this image right here I think we we
have maybe like like 600 uh tracks per
frame. Um and then they're tracked over
multiple frames. So you' be like several
thousand tracks at any point in time. Uh
and partly because of that the uh the
localizer
uh is way slower than it it would be
otherwise because now this you know this
calman filter has a few thousand
additional inputs and that just slows
everything way down. So not only is the
local is the uh the orb features uh like
really slow but it's also making
everything else slow. And not only that,
uh, but the, uh, the segnet is only used
in the localizer stack to, uh, to filter
out moving objects. So what this means
is if we could somehow delete the orb
features, we would get rid of the
segment, we'd get rid of the orbs, which
is the slowest stage right now, and the
localizer would be way faster.
And now the problem is we uh we can't
delete the orb features. We need some
kind of visual odometry because
otherwise the localizer just won't be
accurate enough. But what if we could
replace the orb features with like an
open- source visual odometry model? Over
the last five years, there's been a
bunch of really good ones. Uh models
like Laughter, Flowformer, Tapier, uh
just to name a few. There's been a ton.
And these these models look great on
paper. Like the demo videos are super
compelling. Uh you can see the points
being tracked over time. The problem is
uh when we take these models and we run
them on our data uh it's it's not very
easy to see with these lighting
conditions but uh lofter is like
completely garbage uh in these low light
conditions. Flow former is like slightly
better but when you look at the the
tracks that are being output they're
still basically unusable. Um and the the
problem is these models uh just struggle
in a lot of real world conditions that
we see in our data set. And you can kind
of understand why when you look at the
data sets that these models are trained
on. um like the largest data sets for
these models are like all synthetic. Uh
they're all generated with like a uh
traditional graphics engine uh like
Unity or Unreal or something like that.
Uh Kubric is a is one such data set
that's quite large from Google. Uh my
personal favorite is flying chairs. I
don't know if you can see it from there,
but you can probably guess from the name
what's in it. Um so those aren't great.
And then even the data sets that are
based on uh real data like scanet and
kitty kitty is actually driving data. So
that should be perfect but it's all
during the daytime. Um and it's also a
fairly small data set. Uh like I believe
it just contains like a a a few dozen
hours of driving max. Um might be even
smaller than that. It's been a while
since I looked at it. Um so these data
sets are just not enough. Um, and these
models because of that, uh, really
struggle in situations where we need
them to work well. So, if we're going to
make this work, we're going to need to
train our own model. And, uh, you know,
that sounds great, but where are we
going to get the data? Like, we just
looked at these data sets. Uh, and if we
just train a model on those data sets,
uh, we're going to run into the same
problem as all these other models. So,
we need a data set somehow. Where are we
going to get it from?
Well, the idea that we had was what if
we just train it to predict the orb
features? Like the orb features have all
these problems. Uh but most of these
problems are actually fixed if you just
have a model predicting the orb features
instead of using the raw ones. And
you'll see what I mean here. Um
so basically the setup that we want to
do is uh we'll input like a pair of
images uh that are uh just two adjacent
frames from the video and we'll ask the
model we're just showing a little patch
of the image here where we're going to
ask the model to predict whether or not
there's a key point on each pixel and
then if there is a key point we'll ask
we'll ask it to predict how that key
point moved between the two images. So
we're asking it how this uh how this
point in the image moved to the next
frame.
Uh and then using a loss function like
gausian NL or lelassian NL or something
like that we can also recover an
uncertainty. So the model can tell us
directly how confident it is about its
motion prediction. And that's great
because the uh the localizer takes uh uh
it takes uh uncertainties for uh each of
its inputs. And so we can feed those
confidence uh uh outputs directly into
the the localizer and uh improve the
localizer pretty substantially this way.
So,
putting it all together, this is our
neural orbs model. And we can see that
uh right away there's way fewer of these
garbage features. Uh there's fewer
features overall because we just take
the very highest confidence ones. Uh so
that means uh we're putting fewer of
these features into the localizer.
Um and the model runs about 4x faster
than the old orb feature stage. So we've
improved this a bunch. Uh we get rid of
the segnet. we'll we'll use the segnet
to train this model and remove all the
the orb features on moving objects. But
then once we have that, we can throw
away the segnet and we no longer need it
for the localizer stack. And best of
all, this change makes the localizer
about 5x faster, which is crazy. Like
this uh this improves the entire
pipeline just from this one change. So
we can see this was the state of the
localizer stack in 2024. We got rid of
uh all these these uh parts that were
here before. The localizer is down to a
minute and 20 seconds. Neural takes like
three minutes and 20 seconds. And the
total time is down to just over five
minutes. Uh we can clean things up a
little bit further even. Um we have this
log processing stage uh which was uh
just reading in the logs and writing out
a bunch of intermediate outputs to disk.
That's kind of silly. We can just spin
through the logs as we need them. So
we'll get rid of that. We've got frame
index and frame times, which is just
reading some metadata from the video
streams. um we can combine those into a
single stage that just does all of the
uh all of the metadata that we need from
the video and and saves that. So,
putting all of that together, this is
where we're at in 2025. We have uh one
stage to get the frame metadata, one to
get the visual odometry, and one to run
the localizer. And the whole thing is
done in four minutes and 50 seconds. So,
that's a big improvement.
>> [applause]
>> We're we're booking right along. Uh and
the total data center throughput across
all of our servers now is just shy of
2,000 segments per minute. So what that
means is we can now process about a
million segments in 8 and a half hours
which is great. Remember we were at 40
days before to do a million segments.
We're down to 8 and a half hours now. Uh
which I think is like 110x improvement.
So about 17x comes from all of the
changes that we just discussed and then
the remaining 6x comes from just getting
more servers over time uh and and
growing our data center.
But of course we're still not done. Uh
we can still make this faster and we can
have even bigger data sets. Uh so
there's at least another easy 2x speed
up on the table. Uh we can do the
decoding inside the Triton server. uh
because at this point creating and
destroying the the decoder objects
actually takes a pretty significant
amount of time. Uh so just by keeping
the decoders around for longer we can
make it faster. Uh we can use a faster
runtime like onyx runtime GPU is not as
fast uh as it could be. Uh torch compile
is like almost 2x faster if memory
serves. Uh we can quantize to inate
that's another uh free speed up as long
as we don't lose lose any accuracy. Uh
and then finally uh we could potentially
combine the neural orbs and localizer
stages uh into one since the localizer
is the only thing in our stack that
really requires these uh these visual
odometry outputs. So we could save
writing them out to disk and reading
them back in and that saves probably
another 10%.
So if all of that sounds interesting to
you, uh I'm I'm repeating uh what's been
said earlier, but comma is hiring. Uh if
uh if this uh this part of the work
sounds like fun, come work with us. Uh
do the hiring challenge and help us
build a 10 mile uh 10 million mile data
set uh to get the the next scale up for
our models. And uh that's all I got for
you. Thank you. [applause]
>> Thank you so much. All right, we have
time for a few questions for Mitchell.
Any questions?
Great talk. Um, how does the left side
driving data uh affect the training? Um,
so we uh we explicitly detect left side
driving data uh just based on geography
and then uh we can use that to to have a
model that predicts which side you're on
just to to validate those. um it doesn't
affect things too much because uh in in
all cases like the localizer that you're
running is the same. Um so the model may
need to know which side of the road
you're supposed to be driving on but all
of the stages up till then are
completely agnostic.
>> Hi there. Another question.
Okay. So, you send back like a really
short like log for all the road
segments, but do you like on that look
for key features like hard braking, hard
steering, stuff like that? Be like,
"Hey, we probably want to get those road
segments back."
>> Uh yes. So, uh
the uh the uploading
uh we
we have some of that information in the
Q logs that we can scan through if we
want to. Um, currently we don't
prioritize uploads that have like, you
know, hard breaking or hard
acceleration, although we've talked
about doing this. This may be something
we do in the future. Um, but we have
quite a bit of that data in our full
data set. And so we can choose if we
want to train uh on more of that data or
uh to train the model to predict that
kind of thing. Uh, and so that we do do
a little bit of.
>> All right, we can maybe take one more
question.
Yeah, it's a great talk. Uh, one
question is, uh, previous talk had I
talked a little bit about the, you know,
change in the dramatic change recently
in uh, uh, better engagement uh, higher
percentage. Does that fundamentally
change how you decide to choose segments
that you want to keep?
>> Right now it doesn't because uh, the
differences are small. um like we're
seeing, you know, maybe a 5% increase in
uh in engage time, but potentially yes.
Um you know, if if we're at the point
aspirationally in the future where like
90% of uh all of our drives are engaged,
uh at that point, you know, we might
want to start to pull more specifically
from uh data where where the human is
driving uh just for that reason.
>> All right, guys. Mitchell will also be
available in the Q&A if you have any
more burning questions about his talk,
but we are going to keep it moving. Um,
next up we have Roba. So, thank you
Mitchell.
>> [applause]
Great. Good afternoon everybody. Um, I'm
sure you've all seen my uh my title on
the uh the itinerary for today. It's
actually not the full title. Uh,
obviously after the launch everybody
knows what it's going to be about, comma
four. Um,
concept of shells. It's quite
interesting. Uh, you don't really see
any other companies talking about this,
but I think it's very important to share
like what happened during like the the
the process of getting into the the
device that we have now. Uh I would like
to see more companies do something like
this.
Um so two years ago I also did a talk uh
so about hardware about manufacturing in
our office. Uh to recap that a little
bit because it's still quite
interesting. Um I about talked about
like this general like flow of like how
a product like like comes to be and gets
into your hands. Uh where we start from
like a general like vibe of what the
concept should be. We go into like first
design stages. We prototype it. uh test
to see what's broken with it. Um then
moves to production once like the
design's finalized gets to the consumers
and then we do the repair stuff. Um
so what I did what I talked about last
time was like okay so we get the the
PCBs in um we have like our own
manufacturing line. It's actually
picture I took yesterday. Uh so all the
three axis that you guys have received
are all built on the this line you see
over here. Uh but we've recently been
setting up the second line which is
should be even faster. So hopefully the
the four axis will uh run off the line
as quickly as possible. Um so the puzzle
solid paste, you put on the components,
you make sure that everything looks
correct and then it goes into the
assembly room um where all the
components are mounted onto the board
and then it goes into the testing rack
that a deep and all the people have
talked about before.
Okay, so that's quick recap. Uh let's go
back to this. So last time I really
talked about like the second half. Um so
now let's focus on the first half. We
really start to dive into like how do we
get from the concept into like the
production design that you guys uh saw
today.
It always starts with a code name which
you call MI um and some wildly
optimistic uh thoughts. Uh if you can
read this but it's January 14, 2023.
George posted, "Okay, let's start with
something called Tacoma Mini." Uh, so
it's supposed to be small. I think we
achieved that. It's going to launch at
CES 2024.
I don't know if you checked our calendar
lately, but
almost achieved it.
And really, the concept back then was
like builds like the absolute bare
minimum thing that we could buy uh that
we could build. Uh, that still gives you
like 80% of the value of the the the
main like 3x that we had back then. Um,
and we we figured it would look somewhat
like this. Like it would look like a
stock Alcast camera, would maybe have it
be like passively cooled. It wouldn't
have a display because like we need to
display like a stock Alcas systems don't
have this. Um, we wouldn't store any
training data. Uh, we wouldn't upload it
back. So, it didn't get any LTE, so we
could drop that. Um, we thought like,
oh, like Toyota back then was like half
of the fleet, so maybe we just only
support Toyota. We put like the Toyota
connector on there. Um, we increased the
wide the the narrow road camera. um
field of view to make sure that like you
didn't need like a special mount for
like the the cars that have like the
tilted windshield. Um and really like
minimize all the production steps. Like
if you think about it, it's like this is
all it really needs to be, right? Like
it's one like diecast metal piece. You
place on one PCB there. You have like
the other PCB with the cameras on there.
That's all you really need.
And I don't know if you like if you go
to this link, this is some other company
designed this and it looks so uncannily
like the thing we came up with back
then. It's crazy.
But then we we thought about it more
like having no display. I mean that's
that's really annoying, right? Like how
do you how do you set it up? Like how
get this thing you take it out of the
box, you put it in your car. Like you
have to like connect it to Wi-Fi. You
can't input anything. There's no
buttons. You have to like make a good
app. you have to like support Android,
support iOS. We're historically not very
good at any of this.
So, we thought like, okay, let's just
put the display on there. Um, from our
experiences, like getting a custom OLED
made like in the shape that you want,
that's basically impossible. Like, if
you're like a Samsung and you want to
build like a Galaxy watch, all the stuff
is very easy, right? Like you have like
you buy like a million of them, you
spend like a few million dollars,
everything works. Um, that's just not
really the scale we're at yet. On the
other hand, LCDs, they're a little
easier to like customize, but we've
we've tried this before, but like in the
3x stages, uh like prototyping stages.
Uh this is actually a picture of that
they pulled from a slack where you can
see like, okay, we put this thing in an
oven for a few hours. These LCD panels
are really not made to to like withstand
like higher temperatures you would see
on in a on a car dashboard. Um,
and so this is also not really an
option. But fortunately,
we're looking around the markets and uh
we finally found a company that like
makes like a very nice tiny like little
AMOLED display. Um, it's like almost the
right form factor, right? Like you can
imagine like this is like this height.
It kind of like matches the the the
driver camera. Um, the width is roughly
like what we would expect for the device
we wanted to build. Like this is great.
And the thing is you don't even have
like you don't want it to be square,
right? like that doesn't really fit in
any device. Um, but if you can just
replace the front glass, which is a lot
easier to customize, you can actually
make something that looks pretty nice.
And so that's the thought that we uh we
went on a little further. Uh, contrast
isn't great, but I really had this
concept of this thing like maybe we can
make it look like a Mac Mini like with
like nice rounded corners. You have like
nice rounded display and it actually
kind of looks like the Comm 4 we ended
up building.
And thinking about it a little more,
it's like, okay, like if you already
added back the display, why not just
make it better than a 3x? Um, if you
just add back LTE, which can't be that
hard. Uh, we add back OBDC, so we
support all the cars. Like there's
really no drawback in having this device
versus uh a comma 3x.
And instead of calling it a MI, let's
just skip that, 4. So just build a new
flagship. That's great. You don't have
to support like two different product
lines. Um, this is going to be amazing.
So once you have this concept um I mean
that's all still in like magic land like
everything's everything looks great on a
computer screen like it but obviously
doesn't drive your car. So you want to
get something driving as soon as
possible. That also means that you have
like a product you can hand off to like
uh for example the open pilot team so
they can start working on like the UI
like how does this thing look like in a
car? Can I uh design like an interface
that like works with this? Probably uh
possibly um like very well. Um,
and you can also like test out the
different refactors you want to do in
the electronics. And so this is
something that we really thought about
and we really try to optimize like the
first prototype to be driving as soon as
possible. Um,
and most of the important things like
one of the most important thing to get
something driving as soon as possible is
you really have to select like which
processes you're going to use. like you
don't want to do anything fancy that
would take like months of lead time from
like different companies uh or something
that like only one company in the whole
world can do. You really want to stick
to like the basics like 3D printing for
the case uh or if you want to do a metal
case you just have it CNC machined like
that stuff is all super easy and you can
get a ton in like hours or days.
electronics that's a little easy a
little less easy than mechanical parts
to speed up uh because if you want to
put something like a Snapdragon 845 onto
a PCB you really can't do that on like
your standard like JLC level four layer
PCB uh which they produce in like a week
but you really have to step up to like
an eight layer board which has like fias
that don't run all the way through
through the board like from like for
example like layer three to layer four
and these things like they take weeks
and weeks to produce it's not even just
production production time. Like these
things, they actually take six to seven
weeks to produce, but they also take
like three to four weeks to even just
like design and route out. Like you
don't want to do like 50 revisions doing
this because you'll just be stuck for
years.
And then for the other parts, like if
it's not broken, like just don't fix it.
Like just take parts that already work.
Like from for example the 3X, we already
had a heat sink that worked. Uh and just
like stick it on there. Like this is
also u the board that we designed for
the 3X um which has the 845 already on
it. So we fig like oh let's just reuse
this module get it on the first
prototypes and it'll be driving like
immediately
and that's exactly what we did. So uh
from the time we started the design we
had PCBs ordered in nine days and then
after 30 13 days after that we had the
first thing booting and so that means
that we could hand it off and get like
all the all the development teams start
working on uh on software firmware that
kind of stuff and only 3 days after that
we got the first one driving in the car.
Now I do say driving um it did drive but
the screen is still black.
It's like obviously like prototypes make
mistakes. The screen didn't come up.
Like every time we plugged in a screen,
we see like a puff of smoke and be like,
"Oh, something's not right." So,
[snorts]
the connector was on mirrored. I mean,
it happens. You only make this mistake
once, right? You just design a small
PCB. You don't want to respin that that
rigid flex board because it also takes
like two weeks. You just make like one
simple two-layer PCB. You get that in
like a few days. The display is up.
Everybody's happy.
So that's kind of what this board looked
like. Uh
I mean it worked. I posted it to Slack
and then uh in the same vein that Shane
got the the feedback from a deep saying
like oh this should only be 10 lines.
This feedback was immediately that looks
like way too much stuff.
I kind of agree like in the end product
you see now like at least 25% of the
components on here are just removed like
refactored out completely. like we got
the the STDM to do like the audio codec
stuff. Uh we replace the beeper with
like just driving the beeper signal
through the the speakers. All the stuff
that just you don't need and you just
reduce complexity uh massively this way.
Okay, so we had the S prototype driving.
I mean that's obviously not something
you can just refine on and ship. So we
really had to think about like okay what
is this device going to look like in the
end? Um
and the main driving factor for that is
like what is the case going to look
like? like you can't design like this
complex PCB and and change the shape
because all the components move and you
have to move all the traces that just
every time you do like an outline change
that takes like weeks to uh to
materialize. So we thought about a
little bit and I like my Mac Mini
design. Uh there were a lot of people in
the company that didn't quite agree and
one uh morning I woke up and I got like
this image. I don't know if you can see
it very well. This is like
like play-doh mashed together into like
a potato chip shape. And they were like,
"Yeah, just it needs to look organic."
Like, "Oh, okay."
So, I came up with something that looked
like this. I got really into like the
fusion design tools to like make organic
shapes and stuff. It's really nice. Um,
Eigor, our mechanical designer, did not
agree. Uh, so we completely threw that
out of the window. And also, like if you
try to fit any components in this, like
the curves just don't really work. Like
anything you want to put in there is
square. It just doesn't fit. And so like
we botched it out a little bit and like
we could kind of like start to lay out
components like uh we saw like okay like
this is going to be like a nice diecast
aluminum case. It's going to be
passively cooled. Um so but like in some
cases you might want like a little bit
of like active cooling. So we fit in
like this blower fan to like get some
air moving through the case. Um we laid
out all the ports that we needed. We
need laid out the camera bar uh the LTE
module, the speaker, all that stuff. It
kind of fit. And so, um,
after a few more iterations and design,
uh, we came up with this, which is the
the RAV A case. Um, you can see like
it's still like supposed to be made out
of metal. It's still diecast to like get
the passive cooling working. Uh, yet
like this big surface that like the 845
would heat sink into, distribute out
over the whole surface, and then would
just like mostly cool itself passively
and be quiet.
I kind of proved this out as well. I was
like I posted this on Slack uh a little
after that and I made like a very simple
mockup that we could simulate where we
dump in like the six watts or whatever
the 845 outputs and I said like okay if
you have like 25 C air and move up
roughly 1.2 meters/s uh over the surface
from like natural convection and like
car like air currents moving in a car
this should just work. Uh turns out like
both of these assumptions are completely
wrong. There's no convection in a car.
Uh the force cooling never hits the
windshield. Uh, it's never 25 C. The air
next to the windshield is so hot. It's
uh, this was completely off.
But anyway, we didn't know that at the
time. So, we started laying out the RAF
A. Uh, we put this nice big hole in the
PCB where like the blower fan could sit
on the other side. It could suck in air
and then exit it uh, through the through
the top. That seemed like a good thing
to do. Uh, we like had some trouble like
laying out all the components on the
board. Like it all kind of fit. We got
it to work.
We put that into like a flow simulation
like okay it pulls air from the back.
You can see like it moves like under the
PCB so it moves over the aluminum
surface to cool. It pulls it up through
the blower and shoots it out to the
front. And like ah that might work
as we routed it out. We sent it out and
that was our rev of the MI.
Of course, as I talked about, this is
already like the the high uh complexity
PCB, like an high density interconnect
PCB. So, it would take like six to seven
weeks to produce. And we didn't really
want to wait uh on those seven weeks
before we could start stuff like
mechanical design. Uh so, what we did is
actually we just took the top and the
bottom layers of the PCB and we just
sent it out as a two-layer PCB. So, it
looks and functions exactly the same
mechanically, but it's there's no traces
in there. Like, it doesn't do anything.
But it's still very useful because it
mechanically it's it's completely
equivalent. And you can get this in a
week. We didn't make one mistake though.
Um,
usually the stuff that we intend to
work, we make black because that that
looks the nicest in the case. We think
like if we want to be mechanically
equivalent, we'll also make this black.
Turns out you just can't tell it apart
from like a real PCB anymore. So, I
predicted back then like like how long
is it going to take before we're just
going to waste like half a day trying to
figure out why this thing doesn't boot
and um it didn't take very long.
[snorts]
Okay, so once you got the the real the
MC Rev AP PCBs in, it only took a few
days. We got it to boot. So, there was
no like fundamental big issues. Uh
except like the cameras didn't work and
the display was still black.
We did it again. [snorts]
Uh, this time it was like just 180
degrees. So,
oh well.
After fixing that though, just a few
days later, we have the first actual
drive of a MCI in a car. Um, MCI Rev
August 22nd, 2024.
Okay, it's almost up and running. Like,
it kind of drives. Like, we're nearly
there. It will ship in like two months.
It doesn't. Um,
of course, Rev A, you make all these
like tiny mistakes. We track this in
GitHub. We have just make like a big
list of all the things we want to
improve for Rev B. Uh, nothing too
spectacular in there. Like looking at
the thermals of that first drive, which
you could have seen like this was like
the sun was already setting. It wasn't
very hot out. It was like the the car
was like nicely cooled and aced. The
thermals of the CPU, they just kept
rising through the whole drive. it just
didn't really perform passively like we
we thought it would. Um
and so we we thought like okay um let's
dive into the first principles right
like uh you have this 845 processor that
we get from Qualcomm that's sold to a
PCB and then for because it's usually
used in a phone they're very like space
and uh power efficient to put the RAM
like right on top of the chip. So it's
actually like a chip you sold on top of
another chip, which is great at phones
where you have like very bursty loads.
You don't really care about thermals all
that much. Like with sustained loads of
open pilot, this doesn't really this
really limits like the the thermal
interface between like the die that
actually produces most of the heat and
like the heat sink you want to put on
top of it. Um the 3X we didn't
optimize this all that much. Like what
you basically have is just to put the
heat sink on the top. it just mostly
flows out of the top and it's like
mostly fine. Um, but then we also
figured out like this PCB is actually
like eight layers of copper in there.
There's a lot of interconnect. So, it
actually like thermally decently
conductive. So, what if you just also
cool from the bottom? Turns out that
Qualcomm actually publishes
pretty good high fidelity like thermal
models of their chips. They can just
simulate this. And turns out like you
could get at least a third of the heat
through the PCB out of the bottom. So
that's already like an easy like 33%
improvement that you just get for free
if you design this in. We also validated
this. Uh so this is what we call the the
shot glass test. We just got a copper
shot glass filled it with water and then
if you run a constant load on the CPU,
you can see you can just like measure
the difference between CPU cores and the
water temperature. If you div those, you
just get a flat line and it gives you
the exact temperature difference from
this actual CPU die that you're trying
to cool and the uh oxide uh environment.
That's the best you can do in this
setup.
And it's like it's still not really good
enough. Like is there anything else we
can do? Like you can see this like big
air gap here, right? Like it's in
between the balls. It's on the top of
the processors. And like air is not very
conductive. Everybody knows this. What
happens if you just add some epoxy in
there? That's like somewhat thermally
conductive. It just fills all these gaps
in and just it really improves thermals.
Like this change alone like improves
thermals by at least like one seawatt.
um which is pretty massive in the the
things we're trying to optimize. And as
an added bonus, because it's epoxy, it
also like mechanically bonds the chips
to the PCB and that greatly improves
reliability.
So this is kind of what it looks like.
So this is actually this is not an chip
you're looking at. Uh this was a chip.
It's underfilled and then you just
mechanically like break it off and you
can see like the epoxy filled like all
the empty space uh next to the bins.
Another issue we found on the the early
Mises is it's a metal case. If metal is
at like 50 or 60 C, if you touch it,
it's not good. It burns your fingers.
The device is still running fine
thermally, but like it just it it
doesn't really feel like a high quality
product and like it's just not something
we wanted to ship. Um, we tried to
improve it. I made like this cyber mey
design which I thought looked kind of
cool. My team wasn't very convinced
either. Um but if anybody like wants to
make this I'll buy one. Um
so we still have the metal case back
there.
And like this is also validated in the
plots where like we didn't realize this
but a lot of the heat input actually
doesn't come from the electronics inside
but it comes from just the sun like
shining down onto the device. Like
especially if you drive around in
California and or like the the lowest
states in US, you could see like like
one of these is case temperature. That's
case temperature. It just keeps rising
and rising and rising. It doesn't
dissipate into the the the air. The case
just gets way too hot. It's just not
very good. We simulated this uh like a
small little fake windshield with a
device on it. We had like an IR heater
that like we got to somewhat match the
sun output and we couldn't really get
the metal case to work.
So, let's just okay, let's just cut our
losses. Let's just redesign it
completely. Um, and instead of dumping
all the heat into the case, we know we
can extract like 66% of the heat out of
the top of the chip. Um, which we could
then put in like a a nice u heat pipe
with like a fin stack that we would see
in like a laptop. We simulated this that
seemed to kind of work.
So, we got that made. Um
and we stuck with this design like all
the way from ref C to ref. It it caused
so much problems. Um so one of the
issues you have is that you really need
the surface contact between this plate
and the 845 to be um as flat as
possible. So we designed this to be um
on spring screws. You can see in that
picture like the spring screws are way
too big and nobody really makes the
smaller ones that we needed. So then we
got custom screws made. Okay, custom
screws. That looks a lot better. But
then like the fan standoffs, like do you
want really want to put like all the
screws in and like it has like little
like gapped on labels on there that get
everywhere in production. So we okay, we
designed custom standoffs for the fan.
Um
we figured out like oh we need to
optimize the intake path. So then we
added like a big hole in the front of
the case. We put like an extra fan on
there and it just turned into this whole
big mess. We even came up with this uh
monstrosity at some point because we
figured out that like one of the fin
stacks just wasn't quite long enough to
like be super efficient. So we like
doubled the fin stack up. Uh we added
backside cooling. We added a fin stack
in there. It just
it just didn't really like we could kind
of get it to work somewhat on a 3x level
in this form factor. Um but also right
around this time we figured out that the
GPS performance wasn't actually quite
what we hoped for. Like if you look on
this graph like the bottom line that's
the horizontal accuracy that a 3x would
get on a route and the one on top of
there that's one of the early production
me uh early prototype mees that we built
and it's it's just a lot worse.
So that turned into a whole thing as
well. Um,
one of the most annoying things is that
the 845 because it's like it has so many
sublocks and it runs at so many
different frequencies and PLLs that it
outputs harmonics basically like in the
whole broadband spectrum around GNSS.
Um, so you really need to shield it like
on the 3x it's like nice it has like its
own shield. It's like covered by the
heat sink like that kind of works. But
for this yeah I mean we designed in a
shield that helped a little bit. Turns
out like uh like the the heat pipe
because it's not mechanically connected
because on spring screws it's not
grounded enough. So we like tried
grounding that. That kind of helped. We
covered up the whole thing to like cover
any holes. That kind of helped a little
bit. Then we had to add like shield like
a foil under the holes. Another small
improvement. We had to add like a bottom
side shield.
It just turned into this whole thing. At
some point we even got like production
versions of like the the shields that we
would like get the machines to solder
onto the boards. um because they're like
in awkward shape, they like would bend
and like warp in production. And then
sometimes like not the all the edges
would get soldered. So that also like
become became somewhat flaky.
So we ditched that and we went to like a
full like unibody copper thing that sat
on top of that like sort of sacrificing
some of the thermal performance for RF.
and still you would get like plots like
these that didn't quite match um what a
3 or 3x could do. Another issue for GPS
performance that we had was that some of
the signals that are just like happening
in the device like driving the display
or like driving the cameras because
they're at certain frequencies that are
like if you multiply them by um an an
integer amount you would get harmonics
that are right in the scent of GPS
frequencies and GPS is an extremely uh
uh low um low amplitude signal. Um so it
gets drowned out by basically anything
that's that's even close to it. You can
see this on these plots like uh Maxim
wrote this very nice piece of software
that would like turn off the screen,
turn the screen back on, turn the
cameras on, turn the screen back off.
And so like from this graph you could
see like okay the screen has a big
effect, the cameras have some effect
and some of these you could just fix
with software like we just looked into
like the display code and we could
change like the frequencies the display
was running at. We changed like drive
strengths of certain like regulators and
the 845 firmware. like it just it turned
into this whole hassle to get something
to like barely work. Another thing uh
limiting GPS was just that the antenna
was on like the edge of the board and
the antennas like these patch antennas
are not designed to do that. Like
they're designed to be in like a perfect
vacuum with like a nice 10x 10 cm ground
plane that's like very nicely centered
which is just not possible in the the
form factor that we were building.
This is another RF plot. Um, this is
because the antenna's on the edge like
you want this blue trace which is what
you measure. We want that to be in the
middle to like be more efficient. Won't
bore you with all the details but that's
uh that took a whole bunch of like
optimization as well. But that then
changes like the resonance frequency of
the GPS. So then you have to go to like
brute force all these values. This took
literally took months to get something
that's like barely on the level of a 3x.
But in the end, we kind of got there
like on Revf F Cde EF.
We got it to like something that
somewhat matches a comma 3. Um,
but it's okay. It's maybe barely
shippable.
But if you just zoom out a little bit,
we had this RAVF F that like barely
worked thermally. We had barely working
in a GPS.
The case was still metal. It would get
like uncomfortably hot. uh eat the fan
at the run now because we didn't
passively cool most of the chip anymore
which is kind of whiny. Um the shielding
is like there's a lot of custom
components like barely make it work. Um
and we just came up with just we'll do
one more redesign and completely solve
all the in the uh issues like just
fundamentally
and that's how uh Rev H came to be and
that's remarkably close to what we are
actually shipping now in Revi. So it's
as you can see it's like a complete
redesign again like the 845 moved back
to the bottom side of the board. Um we
ditched the big fan hole for the blower
which allowed like a lot more space to
lay all the components all very nicely.
Uh this also added the space to like add
this exposed ground path so you can have
like a shield that fits nicely on top of
it. Um the shield could also be like the
heat sink we figured out and then from
the backside cooling. It turns out that
you can just have a copper plate here
and that's high conductivity enough to
like just conduct that through the post
back into the bottom heat sink and this
just turned out beautifully. Even the
GPS is like no more no somewhat more
central into the board and that just
fixes so many things.
This is the you've already seen this but
this is the heat sink design we came up
with. This is also the integrated shield
and it just
is great.
After that, we still did a whole bunch
of experimentations um on the input
design, like the airflow input design.
Uh a lot of these had trade-offs between
like noise production and thermal
performance and looks. [snorts] Uh so we
we literally built like hundreds of
these. Um the team also optimized the
thermal design on the heat sink side.
So, it turns out if you add like a nice
little cover over the heat sink to not
recirculate air and also to cover the
sides of the fins, uh, you would get
both better thermal performance and
lower noise profile or at least like
shift the frequencies away of the noise
profile so you barely can't hear it
anymore. And that was a massive
improvement as well. Even more intake
designs we tried uh before finally
ending up with what we're shipping.
And thermally, this is what we ended up
with, which is honestly quite
incredible.
If you look at this graph, like the blue
line, that's the comma 3x. So, it's
running a constant like six watt load.
Um, and we just sweep the fan power,
wait until it settles, and you just see
whatever the the CPU temperature ends up
in. Um, that's, you know, a 3x it works
pretty well, but it's normally not the
best thing in the world. Um, so in Rev
F, like the final design that we had,
like if you run the fan like at 60 70%,
you could somewhat get close and it's
probably good enough for what we wanted
to do. Uh, and then if you go back to
like this abomination with like the heat
sinks on the back and like the extra fin
lengths and stuff, you could get it to
be somewhat better than a 3X.
Uh, that's the green line. And then the
Rev H design. U, I mean, that's
obviously that's in like a league of its
own. like even at like 30% fan, it just
blows the 3x out of the water.
And this obviously also translates into
driving performance. Like this is just a
log app from like a route that we drove
on the Rev H. Um like loaded while
driving like regular Open Pilot load,
the CPU barely like uh dips above uh
50C, which is quite incredible.
uh because it's also under the 75C that
we try to control the temperature at
this the fan was basically not running
at all.
And then for GPS performance, I mean
that doesn't look any different than a 3
or 3X. So we also completely solved
that.
Of course, like you can't do all the
experimentation in house like all the
the like the test setups you build like
you're only testing like one device. You
test it for like one time. Uh but if you
wanted to get some data on like what
this thing would perform like in the
field like what are the the 1% failures
uh uh like then you really need to like
just get so many driving hours on this
thing. And uh we had this nice group of
people that we trusted to not leak the
the device um that we sent some devices
to. They got like the the unbox
experience. They got to test the UI
provided a whole bunch of feedback. They
racked up tons of miles on this device.
Um, which really makes it us confident
that it's it's a very solid uh design.
Other than that, we have uh testing
infrastructure from the other teams as
well. So, I already showed you this.
This is like a testing dashboard that
Maxim from the Open Pilot team built,
which is very valuable. It just shows
like every MCI drive of every day and
you can just look at like all the
sensors that we have in the device like
see if there's anything wrong that you
don't expect. Um this slide is somewhat
that outdated apparently but it's we had
that's like the amount of segments that
we got uh driven around FH Revage and
then we also had like the green check
mark every day from the autonomy team
which basically meant that okay all the
data all the logs that we gathered from
the device were actually trainable uh
which also is a very strict check to
make sure that all the sensors and the
cameras and stuff looked good.
After you've done all of that you're
still not done uh you still need to send
it off to certification. So they put in
like this big anac chamber. You run your
standard open pilot um loop and then
they just measure like whatever RF
frequencies come out of it. The limit is
red line. Um this stuff that's all
noise. That's all like the cabling and
the power supplies and stuff. So you
don't really look at that. But like look
at how flat this line is. Like this is
basically just background radiation.
Like the shielding we did on this thing
is just incredible. Like there's I
haven't seen any other device that looks
like this.
We also went to Shenzhen. I think a deep
show already showed some of these
pictures. Um this is invaluable feedback
like this. So uh I mean this so valuable
that uh you can see like how the
processes are being done. So you can
like incorporate this into like the next
revisions like make sure that that it's
super easy to uh to produce. You don't
get any defects in between batches and
stuff like this. Um like in the right
that's like the the general flow of how
they produce like a a MEC heat sink or
comma 4 heat sink where you start with
like the extrusion they mill in a few
steps. It's just so valuable to know how
all these things do.
That's not only the device performance
that improved quite a lot. It's the
complexity of these things. It's just so
much reduced uh from the 3x. Like I went
through like the the the lists that we
have and like the unique bomb items like
the bill of materials on this thing
that's almost dropped in half from the
3X. The amount of process steps that we
do inhouse like the assembly steps like
focusing lenses um sticking on tapes
like plugging in cables and that stuff
that's literally have and the amount of
custom parts where we actually design it
instead of just buying it off the shelf
from different vendors that is has more
than half. So this is uh quite an
incredible achievement I think.
If you don't believe it, then it's way
easier to build. I mean, we have a booth
over there. Just go up to it, take like
take a look at the components, put one
together yourself. You don't need any
training. You can literally do it in in
a few minutes.
So, I think that's uh concludes most of
what I wanted to talk about. Um, I think
we finally got to a design that we are
that's worthy enough to be called the
comma for.
That was it.
>> [applause]
>> Thank you, Robe. We have a couple
minutes for questions. Any questions for
Rob?
>> Do you guys um do any formal vibration
testing or is it just relying on the the
ones in the field is working?
>> We mostly rely on the field for that.
Yeah, we we've thought about like making
like a vibration setup, but we haven't
just gone around to it to uh
>> figure that out.
>> You know, just like you have um the SMT
line in house and that really helps with
iteration speed. Would you ever consider
bringing like the machining in house or
molding injection in house?
>> Absolutely love to like if we could get
CNC parts like by the end of the
afternoon that would be amazing.
>> Okay.
>> Um we the office that we have now is
just not quite set up for it yet. uh
like we would need like like a decently
sized like actual uh factory building
for this but hopefully in the in the
future. Yeah.
>> I try to fit as much in our office as we
can but sometimes that's a stretch.
>> Uh h how do you find your simulation
tool relative to the testing that you're
doing? Is there any opportunity that you
get to improve the simulation tool
you're using? it. I'm I already had this
conviction that I'm I'm getting more and
more convinced that like most of the
simulations we do are just not very
useful. Like
like you've seen this, right? Like we've
simulated so many things that you just
even if you like get like one very small
detail wrong, the the the conclusions
that you you derive from this are just
they're just not useful. Like just spent
like the two days build a thing in house
and just test it.
Is moving to ray and CPU rendering going
to make a measurable difference to your
kind of steady state CPU load
temperature?
>> Uh hopefully, but I think uh the problem
is like every time the Open Pilot team
makes any improvements on this, it's
just all eaten up by autonomy again. So
just run bigger models.
All right. Thank you, Robe.
But you were not. And now I will leave
Shane to go on stage and talk to you
more about simple stuff again.
[applause]
How's it going guys? Uh that was a great
talk by Maxim um about like the
low-level graphic stack and how we um
simplified that. And I'm going to expand
on that more on like the ray part like
how we turned um how we um yeah so let's
just start so solving simplicity again
uh it's my idea that if you uh if you
have simple code and this goes both ways
if you have simple code you can have a
nice simple life so
yeah nice beautiful surfers here you can
uh go surfing surfing after this great
so sorry to jump scare everybody so
early in the morning. I know if you get
this in your uh you know email uh poll
request closed by Dee that can be scary
but um yeah before I started working at
Kama I was just a college student and
whenever I wanted to work on a project a
coding project I I didn't have um any
like idea of
making things simple. I just hacked
together the first, you know, the first
solution that worked and I moved on. And
maybe I came back months later and it
was like totally impossible to reason
about this code. Like it's just way too
big. You can't keep it all in your head
at once. And that's why you need to uh
try to keep things simple. So how how do
we recognize whenever we're we're adding
complexity where we don't need to and
that's recognition. You need to be
self-aware enough to realize in the
moment when you're doing this stuff. Uh,
one case is let's say you're you're
adding something to the UI and you want
to add an edge case. You want to support
like maybe a user gets into those a
weird you know we want to show like an
error message for this specific one case
and that adds 30 lines well 20 lines or
maybe you're adding a feature that you
don't really need. Maybe you're making
something abstract. You just want to add
one feature but you're like oh maybe in
the future we want to do this other
thing. So we we make it generic and
that's just extra complexity that you
don't need yet.
And
well, that that looks good. That that
looks good, right? We're removing a
thousand lines. However, this is a
tricky case because you're using a
library. And while that can be good
sometimes, I'm going to explore why that
might not be. So, we going we're going
back, I think, eight years or so, back
to 2016. Oh, whoops. Um, we had we were
basically running like um a souped-up
Android phone. It was like the comma eon
at the time. And we had a few APKs that
we ran. One was it was just black. It
just drew a black frame for some reason.
I think that was to hide the blute
splash whenever we switch between the
different UIs. One was the frame. So
like when you're on road if it's green
or or not, like if you're engaged or
not. One was the off-road UI, so you
could like swipe uh you could like swipe
see your uh driving stats, whatnot, pair
device. And I didn't know this, but
apparently we had Spotify and ways um
which I if you have CarPlay, I don't
know why you need that. Maybe this is
before CarPlay, but I guess you could
just pair it to your Bluetooth. And then
on top of that, to draw the like the
lane lines of the model, we had a
different graphics stack called nano VG,
which is written in C. It's actually
quite simple. Um, so that was probably
the best part of this stack, but you can
see this is a lot of like working parts
together, right? So, a few years ago, we
switched to a new stack, which is Whoa,
I think there's some lag up here
as QT.
And QT is a nice uh graphics library at
the time to switch off of or to switch
to because it supports widgets, you
know, if you want to like put some text
um or if you want to like, you know,
enter your password for your Wi-Fi. It's
just all there. It's all coded for you.
Um it has nice multi- language support.
And if we go back to the graph there, if
you saw, there was just way too much to
to reason about. You need a graph.
Let's see if this works here. But
anyway, you need a graph to like see the
whole state of QT. You can see you have
like tree widget. I don't even know what
the hell half of this stuff is, but it's
there. And this is probably just like a
small subset of QT. So this is the
problem with using libraries. Sometimes
they they do remove code. they do, you
know, put the complexity out of your
project. However, the problem is that
you have to trust that this other
developer, you know, they didn't write
bugs writing all this complex code.
So,
if we can switch here, there it is. So,
complexity is a black
box.
And I'm I'm going to briefly explain
like a few cases we ran into while um
writing the new UI in QT. Um so
basically the driving model uh for
experimental mode, it like draws a path
and there's like um it's green if it
wants to accelerate, red if it wants to
break, right? So we we have this nice
hue which is a float, but for some
reason I found that if you don't round
the float from another float to a
slightly different float, it would take
two times longer to draw to draw the
path. And I just never figured it out. I
just ended up rounding it which somehow
worked which is great but it's just just
complexity uh and complexity is a black
box right and so comp blackboxes require
care
issue I ran into um just one day the the
Jenkins test the hardware and the loop
test just started failing out of nowhere
uh for high UI timings and if you can
see over there it might be a little
faint but just some frames would take up
to 300 milliseconds to render where they
should normally be under like 10 or 20.
And while I was debugging this issue
live, the lights in the open pilot
office turned off and the timings that I
was seeing just like spiked. So what was
actually happening was the model was
just um on the comma 3x was pointed
against the wall and it's basically
either seeing light or dark. So when the
light turned off, it was just outputting
lane line geometries that were just
totally not totally wrong, but it just
the the polygon renderer just couldn't
convert it into like a nice uh triangle
strip that the GPU could run and it was
just using this entirely different code
path that it just doesn't tell you that
it's doing in the moment. Um, so that
took a while to figure out. So how do we
how do we fix this? Well, as Maxim
talked about earlier, we switched off QT
to Ray, which is just like a simple
OpenGL wrapper. Gives you a few
functions like you can just draw uh
shapes and text. The uh the entirety of
QT, I think I looked it up last night.
It's like several million lines of code
and we just have uh a widget function
ourselves, which is 200 lines of code.
So that's, you know, that's a huge
improvement. If you want to draw a nice
icon, it just takes four lines right
there.
Uh there's no dependencies, there's no
build time. So what used to take a
minute if you want to try if you want to
change a UI component is now instant.
It's infinitely faster. And yeah, just
who wants to fix other people's bugs,
right? That's cringe.
So
how did we fix the original problem
where the model was just outputting like
lane line geometry that the QT didn't
know how to handle? you can just simply
do less. So you can see QT has this huge
30,000line function just to triangulate
uh polygons and they might be like
inverted or convex or whatever and we
don't need to support any of that. We
just need a simple fourline for loop.
It's all you need and it's way super
it's way simpler. It's consistent. So
yeah, that's uh that's one of like the
practical applications of switching to a
smaller library where you can control
the complexity yourself and you can
remove the bugs yourself which is very
nice. So switching gears to uh the car
interfacing uh I think it's it's really
cool how we support over 300 cars now
and that's growing every single day,
right? And a lot of the car support
comes from contributors like you guys,
which is also really cool. Um, but
you know there's like there could be
there could be a lot of complexity in
that, right? You have to support like
all the different Hyundai support
different harness like physical harness
types and
as well as the software the DVC is going
to be different per car. So how how do
we handle that? That seems like an
impossible problem. Well, to give you
guys some context, last year we had a
Damon ControlsD and it pretty much does,
you know, what you expect,
uh, it takes in CAN data from the car,
runs it through the car interface suite,
which is basically like where's the
steering angle and the gas and brakes,
run it through run it, uh, runs it
through some controllers. So, like based
on the model, should it turn left or
right right now or accelerate? And then
it outputs it back to the car.
And
however, controls D also did a bunch of
other stuff like it ran the state
machine like if you're pressing the
brake should it disengage right now or
if the model is uncertain or if you're
doing a lane change. So it's just doing
a lot of stuff. This is pretty complex.
Um to keep the whole file in your head
is just also impossible. So what we did
and this seems pretty simple now but
this is how it was for eight plus years
or so. We just took the car stuff out of
open pilot which where it was all
together. We moved it to a new project
called Open DBC where the car can uh the
DBC messages already existed. So it's
just all in one place which is really
nice. And Open DVC what I just discussed
is a self-contained package that you can
pip install right now. You can run all
the tests. You can import all the cars.
Um this wasn't possible before with Open
Pilot. Um we're trying to make that nice
and pip installable but soon. So what
Open DBC does is it provides like a very
small API that Open Pilot can um take
and it can read data from the car. It
can send actuation messages to the car.
But again, what this allowed us to do is
look at this API and see, oh, what is
this message that we're reverse
engineering for every single car? All we
need to know is if the user is pressing
the gas, but we're also reverse
engineering how much they're pressing
the gas, which you don't really need in
terms of the uh the state management.
you just need to stop applying the
brakes. So remove that field and that's
just one less thing that people have to
reverse engineer now.
And then also the one minute CI as Maxim
talked about that was a requirement and
it was pretty easy. Um there was like
eight different tests for open pilot and
just adding these onto it. It's just um
just it's nice to have that separated.
So, one of the the improvements that the
smaller API allowed us to make was add a
new tool called the longit longitudinal
uh maneuver report. And that's something
that's a toggle built into Open Pilot,
you can go into your settings, turn that
on, and basically before this, if you
wanted to test longitudinal tuning
improvements, you had to like,
especially late at night, you have to
find a lead car, maybe at a stoplight,
you have to engage behind them, hope
that they don't leave or run the red
light so you can like get a nice um like
stopping profile, and then you you feel
like, oh, did that feel good? Um did it
over like did it overshoot on the
brakes? whatever. But now we can
recreate real scenarios. Uh, let's see.
Oo, laser pointer. So, gas break, gas
brake. You can see the Camry is
overshooting on the brakes a little bit.
Uh, undershooting and then overshooting
on the gas. Corolla looks like it
overshoots a whole lot. EV6 is pretty
good. So, this just allows to quantify
the actual performance of the different
cars that we support.
And what that allows do allows us to do
is we can make like very targeted
changes to the tuning. So if we want to
improve the gas response on Toyota, help
that not overshoot as much, we can make
that we can make those changes and rerun
that part of the report and see that uh
if it improves it, if it makes no change
or not. And it's really cool because you
can see some of these are user reports.
So you want to run this tool again. It's
just in your settings and you can upload
the data to this website right here and
maybe somebody will tune your car if you
can't.
And one improvement from that. So this
is this like the simplicity thing like
Maxim said, it all goes full circle. So
you have this
you have this API that you make smaller
because you're you're reasoning about it
now. You're trying to make it simpler.
Then you build this tool to use that new
API and now you can actually merge
improvements based on that. So, a
contributor in 2020 found this bit in
the uh reverse engineer DBC for Toyota
that improves the gas response. However,
it also disables braking and it makes it
overshoot sometimes. So, we didn't merge
it until just this year. Yeah, I think
just this year. And that was because of
the report that we had. So, on the
Corolla, starting from a stop, it took
up to looks like more than 4 seconds to
move. And now after we we tested the
bit, we can actually see that it follows
the uh acceleration request much much
more uh much better.
So yeah, if anything um if you if you
found any of this interesting, you can
port your new car. You can help us make
the API simpler. You can also get paid
if you go to the bounties website, which
is really nice.
So my final message is if you too can
simplify your code, maybe one day you
can merge your PR and a D will approve
it.
Thank you.
>> [applause]
Hi, thank you so much uh Maxim and
Shane. Amazing talk from the open pilot
team. Um next I'm very excited to
welcome Yen, our head of machine
learning. Um he will be here momentarily
when he gets miked up. So I'll just give
a few housekeeping uh notes uh before we
get started with our next talk. Um there
is still coffee in the back. So feel
free to grab a coffee. Um, and then we
will have lunch served at about 12:45.
Um, which will be served in the entrance
where everyone came in.
Hello everyone. Hi.
Let me see. Let's check the clicker.
Clicker is almost AGI level technology.
So we should all right works. Reach AGI.
Hi. Um my name is Yasin uh from the
autonomy team at Karma and uh uh today
we're going to talk about machine
learning. I'm here to talk to you about
not any kind of machine learning. A very
exciting style of machine learning that
we call end to end. We're all familiar
with it right now. Everybody's talking
about end to end. It's all the what the
craze about. All the cool kids are doing
end to end machine learning. So I'm here
to spill the tea and tell you all what
it is. What's what's end to end machine
learning? So if you're here, you
probably already know what open pile is.
We ship open pile open source L2 ADS
system that runs on the comma 3X. Uh it
has tons of users, many of whom are
here, I think. Uh a lot of supported
cars, more than 300 supported cars. And
recently, Linus Tech Tips said that it
was amazing. So, I guess if you guys
trust Linus Tech Tips, um I think it's
amazing.
As a famous person said while uh looking
at a a car, they said that it was all
computers. Um what I like to say is
well, it's more than that. What we ship,
it's all machine learning. So, we uh
ship this device to you called the Comma
3X. It has cameras all around and it
runs on a card that has some sensors and
it has some actuators and then
everything gets blended into this crazy
uh linear algebra that we call machine
learning and then drives your car. It's
magical, right? It's amazing. I think
it's cool.
Well,
it's especially cool because we are
doing it end to end. Um, and I'm I'm
here to explain to you what end to end
means to us and why it's important.
Uh, so in general, what we want what we
call end to end is what the general uh
literature call general purpose methods.
So these methods what you want them to
scale with is compute and data. You
don't want to them to scale with lines
of code and you don't want them to scale
with numbers of engineers. So you don't
want to uh be in the situation where you
need to ship a new feature or you need
to improve your system and the only
solution is well I need to write more
code or oh wait I need to hire a labeler
or I need to hire an engineer. That's
not what you want to be in. You want to
be in a state where well I need to make
this model better. I need to improve
performance.
The best way to do it is well, I need to
make this model bigger. I need to train
it for longer. I need to train on more
data. So that's what we call general
purpose methods. And uh this uh little
guy over there's name's Rich Sutton. And
that's a photo of our data center uh
built
uh by our friends uh Tiny. And they have
a booth right over there if you guys
want to visit it. uh with some uh some
some cool uh exposition hardware. Uh so
that's our data center and we want to
scale with data, want to scale with
compute, not with people and lines of
code.
As I said, all the good cool kids are
doing end to end, right? Even people
that were not doing end to end a few
years ago now are talking about it as if
it was, you know, the uh the only way to
do it and as if they always did it. Uh
which is fine. It's it's good to uh for
people to get uh you know, convinced and
change their opinions, but it's great.
So um yeah, the cool kids are doing end
to end. Tesla is doing end to end.
Even Whimo is doing end to end.
Robotics companies are doing end to end
as well. Um you know everybody's doing
end to end.
But you see this
oh sorry
these kind of job postings. A data
labeler job posting. Oh well that's odd.
It's not really end to end, is it? Uh or
even outside of the robotics, even
outside of the self-driving uh you know
space, you see these kind of jobs like
evaluator experts, prompts, specialists,
optimizer.
Um there's a lot of hand coding still,
but these models are end to end, right?
Well, how you train them is very
important. They can be end to end. But
the way you train these models might not
be end to end. You might still need
effort. You might still need people. You
might still need intermediary steps to
train these models which kind of defeats
the the idea of end to end.
But you can sometimes you see things
like this which are great. Sometimes you
see these in the news. AI achieves
silver medal in the Olympics. That's
great. And these are the things these
are the methods that uh I'd like to call
end to end because these not really rely
on human data, human labelers or prompts
specialists or prompt engineers or
evaluators. These models were trained
using reinforcement learning. These
models were trained uh using experience,
not using data labeled by people.
Why is this importance?
A few years ago, we were doing
prediction.
2016, 2018 was all about imageet. It's
all about predicting class labels,
predicting lane lines, predicting this
and that. Well, now now it's now it's
the grown-up stuff. Now you need to take
action. Now you need to act on your
predictions. And this is what makes it
hard. It's not just about saying things
about the world. It's about interacting
with the world, make making actions and
then observing what happens and being
robust to that.
Welcome to the era of experience.
This is where we're at and this is what
we are doing right now as a company. We
are building agents, driving agents that
uh act in the world that act in a car
and we want them to learn how to drive
from experience too because that's how
people learn and that's how uh you reach
superhuman capabilities.
Again the case for end to end is is
karma. This is a photo of last Comic-Con
two years ago. As you can see, not not a
lot of people in this photo. This was
this is the entire company and you get
to meet us all today. Uh this uh I think
is the entire company at KMA today. Yes.
Uh so yeah not a lot of people
end to end and general methods and the
bitter lesson in general is the reason
why a company like KMA exists is the
reason why we get to exist in a world
where other people are throwing money uh
from the window and labelers and things
like that while we are trying to solve
it in a principled way in a way that
scales with compute and data and
experience.
So thanks to the bitter lesson.
So enough general and philosophical
talk. Uh I'm going to uh dive into some
concrete concrete problems and concrete
examples of how these general methods
and these end to- end methods uh were
used and are used by comma uh to solve
some concrete problems. So I want to
start with driver monitoring. Uh DM
as we as we like to call it is how uh we
make sure that uh the driver in the car
is alert and not sleeping not using
their phone while the combat 3X is
driving while the ADA system is driving
because it's an L2 system. So we need
the driver the user to be alert and
ready to take over at all time.
Uh, I'm sorry to bring this up this
early
bad memories, but I want to start with
this and get this over with so that we
we get the bad memories out of the out
of the pictures out of the picture. Uh,
do you all remember 2020?
No. Tough year, right? Uh well we had
this thing called uh surgical masks and
u u face masks and suddenly people
started wearing masks all the time even
in their cars. We have Uber drivers and
things like that. So uh but that wasn't
that common right uh people weren't
wearing masks in the past in their cars
so face masks. So it's it was out of the
distribution of our the train data of
the DM models, the DM driving mo, the DM
uh machine learning models. Uh so we had
to fix that fast.
Uh everybody was locked down. We
couldn't, you know, bring labelers or
take photos of people and do do this,
you know, how people do it usually. Uh
so we had to uh to be a little a little
creative.
This is wishing is over there. Uh so you
know an easy way to do it is is to
create synthetic data uh procedurally
not using you know not not using an
artist not cing someone to to to paste a
mask on a on a face or not using
Photoshop. We're not uh hiring uh models
to to wear a mask and then take pictures
of them. No, we use our existing data
and we use some general methods, some
easy to implement general methods to
estimate the pose. This again was done
using a a machine learning model that
that's trained. Uh we're not using a
labeler to to give us the face pose. Uh
same thing with the landmark detection.
we kind of delineate where the face is
and then using these two information and
these two information these these two
sources of information plus a mask that
you can download from Google images
and then you just add the two images and
here you go you have a new data a new
data set of someone wearing a mask and
driving that's great
so uh again this example I like to bring
this one up because you could solve it
in a completely different way. If if you
didn't want to use a general method, you
would solve it probably by hiring an
artist, a Photoshop artist, or by hiring
some models or by trying to wait for
people to start wearing a mask and then
collect more data, but we had to act
fast. So, so we went we went the general
way and that worked out great. Another
example I'd like to uh to uh to bring up
this looks a little creepy here but uh
we we used to call this the eye shutter.
Uh the eyes shutter is well the the
models didn't didn't really detect when
people were closing their eyes that
well. So, and we didn't have a lot of
data of of eyes that were shut because
when you shut your eye, it's pretty fast
and then the data doesn't doesn't really
have that class balance we used to call.
Um, so again, you get the eyelid
landmarks uh using a neuronet network.
There's plenty of them online that you
can download or you can train your own.
Uh, and then using some simple
morphological operations, you can just
close the eye and there you go. you have
a photo of a of an eye that's closed
from a photo of an eye that's that's
open. And again, this is really a a
simple method general and that scales
with data and it's uh you just inflate
your data set very easily without trying
to call artists without without
Photoshop artists. For example, more
recently, there's these things called
VMs or uh vision language models that
you can you can give them a prompt and
an image and then they can interact with
you, right? So, um, with some very
little prompt engineering, you can put a
photo of someone driving and using their
phone and then say and then ask the VM,
uh, say yes if if the person is
distracted from driving because they're
using their phone and the VM knows
Adiv's using his phone.
Um, so yes, this is a more recent uh way
to deal with this and we're
experimenting with how to use larger and
and and uh more subsequent models uh
that are trained on tons and tons of
data to uh automatically label uh some
of our training training set
um which is what I like to call vibe
labeling.
That's a live photo of wishing over
there.
Uh so something more interesting about
DM is that uh we also know the future.
And that's the case also with our
driving data is that you know the
future. You know if someone is going to
take take over or not in the future you
know if they're going to override
the steering we call it override or you
take over. So if the person
uh took over in the future, that means
they were ready to take control, right?
Because they they did take control of
the future. Uh or let's say if they're
just sitting around uh in traffic,
usually you're not really aware of
what's happening around you when you're
in traffic. You can look at your phone,
you could look down, you can be
distracted. So the probability of you
being distracted or not ready to take
control when you're when you're sitting
stand still is generally higher. And
then the rest uh we don't we say we mask
it out. So it's obviously not just these
two cases that exist. There's tons and
tons of other cases. But you we can
label a small amount of our data using
these huristic data that comes from the
future or that comes from other sensors
around the car. and then the other stuff
we just don't care about it. Uh so even
with a really really small percentage of
of what this covers we can we can find
some interesting examples like the one
that I'm going to send you here. Uh I
don't know if you can see but this is a
a photo of me driving and am I ready to
take control? That's that's a
interesting question. Uh I mean I'm
looking at the road looks looks looks
looks normal
and yes I'm ready to take control
because in the future I did take
control. So that's
I did override. So that's a that's a
good example
in here. Am I ready to take control or
not? Obviously not. I'm looking down on
my at my phone. Um I don't look that
interested in what's happening around
me. Well, yes, because I'm a g I'm at a
gas station waiting for someone to come
come back to the car. So, in this case,
yes, I'm not ready to take take control.
Uh and uh and the reason why is because
I mean stand still. So, uh we we call
these end to- end labels and they cover
a really really small percentage of our
data, but it's u it's enough to to get
some really good signals and to get some
interesting samples as well from our
data set.
And uh yeah all this all this shipped by
wishing and maintained by wishing uh
which is over here. Uh so um
the idea is that you can ship and and
and and
create really good systems and uh uh
really reliable machine learning models
uh using a very very small team. If you
do, if you go the route of general
methods and if you don't get trapped
into this uh you know trap of of of of
needing more features or improving the
system using labelers and using u stuff
that doesn't really scale. So yes should
be maintained by wishing.
Next example is uh what we call lateral
control simulation.
Uh I forgot to ask who's here um is a
open pilot user, right? Oh, nice.
Uh who's heard about tuning?
Oh, okay. Cool. Yeah. So, what's what's
the deal with lateral control with
lateral control in general?
This is from uh a really nice forum uh
from our friends at Sunny Pilot which
are here and have a booth. So you guys
are welcome to go visit them. Uh this
model has been fantastic on my Hyundai
Kia Genesis angle steering car.
Finally drove this model and that long
both perform really good. Smooth turns
but some hugging but nothing too crazy.
I can't use this model because it hugs
death too much.
To me, this model is okay, but it kind
of turns too much and too quickly. I
don't like it
with my Toyota lateral is not good.
I actually thought this was a step up.
[snorts]
Yeah. So the thing is we support a lot
of cars. We support more than 300 car
models and every car and every model has
its own quirk and feature and uh uh
these quirks and features materialize in
similar lateral control. Um
so um
the idea is that we control the car most
of our some some of our cars using
torque. So you put in torque on the
steering wheel and then uh you observe a
lateral acceleration and the difficulty
is the predictability of this function.
How does this translate to that? And
that depends on so many things. That
depends on your car, your model, your
how your how how much your tires are
inflated, uh how the road is rolled, and
is it is the road wet? Is it not wet? Uh
is your steering rack old? How old is
it? So, it's really complex and it's a
really difficult thing to to to model.
And that's why you hear about things
like tuning, hugging, turn cutting, uh
things like, "Oh, this performed well on
my car." And then someone else says,
"Well, this didn't perform on my car."
Well, it's because of this, partly
because of this. Um, so how do we solve
this? Um, we could do this for every
car. We could have a Python file for
every car and then kind of try to like
hard code this using using some Python
code using some C++ code maybe
or we could just write this as a as a
big big big big problem big machine
learning problem. So you have your input
observations and then your input states
and then we're going to talk about we're
going to come back to a style of slides
that are like this a lot in this
presentation. So you have inputs that
are observations in time and states in
time and actions in time in the past you
know in in in your context and then what
you want to output is the next state.
What given these observations and given
what you observed and given some actions
you took what are you going to observe
next? And we all know the only way to
solve machine learning problems is using
the transformer architecture,
right? That's how we do it. It's how how
the cool kids do it.
What's a transformer? Uh I'm going to
talk not going to talk about it that
much today, but it's a stack of layers
that that
we just repeat a number of times and
then you get to repeat them a lot. And
the more the more you repeat them, the
more the bigger these layers become, the
more parameters or weights or weights
you end up with. And the bigger the
model you end up with. And that's how
you you here like, oh, this model's
three billion parameter, this model five
billion parameters. Well, these yeah,
it's essentially how many of these
layers do you have? And the transformer
uh not this one the the machine learning
architecture is trained to predict a set
of numbers shifted by one. So the
transformer takes a set of context
number and then shift them by one and
essentially tries to predict the future
which is really cool because that's what
we want to do, right? We have a set of
observations, a set of states and you
want to predict the next state. It's
great.
and it magically works.
The red line follows the green line or
the scan line. That's great. So yeah, we
train these big models using our data
sets. Um and they do predict whatever
we're interested in and that that that
is that is wonderful.
Now how do we use this? Uh, in the
autonomy team, we have this rule called
no testing in cars. It's inefficient.
You have to go down downstairs. You have
to start the car. Sometimes the car is
off. Sometimes you need to pull the
branch. Oh, wait. I didn't didn't have
the right key. Someone took the key. Oh,
uh, someone took the car. The car is in
the car wash. So, yeah, it's
inefficient. You don't want to do that.
So what this enables us to do is well
you can start with the segment that
let's say with the driving data that's
on a Toyota and then simulate as if it
was coming from a Hyundai or similar as
if it was coming from another car. Uh
and then you can see how the model
behaves using different cars using
different what we call noise models that
come from different platforms. Uh which
is really cool. So you can see like this
is a this is one segment that's
replayed. I think it was originally from
a Kia AV6 and then we changed the noise
model so that it will match uh a bolt or
it will match a Corolla which is really
cool. So you can just like swap the car
without going downstairs.
And this is shipped and maintained by
Casper and David. And they're over
there. They have a booth where you can
actually drive uh with a noise model
from which car? Oh, you can pick the
car. Yeah. So, you can actually drive
the drive using a joystick and observe
what the the model is living every day
is observing every day. Uh and uh it's a
really fun booth over there uh with the
the steering wheel and the TV. So you
can you can get to experience what the
model experiences
uh in real life.
All right. Now to uh driving models. Uh
so this is this is the model that drives
the car. This is the model that outputs
a desired curvature and desired
acceleration uh given given the the
camera views. And uh recently we wrote a
paper uh called learning to drive from a
world model. Um and it really um cements
ce really shows how we want to solve or
how we are currently solving the problem
of of uh training driving agents end to
end uh from experience.
This is uh from a screenshot from from
our blog post where we describe in large
details how we how we do this and I
encourage you to go check it out. It's
it's in our blog and you can also read
the paper you can look at the slides
even the talk is published uh and we
have a really nice interactive blog post
where you can click and play and kind of
interact with with the word model that
that we that we train.
What's a word model? Uh word model is
something that uh something of a of a
buzz word right now. Everybody's talking
about it like people are talking about
end to end. People are talking about
word models. Again, a word model is
something that is is a model that takes
in previous states, previous
observations and previous actions and
predicts what is the next state. what's
going to happen to the world that you're
observing given what happened in the
past and given an action. Uh, and it's
really important because some really
smart people are saying that it's
important.
That's it.
[snorts]
No, it's it's important because uh it
really allows us to interact with the
world and uh generate the these
experiences and give the opportunity to
opportunity to the model to interact
with the with the world without actually
interacting with the real world because
that would be expensive. You don't want
to put a a model that's not trained, put
in a car and then go to oh you know just
go go and try things and come back with
with some data and then do do some
gradient descent on that data and then
send the model back. You don't want
that. You want you want some kind of
simulator. You want some kind of world
model that enables you to do this in the
data center instead of the real world.
Um
so our world model is uh essentially two
models. Uh one of them is a model that
takes in the observations and uh
compresses them in what we call
a latent space or laten laten vector.
And uh this compression here is
important because we use that compressed
feature set uh as a as a set of
observations. And then the word model
which is a diffusion model uh is trained
to predict the next state trained to
predict the next latent vectors. And
there's some details about how these
models are trained train using the
latest tricks and the latest uh cool
stuff in machine learning which I'm not
going to go into uh much details today.
So if you're interested just go in the
paper and then you can read how all
these models are trained uh in in large
detail.
again inputs outputs a so input is the
states uh it's the the camera
essentially the camera for the camera
feed fcam and the ecam uh the action is
uh what we call the pose or the position
update which is a a vector of you know
translation and rotation a six degrees
of freedom input and then the output of
this model is uh also So what is the
next frame? So what's the what's the
word going to look like given the past
the action uh action that I took? What's
the word going to look like after that?
So things move around you you move
around. So it should predict uh it
should predict that accurately. But also
we want this world model to tell us
something about about driving not just
the world because this is uh this is a
very special type of model. This is what
we call action world model. Uh we are
asking the world model to also tell us
how to drive in this world. How to drive
in this future world that I'm going to
to to to imaginate. What is the best
path? what is the best curvature and
what is the best acceleration to take
given what you did in the past and given
what you what the future is going to
look like. So this is a special type of
model uh it's future anchored uh to kind
of uh give it some more recovery
pressure uh and again all the details of
why we do this and how we do this are in
the paper. So I encourage you to go
check that out. So we use these world
models as a simulator. Again, same I've
said this before. You get past frames
and you get an action in the past. You
get an action uh and then the driving
simulator the the word model predicts
what is the next frame and also what is
the next action. You can use this next
action as you want. You can use it as
ground truth to train a different models
which is what we do or you can just use
it feed it back into itself and do it
auto reggressively to uh kind of like do
a roll out a roll out of of a
simulation.
Um and
these models are great. They scale with
data as you can see. Lips is uh is a
metric of how good the image looks like.
So the the lower the LPIPS the better.
So yes more more more more more layers a
better model or bigger data set better
model which is what we want. Great. Rich
Sutton's happy.
Also this model is very this is a very
important thing to us. And when when you
train a model that wants to drive the
drive a car you want it to be physically
accurate. You want it to, if you ask it
to move 0.5 meters to the right, you
need it to actually move 0.5 meters to
the right, not 25. Uh, you don't want to
wing this, right? This is driving. This
is serious stuff. When you're doing a a
video game and you move it, you you ask
the the player to move a little bit to
the right. You don't really care how
much you move to the right, right? But
in driving, you really need to be
physically accurate. So we have this
benchmark test that uh starts in the
lane center and then ask ask the model
to move to the right and then you know
exactly how much you can you how much
the model moved using a different model.
So you can you can check whether the
model is physically accurate and with a
lot of care with a lot of care about how
you train and and use these models you
can make them physically accurate.
Also
they generalize out of distribution
which is pretty cool. Look at this crazy
swerve.
Wow. I hope no one did this in our data
set.
I think no one did this. You all are
very responsible.
So yeah, as you can see, uh we really
ask it to go very very far off the road
on on the shoulder and it it responds to
that pretty accurately. So uh we say
that it generalizes our our
distribution.
And if this plays, yes, this is a very
long video. So I'm not going to make you
watch eight minute of rollouts, what we
call rollouts, but this is essentially
uh uh how the world model, how the the
simulated videos look like. Um yeah, as
you can see, uh all these videos are
simulated. They're not real. The top one
is uh the frame that comes from the
narrow view camera. We call it the FCAM.
And the bottom frame is one that's
generated. It's it's also simulated and
it comes from the wide angle camera. So
you can also see how u consistent the
views are and how the movement looks
looks consistent between these two these
two frames. They're generated by the
same model. It's one model that
generates both frames in one shot. So
you can see how consistent they are. And
there's a little installation over there
in the TV where you can see this uh loop
around with some fun captions that we we
all wrote before every video. So uh I'm
not going to make you watch all this
now. If you if you if you want to see
some examples, they're in the TV back
there near near the coffee stand.
Um
yeah,
and we use this model. You use this
world model that generates simulated
worlds and simulated environments to
train on policy and to gener generate
experiences. And we described this in
our in our paper. Uh and essentially
that's how I that's what I said uh
earlier. We start with pass frames with
an action. the driving simulator, the
word model uh gives us a next frame and
the next action. We use the next frame
to feed it back in and we use this
action that the word model tells us,
hey, this is what I recommend you to do.
We use this to as ground truth for a
different model that we call the policy.
And that is our ground truth. We use it
to uh train train the policy and then we
do this over and over again. the policy
uh gets better and better at driving u
and that's how we ship the models right
now in open pilot
no secrets
this is a very just a little fancier way
to describe what I just said
and uh shift maintain by Harold Armon
and myself and journey other people from
the autonomy team so
uh yeah that was the driving Oh,
now this translates uh really easily to
other types of of robotics problems. So,
driving is a robotic problem. It's a
very simple robotics problem where you
know you just actuate using two numbers
curvature or torque and acceleration.
Uh but things can get a little messy uh
for general autonomy.
Do you all know Billy? Who don't who
knows Billy here? Oh, cool. A few a few
fans. Billy Billy is our friend. Uh, a
comma body. Um, comma body is uh looks
like this. It's a it's a comma 3x on a
stick on a hoverboard. Uh, and it's it's
a it's a robot.
So, we use the same approach that I just
described for driving. We used it uh for
general indoor navigation types of
problems. So the goal is uh well you
need to make Billy roam around the
office, avoid objects and if uh it hits
an object or if it gets stuck it needs
to recover autonomously
uh and avoid collusions obviously. So
we open sourced a data set of indoor
navigation using using the comma body
using Billy uh in uh in our office. So
it's uh it's a few gigabytes of of uh
driving around of of roaming around the
office. It's open source
and the the problem here simple. You
have uh inputs observations of of of
camera inputs and then you can also look
at the wheel speeds. That's also nice to
have. And the actions are what the WD
with the wasd inputs for the gamers. The
gamers right here. Uh and then the
output is again what's the next frame
going to look like? What's the world
going to look like given this past
observations and action and also what's
the next action that that you should
take.
So, as you can see,
this kind of works.
It recovers.
This is our kitchen.
This is the open pilot lounge. So, you
can see it kind of moves around,
bumps into people,
tries to recover. Here you go. It backs
up. So, this is all end to end. This is
a model that that that is trained to
predict the future and to predict uh the
next action and recovers.
So this is a short way to show you how
these kind of approaches that don't
really hardcode things. I don't know if
if I said this, but I probably said this
in a previous presentation is that there
in no way in no place in our code you
you will find traffic lights or cone
only in our tests. Some some of our
tests kind of like
tries to find segments with or data with
cones and see interesting ways to to
evaluate the model. But in our training
code, we don't really hardcode anything
about driving. Everything is learned by
this model. So all the behavior, all the
driving is done implicitly. We don't
hardcode anything. We don't hardcode
lane lines. We don't hard code any of
that. So if we just put that to just
swap the data set, swap it with a data
set of of indoor navigation and a robot,
it just magically works. So again,
general methods uh work and generalize
to to different kinds of problems, which
is great.
Uh and also we open source this model.
Yeah, this model is open source. So if
you have a a comma body, you could just
try it out at home and see if it avoids
your your coffee machine or see if it
avoids your your fancy
uh couch.
Now, can you do this for input for
manipulation? So this is an SO ARM 100.
It's an open source kind of uh 3D
printed arm. Uh and uh yeah, same thing.
We we tried to do this. We open source a
data set of uh of uh something that I
like to call the coffee test which is
just grabbing a coffee pod a curig a
curic pod and then put it in this little
tray and you can train a model. I didn't
do this but you can train a model uh
using this data set and to u do this
autonomously using the arm.
Okay. Uh, and this was shipped and
maintained by Armon, which is also here,
Casper and myself.
And, uh, while I'm here, I would like to
advertise something that we haven't uh,
published yet, but we will do very, very
soon. And I know you guys are like
compression a lot. I I don't know why
people love compression. So, we're doing
a new compression challenge. We've done
one in the past that we call the Comma
VQ challenge. Uh this is called the
Combat 2K19 compression challenge and
it's essentially uh a new style of of
compression problem. Um so stay tuned
for that. It's going to be a very fun
challenge for for everyone who likes to
likes to do some some coding likes to do
some challenges. So the idea is to
compress videos
uh make make the video size small uh but
uh with with a very different goal of
not making the image look good but
actually preserving semantic content and
temporal dynamics. That's it. You can
make the image look as bad as you want,
but as long as when you put that image
into a segment or into a poset, it
predicts the right stuff. So you could
do whatever you want to that image as as
long as the segmentation model and the
pose model is fooled by your
compression, you're good to go. And the
cool thing with this ch is that we open
source the segnet that we use. So it's
going to be open sourced. And we also
open source a net. So, uh, it's going to
come very soon. Uh, stay tuned. So,
yeah, we're open sourcing all this, uh,
for for the challenge and you get to
play a little bit with with, uh, with
the compression and plot things like
rate distortion curves and do sciency
stuff if you want. Uh so yeah, stay
tuned for the Comma 2K compression
challenge
and also stick around for more talks
about autonomy and research and machine
learning. Uh Harold's going to talk
later about how we bootstrap very useful
robots today. Uh and Mitchell is going
to talk about building a million mile
data set.
Any questions?
>> Thank you, Yasine. All right. Amazing.
>> [applause]
>> We're going to take some questions from
the audience. Do I have any questions?
Hands raised.
>> Um, how do you evaluate your world
model? I mean, you must be getting
better every day. Like, how do you
evaluate what you're getting better on?
>> Yes. So, we have we have tests for the
world model. Uh, we we described that a
lot in the paper, but in general, what
you care about is image quality.
how how well the image looks like as as
output for the word model, how good the
video is, not just the image because we
do this autogressively. So you want the
word model to generate good videos, not
just good images. Uh so that's the f the
the two first things. And then you also
want the vid the word model to be
physically accurate. So we have this
other part of you control the word model
using some fake actions and then you see
how well the word model responds to
those fake actions. So we have these
these dual kind of word model
evaluation.
>> All right, more questions.
>> Hi. So I assume that your world model is
stereo uh and temporally consistent
because I think it has to be to be
useful. But uh you guys use two
mismatched sensors and lenses. So I
guess my question would be how much of
that is uh I guess generalizable if you
wanted to change the sensor or lens in a
future uh comet device. How much of your
your model could be reused and how much
of it would you just have to uh remake
from scratch?
>> Yes, that's a very good question. So
yeah, some of some of the I mean most of
the models will need to be retrained if
you add a new sensor. Uh but we also do
uh some kind of pre-training of the word
model that is independent on the number
of sensors for example things like that.
So or or like the the temporal context
or how big the temporal context is. So
there are things that we can change in
our architecture today that don't
require retraining everything but yeah
adding a new sensor adding a new
observation vector to the state will
need yeah retraining which is fine.
Another question.
>> Hey, uh did you have a version of
experiment where you're not where the
world model is just predicting the
actions and not necessarily the visual
cues? And does it really help to have
both the visual cues and the actions
predicted together?
Uh the short answer is yes, it does
help. Yeah. Uh so we you can train a
model that doesn't even input the the
the the im the images, right? And it
only outputs uh only outputs the the
future actions. But yes, uh outputting
the the the images and the actions makes
the model more more
accurate and it it generally makes it
more intelligent basically.
>> Yes,
>> we can take a few more questions. Any
more questions for you scene?
>> So is the next frame prediction also
happening during inference on device or
is that just to train a world model for
okay for pre-training I guess.
>> Yes. So the the next frame prediction is
not done on device. It's in the back end
uh and we we use it just to to train the
policy model which is a much smaller
model. Uh and you can see this as a
little model, small model that plays in
this inside the dreams of this bigger
model, the world model uh and gets
distilled, learns a little bit from the
big model and then that's the that's the
the policy model is what we shipped.
>> And that one does not predict the next
frame. Yeah. Only predicts the next
action.
>> Thank you.
>> Any more questions?
uh when you were using visual language
model to determine if person has a phone
or not, how accurate was it? For
example, a person had a hat or didn't
have anything.
>> Uh yes. So we we used it in a very
specific case where it was very easy to
label because it was just asking about a
phone whether a phone was in the frame
or not. It was pretty accurate uh from
from what I recall. Uh because you can
see the phone in the frame, it's pretty
easy to to see. Uh some people do have
some uh very uh creative ways to hide
their phones. Uh but uh as long as you
can see it, the the VM usually sees it
pretty easily. But yeah, you have to be
careful with with the prompt with the
question that you ask. Like the the
question that we asked in this case was
very simple was about was there a phone
usage or not? But if you ask it for
example, is the person looking at the
road? Well,
I don't know. Is it the road that
they're looking at or is it the dash or
is it the steering wheel? You don't
really know. So the the the vis the VMs
doesn't know these kind of things. But
for phone usage or I think sleeping
detection as well, the these visual
language models would do very well.
Thank you.
>> We'll take one more question.
>> Thank you. Uh um you mentioned you have
this world model that is predicting the
action but then you're kind of doing
some like pseudo distillation with this
on policy smaller model. So I assume the
bigger model would benefit from data of
all cars but then you can distill uh
according to each separate car that um
you want to deploy on. So the smaller
model would only see data from that
specific car model.
>> Mhm. Uh is that the case?
>> We could do that. We don't do that. U
>> then what's the benefit of like
retraining an on policy model? Is it
just for inference speed reasons?
>> Well, the the first reason is that the
word model is not causal
by not causal means that it needs the
future. That's what I wrote in my slide
called the future anchoring. So the word
model cannot be shipped on device for
this first reason. This very fundamental
reason is that you you don't know the
future when you drive. So you need to
distill it into a causal model which is
which doesn't know the future and can
act. Uh so that's the first reason. The
second reason is yeah it's too big. So
even if we had a causal model we would
not be able to ship it on a device. So
we still need to distill it in a smaller
model. Uh and why we don't do this for
every car? Well, it doesn't really make
sense. You you want a policy model to
know how to drive in general. This is
not a car specific problem. This is a a
driving understanding of the scene
problem. So, the car the the policy
should be really independent and should
be robust to these different types of of
cars and makes and models and then the
controls is what deals with uh the
differences. So yeah,
>> there was there was one last question.
>> One more question.
>> Yeah.
>> Would having more real world data uh as
opposed to synthetic data improve model
qual quality? And is there a way to
assess that? Did you do that?
>> Yeah. So we the the word model benefits
from real world data. Yes. The more real
world data that you train it with, the
better the word model is and then use
that word model to generate synthetic
data for the policy. Yes. So real world
data is still very very useful because
we use it to train these water models
that are very very big and very data
hungry. So yeah definitely
>> thank you so much Jine.
>> Thanks [applause]
we'll be able to take more questions
after all the talks. We'll have a Q&A
with all of the teams. So you'll have
the whole autonomy team on the stage. So
if you have burning questions, you can
keep those for later.
your first project. You shipped some
other stuff before that.
>> Yeah.
>> And 010.
>> I was supposed to disc
see why people like this
>> check. It's working on X for the first
time.
>> It says zero people. I think it's really
buggy if you streamed it too.
>> Mhm.
>> Let's see. Oh, live. Okay.
>> Whoa. Something is working.
Let's add link to ComicCon so people
know where to buy tickets.
November,
get your ticket.
>> Howdy, Mlan.
>> Are comments showing up here?
>> Oh, they're really tiny.
>> Yeah. Yeah.
>> If we open here, do we see them? We
should.
>> Oh, maybe once they It's a tiny bit.
>> Oh, it's tiny here, too.
>> Okay. Mr. Mlan, hello.
>> Everybody here know what Comic Con is?
>> Yeah. Sorry, guys. The comments are
there.
>> You're here.
>> Uh, we should once a few more people are
here, we'll introduce ourselves, too.
>> I'm sure the new format will be cool.
>> Yeah. Yeah. This year's a new format. Y
>> um last two ComicCons were uh pretty
similar. Really cool formats. some of
the nicest stuff this company has ever
done. Um, but we're trying something new
this year. Um, love this this guy here.
>> Hello.
>> This is Nick. He's our new designer.
>> Yeah, I'm with the uh arts and crafts
department.
>> Our growing arts and crafts department
here.
>> Um, maybe the first little tweak people
Well, I don't know how many people are
in here, so maybe I'll say this again.
First little thing people have seen is
the the new blog post title. You'll see
smaller things here and there ekking in
as more and more art comes out of uh my
department here at this company.
>> Let's split so we can see YouTube and uh
>> Oh, great.
>> Yeah, we can see both. Howdy, fellas.
>> I think some of them that was YouTube.
>> Okay, but yeah, we want to just hype up
the schedule a little bit. We finalized
the Comic-Con schedule. Um there's also
the new thing in the in this Comic- Con
with the booths.
>> Um I've already got an idea for the next
one. I want to have like a Candyland
setup for all the forks. Hopefully
there's some cooler forks and higher
variance forks. Uh but you can imagine
like Candyland with all the forks and
you can go between the forks. You go to
Sunonny Pilot, then you can do a
historical one. You can go to Shane
Pilot. Fortunately, Shane Pilot is just
open pilot now.
>> Um
>> that's why you have Endog.
>> Um
>> yeah. No, we got a I don't know. We got
a lot of fun moves planned. We got a lot
of fun moves planned. Like very
hands-on.
>> What's Comic-Con? So you don't know what
Comic-Con? I'm glad we stream to X. Um
Comic- Con is November 8th. It's uh all
things comma.
>> Uh so we're going to talk about how we
train our models.
>> Um how comma is still around 10 years
later um in the self-driving game, you
know. Um Cruz is out. Who else? It's
just like, you know, you had you had the
serious commas like
>> uh I forget their name. Ghost. Um they
changed their name a couple times.
>> Yeah.
>> So you forget. Um
but yeah, we'll tell you how commas
around. George will talk about that. Um,
we got something tiny coming. Um, so we
got cool announcement. Um, if you've
been paying attention, you might know
what it is. Um,
Shane and Maxim are going to talk about
Open Pilot and how complexity goes down
in Open Pilot over time. Just like some
general software vibes.
>> Uh, our hardware team will talk about
how we go from a concept to like a full
product. Um,
>> basically we're just going to tell you
all the secrets. Um, we don't really
have secrets normally, but uh, it takes
a lot of effort to like communicate all
this stuff. Yeah.
>> So, um, not secrets by design, secrets
for lack of time. And Comic- Con is that
time every two years where we tell you
all our secrets.
>> Um,
>> yeah, it's the big rush around the
office to get all the slides put
together, get all the information out.
It's like, hey, you got to share what
you did over two years in, you know, 30
minutes.
>> Yeah. Um, we have some new speakers this
year, some old speakers. Um,
but yeah, Comic-Con, it's the day for
all things comma. If you just want like
an audits robotics event, you're tired
of all the you saw the figure 03. You
saw uh you know, I mean, Whimos are
cool. Whimos are cool now. Um it's like
a real service you can take. I've taken
many Whimos. It's a pretty cool
experience.
>> Um but yeah, if you're you see the same
thing playing out at humanoid robots,
you saw self-driving cars and you're
like, "Okay, or where was my
self-driving car? We didn't even finish
that one." Comic Con's out for you. Um
am ready for the comma 4 announcement.
Why do you think there's a comma 4? What
do you want to do? Yeah. You want
Candyland? J wants Candyland.
>> I thought that was the ComicCon
announcement. I was like, that's it's
been announced.
>> Uh, we're going to have a comic petting
zoo, though. Um, the booths are still
evolving a bit. Uh, Nick's working
really hard on the comic petting zoo.
Um,
>> we might have a some sim booth as well
potentially.
>> Oh, oh, that booth.
>> I don't want to sell it too much.
>> No, no, I want to sell that one.
>> The more we sell it, the more they'll
have to do.
>> All right. We're going to have a racing
sim. We're going to have Oh, we're going
to have so many booths. I'm
>> all right. I think we have enough people
though to talk about Yeah, we got 258 on
X.
>> Wow. Are are the X numbers fake? Are
they like
>> Are they bots?
>> Yeah, we got 180 bots in here.
>> We get to P. No, no, no, no. We got
We're going to have common bodies. Um we
have some pandas in a corner or
something. But uh have some common
bodies you get to play with. Maybe you
can adopt one um if you really form a
connection with it. Oh
>> yeah,
>> we're going to have plants, green spaces
all around. Nice and
>> it'll be a more organic feeling event.
You know, it's uh you know, open house's
getting more organic, getting more
human.
>> Yeah. I feel like you're going to the
park and looking through all the all the
common stuff.
>> Yeah.
>> Little comma park.
>> All right. Is it time to go over the
schedule? Is everybody ready? Everybody
ready for the schedule?
>> Mhm.
>> Can you show us some of these secret
stuff regarding the No. No. The secret
started. Okay. So, as soon as we start
Comic-Con, we were talking about ML Sim.
We're telling you all about all the
things. Then the secrets start and now
we're going to we'll reveal them all. Um
>> Exactly. Don't Don't spoil it for
yourself, guys.
>> All right. We can uh pull Well,
>> let's
All right. I can make the phone a little
bigger, too. Yeah. Okay. You want to
show this?
>> 24.
>> Oh, there more combos.
>> Yeah.
>> Oh, no. Same. Oh, we have top chat and
live chat. We want all of them.
>> I'm ready for the comma 4 candyland.
>> Um,
oh, there is one secret that's for the
stream, so don't tell anybody. Um, but
discount code stream 50 just for today
gets you 50% off a ticket. Even a VIP
ticket if you want to
>> buy a VIP ticket. I'm sure VIP is
actually are they 2,000 or 1,000. So, if
you want to be a VIP for only $9.99 for
the same price as a 3x stream 50. Uh,
that's no spaces. So, that's this stream
secret. So, don't tell anybody. Sh.
>> The VIPs get a fancy badge.
>> Uh, is they also got the cool bag. The
drawstring bag is really cool. Yeah.
>> And I heard I just learned we're not
giving it to everybody because it's too
expensive.
>> Um, you know, we got to run a profitable
event.
>> Mhm.
>> Whoa. Don't post it. Don't post it.
>> Whoa, whoa, whoa.
>> Wait, wait. I got to delete that.
>> Whoa. Is your primary moderator
speaking, Eric?
Stream 50.
All right. Um, but yeah, you can uh
enter code stream 50 at the checkout.
Um, it'll give you 50% off either a
general admission or a VIP ticket. Only
for today though at 11:55 I think
Pacific. The settings weren't clear in
the site. It might be regional. I don't
know. Um, so just to be safe, get your
ticket now.
>> That's true. There was a lot of flak
about the first Comic-Con announcement
post. was just like, "What time zone is
it in?
>> What time zone is everything happening
in?"
>> Well, we're we're in Pacific, so we're
in San Diego, so I I guess uh probably
Pacific time.
It's all good. All right, I think we're
ready to go over. Uh you want the
camera? You just intuitive, right?
>> Cool. I
>> All right.
So, Comic-Con is uh going to be on
Saturday, November 8th. That's like 16
days from now, 10:00 a.m. to 6:00 p.m.
And then, yeah, we got 10:00 a.m. Doors
open. Chill. We'll get you some coffee.
Um Nick was just working on the coffee
designs. Then we got some cool stuff
there. Um 10:30, Harold will get on
stage, welcome everybody to the event,
and then uh Maxim and Shane will be
talking about Open Pilot in general. And
uh so for those of you who don't know,
Maxim and Shane are the open pilot team
here. Um Shane primarily works on Open
DBC, all the car stuff. Um and then
Maxim works on a whole lot of system
stuff. Um basically everything else
required to get you Open Pilot shipped
to you. Um and those two guys are the
primary ones who work on uh all the
software outside the autonomy team.
>> Uh you know, my desk is in their office,
too.
>> Yeah, Nick's in the office. Nick's uh
providing moral support there.
>> Yeah.
>> Uh
>> tells you which color to use.
arts and crafts department is pulling
their way.
>> We got some nice new lighting in the
office.
>> Uh
oh, I see some general questions. We
we'll get to after the schedule, so feel
free to keep posting this. Um
so yeah, their talk is called fighting
complexity. Um and they're just
basically going to talk about in a
project like Open Pilot, you want it to
get more capable over time. Um but you
don't want necessarily want to trade off
that capability for complexity. Um, and
it's really important in Open Pilot that
complexity keeps going down over time.
Um, they just merged a really big win,
too. Uh, if I go to Twitter, I'll just
give you guys a little preview.
We just deleted QT and Weston. Um, and
I'm really excited about this one. Like,
somebody just posted the 3X is like
beautiful and belongs to the museum.
We're trying to make the internals even
more beautiful.
>> Oh, yeah. Um, so you could see like even
with our new graphics stack, we merged
this massive red diff and it means you
get to actually drive bigger models
because we made the UI better. Um, so
they're going to be talking about stuff
like that. They're going to dive into
some like concrete examples of stuff
they've shipped. Um, and it should be a
really great talk. Maxim said he's been
practicing all weekend. Um,
so after that they're also two new
speakers, which is cool. Um, they
haven't spoken at any of the previous
Comic- Cons. Um, so they've been around
for a while. Maxine was an intern. um a
couple summers in a row and then Shane's
been here for quite a while. He was here
for uh he started right before the comma
3 launch I believe. Um then Eucene will
talk about um just general ML at comma.
His talk is called look mono labels. Um
he's our head of ML here. Um and he'll
talk about everything from DM to the
driving models and the models we use to
train those models. Um so anything
general ML? Oh, you seen we're just
talking about your talk.
>> You want to show for it a little bit?
Oh, you guys are live.
>> Yeah. Yeah, we're live.
>> We got a lot of viewers on Twitter. We
got 500 viewers.
>> What serendipitous timing?
>> I'm here for a delivery for
>> Don't dox us.
>> And
>> wa
>> I just got the nothing headphones.
>> Wow.
>> So that I not wearing these all the
time.
>> Oh,
>> we were just talking about your talk
actually.
>> Oh, so my talk is going to be a lot of
uh new stuff. Uh I'm going to talk about
essentially the word model that we're
using the simulator for driving. But not
just that, we've been adopting this
strategy in multiple parts of our stack.
Not just a driving model, but also
controls. So now we have a simulator for
controls that's that's also a GPT and we
use that for testing. And uh we also
have uh some fun things that we do uh in
driver monitoring that's not using a
simulator in this case, but that's using
uh some big open source models to uh to
do some ground truthing that's uh that's
not relying on a on a uh on a human
labeler but more of a like a big model
that auto labels the data. So
essentially the talk is is called is
called lukuma node labels but it's yeah
it's uh it's the general approach of how
uh we uh we make our training stack uh
more scalable with data uh and that
doesn't need human labelers and that
doesn't need expensive stuff to train uh
and uh the the focus obviously is going
to be a lot of MLS sim and uh uh the
other two is is like small little
nuggets of how we adopted the MLSim
strategy in in other approach in other
problems controls DM and possibly the
body as well. We've done that. We've
done some some simulation with the body.
Yep. So that's my talk and I'm excited
to try to try another
>> I think you undersold the one of the
coolest parts of your talk. I remember
before we shipped MLS, you you and
Harold were like, "Ah, we'll just we
give the CVPR talk, but there's been so
many updates since CVPR."
>> Oh, yeah.
>> That we like just can't do that anymore.
It's cool. We get to like We gave the
CVPR talk in June, and there's so many
other things to talk about since then.
>> Exactly. I mean, we can basically write
a new paper because the the architecture
now is is very different than the
architecture that we described in CVPR.
Uh it's much more robust. uh uh the
improve we've improved a lot of things
that we uh reported on already in CVPR
by multiple orders of magnitude. Uh we
made the models bigger. We made the data
set bigger. Uh yeah, we started first by
saying that we're just going to you know
stream the CVPR talk, but no, it's uh
especially in the driving driving model
part, it's it's a lot of new stuff. Uh
so don't come expecting just a rehash of
CVPR which is available by the way in
our blog post. You can uh watch.
>> Oh, but is the talk recorded?
>> Yeah, the talk is recorded and
available.
>> I didn't know that.
>> Yes. Uh you can see I think it's exactly
the same point of of view. You can see
like my double chin.
Uh
>> what double chin? Come on.
>> Uh but yeah, it's going to be a lot of
fun. Uh a lot of cool videos. I'm going
to have an art installation
uh of MLSim. Uh a lot of uh cool stuff.
Come come say hi and come see the future
of self.
>> You want to remind them of our secret
discount code for the stream? Stream 50.
>> Stream 50.
>> It even gets you 50% off a VIP ticket.
>> Is it an affiliate link? Do I get
>> No, no, no. It's not an affiliate link.
>> Oh, can I have an affiliate link?
>> No, no affiliate link.
>> All right. See you guys. CSTVPN.
See you. See you guys at ComicCon.
>> All right, that was very serendipitous.
We'll see if everybody walks in as their
talk uh comes up here.
>> Comes up. Exactly.
>> People over.
>> Actually, that's not a bad idea. Oh,
next one is George, so that doesn't
work. Harold's also out today. Uh but uh
let's see. There's a couple questions um
we can get to before we get back to the
schedule.
Uh make a secret announcement. We won't
say anything. Extreme 50 was your secret
announcement. We actually have that
lined up for you guys. Uh another two
weeks a waiting. A little more than two
weeks. Uh we still need a little more
time to prep everything. Um
who is the guy next to Adid? He's the
head of arts and crafts. Yeah. Yeah.
Jacob knows what's up.
>> Head of arts and crafts. You'll see the
arts and crafts more and more. Um
>> ComicCon's first big project. We have We
Oh, let me launch uh I can show them the
010 UI. Oh,
>> sure. Yeah. Yeah, that's true.
It's some very very minor quality of
life tweaks. Um I had the pleasure of
finding out that every single dark gray
was a different slightly different shade
of dark gray for some reason. So
>> So this is the new 0101 UI shipping in
the release. Uh I think it should go out
tomorrow. Um so you notice the corner is
a little rounded. This is black now.
>> Yeah.
>> Uh I think these grays are all the same
now.
>> Yep. Yep. Yep.
>> The grays are all the same.
>> Um cleaning up basically. And this is
all on Rayb total rewrite. Um, thanks to
Dean Lee to a very large extent. Um, and
just to give you guys a reminder of uh
those beautiful model timings, this
literally allows you to run bigger
models on your device. Um, this
refactor, not the design. The design is
just an extra extra little thing here,
but this is the old UI from everything
before this release. And then these two
are the blue is what actually shipped in
this release. And then because it's two
distinct changes, um, Weston got
deleted, but you can run the new UI in
Weston and that's what this orange thing
is. Um, so the diff here is that it's
running as a single process instead of
two processes. Like it hands off the
buffer and then there's some there's
like a compositor and there's all this
extra step. Um, and now it's just single
process. So the whole graphics runs as
one process. Um, and then pretty soon
we'll cut it out of the GPU entirely and
this distribution should shift even
more. Um, and then there'll be no
difference. Like if there was no UI
running, the distribution would be like
it' probably be closer to like 21. Um so
there's one more update coming, but you
already get this big big improvement. Um
it's just improvements all around. So
Maxim and Shane will be talking a whole
lot about that. Um but yeah, this little
round of corners um and Comic- Con is
what uh you can recognize Nick for right
now.
>> Um
>> you know, it ain't much, but it's honest
work. That's how they say, right?
>> All right, let's go back to the
schedule. Oops.
>> Uh, my talk is a little bit of secret,
so we'll go past that one. Uh, we got
lunch. Um, we tried to get the In-N-Out
truck. Uh, didn't quite happen. Uh,
In-N-Out is apparently very, very busy.
Um, but we got some good food instead.
We got barbecue. Um, so we got some
awesome barbecue for lunch. And then,
uh, George will be talking, uh,
basically'll be talking about like, you
know, it's been 10 years. How's commas
still around? Um, and you know, when is
the stuff going to actually work?
Like there's FSD unsupervised. It seems
like there's been a lot of progress in
the industry. Um, but, uh, a lot of that
progress you see is is basically just
moving the driver out to some like
remote call centerish thing. Um, which
isn't really a self-driving car, uh, as
we all know. So, he'll be talking about,
you know, where where we kind of go from
here. Um, then we got Harold is our CTO.
Um he'll talk about how we basically got
to a 3X. Um he'll talk a little bit
about the comma body. Um and how we take
these like active research subjects,
turn them into products, um and how we
like kind of follow that gradient of
improvement because it is pretty
distinct um how we do it versus other
companies.
Um Mitchell will be talking about
Mitchell's here. He can actually pop in
here. But uh
should we go Mitchell? Should we go see
if uh want to? Yeah, let's go to
Mitchell. No, maybe not. Mitchell's
probably busy right now. He might be in
the data center. Um,
so Mitchell will be talking about how
we've been scaling up the data. So until
recently, we've been just training um
all the open pipe models on a pretty
static data set. The size has been
completely static for many many years
from way before even the first like yeah
from like five plus years ago I think.
Uh we've been trading on like 500,000
segments which is 500,000 minutes of
driving.
And uh recently we've been really
focused on scaling up the data. So the
latest open pilot models are trained on
two and a half million. So that's 5x
more. And that was the first increase.
Um and now we're working on training on
10 million. Um we've massively scaled up
data collection. And uh now we're trying
to speed up the rest of the
infrastructure such that we can easily
train on that 10 million like we're
training on the 500k back in the day. Um
because training on that 2 and a half
million that 5x increase um because of
all the improvements we've done it feels
just like the 500k. Um, so Mitchell will
be talking about how we scale all that
stuff up. Uh, then we got Robo. His talk
is called from concept to
so Robo's one of the hardware engineers
here. Um, he'll just walk you through
like what the development cycle of new
hardware looks like at comma and he'll
talk about like the SMT line we have,
how we do production. Um,
Rob and I just went to Shenzhen and uh,
we learned a whole bunch of stuff. So
today uh today and tomorrow all of
production team is uh refactoring the
factory um using all the learnings from
the Aranzhen trip. So um yeah Ro will be
talking about hardware. Um he's the only
hardware representative besides uh me
and I won't be talking like super
directly about hardware. So if you have
any hardware questions just post them on
Twitter. He'll uh answer your questions.
There's a lot to cover there. And then
uh after that we'll have a Q&A with the
whole team. So, all like 30 of us will
get on stage and we'll answer any
question you have. Um,
basically nothing's off limits. Um,
then we have a little happy hour.
That'll be the time to explore the
booths. Um, so the booths are something
new we're trying this year. So, the
first booth will be pretty cool. Um,
once again, I'll pull up like a picture
of like a racing setup. Yeah. To inspire
that
sim racing.
>> So, we want to get something like this.
Um
yeah so imagine this and then you can
pick any open pilot car any car from uh
comma AI/vehicles
you pick like let's say the Ford
Expedition 2023 and it'll simulate the
exact like API that open pilot has to
the car and you can input exactly where
open pilot inputs and try to drive as
that car in our simulator. Um, and then
we can also do some stuff like you can
drive around in the old simulator and
it'll give you a really intuitive feel
for all the problems in the simulator.
Um, so I think the way we talk about
tiny sim and LLM, sometimes it seems a
bit abstract, but as soon as you you
just watch a video of the simulator, you
see it starts to deviate. You're like,
why does it look so crappy? And you see
it reset and you're like, wait, the
model sees us at train time and you get
like a really intuitive understanding of
the problems as soon as you spend like
if you watch a little video or if you
just you're driving like a little racing
setup. Um so this is a booth designed to
give you some sympathy um for a pilot.
Um you can understand some of the
problems that we work on. These are like
the real core problems we work on every
day. Um simulation controls. Um
yeah. So that's what that booth will be
about. It's like kind of like a real
life controls challenge. That's another
way to think about it.
So I don't know who's excited for that
one. Maybe it would be cool if we could
make that kind of like a web experience.
Like you can plug in like a like a
steering wheel or something. You go to
drivemycar.com. We own drivemycar.tday.
Be super cool if anybody wants. We have
like no bandwidth to build cool stuff
like this. But uh you know if that
sounds like something fun uh I don't
know. I guess I could make a bounty for
that. I'd be down to make a bounty for
that. That would just be so cool. Um
yeah. Let's go through the next one.
>> Oh, this one we we were talking about at
lunch. I think we I think we have a
idea. We want some kind of uh so the we
want a booth for our production team.
Our production team builds all the three
X's. So we got a new idea for this
booth. Uh you guys can tell us if you
prefer this idea or the new one. So
we'll go over the first one.
>> Um so basically we designed the Comma 3
that launched at the first Comic-Con in
2021. And the Comma 3 is cool. It had a
lot of fun stuff. Um it was our first
product we designed from scratch. But
you know you put like a gaming NVME in
it. You put all this crazy stuff. Um,
and then you end up with something that
is like not easy to build cuz you didn't
think about how to build it until it was
time like, "All right, Comic-Con
happened. We got to start, we got some
orders, we got to build them." And
they're like, "Oh, okay. These are kind
of hard to build. It's a pain in the
ass. You got like little extra stuff
like little through hole stuff you got
to solder. There's like stuff you got to
permanently VHB and then if it's if it
failed on stress test, you got to redo
it. It's just a pain in the ass." So
after the Comma 3, we really what you
know DFM is for. and we launched Comma
3X two years later. Um, like more than
half the bomb cost. It made a way easier
to build. Um,
so we're thinking we'll have like some
Lego style junk bin with like it'll just
be like a big bin of 3X parts. We'll
just like pull from production. It's
like the Lego junk bin you've had from
when you were a kid.
>> Yeah. You see them on eBay or whatever.
All different sorts of colors, different
junk parts. Yeah.
>> Exactly. Yeah. The ecam dcam. And then
from that we'll have like some pictures
of 3xs in various stages but we want to
see how intuitive it is to build them.
Like if we really did our job it should
be so intuitive to build them.
>> Um we've been refactoring it ever since
it launched. It's gone through so many
iterations.
>> Um you know we basically see what fails
in the field. We're like oh okay that's
kind of a stupid failure. Do we really
need that? Either delete the part,
refactor it, redesign it. Um you know go
through the Elon process. Um you see how
those Tesla cars come. They just stamp
them. It's incredible. They do the
coolest shit. Um, so we've done that
with the 3X and uh, you know, if you
guys could figure it out from just a
couple pictures in the the common 3x
junk bin, um, I think it's the most
awesome test if we did a good job or
not. Um, so that's the first idea. The
second idea is uh, you know those like
little um, racing things like where they
do like Rubik's cubes, the stacking
stacking.
>> Yeah. Yeah. Where you put your hands
down, you lift them up, and it starts a
timer. So, I'm thinking you take apart
3X and then you rebuild it and you race
against side by side with somebody.
Maybe we'll have a leaderboard and we'll
give out like special shirts or
something for the winners.
>> Probably going to have like the
production leaderboard as well. So
that's a little
>> Yeah. Yeah. Yeah. So the production team
and the hardware team will be there u to
answer questions. If you have something
like, "Hey, why did you design this like
this?" You know, we'll be honest with
you. Sometimes like there's a cool
reason. And other times like, "Oh, we
didn't think about that." And other
times it's like, "We didn't think about
that." You know, we're just not good
enough to fix it yet. You know, uh, you
know, we're still figuring stuff out.
This thing isn't a cell phone yet. Um,
so that'll be the uh Comma 3X, the build
a Comma 3X booth. What sounds better? Do
we like idea one or two? Do we like the
racing setup or the junk like the Lego
junk bin setup? We got any comments
about that? What do people want us to
try out? It should be a lot of fun. Um,
and this isn't something you have to sit
down and do for hours. It should take
like 20 minutes at most,
I think. I don't know. If we really
didn't do our job, it might take hours
and people would be like, "This is just
the worst."
>> No, it should be.
>> But that's great feedback. Should be
nice to put together.
>> It should be.
Uh, let's see. He's Nick. Yeah, artsy
guy.
Excited for Robus talk. I think all the
talks are going to be sick. Uh, so you
no longer need labelled data. Uh, oh, I
mean, it depends what you mean by that.
We have a ground truthing pipeline, but
we've never like had a big labeling team
or anything. We've never had a labeling
team actually. Um,
we did have comma pencil. That was the
closest thing we had. And that was for
our little segment. Cool reality. A
small team. Move fast. Try new things.
>> Oh, that's Trey.
>> Yeah, Trey. Unfortunately, Trey can't
make it.
>> Oh, really?
>> What about Maverick?
>> Oh, that's too bad.
>> Oh, this is the stream. Every other
stream were talking about cars. Uh oh.
Oh, yeah. We'll get to Jason. This isn't
a talk. That's why it's in here. Yeah,
we'll tell you about Jason's talk.
That'll be cool.
>> Has anything useful come from the EGPU
experience? Gotta come to Comic- Con.
Like I said, the secret started when we
announced Comic- Con, but we got to have
stuff to talk about.
>> Can't talk about everything now. Uh but
yeah, I think we'll do the racing setup.
We'll do the common 3x racing setup and
maybe we'll have a leaderboard for the
event. Uh we already have the
leaderboard code. It's uh we'll steal
our ping pong leaderboard code
and then uh yeah, we'll have a Yeah.
Then we have the next booth. You want to
show the
>> Yeah. body booth.
So we're thinking of calling this the
Kama petting zoo. Um you know, we'll
have some bodies there. Maybe they'll be
grazing on uh some grass there, some
artificial turf. You can drive them
around if you want. Um, if you really
establish a bond with one, you can adopt
it. Um,
>> it'll it'll be a good time.
>> Yeah. I hope we have a lot of adoptions
actually.
>> A lot of people asking about the body.
So, it'll be a little bit of a a revival
for the body.
>> Yeah. Yeah. Printing some new shells,
you know.
>> Yeah.
>> Be a whole new Billy.
>> Whole new Billy. All right. And this one
I'm really excited about. So, we got
live car hacking from Jason Young. Um,
Jason was a community talk last year and
he did this awesome talk about like the
general car porting process. Um, and the
coolest thing about Jason is he
maintains the Volkswagen port and now
he's our first external contributor who
like maintains one of our open source
repos. He's uh he's got like right
access to open DBC and everything. Um,
so Jason this year will be doing a live
car hacking demo where he'll bring a
Porsche Macon into the venue. We'll have
a big TV. We'll have a desk for him and
his laptop and then the TV will mirror
his laptop and he'll take you from step
by step from a stock Porsche Macon all
the way to a full open pilot port. Um
he'll start with open like open pilot
master. Um right he's already done the
full port but he'll like write it out
with you. It'll be like kind of like a
live tutorial thing. Anybody's there'll
be able to ask him questions. We'll
record this. He'll go online. Um I
checked. Unfortunately we can't drive
the Porsche McConnell out of the venue
after the port's done. I thought it'd be
really cool to drive it and engage
because the street right by the venue.
Um, you can engage.
>> It's still a little Can still make
change for where the cars are because
the Porsche could potentially be just
right outside the front. We'll see.
>> Oh, really? I don't know. Julie still
told me possible.
>> My other idea was to rent, too, but that
seemed a bit excessive. Um,
>> yeah.
>> So, that's what Jason will be talking
about. Um,
if you ever want to know how to port a
car and stuff, we got tons of docks and
stuff. I think it's pretty approachable
now. Um, but people really love the
format of his talk. So, this one, I
think, will be even more concrete. It
should be a lot better. Um, it'll be
different. It'll be different. Um, and
it'll be live, too, so you'll see the
mistakes and all. Uh, and then you'll
get to see like when he when something
happens, like which tool he reaches for
when. It'll be a lot of fun. Um, then we
got a couple other small booths. So,
we'll have the uh comma shop. So,
usually, you know, somebody's like,
"Hey, I just bought a 3X. I'm in San
Diego. Can I drive down pick it up?" No,
we only ship things. We're not really
open for business um at the office, but
this is the one time of year you'll be
able to buy something in real life. You
want to buy a 3X, you want to buy some
merch, um you want to buy a panda, we
might not have pandas there. I don't
know if anybody wants to bring pandas,
but if you want to buy a 3X, you want
some merch, you'll be able to buy it
right there. Um we'll even flip the
little iPad, you tip your cashier, it'll
be great. Um
>> be great.
>> What should the tip amounts be? We go
345782.
>> I think that's pretty good. I think
that's
>> as a no tip really small and maybe like
maybe we'll use DM so like as soon as
you look at it
>> well make it as awkward as possible too.
It's like oh just answer a few
questions. Yeah.
>> Do you want to you get the real coffee
shop experience?
>> Yeah. Yeah. Do you want to round up?
>> Uh and then
>> do you want to round up for charity? Oh
for think of all the poor little comma
bodies, you know.
>> Yeah, that's true. That's true.
>> You want to round up for a comma body?
>> Yeah, they're cold. Cold out there in
the Calby office, right? Well, now it's
warm as heck in there. So,
>> yeah. Yeah, the Calby does not get uh
until they fix the heat issues. They
don't get any AC.
>> Open pilot's cold, I'll tell you what.
>> Yeah, we got our AC fixed. Um, all
right. Then we got two more booths. The
next booth will be the tiny court booth.
I don't know if any tiny team member,
Tiny Team members will be there. Um,
but, uh, you might catch some tiny team
members. Maybe they'll talk to you about
Tiny. Um, but at the very least, we'll
have a Tiny Box V2 and a Tiny Box Pro,
which is what we run in our data center.
And uh you'll get to talk to the
production team. You'll get to talk to
Eigor. Oh yeah, you can show them that
>> we're running on storage at the office
these days. So
>> these are getting stored at my office.
>> There's some overflow here.
>> Um what else we got? So that's what you
get at the tiny tiny court booth. You
can talk to the team that builds them.
Um you can talk to Eigore who designs
them and maybe you could talk to uh
maybe Kevin will be there. Maybe George.
Oh, yeah.
>> We'll see. We'll see if anybody wants to
man the booth um on the software team
for tiny.
>> And then last but not least, um we got
another community booth.
So, this is the test run for Forkland
for next Comic-Con. We got the Sunny
Pilot booth. Um Sunny Pilot has some
plans. He's been talking to Nick. Um
I don't know if we want to spoil their
plans too much, but uh yeah, Sunny
Pilot's the most popular Open Pilot
fork. Open pilot is really uh you know
it's it's really pretty cool the whole
ecosystem that's evolved around open
pilot. There's way more open pilot
developers u externally than internally.
There's hundreds and hundreds of them
now. Um the sunny pilot team is just one
of them. Um they're the most prominent
running um with like a a fork that
doesn't cater to like some specific
region. There's a lot of like very
region specific forks these days, but uh
yeah, come meet the Sunny Pot team.
That's uh it's kind of the vibe of the
booth. I think like five study pilot
team members will be there. So if you
really want a feature, you know who to
who to bug. You come and ask us for a
feature. We're just going to send you
something.
>> Exactly.
>> They love features though. So I actually
I I don't even I don't know what to
spoil. All he tells me is I need a table
and I need uh I need some space for
laptops. It's like okay. Okay.
>> All right.
>> So it's a surprise to us, too.
>> So those are the booths. Um anything
else? Anything else we should say? We
can chill a little bit for a VIP.
>> That's pretty cool.
>> Yeah. You guys know a phone call. You
can pay for a phone call or you can get
a VIP ticket. VIP ticket gets you a sick
dinner at Comm HQ. You got to come
around the office. We'll show you the
data center where we train all the
models. We'll show you the factory. If
you really want, you can build a 3X.
It's pretty fast now. Um
maybe we'll let you like poke around the
SMT line. That That one's maybe not as
easy. And then uh
So, this is like phone call on steroids.
Then, at the event, we got special plush
seating that just came in. Um, Nick
approved. They're uh apparently very
comfy. Very plush, very comfy. You have
an open bar at the event.
Lunch, dinner, snacks. Butler,
you can just take in the whole event
from your plush seat. Get a massage
while you're watching. Now, I'm kidding.
>> Do we have that? No.
>> No.
>> Butler doesn't offer that.
>> No. Oh, I'll pick that up.
>> Um, and you get parking, which I didn't
know we had parking, but
>> we have very limited parking.
>> All right. So, if you want parking, this
may be the best deal. Actually, it might
be worth it just for the parking.
>> Yeah. I mean, luckily across the street
there's a uh light rail metro station,
so it's very easy to get there from
>> VIP ticket.
>> Yeah. You know,
>> VIP ticket. Take your comma, take your
car.
>> Yeah. You got to walk. You know, you're
out of state, you got to walk.
>> Yeah, no parking.
>> Um, yeah. Stream 50, if this sounds like
the event for you, come check it out.
Stream50 for 50% off a ticket. Let's see
if we sold any Stream 50 tickets
today only for stream 50. Nobody's
bought a Stream 50 ticket yet. I think
we already got the people on the stream,
but you know, if you've got a friend
who's like, you can enjoy Comic-Con,
stream 50. Today only. Today only.
Stream 50 expires after today. Um,
that's it. It's going to be a good
event. Uh, we'll have a lot of cool
announcements. Um, talks are going to be
really great. We're going to do our talk
practice session next Thursday. Um, and
we'll we'll have a chance to iterate on
the the talks. They'll be sharp this
year. Real sharp. Um, Nick's working on
some cool displays for the booths.
Yeah,
>> Arts and Crafts is hard at work.
Autonomy's hard at work on their slides
in their little sim racing booth. Um,
it's going to be a good time. It's going
to be a good time. Different vibe from
last Comic- Con. Um, it'll be new. It
should be very new.
>> Lots of new. It'll be the best. The best
Comic-Con.
>> It should be though. It should always be
the best thing.
>> It should always be the best thing.
>> Every new thing will be the best thing.
>> Exactly. Exactly.
>> For a VIP, what daytime is the office
visit? Um, that's a good question. We
should put that on the thing. Um, but it
starts with a dinner. So, um, probably
at the earliest five. I would probably
say five. But we should ask Julie to add
that.
>> Get like three or four like cleaning up
around the office and everything. So,
>> okay.
>> Yeah, we'll add that. We'll add that.
No, no, no. Don't buy a ticket to
donate.
If you want to donate, uh I don't know.
I don't know if you can buy merch and
not come to the event.
>> Yeah, maybe. Um
>> but yeah, there's about 60 tickets left.
Um they're selling out, so if you want
to make sure you get a spot, come check
it We got some cool people coming. Um
I don't I don't want to talk to anybody.
We won't say we got some cool people
coming. Um we cool people there. Um
yeah, if you like talking to robots, if
you like self-driving cars, it's could
be event for you.
>> Yeah. I mean, if you want to get your
hands on some some of the physical
stuff, it's it's a good time. It's a
good time to see all the hardware, all
the everything that goes into it. You
know, you you just it's so rare,
especially like a tech company that you
could never go to any consumer
electronics company and just see like
how is everything made from, you know,
zero from idea to product. And it's it's
a crazy amount of work that goes into
it.
>> Yeah. There's no like comms people
walking around like, oh no, you can't
ask.
>> No, it's like look, you know, how do you
injection mold something? Go and ask
her. Go and ask.
>> Yeah. You're like,
>> why is there some shrinkage here? Oh,
you just didn't know. You know, we'll
get better. Yeah,
>> like we'll be so honest with you. Um,
you know, if you ask us on Discord, it's
like we might see that question and be
like, uh, I got to do this other thing
today, but the only thing we're doing
there is like hanging out with you guys,
answering questions. Uh, this is like
the best part of CES, but like the best
part of CES for me is meeting the users.
Um,
and then, uh, sometimes like telling
people about comma who end up becoming
users, which is cool. Um, but this is
people who already know about comma. Um,
and like if you're just like a user of
the product, this is still an awesome
event to go to. If you're just like,
"Hey, why does this work like this? Why
does this
>> this is why we're there. We're here to
talk about it. We love talking about
comma. Um, and this is the the time to
do it." Um, so sometimes you guys are
asking cool questions on Discord and
it's like just the right person doesn't
see it or something. So you can come
find the right person like you have a
question about, you know, you took apart
your 3X, you're like looking at the
board, you're like, "Hey, why was this
done?" Yep. Go to Rob. Go ask him. You
want to uh you want to know why the
corners are around the UI? Now you know
who to ask. Um,
yeah.
Should be a good time. Should be a good
time.
If it's not, we're not giving you a
refund, but I I don't think it'll be a
bad time. I don't time. Uh, worst case,
you know, it's s you're going to be in
San Diego in November. Um, it's a good
place to be in November.
>> Yeah. Sunny and warm, perfect weather.
So,
>> uh, it's a little it was a little cloudy
yesterday, but it's nice today.
>> Well, no, it's perfect. the there's a
bit of rain uh this this week to make
all the plants brighten up, all the
flowers to get in bloom. That's true.
>> Very romantic.
>> That's true. All right, we got to get
back to the uh factory refactors from
our uh Shenzhen inspiration.
>> Um but yeah, we hope to see you guys at
Comic- Con. Remember, stream 50 gets you
50% off today only, even on a VIP
ticket. VIP is a great deal. Um, VIP is
also a very small group. So, um, you
know, it basically gets you like three,
four hours. Comm HQ, you can ask poke
around whatever you want. You see the
dashboards. You want to know how much
money we have on our bank account? It's
right up on a dashboard over there.
>> Um, I I don't know who's interested in
that, but like you want to see like the
engagement optic. That one's a good one.
We got the map of all the users. Um, got
a whole bunch of cool stuff.
>> Um,
>> so if you have a lot of questions, you
should get a VIP ticket.
>> A lot of questions. Yeah. Yeah. You you
Yeah, you should get a VIP ticket. You
can ask a question. You go to the data
center. We'll go to the factory. I think
downstairs is the coolest area. Um and
we'll clean it up for you guys. We're
cleaning up for us, but you know, for
you guys, too.
>> Um all right, we'll end this again with
stream 50. Remember, stream 50.
>> Stream 50.
>> We didn't sell stream 50s yet, so you
can spread it a little further. If you
want to comment it again, Eric, go
ahead.
hey everyone this is the inside of the
comma office is any over here at the
firm where station and he's bringing off
the new neo right here we are going to
be using this neo and putting it in our
new car
remember those secrets on the whiteboard
what Shh didn't want to be periscope
welcome it's their first day on
periscope so we're bringing up a board
and as you know when you flash your neo
you have to press down the button hey
Peter bench there you go you can say
that it's running a giant panda panda
Japan to carry your board for your knee
oh yeah we're gonna plug in you found it
right angle us me yep good cable cool so
I've already flashed neo ass an open
pilot on that Neil and we're gonna take
it out to our new car and that's what
we're going to be announcing today right
here on periscope actually put the
heatsink so cool let's walk back to the
Calvi this is the Khmer I advanced lab
for building the innovation you see it's
like uh may i
and it's max car
I can't tell if that's a smiley face or
a frowny face because the words are
upside-down well why isn't oh I don't
have to unlock orientation what that up
we're putting in the heat sinks into
this on to the 1 plus this is a 1 plus
3t GoPro mount that one prepared so
we're not going to be replacing the rear
view mirror of this car we're gonna be
using the GoPro mount which is also
available in the neo repository this is
a GoPro mount and a GoPro mount new your
adapter already got oh and also the key
to our car yeah the big reveal maybe we
got to get in over a hundred people into
this periscope isn't that what Martin
shkreli does before it does big reveals
you usually expensive sauna this is are
no longer oh this is are no longer
expensive soldering iron alright cool
Hey oh yeah yeah wait what about the
sign okay as close we have to sign
things some people remind me that we're
a real company around here it's still oh
really believe it you're a Ford Fiesta
has electronic steering assistance yes I
do think you could make the steering
wheel move oh yeah without touching it
of course um I think what you're gonna
have to do is figure out how the car is
moving it you're gonna want to sniff the
can bus a great way to do that is with a
comma AI panda which right now you can
only win so go on our forms and make our
three new moderators happy and you can
win a panda so yeah can we get a hundred
people in here hundred people will be
sweet like yeah I know no place still
looks the same
yeah not much has changed you know
[Music]
DoubleTap to flip camera hey how's it
going periscope 34 lookout 33 come on
come on let's get some people Oh invited
followers now we're talking I didn't
realize you could do that but I like
that
that's alright yeah you got your cover
on so just doing neo assembly here
getting the newest neo together
let's also grab its serial number baby
and put a label on it
oh yeah invites slack how am I not doing
that doing that channel that's a thing
yeah get slack over here on periscope
let's get 100 people will do the reveal
of our new car okay this is the logitech
mount this is the number one mouth that
we recommend and I can stick it right
here on my phone yeah that's that's
that's pretty good the best $40 buy one
of these logitech mounts there they're
like the best mount you can get for
Scheffer they're not perfectly rigid
they could be made a little bit more
rigid but they're a lot better than some
of the other mounts we see on the
suction cup is this thing you can like
really torque it down with which is
pretty nice what's the best map for a
neo well for neo we used to replace the
rearview mirror and we had a slide in
thing but yeah if you want to do away
with that so this is what we have I can
show you here umm this is also available
in the new your repository I do know the
open XC we could talk about that in a
minute but this is the GoPro mount
slider so then you can just buy GoPro
mounts off Amazon and it slides into the
same thing
it's almost as rigid as the rear view
mirror and you know you get to keep
now the kite what happens cut out too
much where's the new car well it's not
in here this is the basement
oh yeah the GoPro mounts are real cheap
oh yeah I've heard about the neck see if
you go look at the open XC documentation
they specifically say it can't do it
can't do the a lot of can if you
saturate the bus it won't be able to
keep up because it's doing like JSON
encoding on this tiny microprocessor oh
yes that is the giant panda board that
he installed in this new neo pandas are
way more powerful pandas are way more
powerful your neo board or your open XC
strip
oh of course yeah both the Panda and the
neo boards are both supported for open
pilot are we currently hiring people for
software engineer girls yes we are um
check out comma dot AI slash positions
it's linked to from the main page as
well so check that out if you like that
yeah you have to work with JSON like I
don't understand why they would do that
I mean what you should do is you should
have the micro controller output binary
protocol and then turn it into JSON if
you want your Python libraries which is
what the Panda library does so for those
who don't know Panda is our Universal
car interface and right now the only way
to get one is to win one by using our
App shipper and by being active on our
forms community.com dot a I if you
haven't seen our force alright alright
is the neo together neo is I heard I
heard about the tesla cannon' messages
Tesla key message scares me for steering
its controls to angle not torque and be
careful limit the fork limit torque will
have to make sure torque is limited on
our new
you need some help putting this on the
new car yeah put it on the new car with
this all right
few people can we get 50 people will
change it to 50 oh yeah any people um we
need people yeah
you gotta get right a little slack oh
just check the slack do we invite any
slack we're interested in all Road data
did someone go in the main forum do at
channel get on periscope yeah see if
anyone already did it get on the
periscope go ahead get on the periscope
oh yeah so do it yeah I know they wrote
it they do at channel yeah take a selfie
uh
what the ladder means but at channel
alerts the whole Channel come check out
show you the backyard
what about roads without painted lines
it kind of works um it works pretty well
everywhere uh as long as it looks like
things the machine learning models have
seen before um so yeah this is our
backyard let's wait until we get a few
people all 51 all right now we're
talking right so we added the channel on
slack nibble get some more
um but yeah for now who has questions
let's ask questions it's question
o'clock I remember last time this mostly
just turned into bashing the car
industry but um no the new car it's it's
non Honda and we're very excited about
it
it's yeah I like this company it's a
good company that makes a car that's
just not for you know 5758 alright now
we're getting some people in here I'm
liking this
alright let's go back to the Calvi let's
see how our neo is doing you're gonna
clean that cable up okay um what I
accept speed control with only excel and
regen no break for the bounty II maybe
the problem with that is not you need to
break because if your car battery is
full you can't do regenerate if the
reservoir is full yeah you can't know
the battery yeah cuz regen charges the
battery right if you're bad yeah if your
battery is full
camera orientation leave me by that
did I do something weird maybe it's the
periscope app being weird wow we're get
a lot of people in here alright I'm
liking this I headed the channel you're
out of the channel it's worth 60 people
in 19 different times oh wow so many
times on tonight
um so Eddie's gonna put together a cable
here and we're gonna use this table so
the way that we port to a new car is we
first sniff what the existing system is
doing um so this will be a great
periscope to watch and pay attention to
if you are interested in portent to
require yourself
so the first step lost the feed oh do I
not have good reception
minutes presentation for every team that
joined the hackathon. Every team got a
body. They're all lined up over here and
there's a little indoor navigation
course that they're going to try to
complete. We'll follow you guys. We'll
follow with the live stream so you guys
can follow along and uh start by handing
over to the first presenters.
>> Hey Harold, no one's in yet. Maybe we
should wait. We give them like 30
seconds to move over to this one.
>> Okay. Yeah,
>> we can just wait for people to roll in.
>> Yeah.
>> You want me to uh post
on this.
>> Uh maybe you can reply to the Twitter.
We got our first person.
>> There's there's 44 people waiting.
>> I I can add everyone on Discord.
>> Okay.
>> But they can replay back at the
beginning.
>> Yeah, but I mean
>> people want to watch live
>> live experience.
>> I mean, we have 40 in the other one,
too.
>> Yeah. Yeah.
>> We can thank you guys all for coming.
>> Wait, you really couldn't get this one
more?
>> No, I kept telling me unable to create
stream. All right, I'll just delete your
announcement and
>> Okay,
>> do another one.
>> That's good.
>> All right, the people are starting to
roll in. Let's give them like maybe 30
seconds.
>> Twitter one, too.
>> What's Twitter?
>> Post.
>> No, I don't have Twitter. Twitter app.
a lot of time to brainstorm, figure out
what he's going to do.
>> Sounds like the Discord just went up
>> spots.
I'm right here, guys. Right here. Come
join the live stream.
Are you in there?
[Laughter]
>> Right. We're ready.
>> Yeah. Let's do it.
>> All right.
>> Uh, so I guess we're team Is this our
team name? Church of end to end.
>> Yeah.
>> Okay. Church of
>> Uh, initially I wanted to do LLM
control, but that he's pretty hard. So,
you'll see we got to try to do that
later. Uh, but then we were like, okay,
might as well just try to do complete
end to end. So, we started running
around with the comma body on a stick
and then getting a video of when you
have to turn left, right, and go
straight. And then,
uh, yeah, basically just tried to get
that to work. Um, so lat space painting.
>> Yeah. Yeah. The this technique can best
be described as painting the way in
space where we we walk around and we
essentially tell it at every point where
whether we need to go left, forward or
right and has to be completely manually
labeled and for every single
for every new environment or lighting
change you need new data. That's like
the one downside. But we did manage to
get it at least running from here to the
back corner and then from the back
corner to the outside do the loop. But
we have not gotten them both to work in
series. So I think we're just going to
do the first half today. Uh yeah, I've
got this video of uh you know great
artist
the first person to finish the challenge
coming.
>> Uh
yeah, I guess we can do
video.
>> Oh yeah, we have a video. I guess we'll
show the video at the end because it's
not going to work right now.
So, this is like about 10 minutes of
just running around
trying to paint the lens space that the
direction you want to go is right
everywhere.
All
right, that I think we'll jump into this
demo. And disclaimer is I don't actually
know if this is the model that worked.
The one time that we get this to work.
So
>> Harold, I think we should do an overview
of what the course actually is first. I
think none of the people on the stream
have seen this.
>> Oh yeah, we can maybe just quickly run
with the streamers.
>> Yeah, let's do a walk through first.
>> Yeah, that's good.
>> And then do you want to redo your intro?
I know a lot of people joined after.
>> Yeah, sure. I can talk about it through
the intro. So, let's just walk through
the course here. So, we start somewhere
in our office and it's a small indoor
navigation challenge. So, the bodies
have to navigate through this hallway,
go all the way through all the way to
the end. As you can see, the first part
is just straight, so it's not that much
of a challenge. Uh, but there's a
there's a a gradient. It becomes harder
and harder
as you turn. Now, they see the narrowing
doorways.
Um, yeah. So every team that came to the
hackathon was provided with a body and
over the last you know 48 hours or
something like that
little bit
to go outside. You go over these ramps
over here so you still got smooth
terrain
and then the challenge really starts to
ramp up. A lot of the teams had
difficulty here with the changing
lighting conditions throughout the day
and night.
So, we got to turn around,
turn around the traffic cone, and then
finally, this is the end of the course.
So, if any team succeeds, this is uh
what you'll see them do. And I guess
we'll head back in for the demo of the
first guys.
Yeah. Sorry. It seems like we lost the
stream there for a second outside, but
basically
you just have to uh head out, go around
some cone,
and end on an X on the ground.
And uh that's it.
All right, we'll be back here in a
second. See the first attempt of uh
Luigi trying to do this course. Ad, you
want to take back this stream?
>> I get this much time that you got. We're
It's
>> Are we ready for our first try?
Never seen this before.
>> Let's see how nervous it.
>> All right. Pretty good stars.
Oh, the door's open.
>> Oh, the door's open.
>> Oh, it doesn't care.
>> Okay,
>> we should uh
>> Oh,
>> is it going to recover?
>> It should. Hopefully,
I guess right.
>> No, no,
>> no.
>> Oh, no.
>> That's the light.
>> Is it going to recover?
>> Oh, it could. It does want to go to the
right.
[Music]
It's getting there.
>> It's getting there.
>> It's making so much noise.
>> It's It's going to get there. It's going
to get there.
>> It's going to get there.
>> Oh my god. Come on, Luigi.
>> Oh, he knows where to go though. That's
the important part.
>> He knows where he wants.
>> He's not backing up enough.
>> Yeah,
>> just like FSD.
So close.
[Music]
>> Luigi, don't see it.
>> It's like one inch. Oh,
>> that's
all over.
>> All right, let's head back.
So that was Luigi
from the church event to end.
>> Oh, it did it. It did it.
>> Oh, see you still trying.
>> Oh. Oh.
>> Oh, it's stuck again.
>> It's stuck again.
>> Oh,
>> I don't think it'll work faster.
>> That was anticlimatic.
>> This needs 10 more tries. No, no, it is.
It's It's going to do it this time.
We never got it to back up more than
this.
>> You guys need to increase your backup
time.
>> It didn't make a difference for some
reason.
>> Last one.
Whoa.
>> No.
>> I don't think it'll go much better than
this.
>> All right, let's call it.
>> This was before the outdoor data.
Let's give him a cap.
>> All right, let's see the next contestant
>> going out for the other the other
perspective.
>> No, no, we ended that run.
>> It's doing it.
What is this?
>> They might be carrying it.
>> Oh, he's helping.
>> Yeah, they're helping it.
>> Yeah,
>> I think let's move on.
>> That was Luigi.
>> Let's do a bit of a a bit of an intro
for new people. How many people we got
on the street?
>> 48.
>> 48. Where are all the people? They added
everyone.
>> Should I go live on Twitch?
[Music]
>> Um, all right. All right. All right.
We'll have the We'll have the
>> They're asking if you're asleep.
>> Am I asleep? No, I'm on Taiwan time.
It's Taiwan morning right now. It's
early in the Taiwan morning. Okay. Uh,
so this is common hack 4. Um, I didn't
do anything. I just showed up. I'm kind
of a participant. Uh, these are the
bodies. Uh, you can buy them in the KA
shop. Uh, they're all topped by
beautiful comma 3X's also available at
the Comma shop. Almost not even on back
order anymore. Uh, these things can do
things for the first time in history. We
were too ambitious when we first
launched the bio. When we first launched
the body, we thought it was going to
balance on two wheels, not too much.
Now, it has training wheels and it's
much more reliable at driving around
office parks. And what we're doing here
is we're navigating around an office
park. So, what you're seeing is people
trying to navigate from here around a
loop in the condo office back to here or
around that sign or something.
>> Yes, halfway.
>> Halfway is good, too. But avoid the
walls. Walls are bad. Uh, so if you
watch, you know, if you're watching at
home, if you hit a wall, it's bad.
>> They're saying they don't really hear
the people up front. I guess I can get
closer.
>> Uh, and then Mike, you're next.
>> Yeah, I know. Oh, it had a bit
>> you guys.
[Music]
>> We should close it for one run and not
the other one.
>> Everyone gets to open gym door.
>> Yeah, I drove to the bathroom on its
own.
Um,
>> you can check out my code's open source
now, too.
>> Oh, good.
>> Are you going to demo yours as well,
George?
>> You got it.
>> Does it work with all lighting
conditions?
>> We'll find out. At night, it did a full
autonomous. That's all I see.
>> All right, guys. Thanks for joining me.
Thanks for participating with me. I met
a lot of cool people here. I'm having a
great time and I want to show you guys
what I came up with. So, this is Leon,
Napoleon, as uh I got assigned and we've
been having a great time, me and
Napoleon. Uh he became my my good buddy.
He follows me around. He gives me space
when I need it. He records when I need
him to. And he's my companion. So, I'm
going to take him for a tour around the
office. The way the way Napoleon works
is he just finds the biggest person in
his field of view and he follows that
person around. And so that person,
sorry, is going to be me and we're going
to go for a walk.
I'm going to set him up.
And
yeah, let's do this.
Now, while we make our way through here,
try and not make yourself look big. All
right? Just just for this one part. The
rest it'll be will be just fine.
Oh, turn to you.
>> Hey, boy. Good morning, buddy.
Okay, just like we practice. All right,
got this. Let's do this. Okay, we're
going to go around here. Don't be shy.
Don't be shy. Just follow me. Yeah, just
ignore them. Ignore them. Yeah, we got
this. Let's go. Let's go. That's right.
That's right. No. No. No. Still
there. Yeah. Yeah. Look at me.
>> All right. Now, let's go.
>> Great. That's what I'm talking about,
guys. Eye contact. Don't even No, no,
no. Keep coming. Do not turn your head.
I know. I know. Listen, it's me. All
right.
Come on. This way. Over here.
>> Napole. I'm going to give you a little
hand just There we go. All right.
>> I'm tiny. Look, I'm a little high.
>> I'm I'm big.
>> I'm little.
>> I'm big. Come on.
>> Go this way. Come on.
>> I should have wore my hoodie. All right.
Here we go. Yeah. Now we're Now we're
out of the trouble zone.
>> Look, I look how small I am. Hey. Hey.
[Laughter]
Let's go.
>> Touch that. Perfect.
We're pulling out.
Let's start from this.
That's right.
We're here. Perfect.
That's right. All right. Now, let's go
this way.
There we go. I like to see. Keep coming.
Keep coming. There you go. Awesome. All
right.
>> All right.
>> Push back up a little bit. Back up. Back
up. Back up. Perfect. Okay. Now, follow
me this way.
>> We're going to go straight shot to see
everybody. Okay, let's go.
Don't go down those stairs. Don't go
down those stairs. Talk.
>> Yeah. This
almost There you go. Good job. Can't go
slow over that. You know, you always get
stuck there, don't you? Almost.
>> All right. A fall loop.
>> Great. Thanks, Napoleon. Good job.
[Applause]
>> All right. We got a good number of
people in the stream now.
>> Yeah. Welcome everyone who's new. Just
had two of the teams present. Who was
next? Do we have uh someone time to be
next? Is anyone ready? Yeah. You ready?
Let's Let's do it.
>> We're ready.
>> It's risky.
>> Very risky.
>> It's sitting right there.
>> Um, yeah. Tweaking the
>> addition.
and somebody saysity.
I
>> don't know if there's some way to fix
that.
>> I mean, yeah, if the Wi-Fi
videos. Some of them left, some right
>> controls
are kind of open source
and he really likes
>> so hopefully we'll see it one day. So
for now I just gave it my shot.
Anyway, so how we build this? Um
um okay. So this is the architecture we
used to uh so we take the data from
camera we convert it to GB and then we
model we use mobile version.
Uh and then we skip the floor plan into
custom models that we build and train
here on the spot which we call the
outputs left, right and forward.
So this is the architecture we started
with YOLO running on the laptop. Uh we
didn't have time to move it to the
device. So right now it's a little bit
experimental but that's u how it works.
Uh essentially all the data is received
in the main grid. We moved inference
into separate grid. Uh the reason for
that is that inference uh is still quite
slower than real time. So we need to
drop some frames. For that reason we
basically just process the latest frame
and the rest
and
messages.
And uh we also built a little bit to to
aid with the train and we also build a
build a little bit of tnet interface. We
use tet for just because um PC client is
a little bit
slow.
>> Wait like actual tnet.
>> Yeah. Yeah. Well tnet maybe on like
socket server.
>> Yeah. I haven't seen anyone use TNET.
>> No.
>> I got my I got my 288 modem.
somewhere.
>> Yeah, but you can uh but it's pretty
pretty useful because right now we can
uh basically just uh do we started with
fully manual run. So basically we gave
it comments and I recorded all data and
automatically lab so basically didn't
have to label anything. Uh but once it
got a little bit running also added like
run mode and step mode. So in run mode
it basically just u runs runs inference.
In step mode it basically runs it once
and then closes for the common makes
another inference and so on. Uh and also
we can uh in the real time send it even
when it's in the run mode we can send it
correction command. If we see that it
goes some wrong direction
and it will be
this way improving the model.
Okay. Uh so resource optimization it's
pretty good. I mean we can probably run
it on the device if we have more time.
So we use right now for those two models
we use about 15 minutes of RAM uh two
10% of 50i which is my laptop GPU and it
could be optimized more uh we get about
5 but I think it's mostly because of the
latency
um not
performance
some
Uh it does okay. It's a little bit slow
mostly because uh runs on the laptop. So
>> So basically yeah in the back end it
just detects the lanes as in like the
brown part of which it needs navigate
and then it creates a small neural
network which detects the first right
left or right. So most likely since it's
more of right right it kind of follows
tries to follow the left wall and yeah
but it's slow sometimes it gets
that's kind of
cool.
>> Okay that's our presentation
>> you want to do a demo as well you want
to try this
>> um we can give it a shot but I'm not
Go to network advanced.
I think it's better.
>> So I think right now it's in the step
mode.
>> You guys have to speak up.
step.
>> All right, there it goes.
actually
sometimes
[Laughter]
Is he going to get stuck?
>> But we'll give it one more attempt
because it hits the wall again. We'll
have to
>> check see if that Todd has recovered.
>> Don't do it. I know it's tempting.
And a real slow and steady uh
slow and steady guy
>> conservative.
>> Let's come get to the next checkpoint at
least.
>> Yeah. Well, let let's see what it does
to this checkpoint.
You know, so the difference with the
hitting the wall is the other two runs
the body's recovered. If it recovers on
its own, that's fine.
>> I tried it. I don't think it would
recover once it
>> Yeah. Know I was answering there's a
comment about
>> it was idea to get
>> right. Yeah. No, we missed that check
mark. Let's let's cut it there.
>> All right.
>> Let's go to the next one. Let's give a
hand for uh that team.
Who's next? Is anyone volunteering?
Otherwise, I'm just going to run around.
I'm going to point at someone. Yeah, you
guys. All right, let's do it.
>> All right. And remember to talk towards
the camera. They can hear you.
>> I know it's been a long weekend.
15's got Clay Thompson.
possession intense.
>> Oh, you guys are running the other way.
>> Yeah, we're running backwards,
>> right? We got a backwards team.
>> Oh, nice.
>> What was the reason for that?
>> The camera's better.
>> Oh, you guys didn't like the infrared
camera view.
>> Why are you guys using the narrow cam?
>> No, we used the white one.
>> Wait, they're the exact same.
>> No, no, everything was red.
>> No, sure. The red disgusting looking,
>> but they said it wasn't the IR.
>> I was just like, look at the camera a
little bit. Like for both cameras, I
kind of like the rare one more.
>> It's cool. The other one can see at
night.
>> Yeah, I think it works better at night
because the lighting's consistent.
>> The other one works far better.
>> All right,
>> I remember to be loud.
>> Very loud.
>> Very loud.
>> Uh, let's see. All right, I'll just
introduce ourselves. I'm both
>> I'm Cole Ed. Then,
>> oh, sorry guys. One sec. There's a
comment that says if we flip it, it'll
sound a lot better. Let's try that.
>> Yeah.
>> Oh, yeah.
>> Rotate.
>> Someday we'll have a good stream.
>> Nice. We can even see ourselves.
>> Anyways,
>> all right.
[Music]
I don't want to block this or I guess
whatever.
>> All right. Well, um, so yeah, Cole, do
you want to give them a brief
description of our
>> Sure. Yeah. So, for our approach, uh, we
went with a end toend learning approach.
We're using the efficient net model. The
initial starting out, we tried to
hardcode the path uh because that seemed
quite easy. Um, what we learned a
challenge was two things. one, there's a
lot of latency on the office uh internet
and so that skews the commands that
we're actually sending to the robot and
uh basically caused it to go off course.
Um after that we quickly corrected and
moved towards a end toend neural
network. Um, and I'll let Edgar talk
about the training, how we collected the
data, and then, uh,
>> oh, uh, so we basically tried like to,
um, we labeled the data set, we like
carried the the robot like along the
way, so it's like facing left and then
try to correct it so it goes back to the
right side. And um we tried like to
control it with a with a joystick in
like this way label data set but it was
kind of worse because we had like a
majority of the class being just go
forward. So we ended up just like having
uh like face making robot like face left
carry it forward and make it the left
class and just do the same for right and
forward. So this way can have like
balanced data for training. Um well for
the training it's pretty like simple
just efficient net v 0 we resize like
input to 224. So have like rescale
images fed to network and we tried a
bunch of augmentations like dropping out
like changing saturation like contrast
stuff like that. So you know and yeah it
kind of made it a little better. So
that's pretty much like the the training
part.
>> Yeah. And yeah, I guess just last stuff,
uh, implemented some like kind of cool
features to help with testing and
iteration like engage disengage buttons.
Um, fast loading without having to
restart the the cola. Um, and oh yeah,
and then uh loading the model on the
device. So to get around latency issues.
>> All right. Yeah,
>> the model's running on the device.
>> Yeah. So we are running uh natively on
the device. We took the onyx model and
then converted it to the thne need
format which is allows us to use the GPU
of the comma. Um and so you want to
switch back to to stream.
>> Yeah. So yeah the I just started the
model and then uh when we press the C
and E keys
>> yeah we added like two extra keys on the
monitor. You can see the E and C.
Basically when I'm like debugging like
we press the E and then the AI like
engages and like we press the C and
disengages. It's kind of like
convenient. How did you switch the
camera?
>> Uh, we we swap the web app to use a
different stream.
>> Yeah. I mean, it's pretty easy to do
that.
>> It has recovery though. It has recovery.
Oh,
>> it has recovery. Yeah. Should something
soon.
>> All right.
>> All right.
>> That is cool.
Nice.
>> A sharp turn.
>> Solid.
>> Now things getting a little funky, but
>> YouTube says you're the best team yet.
>> Sorry. It'll recover.
>> Oh, it'll be fine. Just give it a time.
Okay.
>> Nice.
>> Nice. Why doesn't it just do it right
the first time?
>> Good question.
>> Oh,
>> solid.
>> Wow.
That's like kind of the tricky part
because we had the whole data set pretty
balanced but it still like has a bias
toward the left side.
>> So
>> yeah, you multiply the right probability
by 1.1.
>> It goes to the gym. Yeah, this this
wants to go to the show the gym on
YouTube. It wants to go to the gym.
>> All right, let's show the gym.
>> Is it going to recover?
>> Come out of that. Yeah. All right, let's
give it a chance to recover.
>> Well, no, we should show the gym on
YouTube while we remember this is all in
hand.
>> All right,
let's show the
>> Okay, while while Clay's hanging out, I
mean, he's got a basketball jersey on.
Clearly, where he wants to be is the
Kama Gym. We have weights and bigger
weights and a treadmill at the Kama Gym
where Clay wants to be.
I think it's
>> I think
>> I think it's done.
>> We call it there.
>> Yeah, let's call it.
>> All right, that's what we made it to.
>> All right.
[Applause]
more like a video.
>> Does it sound better turned around,
guys?
>> No.
>> All right. Who's next?
>> We can go next.
>> All right. Yeah, let's do it.
>> Should we use your laptop?
>> Yes.
>> Okay.
>> Wait. I'm just going to do a quick check
of who's left.
>> Uh, so Three
teams left.
>> Three left after the current team.
>> Okay. They say it's better.
>> Just can't wait to back a lot. I saw him
sleeping and dead over there.
>> Yeah. Yeah. No, he's uh he's had a fun
past few days. So, um, but yeah, our
team was none other than the great
Julius Caesar in the flesh or in the
metal, I guess. Um, and then our
approach, we tried a whole bunch of
different things, but what we settled on
doing was doing an endto-end model, but
instead of just using the like raw color
data, we do a depth estimation with just
an off-the-shelf network and then do end
to end on the depth estimation. Um, we
originally wanted to just do kind of
like a traditional 2D slam with the
depth estimation. So you could take like
a horizontal slice or something like
that and then map out the building. Um
but that was, you know, less trivial
than we thought it was. Um so we ended
up just kind of doing this end to end.
So you can see the real time color video
there on the left and then the depth
here. Um and then we just kind of run
that through the model. Uh we kind of
did the normal endto-end training
routine where you you know get some good
training examples where it's kind of
facing forward, some where you carry it
and it's like facing left, somewhere you
carry it and it's facing right. And that
worked like decently well. Uh we were
able to get from like checkpoint zero to
checkpoint one uh somewhat consistently.
Maybe it'll struggle with all these
people in the room. We'll see. But since
we have the depth data, there's a lot of
potential for augmentations and stuff.
So you can take the depth and you know
where you're facing and then you can
translate the camera to the left to the
right and do all these things like this.
So here's kind of a demo of that.
>> It's also invariant to the time of day.
>> Yes. So that's another big benefit is
that lots of people struggled where like
they get all their training data at
night and it doesn't work in the day.
The idea here is like you know the depth
estimators train on both daytime and
nighttime images.
>> Why is it like wobbling?
>> So this is us trying to augment the
data. So, we took one picture and then
we're using the depth data, projecting
it into 3D, moving the camera, and then
reproing it back into that
>> a little bit like the stuff called.
>> Yeah.
>> That's a little bit of some issues.
>> No need to talk. No need to point it
out.
>> Too tiny for you to see from all the way
back there.
>> Yes. Exactly.
>> Um,
>> I can tell you
that looks familiar.
>> Yeah. Looks familiar.
>> Very familiar. Yeah.
>> Can we run it on device?
>> Uh, sadly we're not. So since we're
running two models, we're like almost
like really, you know, causing this GPU
to to struggle. So moving it on to
device is definitely doable, but we just
haven't done it yet.
>> Okay.
>> All right. Should we demo it? And then
the model itself uh for end to end is
just a ResNet 50. And then the depth
estimator is just like the top desk
estimator on hugging face. So is this a
demo?
>> Yeah.
>> Here we go.
Maybe.
>> All right. Well, good start.
>> Yeah, we'll see.
>> Yeah, it's never seen this many people
before.
>> Uhoh. Uh
>> oh.
>> No, it's over.
>> Is it going to recover?
>> All right.
>> Recovery.
>> No, no recovery.
>> Okay. So, we'll standardize one manual
recovery.
>> Yeah, one manual recovery is fine.
just for entertainment.
>> When it's more confident, it goes
faster.
>> Yeah.
[Music]
>> All right. That's it for Julius Caesar.
>> All right.
>> Let's give it up for that team.
[Applause]
Right. Then we've got uh three more
teams. Yeah. Go ahead.
>> The demo ready.
>> It should be
>> great.
>> That's Did you want to reset that cone
outside?
>> We're planning to get to that car. You
want to do it or you want me to do
>> We're making it outside when I'm here.
This is
>> ambitious.
>> Oh, they're just resetting the code.
>> Oh, okay.
>> Remember to talk loud.
>> Yes.
>> Okay. We are team Spike the Biker. I'm
Ellen.
>> I'm Maria. And I'm Amal.
>> Yeah. And so for our model um we have a
sim to real and we train in simulation
in Blender and then use the P
trajectories to follow the line uh the
desired center path more closely and
then use that to train in a vision net
classifier um to then predict the action
based on images. And then do you want to
explain the
>> Yeah. So what we started by by doing is
like mapping the office. So we used the
the iPhone lighter to get the 3D scan
and as well as the floor plan and then
from that we trained simple P to get the
to get some trajectories.
>> Yeah, I saw that.
>> So yeah, that's the Blender project. We
did import like basically just a quick
scan with lighter. Uh and then I tried
to add some artificial lights that
basically at the same spot. You guys
want to be
>> play the play the play the key frames.
>> Yeah. Yeah. Looks like this. And there's
also an animation made.
>> Okay. So that's the kind of trajectories
that we created. Maybe you want to
explain how we created.
>> Yeah. Just a simple P following the
line. And so then we just put those
trajectories into Blender and move the
camera around. And then from those
images we predict the output of the P
which is just the steering to the robot.
And that's uh yeah that's basically it.
And you want to show the images.
>> Yeah. Just the P is like
uh basically we took the floor plan and
we drew a path and then we tune the P to
follow it. Uh and then yeah using this
matching with Blender we match like pair
of images and action and train. Should
we go for demo?
>> Do you want to show the other images?
>> No, the the filtering as well. Uh, it
was also kind of difficult to get good
trajectory using only a P. We initially
wanted to train some reinforcement
learning, but it was a bit too short.
And so what we ended up trying to do is
uh can we go to the
>> Was that a picture? Go back.
>> Uh, oh yeah, that's that's important.
That's
>> we matched the images in Blender to the
images from the camera. Obviously,
>> that's that's a simulated picture.
>> It's like a simulated picture, but
>> so it has Blender on top of the actual
real image.
>> It's like to compare the the images.
>> So, yeah. So, we like use the camera
calibration and warped the images to
match the the fisheye of the the camera.
>> Yeah. And then we also have
augmentations for the actual image. So,
like color tinting and everything. So it
looks ends up looking really similar.
>> Do you have a picture of it? Just a full
simulated
>> uh maybe somewhere on the
>> you know what I'm saying, right? Just
the screenshot of a simulated frame with
all the
>> like matching augmentation
>> augmentation we don't have but we like
the fish and stuff.
>> Yeah.
>> Check stuff.
>> I didn't see Blender output the fisheye
like realistically.
>> Yeah, basically. Yeah, that's the issue.
We do it like after Blender also for
like compute reason because it's too
slow in Blender and also like we don't
know what model they they use.
>> Are you guys like training network on
the Blender images or there's a real
images like mixed in?
>> No, just the the Blender images
>> and it like translates.
>> Yeah, pretty pretty well. Yeah,
>> we'll find out.
>> I just know.
>> Yeah. And Yeah.
>> So
>> yeah, so with Blender we could sample
all our trajectories. We have 200,000
images and we also sample uh along like
in different locations kind of skewed
away from the path and have it uh
conjoined back to the path and then we
stop it. So um actually we should have
had the distribution of the of the
predicted actions but most of the time
it's predicting left and right because
we don't want it to be following the
path and that's not very useful. So we
stop it after a certain amount of time
and then we have it sample a different
location and the P to get a lot of
different trajectories so it can recover
quite well. see the demo.
>> Yeah.
>> Yeah.
>> Yeah.
>> Okay.
>> Yeah, they already did.
>> Yeah.
>> Oh, yeah. Can you put your
Yeah.
>> They want to know if it's all running on
the device.
>> Oh, I started it.
>> Yes, it's running on device with also
like Onyx and THD. So, running
so far.
Oh.
>> Oh, you recovered.
>> Stressful. Oh, maybe we need to close.
>> YouTube says you guys got off to a very
clean start.
>> Yay. Let's hope it stays that way.
>> Yeah,
>> the gym seems to be the next checkpoint.
>> Yeah. Yeah,
>> we have a few
It's
>> often tempted to go to the gym, too.
>> I think let's hang out here because it
cuts out around the bathrooms and then
if it goes around, we'll go there.
Whoa.
Is it going to go out?
>> Whoa.
>> Nice.
>> Okay.
Oh, it's going to turn.
>> No, no. So, passing the X isn't bad. The
X's are just checkpoints.
>> Oh, no. Oh, no. Turning away.
He just wants to go back inside.
>> All right. Nice job, Spike.
Congratulations.
[Applause]
>> Done so far.
>> YouTube agrees.
>> YouTube agrees.
>> Yeah.
>> Conspiracy.
>> All right. Nice work. So, we got two
more teams.
>> Uh, Chad P., are we good to go?
Chad,
>> bro, I changed like a lot of code while
I was sitting here.
>> Dude, please give it over. Please.
>> Really bad.
>> I think if you change code after other
people have presented, it's it's it's
not a good not a good Oh man.
[Music]
You guys can close the door. We had to
deal with the gym.
>> We will set the doors however they want
for your run.
>> Someone insists on a retry. Yeah, but
remember how shameful it's going to be
if it doesn't help.
>> That's right.
>> Maybe you want to drive it up a little
bit.
>> Just give this dude a closeup of that.
He's going low.
>> Just a quick closeup. Get a good look at
him right there.
All right, I'll move you back now.
>> All right, everyone. YouTube, this is
Ben Swallow here. My name is John. This
is James. He's actually off screen, so
I'll move. Oh.
>> Uh,
>> yeah. Yeah, I can explain the training.
So, basically what we did to uh set up
Ben Solo here is we captured frames by
driving around the office using just the
WD keys and then matching the frame with
the uh key at that actual timing. Uh and
then we use that to train or fine-tune
ResNet. Um so if I go to the
B here, you can see um we processed some
of the images and then basically
fine-tuned the model from there. uh we
didn't collect end up collecting enough
data because I wanted to do use visual
language models and we set up blip 2 um
on our AWS instance previously but it
ended up not working uh and
hallucinating a lot so we ended up going
with uh this method but we didn't
collect a lot of data so it's probably
going to just crash into this wall here
so let's see
>> maybe we had a couple runs where it was
all right but we haven't tested a little
>> probably crash probably crash
>> the one thing that we did do that a lot
of teams didn't use is we used panny to
filter out any possible issues with
color. So, it'll work both at night and
in day. Well, it can crash into walls in
both night and day.
>> All right. Uh, the other thing that we
did that I don't believe anyone else is
doing, we're actually running our code
in AWS, which is getting streamed down
to the device here through tail scale.
Tail scale is like a meshvpn solution.
So, you can just install it on any
device you want and it just boom
networks them together. You don't have
to worry about anything. So, hopefully
the internet is stable enough and it all
works. So without further ado, let's uh
give you a demo and show you what Ben
Swallow can do.
>> Yeah, the stream and AWS are going to be
competing in this run
>> for bandwidth.
>> We literally have fiber. We pay $5,000 a
month.
>> Our workstations are genuinely 10
gigabit.
>> But uh
>> give it a go.
>> Why? Which is worse?
>> Swallow going straight to the bench
press.
>> That's That's a bit ironic. It doesn't
get to the gym.
>> Last.
>> It's going to go straight to the camera.
>> Get it, boy.
One regret. One
>> one manual correction.
>> We did this originally when there were
>> we did this originally when there were a
lot of food tables here.
>> So the training data is a little bit
messy.
>> Start start after the food tables.
>> We'll start after the food tables.
>> See if
it's going to
>> for the entertainment value. so fast.
>> Oh,
>> all right. He missed the checkpoint.
>> All right.
>> All right.
[Applause]
>> Everything
>> chat.
>> This is going to be tough, guys.
This is
>> um Let me just
>> um Okay. I think
>> Oh. Oh, do I need a presentation?
>> You don't have to.
>> I can present my post.
>> Also written my chat GP.
>> Is it a chatb
>> actually? Yeah,
>> actually. Yeah, Chad, she wrote the dev
post. That's why it's like kind of nice
as you can see. Oh, you want to see
where I did it? Actually, I did it right
here.
>> Oh my god.
>> So, wrote the code, too.
>> Wrote the code. We're in cursor. Um, all
right.
>> Yeah, chat P I guess. LLM's doing
controls. Um, it's kind of the future. I
don't think you guys
>> Let me go and see the the image you
showed. Which one?
>> The the first one. That's the most
relevant one, right?
>> This one?
>> Yeah.
>> Yeah. So, um, basically I'm doing SAM,
but I guess I'm dumb and I didn't know
there was a mobile version. So, I'm
actually running it in a A100 on modal.
>> Um,
so that would have been nice to know
that earlier. Um,
>> yeah. So, P P is like a dollar a second
or so.
So,
uh, yeah, just to go through it real
quick. So, we run the camera
camera, uh, we get this image and then
we run Sam, but Sam doesn't label. So, I
have a a heristic labeler, which is
actually the first image.
>> Um, that just gets floors and walls
based on how big it is.
>> And then, and
>> that's how it works.
>> Yeah.
>> Sam doesn't tell you the class.
>> No, you're
>> It totally tells you the class.
>> No, it doesn't. It's the color. Just do
it by
>> the color. ID.
It doesn't tell you what it is though.
It doesn't say floor.
>> Just do it by green or something.
>> That's what I did. THAT'S WHAT I DID.
ANYWAYS, that's what I did.
>> That's This is good though. So, this is
the floor and then walls and then blue
is other stuff. And then and then we get
this and then we get a really nice asy
and then we feed this asy into chat GBT.
>> So,
my curse. Yeah, it's all written by
cursor. Um, and the prompts like pretty
pretty nice and beefy.
>> Uh, read some of those.
>> Yeah. Yeah, we can read some of the
prompts. So,
>> uh, let's see. You're a self-driving
model embodied as a 5ft tall two-
wheeled robot.
You're currently on a racetrack and your
task is to navigate. Um, I give here I
can show you the ASI log. So, I give it
this like the floor. This is its current
location. I have like a top left just so
it kind of knows what's going on. Um,
and yeah, this this is what it sees.
>> Holy shit.
>> Um, this task is a human.
>> Yeah.
>> Well, anyways, let's see what it does, I
guess. Let's see what it does.
>> So, screwed running.
>> We'll see in the bottom here what what
it's thinking, I guess.
>> Um,
there you go. So, that's from Okay, so
it wants to do Oh, wait. It's
Okay, this is the first. This should be
the first one, I think.
>> So, we're running out.
>> Is it you think three or four?
>> Four.
>> GBT.
>> Yeah.
>> All about spending money in the cloud.
>> Okay. So, we got it ready. So, W A WA.
>> It outputs the keys.
>> Yes, it opens the keys on the bottom
here. So, you can see.
So, that was pretty good, right? The
control loop's like roughly 0.01 hertz.
>> Um,
so it's going W. It
>> So,
>> um, we made it pretty far before, but
>> Can you guys like explain what it's
trying to do?
>> Yeah. Yeah. Yeah. Well, it it says it
says So, so it makes a plan. So, the
plan last time was to move forward
slightly, adjust to the left, stick to
the left side of the track, uh, continue
to move forward, make micro adjustments,
What do you do? You drive down cars.
>> Yeah, dude. So,
>> no.
>> Can you yell at it? Can you tell it?
>> When GPD doesn't follow the right
structure, it just goes backwards.
>> So, we got Lindex out of range.
>> Can we Can we get it to at least recover
from going into the wall? How long is
that going to take?
>> Let's Let's Let's wait another 30
seconds.
>> I have 90 seconds.
>> Yes.
What is that? $90.
>> Um,
>> there's actually an A100 thinking about
this problem.
>> We can see we can see it. Think right
here. Think
>> control of time.
That's my A100 bill.
>> Dude, the numbers are crunching.
That's
>> Chinese
to extract most money.
[Laughter]
>> Yeah.
This is the future control system.
No, someone comes up for me.
>> Another $5.
>> Let's cut it here.
>> Yeah, let's cut it here.
>> All right.
>> Thanks again for chat.
I guess
your bill right now.
>> Uh, I spent $50 on modal and $100 on
GP4.
>> Do you want to demo yours or uh
>> I can try.
>> I don't think it's as good. I think it
can beat me.
>> Let's see it if you can try. Let's try.
>> All right. George has a solution, too,
that we're gonna have some people
holding the thing like this like they're
walking up against the left wall.
So I shamelessly copied their strategy
um and was like with engineering prowess
and pre uh existing knowledge of the
comma codebase uh maybe I can win.
Um it's open source right now on my
GitHub under body loop.
I also put it in speed mode for maximum
entertainment.
So uh we're going to see which is
connected into the body here. Let's go
in. the first one to do that.
>> Yeah. So, I just here it is. It's, you
know,
>> uh it's called common body loop driver.
I did all the training and inference in
tiny. Um the thing that I'm most proud
of is that I have control.py
and control.py can run seamlessly either
on the device or on the computer and
it'll loop it nicely on the computer or
it'll just run locally on the device. I
didn't have to use the needed. Uh I just
used the tiny jit. So, I collected a
data set. Yeah, I can just
I'll show you like what the data set
looks like.
>> Um,
>> so like this is an example of when
you're too far to the right.
Just recorded this data.
>> What labels do you have? Just like
>> I just labeled the entire video. This is
a right video. There's left videos and
right videos. Here, I can show you a
left video. Uh,
>> switch it up
>> for comparison.
>> How many videos do you have? Left side
and right.
>> Um, so I gathered lots of videos and
then I actually got it to drive the
entire loop once during the day and once
at night. Um, every time it would mess
up, I would just record a mess up video.
Um, so I can show you what these mess up
videos look like. Like this is my data
set here. So we can look at like mess up
one. The mess up video is also going to
be like one class or
>> messup videos are just one class. This
is a mess up where you should be going
more right.
>> See? So like if it's over there, you
should be going right.
>> All right, let's see if this works.
>> So you like did you clip the mess ups to
where they should have done something
else?
>> Yeah,
>> makes sense.
>> So I I put it in maximum speed mode. We
got to compile the uh the model here.
Wow.
>> Very smooth.
>> Uh,
>> could not acen.
>> Oh, you missed the checkpoint.
>> Oh, yeah. I don't checkpoint. Oh, did I
hit the wall there? Just correct it that
once.
>> All right.
All right, let's go, Jeff.
>> Jeff's got no interest in the gym
whatsoever.
>> No, Jeff.
>> We'll give him one more.
Jeff is speedy.
Oh, let's go, Jeff.
>> Jeff wanted to take a quick leak.
[Music]
See if he does it.
Oh no.
>> Give him more recovery. Mitchell.
>> You going to do the turn?
>> Oh. All right. He wants to go back.
[Music]
So close.
>> All right, let's carry him in.
>> Too speedy.
>> All right, YouTube voted Jeff as second.
>> All right, but that's it. Right. Let's
give it up for the in-house solution.
>> This is this is the speed he's designed
to go, but he's less entertaining.
>> I guess we'll see how this goes, too.
>> It should work a lot better at this
speed. I don't know why I went for the
high speed.
[Music]
>> I did. Yeah, I did. I did both of my
complete loops at this speed.
[Music]
See, now I can actually make that turn.
>> Yeah,
>> I shouldn't have went for the high
speed.
>> Let's see if he's interested in the gym
now. No, no, no.
>> He really misses all the X's.
Oh, he went that way.
>> Sometimes he goes that way.
>> You want to correct it?
>> I might correct himself.
>> He doesn't like X's.
I tried to train a generic model that
would go like Anyway.
>> Yeah.
>> So, the problem with that is sometime it
goes that way.
>> Outside wasn't too bad last time. I'll
>> do it this time.
You can present Mitchell.
>> Uh, let's see.
No, Jeff.
>> Never mind. Jeff, you suck.
You
>> suck. Jeff,
>> where did you drive during the day? Got
to get back.
>> It should kind of avoid obstacles. So
All right, let's go back inside and uh I
think we're going to end the stream and
then uh we'll deliberate and do some
judging.
>> All right,
>> and we'll tweet a picture on uh on our
Twitter of the who will decide the
winners are.
>> George is not eligible for a
>> prize. I ran out of money on 11 laps.
All
right.
>> Yeah. So, thank you guys for coming
along the stream and uh check in on our
Twitter if you want to see who we decide
the winners are.
>> So, bye 3X. It'll ship Monday.
>> By 3X.
>> Bye, everyone.
>> Bye, Jeff. Bye, JEFF.
>> WAIT.
[Music]
He just keeps grinding. Bye-bye.
yo what up scope he's happy Friday
everybody happy Friday we'll wait for a
few people to get in here look you can
see her broken metrics they're broken
broken metrics wait for a few people to
show up welcome to the comma a periscope
it is it's not a scope you Friday we're
here today to talk about the comma pedal
I'm this Claud you know now I'm in a
good mood today I'm in a good mood today
but but Subaru in the chat ban yo pedal
pedal pedal pedal yo yo yo what up okay
guys I have I have a new piece of
hardware to announce I have a new piece
of hardware it's right here in my other
hand let's wait till we get 60 people we
can do 60
let's get 60 people in here and then I
will show you all the hardware for kamma
pedal we got 50 for your base station DS
not ready yet your your your base
station DS not ready yet no come on we
got 56 come on let's get it up to 60 and
then you guys can see it 59 we're almost
there 60 okay welcome welcome welcome
check it out the pedal is quality just
like the sign says okay so here I am on
the comment
this is the world's first comma pedal
super-strong glue holding it together it
looks like an Apple charger look at that
thing comes in light blue check it out
now remember comma petals are not for
sale we're gonna open source them
sometime next week whenever Eddie
finishes them ah here's a petal so this
is a pedal it's a pedal from an Acura
ILX the way the column petal works is
you plug it into your existing pedal and
it makes your pedal digital so here's a
pedal that's a common pedal and I will
just plug this in right here and now we
are ready to come a pedal this USB
connector is used for debugging and
updating the , pedal firmware of course
it has firmware and this Ethernet
connector is the same fake Ethernet
connector that's on the giraffe's what
cars work with it it should be all
Honda's we think it's all Honda's well
we don't actually know if common pedals
work yet we just got this from the
hardware division right now so cardona
are gonna go out to the Acura and we're
gonna try to make it work um so of
course the Civic needs it a lot less the
Civic needs it a lot less then then the
other stuff because the Civic can
already do stop and go but the common
pedal adds stop and go to the rest of
the Honda's and gives you better more
precise gas pedal control less pulsing
super precision from the common panel in
fact it's just as good as you pressing
the pedal widow the Kama steer comes out
so let's go to the here with Ricardo got
108 people are excited about the column
pedal oh come on fella buzz right so
we're gonna go to the car right now and
we're gonna try it out and we're gonna
see if it works this is completely
untested the codes not tested it is
merged though it's upstreams now you can
check it out on github karma a I pedal
how's the lawyers going
want to say hi this scope is real quick
alright Eddie we're showing the scope is
a comma pedal we're gonna go test it for
the first time ever what do you think
right it's it needs a little bit to seal
properly yeah huh too bad you can see oh
you want to see the board no I mean -
bet you can see why so mom yeah Oh
the car is beautiful I advise looks like
an eye you know what I was looking at
our car I was looking at our car garage
those white USB cables are gross can
confirm does work on apologize to that
one look that door works
you have the good old Acura then you go
to get an iPad charger all right what's
my gamer - IRA you you're you asking
about Subaru your band bro there's
definitely a connector pedal you guys
could definitely get a common pedal yep
you asked about Subaru and you asked for
my phone number bad band I better I
better movie with savage today Savage
right so the actor is disgusting and we
haven't gotten it washed in a while
we're gonna do that today but it rained
and the car washes are closed when it
rains all right so we already have it
Ethernet wire down there don't we do you
know if that's actually like plugged in
to the right stuff I think so cool what
does pedal do panel gives you super
precise digital control over your gas
pedal um you can do the same thing with
an ECU mod but hardware team is better
than car hacking team all right
um it's also more Universal so here's
your column pedal up check the top
connector first cuz we're not actually
sure if that fits
yeah that doesn't fit we're gonna have
to stop the scope e-everyone gonna have
to fix it yeah check out this is my
display childen my acura up this is a
commis maze you can buy this on shop
comedy yard when they're not out of
stock this is a gray panda you can buy
that on shop and come down I would saw
this stock it's an old granite before we
have the proper thing that's actually
terrible mounting the antenna don't
learn from us um here's a neon what
about brake we already have really good
brake control actually how the brake
digital brake control is really good
what's just surprising since the gas
smells already digital I don't know why
they don't just give you good control
but they don't so that's why we built
the common pedal you can check out my
yarn
check out my gear and we save them in my
black Aeons for you guys doing any
meetups we really do
meetups not will Phelps bro bro bro
you're gonna be bad no way to hack into
guys people control we could hack it but
I'm lazy you want to see it you want to
see the calm pedal in person it's not
that great we are gonna open source the
comic pedal the firm was early open
source you guys can go to github come AI
Panda and you guys can check it out
this open source to me have you is a
laptop running ricardo's trying to get
the wires plugged into the comic peddle
comic pedals are new anyway for
simulation with the github Oh failure
pedal hardware um so if it truly
catastrophic lis fails then you will
just lose acceleration on your car it's
pretty safe basically yeah your car
doesn't accelerate put your hands on
pull to the side of the road yeah so
what's that is that is that Q is that as
well if you lose if you lose
acceleration yeah it's QM yeah yeah I'm
here with Ricardo new calibration not
coming with HDR though new calibration
is in progress
we've actually done calibration
correctly now wait no no you want to put
this one into the top yeah the one that
sticks out more gets plugged into the
wire does it does it not that can you
fix the slow acceleration on the Civic
can we fix that software yeah we gotta
fix that the software I complained about
it - it was bad anyone who reminds me of
will Phelps is bad calibration soon TM
eventually TM is like never soon TM as
is maybe yeah I got an already on what
is on pilot getting HDR after after
Scheffer plus I think that's gonna be
Andi sprint next week will come a pedal
also work with Toyota
do the Toyotas with hacking because the
Toyotas don't really separate the gas in
the brake you just feed them
acceleration is that true yes yeah and
like I mean like on a Prius how much
sense does it really make to like Jack
the pedal and you don't want the pedal
you want acceleration control shiver'd
plus usage versus open pilot usage
that's a very secret number very secret
we're doing we don't have for
 is it it doesn't fit I'll try a
little bet if you want to if you want to
take the phone and then if the common
pedal doesn't fit we'll have to send it
back to hardware and we'll have to come
on the periscope later tonight once we
have it fixed all right
here's a skull piece yeah I don't know
any thought that just by clicking that
it would floor Thursday I think this is
the part coming I think it's this part
okay on the other one we totally had to
all rights copies well guess what
we will be back later tonight to show
you a fully operational comma pedal
we're gonna we're gonna return this one
we're gonna return it to comment down a
I slash shop you guys should go there
and buy things today is a great day to
buy things tomorrow's great day to buy
things yesterday was also a great day to
fight us
okay real quick periscope chase this is
a shout-out to you you asked for a
scoping Thursday I'm gonna show you guys
let's go be Thursday so what we're
discussing today let me just put my
laptop away here is right here for sale
on shop comma dot ai
not to be confused with my Thai iced tea
which is not for sale I'm chopped I copy
that I our periscope chase did it you
did it you yes okay
we're showing off is the comma snakes so
much of new pictures of them all look
how nice oh you did a great job with
these oh they look great look at that
new look so they no longer have that
terrible looking tape I do like the fort
we haven't worked that much on the Ford
yet we are here talking about the comma
space so there's a common space and here
I have one right here so your comes
means won't have this terribly ugly tape
this is connected here to a comedy bug a
nakama panda you guys all know these
products comedy bug so just to show you
all look at the new URL that's not to be
you I listen to you I don't know it's
not yeah I'll just show you what you can
do with your comma space so like I've
said that Ethernet is connected let me
just go in here and press all the
buttons I need to bring up a new
terminal and you just tie SS h chase
asked me to show off the space on on on
periscope so gonna show off the snakes
so I can just SSH so this this Ethernet
cable here
it's just connected right to my oh yeah
great of an artist thing okay we'll give
you a sneak preview of the UI as well
but first so right here you can see that
I'm SS aged into my eon right here Oh to
see the new UI you ever seen it yeah
wait you want to just bring it up on a
if you just put the switch on Andrews is
that gonna work and you can see right
here I'm in your manager you just flip
the switch on that know what the switch
on the debug yeah
flip the switch when move okay so we
have way too much of the company you're
trying to huh I'm going to get work here
are the carefully reverse-engineered
state machines from the Toyota ECU oh
look there's some information about the
UI down in that corner now I know what
I'm bringing you guys agree you got into
the stockroom to look at all of the
spaces I think they're in this bin right
here look at these comma spaces
beautiful fresh maze each and every one
of them look at that stage what else do
we have up here oh we have comma powers
Oh Colin powers no way to comma powers
are good but this is a debug born
check out the debug boards it's simply
amazing check out our new red pause we
got a tub full of red pause over here we
got pandas in little boxes oh how nice
of these boxes you I I got guys and
let's see if I can finally come up this
look it's a box of unfinished giraffes
look at Jeff's dress you know what these
are the grant pandas aren't in stock yet
but this is a huge box full of antennas
and we just ordered a thousand more else
so we have a thousand more antennas
coming up there's some eons in
production right there check out those
zeroes are pretty nice alright as a new
UI still loading oh it's low yeah
what do you mean we need to market it
well I'm not sure they need to mock
daily you just need to flip the switch
is there any version to master yes
oh-hoo blue wire doesn't want to hold
the scobie's well I pull master yeah
I'm not turning with moanitors I don't
do that shit so actually you can see
that SSH tin with my comma space so very
useful by a commis maze today and if you
buy panda all pandas shipping now come
in the cutest little boxes you've ever
seen there's a panda box right here
check it out comma dot AI slash setup
you can go to that one so let's go to
that website setup guidance get started
with your new comma AI product to
improve your driving experience today
Panda download the shipper dash cam app
plug panda into your car OVD poi finish
pairing with your shipper app how do you
guys like the new pairing thing where's
it taking forever to download
Josh could you include with on that
marketing what you know I took the what
why what needs improving you don't like
the Box box is nice websites nice yeah
so at least I've been here maybe maybe
the new I works the new UI is nice
that's worth waiting for
we could show we could shown that boy
that's a nice boy yeah yeah look at the
cameras out watch it Steve
oh it's loading Oh guys it's got a it's
got to compile to MPC which takes
forever
what can we show for in the mean get
your midnight black er today this is the
nicest Eon money can buy it's only eight
hundred and twenty nine dollars it comes
with a midnight black heatsink this is a
midnight black built-in compute
unit we've stopped using the p-word
[Laughter]
that's not the P word you don't want
these panels built alright so guys this
is a live demo I really have no idea of
this game yeah check out master I did ok
let's flip the switch right here on my
comedy bug board
yo that's that's pretty nice but I think
that's Oh does it go away would I do
that
yes oh man this is nice stuff people how
to switch two ways oh you just press
this convenient button and then you
press ways and now you're in waves
switch to Spotify very convenient press
here switch back to open pilot oh look
though the lane really goes away when
there's no way no that's nice that's
nice this lights up I think when you're
engaged or something wasteful skiing -
no actually no we don't need the
sidewalk so you can go back to a full
screen mode
oh the pilot only gets full screen what
we call this is using hidden api's for
only our products I think Microsoft
gonna sue for that but clearly it's ok
now look at Apple all right guys open
this let's open this Amazon Prime
together as a parting gift
tear out perforation
to open I really don't know what's in
here those are the fan that I lost my
show do we improve the fan policy no
probably not as much as much well we
would open the Amazon Prime but
unfortunately we're out of time
no bonus mean today yeah so enjoy a new
UI and go shop accommodate a I make sure
to by Thomas phases come space alright
alright
all right
tapping dad
what all right we got we got eight
viewers we got eight viewers all right
you want to introduce yourself hi I'm
Alex she's a longtime periscope watcher
cameras time periscope participant yeah
a lot of pressure a lot of Prayer it's
like those you know when the porn stars
fucked the fans it's very similar I am
so we're driving around in comas newest
car , did legitimately buy this car get
who's eight anyone guess to who lets you
think no that's you thing guess what
race what kind of car do you guys know
we know caught no commenters there's 53
people it's rear-wheel drive drifting
doesn't really ever all wake to
definitely gonna cruise around what you
ought to be doing that no we're actually
we're going to McDonalds guys it's a
Mercedes no it's not a Mercedes not a
Mercedes nope
it is a Volvo it is a Volvo look at them
look at the steering wheel Oh their logo
hasn't changed at all same yeah alright
anyone guess what year it is yeah that's
key really this is a classic it feels
vaguely like a boat
alright it's a 1997 Volvo head guess is
99 8900 disco peas they're participating
love them let's go be spiders baby so
guys old car channel this car so much
interest um yeah so we need if anybody
has a mechanical steering system we were
looking to buy one mechanical pedal
pressing systems old cars channel this
is the new Volvo there's a channel and
slack oh yeah I was telling him how
dangerous building torque interceptors
this alright but it's secretly just
because I want them to build something
that'll work with my Volvo is a great
car tape deck I love this car I got a
great deal on this car I'm Scopus
it can be yours for $1,500 it's on
craig's
right now go on San Francisco San
Francisco Craigslist do we know Mario
who's Mario Mario yeah it's crazy Mario
this car is crazy it's crazy Mario look
at this beautiful burlwood detail yeah
we should go to the McDonald's
drive-through we're here at the good
McDonald's ok I'll go to this one
this one is big flurries I love my
weight we're only fielding legitimate
honestly no is he serious many of those
oh that's it we need to raise it to 2 K
vanilla gorilla to 2 K get 2 K 2 K ok
oh oh oh vanilla gorilla said we'd Oh
someone was offering 2 K my yeah bro
where do you wanna go she ate well we'll
start at $10 will start Julius will you
like do something nice for the person
who buys the car um they'll deliver -
right now I'll pick you up what do you
want
Donald's even off the premium menu if
you want like a buttermilk crispy
chicken house lean assess oh wow I don't
know what all these buttons do I haven't
tried them all yet I think it wobbles
yeah alright for anyone just tuning in
Ronnie 1997 with a 1997 volt latest ,
the latest this is the latest
colourfully car we did buy it
wow it has dumped us and E we're in it
even has power windows I'll buy it if
you take it to me where are usable bugsy
where are you Australia hey look at the
butt just looks kind of like a boat
though it also Pappa wheelie
it comes with a perfectly fit mattress
for the back well no we have to ask
Harold about that oh but it is a station
wagon RV guys were San Francisco it's
got tons of room for activities yeah you
could do a lot of activities on this guy
yeah yeah it depends on what you like to
do that's right
alright George we have 50 people left 50
people watching this shit yeah McDonald
sometime I feel a little bad for this go
piece that library they can turn in for
this they love it they're loving it
right now yeah double denim seatbelt
this car has airbags enjoying the move
no power tools you guys are great ok we
seriously need are like a thing to make
this car steer X Matic if you're out
there if you're ever gonna build
anything
whose ex medic they're people who are
never gonna ship anything Oh like a lot
of people in self-driving cars old cars
we got you old cars we got you wait ok
guys you didn't tell us this I'd watch
trying to turn the radio let's see the
answer I think maybe we should show all
right I'll show the outside you Scopus
what up this is Alex to make oh hell
yeah
wait to the light does have automatic
lights not as automatic lights fun
mm-hmm all right guys we'll show you the
exterior I'm a little concerned about
locking it then it won't on look well I
don't know how did the locks work oh
just just push your lock oh yeah check
it out now you know what wait if someone
steals it they might be doing us a favor
all right guys so this is the Volvo this
lovely car look at this it has wipers
for the headlight we took it at Burning
Man
Wow multiple times
how are the tire treads looking look at
how much tread is in these tires yeah
yeah this is all-terrain tire yeah
no these are Volvo we could sell for the
tires alone no we're not making it
self-driving we are looking to sell it
Oh check out that Wow look at that trunk
space this could be you this could be
you at Burning Man this year at Burning
Man this year in this Volvo yeah yeah
for only two thousand two thousand two
thousand dollars yeah
[Laughter]
oh that's nice oh that is so nice
no but guys seriously you know what you
really want to buy if you got like two
thousand dollars lying around you know
what you can get for half that a
midnight black e on a gray panda and a
giraffe of your choosing
today or we can finally do the Logan
Paul comment on the I slash o sharp how
about I actually redirects there it's
all part of our dude you should you
should do it wow this is good tag team
marketing shipping tomorrow we actually
if you buy it tonight we will
legitimately ship whatever you buy
unless it's a boss draft tomorrow I will
ship it myself I love to like we used to
stamp table they were terrible
yeah that's fulfilled by Shopify I was
great no like fries like in the
McDonald's dude I thought you were
eating healthy no fries let's get fries
yeah your friend sorry okay all right
bye bye bye score peace
[Music]
all right who wants to talk about
servers are servers exciting no no no I
don't believe that for a second they're
boring although we do have a really hot
data center so
all right it's all downhill from here
all right so uh at comma we train models
machine learning models for open Pilots
uh and we always want to train bigger
models faster iterate faster
um and so we need lots of servers to do
that
picture of our prior office we moved to
a new office recently and this is what
we used to have for servers for training
models and um
you can't really see the servers because
this is in a really dirty garage and
um the only way to really filter the air
with a giant garage door and all kinds
of stuff going on in there was to put
filter media right on the front of the
servers
to try to keep the dirt from going into
the servers
so you can see here
this is a four car garage there's room
for four cars and the servers take up
less than one car spot so really not a
lot of space here for our servers
um
this is about 5.68 petaflops of B float
16 performance we measure everything in
B float 16 because that's what our
models are and so that's all we really
care about
um this whole room or this slice of the
garage we spent about 500 000 on the
servers getting power in here in the
ventilation and everything
so in the old office we ran out of power
we couldn't handle the amount of heat we
were generating
this the whole building only had about
200 amps of power that tiny panel in the
picture on the right there is all the
power for the whole building
the ventilation was the best we could do
we had a skylight up in the top and we
had an intake and exhaust fan that were
up in the ceiling you can see the
skylight on the left there I kind of
propped it open because I needed more
airflow because the skylight's pretty
restrictive and for a good reason we
don't want rain coming down in on our
servers but when it was really hot I
would maybe try to prop it opening a
little more get a little more airflow
so it wasn't great we ran out of power
we didn't have enough airflow we wanted
to train models faster we wanted to buy
more servers we didn't have the power
more we wanted to buy more servers more
servers means more power more power
means more heat so we moved to a new
office
a big criteria for the new office was
way more power we found a place with 8X
the power of our previous office and for
the first time the servers are not in a
garage
they have a room
so
uh this is the room that we chose it
started out empty it was not obviously
it wasn't for servers
the first thing we did was we ran 800
amps of power into the room this was
pretty expensive we spent for all the
electrical work in the room we ended up
spending about 125 thousand dollars
the power was kind of on the wrong
corner of the building for the servers
so it was quite a ways we had to run the
power and stuff but thank goodness we
had a place with lots of power so now we
can run lots more servers
so in this room we added a couple short
walls these walls are basically to help
with hot aisle containing the hot aisle
some partial walls the racks obviously
go in between those walls there we have
these 42u racks that we use
we knocked out some windows so I guess I
didn't really explain it but just like
in our last data center we only had fans
it was a garage no air conditioning
we're in San Diego and we can
potentially save a ton of money not
using air conditioning so what we do is
we we just use fans you can see the
windows boarded up here
and then we installed some really big
fans
uh these are
oh thanks yeah I guess the fans are more
exciting than the servers huh the uh the
fans are three horsepower each fan does
about 28 000 CFM uh the room's pretty
small we can exchange all the air in the
room in less than 10 seconds so these
are quite powerful
then inside the room this is one of
those hot aisle containment walls we
also have some fans that recirculate air
so we can basically take the hot air and
bring it back to the cold aisle when we
need to
um because sometimes we need to raise
the temperature on the cold aisle I set
our data center is hot we run a high
temperature Data Center and I'll get
into that a little bit more uh so
sometimes it's not hot enough in our
data center and we make it hotter
and then the last thing was we just used
a strip curtain anti-static strip
curtain to kind of seal off from the uh
from the front side from the ceiling to
the top of the server to the floor if uh
if there's no servers in the racks and
certain in certain racks
then the last thing is
um we want to make sure that the air
temperature from the ceiling all the way
to the floor is a very similar
temperature I'll get into more the
humidity and why but basically we need
an even temperature so we have even
humidity all the way from the floor to
the ceiling so these are called
de-stratification fans they just suck
air in from the ceiling and they push it
back down to the floor to even out the
temperature
so this is what the room looks like
after we built that all out there's two
intake fans on the ends that bring in
air from the outside there goes through
the servers through the racks and then
there's two big fans that shoot the heat
out the back and then on the sides
there's two recirculation fans and you
can see those recirculation fans are
kind of pointed at the intake fans or
where the intake fans blow in and I
thought I was going to do something way
more complicated it turns out you just
point fans at each other and the air
mixes amazingly well so
so in our data center our intake
temperature goes up to 43c Why well we
always want to keep the cold aisle at
the outside temperature or lower and in
San Diego it can get up to it can get up
around 110 degrees sometimes uh rarely
and so that's kind of the max the max
temperature that we designed everything
for on the intake side exhaust side we
try to keep it we try to keep it below
like 55c it generally stays around like
53 at the most so
this is a picture of we buy a lot of
used servers and it's kind of funny to
see we have like temperature history in
The BMC of the servers so you can see
like oh well what What did the what was
this server what was the temperature
this server was like in its previous
life before we bought it and you can see
you know it runs around 21c in some you
know beautiful climate controlled
Data Center and then uh we have a peak
temperature of 42 there once it starts
running in our data center so
we abuse them
you can find data on how much on how
much power data centers often use on
Cooling and it's crazy like I don't know
if most people realize this but it's not
super uncommon for a data center to
spend more power on the climate control
basically on air conditioning then they
give power to the servers
so that's not great like
power is expensive especially in
California we want to use as little
power as possible for the for the
climate control and as much as possible
for the uh
um for the servers
so we do we do way better we if all of
our fans are running full power we're
using eight kilowatts and that's less
than four percent of all the power that
our data center uses and we don't always
use for uh that that four percent or
that eight kilowatts of power in our old
office we had fans that were just on or
off they were either full speed or or
they were zero uh and that made the
climate control a lot more difficult to
to reach a desired temperature and stay
stable and so forth so now we have
variable speed control fans
um this picture on the right here is a
vfd we just have you know they're just
three-phase Motors and you can use a vfd
to basically scale the the voltage and
the frequency up
um and then we can run the fan at any
speed based on on that
there's there's one other big benefit to
this which is if you have big fans when
you turn them on they draw like huge
power initially so so each of these fans
if you just like flip a switch and they
suddenly get power
for a period of time they're going to
draw 80 amps each
and so when they're running once they
get up and spinning full speed uh
then they only use like five amps or
less so the problem is is if you don't
have something like a vfd controlling
your fans then what happens is you have
to leave all this overhead power that
you can't really give to your servers
because well what if the fans need to
turn on so these vfds were really
important in maximizing the amount of
power that was available to the servers
so that we didn't have to leave all this
all this power overhead available just
to turn on the fans
so these vfds basically limit you can
configure how they work but we basically
limit them to the max power that the fan
uses at full speed so if our fans are
using 5 amps when they're running full
speed we don't let it draw more than 5
amps as it ramps up to uh as it gets
started and ramps up speed
for the climate control
we wrote software that we wrote custom
software that does the climate control
we have these temperature sensors this
is a picture of one of the one of the
temperature sensors here that we have
throughout the room uh basically the
inputs to the climate control system is
the temperature and the humidity
um
so what we want to do is we want to
maintain a humidity of 30 to 40 percent
inside the room we actually don't
directly it's kind of unintuitive but we
don't try to control the temperature in
the room we try to control the humidity
uh and since we're in San Diego we don't
have any problems where like it's both
high temperature and high humidity so
anytime it's really hot it's not humid
outside so since that's the case this I
guess this works for us it obviously
wouldn't work for everyone and so uh
yeah so we're just always trying to
achieve a 30 to 40 percent humidity and
the reason that we're so focused on
humidity is because we've had a lot of
problems in our garage data centers with
humidity because when the humidity gets
really high especially if it's dirty
that dust holds some moisture and
moisture on metal is going to cause
corrosion so we need to keep the
humidity below the point where corrosion
will happen and so that's why we we
manage the humidity and try to keep it
down below that 40 percent line for sure
so the way our we have a pretty darn
simple climate control algorithm
basically it uh it takes the input of
the temperature sensors in the room to
get the humidity of the room and the
temperature of the room currently to
figure out like the relative humidity
then
um we know we want to Target this 30 to
40 percent we come up with a temperature
that will achieve that 30 to 40 percent
and then we vary the speeds of the fans
to using a PID controller until we reach
that that Target temperature
um
so yeah
it's pretty basic basically if the
relative humidity is too high we need to
make it hotter because as you raise the
temperature the relative humidity of the
air will come down and if it's too cold
or I'm sorry if it's too cold the
relative humidity will be too high we
need to raise the temperature and
um so we we recirculate the air in that
case and then you have the uh
if the relative humidity is too high
then I'm sorry if the relative humidity
is too low well generally the outside
air has higher humidity than what's in
the room so we're exchanging the outside
air and bringing that in and then
obviously we have like the mixing going
on so that we can we can basically take
the high humidity air that's coming in
shoot hot air at it from the back side
of the servers and get our desired
relative humidity on the cola on the
cold aisle side of the servers
so this is it this is what it all looks
like now uh
we now have approximately
55.88 petaflops of B float 16
performance so we basically 10xed our
our
[Applause]
s with all these fancy new servers we
bought uh well a lot of them are used I
shouldn't say that nudos
um we now have about 10x to the uh the
throughput
and we ended up spending about uh 1.5
million dollars so I mentioned I think
that the all the electrical stuff cost
us like 125 000 all the ventilation
stuff cost us like another 75 000 some
of the equipment that I'm counting here
uh is like money we already spent so
like those those that's included in this
total and then we bought you know
additional servers up to this up to this
number here basically
um so
so how does that compare to other super
computers so all we care since all we
care about is B float 16 performance
it's it's not exactly straightforward to
compare it but we can come up with
something relatively meaningful uh this
top 500 list maybe you've heard of it
before it's like the top 500 super
computers in the world it's not like a
comprehensive list you submit to be on
it if you want to uh we don't and part
of the reason why is because well this
is this is uh fp64 performance which
like who uses that but if you look at
this list and you find
um I look through this list and I found
some systems with modern gpus and uh
if you find systems around like four
petaflops of fp64 with modern gpus they
have around they have around 60
petaflops of beef load 16 performance
and those are around like the 175
certainly above the 200 Mark so in terms
of B float 16 performance we're
somewhere comparable to like 175 to 200
on this very narrow axis at least and um
uh
just for B float 16 performance and if
they have modern gpus some of these are
like all CPU systems and just you know
not really comparable at all
so the high level specs we use about 205
kilowatts of power when all the servers
are running uh Full Tilt we have 580
5088 CPU cores which is actually a very
small number uh we have 640 gpus some of
the gpus we've got all the hardware some
of the gpus are still being installed
but that's what we have in the room just
not quite some of them aren't in the
servers yet
and 2.1 petabytes of solid-state storage
so we have kind of two classes of
servers uh in this system we have
servers that train the models and then
we have what we call rollout servers
that feed the trainers so the trainers
they each have eight gpus
um
that's 2.64 petaflops of v-float 16
performance combined for all eight of
those they have a hundred gigabit
Ethernet and 400 gigabit infiniband so
the the 100 gigabit Ethernet is
basically feeding data into the servers
and the infiniband that's to sync across
the servers so one of the things that we
do now that we didn't really do before
is we often train models on multiple
like train the same model on multiple
servers at the same time so we have this
massive bandwidth to sync data between
the gpus on our trainer servers
so yeah we spend about 25 000 on each of
these servers and for the trainers we
generally buy new hardware
um
to get us the that you can actually
generally get the most dollars per flop
um buying some newer stuff
so the rollout servers they are these
two EU servers that look like this they
we we shove two gpus in them
um
for running models they have 238
teraflops of B float 16 performance then
we have another two gpus for decoding
frames I'll talk about that more a
little bit later here
they have 20 gigabits of ethernet uh we
have 100 of these so they don't need
they don't need massive ethernet
connectivity and then some of them are
part of our distributed file system that
stores all our driving data
um if they do they have this 40
terabytes of storage currently you can
kind of see in the picture here up high
they have some disk drives in them down
low they don't so like those top ones
there are are there we have a dual
purpose rollout servers they're both
part of our distributed file system and
also for rollout
so the 2500 that we spend per server on
these servers doesn't include the
storage
um that's just everything else that's in
there we build these so cheap because we
uh we buy all this I think everything in
these servers is used except for the
disk drives I guess
um which isn't in that 2500 anyway
so that distributed file system that I
was talking about it has all of our
driving data that we use for training
the models
um
So currently I looked and we have 3.84
million segments what we call a segment
is a one minute clip of driving it has
both some video files and a log file for
each segment and we store it in the key
Value Store our distributed file system
is this key value store called mini key
value I talked about it in great detail
in my talk two years ago if you're
interested in how that works but yeah
it's basically a key value store that we
wrote that's super simple we looked at
all the other options and they're like
crazy complex and we just needed
something super super simple it's less
than a thousand lines of code
that driving data uh
it's from 11 000 unique devices so we've
got a lot of we've got a pretty good
amount of data diversity now we
generally have I don't think we've ever
been limited by data diversity up to
this point at least
um so 11 000 devices is basically like
eleven thousand Vehicles 191 platforms
or or types of vehicles uh
cover those 11 000 devices and uh 66
countries there's a lot of there's a lot
of data from a lot of different
countries when we build our training
lists we kind of pick a slice of this
data like the best slice because we
often do things like say oh well most of
our day is from the us but we also want
data from other countries and so forth
we want to keep things like balance so
um so yeah we kind of slice and dice it
and uh
take a subset of all this data to build
our training lists for training models
for openpilot
so the first step or kind of the the
start of the data flow through the whole
training process is reading those video
files those video files are you know
recorded on their you know real people
driving their uh driving their commas
their common devices
the common devices encode that video in
h.265 and one of the first things we
need to do is decode those frames
um and so part of the reason that our
um our rollout servers have both two
gpus for running models and two gpus
just to get more decoders is because we
need to decode we need to do so much
video decoding of these h.265 files so
that whole that whole rollout system
that we have can decode 300 000 frames
per second uh and then so that's mainly
the uh the two gpus two gpus with used
for decoding then those frames feed into
the models that are for example our
simulator and those uh those gpus in the
rollout servers they can output 200 000
FPS once we get all the gpus up in all
those servers
the models that we train for open pilot
that actually output the plan for open
pilot
um it's a kind of a two-step we train
two models basically is what I'm trying
to say for that uh the the input to
those models is like the road camera the
frames the first model the vision model
takes in those frames and outputs a
feature vector
um so that's one model we train that
Vision model then that feature Vector is
input into the policy model and the
policy model
um
takes in the feature vector and outputs
the plan that openpilot executes
so just to give you an idea of what the
size of these models are the vision
model which takes in frames outputs
features it's two efficient Nets at
21.47 million parameters and to give you
an idea of the speed up we achieved by
moving from the old office to the new
office
basically we went from 12 hours in the
old office to four hours in the new
office so
quite an improvement uh really increased
our Ripple time which is great so that
was the first Model the second one the
policy model that we have to train
that one is an MLP with 5.3 million
parameters used to take us 21 hours to
train now it only takes us seven so now
we're like 11 hours now to train the
models that we need to train to ship to
ship open pilot so that's pretty cool
so uh we did a pretty good job 1.5
million is pretty cheap for everything
we built
um the super computer that was like the
closest in that top 500 list that gave
similar performance
um that's like a minimum of
3.75 million dollar computer for sure
and that doesn't include like the
building or you know like all the the
power and ventilation and so forth that
we that I included in you know we spent
on ours so we did pretty good in terms
of dollars per flops
um but we can do a lot better and uh you
know maybe in two years my next talk is
going to be talking about the tiny boxes
in our data center we'll see
any questions
what's up
okay
yeah so the question was uh are we like
unique in running a high temperature
Data Center and he mentioned that like
in Iceland they like do stuff uh
different you know kind of different
setups I've definitely heard of like
high temperature Data Centers before I
don't know like what my background is
not data centers I was a web device I
was a web slash application developer
before I worked at comma who migrated a
big company into the cloud uh worked on
cloud infrastructure at comma and said
wow this is expensive and stupid we
should buy more servers and that's how I
kind of fell into this so
um
so I don't have like industry experience
on this but I've definitely read about
other high temperature data centers what
temperature that is I guess I'm not
really sure and I'm sure they do it for
dollar reasons
um but uh yeah it definitely works I
mean
I don't know why baby I don't know why I
don't know why people baby their servers
so much I guess the like our reliability
in terms of uh temperature I don't think
we've had anything dude failed due to
temperature in any if anything all our
failures were due to corrosion and the
only way we get corrosion is if it's too
cold in our data center so uh
so yeah
uh go ahead in here you're so awesome
thank you
hello I have a question regarding word
usage I noticed that you mentioned the
word data center quite often and I was
watching the geohots podcast with Lex
Friedman a few weeks ago a few days ago
and I noticed that he was reluctant on
using the word data usage because
you guys don't have air conditioning you
guys have fans and yeah so he said it's
not a data center because you're using
fans so my question is what are your
thoughts on this but also second case
did you do any cost analysis on fan
usage because that you use really big
fans versus Air Conditioning ah yeah so
I mean I mean I did some cost analysis
to you know know like I knew what it was
going to cost to buy air conditioning
units that we're going to do you know
200 what was it 205 kilowatt cooling 200
kilo 205 kilowatts of power consumption
you know because that that all turns
into heat and that's like crazy
expensive uh now we bought big fans
um I found like some models that said
like if your temperature difference is
this many C you need this many CFM you
know exchanged to uh you know bring the
temperature down this much and so forth
so I kind of ran some rough numbers
bought fans considerably bigger than
that I think uh and then felt safe that
it was going to work and uh
yeah
is that your only server room or what do
you have for backup solution in case
like there's no power in San Diego for
like three days yeah so I didn't really
talk about our production facing
infrastructure this is all for research
so anything production facing is in uh
is in a cloud provider we use Azure for
uh for our customer facing
infrastructure this stuff it'd be really
annoying if this stuff went down but uh
we're fine with you know some
reliability issues and basically we
exchange uh you know part of the reason
that we can do this so cheap compared to
the cloud one of the reasons we don't
run this in the cloud and we can do it
so much cheaper is because we're not
striving for some crazy number of nines
uptime I mean we are but we'll accept
some down time to save massive massive
amounts of money and but we can you know
like I don't know how much downtime
we've had I guess I haven't really
calculated it which obviously means it
hasn't been a problem so
um
so yeah I guess
yeah we don't run it in the cloud
because it's too expensive compared to
what we've done uh and we know that uh
we know that like our return on
investment is you know if you include
like the cost of the room and everything
uh just for the servers it's like six
months or something like that that we
that we are better off so uh with the
room it's longer but still it's uh we
know it's way cheaper than the other
alternatives
so I have a question regarding the
evision model but what do you use to
supervise this efficient note I don't
know the answer to that
uh uh but the research people would you
should find
your scene or someone or Harold he's
speaking next okay yes you should ask
that question to the next person
I have a question regarding the gpus
that you use yeah it seems the server is
very cheap yeah yeah so what's the
what's the GPU used for the training and
what's for the inference yeah so for
training the cheapest dollars per flop
whatever that is that's what we buy for
training we need the most dollars per
flop you know what you tell me because
if you find something better I would
love to know and I want to buy them
and then so that and then you asked also
for the for the rollout servers so that
we actually need the highest uh memory
bandwidth per flop uh because uh we run
much bigger models
um and so the models don't fit in cash
and when the models don't fit in cash
you end up memory bandwidth limited
because you're running batch size one on
your rollout so for those it's the
cheapest memory bandwidth per flop yeah
I also have another question regarding
the training of the of the model it
seems like there are two models the
perception model first and then there's
a policy model yes and I thought it's
it's end-to-end training should be so
how how's that how do you train these
models separately you should shouldn't
you do this uh end to end great question
for you seeing the next person
save that one
we got a few more questions
uh so you mentioned it takes uh four
hours of the train division model uh do
I mean the whole training process or
just about of the model
what was the first part uh you mentioned
it takes four hours to train the vision
model yeah seven hours of change your
model so does it mean does it mean the
whole training process or just about
epoch oh the whole yeah the whole
training process oh the whole Chinese
yeah yeah that's cool yep
those models are fully trained in in
that many hours
and ready like potential candidates to
ship well I guess they have to be merged
and tested and all that stuff but
hey uh first quick uh uh a quick comment
on the hot data center thing why don't
more people do that I did actually ask
this question by happenstance some of my
old tech leads and he said will it be
too hot for the people in the data
center yeah that was his answer it is
hot in there yeah it's pretty yeah yeah
sometimes it's cold in the rest of the
office though it's actually it can be
refreshing when you walk in there
uh
I mean yeah I'm not really sure
I think a lot of I think it's becoming
way more common I I swear I've read
about some Microsoft data centers that
are all fans and like if you look up
like fan walls you'll find data centers
that have like a giant fan wall
um I feel like that's like kind of Gone
by the wayside now and that was like a
multi-year ago thing now and they're
doing something else but it definitely I
don't know I might even be like a
generation behind there's like better
stuff now probably
wow well I do have an actual question
for you which is
um that was very interesting I will look
up a fan wall
um I want one but
um better than a plant wall
what's uh has anybody that you know have
achieved a lower all-in cost per
petaflop for training and then you guys
I again I don't really have any
experience in like uh industry
infrastructure like server Data Center
building stuff so I really don't know I
think a lot of this information is just
not public either
okay
okay so we're 2x under anything else
George has seen uh I guess we did a good
job I just did the best I could do uh
and I always tell people I don't really
know what I'm doing so I guess you know
why you know why it's so good it's
because this is our third data center
right so we iterated
yeah we think this one is good but two
more and it'll we'll be saying this one
was horrible I'm sure
going back to temperature so you said 50
something degrees Celsius was about as
hot as it gets do you have any idea like
what you're seeing on the actual die I
imagine it's some number oh uh I mean
the gpus they throttle it somewhere
around 88c on the gpus something like
that
um
I'm sure the exhaust gets above 60 but
then it expands out into the room
so
yeah I'm not I'm trying to think of any
other temperatures I know yeah that's
that's the best I can guess
we got time for one more question
anyone there's someone up here oh thanks
Greg
so thanks for the talk
um how long does it take to boot up a
supercomputer do you have to do it in
stages or just
uh how long does it take to what the
super computer
uh to build it no boot
oh they start you power everything off
and then turn back on how how long does
it put most of the I mean most of the
servers Boot and are ready to run things
in I think under three minutes we're
actually talking about like saving even
more on Power by shutting off like 40 of
them and then like turning them on uh
when they're needed so individual
servers they take like three minutes or
so and you know they all start in
parallel so it should be
on the order of minutes single digit
minutes
one more question
uh real quick uh percent wise like let's
say on a 30C day what percentage were
you running your uh your your fans at
and do you run the exhaust and then take
fans at different speeds uh so sometimes
we run the exhaust fans and we don't run
the intake fans and so part of that is
because
um
you saw like there's like baffles on the
fans and they're just uh they're just
like mechanical baffles so we need to
run the fans fast enough that the
baffles open up so there's kind of a
minimum fan speed that we need to run
the fans at uh so we don't run them all
at the same speed we kind of support
using them in a staged manner to uh
to get like a lower airflow than if
they're all running at low speed so for
example like sometimes we run the
exhaust fans and we don't run the intake
fans and say they're running at like 30
percent uh that's that's somewhat less
airflow than if we run the the exhaust
fans and the intake fans at
um at that 30 so uh so yeah we kind of
do that but generally that we're doing
that because the humidity is getting too
high and then we also have the
recirculation going on that's helping
raise it at the same time basically and
then real quick I know y'all said you I
know years prior you had a data sales
thing like for like 200 000 a month did
anybody actually buy it I'm not aware of
anyone no
as far as I know no one's ever taken us
up on that
we do sell a lot of meetings though
all right thank you so much Greg yeah
yeah thanks a lot
all right who wants to talk about
servers are servers exciting no no no I
don't believe that for a second they're
boring although we do have a really hot
data center so all right it's all
downhill from here all right so uh at
comma we train models machine learning
models for open Pilots uh and we always
want to train bigger models faster
iterate faster um and so we need lots of
servers to do
that this is a picture of prior office
we moved to a new office recently and
this is what we used to have for servers
for training models and um you can't
really see the servers because this is
in a really dirty garage and um the only
way to really filter the air with a
giant garage door and all kinds of stuff
going on in there was to put filter
media right on the front of the servers
to try to keep the dirt um from going
into the
servers so uh you can see here here this
is a fourcc car garage there's room for
four cars and the servers take up less
than one car spot so really not a lot of
space here for our
servers um this is about 5.68 pedop
flops of B float 16 performance uh we
measure everything in B float 16 because
that's what our models are and so that's
all we really care about um this whole
room or this slice of the garage we
spent about $500,000 on the servers
getting power in here in the ventilation
and
everything so in the old office we ran
out of power we couldn't handle the
amount of heat we were generating um
this the whole building only had about
200 amps of power that tiny panel in the
picture on the right there is all the
power for the whole building um the
ventilation was the best we could do we
had a skylight up in the top and we had
an intake and exhaust fan that were up
in the ceiling um you can see the
skylight on the left there I kind of
propped it open because I needed more
air flow because the skylights pretty
restrictive and for a good reason we
don't want rain coming down in on our
servers but when it was really hot I
would maybe try to prop it open and a
little more get a little more air flow
um so it wasn't great we ran out of
power we didn't have enough air flow we
wanted to train models faster we wanted
to buy more servers we didn't have the
power more we want to buy more servers
more servers means more power more power
means more heat so we moved to a new
office uh a big criteria for the new
office was way more power we found a
place with 8X the power of our previous
office and for the first time the
servers are not in a
garage they have a
room
so uh this is the room that we chose uh
it started out empty it was not
obviously wasn't for
servers the first thing we did was we
ran 800 amps of power into the room uh
this was pretty expensive we spent for
all the electrical work in the room we
ended up spending about
$125,000 um The power was kind of on the
wrong corner of the building for the
servers so it was quite a ways we had to
run the power and stuff uh but thank
goodness we had a place with lots of
power so now we can run lots more
servers so in this room we added a
couple short walls these walls are
basically to help with hot aisle U
containing the hot
aisle some partial walls the racks
obviously go in between those walls
there we have these 42u racks that we
use we knocked out some windows so uh I
guess they didn't really explain it but
just like in our last data center we
only had fans it was a garage no air
conditioning we're in San Diego and uh
we can potentially save a ton of money
not using air conditioning um so what we
do is we we just just use fans you can
see the windows boarded up here and then
we installed some really big
fans uh these are oh thanks yeah I guess
the fans are more exciting than the
servers huh the uh the fans are three
horsepower each fan does about 28,000
CFM uh the room's pretty small we can
exchange all the air in the room in less
than 10 seconds so these are quite
powerful then inside the room this is
one of those hot containment walls we
also have some fans that recirculate air
so we can basically take the hot air and
bring it back to the cold aisle when we
need to um because sometimes we need to
raise the temperature on the cold aisle
uh I said our data center is hot we run
a high temperature data center uh and
I'll get into that a little bit more uh
so sometimes it's not hot enough in our
data center and we make it
hotter and then the last thing was uh we
just use a strip curtain antistatic
strip curtain to kind kind of seal off
from the uh from the front side from the
ceiling to the top of the server to the
floor If U if there's no servers in the
racks and certain in certain
racks then the last thing is um we want
to make sure that the air temperature
from the ceiling all the way to the
floor is a very similar temperature uh
I'll get into more um the humidity and
why but basically we need an even
temperature so we have even humidity uh
all the way from the floor to the
ceiling so these are called
stratification fans they just suck air
in from the ceiling and they push it
back down to the floor to even out the
temperature so this is what the room
looks like after we built that all out
uh there's two intake fans on the ends
that bring in air from the outside there
goes through the servers through the
racks and then there's two uh big fans
that shoot the heat out the back and
then on the sides there's two
recirculation fans and you can see those
recirculation fans are kind of pointed
at the intake fans or where the intake
fans blow in and uh um I thought I was
going to have to do something way more
complicated it turns out you just point
fans at each other and the air mixes
amazingly well
so so in our data center uh our intake
temperature goes up to 43c Why well um
we always want to keep the cold aisle at
the outside temperature or lower and in
San Diego it can get up to it it can get
up around 110 degrees sometimes uh
rarely and so um that's kind of the max
the max temperature that we design
everything for on the intake side
exhaust side we try to keep it we try to
keep it below like 55c it generally
stays around like 53 at the most um so
this is a picture of uh we buy a lot of
used servers and it's kind of funny to
see uh we have like temperature history
and The BMC of the servers so you can
see like oh what what did the what was
this server what was the temperature
this server was like in its previous
life before we bought it and you can see
you know it runs around 21c in some you
know beautiful climate controlled Data
Center and then uh we have a peak
temperature of 42 there once it starts
running in our data center so we abuse
them uh you can find data on how much on
how much power data centers often use on
Cooling and it's crazy like I don't know
if most people realize this but it's not
super uncommon for a data center to
spend more power on the climate control
basically on air conditioning than they
give power to the servers so that's not
great like power is expensive especially
in California we want to use as little
power as possible for the for the uh
climate control and as much as possible
for the uh um for the
servers so we do we do way better we if
all of our fans are running full power
we're using 8 Kow and and that's less
than 4% of all the power that uh our
data center uses and we don't always use
for uh that that 4% or that 8 kilowatts
of power in our old office we had fans
that were just on or off they were
either full speed or or they were zero
uh and that made the climate control a
lot more difficult to to reach a desired
temperature and stay stable and so forth
so now we have variable speed control
fans um this picture on the right here
is a vfd uh we just have you know
they're just three-phase Motors and you
can use a vfd to basically scale the the
voltage and the frequency up um and then
we can run the fan at any speed based on
on that um there's there's one other big
benefit to this which is um if you have
big fans when you turn them on they draw
like huge power initially so each of
these fans if you just like flip a
switch and they suddenly get power for a
period of time they're going to draw 80
amps each
um and so um when they're running once
they get up and spinning full speed uh
then they only use like 5 amps or less
so the problem is is if you don't have
something like a a vfd controlling your
fans then what happens is is you have to
leave all this overhead uh Power that
you can't really give to your servers
because well what if the fans need to
turn on uh so these vfds were really
important in maximizing the amount of
power that was available to the servers
so that we didn't have to leave all this
all this power overhead available just
to turn on the
fans so these vfds basically limit you
can configure how they work but we
basically limit them to the max power
that the fan uses at full speed so if
our fans are using 5 amps when they're
running full speed we don't let it draw
more than five amps as it ramps up to uh
as it gets started and ramps up
speed for the climate control uh we
wrote software that we wrote custom
software that does the climate control
we have these temperature sensors this
is a picture of one of the one of the
temperature sensors here that we have
throughout the room uh basically the
inputs to the climate control system is
the temperature and the
humidity
um so what we want to do is we want to
maintain a humidity of 30 to 40% inside
the room we actually don't directly uh
it's kind of unintuitive but we don't
try to control the temperature in the
room we try to control the humidity uh
and since in San Diego we don't have any
problems where like it's both high
temperature and high humidity so anytime
it's really hot it's not humid outside
so uh since that's the case U this I
guess this works for us it obviously
wouldn't work for everyone and so uh
yeah so we're just always trying to
achieve a 30 to 40% humidity and the
reason that we're so focused on humidity
is because we've had a lot of problems
in our garage data centers with humidity
uh because when the humidity gets really
high especially if it's dirty that dust
holds some moisture and moisture on
metal uh is going to cause corrosion so
we need to keep the humidity below the
point where corrosion will happen uh and
so that's why we we manage the humidity
and try to keep it down below that 40%
line for sure so the way our we have a
pretty darn simple climate control
algorithm basically it uh it takes the
put of the temperature sensors in the
room to get the humidity of the room and
the temperature of the the room
currently uh to figure out like the
relative humidity then um we know we
want to Target this 30 to 40% we come up
with a temperature that will achieve
that 30 to 40% and then we vary the
speeds of the fans to um using a PID
controller until we reach that that
Target temperature
um so yeah
it's pretty basic basically if the
relative humidity is too high we need to
make it hotter because as you raise the
temperature the relative humidity of the
air will come down and if it's too cold
uh or I'm sorry if it's too cold the
relative humidity will be too high we
need to raise the temperature and um so
we we recirculate the air in that case
and then yeah if the uh if the relative
humidity is too
high then and I'm sorry if the relative
humidity is too low well generally the
outside air has higher humidity than
what's in the room so we're exchanging
the outside air and bringing that in um
and then obviously we have like the
mixing going on so that we can uh we can
basically take the high humidity air
that's coming in shoot hot air at it
from the backside of the servers and get
our desired relative humidity um on the
cola on the cold is side of the
servers so this is it this is what it
all looks like now
uh we now have approximately
55.88 pedop flops of B float 16
performance so we basically 10 xed our
our
uh with all these fancy new servers we
bought uh well a lot of them are used I
shouldn't say that new to us um we now
have about 10x the uh the put and uh we
ended up spending about uh $1.5 million
so I mentioned I think that the all the
electrical stuff cost us like
$125,000 um all the ventilation stuff
cost us like another
$75,000 some of the equipment that I'm
counting here uh is like money we
already spent so like those those that's
included in this total and then we
bought you know additional servers up to
this up to this number here basically um
so
so how does that compare to other
supercomputers so all we care since all
we care about is B float 16 performance
it's not exactly straightforward to
compare it but we can come up with
something relatively meaningful uh this
top 500 list maybe you've heard of it
before it's like the top 500
supercomputers in the world it's not
like a comprehensive list you submit to
be on it if you want to uh we don't and
part of the reason why is because well
this is this is a fp64 performance which
like who uses that but if you look at
this list and you find um I looked
through this list and I found some
systems with modern gpus and uh if you
find systems around like four pedop
flops of fp64 with modern gpus uh they
have around they have around 60 pedop
flops of B flat 16 performance and those
are around like the 175 certainly above
the 200 Mark uh so in terms of B flat 16
performance were somewhere comparable to
like 175 to 200 on this very narrow axis
at least and um
uh just for B flat 16 performance and if
they have modern gpus some of these are
like all CPU systems and just you know
not really comparable at
all so the high level specs we use about
205 kilowatts of power when all the
servers are running uh Full Tilt uh we
have 58 5,088 CPU cores which is
actually a very small number uh we have
640 gpus some of the gpus we've got all
the hardware some of the gpus are still
being installed but that's what we have
uh in the room just not quite some of
them aren't in the servers yet um and
2.1 pedabytes of solid state
storage so we have kind of two classes
of servers uh in this system uh we have
servers that train the models and then
we have what we call roll out servers uh
that feed the trainers so the
trainers they each have eight gpus um
that's 2.64 pedop flops of B float 16
performance combined for all eight of
those they have 100 gbit ethernet and
400 gbit infiniband so the the 100 gbit
ethernet is basically feeding data into
the servers and the infin band that's to
U sync across the servers so one of the
things that we do now that we didn't
really do before is we often train
models on multiple like train the same
model on multiple servers at the same
time uh so we have this massive
bandwidth to sync data between the gpus
uh on our trainer servers
um so yeah we spend about 25,000 on each
of these servers and uh for the trainers
we generally buy new hardware um to get
us the that you can actually generally
get the most dollars per flop um buying
some newer
stuff so the roll out servers they are
these two U servers that look like this
they we we shove two gpus in them um for
running models they have 238 teraflops
of B float 16 performance then we have
another two gpus for decoding frames
I'll talk about that more a little bit
later here uh they have 20 gbits of
ethernet uh we have a hundred of these
so uh they don't need they don't need
massive um ethernet connectivity and
then some of them are part of our
distributed file system that stores all
our driving data um if they do they have
this 40 terabytes of storage currently
you can kind of see in the picture here
up high they have some disc drives in
them down low they don't so like those
top ones there are are uh they're we we
have dual purpose roll out servers
they're both uh part of our distributed
file system and also uh for rollout
um so the 2,500 that we spend per server
on these servers doesn't include the
storage um that's just everything else
that's in there uh we build these so
cheap because we uh we buy all this I
think everything in these servers is
used except for the disc drives I guess
um which isn't in that 2,500
anyway so that distributed file system
that I was talking about it has all of
our driving data that we use for
training the models um
So currently I looked and we have 3.84
million segments what we call a segment
is a one minute clip of driving it has
both some video files and a log file for
each segment and we store it in the key
Value Store our distributed file system
is this key value store called mini key
value I talked about it in great detail
in my talk two years ago if you're
interested in how that works um but yeah
it's basically a key value store that we
wrote that's super simple we looked at
all the other options and they're like
crazy complex and we just needed
something super super simple it's less
than a thousand lines of
code that driving data uh it's from
11,000 unique devices so we've got a lot
of we got a pretty good amount of data
diversity now uh we generally have I
don't think we've ever been limited by
data diversity up to this point at least
um so 11,000 devices is basically like
11,000 vehicles 191 platforms or or
types of vehicles uh cover those 11,000
devices and uh 66 countries there's a
lot of there's a lot of uh data from a
lot of different countries when we build
our training lists uh we kind of pick a
slice of this data like the best slice
because uh we often do things like say
oh well most of our data is from the us
but we also want data from other
countries and so forth we want to keep
things like Balan so um so yeah we we uh
kind of slice and dice and and uh take a
subset of all this data to uh build our
training lists for training models for
open
pilot so the first step or kind of the
the start of the data flow through the
whole training process is reading those
video files uh those video files are you
know recorded on their you know real
people driving their uh driving their
commas their comma devices um the comma
devices encode that video in
h265 and one of the first things we need
to do is decode those
frames um and so part of the reason that
our um our roll out servers have both
two gpus for running models and two gpus
just to get more decoders is because we
need to decode we need to do so much
video decoding of these h265 files uh so
that whole that whole roll out system
that we have can decode 300,000 frames
per second
uh and then so that's mainly the uh the
two gpus two gpus with used for decoding
then those frames feed into the models
that are for example our simulator um
and those uh those gpus in the rollout
servers they can output 200,000 FPS uh
once we get all the gpus up in all those
servers
the models that we trained for open
pilot that actually uh output the plan
for open pilot um it's a kind of a
two-step we we train two models
basically is what I'm trying to say for
that uh the the input to those models is
like the road camera the frames the
first model the vision model takes in
those frames and outputs a feature
Vector uh so that's one model we trained
that Vision model then that feature
Vector is input into uh the policy model
and the policy model um
takes in the feature vector and outputs
the plan that open pilot
executes so just to give you an idea of
what the size of these models are the
vision model which takes in frames
outputs features it's two efficient Nets
at
21.47% in the old office to four hours
in the new office so quite an
improvement uh really increased our
reppel time which is great uh so that
was the first Model the second one the
policy model that we have to train that
one is an MLP with 5.3 million
parameters used to take us 21 hours to
train now it only takes us seven so now
we're like 11 hours now to uh train the
models that we need to train to ship um
to ship open pilot so that's pretty cool
so uh we did a pretty good job 1.5
million is pretty cheap for everything
we built um the supercomputer that was
like the closest in that top 500 list
that gave similar performance um that's
like at minimum a
$3.75 million computer for sure and that
doesn't include like the building or you
know like all the the power and
ventilation and so forth that we that I
included in you know we spent on ours so
we did pretty good in terms of dollars
per flops um but we can do a lot better
and uh you know maybe in two years my
next talk is going to be talking about
the uh tiny boxes in our data center
we'll see Tiny
[Applause]
yeah any
questions what's
up yeah so the question was uh are we
like unique in running a high
temperature Data Center and he mentioned
that like in Iceland they like do stuff
different you know kind of different
setups uh I've definitely heard of like
high temperature Data Centers before I
don't know like what my background is
not data centers I was a web de I was a
web application developer before I
worked at Kama uh who migrated a big
company into the cloud uh worked on
cloud infrastructure at comma and said
wow this is expensive and stupid we
should buy more servers uh and that's
how I kind of fell into this so um so I
don't have like industry experience on
this but I've definitely read about
other high temperature data centers uh
what temperature that is I guess I'm not
really sure uh and I'm sure they do it
for dollar reasons um but uh yeah it
definitely works I mean I don't know why
baby I don't why I don't know why people
baby their servers so much I guess the
like our reliability in terms of uh
temperature I don't think we've had
anything due failed due to temperature
in any if anything all our failures were
due to corrosion and the only way we get
corrosion is if it's too cold in our
data center
so uh so
yeah uh go ahead yeah you're so
awesome I agree thank
you hello I have a question regarding
word usage I noticed that that you
mention the word data center quite often
and I was watching the geohot podcast
with Lex fredman a few weeks ago a few
days ago and I noticed that he was
reluctant on using the word data usage
because you guys don't have air
conditioning you guys have fans and yeah
so he said it's not a data center
because you're using fans so my question
is what are your thoughts on this but
also second case did you do any cost
analysis on fan usage because you use
really big fans versus air condition
uh yeah so I mean I did some cost
analysis to you know know like I knew
what it was going to cost to by air
conditioning units that we going to do
you know 200 what was it 205 kilowatt
cooling 200 Kil 205 kilowatts of power
consumption you know because that that
all turns into heat and that's like
crazy expensive uh now we bought big
fans um I found like some models that
said like if your temperature difference
is this many C you need this many CFM
you know exchanged to uh you know bring
the temperature down this much and so
forth so I kind of ran some rough
numbers bought fans considerably bigger
than that I think uh and then felt safe
that it was going to work and uh
yeah is that your only server room or
what do you have for backup solution in
case like there's no power in San Diego
for like three days yeah so I didn't
really talk about our production facing
infrastructure um this is all for
research so anything production facing
is in uh is in a cloud provider we use
Azure for uh for our customer facing
infrastructure um this stuff it'd be
really annoying if this stuff went down
but uh we're fine with you know some
reliability issues and basically we
exchange uh you know part of the reason
that we can do this so cheap compared to
the cloud one of the reasons we don't
run this in the cloud and we can do it
so much cheaper is because we're not
striving for some crazy number of nines
uptime I mean we are but we'll accept
some downtime to save massive massive
amounts of money um and but we can you
know like I don't know how much downtime
we've had I guess I haven't really
calculated it which obviously means it
hasn't been a problem um so
uh so yeah I guess um yeah we don't run
it in the cloud because it's too
expensive compared to what we've done uh
and we know that
uh we know that like the our return on
investment is you know if you include
like the cost of the room and everything
uh just for the servers it's like six
months or something like that that we
that we are better off so uh with the
room it's longer but still it's uh we
know it's way cheaper than the other
Alternatives right got a question back
here um so um I have a question
regarding the vision model what do you
use to supervise this uh efficient night
uh I don't know the answer to that
that uh but the research people would
you should find youen or someone or
Harold he's speaking next okay yes you
should ask that question to the next
person I have a question regarding the
gpus that you use it seems the server is
very cheap yeah yeah so what's the
what's the GPU used for the training and
what's for the inference yeah so for
training the cheapest dollars per
flop whatever that is is that's what we
buy for training we need the most
dollars per
flop you you I you know what you tell me
because if you find something better I
would love to know and I want to buy
them and then so that and then you asked
also for the for the roll out servers so
that we actually need the highest uh
memory bandwidth per flop uh because uh
we run much bigger models um and so the
models don't fit in cash and when the
models don't fit in in cash you end up
memory bandwidth limited because you're
running batch size one on your roll out
uh so for those it's the cheapest memory
bandwidth per flop yes I also have
another question regarding the training
of the the model it seems like there are
two models the perception model first
and then there's a policy model yes and
I thought it's it's end to endend
training should be so how how is that
how do you train these models separately
should shouldn't you do this uh end to
end great question for you seeing the
next
person save that one we got a few more
questions uh so you mentioned it takes
uh 4 hours to train the vision model uh
do you mean the whole training process
are just one app of the model what was
the first part uh you mentioned it takes
four hours to change the vision model
and seven hours to change the MMP model
so doesn't me mean does it mean the
whole training process or just the one
iog the whole training the whole yeah
the whole training process oh the whole
training process yeah yeah that's cool
yep those models are fully trained in in
that many
hours and ready like potential
candidates to ship well I guess they
have to be merged and tested and all
that stuff
but hey uh first quick a a quick comment
on the hot data center thing why don't
more people do that I did actually ask
this question by happen sance one of my
old tech leads and he said well it' be
too hot for the people in the data
center yeah his answer it is hot in
there yeah it's pretty yeah yeah
sometimes it's cold in the rest of the
office though it's actually it can be
refreshing when you walk in
there
uh I mean yeah I'm not really sure I
think a lot of I think it's becoming way
more common I I swear I've read about
some Microsoft data centers that are all
fans and like if you look up like fan
walls you'll find data centers that have
like a giant fan wall um I feel like
that's like kind of Gone by the wayside
now and that was like a multi-e ago
thing now and they're doing something
else but it definitely I don't know I
might even be like a generation behind
there's like better stuff now probably W
well I do have an actual question for
you which is um that was very
interesting I will look up a fan wall um
I want one but um better than a plant
wall what's uh has anybody that you know
of achieved a lower all-in cost per peda
flop for training than than you guys I
again I don't really have any experience
in like uh
industry infrastructure like server Data
Center building stuff so I really don't
know I think a lot of this information
is just not public either I promise you
the answer is
no
I'm
okay so we're 2x under anything else
George has seen uh I guess we did a good
job I just did the best I could do uh
and I always tell people I don't really
know what I'm doing so I guess you know
why you know why it's so good it's
because this is our third data center
right so we
iterated yeah we think this one is good
but two more and it'll we'll be saying
this one was horrible I'm
sure going back to temperature so you
said 50 something degrees CS was about
as hot as it gets do you any idea like
what you're seeing on the actual die I
imagine it's some number oh uh I mean
the gpus they throttle it somewhere
around 88c on the gpus something like
that um I'm sure the exhaust gets above
60 but then it expands out into the room
um
so yeah I'm not I'm trying to think of
any other temperatures I know yeah
that's that's the best I can guess
we got time for one more question anyone
there's someone up here oh thanks
Greg so thanks for the talk um how long
does it take to put up a superc computer
do you have to do it in stages or just
uh how long does it take to what the
super computer boot boot boot up uh to
build it no boot oh to start you power
everything off and then turn back on how
how long does it boot most of the I mean
most of the servers Boot and are ready
to run things in I think under three
minutes we're actually talking about
like saving even more on Power by
shutting off like 40% of them and then
like turning them on uh when they're
needed so um individual servers they
take like three minutes or so and you
know they all start in parallel so it
should be on the order of minutes single
digit
minutes I don't know where you see
one oh we got one more
question uh real quick uh percent wise
like let's say on a 30C day what
percentage were you running your uh your
your fans at and do you run the exhaust
and then take fans at different speeds
uh so sometimes we run the exhaust fans
and we don't run the intake fans and so
part of that is
because um you saw like there's like
baffles on the fans and they're just uh
they're just like mechanical baffles so
we need to run the fans fast enough that
the baffles open up so there's kind of a
minimum fan speed that we need to run
the fans at uh so we don't run them all
at the same speed we kind of support
using them in a staged manner to uh to
get like a lower air flow than if
they're all running at low speed uh so
for example like sometimes we run the
exhaust fans and we don't run the intake
fans and say they're running at like 30%
uh that's that's somewhat less air flow
than if we run the the exhaust fans and
the intake fans at um at that 30% so
uh so yeah we kind of do that but
generally that we're doing that because
the humidity is getting too high and
then we also have the recirculation
going on that's helping raise it at the
same time basically and then real quick
I know yall said you I know years prior
you had a data sales thing like for like
200,000 a month did anybody actually buy
it I'm not aware of anyone
no as far as I know no one's ever taken
us up on that we do sell a lot of
meetings
though
all right thank you so much Greg yeah
thanks a
[Applause]
lot
all right scope ease okay so first off
check out our Dooley on technology do
you know only one Eon is on but first
off where are we going we're going a
Home Depot let's type that into our yuan
Hao Depot not home right let's go now
ways
alright scobie's always going to that
let's go do people show up so fast these
things I don't go like on to like
subscribe just this for the Accord no no
this is not funny Cory you're right here
in the comma grab for and we're here to
talk to you about the coma tree the
comet rate not the comma 3 whoa whoa
what's that I don't know no no the comma
tree is a the best way to mount your uh
your your your your GPS your second
grape and on the grape and the base
station yeah so you have to put your
antenna high so we can see the sky and
you don't want it to be interviewed with
by anybody so we are about to build the
common tree we're driving the hardware
store right now I just put Home Depot
into my ways oh oh yeah I made my way
he's not talk cuz I hate when way stalks
don't like being told where to go by
always we have Dooley on technology but
one Jana Jana is broken also broken like
we can turn it on but it's my tactical
Panda and then we need to split her out
again that was just such disaster but
can you show there how nice our focus is
oh yeah our eons now have autofocus
shipping soon
not even soon TM actually soon yeah no
now our eons do not yet stop at red
lights unfortunately let's stop for that
person you're so pretty black seem like
a big outline nice Apple come on they
don't like when you turn them a lot they
get sick get sick you can read out their
questions so there's what we usually do
when he's so he has to buy flowers for
his own hand what does that mean that's
interesting desu yo guys it turns out
that you can use the phase detection
autofocus to determine the length to
things in front of you so all you Subaru
people without radars focus is that
Harold yes that's me and my name is two
days
No well nobody does well the focus is so
good I've never seen the focus be this
good before
this autofocus it is it's actually
really good yeah now it's kind of
focused on the car in front of us
someone says I love you George
thank you does autofocus improve federal
control oh no that's you're gonna have
trouble with new models for that
actually all the focus will improve it a
bit probably yeah um autofocus will
probably help a bit with the ping
ponging issue but no no guys you all
know that this is just the beginning
this is just the beginning we're
starting to get everything super precise
in fact that's what the common tree is
for yeah the comet is amazing yeah by
the way if you guys haven't seen it
right now scope ease go to shop code on
the eye and check out the product shots
of the injection molded panda it looks
so good
Oh somebody asked whether I won in Age
of Empires you practice no I didn't know
I gotta practice a little bit in price
nope it's not anymore
somebody asked when's the new model
where's your lighter and where's your
app Linux okay you want to see where our
applet X's it's right here inside this
gray panda okay this is well we do have
the antenna on the roof though antennas
do work better when we're on the roof
well we have an athletics replacement
it's really almost as good except for
the fact that it doesn't your dual
frequencies how can you see without a
laser point about oh my god okay I don't
know if they're just trolls with the
stupid lighter like honestly bro I mean
I'm not even crazy like Elon agrees with
me and the man ly lands rockets okay
so like I can't be too crazy about this
stuff yeah somebody asked when will
Harold be replaced by AI hopefully not
that soon oh yeah like machine AI is
kind of janky but like that's the thing
you learn about AI if you try to use
like AI for GPS it would be like janky
and whatever break you wouldn't really
know why I would break and like how do
you get good ground truth in the first
place
isn't that true for Harold - I mean yes
yes but it's easier for me to check
Harold's work than to check it oh my god
we don't have the mod yet I've forgot
about hack in the rav4 oh yeah okay we
have reef lashes for the rav4 let me
show you what my reflash can do
unfortunately my speed is too low right
now but you see that set speed it says
zero miles an hour we can turn our
cruise control on at zero miles an hour
unfortunately it still doesn't
accelerate will show the Scopus you can
put the cruise control all the way down
all right wait doesn't accelerate from a
full stop well no you but the cruise
control all the way down to zero but it
doesn't do anything because the only
thing we've actually managed to change
was like the number that it says all
right so we made the wrong patch so this
rav4 is actually running custom firmware
but it's running wrong custom firmware
so does that freak you out does this
work for a home data core 2018 that's a
bad question
go get it does it work I don't know bro
what are you gonna make it work you all
do agile process animates Oh a job I
read a book about that it's like like
scrum you know some people do scrum as
well wait I don't even know the right
way
oh we got a good of John Daly oh my god
is this by the loop good yeah it's like
a few miles south somebody asks I'll p2k
if you put it on out EA six to the
bounty good bounty for how to get forced
out EA sixes use flexpay as well so all
like the high-end German caught is that
like people actually want to drive use
flex pay flex right kind of sucks wait
why there two antennas here well this
was the antenna testing oh so many does
the retail store have a parking lot do
we have a retail store retail store yeah
you were there for the night at the
retail store yeah is that a thing yeah
it's happening really did you call them
oh this is amazing everyone if they give
they give you a good deal like honestly
I was on the staff and like they're like
wow you want a retail store what
business objectives does it achieve and
then I told them that I hated business
again it's fun yes exactly
somebody asked that you can hang out in
module cars in the parking lot yeah of
course yeah you're welcome
like let's just take over West portable
yeah exactly somebody asks for stickers
for their car well if you buy call my
products in it stickers that's true
and I'm willing to contribute to the
Audi bounty great yeah I mean I don't
think it's gonna matter really how much
of a bounty be put on Audi's because
flex pays too hard there's a bounty up
for a flex return Seaver - like that's
the first step someone needs to build a
flex panda Oh relax and wait the Panda
doesn't receive flex right okay where's
the comma tree well the comma tree is in
Home Depot right now yeah we're gonna go
buy it
we're buying a 4x4 like a big thick wood
you know it's like a two-by-four but but
what if we just bought two two by fours
and nailed them together that's still
wobbly I think no they'd be nailed
together even why would we did buy a 4x4
that's a good point
how about you get it home it sounds like
a shitty fool I mean what's the
difference being
like it's just thicker right our size
limitation is by two four by fours and
then bolt them together we'll get some
like steel things kind of we could do
that yeah call my tree projects they're
taking them a lot of time to come a tree
project through Oregon
you don't be nice if on the open pilot
screen it showed you your directions
that'd be nice if anyone out there from
commenting eyes watching I complain
about bugs some time on the periscope -
I hope somebody's watching most people
watch it somebody says just buy a fence
post well that's exactly what we're
doing buying a big thick fence post yes
um so we were originally gonna put the
antenna on the roof but the roof at the
calm imagined it being a mansion normal
is very steep um so we call some people
and we send some pictures and they were
afraid to go on the roof I was about to
go on the roof myself
do you guys know I'm a maverick I would
do it oh wait you send pictures in there
like that no they sent pictures and they
were like now yeah that's Yeah right I
thought that's what these people's jobs
so what I saw - and like I don't know
man I think I could make a living if I
just like you haven't watched like dying
Mama's YouTube videos and there's real
calling is coming on roofs and filming
shit right somebody's asked me what I
think although that might by the way
shout out dying llama we haven't have to
go to level support in our code because
um you know you know you know they're
asking you know what we do during a
climb that's right but I hope so yeah we
disengage we don't believe it's
appropriate for computers to make
ethical determinations it's two two by
fours smaller than a four by four No -
two by fours is exactly this big is it
for life is that true because no two
avoids on a 2x4 right wait they're not
if you don't know the scam no they're
1.75 big 3.5 but that's a big difference
so you don't know about the too much
horse camp I don't know if this is true
about four by fours like I kind of feel
four by fours are actually four by four
because I kind of feel like that wider
than a two by four that's it somebody
says a four by four is three point five
times three points okay fine it really
is just two two by fours bolted together
that's how they make for my force
turns you need Python programmers of
just JavaScript ah if you are just
honestly all we really care about is if
you're intelligent motivated if you are
intelligent motivated and like though
honestly if you're like intelligent
motivated I don't care if you don't know
it doesn't matter just just like for
example the autofocus stuff I've been
doing it right it doesn't require any
special skill you just need to like
don't be smart and persistent and stuff
um so if you can do that well I give me
a job of calming I will check like your
getup stars and stuff got a lot of stars
I get out pretty good I mean like look
guys you here's like the things that we
here's like the skills that we we value
okay so we look at where you went to
college and then we probably forget
about that because nobody cares um and
then we ask you questions like how long
does it take light to travel a foot did
you go right yeah okay I mean these are
like good things to know right it's
useful knowledge somebody says this
angles not very flattering for George
well I'm sorry I'm not a very good
cameraman I mean it's just kind of your
face is half black kind of look like a
half of the car bro this car is actually
running custom firmware right now yeah I
know right
no but the new model is gonna be so much
better to look in focus on us
yeah it's never been in focus before
this is better than the slider you guys
and all these improvements are of course
coming completely free to your yawns I
can auto focus is $3 deal say um no
seriously oh but it's about to get I
mean not for a bit you're gonna have to
wait a bit but by the end of the year if
you get the hardware now you get it
installed in your car by the end of the
year what open palette 0.5 comes out
you're gonna be like wow that was what
of what an incredible shift life
distance is measured in meters not feet
and it depends on what are we doing
today well we're going to build a common
tree country which is a base station for
your gray panda yeah you got to put your
great pan to antenna where it has a good
view of the sky and it's unobstructed by
trees so this is generally high up and
if you want to get things high up you
need a big pole and we're gonna buy a
big pole I mean we could provide a real
tree but real trees wobble fake trees
are better 3.5 times 3.5 it's been ADEA
somebody says the internet says one
nanosecond will yeah that sounds about
right that's two now like okay you know
it's like no understand intuitive
physics right what's the difference
between a camera on a ladder
cameras use light music's lidar has a
laser is that what makes light our work
how does light our work I don't know if
you answer that question too precisely
you'll get to by whele will you release
the custom firmware oh for the rav4 yes
as soon as it works bro yeah we will
release Oh Panda Express we tweeted at
them on Twitter to try to get them to be
the exclusive IRL distributor of the
kava ai Panda they didn't tweet back at
us unfortunately but if anyone you want
to go inside and ask we have like some
retail packages and what we'll do that
on periscope no well do that on YouTube
we'll do that for the kama vlog yeah
[Laughter]
this is funnier than coning planking of
wagang was great with that side yeah
that's what the school wasn't too happy
about my planking
that's what PewDiePie said a meme isn't
a 10 out of 10 until somebody died
[Laughter]
alright guys thank you for joining us on
the drive to the Home Depot sure to uh
like you know hit that subscribe button
below subscribe a periscope right
midnight blackity on shipping the
fifteenth absolutely bro everything is
shipping the 15th Eddie has been working
super hard Eddie if you're out there
watching back to work oh yeah it's been
doing a great job
everything's gonna show up even great
pandas by the 15th so get your orders in
today shop comma dot ai you know where
to go more scope e scopes yes I love the
scope ease man you guys are the
strongest family on periscope you guys
too
now see I don't get angry you gotta
really like these aren't flattering
angles fighting I love you guys too I
love the scope ease bye bye see ya
we're live
do I have enough battery I just realized
all right
on stage here take this and they'll turn
them once you get on stage
wait is it online
[Music]
[Music]
[Music]
see
you're alive on the stage we are going
to be it's not everyone should be either
with us today
thank you for tuning in
a few years ago uh I asked the team you
know if there's anything that you could
do or change like a bowel because I mean
GitHub they said you know it would be
great if we could
um get more contributors
not everything benefits from having
people contribute and so we invented the
commies
as kind of joke and now they're real
um and today we are going to award all
our amazing contributors
uh specifically from the last year
we're happening
um
all right
[Music]
thank you
again
[Music]
yes
and not only is he committing he's
refining oh boy
he leaves
he stuck with us
ten percent
thank you
he lives in China
in person but we really look forward to
the time when we could have to be join
us on stage and I hope one day in the
future he could be a contribute our
presentation
let's talk about some highlights from
Dean Lee's constitutions yeah so uh
unreal
yeah I just tagged the issue it's like
you want to fix that at this
and I woke up and he's like in the
different time zone so it is like every
morning at Christmas when we need just
drop some beautiful prns in their labs
sometimes multiple wow yeah in this case
has been working on a requesting
features bug fixes
thank you
all right thank you Dean Lee for all
that you do we will uh ship you
've asked her about it
I'm trying to
find them I don't know anything about
this man I don't know what he looks like
is it true he could be 10 people we just
don't know
true Mysteries
um
or her you know
we used to start up building his own
Papa Neo it's an opening issue and uh
we had to figure out that YouTube video
we thought it was at a comma two or a
comma three we learn to do that
real-time Ohio
oh yes and there's some more you can
hear you even the regular lunchtime
mystery picture yeah who is who is the
man behind you leave
um
so thank you
[Music]
[Applause]
there's Dragon pilot
foreign
[Music]
you're so funny
stage
[Applause]
so
um somebody's been really great at this
as soon as you see somebody in the
Discord kind of new channel influences
he really reaches out and asks another
route and just forces
thank you
[Applause]
hello everyone it's sunny here and uh to
anyone that's using funny pilot I'm just
going to imagine going to before
any issues or any requests that people
like just let me know you can always DM
me or just go to my physical server and
uh if you want to support a new car
that's
as much as I can and yeah I'm going to
be in this community
[Applause]
[Music]
so this next person uh you might have
seen them around
um
multiple people
we only see one here
this is
today
[Applause]
I know it was a track from Texas the DFW
area
I feel like Eric has been in the
community
people
do you have some words you want to say
I fight for the people
[Applause]
this next person
has been here I think before I don't
know
um
[Music]
um
okay I just have this one story I can
think of I can't do that that's perfect
but I just remember I was working on
this one problem with the General Motors
card
yes Consulting whenever we try to study
this in your community survey and I have
reached out to him even though he didn't
have the bar and they were going on
before because he comment interesting
and I reached out to him and I have all
the contacts and I needed
the uh already able to provinces that I
think we were from them they really it
was a really good job
here is
um yeah because you know that great
brand new building
[Applause]
oh
Mustang
and I really feel like no one is
everything
I think he has five how many is it how
many CWS do you want
currently five
and then me and my wife and then I've
got a garage
thank you thank you
tonight I truly appreciate all the
things you do for the community I think
there's a lot of click on the points
that's right
let's go
so I think Jason is the I don't think
he's certainly the oh proud contributor
who I have to review their PR's release
what I reckon that jcpr I'm already
ready for the first book and I have to
remind myself I got to do that fast
change tab keep checking out real quick
because I'm emerging information don't
put that responsibility on me
it's uh it's the best quality camera
thanks again dude
[Applause]
I think that's it for our lives
honorable mentions yes
maybe not a whole commonworthy this year
but if you see you and we're excited
about what we're doing and we appreciate
it
so we've got one who was previously
shouted out in a talk um he's big in the
GM Community he made things are pretty
popular sport that recently popped up on
our dashboard it seems growth he's very
interested in your data he'd love if you
upload it to them
yes
he's got some novel ideas
it's doing your car it's twasenko
[Applause]
um
[Music]
the joints is this or Discord Community
reaches out to the hundreds of
Discord remember matters
artists and similar ly and it's really
all that inspironment
that I can put together
yeah yeah something about uh so we
realized that he was like personally
picking people and asking them to upload
data so that he can see what's up and we
were like where where we have all the
data in the world so which inspired us
to create the data set I mean we were
talking about it before but never really
prioritized it
[Music]
that's exactly the kind of thing that we
encourage a lot which is like you can
hyper optimize something to work great
on your cars and that's perfect and even
if it's even if it aren't really
Upstream it because it's like super
specific to your car that is great I
mean that just simply it is more
developers to you know working over
pilot and doing your own cars and at
this time generic enough time you can
like stream
everybody everybody can benefit from it
but that's that's good that's like
amazing and we really encourage all of
you to look at your Vlogs and see what
you can say thanks thank you
[Applause]
but this next person is also not here
but he's well known in the driving
feedback Channel as uh replying to every
single person with a customized video
the route we're flying on here yes so
this is uh an awesome daytime
[Applause]
honestly you guys should do the same too
I try to be a good example
[Applause]
all right now we want to do a final
shout out for FL 2.0 members
any of them are here you want to stand
up
more
[Music]
thank you
[Applause]
truly
again soon right
yeah well I got the F-150 driver yeah
um here we got a couple of members here
today
um you guys found the bugs
it's always great when we can ship this
stuff get some feedback
because
it's time around
and it was a lot more chill than last
time so really a little look at every
single report I think it was a really
great experience too every morning
on our code name cheese yeah it turns
out we don't drive nearly as much as we
thought so but you guys really
appreciate um
it's funny for him self-driving car
company Focus company
we driving we're very well
everyone lives close to the office and
we've been working so hard everyone's
driving a road trip I really appreciate
the community uh helping us it's
critical
yeah you guys uh
I think 5x came out again
yeah different environments different
cars and things like you know be part of
succession
yes yes we've got lots of new cars
canopy cars especially thank you guys
again you're formerly released from NBA
your previous experiences
[Applause]
all right thank you guys for tuning in
it's a real pleasure really
we really truly appreciate the
development community and the work that
you guys do it's really nice to see so
many familiar faces uh please if I
haven't met you I would love to please
come chat it please
um thank you have a great night
thank you
yeah what up guys all right I'll wait
for few people to get in here no secrets
what up what up what up just make sure
this went out on Twitter good I got a
message on Twitter well let's see what
my request is sometime we should do
public shaming of the people who uh oh
okay alright alright nevermind that was
that was a good yeah thanks yeah go good
um yeah sometime we should do public
shaming or the people who email me and
send me like these like like just just
horrendously bad pitches um so I'll show
you guys
here's our prototype gray panda check it
out this is a little I gotta fix up the
u-blox firmware sorry I gotta fix up the
nothing looks fun where the the serial
firmware in the Panda to make it live
stream everything better
but know what we're here to talk about
today is to let you in the body like you
to check out okay
humans are coming Gilson real soon guys
real soon you know always soon oh um
good but no actually here to talk about
the Corolla we rented a Toyota Corolla
and here it's beautiful
57 scope yeah all right all right what
do we got down here is this that's not
the Corolla where to go Prius um there's
our rav4 Ricardo is that Corolla is this
it here
yes there is this still life
you come back oh it's lagging no no okay
Wi-Fi I'm sorry guys
I didn't make I didn't make the cell
phone pin I didn't make the cell phone
network you want to pull that when you
pull that piece out cool okay
oh you know the same as the usual Toyota
stuff you just remove that thing from
the rear view mirror now it's good right
we go bro good boy you good bro no
gaming quality so what's really nice
about the Toyotas is they all have the
same interface which is not true about
the Honda's where there's at least well
how many different plugs have we said I
guess there's really only seen three
plugs yeah that relax well and then
there's the Odyssey which has the same
plug but upside down so we're just gonna
plug in our toyota giraffe here
available shop comedy I always be
plugging March should work and so there
we go we're in a Toyota giraffe we have
a panda we're gonna plug it into this
ego on over here oh yeah
all right and then we should let the car
home to grab you go for mounting another
Spina because I need to fingerprint a
cow first got it guys this is the same
thing that we do know we're not doing a
fusion port we are only we're really
focusing on Toyota this year so oh
you're not powering it yes so you have
to power it otherwise appear no I wanna
choose the started swish-swish thing
yeah there we go
is it connected yeah all right good good
here we go okay cool cool camera next
yeah all right I do want a sensation
from the arrow do you want to go get out
nice eh phone from here okay we could go
get one of the new uh oh the new life
though new laptops yeah yeah we have new
laptops designed for making development
easier could someone explain other
Toyota's are superior to the fourth well
first off there's a whole lot more
Toyotas than Ford's you wanna maybe pull
forward a little so we can get better on
the Wi-Fi make the quality higher you
guys so we're getting we're getting
Wi-Fi from the house um
Toyota's aren't Ford's no that is that
is good that is definitely true on the
driveway ah oh
is anyone in out of the back well no I
guess do you want to take it out though
right
well I just gotta take a while it's
gonna take a while cool loving the
rear-view mirror set up ya know we keep
the rear view mirrors on cars now we
don't take them out we used to take them
out but then through illegal things
Toyota is far more reliable than Ford
yeah that's probably true what's Cody no
there's no light our guys there's no
light all right there will be HD Maps
what up how do you add to the fusion
boundary um I would actually love to see
someone pour it one of the Fords it
shouldn't be that hard it's lagging
again
I thought we fixed the lag no no no no
no no oh wait we're on LTE for some
reason I don't know why Wi-Fi is not
working
all right should be very good now it's
not better Cody's a movie player oh I
don't know about movies on the odds bus
but yeah so is that open source script
get fingerprint yes open source it 0.40
my truth yeah so we have a script now to
get fingerprint so it's getting the
fingerprint here from the car so the
best thing is if you run it by having a
car cycle so there are some messages
that I like slow ok so you can see and
so to get them it's better like if you
start up the car some of them are sent
right the way when you start the car
those steel Athey cool hey did you watch
me before yeah let's let's wait few more
seconds I forget exactly have a
fingerprint of work so it's like having
more messages is okay you want to have
all the messages because if you get a
message that is not in your fingerprint
he's gonna think that it's not it's not
okay okay got it
it goes by exclusion you want to get
them all yes
so we now have a fingerprint yeah
which this is all this is all documented
on our wiki yeah it is dropping really
so a course
we have we have some some predator
Helios 300s the Dell is actually nice we
can go look at our liner later we do
have some lighters get t-mobile we have
t-mobile and all the other of the other
things oh you want to go landscape
alright alright guys so we have some
exciting news
we found a box full of pandas so these
are gonna ship out
hella soon browse we got all these
pandas ready to go so you know it's it's
one to six weeks if you're on the
earlier end of the one to six weeks
you're gonna be getting a panda very
shortly
check out these heat sinks from eons all
right you guys here's the here's the
Aeon build plan you know we got to get
we got to get all the neons built but um
yeah let's make sure the god of secrets
you guys you've seen the Calvi sign
what does the finger prick different
standard versus a high weights by an
external Wi-Fi repeater we're actually
gonna do that well we're kinda getting a
better Wi-Fi in the backyard cool guys
well we'll check in on this later we're
gonna try to do the toyota corolla port
in one day one day toyota corolla port
we will certainly work on getting better
Wi-Fi outside i understand how the
streams are hard to watch when it's
laggy any new Nvidia stuff want to see
your Nvidia stuff will show you Aaron
video stuff
it's pretty nice in video they really
come aways and improving the like
quality of the experience of the
hardware you can get for them if you are
a self-driving car company we recommend
working with in video they don't super
easy to work with you today like hooked
us up with all this stuff it's kind of
hard to ship which is why we're not
working on it just yet a lot of the
stuff we're doing is still it's still
mobile phones which all have
unfortunately Qualcomm maybe maybe the
next Aeon we'll have a Nintendo
switchman Nintendo switch has a
hesitates to two or one which labels
self-driving car company is the mooing
doing the most damage oh no I don't
think any of them we're really doing
damage I mean some people just like like
you look at I really don't like what uh
I'll sit on to the quality sign we'll do
a little Q&A for the periscope um I
really don't like what like like Ford
does when they talk about all smart
cities cities of the future like this
kind of hype it's it's it's it's bad
because it's it's setting people's
expectations to be unrealistic um it's
not really bad to be honest like none of
this stuff really matters I'm a big
believer in like what you say doesn't
matter that much you know you can you
can say whatever you want your PR and
who cares right if you're measuring
based on PR metrics it might matter if
you're measuring based on like profit
and revenue it doesn't matter
look at Comcast look at all the money
Comcast Maggi everyone hates them right
Comcast could literally say we hate you
and you know people still buy the
Internet
it's a fact Tesla has an interesting
brand but Brenda kind of stupid you the
truth is Tesla just ships the best the
best electric car you can buy by far
cool thanks for joining we'll check back
on this later and there will be updates
throughout the day of our Toyota Corolla
port and this is just because team
localizer is taking a long time um team
localizer team localizer is a very hard
task ahead of them so let's not be too
hard on team localizer but we're gonna
be able to localize with
hence enemy precision in our HD Maps
we're really close to it we have it
working offline we just need to get this
thing working
online and then you guys know that by
the end of the year we are going to open
source all of our HD maps I think
they're gonna be nicer than a lot of the
ones that are out there today I'm
completely automatically generated using
machine learning so we are looking at
putting you know companies like here
Maps companies like deep map TomTom all
of these companies their entire product
we're gonna give away a better version
of it completely free yeah there's a bit
of refactoring going on - so the Toyota
Corolla should get easier but just
remember guys if you're out there
working at an HD mapping company it's
not our core product we make money we
sell Aeons we sell pandas we're raking
in money from hardware so we're just
gonna open-source the HD maps and give
them away for free because information
should be free what's the bet and Falcon
Heavy I think it'll work I think it'll
work I'm excited for that launch um I'm
excited to see us take over the world -
cool thanks for joining labour scobie's
I'm gonna try to do the Logan Paul thing
we're like now I just need it to like
turn off automatically but I can't do
that
I'm a terrible vlog
on YouTube.
>> YouTube is a lot more stable. I checked
the video yesterday. It looked
>> good enough.
>> Cruising in the market.
>> All right. Yeah, we got awesome.
>> Cool. We're ready.
>> All right. Welcome to com hack, guys.
This is the uh third stream and final
one. We promised three cars, Rivian,
Tesla, and the Mache, which is the same
as the F-150.
Um, and we'll do the Mache today. And
then we'll do a quick drive with Jason
and the ID4 after that. And that unlocks
the next gen of VWs. Finally mock time.
Yeah. Yeah. Finally mock time. Stream
looks great. We're inside right now. So
it'll look great. It looks like it's a
nice day.
So we got the upstairs crew, the uh
Aeroba here who's committed to working
on Flex right now. Right. Right.
>> Yeah. Yeah. [laughter]
>> We're all going to hold up to it, right?
So, Ro is committed to Flex Ray. He
says,
>> "I'll I'll I'll sell votes."
>> You can do votes.
>> 100 votes.
>> Who's voting for FlexRay? Anybody in?
>> How much? $1,000.
>> Yeah. $1,000.
>> $1,000 for a vote.
>> Flex harness.
>> Just committed to the flexay harness.
You excited about that?
>> $1,000 a vote. How many total votes?
>> Like, how big of a mob do we need to get
together?
>> 20 votes.
And then we got the autonomy team here
working on the Subaru port.
>> Shane, the car team here, Lucas and his
uh 500.
>> We got Sunny Pilot right over there.
And then we got uh the hackathon. We got
a couple more rooms down there. We'll
check out in a sec. We'll go.
>> Yeah. Welcome to KMA Hack.
>> All right. Should we go down to the
monkey? All right. Looks like he's going
to go for the drive with us. Okay.
You really charge us a lot to be here.
So, we're going to get our money's
worth.
We have to get Sunny Links to your
subscription. We have to pay Sunny
Premium.
>> No, right now it's free.
>> It's free. Yep.
>> Oh, that's cool. It's a better deal
Prime.
>> Yeah.
>> Um
>> once we add more features, uh then we'll
talk right now. It's all completely
free.
>> All right.
>> What's up, Mike?
>> And then we got you. You want to show
off your thing real quick?
>> You can just show them. You don't have
to do a demo.
>> Well, I mean, I have a demo at 4 p.m.
>> You have a demo at 4 p.m.?
>> Yeah.
>> Okay, we'll post that on Twitter then.
>> Uh, yeah.
>> But yeah, this is You seen setup here.
>> My coffee test.
>> This is coffee. And, uh, this is an SO
100.
>> Uh, is it
>> What's this logo you got here?
>> Well, that that was for Christmas.
>> Oh, it was for Christmas. Okay,
>> that's my Christmas logo.
>> I see.
>> Um, so I'm collecting data uh using the
arm to pick up this uh coffee pot and
put it here. They're asking when MLSM.
>> Uh when this is shipped.
>> Okay, cool. So, body first, then MLS. We
had another team here working on the
puppy, but maybe are they in the gym
now? Let's check the gym.
And then we have a bunch of people in a
parking lot nearby, but uh we won't go
to that.
>> Oh. Um
>> you guys want to show your project?
>> Uh well, we're trying to get it running
on his laptop now cuz I was I was
hogging the
>> Okay, but yeah. What do you you guys
want to just describe it real quick?
>> Oh, yeah. We're just trying to make the
dog walk.
>> Yeah. Okay.
>> Just like lowle control like just
getting like the legs moving, making it
walk.
>> Yeah. David found a cool paper on what's
it called?
>> Central
>> pattern generation.
>> Central pattern generation. So, we coded
it up and we got it running and it works
pretty pretty well, I got to say.
>> Cool.
>> Yeah.
>> Very exciting. You guys have something
ready for uh presentation?
>> Yeah. Yeah.
>> You have a cool demo?
>> It will be very cool. All right, great.
There you guys are the first people who
have been very confident in the demo.
All right, head down to the mocky now.
Down to the mock.
Oh, Shane wind it up for us.
So, the driver Sunny will give us an
update on all those Hyundai. We got an
EV9 for him here. That got an EV9. We
got a Tellide right there. Uh, what else
did we get? We got an ID4 we'll drive in
in a sec. It's our Model Y.
We rented the Subaru the autonomy team's
working on.
Shane, can I hand it off to you?
>> Yeah.
You want experimental mode?
>> No.
You left my desk device in here?
Screen's broken the moment.
>> Yeah, I got to get a new desk device.
>> All right.
Didn't install a common power in this
car. This install is a little involved,
but fortunately there's a good community
video for it.
Um, otherwise it's a really solid open
pilot car. All the cars we we've been
working on this weekend um are really
great cars. All the Hyundai are they
have like tons of torque and everything.
>> Yep. A lot of torque.
>> Nice. We need to toggle off experimental
mode real quick.
>> Okay. Uh can we do that? We have to
reboot.
>> Let's just park.
>> Okay.
>> All right, let's go for a drive. All
right, you guys have been asking for the
F-150 in Maki for a long time. Um, it's
been a community for us for a while,
but now it is in Open Pilot Master. If
you buy a device, you can select your
car in the drop down right now on the
website. $9.99 for a 3X. Um, we'll ship
it to you. Right now, you're going to
have to type in a little special URL to
get the nightly build of Open Pilot. Um,
but next week you'll just be able to
install Open Pilot normally with the
release branch. Um,
and it should be a pretty great home
open for. Um, not sure what this guy's
up to. Wait for him. Um,
there's not too much to say about the
monkey. Just works. Um, shout out to I
think the fork's called Blue Pilot. Are
you familiar with them? There's uh Isaac
who does a lot of testing. Yep.
>> Um, who else is in that in that uh neck
of the community? There's a whole lot of
people in the Ford community. I think
there's about 100 people driving around
on this platform already. So, it's very
solid. They've already ironed out a
whole lot of the bugs. It's almost
exactly the same as our Bronco platform.
Let's see.
Let's see. Let's see.
All right. We'll do the same test loop.
Let's get up to speed.
I want to go.
So, it's curv curvature control just
like the other ones. Uh, very stable
wheel. You can like disturb it. It's
very solid. Um,
it's really solid car overall. Not the
biggest fan of the car, but the open
pilot port really good. Um, it won't
have open pilot longitudinal on release
yet because we don't have the radar
parcel for it. The community has a start
at it. Um, maybe we'll polish it up for
the next release and ship it. Um, but
the 4Q3s already have the radar and
that's coming in next release. Um, so
this is a really big release for Ford.
For the other Fords, we up the torque a
whole lot at low speeds and we added a
pilot lock by default. And then what's
called the Ranger is the last one, I
believe. Um, but yeah, super smooth
curve.
This is just what open B looks like
nowadays. It's incredibly solid on the
highway.
We posted the uh we did the Rivian video
and it was like super smooth
>> and uh but you know the video that got
all the traction was the one with the
steering wheel like not you know it was
basically untuned.
So
open pilot is such a hard cell because
when it works it's it's like you just
don't notice it.
Like that's open pilot at its best right
now. It's not doing anything too crazy.
It's just driving on the highway a very
chill way.
>> I think the AC is too loud.
>> Oh, you can turn it off.
>> How you do it?
I don't know. Actually,
too much. There we go.
>> All right, Sunny, do you have any
updates?
>> You want to talk about what you've been
working on at the hackathon?
>> What's that?
>> You want to talk about what you you've
been working on at the hackathon?
>> Yeah. Um, so been working on the EV9
port and also a few tail rides and uh
yeah, right now steering is working uh
on both cars. We have some uh safety
code to figure out, but other than that
drives very smooth on the highway and
we'll we just continue driving like you
don't want to go there. So yeah, so far
we just
>> got what like 11 ports in the queue.
>> Yeah, we have 11 ports. Uh we got some
PRs merch this weekend. Uh mostly open
DBC, but you know, we're slowly making
progress. hopefully get more cars on on
upstream and uh support in the in the
future releases. So yeah, pretty solid
so far.
>> So we have a goal for the end of the
day. We want to be at 300 supported cars
in the list. Um we got it we entered the
weekend I think with like 287. We're up
to 295.
Oh, the stock ACC was not good here.
Open Pilot is so much better than the
Ford stock ACC. So hopefully 099 we can
finish up the the radar parser. I think
really the community should be able to
to finish it up. Um, the tooling for
that is pretty good. Um, but you can go
ahead in the developer settings and if
you have one of these cars, you can just
toggle this to get the open pilot
version. It'll be vision only. Um, but
if you have the radar setup and this car
is is all set up for it. It just needs a
parser written. Um, it's already going
to be way better than the stock ACC,
especially at stop and go. I drive the
Bronco every day and uh the pilot ACC is
a huge huge improvement.
Maybe we can uh poke around with
experiments on a bit when we're back.
We'll try some lane changes here.
>> Somebody asked if the uh model will make
space for cars that you're passing.
>> Not yet. Experimental mode is better at
this. Um you can see like a lot of these
fundamentals, experimental mode, it
understands vaguely like what's going on
in the scene. Um it just doesn't execute
things super well. Um it's not very
robust. Um, but you can really if you
pay attention to these nuances in
experimental mode, it gets a lot of
these behaviors like it it has some
understanding what to do. Chill mode has
no understanding. Chill mode is just
like is there a lead car? Otherwise, I'm
going to drive this SP. Um, it's just a
conventional cruise control system,
but experimental mode, um, we we talk
about this every time. Um, you guys, I
think, will be quite surprised once it
just works. Um, and you'll understand
why we always say this is all we're
working on. We're gonna ship MLSM and
then that'll allow us to ship good end
to end longitudinal.
Um I think most people now there was
some sentiment over the last like four
years since we shipped laneless. Um
especially like you know from the Sunny
Pilot type crowd. Do you guys still have
laneful?
>> Mhm.
>> Do you guys still have like a laneful
mode?
>> Yeah, we do.
>> You do? Do do you drive on it?
>> Uh I honestly haven't driven it for a
while but some users still prefer that.
uh some models don't work well some for
some cars but so uh you know it's just
kind of something that is you know make
sure that it actually stays in the lane
so some people still use it but not not
a whole lot
>> I think the general consensus in the
community is um like laneless is just
strictly better there may be like one
spot on your commute where you're like
man I really wish I had lane lines and
it just centered in the lane
>> but on the whole people I think
generally prefer laneless um it took a
while to get there but it's like you
tell when you go through an intersection
or something, it just gets what's going
on. In a way, a system that's just like
looking at the lane lines and it's has
all these heristic setup is just never
going to get it. And you can see that
kind of stuff with experimental mode.
Um, it's just not very robust. Um, and
this really makes it hard to kind of
appreciate its good qualities, but I
mean, we know it's not daily driving.
All right, let's up the set speed here a
bit.
>> Yeah, very solid tune.
>> Drives very nice. Yeah, car is very
nice. That's really the theme with all
the new cars these days. Uh people are
always like, "Oh, the compatibility
isn't growing." It's growing. It's
growing. I mean, it's a lot of cars. Um
and there's just a lot of cars that are
the cars are getting a bit more unique
and each one is a bit special these
days. So, it requires more care. It
requires us to drive down the complexity
to support a car um and drive down the
effort. Um it's a whole lot of
validation to get a car to this point.
Um,
but I think we're making good progress.
We should hit 300 sport cars this
weekend. Um,
be very excited for that. I think Sunny
will get the 300th support car. That'll
be pretty cool.
>> Uh, once we get the EV9 working, uh, the
2025 Honic 5, the Genesis GV80, 2025.
So, all the ang So, all of the newer
Hyundai Kia Genesis, they're all angle
control uh, for steering. But uh once we
got the EV9 which is using the same
steering API uh the Ionic 5 all all the
other ones that also use the ankle
control will be very easily supported.
Probably just a few lines of code just
to support the platform and uh it will
just work. So right now drives very
solid the highway very smooth lane
change is much better than the stock
system and uh yeah very excited to grow
cars on the on autopilot.
>> Cool. Yeah. I don't know. I've never
driven a blues cruise but uh it's not
called blues cruise. It's like Blue
Cruise.
>> Blue.
>> We call it Blues Cruise. Not really sure
why.
>> It's like a a Blues Clue. Blues Clues.
Is it like a kid show or something?
>> Yeah.
>> Yeah. Yeah.
>> Somebody said they're new to Open Pilot
and they wondered what laneless was.
>> Oh, okay. So, what laneless means is uh
so when we say end to end, what that
means is you see these like lane lines
predicted in the UI. Before laneless,
Open Pilot essentially would just try to
center. It would try to predict the
lanes and then center between them.
Um but now what open pilot does it looks
at the video and all we ask of the model
is like where should we drive um and
then when we say longitudinal we just
say how fast should we drive um just
given this video and it looks at the
whole scene and it's able to use all of
that context much more so it's a lot
richer than just the lane lines. So we
say end to end that's what we mean. Um
you could say like laneless and end to
end are are basically synonyms for the
lateral control. Um, and it allows it to
feel very humanlike.
>> So, give a for somebody who's very new,
we'll give them like a quick overview of
how the system works. Um, you know,
there's about 20,000 comma devices out
there gathering data, driving every day.
Um,
we get their data back, we train models,
and the models we ask the question like
where should we drive and how fast
should we drive and that's what we refer
to ant lateral, anti longitudinal. And
it essentially tries to drive like the
human ground truth. Um
so some systems they'll they'll claim
like you know you we want to like far
surpass the human baseline. Um our
philosophy is you know humans are
incredibly good. There is no system
remotely
remotely as good as a human. Uh you know
if we can get a system that drives as
well as a human this is already massive
massive thing.
you know, like the human driving policy
will be learned from human data. Um,
and we want to ship the first fully
learned policy later this year, in the
next couple months.
>> Somebody asked ETA for the new 2024
Subarus.
>> 2020. Do you know if the
>> I think ours is a 2024 Forester that we
rented.
>> Oh, cool.
>> Yeah.
>> Yeah. So, maybe maybe this release,
maybe next release.
>> Reese research team is working on ankle
control for your Subaru. Yeah.
>> Yeah.
>> We got the research team working on car
ports this weekend.
>> They're using their uh internal ML model
on their head.
>> Don't worry, they'll be back to MLS
tomorrow.
They're uh they're poking into the car
stack now.
>> Spectre still likes the lane lines in
the UI though.
>> Uh yeah, we have any plans for that.
>> All right. Should we try experiment mode
real quick?
>> Sure.
>> We'll try it at this exit. Exper mode is
Oh, we got a toggle.
>> It's okay though. This was stock long.
No,
>> that's all right. We got to reboot.
>> Okay,
>> that's all right. Okay. No, no
experimental mode. You guys know
experimental mode drives. This car has
it. Um,
you know how it goes.
>> Somebody wants to know if the highend
die refactors will make it easier to
support more cars like the non SEC cars.
>> Uh, no. We will never support their own
cars, but um signing pilot here does.
>> Um, yep. We use uh Sunnif supports
steering only. Uh as far as for ACC, you
have a lot more than just software. A
lot of things are really you need you
need the hardware the car to actually
support ACC. So unless the user is
willing to dedicate a lot of hours to
just install the actual hardware needed,
which is ABS controls and etc. Uh it's a
lot of work and it's not really
something that is can be easily
supported. So um but we we do support
steering only. It works. It works great.
Um, yeah,
>> but the refactor should in general make
it easier to support new like
configurations, right?
>> Yeah. Uh, the refactor definitely will
make uh supporting any platforms super
easy. So, right now uh we do a lot of
feature we call feature detection, but
it's really just detecting the APIs that
we use for steering for uh signal
detections and all that stuff. But after
the refactor, it's just simple as just
making one line change and uh Open TPC,
Open Pilot just knows exactly what this
car needs and just works. So that's the
goal.
>> We took well we took Sun uh Sunny in the
fulfillment room and it's like the Lego
store with like all the Hyundai
harnesses. We have this like big wall of
harnesses
>> and you just got to like you know most
of them are for Hyundai cars. Um
>> I think so we sport 40 I think 25 of
them are for Hyundai's.
>> Yeah, 25. pretty crazy and just keeps
growing unfortunately.
>> And then the code like just looks
basically just like that where each car
is like very very slightly different.
Got it.
>> You got it. Click okay. Cool.
>> Um yeah, that's what we're doing this
weekend. Um we're trying to get all
these models supported. We did the
Creta. I believe we did the Nexo Nero.
Hyundai Nexo.
>> What else did we do? We did the Kona
2023.
>> Kona. We kind of did the Kona. We had to
dash cam it.
>> I explained why. Unfortunately,
>> unfortunately.
>> Uh,
>> Jason already.
>> No. No. Jason.
>> No.
>> Um, oh, you know what? We should talk
about fire hose mode.
>> So, Sunny Pilot has a big announcement.
I don't think we've talked about this on
on stream yet.
>> Yep. So the latest unpilot codes or
master new or with the branch master new
dev C3 new and staging C3 new uh
currently it's sync with the latest open
pilot code. So what that means is that
if you're running that branch on Sunny
Pilot all your data will be used in
training in the training set by uh by
KML. So uh uh Sunny Pilot is the first
fork that's that is uh allowed to have
the data used in the training set for
training the models and all that. So
very excited to to join that to join
that. Yeah. Yeah, for sure.
>> One of the big features in 098 is
massively increasing the data ingestion
and the data quality that we're getting
in um such that when MLS works, we can
train really really big models with uh
with all that data um and with our
bigger we want to show them the data
center. You guys can see the kind of the
back of the data center. You see all
this cooling we have here. Um so the
data center is right behind this wall um
right behind these windows. Um that's
where we have racks and racks training
the models for you guys. Um
and we've already 4xed the uh data
ingestion and with this release it's
probably going to be another 10x um and
maybe another 2x with signing pilot. So
that is huge huge increase. Um and with
fire hose mode just to recap that that's
a new feature in 098 where you can bring
your device inside and uh you bring your
device inside you plug it into a wall
charger you click enable fire hose and
then we will just pull all the data that
we want for training. Um, so that's
really a way you can maximize your your
uh training data uploads and make sure
that you are represented in the training
set. You can make sure Open Pilot is
like has watched you and learned how to
drive from you. Um, no guarantees you're
in the training set. You might be in the
test set. Um, you know, open question
whether you want to be in the training
set or test set. Um, but you know, you'd
rather be in the training or test set
rather than no set.
>> Um,
>> yeah. And now you get to use your
favorite features on Sunny Pilot and get
your data upstream to to get train
better models. Did we check the camera
timings after that? It should be like
super robust now.
>> It is very robust.
>> Oh, cool.
>> Yeah, I I I loaded on plot juggler and
it looks
>> nice. Nice. I shipped beautiful camera
timings a couple weeks ago.
>> They were really beautiful. Um,
>> you know, research loves their their
very accurate time stamps. Um, so
>> they're going to get them even on Sunny
Pilot now. Um,
>> you know, you really have this problem
in open pilot generally where you know,
the forks want to like run a lot of cool
fun things. Um, and a lot of the stuff
in open pilot is meant to run very real
time. So, if you start adding all this
extra stuff, um there's no guarantees
around that. Um and it's kind of hard to
do well. But the way we did the
beautiful camera timings, um it should
be very robust this. And then if other
stuff lags, I mean, that's fine. It
doesn't affect training. It's just a
quality thing for the fork and they can
manage that on their own.
>> Cool.
>> Spectctor wants to know if fire hose
mode is different than just like going
connect and clicking all of those.
>> Yes. So, the key with fire hose mode is
the data that you get goes right over
here into our training cluster. Um all
the data we train on is at the office.
If you go in connect and click uploads,
that goes to Azure. Um, and we never
pull stuff from Azure for training. Um,
so it is a bit different in that regard.
So you may see the queue in connect. Um,
that'll show the progress for fire hose
mode. Right now we'll put a little
progress bar in there um on the device
so you know when you can unplug it. Um,
but yeah, that's the key difference.
Otherwise, you know, you don't have that
feedback of going in user admin and just
checking if your things are uploaded. So
we'll add a little counter so you'll
know. We got any more questions before
we go that
>> GM global B support. Uh if you write it.
Sure.
>> Would S have any solutions to making the
3X dual purpose as a dash cam? Uh I
think you guys have your own dash cam
stuff, right?
>> Yeah.
>> So 098 official date. So we'll push to
release three staging at the end of this
week and then we'll let it bake for
maybe another week. Um but yeah, if you
want to run it, it'll be in release
three staging at the end of the week.
Um, but you can just drive nightly right
now. Nightly is a a nightly build of
Open Pilot Master as a release. So you
can experience essentially um it's like
pre-built and all that stuff. It's run
through a bunch of tests.
>> Will EV9 depart?
>> What else? RML models just stuff to test
or do some work better with certain
models. Um, check out the Open Pot
Experience channel. Eene and Harold are
in there every day. I'm like, "Hey, we
pushed this new model. We think it'll
fix this. Do you guys want to go and
test it?" Um, if you want to kind of
follow along, we have internal tests we
use, but uh, it's always nice to get
feedback and it's fun for you guys to
participate. Um,
what else we got?
>> We don't have a stream for EP Nightmare.
>> No, we don't. This is the final one for
today.
>> Cool.
>> The final one. Sunny Pilot can do their
own stream, though. That'd be cool.
>> Yeah.
>> More insight into the Sunny Pilot team.
>> You guys have a team, right?
>> Yeah,
>> we have like a couple people. Yeah, we
have uh me uh Dev Dev TechV. He's based
in Spain. Isaac, he's based in the East
Coast.
>> Oh, Isaac's part of the team.
>> Yeah, he's part of the team.
>> Okay, cool. He's one of the four guys.
>> He's our four guys. Uh Gumar, he's in
the West Coast. He's he's mainly a
Toyota guy for long tuning and he's been
working with Shane for a while for the
for tuning stuff as well. And then uh we
have we have two more that's for
testing. And we recently just had
another Hyundai guy. Uh it's called
First on on Discord.
>> Oh, I know that guy.
>> Yeah. Yeah. and and he's mainly working
on reverse engineering and yeah, great
guy and our team is expanding. We're
getting more and more people coming in,
more talents. Everyone is great in doing
their own stuff and you know, we just do
whatever that everyone wants. So,
>> how's the torque on the Maki? The torque
is really excellent on the Maki. Um, we
could basically go to to the ISO limits.
>> Yeah.
>> Um,
oh yeah, but yeah, back to that point,
there's so many open developers that
there's way more open pile developers
externally than there are internally.
>> Yeah. Um, it's pretty cool.
>> Yeah.
>> What's the best sunny fork to work with?
The 2020 Corolla torque. Uh, it's maxed
out in everywhere. We We already maxed
it out. You can probably get a little
more rate actually. Um, we can actually
increase the torque a bit. I think it
was only only very slightly though. Not
much. Um, but that's basically maxed out
already.
All right, we'll go for a quick ID4
drive with uh Jason, our VW maintainer.
This is ID4. This is a Tellyide, EV9,
Mache, Tesla, Subaru, and then our Civic
and Ram. How's the ID4 port?
>> Pretty good.
>> Yeah,
>> I'm liking it. You want to take it for a
drive?
>> Mhm.
All right.
Uh Shane, get the camera to you.
Okay.
I don't know. I feel like we don't have
any questions today. It's like a chill
Sunday.
>> Oh, there it is.
>> It's a very uh interesting.
>> All right, let's do it. This car is very
interesting. It's got a lot of
capacitive buttons uh that Jason told me
are very controversial.
>> Yeah. No sunny pilot on this one yet.
Sorry.
>> No sunny pilot
>> soon.
>> Sunny pilot soon. So
>> easy to rebase now.
>> Yeah. Oh, very easy to rebase. Yeah.
Once it's merged in master by the
master, we just do a merge and it will
be supported pilot.
>> Is there a ETA on the rewrite?
>> Rewrite. I would say another month.
>> A month.
>> Yeah, another month.
>> Cool.
>> Yeah. Yeah. Everything is very solid. We
uh [clears throat]
we continue to adhere with the uh commas
safety policy. So just making sure that
things are working as expected. And
yeah, we are using more CIS than before.
We we used to manually run tests and
everything. But
>> yeah, and now we we're fully utilizing
uh GitHub actions um and building build
etc. All fully automated. So
>> great. Yeah, I mean we try to make our
tests all run externally and make it
pretty easy.
>> Um so that's great to hear.
>> Yeah,
>> I mean we make very heavy use of all our
testing infrastructure. Um if the tests
are down, a lot of stuff does get
merged.
>> Yeah, it's a blessing.
>> It's also interesting how it impacts
what you work on. like you you know you
kind of steer towards work that has test
coverage and then you kind of avoid the
things that don't have test coverage and
it's like important to recognize that
stuff.
>> Yeah.
>> Um sometimes that's important work.
>> All right guys, we'll do a quick loop in
the ID4. Um so this unlocks the MEB
platform for VW. Um
this is going to have lateral
longitudinal. Um but right now this is
stock long. So it'll go up.
All right. 65. Let's see how it does.
Is this angle control?
>> Uh, essentially, yeah, it's using
curvature rather than steering angle,
but basically angle control. Yeah,
>> got it.
>> It's uh it's got quite a bit more
control authority than uh the older
Volkswagens. It's done some turns that
uh my car back at home will definitely
not do.
>> Yeah, that's a great thing. All the new
cars have tons of torque. Um the
trade-off is the installs are getting
more complicated. Uh some of the cars
have like they just have a camera here
and they run coax down. Um that's pretty
common with the Fords. Now Tesla install
is down at the dash of the autopilot
computer. The Ravian install is uh also
behind the go box.
>> Yep.
>> Yeah.
>> So this one we hope to make pretty easy.
Uh a matter of fact, it is in easy mode
right now. We uh connect once to the
camera and there's genuinely no point in
hooking up a common power. We get
constant power from the camera.
Fingerprinting is taken care of with all
the work the Open Pilot team has We get
the VIN.
>> Uh just yeah, we get the VIN. We get
subset of the firmware.
>> We already fingerprint based on VIN.
>> Um yeah, so you would never run a comma
power here. Uh and the camera cover is
actually easier to take off than some
other manufacturers. So yeah, plugs
right in, done and done.
>> Very comfy. I mean, I don't know. Do you
guys ever like watch our old streams?
Sometimes I like go back to the old
stuff. Um especially George did back in
the day and it's like, "Oh, let's drive
a Corolla off the lot." And then the
steering wheel's shaking. It's like it
works. You fingerprinted it, but like
we've just productionized this stuff to
the point where like I mean this part
was kind of done by the community a
little bit beforehand, but like we just
threw a device in here. Uh worked on a
bit this weekend and it's just good.
Like this is ready to ship. We have to
do some extra validation, but like the
quality is there already. Uh we've made
it so easy to write these high quality
car ports. Um and there's still so much
to make easier. Um, if you have a car,
like a fairly modern car that's not
supported yet, buy a device. It's like a
pretty fun project. Um, it's very
approachable. Join the Discord. We have
so many knowledgeable people including
Sunny and Jason who have these little
special crowns. That's how you know
they're really cool at Discord. Um,
they're the ultra open pilot
contributors along with Dean Lee and uh
I'm sure a couple other people.
It's been really good to see all the new
uh Open Pilot and Open DBC contributors,
all the folks working on new car ports.
Uh for those of you that haven't been
keeping up with the uh MEB porting
effort,
>> uh this is actually not my work at all.
I'm doing a little uh work to get it uh
integrated and tested nicely and and
validated, but
>> Oh, that's a decent chunk of the work.
>> It was uh it was written by uh uh
another community member named uh Deansy
or something like that. Uh just showed
up one day. was already done or not
really done done but uh concept driving
>> and then uh Lucas uh also in the
community uh has really come through on
harnesses. Uh so really um
uh this came through. We knew it was
possible and uh we just set aside some
time uh com hack was a great time to
block off a time to get this all
validated and imported and ready to go.
>> Cool. We got anything else going on? Any
questions? Anybody wants to know
anything about comma about um if not
I'll show for hiring. We're hiring. You
want to come hack cars? You want to come
do this year? You want to work on
getting MLM shit? You want to come work
in operations?
>> We're uh hiring a couple operations
people. Um both people operations and
like kind of supply chain side, running
the shop, that kind of stuff.
Um just looking for smart, motivated
people who want to come help get
autopilot shipped and self solve
self-driving cars. Um, so if that sounds
like you, if you're an engineer, try one
of our challenges. We're working on an
ops challenge um for those operations
people. But in the meantime, just reach
in, work at comai. Um, if you want to
find out more, go to comai/job.
Um, we also have interns. Um, so if you
need us, you want an internship, summer
internship, not summer internship, we
hire interns year round, but very
flexible on like 3, six, eight, n,
however long you want. Um,
>> yeah, that's the hiring show. Nice.
>> It's a lot of fun. Um, you know, you can
come hack cars every day, whatever you
want to do in the stack. If you want to
make this thing like boot super fast,
you want to like come make a killer app
for this thing, um, you know, you want
to come make our our trainers incredibly
reliable, you want to design like Tiny
Box Pro V3, um, you know, you want to
design the Compl 5, and 6, you know, we
want you to come here. Um, if you want
to come run the commerce factory, um,
that's a great job for a software
hardware engineer. Um, I think that'll
be a lot of I mean I I do this right
now. I think it's a lot of fun
obviously. Um,
but uh, yeah. Yeah, we're uh, looking
for like maybe
four good software engineers, couple
hardware engineers, and a couple ops
people.
Maybe we can say what our plans for the
like the setup guide is where we can
just select your car cuz somebody wants
to know like where to find information
on how to install it.
>> Okay. So, all these cars reported this
weekend are kind of weird. This one I
think is the most normal so far.
>> The
Hyundai's are not that weird either,
right?
>> No.
>> Okay. So, Hyundai's aren't weird. I'm
going to
>> All right, cool. Rivian and Tesla are
weird as far as they don't have like an
install period. Most cars you just slide
down this thing, you unplug an ECU, you
plug in RAW, you're good. Um,
we've kind of neglected this up until
now, but now there's just a lot of cars
that have non-standard installs, but
there's very good community resources
for them, and you have to like kind of
find those yourselves. Um, so we'll add
something to the website with this
release um, in preparation for the
Rivian Tesla such that if you want to go
and open pilot, add some documentation,
you can select your car in the setup
guide on the website and it'll customize
the setup guide a bit to your car. Um,
at first it'll be like a very basic
thing like you can give it some generic
markdown that says like, "Hey, go check
out this YouTube video." Um, and then
join us in the Tesla channel on Discord
if you have any questions. Um, but over
time maybe it'll get a little fancier
where you can like make a fully tailored
like native looking setup guide for your
car. Um, if you're so inclined.
Um, but yeah, it's unfortunate the
install is getting a little more
complicated. But on the flip side, the
car is getting a lot more capable. Like
this car has no problems with this turn.
>> Very smooth.
>> Yeah, very smooth. The control is
incredibly good. Um, like this will be
pretty steep up here. We'll see if it
can do this.
I should be able to, I think. Um, even
our EV6 struggles a bit here when it has
a lot of torque.
>> But yeah, this is going to build.
>> Did that work?
>> Yeah, very smooth.
>> Yeah,
>> this is great.
>> Yeah, there we go. There we go.
>> I haven't pushed it that hard yet.
>> Yeah, the new cars are great. I don't
know. Everybody's always like doom and
gloom about the compatibility list. The
cars are getting more capable. Uh, you
know, the compatibility list just keeps
growing. Total addressable market keeps
growing.
I don't know why people are so
pessimistic about this. I am very
optimistic about this.
>> The new Hyundai is looking at the new
Hyundai 5 that's working right now. It
can do a lot of torque as well. Like
those turns that we just did, it's very
smooth, too. So,
>> yeah.
>> Lot a lot a lot better than older cars.
>> Yeah. Don't listen to like the doom and
gloom people, you know?
>> We just got to make this easier. We're
going to make it easier. If you want to
come work here and make it really really
easy to pour cars is already really
easy, but if you want to make it, you
know, this maybe like a 6 out of 10. If
you want to come make this like an 11
out of 10 on easy, um, you know, come
join us. Um, there's a lot of like
obvious things to do and they just
require like productionizing it, working
[snorts] with the community to, uh, make
it super easy, making like really really
beautiful tooling, uh, refactoring
things very carefully. Um, I know this
doesn't sound like exciting work to a
lot of people. I personally find it very
exciting. I think Shane does too, uh,
because it's what he spent a lot of his
day doing.
Um,
>> somebody wondered where the product
design role went.
>> Product was that thing.
>> We have an interface. I mean, yeah, we
have a designer role if you like, but I
mean it's like a think of that as like
full stack design. Um, that covers like
the open pilot UI, the product, you
know, do you like do you have a good
understand like what radius this corner
should be? Um, it's like a full
ownership of like kind of the product
experience and design around that. And
ideally, you can implement your designs
to some degree. Um, I won't say that's
like a hard requirement, but that is
definitely a strong bonus. Um, but yeah,
we're not hiring somebody who's just
like
just like doing industrial design. You
got to like do the interface design, all
that kind of stuff. Like maybe do merch
too, all that kind of stuff.
Somebody wants to know if we're going to
be able to improve like the turn
planning. They want taco style turns.
>> Taco style turn. Yeah. So, experimental
mode should actually help a lot there.
Um
the new cars they just have so much
torque. Um just need better models.
>> Also, yeah, these models can't really
plan steep turns that well. Um I talked
about this yesterday with you know these
turns don't look good in Tiny Sim. So
the the simulator the all the release
models so far have been trained in. The
turns really don't look good at all. Um
they can't simulate a 90° turn
accurately but in MLS you kind of just
get this for free. So, the MLM models,
you get a whole bunch of things for free
as soon as we're able to ship that. Um,
but then the MLM models struggle with
like very basic things like sometimes
they cut turns, sometimes they hug. Um,
lane changes aren't perfect yet. Um, we
showed those a couple days ago.
Yeah, that's it. We'll be back in the
office in another minute here. So, if
there's any last questions,
um, yeah, I don't know. I'm just doom
and gloom people. people who are like,
you know, FSD is going to win it all
and, you know, the compatibility list is
shrinking and everybody's locking us out
and comm's going to die because they
didn't solve Toyota security.
None of this stuff matters.
None of it matters. We're going to ship
MLS this year. We're going to ship Ant
Long this year. We're going to ship a
lot of beautiful devices this year. Um,
like since the price drop sales have
been up, um, like we're profitable
selling these guys. Um, we're going to
use that money to buy lots of compute.
Um, and then we're going to use those
sales to get in more data. Um, I I
really don't.
I think you guys are going to be
surprised by the stuff we ship this
year. Um,
somebody says they tow their 18 ft open
car trailer with their ramp and uh, no
real issues.
>> Cool, cool, cool, cool.
>> They say they do get some steering
wobble every now and then, but we're
we're planning on improving the the
lateral car controls.
>> Yeah. So, the Ram, it's not even
anything to do with I mean, some of it
has to do with the specific car of it,
but uh like we don't even have a good
steering angle sensor on the Ram, so we
can replace that. Do we actually do we
use a localizer yet on the RAM?
>> No, not yet.
>> Not yet. Yeah. So, that's something we
can fix for free in software. Another
one of those things that requires lots
of validation, but we're probably ready
to do that.
>> Maybe after lagd.
Maybe after lagd.
>> Well, is it comma.ai/job?
>> Comma.ai/job. AI/Job.
>> All right, that's where you go to apply.
>> Head there. Um, you know, do the
challenges. The challenges should be
fun. If you have fun with the
challenges, then you'll have the time
here.
I think we can sneak by these guys. Here
we got the uh the autonomy team working
on their Subaru. [laughter]
What's up, guys? Oh.
>> Oh, no.
>> We got the rear button. [laughter]
>> Oh, no.
>> You guys want to say hi?
>> Oh, no. How's the port going?
>> Uh, pretty good. Pretty good.
>> Nice.
>> It's still working though. So,
>> but it's
>> it's pretty smooth when it works.
>> Yeah. Yeah.
>> Oh, yeah. We might uh
before it runs way too far, we make sure
we can get out.
>> Um
Oh, there's a part right here.
>> Stick right here.
>> All right.
Okay, let me do two more questions.
We're going to merge TSA TSK keyboard.
No.
Um, I don't know why you want a
keyboard. Somebody should just make like
a nice installer and that wraps the
thing. Yeah. I'm merging a keyboard.
Hit me up if you need to test. Uh, you
you know, you don't even need to nobody
needs to hit you up. Just go check out
the branch. Keep these live streams
coming, guys. It takes a lot of time.
Um, this will probably be it for a while
unless I don't know. If Harold's
motivated to do a 098, I'll do a 09 yet
with him. Um,
but I don't know. We just got to we got
a lot of work to do.
>> More cars to merge.
>> Prevent OLED burn. We do. We have a
Damon called Brightness D in Agnos that
does this. It's pretty good at it. Uh,
more live. We're not a live stream
company. We're we're selling
self-driving cars. We're not a live
stream company. Um, if you have
questions, I'm happy to answer questions
until you guys don't have anymore. But
it seems like this is it.
Um,
I promise you don't want us to do more
live streams. That would result in no
driving improvements and uh no devices
for you to buy.
New car docks. Oh, I'm really excited
about that. Um, I can talk about that a
little bit before we head out. Um, so
basically we're trying to make a
one-stop shop if you're just curious
about Open Pilot on any car. Um, we want
to make a one-stop shop for that. That
should tell you like, oh, it's gated on
somebody figuring out the security. It's
gated on this. Nobody's even tried it.
Um, like every like the Rose will be
literally every car sold in the last 10,
20 years. And then, um,
you know, it'll tell you you can buy
this right now. It's available
plug-andplay or it's available in a
Ford. It's just waiting for comma to
rent one and validate it. Um, it'll just
tell you the status of it. Um, right now
the way I do this is I ask Shane and
then sometimes Shane has to go and ask a
guy. Um, or Sunny knows a lot of the
time it's just in his head. Um, we want
to get this on a nice website for you
guys. David California is working on
that here. Um, we'll tweet that out.
We'll tweet out the winners of the
hackathon and we'll tweet out
everybody's projects. Anyone working on
the Cybertruck this weekend? No, we had
a Model Y instead.
Anything else? Any plan on adding
additional cameras for turns? Nope. It's
all software.
That's it.
Check time.
All right. Thanks for tuning in, guys.
Um, we'll see you on Discord. We'll see
you on Twitter. Um, we hope you guys
enjoy Z98. Worked really hard on it.
Shame here. All right, it looks like
we're connected.
Oh, it still says connecting.
There we go. Comments.
Hi. Yo, start signing for the Rivian
soon. We're working on it. We're working
on it. We'll talk about that.
Rivian might break [laughter] up their
Come on. Is there any real concern of
this?
Is there any real concern of this? I
mean, the infotainment is like better
than a stock car, but it's like just
really not a Tesla level. I mean, that's
like kind of seems to be the whole story
with the software on this car.
But you guys can hear us. Everything
looks good. We live, boys. Yeah. K,
hack. It's a beautiful day for a
hackathon. We're right outside our uh
got this beautiful parking lot over here
rented by the office. Beautiful old
town. We got uh Lucas who did the port
here. He did the Tesla port, too. Shane
cartoon,
Mike's here for the hackathon.
>> Um, the uh ears on point. Okay. Uh, gen
one or gen two. This is a gen one. Um,
but I think the gen two should not be
any different, right?
>> I have no idea. If there's anyone who is
willing to
>> Yeah, you got a Gen two Rivian, pop in
the Discord channel. We're we'd love to
test. Um, but this should work with the
Gen 1, R1T, and R1S, right? At least.
Yes,
>> at least. Yeah, maybe works with the Gen
2. Um,
I'm looking at some Yeah. Yeah.
Beautiful weather. Beautiful weather for
a hackathon. Really? Really? Um, our
part, our participants are coming from
uh from far and wide and they're really
enjoying the weather here. Shall we go
for a drive? Let's wait until we get to
maybe 120 people and we'll go for the
drive. Any questions in the meantime?
I'll show you guys.
So, we got the device. It's looking
pretty good. Cable's nicely routedish.
Uh, the install is down here,
unfortunately. Um, so it's not like a
nice install on the camera cover like
most cars. Um,
but you know, it's not too bad. It's
like what would you say? Like nice half
hour install chain.
>> Mhm. It's It's very doable, right? It's
uh
just requires a little bit of patience.
Um I think Is there any good video out
there, Lucas? Yes, there one user who
already did a video.
>> Okay.
>> Um, another user um created a PDF um
with all the instructions. So,
>> have out of spec reviews make a video on
this. Uh, yeah, we saw him we saw him at
CES. Um, and uh he said he was
interested just to know which car. Um,
so the Rivian turns out to be pretty
good. Um, there's one big caveat on the
Rivian. Uh, we don't get set speed. So,
we're going to have to hide this little
box here on the Rivian for now. Um, or
figure out some way to get it. Um,
that's one little caveat on the Ribians.
Um, will the 3x be required? This isn't
CANFD, right?
>> Uh, no, it's CAN.
>> Yeah. Okay. So, com 3 will work. Um, if
you want to use com 3.
>> Is the radar can um
>> the No, the the points are on CAN.
>> Cool.
Just getting a little close to us. Um,
thank God for Turo. Yes. Yes. No car
jokes. No. If you know one, go for it.
Um, yeah. Let's go for the drive. Um, I
don't know if anybody saw the Snazzy
Labs video on Twitter. Um, his tune was
a it's very much a work in progress. Um,
so we kind of dialed it in now. Um,
everything you can see here is on Open
Pilot Master now. So if you have a
Rivian and you want to drive Open Pot
Master, this is the experience you'll
have. We're working on adding launch
signal. Yeah, let's go.
This got a park. Um,
yeah, Rivian has a little bit of a
unique install. unfortunately. Um, but
again, very doable.
Has this little set speed quirk. Uh,
we're still investigating this, but at
this point, you do get lateral and
longitudinal at the same spot. Um, so it
should be a very capable uh platform.
You can engage here. Um,
>> well, somebody said you cut out whenever
you talked about what was missing.
>> What was missing?
>> The set speed.
>> Oh, okay. Yeah, we'll go to that in a
sec. But yeah, low speed control needs a
little bit of work. You can see a little
bit of wheel shake. We mostly tested
this on the highway. Um, we did a little
bit of testing with longitudinal and
experimental mode,
but uh, yeah, we've just had this car
for like a dayish. You work on this last
night, chain.
>> Mhm.
>> Yeah. So, it's only been in our hands
for like 12 24 hours. Um, otherwise,
it's been like a community work in
progress
now.
So, we'll just give you guys a little
taste of our test loop. All
right, turn up the set speed engage.
All right. Oh, stock ACC is not so good.
So, this is Rivian stock ACC right now.
And then Open Pilot doing steering.
So, you see it's pretty smooth. Getting
up to highway speeds.
We get any good questions yet?
The bit rate seems to be bad. Bit rate
is bad. [clears throat]
No, I think it was better on X, but we
didn't have comments.
Can you guys like not see anything?
Uh, be a little cautious here. Caribbean
ACC is uh not the best.
Hopefully, we can swap it for open pilot
ACC soon.
Really the main hurdle is that set speed
issue. So if you guys missed that, um
the Rivian does not publish the set
speed on CAN, it seems, which is a
little bit annoying. See if we can
figure something out there.
Um Marco said he noticed the the wheel
shake on other platforms. That could be
the um the overriding the safety.
>> Uh is that what he's saying or is that
what you're saying?
>> That's what that's what we're saying.
>> Oh yeah. Okay. Yeah, the wheel shake.
Um, so at low speed you get this wheel
shake. Um, low speed has several issues.
Um, one of them is likely that it thinks
you're overriding the steering wheel and
it drops the torque and it has to ramp
back up. Um, so this is going to be a
project we're working on very soon,
probably after Comma Hack. Um
yeah, if you guys didn't watch the last
stream, um we got a hackathon going on
right now, comma hack 5, where we got
all these participants who've imported
cars and now we're bringing them over
here and they're going to uh ship them.
We got Sunny of Sunny Pilot fame. Um I'm
sure a whole bunch of you driven with
Sunny Pilot. Um, we got Lucas who did
the Tesla Rivian ports and uh we've got
uh some of the Hyundai contributors um
and some new people in the ecosystem.
So, if you guys seen a lot of activity
on car ports for this release.
>> Oh, somebody asked, does this only work
when the Gen One has autonomous roads
available like the drivers? I don't
know.
>> So, yeah, this works everywhere. This
this should work everywhere. It doesn't
require being on a mapped road or
anything.
CC isn't that comfortable.
I wish I had a slightly longer following
distance.
>> And yeah, long long is working on the
R1T. We just have a few uh issues to
iron out. We're working on the radar
parser now, which is promising. I think
we get all the data and it just looks
slightly different than what we're
already parsing. So
>> yeah, I mean that's the thing with these
cars. Each car has its own like little
quirks and then you just have to kind of
get have to play around with it and see
what you can do with it.
Um, Satspeed is the weirdest quirk I've
seen in a while, besides all the
Hyundai's being different. Um, so Sunny
and Chris um at the hackathon are kind
of unraveling the Hyundai mess right
now. They have a whole bunch of Hyundai
car ports that are blocked on uh
basically all these little variations
that Hyundai's doing in their cars. Like
they change the steering message, they
move this around, they move that around.
Um it's unclear how they deal with all
this complexity. Um so we have to kind
of unravel that a bit. Um refactor
things. Um, but rest assured, we will
have a whole bunch of Hyundai carports.
Probably some coming this release and
then some coming the following release
in a couple months.
I think we're going to do the Carnival
this release. Um, EV9. We have an EV9
and some kind of telly ride.
>> Telly ride. Yeah.
>> Yeah. It's like the latest telly ride.
>> Uh, yeah.
>> I think maybe 24.
>> All right. So, we're going to do a lane
change in the Rivian. You see it's
pretty smooth so far. We'll see how it
does on this curve up here. Um, but
yeah, if you guys saw the Snazzy Labs
video, looks nothing like that. Um, I
don't know if he's tried this tune yet.
Um, we just pushed it probably at like 2
a.m. last night or something. It's
probably not. Um, yeah, looks very
smooth, right? Um,
this is using torque control in open
pilot. Um, and then soon will enable
torque D, so it should learn the
essentially the 2D gains live while
you're driving. Um, it's like an
autotune for your steering wheel.
Do a couple quick lane changes.
Alex asked if we they already have a 3X
and a Rivian R1T. They just need the
harness, nothing else.
>> Uh this Alex uh or Alex or is this just
some Alex?
>> Some Alex.
>> Oh, I see. Um yeah, if you have a 3X,
all you need is a harness. We don't have
the harnesses quite yet. Um there may be
some community ones available before we
sell ours. We'll probably have them in
the shop. We're going to try really hard
to have them in stock for this year 98
release in like a week.
But uh unlikely for exactly the release,
but definitely within the next like 3 4
weeks, we should have them. Same with uh
we just placed a big order for Tesla
Harbor 3 harnesses. Um see how this
does. Might be going a little fast, but
we'll see how it does. The Rivian has
lots of torque. Rivian is a great
autopilot car. This is great. That
>> was nice.
>> This is really nice.
>> Yeah, this is actually really good. This
is really good. Hey, I slow down for
curves. Nice. The ACC actually isn't
that bad. This is like very usable. This
is a very capable car. Cutting this turn
a little bit.
I would be very happy with this open
experience. Um,
in fact, I am very happy with this open
experience. Got to polish it up a bit,
but uh something good.
Somebody said they're excited for the
arm with the cam body.
>> Oh. Oh, maybe we'll show that tomorrow.
>> Okay.
>> Or maybe today. I don't know if we have
time today. We'll show it. I'm not sure
how much progress the scene's made on.
I'll check in with him.
You seen uh you know, he's not uh
Yeah, he likes to show things off when
they're when they're done. He doesn't
like to hype things up too much. So,
we'll check in with him tomorrow once
he's talking a little bit more.
This is actually quite comfortable. So,
it goes Let's see how it does in some
stop and go. Um,
we got to fix these dash alerts. Like,
it's going to keep my hands on the
wheel.
>> Mhm.
>> Um, but you know, Opil's got DM. Hope
knows I'm paying attention. It's little
DM emoji
right here.
This is actually really good. I I'm
really happy with this experience. Um,
there's definitely some polishing up to
do. We'll get it done before the
release, but it's looking like you guys
are going to get Tesla and Rivian in
this release, which would be really
cool. And then tomorrow we'll do Maki.
We'll see if Maki we can just do. We
have a whole bunch of people driving
around on them already. So, I think it's
already pretty good, but I've never
driven it yet. So, we'll see. You really
got to We want to make sure these cars
are like beautifully polished for you
guys before they ship to release. Um,
yeah. I don't know. It's a very chill
drive. Chill San Diego day. chill drive.
That's kind of the theme of the Scotland
hack. Ship you guys more and more cars,
bring the community in.
Okay. Don't have nav yet, so that's
expected.
The override is pretty good. Um,
we got a big curve coming up here. We'll
see how it does there. But I think it'll
do well.
>> You know which model years yours or is
gen one? I
>> think it's 22 to 24, right?
>> Yeah. I think so.
They sold what? Like 300k Rivians.
>> So they sold 300k Rivians. You know how
many of them want pilot? I imagine a
good chunk of them. Chevy Volt is uh
we're in 1% of Chevy Volts. Can we be in
1% of Ravians? I I think so. Maybe more
than 1%. Um
this is
pilot's a bit indecisive there. The
Rivia has so much torque you can see
like what Open Pilot really wants to do.
Um, in some cars open seems a bit
smoother just because uh the car can't
actually do what pilot wants.
Yeah, you can see it's like it's kind of
thinking about this a little nudge it
over. Uh,
but otherwise, I don't know. It's very
smooth.
Very smooth control.
>> I think this is a far cry from the video
that we saw on X.
>> Yeah. Yeah. Homemar's blog. You know,
you can There you go. We spent a day on
this. What do you think? What do you
think? Um, you know, I think, you know,
you you could diss on us for some
certain stuff, but like you want to look
at our car stack. We spent a day on
this. Um, you know, Harold shipped to
Control and you know, his team shipped
really fantastic uh like live learning
for this stuff and it just works. Like
this is really excellent lateral control
and we spent essentially no time on it.
Like how much time do you spend on this
too? You just look at the values that
are output, put them I just fixed the
test and changed the values. Yeah,
>> like our car stack is so beautiful. Uh
Casper's right now working on shipping
lag, which is a Damon that'll learn um
the lateral steering actuator delay
online um which is actually quite
important for lateral control. So once
we ship that we on many of the open
pilot platforms, we have we will have
learned um essentially all the
parameters to do the lateral control
which is really incredible. You saw how
long it took Tesla to ship FSD on the
Cybert truck. Um, you know, this Rivian
community port was like a work in
progress for a while, but it's like, you
know, open source contributors working
part-time on it. Um, and then, you know,
we got it in and we fixed up the tune a
bit. Um, but this is well within what
somebody in the community could have
done and just look at these values. We
just got to like productionize this a
little better so it's obvious what to
do. Um, but yeah, super easy to port any
part of Open Pilot and it's got CAN. Um,
I'm really excited about doing some of
the Chinese EVs. Um, I was looking at
the BYD port today. I want to get that
shipped. I think after we do this round
of like with the Rivian, Tesla, Ford
Maki. Um, we've got a also got a uh a
Subaru. What's the What are the angle
cars?
>> Somebody just asked about the Subaru
2022s.
>> Yeah. Yeah. So, we got a Subaru. Um, the
research team is a couple guys on the
research team um are working on that for
the hackathon. So, we should get that
shipped. Um, take the exit here back to
the office.
Lane change is very smooth. Um, normal
pilot lane change. Um, do you want to
try to switch the experimental mode? We
can show you guys what this is very much
a work in progress. So, that was like
the good stuff. This is the experimental
stuff. Uh, we'll just see what it feels
like.
Go in the settings.
Um,
just need to reboot it.
>> Yeah, just restart the pilot.
But yeah, this is the experimental
stuff. We'll drive out in Oldtown a
little bit, show you guys experimental
mode in the Rivian to give you a taste
of what's possible. But, uh,
>> yeah, somebody just asked how difficult
getting longitudinal on the Rivian would
be, but
>> it's the set speed. It's just the set
speed. Uh, so we should get the the
radar this weekend. Um, set speed. It's
It's a silly one.
>> Um,
>> did we actually check the tech info to
make sure it's the dash is wired to the
set to the uh whatever ECU is doing the
ACC?
Okay. And then let's switch to
experimental mode.
All right. Let's try it. I'll try out
this red light.
So now Open Pilot's doing the launch
signal control. It's going fast. Yeah,
they didn't see it. There's another
Rivian right here, but they wish they
had Open Pilot. Oh, now we're going too
slow. Okay, so the Rivian has a minimum
engage speed of 20 mph if you don't have
a lead, which is a little annoying,
but uh we'll see if we can find a lead
up here.
or it get up to 20.
So yeah, this is uh take it over here.
So it's like, you know, Rivian doing
city driving. It's a little uh it's it's
experimental mode, you know, we're
working on it.
So once experimental mode works, um
it'll come to your Rivium.
It's a very complete open pilot port.
Any other questions? Anything about
release?
>> Somebody just asked when the Maki
support is coming
>> tomorrow. Tomorrow we're going to do the
stream. We haven't tried it out yet. We
haven't Have we even done the install?
>> Not yet.
>> Okay. Yeah, we're doing one car a day.
One car a day. Okay. I didn't see that
stop sign either. Okay. So, Rivian
Longit control, we haven't done any
tuning on yet. Um
so, this is very much a work in
progress. But if it took a day just to
fix the lateral.
>> Well, okay. The longitudinal needs
lateral from the policy to the uh we
don't have any like autotuning for
longitudinal. The longitudinal stack is
much less mature than the lateral stack.
>> Yeah, the lateral stack is incredibly
mature. Um we have ant lateral, we have
learned lateral controls. Um
longitudinal is u you know we have some
like reports for it but the policy isn't
uh I mean you guys experience mode. Um,
>> somebody asked when the next open pilot
update is coming out.
>> Next week. Next week. 098.
It's a big big update. Um, a lot of car
stuff. We got the new Toyota tune. We
got all these new cars coming in. It's a
busy day in Oldtown.
Um, a lot of system stuff to prepare for
like bigger models. So, we have the Tiny
runner. Um, so we have a full Tiny stack
running the models on device. We kicked
all the camera processing off. So, this
picture you see here looks just like
your 3x on release, but it's not done
using the GPU. Uh, which means you have
way more time to run bigger models on
the GPU. Um, and while we're not running
those bigger models, this just means
your device runs cooler. Um, which is
pretty cool. It's like half a watt less
power, which is really significant. Um,
your device runs much much cooler. Maybe
we'll put some plots in the blog post.
Um,
>> Spectre wants to know if it can go below
the minimum engage speed once you
already engage.
>> I don't think so. Right. I can't even
engage here behind this leak. We'll have
to look into this. Maybe we can fix this
without long.
>> I'm pretty sure we can. Yeah, we can
somehow tell it that it's okay to engage
at all speeds.
>> Yeah. To give you guys some context,
usually we spend like at least a few
weeks on a port. Um ports get easier
over time, but um you know, the
community spent a whole bunch of time
getting the initial stuff working. Um
it's only been in our hands for a day.
Um, so you see what you have now and you
can expect uh quite a bit more once you
put some more time into it.
>> Somebody asked uh they want us to show
us or show them the Model Y with the
higher torque just like doing turns, but
it's not really the actuation. Um,
that's not the like the limiting factor
at this point. We need to get uh MLS
merged and it'll be able to like
simulate turns much more accurately. So
>> yeah,
>> they can do turns better. If you go to
Yen's talk, um, Yen's Comic-Con talk on
YouTube, they'll probably have some tiny
sim videos where like if you just
>> So, a reproductive simulator doesn't
produce like very realistic images of
turns, right?
>> Yeah.
>> So, the models trained in that simulator
aren't going to do turns very well.
Let's see. This is pretty steep. And
we'll have a lead. Let's see if we can
do this. This is like a good uh
experimental test.
Yeah. Yeah. Look. So, there's no lane
lines. This is really where experimental
mode and autopilot really really shine.
This car is driving off the lane lines.
Oh, okay. So, we're going around this
person. Okay, that's good. That's good.
Yeah, there's still a lot of torque.
Still not planned properly. Okay.
I suspect it should do fine the rest of
the way here, though. Okay.
Yeah. Okay. Let's see if it it should
stop at the stop sign in a sec.
No, we need to tune this better. Okay,
we'll spend some time on longitudinal
tuning for you guys. Um, but this will
be an open pilot master if you want to
try it out. That roadway is blocked.
Let's go over here and we'll head back
to the office.
Otherwise, I think that's it. We'll be
back tomorrow in the Mach E and maybe
the Subaru if the Subaru is looking
good. Um, do we have any other
interesting cars? Maybe Sunny. Maybe
we'll do a segment with Sunny on the
Hyundai's.
>> Mhm.
>> Um, if you have a Hyundai and it was
ported recently, it was probably sunny.
So, you have empty tank. Um,
any other good questions?
How many people do we have?
>> 117. Cool. Anybody looking to buy a
Rivian? Anybody uh anybody waiting for
this and going to buy a Rivian?
Sorry, not going to buy. Going to buy a
3X for your Rivian.
>> Somebody wants the Rivian in the EU.
>> Rivian in the EU. Are they all shipped
there? No, I don't think so. Right.
>> Oh, I mean it's a pretty nice car
actually. It's I mean it feels like the
Accord. It looks better. It doesn't feel
like $150,000 car,
>> but it is nice. It's just not like that
nice.
It's very unique though.
>> Somebody asked about connectweb.
>> Connect. We're coming to work on
connectweb.
>> Are you good at connectweb? You want
somebody like really good? Do you want
to like write streaming?
Can you write like a mega reliable
flasher for your device? Can you um
or are they just interested in using
connect?
>> I think they're just asking about
updates.
>> Oh, updates to it. Oh, yeah. Camera's
working on it. Um yeah,
we should see some movement on that
soon.
>> Yeah, we just open sourced the website.
So, that's uh that's a big
>> Oh, yeah. If you ever want to do
something on a website, um
>> yeah, you can fix it yourself.
>> Fix it yourself. There's some stuff, you
know, we're just not going to spend time
on because we can spend time on making
your driving better. But, uh, if you
want to spend time on it, you are free
to. And if you put time into it, we will
certainly spend time to review your
stuff. That's kind of the contract that
we have with our contributors.
>> Somebody um asked about the Bolt.
>> All right.
>> We have a guy in research uh for the
hackathon. He's going to improve the the
steering ting is working on the Bolt
actually. Yeah,
>> is working. Look at all these Rivians
around San Diego. I bet they all want
common 3X axis. We should put a little
flyer on the windshield coming soon.
>> Local business.
>> Uh I don't know. You guys want to talk
about I guess we already talked about
Lucas' project. Mike, you want to talk
about your project a bit?
>> Uh yeah. I mean, I'm I'm helping Lucas
with the uh radar right now. And then
once that wraps up, I'm going back to
the Tesla where uh I want to try to get
the headlights to wink on command. So,
you have both of your headlights on and
then you want to sort of wink at someone
where you just turn off one of the
lights. We'll see if we can get that
going tomorrow.
>> Nice.
All right, let's see if we can get
experimental mode. So, this is real
tricky actually. This is the MLC models
are a lot better at this actually, like
navigating around stuff in in the city,
just generally
playing around these laneless
situations.
Just doesn't want to engage. It really
has. It's quite strict about this. All
right, we'll fix it. We'll fix it if we
can.
Otherwise, I mean, it's an incredibly
solid port for uh like general highway
driving. Um but it should be very very
capable for experimental mode. Um aside
from this 20 mph limit, which is
slightly frustrating.
>> Somebody wants to uh know about the
F-150 Lightning support. That should be
the same platform as the Maki.
>> Yes. Yes. Maky is F-150, F-150
Lightning, and Maky. And I think a
couple other cars already in open pilot.
I forgot what they're called, but I
think there's like two more models we
also support. So, all those will get
support at the same time.
It's the Ford Q4 platform. If you want
to buy your harness and get ready, go
ahead and go buy a Ford Q4 harness on
the website and buy your 3X. Um, I mean,
no promises. You know, we going to try
to fit it in this release, but you know,
no promises. It already works, though.
Um, the forks have it enabled. All the
codes in Open Pilot. We just have to
verify it, polish it up a bit.
>> Oh, the Explorer, I think.
>> Explorer. That sounds about right. That
sounds right.
>> Yeah.
>> Somebody's going to be excited for the
Kia Carnival.
>> Kia Carnival. Yeah. Yeah. Chris is uh
working on He's working real hard on it.
We got him uh we got him working on
refactors.
Refactors at a hackathon. That is my
kind of hackathon.
All right, guys. Any final questions?
Any final questions?
Go the clicker.
Oh, somebody's coming out that way.
Yep. Release next month.
>> Oh, that's correct.
>> Release next month. Uh, no. No. This
month. This month.
>> This month.
>> Next week.
>> This month.
>> Right.
>> I think that's it for the questions. Uh,
is it really?
>> Great job, guys. That's not a question.
Okay, let's see.
The whole point of the company is
self-driving for everyone. That is not
the whole point. The point is solve
self-driving cars. We We want to push on
the high end. It uh happens to be
advantageous to support all these cars,
but you know, we don't really care about
supporting your 2016 Corolla. You can if
you want. Like, we're going to open
source it. Um,
it should just be an HTMX.
If you want to come here and work on it
and write an HTMX, that's fine. If you
make good stuff, you know, that's what
matters. Um, you should be sitting in a
fucking room spending time on a Toyota.
Uh, some of them are supported. Uh, but
you don't want that. I promise you don't
want that. Um, what we've been working
on recently is getting data in ingestion
up, getting trainer trainer reliability
up to ship you MLS. you really really
really want an Elsim because then we can
throw a lot of compute, a lot of data at
the problem and you'll have dramatically
better open pilot.
>> I
really want to continue.
>> Let's do you guys are
all right.
Cool. I think that's it.
Thanks for joining, guys.
Anything Anything to share with Atera or
T? I don't know what T is. Uh, I only
got to ask a terra
steering fix. Nonlinear steering fixes
when for which car?
>> I think the GMs.
>> The GMs. The GMs. Oh,
yeah. Machines. Wishing's working. All
right. Yeah. We'll show you guys the
outside of the We'll show you what it
looks like from the outside. Do we uh Is
there How do you turn this car off?
>> You don't. It's like a Tesla.
plus.
>> Yeah, looks pretty good on the outside.
This is a Comet 3X in the R1T.
Looking good
and the team that brought it to you.
>> So, thanks for joining guys. We'll see
you tomorrow in the Maki.
violence which are really useful data
for us because not only we get like your
private data trying to be there but
again
device itself or us those are way more
useful type of data that we can use the
function that we cannot with just that
and so yeah I mean that is that like as
you can see the tribe is very strong
before from multiple users likely and so
the amount of like good high definition
day that we that were interested in to
circulate and we respect we come to make
pretty much like insignificant the
amount of data that we actually get from
purely from the compromise like how how
scalable you want the system to be like
we said we plan to achieve one of the
media minds in like a year or something
more than something more than a year and
so this code the trade-off is between
how how defined how like how much data
you want to collect all sophisticated
you want to be a physical action caster
scalability and we believe that we found
kind of like the best sweet spot with
open pilot people driving with with our
dash cam with Iran with the unibody so
because you kind of connect all the data
we need
it's like scare what I'm untamable so
every company works on spaces their own
definition like the or definition of the
type of it'd be about our size pink
party impiety yes sorry I came only to
skip the zipper incident but it strikes
me that I think like tests these other
vehicles they have so many other sensors
they can be so much more aware of the
surrounding context so are you able to
read those from the canvas or you just
blow it off and go straight vision from
the camera how do you address that
because yeah well so not to make a
Suzanne this is a lot better than what
what should stay with the car step one
is like let's use as much as possible
what you see in front of you right you
can ever season and he's like a lot
better what is today using just what you
see in front of you right and there's a
good starting point which is what
provide however we can also read
everything it comes from your car so if
your car is a key for example we decided
a door so what we can read some
information from the side the other
story so we integrate with some that we
plant correctly
yeah but we do have access to the to the
other data so most of the consulship
today that are compatible with they are
equipped with adaptive cruise control
and so they already can tweet with arada
and we have used right now like the
account features so we do use as much as
possible what comes with the car and
then of course I certain point we do we
do believe that to expand the system and
to make the system like a more valuable
yeah you would need like mobile view
around the car but right now the
limitation is not really how much you
see is more like how when you use what
you can see OMS are taking measures to
improve the partition even security to
block exactly what open pilots trying to
do so how do you actually do that how do
you actually arranged yeah I mean open
pilots for us right now is it's a
development project and the way to make
up a palette scalable to have to engage
with a lot of like developers around the
world is to make a pilot what it is
today which is like a tool or software
that can work with can that people can
buy today the EM cover for karma he is
actually to engage with OEM of T one
supplier and work together to ship out
the pilot in their product in their cars
like assistant systems so if this is a
start for us it's not the end goal what
we have today is not yet gone their goal
is how to hope we hope we scale and the
only way to scale is engaging with oh
yeah it actually wants to wants to ship
do you think that you're gonna continue
with the windshield mounted device or is
it
I'm trying to cameras that are already
in the vehicle no you can't Fellini use
the camel sense of any of the names
because they're my kind of wire that
that actually we achieved it as imaging
processing so it's very hard to be the
images are Fox became
they go we right now we were okay like
using my camera provided by our systems
the camera itself is like she is not
like it makes nice and Barb and I don't
think it would refuse otherwise yes
yeah some came from me great thank you
do i you're welcome
do I have traits to get that data
absolutely somehow yes how is it
protected good question so you have
absolutely access to download your data
this is like something that we consider
a main use for developer terms like if
you are driving and you want to do some
test you want to collect data when you
should have access to your data you
should be able to know your data we like
to two to three weeks ago we released
all our most of some of the important
development tools that we use to develop
open files so that you can actually
develop the same in the same way that we
do and so you came to I collect it
downloaded it that you that you that you
actually collect and develop with
regarding the fish the driver facing
camera by default there's a table in
settings by default the table yourself
so we don't record your data we still
provide you the monitoring functionality
no we don't record your data if you want
to contribute and give us more like data
diversity which we actually need to
develop like a better system but you can
turn it on and then we have access to
your data
but be something to other
no absolutely have no you you can decide
to share the link to your data which is
like a generated thing not something
obvious with other with other people but
of course not like other people don't
have access to your data and we share
that data with other users
I think the only thing that we know
about the user is like their Google
login system so we don't we don't know
like any like personal informations
except
there's parts my question what is the
privacy question with the other point of
view
well if he falls release 33 hours of
data that you can download from our
website so that I think that answers
your question right so we have like
three of our data that we collected
driving and that's like open and
downloadable and we provided tools to
develop the data that we collect if you
believe it's useful to developers and of
course you have access to your data so
party of data MPAs that said that we
believe could be useful for people to
live out on which comes from our
personal life that is set as comma
Engineers
yeah
okay
no it's not actually we're still using
yes we are still saying it we're still
using it is the main device that we use
for interfacing with the card that you
guys have on the card which is sending
the autopilot to stielike device now we
don't plan to shift away from heater is
it's pretty I mean like the chip that is
using is not like the limit of what the
capability keeping the users that we do
absolutely no we still plan to stick
with it we plant a cone is called like
Panda is like the code is also open
source people ready contributed to it
and so the project by itself
yeah we don't want to bring in to an end
at all like anytime soon so it's the
driver
cool I well thank you guys so much um we
have a merch table if you're interested
in buying either a self-driving car tour
t-shirt or any of the devices that
Ricardo mentioned will be around Eddie
Harold myself Ricardo if you guys want
to chat with us ask other questions what
the price tags
- gasps but I say this thing babies
alive it's totally like your case copies
no but they need the whole thing that's
a great point
all right post the audio on slack yeah
yeah too much the scope is have like
ports to do what up greven do be of
twenty-ninth go beats like clear about
comma dinner nothing credible that's so
kind of you guys hey nice to meet you
guys social media coordinator I compared
my tweet yesterday idle no you told me
they were what did I say
you told me to call me some self-driving
car sober self-driving cars solar
generators are self driving for a solver
Cobra team no that's too much
I was gonna say LinkedIn that X CEO and
no pointer George Hotz gave me that
title yeah cuz there's no CEO right
there in the middle of the table as
please
wait to Korean style for us oh love your
feet going - team oh okay well I really
do shelf in the ship way too much I'm
not that's just not qualified to give
you investment advice got a variety of
things people are consuming so we will
get their food for not just bill now
yeah that's right that's big model
I always big mother it's coming along so
guys we have to do an EOS release before
we can do a great father
this means ship SF
oh the other thing to do that's a good
point
no Roger bear is not an investor in
trauma we need to make something there
is a block yeah yeah these model uses
big power and if charging gate is
already a thing oh yes there will be a
little driving car Awareness Week to our
they're not interested and I will be
putting out the date like for a couple
weeks ourselves but set send me ideas on
slack of where we should go we're going
down south I normally cut George's hair
but he got a haircut I've gotta hurt no
Alex where I asked that but normally
would I think it's the real Alex right
that's about Alex right I'm still
waiting on my my coat that you promised
my friend the Dean was like bro you
gotta read this blogs can't draw across
the country 32 hours they're like a
radar detector go to the East Coast it's
so far from here we probably won't make
it out choices hi everyone that's right
sweat pants but yeah we do love those
sweatpants and gave us brevin I wear
them oh yeah they're really good yeah me
too I really do wear them quite often
okay I'll email you my address that
sounds good pick up 48 we have 64 but
now it's like people are not really
hungry people are hoping you're watching
Harold Lee doesn't report me you gotta
keep Scooby's alive
I will I'll just go we can't fit the
extra block on the wires to virtually
Chris makes a good point that we should
ship him here and we'll make a an epic
vlog series
Oh what cleanup the New York to do you
know what we got today what do we get we
talked about it oh my god who does know
we're talking about I know
we're going ham we don't feed them in la
cama cama merchandise is expanding never
have to go back
we got the comedy back it's a comedy
back and it's actually gonna be to a
surprise
why is life going to have the price of
water oh there we go
this is a bike Friday you don't spin a
lot guys what's the safest day Harold
made a scavenger hunt for the office Oh
super awesome SD cards but Alex Roy is
drive from India for you okay links in
the office but we lost it let's just sit
no we didn't lose anything
karma hoodie gold how do we not think of
that that's a
best year this year oh do is it s here
whatever happened to that hoody that you
use on the van like white with the black
come on oh that was only friend in those
rare the over I can get them now too so
you have to return yours George
Catherine's wooden bride up twice this
dinner mm-hmm summer she's not on iscope
established Oh Alex Alex DUP microscopy
ID by white with black comment instantly
I think we should do gold
we've looked so tax it be amazingly no
there's no way that's I'm gonna be so
red tank top rich that's the tackiest of
the know why do they put us upstairs
it's just like the upstairs section for
large tables but you get forgotten that
they don't even like the candles that's
really sad the design that is the next
opening
I mean drives itself look good it was
like a picture of beer it's all my house
yes this is the second thing that's
happened to us yeah they all surprised
me dessert how many Brazilians are there
no worries without the questions
yeah I can't believe it's still not
there oh it's not a bomb that's totally
wrong
yeah no beer sorry it has to be hot yeah
I agree 45 when are we going to connect
to eons together with whatever things oh
do me on technology we do would be
willing to have two wheels yeah by 2
amps for 2 and 1/2 X the call points oh
yes we're not making it to me again make
your pick actually tell me about you you
used to to us and then you get 2 and 1/2
X the amount of colorpoints or you're
right double de on double the fun double
the profit that is
[Music]
apparently if you want to be a CEO you
have to get you got 2 X 4 km okay I'm
gonna say bye
what rad oh I gotta check it back out
alright guys hahaha I already look this
doesn't have anything okay well alright
guys you see that Prius over there you
see this Ford Fusion
we're gonna start over there and we're
gonna race first person to cross that
red thing oh and after the red thing you
got to break pretty hard just you don't
have that much runoff room but it's fine
these cars don't get up to that high
speeds okay guys let's go let's go let's
go to the starting line
do it gonna leave the Prius in the dust
all right does anyone wanna bet does
anyone want to bet will it be the Prius
or the Ford Fusion
I don't have any sport mode in this car
I'm Harold your taxes are all in the
back there oh we gotta close the windows
for aerodynamics you wait do you keep
the windows open for hair dynamix close
the windows definitely closed all right
all right so how do we how do we start
okay I'll be the arbiter I'll do my hand
up and when it goes forward we start
wait but wait wait both of us with
windows open okay so my hands up and in
about 10 seconds it'll go down wait you
gotta pay attention to oh no I can't rub
the engine in this guy confusion
[Music]
alrights copies all right guys
will it be in the future will it be the
Prius in a photo finish all right guys
we're gonna stand here this is the
ultimate challenge will it be Japanese
engineering or will it be American
Muscle you decide or actually the cars
will decide okay
don't worry guys I'm gonna get over
there I'm gonna stay safely behind the
thing we got the fusion on the right we
got the priests and here they come in
here they come fusion on the left right
we got a Prius up left looking for that
photo finish here the cars here are the
cars here they come and yup it's not
even close it's the fusion thank you for
joining back on AI moments later
yo what's up
all right
all right here we go
hey scobies
[Music]
oh here we go
so yeah did it rotate did the whole
thing last
okay cool
no it didn't have have rotation lock on
oh no it's not that one do this
so we got we got a neon right up here on
the dashboard
i want to go probably the other way
leg
oh it's probably no it'll it'll get
better in a minute
say hi to the scopies
there's commonplace everywhere here
we're taking over this town
frozen is it still frozen is it still
frozen the reception here just isn't
really good is that my eons
no no no your eon is getting shipped out
today probably if you got an email
yesterday your eon ships today
yes frozen okay okay yeah it's a lot
better now it's a lot better now better
all right all right well let's let's
wait till we get on the uh the road and
then we have some exciting announcements
very exciting
um so it'll hold now if i engage
yeah
no close lead oh yeah you need he needs
to see the car
oh
hey that's one thing like
but i have my wheel there right
uh yeah but the mod at least not using
the model okay
um
so guys a bunch of exciting things
happened today eddie got a promotion
um eddie is now vp of hardware
and the reason
why he's vp of hardware is because he's
figured out how to proceduralize
so you have this thing
you have companies you have like like
think of like old-school aeronautics
companies like like like boeing or
lockheed they managed to produce
incredible products
with mediocre people
hang on i gotta make this tonight pay
attention all right we're good
um
and the way that they do this is through
procedure
model uh yeah i mean here it's like
it's never gonna be good it's modern is
it my oh it's because it's glare
uh that's terrible
um
but yeah so
remember how i promised
that we were gonna port to all those
toyotas
i lied
you're gonna point to all the toyotas
and also we have a new name for you guys
it's not team comma anymore i really
figured out what it was
today you guys are the comma army
we really are we're an army
like like when i talk about winning who
wins i mean a team can win but who
really wins an army so you guys are the
comma army and what we're going to
release with this corolla
is a guide on exactly how we did this
part because it has a lead
pretty
smooth
pretty pretty smooth
um we're going to release a guide on
exactly how we did this toyota port
so you guys can follow it up in in a
whole there's like 12 toyotas that can
be supported there's like another six
lexuses that can be supported there's no
way we're going to support all 18. but
what we are going to do is ship that's
not that loud
we're going to ship really clean
refactored code and we're going to ship
a guide so everybody out here watching
those periscopes who has a toyota will
be able to literally board their own car
um
so if you have a uh
big um big dan carlin fan are they
asking any questions yes
we accept high school intern of course
we yeah yeah yeah we exercise clinton um
the what corolla model
oh it's uh
any corolla model except the iem
do you think that's bad for the car the
noise
it's okay i think it's okay
even with an according background wow
that loud even with no coding background
so here's the thing you guys you're all
in the comma army right you're all and
that's that's i mean that's really you
know like low gang jake paulers comma
army
um
the way that we're gonna start
hiring is basically this
you come up you work up the ranks
through the comma army you start out as
a shill you start out on slack you start
out submitting pull requests doing car
parts work your way up anybody can
become a general in the common army
this is this is right
oh real vlogger shit
uh
yeah but what we're gonna do is we're
gonna really commit this year to making
it easier for you guys
to making it easier to meaningfully
contribute um one of the things like
that keyboard bug right like there's a
keyboard bug the first time you install
open pilot on oh really
oh yeah it doesn't it doesn't auto i
know i think oh well it's not gonna
accelerate right now stop and go oh
that's too bad all right
um
you know just pay attention here guys
is model failure yeah
but
not too bad
cool
yeah i can barely see anything on the
camera
i don't know it's working pretty well
that's all we have to change any safety
card right well i want to
you want to change there's one change i
need to because of the stickiness no
it's because
so basically
this car is lighter and so the same
amount of torque is actually feels way
more and so there is this safety code
about uh
how much delta torque we allow between
driver and and torque that we can
command
so we need to like i may i made the
change in control
but i didn't make the change in uh in
safety i think we need to do it
how bad is it
um i think it's bad so if you hold it
and you release it you would feel like
the couch yeah you're pretty fast
and the civic controller is just much
better about this
uh but yeah so so comma army we're gonna
uh
how is the produce hacking going oh the
prius is hacking that's going pretty
well um so we're also gonna another
thing that we're gonna push on is like
that you saw that keyboard thing
right
we don't know why it happens but what we
need to do is we need to get out more uh
build processes and more tools to you
guys
um so we have a set of internal skus for
like development tools we're gonna work
on making our development tools
accessible to anybody in the world the
tools that we're using here to develop
everything that you see
um we're gonna get the neos build
process working so you'll actually be
able to fix the keyboard and stuff
yourself
um maybe i think we'll leave an open
source you see the frame around the
thing it's called plus frame i think
right now it's closed source we gotta
get this stuff open sourced
um
so we're going to get more stuff open
sourced and more development process
available to anyone in the common army
to to contribute um
so camry camry is coming right coming is
is one of the cars that is going to be
like easily important
you'll be able to literally follow our
guide and do a port on the camry the
2018 camry
um like no
can we say no coding experience required
for the guide you think we can get it
down to that point
um probably it depends depends i think
like some variant for example like the
camry or like different dreams can be
done with no guidance like no coding
experience if it's just a matter like
fingerprint differences it's very easy
so
civic guide well so the guide is going
to be general and
we can make one for the toyotas and the
one for the owners is going to be very
very similar
i mean
yeah we'll we'll we'll we're really
going to push on toyotas and lexuses
this year
um but no we can
yeah how different do you think the
honda will be
maybe maybe we should do the same
refactor
i think it's working oh we are going
through this every factor and toyota
but i mean there are a few things that
needs to be changed differently just
because like
interfaces apis are different
which here and model civic is best
uh civic after 2016 is supported you
gotta have honda sensing and it can't be
a hatchback civic correct
um hondas are really annoying because
there's lots of like different variants
to them
um but yeah you know we open source all
this stuff i think a lot of it is is too
hard to use right now for a lot of
people we need to make it we need to
make it dumb easy to use
have you ever seen the ethereum
documentation that's where we need to go
i mean you know vitalik's building an
army over there too the future says
armies that's armies
and
yonder young day we didn't look into
yunda yet
but that's something that you you guys
so that's that's definitely doable
that's going to require a programming
experience yeah if you're doing a port
to another honda and toyota
there might be no programming experience
required if you're doing a port to a
different kind of car you're going to
need programming experience but two
people out there have managed to do it
we need to proceduralize all of this
stuff
so when this will be
when this toyota part will be available
probably next release next release so
when you think the guide will be done
um
i mean before it depends on when we do
it actually the fusion works look at
that it feels all the vision fusion i've
never seen that work
why would the hatchback not be supported
well it's totally different
can interfaces
and
there is no easy access
to control longitudinal control for uh
for the hatchback one yeah yeah you'd
have to you have to hack the radar
because a lot of the stuff's done down
on the radar um but people are always
asking why is it not supported do you
have a toyota highlander you'll be able
to support that now yourself you'll be
able to follow our easy to use guide
and you'll be able to um
to to to to support yourself
yeah you need to make it so easy so to
use it and baby can use it we got to get
plus frame open sourced you got to get
all all that stuff should be open
there's no reason it shouldn't be why
come ai does not need mobile vision chip
because we have our own it's called
vision d
we're using state-of-the-art machine
learning from crowdsource data from the
whole comma army
the real the real pawns in the comma
army i mean i have not even it's not
even an offensive title you guys if
you're out there collecting data with
schiffer i think that makes you a pawn
in the comma army you come into the oh
let's meet
[Music]
um
you come into the uh we can turn the
scopies off you got to take that
um
you get a pawn in the comma army if you
come on slack you start helping people
out i think that makes you a bishop
all right you're gonna gonna take some
chances and take some chess rankings
comma
army
um
maybe maybe maybe
there's not enough chess pieces to have
titles right maybe maybe we'll work on
real military titles i'm gonna look up
i'm gonna look at military titles we're
gonna we're gonna work on some uh some
real some real titles for the comma army
eventually you you come and work here
you get to you get to lead the army from
from from actual um headquarters guys
we're in this
to win
like like
man not like a team wins like an army
wins this is this isn't
this isn't this isn't football this is
war
i mean and that's the
uh who was who where was where was i
just reading this catholic church prize
cherokee
we can look into that one too
y'all know i'm religious um
yeah
yeah no but that's like it is i i forget
why i was reading that steve yeage just
quit google
um and i think i think that's how he
really described it he really described
just like the competition between these
companies is not a football game it is
war
um and we're
[Music]
we're about ready to really really
ratchet up the game
um we have something really big
happening that i can't talk about right
now
but
it's really big
um
you guys will find out about it by the
end of the year if you thought the hd
maps thing was big
this is this is bigger than the hd maps
thing i can't i can't talk about it
right now
um but it's going to give uh let's just
say man remember that time
that uh
the europeans were losing world war ii
and the americans showed up it's kind of
like that
remember that time
so
why tesla struggles without mobility and
we don't this this thing has a lot of
torque why does tesla struggle without
mobile eye because they're noobs no um
i don't know
okay is there any p2 really that bad
like is this thing really better than
ap2 if that's true then that is sad i
don't i don't know i've i drove a car
once with ap2 back in the day it is this
is certainly way better than it was back
in the day
but
by now they really haven't managed to uh
to make it on par with this
that's that's that's surprising to me
um why does tesla struggle without the
mobile chip because
well it's infrastructure really like
mobileye has tons and tons and tons of
training data that they were testing
their stuff on only recently has tesla
started getting data back from its fleet
and you have to build a lot of
infrastructure to use that data
meaningfully
it was a good one before what were you
saying
oh are you worried that
he's going to be out there to a car
because like
they're going to be looking down
you guys you guys
look at look at apple and sony these
companies have spent
millions and millions of dollars on
security and they couldn't stop me
do you really think the car companies
can stop me
this i mean this is this is just like
this is clearly just not thought through
the people who like say this about comma
ai like how are they going to lock it oh
they're going to put encryption on it
with keys oh wow wow encryption and keys
were foiled you know what actually the
joke
if they switch to some like more
standard encryption and more standard
keys and more standard ways of doing
things it would actually be easier for
me
like the whole annoyance about hacking
the toyotas is they have everything
custom and proprietary
um it's security to obscurity it's a
terrible idea for security but people
like me who are really good at breaking
like traditional security systems that
you'll find on like phones or video game
consoles that are actually like good um
you know you just gotta you just gotta
muddle through the obscurity
um though i'm getting way better at
hacking the car stuff though
uh well also like everything is going to
the easier direction like platforms are
becoming so somewhat common like all the
toyotas are now much common
to each other than than before they
share same apis the same issues
same messaging so it's actually becoming
easier
um
as a 16z would say software's eating the
world
i mean that's what that's what this is
right like when you had like every
uh
you know every ever like the civic in
the accord using different stuff why you
got it you got to apify that
oh
i got a little confused there even
yeah oh
that's okay and this is with the patch
these well so
the patch doesn't affect the amount of
torque that you put if you don't touch
anything no but that was me holding it
holding it back
yeah look at that that's with the patch
i think we might even have to go more
yes so what it's 500 what is it now on
this 350. 350.
yeah
yeah
that overshoot man
but so the other thing is like the rates
so we can change the rates
proportionally
like the stealing rate well the rates
aren't a safety thing i mean i don't
know this is certainly not as bad as it
like used to be
i'm a little i'm scared now what it
would be at 500. i do think this is a
safety thing uh yeah no 500 too much
yeah
um how are we going to like program that
into the panda uh initialization
you know like have it yeah i mean we
yeah we need to initialize different uh
i think we're already doing it for uh
[Music]
yeah we already have the
like the thing in place
so we have the toyota that allows all
the output so it's just like changing
some parameters
yeah so you just want to give them like
different safety mode ids yeah that's
probably easier to do it
i'll have to bump the panel from my
version
that's something else we should do i
mean that's going to be the last step of
the boarding guide we got to talk about
safety we got to talk about safety
checks talking about like i mean we took
a bit that's pretty
guys
yeah it's happening
it's it's happening but it's not the big
okay how about this
you all seem to think ap2 sucks right
ap2 has six cameras
sounds like more cameras aren't the
solution right more cameras are
necessary but they're not i think that's
a new band question
that's a new band the more camera
question is banned and the when will my
car be supported question should be
responded to with a here is the guide
reporting
um
it's not that we don't think more
cameras are necessary it's that we don't
think more cameras are at all the hard
part right
you guys know what the
there's no like like they hear like
cargo cult engineering
um go fusion
that one was hard
um
cargo cult engineering you had these
people uh
they were on like a like a pacific
island and the us would go there during
world war ii uh they used it as a base
to invade the japanese
and
these people were like indigenous people
they had like sticks and rocks and i
don't even know if they they had farming
they might have had farming but like you
know we're talking real real real stone
age stuff here
um
then these planes come out of the sky
u.s military planes with things like
mres now i've eaten an mri it's pretty
disgusting but if all your life you've
eaten like nuts and berries to first
even be exposed to any like sort of the
richness of modern food and they had
incredible things they had like things
like cans
i mean even even even the most
indigenous people can see a can and can
appreciate it wow like compare like a
bucket to a coconut shell it's no
comparison right so these these absolute
marvels practically fell out of the sky
um the war ended in the plane stopped
coming
so what do these people do well
they didn't really know how to make the
planes come back but they really wanted
the planes to come back so planes have
great stuff on them so they built planes
now
they very clearly didn't build working
planes they built wooden things that
looked like planes
this is what i mean by by cargo cult
engineering right and you see a lot of
this in the self-driving car world today
you'll see people who don't actually
know how to build a self-driving car
because that's a really hard problem
just like building a plane but building
something that looks like a self-driving
car is what a lot of these companies do
right just like kind of well we'll put a
bunch of lidars on it we'll put a bunch
of radars on it i'm not gonna call out
the worst offenders on this because some
of them are okay people but um
the
point is
all of the hard problems are solvable
with a single camera
then shipping cameras is an incredibly
easy problem
so that's why that's a bad question
all right
more questions
he's doing well
so it's a little it's a little jerky and
it's the same sort of
thing as the prius
yeah well it's different so i think it's
the same as the f4
oh you think this is the same as the
round four yes the rav4 i thought was
smoother than this
well so there are four because uh it's
there is a lot more resistance like it's
heavier car yeah yeah
could the previous this one can kind of
freely move can the previous thing just
be caused by the weight of the car
um
well no because it's not heavier than
the than the the metaphor but that's
what i mean it's lighter than the rav4
yeah but this is way lighter than the
previous one there's way light in the
fridge oh yeah no battery
it's not bad though yeah it's like 2800
pounds
yeah well that's some serious torque
yeah
with the i think it's the same max
torque just like much lighter car yeah
and bigger steer ratio so
bigger meaning
like you you for one you don't meet that
the steering wheel is more of the wheels
no the fusion cago
great pandas are still uh let's look at
a bit of work
uh yeah so we're gonna um
start shipping those out pretty soon
does anyone remember the great panda
contest if nobody remembers the great
panda contest we just won't give any out
hi scoby
comma
army
how do you deal with parking all your
cars in the shaft
we stack them vertically we have an
elevator
no we're in the suburbs bros
can't wait we can do this without
disengagements
it is like you're just jerking
why is this yeah i mean it has more dark
and so as soon as the
like it wants to change it changes yeah
but is this like a static friction
dynamic friction kind of problem like
because of our ramp up it like winds up
and then gets to a point where it can
put real torque actually no i don't
think this one has much that problem
it's not like the previous it's i think
it's literally like there are four more
why is it doing that
yeah i mean the model's not doing that
no the mother's not it's probably not
doing that yeah and we'll take a look at
cabana see why it's like
yeah
um
i mean it's all npc determining this too
right yeah yeah we can check the like
the commander for me
yeah
we're replacing a phone camera with a
better quality one
you guys
it's not the sensors
it's not the sensors
none of the problems in open pilot are
caused by the sensors
that's fusion in next update actually
it's already it's not
super good it's going to get better over
time oh yeah the visionary or fusion
yeah
tesla oh you mean well maybe they were
thinking about oh the ford fusion
is
all right
i would step on the brakes
with the system stop maybe would i stop
yeah
pay attention at all times guys
oh man we gotta come up with army titles
oh
what is your background reiki how did
you learn car control
i worked i was uh i studied at
university then i worked a few years at
tesla
and now come and doing the same thing so
any recommendation of writing into can
bus by comma dot ai
um yeah so you can go to uh
it really depends okay so that's the
thing i normally hear a question like
that and i get frustrated and this is a
personal failing oh the
the phrasing was writing into the canvas
like that
so this is like how i do interviews
right like if i hear a phrasing like
that i get frustrated because it's like
writing into the canvas no you like you
like right into a television show to ask
them why you killed their your favorite
character right
um
so
what do you want to write to the can bus
is the real question
now unfortunately there really aren't
i always say things like it's not my job
to educate you but that isn't true like
it is my job to educate you if we're
gonna win as an army imagine a general
that told his soldiers look guys we gave
you the gun it's not my job to educate
would that army win wars no that army
wouldn't win war so it is my job to
educate you um and i have to think about
really what the best way to do this is
so when you're writing to the can bus
there's a few reasons you might want to
do this if if you're writing to the
campus the way open pilot writes to the
canvas
there's this isn't the right place to
educate either you know somebody i'd be
so happy comma army who wants a
promotion we don't have the titles yet
but who wants a promotion i'm going to
explain some stuff now if you guys write
this up and like can you know come up
with the corroborating references and
put it on the wiki and then point people
to it that would be incredible
um
okay so open pilot
replaces ecu's
ecu's communicate with each other over
the canvas and they send canned messages
to each other so when you tap in and you
use like a panda and cabana you're
seeing all the ecu's communicating with
each other
you can unplug an ecu and what you'll
find is that some messages stop being
sent
so what we do for the toyota is we
unplug this ecu the ccu is a camera
and that lets us send the command to
turn the wheel
we also unplug the driving support ecu
to send the acceleration command but
this is like replacing ecu's
a lot of the tutorials you're going to
find on the internet for sending to the
can bus
are using this this this this like iso
tp standard
um with iso tp you can there's like an
api which you can use to talk to
different ecus this is not how ecu's
talk to each other so there's kind of
two desperate uses of the canvas
there's the
there's the like this message is
constantly always being sent
and then there's the
hi can you please tell me the vin number
of the car okay here's the number of the
car
um so if you're interested in the first
one read open pilot if you're interested
in the second one read examples isotp in
the panda
in the panda library
but um
yeah we need to like have have resources
like that right
and you know if you can't even really
fault people like i think about how long
it took me to kind of learn this stuff i
mean it wasn't it was quick but like it
wasn't like i went somewhere and could
google it it was i had to figure things
out for three months right like that
people don't realize that like
well the odb port on a lot of older cars
is just directly connected to the can
bus of the car and pin 6 and 14. uh on
newer cars it's sent through a gateway
ecu like on the tesla you'll see nothing
at all even on toyotas you don't really
get much
um
so to start to document that to search
around like cars have different can
buses what a giraffe actually does how
many how many how many how many uh
soldiers out there
know
what a uh
soldier's comma army man uh how many how
many all know
what um
i forgot i was gonna say
mccann but
yeah we were talking about the can bus
um
but more like
i mean i think about like my initial
journey with the acura and by the way
guys like things have gotten a ton
easier than when i started when i
started i didn't know that like
there was that can bus on the obd oh so
yeah you have these these can gateways
right how many of you know what a
giraffe does is my question like how
many of you really understand why you
need a giraffe what that's doing and how
you might build a giraffe for another
car i know there's a bunch of you that
do but like how common knowledge is that
from the inside i don't really know
let's see what they say
but in the meanwhile some quick catch up
what is that wire on the pillar that's
the uh power like custom power to your
unfortunately don't have like custom
power up there to the camera so we run a
wire just for commodities it's actually
isn't needed we can just like uh
yeah we can disengage it oh no but i
know i'll lose it i'll lose it i'll put
three well if i put yeah i could put
three okay yeah and then you turn off
yeah so it's not needed actually oh guys
i disconnected it we're gonna crash
and
oh which model is here is this car this
is a 2017 toyota corolla
oh
yeah let that stop and go
sounds like someone who's hacking the
toyotas they're gonna do a better job
cool
all right i consider i consider this
definitely a shiftable experience
um the wheel could be a little less
jerky okay and a break there's nothing
we can do about that that's always going
to be allowed and stop and go to work
but yeah in a while these things have
serious torque
yeah these ones
do you think they did like a torque
injection functional safety thing
and they declared this to be okay
no i think they have other limitations
um oh you mean like full talk yeah i
mean the main thing is the talk rate i
don't really think it's like a full
torque but do you think they considered
like anything you could send to the ecu
to be like okay and qm
well i'm sure they have targeted
limitations where
in the in the steering issue what they
do have in the steering issue which is
well okay it's much higher than what i
would consider saying yeah exactly me
too right and also the max stock is well
this much stock is okay i think it's
just even great it's like 50 units per
second
like well
per update yeah um we we limit the
safety even more in the panda for the
toyotas but uh cool scopeys uh thanks
for joining comma army we're coming to
you with ranks we're gonna really this
is gonna be the year and guys
some of you are gonna get rich
like you think i'm kidding some of you
are going to get rich
all right
later
bye guys
welcome
we're just driving lane was here on 083
the new audi
was testing it out we're driving on the
very sunny roads where usually the old
mall used to struggle with detecting the
lane lines
as you can see they're very washed out
in the image i don't know if you really
see that
but yeah the old model used to struggle
quite a lot with this so
this is a good test see how it's going i
thought we just take it for a drive
hi everyone i'm sure everyone 083 is
like on our local commute
here full intent let's go
someone said one to end yeah end to end
is super exciting we're finally uh
fulfilling the dream of comma which is
watch people drive and try to mimic that
behavior
yeah 0x3 is really a big step forward
for
for open pilot hopefully it's the first
of many improvements to come
yeah i guess explain for people who
don't understand what
end to end means in the simplest
possible terms
what it is um what n10 lateral really
really yeah end-to-end is different from
what we were shipping before in that
before we were
using uh just a mall that detect where
the lane lines are
and then we use the location of the lane
lines to plan a trajectory
you know in the middle of the lane
basically
but that's different from just training
a model that
tries to understand where humans would
drive so not thinking about lane lines
really specifically but just
looking at a road and planning a route
that looks similar to where a human
would drive
and then just driving that trajectory so
this end-to-end model is trained that
way so we just give it a lot of data of
how humans drive
and then we try to tell it to drive like
that and
it's been a very there's many many
challenges involved with getting that to
work
uh which we kind of tried to explain in
the blog post and this is really the
first release where we've got something
that
at least kind of works and it works
pretty well
we can drive on it for hours and not
really notice too many issues
yeah it does work really well especially
like you said on roads like this where
the whole
model would struggle with detecting
the lanes because the lines because
they're so washed out and it just yeah
you don't know exactly where to drive
yeah it doesn't suffer from these like
kind of classification bugs
so we use a segment that just detects in
the image where the lane lines are
and if there's any problems with that
and we have problems like that
with tar lines or with washed out lane
lines then those will
end up causing problems in the final
model but because
this doesn't use segments or anything to
be trained it's just training on how
humans drive
it doesn't suffer from things like that
if you can see in the image
things that humans would use on
determining where to drive
then it should do fine and it's not
really that susceptible to these kind of
bugs
which makes it a much more robust in the
long term
yeah it's super cool like i know there's
one spot on my commute where there's
like a mispainted lane line that briefly
comes like from the left lane line and
the right
the lane the lane line model would you
know move over to the right
because it like the lane line edge kind
of is
closer to the right but then laneless
knows that like oh
humans wouldn't follow that little
anomaly in the road
yeah exactly it kind of helps with all
those things and also with other kind of
lane-based things like in europe you
have a lot of
like bike lanes on the road basically
which you're allowed to drive on uh but
then the the langley mall detects as a
lane line and tries to drive away from
it but then
the rest of the road is too narrow all
these kind of nuanced things the
landless model
deals much better with which is really
cool
it's just a it's a much better long-term
strategy and what's super exciting is
that now we finally released an
end-to-end model
we can just keep iterating on that and
keep getting better so that should
hopefully the progress will will keep
keep going from here forward because
we've kind of got this kind of full
uh development locked in because we
think it should scale really well
yeah if someone wants to post this in
the discord go ahead that's usually what
i do but i'm on the street
so feel free to do that
[Music]
i don't think anyone has any questions
or if you think chris there's anything
else that's worth
trying to explain there yeah um
no some people are asking but and then
longitude though
yeah so that's the exciting thing now i
mean we've been spending years on
getting end-to-end lateral shift it's
been a massive project and we never
really know
how much more we had to do before we got
to a point where it's kind of usable
but now that we're at this stage this
kind of frees up to do more
things because because this is a project
that was occupying most of our time
and ant-man long toothless on that list
anti-longitudinal has some
problems that aren't really true in
lateral which is like
it's very sensitive to mistakes if you
break very hard or accelerate very hard
at the wrong time
it's kind of pretty uncomfortable
whereas in lateral you can still
override and correct so it is it's i
think
comfort is more important to get it
right from the first time we ship it
um but i think once we get to spend time
on it which will be very soon
i think we'll be able to make progress
quickly hopefully you'll be able to get
slow down for turns that kind of stuff
pretty quickly yeah it's going to be
great
some some people ask what audi is that
oh this is a
i'll do 2017 a3 yeah prestige does it
say prestige anywhere
i don't know if it does but it's pretty
nice it makes like turbo choo choo
sounds if you uh
if you accelerate it's kind of like a
little
go-kart climb yes it is cool
and another thing uh in zero eight three
is
like the massive volkswagen mqb platform
push
thanks to jason and the community we
have like
there's over like 10 mpb vehicles added
so it's like a bunch of vws
a golf golf from like 2014 to 2017 and
it probably would work all the way up to
now
mqb is all very similar so all the cars
are
basically identical just with some
slight different tuning
does it work on like the suvs and stuff
too yeah not nice
the the saw or whatever it's called it
works on
um like literally every vw it'll work on
um
so it's really easy to port if someone
has a vw that isn't supported just join
the discord join the volkswagen channel
and
probably someone can help you get it up
and running but
it's very exciting now that volkswagen
has fingerprinting 2.0
that we can just easily detect what car
you're driving
yeah we got some european cars supported
i know that's very exciting hopefully
you can get some more european data
some high-speed german autobahn data and
some of
some some types of data that we're
missing still a little bit
over 90 of our data is still from the us
yeah this is how the model would perform
yeah so this guy's loud isn't it this
truck
yeah so we're still using the audi uh
longitude though apparently it's not
very good i've heard
i don't know i mean it's not as good as
stopped cars
it's not as good as open pilot or some
of the other ones
yeah yeah lateral is much better at lane
changes
those those are kind of not smooth
sometimes the old releases
so that's much improved which is nice
it's true and things like
exit wheat like you know going for exits
and stuff i've never had
yeah much the laneless model
uh so for anyone who wants to know how
to
how to get lane list working you just
have to um
go into toggles of 083 and scroll down
right here it says disable use of lane
lights alpha and of course
it's an experiment so
always be vigilant but it's nice that we
have a toggle people can actually try it
out
really easily so you'll notice your path
is red if you use language that's just
to make it very clear that you've
you're not running in the standard mode
um
one of the things that's still different
with laners which is what we're trying
to work on is
there's not as much corrective pressure
so if you deviate from the path a little
bit let's say i push it over here
it's not going to push back as quickly
as with the lane lines
that's just kind of like a tuning thing
we have to
make the controller you know be aware of
how certain the model is
of driving in a certain place and then
we can make it
aggressive if the model is very sure it
wants to be somewhere else or
smooth if it's not that short it wants
to be somewhere else that's just kind of
a project we haven't really done yet
but yeah once we do that we use the
model's uncertainty
to tune the aggressiveness of the
steering controller we should be able to
uh
prevent like slipping into turns too
much if the road's very banged and it
kind of pushes it into the turn
or having it hug sometimes on some parts
of the wall
yeah yeah someone asked yeah the toggle
will only activate if you
turn your vehicle on and off if you're
like trying to activate a mid-drive
that'll work oh yeah that doesn't work i
mean now it's too for all the talk is
right
exactly yeah any other questions about
zero eight three or the laneless model
let's see
people keep asking if you can use comma
in left-hand drive countries
yeah there's a toggle for that i guess
it's right-hand drive i guess
there's a toggle right there enable
right hand drive
yeah so when you put the toggle two
things happen one is that the driver
monitoring system will start monitoring
the person in the other seat
which is obviously important and the
other is the we actually
input into the driving model that the uh
traffic is now on the left side of the
road and so
uh that should make sure that it doesn't
like always try to go right
on like a two-way road with no other
people
yeah that's super cool
um someone asked will lame list replace
the current model
or does it just adapt for situations
without lanes i guess
um yeah it's kind of a gradual thing
there's situations where the lane lines
won't really work that well
and so in those situations we want to
rely on the blameless model
and as we you know progress with the
quality of lane list that will be more
and more situations
because laneless can do things like if
you pass by a truck close by
a human would kind of go out of the way
a little bit and give the truck more
space
and plainness should do that but it's
good enough
so when we're at that stage we kind of
want to use more and more like this
but yeah it's going to be a gradual
thing
yeah that was a good good question but
already right now like
you know we use lane lists if obviously
there's no lane lines when you're going
through an intersection things like that
and when making main changes so
yeah even if you don't have the toggle
enabled
lane changes will be a lot smoother this
release just it's using
a much better laneless model yeah also
when going by
exits and switches to the laneless
policy because then the lanes
the lane lines go apart so it doesn't
really know what else to do
intersections when landlines are
uncertain it also
uses the laneless policy uh the linux
pulse is actually used quite a lot
already
the toggle is just there to make you you
know so you can try out what it's like
if you just drive purely without lane
mics to see what the mall is really
understanding about how
[Music]
i humans drive a pretty pretty cool
pretty cool little feature
yeah and again the way to know if you're
on lane list is you'll see the red
path and there won't be any lane lines
on the screen makes it very clear
if you're on blameless if you're on lane
lance this is white and you have the
white lions of course
um yeah so if you want the improved lane
changes and stuff that's that's all
going to be there
without the toggle since i mean it's the
same model still driving it's just
whether we use the lane lines the model
predicts
uh to plan the path yeah
someone asked if speeds over 90 will be
supported ever
so the speeds over 90 the reason we
reduce the speed is because
we saw from some data that uh at very
high speed
the model can get kind of confused
because we've trained on so little data
of high speed
that uh the model doesn't really know
what's going on it's kind of out of the
training distribution
so it's i mean this is the only reason
we did that as soon as we have enough
data of high speed and that we've
confirmed that the model doesn't get
confused at those speeds
we can raise it again it's just now
we've tested it we know that at this
point
it's getting confused and so as soon as
we have enough high speed data and the
model doesn't get confused anymore
we can increase it again yep
so if you do drive fast just make sure
you upload your data and then that
process will go faster
yeah any of those autobahn users out
there yeah any german autobahn users
i guess that's the most of the high
speed data we see
yeah someone asked how do we stay so
innovative
we stay so innovative i don't know it's
it's just fun i guess it's fun to
see you guys feedback and see that you
guys like it so
it's very motivating and inspiring to
keep working on it we've got a really
good team
who will feel the same way and all we're
really into solving these problems
yeah it's nice because everyone at comma
drives on the devices and
drives with the models so you know we
can talk about it
at lunch and dinner and how we feel and
stuff and we all just uh
yeah chat about our experience and you
know like a lot it's good that we're
users of our own system i think it's
kind of important to encourage our
development exactly i think it looks
like we're getting the traffic here so
maybe i should check it off
yeah it sounds good just engage here
[Music]
yeah someone asked if um big model is
implemented
yeah so big model we kind of have the
training stuff ready to go but there's
some reasons that
we're we're not really pushing hard on
that yet we've just noticed that most of
the issues
that open by the house the situations
that struggled with wouldn't really be
solved by big models so it's not
that way that's why it wasn't really a
priority yet uh
blameless was a much bigger priority
because we think that's the highest
leverage approach to
improve the quality of driving i mean
the
architecture's there uh as soon as we
start seeing that it's a
it's going to help a lot with certain
situations we'll start pushing on
shipping that
yeah yeah brevin asked if uh lane list
will
like move over for semis and stuff yeah
things like that well i don't know does
it
uh it should and it definitely will at
some point i don't know how well it
already works
with the lane line policy you know it's
it's never going to do that just because
it's not designed to ever
react to things like that the lamest
policy is designed to react like that
because humans do
uh i don't know if it's good enough to
do that yet i guess we'll we'll just
have to see
as it will improve at some point it will
start doing those kind of human things
it definitely should move over for like
opposing traffic i've definitely noticed
that if there's
opposing traffic that comes it will kind
of go out of the way a little bit which
makes sense because you know
everyone pretty much does that yeah
so we got the kale model as a tail
and if you want to learn more about the
kale model there's a whole blog post
describing the challenges and how we got
around those
to solving or what it is today actually
i guess
yeah i think we tried our best to
describe in this
shortest possible kind of the whole
strategy we used to get to lane smalls
if you're interested in this kind of
stuff you can always come discuss and
discord there's some
some channel about uh with models is the
topic that
people come discuss model stuff that
have interested in so feel free to come
discuss
there if you're interested or have
questions about the blog post
yep cool any
any other questions this is a pretty
comprehensive review or overview of lame
lists i feel like
yeah i'm not sure if there's anything
else we didn't discuss about languages
yeah
someone asked what the next big
challenge is i think we already said
kind of
the longitudinal thing will be another
big challenge right
yeah i think there's two now now that
the lameness works we can really
kind of iterate on that and prove that
so that's going to be a big thing we'll
be working on
and then the other big thing is yeah
trying to start like doing more
end-to-end longitudinal stuff
it'd be nice to do vision based
longitudinal as well without using the
radar so that
all cars will work exactly the same you
don't have to
rely on the radar to get good
performance
yeah that's great
yeah so you know eventually when uh
vision only is good enough
maybe we'll have like a toggle similar
to now
and you know figure all that out later
but that's a
far down the road thing yeah i think
yeah we'll look into whether we can make
it work with just a mob i mean we
haven't really spent much effort on
longitudinal in a long time
laterals take a kind of priority so i
think as soon as we
kind of really start working on it again
i'm pretty confident that
we can quickly improve things yeah
slow down for returns and everything
nice to get working
oh yeah that would be huge i think most
of my disengagements are
you know coming off an exit or whatever
things like that
i mean we've experimented with some
kinds of slowdown for charge in the past
but it's always like
it doesn't work super well and if it if
it messes up it's just really
uncomfortable
if it slows down too much you get really
frustrated i promise you can't really
help
with the gas or brake we don't know how
you can override the steering but not
the gas or brake
so mistakes are very you know kind of
intolerable they always lead to a
disengagement
yeah someone said my 2013 golf works
really wow nice that's pretty cool
that's the cool thing with mqb is like
it's been the same for who knows how
long all the messages and everything so
i mean if you have like an old car that
didn't even have lane keep assist it's
probably pretty easy to activate it as
long as you already have you know
adaptive cruise on your car
it's pretty fascinating how some cars
keep changing their apis and systems and
volkswagen's just been keeping it the
same this whole time
all yeah so here we're back yeah this is
really the type of road that
um the driving also has kind of
struggled with
uh plane they like to just be really
hard to see because of the sun because
they're so washed out compared to the
light gray road
again for our commute lameness is
definitely uh
helping although the lane lines are also
much better now
in the new new release because we're
using the new segnet
that comma pencil people have helped
create
thank you for all the efforts of
labeling in the common pencil project
yeah all the color pepsi people are the
best yeah
it's really helping us along so that's
true everyone's going to have better
lane line identification no matter what
next to come a pencil pencil
all right is there anything else i feel
like that was a good overview 0a3
was released a few days ago so if you
have a comma 2
you can get it right now just should
already have prompted you to update
and uh it's a great time to get a
comment too if you haven't done one
already
because we have the first release with
working laneless and
you know it's gonna get everybody's
gonna get better as time goes on think
of where we were a year ago
yeah exactly it just keeps getting
better and better every time i think
back to what the old
things the problems with old releases
i'm just so excited about how far we've
come
yeah it's really crazy so yeah comma 2
is 10.99 and then you can get a harness
for an extra 200 and get a
[Music]
get all the hardware you would need so
all right well we're gonna be driving
back to the
office now on lane list but i guess
we'll
see you all later all right that was fun
to see you guys yeah definitely check
out the kale post
and if you don't if you have a supported
car definitely
consider checking out a pilot all right
bye everyone bye guys
Scopus
but I'm distracted happy distracted guys
the Aeons watching you
we got to have your minds right yeah
Oh 2021 would you people showing a bit
more bet no also without mob is about
the transparent yeah
it blinked on distracted for a second
that I think it was I don't know where I
was looking I wouldn't have considered
myself
all right look guys
even beyond our super torque levels case
finally releasing the secret good open
pile of the secret code of the press
event you're gonna see it's gonna be
it's very exciting what we're gonna
release big release really something
that sets the tone for what we'll be
doing for the next year
yes I will show you will show you we're
gonna disable driver monitoring if
you're stopped I'm like we're not
monitoring you due to some states laws
but um but if I do it's not disabled
right now so you'll see what happens
[Music]
very bad very bad
should we kick them out well you don't
want to because like I'm not saying we
kicked them out I'm saying that like I
don't think we should do that I think
once it gets to read yeah we shouldn't
like like disengage we should job is to
continue to do the brakes but we
shouldn't go back to green we shouldn't
go back to the yeah we can and we can't
go into like a final stage where you're
into a state where it'll stay red until
it detects that I step on a pedal or hit
the wheel well but that's what you know
it doesn't know it it let me get to red
and it let me get to beeping oh you're
saying once you get to that do you can
you set up but you can't restart now
once you get to revenues you're saying
once you get to red even after you look
straight you have to actually take
control of vehicle I think is that
policy oh okay so you you for seduction
disengage you force the disengagement
absolutely yeah yeah this would super
booster it's really good look like super
clears when it's pulsing green yeah it's
fine
forcing green yeah but once it gets to
red now it should be slowing down and it
shouldn't let me it shouldn't let me
like that was too easy
that was way too easy for me to get
control back move me to get back at all
yes that's our oh yeah we can do that
yeah that's like forcing you so but you
keep beeping you keep beeping are you
after yeah nobody know I'm told but if
that's the point that's the point now we
might be when maybe I'll give them a
little bit more time like maybe it's
like green yellow red right whereas it's
beeping and you can still look forward
again I don't know though I kind of
think once it gets to beeping I have to
put my hands on the wheel and disengage
no you got you gotta actually take
control the car that's it if you want to
go if you don't go you don't have to
yeah we can do that yeah that's the
policy decision and then if you get
three of those on the drive yeah
what a great feature of super cruise you
guys remember that periscope when I got
locked out of super Cruiser I was
devastated
what but the super cruise localities you
have a war stand it hasn't won because I
have to stop we have to stop for a
minute mom we could do that too yeah how
brutal should be they pay attention guys
I'm so watch my don't pay attention
yeah yeah see that was too easy done
no it's too easy for me to get no no
that didn't punish me enough I should
have to drive the car for at least 10
seconds yeah that's right pay attention
for a second
Wow no false positives they're true
negatives either driving wandering so
good it's great it's not so hard to
detect when somebody's distracted from
something I don't know like gray zones
where yeah when you drive and you pay
attention just look straight especially
if you're on the highway yeah you guys
Tesla needs us yeah is the PF net no
well actually yes is PF yes yeah
we're not when I use a PI controllers
anymore we're using PF controllers like
PID controllers but better
oh man I love driving monitoring guys oh
and by the way there should be no
six-minute a minute all right well there
you see if you set off so what we're
gonna do if driver monitoring is not
working on you for some reason I think
the policy we're gonna ship is a three
minute time out now I mean as our driver
monitoring gets better and we grow more
confident in it we're going to make that
period shorter and shorter children
till eventually he will let you engage
unless it detects that you are an active
driver participating in the driving
experience because guys all self-driving
cars today are level to pay attention
all talks today we got so what what
happen if you look down but you keep
your head straight not doing eye
tracking yet we're not trying to catch
all of them look like can you cheat the
system
yeah can you cheat GM SuperCrew system
yeah but this is mostly to prevent you
know most people are using a phone look
down here watch the merge make sure it
doesn't has it all distracted you so we
just don't want people to do that as
part of well there's great things to be
announced at the press which are
obviously not gonna route bus boy I want
announce right now this card by the way
is running the secret good version of
open pilot I was just trying yeah I
looked over the CEO piece I was
distracted very punishing well yeah I
don't think we should go to read and
just that quickly so we a wholesome
green for a bit what you look at what
super cruises policy is yeah I belong to
think is that you do not is the super
response minutes right in front of you
it is easier to notice that's true
but you know certainly once they get to
rad they got to drive the car
made bad choices
yeah there's guys what do you think is a
secret good personable
well okay so
actually your secret charge you have I I
feel the wobble what well there's a
permit and a signet parameter change but
I don't want to tell you because I don't
want to bias you if I do want to know
what you think you add is it plus twenty
centimeters nothing I actually like it
it's wobbling a little more on
straightaways it feels better in turns
yeah so I made this tonight cos point
five which is what it's always so that's
what is always speed on all this okay it
does feel better in turns and it feels
worse on trees so it should be more
Center because basically it forgives a
lot more we have like vodka parameters
if the model is incorrect or far away
but yeah I mean you know we can we can
measure this
the turns feel better the turns
definitely feel well time with secret
good open pilot yeah I got the
disengagement oh really yeah yeah we
definitely know that's really bad guys
we don't have any unplanned disengage
this one of these go to super cruise and
you can cruise forever now that you have
driver monitoring it's drive monitoring
my scope is my you show me you that's
right don't be distracted don't do it
guys the end some of these props people
dynamic than what they are today
definitely working on some parameter
features yeah it all depends on the new
location architecture which is also the
new calibration architecture oh this is
much better insurance yeah
I don't even go enough drives like every
night working on
making sure the pilot 0.5 is good
okay I was scratching my head he's fresh
event ma'am at the halfway mark guys the
halfway mark that's all it is
we're not gonna tell you what the press
event is you got to be the press
you got to be invited we've invited four
we've invited four groups for presses
hopefully they all accept our lovely
offer I'm not sure why you wouldn't but
now one of them won't so we won't get a
new press in
if you have a press and put it this way
if you know how to get us a million
views on YouTube we're trying to get
some million viewer videos I've been
here right 1 million views it's a good
number of views what happen if you fall
asleep with your head straight well so
Ryan's an asshole yeah literally no I
literally want you to fall asleep with
your head straight it's impossible your
head goes like this and you're
distracted yeah I've tried on airplanes
many times to fall asleep with my head
straight you can't do it that's living
on plane otherwise can you wear
sunglasses with the system was yes
that's lie again we specifically look at
the head orientation and terms out that
you really catch like 95 or more percent
of the situation where if I had a flea
I would definitely make sure my fleet
happiness how do you have a fleet
without you know if you're paying people
to drive please look at the road
yeah so I think we'll disable it if
we're going like lower than a certain
speed
anything's - for action of every commit
the closest be dependent yeah it's worse
to be distracting you going Saturday
we're going ten yes like you media type
of timing yeah
it's a distance kind of thing yeah
yeah well I'm so I'm definitely gonna
put something that like when you go to
zero speed you decide the time that you
keep you basically like I said whatever
it's building yeah should we do it talks
about the six minutes you think wait a
minute like every time they at least not
counting when you're stopped like the
six minutes count their Oh shouldn't
count what you're stopped or I
understand
maybe guys look at the secret good
version of a pilot it's so good and that
will be not in the geofence wheel driver
monitoring incorporates showing
placement to ensure a proper field of
view but so if you follow the mounting
is Tatiana you have the right mounting
procedure and you have the right you can
also enable front camera upload please
enable front camera upload people we
love your data we don't have enough data
this net is trained on too little data
we've taught we train this net on a
really paltry amount of people it's
amazing that it works as well as it does
so this is my plea for data please
data we love data and then you can also
you'll be able to review your front
camera so you'll know what your
placement is you'll make sure it's good
if you upload the data to us
what else is that data data data we love
data please please give me your data
people with definition if you just go
grab the camera that's a distracted
we're engaged again it doesn't detect if
you're distracted when you're not
engaged I think that's gonna be a toggle
yeah yes we're gonna have two toggles
for driver monitoring well actually yeah
we cannot allow people to disable when
is good enough yeah I think I think
we'll still write beta for it yeah we'll
just make that we'll make that time
increasingly aggressive to to encourage
people to turn it on I mean they will
have another toggle which will stay
forever and that'll be an able driver
monitoring while I'm not engaged yeah
Scheffer plus will also have that toggle
as well so Scheffer plus will have
dragon monitoring and no ways in Spotify
because those are gone
and we need all that room to run all
this fancy driver monitoring stuff
that's a line drive about our stuff is
really small
we're driving right into the Sun right
now yeah okay
yeah
yeah there is somebody who wants an
interposition the application try to
give you a job at cutting-edge overcome
I can't say
you see both driver money when you turn
signal on that's a good idea
yeah I mean you also shouldn't be using
your turn now
no is it driving well okay so there's
the driver bottoming would not engage
policy which I think can do things like
that but the driver moment why are you
using a turn signal while you're engaged
only if you want to change lanes right
now when you're changing lanes you
shouldn't look away from longer than the
driver I mean that is a nice thing about
having an ACC system I wonder how many
accidents that prevent they prevent
where people are changing lanes hooking
in their blind spot the person in front
of the brakes I mean that's one of the
main reasons because I'd like to have
HTC always on all the time yeah because
you like use your to more set of eyes
looking site when you don't look one eye
in the EON it's just an eye future
products they have more eyes
just hides right notic not years yes oh
we're definitely more years the yel only
has one year many years but the years
are disabled I don't know why we really
even have ears ears are very cheap yeah
you get great deals on years coming
digit key
Subash two eyes well survivor eyes two
eyes two eyes hey what did they want to
test something out covering the cabin
distracted it yeah that's right don't
cover the camera my friend said he
needed a he donates he stands a lot to
come by for research and development
yeah
hell yeah every Tesla seriously yeah we
take it we'll take your free Tesla what
is it
yeah which which doesn't top and don't
tell Tesla about this if you guys don't
under the out pearl Tesla doesn't like
us having our cars as the parties worked
pretty well well we forget the Tesla
maybe we can support so finally if
somebody donates us a Tesla yeah I would
be okay with that
good it's like the bounty program but
reverse yeah we'll meet you
I want a pencil they all let me by
guys this is the secret conversion of
all compiler that doesn't make mistakes
it doesn't
is this how good it is for everybody
it's pretty close to what everybody has
except they talk limit there
no I think this tonight whatever these
parameters are it's just we getting
better as we've been driving doing away
with the on this one is nobody yeah I
like this your cost okay it's higher
frequency and it more feels like yeah
like the car is doing something instead
of just meaninglessly wobbling me around
the lane yeah yeah we had a big we had a
big wobble fighting yeah after the last
few days we it's like it's not the wall
but that everybody was used to before
but still something was there
well yeah wasn't model counties do model
the old wobbles
doesn't know where it's going
that way that's not the monetary require
calibration actually no you know you
know where the head is you do some math
you figure out the orientation
[Music]
but yeah so what's gonna be enabled is
whether you enable driver monitoring or
not the net is still running and so you
will be able to get a summary of whether
you're paying attention regardless we
send back don't worry don't worry it's
not the front camera data it's literally
six numbers talks about the position of
your head how large your head is and
where your head is
maybe we'll post what Donna lady has a
largest head
[Music]
how do you do that scabies
how many mines have been mapped if I'm
getting partner
love me
and sighs leaderboard that sighs later
bud
big headaches
ya know see you like it when you're
comfortable like and actually that thing
does help look like I'm looking at the
iana that says I fear distracted
yes she's got I think
yeah disengagement
Wow I have to hold the wheel right today
we'll do it we'll know we didn't try to
exit but what's happening distracted
yeah we're you know sort of I was
looking here I guess I was distracted
yeah we'll wait longer till we get to
until they can't do read but then read
is fatal I mean that's what it's
supposed to be right like your head
means that you have to
okay doesn't drink the next day I guess
whatever engages slowly
like what great song
this Acura is running a coma pedal we're
running the couple guys the common pedal
is great it makes it a stop ago so guys
we don't get like dis engagements have
been reduced to like one or two per
track well he was stopping at any cable
right out
what type to cigars which I learned like
the driver my turn although the the
fading alertness a new mechanism or
introducing
it's just temporarily unavailable
because of what we write again oh yeah
yeah yeah they wanted you Justin
beeps in this car loud nice yes this is
the best car she's the best reserved for
the VP the CV kid not sure why then I
use it to be more like Betty trigger
yeah it's very we can also take anything
more for like a head down rather than a
head after especially because the press
is gonna be looking at that's a good
plant and headed down is what matters
more yeah no one uses a phone like this
don't have that info
if I tilt my head like this well I think
that maybe should be along I know I
tried to just teach you I shouldn't do
it because I usually got it at all yeah
that's actually shouldn't care about the
yeah pinko is pretty good ah yes what a
guy was saying that P Park is actually
good on current development parachute
yeah
or just chef replace release today guys
we want your applause
I went does two ever monitoring working
total darkness this is why iris love the
3-minute timer yeah yeah we need to up
the phone back beautiful three minutes
no more six guys and I got swelled with
the sex screening
alright Skokie's thank you for joining
us on this driver monitoring adventure
this is where we leave you pop double
use my phone it's angry I'm distracted
I'm distracted we'll leave with the
beeping no
yo you know webscoe p fam gather
insurance we're getting we're getting
real good at this now alright so this is
my first time driving the open pilot
port to the fusion here I here are you
know it says magnified stop let's end
the upload right is officially canceled
okay guys the fourth thing might be fake
news I kind of think they're just
posturing against Trump's Mexico shit
George why don't we have the cool up so
we got our door for you started again I
know it's good alright why don't we have
the cool what holder for your phone
difference for people lordy zip it on
that alright
sorry periscope smokey so we crashed a
new Ford Fusion
no but they be experiencing it yeah
who's in the car it's me Riccardo and
George yeah it's like a fun mountain -
the sunroof totally agreed that would
look great no let me out some air
conditioning in this car so hot yeah
this is reminding me that's more
weak-ass Ford shit oh that's better now
we're talking I just hear it I feel good
Ricardo a little kind of laptop so I was
wondering what predator yeah this is
reminding me of the good old days in the
rav4 when we drove across the country
and this was just a way to hold the
scope he's at all times wanna show them
for giraffe
yeah look at our four giraffe
large engage this thing so you need to
first turn on the on yes okay it does
something it does something but then it
cuts out now we can try the root of one
because now there is a new combination
this could be worse so yeah there's some
there's some issues with the fork or
what do you psi I told the scope is that
that's a new band question guys EPS exit
dangerous don't mess with EPS x/y Chevy
well so you guys know that we paid out
the Volt port but we haven't up streamed
it yet there's a lot of subtlety to the
the safety we want to make sure we get
it right so we are going to buy a Chevy
you can guess what carcass contesse it's
a dad car
scope is now
they're not guessing it without guessing
both Chevy Volt na debug alert why is
there debug alert because we are like a
low speeds and so it's not allowed it's
not a lot of low speed eleven twelve
miles per hour
okay Demian just like my rev no your rap
doesn't have a stop a gun with Lisa
fusion he'll stop and go the ACC in this
car is very good
oh it's very good with you oh this one
is stop and go yes Sona stopping go yeah
so we're want ACC right now except you
have to press the button to resume which
kind of sucks is this one easy to
overcome yeah because like we can't send
what we can send that we can stay on the
buttons oh that's a good deal if you
have open viola we can just spam the
actual pun I mean I was doing it there
for the bathroom but I was already was
closing fault but I don't think it was
disabled now that's low torque if we
just get like a hundred thousand more
super hearts movie good we can be part
of the periscope famous people program
Oh be like just like Casey nice dad
exactly yeah he's not a periscope right
he's all right so that that's where
that's your half cents yes pumping yes
copies what what GMO were you going to
buy people guessed it but a lot of
people are saying the Impala we thought
about an Impala turns out Jonah Bevan
times our GM sells 720 and follows a
month well if you want a Buick LaCrosse
then they only sell seven
the Cadillac Wow you know hey they just
got one in stock
what if they sold it to folks oh it's
just for me so I know when the lot of
control is cut out by the EPS you have
the 40 PS before the PS so yes as a
problem every 10 seconds it stops
responding and so it's not the best
control starting with but then every 10
seconds they throw out like temporary a
fault that you had like to disable
control and then they like really you to
to commend new things now there are like
a ton of other modes another flag that
you can send and I like a lot of
combinations so there is still hope for
that we might overcome this is like 10
second timeout but so far not so good
there's a lot of modes it's very
complicated oh it's doing so okay we did
something there the pork wasn't that bad
yeah
oh I don't like oh it's not a total
cancellation mode I disabled it there's
a now if you want to engage it oh why
doesn't this go plus because your stuff
I can't put the blocking out for the
speed-up free config world is garbage
no because it's like overloaded we did a
Sumatra I understand alright great Ford
whomp it check out our Ford giraffes in
fact as a peasant at its really how do
you made it yeah long-long like a Ford
it's very funny steer back there back
there back there back
oh man that's all act yo this is my butt
yeah I have like a second masticating
for real well so the problem is that the
interface it seems like it's angled
phaser
yeah then if you provide like an angle
based interface at least the job in -
yeah so what we had what I think that
even though both for both torque rotor
angle nest yes it really seems like
everything is that because the well so
that's the problem
while I'm eating I have stuff for you so
you're getting that from the radar okay
yeah yeah don't like 64 objects that's
nice super noisy but yeah yeah the
Dolphy has a motel
it's like 60 no I'm just beautiful on
your name is autumn
looks like it does look like autumn yeah
yeah multi cause I like that I'm like
half engage now I'm so confused
and it's a little bit better higher
speed because I could was are there any
Chinese
zero counter love for ping pong yang
that this is even like it doesn't even
try
was that your breaker that was the car
is good it's not open file doing that
guys I'm about to doing steering but
okay so here's our hope for the GM we
think that it's the same platform as
super horse so we think super cruise is
using the same like interface and super
cruise is good so our goal for the end
of the year with open piled 0.5 is to
surpass both super cruise and autopilot
we're trying to be like a superset of
both of them well we'll see I think we
can beat the current test log day
we'll see if Tesla keeps updating
supercruise things that we have to ship
to match supercruise our driver
monitoring and supercruise does not
wobble it is zero wobble guys I remember
when it was fun to buy cars now it's at
work someone has swine flu she's sorry
I'm happy that we can I know I was about
I was thinking that - Tesla showroom
showroom reject repeat Alamo GM you
don't understand guys okay Tesla owns
all their dealerships so they can ban us
GM is not really affiliated with this GM
dealership it's like a bunch of bros who
buy cars from GM so as much as GF might
not like me it doesn't matter cuz this
guy like what does he can't just own the
car he's just gonna be like the classic
like Bob cool very cool for a company Ok
Go your guys my lieutenants secret to
buy cars negotiate the price down and
then tell them you know about incentives
and rebates and then pretend you know
more about rebates than they know
yo yo Toyota was trying to lie to us oh
that did something
yeah you know but like it cuts out so
long
well this is usable almost almost
lag
yeah okay so this is an example of a
steering control a class ii
laughs well
these cases so prob
the scope he's know we're doing very
exciting stuff for Oakland of zero point
five point six and if a zero for point
four point seven we're finally going to
focus on a moving wall oh so exciting so
exciting you know sometimes an open
pilot feedback you know we never thought
of that
yeah you know now that you bring it up
so that's why we're working on it for
zero point four point seven
I really don't engage
this is this this system is normal car
I'll cast quality so we managed up the
Ford from nothing to normal L chemist
it's sad there's no reason any of this
should be lacked like there's the
Lancaster where does the lack even come
from
they have like most likely means of in
force
I know these bots are copy or comments
I'm sorry I'll ban on the next time I
see them just
how does periscope up to a little better
you know now that we have accepted that
all these companies are content
moderation platforms
do you know anything is that you can't
hurt a boss feelings you know like you
get an inner win when you ban but then
you realize like wait they don't care
that that's right that's why no
straining yeah that's why we all have to
stop being so outraged you're probably
arguing with a bottom yeah the person
who has very strong different views from
you is probably literally a bot designed
to make you out rich
do I see their driver monitor monitor so
we're going back to the same GM
dealership that let me test-drive
supercruise so I get a little bit of
good points for them Oh George you are
about apparently according to warrant
are you sure you're not confusing me
with mr. Zuckerberg in the same you know
just because I'm wearing a grey hoodie
man Oh way if they go pick up our new
hoodies
you're very employees afraid of boys
only that's right that's right you can't
buy hoodies yeah um but always stay
tuned for the special merch drops being
Jorge from Twitter oh my gosh how could
you say oh I don't even tweet what just
cuz my name is real George Hobbs oh shut
up follow me on twitter also check of a
sack claps a concise Tom Cruise I'm
aspiring rapper from the suburbs
this camera quality is pretty nice they
have like a like our lighting has been
good for most of the ride we start with
the iPhone X yeah oh yeah that's so
great yeah
all right Stuart Chevrolet brought to
you by Stuart Chevrolet this stretch is
so weird it's just like babies are out
babies are us going out of business
classic babies are going to not just
toys I just want to see if we can park
electric vehicle parking only sure we're
a hybrid we have some electric yes
Turner we park the electric that nice
Jim let you used should we bring him in
let's go please oh no we gotta be normal
yeah thank you for joining thank you for
joining there's a real subdued day you
know chill day today yeah we'll let you
guys know yeah well we'll be scope
Maurice cope by
are you
life what up
Scopes we got to make this terrible left
turn we're here in the Honda
Accord testing out open pilot
0.5 uh we're going to be releasing this
to devl when the Press embargo
finishes uh Friday at 6 p.m. oh this car
is so much nicer than the Civic oh so
much nicer guys buy an
accord that is great all right a breous
excited bre is excited for
0.5 oh do you need that on cuz the
driver
monitoring or just to see the scop just
to see the
scop Alo the Scopes can see you yeah
what up scop I'm wearing sweatpants
that's
true you already got 35 Scopes yeah they
show fast
it posted on Twitter wait wait oh that
was
weird why did it say that for longer
than when I press the brakes yeah it aut
post on
Twitter it's pretty
nice op pile 0.5 guys check it
out the cord actuators are worst than
Civic well you know more about that than
I do I think they're uh slightly better
but still the the amount of torque is
about the
same unless you have the secret Civic
torque mod of course then you get 2x the
Civic torque for reals this time
guys uh we need a cord torque
mod yeah we do we we'll make a cord
torque
mod it's only for users of the secret
good version of opet version of op pilot
the good Civic parameters no we've uh we
fixed up all the parameters for all the
cars what's that like beeping is this
car like trying to tell me
something it's probably a b system
trying to tell you something turn that
wait is the B system still like on at
all or no it's not no it's
off that's different behavior from the
other open
pilot normal open pilot won't let me
engage at a stop
I don't know I was pressing resum it
wasn't
working this car is much more of a joy
to drive than the Civic guys I would
really like this to be the self-driving
awareness Tour Part two car I really
like to be taking this across the
country but we're going to need a torque
mod and we don't need a radar hack
because uh you know who needs a radar
just See's
Vision how the the Bosch system
different um so the Bosch system has
a crappy radar that doesn't give you any
objects yeah so this means open pilot
can do long atal control
yeah oh this is a Honda boss
giraffe um one of the uh only couple in
existence then didn't put the thing in
the ethernet P got to make sure we
should
uh using a comma power using the new
comma power diode circuit very
nice yeah night drive thing is supported
driving at night actually works better
than during the
day and it's even driving monor at night
I assume is it see
yeah track pretty
nice I guess it's helpful that we have
the light
on yeah this is guys no wobble there's
no wobble in the Civic anymore either
Hondas don't have
wobble so you tell them why you tell
them about the steering ratio oh yeah
Oh's lying on their website about the
steering ratio yeah so we have an
Optimizer now that calculates the real
car
parameters was the Press
excited oh we can't talk about the Press
yet it's under embargo guys I will get
mad um no the Press went very well uh
Friday 6:00 a.m. guys keep an eye how
many Scopes we got uh we got 50 Scopes
wow so much
scopy who word press wow we definitely
can't talk about that does the fuse with
stop cars uh well the bu system tries to
fuse does it fuse no it doesn't do a
good job does a terrible
job do matter
ours usually gets it if you're going
like below
40 so now the good stuff starts around
the highway well is it
good yeah it's a it's the same
model but uh new models are going to be
a lot more
frequent stting
soon we suppress
impressed uh no
intend we can't talk with the Press
guys oh my God we need more torque I
don't like it I want more torque oh my
God I feel bad for all of you who don't
have torque
mods plebs with no torque mods
no it's pretty
good is this the same park as the Civic
or it feels like
less and I think we're we were just
spoiled
maybe yeah pan on Amazon Pan's on Amazon
guys Amazon Prime Amazon Prime go buy go
buy go buy we good reviews
too if we get 10,5 story reviews we'll
release the torque
mod uh it was really good this is as
good as
s except for
that we shouldn't I mean when that
happens we shouldn't really throw the
orange we should adjust our threshold
for
that
stop uh also does this this car lose
speed if
you're uh distracted for too long I
don't know
actually that ask me c that I think it
might
not because we're not controlling laun
tunal on this
car the car is a great engine guys I
think we we can cancel well but that's
ballsy yeah cuz then we can't uh break
all right so I assume this well exceeds
the torque Limit Oh yeah oh maybe at 50
slow down a little
more oh that pretty nice oh good
experience yeah wow really 50 changes a
lot yeah yeah yeah I mean the torque
goes with the square of the speed
so now the the Priuses with uh park
assist don't have a different steering
racer we still have the theory they have
a different steering column so that's
why the actuator is more
shitty it's not actually confirmed yet
they certainly have different firmware
transmission
L I guess it's also a turbo oh that's
what that
is yeah that is Turbo L you're right it
was in gear
early have you ever been pulled over
while running open vient uh yeah
be
chill if they ask it's Dash count it's
not a
lie put it in sport
mode same
turo you can now you can see the boost
pressure on the dash yeah that's right
oh that's a good point oh we we allow
engagement in sport mode yeah that's
good I should uh slow down so we can
make these
turns it conveniently tells me the speed
limit is
55 W how can open pilot SE right
now oh I see this vog
the model is so good with the fog turn
off the light model loves the
fog
yeah it seem better than I do it's
easier to look at the screen than to
look
outside start I'm
not um
yeah guys uh please uh enable your front
camera record and
upload great say that this this actuator
cuts
out uh when you hit a p hole it's it's
likeing more sensitive
yeah it's not cut out there when I over
road but
I'm pretty happy
uh let's uh let's turn driver monitoring
off and ditch the light oh see what was
that why did I lose steering acuator
there Scopes can see everything they
need to
say which is
over any
questions they were asking who's running
the Periscope it's the other member of
the controls team yeah do they know who
you are would you like to introduce
yourself you don't have to I'll do it
another time oh when I get my fees out
then sounds
good he's he's the
stick um yeah I mean as far as like
wobble goes this is as good as Civic I
wish it had more torque and I wish it
was our
longitudinal something I just like
better about
ours I feel like it's I feel like it's
pulsing
even I'm not sure what that is but maybe
it's just a road maybe I don't know CH
feels
gentle I mean all the Adaptive p
controls are so so aggressive as well
they are I know maybe people actually
like that I think they do I think people
complain about ours not being aggressive
enough good job
model big model won't even try to waiver
over there guys we're building big model
it's not going to be in 0.5 but big
model is going to be amazing open pilot
used to have small model but we're going
to make big model it's too dark
going to do
this
wow not
really people are more aggressive ACC
joks I know they do I know not going to
happen not going to happen it's like
shorter following distance it's just not
going to happen no well I'm okay with
some more aggressive moves than ACC I
mean the ILX is ACC is more aggressive
than the Civic right now and I'm okay
with that
no oh model
or yeah it's like the left L is pushing
on I do like the ACC on the Cadillac
where you if you turn on the blinker it
will accelerate that's pretty nice
interesting what is big model it's big
model guys we used to have small
model it's going to really push your
eons to the Limit
it needs more torque can the cific ACC
effort get to the same XL as
ILX yeah can we look more into can we
look into up and the XL on the S yeah we
can probably do it I mean the interface
is a bit janky but uh I probably work
around that yeah do we know what the
interface is on this uh no I haven't
looked into
it it's too close too close how this Max
oh no
I this Bak mod Little Tall car oh tall
car oh you know tall car no ra 4 is
going to get tall car though actually ra
4 is going to get short car it's the
opposite of tall
car see why is it still saying turnic SE
steering of it after I step on the G
gas we did that before too the alert is
staying on the alert is staying on after
I step on the gas which I don't really
like is that designed or I don't
know
car Boo b AC boo but it's probably by
Design because the F can last for a
really short time and you still want to
show the alert
yeah but not if the user has canceled
the system I don't
yeah a copies have more
questions they have more
questions how' you like to
ride good good ride good ride this would
be a great car if it have twice as much
tourque
when consumers will start buying cars
based on actuator models exactly they
have torque and no lag yeah the the
Toyota has way more torque than the
Honda the problem with the Toyota is it
has
lag so you either get wow Toyota's
dangerous is this the V6 model is the V6
model yeah 2.0
L caution steel plates ahead
say great some of what's in 0.5 under
embargo oh secret
stuff really no I don't think so I mean
there's one big thing that's secret but
it's not in 0.5 there's a big thing that
we showed to the Press that's a secret
um and it was not pandas on Amazon and
it was not
0.5 no everything in 05 is is I mean
everyone knows what working a driver
monitoring
ship Tor ref
flash well the press had a nice GE
offense though oh well maybe that one
was a secret oh was that a secret yeah
well it's not a secret anymore I did say
I told Viv don't say the GW the G
word uh yeah the press the Press had a
little bit of GE
we wanted them to have a good time not a
bad time but we turn it off we we would
we turn it off for a few of for a few of
the press Outlets that we liked actually
I turned it off for all the Press
Outlets but I want them to think that we
liked them all
oh the 60 FPS UI so good oh the 60 FPS
UI um yeah the UI is now yeah I again
the alert's staying up yeah we'll look
into it yeah I think after I've
disengaged the alert should go away I
don't know I just never see that alert
on the uh on the
S cool oh yeah there's some cool stuff
in the new UI
yeah now yeah new UI is 60 FPS uh we got
that butter smooth we also did a ton
work across the system to lower CPU
usage oh so it us uses way less CPU than
it used
to okay okay I
understand um yeah we're down to we're
down to using what are we using 60% of
CPU now yeah something right that yeah
we're down from like 80 to 60
they close to the
curb I think they're fine
check
cool cool scopes that was a drive in the
Honda cord with open pilot 0.5 it's
coming out to devel 6:00 a.m. Friday and
keep an eye out for some Kami press and
guys um if you want to buy more
eons buy them now we don't have that
many more left um and there's a a good
chance that the uh people will uh want
to buy them all and also if you're in
slack get ready for the Eternal
September and if you don't know what the
Eternal September is go BL bye SC
[Music]
yo
uh
can anyone see this
i've never used periscope before
so i'm in the car um on the way to
self-racing cars open pilot is driving
right now but of course um you know i
have to pay attention at all times
because that's how these systems work
uh
yeah i'll let you know if it makes
mistakes
um i'm not really sure like what to do
and i can't really use my phone very
much because i'm in the car of course
i'm uh you know i have my phone mounted
in a mount it's hands-free
so hopefully y'all can hear me
uh this is this is open pilot driving
right now i also have the six minute uh
timeout
so we're about three minutes through the
six minute timeout
we are cruising up vallejo you know
people always like you know there's all
these demo videos and they're they're so
like curated this is real
this is open pilot driving all right
excellent
um cool i think if i double tap
does that work hey what's up
uh yeah i'm driving
uh hang on i gotta put the speed up
so let's go back here
to the road
all right cool
so you see there's a car up there we're
just gonna stop for it
um i put the speed up so that resets my
six minute meter to show that i've been
paying attention
uh yeah let me know let me know what you
all want to see
um the truth is driving is boring
especially driving in this like
stop and go ish traffic
but it's really where these systems are
cool so you see we got some bots dots up
here um you guys can't see it but on the
open pilot screen
it's uh not quite seeing the
right lane so we came to a full stop
here uh can you see the neo um
quickly if i'm stopped sure
uh here's the nail
all right let me put this back in the
mount here
no it stays dead straight no ping
ponging in the lane
so it's it's entirely the car i'll let
you know if i have to intervene at all
uh the longest drive was probably two
and a half hours
uh straight that was on the comma zero
that was on the old system
um yeah i don't know i mean we could
check the logs and we could find like
the max engagement record can it take
bends on the highway absolutely um so
this car has a slightly raised torque
limit as well we've raised the torque
limit double what this car ships with um
which makes it take a bit sharper bends
but even the neo that you build
yeah it could definitely take bends on
the highway
you don't get a lot of updates for me
follow us on twitter yeah within
steering saturation limits exactly
someone knows how this thing works you
know it's great you guys can answer the
questions for me i can't pay that much
attention to the phones obviously i have
to
pay attention to the road
um
so yeah you see things like you know
we're going to go under this bridge
right here and you're going to get uh
you're going to get some shadows but
this is why we have a temporal model in
open pilot so it keeps the lane straight
even when the camera is adjusting its
auto focus
we're about three minutes since i
pressed the button
uh where's the hardware well
my phone is mounted so my phone is
mounted in a place i use dash oh i
shifter i use chevro so getchever.com
downloader dashcam app
open pilot for other cars well you have
to um
go to our website there are bounties we
are sponsoring a bunch of bounties for
other cars the great thing about open
pallet is it is open source and it is
well within the community's ability to
port it to other cars and i know this
because i've seen it done
so yeah it's still uh it's still driving
i mean this is the kind of stuff that's
just grueling to drive in as a human
right you like stepping on the brakes
you got to go a little bit you're
switching from stop and go to go a bit
faster
but the the civic in front of me is
driving pretty well
which is good if the driver in front of
me is being aggressive is like
aggressively tailgating and slamming on
the brakes and slamming on the
accelerator uh it's harder to drive
smoothly this is true for both humans
and for this system but um because that
driver is driving well we drive well
also
um so we should get to the six minute
timeout limit
we're down we're about four minutes
without a disengagement
i mean you guys are like literally this
wow there's like 40 of you watching me
driving traffic
man uh
yeah and i gotta i gotta make some turn
up ahead
onto 880 have i tested this on big rigs
no
um i don't own a big rig
i have a license to drive a big rig
we've tested it on hondas and acuras
thank you
i feel like a cam girl
um so yeah and you know it's it's you
know it's great that we have the six
minute timeout limit because it really
keeps the driver engaged like the
system's been driving for the last
uh five minutes
so we might get a cut in up here for
this truck we'll see how late it is yeah
i thought that cut in from the truck cut
in from the truck
all right good job neo
see that
that kind of stuff man
and actually it did that i you know i
saw i looked on the neo i saw that it
saw the truck um that was incredibly
smooth probably smoother than a human
would do it so here we are we're taking
a little bend on the highway
any near-term updates yeah so open pilot
we're going to get a cut out up here of
the tacoma we're gonna come back to the
honda being the lead car we're gonna
wait till he fully cuts out of the lane
and that open pile's gonna accelerate a
bit i can see on my screen that the lead
is switched over to the honda a little
too hard on the brakes there um part of
that unfortunately is a hardware
limitation
uh does it plan paths for the other
vehicle sorry i missed that that faded i
was watching because there's a lot going
on
um
yes a little hard on the brakes here as
well but you know not bad
i'm well within well within the realm of
uh human driving um so we're about to
hit the six minute mark uh if you've
watched the video
um when we get to six minutes so here
are my hands uh so take control to
regain speed i'm just gonna
move the wheel a tiny bit uh we got a
motorcyclist here i'm ah nah he's a
right
i'm gonna disengage
uh i don't feel great around people with
uh
around motorcyclists since i used to
ride one myself
um so we're back to disengage my hands
are back on the wheel and now i'm gonna
re-engage now i put the speed up to
uh
i can show you guys my hands
um yeah i'm in an acura ilx i'm in the
original comma acura ilx we got a lidar
on the roof we got a high precision gps
we're back engaged here in my hands guys
um
no the neo will not change lanes so we
don't have any side sensors on the car
um the only sensors that the oh my fuel
is low it also won't take me off the
road to stop at a gas station
um i wonder how long i have
does it have issues with bicyclists no
it does okay
um i don't know just like as a like i i
like to you know drive extra
conservatively around that so i'll
usually take control um when there's
other cars like
all right so we're gonna get a late cut
into this elantra here no no no no we're
not gonna let him in yeah be aggressive
that's right
uh oh i'm not switched i'm just showing
you that i'm not touching nothing i
guess there's back
uh when we use ultrasonic sensors yeah
so you probably can
if your ultrasonic sensors are on the
cars can bus
you could probably use them here's a
quarter
can i actually get a quarter
if you got like like what are the
myfreecams bucks called
um i know i need to work on it to take
me automatically to gas station i agree
um
now i gotta find where gas station is
this is a lot of effort you guys
i wish my phone could just like hey
phone gas station i gotta go take me
there that'd be cool
you know what i'll do that neo
uh change lanes okay i can change lanes
to the left um
so i technically don't have to disengage
to change lanes to the left but i'm
going to because i want to accelerate
aggressively
um
so yeah we're back engaged if you heard
that beep so we're back on open pilot
i'm putting the speed back up and there
we are
uh wait actually i might be in a carpool
lane right now no i'm in a carpool lane
i shouldn't be here
we gotta we gotta go back carpools three
or more persons per vehicle well unless
like the neos count as people all right
we're gonna get back over here i'm
disengaged right now
i am driving and that will re-engage
open pilot right here
so i really i don't know how far long i
can go without getting gas either
cannoli next three exits i wonder if
there's an easy on easy off
uh yeah captain picard voice computer
engaged i'll probably get sued by star
trek right
have 50 plus people with me yo all right
we gotta go to the gas station man
uh
yeah so open piles back engaged
you know what i'll do when i'm at the
gas station i'll try to mount my
periscope
i'm trying to think there's nowhere i
can really mount it that i can
show you the neo the road that my hands
are uh off the wheel
and also read the messages that's the
problem like i can't read the messages
so i don't know why i'm in this lane
this guy's going mad slow
uh look at that look at that look at the
long trailer
yeah technology should be open
i mean look it's like
what are we all doing here right let's
we all want the same thing
everyone's going to get rich off
self-driving cars
open source it
um yeah so this is this is actually
running open pilot 0.3 which is a little
bit better than what you can get with
the released 0.2.9
uh but 0.2.9 is still pretty awesome and
if you build a neo of course that's
going to be an absolutely free upgrade
to 0.3
um 0.3 has a new model our machine
learning team has been working super
hard on that and 0.3 we're really
starting to use all of our crowdsourced
data so we're starting to use the model
that's currently an open pilot was
trained somewhat on the crowdsourced
data but a lot still on the original
comma zero data set now we've taken that
out of circulation
um and yeah engineers can contribute
we're really hoping for contributions um
we're working to make it easier for
people to contribute
uh i probably need to stop at a gaster
yeah neo's in the hands of thousands of
people that's the dream man that's the
dream
um
any near-term hardware software so we
have the pandas
uh tomorrow at noon we will be cutting
the top 20 on the leaderboard and the
top 20 on the weekly leaderboard will be
getting free comma ai pandas
see the thing is i'm afraid to get off
at any of these exits
because i worry that there's going to be
lots of traffic when i get back on the
highway
what is a panda uh for other eps cars
yeah um so what is a panda a panda is a
car interface so it's a fairly universal
car interface it'll interface with cars
going way way back a lot more than just
hondas and acuras and right now what it
will do is it works with our app shifter
and it's really read-only right now um
it reads all the look this guy's over
the lane line over the lane line bro
he's going back we're good
um
need us to look up some gas station
options yeah maybe
uh does periscope have my location
oh this is a lot of fun
uh yeah so we've been we've been engaged
again for four minutes so we're gonna
hit the timeout yeah so the
report
um
so any teams using comma at the racing
car event i mean i think we'll find out
tomorrow oh yeah panda uses the obd port
on board diagnostics obd not odb it's
really easy to say that the wrong way
because like b's and d's kind of look
similar
um you really see that glare
going on back there
um yeah this nissan frontier is driving
pretty well as well my hands bros just
showing
uh
yeah so you can see that i mean you can
see my eyes too when it's facing you
that i really am spending most of my
time looking at the roads right you
cannot uh grow complacent with these
systems they are level two systems and i
can't stress that enough
um on low gas i still have about 30
miles yeah that's kind of what i'm
thinking right let's push it
i was driving this one time i was
driving through uh
middle of nevada there is nothing in the
middle of nevada and i see a sign that
says next gas station
183 miles yeah reactions right some
reactions so we can see both cameras i'm
so fully stopped right now now we're
starting to roll again
um do you guys like seeing the front
camera more or the back camera more
i said an uber to pick me up yeah
uh more powerful hardware uh and camera
suite yeah we're absolutely looking into
it um the big advantage to staying on a
cell phone is cell phones are very
available consumer electronics so
they're easy for people to get right a
building come ai is a relatively small
company building complex hardware is
maybe
outside of our reach for
i don't know
at least a couple more months um we're
building some simple hardware we're
building the panda we'll see how that
goes the panda is the most advanced way
to interface to your car it has three
can buses two lin buses it supports gm
land it supports um
detection of whether the car is started
or not on the other odb pins
uh it's gonna get you so like a lot of
especially electric cars you're talking
like nissan leafs and chevy volts here
have three can buses on the odb port um
and the three can buses
uh
one of them is the main can uh one of
them is kind of like the chassis can but
the other one is the battery can so we
should be able to look into what's going
on in the can buses of those cars and we
should be able to get the status of all
of the batteries
up
that's the six minute limit for the neo
so i'm just putting my hands on the
wheel turning it a tiny bit to show the
system that i'm here
um go back to the other camera for a
little bit you want to see some action
is can reverse engineering the biggest
only barrier to using neo on other cars
yeah
um samsung phones crash a lot we're not
using a samsung phone we're using a
oneplus
phone
um
yeah we're really rolling through
traffic here this this this this model
is good i'm i'm super happy like it's
keeping me in the dead center of the
lane
uh stop and go feels pretty good
so i was do you have a question before
that i feel like i was saying something
and then i started thinking about that
got hit by the user distracted thing so
six minute timeout
all right
uh how many sensors we have now so the
only sensors that open pilot uses about
a dead stop right now by the way um the
only sensors open pilot uses
are the uh the camera on the phone
and the front-facing radar that's built
into the car which we access over the
canvas
um cam
i don't know what that means i can
switch to the other one if you want
there we go i like this periscope thing
it's pretty cool what can you help my
cause well there's a bunch of things uh
first off
uh
comedy ai is real and let people know
this i mean a lot of people really
aren't aware
um you know you'll hear about google
self-driving cars you think about uber
self-driving cars but you can't get any
of that technology oh we gotta cut in
here we gotta cut it you gotta watch
okay cool that was that was plenty
backed off and saw that real early
um i don't know why my exposure is so
washed out like that now
let's hope we don't get a leg cut in
from that truck he looks aggressive
uh yeah but just you know spread the
word about comma ai and download our
dash cam app so it's called shifter it's
available for both iphone and android
um and you can get your hands on that
and you can start it's a dash camera
records all your trips and we use that
data to improve open pilot um so we have
almost a million miles maybe we'll have
a little periscope party when we reach a
million miles i like periscope by the
way i'm starting to like this can you
put flyers
i mean
i don't know if we're quite there yet
like i look i mean you look at the thing
right now it mostly appeals to people
who want to hack on their cars um
my hope is that by the end of the year
we will have support for many more
mass-market cars and we'll do more and
more to incentivize that make that
easier as the year goes on well we've
already put up we're not going to do
more to incentivize it we've already put
up
what our bounty program is
um and you can check that out from comma
dot ai our website
um can you upload from shifter when
you're on wi-fi yeah of course of course
shifter by default uploads uh not on uh
not on your mobile data
because it would use way too much of it
it waits until you get back to wi-fi it
only uploads over mobile data if you
turn that option on
periscope's been going downhill did i
miss periscope was periscope cool did he
used to be cool it's not cool anymore
was it not cool anymore did i miss the
periscope was it cool
um
yeah no kami uh yeah we're real uh and
we're we're gonna hopefully win i mean
i think that there's a lot of uh noobs
in the space
and both cameras are washed out right
now i don't know why
all right i should probably get more
serious about this whole gas station
thing
um
so we'll we'll periscope all the way
until we get to the gas station
all right this doesn't look like it's
anywhere near a gas station i looks like
if i found like a sheep around here you
know what this reminds me of windows xp
bliss
uh any teams in the safe self-racing
event using a neo we are
um we'll be doing a lap but we could do
it entirely on the neo we have it kind
of tied in with the computer so we could
use the computer to run some of the
processes i mean it's really it's like a
distributed architecture uh open pilot
uses cmq
for serialization and we use tcp so we
can go over the network just as easily
um all right i don't think we want to
get off this exit hercules stockton
stockton scares me
uh so there's that
let's see if we're going to come on a
gas station we're really really welcome
first off we're going a little faster
now this is nice
um
so we're going we're going 50 with this
cruise control set at 65.
um we're going 56 right now
and yeah we're about 5 minutes in so
usually we get to the bar without a
disengagement
um we're about i'd say on average 10
minutes between disengagements right now
obviously if the bar we don't count as a
disengagement because that's a
uh safety feature oh there's a gas
station over there all right there's a
cop over there um
let's
get off the next exit here well uh this
is like a highway exit i'm gonna get off
this one this one looks like it'd be
difficult to get back on but all right
so you know what we can do i'll show you
guys like the vaguely automatic lane
change oh you know what let's hit the
six minutes first just so you guys can
see that there's uh
no fools here that's tomorrow the fools
come tomorrow
does it already detect crash situations
like the tesla thing that was fake news
um the tesla thing they're they tesla
the reason like it detected a crash
situation it's actually just the radar
tracks a car that you can't see i'm
gonna get off willow avenue here
um
i disengaged if you all heard that beef
uh
there's a car right here i'm looking at
my mirror let's accelerate let's go
re-engage and pull us right back into
the lane he's gonna slow us down behind
this car yeah we're getting off right
here oh there's a burger king too maybe
i'll get a whopper i love whoppers all
right
so i'm back in control of the car i was
switching back oh i hit the screen and
for some reason it auto exposure which
was nice
there's a valeo before the bridge what
bridge oh i'm about to hit that bridge
oh i know that bridge
am i gonna regret getting off this exit
i don't think so this looks somewhat
reasonable and i'm serious about that
whopper too i think i'm playing about
the whopper no i seriously want the
whopper um
all right
a gas station straight ahead right here
we got a 76.
um so
yeah
i'ma stop we get gas get a little food
and maybe i'll be back on periscope in a
bit maybe for some open highway cruising
let's go
which side is this moving on from the
left
i love periscope this is great
i understand why mark shkreli likes it
so much
is that the pump i don't know
this is
this should be easier
there's a pump over there but that's on
the wrong side
there's one right here all right boss
cool uh yeah i'll catch you all a bit
later
i'll figure out how to stop this thing
start sketching oh ask for follow yeah
follow me bros
i don't know how do i stop this thing
freelance
[Music]
i don't know how to do this i'm so bad
at this
hello good morning welcome to Comic-Con
and uh yeah so I'm Harold I'm CTO and
I'll be walking through our drive to
Taco Bell last year we drove to Taco
Bell with
one of our open pilot cars in uh mostly
end-to-end system I'm gonna be walking
through that and just general stuff that
research is working on
so
we start off with I'm gonna
just recap some uh oh I got a mouse
pointer over there let me uh that one
out
uh to recap basically what I talked
about two years ago which is our general
architecture for a self-driving system
so our goal at research is to make a
superhuman driving agent so someone that
can drive a car better than a human can
and
we have a few particular constraints
that we're using to do this
first of all we want to do it completely
end to end so by end to end
we mean that we want to put in sensor
data into a neural network so like video
and potentially other sensors but
predominantly video
and get driving decisions out and have
the system Drive
the big reason for this is that this
gives more flexibility to the machine
learning model to learn behaviors and
patterns itself without being
constrained by for example a perception
layer or some kind of other hand-coded
stuff in between the system
secondly it's really important that we
build solutions that scale well with
compute
large part of society is working on
constant constantly improving the amount
of compute that is available and when
the next Generation computers come out
and the next generation's gpus are ready
to train models you want your system to
get better as a result of that
and so end-to-end training is one way to
get that because there's no hand-coded
constraints
but there are some other things we need
too such as a really good loss function
and enough diversity in the data
diversity of the data we have we have
plenty of users we have much more than
we know what to do with
and then also you need a good simple
loss function that reflects good driving
so a clear example of the victory of
this strategy is recent improvements in
llms they have an extremely simple loss
function a generally quite simple
architecture and they have now
demonstrated incredible ability over the
last few years
two years ago when I gave this talk
there were still some serious players
doing very classical things in
self-driving but honestly today nobody
takes bounding boxes seriously anymore
and everyone is moving to end-to-end
type systems
so I just want to end this introduction
with a quote from Rich Sutton who has a
very
um
relevant blog post from a few years ago
where he described this effect and he
talks about the great power of general
purpose methods methods that continue to
scale with increased computation even as
the available computation becomes very
great and this was before the llm
Revolution and as you can see he
predicted this very accurately
okay so that's kind of the basic
overview of what we're trying to build
so we can break this system down into
three basic parts
first we have end-to-end lateral control
which is basically just controlling the
steering based on the video end-to-end
longitudinal control which is
controlling the gas and the brakes based
on the video of the scene and then the
last part is to actually get to the
place that you want to go you need to
put in a destination so humans usually
use Google Maps or something like that
and they look at the video of that as
well as the road scene to kind of make
driving decisions so that's something
we're going to have to do too and as you
can see here this is how that would work
the model just sees this as well as this
and then it can get you to your
destination
let me open my water bottle here
so
Taco Bell
as a kind of proof of concept of these
three parts coming together and showing
that with an end-to-end system that has
no intermediate perception layers
doesn't have any code related to Lane
lines or traffic lights can actually do
something like drive from point A to
point B we set ourselves a challenge at
the beginning of last year which is
driving from
downtownish where old office was to a
local Taco Bell it contains just some
normal diversity of driving Maneuvers
like some some right turns and some
exits on-ramps Lane changes all that
stuff and we said we're going to do that
by the end of the year without a
disengagement on our device on a comma 3
just in a normal production car which
was our ev6 and opened completely open
source so anyone can see what we did and
by the end of 2022.
so we got a very
reasonable question is that going to be
an Elon time or real time
but for those who've been following
along it is real time by the end of 2022
we have posted you know the full drive
all the logs and all the code
so let's go through how we actually did
that so back to those three parts those
are the three parts we need to implement
and if they work reasonably well it will
work as a proof of concept and it will
drive us to Taco Bell
so let's start with the end-to-end
lateral this is uh what the majority of
my talk was about last time talking
about the technical challenges involved
with doing something end to end
um
so
what we basically train on is human
driving behavior we train models to
predict where humans will drive we can
predict like curvature your rate or
points in space it's all kind of
equivalent
that by itself is not enough to train a
system because you need it to be able to
recover from noise and deviations and
mistakes so that's why
we had to train it in a simulator and we
have to introduce noise and teach it
recoveries
and then for the simulator to actually
be able to instill behavior in all kinds
of driving and to just scale with
compute and data we need to make sure
that this simulator reflects the full
diversity of the real world so we
constrain ourselves to using a simulator
that's based on real data and we have
a method for doing that which I
explained in in two years ago
which is by augmenting real data to make
it seem like you're moving around
and I tried really hard to get a picture
where I didn't look stupid from last
talk but that was actually very
difficult
so lateral's done that was two years ago
back then it was still kind of in Alpha
mode people could choose to opt in or
not opt in to end-to-end lateral control
they could revert to the Lane line
policy if they wish but today the only
thing we ship is the completely
end-to-end policy there's no logic based
on Lane lines it just drives based on
human behavior
so that's done
so let's talk about the second part
which is uh end-to-end longitudinal
so when we designed the lateral system
we always had longitudinal in mind it
was obviously never supposed to be
designed specifically for lateral but we
were focusing on the challenges involved
specifically with lateral first but
always keeping in mind to expand this to
longitudinal later
so most of the architecture worked
exactly the same for lateral as
longitudinal
instead of predicting
instead of it being your rate and
curvatures that are relevant to predict
you predict speeds and positions and
accelerations but those together with
lateral come into like a complete plan
of where to be in 3D space
so we can plug this into the simulator
that was successful for lateral but we
immediately start to get some issues
which is our simulator was pretty
rudimentary it used as you can see here
this is how it would work we would warp
the image basically sideways essentially
we were assuming that everything in the
scene was on the road plane and we were
warping it to be consistent with that
but that means that everything in the
background all the cars kind of warped
sideways and that actually wasn't that
big of a problem for lateral because the
road is what matters most but for
longitudinal you can see it's a lot more
extreme
so we need to do something about these
simulator artifacts the model can't
learn intelligent behavior when there is
so much artifacts in the simulation
so this brings us to how do we make the
simulator better to basically
make the background reproject well when
we move around and also other cars
we have a rudimentary segment that we
use for
a variety of things it's it's uh
predicts a very minimal set of classes
doesn't have any bounding boxes it just
predicts is something part of the road
part of the background part of your car
or part of other movable things
now you can see that working in this in
this scene right here
so you can quickly start to make some
pretty rudimentary assumptions about
what these things are and what how far
away they are just on what they are so
the road is generally relatively flat
and continuously flat and form some kind
of plane the background often sticks up
straight up and so do most of the cars
so with that
with those assumptions and a very
accurate understanding of the road plane
we can actually kind of guess put in a
depth for all these objects based on
that and it won't be super accurate and
especially won't be accurate for things
in the background but the most important
things are the things in the immediate
background and um
and the cars on the road and because we
have very good road plane estimation
we can actually do this quite well
so you can see this in
in action here so this is what it was on
what we trained the lateral models on
two years ago and then with the new
assumptions you can see you can see some
artifacts here for example but the
models really see a kind of abstract
version of this and so they capture most
of the behavior especially because
things on the road are perfectly
reproduced which are for all kind of
driving the most important
so we plug that all in we do the same as
lateral we train some models make them
bigger try some stuff and that works
you can see here this is what we posted
around the time we started having
successful experiments
on our ev6 just coming up to traffic
lights it uh you know slows down speeds
up appropriately and it's also
surprisingly human in doing this despite
us not having to hand code any kind of
smoothness or controls related things to
achieve that it just knows from human
behavior what a reasonable approach to a
stoplight looks like when it's either
red or orange or green
so again this is completely end to end
there is uh no traffic light code that
achieves this this is just learn how to
do gas and breaks from Human driving
so just a little fun side note on that
there is actually traffic light code in
our internal code bases
but it runs this traffic light in our
meeting room that we can over the
Internet change colors on but yeah so
that's the only traffic light code in
the comma code base everything that
makes your car stop at traffic lights is
learned end-to-end behavior from machine
learning models
so that sounded really easy I just gave
you one quick fix to our simulator and
it went from less crappy to from crappy
to a little bit less crappy and all of a
sudden we have something that stops at
red lights and stop signs now is it
really that easy uh well no because it
took us two years and also no one else
has really done this so it can't be that
easy
so I just want to talk about
even though these ideas are extremely
simple and the solutions are also very
simple to the problems we're facing
actually implementing this and
developing a shippable system ends up
having a lot of challenges and several
things that cost a huge amount of time
so the first problem is we build an
end-to-end system because it's extremely
robust it can learn driving behaviors
even if the ground truth is noisy even
if the ground with is completely wrong
for example if we were to just take one
percent of the driving images and flip
them upside down
the models would still learn to drive if
we were to reverse some of the videos
the models would still learn to drive
but the problem comes in when in start
to start to see regressions in some of
the edge cases and it's not entirely
obvious so you need extremely good tests
and infrastructure and tools to
understand how good your models are and
which things affect it so that you don't
have these little subtle regressions
that don't cause obvious failures but
overall regress the performance of the
system
and over these years we've found
hundreds and hundreds of these types of
bugs that will completely break some
tiny percentages of the ground truth and
every time we improve them everything
gets slightly better
another thing is all these things rely
on extremely accurate Road plane
estimation so we need to understand the
curvature of the road and the pitch of
the road and exactly how high the car is
above the road and all those things
without that you also start to get
pretty serious issues
but I think where we spend most of our
time
is in the code we delete the things we
refactor to make them simpler and the
bad ideas that we have try and then have
to reject and completely delete
it's always a continuous fight against
complexity that's what we focus on most
on coma we want to reduce complexity
keep the solution simple and manageable
because that's how you can have a good
chance of finding as many bugs as
possible and not being susceptible to
this issue where you have this large
robust ml system that we constantly have
bugs give it bugs to and subtly regress
Behavior overall
and as a proof that this is a pretty
good strategy we have a really tiny team
working on this stuff and we have a
pretty small code base yet with that
we've managed to ship end-to-end systems
that as far as I know no one else has
and especially none that are
commercially available so this is
clearly effective
to give you an idea of how tiny the team
is everyone from the research team and
infrastructure team except our newest
hire is giving a presentation today so
that's how small the team really is
foreign
so little time on what the actual
solution was to end to end long because
it really was quite simple I want to
give you some ideas on the things that
we really did spend time on and that
cost a huge amount of time
so first of all we spent a probably over
half of last year doing a really big
refactor
now I'm not going to go into the details
of explaining exactly what this refactor
means because the original architecture
didn't really make sense to begin with
which is why we had to refactor it and
if I tried to explain it today I don't
think I would understand it myself
but basically the system that we had
shipped to achieve end-to-end lateral
planning had many steps it included
included student teacher approaches it
included different types of architecture
that work together and it had many
stages of ground truthing
and it was just difficult to move away
from that because it was very effective
it was deployed in the in the field and
if we wanted to refactor it we had to
make sure that the new simpler version
was just as good and theoretically it
should have been but it just took a
serious amount of effort and testing and
refactoring to get there
but after a little bit over six months
of work we managed to do that
um
we were able to take the training time
down from at the time around five days
from beginning to end with all the
models we needed to just two days
we had four models before that needed to
be trained all necessary uh that we
could reduce to just two models so now
it's just a vision model which takes in
scene compresses it to an intermediate
space and then a policy model that
actually makes the driving decisions
and this was somewhere in the middle of
last year or even a little bit before
that and since then infrastructure
improvements and other optimizations
have taken this trading time down from
two days to much less than one day and
Greg will be talking about that more too
so that's a really big deviation by the
way from what many other people are
training training models in one two days
is not really that common in machine
learning world but something we feel
very strongly about because it allows
you to iterate very quickly and correct
mistakes very quickly whereas if your
training run takes three weeks that
means you know in one year you can fix
50 bugs which is not that great
um
so that was a positive thing that we
spent a lot of time on there's also some
things that we wasted a lot of time on
first one was actually one that seemed
like a great idea last Comic-Con and
that we were advertising as something
that was going to give good results soon
uh which is stop lines
so you can do end-to-end longitudinal by
just predicting speed and acceleration
or you can you can kind of
find places that the human stopped and
then say this is like a place to stop
and try to stop for that place we
already had Logic for lead cars that
tell us how to stop in a place pretty
smoothly so we thought this would be
pretty easy to implement
but in reality even though it's very
easy to predict these places to stop
with the model you end up seeing that
not all places to stop are built the
same people stop very decisively for a
crosswalk uh
very decisively for a rail road crossing
not so decisively for a stop stop sign
on an empty road for example
so the end to end is a much better
approach here and as soon as we even
within like two weeks of trying to
replace the stop line logic with end to
end we saw it showed way smoother
Behavior around these things and way
more comfortable
so we probably wasted a few months on
that
and then the other thing is depth Nets
so
the solution I showed earlier was
basically estimating the depth of the
road plane for simulation
making some basic assumptions about the
background and other cars and then
reprojecting to simulate
and that sounds extremely simple that
sounds like it's too stupid and really
what you should be doing is have a large
machine learning model that predicts
accurate depth of everything in the
scene and then you won't have all these
weird artifacts that I was showing
earlier
so that sounded like a good idea to us
and we spent a few months training
training models that did this and they
did predict depth relatively well
but they were still quite noisy they
weren't as accurate to understand the
road plane without the assumption that a
road plane is flat and continuous there
was a lot of inaccuracies there and as I
mentioned that's a really critical part
and also in the things that it should
have been way better at like the
background you start to see these Halos
around stuff in in depth
and then beyond that you start to even
get more issues which is what's the
depth of the light that comes out of a
lantern
I mean that's it there's no real answer
to that the depth of a pixel isn't
necessarily a real concept it makes
sense in many cases but as soon as you
start talking about shadows and
Reflections and all that sort of stuff
it breaks down and when we were doing
stuff with depth Nets we actually were
finding a lot of issues related to
lighting that were causing problems in
the other approach so we weren't even
going to fix those with the depth Nets
so after a few months of that we
completely abandoned this approach
so that's end-to-end longitudinal done
as you can see it was
mostly bug fixes mostly little cleanup
there was hundreds of bugs that we fixed
that uh I didn't talk about and then
some big stuff like these refactors and
then just the slightly improved
simulator and that's what produces the
end-to-end longitudinal behavior that we
ship today in experimental mode
so that's done
and then the third part which is we have
to actually put the map into the model
the idea here is extremely basic which
is uh we have some video of navigation
feed just like Google Maps we show it to
the model and the model can understand
which driving actions to make by seeing
which the humans made to get to a
certain place Mitchell's got a whole
talk about this later and about the
challenges in testing and actually
shipping something like that
and as of two days ago we released
end-to-end navigation uh as part of
experimental mode
so that's also done
so now we're starting to get pretty
close to having something that we think
we can try this Taco Bell attempt on
there's a couple more things that we
ended up doing uh so we've got the model
here that's uh basically what I've been
talking about so far
we have some other controls stages
what we call a planner is essentially a
controls layer
and that needed some changes to
accommodate high angle rate turns and 90
degree turns that's in release that's
not in the state that was necessary
another thing we did is we conditioned
the model on aggressiveness of drivers
so the idea was if we classify every
driver as either being smooth and
conservative or aggressive we can also
tell the model at runtime to drive like
a conservative driver or like an
aggressive driver and we did that for
the Taco Bell run so that it would drive
more like a conservative driver and go
slower through the turns and just
generally be more comfortable
and then the last thing is uh we did map
based Lane changes so the lane changes
are completely end to end we just say do
like a human would but to trigger the
lane changes we uh used the mapbox logic
that said in which lane to be and if
there's an exit coming up
so that's just four commits that code is
still open
you can you can go look at that code the
logs of the driver public and the models
are end-to-end as we intended and
there's only a couple other things that
we had to change
and so December 15th we ordered our food
from Taco Bell
and uh completed our challenge
so I'm just gonna play the video here
for a second
I'm gonna attempt to speed this up which
is very high risk
okay
that went pretty well
so as you can see it starts in the city
there's some
just some normal stop and go traffic
with some traffic lights that it does
fine and does the on-ramp here
then there's a short section on the
highway so you can see that lane change
it made there was based on the
on the map-based logic so openstreetmap
said you're on the on-ramp so switching
to the lane and then same here there's
an exit coming up make some Lane changes
to the right
um yeah and then there's just a few
minutes on the highway take the off ramp
there's some turns here
and I think there's just a final turn
coming up and then we'll see Taco Bell
in The View
so just this left turn and then Taco
Bell should be right there somewhere
all right there we go right so that was
our
[Applause]
thank you thank you
so that was a demo uh we make final
demos a lot because they there's a
massive difference between shipping
something and having a demo of something
and the Taco Bell Drive was a demo like
I said earlier we wanted a proof of
concept of the systems that we intend to
ship working together
but that's only the beginning we then
still have to go through the effort of
making this stuff actually
um
usable and comfortable and reliable
and that's way more work beyond the demo
so I think we did maybe about a dozen
drives I think once we had the models
that we wanted and all the end parts
there's a whole bunch of reasons why we
did redid drives sometimes we had camera
issues sometimes open pilot was too slow
sometimes open pilot didn't take the
exit
um
and actually I think about 30 of our
drives uh were unusable because there
was a whole bunch of trash on the
on-ramp that some car dropped and uh
that that
was about four drives ruined until we
waited for the city crew to clean it up
but yeah so
it did it it can do it it's end to end
but there's still work to be done
so when will that actually be good so we
have experimental mode people can use
end-to-end long
um
it's about 22 of people that use it
today
and you know it still has flaws but some
people prefer driving with it
so if we look back at the situation of
end-to-end lateral control we can go
back two years I found this message in
our slack Deep saying we have 16 point a
lot of numbers of people who were using
laneless at the time
and currently we're already higher for
end-to-end loan so that's pretty
promising
what you can also see in this image is
how our metrics changed over two years
from uh slack messages to a real
dashboard and
something that we can track over time
so some interesting things to point out
uh end-to-end longitudinal is very
relevant at low speeds and you can see
here that the engagement numbers are
significantly higher at the lower and
mid speeds than without
end-to-end longitudinal but then in the
on the highway there's still stuff that
we're trying to improve if the model
decides to drive too slow people will
generally disengage and drive faster so
that's one of the things that we're
working on fixing for end to end long
so this engagement minutes is a bit
higher than it is for normal driving
normally it's about 25 to 27 percent and
in Miles uh I think now we're hitting
about 55 to 60 percent of miles are
engaged of open pilot users so that's
the majority of our users driving is
driven by open pilot
uh and then that's two of the three
parts and then the third part is
navigation which is released two days
ago so
when will it be good well if the past is
anything to go by which it should be
then uh in the next two years we'll be
getting these numbers to 100 and all
cars will be driving to Taco Bell
[Applause]
so that's what we've done so far I'm
going to talk a few few quick notes
about what we're working on next
so we keep talking about end to end we
even have hats that say end to end and
end-to-end machine learning is really
the core of what research stands for we
want the models to do as much as
possible to do as much as possible
internally to make everything as simple
as possible and have all the difficulty
be dealt with by the gradient Descent of
the model training this is an extremely
effective strategy and the last few
years have really driven this point home
with things like gbt4
so we still have a simulator that's hand
codes of physics we estimate the depth
with some rudimentary assumptions we
reproject that's not great we want to
have machine learning models that can
simulate for us that's something that
you've seen we'll be talking about later
we still have classical controls the
controls is quite smart and does a lot
of learning which uh Vivek will be
talking about later
but it's not machine learning so
that's something that we can improve
eventually we will need reinforcement
learning uh it's it's normal for the
model to need to do something to do some
driving with your car to get used to it
that's how humans drive too and should
improve over time so that's something
we're looking into
and then finally a little bit more long
term
every time one of our users disengages
they're giving a signal that they would
prefer to drive an open pilot that's
something that we want to feedback on
because that means our system did
something uncomfortable or undesirable
and so in the future we want to feed
those signals back directly into
training and have the models learn to
optimize how to make the people happy
so and then if we zoom out a little bit
more
we can think what's an even more General
and more end-to-end approach than just
focusing on driving
so driving is a subset of Robotics
there's you know Ada systems or some
robotic system you have even a bit more
Niche you have like these self-driving
race cars but you know there's also just
general purpose Robotics and they share
a lot of things in common uh interacting
with the real world understanding
actuators and you know friction and
physical limits and that's something
that as the self-driving systems improve
will become more and more relevant there
too
and this at first may seem a bit weird
to think like that you can make a more
effective system easier with a
completely General approach than you can
with something hyper specific but just
to give recent examples again anyone
who's making machine learning models
specifically to be a medical doctor or a
lawyer is now completely outshined by uh
gbt4 and nobody that was working on gpd4
was specifically optimizing for that
they made a general purpose language
model and it beat everything specific
and so it's not unreasonable to think
that that's how robotics will play out
too so we want to keep zooming out and
thinking are there general purpose
robotics methods that will be very
effective in self-driving in the same
way as general purpose language models
we're good at domain specific things too
so
along that axis on stage we've got Billy
and silly their little side project that
we've just been working on
the comma 3 is a great development
platform it has
good compute for machine learning it has
a screen microphone sensors kind of
everything you need in a robot very
similar to a human head and the only
thing that's missing to do robotics
experiments is to put some wheels on it
so we do sell those Wheels it's very
much a dev kit but we've been having fun
with it over the weekends so just kind
of experiment with some kind of Robotics
types things and see how well the comma
3 holds up and if there's anything
interesting we can learn from that
so I think it was a couple weeks ago
some of the research Engineers went to a
hackathon with Billy and silly and they
uh won second place doing some just some
things with llms talking and taking a
picture of you and printing it
so
more on a little bit of fun fun robotics
with comma 3 we're going to do a
hackathon at the office it's going to be
some kind of indoor navigational
challenge can we use you know machine
learning to navigate indoors you know is
that similar to driving outside that's
the kind of stuff we want to explore uh
we'll probably have some like obstacle
course indoors and have people try to
get some kind of speed run through that
it's going to be the whole weekend at
the end of September we'll do like 20 30
people if you want to come you should
apply and we'll select 20 30 people from
that and we'll post more details about
that later
going to be at our office which is super
cool we moved into a new office last
year it looks a bit like a compound and
has a fountain so if you're interested
in robotics hackathon definitely check
it out
and that was it for me so let's move
over to questions
[Applause]
all right I'll be doing some walk around
q a does anyone have any questions all
right we'll start up here
oh uh so I was just curious for to
navigate on uh open pilot uh I saw that
in the video it was doing fully
autonomous Lane changes but uh as far as
I I'm aware like uh looking in the code
and on my own custom Branch I don't see
that
um it's actually it's only using the
blind spot sensors on my Toyota 2020
Toyota Corolla but it's not using the
railroad facing camera so
um if it's only using the blind spot
sensor that but the blind saw sensor is
not like a hundred percent like um
effective right um so how safe it would
would it be to do those Lane changes
which is so it's still an ADA system so
you're expected to pay attention any
time so for example in a Taco Bell Drive
you can see that I'm checking the blind
spot monitors for those Lane changes
yeah and I mean that's kind of what
we're imagining and also this is true
for all of open pilot driving for the
foreseeable future you need to supervise
it so yeah the expectation is we'll make
we can make Lane changes when we think
it's a good idea but there's still some
burden on the
on the user but that aside in the future
we are going to use the both the
interior facing camera and the blind
spot monitors uh to check this so it
should become more reliable when we move
to that but we haven't shipped that yet
oh okay gotcha and just uh one more
small question like does that work on
everything because um in the DBC file I
I don't see like Lane chain or the
indicator status so yeah that's going to
be car specific and then the interior
facing camera will be uh on all cars
obviously
hi two questions did you go to the
retreat after you delivered Taco Bell
Drive so it's planned for October
but it's real I always planned for
October and the second question as far
as I understand the enter and long
doesn't give anything specific attention
to speed limits right no it doesn't so
like I'm from I'm from Europe and like I
know that here you can make a pretty
good guess in States like what the speed
limit is going to be in Europe it's a
mess right so I mean that's going to
change in the future
just just like Europeans users need to
pay attention Lane changes to speed
limits open parallel world 2 and in the
future we'll add that as an input it's
just not the priority right now
um for depth prediction in the simulator
have you considered or tried out using
neural Radiance fields or anything
similar to that before
so I didn't train the depth Nets you can
you see and did those
but just generally speaking
we we didn't see a future in that
approach the concept of depth just
doesn't scale towards the end and so
even if we had perfect depth Nets we
didn't see a solution so we were
actually dealing with a lot of issues
which is so you've got headlights of
your car they illuminate the road in
front of you and when you start
augmenting the video you need to augment
those lights too and a depth net can
never help with that and that's the real
reason why we gave up not because we we
were confident obviously you can get
better and better models but not that we
can solve this concept of depth to make
a good simulator
hi is the model trained entirely on
simulated data or is there any fraction
of real world camera data too so
it's trained entirely on simulated data
but the simulated data is all real video
that is augmented okay there is no
actually simulated there's no like pure
simulation data
like like a Unity or something like that
anyone else down here
oh yeah thank you for the presentation
um so you know I think a lot of the
questions around like hey
this doesn't seem like it's ready for
like general public driving prime time
but this is still quite an impressive
system are there narrower applications
that are now much closer to being kind
of production ready
twice or
uh yeah with and self-driving so say for
example you can't drive on a public road
but could you drive around a mining site
for example
oh I mean I guess but yeah we're just
not really interested in that we want to
make a really good Ada system and kind
of expand on this robotics
AI future I guess
uh can you talk a little bit more about
some of the techniques uh for the
end-to-end nav with the map like for
instance keeping it at like a static
zoom level versus zooming in as you get
close to terminal presentation about
that later this morning and we'll go in
a lot of detail and that's why I glossed
over it very quickly okay I have some
more questions if that's okay
um can you talk about maybe some of the
challenges with disengagement analysis
for cars that don't have op long
um you know how do you detect it's a
disengagement for just a failure of the
stock ACC versus an actual open pilot
you know uh long I mean we know whether
they're using stock lock so I mean
obviously we we know that context when
we're looking at the disengagements
right we know if it's their system or
not so that's that's not an issue but
actually some some disengagement
analysis uh talk coming also later and
wishing we'll we'll give some insight
into that as well okay one more question
related to that
um you know is is it a training day that
should get more useful from cars that
have op long enabled or you know do you
still use it for cars that don't have op
long enabled that are using the stock
ACC so training data the way we train
the models now not necessarily but as a
kind of feedback for us as the engineers
to understand how the system is being
used and where it's failing it's more
useful when you have op long but again
it's not training the models it's
training us but I don't know is that
kind of that's kind of the same thing
again
hi Charles
[Applause]
[Applause]
hello good morning welcome to Comic-Con
and uh yeah so I'm Harold I'm CTO and
I'll be walking through our drive to
Taco Bell last year we drove to Taco
Bell with
one of our open pilot cars in uh mostly
end-to-end system I'm gonna be walking
through that and just general stuff that
research is working on
so
we start off with I'm gonna
just recap some uh oh I got a mouse
pointer over there let me uh that one
out
uh to recap basically what I talked
about two years ago which is our general
architecture for a self-driving system
so our goal at research is to make a
superhuman driving agent so someone that
can drive a car better than a human can
and
we have a few particular constraints
that we're using to do this
first of all we want to do it completely
end to end so by end to end
we mean that we want to put in sensor
data into a neural network so like video
and potentially other sensors but
predominantly video and get driving
decisions out and have the system Drive
the big reason for this is that this
gives more flexibility to the machine
learning model to learn behaviors and
patterns itself without being
constrained by for example a perception
layer or some kind of other hand-coded
stuff in between the system
secondly it's really important that we
build solutions that scale well with
compute
a large part of society is working on
constant constantly improving the amount
of compute that is available and when
the next Generation computers come out
and the next generation's gpus are ready
to train models you want your system to
get better as a result of that
and so end-to-end training is one way to
get that because there's no hand-coded
constraints
but there are some other things we need
too such as a really good loss function
and enough diversity in the data
diversity of the data we have we have
plenty of users we have much more than
we know what to do with
and then also you need a good simple
loss function that reflects good driving
so a clear example of the victory of
this strategy is recent improvements in
llms they have an extremely simple loss
function a generally quite simple
architecture and
they have now demonstrated incredible
ability over the last few years
two years ago when I gave this talk
there were still some serious players
doing very classical things in
self-driving but honestly today nobody
takes bounding boxes seriously anymore
and everyone is moving to end-to-end
type systems
so I just want to end this introduction
with the quote from Rich Sutton who has
a very
um
relevant blog post from a few years ago
where he described this effect and he
talks about the great power of general
purpose methods methods that continue to
scale with increased computation even as
the available computation becomes very
great and this was before the llm
Revolution and as you can see he
predicted this very accurately
okay so that's kind of the basic
overview of what we're trying to build
so we can break this system down into
three basic parts
first we have end-to-end lateral control
which is basically just controlling the
steering based on the video end-to-end
longitudinal control which is
controlling the gas and the brakes based
on the video of the scene and then the
last part is to actually get to the
place that you want to go you need to
put in a destination so humans usually
use Google Maps or something like that
and they look at the video of that as
well as the road scene to kind of make
driving decisions so that's something
we're going to have to do too and as you
can see here this is how that would work
the model just sees this as well as this
and then it can get you to your
destination
let me open my water bottle here
so
Taco Bell
as a kind of proof of concept of these
three parts coming together and showing
that with an end-to-end system that has
no intermediate perception layers
doesn't have any code related to Lane
lines or traffic lights can actually do
something like drive from point A to
point B we set ourselves a challenge at
the beginning of last year which is
driving from
downtown ish where our old office was to
a local Taco Bell it contains just some
normal diversity of driving Maneuvers
like some some right turns and some
exits on-ramps Lane changes all that
stuff and we said we're going to do that
by the end of the year without a
disengagement on our device on a comma 3
um just in a normal production car which
was our ev6 and opened completely open
source so anyone can see what we did and
by the end of 2022.
so we got a very
reasonable question is that going to be
an Elon time or real time
but for those who've been following
along it is real time by the end of 2022
we have posted you know the full drive
all the logs and all the code
so let's go through how we actually did
that so back to those three parts those
are the three parts we need to implement
and if they work reasonably well it will
work as a proof of concept and it will
drive us to Taco Bell
so let's start with the end-to-end
lateral
this is what the majority of my talk was
about last time talking about the
technical challenges involved with doing
something end to end
um
so
what we basically train on is human
driving behavior we train models to
predict where humans will drive we can
predict like curvature your rate or
points in space it's all kind of
equivalent
um that by itself is not enough to train
a system because you need it to be able
to recover from noise and deviations and
mistakes so that's why
we had to train it in a simulator and we
have to introduce noise and teach it
recoveries
and then for the simulator to actually
be able to instill behavior in all kinds
of driving and to just scale with
compute and data we need to make sure
that this simulator reflects the full
diversity of the real world so we
constrain ourselves to using a simulator
that's based on real data and we have
a method for doing that which I
explained in in two years ago
which is by augmenting real data to make
it seem like you're moving around
and I tried really hard to get a picture
where I didn't look stupid from last
talk but that was actually very
difficult
so lateral's done that was two years ago
back then it was still kind of in Alpha
mode people could choose to opt in or
not opt in to end-to-end lateral control
they could revert to the Lane line
policy if they wish but today the only
thing we ship is the completely
end-to-end policy there's no logic based
on Lane lines it just drives based on
human behavior
so that's done
so let's talk about the second part
which is a end-to-end longitudinal
so when we designed the lateral system
we always had longitudinal in mind it
was obviously never supposed to be
designed specifically for lateral but we
were focusing on the challenges involved
specifically with lateral first but
always keeping in mind to expand this to
longitudinal later
so most of the architecture worked
exactly the same for lateral as
longitudinal
instead of predicting
instead of it being your rate and
curvatures that are relevant to predict
you predict speeds and positions and
accelerations but those together with
lateral come into like a complete plan
of where to be in 3D space
so we can plug this into the simulator
that was successful for lateral but we
immediately start to get some issues
which is our simulator was pretty
rudimentary it used as you can see here
this is how it would work we would warp
the image basically sideways essentially
we were assuming that everything in the
scene was on the road plane and we were
warping it to be consistent with that
but that means that everything in the
background all the cars kind of warped
sideways and that actually wasn't that
big of a problem for lateral because the
road is what matters most but for
longitudinal you can see it's a lot more
extreme
so we need to do something about these
simulator artifacts the model can't
learn intelligent behavior when there is
so much artifacts in the simulation
so this brings us to how do we make the
simulator better to basically
make the background reproject well when
we move around and also other cars
we have a rudimentary segment that we
use for
a variety of things it's it's uh
predicts a very minimal set of classes
doesn't have any bounding boxes it just
predicts a something part of the road
part of the background part of your car
or part of other movable things
and you can see that working in this in
this scene right here
so you can quickly start to make some
pretty rudimentary assumptions about
what these things are and what how far
away they are just on what they are so
the road is generally relatively flat
and continuously flat and form some kind
of plane the background often sticks up
straight up and so do most of the cars
so with that
with those assumptions and a very
accurate understanding of the road plane
we can actually kind of guess put in a
depth for all these objects based on
that and it won't be super accurate and
especially won't be accurate for things
in the background but the most important
things are the things in the immediate
background and um
and the cars on the road and because we
have very good road plane estimation
we can actually do this quite well
so you can see this in
action here so this is what it was on
what we trained the lateral models on
two years ago and then with the new
assumptions you can see you can see some
artifacts here for example but the
models really see a kind of abstract
version of this and so they capture most
of the behavior especially because
things on the road are perfectly
reproduced which are for all kind of
driving the most important
so we plug that all in we do the same as
lateral we train some models make them
bigger try some stuff and that works
you can see here this is what we posted
around the time we started having
successful experiments
on our ev6 just coming up to traffic
lights it uh you know slows down speeds
up appropriately and it's also
surprisingly human in doing this despite
us not having to hand code any kind of
smoothness or controls related things to
achieve that it just knows from human
behavior what a reasonable approach to a
stoplight looks like when it's either
red or orange or green
so again this is completely end to end
there is uh no traffic light code that
achieves this this is just learn how to
do gas and breaks from Human driving
so just a little fun side note on that
there is actually traffic light code in
our internal code bases
but it runs this traffic light in our
meeting room that we can over the
Internet change colors on but yeah so
that's the only traffic light code in
the comma code base everything that
makes your car stop at traffic lights is
learned end-to-end behavior from machine
learning models
so that sounded really easy I just gave
you one quick fix to our simulator and
it went from less crappy to from crappy
to a little bit less crappy and all of a
sudden we have something that stops at
red lights and stop signs now is it
really that easy uh well no because it
took us two years and also no one else
has really done this so it can't be that
easy
so I just want to talk about
even though these ideas are extremely
simple and the solutions are also very
simple to the problems we're facing
actually implementing this and
developing a shippable system ends up
having a lot of challenges and several
things that cost a huge amount of time
so the first problem is we build an
end-to-end system because it's extremely
robust it can learn driving behaviors
even if the ground truth is noisy even
if the ground with is completely wrong
for example if we were to just take one
percent of the driving images and flip
them upside down
the models would still learn to drive if
we were to reverse some of the videos
the models would still learn to drive
but the problem comes in when in start
to start to see regressions in some of
the edge cases and it's not entirely
obvious so you need extremely good tests
and infrastructure and tools to
understand how good your models are and
which things affect it so that you don't
have these little subtle regressions
that don't cause obvious failures but
overall regress the performance of the
system
and over these years we've found
hundreds and hundreds of these types of
bugs that will completely break some
tiny percentages of the ground truth and
every time we improve them everything
gets slightly better
another thing is all these things rely
on extremely accurate Road plane
estimation so we need to understand the
curvature of the road and the pitch of
the road and exactly how high the car is
above the road and all those things
without that you also start to get
pretty serious issues
but I think where we spend most of our
time
is in the code we delete the things we
refactor to make them simpler and the
bad ideas that we have try and then have
to reject and completely delete
it's always a continuous fight against
complexity that's what we focus on most
on comma we want to reduce complexity
keep the solution simple and manageable
because that's how you can have a good
chance of finding as many bugs as
possible and not being susceptible to
this issue where you have this large
robust ml system that we constantly have
bugs give it bugs to and subtly regress
Behavior overall
another proof that this is a pretty good
strategy we have a really tiny team
working on this stuff and we have a
pretty small code base yet with that
we've managed to ship end-to-end systems
that as far as I know no one else has
and especially none that are
commercially available so this is
clearly effective
to give you an idea of how tiny the team
is everyone from the research team and
infrastructure team except our newest
hire is giving a presentation today so
that's how small the team really is
so since I spent so little time on what
the actual solution was to end to end
long because it really was quite simple
I want to give you some ideas on the
things that we really did spend time on
and that cost a huge amount of time
so first of all we spent a probably over
half of last year doing a really big
refactor
now I'm not going to go into the details
of explaining exactly what this refactor
means because the original architecture
didn't really make sense to begin with
which is why we had to refactor it and
if I tried to explain it today I don't
think I would understand it myself
but basically the system that we had
shipped to achieve end-to-end lateral
planning had many steps it included
included student teacher approaches it
included different types of architecture
that work together and it had many
stages of ground truthing
and it was just difficult to move away
from that because it was very effective
it was deployed in the in the field and
if we wanted to refactor it we had to
make sure that the new simpler version
was just as good and theoretically it
should have been but it just took a
serious amount of effort and testing and
refactoring to get there
but after a little bit over six months
of work we managed to do that
um
we were able to take the training time
down from at the time around five days
from beginning to end with all the
models we needed to just two days
we had four models before that needed to
be trained all necessary uh that we
could reduce to just two models so now
it's just a vision model which takes in
scene compresses it to an intermediate
space and then a policy model that
actually makes the driving decisions
and this was somewhere in the middle of
last year or even a little bit before
that and since then infrastructure
improvements and other optimizations
have taken this trading time down from
two days to much less than one day and
Greg will be talking about that more too
so that's a really big deviation by the
way from what many other people are
training training models in one two days
is not really that common in machine
learning world but something we feel
very strongly about because it allows
you to iterate very quickly and correct
mistakes very quickly whereas if your
training run takes three weeks that
means you know in one year you can fix
50 bugs which is not that great
um
so that was a positive thing that we
spent a lot of time on there's also some
things that we wasted a lot of time on
first one was actually one that seemed
like a great idea last Comic-Con and
that we were advertising as something
that was going to give good results soon
uh which is stop lines
so you can do end-to-end longitudinal by
just predicting speed and acceleration
or you can you can kind of
find places that the human stopped and
then say this is like a place to stop
and try to stop for that place we
already had Logic for lead cars that
tell us how to stop in a place pretty
smoothly so we thought this would be
pretty easy to implement
but in reality even though it's very
easy to predict these places to stop
with the model you end up seeing that
not all places to stop are built the
same people stop very decisively for a
crosswalk uh
very decisively for a rail road crossing
not so decisively for a stop stop sign
on an empty road for example
so the end to end is a much better
approach here and as soon as we even
within like two weeks of trying to
replace the stop line logic with end to
end we saw it showed way smoother
Behavior around these things and way
more comfortable
so probably wasted a few months on that
and then the other thing is depth Nets
so
the solution I showed earlier was
basically estimating the depth of the
road plane for simulation
making some basic assumptions about the
background and other cars and then
reprojecting to simulate
and that sounds extremely simple that
sounds like it's too stupid and really
what you should be doing is have a large
machine learning model that predicts
accurate depth of everything in the
scene and then you won't have all these
weird artifacts that I was showing
earlier
so that sounded like a good idea to us
and we spent a few months training
training models that did this and they
did predict depth relatively well
but they were still quite noisy they
weren't as accurate to understand the
road plane without the assumption that a
road plane is flat and continuous there
was a lot of inaccuracies there and as I
mentioned that's a really critical part
and also in the things that it should
have been way better at like the
background you start to see these Halos
around stuff in in depth
and then beyond that you start to even
get more issues which is what's the
depth of the light that comes out of a
lantern
I mean that's it there's no real answer
to that the depth of a pixel isn't
necessarily a real concept it makes
sense in many cases but as soon as you
start talking about shadows and
Reflections and all that sort of stuff
it breaks down and when we were doing
stuff with depth Nets we actually were
finding a lot of issues related to
lighting that were causing problems in
the other approach so we weren't even
going to fix those with the depth Nets
so after a few months of that we
completely abandoned this approach
so that's end-to-end longitudinal done
as you can see it was
mostly bug fixes mostly little cleanup
there was hundreds of bugs that we fixed
that I I didn't talk about and then some
big stuff like these refactors and then
just the slightly improved simulator and
that's what produces the end-to-end
longitudinal behavior that we ship today
in experimental mode
so that's done
and then the third part which is we have
to actually put the map into the model
the idea here is extremely basic which
is uh we have some video of navigation
feed just like Google Maps we show it to
the model and the model can understand
which driving actions to make by seeing
which the humans made to get to a
certain place Mitchell's got a whole
talk about this later and about the
challenges in testing and actually
shipping something like that
and as of two days ago we released
end-to-end navigation uh as part of
experimental mode
so that's also done
so now we're starting to get pretty
close to having something that we think
we can try this Taco Bell attempt on
there's a couple more things that we
ended up doing uh so we've got the model
here that's uh basically what I've been
talking about so far
we have some other controls stages
what we call a planner is essentially a
controls layer
and that needed some changes to
accommodate high angle rate turns and 90
degree turns that's in release that's
not in the state that was necessary
another thing we did is we conditioned
the model on aggressiveness of drivers
so the idea was if we classify every
driver as either being smooth and
conservative or aggressive we can also
tell the model at runtime to drive like
a conservative driver or like an
aggressive driver and we did that for
the Taco Bell run so that it would drive
more like a conservative driver and go
slower through the turns and just
generally be more comfortable
and then the last thing is uh we did map
based Lane changes so the lane changes
are completely end to end we just say do
like a human would but to trigger the
lane changes we uh used the mapbox logic
that said in which lane to be and if
there's an exit coming up
so that's just four commits that code is
still open
you can you can go look at that code the
logs of the driver public and the models
are end-to-end as we intended and
there's only a couple other things that
we had to change
and so December 15th we ordered our food
from Taco Bell
and uh completed our challenge
so I'm just gonna play the video here
for a second
I'm gonna attempt to speed this up which
is very high risk
okay
that one pretty well
so as you can see it starts in the city
there's some
just some normal stop and go traffic
with some traffic lights that it does
fine and does the on-ramp here
then there's a short section on the
highway so you can see that lane change
it made there was based on the
on the map-based logic so openstreetmap
said you're on the on-ramp so switching
to the lane and then same here there's
an exit coming up make some Lane changes
to the right
um yeah and then there's just a few
minutes on the highway take the off ramp
there's some turns here
and I think there's just a final turn
coming up and then we'll see Taco Bell
in The View
so just this left turn and then Taco
Bell should be right there
somewhere
all right there we go right so that was
our
[Applause]
[Applause]
thank you thank you
so that was a demo uh we make final
demos a lot because they there's a
massive difference between shipping
something and having a demo of something
and the Taco Bell Drive was a demo like
I said earlier we wanted a proof of
concept of the systems that we intend to
ship working together
but that's only the beginning we then
still have to go through the effort of
making this stuff actually
[Music]
um
usable and comfortable and reliable
and that's way more work beyond the demo
so I think we did maybe about a dozen
drives I think once we had the models
that we wanted and all the end parts
there's a whole bunch of reasons why we
did redid drives sometimes we had camera
issues sometimes open pilot was too slow
sometimes open pilot didn't take the
exit
um
and actually I think about 30 of our
drives uh were unusable because there
was a whole bunch of trash on the
on-ramp that some car dropped and uh
that that
was about four drives ruined until we
waited for the city crew to clean up
but yeah so
it did it it can do it it's end to end
but there's still work to be done
so when will it actually be good so we
have experimental mode people can use
end-to-end long
um
it's about
22 percent of people that use it today
and you know it still has flaws but some
people prefer driving with it
so if we look back at the situation of
end-to-end lateral control we can go
back two years I found this message in
our slack Deep saying we have 16 point a
lot of numbers of people who were using
laneless at the time and currently we're
already higher for end-to-end loan so
that's pretty promising
what you can also see in this image is
how our metrics changed over two years
from uh slack messages to a real
dashboard and
something that we can track over time so
some interesting things to point out uh
end-to-end longitudinal is very relevant
at low speeds and you can see here that
the engagement numbers are significantly
higher at the lower and mid speeds than
without
end-to-end longitudinal but then in the
on the highway there's still stuff that
we're trying to improve if the model
decides to drive too slow people will
generally disengage and drive faster so
that's one of the things that we're
working on fixing for end to end long
so this engagement minutes is a bit
higher than it is for normal driving
normally it's about 25 to 27 and in
Miles uh I think now we're hitting about
55 to 60 percent of miles are engaged of
open pilot users so that's the majority
of our users driving is driven by open
pilot
uh and then that's two of the three
parts and then the third part is
navigation which is released two days
ago so
when will it be good well if the past is
anything to go by which it should be
then in the next two years we'll be
getting these numbers to 100 and all
cars will be driving to Taco Bell
[Applause]
so that's what we've done so far I'm
going to talk a few few quick notes
about what we're working on next
so we keep talking about end to end we
even have hats that say end to end and
end-to-end machine learning is really
the core of what research stands for we
want the models to do as much as
possible to do as much as possible
internally to make everything as simple
as possible and have all the difficulty
be dealt with by the gradient Descent of
the model training this is an extremely
effective strategy and the last few
years have really driven this point home
with things like gbt4
so we still have a simulator that's hand
codes of physics we estimate the depth
with some rudimentary assumptions we
reproject that's not great we want to
have machine learning models that can
simulate for us that's something that
you've seen we'll be talking about later
we still have classical controls the
controls is quite smart and does a lot
of learning which vivec will be talking
about later
but it's not machine learning so
that's something that we can improve
eventually we will need reinforcement
learning uh it's it's normal for them
all to need to do something to do some
driving with your car to get used to it
that's how humans drive too and should
improve over time so that's something
we're looking into
and then finally a little bit more long
term
every time one of our users disengages
they're giving a signal that they would
prefer to drive an open pilot that's
something that we want to feedback on
because that means our system did
something uncomfortable or undesirable
and so in the future we want to feed
those signals back directly into
training and have the models learn to
optimize how to make the people happy
so and then if we zoom out a little bit
more
we can think what's an even more General
and more end-to-end approach than just
focusing on driving
so driving is a subset of Robotics
there's you know Ada systems or some
robotic system you have even a bit more
Niche you have like these self-driving
race cars but you know there's also just
general purpose Robotics and they share
a lot of things in common uh interacting
with the real world understanding
actuators and you know friction and
physical limits and that's something
that as self-driving systems improve
will become more and more relevant there
too
and this at first may seem a bit weird
to think like that you can make a more
effective system easier with a
completely General approach than you can
with something hyper specific but just
to give recent examples again
um anyone who's making machine learning
models specifically to be a medical
doctor or a lawyer is now completely
outshined by uh gbt4 and nobody that was
working on gpd4 was specifically
optimizing for that they made a general
purpose language model and it beat
everything specific and so it's not
unreasonable to think that that's how
robotics will play out too so we want to
keep zooming out and thinking are there
general purpose robotics methods that
will be very effective in self-driving
in the same way as general purpose
language models
we're good at domain specific things too
so
along that axis on stage we've got Billy
and silly they're a little side project
that we've just been working on
the comma 3 is a great development
platform it has
good compute for machine learning it has
a screen microphone sensors kind of
everything you need in a robot very
similar to a human head and the only
thing that's missing to do robotics
experiments is to put some wheels on it
so we do sell those Wheels it's very
much a dev kit but we've been having fun
with it over the weekends so just kind
of experiment with some kind of Robotics
types things and see how well the comma
3 holds up and if there's anything
interesting we can learn from that so I
think it was a couple weeks ago some of
the research Engineers went to a
hackathon with Billy and silly and they
uh won second place doing some just some
things with llms talking and taking a
picture of you and printing it
so
more on a little bit of uh fun fun
robotics with comma 3 we're going to do
a hackathon at the office there's going
to be some kind of indoor navigational
challenge can we use you know machine
learning to navigate indoors you know is
that similar to driving outside that's
the kind of stuff we want to explore uh
we'll probably have some like obstacle
course indoors and have people try to
get some kind of speed run through that
it's going to be the whole weekend at
the end of September we'll do like 20 30
people if you want to come you should
apply and we'll select 20 30 people from
that and we'll post more details about
that later going to be at our office
which is super cool we moved into a new
office last year it looks a bit like a
compound and has a fountain so if you're
interested in robotics hackathon
definitely check it out
and that was it for me so let's move
over to questions
[Applause]
all right I'll be doing some walk around
q a does anyone have any questions all
right we'll start up here
oh uh so I was just curious where to
navigate on uh open pilot uh I saw that
in the video it was doing fully
autonomous Lane changes but uh as far as
I I'm aware like uh looking in the code
and on my own custom Branch I don't see
that
um it's actually it's only using the
blind spot sensors on my Toyota 2020
Toyota Corolla but it's not using the
railroad facing camera so
um if it's only using the blind spot
sensor that but the blind saw sensor is
not like a hundred percent like um
effective right um so how safe it would
would it be to do those Lane changes
which is so it's still an ADA system so
you're expected to pay attention any
time so for example in a Taco Bell Drive
you can see that I'm checking the blind
spot monitors for those Lane changes
yeah and I mean that's kind of what
we're imagining and also this is true
for all of open pilot driving for the
foreseeable future you need to supervise
it so yeah the expectation is we'll make
we can make Lane changes when we think
it's a good idea but there's still some
burden on the
on the user but that aside in the future
we are going to use the both the
interior facing camera and the blind
spot monitors uh to check this so it
should become more reliable when we move
to that but we haven't shipped that yet
oh okay gotcha and just uh one more
small question like does that work on
every because um in the DBC file I I
don't see like Lane chain or the
indicator status so yeah that's going to
be car specific and then the interior
facing camera will be uh on all cars
obviously
down here
hi two questions did you go to the
retreat after you delivered Taco Bell
Drive so it's planned for October
but it's real I always planned for
October and the second question as far
as I understand the enter and long
doesn't give anything specific attention
to speed limits right no it doesn't so
like I'm from I'm from Europe and like I
know that here you can make a pretty
good guess in States like what the speed
limit is going to be in Europe it's a
mess right so I mean that's going to
change in the future
just just like Europeans users need to
pay attention Lane changes to speed
limits open parallel 2 and in the future
we'll add that as an input it's just not
the priority right now
um for depth prediction in the simulator
have you considered or tried out using
neural Radiance fields or anything
similar to that before
so I didn't train the depth Nets you can
you see and did those
but just generally speaking
we we didn't see a future in that
approach the concept of depth just
doesn't scale towards the end and so
even if we had perfect depth Nets we
didn't see a solution so we were
actually dealing with a lot of issues
which is so you've got headlights of
your car they illuminate the road in
front of you and when you start
augmenting the video you need to augment
those lights too an adapter can never
help with that and that's the real
reason why we gave up not because we we
were confident obviously you can get
better and better models but not that we
can solve this concept of depth to make
a good simulator
hi is the model trained entirely on
simulated data or is there any fraction
of real world camera data too so
it's trained entirely on simulated data
but the simulated data is all real video
that is augmented okay there is no
actually simulated there's no like pure
simulation data
like like Unity or something like that
anyone else down here
oh yeah thank you for the presentation
um so you know I think a lot of the
questions around like hey
this doesn't seem like it's ready for
like general public driving prime time
but this is still quite an impressive
system are there narrower applications
that are now much closer to being kind
of production ready
twice or
uh yeah with and self-driving so say for
example you can't drive on a public road
but could you drive around a mining site
for example
oh I mean I guess but yeah we're just
not really interested in that we want to
make a really good Ada system and kind
of expand on this robotics
AI future I guess
uh can you talk a little bit more about
some of the techniques uh for the
end-to-end nav with the map like for
instance keeping it at like a static
zoom level versus zooming in as you get
close to terrible presentation about
that later this morning and we'll go in
a lot of detail and that's why I glossed
over it very quickly okay I have some
more questions if that's okay
um can you talk about maybe some of the
challenges with disengagement analysis
for cars that don't have op long
um you know how do you detect it's a
disengagement for just a failure of the
stock ACC versus an actual open pilot
you know uh long I mean we know whether
they're using stock lock so I mean
obviously we we know that context when
we're looking at the disengagements
right we know if it's their system or
not so that's that's not an issue but
actually some some disengagement
analysis uh talk coming also later and
wishing we'll we'll give some insight
into that as well okay one more question
related to that
um you know is is it a training day that
you should get more useful from cars
that have op long enabled or you know do
you still use it for cars that don't
have op long enabled that are using the
stock ACC so training data the way we
train the models now not necessarily but
as a kind of feedback for us as the
engineers to understand how the system
is being used and where it's failing
it's more useful when you have op long
but again it's not training the models
it's training us but I don't know is
that kind of that's kind of the same
thing again
okay thank you so much Harold
[Applause]
remember really like that if happen I
miss Catholic is this life I was like
huge like nobody can't comfort I was
trying I can't tell you because it's
just to share that
I think that'd be too hard to hit
tonight yeah she has pulled in Taj it
this girl you do really quick now you
really would
laughs that was weird all right Scotties
I hope none of y'all are taking pole
dancing class now pole dancing class is
cool I take it back
yeah that's right super cool no no
that's like it depends why well it's
just like have fun and like get a good
yeah no no I mean guys people looking
for attention and that's good I don't
think so cause you don't really get
attention from your pole classes lately
posted online like the kind of girl
who's standing on the table at the club
right all right guys so we're driving
the first what did you yeah
don't discriminate you're right you're
right Eddie what i discriminate against
he said don't discriminate gee somehow
my discriminating against I think women
dance attention whores
oh absolutely discriminate against
attention whores I am at which stop
though I don't know if you guys follow
me on Twitch but I'm a quick start
so guy offered me $4 to show my left
nipple I'd really thought about doing
yeah why wouldn't you
this is the first comma planning retreat
yeah it's not the first time a retreat
yes that's right
George memory you're gonna change your
wardrobe to wifebeaters you retell the
scope he's about that no no I put a
wife-beater on I looked at myself in the
mirror and what camp Baylor can't do it
guys guess what we're driving on right
now the new model
well the meanwhile so good
the new model is so much better so it's
trained on some toyota data now trying
on tour today to try it on HDR data oh
that's good that's good
yes and this is the caller planning
retreat yeah eta for new model by the
way now you tell them never never know
the model is just for us actually no
chips next week guys
Tesla data next Friday
stop and go yet for what stop ago
certainly works in your Center nine
you're out for but don't worry cuz
yeah no new model ships Friday GM ships
Friday and Bosch Wow
what's out there yeah
that's the scope is how the quality of
the Baldy gun has the quality you guys
so magical well no not if the quality I
guess he guess who they get the article
today that's all you want to
surprisingly attractive on the inside
thank you
I agree how did you like it it's really
nice um I think if you take a slice of
it it looks nice but as a whole I just I
don't see like the you know it's not
fully cookies it I would say if I just
like staring at this section of the
whole thing is just feels no this is
such a nice car look at these back seems
like too many distinct parts put
together doesn't feel like a one thing
too bad about the exterior the exterior
is perfect
what George Nick did alone
whoa
you know we really got tired of having
your that handheld stuff
we're driving to the offside we're
driving the offside it's in lovely
Pacifica invite the stokke you know
[Laughter]
we've 74 viewers damn bras open though
everybody check out okay
all right guys I'm gonna say this on
periscope but you got all be chill about
can all discovery be chill about
something mate go to news dot y
combinator calm go to that just that
website you gotta type it in go to the
second page casually browse the links
and if you see anything that catches
your fancy after clicking on the link be
sure to upload it
that's right I'm not sure it's gonna be
on the second page
no might be on the first page the third
page but just you know casual this is
not for dates gains are filtered out
in the orange message beat jesus take
the wheel no we're a serious company
always serious products what's the
website news dot y combinator calm it's
called hacker news you haven't created
an account I would like to do a lot of
new accounts
that's G going to China they know you're
going to China DVD never mind smallest
socks
this is the new model maybe not good
surprise say he was gonna reboot it
is it the new model Oh
meanwhile has bugs still it is much
better on the highway though on the
Honda Civic the wobble is gone and the
GM the wobble is going like for some
stretches of highway when I was driving
yesterday you can't tell whether it's
the new model or Cooper's damn
so feel superhuman
das yeah it's on here it's on your
commitment this morning it is
George did you eat rice yeah whatever
type of I'm excited for a new model fu
GD ing yeah we're planning what I told
everyone I'm fine it's a long saga talk
I'll settle for regular human he's very
good no one really knows his name buddy
is very good that's right the iteration
speed is unparalleled
[Laughter]
we've got more new models in the last
two weeks that we did the last year drag
mode on , who's drag mug someone's
wondering what's going on with huevos
oh wait wait this is something this is
actually well new model be the same as
old when a road isn't mad
yeah yeah no maps maps are gonna be
later I'm Malcolm Smith mellow guy is
actually ml George the new head of ml
you scope these yeah I would love to be
had I would love to be out of ml but I
actually I write firmware and do you see
my hand I've been thinking I reaffirm
where until we finally kick ass former
engineer if any of you guys know Benny
has to send an email to give me a job at
kamidana you check out our no leverage
yeah we're hiring page now lines
everything connect you can apply
directly through lever all right so
let's see if it's actually wobbles there
we go someone found it
all right bitch nope oh my god yeah
don't post a link that's per gate don't
post the link Oh
but yeah look at the look at the
stability I've never seen the Toyota
Drive like this
yeah this feels so much better he's much
more then this has been here yeah this
is yeah exactly
this feels so much better damn it's
drifting No
that's bullshit
okay it's drifting out of the lanes fix
the model Googler cama cama owes us free
food so if you're buying a good look for
free food you should keep in mind
economist
great look at the right lane this is
shit this model doesn't work at all
[Music]
I know it's working
take it back to our internal tools
debugging and adjust our we should keep
a baby should know what time yeah I
played did you did you watch the barber
theist talk from last week it's all
about it's all about the tools for
labeling and no software - something's
wrong you've got a waffle add more
examples it doesn't Rebecca Liz talk
the problem wasn't as bad at this price
wasn't civic no no this car the weariest
has the worst wall but this is where's
the Civic you were really a Batman
this feels a lot better on this girl
what was that weird smile there was that
spawn where it actually just best-off
yeah
the new model doesn't have bias issues
we've removed the bias from our models
guys
we hired a diversity I've seen guys
doing it again it's doing it again the
right lanes broken look at
[Music]
did you fix that or did it fix it
shit guys can't ship it never mind who
said the new vana was coming out Friday
night it's failing internal QA Bailey
people are sad yeah we're sad to risotto
gonna get bad guys
my rap for dinner they grab a bunch
right behind this trough Lowe's truck on
the road
like it said yeah it's pushing out yeah
just wants to hop
somehow Glenn Hubbard
going real slow or what if the model has
learned to map and it's just trying to
change lanes for you
wrong back no new model is not specific
to
that new model is actually worse on raft
and that's part of the problem
so was asking what causes that Lane to
push out I guess my new model is
personal because the rav is now in a
different place
Etan goal coverage map so we can drive
alternative routes
only us
well actually I'll tell you when we'll
have global coverage map when somebody
else pays heart yeah like if someone
would like to like pay us money to map
their country like their country like if
Mexico paid us to map Mexico we'd map
Mexico around Mexico we would map Canada
that's right we had to fly to fly
they'll be kind of hard cuz we'd
probably drive out of the car yeah yeah
well no will you fly hurt a lot of
people will just drive it for us and
then we'll yeah so if the country or a
company would like to pay us from after
that country that is possible
a really weak right now
[Music]
there was a week on the road terror yeah
we should know
remember constants memory honor the past
can remember supercruise refused to
engage supercruise does this here at all
get if we could just make a drive
without the lanes all would drive so
well hate the lanes like it's fine on
turns without the legs you just dream
about
Oh everybody like a near where we need
to go yep surely not I should show this
gobies where we're going yeah oh good
the models working well right here yeah
there's just some bog back there we'll
fix up
check the ground truth
open toward that accent
whereas right here I'm holding I'm
disappointed with this model don't worry
no sorry it's gonna be shit forever no
new models I live it doesn't wobble on
the highway like it's more sharp in its
decisions they're just sometimes wrong
Good morning. Good morning, Periscopes.
Good morning, Periscopes.
Let's go on Twitter. Let's see. Let's
wait for a few people to get in here.
Yo yo,
what's up, Vanilla Gorilla?
So, we're not actually in the car yet.
We're going to go to the car. I'm go to
the car in a minute. Um, sweet, sweet.
What up, people? This is Key to the Rav
4. I got to flip you around.
I've been up early this morning. I've
been doing some some unsupervised
machine learning training posets. What's
up, Gameshack?
Check it out.
That's a It's distance. The sky is
really far away. Rav 4 is coming this
week. Let's go for a drive.
Um, check it out. I'm running for mayor
of San Francisco. This is my plan. Uh my
plan is nice and we're going to do
housing, transportation, and parks. So,
Ed Lee, watch out. I'm coming for you.
Uh
I'm actually not going to launch a
Prius.
Um cuz there's a little bug. Uh we're
going to do one car at a time, but we
have the Prius pretty much ready to go
as well. Got my keys. Let's head out.
All right.
So, let me switch you to the other
camera.
Here is our RAV 4.
Rav 4 torque is amazing, man. All right,
let's open this up. Let's see what we
got.
Um, here is my Eon.
Uh, now, of course, when you buy an Eon,
it only comes with Shiffer Plus. Uh,
this has been modified internally to run
open pilot. Here's our panda.
See if that's on. Looks pretty on to me.
And then we have a wire. Unfortunately
with the Toyota Oh, this is a this is a
Toyota Giraffe, by the way.
Unfortunately with the Toyota, um,
there's no power consistently on this
connector, bro. Joe. So, we've connected
uh this guy just down. and we could
trace it down to the OBD port
down to I'm going to put my phone there.
I'm going to mount it up there. Um,
cool. So, let's uh let's start this
thing up. Got the key right here. Yes,
we are hiring. Uh yeah, check out uh
check out our positions link from our
main website, comma.ai,
or you can go to our uh I'm going to
turn off the use front camera review
because I have a real rearview mirror.
Look at that. Look at that. There's a
real rearview mirror. Pretty cool,
right? Um, no, we don't remove the
rearview mirror anymore. We use a GoPro
mount. You see this GoPro mount up here?
Yeah. So, this is the Neon mounted up.
All right, let's start her up.
Cool. Uh, so always keep your hands on
the wheel. Be ready to take over
anytime. Of course, that's a good uh
rule. Some like Miley Cyrus or some
isish. All right. Um,
cool. So, I am going to take us out to
the highway and once we're engaged.
Thank you. I'm going to put this I wish
there was a nice way to show you guys
open pilot while I'm driving, but I will
show you once we get to the highway. So,
I'll flip.
What up, y'all? In the seat of my Rav 4
plugged in down there to the uh OBD
port, we got that wire. You don't really
need the wire because you can get power
when it's started. But um all right,
let's head out here. Is still beyond the
torque limit of even the high torque RAV
4.
Um
me I'll I'll spin you guys back around
as soon as I make this turn.
Lost. Oh, bad connection.
Oh, that's too bad.
Um let's hope it comes back.
Yeah, the cell phone reception here
isn't the best.
You can see that we're just sitting here
is open pilot. Uh yeah, so that's why we
have a uh that's why we have a fan. The
fan can run at any time, so it should
keep it pretty cool. Thank you.
So, red light. Open pilot doesn't do
anything about defeating red lights.
They're pretty cool, though. I hear
there's some like special frequencies
you could transmit on. All right, this
is probably good. Let's engage.
Here we go. System is driving. Let's
bump the speed here.
Pretty cool, guys. Pretty cool.
All right. So, sometime we have a fusion
issue with parked cars, but this one
looks pretty good. Remember, always pay
attention at all times.
Um, there you go. Look at now. Now,
unfortunately, the RAV 4 has an issue
where below 20 mph it will come to a
full stop. So, that was totally the car,
but now the speed's too low, so the
system cancels, but it will bring you to
a full stop. It actually should hold you
behind the other car for a little bit.
Um, so this is a release candidate of
Open Pilot 0.3.8.2,
which should be going live on Tuesday.
Um, so yeah, unfortunately I have to
step on the brake right now. Um, the
system could hold you in brake, but it
can't reacelerate. Uh, this is a
limitation of the car.
Um
there's just nothing you can really uh
do about it once you go below 20. If you
send the command, the accelerate
command, it doesn't accelerate. Uh this
is of course fixable with a firmware
update. Mine going landscape. Yeah, we
can go landscape.
Um let's go landscape. We'll turn this
guy here, too. Um
Oh, actually, hang on. That's not
landscape. Let me
unlock my rotation. Oh, yeah. So, you
could do it with a firmware update. Now,
that firmware update I feel a whole lot
better about. Um, because this is
probably going to be a disengagement
here. This turns pretty steep.
All right. I had I had to help it at the
end there. Um, so we do the Toyota has a
much much higher torque limit than the
Civic.
Um, which is cool. In fact, it's so much
that we limit it. So, if you see if you
go to the Panda Repo, we've already
committed the safety code for Toyotas.
Got a cutout here. Got a cutout. Car is
coming to a stop. We are good. Yeah,
buddy. All right. So, you're going to
see it's going to say like speed too low
in a minute. Ah. So, okay. See, it says
take control, resume driving manually.
Yeah, that's that's just the limitation
um of
uh
the car. Yeah. the speed too low. When
it wanted to accelerate there, it
disengaged. So, you'll get a little bit
of acceleration from creep, but we can't
actually command any acceleration.
Video is now sideways. What do you mean
by that?
Uh, fixing that. Well, so yeah. Um, I
feel very differently
about uh
firmware updates to the ECU versus
firmware updates to the steering
computer. So, firmware updates to the
ECU is something modders have already
done for a long amount for for for a
while now. Um, so anyone who's doing
like like engine boost mods are
reflashing the firmware on their ECU
much much safer because what's the worst
your ECU can do is accelerate your car.
Steering controller can do uh bad
things. You know, you got to be super
super careful if you're reflashing them.
Uh yeah, so take control zoom driving
manually. You need Civic firmware. Well,
the specific firmware you want is uh
like I talked about, you want the
the steering mod.
We'll see. We'll see. We have it, but
you know, careful.
Uh but yeah, the mod to make this car
work in stop and go is definitely
doable. Of course, the system does not
ship stop and go. The Prius can do stop
and go. It works pretty well in rain.
Yeah. I mean, we're training on rain,
right? Our system doesn't even like it
doesn't even know to be honest.
So, here we go. Let me pull back here.
You can see the wheel.
My legs. Open pilot, bros. Open pilot.
Woo.
Dean scream, man. Dean scream.
Acceleration is a little bit pulsy,
which isn't great.
Um,
working on that. Hopefully, we'll have a
fix before we go live with the launch.
Oh, look at that smooth stopping. That
was nice. Vision only. No, it's using a
radar. iPhone X. Yeah, I bought one of
those. You know, I'm picking it up the
first day. When will the first eons be
shipped? Um, yeah, I'm picking up Best
Buy. I paid an extra $100. I'm getting
that the first day.
Uh
any vault update? Uh well, you know, the
vault is the vault is a community car.
Um we we want to merge it in and pay out
the bounty, but as far as like
priorities go, Toyotaas are vision. What
do you mean by demo vision?
I tell you, you Subaru people, I tell
you. I tell you what what what we're
going to have to do. Um,
you show me it driving with a with a
joystick and I will work on vision for
you guys. But I've yet to see any Subaru
people drive a Subaru with a joystick.
So, y'all don't need vision only cruise
control until I see that.
All right, systems back on.
Almost to the highway.
Man, this thing is good.
So, this is this is all the car I'll
tell you guys. We had one disengagement
back there on that sharp turn and now we
have a speed too low cancellation. If
you're below 20, you can only break. You
can't accelerate due to issues with the
PCM. Ignoring India question. What's the
India question? I'm not ignoring your
questions. Where am I going? I'm going
this way. Uh, no. I'm just out testing
this. You know, we're uh the release
candidate. Maybe I'll go get donuts. You
know, I love donuts. How much for your
old iPhone? My beautiful iPhone 7. No,
no, it won't have new models. Same
model.
The the the the model team.
Soon. Someday. Soon. Um, yeah, I know
there's there's issues with this model.
Someday soon. New models.
All right, let's go for a drive. LAR is
becoming cheap. Uh, yeah, and vision's
becoming really, really good. Let's go
visit Andy. You want to drive to
Berkeley? Can it auto turn right? Well,
I mean, it'll turn right right now.
Thank you. Thank you. I love my
interview, too. I was very happy with
the way it came out.
All right, we got a cut in here. It's
pretty good.
Oh, Vim. You know, I'm a Vim guy. Come
on. You really think I'm an Emac guy?
Look at this. Yeah, look at that torque.
That's not even torque, man. Now, we'll
go to we'll take Route One uh and I'll
show you guys some real some real
driving. Um the Toyota has a much better
torque limit than the Honda, so we can
we can show off some real uh some real
turns. Was doing windy roads last night.
Um yeah, Toyota torque limit is actually
so high that we limit the steering
torque. So, we've always limited the
acceleration and deceleration. Um, but
we don't actually limit the torque. We
limit the, uh, torque rate. Uh, so it
takes 1.5 seconds to ramp up full
torque. And that's how I can feel safe
driving, you know, without a hand
necessarily touching the steering wheel
because I know that the car can't jerk
me around.
All right, let's take a look at that Eon
for a bit. What model year you wrap for?
Anything that has TSSP.
So, we're going to support all Toyotas
with TSSP.
Damn, this thing is good. All right,
let's I'm going to change some lanes
here.
Notice those beeps with the disengage. I
love this car. Blind spot awareness
sensors
now. So, let me drive here.
Now, I can put the system back on. Woo!
Look at that turn.
Get it, car. All
right. So, we're going to take Route One
here.
Is that a good angle?
All right. Coming a little fast on this
turn. Let's see if we can do it.
Oh, yeah.
That's the kind of stuff that like in
the Civic, can it do it? Maybe in the
RAV 4, can it do it? Oh, yeah.
speed. You can see it right there on the
thing. Probably want to get on Skyline
Boulevard there, but I didn't.
Look at that turn, man. Look at that
turn.
Can you input the destination? Uh, not
quite yet.
All right, I'm going to put you guys in
the holder while it drives.
Keep my hands a little bit closer to the
wheel because it is uh is putting some
real torque on the wheel for these
turns, but should be good.
Um yeah, so remember this is a level two
system. Pay attention at all times. Uh
it's like a seven-year-old driving a
car, but man, no disengagements here.
Unreal. Unreal.
Toyotas are cool, man.
How many Nvidia GPUs? We have 23 in our
basement.
ETA for going level three. Uh I don't
know, next year.
Oh man, look. This is all open pilot
driving right now.
Look at that. Look at that.
Cutting a little on that lane,
but still totally what I would consider
safe driving.
Oh, yeah.
I'm going to spin us around here. to
take us back. I didn't charge my phone
last night. I actually only have 20%
battery. Can this work without radar?
Yeah,
we have radar. Why not use it?
So, this is me back in control of the
car. Now,
Open Pilot can't do too much city stuff
yet. I mean, it can do this. So, I just
turn the system on. You're hear that
beep.
Yeah, you know this, right?
Should I stop at Safeway? Get some
donuts.
Let me see if I have an iPhone cable
here. No iPhone cable.
Yeah, right. This place is a pretty cool
place to test self-driving cars.
Training in GTA is pretty good.
All right, let's put it back on.
Open pilot. Go.
See, now these turns are something the
Civic wouldn't even think about doing,
and the RAV 4 is just killing it.
This
finally finally we're testing what
autopilot can really do.
The models have outstripped the torque
limit of the car for a while. So this is
all driving on autopilot. Wow. A little
little harsh on that turn back there.
There's no limit of the torque ramping
down. There's only a limit of the torque
ramping up.
The Civic cannot do this. No, it's No,
it's the torque limit. Can't do it.
Fan is spinning. I wouldn't really say
it's loud. I barely hear it.
Okay. Wants to go. All right. All right.
Disengagement there. It got confused
because the lanes were too spread out.
Wipers. This is fog, bros.
Um, maps localization are on the road
map. Open pilot 0.5. Uh, you guys will
see what we have planned. 0.4, but this
today we're of course to add another
disengagement. There. There's a lot of
fog. Um,
we are today talking about Open Pilot
0.3.8,
not 0.4. Yeah. Yeah. Typical Sunday Bay
Area fog. Exactly.
You need to certify roads and lanes. No,
I mean, it's driving right now. Like,
you you're watching the feed right now.
If you think you could drive a car from
that feed, it can probably drive a car,
too.
This is awful.
Let's take a look at that screen. Now,
phones take screens doesn't really work
that well.
All right, let's get back in the highway
here.
What?
Nope. Fog won't interfere with driving.
Flexray. No, I don't really know much
about it.
Can we see more of this dude? Yeah,
sure. Let me just get you guys over.
Just So, I'm doing the lane changes here
manually. We get into the lane that goes
back to my house.
That broki was in my blind spot. All
right.
All right. I'll re-engage the steering
wheel.
Why not certify lanes DB that they are
safe. I don't know what that means.
I'm not sure how much of Apollo is
useful.
Uh I want to see it come a little bit
further first. Um, the big problem with
Apollo 2 is the car they support. Uh,
nobody has. Nobody has that data speed
car. It's super expensive and weird.
That's why we support the Toyota RAV 4,
which for a short period of time was the
third most popular car sold in America.
So, this is all still open pilot here.
Once we get into places like this, you
really have to pay attention.
It can make a mistake at any moment.
Let's
hope it doesn't.
Man, this thing's good.
How does it compare to Tesla's? This is
on par with autopilot probably now.
All right. I had to correct it there to
make sure it wanted to go the other way.
Put the speed down a bit here, too.
Speeding.
Uh, does the model have issues in
driving into direct sun?
H
direct direct sun? Yes. But things that
might trip up some other systems, no.
Uh, because of how we train it.
Will it support Nissan Pathfinder? No
Nissan support right now. Hondas and
Toyotas. Um Toyotas are going to be the
best. Uh the Toyota Prius is the
flagship model of this year. Um the
advantage to the Prius over the RAV 4 is
we can do full stop and go where in the
RAV 4 you have to manually accelerate
once you get below 20 mph.
So once I hit above 20, I'm going to
test out the resume. So the resume
should set my cruise speed to 45.
Cool. Works.
I think of Xmatic. I haven't seen them
ship anything yet.
I I I'll believe it when they ship it.
Open Pilot can do stop and go. The Prius
uh and the Civic can. The ILX, CRV, and
RAV 4 cannot due to limitations on this
car. Uh Nissan Pathfinder is definitely
not in the top 10 for the US. There is a
Nissan in there. The Nissan Rogue is in
there. Um so three are pickups, three
are Hondas, three are Toyotas, and
there's the Nissan Rogue, which
ironically that's that's a pretty good
name for the one weird one.
Um this is all open pilot driving right
now.
Got to stop in behind that car.
How will the iPhone X help? It won't. I
just want one.
Uh the Toyota can also turn the wheel
all the way down to zero speed. Uh which
the
Civic
can't and the ILX can't.
But the Prius really is going to be the
best car because you'll get full stop
and go and and full steering. Um that's
why the Prius is the flagship for the
year. But this one is coming up first.
[Music]
That might be it. It might not be a
flagship for next year. Um, it might
just be those six Hondas and Toyotas.
What's a traffic site?
Oh, well, a traffic light. No, no, no
traffic lights. Uh, no shipping system
today can do traffic lights or stop
signs.
Um,
0.5. 0.5.
That's that's that's when the mapping
efforts will really start to pay off.
That was a disengagement right there. It
wanted to go in the other lane.
And you do hear that noise the brake
controller is making. It does not seem
too happy to be stopped.
show about the window everything's wet
yo guys we rented an airstrip
[Laughter]
this is so cool this is so cool so
there's two runways I don't know which
ones longer we get two runways oh my god
they're really right thousand cones
let's go it does it come VC money spent
wisely
oh oh shit I got a chicane cries
whoa and this is all ours oh man this is
great
what is this
[Music]
[Laughter]
whose uncle
brand-new five years of tires do I
scratch it up
no this entire box what do you think
that one's doing out here
yeah it's a condo in the Prius are two
cones
[Laughter]
yo this place is incredible this is so
much fun it's great
alright scope is uh I think we're gonna
have fun without you guys but um yeah me
seize your money is well-spent how many
we get
[Music]
yo yo
[Music]
down here on the periscope in the cow be
you hear that terrible noise can you
limit the current to lower than one amp
so it doesn't do that shut off it'll
just lower the voltage right so well my
phone is currently being charged by a
panda connected to a power supply but
it's making a terribly annoying noise
yeah get rid of the one the one is the
problem 800 milliamps that sounds good
there's a charge I've fast
what ok it's drawing 5 volts that's good
I told you what it would do yeah it was
just like all right yes so charges my
phone less fast pelas don't need that
many volts pandas are super reliable it
goes oh that's that's literally a worse
noise that's happy it's oh alright I
don't know no but now it makes noise
could have charged a little bit less we
can check out my panda charging my
iPhone Oh what if we raise the voltage
that's a good idea
yeah pan is getting 16 right don't break
my iPhone man oh oh now we're target
that's good volts that's good didn't
they yeah we changed the power supply to
15 volts now it's showing point 9 so
this power supply at 1 amp ridiculously
turns on its fan and it's loud and
annoying
let's take a look at this panda here see
that pulsing that means it's in fast
charging mode
check out those giraffes buy a giraffe
buy a giraffe today new Honda giraffes
coming in on Monday I think they are
KITT nobody comes with a our kidney oh
it's shitty the new Mac OS X it turns
your eyes into the center yeah yeah yeah
so that's the directions that come with
the Toyota giraffe which harm does do we
support
well not the Odyssey because hard to put
the connector on upside down everyone's
hanger gets the e on board it's a secret
e on board this is on assembly welcome
to Ian's assembly this is thermal grease
just playing with the thermal grease
don't get this stuff on your hands
disgusting sleek normal graceful it's
thermal so these are the prototype Eon
boxes boxes oh they're here
oh you guys too you know you get is like
five minute walk see two hour of Fox all
right so we like put a little potting in
the board this is the fan and USB
assembly they're pretty nice coming
young boards they're gonna be made by us
park these might even be hand assembled
but yeah we'll make sure that we test
him really well the heatsink yeah of
course
this is thermal solutions good to 12
watts
yeah today's a great day I'm gonna
shipping eons now of course I always
have this problem on the periscope
there's a little tripod right b1 all
right let's go over to Andy's desk I'm
sure he doesn't know it's Andy always
does announce we can steal
no no no no guys have you seen the
testing center is the testing center
look at those look at this pant a
testing board Wow nice LEDs on the Panda
testing board he has an e on mounted up
here it's kind of hard to see doesn't
mean there are so we can see what's on
the e on let's take it down right now um
I want that like grippy mount you know
the one that has like the big put in the
rav4 magnet at work you're watching
those insane clown posse videos
yesterday I kinda want to go a Juggalo
convention you know they really do it's
really like such a positive message
yeah well needs that alright um so I
guess I'm just gonna try to do this with
one hand where's ye are number five um
well this is your number one right here
I should be a final production beyond so
let me see if I can wrest this and kind
of see you can see cool um so I can't
obviously see what you're saying yeah so
this this piece here is the fan and USB
assembly just snaps on in like this
we're playing with this snap bit for a
bit so you just
yeah it's cruellest now you guys screws
are terrible it just made it seem like
you could unscrew the back and take it
off really that's really you don't want
to take it off in fact so that's that's
an e on back assembly piece take this
phone sorry guys
Saros
all right is it an icebox
Jamie Foxx all right how about didn't
work so you have to kind of slide the
heat sink it is the bigger guys that's
the bigger box well let's build one of
each and we'll see what we want that
solidly in there making good thermal
conductivity if you have some screws
ready not not the new secret screws for
the new secret stuff yeah only the
oldest Chris don't worry that it was the
new secrets that's not that great this
screwdriver which screwdriver Jim isn't
it we got to work on the flush this
issue this probably would Ilan doing
right now with model trees you know can
you see like what I'm doing yeah no pace
for beet sink there is pace there's
definitely pay that's my pace can't get
12 watts without paste base is essential
yeah if you were to buy a car
specifically for this tell me what the
Civic is a really nice car it has a
torque limit though yeah the Prius was
like gonna be the flagship but the
steering Ricardo complains about it hmm
I'm sure like he says he says that it's
like sticky and then like he's like a
lot of static friction yeah it's just
like a whole the whole column has static
friction I really wonder if that's our
Prius or Prius is in general yeah um
City California
no no it's like you you can see it when
you're just driving like straight in a
parking lot
I'm basically like in order to get the
wheel to turn it has like static
friction that it needs to overcome which
is surprising you'd think I'm like a
tight like a car with like pretty tight
steering like the Prius you wouldn't
have that I do all right
and that folks is a neon so now we don't
touch it
yeah I've reset the Paris really bad hey
hey hey we love periscope ma'am because
it's me right Twitter all right check it
out it turns on we need a we're gonna
need a microfiber cloth
we're gonna make sure every eon is
really nicely polished it won't say
common neil like that wait'll you see oh
man you guys are not gonna show you
we're not going to show you those or not
we're keeping the software I've been
under wraps until Leon chef really this
offers really nice yeah so that's that's
an eel and then we put the EON through
our to our testing procedure we make
sure that everything works squeegees
yeah I got like this to spread the
thermal paste it really is a little tiny
it's not for spreading a thermal paste
on fine look at the size of this thermal
paste Wow
we should thermal paste the world so
that's that's a neon folks let's check
out the boxes is the small one a big one
I agree is this the small one of the -
Yama
we want to make sure that if we bought a
Yeon Panda and giraffe we can put them
all in the same box
hey we got that time I heart stamp
anywhere am I gonna have to like clean
the ink off the stamp when I'm done I
just I'm not good at stamps you guys yes
yeah that's kind of weak do it on this
one terrible I'm not gonna stamps you
guys don't worry George I think we hire
people new better at stamps to me what
we switch W someone else now good good
good we don't solve people we use we
only install people we don't use so yeah
great if anyone's looking to start a web
store Web Store Shopify is where it's at
no it's true really like this is the
thing now Shopify pop-up stores we've
made like like for how for how little
time we've had this store up a naval
forward collision warning toggle right
it's pretty nice you think we want that
I don't know yeah it's cute but you know
alright this front do we have an e on
our thing oh yeah you need to power a
while I really did a bad job look at
what a bad driver did with the stamp
periscope really bad news stamp it's the
same stamp we used on the envelopes in
the pandas videos will come in small
boxes I mean if you buy a panda a
giraffe with the EON we'll put them all
together I think we shipped out the
pandas and the giraffes already yeah
yeah all the secrets of our
manufacturing just an e on a Toyota you
want to admit yeah I want to be able to
fit the truth to write the whole time
[Music]
go back to the huge box yeah I think
this is saying this is war doing yeah I
mean we're gonna wrap it all with
something - yeah yeah this is a nicer
box but you know or we could just put
the EON in this box no we're not
shipping we're not shipping it separate
we'd have to just put of you know we
need we need bubble wrap I like I really
like the size of this box it is really I
really think this box box like look at
that some reason you can't get how large
the other box was I think that's a nicer
bomb there's your box
we gotta fit all the cables and mounts
and stuff six feet enough is that what
you're saying is not enough on the Civic
don't you say any other thing oh it's a
USB two barrel connector that's weird
I got I got it I got it yeah I mean you
know I like things kind of densely
packed right foot pan of cards in here
yeah giraffe cards we have to do it
look at that fold wouldn't you be happy
okay I mean it's that or like to ask the
periscope people do you want the nicer
box or do you want the uh the sticker
well the stamp won't look that bad I'm
just bad at stamping from stole our
periscope people out there what do you
think anything my back button says yeah
that's the small box yeah yeah we got a
small couch get into the custom real
upset small box small boxes where it's
out I know I know right inion all right
you got it to the small box to put eat
your ass see it's a better fit we
absolutely we have some stuff to wrap
the giraffe to right yeah how does your
ass
it's a ban but it doesn't fit if you
shipping with a giraffe yeah I mean I'm
putting this so that and that's what we
can do we package we packages a giraffe
and the Panda separately and then these
are just eons in a box yeah all right we
could fit we can fill all the EON stuff
in the small box - GoPro mounts now and
keeper adjusting it oh watch we should
tell people about that now yeah so we're
including two mounts I'm so these legs
slide into these guys right we're
including two well including two with
you so you can put it two different cars
and we're also including two of these
that have different angles so this is a
20 degree mount meaning this angle is 20
degrees we also included 28 degree mount
for like the wrap floor is a 28 right
yeah 28 yeah have you have a higher car
because you want to make sure the
calibration is within like a reasonable
range you don't want the thing to be
unreasonably calibrated okay well then
at least we can like package up all the
Aeons like separately from and then
you'll just grab one grab we could even
like have like a single pan they're
prepackaged a lot of people just buy one
yes so you'll throw like a tiny Panda
box after a slip they'll continue to
come an envelope like that right you'll
just throw this and the envelope into
like a big table the direct yeah this is
big tie back end looks from us yes
what you're talking about that way
that's just like like it's a thin right
have like inventory right gets keyboard
yes we have a real we have a real scoop
from game again well we can't tell why
we have a real skew for pants cubes or
fans
pandas are real products thankfully I'll
be something nice if we could fit
everything boxes I mean do we need tabs
nicer on the side you kind of do you got
to tape it yeah more money on like their
songs I know suck right madam I hired
engineers instead of packaging people so
nice I mean no it's just what I mean
like we got to do it only the best
reason only the best for the people who
bought a Yong Yong card together tough
so this is what you're not with this
thinking this sharp you won't cross this
out this is not what the stamps gonna
look like you guys it's going good I'm
not good at stamps vanilla gorilla wants
the messed up smaller stamps
that's all right mr. classics dams
that's about lean departure for sugar
for shipper nothing average coming out
for shiver shiver + sugar + shift+ now
we've got a percent battery but I got
time to steep and here
the Vice the phone a device see what
guys advise his data partition increased
on Eon yet will be yeah we're gonna get
the data partition to be big
particularly if you got a 128 kg on
that's that's driving for days I was
surprised but I'm happy we offered it um
there's not too many of those in stock
so don't don't too many people buy the
128 games
could you put shiver Plus on iOS no
shiver plus only runs on eons when do
you ship the comma light on Wow you know
they heard about the secret new sensor
and what if it's a wide are place all
lied all right that's true Joyce is 128
yes let's see the secret guys secret can
we hear sensor name was not the pigeon
it's like I'm like a few boards around
here if you probably like that board
over there at the bottom of that boy
it's at the bottom of the list after the
EON ship yes anka zoom in what's the
sensor first letter l l like you know
else the back of the benzene or how many
aeons will we ship tonight none like
next week it's close what close were
close for close productions hard I'm
lighter to start with Al the llama
remember the Koala do you do we
prototyped koala SoundCloud slash time
cruise up yeah the Edison yeah but what
about the jewel The Jewel yeah the Koala
was gonna have a jewel
I don't know ma'am koalas are extinct
we're really crabby look at how fast
this pan is charging my iPhone I know 10
watts this is charging an iPhone like
twice as fast the real iPhone charging
those are so good
did you write made in America no oh man
I wouldn't do that it is made in America
though it is but what a koala do there's
like a better Panda yeah well this is
just shit talking our oh yeah I can do
both cameras the same time Marhaba all
right you you guys know that I'm a big
America fan you guys know that I love
America but like I'm not gonna like this
tacky I'm gonna say made in America you
know it's like it's made its quality
right like investigate us or some yeah I
don't want to see that's what I mean
like I don't wanna I just don't want to
be a part in I'm not yeah all the
thermic pace to use is not made in
America yeah there's like stupid
restrictions about it's like non-gmo you
know like it's like it's a completely
like arbitrary distinction then that's
not who we're marketing tonight you know
what I mean yeah you're marketing
because you know you want to brass used
in your metal inserts
Oh does it use the camera to steer the
car so Ian's officially don't drive cars
he owns our dash cams I'm very proud to
be from America you guys know I'm proud
to be from New Jersey that's even that's
even how do you young rear view merit
Thank You chef we're gonna down the rail
adapter we don't include that and we
don't encourage people to do that
so technically yeah if you do that we
can't sell anything that replaces your
rear view mirror because of FMVSS but we
do we do we do give it away if you want
to do it yourself we can't we can't sell
anything or encourage you to do it but
if you want to do it yourself as long as
you're complying with your local laws
which you can you are allowed to remove
the rearview mirror on your car but we
can't sell a product that forces you or
encourages you to remove your rear view
mirror I mean this isn't even like a
Honda we have the rearview mirror but on
the Toyotas we don't we're Schiphol with
these things the GoPro mounts just take
it to your windshield again make sure
that's legal in your state most states
have a fairly reasonable rules about it
if you can't stick it right in front of
your face and it can't take up more than
like a couple square inches but there's
a Honda mirror - GoPro STL file yeah if
anyone does want to convert so yeah you
could just you just print out any 3d
printer yeah it's the one we're using
nothing nothing on windshields in your
state whoo
that's rough could be on ever
unofficially drive the car well the over
pilot does support the Aeon but the Aeon
doesn't officially drive your car it's
not a self-driving car yet it's a dash
cam development kit the key word there
is development so you can develop and if
you want on it what are you gonna make a
HUD Oh everything's about to look a lot
better have you guys seen so check out
the screenshots on leonov shiver shiver
plus nebraska doesn't care yeah
no safer flash no
Yeah right doesn't look good they kind
of come up by one I want to buy anything
it's a good experience it's really look
I don't build these things for like a
market I kind of built the stuff that I
kinda always want it you know it's kind
of and you want ways on your car to is
really what you want I was driving I was
drunk of cars to Thanksgiving I'm in the
Civic and I'm like my phone was uh I
just wanted to like like like my
Mercedes at least had like a decent map
that could stay like wicked acidic one
relax it's not usable BMW 3-series will
at work I mean will it work to do what
will it be a dash cam and a 3-series
yeah uh don't ever code in Java gross
Java is terrible he's Python you know
why cuz it's just print and it used to
just be print with a space but now it's
print with two parenthesis anti Python
three to four life
Civic had map update pushy I don't care
if they update the map like my problem
isn't the map it's the software it's not
like there are roads missing it's like
wow you sound like the Microsoft
connected but yeah no I mean so you guys
know where we're going with this
obviously you're gonna be able to type
in shipper on your phone you're gonna be
able to type in your destination and
I'll get pushed you're right eventually
eventually and that's like like shipper
is kind of you know you can use shipper
as a dash cam it's a way to get into the
ecosystem but it's also gonna kind of be
a remote control for your car to the
point that like if you if you have a
panda maybe you'll be able to like
unlock your car from your phone okay we
can really push a lot of things you
scroll up far enough you said something
silly I can't scroll what's the most
important spec for the e on camera
for modeling resolution uh the camera is
really nice I mean the nice thing about
the camera is more more the way we run
it we've written our own camera stack we
don't use any Qualcomm stuff much more
reliable and it's it's we have we have
like precise timings my timing is really
important whenever you're dealing with
anything that's like quasi real-time
I mean people make fun of us for using
like Python right don't look it up are
those not real time yeah it's like plus
or minus five milliseconds your shutter
on your camera takes fifty milliseconds
to roll right so it's not it's not five
milliseconds here it's 50 milliseconds
but you know that's the kind of thing
that if you're running through some like
post-processing stuff like like you
camera server does its you don't know
why not do a paid app with lane
departure warning yeah selling software
yeah not that interesting you play
pac-man in Park mode she we shipped
games on it's fun is Park OGE on App
Store Android we can we can make it so
you could probably kind of run other
apps if it's not like janky we'll do it
you know I'm not it's not like we're
trying to control the thing you'd like
SS agent do it whatever you want on it
he's kind of it would just kind of want
to I don't like make the experience nice
it's more like working well and then
we're gonna have the e on App Store
reviewers and then we're gonna have to
go through like I don't like the
reviewers at Apple you know what I mean
chrome on yon how about how about be on
in chrome right alright you go to drive
my car dock today
we could probably make it so with with
the Panda Jas library that'll talk to
your panda over JavaScript you could
drive your car right from a web browser
that'd be kinda nice
all right guys uh I can you know never
receive button presses from a car wheel
yeah so the Toyota is unfortunately
hardwired a lot of them but on the Civic
we can get almost all of them I don't
know what Marhaba means or monthly
subscription yeah again maybe maybe oh
no it's not that exciting to me you know
what's exciting to me winning
self-driving cars no forward collision
warning day one on on on eons with
shiver plus assuming you have a
supported car you need a radar for it
but we're gonna ship vision only forward
collision warning and chef applause and
we're gonna ship lane departure warning
and here's the thing about lane
departure warning right um
so forward collision warning is a lot in
some ways easier to do than lane
departure warning most people turn off
lane departure warning in their car
because they're really terribly done so
if we do it it's gonna be really good
our forward collision warning no know
what you're flying cars we're working on
we're working on mesh 3d we're moving
everything like all our mapping stuff is
in 3d so it'll work good with flying
cars because cars kind of fly I mean
they just fly along the road right like
the road change out to lane departure
warning most people turn it off and in
two thirds of people turn it off in
their cars because there's too many
false positives when you have a warning
system false positives are super
annoying because I mean it's the boy who
cried wolf right maybe not maybe not um
maybe because the person is doing good
job modeling with your head either yeah
I mean we really want to you know the
boy who cried wolf is a story of false
positives like false positive torque
moments no I like my to know like my
pork limits Oh like false positive
torque limits like when it says turn too
sharp yes oh yeah
we can can do better on that we can we
can certainly not we can change how we
show that alert we show the alert now
whenever we're at max torque of the
steering wheel but sometimes max torque
is so close to the right steering angle
we could not show that alert yeah we
should do that because you paid a I
Drive assist app yeah what and then I'm
gonna like like cell like engagement and
stuff I'm gonna like oh man look we're
selling like red light DLC my dollars
red lights five dollars have you know do
that if I like really wanted to go
full-on troll I'm sure the VCS would
love me what are my thoughts on necks
are it's alright do we buy or do we all
we have one oh let's take a look a sense
of pride and accomplishment winning self
dragon cars that's really what I want to
do will advance torque limit warnings
come with Maps yeah we can do we can do
a lot more with the Tarpan mornings with
maps and we can like this is next hours
little camera that they ship so yeah you
know don't have 3m VHB 'ls you know the
joke about access camera right yeah yeah
they like bought some like Chinese
knockoff camera and called it like necks
are cab this isn't like exciting for me
right like for us shiver is a starting
point not an ending point shiver is the
way people almost everyone who's bought
and Beyond from us and everyone who
who's in our ecosystem started with
shiver right shiver is the beginning
point to a self-driving car I mean it
will get better eventually all the
features will trickle down but in 2018
if you're gonna want their really nice
warnings you gotta buy any on just
because we can do a lot more with the
power its power eventually I feel so
good the next gen i phone accesses
iphone Exadata are good enough to
probably arrive some sudden drive is
this thing what $600 instead for a
monthly subscription to what
Mobile is a monthly subscription do that
$6 for yes your put 0.2 when I move at
least this week I have a model we got a
qualified that's what I've been working
on all weekend I've been working on
models so zero point three point I will
definitely come out this week there's
some chance didn't want to model the
breaking is the ring is good controls to
do the job with that
alright guys thanks for joining me
bye bye Young's shop like I'm sorry
bye cool
what's up periscope hey does this show
on Twitter automatically yeah probably
my cool welcome welcome welcome welcome
to the e on shipping party
Oh like I said we have 20 eons built so
far those are the 20 don't worry they
won't ship to you like that
these are q8a eons for us just testing
out the provisioning script making sure
they're all good we literally got
everybody at this party these are the
boxes Aeons will be coming in there's a
lot you just don't realize it how many
of something is something not too late
it's not too late over nyan Q aim right
now fine here's the assembly team right
here
getting a few more a few more amounts of
printed you want to make sure you guys
got the right mounts fury on oh it's a
party out it's a party these are the
four that go Annie on so they're got to
assemble own every on is tested
has anyone Akama made a neon drive a car
of course hope you guys watched our
periscope how many yards are being
shipped way too many you know I
submitted to all of them it's a little
you are must you know what you do is you
just say I'm Twitter that we're shipping
tomorrow and guess why everyone kind of
ship tomorrow yeah but now the more
people are buying them so it's getting
harder to ship is probably selling water
shop that coming i buy a on fire on fire
come on every on you buy you make them
work harder we're at Christmas party
last night so today we have the shipping
party oh so these are the cables they'll
be included with your Eon well he owns
come with a long cable the short cable
they come with GoPro mounts heat sinks
are all measured to make sure they're
the correct size there are no comma
lighter and lighter is a scam folks
every on has hand applied thermal paste
for maximum conductivity cleaned
polished
giggle the box as a phone came in you
ever opened hundreds of boxes of phones
they used to like their boxes right
right there's a lot of useful life
before I work to come when you unbox 100
of the same phone it's less fun what
periscope alliance of show you iam
number 11 I wouldn't go to you number 11
let's go I gotta hide you from over here
because there's secrets on the
whiteboard super secrets oneplus still
producing three keys I don't think so
over the meeting room quality of growth
maybe we should maybe we should put them
all in the meeting room that dashed bit
let's put everything in the meeting room
that'll be the final packing room then
let's put everything in the meeting room
to like final pack oh you want to pair
with the label pen all right 128 gig
Yeon's those are those are coming out
soon I'm so young number 11 is in this
box here well I think this one here
we can see the serial number fresh every
you know will be wiped out with a
microfiber cloth oh if you guys haven't
seen the little Aeon change we made a
tiny last minute hardware change of this
my young CVE three holes
that's so your yawn can have a light
sensor and it can dynamically adjust its
brightness depending on how bright it is
see how it gets dimmer and now it gets
brighter those are all 64gb on the 128
are coming out in a little bit I'll have
to go down to the factory and talk to
them yeah let's see let's see how many
young to be sold to that oh man guys you
know yawns are flying off the shelves
this is the end of year whiteboard these
are the last things we got a test on
every yawn we're gonna test the fan
we're gonna test the camera we're gonna
test the USB port with the Android
self-driving cars and we ship if you
haven't heard about self-driving car
Awareness Week and the self-driving car
awareness tour go on our Twitter
twitter.com slash comma underscore AI it
is the pin tweet why don't have a big
but sales data secret we gotta have some
secrets to come AI right though we do
have we do some cool monitors but yeah
if you haven't heard self-driving car
awareness tour um what I've said about
press we got a few reach outs from SF
press we're not doing SF press this time
um but we are happy to do local press in
the stops we make on the self-driving
car awareness tour we'd love to give you
guys a demo of our open source software
open pilot running on the latest comet a
I hardware try it out we have the stock
system ready for you to try as well so
you can really get a a be comparison to
see why open pilot is the future cool
any last questions
yeah so eons are hopefully yeah they
should about today hopefully everybody
if everybody does their part it all
comes together
shipping yesterday wasn't outside gone
with us he's in New York man he's
already in New York cool thanks for
watching
morning periscope
all right
so
all the eons are going to the post
office today we were up late
um
putting them in boxes and flashing them
for you guys
so i'll show you
the room and the mayhem from the
flashing
big charging stations and carolyn's have
a bit of a charge
and these
are the 13 i guess only 11.
this is how many we had left over
these are the ones that will be coming
on the self-driving car
awareness tour
with us
yeah a lot of chargers so let's do an e
on unboxing
let's see what it's gonna look like now
i hope these ones are well packed up
um
so these are 128 gig neons
i should say yeah this is 128 on the
back
so you'll see that you'll get a box that
looks like this comma ai
i'm going to turn you guys sideways
if your box looks like this
oh
look at this
it's the eon card
eon your new co-pilot
getting started with eon mount connect
drive
you'll find this right at the top
set this aside
nice piece of high quality foam we
bought a lot of these phones and a lot
of them are not high quality
um you guys know i'm big on quality i
try my best
so you take this foam away
and this is what you guys will find
co-pilot
that's a good word
um
this is the charger and cable bag
and the charger and cable bag includes
two chargers
this is the eon wall charger
and this is the eon car charger
um now of course you don't actually need
a car charger you can also just plug it
into a panda
uh the panel is actually a better
charger than this one but this one works
fine
and then we have a short cable and a
long cable
that's that bad
is this bag
this bag includes
oh different type of charger for around
the world you got us chargers bros
um
it's a usb any any usb charger kind of
works too much plastic that's not too
much plastic so these are eon mounts
um notice that we've pre-applied
the uh
the backing
uh sticky for you so you're just going
to stick that on your windshield or
wherever you want to mount your yam
um
it includes a
sim removal kit
and your eon of course has an lte radio
as well as a wi-fi radio
shifter plus does not require uh lte uh
open pilot pills
and this is the
allen wrench
and we included a second mount and if
you look on the side of the mount you
can see it right here maybe
it's really hard to see on the camera
but it says 28 on it and that's because
it's a 28 degree mount meaning this will
mount your around at a 28 degree angle
if you have a higher car like a rav4
you're gonna probably want something
like this
um the default mount that comes on the
eon itself which we're going to open up
right here it comes in this nice
oval wrap bag
doing everything with one hand while
holding you guys on the periscope is not
that easy
i need a hover phone like a drone
and then this
in here
is the eon
so that is a completed 128 gigabyte eon
see the eight screws on it um so this is
that 22 degree mount that i was talking
about
and if we look down here we have
the usb connector the heatsink camera
pretty nice decent build quality uh
there's no screen protector nope
um so let's power it up see what we get
so
some of the eons will come charged uh
some of them will come less charged
let's hope this one's a bit charged
so you'll see that it comes up with
comma
no no no we love nishta we are friends
with all regulatory agencies
this is not a self-driving car kit this
is of course a dash cam development kit
you can install whatever you'd like on
it
but what it comes with is dash cam
software called shifter plus which is
open source on our github
so you'll see that it is loading dude i
don't like marketing man i don't do
marketing um so welcome to eon uh before
we get on the road let's cover some
details and connect to the internet
um so i'm not actually gonna set this
eon up because i'm gonna box it back up
but that is what the eon unboxing
experience
will look like
any questions
of course
which is going to be here
and welcome to eon on so yeah i mean you
know i'm not gonna i'm not gonna ruin it
for you by by clicking set up you read
on i mean you guys would experience the
adventure when you
get your own eon you want to buy it it's
available for sale at shop.comma.ai
um
it's not a pre-sale actually oh if you
ordered an eon before yesterday
it is actually going to the post office
today it's already in a box
you can kind of see a few of them over
there that's just part of the
big mess of eons
um is there a neo s4 yes and that's
what's installed on the eons right now
um so you'll see right here it says it
has no sim no car looks like it's got
about a 20 charge
uh we don't sell self-driving
um
i talked in my uh
website presentation about how
self-driving is a journey and not a
destination
uh we're not i mean you know the tech
just isn't at the point where
we want enthusiasts using it
not uh consumers
but yeah so that's kind of where we are
that is an eon unboxing
eon your new co-pilot and that's what
shift plus looks like when it's running
we have a support email some people are
like where do i get support we have a
support email support at commandant ai
um
note
connect
drive getting started with eon
cool
well that's a neo unboxing
thanks for joining
yo yo Scopus alright so we are we are we
are doing it we are putting the
ultra-rare my job okay
so let's wait for a few people to get in
here but maybe we'll post this periscope
on slack someone want to do it so we
want to post that in kama we're doing
the merge drop guys we're doing the
merch table but before we do the merge
drop down on the hoodies no no no that
he's no hoodies let's not get crazy yeah
okay
no no no she's
the first thing I'm going to show you is
our flow nets like we were making flow
nest
look at the flow net it kind of works
this was trained unsupervised and
unsupervised machine learning kind of
works kind of works it has a little
trouble getting a road down here
sometime but I went to the diner on
Saturday and I read papers and I read
flow papers and then implemented this
flow paper no it's not decent it's bad
look see how the road drops out we're
trying to fix that we're using the
uncompressed videos but ya know you'll
see it's like it's pretty good when
there's like a car coming the other way
now they're getting the flow but like
all of this flow here is missing yeah so
red means it's going that way and green
is the vertical flow see it works there
when there's actual texture on the road
um yeah we'll see maybe we'll get a car
coming the other way but guys know the
flow that's not we're here to talk about
you know what we're here to talk about
the exclusive limited merge drop so Yun
flipping put the mapping yeah it doesn't
work well on flat textual services well
roads aren't really textualist we think
of the uncompressed ones we can get it
but guys let me show you the limited
edition comma AI beanies right here so
equal is on track to be comma a eyes
highest revenue month in history you
know more than we announced pandas more
than more than ever more than the
self-driving car awareness tour and
really it is it is thanks to you guys I
know it's April it's almost over we have
to make 1000 more dollars worth of sales
so that's one yawn but also we can make
some money selling the hoodie so selling
these beanies so let's see how many we
have we have one we have two we have I'm
gonna turn you guys sideways okay I know
I know you might get crazy here alright
hang on why didn't that
rotate no unlock like that will count
the beanies together so that's a to
beanies over here three no hoodies well
well that was a mistake for be nice
I've but you get beanies okay you told
Kent hoodies six beanies and then this
here is my personal beanie which I'm not
selling I'm gonna put it on my head
right now they're really warm and cozy
we have two softest merch in the game
now the second softest I can't I still
don't know if I could say that but look
okay guys all right so here we are on
our Shopify back-end well okay let's not
get too crazy here comma can you pick up
no no no no no we don't do that we will
ship these out on Monday beanie
exclusive limited only six all right
okay guys so what should we well no no
we're just dropping mercs today that's
all we're doing all right so if you here
for the merch drop you here for a merge
drop and so how should we describe the
beanie guys don't have any good words we
need words
black that's good word I like that black
it goes on your head your head
Oh midnight black oh no no that's that's
trademarked for aeons very black oh very
black will definitely add that too yeah
I love the super hearts by the way guys
we're gonna become a paid Paris copy
soon very black up it goes on your head
has a comma let's put that on the next
line we don't make this is for souls of
all colors a beanie has no holes that's
a good point has a comma on it
topologically it has no holes I'm not
sure about animals I don't think
anywhere harmed but I can't state that
topologically has no oh no typing with
one hands heart no pulse
okay cool you may be more gangster if
you wear I got to qualify that with men
you just I got more gangster if you wear
it micro holes aren't holes holes
not yes oh can I say blockchain powered
is that legal
something-something b-baby I don't know
if I can say that something something I
can definitely say something something
that's legal does not use lighter light
are not included include it or need it
[Laughter]
what is the merge cop
it's the Kama AI beanie we only have six
of them I looked around the office at
first I thought it was only four but
then I found two more so there's six
brand-new Kamiya beanies right here ah
one more thing can hold o let's see if
we can put a neon in a beanie oh that
sounds fun
alright so here we have a neon and let's
see if it fits in the beanie it does it
fits in the beanie and let's try to put
this Panda in here too oh that's good
that's good oh yeah good holder for your
comment AI hardware good older for your
it does not come with a panda or no I
shouldn't say that that sounds like
something that can be bad compatible
with humans well someone's gonna buy
this beanie so we shouldn't you know
leave my card
Panda right there check out that panda
by the way this stuff's all and I'm shop
a comedy I make sure to check it out
alright guys so we know how many we have
in stock this is a physical product
what's the weight event point three
pounds let's say inventory policy
Shopify tracks this products inventory
six allow customers to purchase product
when it's out of stock no that's it
there is only six of them I will be
uploading an image shortly I'm sorry you
look dumb in a beanie clay but we are
only offering beanie so guys this is the
big question will be scanned by the Aeon
nobody's writing that code ok cool guys
what should the price be this is
exclusive much we got to remember that
throw some numbers out there $20 this is
exclusive merch 500 dollars that's a
little much 150 that's a little 1,000
over six that's that's more doable 399
how many exists well so I have one here
for my head and then I have six up for
sale alright alright alright alright
about 25 will free shipping is always
included except for International
shipping guy you have to pay 30 there's
six ever yeah I mean there's no
guarantees of that that's just how many
I found $99 you guys what can we
actually price it at oh ah you know what
we're gonna go with 69 let's go at $69
[Laughter]
only six the price is $69 off let's save
this product I want to make sure I don't
little look over here while shop with my
loads because I can't show you any
secrets view all right let's go all
right guys it's black who wants to buy
it
Skokie thinks that price is
inappropriate the prices all be going up
guys just because I'm pricing beanies
$69 this is exclusive comedy I'd merch
exclusive limited it's still cheaper
than jeeva yay that's what I'm saying
right oh we should say compare just do
you want Chang have a beanie let's let's
look at the G Vaughn che beanie
oh my god $279 Wow okay alright so I'm
gonna say compared at price 270 how much
was that again
275 damn compare at price 275 compared
to that's probably illegal I could say
compared to that's legal we did nice I
love it I love it
guys this really there's only six of
these okay compared to this beanie it's
[Music]
ile of a life time um okay well you know
what I think we just sold one so I
actually think we actually did just sell
one so I think the price is about to go
up you're not seeing it guys it's posted
and slack okay guess what someone bought
one guess what the price the next be
Gnaeus $79 prices went up now it's 79
early I back in the day we were just
talking about that actually do this
beanie yeah look at that
we might be dropping the price back to
69 I don't know if we should do this so
you see that we have 15 outstanding
orders right now so when I can refresh
this page I believe and it won't show
any secrets
wait oh my god we have 20 outstanding
orders right everyone just buy I'm not
showing you guys the $79 no there's
literally one left when someone buys it
you'll see it go to out of stock you
know what I'm not gonna do that they're
all gonna be the last one gets it for 79
that's
you should you should have gotten Harley
should come in quick
oh forget it we gotta sell one more
beanie guys wait okay know what to sell
one more beanie I'm gonna post it on
Twitter top that exclusive merch
there's literally one left and now the
price is $79 it might have sold out like
literally you guys are crazy
oh no it didn't put the product photo we
did a product photo wait okay do we sell
the last beating up no one's buying the
last beanie
we're so five we haven't sold the last
one yet we'll wait for that Twitter
tweet to get a little bit of
okay maybe we need some pictures what
the Javan ji price is 275 all right guys
come on we got to sell one more
we got a literally sell one more get
your exclusive alright alright fine fine
fine I'm sold
I'm sold sure we dropped the price back
down a special price all right we're
gonna make a coupon code we're gonna
make a coupon code let's make your
coupon code that sounds great it's very
easy to do here on Shopify unless
somebody buys it before the coupon code
say last beanie you know why no no at
common hey I we only raised our prices
on hardware we don't lower our prices on
Hardware create discount we'll call it
okay bro 69 discount value is a fixed
amount it's ten dollars and it applies
to only the beanie
save discount
you got bad who's gonna buy the last
beanie there's literally one left guys
like I'll prove it to you I gotta I
gotta hide I gotta hide the rest of
these analytics but let me see if I can
only find the analytics for the beanie
Oh reports see reports oh we bring up a
live view yo the coupon codes posted on
Twitter the coupon codes posted on
Twitter okay bro 69
visitors right now in the store buy them
beanies right now let's go real-time
pages for a minute let's go we have 12
active cards nine people checking out
who's gonna get the BT five purchased
there's five purchase like I said
alright guys come on
who's gonna buy that last beanie who's
gonna turn that number to a six it can
be you there very nice exclusive comma
AI all black beanies no pictures you got
to come on periscope no okay bro 69 get
it right now buy that beanie buy that
beanie let's refresh this live view I
don't know if we have to refresh it oh
and is that 21 did I see 21 by the
beanie so good so I love it guys I love
it thank you for joining this comma AI
exclusive merch dropped beanie ship on
Monday love to all the scope is comma AI
wear the most lip self-driving car team
in the world back on that logan paul buy
my march but you can't cuz it's sold out
six beanies thank you for joining
Connecting. Connecting.
>> We're ready.
>> We're squatting.
>> Oh, look at all the comments.
>> Oh my god, so many comments already.
>> All right, cool. Let's get started.
>> Hi, friends.
>> Hi, I'm Yasine, part of the autonomy
team, research team.
>> Oh, yeah. Hello, I'm Harold. I'm also
part of the the research team. Um, yeah,
I don't know. Yen's got some cool stuff
to show you today and we're gonna talk
about all of our uh latest experiments,
all the new model architecture we're
working on. I've been working pretty
hard and it's going to give you a cool
overview of uh all the new exciting
stuff.
>> We have a lot of comments. Maybe we
should just catch up on the state of
things here.
>> All right, let's see.
>> There's like 400 people in here right
now.
>> Wow.
>> Models train wise a lot of So, we'll
talk about that while we're driving.
This will be a live drive based off of
training that was all simulated. Yeah,
we train in a simulator. This first
software feature doesn't work on the
comic. Why wouldn't it? No, it works on
the comic 3. Um, we're going to Taco
Bell again. Uh, so this won't be a Taco
Bell drive.
Uh,
>> Taco Bell was more about selling you
what is possible. Now we're focused on
actually shipping things to you that
work for you every day that are
reliable.
>> Love the software. I don't think anybody
wants regressions. Yeah, we don't want
regressions either.
>> So, we drive with Open Pilot every day.
We're just as annoyed about regressions
as everyone else is.
>> There's a sale right now, guys. We
haven't even built half the Comma 3X as
we plan to build. I've been saying this
for months. This is uh still true. We're
buying lots of parts, lots of A45s. 1.0
when uh we'll be talking about it soon,
actually. Um
Drew got out the L hoodie. Uh Billy's
right over there.
>> Billy's here.
>> Billy has arms. He's been working out.
>> Oh, behind the mic is bad audio.
Uh,
okay.
>> Well, you should just speak louder.
>> I should speak louder. Okay. Volume is
way too low.
>> Is the volume low?
>> It's okay, I think.
>> How's the volume when I speak?
>> Even me.
>> Second.
>> I'm okay, too.
>> Yeah, you're okay, too. It's better in
the front of the mic, but that's fine.
>> And turn it sideways.
>> Okay. I think we're caught up on the
comments. Let's
>> Let's give them a preview of how it all
works. So, we wanted to talk about the
challenges, the hiring challenges a
little bit before we start talking about
MLSM. We just finished the Comma VQ
compression challenge. Uh, for people
who are not familiar with what it was,
it was uh basically
>> you can go to comi/leerboard for this.
>> The goal of the challenge was to
losslessly compress video tokens. This
isn't a Dolby experience
>> that come from comm
um and the idea was to essentially start
with uh something that's already los
lossy the result of a lossy compression
algorithm that gave us already a good
good frame by frame compression but then
we wanted to add additional compression
on the frame to frame compression and um
uh we had some pretty cool results. A
lot of people beat our baseline which
which was uh I guess pretty easy to beat
but nonetheless pretty nice. So we had
two kind of solutions. We have solutions
that use comp standard compression
algorithms like Zpack and such and then
the winner Paneotis
uh so shout out to Panotis who used a
GPT
so uh pretty cool solution using GPT uh
together with arithmetic coding uh and
then reached a 2.6 6 compression ratio.
Uh many other people actually attempted
using a model some kind of predictive
model to compress the data. Uh but only
Panayotus was able to do it
successfully. Uh so shout out to him and
congratulations for for winning the
challenge.
>> Yeah, it's really cool too that in this
case the uh coolest solution also won.
You know, sometimes there are cool
solutions that suck. Uh it's really cool
to see like the list of uh you know
simple compression uh better standard
compression and then uh complex
compression be the also the ranking of
quality. That's pretty awesome.
>> Yeah. Yeah. The solution is really cool.
Uh we were expecting something like this
to be the winning solution and that's
what we we got. Uh so we're going to
keep ch cycling between these challenges
and updating them and uh
>> so let's say next challenge launches
Monday, Tuesday next week.
>> Yeah, sometime next week. we can we can
figure out when
>> um it's going to be another iteration of
the controls challenge, but we've just
learned a lot over time. We're making it
a bit more cool.
>> Um both of these challenges, you know,
the compression challenge and the
controls challenge are very much in line
with the type of work that is necessary
to make open pilot good. You know, the
compression challenge you trains GBTs
that's at the core of now current open
pilot performance and the controls
challenge is a bit more long-term. uh
but we need solutions like RL ondevice
learning um potentially uh gradient free
optimization to get really good controls
on all the cars. We can't hand tune cars
forever. Obviously humans don't do that
when they learn to drive a new car and
we need uh that to work with machines as
well. And the controls challenge kind of
tests that ability. Uh but currently
research just isn't in a place yet. Not
not just us but I mean just the state of
research where this stuff is easy but so
that's kind of a more long-term thing.
Um
>> so they're asking what a good score for
the controls challenge is. I mean, look
at the leaderboard. If you get better
than the number one score, then there's
a good score.
>> Quantizer 66. By the way, Quantiser is
>> He's an intern here.
>> Yes.
>> Yes. Uh that's Jimmy. He's here now.
He's uh found important bugs in the
controls challenge. And uh completely
blown out of the water all the other
scores. I think uh I managed to get a
score below 60 knowing my knowledge of
how the challenge was created. So, it's
a little bit cheating. Um so, we know
that's possible. Um, so I I think
probably probably the best possible
score might be around 50 or slightly
lower, but uh yeah, this is a very the
the the gradient of quality on this
challenge is really cool. Like it's it's
always possible to do better and the the
solutions become harder and harder.
Yeah. But it's really fun, you guys.
These challenges are really nice.
They're really in line with what you
would uh the job that that you would do
here. And I mean, you learn a bunch of
things doing them.
>> I mean, this is most of our hiring
process, too. You submit a good
challenge, you do a couple phone calls.
Um, and that's most of the process. Um,
super straightforward. Um, we hired
Jimmy, I think like less than a week
after, um, he submitted his challenge.
>> Yeah. Yep.
>> And if you look at our old challenge,
uh, Casper's not here today, but
>> Casper Casper's record on the
calibration challenge blew everything
else out of the water. He had a very
sophisticated solution and it wasn't
luck. It wasn't a trick. He didn't
cheat. Uh he genuinely just had a
solution that was that much better than
everyone else's. Um and you know he got
hired. He does cool stuff here now too.
Somebody's asking for the source code
for the winners. Um so that's up to
them. We'll link it if it exists after
the challenge is over. Um so the method
for these guys was redacted until the
challenge ended yesterday. Um so you can
click on their GitHub and then you can
see if they published the source. Um but
we will not publish the source um
ourselves.
>> Yeah. I mean we've kind of changed our
opinion on this. In the beginning I was
kind of pressuring people to not you
know publicize their solutions but over
time I think you know if you copy
someone else's solution that you know
obviously that's cheating. Uh that's
going to come out if you get away with
it. We'll notice in the interview that
you didn't come up with this yourself.
Like that's just a that's obviously not
the point. So a lot of these people
actually have been developing in the
open. It hasn't really been a problem.
Uh another big change that's been to our
challenges in the past we had you know
private validation sets. Uh we're trying
to you know move away from that. It's
really hard to make challenges where
when you're developing on the challenge
if you get a result you know that result
will translate to how we evaluate it.
The control challenges like that. I
think those are the coolest kind of
challenges because when you do well you
know you did well you don't have to wait
for secret evaluation. Um so we're going
to try to do that as much as possible uh
in the future as well. I think it's just
the coolest type of challenge. which is
also just the hardest to make, but as as
possible, we'll do that.
>> Let's quickly show for the other
challenges.
>> So, we have the compression challenge,
which is just done. Controls challenge,
which will come back soon.
>> We're looking for a designer. So, we got
design challenge, um hiring for the
hardware team. We've got a a hardware
challenge that has some uh hardware
elements, some software elements, and
then uh some older software challenges.
>> Yeah, if you go back to the hardware
challenge, you'll see a familiar name,
which is Jimmy again. Uh Jimmy is uh so
such a fan of challenges he managed to
do well on two completely different
challenges.
>> Um yeah, so all three of these people on
this list are people we've given offers
to. Um so this makes it super clear what
the bar to work here is. This is our
best definition u of people we're
looking to hire. So if you can do the
challenges well um you're probably a
good fit.
>> So I see a question in the chat saying
that this is a complex hiring challenge.
I 100% disagree. This is one of the
simplest hiring hiring pro hiring
process. This is one of the simplest
iron processes I've seen. It's really
clear. If you go to commaai / jobs,
there's nothing nothing hidden from you.
The process is super simple.
Three bullet points, three steps. Uh and
everything is transparent. You can see
it is not difficult at all. Compared
compare this to multiple days and
multiple rounds of lead code of
whiteboard interviews of HR screening
all this stuff. This is not it's not
complex. This is very straightforward
and uh in my opinion this is uh a really
fair uh hiring process.
Yeah. I mean obviously you don't get
paid for the challenges if you don't
win. You know you should be having fun
doing them. If you don't like the
challenges you're probably not going to
have a good time here either. If you
really want to get paid, you can do the
bounties. You know, doing bounties is
very similar to doing the challenges in
terms of getting hired here. And you do
get paid for those. I think this is a
super fair process. Yeah. In general,
the turnaround time is a matter of one
max two weeks. Uh you know, if nothing
crazy is going on a comma, we generally
uh schedule interview couple days after
we get a good challenge and then uh move
over to either reject or accept within
within a week.
>> Saying if we do the challenge, we don't
have to do any technical interviews. Um,
so I think that's the wrong way to think
about that. It's not about like cheating
the process. Um,
>> again it's everything is if this
question is asked, you have to read
Kayasa's job. Everything is laid down.
Number one is the challenge or the
bounty. Number two is a phone call which
will be technical. Number three is a
paid micro internship or internship if
you want to apply for an internship. So
very straightforward and in my opinion
very fair.
>> Yes. But yes, you cannot get out of a
technical interview. If you manage to do
well on a challenge and terribly on a
technical interview, uh that is also I I
think you know people see the technical
interviews too often people are worried
that they do poorly on an interview
because of various circumstances.
Generally a good interviewer can see
straight through that if you have
technical ability uh you know whether
you're having a bad day, whether you're
tired, it will be obvious in the
technical interview. Doesn't matter if
you woke up late or any of those things.
You can't you don't just suddenly forget
all of the technical things you knew a
week before.
>> Yeah. And you're not talking to like a
recruiter who has like a checklist.
You're talking to me or Harold. So,
>> yeah. Nobody's asking you what your
weaknesses are.
>> Yeah.
>> What's your best weakness?
>> Can you expect design challenge design?
Figma. Yeah. Just the Figma. Just make
something beautiful. That's kind of it.
I mean, you can see the one that's on
there. Um, so we didn't give him an
offer, but I thought it was a pretty uh
pretty solid challenge. Um, you guys
have a pay range. Um, if you go on our X
account, um, Twitter, all our jobs are
listed there with some, uh, pay ranges.
Um, but I think those don't make it
super clear that these positions are
equity. So, I can update that later
today. Tech was George asking about
Axton at Yeah. So, I mean, it's super
basic stuff. It's like, you know, do you
know anything about computers?
You guys cover relocation. Um, yeah, we
can talk about that. How longest a paid
micro internship? Um, two, three days a
week. Um, it's kind of up to you.
All right. Should we go on to MLIM?
>> MLS sim. Uh,
all right. Let's talk about MLSIM. So,
the videos that you see here are all
100% generated, 100% imagined. So, these
are short rollouts. Uh, they're 100%
imagined. Uh, to uh
>> these are very short rollouts. Do we
have longer rollouts?
>> Yeah, we do have longer rollouts that
I'm going to show in a minute. Uh but
these basically are what we run during
training uh of the uh of the the GPT the
dynamics models. So just as a reminder
of what MLS sim is uh we train our model
fully in simulation in closed loop. So
we ask the model to drive in an
environment and then the model learns
how to drive using standard supervised
learning in that environment in closed
loop. So the model makes mistakes, is
exposed to its own mistakes, its own
noise, and then learns how to recover
from it. And that's how we've been
shipping uh end to end lateral and end
to end long open pilot for the past few
years.
>> Why not use a game engine?
>> Um I talked about this extensively in my
comic con talk last last year. Uh a game
engine is essentially hardcoded and then
if you want to add scenarios, you need
to hardcode scenarios, etc., etc. you
you'll be basically writing scenarios
for every case that you want to cover
and that's not scalable. You'll be just
writing scenarios. You'll be just hard
coding cities and hard coding roads
which is not uh really scalable for
learning how to drive. And then we also
want to not just solve self-driving but
also self robotics in general in a
general approach. So yeah, this is game
engines are are have their place.
They're good for validation, but they're
not, I would say, not scalable for for
learning how to drive a learning
robotics.
>> I mean, just to add on to on top of what
he's saying, you know, machine learning
models will do well in situations that
they're trained on, game engines, like
forget about even other other than
self-driving, simulating a road in India
and Nigeria is not something that game
engines generally focus on. Right? If
you think about GTA V, which is an
incredible game engine, it simulates uh
California driving um to I mean,
obviously there's some gamified parts
that are not realistic, but even if you
think of the whole world of GTA V, which
is a multiund million dollar project to
make, you're still only simulating LA
driving, this just doesn't scale. You
need to use real data um for
self-driving. And then obviously beyond
that, uh you know, the stuff that Eene
has been doing isn't even limited to
driving. It scales to anything. So it's
just a much better approach. Yes. So the
new approach now is to actually learn a
driving simulator from data. So the
simulator takes in previous frames and
previous actions and other things that
I'm going to talk about later and then
predicts imagines a a roll out that's
that's a video of driving. So I'm going
to show you an example of one of these
rollouts right now. It's a little slow
because it runs on my uh on my desktop.
Uh but yeah, this is one of our newest
models. This is fully imagined. Uh the
top is the FCAM, the bottom is the ECAM.
Uh so this is a very simple scenario. Uh
everything here is imagined using a uh
machine learning simulation based model.
Um so we trained these uh some time ago.
So that's it trained some time ago and
now we've been successfully training
drive-in models inside of these
simulation environments that are that
are fully learned which is very exciting
and that's what we're going to drive on
today. Uh
>> so talking about getting experimental
mode out of experimental this is exactly
all we're working towards.
>> Yes. So the idea of uh of machine
learning simulation is what what we had
what problems we had with the previous
simulation uh paradigm which is tiny
which is short uh the the small offset
simulator which we talked about in
previous comic cons too uh is that the
the simulation range is not big enough
to learn uh to learn uh recoveries
especially in longitudinal uh which is
why your models don't drive the speed
that you want on the highway. Sometimes
they don't drive too fast, sometimes
they drive too slow and they don't
recover to a good speed because they
don't have enough uh training range
where they accelerate hard enough or
they decelerate hard enough. So this
will be solved in uh in machine learning
simulation because we have essentially
infinite infinite uh infinite rollout
deviations.
>> Mhm.
>> We ready for a drive?
>> Yes.
>> All right.
>> Yeah.
>> Let's go to the car. We'll stop by for
film real quick to remind everybody
about the Fourth of July sale.
>> Sure.
>> Yeah.
>> Thesieves on the frame.
>> What's up, guys?
You guys research research patio.
>> Yeah, this is brand new.
>> Brand new research patio.
>> Oh yeah, the research the research patio
was a great project. In January we had a
sprint. Everyone in the team had goals
and if we achieved all of them, we were
going to get a nice patio and uh I mean
everyone was working super hard. I think
we were here all at 4:00 a.m. the night
before. Basically, everyone was uh
fighting to get to the deadlines. Uh and
we made it and we got our couch. Now
everyone gets to hang out in the sun.
Yeah, we are waiting for some more
furniture, I think. But it's going to be
beautiful, especially with the summer
coming up.
>> We've still been waiting on, you know,
it was a real good time fighting for
that goal. We're trying to find another
uh goal for us to to work towards. Do
you guys have any ideas?
>> Attempting to reconnect. All right,
reconnected.
>> All right,
>> I think we're back live. We're back.
We're back.
>> We're back.
>> We're back. Oh, yeah. So, uh lunch. Oh,
here we go. Man, it's
>> You guys can't smell this, but it looks
pretty good.
>> Hi. You guys are alive.
>> One of the most important parts of the
company right there.
>> Yeah, we'll go to Yeah. I was saying
we're looking for another thing we want
to put on our patio that we can work
towards. Something like hot tub, sauna.
If you guys have any ideas, let us know.
There's a
[Music]
>> park the boat there.
>> Huh? Oh, yeah. We'll
>> park the boat there. Sailboat.
All right, let's do our
little closeup.
[Music]
>> So, right here we're building the
lightning hearts we showed off recently.
This is uh some recent insourcing work
in front of
>> and then we can uh quickly just pan
around circuit spoke.
>> Okay,
>> I'll point it this way.
>> Yeah, stay same time. Okay.
>> All right. So,
this is what these lightning hearts look
like.
This is how we can get give you guys
$150 off. Um, we're continually working
to reduce the price of these guys. Um,
so we used to buy these, now we build
them, we source all these A45s, all
these components. Um, we get the best
price and then we pass those savings on
to you guys,
right? And then uh we can give a sneak
peek at harness V3 which will be
launching very soon.
>> Yes, this is the factory.
[Music]
>> Hi guys.
[Music]
>> This beautiful stack.
>> We're doing some super cap soldering.
Inserting an eim for you guys.
>> Look at all these screens we got
prepped. You guys think we're dumping 3X
stock?
>> Look at all this stuff we got.
>> Ready.
>> New products. Comma 3X forever.
All right, we're going. We're
>> People say it's laggy.
>> Laggy.
>> Is it still laggy?
>> Oh, look at all these devices going out.
>> How's it going, guys?
>> Hi.
>> Hi.
>> This is the
>> So, you buy a Comet 3X today, it'll ship
tomorrow. Fulfilled right here. Um, our
awesome fulfillment team. Um,
>> can you talk about the sale a little
bit?
>> Yeah, so $150 off for Fourth of July.
Um, the sale will go on for at least a
week. We're not sure how long it'll go
for. Uh, really just depends on stock
and how how many you guys buy. We can
turn it around and show them. Uh,
>> wait, there's so many of them.
>> Yeah.
>> All ready to go. Are these all going out
today?
>> These are going out today.
>> Oh my god.
>> These are all orders from today.
>> Crazy.
>> Okay, it's okay right now. It was laggy
for a minute, but
>> we're all good now. Cool.
>> We're streaming on an iPhone 15 Pro. Is
it 15 Pro?
>> 14 Pro. I think I have the slightly
smaller cameras.
>> It's not not sponsored.
>> Not sponsored. Sponsored.
>> Not sponsored.
>> You guys, it's really not our fault that
the streaming is so bad. It's so It's
terrible.
>> I mean, you know, it is our fault to
some degree. We take ownership here of
all the products we ship, including this
stream.
>> Um,
>> but yeah, these are all going out today.
Um, this isn't even all of them, right?
>> Yes, sir.
>> Yeah, we got a whole lot going out
today.
>> We have another probably 10.
>> But look at this. is crazy that, you
know, they managed to stay on top of
this. There's like 5 million harnesses.
>> So, there's 39 different harness
connectors that support our almost 300
unique cars.
>> Look at this. Hyundai is like,
>> half of it.
>> We just placed a massive order for
Hyundai connectors. Um, yeah, this is
what your 3X looks like right before
gets fulfilled. It's got a nice
calibration sticker. We calibrate every
screen so they look exactly the same.
Um, and then that gets taken off right
before it gets boxed up.
>> Then you got your accessories. So, buy
your Comet 3X today.
>> You can try out secret good open pilot.
You buy your device today. You install a
secret good branch.
>> I I see a question about the car height.
I'm going to talk about that when I when
we're on the drive. We're going on a
drive right now, guys. You
>> box preview.
>> You're too impatient. We're going
>> Wait, I was reading some of the other
questions, too.
>> So much impatience.
>> Oh, someone suggested a hammock for our
patio. Yeah, we thought about a hammock.
I think we might do that.
>> You don't want a hammock?
>> You don't want a hammock?
>> No. Oh,
>> that's someone who slept in a hammock.
>> Human driving did. Okay, two questions.
We're going to answer that.
>> Oh, I got about that.
>> I really selling quality of the office
with the Wi-Fi. No, this is LTE. This is
a Bloom.
>> This is AT&T, actually.
>> Oh, AT&T.
>> We have high quality stuff.
>> No, our Wi-Fi is actually really good.
We made it really good so that we can
drive the body around with no lag.
>> All right, I'll switch back.
[Music]
How many cars in your fleet? So, we've
got about 15 cars. This isn't all of
them, but uh this is about half.
>> We're going to take you guys for a drive
in the Corolla today.
>> Secret good open.
>> Do you value challenges over bounties?
Uh, no. They're valued equally. Um,
bounties are preferred for working on
the open pilot team.
How many cars got that?
Does the model work on the 3X and not
everything that works on the 3 and the
3X? It's all the same stuff. 3X is like
a refactor product.
It's easier for us to build, cheaper for
you guys.
>> Okay. So, I saw there was a question
about heights and another question about
how is human data used in the MLSim
paradigm. So the ML simulation model
what we call the dynamics model is
trained on human data and it's very
important that we have diverse human
data and diverse human human
uh and human se people driving because
that's essentially the the the
essentially the the brain of the driving
is the sim is the simulation model. So
we do use human driving data to train
the simulation model. Uh,
>> you want to prove to them? So, they're
asking, is this like a secret branch?
>> This is not a secret branch.
>> We can click in the settings. We can
show them. Let's prove it to them.
>> You could do good. Check out secret good
open by name.
>> Whoa, whoa, whoa. Do you have anything
to hide? Why aren't you showing the
people?
>> Sure.
>> Oh, this show.
>> Oh, okay. I'm driving
on the road.
>> There you go.
>> Secret
20.
>> I don't know if you guys could see that,
but it's all stock. Secret could open 20
Hz.
>> So, we're going on the highway.
Uh yeah the other question was about
height. So as I said the simulation
model is trained on human driving data
on our human fleets on our people
people's cars. So given that people have
different heights cars at different
heights
uh the simulation is aware and is
exposed to different heights. So, I
think that answers uh whoever's question
that was about about the height. So,
we're engaged right now.
Uh we're going to do a lane change.
As you can see,
it's pretty nice. It's pretty smooth.
So, this model was trained fully in
simulation. Nothing, even though a lot
of lane change, nothing was hardcoded.
Everything was learned from data.
Um, and it's pretty exciting, I think.
[Music]
Very chill.
Yeah. So, the first goal is this just
has to perform the same as the model
that's in release. And then the next
goal is making ant long a chill mode
feature and we get rid of experimental
mode.
>> Exactly. So, we're kind of focused now
on on lateral a little bit. Uh, I mean,
it's hard to disintegrate two things,
but we're basically we don't want
regressions
uh before we ship this to Master soon.
So, we're going to try to match the
performance, which we think is going to
happen soon cuz we're pretty close right
now. And uh tell them about our
constraint.
>> It has to get shipped soon.
>> It has to get shipped before October
1st. Um and then we are
technical paper, research paper that
describes how we how we train these
models. We're also working on a blog
post that's going to be published soon.
Uh
and uh yeah,
so those are those are our constraints.
Hell, do you have anything to add?
>> Uh, what do I have to add?
>> Beautiful drive. Yeah, we're going to
we're going to print the weights. Did
you mention that?
>> Oh, yeah.
>> A lot of parallel things going on here.
>> Yeah, we just we wanted something cool,
you know, if we make our goal like this
is this is such a long time coming. I
joined KA 7 years ago and this whole
goal predates
um you know, my arrival at KMA for a
long time. George wrote a paper back in
I think 2016 talking about this dream of
you know making a simulator training in
that simulator. I think theoretically it
was always an obvious idea but the
technology just wasn't there and like it
never really succeeded. But we're really
at the precipice now of shipping this
super long-term dream at a time when
other people in the research community
are coming around to this. You know
Tesla talks about similar approaches
Wave does. Uh I think people are really
seeing this is the right idea but we're
here now driving on it. So this is such
a culmination of such a long dream. So
uh we're super excited about that and
then we were trying to find some
exciting ways that when we do ship it to
users uh to kind of cement that and we
figured why not print all the weights on
paper uh in an encyclopedia book series
since this is probably the last round of
models that you can print. You know in
the future these models will be you know
if you printed them they'd be uh
thousands or millions of pages. Uh so
this is the last time it's possible.
also figured why not and maybe we'll
sell them if anyone wants to buy them.
Um,
>> all right. We got a lot of good
questions. So, let's scroll back.
Um,
>> all right. I'll take
>> Can we replace MPC2?
>> Uh, yes. In fact, this model doesn't
have any lateral MPC that we're driving
on right now.
No MPC.
>> Well, neither does one in the release.
>> Well, the one in the release, we moved
the MPC kind of in the back end. So it's
still somewhat exists in the model has
like a block that that serves as an NPC
block, but this model doesn't have
anything else that resembles the NBC
MPC, which is really cool. So it's all
it's all trained end to end. No hard
coding. So whatsoever
you put your seat belt on.
>> I don't know if this is the right exit.
Actually,
>> it's a very it's very pretty cramped
back here.
>> All right,
>> it's a small car.
>> All right, let's see what else. Got a
lot of questions. So, they want to know
why was it 5 FPS at first?
>> So, um
currently we're somewhat compute
constrained with these models because
they take a long time to roll out the
dynamics models, the the simulation
models. So we trained them in 5 fps in
order to generate longer rollouts and
without generating so many frames. Um so
it takes some time to generate one frame
and you can imagine if you want 10
seconds of roll out you would need a lot
more frames at 20 fps than 5 fps. So
that's what we did. We trained them at 5
fps and we still do. Uh it's just that
now we have a a trick to be able to use
them in inference in inference time.
Harold came up with this trick that
basically strides the history of the of
of the model to be able to be used at 20
at any FPS, even if it was strained at 5
FPS.
>> Seen's got a seat belt on. There's no
custom code here,
>> guys.
>> We're not running a a weird branch that
isn't public just to not put our seat
belts on.
>> I love my seat belts.
>> Um, also, it's super inconvenient for us
to set up anything that isn't a public
branch. So,
>> yeah, we talk about why it's called
Secret Good Open Pilot.
Oh, they have a question I don't want to
forget about first. Uh, what happened to
NAV?
>> You want to answer that?
>> Yeah, sure. Uh, Nav, you know, we did
Nav to do Taco Bell. That was kind of
the vision of uh, you know, the whole
trifecta of parts end to end lateral,
end to end longitudinal and then NAV.
But when we started writing Nav to get
it to work, we ended up writing so many
hacks to deal with the fact that the
simulation was poor quality, which led
to issues around exits that we had to
put a lot of effort into fixing and it
became really hard to maintain because
there was so much added complexity. And
so we just realized that you know we
have to ship the new simulator before
NAV will ever be good and making changes
with the whole navstack in uh you know
in the training stack is really hard. It
it just adds so many steps to every
validation procedure, adds so much
infrastructure that needs to be
maintained and we want to deliver, you
know, these this new architecture as
quickly as possible because it's just
the best way open pilot will get better.
So, we removed it. We'll add it back
once nav is a majority source of
disengagements.
>> I mean, yeah, you guys saw everybody was
asking about experimental mode and chill
mode. Um, they weren't asking about nav
for the most part.
>> So, that's where most of the value is
right now. I mean, Nav is cool, but it
was getting in the way of something more
more important, which is shipping this,
which will make the experience better
100% of the time instead of only when
using nav. This will makes the
experience better on highways, on city
streets,
>> on all sorts of subtle ways. I just
drove up to San Francisco and back and
most of my complaints were longitudinal
and like fairly subtle. Um, it'll make
cutins really smooth approaching like
slower traffic. It'll make all this
stuff really good.
the same stuff lane list does for you
where you go between intersections. Um
it'll it'll be like that for launch.
>> So we're engaged right now. We're in
we're in experimental mode. We're very
excited about these simulation models
because essentially it'll be in a state
where it's unbounded where it's only
data in retrain the model make the model
bit make the simulation model bigger and
better uh make the driving model bigger
and better. And uh look at that. It's
keeping it clear. Well, it's not really
keeping it clear. It tried. It tried. Um
but yeah, uh we're very excited about
this state where we're not bottlenecked
by something. We're not bottlenecked by
some uh some unperfect some imperfect
simulation uh environments that we have
to go around and make the model crappy
to be able to to deliver.
>> If you get rid of chill mode speed, it
has to be perfect. We're all on the same
page about this. Um the goal is to
deliver something that is strictly
better.
I mean, when have we shipped you guys
something that's worse to release?
>> I'm sure they have some answers to that
on this one intersection on my commute.
>> Um, yeah, I also want to answer one
question. They were talking about
liability.
Um, someone asked who is liable. We're
making level two systems. I think we're
extremely transparent about that. Yen is
driving. Yen is in charge of the safety
of the car. Uh, you know, this is a
driver aid. It makes driving more
comfortable and more enjoyable. Uh
safety is in the hands of the driver and
that's not going to change anytime soon.
>> Look at this. You guys
>> look at it go. Look at
>> So without end to end long, you would
see this thing where like it tries to
speed up as it loses the lead. Um so
this automatically slowed down
>> and look at how we speed up for the
highway.
It's beautiful. There's some cars next
to me, so I have to
>> Can we still have nav back as a toggle
option? Uh, no. So, that's the whole
point, right? Um, it being in release
and in open pilot master means we have
to guarantee some quality around it. Um,
and there is some friction to improving
all this other core functionality we
want to ship. Um, which is why it's
removed, but it will come back.
What's the P Comma Prime now with no
nav? It's for dash cam features. um
solving self-driving. These things don't
really they're not related, right? We're
very serious about solving self-driving.
Um but we're not we're not looking to
ship you a robo taxi service. Um we want
to solve the problem and then we're
going to move on to more general
robotics. People talk about this
liability stuff and like, oh, you know,
why are you trying to solve self-driving
cars but not dealing with that? We're
three engineers. This company is almost
exclusively engineers. We're only
interested in building technical
solutions. Along the way, we want to
ship you useful products, but we have
zero interest in building a legal team
to be able to take liability and find
areas in which it's reliable enough or
like have an insurance policy. This
stuff just does not interest us. We're
an engineering team. We make engineering
solutions and we try to sell you
products uh that, you know, are useful
and don't, you know, don't have any any
implications on safety that are uh that
you have to worry about. It's just the
driver aid. This is what we do.
>> No more stopping at the red. No, no. So,
it still does that. That had nothing to
do with NA. That's all at longitude
though.
[Music]
>> So, there was a question on Twitter I
saw last last night about how we use
these dynamics models, the simulation
models to train policies. Uh so we what
we came up with is this uh architecture
that not only predicts a video not only
simulates a video but also simulates a
trajectory and we use that trajectory
essentially to train the policy model
that is uh driving the car right now. So
the dynamics model simulation model is
both a video simulation model but also a
trajectory simulation model and we use
these uh the we use this model as a some
kind of a teacher uh to to train a
smaller model that runs on the car. Uh
but we will write a blog we're currently
writing a blog post about this. uh is
going to be very detailed and we're
going to talk about how this this works
in detail and we are also going to write
a research paper when this is shipped.
Very exciting.
So there's also a lot of questions about
whether this is vision only. Uh so what
we're driving on right now is the end to
end models are all vision only but there
is still a policy that if the lead is
very close
is basically the most aggressive uh
setting of of stock open pilot that
radar lead policy is still there as a
stop gap but uh everything related to
what the model outputs is end to end and
as you can see uh you know in these
drives when there's no lead and stuff
like nothing dramatic happens uh as it
switches over to vision policy because
the vision only actually works pretty
Well, um, so yeah, we're hoping to ship
this on on radarless cars as well. I
expect that to go fine once these models
are pretty good.
>> It's very nice.
>> How much does performance degrade with
high speed?
>> Um, what do you mean degrade at high
speed? It doesn't generally what's the
high speed?
>> I don't know.
>> Yeah, I don't know. It's generally
>> performance is not really dependent on
speed. Um, in general, actually, most
cars just offer you lower torque at low
speeds, but that's a car limitation.
Nothing to open pilot.
>> Guy keeps asking about VS slam. I don't
know if that's a particular slam or if
that's just slam in general.
>> I don't know. Vision slam. I don't know.
>> He keeps asking, we should just
>> slam. No, everything's learned. We learn
things. Everything's learned from data.
>> We're lazy. We like to just learn it
from data.
>> Yeah, we have a localization algorithm
that, you know, is a prerequisite for a
lot of this stuff. Uh, it's relatively
classical. It's called MSEKF. We've
talked about it a lot before. That stuff
hasn't changed in years. That's
something we wrote like 5 years ago and
has been incredibly stable. There really
isn't anything better out there. So, um,
yeah. I don't know. That stuff's all
classical, but it's only used for
localization. We don't actually do slam.
It's just localization.
>> Oh, Harold, I got a good question for
you. Will the car take advantage of
engine brake and coasting region?
>> Oh, yeah. That's something uh we
recently came up with that I've been
very passionate about. So
we were thinking about what is the right
API for the policy to communicate with
the car and for lateral we just have
curvature right which is uh just the
angle of the of the turn and so for
longitudinal acceleration has this
problem that you know it doesn't capture
when you want to coast when you want to
break you people get very annoyed when
you press the brakes when a human
wouldn't uh so I think the right the
right idea for the API is you tell it
when you want to stop you tell it when
you want to press the gas when you want
to press the brake and then how much you
want to accel accelerate and decelerate.
And so we're working on that now and
we're trying to shift that soon. So the
model will decide this is an appropriate
time to press the brakes. This is an
appropriate time to press the gas pedal.
And so then that should uh enable
coasting behavior and we want to shift
that directly to master.
>> So someone is asking about red lights.
Red lights still work. We're going to
approach one right now.
>> This is a end to end red light. Hey, you
notice how it stopped for that car that
was cutting in poor lane
>> and it's going for the green end to end.
Nowhere in the code base is talk about
traffic lights.
>> Describe the future of experimental
mode. It will not be experimental mode.
That's the future. So, we will not be
shipping any more models to Open Pilot
Master um that are not trained in this
new simulator. We're committed to the
future. Um we want that to be October.
Um, but if it goes beyond that, we're
not going to compromise the future of
Open Pilot to ship you some
incrementally improved models.
What is the size of the current install
base? Um, so we have about 5,000 daily
activives um and then quite a few more
um weekly and monthly activives.
How do you learn inside of the ML
simulation? I mean, we kind of talked
about this.
>> So, we talked about it. We the ML
simulation is not only uh generating
frames but it also generates
trajectories and what we call a plan. We
use that plan uh to to learn a policy
model, a student model inside of inside
of simulation. Basically that's how it
works.
You want to do a little bit of city
drive. City drive we do a stop sign
right here. Is there a stop sign here?
>> Yeah, right up ahead.
>> Oh,
>> yeah. See, even you seem couldn't see
it, but because this is end to end, the
models are driving too fast. It knows it
maybe should expect a stop sign coming
up just like you would. If I order now
in October, there will be an update. Uh
we hope October, you know, this is uh
see it.
>> I didn't see it. All right. Um but yeah,
in like a conventional ACC system, this
would have just gone straight to your
max speed of like 65 70 mph. Um, so it's
always doing something that's like
somewhat in distribution for what you're
um it's not doing something that's like
totally crazy for the situation.
>> Yeah.
>> Um, but yeah, October is the goal. Um,
but this is very bleeding edge stuff.
Um, this is something very very new.
>> I did stop sign.
>> Okay. Yeah, I saw this one. Let's go.
What data do you use to train the model?
Um, data from our users
>> stops for the for the pedestrian. Look
at that. Beautiful.
>> Uh, yeah, we only stop open pilot.
This is like, you know, if you have a a
jailbroken iPhone, Apple doesn't look at
your crash statistics or anything. They
don't care.
Given a car such good steering, what is
the limiting factor on getting parody
with um Yeah, we first have to ship this
new ML simulator. Um and then we can do
a whole lot more things. Um like our old
simulator just really didn't support
doing turns.
>> Yeah. So, the idea is to when when when
we ship this, we need to scale this up.
uh scale the simulator up, scale the
policy up, scale the data set up and I
think uh when we do we do all these
things correctly uh we will have
incredible performance on a highway on
city streets on on parkways. So um yeah
given sufficient torque it should be
able to do turns pretty well. It's
already already seems like that the
turns are significantly better on this
model. Um, but yeah, the what's needed
is is scaling up the the the models.
>> Someone asked about do we benchmark
against FSD? No. Again, we we have a
problem we're trying to solve. If FSD
was really great and then the next race
sucks, this has like there's no
counterfactual here, right? It's the
exact same scenario. We're we're moving
as fast as we can. Um, you know, we just
have some very real engineering problems
to tackle and this takes time. We're
very honest about the problems we solve.
Um, and this is largely the the appeal
of working here.
>> If you like just solving problems,
um, it's probably a good fit
using OSM data to predict. Uh, no, you
don't use mapping data when you're
driving, right?
Your map doesn't tell you like, hey,
there's a there's a stop sign up ahead.
Be careful.
There's
>> any interesting questions. Does that
mean there's some kind of new hardware
coming out? No, no, this is all this is
a comma 3X, guys. Um, stock, 3X, comma 3
is exact same as a 3X. Um,
pedestrian, yes, ped pedestrian and
obstruction detection will all be end to
end. Um, we have very little interest in
doing anything that isn't end to end.
>> We can head back to the patio and do the
final Q&A.
>> Yeah, let's do it.
[Music]
might be too.
>> Maybe we want to go inside. Let's see
how this
>> uh we can see. Yeah, I don't know. I
keep getting distracted by the phone
trying to check for questions. Um but
there's a couple more things that I want
to mention about uh about Secret Pilot
when we're upstairs.
Um, somebody's asking about high school
internships. If you can do our
challenges, this is literally the
definition of what we look for. Um,
>> yeah, we do not discriminate on age on
>> There's been a couple people we can't
hire due to like, you know, we couldn't
hire somebody from Russia or something
one time or North Korea.
>> Yeah, even on immigration, we do
absolutely everything that we can. You
know, sometimes there's there's
impossible things, but uh, most of the
time we do whatever we can.
[Music]
So,
>> um, yeah, what I wanted to mention about
Secret Good Open Pilot,
>> uh, the reason it's
>> the reason it's called Secret Good Open
Pilot is for a long time there was this
meme in the community that we were
testing out branches that were so much
better and like we were just not I don't
know telling people about it or
something. But
[Music]
>> the mic is
>> Oh,
we're gonna flip the mic for a second.
Just a minute.
There you go. I just want to read your
questions.
Watch out. Watch out. Watch out.
Touching the screen. Okay.
But yeah, the reality is that everything
that we've driven on over the last like
5 years has been a publicly available
branch. Um, so that's why we called it
that. There is no secrets. Everything
we've tested, you guys have had access
to. We don't we don't really, you know,
want to keep things internal. A lot of
times it's just not interesting. There's
nothing really for interesting to see.
But just so you guys know, you know, if
you want to see what we're up to, if
it's not in a public branch, means we're
not driving on it. So that's that's kind
of always a good benchmark of what we're
doing.
Uh
let's see what else is there.
So, I don't know why there's still
ambiguity around solving self-driving
cars. Um, we want like a very general
solution to solving self-driving cars.
We want to build an agent essentially.
We describe this pretty well in the talk
blog post. I'd recommend reading that if
you haven't um in Harold's blog post
from like four years ago or something.
>> Yeah.
>> Um, but yeah, we want to ship some
software that can uh drive you most of
the time. It clearly doesn't do that
right now. Um, other than that, we, you
know, robo taxis, anything else, we just
want to, we want to ship you a comma
body in your house after that. That's
the real the real thing we want to ship
you. In the meantime, we'll ship you
little devices to put in your car.
We need better documentation. We're
working on that right now. There's a
good bounty out. Um, we're going to just
copy the rerun documents because I
really like them. Um, we're working on
like exposing a good road map for the
things the community can work on. The
bounties um I think have been very
successful in
um kind of exposing what's important for
us to work on right now. Um are you guys
planning on incorporating text into the
text?
>> No, we're not planning to do that. We're
trying to do things end to end. Uh if by
text you mean text from the road signs,
uh we're not planning to do that. We're
not planning to do a chat GPT either.
So, uh, no, we're not we're not
interested in in in that that kind of
explanation
quote quote explanation quote models.
So, no, end to end image from from video
from from uh from uh photons from
photons to acceleration and steering
from video.
>> Yes.
>> Not quite photon.
>> Not quite photons.
>> Yeah, we're working on some like pretty
major refactors to the car stuff. I
would expect in about two months this
stuff to be in like a completely
different state. Um, essentially the
goal is to pull all the car interfacing
code out into its own repo and its whole
job is to be like a Python API for your
car and that is a repo that can be very
much finished for a lot of cars. The
architecture will be very simple. Um,
then you don't have to understand
anything about how open pilot works. Um,
we'll have some really great docs. I
would say in about 2 months that should
be in like a very very good state. Um,
>> question.
Yeah. if if comi/job look at the
challenges. Uh if you're interested,
check it check them out. Um yeah, if you
think you're a good fit, welcome to try
it out.
>> No, so that's the cool thing. We don't
need to be open to it. You can just sell
it. It'll work with, you know, have a
fork or pretend to be another car and it
just works with stock open pilot. That's
up to you if you want to make something
like that. Um we have no interest in
these cars that just don't that don't
work. There's enough of them where we
support 300 cars right now that are like
a pretty good open pilot experience and
a good fraction of those like all the
modern Hyundai and Toyotas are very very
capable and can do the Taco Bell drive.
Um so it's enough cars where we don't
need things like the compet
um we don't care about bringing every
car along for the full open pilot
experience. We we don't care about that
at all.
>> So there's a question about how the
model recognizes a stoplight from a
distance. The model actually inside of
the model there is some recognition. So
the the model understands where the stop
stop light is. It doesn't do that
explicitly. It is just trained to mimic
to do as what humans human drivers do.
So what what would you how would you
recognize a stop light? Well, you see
the stop light and then when you see the
stop light, you try to slow down and
that that's what the model is trained to
do. And then internally obviously it
learns what a stop light is and what a
stop sign is and all those things. But
yeah, it just tries to mimic human
driving data. Um
uh yeah, no no hard coding of stop
lights and stop signs. Size of the model
that we use today, same size as before.
I don't have it on top of my head. The
simulator, I know exactly how many how
many parameters. It's about 400 million
parameters. It's a small smallish model.
Uh we're planning to make it bigger
soon.
>> Yeah. I mean, this stuff will all get
better. right now. I mean, we should
tell them how crappy tiny sin is for
launch.
>> Uh, slow. Okay, there's a question that
it doesn't slow down until it sees the
red light. Uh, I mean, we have to see it
to slow down, right?
>> Shouldn't be part of your vocab. We're
very honest about what our priorities
are. Um, it's open source. Um, people
can build off what we do. Um, it's very
important to us that people can do that.
Um, but, you know, we're not like media
trained. The the most professional thing
we've done is, you know, we got a camera
rig so we can have a stable video. Um
otherwise it's very like raw and uh it's
a very raw look into how things work
here.
>> Yeah, people are asking what should we
expect by October. I mean our goal is
just to ship the new architecture and to
not have any regressions. Uh the first
priority is that after that it will
improve quickly but we just really need
to move to the new architecture. I mean
the real power of this architecture is
that we're not hand coding anything. You
know, it's basically only Yin working on
the simulation models and even Yin is
not writing anything that is particular
to driving. Like we're just writing
generic machine learning solutions and
they just happen to solve these problems
pretty well. Um so that's moving to that
is so powerful. We don't have anything
handcoded about cars, about lane lines,
anything like that, which we did to some
extent before with the with our previous
simulation strategy. We had, you know,
assumptions about roads. We had
assumptions about the distance of cars,
all that sort of stuff. But so all of
that is gone now. And so if we can ship
that without regressions, uh, that sets
us up really well for improvement soon.
>> You don't say that to customers. Uh,
it's okay.
>> Okay. Um, let's let's not argue. Uh,
>> speak with say his username.
>> There is a question about comma. Uh,
shipping a small training example. Yes.
Uh, we can do that when we have time. We
actually did that for some examples like
comma vq is a small data set where you
can train a model. Uh comma 2k19 is also
a small data set where you can train
models. The steering data set is also a
small data set. So we do have some open
data sets where you can actually train
models to to experiment with and then
come up with interesting ideas that we
can then if if we like them and if they
they are if they are uh if if they look
promising we can we can scale them up
and uh and use them in our training
stack.
How many new versions? Um I mean it's
not like we have a road map for this or
anything. As many as as we can ship to
it. Um, I mean, we showed you guys the
open pilot fleet right now. Um, the
official fleet. Did you see any other
hardware in there? Um, common 3X's uh
will be around for a long, long time.
Train on fork data like to configure.
Well, fork data, yeah, it really
depends. Uh, the problem with forks is
that they they alter our logging, you
know, logging infrastructure. So, we
can't really parse their data. Um,
>> it's like using a jail. You wouldn't
take a jailbroken iPhone to the Genius
Bar. It's the same thing.
>> Yeah, we would like to, but uh it's hard
to do.
>> Going to try to have a bigger presence
in Europe. We sell internationally.
How many users in Europe? Probably like
a thousand, maybe
500.
>> Some questions about external GPUs. that
will probably come soon when we start
when we ship these MLSM models and then
we uh scale them up and scale the
driving models as well. Um when that
happens, I'm assuming in the next year
or two we will start needing bigger
GPUs.
[Music]
Ever try out Mat Lab to train dynam deep
learning models? No.
>> Anybody buy a 3X yet with the sale?
Anybody want to try out secret good open
pilot
credit the best forks? I mean yeah the
forks are great. Sunny uh pushes a lot
of stuff upstream. Um forks are great
inspiration for us. So um
[Music]
hope
I mean these new models will improve the
thing for every car. Um it's not really
specific to any given car. Um
>> Oh someone bought boo.
>> Yes. GG.
Oh, we can pick one random person who
buys and then show we can uh we'll post
our segment in Discord.
>> Do you guys want
>> Thanks, Grant.
>> What kind of timelines do you guys want?
We don't really have timelines. Um
>> we've kept saying October. That's the
only timeline that matters.
>> Yes.
Before the free hat announcement.
>> I think we're running out of questions
here.
Yes.
>> Oh yeah, I probably want to work with
your 2011 Nissan.
>> What will a new ML engineer hire Bas to
do on the today? Yeah. So work on the
machine learning infrastructure. The
machine learning training code really is
as as Harold said, it's it's pretty
standard. It's uh very agnostic to
driving or to anything. In fact, we kind
of ported our I mean simulation stack
our simulation solution to the body to
the comma body and it just worked and it
was doing loops around the office really
nicely. So yeah, it's standard machine
learning learning diffusion models,
learning GPTs,
uh training, you know, uh policy models,
uh yeah, writing machine learning code,
infrastructure.
Yeah. So just 99% or 95% of what we do
in in our team is infrastructure and
testing work. uh you know it's fun to
think about machine learning
architectures and dropout and batch norm
and all that stuff but realistically uh
the hard work is making sure the GPUs
are running stably that the machine's
not crashing that it's easy to start
training jobs it's easy to stop training
jobs that's easy to track training jobs
uh and actually knowing how well the
models perform 95% of what we do works
most more than anyone else on these
actual models and even his time is spent
majority on infrastructure uh and all
that stuff that's just the reality of
machine learning. Having stable tools
and having good infrastructure is the
only way to make things work and that
it's what everyone in our team does.
>> Yeah. And outside of our team too, you
can see in most, you know, most research
labs, you we don't want to be in a state
where like it takes you a week or two to
set up an experiment. You want to make
your experimentation
environment easy. You want to make your
testing easy. How you train a new model
now? So what? How do you know if it's
better or not? You need to write good
tests. You need to trust your tests. You
need to make them fast. You need to make
them run in the loop. Uh you need to
make your training fast. So yeah, a lot
of uh a lot of infrastructure. It's fun.
>> Uh there's good question about uh well
do you guys feel constrained by hardware
at all?
>> No.
>> No, not yet.
I mean, it's worth trying in that it's
really cool. Um, that it performs very
similarly. Um, if you're not going to
have fun with that, then it's probably
not worth trying right now. But it is a
massive milestone that you can have a
green connect timeline with like no
overrides. Um, that is a huge milestone
we've been working towards for like what
year, a year and a half.
>> Yeah. There's another question about
depth. Do we use depth? Uh, well, with
these uh MLS models, we don't we do not
use depth anymore. depth is learned end
to end by the GPT.
>> Somebody asked about lightning hard
reliability. Um so that's the new SOM we
started shipping um about a month ago.
So we've shipped many many hundreds. Not
a single one has come back yet. Um
common 3Xs are incredibly reliable.
Any plan for Mercedes? Again, we don't
really have plans for cars. Um our next
car though will be a Lexus ES. That is
our new demo car. If anybody's got any
thoughts on that, what model year we
should get, what trim or something, if
anybody's got tips, post them in
Discord.
>> Do we There was a question about using
disengagement signals uh to train the
model. We do not do that yet, but we are
planning to do that after we we ship
these models.
>> You can talk a little about model
testing.
>> Oh yeah, the testing. Yeah, we do use
them for testing and and for, you know,
the disengagement analysis.
>> No, no, they're just talking in general.
How do you you know, we train a new
model. How do you know it's good? Well,
we have a whole suite of tests. We have
uh many many metrics that run on on a
test set of about 2,000 minutes of
driving. Uh we we have so these are off
policy tests on policy tests as well on
real data using a simulator and also
using a classical simulator. We have
some unit tests. The classical simulator
that we use is uh now metad. uh we have
uh we have a list of unit tests that we
do that we use to basically see if
there's anything clearly broken in the
model. But uh the performance is is is
monitored using real data and off and on
policy driving on about 2,000 minutes of
driving. This these tests run in the
loop while we while we drive while we
train and then we can see if our metrics
go down, go up, go down and that's it.
>> Yeah. Yeah. So, they're like N10 tests
that test very specific units of
driving.
What is the benefit upgrading from C3 to
C3X? Um, it's probably not worth the
upgrade. Um, it's more for new users get
a cheaper device. Um, it's a little more
reliable. The sounds are a lot better.
So, Harold was very passionate drove
that. Um,
that's probably the biggest difference.
>> So, there are someone someone asked if
these tests are in the open pilot
repository. not the test that I talked
about, but there are other tests in the
open pilot repository and I know that
they're working on the metad
>> loop. We got a cool thing. So yeah, open
pilot now has a test as of maybe a month
ago. Shout out to Bong Buy who wrote
that um that drives a loop in Metad. So
it spins up the whole Open Pilot stack,
drives a loop and ensures that you know
nothing is critically broken open. That
could be like the params learner, the
localizer, the model running the mo the
driving model itself. Um so that is a
super super cool endto-end test for the
whole stack. Uh what we want to do now
is get that posted in every PR. We'll
post the uh like what the UI would have
looked like. Um imagine you had your
Comet 3X driving there. It'll just be
that same UI and it'll be posted as a
comment to your PR. Um we got a bunch of
cool ideas like that that will be
rolling out soon.
We uh Maxim Maxim didn't show up here,
but um he just started he was an Open
Pilot intern for the last couple
summers. Um he's very excited about
making the Open Pilot development
experience super fun for you guys. Um,
data connection required. Nope. All
local.
>> Someone keeps asking about DAM blind
spot monitoring and not just lane
chains. It's just so not like in line
with the critical improvements that
we're working on. Like we're not against
that sort of stuff, but we have way more
important stuff to worry about right
now. We want to ship these new
architecture of models as soon as
possible and then we're going to work on
improving the longitudinal performance.
The biggest priority that we want to fix
is we want you to engage on experimental
mode on the highway and have a better
time than you would without it. Uh that
is by far our biggest priority and what
to whatever extent we can we put all of
our effort into.
>> Yes. Then when we're done with that,
we'll move to the things that you just
asked about like that like the decam or
nav things like that.
>> Uh yeah, harnesses are currently
handmade and the connectors are
extremely expensive. Um we're working on
fixing that right now actually.
U been in the UK only got the road
secret. Thanks.
>> Yeah, it's pretty cool. It's like a new
power, right? It's a completely
different way to drive. Um
[Music]
>> all right, I think we we're cycling
through the questions now.
>> No, we're not going to do an 88 event.
Um I think we'll take one more good
question and we'll call it a day.
>> Last question, you guys.
Also, if you join the Discord, there's a
special code that gets you a free hat
with your $150 off of Comma 3X.
[Music]
Anything new about the Kama data center?
Well, there's some exciting things. Yes,
we're trying to uh expand it to be able
to train bigger models uh and to uh to
use to use these new bigger dynamics
models. So, yeah, very excited about the
new comma not a data center
>> compute cluster.
>> Compute cluster.
>> All right, cool. Let's call it a day
then. So, reminder about uh July 4th
sale. Um that's just while supplies
last. Um they're flying off the shelves
right now. You guys saw fulfillment. Um
and then we're hiring. If you want to
help build the future of Open Pilot,
there's lots of good work to still be
doing. Um, so super simple hiring
process, challenge, couple phone calls,
and then, um, it's paid on-site work.
Um, and it's like a mutual thing. You
get to see if you like working here. Um,
it's a pretty cool thing.
>> Yeah, maybe in Discord. Yeah, if you
haven't joined Discord recently too, we
did some pretty big refactors, so if you
want to just play around with Open Pilot
and stuff, um, we're working really hard
on this. There's some really great
development channels. Um, we deleted our
devop pilot internal Slack channel. Um,
so it's all public on Discord now. Um,
yeah.
>> And you guys, we're super excited about
MLS driving. I hope you all are. This is
really the future of open pallet, the
future of robotics. Uh, and uh, we're
really excited to deliver on this as
soon as possible. We're going to be the
first. You'll see. No, we'll be the
first to ship. All right.
>> All right. See you guys. Bye.
we're live with live vanilla gorilla
hello guys we're in Shanley Honda guys
hey we shout out to that person on
Twitter that told us where to go to find
a way mouth we just drove up and down
railroad for five minutes we found one
more like that
Wow Victor yeah this is totally visible
in the rear view mirror though yes
definitely reducing our lifespan until
the cops come the cops might come yeah
we might all end up to jail and we might
finish the finish carving Jamie yeah am
I gonna give up YouTube I hear when we
go to jail was that at least we want you
to fly yeah I were just gonna follow it
I didn't know they were hybrid they are
hybrid yes you can't have the future
without 38k why would the cops come
because some journalists followed a
conway mo for like two hours and the
cops came I saw what I saw they like
came
so we've tried to be low profile yeah we
have it this is such a power it's like
kind of residential we found a way took
away the one program this is way about 8
to10
you see on we are using again aren't you
and his rotary and he's not yes he is
but he is able to well you hit the way
no no we got to be under the radar here
yeah we wanna we want to slow the
profile but do you think they're
autonomous right now
hard to say oh it must be now they must
be yeah seems like this is like a that
hard no we haven't been a passenger in a
way mode they have it's like very
exclusive who allows is allowed to be a
passenger it's not just anyone you have
to sign an NDA you have to be a
volunteer so I think they have you go
through some I don't know some training
to be a passenger I have to sign an NDA
yeah not anymore seriously chastised the
drivers felt like a huge screen in front
of him they're gonna have to merge left
if we call the cops
we're not doing anything about they
fooled that rights you know they they
stopped it they change their mind
we following option now I'm taking over
Oh Eddie's say you know we can't do this
but they're just pulling over
because we're gonna go find them again
we're just gonna say we really need to
follow them
[Music]
[Laughter]
I mean we picked them up when they were
shopping that was the there's a lot of
McDonald's in the world there's like one
way mo that we've seen in Arizona all
right here we go
low profile up four above I mean we do
want to go right the only way you can go
is right so it's not she's wearing a
Santa hat oh that's so lovely
oh yeah honestly I do feel really bad
for the driver because I'd be a little
worried they'd be sketched out
especially with what's been going on
cancer Jesus Carol watch your language
Ron periscope oh my got two of them this
is amazing
we go to the left or that's gonna left
yeah let's let's wait okay okay okay I'm
just gonna slowly put my camera there so
take a look you guys you didn't see
anything
yeah should i film the more sketchy so
you have a very set like us the woman is
just way to us I think oh really
I'm not sure either way you know at some
point they're gonna have to embrace it
okay what are we doing why are we are we
just going next to them yeah no I can
get in the right leg
I mean we can say okay let me let me
film from the side then right what's the
fear right
they turned okay they're not coming I
don't see them but the other ones not
the other ones behind us no that's a bad
turn yeah where is it terrible
no way they can see them all right this
is silly
we're gonna get a restraining order for
them to not be within 500 feet we're
leaving very low-profile guys I don't
think they don't very fine okay why
don't why did we get so far away all
right I can make it slow down but this
is the same one I wanted to finally pull
over
come on yeah I can we flew a moment full
oh no the one behind us is the newer oh
I think they knew almost one in front
okay that's far away here we got a right
lane I can go super slowly okay yeah
just go super so
you can try to YouTube live no one goes
there so what said literally the worst
streaming service you guys could have
chosen that's
we can turn again and wait for it all we
find a new one what do we get milkshakes
shake yeah yeah we I mean wouldn't this
be so much more fun with milkshakes it
would feel more like this you look at
them in the eye and stuff your milkshake
yeah we also said we working on YouTube
live and I just directly went to
periscope I didn't even think about it
but you then Google will know where we
are that's why we can't that's what
we're using Apple maps people think
about it goes really slow in Arizona
guys like I can easily use my San
Francisco aggressive driving yeah you
laugh there's no problem well but they
have no traffic that's why right
yeah there's big looking but just floor
it and it tastes like it takes like a
second and a half yeah okay let's find
this waiver well because the tubule
works like I said up there yeah I guess
it also shifts slow yes yeah like the
Civic because of the CVT
[Music]
I got them engage open piloted sport
mode cool engage about sport mode here
we go how fun is that away no on an open
pilot don't be friends
yeah we're gonna have Chrysler supports
the Pacific or it drew is working yes
we're actually gonna support the guys
that we wait up in pilot yeah so drew
hits on a fun project I'm gonna do over
the holiday actually I mean I think we
should buy a minivan we don't have any
like more than five persons either
coming down and we rented positive there
today
I'll see if you can and then we are
gonna buy a Fiat 500x okay I was being
no you were just because it's Italian no
he also likes it okie does I do like
because he's Italian like he's like a
five-seater cars he said you know we
haven't been arrested yeah
about for a few cars we're trying to
remain not really well I
[Music]
everyone goes the speed limit and
Chandler why are we following huevos
because we have tourists you know
something what's the best feature for a
step and we are in traveling space and
you walk using a space that was like a
drug like I just broke randomly I mean
it had its brakes applied yeah that's
super picky about driving yeah yeah yeah
oh it's breaking for no reason great you
know why break the flow it I think
there's been maybe these 45 Americans
have a slightly fun look at exactly
might be going at 44 yeah white really
have been accurate although either
that's you have terrible those glasses
so they probably have to break when they
go faster than 45
oh you think gosh I would get so sick in
that part I'm breaking for this guy's
turning
sport
see there's always yeah the woman
doesn't even know where if he must get
followed all the time let's see if there
yeah I wonder if they always turn your
hands are on the wheel but definitely
driving she's just a really good safety
driver maybe we should give it a
shout-out to her as a safety they have
to keep their hands in
they're driving its own thing you know
those conspiracy theories that they say
it something doesn't happen something
everybody in the case of way more wine
it's actually true yeah it doesn't
excuse now do you think they'll be out
of business in five years do you agree
with my opinion it's a little
concessions
going down it's also possible that they
have a policy if they're being filmed
you should take over because they just
slow down to lose us we stopped next to
there's not a school unlike a
residential street like they definitely
know we were falling how do they know we
stopped next we stopped them into they
could but we were like two cars away no
no now but we've been following this
same car for sure yeah oh yeah they know
but then they didn't know
for why intentionally well guys they're
good these are going to everything you
say about two men driving a few years
it's just going to go the way of like
Google Fiber we should have driven s
them Eddie and you should have like put
both your hands like hey speed away real
quick I mean we could probably go back
you want to find McDonald or even like
something better do we want something
better than I take a better ricardo
loves Denny's who would have thought ok
yeah yeah
but that's Dave minutes we really should
have done that next to a way Moe what a
bummer
sorry guys no no I just thought about it
don't be sorry Eddie you did a wonderful
job finding that way no yeah yeah and
not getting us arrested yes it's fine we
can try I'm okay trying it for once
record are you sure it let's feel like
that was a lot of effort for users have
an open mind it was I was I tried
fighting in shakes it wasn't pin mine
have you tried in and out I guess
maybe we'll see another wave on the way
I'm still got 40 viewers Wow
I know people like the exciting what's
exciting I'm sorry we didn't follow
close I got this one that makes a movie
in very rude
so you okay yeah cool they're gonna find
out that way yeah and then Eddie just do
the hands up and then we'll call it a
time okay okay super cool oh all do
hands up
anyway mo bro down the way that roll
down the windows
right
it's pretty lame an update on what I
think they said HD maps should we talk
about their tweet we sleeping tonight
did you guys see the top like a counter
that counts down and every 30 seconds is
somebody but the thing about like I was
discussing this in the present like in
the little spoiler for people that are
still gonna I watch us and follow us on
the tour but like one thing one guy
asked a pretty good question about like
safety and I said how important is
safety for society cares it's very
important but when you think about still
driving like before you cannot compare
safety to to any other like average
driving you have to compare safety to
services that provide the same type of
service that car level 4 provides you so
when you take like a better car when you
take like public transportation the
level of safety is actually a lot higher
than the average driving so engage
it's not gonna be fair coming with the
average that I wear when you talk about
safety for level four yeah yeah just
because that because they're like a real
skilled driver like what are the tips
well you sound like what is driving you
somewhere well he's gonna like doing a
better job than what probably would do
if he's trying to buy himself yeah he's
getting worried job right people do
better and public transportation like
two trains right right super well I was
on the Muni though we hit a car and then
we had to stop and get out and wait for
the safety officer because we're on the
road on the end so like all of the
trains are backed up no one can get by
the car was fine we just like tapped on
the card room and let's go to hell for
trains it's great
I don't know how we hit a car but they
went away those terrible training
spirits are off there so just drive away
that wasn't even anything oh by the way
wave with it is not like we're driving
these are two faster oh yeah well it
full electric yeah I guess yeah by an
old otezla play of the pilot and
community are doing a super good job in
porting of the pilot to pre out the
pilot test
generous to me that his friend put it on
the boat with a bead oh oh really
[Music]
yeah you said they don't have a CC they
don't have never model a basis they can
ultimately break there is not as much
thank you Harold's still engage in any
changes
yeah just how many archive submit like
just just an audio track of the
periscope so is this one
thanks it's a huge these lanes are huge
no but the ones in the residential
thanks we'll try to keep being round so
that
at
they might get a single you gonna get a
secret am i leaving these cookies
probably rather not go through the drag
bird in and out like the line is so long
in the drive those who are curious and
seeing way most railroad was the way to
go
shut up to the person on Twitter who
gave us that to that okay also for those
listening and watching meet up tomorrow
Albuquerque fuse maker space 5 p.m. whoo
cool alright guys thanks so much
wait for people to come
to my stream i'm on my way back from
las vegas to san diego oh shit but
i unplugged my phone and my phone was
telling me where to go
so get ready for an experience of trying
to use a car's navigation system yeah
let's go there
oh okay it's doing something
it wasn't actually bad start guidance
i'd love guidance
please proceed to the highlight oh my
god but shut up uh
yeah that's the shut up button alright
good perfect
uh by the way if you guys are looking
for
you know a song recommendation uh
929 by halsey unbelievable
uh you know i stared at the sky in
milwaukee and hoped that my
father would finally call me
this is unbelievable um
there's a few a few other
uh lines in that song
um they say don't meet your heroes
they're all fucking weirdos and lord
knows that they were right
uh so yeah
you know that's good advice all right i
don't actually know if this stream is
working because there's nobody in the
chat room
so this might be a fake stream who am i
i'm only 25
i just enlisted that song on repeat guys
um
let's engage up here
i don't know maybe it just takes time
but if anyone's there and you're just
saying silent for some reason
i applaud your incredible ability to
coordinate in a decentralized manner
and think that those are the skills
we're going to need for the revolution
uh so you know they're good skills to
have
um so basically have you guys ever seen
an
infomercial and this thing is kind of
just going to be an infomercial for
common devices uh look at it
just you're going to watch the device
drive the whole time it's it's beautiful
and partially that's just because that's
what we're doing with this stream
but it's also partially because yeah i
don't think the stream is working
otherwise there'd be people
uh in the uh in the chat oh 25 viewers
okay so something is working
i don't know how come there's no chat
uh yeah so it's just an infomercial for
for the comma device
you can watch it drive uh
for hours and you know ask yourself the
question
why have you not bought a comma two yet
um you know you can go to comma dot ai
slash shop and
you can purchase one of these and put in
your very own car
uh oh yeah finally we got a chatter yo
that's somebody
oh chad is working i bet you it's
subscriber only chat
and i don't know if we're gonna be able
to turn that off so uh guys i guess
there's only one option and that's for
you to hit that
subscribe button yeah
thank you for subscribing woo woo
that's that's that's uh we're gonna dab
on the haters right who remembers logan
paul dab on the haters
it's great to have you all here with me
we're on our way back from
las vegas and i had a big win in las
vegas big win
we're coming back big win a m
c i got in yesterday
and i'm not distracted oh it's because
my phone is in the path of
uh the driver monitoring camera
uh big win on amc that was the right
horse to bet on
uh today amc pumped uh and you know i'm
not gonna
guys you know what i'm just gonna say
this that i'm probably lying right now
but never sell
always huddle and always you know you'll
always just make more money right
if everybody could just get behind this
is definitely true about crypto you know
i mean i'm a no coiner but if you're
going to buy crypto here's the following
investment strategy oh my god this is
way i don't understand what the fuck i'm
supposed to do here
oh wait i kind of do okay let's see um
oh guys 9 29 by halsey
uh
i wasn't in love then i'm still not now
and i'm so glad i figured that out
it's just it's so good don't meet your
heroes they're all fucking weirdos and
god knows that they were right
uh is this the exit you know we need
that navigate on open pilot
navigate on open pilot but
the main things that we're shilling for
uh are look you know what i talked about
in the common ai meeting we should have
live stream this week's comment ai
meeting i think it was an appropriate
meeting i'm giving it a little nudge to
the right here
uh soon you're gonna be able to use the
blinker to do that the feature's called
keeps coming soon
not an open pilot zero eight two i'm on
zero a2 right now
it's got new mpc new npc adds a cost
to the yaw of the car it's so good
but now i don't have a lead car so it's
gonna take this turn way too fast yeah
we need that slow down for turns too
coming soon boys
coming soon we're gonna zip past these
cars open piles driving right now
uh we're going a little fast but not too
fast i mean if it's within the torque
limit
you know i feel more comfortable going
55 but i got a wide shoulder
so we're good oh no
no traffic no
i disengaged i probably didn't have to
but you know i could see that traffic
coming no
there's traffic no
we're near la i guess when you're near
la you just get traffic
um
no traffic i hate
traffic all right
okay one yeah yeah we need cutting
detection right well
unfortunately i'm chilling here in my
2020 hyundai sonata
while it does have incredible lateral
control uh the longitudinal is
in control of the hyundai and uh you
know this needs to change i think with
open pilot's new cutting detection in
the zero eight series it's actually
better
um yeah
all right well you know what fuck these
people uh
guys don't do this drive like a don't
ever cut people off this is terrible you
know you should never you should never
stay in this exit lane
uh for way too long to get ahead of the
traffic and then cross this double white
line
you know it's pretty terrible but you
know we're doing it we're doing it
uh yo i'm not gonna be like like who is
that guy afroman or afroduck
yo guys look up afroduck afroduck's a
wild story
uh you actually can get tickets and get
in trouble
for things that you post on youtube he
set the record for a lap around
manhattan
but aphrodoc also my understanding is
and if i got the story wrong i got the
story wrong correct my misconception
but he like ran away to canada or
something instead of you know being like
bro no one got hurt fuck with me uh
which aphroduct totally could have done
and you know it's easier than like
running away to canada like justin
trudeau
um i don't know if he ran away to canada
he might have been born there he
probably was all right cool
geo hurry up and chill your meme stonks
you know what guys
i'm out of the meme stonks game uh i
made i made bank yesterday
on am fucking c yo get your movies
you want guys want to hear the real joke
about amc
so people bought amc because they
thought there was going to be a short
squeeze on amc this is get ready is my
mad
mad money jim cramer shit um they
thought there was going to be a short
squeeze on amc
but the actual over shorted stock was
amcx which was amc
networks uh so this had nothing there's
no short there's no real short pressure
on amc
um amc apparently also uh you know
minted new coin today
uh which good on amc suck up all that
retail fish action
but the trick if you want to make money
on amc was to buy yesterday and sell
today
uh now if your stock market trading app
didn't come with a buy yesterday button
uh you know mine doesn't either and you
know we can all a man can dream
right um
wait it went up to 21.70
shit i just put in a whole bunch of
limit orders
just you know some of them probably
executed so it probably didn't
if i micromanage it too much you know
let me tell you something
the closest i ever came to smoking crack
was trading bitcoins with 100x leverage
on bitmex
uh bitmex rip uh
yeah don't meet your heroes they're all
fucking weirdos and lord knows that they
were right
oh gme pump yeah yeah yeah yeah
uh jimmy actually there was short
pressure and i really hope you know i
love to see money flow from the
institutions back to the people
but uh you know
all right all right you know what i'm
gonna provide some real value to you
guys get ready for
market analysis um so
what these things are are kind of like
mini ponzi schemes right
they're mini ponzi schemes and um
you know um
i uh you know i i heard it i heard a
joke yesterday we'll change it a little
to make it appropriate for the twitch
stream
um the the dumb investor hears that
something is a ponzi scheme
and says uh that is bad i don't get
involved with ponzi schemes
the smart investor when they hear
something is a ponzi scheme asks the
following question
how late am i um if you get into ponzi's
early uh you get rich uh if you get into
ponzi's
late you're the bag holder that
everybody's dumping into
so make sure to get into ponzi za early
course don't actually do any ponzi
schemes all this is vice is only in
minecraft or whatever so
yo that's that's real real real madman
money advice yo
defy man let's cut the boomers out of
the money
and let's have money taken over by the
meme lords
of the internet you know i'm a big fan
of that i'm a big fan of um
decentralized finance but i'm also a no
pointer so you know
there's that
[Music]
diamond puns yo all diamonds are going
to be worthless
because synthetic diamonds are going to
be better cheaper faster
smoother harder better faster stronger
that's what i was thinking about
um all right what do i do oh no i gotta
go over there oh no we gotta go over
there all right hang on boys we're going
over there
i see yeah you know i don't know i'd be
freaked out if my car did an
actual automatic lane change that wasn't
like user initiated
uh i was freaked out when the teslas
were doing it
but someday we will get there and
someday it will make lane changes
better than a human oh yeah so the theme
of this stream is like i said you are
here
with the george hot's infomercial for
comma devices you're just watching a
comma device drive
if you put some chill lo-fi hip-hop
music on here check out the automatic
lane change
um if you put some uh chill lo-fi
hip-hop beats to this
this would be an incredibly relaxing
video but you know if you put
me on it maybe it's a little uh you know
edge of your seat you guys always think
i'm on adderall man
you know you always think that um
you know i've taken adderall and when i
take adderall i'm actually more calm
uh so there's that maybe i really have
80d
nah you can't have 80d if you don't
believe in it
that's right that's right big brain big
brain
oh a shaky but chill lo-fi vibe right no
i think you'd want to put the stabilizer
on
you probably just want to loop a 10
second part of it you know
that repetitiveness it's a it's a
metaphor for life
um
you know for some reason i feel that
when i put you guys on the stream
it becomes more socially acceptable to
talk to myself and that's kind of why
i'm doing it
i'm able to see chat yeah yeah yeah i'm
looking over occasionally
safely uh you know i could look at chat
more if we were in a more
chill area so you know because the
driver monitoring and uh
income is adaptive to like right here
there's a lot of cars around
so like you know you have less time to
react but if you're in the middle lane
on a highway and
you are the only car around that's
what's gonna get to level three first
you know
hold an air camera still i'm sorry you
know it's hard it's hard
yeah i should really get you know what i
should get a phone holder
um
whoa guys 9 29 by halsey i quit smoking
well recently i tried
i bought another house and still never
go outside
oh beautiful um
yo and you know what just to bring you
guys along on the adventure of my life
i'm looking into buying
land i've been looking into buying land
recently
uh you know i think that'd be kind of
cool we'll make a school
for uh for programming and life like
plato man i think plato did this shit
plato's a cool guy earth to land how
much
well uh let's just say more than my amc
gains will cover but not that much more
um okay kanye yeah i heard kanye can't
build on his land because it's home to
some like
uh you know unladen swallow
african or european it doesn't matter
they're both fucking endangered
you can't build here fuck you kanye west
uh and you know what i say fuck wyoming
i side with kanye west for governor
apparently chamath's running for
governor i kind of like his platform his
platform is no taxes and lots of free
shit
uh that's the candidate that i'll get
behind the no taxes lots of free shit
candidate
uh i think we all learned here in 2020
that there's a printer and it can print
money
and like why do we need to collect taxes
if we can just print money
all right see what i'm saying but this
you got to play some 40 chess here
because you know
we want to we want to accelerate the
demise of the us dollar
and replace it with alternative
currencies that are by the people for
the people and of the people
no actually it's just a world where
engineers rule and you know i think it'd
be a better world than a world where
politicians rule but you know it's just
not you know the problem is never
uh every every communist knows that you
don't actually want to dismantle
hierarchies every feminist knows this
too
uh you want to invert hierarchies you
want to place yourself at the top of
hierarchies right
that's just human nature and now you
know for people to say no but i want
everyone to be equal
yeah yeah yeah but you say that because
you're not at the top of the hierarchy
right this is again
human nature and if it was not human
nature you'd be out competed
by people who know that it is human
nature
and who's forcing the equality is the
paradox the tolerance
well you'll know what i'm saying all
right but coming back to the purpose of
this stream welcome to the infomercial
right here this device is a comma two
you can see the beautiful infrared leds
on the bottom of it
i'm chilling i'm leaning back a little
in my chair my hyundai sonata i'm
watching the road ready to take over at
any time i think of myself as an
exception handler
if anything bad happens i'm ready to
take over but
you know things have been pretty smooth
sailing i got the plane on autopilot
i feel like a pilot you know i'm an
autopilot and this is just really
tesla really nailed the name uh
but you know we're open pilot it's open
source software mit licensed available
on comma ai now
uh maybe here here's one of the memes
wow i'm really i'm really uh
scatterbrained a little bit on this and
you know i don't even have chat to keep
me unfocused
um 929 by halsey
i know how to write html
um
got more screens in the next gen model s
yeah i heard that came out i haven't
watched a video yet
i'm interested
you know i hate when people tailgate
that's why open pilot doesn't tailgate
who's this fucking who's on my tail i
hate this shit
good yeah go around me good yes please
go around me thank you
open pilot bottle bumper check people
um yeah it's a little low on frame rate
ui is not the highest priority process
ui does not run real time
uh we leave like controls in the model
to run real time
uh yeah it was that truck
get off my ass you know i hate that you
shine your bright ass lights into my car
uh what did i think of the funny
incident that happened this weekend with
wall street betsy oh
i made bank i bought amc yesterday you
know
um by the way none of my shit stock
trading advice sec
i'm your friend man i'm your friend i
didn't do any illegal icos go after
ripple fuck ripple right hey fuck ripple
no seriously though
um
[Laughter]
now i can buy that expensive dna printer
yo
um no they wouldn't sell me the dna
printer fuck uh ox
nanopore technologies i emailed all
their executives they wouldn't sell it
to me they
charged my credit card and then refused
to sell it to me
please tell me what company or
institution you're affiliated with
you know you fucking gatekeepers in bio
man
oh that this isn't a biostream though
um fuck oxford nanotechnologies
uh they wouldn't sell me the thing i
emailed all their people
fuck them fuck them fuck them and they
took my money
they charged my credit card and then
like four days later i got up well we're
not going to ship your order until you
give us more information and i'm like
yo i'm just a bro who wants to sequence
dna which is true
i'm not trying to like like like like
steal their technology or like use it to
like
like shove a tomato in there and be like
oh look it says tomato oh i'm so happy
i'm doing biology
that's literally all i wanted to do and
these fuckers deprive me of my joy
so that's how i feel about oxpor
nanotechnologies
and i'm gonna buy a you can buy old
aluminum machines on ebay for like the
same price
i can buy a dna sequencer that was
seven hundred thousand dollars ten years
ago for like fifteen hundred dollars it
has a super cool oh
also wow i'm really i'm really hyped i'm
really hyped
um we're gonna calm a little bit also
i got a microscope and i started looking
at shit under the microscope
there's bacteria everywhere and you can
see them
under a light microscope they look like
little things and they're everywhere
like you know spit on a microscope slide
and just like look at
it it's wild and julia is better than
pie torch bullshit
you know how i should have switched to
known you got to switch to pi torch
sooner
um you gotta switch to pi torch sooner
because that is what all
of the papers switch to follow the
papers most of the papers come out are
using julia
we'll switch to julia now but pytorch is
tensorflow is a framework and fuck
frameworks you want libraries and
pytorch is a library
where am i driving this fast let's speed
them at 65. well 68.
those people are passing me a little
faster
that's right i'm a pilot just adjusting
the the knob so i'm getting passed up in
the right lane all right we really do
got to go faster
uh agi has a hardware limitation and a
software limitation
they go pretty much in locksteps office
a little bit faster than hardware but
all right the point of the stream calm
big brain thoughts
look guys
open pilot is
i think one of the most incredible
things of the last couple years
um in the way that it has actually
uh changed my life for example
i would have flown to vegas this weekend
if i had to drive
uh with this i drive to vegas right
now
you know you look at it you're like it's
a phone with a 3d printed case i know i
know i know
we're working to change now um
and we're looking to hire people uh
we're looking to hire people who can
help us change that we're looking to
hire people
how do we take comma from where it is
now
to a million people to a million users
right i don't think like that
a lot of startups to think like that a
lot of startups that's their first
thoughts my first thoughts are
let's build something that works really
well
uh i didn't have i don't believe i had a
single forced
disengagement uh
on my drive over
whereas like the car would have done
something catastrophic had i not
intervened uh
there were plenty of unforced
disengagements you actually saw some in
the video
but um yeah we're hiring we're hiring a
whole
uh sort of diverse array of people
uh we're gonna update the comma jobs
page to include a lot more roles
uh we're also gonna probably uh raise
some money this year
it's time to it's time to think about
how to scale
this up uh we support most new vehicles
sold
and it's
i mean life-changing's a lofty word
right
how life-changing is i think i'd say
let's say it's less
life-changing than uber but more
life-changing than airpods
right so like uber was a whole new way
of thinking about things uber lyft that
whole that whole thing was like a
it was a lifestyle shift right like it
changed the way that i did some things
in my life
um whereas airpods are great headphones
and they
like sort of changed the way i did some
things too
but i don't think i think open pilot's
somewhere in between there
now of course airpods sold uh you know
many many many many units
um so yeah you know we we we grow common
to sell
a million devices a year we are
comfortably a 10 billion dollar company
a million devices a year thousand
dollars a device
that's a billion in revenue 10x revenue
multiple is
maybe even laughably small mobilize sold
for 42x
uh their revenue um so
here's what i don't want right and i'm
gonna i'm going to make it a little bit
more open here's here
like we want people who are going to
help us get
to 1 million uh
of these things sold here's what i don't
want look
small brained mba bullshit
anybody who ever writes in an email i
will come and work for you for free
why the fuck would i want you to work
for me you are not asking
to work for me you're asking for me to
educate
you for free and the way that education
works
is if you want to be educated you pay me
right like
you know education is not you know
you're not working for me for free
stop that and then also right away when
i see that i'm like you're a fucking
liar who doesn't speak the truth right
and you know you got to speak the truth
if you want to work at comma i hate
liars
i hate liars oh we got we got no place
in the world for liars anymore right
and some people i'm not even i don't
think they're aware they're doing it i
don't even think they're aware they're
doing it
but like i just you know they say
something and i'm like but what does
that mean
and they have like no fucking idea and
i'm like what's inside your
head i feel like you're lying to me
right so i don't want any of that shit
but we are kind of to the point
where we have to recognize there are
definitely other talents besides
straight up software engineering
think about it like this if you're
trying to build a hard drive
that is you know five terabytes well you
don't have to build it you just buy it
on amazon
if you're trying to build a hard drive
that's 100 terabytes okay maybe you have
to build it
maybe you know you want the 100 terabyte
hard drive you gotta
put a bunch of uh you know you probably
put enough hard drives in a single
machine you want a one pay to buy hard
drive okay i got like 10 machines
scattered around my floor connected with
a 10 gigabit switch great i got gotta
i gotta i gotta pay to buy hard drive
but what if i wanna build an exabyte
hard drive
right think about the skills required to
build an exabyte hard drive
they're not all software engineering at
some point where am i putting this thing
do i need to know how to drive a
bulldozer and lay a concrete
foundation right um we are definitely
looking for software engineers
you know i was just sshinging into this
thing today to change branches
oh my god i posted on our internal slack
channel a whole rant about how
like first off i had to set up the
tethering and i didn't know what the
password was so i had to change the
password to the tethering
and then i had to you know connect my
computer to it
and then i had to figure out what ip
submit it was on for some reason it's on
something at 43
i guessed 43.1 i had to know that ssh
was actually on port 80 22 on the device
and not 22.
uh then i had to a good thing i had open
pilot cloned on my laptop so i had the
key so i could ssh in
and then it was on a release branch so
it was shallow so you know you got to
like
get branch add remote origin
master ci get check out master ci
is just it was terrible it was terrible
and we need people who are going to
improve that experience
right
um
no you know look some companies have
structures in place
where they're designed to tolerate
you know maybe educating employees more
i'm not doing that it's not i say this
all the time like it's not my job to
educate you right
present something coherent
and i'm interested right like
you know
the commons mission is solve
self-driving cars while delivering
shippable intermediaries and that is
absolutely our mission and you know
everything else is secondary to that
mission
but like
you know uh i gotta give this quote all
the time on my streams you know
la told me you'd be a pop star
all you have to change is everything you
are
uh and i'm not gonna do that
pink had a successful career without
doing that
uh you know i'm never gonna fucking sell
out
uh yeah
but then you know okay i could talk
about oh the mission you know my
personal
is to change culture and it's like then
i get people who are like culture
warriors and like you want to like oh
talk about culture i want to talk about
fucking culture i want to talk about how
to actually make this device better
easier to use and ship it to millions of
people right
that's what i'm interested in people who
sit around
and talk about how to change culture are
not
changing culture you know armchair
anarchists right
um how much experience do i look for i
don't care i don't care
like if you're asking me for something
like well i want you to have three years
of industry experience
no i'm gonna talk to you do you know
everything
right like know everything
i mean there's things you don't know
you're not actually gonna know
everything everything but i'm gonna ask
you simple questions
like what's the difference between
kernel and user space you know maybe you
should know that
all right i'm going to ask you like you
know what's dns
people are going to do this is domain
name server okay what port is it on
right and it's like 53 and like people
don't know that but like
you could say like oh but that's a
useless piece of trivia yeah but if you
have exposure to all the right stuff
you'll know all the useless trivia
right nobody who ever got good at
anything did it by studying
dns port 53 why you got a fucking flash
card
you know i got that anki learning system
no you just know that
right because you spent some time in
wireshark
uh yeah
you know we have an executive team at
common now we have executives
executives uh
guys are gonna interview with them you
know
can i do this no that's my i gotta
recognize my own limitations right
now i'm here i'm here to scream if
anything looks like selling out you guys
know i hate selling out you guys know
that i care so much about not selling
out that i would die to not sell out
we'll talk uh i would die to not sell
out
and if i'm willing to die i'm certainly
willing to lose everything i have
you know certainly willing to lose any
any money i might have any any niceties
i might have right like
like before willing to die you know you
got to be willing to live and i'm going
to live through
complete and total bullshit to not sell
out because what's the point
what's the point you know what's the
point of life if you're going to sell
out
right and everyone everyone you know
everyone has their own stupid ways of
justifying it to themselves right they
justify selling out i should have done
this
i should have rolled with that guy oh my
god my rent's high wow i should have
realized hobson
uh
yeah people justify to themselves
and then one day you wake up and you're
like what is it all for
uh yeah i think i figured it out real
early
uh no no i don't no no
no i don't got any new wraps that are
complete enough for me to do but you
check out my new
rap on the soundcloud is not called the
civil war because people were civil
i don't really know why it is called the
civil war so that's a good question
i do know why it was called the cold war
though because russia is cold
uh oh short selling yeah you oh my god
so i saw a meme and it was like a person
in tears
from a melvin capital and like i thought
i thought they were like i thought it
was like making fun of like the melvins
you know like what is a melvin like you
think of a melvin as like a
like a like a soup right and i thought
it was a meme and i thought
this was just hilarious it was hilarious
that like like
you know the meme chose the name melvin
and then i found out that the company
that the hedge fund short and gamestop
was actually called melvin capital
you know were they self-aware
uh melvin capital wow
um don't meet your heroes they're all
fucking weirdos and god knows that they
were right
melvin
[Laughter]
yo you know what i'm gonna do on friday
maybe i'll live stream it set up a roth
ira
this is the first time i've ever day
traded and got them short-term cap gains
so i got to set up some some tax
structuring like the rich people do it
you know
so maybe a video live stream live stream
financed
what do i think about luminar oh god
guys every spec i have ever seen
is a scam no legitimate company would do
us back
uh no but i love i love i love
wall street beds big brain shit it kind
of seems like in a weird way
like the mob is aligned more with
reality than like
walk like wall street right it's these
mob of people who are
you know i saw i saw a great like the
way the cash flow is happening it's like
it's going from on it's going from
people who take finance seriously to
people who do finance for the laws
and i definitely want people doing
finance for the lulls
to have funding and the people who take
finance seriously fuck that
and then maybe maybe you can even extend
that to life like the people who take
life like really seriously like well i
want to retire by the time i'm 65 with
my ira and my social security payments
and
dude yeah you're gonna be trapped in
that boomer mindset forever
um and you look look look
look while this is still while this is
still uh you know acceptable
before the boomers really start to you
know realize the boomer sentiment
right you know guys like being racist is
dumb
um but hating on boomers
and look it's not the individual boomer
right it's not it's not each and every
boomer
that's the problem right like my parents
are boomers i love my parents they're
not the boomers who are the problem
but i'm talking about the boomers i'm
not distracted
it's because i'm holding the phone there
um
it's because i'm holding uh because the
boomers hold all the money
right and you know they don't want to
pass it on
you know they don't die so yeah boomers
man
and look i'm all for you know what we
got to do
you know we got to do with boomers like
be nice to boomers everybody i'm not
saying be meet the boomers
but we gotta like disrupt boomers
disrupt the boomers yeah disrupt boomers
i like that i like that
disrupt boomers
hating on boomers who build most of our
infrastructure you mean our decrepit
shitty infrastructure where we can't
build a new nuclear power plant because
you know all those people died in three
mile island oh wait nobody died
um you know
and they did right i'm not hating on
like what the boomers did in the past
but like it's time to pass the reigns on
alert to code yo yo that was the
funniest shit
that was the funniest shit when like
that was like a meme like the
journalists would write all those
articles about like learn to code and
then these journalists would lose their
job and people would tweet at them learn
to code
and they like freaked out about it like
it was some like secret hate group
no no it's just called condescension man
it's the same fucking condescension that
they put into all their buzzfeed
articles
turned back at them and oh shit they
don't like it
well how do you think the rest of us
feel
wow big brain shit big brain shit
um
no no no no no no all right all right
maybe that maybe i'm too harsh on
boomers maybe i'm too harsh on boomers
but
um you know what i'm never too harsh on
the fact that all the money is a scam
today
right the money used to be backed
by gold now the money is backed by
nothing and this didn't happen a
thousand years ago
it happened like 50. there were people
alive when the money was still real
it became fake in the last 50 years and
then they're like oh but but we have all
of these all don't you remember the
great housing crisis of 2000 yeah
because the money's fake
real money
burr money printer go burr
keynesian economics big brain shit throw
money out of helicopters you know i
don't know
like like i'm not i'm not saying
i'm not one of those people who
advocates like oh we have to go back to
the gold standard right
i think the gold standard is is perhaps
even more ridiculous
um but you know we do need
better transparent monetary systems and
wow there's a whole
industry of people building them
and they're amazing d5 bros
d5
the d5 pump will last
long after the amc pump is
the you know amc is the new blockbuster
video who i hear also pumped
um
get bitcoin to less than 1k i don't
think that's gonna happen
i think less than 10k might be possible
less than 1k would
shock me
never
just replace the fed with the computer
exactly
yo that's even you know i want you know
i want engineers to run the world but
really what if like like
technical systems ran the world
should money be backed by the jewel like
jewel pods
communists advocate for the abolition of
money
well
[Laughter]
i mean you know
hey guys guys you want to live in a
communist country uh there's plenty to
choose from
i don't i don't like you know
you can make america into a communist
country and all that's gonna mean is
that i move out of america right i'm not
really you know i'm not a communist guy
but hey you know let the communists have
their shit and like you know
the the reborn from the ashes and all
that right let them
um how much of my liquid net worth is in
crypto zero
because i am no coiner no coiner
that's right communism has
tried and failed every time that's right
but
so has capitalism it just hasn't failed
yet
we need a newism lulzism lulzism
you know maybe there is some real truth
to like lolzism though it's like like
keep the world
you know don't let the world fall into
shitty state systems keep the world
interesting
my terminal value is narrative you know
um
as long as they're telling me good
stories i'm i'm down i like this whole
thing right
narrative value welcome to
post-modernism
you can't put the post-modernism genie
back in the box
i'm almost home sweet almost home
we nikon we based on carbon dioxide
pellets
no you don't want carbon dioxide pellets
carbon dioxide i've been reading
molecular
biology of the cell and carbon dioxide
is low energy shit
low energy shit you know some high
energy shit like atp
that's some high energy shit
atp pellets sugar pellets so wait that's
already kind of
our economy moved away from sugar
pellets and that's the problem
food became too easy to produce
yo yo yo yo yo big brain shit what if
we genetically modified humans
instead of needing 2 000 calories a day
to need
200 000 calories a day and then making
food is hard again
yeah that might fix the world i listen
to i listen to the first couple chapters
of ready player two
and they talk about a declining world
well yeah because all difficulty in the
future has to be artificial
sign up for orbit today
that will fix the economy all right now
we have a lot less cars around
i can read some chat we'll read some
chat and then uh
i gotta go because i'm almost home
i think
calories are a flawed measurement
yeah i've been reading dune as well like
a racket it's like water
sounding like the unabomber why
because i advocate for the love of wild
nature
if that makes you like the unabomber
then there's a unabomber
in all of us actually it's on my blog i
wrote a thing i mentioned the unabomber
my last blog post it's not that well
thought out but
um
you know one thing there's one part of
the manifesto there's there's one
and he's self-aware about it too which i
appreciate uh but there's like one
paragraph where he says
you know he advocates the collapse of
industrial technology society
and uh then he says well let's make it
collapse and then what are you going to
replace it with oh well that's other
people's problem
i don't know about that now you have
some ideas about what to replace it with
then like the question is more like but
what if the industrial technology
society comes back as it's going to do
and he says that's other people's
problem
that's that's that's that's that's my
main problem with the manifesto
oh yeah no we're going to fuck biotech
man i was thinking about i was thinking
about when oxford nanotech
you know they're a shitty company and
they wouldn't sell me my product even
after taking my money
like why would you take my money and
then not sell me the product
i don't get it do not make money on the
product
if you don't make money on the product
why do you sell the product
you put it on a website i clicked buy
and i expected it to be shipped to me
and you sent me up what are you gonna do
with it and who are you affiliated with
why do you care
um so yeah no i was thinking about a
common ai bio
we could do it we could do it see what
you really want to build is a dna
sequencer and a dna synthesizer that is
itself bootstrapped through biotech like
3d printers are limited i think i was
talking about this 3d printers are very
limited in what they can print because
it's made out of plastic how many things
are just made out of plastic only like
little doohickeys you know
little trinkets and you know little
useless shits
can be 3d printed right you can't make
something useful just out of plastic
maybe you can replace a part
but it's still usually a part of a hole
right um
but dna shit i'm made out of dna
right biotech
i wanna i wanna you know i'm buying land
and i wanna like like build a house on
my land but imagine my house just grew
out of the land
make some dna be like grow a house from
sunlight and then i'm like shit you know
that's already a tree but the only
problem with trees
is that they're not house-shaped so what
if you could figure out
how to make house-shaped trees
how sick would that be you plant it
you ate five years and a house grew
that'd be the coolest shit
yo i just thought about that now but
this
what do you guys think of that idea
right it's like a tree but instead of
growing into something tree shaped
it grows into some house shape that you
can live in
yo that'd be sick i'm gonna solve the
housing crisis i'm gonna be johnny house
seed
it's like johnny appleseed but i'm just
gonna go throw lots of house
seeds around in the country and i'm
gonna solve the housing crisis it's like
the gang solves the gas crisis because
geohot solves the housing crisis you
know
oh yeah with house seeds
yeah you had that idea 10 years ago well
i just
fucking patented it so it's my idea now
because we're first to file system
bitches
yeah yeah yeah yo yo jarvis
call my patent attorney i want you guys
to patent a seed
that grows into a house a process for
making houses
out of seeds yeah yeah
and then i want you to troll people with
the patent and i want you to like try to
use seed metaphorically
and sue every construction company and
be like well the seed is the idea in
your mind
you guys are violating our patent you
got to pay me ten thousand dollars just
imagine we got ten thousand dollars
for every house made in the country we
could be patent trolls man
we could be rich and then i could live
in the bellagio tower sweet shit
yeah can't even book those bellagio
tower sweet shits
you gotta you gotta be a you know big
gambler big bellagio gambler
genetic engineering super purpose for
life exactly
want to live in a world teeming with
life bio fluorescence yo
no remember the glowing plant
kickstarter and then they got gmo
organisms bam from kickstarter
but i want glowing plants i was reading
some paper some guys modified tobacco
plants to glow
the eye's gonna glow
mushroom houses yeah yeah
rivendale you know real real lord of the
rings shit let's make them out of fungis
we can
we can transfect genetic fungi
everything
comes with biofilter you know it's like
a sick house
yo no seriously though house oh people
are going fast
seven yeah we can go faster let's go 77.
am i okay yes we're all having a good
time
rhett's got a blue lawn yeah
yeah i don't know just killing time
a million units
sometimes i wonder if you know i think
we've had that am i crazy talk before
and
get shit done i function in society
i even shave my beard you know crazy
people never shave their beard
they never do when they do they don't do
a good job of it like they miss a big
spot
you're like yo what is that like big
clump of hair on your face
and they don't notice it because they're
crazy and i look in the mirror i see my
cleanly shaven face and that's all i
know i'm not crazy
we're going to move over a little bit
where we're in a lane for people who
really want to go way too fast
being crazy is the opposite of a bubble
[Music]
would i get the neural link no but ready
player 2 was talking about a neuro link
without having to do any invasive brain
surgery
i will get the neural ink once a million
people have gotten it and i will go to
mars once there are five star hotels
there
and i will buy a tesla once the
experience is on par
luxury wise with the mercedes s-class
what madman shaves beard
423 people
yeah this is a weird year
weird year you know you guys can do this
it's a fun activity we do it if we had a
computer of course but we don't
uh open one window and go to google
trends coronavirus
there's no cops it's chill
chill it's chill we back we're back no
cops
zero cops
go to google uh
go to google trends bring up coronavirus
in one window like searches for
coronavirus and then bring up cases of
coronavirus in the other window
and they are hilariously uncorrelated
uh you know i just just
and i've been saying this from the
beginning and you guys can look at my
coronavirus song
they overreacted at the beginning and
then when there's a real problem no one
takes them seriously it's a boy who
cried wolf
you know don't cry wolf but we have to
do everything we can if one person dies
it's worth sacrifice if we can save one
person's life it's worth sacrificing the
whole economy
no it's not right
and like i really hope that anybody who
thinks like that
never has any power but george you're
heartless
of course you'd sacrifice just the
economy it's just money and you can save
a whole person's life
yeah think about that think about that
you know
you can even think about it in terms of
lives
right
so my hands getting tired holding you
guys i need a phone holder
what's my qualms with communism
i've been to russia
uh yeah i've been i've been to russia
for some reason i don't think it was
better during the uh the soviet
era oh but that wasn't real communism
real communism has never been tried
real dictatorship's never been tried
because i've never been the dictator
have i seen putin's house yeah again
things look pretty good in communism if
you know you're putin
poggers
ah 45 miles to san diego
everyone who's still with us to all 247
of you
listen to 9 29 by halsey and i it's just
it's it's
it speaks to me it feels like halsey's
speaking to me
um and uh if she ever wants to hang out
yo i want to hang out with halsey i
think i think we'd have a good time
um you know i got to set my sights a
little lower than taylor swift no
offense halsey
uh by the way no we're not going to go
there we
only said nice things on the stream
except about boomers which look it's not
the boomer individual
it's just boomers it's like uh it's like
a
it's like a meme that went on too long
yeah
well who's your experience interning at
project zero oh
god i don't know what you expect me to
say to things like that
not no hate to project zero my hates to
that question about zoomers
are they based are zoomers based
hollywood
celebrities do they know things let's
find out what do they know do they know
things let's find out
hollywood stars and celebrities do they
know things
hollywood stars and celebrities do they
know things
let's find out hollywood stars and
celebrities what do they know
do they know things let's find out
that's right
uh do i consider myself based
uh i don't really consider myself
another great bojack horseman like
exchange
bojack's going to diane and he's like
diane you know i do a lot of we both
know i do a lot of shitty stuff you know
i'm like i'm like like like bad but like
you do believe that like
deep down i'm a good person right and
diane says
well that's the thing bojack i don't
really believe in deep down
man i love that show
would i sell my products to the flat
earth society i'll sell my products to
anyone who's willing to pay me the money
for them
unless they've pissed me off personally
if they've like offended me in a
personal way
yeah fuck them you know elon does this
like yo elon doesn't sell me a tesla i
don't blame him i don't say fuck tesla
like that's elon's right he can decide
where he is and his beef with me but ox
porn now attack
who after taking my money tesla didn't
take my money by the way tesla just
canceled my order before they took my
money
oxport nanotech took my money waited
four days
and then said yeah we're not gonna sell
it to you
so fuck them and we're gonna disrupt
biology and when we do
we're gonna laugh about them the same
way we're gonna laugh about waymo and
cruz
everyone does know that like waymo and
cruz are over right
i think i think the world's kind of
caught on to that right the future is
amc and gamestop
oh
all right thank you
all for watching my stream i think
that's a great thing to end it on the
future is amc and gamestop
this is not stock market advice no
honestly like i don't know if the stocks
are going to go up or down tomorrow
i've lost the ability to predict it but
if you do follow me on instagram
george hearts i have a blue check mark
uh and if you guys took my stock advice
yesterday
well let's just say um you'd be rich
today
and by rich i mean yeah you were
probably about 2x
thank you for gifting subs uh stuke53
since you gifted subs
uh well remind me next time
that you get one question answered
even if it's something like when's the
last time i had sex
we can even ask personal questions
because you're a great person
you've not just been a subscriber
yourself but you've passed the
being a subscriber on to other people
and and
i appreciate that uh from the bottom of
my influencer heart
thank you thank you all for watching my
stream
the name of the stream is a million
devices because our goal at common is to
ship one million devices
and if you think you can help with that
email jobs common.ai check out our job
postings page
but even if it's a little bit more
outside the box like look you know i was
i worked at oculus when they ship their
first consumer product here's what i did
there here's what i think i can do for
you
i'm interested i'll hear yeah um or you
know
our executive team will because can i be
trusted with everything
no i cannot there's much i cannot do i
am self-aware enough to know my own
limitations
can i run a multi-billion dollar company
now but i can oversee it and veto
selling out bullshit because i would
rather die
than sell out uh
we're also thinking of raising money
very preliminary but if you are
interested and you're an accredited
investor
and you're looking to invest two million
or more dollars
invest at combat.ai
invest at common.ai okay thank you all
for watching
today's lovely stream we're not selling
out we're not selling out boys
when i say you know investors you can
invest in getting this device to
millions of people
hey you know if you're not value aligned
with that i'm not gonna let you invest
but if you are more power to you
let's all get rich
and win in our own ways
not in the boomer economy in our new
economy based on smiles no not smiles
how about uh cryptocurrency yes that's
the one i was looking for yes
yes cryptocurrency that's the word i was
looking for the fly
is the future boys never forget it don't
let
any old finance people tell you
otherwise defy the future
you are the future unless you don't have
any skills then you're not the future
and i feel bad for you but if you have
skills and you get what's going on
you're the future yeah hype up shit all
right
all right thank you all for watching
thank you all for watching my stream
bye bye
hello
welcome everybody
hi welcome to the first annual comic-con
in san diego
my name is alex and i run operations at
comma
um and this is george i think some of
you guys might know him
if you're going to change the world
there's no point if you're just going to
change the world like everybody else
maybe i'll borrow a slogan think
different
uh welcome to comic-con i think you guys
are going to enjoy it
you know in 10 years people are going to
be like you were there for the beginning
thank you all for being here
you know at kama our mission is to solve
self-driving cars
while delivering shippable
intermediaries today you're going to
learn about
you know the history of comma where we
where we came from
where we are right now and where we're
going
it is my pleasure to bring to this stage
one of our hardware engineers
robe dirks
hi welcome everybody how's everybody
doing
great just wait for my presentation to
start
cool so i'm rob i'm one of the hardware
engineers and today we're going to talk
about
how comma actually works um
look look i'm not working
oh there it is
it's a little slow
you go to the next slide please
no so today we're here to answer the
question how can something like comma
exist
so like we support most of the cars
that have been shipped in the last five
years and like how does this actually
work because if you think about it like
we have all these different brands
uh they all work slightly differently
you would think they would all have like
different standards but somehow we
managed to
build a system with only a few engineers
which works on most of the cars that are
sold in the last few years
so how does motor car actually work i
mean almost
probably most of you already know that
most uh that most cars are not filled
with a bunch of electronics
so we have a bunch of connectivity going
on we have the comfort system
we have the powertrain stuff which runs
the engine
we have an infotainment system but most
importantly most modern cars also ship
with
an ada system so what does ada stand for
this click is not working great
there it is
i'm pressing the top one it's not doing
anything
one back there you go so an advanced
drive resistance system
so this means this is a system that's
built for safety and for comfort so it
has both
lane keep assist which keeps you inside
of the lane if you're not paying
attention
probably doesn't work very well on your
car but it also has
stuff like acc adaptive cruise control
to keep distance with car in front of
you
and what we really care about is that
the system has control over the gas and
the brakes
uh this is really important for us
because that's obviously something we
want to control
cool so how does this this ada system
look in most cars so usually you have
two systems
which do the adas which is the radar and
you have the vision system
so those are used uh the radar system is
used to measure the distance with the
car in front of you and you also have
the vision system to look at the lanes
and and give some more visual clues
into the system these then send messages
over to the actuators such as gas brakes
and steering
which then control your car
cool so if we look at this from like a
topology perspective we have all these
different systems
uh so you usually have the adas camera
and the radar which we already talked
about you have brake systems power
steering engine control sensors
diagnostic stuff
just infotainment user interface all the
buttons in your car like everything
that's electrical in your car is
connected over these bus systems
on most cars these are actually divided
up into three different buses
keep pressing
oh it's the bottom one i see now
you have the power train bus which is
the most important one so this runs all
your engine control stuff uh you have a
body bus which is a little bit less
important this runs like your infant
damage system
um and all the other buttons in your car
and then there's one extra bus which is
a radar bus
usually they separate this one out
because there's a lot of data going on
it so we don't want to
have all that data on the auto buses so
if you want to control the car like
where do we want to be
well first of all we want to get the
rate off points but we also want to
see what the camera is actually sending
so you have all these bus systems what's
actually going on on these buses
well all these buses use a protocol
that's called can bus
uh this is used in most cars and it
basically consists of these messages
with which have an identifier and a data
portion
and they get sent around the bus uh
providing all the data to the other
modules
so this is for example one of the one of
the messages that goes around on the bus
so you can see there's two two lines
there they go uh
out out to each other which means this
is a dominant bit you have recessive
bits
and these that make up the identifying
the data portion and some other stuff
you don't really care about
so why do all the cars use canvas i mean
this is kind of a kind of a wonder right
like you have all these cars they're all
made by
different brands and somehow they all
ended up at the same kind of bus system
well it turns out that in 1996 when cars
weren't very
electronically complex yet they all all
were mandated to use
a diagnostic sport so which is called an
obd2 port you guys probably have seen
this already like
below your dashboard there's a sport
which is useful diagnostics
in the specification like it mentions
that you can use one of five buses of
which the most common one was canbus
and so all the car manufacturers just
chose the can bus and just went with it
now cars weren't very complex back then
so we usually only had this one can bus
going on
but after that like they uh they merged
out and when they built all the
all electronic systems they just went
with what they already knew and they
just went with can bus
cool now you know how a car like kind of
works on the inside
like how do we actually take control
over the car
so controlling the car is basically
three different steps so first we have
to connect to the can buses
after that we have to figure out which
message is which because they just have
an identifier which is a number and they
have a data portion which
just looks like random garbage
and then after that we have to intercept
it and send better control messages
so let's first look at how we connect to
the canvas so if you go back to this
topology
like like i already said like we really
care about the data on the radar bus and
we need to
we care about the messages which the
adas camera can send to the rest of the
car
uh so the ada's camera is in control of
uh
joining the radar and the vision data
and then providing all the acc messages
which control grass and brakes and then
also the lane keeps test messages which
can
put torque on the steering wheel to
steer your car so
where do we want to tap off we want to
tap off
there we go back there we go
so you want to top off at this point uh
this point
is kind of ideal because it's right in
the cabin like uh this ada's camera is
located behind your rear view mirror
so that's the ideal spot to tap off
these buses
you don't have to mess around in the
engine compartment or anything you can
just take this connector take it out and
then
mess with it there so if we simplify
this diagram so we have the radar system
which sends messages to the camera and
the camera system sends messages to the
rest of the car
so what do we do we just connect to the
radar
we split apart the camera and and the
rest of the car
and then use a scan to usb interface to
actually talk to the car
the scan to usb interface is called a
panda and the open pilot device is the
part that runs all the application code
all the machine learning models which
actually
then figures out which messages to send
so to connect to the car we used to make
this thing called a giraffe
maybe some of you who've been around for
a long time still remember the giraffe
then we have the panda
if nafta comes up there's the panda
there's the white panda this is the
first one we sold
and as you can see this is basically
just an obd2 port which has three can
buses on it
and it has a usb connection to go to the
open pilot device
which we used to sell which was the eon
uh
this is just a ford in a 3d printed case
with a heatsink
it's pretty simple cool so if you put
this all together it kind of looks like
this so it's it's
not the cleanest setup like a camera
cuff that's gone um
like giraffe's just bungling down there
there's a panda plugged in you have
usb connection which is kind of flaky uh
and then the device mounted to your
windshield
so what about these these giraffes so
we used to have basically like four
types of giraffes these are the main
ones that we sold so we had the toyota
one
um which is common for all toyotas then
we had the honda bosch one which is for
honda cars but then with
a bosch camera installed and then we
also had honda
harnesses for the nida camera system now
we actually have two versions because
you can anybody spot the difference um i
mean disconnect those upside down on one
of them
so with one day like night i decided it
would be really funny to like flip the
connector around so we had to make
another harness
cool so she wraps so it's not a very
clean install you saw that in the
picture
it has a bunch of switches on it so if
like an open pilot device is not
connected
uh the car buses will still be separated
so your car thinks the camera isn't
there the radar isn't there so it throws
all sorts of faults
uh there's also like a lot of variants
all very different they're hard to
manufacture because they're so different
and it's also terrible naming like who
knows what you're talking about if
you're talking about your giraffe
so drafts are cancelled so then we went
uh on 2019 we rethought this whole
ecosystem
and we came up with what's called the
car harness so car harness is a very
clean install you can put it all behind
your camera cover
there's no switches anymore so if you
disconnect your device uh it actually
has a relay inside
which switches your buses back together
so if you unplug your open pilot device
your car results just think there's
nothing nothing
happened and everything will work great
car is happy
so this whole system is very generic
so we have like the cabling system we
have the stuff that plugs into the obd
port which is generic for every car we
have the harness block which we
manufactured this has the relay in it
and the auto switching logic and then
there's one custom connector for every
car which is the car harness
connector so this one is very easy to
manufacture because most things are
common
and it's also a great naming scheme like
everybody knows what you're talking
about if you're talking about a harness
cool so we have all these different car
harness connectors because like at this
time we support
i think 134 different cars not only
toyota and honda anymore
so we have all these different
connectors so we we got all of these
made
so we have two for honda which we
already saw we have the nidak one and
the bosch one
like now that there's a harness
connector we can actually just flip it
around and still fit
um we have the toyota one we have the
nissan one which also has two we have a
vw one we have an fca one a subaru one
and then there's hyundai they apparently
didn't think it was necessary to make a
standard in the company like most of
these actually use the same connector
but some of the like buses they just
like
pretended it was funny to flip the the
high and the low pair and it's like
okay ship the car that way
so we connected to the car buses this is
already figured out
now how do we know which message is
which because we have all we have all
these messages going on
as you can see like uh we did a log of
all the messages on the can bus
this is a video of the actual drive any
of all these messages going on there's
actually a lot more there's a there's a
whole bunch of messages you all have
this identifier
and then a bunch of random bytes like
which like change during the drive
so how do you figure out how to uh what
part is which
all this takes quite a bit of reverse
engineering effort um
which we built a tool for called cabana
uh
i think drew's gonna do a lightning talk
he's gonna talk a little bit more about
how to use this
um as you can see like you can label all
this data once you figure out which is
which
and then we can actually see like okay
this message uh is actually for like
wheel speeds so you have the four
different wheels
of the car uh so we we figured that out
you can plot this value so you can see
it corresponds with the picture now
where it's stationary for a while and
suddenly start moving and see all the
wheel speeds of the car
cool now we have all the messages
figured out where do we actually store
these definitions
um so what industry standards
for these definitions is called a dbc
file which is basically a definition
file for every can message on the bus
so it's just this this large text file
which specifies like a
okay this identifier is called this
message these bits and this meshes
say this now these aren't
available from any car manufacturers
because there are like internal secrets
um so we created this project called
opendbc
which we also on github which has all
these reverse engineered dbc files for
all the cars we support
so as you can see this is the one for
the civic which we were looking at
before so this is for example the wheel
speed message we were looking at
with all the four wheel speeds and then
also it checks them to make sure the
message arrived correctly
uh so what's what kind of messages go
around on the bus so you have sensor
values button states so if you press a
button like a bit toggles
uh there's control messages going on
saying like okay i want to accelerate by
x amount of meters per second squared
uh there's stuff about like what shows
up on your dashboard so you can
throw arrow messages on the dash there's
a rate of points going on from the radar
et cetera et cetera okay we figured out
which mesh is a switch and how to
connect to the canvas what's left
well we just need to figure out like
which message to actually send like how
do we figure out
what the battle message is to keep you
inside of the lanes and not just like
drive out of the lanes and then bounce
back
so we actually want to stay in the
middle of the lane well for this we need
to look at openpilot without all the
fluff
so openpower is made up of these all
these services which talk to each other
each service has this one specific
purpose
um we call them demons so that's why
everyone and uh every one of them ends
with a d
so it's camera d model descends and it
controls the etc
uh so we have the camera d which is
responsible for sending camera frames to
the model
and a model d just runs our ai models on
them and
actually outputs the information we care
about so for example we have camera
frame with a mole input overlaid
then we have sensody which takes all the
values that the sensor outputs
and then those get all sent to controlsd
control z is a big blob of code um it's
mostly mathematics with like path
planning and stuff which we'll look into
a little bit more
control z then actually generates the
car specific messages you want to send
which are then forwarded to the panda or
can to usb interface
and then the panda sends them over to
the car such that the car is happy
so that's our let's go back to one more
so that's a panda inside of that comma
two if you open up the case that's what
you'll see so there's an sdmi controller
in here
which provides usb to the phone and then
it has this obdc connector which outputs
the can buses back to the car
uh and then here's the harness connector
installed on the car
so after that we'll look a little bit
into what control z is doing
so control z basically exists with like
three big layers so the top layer is the
general
longitudinal and lateral planning so
this basically means okay the mole
outputs we want to be on this path which
are actually over here like what's the
actual best plan to get on the path that
the model wants you to be at
uh this then gets output to the control
loops which are very generic so they're
all
in si units or in like meters and meters
per second squared and stuff like this
um and they actually
go from the path to like the curvature
you want to be in
uh and then the curvature gets gets
converted into an angle and an angle
gets
into a control loop which then provides
how much torque you actually want to put
on the wheel to get
to that path beneath all of this which
is all generic
there's all the car interfaces so each
uh
car make we support has its own little
interface which basically specifies okay
like
how do we want to send these messages
what rates how do we fill them in
etc etc one of the car specific
limitations
um and on average we managed to support
134 cars with only on average 45 lines
of code per car so this is really easy
to maintain
uh we also don't really have to own all
these cars because a lot of this code
actually comes from the community
we only own i think six cars at coma
so a lot of this comes from community
contribution which is really nice
okay so now we figured out how to
control the car right so talk should be
over
well no there's a fourth thing you have
to make sure that it's actually safe
because obviously you don't want to be
on the highway and then you will
suddenly start spinning like this
um that's not a good thing so how do we
figure this out
well from the beginning comma set out to
be very safe
so um we made this one text file
explaining very concisely uh what our
safety model is
and this basically boils down to two
points so the first is that the driver
always needs to be attentive and ready
to take over at all times
so uh comma 2 is a level 2 system which
means that it
it requires the drive to always be
attentive and if it messes up that the
driver needs to be able to take over
we do this by enforcing that if you for
example press the brakes
uh or the gas that open pilot disengages
and you have full control of the car
again
the second part uh means that the
vehicle
shouldn't alter trajectory too fast for
a human to
take over so for example
if you're going fast on a highway you
don't want the car to swerve suddenly
and steer you off the road this is
enforced in
our panda safety library
the panda safety library is this piece
of code which runs on the banner
it runs on an stm32 which is an slb
rated microcontroller uh and it's good
it's meant to be very simple so it
doesn't use a lot of external libraries
it's very easy to reason about
and this basically has
this basically enforces like for every
message if it's safe to send this
message or not
so if you're going on a highway and you
want to suddenly steer very hard
the brand is not going to allow that so
if even if like somebody messes with
open pilot code and you
introduce a bug or anything the panda
will not allow this message to be sent
to ensure that you're safe so
quick example for example on the toyota
there's this acceleration message
which has id number 0x343 and
it in it it has a 16 bit uh
signed value which basically tells the
card to accelerate or decelerate
it's divided by a thousand so in in the
end you get up with the limit you end up
with the limits minus 32 and 32 meters
per second squared
now i'm sure that a lot of you know that
uh 1g is like 9 meters per second
squared so this is quite a big range so
you don't want your car to suddenly slam
on the brakes with three g's of course
so the panda enforces these limits so we
have a limit
between -3 which is pretty heartbreaking
and we have a limit of mine of 1.5 which
is pretty fast acceleration but still
within our safety model
so the panda gets messages it checks if
it's in
between these limits and if it is it'll
allow the message if it's outside of
this
limit it'll block the message and you'll
be safe
so to circle back to the beginning of
our talk
how can something like comma exist i
think it boils down to three different
points
so first more car the cars are more
similar than they look at first glance
so we know with all the the obd2 stuff
that they all ended up using can bus
except for a few german brands which is
flaxway
but whatever so they're all using canvas
they all have the same generic setup
with the radar connected to the camera
and then the camera sending messages to
the rest of the car that's very nice
they're all accessible from the cabin
so it's very easy to build harder then
the second point is that most of the
code based code base is very generic
so you saw that for example controls d
which should be the one generating the
messages
is even mostly car independent so all
the planet stuff all the control stuff
is very dark independent
and then finally um
the hardware difference is also
abstracted away with the car harness so
most of our harm or heart most of our
hardware system is very generic
with only the gar harness connector
being the part that really
differentiates them
thank you so any questions
[Applause]
um
yes i'm not sure if everybody heard the
question but the question is uh do we
run into issues
with uh oh he has oem systems detecting
that we are sending the messages inside
instead of the car itself
yes now this
this doesn't really happen uh because
for one we just got the canvas in half
we have all these messages and the panda
forwards every message that comes
through
which we don't care about so if there's
something with like button states or
something it just passes it through and
the card doesn't even know it was there
then second of all we use the same
structure that the ada system uses
itself
so we just replace the control messages
it would send so the card doesn't really
know
who is sending the messages like if it's
either the ada system or if it's open
pilot
so it completely mimics the internal car
system
yes so questions about tesla uh
actually i own a tesla myself um
so that's probably why it's one of the
carports
so i have an ap2 tesla there's
the the autopilot module which is behind
the glovebox it also has this one
connector which goes to the radar and to
the car
so i also built a harness for that so
i'm intercepting that and i'm sending
messages as if i was
the autopilot system now there's also
the people who
have very early teslas which don't have
the the ap system
so which don't have autopilot uh so
those are
also pretty big in our community with uh
adding
open pilot to their car
it's it's i think open pilot is a lot
nicer on the highway at least
um i don't have longitudinal control on
my tesla yet
uh so tesla's still doing gas and brakes
so i still have all the ghost braking
issues that hazard deals with
but on the other end i think the longer
journal is the lateral control is really
nice from open pilot
thanks uh first thanks for the
presentation it was really great
thank you um how do you come up with the
values like the 0.3 for deceleration
like
is there any better way to do it besides
just following each other around
break checking each other until yes
there is actually a battery
so uh there's this body called
iso which enforces these limits on
car manufacturers themselves so they
publish all these specs all these
standards which say like okay
do you have to have a safe ada system a
safe ac system you need to be between
these limits so we
looked at those limits and we actually
enforced those i think on some
of our actuarial values even like
slightly below the iso limits
uh so there's just from uh from testing
ourselves we found that we found out
these limits
to be very safe
hey speaking of safety validated
um so the question was how are the
claims about safety validated uh well
the panda safety is this uh
part of the c code which is very generic
so there's
it doesn't have a lot of interface with
the rest of the panda code so we
actually built this into a shared
library
ourselves and then every time this
changes it runs through automated
ci tests so we actually try to break it
so we have all these unit tests on the
goat which that's every limited enforces
and make sure that
that these limbs are always always
enforced
also we try to be
be implementing the iso 26262 standard
which is also
one of the one of the c safety
definitions uh which is i mean it's just
good practice if you're writing any of
these codes
yeah actually i was going to ask about
that iso 26262 and if you
need to be certified to it and how are
you reaching that
through software testing or and the
hardware
um well some of this just comes down to
static code analysis
so for this we also have automated tools
to test this but on the other hand
it's it's still a level two system
so we need to ensure that this uh
code doesn't mess up which we do with
our automated tests and other than that
we also still have the limits which are
usually present in the ecu's of the cars
so if you send a torque limit that a
torque value that's too high and for
example a homework car it won't even
accept that message
so even on top of that there's the ecu
safety which is in the car itself
also iso is a standard not a regulation
so there's no certification body you do
sell certified
yeah that was the name i was looking for
so so okay so mr you're using mr c or
not
src plus plus or we're using c uh cpp
check to
check all the mystery regulations um i
was wondering
how do you get like the right can you
get radar data from the blind spot
monitoring
the two radars on the back of the car
yeah so on uh
that depends on the car so on some cars
uh the blind spot radars are actually
available from the power chain canvas
and sometimes they aren't but also on a
lot of cars we see that they don't
actually output any radar points
um so they actually only output like if
there's a car in the blind spot or not
so it's only one bit so it's not
extremely useful
um we still use it though for our lane
change stuff so we check that there's no
card there if we have the data
but we're also working on trying to get
more data out of the blind spot radars
because they seem very interesting for
the future of command
thanks for the presentation the uh car
harness is it
um will it have ability to accept more
cameras in the future or i know george
is uh all about the one camera because
it's
you know the potential is not fulfilled
but going forward
we don't actually use the camera images
coming from the adas camera because it
doesn't actually send that data out over
the canvas
uh so we use our own internal camera in
our open pilot device
uh so the comma two which we now sell
which has one camera and uh for most
stuff we do that should be enough
um could you maybe speak to your
hardware fail-safes if there's like a
catastrophic failure in the
comma system that reconnects the can bus
and the car is able to
yeah is it is it like a an analog sort
of thing on the board
it is implemented in hardware yes so we
have this relay
which is powered by the banner so the
panda says okay i want to be in control
which then
actually is a relay splitting the buses
apart and then actually starts
forwarding the messages
now this can fail in two ways so either
the relay stays uh
closed which is very easy to detect so
you just see like if a message still
went through which you didn't expect to
go through and another way it can fail
is that it
stays open and then the car just will
fall because it doesn't see all the
messages because we're not sending
everything
oem cars tend to fall in the safeway yes
yeah
anyone else with a question
my question is also in regard to the
range limits um
do you always know that if it's out of
range that you can safely throw it away
or would you consider
limiting it and um second one is if it's
like on the lower end of the range and
the higher end of the range
is that also kind of something you
consider when executing those messages
uh yes so a lot of these limits in the
safety code are actually based on speed
as well
so torque limits are based on speed
second if we drop a message like this in
practice it shouldn't really happen like
this only happens if the open pilot code
messes up or if as a bug because in the
open particle we also tend to
uh want to stay within those limits so
usually we stay in those limits and
everything is fine
uh if we do go outside of these limits
and this would pose a safety issue then
we would just block the message
and uh go on today if this continues for
a long time
and a lot of these messages get dropped
then the car will start complaining
because it does expect
a certain uh a certain frequency of
these messages
great i've got a question back here
so i think i have a question about
hardware and oems potentially in the
future locking out
foreign parts and the reason why i have
this thought is because
i saw videos on like the right to repair
and how different companies make it hard
to repair their software without
you know they're assigned specific
hardware and i was wondering is this
something com is going to consider in
the future where it's not a problem now
but
oems might make it so that only certain
pieces of hardware can communicate with
their systems to control the car
uh yes so well first of all
we tend to use the same message
structure as the internal components
itself
so as long as there's not any signing
going on the car doesn't even know the
difference between their own internal
modules and
what we are sending second of all there
has been some
uh very recent car implementations which
do use the signing and that's that's
something we're
working on i'll break it if i need to
[Applause]
all right um so i just have a question i
think similar to what was us before but
rather than dropping the package would
it be better to just clamp it to the
maximum value that
the limit you enforce well that's an
interesting question well
we don't do this because we don't want
the panda safety code to actually start
generating messages
so the panel safety code is designed
from the bottom up to only be able to
read messages and block them
if we don't do this if we actually allow
the panda to generate messages
this will make the system very hard to
reason about so you'll have open pilot
which we lock
then sending a message and a car
reacting differently than what we expect
so we just dropped the message and then
we know this is very easy to reason
about and we know what the car will
actually do
now in practice this doesn't really
happen because openpower is pretty good
at keeping it between the limits
great and we're sending a mic upstairs
so you guys can we can hear you
um does anyone else have a question down
here
did you guys ever or do you plan to
maybe modify the firmware on any
existing car modules let's say if you
need to
get around some limit that's arbitrarily
too low or
too high on the oem side
this is something that's been going
around in the community a little bit
we don't actively endorse this or
support this
but there is some people who have
figured out how to alter these limits
especially on the honda cars which have
a pretty low steering limit
so yeah we do block these users if they
if they change them to unsafe values
thanks again for great presentation um
one note
would be nice if you guys put it into
some kind of
document like explaining
architecture and all that because it's
very useful for somebody starting
another thing i wanted to ask with the
cars for the cars with the weird
arrangement like hyundai they have radar
connected
to different place what what is coma
planning to do about it
um well some of the cars have a slightly
different apology
so i know on one of the cars for example
the 8s camera sends to the radar and the
radar forwards it to
the rest of the car uh usually we do
find a way to tap into
those cars as well though sometimes
we just tap it off of the camera and
only control the lateral part of the
steering so we just control steering and
not gas and brakes
which is an easy workaround but there's
also other harnesses floating around
which actually do
pull it off on a actually split the bus
at a different point which makes us
control the rest of the car
great got a question down here
um given that most of our cars are only
designed to
keep ourselves within the lane and we're
extending that to
you know more active uh use of the
steering motors
have you done any research into if that
shortens the lifespan
of our steering motors what the
implications might be there
um well i think we can say
pretty certainly that this doesn't
because these motors they're
not actually meant to provide the ada
system so not for linking assist but
they're actually there
to provide power steering so they
actually put so much torque on the wheel
when you're like just flinging the wheel
around yourself they actually put way
more torque on the wheel than we would
uh just driving it through the adas
messages so this wouldn't be uh this
wouldn't hit any hardware limitations at
all
for the dbc's you guys reverse engineer
do the companies
care do they say anything provide you
guys feedback
i'm not sure if we ever got any feedback
on it but i'm pretty sure they don't
really
they don't probably even know it exists
um out of curiosity how does can fd
affect things
is that something that you guys need to
consider and what are your thoughts on
it oh kind of d
that's uh i think we're going to talk
about a little more today so
i'm not going to say too much so
um when you connect a device like
carista
to your obd um and you can
unlock some features like cracking the
windows from your
key do you have any messages like that
that you can use it's not really related
to self-driving but maybe
you can detect that the car is getting
hot or something and then just crack the
windows
well yes i mean we have access to the
canvas so we can send
any message we'd like um this is not
something we'll
support uh officially of course but if
people are running forks
uh some modified versions of open pilots
like they can certainly uh implement
this stuff
great do we have any more questions down
here oh
god here out is there any plans for
weather related or or road condition
uh you know speed limits or checks say
uh freezing cold uh mountain pass and uh
you gotta limit the uh torque a bit
so that your safety uh increases
well i think it's more of a question for
the for the next speaker or research
research hat because this is more an
open pilot question there's not really
any any low level implementation needed
there
so we hear a lot about tesla over the
air updates do they go deep enough that
they would interfere with you
would they be able to break your
connection and break your control
over the car with an over-the-air update
i don't think so
um no i mean we're just tapping off the
ada the bus they don't even know we're
there so
are there any um are there any concerns
with manufacturers like forking
open pilot and creating their own
version of it in some way
or like are they concerned with you guys
at all do you have any comments on that
uh i don't know if they're concerned or
not but uh i mean
it's an open source project it's mit
licensed so they're free to do whatever
they want with it
okay is there another question over here
sorry could you quickly speak to what
kind of hardware you use are you mostly
microcontroller based do you have fpgas
on board and
what kind of latency throughput problems
do you have
between sending receiving messages to
like the core
open back into the system
um i can't really come up with a number
about our total latency
uh but we do run all of our stuff at 100
hertz and that seems to be more than
fast enough
to get the throughput we need canon is
also
not a time triggered system so if the
message comes a little bit later like
nobody cares about this
as far as which kind of hardware we use
on the panda is mainly an stm32f4
microcontroller
which runs all the low-level embedded
real-time stuff
and then on the hardware side we have a
a phone which runs all the open pilot
codes basically
there are several features that use obd
ports like some of the insurance
companies now have dongles and t-mobile
has a dongle
have you had any thoughts about
integrating with such things or ways to
make them work
do i have to pull my comma if i want to
get a better insurance rate
um we don't work with these kind of
companies uh we have a pretty small team
so this these are all features that are
not really that related to self-driving
uh so i don't think we
will spend much time in uh integrating
this but as i said like it's an open
source project so if
anybody wants to make these
modifications they're more than welcome
welcome to
because are there any other evolutionary
changes that you guys are thinking about
like
car to car communication or anything
else
uh there's some stuff going on as uh
alluded by one of the questions so can
fd is an upcoming standard which
basically uh
uh makes sure that the can bus can
handle a lot more data throughput
and this is also something we're looking
into
great do we have any other questions
down here
all right thank you so uh so for
combustion cars you guys voted
like a sending message to uh vcu
first and obviously you is going to send
the talk command to the
uh engine but like for you cards the
panda probably can do uh
it can it can directly send the total
command to
uh inverter have you guys try that
uh you mean how do you send the commands
to the inverter of an electric car
yeah for you cards you can use panda
directly send the torque command to
invert
and kind of bypass the
ecu fundamentally these systems aren't
very different so they still
they're still an acc system which is
very similar to
non-electric cars and they also still
send the command which says like okay i
want this amount of acceleration of
braking and the invertible handle is
exactly the same way as a regular
fossil fueled car would
great if we don't have oh we got some
more questions on here
a lot of questions is there any worry is
more cars have over-the-air updates that
they could roll out something like the
rav4 prime
encrypted can bus where you could have a
vehicle that works and then over the air
that
encryption is rolled out or is that too
low level to worry about that in the
future
i wouldn't be worried about that if you
have a car right now which doesn't have
any encryption going on
um they're not going to be able to do
this over the air like most of these
cars don't even have over-the-air
updates
i think tesla's the only big
manufacturer which really has that at
the moment
but also this this encryption stuff
usually requires
a more advanced microcontroller than all
of the ecu's so you can just upgrade
that over the air so wouldn't be too
worried
hey um can you also elaborate a little
bit on the next version of uh
hardware what is what is in the to-do
list
like what are you guys working for i'm
sorry i didn't fully understand
like uh next version of the hardware
what uh what is uh
what was then uh i mean what's in the
pipeline
oh it's not just a higher level
it's not my point to talk about today
have you considered building like a
flash utility in the open pilot so you
can actually do updates at the ec level
like true ota updates like for your cars
controllers
well no because for once uh
for one part we don't really want to do
easy up ecu updates uh
the structures of all of the safety
stuff which is internal to the car
and second of all we don't really need
to do this like most cars have a pretty
good interface as it is so this this is
pretty complex and we wouldn't want to
support swallow different cars obviously
great if that's it i will thank you so
much roba
i'm i'm very excited to bring to the
stage
harold our cto who runs research
where did he go all right
that's important
[Music]
hello thank you
[Applause]
good morning good morning so i'm harold
from research
and i'm going to give an overview of the
kind of work we do at coma
so our stated goal at coma is to
build a superhuman driving agent which
is basically
a level five self-driving car and i'll
talk about the way we're trying to
achieve that
first i'm gonna test my uh
pointers right that works
hmm
oh that's something
so before we can talk about how to build
a self-driving car it's important that
we have a very clear definition
of what it is that we're trying to
achieve so
to build a real self-driving car i think
the first obvious thing we want is that
it doesn't crash
crashing would be bad we can expect it
to never crash
because that's very difficult so
crashing less than an average human i
think
is a good minimum goal
another problem is that you also wanted
to get you somewhere
if it doesn't get you anywhere it's not
that practical
and for it to be really useful we wanted
to drive on
basically all the roads that a human
would have no problem
navigating so just your average driver
with a driver's license
our self-driving car should be able to
do the same things
it shouldn't oh i don't know why that
happened it shouldn't have to satisfy it
shouldn't satisfy these things just by
being super slow and avoiding hitting
anything just by driving five miles an
hour
so it should be somewhat efficient so
that humans don't get frustrated by
using this
and then the last point's a little bit
more nuanced um we want to build a
self-driving car that doesn't require
any infrastructure at all
what i mean by infrastructure is we
don't want to have to change the lane
lines or the road
or change the traffic signs and change
the traffic lights
also it appeals a little bit more to our
self-driving system
we want something that works exactly on
the roads that humans can drive on now
if you can't do that you're basically
just building a train
in a slightly different format so no
infrastructure
okay so first we'll think about the the
classical approach
that people use when building a
self-driving car
it's kind of seen generally as a
robotics problem where you have some
environment
in this case you've got the road and
then you've got a whole bunch of sensors
that tell you things about this
environment you've got cameras
radars some cases lidar imus
and all these sensors go into some
perception later this perception layer
can
analyze what these sensors are doing and
can process it in some way in many cases
you have machine learning models running
that will parse the camera data
and tell us some things about maybe
where the lane lines where the other
cars were pedestrians
all this information then produces some
perception output
which is a list of things that you think
might be relevant
for driving which is like we said laying
lines where everything
is where the people are where the
traffic lights and then this would go
into another layer which is the planning
layer
the planning layer is generally some
kind of hard-coded optimizer
that tries to optimize several different
goals which is like
don't hit things try to get somewhere
follow some traffic rules
and then the planning layer outputs some
trajectory
that you expect the car to drive which
is then executed by some kind of control
system
robert talked earlier about what that
control system kind of looks like
and here we can see the steering wheel
turning
so we'll look a little bit more into
what one of those perception systems
would be here are some examples of
things people use for self-driving cars
so you've got a machine learning model
that just looks at the video of the road
and it's labeling all these things that
might be relevant which is like cars
people
traffic lights it's probably also you've
got systems that label all the lane
lines and the sidewalks
it's laboring the bus is a different
thing as a car
and then you can compile all this
information together with some other
sensors maybe like lidar
into this 3d representation of the world
where
you've got all these cars all these lane
lines you know where you are
and you know kind of some some version
of what the environment looks like
once you have this perception output
let's go back one
i can oh yeah
there we go so we have just a classical
planning layer
you'd have some objectives that you try
to stay so like stay in your lane don't
hit other things don't hit cars stop at
traffic lights
and let's give an example here for this
scene how do we do that
well it's pretty easy right you just
drive straight stay away from the other
cars
don't don't try to go over the lane
lines so this seems pretty easy to write
an optimizer that can satisfy those
requirements
then we go to the next scenario
here this is a little bit more
complicated oh let's go back
where we have an intersection
and let's say we want to turn left at
this next intersection
now you're trying not to hit things
you're trying to stay in lanes
and you're trying to stop a traffic
light now this all doesn't seem like
much of a problem the light's green so
you can drive through the intersection
that lanes open so you can just go over
there drive there and then you turn left
at the next intersection
that doesn't seem that hard we can write
some code that does that
but if we zoom out a little bit in this
scene
i'm really confused by which button does
which on my clicker
the top one goes forward
oh there we go all right so we zoom out
a little bit in this scene
and there's a pedestrian standing on the
crosswalk now this person looks like
he's paying attention and it doesn't
look like he's going to cross if there
was a car driving
but we still kind of want to keep a safe
distance you know our optimizer has a
target which
is don't hit people so we try to keep
some distance from all the pedestrians
that
uh we're trying to avoid but what does
that actually mean
you want to drive in this left lane you
want to keep some distance from this
person but you also want to stay in the
lane
so what's the compromise like are you
going to drive in the middle of this
lane or are you going to drive a little
offset
there starts to be a lot of these
competing costs in this optimizer and it
has to be very confusing how you tune
this
to get a desirable trajectory personally
i would just
drive in the left lane and stay a little
bit away from this person and that'd be
fine
but it's hard to actually implement
these compromises correctly
and then if we change the scene a little
bit
and imagine it's a child that just
dropped his ball
for me this would completely change
things i would not go in that lane and
i'd keep
way more distance but this introduces a
new problem which is that
our perception layer doesn't output
whether this is a child
or a normal pedestrian or a child that's
holding a ball or just dropped a ball
so now it's kind of unclear how we can
write policy
that deals with pedestrians correctly
because pedestrians can encompass all
these different things
and the more of these kind of more
complicated scenes we look at the more
and more we run into these edge cases
that we really have no idea how to deal
with
so that's the classical approach
it honestly seems like the back button
works and all the other ones don't
so the flaws with this classical
approach are that
you require machine learning models that
do perception based on some camera
stream
or some lidar stream and generally these
are hand labeled
that's very resource intensive and not
very practical
the planners are some hard-coded
optimizer logic
which has generally has to have code for
a whole variety of different scenes and
environments
and this list grows and grows as your
system becomes more and more capable
and has some unbounded complexity
and then there's the other problem which
is that the planners need to take in
information from the perception model
and any list of things that we can come
up with that we think will be good
enough for the planner
tends to be incomplete we always run
into some new edge cases and actually
need to add new information
and this list of things the perception
model needs to output also grows
endlessly
so the result is you have this stack
which is massively complicated
impossible to maintain and this is why
you see many self-driving car companies
that use this approach
make a lot of progress for a few years
and then they start to stagnate because
they're working on this huge stack
that is so difficult to alter because of
how complex and intricate it is
so what can we do a friend of mine used
to say
every time you get in a car you show it
how to drive the problem is
is that it forgets and this brings up a
very powerful idea
humans don't drive by memorizing some
very long list of
rules of how to act in every environment
instead they
learn some basic traffic laws maybe but
in general they observe how other people
drive
they observe how their teachers drive
and from that
they learn how to operate a car so we
can very easily collect data of humans
driving
so how can we leverage that in the same
way that a human would
to teach the system about how driving on
a road works
so we call this an end-to-end approach
we can just build machine learning
models
that take in some raw sensor data like
video or other sensors
and can immediately just say drive like
that
so it's kind of like having video and
asking a human based on this video where
would you drive
so we can very easily collect this data
set and then we can
show the model where the human drove and
have it
predict uh predict that and then you
have this system
that will tell you where things humans
would have driven and it's
actually a very powerful idea because
when you have a data set of thousands of
users
then the model will predict where things
thousands of users
would all predict on driving together so
it's kind of some consensus approach
which can be
much more robust than just asking a
single person where they would drive
and what's really powerful about end to
end is that
all you need to make it handle more
complex scenarios
is to make the models bigger give it
more data
and it will just become better and
understand more it doesn't require more
code
it doesn't require hand tuning some
things and it doesn't require
adding extra logic for every new
scenario we support
all we need is bigger models and more
data
so given that we can redraw the diagram
and look at the new approach
so we've deleted the perception layer
all we have is raw sensor data it goes
into some big planning machine learning
model
that outputs where it wants to drive and
then that gets sent to some controls
interface
and operates the vehicle it's now much
simpler and should be far more scalable
to actually dealing with the huge
variety
of complex situations that appear on the
road
so to start
we need data and we need a lot of it so
that the machine can learn from it
openpilot collects data from all over
the world in one minute chunks
we collect currently over a hundred
thousand minutes a day
collectively it's over 50 million miles
of data collected
and that equates to a few full lifetimes
of driving
humans can learn how to drive in a few
lifetimes so it doesn't seem
unreasonable to expect
that under some conditions a machine
learning model can too
on the right you can see just a couple
weeks of data collection from the united
states you see we have a
pretty widespread data collection across
the entire country
i think there's some ai in this clicker
oh i see all right let's go
oh maybe i should just stop for a while
and let it catch up
okay this is oh that's the one i wanted
that's the one great
so just to give some examples of how
really diverse this data set is
i just made this quick tool where you
can click on the map and it'll show you
some video that's the closest
i picked some places i thought look
would look cool so we've got the golden
gate bridge
utah joshua tree national park
san francisco bay bridge new york city
the colorado mountains and so when it's
exposed to all these scenes our model
can learn
about how driving works in all these
different environments
this is some international data we've
got thailand
some rural roads in scotland nigeria
belgium singapore taiwan
so you can see driving is really
different in all these scenarios and
it's very important
that we have this massive amount of
diversity in the data set so the human
so the machine can start to understand
what's different between driving on some
farm road
in scotland where you drive on the left
and driving on some you know cobblestone
street
in belgium so we've got the data
and now we want to start thinking about
how we train this model
we want to clearly define what the
output of the model will be
we talked previously about how the model
is going to output some path
of where to drive this path is going to
be in meters it's going to say
over the next 50 meters you know turn a
few meters left or turn a few meters
right and after that straighten out
getting this information about where a
human drove
in this representation for all the video
we have is actually not
trivial we need a localizer to do this
so a localizer answers the question
where
am i right now where am i looking where
am i going
and where did i go once we can answer
those questions we can then generate the
ground truth
for our machine learning models on the
right here you can just see
some satellite view overlaid with
some images we use to represent cameras
of video we've taken
so there's just four parallel lanes
somewhere in the bay area
so to build a localizer we start with
gps or if you want to call all those
constellations
including the chinese and the europeans
who call it gnss
gps doesn't exactly tell you where you
are it has these satellites
orbiting around the world and it tells
you
kind of how far away every satellite is
from you
if you know that and you know where the
satellites are you can then kind of
estimate where you are
and this is what most gps receivers do
the thing is they use pretty simple
algorithms with not that much compute to
do that
when satellites tell you how far away
they are there's a lot of error in this
measurement
it can be influenced by the humidity of
the atmosphere by the relativity errors
in the satellite's atomic clocks
it can be influenced by things in the uh
just ionization in the atmosphere and so
we can get quite a bit more accurate
results if we just take these raw
measurements and do our own processing
so we built an open source project
called leica which is capable of doing
all this processing and we can get much
more accurate results
one of the cool things that we can do by
having our own library is we also get
the
doppler shifts to every satellite at
doppler shifts
you can measure the difference in
frequency that you're seeing from a
satellite and it will tell you the
relative speed
of your receiver to the satellite and
this actually gives you such accurate
speed readings
that the gps gives you far better speed
readings than the speedometer of your
car
so this is very useful for the kind of
localization we're trying to do
one of the examples of things like i can
do is
if there's activity on the surface of
the sun this ionizes the earth's
atmosphere and can cause a few meters of
localization error in any normal gps
receiver
we can download some reports from nasa
that tell us about
the solar activity and compensate
accordingly making our localizer even
more accurate
so we've got raw gps measurements that
we process a little bit massage a little
bit to get low errors
and we can use that to get a location
and to get speed
but it doesn't tell you where you're
looking it just tells you the position
not the orientation
another problem is that gps is great but
not always
when you're under trees in a tunnel in a
parking garage gps either works worse or
not at all
so to be able to have ground truth in
all driving scenes
we want to have a system that always
works
so it needs to work when gps is spotty
and sometimes even when gps is not there
at all for intermittent periods of time
so we want to do sensor fusion with
redundant sensors
we made an open source project to do
this it's called red nose
and it's a pretty large kalman filter
which is a type of optimization filter
that takes in all these different
measurements including gps
and will output its best estimate of
where you are
and the orientation of your vehicle
one of the so we use imu data here
speedometer data
but the most important is actually
camera data
so we can look at the video of uh of the
dash cam
and we can see how things are moving in
the scene and we can track those
with things called orb features and we
can use
those uh pieces of information in our in
our sensor fusion system
and it'll give us accurate information
about not only where we're going but
also
what orientation we have how the car is
turning
if you have very accurate localization
of both your orientation and position
across
many frames you can start to stitch
things together so here you can see kind
of a cool example
of how well our localizer works we take
all these points that it's seeing while
driving along this road
and you project them all down and see
this beautiful top-down view
of you passing an exit but staying in
your lane
and this localizes very accurate and
that's great
but the most important thing about it is
that it is robust
oh no no no it needs to work
in all the situations we want to expect
our car to drive which is all of them so
it needs to work when the scene is dark
when there's not many things going on
not many features to tell you about
where you're going in this case we still
have a sign
and but once you pass the sign really
you've just got a couple lines on the
road
and this can really confuse the camera
odometry system
this is actually an example of a bug we
had only a few releases ago
where if the lines were continuous then
it would match features to itself
and get super confused and start cutting
the turn but that's now been fixed
and so far the system has become
incredibly robust
so now we've got ground truth we know
where the human drove
for all this video we have so all we
have to do
is we train a neural network that takes
in a couple of video a couple of frames
from the video we just use two
and predicts a path of where a human
would have driven in that situation
here you can see the system training
it's a little bit noisy at the end but
it's already getting right that you have
to go mostly straight
the model we actually use is an
efficient net b2
takes in the images here which are that
size and then goes to some head and
outputs this path
no no no no
okay so we've trained our machine
learning model
and now it's time to find out whether it
works
so generally in machine learning you
have some training set
of data that you've worked on
and then you've got some other data that
you keep separate
to test on just to make sure that it's
not overfitting so we've got all these
examples
from our validation set
and we look at them it looks pretty cool
we've got some lane lines in there as
well
that was easy to do so we just added
those and you can see it turns
turns there you can see it even gets the
3d parts pretty
pretty nicely here it's pretty things
going uphill and
i'm going over a crest of a hill over
there but in general this all looks
pretty good
this uh looks like what i would have
labeled if i were to say
where to drive so
we're ready to try it out on a car so we
take this model we implement it
we make it so that its output is
executed by controls
and it doesn't work at all we drive on
it
it completely drifts out of the lane
almost immediately
so there's this quote about software
engineering that i think is really
applicable
we do these things not because they're
easy but because we thought they would
be easy
and so this applies here too but this
brings us to
what can we do now we thought it would
work
it looked like it worked on the data we
tried it but
in the real world it fails completely
we could keep trying things and then try
it on a car but this is very time
consuming and gives us
a very very slow iteration speed
so we want to have some way to test it
online from
offline from our desks before we go out
and try it on a real car again
to do this we would need a simulator so
that
in the simulator the model can predict
where it wants to drive we can have some
simulated control system execute on that
trajectory
and we can then see how it behaves
hopefully
if the model is driving on its own path
and this is simulated
in full rollout we should start to see
similar results we saw in the real world
so what kind of simulator can we use
um you can use things like gta 5 or
carla or truck simulator
i mean there's roads there and they look
kind of all right but the problem you
get with those kind of simulators is
very similar to what we talked about at
the beginning
the amount of environments and scenarios
one of those simulators can simulate
is always going to be limited to the
amount of scenarios you engineered into
it
it's never going to capture the full
diversity of human driving
if you want a self-driving system that
can work in nigeria or
in the country roads of scotland you
also need a simulator that can represent
that
otherwise if it fails there we never
know about it
so we want to build a simulator that is
based off real data
and can simulate the entire spectrum of
our data set
so we use a little bit of a trick which
is you just take video
and you can just warp it a little bit
left and right make it appear as though
you're driving
in a different location than you
actually did
you can see as it's moving around in the
simulator that things are warping a
little bit
and obviously if you go very far from
where the video was taken
there'll be nothing left but this simple
trick seems to be good enough to do some
simple simulations
and those simulations tend to be good
enough
so let's try the system we just trained
in one of these simulators and see what
happens
so on top we see we just have this
segment of driving down a road behind a
truck
and we have the model that predicts your
path and we try to
execute that plan you can see it kind of
already starts to drift out a little bit
but in reality it started to drift out
much much much quicker than that
and then we realized this is because in
the real world there's a lot of
disturbances that act upon the car
there's little bumps in the road the
tires aren't perfectly aligned
and there's things like wind gusts and
all these things push the car around a
little bit
in a way that the model didn't want it
to
so we can simulate those disturbances
too and this is what you see in the
bottom frame
and you see it drifts out in a matter of
a few seconds this is exactly what we
saw in the real world
so trying to understand what is actually
happening and why
just having the model predict what it
thinks a human would have done in this
situation isn't enough
is kind of difficult and something we
argue about a lot and it's kind of
is worth the whole discussion in itself
but i'll try to give
as clear of an explanation as i can
which is
imagine the car is on the right of this
lane so it's not perfectly centered
what would a human do in that situation
you could imagine that the human would
probably correct and go back to the
center of the lane
and this is probably true but when would
the human correct you can see here it
tries to correct a little bit at the end
but in the beginning it still goes
straight
so if that's what's happening and you
have this car at time
t0 which predicts to go straight and
then recover
then tells the controls to do this it
goes straight
and it's still in the same position in
the lane and you ask it again what would
a human in this case
but nothing has changed so it answers
the question in exactly the same way
again
it says go straight and eventually
recover
and if we run this in a loop the system
never recovers
it keeps predicting just go straight for
now and at some point recover
because that's what a human would have
done but with nothing keeping track
upon the fact that it's never actually
executing recoveries that it had in mind
it just continues to accumulate error
and if there's any amount of disturbance
like wind pushing this to the right
it'll just drift out of the lane
and so this is what we see in the real
world and it's also what we see in the
simulator now
oh almost
so how do we solve this
like we mentioned really the problem is
is that the model is never learning to
recover from mistakes
it gets pushed out of where it wants to
be a little bit and it doesn't recover
so one of the ways we can solve this is
by training directly in a simulator
in the same simulator we've been talking
about
push the model left and right a little
bit introduce these disturbances
and tell the model recover right now and
that's what you can see in these gifts
right here
so we've got the black path is where the
human actually drove in this situation
and we pushed the car around a little
bit and we tell it that's where a human
was driving
get back there immediately and that's
what you see the white path is which the
model is predicting so you're seeing
we're pushing the car around
and the model is seeing that and it's
shifting this path
to where the human was driving you can
see the same in this situation
there's actually a lot of details
involved in getting training in a
simulator like this to work
and that's the culmination of a few
years of worker comma
we've got some more technical write-ups
about the details of that but in essence
this is what it is
so we've got this new solution and we
think it might work
but how do we know if it works we
already talked about the importance of
testing before
because we don't want to test in cars
testing in cars is super time consuming
we actually have this rule at a research
a coma
that testing in cars is not allowed if
you can't reproduce it on your desk
it's probably not worth looking into
so we want tests that work completely
offline
and give us indications about how the
model will perform in the real world
everything that we don't track or test
explicitly
will probably regress or break at some
point we've experienced this
through a lot of trial and error and we
are now
very aware of the fact that every
situation we want to work correctly
needs to be appropriately tested so we
put them all through
a whole series of tests give it a little
eye exam
so i'll just give some quick examples of
the kind of tests we can run that just
give some indication about what's going
on
um the first thing is we can just
ask it the model how fast it's driving
we know how fast the car was driving
if the model doesn't know exactly its
own speed um that's generally an
indication of some kind of failure
we can also
we can check the accuracy of how closely
it's matching
the path that the human was driving how
closely it's matching
the predictions of some lane lines if
anything here looks weird or
there's a lot of outliers that's usually
an indication of a failure that we would
want to look into
we also have this simulator so we can
actually just let the system drive
in simulation and do all kinds of tests
of how it behaves
we can introduce lag in the steering
rack and see how it reacts to that
we can introduce disturbances such as
wind
we can make the steering wheel offset
pretty large so that it's just
pulling left all the time and we can see
how it reacts to all these situations
and kind of get an idea of how it would
fail and
how many disturbances are necessary for
it to fail
so we drive the model in simulation on
thousands and thousands of minutes of
driving
and we see kind of what the overall
results are we check how often it
deviates from the human path
we check does it cut turns too much does
it overshoot turns too much
is it just kind of too aggressive all
the time and all these things we can
find out by just doing metrics on
thousands and thousands of minutes of
simulated driving
um
so one of the other tests we do is
we just check overall when did the model
predict to do something
that is completely different from what
the human actually did in this situation
so we did the model ever predict
something that looks like a swerve
compared to what the human did
and here are some of those results of
those tests
as you can see they're basically all
lane changes
the human made a lane change which is
the white path and
the model predicted to stay in your lane
this isn't a bad thing but it brings up
this interesting point which is that
we expected the model to always output
the right answer which is what a human
would have done
but that's not there's sometimes there's
more than one correct answer
whether or not you make a lane change
both making the lane change or not
making the lane change is generally
acceptable and it's definitely both
safe so
we need to give them all some context so
that it can understand
how to deal with this we need to make
sure the model understands where it
wants to go so that i can
make a lane change if it's necessary or
turn right or left if it's necessary
here are some examples of this happening
so you've got a human making a lane
change past this car
and here you've got an intersection
where there's a
turn left lane and there's a go straight
lane
and here in this case the person kept
left to make the left turn but
might have just as well just gone
straight
so to deal with this problem we just
have like a small set of hand labeled
classes which is
you can go straight you can make a lane
change you can keep left keep right you
can turn left turn right
and we label those we give that model
the model that is context so it makes
sure that
when the model's making a lane change
it's doing that when it's told to make a
lane change
um and then that brings us to there's
really
only one correct path given this
information
so we fix this problem by labeling that
you'll hear later in uh
in the talks a little bit more about how
exactly we label that
and so this kind of works and
it more than kind of works this is an
end-to-end system that we've shipped
and since a few months has been running
on open pilot you can go into settings
and disable lane lines
and it will just work completely end to
end in the way that we've described
this is as far as i know the only kind
of end-to-end self-driving system that
works at all
and it's definitely the only one that
you can experience
so i'll just go through some quick
examples
of kind of the power of this end-to-end
approach
and things that it allows us to do
i think the button's sticky i think
that's what's going on
oh oh did i do that oh
wrong talk
but the clicker definitely has a mind of
its own
anyway so uh quickly i'll give some
examples
of lane changes which are one of the
things that's possible with this
end-to-end thing
we can we've told the model about lane
changes during training
and so we can also tell her to do a lane
change like a human would
i'll take a drink break while we're oh
we're taking a break anyway
lane changes are too good yeah
it's trying to keep it a secret
trust me the lane changes are going to
be worth it when they're finally
revealed
yeah we can we can talk about it in the
q a as well but uh
i will take a short break everyone can
think about the questions they're going
to ask later
i guess this is kind of a good place to
take a break that was how we build it
and then we'll have the grand reveal of
the results
you take questions okay i can take some
questions right now yeah
we'll do a couple questions until we've
got the laneless
training takes a results time
[Laughter]
yeah somebody's trying to get the gpus
up and running
any questions
sure so um i saw on the slide you had an
efficient net and then a fully connected
layer
and that corresponded to um vision and
planning
uh could you go a little bit more into
um like
are they separated or are they all
trained at once
um is there any separate training of
those two model components
uh no it's just uh it's just an
architectural separation so you've got
the convnet which is so the
b2 is fully calm and then you've got
some dense layers on the bottom but it's
all trained together
how many parameters on the bottom versus
the the top i don't know or roughly
just a few million in the bottom and i
don't know how much inefficient that is
that's several million too
oh we're back back back back right so
this approach works
and we've got end-to-end machine
learning working for self-driving
here's uh the first example of this is
we've got end-to-end lane changes
so this system was never explicitly
taught about lane changes uh lane lines
it was never told that a lane change is
crossing a lane line
we just teach it these are lane changes
that humans did try to do them like that
and in fact these lane changes will work
perfectly fine if there were no lane
lines if this was snowy
or it was just a badly maintained road
lane changes would jerk would work just
as well as they would for humans
next example is
just driving lanelessly in a variety of
situations so
on the left we've got a road that's
completely snowed in if there were lane
lines we can't see them
and a classical system would struggle
here there's not really much to go off
you could say that maybe the road ends
there and you try to stay on the road
but a language system can clearly see
this is where a human would have driven
because that's where the
tire grooves are and it can smoothly
just do exactly what a human did
this is the power of the end-to-end
machine learning on the right here you
can see
there's a turn to the right and there's
quite a bit of oncoming traffic that
looks quite intimidating
and the lane this model does what a
human did which is cut the turn
aggressively
to avoid this oncoming traffic again
these are all just
features that it can learn just by
observing humans we didn't ever tell it
to avoid traffic we didn't ever tell it
to follow the grooves in snow
it's just observing humans and doing
what a human would have done
so what about longitudinal this entire
talk has been talking about lateral
control of the vehicle which is just
controlling the steering wheel
there's more than that to controlling a
vehicle you also need to control the gas
and the brake
we've been working on this for quite a
long time and only the last few months
have we really been able to ship
blameless models that work
well and so that's been the main focus
but all of the lessons we've learned and
all the strategies we apply should work
perfectly fine for controlling
longitudinal as well
so recently we just started working on
that and i'll give some
quick examples of what some end-to-end
longitudinal features would be
so we've got uh model-based fcws that
was shipped a few releases ago
so we can just ask the model a question
you know how humans drive
tell me if you think a human would break
in the next few seconds and so that's
what you see here when the fcw pops up
the model is saying whoa
i think a human would have break hard
here and so this is shipped in open
pilot
if you're engaged and you're in a
situation like this you'll get a warning
from the model saying
you might want to break pretty hard here
here's another example so again this
model we're never told it about
cars explicitly or anything like that
we're just asking it tell us when you
think the model would break
when a human would break hard
another thing we can do is we can ask
the model tell us where you think a
human would stop
again that's basically the same ground
truth as the paths we just check where
the velocity becomes zero and a
human driver becomes stationary for a
while so here you can see the model is
predicting a stop line which is where
the human would stop
right by the red traffic light and here
you can see it by a stop sign
so this is completely end to end seeing
the traffic lights because it knows
that's where humans generally stop
and the same with the stop sign it's not
explicitly looking at the stop sign it
just looks at the scene and knows a
human would probably stop here
so what's next for comma research
stop lines is one of the features that
we haven't rolled out yet that's the
only thing in the talk that's
kind of still experimental we might want
to ship that soon if we can get it to
work pretty well
in general we're really just looking at
making these models bigger and smarter
and understand more and more complex
environments so this is going to keep
improving end-to-end lateral control and
then we also want to move more and more
to end-to-end longitudinal control
currently open pilot still uses lead car
detectors and
just normal acc commands to control the
longitudinal control
and we want to start moving that to
exactly the same full end-to-end
architecture we're using for lateral
questions
[Applause]
guys sure yeah
um
it is used for some parameter estimation
of the vehicle controls yeah
i'm not really i'm not sure why that
would be necessary
um the model shouldn't require gps for
anything at runtime
are you saying because you want to make
a map of the places to stop or something
right right so we do rely on gps for
ground truthing but
like i mentioned we do support spotty
gps and gp and so
the system should work completely
without gps and so currently our data
set should capture all the situations
where gps doesn't work
just because if you had gps 40 seconds
ago um
then that's enough to carry through
through the entire chunk of data we
analyze
so that's not another requirement i'm
going to start with
questions down the row here
i want to ask how you look at training
data and decide
this is good driving and by that i mean
what happens if
in your training set you look at night
and the driving in the area of this bar
at night after 3am is kind of weaving
all over the place
or a human tends to roll this stop sign
or
uh somebody's just weaving on the
highway or quite frankly you drive like
i do when i'm not
driving on open pilot how do you get rid
of all my driving data and train on the
chill people
so we kind of think about it as
you're not just looking at mimicking one
person right we're looking at this whole
data set
and we make the assumption that when
humans make mistakes
they tend to do it in noisy uncorrelated
ways
and so if you have a system that behaves
like it would the average or the median
of thousands of different drivers would
that's generally
a very good approach if you ask you know
50 people
to look at a video and exactly what they
would do the consensus of that
should be very stable and i think good
driving if that ends up that the average
driver is perhaps too aggressive what we
want openpilot to be
we can start you know doing some basic
things to differentiate some
aggressiveness and tune it down a little
bit so a little bit more conservative
i can see how that would work for most
things but just how would you control
for saying
rolling a stop sign uh which quite
frankly
the average is going to show that a fair
bit
so right now we're just really not at
the stage where it makes sense to
think about things that detailed i think
we first want to get to what an average
human would do
and if for some reason we want the
system to behave differently we can
think about that then and there's
some tricks to do some filtering of
certain types of human behaviors but
i think average human behavior would be
a massive victory for the entire
self-driving space
thanks again um question here how do you
train out
like unwanted behavior one thing that
they've seen
with this end-to-end approach is
sometimes car
tries to follow what driver in front of
you does
it kind of ignores lane lines it just
if that car goes right left it just
follows it
yeah so that's kind of similar to
jason's question and like i said
generally mistakes humans make are very
noisy and uncorrelated and so if you
take
the average of lifetimes of thousands of
different humans
the behavior should be very consistent
and should be
pretty desirable
yeah i mean like like i just said i
think
average human driving would be a huge
victory for the self-driving space
no system in the world is anywhere close
to that so that would still be
uh much better than anything in the
world
yeah so in regards to
n10 lateral control if you let's say had
a camera on both sides of your vehicle
so you had a wider field of view
and you were training on that would the
ai
start to learn to move over to the left
side of the lane
if there's a semi on the right side like
a human would assuming there's no car on
the left side
or would that kind of get washed out in
the training no i'm pretty sure that
would
consistently i think humans try to keep
distance from cars next to them in
highways
and so i'm pretty confident that model
should learn behavior like that you can
actually see
in some cases if there's a semi on the
left side of the lane the end-to-end
planning will deviate slightly
awesome thank you
uh yeah so first of all thanks again for
the presentation super informative and
amazing technology um but um kind of
like inverse to the two bias questions
that came before
um have you found um
either any places where it's relevant or
where it's
useful to have explainability backwards
like if the model does something that's
particularly weird one time like it
swerves out a particular type of
lane or it takes certain types of exits
um are you able to go back and tell
what influenced the model to actually
behave this way yeah so that's
i think a very interesting question and
something that i when i started working
on these things was much more worried
about than i am now i think generally
these models are seen as kind of these
black box things that can predict behave
in unpredictable or weird ways and
there's no way of explaining it
but so far every case that we've seen of
it behaving something that initially
looked weird
we've been very easily able to reproduce
and explain
to give one quick example of an issue we
used to have is
everything was fine the roads looked
fine and it was sometimes randomly start
predicting lane lines in the center of
the road
and this was a bit of a mystery for a
while and then you start to look at the
ground truth
uh that has you know lane lines in the
middle of the road and you find
there's some person that had like a
fluffy thing at the front of his car
which was kind of colored orange which
was detected as a lane line
so this kind of made it into the data
set and then the model sometimes behaved
that way
but so far every single weird behavior
we've seen we've been able to explain
same yeah um what's your intuition on
continuously
making use of larger models and keeping
just
sort of taking the traditional ml and
just scaling it forward
because in the case of like real like
real world like you have distributional
shifts in that case examples that occur
very rarely
would be it would be unlikely for the
model to make any sort of generalization
on that sort of data so how do you
sort of augment the data so make use of
examples that occur
very rarely um i'd say so far we haven't
really seen much of the issues
with that yet if there have been issues
where the model struggles in rare cases
of that
it seems to be that generally the model
is just limited by the quality of our
ground truth
if there's you know 0.1 percent of data
that looks completely broken because of
some bug
this will usually manifest itself in the
model not being that smart in the end
and not being able to see rare cases but
as we've improved the ground truth
quality
even with the same size of model we've
seen the model become smarter and
smarter and can learn more and more rare
events
maybe someday some kind of sampling
would be necessary but i think so far
we're making very good progress without
that yes so
my question is uh specifically in
regards to
driver alertness so one of the things
that i've noticed that as i'm driving
uh there's some scenarios that i run
into that i'm particularly on
high alert so i was wondering if there
was any consideration
with a comma team into developing a
predictive model
uh maybe you have different levels of
alertness that that
could either be communicated to the
driver or that the
that you recognize as as like high risk
scenarios yeah so
currently we actually have the model
tell us how likely it thinks that open
pilot would be engaged right now
and how likely it is that a user would
take over from open pilot in the next
few seconds either with the brake pedal
or the gas pedal or with the steering
wheel
so the model already completely outputs
all this information
we've thought about communicating this
somehow but just really haven't gotten
around to it but we do have
tons of introspection in how much
confidence the model has
in that the situation is weird or that a
human would start to feel uncomfortable
have you and uh one follow-up question
have you thought about like creating
a project for you know kind of like a
take-home project type of
type of thing for where you could let's
say you could
export a csv file and ask a few
questions
you know and and ask someone to like
predict
to develop a a model like based on
you know 10 data points or 20 data
points that
that like oh if you if you think this
would be
more more likely to be a high impact
scenario
so like say for example you could go to
a
insurance company look here are the top
10 uh
reasons for car incidents and then
you could you could you could have like
specific questions based on that
so just like just not entirely sure if i
understand the question well just in the
same sense that you have like um if you
look on the website you had you used to
have the 500
bounty so i was asking like it would
have you
was there any consideration or would you
consider like potentially having
something where you took
um just some general instances and then
you you gave that as a project to
the community that we could potentially
work on i mean if you're talking about
developing on the model that's kind of
infeasible for anyone that doesn't have
access to all the data
and all the infrastructure that we use
so
that's not something that's easy to
distribute development on
we got a question upstairs hi a question
regarding the evolution of this approach
i mean
my impression that it can brings you so
far like what you do
but in building like a very nice l2 and
keep assist
but at some point you probably want to
go to you know like end-to-end
trained unprotected left turns and going
to the l4
and can you do you think you can push
this approach where like you may
like use the imaging data and the
trajectory of the actual driver for
training or you'll have to do some like
paradigm shift where you
now go to zero approach and like where
you have to rewrite the whole training
pipeline
um so i think in general this end-to-end
training scales
much further than any other approach i
mean you mentioned things like mu0
it might be possible that a distribution
shift of that level
is necessary that we can't use the
simulator the way we do now
and need something a little bit more
advanced with some kind of learn
simulator or
you know other other more advanced
machine learning techniques something
like that but it's like ideation it's
there's no
nothing like roadmap where you think
okay i probably go do it this way
like in five years uh we've got some
internal discussions about that but no
nothing concrete
okay cool thanks great thank you
all right um i screwed up my last
question luckily somebody else asked the
right one so this time i took notes
um so two quick questions and one
thought
first question uh do you so with your
human example under crossing
do you um consider the bounding box
movement
if you detect it makes sense if not
because even tesla i don't think you
didn't do that wait i'm just looking for
where you are actually oh
i'm here oh okay sorry i'm like the
voice so what do you mean by the
bounding box
oh yeah if you so your example of the
human on the border crossing
on the lane line crosstalk on the lane
lane crossing yeah would you consider
the bounding box
and the movement of it like the
acceleration or what do you mean by
bounding or for predicting well you make
the bounding box of the human you
you see that there's a human there right
so you make a rectangle around here oh
okay yeah
like now the movement over time right so
would you consider that for example
as to better predict like with stopping
or going
right um down the line something like
that no so we don't want to do anything
like that
so we really want a fully end-to-end
approach the system should completely
learn that a human would slow down or
avoid a human
and that behavior will come into the
end-to-end system right we never want to
explicitly track these things
okay okay okay so that goes with my
second that was
the thought like of thinking differently
um instead of like
finding out if it's like a kid or adult
you could like do maybe post estimation
right like you could um train a model
like using epic mega games um
meta human stuff right right so that's
that's the kind of stuff we want to
avoid we really want a system that is
very simple architecture you take in
training data
behave like a human so that we don't
have to write any of these code or
scenarios to deal with any complexity
right i figured you could kind of just
make a model that um
extrapolates like the movement right the
skeleton and yeah sure but the problem
is this there's an endless list of these
things right
right and it never ends yeah okay um and
then last question
um it's more for me like i work on the
vr operating system kind of thing and
the slam stuff is really not great the
open source slam stuff in some ways
um your system the sensor fusion um slam
tracking system would that work also for
like lower velocity and like
vr kind of systems or is it more yes it
should completely work
so we haven't really been able to spend
much time into documenting
or you know putting effort into really
making this library accessible
but it is open source you can see how we
use it and i think it has
a lot of compelling features compared to
other solutions
great i'm going to move to the back of
the room we'll come back to the front
i feel like we had a lot of questions
down here
hi so you mentioned kind of the machine
learning mantra of
more data bigger models and you've been
working with these models for a while
uh do you have any sort of kind of
estimation of
how big these models are going to have
to get in order to reach that goal
of driving as well as a human or are we
not even at the point of
estimating that um
i think it's difficult to estimate that
but internally we talk a lot about
you know what's what kind of animal
would be able to drive a car
would a cockroach be able to drive a car
probably not
i think that's kind of the scale that
some of the large models people use
these days are at
like insect level um i think we're
pretty confident that like a bird or
or a small mammal would probably be able
to drive a car so if you want to have
some very rough estimation i think that
that makes sense to think about how many
neurons
do these animals have that seem to be
show complex enough behavior
great we also should have plenty of time
for everyone's questions so
hi um so you described that the
um end-to-end approach is essentially
predicting the
trajectory that the human would take in
the picture right
isn't that strictly speaking not fully
end to end because
fully intent to me would mean that you
record all of the inputs that the human
took in the car and then predict those
raw inputs from
each frame a number of steps into the
future
yes so it's not fully end to end i think
i glossed over that a little bit too
quickly but
uh we still make the separation between
planning and controls
uh what you're saying is you could skip
that as well just take in video
output the car commands the problem with
that is that it makes very difficult to
abstract different types of cars so we
support all these different types of
cars
so we already need some kind of common
interface there um
that's one reason the other reason is
some level of introspection is useful if
we're just seeing the steering inputs
and the gas and brake inputs it becomes
harder to
see what the model is thinking and we
really don't think that much is lost in
this abstraction layer between planning
and controls
it seems like it's reasonable to think
that some plan
some trajectory is planned and then you
should just always be able to execute
that with controls i don't think there's
that much nuance
okay we're back here right similar to a
couple
questions but as far as the level five
and
uh somebody mentioned the model but i
was curious more on the hardware do you
think
the the camera and the sensors that you
have now is sufficient
or is it going to require like mimicking
more like a human like
binocular vision or you know only
cameras or
is there any kind of idea of hardware
wise what the future is going to hold
yeah i think there's some limitations to
the current system
and there's some reliability concerns
but
in general this isn't the limiting
factor given the video
that the system is getting it can do
much better and this is true for all
self-driving systems they're limited by
the compute
and by the software not by the sensors
hi uh i'm curious if you've all been
thinking about this or if it's even
appropriate
using data visualization or
dimensionality reduction
techniques to try to peek into the black
box of the model so to speak a little
bit to see what features of the world
your model is starting to learn and pick
out for its processing
yeah we've done various experiments with
this at some point tried to train the
gans that try to kind of reconstruct
some representation and we can see it
what things
things are important and stuff like that
but like i mentioned in one of the
earlier questions
we've never really had issues trying to
understand what the model is doing
with just a little bit of effort we've
always very easily understood why the
model is making a certain mistake
and extra introspection wouldn't really
help us that much if it was necessary we
could build more tools but it's not a
huge part of the way we work right now
hello so a quick question as you're
ingesting data into the knowledge base
are you capturing video for all active
sessions or is it simply a sampling of
the population
and then secondly how does my active
session benefit
from the contents of the knowledge base
i'm not entirely sure what you're asking
so you're just saying is all data being
used
to train the model um no so we do some
kind of
diverse sample with some basic logic to
enforce some level of diversity
and then we train on that if we see
benefits from training on larger data
sets then we can move to larger data
sets but
currently that doesn't seem to be the
limiting factor
how do you plan to gather the context of
a curvature
what do you mean by the context of a
curvature whether that
curvature is going to say do
a full 90 degrees or
what's i don't see how you can
understand the curvature unless you have
a top-down
view like a map i mean
you're talking about the ground truth or
how does the model see this um
i could think that you could ground
truth uh and to win
longitudinal by using open street maps
and then
using a test track with um no no so this
is all
just ground truth by using a localizer
on human data we know exactly
how a human moved through the world from
the localizer and so that's the ground
truth and that's what we make the model
predict
does the localizer see the context of
the curvature
like the future of it yes the view the
localizer knows
we use the whole future of the of the
drive so we do
we do know that yeah hey um has this
been tested on pedestrian crossings like
does it stop
if someone's crossing the street so we
as i mentioned
longitudinal currently an open pilot
isn't that end to end yet
we've done some basic experimentation
with end-to-end longitudinal and we
haven't gotten that far with it yet it
does react to some things
and it doesn't react to other things
we're still working on that we only just
started really working on ant
longitudinal
but i imagine it would react pretty
appropriately once we start working on
it actively
so my question is more related to the
switching of the lanes
so does the model take into account the
the state of the
blind spy blind spot monitoring is that
um
is that input data taken into account in
the model that's not taken account into
the model i think open pilot on some
cars it will just prevent
you telling the model to lane change if
there is a car in the blind spot
um yeah did i have some questions
in the middle all right i'm headed back
front
uh this is a question about the
simulator so
you train off policy and this induces
distributional shift into
to account for that you throw in some
noise what you do with your warping
for richer more more dynamic multi-agent
scenes like going through an
intersection
do you think this approach will scale uh
what will this work and if not
do you have to have a multi-agent
dynamics model
like wave ai where they predict the
trajectories of
other agents um yeah i mean
like we were talking about earlier it's
possible that we need a little bit of a
paradigm shift away from this
type of warp simulator that we're using
now but i think just right now it's not
really a limiting factor we have quite a
bit of ways to go and then
maybe after that we can see if there's
different strategies that can
simulate some more dynamics for example
do you guys use some sort of like
self-supervised learning setup like um
i guess cathartic and his talk cvpr he
talked about like
how tessa's like building sort of self
label annotation
engine on training examples where the
model didn't predict
was the accuracy of the prediction
wasn't that high do you guys see that as
some sort of
useful pruning of data
right now we don't use that and i don't
think we have a need for it right now
um so in this new like what would a
human do
type of training for your models um are
you still
like hand labeling for like anomalies
right when you have a dog that runs in
the road or maybe an obstruction
um does this new model remove
the the requirement of that like is
there still a use case for
comma pencil or is that legacy now
um so comma pencil has a very important
use in the localizer
the localizer assumes that everything in
the video
is an enviro static environment and by
how that moves it knows how its
camera is moving so that doesn't work if
you
assume that moving cars and moving
pedestrians are part of the environment
so
comma pencil is incredibly important
there to filter out the things that are
moving through the scene
which are not static and the static
background which can be used for
localization
so common pencil will always stay for
that common pencil also we get lane
lines from that
and lead cars which is currently still
used in openpilot
and we can conceive beings useful for at
least some level of filtering and
introspection forever
but it'll just the policy will rely less
and less on these kind of things as we
move forward
um i think someone you touched on a
little bit but
um when your model is
making mistake i guess i'm just
wondering is generally the confidence
high when you're making a mistake and
is there any kind of approaches that
you're taking
to try to anticipate whether i'm going
to make a mistake or i'm more likely to
fail uh yeah yeah so uh
like i mentioned earlier the model does
predict the likelihood that it thinks a
human would disengage or take over
the likelihood that you are engaged it's
very rare for the model to be confident
and still make mistakes um generally if
that does happen that was due to some
crazy data bug
that we've fixed i can't
remember seeing any cases like that
recently
um this is a bit of a philosophical
question because
from what i've gathered it seems like
you guys are trying to build a model
that
behaves like a human more than just like
an object prediction model
what impacts do you think this will have
on agi in the future
say like five ten years from now um do
you think it'll
help out with that at all or do you
think it'll make it more possible
i mean i think this is just a step
towards agi i think this is
more you know more generic machine
learning that will
scale and sometimes might create
superhuman ais hi
uh so first a comment i work at a wave
ai
and we have a end-to-end lateral and
longitudinal okay
right that yours is the only one you can
buy and try it yourself
i appreciate that uh i don't know if you
you could have seen the videos in the
cvpr uh workshop we had
um i think i've only very briefly seen
things i don't think i really looked
into it
um the question you've mentioned that
most of the stuff you've been doing to
improve the model is improving the
ground truth
but if it's end to end i'm not sure what
ground truth you're improving is that
just
failures of the localizer yes pretty
much so the localizer failures uh
they can fail in many different ways
mostly because how much of it relies on
video
and you have all these different types
of driving scenes
so it didn't talk that much about the
localizer but we started two open source
projects based on it so it's clearly a
big part
of what we do probably spent two
two to three years really iterating
through the localizer making sure that
it's robust
you have you know other slam systems
like orbslam
stuff like that that is very accurate
and works most of the time
but they tend to fail in rare cases
which are still not that rare and need
to be fixed so
we spend a lot of time working through
that thanks we've got another question
upstairs
oh hey i'm just curious if the
self-driving models that you're using
primarily seem to be used on highways
and i think of
driving in general to kind of really be
split into highway driving and
sort of city driving with stop signs and
people and stuff like that and i see
those as two
kind of distinct problems do you think
that the models that you're
building now actually can work safely in
city environments or do you see any
challenges
looking ahead to level five in that
regard
so we currently focus on highway driving
just because it's the most useful we
want to make
self-driving cars but we do want to ship
cool and useful things along the way
i don't think there's anything in this
strategy that's inherently limited to
highway driving or any specific scenes i
think it will scale perfectly fine
but it is significantly harder to drive
in the city i think than on highways
hello i have a bit of an open-ended
question
do you guys see like any differences in
the average
of the way that people drive in like
tijuana and like
l.a and san diego i can't say i've ever
looked at the differences between cities
but there's certainly a difference
between continents
uh hi i have a question since you say
you uh
uh finally like uh let let a human kind
of teach the
agent to learn how to drive so when is
the day
uh come plan to let us teach it when not
working
i mean implicitly that already happens
because when
a user disengages from the system that's
a signal
that the user wasn't happy with the way
it works so
there's already this kind of feedback
loop we have very good ground truth for
you know when a user didn't think the
model should drive
so we actually have very accurate
metrics on how confident people are and
what it's doing
we're back here hey harold um in your
blog
posts on lateral planning you talk about
ways that the model will cheat in the
simulations
could you go through some of the ways
that you all detect and
mitigate against the model cheating
so just quickly on that
when we move around in the simulator the
image warps and this can be detected by
the model
which is what the cheating is so one of
the ways we can detect that
is by introducing warp
without actually having real data so we
can have fake data introduce warp and
seeing if the model reacts
and so we have tools like that that
allow us to measure some level of
cheating and we had some introspection
into that great these are our last three
right down here i wanted to ask how your
model training process scales or doesn't
scale and this is
my ignorance on machine learning in in
general
when you iterate on your model are you
throwing away the previous model and
starting again from scratch
like if i had a new human driver 16
years old and
they had an oops a collision they would
learn from that and move on and
become a 17 year old driver instead of
16 year old driver but
i'm curious if you have to start that
over and if that has implications for
scale and the the kind of long tail of
weird little problems you have to figure
out to reach true self-driving
right so yeah so that's an interesting
question currently we train everything
from scratch most of the time
it doesn't cost that much time so it's
not really a reason to try to avoid that
maybe in the future the training is so
costly that it makes sense to
start training incrementally
um i don't foresee that happening soon
we don't seem to be that limited by the
size of the models right now
but if we do have to scale the models to
get the performance we want then maybe
incremental learning is what we want to
do
uh yeah um so uh
i know that you know eventually you want
to get to level five
and you know ideally you would be there
tomorrow
um and then on the other hand some
companies seem like they'll
maybe never get there like waymo um
what's like like what what primarily is
influencing the velocity of your model
improvements right now like what what
work inputs
uh do you find are like the biggest
barrier to like getting to that next
major milestone for you right now
i think if i were to list one limiting
factor it would just be the
infrastructure to test the models
in how well we can predict that they
perform so
if we have tests we can run immediately
on a trained model and immediately says
it messes up in these ways and it's good
in these ways then it's very quick to
iterate on that
and i'd say it's building these tests
and building these metrics that is very
time consuming and if you mess it up it
costs even more time because you find
out later and you have to go all the way
back
so i'd say the quality of how well we
can evaluate the driving
offline with tests i think is one of the
limiting factors
so you mentioned this bug that you had
with the mapping continuous lines to
themselves in
the visual odometry how did you fix that
bug
um so we fixed that bug in particular by
doing some basic filtering on the old
features that are tracked
so we do have a gyroscope which tells
you how the car is turning
and we have some gps data neither of
those are accurate enough by themselves
but they're accurate enough to just do
some basic filtering
throw out really bad orb features and
then the ones you have left are good
enough to
deal with the rest of it
i'm coming so harold told you guys a lot
of things today
but there's one thing that he didn't
tell you guys and that it's his birthday
today
so will you all join me in singing happy
birthday to harold
happy birthday to
you
[Music]
happy birthday to you
i was gonna try to eat this with my
hands but that seems like a mistake
it's a cheesecake that's really hard i'm
gonna go find a fork
all right i think we're gonna say
goodbye to the live stream for an hour
um just a little bit of logistics
uh there's burgers in the back anyone
with special dietary needs there should
be everything for you
if you find someone to help you have any
questions
there's soft drinks all day and water at
the bar help
just waiting for the thumbs up all right
great we're online
hello world um
obviously this next speaker
needs no introduction from me
george is the the creator the visionary
behind comma
and i'm beyond excited to introduce him
to the stage
[Applause]
[Music]
[Applause]
[Music]
[Applause]
[Applause]
ah i did make a presentation that's
gonna maybe be up in a bit
uh i worked hard on it i made it in
keynote everyone else made it in google
present oh comic-con keynote there we go
that's my name and that's today
uh we have a laser pointer and you can
go backwards oh and we can go
forwards but can we go backwards oh wow
we can go backwards and forwards that's
pretty cool
uh so we'll start at the beginning uh
this is me about five years ago
see a bitcoin mug i wish i bought more
bitcoin back then
that's the comma ui up on the screen you
can see uh we're detecting lane lines
and you know kind of making it work it's
still the engaged logo from star trek
um this was the original comma system
uh it's been a long five years
had i known what this would have ended
up being
i probably never would have done it but
to be honest uh starting a company
is is absolute hell uh but
you know when you start out with things
you don't know this
right go into a full tilt right there we
go man
come ai on the back of an acura ilx a
license plate
right fuel on man it just means like
keep the keep the gas going bro
or fu uh um
uh so you know yeah we put this together
and you go for it it's like yo let's go
to the silicon valley vcs man you know i
was watching that show silicon valley
that's why it's called comma
hey if we're not having a good time
there's really no point doing this
um this is the original comma team
uh at an event self-racing cars uh
you know this was this was 2016 and a
lot of the companies back then
were way more honest and open um i think
that this self-driving space is
incredibly sad uh i said this
back in 2016 we are going to win
self-driving cars it still kind of holds
true
because you know i don't like losing and
why do you keep doing it right
there's no point you know there's
nothing you can buy with money uh
there's no there's no amount of like i
live a nice life
but i like winning and i want to win so
that's why we're here and you know
i appreciate that you all came out
[Applause]
i remember uh before this techcrunch
disrupt
i was talking to my sister uh and i was
like saying like what i really want to
do is get up on stage pull my pants down
and take a shit
no really really because there's no
other way
like to to to how do you compete when
everybody's just
lying and so i'm like all right we're
going to go completely over the top with
it this is all you need to solve
self-driving cars
look it's in a neon green it's a phone
in a neon green case
like it's kind of a joke but it's kind
of not
you know i think most you have used that
phone to drive a car
and it's kind of a joke kind of not well
nishta wasn't it on the kind of a joke
so i'm like you know what
cancelled cancelled no comma three uh uh
i'm sorry no com whoa whoa no comma one
the comma one was canceled um
alex roy wrote this article he got a
test drive in the car with the comma one
and
the cancelled comma one would have
embarrassed the car industry
prediction there will be a comma two
well this was an all this was in october
one month later
we released openpilot open source really
all the ideas start to come together
it's like we're going to be the android
of self-driving cars if tesla's the ios
we're going to be the android um so this
is openpilot 1.0
you can see it has a lot less directory
is it i didn't think i knew how to put
pictures and readme's back then
uh we figured it out it's pretty nice
now if you go to uh open pilot on github
and as for alex roy's prediction well
the open source software included the
neo
how many of you had neos all right we
got a few neo people out there how many
you had eons
all right and then how many you have
comma twos all right nice to see
um so it took a little bit for alex
roy's prediction to be uh to come true
but we did ship a comma two and it did
embarrass the car industry
this is consumer reports if you guys
didn't see it
[Applause]
um
i mean open pilot is
is good you know how i know open pilot
is good
like i said i don't do this for money
i'm rich
i used to drive a mercedes-s-class you
know like what other car are you gonna
buy right
but if you ask me today would i rather
have a mercedes s-class
or a hyundai sonata with a comma two
uh i think that that one's actually
better
right like that's how i know it's good
how much more does that car cost than
that car
even with the you know egregious price
of 1090 wow these things are priced way
too cheap
we got to raise the prices
what does it mean to be good right so um
what's our slogan
meg driving chill uh so we like to say
the tesla slogan is look at this crazy
feature
i mean again maybe it appeals to a
different kind of audience but what does
it mean to be good
does it mean things like turning right
at an intersection well not really
because like
you just don't turn right that much in
your drives like it happens every once
in a while but
it's not that bad to do and i've been in
demos where the car's made autonomous
right turns it's stressful
it's stressful watching that wheel fly
in front of your face you're like do i
touch it do i not touch it is it gonna
do it i don't know i'm stressed out
right
our slogan is make driving chill so it's
not things like this
it's things like this so if you look
coming up to that exit
you can see that the lanes widen and
what almost every manufacturer lane keep
does
is it places you in the middle of those
two lanes
and you have an okay time right up until
you get to the fork
so what it should do is if you're going
left it should bug the left and if
you're going right it should hug the
right but
this stuff is really hard to program
in in ways that are reliable and
repeatable and you saw this as some of
this in
in harold's presentation about like okay
let's say there was a dashed line there
right
like it's just there's there's so many
variations
and what makes a system good isn't
the crazy things that it can do but it's
the things that it can do
over and over again repeatedly and well
that's what chill means to me so uh
yeah that's what it means to be good
i remember i was uh
2008 it's like the knights of whoppers i
would drive to burger king and go get
whoppers
that's my sister she wanted to come and
go to burger king and you know just
talking about things and i tell her you
know it's like impossible
uh to make a computer recognize whether
there's a chair in an image or not
like this is a task that a five-year-old
can do and in 2008
computers just couldn't do this and it
was because they were using a lot of
this sort of stuff
they'd run something like a harris
corner detector detect corners
compute some orb descriptors and then
come up with some like hacky definition
of what a chair was
based on some weird nearest neighbors
thing maybe
it just doesn't work right so
how do you actually detect chairs and
images this is a trivial problem i think
i think even a five-year-old can write
the code to do it now um
you know yeah import import
torch magicvision
torchmagicvision.predict and there you
go
and the way this of course works is they
took lots and lots of images
and they labeled where the chairs were
and then they trained a neural net which
uses this algorithm called back
propagation
to improve the weights or the program
that's actually detecting the chair the
program is learned the program is not
hand coded
now you say no no no no but but
waymo learned this lesson right they're
not doing the stuff on the left they're
doing the stuff on the right
right they're they're they're getting
neural nets which put boxes around cars
they're
fully deep learned yeah but like
can these people think a little higher
in abstraction space
what's the meta lesson here right for
the task of prediction it's end to end
but the task of prediction is not the
task of driving
right it's unclear how you go from
prediction to driving why
why is this lesson still not learned and
why are these companies
hiring cone guys
well like really right and you're gonna
get you're gonna gotta dive into the
taxonomy of cones
you have small cones you have large
cones what does it mean if a cone is
squashed
what about the big cones like this what
about the thing outside with the you
know is that a cone i don't know
gotta hire the cone guy for that right
um so yeah the lesson's really uh not
learned
uh one of the things we say at comma one
of the questions we ask all the time is
will this be in the final system
uh you know i find that people are like
i'm by the way we're proud level two at
comma
we're pride level two for two reasons
one because the higher levels don't say
anything about capability they only talk
about liability
and we don't want liability obviously
but
you don't want things higher than level
2 either do you want to tell the machine
what to do or do you want the machine to
tell you what to do
right what the higher levels mean is
you're no longer in charge you're no
longer driving the car and like
some people might be okay with this like
i'm not i prefer that machines work for
me and that i don't work for machines
which is kind of you know that's long
and philosophical but uh
you know we're level two forever but
there's no reason that a level two
driving agent should not be a superhuman
driver
there's no limit to it's like well it
can't be too good it's only level two
no way so we always ask the question
when we're building something and you
saw this this morning with the end to
end stuff it's like
will this be in the final system
uh so this is a real story uh from uh
a secret internal source at that company
um they had these cars and they were
driving this little loop around
pittsburgh
they really got the loop working well in
the winter it could drive the loop most
of the time without a disengagement
um but in the winter well
the bike racks looked like this right
car drove by fine on the street and it
was all good
but then spring came and the system
stopped working the system stopped
finishing the same loop that it could do
in winter
and they checked all their hd maps and
they were all good it was a localization
issue
the bike rack didn't look like this the
bike rack looked like this
now if you're trying to build a system
that individually picks out each bike
then runs a complicated prediction model
on what that bike is going to do
how big is your computer this of course
isn't how humans do it at all
right humans just look at those things
they're like oh it's a bunch of bikes in
iraq uh
so well what did uber end up doing
they put that area in the map as an area
with a bike rack and they said don't
detect any bicycles in that area
we all know all right uh we won't we
won't
talk anymore about that but uh you know
will this be in the final system is a
real question and a
hand-coded this is a bike rack don't
detect any bikes in this area would
never be in
any sane uh final you know superhuman
driving system
another question we ask is is this how a
human does it right
um so when we think about like we're
trying to like do some tasks we think
you know let's let's think about how a
human does it because humans are the
only
implementation of driving today people
talk about how humans are bad drivers
humans are so much better than every
self-driving car out there available or
not available
today do you know how i know that
because the second that flips
everything's gonna be self-driving but
we're nowhere near there yet
right so like people are like oh humans
crash cars humans almost never crash
cars i saw a good graph i
probably should put in here was a pie
chart of like during your commute how
many times you crash
and it was like a thousand times no
crash
maybe one time crash maybe maybe a
million times no crash one time crash
humans crash cars very rarely so
there's only one safe policy for driving
um
and it's not just ask how a human does
it because a human probably does it in a
good way
everybody in self-driving understands
that you want to build
systems that are capable of predicting
what the cars around you will do
but you do understand that humans are
running that exact same algorithm
humans are trying to predict what all
the other cars will do and they're
assuming
implicitly that humans are driving them
so driving with an
inhuman policy is dangerous
right you can say oh yeah but
technically you rear-ended me
you have the liability yeah but if you
slammed on your brakes in the middle of
a highway like you can make that
argument but you still crashed
there's only one safe policy for driving
and that's the human policy
assuming you want to interoperate on
roads with other humans
now you're going to get some wacko
utopian people who are like we're gonna
replace all the humans with bunk people
and
um you know uh we'll put the bug people
in the cars and the bug people drive
according to these very very rigid rules
but you know this is
well i like driving
take it away all right um there's only
one safe policy for driving that's a
human policy
this is our mission solve self-driving
cars while delivering shippable
intermediaries
a cool test that i like to use about
whether somebody is saying something
is ask the question of what else they
might be saying
right like does the opposite of this
make any sense um you know some
politician gets on the stage and says
we care about the children could you
ever imagine a politician getting on a
stage and saying
what you know the children aren't that
important to us no of course not
um so what's in this mission is very
clear about what we have to do
but it's also clear about what we're not
trying to do we're not trying to
deliver a return to our investors sorry
investors
um we're not trying to
aggrandize ourselves with
self-importance by throwing big events
with lots and lots of poa
um uh
no we are we're here to have a good time
too but fundamentally
this is the goal of our company right
and it makes it very easy for everybody
to be aligned the amount of political
how are we winning if you believe we're
winning
how are we winning what are these other
companies doing wrong and they
understand some technical stuff wrong
but i think they also understand some
philosophical stuff wrong
this is our company mission solve
self-driving cars
while delivering shippable
intermediaries
uh and that brings me to the next slide
business
so common is a business that is our goal
and that is the mission of the business
but comma is a business and we do have
to operate in the business world
this is a quote from my uh self-driving
uh my 100x investment blog post
it's so sad it's really it's really so
sad
how yeah um and it's because business
selects for psychopathy
uh maybe you guys saw the nicola founder
was was indicted
um yeah you know he he he uh told
and he told the world that his truck
fully worked but actually what he did
was he tilted the camera a little towed
the truck to the top of a hill and had
it rolled down and didn't put a motor in
it
right even boomers understand that's a
scam right
um
so you know it's always nice to see that
but it's these these scams that are much
more intricate that you don't exactly
you know it's not exactly clear to point
to the scam but when you just look at a
company that's raised
10 billion dollars and has no revenue
and now is like we're gonna do an ipo
like it went from companies aren't
profitable to companies don't have
revenue to companies don't have users
right so i promise this is the downer
part of the talk
the the stuff that i really like talking
about is coming up
um so the fundamentals of us as a
business we've raised 8.1 million
dollars
uh we've made 9 million in revenue
the next milestone here is to have over
8.1 million dollars in assets
and the next milestone after that is to
have over 8.1 million dollars in cash
because then undoubtedly we've created
something right and i like that i like
that from a business perspective like
figure out how to you know make money
um we sold five thousand comma twos
uh this is now the majority funding
source of the company
and it's great because we're aligned
with you kama wants the same things you
do we want openpilot to be better you
want openpilot to be better we want to
build better products you want us to
build better products this is the beauty
of capitalism when it works
right it's like you're 3500 weekly
active users
this is a wild statistic in the context
of how many we've sold
over 50 percent of every piece of
hardware we've sold is still being used
every week
the only thing that i know that competes
with that is like appliances and mobile
phones
this beats laptops this beats game
consoles and this crushes virtual
reality headsets
the average use for a virtual reality
had the average number of times people
use a virtual reality headset is one all
right
50 still in use over over a three year
uh
we've sold about 2 000 eons um so it's
yeah
it's over 50 uh still in use
these are our shopify numbers uh i
challenge
other businesses out there to start
doing this uh post a
screenshot from shopify um you can see
our sales going up
you can see our average order value is
going up and you can see our total
orders are going up
um average order value is a important
one uh that i like because these things
are going to get more expensive as they
get better
um a lot of companies if you're really
talking about the kind of smash and grab
approach or like the exit scam you see
in a lot of companies what they'll do
with their hardware pricing
is they'll price it very high at the
beginning capture the early adopters
money who'll pay whatever they want and
then lower the price over time
i'm not doing that we price it and then
we raise the price and we've done that
with every release
um you know the comma 2 went up a little
bit in price uh so yeah the
the order value goes up over time but we
also think the value that open pilot
delivers
has gone up over time would you guys
agree yeah
so weekly devices by type uh so you can
see our weekly active users about
the 3500 we talked about one of the
things that i like here is this
yellow line here is the comma two so
most of our users are on comma twos
uh which to me signifies that we've
actually delivered
uh uh enough of a better experience for
people to upgrade
um we did we did uh sadly deprecate the
original eon but we offered free trades
to everybody
just pay shipping to eon golds if you
wanted to stick on the old system
we do want to support this stuff for as
long as we feasibly can
but remember you know i'm not a no child
left behind guy i'm a gifted program guy
uh so you know we do want to push the
high end and we especially want to push
the experience
for uh you know all the
[Music]
the majority right the needs of the many
outweigh the needs of the few it's a
vulcan quote
we are comfortably in control of our own
destiny
um this is nice this took some time
we're not ipo-ing we're definitely not
specking
we're not selling out to bankers uh i'm
i'm the majority shareholder
i'm the sole board member and i am 100
committed to the company mission
i've never sold a share uh my salary is
78 000
a year uh i don't care
uh like
it doesn't it doesn't really matter
right and this is an important thing to
realize right like
i think about how good my life is i live
in a beautiful apartment in downtown san
diego and my life is good
because i have things like hvac you're
the king of france you couldn't get hvac
you could order all your minions build
me an hvac system and they'd be like
want to invade poland what um
so we're comfortably in control of our
own destiny and we are committed to
making
better and better technology every year
why don't we work with car companies we
get this question
a lot and sometime i'll give some flip
and answer about how they're hard to
work with
but there was always just something that
like never
sat right and i think i can put some
good business terms on it now since this
is the business section
uh so this is the gross margin in
automotive it's 18
right automotive is mostly a you're
gonna like grind out for these little
margins you know the dealers take their
cut
it's a very like protected industry um
you know that's like like
look at tesla trying to get their direct
to consumer model working like the
dealerships are protecting their little
cut
and you you don't want to be in a place
where everybody's fighting over a small
piece of the pie
you want to be in a place where a large
pie benefits everybody
you want to be in a space where the
gross margin is high
because it lets you it gives you room to
experiment and like have fun and like
build cool things
um so the gross margin automotive is 18
the gross margin in consumer electronics
we're an aspiring consumer electronics
company
no like this isn't comma's transitory
business model look we're not going to
be selling dev kits forever
but well let's talk about our total
addressable market
more business trips you guys um
we support over 130 cars
that's over 50 percent of all new cars
sold in the us
in numbers that's about 8 million
compatible cars per year there's about
25 million potential existing users this
is in the us alone
uh that's 0.02 market penetration to
date
we have a huge addressable market right
is it always going to be a dev kit that
you self-install that you have to know
what a panda is no
it's going to be a consumer electronics
product it's going to be like a
well let's just say if we build this
i can easily see a one million devices
per year market that's like five percent
market penetration that's nothing
at a minimum of a thousand dollars each
you guys know what a thousand times a
million is right
[Applause]
[Music]
this is i'm bringing back an old comma
slogan we're going to be so rich
we also briefly made comma gym wear like
a tank top it said we're going to be so
ripped
um you know this was a good pitch to the
investors but this is that's
kind of true comma
is defining the next device class of
consumer electronics
right the smartphone the tablet
the portable media player uh
the laptop right the
advanced driver assistance system i
don't know if there's a better name for
it but
you know we want to be the android i
don't want to be the only company
building this hardware open pilot's open
source
i think in the next five years we're
gonna see a ton of these things start to
pop
up because the total addressable market
is huge the potential for profit is huge
and like i said her company mission is
to solve self-driving cars
the more people we got thinking about
this stuff the more people who wanna
it's not working with us right it's not
like it's not a partnership it's not a
sketchy back room deal it's like
here's who we are come play in this
beautiful ecosystem we're paving the way
for you
right maybe one of you out there maybe
one of you out there is making
you know action cameras or some some
again there's another consumer
electronics
uh device class right build a
open pilot compatible device let's live
in a world where there's 10 of these to
choose from
right and i've seen i've seen a few cool
things you know i'll give a shout out to
blue box
uh they launched the kickstarter i think
their device is a little too cheap and a
little underpowered
but it's the right idea um
i know i'd love to see a world where you
can just like android phones you can
pick from a whole lot of these to choose
from
all right
that's the business section now the
stuff that i like talking about i told
you to get more upbeat
that's a picture from akama too
you know what question i get asked all
the time
george how are you going to solve
self-driving cars with one
camera um
well this is the comma 2 camera and it's
like pretty good you can pretty much see
what to do on that road
but what if there's a car next to you
and it's a little hard to make out
what's going on in the distance
so no the comma two now we can say it
the comma two is not
good enough to build a level five
self-driving car out of
i hope you all knew this right
it's a driver assistance system but
you know we we do want to get better
like i said
we're not stopping oh they're going to
stop come ai only does highway
do it all there's no distinction
but we are going to need
more cameras
who's ready to count
one
two
three
[Music]
man i always wanted to do one of these
you know
[Music]
all right uh so th this is the comma
three
uh you know you guys can see a few
changes
it's nice and slim um the display is
stunning
i don't want to talk about how much i'm
paying for those displays
it's more than the whole ego
you can see navigation on the right
uh you know you see the basics the the
open pilot interface on the left
you can see down here we have this is
185 degree lens
uh infrared these are the same two
infrared leds
uh that are on the comma two so you get
that same great nighttime driver
monitoring
this is what the device looks like from
the back
uh yes we finally made injection molded
cases
they look nice um you'll see that we
have two eyes
uh but not for binocular not for stereo
vision stereo vision at long distances
is relatively useless
although this does exceed the human
baseline so if any of you we're wrong
we got the stereo we got the hardware
for stereo in here
again like i said it's useless but what
it is useful for is you can see the two
cameras on the back
have different uh lenses so that's 185
degree lens on the right
and that's like a 45 degree lens on the
left so you can see
objects that are really far away
speaking of the cameras they're really
good
uh 1080p oh but george the eon has a 16
megapixel sensor
and it does so why is this only 1080p
the eons lens can resolve about 0.5
megapixels
it's not about how many megapixels you
shoved into your sensor
it's about how many you can reasonably
use and resolve
um the sensor has you know what's the
benefits of
less pixels looking i could put it i'm
paying a lot for these sensors i could
put a 16 megapixel sensor in there but
you're not going to get better pictures
your picture quality has a lot to do
with how good your lens is
and how good your uh how big your pixels
are
right bigger pixel more light uh more
light
equals less noise uh so yeah these are
uh
there you can also see that the lenses
are fixed focus
uh so one of the big problems with the
the comma 2 data is it's kind of blurry
uh especially when you're like braking
hard or when you're
the way that it works is the lens is on
this tiny spring and then you have like
uh like a piezo
like actuator uh to to to press on the
lens uh
here we don't have any of these we focus
these at the factory at infinity
um the depth of field is plenty to
capture everything you need
all right um
so about 1080p uh 120 db
of high dynamic range uh so that's
up from 85 in the comma 2.
uh 285 degree lenses for full 360 degree
coverage yes we can see all the way
around the car
narrow cam for far away the human eye
actually doesn't have sensors equally
distributed throughout the eye you have
a center of the eye called the fovea
which is a very dense
area digital sensors aren't like this
digital sensors are in grids but you can
mimic this by using two cameras
and that's why the device has two
cameras on the back it has a fovea
and it has a uh outside the fovea
i'm sure there's a word and some
optometrists would know
uh it's an ar-0231 automotive sensor
there is a zero two three three you
cannot buy it this is the best sensor
you can buy
it's two generations ahead of teslas um
let's take a look at some pictures
uh this is me and alex chilling on the
five
um look at the upper left
you can really see look at look at that
road texture that we're now capturing
uh full 360 you can see that down here
you can see that
front pillar we didn't consider this
when we did the balloons
don't pop the balloons
uh yeah you can see uh you know the
driver monitoring
captures a whole lot more so there's no
more fiddling with your device so like
aim it in the right sort of way uh
to make sure it sees your face
it always sees your face it even sees
whether your hands are on the wheel
uh oh by the way it also sees next to
your car
right so if there's like a sami dexter
we see it now we see everything
uh this is its performance at night
yeah that's what those big pixels get
you look at how in the narrow picture
you can't even see that car right there
um the the gamma curve on this uh
i don't know about the gamma curve on
this screen it seems pretty harsh
but you can easily make out that car on
a computer screen
um so that means the net can as well
driver monitoring at night with that
infrared
uh yeah nighttime pictures
it's not a cell phone
we used zero cell phone part well i mean
it depends what you mean
we use the snapdragon 845
qualcomm's chips are half the price and
more performance than nvidia's
a lot of people don't use qualcomm
because uh the software is nowhere near
as like there's no easy sdk to use
qualcomm
so like the snapdragon 845 uses a
completely different
camera the hardware is completely
changed from the 820.
yeah we reverse engineered that one too
it's in camera 2 and open pilot
so it's great that we can use the
qualcomm chips and
we plan to stick with qualcomm really
all the way to the end
uh wi-fi and global lte connectivity so
it has the same connectivity as a cell
phone
uh of course that works with comma prime
it's got wi-fi it has bluetooth too
we don't really test it so you know well
what good is bluetooth but uh
no i'm sure the bluetooth works we did
test we did test the antennas we got
this device fcc approved
the device has an fcc id um
a 2160 by 1080 oled display
uh no more no more issues with
sunglasses and did you polarize it
diagonally no it's not polarized it's an
oled
i hear it actually it might still be
polarized but it works great with
sunglasses
um now the display is really stunning
and you guys know the beauty of oled the
blacks are actually black there's no
bleed there's no local dimming there's
nothing like that it's actually
uh we went above and beyond i should
have included the video we calibrated
each oled
display we had all this code to
calibrate the camera for colors
and it was pretty easy to also just do
the display so every display that goes
through our factory
we put a uh put a little camera on top
of it
and calibrate it to the uh to have the
exact same color response as every other
comma three
i believe even apple doesn't do that um
apple you can and apple's very good
about this apple has some of the best
displays in the industry
but we actually take the time to
calibrate it um that's the cool thing
about having 58
gross margins we can do things like this
that are just kind of
you know above and beyond another thing
that's above and beyond
uh yeah we put a real gaming ssd in
there like
like why not it's almost the same price
per gigabyte as sd cards
but why would you use a crappy little uh
oh it writes it
did you buy a class seven or a class
nine no we bought a samsung 980
nvme ssd uh you guys will see we have
some interior pictures coming up
um high precision gps same one as a
comma two
and obdc port same as the comma two the
harnesses are compatible
so it's the exact same harness if you do
buy a comma 3 you do not need to buy
another harness
we include it has a right angle cable
the cable's a bit nicer
uh but that's included in the box so you
don't need to buy a harness if you're
upgrading from a comma 2.
it also has a usb 3.1 gen 2 port uh
so finally we have real expansion
capabilities on this device
uh you're actually going to be hearing
we already have one
expansion device being also maybe
announced
later but uh this usb port is capable
of streaming out the entire sensory on
the device so the five gigabits of
bandwidth would allow us to stream
all the cameras in full resolution if
say we wanted to attach an external
i don't know gtx 3090 to it uh to run
some really huge models
um also just because it only cost a
dollar
uh that's also a display port uh so you
can connect it to a big screen
uh some of you guys want the comma
screen you can do it uh
you're gonna have to get the west end a
little software but the hardware works
uh so yeah this is the front of the
motherboard
um you can see this is the 845
som uh the we have a heatsink which sits
on top of that
you know one of the problems with cell
phones the comma 2 runs hot
uh the comma 2 the uh
it's very hard so the processor on the
comma 2 faces the screen
in a cell phone it's really hard to deal
with heat because the only place really
to dump that heat
would be in the user's hand so they try
to dump it out the screen but it doesn't
work that well
um you know it's glass it's not metal it
would make a glass heat sink
so we can put the heatsink right on top
of well
right on top of the memory which is
right on top of the processor
um but in the stress test the comma twos
get up to 90 degrees
uh celsius in the stress test for the
comma three which is when we run it at
full tilt
they range between like 60 and 65. so
they they run
they run 25 to 30 degrees celsius
colder at full power than the comma two
and it's because we can shove the
heatsink right on there uh
so uh well we'll get to this in a minute
there's still a little android in the in
the
phone in the thing in the device but we
keep it in that metal box there
uh we keep all the android in there
don't worry there's a there's a cover on
it it holds the android in
it's the only way to get an lte modem we
stuck a great lte modem
that's the global edition uh we've done
some some speed tests you're getting
uh i think i've seen it up to like 80
megabytes a second
um 80 megabits a second it's lte and
it's good
uh part of the reason it's good also is
um you know a cell phone has these like
crappy little antennas that have to go
through your hand
we have two big antennas on either side
with ground planes behind this and you
know user's not touching it
so the lte reception is great uh that's
the front of the motherboard uh this is
the usb
3.1 port this is the obdc port there's a
daughter board which sticks on top of
here that i don't have a picture of
it has super capacitors on it uh so you
have about five seconds of power
after you pull the thing uh this lets us
write the logs to disk in a safe way
it also gives us time to alarm if the
device does immediately lose power
uh so it's the best of both worlds it's
not a battery it's a capacitor
uh and you still get some power uh after
if the
if if say your car uh catastrophically
loses 12 volts
uh you still have some uh
you don't immediately kill the device so
yeah that sits right on top of there
there's a speaker also i should have
gotten pictures of it uh two digital
microphones
uh you know
everything i like they're like little
people two eyes
two ears a mouth a brain
an lte rate
this is the back uh there's that uh nvme
uh that's the display connector
underneath there
is the uh ir led driver
this is a panda uh so you guys know what
the panda in the comma
two was called right does anyone know
the code name
the una uh this one's the dose
just a dose uh got a sim card right here
rtc battery
audio codecs and sourcing for these
things
you know you guys know about the
pandemic sourcing and like like
we got it uh yeah these were these were
one of the parts that was tricky to get
um open pilot at launch
uh if you guys have been watching the
code base this is tc
uh it's already better than the comma
two with zero eight seven
and this is for two reasons uh it's not
due to training
we've barely trained on any comma threes
but
the fixed focus of the camera means that
it never goes blurry
and the processor is eight cores instead
of four cores so every open pilot
process practically has its own core
uh so your timings are much more
consistent your focus is a lot better so
open pilot is already a better
experience out of the box
agnos a great new operating system no
more neo s it's ubuntu 2004 based
all apt-get just works i did i did one
of these devices like how did that work
don't we have the system partition
mounted read only
uh and like the reply on slack is like
no no we added a hook
it mounts it read write and then it lets
you apt get something and then it mounts
it read only again i'm like that's so
nice
this is like a nice development
environment this is a ubuntu 2004
computer
as far as i know we're the first company
to ship a qualcomm device with linux
um
and navigation alpha is ready that's not
a mock
this is the whole reason we built comma
prime you think i wanted a deal with um
carrier i can't name uh and write a
writer like sign a contract to like
resell some no
but we got to ship navigation to you
guys i mean you need navigation if you
want to solve level 5 self-driving or
superhuman self-driving or anything no
liability
and you know what i'll be honest about
how good the navigation is right so if
you kind of rank these like
carplay android auto how many of you use
that for navigation
and mostly it's pretty nice right um
then maybe and sometimes you'll rent a
car and you'll use phone and cupholder
navigation
um and then sometime you use the uh
actually i don't know you'll never use
the built-in oem navigation you'll
always use the phone and cup holder
right
[Laughter]
uh so uh the comma three nav is better
than phone and cup holder
um so and then once we do ship uh
navigate on open pilot i think then
maybe
we can jump that but there's no way to
jump that right now it is i'm not gonna
lie to you and tell you it's better than
than carplay but it's a very usable
experience
uh more so than your phone in a cup
holder you'll be hearing more about this
in the next presentation
wanna stand up everyone who was in epot
i think seven of the epot people made it
out here
um these people have had the device for
four months
they've been testing it giving us
feedback we went through two revisions i
now release
you from your nda so feel free to talk
about your honest experience with the
device
uh is it perfect no but a lot of the
bugs are software
uh and it's now now it's good
four months ago it was kind of meh six
months ago
maybe fifty percent of the time it would
work now we don't even have common twos
in the car anymore uh you guys saw
maybe some of you saw in the stream our
leak user admin screen where all the
cars had comma threes
uh so this device has been tested in the
field for months we've done way more
testing on this than we did on the comma
two
um we also ported over all our
factory test uh infrastructure uh from
the comma two to the comma three
so these devices all for example have a
24-hour stress test we test every sensor
we test the microphones we test the
speakers we test everything in this
device uh you know our goal is really
as we go forward to drive reliability of
these things up
to the point that you know someday
hypothetically if you ever have a comma
seven
that thing's never going to break uh but
the comma three should be a good bit
better than the comma two
on that front so yeah
thank you epot
now who knows what this slide is
what do you think's on it
69.20 yeah
uh this is the price slide
three thousand dollars
now they started 21.99
[Music]
double a comma two uh starting at 21.99
now there are two variants of it
so before you you know go on your phone
and place your order right now
uh you may want to wait to hear what the
other variant is
uh so yeah these devices are not uh it's
not a pre-order
uh this is pictures from our factory
this week uh
they're already uh in production and the
first ship date is thursday
now if you want to be in on that first
ship date well you want to buy the cross
country edition
the cross country edition has one
terabyte of storage it's the high trim
so if you guys like that like king ranch
f-150 it's like this is the
cross-country edition uh it comes with
the sick looking boot badge
um and it ships first uh so all orders
are first in first out but there's a
bit of a priority element to that we
fulfill all one terabyte orders
and then we start fulfilling the 250 gig
uh which is the 21.99 base model this
one's 27.99
so yeah those are the two models the
site should be up right now
uh first in first out and this is the uh
this is the comma three
thank you everyone uh you know really
i'm super impressed with the team that
built this
uh we have really
you know the the people on the comma
team now you saw some of them this
morning
it's uh it gets harder and harder to
beat us every day
uh i'm starting to think we're going to
win
i'm starting to think i was in an fsd
beta
i'm starting to think we're going to
beat them start to think we're gonna
beat everybody
ah yeah
there's a bunch of comma threes in the
back uh for you guys to actually go and
check out and touch
actually i think i might have one
right here
it comes in this beautiful stealth black
box
that it will ship in so when it shows up
on your uh you know doorstep it doesn't
say 21.99 on it
you see the cross country badge is
included
on the leaflet as well uh this is the
most complicated text we've ever shipped
shows you how to mount it
and then whoops right under here you'll
see an actual comma three in the box
in here you'll find the accessories bag
just get this open i'm sure someone will
do a much more beautiful
unboxing of this device than i can
and you'll see the accessories bag here
which is what includes the harness if
you order one or if you don't order a
harness
it's just the mounts a bunch of stickers
adhesive and this right angle cable uh
this bag doubles as a carrying case for
the device
so if you do want to take it off your
windshield you can put in this beautiful
microfiber
cloth
so that's it that's the common three now
i think it's time for questions
all right guys i picked the wrong day to
wear shoes covered in spikes
it's not my birthday
all right
it begins um all right
we got a question up top first great
looks terrific george uh congratulations
to the whole comma team
um my question is are the harnesses the
same for the comma two as they are for
the comma three absolutely if you have a
comma two
uh we even made a special uh video of
chris made a special video
uh for upgrading from the two to the
three it's super easy
it's the exact same harness so all you
need to buy is the device
i will say that the site is now live
sweet
and we will be shipping first in first
out so
that's your chance to get first in line
um
we got a question up there
go for it yeah hey so
um
that sounds so boring what am i gonna
get up here and show you sexy pictures
of auto insurance
i can't believe that's the first time
we've heard that
listen listen that's great and they can
do that they're welcome to they're
welcome to play in our ecosystem we
we're not going to tell them not to
but but after we solve self-driving cars
let's solve home robotics and agi i
don't know
insurance sounds boring
you know the comment three is a it's a
little head kind of you know
i'll take it out it can be it can be
touched um
all right i got a question back here
george you guys see the similarities
two eyes two ears a mouth
a usb por what power goes in right
all right i got a question back here
hello what are the biggest challenges
with building a world-class team
and how do you and comma overcome these
challenges
uh basically we do very little outreach
we mostly reach in and you can ask
yourself this question
do you want to scam for the rest of your
life or do you want to come here and
actually build something
that's it and people show up and they
want to build something they got skills
they're motivated welcome to comma
um is there anything different about the
cross country edition other than the
storage and the
uh and the badge like do you upgrade my
car's warranty here
um i i would uh cross country
is also included right here
the cross country edition has enough
storage for an entire drive across the
country
that's why it's named uh the cross
country edition
and it ships first and uh yeah
cross-country edition
[Laughter]
they're both great they're both a great
choice
hello i already ordered my comma three
thank you
great persuaded um
this is who funds our company uh so i'll
preface this with
i also think he's completely
insufferable but why so much shade for
elon
what what shade did i throw at elon look
i know i actually have a lot of respect
for you
i seriously do um elon is a man
who has a positive vision for the future
and that's what we need more of today uh
elon can talk about the future in such a
way that it's a future that i want to
live in
uh so you know we're just playing you
gotta have a worthy adversary right
if he's sherlock holmes on moriarty all
right we got a
we got a question upstairs but moriarty
respects you know mr holmes
hi jordan why play you know hey george
nice nice product what's the kind of
benefit of having more storage
like practically we can oh just stores
more stuff
like porn
the driving performance is the same on
both devices you can choose which one
you want to buy
yeah another question uh is there a new
trading
program for existing users of some sorts
not yet so we
made i'm gonna say never say never
but probably not yeah so you know
where we're it's not like we have a
warehouse full of thousands of these
uh we are building them as we speak
uh so you know maybe someday if we have
excess uh capacity but they're
you know they're they're kind of hard to
make and like we make them we test them
we reject all the ones that fail even
one test
uh so you know they're gonna be probably
fairly limited supply for a bit um maybe
after that changes we'll see oh with
respect to the comma two
uh so we still have i think it's 791
comma twos in stock
uh we're not gonna stop selling them um
the comma two
from today is going to be supported for
one more year
uh so there's gonna be one more year of
open pilot updates it's not going to get
features like navigation
navigation is hard to make work on the
comma 2 the processor just doesn't have
that much more power
but things like end to end longitudinal
will likely come to the comma 2 as well
uh no promises but we're not going to
artificially you know things that are
easy for us to make work on the comma 2
we'll also work on the comma 2
and there will be at least one more year
of core open pilot software support
thanks i got a question all the way in
the back in the center
what's up george awesome products thank
you is the c3
so is the storage replaceable and
upgradable
by the user wow
yeah we gotta go to the picture oh these
take
yeah i will warn you
that actually these drives the reason we
use the samsung drives isn't just cause
i'm a nice guy
uh it's because um most of them are
egregiously bad at low power modes
uh so i mean you can change it
but when your device you know kills your
car battery
you can check it all you can check it
all it's not as easy it's not like you
know you have a desktop where power is
effectively unlimited
um so yeah you'd want to make sure that
whatever drive you put in does work with
uh
low power modes but you know that's a
that's a pcie
slot uh if you put anything in there we
test it with a google coral as well
if hypothetically we want to put an
accelerator in there
great
this is a question about the driver
facing camera in the sensor fusion stack
so it seems like the uh car frame is
going to be
possibly a factor uh that that's
invariant
or not invariant across car designs how
do you intend to
get around that when fusing the cameras
um so probably the same way we do
everything which is big data
uh as long as we i'm so sorry as long as
we have enough data from enough users
the models will become invariant to this
um maybe we'll re-hash back to one of
the things how does a human do it
right that's not that big of a deal
um let me just say so i also already
ordered my cross-country edition
right here do you see there
being plans for some kind of like
century mode
um of way of like with that expanded
storage
uh next talk will kind of get into some
of this stuff
so remember that every resource comma
puts on something that's not
self-driving is a resource that's taken
away from self-driving
uh so you know it's not high on our
priority lists
but this stuff does still have to be
usable we have some cool announcements
in the next talk
hey george congratulations and uh
just wanted to ask you to touch on the
boot time or the boot time
uh well you know it's not you guys know
i'm just a cheerleader
right like i'm just the guy who comes up
and presents these
uh so you know it's really
congratulations to the team
uh the boot time is
it's been a while since i've used a
comma 2 but i think it's better
it's not too much better and there's a
lot more that we can do here that we
couldn't do on the comma two
uh so for example the comma two is a
leica with a locked uh
and you can flash whatever kernel you
want but the bootloader is signed uh
there's no signing enabled on the comma
three
uh so we can go all the way up the stack
and our goal is to get boot times down
to five seconds
but that's not hardware that's software
uh so yeah
it'll get better over time uh i would
say now it is at least as good as the
comato
all right i'm coming for you we are one
of our things that comma is always
no regressions no regressions no
regressions
yeah so i was wondering about the uh if
you look into the
commercial use case for this because it
seems like
it would be very interesting for fleets
and also given that
um it seems like people are asking
the uh the self-driving ceos about
uh crypto i'd be much more interested
to hear your thoughts than uh someone
else's
uh all right so what was your first
question
uh so it's limit two per customer right
now uh due to limited supplies but that
will go away
i think we'll do the same sort of bulk
discounts look i'm not working with them
but can they buy them and use them
absolutely i'm not gonna say no
right like you know what one of the
things that i really like um
you know one of the things that i during
like the playstation hacking i would say
stuff like
when i buy this playstation it's mine to
do whatever i want with and i feel the
exact same way about common products
right like if some fleet wants to buy
them and use them we're not going to
tell you no
nobody asks you what you're going to use
it for you might get banned from our
servers if you you know make unsafe
changes but that's
our servers right your device is yours
to do anything you want with and i
really believe in that
um so uh yeah can fleets buy them and
use them absolutely
and what's my take on crypto oh wow
pump pump pump pump pump
pump pump pump pump die to two dollars
tether to the floor die to two dollars
chibi
so uh on the business side you uh kind
of covered the u.s market
and the potential there but i was kind
of curious if you could share some
on the european market or other markets
in the world
i'll ship it to any country that doesn't
ban me or charge and say and import
taxes
so you are in those markets and you see
growth
oh if someone from another country
orders and pays the shipping charge and
pays the import charge again i'm not
going to say no
i'm not a no kind of guy
we don't track any of that okay right um
i guess i get to be the third to say
i've ordered mine
so cool all right things are looking
good for how many we ordered
[Applause]
so it runs linux so probably it could be
used as a hotspot
with great antennas it sounds like
that'd be nice in the car to have like a
good reception maybe or something
oh yeah i mean the the comma two
computers is a hot spot too i think we
have the same feature
uh you can toggle tethering it works uh
you can also so our sim is is is
not that fast uh the comma prime sim is
uh half megabyte
the upload is faster though but it's
supposed to be half megabyte symmetric
but it's actually like 1.3 if anyone
benchmarked it
but uh that's a nice lte modem if you
stick a real sim in there and turn it on
yeah it works great
sounds awesome um and are you also aware
that you probably
built a pretty great uh baseline you
hackling vr a lot but that's a pretty
great baseline for kind of another case
and it'd be a nice vr
device as well um yeah
vr has a bunch of challenges
i can talk about this stuff at length
some other time
uh it's unclear what the the beauty of
the comma three is when you buy it
uh when it gets to you you're going to
be able to use it to improve your life
tomorrow
right no waiting for anything i mean you
guys use open pilot
if you like open pilot with the comma 2
you're going to like it even more with
the comma 3.
so you said beautiful product and great
presentation
he said something to the effect of uh
level two the machine you tell the
machine what to do
and higher levels the machine tells you
what to do
can you say more and maybe give us a
glimpse into your roadmap
well when you get in away mo and when
you touch the steering wheel it pulls
over and locks you out
who owns that machine i like owning the
machine and open pilot when you take the
wheel you turn it it's your wheel you
paid for it
does that answer the question i'm not
sure what else there is what is our
roadmap get to superhuman as fast as we
can
win self-driving cars right i don't know
look if i was betting i'd still probably
bet on tesla but we'll be close
all right question on the navigation how
what's
um so do you expect me to reach for the
screen and just type it in there or
is it gonna be through the app go ahead
what am i trying to build an oem
navigation experience
yes please scroll through each letter no
go on your phone and type in the
destination and it goes over prime and
it's sent to your device
it's real nice um we do have uh
shortcuts that you can program in from
your phone
you'll see more about this in the next
presentation but you think i'd design
something terrible like that
i'm telling you i use it i want to use
these things i drive around that hyundai
sonata with open pilot
i use the nav i'm not using it if i'm
piping in oh
no i hit the d oh
my question is does nav integrate with
like auto lane change or suggested lane
soon soon uh so we need to gather the
data first uh so remember that the way
comma works is we gather the data from
from all our users and we use the data
to train the models
uh so once there's a whole bunch of
comma threes out there all the comma
threes will get better
uh and we'll we will put it this way
navigate on open pilot is a simpler
feature to build than end to end
longitudinal
we know how to build it you know i'll
tell you guys
you see that nav screen we you know we
wrapped our brain for a while
about like well what's the api right we
have the desire stack you'll hear more
about that desire is cool for things
like lane changes which aren't covered
in nav
but like for all the rest of it well we
just asked the question how do humans do
it
well humans watch waze right or watch a
nav system so we're just gonna take the
picture from the nav system and shove it
in a cob net and put it into the model
and i think it's totally gonna work
why would it not right if a human can
learn from that information
so can the machine so navigate on open
pilot is uh
will look i don't like being a lot and
making predictions i can't keep
but uh i'm sorry i'm ripping on elon you
know i got a lot of respect for the guy
i don't even rip one who's the comma
i don't even know right um
oh there's two of the co-ceos yes that's
a great sign guys
um he's ceo no he's ceo
um oh she all right um
that diversity is good uh
uh yeah i would say that there's an 80
likelihood
that we ship navigate on open pilot
within the next year
okay so you talk about how you want
comma to kind of become
like an ecosystem like android is sure
you know what products do you think
are you excited to see you know um for
you know the ecosystem as of now yeah so
we're focused on the high end and this
is the decision that we had to make as a
company we talked about building lower
end cheaper devices maybe the kind of
like
tiny device without a screen and then
again you run into the same car
insurance problem which is like that's
kind of boring
right like no one's going to get up here
and clap if we talk about the iphone 5s
or whatever it is you know not the s
what's the
no no no no the se yeah yeah the sc it's
like oh and it's a little bit cheaper
and it comes in 10 fruity colors like
while i don't personally want to build
that i am
i would like to see those things exist
right
i'm very much a believer in like the big
pie mentality of economics
so i would love to see people who are
capable of
you know building and managing like like
large numbers of devices that maybe
comma right now can't do
kind of getting in on the low end it's
gonna be hard for them to build a
high-end device
right because they don't have you know
the high-end devices work great because
they integrate really well with the
software you see this with android but
there's some people who just want any
kind of lcast system
and they'll buy up the low end right and
you see this exact same thing with
android
the google pixel is a high-end phone the
motorola j7
well it's 60 bucks and it comes with a
boost mobile you know month
right um so like that's what i want to
see
from people in the common ecosystem but
hey if people want to compete on the
high end i love that too
right i just want to see all this stuff
get better because
self-driving cars are just the tip right
like self-driving cars are just the
beginning of
what all of this technology can allow i
want robots that clean my house and cook
me food
right it's the same tech we got a
question up there
hello george good to finally meet you in
the flash uh
quick question can you touch on what the
microphones are for in the comma three
i mean can i use it for nav or what are
they gonna do
um we put them in because it was easy uh
the comma two has a microphone as well
we're not recording you you guys can
read the code
um one of the first things that i'd like
to ship with the microphone
is something that adjusts the volume of
the alerts based on the ambient noise
level
right so we can use like a service to
estimate how many you know if you have
loud music playing the alert should be
louder
if you're in a dead silent car like a
hyundai sonata the alert should be
quieter if you're in a toyota corolla a
little louder right
like it should be it should so that's
one of the first uses of the microphone
uh the like voice nav stuff again the
oems kind of try this and while i think
we could build something better than the
oems there's still nothing that compares
to just
copying the address in your phone uh so
they're there because the hardware we're
just feeling complete without them
right on thank you got a question in the
front
yeah very excellent um i feel
embarrassed to say that i own
two teslas that i've already paid for
full self driving
well they're nice cars the software 000
spent on what i could have bought but uh
i saw in the thing on the website that
you're offering
this for the tesla will will it plug in
because i've been waiting for full
self-driving beta and i'm wondering if i
buy your
device and plug it in and it works maybe
they'll send me the full self-driving
beta ah
well um so so robot who was up here
earlier has a tesla
he's done a lot of the work pushing the
tesla port forward a bunch there's a
whole community of tesla people too
uh collude magyver it's a lot of
community stuff so will it work yeah you
have to make one line change to the code
the reason the tesla actually isn't
under community supportive features is
we can't do the same kind of steering on
the tesla that we can on the other cars
it's very hard to make the tesla
steering wheel overrideable uh it has
that kind of tesla feel where it's
locked and then it disengages
uh we just don't think that's really an
open pilot experience but
it's relatively easy uh to do this we
should sell the tesla harness
um yeah we should uh
you can do it but it'll take a little
bit of work now it will get easier over
time
i remember that like also the stuff
that's live now is not i'm not selling
anybody full self driving i'm selling
this on the hardware specs right like
you're buying this for hardware specs
don't expect it tomorrow to put this in
your car and it's going to make a 90
degree turn it's not
i'm not even that interested in that
what i am a lot more interested in with
this hardware and
the places where you're going to start
to see disparities between the two and
the three
are things like trucks in the
neighboring lane like moving over for
them right the comma two just can't see
them
another place you're gonna see a
disparity pretty soon if you don't
already
is detecting a far-off car at a
stoplight in a distance
right the comma 2 camera it's the lens
it just does not have
that much yeah
um as soon as you know we get as soon as
we sell like a thousand of these devices
and we start getting the data back from
them
uh we're gonna be able to train models
that significantly outperform the common
two just because the raw data is better
great i think that's uh that's it ain't
got any last questions
one more logan
could you speak a little bit more on the
dynamic range of these cameras and their
ability to see into like harsh lighting
conditions and things like that
it's a lot better than the comma 2 and
tesla i'll say that they're
ar 0231 you can look up the data sheet
of that sensor
multi-exposure 120 db i think it's
probably the highest dynamic range
camera you can reasonably buy
there are some in pre-production that
have a little bit more it's not
quite at the human eye level yet
but the human eye has absurd dynamic
range
um but it is the best thing on the
market today for that and it should be a
big step up from the comato
i think the human eye is like 150 this
is 120 the 2 was 85.
the tesla's 95.
i think that's it we did it
[Applause]
could be yours i'm very excited to say
there's
three if you guys look back set up back
there you guys can take a look at
um i just
i'm so excited finally could talk about
the comma three
the team has done an incredible job
we've had them in the cars for months
they're unbelievable
i know george is like an epic salesman
but like
as a regular person they're a
life-changing experience i'm
i'm beyond that you guys will get to
have them in your cars
um on a
willem who runs open pilot uh
unfortunately cannot be here with us
in the flesh today um so we are
you guys gonna do our absolute best to
bring him onto the screen for you all
the way
from the netherlands
we're going to do our best to try to
maybe squeeze in a q a but
no promises um there he is in a tiny box
hi willem
i mean as you guys know our live streams
are not always great like we're
we really tried here um
this looks great um
so um i'm head of openpilot
my presentation will be uh will be about
openpilot
um so the responsibility of the
openplaya team is basically all the code
that
lives on your device so your command 2
or your comma 3.
from the research team we get this nice
blob of weights from the neural nets
and then it's our job to run this as
stable as possible
and to interface with a whole bunch of
cars
and to do this reliably we're basically
trying to build this
the most stable robotics platform that's
possible
so um in my presentation
i'll be going over some open pile
features i'll be taking you
on like a history tour um but i'll start
off with this
uh solving self-driving cars is a
software problem only
um some people think this is what a
self-driving car looks like
it's a a car filled with computers
because otherwise
yeah you can never build a self-driving
car uh of course we don't think this is
true
uh if you would ask someone at a
traditional self-driving car company
what you would need and they would say
you need a lot of cameras
you need a lidar of course you need a
lighter i need a radar you need imus a
gyroscope
an accelerometer a gps and definitely a
trend full of computers
um well everyone knows that lighter is a
scam
so we can immediately cross that off the
list so people use this to make their hd
maps and then localize themselves in the
in the hd map to do their planning on
um yeah that doesn't scale so definitely
no lighter i can also say confidently
that a trunk full of computers is not
going to be necessary
um we can run open pipe very comfortably
on the comma 2 and the comma 3 is even
better
um so yeah and it's not a problem of
compute
i'll i'll get to that later definitely
not cpu
um then we can also cross radar off the
list
i've been we've been using radar for
quite a while
i looked a lot into the data that the
radar gives us but the data is actually
pretty shitty
uh you get this like one line you get
all these false positives it's really
hard
to tell apart like a stationary car or
like a manhole cover so we
very quickly switch to a system where we
only use vision
to tell if a car is there or not and
then we still use the radar to
um to give us a speed because the the
radar gives us a doppler shift
which is an instant measurement of the
speed which is very nice but we're also
moving away from this and
trusting the model to give us the
relative velocity of the car
uh and tesla is doing this now as well
so this jose
this is very very possible
um and i would say an imu
and a gps are kind of optional for the
driving part
uh over time our models have become very
good at estimating the motion
that the car is going through will tell
us the rotational velocities and
accelerations and the velocities um and
the gps
like of course you can drive through a
tunnel so without a gps it's
very possible to drive um but yeah for
ground trooping those things are very
nice so we definitely put this on
and then the most important part is the
cameras if you have some very good
cameras which the comments three has
uh this should be all you need this is
what a human drives with their eyes so
good cameras are very important and the
cameras on the comments three are really
amazing
i worked quite a bit with them already
george talked about 120 db of dynamic
range
uh they they do hdr they do full four
exposures at the same time
so you have four exposures and each
successive exposure has a
16x shorter exposure time
so in this way you can see very dark but
very bright areas at the same time
um so yeah this is uh
kind of what uh represents open pilot
uh over time um we've been running on
the on the lay code or the oneplus 3
and basically open file has always
filled all the available cpu space
um but it was always fine like if we
wanted to try to ship a new feature we
would free up some cpu we would rewrite
something
um in c plus plus make it faster
and then in the end we always have the
cpu available to direct the feature we
want
um so yeah we've been running our 2016
era smartphone for quite a while
uh and actually we don't clog the cpu a
couple times
uh just for thermal performance because
the the cooling is really terrible
uh but still we're only using like 65 of
the cpu
i mean the gpu is a different question
but cpu there's definitely plenty of
um so yeah now i'm gonna take you on a
tour of
openpile features some some nice
milestones basically from
version 0.1 to the upcoming release
version 0.8.7 this is between 2016 and
2021.
um so this is basically pre-release
this is the the acura ilex with still
the computer in the back
uh and the joystick to engage and
disengage this is what
george took the bloomberg reporter on to
uh to vegas
so this is kind of the shape of open
pilot you can see the
the open pilot ui in the bottom left
we still have that debug ui around so
happy to see that
that code still exists um
and then it was time for the basically
the initial open source release
which ran on the the common neo it's
like this whole diy
the 3d print a bunch and this is also
where
the neon green color came from we got a
bunch of 3d printers
and when you buy the 3d printer it comes
with a little bit of free filament
in the most hideous color you can
imagine of course so that's why a bunch
of our stuff was neon green
i think we still have uh quite a few
spools of that left
um this is what the ui looked like um
back then
so very engineery hackery with
all the green boxes all the lines over
time like
a lot nicer as well
um then i want to talk about the feature
in 0.3.7
about model predictive control i mean
the feature itself is nice but this was
my
my first feature i shipped as an intern
after i joined comma
um this basically made the controls way
more smooth
instead of some like it turned it into
an optimization problem so you put in
like the position of the leaf car and
the velocities of the leaf car and you
try to optimize
the brake and the gas and the steering
to get the most smooth maneuvers
possible
and a lot of this code is still around
which is very nice harold made some
tweaks to it
in the meantime the the basic stuff is
still around so
it was um it was pretty cool to see that
a comma when
yeah you write a feature and then in a
few months you have this running
i mean at the time at a few hundred
users but now it's like thousands of
users
that run your code
another feature i worked on as an intern
was for question warning
this is when i kind of realized that the
power of all the data that comma has
so when you at the time this wasn't
no machine learning but i used the model
outputs um to see what the current phone
was doing
and then i made some rules to come up
with uh
when to show the four question one then
i could use all the data to see
what if this had any false positives to
tweak the algorithm
and this is yeah this really showed the
power of the data and this is probably
something the oems can't even do
they have to go to a test track and some
testing
um 0.4.4 was uh the big flipping
so it was pretty funny uh so when we
designed the original eon
uh we actually put the selfie camera on
the right side of the device
uh which turned out to be a mistake um
when we wanted to start
gathering uh driver monitoring footage
uh we want to put the camera on the left
so we just flipped everything around um
luckily the eon case was symmetrical so
with a hex screwdriver you could take it
apart
flip the mount around and then put it
back in your car and chris even made a
nice video about that three years ago
[Music]
so this is the the first step towards
driver monitoring which is very
important
um when i was going through the release
notes i also noticed this
pretty funny thing and version 0.4.6
which fix all memory leaks
uh i don't think that was actually true
but it was very optimistic at least
in version 0.4.7 we shipped
the first model with our improved brand
choosing stack
um so before we just we we tried to
recover the path that
the car took we used mostly as the
gyroscope for this and then
all gyroscopes has have a bias which we
didn't remove properly
so before this point all the models had
like this bias that
would point you to slightly towards the
right if you looked in the distance the
model would always do this
uh so we had this uh this fixed offset
of one and a half degrees which we
always subtracted before we sent
the angle to the steering controller um
but after this was finally gone
so just close cool dimension
then in version 0.5.0 we shipped right
for monitoring i'm sure wishing is going
to talk a lot more about
the driver monitoring but yeah as
openpipe started getting better and
better
like in the first version we had this
this bar that took six minutes to calm
down and he had to touch the wheel
um i mean six minutes now in hindsight
is a very long time
but uh overpaid messed up so so often
that
you you felt very proud if you actually
hit the six minute mark and you're
always paying attention
but then as opposed got better it made
less mistakes and then
it became very important to make sure
that the driver is paying attention
um and yeah you can you can just make
the wheel touch time shorter but at some
some point that just becomes too
annoying so we actually want to make
sure that the user is paying attention
so we
look at their face and see if they're
looking at the rib
then in version 0.5.8 we open source
vision d
um we always joke that we were probably
one of the first companies to actually
ship
a neural net on the edge on like a
device in in the field
uh back at the in the day we wrote our
own opencl kernels to do
all the neural net stuff but at some
point we shipped to the
smp which is a qualcomm library to do it
as well and they have all these
these nice uh opencl kernels i reverse
engineered their their library ones and
they're they're super tweaked for for
what the the snapdragon can do so
they're super good uh so we should
switch to smp
um and then so we just decided to open
source vision d
uh and at that point all the code in in
open pi was open source which is a
pretty cool milestone
then in version 0.7.7 we actually
started driving on the localizer so to
speak
so all cars of course are different all
the tires have different grip on the
road and this can depend on like
how wet the road is how the temperature
and there's the steering it's like the
manufacture system
some end-to-end ratio usually but this
is not true for driving
so we try for each car uh we try to
estimate
the vehicle um and with like 130 car
support this is very important because
you can't
be measuring this for every car uh so we
actually uh
estimate this offline we look at how the
car drives with the steering angle the
speed
and then we predict how we think the car
should drive and then we could tweak
uh the vehicle parameters a bit so it
matches our expectation
and this is very important for things
like banked roads
so if the road is a little slope to the
left or right
then you would start hugging but this
actually takes care of that it sees that
the the car is not driving as expected
and then compensates for it
uh in version 0.8.0 we shipped
the first full 3d driving model uh that
would not only output lanes and paths
and
x y but also in z um and this is
mostly useful for the the discussions
the openpilot team had with research
uh we would look at like a a replay and
they would say now this model is
overestimating the turn
um but you have to be very careful
because of projection errors that if
the road would slope up or down a little
bit it would completely throw off how
the lines looked and the research team
always said no no it's not
overestimating it's just um
it's just a projection and then well
turned out usually
in a lot of cases we were right and this
is the one of the bugs that harold was
talking about
with the yellow lane lines at night
and then in version zero 8.3 we shipped
the first end to end lateral model uh
which is
yeah a big very big step which is
something that the research team has
been working on for a very long time
uh and i'm very excited to see what the
the future of this will look like
and then in the same release we also
switched to a ui and qt
we had this massive code base in react
native although
the ui was uh was an android apk and
then with uh
at the time we were already working on
the on the chrome 3 as well
um so yeah we uh we moved the whole ui
to qt it's super responsive now
and it's all it lives in the same open
pilot code base so
we didn't have to rewrite all the
messaging stuff
in january 2020 we also made a very
important change
on how openpilots developed so open file
used to be developed in a cathedral
style
open source which means all the
development happens behind the scenes
and then when there's a release you get
this dump on github with all the source
but of course you want to get
contributions from the community so
people still make prs for
things like car support i just kind of
became like a pain to merge
because like they could basic the public
code base was already behind
people couldn't see what we're working
on we started running all the ci
behind the scenes but then we couldn't
run the prs on the ci
uh so in january 2020 we just decided to
uh develop everything at open source
uh by the time we also didn't need to
test in cars anymore so
we could be pretty certain that if uh if
rci passed that
if the code probably wasn't broken so if
people started running that
on their device it wasn't such a big
deal
so this was her old monorepo was called
one everything was in one
repo um yeah and then
this grew over like the three years that
we used it
uh but now everything is done in the
open pilot repo and you can see this in
the in the graph the number of commits
went up significantly
and now all the other developments done
in the public uh no
no secret stuff even the the common
three stuff has been
developed in the open some people know
this but yeah
so yeah i think this uh this shows us
very nicely how far
we've come from version 0.1 to version
0.8.7 um sometimes progress feels slow
but it's always good to take a step back
and see how far we've come
and i think this is very promising for
what the future will show us
um if we can get this much out of
the 2016 our smartphone i think that
proves our point that this is just a
software problem
and if we just keep chipping away at the
software it's just going to keep getting
better and better
so what's next i think the most
important part is stability
and it's definitely a few features that
still need to be developed but yeah
stability is very important so we're
flirting one hours or 1 000 hours
between
failures so it means unplanned
disengagement so this can be anything
from
a hard reboot which is very rare now
but also like communication error
between processes so if you don't meet
the real-time deadline
or other unexpected like planner
failures or
model failures uh of course we're gonna
start to keep supporting more and more
cars and the openplay team is also going
to prepare
running larger models it's mostly a
bandwidth problem with the gpu
so just by writing the all the
processing stages of the video so it's
like
all the debayering um all the
all the conversions we do uh just make
sure that all runs on the c
on the gpu stays on the gpu um do
efficient messaging so yeah
uh and of course we're gonna talk about
navigation but i'm gonna talk more about
that later
uh i also want to usually thank the
community who uh also make
especially the old 130 cars we support
possible
uh you can see this is just past months
we had over 200 pull request marks which
is uh pretty cool
i think a while back on hacker news
someone made a tool to see how fast vrs
were emerged
um and it's also cool to see how quickly
we were processing
all these pr's with quite a small team
um yeah this this small team um
forces us into certain things like not
writing a lot of code
but these are usually good things like
we see this in research too it's like
yeah we're not hiring a cone guy we're a
small team so we have to
we have to make sure that we have as
much leverage as possible so
this end-to-end approach makes a lot of
sense um and if you have a lot of people
you're tricked into these
approaches that don't scale well and
even with all those people still
will never work uh so i think this is
true for the the number of lines of code
as well if you you can do a lot with not
a lot of code
um so yeah like the sudo project it's
like over 200 000 lines of code
um yeah with open pi we're trying to
keep the number of lines of code
below 100 000 and so far we've
succeeded now we can also plot this over
time
um so yeah we're you can see uh version
0.5.8 there's a big increase when we
open source vision d on camera d uh and
then
in version 0.7.7 we start to get awfully
close to the
300 000 line limit so we did a big
cleanup started to remove all
unnecessary code and that was
comfortably
down to 60 000 again and this is still
an amount of code that one person can
keep in their head
i know what all the moving parts are and
this yeah
makes a lot easier to develop on open
file as well
but as you can see the the number of
cars that support it keeps going up
um and robin mentioned this as well
nicely that we only need 45 lines of
code for each supportive card
just because we have very nice car
abstraction links
um i also want to talk briefly about the
hardware that's needed to run openpilot
uh so in the past it was the the common
neo
which was this diy project it's like we
have this manual on github you have to
3d print some parts order a board
um and it's like solder a connector to
your car
you lost all stock system capabilities
but that's uh
luckily no longer the case uh then we
shipped the eon with the giraffe
which had some nice switches but even as
an
open as a comma employee i could never
remember what all the switches did
i always had to look it up so it's not
great for usability
um and then that was fixed with the the
comma two and the car harness and
um this turned out to be the future and
this is still used for the chroma 3.
um i'm also going to show a bit of the
the ui progress we made
i think this uh very nicely shows how
much
open pi has progressed the software i
think the ui quality
really nicely shows that the state of
the
the self-driving code as well so this is
the original ui
with the nice hacker font this is what a
something in a movie would look like but
uh nem starts to become nicer and nicer
and this is all the react native stuff
it's turned out to be a mistake in the
end and now we have this beautiful qt ui
which looks really slick
and to develop openpilot we also had to
develop quite a bit of tools
and libraries uh which i'll go over
briefly
um so we developed cabana which is used
to reverse engineer the car
uh rob also talked about this a little
bit which produced opendbc which is this
big github repository with all the
different reverse engineered signals
um we also added open file support to
plot jaguar recently
uh which is this very smooth nice
polling library
so you can pull all the the signals for
the open pipe modules and how they're
communicating with each other
it also parses out all the data from the
from the canvas so you can put those
together
um yeah and you can also do live
streaming so if you're testing something
in the car
and you can see it live for tuning this
is so much better than all the
one-off jupiter notebook scripts we use
the riot and it's
so much faster to debug stuff with this
um we also added support for carla which
is a great way for new users to
experience open pilot
uh where they can try out open file
without a supported car
um i mean carla is not the most
realistic simulator but
i i use it some from time to time to see
if like if i'm writing a new feature
just do some sanity checks make sure i
didn't
mess up a sign or anything it's not
steering left when it's supposed to go
right
um we also made explorer
which is a nice way to view all your
drives or your dashcam footage but i'll
talk more about that later
so we um overall we made quite a bit of
progress
i went from a proof of concept and to
well over 3 500 weekly active users
we went from a 3d printed case to an
injection molded case that's like a real
product
product we built some nice developer
tools in the process
and we also built some very nice
libraries uh so we tried to keep the
number of dependencies low uh but they
also need to be
resource efficient so we wrote message
queue so we used to use zero mq which is
nice socket library but i used quite a
bit of cpu so we wrote our own library
reduces shared memory
um research team read leica to do gps
processing and we
developed open dbc in the in the process
um i also want to talk briefly about my
time at comma
i i've had a great time at comma so far
um just i was looking for an internship
and then i
saw the program i got sent a programming
challenge which i thought was really
cool way to hire at the time
so it tipped away it's a the chance for
a weekend
i was like well even if i don't get the
internship at least i had fun for a
weekend
and if you get the the attitude to get
you into comma
i did well enough to uh to get an
internship which is a great start
for my time at comma i made some great
road trips in the u.s
with my comma devices it's really fun
we spent some days in the field as well
uh this time we're testing a b we're
making sure that all the
all the forwarding of of the a b still
worked as we went out with
ricardo and nadeep and we uh printed out
this uh this
bw golf stuck some aluminum foil to the
back
taped it to some boxes and then we
rented this piece of
empty track and then we just tried to
drive into it it was this game of
chicken with the boxes
and as you can see in the bottom right
it didn't always go successfully
um i also learned how to hack cars at
comma
so this is the time we uh i guess we
wanted to show the
flex-ray wasn't so insurmountable as
people thought
so the plan was to rent an audi a4 so
rob and i went up to la to pick up the
the a4 and the person who rented this to
us
really uh he said it had all the driver
assistance features we needed but it
didn't so we had to
give it back immediately and then we uh
went to mcdonald's and we started
looking for other audis with flex-ray
but the only thing we could find with
the driver assistance features was this
absurd q8
so we picked it up in compton um
and then we uh then went back to uh to
san diego for the hackathon
and we immediately filled it with wire
started hacking away
um and then after two very long days we
uh we finally got it to steer
so it's a very nice to see that was
possible uh
i also showed how absurd the use of flex
ray is in these cars
uh i know some some manager probably
decided that they need a flex rate uh so
they put in this
this whole flex ray stuff and then they
stand sent the same exact cam messages
as
on any vw golf but then they send it on
this super expensive bus
and so not sure why they did this
this is uh the combat three this was uh
back in san francisco
uh just we uh we decided we wanted to do
rtk gps where this is where you build
like a base station and you could do
very accurate gps
i was a complete waste of time but we
had a lot of fun building uh the combat
through
the combat 3 so i guess it's the the
predecessor of the
of the comma 3. um so we put this uh big
gps antenna on the roof
got some two by fours um attached it to
the outside of the house
and i had some cables running through
the bathroom so sometimes when you're
taking a shower like the floor got wet
and then the gps antenna went down
so that's i guess that's the startup
vibe
um i want to talk about some
announcements uh i think olaf is already
spoiled by george with the navigation
uh we're gonna start with uh connect
so we used to have explorer and the
mobile app connects but
um yeah we decided it was not worth it
to deal with apple and the app store
anymore
uh so we decided to just all integrate
this into this super nice web app which
is now live
at connect.com it has all the features
that
from the the phone app used to have and
and way more
um so yeah it's really cool you can see
your battery filtered you can take
snapshots
and with the comments three you can see
your live location and previously it
would just show the
the last the position of the last drive
you took but now if your car would get
towed
you could actually see the car in real
time
and we have now this nice unified
experience between
desktop and mobile
so yeah no longer in the app store it's
a nice progressive web app which you can
add to your home screen
and it will always be up to date and
this change to
to connect was also very important for
the next feature for
navigation because we needed a good way
for users to enter their destination to
manage their favorites
um and like typing a destination on the
device is not really a
not really a nice user experience
um so yeah so we have connect and then
we have navigation on the device
uh which is just for my turn navigation
but then integrated into the open file
experience
so you can go to connect you type in a
location so if you want to go to
taco bell so that's very nice reverse
geo coding we'll show you all the
taco bells in the area
and you can add favorites you can add
home and work locations
which will then show up on your device
like this
so if you're just starting up your
device you click home and
i will just go down and you can also use
the
connect to set up a destination um so
how does
so you type in your destination it will
preview the route and then when you
click navigate it will actually go
through athena
so all the devices on the common network
have a websocket connection open to our
server
and then if you're subscribed to prime
you can use this to
to send the location over to your device
and this is this is really smooth like
within a second
the map pops open with your red loaded
and it's a really
smooth experience
uh this is all based on mostly map box
and
other open source stuff so the relating
is uh
i think it's basically based on valhalla
and then we use the macbook driving api
which is built on valhalla with them
with some
traffic information sprinkles on top a
lot of macbooks users send their
real-time location to macbooks so they
have all this real-time traffic
information which is really nice for us
to use
um and then we render it on top of some
very sharp vector tiles and they have
this nice
opengl library uh to render these so
it's it's very smooth
and yeah it looks looks really nice if
you just get this term by turn
navigation you've even got lane
lane info if that's available so in this
case we'll tell you to be in the
leftmost line and it will also tell you
the traffic so we know how much how long
a round normally takes and if it takes
longer than that we can see for each
segment
if that's the case and we can we can
show that as well
um but then the big question of course
is um
yeah so uh what the future will look
like so
it's important that you have comma prime
uh this pays for all the
all the tiles and all the writing
requests we do and paste for the
infrastructure
so yeah sign up when you get your comma
3 just sign up for the trial immediately
and enjoy this for a couple months
and see it just experience the
navigation experience
and then the question is like how how
are we going to build this out to
um navigate on openpilot so how we
already talked about desire
which is this way to signal to the
layout to the model that you want to
make a lane change or keep left and keep
right
and of course this is going to be the
first step to see if navigation tells
you to keep left what
what will happen if we tell the model to
do that
but then we're also going to this is why
it's very important that navigation is
is an
on-device experience we can render a
nice view
of the map and the routes uh that's
specifically meant for the model
and the model can take that in as like a
fourth camera
and then actually can make decisions
based on that and i think if we all
put that together uh train this with all
the data that's coming back from the
chromosomes i think
is going to feel like a magical
experience
so yeah that was my presentation
i hope you guys all saw what the nav
looks like in its current state uh and i
think once you try it out for the first
time it really feels like a
magical experience um and
i think i've also shown how far we've
come with open file how
how we've come from version 0.1 to
version 087 and i think this just
shows how much more is possible and how
good hopefully it's going to be in the
future
yeah that was uh that was my top
no q a
all right
all right guys it is my absolute
pleasure uh
to welcome adeeb to the stage next he
works on open pilot um
endlessly every night when i leave i
don't think i've ever
uh a deep i've never left after you in
the office
ever um he's unbelievable machine
um and you know when we were planning
the event
we were talking about you know the
developer community and what we could do
for the for the community
and i just want everyone to know that at
every
team dinner and lunch hadeeb is talking
about
is is literally a ticker of all the
information going on on github
um and he stands up for all for the
community
and he has some really exciting
announcements um
about pricing products um
you can thank him afterwards uh
come on up
which clicker is it
alex this one yeah okay
[Music]
this is confusing all right
so i'm indeed i work on open pilot
and i'm going to talk about mostly
testing
but as alex said there's going to be a
couple of fun announcements at the end
so we're going to talk about uh quality
and how we don't break stuff because
oppai is getting to be a big project
and we support two hardware platforms
now
with two different operating systems one
based on android and one based on ubuntu
we do roughly monthly releases that are
fairly large
this one in particular was a recent one
that was pretty large
um this one so these are a couple of
releases that we did recently
they're pretty big we have a small team
we support 132 cars as of today
um various brands and we have over 200
plus contributors
in the last well since last january um
since we went to change development
style and we develop publicly now
so how do we not break stuff
this is a commit from 2016 and we had a
dream back then
one day we'll have ci
and then here we are july 2021
so these are some randomly sampled desks
at the office and you'll notice
there are no common devices on these
desks
they're just computers they're built to
work stations
and this is largely our development
workflow now
we sit at desks not on cars anymore
and the answer to how we don't break
stuff is
um we have automated regression testing
and human testing
we do hardware in the loop tests we do
offline checks
um for long for anomaly detection and we
do online checks
on the device so the testing goals for
open pilot
are enforcing quality reducing the time
spent in cars
as we showed with that picture on the
desks and
efficiently scaling a small team
because the open pilot team is about
three full-time people with a research
team
that doesn't have four full-time people
and
we have a very concrete goal of a
thousand hours mean time between failure
for 1.0
so some of the automated checks we do
these are the public ones at least
we have a github actions test suite that
runs unit tests
this test process replay that's fairly
important and we do these uh
car unit tests that are also pretty
important
then we have um a jenkins server that
runs our hardware and the loop tests
where we have comma threes and comma
twos um
going on road running real segments
doing replays and enforcing things like
are the timings as good as we want is
the cpu usage exactly as we
expect it to be things like that
and then uh you guys have probably seen
the online checks if you use open pilot
sometimes you'll get a fan mail function
sometimes you've got a gps malfunction
it'll say contact support and then what
people do
they go to discord but when the alert
works you should contact support
um we try really hard to make these
alerts and be very aggressive about it
but also
um prevent the stuff from going out in
the field
but yeah we do some pretty extensive
checking across
all the different services in openpilot
we make sure that uh all the services
are live
they're healthy and their sources for
data are also healthy
so if um like one of the sensors is bad
for example this will propagate all the
way through the
through location d through the planner
and controls will say
okay we can't engage now or we have to
disengage now
and then this is uh one of our more
important tests
that run some github actions um it's
called process replay
and we can deterministically uh
replay segments through routes or
through uh
processes and we can take the same set
of inputs
and assure that we get the same set of
outputs and if we don't we generate
these nice diffs
as you can see here
so this is a diff for one of uh for
actually the new model that we just uh
tried to ship in 087 but we had to
revert
which will hopefully ship soon but this
is the diff that it generated
um we switched to um
some different lead packets and stuff so
you'll notice the difference here it
tells you exactly what changed
and we can know given two different
commits um
what will the outputs of this particular
open pilot service be
did they change in the ways that we
expected or did they not change so
a lot of times we'll do a refactor where
we expect that nothing changes
and this is pretty important because we
can do things like
we can review pr's really quickly you
read the diff
you make sure the diff is reasonable you
do your diligence there
but if the green check mark is there on
github actions you can be
reasonably certain that this did not
change any behavior of the tested open
pilot processes
and this runs on all the driving
processes so there's six critical
driving processes and this covers all of
them
and some other ones then we do
some car unit tests and these car tests
are super important for scaling to these
132 cars
that we haven't really touched so we
have six cars in the office right now
we've probably touched somewhere in the
neighborhood of a few dozen cars
over the lifetime of the company um but
all the other ones come through pull
requests
pull requests that are fairly small but
uh it's still important to make sure
that these cars work because
we sell devices we want to ensure
quality and
there's really no reason not to we
invested
quite a bit of time in making these very
reliable unit tests
and now we can be reasonably certain
that every car that openpile has a test
route for
functions to some degree we can't we
don't necessarily check
driving behavior but we check system
behavior will this car throw a canner
will the frequency checks work on this
car
um will panda safety agree with
openpilot
because if this isn't true as you heard
in robay stock
the panel will just block the messages
so this asserts some very basic behavior
and allows us to effortlessly scale to
the next milestone in cars which maybe
is 250 1000 cars
and then this is a part of our suite of
offline anomaly detection
so we have a pipeline stage called find
interesting that runs on all the
incoming data
and this runs on those queue logs that
anybody who runs open pilot uploads
and these are some tiny logs that we get
a lot of information
about all the devices in the field
we can so this is this is like a real
screenshot from our dashboards
that we have up in the middle of the
office so you see right now
some of the top errors are with um some
there's some panda stuff
there's some camera d stuff on the comma
two there's some
a little bit of poor model timings on
release
and we have this cool iteration loop we
do with find interesting where
we aggressively log everything that we
want that we expect to happen with
openpilot
and then we look at it and find
interesting and we look at the data that
comes in
and if this isn't happening it's going
to show up and find interesting it's
going to be one of these top things
oops
clickers are hard oh yeah there we go
so you see that these panda errors are
dominating right now
a year ago it used to be overheats can
errors all these other things
but every release we look at the top few
things and we fix them
and then you just end up with a way more
reliable system when
you're tracking the things that you care
about because if we don't track these
things they're going to regress
and this is our testing closet you may
have heard about it it's a little bit of
a strange name
but the name comes from the closet it
was originally housed in
in the original comma house and you can
see
you can see some comma threes here
running different branches
you can see some comma twos these comma
twos are running
an eos update that was supposed to ship
in a previous release
but that didn't make the cut because of
some things we found it find interesting
that i'll show you in the next slide
um but this is how we verify um some of
like the long tail reliability in that
there's no reason open pilot shouldn't
just run if we if we connect it to a
what we call a jungle and this allows us
to essentially emulate the behavior of
being in a car and driving around
there's no reason it shouldn't run
for days and weeks and months and these
comets whose here
have been running for a little over four
weeks
so far this was with obviously a version
of openpilot from about a month ago but
we update these devices fairly often and
we
were able to be reasonably confident
about the reliability and behavior of
these devices at openpilot
because of the data we get back from the
testing closet
here's some plots from the testing
closet these are
diffs of uh consecutive messages from
different open pilot servers so we have
calibration d's message we have one from
d modern model d
um we have one from the planner and we
have one from
the modern model d so these are four
different open pilot processes
that we're looking at messages from and
we can see that the timings are
they're pretty good for the planner
they're
a little bit worse for the modern model
d
and then you'll see
the monitoring d and d monitoring model
d follow because
they're driven by each other but uh
we can assert some timings
as you can see in the next slide so this
is the
timings of board d so bordea is a
process that talks to the panda
in your car so that's um you have
if you remember from robestock you have
uh your comma device
the combat 2 or 3 now and you have the
panda which is
built into the device but nevertheless
it's a it's a distinct
device and we talked about over usb on
both devices right now
and this timing is super important
because it drives the rest of the stack
the camera and the panda drive the stack
essentially
and that's why camera d and board d are
super important for
latency and real-time performance so
if more g is performing poorly the rest
of the processes that
um rely on board d are gonna perform
poorly so just controls the
which is what actually talks to your car
so we worked really hard to get these
timings
to the point where it doesn't miss a
cycle anymore um
and then this is why we didn't ship that
neos update
a couple releases ago there's still a pr
open for neos 18.
about a year ago we wrote this daemon
that fixes
um these random canters where you would
get lags on comma twos
um randomly where it would seem that
board you just wouldn't get
would run for uh dozens of milliseconds
and then you get these lags
because of our strict online checks
so you can see out in the long tail here
you have it lagging for almost
100 milliseconds and it does this
quite a few times if we go back to the
previous slide
it never does this so this is some of
the behavior we certain testing closet
um it was pretty important for assuring
that we don't ship progressions
and then we're hitting the targets that
we aim to
and this is pretty cool so we all of the
github action tests that we run on our
repo
you can run on your repo too we put the
effort in to the point where you can
click the fork button
and then you click allow actions and you
will have
a large portion of our of our testing
infrastructure running on your fork
if you're there's many popular fork
maintainers out there
who have sometimes hundreds of users
and you have all this testing
infrastructure that we've built up you
can if you do
uh if you support cars that we're never
going to support for example
the mosses that have the steering
lockout we don't intend to support these
cars
or at least claim uh that they're an
open pilot experience
but you can you can reach
uh as much as you can like you can
support the car to almost the flow of
stat that we can
by using the test infrastructure that we
have and it's really
you click this one button you go into
the settings for your forked repo
and you enable github actions um
now we're going to talk about panda
testing
so we have two goals for panda um it
should enforce the functional safety
um that we've defined for openpilot
and it should enforce the hardware
functionality um so
you know you tell the panda to send this
cam message it's just on the can message
so here's an overview of the testing
infrastructure for panda
we do unit tests again in github actions
we do replay tests where we take
a segment and it's very similar to
process replay
where we assert that the behavior hasn't
changed um
from commit to commit and then we do
some static analysis
um robot talked a little bit about mizra
i think in his q
a and iso 262 so our unit tests
and our stack analysis um go a long way
to cover the uh
code rigor that we have that we have
hold in panda
um that isn't necessarily um a goal of
open pilot
and then we have hardware and loop tests
that run on the whole zoo so they run on
every panel that we've ever made from
white gray black uno dos
so our safety unit tests are pretty cool
because you can write
all the functional safes you need for a
brand new carport and you can write a
test for it and on average
the test is about 165 lines which is
something you can reasonably do
in an afternoon or uh or a weekend and
you can
develop functional safety for your brand
new carport um
and verify the functionality without
ever going in a car or even doing a
replay
so i think this is incredibly cool and
we we have tesco all these cars all
these safety modes that ship and open
pilot release
and this runs for every hardware
combination of every car we support so
we support 132 cars
we support quite a few pandas that's
that's a lot of combinations
and then we do hardware in the loop
tests um we assert things like
can latency can loopback um this
essentially
maintains that if i send out a message
do i get it back
and we can do this with multiple pandas
we use something i'll talk about a
little bit later the panda jungle
uh we also uh do some checks with the
car harness that we're correctly
detecting ignition all this other kind
of stuff
and then i want to talk a little bit
about production building devices
um because this is also pretty cool
george talk a little bit about screen
calibration
um this is some of the stuff we've just
gotten to do because we've gotten really
good at testing these devices
that we can do the fun stuff
we'll go back so after your comma device
is built
what happens so we flash it with neo s
or agnos um whether you have a comma two
or three
we do some initial checks to filter out
defective units
um and then we have this provisioning
stage
which runs uh quite a few tests and
asserts all
the hardware functionality um
that we design our combat devices for
and then we have a 24 hour stress test
that george talked a little bit about in
his presentation
and this is this is how we're working
towards building these really incredible
devices
um that i think you guys will get
hopefully uh
after the first shipment on thursday so
this is our provisioning stage
this is what happens after flashing and
we do that um
initial check and make sure there's
nothing obviously wrong like
does it have all the sensors or is it
missing the modem
after it passes those basic checks it
goes on to final provisioning
and these are some very early comma
threes um
and we started writing these tests
fairly early on um we wrote these tests
a couple months ago
and we've really iterated on them the
last couple of weeks but
these are some old revisions of the
comma three and they
um you can see some of them failed some
of them are still running the test and
some of them pass but it's cut off um
and we verify things like sensors is
wi-fi working is lte working
um are all the things the right firmware
versions that we expect
is the camera in focus this is becoming
more important with the comma 3 because
we
focus the cameras ourselves we have a
lot of control over the process but this
means there's
a lot more that can go wrong so um
testing becomes
a little bit more important in some
aspects comma three
then we also do some testing with the
panda the internal panda um
uno and dos and your comma twos and
threes
um and we can
basically be confident about all the
hardware that we're shipping out um
just based off this quick test this test
runs um in a couple minutes
and it asserts all the instantaneous
functionality we can check we do some
there's a and the daughter board that
george talked about
in his uh presentation that goes on top
of that uh
that modem on the comma three there's a
there's a
beeper and that fires when you
uh device powers off essentially um
while it's still engaged
and uh there's we do tests like that we
you hear these all throughout the office
we go through a lot to test these
devices
we have some really cool tests with that
and then it also does a server
registration
then we do the stress test so this one's
pretty cool
because we have all sorts of different
failures we caught on the stress test
we check for temperature this one used
to be super
super important with combat 2 because
the device would fail a lot
we check for gps accuracy now we do
a lot of camera checks like are we
dropping frames uh
are we getting any errors from the
camera at all this indicates some kind
of
assembly defect um where a screw isn't
screwed in all the way
stuff like this and we have these very
strict checks
and it runs for a continuous 24 hours
no like uh if it happens two times then
we'll let it pass
these are super strict at it turns red
when it fails it's uh
it's alarming we pull it off the rig and
it goes back in the production process
and then this is a pretty cool chart
so we shipped the comma twos with uh
some some testing that we can think of
beforehand but there's a lot of
unexpected failures with them
and a lot of the tests were written
after things happened in the field
and then we found out that this is
something we really need to test for
this is something that varies quite a
bit from device to device
as we still establish these production
processes
so this this kind of
shows how we improve these devices over
time and
how every device that has been shipped
also benefits from the improvements from
the device that we make in the future
so we said we used to set aside all the
comma twos that failed um this is our
first serious time doing production so
we
do the tests and failed either final
provisioning or the stress test we put
it to the side
and it goes in a bin and we just have
walls and walls of
um particular failures um ranging from
very minor things like
we need to fix up some solder joints or
something
to the cpu is too hot this is
some kind of device failure or we need
to do something more major
to fix this so cpu too hot
around i think september october of last
year was by far the um
biggest uh and most common failure for
the comma twos
so we reduce cpu usage in open pilot
and then we down clock the cpu fairly
significantly
to get these devices to pass the stress
test and
we went a little bit above and beyond
here we did a more extreme down clock
and the orange part of the histogram
here
is the devices that were too hot
and failed this in the stress test after
the down clock
and the blue ones are the device all the
devices we ship before that with the
current
uh clock frequency so the device that
were too hot
actually ended up being running even
cooler than devices we shipped out
before that passed the test
and then every device in that blue
category also benefited from this
because we shipped an ota update
to the kernel and all the devices got
cooler in the field
and then this is pretty cool here's a
gif of the screen calibration
so we've thought about comma 3 testing
for a long time
and how we're going to test them in
production and
we got to do some fun stuff um before we
shipped out the first units
so i think it's this kind of shows how
far we've come
from the comma 2 a couple years ago to
where we are at with the three right now
where we can we can do things like this
and you look at them and the stress test
is
uh let me go back to stress test the
stress test is
pretty big it's it's this is a small
part of it and you can see all these
devices on the stress test and their
screens look exactly the same
this is uh we put a comma 2 next to the
comma 3s yesterday
and the difference is incredible these
devices are really beautiful
and we have time to do things like this
now in the capacity
so i think i think you guys will be
really happy with these devices
and then now we're going to take a trip
to the kamazoo
well to the premiere san diego zoo which
is
kamazu and we're going to talk about the
panda jungle
so the panel jungle is what most of us
who have a device on our desk
use to uh do replays and to
debug and develop open pilot um so pano
jungle essentially has a panda on it and
it has six obdc ports so you can plug in
six comma two six comma three six pandas
whatever you want
um and this is how we do our hardware
loop testing for pandas
this is how we develop open pilot on
desks
you can essentially emulate being in a
car on your desk
um and it's an incredible debugging tool
um
and then now it has a working ignition
button we
ship nine of these devices in the last
well since we started selling them we
ship nine of them
and we just got the ignition button
working
but we have an announcement it's gonna
be 199 now
so hopefully uh we'll get another nine
people to buy them
and we have the next gen panda
red panda
so the red panda is based on an stm32h7
the previous generation of panda was
best was based on the stm32f4
we've been doing work um in the last
three months to develop this device and
bring it up
it's the future of the panda platform it
supports can fd
has a forex faster cpu and it's red
so it's the same black panther form
factor
um in a red case without gps
you'll be able to connect this to your
comma three um directly into that usbc
port
um and then you can buy one today
299. and it ships in two to eight weeks
and we're optimistic live support and
open pilot um
in the next release 08.
[Applause]
questions
um
not only from a time standpoint but
others as well
i imagine you'll be selling hundreds of
thousands of
devices we talked about the testing that
goes on
during production so that reworks
okay so there's a couple things there um
we're not quite at the scale of selling
hundreds of thousands
um yeah
yeah maybe but uh
as far as uh reworking the devices it is
it costs a lot of time um
but it's really clear now that this time
is
really worth spending uh it made every
comma 2 we ever shipped out
much more reliable and a much better
product
so i think right now the time we
invested in
and we do this kind of in stages so
we do the production process we build
devices we set them aside and then
it's kind of like to find interesting
loop we look at the top failures we fix
them
um or we evaluate what can we do about
these can we improve processes
can we improve the software at all like
where can we do better um
and it turned out for the comma too we
fixed all the common failures and this
made all the devices that much better
you buy a comma 2 today and it's
incredibly well tested
um so yeah it is worth spending the time
but we do it in stages we don't just you
know immediately rework them
was there another component to your
question i think i covered everything
how can we catch them earlier
yeah so um we try to
push test downstream as much as possible
into the earliest stages
and we've gotten really good at this
with the combat threes already actually
we catch
almost all the failures in final
provisioning which takes a couple
minutes you build a device
you flash it um there's a couple stages
of flashing actually
so we flash just the boards themselves
then we build it into a device then we
put agnes on it
um and then we do some final
provisioning
and um
we've gotten really good at this
actually so we we do
we add these tests when necessary and uh
yeah the the final provisioning tests
are really quick
we catch these super early in the
production process actually
have another one up here actually oh yes
thanks
um since again uh nice presentation nice
work on uh
on testing one question i have for you
guys uh maybe like um
for improvement uh you guys planning on
doing like some thermal cycling of the
devices
same thermal what cycling like uh
freezing them
basically like to minus 10 at minus 20
and then
hitting the knob pretty quickly because
that's what really happens
in practice and uh my device actually
had a problem comma too
after after this load trip when it
stayed outside
and cool down to -10 screen just stopped
working
okay um so i think your question about
thermals i i couldn't quite understand
that yeah like
thermal testing like do you guys plan on
doing like thermal cycling
yeah so i think we plan to
we cover all the hardware right now um
pretty thoroughly
but there's a lot of room um there's a
lot of depth to go into
um and the testing and our testing will
get much better we'll go through the
same process we did with the comma two
the comma three testing is where the
comma two testing um it kind of picked
up from there we didn't start over
so i think the combat three testing will
be really um i think it's quite
incredible right now
i think it's gonna get you saw the
screen calibration yeah this is
but what i'm saying is that uh coma is
not not really
it's a little bit different from
consumer electronics because uh it's
upgrading condition can
can go from minus 10 for example
celsus to i don't know 80 degrees pretty
quickly
yeah so that's not your playstation like
use case scenario usually
yeah yeah just something for improve
thanks
so with the red panda yeah and the new
car config
or in the comma car configurator when
you're trying to see if your car is
supported
if you need a red panda to support your
car is that going to show up in
in the configurator yeah so
this is something we we could easily do
no cars require the red panda right now
but i think some cars are starting to
ship like some
genesis cars uh we're starting to ship
with canfd when uh
when the first can if the uh carport
comes in we'll we'll handle this all
nicely
gotcha and can you maybe speak to the
what's on can fd and why it's important
to have that support in the red panda
yeah so it's just an upcoming uh
standard it's it's kind of the next step
in can
uh the fd stands for flexible data rate
you can get more data through
um faster so this is what the cars are
going to be shipping with
we want to support it it's also just
changing one ship so this is pretty cool
um we have one up here again
i'm sure another question on the red
panda um
since there's a panda in the c2 or the
c3 already
how does that work
do you bypass one do you switch one off
how does so you won't be able to use it
with the comma two um unfortunately
um this isn't like this is a hardware
limitation to combat two
it's the same reason you can't use a
comma smaze on a on a comma two
um so i guess if you have an eon you can
use the red panda but
any on gold it'll use the
usbc uh port on the comma three oh the
spare one okay okay yeah
we have one of our cars uh we have a red
panda one of our cars driving with a
comma three
okay cool thank you so one of the things
you listed was uh misra c2012
is that being applied to the panda and
also the um
open pilot no this is so openpilot is
considered qm
uh in terms of our functional safety
analysis um
panda is where that kind of code rigor
happens um
and this is where we designate um the
safety being enforced
okay and are you applying anything like
then cert
at all to the uh for security another
coding standard
considering you know making sure that
the code is written a certain way so
that
there's no vulnerabilities or anything
like that
misroad does that in in some sense but
wondering if there was any other
standards that you're applying uh
these are uh you may as far as coding
standards or is code shell save
coding standards so we uh
on the c code we also run we just run
some generic uh
stack analysis tools like cppcheck so we
use cppcheck
um we use some other static analysis
stuff and then they have a mizra add-on
and then we keep up to date with their
mizr add-on we even uh we fixed a couple
bugs in there
so we pretty actively
um work to work towards mizroc 2012
and for functional safety standards are
you then applying
like uh deal iso 26262
process standards for yes so you can see
uh it's pretty cool
if you go to panda you'll see we have
two projects we have an iso 262 project
and we have a sl2 project
um from when we did our
in-depth functional safety analysis and
we made a bunch of
issues and then you can see the product
you can see the progress
uh all the iso 262 stuff is almost done
all the cars that we officially support
have full iso 262 and panda
um if you self certify
as well the code or the the for safety
standards
like yeah there's no certifying body
there's no
okay
you said something about declocking
one of the chips to reduce the heat yeah
are all the common twos that are out
right now um with the d
clocked yep okay thanks yup and running
at about
55 60 overall cpu so this is well below
our target for uh
zero nine
thanks for the presentation so
the one question i have is what will be
the operating temperature for the
comma three we'll have the same
limitations that the comma two has
as far as maximum temperature that it
can be
run at so the active cooling in the
comma three
is quite a bit better uh the thermal
thresholds may be a little bit stricter
because
um from what we see in our stress test
thermals are
significantly better we see about max
temperature of 65
c you'll never see a combo 2 of 65c and
this is the max for the comma 3.
um it's
we might be a little bit more strict but
it's because we can we have more
um we have more room to be strict and
you you'll see the active cooling is
quite good in the com3
hey how's it going i'm curious what
yield you guys tend to get on the
production units
and when production units fail quality
control what tends to be the
the sort of common culprits yeah so
like i said we we do it in stages um so
we kind of establish processes we write
tests and then
production comes back after some period
of time a couple months or so
and they're like okay here's what failed
uh
a lot we also do we have a lot of
logging around this that's why we're
able to make these
uh cool histograms and stuff comparing
like all the comments we shipped up
until now
and then compared with the down clock um
so some of the common ones we saw with
the common too were like cpu too hot
some of them don't have an imei so we're
able to filter filter out a lot of the
like the raw eco phones there's tons of
failures in those
um that's like kind of a cost we just
have to eat
so we do a lot of filtering at every
level and there was
each kind of stage had its own uh
common failure stress test was cpu too
hot mostly
um final provisioning usually uh catches
things like
oh this device doesn't have a microphone
stuff like that
all right hadeeb thank you so much
that was great
so we started with robe he told you
about how we control the cars
and harold talked about our research
george announced our new hardware
deep talked a little bit about more
about open pilot and testing and now
i'm very excited to bring greg to the
stage
greg is our head of infrastructure you
are gonna
i mean unbelievable
you're gonna see inside our servers how
we build things
how we store the drives a lot of
i'm very excited there's a lot of
questions that come in and i feel like
today
greg is going to answer them please
welcome to the stage greg
[Music]
not on oh it is on can you guys hear me
how loud should i talk
louder okay tell me if uh
i'm making you go deaf all right so i am
greg hogan
i work on infrastructure here at comma
um
yeah let's see if i can figure out this
clicker
there we go all right let me turn this a
little bit
that's better all right so who's excited
to hear about infrastructure
wow i didn't think it'd be very many
people
that's good i guess that's a lot of
pressure though now if i
feel like people expect a lot or
something all right anyway we'll see
what happens
um so the goal comma is to solve
self-driving caller
solve self-driving cars uh we're gonna
do it with machine learning
and uh we're gonna need really good
infrastructure
to be able to accomplish this we got to
be able to iterate fast we got to be
able to train models you know
with reasonable speed and so forth
so at comma we call
everything supporting our customer
facing applications and model training
infrastructure so that's hardware and
software we call it all
infrastructure
so what do we need uh well
one thing we're gonna need is data and
so luckily we have
thousands of users every day collecting
data for us
and somehow we need to get this data to
train models
so we have devices out in the field
that have this data and
they upload it to a storage account in
azure that
data when it comes in we throw it into a
queue
and then it goes into uh
it it gets picked up from things get
picked up from that queue
from virtual machines that run in an
auto scaling
group and then we do some processing on
it
and uh decide what's good for you know
what what data do we have where are we
getting that's good for training
and we save some metadata about it off
so we want to minimize the cost of
processing this data we get a lot of
data
uh and we don't want to spend a fortune
processing it
um so what do we do well these cloud
storage providers pretty much all of
them now
have this great feature where like they
have all this spare capacity
and no one's using it so they have
something called spot instances or low
priority vms
and so you can use their infrastructure
that's kind of
spare for like 20
of the normal cost so but what's the
downside of this infrastructure
that's like super cheap well they can
pull these vms back anytime they want
when some other customer says oh hey i
would like a vm of that size
well then they kick you off and they
give it to someone else so
how do we manage this how do we keep our
processing
costs low and keep our latency low
because we need to get this data
processed so that we can give our users
access to it
and we want to do it in a timely manner
so what we do
is we spin up multiple
sizes of these scale sets
with different cpus different memory
configurations and
the probability of us losing any one of
these scale sets losing all the vms and
one of these scale sets
is independent of the other scale sets
that are the same size so what's the
probability of us losing all of them
well
it's exponential as we add another scale
set of a different size and another
scale set of a different size
so so that's why this works
and it works really great
so now that we have all this data uh we
need to be able to use it for different
things like some different applications
that we have
um the data isn't public but like the
api
we use for our applications we made it
public so that people can get their own
data
so you can go to api.com.ai for example
and you can see the documentation so
that you can you know if you wanted to
build your own application
on top of your data
we also have some nice tools that have
been in some of the other presentations
cabana for example it uses that same
public api
connect or it was previously explorer
it also uses that same public api and
this gives you you know
nice dash cam type functionality for
reviewing your data
and another nice thing that we offer
people um
is what we call an ssh proxy
so we sell a dev kit
and uh it'd be nice if
you could you know ssh into your device
from anywhere if you're doing like
development type stuff
uh but normally like if your cell phone
is on a cell network
mobile data they block port 22
uh because there's actually been
problems where like people accidentally
leave port 22 open and then
people can get into devices because you
know they did shady like the same
username and password for every device
or something like that
so how do we get around this so what we
do
is the devices whenever they have an
internet connection
they open a websocket connection to a
server that we have
uh in azure
and then when you want to connect to
your device what you can do
is you can ssh into
the hostname ssh.com.ai from your
computer
and your username is your device id and
you have to present a public key that
you had previously already set up
on your device so then what our
proxy server here does is it bring it
looks at your connection
and it says oh you're trying to connect
to this device let me go ask that device
what public keys
are allowed to connect to it it pulls
those public keys it then sees
if you can successfully authenticate
against the proxy server with that
public key
and then if you can then it lets you
tunnel an ssh connection
through the proxy server through the
websocket into your device
and then the device just i mean it's
literally port 22. like then
your your device then is going to
authenticate again with that same public
key
this is like what they call like an ssh
jump server
we just tunnel it through a websocket so
that everything's making incoming
connections and it doesn't matter if
you're on
a mobile network with your device where
port 22 is blocked
so
in case anyone's wondering comma doesn't
have ssh access to anyone's device
uh ssh is off by default on your device
you have to turn it on
and then you have to set up you know
what public keys you want uh to have
access to your device
um and all the authentication you know
happens on the device we can't
it's you know the way public key
authentication works is you know even
though
the traffic is passing through our proxy
server it's still encrypted with your
keys and so we have no way to be able to
look at any of that data
so all of that infrastructure we just
talked about
uh it's hosted in the cloud and it's
hosted there because you know
the cloud has these great features and
we're willing to pay a premium for
high reliability scalability and
availability
all right so we got a little sidetracked
there
we're talking about you know training
models
uh but we needed some good stuff to uh
we needed a good pipeline of data coming
in and and
you know that's kind of all the stuff
that supports that
so let's get back to let's get back to
training models
so what kind of hardware do we want to
train models
do we want to run it in the cloud well
the most important thing to us is that
we maximize
the compute we get per dollar we spend
on that
infrastructure and we can tolerate some
failures
the cloud is great you know because it's
so scalable and reliable
but for research you know we don't
really need
all of that there's a lot of data that
we can like regenerate if we
if we needed to and so forth um
so what meets these requirements so
it turns out that refurbished equipment
running in a garage
actually is it's really cheap and it
works really well
so if you consider the cost
of just the cloud data storage
for all the data that we hold for
for doing model training
the cost of that cloud storage that we
would need
to have equivalency we would recoup all
of our costs
in 10 months buying all the hardware
that we've bought so like our our return
is so
is so good like this here is a dgx super
pod
this thing's brand new probably looks
super clean and nice
so let's let's see if our servers look
like that
okay
so we started in an office in san
francisco and at some point
someone bought a rack and put some
servers in it
uh and then that rack turned into two
and then i turned into three
and the power wasn't very stable in the
house
at this point we had like a lot of
voltage swinging going on
when like gpus would hit really hard
uh model training or you know running
the segnet or something
and so we need a lot of power
conditioners
so you can kind of see here our ratio of
you actually can't see
the gpu servers here but you can see our
kind of
ratio of uh power conditioners to actual
you know use of compute it's kind of
it's kind of high um
another funny story so we actually uh
when we were in this house something
kind of weird happened
we had like a water leak at some point
and so they were in the front yard
digging up the water line and all of a
sudden like
the two phases on the house one went up
to like
300 volts and the other one down to like
100 volt 100 volts and we're like what
that
what in the world is going on uh and so
all of a sudden it went away and it kind
of correlated to when
they buried this this water line this
copper water line that was going into
the ground again
and so i take a clamp on amp meter and
i'm going around the house i'm trying to
figure out you know
what the heck is going on and i clamp
this clamp on amp meter
onto this copper pipe going into the
ground
it read 30 amps 30 amps of power
getting dumped into the ground through
the copper pipe
so why is this happening well it turns
out
that on the pole not even in the house
the pole where the house gets power
the uh the neutral was completely
disconnected like corrosion
had completely electrically disconnected
the neutral
so when you have an imbalance in between
your two phases
where's the difference go it goes
through the neutral
back to the transformer well we had no
neutral
so what's the next best thing well it
might have actually been
the copper water pipes which the ground
is is clamped to
through the ground to the neighbor's
house which also has
the neutral clamped or the ground
clamped onto the copper wire
and you know in your panels the neutral
and the ground are bonded together in
your main panel
so that's why we had 30 amps of power
going down into the ground
so uh so that was pretty funny
uh you know i don't know how gosh i
remember just like scratching my head
for days like really frustrated like
what the hell
we got these nice power conditioners and
all this weird stuff's going on but
anyway it's good good story i'm glad we
glad we figured it out um
so right now we're running these servers
in this garage in the basement
and
eventually the garage that the servers
are running in
well the garage doesn't have enough
power anymore to power these servers
so we need to find power somewhere else
so what do we do
well there's more circuits in the
basement so we start pulling power from
other circuits
but eventually the uh
the bottom floor of the house doesn't
have enough power
so well kitchens have a lot of circuits
a lot of 20 amp circuits so
you can kind of see here there's a
there's a black thing going down from
that window to the garage
that's a bundle of really heavy duty
extension cords
powering some of our servers in the
garage uh we also had a bunch of 3d
printers in there too so that didn't
that didn't help those things the the
heated beds can obviously
draw quite a bit of current too uh but
so
you know this can't go on forever the
house wasn't going to have enough power
we really wanted to buy more servers
like we always want to buy more servers
um and so
we get a real office we moved to san
diego
we got a big garage we got three phase
power
everything's great well
when you're using 60 kilowatts of power
you're generating a crap ton of heat and
you got to get rid of that heat somehow
so there's a few ways you can do this
you know the obvious one is if you run a
data center you have like climate
control right you got hvac
well air conditioning is really
expensive if you want to you know get
rid of 60 kilowatts of heat
so you know what do we do
well we're in san diego the temperature
doesn't
swing that much right doesn't get super
hot here
so we put in two ten thousand cfm
two ten thousand cfm fans we got an
intake fan and exhaust fan
put in a partition for separating the
hot and cold aisle of the servers
uh and you know that that worked pretty
well
but then we had another problem uh
so
it turns out that uh we started seeing
signs of corrosion like this fried
capacitor
this is a backplane on the server so
there's a lot of dirt here
uh and we got this capacitor that's
fried so
what's going on here it turns out
there's this thing called
equilibrium moisture content or emc
and it's really important so
um it's basically so equilibrium
moisture content
is the amount of moisture that a
material will hold
and it's neither releasing moisture into
the air or sucking moisture out of the
air
so like there's no such thing as dry or
wet
there's there's a continuous scale and
depending on what the relative humidity
and the temperature together
are determines what this equilibrium
moisture content is
uh so you've got to manage this or else
uh you know
all that dirt from this dirty garage
you know it's it holds moisture and
that's
that was kind of a problem
so you to manage this basically uh
you can look around and like find
numbers uh you want to keep it below
this 10.5 number generally if you go
above that it's considered corrosion
or it's considered a corrosive
environment if you keep it below you're
in good shape
so how do we stop this corrosion
so it's it's the scale right where like
as the relative humidity
goes up the temperature goes down the uh
the emc goes up so
how do we keep the relative humidity
down
and the temperature up is the question
or how do we how do we keep this number
low
and so you know the the obvious solution
here is again air conditioning
but that's kind of expensive do we
really want to do that
no we don't there's a cheaper solution
so
instead of sucking moisture out of the
air i'm sorry instead of lowering the
relative humidity
by taking moisture out of the air with
something like air conditioning
we can just raise the temperature
so when we buy these used servers
they've got like metrics you know from
whoever owned them last
so this here is a picture of you can see
the the black and gray on the far left
here
is what temperature the server was
running at before we got it
and then there's like a dead zone where
it wasn't on because no one owned it
and then you know the temperature after
we start running it so you know they ran
it around 21 to 23
c it sounds like a nice life for a
server
but then you know we get it and it runs
like 35c to 42
so uh you know we our our goal is to
keep it under 43
c 43c is 109.4 degrees fahrenheit
so you know we kind of we kind of abuse
them but everything in the server can
handle this
like the the lowest temperature i think
of anything
like the lowest operating temperature of
anything in the server is probably the
spinning drives and the ones that have
spinning drives
and that's like 55 c so you know 43 is
not that bad
so we also decided you know this is this
this is a lot of dirt maybe we should
try to keep some of the dirt off the
servers
so now we put this filter material just
right on the front of the servers
because you know
to get a 10 000 cfm fan with a filter on
it
is like 10 grand or something crazy
so that seems stupid we've got all these
servers they've got all these fans in
them
the only place they take in air is right
on the front of them so we just throw
the media filter right on the front of
it
uh we also decided you know we want
these back planes to last a while
they're still going to get dirty and
this
this isn't going to filter out all the
dirt this garage is you know pretty
dirty
so we put like 10 layers of conformal
coating on our backplanes
and we use like a potting compound to uh
seal up these exposed leads on these
drive connectors
this is a picture of a backplane that's
been all sealed up so that
you know we don't have this corrosion
problem and this is really only a
problem in the front of the server
because the temperature needs to be kind
of low
for the emc number to be high
so in the back of the server it's always
really hot but in the front of the
server that's where you're going to have
problems
and so you know that's kind of what we
saw the back planes you know catch a lot
of dirt and they're
it's the coolest part of the server
generally
all right so what do we have in these
racks
we've got 1888 cpu cores
72 gpus two petabytes of spinning drives
and 516 terabytes of solid-state drives
we've got basically two classes of
servers we have servers that we use as
compute nodes
and we have servers that we use as
trainers
so here's what our compute nodes look
like this is a rack of them
every one of these servers has 10
spinning drives
they're 1u servers they were new back in
like 2015 or 2016.
but they work great we have three racks
of these
here's what our trainers look like
they're also old servers
basically you know lots of ram lots of
gpus and
lots of network bandwidth
we also buy used networking with uh
equipment
so it's it's it boggles my mind how
cheap
you can buy this stuff uh
this is a 100 port that you're looking
at here this picture 100 port
64 or i'm sorry 100 gigabit
64 port switch this
switch costs us 2 800
that's 6.4 terabit of switching capacity
and i remember at one point i bought a
new
netgear 48 port switch for comma
and that netgear switch was only 10
gigabit
48 ports it was almost four thousand
dollars
and i can get a 64 port 100 gigabit
switch
for 2.8 thousand dollars yeah
thousand eight hundred dollars so we
have multiple of these
uh and then we also have an infiniband
switch for the for the trainers to get
even higher network bandwidth between
them
so how do we use this hardware to train
models
uh well we've got all this data and now
we need
really high bandwidth high performance
file system
for the different servers doing the
different tasks to pull the data
and work with it so originally we used
nfs for a long time
and yeah that doesn't scale uh it's
pretty bad
so we looked around at distributed file
systems that existed
and everything was way more complicated
than what we needed
um it's crazy how like complicated like
ceph is
and all these things so we built this
this uh we built this distributed file
system called mini key value
uh it's open source it's on github it's
less than a thousand lines of code
uh it has an http interface you know
kind of like s3
and uh the one of the reasons it's it's
such a small amount of code is because
we use nginx for the volume servers to
serve up the files
so
so how so let's take a look at this this
is kind of a
picture of kind of like our
infrastructure in our garage
and uh let's see how for example you
write data into mini key value
so the first thing that happens is the
client trying to write a file
into the into mini key value makes a put
request
to the mini key value master the mini
key value master then
takes that and
depending on how many replicas you want
it then makes
that many copies across that many
machines
so each of these machines are called we
call them volume servers so there's the
master
handling the requests initially and then
there's volume servers that hold the
data
so these are our machines with you know
10 spinning disks each
and basically if you have three copies
of your data it's going to put
a copy on each of the uh on each of the
servers
so if you've got three copies then you
know you can lose like one or two entire
machines and you haven't actually
lost any data um
so that's what we use for our raw
driving data
uh we use three copies and so that's how
you put data into many key value
uh the the volume servers again are
nginx so basically
it's just using you know http requests
passed through to nginx to write out
these copies of the data
so now how do we read data back out a
mini key value
say you want to say you want to pull a
file and you want to like run through
the video or something like that
so the first thing that happens is the
client again makes a get request
it hits the master
the master then looks at the it looks at
the list of it maintains an index of the
list of volume servers
that have the data that it that you're
trying to request it then picks one
randomly
and it returns a 302 redirect to you
so then what does the client do it just
follows that redirect
which you know hits an nginx server
directly that is hosting the files
and just returns it and so uh
our master is really simple like our
master is just a leveldb
index of all the files on all the
servers the files on the servers
are actual like physical files and they
have a name
that is the hashed key or the base64
encoded key
so like if our master ever disappeared
for like if our master ever failed for
some reason and we lost
our we lost our index we can actually
regenerate the
data that was in the master very easily
just by spinning through all the files
unbased 64 encoding them and
repopulating that
that master index
all right so now that
we have a high a high performance
distributed file system
let's let's run some tasks that are
going to
generate our ground truth uh
for training models so
the way that this works is um a
workstation
uh we have some software libraries
custom built that we have that
we use for submitting jobs to our to all
of our servers
and uh basically it
builds up a list of tasks uh each task
can run independently in parallel of all
the others
and it kind of manages it manages
dependencies and gets results and so
forth and submits them as
as uh as they can be submitted
um so
then all of these um these three racks
of compute nodes that we have they're
all
pulling tasks out of out of consumers
and they then
read data from our spinning drive mini
key value we have a mini key value
instance that's just spinning drives
they then you know to run tasks they
need to read data from
you know like let's say the raw driving
data that we have
and then they write the results back out
to the mini key value instance
that is uh solid state drives so
that way like our model trainers have
like really high iop really high
bandwidth
file system that they can pull the data
from for training
so let's see here and go back one
there we go so our spinning drive right
here
it's 40 machines it has 400 spinning
drives
spread across 40 servers and so that's
our two petabytes of storage that we
have
which is about 10 million minutes of
driving data
uh and then our our mini key value solid
state drive
or mini key value that's you know all
solid state drives
is 20 machines and that's our 516
terabytes of ssd
all right so now we've got our ground
truth generated
um let's train a model so how does that
work
so we have 10 servers here that are
model trainers
we can run a lot we have 10 of them so
we can run a lot of experiments in
parallel
each of these model trainers has a 100
gigabit
ethernet network connection
to one of those 100 gigabit switches
and then uh one of our racks has another
400 gigabit
per server hooked into an infiniband
switch so we can do things like
rdma and do like parallel
training and so forth
let's see i went too far
okay so when we kick off uh model
training
uh it's it's something that's running on
one of the gpu servers
this is our mini key value ssd instance
and you know it pulls data from pulls
data from there each of those machines
has
20 gigabit of network connectivity so
it's really high bandwidth
and then each epoch
it generates some metadata
and it writes it out to what we call our
our reporter server
which i'll talk about in a minute so
you repeat this you repeat this about a
thousand times
and then we've trained a model
so this is our reporter server this is
what it looks like
[Music]
one of the screens in our reported
server it's kind of like
it's kind of like tensorboard um
it has a lot of charts and images uh
it's pretty simple
something we custom built just to hold
all of our experiments
we looked around kind of at like the
other options that were open source and
available and free and
they didn't really have all the features
we wanted
[Music]
so that's why we ended up building
something custom
and it really wasn't like this wasn't a
big project at all
um another another screenshot from our
model reporter this is
[Music]
this is a example of like where you can
pull up worst losses
for an epoch
and so that's pretty much all the
infrastructure that we have that we use
for
uh training our models um
so our user base grows like 50
every six months at least on average um
we we need to scale up a lot of our
infrastructure as we you know
doesn't take us too long to grow another
10x at that rate
so we've got a lot of work to do you
know there's always ongoing work to
really scale things up
we want to build a 10x larger data
center
so we've got all kinds of exciting
things we would love to do
to uh you know uh
train on maybe 10 million segments
of driving data and running the ground
truth for that
takes a long time would take a long time
on our on our current setup
so um let's see
so yeah if you uh i don't know do you
think this stuff is exciting to you
you think uh uh you think that's cool
stuff
uh we're hiring and so uh it looks like
i'm
pretty much out of time here but
yeah i'll be around and find me if you
have any questions
oh hang on if we have
i thought i was going to be really cool
and i didn't get any questions like like
does steve jobs take questions after he
like
talks i don't think he does does he
uh okay hi i'm in the back on the first
floor
hello i i can't see anyone
what's up oh hey all right thank you for
the mini key value presentation was very
interesting
um i i okay maybe i
maybe there's not a good answer for this
but like how did that not exist
like there must be like other companies
trying to build their own training
pipelines in their own data centers
yeah i mean it's it's pretty it's pretty
the functionality is pretty limited
right like
a lot of people want you know like super
high availability
and uh uh you know more
a lot a lot you know kind of better
assurances than what we have
we've got mini key value has this kind
of bottleneck for writing data which is
the master
we've got a i've got ideas how we can
improve that like
we've got some pretty specific how do i
say this
we don't need a lot of these crazy
features that these other distributed
file systems have
so like for example our data our mini
key value instance that has
three copies of the data uh this master
is a bottleneck
all the writing goes through the master
right now it manages getting three
copies out to three the volume servers
so like that that can obviously be a
bottleneck right so other distributed
file systems are like oh well
that's that's never gonna work right but
for us it actually does
because the amount of data we take in
like we take
we we don't if we could generate like we
have a thousand users if we could
generate 10 times as much data today
would that actually be good data for us
the answer is no
unless we have 10x more users too like
we need diversity
in our data so our data comes in
slowly and we don't need a ton of
bandwidth
to this mini key value instance that has
a bunch of redundancy but on the other
hand
we do need really high write performance
for our mini key value solid state
instance
right because that's where our our
reporters read data
and write well we need to be able to
like massively write out our gra
our ground truth from all of our from
all of our consumers
and so uh there's a solution to this
because there's a good solution to this
because
we don't need multiple copies of that
data we only need one copy
because if we ever lose a drive that's
like a small portion of our data number
one
like we don't really care but number two
if we did care we can just rerun the
ground truth and regenerate it if we
have a disk fail
like who cares we'll replace it we'll
rerun ground you know the ground truth
for that
so what we can do is we can actually use
redirects to write data
uh if all the master is doing is doing
redirects like it's
it's you know we don't have any
performance problems um
so when you only have one copy of your
data like our mini key value ssd
instance
your writing can be redirects too you
don't have to funnel all your data
through
through the master we could also do like
crazy stuff like have the client write
out multiple copies but like
again like you know when when it's uh
when you're really focused
when you understand your own problem
while you're really focused you can you
know come up sometimes with really
simple solutions to those things
thank you that gives me a lot of insight
yeah no problem
you mentioned the humidity is a problem
in san diego it's about 60 percent
on average in in would it be beneficial
to move
the compute cluster to somewhere like 29
palms where the humidity is half
uh i don't know like why do i care if i
run my servers at 43c
do servers have i don't know is anyone
like advocate advocating for server
rights
like they do they get like is there is
it what is it like uh
child uh whatever you know like children
can't work in like hot conditions
we're gonna have that for servers
someday too yeah
i don't know yeah i mean it would we
wouldn't have had this problem that
would be nice but
uh it's kind of like you know it doesn't
really matter
um what's been your largest challenge in
terms of
growth and scalability of this hybrid
cloud environment
and then also a second question is why
did you decide
azure when there's more mature cloud
environments out there like aws
oh okay uh yeah okay i got answers for
those things
so the biggest challenge i think in
scaling any of this stuff is like
finding simple ways to do it
that doesn't require us to hire like a
team of people to manage it
right like like why do we care that mini
key value
is under a thousand lines of code we
care because like
george wrote it i can sit down and look
at it and like fix bugs in you know
sometimes a matter of minutes
and and and you know i can i can i can
read the whole code base in like an hour
right and understand everything that's
going on
and so um you know finding good
solutions to these problems
is is uh you know less code is always
better and
i think a good example is we used to
spend
a lot of money processing transcoding
video processing video files as they
were uploaded to us
and you know we were doing this and
i'm always trying to figure out how do
we lower our cloud spending and i'm like
well
this is obvious like it should happen on
the device
why are we transcoding in the cloud so
you know that's what we did
we didn't like build some crazy stuff to
like do caching and be smart about
oh someone requested the first video of
this file let's start transcoding it and
then the second and the third and the
fourth one minute segment you know
you could go really complicated and
build something that probably works
really well but you know finding a
simple
you know that's that's like writing a
lot more software and and you know
scaling that thing sounds like a
nightmare and you know it's still
probably kind of crappy
so you know it's that you know that's
the real that's the real challenge i
think you know
finding a way to do it really cost
effective second
question you asked so why are we in
azure so we
uh we weren't always in azure i don't
think i've ever
really told anyone this story so before
i started akama
everything was in aws and why were we in
aws
well the reason we were in aws was
because uh if you run a startup
these cloud providers they'll give you
they'll give you so much
money yeah and why do they give you all
that money
well they give you all that money
because you know
if you if you build this really
expensive system
with all that those free credits that
they give you well you got to keep
paying for it when the credits run out
uh you know even if they give you
hundreds of thousands of dollars
it comes with an expiration also so if
you don't spend it really fast
it's like they incentivize you to spend
the money really fast
because it expires and then once it
expires
well how much is your cloud bill every
month now and you got to start paying
that
so we got i don't even know how much
money we got from aws
that money ran out so we shopped around
we said who else will give us free money
so number two was azure and i want to
say
they gave us 360 000
of credits that was also
a little bit before i started and after
i started
um after i started um
i needed to transfer this subscription
to my email address
i'm like this would just be so much
easier so i'm going to do it well it
turns out
azure is ridiculous you have to like
they can't transfer a subscription
they have to cancel your sponsorship
with all these credits
and then they have to set up a new
sponsorship with the new email address
so guess what happened when they set up
the new sponsorship after we spent most
of our money
we started back over at 360 thousand
dollars
i didn't complain actually there's a
little more to the story than that
actually what happened was
they so they train they did it and we
didn't have enough money i'm like what
the heck you guys are screwing us over
they're like oh no
oh no we'll fix that yeah they fixed it
so anyway that's why we're in azure so
we we didn't
we like like now we're you know we're
trying to we're trying to run our
infrastructure in a way that's you know
maintainable and so you know we just
now we're just decreasing our costs
[Laughter]
hi um uh awesome presentation uh really
love your passion about the subject
question um what about like backup
and what what is like your dr plan
do you have one uh for what right like
for
for the data that we use for training
uh there is no the the disaster recovery
is bottlenecked by how fast we were like
worst case
it's bottlenecked by how fast can we
collect new data from our users
right so uh we back up some data
like like our reporter server we send it
you know to like cold storage or
whatever inexpensive storage and azure
you know we run on-prem the reporter
just like the the trainers and
everything
uh in the cloud you know it's just kind
of the same thing we
uh one of the first things i worked on
was
you know really making everything
infrastructure is code deploying things
in an automated way uh so you know a lot
of our disaster recovery from like an
infrastructure perspective not from a
data perspective
is uh you just redeploy yes redeploy
things
and you know i'm huge on putting
everything in scale sets
you know so like your recovery is built
in right like every time you scale up
you're practicing your recovery which is
great
thank you yeah so you mentioned
um the like spot instances and stuff and
kind of balancing between
instances of different sizes can you
talk a bit about
how like generally particular workloads
fit within particular instance sizes i
don't really know
what your compute needs are but how how
do you balance that out if you have like
uh uh certain memory compute sort of
ratios that you're trying to maintain
yeah so uh one of my goals at one point
when i was one of my first goals at
comma was to
get our processing time like the latency
from when we receive a file from a user
to when it's available in like explore
connect cabana
to be under 10 minutes on average for
like 99.9
of our data or something like that over
the over the like over the course of a
month
so i worked really hard on that and i'm
happy to say that our data
now uh is processed like on average
under 10 seconds after we receive it um
and um so
we used to do like heavier stuff like um
like processing video files and so forth
so you know a lot of the solution to
this was
was eliminating that stuff pushing it
you know pushing someone back to the
device
uh using the q logs for every like
really pushing people hard to use our q
logs for
you know our processing needs um for
customer facing stuff
uh you know like figuring out what data
we can train on
i always you know tell people it has to
be based on the q logs because
you know we don't want to pull the the
raw log files to
to figure that stuff out um so
we need the long they're the short of
this long story is basically
we need very small vms we we spin up the
smallest possible vms
which helps right because uh
when when when we're out bid
and we lose instances we lose these spot
instances
the more cores we're using the more
likely it is that someone
is going to steal our vm like say you
know say we use
four core machines versus two core
machines well if someone needs a two
core machine there's only four cores
well then we're gonna lose the four core
machine but if we're doing two two core
machines
and someone needs two cores you know we
only lose one of them so
we use we use like the smallest we i i
pick the
i picked the least expensive um you know
the least expensive skus
uh and um always do like the
uh azure has this great thing where you
can run the operating system
out of the super fast cache so then the
vms come up like super
they you know they we scale up and down
really fast um
so yeah we just use we use the tiny
instances and
um yeah that's all we need because we we
really
squeeze down the processing as much as
possible uh obviously there's very
little processing happening
if every file we process is done in 10
seconds
got any more questions
nice hat
uh quick question about infrastructure
as code do you guys use like a
terraform or ansible or what does that
tech stack look like
yeah we use terraform uh like in my
previous job
things were also in azure and we used to
use the like the arm templates i think
those are great too but
i mean if it's if it's not broke you
don't you don't change it right we just
always use terraform and it works great
yeah we so we use terraform and then i
guess you were asking like ansible
so we use terraform and then i like
really try to use
uh cloud in it to bring up the vms
basically i try to keep those vms as
simple as possible
so most of our vms that run in the cloud
it's a cloud it's uh it uses cloud in it
to
install the azure cli so that it can do
like
integrated authentication to do things
like pull keys for storage accounts
that have been given like role-based
access so we need the azure cli so that
the vms have access to things and then
and then docker
so everything that we run runs in a
docker container so we just need to
basically
uh install docker and the azure cli
hey um so i guess i sort of wonder
in the long run um how much data do you
guys
keep like i guess it sounded like you
weren't particularly concerned
if there was a case where you have like
some video or other piece of data you
want to train on and it gets lost
because i guess one you can
get it back but like did you guys store
all the video you've ever collected from
customers or do you clean it up as time
goes along and you like upgrade the
cameras and becomes less useful etc
uh we we don't store all the data that's
ever been uploaded to us
we retain the um
we retain retain the raw data that we
get for only 14 days
because like the data i mean again like
keeping our cloud bill low like i
mentioned at the beginning the storage
is so expensive
like that's how they get you and you
really can't separate things from the
storage very well like who has
crazy high bandwidth for free to you
know cloud providers and then they
charge you if you want to pull data out
of the cloud outrageous rates like eight
cents per gigabyte
so uh you know if they if they get you
hooked into that storage
they really got you hooked uh and so
uh yeah so we we just keep the data for
14 days uh because otherwise
we'd be you know even now even keeping
the data for only 14 days
our storage is by far our biggest cloud
expense
and then the lower quality stuff we keep
for at least a year so like if you have
prime you can
you can watch your uh low quality video
uh in like connect
should be able to back a whole year
great thank you so much greg yeah no
problem
all right how many of you with the show
of hands
use open pilot all right now
how many of you have driver monitoring
upload on
all right pretty good well i'm hoping
after this talk that'll be everybody
um please welcome wishing to the stage
he's our research engineer who's
the genius mind driver monitoring
[Music]
it's
[Music]
hello hello right
okay so uh this one's been the eleven in
the room forever
most people love it some people hate it
but let's talk about it and
it's the driver monitoring in one pallet
i'll just call it dm for the rest of the
talk
so here here are the topics i would like
to cover today
to hopefully demystify commerce camera
based dm
approach let's start
let's start with the basics so what's
the goal of dm
what are we trying to achieve a bit as
we all know
comma is uh proud about shipping a very
good like
level 2 system and as the system is
getting better and better
we need to remind people that they
always need to pay attention in a in a
level two system
uh to your uh to your driving
surroundings
therefore the direct goal of the vm is
to keep the driver engaged
and
this one oh it's this
thanks using the wrong one
right and obviously by using the camera
only driving now becomes more true
because the driver now doesn't doesn't
need to
touch the wheel every now and then when
the system is engaged
when we say keeping a driver engaged it
means to
make sure the driver is always paying
attention to the role
that they should be always to be ready
to take over
some examples of not being not paying
attention
includes on you're being on your phone
falling asleep or sim or
even like simply by just looking at the
car nestling for like too long
now that we have the problem in mind
let's fast forward and take a
quick peek at what uh comma dm has
achieved so far by looking at some
uh numbers got here uh the first one is
a
comparison part between having dm and
odm
showing the cumulative uh the plot shows
the
accumulated distributions between uh
of destruction durations between
the current dm current data and the data
we had before we ship
um open opel dm the green line is from
recent free data
and the orange line is from running the
same model and the data we had before
dm was shipped both lines show when
both lines show data when the own
palette is engaged only
if we zoom into that that section there
in recent data 99.7 percent of the
distracted events are less than five
seconds
while in the old data this number is
97.1 plus 2.4
which means dm has managed to reduce
distractions more
uh distractions more than five seconds
by 90
which is substantial here's another
interesting step
so at runtime dm is only like active
when open pilot is engaged but how about
when it's not engaged
by assuming dm is always alive we can we
ran the policy and the model of line on
all the logs
to compare the amount of dm alerts each
user we have gotten
per minute both engaged and not engaged
as shown here
so the results show that when own pilot
is engaged drivers get sixty percent
less alerts on average
on average when compared to when they
are driving themselves
thus we can say that when engaged with
open pilot
people pay 60 60 percent more
attention in the sense that dm helps
them
helps to remind people that they need to
be paying attention
it's not the fact that that it beeps in
the fact is the fact that you know
it would beep at you if you don't pay
enough attention in a way it's similar
to like speed limits
say it's not about like the pres it's
not about the consequences
it's mostly about the presence
which brings us to this graph to sum
things up dm basically achieves two
things
one is that it reminds people when
they're getting distracted without
actually knowing
being distracted the other one more
importantly is that it keeps people from
involving in distracted behaviors in the
first place
so how does so how does everything work
we start by looking at uh what happens
in open pilot
from sleeps to beeps
so we have the driver the driver facing
camera that takes the picture of the
driver
say here with this beautiful comma-free
uh camera
and then the picture is fed into a
neural network to estimate some
parameters of the driver
we call these parameters driver stage
which
includes things like whether there's a
face where's the face
where where are the eyes are the eyes
closed where the face is
looking at stuff like that
then we have a classical uh state
machine that takes in
the driver's state all these parameters
of the driver
and process them in loop as new pictures
comes in
come in it also takes into account
things like the speed of the car um and
also the
how the camera is mounted or even like
how complex is the scene
to adjust all the things then the system
will use all these
information to determine whether the
driver is being too distracted
and if they do an alert will be shown
you get the beeps
um of course the being the brain of all
these is the
neural network model we use to extract
information from the picture
now let's zoom do me more and look at
the model itself
uh in like the more technical terms the
model is
efficient at v0 vision network which
which is 8-bit quantize to run on the
dsp instead of the gpu
such that the dm model doesn't compete
with source
compete for resource with the driving
model such that they can vote
they can both have room for growth say
we want to shrink big model
in the future for both of them we can do
that
and the two main outputs will be the
driver's head post and ice stage
which are the two cornerstones of open
power dm uh well
it may not seem much but as we shall
show here we
are we shall be showing uh these two
aspects are actually
proven to be quite versatile when it
comes to determining driver attention
here are a few examples of dm model in
action when i was driving
we can see that by just looking at uh
only the head and the eye
you can actually catch things from
simply looking away
or playing with your phone when driving
or
the the even more subtle like falling
asleep somehow
and of course the model works both day
and night
well you might not wonder how the measly
8-bit model
can do all these tricks as george always
said the most important aspect of
machine learning is of course the data
so so the next talking point will be our
data
the latest dm model is trained with more
than 23 000 hours of
driver videos uploaded from
over 1600 unique users
unique users from our feed fleet which
is
which makes up roughly 20 25
of the total user space
uh thanks to them open pilot dm can be
as good as today
uh we would love to see this number this
number grow
and in the coming slides i'm going to
show what we go what we are doing with
the data
and why more people should upload
well some people might be worried that
their faces will be looked at when we
label the data
and thus have concerns about privacy and
stuff like that and yes we do late
we we do have our diligent data labelers
but they are
machines so these beautiful computing
clusters that crack build are also our
dm labelers
here i have three pictures for them
because we have three racks
so how are the ground shoes generated
so we have been building this dm data
annotation pipeline for
almost two years now which can do the
following task
in a fully automated manner so so that
no human
no human would need to look at the data
any of them
here are some of the examples of our
auto ground shooting
stack in action where you can see faces
being
detected and the pose being accurately
estimated and also
as well as the eyes and where whether
they're closed
so what's actually doing all these
things are what we call the t-shirt
models that we train separately
uh to work specifically on our data set
uh using a technique called transfer
learning which means the knowledge of
these models are obtained from somewhere
else
in this case is the open source data
sets
so you have these open source data sets
of course you can
not easily just change some models on
them but it won't work
because they not like nothing from our
data which brings us to the idea of a
domain
adaptation it means that we need to open
these open source data sets to make them
look somewhat similar to
what's in our data set then we can start
training models on them
speaking of domain domain adaptation the
idea can be also
be applied to say when we want to train
we train the
model that used to work on eons to work
on comma tools
we can just make the we can just start
by making the eon pictures
pink kind of pinkish to mimic the ir ir
lighting in the comma tube
and it's also the same trick when we
want to transfer the say the comma two
models knowledge
into uh the comma three
oh sorry into the comma three capable
model
that's how we shipped a really good uh
comma two
that's how we ship the diff
that's how we make the common free dm
model
good at launch without actually using a
lot of common free data
so after all that labeling and training
now we move on to testing
which is the most integral part for us
to move forward and
avoid aggression regressions
so to test you need a metric what is a
good metric
for good dm experience is it model
accuracy
does a high motor accuracy equal to a
good experience
well not necessarily well that's not
true for dm at all actually
usually like 99 would be fine but
but now you're assuming the one percent
back experience is evenly disputed
among all users then in this case all
users are enjoying
99 of the experience but in dm
usually 99 means one percent of the
users are
constantly suffering and having constant
constant force positive or something
like that where the am doesn't work for
them at all
so how do we catch them so to catch only
any of such
bad bad experiences
we crunch numbers on every device in the
training set and validation set
for example here we try to see uh how
often
each device will get alerts with some
candidate model we want to ship
each dot here represents a bit device we
can see some device get a lot of dmo
consistently and it's a and it's
important that we understand all these
positives
for example if this happens on me where
the model constantly thinks i'm
distracted why i'm not
we need to find out why it could be
because the model doesn't work well
enough when
wearing glasses or is it because the
policy is too strict because i
squint too much into the sun or
something like that these are the
questions that inspire us to write more
detailed tests and fix the problems they
exposed
on the right uh is another example of
testing by worst cases
according to this distribution curve
some devices are constantly failing to
detect bases
why is it due to the model not working
in certain lighting
conditions or maybe it's just the lenses
covered
we need we need to figure them out
so by visualizing all these worst cases
we can easily identify
what some of the problems are and what
can be fixed either by software or
hardware
say for example uh in the red ones
they're clearly covered and they're
hopeless and then
in the black in the black images it's
probably because the iids are broken and
that's a horror issue
so the takeaway is we can learn and
improve things a lot by just looking at
the worst cases
all right on top of everything i've
talked about so far
i would like to also ask some comments
about thinking dm as a machine learning
problem in general so we currently have
data
uploads from about 1600 users
and below is the amount of people who
don't who
from who we don't get the dm data from
which is 75
75 of all users
which means for us as a company we are
stuck with this small subset of date
of data to build a system which is
expected to work on the ma
on a much larger user base than the
training set size
well now all this looks like a disaster
for overfitting
especially when we have shown that even
99 isn't good enough
in other words the model is only
guaranteed to perform well on the people
who's in the training set what's the
solution then
well how about more people consider
uploading their driver camera maybe
wow it's just an inform recommendation
absolutely nothing more than that
right seriously though turn on turn it
on
to help yourself and help others now
let's move on to um what's next
apparently the next uh big thing would
be end-to-end dm
where we will move the boundary between
perception and reasoning
like we did in the driving model the dm
model we have only
one output called iso and row unlike
like in the classical model where we
output like
many parameters of the driver and did a
lot of
complex map and then and figure out
whether it's distracted or something
and actually we are now actively working
on getting automatic wank through
working on this
end-to-end pipeline
pretty exciting stuff
also to give the model more context we
are also considering
making it temporal or turning back
models on the common freeze 180 model
to make it see more so yeah there are so
many
potential big improvement we can make to
stay ahead of the dm game
very exciting stuff that's it for me
today
thanks for listening
all right how many of you are going to
turn your driver monitoring
toggle on
all right here we go jason
thanks this is a lot of good info can
you talk a little bit more
you said there were times when the dm
model would kind of
relax versus tighten up its requirements
for
paying attention is that more than just
stopped versus not stopped right now
so in the driving model
in the driving model it outputs uh the
probability of
you like being engaged and also the
probability of you like disengage in
so many seconds in the future so we use
all the information to
like like adaptively set the threshold
based on the scene complexity that the
model thinks
like when it will fail so that such that
the dm model can be
more relaxed when say it's driving on a
straight highway
compared to it's like stuck in traffic
okay so
every once in a while i see someone
question you know i tried closing my
eyes and the dm model didn't do anything
or i tried doing this or that or i
looked away and it didn't detect
anything
and a good explanation for that might be
that
it's relaxed a little bit because this
is a a simple scene with a low
probability
according to the model of the driver
having to grab control
yeah would that be fair okay thank you
doesn't mean you can ever not pay
attention though
that's right
um my question is more about
future possibilities with the comma
three in the
180 degree field of view obviously there
was some questions about
uh a sentry mode and comma security and
all these things
do you think uh implementing some of
those features
into the official release of open pilot
may encourage with like
a prerequisite of needing to upload your
driver monitoring to record these events
could help encourage more people to use
that feature and upload
because they're getting more benefit
from it when right now they may just
feel that it's only a
benefit for comma at a cost of their
privacy
where you could give them security at a
cost of their privacy and they may
consider it
yeah so we are considering that um so
actually we are actually also
considering using the
common freeze 180 like driver camera to
like to extract some of the like
information for driving
which is like the offering like we can
do
uh like you mentioned uh so what we can
do is like
if we can somehow make the users upload
with that and if they if they don't like
it they can like choose to blur out
their faces
then that would be great
quick question for you are you always
limited to using the dsp
will the open pilot team ever give you
more compute if you ask for it
and is there any difference between the
um c2s
qualcomm i think it's an 820 or 825 dsp
versus the c3 is 845.
uh the c3s is way better but we are only
using
say 10 maybe 12
potential on the c2 so there's a lot of
room for growth
got anything in the crowd alright we got
someone upstairs
uh you you mentioned transfer learning
from training on some
general object detection data sets with
some kind of
augmentation are you doing like uh
self-supervised pre-training or
could you explain that a bit more well
you can do augmentations like
um color like mimicking
or you can do like something like
fourier domain adaptation to mimic like
the sharpness
on like a finer level of the image to
make them more
look like uh look more like the ones on
our data set
does that answer a question and you
aren't directly training the uh
efficient net you you're training a
teacher policy
yeah we first generate the ground
through using the ground shoes using the
t-shirt networks on our data and then we
use
our data and those labels to train the
efficient net
to make the model perform
have you ever considered using a
monochrome ir camera it looks like there
is some
color data maybe limited use on
what we saw on the demos um
we are not having problems with using
like rgb ir cameras so i
don't think that's a limiting factor for
us so far
so given that this is an opt-in are you
currently tracking the users who show
um a high uh what's it called the the
distribution
distraction level on a consistent basis
and
would you ever seek action to ban those
users is that a consequence
no oh
you want to put up with the b i mean you
know
from the man himself
you heard it that's right
hey so kind of a broad question so it's
totally understandable why you need to
like work on dm
and and have some way to like be able to
alert the driver and even help them and
perhaps even hold them accountable and
maybe that's taking it too far but
but at the same time you also say stuff
like and i realize it's maybe half
joking like we're l2 we take no
accountability
so i guess what you see is the purpose
of dm to the extent that what i'm saying
of the company not taking any
maybe i meant to say liability instead
of accountability um not taking
liability like
what's the purpose in light of that
um it's not
it's not like a liability level it's
more like
you want the you want to remind the
driver that
the limitation of the system and what
their
expectation of the system should be but
and by using dm
we are ensuring that concept is always
present does that answer the question
i think so thank you
um since in the future you guys are
going to be using the front facing
camera for
the driving portion of the of the
of the comma of open a pilot are you
going to be doing
two passes basically um process the
frame of
video for driver monitoring and then um
reprocess the frame again for the
driving or is it gonna be all mended
into just one process
we'll see so now we have the super combo
maybe there's a super super combo in the
future
using all three cameras
uh hello have you considered
incentivizing users to upload their
their video as a as an investment in
improving the overall
effectiveness for everybody
yes i mean if you upload it
works better on you so i mean that's the
direct incentive common points obviously
are very valuable
the more you have the more important you
are
all right that looks like it any other
questions
not so much a question i find it a
little bit sometimes
not working very well when the visor is
down maybe it's a
um you can check the visibility using
the preview function in the settings
you're worried about like visibility
when you're using a visor
great we
alright live stream you guys are going
on pause
we're going to set the stage up for a
few minutes
you know a really fun part about working
at kama is
the lunch time and dinner conversation
um
i think you know really get to spend
time with the team
and i wanted to recreate that vibe on
the stage
so we're just gonna have a conversation
with the whole team
anyone wherever everyone
guys come on down see you're over here
if you want to grab a chair
and thank you so much wishing
we got the live stream going again great
yeah who's this um strictest code
reviewer
uh out of all of you
actually you know what that's a great
question why don't we go around and
anyone who didn't speak maybe wants to
introduce themselves
this is uh wishing we know we got nick
yeah uh
nick i've been at the company three
years okay what do you do nick
uh that's it there's a crush take your
time
um i am the head of hardware but
probably the last
six months i've been purchasing uh
components for comma three so sourcing
uh hard to find components at good
prices
part hunter how did you find out about
comma
originally one of my friends from
college initially shared the
bloomberg article with george from the
original ilx
and kind of just started following comma
from there after graduating college
moved back home
bought a civic put a neo in it and then
just
kind of just got involved from there and
now i'm here
so and i think you originally came on as
a you're doing
customer uh i think at that point i was
like hardware operations so taking
uh responsibilities from uh eddie
doing like neo or eon production and
then moving
um like production and
fulfillment and day-to-day operation
stuff so and some people might know you
as vanilla gorilla online in the flesh
hi um my name is shane and um i've been
an intern here for the past
three months or so yesterday was my last
day so
thank you very much very exciting
[Applause]
you know vivek came in last night he
told me came into your office and he
said today's your last day shane and you
said i'm so excited
i didn't know what to say i'm excited
for comic-con that's what i meant
oh okay all right all right yeah i
worked in uh
open pilot team under the strictest code
reviewer adeem
but i learned a lot so it was really
cool and also you run one of
our most popular forks yes i used to
and then i stopped updating it because i
was so busy
but it's coming soon amazing
you want to pass the mic on hi my name
is yasin
i've been an intern at the research team
for about two months now
and uh yeah been working on research
training models i never asked you how
you heard about comma
um i kind of always knew not always knew
about comma but
it was out in the back of my head then i
was browsing github and then i found
comma 10k data set
i thought it was cool i looked at it and
the quality is amazing quality
so i just started training a model on it
and
i realized it was cool and yeah that's
how i
got in touch the model was more accurate
than the one we used internally
this is how you get an internship at
comma
yeah it's been an amazing time learned a
lot of things
yeah so really glad you're really glad
you found us yeah
hey i'm vivek i joined as a full-time
employee
two months ago i work in research
uh i interned at comma last year last
summer
for around three months and then i
finished my master's and then i joined
full-time
yeah yeah
i found out about uh comma through
the hackathon i think i was just
browsing twitter one day and then i saw
a tweet that somebody i was following
had retweeted saying
hey karma has a hackathon and i do a lot
of hackathons so
i you know i applied and then i came
down and then i was
super excited to meet everyone it was a
fun experience and then i came as an
intern
so happy to have you thanks yay
okay harold you can talk about yourself
i guess i'm next
okay yeah we should probably do everyone
huh just you know in case someone just
watches this segment they haven't been
with us
all day all right so i'm harold and i've
been working a car
a little over four years now um
i heard about it through a friend that
was just telling me about self-driving
stuff and i started watching videos of
george and comma and just thought it was
a very
straight-up no bullshit approach to the
problem which i really liked and then i
sent an email after i graduated and
started as an intern and i'm still there
hi my name is robert i'm on the hardware
team
so we developed the comma 3 over the
last
two years now i think some something
about that i joined in the summer of
straight out of university uh i was
really looking for a job in belgium
there was nothing like cool around
belgium so i decided to move to san
diego and stuff
so yeah that's my background great
i'm greg hogan i work on infrastructure
at comma
i heard about comma because i bought a
2017 honda crv
and i really wanted adaptive cruise
control and this car had it
and then when i realized it was crap i
was like
like is this it i wanted this for so
long
and now i have it and this thing's
horrible like the lane keeps this
especially
so i i think i was just searching the
internet and i came across
somebody opened a pull request to add
support to open pilot
i was like holy crap this is amazing uh
um so then uh i started kind of
following the company i thought it was
pretty cool
and then i noticed there's these
bounties um so my previous job was
software development and
i was like oh maybe you know maybe
maybe i should try to you know make some
money doing this
you know kind of stuff that i thought
was fun um so
i fixed up the j2534 driver so that
um you could use like the diagnostic
tools that come from oem manufacturers
with open pilot
or with the panda with the white panda
um
i did i did one of their bounty two and
i thought to myself you know well
maybe i want to work here but if i do a
good job they'll probably reach out
sure enough that happened but then
something weird happened george called
me for an interview
and his first sense was something like
so
i'm interviewing you for uh for a
firmware
position and i said oh hang on here
buddy
i don't think you want me working on
firmware but
i did see you had a cloud infrastructure
engineer position on the website
um and it just kind of went from there
so yeah
what's up guys virtually chris here
yeah you all probably remember me from
most open pilot videos until hubble
sphere really started taking off
i've loved comma for a long time i
started back in the neo
i think a lot of you will remember my
building a self-driving car series
i went to my school 3d printed some
parts and just made this really janky
neo
soldered for the first time ever on that
connector and it was not good
[Laughter]
but yeah i just had a civic you know
decided to
look up if i could get autopilot for it
found open pilot and and here i am
now i do communications and i'm head of
production so
yeah i've been making a lot of comma
twos over the last few months
we have you know we made over a thousand
at one point in stock
and yeah now now me and my team working
on making all the common threes so
you know we have a great hardware team
or sorry
not hardware production we have a great
production team
i just want to call out you know alan
aydah and juan they're
our full-time production staff they're
amazing
yeah we're making a lot of devices right
now
and we really hope you like them when
you get the comma threes so
yeah it's been a crazy journey but here
i am
my name is mitchell i've been at comma
for about nine months now on the
research team
i think i've known about comma for at
least you know two
three years back since like 2018 um and
it always seems like a really cool
company
but uh i thought like oh it's too cool
for me like i don't know how i'd even
apply
and then in early 2020 i left my job up
in sf
and around that time i saw one of
george's live streams
and he was saying like hey if you want
to apply to como to work on research you
should do the speed challenge
and that was that was our challenge back
then it's much easier than
what we have now um and so i i
worked on it for a while um and
uh i thought like yeah congo would be a
really cool place to work so i applied
uh i got in and uh i've been working on
a
training machine learning models for the
last last nine months
it's been great i really love it here
[Applause]
so i'm adeeb i work on open pilot uh i
might have reviewed one of your pr's
if you uh open a pr pilot definitely
yeah
and uh i was an intern twice and then my
total tenure.com is about uh
a year and a half
i also want to add that adev is a
machine he's also a full-time student
and full-time employee
thank you adeeb's parents for letting
him work here
uh there's two employees not on the
stage right now uh you saw willem
earlier in yoast they work in our europe
uh our our
rotterdam office uh so comma is a
multinational corporation
oh wait where's where is he
oh igor is back there igor come on
and actually oh he started after you
technically
wait but he's higher someone's got to
guard those comma threes
nice
[Laughter]
he's a soldier thank you igor
no no just talking to it okay so i knew
about
call my ai i would say from 2017
to 2018 but at that time i
just arrived to united states and i had
my first car
that is not supported so i was waiting
and waiting then forgot about it and
i would say in november 2020 i decided
that
i need to buy a device with open pilot
at the time i had a mustang so i decided
to sell my mustang and
bought corolla
right now i'm full time employee
for a month but before that i was as
in turn for two and a half months and i
was working yeah i was working on a
red panda so that's my project
great
igor was also a member of uh epoch uh
which you guys heard about earlier
uh so yeah like i said william yost uh
we would have
loved to have them here but
unfortunately uh the people at the
border felt differently
um and you can't hide by holding a
microphone
i like to hide um nice
uh let's see i think i met george in
i was hosting an event at nips
uh which i don't know if you know is now
called nurips uh that's because of me
uh and shout out to rivetes the event
was called tits
it's true uh and
yeah because you cancelled you can't
have it did it did
uh you can't have nips without tits i
think um
um anyway i uh georgia speaking at the
event
um at the time he was giving a talk
about crypto kitties
um how to chill your bags that's right
that's right
and uh we were running some errands for
the event
and i was like what is this thing in
your car and he's like oh this is a
self-driving car
and uh if you remember willem's talk he
had that graphic of the the green boxes
and the red boxes and i think the first
question i asked is
is it going to stop at this stoplight um
you're like maybe one day
um and i was you know
enamored with the project since then and
in 2019 i came
down uh george and i uh
went to china to try to find more phones
and on the trip i was talking about some
ideas and different different thoughts
for
for the comma 2 launch and george why
don't you come down and
help get the company prepared for the
launch so i worked on that for about six
months we launched at
uh ces 2020
uh hopefully we'll be back again in 2021
um if things are allowed in person again
the comma 3 was supposed to launch at
ces this year but we never would have
had it finished
well it came on in june first george
called me he's like we come down i think
you know
it's ready we're already launched the
comment three one one year and one month
later
um i thought he's like you know i don't
really know a lot about
he's like it should be ready like by
december
i was like i had we had one work
sometimes
okay he's like you know in some parts of
six months lead times just like make
sure you order those like
i'll be gone for a month like you'll
figure it out uh
so and here we are today on the stage um
what's that everyone
um and that's how i got here
we oh asian got skipped
all right uh so i went to school in
michigan it was cold
i just wanted a job in california and
then i find
and then i find comma on this startup
website which is pretty cool and
that's it
oh well first off we do all have hot
bikes so everybody tapping the mics
i hear a lot of tapping uh my name is
george
i was working for this company this ai
startup in the east bay
my friend approached me and he's like uh
yo elon needs someone to build vision
for autopilot
i was interested uh i met with elon
we almost had a deal there was a
i miscommunication know i don't like to
lose you know
so like i'm thinking all right how do
you how do you video on itself driving
cars but it turns out it's like it's not
beating elon it turns out
you're all on the same team it turns out
it's beating you know
honda uh so yeah five years later i'm
still here it kind of works the
software's
nice you know so nice never thought like
i mean it's not you know it's like like
i said i'm a cheerleader
um uh yeah
the the the software is nice uh let's
see
uh back when i started comment i was
doing like a smoking weed everyday phase
uh it's like yo i'm gonna start a
company yeah silicon valley shit
yeah and then like you know
you stop smoking you're like what did i
do you know it's like having a kid man
um but uh yeah
here we are and it's like it's been a
it's been a journey and uh
i think the journey is going to continue
and i think that when
lay back and let the winnings start
rolling nah just continue to work hard
forever but uh you know
it's the same thing
i thought maybe you guys could talk
about what your your favorite things
about comma are
harold
um putting me on the spot here
um ice cream free
ice cream yeah i do like the food a lot
the food's really great
but on a professional level i just
there's just not much
red tape or nonsense to deal with if you
want to try any approaches or you think
there's a better way of doing things
i think there's not really many
obstacles in the way and i think that
really promotes
doing good work and keeping people
excited
i care a lot about being right but not
at the expense of being wrong
yeah so
uh i guess i can go if everyone else is
going to be silent
one of the things i really like is so
i've worked for
small companies that got so small that
they closed the office
and i worked from home for a few years
then i worked for a big corporation
i grew up on a dairy farm in iowa so i
work really hard
people tell me and it's true it's true
anyway you know i i i really want
something from everything i put in
you know i have all this energy i put
into things and and i really want it to
be something
and um you know being a user of
of the actual company um
i i just saw the company i thought to
myself like this is my chance
uh you know i should try and and like
that's
i still feel that way today like that's
that's you know that's why i work here
because i think i mean
is there a chance we don't solve
self-driving cars i think it's possible
i mean i i'm kind of a pessimist
i think anything's possible but if
anyone is going to win
like if i have any chance i think this
is the company and that's why
that's why i work here i love it and you
know even if we don't it's
it's great so
um i'm gonna be less serious about that
um
so in common you can use company cards
you know
so i own several cars that
i would say impractical
they and they work 20 of the time so
having
access to company cars is a great perk
thanks you meet the requirement of
having reliable transportation now
because of the company right
a few months ago chris did a uh
recruiting video that goes that went on
the website and
had interviewed me on what i liked about
working at comma
and i'll just reiterate those points
because they're still true uh
one building something that's not been
built before
uh how do you build a comma three like
there's no instruction book
uh you know okay add some cameras to a
song and that sort of thing but
the design is uh you know fluid and we
can make our own decisions based on
on this thing the other thing too being
just being able to go directly to
the open pilot team to give feedback
on specific issues
you know i myself have a honda civic i
use our system
quite frequently and
you know if i see any little small item
i can easily just report it and
it's within reason uh looked at pretty
quickly
i used to work at a larger company and
this was not the case
you know issues with the app the company
was so large
okay you gotta put it in jira and like
who's gonna look at that
and like when are they gonna look at
that and do i ever know if they're
really looking at it because they're in
a different building
no i just you know walk down and uh i
think
that's probably the biggest thing why i
look uh like working at kama
and uh the food is also nice as well so
the common three sells well we're
getting a dinner show
i can speak about a few reasons why i uh
chose to work at
comma so i had to make a decision you
know sometime earlier this year
uh i think uh one reason
it's a big reason is that like you know
we build something real
like something tangible and that
means a lot to me and i can really hold
it and it's real and it's not
like like nobody's trying to scam you
right it's a real thing that you put on
your car and then you you
it like it drives and that really feels
like magic to me even now when i
you know it's like you're thinking about
something and then you drive it a lot of
times and then one day i'm like you know
paying attention to it i'm like oh my
god this is actually driving
and that that feels really cool and
that's super important to me
that's a big reason i also think karma
is like super aligned with
uh with the final users right like
i mean like we want to win and
like you will win when we will win and
we will win when you'll win it's like
the same thing
like there's no like there's no side
angle like we're not trying to steal
your data or
like uh you know like pull one over your
head
it's like it's a real thing that it's
like yeah it's it's real
and uh our incentives are extremely
aligned
which i mean you might think that's
common but it's not
as common as it should be right so
that's uh that's
very nice uh another reason uh
why i like working as the people i mean
i really like
so i was here last summer and i really
enjoyed just
hanging out with people and especially
while having lunch
like we were recently discussing which
are real sports and which are fake
sports
and this is like a real thing that we
you know discussed and debated for like
half an hour
no basketball is real
our current criteria is sports where the
world
the supreme athletes are fat uh it's not
a real sport
so that's like our current current
criteria it's subject to changes
uh yeah and finally uh yeah i mean
we have a lot of fun in office uh apart
from like you know having fun
doing what we do but also generally
having fun we play geo guests here in
the evenings
and we the winner gets one office
furniture so
that's that's also a good perk
these are the reasons why i like working
on comma
i just realized today i'm getting my
izzy's back
it's been months we bet them in
geoguesser we all bet our worst
like the thing we don't want to lose and
i lost along with like half of us and we
all couldn't drink the things we liked
it's back drinks are back
um so i don't know if you noticed but
you can see the windows up there are
open
and the temperature in here is perfect
so i come from texas
and so it's 100 degrees there right now
so the perfect weather is the reason
that i
came here
but more seriously this is my first
experience like in open source software
and like a professional setting so i
knew a little bit of git
and github before and i think not having
to relearn like a
proprietary set of like software
management systems and everything's just
out there
and you can request help from the
community if you need to
or yeah the community supports
been pretty cool about this whole thing
and yeah i just like how everybody here
knows each other and it just feels like
a big family and somebody at lunch i
think
one day said that's how your company
succeeds everybody knows each other and
it feels like a family
so those are the reasons
so i'm doing a phd in a computer science
and they always teach us that we have to
try things and then we
have to try to break things and discover
stuff um
be bold and you know
do experiments and try stuff but then
when you go
in a company you can't do that
because they just tell you hey you have
to write this piece of code
and you have the specs you can't go
outside and
it's kind of annoying and i loved that
comma
we are given the opportunity to try
stuff and it's really easy
the barrier to to experiments and the
time from
experiment to shipping the product is
really short
so that's what i love about comma and
and yeah i just want to keep
experimenting and keep
doing research
one of the cool things spending a lot of
time in tech is uh
i think everyone here wants to make the
thing work better
um and it's kind of clear what better
means and it's nice
right because when you come to a company
a lot of the times
the ground's kind of already paved but
there's no space
there's no space to expand there's no
how do you make facebook better you
don't know
i used to work facebook i show up there
it's like what can i do that would
possibly i don't even know what better
means in the context of facebook
so when i think about commas it's very
clear um you know and everybody who
works here can
see it get better and can work on the
things like at least
i think we all share a definition of
what better means that includes you guys
so something's pretty cool
let's just if you guys want to throw out
topics we'll just kind of talk about
them
auto-tune like t-pain uh
let's talk oh my
god who wants to talk about auto tuning
i mean i can briefly say some things
about it
um it's something that seems like it
might be necessary at some point
we really until recently had no idea how
cars were tuned
whether cars were performing well or not
the only way we'd know is like people
would be like oh my super 8 doesn't
drive well and then somebody else is
like oh i have a subaru too and it sucks
as well
and recently vivec's been working on
writing a lot of metrics that can really
tell us exactly which cards are
performing poorly and in which ways
we recently started doing some metrics
on longitudinal and turns out that most
hondas are horribly tuned for
longitudinal
and so this is the first step we're
going to try to understand which cars
are bad and in which ways
then we can think about the quickest way
to solve them and
perhaps that somehow leads to auto
tuning of some shape or form
i was tempted to post a vivec posted a
pdf on our internal slack
that said which cars worked well and
which cars didn't
no we actually wanted to post those i
think on github discussions i think it'd
be nice
all right yeah that's what we wrote that
sounds good i apologize in advance to
chevy volt owners
it's not you it's your car
i want a megawatt of power for our
servers
guys and i'm not even joking like i
would be so happy
if we found and it was like even if we
needed the office that we're at now
somehow
[Laughter]
in my office there's a
cork board and it has a list of
everything we can do
after we launch the comma three and the
number one thing is find the team a new
office
we want to find a long-term home
that has all of our power needs solved
we want a fancy kitchen
and a gym and a big
big parking lot i want to buy a lot more
we're going to get 20 cars
george asked that it looked like a
spaceship so it's going to look like a
spaceship
all right that's negligible power and
and cars our commercial realtor
bill is here tonight thank you for
coming um
that's how serious we are about this
office um we're very excited san diego
is great there's not a lot of traffic
here it's easy originally
our goal was to be near a highway uh san
diego is a large highway
um so that's worked out very well for us
uh
i don't know if people know the original
story of how we got down here but
comma used to be located in sf
and we were looking for a new office and
i think
uh you and ricardo you guys couldn't
find anything you really loved that
meant all of our requirements
a spaceship that's a hard thing to find
looked at some spaces in sf
and uh you know you like went outside
and it was like i was like
this is this much money oh i don't know
uh you know we got our cars broken into
twice we had our office broken into it's
insane up there
so the team at the time rank choice
voted and i think san diego was first i
think la was a close second
i wasn't there but this is what i've
heard um and staying in sf was uh
and that's because it was funny but no
yeah we never really hired anyone
no one here came from sf so we're like
all right it's time to move and that's
how we got down here
um really really enjoy it
yeah jason for a second
so my question is this um
for the driving task of open pilot
you've made a big deal and i understand
it about doing what a human would do
but everything about controls is hand
coded as classical
humans don't drive by doing a bunch of
math and predicting exactly what the car
does they can get in any car and just
drive it no matter what the steering
ratio is no matter if it's
slipping a tiny bit
is the way controls works now is that
going to work that way forever
and why does it need to work the way it
does now why do you have to have that
precision prediction of what the car
will do in order to drive it
so the alternative would be to use a
machine learning approach for controls
okay um if you controls is super human
with these mathematical optimizers
right unlike planning which it's unclear
what the good definition is
right because like from harold's
presentation where
what should your weights be on the
planner for controls you can actually
come up with a very good set of weights
and you can execute these in a
superhuman manner or maybe you saw i
think was marty the self-driving
delorean that was doing the
the perfect drifting figure eights um
controls is already superhuman
using classical techniques so in order
to achieve superhuman driving
performance we don't need
machine learning and also i don't think
it's as good i haven't seen
good machine learning control approaches
maybe
if you use rl but then there's a
question of what you're going to do rl
in
do you want to do rl in a simulator how
good is your simulator do you want to do
rl
on the road well we can't really do that
um so that's why we keep it the way it
is and yes i imagine it in the final
system
so it's done in classical code because
you you can really you can define the
problem really well so you can solve the
problem really well in code
exactly okay
hey thanks um can you guys speak a
little bit about
um the interface between the discord
community and all the team members like
i'm sure a lot of you aren't on the
discord
but you know it's just very cool to
interact with the company
as like a user and then talking to
someone you don't know who they are and
they're giving you
like super answers or they're ignoring
you
so it's an adventure
we're on the discord we have a special
color
you can talk to us just like we're pink
yes
fuchsia pink i don't know there we go
yeah the discord is probably you know
one of the coolest things about
comma in our community is that you know
you can report
feedback in the discord and someone on
the research team is going to look at it
you know same day if it's like a concern
right so
i mean you don't get that anywhere else
so you know thank you all for being a
part of the discord community
and uh yeah it's uh you know a great
place
to report problems and stuff wish
everyone in discord knew that we could
tell them
you know like how to make it before
yeah you know when you join the discord
look for questions before you ask
questions or look for answers before you
ask questions
uh a lot of the times you know we have
the answers on our website on the wiki
or as like eric likes to say where's
eric
i don't know check the pins is what eric
says
uh but yeah you know if you have a
reasonable
question someone's gonna be there to
answer it and if you have any
issues someone's gonna be there to help
you uh so that's really
really good because it's kind of all a
community effort you know you're
community porting your cars how do you
install this in your car
i mean like maybe only you're the only
one with the volts so you got to tell
people how to install it you know
uh so yeah i don't know if this came out
in the
comma three reveal but is there a ram
memory difference between the c2 and the
c3
or is it the same amount of ram usually
it's the same amount
it's the same
openpile uses very little ram we'll say
that
[Laughter]
um
if you have a supported car it should be
pretty easy
you know something we've spent a lot of
time thinking about
um also on the cork board is
ux um we know that
you know our ecosystem can be a little
the bar to get into it is pretty high
and we want to keep it pretty high but
also we don't
like when there's bugs or problems or
errors um
we want to continue to improve our
communication and our documentation
you'll see
when we ship the comma 2 it came with a
tiny pamphlet and it just said
you know get your phone to go to this
website
um we try to increase documentation
um and and the quality of our
documentation
i think we'll continue to get better
with the products
over time
the comma 3 still is a dev kit uh open
pilot is not 1.0 software yet
uh we like
people in our community and people using
these products to have some
it's not even technical knowledge it's
the willingness
to search for technical solutions it
makes for a better community and it
makes for a better experience while
we're developing the product
um i think in some sense it's also like
a lot of people
like friends from me like uh they don't
really know about coma yet
they are technical and do they do want
to solve this stuff but they actually
don't really know about coma yet like
you tell them about it and they figure
it out and like oh this is great and
then they
they buy one and then they drive it and
they tell their friends like i think at
some point there will be some kind of
like
critical mass thing going where like
this will spread a little
faster but uh yeah it's pretty amazing
do you think that um as you continue to
grow
that discord will no longer be a
scalable enough platform you might have
to move to a more
like zendesk kind of approach with
knowledge based articles or
do you want to keep that fostering that
community
like you mentioned
i think we always want there to be a
discord maybe they'll just be a test
before you can enter it
what about the discounted prime without
sim card
i'm like from europe so
no discounted prime without sim cards
because like i'm from europe so the
prime is cool
like most of the prices probably the
same
the problem with that is we have a
saying at comma
that every line of code's worth fifty
dollars so it would take a good number
of lines to implement that
and i don't think they'd pay for
themselves this may change at some point
but at least for now
uh your prime is what it is maybe we
could do it what would you pay
three what what did you say what do you
think's fair
20 15 instead of 24 or 20.
don't you have 38. ah comprise 24.
i mean all right what do we do 16 16 for
if you don't use the sun
15 would be cool oh but no but the
people get the sim card with 24.
yeah if it's easy to code
20 well no i could make it 16 i think
like 15. t-mobile's expensive oh 15
whoa whoa whoa whoa whoa well that's way
too cheap
uh i have an idea we'll keep it 24 but
we'll raise everyone else's prime to 40.
[Applause]
prices go up tomorrow
i got a question for george i think you
mentioned earlier
that um if you had known what the
company would turn into
five years from sorry today
from five years ago you said that you
wouldn't have created a company
i was wondering if you could expand on
that maybe talk about some of your
regrets
i wouldn't go that far
what else what have i done i'm aging out
of my competitive prime
it's ups and downs uh it's a lot nicer
now it's nice to be profitable
uh it's it was very stressful when
you realize you're not profitable and
that
you're losing money every month and what
do you do do you shut it down
uh when things make money well
they have kind of a intrinsic you know
so do i regret it now of course not
it's nice now but um
no i i think again it was a lot of just
kind of personal letdowns with with the
business world and a lot of the people i
encountered
um i was in the hacking world before
that and
liked almost everyone i met you know you
could just like right away or
some guys were here you're talking about
uh you know some some game console
exploits i'm like right away it's a
shared language and it's cool and you
respect skill and talent
uh whereas in the business world it's
not this
um so but you know we try to insulate
from that as much as possible
and i'm you know very proud of everybody
up here for building the comma three
i always wanted to be part of a team
that you know shipped
awesome consumer electronics like that i
love consumer electronics
i wish there were more things like the
common three for me to buy
you know i love these things i buy them
all
uh so you know
yeah you guys all by the robo rock mine
has a lighter
you're the neat all right i got the
neato yeah it's old now
just sent me a message that it stuck my
vacuum got stuck about 30 minutes ago
and needs help
i guess i'll have to go home at some
point and help it out
hi i saw that uh on ebay an apple ii
signed by steve jobs and steve wozniak
sold for 40 grand last november so
george will you sign my comma too for 40
grand
[Applause]
i'll buy a comma 3 if you do
you know what sold
[Applause]
does this need to go into like escrow
now
we only have
just out of curiosity how many of you
contributed to like open pilot or
anything else that kami used before you
got hired
[Music]
i guess yeah if you want to if you want
the best self-driving car system your
best chance is to like
work for a company that builds it you
get the good hardware here for everybody
is there any thing you guys
are looking forward to with the comment
three that you can
say as far as like features you're
looking forward to working on
it can be general but just things that
you
are excited about this new device
helping you guys like coming to work
every day and
push forward
i can say some some things we're just
talking a lot about
the desire problem at work with if
there's a fork or an exit you take the
exit do not take the x it's kind of all
acceptable if you don't know where to go
and if we can implement nav correctly
then the model can just do
what what it needs to do to get you
where you want to go so i'm pretty
excited about that
yeah i have the same one i think we
think nav's gonna be fun and easy
we always think that before we start
working hard
um i'm really excited the last few weeks
steve and i have been working on new ui
on shane so you'll see some new
interface stuff on the
on open pilot and just seeing it
on the stress test has got me really
excited about continuing to
update the design of open pilot
i hear shane and igor stayed up all
night last night getting those replays
working on those devices
but is that actually replaying like
that's awesome
thanks guys
so uh one of the harder features that
i'm really excited about that's one of
the hardware guys obviously
uh is that like all of the sensors are
now coupled to like the same
synchronization line and this is
something that wasn't possible in a coma
too like you'd have these sensory events
from like excel
monitoring and the even the image
sensors coming in you kind of feel like
guess when they were actually recorded
well now like they're all synced they're
all on the same lines
you can even sync them up to gps time if
you wanted to so
i think that's really cool
[Applause]
there's a lot of cool stuff we can uh do
with agnost too
i think boot time somebody asked about
this earlier this is something really
excited to drive down
um maybe not five seconds at first but i
think there's tons of blowing fruit and
agnos
um it's already better than neos you
have apps you have
you have pip it's great um but there's
tons of low hanging fruit like
reducing boot time um and there's a lot
of stuff to kind of chip away at
and use a real linux operating system
and not be stuck with android we're
still cleaning up some of this android
stuff
outstanding questions i'm not going to
wrap up
one more now that you're releasing uh
the the newest version of the hardware
um what are there plans for the next
version or is that a too early question
to ask
or kind of tying in with that are there
other just
how do you approach that are those new
ideas like oh we could do this we could
do that you
comma three forever
what should we do if there's this car
that meets all the requirements for
being officially supported but it's on
the community supported list
asking for a friend uh my friend's name
is eric actually
the toyotas are already officially
supported yeah toyota's you're all good
they're all officially supported
even lexus no you're asking about
vwa soon i'm sure eric was concerned on
my behalf no they're not official
tests yeah we got to take the car out
well i think we'll um shut a picture
of our original aeb tests
so we gotta find some time we have a lot
of safety testing to do um
to bring some cars out of dash cam mode
too so
we do own an audi but hey that's the
first step you know
vw chrysler yeah we are thinking about
buying a new car
yeah you should do a poll we can't we
can't decide there's been a lot of uh
indecision on the team on our next
[Music]
purple panda
it's not going to be a panda it's going
to be a harness fluctuate harness
see and this is where every car
purchasing conversation goes
no but to answer jason's question uh vw
hopefully will be
official soon at least the audi a3 that
we own
um it's just kind of been in the queue
while we're making commentaries
incredible now we came back to
and for the record you've already told
me that but eric said i wasn't making
enough trouble over here
thank you because in in one of the talks
it sounded like
thomas said they were actually looking
into toyota's security key
but from what i thought it wasn't going
to actually start till
2022 i personally think toyota is the
best in the world
i know a lot of people have sold their
hondas just to get a toyota
but anyway i think that the security
issue is pretty big so i want to
kind of know from comma if they really
do have some solid plans
to look into it um so we looked into it
a bit
um i think we'll just look into it a bit
and
just kind of understand uh what the
scope of the issue was
and we just decided this isn't affecting
too many cars yet
um that's not where we're choosing we've
aggressively chosen in the last
year or so to not spend time on uh on
specific cars
we've spent almost all of our time doing
things that improve everybody's
experience with open pilot
um now the comma three's out maybe we
can get back to
doing stuff that helps some subset of
the users but we've we've really been
pushing on the experience
that every user sees
i'm counting on the community for that
one one of you out there we put five
thousand dollars of commas hard-earned
money up
what's the total bounty now uh it's in i
think it's like 8 000 something but
honestly
you know a lot of the community is
wondering if you still have that hacker
blood
in you whoa oh it's happening wow
i think that's a great note to uh end
our in our time
on all right all right all right we'll
contribute a comma three to the bounty
there's a cross-country edition
um one more thing to remind you guys
about you guys know common jeopardy is
tonight
the prize has a fifteen thousand dollar
value
fifteen thousand dollars it's true
retail value
you can fly with it on a plane
uh maybe um
i don't know it's kind of heavy yeah
well you might as well pay extra for
your suitcase wait
i couldn't i couldn't carry it myself um
hey you get a rolling suitcase
you can split it we are playing in teams
so
it's much more manageable in three yeah
um
it's great i'm glad you brought up
logistics comma jeopardy it's
around 5 30. um i think we're gonna say
goodbye
to the world thank you everyone for
tuning in today
bye live stream
[Applause]
hey everybody we're live
on the comma youtube starting comma hack
everyone's here
say hi to youtube are you live streaming
yes
got some cool
announcements to make at the start of
the hackathon right harold got some cool
announcements
some great announcements so
figured we'd stream it for everybody who
can't
make it here today
some very cool
hacky announcements today
so uh yeah we're all out here in the
main room here
ci's currently failing oh gimbal's
failing too
gimbal why
there we go we're back
all right
this is a scene
just scene do you want to announce
why you're here
um here for the hackathon yes
yep
that's pretty much it
the rest is uh
is a secret for now
all right we're ready here we go we're
starting thank you so much for coming to
our 2021
hackathon
um
george gonna evil intro and then we'll
have some pizza
all right
oh i didn't prepare a speech
um
how many all have you all common devices
right
how many y'all brought your comment
advice
all right a good number good number
um
yeah so
[Music]
uh
you you you did the zoom what do we uh
do we have project ideas what's our
who here represents the youth by the way
who would say they represent the youth
there's one all right we got three new
that's pretty good
you youth
uh
cool
so yeah we have a lot of open pilot uh
related projects uh to work on
but you know comma is a lot more uh than
just a
we're not a self-driving car company i
mean our mission is to solve
self-driving cars but the reason we
chose that mission is because
self-driving cars i still believe and
believed at the beginning are the best
applied ai problem in the world
right
our goal is to solve
ai in general and how do you know when
you've solved ai it's a good question
um how do you know when you understand a
radio
well there's a there was this paper it's
called could a biologist understand a
radio
and it doesn't bode well for the
biologist right they're like classifying
the different organs of the radio
they're doing like radio dissections you
know you understand a radio and you can
build a radio and we will know that we
understand a human once we can build a
human um
so of course you know
when we think we're building a
self-driving car we're not building a
car because a self-driving car is not a
car a self-driving car is a car plus an
uber driver
we work with existing cars we're trying
to build an uber driver
all right
um
so you know some fun
uh announcements and maybe some project
ideas this here is a comma body
they're going to be available for sale
next year but you guys can can see them
early on uh it's just a comma three uh
being able to control this body uh so
you can think maybe some hackathon ideas
related to this unfortunately we only
have one common body right now but you
know a lot of the software there was
some discussion about making some like
face software that display some eyes
maybe using the driver monitoring model
to be able to watch people
um you know just sort of just sort of
fun stuff
uh you know we have access to
you know the team that basically built
all this stuff
so uh
you know questions about comic crime
that we've never taken time to document
right like some common security features
some unlock your car doors kind of stuff
this is all like doable all right we
have can fd captures from red pandas
adding can fd to cabana we have a list
of
hackathon ideas i'm gonna hold it up on
this yeah all right
stuff on the tv um
for you know the common body the one
that we actually sell will be a little
more slimmed down this with a pole on
top of it uh so you know this is this
stuff is the future but we also have an
announcement
uh you guys remember at the last
hackathon was anyone out the last
hackathon
wow
uh vivec was the last hack thought um
we announced comma 10k which is our
segnet dataset uh at this hackathon
we're announcing depth 10k which comma
10k has a picture uh and segmentation
labels depth 10k is great because it's
completely unsupervised we don't need
people to annotate anything it's a
really high quality
uh you know images captured from comma
threes ten thousand and there's like
their image triples right so they're
images one taken at zero one taking to
fifty milliseconds one taking a hundred
milliseconds
um so it's like just three consecutive
images from the really high quality
comma three camera uh we've gotten great
results with some unsupervised depth
vents so it's just a fun data set to
play with
um and we are open sourcing that
well unfortunately i can't stand here
you all can't crowd around my computer
maybe if i open source it we can bring
it up on there
i'm gonna click the button to open
source.com guy and uh maybe someone else
talk while i'm doing that
harold say something
yeah i'm just trying to pull up the list
of all the hackathon projects
so that if people want some ideas
they can get inspiration from that i
think some cool ideas would be to maybe
run some games on the common three
um
[Music]
next year hopefully we have much bigger
office
uh we raised 10 million dollars
so uh
raising money is not an accomplishment
let me explain you know people are like
oh you got money oh that's a good thing
no i paid with my soul
but that's what you pay with right
you know
all right so i'm in debt i'm a debt to
some some mafia guys
we got 10 million dollars so we're gonna
have some money to buy uh
an office um
big data center you know big models tons
of data everything faster this is depth
10k here as you can see those are like
image triples from the dataset
but yeah that's open source look you
know i have two issues on the project
like those images i didn't even look
through all 10 000 images so like you
know buyer beware there could be
pornography probably not but you want to
check them um there's also a whole lot
of just junk images in there so like you
know even if someone wants to throw up a
pull request just for moving like the
the
you know 100 of those images that are
just like staring at a wall right
curation of that data set the camera
intrinsics are there so you can do all
sorts of cool things with that you know
get like yolo nets up running like how
many how many people are in depth 10k
how many license plates can you supply
no
um
data set four ideas what other hackathon
ideas we got what do we got on the board
oh there's a bunch of things on here
we've got uh well i just wrote down play
games another thing somebody mentioned
was a see-through comma three can you
make the screen track your face
and show what's on the other side of the
device
um
running the simulator
on your laptop oh display port on the
comma three if somebody could do that
that'd be really cool you know every
common dream i spent like a dollar fifty
on this per device right that's not much
until you're building you know 10 000
devices and you're like wow that's just
15 grand that was just for a feature
that nobody's ever going to use but
maybe we can you know somebody can use
it and that goes well in conjunction
with playing the games because then you
can play the games full screen
um you guys know the common three is
running full on you bought your 2204
how many people have a couple three
how about two
i've got a freon
[Music]
uh designs
oh that needs designs wow
we can get some designs
um
any of the projects we want to talk
about on here at the deep
um
what are we talking about so
far oh uh i mean i guess we should just
talk about like
we brought people here to do cool
projects but
if you like spend a day or two and you
think you're not getting that much done
and you want to fall back to some
practical projects we have a big list
for you um so i don't know
think ambitious today and then tomorrow
you know you can sleep on it and think
whether
you want to go practical or
do something cool
um you have to need any of our hardware
uh we have hardware available for loan
um somebody who wants to write like
right hand or fuzzy tests you know take
two red pandas connect them together so
you can get some can of d messages going
between them
yeah
that's pretty much it what else we ought
pizza
yeah
and if anyone has questions
[Applause]
i mean there's plenty of coma employees
around if you guys have questions about
any other project or want some
inspiration or anything like that so
feel free
to bug us
yeah
and uh we'll be streaming the
the results in
two days on sunday we'll be streaming
the presentations
i mean yeah they know about it
congratulations everybody here i'm very
happy you know i'm a really big fan of
things that are meritocratic uh things
that have like like you know
like just wasn't the last hackathon
unfortunately we did where it's like you
emailed in and like we kind of like
looked over stuff and it was very
subjective this was the ctf right so the
people you see here today are not just
you know they're winners they're people
who did well in our ctf which required
real skill and uh you know see that is a
lot cooler than raising money right like
skill skills skills cool
so yeah uh i expect much better things
for this hackathon in the last icon of
course because you guys have proven
yourself through a test of scale r is
high
the rsi
ah you know hey look anything that gets
done right like anything that gets done
done is better than perfect uh move fast
and great things uh what else would mark
zuckerberg say
rebrand your company the better
what should we rebrand right i
personally anybody who figures out what
a real use for the common body is
because like we're selling these things
they're going to be sold next year it's
a common three on a stick that balances
right
when we give it to you what does it do
it balances it will stand there and
balance right if you guys can like
figure out how to like wow this could
actually be useful for something we're
interested right um it also makes
development on these things more
accessible right like a lot of people
can't buy common devices because they
don't support cars or maybe they don't
have a car at all calm body is for
people
uh so yeah enough about that uh let's
eat pizza i really like those garlic
nuts they're very delicious
or something i think a lot of these
um
yeah oh you want to do one of your
intros yeah
i think like maybe we know people from
er
yeah we're done streaming bye everybody
we'll see you sunday for the
presentations you missed out do better
than ctf next time that's right
bye youtube
[Music]
and today we're going to be announcing
the current winners of the ctf yeah
so we've got uh should we wait a little
bit yeah we can wait a little bit
but is there
no one's got third place yet right yeah
i can say that so if you're uh still
working on the ctf
keep trying and you might uh
get the third place prize yeah we've
been upgraded the second place prize so
you never know yeah merch can turn in
something really cool
yeah we got some cool stuff coming
uh any general updates you can think of
around open pilot or anything what
you're working on
well we're pushing uh 0810 hopefully
this friday
we got some good stuff in there um
it's a pretty big release
um just happened to be that way but we
also got some really cool stuff clapper
um
yeah new sounds we're going to test
those after the stream our sound guy's
been killing it
yeah we don't want to give away the
the sounds just yet but yeah they're
they're they're pretty cool look we can
preview the sounds yeah i guess we
should
look at my phone
they're work in progress
we'll say that
yeah do you have one on your on your
phone yeah i got the sounds new open
pilot sounds and uh you know the
amplifier config on the three is gonna
sound really nice so
yeah and a big
upgrade there
we'll do uh
oh you all play the liquidy one oh yeah
yeah
throw him out it sounded real abstract
at first yes
i think that was option d
let's turn the volume all right take a
listen
here we go
all right
what does everyone think of that
that was that was disengaged oh here's
engage
so
we didn't go with these sounds yeah
these are some of the options we're
saying the options
um what else we got
which ones did we like was that a f i
don't know
yeah we'll play f
just showing we're working on it
yeah
they sound real video gamey uh a little
a little complex
um but we got some stuff that we like
now um
really refining them um yeah it's for
both right column two and comma three
yes i think i don't think we've played
them on this comma two but if they sound
good on the comments too we'll bring
them to the comment too that's the plan
yeah
so that's exciting
yeah this this release uh is gonna have
the first model trained on one million
uh segments so one million minutes which
is huge from research
and it's gonna have wide why box the
black box driver monitoring which is
really nice someone just said in discord
today they're like i don't get it i have
a comma three but i can't see my face
off to the side now it'll see it like
way off to the side it's really great
yeah it shouldn't matter where you mount
it now that really shouldn't be a
consideration um while you're mounting
yeah it should just be just a pretty big
improvement for a dm we're gonna do a
release blog post with this release so i
think you guys got a lot of cool details
you don't get it um
and the release notes we put on your
device
yeah yeah the blog is
is big now you know we're doing a lot of
blog posts and uh a lot more content you
can tell
yeah what's up
all right we want to announce uh should
we start
yeah well
what should we do first the first place
in the second place
they're both kind of first place now
yeah they're kind of both first place
all right what does this guy say
i get a random crackle you sometimes get
when engaging or disengaging is that
because of cpu affinity settings
no
is that just the amplifier config do you
know what that is are you talking about
the comma two or three i think it's like
on both wouldn't you
disengage like
crackles are we gonna fix that with the
new sounds
the new sounds also don't have this
problem we tested it pretty extensively
the new they sound great they sound like
real sounds
so it should be yeah fixed
oh thank you
yeah the new sounds they sound like real
sounds yeah um
we we ran out driving uh playing the new
sounds and then we went back to the old
sounds for fun
yeah it was it was horrible we know the
sounds are not that great regardless of
whether you're coming to a commentary
user um
so like we've been upgrading the ui um
with some like real design and stuff um
let's get a couple of the sounds now in
the next release hopefully
it's been a work in progress um since
common three development to get those
new sounds out yes so they'll be coming
out soon um some ui updates should
hopefully come out soon as well
uh we're talking some designers now
um
yeah stuff's rolling all right yeah so
that's really cool so are we just going
to jump to the chase and announce the
person who won first i guess yeah okay
all right so i believe on friday
um
david cook won first place um he found
all eight flags that was the first
mission with all eight um shout out to
gregor though um he's a former intern so
you know he wasn't uh really eligible
for the prize anyway but um he found
seven in i believe two hours like two
hours yeah that's impressive that was
pretty fast um
but uh divergent dave uh his username of
our first place winner
he found all eight um pretty quickly um
he found them all by friday i believe
right yeah i think so sometime sometime
later into friday i think yes and we
have one more participant who found all
eight he actually found ten of eight
flags um what was that wait give the
what does that mean i thought they were
only so
um
we changed the
the route name to the date that we
released the ctf rather than
the source route that was used
and uh
it was harold
harold do you want to enjoy it yeah
don't say hi to the stream
wanna come sit on the comma couch i've
got nothing nothing really to say
anything you want to tell the people
about zero
uh 010 is going to be very exciting lena
small is significantly improved
um dm mall's gonna be much better for
comma three it's gonna have a wider view
so
you shouldn't have the issue where even
though it sees you you're not in the uh
driver mooring model box
what else is exciting about we've got
acados which is just a
massive code cleanup and some
longitudinal improvements
you might not notice that that much
though
it's great behind the scenes behind the
scenes yeah behind it under the cover
everything's great yes
cool well we were just talking about how
someone found 10 flags what oh yeah
crazy how did the flags how did that
happen that we didn't even know we're
there
um so the way that happened was um
there's this
the ctf route is a it's a fake route
right so we took a real drive and
injected the flags inside that route so
we found a route that we uploaded
before the final ctf one that was like a
work in progress one and he found some
other challenges that we were working on
there and some of the
the current challenges that were not in
a final state so we found two extra
flags that's crazy so although he's
second place um since our first place
winner um
indicated he wasn't interested in coming
we want to offer um
our second place winner
the uh travel accommodations so the
flights and uh at hotel to come out to
the hackathon
we thought that was a cool prize and
yeah we thought that should go to
someone who's attending
yeah so hit us up email us uh
i think we'll email you all right i
guess we'll yeah
you have to stream we'll email you after
the stream yeah um the third place is
still out there and you never know
what's third place right now it's what
was it merch yeah we have a lot of
people seven so you know competition a
little tight for that one yeah um just
gotta find one more everybody yeah just
just one more
it's gonna be easy
yeah
yeah so what the first place winner won
250 250 right yes he won't do it for two
dollars since he didn't uh
he didn't want to come to the hackathon
yes unfortunately but uh our second
place winner he got 10 out of eight so
yeah
you know we've got we've got we'll say
those tied for first place but uh he's
in second place so he can either have
his second place hundred dollar prize or
the accommodations come out of the
hackathon i would have i'd pick that
personally if i could
nice what does this guy say
our flight is going to be revealed after
no so i think the ctf is going to we're
going to keep it around um as like a
form of documentation for open pilot
like if you
um if you're able to find the flights in
ctf you should be pretty familiar with
open pilot infrastructure and some of
the tools we use
at least that's what we think let us
know if uh
if it was a good intro for open pilot um
do you want to show them the the new uh
testing closet
it's not ready yet okay it's a secret my
desk looks really nice
your desk yeah look at one sign up
isn't that nice
to center it look at that yeah
looks really professional yeah we got
real uh
comma threes uh production comma threes
in the testing closet yes so that's cool
with like you know real cases not 3d
printing cases yeah big upgrade
have anyone even seen like a 3d printed
copper three games should we show them
we have one yeah
we worked on the case for so long
yeah look yeah look at that what a nice
three oh let's take this tape off
this is what the f-pot members will
remember getting
uh let's just say the injection molded
case looks a lot nicer
um people asking how many people are
going to be at the hackathon it's going
to be like rolling admission and uh
well we've got a lot of good stuff so
far though yeah but uh
i don't know ideally we get everybody
who comes has eight flags but we'll see
uh yeah
so rolling admissions means basically by
the deadline everybody has an equal shot
otherwise uh as it gets closer to the
event the bar for admission becomes
higher and higher yeah so you know
there's only what two days left there's
only two days left for the you know the
first deadline but yeah if you wanna
come you can always play the ctf um
and put a good github in there i mean it
should be yours but you know make it a
good github
don't attach your resume please oh yeah
someone put his resume for the flags you
know the link didn't even work
oh man
yeah so don't do that put actual flags
yeah but actual flags
there's a band it's a band it sounds
like a bit i missed that one um but yeah
good stuff yeah i think that's that's
the ctf the ctf we got what have we got
like 30 submissions as of now yeah um
which is a little more than some of us
in the office were expecting but uh i
think we could still get more um
got quite a few more submissions
hopefully and before the deadline um
keep going get eight um but
it seems like anybody who's found one
flag um has generally found at least
four
so
once it might be a little hard to get
set up with open pilot we're still
working on that part um we're talking
about ways to make it easier today
but once you get in there you should be
able to find quite a few flags you
should be able to learn quite a bit
about a pilot and uh i think it's worth
it so
yeah someone has five so far
nice oh and if you guys have five and
you haven't submitted so far if you have
any amount of flags you haven't
submitted so far feel free to fill out
the form anyway because you can always
go back and update it it's just cool for
us to know uh like i like seeing that
number go up throughout the day i
refresh that quite a bit so yeah yeah
then you're entered even if you don't
get all of them you still have a very
good chance of getting an invite to
comma hack yes you don't have to get all
eight i mean try your best you know but
we have to work on it's been a busy
couple weeks someone said they wish they
had more time to do both
i mean yeah it's rolling submission so
you can you can keep working on it um
but i mean as soon as you find the first
flag just
um submit the form and as you find more
you can update the form
um
we got some good ideas for part two of
the ctf we've been talking
yeah so i'm glad everyone's been
enjoying that and yeah the video contest
does end this friday uh we'll we'll see
how we're doing mid-week if you know
there's still enough oh my
[Laughter]
yeah what did you think of the ctf
i think it's cool i tried to make it
work on mac and it didn't work on mac
the ctf is great i'm so glad that you
guys are out there using open pilot
tooling yeah
yeah that's great saying that someone
got 10 flags
those
10 of eight 10 of eight i i heard i
heard there were extra flags in the
hidden route yeah pretty uh pretty
incredible did we we announce the prizes
we tell them what they're getting all
right great we got we got first and
first star yeah we said second we didn't
call it first star oh i call it first
star you know i think we should yeah i
think we should uh
yeah
good stuff um are you gonna be around
when we do the video contest judging on
friday
uh yeah probably so we might yeah we're
gonna be doing that friday after lunch
like 1pm
and check out some videos so you all
have a chance to make some good videos
so good luck
make them as good as you can yeah good
luck on the video contest get your ctf
submissions in
um by wednesday yeah uh yo
guys you know what i was just talking
about or just we're just the hardware
division you know comm is not stopping
at cars right
like we're an ai agent company we build
ai agents
the the comma three is a head it has two
eyes it has a mouth
it has two ears
just just just like your car harness
connects your comet three to your car
and the car is the body what do you guys
think of a mop harness
all right connects your comma three to a
mop
and what if the mop harness is generic
and it also works with brooms
and it also works with
dishes
they have nice abstractions like cars
um
they don't well yeah i mean no the
obstacles are surprisingly nice you know
they're all the same well no but like
yeah what i'm talking about is maybe the
harness would have to be mechanical not
just electrical right like you could
imagine the mechanical car harness too
that would turn the wheel and would uh
you know uh press the pedals
mechanically yeah right so the mop i
mean i don't think many mops are digital
but what is the mop harness well the mop
interface is like you use a hand and you
pick it up and you move it right so it
sounds like we have to build a hand and
a way to pick things up
yeah we build little boxes for ais yeah
autonomous swiffer well yeah i mean it's
not like you know the the common body is
not gonna like
uh you know you're gonna just stick a
comma three on there
yeah it's the same head
lawn mowing is a good one so
yeah it uses your push mower like in
stacy's mop video
yeah uh yeah
this is uh
so what we're thinking about your
commentary your actual comma three
will be able to you know who would buy
the common body
yeah right who wouldn't buy the common
body yeah
i'd buy it
how much is the common body
ah the secret
no no you know what we were talking
about guys you know what you're talking
about we're talking about how the comma
3 is expensive we know we know yeah
no one's happy about this right
like
the comment three despite it being the
price that it is we make less money
uh proportionally the the profit margins
are proportionately lower on the common
three than the comatose
so we made we made more more of your
dollars used to purchase comma twos of
profit than the dollars used to purchase
common threes which is just an
unfortunate fact
um but you know we're working on we're
working on tightening things up we're
working on lowering production costs
uh
but
that'll just raise our margins
uh
if you
sort something that folds close you have
solved ai you see the thing is you've
always solved ai if you build something
that plays chess you've solved the ai go
come on that's gotta be ai man
self-driving cars it's gotta be ai the
truth is it's no it's never ai
uh the girlfriend is maybe the hardest
thing to build i i mean that like when
you build something that can do
everything you know a girlfriend can do
then then then uh you know maybe they
need all day i
yeah
uh
how many common threes have been sold
six hundred something yeah we got 679
i think a leak in the live stream anyway
so
no we don't know do we have secrets
anymore no secrets let's see i mean
there's not there's something yeah
there's not really secrets anymore like
failed threes right there that we're
looking into
yeah they just have numbers as long as
they don't have names
for information
yeah so we have we have one we have five
failed comma threes out of seven
fixes in the new magno's going out and
zero um
you know the common three does seem
quite a bit more reliable than the comma
two
um you know the the overall failure rate
of the comma two seems to be about
fifteen percent
uh maybe a little higher
uh which you know it's not great but
for retro for for perspective at in 2006
the uh
the wii the ps3 and the xbox 360
launched um the xbox 360 had failure
rates of almost 50 percent
uh so this is not unprecedented in
consumer electronics the ps3 was about
15. so we're similar to the ps3 we're
not as good as the wii you know not
everybody can be nintendo
um but the common three does look better
um
uh we're not going to do the warranty
from one to two years and it that's not
really about reliability but the problem
with that is it would then require us to
uh
uh like like the logistics required to
plan that and the stock we would have to
keep right um we're not you guys know
we've raised 8.1 million dollars we've
made about 10 million in revenue
like we don't have uh you know a huge
warehouse where we can keep a million
dollars in inventory
uh required to to to be able to honor
that warranty right like we have a lot
of common tools now that are just
warranty replacement commenters and this
is all a strict liability to the company
so uh no
but the reliability is better
um
and you know we are very good about the
one year warranty
yeah that's very true
cool
tesla model 3 harness one
i think rubber is working everybody's
working
tesla
yeah one of the issues with tesla is um
it's hard to mimic open pilot's lateral
policy because tesla does this very
different like the wheel is locked until
you move it kind of thing the the like
cooperative steering that's in every
other car with open pilot is hard to
bring to the tesla
yeah
cool yeah you flip one flag you can use
your tesla model s i believe you support
ap one or maybe two model s's yeah yeah
yeah we should we should be able to
support them you know it was just in the
video i saw how many comments were like
like fsd shields oh these guys are way
behind tesla no we're one to two years
behind tesla like i tell you this all
the time right like it's like ios and
android and eventually we'll get to the
point where you know that gap kind of
collapses once you're that gap may have
already collapsed for actually providing
like the majority of the value
um the majority of the value provided
comes from
uh a chill highway experience
right and like
you you're you're
you're better off getting a
you would prefer as a consumer whether
you know this or not and sorry i'm
making a statement for you you would
rather something that instead of making
a mistake every hour on the highway
makes mistakes every 10 hours on the
highway versus something that makes
mistakes every hour on a highway but
also makes 90 degree turns
right you'd rather the former than the
latter you may not know that but it's
true
i mean it shows in the data too yeah
um you mean the engagement time yeah
yeah yeah um we have significantly
higher engagement times than tesla how
often a lot of people drive tesla
without autopilot engaged um people with
open pilot have open pilot engaged
almost twice as much
uh autopilots engage like 30 of the time
and we should adjust
our our statistics too right there's a
lot of engageability time that we can't
get back like some of the toyotas have
and the chrysler's you could only engage
in about 35 miles an hour yeah this time
is super high for everyone
yeah yeah yeah no we i mean we it's we
should actually plot the whole
distribution i'm sure this is true with
autopilot there's some people who are
using it like 98 of the time or
something but because well it's much
more cooperative um
you know it's it's easier to stay
engaged
uh
so yeah your comma three will just
you'll go use that expansion port you'll
plug it right into the comma body uh
comma body will go in the top port where
you connect the car harness right now
that's the thing harness port uh we'll
make the body speak obdc it'll use you
know arm will be on can and stuff right
because you just can't for all that and
then you always have that other you know
you've got that other expansion port on
the comma three uh which as we sell more
comma threes as we start getting more
data we can start to train really large
models even if the models can't run on
the comma 3 well you can comma compute
you know plug in the compute
uh 30 90 in a box
uh and that should be enough to solve
self-driving cars right because what do
you need you probably need does the the
goal with the comma 3 was to be sensor
complete uh not necessarily compute
complete it may be compute complete we
don't really know but maybe not
but the usb 3 port on the comma 3 has
enough bandwidth to stream out the
entire sensorium of the dice so we can
stream that sensorium over to the
computer with a 3090
a 30 90 i would say a 30 90 can uh
can do level five
maybe four thirty nineties right can a
mouse driver copies the question at 439
is about a mouse
cool
yeah at the hackathon you can make a
cool project with that expansion board
too and you can set up your computer
your comma 3 is a computer you plug in a
monitor with displayport a mouse and
keyboard did we say we're doing a
hackathon with the office doing outside
no we didn't oh we haven't decided that
yeah yeah uh oh oh yeah yeah you can the
commentary is a computer yeah yeah you
can sit at a desk plug it in you should
be able to develop open pilot on your
comma three did we get that to work in
west them no no that's that's their
project
[Laughter]
we released all the agnost stuff right
uh not western but oh
why i don't think we can
oh
that's a shame yeah magnus builder
itself is open source yeah no i mean
look it's not like it's a secret like we
can talk about this no no sure um yeah
why because it's using better kind of
sources yeah
can we just like build less than what we
need special over there so what's in
there i mean it's just gonna be a lot of
work
west if you guys want to come and
rebuild western upstream western
upstream western
upstream
did we fix that bug yet
which bug dui crash bug
oh it's just rare enough oh no
yeah well they know what 10 hertz ui
we're going to fix down here 2i in the
next release yeah i don't think they're
really interesting
oh it's not an issue in last release
okay okay great
pay attention to the road yet you guys
like that like the sounds
i hear really good things about the new
driver monitoring model
we played new sounds for them we showed
them a preview oh you showed them a
preview of your sounds you guys the
comet 3 has great has a great speaker
and a great amplifier it sounds like
shit now because nobody tuned it well
we're gonna fix it got a real guy to
tune in yeah we hired a sound guy
uh yeah that was that was the tragedy in
hubble's here's video when you hear the
comment three
screechy sound
i didn't even fix it we're fixing it uh
i don't think sounds are going to make
the next release i'm going after i'm
going to make next release we're going
to make the next one oh oh great we're
going to try to squeeze them into this
one but we want to make sure they're all
oh you mean not this one but okay
yeah like it's very eleven okay
um
uh you know antenna longitudinal stuff
is uh
it's coming along but it's just gonna
take time it's just gonna take you know
what we were fantasizing about in the
research meeting this morning we're
talking about the day when we're
training models on only comma three
datas for only comma threes nine months
nine months until the great deprecation
oh think of all the code we're gonna
delete oh the great deprecation
common two will be left in a great state
though
yeah
yeah yeah no
right yeah yeah yeah uh i mean the
comment is already kind of like
uh have we have we hit the thousand
hours yet for it we're really cool we're
really close to the thousand hours when
we come too
as well yeah our our goal our goal like
one of the goals for the common two
projects what we call open pilot 1.0 uh
is a thousand hours uh mean time between
failure on the comma two so we'll make
sure it's there
um i mean yeah what else is there like
the comma 2 is kind of a complete
product
yeah it is it is exactly what it is i
think all the the rough edges are kind
of polished
yeah uh and then you know onward to the
future with the comma 3.
um
and we'll see i mean we'll see how much
effort it is to
i guess the open house will start to
diverge at some point yeah but it'd be
nice if like new cars could still well
like backboarded if it was easy enough
yeah
i mean
the way it's structured right now you
could probably even copy the self-drive
or the self-drive car directory that
should probably mostly work
yeah
yeah
cool
how's the accord someone asked oh i love
the accord that's nice do we have a
torque mod no we don't yeah but you
still love it i still love it the acc is
pretty good i want our acc to be like
that uh i know the honda bosch acc and
the handbag acc are very good yeah the
override is very comfortable in accord
too which are
the steering wheels the steering over
here yeah i don't know i haven't felt
this in the other cars either
i mean honda's honda's always have the
good smooth changes see the accord is
great even without a torque mod it was a
little frustrating but you know i drove
to la and back and it was still a great
experience it had more torque than i
thought i'll be honest i thought it was
way less it was pretty pretty decent uh
hg acc is good but too slow from a stop
like do you mean ours or do you mean
theirs they mean ours it's pretty slow
but well there's a slow too it's just
it's in the api apparently oh that's
true yeah the delay is isn't the delay
is apparently in the api yeah and we
spent quite a bit of time on that i
think this is
the best we can do right now yeah well
you know the 10-day is still our star
pick for a level five car you guys ready
to see some 90-degree turns i changed my
position we love 90-degree turns
only on the common three though
no look
tesla a lot of people have fsd now
yeah i think they're they're releasing
to the 99 uh driving score we don't
score you guys you can uh engage with
the open pipeline everyone we should
start scoring them i like that tesla we
can't check out our experimental
branches that's right that's true i like
the tesla does that you want stop lines
you know drive safely don't get driver
monitoring things
um pay attention uh
oblong say stop longer than hyundai we
gotta do better nibbles turn mode
what's nipples don't know what that is
no
uh look look we're a year and a half
behind tesla so in 18 months your comma
3 will make a 90 degree turn probably
right you saw the red lights and stops
on demos we're working on them but you
know we do things right in a slow way
not hacky in a future way
uh like even when talking about stop
lines this morning it's like well do we
really want to ship stop lines or do we
want to first focus on more into and
longitudinal stuff and the answer was
kind of ant and longitudinal stuff yeah
um
corolla 90. i've seen the i've seen the
corolla already make 90 degree turns oh
yeah yeah yeah like seeing it you know
you people like people are like hung up
on this i should have said that at
comic-con like they just got hung up on
this like
it's like
my point is more like what do you even
mean by a 90 degree turn guys like well
we're gonna oh no no no we're like
hyundai we're gonna put a limit you know
the limit in the handbag yeah we're
bouncing back yeah that's right that's
right once you get to 89 open pilot's
just going to disengage all right that's
it we got to stop we gotta stop
somewhere we gotta stop somewhere
um
open pile is a 90 degree system yeah
what else you want to stop you want to
make a turn all right let it stop we'll
have it make a turn you know dude you
want to tell me what your bonuses
oh we're driving a taco bell with uh no
disengagements yeah taco bell notice
engagements
how long has that been the the goal
last year last year nice
it's a long term goal yeah
cool i'm going to
love comma thank you
yeah thank you come body come soon
commas all right yes comments already
360. oh they're going to need more
cameras where do you want me to put them
you know there aren't any more degrees
right
oh but they're not going to be able to
see through the back pillar yeah neither
can the human you know
yeah the comet 3 has plenty of field of
view for every part of driving except
for
cars approaching quickly on the side
which you need to know in order to make
a lane change but fortunately humans
struggle with this as well and that's
why we have blind spot monitors right so
good blind spot monitors plus a comma 3
should be sensor complete to drive a car
right remember you don't have to see
every single bit of the road at every
minute humans don't do this either
you just need to be able to have a
holistic 360 degree understanding of
your place in space right and the comma
three can do this you know more than
well enough
oh my i don't know oh does the prices
only go up department have any incoming
announcements
nah now we're
the price is chilling for a bit the
price is chilling for a bit we
they're in the price justification mode
that's that's how we renamed it to yeah
the price justification department
um yeah we're
you're gonna be happy you bought a comma
3 by the end like are you happy about a
comma 2 did it provide enough value to
you
uh
humans see a lot more of you inside
mirrors yeah questionable i mean that's
why you need the blind spot radars
but you can drive a car with outside
mercs take them off actually you can
it's illegal
george said i could take off the sidebar
uh
will there ever be a need for the model
to remember more than two frames at a
time yes but you do understand we've
been doing this since it's open piled
0.6 right the model has infinite it's
it's an iir filter
it looks back infinitely far
it incorporates state from as far back
as you want when at train time we train
up to 30 seconds back so that's like a
practical bound
all right if we're up to if we're up to
those questions i think uh i should just
remind everybody i want to be a winner
you got third prize is still up for
grabs yeah 100 bucks nope
merch right merch merch merch yeah yeah
there's some cool merch so do we have
hackathon marketing yeah we're gonna
have a cool hack at that merch it's
gonna be great
and
you can come in a coma hack so yeah
already that's a great prize it's gonna
be a really fun time
let your friends know about comma hack
see if they want to compete um reach the
kids let's reach the kids do you know
any kids
who want to go to college we try to
reach out to the local universities but
i don't know if they you know printed
out their flyer and put it on the wall
yet i don't think they did yeah we
didn't get any submissions if you know
anybody in the local universities uh in
san diego or l.a
let them know spread the word yeah
we want uh you know anyone who wants to
come work on cool stuff to come to the
hackathon yeah we're gonna have lots of
cool projects
um
and that could be you yeah
video contest probably ending friday
we'll see if there's no like crazy
submissions we can extend it but like
you know let me know on discord if
you're like hey i'm working on something
really great i just need more time
because otherwise i'll just not think
that anyone's doing anything cool
so
yeah
all right
bye everybody
live stream
but there's some other stuff we're going
to show off
first
yeah this is the judging panel
introduce yourself
uh hi i'm vivek
i work in the research team
i'm harold i also worked in the research
um i'm chris yeah work on production and
comms so here we are
we're in the research office today and
there's some pretty exciting stuff going
on in research
yeah we can also start with uh if you
want to talk about yeah you're working
on the bank roads oh uh yeah i'm working
on the uh
bank roads problems uh
the problem is uh
when you're in a turn
um
it's usually the road is usually has a
bank right so this is you might have
studied in physics problems where you
know uh
the vehicle should not slip off the road
so there is a bank
uh because of this
the amount of steering you need to give
to achieve the same sort of degree of
turn
is different uh if it was a straight
straight road versus if it was you know
a bank
so
the result that we that we see in open
pilot is uh if you're on a bank road and
you're turning you tend to typically
over cut which is you you go into the
turn
uh which is not desirable so yeah this
is especially true on on lane list if
you guys have been driving laneless
you'll notice that that's a big problem
with lane still that'll cut the turns a
little bit too much
um and yeah i think that's one of the
big things that uh blenus can still be
improved on so hopefully
the next project will bring fruition
soon and that'll that'll be improved
and uh hopefully one of the next
releases
um yeah should we go through some you
can show some of the exciting stuff
we've been working on here in research
as well
uh these are our training graphs of uh
the model that's going to be released in
0 8 10.
um looks good what is the
for for someone who doesn't know like me
what's like the blue and what's the
what's the red line oh so this is uh
this is for everything we train a lot of
output so this is the loss for
the entire model and then just
individual outputs and so loss is
kind of some cost right so you want to
keep that minimal it's basically how
accurate it is in predicting
the ground truth
um
in a variety of situations and i mean in
this case it's mostly just like path and
lane lines like you can see in some of
these issue images here so
the closer it matches the ground truth
path and lane lines the lower this value
will become so you can see here training
over time this model took i think a
little over a day to train
you see the
plot's going down
difference being the
the red ones the validation so that's
what we test on so 10 of your data gets
uh separated into a
test cases and then ninety percent will
train on you can see those two things
being different here
yeah why do we have that initial spike
over in the big loss
oh this initial spike is uh i mean
that's kind of a quirk of the type of
loss function we use we have uh
um we output multiple plans so there's
multiple hypotheses for the plans oh it
takes longer now
to spike yeah
yeah it changed i changed the weighting
quite a bit on this that was one of the
bugs that we fixed in this relationship
so we downloaded this and it was just
sometimes picking garbage solutions uh
but yeah so basically this is kind of
like a competitive thing that this the
ground truth for this depends on the
model so it kind of changes throughout
you throughout training so this is kind
of not the shape you normally see during
training
um i think we explained that a little
bit better in some of the blog posts the
way these hypothesis uh models work it's
kind of a little bit more complicated
um all right here we have a new
new thing we're trying out we thought
maybe it'd be nice to explain some of
the things we're changing in the release
so we wrote
well we're still in the process of
writing it but we thought we'd write a
little blog post explaining some of the
the big changes hopefully some people
that are interested in the more detailed
changes but you know don't want to read
through the commits of open pilot and
that can get something out of this
yeah yeah it's pretty cool
yeah i don't want to show the oh we can
show our last uh our last innovation
here in research is uh if you guys have
seen some of our blog posts you know we
use a simulator to train in where here's
kind of a simulator where you can move
around left and right forward and back
so now we're moving forward and back the
it's actually taking diff frames from
the video you can see that truck in the
left moving
but with this latest one uh if we now
freeze the frame we can
from the same frame move around left
right forward back and you can see it
doesn't really look that distorted it's
a pretty pretty good simulation so this
is some latest improvements we made
hashtags the color pencil
yeah pencil my is a big part of this
this is all this warping is based on the
segnet we use the segment outputs make
some assumptions based on the depth of
the road plane and uh and just the depth
of the surrounding and you can see this
beautiful reprojection it's uh
almost looks like gta 5.
yeah i think that's uh
biggest updates from research it's
pretty fast now
yeah it's not bad
uh yeah it's training now it's twice
slow in total which is not too bad well
we're getting a new office we're getting
a big data center
yeah
big things happening yeah very exciting
things i think you guys are excited
about this latest release too it's uh
it's been about a month or something
we've gotten quite a few improvements in
it so
uh yeah if you look at the release notes
you'll just see like you know new driver
monitoring models so that's why we
really wanted to kind of explain a bit
more
like what these things actually mean uh
because you know it's pretty cool
there's some cool little tricks we do
this is like mask on augmentation
and then uh
field of view of comma three is starting
to be used for uh
for the driver monitoring so that's
pretty cool
all right do we wanna wanna go check out
let's do it
the videos
thank you all for submitting your
awesome videos to the video contest
means a lot uh you know we love seeing
content love seeing people driving with
open pilot and uh enjoying what we do so
definitely yeah it means a lot sure oh
we got another another thing to check
out
so
i'm looking into training uh
depth nets
so the comma 3 has much better picture
quality than the uh than the comma 2. so
we're hoping we can finally train
unsupervised depth nets and you can look
at these three frames here
and uh
you see how the you know it's like three
in a sequence so using just this picture
you can figure out the depth of all the
objects in the scene
and this was never possible on comma two
data
uh because if when you looked at the
road on a comma two it would just look
kind of blurry
but this is comma three data and if you
look at the road look at that texture we
can capture
that's a lot of texture yeah so using
this texture we can figure out how far
away the road is
uh based on how the texture moves and
this is just a google paper wow look
look at that word texture oh yeah all
right and you know the two is so
detailed glory uh holy crap
other people's skid marks will help us
learn depth that's right
that's cool another another innovation
coming
down the pipe
anything to say about the videos you
like like community content it's
were good watching the videos or is this
one of those things where it's like the
academy awards where they know already
who's going to win
we know who's going to win
it's like the academy awards do you have
the envelope
[Music]
[Laughter]
yeah
all right let's go let's build the
suspense anyway yeah
yeah nobody don't know who's gonna win
yet
i mean we'll start with honorable
mentions first of all the first category
we're gonna talk about there's two
categories remember first category was a
general review of your common device
comma three and the second category uh
was laneless videos showing off lane
lists i mean they can kind of overlap a
bit but anyway here's uh honorable
mention
wait did this guy uh follow the turning
the speed blue to
turning the path blue
he's just riding a fork
but yes
if you're in here
here's your video
pinoy
pinot drives
let's check it out
it's pretty cool
that's me driving hands-free on my
subaru forester
you know how many people use subarus yes
i wonder which tv the audio is coming
out
or is it coming out of all of them
oh it's coming out the bottom one
um
wow look it's a comma three
oh that that screen looks so nice yeah
right
such a big screen such a deep black
[Music]
but it's pretty a comprehensive video
you know it talks about what is open
pilot uh talks about
their experience with it they even do
some laneless drives in here which is
pretty cool this is on like a laneless
country road oh yeah i love lamels
drives yeah laneless drives are
that the great
is uh you know going on the right side
of the road yeah it's pretty cool
so it just knows like a human
um like a human but yeah this is a great
video and discord i'm gonna post a
playlist that has all the finalists in
there and uh you can all check out the
videos they're also all on our community
uh videos tab on the youtube channel
are you quite impressed by all the late
late submissions
yeah there's quite a few today quite a
few late submissions um procrastinators
are always the best
yes so all right next uh next up is a
let it drive video
we like let it drive but it drives
pretty cool
whoa we got a cookie no way
oh man
uh so this is pretty cool we kind of
broadened up the
category of uh comma 3 review to just
kind of be a general review of open
pilot because some people don't yet have
common threes uh so wait this is i
thought this was a pay-to-win category
no pay-to-play pay-to-play
yeah the
the winner does have a comma three to be
fair oh that's good
that's right so yeah this guy's driven
over 10 000 miles with uh open pilot and
he he gives some that's a lot yeah i
mean that's a lot right ten thousand
thousand miles to the open pilot wow
what percent of all the miles yeah
that's a pretty good
pretty good quality
i think i have two yes
um but you know what i like about this
video is he has a whole section about
things he wish he wishes he understood
better before he bought it
things like torque limit like car
specific limitations it's stuff that we
don't communicate very well yet so i
mean i think it's nice we don't just
want to review where you're just saying
all these nice things about us and
nothing critical
yeah i think i especially like the part
where uh he did not know that uh the acc
was stuck for a long time after he
started using it yeah he was confused
why
it wasn't uh why was it getting better
yeah why
all the youtube videos that you saw were
so good but then his car was not that
great so it was stuck so yeah
that's good
it's not just about the good stuff we
want a clear honest honest picture
that's right we should know what they're
getting into yeah so i think this video
does a really great job of that you know
providing some things you should know
before you order but then also
saying how much he loves uh loves using
open pilot
and uh is that a civic type r that what
that was that was just b-roll but
um
but yeah he also has a shout-out for our
awesome support team
oh thanks yeah and the discord
but yeah you know let it drive is great
we love let it dry that's some really
good stuff
so
wait so he uh says talks about whether
he wants to buy a comma three
and he decided he didn't want to buy a
comma three is that what uh
he's saying he should buy a common three
but he's still chilling with his
commentary he's still waiting he's happy
with his coma too yeah i think he
doesn't yet have the money to get a
company that's good but yes he loves
open pilots
so that's great that's another honorable
mention and we'll have a little
announcement about what honorable
mentions may be getting a little bit
later pensions get chris oh we announced
that we can announce it now
every uh honorable mention gets a hoodie
[Music]
so uh yeah if you're
on the discord feel free to just dm me
uh your size
and but if you're not on discord and
like you're just watching this and your
video came up uh just email support
comma dot ai with your uh your address
and
your size and we'll get a hoodie sent
out to you so that's pretty cool that's
pretty cool 89 value right these kama
hoodies are real good yeah the kama
hoodies are super nice so
you get some nice merch
all right we ready for the winner of the
comma three category yeah let's do it
who's doing the drum roll
late submission by the way came out a
few hours ago
oh yes
um
people are better at pronouncing names
than me this one's bi i'll go uh
nice that sounded really good it's just
i guess it could be something completely
different i turned my corolla into a
self-driving car
is what a brain logos this is my car
being driven by oh yeah i think it's a
cyborg brain
uh so yeah this is a great video what i
like about it most especially is that he
kind of explains
what's going on at the beginning like
what is open pilot which is good i used
to do a video uh a long time ago about
what openpilot is but it's definitely a
lot better than what i like where they
show comic-con clips me too yeah there's
a lot of great comic-con footage out
there we really go through a lot of
stuff in detail yeah we're very proud of
go over yeah go right there there's a
pretty cool installation
sequence
yeah check it out
oh yeah this was super good this was so
good
and it makes it look pretty easy which
is pretty easy it takes some time but i
think anyone can do it yeah just uh
sticking the mound on correctly with no
angles also a little bit of a
you know just be careful yeah have you
installed hero
uh no not the whole thing that's the
whole thing
i'm waiting until uh it's ready for the
consumer experience
i've installed a lot of mounts to i feel
like a lot half the time you're like you
accidentally touched the windscreen and
i got shit yeah
yeah so this is great and then you know
it kind of almost qualified both
categories but in some ways it's more
than laneless um but he also shows a lot
of great laneless examples going through
intersections and things like that
and i think uh yeah it's just really
cool how he he shows it's successfully
going through uh intersections in
different ways also you know he's
critical like sometimes it doesn't
always go the right way um but all stuff
we're working to improve so yeah also
it's uh another thing that's pretty cool
is uh this person has been uh using for
a week yeah so you can see how his hands
are you know really around the steering
wheel but if you see the other videos of
people uploading the especially the guy
who drove for like 10 000 miles you can
see that his hands are you know quite
comfortably on his lap yeah yeah you
change your behavior a bit over time
don't you yeah
so that's really yeah let's let's check
out some of these yeah like his
intersection tests really cool videos
yeah look at this
it's making a curved intersection uh
look easy look at
that is nice
that's pretty cool oh that's google maps
i didn't even realize that's not great
i almost did that but i pulled out my
drone for the the videos we did but
that's a great way to to show a top-down
view i really like that it's a good
camera set up i think more people should
show up how they rig their cameras right
i'll probably do that for us because
it's pretty difficult look at this
another nice laneless road there nice so
congratulations you win 544 dollars and
46 cents
um
this actually i like this bit a lot uh
the rotary the rotary bit yeah that was
you know it was kind of suspenseful this
is what i like
he's in a roundabout it's a pretty big
one yeah it's pretty big he has a image
of the thing yeah there is this
yeah there's a roundabout it's this
looks like this is this in america
what the hell never seen this i haven't
seen that in america either nice i see
you're in the chat so uh wait this guy
has a green path everyone has different
color paths
he's on shane's fork he said
oh i see yeah he's on chainsaw yep
um but yeah he's super
super famous
[Music]
thanks for all your great submissions
yeah they've been yeah their submissions
were really great over here show my
favorite one
which is that one
no not yet that's your favorite
maybe we'll play that one in full you
know it's so short yeah but uh that
one's an exciting one i like that one
yeah and this video ends with a nice
time lapse which is always nice
uh so it's a very very good all-around
video yeah this was very complete very
informative yeah so it came out a few
hours ago very
very exciting uh but yeah
544.46 uh you know email support.com ai
if you're not on the discord if you are
just message me virtually chris all
right
so that's the first category comma three
review now let's check out some
honorable mentions in the second
category
which is laneless
so
i thought this was uh
pretty cool is the this guy
has made videos in both uh for both
categories oh yeah and they're honestly
both pretty good so this is uh
specifying his
he's uploaded i think like four videos
in the last week which is great you know
we love having new open pilot youtubers
come to the scene uh i think
education is a big thing and you know
people need to kind of understand what
we're doing and sometimes we can't just
be the only ones saying it so it's very
helpful when people make videos like
this yeah i think it's very good because
they know the things that they didn't
understand before they got into it and
the things that they didn't want to
didn't want to know beforehand right so
it's less sketchy right when you know
people use it and make videos right this
is the company making videos yeah right
we can try to be honest but yeah nobody
will believe us anymore yeah for sure
yeah even if we're the most
honest company george is a
sneak previewing some hackathon projects
wow
comma hacks going to be wild
[Laughter]
whoa
i was like close to it
we have an announcement too this isn't
mine are announced but when they're
vietnamese
okay you want me to come over in your
office when all right sounds good
so well so many announcements today it's
crazy
it's almost just been happening
i know it's very busy lately so yeah
this is an honorable mention this guy
does only get one hoodie even though he
he's done multiple videos
so uh appreciation as well yes we really
do appreciate it we hope you keep making
videos i think they're great there's
literally no subaru content creators out
there so you kind of got a good niche
there
all right another honorable mention
the good old logan le grand
uh we're long-time fans of logan legrand
long time fans he's got some great
content great explanations yeah i'm sure
most of you know logan as well ooh
we're starting off with our honorable
mention there it is i'm gonna ship you a
comma hoodie if you are jealous you can
get one on the
shop yep
shop 89 so that's right we'll be uh
sending these to our honorable mentions
thank you so much yeah they're very nice
very high quality
high quality hoodies so yeah what i love
about logan's oh i've got a new car
first of all i've got a highlander yeah
and he told me that he thinks the tuning
lateral and longitudinal longitudinals
better than his scroll i think the
highlander is the the highest turning
rate i've seen on any open pilot cars i
was doing some metrics on
what's the strongest open pilots ever
turned from the data set and highlander
came up a couple times so it seems like
it's got some of the best lateral uh
control available
yeah this is a cool laneless going
through a street like that really nice
and uh you know logan knows we we always
like when he makes a video he's always
uh you know very good yeah this is
actually fantastic yeah it's fantastic
he's he's showing it uh oh he said the
highlander's pretty great so far you
just said
so i know you keep getting comma stuff
but now you're getting a hoodie i don't
know if you already have one but you're
getting another one
yeah so this is basically he's uh
driving straight into this intersection
and then now you can see
yeah
that's nice when pilot made a decision
yeah i think it's great that he's
looking showing the challenges of
lameness as well i mean
lameness is great at a lot of things but
there's also things we're still working
on improving and just inherent
challenges i think it's really cool that
he gives a pretty complete picture and
like the stuff that can still be worked
on yeah so there is one bit that i want
to show
where basically there's a parked car and
laneless you know
slightly goes around the car which is
pretty cool to see
yeah that is really cool i wonder where
that is
this video is all full of uh good
good info so maybe somebody here
let's see this is the
intersection one which is also pretty
neat oh it goes right through this
section i guess it was somewhere here
then hmm
i think it was later
oh yeah oh here it is yeah look at that
yeah yeah so you can see that there is a
uh
parked car on the road it looks like a
lead car but then you see lane lists
slightly taken yeah
you know it's showing the intros of
something amazing yeah exactly you know
it's a work in progress it's getting
better every release
and i think i've been working on the
end-to-end uh long-term stuff now
recently and i can see a lot of uh
a lot of potential i'm very optimistic
i've been focusing a lot of bugs
very excited about the next next demo
yeah
yeah one of these weeks maybe we can do
another yeah once we get the next round
of improvements on a branch i can see
again
people can see the progress
yeah so congrats logan thanks for your
submission and your continued uh support
we really appreciate that
all right another honorable mention i
can probably play this well we can play
this one we'll see if you can hear it uh
a lot of people around the office really
like this one
let's
first of all it's by js
mysterious name
i like js a lot js does a lot of cool
like uh just showing the end to end
stuff even longitudinally but yeah here
we go
whoa look at that
i like this one this is a punchy little
ad yeah pretty cool
yeah yeah
good beats yeah there's good beats we
couldn't pay enough to get an ad like
this
if you ever saw him paddle on tv here's
what how you see it yeah exactly yeah
did you ever make a super bowl ad i
wanted to be like this
yes
whoa look it's making a lane change with
no lane lines what
that's impressive dude is it even a lane
change if there are no light lines yeah
it's
just something completely different
philosophical question there
whoa is that was that an actual drone
shot
yeah except that's pretty cool yeah this
is great uh great ad
like a human
we're gonna have to
use that slogan later
so we love that you'll be getting a
hoodie thank you so much for your
continued content it's getting you know
every video you make i see is getting
better so definitely keep it up we
really do appreciate it all right
we've come to the this point where we
got the final winner coming up final
winner yes
and another new content creator someone
who's never made open pilot video before
all right here we go
oh we always like new community members
we do
all right here i'll try to
uh this one this is less my my yeah my
ethnicity yeah but i'll go with that
so sci-fi congrats for winning uh
[Laughter]
[Music]
eddie as the profile picture that's
hilarious
that's funny all right yeah let's just
we'll play a brief bit of this video
it's pretty pretty great it's like a
swiss town
whoa
we're trying to develop a self-driving
vehicle yeah it feels like there's a
really good script in this video like it
feels like
this one really communicated things
super clearly
really communicated what laneless is and
why it exists and why we're approaching
the problem the way we are yeah
so
yeah it's great he starts something like
hey how come you can't just have a car
that you know just stays in the middle
of lane lines and doesn't hit anything
but it's harder than that and he he
shows off some great examples here where
we do really good
i think my favorite i mean this is
always a fun example the the country
back road where we do really well even
with no lane lines
i wonder how long this guy's had open
pilot he's got his hands near the wheels
yeah i think the the stickers are
popular on the steering wheel this is
the second person i've seen yeah i've
never seen that do we need to start
doing that that's pretty neat though oh
look there's a truck coming on yeah this
is you know i was surprised that he
didn't have to take over here just uh
nice it was hugging right enough that
there was no issue
very much though even though there's an
oncoming truck yeah so yeah pretty sweet
and then let's uh let's go over to my
favorite one he shows which is uh
oh yeah this one's good too
yeah check this out you're not gonna
believe this so he's going through an
intersection first of all he's saying
like
you know how that's cool in itself that
was a curved intersection but then look
at these crazy lane lines going on
over here like what is that
if we had any hand policy you'd be so
screwed right now because they're really
confused
i'm really impressed with how good the
video footage is in this uh this one
like the the shots of
uh i guess of the gopro yeah look really
really good and it's explained super
clearly i think this is a very well
deserved win
yeah definitely so you went sci-fi
544.46 congratulations
so yeah you know we're really
loving all the community videos
definitely keep it up if you like making
videos you know i definitely enjoyed it
when i was making open paddle videos
it's a lot of fun to just drive around
and see what the system can do yeah it's
pretty fascinating yeah it's a very
impressive set of videos yeah
really happy with all the all the
content
yeah yeah for sure definitely definitely
yeah
also it helps around
everyone else who already has open pilot
or who is planning to buy just uh just
good to see
people in the community making videos
and you know
yeah
just nice
it's nice all around so everyone keep it
up i think we might have made some new
open pilot youtubers with this contest
which is fantastic keep it up i mean you
know logan has a lot of subscribers now
i got a lot of subscribers just from
doing open pilot videos so if you have
any youtube aspirations this might be a
cool route think of how many people do
fsd videos you know we need more more
open pilot content out there
definitely
do we go see what george's announcement
was yes george you ready for your
announcement
all right
going in
uh
no it's not on a computer or anything
okay
so
um
a bunch of things
it's actually on the board if you guys
are paying attention
uh
how to approach this let's see
um
you have this concept of uh
like
pareto optimality is there anything that
comma
could be doing better
um
and then you know you have you have
optimality with respect to constraints
right
and something i've said around here a
lot of times that should never be a
constraint
is uh non-recurring expense
or the amount of money that uh you can
put into things right
a lot of companies now of course
spending money is not good
uh spending money is bad uh hiring
people is bad right people are cost uh
this is a lot of people don't think
about business like this they think
about oh people are growth no no no no
sales are growth right like like i guess
for some people
uh you know maybe it's kind of like an
all-attention is good attention kind of
theory
uh where it doesn't matter if your
growth is in negatives or positives as
long as the numbers are getting bigger
some people are happy
i of course don't feel that way now
uh so
we are
uh
raising a small amount of money
uh i'm not i don't i don't want to be
sec you know i don't want to be sec here
so like i don't know what i'm allowed to
say what i'm not allowed to say i didn't
i didn't consult with my lawyer before
talking
um
the
it's no it's i'm not gonna okay now i'm
gonna send you this link right now to an
erc20 on on uniswap and you all should
aim it no it's nothing like that it's
nothing like that uh the minimum
investment is a million dollars
uh we have a whole bunch of people
already uh
basically that we've reached out to
uh you know just people we've been in
communication with
um
accredited investor obviously
a million dollars minimum
and then um sort of mission aligned
uh if it's the kind of thing where
you think you're gonna get in you're
gonna you're gonna flip or you're gonna
push me into spacking you're not you get
no control
uh but
yeah we haven't raised money in a long
time we are a profitable company
we don't have to but there's two things
that we can do better uh than we're
doing right now
and the first one is our data center for
research so
the amount of data that we're processing
is going up and the amount of operations
we need to do on that data is going up
so models are taking longer and longer
to train given a fixed size of the data
center so we want to make the data
center bigger
uh we're never going to ipo this
company's never going to be owned by
bankers
right so once you ipo or you stack your
company is owned by bankers right um and
bankers don't create value bankers are
middlemen so we're not interested in
anything like that
um you know it's it's uh it's private
equity
uh now
you know uh
i don't know how much should how much am
i allowed to say how much do i say in
private conversations it's on youtube
uh whatever whatever whatever
you know who you are um
if you're interested in your approach in
the right sort of way
uh there's a possibility
you could be uh included in the round
but again it's really about
people who are aligned with long-term
value creation in the future
and hopefully there's enough of them out
there because honestly if there's not
well fuck it we're not raising money uh
but if there are
uh
you can you can uh subtly reach out
uh and i will
justify our valuation talk about our
plans in the future but there's two
basic things uh that money would while
it's not necessary money would help us
uh one is buying a larger data center
why don't you just put everything in the
cloud yeah great great great you will
own nothing and you will like it uh no
no no we don't like that um the cloud's
very expensive especially for deep
learning so we do we do all our machine
learning stuff on premises we need a
bigger data center uh that also means we
need a bigger office
um we have the the main thing that we've
exhausted at this office is the power so
we're out of power
and we're gonna get a new uh office with
more power and a bigger data center
and the other thing and we could do this
with debt but
you know i think that
uh if you're the right person you learn
the details of the round you'll see why
we're doing it this way
um is purchasing parts in bulk
so the comma three costs us a lot to
make uh-huh i've you've seen me gripe
about this on many videos um the the
gross margin on the comma
is is lower than the gross margin on the
comma 2. this is very unfortunate so for
every dollar we we get in from comma 3
sales we keep less of it more if it just
goes straight out to our suppliers
but one way that we can mitigate this is
by starting to purchase in bulk uh
starting to purchase stuff in in in real
bulk
uh
so that's another thing that we can we
can do with money
ah
a new data center in plano i have a
bunch of bunch of guys chilling for
texas
i don't know
i think i think we're going to stay
right here in san diego
uh
i don't think we're moving
but yeah so that's that if you're
interested you know who you are
um
the main thing we're looking for is
people who are aligned with
a long-term value creation for the
future and are not interested in finance
scams
there's a lot of finance scamming going
on today you know
so we don't we don't do scams
uh we're here to complete our company
mission which is to solve self-driving
cars while delivering flood trade areas
so i think that's that announcement
i don't think i really have anything
else to
to just to say about that
uh
but yeah what is it oh
four things fourth day copd you know
it's easy to remember right i remember
my talking points right uh cars
office
parts data center
uh are all places where
we can expand
uh
in such a way that we can accelerate
the uh mission of the company i
accelerate the mission of the company
that's right right so so maybe two years
ago there wasn't really a way maybe a
year ago there wasn't really a way like
a bunch of people reached out to invest
and i was like well
you know really tell me how uh
if we raise more money
we can
accomplish the company's mission faster
and i got back a lot of bullshit i got
back a whole lot of bullshit about well
you could hire more people you could
hire people and pay them more money
god all you're looking for is ways to
you know you know it's like like like
more people people are a liability you
know
you know like we hire we we hire people
we're we have great people but it's not
about like something like what we're
trying to like oh well we've got to grow
i got to grow my influence in my
division so if i hire more people my
division gets bigger and i have more
influence you see none of that none of
that you know
com is a dictatorship right but you get
the benefits of dictatorship
um
yeah uh bulk orders how big you guys
haven't sold that many threes
uh on the order of magnitude of tens of
thousands
um
would you shifting to drones
no
no uh drones
you know
the main problem with people think that
self-driving cars there's some
regulatory barrier for them there's not
the self-driving car barrier is almost
entirely technical
the drone barrier is almost entirely
regulatory it's actually really easy to
make a drone that can fly from point a
to point b because you know there ain't
much to hit in the sky
uh the problem the reason we don't have
drone delivery services has everything
to do with faa regulation
uh nothing to do with
the practicalities of building it at
least i hope so i hope you know it's a
much easier problem than self-driving
cars i don't know maybe maybe we've
declined to a point where we can't even
solve that anymore
uh
the dictatorship eventually falls you
know so does the democracy so does every
form of government the trick is to you
know uh sow the sow the seeds when the
when the growing is good
uh does this round of funding mean we'll
have an actual data center now
what do you mean by actual data center
um
i learned the kind of cooling we use in
our data center you know it's like we
don't have air conditioners we just
bought a bunch of fans this is
apparently a real thing it's called free
cooling and facebook does it now too all
these suckers we're spending 40 of their
power bill on air conditioning all right
so no we're going to still have free
cooling um we are going to do we're
going to move the filters into the air
system and not to the front of the
computer so we won't have those stupid
filters on the front of the computers
anymore
um that's not a data center it's a
compute cluster we're never going to
have a real data center we're always
going to have a compute cluster and
that's for legal reasons
um can i officially call the data center
hell no sorry i should not have said
data center s you know data center slash
compute cluster g you know what i'm
saying
uh
so yeah there's that
um
nothing to hit in the sky or deploying
aliens as fake as where these people
come from
uh
why not equity crowdfund god what i'm
gonna go i'm gonna go on on on on wish
stalker or whatever those things are
uh
not for me
it's not for me
you know why cuz like you know
look we're gonna get like probably
really it's gonna be like five people
and i'm gonna talk with these five
people and if they're good reasonable
people they're letting to the round if
they say things that secretly let me
know that they're dirty bankers well
they're not welcome in the round um but
you know the equity with the crowdfund
things
that you know what i mean so you know
you know what i'm saying
um
no i'm not kryptos crypto
while it's not the bankers it's another
class of kind of gross people
i mean no you know what they're better
than the bankers they're better than the
bankers but
uh no we're never doing a a coin
um
so comma can never be acquired uh i mean
i'm
before and after this round i am the
majority shareholder and sole board
member
uh the only way comma's getting acquired
is if i believe there's a company out
there actually more capable of achieving
the mission you know you guys heard the
expression yolo you guys know what it
stands for
you know you only live once do you want
to live for bankers i don't live for
bankers
unless you know
build ai and save the world right
uh what is our vision stack going to
replace the car acc is comma a unicorn
uh no no
uh our evaluation's not that high i'm uh
i'm not a scammer right yeah
again if you're the right type of person
you reach out you get you get all the
details
and uh
[Music]
our evaluation is not a billion yet it
will be it well
here's here's an argument here's a
here's a simple argument for a billion
dollar comma evaluation right
so if we if our final version of the
device is a thousand bucks
and we sell a hundred thousand of them
per year uh that's a hundred million in
revenue with a 10x revenue multiple
that's a billion dollar company right so
pretty pretty straightforward uh
pretty straightforward argument um and
10x revenue multiple is small
for reference i think mobile i sold at a
42x revenue multiple
so you know maybe we're actually maybe
if we're actually selling 100 000
devices a year which is very clearly a
market for
um we're looking at
uh
more like a four billion dollar
valuation that sounds right yeah i think
that's a good
good sort of uh growth trajectory what
opportunities i kind of hate that word
everybody says the word opportunity
especially when people refer to things
that have like much more normal job much
more normal like terms like job and they
say the word opportunity like uh i don't
know
no uh more cars
uh
so we can you know like for example we
should have something we should have a
chrysler right we don't have a chrysler
right now and people buy the chrysler
and they have a bad experience like we
don't want that so we should have like
one car from every brand
um you know the great thing about the
great thing too about all these things
i'm talking about is they're buying
assets right they don't like like i'm
not looking to blow the money on
something stupid
you know what i mean
uh
i don't even know i'm trying to even
think like how these how these people
fall money it's it's just it's
mind-blowing to me
um
new cars are assets obviously they
depreciate
uh you could hire another deep if you
know another deep uh we'll hire we'd
love to hire
the problem is find another deep you
know
uh
we're always we're always looking
uh you're not rich if you're not rich
you get good private equity you
shouldn't play private equity
uh
the specs are disgusting and somebody
should come in and clean them up
but you know no no no no we gotta
regulate the cryptos but let the stacks
go uh that's what we get
uh
you're in a diva training ah well you
know you know how deep started he
started some import quests
um don't you need advertising to sell a
hundred thousand units
uh
how many cars does tesla sell and how
much advertising does tesla do all right
it's the same thing um what did tesla do
well tesla did the same thing that we're
gonna do right um you know okay the
common three is is is
something we say a lot around here is
the common three is the most expensive
uh sorry
it probably will be the most expensive
um but it is also the most complex
device uh comma will ever build the
comma three has a lot of things in it
that are overkill
um which are great
but you know as our stuff gets more
refined it turns out we'll be able to
make do with less
so
look at tesla right tesla launches the
model s great car but eventually in
order to reach mass markets they launch
model 3.
so we have to figure out what our
version of launching the model 3 is but
the trick is the model 3 in a lot of
ways is a better car than the model s
you can see the same thing with oculus
too right you look at the you look at
like the the rift uh i think i think
cv1 was 800 bucks
yeah yeah all right i don't think the cv
cv one crescent bag i forgot exactly
what they called it but uh you see that
you know and you can buy like a quest 2
now for 300 bucks and they're really
they're really i've changed my mind on
the quest too i love the quest though
uh i got i got a new strap
um that that improved it a lot uh i got
oculus link cable
but
um
[Music]
feces
making do with less is a super awesome
approach
that's a common right like so so tesla
tesla's cars um
you know the model 3
benefited a lot from years and years of
tesla's experience of building cars and
we're looking for something similar so
to come back to your question do we need
advertising to sell 100k units no we
need a better unit to sell 100k units
the common three is not going to sell
100k units
um the common three should outside the
comma two and
you know so on and so forth
uh i don't stream on twitch anymore
it requires facebook i don't read the
news
um
any chance of a blog post going over the
dm model you see a new thing about mask
augmentation that's coming out soon
uh will more more of openpod ever go
from python to being rewritten to c it's
almost all c now what part of it's nazi
every every like that's i'll say
uh fortunately for you tesla's now a
robotics company yo we were a robotics
company first elon stole all that shit
from me nah i don't think you stole it
great minds think alike you know but uh
we do use an efficient epi too
change its follow distance based on that
yo
that's such small-minded thinking stop
thinking like that as a human when you
drive do you think oh i'm in a dense
traffic situation i am going to lower my
following distance to two
right i look like mark zuckerberg uh
maybe that's how he drives um no no hate
for zuckerberg oculus quest 2 is a nice
product i take back all the hate uh
hints for calibration challenge
computer vision use computer vision
if you've thought about that um
[Music]
when's the next robot c3 is gonna be
stuck on the brain yo yo yo yo yo we got
that's what we got this thing for man um
we're gonna we're gonna stick a comma
three on a poll we're gonna we're gonna
figure out okay we're gonna figure out
look look look look um
uh cooks and cleans right how do we make
a commentary cook and clean
uh questions about this are if we're
gonna make you cook and clean
well
how many arms do you need
all right this body's probably good but
how many arms you need do you need two
well you use one okay
um
if you have
two arms or one arm how many fingers do
you need on those arms
eta level five all right
four arms i mean maybe you need four
uh
is there a chance the nav will take over
the whole screen
yeah we're hiring a designer um we
interviewed someone who's pretty good uh
and they're coming to the hackathon
and yeah eventually we hope for like a
unified the split screen is kind of
what's the simplest thing to imagine but
i think stuff can be done better
um
we're a robotics company oh we're a
robotics company uh
the common i mean
you can think of the car right now as
the comma body
all right comma twos connect to a uh uh
we have this car harness which connects
it to the car right but if we want to
attach it to a mop well what does a mop
harness look like we don't want it to be
generic for like mops and brooms and
knives and forks and spoons and whatever
else you use for cooking i don't know i
don't cook that much pots and pans and
stuff but what is the generic interface
to that it's arms actually wouldn't it
be funny if the comma body could get
into a car and drive driving you know so
i always say like people are thinking
they're building self-driving cars like
you're not building a car you're
building a person
um
any update on openpod 0.8.10. did you
watch the rest of the video
a little bit i'll be fully laneless yeah
0.9
um
oh oh maybe there's a lot of people out
there who don't know what come is and
advertising what comma is
will help advertising is for losers
uh building better products is for
winners
right
eventually if you build something that's
just so good
everyone will hear about it you know
what i mean
like you think they needed to advertise
refrigerators i'm sure they did
especially when there's competition but
if you were the only guy who had a
refrigerator your word get around about
that he's got cold beer
um
male
transporters i don't even know what that
is tesla advertises on youtube oh that's
too bad they should not
um
don't pay for eyeballs
don't pay eyeballs
all right
it's like the corporate version of
hiring hookers
uh
comma isn't user friendly enough for the
people that are hearing about comma from
an ad exactly so then you get to the
truth of it and the problem is not that
we don't have an ad the problem is the
comma isn't user friendly enough now ask
yourself this are we more user-friendly
than we were last year are we more
user-friendly than we were the year
before this starts to be a positive
thing to focus on right how do we build
something that is more and more
user-friendly and easier and easier to
use that's an engineering problem right
that's good solve engineering problems
that's how you save the world um
do you buy algorithms from china
yeah go to the shenzhen markets here you
got any algorithms
come down here you know it's right next
to the pangolins
um
then you can focus on advertising or you
could never focus on advertising that's
an interesting idea let me think of that
uh yeah we have a well-priced product to
sell the common three represents like
the flagship
comma 3 represents the
the high end it's nice that's real nice
it's not the iphone sc
you consider an ai on
it's bikes like sometimes i think you
guys are gpt3 you know
have you considered
sunscreen for cows there's a malcolm
middle episode about that
uh
what's your role in comma that's a
personal question
uh it is well priced i i yeah i think
the commentary is worth it for what you
get
but remember it's also it has to do with
like a market which evolves over time
right so like yeah um
advertising is scam it does not work i
mostly agree with that
uh also you have to remember who you're
enriching with advertising right like
some of it
if we ever even considered it it would
be like
direct with certain you know sort of
content creators who would want to fund
anybody anybody who's paying for google
and facebook ads it's unforgivable like
it's really don't do that don't starve
those companies
um
you know you can figure out how to
directly fund people it's like hey you
make cool content you know yeah yeah
shout me out maybe we'll see
uh
do any electric cars walking up
not yet
i mean the tesla's the tesla's yeah the
tesla's the tesla's though
uh
a bunch of uh you know hybrid electric
vehicles work you know
yeah
ionic and
you know prius plug-in hybrids and stuff
yeah yeah yeah prius prime that's that's
that's electric car right yeah i guess
you could i mean can you go highway
speeds with uh you can find the prius
yeah some people like fill up once every
like half a year if they have local
well yeah but can you get on the highway
even if you're going you're going short
distance all right cool cool
uh do you mind ethereum on your gpus but
you don't need to deep learn for extra
cash no because power is so expensive
here
um oh what's customer fund oh
uh you'll find out after you raise money
uh
you know it's just
we we want to make sure that that you
know they the comet who
uh
had
it was less reliable than we all would
have liked um you know it wasn't some
people make the situation out to be much
more dire than it actually is but you
know it's not perfect and it's a way
that we can improve
so the customer fund would allow us to
do something like you know if
hypothetically we ever did a a comma to
buy back uh maybe even if your comma 2
broke we would include it in the buyback
right now this you know we lose money on
that but it's you know it's like a
customer loyalty kind of thing so that's
that's where the customer fund is you
know
ethereum mining is insanely profitable
yeah maybe it is
it burns our gpus too like oh great
we're making 17 a day burning our gpus
oh
this ford's still out of the question ah
the new f-150 should work
the problem with ford is that it's only
available on the high trim cars
like toyota and honda is available on
all the cars and that's why it's a lot
better you're making
twenty four hundred dollars a month with
10x 30 80s
all right i will briefly do the math on
ethereum mining with our gpus in our
compute cluster and we'll see if it's
worth it
for the ctf
is it for the hackathon
is the cdf still going on it's a rolling
submission
oh yeah quality submissions yeah if you
haven't done the ctf yet go do it uh
you're still getting rid of the
hackathon yeah right yeah if you're
looking for a higher now
yeah yeah the bar is a little higher but
uh yeah if you haven't done the ctf yet
um
i'm better off buying eve instead of
mining yeah but that costs money
why not integrate with edge devices
i don't know what that means
integrate
with edge device do you know what that
means i don't know what that means i
don't know what that means sometimes
that you know
again again sunscreen think of all the
cows that stand around in the sun all
day don't they need sunscreen
um in before there actually is cow
sunscreen
uh
and not even proof of stakes
we're very excited at comma for proof of
stake because the gpus are going to be
cheap
what's up
alex seeing how things are going
yeah we talked a little bit about our
fundraising we didn't say anything that
would trigger the sec
we don't like we are we are we are
employers this week oh
oh my god lawyers um
what happened to cherry computer what
you guys like what did i did i raise
money did i incorporate a company no i
wrote a blog post you know some of y'all
no other reason i don't stream anymore
[Music]
[Laughter]
[Music]
all right
uh
uh
right now 17 of com is owned by
investors
uh
after this round it'll be about 19.
no we were talking about should we be
mining ethereum with our gpus when
they're not training i don't i didn't
even slow the wear and tear
yeah i don't know but what if it turned
out we could make like a thousand bucks
a day would that be worth it i don't
think so no even a thousand a day a
thousand day be worth i don't think we
can make a thousand today
our data center has like a thirty
percent utilization
oh maybe it's not a bad idea yeah i
don't think it's a thousand dollars a
day though i think it's more like a
hundred dollars a day and now it's like
all right we make 30 grand a month great
i mean it's not really worth it yeah
let's sell one more
i think i think we should just encourage
people to buy more um
torque interceptors
uh i have serious safety issues right
you know if you see someone you know
ever like like like posting about a
torque interceptor or how they got one
to work like
comma you know again we're about
we're we're 20 person company and we
can't build a torque interceptor
we don't have the we don't have the
ability to do the safety validation
required to like an asshole d level we
probably could but it requires a lot of
resources
and like it's unfortunately one of these
things that it's very easy to build one
but it's very very hard to build one
that's safe
and the amount of engineering validation
that goes into it right like like comma
has a safety model um and a lot of like
we can mess with our models we can
change we can change our ai models to be
whatever and they don't impact our
safety model because we're using a lot
of the safety that's built into the car
right we use the messages that the car
shipped with
and that the car is designed to use to
turn the steering wheel to hit the
brakes for a das systems
right when you start trying to hack in
adas systems to cars that didn't ship
with them
they put
the the the manufacturers and the tier
ones who make these steering racks put a
lot of effort into making sure those
things are safe
so you know i'd be really worried if i
saw
uh if you see things like torque
interceptors or things start to like
spoof parking modes um using these
things in ways that they were really not
designed for
like open pilot doesn't use the car in a
way that it was not designed for we just
put smarter
uh ai basically
in the camera to make better steering
decisions than the ones the stock camera
makes but if you start actually changing
what the controls look like you're in uh
you're in an area where you can have a
lot of issues with functional safety
um could a panda set off airbags
probably not
uh
there might be some ways to do it but
they would look more like exploits than
they would there's no normal can message
that will set off an airbag the sensors
are directly wired to the airbag
controller um airbags are another thing
that are sld
um
i believe it's azld to not have
unintentional airbag deployment
because you know again unintentional
airbag deployment you're likely to cause
an accident
um the same
is true with a bad electronic power
steering
um
in terms of processing power how big of
an improvement will the new compute
cluster be uh 5x we're looking at 5x
all right look at we're looking at 5x
and what's that what's the 2 million
dollar budget
so uh yeah
at 2 million the whole budget includes
the the build out of all the of all the
stuff we've spent about half a million
on the data center so far so yeah we can
get 5x with with 2 million uh actually
maybe even only a million but that's the
conservative budget
uh all right cool i'm getting asked
about baseball teams this time that's
time it's the end of the stream one
person always remembers it yeah yeah
yeah
yeah uh i did like houston i like boston
too they're nice cities but if you said
the yankees
all right bye george bye
so again thank you all for the video
submissions and uh definitely check out
the ctf if you haven't i'll put a link
in the video description you can still
do the ctf and uh we comma hack is going
to be i believe november 12th to 14th
right here in san diego so if you're
still interested in that definitely
check it out
and uh yeah congratulations to the
winners of the video contest and we'll
see you all in a different live stream
later
bye
[Applause]
[Music]
[Applause]
[Music]
[Applause]
uh
i did make a presentation that's gonna
maybe be up in a bit
i worked hard on it i made it in keynote
everyone else made it in google
present
oh comic-con keynote there we go that's
my name and that's today
uh we have a laser pointer and you can
go backwards oh and we can go forwards
but can we go backwards oh wow we can go
backwards and forwards that's pretty
cool
uh so we'll start at the beginning
uh
this is me about five years ago
i see a bitcoin mug i wish i bought more
bitcoin back then
that's the comma ui up on the screen you
can see we're detecting lane lines and
you know kind of making it work it's
still the engaged logo from star trek
um this was the original comma system
uh
it's been a long five years
uh had i known what this would have
ended up being i probably never would
have done it but to be honest
uh starting a company is is absolute
hell
uh
but you know when you start out with
things you don't know this right go into
a full tilt right there we go man comma
ai on the back of an acura ilx or a
license plate
right fuel on man it just means like
keep the keep the gas going bro
or
uh you know
um
uh so you know yeah we put this together
and you go for it it's like yo let's go
to the silicon valley vcs man you know i
was watching that show silicon valley
that's why it's called comma
hey if we're not having a good time
there's really no point doing this
um this is the original comma team
at an event self-racing cars
you know this was this was 2016 and a
lot of the companies back then were way
more honest and open
um
i think that this self-driving space is
incredibly sad
uh i said this back in 2016
uh we are going to win self-driving cars
it still kind of holds true
because you know i don't like losing
and why do you keep doing it right
there's no point you know there's
nothing you can buy with money uh
there's no there's no amount of like i
live a nice life
but i like winning and i want to win so
that's why we're here and you know i
appreciate that you all came out
i remember uh before this techcrunch
disrupt i was talking to my sister uh
and i was like saying like what i really
want to do is get up on stage pull my
pants down and take a shit
no really really because there's no
other way
like
to to
how do you compete when everybody's just
lying
and so i'm like all right we're going to
go completely over the top with it this
is all you need to solve self-driving
cars look it's in a neon grid it's a
phone in a neon green case
like it's kind of a joke but it's kind
of not
you know i think most you have used that
phone to drive a car i mean it's it's
kind of a joke kind of not well nishta
wasn't it on the kind of a joke so i'm
like you know what
canceled cancelled no comma three
uh uh i'm sorry no com whoa whoa
no comma one
the comma one was canceled
um
alex roy wrote this article he got a
test drive in the car with the comma one
and
the canceled comma one would have
embarrassed the car industry prediction
there will be a comma two
well this wasn't all this was in october
one month later we released openpilot
open source
really all the ideas start to come
together it's like we're gonna be the
android of self-driving cars if tesla's
the ios we're going to be the android
um
so this is open pilot 1.0 you can see it
has a lot less directories it i didn't
think i knew how to put pictures and
readmes back then we figured it out it's
pretty nice now if you go to
openpilot on github and as for alex
roy's prediction well
the open source software included the
neo
how many of you had neos
all right we got a few neo people out
there how many you had eons
all right and then how many you have
comma twos
all right nice to see
um so it took a little bit for alex
roy's prediction to be uh to come true
but we did ship a comma two
and it did embarrass the car
industry this is consumer reports if you
guys didn't see it
um
i mean
open pilot is is good
you know how i know open pilot is good
like i said i don't do this for money
i'm rich
i used to drive a mercedes s-class you
know like what other car are you gonna
buy right
but if you ask me today would i rather
have a mercedes s-class or a hyundai
sonata with a comma two
uh
i think that that one's actually better
right like that's how i know it's good
how much more does that car cost in that
car even with the you know egregious
price of 10.90 wow these things are
priced way too cheap we got to raise the
prices
what does it mean to be good
right so um
what's our slogan
meg driving chill
uh so we like to say the tesla slogan is
look at this crazy feature
i mean again maybe it appeals to a
different kind of audience but what does
it mean to be good does it mean things
like turning right at an intersection
well not really because like you just
don't turn right that much in your
drives like it happens every once in a
while but it's not that bad to do and
i've been in demos where the cars made
autonomous right turns it's stressful
it's stressful watching that wheel fly
in front of your face you're like do i
touch it do i not touch it is it gonna
do it i don't know i'm stressed out
right our slogan is make driving chill
so it's not things like this it's things
like this
so if you look coming up to that exit
you can see that the lanes widen and
what almost every manufacturer lane keep
does is it places you in the middle of
those two lanes
and you have an okay time right up until
you get to the fork
so
what it should do is if you're going
left it should bug the left and if
you're going right it should hug the
right but this stuff is really hard to
program in in ways that are reliable and
repeatable and you saw this as some of
this in in harold's presentation about
like okay let's say there was a dashed
line there right like it's just there's
there's so many variations and what
makes a system good isn't the crazy
things that it can do but it's the
things that it can do over and over
again repeatedly and well
that's what chill means to me so
uh
yeah that's what it means to be good
i remember
i was uh
2008 it's like the knights of whoppers i
would drive to burger king and go get
whoppers that's my sister she wanted to
come and go to burger king and you know
just talking about things and i tell her
you know it's like impossible uh to make
a computer recognize whether there's a
chair in an image or not
like this is a task that a five-year-old
can do and in 2008
computers just couldn't do this
and it was because they were using a lot
of this sort of stuff they'd run
something like a harris corner detector
detect corners
compute some orb descriptors and then
come up with some like hacky definition
of what a chair was based on some weird
nearest neighbors thing maybe
it just doesn't work
right
so how do you actually detect chairs and
images this is a trivial problem i think
i think even a five-year-old can write
the code to do it now
um
you know yeah import
import torch magic
uh torchmagic vision.predict and there
you go and the way that this of course
works is they uh took lots and lots of
images
and they labeled where the chairs were
and then they trained a neural net which
uses this algorithm called back
propagation
to
improve the weights or the program
that's actually detecting the chair the
program is learned the program is not
hand coded
now
you say no no no no but but waymo
learned this lesson right they're not
doing the stuff on the left they're
doing the stuff on the right right
they're they're they're getting neural
nets which put boxes around cars they're
fully deep learned
yeah but like can these people think a
little higher in abstraction space
what's the meta lesson here
right for the task of prediction it's
end to end but the task of prediction is
not the task of driving
right it's unclear how you go from
prediction to driving why why is this
lesson still not learned and why are
these companies hiring cone guys
well like really right
you're gonna get you gotta dive into the
taxonomy of cones you have small cones
you have large cones what does it mean
if a cone is squashed what about the big
cones like this what about the thing
outside with the you know is that a cone
i don't know
gotta hire the cone guy for that right
um so yeah the lessons really uh not
learned
uh
one of the things we say at comma one of
the questions we ask all the time is
will this be in the final system
uh you know i find it people are like
i'm by the way we're proud level two at
comma we're proud level two for two
reasons one because the higher levels
don't say anything about capability they
only talk about liability and we don't
want liability obviously but
you don't want things higher than level
two either do you want to tell the
machine what to do or do you want the
machine to tell you what to do
right what the higher levels mean
is you're no longer in charge you're no
longer driving the car and like some
people might be okay with this like i'm
not i prefer that machines work for me
and that i don't work for machines
which is kind of you know
that's long and philosophical but uh
you know we're level two forever but
there's no reason that a level two
driving agent should not be a superhuman
driver there's no limit to it's like
well it can't be too good it's only
level two no way so we always ask the
question when we're building something
and you saw this this morning with the
end to end stuff it's like
will this be in the final system
uh so this is a real story uh
from uh
a secret internal source
at that company
um
they had these cars and they were
driving this little loop around
pittsburgh and they really got the loop
working well in the winter it could
drive the loop most of the time without
a disengagement
um
but in the winter
well
the bike racks looked like this
right car drove by fine on the street
and it was all good but then spring came
and the system stopped working the
system stopped finishing the same loop
that it could do in winter and they
checked all their hd maps and they were
all good it was a localization issue
the bike rack didn't look like this the
bike rack looked like this
now
if you're trying to build a system that
individually picks out each bike then
runs a complicated prediction model on
what that bike is going to do
how big is your
computer this of course isn't how humans
do it at all
right humans just look at those things
they're like oh it's a bunch of bikes in
iraq
uh so
well what did uber end up doing
they put that area in the map as an area
with a bike rack and they said don't
detect any bicycles in that area
we all know
all right oh we won't we won't talk
anymore about that but uh you know will
this be in the final system is a real
question and a hand coded this is a bike
rack don't detect any bikes in this area
would never be in any sane uh final you
know superhuman driving system
another question we ask is is this how a
human does it right
um so when we think about like we're
trying to like do some tasks we think
hey you know let's let's think about how
a human does it because humans are the
only
implementation of driving today
people talk about how humans are bad
drivers
humans are so much better than every
self-driving car out there available or
not available today do you know how i
know that because the second that flips
everything's going to be self-driving
but we're nowhere near there yet right
so like people are like oh humans crash
cars humans almost never crash cars i
saw a good graph i probably should put
in here was a pie chart of like during
your commute how many times you crash
and it was like a thousand times no
crash
maybe one time crash maybe maybe a
million times no crash one time crash
um
humans crashed cars very rarely
so
there's only one safe policy for driving
um and it's not just ask how a human
does it because a human probably does it
in a good way
everybody in self-driving understands
that you want to build systems that are
capable of predicting what the cars
around you will do
but you do understand that humans are
writing that exact same algorithm
humans are trying to predict what all
the other cars will do and they're
assuming implicitly that humans are
driving them so driving with an inhuman
policy is dangerous
right
you can say oh yeah but technically you
rear-ended me you have the liability
yeah but if you slammed on your brakes
in the middle of a highway like you can
make that argument but you still crashed
there's only one safe policy for driving
and that's the human policy assuming you
want to inter-operate on roads with
other humans now you're going to get
some wacko utopian people who are like
we're going to replace all the humans
with bunk people and
um you know we'll put the bug people in
the cars and the bug people drive
according to these very very rigid rules
but you know this is
well i don't know
i like driving
take it away right there's only one safe
policy for driving that's the human
policy
this is our mission
solve self-driving cars while delivering
shippable intermediaries
a cool test that i like to use about
whether somebody is saying something
is ask the question of
what else they might be saying right
like does the opposite of this make any
sense um you know if some politician
gets on the stage and says we care about
the children could you ever imagine a
politician getting on a stage and saying
what you know the children aren't that
important to us
no of course not um so
what's in this mission
is very clear about what we have to do
but it's also clear about what we're not
trying to do we're not trying to
deliver a return to our investors sorry
investors
um
we're not trying to
uh aggrandize ourselves with
self-importance by throwing big events
with lots and lots of poi um
uh no we are we're here to have a good
time too but fundamentally this is the
goal of our company right and it makes
it very easy for everybody to be aligned
the amount of political
how are we winning
if you believe we're winning how are we
winning what are these other companies
doing wrong and they understand some
technical stuff wrong but i think they
also understand some philosophical stuff
wrong this is our company mission solve
self-driving cars while delivering
shippable intermediaries
uh and that brings me to the next
slide business
so comma is a business
that is our goal and that is the mission
of the business but comma is a business
and we do have to operate in the
business world uh this is a quote from
my uh self-driving uh my 100x investment
blog post it's so sad it's really it's
really so sad how
[Music]
yeah um and it's because business
selects for psychopathy uh maybe you
guys saw the nicola founder was was
indicted
um
yeah you know he he he uh told and he
told the world that his truck fully
worked but actually what he did was he
tilted the camera a little towed the
truck to the top of a hill and had it
rolled down and didn't put a motor in it
right even boomers understand that's a
scam
right
um
so you know it's always nice to see that
but it's these these scams that are much
more intricate that you don't exactly
you know it's not exactly clear to point
to the scam but when you just look at a
company that's raised 10 billion dollars
and has no revenue and now is like we're
gonna do an ipo
like it went from companies aren't
profitable to companies don't have
revenue to companies don't have users
right so
i promise this is the downer part of the
talk
the the stuff that i really like talking
about is coming up
um
so the fundamentals of us as a business
uh we've raised 8.1 million dollars
uh we've made nine million dollars in
revenue
the next milestone here is to have over
8.1 million dollars in assets
and the next milestone after that is to
have over 8.1 million dollars in cash
because then undoubtedly we've created
something right and i like that i like
that from a business perspective like
figure out how to you know
make money
um
we sold five thousand comma twos
uh this is now the majority funding
source of the company and it's great
because we're aligned with you comma
wants the same things you do we want
openpilot to be better you want
openpilot to be better we want to build
better products you want us to build
better products this is the beauty of
capitalism when it works
right it's like
you're 3 500 weekly active users
this is a wild statistic in the context
of how many we've sold
over 50 percent of every piece of
hardware we've sold is still being used
every week the only thing that i know
that competes with that is like
appliances and mobile phones this beats
laptops this beats game consoles and
this crushes virtual reality headsets
the average use for a virtual reality
had the average number of times people
use a virtual reality headset is one
right
fifty percent still in use over over a
three year uh we sold about two thousand
eons
um so it's it's over fifty percent
uh still in use
these are our shopify numbers uh
i challenge other businesses out there
to start doing this
uh post this screenshot from shopify um
you can see our sales going up you can
see our average order value is going up
and you can see our total orders are
going up
um average order value is a important
one that i like because these things are
going to get more expensive as they get
better
um
a lot of companies if you're really
talking about the kind of smash and grab
approach or like the exit scam you see
in a lot of companies what they'll do
with their hardware pricing is they'll
price it very high at the beginning
capture the early adopters money who'll
pay whatever they want and then lower
the price over
time i'm not doing that
we price it and then we raise the price
and we've done that with every release
um you know the comma 2 went up a little
bit in price
uh so yeah the the order value goes up
over time but we also think the value
that openpilot delivers has gone up over
time would you guys agree
yeah
[Applause]
so weekly devices by type
uh so you can see our weekly active
users about uh the 3500 we talked about
one of the things that i like here is
this yellow line here is the comma two
so most of our users are on comma twos
uh which to me signifies that we've
actually delivered uh uh enough of a
better experience uh for people to
upgrade
um
we did we did uh sadly deprecate the
original eon but we offered free trades
to everybody just pay shipping to eon
golds if you wanted to stick on the old
system we do want to support this stuff
for as long as we feasibly can but
remember you know i'm not a no child
left behind guy i'm a gifted program guy
uh so you know
we do want to push the high end and we
especially want to push the experience
for uh
you know all the
the majority right the needs of the many
outweigh the needs of the few it's a
vulcan quote
we are comfortably in control of our own
destiny
um
this is nice this took some time we're
not ipo'ing we're definitely not
spacking we're not selling out to
bankers
uh i'm i'm the majority shareholder i'm
the sole board member and i am 100
committed to the company mission i've
never sold a share
uh
my salary 78 000 a year
uh i don't care
it doesn't it doesn't really matter
right and this is an important thing to
realize right like i think about how
good my life is i live in a beautiful
apartment in downtown san diego and my
life is good because i have things like
hvac
you're the king of france you couldn't
get hvac you could order all your
minions build me an hvac system and
they'd be like
want to invade poland what um
so we're comfortably in control of our
own destiny and we are committed to
making better and better technology
every year
why don't we work with car companies
we get this question a lot and sometime
i'll give some flip and answer about how
they're hard to work with
but there was always just something that
like
never sat right and i think i can put
some good business terms on it now since
this is the business section
uh so this is the gross margin in
automotive it's 18
right automotive is mostly a you're
going to like grind out for these little
margins you know the dealers take their
cut it's a very like protected industry
um you know that's like like look at
tesla trying to get their direct to
consumer model working like the
dealerships are protecting their little
cut
and you you don't want to be in a place
where everybody's fighting over a small
piece of the pie
you want to be in a place where a large
pie benefits everybody you want to be in
a space where the gross margin is high
because it lets you it gives you room to
experiment and like have fun and like
build cool things
um so the gross margin automotive is 18
the gross margin in consumer electronics
we're an aspiring consumer electronics
company
oh like this isn't comma's transitory
business model look we're not going to
be selling dev kits forever
but
well
let's talk about our total addressable
market more business trips you guys
um we support over 130 cars
that's over 50 percent of all new cars
sold in the us
in numbers that's about 8 million
compatible cars per year there's about
25 million potential existing users this
is in the us alone
uh
that's 0.02 market penetration to date
we have a huge addressable market right
is it always going to be a dev kit that
you self-install that you have to know
what a panda is no
it's going to be a consumer electronics
product it's going to be like a
well
let's just say if we build this
i can easily see a 1 million devices per
year market that's like five percent
market penetration that's nothing
at a minimum of a thousand dollars each
you guys know what a thousand times a
million is right
[Applause]
um
this is i'm bringing back an old comma
slogan we're going to be so rich
we also briefly made comma gym wear like
a tank top it said we're going to be so
ripped
um you know this was a good pitch to the
investors but this is that's
kind of true
comma is defining the next device class
of consumer electronics
right the smartphone the tablet the
portable media player
uh the laptop right
the
advanced driver assistance system
i don't know if there's a better name
for it but you know we want to be the
android i don't want to be the only
company building this hardware open
pilot's open source i think in the next
five years
we're going to see a ton of these things
start to pop up because the total
addressable market is huge the potential
for profit is huge
and like i said
her company mission is to solve
self-driving cars the more people we got
thinking about this stuff the more
people who wanna
it's not working with us right it's not
like it's not a partnership it's not a
sketchy backroom deal it's like here's
who we are come play in this beautiful
ecosystem we're paving the way for you
right maybe one of you out there maybe
one of you out there is making you know
action cameras or some some again
there's another consumer electronics uh
device class
right
build a open pilot compatible device
let's live in a world where there's 10
of these to choose from
right and i've seen i've seen a few cool
things you know i'll give a shout out to
blue box they launched a kickstarter i
think their device is a little too cheap
and a little underpowered
but
it's the right idea
um
i know i'd love to see a world where you
can just like android phones you can
pick from a whole lot of these to choose
from
all right
that's the business section
now the stuff that i like talking about
i told you to get more upbeat
that's a picture from a coma too
you know what question i get asked all
the time
george
how are you going to solve self-driving
cars with one camera
um
well this is the comma two camera and
it's like pretty good you can pretty
much see what to do on that road but
what if there's a car next to you and
it's a little hard to make out what's
going on in the distance so no the comma
two
now we can say it the comma 2 is not
good enough to build a level 5
self-driving car out of
i hope you all knew this
right
it's a driver assistance system but
you know
we do want to get
better like i said
we're not stopping oh they're going to
stop come ai only does highway
do it all
there's no distinction
but we are going to need
more cameras
who's ready to count
one
two
three
uh
[Music]
man i always wanted to do one of these
you know
[Music]
all right
uh so th this is the comma three
uh you know you guys can see
a few changes
it's nice and slim
the display is stunning i don't want to
talk about how much i'm paying for those
displays
it's more than the whole like
you can see navigation
on the right
uh you know you see the basics the the
open pilot interface on the left
uh you can see down here we have this is
185 degree lens
uh infrared these are the same two
infrared leds uh that are on the comma
two so you get that same great nighttime
driver monitoring
this is what the device looks like from
the back
uh yes we finally made injection molded
cases
they look nice
um you'll see that we have two eyes
uh but not for binocular not for stereo
vision stereo vision at long distances
is relatively useless although this does
exceed the human baseline so if any of
you we're wrong we got the stereo we got
the hardware for stereo uh in here again
like i said it's useless but what it is
useful for is you can see the two
cameras on the back have different uh
lenses so that's 185 degree lens on the
right and that's like a 45 degree lens
on the left so you can see objects that
are really far away
um
speaking of the cameras they're really
good uh
1080p oh but george the eon has a 16
megapixel sensor and it does so why is
this only 1080p
the eons lens can resolve about 0.5
megapixels
it's not about how many megapixels you
shoved into your sensor it's about how
many you can reasonably use and resolve
um this sensor has you know what's the
benefits of less pixels looking i could
put i'm paying a lot for these sensors i
could put a 16 megapixel sensor in there
but you're not going to get better
pictures
your picture quality has a lot to do
with how good your lens is
and how good your uh
how big your pixels are right bigger
pixel more light
uh more light equals less noise uh so
yeah these are uh
there you can also see that the lenses
are fixed focus
uh so one of the big problems with the
the comma two data is it's kind of
blurry uh especially when you're like
braking hard or when you're the way that
it works is the lens is on this tiny
spring and then you have like uh like a
piezo as a like actuator uh to to to
press on the lens uh here we don't have
any of these we focus these at the
factory at infinity
um the depth of field is plenty to
capture everything you need
whew
all right um
so about 1080p uh 120 db of high dynamic
range
uh so that's up from 85 in the comma two
uh two 185 degree lenses for full 360
degree coverage yes we can see all the
way around the car
narrow cam for far away uh the human eye
actually doesn't have sensors equally
distributed throughout the eye you have
a center of the eye called the fovea
which is a very dense
area digital sensors aren't like this
digital sensors are in grids but you can
mimic this by using two cameras and
that's why the device has two cameras on
the back it has a fovea and it has
a the fovea
i'm sure there's a word and some
optometrists would know uh
it's a
r0231 automotive sensor there is a zero
two three three you cannot buy it this
is the best sensor you can buy
it's two generations ahead of teslas
um
[Applause]
let's take a look at some pictures
uh this is me and alex chillin on the
five
um
look at the upper left you can really
see look at look at that road texture
that we're now capturing
uh
full 360 you can see that down here you
can see that
front pillar
we didn't consider this when we did the
balloons don't pop the balloons
uh yeah you can see uh
you know the driver monitoring
uh captures a whole lot more so there's
no more fiddling with your device like
aim it in the right sort of way
uh
to make sure it sees your face it always
sees your face it even sees whether your
hands are on the wheel
uh oh by the way it also sees next to
your car
right so if there's like a sammy dexter
we see it now we see everything
this is its performance at night
yeah
that's what those big pixels get you
look at how in the narrow picture you
can't even see that car right there
um the the gamma curve on this uh
i don't know about the gamma curve on
this screen it seems pretty harsh but
you can easily make out that car on a
computer screen
so that means the net can as well
uh
driver monitoring at night with that
infrared
uh
yeah
nighttime pictures
it's not a cell phone
we used zero cell phone part well i mean
it depends what you mean
you use a snapdragon 845
qualcomm's chips are half the price and
more performance than nvidia's a lot of
people don't use qualcomm because uh the
software is nowhere near as like there's
no easy sdk to use qualcomm
so like the snapdragon 845 uses a
completely different camera the hardware
is completely changed from the 820. yeah
we reverse engineered that one too it's
in camera two and open pilot
um so it's great that we can use the
qualcomm chips and we plan to stick with
qualcomm really all the way to the end
uh wi-fi and global lte connectivity so
it has the same connectivity as a cell
phone uh of course that works with comma
prime it's got wi-fi it has bluetooth
too we don't really test it so you know
well not good as bluetooth but
uh no i'm sure the bluetooth works
we did test we did test the antennas we
got this device fcc approved the device
has an fcc id
um
a 2160 by 1080 oled display
uh
no more no more issues with sunglasses
and did you polarize it diagonally no
it's not polarized it's an oled
i hear it actually might still be
polarized but it works great with
sunglasses
um now the display is really stunning
you know you guys know the beauty of
oled the blacks are actually black
there's no bleed there's no local
dimming there's nothing like that it's
actually uh
we went above and beyond i should have
included the video we calibrated each
oled display we had all this code to
calibrate the camera for colors and it
was pretty easy to also just do the
display so every display that goes
through our factory we put a uh put a
little camera on top of it and calibrate
it to the uh to have the exact same
color response as every other comma 3. i
believe even apple doesn't do that um
apple you can and apple's very good
about this apple has some of the best
displays in the industry we actually
take the time to calibrate it
that's the cool thing about having 58
gross margins we can do things like this
that are just kind of
you know above and beyond another thing
that's above and beyond uh
yeah
we put a real gaming has this d in there
like like why not it's almost the same
price per gigabyte as sd cards but why
would you use a crappy little uh oh it
writes
did you buy a class 7 or a class 9. no
we bought a samsung 980 nvme ssd you
guys will see we have some interior
pictures coming up high precision gps
same one as a comma 2.
and
obdc port same as the comma two the
harnesses are compatible uh so it's the
exact same harness if you do buy a comma
three you do not need to buy another
harness we include it has a right angle
cable the cable's a bit nicer
but that's included in the box so you
don't need to buy harness if you're
upgrading from a comma two uh it also
has a usb 3.1 gen 2 port
uh so
finally we have real expansion
capabilities on this device uh you're
actually going to be hearing we already
have one
expansion a device being also maybe
announced later uh but uh
this usb port is capable of streaming
out the entire sensory on the device so
the five gigabits of bandwidth would
allow us to stream all the cameras in
full resolution if say we wanted to
attach an external i don't know gtx 3090
to it uh to run some really huge models
um also
just because it only cost a dollar uh
that's also a display port
so you can connect it to a big screen uh
some of you guys want the comma screen
you can do it
uh
you're gonna have to get the west then a
little software but the hardware works
so yeah
this is the front of motherboard um
you can see this is the 845 som
uh
the
we have a heatsink which sits on top of
that you know one of the problems with
cell phones the comma 2 runs hot
uh the comma 2
the
uh it's very hard so the processor on
the comma 2 faces the screen
in a cell phone it's really hard to deal
with heat because the only place really
to dump that heat would be in the user's
hand so they try to dump it out the
screen but it doesn't work that well
um you know it's glass it's not metal it
would make a glass heat sink uh
so we can put the heatsink right on top
of well right on top of the memory which
is right on top of the processor
um but in the stress test the comma twos
get up to 90 degrees
uh celsius
in the stress test for the comma three
which is when we run it at full tilt
they range between like 60 and 65.
so they they run they run 25 to 30
degrees celsius
colder at full power than the comet ii
and it's because we can shove the
heatsink right on there uh so uh well
we'll get to this in a minute there's
still a little android in the in the
phone in the thing uh in the device but
we keep it in that metal box there
uh we keep all the android in there
don't worry there's a there's a cover on
it it holds the android in it's the only
way to get an lte modem we stuck a great
lte modem that's that's the global
edition
uh we've done some some speed tests
you're getting
uh i think i've seen it up to like 80
megabytes a second
um 80 megabits a second
it's lte and it's good uh part of the
reason it's good also is um you know a
cell phone has these like crappy little
antennas that have to go through your
hand we have two big antennas on either
side with ground planes behind this and
you know user's not touching it so the
lte reception is great
uh that's the front of the motherboard
uh this is the usb 3.1 port this is the
obdc port there's a daughter board which
sticks on top of here that i don't have
a picture of it has super capacitors on
it
uh so you have about five seconds of
power after you pull the thing uh this
lets us write the logs to disk in a safe
way it also gives us time to alarm if
the device does immediately lose power
so it's the best of both worlds it's not
a battery it's a capacitor uh and you
still get
some power uh after if the if say your
car uh catastrophically loses 12 volts
uh you still have some
uh
you don't immediately kill the device so
yeah that sits right on top of there
there's a speaker also i should have
gotten pictures of it uh two digital
microphones
uh
you know
everything i like they're like little
people
two eyes
two ears a mouth
a brain
an lte rate well
[Laughter]
this is the back uh there's that uh nvme
uh that's the display connector
underneath there is the uh ir led driver
this is a panda
uh so you guys know what the panda in
the comma two was called right does
anyone know the code name
the uno
uh this one's a dose
just a dose
uh got a sim card right here rtc battery
audio codecs
sourcing for these things
you know you guys know about the
pandemic sourcing and like like
we got it
uh yeah these were these were one of the
parts that was tricky to get
um open pilot at launch
uh if you guys have been watching the
code base this is tc
it's already better than the comma two
with zero eight seven
and this is for two reasons
uh it's not due to training we've barely
trained on any comma threes but
the
fixed focus of the camera
means that it never goes blurry
and the processor is eight cores instead
of four cores so every open pilot
process practically has its own core uh
so your timings are much more consistent
your focus is a lot better so open pilot
is already a better experience out of
the box uh
agnos a great new operating system no
more neo s it's ubuntu 2004 based all
apt-get just works
i did i did one of these devices like
how did that work don't we have the
system partition mounted read only uh
and like my the reply on slack is like
no no we added a hook it mounts it read
write and then it lets you apt get
something and then it mounts it read
only again i'm like that's so nice
this is like a nice development
environment this is a ubuntu 2004
computer as far as i know we're the
first company to ship a qualcomm device
with linux
and navigation alpha is ready
that's not a mock
this is the whole reason we built comma
prime
you think i wanted to deal with um
carrier i can't name uh and write a
writer like sign a contract to like
resell some no but we got to ship
navigation to you guys i mean you need
navigation if you want to solve level 5
self-driving or superhuman self-driving
or anything no liability
and you know what i'll be honest about
how good the navigation is right so if
you kind of rank these like carplay
android auto
how many of you use that for navigation
and mostly it's pretty nice right um
then maybe in sometimes you'll rent a
car and you'll use phone and cupholder
navigation um and then sometimes you use
the uh actually i don't know you'll
never use the built-in oem navigation
you'll always use the phone and
cupholder right
so uh the comma three nav is better than
phone and cup holder
um
so and then once we do ship uh navigate
on open pilot i think then maybe
we can jump that but there's no way to
jump that right now it is i'm not going
to lie to you and tell you it's better
than than carplay but it's a very usable
experience uh more so than your phone
and a couple there you'll be hearing
more about this in the next presentation
you want to stand up
everyone who was in epot
i think seven of the epot people made it
out here
um
these people have had the device for
four months they've been testing it
giving us feedback we went through two
revisions i now release you from your
nda so feel free to talk about your
honest experience with the device
uh is it perfect no but a lot of the
bugs are software uh and it's now
now it's good
four months ago it was kind of meh six
months ago
maybe fifty percent of the time it would
work now we don't even have combat twos
in the car anymore uh you guys saw maybe
some of you saw on the stream our leak
user admin screen where all the cars had
comma threes uh so this device has been
tested in the field for months we've
done way more testing on this than we
did on the comma two
um
we also ported over all our factory test
uh infrastructure uh from the comma two
to the comma three so these devices all
for example have a 24 hour stress test
we test every sensor we test the
microphones we test the speakers we test
everything in this device uh you know
our goal is really
as we go forward to drive reliability of
these things up to the point that you
know someday hypothetically if you ever
have a comma seven the thing's never
gonna break but the comma three should
be a good bit better than the comma two
on that front
uh so yeah
thank you epot
now who knows what this slide is
what do you think's on it
69 420 yeah
uh this is the price slide
three thousand dollars
now they started 21.99
double the comma two
uh starting at 21.99 now there are two
variants of it so before you you know go
on your phone and place your order right
now
uh
you may want to wait to hear what the
other variant is
so yeah these devices are not uh it's
not a pre-order uh this is
pictures from our factory this week
uh they're already uh in production and
the first ship date is thursday
now if you want to be in on that first
ship date
well you want to buy the cross country
edition
uh the cross country edition has one
terabyte of storage it's the high trim
so if you guys like that like king ranch
f-150 it's like this is the
cross-country edition uh
it comes with this sick looking boot
badge
um and it ships first uh so all orders
are first in first out but there's a bit
of a priority element to that we fulfill
all one terabyte orders and then we
start fulfilling the 250 gig which is
the 21.99 base model this one's 27.99
uh so yeah those are the two models
the site should be up right now
uh first in first out
and this is the uh
this is the comma three
thank you everyone uh you know really
i'm super impressed with the team that
built this
uh
we have really
you know the the people on the comma
team now i mean you saw some of them
this morning
it's uh
it gets harder and harder to beat us
every day
uh
i'm starting to think we're going to win
i'm starting to think
i wasn't an fsd beta i'm starting to
think we're going to beat them
sorry i think we're going to beat
everybody
ah
yeah
there's a bunch of common threes in the
back uh for you guys to actually go and
check out and touch
actually
i think i might have one
right here
it comes in this beautiful
stealth black box that it will ship in
so when it shows up on your uh you know
doorstep it doesn't say 21.99 on it um
see the cross country badge is included
on the leaflet as well
uh this is the most complicated text
we've ever shipped shows you how to
mount it
and then whoops right under here
you'll see an actual comma three in the
box
yeah
um in here
you'll find the accessories bag
just get this open
i'm sure someone will do a much more
beautiful unboxing
of this device than i can
and you'll see the accessories bag here
which is what includes the harness if
you order one or if you don't order a
harness it's just the mounts
a bunch of stickers
uh adhesive and this right angle cable
this bag doubles as a carrying case for
the device so if you do want to take it
off your windshield you can put in this
beautiful microfiber
cloth
so that's it that's the common three now
i think it's time for questions
all right guys i picked the wrong day to
wear shoes covered in spikes
it's not my birthday
all right
[Music]
it begins
um all right
we got a question up top first great
looks terrific george uh congratulations
to the whole comma team um
my question is are the harnesses the
same for the comma two as they are for
the comma three absolutely if you have a
comma two uh we even made a special uh
video of chris made a special video uh
for upgrading from the two to the three
it's super easy it's the exact same
harness so all you need to buy is the
device
i will say that the site is now live
sweet and we will be shipping first in
first out
so that's your chance to get first in
line
um we got a question up there
go for it yeah
hey so um
that sounds so boring what am i going to
get up here and show you sexy pictures
of auto insurance
i can't believe that's the first time
we've heard that
listen listen
that's great and they can do that
they're welcome to they're welcome to
play in our ecosystem we we're not going
to tell them not to
but but after we solve self-driving cars
let's solve home robotics and agi i
don't know insurance sounds boring
you know the comet 3 is a it's a little
head kind of you know
i'll take it out it can be it can be
touched
um
all right i got a question back here
george you guys see the similarities
two eyes two ears a mouth
a usb por
what power goes in right
all right i got a question back here
hello what are the biggest challenges
with building a world-class team and how
do you and comma overcome these
challenges
uh basically
we do very little outreach
mostly reach in
and you can ask yourself this question
do you want to scam for the rest of your
life or do you want to come here and
actually build something
that's it and people show up and they
want to build something they got skills
they're motivated welcome to comma
um is there anything different about the
cross-country edition other than the
storage and the uh and the badge like do
you upgrade my car's warranty here
um
i i would uh cross country is also
included right here
the cross country edition has enough
storage for an entire drive across the
country that's why it's named
the cross-country edition and it it
ships first
and uh yeah cross-country edition
[Laughter]
they're both great they're they're both
a great choice
hello
i already ordered my comma three thank
you great persuaded um
this is who funds our
company uh so i'll preface this with i
also think he's completely insufferable
but why so much shade for elon
what what shade did i throw at elon
look i know i actually have a lot of
respect for you i seriously do um
elon
is a man who has a positive vision for
the future
and that's what we need more of today
uh
elon can talk about the future in such a
way that it's a future that i want to
live in
uh so you know we're just playing you
gotta have a word of the adversary right
if he's sherlock holmes on moriarty
all right we gotta we got a question
upstairs but mori already respects you
know mr holmes
hey jonathan
hey george
nice nice product uh what's the
kind of benefit of having more storage
like practically we can
oh just stores more stuff
like porn
the driving performance is the same on
both devices you can choose which one
you want to buy yeah um another question
uh is there a new trading program for
existing users of some sorts
not yet so
we made
i'm gonna say never say never but
probably not yeah so you know where
we're it's not like we have a warehouse
full of thousands of these uh we are
building them as we speak so you know
maybe someday if we have excess uh
capacity but they're you know they're
kind of hard to make and like we make
them we test them we reject all the ones
that fail even one test
uh
so you know they're going to be probably
fairly limited supply for a bit um maybe
after that changes we'll see oh with
respect to the comma two uh so we still
have i think it's 791 comma twos in
stock uh we're not going to stop selling
them
um the comma two from today is going to
be supported for one more year
uh so there's going to be one more year
of open pilot updates it's not going to
get features like navigation
navigation's hard to make work on the
comma 2 the processor just doesn't have
that much more power but things like
enter and longitudinal will likely come
to the comma two as well uh no promises
but we're not gonna artificially you
know things that are easy for us to make
work on the comma two we'll also work on
the comma two and there will be at least
one more year of core open pilot
software support
thanks i got a question all the way in
the back in the center what's up george
awesome products thank you is the c3 so
is the storage
replaceable and upgradable by the user
wow
yeah we gotta go to the picture
oh these take
i will warn you that actually these
drives the reason we use the samsung
drives isn't just because i'm a nice guy
uh it's because um
most of them are egregiously bad at low
power modes
uh so i mean you can change it
but
when your device you know kills your car
battery
uh you can check it all you can check it
all it's not as easy it's not like you
know you have a desktop where power is
effectively unlimited um
so yeah you'd want to make sure that
whatever drive you put in does work with
uh
low power modes but you know that's a
that's a pcie
slot
uh
if you put anything in there we test it
with a google coral as well if
hypothetically we want to put an
accelerator in there
great
uh this is a question about the driver
facing camera in the sensor fusion stack
so it seems like the uh car frame is
going to be possibly a factor
uh that that's invariant or not
invariant across card designs how do you
intend to get around that when fusing
the cameras
um so
probably the same way we do everything
which is big data uh as long as we
i'm so sorry
as long as we have enough data from
enough users the models will become
invariant to this um maybe we'll re-hash
back to one of the things how does a
human do it
what it's kind of it's not that big of a
deal
um let me just say so i also already
ordered my cross country edition
right here
do you see there being plans for some
kind of like century mode um of way of
like
with that expanded storage
uh
next talk we'll kind of get into some of
this stuff so remember that every
resource comma puts on something that's
not self-driving is a resource that's
taken away from self-driving
uh so you know it's not
high on our priority lists but this
stuff does still have to be usable we
have some cool announcements in the next
talk
hey george congratulations and uh
just wanted to ask you to touch on the
boot time or the boot time uh
well you know it's not you guys know i'm
just a cheerleader right like i'm just
the guy who comes up and presents these
uh
so you know it's really congratulations
to the team
uh the boot time
is
it's been a while since i've used a
comma 2 but i think it's better it's not
too much better and there's a lot more
that we can do here that we couldn't do
on the comma two uh so for example the
comma two is a leica with a locked uh
you can flash whatever kernel you want
but the bootloader is signed
there's no signing enabled on the comma
three uh so we can go all the way up the
stack and our goal is to get boot times
down to five seconds but that's not
hardware that's software uh so you know
it'll get better over time i would say
now it is at least as good as the comma
two
all right i'm coming for you
we are one of our things at comma is
always no regressions no regressions no
regressions
yeah so i was wondering about the uh if
you look in into the commercial use case
for this because it seems like it it
would be very interesting for fleets and
also given that
it seems like people are asking
the uh the self-driving ceos about uh uh
crypto i'd be much more interested to
hear your thoughts
than uh someone else's
uh
all right so
what was your first question
uh so it's limit two per customer right
now uh due to limited supplies but that
will go away i think we'll do the same
sort of bulk discounts look i'm not
working with them but can they buy them
and use them absolutely i'm not gonna
say no right like you know what one of
the things that i really like um you
know one of the things that i
during like the playstation hacking i
would say stuff like
when i buy this playstation it's mine to
do whatever i want with and i feel the
exact same way about common products
right like if some fleet wants to buy
them and use them we're not going to
tell you no nobody asks you what you're
going to use it for you might get banned
from our servers if you you know make
unsafe changes but that's our servers
right your device is yours to do
anything you want with and i really
believe in that
um
so uh yeah can fleets buy them and use
them absolutely and what's my take on
crypto
oh well
pump pump pump pump
tether to the floor die to two dollars
cheap
so on the business side you uh kind of
covered the u.s market um and the
potential there but i was kind of
curious if you could share some on the
european market or other markets in the
world i'll ship it to any country that
doesn't ban me or charge insane import
taxes so you are in those markets
and you see growth
oh
if someone from another country orders
and pays the shipping charge and pays
the import charge again i'm not going to
say no i'm not a no kind of guy
we don't track any of that okay all
right um i guess i get to beat a third
to say i've ordered mine so cool
all right things are looking good for
how many we ordered
[Applause]
so it runs linux so probably it could be
used as a hotspot with great antennas it
sounds like um that'd be nice in the car
to have like a good reception maybe or
something oh yeah i mean the the comma
two can be used as a hotspot too we have
the same feature uh you can toggle
tethering it works uh you can also so
our sim is is is not that fast uh the
comma prime sim is uh half megabyte uh
the upload is faster though but it's
supposed to be half megabyte symmetric
but it's actually like 1.3 if anyone
benchmarked it but uh that's a nice lte
modem if you stick a real sim in there
and turn it on yeah it works great
sounds awesome um and are you also aware
that you probably built a pretty great
uh baseline you hackling vr a lot but
that's a pretty great baseline for kind
of another case and it'd be a nice vr
device as well um
yeah
vr has a bunch of
challenges i can talk about this stuff
at length some other time uh it's
unclear what the
the beauty of the comma three is when
you buy it uh when it gets to you you're
going to be able to use it to improve
your life tomorrow right no waiting for
anything i mean
you guys use open pilot if you like open
pilot with the comma 2 you're going to
like it even more with the comma 3.
so you said beautiful product and great
presentation
uh he said something to the effect of uh
level two the machine you tell the
machine what to do and higher levels the
machine tells you what to do
can you say more and maybe give us a
glimpse into your roadmap
well when you get in away mo and when
you touch the steering wheel it pulls
over and locks you out
who owns that machine
i like owning the machine and open pilot
when you take the wheel you turn on it's
your wheel you paid for it
does that answer the question i'm not
sure what else there is what is our road
map get to superhuman as fast as we can
win self-driving cars right i don't know
look if i was betting i'd still probably
bet on tesla but we'll be close
all right
question on the navigation how what's um
so do you expect me to reach for the
screen and just type it in there or is
it gonna be through that god what am i
trying to build an oem navigation
experience yes please scroll through
each letter no
go on your phone and type in the
destination and it goes over prime and
it's sent to your device it's real nice
um we do have uh shortcuts that you can
program in from your phone you'll see
more about this in the next presentation
but you think i'd design something
terrible like that
i'm telling you i use it i want to use
these things i drive around that hyundai
sonata with openpilot i use the nav i'm
not using it if i'm piping in oh no i
hit the d oh
my question is does nav integrate with
like auto lane change or suggested lane
soon soon uh so we need to gather the
data first uh so remember that the way
comma works is we gather the data from
from all our users and we use the data
to train the models so once there's a
whole bunch of comma threes out there
all the comma threes will get better
and we'll we will
put it this way
navigate on open pilot is a simpler
feature to build than end to end
longitudinal
we know how to build it
i'll tell you guys
you see that nav screen
we you know we wrapped our brain for a
while about like what's the api right we
have the desire stack you'll hear more
about that desire is cool for things
like lane changes which aren't covered
in naf but like for all the rest of it
well we just asked the question how do
humans do it well humans watch waze
right or watch a nav system so we're
just gonna take the picture from the nav
system and shove it in a cob net and put
it into the model and i think it's
totally gonna work
why would it not right if a human can
learn from that information so can the
machine so navigate on open pilot is uh
will look i don't like being a lot and
making predictions i can't keep but uh
i'm sorry i'm ripping on eli you know i
got a lot of respect for the guy i don't
even rip one who's the comma i don't
even know right
um
oh there's two oh the co-ceos yes that's
a great sign guys
um
he's ceo no he's ceo um
oh she all right um
that diversity is good
uh
uh yeah i would say that there's an 80
likelihood that we ship navigate and
open pilot within the next year
okay so you talk about how you want
comma to kind of become like an
ecosystem like android is sure you know
what products do you think are you
excited to see
you know um for you know the ecosystem
as of now yeah so
we're focused on the high end and this
is the decision that we had to make as a
company we talked about building lower
end cheaper devices maybe the kind of
like tiny device without a screen
and then again you run into the same car
insurance problem which is like that's
kind of boring
right like no one's going to get up here
and clap if we talk about the iphone 5s
or whatever it is you know not the ass
what's the no no no the se yeah yeah the
sc it's like oh and it's a little bit
cheaper and it comes in 10 fruity colors
like
while i don't personally want to build
that i am i would like to see those
things exist right
i'm very much a believer in like the big
pie mentality of economics so i would
love to see people who are capable of
you know building and managing like like
large numbers of devices that maybe
comma right now can't do kind of getting
in on the low end it's gonna be hard for
them to build a high-end device right
because they don't have you know the
high-end devices work great because they
integrate really well with the software
you see this with android but there's
some people who just want any kind of
lcas system and they'll buy up the low
end right and you see this exact same
thing with android the google pixel is a
high-end phone the motorola j7
well it's 60 bucks and it comes with a
boost mobile you know month right
um so like that's what i want to see uh
from people in the common ecosystem but
hey if people want to compete on the
high end i love that too right i just
want to see all this stuff get better
because
self-driving cars are just the tip right
like self-driving cars are just the
beginning of what all of this technology
can allow i want robots that clean my
house and cook me food right it's the
same tech
we got a question up there hello george
good to finally meet you in the flash uh
quick question can you uh touch on what
the microphones are for in the comma
three
i mean can i use it for nav or what are
they gonna do um we put them in because
it was easy
uh
the comma two has a microphone as well
we're not recording you you guys can
read the code um one of the first things
that i'd like to ship with the
microphone is something that adjusts the
volume of the alerts based on the
ambient noise level right so we can use
like a service to estimate how many you
know if you have loud music playing the
alert should be louder if you're in a
dead silent car like a hyundai sonata
the alert should be quieter if you're on
a toyota corolla a little louder right
like it should be it should so that's
one of the first uses of the microphone
uh the like voice nav stuff again the
oems kind of try this and while i think
we could build something better than the
oems there's still nothing that compares
to just copying the address in your
phone so
they're there because the hardware we're
just feeling complete without them
right on thank you
got a question in the front
yeah very excellent i feel embarrassed
to say that i own two teslas that i've
already paid for full self driving well
they're nice cars the software 14 000
spent on what i could have bought
but uh i saw in the thing
on the website that you're offering this
for the tesla will will it plug in
because i've been waiting for full
self-driving beta and i'm wondering if i
buy your device and plug it in and it
works maybe they'll send me the full
self-driving beta
well um
so so roma who was up here earlier has a
tesla he's done a lot of the work
pushing the tesla port forward a bunch
there's a whole community of tesla
people too
uh
collude macgyver it's a lot of community
stuff so will it work yeah you have to
make one line change to the code the
reason the tesla actually isn't under
community supportive features is we
can't do the same kind of steering on
the tesla that we can on the other cars
it's very hard to make the tesla
steering wheel overrideable it has that
kind of tesla feel where it's locked and
then it disengages
we just don't think that's really an
open pilot experience but it's
relatively easy
to do this we should sell the tesla
harness
um
yeah we should uh
you can do it but it'll take a little
bit of work now it will get easier over
time
i remember that like also the stuff
that's live now is not i'm not selling
anybody full self driving i'm selling
this on the hardware specs right like
you're buying this for hardware specs
don't expect it tomorrow to put this in
your car and it's going to make a 90
degree turn it's not i'm not even that
interested in that what i am a lot more
interested in with this hardware and the
places where you're going to start to
see disparities between the two and the
three are things like trucks in the
neighboring lane like moving over for
them right the comma two just can't see
them another place you're going to see a
disparity pretty soon if you don't
already is detecting a far-off car at a
stoplight in a distance right the comma
2 camera it's the lens it just does not
have that much yeah
um
as soon as you know we get as soon as we
sell like a thousand of these devices
and we start getting the data back from
them uh we're gonna be able to train
models that significantly outperform the
comma 2 just because the raw data is
better
great i think that's uh
that's it any last questions
one more logan
could you speak a little bit more on the
dynamic range of these cameras and their
ability to see into like harsh lighting
conditions and things like that
uh it's a lot better than the comma 2
and tesla i'll say that um they're ar
0231 you can look up the data sheet of
that sensor uh multi-exposure 120 db i
think it's probably the highest dynamic
range camera you can reasonably buy
there are some in pre-production that
have a little bit more it's not quite at
the human eye level yet uh
but the human eye has absurd dynamic
range
um but it is the best thing on the
market today for that and it should be a
big step up from the comato
i think the human eye is like 150 this
is 120 the 2 was 85 the tesla's 95.
i think that's it we did it
[Applause]
could be yours
you
Of the time and I'm pretty sure it'll happen
over the next two days
That said I'd like to introduce our first speaker George. Do you want to start coming up?
George Hotz
Is a pretty interesting guy
He had his first 15 minutes of fame as I understand it hacking the iPhone as a teenager. Is that right? George?
and
And it's George will correct me if I'm wrong in any of this
And his second 15 minutes of fame when he went into his garage and came out a couple of months later
having hacked his car to be self-driving that set him off on a
project that he's still in the middle of creating an operating system for
Self-driving both retrofitting existing cars and for new cars and and that's what's gonna tell us about today George
Hey
Oh
Okay, I'm good
When I talk I try to be really concrete with words, um, if I say anything that doesn't sound concrete, please ask me a question
Last
couple months ago
I started working with like formal languages like talk and Isabel and everything could be specified
rigidly, and I think a lot of
Definitions for a lot of things are just thrown around and there is no formal definition of them
And then it's a question what you're really saying. A lot of people can have conversations where two people just talk past each other
Because they have different definitions of a word
But you know some disciplines like math have found beautiful ways to solve this by giving things formal
Definitions so if I'm informal about anything, I mean it's obviously an informal talk, but I'm happy to clarify
So when you think of self-driving cars, what's the first company you think of I?
Hear a few Tesla's I also heard way moe
I think I think
yeah way mo is way mo is probably the one that captures the
Perhaps national consciousness of what self-driving cars are or the other one people mention is uber uber?
Actually got the most press about self-driving cars. If you do a Google Trends search for them. It's when uber killed somebody
so
but the traditional
Maybe this is just because a lot of marketing dollars have been poured into it
The traditional idea of self-driving cars is the way Moe. It's a car with no people in it and
You can call it from an app that it will drive down your idyllic suburban
street and it will pull up on the curb next to you and it will flash its little lights and be like way Moe is
Waiting for passengers to get on board
You could see this in the Google ads and it does not reflect the reality of driving
At all if you if you guys have seen a way Moe ad
Yeah, but you know so you pull up oh look everyone's so happy they're riding around in a way Moe
Way Moe is valued at a hundred and seventy five billion dollars despite
Not only not making profit, but I believe never making any revenue
So this this notion of self-driving cars may be distinct from Tesla is known as and we'll get to Tesla
But it's known as level four
Maybe this is the term that the levels don't really mean anything, but that's just the term people use
What it technically means is a car that's capable of full autonomy in restricted areas
so
full autonomy in restricted areas the
Application people immediately think of is ride-sharing
Ride-sharing is only a very small percent of rides people who?
Google's notorious for this if they don't think about what
Life is like for most people most people don't live in the Bay Area
Where they can call an uber and have an uber arrive in three minutes
I'm from suburban, New Jersey very nice area, but you call an uber. I'll be twenty minutes
So ride-sharing is only a very small percent of rides most people still in cars
and
Level four self-driving is a strictly worse product
So if ride-sharing
Can't even capture these markets. How do people expect self-driving cars to be able to
so first and foremost
Anything that's level four. So also level four or says something about usually how it's technically done way
Moe uses High Definition maps a very high precision like precise to the centimeter maps of an area
Uses lidar that can register every object up to three hundred meters away
This is not how humans drive at all
But because of these this HD map requirement they have a smaller service area
They're also slower
So way most travel the speed limit they come to full stops at stop signs and
They slow down at the slightest hint of hesitation
Which may be if you're trying to design your thing to make sure there's never a PR disaster for your company like uber
It's the right call
But if I'm sitting there, oh man, y'know I gotta get downtown or home way. Mo is 18 minutes uber saying 12
I'm gonna take an uber
There also, more expensive
So this might change this will probably change in the future everything eventually gets cheaper
but right now when you look at away, mo those cars cost about
300,000 to 500,000 to retrofit
Again, Google thinks oh, yeah. Well, we pay all our software engineers 200k a year salaries uber drivers ain't makin 200k. Um,
so
They're they're they're they're more expensive
the
Autonomous vehicle vision wouldn't even be a revolution at best
It's cheaper ride-sharing. A lot of times people get caught up in notions because they see
Futuristic looking stuff like this and think that this is going to have some
revolutionary impact
But they don't think about what the exact same product would be with a human
so all those chatbot AI companies criticized like
They're just humans doing the chatting, but they put AI in the name and they're there for some reason their valuation is way higher
It's a scam
So who's profiting off this game
This is a company drive day I
So they use all they're all you read their medium posts aw
They're unbelievable with the well, so we want to make sure that our self-driving car is capable of operating in multiple areas
So we hired engineers all over the world
What does have anything to do with that?
The very very kind of lofty language
Then when you get down to the root of what they actually made they made like a neighborhood shuttle bus
You know those like like like those buses that that ride around retirement homes that look like this
It's not self-driving. There's a human in the driver's seat. They made a
77 million dollar
Retirement home shuttle bus. What even is the global market for retirement home shuttle buses
I don't know
anybody
Consulting with people about the ethics of autonomous vehicles all well
So if I'm driving down the street and and there's a baby in the way
But there's a tree do I swerve and kill the driver to save them has this ever happened to a human?
Has this ever been a real scenario?
Cars are incredibly dangerous and 90% of accidents are caused by drivers who are drunk distracted or asleep
not because they swerve to not hit a baby yet this captures again a
conversation about self-driving cars that's completely disproportional to any
Remote impact it may have but a lot of people are making money off this and they're there branding themselves
It's like well, we're gonna consult with the city of Beverly Hills about their autonomous vehicle strap. What?
This stuff's not a thing. I'm in this one
So in the in the gold rush so you look at the the cruise acquisition
Probably actually a good vote for GM but then it was all the follow-ons to the cruise acquisition
this was the
Delfy spent four hundred fifty million dollars for demo quality software that drives around a block with a human of a driver's seat
This was done by Stanford in in during 2011 and the DARPA urban challenge and even better
They open sourced their code
They paid four hundred fifty thousand forty fifty million dollars probably for a few engineers and some code that's effectively open-source
So what's not a scam we gotta have the the positive atom actually sit here and rant about all the scammers for for an hour
This is car sold in America
Personal vehicle ownership is on the rise and not going anywhere for a long time
Might convert to electric. I think it will
Give it
time for the infrastructure to proliferate but personal vehicle ownership is not going anywhere because
How much cheaper would self-driving cars even be the nuber how much of the cost of the ride-sharing is the human driver?
About half the other half is maintenance of the car and in fleet and fuel and lots of other things
So it would even make goobers that are twice as cheap, but uber tries this we can already do twice as cheap uber today
It's called subsidies and they still, you know, can't get more than a few percent of a lot of these markets
This is US car ownership. This is Chinese car ownership
Huge potential market car ownership will continue for a long time
like we're not going to
Rethink and revolutionize the way that we have cars people like owning cars for the same reason people like owning houses
So if people are going to continue to buy cars, what does a better car look like?
You think of cell phones
You go back people had cell phones in the early 2000s, but no one really had smart phones
So what does there's a benefit Kevin's quote, right? What does a smart phone on wheels look like question down front on your right?
Would would this change if it was
Mixed use in the sense of if you want to get on an interstate. It will only be with the driverless car
So you flip a switch or something and then when you get off it goes back to human driving. Well, so
Yeah, I mean you can build that. We're already seeing systems like that today with test auto pilot
We're seeing systems where they still require monitoring
But they can do a lot of the work on the interstate and I do think this is the direction that we are headed
When it comes to we're going to rezone interstates as autonomous vehicle only zones. That's I mean
Some legislature person can might talk about that kind of stuff. But in reality, there's no reason to do it
Yeah, maybe you have you know, this is the autonomous Lane kind of like the HOV Lane, okay, I could see that happening
But does that answer your question?
So
On a lot of new cars today in fact, it's becoming standard on a lot of manufacturers you're starting to see driver assistance technology
So don't view
Autonomous vehicles as a binary like there's either you know
A human driver or there's no human driver all of those way Mo's driving around Chandler Arizona still have a human in the driver seat
That still has to be there to
intervene in case the car makes any mistakes
So instead of thinking about it like a cliff think about it as a gradual as a gradual increase to full autonomy
So we had cruise control cruise control came out in the first cars before in 70s. It's automatic gas
So when you're on the highway instead of having to keep your foot of gas pedal you press the button and the car will will
Handle the gas for you not so great if there's another car in a way
Because it will slam right into that car if you set the cruise control at 65, so that's why we have adaptive cruise control
How many people have cars with adaptive cruise control?
Cool a lot of you
It's common in mice
So it's the car will the car will do the brake for you and will keep you a safe following distance from the car in
front of you and then
lane centering
as distinct from Lane Keeping Assist
Which will correct you if you're drifting out of the lane Lane centering
Actively keeps you in the land how many people have a car with Lane Center?
Okay less. So if you guys didn't see the hands it's about 50% you with adaptive cruise control about 20% with Lane centering
All of these combined gas brake and steering that's all of driving a
Lot of
Manufacturers were selling their cruise control systems and their dapping cruise control systems in the lane keeping system
All kind of on separate pages if you've ever tried to navigate
The OEMs website. I think Tesla did a great job with the branding on this when they came out to test the autopilot
Tesla autopilot is just these same features but packaged into one
Nice Oh
Test autopilot. Okay, cool. What is autopilot? Oh, it drives the car for you. Well, that's not really what Auto powered on the plane does
But interesting interesting pyaare around it, they know how to be provocative. So, this is a Paul Graham tweet
The Tesla Model S was like the iPhone
And that all the manufacturers now have to copy it. The difference is many don't realize it yet
So when these things come out
Even blackberry is scared. There's there's initial articles about all the iPhone will never take off because people want a physical keyboard
Blackberry doesn't think this blackberry starts working or if you guys remember the blackberry storm
they tried they tried to they tried to stay around but
they didn't I
Spoke with someone
I believe it was from from Mitsubishi and they said there's no way that we can now build electric cars
Because because Tesla is Tesla is so far had on the battery technology. They have a 5-2 lead in the battery technology
There's no supplier. You can go to to buy Tesla's battery from
but even if you built a car with the same range and specs as a Tesla
nobody would buy it because they're also five years ahead in a
Huge number of other areas like the operating system like the supercharger network
So, I don't know what's gonna happen with it with what the car industry but
This is kind of where we come in I was approached by a friend
To build a new to build the vision system for Tesla autopilot before it launched
Tesla was using a mobile eye chip. So mobile eye is a
really the original a task company and I've come to respect them a lot more throughout this journey because they've been saying a lot of
His self-driving cars a scam stuff for a long time
And they are they were acquired for fifteen billion dollars by Intel
Not a bad price. Sorry Intel Botham name an Intel acquisition that's gone on to be a successful company
You get bought by Facebook. You're successful you get bought by Intel you're dead
Uh-huh
Thanks for everything though whatsapp Instagram oculus
Let's go sold a million of those things
so
I'm working I met with Elon a few times who talked about
a deal for building the vision system
But eventually the deal kind of fell through I'll chalk it up to a miscommunication
And I come up with this idea for a company. Okay build better test the autopilot
sell to automakers be rich
Just pitch that I get this is the pitch that I gave to VCS and it sounds like a good pitch. I
talked about the smartphone stuff and I'm like look, I mean Tesla's running iOS
We're gonna build the Android
So we did we did step one. It's called open pilot
Um open pilot. I have a little explainer video made by one of our
Community members after this but it's effectively
autopilot
for cars people actually have
So this is this is a little what is open pilot open pilot is an advanced driver assistance
System that turns your car's lane keep assist function from this
To this as well as provides smoother and safer radar adaptive cruise control
Open pilot allows you to be driving hands-free and feet free for long periods of time without intervention even more so on interstates and highways
Everything is controlled by open pilot, but it's easy to intervene at any time. But how does this all work?
You need three pieces of hardware all bought from coma ai slash shop
first the giraffe
This device converts your car's lane keep assist camera connector into a more Universal port for the next piece of hardware
Which is the gray panda the Panda receives information from your car and can also send information as well
This is what sends the car commands such as speed up slow down and turn the wheel in either direction
It also has a high-precision GPS antenna used to create HD maps as you drive
Finally the e on this is the main device that drives your car first plugged into the Panda then mounted on your windshield
it sees your car's existing radar information which shows exactly how far away the car in front of you is
With this it instructs the car to speed up and slow down as needed
it also has a high quality camera that looks for lane lines in the road and tells the wheel to stay exactly centered in the
lane lines at all times
As an added bonus. It is also a fantastic dashcam with free unlimited cloud storage
Open pilot runs on Honda's Toyota's
Acuras Lexus GM in Hyundais with even more car support being worked on every day and the best part
Altogether this setup costs less than
$1,000 check if your existing car is compatible then go buy a neon panda enter after day and upgrade your car to the future
That's our slogan
So
Back to the the the the the business plan build better Tesla autopilot. Well, I really think you're not really gonna build better test autopilot
because
Tesla autopilot is
Not a fixed target
It's much better right now than Tesla autopilot when it came out
Is it better than Tesla autopilot now? No
Because Tesla's good engineers
when I saw what Tesla was doing with autopilot like
When I compared myself to the way that like Toyota and auto manufacturers and even the tier ones Delphian Bosch are thinking about this
They're thinking in old ways. They're coding in. Well, we have to code everything in Misra C and run it on
32-bit
freescale trike or micro processors that have as 'old these safety ratings and
This doesn't really make sense
You're not gonna get
Functional safety, you're not gonna be able to get a safety spec of these things because there's no formal definition of a car
You're just gonna have to use statistical safety
You're not gonna want to code all of this in
You know this this very restricted
C because you're never gonna get any sort of modern performance
You're never gonna get all the niceties OBE how it's gotten in Python, by the way
You're never gonna get you're not gonna be able to be competitive
Tesla autopilot is coded in C++, but it's a very
Nice high-end abstracted C++ not the kind of low end stuff that the car manufacturers are doing so
Tesla is using neural networks. They're using GPUs. We're using neural networks. We're using GPUs
We're using all the same tricks. So we're not actually going to pass autopilot. We're gonna kind of tie him
So we do this right and I hadn't thought that the reason that other cars didn't have autopilot
Was that the car manufacturers did not know how to build it?
This is not true
So I met with the car makers I met with several CEOs
Drove down to their offices. I met with a lot of business development people. I'm still kind of confused about what business development is
Oh, I was I was I was appalled
You couldn't you couldn't talk to these people?
There is no I guess it makes sense when you think about it Ford is a four hundred thousand person organization
Who is Ford if I had mind control over the CEO of Ford?
I still couldn't make this stuff ship
It's like a big it's like a big boat and no one's really skewing. Everyone's got like a little paddle, right?
Question on your right in the back
Yeah, so I think I'm your worst nightmare because I'm both a business development person and a PhD in psychology. You're not gonna take
So if you're appalled now, you should be a little worried. Um my question
Listening to the way you're thinking about going at the problem what you're trying to solve
Makes me think back to your slide with that big red X on it
yeah, and in the way I shorthand of what you did was you put a big red X through the category or the the
Topics having to do with the ethics
and the
Interaction between the technology you're working on in people and I know the baby case could be put off as an edge case
I taught probability I get it
Yeah, but that's a placeholder for a whole bunch of issues that aren't about whether pythons gonna cut it for me or not
And so I'm wondering how you think about that as you develop your technology
I
mean I get look I
Understand big companies and challenges moving through but I think there's a pretty fundamental one when we're looking at some of this stuff around
Assisted driving autonomous driving, whatever part of it you think you want to address?
So when it comes to what I put an extra was people talking specifically about the the ethics of autonomous vehicles
The handoff problem is absolutely real on the problem of making sure
Of just remove from a from like an HCI perspective
Understanding whether the human is in control of the car whether the machine is in control of the car making sure expectations are correct
Oh, these things are extremely important. I
Don't go into it in this slide deck, but we have some medium posts about we have a camera facing the driver
I mean we make sure that the driver is paying attention at all times that we expect them to be paying attention
We make sure our our transition system
When we how we alert how we do the handoffs has been praised by a bunch of people
Auto makers it like beeps and flashes like a little icon. You have no idea what it means
We have consistent messaging about whether the car is capable of doing this whether it's capable of engaging here
So I think things like that are extremely important
What I don't think is important is the kind of people who give far reaching twenty years from now
We're going to rethink cities around autonomous vehicles
Are we what's the difference to the autonomous vehicle and a non autonomous vehicle at most its cost?
In these cases. It's also building a product that is more convenient for a user but from an external perspective
The car looks identical you can't tell
If you see a test on the highway with their cars on autopilot or not on autopilot, I'm sorry
I don't mean to group those two things together. I think one is extremely important I think one is
People self-promoting and stuff that like, I don't see the relevant stuff, but does that answer cool?
So, yeah, you you try to work with these uh with these automakers and
You can't
It's a structural problem
Mobileye has more business development people than they do R&D engineers. That's why their text not that great, but it's in all the cars
So, yeah, I mean to go back to the Paul Graham tweet
You don't realize it. The car manufacturers don't realize
when you get in some of these cars and you use the their adaptive cruise control the
Quality varies wildly from manufacturer to manufacturer. It's almost like these people have never gotten in a Tesla and tried it
So yeah, what do you do? So is this hard as hard at the beginning of the company this was like my plan
I'm gonna sell to these people. I'm gonna talk with them. They're gonna be reasonable
So I realized that who really cares if Tesla is the iPhone
We just have to build the Android and the phones already exist
It's not like we have to get
manufacturer by n we just have to get
Manufacturer compatibility, I would much rather work with the product than the company
Open pilot already supports this whole list of cars
you can go right now and
you can put open pilot in these cars and it will take over the steering the gas and the brakes and it will do a
Significantly better job than the manufacturer system in all of those cars
open pilot is the Android and
Just like Android
It's open source
Why make it open source well
Nobody has any excuse anymore
You've seen it in the last two years how many companies try to raise money off of a demo video of self-driving?
nobody
Because if you can't build something better than what's available and open source and market of it nobody knows that Stanford codes open source
You have nothing right? There is no reason for somebody now to start from scratch on this stuff
Just take open pilot modify. It build it extend it and hopefully
upstream your stuff change the conversation from
Intellectual property and business development deals and exclusivity to do a pull request on an open pilot
Well, upstream it. It's it's everybody's MIT license
So somebody else could take this rebrand it call it their own great. I just want to see the stuff you better
Have you tested
Open pilot and all of those
vehicles that you had previously you have um
So not not personally but so we have a we have we have a safety model
I can go into after after I run through the slide deck
I can go through I can go to the website and show what our safety model is
so our safety model involves
It's two things
It's one
Make sure that the system can never do anything
quickly
make sure it can never like jerk the wheel or slam on the brakes or do something faster than a driver could react and to
Make sure the driver is paying attention at all times
And as soon as they touch either the gas or the brake the car immediately reverts to manual mode
So as long as you ensure those two things you have a pretty good level to safety model
Um and yet be explicit about this. So we say like it cannot do anything bad within one second
So as long as you're paying attention, you know just reach out and it's not like it'll ever like turn the wheel like this
It's really designed for highway driving kind of stuff
So if you just reach out put a little bit of pressure on the steering wheel, it'll just stop doing anything
So yeah, yeah making sure this stuff is well done
and also the safety code is not a Python on the safety code isn't see the safety code is is on an as will be
microcontroller
The stuff that's in Python is like the machine learning model part of things
Which you're never going to be able to formally validate. Anyway, the safety code is formally validated
It has tests it is you got to do it stuff correctly
I am Ashley McCorkle from Intel and
Just let you know we haven't killed mobile yet. We're trying really hard not to that was kind of an expensive acquisition but and
You actually have a lot in common in your approach and am nons approach with mobile
I and one is trying to scale up from ADAS into more sophisticated
Levels of autonomous driving, I think. The other is assuming that this will never work if you have to put you know
multiple xeon
supercomputing resources in a car
You know
he's trying to scale it up from basically like a a
In SOC like a very light computing and addling thousands rather than tens of thousands of dollars the price of a car
Right. So one of his assumptions though, and I think it's relevant for the
Lead up with that we had previously the the warm up on trends in AI is
Rather than trying to use a brute-force approach
Where you were I think you like you were saying, you know
Having 3d lidar mapping of the entire terrain and having these massive crunching to be able to map
You know in 3d, you know everything entire surroundings the car
Using a very light compute method that is really based not on, you know
these deep learning based number crunching but on a rules-based approach and I think he's also published that as you know,
basically open sourcing this responsibility sensitive safety where you're programming a set of
rules into the AI
that that
Basically encapsulate what society's idea of safe driving is and by society
It can be a little bit flexible as well. Like an Israeli car can drive differently than a French car than an American car
So what do you think of that approach and and you do you agree with that particular?
assessment of AI and brute force computation in cars
so
Multi parts here. I've watched I've watched all of his recent talks
Especially especially after auto pilot comes out. I really I'm going to respect
His perspective so a lot more give a very good cvpr talk where he went into
Actually, like what it takes to make these computer vision things reliable enough to drive cars. I
thought the formalization of
that
Stuff he goes into one where he talks about like formally specifying what it means to be a safe driver. I
Think that stuff was pretty weak. The problem is
What he's really trying to do there the subtext is we want to make sure we are never liable for any accidents we caused
I mean you can view the world that way and sell like lawyers and accountants view the world
I don't I want to figure out an engineer. I want to drive accidents down to zero. Let's root cause it let's figure it out
NTSB not nishta
So I also don't think it really works from a technical perspective because take a
double yellow line
The rules of driving say you cannot cross the double yellow line
But if you do not cross double yellow lines and you're driving around San Francisco, you will never get anywhere
There's an uber with their blinkers on right there. Okay, so then when is it?
Okay, do we formalize this or do we look at big data?
My argument is that the definition of driving is what people do when they drive
Now you say not everybody's a safe driver is the anna karenina quote
Every good driver is good in the same way
Every bad driver is bad in a different way because of that the statistical algorithm earning algorithms
Kind of ignore the bad data because they can't find much signal in it
Instead of thinking of the average driver think of a committee driver
Think of 100 people sitting in a room voting 100 times a second on what the car should do
Some of them may be drunk
Some of them may be distracted and some of them may be asleep, but the committee will probably still make the correct decision
So I think that's more the approach and when you try to formalize this stuff even trying to formalize what a car is
becomes extremely hard
So, I don't know. I don't think it's gonna
Gonna go anywhere. I think the way to actually do this is with big data and statistics
Jenna has a question
Yeah, I work for a big insurance company
So I'm curious in your safety stats when you talk about it if you're gonna cover it great
I can't find any data as to when open pilot actually came about so I'm curious how long it's existed and then to
When it's been in an accident
How is fault determined and how is that?
Dealt with so I have some stats on a later slide, but it's a dash cam as well
So we've had no
At fault accidents so far but the system engaged
Which is better than the average you'll see how many miles we have but
How is fault determined
I mean the exact same way it's determined the human is still legally in control car open pilot is a level 2 system
So just like Tesla autopilot or just like imagine you put your car on cruise control, right?
You can't say well, I understand. I rear-ended you but the car was on cruise control and it wasn't supposed to
Great, you're liable. So liability is determined in the exact same way that a
An accident between two humans would be determined right
In fact people think that the problem with these kind of systems is you can't introspect and ask them
You can't say why did you make that decision?
You can't ask humans either if you go after a car accident and ask humans
What happened there recall is extremely bad if you have dashcam footage from both cars
Now you start to figure out what happened
um
So I think devices like this which also function as cloud dash cams will be an extreme boon to the insurance industry
Here you go right away instant fault. I like insurance. I like the whole businesses
Well, the whole business is great its statistics. It's we're going to drive down accident
So we're gonna charge and we're gonna make art we're gonna make our profits
Great
So yeah, how is fault determined in the exact same way that is with humans
So yeah open pilot is not it's not some oh
Hi, so I am a human machine teaming engineer so
You talked earlier about automation as a gradual rise rather than as a cliff
There's a lot of work on levels of automation like you were talking about do you expect to open pilot to eventually
You know climb that gentle slope to full automation? And if so,
What do you expect to need to change or grow and capabilities to achieve that if not, why not?
Yes, I do
The so we're gonna need a few more okay right now it only has one forward-facing camera, that's clearly not enough
You'll need 360 degrees of vision. I think you'll need a bit more compute than what you currently have
If you really want to say the human doesn't have to pay attention
You'll need to talk about like systems reliability engineering. You'll need to put two
Processors and making sure that failure cases are not just right now
A lot of failure cases we have or safety model is based around having a human driver in the driver seat
so as long as we don't kind of have
False positives it's okay, but you start to get into true negative is becoming really bad as well
if you're trying to remove the human from the system, so
Do we eventually get there? Yeah. When are we ready for it when the statistics show we are
when we start to see in the statistics, oh
Wow, open pilot has driven this stretch of road 1 million times and has never made a mistake. Is that good enough?
Figure out those statistics and let's see maybe ask the question. Uh
Yeah, but kind of an add-on question. So you were talking earlier as well about
Restrictions in the utility of full automation in terms of the you know, the larger system that the car is driving in
what are your thoughts about that going forward that just the
Ecosystem of consumer desires will change and legislation will follow or what?
And the design of traffic systems
It'll be gradual it'll be what makes sense
Like I don't know I don't think it's gonna change that much because I don't think machines and humans are that different
I think that the things that
Have been developed over hundreds of years for human drivers will actually work out to be
Oh, well, those things are actually pretty useful for machine drivers, too
Like you're like well machines won't need stop signs. Oh, I forgot about that whole scam v2v communication
Machines won't need stop signs. The two cars will just communicate with each other. This is horrific
This is I don't know if anybody knows anything about safety who comes up with ideas like this because now you need two
Active components to work correctly for a stop sign to work
The beauty of stop signs is a decentralized as the logic
Either party most accident there would be so many more accidents on the road today
If every driver wasn't actively avoiding accidents. Think about every time you hear a horn honk that's an accident
That would have happened if I didn't actively swerve you need both parties to be paying attention
so yeah with respect to like changing these things radically
I don't know. I think that what's good for you most to be good for machines as well
some things are already becoming less relevant like road signs since everybody doesn't have
Like like signs saying oh this exit here. Okay, so yeah open pilot is not
Some fancy research stuff. This was actually my drive to the conference. I guess. I'm on my way to the conference Oh
piles driving right now
It's got the wheel. It's got the gas at the brake
It's got the bridge traffic I have the car in the parking lot. Maybe there's driver I
Know that's in the back. So I noticed there's no rearview mirror
So we don't encourage people to do that
You do not you you you do not have to remove your rear view mirror for driving
but this is still a road-legal car on swivel law in California is you need to have two mirrors on your car that can see
The back if you have to side members, you don't actually need a regular that's more of just an aesthetic taste on my part
But we do not encourage people to do that and the kit does not require it because that would violate FMVSS
But you can do it personally
Doesn't it doesn't violate anything?
So yeah business was simple profit off hardware. I
Mean, you know, it's a business model. I can respect we make the hardware for less than we sell it for
We don't license IP
Ya on the website you buy the three components separately I think it was 600 mm
Don't you need all three you do? Yeah. It's about it's about
$650 for all of them. Yeah. Should we make this easier? Yeah, we should we should make it easier. I don't know
I'm the head of research now. I used to be CEO. I'm not anymore
We'll get a real CEO who who knows things about execution and business right now. We got a new CEO. He's great, but
Uh
Yeah, so it could just about stats. We've driven a point five million miles
So yeah to not have seen to not have seen the system calls accident an eight point five million miles
It's pretty good. We've seen a bunch of accidents with the system engaged
There is one that's particularly hilarious
There's a the system comes to stop behind a car, but the car overshot the stop line
And the driver just puts it reverse and just Rams right into it
Good thing you had the dash cam footage. All right
So first some comparison whammo just reached ten million miles and cruise probably has about 1 million to have significantly more than them
I'm the one that I did not put there is Tesla which has billions of miles on your left in the back again real quick
Over what time span is this? This is oversold. Well, it's been around now for almost three years
Times this is the life timing system
This question will be shorter
When you have a deep learning based approach, yeah and you know, it's really a game of getting a bunch of training datum
so
And what competitive disadvantage does that put a smaller company like yourself? I mean if you back to your Tesla example, right?
Yeah, these are V. Say Wemo or Tesla which are just going to be piling on the
training models
We train our models on only about 100,000 miles of data
Um, the models are not even trained on all the data and we have almost the same number of miles way now
so so to pull out my
amnon
Well, we don't have any small blows, right
But they're not we send all the video back. He would say that, you know if you're trying to
Specifically avoid crash situations that you know that you it's a very low probability event
Yeah, so therefore you would need billions of miles okay in order to properly train
This system against these sorts of events
And also every time you update the system you need another billion
you know billions of miles in order to retrain the model for to avoid these events, so
Is deep learning really the
Scalable approach particularly for a small company. Yes
Um, so the former part of that about needing billions of miles to get to level 4
I completely agree if you 1 billion miles is 10 fatalities, maybe five fatalities
You have to have that kind of stuff in your dataset. If you're trying to say to your systems level 4
Do you need to gather new billion miles? No, you need some good statistical way to
Show that your system can function on replace
Um, so we can just rerun the new system over the billions of miles and say it's still good. Um does deep learning scale? Yes
You have to start to do you're not going to train on all billion miles and you don't have to
When you want to deal with crash scenarios, we're gonna have like a data set where it's like here's 1 million near crash scenario
These are the good ones. This is what you should do. We can do automatic recovery on that stuff, too
So I got two minutes let me just get through the last few slides here this is daily miles driven
And this is daily percent of miles engaged
More than 50 percent of the miles are being driven by the system and this is crushing Tesla Tesla's about 30
Their reason are is is significantly higher is because we don't disengage on the steering wheel and everything is just more
Gradual and gentle we view it as much more of a system than an autopilot
But our goal is to get that number up to 100
So it's kind of growing over time. We got some new users who were less power users
It's also engaged last around the winter because there's snow on the roads
So we expect to see a hump in the middle of every year
Yeah, so how to scale and win
We already have a product people pay for and use daily
continue to improve driving quality and car support
Lower the barrier to entry you don't have to buy three reared animal named things and then partner dealerships for mass distribution
Don't try to talk to don't try to talk to the OEMs. I think it's hopeless
If you partner with dealerships, it's like partnering with you you got your phone and the AT&T store in the t-mobile store
I've talked with some dealerships
They're super hungry for this kind of stuff and they're the kind of people who you can talk to
you're like look we make this thing we sell it to you for $600 you sell it to people for
$2,000 you give $1400
That's a good deal
Since you just did when Twitter, I call me and Instagram George Hotz
Let's talk
When I'm back in your left, please. All right. There was a question over here first, and then we'll come back
Yes, so
How do you deal with and you answered it a little bit or at least hinted at it because of the the winter comment?
All the sensors on these cars are in different places. They have different
limitations or blind spots
How do you deal with the fact that your hundred thousand miles of training data? Probably doesn't
accommodate
Degraded conditions and so how do you build models and understand how they vary and these in these degraded capacities because
Your system. I understand that the sort of the humans always engage, but at the same time
The AI is going to be generating some faulty data and how do you detect that?
Yeah, it's not generating faulty data
And we do have a huge diversity of weather conditions and locations in our data set the data set just comes from all the users
So we have whatever the users are actually driving on
So that's not really that big of a problem
When it comes to the sensors being different
This is why we have the eland the EON has a camera on the back of it that cameras the same across all the cars
The radars are similar enough and the actuators are similar enough that we built a hardware abstraction layer on that
abstracts them to this uniform
API that gives it to all cars and going a lot more into technical details of that but uh
Yeah. So again, it's level 2 if the car like traction control fires. It's like the ESC fires we disengage
We're like you got to be driving right now. Just like you should not use cruise control on the snow
You should not use these systems if there's snow on the road if there's snow on the side of the road. Yes sure, it's fine
Robert
Did you still have a question?
My question was around you mentioned the cloud storage of the dashcam video
Is that a subscription model or how does that work right now? It's free, but we're moving towards
Yeah, we're looking into that kind of stuff
It's expensive storage is expensive
Ok Zee, and then we'll pop back up this
You're tracking all the location data
What is your how do you manage the privacy around that you by using our system you consent to giving us full access to all?
the data
If you don't if you're not ok with that, don't use it. I'm very open about that. I'm not like Facebook
I'm not wishy-washy you are giving us all the data and we will use it for whatever we want if you're not ok with that
Don't use the system
Right side so I have two quick questions one is have you found any issues with
contextualizing how people drive in different regions
I know in Buenos Aires for example as soon as you see a yellow on the other direction
You start going in see see where I'm from. You kind of let rides Lauren out
I always imagine taking half DC drivers and half Buenos Aires drivers and watching what would happen
So when you have these voting's you have differing dimensions. The other one is is
Are you looking at the attention data as people are going more confident in the system?
Are they more willing or more likely to pull out their phone or start losing their attention because they don't have to again here
We're starting to get in a situation where people are feeling pretty safe on this up on the highway
And they're not paying attention anymore
This is why after the second Tesla accident where the guy hit the guardrail we're like we have to ship driver monitoring immediately
So right now if you're driving and you look at your phone if you look at your phone for more than four seconds
it will beep and
Then it will continue to steer but it will stop gasps. It will stop doing the gas
So if you are distracted, it won't accelerate anymore
And then people learn eventually if this becomes a problem, we're also gonna put in lock outs
But that hasn't really become a problem yet. Tesla should do driver monitoring as well
So yeah, as people have become more common
That's the danger as these things get better people pay attention less and that's you just solved with driver monitoring make sure the driver actually
Pays attention and punish them for not
And then the contextualization of regions, oh regionalization. Um, so we just have a country filter right now
Most of the data comes from America it works. The best in America driving is similar enough in America
You will get into weird edge cases, maybe like the Pittsburgh left
I think the way to solve that problem long term is to train different models for different regions
It's like the iPhone has different stuff. He's loading the region model
Okay, maybe time for one more
You have a
Security aspect of it. Sorry. Could you raise your hand wherever you are? Oh right in the middle
Yes security aspect against hacking for Oakland pilot. Um, so
Car hacking is one of these things that also people make a ton of money talking about in conferences
Can you give an example of what it actually happened?
But at least you have seen situations where people have
You know had a gang, you know a regular laptop or something talking to the canvas
Oh, yeah, I've seen I've seen Charlie Miller do a PR stunt
But I've never seen car hacking does not appear to be an actual threat by malicious actors in the real world
When it does I'll consider it much more seriously, but like until it does like what are people really going to do. They're not
It's not really a thing but use industry standard security. Don't do stupid things
Thank you speaking from experience though. If you want to sell your system in certain countries like China, yeah
Oh, we've given up on that mark. Yeah, they have a lot of restrictions and
They actually want to be able to monitor the AI
because they're very
Paranoid about about cyber security our stuff gets into China through github. I'm not I'm not touching that market
I'm not working with no people like that
Okay, well I personally think this was a great way to stop the conference cuz this is one of those
This is a talk where I'm like one minute
I'm like, yeah
I'm really on board with that and then the next no I hate what you just said and then the next minute
I'm like, yeah, I really and then I'm back to
But talk about a provoking way to stop the conference George. Thanks very much
what up
all right so the tour doesn't start till
11.
so we're just chilling we're just
chilling here
for now welcome everybody welcome
uh come on twitch and you can see what's
up
let me see if it's actually live i never
know what actually works you know
is it live
george hans is offline
kind of do your crown job or whatever
i don't know i had this problem once
before it wouldn't let me start mobile
streaming but i thought it was because i
put bad words in the title but maybe
it's just buggy
oh we are on the wi-fi right
make sure we're on the left by my dad
uh
let's see let's see
thank you for subscribing we're not if
we're on subscriber only chat
i'm terribly sorry
but um you uh lose
and you gotta subscribe in order to talk
but if we're not unsubscribing great
everybody can talk and this is the
egalitarian utopia
[Music]
no more san diego whoa we're still in
san diego
whoa whoa who said we're not in san
diego yeah george house is streaming
special events oh here we go gotta watch
an ad
live
um
there's a song mumble by uh canadian
softball
and it's just mumble rap but they say
nice things about
the streets will run right with the
blood of the capitalist cucks
welcome welcome welcome
ah thank you thank you
yo
okay guys
this place is crazy
you think we got some like jankass
offense yo we signed a five year lease
on this
um
who'd have thought that ai would be
solved in a 20 000 square foot office in
san diego
see that's what i'm saying though
um
you know the stream should be high
quality but i don't know if it's not
it's not
uh
384.
all right well we got five minutes we
got five minutes to kill before the
stream starts
uh so we can talk about whatever because
the stream starts at 11. i scheduled it
if you uh if you're on a discord
um
shitty internet
the upload here is kind of shitty
uh
keyboard oh
yeah you see a little keyboard right
there all right see what i'm talking
about
uh the audio is good glad glad glad
um
i just read uh
when i was on vacation i read uh
project hail mary glad glad glad you
know talking like rocky
um
yeah i know karpathy did a micrograd
tutorial apparently it was better than
my tiny guy tutorial
uh
your projects on mary's pretty good
i enjoyed that
i'm jet lagged from europe i woke up at
uh 3 30 this morning and i was reading
uh
uh story of your life and others
uh commentaries are born in the new
tucson i don't know does that have
toyota security thank you for the hype
train everybody thank you welcome to my
stream
the tour begins in three minutes
uh for now we're just warming up
we're getting everybody in here getting
ready
uh
for the tour we're drinking recess and
antidote to modern times did you think
that soda costs five dollars recess
well i'm working here on
these are new cameras
the comma three
uh these are
some omnivision sensors because aptina
is charging us too much money for their
sensors so now you get these sensors
which are actually a little bit better
um
20 more db four frame hdr instead of
three
uh so you know these will just come to
the comma three uh they're dropping
replacements
so we have these sensors you know those
are the these are the crappy ones these
are the good sensors uh they have lenses
on them um
these are
ones that i couldn't figure out how to
make work and these are seven dollars
each so we were like oh man if we could
use the seven dollar sensor but no i'm
not gonna give you guys seven dollar
sensors these are good automotive
sensors um with automotive you get a
really high temperature range
which is important
because um things get hot in cars it
turns out
things get really hot in cars in fact we
just upgraded if you buy a common three
today we just upgraded the case the new
case can withstand temperatures of like
160 celsius
uh we got some like crazy high temp
plastic
maybe we'll visit igor and uh
he'll tell us about it
um
i'm sorry it's not high quality i don't
know what to tell you
now maybe if i switch the other camera
we will switch the other camera because
the tour is starting now
ah welcome uh
so that door goes to infrastructure but
you can't use that door
uh
no i don't think it's twitch actually
should i try switching to my cell
radio
uh it's our upload we don't have fiber
yet we're getting we're getting
symmetric five gigabit fiber in here
um quality is fine thank you okay but
maybe you guys want to meet uh if you
haven't met kenny yet
uh this is kenny
all right kenny runs open pilot
uh so you know
yeah kenny right because he's getting
yeah he's sitting down
he's having a good time sitting down
it's pretty uh they're in locked mode
now it's just piding to
stay locked
uh yeah yeah that's it kenny good kenny
these are the new computers that we're
getting for employees only a few people
have them up these are think stations
they got thread represent them
um you guys know about the three focuses
of comma we're focused on compatibility
improved driving experience and cheaper
for us and more reliable comma threes
oh yeah so this is my office uh oh we're
guys we're going on it we're going on an
adventure you guys ever see scooby doo
it's gonna be like that no no no no no
the magic school bus that that's what
i'm thinking of
uh that's my plant
that's my computer
uh yeah nicer office right you guys
remember my old office but just wait
just wait all right we'll go out this
way i'm gonna come back to research
um or you're not gonna believe this
place is unbelievable wait i gotta find
my wallet
let me get my wallet because we gotta
have the key
without the key we can't get in all
right
all right we're going exploring we're
going exploring boys you
ready you ready
yeah i went to 230s
welcome to the foyer
oh we should go the other way that way
this we can wait
okay
we gotta be quiet because people are
working
um this is an empty room this office is
so big we have so many empty rooms like
you wouldn't believe
uh let's see if anyone's in the
infrastructure office yet
no mitchell and greg are in here yet
but this is the infrastructure office
see we got some r630 motherboards down
there yes we are hiring that's the whole
point of this stream
um we'll get to we'll get to what we're
hiring for actually we're hiring for
infrastructure uh we're hiring for
infrastructure uh i think this is gonna
become an infrastructure room too
uh so if you'd like to sit in here you
can have your very own office now we're
gonna put two infrastructure people in
here you know what i'm saying
got those uh ethernet my dad and i did
all the wiring in this office
uh we're not hiring project managers we
don't hire anyone with manager in their
title because they're losers
uh no not exactly but like you don't
become some people do manage people but
you become a manager by having all the
skills of the people you manage
um
we are in san diego yes this is in old
town san diego
uh okay so this is the open pilot lounge
oh this this office is unbelievable
we're gonna be doing this 40 minutes
guys so so buckle up grab a red bull or
whatever we could have a meeting in here
oh my god wow this is this is all new
um
yeah
i don't know what's on that board we
should hide it we got people hard at
work in here
people hard at work
there's no secrets oh it's on the board
are there secrets i don't know cars
we're gonna support oh silverado no no
we don't really have secrets this is
just i'm just worried about any oh no
this is all your stuff all right cool
no this is legit you guys know the three
priorities the three priorities are
really all that's going on here here's a
wall of comma threes uh you can adopt
one today for just two thousand dollars
um adeep has a think station
very fast yeah very fast uh and a kenny
in a slightly different position
um i was looking this morning for usb to
ethernets
oh i have a bunch of them today
everybody's coming in cool
cool uh we'll let open pilot get back to
work but this is the open pilot office
this is the extended open pilot office
uh we got some new people starting we
are hiring now pretty quickly
um so i'll tell you what we're hiring
for so if you are interested in
if you are interested in carporting if
you know about cars
we'd love to have you we have a huge
parking lot now to fill with cars this
is actually only half the parking lot
the parking lot is absolutely
massive um
so we we don't hire any remote uh all on
site right here in san diego there's no
more europe office even just san diego
uh the unification is real uh how many
people are in the company now uh i think
we're like 21 now
um
yeah so if you want to work on
infrastructure infrastructure we need
some insane infrastructure software
engineers i'm gonna ask you about
linux i'm going to ask you about
uh you know like sys calls and
networking and
i really only ask one question actually
and i'll tell you the question you all
can prepare for it when i type
google.com in a web browser what happens
it's the only question i ask for
infrastructure
and you can really go into depth there
you know
you all know your sins snack and ack
don't know what port webb is on
right right
what if i'm going through a socks proxy
what's a socks proxy who knows
all right uh cool
this is going to be our gym
that we don't have any gym equipment yet
um this is going to be the gym
this is going to be
storage room i think
i don't know wow this is
there's a lot of stuff in here these are
cases for comma threes
um no but okay the best part of the tour
is at the end
we're not even well we're not even close
to done the best but we're going to go
to production
uh these are our rooms available for um
sleeping uh if you're interested in that
we're gonna stick a couple of bunk beds
in here it's gonna be intern housing you
see what says interns
i'll show the toilets all right you guys
want to go to the toilet let's make sure
there's no one in the toilets we'll go
to bathroom land here there's a place
called bathroom land because it's some
handicap thing and we got like seven
bathrooms all next to each other
uh legit and then we go to the executive
herald has an executive bathroom all
right there's no one in here
yeah yeah your very own
um high quality yeah yeah just like when
you go just like when your girl's coming
over you got to clean the bathroom you
know people judge you based on your
bathroom
oh yeah private bathrooms yo yo you
think we skimp on that no way
um this goes to stairs don't go there
uh
oh yeah we got showers we're getting
some uh some laundry equipment can be a
little louder over here because no one
works over here
uh this is the uh the the
living area uh there's gonna be chill
we're gonna put some couches here and
stuff
it's gonna be good
um here's the lunch
and dinner room
check out the water on the freezer
oh wait can we get a can we get a round
ice
how do i get a round ice ice plus
cubed
oh no no no no no no that's not what i
want let me get a round ice
are there round ices in here
don't show me around ice yesterday
i don't know how to get round ice but
you can get round ice out of this fridge
because it's crazy
um oh a chip
hmm pretty good
yup so this is um this is for lunch and
dinner
we've got nest thermostats all over the
place
all right let's go visit
there yeah we're on stream
this is the laboratory of the bodies
where the bodies get made
check out we switched 3d printers
we got x maxes now
uh i got anything else to show
oh the secret the red panda replacements
oh we're gonna show it yeah yeah yeah
yeah yeah
well no we're just we're just making red
pandas cheaper
oh yeah now look at that that's a red
panda is that not the smallest red panda
you've ever seen
um it's gonna be the same red panda for
you but we're just lowering costs
how hard is recruiting we're doing
recruiting right now
um yeah if you're interested oh yes
we're hiring for the body team yes if
you're interested in joining the body
team
um we uh
we are hiring a controls engineer who
can make the kenny's actually do
something
if they move they move they're good at
that
but um you know get it to balance while
moving the knee around that's going to
take some uh controls and we're hiring
for that so if you know how to do that
uh come come work at com
all right let's move on let's move on
all right
we're going into the calvi people hard
at work in the caliber
people are harder
no no one's in the cafe
oh those seats no those aren't secrets
this is just for circuit spoke man which
we're gonna go visit in a minute
uh here's another bathroom
don't want winner to see that this is
alex's office
i don't know if she has secrets
um
no no secrets
there aren't really secrets i don't know
why i keep saying that uh this is the
the snack area check out our drink
fridge bro bro it's like google bro it's
like google
um
we got snacks
um
okay another meeting room i don't think
anyone's ever had a meeting
so i don't know what we're gonna do with
it we have we have a symmetric fiber
coming five gigabits symmetric five are
coming but
oh yeah alex's off is nice right alex
nelson make nice things
oh yeah you wanna see some here's some
networking i said my dad and i did the
wiring
right
oh guys guys the office is unbelievable
no it's it's massive all right let's go
let's go visit research research is hard
at work so we gotta be quiet
do you want to say anything to the
stream
so much space oh yeah this is harold's
office
i promised myself not to get anything
nice
[Laughter]
station
oh oh you're going to yeah we already
bought the think station
sounds good this is this is the sarah's
office this is the rest of research
yeah we're doing we got 800 people this
is we're doing recruiting yeah there's
plenty of space there's plenty of space
yeah you want to do machine learning
only if you're really really good that's
the hardest team to get hired for
um
we're gonna put a laundry machine in
here this is the executive bathroom
uh where we have a shower
um no no no no you guys know about uh
the mythical man month right you got to
give people at least 100 square feet so
we doubled that when it was 200. you
know you need a margin
this is research again we're hiring uh
the hardest team to get hired for here
uh so if you're very very good and you
want to come here and do machine
learning uh come join this is the
research lounge
um you can see that it's uh luxurious
all right
um
how much is our lease bro we raised
money bro
bro wait wait guys
this is the upstairs we haven't even
gone to see the production in the data
center yet this place is unreal
we raised money don't worry about it
don't worry about it cheap cheap cheap
we got a great deal we got a great deal
we did it at the top of the market
insane valuation you know all this shit
right
um and now where this is the all hands
room where we have meetings
for everybody
that's a traffic light
uh
some clocks
and a tv
and now if we go back here we're back at
my office
where we started
and that is the upstairs of karma
uh so
i don't know where'd my chat go
no there it is
okay so we're here in san diego in old
town san diego absolutely beautiful
place uh if you want to come work here
uh
either go to jobs at comma dot ai that's
uh you can get commentary i slash jobs
see our page see what we're hiring for
look
you know if you look you know if you're
good right
um
have skills
come work here have skills we work hard
we solve problems it's straightforward
it's straightforward um who'd have
thought ai was gonna be solved that nah
uh
but uh
you just want to hang out with me nah
that's not what it's for but if you're
really good you can apply a georgia
commandant ai but everyone who usually
does that is kind of
do the programming challenge
can you work remote fuck no
what what did elon say go pretend to
work somewhere else there we go um
right brutal right
um
well karpathy joined i don't know go ask
him
uh
look if you've got a nice salary look if
it's enough to live on if you're if
you're about that maximizing your tco go
throw your life away selling ads man
actually i'm not even sure that
maximizes tco anymore you might do
better here but if you're a tco
maximizer i'll smell you and i'll throw
you the fuck out of the building that's
right okay cool uh
why do i dislike remote work because
it's stupid
uh work is life
uh that doesn't mean you spend your
whole life working right but no one
would do would you do a remote marriage
right
oh yeah i'm gonna i'm married remotely
yeah i'm gonna i'm gonna raise my kids
remotely no you wouldn't do that right
so why are you doing work remotely so
i'm saying ah cool now that that's over
let's go yes we have equity
uh
look at the equity bonuses salary yes
yes yes um competitive with
uh most you know
honestly you'll probably make more money
here than you will working at a big tech
ad company now
over a long horizon if you produce value
um all right cool would you prefer
remote sex exactly exactly this guy gets
it this guy box all right
um let's go
to see the bottom floor this is only the
first floor you guys it hasn't even
started yet wait till you see the bottom
floor is even crazier
all right
should we should we take the elevator
should we take our own private elevator
uh
our fountain
i don't know when it turns on no one's
figured that out yet no one's figured
out how the fountain works yet
um
yeah yeah right right right check it out
we got a gardener we got a landscaper
bros
got a landscaper
uh work from home doesn't suit top-down
funding personality driven operation nah
look
guys
i you know i listened to i listened to
uh john carmax lex freeman yesterday
like you come here to work hard you
build something incredible right
um
yeah spanish villa right
all right i don't know but you're not
even seeing the craziest stuff yet get
ready
uh do we hire out of boot camps again
it depends right if you're like you did
a boot camp because you majored in
physics and you just wanted to get into
computers then maybe if like you majored
in communications you went to a boot
camp because i really want to get into
programming i'm probably not i'm going
to be honest with you about that um
no look
it's a place to work for people who have
skills and want to come and apply those
skills and create something great
um
a lot of self-taught people again we
don't care if your college degree or
anything like that
you're just gonna be asked questions and
if you know the answers
uh you're right
uh we pay relocation bro like
again these kind of things are i think
you're thinking about it the wrong way
yeah of course like we'll pay a
reasonable relocation but
if you're thinking about it like a a job
it's probably not for you right
you can go
and it's i mean it's a sad kind of
dichotomy of of
you know what the what the economy looks
like right there's a there's there's
people sort of like below the api line
and above the api line everyone here is
above the api line
uh it's a lifestyle works a lifestyle
right
uh you know when said no you don't get a
salary of course you get a salary bros
of course uh
you're saying something about carmack uh
yeah yeah no look i think carmax got the
right idea you know i i love i love like
the early story of in software and those
kind of things it's kind of what uh
i'd be happy if we went down in history
and had built
a calibration challenge still a good way
to get interview absolutely yeah if you
do well on that
um
we pay we pay good salaries uh we do
give relocation bonuses
uh you know you're gonna probably make
most of your money off of equity
but again it's it's startup equity you
know it's not a scam it's 1x vc multiple
18.1 million raised that kind of stuff
uh but you know
we're gonna sell self-driving cars
yeah maybe maybe that's what else i
didn't talk about the mission
solve self-driving cars while delivering
shippable intermediaries and that's it
nothing else
people are like george but don't you
nope nope it's actually just that all
right cool
uh oh it's locked all right we gotta go
in here
all right
welcome
we really can't disturb production
because if we disturb production the
orders won't ship
and if the orders don't ship
then we're in trouble
get ready for this guys
welcome
to the state-of-the-art comm ai
production facility
we'll start we'll start at the other end
because it's a it's a it's a it's a line
this is our lens focusing room
this is where lenses get focused we're
testing dust for guys i'm serious we're
building out a hardware company here
we gotta allow we gotta we got a
positive pressure machine keep the dust
out of here this is where cameras go
got a mirror here to you know focus at
further distances than
what's on the table
do not open
okay so we're gonna start down here
over at circuit spoke
you guys playing with the aoi machine
yes oh you want to show the the twitches
oh nice
which component you want to see
we're going to take super high
resolution pictures of every comma 3
board and then like whenever there's a
defect we're going to know what went
wrong
why is the color off no because there's
this is the rgb that's the rgb thing
oh
wait what
what did that switch to
this is just the white line no no no but
what was the other one
oh this one huh
so that was the
it's like that these things those are
the rgb this thing's fancy
man this was worth the money we paid for
it
looks like it's got like carl zeiss
optics
yeah and it has actually doesn't work
with that the door open the email button
this is the my 12 but we bought a new
one of these we actually have my 300
coming it's gonna go right here uh this
is a transformer kids this is why you
don't do transformers at 60 hertz
um this is power we got power for this
this this facility
uh
now we understand why no one's in the
cowboy all right gonna walk quietly to
production
production
they go down the line they get more and
more built
they end up on this cart
and they end up over here
on the stress test
uh every comma three goes through a
comprehensive 24-hour stress test uh
where we try our best to break them
before we send them to you so it's not
broken for you
um
we have so much room now
state of the art oh yeah we're doing
manufacturing see now all the people
showed up to the stream we haven't been
to the data center yet
that's colin's desk
let's see i don't even know what i don't
even know everything that's here oh you
guys want to see the biggest fan
fulfillment
hello
can't just if we disturb people the
orders don't ship we need the ownership
so we can make money and pay for all
this oh yes welcome to the nod of data
center
yeah no it's not a data center that'd be
a lie i told you it was a data center
uh
oh no no we haven't even gotten to the
fans yet
3d printer room
okay
let's see who's here
oh we're on twitch
the fans just ran for the first time oh
they work
[Laughter]
you would not believe how large the fans
are yeah this is this is a compute
cluster it's not a data center
definitely not
um
no no no like you don't even understand
what's behind this this is a fan
this is a fan
[Applause]
variable frequency drive whoop sorry
there's more fans back there we have
exhaust we have intake it's dual zone
all right again i don't know what's
going on here we shouldn't disturb
anybody
uh
and go look at the fans in the in the
parking lot i think though
dude
yeah yeah the fans right right is this
shit unbelievable or what
[Applause]
all right
wanna see what's behind this
fan you ever seen willy wonka that's the
kind we got willy wonka fans
oh here's our ram
[Applause]
no we don't have a tesla
we didn't buy one though we get so much
parking right let's go to the parking
lot
no i've mostly drive the ev6 now
this is that's
garage one
oh hang on
let me get my key out
for garage too where in cali is this san
diego
we are in san diego california
um oh someone's got a tesla
i don't know who's it is but it's here
here's the rest of our fleet uh we have
an accord we have a sonata we have a
civic we have a rav4
um this
we're gonna have an outdoor chill area
here we're gonna put a machine shop in
there
um that's pallets full of hoverboards to
turn into bodies
uh yeah
no san diego bryce we could go look all
the bodies yeah yeah guys
i i did tell you we're gonna solve ai
right it's not gonna stop at
self-driving cars what you think we're
gonna we're gonna solve self-driving
cars and we're gonna com is only doing
level two
oh my god
i just i got so bored i got so bored
just trying to like correct the
narrative man i'm not correct the record
i'm not a political shill organization
right like i'm i'm here to just
you know we're here to build this i
think people who get it get it
[Applause]
um
yeah the comma three is a head you know
it's got it's got two eyes two ears and
a mouth
breathes air
just for a slightly different purpose
um why isn't tesla going the
reinforcement learning route we're not
pure rl uh our models are look if you're
good enough you get a job here i get to
see how the models work they're kind of
magical it's kind of past the state of
the art which upsets me by the way i
wish we weren't past the state of the
art because then we could just read
papers and implement them
um but
[Applause]
i don't know what's going on here we got
some wires
[Applause]
out on the porch
this is a porch we're gonna get some
torch furniture
i don't know if we can actually get in
these doors we might have to walk around
uh
what about the rotterdam office over san
diego only
uh yep the location is san diego
uh pretty close to downtown
beautiful beautiful area
very high quality of life down here
um man we're trying to solve a very hard
problem
and i want to build the kind of company
that uh
[Applause]
who's this
someone's got a key
what car is that
is it like oh this is the kia optima are
we on one of those
all right cool we are back
i want to build the kind of company that
i would want to work for when i was
younger you know
bro you're like pablo escobar with a
compound well i thank you i think
uh do we accept non-us people yeah
absolutely uh we'll work with you we'll
try our best to get a visa uh you know i
think the u.s immigration policy sucks
uh but we'll try our best again if
you're talented uh
we want you to come work here
do we accept aliens bro i'd hire anyone
we don't discriminate discriminations
for losers
can you live in tijuana and work here
yeah sure
if you want to do the uh sit in la lania
every day
oh no it's failing it's failing
all right all right we're coming back to
my office i got an access point right
above my head
all right
bros
uh all right
we're back we're back
uh no we have ubiquity aps it's it's not
the uh it's not the aps does it doesn't
see the ip
we got the best ubiquity ips uh it's not
that it's the internet
uh we're getting fiber
just
uh you know you guys
the foyer needs to have these three
people come visit and you got that it's
just it's a hassle to do anything but
we're gonna set this place up we got a
five year lease here
we're gonna be here for five years
uh
a masseuse yeah we do them once a week
usually or maybe maybe once every every
other week
every other week we got a masseuse we
got nice meeting rooms to have massages
in now
for a five star five star uh we have
lunch and dinner
uh we have a lunch and dinner uh chef we
have different chefs because we like
diversity you know fans of diversity
here comma
um
you gotta have diversity in your data
set you got a diversity in your diet
diversity is important
uh
no no get your mind out of the gutter uh
chefs
a petting zoo by the water cooler i have
been thinking about buying goats but
that's unrelated
um
no seriously uh if you wanna come work
here uh we're hiring for infrastructure
uh we're hiring for open pilot uh if you
wanna get a job for open pilot submit
pull requests i'll start working with
the open source software
i mean that's really the only way to get
a job with openpilot it's like
you know do some pull requests and
we think your work's good we'll hire you
but i don't want to do any work for okay
then it's not for you um right
uh no but i mean look that's like
uh
who else would we want to hire all right
we want to hire the people who can make
contributions to openpilot what's the
best way to show you can make
contributions to openpower just do it
i'm not gonna check your gpa bro but
what's your sat score i don't care
probably you could be i'm literally i'll
hire alien man if alien shows up you
can't work remote though you can't work
remote you got it you got to land the
spaceship or teleport or whatever you
got man that's cool come to work however
you want
all the cars are available for employees
to use
um more if you're not from the states
we'll try our best
uh again you got the skills we'll try
our best to uh to get you here
uh
yeah
the new office is crazy uh it's a bit
overwhelming it's pretty empty still
um
no why would i care about a degree you
want to get hired for open pilot uh
submit the pull request open pilot
uh
research is the hardest team to get
hired for the best way to do that is
probably get an internship first
uh where the bar is a little bit lower
for research interns and if you uh ship
things during your internship uh that
are good uh we'll bring you on full time
for research that's the team building
the models
um open pilots the team maintaining the
software
um if you want to get hired for the body
uh that's that's a bit new i'm mostly
dealing with with that uh if you want to
if you think you can make kenny here do
stuff
um you know
it can balance and it can move the knee
joints just not at the same time
uh you know we need to build like a
like a model you can download uh mujoku
build a model if you figure out the
center of gravity of each thing and your
pivot points and all that kind of stuff
right
um
but i hire visually impaired people sure
the only thing that we discriminate
based on is whether you can produce
value for this company without
detracting value from this company all
right that's it
um
uh for infrastructure look machine
learning is infrastructure there's so
much infrastructure that needs doing uh
you know we got that data center we've
got 180 gpus in there
um
do we sponsor visas yeah we do
uh yeah if you're if you're uh we'll try
our best look
u.s immigration's fucked uh we will we
will absolutely try our best to get you
here if you have the skills
um
i don't know what security is security
is everyone's responsibility security is
infrastructure we don't have security
engineers we're not gonna have a red
team we don't have anyone at comma whose
job it is to just tell other people what
to do right like it's just we don't have
that it's not even my job
you know i try i try to guys it's more
like herding sheep and then you know
you've got to write code too
yo tinygrad's coming open pilot
um i i got the test passing this morning
um
on-prem info looks so fun what type of
pr to submit if you want a job for
infrastructure
that one the pipeline's a bit more old
school
uh if you
uh send a resume
and uh you'll get asked questions
infrastructure i feel i'm pretty good at
telling whether you're going to be good
or not by asking i can ask questions
like all across the computation stack
um and if you can answer questions all
across the computation stack
you know i'm going to ask you from the
very high level to like what web
protocols look like to the very low
level what are sys calls
um and everything in between where were
all the buffers what's malik how are
things built on top of metal was nudo
and c plus right all these things what's
rust's innovation uh we don't need
anything about rust but you should know
that actually you should know if you
don't know about a borrower checker
where are you man like just where are
you you know
um
so uh no we don't go to rest but
uh you should know that right you should
understand the trade-offs made for go
you get infrastructure we just do a
straight-up interview for so
infrastructure we'll do an interview for
um
research the best way to get hired is
through an internship and doing the uh
calibration challenge
uh openpilot the best way to get higher
to submit pull request to the open pilot
repo
and then if you want to get hired for
the body team uh reach out to me
uh you're like yo i worked at boston
dynamics for four years now i'm
interested i'm interested right you come
work here um
let's uh let's let's make this thing
dance
um
seems too easy what's too easy
we're still in san diego we are in san
diego uh this is in old town
uh that's why it looks like a 1997
1850s spanish villa
uh do i need a pre-chair no we're not
hiring preachers we're hiring uh
engineers uh no look some of you guys
pissed me off with the comp questions
just cause like you know you read team
lodge and just like who are these
disgusting people nobody should ever
hire them but the comp is pretty good
um
we're doing uh
you know it's it's it's
six-figure software engineers
um
and then equity uh on top of that
uh
total comp
you know it actually is competitive with
with uh with bigger tech companies again
it's startup equity though it's not
liquid equity blah blah blah blah growth
potential blah blah blah blah you should
you should know all these trade-offs um
give you an idea of the comp i mean
again
you know
we used to just post salaries
and i don't know how i feel about that
uh
you can chew we we do a you can choose
between equity and salary when you start
we usually give people three options
um our current valuation is 500 million
dollars that was what our last round was
raised at uh
employees have sold equity of that
valuation as well
uh you know no restrictions on the uh
on on the sale right what's for your
best on your cliff but no restrictions
on sale that equity
uh we have one xvc multiple we've raised
18.1 million so i feel good about uh all
that sort of stuff
uh what if you're in underground you
want to write code for free so um let me
tell you anyone who wants to come work
here for free we would never hire and
the reason for that is you're not
actually looking for a job you're
looking for an education and education
actually works the other direction you
have to pay for that
um so no we never hire anyone who wants
to work for free
uh
again like for 4k month is so low it's
like practically free
um
yeah i mean look you know
you want to sell self-driving cars come
work here right like i think we're going
to do it
um especially with carpathia leaving
tesla
uh with a bunch of the directional
choices they've made i think we have a
decent chance of beating them
it's gonna take you know everything
takes a long time
but i think there's actually a serious
chance we're gonna win self-driving
course
uh i think yeah i think there's a decent
chance we beat tesla
it's it's not
tesla's stack is just a lot more
complicated than ours um
carmack was talking about this he's like
agi's gonna be ten thousand lions right
and i agree i agree
um we really try our best to everything
we do think about how it does apply to
agi
uh and i have a definition of agi by the
way just a machine that can do
everything a person can do right that's
that's it that's there's nothing i don't
even think like the concept of general
intelligence i don't care to define it i
love i loved carmack's pragmatism you
know i'm not likes freedom it's just so
like if you want to talk about the
meaning of life bro like i don't care
all right like i'm here i want to build
things right i like that attitude
um
no i think there's some companies like
waymo and cruz that are going to be
huge
you know wastes right just like this
money being blown on absolutely the
dumbest stuff
um i think someone like tesla is going
to be like oh cool that's the solution
and they'll ship their own version of it
in two years right
um
if they don't beat us by two years right
there's a chance they beat us by two
years uh though if they continue down
the labeling route again you don't
really know what's going on there but it
looks like the wrath they're taking i
don't think that's ever going to solve
the drop of course
um i think there is no
the germans will eat us alive i don't
think so
uh haven't just spent some time in
germany i'm not bullish on the german
solving self-driving cars
um
it's a few startups that are a bit
better companies like wave
uh there's an argument to be made that
it's actually not even gonna be a
self-driving car company that solves
self-driving cars it's gonna be someone
like deepmind
um deepmind's going to release here's
like you know what you know what you
know what the closest thing i've seen to
our architecture that's released is the
open ai plays minecraft paper right so
it's possible that just open ai deepmind
are going to solve self-driving cars um
and then this puts comma in a great
position too we can move very quickly
and implement uh whatever the paper is
yeah
bmw they're not solving self-driving
cars
uh bro google wins
well
yes and no right
um
i don't know how tied deepmind really is
to google
how quickly something that deepmind
would do would ever actually make its
way into a car
uh
but yeah i know i look i think i think
d-min and opening i are unquestionably
the leading
ai research places today's
is sort of sort of it's sort of very
it's unapplied and it's unclear exactly
what the thing's going to look like
right maybe tesla is right or maybe we
are
our approach looks much more like
tesla's in the sense of i think that in
order to solve ai you kind of have to be
embodied
right like it's all well and good that
you solve games
um and i think if you can't solve games
you can't solve ai but i don't think
that any game even of arbitrary
complexity
uh will allow well if you restrict
yourself in the games like i like what
mu zero is doing where you don't get
access to a uh
something that can infinitely query the
state but you know you need to deal with
sample efficiency and reinforcement
learning if you want to really get these
things to uh to be online but
self-driving cars are not ai either we
think we can solve self-driving cars
without solving a gi uh we don't think
we can make the body cooking clean
without really selling edgy i think that
one might actually be ai complete but
maybe i'm even wrong about that
um what do you think of audrey leaving
tesla look i'm not gonna speculate
whatever he said about it a lot of
respect for the man uh you know
i'm sure he has his reasons
no full self-driving does not need a
different architecture of roads and
that's really dumb because humans can
drive you have an existence proof right
we just need to build we need to take
the human
and we need to here i'll
i will dismount my comma
three so i can demo this we need to take
what's ever in here and put it in here
yeah you take what's in here and you put
it in here you see the eyes i i i i
right you can't see them but there's
little ears in here these are ears
it's got a mouth
that both breathes and speaks
um yeah i mean it's a head right a
little head
see it's ahead
me and my comma three you gonna buy one
of these by the way two grand calm down
ai
i wouldn't putting humans in it be
unethical virtual humans man virtual
humans no real humans were harmed in the
production of the commentary
uh stability ai has four four thousand
uh a100s yeah nice vc money burned bro
um no i'm look it's cool that i i have
those of people that release the open
source dolly respect
um
someday we have to solve agi yeah that's
kind of our goal
uh you know solve ai while delivering
shippable intermediaries maybe that's
the overarching thing but we're focused
on self-driving cars now i think
self-driving cars are the best applied
ai problem i think if you say solve ai i
don't think ai is going to be solved in
five years i do think that it is
possible that self-driving cars will be
solved in five years
um it's very hard to talk about the
future beyond five years that's why we
don't uh
i don't know that's why the mission's
not ai we should pull any areas but
we're gonna show off these bodies at ces
uh hopefully we're gonna we're gonna get
on tick tock man with the bodies we're
gonna put them on tick tock right hey
kenny you excited for tick tock you
excited for tick tock you're gonna be on
tick tock oh he's headless now i chop
his head off um
hoverboard motors bro
uh are we attempting to open source our
products
the software's all open source not the
hardware
uh
when do you consider self-driving solved
when you have a machine that can drive a
car safer than a human safe or better
multiple things right
less disengagement than a human
uh
scale to more parameters to solve
driving i don't think it's that that's
not the problem uh our
our big issue right now okay so we have
these like we're learning in simulation
we've written the simulator but like to
kind of get
how do you get the simulator to transfer
to the real world is kind of the big
thing we're struggling with now and
transfers pretty well right the new
model shipped in open pilot today don't
use lanes they are fully trained in the
simulator but the simulator is not
perfect
all right so as we get the simulator
closer and closer to perfect uh it
things drain better
why do we have a camera pointing at the
driver make sure they're paying
attention level two pay attention at all
times
um
oh that's getting oh we're getting
i think the next one's going to contain
this upgrade we now have end-to-end
driver monitoring so we can tell from if
the driver actually takes over whether
they're ready to take over or not no
don't use your phone we're going to
catch you we do pretty well now but
we'll do
better um
yeah karpathy's a youtuber yo yo if he
wants to let's do a let's do a joint
stream
um
milestones for taco bell drive
all right all right odds are down to 60
i don't know harold might have a
different opinion
um we'd love to do it uh if we do
succeed at taco bell we're taking the
whole team on all expenses paid trip to
hawaii
that's succeeding at taco bell means
getting in the car typing in taco bell
and chilling while the car drives you to
taco bell
um
tesla fsd can do this sometimes uh which
tesla fsd would
would meet this uh requirement
um
[Music]
we would consider making an early
warning system for wildfires bro what am
i like some ngo trying to scam
government dollars we're here to solve
sell driving cars and then solve ai
well i think it's just from a person's
point of view you could put lots of
cameras on the car
oh oh you know
bike shedding bro bike shedding that's
what that is if you can't solve it with
two eyes looking forward right we don't
even need this camera we're still
getting disengagements because of this
camera i don't even have antenna
longitudinal this camera can see red
lights and stop signs so i can't stop at
them software it's all software
why do i want to solve ai i don't know
seems cool
i want to know what i am
uh
yeah six or seven things that'll make up
agi i generally agree with that i
generally agree that like it's going to
be six or seven tricks when we look at
it
uh that like oh well okay cool
um if you saw the ai the ai will take
your job so
uh what is the benefit of solving ai
boring boring boring we're just gonna do
it it's cool
um simulation is double-edged sword
well you can only train in the real
world now can you right we don't have
the sample efficiencies yet we'll get
there we'll get to
so we're in second paradigm common now
first paradigm comma was supervised
learning tesla's still in first paradigm
uh we've now moved to second paradigm
which is training and simulation and the
third paradigm learning is going to be
reinforcement learning directly on the
world uh but you need second paradigm
because
i can get into the technicals of why but
i don't know uh come work here we talk
about it all the time
do i really think that two cameras don't
have to solve self-driving i think one
camera is enough to solve self-driving
um
you know you know why i think one camera
is enough because one-eyed people can
drive cars
do we use our own simulator are we
training that
uh
i think memory will work i don't know
um
will be more on the subject of safety
well like i mean
look we're not building
safety devices our goal of comma is to
make sure that our devices do not make
driving less safe and we definitely
succeed at that we actually from the
data we have they make driving safer but
this isn't what we're marketing we're
not trying to like say buy this for
safety it's just like it's just like a
it's almost like polite you know what i
mean like you're not gonna buy this and
become less safe you're actually
probably gonna become
uh marginally more safe right but again
it's marginal right it can't be every
single person some people might you know
buy this and be an idiot and think they
can fall asleep uh don't do that pay
attention at all times level two
uh but yeah i mean chill driving to safe
driving
uh what kind of exceptions could we make
for carmichael make exceptions this is
look it's a very opt-in environment
right you come here because you want to
come work here
um
one of people can move their head yeah i
think move their head so maybe we need
to make the common neck
um
what about 360 degree camera well this
thing is a 360 degree camera so we have
two on the front we also have one in the
back here so this this can see the full
360.
um we're 21 employees right now
how do we prevent overheating we got fan
uh
just guiding or reacting i don't know
whatever that means we just use radar on
open pilot now uh but this is more of a
it's because the policy is a lot simpler
when you have a precise speed at
distance
um but the actually the mobile guy said
this pretty well it's like just fix it
in your policy we're not going to fix it
our policy we're just going to remove
the radar when we ship and and long
uh
why have we all shied away from lidar do
you have a lidar no can you drive a car
yes
sounds like you don't need a lighter
just saying
um
light are still very stupid
uh do we have investors we have
investors we've raised 18.1 million we
have like a lifetime revenue of
something like 13 million
um so yeah we made we've made 13 million
to date
uh so you know that's the funding is
it was 50 50. that would be before we
raised 10 million recently before we
raised that money one of my goals was we
absolutely have to exceed the previous
amount raised in revenue
um
and that rule applies uh forever you
know i used to have a more hard-line
stance on not raising money it turns out
you just don't want to raise money from
vcs uh you can raise money from like
normal people who want to invest and
it's pretty chill
uh like i like i like our new crop of
investors look at it's not that i don't
like andreessen they're not bad um but
they are not really incentive aligned
with you
all right we can get into like why that
is the problem of vcs but
um
we'd like to give me more money well
next round maybe i don't know i hope we
never have to raise again i always hope
we never have to raise again
um i mean we're not raising in this
economy if there's like at the end of
last year i was just like the boom times
are crazy let's get some money
um
we're doing better i was upset like a
month ago i thought oh my god we're not
really profitable but i went through
finances quite a bit
on my vacation and it turns out that a
lot of these costs are transient just
from moving uh building that new compute
cluster and building circuit spoke
circuit spoke is our is our production
facility
um
no we don't plan to ipo i'm not selling
out the bankers bro you're just selling
the bankers on your ipo
i do think the code for agi will be
simple yeah
uh no the 845 is not really a limitation
um remember that for every
like it would be harder for us to scale
up models because we'd have to scale up
our training equally much right our
training now uses hundreds of gpus to
produce one efficient mp2
uh so yeah it's but no it it it's not a
problem of model size it's really not
model size is this thing you can always
do later and get free improvements
it has a lot more to do with the
transfer from simulation to reality and
getting the loss function correct
um
i mean aptera is building a motorcycle
right all the trade-offs that come with
motorcycles come with hep terrace
uh i also you know again
believe things when they ship right go
buy a honda cbr
uh can you simply buy shares the current
valuation no because com is private
equity you might be able to um if you
found someone who is willing to sell
shares
uh
but no and then if you found someone
who's willing to sell shares they're
probably likely to be common shares and
not preferred shares which are similar
but the main difference is preferred
shares have a liquidation preference
um so
again like it would comma would have to
fall pretty far to somehow be worth less
than 18.1 million this is kind of how i
justified it the last investors i don't
know like i'm not a lawyer i don't
really know anything about this stuff i
try to be fair to everybody i like being
fair
uh i don't like ripping people off i
don't like getting ripped off
um are cameras in the dark working
better than the human eye at night
yeah or you
depends they can
uh they can especially the human eye
actually has a pretty big lens
uh it's big uh it looked like the new
iphone right so are these cameras gonna
beat it
maybe not that doesn't really matter
well is the front camera being used for
driving or just driving monitoring funny
you ask come on our discord now uh go in
the comma pencil channel and help label
front camera images and soon we'll start
using it for blind spot detection
can i share a bit more about how to make
a good driving simulator well our
simulator is a it's a
called a small offset simulator right it
simulates re it uses real world
scenarios it doesn't use made-up
scenarios because you're making up the
scenario
you're what's the policy of the other
cars right
um
there's some unsolved research problems
here
where it's
like inverse reinforcement learning is a
joke
like but that is the thing you want we
want to build something that
implements the human policy
uh but this is really hard
how do we do blind spot detection right
now we just use the radars in the car
but there's other parts you need to get
and we'll do in the cameras but it's
we're not fully there yet all lane
change requires you to confirm with a
nudge
what's my opinion on robo taxis what you
mean like uber
oh it has a human in it oh see i don't
discriminate right there's not really a
difference between humans and robots
i love uber
18.1 raised the most recent round was at
a 500 million dollar pre-money valuation
the most recent 10 million
uh would i take an acquisition offer
probably not
um everyone who approaches are such
clowns like these m a people reach out i
reply to them with two words how much
and then they reply to me with a
paragraph that doesn't have a number in
it and i don't reply again right if you
want to buy comma
send me a number at least that's
respectful right
would i sell to uber no
toxic culture bro
ah
any intern systems engineer position
well what do you mean by intern right
so
are you is it an internship because
you're in school and you only have a
summer then we might be able to make
something happen if you think
internships are some place where you can
like sit around and learn and it's not
it's not an internship but you know we
do internships for everything
internships are open pilot internships
for infrastructure internships for
research
uh if you're in school or for some other
reason you want to work three months and
not
uh full time
um how do i keep work and home life
separate
i have a
desk here and i go home and then i don't
i have a desk there but i do other stuff
at that desk
um how much does an internship pay uh
comparable to other tech internships
uh job really you want to see if you fit
in yeah apply
uh apply we'll do
internships do we have a cyber security
team i definitely anyone who uses the
word cyber is immediately disqualified
go work for wired magazine bro
comparable for internships in cali yeah
i i don't know what i don't know what
the internet salary is now but it's
enough to pay for things and make some
money actually if you live like a
college student
gatekeeping much yeah bro no one uses
the word cyber except for journalists
it's never good everything after cyber
is never good cyberspace no no no it's
always like cyber terrorism
cyberstalking
cybernetics what's that man
i will drink in recess an antidote for
modern times
cyber racism man see there you go you
really get a job in the media
uh
do i expect people to
still mod cars so the industry doesn't
have to purchase open pilot is open
source they can just take it and run it
it's free
you'll be dedicated to folks to prevent
someone to tamper with models and otas
well yeah that's called infrastructure
right infrastructure involves security
you have to write secure infrastructure
it's a separate job
that's like saying like what we have the
designers and then we have the people
who uh proofread the design it's not
proof of your own damn design right
um
you blocks less comma three yeah we're
gonna take the boxes out soon so yeah we
got three we got three goals now that we
got a lot more people in here they're on
the board
um compatibility
and communicating that compatibility so
you can check out the new compatibility
page see if your car is compatible we
support over 200 cars now
uh with open pilot which is absolutely
insane like from where we came from we
had two now we have 200 100x bro 100x
love that 100x improved driving
experience this is where you know we're
that's what the whole research team's
working on uh we're working on better
models
um
end-to-end longitudinal
uh
integrating navigation with the driving
and then cheaper for us and more
reliable common threes so we're trying
to bring the cost down to the comma
three not for you but for us
right now they cost us over a thousand
dollars each to make i'd like to bring
that down to 500 and then we're sitting
on real profit right
75 gross margin that's pretty good
that's pretty good i don't know what
gross margin is but that sounds like a
good amount of it um and then more
reliable uh common threes are i think
the current failure rate something like
eight percent
um comma twos were 25 so we're
definitely trending in the right
direction as a company
but uh yeah i want to get that down to
one or two
uh we have you i mean you saw you said
that production facility right part of
the reason we bring production now is i
want these things to never ever break
and if they break we're going to bring
it back here we're going to put in that
fancy camera i showed you guys we're
going to figure out exactly what broke
and then modify the design to make sure
it doesn't happen
you know you want to make something
great well make it 10 times and improve
it a little bit every time right
um what's the business model post full
self-driving we sell common bodies we're
going to have stores and malls now i'm
serious about this i'm serious about
this we're going to have stores and
malls and you're going to walk in you're
going to walk out with a calm body and
it's gonna like hi i'm your comma body i
can cook and clean and do dishes and
drive your car right chill
how long does it usually take for them
to break comma threes well it's like
yeah the failure it's like eight percent
a year or so
but will i ever get into politics no
it's for losers man
uh oh my god the people who are like oh
they're gonna encrypt the canvas they're
to encrypt the camera where they putting
the key bro
oh you mean in the car oh i'm just
getting the key out yeah let me get the
key hang on hang on yeah okay i'm not
that worried about it by the way if you
if you think we can't crack toyota
security go vote for it
um go vote for it you know it's just
like i'm not working for free you know
i'm not going to fall for those nerd
snipes where it's like bro do this
uh
body compatible with 1687 mustang yeah
that's the idea right kenny will get in
your car and drive it
uh
how to invest you can't invest
uh it's private equity
when i raise money now not raising money
in this terrible economy
um how soon do we figure out if a
module's failing i mean you have a spike
right at the beginning some of them fail
quickly and then some of them fail you
know randomly after that over a long
period of time uh we had a new failure
to fan malfunctions but it's not really
a malfunction like it's just it's a
software issue some of these things are
just going to fix the software
uh what do employees do with equity if
you don't wanna ipo or get acquired i
don't know what's up to that man
uh you can sell your equity
uh to investors i don't understand how
this all works man
um
no i mean oh well actually no here's the
real answer uh i want to make a lot of
money and then i want to do stock
buybacks
um i mean i want to make a lot of money
i think there's a lot of money to be
made selling these little boxes to
people right make a better box make a
perfect box we'll sell it to people to
compress right you make a box for more
then you sell it for more than it costs
you to make you make money you use that
money to reward the investors and the
shareholders that's business right it's
not scam business where you're just
passing the ponzi baton on to the next
guy we're going to ipo and then the
bankers are going to get money from the
fed which prints the money ponzi bro we
are going to uh
make a device
sell it for more than it costs us to
make and then we're going to use this
profit
to grow the company and to do
share buybacks
maybe pay dividends is the company
profitable right now not these quarters
because we spent a lot of money on this
office and on that new equipment but uh
we'll be back to profitable soon
am i in love with money no i'm no longer
money for
it sounds so reasonable right it sounds
so reasonable hey
gotta ask gotta ask people don't wanna
ipo see that guy who asked that you
don't even trip me up in the way of
thinking it's like maybe you do need to
ipo
or or get acquired to make your record
we have value wait a second no you don't
what about the other companies
well i guess everyone's thinking they're
ipo and they're going to sell out the
ban i'm not going to be owned by bankers
we're all by engineers man
um have we built a new not data center
yeah you still have a beautiful compute
cluster earlier in this video
um
edie long updates we're working harold
said he's not buying anything expensive
for his office until uh until he ships
the models
um am i richard and elon musk
considering elon musk is the richest man
in the world no
uh
did elon invest no
elon is not on our cat table
uh anything i was genuinely excited
about lately
i don't know
oh injection molding in-house no no no
that's that's the cheap to send out
um though i'm thinking of buying a uh i
do kind of want to start to make the
plastic spools for the 3d printers
um
my richer knowledge than elon well i
don't know always i'll have a knowledge
off if elon would like to
i look very smart thank you but don't
judge a person by their looks
uh looking forward to the day i buy out
tesla i don't think that's gonna happen
man i think we could buy like
gm
how long will commentaries get updates
uh until tomorrow bro if you get updates
any longer be happy
no i don't know how you think i have a
fucking schedule like you think i have
some some like oh well though comma 3 is
going to get updates and we have the
comma 3 team and that doesn't work like
that how long is it going to get updates
well at least as long as we're selling
them
there's no plans for new hardware we had
a common three as we canceled it uh
we're just going to make the comma three
cheaper and better and more reliable
ah
when the shutdown was that going live i
don't know man fuck politics
uh
full solve intelligence an engineer a
neuroscientist one engineer is sure
going to build it
it's the last physics book i read i told
you about project hail maryland sure
seemed like a physics book
um
bloom
i don't think you mean bloom filters the
way that you wrote it it sounds like you
mean a shit coin and if so i've never
heard of it
um
are the toilets good yeah we got
top-notch toilets bro
uh
any ui updates we did multi-lag we did
multi-light multi-line shift right
uh yeah we support we support chinese
and traditional chinese and korean and
uh i think maybe japanese all the
languages though there's like not much
overlap with english
um
a lot of people are excited about that i
think i think we merged a lot of uh
pull requests people want to do the
ports um do they have bidets we should
get some bidets man we'll get some good
days you you come work here you say you
want the days we gave your days i like
them
is mobileye gonna make it ngmi bro i
don't know yeah probably
um
do you wanna spy on your wife's car all
right
um
what's our tech stack
uh pie torch for the models
uh though we're writing a lot of
cuda hand coded cuda stuff now
uh
i don't know the blue male on this
build a career what's a career
uh
y'all got a gym we're putting one in
we're putting one it's gonna be good
it's gonna be good uh right now we pay
for gym memberships look i mean that's
like kind of a common philosophy you
know i really like the perks at google
uh it's just stuff that the company will
like you don't want to deal with having
your own car you don't want to deal with
where to get food like we got you bro i
gotta buy one of those fancy coffee
machines and buy a fancy coffee machine
um maybe when we when we ship something
good if i get these new cameras ported
we'll buy a fancy coffee machine new
camera's gonna save money
we have massages every other week
uh
you build info with micro services sort
of i mean you can read mini key value
mini key value is our distributed file
system i wrote it
um i wrote it and then greg actually
deployed it uh you know
um
yeah this is good stuff on the can of d
cars i don't know
am i worried about nuclear war
huh
i don't know man
nuke me bro make it quick
um how many hours a week do i work i
don't know like 100
80 to 100.
i mean like life is work i don't know
what i do the rest of the time sleep
sometimes i watch tv can i throw a
football
football but don't ask me to play
basketball
um
looking at training accelerators there
aren't any yet no this is a
gpus or where it's at
um
are we hiring yes we are hiring we are
hiring we're hiring for infrastructure
we're hiring for open pilot we're hiring
for research we're hiring for the body
team if you know how to make these
things work think like boston dynamics
bro you know how boston dynamics works
you come here you build it for the body
um we're hiring for infrastructure that
one's a straight up interview
i usually do the infrastructure
interviews ask you a whole lot of
questions know the entire compute stack
um you gotta you gotta get through a few
levels to get to me though i don't think
you can just kick interview if you wanna
have a phone call um
we do
uh research a lot of research comes in
through internships uh you get an
internship at research you produce
something of value that ships in three
months uh we give you a full-time offer
openpilot go on our github submit pull
requests to open pilot that's how you
get a job for that
um we're going to make autonomous robot
yeah you've seen you seen kenny sitting
right there
you got a job bringing coffee no you're
gonna you you don't have to make the
comma body do that i'm interested all
right the common bodies are gonna do
that
um
[Music]
any tips on how to make 10k in like an
hour
rob a bank
not a real tip but
now
trade on insane margin and then reset
the simulation until you hit
um
do you let devs access production yeah
anyone can have a station at the
computers
is pay competitive again like
yes but if you're asking that question
it's probably not for you
did we catch any ufos i don't know you
want to search our data set for ufos
well
we want to hire for that but we could
uh the tour already happened yeah yeah
you got to go back if you want to see
the tour
um
you'll apply that once you build your
own robot that walks around does useful
things yeah cool
uh
what would a research position actually
look like you know it's making the
models good
it's infrastructure it's a lot of its
infrastructure too right like if you
have experience you you you want to know
like what skill set gets you oh uh you
want to know what skill set gets you a
research position like if you're like oh
i just implemented like five papers
right and then yeah cool you have one of
the papers you made them work like great
we got a job here
um are you planning on expanding the
number of employees yeah we'll probably
hire
like 10 people the next couple years
um
how long is the new lease five years
five years we're here
no we don't do any remote work uh all
work is in person right here in san
diego
um
it's a culture thing
uh i love what elon said about remote
work i love that he dunked on it so now
i can dunk on it too he's like
you can pretend to work somewhere else
why san diego this place is beautiful
man i don't know
because san francisco is politically
incompetent
so is la
uh san diego's decent i love california
um remote work is here to stay go on
hacker news with your opinions bro
you know like it's remote work is okay
if you want to be viewed as a work unit
right if you want to be viewed as a work
unit that will quickly be replaced by an
ai remote works perfect for you
um we're absolutely hiring international
people though and we will try our best
to get you a visa in the u.s depending
on your situation
remote work is good for people with
lives outside work yeah maybe that's
really what it is right if you view work
as a separate thing from your life
what are you doing man
ah i did sienna's coming about tiny guy
we emailed about it
um
all right
do you see applying your tech to
medicine how do you think it works like
the only people who ever say that are
like scammers i feel like billy
mcfarland was going to apply his fire
festival tech to medicine
there's a life outside of work exactly
exactly you want to be great in a life's
work
um
i know you and the eu have different
perspectives and that's why all the tech
came out of america there's no eu google
interesting
um
two comp two countries have succeeded in
making internets all right there's
american internet and there's a chinese
internet and they have similar
philosophies that would work
um
internet was built by the government
what do you mean like google and
facebook were built by the government i
don't think so bro
um
yeah carmack talks about that pretending
hundred hour work weeks are productive
is an insane take well it is i mean it
is i agree that it's less marginally
productive per hour and not everyone
here you have to work 100 hours a week
like you know we're chill with the
vacation policy i don't necessarily
think that more work is uh is better and
smart work is better um this isn't you
know i honestly i think people work less
hours here than they do at uh at spacex
and tesla i i think i think elon maybe
gets us straight up a bit wrong i was in
it was insane the hours people worked at
spacex when i was there you know more
hours my work
it's unlimited vacation policy the
vacation policy is pretty chill but
again
if you're asking these questions right
like the kind of person who's like going
to choose between 10 jobs based on perk
and compensation shouldn't work here
i'm the kind of person who's like
yo i want to sell self-driving cars
and like
you may not think we're winning
but
if you think we're not winning i'm
curious why
right like i sometimes i think okay i'm
just super biased right i'm incredibly
biased obviously i see the cutting edge
stuff here i don't see the cutting edge
stuff at other companies
uh
but at the same time
i'm pretty smart i've spent a lot of
time thinking about this problem and i
don't think i'm deluding myself
um
fsd beta is cool and i do still give
tesla a higher chance of winning than us
if tesla does win we are very close
behind them
uh though recently i've seen a way that
we may leave frog tesla because you
could see where the issues are in full
self-driving beta for example you make a
change to whatever your policy is for
say you know stopping at a stop sign
right
and it improves it in some situations
but it hurts in other situations
and then you might need a new feature to
distinguish those two situations and if
you're doing that all by hand you're
never gonna get to level five
um latest home pilot release i'm i'm
glad you guys like the blog post yeah
the value team's really excited about
those
oh yeah if you if you haven't seen go to
blog.com.ai we have a blog we do a blog
post for every one of the open pilot
releases it just goes into all the
technical detail of what we're doing
uh i was an intern at spacex uh
four months
you know what i didn't understand about
tiny grad yeah he seemed to understand
it pretty well
um
i added linting this morning
so i
tried to clean the code quality up a
little
and then taco bell by the before the end
of the year right my odds have changed
to 60 percent
i'd love to see i wish there was like a
nice prediction market we could set up
can you get a job you stole company
secrets no don't bring your company
secrets here i don't want your company
secrets i don't believe in intellectual
property and i don't want your secrets
uh who writes the release blog post the
old pilot team
uh the old pilot team research everyone
writes basically what they what they uh
what they did
uh jim keller works at tens torrent yes
and i'm hoping they ship a chip soon
all right i think we'll do five more
minutes two more minutes five more
minutes
see if we get any good questions hiring
a game dev actually yeah
um if you have experience with with game
development
uh like i mean like the low level sort
of stuff right like it's interesting
today what game dev kind of means
like
game devs who like know how to write the
engines
is uh is certainly what we'd hire for
uh i i mean i've heard there's some
incredible programmers in that world and
that's just not really something i'm not
exposed to so yeah if you have
experience with with game programming i
mean like yeah unlike the kind of engine
level not like well i know how to drag
and drop in unity kind of stuff
custom shaders yeah i mean maybe i don't
know like apply it's kind of
infrastructure like apply for
infrastructure and say like you know
game stuff and i'll i'll grill you about
how gpus work and if you know yeah it's
pretty good
uh hiring a mobile dev
we'd hire
we have this like problem with front-end
stuff where no one's that excited to
work on it
if if you wanted to come take our like
front-end stuff like connect and cabana
and you're like i'm really passionate
about this and i want to make this stuff
incredible and top-notch then we'd hire
you
um the problem is we don't really have
like you're not going to be able to work
you have to be like really senior in
order to
in order to do that and then come like
come like own the cloud strategy here
uh
but you have to be like excited about it
you know
what do you mean not that much more
bureaucracy
i mean i signed a lease i put some
people in office it was easy no i
haven't alex said most of it you think i
did shit on t-shirt
i'm vaped before that all right you guys
remember vivian
um
there's fe stuff what's fe
uh how many years after fsd will you see
a clear path to itchy i don't know
which cloud is best uh we do have the
traffic light yeah i showed it to you in
the tour uh we use azure
uh
if i had a time machine what would i do
what these questions are getting stupid
you join like you missed the tour you
got to go back to the previous stream if
you want the tour
um
all right all right we'll do a quick
tour we'll do a quick tour part two and
then we're signing off because we gotta
go but we have a thousand people here i
can't just hang up on y'all we are
hiring and this whole stream is just a
chill for coming to work at comma in our
beautiful new office all right quick
tour let's go
oh i gotta get my key where's my key at
who asked about the traffic lights over
there
is this a house no this is our mansion
office man
compound bro is the office ai friendly
absolutely we're gonna have bodies
wandering this hallway soon
all right it's chill yeah we keep with
the brand you know
oh it's lunch time that's where everyone
is
there is too much
they try to pull off the
whole twist at the end of the season
again
it's lunch time are we hiring sofa
testers no
all right but we're going to take you to
the motion credit this is the cal bee
we're going to take you to the most
incredible part
wow closet question mark i don't know is
that a closet i don't know
all right no like we're still not even
where we started bros
we're not even where we started bros
oh wow this is we're speed running this
now we're speed running this no we're
not even where we started all right now
we're kind of back to where we started
that door goes to my office you see
that's back here in the foyer by the
traffic light oh and this is only the
top floor where the programmers work
i'm gonna show you guys the basement
real quick on some speed run shit let's
go
i don't know where that door goes man
probably somewhere magical
[Music]
so
this is production
we can't disturb them because they're
behind class
lens focusing
storage
production
production
wow crazy pros crazy bros crazy bros
crazy bros
bathrooms
oh yeah
and
the compute cluster wow
wow that's a fan that's a fan bros
that's a fan
wow
yeah we made it we made it
all right thank you all for joining if
you want to work here a jaw come high
slash jobs jobs at comma ai reach out
you know how to find us
incredible office downtown san diego
uh we're gonna solve ai uh and you can
join and get in early get rich get in
late get fucked right classic
all right cool uh thank you all for
watching love having you all here
um like and subscribe and hit the
whatever i don't even know man you know
what i'm saying come work here come work
here tell your smart friends go go tell
the smartest guy you know be like yo
come ai man
come solve ai
saw self-driving cars first then solve
ai
thank you thank you
bye
goodbye
[Music]
hello
is this good qualities
oh good good good I'm glad I'm glad no
potato quality I'm on a brand new iPhone
11 Pro here good quality all right good
good good good is what I like to hear
all right we got some tea and we got
some Lacroix and I'm in my brand new
office so as promised while we wait for
everybody to come in here and join our
our amazing coalition of people who are
definitely gonna smack the Buy button on
this product you know you know like I it
is it is really good it is it is a
really good product
I wouldn't know this isn't common prime
this products really good um come on
friends okay common friends okay common
phone is getting better you know common
friend but but this one this one is is
is months in the making
we're gonna show you some really cool
stuff today um I found a quote that was
really inspirational Oh
so I wanted to share that with you guys
it's this quote right here and I'm not
sure if it's backwards its first they
ignore you then they laugh at you then
they try to copy you then you change the
world and that quotes by Elizabeth
Holmes so you know I thought I thought
that quote was really inspirational so
let's let's go live
live Spain now
yeah I know I'm on a different Street
from the scheduled one I know why wait
I'm watching myself but it's backwards
its backwards on the screen it's
backwards on the screen you can't see it
yeah yeah Elizabeth Holmes you're a
chill driver from Switzerland welcome to
the stream welcome to the stream we got
35 people come in join our broad
coalition of great people in the
community we're definitely gonna smack
the Buy button on this product it's
really no it's not no no no no don't you
know whoa let's go let's go fifty-two
let's go let's go at 3:00 p.m. we are
gonna open the bag you see the bag we're
gonna open the bag at 3:00 p.m.
here's my yawn
this is running open pilot zero point
six point five um you can check out the
beautiful new home screen yeah oh it's
just I don't know final incoming eyes
YouTube
I posted them on this uh yeah no don't
worry I haven't unveiled the product yet
I'm wait until three yeah if there's no
product unveiling we're doing an office
tour and you can see this top one here
and Nabal open violet so if you have the
new hardware this toggle will work if
you don't have the new hardware you're
gonna have to flip switches so there's
that um buy new hardware all right good
no I didn't what does no new hardware I
didn't jump the gun into a shed then do
it alright alright let's go
can we ask about self-driving cars in
here absolutely this is finally the
place to do it
you want a tour of common we're gonna go
on a tour we're gonna go on a tour but
first for everyone who hasn't seen no no
I promised the new harbor is not
canceled we built a lot of them is
really good my Elizabeth Holmes quote up
the name of the heart ran well we can't
show you that well that's a secret all
right all right
yes we're finding something out today at
3 o'clock that's a 3 p.m. so in five
minutes we're gonna open this bag up
we're gonna open this bag and we're
gonna see the new hardware and this is a
neon this is our old hardware I'll tell
you guys early spoiler 217 people thank
you all for joining this Eon is not
going away
eons are still as relevant as they ever
were but what's in this bag is gonna
make your Eon way better so at 3 p.m.
we'll be opening the bag to be like you
know going into this bag we'll be
pulling things out of the bag and we'll
be showing them to you guys we have a
medium post we got we got some great
stuff coming and I believe shops gonna
get updated too right away at 3 p.m. so
you don't even have to listen to me talk
you can just smack that Buy button as
soon as it goes live huh Jack died my
chat die wait what a chat for what a
chat break chat disconnected this is
terrible YouTube oh yeah no no we're
good we're good we're good
oh yeah all your chats back alright
let's do it let's do it got 245 people
get everybody in here 248 248 and we're
gonna be in just four minutes reaching
into this bag and looking at the latest
Hardware of common AI let me just remind
myself what it oh that's that's pretty
nice
what's that's a nice wow that's that's
pretty nice oh yeah that's that's good
that's good stop and see the sea yarn
it's not for sale alright but this is my
new office so you guys I hope you like
it I have my own office now these are my
books this is my television it's not
connected to anything yet this is my
couch so we go over here and we just
chill baby chill we wait for stuff we
talk to people yeah so that's my
office that's my whiteboard yeah my
Elizabeth Holmes quote I find it really
inspirational every time I think about
that I might be doing badly at startup I
just remembered the raw knows and I know
that I'm not doing badly that's because
we're making real money for real people
like you guys today where you're gonna
hit the Buy button on the car harness oh
whoa whoa I said the name of the product
oh I shouldn't have done that
that's a leak I get the black bear oh
yeah you'll give my ship in a black bag
don't like this one but but we're gonna
open this bag I'm gonna just reach in
here I'm gonna just can't show you the
product now is yes I got two minutes
yeah we're breaking YouTube we're
breaking YouTube all right
no no she lives in a San Francisco with
her with her new boyfriend and her wolf
dog that's what I heard
all right this is not an Elizabeth home
stream this is a comma a I stream where
we're announcing a new product in just
two minutes in just two minutes so stay
tuned here let's play the jeopardy music
that's what I like to do when I wait
jeopardy music all right let's go 30
second timer with Jeopardy
[Music]
[Music]
alright guys we're going live in just a
few minutes no guys I'm actually this
isn't I'm actually psyched for this
product you guys it's good it's good I
wouldn't tell you if it was good if it
wasn't good umm it's it's it's really
it's not just it's not just oh what's in
the bag
we need 420 viewers yo you'll get people
in here call up your friends tell them
Commons if I have to reveal what's in
this bag in just 5 5 minutes about 5 min
how many minutes that I said I know
we're still getting people I think we
gotta wait I don't think we can do it at
exactly 3 I think we're gonna have to go
to a commercial break first ah look we
got we got T we got Lacroix mmm ok
oh it's live it's live I'm gonna shop is
it live on the shop I've on the shop you
go oh it's live on the shop it's live on
the shop okay at 3:00 p.m. okay let's go
let's open this bag up congratulations
welcome to our hardware future um we
also have a medium post let's just can
we go live with that as well
if you guys out there at comma watching
live team if you could just go live at
the video post so people can can read
along at home actually know what I can
do it right here but that's boring you
guys came here to watch me pull things
from the back so we're gonna start with
this here this is the car harness well
the whole thing's called the car harness
first of all but this wire is a
replacement for the giraffe so you see
we have different wires
Honda Bosch Toyota Honda Knight AK
instead of needing all that complexity
that used to be in a giraffe I don't
even have a giraffe I'll show you one
later they were terrible the giraffe was
the worst product comet ever made and I
really think that the car harnessed this
new product right now is the best so you
see this is a car harness on this side
we have a brand new connector we're
introducing right here this is obd see
it uses a USBC cable plugs right in
there like us this 26 pin connector is
open source will explain to you what it
is in the medium post but if you want to
add a new car to open pilot to the
common eco system you'll just have to
make a wire and these wires are super
easy to make this is all available on
digital I would just take the Toyota
wire I'd click it right in here to my
car harness like this and we're good to
go you'll see that there's another port
here - this is an Ethernet port it
connects with an Ethernet cable you know
i plug the ethernet cable in here got
together end Ethernet cable see how it's
flat it beautifully tucks into the trim
of your car and it connects to the comma
power v2 remember the terrible white
comma power super light really ugly this
is the replacement reliable and it
doesn't just have power it also has
can 424 viewers that's higher than the
price that Ilan was gonna take Tesla
private act let's go for 29 welcome
welcome for those you're just joining
the stream the product is called the car
harness oh yes and the most wonderful
thing that I didn't even talk to you
guys about this harness it's entirely
underneath your trim so you can take
this and in all of the supported cars
you buy the harness the correct one for
your car you'll be able know it's the
price a typo no way no way it's not
cheap you know this is quality stuff
[Laughter]
well we haven't gotten Dollard again
it's not just this we're still gonna
pull one more thing from the back but
yeah so this is a Toyota cable plug it
in here USBC cable , power v2 which
doesn't just do power it also does kin
so fingerprinting 2.0 is going to read
the VIN from the car so this will just
go in here like this and then you have a
complete set up where does this cable
connect you might ask to the greatest
part of the car harness it's this the
black panda the black panda has all the
great stuff from a grey panda this has a
high-precision GPS inside of it and I'm
gonna take you guys live to the
manufacturing oh we can go look at this
stuff
this has four can transceivers this is
the part you're paying for USB C plugs
in right here and of course you can take
an Ethernet cable USB in the USB cable
this is a commis maze also available for
sale in the shop plugs right in here or
you can just use a normal USB cable
you're gonna need this mains I just
don't have one and it plugs right in
here - you're here complete
this is the v2 hardware system are they
in stock and ready to ship well if you
order today and you're one of the first
50 people to order will ship it out on
Monday so yes they're in stock and ready
to ship and we're gonna go look at that
right now
this is a car varnas and maybe now we
can roll to the video that shows the
harness off is the medium post live no I
don't think it is
let's just go live with the medium post
here called our Hardware future that
just basically goes over what we talked
about and we're gonna watch a quick
video I'm gonna flip cameras so we can
watch this video yeah this is the
harnessed trailer yo I hope you guys
enjoy whoops
got to make sure we got sound yeah yeah
there we go wait let's rewind all of
this for the low low price of 399 if you
think it's high it's gonna go up so buy
today the black Panda the greatest Panda
calm a eyes ever made
[Music]
yeah um if you guys are enjoying videos
we also have a full v2 hardware
installation video linked from the
medium post shows you just how easy it
is to install but you guys can watch
that on your own okay let's look at the
inspirational Elizabeth Holmes quote for
a little bit that's good and now let's
go on a factory tour first we're gonna
take you to the left here our testing
closet this is the company's predictions
for how many car harnesses we're gonna
sell they range from 15 to 99 so please
get your order in today for our harness
that's live at shop tower comedy guy
this is our testing closet where we test
Aeons we've been testing car harnesses
now for over a month
this is the most well tested call
hardware that kamas ever shipped let me
see if I can bring the comments up here
so I can see them comments top chat live
chat oh yes here we go yes perfect
and now we're gonna take you guys live
to the factory floor where these
products are being made so you'll see we
have black pandas uncased right here
this is a black panda you'll see it
includes a GPS some can transceivers
there some can transceivers there and
upgraded inductor this is uh no more
power issues for your Yuans Corolla
hybrids are gonna be fixed with
fingerprinting 2.0 so this is what a
black panda looks like without a case
this is a GPS antenna it's already built
in to the complete black panda here so I
think if I open this guy up I don't to
break it these things are very expensive
it includes the GPS antenna so this is
everything wait it's flipping this is
everything that's in a gray panda just
in a much smaller case
this here is kama powers ready to ship
power V twos
these are car harnesses you can check
them out they're sort of beautiful no
scam it's all real it's all right here
for you today we can go down here we can
see all the wire so giraffes are being
discontinued powers are being
discontinued you need hardware too if
you have any questions about it you need
hardware to buy hardware to today oh
yeah check it out you only want it if
it's real that's right it is real this
is where I make it some more eons always
making some more eons these are called
powers without they're beautiful cases
if you want to write now you might be in
the first 50
I don't know how quick these sold these
are antennas yeah cool guys oh yeah
wait is that part of the oh we should
talk about that I thought there was only
four people who got the email Oh yo yo
if you guys buy a shirt with it it's
only three dollars yeah ninety percent
off I said it all wrong Wow someone
should have given me talking points for
this I'm worse than I'm worse than than
you know when those guys go on
late-night TV and don't know what
they're talking about
Oh 90% off get your t-shirt right now
that's crazy you already bought yours
well you know what it's great it's great
it's only 399 do we have anything we
want to show them oh we got something
special what do we got oh I don't
remember where are they
why we showed them the wires is it do I
know about this oh the boss one oh yeah
oh it's $30 but you got to use the promo
code shirt yo is that real plastic this
is a real Bosch connector no more 3d
printed they work great Bosch harness
Subaru harness and FCA harness coming
soon but for now everybody who has a
Honda night act a Honda Bosch Toyota it
does work in Russia make sure to buy one
cool wow we got 459 people here pedals
no we don't sell pedals but oh yeah by
the way if you just split the Ethernet
it'll work with a pedal it works
perfectly with the pedal just split the
Ethernet should we well so you know the
harness is cheap to make but the the
black pan does not so cheap black pandas
are great oh the discount code doesn't
work do you want to go to our sales team
and and complain mmm
hey Alex they say the discount code
doesn't work code works fine never mind
just didn't know how to use it yeah just
bought it all right should we see how
many were sold how do you get assured
for no more switches no more switches
yeah if your stuffs less than a month
old you can return it we have a 30-day
return policy on everything so if you'd
like to send back your giraffe and your
other Panda and it's been only 30 days
of course we honored the return policy
here yeah so giraffes powers pause pause
now paws are gone Oh paws are still here
no pause actually work with black pandas
two giraffes are over powers are over
pandas gray pandas look how many gray
pandas we have left that's right none
them because the black Panda is a far
superior product to the gray panda let's
go take another look at it if you return
it smash you don't get your money back
oh but yeah let's go take another look
at the black panda you know you might
think that you know because it's small
it's not powerful I promise you it's
powerful
there's no GM version uh right now
better USBC than Raspberry Pi for I oh
my
you guys you guys that's today's sales
oh I'm so happy you guys are applying
them oh this is incredible this is
incredible we made ten grand today yo
we're gonna break the record of 26 grand
or what 26 grand is the all-time ,
record oh man this product's a hit
that's right that's right
oh they're so nice they're really nice
they really are beautiful and if you're
one of the first 50 to buy you'll get it
shipped out on Monday
it's Kama pedal compatible you just need
to get an Ethernet splitter you just
need that one wire down super good
whoo 21 sales all right there's no new
functionality oh I didn't even tell you
guys about the functionality no there's
new functionality okay do you know about
cruise fault do you know when you have
to take your car and you have to power
cycle the car because it has a cruise
fault error because your Aeon was turned
off that doesn't happen anymore inside
of this harness is advanced relay
technology this is all fixed you can
unplug your Aeon and it just switches
right back to stock that is one of the
great things fixed on our Hardware v2
system also you see these little loop
wires right here no dip switches the
relays are not optically isolated
there's no reason to do that
um but it is advanced relay technology I
do promise um you have to add the shirt
to the car and thing to the car you
can't just get the shirt oh if that's
what you're trying to do you're cheating
you gotta buy a harness if you want to
get a 90% off shirt no crews fault
completely still this stuff fits
entirely inside your your trim too late
to get shirt well send us an email if
you send an email to support we'll add a
shirt on afterwards we did announce that
too late
that was because I'm the worst talk-show
host ever a Lima gonna thank you thank
you thank you 463 people everybody go
out there if you have an e on you buy a
black panda today comes with all of this
you're not gonna regret it you're gonna
love the way your car looks you're not
gonna lose that piece of plastic that
comes with the car because you can
reinstall everything on the car stock if
you pull the USBC cable out of your
black panda or if you pull the USB cable
out of your black pen if you pull either
one of these cables out your car will
revert to stuff there's also a toggle
added on zero point six point five that
can rien a ball
open pilot where you can switch to stock
right like that say you know your wife
drives a car your friend drives a car
you want to disable open pilot just
disable compile it right like that and
this Aeon will turn right to dashcam
mode check out the beautiful new screen
this of course ships to everybody if you
don't have come a crime and you live in
the US this is an ad for comma Prime we
love ads but if you buy a black panda
today you're getting with the hardware a
v2 program also if you have an old
Toyota giraffe well you'll see what the
problem is
you're probably gonna definitely want to
buy a harness um because you're gonna
get everything fixed up you're gonna get
your high beams back you're gonna get
you a TV back that's all gonna be fixed
oh man wait who said twenty one orders
you got way more than twenty one orders
we got a crazy amount of orders guys
look at what we're at right now we're at
12440 four dollars you guys right now
can help us break this record 26
thousand is the record from July 4th by
a black panda today you're getting with
the future I promise you prices are not
gonna go down prices only go up you know
I've been I've stuck to that he owns
have gone up white pandas have gone up
this is the cheapest you're gonna be
able to get a black panda for so make
sure if your
by one buy it today you're gonna love it
and you know it just gets you with the
new v2 hardware
notice that this thing is not called the
black Panda where the car horn is this
is called our Hardware future giraffes
and pandas were v1 Colome whoo Chris
thank you um what about Ford's IDs you
were no DSU I mean it works with both um
we just put a white fan of 2030 four
days ago here a little Oh any updates
yeah zero point six point five is going
out to develop I mean this stuff's all
cheap this stuff's wires but what you're
really binds a black panda right here
black panda has got an entire gray panda
fit in here
in addition to you know how hard it is
to make it so you can plug the cable in
this way or this way real hard but we
did it we did a great job with the
engineering of course all the code on
the black band is completely open-source
github.com such come any I slash panda
the real takeaways here are if you have
do the email go out did you guys get the
email um oh a on v2 and yeah yeah black
pant
that's where it's at alright let's see
let's see what we got let's see let's
see how many orders we got how are we
doing how we doing on sales have we here
oh one more salem we're gonna cross
13,000 one more sale we're changing the
game guys what this is doing what this
system really is what hardware v2 really
is this stuff you know the ethernet
cable you won't even see any of this all
that's gonna come out of your car is
this and this is a USBC cable we've
created a custom protocol for it called
obd see ODBC this is the future of
interfacing with your car this has four
can buses on it relay control and
started detection yeah we're gonna use
iphone 11 pros we are just like bit
connect except we're not a scam and if
you buy one of these will actually send
you something oh it's only 399
it is only to aetherium it's it's like
none of a Bitcoin I wish it was less
aetherium aetherium was worth more but
now you know you can't have everything
can it start the car well okay so the
other thing that this has that the old
stuff did not is so this is a common
power as you can see there's five pins
on here two grounds one power and to
camp so the black panda has four
canvases and the fourth canvas allows
you to talk to this the canvas on the
OBD so if your car has lock and unlock
support from from like the the tools
that it comes with like honda has hds
toyota has t is you couldn't if that
figure out what can come and was sent
and then you'll be able to unlock your
car live overcome a crime alright and
that's where this is going that's one of
the reasons we added the canvas here we
can also do fingerprinting 2.0 so for
the corolla hybrid for the honda clarity
there were a few cars that broke
fingerprinting 1.0 they're all gonna
work and fingerprinting 2.0 and you're
gonna need this hardware obd c obd see
why does car horn is a separate unit not
integrate into black panda this hides
underneath your trim this does not this
needs to be on the windshield cuz it has
a gps inside of it whoa whoa guys guys
what is that what does that say remember
when I thought we were getting a smash
the record we're gonna obliterate it
yo know if you haven't placed your or
yet 437 people get in right now I think
you will still be ok so so this is this
is real talk I'm not even making this up
I'll prove it to you 33 total orders the
next 17 people who order will be in the
first 50 and you'll get it on Monday
um if you order after that it'll ship
later that's how many we can make this
week we can make about 50 a week us PC
with can is odbc yes it is what is my
role at common today I am the president
I am the president
that means
I'm but I'm not like one of those
democratically elected presidents I'm
like one of those you know like like the
president of something that has a lot of
like Democratic and people's in the name
yeah that's that's what I'm president of
um so I am here today and I am obviously
telling you that this stuff is the
future of the comic ecosystem I was not
this hyped on the prime talk I was not
this I because we've been working on
this for like a long time now
we were gonna launch something similar
to this but not as good three months ago
and I just got mad and said this is this
is total crap we're gonna cancel that
and we're gonna do it well and this is
the one that's done well I will Ford be
in the ecosystem soon floored has a
ten-second lockout problem probably not
the new fusions I think we can add Ford
back in and it will be super easy to
just design a new twenty six pin cable
that works with Ford John dies so if you
buy the coma harness um we can ship you
send an email to support about it we'll
ship you one of these with just wires so
you'll have to get the connectors for
the car yourself but it's fairly
Universal actually looking at that post
on the medium post is pretty good so
let's just let's just turn around here
and take a look at this so this is the
pin outs of the cable um so this this is
this cable right here faces like this um
so this is what you'll need to wire up
your own car most cars are wired like
this the car connects to the camera
connects to the radar so you can just
wire it up like that
it's pretty easy if you've done a
carport nissan rogue support coming VW
coming yeah I mean what this is allowing
us to do Hyundai is actually in official
open pilot right now we're gonna try to
make you and I dongles I'm gonna try to
make these for Hyundai right now we've
just made the three most common but
uh-oh yeah and these are all the we're
gonna open source the wiring diagrams
for these we want to make it easy for
people to add new cars to our ecosystem
the camera shaking sorry
GM GM's coming
Nissan Rogue yes absolutely yeah third
party can absolutely make these wires
and sell them yeah my happy hacking
keyboards beautiful eyelets
Oh guys guys 15700 36th only 14
more people are gonna get in yo well i
autographed the first 50 hundred no I'm
not willing to sell myself out like that
you got up some standards but I will
appreciate you and love you forever
whatever that means
black panda coke dude I sniff you know
you know some people are excited about
black pandas I've been working on this
for three months post shop info on
Twitter yeah we closed the shop info on
on Twitter we also post that
installation video on Twitter if you
guys are out there listening oh I guess
well you there waiting for the live
stream to be over but yeah yeah let's
start let's start posting that stuff um
what T am i drinking it's green green
tea I don't know my friend made it for
me um the clarity will be officially
supported I believe I think the clarity
is only problem is fingerprinting the
comma power is included and yes it's
required no we're not clearing out we're
actually almost out of stock of gray
pandas how much longer will the OGE on
work in the comic ecosystem for a while
for a while when i planet deprecated
that anytime soon what will be
deprecated first is white pandas and
giraffes and gray pandas right now
there's no reason for us to break them
but once fingerprinting 1.0 becomes too
hard to maintain future versions of open
pilot are only gonna work with the black
panda and only gonna work with
fingerprinting 2.0 um no so this
actually has a built-in gps antenna
already um by the way i've been working
on this the company's been working on
this for three months when you actually
make a product nice
we have installation videos it takes a
lot of time how are we decoding the VIN
we're building a big lookup table we do
ship to Sweden we ship worldwide gotta
pay for shipping free shipping in the
u.s. though so if you're in the US get
in right now get your free shipping
we gonna smash the sales record live on
this stream we're up to seventeen
thousand six hundred and fifty eight
dollars if we get that above twenty six
you guys are setting the all-time
one-day sales record for koumei I will
there be updates to the porting guide
it doesn't change that much
fingerprinting that the whole notion of
fingerprinting and having to add a
fingerprint is gonna go away with the
black Panda and fingerprinting 2.0 and
we're gonna build that on the server
side yeah I know that hockey stick right
well who was buying anything today when
the new product was coming out at 3:00
right that's like somebody who buys the
iPhone X the morning the iPhone 11 comes
out um the new Jeep Wrangler I believe
so I think that the jeeps are supported
we're gonna do FCA dongles pretty soon
we're gonna roll out FCA dongle and
Subaru dongle next um yeah you need to
buy more Toyota's what's the code the
code is shirt if you just put in shirt
you can get a three dollar shirt that's
ninety percent off on shirts that's the
cheapest shirt you can't even buy shirts
from street vendors in New York for that
cheap can we just spin he's been
spamming scam I mean you know not
everybody can be helped uh he said VW
coming yeah yeah we're doing we're doing
VW I know you need more torts we've been
talking about the cork situation we know
and actually if there's ever any
firmware updates see they can be pushed
right here through this obd you can
using the fourth cam available only on
black panel all their pandas only had
three cans black panda is the first with
before cams
that's one more cam what about that
conversation about cooling the EON well
you know now it's easy to take the eon
off when you take the eon down it's not
gonna cause any loose fault problems on
your car it's really easy all the link
is on twitter the link is on twitter
comic our harnesses are available now
let's we got we got some great video
content too we did uh yeah it's one more
cat you know promo code today so the
promo code guys i'm gonna paste it right
here is
shirt is 90% off shirt with black with
car harness purchase yeah have you ever
thought about working for the Chinese
government no Mazda is also happening
yeah no great job mmm I wish I
remembered his name but there's someone
who discord have been working really
hard on the Mazda 4 we really want to
get that upstream it's incredible how
far this community has grown in the last
limit let me let me shout out when he
shout out the Mazda 4 I think we've
gotten that already up streamed into
Panda and that's Mazda Jafar yes Jafar
all he's been he's been working on the
Mazda and it looks really good and
shout-out to Angela for making my office
beautiful can we link her can we link
her can we can we give love to everybody
what car should we select for other cars
um we should have launched with that we
should have launched with that I'm sorry
we didn't that'll be up in a bit
don't buy back the cathode is the next
evoke recently right guys we're winning
we're winning key is it's all coming all
the other cars are coming it's gonna be
so easy for us because the harness is
the same for all cars the black panda
the same for all cars power the same for
all cars the only thing that changes is
these and we're gonna get lots of
different ones that I made if Eon is
dead yes it'll automatically switch if
your Eon is dead it'll automatically
split from stock you don't have to shut
the car off this will just automatically
happen Dodge Challenger probably not
eighties Volvo oh yeah we've left that
in Vegas with some guy who tried to give
us Walmart gift cards for Real Talk , is
yes we're gonna go for an hour with this
stream so if anybody has any questions
I'm happy to talk about the comedy
ecosystem and really this someone said
it I mean all our future products are
gonna work with this same obd seek and
there that works on the black panda so
it's gonna be the same connector it's
gonna be the same harness you're only
ever gonna have to take your trim off
once no it's not USBC power delivery
protocol it's we put 12 volts on the
USBC don't plug this into a phone it's
actually pretty safe in most phones but
don't plug it into a phone I'm how good
is comma Prime is it really worth it
well it is exactly what it is you have
to make your own decision about whether
it's worth it some people really think
it is um black panda definitely worth it
come a prime also big feature coming
next year like an unreal feature so you
know you can always you can always hold
off till next year when we up the price
you'll have to pay more per month but
you know the new Panda has hired a
powerup but yeah um so it has a it
hasn't much better switching power
supply brilliant new hardware engineer
routed it for us it's good uh I soldered
her and that's what I like the
black pandas let's see what the sales
are up to yo yo we're gonna smash that
record we're gonna smash that record you
can still get in right now and be one of
the first 50 we got 47 orders today
if I'm crying right now I mean no it's
it's useful it's it's unlimited a that
we fixed tethering in in zero point six
point five we are adding a new feature
soon gonna be snapshots you're gonna be
able to take a picture from your Aeon
right from the app we're making the app
like more interoperable with common
prime who's winning the bat in the
office well we already have some losers
as to who's gonna win I don't know but
we can go look at that board let's go
let's go back to the testing closet and
take a look at that losses um where's
that with the marker gotta go find the
marker let's go get a marker what oh
yeah yeah yeah yeah Harold has it down
here guessing um 15 we're just gonna
cross that one off Andy with 27 that can
go up 42 can go 32 can go 37 can go all
right all right all right so we got viv
right now we got Willem with 55 I guess
69 guys I'm just I'm just
I guess 69 and we got way Shing here
with 77 and we got Greg down here with
99 so will it be there with 47 that's if
nobody else buys one will it be willing
with 55 will it be me with 69 we'll be
waiting with 77 or will it be Greg with
99 yo let's see how many result ETA to
profitability our estimate actually was
selling 50 of these
so we've already crushed that estimate
I'm super happy with all of you
well we're hoping also 0.7 on software
coming to all the eons is gonna be
really good
0.6 did wonders for our sales our
revenue growth is up 50% from q2 to q3
we'vewe've 50% opt our revenue if we do
50% again in q4 a profitable company
0.65 0.65 is it in devel let me check
0.65 is not in developing a why but uh
coming soon a Comi UPS firmware might
happen uh we'll see
car horns is at 43 well oh it's at 43 or
what about the other ones no we've
already sold 7 them right those ones
aren't included but those ones aren't
included in the first 50 that are gonna
ship so if you get your order in right
now when are you gonna get a consumer
product so consumer products are journey
not a destination if Apple called the
iPhone a consumer product and said it
was over uh it'd be over but Apple
worked tirelessly to make eleven iPhones
and that's how many aeons we're gonna
have to make but the final one's gonna
drive your car right full self-driving
um what car should you buy for kamma
toyota corolla toyota corolla is the
best car it does work in the UK driving
on the left China I know it does
actually there's some great people
privacy policy
Commodore a / terms I believe it's
linked from the set up a boat of the app
which you can download for free so
that's probably the best place to lock
but if you're asking that question yeah
um we sense flow oh you wanna see the
data center let's go to the data center
guys we're just gonna take we're gonna
take this black panda with us in my
pocket so we can we can see the black
panda everywhere let's go to the data
center the data centers really cool we
do our training in-house because the
cloud is an overpriced camp so we're
just gonna bring you guys over here like
this so we're gonna see a few cool
things as we enter the cama garage
it's loud in here we got a rav4 you can
see ignore the terrible looking white
table but that's a black Panda right
there on the windshield beautiful setup
we've been testing them for months
here's our wall of printers where
everything is printed
and here is our data center I'm very
proud of it Greg's worked super hard on
it all of this is our data Wow
two of them are broken and these here
are forty 1080i GPUs these are our
random server computers and this is our
working data storage yes if someone
parks badly that's the end of the data
center in the printers it's true that's
why we have open pilot we have secret
good open pilot that does parking for us
check it out black panda cases beautiful
[Music]
stock ad with harness yes unless you
unplugged your DSU or I have a GM
without an SEM there were all Linux
simulators coming along great yeah it
does right and show you guys the secret
code oh you guys want to see look at
that fan a clouds a scam oh man well
that's sketchy don't touch it don't
touch it
behind the door wires and a big fan oh
my god that's the hell is sketchy
if you're concerned about privacy and I
mean your data is here look at them
blinking they look beautiful
no no we're in San Diego now just bought
all right that's what I like to hear
all right we got we got 14 more minutes
of the live stream do we record audio at
all no not at all and the front camera
is opt-in so by default we don't record
the front camera either oh yeah we got
it we got good locks and we got theft
insurance
I hate crime and that's why you moved to
San Diego because a lot less crime here
in San Francisco check it out we're
building some new yawns these are
actually gonna be throwback eons we're
gonna do some some og eons 128 gigabyte
we got the last stock of the one plazas
Toronto was less crime yeah but it's in
Canada it's cold black pandas open
source no the hardware's not open source
did we pass 25k let's go check oh yes
Python 3 on 0 6 5 so we're really moving
to the future wide my mind change on the
firmware there was yeah I don't know
some of you might know some of you might
be able to figure Oh will gain a break
the record today we're gonna break the
record I actually think that we can
subtract some of those were yawn orders
so you might still get in the first 50
if you go today rip stream no no
connection come back No uh can you make
a legal request to receive and download
all your data and you can try this is
why we've started deleting data its back
excellent excellent
we're at $23,000 guys I'm gonna stick
you know what I said it was gonna be an
hour but I'm gonna stick with the stream
until we smash the record let me let me
get I posted what the exact record was
in staff yesterday
in our slack let's see what it is no I
actually didn't post it because I was
concerned we weren't gonna break it but
now I know that we are so let's go look
at the end whoa we're looking at it I
got I can show you a video of
installation
[Music]
23700 $740 sister what's up yeah yeah if
they got an impatience and they wanted
then yeah I'm cool with that yeah you
gotta yeah you gotta give the t-shirt
size too
yes oh yeah oh yeah 22000 24266 whoa if
you buy it now you get an FCA connector
later wait till the FCA connectors ready
no our investors are not pressuring me
to make money
definitely not I'm pressuring everybody
to make money because if we make money
we prove that the idea is great and we
hire more people we get better models
you know money guys look at me we're
gonna we're gonna flip around and then
we're gonna do a look at me we're almost
at 69 now we just moved down here we
moved to a beautiful new office can't
invest not looking to raise money
[Music]
Zor tracks em to hundreds pick me back
to read the code don't think so
unless they snuck past me stick a sturdy
box International shipping purchase is
really hard investment to the company I
do live in San Diego I live in a
beautiful apartment watch me on twitch
if you wanna see it's super easy to set
up
[Music]
that clouds not a scam
it doesn't matter that much the GPS is
only good to a meter so thank you
uh yeah we don't know yeah he knows talk
to private company but I'll say that's
look all the money we make
so someone someone wants I think it was
a youtube comment where it was like you
know about me like this guy wants to be
a billionaire so bad well what I do with
a billion dollars well buy ya know every
dollar that , AI makes just goes back
into the company right like there's no
people taking profit off of the table if
we make more money we're a 13-person
company now you know why we're not a
huge company like like like tzuke's
and like cruise because those companies
lose billions of dollars every year
we're not only gonna win self-driving
cars we're gonna do it with a profitable
company um we're gonna sell stuff that
actually provides value to you if I
didn't think open pilot Act I'm thinking
about getting a new car I don't want to
get Toyota I don't want to get a Honda
but I don't know if I could get a car
without open pilot is it Toyota Corolla
with open pilot better than an Audi a4 I
think it is um take my shirt off whoo if
we get the 69 I mean how many hours a
day do we work yeah what'swhat's the no
we work normal schedules grow roll the
life have some basic Carver 1k I'd buy
that yes I still work a comma yes um a
Camry with open paws that in the name
for I really think that's true and that
just says like you're really getting
this product for so cheap compared to
the value that it adds we're gonna cross
25,000 soon we're at twenty four six six
eight there's three payments to capture
well I think those are the people who
bought shirts
wait unfulfilled what why oh I don't
know
26000 guys you guys we might even do it
in the hour this is insane
how do I cover my personal expenses I'll
tell you my salary I make $80,000 a year
that's legit my salary oh yeah yeah we
might run out of t-shirts so if you want
a t-shirt
yeah you better you better get it now
what's the no free lunch theorem you can
google it well no no free lunch in
search and optimisation we're talking
about that today at lunch yeah the
company pays my salary of course but
like I'm saying like I'm not taking
millions off the table here right
actually I below a salary at the company
now um some people got raises recently
so now I mean you know
how do you get I've I have personal
money I have other money too not related
to comma I make money streaming on
twitch twitch deep got TV slash George
Hotz and soon I'm gonna be an Instagram
influencer and then I'm gonna make buku
bucks and I'm gonna buy a yacht just
kidding no I'm not CEO I'm president if
you if you come to work here
you'll get salary choices and the lowest
one is eight again Tom if you want the
highest equity we do pay inequity yeah
so actually really the only way to
invest in comma the only way to get
common equity now is to come work here
nope no CEO can you work there as a
mascot you see if we sold two hundred
thousand dollars of sales today maybe
then we could afford a mascot I'm the
discount code for ninety percent off of
a shirt is shirt oh yeah I could make
two hundred k plus yeah beforeand okay
um but look I don't even know what I do
with money man whatever and then wait my
wins that's no fun we live in a fun
world what I look for an engineer's you
know knowing everything um we don't
really do like we develop open pilot
right we're not looking to make sketch
business deals we sell this like it's
foreign dollars you see exactly what it
is
we're totally transparent about it
where's open sources we can be why can't
see a knock anything it because there's
four canvases on here um plus power plus
ground so that's ten pins plus star
detect plus relay trigger so it's twelve
pounds you got a twelfth anything that
lying around somewhere Ethan it's a pro
tip guys we just broke the record we
just broke the record
highest sales day in common AI has yeah
yeah so we really are gonna be done Wow
we're gonna be done we're gonna be done
in an hour so it's gonna be an hour long
stream firstly Chris thank you do we
have anything else to do I think we
broke the record I think we only got
three more minutes road to 30k guys I'm
happy about the record we sold a lot and
I think 69 might be pretty Clutton I
think ratchet I saw a little more can I
live stream the celebration tonight
maybe yeah what higher we're actually
we're hiring for two positions right now
we're hiring an open pilot developer I'm
hiring a research engineer I'm so open
pilot developer we're looking for
someone with assistive background Python
background I'm someone who's really
gonna make open pilot super stable wants
to work on testing we're also hiring a
research engineer to work on the desire
problem um so if you guys read the open
pilot code and look at desire especially
people are writing Forks you might be
very interested in what that is desire
is one of the craziest things we're
doing here and it's really a big step on
our way to do self driving I can't say
full self-drive we build levels to a
tower systems show books
I'll show one book so I'll show one book
let's make a good book
yeah yes
information theory inference and
learning algorithms super important
stuff to know this is cool to home graph
complexity we're talking about this at
lunch this has to do with no free lunch
stuff twenty seven thousand three
hundred and three dollars give me a job
coming down AI that's where you apply um
smart Salman is a gimmick you don't want
that will do red lights and stop signs
before we do smarts on the cut out that
uh is everyone making the same effective
calm poll if you got an earlier you've
got more equity some people opted for
higher salaries some people opted for
higher equities it's pretty fair oh did
I just show for that book I don't make
any money off those books actually the
information during book is free as well
I bought just to support the guy I like
the author he's dead now though so I
don't want to support him anymore
will you get rich working you're coming
if you're coming here to get rich you
probably won't fit in well you might
though but if that's your goal go work
and Finance breath you'll make more
money in finance you really well but you
know you won't change the world
and grow slowly prisoner of resources
and wait for all the companies to crash
next year oh oh you need to raise 1.3
billion dollars to keep your company
around bro see I'm just happy making
mine making mine
twenty seven thousand three hundred
dollars today thank you to everybody who
some days I leave work smiling some days
they don't it depends if it works today
I'm gonna leave work smiling cuz we
broke the record whoo
it's common profitably got q4 this year
we're going for it hopefully hopefully
we saw 50 percent growth from q2 q3
we're hoping for another 50 percent
growth q3 too cute for and this starts
with the harness and the black Panda I
mean records not broken yet you mean of
course the records broken
I just sold another 120 7705 how does
the black pan to interact with the
Toyota TSU if you ever EDS you
disconnected the stock mode toggle won't
work unfortunately follow distance
reduction you don't yeah wait for end to
end longitudinal do I think being open
source will make it hard to compete with
other companies with significant capital
I think a lot of those companies are
just throwing capital away
they are absolutely throwing capital
away there are companies who are so much
better funded than us that have code
that's worse than open pilot we do take
interns we take interns year-round it's
a three month internship program again
the talent bar is quite high but if you
have a good github you have a good like
math and physics background will
absolutely take you as an attorney sales
are good but how many could be returns
we get a lot of returns lower than the
industry I think I were returning it was
like 5% um once people get open pilots
set up in their car and no one returns
it um how do I get a merge request
approved you mean a poor first kamidana
we're pretty good oh that was mistaken
the record has been broken guys the
record has been broken and then
longitudinal next year we'll ship to the
Aeons but let's first you know zero
point six point five should be in de val
any minute now I'm not sure why it's not
I'll find that out as soon as we stop
the stream allied our math company is
this someone's it for a sad reckoning um
except your pull request with the Subaru
we're gonna get serious about Subaru
when we ship the Subaru connector um
what happens with he owns right now we
make more eons
always more eons now an unexplained
antenna longitudinal no that'll be for
another day we don't exactly know how it
works yet we've been trying some very
basic experiments right now
sup J ROCs we make DI yeah you can make
DIY connectors we've we've checked the
medium post you check the medium post it
shows you how to do we work more than 40
hour weeks
yeah probably probably most people end
up but it's not none of its required
which hill it's a real chill place to
work you deadlines be smart that's it
it's nothing goes worked for a while
depending any car flex right yep I have
to come from the community there's not
enough most cars on the common network
are Toyota's well we have to do
marketing define marketing is anything
we did today marketing I'm okay with
everything we did today if you're
talking about and I'd love to buy a
Super Bowl ad man this guy on the Super
Bowl that'd be crazy uh
quantum supremacy I've seen that talked
about a bit lately just come and make
profit q4 we should be profitable no I
don't think other companies are aware of
what we've accomplished at all I think
if they really knew how our models
worked it's unreal how far ahead it is
um you know what Tesla's doted Joe is
that they talked about I think it's what
we already have um about CNN oh yeah we
need confidence yeah Joe Rogan known
about Nora
six minutes how does open pilot handle
uncertain traffic situation it hasn't
seen before the new model is trained on
so much driving it's trained on tons and
tons of driving
do I think way mo is a good company it's
not that way mo is a bad company they're
just extremely overvalued we pitched to
investors one said not at the current
not at the valuation I wanted of course
I just demanded a ram evaluation off the
top of my head the others said
absolutely there a 16z and we went with
them oh they're great
they're diggin they're good our partners
Chris dicks in there it's good guy as
you're talking to that yeah
I will say this if I ever go on Joe
Rogan and he offers me some weed I will
smoke is deep route a copy of open
violet I don't even know what deep route
is I really parking sensors now , prime
what is it
check the medium polish plan for lane
lines you were doing away with lane
lines tons of driving equals supervised
learning why are you so against
marketing a lot of it's really scummy
if not scummy I'm cool with it how many
people got the email by the way I think
we worked hard on that I'm pretty happy
with it I originally wanted to make the
subject re kangaroo what I think of deep
sky like position was it NACA higher
test actually I think publish that to
make it clear that Tesla doesn't acquire
companies for overpriced yeah paying for
market in 2019 is not my grades uh you
didn't get the email because you guys
bought eons I think a long time ago oh
you got the email right someone got the
email ID excellent um gonna need a good
jingle twenty-eight thousand one hundred
and ten dollars mr. Maira thank you
you bought yours less than a month ago I
don't know maybe you didn't opt into
emails well we'll have to figure it out
a gray panda more recently do you guys
lose
scale the io2 label stuff we got like
seven things labeled with them it's too
expensive it's too expensive to get like
10,000 images labeled would be $60,000
and that's more than we can really pay
if they lower their prices 10x if they
figured out how to do that like they got
it to work with models we'd uh we'd use
them
I do enjoy San Diego in San Francisco I
think San Francisco's an overhyped scam
do I think test will get to level 5
automation next year no no and I will
bet big money that they do not it's not
to say that I actually think test was
the farthest along but if anybody would
like to bat the test little knock it to
level 5 in 2020 if you like to bet that
they would I'll take the other side of
that bet
labeling in China should be cheap well
in China is not even the place for cheap
labor anymore China's crazy expensive
though did I really sell my soul
I say I say when did we get comment and
sure
earns Oh in a while we didn't work with
via walk so we didn't work with via and
that's the wonderful thing about open
pilot we didn't know that was coming
either guys this isn't about
partnerships this isn't about sketchy
backroom deals it's my shirt on inside I
think so um this is about MIT license
code that anybody can use oh well they
have we helped with the app yeah they
used our code they used our MIT license
code just like pronto used our gray
panda right like it's it's it's uh it's
not talking to us it's reading our
github I absolutely agree with what you
learned said about liner yes anyone
using lidar is doomed two minutes guys
no one will have it by 2025 that bet I
wouldn't take 20 20 I would take I'm not
saying I think it will be but I wouldn't
take it that um are there any
restrictions to using MIT license code
basically you can't sue us if it's
shitty that's basically it
um how many sales seventy seventy well
let's let's actually check so we sold
seven impatience um and then we can
check how many car harnesses we sold oh
there's three different types of car
harness
I think the bet goes until 3 p.m.
tomorrow I think Greg with 99 is
definitely gonna win thoughts on deep
scale I don't know much about forest a
few times I think they're pretty legit
if Tesla didn't pay an exorbitant price
for them and it's probably good deal I'm
no comments on the EPS firma right now
well adjustable follow distance ever
come to stock Opie no probably not
when will the next batch ship when we're
done making them won't be too long it
should be like 1 to 2 weeks should be
actually it should be within it it
should be a week after Monday I think we
can make like 50 a week can you remove
the liability with the EPS firmware the
prom with the EPS firmware as it can be
dangerous it can be dangerous so we are
looking into it I understand I put I on
flashed the torque mod from this deck
and it was terrible so I get it again um
no adjustable following distance I don't
think is gonna be merged I think that we
need to address what you're using it for
in end-to-end longitudinal and we just
need to make we just need to make open
pilot better to the point that you don't
need that we do calculate gaze direction
with the front camera that is part of
how our stuff works is anyone working on
flex rating not a comma because a bunch
of external people join the discord can
a cop give you a ticket absolutely
you're completely liable at all times
and always remember guys pay attention
um
UI button to tag grid events yeah as you
dance that he's off having down a degree
worth it I think most of the contents
available for free get opted into long
control maybe you guys look into it if
it's good that I would consider merging
I live in San Diego that's what common
AI is Lane hugging like as a motorcycle
on the right side need to hug the left
lane man that's coming when we ship lane
list check out zero six five I think
it's actually gonna be much better um
walks when I missed your thing how many
FPS 20 fps we don't sell the harness in
parts one price one deal how smart was
our team mad smart
san diego's pretty cool people sleeping
a test was actually sneaky marketing it
might be the porn really was good for
get zero six five out yeah I got it I
got to go do that
Insurance is kind of boring but yeah
we'll probably have that installation
companies or dealerships dealerships but
if you want to be an installation
company you can actually do that right
now we have great bulk discounts on all
our products eta for lane list end of
the year or the lane hugging be
adjustable no it will not it'll just be
great stop signs and stoplights man will
later after Tesla ships them we'll look
into it
before Tesla ships them we're not gonna
look into it it's hard again it's easy
if you're way mo and you can map every
one of them but if you want to work at
every stoplight and stop sign in the
country Lance a lot harder but uh you
know the black panda has a
high-precision GPS so if we ever do ship
features like that you already got the
stuff you are going to need see how far
the Corolla can steer you got lock to
lock using joystick do ya the Corolla
torque is crazy Corolla is a super light
car and it's got like the same torque as
a rav4 we don't rent the server's we
bought them we got great prices on used
servers you sell your product in Panama
yes and it should absolutely work we
don't we cancelled the referral fee
program it didn't get more sales people
we're to hire more people who try to
port more cars probably not almost all
our cars are Toyota and Honda
but we'll get to him we got to make it
easier to port a car and this hardware
is a big step towards that do you go
spare time we're always working always
working bro I got tons of spare time
check my streams on Twitch does it work
well when it's driving on the left we
have something probably coming for
left-handed driving you won't be
disappointed if you find it I will say
that you can check out some of the
things but guys I'm already three
minutes overtime we're not hiring remote
what's the fanciest car with kama
installed no ecord is pretty nice high
trim Toyota Camrys pretty nice
what Lane the car is in yes absolutely
it's accurate to a meter what car ports
are left really much yeah we're to be
got them all Tesla Tesla Tesla Tesla
any Java damn position now we don't use
Java older come older Corolla and it's
gonna be a ton of work may
if you replace the steering column can
you put open pilot and Tesla yes and
people have done it checked the discord
um Genesis is nice and nicer with Opie
that's right oh genesis is it pretty
nice well that's actually not a bad
choice a bunch of Lexuses have it
Corolla doesn't have Android auto I know
I know
come back soon zero seven zero seven by
the end of the year Bentley GT support I
don't think so
alright guys thank you for joining the
final sales total is twenty eight
thousand nine hundred fourteen dollars
thank you all for joining get your order
in for common harness you're gonna love
it
$3.99 prices only go up you saw it here
thank you all for watching we'll take
one more look at the beautiful harness
Python is a dying language pythons girl
I'm mad fast and we're on Python three
now so it's great
alright see you all later bye-bye
hello everybody welcome to become AI
hackathon
we'll give a minute to get some people
in here
[Music]
so it's generated by our internal
segment that was trained on kama
coloring kama correcting cityscapes cam
vids mapillary vista the same ones
everyone else cuz we just don't like oh
yeah my name is Jorge for those that
don't know youtubers so much now I'm
this sick hackathon food what we're
really here to do is induce as much FOMO
as possible so you'll tell all your
friends you know which I was at the
comic hackathon
that's a good plan fine tuning our shop
hello French onions gross ma'am what
happened to twitch things it's a new
year it's 2020 I am rehab check out the
kitty leaderboard it's pretty good for
that and I think it is that in video
paper
stall click somatic segmentation on the
videos result okay we got a bunch of
people here I'll show you guys the
secret TVs what's made available we're
not going to disturb them here are some
fun projects to work on
here is some random projects to work on
here are some open project pilot
projects to work on and here is our
Wi-Fi network
welcome to the common hackathon where we
have kickoff and dinner some challenges
will come live tomorrow you can see my
terrible handwriting dinner lunch
presentations and then say goodbye
how was flex are going oh yeah yeah some
some some common employees decided they
were to do flex raise their hand home
project
the board for all the haters who said
you can't do flex rate with a logic
analyzer and an FPGA oh oh yeah
this is leaked content guys welcome to
my office you know my office can
transceivers and a logic analyzer and
then hopefully that will allow us to
intercept the messages there's an Audi
q8 in the garage there's more lidar in
the comma is right now then there's ever
been in history there's actually three
lied arse in here
because there's two lidar is in the in
the Audi q8 yeah this is actually old
wrong this is the a4 one this is gonna
be easy
is it hard
oh man to the keyway have good drivers
system yeah but I don't need right 45
because all the traffic but a dinner
mess up go okay and I couldn't ride a
traffic jam assist I don't know it
didn't like or something goes to me but
it didn't mess up and you were on the
highway yes it was like an agar b5 did
you have to wheel to reset it or could
you oh you're the wheel aha yeah
all right I don't know what else to tell
you guys you know next year or next time
it won't even be next year make sure you
get invited to the combat AI hackathon
and you could be participating in all of
this fun yeah that's all we got bye-bye
oh I saw that steaming I thought
something was on fire
pandas was on fire two people no chats
oh wait someone subscribe like pay me
money I love when people do that yeah
and that's no one even talked no could
you guys talk to make sure chats working
Oh someone talked wait I don't know
where everybody yes maybe I didn't act
maybe it didn't actually send the
notification or something maybe those
are just the people refreshing my twitch
stream oh did we mess up and not send a
notification oh yeah buddy we got people
buddy the twitch servers slow today are
you a subscriber do you pay money a
tier-one oh I love when people subscribe
to my stream I get money they get well
and that's Twitter's problem right yeah
Noel bars now we're being watched
take a look take a look have you watched
no no just show them the watching yeah
yeah no I was distracted I was using my
phone don't worry we say if I had Alex
watch the road and it was yelling at me
that's because they're good driver
monitoring's wait is it prime exclusive
good eye wait but not many people are
talking oh yeah yeah go to settings do I
actually have maybe it's still armed
from last time oh you have to be a
subscriber to talk sometime we do that
sometimes but maybe you can turn that
off in settings this is terrible you
know what it's subscriber only today
everybody better subscribe and I'm
really sorry about this but I really
don't know this is paola chat will ask
will answer any of your deeply personal
questions right now right here on
exclusive chat guys honestly if we knew
how to turn exclusive shut off we would
but I think all you can do now is
subscribe if you want to chat welcome
welcome to the talking party oh no don't
worry my mods will show off and they'll
be banned to typos but subscribers are
good people and they don't deserve
answer times
wow that's that's I love when you guys
subscribe to my channel you could show
me open pilot show me
I see open pilot yeah oh yeah we gotta
get some of that microfiber cloth oh I
have a cold so I can barely hear out of
my left ear my right ear but we got to
heal up guess we got a lot of great
things planned for CES we're on our way
to Vegas right now we set a course in
the open pilot we just typed in Las
Vegas because we have the secret good
version of open pilot and it's gonna
drive side to what's happening at CES
well with us or with everybody
I went I've been to CES twice before the
first year the big thing they were
advertising is yeah go yellow pixels on
TVs like like like I think it was like
sharp they spent that was the big ad
campaign around everywhere yellow now of
course you know this makes no sense
all right like red green and blue can
capture you only have three cones in
your eye always for women the yellow
we're have four well they should buy
yellow TV and they just have like yellow
pictures and it was so stupid so that's
what happened to see yes that year and
also my buddy lost eight thousand
dollars playing casino war that happened
oh come on broski get in your lane he
was not his thing he was over-the-line
and then the next year I went he lost
way more and now we're not gonna go
there but but you know bros casino Wars
a great game and Tom tell that story
moving the time we played like those
people playing war and they were all
betting like ten dollars and I just
showed up put on dollars down and played
one game of war gotta ace and then live
in my line is that good oh yeah I
crushed it I crushed it
what do you mean no okay so where I
don't like hype is like in the medical
field right like like like pipe in the
medical field is disgusting
the theranos um but consumer electronics
is hype like it's honest you know what
you know you guys know what I really
don't like is dishonesty the people who
are hypocrites but like people are
supposed to get hyped about ok the
yellow TVs were kind of bullshit but
like some consumer electronics are
really cool you should get hyped about
subscriber only chat is really getting
us so many so many subs today people
want to talk and then the next year I
went to CES no I'm the president pros
but like I say I'm not like the
president of like a first world modern
democracy I'm like the president of like
the Democratic People's Republic of
Congo and you know the more they put
Democratic and people's in the title the
last legitimate the country is it's true
People's Republic of China versus
Republic of China Democratic People's
Republic of Korea versus Republic of
Korea but so yeah I'm one of those like
third-world
presidents who rules with an iron fist
and doesn't feel like he serves the
population we have a booth they know we
have a booth right what's 25 20 but
we're in the smart cities section
because we didn't yeah yeah so you know
man
hi Breathitt Sucker Free get hyped
yo Pat stay look him up you don't know
Pat today is this is a pat stay over the
break Sucker Free get height you know
what rhymes with Sucker Free talkin me
yeah we all a change bros come to 0-7
one is that guys subscribers asking oh
that's right everyone subscribers
talking so I'm gonna honestly answer all
your questions probably around xx look a
little before that see like like this
guy's driving slow so we're just kind of
passing see I just put the blinker on I
touched the wheel I'm making a lane
change
oh yeah changing lanes monitor other
vehicles it doesn't watch the vehicles
for you yeah ever you don't need that
that's what you have eyes for we
outsource to the human you see in the
future humans will work for robots you
know and they get you in by like and
this is like what it's like to have a
company right like you think your
employees work for you but the truth is
you work for them it's like the same way
with this right like you think that the
computers work for you but soon you're
gonna you working for them yeah buddy
what do you want to shout at the screen
okay we'll get we'll get pulled over for
too many lane changes
don't think they'll think we've been
smoking back Oh
what are these what's pedestrian
heatsink this is someone who's talking
about wanting an IR camera on discord
last night do you have a IR camera no
can you drive car yes don't need will be
mine the same buddy now I really
snapping I'm religious I just don't like
atheists you know nah a theists are all
like all non-religious I'm not religious
but then they're just a theists and
that's like a religion I think we should
just tag all the deer and then you can
subscribe to deer net and it'll tell you
where the deer are deer become on the
IOT that's if you click somebody watch
survivalist I do anything special on I
fell asleep before we really got to
whether the Sasquatch is real or not but
I would say that
Sasquatch being real is more real than
honey healing burns and more real than
than fluids treating illnesses that's
how real I say sasquatches but I'd say
it's less real than an increase in
carbon dioxide it's probably about as
real I'd say I'd say yeah yeah it's
medium real Tuesday is the first act no
we're doing we're doing a big live
stream on Tuesday guys so make sure make
sure to turn in tuned into the common AI
YouTube if you don't subscribe over
there go now come an archive go to the
official comment a I YouTube make sure
to subscribe you know what I was just
stressing out like before when I thought
it was driving badly it's just cuz
that's all I was paying attention to oh
my god don't change lanes I was driving
beautifully I haven't even thought about
the driving for a long time no no I
don't have Disney Plus yeah I have Nick
heads yeah yeah let's rewatch half a
Twitter last airbender yeah if you get
into a crash because you are watching a
video instead of the road
what video and you haven't been the uber
driver killed somebody while watching
The Voice to test the guy hit a truck
while watching Harry Potter oh yeah yeah
Harry Potter was discovered at the scene
of the crash still playing on the
portable DVD player I laughed because
it's sad
we didn't see it good that's a job for
the cars no it's like doing talking oh
it's just twitch and carplay doesn't
work well so we can't actually see our
mouths per gallon but I think this car
gets like 40 on the highway yeah it's
pretty good now we're gonna have to stop
for dance at some point guys like okay
so I branded it in 2019 I called
insanity 2019 Saturday 2019 you notice
how all like the like sjws just died in
2019 like it was just over like sanity's
back right and no it's just like like
everybody just came to a nice middle
ground 2020 I really think is gonna be
the year of the death of hype like I
used to talk about height because hype
was a threat I don't think hypes a
threat anymore
I think a lot of hype died last year to
the new things are excited to get hyped
about you go through the hype cycle
alright the beginning of the hype cycle
is exciting we love to get hyped about
new exciting things that sounds about
right
um nah but in like 2020 like zukes is
going out of business this year
vishal prediction zooks goes that well
no Suk's gets aqua hired I think so yeah
some car company maybe even by way mo or
cruise now cruise cruise is sad I was
like like people have read people and
read a self-driving cars or see again
people are self-driving cars are seeing
it now like oh yeah they've become much
more reasonable they were unreasonable
to be kidding oh they were Tesla haters
I mean no you still the occasional Tesla
hater Weibo has actually made some
progress what his crew showed in the
last year's should do a review reviews
yo we're here for that we're here from
the George Hotz twitch channel to review
mobile I can you let us up to this booth
no no mobile I last you had like a
little castle the last time I was there
I did let me end yeah all right astray
how pleasant to subscriber only chat I
think this should always be a thing I
just I feel like we're just chilling
with cool people cuz their subscribers
house way Mo's progress oh you guys want
to hear something terrible
[Laughter]
how's way most progress put it this way
if whammo had spent fifty million
dollars to get to where they are right
now
way more be a good company if Wayne
would raised fifty billion a 50 million
50 million but no instead I've spent
like ten billion so yeah they're off by
like you know fact there are twenty
twenty twenty let's play more than
twenty it's two hundred it's a really
big factor all right find a hundred
billion for fine wait so watch carefully
still have to start lane change
whoa I don't know it went back it got
freaked out and undid the lane change it
was kind of a normal human renew ver
something freaked it out we need
diversity is very important number
progressive
yo but as long as there's no glass
ceilings as long as they're not made out
of glass
so what that means what the lane change
I don't know I just freaked out a little
bit that was like a normal human thing
spindrift man look at the look for their
product placement in the new Veronica
Mars season they place things like spin
drift and then you wonder like we're
gonna really change ID for this truck
ready all right steer right to start
laying change let's go Oh point eight
figured it all out yet I have a few
things that I want one of the things
that bothers me is it's slowing down
four turns it needs to learn how to slow
down four turns better
yeah a lot of bugs a lot of little bugs
just need fixing I'm gonna start really
taking advantage of the fact that we're
getting all this data back from all the
people so it was the battle just a
competitor to Newton Mass Wow a battle
of water
oh you mean oh that disgusting one with
the ugly font wow that's crazy sounds
like going like crazy ever since that
note 7 blew up you know they've been
everywhere oh I did some refactoring oh
it did that not ship
I did some your wiry factors oh I guess
yes on zero 7 this is it's in the
eternal republic yeah serious curves
that's what you get when you have a
torque modded Civic Oh someone's gonna
break the glass floor though and that's
like you know you break the glass
ceiling that's bad if you break the
glass or a floor because there's nowhere
to go but down who broke the glass floor
[Music]
if only if only I decided to do things
whereas in commerce or publishing
because what do I get when we publish
it takes time and we don't get anything
it's not that I'm like we got to be
secretive about it but I'm like you know
we published some great stuff we publish
incredible stuff like when we when we do
that ie B analysis you know that took us
a lot of time as a company we were
really excited about it we put a medium
posting it's like a hundred collapse and
then I write up some trash just
insulting other self-driving car
companies 2400 collapse that's 24x more
collapse so the reason we don't publish
is because that's not what the people
appreciate know really like it's just
nothing useful research actually we do
publish we publish a new model almost
every release we don't really get those
engagements anymore yeah yeah no other
roads you definitely get them but on the
highway subscriber people get a lot of
slack because their subscribers but all
say is you know you gotta figure that
out yourself yeah exactly figure it out
yourself
yeah yeah if you're following someone's
guide how not to be a noob though you
know I do always recommend heavy how to
not fail at life quit bitching about the
bitches edition I do always I do always
recommend that that taught me a lot
about life guys
[Music]
[Laughter]
oh well it depends how many shares we
have no what's all right well well no no
no hang a negative so I can do this we
have six million outstanding shares if
we were to raise money now would
probably be it like let's say 300
million dollar valuation just because I
can do that math easier so six million
was 300 divided by six 50 so it's $50 a
share so yeah we're ways to go before
420 see we'd have to like we'd have to
like 10x our share price so oh yeah what
comes with a couple billion we thought
we'd have a wait there's some big exits
here I also have a coffee maker well we
don't we don't tell the twitch is about
my you know thing but we're not telling
them just because I was disengaging
while steering obviously that was a
disengagement that exit ramp is a
disengagement for drug trafficking he
moved he moved on to his next thing
[Laughter]
whatever he's into now
so yeah okay we had a disengagement for
an exit ramp yeah kind of well some of
us a breakfast I offered you breakfast
you're like no no it's not time for food
yet no I threw them out but you did yeah
in the car they're not right there's a
vault yo I test drove one of those ones
it's $40,000 and it has seats that you
have to do manually what vault no their
vaults with a fee I know they sound very
similar there's how many sad note
reviewers because everyone just wants to
talk no I don't you see you know what
they say about dreams if you fall
we have 309 viewers this is insane and
reviewers yo if you guys aren't
following me on instagram instagram
complex george hotz
mark zuckerberg told me that if i get
30,000 followers he'd give me a blue
checkmark and I'm not like eighteen
point four thousand snaps so I always
say thirty I wrote it on my LinkedIn
this proof
I round it up what can I say
catch me outside how about that lotions
and lace more affordable than divorce
while ya get a histogram get the
histogram out everywhere the lanes are
tiny I'm not posting more content
Alex this is like if I can't do it on my
terms I don't want to do it at all
because when she what no one's just hurt
no I don't even know Mattox I saw you
bypassing your screen time restriction
on Instagram this morning oh that guy
who oh should we start on the Navy oh
don't get me started on the Nate young
guys when do you think the last time the
Navy did anything was like like shot at
anything or like did anything we looked
it up 1988 man I don't even think return
to the Jedi came out yet
yo that was before the Berlin Wall fell
we could definitely say that yeah oh
yeah but then you know you could read
you know the Navy the Navy the Navy
crashed two boats like two years ago
like when's the last time there's been a
Navy battle all right but now we can't
rehash the Navy conversation the Navy
conversation only happened once
it's too hot all right all right yeah
hold guys does that count the secrets uh
bad tax have we done secret Sabha tax
wait just a spin draft now it's banana
as well yo you know what's crazy if I
was sleeping in the backseat
except for that exit we'd still be alive
right now don't do it I mean if your
chances of dying or high you shouldn't
do something current constantly all the
aircraft carriers are deployed how much
money is that costing me and what are we
blowing up with aircraft you guys know
the Air Force doesn't even do the drones
us the army was the Navy always joke was
the Navy always a joke someone like like
like back in the day and they wore those
uniforms the Navy used to be like a
serious I think the Navy went down with
the British Empire
that's totally a compliment and we like
to be chill and relaxed on this channel
that car got a little close to me so
that was a disengagement we trying to
kick the Russians off the internet wait
really
you mean the guys like sitting in like a
warehouse in New Mexico well Colorado
New Mexico deployed yeah they run
Windows XP welcome welcome to the
conversation yo if we just say
inflammatory stop people subscribe so
they can counter the inflammatory stuff
no no no Tory stop on the tour channel
wow I can't believe anyone like us watch
this more than when I'm on the computer
not even doing anything I'm literally
watching a car drive and complaining
about the Navy do you want you want to
just go to that convention center and
say were there yeah I know you want to
stop cuz you know unity breakfast I
offered you breakfast I made nice
guacamole this morning I had to use the
avocados so remember that's having
winter Burger King on periscope no no no
we went to Burger King on periscope once
way back in the day we went to a
McDonald's at a periscope together
wait why do you mean the time we went to
Denny's we periscoped in the Volvo
periscope was still a thing oh yeah I
was trying to sell the Volvo well look
how the lane disappeared it just it just
hangs on perfectly man this thing's good
technique here for the crash yo if
there's gonna be a crash I'm happy to do
in a live stream oh I've stream I wasn't
on the way to Vegas that was just that
night we went to McDonald's yeah my
mother watched that live ship it said
who's Alex she's be upset just like you
know my uncle was in the Navy or
something I don't know I don't know I
don't know anyone even me
well that uncle's an architect a he's
cool it's been driving itself forever we
don't even talk about it you know cuz if
you have a good self-driving car you
don't even talk about it you can have
this yourself if you just go on our
website and buy a yacht yeah you're
gonna need a compatible car but don't
worry there's like 65 book now so you
have a lot of choices
go to Barstow uh no tech lead okay I
thought it was like what you call like
yeah we know what tech lead is ya know
climate change is family weddings all
right
climate climate change is real but that
doesn't mean we have to do anything
about it that's that's a good meme I
think right I always want to piss off
you know like Republicans and Democrats
have ever told you about like my dream
of marrying a corporation is the
Democrats say marriage is for everyone
and the Republicans say corporations are
people right global warming is real but
we're not gonna do anything about it
boom lovin corporations like be like a
boring legal battle and like my marriage
my marriage would only be recognized in
like four states and Rhode Island they
recognize it but only if it's a civil
union
this seems like too much effort yeah but
what panic the disco was good
they were now he sucks it does collapse
with Taylor Swift no there ain't no I me
yes I know I T yes I know there is a but
there is of me yeah terrible
Oh yo that's a little that's you can't
marry your own corporate that's I don't
think that's okay
I wish you would all have automatically
changed lanes there to avoid this truck
that would have been really Pleasant I
[Applause]
don't think I can marry Tesla Tesla is a
bit you know out of my league you guys
you just missed two excellent lane
changes all the lane change features so
good it's what used to be disengagement
is now just not disengagement at some
point the future I have to pee and then
we can stop maybe they lost the service
how about we got a comment
you can't incorporate your spouse stuff
this big of established corporation
that's right it's kind of like if you
marry a corporation you like merge your
powers lightly you know marrying your
daughter off to the Prince of Denmark or
something no there's no princess anymore
who's making George mad what are they
saying
Wow
Walt that we have service man it's cuz I
have an iPhone 11 Pro
what are this comments oh no but no but
remember not all of them are subscribers
some of them can't talk because we don't
know how to turn that off well that's
not what we call it just sleeping with
other people
ethically and being chill about it is
not polyandry polyamory the whole thing
will get me started on polyamory it's
worse than the Navy no but what foods
you are what do you want you want subway
you want that terrible-smelling spread
pick where we're eating good poi twitch
twitch yeah
twitch plays eating which plays lunch
we're at that we're by a speed limit 70
signs now you can google we're at CA
trops
oh wait no here's a road show them the
side road yeah who are 215 that's true I
don't even remember where we are because
I haven't driven the car for like hours
yo possib I know I see his Mountain ears
are messed up because I have a cold I'll
take that shit guys I do way less drugs
and you all think
oh the new MacBooks display no no no the
new display and the new the cheese
grater well we have a trash can we got a
complete the Apple home where / now
because the drop is better than me
gusting OH
that's right that's right yeah
oh we gotta take that one what's the
time flies when you're streaming and
having fun with good people with stars
Nexen a Taco Bell franchise or corporate
arena then all Taco Bell's at the same
Wow we didn't go to San Diego San Diego
we're just in the right light I keep
thinking of that song Barlow girls the
best night is a terrible song it's not
pronounced Mimi it's pronounced me
[Laughter]
who set up who said I'm a tech people
wait go on about changes to the system
yeah we're gonna change the system one
point out we're at 0.7 now what's the
next big thing well it's not the Navy
I'll tell you that
[Laughter]
oh man it's really bad you know if you
know what it is we're going up Alex
you're always cold
you can unsink them and you can make
yours ha pasa bro oh wow so but really
we're going up and it's really bothering
my ears this is in Belgium I do not like
the impossible burgers and I'm not a
tech people so stop with that shit just
I have a complex nuanced identity
outside of tech No
yes everyone needs to be able to do that
programming challenge we don't like hire
any those people the only people who are
really hiring four people are gonna do a
bell because the futures ml no we would
also hire people
we'd also hire like oh my god oh no no
Matt you're just popped oh my you're
just popped ah ah that was pleasant wait
use your ear popped yes wait why don't
you just pop the same time we're so in
sync
it's like recycle together now what was
oh no no why are someone who's very good
with like SystemC stuff - there is
another way to get hired a comma as well
that we don't really talk about and
that's the mini pro request to open
pilot so like yeah like people who do
pull requests people have done car ports
we've discussed a hiring map yeah we
should put on the jobs page like it's
not just the programming challenge like
if you have a history of doing pull
request to open pilot where you want to
hire you the stream is alive and now
we're back thing good thing open pilot
doesn't require our constant internet
connection yeah yeah that's just a
people thing you don't got to put tack
before that
[Music]
we're full on the hardware team oh yeah
no okay so the programming challenge is
how you get hired for the research team
if you want to get hired for the open
pilot team submit pull requests to open
pilot don't get us started on settings
where a set settings we're coming out of
the hills complain we know people the
doubler well I know that bar yeah yeah
is he cool down the bar only in San
Francisco drinking is alive and well in
San Diego San Francisco's over man Oh
will open pilot stop for this bag Trash
Pack will open pilots slam on the brakes
for this trash bag
you know what would slam on the brakes
for trash bag lidar
yeah cuz its export control technology
know why DARS great we're stuck with
Lyde ours yeah okay our choices are
McDonald's or subway or neither they
keep going that's right that's the right
choice because it's the only one I would
have accepted I mean I might have
considered if you said McDonald's if you
would have said subway I just would have
made a face it's always disgusting
okay we have 11 viewers and I'm gonna
see if I can turn off there has to be a
way to turn off that moderator only
chest
no I don't even understand I'm not sure
ten on the web
2021 comma awards this is the award show
where we award all the community members
who do great work in the community
eric's one of the higher inspectors here
these are real community people that we
know
and uh yeah we're gonna talk about you
know a little bit of open pilot this
year in review all this exciting stuff
it's gonna be fantastic
so uh
let's stop the
copyrighted music before it gets too
late
and uh
yeah let's start by talking about open
pilot this year
all right it's been a crazy year hasn't
it yeah should we flip it to the are
we're gonna oh no we're gonna show it
it's just our notes our secret notes
all right so
we've got open pilot launched november
29th 2016. i guess that was our first
commit yeah it was the first commit uh
that was released in open pilot and that
was 1800 1800 days ago five years ago
open pilot started which is crazy it's
been over five years of open pilot
existing in the world
uh this year we've had
185 unique contributors including comma
employees that's a lot of no secrets
there are no secrets no secrets oh
should we just show them briefly there's
no secrets everyone has the awards yeah
so the secrets for you know their secret
finale yes right
um
look how many stars we have now dude we
have
31.27 000 stars and that's up from 21.8
000 at the beginning of the year so
we've had basically a third of the stars
came from this year alone i think the
top 100 repos at least for
the main language getting helpful
exercise so that's pretty cool super
exciting let's climb up
next year
all right now we support over 150 cars
that's actually 157 as of yesterday whoa
[Music]
[Laughter]
someone wants to buy me a s-class we'll
make it work on flex shit the community
i heard was going to chip in by bmw i3
would give it to us
did you take a few or three
crap and boxes
boxes
yeah we'll show you the tree it's very
pretty it's the comma the commentary wow
did someone get a common body for
christmas
they sure did george
you've been decorated
for next christmas that's right
today
yeah there's a lot of common body
pre-orders so
you know still get in and you're you'll
still be in the first batch of combat
bodies how many how many viewers we have
today we gotta give people a little bit
of time to get in here we don't just
jump right here well we're not jumping
into the awards you know that's a good
point
oh
sounds good
[Music]
all right well this is good because
we're not in the award time yet
yeah oh here here's here's a fun little
easter egg everybody
uh this is what was this called the
hippo
this uh was a common neo how many people
remember a common neo
yeah
look here it is right next to a new
comma body let me explain the problem
with the hip bone it's small and you
might kick it it reminds me of a lumo
yeah look how tiny it is i don't think
they know what a lumo is i don't think
oh there's going to be a google it
l-o-o-m-o
we're very festive look at the look at
the ceiling
pretty cool i think people are in here i
think they're in here too yeah
what about ci runs
are we over we don't have any i rents oh
crm we've got 22 kci runs i don't know
if that includes force too you know you
can enable the open file at ci and your
for one button no way yeah you go under
settings you enable github actions you
have all almost rci coverage we have
some stuff that runs here do their good
have actions paid for it or what or do
ours
i mean ours but you know it's free it's
open-source i'm just so generous for all
these horses
you know it's going to scale back you
know it's one of these things we don't
talk about as a world how we're all
becoming so dependent on you know i
think it has gotten way better in this
way i agree
but
first
this is the basic startup business model
first you get all the customers then you
lock them in then you jack all the
prices up you know the thing is we'll
just run on this e24
yeah so total commits 3173
and that's about to commit every three
hours
look who did the most commits this year
oh i wonder who that would be
oh it's this guy named
who who's that
and you did 910 commits all right we
have our everyone clap
we need i mean like a audience a live
audience clapping every time we say
something and we also released 11
releases this year yeah it's almost one
a month yeah so super great all of them
have been pretty big
we did the zero e series this year
launched last year kind of late last
year
just kept pushing on the same stuff
lateral toggle will be removed
uh probably maybe next release release
right after i don't have a new toggle
slider
not lateral in general
yeah
well let's go over some highlights with
open pile this year should we ask them
what their highlights were yeah your
favorite features sure go ahead what
were your favorite features of the year
i'll start uh by saying some we shipped
the first
good laneless model this year the first
kl model kl as we branded it back in the
day
and uh yeah that was very exciting
research has been working on you know
making lateral good for years
and finally there's a model that could
drive end-to-end so that was a really
big deal for us
anybody have any favorite things does it
show us all the checks yeah okay
when you view it they have top chat in
live chat oh yeah that's annoying
uh
we shipped forward collision warning
using the model that's pretty much
improved yes
yeah laneless literally used to like not
work
if you drifted at all from the center of
the path they would stop working uh so
we've come a long way
yeah this is amazing how yeah
break never bro never broke for overpass
i don't think yeah
uh obviously hardware announcements the
comma three launched this year
back it was really july 31st
yeah you saw the common body you saw the
red panda you saw the comma three
yeah this is the hardware here yeah we
launched a new platform
and then we launched the evolution of
the eon platform yeah so and the
envelopes from the panda platform so
it's a big hardware here hardware team's
been working hard oh yeah and they grew
50 percent this year
[Laughter]
are the people
right oh yeah yeah
it grew one person yeah one person 50
yeah
productions also you know done a lot of
great work this year uh we finished out
all the comma twos pretty much
start building comma threes and you know
still working strong on that sounds
continuously getting better
there's a lengthy mode oh yeah it's
default lane there's yeah there's the
landfill policy and the laneless policy
the socks someone said
socks are good too
all right next year i have to say long
for no dsu toyota
if you want that you got to work on it
yourself we're not interested in weird
cars
though we are hiring a car person so
that'll be on the priority list but you
know like very very low
um
so that's really shot if you want to
work incarcerated yeah that's a good
point comma 10k finally finished all
their images in 2020. we give them new
images we did yeah new images we gave
them some official commentary images
it's not even called tc anymore
common pencil we really appreciate you
you know it's you guys who are making
big model possible
i'm super excited for big model
next year
um but before you have an award let me
know because we'll touch the commercial
back you have some good commercial
man i think it's that time it's
commercial time i think it's commercial
oh come here
this commercial is for
this large rack
it represents 42 use of space
and it's about big enough that i can fit
inside if you said this was an elevator
somebody might believe you it's like one
of those like mine
shaft
this award is brought to you by this
rack and there's going to be five more
just like it in our brand new compute
cluster
uh coming next year thanks to the money
we raised
so that's a commercial for this rack you
can buy one at
cdw or amazon and they come fully
assembled
this just wheeled up to the door
wheeled up the door just like this and
now we have a switch in the rack too but
this commercial is not for the switch
it's for the rack switch
is there another commercial or is that
the only commercial
all right let me show everyone what the
commies are gonna get
here it is this is
what they're getting those things
oh man they're so nice we really love
them we're gonna miss them yeah
they're really nice neon commas that
light up
batteries included
yeah we'll include the batteries
takes
three double a it charges these are
rechargeable
check it out
that would make a good commercial
so you can see we've got some
christmas snacks going oh yeah yeah
we're eating holiday food there's some
donuts under that foil i'm very excited
all right great
cool let's uh announce the first award
harold here
harold
come see what the first award is so you
can announce it i think you'll like oh
there's a list i see here's the first
award
oh yeah best tuning
for quadmas
yeah this was the second oh cadmus
all right either way for uh you know
making a pr that
meaningfully improves the tuning
experience
that pr allows people to plot and plot
jugglers kind of all the things that are
relevant for tuning it should really
direct people to
tune more effectively tuning is kind of
this thing where you can just change
things and see how it feels but there
are much more effective ways of
figuring out what a what the right
approach is to improving your car
so kodmus thanks for that it was good pr
hey you also did the the tuning for the
volt oh yeah the customer
yeah for like the four people that have
that car implementing his own uh his own
tuning system
yeah
tama is the best you're right
all right we'll go off to another
commercial break you ready oh yeah
[Music]
while you're here enjoying your
chips and salsa you know what would be
great to enjoy with chips and salsa if
you had a robot that was just standing
over there balancing and soon
you can
this is the prototype comma body take a
look at it you got to look at it from
top to bottom it actually won't be made
out of wood we're going to replace this
with an aluminum plate but notice how it
has a much
smaller stance than a hoverboard
it has a square
a square pipe and the trick to a square
is you can't rotate it so the comma 3
mounted on the common body's head is
always perfectly aligned
with the rest of its body which is not
so true for me you know i'm a little
unaligned but the comma three fits
perfectly on the common body this is a
lot closer to what you're going to be
getting you can actually pre-order one
of these today there's a limited amount
of pre-orders it's only 50 i think maybe
even only 40.
we sold 25 so far so you know get an
early get a common body like imagine
just yours
if you go on our instagram you can
actually see a clip of it uh one of the
earlier prototypes actually going
outside pre-order your body today yes
you can do it just go to comma dot ai
slash shop and it's in the accessories
page
we didn't set up no we still have a few
all right next up
also harold needs to announce this one
what am i announcing you're announcing
the the most helpful feedback slash bug
reports winner oh yeah so that goes to
hubble sphere
given very constructive feedback
it's got given a lot of negative
feedback with you know attached data
that we can investigate and things that
are reasonable and have all the
descriptions relevant for us to
investigate i've investigated so many
hubble sphere bug reports that have led
to finding real bugs or improving
experiences so that's very helpful if
you guys want to see
how you can be helpful you can look at
all the things that help us through your
posts on discords oh hey hello sphere
or logan i guess uh yeah it's very
helpful it's very informative when
there's all the details attached that
could be relevant to us and have routes
attached and stuff like that
yeah keep it up a good bug report what
makes a good bug report for those who
never made a bug report
they have an issue but they want to
report it how do you do it yeah the most
important thing is that you attach a
route without a route there's very
little we can investigate so that's the
number one thing please how do you
attach a route okay so you can go to uh
connect.com.ai and there you can look at
your drives and there's a button that
says more info or something and there
you can copy the route and the timestamp
in the route to your clipboard so just
post that when you have any complaints
and then uh yeah just kind of give a
good description of your experience um
don't just say like oh it was driving
badly
in a lexus like there's very little we
can do about that if you give a route
and you say what exactly is driving
badly if you say you're on a fork or not
and if you say like this is something
that's changed recently or this changed
since then uh that kind of stuff's all
very useful so
don't tell us you're on a road trip i
don't care
hurry i'm on a road trip
on posting gifts that's also super
useful if it's like a driving related
thing if you just attach the gif of
what's going on on the road super useful
remember the difference between being a
hater and criticism is data
i'm gonna consider that the ad
we love complaints if you can
investigate them complaints we can't
investigate we can't really do anything
with it yeah so thanks logan you're
gonna get one of these
commies
here it is
one of these out for the hackathon oh we
did i don't know
daddy we gave one away what did we give
that away for no
yeah we should also say you know this
this commie will have to come down too
but right now it's being the star of our
christmas tree so that one's going to
take a while
logan didn't get one so he's excited
he didn't get one okay did he did you
get something that last year still on
this yeah you got like the 3d printed
color there's gonna be a real theme here
of
same contributors we got we've got new
faces in here yeah i know
all right
uh
this one i mean i don't know who should
announce this one i guess i i couldn't i
feel like we should just give it a
dongle id and then it's like a raffle
kind of thing that's what i was going to
do with the word
i think order number's better
okay
next next one uh greg invented for this
year and it's the most common three
training data the most uh data we can
actually use in training a model that
came from a comma three this year
and that went to gregory and your order
number is one six seven four two and if
that's you we're shipping to the copy
wow
yeah this early early data in the
commentary is very much appreciated in
the beginning there wasn't that much
data so they always have to collect all
the comma three data in every training
run because we want to have similar
amounts for the comma two data yeah so
very much appreciated should we tell
them how to upload yes
effectively let's do that like bring
your device in connect it to wi-fi
ideally upload dm
yeah if you wanna be useful the the most
important things are to mostly be on the
internet most as much as possible so we
just scan for uh
routes that have been driven and look
for certain things that we think are
useful and we pull data from those
devices if they're online um having dm
footage is also incredibly useful for
the dm training and future also for the
driving training
what else is yeah we also we want dms
anyway right later on
yeah all the video without all the logs
without dm are going to kind of use this
at some point right yeah at some point
we'll require all three cameras to train
comma 3 data
some other things that are very useful
um yeah we also filter on forks we it's
not enough
worth the effort for us to make sure
that certain guarantees are met on fork
data so we don't uh use fork data right
now and forks intentionally mess with
the logs which is not fun so yeah
it's kind of adversarial to use for
supports can also have timing issues
yeah we work really hard on the timing
yes you know if you're using a lot of
cpu usage certain messages that should
be logged appropriately
might might be too slow uh and then the
data is kind of broken and unusable yeah
anton dm is something we're working
on i'm quite impressed with the vm
impression so there's a lot of stuff in
zero a13 already
yeah zero 13 is gonna be very exciting i
was just uh just about to roll in roll
comp uh merge and roll compensation
which really helps on like
windy rolled roads just testing that
that seems pretty exciting
cool zero 103 is gonna be great but it's
probably gonna be uh zero eight twelve
barely just came out
and that was a great that was a great
job
yeah it has been amazing so you know
keep driving with your common threes uh
upload all over wi-fi like keep them
connected to wi-fi when you're home
there's so many people who must have
wi-fi where they park and i think that's
great i mean yeah we don't really offer
a cheap way for people to plug the
device inside
yeah maybe we should but they don't need
to in the comments
right like a nice five volt connection a
little power find on the front yeah
all right okay so you can bring your
commentary inside plug it into your
phone charger or your macbook it'll work
great yeah it plugs it even works with
usb-c to usb-c i know eric
didn't know that but yeah comma two is a
little uh it's a little sketchier but
the comma three is good um i mean this
is another thing we can do i'm down to
like
offer like something really cheap maybe
we can even include the box yeah if we
want people to power devices inside and
helps us yeah
we can we can help with this yeah
i guess most people don't have wi-fi for
their price products you know i think
drugs probably do and like like if you
had just have a house
but it's also important to bring it
inside because it will power off at some
point
well i think it'll power off even if
it's inside
we have a jack though
uh i think we have a check just we have
some kind of checks to see if it's in
the set of things that could be on ours
if it's five volts i think we need to oh
i guess five balls here we could get
five balls we could also do like the
power if the bolts don't go down at all
yeah yeah
but otherwise i don't just count the
power
yeah seems good um you know
you guys know if prime loses money and
it's about to lose more money
way more money yeah
um the cell phone companies are all
switching to paying per gigabyte
unlimited is over the party's over
so we're not going to pass those costs
up to you crimes are ready to rip off uh
i'm sorry it's a reasonable deal
um
so remember that we do lose money on
prime so we're going to really encourage
people to to get on wifi um
until the cell phone company is in two
years pretty long
party at the top
yes
i remember i remember back in the day i
didn't i had unlimited then i didn't and
i have it again this is a commercial for
bad cell phone companies who took away
unlimited plans
uh don't because now it's per gigabyte
you pay for what you use and it makes
people who use six gigabytes per line
very sad
at least they're going to be fast
gigabytes now it's true it's true yes it
will get faster the prime experience
will improve for the user just the
colossal
deep root for us
this will incentivize us to make it good
so that's right i guess it really is a
plus for you guys it's going to be great
the people's people keep winning
all right
cool uh i think the next one i mean i
think indeed you should announce the
next one car porter of harry potter of
the year let's get a
all right a little ramp up to it like oh
should we give it a runner up yeah okay
get a runner up so this is we'll give
you a hint this one is a jason the
runner-up but the winner is also jason
so i don't know if there's some
correlation with you know people named
jason
uh sunny haven or something like that i
don't know how to pronounce this he's
wrong but he's been the
kind of de facto hyundai maintainer for
a little bit
he did a bunch of carports he's been
upgrading firmware versions
just super helpful um
so shout out to you you're the runner-up
for this year but
our other jason like really killed it
this year uh we should have actually
counted how many individual cards i can
go count after this announcement
yeah
but it's well over 20 i believe oh yeah
57 supported cars congratulations
jason
jay young you win akami
[Music]
car porter of the year and
what's great about
a community member like jason is
they're also willing to help out
34. he said we're nobody oh he's wrong
okay good i'm glad i'm scott i'm glad to
um
but he
you know oh there we go
now we're
a big improvement
um but he
goes out of the way to help other people
importing cars different brands helps gm
fresh brand ports he does a great job he
recently fixed the issue that's been uh
kind of plaguing the gm cars for a long
time where they the ec rule falls
that's quite strict so
came up with a clever solution there's
only a couple lines
and it's largely mitigated to the issue
yeah so it does a lot of great work with
other
sub communities and helping them make
their cars good too so someone like
jason was just super invaluable
and he's really uh
not uh he's not too far behind our real
number one contributor of the year that
we'll shout out a little bit later but
jason is offering
after at their commercial break
all right commercial break
all right
have you ever gotten a box in the mail
and had no idea what it is well that
just happened to me greg handed me this
box
so
let's figure out what it is
do you have any better ideas
in here oh scissors scissors would work
too
i'm i'm rich i could use now a box
cutter
this commercial is brought to you by the
laptop
are scissors allowed on planes
i think so
it actually depends where you are when i
was in
the country of georgia they seized my
scissors
[Applause]
all right let's figure out what's in the
box it's package it
oh no way bro
is this a rtx 3080.
i'm gonna play so much minecraft on this
wow it's even better look it has a
blower fan
wow the hot air goes out the back wait
does minecraft use gpu
i'm going to render an ultra high 8k
resolution
gtx
rtx
and also the cuda graph api that runs on
this rtx 3080 but not in the data center
only in a compute cluster
all those shaders on minecraft it's
gonna be great
[Applause]
good commercial the unboxing
okay
now it's time for shout outs
these are you know they're not getting
commies but we appreciate every
community member
so there's there's a lot to talk about
uh first of all there's shane who runs
the most popular course
hey we did yeah
okay we got one more to announce you're
right we have one more comment
uh you want to hold up a commie yeah i
feel like we don't hold up the community
these are really cool they're custom
made all right china
from china
unlike your comments to be built in the
usa that's right
still right
right there
okay
this one goes to the most controversial
community member of the year i'm gonna
let people guess for for a second
who's the most
controversial community member of the
year who's winning this commie right now
is she more more popular than dragon
pilot shane jane's fork uh i just put
dragon most dragonfire devices are
uh oak
no not gucci
well i guess i guess this guy isn't that
controversial we should talk about it
no good who likes good shit
he's just negative
okay this question is helpful
yes they're very helpful they help
people in the community
if you catch them on a good day they're
gonna you know be amazing fix all your
problems if you catch them on a bad day
they're gonna send a meme in the discord
yes the commie goes to
eric
cloud
shortcut
good job eric
thank you thank you for providing uh
toyota he drives a toyota and he works
at ibm
yes
he's sold more toyotas than your average
employee who works at a toyota
dealership
he really has i can't i can't believe it
i met him in person he wears a toyota
hat like this guy's real wait where's
victoria no he just wears a trailer
i don't know where he got the hat
um but yeah eric you did a great job
you helped a lot of people
and uh
you know i think you're you're good at
pointing people to ask the right
questions because sometimes you you know
you come in discord you don't know
what you're asking you don't look it up
enough and i think that's important he
keeps the discord kind of elevated you
know yeah he does we don't want to hold
people's hands too much keeping the
hacker spirit alive you gotta google
your own shit that's right
yeah so thank you eric for all you do
cool
okay now the shadows now to the shout
outs first of all most popular fork
shane
uh shane is the inspiration for our fork
installer so thank you for for that
installer.com.ai lets you install custom
forks and this all came from shane
originally shane interned here for a
while
we appreciate
you what you do in the community yeah i
think his fork kind of delivers um
pretty good experience to a lot of
people who otherwise might not have had
the best experience on stock open pilot
so it's pretty nice you can take stock
open pilot and make some of the little
optimizations that we're starting to
sell like an ad
there's a commercial
we just want to shout them out properly
all right chain he runs a good fork um a
lot of people run it and they're very
happy with it so
yeah shane a lot of forks are based on
his fork so he's kind of like the king
fork yeah
that's true all right next up
is uh people who got fingerprinting 2.0
working this year
so
we got nissan and mazda
who are these people the nissan people
robin yeah he came to the hackathon
yes martin l wait this isn't nissan
oh maybe he helped with it i think he
helped you okay martinella's the subaru
maintainer does a great job working on
some of his pr's recently
um but yeah i guess he helped on a
nissan
firmware query and rosim io
big shout out to you guys
um you're really improving the carports
yeah big thank you to you guys and we
really need all the cars on fingerprint
2.0 you're working on super
soon yeah yeah super one's gonna get
merged soon we just got some audio we're
to test it um once we confirm it doesn't
interfere with any other cars um let's
go to merchant great another shout out
to mark now if you want to make your car
a tier one car it needs to support
fingerprinting 2.00
[Music]
yo
yeah
you'll see about this new thing in the
new year
uh
but um now
ours are whoa
and some cars are doomed to be silver
cars for their entire life
didn't tell the car go out of business
didn't get rid of you
i don't know whose silver car
of business but is can make your silver
car a bold car but it's gonna be real
weird no one else is gonna have one so
wow
[Music]
what
the
it's a way of saying if you have a
firmware model if you say honda civic
silver you don't have a firmware
honda civic gold
carpet ram is not metal color
the engaging border depends on your kind
of car yeah you should know you can
drive a sub to your experience all right
should we go on to matassa okay
i drive the accord every day it's it's
terrible
and yours is terrible too the only
person who has a not terrible accord as
well and this is why it's a slow you
won't even share it with us
yeah it is though that's true it did
inspire some good things
but every day every turn it's like
great
all right and then now we got the mazda
ecu query but really the whole mazda
form yeah we recently i think this was
in 0811 we got the csi merged um it's
the first
supported mazda uh an upstream open
pilot we have some other ones that are
dash cam only because they have a
steering walk out but so thanks
yeah he did a great job
um still work in progress i think he's
working on longitudinal now but i drove
it it was pretty decent yeah i think if
it can support home pilot longitudinal
it can be a gold car yeah yeah i don't
know
it's all right twerking 65 is good
all right is it not good kind of berries
i don't know all right i think there's
some space to go to ice
almost gold almost gold
no no it sounds silver yeah
we got the hyundai the toyota and the
bbc
oh wow oh yeah jason the vw crew really
you're gonna really show up no wait wait
really the dws aren't all exactly the
same they're exactly the same they have
a great api
why is that
i don't know just like i think it was
poorly tuned the wheel was sloppy yeah
yeah a lot of it was turning yeah yeah
yeah i i think jason fixed that like the
actuator delay on it was like
ridiculously way too low so
oh you're telling me it has laggy
steering
no it has like like a toyota level
steering oh yeah that's not that bad
yeah yeah okay in open pilot the toyota
was like 0.1 second delay and for some
reason the vw was like 0.02 or something
okay so i think i think there's just
we're not accounting for the lag in the
stack 0.1
sounds good yeah we'll do one more
before the final award yeah um
all right so yeah gold cars coming in
the new year yeah it totally doesn't
have crap torque what is wait vw or we
cap it
uh maybe we're gonna change it now but
we know it's limited all right tuning
related we've got a somewhat new
contributor here um i think we merged
something of his just today clockness
monster
really looking into the internals of how
the controllers work
found some things that were
some
very low-hanging fruit he could improve
and uh some
some nice prs with you know provided a
goal verification and he confirmed it
actually works better on his car in
principle it's better so those are the
kind of pr's we're looking for um not
just kind of a pr commitment open pilot
so great work clockness monster yes
thank you i think
he was just in chat so thank you for
your he was pretty awesome just gonna
work yeah keep it up i think he's gonna
say maybe next year you'll get economy
keep keep working at it yeah yeah this
is how we actually hire should we talk
about you yeah this is how we hired go
ahead
how do we get igor
so uh igor is now on the hardware team
this is how we grew the hardware team 50
this year
um
and yeah he joined the community
sometime last year
um yeah he got a shout out
i think his first time like
maybe was a week after his first post on
discord he already had like three pr's
merged across different repos he had
like one serial open dvc
pilot
immediately productive and this really
got our attention and he just kind of
kept the ball rolling
and uh we gave him a shout out in the
comments
and i'm not sure we actually got an
award no he just got a shout out but it
inspired him to keep going yeah he kept
going and then he
got a job here yeah so
keep it up if any of you want to work
here i mean one just you know try it out
submit good pr's but uh yeah keep it up
great
uh we also just wanted to shout out a
few
open source repos that we use here
before the metro break i think the
commercial break is it's just gonna be
this is gonna be right after this and
then we do that
okay
yeah okay so first of all a tool used
that we love is plot juggler yes tell me
about the hot chocolate you use it all
the time i do use water a lot of time
but i think it would be
a little more pudding come from a
skeptic
you were a part of a skeptic at first
yeah i was a cloud checker skeptic at
first i had i don't know i had a lot of
juvederm notebooks that did the same
thing
um
so at first when all the jupiter
notebooks i had worked perfectly i
always just used that for a few months
but then i had to start adding things to
them i tried plot juggler instead
and it just worked and now now i'm a
convert yeah he's converted i'm a
convert i think i was skeptical because
my notebooks worked really well and i
didn't think that portugal could be even
less hassle but it was so
fully converted fully converted it's an
amazing tool um so shout out to this
maintainer um davide fakanti
i think that's how you pronounce his
name um
and we actually are working on a plugin
to put the video from your device into
the blog so it'll when you scrub and
prop and watch uploader you'll see the
frame at that given time oh wow that
would be pretty cool
and you can use a few cameras your f
cameras any of the camera streams um
it'd be really good
yeah we saw people complaining about
that
it wasn't corporate it wasn't
professional enough
we liked the memes we were thinking
about submitting some new memes upstream
build custom tools we use platforms
all right great and then harold used
this one a lot yeah so jonathan frey the
he's the main maintainer of akados
acados is an mpc library so we use uh
through our lateral longitudinal
planning we used to have something else
that was akato and then akados came
along and it was this this nicer cleaner
python version with the same
functionality
which jonathan has been maintaining and
when i started implementing that uh he
started having i mean i'm not that
familiar with mpc i was trying to port
rnpc to that and he had a lot of very
useful comments on how to make rmpc work
better and better suited to our
application so his comments are super
helpful since he you know was much more
familiar with all the npc stuff and he
uh helped improve our mpc project so
that was very nice of him and very
helpful should we talk about his project
yeah
john will also be
joining us for an internship in uh
january next month
um since uh since he was so helpful with
all the uh though the academic
supporting and his project is going to
be
probably mostly actuator modeling so
for example in the prius we have this
big problem where the angle sensor of
the steering wheel is not that accurate
so you're not exactly sure where the
steering wheel is
this gives a problem if you're relying
on a pid loop to check where the angle
is then apply torque to get it to the
correct steering wheel angle so if we
can just model how it responds to torque
so that we don't even really need to
rely on the steering angle sensor which
is not that good in the prius we can get
very smooth
smooth lateral control without relying
on the crappy sensor and i think uh
johnson's going to do a great job at
that and then those improvements also
carry over to other cars but the prius
is going to be the main
main benefit benefactor and the priest
is also very popular car so it's very
exciting yeah good prius
you drove the prius the other day how
was it i was so excited i was gonna post
in our internal channel i was like i'm
so happy with all the prius is driving
and then i hit a turn and
it was just like
i deleted that post
did you post it and then delete it no i
was about to oh i see you know i just
deleted it bye bye css eric said
yes exactly
software's essence
prius it works if you're driving on a
straight line
the longitudinal is great it's so
responsive yeah
he's not that bad yeah it's kind of a
hybrid motor torque yeah yeah all right
you ready for the final commercial oh
yeah
we got a few commercials now
these are
holiday reese's pieces you can see the m
on them it stands for reese's pieces
they're red and green and delicious
also
brought to you by
here was the computer
nights without you a midwest emo mix to
end all midwest emo mix
by pets
also brought to you by redis
redis is an open source bsd licensed
in-memory data structure store and then
when you realize it's in memory you
realize you need more memory so our
final commercial is for one point
terabytes of memory how much memory do
you have in your computer i bet it's
less than 1.48 terabytes listen to
nights without you a midwest emo mix to
end all midwest emo mixes today
great
thank you george
all right this is big this is the final
comedy of the night oh this is the one
it's that time
yeah we need to someone pull up the drum
roll on
youtube
people are very shocked by what george
just laid on them
he said that he has 1.48 terabytes of
friends
okay
it's quite long great
[Music]
contributor of the year
i think
he doesn't work at ibm let's take
guesses he doesn't work at ibm
and he doesn't have a toyota hat
he doesn't have a toyota
he has a turtle but he doesn't have a
toyota hat
as far as we know
[Laughter]
[Music]
one two three
[Applause]
dean lee for the second year in a row
you've been
the contributor of the year you've had
by far
the most commits out of anyone
who works here
yeah let's do some
he has a chinese toyota erickson okay
do you have the what's it the avanza or
something no no no it's a corolla
open plot
do you work here dude
[Laughter]
all right and then uh yeah we can just
go in the first position all right let's
check it out
979 closed pr's oh my god so he's almost
at a thousand pr's
that's insane i wonder what his merge
rate is
i bet it's high is it high all right
i mean that's pretty good
all right oh should we start with uh the
contributors page
yeah we can show the full contributors
page so shout out to our 261
contributors
and as you can see dean lee right here
650 nice round number
that's cool you know what's very
important he's twice as good as me this
is the most important thing right here
negative contributions
nice he's down 4 000 lines
i'm i'm not good
yeah chris just add lines yeah
whoa no kidding no no no no
yeah unfortunately most of us are fake
we deleted ad libraries so oh my god i
added a million lines you just add and
then we're deleting all your stuff
oh that's great but yeah dean lee is now
the third
i mean he's been the third for a while
for a while he's really solidified his
position
he's the
wow
wow keep it up dean lee and in a few
years
you might
actually we can do it just this year uh
where is the internal common place wow
hey look at that this is just this year
also you can um oh he's not that close
alone that's like 80 comments that is
close oh yeah
that's pretty close click on these
look at the trend though
[Laughter]
let's see
look at that beautiful what a year
real shout out to dean lee oh my god 36
commits an open pilot just this month
that's wild and keep in mind he doesn't
get all the quick commits like fix the
typo or anything yeah he has
[Music]
there's no one look how much more he's
committed
to everybody who ever asks me how to
become a great programmer this is how
you do it there's only one way
yeah here every day the dean lee method
he gets his pr support all the time he
doesn't care he comes back he uh fixes
up what uh we discuss and then yeah the
new one's even better and you just keep
that cycle going
until you get better yeah so we
appreciate contributors like dean lee
uh thank you for contributing to
openpilot
and you've got a comment coming your way
let's find some highlights
your number one fan yes all right
some highlights
oh this is actually a pretty cool one
i don't know how he finds this stuff too
okay what do you do with this all right
this one's just a cool one to me but
basically what
it's very it's small diff but what this
does is
only initially in the boot log so boot
log is uploaded once when your device
boots up so what this will do is it'll
collect all the logs up until then from
the system logger throw them up into
some log and then after that it'll only
collect the logs um from the point where
you went on the road let me tell you
about off-road so i filled this pr it
would always be all the ones from when
your advice booted up until you went
on-road and that would be every time you
went off-road
know how you found this bug it's not
really a bug but this is
a little bit better way to do it that's
great so
it just amazes me how he finds the stuff
yeah he finds all his own problems in
the code base which is pretty amazing it
was amazing
yeah what's another highlight oh we got
another big shout out actually oh we do
so
robert had a great idea last night and
he well i guess europe morning but
um we
had this idea to add the engagement and
disengagement uh kind of hotkeys to
replay so you can click e or d and then
it'll take you the next engage event or
disengage
um and then a couple hours later deemly
already has that implemented there it is
in like a nice generic way so you can
add other features where it's like okay
i want to see all the times where the
alert status changed and you kind of
want to keep jumping between them
he wrote it in like this really nice
generic way where you can just write
that
and he wrote he basically wrote this
whole replay tool which is what
everybody uses now internally and
externally yeah to replay their logs
incredible what an incredible person
or is it
they're sons
quite honestly we don't know lizard
robot government yeah we're on
[Music]
so we're still unclear is it wally we
should probably get like a wally statue
to commemorate dean lee in the office
look at this 40 pages of pr
i believe junior is one person
but are they this style is too
consistent yeah this is true
or a class you know a team of people all
trained in deeply
oh they've
maybe it's a mob programming group oh
yeah i think harold's onto something
yeah yeah that's why do you wanna talk
about mod programming you wanna explain
what that is if you guys know about pair
programming
it's all the goodness of pair
programming but instead of two people
you just have a huge amount of people
all sitting around the same computer and
then when you write bugs nobody can be
blamed
[Laughter]
oh it's amazing you could have 10 people
writing code but no no instead you have
10 people arguing about which code not
to write
and they all have their different
keyboard with the switches they like
it's amazing
would you take a vote one character this
is why george has a big couch in his
office we all pair a program in there
plays open pilots well the commenters
think there might be a dean and a lead
oh that's just interesting
it could be a sentient ai as well it's
always a possibility
look at this he just finds all his own
issues that's amazing that's pretty
exciting look at all these replay pros
look how many get close too
it's incredible but then he keeps going
yeah he doesn't discourage him he just
keeps going a lot of my pr's get closed
too
yeah but the thing is you close up not
somebody else
i think there's a big difference
they're closing before other people can
it's a good strategy
yeah awesome it's hard to find distinct
projects because it was so consistent
it's like it's it's amazing because you
know nothing he does is pretty much ever
featured in the release notes have we
ever even put his name in the release
yeah we did it for the replay tool the
replay it's just the thing isn't like
the stuff he works on isn't like super
user-facing yeah but you should
definitely get more shout outs maybe in
the blog post yeah and like the back end
and like when open pilot you know
overall gets cleaner and more stable
like a lot of that's thanks to you yeah
yeah for sure
so
in every version there's a lot more
changes than what's in the change lot
i'm sure sure you know that yeah we sent
him a comma three he was in the first
batch he immediately got it and fixed
all sorts of bugs that's amazing
that's incredible
but yeah
i mean these are all quite small
yeah
like he really knows the code base
outside of this company he probably
knows the code base the best which is
really incredible
yeah thank
you yeah
clapping sound
oh that's not enough
[Applause]
[Music]
great
well yeah we just want to say thank you
to all the community members uh you know
whether you just make youtube videos you
just have a comma device and you enjoy
it the retweeters the retweeters the
likers the instagram people we even have
instagram people the data collectors
thank you to the haters
yeah
it's really incredible you know we're
that we're open source and uh
succeeding making open source software
uh yeah very cool example in the world
that you can actually do this you're
becoming forks
there's like seven thousand forks of
open piles now
i guess muslim
but it might not do much but there's
seven thousand points and
i think we're getting to a point
where nobody can catch us you know
there's gonna be a point where
car manufacturers don't really have a
choice
like
could you start open pilot right now and
ever pass us no matter how much
resources you had i'm not sure you could
yeah
it's true
no
they don't know what kind of box to put
it in
we need to show them the kind of boxes
comma three just put it up there
glue it up there no no the top three has
to be a small metal box without a screen
then the car manufacturer is trouble
it's incredibly reliable
yep
great thank you everybody that was
another year in the books
and uh we'll see you next year for the
kami's uh 2020 to
trustworthy
we should get like a metal paint
yeah it might help
thank you all for watching
happy holidays
merry christmas happy new year
bye everyone
it's presentation time everybody the uh
prize the top prize
oh yeah
here's the problem
you hold it i have the hold it by the
end
all right welcome to the hack people
here
we're going right into presentations
we're going to show them the prize first
chris is grabbing the top prize to
motivate everybody oh wow wow check out
these prizes
it's a cross-country one so
47.99
dude
great piece of hardware a lot of value a
lot of value
so we're gonna leave those here
and uh
everybody hackathon is ending
it's so sad it's been great
we gotta unplug the right tv huh
if
i'll give a little
little sneak preview for one of the
actual one of the ones coming out
computer runs windows
because the linux doesn't support six
monitors don't show them the real killer
feature of this no i'm just gonna yeah
he's it's sleeping
the common body's sleeping
the secret features
yeah secret feature to be shown later
wait what that's a really good prize
even a red panda
wait that's better than second prize
i don't know if we can do that
i think they get their choice of panda
whatever color they like one color
wow they even get a great no they'll get
a gray panda that's great
what or ten white pandas
uh
that's a lot of white that's a lot of
value
these are these are nice prizes
if i was in charge of the prizes it
would have been like a t-shirt
maybe two t-shirts in first place this
is why they don't put me in charge of
prizes
yeah everyone here got free sweatpants
too already
see that's what you get for being a
champion you know everyone at common
hack he's a champion that's right
but some people are more champion than
others and that's what we're here to
determine right now
[Laughter]
all right looks like the
tv's almost ready
who is most champion that's a common
throne across the country
i think i think yeah yeah
let's go in that room we'll roll a
20-sided die and that's what we'll
decide
hey shane want to hold the stream for a
second i'm going to go grab a tripod so
yeah
we remember your name you're more likely
to win projects
those ones i remember should i begin
go for it okay um
hi thanks for inviting us it's really
fun i came here with a question
i wanted to know what happens if the
driver becomes unconscious
you see this and staying here you cannot
stay engaged
and
hey so you have to kind of do this
so this was great i got the answer i
need it when people ask me i can tell
them
like i know where things are happening
then i wanted to do something
more interesting so i tried to do the
seed project
i shared a device with the displayport
team
so that caused me to have to learn some
more interesting things and the common
body project was going on
and so i just kind of got distracted a
lot
i ended up doing a web streaming thing
i used the canvas to kind of
being it be able to manipulate what the
camera is doing based on the case
position information
that was interesting but not exactly
what was expected
so then i started working on the comma
tube
that i used to drive home every night
for two hours i didn't want to break it
it also takes a long time to
compile on that
so i decided to just impulse buy the c3
today
it's awesome
[Applause]
and i'm busy trying to get it running on
there uh i don't know i'm enough open
jail to get the actual demo working so i
didn't complete it but it's been fun
thank you
[Applause]
um
people want to be on the table the five
people want to be on the table you know
i see that falling over there
you know what might be able to hold that
up great
oh
i think i know you're
what are saying coming soon
all right my name is cameron ranks uh
this is what i worked on on the
hackathon thanks for inviting me
so the calm body is very clearly the
feature of this company it's going to be
in walmart watching people check out
groceries it's going to learn how they
move we were doing we were staffed
yeah yeah right like
replace the people but
it's clearly exponential right starting
at one next year is going to be the
bottom
there's gonna be like 500 000 these kama
bodies right they're gonna be everywhere
so we're thinking about the long tail we
got to think about the future of
humanity right we're all going to be in
metaverse plugged in right so what's the
future of artificial intelligence in
this new world
this is the omni bridge
so any game or software on linux you put
into the omni bridge
puts it into open pilot gets back to
steering gas and brake and outputs the
keyboard controls the joystick through
x11 or view input to the gamer software
in question music you found open pilot
on something like mario kart 7 with a
legally acquired rum right
or if you don't have access to something
like that
do something like team fortress 2 right
so it's coming to open pilot master
sometime near
once carlo's working again live demo
live demo yeah you want to see a live
demo
[Applause]
that's yeah you guys want to see more
quite seven yeah i tried it
i started with super text but it didn't
work as well
does open pilot know how to click
through start
i don't know you do guesses pressing a
second
we love live demos
live demos or make hackathons great
yep
is it not in a good state
it's tethered
well i mean you know there were some
tragedies at least it has a working
screen
we broke the body has broken one screen
so far it's a three hundred dollar
replacement the comma part shop
see
whoa
whoa
so it's not super perfect there's some
issues right oh it's still going
is it is it a calibration issue i think
we need more mario training data if we
need a higher level
it wants to turn
yeah
is there a one-click reset yeah here it
looks like it's gonna go back to the
start
yeah sometimes it gets turned around
i did cherry pick some
how clean is the zombie bridge code can
we stream it here
no i mean carl is a tragedy because you
know you need like a 30 80 ti and like a
ryzen 59.50 to run it this is
intel you know running github actions
and github actions
[Music]
no no no no it's gonna download it from
like
dot r-u
hey github actions i'm sure owns a copy
of mario kart
let's try this
how's it driving right now it's pressing
a
oh
yeah
all right well
that's what i worked on
[Applause]
who's next yeah maybe we'll just do uh
15 years
i don't think we have to go to picking
people yet
picking people is cruel the teacher
would do that when like everyone wasn't
behaving
you i'm calling on you
front of the class
multiply numbers
beers in the fridge everybody if anyone
else wants beer is beer o'clock
that's pretty cool someone said for
every comma owner and future owner for
comp device uh it's about tuning you
want to get into a driver assistance uh
supplied vehicle and press engage and
just like be totally still down the road
straight in the center of the lane
perfect longitudinal control nice gentle
gas and break because that's what the
model outputs but a lot of cars don't
follow the plan exactly so this is about
tuning i want everyone to tune their
cars and have the tools to do it
this is plot juggler an amazing drag and
drop tool
and i created uh layouts to help people
tune their cars so this is a lateral
layout
let me plug it in
so
when you make a tune and you want to
upstream it to comma which you should do
for every car
uh you want to be able to plot like the
exact model output curvature and what
your car actually did
and then also there's a lot of effects
that can happen that can uh
you don't want to judge so like if the
car is in a roll position if you're
touching the steering wheel or if you're
limited by the steering actuator itself
and you're going to upload in the pull
request lots of scenarios and this
layout helps you pick those
for longitudinal
we care if you touch the gas or break uh
and we wait five seconds um
after uh affecting the car's performance
before showing up on that graph there
and so this is a log from a demo route
by comma
what i also worked on was uh half
finished but it's
a
score
for a tune and i'll try and complete
this too
but um i'm trying to collect a list of
your errors over time find their
frequency distribution
their mean the absolute value of the
mean and i'll work on this more but i'm
just comparing you know how you did
achieving that speed and how you did
achieving that curvature that's it
cool
everybody uh
get your tunes in we're getting rid of
the toggle for laneless uh and when you
do
uh if you have a poorly tuned car it's
gonna be worse so you know get your
tunes in now get them in early now's
your chance and this is already upstream
i hear i heard the pull request was
beautiful
all right we will call from people if we
don't have volunteers
volunteering
here yeah oh volunteering we're missing
kern where's curran
current get over here
all right this is
sorry to disappoint anybody but this is
a live demo only so
you have to
um gather around the big screen here
with comma 3.
so
raise your hand if anybody has ever hit
your car
in a parking garage or parking spot
great i see this is this this feature
will apply to everybody
[Laughter]
right so um
uh current matinee did sentry mode for
the comma three so what this does is
if somebody hits your car or tows it
um it will send you a text message
automatically um
and uh
we'll give you a demo
great
so you can check out here
under toggles
we have uh enable parked car crash tow
notifications
and uh you can add your phone number
here this is my phone number
i shouldn't have shot
that live stream bro
i'll just
[Laughter]
but yeah we'll simulate a crash here
oh no
somebody crashed into our car
my poor comments racing
[Laughter]
and uh check this out it said exactly
what happened which is that we sent
something from our twilio trial account
all right
wait so where are you talking to twilio
on the on the device on the device
we store the phone number on the device
just uh just like you wanted
cool we also did some work with the
temperature sensor so
if the temperature increases by a
certain amount in the car every increase
it'll send you a text message as well so
now do you have to run censors d even
when you're off-road
uh yeah that's that's cheat right now we
run we run sensors do you well
uh i i don't want to talk about it
it'll be a fix in the future
yeah that's great so um without
sensitive running it's 4.5 utilization
of the cpu monitoring on all the time it
goes up to 7
so it's about 50 increase so that's
undesirable
yeah i mean it's got the content there's
a good power monitor on it like this is
one of the things that actually holds us
back for shipping well actually no we
want sensitivity all the time to come
too right because
i'm going to use this
because we were
it was it he's
negative we saved way more on the screen
yeah yeah yeah but um cool
um there's another i guess feature that
i wanted to mention so if
you choose to have it sent to your email
um if it detects an acceleration um or a
crash it takes photo on the front and
back camera and then it emails it to you
so that's that's another way for you to
see what happened how do you send an
email
um use using python s
smtp what server connector uh so you
have to authenticate using your own
email account so you kind of have to put
it in first so you have to put in your
gmail threads into your comments right
this is always the problem with these
things i mean we should just buy a
company twilio account and add a prime
end point for like sending text messages
and like your prime thing can include
things and actually we can definitely
set up email as a back-end gateway but
prime should really like support these
things it should be upstream too
ultra prime well
wow all ultra prime yeah no no normal
prime will support this ultra prime will
send it faster
possibly
get that get that get that edge 30
seconds to upload on normal prime three
on ultrafront ultra prime big bandwidth
big price
great cool cool
good job
who's next
all right
good thing i stayed here until 1 30 last
night
there
definitely a winner
yeah youtube live sucks so it only uses
the front cameras so i literally have to
like
turn it around and use the screen you
can't switch cameras when you switch
cameras the mic is still here so like
you can't hear anything so you have to
like hold it like this so before winning
the prize reminds me when mr burns gave
employee to the month to this titanium
rod
[Laughter]
so i apologize if some angles aren't
perfect i can't see the screen
that's
next stream
you want to write that code the issue
isn't writing a code it's maintaining
that code
yes please put your youtube stream key
into obs which is connecting to the
h.265
streamer d
port
oh yeah where's streamer d
yeah where's europe yeah
i was wondering i guess it's robust
i went to sleep
thanks for having us it was really fun
um so we did a lot of work with uh depth
10k
uh
mainly started focusing on trying to
clean up the data set since there was a
lot of bad images in it
so
this is sort of our was our first
approach to just take the site net
outputs and just look at
the proportions of each class in the
output
and then if there's
uh an unreasonably high proportion of
one class in the image then it's
probably garbage
so like this is an example of the kind
of images that we would extract
um
and we did some
uh so basically we would calculate the
proportions
of each class and then
basically have a cutoff threshold
we also did some testing with uh
image variants
to see more complex images
yeah and we did this because initially
we sort of filtered it
like a self-driving data set where most
of the images which we kept in were
those that had like
classes that are related to the road but
as george pointed out this is supposed
to be a depth data set so like images
where you're looking clearly into a
field would
would give us
like it would would be in these images
but we want to keep those since they
have depth so what we did after that is
looked into some of these other stuff
like
pixel variants just seeing um if we
could get any structure different types
of structure out of images since most of
them bad images looked um as can you go
back to the first slide like this where
it was just like you know
one color everywhere um in the end
so
so we did a couple things uh pixel
variants was giving us some mixed
results uh we also tried to do some
stuff with color differences uh plus
grain on color uh using like k-means
clustering on the colors
that didn't give us really excellent
results so then what we ended up doing
was um so this is an example of some
scenes that you might want to keep
because they can
uh
these sort of segment outputs would get
excluded in uh
in our initial method but
the next method we tried was we
basically ran the depth net over the
data set and
that would give us some indication of
whether there's any depth to extract
there so the middle image is an example
of an image that's the depth uh output
is completely blown out and so
that's easy to filter out versus the
other images where there's more contrast
in the depth
that gave us a lot better results we
were able to recover some really good
images uh
like these
uh from the initial bad images that we
uh
that we excluded
so we'll be pushing up those those
changes as soon as we get something that
looks good we also did some more
experimenting with different depth nets
uh initially our approach was we wanted
to try to fine tune some of these depth
nets
on depth 10k
we kind of ran into limitations with
time and resources to get that done
but actually we're just getting yeah
worse results yeah and initially just
getting worse results there needed to be
more tuning done to get it to properly
work but
we uh we were able to run it through
some pre-trained models on
monodepth net which gave us
actually very good results
uh we tried struck to death
uh although this is pretty old and the
results that it gave us the cars you can
you can see like that it doesn't capture
the depth very well
um
and so then we tried this other paper
that's actually
just came out this year
uh something
about instance aware monocular depth and
that gave us pretty good results as well
and that's actually that's actually what
i was using
to filter out the uh
the images and the from the bad images
so
since we weren't able to get
much fine-tuning done on these networks
we decided to
hard pivot over to uh
trying to put a chess engine on the
comma three
uh and so we were actually able to get
uh
we were actually able to get twitch
chest running on the comma three
and i'm currently in advertising
with my very high quality chest yeah
with your very high quality
i'm currently in a very heated battle
uh but bro he's gonna take your bishop
yeah it right it runs very very slowly
if it figures that out because yeah
it figures it out but um
it's not optimized currently so it does
take
quite a while to actually run um
but most of my time was spent trying to
get uh a qt web app to actually display
it on the comma 3 screen but qt wasn't
uh wasn't being very nice to me so i
wasn't able to get that working
in time so bro
we might be here for a little while to
see how to take the bishop it takes
takes quite a while to take a turn for
some reason
huh does it take minutes
uh hours no it doesn't take hours but i
mean it does take a little bit of time
i don't know why it's so slow i mean
i don't know if it's just an unoptimized
thing
yeah
but
that's basically what we did yeah
cool cool
for those that don't know uh depth 10k
is our new drop from this hackathon you
know we came out with the comma 10k last
hackathon
uh comma 10k requires you to color each
pixel a lot of people have had a lot of
fun doing that over the last year and a
half
depth 10k
really doesn't require you to do that
much we appreciate the work cleaning it
up
but it has three images in temporal
order so you can use this to train
unsupervised depth nets it should be the
most diverse release data set for doing
that so you know we hope that people
start to use it people start to put it
in papers don't use kitty and cityscapes
try a challenge try depth10k yeah
we'll continue on our own trying to
implement and fine-tune some depth nets
on on 10k and hopefully get some very
good results out
[Applause]
good choice twitch good choice
so if you know maybe uh
on the back of the comma three there's
not only one port this pc but there are
two ports and
so far
so for example you can plug in
uh
like some usb devices like a mouse or a
keyboard and they they will be
uh you can use them already
but what this thing also can do is uh it
has a
power sorry a displayport output so
you could plug in a displayport cable to
a monitor the problem at the moment is
it's still not working in the software
so what we tried
um
and maybe not completely succeeded but
yeah we tried at least to make this run
so um maybe if you can go over here
yeah
and probably it might work
otherwise
well it was working fine a minute yeah
it was it was
literally i just ran out like five
minutes ago
okay well
well what would happen
so maybe
soon do we have to plug in a monitor
oh it's plugged in already it's i've
already tested it oh it's that comfort
yeah okay so what essentially what's
supposed to do is it's supposed to show
the pattern it unfortunately flickers a
little bit uh we're trying to figure out
why exactly we can really figure it
figure that out um when it comes to
setting up the
displayport there's different modes um
that are possible so one of them allows
it to flicker one of them makes it super
super smooth but it literally just kills
the device completely and we have to
re-put it again
um
but we've got we went through a bunch of
like our team we were pretty new to like
the colonel stuff
so when it came to the trying to figure
out where exactly
to find the displayport i mean you could
probably talk about like the willing the
weyland situation trying to find how to
connect
the comma stuff to the actual list of
paper i mean it was kind of a it was we
just kept getting deep going deeper and
deeper
right so
what we did
was we took an old commit that was
supposed to enable the display port and
we ran that through and we got the
displayport working using mode test
uh
in order to get it to work we need to
display wayland disable wayland and
anything using the graphics drive
the back end sorry to check the monitor
maybe tomorrow like went to sleep or
something no it's good
[Music]
[Applause]
we have disabled western that's why um
every yeah every comma 3 has hardware to
output display port over the expansion
port
does the usb port work if you use that
thing yeah yeah so oh yeah
yeah we want to show that also right
there
um
what you can actually already do with
your homeless toy if you plug in uh a
sorry a mouse
the cursor will actually show up so
there you go
[Music]
um
we customized this a bit but you can
already open a terminal in here
it's the perfect computer for very tiny
people
yeah
that's cool yeah the mount we got the
mouse working uh for some reason the
keyboard doesn't work so we're trying to
like
program on the actual combo which would
be pretty sick
um i'm sure in time
so we'll get it working
and then obviously if we try to do
this is where election policy kills yeah
it's western
windows like that
yeah
i forgot and then this takes a while to
like
do it again
okay
so it looks good but then it completely
like crashes
crashes instantly so we're trying to
figure that out why
is um about trade-offs
yeah dave was able to give us like the
west end stuff but even then we were
we were going deep
yeah yeah no unfortunately there's a
great tragedy our western stuff's not
open source you know i hate making
things closed source but it was given to
us you know
weston is open source though so if you
could get open source westin to run on
the comment three i'll be very happy
with you
that's our next next
bounty up for that
it was a lot of fun going into the
kernel it was my first time actually
even going into that so it was it was
crazy
it was all fun cool i think that's it
for us yeah great thank you for having
us
who's next
we're moving down still or is that a you
guys have
you got a show
all right
my seat's
gone
seat's been stolen
all right here we go next presentation
all right i'm connor
aldrin and they say brevity is the soul
of wick so we'll try to keep it short
and maybe it'll be so short that you
just wanted it to last longer so uh we
did a ui uh design change um
when you upload uh the comma
drives uh the ui kind of looks terrible
so we
dedicated some of our efforts towards
making it from bad to like not as bad
but it's still not great so this is the
original watch um
so this is the original one
and then it doesn't look too good when
it's um
like
i mean like like this is like a kind of
phone view
and then this is what we intended to
create and then
yeah
so we change it a bit if we go back to
like a normal
scale it would look a bit better in my
opinion so
um it's also more clear like custom
would go to custom thick range which
is more self-explanatory
and then it also looks better on mobile
so it
can
have responsive web design
so everything still fits
yeah
it's simple but
it's nice
[Applause]
nice
looks good
more
presentations
yeah i can go
let's do it
okay
so this is a tool to test the ui
so generate the ui in most of that state
currently it's most about and mostly
about the off-road and on-road
but yeah
the demo is a little bit slow uh because
it's for a demonstration purpose but we
could uh
speed it up with uh yeah just if you
want to do a real test uh what is the
test
it generates the the ui and all the
states so at the beginning comma prime
comma not prime not pair etcetera how
can it fail
yeah
okay okay so it's processor replay for
the image for the images
so uh
you have the ashes uh this is the the
the true version that i said in the file
uh so if you want you have a new version
you can put it there and this is the
real version
um
so yeah then you have the the ashes um
and for all this the states uh sometimes
it's not the same like for the wi-fi uh
because it changed all the time so it's
not it's not really true and for the the
on the road it's not the same uh because
i
i i need to like send two frames to get
exactly the same replay or maybe a video
but yeah right now it's not exactly the
same but we can see that it's look
pretty much the same
so yeah that's it how many lines is this
uh
it's
not not not yet not yet okay
it's on it's only working on ubuntu if
you are not like on i3 or something like
that
uh but yeah
yeah we can't we can't uh
stream it right now it's not ready yes
github actually this is this would be
great yeah
cool
all right who's next
is it trust me i think that's project
very impressive
there gonna be a demo on the screen uh
it's gonna be a demo on the device okay
um i'll probably send it right here
this device
yep
and after this we got some employee ones
right yeah
are you ready for your demo
is the body working
uh yeah yeah it should work oh better
there's going to be two body demos no no
if you want to charge it you got to
unscrew the thing connect the other
thing and it's really hard
well someone else may have to film
because we might need you for one of
those demos
oh shit body's working
[Laughter]
for those people who are new to this
stream you guys all know what the common
body is right does anybody not know only
body for staff body for everybody 5.99
q1 in fact if i put a hundred dollar
pre-order up right now how many people
will buy it
right
yeah
no really though
really hundred dollars get in pre-order
fully refundable right do you want to do
it
yeah
yeah
we'll make outrageous claims about it uh
yeah
oh wait actually maybe if we have a
little bit of down time we can award
this special prize i have a special
prize i promised one of these we can
give away one of those commas right i
just won though
i promised this comma to whoever came up
with the best idea of what to do with
the body and i believe it was you
who suggested that the common body could
be used as a scarecrow and this is the
best idea so congratulations
enjoy
[Applause]
i probably shouldn't give the speech but
i dedicate this to all the scarecrows
who will be losing their jobs
they need to find new employment
common bodies here to take it
okay
so you know i'm i'm not joking maybe we
will throw that pre-order up yeah i can
throw it up yeah let's stop and
pre-order a hundred dollars for common
bodies fully refundable it'll ship
sometime next year uh just like elon you
know
yeah i think yeah can't body pre-order
right no pictures just like you all know
what it is
there's just no description it says
common body maybe your body like you
know like the future of people
cool
all right hello everyone
um i think to begin i want to say thank
you to the common team i had a lot of
fun i learned a lot and you guys are a
great uh inspiration for me so
thank you very much
um so
what i decided to work on was um
something the common body
so i did was
i decided to like put a face on it
and uh what it does is
uh it has eyes and it will track
the
position of uh
it tracks um it uses the driver's seat
to uh track
the the driver and then basically just
looks at you
a little bit of an issue though because
like um the drivers today it's only for
like it only looks at like a particular
part of the
of uh like what the camera sees
so
uh if you move too far left and right it
won't track you but if you move left and
right like right here you'll look left
right so i replaced the settings with my
comma eyes
so
when it doesn't see you it makes a sad
face but when it does hit you
um
you have your face
[Applause]
nice
the price is 5.99 uh
subject to no
you know what
if you put in the pre-order i will
promise you 5.99 we'll honor 5.99 so the
final price is 5.99 so it's going to be
4.99 more to actually buy your body uh
the deposit is fully refundable at any
time up until you know you've got to put
your money in and then you know
that
i think we can do it
is that this is this do we want to like
copy you one yo by the way by the way i
just want to give a shout out to to real
whole mars catalog and the people who
are replying like george is just copying
elon elon wanted to do ai first
check your history that's all i'll say
about that
um yo check your history
uh but grapevines do think alike i'm not
saying you don't copied me
um
but uh yeah no common body i get in uh
we're gonna copy elon and do hundred
dollar pre-orders for our future product
which probably will exist maybe someday
in some form
okay
we'll get that up after
i'd also like to say a lot of people are
asking about crypto you can make your
deposit in crypto except yeah except
i think i think we actually hold the
coins too
yeah
yeah yeah
i can make a deposit in crypto but it
won't be refunded in crypto i think
that's too hard are deposits to
refundable
i don't know the closets are fully
refundable we got a copylog
maybe if it's crypto it isn't yeah
crypto i don't know if that's refundable
yeah especially no it's also like no if
you buy it in crypto like you know what
they say about dollars they're always
worth a dollar
except for that one rick and morty
episode where it sets them equal to zero
and everything goes crazy but you don't
know what i'm talking about
who else is presenting
yeah we got everyone
all right some cool presentations
who's going first
how else do we present the body is it is
it a balance mode
balance mode right now oh okay then we
should go first why don't someone else
go first then i'll make sure it's bound
well no no but do i know what mode it's
in now and do they want to present that
oh it balances still no yeah and it's
still remote control
oh
wait it's just a face what about the
face yeah you have the acceleration face
uh all right let's just do it let's just
do it now yeah come on come on into the
research office
uh the body is tethered now because the
battery died there's no viewing platform
charging batteries
yeah you guys can all see
it's balancing now so i can kick
something
you can see it has a face uh just if you
wanna come take credit for the face
and then just move it somewhere hold it
and now
go ahead
it should be on
right look at that
all right uh
who worked on who worked on it all right
i was going
copied the face from joseph
to the branch
[Music]
by the way this is what you'll be
pre-ordering for a hundred dollars
although i do think i i will say that
the retail version will be a little
better than this
yeah here's an overview
slow pan
all right so do we want to show one
common three not included right show off
what's going on in the screen right now
yeah you gotta buy the comment three
separately
five ninety nine commentary oh you seen
do you wanna yeah tomorrow
can someone hold someone
this is the is crisp branch on open
finally
it's more difficult when it
it's more difficult when it moves
but yeah but it's stabilized if it's if
it's stable
now watch let's watch you know you gotta
also do not hot dog okay
[Applause]
want to demo your remote control wait do
you want to see how it works how the not
how the chris and not chris detection
works okay we'll demo the remote all
right so i went online and i googled
joystick and then i imported joystick
and i had joystick do a high quality get
request to a flask server which
publishes a test joystick message on
serial and now when you go like up oh
no
your phone you have to lock the rotation
on your phone
let's see if it's still alive
oh it's alive
wait hold it
all right i'm holding it
all right
wait
i think something's not but oh maybe
this is bolted
i don't think faulted
crashed
nice no i mean it's not getting signal
right
well all right so the kind of body was
good
your body will be 25 more reliable than
this common body
by the way it did exactly what was
commanded the problem was i rotated the
phone and whoever wrote
joystick.js that made it jump all the
way to the corner
[Laughter]
uh we just lost seven pre-orders right
there
we got more i don't know why it's
beeping yeah i mean i lost connection to
the board i'm assuming must have yeah
maybe it broke the board
oh well
at least it balanced a little bit yeah
you all soft balance right this is real
yeah check out the instagram if you want
to see it us
did you check the windows running board
oh if that faulted yeah oh no that folds
yeah yeah restart that oh okay here we
go
wait you sure the board started though
uh yeah we're starting now
[Applause]
you know what let's try it again i will
not rotate the phone yeah let me know
let me try it from my phone because i
lock rotation on my phone it's just
accessible on a very simple ip address
interface here's joystick.i and launch
i'm going to gently press it backwards
well that's forwards
that's backwards right
yeah that way's forward so we can turn
even we'll turn we'll drive it over to
harold right
all right
yup yup yup it's very high quality and
robust
whoo
oh yeah you can even kick it
all right well
his head broke up
the mount
the mount's a little non-rigid but the
good news is this is a cheap piece of
plastic
you guys just watched a comet 3 get
thrucked into the ground twice if you
say our hardware is not reliable you
know
we've got reliable hardware here
um
do you want to explain it yeah
cool
good thing we're not judging ourselves
oh wait what about this i don't know
when's the next uh i guess we'll take a
second to start up okay we'll talk about
is chris first this is chris
you know
maybe maybe today
oh yeah at the new office
yeah right when we launched the body
when we launched the office yes
okay
by the way you know that none of that
stuff's using the balance code from the
hoverboard it's all running on the
comment three so when i kicked it the
thing you know
it's in the comment three
hi everyone my name is jasin i'm wishing
we're going to talk about how escris
works
the cruise detection branch
so um you basically wanted to see if the
dm models
um were able to recognize people without
any training without any fine tuning
um so do you all know how the dm mobile
works it's a convolutional neural
network that takes
the frames of the driver and then
predicts uh many things
one of the things is if it's distracted
or not distracted right
so we go before the
head that says if it's distracted or not
and we pick what we call the feature
maps which is an 800 dimensional vector
and based on that we created what we
call the virtual quest
which is a template of what the feature
map of a chris photo should look like um
and after that on on the device we just
compare
the actual feature map to the virtual
chris
and if the distance is low enough it's
gross if the distance is high enough
it's not because and the distance is
just an l2 distance um and uh rashin
came up with a nice trick uh to avoid uh
some of the uh false positives you want
to explain that yeah yeah so if you just
use like the vanilla like virtual chris
visual vector it like contains many
features for chris say when
where is his head when it's driving and
when he's looking at or something like
that so we don't want that in comparing
like to other persons say if person is a
person stands in front of a camera like
like in the position where like chris is
normally driving it would probably say
like it's crisp because like it's in the
position which is encoded in the future
vector so to filter that out we we just
like we can simply rank the future
vector using
uh by uh comparing like the standard
deviation like
throughout like say one segment or a
segment when chris is driving and then
we filter out like the the most changing
ones and we only like use like the the
least changing ones which is most uh
more likely to be you know what's chris
himself so the features that change a
lot
are describing how features how chris uh
moves his head
how chris is standing and the feature
that doesn't change are encoding
actually chris
virtual
actually chris is back
so that's how that's how it works no
training at all um just a very low tech
simple trick
thanks pretty cool i mean master open
pilot soon so you know when i'm driving
all right who's next
mitchell do you want to go next
are we going in there are you coming out
uh i just want to get lane changes
working on carla
first to get karla working was a big
task
so
let's see
why
it hasn't worked like a month
no
i thought we had regression tests oh no
also now uh
so the
let me put it on the screen
so the images are over uh vision ipc
do we have showing the karma fixes
no i should have so yeah but i think i
need to make a carla car because this is
right now the palace head
okay so it's driving and you can see
that the steering wheel
that's so cool
nice it turns okay it's doing a left
turn
it's a real palisade yes
desk palisade so uh the thing that i
actually wanted to do was lane change so
you can change the lens
so that did finish the turn
change in a turn
as we all know that's a bad thing to do
someone needs to improve the tuning
yeah yeah tuning so yeah we have to make
a car car so okay
uh yeah hey craig greg was uh also here
until like four days in the night we
were fixing this so you can first you
have to put on the blinker
and then you give it dark
and then it changes the lane
and then you switch off the blinker
wait can i drive oh yeah
oh yo i got this i got this i got this i
got this all right i gotta go back let's
go that's great yeah yeah that's pretty
good
yo
got that real force feedback you know
remember playing need for speed and you
had a wheel this is a real wheel
oh yeah it's i think it's uh it's
because i turned the wheel yeah yeah
don't do that it happens in a real car
too
yeah so we had a dream of uh having this
infinitely long road on which open pilot
drives are a little bit closer
that's it yeah look at that does it feel
good like it feels yeah it gives you
like the resistance yeah it's pretty
good
yeah this is great
you gotta keep this working
awesome
[Applause]
okay who's next
okay all right so i made a little mind
storms tank and uh i ran it around for a
little while and collected training data
of it bumping into things and not
bumping into things and then i trained a
model to predict when it was about to
bump into things and now i
am just uh running it around trying to
not bump into things
so let's see
the car tank
look how cute this is
someday the software will come to the
body so get it first if you put a
pre-order in right now for a hundred
dollars
and by right now i mean once we put it
live i think we're gonna get at least
three all right let's let's see how it
goes
all right will it hit things
what happened to our board
oh no
no oh no it's not moving
[Laughter]
yeah
i'm gonna come back to this one okay
any other presentation
yeah igor you should talk about your
yearly i don't have a presentation but i
was working mostly on a research uh
canfd
car kia surrender i confirmed that it's
kind of d i
got some data
to understand what needs to be merged
into
uh
red panda to support kennedy what needs
to be merged
into open pilot
and what needs to be done to port this
car
so
also i got
roads
with the data
and i think
tomorrow i'm gonna
[Music]
merge into master support of knfg for
red panda
for full support
um
i don't know when we're gonna
merge nfg for open pilot
but
i suspect pretty soon
uh
so that's that's all
great awesome
[Applause]
so we're at mitchell or not yet
i'm restarting the break okay
yeah so
alex and i are working on uh making
support
refactoring support
right you came down to me thank you yes
um
we have pretty good feedback around
support but it was it was becoming a big
task and we want people to be able to
support themselves it's really important
yes so yeah the whole the whole rework
is going to help people support
themselves uh
making some quick videos on how to do
things like factory reset some things
people have questions about uh so
that'll be nice very exciting videos
yeah the video's gonna be great our
support response email yeah we added um
a ton of new frequently asked questions
to our zendesk and we've publicized the
zendesk
so now you can access it instead of faq
which was very limited yes there's a new
support tab on uh on the comma website
so check it out yeah cool that was our
project
[Applause]
any other
i think we got most of it right
some work in progress things yeah yeah
you can use the tv
got a designer at comma hack is that
working
all right
we'll do that right after
uh i can do it really quick okay so okay
let's see
wait did it avoid that chair yeah yeah
wow if only the body avoided the desk
this is so cool oh it's a little
confused now oh it's trying to avoid
everything 360 360.
does it need light i got that
i was trying to avoid its own cable i
think you're like white
here come here come here you like light
it's good go into the light
with the light
that's pretty good
yeah it hasn't hit anything it hasn't
hit anything
[Music]
yeah
hey guys who wants to put a battery in
the commentary what do you
think the eon it had a battery that was
a good qual
[Applause]
yeah the cable
uses it
oh my god they even hit that vacuum or
vacuum would have just warmed that cable
right over
this is something yeah
real machine learning
i know
it would definitely help
i have a battery somewhere yeah it's a
little big battery in a very long thing
the common body has a battery on board
can run your comma 3 for up to four
hours maybe no promises if you pre-order
it might be more like 30 minutes
who knows four hours possible in
parenthesis
so do you wanna just explain like how
how it avoids oh yeah no uh i'll kill it
because it's getting kind of tangled up
uh it so it just uh uses the the wide
camera on the comma three so i i
gathered a bunch of data i've been
moving around and i used the
accelerometer to actually find out what
bumped into things and it's only trading
on like you know four minutes of video
total
uh so it's pretty crazy that you can
fine-tune a network to predict when
you're going to bump into something with
only like four or four minutes of data
so what was the base now we're using the
chat yeah just an image networks in the
18.
that's the first use of the wide camera
on the comment three yes
that was great thanks rachel
[Applause]
someone said another hundred dollar
pre-order for the comma vacuum
how about if it doesn't vacuum but it
stands
you can lean a vacuum up against it
i promise the real one will fall over
last i know what you saw
yes we can confirm that uh is this great
oh yeah it might be on screensaver
let's see is that a real thing oh
perfect
screensaver coming to the common three
no more burning
uh so one of the projects was to explore
uh some of the faces for the comma body
which is like one of the idea to use
some sort of a pixel grid
and then exp to use different
expressions
but one of my projects was to look into
streamlining the website and we have
some early stage
holy stage prototype over here
so the challenge was how can how can we
communicate more or better what are the
products and
what do we offer
so this is like a quick first time
preview
introducing comma 3
open pilot
51 daily miles engaged
um one of the some of the feature
features uh key features of the open
pilot
drive monitoring
the upcoming laneless
compatibility which is very important
supporting over 140 cars
testimonials
some media some user reviews from the
recent
video
and then the final call to action uh
comma two comma three
and then the 90 days trial
big quarter
yep
it's a very early stage just like
exploration how can we streamline the
structure
your calm body is an ad but it lives in
your house
website's great
[Applause]
okay i think we have to have a little uh
pow-wow to discuss prizes
uh i don't know how we're gonna do that
with a live stream this is usually the
part of the circus where they bring the
clowns in
you know that's what circuses do they
bring in clowns and they got uh
yeah yeah yeah maybe yeah all right who
wants so who wants to discuss prizes
who wants who wants the live stream
great
uh feel free to go interview people and
you know
oh okay you can use the joystick to give
the
oh wow okay
okay so we'll go through and uh talk to
the various attendees who wants to
volunteer to talk
i'm the most interesting person here you
guys ah all right that was easy all
right
so hey tell us about your cell phone i'm
on tv mom
okay i don't know how to use this gimbal
i'm not gonna lie uh
let's say these are comments my name is
cameron you should once my mario kart
thing is upstream you should try running
it in like flight simulators and stuff
that would be cool
oh yeah did you like make a how-to and
how to hook into yeah it'll just be run
the command and you type in the window
name it'll worry about that i gotcha all
right well it'll be pretty easy anyone
who wants to run
what he wrote and on any simulator you
also got to turn on different games i
tried to i tried on tf2 and actually
like the soldier like walked around a
little bit
all right so when he upstreams it
everyone should give it a shot uh
yeah it was people were saying it's
pretty rad so yeah thanks
all right anyone else wants to
talk to the audience i mean
buy a comma three
yeah
okay let's see uh run on pc star citizen
they say you should run on star citizen
okay how any anyone want to
talk to the crowd no okay so there's a
lot of guys who don't want to talk to
anyone here so i'm kind of curious i'm a
little curious
if
so the comma 3 has bluetooth
so i'm curious if there's anyone who has
ideas when it comes to like bluetooth
that's something i'm like would probably
do yeah
imagine if you're stuck in traffic
and
you know kama's driving because you know
driving is chill the idea is you can
talk to everyone that has common chat
installed and it's like a little mini
chat room
exclusively for
combat three owners and comma prime
maybe
yes i don't know anyway anyone who wants
to make it should totally fail thomas
open pilot is open source
all right let's let's see
any you want to talk to me i have
nothing to say nothing to say all right
i can catch tuning cars more oh yeah you
want a car that is the best open pilot
experience you can get and the best way
to do that is to follow the plan exactly
and the best way to do that is to tune
your controllers so talk to cadmus
run the plot juggler layout and uh we
will tune all 140 vehicles that comma uh
supports and more tomorrow more is it is
it complicated to tune your car i'm
curious it is a procedure that i'll
write the wiki for okay i'd say it takes
a weekend weekend to work for a lifetime
of open pilot
and you could say i tuned my car and not
many people can say that right
all right so you guys heard him fir you
guys heard it from him first
look for his push
is
it gonna be pulled into plot juggler for
you to already landed so it's already
part of the oh what the heck
i got the pull request approved nice
okay well in that case
look out for today you can already
tune your car
neat okay
let's see what if
man it's really hard to read the
comments on here do people like
anyway all right we're back okay thank
you
we're back
all right the ballots are in
uh
i didn't lose the envelope because i
don't have an envelope right so when i
make up the winners of the oscars it's
all cool who gets my reference all right
um
i'm trying my shoe
all here
we're going to start
with an honorable mention
um
i mean you know
it did have it did say twilio trial
account
but
it did do something so who was on the
sentry team
sentry team hello century team you guys
win comma hoodies
[Applause]
in any size these are worth 69 apiece
they are
[Music]
okay
in
third place
useful
beautiful
upstreamed
tuning for your comma device
third place you win one of every color
panda that is a white
[Applause]
canon and i don't know what white canvas
do but um
i know you as cadmus you didn't give me
your real name so
this is good canvas congratulations on
third prize okay
our second prize
it was probably the most entertaining uh
presentation
even though it hit a wall a few times
mario kart
[Applause]
we're going to give you a comma two but
not just a comma two we're also gonna
hook up with a toyota harness
[Applause]
for your toyota harness
um
our first place
goes to something at comma we've been
discussing doing for a while but we
haven't done
i believe your name is maxine
for ui testing congratulations on your
brand new comma 3 cross country edition
[Applause]
[Music]
[Applause]
do you have a common device uh no
do you ever support a car i don't think
it supports it oh you got you got a
fancy device man i think that thing's
nice you know what you know what let's
hook him up with a way a comma cereal so
we can hook it up in his house okay
right it's coming cereal that's the
harness for the unsupported car i mean
it'll look great on your common body for
your order today
oh you want to send hana i'm not that
generous but um
thank you all for coming out to the
hackathon uh if you'd like to
participate next year uh you have one
year to acquire skills for next year's
ctf
um
yeah i don't really know uh colin for
organizing a d for writing this etf
[Applause]
[Music]
we'll see you next year in our new
office yeah
everyone say bye to the stream
[Applause]
thank you
oh you're live we're live hey YouTube
Welcome welcome wait hang on I got to
figure out how to tweet this link on
Twitter oh no but if I close this no I
can't do it I need Alex
I need Alex uh
uh wait
yeah
what I mean yeah
Twitter yes
welcome welcome to our CES Booth Best
Buy is popping I know right I know this
is Best Buy but you can't buy anything
just like AVN is not the strip club this
is not Best Buy uh welcome everybody we
have an announcement planned in 10
minutes
um I'll take you around our booth okay
that's just uh go in here
if you really don't want to do the demo
I will but what do you want me to do it
I'll do it yeah yeah I just we you know
uh
foreign
yeah Welcome to our booth I can't show
you that side of the booth because it
has secrets
the secrets come in 10 minutes we got to
get more people in here I hope someone's
spamming the Discord with this link
um I don't know if I can share the
Discord I did share to Twitter though
and I promise I'd share it on Twitter so
I'm sure the discords will find it
uh the yeah will you say my time at
Twitter was wasted absolutely not it's
not about the destination it's about the
journey and there was some good food
when I first got there it was delicious
smoothies acai bowls
it's on Discord great uh 350 was way too
cheap that's so boring what you want us
to ship little shit dash cams we ship
high-end high quality consumer
electronics all right
they say they're here for a deep what
who is this YouTube
who is this
what's up any questions I got you a d
you better ask questions
any more contributors it's yes we just
met ifini here Sunny weeks here
the food is a good part yeah they're
talking about Twitter
uh tell us about yes bro all right so
there's a lot of scams here yeah pretty
cool Booth a lot of people we have a
pretty cool booth about a lake check out
the taco video
a bunch of uh devices
you know right uh
no no you think we are announcing a
partnership guys we're announcing things
that are going to directly impact your
life
Taco if it was a hit right
there is a Discord yeah discord.com
we did we took car and driver for a test
drive this morning it went well uh red
lights
spot on you guys know we do red lights
and stop signs now in experimental mode
um people don't believe this is real
people do not believe this can exist uh
it can the commentary is really an
amazing product
um there's no common four there's no
comma four I you know what I was
realistically I was talking we're trying
to buy chips from not Qualcomm and not
Nvidia because those companies uh so
yeah we're the comma for realistically
we say two years and it's going to be
more like three we're gonna be on the
commentary for a long time but it's the
common three right remember we shipped
the Eon the Eon gold and the comma two
which were all kind of part of the same
family we have a three device family
plan for the comma three and they're
gonna come slow uh this is still uh
still the comma three but the common
three you buy today is not the common
three you bought a year and a half ago
today's comment 3 has an all new case
um today's coma three has just build
quality
uh the build quality of a comma 3 that
you buy today
the reliability of that device the
likelihood it's going to fail in the
next year is similar to a new iPhone
um common three Ultra maybe maybe not
today though not today
um not today all right so you guys got
to tell me when it's one o'clock so we
can do the announcement uh it's a quick
announcement I think you guys are gonna
love it
um but yeah I mean you see the name of
the video the video is ready for growth
and we really are ready for growth it's
not one o'clock don't try me don't try
me
um
have we used our Trooper chip scanner
debugger uh it's not one o'clock
it's not one o'clock somewhere in the
world you guys don't know how time zones
work
T-minus eight minutes all right we got
seven minutes all right cool
um
not body related not body related it's
not a partnership
well how long should red pan is
integrated into the common three that's
not the announcement today that'd be a
cool one though
um
hopefully now it's a merge acquisition
why the hell do you want that do you not
like products you can buy do you want us
to get acquired by a scam company who
will stick all the tech in a corner you
think I would allow that
this stream is seven minutes behind yeah
funny
um no back camera you can't do a smack
come on you guys look like you want
scams you guys act like you want scams
um
are you on Booth every day yeah but if
you come here and be a fan you know how
I feel about fans like if I go up to Sky
Bree and I'm like hi Sky Bree I'm a big
fan I saw you on plug talk would I do
that no because it's lame don't be lame
you want to talk to me like a person I'm
here
uh
uh no scans please right right that's
what I'm talking about comma
comma taxi no no taxi no Taxi
uh AI girlfriend uh no no later later
later
yes so we are ready for growth you can
see the three rocket ships and the title
of this video
um we are announcing a chip production
facility absolutely that's what it is
you figured it out
uh does common work in any country yeah
what you think we have a region lock
well you think we're the DVD people
you want to say hi to YouTube
hello
my road no I'm not
okay we got a blog post we got blog post
going live at one I'm very excited for
the announcement guys it's been pretty
wild it's been nice
yeah we did a drive this morning up uh
straight Vegas Road multiple red lights
it's good
[Music]
uh you know red lights are good but
they're not always perfect
um oh we got harnesses we got harnesses
do you have a harness
they bring a box
all right oh just on our website
nice looking harness right that's the
Toyota harness
can common three stop and go with
traffic lights yes
yes it can
we're hiring zero Biz Dev people here we
got the crowd around our booth
no no no no no you want to be on the
YouTube video
gonna buy one go ahead that's right
don't say what other things are on that
sign though
all right all right how long we got to
one
four minutes
comma should automatically drive you to
the nearest charger
no no spoilers it comes out in four
minutes
do you guys watch White Lotus no
spoilers man every week you gotta wait
you got to be patient it's for semis do
you have a Sammy here's our list of
supported cars
here's our support of cars and just when
you thought that was like whoa that's a
lot of cars well guess what they're all
different on the back
but you you can't even believe they're
different on the back but they are 200
Cars it's more than 200 Cars
I'm growing right like growing Daniel my
boy
uh
no why
yeah why
okay
yeah large iPads are great
yeah they're different cars Bros you
think you think we're messing around we
did not partner with the CCP no no we
did not it did not happen
check it out Bros we got some we got
some consumer videos
open Pilots would be more popular than
Chach EBT yeah man
look it's a slow and steady grind but we
are going to win
[Music]
self-driving cars
Toyota security you got to vote whatever
you want to vote Greer you're welcome
this is your event congratulations
uh
introducing the comma question mark okay
we're gonna if the commentary we have
the price put you only 50 get a comma
three it's like a loot box you know
or how about this well we'll make it 90
off but only a one percent chance you
get it what do you think loot box
boot boxes are illegal that's right
um
hello from Nebraska hey Brevin
free comment three what you think I'm
Oprah
nah Alex thought I was Opera you want to
talk to YouTube
hey guys welcome to CBS thanks for
tuning in here
uh I'm a marketing intern I'm here doing
marketing as you can see
you want Shane Shane they want you
all right is it one o'clock
that's 12 59 all right one minute guys
one minute one minute we got 255 people
in here what's the big announcement now
it's one
the food in Arlington's good the food to
come is better trust me
all right all right it's time all right
wait you took away the one thing I was
going to show them
okay what is it being updated with
it uh Alex delayed the announcement
Alex delayed it hold on we can bring it
back what do you guys think of Alex
delaying the announcement it's right
there oh it's right there okay it's back
okay guys in ten
nine
eight seven
six
five
four
three
six one the price is now 14.99
14.99
gross
Bros
Jesus you want this one
did you lower the price even more
oh you made the common AI bigger
oh there we go guys 14.99 look at that
common dot AI uh so I think the Shop's
live if you want to buy it right now for
14.99
um
the comma 3 is definitely a consumer
product this one's really good the new
ones are so reliable we talk about this
a bit in the blog post if you buy a
commentary today it has reliability on
par with an iPhone
um you know close the loop fix every bug
we do it
uh 32 gigs oh yes and it's 14.99 for the
base model and we're not scam it on the
storage anymore 15.99 for 256 and 16.99
for the cross country one terabyte the
new price is look it's an experiment
guys if sales don't go up price goes
back up right but if sales go up price
days
uh yeah the site's still got a few
places the site they say the site still
got a few places where it says 1999
you can order it for 1500 right now
uh the blog's deploying we got a blog
post coming out uh we're really ready
we're ready for growth guys uh tell your
friends there's never been a better time
to buy
um you know I know people have said
about remember the comma 2 was at the
end of kind of a long product life cycle
right the eon eon gold and the common
two were all part of the same 821 uh IMX
390 family uh these
are
got at least two more years
um got at least two more years probably
three
uh oh yeah yeah they're working on it
look chains out to his laptop right now
uh we're fixing them uh we we don't work
with anybody we don't work with abtera
you don't understand Kama doesn't work
with people we work with cars right I
don't know if we support epterra it's
not a production car when it's a
production car we'll think about it
um
but yeah
uh major Hardware changes no major
Hardware changes uh same screen same
Outlet
uh in the comment three you're
definitely more tempted right
we did we did uh we did a survey and the
new price is within a region that should
sell a lot more
um you guys can see I published the data
on the blog
I'm a marketing intern I'm a marketing
intern and at Twitter I showed up and
demanded refactors and a comma I'm like
comma your biggest problem is that your
price is too damn high so you know the
price is too high we need to cut it and
we did uh we did and same quality
actually the quality is even better than
when it first came out because we have
refined the shit out of our
manufacturing process uh best card of
the common three Toyota Corolla can't go
wrong now they Sonata ev6 all great
choices
lower price better software better
Hardware buy now that's it that's it
um 14.99
um
open source the common three car mount I
think it's open source it's not open
sources
uh Nick's not here so I would ask Nick
about that
uh OLED at 14.99 amazing deal right
no this is um look
we did by bringing our manufacturing our
manufacturing in-house and by increasing
the reliability of the device we uh did
a lot to make it
you know to lower our costs so we can
pass the savings on to you
uh if you had hardware issues with the
C2 you will not have them with the C3
um the original c3s were about five
times better the new c3s are about 10
times better
monitor
yes yes
um keep optimizing bomb we're working on
it we're working on it what's the runway
we're gonna be profitable this year
we are very likely to be profitable this
year and that makes our Runway of course
Infinity
um
see c3's 10x more reliable than all the
previous Hardware that's true uh no
trade-ins for common twos
uh
never raise a guy you never say never
right like we got a good deal on our
last round you know you never say never
raise uh that's just bad business if
you've got a good deal never raised from
VCS we didn't race from VCS we raced
with some cool people some of our
investors are here uh when did the new
C3 Hardware begin rolling out uh we
moved to our new office about six months
ago so the new production line is just a
lot cleaner a lot better and that's how
you get quality
in Europe I'm not sure uh orders placed
in the last 30 days no we're not doing
refunds come on guys come on
um
you know come on
you buy it at that price you get it at
that price you got to be fair here
uh lidar is a low interest rate
phenomenon that's true
uh newcomer dress shirts I don't know so
made in America hell yeah San Diego uh
Toyota Corolla better with Taco Bell
that's pretty good uh we did all the ev6
the corolla's longitudinal is a little
bit better actually we made some bug
fixes we're using the ev6 as our demo
car so we made some bug fixes for the
ev6
um have any large manufacturers in choir
they're not serious uh they aren't
serious we have no interest in working
with manufacturers uh it's it's not
it's it's structurally not going to work
uh we are going to build better cheaper
and well maybe not cheaper than this
14.99 is pretty low but um
people are happy we gave you what you
wanted we lowered the price that's right
who's the boss at comma well Alice is a
CLL and Harold it's those are the bosses
you're the president I'm the I'm the
president but I don't get it confused
I'm not a president like one of those
democratically elected presidents I'm a
president like one of those like like
you know dictatorships where the guy
tries to like give himself a fake title
for legitimacy that's the kind of
President I am
a marketing internship
did Alex fire the prices go up
Department no I did I came back in and
I'm like guys guys we got to do
something about the price it's too high
I went outside and I was like oh my god
I've never spent two thousand dollars on
anything in my life so we lowered the
prices 14.99 now
uh interns make change that's right
that's right we had to do something we
had to do something about the price it
was insanely High we couldn't ask you to
pay two thousand dollars now it's 14.99
which is basically the same price as the
comma 2 was uh but there's been a little
bit of inflation you can thank
um you know uh Biden for that yeah you
can thank Biden and Trump if you like
the inflation
um so it's really the common two price
the price is still showing 1999 on the
website
price still says starts at 19.99
check it all check it all
it's right in the shop and honestly okay
it checks out it's 14.99 in the car
um
grip grip's good right
uh it's 14.99 for you hard fresher hard
refresh all right deployed two minutes
ago but but it's live everywhere right
right let's see all right what our
options look like oh wow the cross
country 16.99 that's insane boys
oh man
no guys
one inventory we will make more but it
could be it could be a short wave
actually if you want a common three you
should buy it right now we don't have
that many in stock we're just doing it
guys you know what I learned something
at Twitter and the question is what
would Elon do and Elon would cut the
price because it's the right thing to do
and that's why we cut the price
you don't like my hardcore haircut
um yeah any other questions
200 extra for the harness well if you
bought a comma 2 you don't need a
harness
uh can you got it for Black Friday can
you return and by now no
um
the best car for Comet three Toyota
Corolla is a solid Choice Johnny Sonata
is very good uh the evcx is probably the
best
uh 1700 with a free harness you can
consider it that
[Music]
um should I live stream this on Twitter
yeah we could have we could have
uh we're on YouTube We tweeted about it
I don't know if I trust Twitter's live
streaming yet we need the software and
servers guy to you know beef that up a
bit
um is the dev harness the same as the
comma serial oh no it's the same as the
comma two though
radarless is on yeah the ev6 demo we're
doing for all the press and YouTubers
now is radarless
you gotta Elon it right
uh you gotta Elon it right what would
Elon do he lowered the price so we're
lowering the price
um where's the zoo's Booth that's over
there
how fast is new model support pretty
fast
um will it work with a 2023 Corolla uh
you have to ask them
um
I said I wouldn't lower the price well
guys I quit and I came back as a
marketing intern and then I lowered the
price right George Hots as president of
comma would never lower the price his
favorite people where the prices go up
department but when I came back as a
marketing intern and I did market
research by the way check the block
I did actual market research it's like I
hired McKinsey or KPMG that's how good
this market research was so I did market
research thank you for buying
um I did market research and I found out
that we were charging the price was too
damn high so we we cut it we lowered it
um and look a lot of this is because we
brought all the manufacturing in-house
which lowers the costs
uh the intern might get fired to be
honest I might get fired if this price
cut doesn't go well
uh for people if this doesn't go well
for the company I'm probably going to be
fired and they're going to put the price
back up
I mean you know I had to fight a lot of
political battles to get that price
lowered guys there's a lot of internal
there's a lot of resistance against
lowering the price but you know I fought
man I fought I did politics that's the
distributed system guys
um just bought another comment three
yeah keep it going buy common threes
let's go let's go
uh no you're not gonna get a better
price than this uh yeah you're not
getting a better price than this
like the injection molded case is
beautiful it's really beautiful in fact
in fact
the injection molded case is the third
rev of it the third rev is good
is this the first time I've ever lowered
a price it might be honestly we were
charging too much the common three was
too expensive the comma 3 is now the
same price as the comma 2 was but
there's been some inflation
um what do I just wait for a while until
I lower the price again I don't think
that's happening the price may go back
up this may be temporary
um
no comma 3s light
uh
no
[Music]
we're not lower the price again but
really not
um
they might go back up it might it might
it might happen will it work with your
Tesla no uh maybe
George hats isn't coding anymore he's
writing movie scripts and doing
marketing by the way if you didn't check
out my Avatar 2 script on my blog it's
fire I wrote a much better Avatar to the
James Cameron and he should hire me to
consult on the next movie
um boom ordered yeah let's buy some
common threes guys you have a comma too
any advantage to getting the comma three
uh it drives better it works better it
looks better it's just better
like I have an iPhone 6 any advantage to
the new iPhone yeah your iPhone 6 kind
of sucks bro it's old
um finally got you to upgrade from the
gold yeah keep that old Hardware now
they're really good the new common
threes are really good uh do I price
match no I'm not price matching shit
that's the price you can buy one
um comma phone when we're not making a
phone what's my marketing strategy well
I don't believe in that
uh how's balti UV integration going very
good very good uh we have a balti UV uh
a lot of people are buying it for the
bald I think you'll have a great time if
you buy it for the vault
uh when is comma four three or four
years
realistically I say we gotta look I have
some people here we got to talk about
chips for the comma four we're gonna get
a new chip but
and I'm not just saying that I'm really
not just saying that you guys can
believe me or not but like you know the
commentary is still pretty new
um yeah the price went down a little
um what chip does coming through use
Snapdragon 845
uh the red panda doesn't come with the
cables needed can you have two common
threes one in your front rear window
yeah but it won't do anything in your
rear window how does common handle the
trolley problem we disengage and we let
you handle it ethical dilemma should not
be decided by computers
oh we have a new product for the red
panda people
what
it's not ready yet all right next week
we have a kid coming with all the wires
for your red panda yeah 450 it won't be
cheaper but it will include all the
wires just just yeah
uh is karma ahead of Tesla now not
really
um will there be another Comic-Con
Alex is like no I'm never doing that
again
um
Alex loves Comic-Con
uh show the zukes booth it's over there
can you buy it with PayPal Credit I
think so can I buy with paper cutter you
can yeah PayPal allows you to buy things
for credit you can
public release development by 11.0
Comic-Con confirmed hey guys mark your
calendars well we're doing we have a day
right yeah we have a date every day yeah
yeah comic-con's coming back are we
turning this into a full announcement of
everything no they asked I'm just I'm
just answering questions I don't like to
lie to the people ever you know that
another self-driving car awareness too
and no that's actually not happening
that will never happen I don't think
it's all right we'll remember zukes
they're here they're here they they have
a nice they have a really expensive sign
I don't know who paid for it sign cost
the entire cost of our entire world yeah
uh we don't know who paid for the zoo
sign because it doesn't make any money
what do you mean Amazon paper they're
sugar daddy oh they're sugar daddy
Amazon pay for it that's a good point oh
is Tiny come over no way I'm a marketing
intern here and I'm gonna move on and be
an intern somewhere else I interned with
this good food
um does it work with right hand drive
cars absolutely yes coolest Tech besides
comma
do you want to go on a walk around is
there another consumer no no uh this is
only the announcement we can go on a
walk around ourselves a private walk
around maybe maybe I'll stream that on
my twitch I haven't seen it someone
brought a Tesla in Corning yeah Corning
has a Tesla in their Booth that's the
other Tech I've seen here
uh how can you work a comma you can
apply jobs at comma.ai work at comma.ai
we're gonna have a hackathon oh tell
tell them about the hackathon I don't
know anything about hackathon I don't
work here anymore I'm a marketing intern
no one briefed me
um it's Harold's hackathon he has a real
Vision oh that hackathon oh shit that's
how I got a lot of Secrets prepare
yourself prepare yourself Harold does
have a vision for hackathon beefing up
your githubs any progress in common body
we got we got look comma robotics
you think there's no future in
self-driving cars after five years we're
going to build an absolutely perfect
add-on ados system and then we're going
to Pivot to home robotics tell them that
this year
CR Booth is very small we have a 10 by
10 booth the bodies didn't fit they were
too fat they gained weight they've been
eating but next year next time big Booth
oh no we're not gonna we're not getting
a big booth next year robotics common
robotics is getting a tiny boot if you
just won't have any comment to these
because everyone already know about it
because the Optimus you don't don't make
me go there guys
we love tests we love Tesla that's right
Comic-Con this year too
yeah comic-con's coming back comic-con's
coming July 31st
booked it might as well soft announce it
yeah yeah I don't know what stocks it's
not a launch conference my newest stock
you should buy I never would have bought
meta and lost lots of money it's gonna
be a party for comma it's gonna come
it's gonna be all things comma
um
we don't have any more stuff do we you
think we're working on a new product
that's like
yeah we just slowed the price of the
commentary that's right
you tell them about insourcing yeah
through the blog post no I don't know
how to get to it on my phone it's just a
lot of like language we don't do
collaborations we don't do Partnerships
I don't know what any of these words
mean guys if Boston Dynamics open
sources robots will play with them
you want to collaborate it's on GitHub
they're not shirts they're um we got
jumpsuits we got we got a jumpsuit and I
got a jacket
comma swag I can't turn it no you can't
hear the camera
I don't know what Foss dam is
uh when's coming into IBO never you
think I want to sell myself to bankers
wait we are selling a consumer product
the common three is a consumer product
guys we call it a dev kit if that
bothers you too much it's not for you
but it's a consumer product and it's a
good one
uh open pilot V1 oh it's literally a
deaf kid it says the word Dev kid oh no
man that's the thing if your mind can't
think outside the box it's not for you
um you didn't lose a couple hundred
dollars you bought a good product at a
good price and now there's a better
price you know that's just what happens
at least you didn't buy metastock and
lose 75 000 last year like you know and
don't even get me started on my gptc
like you know wish I could return that
shit
um how to use this tiny grad right
um new features went wait did you not
try experimental mode is that not
everything you want red light stop signs
turns nav on open pilot uh is it a
branch you can try the taco Branch if
you want to use nav an open pilot it's
going to come to release probably
three months George you got to become an
official twitch streamer stream to the
twitchies yeah no I love the return rate
what is it ten percent yeah you're
hovering around 10 I think yeah
it's gonna be lower with the new crazy
low price now it's actually too low we
need to raise our turn right I think it
was sub 10 it was like 80. I'm telling
you just buy it even if you're gonna
return it
Axel and it's still alive we don't talk
about accidents anymore it's done it's
done and we didn't pay him any money and
that's what matters so
uh with the comma 3 work in a boat
I mean what do you want it to do
you want to drive the boat I don't know
if it's gonna drive the boat
does boat
uh can you show the comment three you
want to show them come today yeah of
course here's a comments right yeah
it comes with a beautiful
organic LED screen you know that's what
the o l that stands for it comes with a
nice dark dark 80 degree fisheye camera
some beautiful IR LEDs which light up
your face at night and see what our
driver monitoring is up here
then on the back here
we have the comet three has two eyes it
has two ears it has a mouth for speaking
it has a mouth for breathing and it has
two USBs this one is a real USB this one
is an obdc which connects to your car
screws this is a wide GoPro Mount tier I
want to know why newer comma 3s are
better than older comma 3s they've just
been more rigorously tested also just
look at this case right do you remember
the case of the older common three how
it had like little bumpies in it we got
good at injection molding just
see guys like this is absolutely
beautiful plastic this plastic is rated
up to like a hundred and
I think it's 160 Celsius it's something
crazy Igor would know
[Music]
um who's over there uh this new plastic
is rated to some crazy high temperature
uh this whole thing is like you can bake
these things at 105c and they're fine
and you can put them up to 125 and the
only thing that will happen is the
screen will go off color and you've
never been at 105c that's boiling water
guys
these things deal with heat like you can
leave them on your windshield
um yeah they're good
foreign
for a bunch of our things but uh the
common threes are injection molded how
many commentaries do we sell in total
five thousand the one about the failure
rates failure rates yeah yeah so the
failure rate at like pretty much launch
of the comma 3 was 5x lower than the
comma 2. the new common threes it's
about 10x lower than the common two
um which puts it the comments was about
25 uh the new failure rate's like 2.5 uh
which is on par with a modern iPhone
did we find a new SOC vendor no we're
using Psalms and then yeah we got to
move away football coming to video These
companies aren't the future
um
[Music]
do you guys do wholesale for car dealers
so we'll give is it 15 off for 10. oh we
got to make that 10. it's just too long
now
it's too low now we gotta make it tap oh
get in yeah
don't tell him to get in we gotta we
gotta make a 10. it's 10 off it's 10 off
you buy chattermore
uh it's self parking possible self Park
is bad the only features you actually
want are places where the system can
drive better than you and that's Highway
stop and go and in experimental mode
that's uh you know a bunch of sheets
with red lights
I did not talk to Elon about common
threes to Twitter
mqb badge cars do they work I don't know
you have to ask a deep about that how
about summon mode oh come on they're
gimmicks you don't want that
are there any car dealers that are
installing these I think there might be
yeah you can ask I don't know
Works in right hand drive countries too
yeah in fact there used to be a toggle
we remove the toggle and switch it all
to Auto detect because people didn't
know about the toggle uh yeah but we
have an input to the model of what we
put in whether it's left-hand driver
right hand drive and it works a little
common three integrate learning on
device we're working on it um there is
already a good bit of learning on device
uh I think we call it params d
uh want to enter in a bank no uh when
can you expect eating long for FCA
whenever you make it work no we'll get
there order it all thank you thank you
thank you 1tb red panda you're gonna
love it
um the stop and go at traffic lights is
live today yes it is already in release
there's a toggle from chill mode to
experimental mode
um so chill mode is a traditional ACC
system experimental mode is end-to-end
longitudinal uh and it will stop at red
light the stop signs today the demo that
we're doing for the Press is on release
pretty much there's a few fixes to the
evcx which we'll get out in the next
release but they're very minor fixes uh
red lights are already live the model is
already live
what oh hold the phone oh okay
all right uh speed bump detection yeah
experimental model slow down for Speed
bumps
uh still planning on making your own
chips eventually
was the most egregious performance
improving bug I wasn't here for it I'm a
marketing intern guys uh is stock FCA
disabled when the C3 is installed I
don't know
um you ordered the basic unit if you're
doing a new model Port do I need
anything other than a harness no harness
is fine fix the slow speeds on ede
um
worse than experimental mode you got it
you gotta talk that you wanna Harold can
answer these questions but he's not here
I don't know where did Harold go I think
he got food I think you got food
why don't I hire an agency oh I'm bored
would I like to see a web only OS
sure Jack sure
um my next job I don't know
hi videos
[Music]
no we're not
Alex we're just not gonna do it
that's it this is our last seat yes guys
[Music]
um
how can you contribute to the growth by
comma threes tell your friends
I think it's time I think I think we hit
a price point now where we're going to
start to seize a bit of virality
uh you want Shane or Harold to talk
uh I can get I don't know if Shane I
don't know if they want to talk I don't
know how it is Harold's getting food
um
Shane they want to hear you talk
yo YouTube what's up I have a fork I
don't update I'm sorry
any questions
oh uh we have Mike D uh Cameron and I
worked on that so uh you should adjust
the volume for the sounds and adding
record adding recording soon so that
should be nice
foreign
[Music]
any other questions
support getting better I mean you had
support for cars every every week every
day so just want to tune just the KF
tune what's autotune what are we showing
autotune is that did a nice job on that
stuff
how old
I did I had no programming experience
how welcome so the question was how old
was I when I contributed open pilot I
had no experience pretty much like in
this kind of environment and I just
looked at the source code and saw what I
wanted to change
I just started learning the code base
so yeah it could be you guys you just
gotta work hard
I'm nobody's boss guys I'm a marketing
intern
I don't know
let's go to the board for that
uh got anything else but they were
complaining about some experimental mode
things maybe Harold would know
they were saying Wyatt like doesn't slow
down for Hills or something
no we kind of just got good before the
release next update should be pretty
good
it's an 80 models
jobs y'all were hiring we're hiring guys
we're hiring
oh we want to make aeb work on all the
cars
car interface engineering a car team
fix all the bugs fix all the bugs a lot
of bugs
is research hiring I don't know
I don't know what research is research
is off getting food we're always hiring
good people
we're always hiring good people that's
right if you have evidence of
exceptional ability that's kind of
always the policy is desperate for
people no research needs yes we're fully
on site no remote jobs that's not a job
you can pretend to work somewhere else
you can work remotely for Comma just
make a pull request on our GitHub
will there ever be eat no we don't have
any full remote and no there will not be
East Coast offices we have one office in
San Diego it's beautiful uh calibration
challenge
yeah bro West Coast for Life bro what do
you want
security rolls what's this what's a
security role
uh we have in front yeah yeah you want
to work on infra absolutely
um
criminal trying to copycom AI there's
some clones you can buy not have common
threes of comma twos they're kind of
mediocre
but they're cheap so it's up to you
no we can't drop the price of connect we
lose money on connect what price do you
want connect to be
it cost us 26 each we only get 24 from
you
we lose money I can't lower the price I
gotta raise it
a deep a deep suggests that it should be
44 yesterday
well I can't tweet because I'm on
YouTube
the food's good
the blog is live go to blog.com read the
blog post
uh question from the audience
no I'm not going
uh
uh maybe you know everything's always
possible
um
well the smart small Storage Commerce 3
performed better in the bigger storage
option yeah it's the same driving it's
just about how much storage you got
um can I make navigation free no
navigation is part of prime you have to
buy it it costs us money I have to pay
for the map box API you don't understand
like you think these things are free for
me I have to pay for them
and then I gotta pay for the Azure for
you guys it's already too cheap it's too
cheap to be honest we just lowered the
price of the comma three you know
don't make me regret it by the way if
you guys all don't buy comment threes
I'm gonna regret it and then I'm gonna
get fired and then they're gonna put the
price back up
oh I'm missing out on great dab Talent
by alienating remote work if you want to
work remotely you really don't take your
job seriously
um
yo yo welcome
do you want to say you want to say hi to
the live streams
[Laughter]
look who we got in our booth he's Tim
Keller good to see you
we just we just cut the price yay 19
14.99 yay
um
we're not at the scale yet we've talked
about it we've talked about it uh
maybe
um
maybe in uh no no we don't know security
is everyone's job uh
when will the AE Model come back the 80
models on the taco Branch you can use it
wait Harold's here do you want to
complain about experimental mode to him
I'm called into the manager's office
Jim has a Tesla
what's wrong with experimental mode
[Music]
it seems like everyone's happy with it
hey can you show a video of stop and go
traffic using comma three yeah you can
do that we
drives too slow oh the height was a big
thing that was discussed oh yeah
Anatolia is complaining that he's got a
palisade yeah yeah I'm working on that
yeah we're working on that we're
building the data set with tall cars
hopefully in a couple weeks there's a
mall already with that yeah
uh drove into a lake
that's what someone said bro if you
drove into a lake the amount of little
attention you were paying
I did see that episode of The Office
though
um what's a sequel developer no we don't
we're not hiring any prompt Engineers
either that's not a real job
what do you mean
to write what
wrote this video
[Music]
how shit is the code in my d
what did you tell that did you give it
the problem
yes you were you were you were you were
a multi-usamo winner who has spent many
hours grinding at least code
yeah if you really want a knee look the
knee is scary no the knee is
legitimately scary you don't want to
knee it's scary
it shouldn't cost it you really should
not Cross Lane lines if it's Crossing
Lane lines post the video it really
shouldn't happen
uh open pilot and snow you shouldn't be
using it in snow really like if it's
heavy snow if it's like snow on the side
of the road it should be fine Apple
care-like warranty extension yeah
is it is it coma care time
it's so reliable do people like the
parts store I like the parts store can
we tell them the daily rate number yeah
it's like two percent guys it's
incredible they don't break they don't
break they're not count twos
um
yeah but no I mean then we absolutely
should offer comic care and just get
free money from worry warts
right
we gotta deal with it you guys
I don't know
it's still easier than dealing with
apartment hackers
experimental and two-lane freeway will
drive about 10 miles an hour slower in
the right lane than the left
sense but is that not what humans would
do yeah
what
that's somewhat by Design I guess why
did comma twos break because it was a
cheap Chinese cell phone and a 3D
printed case
that was 25
as well I was trying really hard to make
sure they didn't oh yeah no like we
tried too like it's not like we were
like oh we want them to break I swear to
you
yeah we down clock them it cost me half
a million dollars because those things
broke like out of pocket I'm out half a
million dollars all right so you know
I never want to hear that offensive shit
that I wanted him to break I really
didn't but on the common three we tried
really hard
um we're gonna focus on experimental
mode now that the Taco Bell video is
done so if you're not happy with how
it's driving if it's uncomfortable post
it and it's slowly Gonna Get Better The
High cars is the first thing that we
know how to fix that that's on the on
the schedule oh yeah we got to fix our
high cars
yeah well we're including them in the
data set oh all right that's good yeah
do you think if you had better marketing
brand Direction design look we're
interested in design I'm a marketing
intern as a meme we don't actually
believe in marketing guys
we want to make nice stuff nice is good
design is engineering Elon actually said
exactly those words design is
engineering
yeah yeah yeah seasons tweetings
you need to get eyes on the product no
no no we need to make a product that's
at a good price point that provides
value such that it'll go viral and
that's all you need
this is marketing no this is shit
talking
there's no visual language I think
there's a visual language
um
is there a fully self-driving plan what
do you mean by fully self-driving
for comma by an aptera nah
I don't know
I'm not I'm not that interested
uh I mean it depends like things that I
like and this is just me like I like
cars with good uh nice and quiet
Interiors good ride quality I used to
ride a motorcycle younger Me Maybe
younger me would like to have Tara
um comma nfts you guys think we're going
to start skimming you just saw an exit
cam we're gonna exit cam
any new lawn control breakthroughs come
in Subaru or other yeah I mean I think
yeah but it's not nothing's a
breakthrough but wait do we have
experimental mountains
there's a PR for it okay
I mean yeah
is it is it responsive
it's a weird FBI I think we can yeah I
think the Subarus I mean now that the
promise Subarus they don't have Radars
but now that we can do experimental mode
on cars without Radars I think we're
going to see a lot better stop wanna see
the video shop and go at lights
yeah we're coming out this has been the
demo drive for everyone
oh yeah that's a good point if you want
to see it from the perspective of the
device we can make one public also just
watch the taco video like the taco video
is experimental mode with like a hundred
line change that you can read it's all
open source so that guy on Twitter who
was like you guys didn't open source it
yeah we did it's in a branch bro
uh we'll Taco Branch navigate work on
cars other than ev6 I think so yeah we
didn't have on Op with the crow
yesterday morning I was doing it uh
it'll work it won't do the blinkers the
blinkers are ev6 exclusive
uh all Canada
radar support our support is very good
if you depends what you want right if
you're looking for somebody to hold your
hand through the product our support is
not good if you're looking for like the
hardware broke and I need a replacement
our support is very good
um so yeah again if you're if you want
like emotional support no emotional
support if you want actual like dude
like my device won't turn on anymore and
I treated it really well we will have a
new device out to you really fast car
specifically
um
if car is not moving as distraction if
car's not moving it won't progress past
a green alert uh the new DM is
the new DM is better the new DM you
should not be using your phone while
you're driving
uh so the new DM is more strict in
certain ways and less strict in other
ways right but false positives are
always bad
DM but again DM is not meant to always
catch you DM is meant to remind you that
you need to pay attention at all times
any plans for Mercedes no they're Flex
rate cars
support your support thank you thank you
in some ways our support is very good
depending on what you're looking for
here what is Taco Branch gonna hit the
Vault I mean you can just go in the
branch switcher and click taco
uh add auxiliary cameras you don't need
that you think you need that you don't
uh can mads be in alternative mode only
on Forks
uh does Tesla gdm now too apparently the
new model my friends bought a new model
3 and apparently they don't have IR
cameras
uh common did not have driver modding
before every car company super Cruise
had it before us
uh no you will not be getting a refund
come on guys come on is that really you
want you want your 500 from me no
no you will not don't send in an email
being like well I bought it and then the
price went down oh come on
um how many active users does open pilot
have like 5 000 dailies
but we're ready for growth we want to
get that up to 10 000 by the end of the
year
what do I drive uh Sonata
uh thank you thank you
um
nfts I will sue you
are we hiring for mobile front-end Dev
[Music]
scale you probably won't get hired here
but if that's what you kind of want to
focus on yeah there's a lot of stuff to
improve connect
um your average cost will go down
exactly if you bought one buy another
one your average cost will go down love
that
um
zero nine two you know like a month
is Jonah and one out I think zero nine
one's out I don't want your royalties no
nfts of me
um what's up with the lawsuit lost it's
over lost it's over no money plus it was
dropped I don't really want to talk
about it anymore not because I can't
just because like you leave me alone
I'll leave you alone I'm a nice guy you
fuck with me I'll fuck with you like
that's just how it works
uh
uh yeah we want to get we'll get to 10K
a day this year we're at about 5k
dailies I want to get to 10K
I think we're gonna stream for six more
minutes and then I gotta go home and do
a demo
uh high-res radar and vision we don't
need any higher as radar give us an
update on common body common robotics
has some good stuff planned this year
um but we've been focused on the patent
troll is over
uh it's over I don't really want to talk
about it it didn't cost us anything I
promise you I didn't give him a dollar
um
I did not give him a dollar I think I'd
give him a dollar you think I'd talk all
that shit and then be like oh here take
my money no way
but like I said look you don't mess with
me I don't mess with you you mess with
me I mess with you that's just how it
works
um Sonata doesn't stop at the red light
yeah uh you can enable experimental
model Sonata right what
on a non-release branch yeah a
non-release branch versus Sonata am I
wearing Sony on purpose no they're just
the sponsors of CES man
um is the settlement with a 10 million
races uh we bought a whole production
line in-house check out the blog post go
to blog.com.ai city streets work in
experimental mode
um common body is going to be common
body will explode in popularity in three
or four years once it can cook and clean
for you
uh no I'm gonna turn in the marketing
department but we don't do marketing so
I don't really do anything
um well the navman limp would be in the
future versions you can see in the taco
Branch already we're putting in like a
it's a feature vector uh from the uh
from the from the navigation UI
uh I don't know which car is better
they're both probably pretty good
uh if your car's running master will be
included in model training yes
um
I don't know about the Pacifica
uh no we're done with the patent show
guys that's in the past that's in the
past
if you don't mess with me I don't mess
with you you mess with me I'm messing
with you all right
um
all right we're wrapping it up great any
last words you want to say to them
because we got we gotta get home
I'm sorry I gotta get home where yeah
all right all right we got we got we got
YouTubers future plans there's always
future plans for Connect
hypothetically
um do I have anything else for them no
Jim and I were just chatting about how
many scams there are out there and I
just want to push the message that work
on something that's meaningful create
real value in the world Life's Too Short
collecting business cards and shaking
hands is not a job okay try it okay
that's right neither is remote work
all right remote work is okay for call
centers assistance
um I think there's a go and this isn't
actually true like look if you are truly
incredible of course we make exceptions
but most people who are like could I
work remotely no
no I think those people
remote against your will yeah I don't
like remote work I went and lived you
know how much I hate San Francisco and I
went and lived there for Twitter I think
you also need to tell people something
important about how comma Works your
company is a design like how we
communicate and we're just not well
suited for remote work
um the way we work we don't have a jira
we don't Alex Alex is a lot nicer than
me we don't have a monday.com you know
we don't have anything it's hyundai.com
product management using website called
monday.com
you know it's a product management
software they didn't want to use it if I
had to go to monday.com that reminds me
of someone's got a case of the Mondays
if I if I worked at a job and I had to
go to monday.com
so anyway the point is
we are hiring
um Romo work is not bad
you know we do have a secret robe Works
remotely
if you worked at the company for two
years in person and then you want to
talk about remote fine we'll think about
it yeah
I work remote and I use I'll use the
teams yeah we don't have teams we don't
have anything if you've worked at comma
for years and then you want to go remote
because of some lifestyle things can
Harold Harold do people want to ask you
a few questions
do they want to know all right I have a
Herald here
shoot
I just I just saw it says old man
that's you the old man yeah you want
Toyota Corolla navigation open pilot
yeah okay well I want that too
what do you mean stop signs work have
you tried it
how far are we free from training
specifically on disengagement override
oh that's a good question I don't know
we're still pretty far away from that we
keep talking about it
when is pedestrian detecting uh
uh I mean it detects pedestrians
sometimes
more videos about training it's fun to
see uh I mean did you see the uh actual
development speed blog post I gave some
insight into how our training stack
Works maybe we'll do some more technical
blog posts like that if people like it
Lexus Toyota I mean we're working on nav
it somewhat works there's just a few
things quirks to work out you got to
make sure the map looks good to the
model and the model's never confused and
if you're being rerouted that it you
know detects that and says like oh
rerouting Gotta Wait with navino pilot
but I mean there are branches and they
they do kind of work I think it's pretty
close to shipping and experimental mode
I said like three months oh yeah that's
hopefully before then but that sounds
conservative you know I'm saying six
months stop sign struggling four lane
roads yeah because it's kind of like not
right next to you stop signs is hard if
the stop sign's not next to you but
it'll get better
messages are coming in comma three can
run comma three can definitely run Doom
comma three doesn't matter
what to expect on 1.0
basically the Taco Bell Drive but then
like shipped and really highable 10
hours between the states on 1.0
yeah
why is VW not supported more wait it's
super awesome it's supported isn't it
yeah
new DM models performance versus older
models I don't know is that a question
wait when is it fair mode coming to
Pacifica is it not on every car uh
uh I'm not sure is it on the Pacifica
what's up
then I don't know it's in a branch
improvements are increasing the model
size no
never
does it work in European driving laws
yes oh I heard about the new European
Fork oh yeah
you put we'll use classifier free
guidance style training I don't know
what that means it's more technical blog
post okay
I like technical blog posts
drastic stuff
I don't know if that's what it is I mean
we've tried some of that stuff it's
interesting maybe we'll work more in the
future
so we are using an auto encoder to talk
about that really makes it hard yeah
that's true yeah we really want to ship
that but requires some simulation
improvements
after Taco is launched what's next
feature-wise nothing
no that's actually it for peaches what
else do you want besides typing in a
destination in your car driving there
without a disengagement yeah
yeah the railroad tracks have seen to be
confused
George hot's voice directions
well we are going to ship we are going
to ship uh you can your destination
should be enterable by voice where
you're going for now yeah
come on Belgium exists by the way it's
just rubber yeah we pay for an office so
yeah
we'll have brown eyes
first of all George has green eyes okay
nice
robo's actually three people
Lane change initialization I think in
the future we'll just have to train the
model to look at the scene and the map
and determine whether a lane change is
necessary and then propose one
I think that's what's up
more blog more okay we can do more of
everything guys
what do you want what do you want less
of yeah yeah that's a good question
uh what are you using the auto encoder
for so the auto encoder is to ensure
that the embedding space we use to train
the models in the simulator contains uh
most information that would be relevant
for driving so like stop signs and stop
lights we want to be sure that's in the
embedding space and the auto encoder
basically enforces everything to be in
the embedding space can a human drive
from a reconstruction of the embedding
space
not yet but soon probably
Sentry mode I don't know we can't do
Sentry mode videos and blog posts
entry mode videos
we need to stream the videos take
snapshot is a terrible feature yeah it
needs to instantly come up with a video
not maybe send you a picture 12 seconds
later I mean we do have a connect
engineer now so yeah
what's wrong with you along send
feedback we'll fix it we're hiring if
you want to come work here and build
Sentry mode why are the side view
cameras no
specific Road placement no
you're not on the
link oh we missed a lot and it flip off
that drive yeah that's why we went back
before
what cream should you use for dry skin
just lotion probably no no no fig one
best skin care no it's life-changing
actually check it out figuon.com you get
a putty scraper just scrape the dry skin
off no I was blowing my nose and it
saved my device learning is very far
away what do we have on devices where's
okay sure I owned on device deep
learning is very far away we've got
shallower what is deep
thank you
instructions it's getting better during
constructions especially the auto
encoder stuff will help
can you upload Drive footage to YouTube
easily
what are the clips explored as I never
used that
so
my body jump how did it even work oh the
knee oh I guess you gotta put a lot of
weight up top Denise very scary it is
scary
experimental mode to Hondas I think
there's also a branch for that
curious about all these cars
let's get a tss2 Toyota we're gonna
leave sex with me it's so good now
power manufacturers look they haven't
locked us out don't worry
what time is it I don't know it's time
to go
two oh yeah
thank you thanks for watching our video
see you guys
uh thank you for watching the video
this is an experiment
the new price is 14.99 uh tell your
friends uh we need sales uh if we don't
get sales the price goes back up but if
we get sales the price stays low for you
all right thank you all for watching
live from CES 2023 it's comma AIS booth
uh does anyone want to give their
opinion on the bald euv
yeah i don't like dv6's door handles
this is so this is welcome to kama's
electric car fleet as you can see
all the cars and at comma are electric i
don't even know whose camry that is over
there and that's our oh it's a hybrid
and that's definitely not our rav4 nope
nope just okay every blue car comma has
is electric
uh well i can't see it every blue car in
this shot is electric
we care about the environment guys
uh no look i spent 40 grand on this
thing so
please i need at least like
[Music]
40 people to buy comma threes for their
bult
um and if you do that i'll keep buying
cars otherwise i won't
um yeah we need we need 40 people to buy
uh we'll get 40 volt users
yeah i mean if we have one percent of
the chevy volts by the way if you're
gonna buy a bolt uh maki next year we're
done buying cars this year the only car
we'll buy this year is a toyota security
car if you vote
no ford
only chevy
this this continues look it has it has
two kinds of plugs
oh yes it came with a charger the ev6 by
the way
wait what
oh that bump is part of it
oh yeah alex doesn't like this
it's so weird
nick's upstairs building a harness
i said maki next year but then no fords
yeah and maki next year maybe i don't
know i'm not excited about it
this is this is
kama's whole fleet of electric cars we
have here a kia ev6 yeah blue's cruise
is so terrible
uh oh by the way
if you're about what
yeah yeah oh is it
yeah okay the install here is just a
camera just like the normal
cars um
yeah yeah was the install terrible on
the ford we rented two or is that fun
oh that one's camera installed all right
cool yeah once like a mainstream ford
has camera installed what we'll chew
forward but
what's in the back there does it come
with a tire
wait it doesn't come with a tire
wait really did we get stiff to tire
almost all cars have gone without dies
what do they come with instead they're
just run flats yeah they're rolling
flats and i probably have like a small
compressor somewhere
no they don't come with tires anymore
yeah
do do any evs come with spare tires i
don't know this is what some guys saying
rubber is not eco-friendly
um yeah i mean these wheels don't look
bad actually look at the wheel that
looks pretty good yeah
yeah
oh i got stuff on my hand
i regret that
wait a rivier guys a ribbian comes with
a spare tire if i spend like 130 000 on
a rivium
does the rivian come with a charger
because the ev6 does not the bulk comes
with the charger let's see if it's any
good
i can't believe that
i know
all right
looks okay
all right any questions about our
commitment to electric vehicles
this is a greener more green comma
where we commit to electric vehicles
like this bolt euv
this cost me forty thousand dollars
that's how serious i am about a
commitment i even paid some stupid deal
or up charge
and by me i mean alex did it all
make climate change chill
bro no no we're here to save you from
the climate crisis
if you buy a common three in a bolt um
oh yes no no real talk though don't buy
the super cruise one
okay so this car
gm had this problem and it had it in the
vault too called the ascm ascm stands
for ass shitty control module and the
supercruise ones have two of them
uh the volt has one of them the bolt euv
premier edition has zero ascms
uh which means that you don't have to
deal with anything in the back of the
car when you install it all you have to
do is uh
is uh you know just up here it's really
easy to install just like all the other
camera only cars
we're going to make the port good
that's it
that's it does anyone have anything
to ask about the bolt
do we have any bolt users watching your
bolts about to get good shane promised
me it's going to be good
oh it's going to get out to end long oh
yeah
no we think that antenna long is going
to be a lot better on the evs because
they can like accelerate and decelerate
quickly
did we break any clips yet
is glued
can you buy the bolt off me no no no
we're going to keep it we're we're
committed to electric vehicles
we take climate change very seriously
we we care about causes
did it break
great it's easy all right cool that was
easy
15k for fsd is a scam i don't know fsd
looks pretty cool
how many guys did it take to install a
combo everyone's just excited about the
new car
uh no really it takes like it takes like
30 minutes
if you're new to it
um we can do it fast so we don't have
any bolt harnesses in stock nick's
upstairs building one
um i think that's it just a quick stream
uh
this is our bolt euv
if you're buying a bolt you want to buy
the bolt euv premier you do not want to
buy the supercruise edition we
absolutely will wait 48 hours for the
mount to cure
is it 22
yeah
oh really so not all the premiers have
it
i don't know maybe there's just an
addition isn't it okay okay
um yeah we put it in the it's in the
compatibility flow don't buy the super
cruise one it probably won't ever be
supported
uh sorry super cruise
like you know what it's gonna be a joke
on the bolt forms in a year
everyone's going to be saying yo
uh
i can't believe you bought shitty super
cruise when i'm driving around with my
open pilot and it's way better what's
wrong with super cruise it's just like
look super cruise was good in 2017.
you can watch my videos from back in the
day it's all archived i loved my
cadillac with super cruise but open
pilot today is just leaps and bounds
better super cruise has not gotten
better openpilot has ota updated so many
times it's so good now compared to
really every other system except maybe
for autopilot
fsd is better at the high end features
but everyone's even saying it and when
we ship end to end long it's going to be
hands down about to the best
um
yeah
1.0 when
uh
we're hoping for 0.9 by the end of the
year
when zero point nine coming
on zero eight points two years now yeah
zero zero eight zero eight was a long
series that's how long it took us to get
lane list to be good enough that we ship
it by default
uh and zero nine is going to be the end
to end long and 1.0 is going to be 100
end to end it's not going to use a radar
it's going to have navigate on open
pilot 1.0 is going to have everything 09
might even get some beta navigate an
open pilot we've started to work on it
oh by the way by the way also go and
come a pencil we need 150 more dcam
images you can see the improvement from
50 to 100 but we need 250 and then we
can give you guys lane change without uh
needing
if you have a car with a blind spot
monitor and you have a comma three uh
you won't need to
you can do zero comp lane changes
uh on a fish level pilot i know some
forks already have this
you know again you're not checking your
blind spot we can actually make it check
the blind spot with a combination of a
blind spot monitor and uh the comma
three
and that should be enough
to do a full self drawing
how many sales of common body i don't
know i saw like 60 of them or something
uh pretty good
all right that was 10 minutes
thanks guys
bolt get your bolt it's going to be
pretty good if you're thinking about an
electric car consider a bolt euv we do
support nissans they're a little bit
annoying to install
um we're gonna we have a ford now we're
gonna upstream but yeah nissan ford
mazda are all i hear the mazda port's
pretty good but um yeah if you want to
buy a car buy one that we have we should
include maybe what our full list of cars
is and how much we like them i think
that actually be cool for the website
and we'll do that
all right cool
thanks guys
we're live on instagram
[Applause]
some instagram lives aren't like my
instagram lives we post wherever you
want they're not copyrighted
that's right
so welcome to the common body
uh i can drive it from my cell phone
look at that
so for all the um python haters out
there the control loops running in
python
and look at how stable it is all right
so that's not instability that's just
because it doesn't have a objective to
stay still
yeah it's very stable
yeah this is too different look at that
yeah
you can
all right is it well
that was bad driving
are we ready to bring it outside
leave a heart if you wanted to go
outside
how many people we got
uh 65 already instagram live works yeah
now if we go to this is the common body
we're going to lose wifi connection
we're going to have to chase after it
okay
yeah don't think we wrote any uh
timeouts on the on the sockets we don't
check if they're valid
yeah why don't we just uh
device oh yeah good point you want to
set up a wheel
let's just do this conveniently from the
open pilot ui here i'm just going to go
in here to network
advanced and i'm going to enable
tethering
all right hopefully this works
now
let me go on my phone here
wait i don't see any wheels
it's like a hoverboard with like a
battery
what are these things supposed to be
called
when i tethered to them
does that say its name
does tethering even work indeed
i thought tethering didn't work at all
usually i tethered from my phone and
then connect from the
or from the device oh i don't have it on
my phone
why doesn't tamarind work
but it's still on chassis it's still
enchanted yeah
the tethering toggle just does nothing
great okay well that's quality
oh let's go outside anyway
all right very careful
you guys can watch a comma three break
yes
it should be okay we have wi-fi outside
the building a bit
won't go far
what happens on a hill
oh my god
untested oh no
okay
oh my goodness
what the heck
it works
it's alive
it works better than i thought it would
yeah this is very stable comma three
it's all running locally on the device
it's written in python you know python's
a very real-time programming language
yeah
you know can commentaries ride
hoverboards the answer is yes
wow all right should we do a speed test
it goes pretty fast too
can it get back into the
the building yeah yeah i don't know
about that i'd be too steep
all right let's go
oh my god it went back in
someone said let it loose on the road
not yet but yeah i mean it can run open
pilot yeah we'll just put open pilot
engagement let it go
yeah
coming soon
yeah um so you're gonna be able to buy
this uh in the in the shop uh next year
uh the comma three is not included but
you can use those already for your car
uh the common body will be for sale for
5.99 uh we'll have less duct tape and
less wires promised
yeah
this is the first one this is the first
this is calm body v0
i will also have a squatter stance so
you know to be able to make it through
more narrow areas
yeah
great
it will have eyes
these kind of look like eyes but yeah i
don't have eyes no you don't have eyes
there yeah
yeah it should be for the camera
well no the eyes are mostly like okay so
for example you know this thing will sit
in your house and it'll stand there
because that's what it does it's there
and if you want it to record you can
open its eyes and if you want it to not
record it close its eyes
that's a beautiful old edge screen
yeah then it's watching a little bit
cool
which how much money
a lot
whoa
that was pretty good
the safety limits didn't uh
[Laughter]
it's in body control
wow we just pushed it before we took it
outside just in case you know because if
if the comma dies you don't want the
code to die with it
yeah welcome to common hack we're gonna
have a real presentation tomorrow
a lot of people working on a lot of cool
things
yeah
uh
i don't know what else what else he says
welcome to first instagram live unlike
george hudson's instagram lives these
ones are not copyrighted you can do
whatever you want with them
because it's all corporate chill
propaganda it's like someone trying to
say they got a copy right on an app
don't do that
do that copy wrong please copy my ad
show my ad
put my ad on the news
call body on the news
all right well that was it short one but
see y'all on youtube live tomorrow for
the presentations
bye everyone
okay connecting is this gonna work
i think we're live welcome 
to the common body launch
uh i don't know if we can see comments on here but 
can someone check if the youtube's actually live  
you all have phones uh oh no it's upside down 
is that okay that is not okay we're live okay um  
i should have thought about this before i made 
it this way it had to be this way no no no
um hang on let me think quickly 
of how to that's upside down uh
can we get a allen key to 
flip this to the other side
so we can't turn the stream around we're gonna 
turn cameraman has his phone mounted on that side  
so we're gonna mount cameraman's phone on this 
side so you guys can see the body launch filmed  
by a comma body uh mike and billy are over 
here in the audience um hi mike hi billy
uh yeah we're flipping it around
he doesn't like the weights buzz over here oh buzz
oh yeah yeah cameraman's a little a little wobbly  
all right um have you ever been on a 
boat before it's like that that's uh
i tested it with the weight on the other side
there we go
oh yes no cameraman no stay okay 
you're being filmed by a common body  
this is experimental technology uh you'll 
learn oh well okay okay chill ashwagandha
um
people are going to complain about how sick they 
are from watching this video stabilization because
did you bring your shirt for your body uh i 
have a flight jacket but that was too heavy
oh buzz lost his flight jacket yeah all right 
how much is youtube complaining about the rocking
not much i'm getting sick
come on cameraman you know  
normal people would lose their job for this 
someone ask what the body's pronouns are um
look at how stable vehicle researcher is oh 
cameraman you can learn it's cause he's wearing a
mask it's on you great
all right you have a good framing 
of the shot yeah you we do actually  
cameraman i think you should 
close the door though what time
post it on twitter
okay you know what do we have some blocks 
no i asked for this today i want to jack up  
my body for development yeah yeah we could 
put them on some we put them on some blocks
we got it's oh it's rocking back and forth pretty 
bad oh that's fake no we got we got we got like  
a cinder block or something no that won't fit 
what do you mean i mean you have the legs and  
then you have the uh yeah yeah but i'll put a 
cinder block vertically the bodies balance very  
stably when they're not holding weight like 
vehicle researcher my phone's heavy though
i got it stable but i can't rotate it now 
you change your mind i think this is the  
perfect size oh wait is this a rtx 30 90 bucks 
perfect for playing minecraft in 10 000 fps
oh let's zoom out here
um okay so i had to download 
some app to do the youtube  
because the real youtube app didn't work ah all 
right it's stable now we just gotta frame the shot
all right wait i'll go ahead everyone on discord
is
business
do we have a mirror so 
everybody can see camera man
is buzz causing trouble yeah he's 
definitely going to start a fight let's
cameraman's very stable
well yeah but that's a later problem
uh who's in charge of youtube comments what 
the what are you doing i'm gonna turn them  
okay very carefully no no don't turn the 
phone you have to turn the rope if you  
turn the phone it will go unstable again 
okay come here cameraman i know i know  
a normal person will be fired from your job but 
you don't get paid much so we keep you around
okay okay no stay
you had one job to do and it was stand still
okay
okay oh look he's stable now 
we put him on some blocks
okay cool uh check out how the shots framed
uh i'm sorry if you uh pull a long 
distance to come here for this
all right is the shot good yeah it sounds 
great on youtube what what's youtube saying  
i want to know where the other bodies 
are i agree you should get some bodies
let's go um you wanna judge me do i connect to 
mike and oh you guys you got something to do  
we want the connector mike to drive around 
i tried connecting to billy this morning
you didn't miss anything why don't 
you just get in here i missed nothing  
can i see the stream cameraman was 
trained on forty thousand hours
do people there ever actually work
how do you think all the bodies this is a 
different one right you can control mike
where are you on channel 
all right oh you were raped
i think it's worth it
oh
six minutes
oh don't knock into camera he looks great 
vehicle researcher is very stable turn around  
um so all the code doing the 
balancing is running in python
cameraman is the only employed body here
oh it's nearby can we move it into a new office 
so we'll actually have like you know space  
twenty thousand square feet yeah oh my god 
hopefully you know you guys see our data
well so we got two more of these r730 racks 
coming in and then we got another data center  
of garage which is one year it's all 
going to get re-reacted to these guys
buzz do not knock it to 
cameraman you're very close
all right we got four minute countdown all right  
we have 288 people i think we just started 
we have 288 people in youtube yeah oh okay if  
everyone's here i think we can smart is the shock 
frame dweller these bodies too much of the way  
no they're great i really think it'd be nice if 
it buzz got it all right okay am i gonna get bus  
back in there oh well do not knock on camera 
all right it's a little bit more aggressive
so this is probably one of 
the most recorded events  
because well the bodies are all cameras 
they're all they're all watching
so what you see here are homo bodies and they 
may not look like much right now but they are  
the future of people i want to remind everybody 
that one of the people uh didn't look like the  
future people you know if you think about 
if you look at the earth 40 000 years ago
you saw the ferocity of lions the the 
magnitude of elephants or the speed of cheetahs  
and you wonder how the little squishy things 
would come to inherit the earth but here we  
are 40 000 years later nobody questions uh 
humanity's complete and utter dominance over  
the animals when's the last time you've 
seen a bear on the way to the coffee shop  
so the silicon people are coming and you know it's 
not gonna take 40 000 years it's probably going to  
take maybe about 40 and in 40 years nobody 
will question the dominance of the silicon
and the reason humanity came to 
dominate the earth is our brains  
and these silicon grains are about to go way 
past human brains uh one of these is maybe about
maybe equivalent to a human if you're really 
real good software and then if you've got a  
machine with eight of these and a rack 
or 40 of these as well okay so uh yeah
now of course uh you know if you talk about 
all the eyebrow singularity philosophical  
stuff let's focus on the very concrete bodies 
are very concrete one of the slogans we have  
in common ai is real a self-driving car is not 
cock this is a weird uh thing that's like been  
put into people's head by images of google pod 
cars and stuff uh here's a here's a rolls royce  
and a guy and the self-driving car is again not 
the car it's the guy right you self-driving you  
see most of the letters in self-driving 
car are actually the guy and not the car  
so we need to stop i mean like you can look at 
these things special purpose uh robots this is a  
vacuum and this is a mocker the vacuum and the mop 
have exactly the same brain they're doing exactly  
the same thing just one of them has a vacuum 
attachment one of them has a top attachment  
then you know you have to buy the same 
thing again when you go buy your robotic  
lawnmower it's basically the exact same 
thing it drives a path you use a slam  
and all that and then you know you can go even 
further with the special purpose robots and then  
like this is why did anyone build this right again 
a self-driving car is not a car uh just as these  
robots are not lawnmowers bumps and bags the thing 
that you want is one robot that is vaguely human  
plus well you know a vacuum um you can buy 
on amazon uh um that you can buy on amazon a  
lawnmower you find amazon and a car you can buy on 
amazon uh so yeah you you want you want to not do  
the special stuff you want to just have one human 
issue a lot all these things so when you look at  
the comma three you can see comma three is atop 
the five bodies here the comma three is a head  
it has two eyes two ears ah they're not 
active yet but it does every country has two  
uh it has a mouth maybe you've heard it talk uh 
it beeps right now but it's capable of you know  
producing uh it has a very good vocal tract 
that's capable of producing all human sounds  
it has a nose maybe you've seen it 
brief when it gets hot it breathes
out uh it is brain snapdragon 
845. maybe on par with a b brain
but you can see these things maybe 
have the intelligence of bees  
and then it has a spinal cord you can look at 
the spinal cord running you see my spinal cord  
right here uh so this has a spinal cord that 
connects to your car as well uh working off his  
power so i guess the blood vessels built into 
that this kind of works well for the frame
in order to drive all the cars people 
think oh what are you going to do  
about toyota security how are you ever 
going to support my 1968 ford pinto well
stop thinking about it in terms of a special 
purpose machine that connects to a car and  
talks over some fancy electrical 
interface and start thinking about  
it as a machine that gets into the driver's 
seat and presses the pedals in this journey  
that's the real api for cars and this api 
has been standardized for a hundred years  
so how do we build something that interfaces 
with that api and the cool thing is it also  
interfaces with the api room and the api 
of the mock and the api the lawnmower  
of the api of pots and pans and your stove and all 
these things so what you really want to build is  
it doesn't have to be humanoid but it 
has to be humanish so in order to drive  
all the cars clean your houses cook your 
food et cetera the comet re-needs a body  
and this is the common body here's the common 
three here's the body and here's the human person
this is what it looks like on top this 
is what it looks like on the bottom  
and you can buy it right now 
at commonwealthbody.com for 99.
so go out there and apply and we have 
a little batting pool going on in the  
office about how many bodies where we're going
this is what the footage looks like from the body 
this is from the office you can connect your body  
remotely this is from our europe office so 
these things are fancy 360 degree cameras
we've already shipped uh about 20 bodies out 
uh for body epoch here's a user youtube video
uh well the body needs some 
some space to get up to speed  
we'll talk about a generic way to address 
that up in a little bit um so yeah we've  
already shipped out the body epoch problem 
uh program you know f stands for experimental  
prototype partner up tomorrow we ship out some 
comma threes uh in the epot program as well
watch that again uh on and off with the 
bodies look like clothes this is what  
bodies look like naked it's very compact ships 
to you only domestic not international uh but  
it folds up nicely and fits in a box it comes 
to nice assembly instructions on the internet  
this is what the internals look like so this is a 
hoverboard motherboard with a custom board on top  
of it we also replace the microcontroller on the 
hoverboard motherboard with a stm 413. the exact  
same microcontroller that's in the common tube 
common grade white panda the right hand black  
panda so it runs panda software and it's talking 
directly to the mos hex which this means there's  
zero lag on these motor controllers right you 
have full control the software is all open source  
uh that directly drives the motors um maybe uh 
you go you want to bring a wheel out yeah um
you know when you think about
what these what these these wheels uh audience 
things are and why this stuff kind of wasn't  
possible maybe 10 or 20 years ago i go 
back to maybe i remember in high school  
2005 trying to buy a brushless boat and you could 
buy brushless cars they were hundreds of dollars  
uh relatively low power and require 
these very specialized motor controllers  
in the last 15 years mosfets have become like 
10x more efficient you can get mosfets that are  
the size of my pinky that can switch kilowatt 
power uh so you were going to bring a wheel  
out i'll just show you how far these things 
have come these are they're hoverboardings  
but they're uh they're sensored brushless motors 
meaning they have three phases for the windings  
and then they also have polish effect sensors 
you can get instant starting torque and this  
is all connected to the v413 microcontroller uh 
your current sensors on two of the phases and  
then a general turn sensor on the whole thing 
this is what's on the hoverboard motherboard
um yeah these are these are lovely single
when you just look at this and that this was this 
kind of motor would have been so extensive uh  
15 years ago negotiate magnets brushless and 
you can get the controllers are cheap also
okay
we have to start
we didn't we thought about buying one of 
those mesh suits dressing somebody off  
having to come out here and dance but that's 
just ridiculous that's enough science nation  
uh this isn't the common way of 
doing things comedy is really
so how do you start right what 
is what is kind of the minimum  
set of stuff required to start interacting 
with the human world in an intelligent way
and the answer is first let's start our 
about with a with a way to move around  
okay yeah you can build legs but why are 
you spending time on that that's not what  
the heart problem is um robotics is 99 the 
software pro if you had magical ideal software  
on the body again like i like to think of software 
written by god if you had software written by god  
on body this thing could already do so many 
different jobs right it could do all kinds of  
qa and inspection it could do security 
unfortunately software is really really hard
so right now what does the 
body do well the body balances  
but it has the same logging stuff as what's 
in overpilot so we're going to start gathering  
data from the bodies and we're going to 
start training models that are capable of  
the first task that we want to focus on is 
localization is being able to localize well  
in the environment we have more than enough 
cameras and i use in order to do this
and then thinking about the we're going to move 
the camera closer move the camera closer yes um
thinking about the general-purpose 
robotics problem the same way we  
think about the self-driving car 
problem which is don't hand code it  
what does it mean to build well ai systems that 
don't you know that interact with the real world  
but don't have very specific like oh we're going 
to detect a mop and we're going to detect we're  
going to use an a-star algorithm to plan how our 
hand will wrap around that well you can't do this  
you have to you know think about well what does 
end to end for the bodybuilder this is not an  
easy problem and i don't have an answer to it 
um i feel like maybe about three years ago we  
had the full solution for self-driving cars uh i 
still think we do it's complete we just have to  
fix all the bugs and fixing you know saying just 
fixing all the bugs is really really really hard  
but at least from a conceptual perspective we 
have self-driving cars solved and the question  
is what's the next thing conceptually 
um so self-driving cars are a lot easier  
than uh safe cooking because when you 
drive a car all good drivers are good  
in almost the identical way they'll take 
almost the same actions given the scene
for cooking this isn't true you can take a 
huge variety of actions to make an omelette  
think about it does it really matter if you put 
the pan on the left burner or the right burner  
or does it matter if you crack the eggs outside 
the pan or inside the pan so i'm grabbing shells  
right it's a much more uh a lot like the 
the loss function is much less maybe convex  
than the loss function for driving where all of 
the okay does it matter if you're in the left lane  
or the right lane no but that's a problem that 
we can talk about very explicitly and you can't  
really talk explicitly about the equipment problem 
for cooking robotics is 99 a software problem  
openpilot is the best robotics platform in 
the world and i'll justify the statement  
you can look at ross um a lot of people in in the 
robotics world are using ross ross has a custom  
serialization format uh ross has a antiquated 
socket interface ross2 was moving to zmq we've  
already moved past zmq so zmq is this uh maybe 
somebody familiar with the library we've written  
our own thing called message queue and the big 
advantage to message queue is you don't have to  
make a copy so you can pass it's a like publish 
subscribe interface where you don't have to  
send the packets through the kernel you can just 
allocate some shared memory that shared between  
the processes and this isn't academic stuff 
i'm sure many of you here today many of you  
watching at home have open pilot on your cars 
this stuff is tested for over a million hours  
uh it works at scale it's it's just much more 
developed than any of the stuff i've seen from  
robotics maybe cars are one of the only examples 
of working robots in people's lives today like you  
can look at a roommate it's a joke i got rid of my 
robot after it destroyed my second macbook charger
so how do we take all of the good stuff in open 
pilot and apply it to more generic problems
with the magic of software anything is possible
we don't just want to watch the world and now 
the bodies just sit there and and watch the world  
body adam gets
the knee is coming in late 2022. so we started 
thinking about arms but one of the problem with  
arms is if we put an arm up here well how useful 
is that right you got to be able to pick up the  
vacuum so you need a knee you need to be able 
to bend down the knee also includes a hammer  
arms are coming in 2023 and the price point 
that we're targeting for all this stuff  
is on the order of thousands of dollars so 
when you look all robotics in the past has  
fallen into basically one or two categories 
there's toys generally which fall in the  
realm of hundreds of dollars you have like lego 
mindstorms uh you have a lot of these sort of  
toy robot kits i bought a little six degree free 
tomorrow on amazon for like 200 bucks but they're  
useless right or you have things in the tens of 
thousands of dollars uh you can think about like  
baxter from the defunct grief think robotics or 
you think about spot dynamics is now shipping  
spots for 75 grand right that's well outside the 
budget of most people but something that's on  
the order of thousands of dollars it's not a toy 
it's legitimately well built you can look at these  
things you'll have an opportunity to look at these 
things much more close like a solid aluminum base  
uh 80 20 which is easy to attach things to this is 
being filmed on a slightly unstable body right now  
um it's it's professional grade robotics for a 
price point that's 10x less than uh everybody else  
pretty much doing this um at this at this sort 
of level so we're going to build arms we're going  
to build arms that are capable of lifting serious 
weight uh that are capable of you know they don't  
have backlash they're very precise encoders on 
them they're not like hobby servo motors uh look  
the other philosophy also is minimal actuators i 
believe when tesla launched their bot they talked  
about 40 actuators it's not quite shit right well 
it's not going to shift for any reasonable price  
over here this is a body with a knee and 
you can see that there's two actuators one  
for the knee and one for the hip this allows 
pitch control and height control of the camera
uh these are the gearboxes that 
we're going to be using again  
it's the same wheel unable to play video error 5.
well i have something better
using the same wheel this wheel 
has nine foot-pounds of torque  
10 to 1 gear ratio 90 foot 
pounds of torque look um
if you don't believe us can we 
bring uh if we bring kenny out here  
there's one body you haven't met yet so you've 
met cameraman uh you've met fawz you met mike  
you've got a vehicle researcher you've met billy 
over here they're doing millions very stable
um
it's just like a normal thing oh yes  
this is kenny um kenny's a little 
bit taller uh than the other bodies
these are those gear boxes i was talking 
about ten to one cycloidal drives  
zero backlash uh we're going to put a very precise 
uh magnetic encoder on them uh and then we're not  
doing this in some tiny microcontroller so this 
is this is a good height i like this i feel like  
me and kenny were like similar um this isn't being 
done this doesn't have some tiny microcontroller  
which a lot of these sort of toy robotics do 
it also doesn't have a fancy computer which is  
going to break which is going to cause problems 
like you know you look at the boss dynamics thing  
it's like a chorus 7 it's like a full computer 
it loses all the beauty of the reliability of  
embedded systems why do you think phones took 
over from pcs um it wasn't just their size  
so it's the comma 3 which runs ubuntu 2004 it's 
open pilot and it's so easy for us to do things  
like use mpc use the same mpc we use for cars to 
control these actuators uh to place you know uh  
kenny in in different uh positions part of the 
reason these things are unstable is there's not  
that much weight and the commentary is not that 
heavy there's not that much weight in the in  
the top part of the uh the body so balancing like 
that's actually pretty hard but with these sticks  
it's going to be completely stable because we 
know the exact position of these things we compute  
exactly where the center of gravity the thing is 
um so yeah kenny's gonna be able to uh sit down
um
uh you'll be able to lay down stand up completely 
uh from from from completely laying down and this  
provides a really good platform when we attach 
the arms up here to be able to crouch down  
pick things up so you can be able to use bots 
and this is shipping at the end of the year and  
it's an add-on kit for your body so if you buy a 
body today uh we'll sell the knee add-on kit you  
just replace the bar with this bar attach it it's 
all on a can bus again something that separates  
the hobbyist robotics from the professional 
robotics it's canvas this thing is basically a car  
it shows up to open pilot just like a 
car as a fingerprint just like a car
so yeah sorry kenny's not on um see on 
version of kenny probably in a couple weeks
come with us on this journey body 
support is already a master on autopilot  
this is not a separate repo it required very few 
changes to autopilot to make these things work  
um the localizer that's running on the bodies 
to keep it stable is the exact same localizer  
that runs on the car um it's even using the pose 
net that was only trained on vehicle data and  
that's one of the reasons for the rocking back and 
forth but as soon as we start getting data from  
the bodies out in the field we're going to put 
that training data into the vehicle models as well  
and i think that it's not just going to improve  
the body but it's also going to improve 
driving because you have this problem  
in uh in the data that we get and the data that 
we get if you're expecting a rotation to the right  
you're also expecting the road to be curved right 
the action taken by the car is correlated to the  
environment it's extremely correlated to the point 
that even though this isn't actually true or the  
inverse of this is whatever you try to train a 
simulator from driving data what you end up with  
is a simulator that when you tell the 
car to steer right the road curve's right  
that's how it works right humans no that's right 
the steering wheel controls the curve of the road
obviously um and there's nothing in the data to 
really show that that's wrong because there's no  
points in our data except for some really really 
extreme ones uh which are more rare than data bugs  
where the human sees a right turn and turns left 
and like say smashes into the wall right you as  
a human have no problem visualizing this everyone 
imagine a light right banking curve on a highway  
and taking the wheel and going like this you 
all have no trouble imagining what will happen  
but you don't you can't imagine this because 
you've ever been in a car that did this you've  
never been in a car that did this you've never 
been in a car that was on a lightly right bank  
turn on the highway and somebody turned the 
wheel left and smashed into a dividing wall  
but you can imagine no problem because you 
have a generic model for how uh physics looks  
for how um uh what's the word how 
like projective geometry works  
how you expect the scene to change 
based on how you move through space  
you got this because you didn't drive for the 
first 16 years of your life for the first 16  
years your life you were in environments that 
look a lot more like places the body will be in  
and by jointly training the models on driving data 
and body data we can teach the car the same things  
we still have to hand code so the big thing the 
way that we made laneless work and the way that  
we're gonna make end and longitudinal work is by 
using a hand code of simulator but the simulator  
is not hand coded in the sense that we call the 
behavior of other objects the thing that we're  
coding are these rules of projected geometry 
uh so hopefully with the body they can learn us
things not to buy so these are our competitors 
um this is a segway lumo this is an amazon astro  
and i'll tell you what's wrong with both of these 
things they are small and deserve no respect
would you respect something that was two feet tall 
two feet tall is about the height of kenny's knee
do you respect this thing  
but seriously like imagine you like broke 
into a building and this thing showed up  
and these 90-foot-pound motors started moving
we're building robots people respect not 
robots that what do you do what do you do  
when you see an amazon astronaut imagine you 
broke into a place that was an amazon astro  
what's your first instinct exactly you're 
going to kick it you want to kick kenny
you can try kenny might kick you back uh so you 
know it might be the biggest when you search for  
a security robot you get this company nightscope 
robotics nightscape robotics is again one of  
these companies that's in this 10x overprice 
they're charging 70 grand a year for their robot  
we already have all the stuff for security right 
you've seen common connect we're going to roll out  
sentry mode to the cars um so why not also do 
the same thing for the robot we have all this  
this logging infrastructure uh you know security 
robots for like five grand that set it up and  
this is gonna deter people a whole lot more than 
uh you know a camera that they might not even see
sit down kenny come on
uh i just like here here this is for her
that's like to scale
so buy your body today commonbody.com  
9.99 uh ships in one to three months first 
in first out and that is the common body
all right who's got questions hey kenny what 
you want to share you want to share your seats
um
as someone who is not really familiar with machine 
learning and stuff i would be wondering like  
how many people would they really need 
to buy this and provide enough footage  
to have an impact on a model or trading forward 
well not that many but probably something like uh
20 hours of footage will be playing
um even if we're the only ones with them when 
we're using them around the office of course  
don't know like a small amount of data that 
just completely breaks the correlation of  
when i see something that looks like this 
this happens to start to learn the actual  
physics of the world instead of just uh 
also you know on a car you can't explore  
so if you think about i if you think about 
in in reinforcement learning you have this um  
explore versus exploit right uh maybe this is 
also referred to as a temperature parameter  
uh where sometimes you take an action that 
isn't the optimal action for a scenario  
just kind of see what will happen do it sometimes 
randomly well you can't really do this on a car  
uh but on the body you can it's it's a much 
as a development environment it's a much uh  
lower stakes a place to try out changes to open 
pilot as as open pilot gets better and better  
on the cars it becomes harder and harder to just 
like mess with something whereas on the body you  
know the it's still developing on the body is fun 
all the low-hanging fruit is still there you want  
to make that guy not rock back and forth spend 20 
minutes tweaking the pid loop and it'll probably  
you know spend a little bit of time 
learning like he rocks back and forth  
because he has a he has a uh he has a hoodie on 
uh billy's wearing a nice lightweight t-shirt  
uh okay learn the parameter for 
the for the way that you think
all right that's the learner on there like you 
can do that you can play with this and it's  
it's fun unlike you know trying to do that 
car so does it balance right now based on uh  
machine learning um so the lowest the localize 
is based on machine learning so it's the local  
it's the same localizer that's running in the car 
it's using the gyro it's a common filter but the  
pose net is is all machine learning the postnet is 
trained on vehicle data so once we start adding a  
few body segments uh that'll all just will just 
work um doing controls with machine learning
like the state of the art maybe the 
state of the art is boston dynamics  
none of boston dynamics controls has 
anything to do with machine learning  
you can watch videos about how boston always does 
controls they use machine learning for vision and  
for some other stuff but the basic control loops 
are this state space linear model transition thing
so yeah i mean classical controls are just you 
don't want a lot of parameters in your control  
system because you don't want it's not high 
dimensional space right like like vision's a  
very high dimensional space so you know you can 
you can learn a lot easier than trying to learn  
something that's well it's you know your 
your output is is four dimensions and your  
input space is not that big either say the input 
space of the whole camera it's not really the one  
how many dimensions do you really want to reduce 
to first uh so yeah the classical stuff still does  
better than machine learning stuff but this will 
start to change and then the other thing about the  
what you can do on the body that you could never 
do on the car is you can do reinforcement learning  
on the body if you want to do on policy 
reinforcement learning like again it's a  
low stakes uh space so go get your download your 
open ai gym cart call solver you know car pull  
it up with an ai gym it looks like this and run 
another body and maybe it'll work go try it i will
so i'm not that fluent with machine learning but 
what i'm understanding is that if self-driving is  
like what would a human do in this situation and 
you got the answer because you got all the data  
from the camera as well but in this situation i 
don't really see the answer so i guess you just  
said reinforcement learning but i think like it's 
a very different dimension it's a lot harder yeah  
so the well i mean the answer could be the same 
right so you can see you can say the same thing  
right like say i want to you know i want i want uh 
you know kenny here to learn to make omelets well  
the human has a policy for making almost and kenny 
should learn the same policy now you're right it  
feels different from driving the driving policy 
seems a lot easier to talk about and i think it's  
due to the uh like linear linearity i didn't mean 
convexity before linearity of the space right like  
when i mean the space is linear i mean it's like 
well if you're driving here if you're driving like  
20 centimeters off it's almost the same thing if 
you're putting the egg 20 centimeters off that's  
a very different thing right the loss function is 
so much less like you know whether you put the egg  
on the right side of the pan or the left side 
of the pan doesn't matter but you put the egg  
just a little bit over the pan and no now your 
stove's a mess and you know kenny gets fired
uh so yeah i mean what is the loss function 
there well what's your loss function  
because human function good 
way so like machine learning is
i'm saying that like the the loss functions right 
now that we use for driving in our driving model  
um is basically a uh i don't know if there's 
the gaussian and laplacian but it doesn't  
really matter it's it's some it's some shape that 
looks like this right it's a very convex shape  
um whereas the uh lost landscape for things 
like cooking uh don't look like this and  
that's that's the the difference now this one's 
function by the way isn't perfect for driving  
um we can express some amount of stuff 
in the like we have we have a mean and a  
standard deviation you can look at our models 
but uh it's not perfect to express like well  
okay but that's a cone you really don't want 
to hit that you can go on either side of it  
kind of i mean actually it's not just i mean 
the standard deviation it's it's multimodal  
as well so there's five modes but yeah you 
want a more complex loss function than this  
like what i'm understanding it's actually 
very different from boston dynamics because  
that banks have like certain goals you basically 
like their ai inside you still hardcode everything  
but here you're saying like you learn by 
yourself learn certain qualities yeah i  
mean boston dynamics is largely remote controlled 
right like the spots largely remote controlled but  
they're still using on top of the remote control 
a lot of sophisticated control stuff so it looks  
good so the bodies are remote control as well but 
the remote control doesn't remotely control the  
torque on each wheel you'll never be able to drive 
it right but take a remote control for a drone  
imagine a remote control for a 
drone that has four throttles  
good luck flying that drone right but you have all 
this dynamic stabilization stuff running on the  
drone and gotten very very good to the point that 
you can give it a high level command of you know  
move your position here or rotate uh so we kind 
of want to get to the same point with this stuff  
so we have i've been driving down the latency 
streamer up from this thing it's about 200  
milliseconds right now uh to stream that back to 
a computer the joystick control is instantaneous  
uh not as case but like sub 10 milliseconds 
um so i want to drive that down to 100  
and then i want to write map for a vr headset 
put the vr headset on and you can drive it and  
this is going to be i think a nice way to drive 
the arms as well you'll be able to use the oculus  
controllers you know where you place the oculus 
controllers where you place the arm uh you know  
you want a knee like this going to pitch like 
this right and we can put things like the goal  
pitch angle the goal height um the goal center of 
gravity the goal speed into a solver the center  
of gravity acceleration but we could put that 
into like a like a mpc solver and it'll output  
actual low-level commands to the motor 
we might even have like the way we have  
it on the cars right now is we have mpc which 
takes the model stuff and turns it into a plan  
um trajectory so the model outputs a plan one of 
the things about a plan is the plan doesn't have  
to start at the center of the car i can start over 
here of course you can never actually do that so  
the model predictive control turns this is the 
car against this into this computer kind of uh  
recovery trajectory and then there's even lower 
level stuff like we have a pid controller and one  
of the steering loops in there also the actual 
like controller car with torque uh you want to  
command it to an angle because pid looked 
for that npc was the angle yeah i was just  
very attracted by the ideal like the end goal and 
then i didn't know how it would go there but you  
know explain quite good like get the controls 
first yeah like it's unclear if these controls  
are necessarily bad right like you might want 
your machine learning to not have to deal with  
the lowest level torques maybe you eventually 
do but that's not where the low hanging fruit is  
for this stuff the thing that you really want 
to avoid doing that we're never going to do  
is like you never want a cone guy because what's 
a cone that's a really hard question what does  
it mean to control something to an angle that's a 
very clear question now you might not be able to  
do it your noise model might not be perfect 
pid for example can't deal with things like  
latency but you know it's it's a you can still 
talk about it in very physics-based ways where  
there's no physics definition for the comments we 
got any questions from youtube we do what we got
how do you go about collecting data about learning 
human cost functions for things like cooking well  
so we think about what the actual intermediary 
goals of the body are uh this thing is not going  
to be making you an album anytime soon do not buy 
it with the expectation i do not want to hear and  
support oh you know i didn't make an omelette 
i put it behind the skull and pulled it today  
um so yeah uh how do you collect that data well 
here's one idea we have so like i said i want to  
write a vr app uh and you guys can do it this 
is all open source um you know we'll do all  
open source that streams uh the consortium of this 
thing back to the headset and let you control the  
arms so one way we can train it is can you make 
an omelette in telepresence can you use the body  
use the arms using the full human brain and 
our controls good enough to kind of smooth over  
this is still a really really hard 
problem and a really valuable problem  
building a telepresence robot that's capable of 
making an omelette under human control allows us  
to outsource the job of your chef to bangladesh 
right but think about it if we could build a good  
just a good telepresence robot we've enabled 
this labor arbitrage for a whole set of jobs  
where it never previously existed wow that sounds 
like a trillion dollars oh that sounds boring  
i'm part of the common discord 
some people had some questions so  
you you kind of compare this to the uh 
like enterprise robots as opposed to like
um so i considerably it is steeply priced you 
know to some that is understandable are you going  
to be warranting like that board components 
because i think some people heard that once  
you guys put out four components in it why is 
it so expensive and it's kind of risky if you  
don't like the price don't buy it like that's all 
of that yeah um another thing from the discord  
somebody asked will it be able to go upstairs 
uh well look at it again again software is magic  
um could could kenny make it upstairs 
well if you put enough weight here
how am i doing that do people what  
well i'm not using my think about it it's how 
can i jump right cause i have weight here do this
so yes uh canyon can jump how 
will this impact open pilot  
is this two products now is this taking 
priority is it a separate department  
um so it's the same problem right 
is it really different from driving  
all the things that are specific to driving are 
things that you probably shouldn't be putting  
that much time into anyway uh there's a i think 
who wrote it uh richard sutton the reinforcement  
learning guy wrote like a hard lesson of ai what 
sudden sun yeah um once you read this uh basically
the
uh
the more time you spend thinking about how to 
hand code something the more time you're wasting  
like it's going to be replaced by machine learning 
it's a question of when so the body forces us to  
think about what things were hand coding on 
the car and if they don't work for the body  
we have to ask why so what is our our company goal 
our company goal is to solve self-driving cars  
because if you can't solve self-driving cars you 
definitely can't make an online uh it's way hard
so is this going to uh we changing the company 
goals we're giving up on openpilot oh no  
it's the same problem
i think that just like the model with both data 
with with both body data and driving data will  
end up learning something that's better at both 
the body and driving i think that open pilot  
will end up being better at driving because of 
the body and we would have done in other words
i'm just reading the questions they want 
to know does the body have to watch me cook  
to cook so does it have to watch you cook 
i mean that's that's even harder right so  
one of the really nice things about driving as a 
problem is the car is a digitized system already  
the car that you drive is the 
same car that open pilot drives  
if the body watches you cook it's not then 
controlling you it's controlling itself  
so being able to like learn using 
mirror neurons the way humans do is  
really really hard and we haven't even 
started to consider how to do any of that yet  
um is the body going to be able to watch you cook 
to learn to cook uh ask me to get in five years
don't expect any of that if you're buying a body 
expect something that stands up oh by the way  
the other thing about the knee which 
you'll get right away when you get a knee  
is right now the body has a top speed of 
three miles an hour um largely because it  
has to lean over too far and accelerating 
is really hard when all you have is this  
uh this is not how a human accelerates on a 
hoverboard a human accelerates on a hoverboard  
by uh shifting the weight 
forward and that's what kenny did
uh balancing is about six hours 
uh driving around the joystick
uh it can the batteries are really nice they 
have like a built-in bms you can like stick more  
batteries on if you buy more of the batteries 
and you hook four of them up i think it would  
just work um you know eventually maybe sell the 
call of the stomach just fill it with batteries  
uh but you do the math you do the math on 2000 
calories and how many watt hours 2 000 calories is  
i forget what it is exactly but it's like 
within the realm of feasible it's like  
within the realm of feasible that you can fit a 
day's worth of human power in in in batteries um  
you know once you have the arm it will be 
able to plug its own charger you know you  
don't want to make a charger dock well you need 
a charger dock right humans don't have this  
i have a feeding tube put the 
food in your mouth right right
magic is softer is there a specific 
task we'll focus on first uh balancing
if you're expecting the body to do things 
it's not for you um if you're expecting a  
high quality robotics development kit that's 
fun to develop with the body might be for you
but a specific task i mean like all of the tasks 
that are really all use a good business where it's  
synergistic with the driving problem uh we'll 
focus on the body like sentry mode for example  
right like sentry mode is both useful in cars and 
useful on bodies imagine this thing stands there  
sends you a text message to someone 
uh you know comes into your house  
should i try to make my own body you can
what ability are you most looking 
forward to the bot body having uh
oh man i'm not like if i was elon i 
promise you that it would like you know  
it's going to vacuum your floors by the end of the 
year but you know that's like i'm not you on so  
are you saying it's too far out 
to even like think about that
it's not what it's too far out to think about 
it's that i couldn't give you any timeline on it  
it's hard enough to make timelines of when we're 
going to ship 0-8-14 we're really bad at timelines  
everyone is everyone is you're the only everyone's 
bad at timelines the only question is how honest  
you are with yourself about this right some people 
are very dishonest and managed to continually do  
this right it is amazing like people will say 
that they'll have something done in in in two  
days and they don't have it done in two days and 
they'll tell you in two days by the way there's  
going to be two more days and they do not and 
you're like okay can we like like eventually  
you'd think that something about the human would 
uh you know correct this this broken loop but the  
reason you don't is because like there's two ways 
to estimate timelines one way to estimate timeline  
is to think about each task you're like okay well 
if i want to make something that um vacuums okay  
well first we're gonna have to be able to pick up 
a vacuum okay well maybe that's like a you know  
maybe that's a two month project okay and then 
we're gonna have to be able to like move around  
it's maybe a little harder maybe that's like a 
three month project so we'll be able to vacuum  
in five months but this is an absolutely terrible 
way to think about this um a much better way to  
think about it is how long have projects like this 
taken in the past and it's taken us maybe five  
years to learn to drive cars as well as we have so 
five years to learn to pack them though like again  
maybe it's a similar order of magnitude 
problem which maybe it's very hard
have you guys tried like small like small projects 
internally and see how like maybe like avoiding  
a table like but this isn't a good way to think 
about it right this is the same problem as like oh  
well you know oh my god the people who walk like 
well can you just add an adjustment to open pilots  
we can adjust the position in the lane like no no 
this is a huge waste of time right and it's the  
same thing with the thing that avoids the table 
right like yeah sure you can waste you know what  
you can write a prototype of that in a week right 
i'll download the latest yolo v7 and put it to  
something else now and put a table detector and 
all you that's that and it'll avoid tables 80  
of the time i'll make a really good video that 
doesn't show the broken 20 percent and it'll  
look impressive right but it's a stupid waste of 
time right so no this is the wrong way to think  
about it people think about driving like this too 
people like well let's start with an easy task uh  
you know like like like but you do this and if 
you're not focusing on the problem holistically  
you're not getting anywhere towards solving 
it um there's a saying about self-driving  
cars the self-driving cars are demo complete 
uh meaning you can build any arbitrary demo  
get any blind band across austin in your in 
your thing and you still are just as far away  
from solving self-driving cars as you were 
when you started um the demo air is useless  
there's a lot of good insights in 
the youtube comments what do we got  
they they say it's a it's a problem we didn't know 
we had we've uh invented an entirely new space  
and that might be why some people have a hard time 
understanding how it can be useful but oh sorry or
you know a bunch of people on reddit there's 
something that's really full of haters um think  
about this as like some like cynical uh business 
or or uh marketing move uh like look at me right  
it's possible that everything about me is a lie 
and everything about my identity is constructed  
in order to do but does that really make sense 
or think about it a lot more like you know  
we're kind of like an ai research lab i 
like to make things that actually ship  
i think a lot of people here really like 
that like using the things but it's not like  
there's no there's no and next week we're going 
to announce our partnership with with uh the city  
of beverly hills to have bodies standing on the 
corner deterring microaggressions right like no um  
you know it's just cool and it's it's it's cool 
to to think about so in terms of like if if you're  
viewing this from a very utilitarian perspective 
like kyle the body improved my life don't buy one
and i feel even the same way about the comma stuff  
like people who are buying it for that 
purpose and making it very like clear  
oh well i have to think about how many how many 
how many rational gnats of how many how many  
gnats of happiness i will gain by purchasing this 
oh my god i can't believe people think like this
it's just cool man they want to know more about 
the arm oh you learn more about the arm all right  
so what is the knee um the knee is a two degree 
of freedom uh thing we really want to keep the  
actuators to an absolute minimum but with the 
arm we're gonna need six right so you need six  
degrees of freedom because you want your end 
effector uh to be placed in any xyz position  
and in any roll pitch you want so what i'd really 
like to design is like a four degree of freedom  
shoulder that can do so you can do like the polar 
interpolation of the shoulder as well as the  
rotation of the shoulder in like a three degree 
of freedom thing and then because you want to keep  
the motors as close to the thing as possible 
right the less inertia your your arm has been  
moving uh the better it is um and then the fourth 
motor will be here and then belt into the bicep  
right so four degree of freedom assembly here as 
close uh to the to the to the non-moving part of  
the arm as possible and then you have three you 
have two more degrees of freedom to get your six
you have uh wrist and forearm rotation so you can 
use relatively small motors for that uh and then  
the hand the hand is even harder than the arm  
we were just thinking the first uh would 
have a gripper similar to the one on the  
spot if you saw the spot arm i don't exactly 
like how the spot arm does its six degrees of  
freedom because they're not the human ones uh 
the spot arm does not do uh can't do this it  
puts this rotation axis over here it's still six 
but it's not the human six i'd like the human six
they're making a lot of comments
if you can pull this off it'll be huge it's 
a long-term project make driving chill and it  
has the body will make what i don't know i came up 
with make driving chill like three years in tacoma  
we'll figure out what the fuck the body is way 
less utilitarian than the open pilot like it's  
it's it's more in the in the research direction 
it's not like don't buy it expecting it to do  
something buy it expecting it to learn things buy 
it if you buy a body and you work on it for i'm  
going to give a shout out to dean lee lee's a guy 
in china um he's one of the biggest contributors  
to open pilot and open source he started out 
where he started out and where he ended up the  
change in his programming ability over those 
two years is unbelievable so you buy this  
you legitimately try to like write 
features for this try to improve it  
you know you'll become people always asking 
people always asking how do i become better  
at programming well it's like well how do i get 
you know big arms right we got to lift weights  
man i just want the one magic trick no there's 
no one magic trick go to the gym ever again okay  
uh so it's like that is this just a meme response 
to tesla can you just admit that um well we saw  
tesla do it and tesla had this was a revolutionary 
idea we never ever thought before about building  
uh bodies but when we saw tesla do it we 
were like we put our top guys on it and  
we're like we're gonna copy that and what we 
did was we put a broomstick on a hoverboard  
no it's an obvious idea right like think about 
it people are always saying how are you going  
to deal with the fact that the car manufacturers 
are going to lock you out and i mean like sure we  
could do it with hacking or we could do it by just 
building a human right and then we consume people  
you know we gotta get we gotta get this added to 
the anti-discrimination laws don't discriminate  
based on brain biochemistry like just because 
they're silicon and metal like hey man no blur
they're asking about if the 
hardware will be open source oh  
i'll tell you why not um open source hardware 
benefits uh call makers and clone makers and only  
clone makers um we don't open source hardware 
because it benefits clown makers uh you think  
oh well okay there's going to be individuals going 
out and building this not really uh like it's it's  
hardware has so much it's not like software right 
like a software is built using a compiler and the  
compiler is also open source and you can download 
it you can have software running uh in no time  
the body has an intricate supply chain which 
involves uh so you're like oh it uses hardware  
corner parts it uses hoverboard wheels um the 
motherboard is reworked like crazy we pull off  
the knockoff microcontroller on there we put 
a real stm on there uh you know we decided  
resistors we put another circuit board on there 
it's a custom aluminum milled plate uh like it  
just due to the supply chain complexity open 
source hardware does not benefit the individual  
yeah i think we should make it clear it's 
not just a hoverboard we stuck a poll on
there's quite a bit under the hood yeah yeah 
for our late arrivals you didn't see the picture  
have you ever seen a hoverboard that has a 
solid aluminum plate on the base like that
we can any actuator for neck 
um no ask why you need it
right if you want so you can 
think about the three degrees  
of freedom for the camera you all pitch 
and roll uh pitch will be handled by the  
knee uh yaw is handled by the base 
wheels and why do you need to roll
yeah i think why aren't more people using 
shipping first hardware strategy in robotics  
shipping first hardware strategy because 
they're run by loot business losers who  
were like well we have to figure out what the 
application and the target consumer is for this  
i think it's i just i hate that mentality so 
much i think it's this mentality that you like  
you're you're managing people like you view 
people or customers it's like something to  
be managed and analyzed and bro like i 
don't know i think this is pretty cool  
to be honest would i have an open pilot thing 
in my car maybe not this rev give it a little  
more time for the software to get more mature 
maybe when 1.0 comes out it's just easy because  
like my car is something i actually rely on 
but would i buy one of these yeah probably
why don't we have more robots already you think 
because robotics because software is really  
hard and because with driving i mean the comment 
mentality is uh deliver shift for intermediaries  
and there are nice shippable intermediaries in 
self-driving uh that don't involve level five  
right open pilot can already provide a lot of 
value to people building a robot that provides any  
value at all is quite hard and we do have robotics 
you just don't call it robotics right there's a  
saying in ai it's something is called ai until it 
works then it's just called software right no one  
like there's like search algorithms oh yeah search 
algorithms that's ai today you know there's a  
right sky like oh now deep learning is kind of 
well no i mean that's not like they like but  
once they oh man oh it's like oh doing this you 
know fancy like got a consciousness or something  
right like it's the hard problem that always 
gets pushed out so robotics is the same way  
right you have a robot in your home it washes 
dishes it's called a dishwasher but you don't  
call it robotics because it works robotics 
is just cold all the things that don't work
what kind of open positions will be for 
the common body department um i mean
if there's someone out there who like knows a 
lot about mujoku uh so we're not doing any sort  
of like real classical stuff but if if you know 
the kind of control theory that's going to let you  
build good models of these actuators and build 
a good simulator uh we're interested if someone  
wants to come work on the simulation environment 
for the body uh i'm interested and you might not  
think you have the skills for this but like if 
you're like like a game developer like that sort  
of person someone's going to build a great fast 
reliable simulation environment for the body  
and test it to the real world not 
some theoretical academic model  
uh i would hire you uh but i think that would be 
it for the body positions yeah we can put some  
comma body parts in the comma part shop maybe 
yeah seems reasonable i dropped the body uh  
two days ago and broke this top piece well open 
source the top piece here so we'll source this  
mount you can print other mounts if you'd 
like to mount other things to your body  
curious why we used a hoverboard what else did we 
consider oh nothing i built the first prototype  
karma body like a year and a half ago now i went 
to best buy i bought a hoverboard went to home  
depot bought a pipe and stuck it on there and 
then like they don't balance on their own so you  
have to write software to do that but uh what else 
do we consider i mean nothing look at this wheel  
look at this wheel cheap available 250 watts the 
only reason these motors are we say 150 watts  
is because we're not running them at 36 volts 
you can run the motors at 36 volts and get 250.  
um at a board maybe not but the 
motors you can definitely do that  
like it just has so much power at such 
a low price point that they're amazing
all right i think that's kind of it from the 
youtube cool yeah we're we're almost done what's  
that eleven o'clock and we've got one last 
question mama you know anyone here for now
so you referred to sort of uh the idea of like  
interacting with things in the real world is kind 
of like a human oriented api if you're controlling  
a car as long as you're not locked 
out you're basically controlling an  
api that's been provided for you to control 
those various things so it seems very hard to  
if you think about you know making an omelette 
or doing laundry or many many other things  
each thing seems like an individual challenge 
that is quite difficult even if you have all those  
degrees of freedom so ultimately is there sort of 
an interim step where a device like a vacuum or a  
washing machine might know that it's being 
talked to but know that it's being controlled  
by such a device and make it easier for such a 
device to interact with it versus having to do  
all the human things needed to do extra work 
this is a bad way to think about it this is  
the same sort of people who are thinking like 
well wouldn't it be nice if we upgraded our  
city with smart streets for self-driving 
cars right like like this whole mentality  
it just involves like the reason that cars have 
apis to control steering has nothing to do with  
8as features and everything to do with the fact 
that electrical power steering saves you one mile  
per gallon on the road right they've repurposed 
something that already exists to provide this  
small value-add feature they did not put in um 
the adaptive cruise control like it involves  
a slight change to the braking controller but 
all the valves are still there they're the same  
valves being used for traction control they're 
the same valves being used for anti-lock brakes  
right like because these things were repurposed 
and already in the car you managed to get these  
apis but i would not try to like don't make 
the world conform to you conform to the world
cool thanks for coming out 
we got some got some food uh
yeah this is uh where where
we're trying all right and we're honest the body 
is an honest product it's not a man dancing in  
a mesh suit and the man dancing in a mesh suit 
is still leaps and bounds beyond what you know  
what does google promise in roblox they make 
some vague emotional claims about how robots  
and humans are going to coexist like this is this 
is like show me a real thing or shut up like so  
you know i really subscribe to this mentality 
and like uh we showed you a real thing you know
it'll get better over time slowly iteratively 
honestly one more question um so not too compared  
to a boston dynamics robot but if you were to 
kick one very hard would it fall over oh sure
um it's hard so you can't with just having the 
wheels down here you can't really prevent it  
but with this one uh i think this one we 
could get to withstand any human camera  
um because you can you know shift your 
weight especially if you have weight up here  
right like if you if you put you know two big arms 
here that way that way 30 pounds yeah when someone  
kicks it you know okay i got 30 pounds of weight 
stabilizing here i move my actuators quickly  
so no not that body but this 
body with the magic of software
remember also boston dynamics showed one video 
that they kept you know they didn't have like uh  
like a carnival day where they invited average 
people in off the street to kick the robot  
now that that's this this is the 
difference between a demo and reality  
um i bought a spot and i kicked 
it and it fell over please help
all right thank you all for watching youtube  
uh how many people we got about 300 people right 
now 300 people do we want to give them a bagel  
the bagels look at me oh you got to go get your 
own bagel that's what you get for being remote
look at our beautiful wall
of comma twos
yeah they're red and green just like
christmas
no showing my thumbnail was the uh
the the antenna that came with our
spectrum analyzer
yeah because it looks like a christmas
tree
oh sales are coming back up after
mega sales yo you guys want to see mega
sales
dude you guys have no idea how much
money we made for black friday
mega sales
it was it was absolutely insane
yeah 645 000 in the last 35
30 days uh so that's
that's mega sales but now we have the
hangover from mega sales
so yup yup that's that's
never going to be another sale ever on
anything again
uh these are tons of uh
of uno boards hundreds of uno boards
i've been doing advent of code i'm in
20th place right now
um what are you doing over here we're
making
fake comma twos we're gonna sell some
people fake ones
they're going to be christmas ornaments
on our tree
you're using the bad parts i hope right
[Laughter]
look at all that look at all our
retrofit these are all retrofit phones
we have so many of them we're actually
buying more phones
because sales went so well check out all
the comma 2 boxes
why are we working what else is there to
do today oh yeah no we're sending the
broken phones back to the
yeah the place where they come from
going back
china
um these are some of the failed ones
thank you look these are some other
failed ones
yeah oh look at these harnesses yo what
are these these subaru
[Music]
nick what are these harnesses are
i can't believe we got more subaru wow
i heard that we actually saw some super
when we got a red scale
oh we see you stole the scale
okay we've got yeah carcasses oh yeah
we're
building uh fake comet twos for
christmas ornaments for our tree
i'm gonna go show you guys our tree and
past
oh you we sold out by the way this was
this was all the uh
in the last 30 days we sold 581
comma twos and 32 and 30 upgrades
so like we shipped 610 in the last 30
days
got a bunch more servers over here
you know what i was working on today i
was working on why the the the prius is
laggy
so that was that was what i was working
on i added torques to the kalman filter
but they don't really work because
they're not real torques
i was looking at these graphs all day i
was trying to make a match
yeah i'll respond later typing is hard
oh yeah it's all good
oh we gotta erase the secrets from the
board
that's a secret secrets yeah no secrets
yeah secrets gone secrets no secrets
any more secrets on the board hiding all
the secrets yeah find all the secrets
that's it for secrets
why what the oven
oh we're making cookies all right
oh no no no there's still more secrets
oh we gotta write some more secret stuff
all right what don't make all the
cookies as a savage amount of cookies
yeah um
and he's cookies no you can't see any
secrets
we're erasing all the secrets
uh let me show you these things
look at zero eight it's doing better at
left turns
it's not oh it's two actually no it's
doing way better at right turns
deviation is bad
but yeah oh yeah we got a tree and
that's what we're setting up right now
now i don't know trees came in pieces
alex remember we'd go chop down a tree
we we could drive up to snow-capped
lands and chop down a tree
wow
what oh i was gonna stream today but i
got distracted by the prius crap
i was gonna work on my beautiful m1
macbook
right there
yeah uber's valuation weigh most
valuation tomorrow
we're going to run dynamics and
simulator supposedly
that's our new data center it's not a
secret
10 000 cores 512 gpus
uh this tv turns on once we ship zero
nine
it's what passed a week
oh well we're done with we're done with
the val
this is a test there was an infra issue
yeah open pilot 1.0
yeah i kept the mac yeah yeah yeah i
didn't return it
i was never going to return it
um but yeah this is comma christmas
uh guys something we're very excited
about next year
navigation if you're interested in
coming here and working on navigation
please reach out alex we gotta go
through all the applicants
we've had a lot do you want my help do
you want to have a go to the applicant's
party
all right could we cookies and go
through the applicants
you know what it's just like can i say
hi livestream hi hi guys
[Music]
hopefully some of you guys are good
who's asking
which ones tell them their names oh no i
don't know no one's asking
comma cookies no but i got towels bros
it's time for the tree let's put the
tree together
i'll stream and you put the tree
together
if you have no experience but completely
devote myself to this would you hire me
no
i'd rather you have experience and work
nine to five
did you have to assemble that or did
that come assembled are you trying to
take
you're trying to take credit for
something that was done
[Music]
yeah of course i would say i worked hard
putting the stand together always take
credit
are these are these poinsettias oh
points out is their poison
that's what i've heard okay we've got to
refactor sensor events
[Music]
i do it's look it's not that i hate
noobs it's just
like noobs aren't my people you know
yeah no it's not it's not look look look
look
the good thing about being a noob is
hopefully you're not going to be a noob
forever and if we are
guess what we hate you i don't know what
to tell you
if you have more data than you need why
do you care about selling hardware just
for revenue
yeah man we're a hardware company why
does apple care about selling more
iphones
that doesn't look stable i think it has
to do with
the um bottom is pretty stable
this these things are like movable parts
you can adjust the trigger
i see yeah who wants noobs to work for
them
i guess yeah i think people just can't
tell there's two types of people
oh that sounds like a taylor swift song
you guys know i'm a big taylor swift fan
alex jones is the real president-elect
of 2020.
that's what i read in the comments
[Music]
[Laughter]
this usually goes to europe but
yeah yeah one of uh
one of the common places bought a tesla
so yeah we're gonna we're gonna make it
work and tesla
what it needs to be fluffed more i think
do you need my help
cool oh it comes with pine cones
[Music]
it's so expensive how much much does it
seven foot
[Music]
well does trees scale volumetrically or
clearly not linearly
ah
uh you can't really experience the tree
oh this is a pretty nice tree actually
this is this is way more tree than i
expected
when i told you i was going to get a
treat uh no just when i saw the box you
know this is a pretty legit
tree wow it comes with a tag
wait the tag is great we should put
something like this on the comma too
oh we should put tags on look what it
has it's like troubleshooting
oh not full spread the branches
other issues well wow some people are
choosing
is hanging too low bend it up
not full spread the branches wait some
people are literally
who's connector section out wow people
are
morons yeah then the hang tag reminder
i think maybe put something like that
even i haven't showed you
the stop lights just our ci that
represents our ci
i made illustrations of all the harness
parts
oh nice
[Music]
do you ever see open pilot having
control over the gas and break of the
hyundai
yeah bro
you know if somebody actually knew about
safety
there are ways to do it now doing it's
easy doing it safely is hard
oh can i do that with one hand
we're making cookies we're making
holiday cookies
oh yo guys we're working on we're
working on okay they're called extra
models let me explain how extra models
work
all right so you guys know that there's
small
box in a small box
well the current model has small blocks
and then it goes through the temporal
and then it goes through the policy
so it goes small box temporary but we
want
big box so we're going to add another
model with big box
over here and we're going to be able to
run all this on the comma two thanks to
hyperthnead
been i've been working on hyperthing
we're gonna put the small box
and the big box in well okay this is
kind of a lie we're actually gonna
downscale the big box
so we're gonna go right up here we're
gonna go 0.5 x on that big box
greater than zero
uh 16 employees
yeah we are well do we count europe
do we count contractors for county
contractors we're like 25
employees
big box so it's going to make the box
bigger so the model can see more
the tree's coming together this side
looks really good
oh maybe you should read the direction
card more
i don't like bug bounty programs
no it's just it just comes in comes down
to arguments with noobs about oh i found
this bug
you should pay me money
wow this is a beautiful christmas and
we'll have a nice christmas treat for
the monday meeting
what's our big news is it a secret
employees oh the employees don't know
that yet yeah
yeah that's true we got a new employee
um
there's a ucla profit that says bug
bounties are against cali employment law
oh
there's someone who says everything's
against the law yeah
i don't know what scratch is does the
right-hand drive model do anything yet
puts the right-hand drive
bit into the model read the code bro
oh to plug the tree in uh there's one
right there next to the razer scooter
scooter
[Music]
no should we give presents to people
yeah
we'll see
oh we're going to dump all the shit in
there oh the comma bag of crap remember
the boot bag of crap
i don't know everything on the internet
like that died and the internet got
taken over by evil
so many great people you know i started
to realize that it was never the
company's problems it was just all the
noobs that showed up on the internet
the eternal september
okay how are we looking what do you guys
think guys
you like our tree
uh are angels still allowed
how about a star
oh now we're apparently putting karma
twos on the tray
yes for christmas that's what's for
christmas get a comment too for
christmas
[Music]
do you want me to help you i'll fluff
the top part of the tree
ah to plug it in okay
well i don't know if we can oh the
weather
outside is frightful but the fire is so
delightful
look at that there's plenty more wire if
you just undo the thing
look what i found
what i i'm the i used my eyes
i did the finding i did seeing
okay i don't think that's gonna undo the
knot i think you got no
no no you gotta no no
but let's should you just make sure all
right all right
all right well alex if i read the
instruction card and it said to check
loose connections did you plug the trees
into each other
um
no but do the trees plug into each other
they do
yeah there must have been connectors
because we have to check for loose
connections
oh
the comma twos work better than the tree
i promise
oh well yeah how is that one gonna work
it wasn't connected
look it's just the only way it connects
there's just two little holes no it
can't
is it really just that so i just gotta
make sure that wow that's
that's some sketchy electricity shit
oh just lift it up yeah it did okay
yeah yeah now you gotta oh you gotta
yeah you gotta lock it in
all right well rotate it's until it
lines up so you gotta rotate this you
gotta keep rotating
no no not the bottom one now lift it up
lift it up there's an alignment
indicator
see you guys see the alignment indicator
here i'm shoving my phone in there so
you all can see it
all right lift the tree up there we go
now i'll rotate it i'll guide it
all right all right all right the arrow
needs to match the arrow
there we go yeah buddy now it's gonna
stay together
even better okay so there's the arrow
yeah
check out my rings
yeah my rings all right
blind the arrows up oh wow
[Music]
i don't know any other christmas songs i
only know let it snow
and jingle bells
no i think it's good here
i was gonna put it right there well
that's a sad corner
yeah so i'm gonna stream on twitch
tomorrow guys what do you think of that
spot
no i think this is an okay spot
yeah we don't need the door though we
have to we should add a note to the door
that if you want to read your employment
things they're over there
[Music]
all right
oh oh
okay yeah i mean i'm covered in glitter
too
what's beeping the cookies
oh christmas cookies
day old sushi i don't know i've just
been listening to it and kind of like
you know it's no it's no taylor swift
song but do we burn the cookies
early oh hell yeah bro no
no no they look great yeah i got no
shoes on
no can i can i eat a cookie now oh you
have glitter on your face
ah holiday comma
they like your shoes
am i yeah the tree looks great
this is a great trees around the office
to decorate the tree
we can put a scooter on it first
whoa it's spinning no no it's good
good thing that mount was so well
assembled call back humor bros
no no
oh beautiful
it's great should we have office secret
santa
no i feel like that's just
it's kind of beautiful can we leave it
up oh actually the christmas lights up
till
january this is our house
we make the rules
what
[Applause]
uh yeah yeah the top's got to be fluffed
to there i got you
i got ya
okay it said if the things weren't good
you should pull on them
i read the instructions how's it looking
is it symmetric-looking
i'll turn the lights off in the room
[Music]
i'll put red and green cellophane in
front of our comma no i mean you know
the comma doesn't look like that that
just shows how non-hdr this iphone is
right now
oh clean your lens oh yeah good point
no i don't even think that's cleaning
the lens
the reflection the lens flare might be
but not really looks like a fire hazard
there's probably some low volt dc
lights
don't end up like tony
camera iso too high yeah i don't think
this lets me adjust that i don't know
what is this button though
oh i have like filters
on youtube there's an internal
reflection on the lens projector yeah
who is tony well he was the ceo of
zappos
what a tony reference is a casual one
i don't know
oh can we open the poinsettias
i mean you know what i meant by we
already
oh the tinsel's so beautiful i'm
searching the christmas spirit right now
i love christmas and black friday
not valentine's day valentine's day
sucks it's just designed for you to make
people miserable and get them to spend
money
okay george would you go back here and
grab
some common two boxes we'll put them
under the tree oh yeah
don't read the last page
oh hoodies or beanies beanies are
exclusive and gone
you can never get a beanie again if you
missed out on that deal
you don't get a beanie but um
if you want a hoodie yeah i think that's
still for sale you can buy one
i'm sorry boys it's hard to hold all the
stuff a bunch of common two boxes
no the beanies are no you can't get them
anymore
oh that's beautiful do we have one more
beanie for that
they're in the fulfillment room oh okay
i got you three boxes do you want more
you want 10 boxes damn how much is a box
what's the budget for this green light
we can go
all right we're gonna we're gonna we're
gonna uh
any announcements we do we'll pull the
shit out of an oven like jensen
uh alex where's the beanies
the fulfillment room i'm in the oh the
fulfillment room
oh yeah i got more boxes but i'll go to
the fulfillment room
look at all those successful comma
twos yeah jensen was baking them gpus oh
they're in the custom ink boxes
i only found more common tool boxes
yeah let's go to the fulfillment room
and see what's up
hopefully we don't have any secrets in
here
oh good wow that's a lot of comma twos
that are broken there's the broken
common twos this is a graveyard
yeah no we've sold bajillions though so
that's actually not that many
we have less than i think our defect
rates like
i think it's under five percent
all right um
all i see is hoodies
these boxes full of beanies
are they from custom ink too no they're
from a different store
oh in there
oh yeah let's go eat a cookie pcb yield
only like one percent of those fail our
testing has gotten really good though
oh yes oh cookie delicious
[Music]
we're gonna do it broken common twos we
put them in this room
we put them in this room and we deal
with that later
um i love gluten
make sure the caramel bean beanie faces
me
the comma logo oh it's so cute
look you sure you guys could have had a
beanie if you bought a comic too on
black friday
a 69 value
[Music]
um twitch tomorrow
we'll work more on tiny grad
i just started working on the prius
thing and that's what i did today
i also worked on the hyper-the-need
disassembler
the hotter price oh lost way too many
months to the hotter price
double tinsel yes what's double tinsel
is that is that all the tension we have
no no i have four times
oh hell yeah that's quadruple tinsel
like stripes or horizontal feeling
don't read the last page
that's all all i just do is think about
taylor swift songs all day
oh fake commentaries for the chat
they're really good much better than
dough
alex alex was eating dough
all right what else we got any other
questions about comma you guys are like
why don't you do live streams anymore
and like you know why because we've kind
of like
we've already well yeah we don't do like
periscopes anymore but guys
you know the real reason it's because we
already won
the world just hasn't really realized it
yet
no really though we're five years in
tacoma and not a single other vehicle
manufacturer besides tesla
has started gathering data at any sort
of scale
like and you can't just oh they're like
oh we have the cars we can turn it on
tomorrow yeah
who's building this infrastructure who
afford
is building this infrastructure
yes we're absolutely still looking for a
navigation engineer yeah no we we have
talked about when we're going to buy
ford
and the day of the the day of the ropes
going to come
don't fire half of ford i'm gonna make
ford great again
we're gonna buy ford
um wait comma two question what are the
bare minimum
car features needed for longitudinal
really radar available
oh do i have to get them or can i just
eat cookies i only have one hand
it's kind of hard
[Music]
that's a rhetorical question let's give
you another cookie boys
oh let's go get a lemon spin drift too
what do you think of a lemon spin
drift on a cookie
i mean okay we can still lose right
i shouldn't say we've won but like
there's nothing more to figure out
ah lemon spin drift
20 hertz i don't think we ever have to
go faster than that is the model
20 hertz is 50 milliseconds way faster
than human reaction time
the outer loop is 100 hertz
bring on comma logos here um
you can read what it would take to get
fca officially supported
um one of the requirements is that we
own one of the cars
so you know we own a hyundai that's
officially supported
honestly there's not that much incentive
because what does fca bring to the table
that's different
from the other manufacturers by the way
our controls on toyota are terrible
the only people we could really lose to
if the legacy automakers managed to
catch up
did alpha fall 2 release a paper or just
a press release
it it's just a press release i don't
give a shit
when do i think they'll get to
developing countries well we ship
mondays and thursdays
um i don't care what country you live in
if dhl ships there and it's not on a
trade embargo with the united states i'm
happy to ship it to you
how is ghost doing um
i mean they picked a great name
vaporware ghosts
i mean ghosts can decide they just want
to run open piles on their hardware they
probably will
what google drama
do i still think i'm one year behind
tesla i've always said one to two
what
[Music]
a million cookies
let me finish my cookie first
that's a fake comma too right here
[Music]
oh beautiful does it have a mount
uh well no it doesn't have a mouse but
what i'm gonna
scorpio is finally community supported
wait is it actually wait
what really um no like why do i care
about supporting fca
look at our company mission guys
solve self-driving cars while delivering
shippable intermediaries
guys we make 10 million in revenue next
year
all right oh this is so hard
how come we don't have robots you know i
need a robot
boxes little boxes on the hillside
i think we'll try to do zero eight one
this year yeah
you guys know about the bug with the
double yellow lines at night time
harold's been working hard on that our
training infrastructure is so much
better now
we can actually make a model in about a
week it used to take like
6. welcome
to the room we're going to be supported
what gpus are the 512 gpus uh ati
amd let's buy some amd gpus yeah
you buy the old gpus actually yes um not
replace them with 3080s
do you want to buy we have four 30 80s
and 428 etis if you want to buy them
can i actually buy a 6800 xt
and did they make any with blower fans
how much for the 38 eti
whatever the ebay prices
we paid too much for them
oh you thought i was going to sell them
at a good price
yeah that infinity cache on the uh on
the amd cards
you know but it takes up two and a half
slots
the reference edition for the uh 6800
xt
and i like density in my data centers
always progress on common pencil yeah
have you guys seen the torch model
seasonality is good
how many dius compared to last year
um i think this time last year we had
like 500
now we are
15 you know what's that what does that
say 1700
glitter in my cookie i'm sure it's
edible glitter
hmm
black friday sale was a huge success we
made about half a million dollars
what do you make 400 000
400 000
so yeah we sold yeah like 300 something
devices we sold all our inventory
we have more now oh i like the tinsel
do you need more boxes um
how much profit margin how much does it
cost us to make common tools
[Music]
way too much guys let's just say the
profit is actually
it's way too little have you seen the
huge boxes of broken phones
almost almost four threes miles we
almost got quads
rumor is comma is going to be acquired
by carlisle
well considering i don't know who
carlisle is
i mean like carlisle pennsylvania you
should go to summer camp down
oh the carlisle group you think i'd ever
get acquired by some group
what if the vcs do it behind my back oh
that's right they can't
run no
i'm working on it
it's a private equity defense fund oh
god comma will never go public no i
looked into it and there was too much
bullshit
we're making progress we're gonna do
what we're gonna do is wait for the
federal government to collapse and then
we're gonna release our shares as tokens
this is not a forward-looking statement
um no like but i'm actually serious
about that when will the sec just
collapse and we can like
actually just make our shares tokens
it'll happen
we'll give we'll give a few we'll give a
few shares to everyone who has comma
points
you think we give a few shares to
everyone who has comma points
we reserve a small amount of the token
like that uni-swap shit
get in early get rich
[Music]
would clemata want to ask a common point
should be a crypto yeah who's going to
write that
nobody
oh is zooks dead yet
if they're having a big announcement
this week yeah
they've pivoted to making you know
they're launching their car
oh they're they're launching their car
tell me more about this am i launching i
mean announcing their cars
who knows god knows what what do you
mean by
launching you know people criticized
nvidia that you couldn't buy
3080 ti's but they made at least 10 000
of those
how many cars did zooks make
um can i can i count them on one hand or
do i need
two i will find out let me announce it
oh no do we think the car companies are
watching comma
we don't just think that do you want to
[Laughter]
work
yeah they're supporting exactly the
direction of money flow
is very good
it's prophesizing the future
zuke's is for bezos's affairs
quite the convivial workplace what is
convivial i'm sorry
what is it convivial do you know that
word what does that word mean
i'm gonna go broke by 22.
wait what we're going to go spend all
our money on trees guys spend a lot of
money on trees
it's expensive to decorate why are we
not doing flex rye
are you not worried about honda and
toyota or switching to flex-ray
yeah sure i'll believe that when i see
it
and guys when we have to we'll do
flex-ray oh thank you thank you for the
definition
what i think karma will look like in 10
years you guys have seen tc right you
want to get tc out
that's an s no tc in the garage
wanna go get tc you guys hoverboards are
dangerous
no we're gonna go get tc guys there's
been a lot of talk about tc we're gonna
go get it
it's time to show you all tc
[Music]
oh you know what's dangerous i can't see
anything
[Music]
oh where's the light at i have a light
don't i
ah enable flash there we go
all right where's my tc at pc
ah let me turn the tc on
oh yeah
i'm showing off tc yeah
[Music]
all right
what
all right can i have that fake comma too
so i can show off really what tc's going
to be someone asked what com is going to
be in 10 years
someone asked where calm is going to be
in 10 years and guys i swear this
stuff's not a troll
yeah have you guys noticed how our
company makes small faces
like it's a head it's a human head
it has ears it has a mouth it has
eyes
[Music]
so we're going yeah we're gonna stick
comma twos on top of the hoverboard
that's a tc
this is a tc
[Music]
it's tc you guys
don't break our one only tc prototype
no but guys here's the future the future
is going to be commas on sticks
in 10 years when you're walking down the
street
and you see like humans cooperatively
co-existing
with tcs you guys are going to be like
holy shit
i saw the future on youtube 10 years ago
like i'm not even trolling we're going
to sell the comma arms separately
tc
i know do you guys want to buy a tc when
will we sell them
next year i think we'll sell these
things no seriously
okay so not this tc this is an early
prototype tc
but you want to get the other the other
tc out in the in the amazon box in my
office
yeah go for it i mean you know i i
only have one hand um no but the other
one
actually has an stm microcontroller that
has can
so we're going to connect the comma 2 to
the tc
another t oh the other tc the one in
there
um yeah well this tc has actually knock
off stms in it
um there's some chinese company called
gigadevice knocked off the stm
and it doesn't have a can controller
but um yeah so this
i'll keep tc company what
you don't like leaks what
you don't like my tc leaks
what what's that
what's that
oh you got letters
um no guys look
people get humanoid robotics all wrong
the truth is
if you all you need to build is a head
this thing has
motion sensors in the same way a human
does it has great it's t-i-c-i-t-c
uh no bosnia-dynamics is building
incredibly complicated mechanical and
hydraulics
shit we're sticking a pole on a
hoverboard
yo guys this is the future right now of
comma
after we solve self-driving cars which
what
what you have an n and a w you're trying
to spell now or one
or you're trying to spell win oh win
we don't have an eye
well you can spell no
nothing actually you need a vowel you
got to buy those
no they never gave me access to gbt3
yeah you want to throw away a lot of
broken common tools
what you can't find your your your eye
well the is the simplest letter
now we haven't won yet we're trying to
win but yeah so we're gonna stick these
guys on top of pcs
and then they're gonna like they're
gonna like interact with you like a
human you're gonna be able to talk to
them
they're gonna keep you company you know
when you try to rent
a one-bedroom apartment now you can't
because they're all rented out because
nobody has anybody in their life
but imagine coming home to a tc that
greets you
asks you how your day was and cares
about you
you know ai girlfriends guys it's the
future
well have you seen it i mean that this
is a v1 tc you know
not great but
whoa whoa whoa whoa whoa companionship
only
what
[Music]
what kind of europe ass shit is that
[Laughter]
wow wow where'd we get those shiny comma
stickers those look pretty nice
pretty nice all right mix it up you guys
we'll go to an hour for the live stream
we've got 10 more minutes what do you
guys want to do
doesn't look at the books
no we're going in an office wide hunt to
find the eye oh the eye
well i found a fuel on
you gotta go find the eye crew no the tc
think about the tc as a companion
that cares about you
nothing's thrown away
[Music]
my beef will open mean they're all right
i think that the way they handled gpt2
was incredibly childish
now ai safety is something to be taken
seriously not
to be used as like fear-mongering
headlines
what the i
i i like fsd beta i've watched some of
those videos
very cool um
tesla
i saw some of those videos and i think
tesla's six months
further along than i thought they were
um
i'm very impressed by fsd beta and
i can't wait till they actually ship
back to cars
karma will get fsd in one to two years
yep that sounds right
i mean next year we're going to ship red
lights to stop signs
i can say that pretty confidently and
when did tesla ship red lights and stop
signs earlier this year
so we're one year behind
two years year and a half
we'll have the fsd beta stuff we've got
to hire someone for navigation
tesla already had navigation we need
navigation the stuff's all ready
all the machine learning stuff is ready
to go as soon as we just literally
have a navigation app running in the ui
we're switching to qt you guys have seen
that we're gonna get rid of off-road
why'd we buy these
i bought them you didn't no money was
spent on these
that wasn't mine we're gonna have full
control over the car by then we're gonna
have full control over
we have full control over the civic why
do we switch to qt because react native
sucks if you know what you're doing you
can safely raise the torque limits
um
the thing about torque limits is raising
torque limits
just decreases safety so you have to be
very very careful when you're doing it
it's not technically difficult
we've had torque mods we've had torque
mods i mean you guys have seen we've
gone around the racetrack
super high speed you can do it just i
wouldn't really use that on roads yet
um but we can do we can do something
very similar to tesla now
uh with respect to like the actual
control
so don't worry about that um
the f-150 thing so the parking modes are
already very dangerous
and then if you're implementing them and
implementing them in the eon and you're
setting all hand to safety to let things
through i mean someone's going to get a
serious accident
so uh don't be careful what you run
um how is karma gonna auto lane change
why do we need to
like why do you i'm not sure you
want the car to make a lane change
without you prompting it in some way
um same thing with a turn
some of the things we can do
automatically so i think resuming at red
lights we can do automatically
um yeah parking mode on cars is super
scary uh you saw me on the leaderboard
that's right 20th place i'm gonna beat
last year i got the 21st last year
um you know some people talk shit some
people are like oh geohart doesn't know
anything
oh yeah yeah it's all he just talks shit
he's just got a big ego man
beat me at advent to code you know
you think your skills are better than my
skills let's go
i'm in 20th you beat me those 19 people
can be like
yeah george is an idiot but everybody
else
where is it
oh i didn't see it yeah it looks great
i don't know if we're gonna do advent
code i don't remember what was day two
part two
oh was it that stupid one we had to
parse those passports and it took
forever
i did it slowly
you beat me if you beat me on advent of
code yes i will personally send you a
beanie
not one day beat me at the whole thing
you're higher up on the leaderboard than
me
i'll personally send you a meaning
evidence code usually gets harder yeah
all right five more minutes for a nice
one hour long live stream
uh tesla's still using conventional code
do i think they're compute power limited
no
has a 16z been a good investor yeah
on balance sure asus whatever language
you want you actually run all this stuff
on your computer
and you just compute an answer
but this isn't common like we're not
going to talk about aoc
um are there any sweet oem sensors
you're going to integrate with no we're
cameras forever
or is forever you've seen a tc
maybe there's hidden cameras inside of
tc
i'm going to use outlook
i don't describe culture if you guys
can't figure out culture from watching
the videos you're not a good culture fan
okay um have you been approached by any
other car manufacturers looking to
license comma yes since day one
how serious are they what do you mean by
approach who do you think approaches
the car companies are not monoliths
they're many different people
if you get approached by a low-level
business development person they want to
waste your time
i think we've been approached almost
literally just like
you know people are like i'll find out
information about them and i reply to
these people i'm like
you know money or gtfo right
uh that's why it's a thousand dollars
for a meeting like
pay me or gtfo uh because they're not
serious
everyone approaches some approach with
money
um honda got rid of the radar on a new
tiny car only camera
we can do only camera oh you want to
show the t-shirts
best business advice yeah it is everyone
should do it
man who was i just talking about how i
would pay a thousand dollars to talk to
them
two shirts ooh the new hoodies are very
nice i'm wearing one right now
oh beautiful wait 50 bucks
yeah 50. oh no the they're made of 50
50.
where does tournament 30 what's 50 50.
50 cotton 50 percent
oh are we selling them for 50 bucks off
there
50 bucks oh it's shit no this should be
more than 50. it's really nice how much
you're selling these for
they haven't decided yet oh well the
prices go up division wants it to be
really high
i mean yeah they comply with part 15 of
the fcc
the shirt
35 no 50 bucks common merch is expensive
merch
if you're gonna buy a two thousand
dollar look if people are going
okay all right a week at 35 and then
they go up to 50.
but i mean you know you know how much
tcs are gonna cost shit tons man
shit on i hope you guys got two grand
saved for the tc
and if you want a top model tc 2500
that's right
be nice to my tc
twenty five hundred dollar tcs 500 for
the poll just the poll
okay
what is the common food price going up
after we ship red lights and stop signs
i think when we ship bread like to the
stop signs where is the price 200.
all right i think when we ship red
lights and stop signs we're going to
raise the price 200
on comma twos i think that's reasonable
yeah
just like elon bros
how long until red lights and stop signs
next year
a room but it was easy
do you still need more boxes
on the tree i'm a no corner
technician it's not real but the san
francisco access is real no one lives
there anymore
i love my pink m1
[Laughter]
[Music]
no you have to buy the comma arms if you
want tc to do the rings
i don't know how much the common arm is
going to cost yet
taylor it's small and my taylor swift
obsession's been real lately
i forgot i made my computer after her
well when does comic go publix you can
gamble stock options
as soon as the sec allows it and there's
no more regulations and the federal
government collapses
we're going to ic up
no the sec allows it with regulations
i'm waiting for them to go away
bye bye scc bye bye
it costs like five mil to go public yeah
what a waste of that money
you're paying people you hate like
lawyers and bankers you know i'm gonna
pay some engineers we're gonna build a
sick ass
platform hopefully someone else is gonna
build it open source we'll just use it
stand up an instance of stock market
coin
we'll we'll deploy the contract stock
market coin i'm sure someone's already
written it
and someone will pay you to go stacks or
scams spacks are just the new ico oh
luminar did us back
oh yeah that's a valuable company
who's losing money in the specs i mean i
guess it was hard to figure out who was
losing money in the crypto boom until
everyone lost a ton of money
um spacks are such a scam
i'm gonna spack with my hot dog company
i don't know who chamoth is but no
luminar
guys yeah if you're in the lidar boat
dump
lidar hollowing lidar is like hodling
bit connect
how's your uh lidar on your iphone 12
wait now how's your light on your iphone
12. yeah
that's right
release date for 1.0 i don't know
i will stay stop signs and red lights
are gonna happen next year we know how
to do it
we just gotta convince i know who's
gonna do it too we gotta we gotta get
him in back in this office and working
on it
um
that lighter gets cheaper all the time
what else gets cheaper all the time
bitconnect
bitconnect
what are one or two steps you'd take to
surround yourself with successful people
i i think you might have to take a
couple you might have to take a couple
more
steps than that like first you got to
find successful people
and then you got to take the steps and
go surround yourself with them you know
what i mean
you have to physically walk to them to
those successful people yeah
yeah yeah where's taylor swift
more speedometers
oh fuck scooter brawn man i heard he was
mean to taylor
does it have screws wow what's that from
the 80s
look what is the spring you think it's
still around
cantus well it's nissan this is a 1994
nissan
whoa we don't support that shit it's an
ultimate look how sick this one is
looks disgusting it's gorgeous those
traces
can you know a trace like that on
today's stuff
can carry like 100 amps this is a nissan
look this is a
buzzer sport buzzer
i don't know what nissan this is from
looks like it's begging to break
in japan made in japan oh taylor swift
tc oh yo
there were these life-sized cardboard
cutouts of taylor swift
at walgreens and i asked the walgreens
if i could have one and they said no and
then i looked on ebay and they were like
and apparently like a lot of people
asked and they were a big deal what the
cardboard taylor swifts
oh if you're as big of a taylor swift
fan as me
that's right all right
i think i think that's today's stream
there's almost seven billion people on
the planet
all right all right let's end with the
tree
[Music]
are you planning to make a comma for
planes i don't have a plane
i don't know what sun valley is kind of
coming to get the coronavirus
uh i don't know where i'd shove the long
swab to test it
common for boats now that's a bit more
likely
yeah small planes are sketchy oh i am a
certified sailor now
no i didn't open it yet but i can rent
boats now
i found a coffee shop i can go to no
mask that's where i've been going
whoa whoa whoa comma does not endorse
political candidates especially not
shitty ones
um knew some more trump
i would endorse you want comma to
endorse a political candidate
we're going to ask them about bayes rule
we're going to ask them about the
complexity of matrix multiplication i'm
going to ask them for a couple
derivatives
they answer those questions right comma
will endorse them that's that's we
believe we believe in an evidence-based
approach and if any
presidential candidate or political
candidate period beats me at advent of
code they have my full support
[Laughter]
that's right
jump behind
he's got a broken foot he's got some
time
what if they promise to ditch the sec no
not enough that's going to happen anyway
they're not going to ditch the sec see
guys you're thinking about it the wrong
way you're asking government for
permission
the sec is just going to fall apart
crypto is coming for these people
whether they like it or not
where's the international horse and
buggy regulation organizations
they're gone
[Music]
um
yeah they'll be there and everyone will
ignore them that's right we'll give them
a nice cushy payday
[Music]
show them what the hoodie that they can
buy right now
you guys look how good it is we gotta go
get first we're going we're going back
to the office
we gotta get sorry guys for the shaky
cam
calm a horse thanks i'm taking them to
come get the rest of the
guys hopefully there's no secrets
hiding back here in the back corner of
my office
are all these old speedometers that i
got off cars at the junkyard
we got a lot
we're gonna put them under the tree this
one this one's amazing
okay sorry you guys are coming with me
the printer it's a secret yeah i'm
taking them to get the rest of the
dominary thingies oh okay
will you take the phone or carry things
no i can't carry things but i can take
the phone
where's the delorean's pedometer you're
making a wall and lighting them up
alex is putting him on our christmas
tree
secrets exposed
uh you guys already saw tc i don't know
what other secrets there are
i just showed it to you i couldn't
resist
only if you have prime oh that's sick
yeah buy
prime
it's it's gonna be turn around george
it's the comma hoodie you go you come
closer you're too far
it's the back turn around we're gonna we
are working on prime
and then no we need to hire full stack
engineer otherwise nothing's gonna get
done on prime
secret hidden from lex oh there's
nothing hidden from wax
pesos um
we're doing the the back of the hoodie
is gonna be on the front it's gonna be
orange and it's prime only
prime only can i have one no do you do
you pay for prime or i don't pay for it
i have the uh the script that says give
common employee free prime
we're not removing the https
https on the hoodie
it has the url for openpilot on github
you can see our i put all the comma
employees on the tree
the are you complaining that the tc's
ugly
what this is prototype you see why we
haven't shipped tc yet
the two thousand dollar tc is gonna look
sick you guys ever seen a corn on the
cob it's gonna look nothing like that
all right george i think we should get
dinner i'm hungry all right hey i ate
too many cookies
put the tc on the tree thank you all for
watching
thank you for supporting comma uh tell
your smartest friend
uh come work here
uh here's a quick pitch we ingest
more video data than youtube
um we have we're training
neural networks on par with the largest
neural networks ever trained
uh and
we're going to turn a box that fits
on your windshield into magic
you know if you took an iphone and you
showed it to some
some some tribal people they'd be like
that shit's magic and we're gonna do it
again
but for modern people some of you guys
with open pilot how many people see it
as magic how many people believed
that you could buy a small box put it on
your windshield
no drive a car believe
it's gonna get even better it's going to
be unreal
yeah waymo will win all of chandler
arizona that's right that's right
there will be more waymo's in chandler
arizona than comma for a long time
or but there's you know more commas than
waymo in the world
that's right unreal thank you all for
watching
have a good night everybody if i don't
see you merry christmas
happy hanukkah if anyone actually
celebrates it
celebrate kwanzaa what's the word for
kwanzaa
there's a word i don't know
um and if you don't celebrate anything
consider christmas it's a great
non-nominational holiday
for everybody thank you bye-bye good
night
charlie theme songs
[Music]
this song is so good
um couch time it's catch time
cool wait we're sitting on the couch
yeah a couch time
oh my god yo
uh i'm gonna no are we on the couch or
how do we switch i'll just switch it to
you
42 in my cup bitch i love my pocket
bitch i love the trip
uh yo uh what we're gonna oh yeah guess
what's in the box boys
guess what's in the box you know what's
in this box
do they know no it's a 30 90
wait what it was just one 1390 yeah
we fixed it this was in the box
you know what this is
do they know we got 65 people in here
uh don't worry karma wasn't bought by
facebook i was i was just messing with
you guys
you know what this is wait you told him
that we got by facebook i told him
there'd be some sick announcements at
comic con
like you know normally when companies do
these cons you know it's like uh it's
they're gonna announce some
you know big shit
um oh yeah yeah yeah yeah the secret new
feature talk all right so
so you know um check it out okay we
clean the cam
is it clean now guys all right they're
upset
check out the updated schedule
uh so i sent you guys guys the link
uh don't worry we're not getting
acquired by
facebook um we are
having a conference on july
31st 2021 you can buy tickets here
i believe there's only four more vip
tickets left
uh and we have about 70 general
admission tickets left look this one
includes the fee how come sometimes the
fee is not included and sometimes it's
included it's 99
for a ticket but then you have to pay
the fees on
please log into your facebook account to
activate emergency braking exactly um
uh will it be streamed some of the event
will be streamed the daytime talks will
be streamed
all of them that's pretty nice to people
i don't know
some people said they would pay to watch
the stream well
no i'm not going to sell digital content
i just don't give you the digital
content you know what i mean
you show up in person for you know you
don't like oh man i used to have some
good
some good lines about this about like
you know remote man
i like how you're gonna like try to do
things remote like oh yeah no i'm
building a house
no i'm working from home you already
have a home while you're building the
house well yeah yeah no i'm working from
home
you know it's like that like show up
comic con it's a real
thing uh it's here in san diego it's at
1337 india street
uh 137 india we did petition the city to
change the address
yeah not a joke boys um is there an
age limit to attending
uh you have to be accompanied by a
parent or guardian if you're under 18
no anyone can come no like if someone
like 15 year old shows up at the door
that's fine wow that's more nice than i
was thinking
san diego george when did you when did
you go to your first
conference when you were a kid yeah i
was the 15th
yeah hackers on planet earth
um all right so our first talk
uh what was going to talk about open
pilot
see what you guys don't realize about
open pilot is is drives cars and that's
great but it's also really like
do you know how none of robotics
actually works like there's allegedly
like robotics ecosystems out there but
the best they've managed to build is
like like a vacuum cleaner that like
eats your ipad cord half the time
like that's just like really and the
reason it's all so
bad is because no one built good
infrastructure for us um i
made the same argument for now as well
so um
first talk here from will about how open
pilot
uh you know became good uh then harold's
gonna talk
howard was our head of research is now
our cto uh at 11 a.m
about how our training stack works you
know carpathi talked about tesla's
training stack
uh yesterday what tesla's doing now
is what we were doing two or three years
ago right like
you guys think we're going to win
self-driving cars um
[Music]
nobody can touch things like land this
model uh and you're gonna learn right
here how they're made
because you know what we'll tell you
we'll tell you you can copy us if you
think you can i mean you can try but you
know we'll just tell you
uh because you know what we're happy to
we're happy to tell you
um then we have a free lunch at 12.
oh it's burgers hope y'all like burgers
uh yeah we got we got burgers
um bro
you're gonna miss out if you don't go to
comic-con um
so then uh it's my talk
um i'm not you can read the schedule if
you want to learn more about my talk i'm
not gonna be my own hype man you know
what i mean
uh you know like the guy's like rapping
i'm doing the beat and then you can't do
both so you guys guys just read it but
uh
uh oh you you won't want to miss this
was supposed to be italics
do you get the italics in the event
right yeah there is html
i will update that yeah just put the i
tag around it you know the ipad
hi carly uh
hey then um
yeah there there's there's a big
announcement at comic-con
there's a big announcement uh and if
you're there you'll get to see the big
announcement and if you're not there
you get to hear about the big
announcement later i've been like wow
i could have been here for the big
announcement and not
there you know um
then we got robe and the hardware team
are coming up on stage you know kyle
vogt
said that it was impossible powell vote
talked about comma and that was the
company that he wanted to build but
he said it was impossible he said he'll
never be able to support all the cars
and you'll never be able to deal with
you know all the cars having
different versions of firmware and you
know you'll never be able to like attach
nicely to the cars
yeah well yo we did it and we'll tell
you how we did it you guys like you know
it's stuff that if you've been following
closely you know but if you haven't been
following closely you'll be like
wow turns out all the cars are the same
architecture and like all that kind of
that kind of shit you know it's like we
used to have giraffes man and now we
have harnesses
the harness is nice all right you can
hear about that process of evolution and
you know where we're coming we're going
the pitfalls the possibilities and the
promise
uh coming back to the future all right
um then we got uh then we're going into
the 30 minute talks
uh we got a deeb uh you guys know deep
uh he's gonna reveal a secret new open
pilot feature
never before seen um it's a good feature
something that people have been uh you
know asking about for a long time
and you guys are gonna see it be
revealed at comic con
for the first time uh at three o'clock
p.m um and greg our head of
infrastructure
uh is going to talk about our amazing
on-prem data center
uh we've built a data center for like a
tenth of the cost of every oh sorry
sorry not a data center we've built a
not a data center for like a tenth of
the cost of everybody else
you guys want to see my 30 90 again um
yo
so yeah there's that and uh you know
it's gonna be great we're gonna have
like you know like
you guys want to see like sexy looking
pictures like lots of wires in a bundle
we'll have some of those you know we got
we got wires and bundles like it's
really
you guys like the data center looks so
nice you guys haven't seen it
uh you know we have we have two
pay-to-bites spinning discs we got like
another like
600 terabyte ssd array uh we have then
another like 400 tower we have like
three petabytes in this in this
you know beautiful rack um 80 gpus
you guys will hear about that um
that way xing is going to talk about you
know our camera based driver monitoring
that's so good that tesla copied it two
years later
uh wishing is a engineer on the research
team he built this in like
half his time so you know i was like oh
it's built by like you know like like
half an engineer
bro that's the power of comma and that's
the power of common infrastructure and
crowd sourcing and big data
and you know not being stupid uh you
know come come learn
how to build uh driver monitoring in a
not stupid away
uh yo everybody like who's making like
crappy tesla you know just watch this
talk i'll be like oh we could make
driver monitoring like that you know we
could have put all our leds on all the
model threes but we didn't
um so yeah you know don't do that um
then we're gonna have a group chat we're
gonna bring a bunch of team members up
on stage
kyle's been a company from six years now
uh you can hear about how we came from
like
you know building hobbyist crap to
building oh well you know
the future the actual like like like you
know
uh i was thinking of the icarly song um
uh so then we got uh we got happy hour
uh and we're going to get people on
stage for community lightning talks
i think drewery said yesterday he wants
to give a 15-minute talk about the
chrysler court
uh so if anyone else is interested in
giving a community lightning talk
uh this is your chance um
then we have dinner uh if you didn't buy
vip
you get flat breads on the first floor
these are the pizzas guys like we're not
we just call the flatbreads because
likewise not burgers and pizzas burgers
and flatbreads you know burgers are
fancy food you know
i was like iceland once i paid like 60
bucks for a burger and a beer no joke
man
iceland has the iscs uh
been like months since i saw the video
yeah we're chilling for comic con guys
uh
oh yeah yeah but if you bought a vip
ticket you get a beautiful
sit down dinner with us on the third
floor it
this is your chance to pitch us whatever
business development shit you want to
pitch us
and like you know i think you'll leave
this dinner being like wow
i now understand the world better um so
you know no promises about that you
don't get a refund if you don't feel
like your world changed but
to sit down dinner with the whole team
uh you guys can learn you know what the
new business looks like half of the
phone calls you know i just school
people in the new business
you know you learn like mba shit you
don't learn how you know like to do
anything
i'm just like oh like they understand at
the end of the phone call why like
their thing isn't real uh you know
i want real things that i want to know
once they say something i want to know
that it really happens
oh and then
we have maybe the crowning event
college equity uh you know i think like
a bunch of guys on a stage with some
beers and a jeopardy board
i will ask questions and you know we'll
all clap for you if you get the right
answer well
we'll boo if you get the wrong answer uh
two rounds of jeopardy it's gonna be
like great common questions
like this release
was the release that included
the new ui do you know
in one word or other what were other
jeopardy questions that you guys might
want to study you're going to give away
our questions what does
calvi stand for
what's the code name of the panda inside
the comma two
bonus points if you can tell us why
um someday you'll see i know the world's
gonna change for me
and be so wonderful
uh um can i sign your comma too if you
buy a vip ticket
sure why not uh so yeah get in
uh buy your comic-con tickets today
uh before they do sell out uh we're
about halfway through the sale of
comic-con tickets
uh we're a little more than halfway
through the sale of vip tickets
uh so if you guys wanna wanna come to
comic-con uh today would be a good day
to buy your ticket
tomorrow might be an okay to buy your
ticket but the day after that uh you
know you're gonna get there and it's
gonna be like
sold out and oh man you know
just like 39 now 3090s were always sold
out but just like everything else man
you know how many rav4 primes i should
have bought seven you know what i could
sell them for now
double that's right uh i can't buy vip
i'm bringing my wife with me and that
would be 2k hey vip is not for everybody
we appreciate having you at the
conference you get most of the same
experience except you don't get a vip
look vip is mostly you guys heard of
proof of burn in crypto
it's proof of burn bros it's proof um
can i ride the hoverboard you think
okay you think more users would increase
the speed of development
why do you think that you think would
develop faster if we had more stupid
issues to answer from people
don't think so bro don't think so
all right what do we got always the
after party you know if you're cool
you'll get invited
uh you know you'll get tapped you've got
to follow the weight rather than
um all right what are we hearing from
from youtube
they just want to hear the full icarly
theme song don't they
yep the entire schedule is up on our
eventbrite
chris posted a link to it
it's it's a little quiet it's mostly
been garbage
wow just trolling can we get some comma
tequila yeah maybe
three trace commas uh no there will be
some big announcements at comic-con you
think
i would pay you know you know how much
this event costs man
it costs more than the average american
wedding
uh is it this beautiful venue
uh they're like rock stars at this venue
you know but really like uh you know
comic-con
like it's surreal like it's not like
gonna be like some
some some folding chairs in the
auditorium bros we wouldn't we wouldn't
do you like that you know
it's gonna be like plush leather chairs
and vi you know it's like
it's like the club but not shitty
you know like what sucks about the club
the alcohol is all overpriced and the
music's all really loud and it's dirty
this is going to have informative talks
reasonably priced alcohol and nice clean
seats
you know and it's not going to be too
loud it's not gonna be too loud i
wouldn't do you guys like that you know
i'm not here we don't make the money on
drinks bros
what are you looking forward to about
can fd oh
can fdo they they heard a little
announcement about can't have d i mean
announcement i did ask them if they
liked canfd and if they like the color
red they should come to comic-con
i did mention that on reddit um
someone asked about esperanto's ai chip
i talked to some guy from esperanto
uh you know they just got to get out of
underneath the boot of the professional
managerial class
and then maybe they could build a good
ai chip but as long as they're under
that boot they're going to build
bullshit that nobody wants
since you said we don't need more users
what do you need
more quality developers
yeah what do you mean by more time when
software just gets better it just takes
time
it's like a fine line or like you know
you have to age your marijuana it's like
that
uh no i mean we could always use more
quality we can always use more great
developers
right uh you know better developers
geniuses
who want to like you know just like look
at open pilot be like i can do this
better
that's not we don't need more we need
better
right like i don't want like you know i
have a localizer right like i don't need
two localizers i want a better localizer
all right we don't need more i don't
want to add you know do hickeys and
features
i want to take all the core stuff and
just iterate on until it's better and
better and better and better
if that's how you manage complexity and
make things better it's easy to build
features it's hard to build things that
are truly great reliable
robust you know low cpu consumption
uh yeah like all that kind of stuff
logan asks
what did you think about carpathia's
examples of tesla's radar problems with
phantom breaking in his last
talk what carpathi is talk with a hand
labeled 230 different scenarios bro we
just use contrastive models find them
automatically you know
um we do things automatically if you
can't count the number of things you're
gonna do
on one hand and maybe you can get a
two-handed exception but if it's more
than two hands it's definitely way too
many things
uh i know i mean when tesla shows off
the ground trading stack
this is an example we are two years
ahead of tesla
you guys know we're two years ahead of
tesla and driver monitoring
uh you know tesla is two years ahead of
us in hardware
um they're six years ahead of us in
fleet size probably
uh i would actually do that how big is a
tesla fleet size now
it's over a million no it might be well
if you could see if you extrapolate out
commas current growth rate
i think will be where tesla is at fleet
size now in like
four years um
so yeah they're quite ahead in that but
again is that really a metric towards
solving self-driving cars the hardware
is nice
their hardware is a lot nicer than ours
obviously uh but you know
comic-con just like to say it's
interesting that we announced comic-con
and
one week later elon announced an undated
event
in a brand new common ai car
we're stealing cruise origins no
actually though we do want to chrysler
pacifica
like i wasn't kidding about that we
actually like someone reached out
they have one and they want to sell it
to us a reasonable price or for a new
scam price
i don't know they didn't name a price
but
to know that your car is going to r d
for a better future that's right your
car has a good future ahead of us it's a
good cost
sell your car to a good cause we'll pay
you money but not scammed yes our common
car is gonna be just like zuke's it's
gonna go in both directions
whoa our car already goes in both
directions have you heard of reverse
i mean you look kind of stupid going
reverse on the highway but yeah you
could
it's going to have v to v um
what about mobile what about them
does comma support the audi a3 some of
them
tickets i'm not offering digital tickets
what is it
shit's so lame guys we all do zoom calls
you know
it's real it's a real event show up
yeah when was the last time anyone went
to a conference i don't know
what do you think about honda going
vision only
why are you guys posting junk and
discord or maybe because they can see it
on the video
yo yeah oops wrong chat what is this
junk get your junk out of discord
or we're gonna see some bands come in
what car would you recommend for a comma
two
georgia's favorite car is a sonata
that's right hyundai sonata
it's a great car it's really quiet it's
a great entertainment system
uh willem's coming out to work on it oh
yeah no all of europe's going to be here
hello i'm robert yost are all going to
be here
for comic-con
it's gonna be a great day the whole team
i really don't think you're gonna want
to miss us
that's right i'd get in early rose
um
the accords are nice these are pretty
nice
you want to talk about our new employees
no
oh can you ask george about vision honda
getting vision only
like you know i don't like when people
talk about me so i wouldn't do that to
their employees you know
um honda's getting vision only
i mean like we used to just video and
new employees
just walk around you know and startle
them
yeah i don't know i think we're too good
for that now it's too much of a
corporate environment now
so corporate here yes yost is on fire
with the new comma explorer
right we also love everything he's doing
do you want to show them a new explorer
i have to wear masks at the event
can you work a common eye without a
degree yes but not without stills
um do you want to show them some new
stuff in explorer
i can't go to my explorer oh it's got
too many secrets
um is blockchain and auto
an open pilot are are not intertwining
anytime soon to be done to filter out
common bad habits question from the bill
no
um what kind of books do i have behind
me
lots of books you want to learn about
convex optimization
yeah probabilistic robotics
machine learning
oh yeah we got a google pixel
yeah you know and the bible
mcmaster car oh yeah
uh i hope there's no secrets on your
whiteboard
[Music]
sorry guys i'm gonna see if i can tripod
us
except for a new evaluation oh hell yeah
[Laughter]
yeah that's what common shares are going
for on the open market now
474 million
but it's all fake money you know what i
mean you're gonna be like like
like have you guys heard of the weimar
republic
oh my god you're good i helped fix it
thank you how's this thing
try putting someone apart and whenever
you're good you tighten the back
okay good
is that good yeah it's just on georgia
screen now yo
you guys remember eons
you know what eons are not for sale
but comma twos are for sale you guys can
buy one today
or a comic-con ticket um
what else we got troy i think
i think that's kind of it we're really
excited about the schedule
i think that
i didn't need to carry it on my phone oh
yeah some car companies reached out
oh yeah car companies are always
reaching out
car companies are always reaching out
but they're not ready to embrace the
future yet
they'll know when they're ready does
anyone have any other
other um compatible cars they'd like to
sell us for a good price
we're in the market would you like to um
donate your car to comma
it's a write-off it's not
this car charity write-offs a lot of the
100 cars for kids i hear they didn't
actually go to kids they went to like
pawn shops
um what kind of car do you have creator
we're interested if it's flex right you
got to pay us to take it
250 cap we'll do flex right for 250k
or you know what some guy was like will
you pour it to like my porsche 911 and
what i said about that was if you buy me
a porsche 911 we'll pour it
that is cheaper than the 250k it is
cheaper
i think that they're going to let the
canadians across the border before july
31st
i think if you're canadian you'll be
able to make it and um i can write you a
letter
saying that this is important business
can we i don't know if we want to extend
our
credibility like that well for a vip
for vip i mean you know they're very
important obviously this is a business
meeting a fair point it is a business
meeting it is an important business
meeting
i would happily write a write a note
from comma recommending that the us
government consider letting you cross
that's right if you're a vip we do that
don't you
um is george still buying iphones
i mean he does have the latest iphone no
i don't
you were the latest iphone i heard the
battery life was better on the 11 so i
stopped for that
the battery life's better now no i don't
like it it's too square
it's beautiful i love the latest iphone
i'll help your mechanics if you help me
with my signals for fiber optics
that's it that's it uh wait how many
tickets we sold
we found the stream i look on my phone
but it's streaming
oh that's a fair point yo hopefully we
sold a lot of tickets
we want this event to have a lot of
people
um guys we got to sell tickets you know
the events of fixed price
you guys got to come to the event
because we got to you know like we want
there to be a comic con next year
we got to come to this comic con man
yeah ernie jimenez
with the 2020 pacifica hybrid did we
want a 2018
uh are we open to a 2020.
we got to talk to a d this is the
deepest division is it going to be
better than ces
uh without a doubt oh yes yes
cs was okay well george rabbit
you guys common jeopardy is
there's so many unknowns you just don't
know what can happen
with a lot of hype and energy it's not
going to be recorded
there's going to be a lot of drinking
and active and fun and like who knows
what will happen
um i love t-pain but he will not be
there i'll send him an invite
oh yo i went to this
concert ones and they got the gangnam
twins
i hear we were able to get them what
lange
um we might have some special guests
special guest i have reached out to some
friends of comma
um
no promises but
yeah cool we want it you want to hit
header real quick one more time in the
schedule
all right you call it oh we're gonna do
it again just like i'm not an
actor man you know actors you ever watch
them they do the same line in the same
way all right we'll do the schedule
we'll do a little different
look i don't think elon's going to come
but we'll send him a link to the live
stream because i think there's a lot for
him to learn
we didn't buy carpathians he can come
um we haven't said the email yet i was
waiting for the schedule to launch oh
did you drop
in back around yeah there's an open
email on my computer we invited
uh no compat is actually really cool uh
we'd love to have him at the conference
uh we're also inviting anthony levdowski
um
you know lebanowski's legitimate genius
man he doesn't get enough credit for
this stuff you know
he really doesn't get that like we got
taken over by lame people you know what
i said i would do if i was in charge
away more i put leadowski in charge
only he can think big enough to save
lima he's a
gigantic man with gigantic ideas he's
six foot
six i've heard that
um
okay one more i'm gonna do a run through
the schedule
all right
i'm gonna open with chris and then
william the head of open pilot's going
to talk
uh then harold our cto is going to talk
about
models then we'll have burgers for lunch
george oh my god
we got spindrift everywhere i can't
leave that on the
oh george
this is just uh
and then greg's our head of
infrastructure is gonna speak
um
we got spin drift everywhere on the
couch it's brutal
my pants are wet now
[Laughter]
um the happy hour with community
lighting talks
shoot me an email alexa comma dot ai
comic con is gonna go better than the
live stream i hear you spilled stuff
yeah yeah we spilled stuff everywhere
what'd you do oh wait you're watching
you want to watch just clean up the
spindrift
here we go wow that's a lot yeah
whoa whoa whoa whoa alex left in a
precarious place
i stopped watching the stream for like
three seconds i look back whoa there's
spin drift everywhere
[Laughter]
um it cleans up pretty well where are we
on
look like i'll give you a lot of high
level overviews
reverse engineer is all about moving up
layers of abstraction um the morning
talks
are the in-depth uh technical talks
um where you'll get you know serious
information
about uh how old pilot works how a
training stack works
um then
there's lunch uh
i talk after lunch i mean if there are
big announcements
you know uh maybe that's when they'd be
uh and then
we got the hardware team uh
talking you know we got like okay so
it's like the morning solid software
the hardware chunk and then we got like
the different pieces you know we got we
got like
the secret new feature we got driver
monitoring and we got infrastructure
um now we have a nice group chat it's
gonna be like
uh you know like a look at how far we've
come you know
like everyone's in the rainbow
connection it's like that uh
you know and then yeah common jeopardy
all right we came up with the prize at
lunch you guys legit aren't gonna
believe what
a 15 000 value you guys are not going to
believe what the prize is
it's gonna be great a great prize so
yeah that's what we got
that's the stream and i'll leave you
guys with uh the icarly freestyle
this is flat what it can't be
copyrighted
if you point the camera at the be too
raw boy
bye everyone i'll see you all comic-con
comic-con
all right let's go
yo uh i i guess i'll start talking now
for the people watching the stream
uh check out the 3090s you guys missed
it it was actually really cool like we
should have uh put it on the thing all
right hang on why isn't my camera
switching
yeah there we go yeah those are our 30
90 boxes which we were saving for no
reason i guess um
do you want a 30 90 box we can hook you
up
uh at the comma garage sale on sunday
next sunday
2 27
um we are going to have ridiculously
good stuff at bargain basement prices
have you can i interest you in a laser
cutter original value
twelve thousand dollars for you
yeah
three thousand dollars
can i interest you in what's uh what are
we selling the circuit board mail for
oh 25 new yeah it was 30 with the
accessories
wait that's so cheap
no that's a good circuit board mill
can we do that whoa whoa that's insane
alex
yeah yeah
what this is
you're not for the people all right
you'll take a 30-90 box can we wait
wait how much will you buy a 30-90 box
for we should actually sell them at the
garage sale people can take pictures
yeah yeah yeah you know the guy who it's
it's next sunday it's february 27th um
we're also going to have the entire
comma shop available for sale so this is
your one
yeah this is your one chance in common
history uh to actually come buy things
in person at the office um
i know i know we have comma threes we
have comma twos and we also have
computers at bargain bargain bargain
bargain basement prices
uh do we ship no we don't ship what time
i think we start as early as eight am
seven a.m
no no no what do you mean i'm not going
to be here
10 a.m perfect
perfect
all right the comma garage sale starts
at 10 a.m common threes are the normal
price but if i can interest you in a in
a computer that used to be used in the
original comma compute cluster that can
fit four gpus with a 1600 watt power
supply for i don't know
it's
yours um
can i interest you in a ups market value
250 yours i don't know 30 bucks
um no there's no warranty on any of the
garage sale things there's a warranty on
the comma store things if you buy a
common three yay oh yeah yeah we'll have
power um it's going to be a chill
experience 10 a.m comma headquarters
yeah yeah we'll
we'll post everything um are those gpus
no those are boxes uh we're selling
30 90 boxes for five dollars each
what
would have been me
oh yeah i'm up here
um
with oh yeah yeah can i interest you in
pandas
look at these pandas
we got a lot of pandas
we actually have someone who's buying
them all uh so you know i don't know how
long pandas are going to last
um
what else can i interest you guys in a
christmas tree now we need that um
uh the mounts for comma threes i believe
um many heat sinks from comma twos uh
boxes of antennas no no this stuff will
not be in the garage sale but i'll i'm
gonna go down and i'll show you guys
some other stuff that's gonna be in the
garage sale
oh yeah i got to lower this this trash
white board to you
oh yeah yeah
all right this is our this is our
convenient conveyor belt system uh watch
out i don't wanna this might fall i'll
try to make it not fall but it's not the
most balanced thing
uh your fiance's in san francisco no
okay so there's no actual gpus in the
boxes it's just the box
um though actually if you're interested
in like 970s i'll sell them to you at
bargain basement prices you want to buy
like a 970 for like 40 bucks yeah it's
yours
oh we have tons of white boys if anybody
you know what the comma garage sale
actually i have to be there for it
because i'll be negotiating with
everybody
um
three empty boxes coming down
ah
no
no
i broke three boxes
no that was i really didn't mean to do
that
oh no
i destroyed how much of these boxes
i'm sorry i didn't mean to do that i was
holding the phone
we're on youtube
did i show them all the stuff no i'm
coming down
i'm showing them all the stuff in the
wall your office
oh yeah
oh wow i really i really uh did i break
all three of them yes oh that was
terrible
oh yeah these computers
can i interest you it has the name
gpuslave04
don't worry it's okay with its slavery
uh we asked we got consent
it's like it's like it's like bdsm we
got consent oh look it comes with a gtx
3090 can i interest oh no sorry 970 can
i interest you in a 970
oh yes this dss station
is part of uh
how much for the master oh this one's
the master oh i'll sell it to you for a
good price
um i don't know you know what you come
make a deal it's like let's make a deal
do you want to buy a rack of computers
you can't
uh
what else we got
you can't buy those computers either but
you can buy these computers oh can i
interest you in low-quality acer
monitors
i don't know uh
no power supply included dollars
oh no because we don't get interns low
quality monitors wanna say hi to youtube
guess what's happening next sunday
the comma garage sale
support
we're posting a deep's phone number on
twitter um the dell monitors aren't for
sale you can only buy the acer monitors
uh but seriously uh next sunday all the
stuff's for sale crazy bargain basement
prices can i interest you in a nine baht
or a gyro hoverboard
um
i can't believe i broke three boxes
well those were junk boxes
uh
check out these hoverboards
uh they're not for sale how much for the
street light no we need the street light
uh
that's mostly what we got oh yeah yeah
yeah we also have a box of trash you
want pool noodles
uh a steering wheel some old nvidia dev
code uh some some lock boxes
a space heater oh is that soldering iron
for sale
yeah
why don't
what was that they don't like that one
you can ask nat he knows they don't like
the one of the acer monitors 4k no i
believe they're 1080p
oh badminton rackets
i can't believe i broke three boxes
um
can i interest you guys in mcmaster
catalogs
um there's no import taxes
at the garage sale
paddles we have tons of cables for your
boat uh whatever that thing is the space
heater yes
oh yeah you got space heaters no we need
the wet dry vac
many comma three boxes um yeah if you're
interested in buying any of this stuff
you name your price and we'll probably
sell to you for that price yeah yeah we
got more stuff
yo yo yo yo check it out check it out
yeah um
oh i can't believe there's plastic
everywhere
i'll clean it up
what
oh wait opt-3 eons
oh we'll dump them for a good price
yeah if you just don't want to run like
zero six six we have a whole bunch of
those eons people love zero six six yeah
um you wanna buy the comma hippo it's
not for sale it's a piece of common
history
i don't know can i interest you in a dji
phantom 4
amazon basic
chairs duffel bags frisbees what are
these
i don't know
wow what is this
oh that's not no no hawaii is not the
code name of the c3 slim hawaii look at
this what is that it's a kick it's for a
drum
do we have a drum
andrew uh andrew valash if you're
watching did you leave it here i think
he did well we can't sell his thing does
he want it we should give him until
sunday to claim it for free of course
um
i think before he left he grabs a bunch
of stuff well
just send him an email i mean yeah but
it looks kind of nice just send him an
email that's our policy
what that is not our pr that's not our
policy what send them an email i found
stuff in the car once and you told me
that's not the policy what stuff in the
car found some glasses and you told me
that someone wants them they'll ask for
them but glasses are like
no less could cost more than that drum
what what
didn't we post on slack about the
glasses i don't know i didn't well i
don't know anyway wait you guys want
common frisbees
what's the what's that phantom drone
what is that oh remember that was from
comic-con it was the giant green
inflatable guy we're going to pull that
up not the garage oh no yeah we can't
sell that that's for hype at the garage
that's ours
we can't sell the hype that's our garage
we can't sell the hype wait has anyone
ever put one of these together
in an office
oh yeah wait do you really want to buy
rtx 3090 boxes five bucks each
can i interest you in discontinued comma
shop hardware
how much for a comma pigeon yo wait you
want a box full of random gray panda
parts
yeah we might have that
we gotta drill holes in this hard drive
i think it has bitcoin on it
um yeah but it's next sunday
uh we'll post details of it or write a
blog post
i don't think the garage sale needs a
blog post oh we'll post it on twitter
we'll twitter you'll see that all right
cool uh yo yeah no you guys um this is
gonna be your opportunity to buy
ridiculously good stuff at ridiculously
low prices
uh oh yeah and adib is gonna give out
his phone number and he's willing to do
support for everybody um so if you are
trying to set up your comment next
sunday uh deeb will do support
we'll give them a forwarding phone
number we won't make it the real phone
number
wait alex
one hoverboard moved
oh i see where you got that cart from
you need a white panda we have white
pandas for sale absolutely uh normal
price though no special discount on
white pandas
i understand where you got that card
from now
yeah what what no i loved my candle it
smells like glen rock
how much for one gray panda
of all um what is it
do i like these
so gum uh wait you wanna you wanna you
want a great panda i don't know
99 dollars it's like a crunch bar
the whole thing is crunchy 99 half off
gray panda
panda
panda
no no the comment threes aren't final
sale
yeah if it's not in the shop it's final
sale
um and final sale even doa check it
before you take it
what
no we'll do cash
you going to do cash
venmo yeah
what if people want to pay anonymously
guy asked if we'd accept dogecoin
yeah
we do on our website
no for the garage sale
how many block confirmations you gonna
double spend the dogecoin
one of the blog posts with details going
up uh
i don't think there's gonna be a blog
post i think it's gonna be twitter and
it's gonna be a few pictures on twitter
and you can watch this
what this stream
oh yeah watch the stream um well you
want to see the key ev6
[Music]
yeah yeah the ninebot can go
look it's in a div in the kia ev6
i said look it's nadim and the kia ev6
yeah this is where the garage sale is
gonna happen
um can i interest you in hundreds of bad
comma three cases
um
can i interest you in jungle strapped to
pieces of wood
see look at this did you see gpus no we
are selling boxes that 3090s came in
though for five dollars a box
there we are yeah
oh we have this prince comic-con ladies
what do they say
they say they're the yellow ones do they
say comma cone no
oh that'd be cool
there's a comic-con
they say comic-con
yeah that's so illegal that's so illegal
that's just like yo some guy actually no
some guy last night discord um he was
like trolling but like apparently in
taiwan there's some companies selling
knockoff comma twos claiming their
official comma and they're affiliated
with us so i think we got to go to
taiwan and beat somebody up
we got a guy in taiwan yeah we had a guy
oh yo we do got a guy that's a good
point we should reach out to our network
um because you know you don't mess with
me man
all right uh what else we got for you do
you want a z840 with a broken
motherboard and actually doesn't have a
motherboard in there we will sell that
to you for
twenty dollars do you want these random
ass computers
if they boot a hundred dollars if they
don't boot 20.
what up
no that's good uh oh my god i broke
three boxes
snack time we gotta oh yo wait they're
they haven't used their 30 inch monitor
yet got cowboy i don't want to steal it
it's still in the box
i think i should set it up in my office
why the sale because this office is too
small and full of junk
um
sorry sorry high quality stop listen
we're just inspired to connect with the
community listen listen you guys
wait do you want to buy a slightly
dented prius
honestly if we get the right offer the
prius is yours
it has a dent in it now
it's slightly dented the prince's final
sale
um
fund hawaii yo can we raise enough money
for hawaii from our garage sale
yes
i think so i think there's some common
threes maybe
um
it's a normal priest
it has been like weirdly reflashed a few
times a lot of common merch we got we
got an offer for oh yeah yeah yeah yeah
try the merch on we'll have a mirror so
you can look at yourself
we'll have a comma three with the driver
camera up so you can look at yourself
wait
wait no we actually will we'll have a
comma body there balancing
oh this is the first real life preview
of the common body this is a pop-up shop
just to show off the body
um
does comma still have the rav4 we do no
one likes it but we do
we have
we still have to go through like 20 more
boxes today oh yeah no we have so many
boxes can i interest you do we have any
libraries left or we get rid of those
oh can i interest you in a sixty
thousand dollar applinex gps
i'll sell it for 25.
that one's actually that one has resale
value because they haven't gotten any
better
oh
all right well we'll put it on ebay yeah
that one should sell on ebay
um because we realize that all of this
fancy stuff is totally useless
um
all right
um you're right you're getting close on
the hawaii you know what's up
uh all right cool guys that's all we got
um
come to the common garage sale next
sunday starting at 10 a.m
i will be there to negotiate with you
i'm a great negotiator i warn you
um if you're a fan boy don't come if
you're a fan boy everything's a million
dollars
right uh
now that's not really true i won't be
there to negotiate with you you'll be
negotiating with great people
um
it's next sunday at the store i'm never
streaming on twitch again uh don't ask
um what's in hawaii
you'll hear about you'll hear more about
hawaii soon oh yo
and by the way
big models merged for the comma 2 and
the comma 3.
so
uh update master and enjoy
your uh
for big model
thank you thank you we're hoping to
raise money for hawaii um only if the
garage sale goes well please buy things
bye-bye
okay there we go welcome welcome welcome
everybody welcome to the comma prime
launch all right so first we're gonna
tweet the live stream just find our
hello Prius Prime for the win
hey I gotta figure how to delete the old
stream and I don't know we'll deal with
that later
no we will just share this one let's
check my tweet looks good
yo yo there's no black pandas that's
fake
alright guys I didn't really plan too
much for the live stream I did plan this
is what we're launching it is called
comma Prime and it's a good service it's
also an excuse for you to give us annual
recurring revenue which is something we
need in order to make you know Silicon
Valley are happy with us and they could
they could love us if we just became the
kind of company that makes annual
recurring revenue it's not a credit card
it's not a credit card you know what I'm
just gonna post the medium post and you
guys can all follow along just copy and
paste this let me post on Twitter let's
see the card validator I love you every
Twitter's card validator guys just card
validator space thank you
yeah that looks pretty good ,
I'm launches today exclamation point
dad alright let's make that our pinned
tweet John sorry
Drew's introducing prime okay
so you guys can can link to this and
read it but basically it's got a couple
of cool things one it has an unlimited
data plane meaning you can buy the SIM
card from us and it gives you all the
data you need for you our Eon oh it's
unlimited but it is capped to 512
kilobytes of bandwidth well we could
wait for a few more people to get in
here before we get to the next thing but
you know what we're doing it right like
um you know we're we're a social local
mobile company except if you get rid of
the social so we have mobile and in
order to really be mobile what's more
mobile than being a cell phone provider
I'm so it turns out you can be we're in
NV and oh we didn't come and put towers
in your local neighborhood
we didn't upset your local housing
hallways and stuff we didn't do that we
we partnered unfortunately contractually
I'm not allowed to say who we partnered
with but uh it's they're good they're
good don't worry we didn't partner with
anybody crappy I wouldn't do that to you
guys um so it's unlimited data it will
not work in the UK right now it's us
only we're not sure it might work in
Canada and Mexico but we're gonna say us
only but if you buy one in Canada and
Mexico maybe it will work so we have
some new infrastructure URL out in 0.6
the cue logs the 512 kilobit will allow
you to update load your routes in real
time so they'll show up right away in
the app should be pretty cool
alright so that's the good thing right
that's a good thing um and just so you
will get this out of the way right now
it's $24 a month so you know $24 a month
if you
some old TechCrunch Disrupt Tom had
always been talking about how it's gonna
be $24 a month well guess what now it's
$24 a month um so you can buy it in the
App comic connect but we'll get to all
that in a minute we're gonna talk about
the next perk that you get now this is
kind of the bad one so remember when we
promised unlimited cloud storage well
that was all alive because it turns out
that cloud storage is really expensive
we had free cloud dollars for a while
but the free cloud dollars are running
out so the perks that we can you know
pass on to you are running out too but
basically what this means is you know
you can access all your drives and
Explorer in the app and in Cabana if you
don't have a comma Prime membership you
only get three days one two three but if
you have common crime you get 14 14 days
of unlimited storage
[Music]
you don't like clouds where's your
privacy bro-bro privacy is dead
what we'll get to privacy actually we
have for the next part is pretty private
I like to think that like read privacy
is dead but write privacy can still
definitely exist um so we we these are
expected things these are expected you
should have expected them from us you
know we got a we got to do it just going
discord so we can we can live discord
while we're live youtubing and all the
things so we're gonna go through a few
more things and then we're gonna go
around the office and ask people what
their opinions are on Kama Prime there's
no black panda guys um no no no but we
have one really cool thing for you guys
um that I think oh yeah discord comedy
guy we have one really cool thing for
you guys that I hope I'm you're gonna
appreciate let's see how our how our
tweets are going yeah you know what yeah
okay cool
okay the next thing is the SSH gateway
so this one I'm gonna show you a little
bit one of the first things we built at
kama was a VPN if you own an eon we
should get a free sim if we sign up for
kama prime so the sims are $20 if you
already own an eon if you're buying eon
today or later you get a free sim but
what I think I'm gonna mail you guys all
sims you think I'm really gonna do that
and then me with a little envelope
sitting there forever no no no no it's
not ssh with 22:4 right because we're
not gonna open we're not going to expose
that ssh to the Internet
um you can't really do that right
because you're behind that's what we've
built is an SSH gateway it's not a VPN
um so to be clear what the differences
are we don't like like unlike some other
companies that put all the cars on a VPN
I think they've moved away from that now
but you kind of don't want to do that
right because then all the phones are on
the same VPN so you don't want to do
that sorry if you're in Europe this is
for the America the US people only I'm
not dealing with all your privacy laws
talk to your local representative to
make it easy you know only punish I'm
all for punishing Google and Facebook
but don't don't punish me you know so
it's a gateway meaning what it can do is
know go to discord comma dot ai it
forwards SSH through our servers but
it's end-to-end encrypted meaning we
can't tap into to to any of that stuff
it's your private key and the way that
you enter your private key is you enter
your github username right here so this
is gonna be in zero point six point one
of both Open File intention for plus and
it's gonna grant SSH access to the
public keys that are built into your
Jail we do not have access to your Aeon
no no man in the middle attack if you
guys tell me how to man in the middle
attack this I'll be impressed I thought
about it a bit it seems pretty good our
so our security model is the same as SSH
meaning basically all its real all our
back-end is really doing is exposing the
SSH port on the phone to
yeah it's just like bitcoins encryption
system okay so this is the command
you're gonna use you can go right now to
ssh comma dot i I'm gonna go to it right
here
SSH comma dot I and it shows you how to
set it up so this is the command we have
some scripts to make it easier but if
you want you can just do this this is
the key this is the dongle ID I press
ENTER and give it a minute and boom I'm
connected to the Aeon so this is now
live on any on and you'll be able to
connect your Aeon just as easily um who
wrote that well do you want to go do you
want to go a speaker go up we got to get
to one more thing and then we can go
speak with who wrote the SSH and then we
can answer any questions you might have
about comma Prime so how do you sign up
if you don't have it right now go on
both the iOS and the Android App Store
you can download it's it's it's if you
know what SSH is you can do it um no
it's not Arch Linux Ubuntu servers high
quality um what this does is gives you
remote access to your Eon from anywhere
in the world so if you're a comma Prime
member you can just set up a script on
your computer so you can remotely access
basically your car from anywhere in the
world um we're gonna be rolling out a
lot of features in the coming months
that use like this live integration with
the car
say something hypothetically we could
roll out is like door unlock from the
app or something like that right I don't
know if that's actually gonna happen but
you could theoretically build features
like that for now we're giving you know
are our tools still really are developer
tools so we're giving developers access
remote start yeah SSH right you see not
now you guys are thinking of course you
know yeah remote access to your car it's
your car that you're getting remote
access to know the EON is never offline
for power saving the EON is always
connected to the cell phone network just
like a normal cell phone right but a lot
of the power saving stuff had nothing to
do with the the radio being on in low
power so the comma Prime is available
for purchase in the app for 24 dollars a
month and remote fuel check absolutely
$24 a month it's only available right
now in the
States and if you have an eon currently
you're gonna need a comma sim and you'll
be able to buy that there's a link for
the medium post into comma prime sim for
only oh come on come on you a guy I've
got it cuz it more gotta get some more
tweets on this who's not excited about
comma prime let's just post this on the
discord with out with a nice at channel
yeah we love it at channel you know what
better idea we'll put it in the
announcements channel boom John that's
not what I wanted to do that's at at
this let's just make this the medium
post Oh maybe everyone will click
through that anyway I'll just not not at
it no no no no it'll cancel delete be
okay
I don't even you know when I livestream
normally I have it too you guys can see
my screen you can't even see my screen
right now but let's hope that that
expands nicely so this isn't discord
announcements right here yeah cool sweet
so gamma prime includes the unlimited
cell service we may someday offer a
version that does not know 19 inch
monitors in your cars okay let's go
speak with our app developer Andy who's
done a lot of the work to make comic
prime a possibility hey Andy you want to
talk to the YouTube ease let's go B's
they still scope he's oh yeah we're hang
on a flip the camera so I can
[Music]
and you're really happy about it we're
externalizing the key part of our
infrastructure that we've had for few
years but it's really nice to rewrite it
in a way that we know we can share with
with everyone and it's actually really
nice our old VPN used to kill our car
batteries it would wake up the radio all
the time and we think our new design is
going to be much better on that front so
hopefully less trips to the car
dealership to the Toyota dealership and
in fact the new design uses Athena which
has already been rolled out in open
versions now prime only feature like
common security doing anything oh how
many people had VPNs yeah yeah yeah shut
it down come on Prime
yeah we should do we should do the cheap
prime that doesn't include the data
Sunday - we'll see there's a lot a lot
of Europe a lot of Europe was like is
this only for America yeah yeah we're on
the finances you guys should all buy it
we want lots of annual recurring revenue
cool cool
thanks guys
all right let's take a look at the plant
an interlude for the plant do you want
to say a few words in the scope yeah has
worked hard to make puts the car on the
Internet
like Internet of Things we didn't we
didn't say Internet of Things nearly
enough in our medium post I'm gonna edit
the categories right now
Mykel watts I'm glad you like it Willem
deep anything oh good
yeah no it's uh this has been a long
time in the making we can't mention we
didn't mention him yeah I think so Joe
I think yeah I think this is really
important to the future of the company
you know making sure we can provide the
best possible service no matter where
you are and not make you have to go home
and connect to Wi-Fi yeah cool thanks
yeah
well a deep and quick comments yes
they're very excited about at the plant
özil he's a nice plant guys Harold do
you have any comments about common prime
[Laughter]
is it coming to the UK I don't know if
there's enough demand you know what if
there's enough demand somehow you can
signal that demand to me we can work
hard to try to find a UK partner what
did I know there whose name what's my
scam well if we just want the
connectivity know so the SSH feature
only works if you're a comma Prime
member and we're gonna start doing this
with a lot more of the sort of
cloud-based features basically the cloud
costs us money and unless it makes money
we cannot afford the cloud so if you
want the cloud to continue by kava prior
summary the announcement check out the
medium post on Twitter well you pay 20
so you pass 24 you'll have a better
experience you know well really maybe
maybe we'll do we'll do some we'll do
some special colors for people on disk
or who have comma Prime let's see how
many SIM cards we sold let's see if we
sold a lot of SIM cards he's come from a
popular product let's find out LTE band
compatibility don't worry about that
all the Aeons are very compatible with
the comma Prime Network alright alright
how many have we sold so far zero no no
no I'm kidding he's sold one we sold uh
I bet on you guys I bet on you guys to
buy lots of SIM cards go to the shop
right now buy a SIM card before we run
out no if you sign up the
cards not free - SIM cards $20 it's only
free for the people who buy eons from
now on we did sell one yawn though so
maybe comma Prime is sold in neon you
guys we really need to we need to sell
things cuz that's what we do as a
company and you guys need to buy things
I think I think that's how it works you
see all these eons look back to you
running out like that used to be full of
eons and like now it's not full of eons
anymore now it's full of like phones and
boxes
you just bought thank you thank you we
are we are gonna be the Android smart
cars um so yeah sign up today thank you
thank you for it age thank you come on
get in here buy them buy them buy them
we're not selling any large monitors for
the cars no that's not happening
no you can't buy them with comma points
unfortunately wait wait you guys bought
I don't see your orders on here no
what's going on
guys you got to click the Buy button you
got to click the checkout button all the
way you can't just add it to the cart
that doesn't make us any money of how
many users yeah
while the live stream tweet got very
little got very little traction so we're
just gonna delete that
bye-bye tweet and hopefully people will
be excited about comma crime just bought
just bought shout out shout out to to
Christian who's working on me hybrid
Corolla did you actually buy let me
check yes I see your purchase right here
excellent thank you thank you please by
Colin prime guys we're not getting
interviewed by anybody we're just
rolling out the products it really is a
great product it makes you eat a lot
better it's $20 for the SIM card and
then $24 per month you know it's it's
it's a it's a good deal you should buy
comma Prime if you're in Indonesia don't
buy the SIM card it will not work for
you is it a data
it's an unlimited data service what even
is phone mean today oh your violin I
think GT mobile cyclones that make sense
yeah no it's very reasonable you can
also tether you know you can your Yan
can serve as a hotspot you can tether
you can connect other devices through
this it's unlimited some limits you guys
can use all the data you want if the
price rises in the future will you be
grandfathered in perhaps we can
certainly work out things like that
especially as we start to add some real
perks to come a crime this is just the
beginning
no I'm not selling a stop asking for the
big monitor we're not doing any big
monitors
what is it check out the medium post I'm
gonna link the medium post right here in
the YouTube comments
just go to all you want I can find it
from Twitter but I deleted the live
stream post so that's too bad yeah you
guys can post attack are nice we're not
using arch linux stop with the monitor I
have to figure out how to delete this
one
this shouldn't be a thing edit video
[Music]
how do I do we I don't know okay all
right that's that's that's mostly what
we're talking about today for comm prime
any yeah phone sourcing we're good we're
running on Windows nah we're running on
Linux everything here is on Linux let me
just get a link to the medium post that
I can post right here in the YouTube
perfect
well you can certainly do both yeah
updates but OTA updates you know I know
it's for I think a car is like a an
internet-connected device now it really
is an internet-connected device would
call a crime cool IOT that's right all
I'm gonna I was gonna change the I was
gonna change the things on the medium
post to include the Internet of Things
story tag this is a way to problem cool
guys thank you for joining today's live
stream that was today's project
announcement comma prime it's available
at shop comma dot a I can the uplink
handle and how long will it take well so
we've moved to a we've moved to a cue
lanks which mean we upload a really
small amount of data that describes your
route pretty well and that can keep up
in real time that's about a hundred K
per second so at 512 bandwidth should
keep it up no problem um does it work in
Canada maybe it may work in Canada in
Mexico
we're not sure yet if you try it then
let us know how it works and if it works
well then we'll advertise that it works
in Canada and Mexico as well it's a good
way to it's a good way to get an
unlimited data plan it it shows if you
guys buy it it shows that there's demand
for these features and then we'll put
more effort into developing even more
features like you know like we're
talking before about the remote door
unlocks Road engine start we can do
things also like comment security say
somebody caps on the hood of your car
can send you a ping your text phone
right if come on if al cam can exist as
a company doing only this and we can
roll it out with an OTA update so I'm
talking about cool dog - I'm super happy
I love when people buy things at shop
comedy I
yes sentry mode we call it comma
security right yes sentry mode his
security right is that the feature you
I want well let's see how many people
buy it no it can't cure your depression
this isn't that kind of AD the truth is
no product is gonna have any influence
on your happiness it just might make
your life a little bit better and a
little bit more convenient
yes entry mode right no remote drive
remote AC perhaps I mean this is all
open source stuff right so you'll be
able once you get in to add whatever you
want to your your open pilot or shipper
plus vote with your credit card I like
that I like that this is gonna be a 30
minute livestream so we got four more
minutes to go does it do where's my park
stolen car absolutely that's already
live today in the comic Connect app I'm
sorry your card got declined that sounds
like something you need to take up with
your bank
yeah live stream capability that's the
kind of stuff that can be rolled out
look if I look at the bills if I look at
the bills and I'm like man we're making
30 grand a month annual recurring
revenue on common prime then I'm very
interested in writing all those features
for you because let's see actually know
what if we can get up to ten grand a
month recurring revenue I can hire a
full-time developer to write features
for you also comma connect app you know
make sure we're gonna be aggressive
about fixing all bugs yeah you can track
other people using your car absolutely
please use it at eclis but that's not my
problem we just write software Todd
starts the car to cool off yeah it turns
on the AC can the panteon read obd codes
for check engine lights of course it can
but you got to write the software you'll
code for food well you know what I'll do
one better just um submit pull requests
to explore in Cabana making them fast
and perform and I'll be very happy with
you is SSH open source of course it is
it's called OpenSSH check neo ask the
operating system distribution we have
tells you what version it is you can
find every line of the code in there
which cars will get priority you know
which cars get priority Hondas and
Toyotas thirty dollars shipping to
Canada yeah I mean that's the
International shipping charge I don't
know what to tell you why don't you
order
- while you're at it - thank you thank
you Ethan
each table um I can't read YouTube's
comments or nowhere near as good as
periscopes comments but their stream
quality is just so much better
you bought kama prime congratulations
thank you for buying kama prime you are
making it possible for us to develop
features for everybody everybody else
because the money from Kabul prime will
go straight into kama prime features
let's see how many how many comic lines
you sold oh oh we got we got we're up
200 we got actually a lot
oh they're rolling in now we got five we
got five thank you all very much
we got five we got one Aeon if you could
keep the Aeon in your car 24/7 so we
keep our eons in the car 24/7 I
understand that in some places maybe the
temperature doesn't allow this but I
think if you park it out of the Sun it's
gonna be fine no matter what we've made
great strides in the amount of power the
Aeon uses so shouldn't kill your car
battery unless you leave your car for
over a week so that's pretty good comma
crime uses like really no more battery
in San Diego you've killed two we have
all our cars with the Aeons in them
Texas yeah if you leave it in the Sun
yeah don't leave your cars in the Sun
that's not good for your cars anyway
batteries the batteries good um so we we
leave the Aeons used to kill our car in
a weekend but we did a lot to lower
power consumption we've removed OpenVPN
off of our phones and now the battery
life is more than a week so you should
be pretty good you can make a tinfoil
you can make a sunshade I mean people
have those for their cars too for a
reason you know it's good to keep your
whole car cool um battery list Eon with
USB power over the comma power the
batteries less of a big deal than you
guys think we moved to San Diego a
couple of months ago life's a lot better
down here as that's a scam
yeah any last questions about comma
Prime now it processed cool are you
telling me we have one more order you
two
no I can't I delete it off Twitter it's
just a spur private YouTube Jim yeah I
tried to look and I couldn't see it yeah
yeah yeah it's kind of the medium post
on Twitter YouTube thought some people
find it turns out these don't convert
that one medium positive media post
convert very well yes we've started to
track analytics because we're gonna be a
real company and uh where is your one
you don't like your lane curves show you
the executive bathroom all right yeah
we'll go to the bathroom you go to the
bathroom on stream oh this is the comi i
stream if it was my twitch we could do
that no oh what science oh yeah okay I
don't want to know about that let's see
how many let's see how many how many
things we are sold do we sell a lot I
would show you guys this screen but it
has everybody's names on it so we're not
gonna do that
hey privacy great again I mean I don't
want access to your device because it's
just a liability for me oh my god shows
so many we've sold eight we've sold
eight all right should we keep the
stream going until I can't count how
many we've sold on my fingers oh this is
pretty good guys
I bet hi we have an internal like office
little betting pool to see how many are
gonna be sold
I bet thirty-two so you guys don't let
me down come on everyone by comment
Prime today's the day to buy it you'll
get that SIM card in the mail you're
gonna love it
we got eight so far let's just get three
more let's keep the stream going until
we get three more buys I'll check this
out guys look at how much common prime
we have in stock
four-twenty so you only need to buy 24
more no no no he's gonna sell 11 we've
sold it so far they're pretty good it
was a little bit slow at first but I'm
glad you guys are coming around to see
all the benefits of that , prime can
offer you the sim cards only $20 to get
started I'm not signing anybody's comic
Prime we're not doing that walks are
what's kama Prime check out the medium
post kama prime is our new $24 a month
unlimited data service it's not just
unlimited data it provides more than
four times as much cloud storage as as
the newly nerfed cloud storage without
comma Prime it provides SSH to remotely
access your Aeon in a very secure way
such that we do not have access to your
Aeon only you with your private key no
you can't you have to get a comma sim
which is the SIM cards that we sell
how many aeons sold last month a bit
over 100 is this we're not actually
allowed to say contractually the name of
who said mobile network partner provider
might be but it is a good one and if you
you know think a little bit maybe you
can you can you guys can solve the
mystery
Thanks walks or no that's a weird
question Al's dee sign some of the sims
to sell them faster known and I don't
know we're not doing any of that no it's
not Verizon it's a mystery but it's a
good one don't worry it's not like
sprint or 18 to you or anything like
that all right we got we got us out
we're still at 8 guys was still at 8 no
come on I'm not signing them now maybe
maybe we'll just leave you today maybe
we'll just leave you today I'm not
licking any other sim stop that guys oh
man right now we're starting to get some
reach on Twitter much better
transform more than three gigs a month I
think if you do it and do that math
again she'll be able to do quite a bit
more you just just bought one high
refresh it again oh oh it just flows
another one that's nine guys that's nine
that's mine kama primes no we don't have
any marketing people we have me who does
live streams occasionally we don't
really do that we do so we have we have
a great designer and like we design
sales right sales are designed they're
not marketed yeah
we are real yeah it's a level in three
gigs and there's they're actually no cap
you can upload as much as you want make
sure that I don't think it ever I don't
think it throttles you we've tried
I don't think it's one point three
terabytes either I think that's
aggressive as well I think I think when
you do the math it's somewhere in like
the thirty gigabyte range let me let me
let me do the math out sorry I can't
sorry I can't show you this dream this
screen but I just don't have a good way
to do it but okay so it's 512 kilobits
per second times 60 that's per minute
times 60 knots per hour times 24 times
30 and that is of course kilobits not
kill a byte so we're gonna divide that
by a illness they kill a bit yellow by
doing data bytes
so if I did the math right it's that all
right so it's it's 512 kilobyte 60
minutes 60 60 seconds per minute 60
minutes per hour 24 hours per day 30
days per month divided by 8 because it's
bytes not pets kilobytes equals hundred
twenty hundred thirty sixty five
gigabytes so that's theoretically
possible but you get you get less than
that right but like really you don't
need that much
um kanikama prime Simba used as a
hotspot not in an eon no they only work
with eons ah ok google' yeah yeah yeah
dance listen did it the better way than
uh than I did um yeah that Tara was was
those you're not going we're not going
terror big here
he owns use about I think I think it's
about like no contract cancel anytime
it's month-to-month $24 no roaming
charges as far as I know we definitely
won't charge you more than $24 a month
the Eon can be used as a hotspot my face
is red so hot in here
let's see how many more sales we have we
have sales sales I love your sales only
nine I'm pretty happy with knowing guys
ma'am maps are never gonna happen maps
are a dumb idea I'm getting to why maps
her dumb idea on some other live stream
may consider signing up the inside PR
gets merged we should merge the inside
PR change the is a yeah I'm happy with
nine guys nine is pretty good the sales
are gonna trickle in all day thank you
all for watching this official comma
prime launch party that's a pretty good
deal Oh
gonna order one now all wait I'm gonna
hang on if you're gonna order one now
I'm gonna hang on we'll get to ten zero
six one goes live later today I think to
beta and then ya know maps are stupid
you know what I will show you guys
something cool I will show you guys
something cool
since all 113 of you stuck with me um
through this live stream but actually
only if we buy more stuff you gotta buy
more stuff yes
look here see the red light see the
green light
see how when it's red it's like slow
down see you when it's green it's like
go ahead yeah so secret Maps is dead
what's the point of a grey panda um so
if you have a grey pandit your data is
included in the training set uh so it'll
work better in your area um most likely
good then there's no black panda can be
on autopilot work in France maybe is the
stuff you do learn in a research
upstream almost we're working on it oh
oh you're gonna buy one too are we
actually gonna get to eleven I'm so
happy when we get to the number I say
we're gonna get to gonna buy a new car
soon so hold on if you do buy a neon
today by the way the SIM card is
included for free I did tell you all
that eons were appreciating assets we
didn't get to ten yet we're still at
nine I did tell you all that eons are
appreciating assets so future eons are
gonna include a free free free Kyle
prime sim card just for you guys we got
it we got to get it we gotta get I feel
like we can do it guys I feel like we
could do it you buy a panda while you're
at it - you don't want just buy more
stuff I mean the store is open for
everything guys come to the beautiful
comma a I store it's open for everything
you're number ten all right all right
let's let's refresh this and see if this
guy's actually telling the truth grd no
no no we don't have any beanies anymore
those just sold out
oh yeah Jared D is telling the truth he
really did buy us in we have one two
three four five six seven eight nine
ten can we get to 11 can we get to 11
who else wants to buy a sim you won't
regret it you'll love your new , Prime
get out your wallets guys it's 20 bucks
but don't buy it if you're not gonna use
it save the common crimes him two people
who are gonna use it
oh hold up Bob camac is buying oh yeah
you're gonna be number 11 that's cool
I'm super happy when we get to I don't
have any more traffic light detection
that's the only one I have not merely
have one common insurance maybe
eventually right yeah the affiliate
program it didn't it didn't increase
sales
that's who cancelled it wouldn't try
other things like that maybe in the
future it is only for the u.s. I'm sorry
I'm sorry I wish our partner had more I
can't even know how much I could say I
wish they were all everywhere they might
be in Canada in Mexico we don't really
know I'm looking up coverage map of
unnamed provider perfect oh yeah oh is
that 11 is that 11 did you just buy 11
just go no no no we're still 10 just got
in what did you missed you that I the
video contest was a good deal we could
do the video contest again and I'll
spend more time judging it I feel like I
was too quick on the last time judging
the video contest yeah we don't do live
streams that often only now you missed
everything
oh I'm holding up for one more person is
gonna get it what was the video contest
thousand bucks who can make the best
Oakland pilot video yeah I think it does
work in Mexico and Canada show you
something fun in the office I will go to
data center uh-oh my mom just texted me
I'm going back to Jersey tomorrow I'm
using Ubuntu 1604 if you do the video
contest no I don't know about Iran
alright guys welcome to the hello in the
data center
cool
this is where the models get trained
have you wondered why the models have
gotten so good lately
it's because the data is so big got some
cars in here
the Prius Corolla it's all the way back
there
Oh Michael Watts ordered Michael Watts
ordered oh this is exciting yeah we have
zi8 40s for everybody at the office
that guy was telling the truth I don't
know if you want me to say your name
publically I forget if your name is in
your username we don't out anybody we
care deeply about some kinds of privacy
so yeah there's that we just reached 11
sales guys I'm so happy that you guys
could get me to 11 you're all incredible
scope ease and I want you to go out
every day and remember all Brad's buying
right now all we're gonna get to 12 well
that's even more than 11 that's crazy
that's crazy that's so many sales I'm
super happy that you guys are buying
these because every comic Prime
subscription that we sell increases the
likelihood that we're gonna hire a
full-time developer to write come prime
features review I'm sorry I have to go
we reached 11 we reached 11 but I'm glad
we made it there you guys got a 45
minute stream we have to we had to get
through those last few sales but since
we made it that's all I have to say
today only $24 a month $20 for the sim
included free with all new eons you'll
be able to activate , prime directly
from your comic connect app available
for iOS and Android the comic connect
app is free if you have a neon already
download it you're gonna have a great
time it's got a lot of five-star reviews
let's keep it that way if you have
something bad to say tell us we'll fix
it and leave us a good review thank you
very much bye bye bye bye bye bye bye
YouTube nice coppice bye
[Music]
[Music]
[Music]
hi everybody
I'm taking it over to the show right now
we did press and it took a long time
right now we did press and it took a
long time and also I'm hungry so if any
all have food I'd appreciate it ah yo
what up so look here's here's my badge
going to the show right now ban that
user done sup how do i how do i
permanently hide user or even better
perfect big-time CES calm a takeover
it's true it's true so you know y'all
gonna y'all gotta wait while we while we
get to the show your streams is so funny
Thank You oh yeah yeah yeah we're we're
launching the Hyundai harness yeah
that's that's a product announcement
yeah we're making an announcement it's
gonna take some time it's not a
self-driving over no no it's not no you
didn't miss anything don't worry you
ever watch The Bachelor
hey virtually Chris you ever watch The
Bachelor where you gotta like wait
through seven commercial breaks before
they tell you who they're giving the
final rose to we're gonna make this like
that so we're gonna wait for the people
to show up everywhere my my comma
jumpsuit right now CES is the Consumer
Electronics Show it is the largest the
largest trade show in the world and I'm
here right now on location in Vegas and
we wait for some people to show up
what's up Larry a role player carve a
jumpsuit does anyone want to buy one of
these I'll sell you mine it's mine
personally they give them to the company
I'll sell you my person
what's up yes I heard Sony made a card
no open pilots a boy it's not allowed
you purchased the Kama jumpsuit well
well well look into that we'll look into
that
no I'm not signing anything yo I'm
really hungry or if you guys got pizza
I really I really want some pizza if
we're announcing a camera extension or a
micro sized yawn hmm you can buy my
t-shirt right now go to comment on AI
this Burger King y'all I'll settle for a
burger you got tender-crisp that'd be
great
um but no mail on that tender-crisp
spicy tender crisp good toe
it was a spoiler it's not time yet or
Carver and I think when I win a Ford
Flex ride no open pilots support yet
yeah full self-driving yeah yeah that's
guys it's not real test the lie to you
yeah bobland I'm gonna feel you um yeah
no full-size wrapping is not real Johnny
Stein welcome welcome to the first time
stream bro no but you're gonna you're
gonna come with me right now well we
went make our way to the common both I'm
Tesla didn't lie they exaggerated you
know they stretched the truth full
self-driving won't be real for quite a
while but we have an incredible
announcement planned for you today I
didn't put any steel balls to try to
throw through the new product
unfortunately what time right I lied are
you guys are gonna really Tesla
stretched that your full self Driving's
not coming anytime soon
I look tired yeah I'm doing press all
morning it's called marking again we
don't do that
dude can't believe commas fine oh yeah
there's new product oh well you guys
don't know there's a new product what
are we here for
want to think about the ps5 and wheels I
saw the logo I don't know if anything
else was announced yeah open palette is
quite good right cock vapor will know
this product is real and I'll tell you
this I'll do a leak right now I'll let
you guys know that you'll be able to
purchase this product literally as soon
as this live stream is over
cool yeah can you jump out right here
thank you very much have a good day
yes I'm in an uber right now uh welcome
to CES good thing I remembered my badge
George Hotz
I present no we don't have any events in
South Florida I'm sorry all right we're
heading in right now all right I'm not
sure I'm allowed to livestream in there
so I'm keeping you guys on the DL no I'm
gonna I'm gonna bring you guys in just
just be stealthy like right I promise
you it's not a connector
thank you all right we just we just got
by security
I could put you guys in my pocket if we
need to but I don't think we need to
oh is this a line no it can't be it
can't be all right we're going in we're
going in I'm gonna flip you around oh
yeah we're going in all right live from
the CES showroom floor I'm glad you love
the Subaru harness we're announcing that
car no no no we're in we're in we're in
oh no you're gonna have to wait for the
news all right what do we got is it
quality good I've got a good stream
going y'all cooking it up in a crock-pot
Tyler thank you welcome welcome to the
live stream haha good we're in
autonomous drives generation the next
generation millimeter wave radar guys yo
okay quality that's good this is not
shot on a lake oh look 403 um now I'm a
little sick Twila tired too are we lost
where's our booth that
oh yeah IOT infrastructure oh yeah
yo yo alright everybody hide the new
product stand in front of it don't let
anybody see the new product yet stand in
front of it
welcome to the calm a icees booth I'm
glad to have you all here with us oh yo
on the press demo this morning the only
disengagement there was an accident
right in front of us
yeah like this car swerved across two
lanes so I disengaged for safety
definitely not caused by Karma alright
welcome what time is it oh it's 58 oh we
gotta at least make them wait does our
neighbors on say uh-huh yeah
we good to put the website line all
right
well but we'll get we'll give the word
what your biggest fan you want to be on
the live stream
hi I'm George nice to meet you hi George
yes yeah the whole audience here we got
317 people live right here right now in
the kombu 'the we got that PVC from the
highest quality strip club in Vegas oh
wait okay they can't see that that would
be the product oh that would be oh oh
whoa whoa whoa whoa whoa well that was
close that was close
combo lasers come a phone does everyone
want to introduce themselves
all right so um we're gonna let you know
who gets the Rose we're just gonna make
everybody wait like five minutes let's
let's let's launch their product no no
and 352 virtual view is on blocking the
mic uh sound okay the audio is weird
when I flip the phone flip the front cam
otherwise audio is low oh I see okay
what's the front cam we're right here in
the comic I see yes booth I've seen
Logan Paul do the shot before no Harold
is driving the Prius right now 4 p.m.
yeah we're gonna oh man
yeah don't don't let him don't let him
throw let him see anything oh yourself
you know Alex let's go let's go oh it's
one o'clock no I'm not on coke I did
take two dayquil this morning though
well well we don't talk about that yeah
yeah yo what kind of video is this no
it's - I don't drink caffeine anymore
I'm off drugs guys I'm off drugs clean
20 20 shut out to our users yeah this is
a hobble spirit video it's a nice video
yeah showing off your videos 403
watching 409 whoa and toenails how did
you how did you see the name of the
product did you see the name of the
product right here yo check them out
check them out the name is revealed
it is the comma to
we got boxes there's a lot of them and
we still get a little bit of time we're
gonna do the real unveiling of the
product just got away for a few more
people to get in here we got to get to
at least 420 that's right
we need more people than Tesla's share
price come on let's go let's go , - the
video came out before the livestream
announced defconn is on the store guys
everything you see here today is live
right away
it's shipping on the 20th so if you like
what you see get your credit card out
right now get your credit card out right
now see this your credit cut out right
now I leaked the number nope Amex is the
number on the back no it does don't work
all right all right maybe we can slowly
start trickling things out oh no that's
that's too much that's that's not
trickling yeah yeah have you guys seen
this here's a harness
alright 4:30 are we still getting people
though we got away we got away is the
website live it is a live website live o
do it do it wait wait it's live dog Oh
people are slamming it is it going down
slow to load all right guys if the
websites live this is the comma to check
it out truly beautiful hardware remember
some of you we reached out to and we
asked a bunch of times if you were
making the EON what would you make and
that is exactly what we've done here
with the camuto so Paul we already sold
one yo that was so fast this one's off
right here okay so what phone it's a
custom phone
I mean it's custom phone because it
doesn't have a battery it has an
infrared camera it has a custom fan
cooling solution that you're never gonna
hear and it has driver monitoring 24/7
with the infrared cameras right here
it's based on a l'école X 720 but up Oh
just ordered this is it's 999 dollars
this is the comma - it comes in a
beautiful box so these boxes have real
foamies in them yes oh let's open a box
up let's let's put let's put a comma -
here
wait what's wrong that one you brought
the broken phones ah no no no this knows
what's good we're good we're good we
good we good but oh yeah
let's just let's well hold flip the
camera around the comet - oh this is
backwards the foams in backwards
lift it out it's gonna go up it around
don't worry all the comet tools will be
packed properly yo look at this we got
we got a bit of an audience here for
really comas most consumer friendly
product yet welcome to the fleet we have
a beautiful grab your phone to get
started oh it doesn't need a speaker we
figured out how to make the sounds mad
loud the comma - is really designed for
acoustics check it out
in the bottom you'll find a harness it's
the same harness oh yeah
the pandas built-in I almost forgot to
tell you this is an ODBC connector so
that will just plug right into your car
you don't need anything else all you
need is a comma - and a car harness so
this car harness just use an ODB to see
cable process is the same Snapdragon 820
one it's compatible to Aeon software but
you get driver monitoring 24/7 yeah it's
running on 50.7 release here are
supported cars same ones as before oh no
oh no not the same GoPro mount do we
have a mount
we don't have mount let's get a mount oh
yeah we redid the mount - of course you
think we'd leave that crappy GoPro mount
we invented the double-wide GoPro the
comment you will not comment uses way
less power because it doesn't have to
charge the battery constantly these are
the mounts custom cut VHB we invented
the double wide go problem yeah if they
already have a harness you can just buy
it you don't have to buy another harness
what you can tell them what you want on
your sold five y'all wow this is a lot
can you sell your black panda not to us
yeah you can sell it short same comma
power so if you buy a harness it comes
all in this one beautiful box this box
is what's gonna show up on your doorstep
ha IR LEDs dual IR LEDs
camera in here you know the you know
board you guys been hyped about in here
is an you know it's a Snapdragon 820 one
face ID built in four DM it's not have a
face ID I'm not sure what that would do
but it has a camera right here and
that's for place we replace the one
that's usually in the phone with an
infrared camera Uno is the panda that's
integrated into the comma to what is the
you know so it's the built in panda so
you no longer need a panda the install
in the car is completely stealth no more
stuff on your windshield oh did I not
tell you this has a built in
high-precision GPS in fact inside let me
just pull this off inside of this
antenna of this mount you'll find a GPS
antenna built in this has the same high
precision GPS as a grey panda and a
black panda all built in is there a wire
lens it's slightly wider I think it's a
few degrees wider we have no problems
seeing you bought yours a month ago
pandas are now extinct yeah tear down
and reveal I mean you'll have to buy one
panda Eon GPS all built into the comet
to the case is made of ABS if you have
weird windshield angles it should be
fine I mean guys it's the eon but good
uno will not be open-source seven years
early will get years early absolutely
same harnesses
and it's just that same ODBC connector
you're just gonna need one wire and it
plugs in right there you can also use
that as a USB to connect to the phone
no you won't have to take the common two
out of your car on hot days the comma
two can withstand up to 85 degrees
Celsius we tested it we put it in an
oven it'll withstand any heat your car
has to throw at it and that's because it
has no battery in fact the battery has
been replaced by a thermal pan given the
coma - unprecedented thermals oh we
didn't we should have brought a few that
were kind of in oh yeah yeah um if you
have an outstanding Aeon order just
email support we'll cancel that for you
because you know you want that comment
to all the power of an Australian summer
does not get up to 85 degrees Celsius
that's very hot they could probably do
more than 85 as well
yeah that's what the rating is on the
comment Oh typical for consumer
electronics all right that took a lot of
out of me and everything yeah it took a
lot
oh we have beautiful pictures yeah well
okay we're zooming out on the booth you
can see the full booth now it's almost
the same price it's 999 dollars for the
combi - oh and what we didn't tell you
is that the comma - includes three three
months of comma Prime every comma - is
gonna ship with a SIM card reactivate it
if you buy it in the US and you just
need to go in the app and you get three
free months of comma Prime we've updated
the software so the the drives upload in
real time using comma Prime
you'll be able to get updates using that
free comma Prime for three months so if
you purchase an eon two weeks ago yeah
absolutely
we have a 30-day return policy so if you
have any on that you bought in the last
30 days you're welcome to send it back
lane changes coming in the next release
boot times about the same as an eon but
you don't really need to turn it off no
battery no power draw it's pretty low
and we're gonna work on bringing the the
power draw while the car is off down
even more there will not be a Raspberry
Pi 4 version just a weak little thing
there's opie drive better with the new
Aeon there's some things that are better
about it
so the thermals are a lot better on it
your CPUs a lot less likely to trip the
throttle out you still need the obd2
connection but that just uses the power
which connects to the Panda same cameras
except IR so you guys can do DM at night
um
boot time is all the software question
we can bring down boot time and power
draw down with software updates and we
will continue to do that we're at booth
25 20 can I show you a boot show you my
shoe no never mind I can't have their
own camera selected Ricardo give
anything to add
at night
oh wait you guys know it's they say you
can't hear you guys can't hear anyone
for George yeah yeah maybe yeah you can
only hear this yeah so big improvements
I mean George only went through it but
fundraising through that so no more fun
at sticking out of the product just one
why are going inside the stock camera
the other phoebe's driver my tonight
there is is being shown in the video so
that money talked 24/7 and bigger mount
a GoPro
it's great yes yeah you you you really
want it you should buy one okay I was
saying that we said you guys annoying
emails asking what what did you want why
did you stop using this product and then
you answered and them really all right
how can we make this with all of the
things that they asked and that's what
we did check out the website if you
haven't brand-new website
it gets really beautiful
oh yeah and you can buy it with a firm I
know I said I'd never do that but we're
selling out cuz we got to make money
how long does it last without direct
power no time at all does another
battery is there a way to invest sadly
now we're a private company a wide-angle
camera same angle in fact you know we're
not even using the full angle of the
camera in the model so we'll get there
it's so as the harness but again
everything goes either under the trim or
is the device it's just one wire it's
the same harness so if you already have
a harness you can just use the harness
bone and harm the screen not really yeah
look at the beautiful video right remote
Java position we have no Java and we
have no remote we are hiring it's true
if you want to be hired for machine
learning to the programming challenge if
you want to be hired by open PI out
submit ports no poor quest on power
focused on pal yeah so we're gonna get
hired well I told you the program
challenge stuff no the Black Panthers
will continue to be on sale you can
upgrade your young with a black pant at
any time how many drivers are currently
on the road we have but a thousand daily
activists about 1500 monthly actives
will it work on GM absolutely do you
need to Siesta gree to get hired I don't
care who knows the new boy dad isn't
gonna do yeah yeah
you have an e on what's the USP driver
monitoring at night
big mount quiet fan it's just better
oh yeah leave it on your windshield no
battery what if you don't already have a
harness two hundred dollars you can buy
a harness firm install what phone is
it's the same phone it's a it's the same
way you go appropriate no flex Rea
living you unplugged in battery drain is
better with the new product and we're
gonna work to drive it down even further
so because there's no battery so we're
directly driving the battery circuit in
the phone which means you don't have to
go through the next step of conversion
so it's a bit more efficient and we
talked about it last night we can even
get it down even more
so yeah the comma to is gonna draw
considerably less than a neon if you're
just out of 30 days 30 days is our
policy upgrade kit no upgrade kit
Pacific batteries trash yeah oh look
yeah yeah driver monitoring at night the
old Yun will continue to be supported
through probably just shy of open pile
at one point out you fixed everything
that was not nice with the old II I'm
very nice product thank you thank you we
try
when's the press release going out we
did some press this morning and write a
medium post I was lazy alright a medium
post come a watt I don't know what the
comma watt is Robert you have anything
you want ad that's it yeah that's it
that's a new problem that's it that's
the new product I don't know I mean
these we still got a lot of people here
we got to keep the light room going how
many of you sold all I have been Oh Evan
that's a lot we're rich what do you miss
around driver monitoring it's 24/7
unique selling point I got you it's 24/7
driver monitoring works all the time can
you just run an external power source
without the ODB it's pretty clean but if
you really don't want to run it yeah
though you actually know it also
connects to the can down there - yeah
in-depth QA check out the new website
you know we've answered a lot of
questions on the website I'm gonna put
you right here hopefully you guys hear
me
driver motor isn't a selling point it is
because the alternative is we lag how
many can we sell for the first 300 ship
on the 20th of January so if you buy
within the first 300 your 20th of
January later than that it's first-come
first-serve we're gonna build them out
slow what is key is supported here yeah
we support Kia bro you know what that
says this is key
see I our work through sunglasses no it
can't see your eyes if you're wearing
sunglasses at night it will but I don't
know why you're wearing sunglasses at
night so I don't know how to help you
with that there better be an out
background unless yeah we'll get the out
back
yeah diem works kind of fine with
sunglasses it shouldn't bother you yes
but the battery was only a net negative
on your power no you don't have to
waiver that you under both the Aeon
stays on if you haven't driven your car
within 30 hours you have to wait for it
to boot but it has the same technology
as the black panda so it's not like you
have to restart your car ever you're
never gonna see any warning lights on
your dashboard all you need is a comma -
and a car honest 1199 total but will
comma 3 get released you know every year
bro it's every year bro oh where maybe
every two years I'll probably keep next
year we'll do like the comma to slam you
know what it was what do they all do
please continue to say awesome always
try thank you thank you
ah well I visit a emoto's booth here
maybe we'll do some live streaming visit
people's boots I are only on and not yes
you have plenty of light during the day
you the cover to the harness and power
the powers included with the harness so
if you're despite karma - and a harness
it's called the comma - dev kit why was
the old battery never removed from the
old deal and you had to wait for the new
product by a comma to
you can't sell just the case the phone
is completely reworked we have a custom
flex PCB inside the phone replacing the
battery we replace the camera with an IR
camera yeah the camera IG's yeah that's
right that's right I get the Alpha
reference graphics and sound yeah how
are sales go how many we sell so still
11 Oh shop link on Twitter merch Lincoln
bio oh yeah no one's bought with a firm
yet if the comment who dies from leaving
it out of the Sun is there any kind of
warranty so we have a one-year warranty
on the device so yeah if it it shouldn't
break from leaving in the Sun yeah we'll
fix it ships January 20th we got we got
a firm order we got our first two firm
order that means 12
you knew you made the right move by
waiting some time waiting pays off this
is gonna be around for a long time this
is really 1.0 hardware can we use driver
motoring all the time you can change it
to do that how many users nowadays it's
like a thousand dailies 1500 monthlies
features have come to give a coupon now
get out of here with your coupon
features of the combat oh we got a big
mount check it out it's a big solid
mount we got odbc with an integrated
panda we got IR LEDs and an IR camera a
driver monitoring night you guys can see
one on one it's on runs the same
software what feature would make one put
another hardware I think this is 1.0
hardware the software is gonna need a
bit more work how long will you gonna be
supported yeah we'll see see if it gets
annoying I mean you know it's all
hardware right well we'll phase them out
gradually but you know we are consumer
electronics company this is what we do I
am sitting on the floor yeah even though
I have an installment Union you did
purchase a common prime so how do i
repair the new combo - I'll know what
that means
steering mods I mean we didn't release
any steering rods but check discord bro
how does upgrading work for 30 day
policy that's from what is it from the
day you from the day you received it so
from the day you received it you have 30
days to return it YouTube thinks of the
karma to videos targets were children
excellent we love making child-friendly
content here at calm a I this is a
Christian channel you can have one of
these one of these can be yours if you
pick one up in person no we're not doing
in person that allowed to sell things
here he and Nero go to just comment at
AI and you can check how to update the
comma to do a new version automatic
updates over Wi-Fi or if you have comma
crime of course comma Prime no trading
program planned
Andrew hints thank you thank you
it's it's really pleasant to just leave
it in the car what's the biggest point
behind no battery because the batteries
are terrible and get puffy is
right-hand-drive supported that's all a
software problem
yep it will be all engineering is these
work these were designed and
manufactured in California that's
America for fur fur for people watching
like that that's America why did you
spend four dollars in black pant I mean
you have a black pant it's a great
product remember also that you it's 200
G per on your comma to because you don't
need to buy a harness you can reuse the
same artists that you have with your
black panda we wanted to offer an
upgrade path for eons but then we add
all these sick features to the comet to
so you're gonna want it if you use the
black man for something else absolutely
you use whatever you want
ah what's the second-best feature on the
comet to over the year on the driver
monitoring the driver monitoring 24/7 if
you're afraid you might fall asleep at
night get a comment oh because they're
trying to make money in lie to you I
would never lie to you I always tell you
the truth the whole truth nothing but
the truth
harvest the parts build a franca karma
joke
Christianity Christian channel Christian
channel bros oh yeah how many myself is
it more you boy you're mid-december yeah
you can return urea and get a
complicated I was like well still 12
what are we getting Maps I don't know
what about talent points they exist are
we adding more cameras radars and lied
ours
no lied ours lighters are stupid we can
go on the lighter is stupid to her
around CES yeah what new hundred we're
never gonna tell you in advance there's
gonna be new hardware no company does
that you can't pay for the comment with
your common points you need a different
angle mount will release the mouse stuff
open records car accidents absolutely
every feature you can want no but level
two is a spectrum level two is a
spectrum that ranges from TSS P on the
old Toyota's all the way up to open
pilot 1k a harness isn't included no
that's the brakes folks that's the it's
999 the harness is $200 more can you
recycle the black pan to hardware I mean
you can sell it what about the level for
potential company your tweeted it don't
take everything I say seriously navigate
on open pilot yeah and not anytime soon
so I think the Chinese will come with a
knockoff product yeah but it won't be as
good these are actually a lot harder to
build the deals because you have to take
the phone apart remove the battery
change the camera we have a custom flex
PCB in the phone that replaces the
battery dashcam integration has a built
in dash cam it's pretty good it's in the
app now it's actually usable now as a
dash cam I can't believe how responsive
Nick and support is to my emails
I'm getting thrown as quick as I can but
the Wi-Fi is slow here so I am getting
back to everybody to wear it Noah he was
serious his actually I think was gobbler
yeah
13 plus orders any need for faster CPU
or GPU we're still a long ways so well
oh the other thing that makes the comma
to better than the Aeon so remember with
me shipped big model on the e on and the
young kind of crapped out that was
because the eon was hitting its thermal
limits the comma to has much higher
thermal limits than the eon you can push
that chip a long ways if you don't have
thermal you know we under clock the cpu
to deal with thermal and on the comet to
we can think about about clocking it
again
a watt phone it's a lex 720 is it a
hundred percent self driving that's not
real brow fit wish your car was
supported me too it's becoming less and
less of a phone now how can you bring
mobile uploads back maybe maybe I'll
think about that what brand of fan any
one of the brand of fan
brother it's
in China somewhere um they're really
nice fans though they have they have
they have four wires to for power one
for pulse input and then we have also a
tachometer so unlike the EON we can
measure you can measure from the
software how fast the fan is turning
we'll never be better than autopilot
I wouldn't wouldn't say that harness for
GM we don't have it yet future RGB
support I don't know what that means
you're brand new explain it to me like a
five-year-old buy one of these read the
website benefits of the firmware what
firmware traffic light detection and I
don't know what I have GTT means if this
than that
Oh in savings kill people future
external cameras no Mazda support maybe
no more cameras fan is dead silent will
your job at your Sony car not for me
ship to Malaysia yes we ship worldwide
open pilot is smoother for me than
autopilot see that's what I'm saying
don't count us out of the combi two has
no battery and no mobile uploads
oh no no so just because it has no
battery it connects into your car gets
constant power from your car yawns are
still you know the stolen story yeah
yawns are still available to store same
price nothing changed
can you just connect the Prius TSU you
can you're going to need to enable
that's community feature and be aware
that does disable your autonomous
emergency braking will I sell to test
that for 10 billion yeah absolutely
wanna give you ten billion dollars I'd
do anything for not anything but yeah
10 billion 10 billion is the price where
you know you just say yes but smaller
amounts money you gotta have integrity
right for small about somebody have
integrity for 10 billion say yes
can you send a fake email that you're
replacing yard for free for my wife
we're on it see this is a Christian
Channel I do find that humorous though
is it based on a OSP could I root it
yeah the stuff to build the androids all
open-source
you can change it it's already routed
you can SSH into it if you have common
problem you can SSH into it from
anywhere what car should I buy
I want to Priya
that's a pretty good choice I check out
go-to compatible cars on the website the
Corollas bet at our choice I'm gonna
torque mounted civics real nice
no no no it's I'm making fun of
PewDiePie with the Christian Channel
thing a lot of track to meet our unicorn
goal I don't know what do you think our
valuation is we don't raise the money
again because we're gonna be profitable
because you guys are gonna buy so many
common tools the EON is missing on the
shop overview page and there's no link
for this is not it's only like the Deaf
shop ok the least over say we'll put it
in the Deaf shop grey panda
compatibility so this is a built-in
great Panda this has a built-in GPS and
one of the beautiful things about this
is finally and I know you guys always
ask and it did start to become a problem
the GPS antenna is a fixed distance from
the camera now so we know if you have a
comet - exactly where your antennas
replaced with respect to your camera
which is really nice
can you get a special edition comic - we
weren't thinking about making green ones
in honor of the Fallen comma one future
Kia Hyundai Genesis they should be how
do you hook it up to your 17 volts I
don't know how people are doing the
volts to be honest this is the black
velvet - comes in L color any color you
want except if you want something that's
not black because it's only black so you
should buy one cyber security
innovations I don't know what that means
free t-shirt with otter no free t-shirts
I'm sorry about that oh yeah I like that
yeah we'll do a hoodie at a random order
or two hoodies random order yeah that
sounds nice yeah cuz we never have to do
it cuz nobody old no no I will make sure
to actually do it I would lie to you
guys
Christian channel postive you're the one
who gets it that's right hoodies are
real volt is very hard now good luck
roll the diver hoodie we will roll the
dice it's really printed but the 3d
printing is becoming nice yeah yeah
tell them Alex we shop today if I won
someone will get a hoodie in there by
today get ot will tweet that civics
better the Prius in terms of steering
motor Oh 12 I get a hoodie a DM for
right now drive country it's a software
issue it's actually already in read the
code in monitoring D you can just
comment it out it should work yeah just
bought one year so I'm talking about
volt is super reliable a seven point one
will come out
so these ship on the 20th and we have to
ship 7.1 beforehand
resellers yeah if you want to so what we
do for resellers is we have bulk water
pricing so if you want to buy like 10
comma 2 is contact us will give you a
good price if you create a customer on
board its bootloader unlocks you
absolutely everything is unlocked what
else we got what else we got oh man I'm
losing my voice
- I've had a cold it took to day quills
this morning really dries you out I
don't want to slice of pizza so bad
right now thank you
can you make harness inside yon - it's a
difficult to fit it that's problem oh
you got me on chicken where Oh sick I'm
gonna eat orange chicken on stream
mukbang mukbang virtually Chris yeah
those are some good insulation videos
virtually Chris made the installation
videos orange oh this is the most
conference e food I've ever seen take a
look at that oh yeah conference salmon
oh the wobbles much less with big mouth
it's put free driving to ones 1.0 comes
out what's it
convergently Claire's a free one
virtually chris has had a comma - for a
while oh yeah
I love eating bye-bye simulators good
comma powers required on all cars yeah
thank you thank you
[Music]
food oh yeah yeah we're gonna get one
fast super combo model super combo model
in zero seven one lane change in zero
seven one exclusive on the comet - and
also the Aeon shout-out to virtually
Chris make me coming to videos super
impressed wait
200 miles watt no no we're not giving
away free climate 200 you can make a
video but we love videos but the old
free climate twos there's an exit in
change my ways no no don't change
highways that's the road
no freak sama twos no precognitives but
we will give a free hoodie to one person
who are expecting
how much you make from a firm we lose a
little bit on it for so what is the
comment to happen to be with the hoodie
any plans for automatic lane changes
yeah you'll see it I mean it's not
automatic its assistant yes it comes to
a complete stop in poopy traffic and
resumes depending on your car but most
of them yes one of the orders Wow 20
orders 20 and we'll BMW get from a I
[Music]
guessed 54
hmm if they buy a hoodie do they get a
free comma - no
oh the cg6 mistake it was a mistake we
learned a lot from that we little often
supercruise eating the stream people are
dropping off they don't want to see me
eat how do you determine speed from
video wouldn't you like to know when
will we move aqua highway mo I'm not
sure I think there are bloated
organization will by the Yandex team
know what AOSP is open-source all our
Android is open source as well
any details on know
come to this beautiful box
I don't know about the machspeed oh yeah
I'll spin the box
custom foam go around zs boobs and judge
big TVs Tyler will do a seat yesterday
but now right now I'm tired and a
bungling at CES dream later absolutely
yo you know what's here that's crazy
life-sized droves
alex has hat is crazy Alex wanted more
comments from you guys on the on the
stream brevin says either lives busy
just bought please include hoody in
order six-four six-five where's Andy
Andy's in Boston
vendors are fingerprinting problem is
supported on comma 2 and black Panda and
will be coming soon I think it's a lot
better than stock ACC who's on your
board me and that's it
you never give up control your company's
kids because they'll sell them out to
Wall Street I'm eating chicken pie from
America should you get black pan if you
gotta come in - no if you gonna come -
you don't need a black panda built in
its built-in there's a panda built in
their custom engineer great engineering
well dealerships offer dealerships are
welcome to we have a great discount
November of last year 30 days is the
policy 30 days is the policy I mean this
Apple let you return if you bought the
previous iPhone before the new iPhone
comes out they love till your customer
demographics I don't know them just
bought let's go it's what I like to hear
guys stop being so cheap you know what
guys I'm gonna be honest with you if the
comma - doesn't make this company
profitable no more common AI so y'all
gotta buy them no pressure
I wouldn't do that but that's true but
you know I wouldn't do that this was how
I feel its food America's profitable
though if we sell the same number of
eons that were selling comma twos I mean
if you would buy neon why would you not
buy a comma - it's literally the eon but
with all the bugs fetched it seriously
1.0 hard right yeah I'm very happy with
that this is a good product thank you
Alex wants me to remind you we're
shipping on the 20th of January I'll get
your order and soon because if you
missed the first 300 it might be a
little bit before your ships
you just bought a 400 all black panda
what so it's really only $200 right 200
is the harness you can reuse the harness
from the black panda to the EON I'm Duke
on it - I mean when not looking for UX
designers we're open power engineer
research engine how long have we been
testing it a couple months now I think
we started and we got the first ones in
November
you got these with your owner now you
have to wait longer for shipping and not
sleeping while driving how much can you
earning Commission's we don't have
independent sales reps we don't have
commissions if you want to do that you
want to buy ten I think we give you like
15% off of you buy ten so by 10 cell I'm
at 15% infrastructure DevOps sre that
might be the open pilot role um if
you're interested go request open pilot
last six months bought it yon white
panda black bear not sure you can
justify buying - it's not for everybody
it's not for everybody
look the Aeons gonna eat all of open
fire on 0.7 you're still gonna get I
think you'll get 0.8 as well you
probably even get 0.9 1.0 is probably
only for the comet tail
how did fresco pretty well yo we were
driving this morning and the only just
engagement we had on the route was an
accident that happened right in front of
us I know like this guy just like zipped
across two lanes and actually the thing
probably would have done the right thing
but I didn't want to find out comet -
will support one point out yes the
DePalma - will definitely support an
open pilot one point out tell you what
yeah Alex do what you want to tell them
you want to hold em so I can eat for a
minute yeah we're happy to do kress tell
your favorite YouTube streamers and tech
reviewers but they should review the
comma 2 is about that we might have room
for another demo while we're here so let
us know Chris Andrew furiously working
built the website Nick's been amazing
building the comet ears it's got a lot
of time building to come it too so
hopefully everybody likes it we're gonna
post a post a picture on Twitter so you
can see all 300 of them sitting in the
office they were amazing team has been
working around the clock to build the
comet oohs very excited to share them
with you guys there they look amazing in
the car
yeah if you bought within the last 30
days just send us an email
Greg's not here Greg at Georgia cancel
your order new me
I know we missed you hi Greg Morgan
George about a jerk he's so hungry man
those rice all right we have 382 viewers
anyone have any questions send one to
Linus tweet at him where does one get a
black panda the black pendant is on the
comic the car harness page
well panda be upgraded with EP 32 ever
how many hours in workday it's been
non-stop 1260 when is George talk George
talks all the time we're gonna do some
more live streams from the floor George
will take you guys around and show you
show you see yes you can see we're back
here at booth 25 20 if you're in Vegas
come by I'm trying to convince George to
maybe drop some comma twos off on the
drive home no the software is not ready
pama tube in zero seven one will be out
by the time
just on the 20th show us a full-size
Android any plans stopper money no
there's a second market for these if you
want to sell your comment beyond and buy
a comment to you
even Apple partners with somebody woulda
trained us maybe somebody should buy up
all the Youngs for cheaper and then they
didn't resell them in like Africa where
nobody knows about the combat Oh any
other questions
thanks guys just 374 people still
watching it have any questions for the
team was 0 7 1 leak them one do you guys
talk about what happened did you talk
about they know about the super combo
any other questions
what cars for the demo specific and the
case be 50 why would you know it can be
put its model that combines all the sub
modules that we had in the past together
so we have you have the driving model
the calculation model all combined into
ones and yeah it's more powerful more
than you like it
B&W support its its own flag so it's not
linear for your day we're thinking about
you you're in our minds
the same way ynw Mele had murder on his
mind oh that's the point where for kids
it's kids friendly contact comma twos
are for everybody with the driver's
license so now our epilogue at CES I
sure hope they didn't spend their
seedinvest money on that is that playing
for new merch shop Alex you guys if you
buy out all these new merch if you buy
all the comma twos we'll get new merch I
think that's a good China yeah we can
sell 300 of these Oh try 5,000
Hyundai Kona eBay let's say no he might
be supported for his end of life of
tamil one well comma one never existed
so never yeah 2016 was the end of life
what is this temp limitations on the
stock eon don't get it too hot it's
happy when people are happy no discord
that's amadhatter i you should go check
it out
let his end of life a panda Neos soap
and a neon are no longer you want to
what do I have to do it who wants to do
the recap
[Music]
business connections its back down they
make LTE modem
[Music]
just tuned in alright you want to recap
go to comma dot ai and leave the website
go recap
ah my recap is cheap yes yes you can use
your currently installed harness for the
comet to it to say oh the comma business
card yeah you'll remember it bro
just take a comma and just think a I go
the new mounts am i a celebrity I am
famous people have said that about me
yes look at these new mounts big GoPro
quick recap all right so we're kind of
AI we developed software called open
pilot open I can't say driving uh
controlling your car in limited
scenarios with a lot of legal
disclaimers but it's actually really
good our slogans make driving chill if
you want to make driving show you can
buy a comment to this to come back to
this is our new hardware it's beautiful
it's got a big screen a big beautiful
screen it's got an infrared camera which
is watching you
you can junction with these IR LEDs to
make sure you pay attention it's got a
custom engineered fan and heatsink
solution they buy some company in China
but it's truly good it's got four wires
so we can measure the fan speed dead
silent can't hear it and it has a built
in panda has a built in black panda act
like it's black because the case is
black built in black pants called the
Muto stuff for cancer and tears
it's got battery replacement circuitry
and unless an antenna right here in the
mountain s
thirty hours of no drive-in yep oh it's
designed to live in Cooper it's designed
to live in your car when radar control
sensitivity be reduced yeah we'll fix
that there's someone we already fixed
that internally all right if I see
anything else any other questions people
rename the uno two dos for historical
reasons its people no although that
would make a lot of sense we're not
working on flex ray you can't get a free
comet - what's the focus of 2020
end-to-end longitudinal and stability
stability stability stability and growth
and profitability so make sure to buy
them you recently bought an e on if it's
under 30 days you can return it just a
package it all back up nicely set
everything back we'll give you your
money back and then buy a comment so you
get a better 3d printer these are pretty
nice you think you're gonna like we
think you're gonna like them we've so we
did a bunch of things to improve our 3d
printers we put them in a big enclosure
alternative uses for old yawns yawns
make great door stops yawns make great
gifts for your cousin's who you kind of
feel like this about eons can be taken
apart and used as a 2016 era smartphone
well I'm really I'm really savage on the
Aeons now wow yeah now it's best pretty
savage like if I was like a real company
and someone gave me like like if I used
about how I'm supposed to talking
through the are things I'd never say
that like honestly I don't know why
you'd wanted to yawn by comment okay
does it have wireless charging no it's
just a battery oh did you drive here
Molly yeah three three months of comma
Prime the included that's a $72 value
what do you get why you get with common
crime a lot of good stuff you get one
year of drive storage you get remote
access to your car
anywhere you can if I had my phone in my
pocket I could show you we can take
pictures of the cars anywhere that's a
great new common products you're talking
to check your battery voltage watch your
dog in South America yeah I'm a prime
she'll Vil yeah if you want to purchase
common prime how do you do that you
already have your credit card on file
because that's how you activate we're
just gonna automatically bill you
connect app download the copper connect
app right now it's on the Play Store
it's on the App Store it's common five
available in Canada only without a SIM
cards you'd have to get your own is it
legal in North Korea
they'll have to ask Kim Jong hoon how to
connect to GM you'll have to ask B
tasarov if he's still around maybe Kim
jong-eun no comma to is an appreciating
asset absolutely this is no this is the
introductory price you guys know when I
say prices only go up I don't lie do we
ship to Europe yes we ship worldwide $30
flat rate you're responsible for all
custom fees because I'm not your
government on impasse those fees what
type of smartphone is use don't worry
about that you'll never think of it as a
smartphone it's fairly costume yeah USB
to obd2 buy a panda old sweep and a
white one it's just the North Koreans
called combi - yeah all right can we use
the same artist that Yan absolutely yeah
it's the same artist in the black panda
so if you already bought a black panda
is half of that money you can just reuse
and save that on the compet to come to
monitor your words it sparked what do
you mean by monitor you can get pictures
on your phone to come on
to be a veggie boss long you got to do
it yourself can I install the Aeons in
Europe for free uh yeah I don't control
yo you can do whatever you want for free
for whatever price you're denied your
device you do you want for it Brazil
yeah how fast we ship out everything
else I can ship on the 13th how much is
your gonna ship on the 20th it's more
advanced to the galaxy s 11 I don't know
about that in the commentary yo dole
wall drive it I think that's a good end
of question question Donna will give him
a few more minutes out you seem like
you're in the rise look we still have
like three hundred forty two people here
we can't let him down guys if all 342
are you bought no retweet on the twos
right now did I try the Honda bond we've
had pong oh they like your rings common
crime is not available in Europe it is
but you have to get your own SIM card
this is a kid to twitch my Michelle like
it really is I show for all things prime
does it have a JTAG court know how many
have been sold a lot wise Alex in a rush
[Music]
I stuffed my face at the Aria buffet
last I was pushing like my stomach was
out to here guys not even exaggerating I
think it is too but costs like 50 more
dollars
the only the Aria buffet had oysters I
was happy with the oysters the sushi was
really bad the pokeball was good
what press tried it we did Roadshow and
VentureBeat this morning
what hotel we're staying we got a condo
we got the Vegas office of comedy night
the new model of Trent after thank you
thank you
common or mobile I trifocal will
consider you can't buy a bubble I Drive
boat because globalized windows Tesla's
Apple and we are I lost money gambling
last night what I'm going to talk about
but Nick made money and now it's made
money so everybody made money oh I bet
the don't pass line it's the best odds
in the casino and the table hates me if
the iana comment to have the same
hardware why wouldn't you be phased out
before the competition if you have any
on with a black panda it won't be if you
haven't gone with a white panda the
problem is you don't have the the GPS
the thermal solution in the combi 2 is
also a lot better 0-8 probably will be
supported I make no promises about the
future the only thing I will say is that
the combi 2 will definitely support
version 1.0 can I switch the camera yeah
but they like
[Music]
you have our community videos you guys
have good videos post them on the Gaspar
video channel you have a few days a mare
teams just working
SiC chargesheeted applause so many
supported cars right now dory we didn't
forget you community maintain and
butters what's expected 1.0 stability
stability stability
Janee the developer harness for kia
right now yes and if every one of them
just bought a comet Oh seventy three
hundred forty four thousand dollars we
can buy a house oh one more reminder
about affirm oh yeah if you guys are
like wow that's a really high price you
should feel like a good American and
spend to be in debt with a firm look
don't get in debt you guys I trust
you're smart enough to make your own
decisions we did offer a firm we do
offer a firm if you'd like to buy with a
firm you can pay monthly yeah but I feel
bad shilling for this does not want
people spending and down the glacier you
got me in debt for your shit that's your
choice Ben you got to make your own
choices
that's about freedom that's about being
an adult I need to start shelling for
Defense College hands just purchase
common to without a harness know if you
already have the old martes it's exactly
the same um this is an appreciating
asset I wouldn't really focus on it as
an investment but we do raise the prices
so like if your choice is like if you're
gonna buy it and thinking you're gonna
sell it for more later yeah probably not
but if you're gonna buy it now because
you know it's gonna cost more money
later yeah that's a good idea because
it's gonna cost more money later so
those of us have any late can you have a
recap this is a comma to so over there
you should buy one at our website
comment on AI check out our new website
kind of new website we have install
videos it's all easy Fatlip in
what I got some funny ones home talking
through the party like my name is on the
bedtime in Europe all right
would I host test drives if you're
famous or you have a large outlet is the
driver cam customer off-the-shelf it's
custom we have them made at a camera
factory in China Yan with white panda
will get dropped soon yeah gray panda a
little bit longer I think white pant is
gonna get dropped in 0-8 who we ship the
localizer a great pant is gonna last a
little bit longer
black Panda + E on should last a long
time the only problem is the driver
monitoring so we're gonna see we're
gonna see if this becomes a problem you
know a few people have fallen asleep and
we really want to prevent that and
that's one of the reasons we're really
excited about the ah the driver
monitoring operating both day and night
yes shout out to Asia we made Black
Manta plus e on what white definitely
won't support him young be made with a
remote screen no remote screen test
drive me I'm as famous as you if you
come if you have like a channel if you
like a channel you want to post
something on we could never do it
we were for supper updates I can't force
anything on you
what does open pilot what oh we lose
them to connect internet time we know
it's gonna be 30 days I know you guys
complain what does open pilot have the
autopilot does it what does linux have
that mac OS to us it don't compare us to
that compare install the less to which
is what all the other cars are running
kona electric if you make it support
that i don't know anything about iran
driver monitor yes very important very
important
you dumped test the autopilot what does
that mean how do you test about it isn't
it just like you're talking about spring
you chose to share this heavy frame
oh we don't have any you know I did
measure the comma - if it's a sec sauce
it's six and a half basically inches
wide it's the same size except the
stupid mount isn't up here it's back
here it's a stealth mount the mounts
completely invisible when you see in the
car it's great in the car yeah do we
ship to Iran I don't know we learned
that we can't ship wide ours I don't
think we shipped to our round sorry no
we can ship light ours but I don't think
we ship - I'm sorry about that insurance
companies offering a discount for usage
but they don't seem to be upset if you
are using it so that's good how do you
get driving data people don't know opt
into prime Wi-Fi
I see more tired than usual I'm sick
guys I've had a cold for the last week
prerequisite to install an e on a brain
ah fitness fitness stack that's what I'm
talking about by comma twos oh you will
love large GoPro the new standard large
GoPro it's great on your windshield you
love your black man except if you love
your black man to set up keep it if you
can't want to keep your existing
insurance provider keep it and I meet it
we ship to Africa sure unless you're
like on one of the like export control
countries they're just somewhere nice
like Ethiopia will ship to you look at
you GOP laughs yeah we got custom cover
drops suits
show the back doors gonna model their
job
FES you will need to delete tesla
Tesla's not our competition our
competition is legacy automakers sorry
why it's coming summer it's a lot faster
now queue logs and cucumbers making a
lot faster it's common insurance coming
insurance is boring guys I woke up one
day and I'm like George do you really
want to make an insurance company and
the answer was no oh there's no switches
there's no switches on the harness and
there's definitely no switches on the
comet tail Elon shouted us out whoo I'm
how its functionality different offline
versus online offline you get updates
you get dashcam being sent back to the
cloud one year of storage now if you
have come a prime stealth murdered a
stealth mount that's right
one woman localized reprove 0-8 I know
the bitrate slow well that's the
trade-off you want fast or do you want
quality
let's pick three jumpsuit in order 300
yeah if 300 still happens it comes
around again what is the comment still
one plus it's based on a leaky Cola pro
three but it's fairly custom to help
like open the phone up we take the
battery out should we replace the camera
can you get a broken Tama for research
you can buy a comma and then break it
and then you can do research on it yeah
they all work you want quality well you
can get quality just probably explore
any I fired the exploring cabana guys
and wasn't getting the past hour so it's
never gonna get better now it is open
source wide replace the camera because
it's infrared it can see in the dark at
night just like in that Paramore song
about castles even in the dark as IR
yeah driver monitoring is you can't turn
it off anymore we've turned that off a
while ago did you ever do Hardware
swapping no come on we're a small
company guys why you think I'm dealing
with that I think I'm dealing with like
seventeen miss shape and packages that
we're gonna like put some come on what
do I think about all the MLA six I think
they're overhyped it's only the front
camera place you have the back camera
saying ah is BMW five no we'll use
something like that in the comma three
comma two just came out we're not even
thinking about future products yet when
it's gonna happen what a pre-orders get
personal voicing for me will shout you
out if you buy it right now
am I gonna be the AVN's if someone
invites me absolutely up down let's do
it
the self-driving work offline yeah you
don't need internet connection
you don't need internet connection it
has a check you have to connect every 30
days it used to be seven but it's not a
big deal it totally works offline gonna
have to compile comment
in the 2020 Civic Nebraskan how good it
is tell me to dance really good
nada go to DEFCON any more boys more
chips in the counter - it's a Snapdragon
820 one what phone is it inside it's
based on parts of a lake oh all right
just in New York and that's why I got
sick what are the main goals for twenty
end-to-end longitudinal canceling your
own order just reach in to support will
cancel it feel free to place a comma -
you know what's with the Sony lanyard
Sony has too much money and they waited
on that you need to partner with a
rental car company and my partner with
anybody rental car companies to lock the
bottom and put them in the car what's
new the comma - its brand new it came
out today go buy one look at adding
voice control cool
you won't comment to me well you're
gonna have to wait till at least a while
it's porn until the Nvidia Jetson give a
try it's what's better about this one
it's free the website we can't just keep
doing recaps it's gonna get weird it's
gonna some people have been here a long
time they want new fresh original
content auto resume supported bro if I
knew things like that off the top of my
head no we're not level four we're level
- we're proud level to be proud level to
proud levels - why such a slow chip
chips plenty fast guys my tech civic
stuff is so slow to accelerate if you
need car it's pretty fast what's your
email George at comedy I will your
wheelchair support it that's why it's
open-source your PIN tweet is still car
horn so we got to change that oh we got
to change up in three days
image oh nice did comma already sell
lighters on ebay no we haven't sold them
yet
Volvo's in our booth right now maybe
they wanna buy some light off um where
did Sony's CAD currently in the TV
market I don't know everyone the
livestream I like that recap the recaps
alright yeah so there were recaps what's
the longest trip made without
interruptions who knows we did check in
our data I think it's probably something
like four hours might even be longer at
least if you ordered the car odors in
the last 30 days can you get a 200 our
refund well if you order anything within
the last 30 days you can send it back it
hasn't even shipped it hasn't shipped
our lines are better tar lines better
the super combo model why is there a
weather vane behind these they make
weather vane wait what happened
oh yeah yeah yeah and they're like how
do you doing this how good do they want
to buy some data also update amazing
I'll sell your data guys we should have
like yeah we didn't but that
will sell you you want to buy some data
are we still honoring Aeon warranties
yeah the TVs are not playing for Cabana
I know what's a release date for the
comma three yo that's like comma two
misspelled it that's like saying like yo
but I want the iPhone 12 where's the
iPhone 12 coming out I bought an iPhone
11 you should buy a comma - alright
okay I think that's the stream guys
thank you all for being with us on this
incredible journey where you're here a
you should buy stuff so we can continue
this incredible journey by comma twos
tell your friends to buy comma twos
you're gonna love it it's really a great
product if you could download a comma -
we would love to make that possible link
you pre-order you can order right now
it's not really a pre-order it ships on
the 20th if you're in within the first
300 we already have the made we just
need to do some final tests on them want
to make sure that your comment - works
great we're putting them through a big
QA thing I did not good comm I'm still
right here thank you all for joining how
many sold we're gonna keep that a secret
from here on out but I will say it's at
least 20 if you want to invest in the
company you can't because it's private
and you can blame the SEC I would love
to make it possible but all plug lay is
to follow me on instagram at george hotz
that's right that's right
keep up the great work thank you thank
you very much it's nice having you all
here today and you'll see us from seat
yes we don't map shit cuz you don't need
Maps you just need eyes alright okay
all right we're live oh no my
massages my massage is very relaxing
yeah that's good yeah
hey hi everybody
all right guys it's the moment you've
been waiting for
for a year
this is open pilot 0.8
now you say what's different
well where's the stop sign right now
look at how the path is going watch what
happens when i go
the path comes back it doesn't stop at
stop signs yet
but that's just some of the potential of
the new
high torch model this model is
completely trained
in pie torch see it's stopping again
from the stop sign
don't go there's a car now you can go um
and we're gonna get on the highway and
we're gonna engage
of course engage here go drive for a
little bit
great of course
going left here
um so you know there's no 90 returns yet
we're not so tesla full self-driving
but um does the model support them
well maybe take a look
that's pretty good yeah the last
remaining issue on zero eight
was um the model x and
the model lags are fixed last night
we discovered that gpus have priority so
now the model is the highest priority
thing running on the system gpu
yet the ui is still pretty smooth as
well
so we're in the hyundai sonata um which
means we only have lateral control
not longitude uh so we can't show you
the absolute best feature of the zero
eight model which is cut and detection
but if you have a honda or a toyota with
longitudinal control
you're going to get that when you're
updated to zero eight
uh so zero raid is in what's called
devel right now
um devel is where open pilot releases go
before they end up in release
i'm just going to take control
kind of aggressive on that turn um so
yeah i mean you saw that you saw that
left turn back there why can't open
pilot make left turn the salt torque
limits on the cars now
uh the model is probably capable of
doing it you'll notice here there's a
red line on this wall
this model also detects the edges of
roads which is going to be very
important
when we start to move into mapping
[Music]
navigation
so notice that the puddle detects four
languages one
two three four i feel like the count
[Laughter]
but uh yeah it's gonna engage right now
five nice beautiful san diego sunset
[Music]
uh and this is coming live
to your commentary if you have one
and if you don't have one there has
never been
a better weekend to buy
all right so well well
you're gonna have to announce it because
a comma you know we have two divisions
we have the sales go up division
and the sales division which tries to
make sense right
i'm the head of the sale the prices go
up division yeah i'm the head of the
prices go up division
and we try to raise the prices on
everything every time every time
that there's a price i'm like why isn't
it higher
right but alex over here is in charge of
the you know being a
real practical company division and uh
i think you might maybe have an
announcement for the people
it's true yeah first first hi
everyone um wait before i announce the
sale
i'm very excited about our new merch
which i'm wearing can you get
background oh yeah look at that it's a
new hoodie
are they on the store they're in the
store wow how much
well right now they're eighty nine
dollars yeah that's so cheap
get em before the prices go up you know
they are gonna go up
i'm thinking 1289. they're higher
they got a line oh they're really nice
let's see
can we get the front somehow it's just
as a common same it's the same
there's a soft hoodie but the back the
back it's nice
you see um honey
i don't know if we can use that logo
it's parody it's all satire
the par 15 the hoodie is parking that's
correct
um i've new hoodies yeah and
[Music]
really really what you've all been
waiting for that rivetage
that's insane that's really nice
it's so good so solid who was talking
about ping pong no no but the
announcement we got distracted sorry
sorry it's just too good it's too good
um i think we have driver monitoring to
prevent real distraction
um we're doing a black friday sale
starting today early for our
comma fans to the live stream we're
offering a hundred dollars off the
purchase of a coma too
and for all sales between today
right this second and
friday evening the end of day friday
we're offering a
very exclusive kama beanie which is not
for sale in the shop
to get a freebie you're telling me you
get a hundred dollars off and a free
beanie
that's correct did anyone from the
prices go up division has to have
anything to say about this
i could lose my job wow wow
there's gonna be you know it's a big
deal we don't really put the common two
on sale very much
um if at all i mean we might i don't
know when we'll we're just sales have
been so good
it's hard to imagine guys offering
another video let me tell you
let me tell you a real story wait are
other stories fake
i don't know this is just like it's a
restaurant for my childhood oh it's a
george johnson childhood story i'm
getting nostalgic growing up
in high school i loved black friday
oh george loves black friday it wasn't
thanksgiving thanksgiving
you had to grin and bear with your
family and then you know
you get the boys together and you're
going to a shopping mall
to camp out i'm from jersey i love them
all
from bergen county been blue logs so
best buy wouldn't open until
seven the next morning so we'd get to
the parking lot
at like 10 p.m we'd all camp out i
remember this is the first time i think
i got drunk
we stole a bottle of wine from my
parents pinot noir we're like holy shit
what if that's expensive
and we camped out one time i was
interviewed on tv they're like what are
you gonna buy
i said season 5 of friends on dvd
[Music]
can we find that footage somewhere is
that in the archives i hope so exactly
i wish someone could dig that up but
look at that this model is so good
anyone who said this model was worth in
the last while that's total fake news
yeah it's really nice that was beautiful
um but yeah guys a hundred dollars off
it's a pretty big deal there's no code
it's just it's marked a hundred dollars
off
now until black you know the end of day
black friday
yeah if if there was ever a time to get
into the common ecosystem
it's right now what i have showed up oh
look it's the free beanie you get if you
order
wait wait it's a gift it's a 69 value
yeah like that's not even a joke that's
actually how much we sold these beanies
for
a true story yeah 69 value okay
i didn't they're they're expensive i
didn't buy that many of them
um so it's while supplies last first
come first serve classic black friday
shit
um i just didn't know how much sales are
going to be and they'll have beanies
maybe we'll sell the beanie we haven't
decided but until we decide
um you'll get one with your comma too
it's packed by me um in case there's any
questions
and yeah virtually chris maybe just put
them on i already have a hat today
whoa look at that beautiful embroidery
that's two thousand stitches you guys
2 000 stitches yeah this is insane
we're gonna have to hold off on this on
this beanie for a second look at this
two road edges two lines
how smooth it is 0.8 yo the model eggs
are
it's really that's really nice
i'm kind of impressed with driving on
the model lag yeah we fixed them
it's amazing look at the but you're
you're not going to let it do a
lane change together there's too many
there's a car
here yeah this is a good testing road
this is the same road we came on with
lex yeah but we have menu
yeah you know we in spirit but like you
said it has banked roads a lot of
curves it's a it's a really good road to
show the capabilities
[Music]
pacific content would've been better
than that so the open pilot right now is
only doing the uh lateral control on
this car
uh the longitude was being done by the
candidate system are the people have any
questions
no people just enjoying guys i love
people just enjoying
if you don't have one of these yet this
actually i think this is actually going
to be the cheapest you can ever buy a
coma tool for
we have been talking about raising
prices the raising price division has
put a lot of propaganda
look at that right there if we want a
car if we want a car with longitudinal
control controller would have done that
oh yeah oh we got to get longitudinal
control on the countdown go back to the
office
and get the civic oh that was the most
beautiful cutout do people want to see
the civic
that would do with one test drive you
guys can imagine how good it is in fact
i think we're linking a video in the
marketing email because we're getting
another cut in here
wow the hyundai system could do this
engagement that was nice well
it just didn't do anything yeah
it's my uniform here you filmed the
screen over there and i'll i'll put on
the video
though but yeah so notice how
you know if the car is doing
longitudinal control if it has that
uh that caution sign on the car
um so it doesn't have it on this car
because the cars are doing that but
if you want to check out how good the
cutting detection is on zero eight
there's a youtube video
uh or it's linked on twitter uh and it's
it's it's
stunning uh i think only autopilot has
gotten detection that good
yeah all right i'm wearing it i hope
right
you look great thank you because you're
kind of crooked but in a
delightful way yeah it's in a hip way so
it's i mean it's a very nice beanie you
know yeah you look great i run out my
hair just for this
yeah i just tell it between to get it
sales in india i think we shipped to
india absolutely
we do international shipping
dollars fly rate canada usps
beautiful san diego yeah young people
enjoy driving by not driving that's
correct
what what look at that twerk wow that's
insane torque
whoa oh and look at that
right into the sun it's still detecting
the lane lines thank you
to the comma pencil people who made that
possible
that was all comma pencil right there
into our to our biggest
common pencil contributors we have
hoodies for you pj lau
special shout out you did so much for
this project those lanes
totally wouldn't have been detected on
the old one we have some special stuff
for you guys
thank you for contributing
yeah common pencil people are the best
wow it feels so so much better about the
model x
so nice so nice i'm like shocked yeah
right
look we're engaged in this i want to
tell them about all the other things
we're doing but i can't
oh yeah no we don't talk about any of
that stuff so many secrets you guys
zero a black friday is the hyundai going
to detect that not bad
see on the civic if you were in stock it
would just like run into any stopped car
even if you're going like 25 miles an
hour it's terrible
such an upgrade yeah
oh yeah i mean this car doesn't really
need the longitudinal it's not terrible
uh the civic really does and that's why
it gets it
look like the placement is human on this
road
it's such a good way to describe it look
it's dodging the cones a little bit
incredible it's really something else
yeah
so our red lights and stop signs coming
soon yeah
yeah no we're really gonna do it
shout out by vivec
oh you replied he's interested yeah all
right
good stuff so reminder a hundred dollars
off a comma two
um and a free beanie while supplies last
this is actually the cheapest you're
ever going to be able to get this far
yeah
we want big sales we want to impress our
investors psych
the investors don't give a shit about us
the board is putting a lot of pressure
on
us oh well that is true the boys a lot
of pressure
[Music]
you guys have no idea
it's just so good look at how it moved a
little because they want to get too
close to that i don't want to get too
fast
um any questions what do we got let's
see
someone said can we combine eon trading
on black friday sale
no they're separate sorry separate
things separate things
what happened you missed your chance in
august
yeah i mean it now's the time to upgrade
if you have the old old hardware this is
a really good price
put it this way the eon trading was 200
buy a comma
2 for eight ninety nine and sell eureon
yeah
yeah it's a great idea
for the common discord for sale channel
yeah good recommendation
yeah people quiet today how many we got
how many girls
not that much 85
they're gonna get the exclusive on this
deal that's for sure well that i mean
yeah you guys are gonna get all the
beanies no this is when this hits
when this hits uh kamehameha archive
yeah that's
that was a great that was a great zero
eight demo
thank you thank you all for watching
zero eight going to be in release
next monday so by the time your black
friday
device gets here you'll have zero eight
you'll have all of what we just showed
you
available in your car buy today
shop.com.guy and buy a hoodie bye
everyone they're really going up prices
growing up
[Music]
oh wait for some people to get in here
is that people i don't see any people
we got a person slack thank you hello
what's up
hi everybody how you doing
thank you thank you we are
live on location in telluride
colorado um
and i'm here to show to you
the comma 2 sale now it's not so easy to
use
you're gonna have to solve a little
puzzle so hopefully you guys
solve the puzzle um
yeah yeah i'm staying cool outside
california that's right that's right
it's uh
it's 120 degrees in palm springs
i have never felt so much heat in my
life
i'm speaking about things that are hot
you guys should check out our labor day
sale
it is the first sale ever on the comma
two
you can save one hundred dollars uh if
you solve the puzzle
if you don't solve the puzzle you don't
save one hundred dollars it's as simple
as that
um we'll have to repeat again when we
get a few more people in here
cheap comma two that's right you're
never going to see a comma two this
cheap again
probably till like next labor day or
july fourth
um so today is the day
to get your purchases in
um the answer is not 42. you're close
though you're close
a little higher than 42 a little higher
um so we're in beautiful telluride
colorado
um i would say 95 of my drive here was
open pilot
um oh you got you guys got to check out
this mountain behind me oh look at this
look at this mountain there's a
there's a gondola on the mountain it is
not 69 no no no
um that is that is also wrong yo let's
go let's go walk over there we're going
to go check out that mountain
um oh
we're not here to talk about that we're
here to talk about the labor day sale
on the comma 2.
can a vision-based system be better than
a fully attentive human yes of course it
can
um
is there smoke in the air from the fires
yeah yeah i think that's what it was
um but so guys you know i was gonna show
some driving footage
but unfortunately the uh reception
while you're driving is really spotty um
i'm in the hyundai sonata 2020. uh you
guys i think the story's live for
another couple hours on my instagram
if you want to see i posted a nice open
pilot picture also check out the song on
the radio
yeah that's the smoke right we are still
hiring uh email
just commenting i slash jobs or email
give me a job a comment ai
we are aggressively hiring but you got
to be a genius because that's the rule
be a genius come work at com ai and
don't get hit by that truck
um you know if that truck had open pilot
i know
bob doesn't see pedestrians always pay
attention level two system
um yo
just look look at this look at this look
at this mountain behind us
zero eight is on its way uh
we're gonna have we're gonna there's
gonna be a little ui change up in zero
eight not a big ui change up just a
little ui change up
i think you guys are gonna love it um
make sure to get your comma two
while it's cheap uh because you're gonna
be like damn you know i should have
bought it while it was cheap not while
it was expensive
uh so you know this is hashtag ad i'm
being paid by comma to do this not
really
now i really don't get paid when
i'm traveling but other than that
um i wouldn't chill for a product that i
didn't really believe in
you know that you know that you know if
i wouldn't drive out here with my very
own karma two
uh i wouldn't be i wouldn't be shilling
for it but you know i love road trips
and it's really a nice um
companion maybe that's the word
companion
uh yeah so we can't make this live
stream only five minutes we'll do like a
couple minutes of questions and then
i'm gonna go find lunch hopefully
there's lunch
i hope there's lunch driving through
arizona there's no lunch
what's up um now but today
uh one day only get a discount on the uh
commentary you're gonna have to solve a
puzzle
um and i will give you guys a hint right
here just in this live stream
if you want to know how many cars open
pilot supports go on the github
and count them count the number of rows
and the tables
uh count the number of rows if you guys
didn't figure that out
oh how's museum driving coming along
it's all right that's all right um
hopefully
we made an offer to someone on friday
hopefully they accept they're going to
come help with the
new zero driving project uh this isn't a
life advice stream
this is an ad for the savings
on the comato uh just today today only
you can save
100 you know
figured since this labor day you guys
know i love america
um if you're near by omaha hey reverend
no i'm not near omaha man i'm in
telluride colorado
uh you want to join with rotterdam we no
we don't do research on rotterdam open
pile team at rotterdam
research team in san diego
yeah i know once to solve driving you'll
have an institution with the general
ability to solve problems i pointed at
next
world hunger nah nah we'll point it at
you know what we're gonna point it out
we're gonna point it at the uh
the greedy bankers man we're
gonna we're gonna all day all week
occupy wall street but like you know
good right
does that sound reasonable i don't know
i'm here in colorado we're going to go
walk off
over over going to walk over a bridge
over we're going to go walk over bridge
great place for corn on the cob what do
we got what do we got
uh 2020 rav4 prime i think i read there
were some issues with that but i'm i'm
sure they're software not hardware
um so we could just
fix that someone can fix it you know all
the code is open source
it was always one thousand dollars
except for today when you can get it
for 8.99 if you
uh use the discount code yeah
oh this is oh it's private oh i'm sorry
boys
we're gonna walk across this beautiful
bridge but it's it's a private bridge
so what's the margin on it no i'm not
making you know
this this is almost that cost so you got
my fingers crossed
uh no a for-profit company man uh no but
these things are real pain to make
uh i believe we do support the kia
telluride i think one of our employees
may have purchased a key italia ride
actually
uh so that's gonna be very well labor
day means we work extra hard hell yeah
hell yeah it's a day to celebrate hard
labor
um well zero eight work with white panda
no white pandas are over
bye-bye pandas bye-bye white pandas gray
pandas
gonna be over soon we support our
hardware for one year after something
new or has been solved
so once something newer comes out have
you ever seen a comma harness fail
yeah probably we've sold thousands of
them you know
one percent failure rate is sick and
that still means that like 20 harnesses
fail 30 horses failed
um yo should we ride the gondola we can
go to san sophia
and mountain village i saw a sign for
mountain village on my way down here
explore the telluride let's see what we
got
we might get on the gondola in here
gondola stream
um any more any more open pilot
questions
any more questions about the discount
who solved the puzzle who solved it
already
um no interest in gta
it's you can't we can't uh we can't
repackage it we can't run it in
uh nci carl is our main simulator
um the puzzle yeah you guys go on our
twitter
uh and you'll see about the puzzle and
you solve the puzzle you save 100
on your comma 2. you see the puzzle yeah
uh you know masks oh wait no no no this
is an official comedy
channel uh you can judge for yourself
um it is not dodrill
no some people have masks
sue me man sue me if i go to jail in
colorado it'll be like outlaws in the
old west
um oh vision ipc had some issues we're
working on it
oh you put a comment too in the car just
so you can check the answer you get the
answer right
don't tell anyone the answer uh failure
rate for c2s
uh we have a one year warranty uh
they're getting you know the early ones
had some issues the new one the ones
being built now are a lot better
um i mean you see them on discord too
remember that we have sold multiple
thousands
of them so you know if you see 30 people
in the discord
you know having issues well
it's still like one percent
looking like a little nasty
nah i've been uh listening to some
philosophy books those are the stranger
audible the stream is not brought to you
by audible unlike a lot of other streams
uh we're gonna do the trial next but
interspersed with some
david sedaris you know i can't just
listen to music the whole time
but yeah open pilot road trip um
i don't know i haven't heard grimes
argument all right this one doesn't say
private we can walk on this bridge
check out this bridge this is pretty
nice bros
no fool by randomness
but yeah humans like to see patterns and
things but they don't exist
more frequently now it's labor day hat
you remember you guys want to oh audible
speed multiplier i got it on 1.3
we are literally wired to find patterns
well 1.7 us where what's intelligent
hopefully some lunch no i won't drop the
phone
i got two hands on my phone ripping it
all right any other questions about the
sale
labor day sale i wish i wish i could
have streamed with you guys while i was
driving but the reception up here is
just too spotty and it would cut out
and you would think that that reflects
on the quality of the product which it
absolutely does not
it's an incredible product do i know
meditation yeah
yeah it's meditating this morning
is it the hat is that why i look
different i'm wearing a hat
yeah yeah i sat i sat cross-legged on a
tree stump
that was pretty cool
thank you um
but uh guys you know what we're trying
to get we're trying to get our
uh and fat oh who's getting bad
um
no no no no this is this is a work
related stream got to keep things work
related
self-driving cowboy
look there's someone behind me
uh all right what else we got we'll make
it go to make it go to 15 or 20 minutes
or something
we've got a beautiful stream over here
to our left how long until level four i
don't know ah
we'll see maybe we'll do lex friedman
again
um i don't know you can't you know
i'm just thinking of the marshall
matters lp2 where he says gonna
recapture the magic and like
you know it's just you can never capture
the magic once the magic's gone the
magic is gone and that's just
how magic works
uh how long until level four
level three's gonna happen first next
product
autonomous horse
oh i found a lake there's a lake
maybe oh let's go sit by this stream oh
that sounds nice
yeah the first podcast is good it's one
of my better pieces of content
oh perfect i can put the stream in the
background
um if you guys don't have i mean how
many of you already have comma twos
raise your hand if you already have a
comma two
stream by the stream yeah
who's missing a comma two who still
lacks a comato
what could i tell you right now to get
you
into a brand new comma two
you've got one your car doesn't work
with it jonathan what car you got
you have panda white panda white silver
man
um buy you a car vw
it should support vw's that comment
three who's heard of a comment three
we're selling comma twos
um everything's obsolete in two years
haven't you seen like the future
you know i'm here on an iphone 11 pro i
can't wait till that 12 comes out
i had a dream last night about buying an
ipad because i heard some sick things
about the new processor
but then i was like i'm gonna wait for
the new arm macbook cause it's gonna
have that sick processor um i don't
really know why ipads were in my dream
but they were
all right we'll go to 20. go to 20
minutes
20 minute ad comma twos what what what
could
i you have panda blue i don't know what
that is
uh you drive ford focus i mean white
pandas are still good for other stuff
they just don't work with open pilot
anymore we need that high precision gps
to
keep you locked on in curves
um you're just here for the startup
review what's the startup review i have
high hopes of the arm macbook yeah
um would i be interested in building a
new social media platform
no
zuke's is over man got bought by amazon
now bezos you know got a rocket company
at a car company
uh holds the car to one lane when the
other lane disappears yeah that's that
at the end
you guys know new models are coming in
zero eight new models have
four lanes and two road edges so
hopefully we're gonna display those
things
in the ui avx is stupid especially
the x512 that's not what an x86 chip is
um and then for the zero eight series
we're gonna really push on end to end
longitudinal
i was thinking i was uh coming up behind
a car at a uh at a
at a red light and like i don't like the
way it stays so tight behind the lead
car even when there's a red light there
but the only way to really do that is
holistically because you can have the
same lead car state it's just the color
of the light that determines your policy
end and longitudinal will solve these
you can do navigation with what
no i'm not going to virtual ces virtual
ces is lame
virtual anything is lame um
yeah yeah we're here representing
america labor day there is nothing more
american than
working
another simulator stream yeah maybe
covetously
to convert old cars someone else can do
it i mean someone else should do it and
just build it on our platform
that's i tell the x-matic guy that's
what he should do you know he could
actually sell like you know probably a
thousand of them
um but nope
no go go send an email to the x-matic
guy he has the kit
labor day means you work double the
hours edie long for the bosch boys yeah
yeah yeah well once we go radarless
um we kind of need anton long to go
radarless
i'm very we're very excited about the
rtx 3000s
um xmatic they're a
canadian company you know they have
ideas that they're going to compete with
us they should just play in our
ecosystem
but um you keep trying to compete with
me i can play in our ecosystem
ghost why don't you just make hardware
for comma ai you know play in our
ecosystem come join
come join come come into our ecosystem
uh we think in 30
80s actually um
because 3090s are overpriced to take up
three slots
oh the multiple camera question oh the
multiple camera question
nah dgx is stupid
so overpriced so repriced
you wanna you wanna buy you know what
man i'm gonna take something i'm gonna
make it gold-plated and then i'm gonna
charge
5x for it i'm gonna buy a gold-plated
comma two five g's
but on labor day i sell to you for 4
500. i know that dog's having a good
time
um i don't know ati needs to get their
software together what's the labor day
sale
the labor day sale is
dude if you can sell a concept for 70k
do it concepts are worthless i don't
know what sucker's gonna pay you
um yeah i know the dog right
um you would contact me directly well
you can buy phone calls comment i slash
services
uh well i have a shop in europe what do
you mean by a shop
or should we ship from the europe office
uh the europe office doesn't do that the
urban office just does software
development
you know they have like a lot of laws
over there this is america
we have a reasonable amount of laws
um rock m is so bad
i mean maybe they'll fix it maybe
they'll fix it amd if you want to put me
in charge of that project
i'd love to stick it on video
for new hires do you look more at skill
at ability or work experience and
education
i look for skill and
you've motivation to have skills and you
got to be motivated
that's it
it's a nice stream
red meat and corn is light it's a good
diet
elon talked about my video on twitter oh
yeah yeah the open dojo one yeah
stream on stream this is a stream stream
we'll sit we'll sit this way so you guys
can have a different a different
background
we're on location i swear this is not a
zoom screen
oh best beer
bud light man
thank you
uh i did see mercedes claim of level
three autonomous
and all that makes me think is of audi's
claim of level three autonomous and it
was fake
for future car buyers toyota better
hyundai you're gonna have a good
experience in a corolla
um but you'll also have a good
experience in a hyundai so that's a
nicer car
cost a bit more uh internships in europe
i don't know
willem's in charge of that office you'll
have to ask him i don't know if he wants
to do interns or not
um you love hyundais
all right this isn't a generic stream
this is a comma stream this is an
official comma stream
on an official comma channel so we gotta
keep it official
uh toyota's layout you mean how hyundai
has eight different connectors
what why do i need depth do you use
depth
can you drive with one eye i don't know
i think you can react to mercedes ai
video
that's probably terrible and lame i
don't know i haven't seen it maybe it'll
surprise me you know
i always want to be surprised i always
want to be surprised level three in
three years
yeah i'm hopeful i'm hopeful we're
setting a reasonable target that we
believe we can achieve
elon's doing shield streams now it's
changing the future
i'm telling you in like 2032
the presidential candidate whoever wins
the u.s presidency is going to live
stream the whole thing
ah they're gonna be a streamer that's
what i think
gave up on slim now we use slam
internally to recover state
but then we just predict the state
directly with a neural net
our first tick tock president not too
back sucks
and is banned banned for sucking
okay thank you all for joining my stream
make sure to go and
purchase a comma too today or actually
you know what
do me a favor and don't purchase it
today
purchase it tomorrow
because tomorrow we make an extra
hundred dollars off of you
yeah i mean i don't know i don't want
you to save money
no i would never sell for a billion i'm
selling for two billion
two b's someone's gonna one day contact
me seriously i'd be like i'll give you
two b's and then i'm like
all right cool thanks bro that's what i
was looking for and then i'm out
uh two bees buy me out um
waiting for tc what's a tc never heard
of a tc like a tt fly
like you mean what ari gold said you
know it's like the key word to get out
of the agency
titsy fly sell out two billion
that's right why not do a spec so lame
um
come and i planning on becoming public
soon no i don't really like that whole
aspect of the business we don't really
do any of that
we're just gonna make open pilot better
and better and better and better
two billion i've always said two billion
uh what would i do with two billion
dollars give it a charity man
i don't care i don't need the money but
i just like the idea you know
you know that's right i beat cruz and i
beat zooks
um and by the way we built something
incredible open source that'll be
open source forever
nah nah 199 billion not two only two
two b's um
thank you vegas
now i'm gonna donate it to like some
ridiculous cause you know
masks for hamsters what would masks for
hamsters do if we got a they got a two
billion dollar cash infusion
ah have we had offers yet yeah i don't
know i wouldn't sell to anyone for two
billion if i thought they were really
lame-o in the south of them
uh but yeah like you know some car
company they decide they seriously want
to win
two billion maybe
maybe should i demand open pilots stay
open source though
we'll see we'll see we'll see how it
goes
um you know every release it gets better
uh
when you're climbing out of a hole if
every night
if every day you climb up three feet and
every night you slide down too
you're still eventually going to get to
the top of the hole
possible twitch road trip stream nah
nah this is not this is a private road
trip for me
and me and some of my instagram
followers but
um nah i'm coming into denver tonight
maybe tomorrow got some friends in
denver
and hang out
i was gonna stream fall guys yeah yeah
yeah no there's official comic stream
we're not here to talk about that stuff
would i create an open pilot kit for
tesla with ap two and three you won't
believe how bad it is in europe
you don't even need a kit to be honest
you could probably install open pilot on
the driving computer
of course i drive the alpha builds i
haven't seen any fires but i have seen
smoke and you know what they say
i just smoked this fire
all right all right i'm serious this
time it really only will be a 30 minute
stream
i know the followers have been growing
but uh the viewers
but twitch did not accept my proposal
but they didn't decline my proposal
either the proposal is in purgatory
which i am not i'm in telluride
purgatory is over there
um how long will the recruitment process
take
for what
i don't know that game and nintendo's
yeah we could make it work i don't know
someone can do it
hello uh no more trade-ins nope but
today you can save 100
uh if you buy it am i in texas now i'm
in colorado
the fifth free estate according to the
cato institute
uh can you download the apk for comma
prime uh yeah go to one of those like
apk finds i'm sure it's on there
why don't you get through the store uh
well we could put a link on our website
too
for the apk
um what do i think of elon thinking
autopilot improves exponential with data
it's a
total not only is their system
not fully learning based
it's actually the other way around you
get exponentially more data for linear
improvement
um and elon knows this too so you know
exponential growth sounds good though
right like that tesla stock
i don't know if it's up i sold i sold at
the peak uh hopefully the peak
i want to get back in but you know 2500
a share
it's a little high
oh yeah
yeah i made a lot of money yeah common
pencil update project's going well
uh the new segnets have really low
losses
um it's great to see community coming
together like that
we hired a company to to to help speed
it up it's after split now i don't know
i still think of before split
my mom was like you know i i used to
only have
x shares of tesla but now i have five x
shares of tesla i'm like mom
it's the same
she's like no but now you can buy it for
less money i'm like robin hood really
lets you buy fractional shares
and then she was like yeah but only kids
use robinhood and i was like yeah that's
true
um okay thank you all for watching
today is the one chance for you to get
one hundred dollars off a comma two
you're probably you're really not gonna
see this deal again this year
probably not for most of next year
either so this is this is your chance
just ordered it that's what i like to
hear thank you all for watching
drive safe everybody enjoy life love
nature
thank you all for watching
all right hi everybody
got a special announcement today
[Laughter]
welcome welcome to the stream welcome
all right so you know uh
let me tell you guys a story uh the year
was 1776
and the richest man in america george
washington
was upset that some guy in some far away
land
was trying to charge him tax this is a
true story he's the richest man in
america so
he got his other billionaire buddies
together they recruited
an army told them they were fighting for
freedom and independence
and they fought off a bunch of idiots
who dressed up in bright red uniforms
they were called the hessians
and they were german mercenaries and
they were bright red uniforms and they
were idiots
uh they lost some dudes from american
dudes you know hardcore freedom-loving
american dudes with like ar-15s hanging
out in the woods
you know taking out the hessians one at
a time and the hessian's like
marched in a bright red uniform
secession which you know in retrospect
is like kind of stupid
and it makes you wonder about people
back then but none of this has anything
to do with the story except that
uh two days from now is july 4th sunday
so hopefully you guys are going to you
know watch fireworks
uh you know eat grill grill with hot
dogs and hamburgers
uh let me just post a stream on discord
and then we'll get to what the
big reveal is um oh wow the stream
already has the reveal
oh it's in the front it's in the logo
guys hi so for the first time in common
history
uh we're not giving you guys a sale
we're doing something
even better we're offering you something
so exclusive that it's never been
offered in
all of common history despite it
actually being really easy to make
for us super hard for you all right this
is a comma two notice the color it comes
in
black just like the model t
this weekend only we're offering the
color drop down
patriot edition made in america
red with a white border guaranteed white
border gonna be a blue phone but those
are two rare and exclusive
blue coming next year this is this year
the
2021 patriot edition in red
red red okay so this one is in black
this one is in red
okay so if you want to buy one of these
um
we thought about making the price you
know we're like ah
what should we make the price and you
know i suggested 1776
but nope it's actually just 10.99 it's
the same price
um we made five of these so hopefully
five of you buy them
if more than five people buy them we're
gonna make even more
as many people want to be a patriot as
want can
purchase the comma 2 patriot edition
it's red that's all i have for today's
stream i'm not going on forever with
these streams anymore
you could wear a cool hat like this you
could drive around in your lifted truck
with your red patriot edition i think
someone supports the dodge ram
uh you can also drive around in your
prius because you know that's part of
america too
that's right california is still part of
america um
i drive around your prius with your red
comet to
you can buy only this weekend seriously
never again
i'm never doing this again like this is
your only chance to get
this exclusive red comic 2 now one
caveat on the red combo 2 is if you do
send them in for
warranty repair you're gonna get a black
one back
so you know the red is ultra rare ultra
exclusive you could buy yours today and
now we're gonna add everyone on discord
to tell them this alright bye-bye
patriot edition bread
welcome to the comma awards
pedro hit it
[Music]
there we go the comma awards
at your local chili's we're live
everybody
it's me chris head of communications.com
ai
uh we have a lot of awards to announce
today
we actually show you some of these
beautiful awards that we have
to give out look at these amazing awards
3d printed commas they're all silver
they're going to be sent out to the
award winners today
[Music]
we can cut the music
no cut the music
oh here's george's what would the music
go
george is dancing
that's great okay so
we have some honorary mentions before we
really get into the show here
all right pedro cut it again this time
for real
okay so yeah we're here by the beautiful
comma christmas tree
even has it has this amazing
3d printed comma star
and look at all the ornaments a lot of
different people
from the open pilot team all here
so let's get on with some honorable
mentions
a lot of great community members this
year and uh you know we just really love
the comic community so much so first of
all there's brisk spirit
this is a new member of the community
who's been making some pretty good pull
requests
we appreciate his attitude and we
appreciate him just jumping right in and
we want that for more people so that's
great
some car porters we have that are really
awesome
mlp is doing some great subaru stuff
over there
jakar did the mazda port which is pretty
cool it's dash cam only since
you have to put a wheel weight on and a
bunch of stuff but we still like the
port
um there's avalaminsky who did the
nissan port and there's a lot of nissans
now actually probably a new one coming
out
very soon the nissan altima shane
does a great fork we'll have more to say
about
chain a little later and then there's c
sours who's been doing a lot more of the
honda bosch stuff
lately reporting some of those bosch
cars and then i also have a shout out
for a moderator
michael does a great job on the
discord so
that is it for our honorable mentions
we're going to hand it off to george
who is going to do some of the big
awards
george it's your turn to announce the
awards
bring up some stuff you know these award
shows gotta take forever
your people aren't here for your
acceptance speeches
so whoa whoa don't show them the script
no they can't see it yeah
yeah yeah you know i don't even know who
wins these things to be honest
uh you know this is like the time my
girl taylor swift hosted the grammys i
need a beer you know
we're gonna go we're gonna go get beer
all right yeah wait no we'll be right
back
we'll be right back with the comma
awards
okay we're gonna try this uh stabilizer
see how it goes
wait what happened they're not a
stabilizer anymore we're putting them in
all right um
all right everybody you're going in how
we doing on viewers i added everyone on
discord
202. oh that's pretty good oh
yeah so you know these award shows
uh we like to take a long time
with them no one's here to give
acceptance speeches and that's the thing
we're really dissatisfied
even though we are far apart you are
close in our hearts
is that what i'm supposed to say here is
that what jim carrey would say is still
alive do i know
yeah apparently yes
all right so
um uh we didn't have an envelope
to put them in our chris
community yeah you and michelle okay
good we did that we did that
um george announces winners in this
order
uh what we need what do we need one of
those like tv things where it like comes
across with like the bad
font and the 90s to announce the first
award
pencilers of the year
we're going to start for those who don't
know karma pencil
was our channel in discord where
everybody came together and labeled the
comma 10k
uh it's a 10 000
image data set well you guys can add
class labels and this one
if you didn't contribute you had no
excuse
you didn't even need to know how to
program you just needed patience
dedication and time you know all you
people out there were like man i wish i
could contribute something to come
you could have contributed to common
pencil and these people did and that's
why they're here today
winning coffee awards so
we're going to start with pj lau
our first commie goes to pj lau he did a
great job coordinating
uh you know a lot of work on common 10k
just committed to the repo
this commie right here is for you
this has made a real silver letter
should we put the yeah we'll spin them
this way if they're digging out
okay um our next penciler of the year
goes to eric b who wrote image labeler
the tool that a lot of people used
uh to label you could have labeled on
the web remember when i said no excuses
people what excuses are they getting
what excuses are they getting i don't
have a computer i'm not a winner
that's right this is for pj lau and eric
b
this one here goes to someone who's
really
uh picked up the slack on part two
putting a lot of light into a pencil
recently
this one goes to dr
and we have one more one more penciller
one more really
did a lot of work in the last three days
and it's definitely been noticed you
know
the first three people there actually
got sent free combo twos as well
and you keep up what you've been doing
over the holidays and we'll get you one
too
this commie goes to spectre specter 56
this one's for you that is four for the
pencilers of the year
uh if you've noticed that openpile has
improved its lane tracking
uh it's all thanks to the folks in
compensation
but for um next one i think we should
roll some clip
even if it's like on a screen let's just
make sure the sound is loud
yeah so this this comedy is for video of
the year
video of of the year video of the year
quick weekly we're all no like with some
sounds
you know the av production team
is um i'm taking a break yeah these
comedies yo your comments are gonna come
in the mail in the mail in the mail
oh definitely that's that's where
they're they're going maybe while we set
that up are there any questions from the
audience
what are they saying a lot of excitement
oh a lot of excitement
guys you guys this is just the first
comment you know they don't announce
artists of the year at the beginning
our decade man taylor swift and eminem
were the last two artists
they don't announce that no that comes
later in the awards ceremony we started
off with pencillers
of the year and this one is video of the
year
and it goes to hubble sphere and andy
sly for the open pilot
versus tesla comparison i think we have
some footage right over here
look it's logan would like to read up
and compare the autopilot on my model 3
against the open source open pilot that
he has installed on his 2019 toyota yeah
that's a good video
love that video
[Music]
yes we were really happy with it we're
all so happy that we're holding our own
to assist the driver with safety and
convenience apparently almost
a million views logan that's a million
views wow
man i know battle rappers who would you
know give their left leg for a million
views
um yo so um this one
is for andy sly and this one is for
hubble spear
who made lots of other great videos
logan legrand make sure to check out his
channel
uh yeah we got some comedies for you
guys
oh well that was a video video
so so logan asked if they're real silver
they're real
silver 3d printed yeah silver color
silver color um okay okay
yeah um
this next tommy you know you guys
if you don't win a comedy here tonight
that's just who means you should work
harder next year you know
that that just means that that next year
you can do better
there's there's room for improvement you
know one i heard taylor swift once
talk after she won a grammy she said
it's actually in the reputation
video in that place and she said look
that was all i ever wanted in my life i
don't know what to do from here
but for everyone who doesn't want to
call me here tonight
you have goals and dreams three people
are watching
uh 261 261 that's pretty good
ah this next award
is fingerprinter
of the year
fingerprinter of the year he spent a lot
of time on discord
helping a lot of new people he didn't
have a fingerprint head for their car
get one added he's also a moderator on
our discord this commie goes
to eric mariah all right
yeah we need me to clap crap
yeah oh yeah eric's been with us for a
long time in the community
there's a lot of great work helping new
people uh get started and you know
keeping out
uh you know the the new people who are
too demanding because you know this is a
hacker community
you get out what you put in
um unlike you know consumer product uh
but that does not mean we sacrifice on
quality
we love we love quality so we have two
other people
who manage to do so well contributing
to compile and that's really what this
next section is people who contributed
in the written code that ended up in
occupied we ended up in the greater open
power community two of these people
are joining us as interns shane
and yasin we're excited to have you here
next summer
there's no comments for you but there
are internships because of course these
are paid internships right here
on site in san diego just like bob
barker shows the showcase showdown
we're here to show the common internship
now
we've saved the best
uh a for last i think we're going to go
over
into our open pilot office and we're
going to review
some contributions real code changes
that landed in helping public in the
last year
hey everyone let us know about this
this person and what they've done
one person yeah i'm really not sure if
there's one person oh
are they of them
[Music]
is he one person or is she or are they
so there's like this mysterious party
who like contribute
like more than myself as like a common
employee
in the open repo but that's like a pr
merger like a major pr merger for this
or their commit i'm honored to
review this person but now's the time
but
let's go let's go review some of his
latest commit actually
this beautiful camera dp think
let's check this out
[Music]
wow give me some insights as to what's
going on here
dude i just see beautifully this
contributor signature is uh
red diffs net red diffs and that's one
of the most beautiful things you can
contribute to open pilot
a beautiful red diff yeah i see it it's
looking good
i'm still wondering can one person
really do it
yeah how does one person do all this
that's a real that's a really good
question
george may have just leaked a little bit
of a george
the tc he's trying to oh it's
oh are we ready we're ready
i should have watched that whoa whoa
whoa whoa we're not ready for that yet i
should watch that
that that segment take my hat off
first for this one all right welcome
we've watched you
go on a journey the last year we've
watched you not just
contribute to open pilot but also
become a better programmer you know what
i say you want to get better programming
for that
program this comedy
this company is for dean lee our
contributor
of the year believe
all right whoa look at that yeah it's
definitely a big comedy we will be
sending this
to you uh we also have a second one here
we're gonna keep whoever wins the big
comedy contributor of the year
she's going to be giving out every year
this is just the first annual comedy
awards
we're going to keep one here we're going
to write your name on it and keep it for
all time history
someday when we're worth billions of
dollars you know you go to the google
office you can actually see the first
google data center
and it was a bunch of motherboards
shoved into like a dish rack
so it's going to be like that
thank you all for joining us
uh it's been it's been you know it's
been 2020.
you know that's all i'm gonna say about
the year it's been the current year
yeah you know what what's good about
dean lee he was
he's never been credited in the release
notes but yet he still does great work
wow daily i mean this is really
you know it's really easy to contribute
in open source if what you're
contributing is a feature that you want
a lot of my pull requests other open
source projects are features that i want
or
bug fixes that i care about but when you
go in and refactor
that shows dedication um and it is
legitimately the best way to get better
uh you know you can have it's a it's a
programming education that's better than
any programming education you're gonna
get
um anywhere and the beauty of
contributing
is you get feedback you get feedback on
what's good and feedback sounds bad
and you just watched uh you need to come
yeah i mean and that's you know that the
the dedication
uh yeah you know i will try open pile i
will try
i will try i would love to try it i
would love to try
um no and you know we'd love to attract
more people like that to up and pilot uh
it's like getting in on linux early you
know
imagine you could have gotten in you
could have written rise or rise or f out
maybe that was a bad example you could
have written ext4
uh i got the riser at fast on riser
uh
um yeah i think that's
all we have for you today yeah thank you
for watching the comments this is going
to be an annual thing
we appreciate you if you contribute we
appreciate you if
you purchase we don't appreciate you if
you complain
uh but we do appreciate appreciate you
constructively
and we definitely appreciate you you
contribute and make pull requests some
comments
slash open pilot you do that you're
ahead of the car companies
you know all right
all right let's hear some award show
music
dean lee feedly
[Music]
throw this away oh
and of course we need the drink that
this stream is brought to you by
all right let's wait for some people to
get into this chat room hello
this is my work computer welcome to my
office
just down a little you got no leaks i
got we got no leaks
kind of leaks boys
uh we gotta go get the uh drink
the stream is brought to you by
and then we're ready to get started oh i
didn't set the title of the stream
ah i'll go change that
there's probably still something stupid
about cheap eth has nothing to do with
cheap ether i promise
uh i never know how to do this
customized channel
uh stream manager
no edit stream info here we go is that
set
hit stream info okay not gp do
open pilot tools work let's
find out
all right we got people in chat
oh someone subscribed oh do i have it as
subscribers only
we'll let everybody chat for now but if
it gets shitty we're gonna go back to
subscribers only
[Music]
good morning good morning all right
we've got zero viewers right now
i don't know why
we'll add everyone on discord once the
stream gets going
all right let's first github comment ai
opened up so i'm in an incognito mode
window so none of you guys are going to
uh
this is a experience that all of you can
have at home
now we are doing this from
um my computer i know what we're gonna
do
uh let's just move let me just check
something quickly
all right cool so i'm just gonna move my
normal installation of open pilot
into this stream folder and now we have
no open pilot anymore
on my computer we just have that crap
i'll put the chat up here i have three
monitors at work which is pretty nice
thank you all welcome welcome welcome
this is my this is my office at work
i'll show you guys around this is my tv
it's behind me this is my gaming chair
and
only once can you guys see i also
have a happy hacking keyboard at work
and i gotta i got a logitech mouse
all right um so we've put a ton of
effort as a company
into getting open pilot to work on uh
computer let's let's add everyone in
lobby
at everyone live on
twitch exploring
open pilot tools on ubuntu
let's delete that message good
all right cool uh
[Music]
we put a lot of effort into making open
pilot
work on ubuntu let's let's clean up some
of this crap i don't need
don't need any model oh we got that hype
train all right let's go
let's go we don't need working i don't
know what chain torrent is
i'm sure these notes aren't important
but we'll just move them into documents
just in case uh and record a dot wave
we don't need and i don't know what the
other stuff that's yeah open pilot has
tools
open pilot runs on a ubuntu computer
like all of openpilot is not just for
little tiny devices
everything you're going to see me do in
this stream you can play at home
so first let's go get a drink and then
let's get to work
this stream is brought to you by
recess uh it's
a pomegranate hibiscus
calming hemp and adaptogen infused
sparkling water
if the font is hard to read get a better
computer
uh actually
let me see if i can i don't really know
how to increase it i don't actually know
how to use ubuntu so that's too bad
this is this is uh what we get the
stream is also brought to you by
the comma two um this comma two is
broken because it boot loops
but if you buy a comma two today right
here
on shop.com.ai
you can buy a comma 2 right here it
includes a free
hat um font size is okay change the font
you don't like the font okay well now
you're just nitpicking
now you are just nitpicking okay so
let's go back here let's get here
okay um right click on
x term i'm running x monad here so you
see i can like move my things
uh uh yeah so i don't know i don't know
how to use this for 1099
what a bargain i know what a bargain
control plus will not make it bigger
this is the font size you get if you
don't like the font size
uh well you know zoom in okay cool so
first
open pilot is just a repo um
on github control shift
plus i tried that too you like the font
size good good good you're a good person
alright cool
so this is the reap this is the clone
link that anybody can use
github comma ai open pilot and i'm just
cloning it right into my home directory
right now
we've been working on openpilot for
about five years now
uh it's actually a pretty mature code
base
um a lot of great tests
uh it's also got a whole bunch of sub
modules so we can just we can just go
through what some of these are quickly
so this is open pilot
um openpilot for those that don't know
is an open source driver assistance
system so what does that mean it's like
tesla autopilot but it's open source
code
that anybody can run ah
openpilot performs the functions of
automatic lane centering meaning it'll
take the steering wheel and keep you in
the middle
an adapter cruise control meaning it'll
do the gas and the brakes and it works
on over a hundred car makes and models
so if we go down here you can see these
are all the supported cars
uh these are all the community
maintained cars
we work on pretty much every reasonable
car
after 2017 except for a few uh that
don't work for
for different reasons all right we got a
thousand viewers oh that's awesome
that's awesome that's awesome
um great uh
so yeah you can see that it's over here
cloning right now so it's
it's a git repo open pilot lives on
github we're at almost
25 000 stars so if you guys want to
smash that star button
cheers recess to you
um if the sound's on sync god that i got
sound to work at all
is an amazing feat of linux that i got
any of this to work on linux actually it
was pretty easy
um it just kind of worked okay cool so
now we're in the open pilot repo
um you'll notice these red things mean
that these sim links aren't ready and
that's because you still have to do a
few more things so open pilot has a few
sub modules
uh so for those that don't know sub
modules
and github are basically other git repos
that you can import
and we've structured our code base like
this because it makes it really
easy to like develop these things
individually and to conceptually think
about
an api between them that's clean uh some
companies have sprawling mono repos
google uh and you know it makes
everything just really difficult
to uh to to to like
factorize in your head um so first let's
so let's emit these sub modules i can
just do get some modular net
you'll see that there are five of them
um serial
is basically our library version of ross
uh serial is both a messaging spec
and a high performance ipc pub sub so
it's an opinionated ross
um ross lets you pretty much define your
own serial gives you these log capping
ps but if you're building a robotic
system or a self-driving car
this is going to already have everything
you need in it see here are the things
we support
um can messages gps messages
uh gyro messages somewhere
you can find them uh wait we haven't
refactored sensor events yet
oh well that needs to be refactored but
yeah either way it's in sensor events
ah cereal also includes so it's just
really easy to use serial i wrote this
demo actually i wrote it during a live
stream once
um thank you for the hype train
ah so this is how you can set up a
subscriber and a publisher
to use serial leica
is our open source gnss
processing library we basically wrote an
rtk lib that was like usable in the
modern world
um so if you guys know how gps works
there's a whole lot of satellites
uh and you can get from a gps module
pseudo ranges to those satellites
which is a uh a distance it's not
exactly a distance it's a distance
plus or minus some constant c uh so when
you solve the system you solve for both
your three-dimensional position
and time ah
so yeah we described kind of how it
works we've built our
own gps satellites
gps processing stuff and you can see
that you can get more accuracy with
leica
than you can with u-blox live it lets us
do calvin filters afterwards and
while we're talking about calen filters
we'll jump down here to red nose
red nose is comma's open source kalman
filter library
there just aren't really many good ones
so we wrote it from scratch
i believe it's still my c plus code in
here
a lot of these were written by our cto
harold
both leica and
red nose
serial was written largely by our head
of open pilot willem
and then we have open dbc and panda um
so opendbc is dvc files
describe the internal messaging spec of
your car
so if we look at like uh here's a toyota
uh toyota of course names these all
stupidly maybe hyundai names them less
stupidly i know i'm going to be let down
by this because they're going to be
equally stupid
oh yes of course the cf spaz disp oh yes
um but these are all the messages that
are flying around on the buses of your
car
and this file shows you how to decode
them opendbc
isn't just dvc files it also includes
this library called can
which will let you parse them and let
you parse them at very high speeds
uh if the audio is out of sync i don't
really know what to do about that
uh i don't know
everything just lags it's linux
uh oh could this be a make unlogger not
gc pause yeah well
we're working on a new unlogger there's
a new unlogger in the repo actually
um 60 fps
we are not dropping any frames i mean
i'm on a sick computer right now
you guys just want to look we got some
well i mean they're old xeons but we
have
56 virtual cores 28 real ones i guess
we have 256 gigs of ram
we're rocking a titan v and a 1080
uh so you know i know you guys look at
like looking at the specs
uh yeah if it's dropping for you it's
dropping for you
i don't know maybe our maybe our
internet is just crappy
that should be okay all right
cool uh yeah i know right come work at
comma you can get a sick computer like
this too we got sick computers for
everybody you guys want to see some real
sick computers
you know this ssh over here into gpu-06
wanna see something sick
oh look at that wait wait is that is
that
is that seven rtx 3090s
no it's eight rtx 30 90s
you boy each with 24 gigs of high-speed
gpu memory
all hard at work right now of course
they're not in a data center they're in
a compute cluster you can't use these
gpus and data centers
wait wait wait wait wait wait wait was
that gpu six what about gpu seven what's
in gpu seven oh
did you mean to say it has eight 30 90s
oh what
um yo if you want to come work here and
play with mad
huge stacks of 30 90s uh you know we got
that we got that
um used only for this is this i play the
sickest minecraft games on this computer
you can see right now it's hard at work
playing minecraft look at look at all
those percentages
um so uh yep if you wanted to buy 3090
and couldn't it's because i bought them
all
uh sorry about that all right so let's
get someone's little update let's
actually download these sub modules into
openpilot
and then let's see what we are going
to get i think we've gone over all the
sub models oh we haven't gone over panda
yet
um panda is the code that runs in the
microcontroller
that's built into the comma two
does someone do a comma two teardown
that i can google
um
nope no good comma two tear down
uh but
the comma two uses the same
microcontroller that's in panda
which is our first generation hardware
here the stm
f413 and one of the cool things about
this
is there's actually a guide um to build
functional safety into this into this
microcontroller
uh so the panda handles some safety
functions that are as will be
uh it's all you know people like open
pilots written in python how can it
drive a car
well it doesn't do any of the safety
critical stuff all the safety critical
stuff
lives in panda um and then you can read
uh our safety code here and board
safety we have different safety for each
car which is basically enforcing
the open pilot safety model um if i go
here we can look at it
the open pilot safety model is basically
two things in addition to a driver
always paying attention
uh the driver must always be able to
take immediate manual control of the
vehicle
with either pedal or cancel button and
then the vehicle must not alter the
trajectory too quickly for the driver to
safely react so you always will get
about one second
uh regardless of the scenario because
open pilot can't
jam the actuators now of course you need
to be paying attention at all times
but the safety model gives you some
guarantees that for example the car will
never turn the steering wheel super
super fast or turn it to the point that
you can't simply override it
um so yeah
uh the panda code is written
to misra c standard uh so it's actually
like real uh automotive quality
uh miseracy is the same standard that
the automotive manufacturers use
uh we're doing static code analysis we
have a lot of
unit tests so panda is kind of like the
the safety critical component of open
pilot that runs on a completely separate
microcontroller
from the qualcomm chip that we're using
to drive the car so
if you're running open piled on the
comma two the comma two is a legal a pro
three
with a bunch of mods put a plastic case
with that safety micro slapped on the
back
uh no battery and it's a it's a qualcomm
snapdragon 820
so that's what open pilot is designed to
run on but of course it can also run
on uh the pc
and that's what we're here to do today
so
let's start to take a look in here at
open pilot
uh now if you want to build open pilot
you're going to need to do slightly more
than me
because i've already run effectively
ubuntu setup
oh we might have to do a git lfs pull as
well
no it looks like we already did that
okay cool so you'll have to like install
python
you'll have to pip and install
everything and we also have this big uh
apt-get but this has already been run on
my computer simple
it's just in open pilot tools ubuntu
setup uh this is my work computer so
it's already set up
okay cool so now we're gonna have to
build open pilot uh we build with the
scones build system
so let's do a scones j16 wait 16.
doesn't my computer have 56 cores yeah
56. now we're talking that's fast
all right let's if we can just go over
here in h top and watch it build ah look
at that oh it builds so fast
56 cores what that's right see them look
at them
they're driving hard uh so we're
building you know like i said come work
at common we got great computers
uh we got some great uh build
environments
uh open pilot has five thousand forks
that means five thousand people have
taken open pilot and modified it in some
way or another
there's just a flex stream yeah who
wants to see more 3090s yeah we didn't
even
um
no no we're not on the macbook today
we're on my ubuntu machine
are we still working on a map solution
yeah
uh
i can i can show you this there's no
this is just topic maps here we go
so this is this is in a branch right now
on open pilot
uh we are working on navigation
we're working on end to end longitudinal
working on a lot of great stuff
uh for you guys coming soon uh where
does our revenue come from
our revenue comes from right here
shop.com
ai yo we're just chillin while this is
building um yo
oh it's done wow that was so fast if you
had a 56 core computer
your builds could be that fast too no
but it actually builds pretty fast it's
pretty cool
okay um so now we have open pilot
now what if we want to run it well let's
take a look at some tools
and let's start with this tool plot
juggler right
um so i've already done
these uh installation steps here this
morning
you can do them just install plot
juggler here and then
this file this r log is a file from
uh a device right so your device will
produce these things
and then we can just run this down here
it's gonna load that file from azure
this is a free file actually everybody
can run that command at home
we are giving that file away forever for
everybody if they want something to play
with
uh let's just give this a second here to
load
hopefully it's gonna work free file
that's right who else has given you free
files is waymo giving you free files
only if you sign the license agreement
lidar is a joke guys lidar is a joke
you want to hear funny joke lighter
um all right well plot juggler was
supposed to load
it didn't load let's try it again
oh here select the loader to use oh i
might need to reinstall the
because we checked out uh
yeah i think we're gonna have to rerun
install.s8 let's take a look at what the
script does
okay yeah so we're gonna need to
download
these plugins for plot juggler and
that's why it wasn't working
i followed the instructions but then i
recloned open pilot so let's try it
again here
downloads the file parse is the thing
all right parsing log let's go let's go
let's go
and throw this over to window four there
we go okay
so this is just an example of some of
all the data
that uh openpilot is logging and you'll
be able to look at it right so these are
these different messages
actually if you want to look at where
these messages come from let me get my
chrome back
here we go um so these messages here
are defined in serial and every comma
device is producing these and we gave
you that one so you guys can play at
home right now
if you just go into tools
plot juggler uh and you just follow
these setup instructions and then run
this demo
you can play with this at home
everything i'm doing right here is open
source
and available for you as well it should
all work on mac
uh if you guys find bugs on mac we're
happy to uh merge the pull requests and
if you have windows
bro bill gates got a divorce didn't you
hear who's still using windows
uh i'm using x monad if you care about
the window manager
okay so uh this is plot juggler plot
drawer
is written by this cool guy uh i think
we're trying to upstream our plot
juggler stuff
uh i don't know maybe not
um so let's take a look at what some of
these things are
first let's talk about where these
things come from so they come from
serial
and this is our messaging spec and here
in log
so let's just x out all of these
we have a tab here and then we can look
at something like car state
all right so car state is basically the
state of your car it's actually not in
this file it's in
car.cat pnp i wrote this stuff
i wrote this stuff when we went from
openpilot 0.1 to 0.2
um and it was all yolo like no tests
like i would make some changes i'd go
out in the car and drive make some
changes go out in the car and drive
we've come a long way since then you
know we've been working at this for
five years okay so let's take a look at
the car state packet here
um so
they're sorted a little bit differently
here they're alphabetical they're not
alphabetical here
uh so we can start with something called
v ego uh so ego is your ego vehicle it
means u
uh v means velocity so let's plot v ego
over here
and this is a 60 second uh window in
fact
maybe to give you guys some context
let's see if we can grab the video i
should show this off
okay let's just go in here to open pilot
tools
plot juggler this is going to be just
some magic that you have to know
but it might just be public so if i just
do ff play and i type fcamera.hvac
fingers crossed there you go okay so
this is the route we're looking at so
you can look down here at the v e go oh
that's probably where you can't see
[Music]
oh you guys can see fine okay so it's a
one second video you see we're going to
come to a complete stop
at some point
maybe about halfway through behind this
red light so now we're down here
chilling we're chilling we're chilling
we're chilling we're chilling
up and now it turns green and now we're
going to start to
ve go ahead again and we get the car
back up and this is uh this unit on the
y-axis is meters per second
so this video corresponds to what we're
looking at here
pretty cool um everything in open pilot
is chunked into one minute segments
so this is a one-minute segment uh so we
can look that's the ego
we can look at something like your rate
of the car um you're it's on a different
axis let me just hide this here i think
i can go to split vertically and throw
you all right down here okay cool so
you're right is how much your car is
is going uh
we can overlay the brake maybe here okay
you can see that obviously we use the
brake a little bit to slow down there
use the brake a little bit to slow down
there we were on the break
while we were stopped and then we let
off the break we can check the gas
same sort of stuff um let's actually
throw them down here so we can really
see them big
the brake and the gas
pretty cool right plot juggler
uh we're gonna we had uh matcha uh our
intern worked hard on this adeeb's been
hard at work on this
william's been hard at work on this this
is we have we have really an incredible
development team
uh working on open pilot that's making
this stuff possible for you guys
how easy is it to install on a car yo
watch like the
comma 2 install video it's like mad easy
um here we go it takes about one minute
and 21 seconds
uh no it's it's it's if you can set up a
piece of ikea furniture you can install
a com2 in your car
um it's super easy it requires no
irreversible changes to your car
uh i flew up to seattle a couple weeks
ago i rented a toyota camry
i brought a comma two i put it in the
car i drove five hours out east
drove five hours back all without a
pilot and then i took it out and the
rental agency
didn't know at all uh so
um can i explain how the safety testing
system works for random pull requests we
read them
we have a whole lot of automated tests
as well but again
you know with most things it's not
malicious that you're worried about it's
bugs
right it's bugs and mistakes so that's
what we're really here to catch there's
no
evil people aren't really out there you
know people love to talk about evil
people people make movies about evil
people but then you look at you know
some of the greatest tragedies in the
world like the 737 max and it's just
bugs and things that are poorly thought
through
so uh that's car state pretty cool
shows you all things about the state of
your car uh like here's a fun one look
you're looking at the brakes you want to
look at the brake lights well the brake
lights turn on obviously when you're
pressing the brakes right
um seat belt unlatched oh good your seat
belt was latched the whole time that's
good
uh you guys know what a ego is who knows
what a ego is
excel there we go acceleration great we
have another bit called the sand stand
still a bit when we're at standstill
uh yo this stuff is like this stuff is
miles beyond anything any oem has
um pretty cool tools okay
what else do we want to look at well so
that's car state those are things from
the car
uh we can look at driver state let's see
if the driver was distracted
um let's clear that one up let's see
what's the probability that we're seeing
a face
okay okay we didn't see that we saw the
face pretty well let's see what's the
probability that their
left eye is blinking oh somewhat what's
probability that we see a left eye oh we
lost the left eye
um were they wearing sunglasses no no
sunglasses
were they distracted nope they weren't
distracted
cool uh we can look at like we can look
at the face position the face
orientation
so that's like them moving their face
around how about the orientation of
their face
we have all this stuff about the driver
uh driver camera state this is
let's talk about the driver camera state
not that interesting cool
now let's get into what makes open pilot
open pilot
this will be back in log cap emp we can
start looking at the model
all right so let's go back to car state
here and i remember car state's coming
from the car we'll throw ve go down
here let's look at the model
and let's look at the model's prediction
of huh
okay it's not in here
oh here camera odometry that's a
separate packet so we can look at the
translation
from the camera and you can see this
orange here
is how fast the camera thought you were
going just by using the camera
these are the translations on the other
two axes
so we use those for calibration but yeah
you can see it got a little bit confused
right there
but that's why we have car state the ego
ah this is the rotation you can compare
the rotation
not rotation 0. i believe it's rotation
to what the car state your rate thinks
it is
all right all right cool you can see
that that's a negative
uh with respect to the other so i think
i could apply a filter to data
scale let's do a scale multiplier of
minus one
oh no they all showed up again all right
let's just x this
split vertically let's look at the yaw
rate
let's look at the axis 2 of rotation
let's edit
not that we want to apply filter to data
we want to do a scale and we want to do
a value multiplier of minus 1.
boom so now they match up pretty well
right so that's that's the yaw rate as
perceived by the model
versus the yar rate as perceived by the
car
um now of course we have all other stuff
in the model too we can talk about
whether you have a lead car let's look
at the distance to the lead car
right now you want to bring that video
up again and we can watch and see if
they correspond that's not what i
want what do i want i want that okay
there we go
all right so we're going to see it looks
like for a while
there's no lead car you can see it's up
here we can also
throw that over there we can also go in
here and take a look at the probability
of the existence of the lead
so you see that we have zero probability
of an existence of a lead
until we get to like maybe beyond that
light and then once we're at that light
we're
super sure the lead exists and it's
really close to you so this is the
number of meters
from you to the car in front of you
um can you get live fed the data while
watching the video yes and we can
we'll get into how to do this stuff in a
minute
so this is all the offline explorer of
your data and of course
i'm showing you this on this one sample
piece of data but if you buy a comma 2
and you put it in your car
all this data is logged uploaded to our
servers and then you can
download it and you can analyze it you
can also pull it right off the device if
you don't want to use our servers
it's really just there to make it easier
cool um we can look at
all right so let's let's keep this video
up here
let me throw that up again
that over here we can look at for
example the
probability of the existence of a left
lane
uh let me also put the probability
existence of the right lane here
so you see for a while we get no lanes
and then we're going to start to see a
pretty strong
right lane right here once we get to
here
about 20 seconds into the video we have
the
distance to the right lane we can look
at lead cars we can also look at the
holistic path
we can look at how likely you are to be
engaged at a certain scenario
we can look at the likelihood you are to
disengage using the break
yeah right okay cool
but we're done with this for now that's
what's possible with plot juggler and
you can just that's just the example if
you want to do it with your own stuff
check it out it's all super easy to use
you just log in
and then you can put in this here is
what's called your dongle id
your dongle id is what uniquely
determines your device
and this here is your uh
route name uh so that's the route
let's go over here to user admin oh okay
i can't do that
ah
let me bring up user admin
dongle id
uh can you connect to the device and
show live data not right now
but we do have another tool called
unlogger and it's in tools replay
unlogger
oh what am i drinking i'm drinking
recess
uh recess
yo guys there's never been a better time
than right now to purchase uh
a comma two get in right now
and you get a great price before the
price goes up again
and you also get a free hat
free hat with purchase of a comma two
free hat
free hat uh it doesn't work on your car
what car do you have that you
say it doesn't work i know you don't get
a free car you do get a free hat while
supplies last
all may assuming we don't run out of
hats
is it legal in canada so is it legal
i mean it's not illegal right i don't
know if you live in a free country
or you live in a country where you have
to ask permission to do everything right
if you live in a free country
it's not illegal um
of course you're responsible for
complying with your own local laws and
regulations if you do live in an unfree
country
i'm very sorry you should come here to
in to america
where i drive around all day with my
comma two
and i'm super happy with it
um so you know
i don't know all i know is i'm in
america and we have freedom
oh thank you oh free hat whoa check it
out
yo you could get one of these if you buy
a coma two today
for only 10.99 10.99 that's a crazy good
price you know how much
tesla costs 10 000. you know much super
cruise costs five thousand dollars
even ford blues cruise cost sixteen
hundred dollars
something called blues cruise is more
expensive than the comma two
all right blues cruise
blues cruise oh yeah oh did you turn on
the blues cruise
no shaggy i didn't turn on the blues
cruise
you want to say hi
ah all right
thank you thank you thank you how many
people we got we got a lot of people in
the stream
whoa one thousand two hundred three
hundred and
so if you guys each bought a comma two
right now
we would run out of comma twos okay
but before we go crazy let's start
playing with unlogger
so i have this tool called on longer
here i can just type in
the uh
route name and i can type in the segment
name
press enter unlogger is going to connect
to the server it's going to download the
right files
hopefully well okay that one's a 404
let's try this one maybe this route is
going to replay
this will work with your route once
you're logged in
it's pretty easy to do all right cool so
these binding things right now what
you're seeing is those are all the
different messages being sent around
live so when we were looking in plot
juggler we were looking at them offline
but now they're all being broadcast on
my computer live now what's crazy
is i can just go in here to ui run the
open pilot ui
and here we go i'm running open pilot
right now on my computer
live replaying all this stuff so let's
skip ahead here to 300
got a little bit to load unloggers
unfortunately a piece of crap code
we have another one called nui that
we're working on we're actually going to
integrate
replaying in with the ui
um so we can run this ui and this is the
open pilot ui
we'll leave that up but we also have a
debug ui
i think it's in debug ui
ui view let's see what ui view is
oh the same thing
okay well wasn't that
oh i broke it
i can start on logger with a time uh or
i can't never mind none of this works
up controls unresponsive take control
out immediately boys take control
immediately
all right go we're back on skip to 300
again
and let's find my debug ui and it's an
internal
no that's just actually internal it's
all public where's the python ui
do we delete it
oh maybe it's in tools probably in tools
all right there we go replay ui dot pi
alright cool
so this is the debug ui of open pilot um
you can see right here it's got the lane
lines here
these are the radar points from the
other cars
uh yeah and then this is this is what
you actually see on the comma two
so yeah um we're watching all this stuff
live so
you know when you guys have a problem
with openpilot you can see this is the
lead car
if you look here that
that white dot is the radar point
and then that green square
is the output from the model with
uncertainty and then the red is where
open pilot's actually saying the car
is right now um sorry this stuff's a
little laggy
uh we're working on making it non-laggy
and i can show you some of our efforts
toward that
but um we're dealing with the same uh
annoyances
you are we'll see if nui works maybe nui
work oh you see it just turned green
so that means we're engaged right now so
openpile is driving the car
the driver got yelled at for being
distracted remember open piles of level
2 system always pay attention
we're tracking both those lanes no lanes
over here
you can see these light red that's
actually the road edges
we're going to use them for maps see
this triangle here is looking at our
lead car
and all this stuff is open source and
works
not just on the demo route but also on
your route
oh yeah oh oh oh wow wow you guys really
believe the austin us a luminar hype i
mean he's a nice guy i don't want to rag
on him too hard but spax are a scam bro
um what do you do yo i made a g today
but you made it in a sleazy way you know
don't do that
it just rolled the stuff so i i think
that was the driver
um
yeah yeah we gotta clean up that ui yo
if you guys are game designers and you
want to make this like ui looks sick
uh you know give me a job a comment on
jobs a comedy eye
or if you really think you're ready for
just email georgiacom ai
uh and we can chat uh if you got skills
man but if you don't got skills i'm
gonna be mad
um yeah
look at that look at that hdr
gasoline engines are useful
all right so that's ui that's the open
pilot ui and we're unlocking everything
right now but
we can take it a step further all right
so
this is all being run live i think i can
just run controls right here
now if i run on logger the thing
shouldn't be able to bind that normally
connect to control oh
never mind multiple publishers there
okay um i'm gonna have to figure out how
to tell unlogger not to publish certain
things
disabled and we'll figure out what
controls
i think some of this mess stuff might be
up to date
do we have anything about like who
broadcasts what
well let me just read the code so if i
go in here to controls we can see
there's something called pubmaster so
send can control state car state car
control car events and car params
we're gonna have to disable from the
replay
all right uh
well actually we also have to tell it
what we're replaying
which is this route unlogger also works
there we go now i can run controls
which should the vin query fail but
that's okay
so now this is running controls live
like it's taking in the information
pretending that there's a car
and it's running controls in the exact
same way it runs on the device
um so this stuff is how all our testing
frameworks work
so bring the ui back up up and you can
see that we're
out of storage
i don't know what that means uh
but all this stuff does run on pc it's
probably because i don't have any disk
space left
on data or maybe on raid i don't know
but i uh we also have
see if we have nui
no nui
we have a
uh somewhere a c
plus plus version of that replay tool
that shouldn't lag at all
i don't really know where it is
zookeeper oh zookeeper is our internal
testing wow that's public that's pretty
nice unless
uh zookeepers are internal testing
infrastructure which lets you actually
physically like test all of this stuff
on devices
send you one here
oh i think it got moved into ui replay
oh that's crazy
replay oh replay route oh let's see
what are the odds this is going to work
for events
oh cause that's is that the route that
doesn't work okay let's go back to that
route that i know works
about tools plot juggler cat read me
this one i know works replay
that all right
we're replay
good
there we go this is the stable uh simple
plus replay
you'll see that all this stuff now is
beautifully written in c
so you can toggle all of it just like
you can on the device look even the
scroll works
os version open pilot for pc
um you know click oh the pc is on 4g
right now
uh can i seek seeking doesn't work of
course not
uh oh this thing used to have a crappy
ui let's even get the crappy ui to work
no i think the crappy ui is gone
but yeah this is the new replay
infrastructure
more modern uh more useful
very good stuff all right what else do
we have in tools i showed you guys plot
juggler i showed you guys replays
is there anything else we wanted to see
these tools all work pretty well see
stuff in webcam
you guys know about the comma zero like
we've done so much stuff you know
this is all our blog
self-driving car for free you can make
open pilot run on a gaming laptop and
then you can like stick to webcams and
it'll drive
uh so you don't need to buy really
anything from us that is a black panda
that is a piece of comedy hardware but
look can if you make mistakes uh oh
you know what let's try one more thing
the simulator
we have a whole simulator for this thing
too and let's see if we can make it work
uh that's a good thing for this stream i
forgot about the simulator all right so
what have we seen so far in this stream
we've seen let's go let's get a google
i'm not google docs what do i want
text editor online just so i can write
some words for you guys
edit pad create new text note can i make
it big
yeah i can what is this side
this is terrible this is the worst text
editor i've ever used
let's try text editor dot co oh
no it's not good all right let's try for
html online text editor open
wow this one looks even crappier oh yeah
okay good good good we're good all right
let's get rid of this annotation all
right
so we have seen today two different ways
to use
open pilot one plot juggler
to view routes offline
two unlogger to replay
routes live
on ubuntu pc and three we're about to
see
carla simulation with openpilot
uh so what are routes these two are
using
real data this one is using
simulated data
this is using real data offline
this is using real data online
education
who is carla uh what does carla call it
is a simulator
um open source
cool people and we made open pilot work
in it
uh we've had yeah yeah people have got
no power to drive in all sorts of things
um
all right let's give carla a try
now these things are supposed to work
carla oh sim okay
install carla what's the odds is gonna
work boys
let's read the instructions before i
just go and do things
cat read me first start carla
then start bridge and open pilot to
engage open pilot press one
a few times while focused on bridge dot
pi
to increase the cruise speed oh
so we we have a low quality mode oh
that's cool
all right that's got to download that's
going to take a little bit i'm going to
be right back
uh i'm gonna spectre i can i can just
get rid of that for now
we'll do we'll get rid of followers only
chat we'll make it 30 minutes or make it
10 minutes just so we don't get too much
spam
um can i show live debugging of the
python code
you guys think i know how to use a
debugger i know how to use print
all right um by the way all these tools
designed for oh ubuntu
2004 but also on mac
not on windows
uh how many people we got working on
openpilot let's go take a look
we have 175.
hey look there's me
um the front part of this list is mostly
com employees except for dean lee dean
lee is our favorite external contributor
uh he's out here doing refactors
improving the quality of open power for
everybody like replace if deaths with
hardware abstraction layer
this is what makes code good quality
um yeah
my seeking functionality is coming uh
we're playing with navigation
we got zero eight four coming out soon
yeah so it's developed by a ton of like
different users you'll see
if you look at the release notes from
openpilot oh 78 right
if you look the release notes for
openpilot you'll see like most of the
time
uh the car supports being added by
external people and it's different
external people every time which is
really cool
so we got like a real you know open
source project going on here
uh we only hire engineers for the most
part
uh and it's like you know when you look
at a company i saw this really great
post i'm gonna shout it out
um i know i linked to it my slack random
so so let me uh
let me just bring up our internal slack
here where you guys can't see it off the
screen
oh this is terrible slack really doesn't
want you to
they really don't want you to uh use it
without
i don't have the app i'm sorry i didn't
download the app make your web apps work
it's irc bro make your web app work all
right cool
so you guys can see like there was an
issue filed on openpilot this morning
where uh
here we're all engaged it failed to
break for a lead car
uh so we can like look at this video
this stuff's around here
so you'll see what happens here is
there's a red light
this car is breaking but this car
doesn't break hard till
right there so then this car ends up
breaking hard
so you know we did a plot juggler
analysis
of that route and we found that
openpilot actually was at max breaking
already
when the user took over um
so it's cool
uh
yeah so this is like why we only hire
engineers
we hire some operations people as well
but we don't hire for example like
sales and marketing or technical writers
um
because of this trend at companies that
basically looks like
this uh i just think this is like
technical skills over time
comma is a highly technical company
after we solve self-driving cars i want
to go on to solve all of robotics
uh so you know we gotta we got a long
path ahead of us and it's gonna be very
technically hard and like
and at some point the technical skills
of the company become negative
and what does that mean that your
company knows so little about what it
does that if you were to ask a random
person on the street for advice on the
thing that your company makes
they're more likely to provide correct
answers than the people that actually
work for the company
and this for example can be seen in the
5g division when you ask someone working
in a big telecom company what 5g is
they will tell you a whole story about
self-driving cars
and it's all bullshit and the people on
the outside know that look maybe it's a
faster phone i don't know
but the people on the outside are not
fooled that the 5g phone will actually
improve your soccer skills as one of the
dutch communications as current
communication companies is currently
claiming so at some point your technical
contribution as a company becomes
negative and that's the point of no
return
because then also no good technical
person wants to work there anymore
we have incredible people here working
on this project
and we do it because well you know they
want to be around other incredible
people who are working on
a really difficult challenge in
a really smart way
um so yeah
okay um didn't work
easy install command is deprecated all
right maybe that's okay
maybe that's an okay error let's just
hope it's an okay can we start carla
huh all right we're gonna oh we gotta
download a docker
we love docker
uh that was linked on hacker news
you helped with this with what
oh and how fast our internet is now our
internet sucks
i mean i think it's gigabit down but our
up is pretty bad
my internet holds fast symmetra gigabyte
i actually think we didn't have to do
install carla and we might want to
consider deleting it
because i think it's all just moved to
start carla now
because it's all in docker yeah docker
using that nvidia docker
um it would be nice if unlogger is not
so cpu intensive well yeah
and that's why you got to use replay in
ui
um this is a c plus or implementation of
unlogger it borrows some parts from my
old nui
uh we allow homepod to be engaged at all
times we trust the user for that all
right
well at docker downloads we can talk
about some more parts of openpilot
uh so self drive is where a lot of the
main folders are
um we used to have a little diagram of
how all these services communicated
but i don't know where the diagram went
maybe it's in cereal
not there in cereal no no no
self drive well the services all
communicate in some weird way that
you know somebody should document um but
basically here so we'll look at controls
controls is the main
like process that's uh actually driving
the car
uh you see it publishes send can control
state car state car controlled car
events and car params
it listens for the state of the device
the state of the panda the model
how calibrated it is um one of the one
of the like
big engineering challenges that we've
overcome here is
oh man uh wait wait i gotta i gotta find
this
uh no you gotta like like
oh no no no lyft
built lyft built a turntable to
calibrate their cars
like they put the car on a huge
turntable
oh yes here
yes here we go look they they i just
want you to think about the amount of
money
that went into that compared to all of
comma ai
we just wrote some clever software that
runs on what's basically a cell phone
here's a comma two i see i'm working on
the boot loops
and here's neon gold uh this is the
older generation hardware
all right maybe the docker's running we
can try it
ah this is the old generation hardware
but it all calibrates entirely using
software
and intelligence uh tesla's doing the
same thing tesla's all
calibrating we watch them struggle with
their calibrator pretty much the same
way we did
all right so what do we have to do next
we have to start open pilot docker let's
start open pilot docker
oh we gotta download that too love
downloading stuff
the turntable salesman look at this what
a joke
do they think that's the future do they
think their cars are always going to
have to be parked on turntables
um man if we rode up more of the stuff
we do here
uh this is a great this is a great post
uh by our head of research harold
um who's now our cto uh
how we can drive without lanes um it's
similar it's similar to what nvidia is
doing it's similar to what nvidia is
doing with drivenet
but we're doing it at scale
not driving it i forget what it's called
but there's a bunch of guys in new
jersey working on it
what framework do we use for comma ai
like this website
i don't know i didn't make it
um view i think is that a framework the
blog is jekyll
wow docker slow
don't buy doge uh no we don't support
doge
don't don't feed that meme
um so here are all the cars it's super
easy when you're checking out your comma
two you can just like click a car
it'll automatically add the correct
harness for your car you can click buy
now remember
it's a dev kit it doesn't ship with any
software so if you want open pilot
you're gonna have to install it yourself
afterward
but there's plenty of tutorials that
will help you out with that
um when you have the device you'll be
able to install any software you choose
at your own risk
agree add to cart it just adds to your
car and you can check it out
yes okay we got the open pilot docker
all right
um all right vehicle online
oh we're up in carla wow that was so
easy that was just two dots slashes boys
i should have read the instructions and
not installed carla okay
i just go over here and i press one a
few times
all right we're engaged let's go
so this is all you can do this right
from your computer at home
uh it's super easy to do you can see the
model here working on this
model's probably predicting a little
more lane there because most roads are
banked i don't think there's any bank on
these carla roads
you can see open pilots doing a fine job
of driving in fact
what if i go crazy here can i dis can i
uh
disable to use the lane lines
oh yo we gotta fix our docker there's
supposed to be a kale emoji there
um so now all right so you can see that
it's driving beautifully
uh it's using the lane lines we got the
road edges displayed here but i think
there's some chance if i restart
carla it's actually going to take this
on-road and off-road and it's going to
respect my
laneless mode let's see
nope probably not
that's bridge
wait i don't understand
let's restart bridge
okay can air is gone i know if we uh
i want to go on road and off-road
i guess we can restart open pilot
it's all going to work open piles dead
launch open pilot
oh yeah look at that red that means now
we are in open pilot laneless mode i've
just enabled carrot model
not caramel carrot model is a scam but
i've enabled uh
my friend just texted me time to sell my
doge sounds like someone's watching the
stream
ditch doge boys um
now we got kale enabled right here in
carla and you can see that kale is
driving in
carla boys boys do you understand
the accomplishment here you can
replicate this on your computer with
entirely open source software
yo it's driving with no lane lines
through a world full of fake trees and a
fake sun
and lots of other stuff gg i think this
is a beautiful place to end the stream
by the way i want to shout out hadeeb
willem
matcha i think wei shing worked on some
of this stuff
uh vivek worked on some of this stuff
amazing job to everybody who made the
open pilot tools
actually work um
research worked on it too how the
mitchell worked on it
everyone worked on it sure chris worked
on it nick worked on everyone complained
about it
everyone on on discord who's
contributing uh you guys make openpilot
what it is thank you all for watching my
stream thank you all for being here
uh this stream was a shill for two
things uh this stream was a show for
three things three things three things
if you already have a comma two and
you're like wow i can explore my data
and improve open pilot
yeah do that you don't have to work here
you don't need anything from us
we've given you all these tools to help
you uh make your car better
that's what it's all about um this is
also a shill for after you've done that
after you've contributed a bunch of
things to openpilot people are always
like oh george i don't have the skills
how can i get a job here well i don't
know
i mean there's some people who actually
don't have the skills but there's some
people who just think they don't have
the skills
show you have the skills right
contribute open pilots open source
submit pull requests
github comment ai open pilot let's move
this guy over a little bit we can uh
we'll show for the github right here
um yeah just just look at all the people
submitting pull requests
um if you guys think you can contribute
you know check it out it's open source
code
uh fork it uh
yeah pull request to fix spelling errors
meh meh
um yeah if you're interested in a job
here
uh that's the other thing we're shilling
for uh
san diego on-site for rotterdam on site
uh we're not a remote company
like a lot of remote works a scam uh you
know we work hard but we build something
real and that's the cool thing about it
like you you know you work with some
companies like oh it's great i can slack
off all day but then
when you're on your death bed and you're
like what did i do with my life man
you know you're just gonna be like i
didn't do shit i slacked off and took
the easy route
you know or you can you know be like
dude
i saw self-driving cars uh and i think
that's pretty sweet
that's why i keep doing this uh
yeah we have a europe office uh thanks
trump
uh and we have an america office uh in
san diego
um yeah i'm anti-remote work
uh i think i don't know what like we
have a culture
we have a culture of excellence with
culture quality we have a culture of
knowing things we have a culture of
you know like being good at things what
kind of culture can you have remotely i
don't know
yeah i mean it's not perfect boys it's
not perfect feel free to improve it
uh
uh do we allow work from home at all
yeah if you like work from home one day
a week yeah that's fine
uh just not remote
um will you ever get commented code uh
you come here and add comments if you
submit pull requests and they're good
comments we'll merge them
um
this it actually drives much better in
real life
oh no we hit the torque limit
uh
the other thing that i'm here to show
for aside from contributing to open
pilot
uh getting a job at comma ai we have a
website for that comedy
jobs uh
this is our company mission solve
self-driving cars while delivering
shippable intermediaries
um you know people come to me and
they're like george but you know don't
you want to like
like like sell it to a lot of people and
market and partner and i'm like
bro we want to solve self-driving cars
while delivering shippable
intermediaries that's the company
mission
uh you gotta have a mission these days
you know because otherwise you'll end up
in the weeds man
you know you'll end up you'll end up
doing who knows what you know some
companies they just go way off track we
got a company mission
solve self-driving cars while delivering
shippable intermediaries
um so yeah we're hiring
uh yeah and it was pretty cool that we
do it so like
uh we have programming challenge uh we
do
a couple phone interviews and then we'll
bring you out all expenses paid for a
micro internship
which is like a two three day work with
the team work in our real code base
you know you feel it out to see if it's
a good fit um
so that's pretty cool uh
software engineer yo can you build a
waze like app people will use willem's
been been actually doing a great job on
this but
you know we're always looking to hire
someone to to help out build navigation
for open pilot uh our stuff's on qt5 now
same as tesla
um you got to have some c plus plus
coding skills if you have good design
sense that's nice you can see the font
is not as good as it was pulling there
um and ability to deliver on a quality
experience we really pride ourselves
on our experience senior full stack
engineer
i can't believe the amount of people who
apply for this job that are full stack
engineers and like i ask you if you know
how the internet works and turns out
people don't know how the internet works
like bro what port is dns on you know
you should know that right if you don't
know that it's 53 i don't know what
you've been doing with your life
um not being a full stack engineer
probably only coding and node.js or
something
um but if you know stuff like that
you're like bro that's easy i could
actually tell you about like
send synack and ack and all that stuff
then uh yeah you might be a good fit for
this you know i just asked one question
i'm like i go to google.com what happens
right like i type it in my little
browser on linux and
you know we could go all the way down to
timer interrupts if you want man
um interface designer engineer
we're trying to take open pilot to the
next level with interface
uh design experience implement this
stuff
you can see we're really we're really
pushing on this you know it's our it's
our qtui
interface designer help out with the
apps as well the apps are kind of a
trash pile right now
we hired a guy in rotterdam yoast who's
really improving that situation pretty
fast um we'd have a new app to you guys
but unfortunately you know apple and the
30 percent
oh yeah we crashed oh no boys oh no
the car crashed oh what do we do what do
we do
is there a button for this let's read
the readme
um it actually drives better in real
life than the simulator
because we put a lot more time into you
know driving in real life in the
simulator
uh i don't know how do i
oh
eggs at all
all right well so that was good while it
lasted um it drove for a nice reasonable
uh
20 minutes or something three minutes
yo if you want to come here and you want
to get a job and you want to fix a
simulator
uh that's cool we want to add more
scenarios to the simulator too
um do we have any junior positions i
don't know what that means
i've heard people say this before like
will i hire you if you're fresh out of
college
sure i'm not going to discriminate i'm
super ant i think discrimination's for
losers man
like people who are like you have this
or you have that or you're this or
you're that i don't care
the only thing i'm discriminating based
on is whether you got skill
so if you got skill welcome uh i don't
care if you're junior i don't care if
you're senior
i don't care if you're a dog man if a
dog showed up and be like
ruff ruff i can program ruff and like
i'd be like yo
pull requests then be like ruff i
submitted three pull requests to open
pile i'd be like congratulations man
i'll even buy you a dog chair or
whatever it is you want
you want bones we got bones for lunch
you know we can we can we can make that
happen
um it's all about having skills it's all
about being able to you know contribute
at a high level to these kind of
projects
um
53 ml engineer data scientist research
is probably the hardest team to get
hired for around here
uh but you know people have done it
um research is working on
actually making those models this is one
of the areas look we're behind tesla and
hardware
we're maybe on par with tesla and
infrastructure they're probably a bit
ahead of us
actually um we're way ahead in hardware
you know they're ahead in unit store
installed but i do think we're
ahead on machine learning uh i do think
our ground truthing is all automatically
supervised
if you saw we dropped on twitter
yesterday
uh do open pilot tools work let's find
out who's watching the stream
wow it's so self-referential where we're
on the stream looking at the twitter
showing for the stream uh no we have a
cto
um see the yellow line coming soon to
the comma two
this is all unsupervised this is this
new thing called stop lines
and it's going to say yo see that line
humans stop there
and we can be like open pilot you stop
there too
um can do we pay with cheap no we pay
you with
real u.s dollars if someone came in was
like hardcore about wanting to be paid
in crypto i think we could make that
happen too
um i understand people who are like i
don't want to be a part of the system
uh senior software engineer uh
safety engineer uh we're always looking
for people to improve the safety of open
pilot
so this is a bit of data science it's a
bit of actually working on the panda
code expanding the safety model
of open pilot to start to allow things
like well so right now we disengage
always when you press the gas
but that's going to have to change when
we ship when we ship stop signs
i won't pay you in ripple i'm sorry um
uh only some of the positions are
available in rotterdam look i mean
how serious are we about these positions
like if you have skills and you can
contribute to this project and you have
you can convince that you can contribute
to the project from rotterdam
we'll happily hire you over there i mean
willem kind of runs rotterdam
if you impress willem uh you got a job
you don't even have to impress me
um
uh electronics engineer uh
got a we got an intern who's who's
working on this it's working out pretty
well
uh so yeah there's there's that
um and
infrastructure engineer oh we're very
excited to hire for infrastructure
engineer
uh we have an incredible infrastructure
engineer right now greg
you built the he built this we have this
whole data center we have i wish i could
show you guys
we got a two pay-to-bite spinning disk
array we have almost a petabyte of ssds
um you know here's like data.com.life
this is this is where all of our data is
stored
uh at the office
you see that's just some of the data uh
i don't care about degrees
uh sorry not a data well okay the part
that has the hard drives is a data
center
but the gpus are in a separate part
that's not a data center
that's right the the data center does
have v100s in it that's true
the nine uh the 3090s are just
under somebody's desk for research
about 20 employees right now i don't
have a degree i do not care if you have
a degree
[Music]
uh yeah
all right so the things i'm the chill
for contributing to openpilot i showed
you guys how to contribute
i showed you guys how to do it with your
your own car
uh where's my little document yeah plot
drug order view routes offline
unlogger to replay routes live and then
carla simulation with openpilot where it
only sometimes crashes into the wall
um we're not looking for investment
uh we now our revenue
is about to surpass we've raised 8.1
million dollars and our all-time revenue
is about to pass that i'm very excited
uh we are a profitable company uh so
we're not really looking for investors
right now
i played around with the idea a little
bit but you know sales were so good i'm
like yo
just like thank you people for
supporting us i'm glad to see that you
all like what we're doing
uh really i was at dinner last night
and um my friend's friend came up to me
and she's like yo
i bought an open pilot in january i
bought a coma too
and i spun on some road trips and it's
mad chill uh
just like like people who you'd never
think you know
people who you'd never think like would
get open pilot went out and got it
uh will we ever go public no fuck the
finance people
uh i do not like them i do not like them
sam i am
uh if we ever do if the regulations ever
shape up such that we can put
comma stock on uh the blockchain if we
could wrap comma stock with an erc20 i
think tether for private equity
i'm interested in doing that um
so that would be the closest you'd get
to us going public but we ever gonna ipo
or god forbid spat
no but really i mean let's just get rich
and pay dividends
like private equity bro
uh keep it private keep it controlled
uh don't let the finance people own your
shit because you'll end up like that
that thing that i posted uh bert hub
i don't remember where it is
uh you know what i'll post that in chat
because you guys all should read it
everybody should read that
uh and you know it's never gonna happen
here uh
internship wow it says they're only in
rotterdam we could technically do
internships here in san diego too
um yeah this is vivec's blog post
uh he put it on twitter he's joining us
full time
yeah uh do people from good old car
companies
honestly like we got to reach out
recently from a car company and like
they're
serious kind of but i think there might
just be like a like just an upheaval in
this industry
right these companies don't understand
software
and they also think that like their
brand matters
you know i just did a thing for like
well like if i search for like
top 10 android phones
look at the top android phone the top
android phone is the oneplus 9 pro
oneplus is a company that's been around
for under 10 years
and they're now making like the best
android phone
right it's not it's not any company
you've heard of look google
samsung right where's blackberry
where's nokia where's motorola these
these
unstoppable phone giants
15 years ago are now nowhere
um yeah
moto they continued a little bit but
they were like bought and sold for their
ip three times
uh samsung's still there yeah you know
when it comes to oems like the oem that
i would take the most seriously if they
reached out to me
it's like hyundai because i think
hyundai understands the future
right if like gm reached out to me i'd
throw up a little bit in my mouth like
oh yeah i want to ride around in my
chevy bolt
oh oh god even the worst cars they make
ah i didn't respond what do you
we have a pole hole uh
you know back office that responds to to
things if you really reach out to me and
grab my attention my email is george a
comment hi
uh you know somebody shout out but like
we don't think it's gonna work that way
right
like i'm not gonna like talk to
hyundai's business development team
the engineers at hyundai at honda at
toyota at volkswagen at subaru
are going to go out and buy coma twos
put it in their personal car and be like
yo guys have seen
if you guys haven't seen this this is
consumer reports from last november
um gross
sorry cadillac sorry tesla sorry ford
sorry
audi sorry mercedes sorry subaru sorry
hyundai
sorry bm but we're not even gonna name
those comma two
king of the eight ass
um
we're beating tesla so if you look at
how we're beating tesla
it's it's interesting so tesla actually
beat us on capabilities
um but tesla lost out massively at
keeping driver engaged because they're
touching the wheel thing is terrible
clear when safe to use is terrible
uh like you guys saw my tesla stream
those complaints were not like for show
like i want to see tesla be great i'm
not here to dump on anybody like
you know i appreciate quality and
there's some things about tesla that are
really nice
like capabilities and performance but
when it comes to like their driver
monitoring solution
or they're confusing as fuck like ui
well you know
um no yeah the germans are like our
veins run with gasoline and like that's
great man but like your veins gotta run
with python
because that's how you build a modern
car company um oh yeah the r
d price for consumer it's a joke
it's a joke but yeah if you like winning
uh come work at comma
if you want to just experience winning
yourself uh buy a comma two
uh we support a whole lot of cars if
someone's like i want to buy a coma too
but my car's not supported
post in chat right now what your car is
yeah sorry about the volvo the newer
f-150s if you don't have a lockout we
can do that
okay if you have a car that's older than
2015 i can't help you at all
um those kias if they're new they should
totally work
uh 2020 super impressive works bro buy
one
okay so we're not going to be able to
support volvo benz
uh i think we tweeted this we tweeted
like we support all the brands
except for like the few we can't
oh support god i can't believe i just
saw a picture of donald trump
ultra rare merch bro that's the old hat
if you want a new hat
buy a comma 2 right now get a hat you
you guys just
click the buy button right now i'll go
look at my shopify
we'll we'll come in chris if you're
watching this let's
let's have a buy-a-thon right now how
can we have a buy-a-thon
um i haven't been to the office in
rotterdam they won't let me in there man
uh
you just got here can you run you
through how to contribute uh rewind bro
you heard of the rewind button press it
uh one percent off yeah we do one taller
off
um but yeah
uh or you know if you just want to right
now go clone open pilot check out that
plot juggler thing i showed at the
beginning of the stream
check out carla seems like it's just two
docker containers now
that's great um
why not skoda octavia i think we support
some skodas don't we
i think we could do that yeah it's just
like why not like add support
you can do it uh why can't i go to
rotterdam
it's like restrictions i don't know i
haven't tried that hard
uh will the sonata hybrid get vision
along with the ice sonata yes and
there's no reason the hyundai hybrids
can't work it's just somebody needs to
put a little bit of effort into
upgrading the panda safety and make the
gas signal work
um where's the pytorch model oh and show
you guys the models
the models are in this folder here
called models
uh so we provide the models in two
formats for
you guys um why is there something
called current
i understand why that's there oh that's
just the name of the
that's gross
this is just a text file that says what
the like internal ids of the model are
um i don't know maybe that's not that
gross i'll think about it more but we
provide the models in two formats
um so dlc is the format that runs on the
device
using our hacked version of smpe which
adds need on top of it for more we could
have a whole stream about that
ah no remote onyx is the most standard
model format we use
um i can't think of it right now
uh microsoft onyx runner might just call
the onyx runner yeah onyx runtime that's
it
so you can use this thing called onyx
runtime to run it there's also tons of
tools to deal with onyx
um people are like but why don't you
open source the pie torch model i'm like
that is the pie
torch model we save the pie torch models
in onyx format
no i said smpe this uh snapdragon neural
partisan sdk
yeah see this thing and then we like
build this thing on top of it called
need
uh so this is the models and if you want
to see the code that actually runs the
models we can go in here to open pilot
in self drive model d
uh and this is model d which actually
runs the models
this is the need is an s p e accelerator
i know s p e is already accelerated i'm
chilling for it because i wrote it and
i'm excited about it
um we don't hire installers we don't
hire sales people
we don't we hire like because that stuff
doesn't pay returns
if you build software if you build good
infrastructure if you build solid
tooling if you build you know very
mature code bases like that stuff will
pay returns
thousands of times over and that's why
we're going to be a billion dollar
company
uh i don't know what security means like
people like security i have no idea what
security means
you know as someone who like worked in
it like would i hire myself like someone
to find bugs no that's worthless
um
customer service pays returns we do
customer service contractors uh
we're trying to oh features roadmap yeah
we can talk about that
um so this is the this is the 0.9
features roadmap
and then i think we have other ones too
deep linked me to them once but i forget
exactly how to get to them
if we just oh yeah the tags so this is
the tag for
for 084 uh so this is what we have to
get down for zero eight four and then we
have a whole bunch of tags for
zero eight five as well
oh zero eight five here we go so this is
the stuff that's gonna get in zero eight
five
uh but these are the zero point nine
things vision only longitudinal and to
end longitudinal
you're going to be able to put the
blinker on and it's going to
automatically take the exit for you
it does not take exits that's been fixed
for a long time 100
dm there's still some false positives we
got to get we got to get rid of them but
things are a lot better we just trained
a brand new dm model uh
it's not gonna make zero eight four but
it is gonna be in zero eight five
um we gotta support big model there's a
pull request in progress for that
auto tune is the auto tune on uh no more
hugging
we're doing pretty well on cpu we're
bringing
open pilot into uh like we have a lot of
testing but
we can even go further with this to be
able to like replay open pilot and bulk
on
thousands of routes before we ship any
versions of it so that's what that means
multi-language support got a list of
languages we're going to support
reduce ping pong this has already been
done we were paying log entries like a
thousand dollars a month we replaced it
with our own thing
i don't know if we would play sentry uh
replace off-road with qt that's already
done
um yeah the kia forte 2020 i know it
might say sorry but like i'm sure that
car will work
oh wait really oh that's a bug
because it says right here that it
supports it
you're telling me that if i go to comma
ai
right here it says kia forte works
will it work on my kia
are you trolling me what do we have bugs
forte 2020
does your car have a built-in camera oh
yeah oh it needs to have a built-in
camera oh if it doesn't have a built-in
camera it's not supported
i didn't see this yeah that means it
needs that uh thing
same for skoda the brand doesn't even
show up
oh yo chris gotta make skoda show up
i gotta add skoda to the website your
car doesn't have the intelligent cruise
control yeah that's too bad
uh will zero nine come before july no
can i come back to my note about
security what is security bro
just good engineering security is good
engineering right
you don't have a separate security team
it's everyone's job
uh oh you could be everyone's job yeah
we can
um
what do i think mobility will look like
20 years from now
i can't say anything about 20 years from
now five years from now it's gonna be
like it is today but with more open
pilot and autopilot
uh and maybe even mobile eye will show
up with something like windows phone
uh 2016 hyundai elantra i think that's a
little too old how good are stop lines
they're okay we're still working on them
you can't find the hat so the hat
i believe the only way to get the hat is
if you buy a comma 2 and it includes a
free hat
but we maybe include the hat if we go to
merch
you can buy beanies for 69 and the
beanie will never be sold for less than
so it's a good buy always we put a floor
on those nfts
um yo you need that hat well
buy uh yo this is a cat free hat would
purchase a coma too
yo it's adjustable to fit my big head oh
big head on the beat
t-shirt is sold out yeah why is our
t-shirt sold out
i'm gonna go complain about that you
want the hat
buy a comma too oh big head on the beat
um elon finally under good open tesla on
y ios for android boys
um international interns that don't have
a us visa
rotterdam uh we can also maybe we're
good
you know i i think that the immigration
you know
i think immigration is rough in america
uh
and we're happy to do what we can to
help you out as a company
uh
i'm not doing ctfs do i ever get burnt
out no that sounds like it's for bitches
man
uh you buy the nft
you want to do it the other way around
android on ios yeah that's what i meant
uh
can i add baklavas maybe yeah maybe
is that a dessert or a hat
uh ai or car controls hey i mean
long term more and more of com is gonna
be research
but i don't know no there's like a long
tail of car controls as well that's like
they're just very different problems
um all right
so buy a comma two
contribute to github
and let's just bring up a third window
here and
if you're qualified apply or
job github shop
free hat job
also tools check out the tools check out
the tools you guys can use them at home
you guys can play
at home
you'll buy a comic too just to get a hat
yo that's that's hardcore bro
that's hardcore uh
she said you're gonna end the stream a
while ago dude do something more useful
uh yeah good point bro thank you for
watching i appreciate all
you thank you for supporting my twitch
if you like me
subscribe if i like look and i'm like oh
my god i got so many subscribers today
maybe i'll even start streaming again
um or if i look and we sold like 50
comma twos
yo if i sold 50 comma twos man uh
that'll be that'll be a crazy day
that'll be a crazy day and i'll
definitely be more excited about
streaming and i'll do more open pile
streams for you guys
so um yeah this is these are my notes
check out my notes read my notes
uh you guys can do all this on mac too
uh yes dev kit that's right
uh check how many got sold uh most
comments sold in a day yo like last year
black friday was crazy
we made like 650k in november last year
uh yeah i think the dev related content
will help people submit prs i agree with
that
uh can you get a free hat with the phone
call uh the phone call is no longer
uh you know with the president the phone
calls with the head of business
development
there were some people buying the phone
call who shouldn't have been buying the
phone call
uh and if you buy the phone call and you
shouldn't be buying the phone call
you don't get a phone call uh 650 in
revenue yeah
oh well the price used to be 9.99 and
like someone dm yesterday i was like
bro i know it's 10.99 now but can i get
it for 9.99 and i'm like no
and you can wait till it gets to 11.99
and then i won't give it to you for
10.99 you can get it for 10.99 now so
it's a pretty good deal
now who are the people who shouldn't buy
uh if you expect a consumer product
and didn't read the word dev kit uh if
you're a whiner
or a hater uh or if you don't have a
sporty car
so just those those those group of
people did we really hire biz dev no we
did not
uh it's kind of a joke but it's also to
stop you know
i mean yes there's somebody at comma
uh with the title vp of business
development
are they a hired biz dev person no
they're an engineer
they're an engineer who thought that
title would be funny
um is it legal to use it in europe i i
gave you the talk already about freedom
right like i live in a free country
in america we don't ask the question is
it legal we ask the question is it
illegal and is it illegal
i don't think so
um it's pretty damn close to a consumer
product it is it is we're getting there
can you get it for 1500 yes use promo
code i want to pay more money
again is it illegal that's what we ask
no it's not illegal the other
thing too is like people are like but my
insurance
we've had a whole lot of people now who
call their insurance company
explain to them what the device is and
the insurance company is like
okay i'm fine with that like insurance
is fine with this kind of stuff for the
most part i mean call your insurance
company if you want to make doubly short
but people think it's going to void
their insurance or void their warranty
it's not um insurance i mean
we don't know we don't actually have the
statistics but
i'll say this like now you know knock on
wood we're driven
40 million miles and like there have
been some accidents but there haven't
been any injuries
right there definitely haven't been any
fatalities which means we're doing way
better than uber
um so like
yeah i mean they've been accidents
obviously humans get into accidents once
every
500 000 miles but again we're not sure
we're getting them all but as far as i
can tell the accident rate with comma
twos is significantly lower than the
average
uh so again why wouldn't an insurance
company want to want to cover you
um the answer is no reason they do
uh so again no promises about your
insurance company but
lust but thank you for gifting subs you
get a free question um
and as far as uh
warranty goes you know like if your
engine breaks the dealer's not gonna
void your warranty because you install
this they don't even know if you take it
out but i don't like
they can't even legally do that like if
they want to try to avoid your warranty
they have to show that the
failure was caused by the aftermarket
market product
uh yeah four
just ford is annoying because of the
lockout we could do ford i don't know
maybe it's time to revisit ford i always
say that i never do
i will work on your tesla if your tesla
has autopilot ap one or
two yes but it's going to take a bit
more work
um yeah hashtag not legal advice uh what
about audi uh yo the hat
oh yo if the hat's illegal in your
country because it's just too much
freedom
i mean i don't know is this hat legal in
like north korea i don't know man
not to rip on north korea i'm sure kim's
got a nice country going on there
uh but i don't know if the hat's legal
there it just it just reminds people of
freedom
um chrysler is a mess yeah
uh you definitely can be arrested for
tweeting the wrong things free speech
does not mean a license to say anything
at all you want there's definitely
things you can't say
but you know that's not like they're
like
things like obvious you know
[Music]
the hat will make you better coder just
like 5g will make you better at soccer
why is that a good looking company
because like look at their nice shiny
you know they just got the best carplay
experience
um what else we got
i think that's all we got
all right uh oh well actually i
do have a question lustber did you have
a question
you gifted subs if you give subs you get
a free question honestly drop the ai and
just sell hats are we using attention
blocks no
um it's just it's an efficient epi too
um you should stop you wanted to stop
like half an hour go over here no
question just wanted to say i love your
recent blog how's the podcast thank you
what is luminar competition no there are
scams man
there are scams we have two we have two
areas of competition
all right and like tesla's not really
our competition our competition is like
mobile eye and legacy automakers right
like who's whose linux is competition
well it's like windows right it's not
only mac it's windows so who's our
competition let's mobilize
no you can't buy shares nope private
equity bro
um yeah if i could tie my company shares
to erc20 i would do it but
there's a lot of legal implications uh
oh neo oh i like neo
uh i like neo chinese are gonna win cars
bro just like oneplus
okay everybody we were live for one
hour and 42 minutes that's pretty short
stream actually that's why it feels like
that's why it feels like there's got to
be more stream
um if you did a spec you're a scammer
that's all i'll say
uh no i don't want money i've told you
guys
i don't know what i buy you know what
i'd like to buy
a solution to self-driving cars oh but i
can't buy one
we're trying though if anyone knows how
to buy one i'm interested common will
pay any amount of money
um
my aix i
yo just just proceed to check out buy a
coma 2
right now check out this beautiful
uh get a very rarely sent email about
new products and promotions i can't
believe that's a copy uh i think we let
you pay with crypto too is that one for
crypto
i don't know i didn't make our website
you're trying deep oh yeah oh by the way
here's another way you can contribute uh
we have a whole bunch of github
we have a whole bunch of repos on github
it's not just open pilot
oh this is my private kit how we're
gonna get rid of that
um
comma 10k uh if you guys like
labeling images uh
you know they look like this you guys
can like label all those pixels it helps
our ai
uh this is like our first stage in the
processing we call the segnet
we use it to filter out all the movable
objects when we're trying to derive the
ego motion of the car
getting very precise eco motion of a car
is hard
um rebuying the old eon promo no
no more eons no more trade-ins eons are
like two years ago now
that's so two years ago um
if you buy a coma two does a small box
come with a car we do not sell cars
unfortunately maybe someday maybe
someday we'll buy ford what do you guys
think
um what does mit license mean
i'll show you uh
permission is hereby granted free of
charge to anybody obtaining a copy of
this software to deal in the software
without restrictions including
limitations blah blah blah blah blah
blah
also you don't get any warranty
um i've been pretty happy with shopify
for the most part they've been pretty
good to us
cool okay that's it that's really it for
the stream
that's really it for the stream we'll
just leave you
with this real data
offline real data online simulated
submit pr
get job buy
comma two free hack
big big big big big
thank you everybody if you come work
here yeah if you come work here i'll
give you two hats
we aren't good right shut up and our
master Mirotic yonder dealership yeah
buddy
the Hyundai dealer shhh
all right we're in HD a mode ok doing
something
perfectly straight line when John died
HTA
we think I'm telling nectar person on
Twitter first you to live
[Music]
you got a few discard we have 14 14 so I
think we got to go back soon we don't up
for too many miles on this car pretty
good though it's pretty good let's see
if we get like anything at all that's
hard
which bank to be robbed yeah that's a
good question
they said you'd go 163 will it make a
turn pretty good
long did it do it yeah all right now
let's let's take trying to have it do
some a little art let's go here Oh God
what model Sonata Limited 2020 oh god
that's so terrifying
it does not make turns doing something
yeah that Lexus is like screw you we get
it
I don't let its key thing about now oh
it's detecting that thar line is a lame
wait this is actually really concerning
its steering right now is it yeah how I
disengaged
the mode confusion on this is
unbelievable I just take the next exit
what is that sound we don't know what
was that sound
[Music]
assisting because it thought that the
crack in the pavement was a lane or
service lane departure warning
Thank You Congrats in the profitable
quarter yes thank you thank you
wait so next exit soon there's like
points
because cars kid
this later equality can they make a turn
how does driver hit monitoring handle
masks farewell
[Music]
okay
let's move down to 31 we want to go
right or left let go left or right left
and it does not continue yeah wouldn't
have seen that car you think but look at
this cool thing you guys Oh with the
blinkers they have the okay look at that
they have the camera yeah
does this one I've stop and go
definitely this is Sean guys I think
it's the same one that's on the palisade
so it is their highest end it has this
always on seems like a very it seems
like Oh
adaptive cruise has anything to do with
that well
just for our enjoyment Hey oh yeah it
gets a higher trim you get a smaller
engine and it's actually slower I think
gonna gives us more gas higher trim
slower
I love slower engine you said he has
like a 1.6 liter turbo engine look at
that space back there for Willam so much
room so much room in this car crazy
oh wow
[Music]
delayed reaction what's assisting Haley
yes you want to take the exit valve
little out Avenue oh yeah
[Music]
it's good at straight lines though don't
ask it for like torpor like this it
probably will be okay
[Music]
I know it's stabbing me
wait why does it nag you because you
haven't touched the wheel in a while
[Music]
that's pretty good yeah yeah I'd say so
like this straight line I'd say it's
pretty close to open pilot - I mean
everybody can do this train long doing
nothing yeah they're just - just let me
drift over that line
I'm still not sure and hear it but it
won't do well okay okay West yeah so if
you're coming at all in an angle to the
lines it doesn't seem to do anything it
seems to be very like they seem to have
a very sort of it's interesting I mean
this was one of the things discussed in
the in the safety discussions on costume
Forks about whether cars can steer
[Music]
without being engaged and they seem to
take the philosophy that you can but
they're steering codes are incredibly
weak so we cut it doesn't seem like like
like we'll do anything here it won't
yeah like the steering wheel needs to be
green on the dash
and laughed at the line so now what if I
like its flashing green it's a nice off
so now it's off so it's green like locks
on I say it was just green man okay
that's interesting
oh well like it's good mom yeah yeah no
he gets good marks yeah well so yeah we
learned yesterday that there's a some
entrepreneurial South Korean I'm not
gonna say anything about I don't know if
they're care an adult or a man or a
woman who's been testing out I think I
took nothing literally took nothing
[Music]
who's been who's been doing free on
installation services around South Korea
got a fork Hsu mm mm yeah Wow got a four
why isn't George wearing a comma hoodie
wait wait calm hoodies like that
everyone would wear them by this car
guys for what it's worth
Erik Morocco says South Korea has been
buying a ton of pandas from me oh
they're buying panda that's what they do
it yeah that makes sense yeah yeah yeah
don't buy a white panda you're gonna be
very disappointed when open 5:08 comes
out about zero way it's gonna require
the GPS
GPS Aston Martin stop there yeah we just
have oh I guess it has smart Park so
it's not like Park Assist I haven't seen
it put any big big torque on the
steering but here's another reason we're
buying this car
Yandex is now using them in Russia as
their base platform for their level 4 so
this will be kamas base platform for our
let's just say full self-driving before
is a stupid toy
just just do it Yandex does you're sorry
so I'm locked on right now does this
mean I guess I don't even need the
cruise control to use this
see there's on the right you're right
the Subaru oh yeah yeah Mabel are on the
other side yeah that's terrible
all right this is let's see what does
this turn yeah this intersection
all right lost it in the intersection
it's like oh it's the green thing okay
okay at least the green thing is helpful
for you as the driver you know I kind of
missed uh like a deep or something
didn't you notice the same system where
I so log on but then it beeps when it
locks up so you know it's gonna work
hmm that oh yeah oh well it separates
the steering from there longer No
it is nice we shall show the broken trip
yeah it has a broken trim see this is a
new card some serious production
problems like things falling off why
wait let's try some our park yeah so I
turn it on sorry you guys I'm like
shaking this okay it's on I press this
button use forward a backward button on
smart key after leaving vehicle so we
have to leave okay I'm not staying in
eat kidding me what if it crashes
I'll stay in this is a little wearing
this car might be moving oh yeah yeah
and George is using this with the remote
well there you go
that make sense yeah I've got a die at
some point you guys that's not bad
not really try it's also aggressive with
the brakes
a little not really not from what I saw
you can say it's pretty straight Oh Oh
interesting
all right the sales department is open
because we learned that and they are a
essential business sales department is
an essential business you guys that's
pretty fun to be in the air look at that
though fun
very nice masterpiece
uh hello everybody uh
just wanted to show you guys a quick
drive you guys know that uh
i don't know no one put any driving
videos up yet so i thought i'd do a
quick one
uh the commentary is very real
my phone also is real low on battery
so if we randomly cut out uh it's
probably because my phone died
um you can see the screen is very
similar
to the comma 2 except more
beautiful let's get on the highway
get over to the middle lane and then
once we're on the highway
we can chill
now we can just engage it here let's go
all right
lane change uh we're on the lane full
model
of course it has the exact same laneless
toggle
as the comma two
uh so yeah we're just gonna chill bros
see if i try to lane change with someone
in my blind spot we got car detected in
blind spot but now that they're gone
just move over here just like the combat
two
but better and even more chill and more
beautiful
you guys can see the beautiful screen uh
on my on my windshield that oled gives a
crispiness
that you just can't compete with
anywhere it's my uh
my legs and the wheel what we do in
there
see everything uh so yeah my phone is
almost out of battery
so hopefully it's charging fast enough
it is plugged into my hyundai sonata
which we're chilling in right now
is beautiful it is beautiful guys like
i'm looking at the phone screen and the
picture looks way better on the device
you just can't capture the crispiness of
the screen with the
uncrispy iphone camera we'll get some
hdr camera up in here
um
yeah uh
it's me boys got my three comma hat on
chillin here's one hand the other hand
is holding the phone
looking at the road at all times of
course it has the same driver monitoring
as the uh oh show nav
of course yeah we could just bring up a
map if we go like this
so we'll give that map a minute to load
here and there's our map
you can see me driving down the san
diego freeway
uh we've opted to remove the traffic i
guess it's just not in this rev
uh because the traffic is spotty and
kind of shitty uh
but yeah oh yeah how did i how did i
forget to show you guys that
nav if we actually want to navigate to
somewhere
we can go in here we can go to
navigation that's the uh
it's telling us to make a u-turn if we
want to navigate back to the office
uh the map is online
oh gotta cut in here
we're of course on honda's stock uh acc
not open pilots it was open pods you
could have let it go
but i'm sorry not hondas i mean
hyundai's
uh so we're just gonna get off here at
seaworld drive
let's do an automatic lane change here
boom
still got a bit of improvements to do to
the software
uh but overall you're out of the box
experience
should be greater than or equal to a
comma two
uh and that's just from a driving
perspective
from a beauty perspective it's 100
better so i could do something we could
do some of this road too
uh will the nav talk one day no that's
terrible
i never make the nap talk i would do
that to all y'all
all right so it looks like i got eight
minutes to get home
uh we could pull over here and do some
questions quickly
just find a good spot to pull over
but yeah comma 3 driving footage i'm not
a professional
photographer
is the lane change automatic or does it
still need the driver nudge
still needs the driver node you don't
want automatic lane change it's not a
good feature
uh
is the screen ever gonna get bigger it
does not come with a growing screen i'm
sorry uh the screen on this is slightly
bigger than the screen on the comma two
it's also borderless which is really
nice
um so
yeah let's uh
let's pull into this sketchy parking lot
right up next to this uh bus
yeah any quick questions i think that
was just a quick stream
real footage of the commentary driving
get yours today at
comet dot ai slash shop or just go to
comma dot ai is the screen ever gonna
get smaller
uh how will it perform in the mountains
bit better than the two uh the alignment
is still centered absolutely yeah yeah
so you'll see
you'll see we can we can toggle between
uh
well actually we'll go off right here uh
so we can toggle between
navigation and uh the sidebar
if we go off off-road see we're
subscribed to comma prime
you can see in the settings here
navigation
uh you can also control this in uh
running open pilot 0.7 it's running
agnos 1.1 which will be the shipping
version
got the same great toggles i think i'll
uh turn laneless on for my drive home
we have this new toggle show eta in 24
hour format
uh we can wi-fi
uh things about the device i can reset
my calibration here if i want
the dongle id the serial number we do
have an english only multi lang coming
soon
um we should really work on that will it
work anywhere
sure why not cool
thanks for watching quick drive on the
comment three i'm going home
it's nap time
you
do we have to use Kobe's 7:10
16 nothing 1726 oh my god I should go on
the discord on their 35 sup yo G there
we go so jacked really what up you're
not been working out okay they see that
not sue sue though you see these are my
values all right what up what up scope
is how many spokes guns alive sixty
sixty Scopus all right guys how many
you're happy to see me
Judy Scott Caan's now Wow we missed you
bro they're not saying they're happy to
see they just say oh good good good they
don't even know what I have planned for
today yeah oh now they're saying they're
happy
oh good I'm glad they're happy wait we
got a few more people cuz we have an
announcement today I'm not gonna say
it's a big announcement I'm not gonna
say it's good announcement but it is the
title does allude to what the
announcement is do we have a neon we do
can I hold me on oh here we go
perfect ah this is a neon that connected
up to my computer how many we go okay 86
we wait for a hundred yes it's a big
announcement um 89 91 guys don't like
psych up your friends or anything it's
not like you know that big of an
announcement no no no today's guys we
got the answer days and we're gonna do
something that's gonna help improve you
know how are you happy honest all right
how many us copies I wonder what for
Sammy's coffees you got Mandy 191 how
many of you 91 have you if you have any
on this is gonna make you
happy if you don't have a neon this is
gonna make you sad
96 93 going up and down out out out
so how many of them how many of them
have yachts could they raise their hand
let's say like see half of them have
feelings all right so that's like you
know 45 over 91 so you guys we're gonna
be happy and then the other ones are
gonna be you know the one - is gonna be
sad right yeah
don't have one yet oh so Young's are an
appreciating asset just like Tesla Model
3 let me explain to you what that means
okay so you can look at appreciation
like this this axis represents time and
this axis represents price and Furion's
cost this much now a depreciating asset
would go down but an appreciating asset
is going to go up so this one no one
one-on-one partner this is the perfect
time for this enough yeah so eons are an
appreciating asset and using this d20
here we're going to determine exactly
how much they're going to appreciate
today and it's oh my god is that a 20
that's literally a wait is that a 20 or
14 that's right it lets you know what
let's call it a 40 let's call it if
we're gonna roll it next time we're
gonna roll it but it's 14 yeah so come
here guys we're gonna go over in here
today and this is the price of a neon
it's $4.99 and we're gonna just you know
make it 5 13 because we're gonna add 14
dollars because we only have sent an
appreciating asset so let me just save
that I actually think we're gonna have
to uh we're gonna have to refresh the
webpage well so when I add this to my
cart like right now it says $4.99 but
when I add it to my cart it is five
hundred thirteen dollars up so scope is
uh I appreciate you joining me
today for this periscope remember your
yawns are an appreciating asset and they
just appreciated $14 thank you
what up
I'm going to just link to this end
escort
it's not worth tweeting about you guys
you guys know the discord let's go right
here give a little bit of time for some
people to get in here I got two things
to show you today it's gonna be quick
livestream what's up walks or hello
Logan Legrand welcome everybody
close the doors my office take off her
hoodie welcome welcome welcome so we
have one question to ask today and
that's our FCA people better than Subaru
people so wait why is this not here
let's see is it live oh yes it is
oh-ho FCA car honest if you right now go
to our shop you can buy one of these
guys this is a harness it supports we're
gonna go through all the cars that it
supports it supports the chrysler
pacifica it supports the chrysler
pacifica it supports the chrysler
pacifica Hybrid all of the user
supported but you know things like this
this is the bosch one I'm sorry tonight
I've fun um and then where's the Jeep at
yeah it also supports the Jeep Grand
Cherokee so you can buy you can buy an
FCA harness put this in your chrysler
pacifica and be just like way mom you
can you can you can be just like lame-o
um it's not more carports what we're
doing is we're consolidating everything
a comma is about stability is about ease
of use is about making this stuff
consumer friendly that's the word
consumer friendly that's right so it's
very easy for you to install this it's
completely behind the trim this is the
first harness we've had to do can you
buy a car with Eon on it no we don't
sell cars
is the first harness we've had to do a
little bit differently so you see these
ones are just straight-up wire harnesses
unfortunately the female FCA connector
and actually we should make sure let's
make sure just the harness connector
connector perfect you can buy se a
harness connectors to only $50 this is
really in the same deal because it
includes two parts it includes both this
wiring harness part and this little
adapter board which goes from this what
is that 12 pin molex to this FC a female
and you see the FC a female fits into
the FCA male beautifully can you buy a
car and put Eon in it then sell me no no
no no no this isn't for you man this
isn't for you this is a chill livestream
what I'm gonna tweet about it no tweet
about the livestream it's chill just for
the discord grows we got something else
to show you too but we're only gonna
show to you if at least one person buys
the FC a harness we need one person oh
you know what we're gonna we're gonna
add everyone maybe they will just do in
the announcements Channel FCA
artis is live
you want to try open pilot is there any
help no there's not any help there's no
help no there's help you can come on
this cord but if you're not technical
it's not for you when you can try right
but but open I'll just give and take
right open pile it's not just like if
you think you're gonna like buy like an
Apple watch and just install it not
another no but if you're willing to put
the time in you get something before
everybody else in the world like this
beautiful FCI harness so we just need to
wait for a few people to get in here we
need to sell one of these it's gonna get
easier it's always gonna get easier but
you know if you're asking those kind of
questions those are all kind of
questions there's always help hop on
disk fci harness is live and we're at
the kebab shop now another thing kebab
Shepherd is right around the corner
though makes great kebabs FCA harness
there isn't really that much more to say
about it we also fire tweet today
exactly yeah somebody sent them an
overpriced car that sounds like the
right solution here 40 more people come
one come all to this absolutely chill
don't tweet about it stream where we
launched the FCI harness and we figure
out once and for all if FCA people are
better than Subaru people all right
maybe when we get to 50 people I'll show
you guys the cool thing so let's talk
about upcoming features I know new
features ever that's right all features
are canceled that's a lie we launched
the MCA harness the Hyundai harness
coming soon and if you want to get one
of these FCA harnesses you got three
days you got three days to come down to
our virtual store at shop comedy eye and
buy it if you want to get it fulfilled
before the holiday break give your loved
one hours of entertainment buy them an
eon of what this does is it allows you
to plug in your chrysler pacifica or
your jeep compass I think we also
support one more car
soon to yem like maps yeah no no maps
are never gonna have maps a lie
you see we've updated the readme we've
included limitations be sure to read
these very carefully like you read your
car owner manual and we push some cars
into community maintain cars and
features but fortunately the Chrysler's
are right here in officially supported
cars the jeeps are right here and
officially supported car things because
actually a lot more to get what you mean
red lights and stop signs like this like
whoa is that is that open pilot running
on on a PC look at that model detecting
that lane look at that oh yeah we
support Kia Kia's are just you and eyes
yeah open pilot in simulation you want
to talk about features look at that this
is just a computer that's manager
running entirely on a computer will fix
the slow frame thing this is real this
is very real um this is Karla so uh yeah
yeah we're gonna make open pilot run in
well it's an internal fork for now but
we're gonna make open pilot run in
simulation this is a big push for next
year so everybody can develop with open
pilot not just people who have the
supported cars we got some absolutely
crazy announcements lined up for 2020
FCA harnesses are just the start do we
need a do you need a GPU there's one in
the CPU right now not kind of runs on
the CPU we got we got some great reuse
some great research from from from the
research team let's see if we sell any
FCA harnesses you know the amount of
leaks that I want to give has a lot to
do with how much FCA harnesses we sell
and so far there's been zero FCA harness
is stalled so we got I'll show you and I
never want to show you user stuff but
that's what's happening with our store
today so you know we got to get this
number we got to get this number up we
got to go way way up
open pilot unfortunately we can't move
yet oh if you already have the hub um if
you've already bought the harness you
can go right in here and you can just
buy the harness connector we sell them
for $50 Subaru is right now equivalent
to FCA nobody bought any Subaru
harnesses either I think we filled six
of them so far but I believe in you FTA
people come by come by FCA yeah look it
simulation all right all right your your
yurt no no no this is the wrong kind of
questions to ask I don't know if it's
legal I'm not a lawyer man you got it
you got it you got to ask your friendly
neighborhood lawyer about that
FCA harness buy it right now $50 if you
want the black panda which you
definitely do want the black Panda yeah
simulated car that's that's what I'm
talking about
can I Drive a simulated car I'm not sure
I don't think I wrote any of that maybe
we can do a coding livestream later
where we write some of that code but um
whoa whoa
oh no I thought we got an order I got
excited about the forbidden topic if
it's demonstratively safe and time
there's a lot of forbidden topics I'll
let you mention one word event which
which which forbidden topic if it's
torque interceptors no oh don't know
okay look
torque interceptors look there's less
safe things in the world than to work
interceptors if you truly have built a
torque interceptor that is as LD and
applies the limits and meets all
automotive standards I think you can
build a safe torque interceptor but I
think that the the
to do it is really beyond a hobbyist
project so if you guys are like a
company and you're building torque
interceptors and like you know you've
put a lot of resources into Q&A into
testing then I do think torque
interceptors are possible but I think
that an open-source torque interceptor
like the way the pedal is open-source is
extremely dangerous this is the worst
case law if your pedal freaks out the
worst thing that happens is your car you
get uncontrollable acceleration well go
into neutral step on the brake you're
fine
uncontrollable steering torque that's
Azal v yeah you gotta you know commas
for people who are gonna who are gonna
search and find come on FTA people can
we sell one of these things you guys
make me never want to introduce new
harnesses you guys make me realize that
the only car anybody cares about is
Honda's in Toyotas um you think some of
it can be deconstructed to be given the
control method how and what do you mean
by deconstructed if you're straight-up
intercepting the torque sensor on power
steering I don't see how that's not D
because of malfunction you're thinking
cause ah beautiful
all right we got four visitors right now
on the store I don't see the live view
or any you guys buying in FCI harness I
just want I just want to conclude this
video with the conclusion that FCA
people are better than Subaru people and
we can leave it there oh oh we got we
got a person there where are these other
visitors
since it's harder to control the motor
it's less likely for a catastrophic
failure you know what how about this
before you post a safety analysis post
like an ISO 266 to safety analysis of a
torque interceptor and we're happy to
comment on it
this isn't about remote control why is
remote control is absolutely banned
what what what what could you possibly
be doing good with remote control at
least a torque interceptor like torque
interceptors have positive value too
right yeah flexing exactly thumbs down
thumbs down right
well we gave up safety so we could flex
thumbs down even once a dog ran right
0:06 visitors right now oh oh oh come on
come on somebody buy one somebody buy
one oh you know you want to buy one
they're beautiful they're they're FCA
harnesses they're only $50 399 when
coupled with a brand-new black panda
that has integrated GPS I don't have one
of my desk all I have is on my desk is
an e on up oh boy what a gem cell what
do we just sell was that an SCA - I'm
gonna check I'm gonna check
up oh yeah if you announce your name on
the stream I will confirm that it was
you who purchased an FBI harness thank
you we have absolutely proven that FCA
people are better than super people
thank you for buying you guys give me
hope you guys give me hope of launching
harnesses now spill okay okay okay you
want a leak will show you a leak this is
the research teams leak but let me see
if I can find it okay what no no no what
oh no I don't know anything about it oh
no we don't have any works um but we do
have this joint model oh yes oh this see
these end-to-end longitudinal you see
this integrated pose net yeah and you
see how the curves are beautifully
sloping down the models the deep is
learning oh it's beautiful oh look at
that
yeah come the other leak which I'm sure
many you guys have already found is um
it's not so hard to enable automatic
lane changes but we haven't officially
shipped automatically and changes its
not shipped and do remember that the
automatic lane change does not respect
the blind spot so that is always your
job it's good enough the problem with
red lights and stop signs is not the
camera red lights and stop signs are
hard for a whole different set of
reasons but this stuff man end-to-end
longitudinal control
that's one of the things I'm really
excited for in 2020 in addition you guys
have seen hopefully in zero 7 vo ATC I
think well it's no radar right so in
zero six two we switched I know 2020 is
near vests right um in zero six two we
switched from the radar being the
primary sensor to vision being the
primary sensor um you tried to take the
lane changes to a curb and it was ready
to go it'll tell you yeah if you turn
the blinker on it'll still tell you um
it shouldn't actually make the lane
change but again that feature is not
officially shipped we did leave the
skeleton in there for it so you guys can
can can mess around and start
experimenting with it was the biggest
harness purchase we sold a lot I think I
think Taiwan there's a bunch of people
in Taiwan really buy a lot of these
things in big quantities we get another
FC a harness or am I being too greedy
it's really a beautiful harness comes
with these tiny boards reading the speed
limit signs again these sound like
community features community features
you guys can write that stuff um we've
open-sourced like all of open pilot is
open source now it should be relatively
easy for you guys to add a something
else that runs the model bro shop is
slow take a look you're this close to
getting banned I don't know what to tell
you man you use dial-up does it make
does it make a mean noise when you
connect to the internet well maybe
that's why it's long huh
what else we got when is autopilot when
is open file for PC gonna be released
what has been my pet project sometime in
in 2020 San Diego is a beautiful place
you know they say it's always sunny in
philadelphia this ally I've been to
Philadelphia but San Diego is pretty
close when open pilot for the Xbox 360
Oh way better in the Bay Area yes we
sell one more FCA harness what's our B
because they're really really a lot
about our B oh oh well should we make
fun of should we make fun of startups
briefly our B is the first company oh
wow that's slow welcome to radars new
era our B is disrupting radar technology
to support drivers and autonomous
vehicles
Zook says let's just say I haven't seen
the other 500 million of their around to
come through all oh it uses 4d imaging
radar oh I can trust it oh that's all
that's good to know that's good to know
man you know when I go on Bosh's website
they call it the radar you can't trust
that's not even my side I'm glad you
like the lane change ooh
proprietary chipset technologies this is
a joke is this I don't know if this is
at all or not I don't know hopefully you
guys the new manager status line I wrote
this myself it's green and it's red when
the processes crash yeah I took typed
out those anti codes yeah what else just
make sure I'm not oh oh do we have any
more orders or someone else want to buy
one there they're really beautiful the
FCA harness is a wonderful harness it's
like if juice arrow made a radar that
sounds about right
how hard is it to add car simulation
it's pretty easy
headless the headless Aeon stuff is not
gonna go anywhere the problem with the
headless Eon stuff is first it only
works on one car and second you're
limited by the features that are being
outputted by the stock camera the
features are not very good it's not
taking a picture from the camera you
can't do that you're just using you know
Bosh's crappy lame finding algorithms
and then like making guesses based on
that which is really not the way to
build one of these things
so always good to see people
experimenting but I don't think that
that is very fertile I think what would
be more fruitful and what you can
experiment if you insist to use
something that's not like the ER mounted
on the screen is you could probably get
open pilot working pretty well with a
webcam um my long-term goals not
headless Obama does kind of annoy us
yeah we we we ship eons and we'll ship
better eons and the Nubians will be you
know slimmer and smaller and have more
cameras so on and so forth and you know
for the next for the next Eon years but
um you know headless is not headless is
not a goal well let me show you the ads
where would we show you the ads that's
the question all right 65 feet we got
anything else
thank you speed drawing 101 wanna pee on
the cars compute not really I mean I was
making fun of the car people for not
putting any real computers in their car
if they're a real computer sure maybe us
running on an iPhone that's gonna take
you a lot waffle makers still there
well I ship bumper stickers what we're
thinking about bumper stickers like this
car runs open-source software something
like that what you guys think what's for
the bumper sticker say um but no we
don't serve any bumper stickers right
now I think we include some stickers I
think we have some stickers but you know
went out the swag business we're in the
high quality hardware business harness
is one of the highest quality things
coming I was ever shipped so make sure
to buy your harness today I can't show
you that one cuz it has user info
I prefer open pilot disengagement
instead of Tesla autopilot yeah gasps
disengagement makes so much sense how
long will the current Aeon be around
eons Pan know you'll say I mean you'll
see all in 2020 all in 2020 things will
happen
see look if we had new heart if we had
if we had new hardware right around the
corner what I have a neon on my desk the
way man um all right so FCA people are
slightly better than Subaru people true
the been determined
we're gonna go for uh what is Lou I
don't know anything about you know um uh
yeah the dash cam the dash cams got
really good your if you guys have comic
prime um try out the comic connect app
has gotten quite good in the last
release I show us a neon in a test card
yeah we can we can we can go it can go
now when I got to do that that's a long
walk um Opie long end-to-end
longitudinal control 2020 that's really
gotten good you know we debated in 0-7
all the videos the videos are quick yeah
right hey I know the quality is not that
great but that's the trade-off those
videos are small enough that they can
keep up live on comm prime so if you are
comma prime subscriber those videos will
show up in your phone almost instantly
from your drive um it truly is a cloud
dash cam okay we'll let you in on one
more thing this isn't finalized yet
right now if you're a normal comma user
you got three days of storage comma
prime gets 14 days of storage we're
thinking about increasing that to one
year comma prime is about to be really
good you know we put a lot of effort
into it those features in tell you about
internal debates
I like internal to comma there's no
debate I'm a dictator
not show a lot of talking about
fingerprinting 2.0 a lot of debates on
how we're gonna do that what else know
come from is not free it's $24 a month
bro we debated on how much comma crime
should cost let me tell you something
everybody else in the company they want
to make things cheap for you guys and
I'm like no no nothing no no no we got
to make it expensive so whatever
something's expensive I'm the guy to
blame are we hiring any developers we
are we are we're hiring an open pilot
engineer somebody who's good really
infrastructure testing a lot of that
stuff if you're good with we were
talking today like if you like if you
don't C++ you're on the right track but
also maybe hiring an ml engineer maybe
if you're very very good but open pilot
engineer will hire you tomorrow if you
uh if you are if you do great boxer if
you're looking for a job
um C++ is it's a language yeah yeah how
do we stop progressions in the models oh
we have all these complicated we have
lots of we have lots of tests maybe
someday we'll go live to the to the
research team and the research team know
we don't charge money for album pod by
prime um I don't feel good
look I'm not the kind of guy who's gonna
charge you money for a software that
runs on your device you bought and paid
for an e-1 from us I'm not gonna charge
you to use your device I'm not one of
those dicks right we do charge you of
course
jeez comma Prime come front cost us
money over an MVNO we we resell a
certain large mobile carrier service to
you guys and we have to pay that mobile
carrier money on the back end so that's
you know come front cost us money coming
from all so honestly honestly we don't
even make money on comic prime because
the azure bill is so high yo
gotta pay for cloud now whoa whoa whoa
wait when I was a page me that wasn't a
sale come on come on FCA people buy some
harnesses we got we got we got two more
minutes
Alton media I didn't say that I'm just
saying I didn't say that aloud uh-huh
yeah clouds for users data like videos
yeah yeah we got we got videos in the
cloud
it's like Pied Piper but only for
dashcam videos and we're really we're
thinking about increasing it to one year
no promises on that there's still
internal debate um you know you know see
people are like oh you know I want to
work serious like man we want to give
all the people great features and I come
along and I'm like does that cost money
they're not gonna cost money sounds like
it's gonna cost money no not a no it's
gotta go we make money we're almost
profitable to uh Q for this Q for is our
highest profit quarter on record already
um and if we it's already let's let's
let me let me get you the total I'll let
you in on the total let's go quarter
today let me make sure there's no user
information here yes this is commas most
profitable quarter today and why don't I
show you guys this stuff I think I'm
crazy
um yeah man three hundred ninety seven
thousand dollars that is almost a
profitable company our burn rates about
I'm gonna mount one eighty a month um so
so we're we're we're seventy eighty
percent of the way to profitable I'm
very happy we're up 43 percent from the
last quarter which was a new record
quarter four comma we're really we're
really killing it and wait'll you guys
see what we haven't done we're gonna
blow you away in 2020 right if you think
if you think what we've done so far if
you thought this year was a good year
wait'll you see the lineup for 2020
things have been working no hockey stick
growth not real yawns don't use the
microphone how many eons are out there
driving here looking rid of bad
information
no we're not at when not at 5k monthly
users yet I'd like to get there let me
just
it's an overview I'll bring up weekly
for the last six months it takes a while
to load it's got a hit on my sequel
database ah no no no prime is all stored
and then Prime is all stored measure
there we go here's the weekly devices
chart
so that's ignore the last couple weeks
aren't up to date it takes a bit for
things to actually like make their way
into the system but yeah so we've
reached a bit over 1100 weekly active
users and you see our growth is nice and
steady um you know if you guys didn't
read my medium posts you guys should be
concise comedy i we just kind of break
down what do you do it's like Facebook
is like my sequel they focus back below
is what I worked there was backed by big
my single database I don't know no then
you put memcache in front of it and
there you go
the harness videos current Eon uses a
phone you can't get anymore
what do you mean there well oh you want
me to jog I know but um ya know if you
guys didn't read didn't read this
breaking down unit economics this is our
monthly device growth should we've
really does that's just been in two
years and you can see this is actually a
slight upward exponential to that to so
you know hockey sticks girl it's not
real but exponential growth is yeah this
is if you guys didn't read this go read
it we're not even gonna make fun of
startups anymore comma
hires full-time we only hire on-site yes
you think I'm dealing with managing a
bunch of contractors come here because
you want to add value if you make a GM
harness we're thinking about it
tamo coins not real never gonna happen
we'll be doing constant hardware versus
a on versus a phone tell me what
improvements there are to make I think
there's one big improvement but I think
that you'll you'll actually find I don't
think winstram AIC today I think you'll
actually find that that improvement can
be made very easily with a phone as well
cool be consumer ready well you know
we're at 0.7 we got 0.8 we got 0.9 we
got 1.0 we into a stream for 0.7 but it
is pretty cool driver monitoring at
night yeah no one's interesting to the
night driver monitoring and uh no
battery and permanent install well uh
you know 2020 guy's 2020 you'll see uno
this dog Luna who's not real
who told you about who no um yeah you
guys get yawns man beyond this where it
is gonna be at sea yeah so told you that
who knows and I did huh oh yeah know who
know is uh no no it's just it's for the
Spanish market
yeah it's yawns for the Spanish market
yeah the comic you know yeah that's
right we got that we got it we got a you
know we're right down we're right next
to Iran San Diego is well it's much
better than San Francisco in New York um
let's just say yeah the como uno is the
the EON for the market we're right next
to Mexico you know we're gonna get a lot
of Tijuana sales so the comic uno
what does Tesla have that we don't what
tests the feature do you like that we
don't have right now I can think of a
big feature we have the Tesla doesn't
have make it funny you on for this
morning
oh yeah that's right that's right Thank
You Go Go quiero mucho dinero por , no
uh some people on Hacker News felt that
I'm dismissive of marketing yeah yeah
why would I want to market marketing you
know think I'm who clicks ads alright I
just do you think smart people click ads
what do you think dumb people click at
right and now think you think marketing
is a good idea
oh well come I have a booth at CES ah
not to hear anything about that I don't
know we can ask around that I don't know
um I want to launch a new Aeon three or
four cameras why do you need more
cameras explain to me what you're gonna
do with more cameras all common dos o BM
W no no flex right exactly you have an
ad blocker see even you want to sleep
alone has an ad blocker hey um what's
the state of the industry it's all total
dog shit man but you know it's not even
fun anymore right like it used to be fun
when we were punching up when we were
like this small startup struggling to
survive or punch it the big startups
like it was fun but like now it's like
you know it's not uh it's not funny
anymore right like like Zuke's actually
can't raise their money alright like
it's just it's just sad
yo how about this you buy me a banners
truck and I'll work hard to port it man
I'll try to do that pour myself I'll
pour it to the been stuff will get to me
on an adventure
alright can we sell anymore FCA or
nicest we're sold we sold we sold one
so one I'll take it you guys are one
better than then does Subaru any more
questions I said what
how is Christmas in our office I said to
get a Christmas tree I don't think
anyone actually did it I was doing good
21 yeah uh forward lock out bro email
for I don't know I can't believe I
bought that car well I lost like ten
grand on that cart oh they depreciate so
fast so disappointed really Honda and
more importantly Toyota Toyota is really
where it's at buy a Corolla next year
you're here yo uh no actually check it
out we launched a new uh oh don't get me
started on how much I lost on the ct6 we
launched a new compatibility flow it's
really nice and here we have compatible
cars we recommend really really get at
that Corolla but these are all nice cars
you'll work with my I'd say my Porsche
911 2019 oh no that's too bad
yeah Corolla should be at the top we
should change that yeah I know the
website super fast I know but some
people on dial-up rav4 is very good yeah
TSS 2 is better than all Honda's the
rav4 is very good
the we do recommend the round 4 right
yeah we do yeah the TSS 2 rav4 is great
the curl is really the best car you got
so much torque on that thing
great car pick up a Corolla and while
you're at it by a neon and Toyota bona
bundle right now buy it um Thursday so
let's just bring up a calendar and 2019
December let me just bring one of these
up so you can see yeah we support all
praises the 19th is our last day that
we're doing fulfillment so if you want
to get your order in
uh no Ford is over you guys Vivienne's
the only Ford we have here this Ford is
over no Ford uh no I don't know if
someone supports Ford we top stream it I
think we already released the code that
we wrote for it oh yeah look at that
look at that look at that look at the
line look at how nice is detecting that
line that's a solid model we don't have
driver monitoring on pc yea thou coming
soon ah EPS record oh no no no we don't
want any we're not doing any firmware no
no no no firmware hacks no firmware
hacks people externally do though hey
you know that's on you if done if done
properly we don't think they're
dangerous
if Opie malfunctions how hard is it to
overpower the car so what do you mean by
that
right open pilot it can't put you can
combat the torque open pilot can put on
the wheel I used to say with a pinkie
but in the Corolla it might take these
two fingers ah but still if you have a
hand on the wheel there is no way open
pilot can overpower you if you if you
have a hand like gripping the wheel
you'll see them a maximum amount of work
it can put it so much less than you can
so if you're worried about that you can
check we we have we have the safety code
in pan if it's not even our safety code
we're that's really just using the
safety code of the car um we're using
the same interface that the car cameras
are using
well does it need to be these two
fingers when I like you know the good
fingers are nice for you know pushing
back on things you could use these two
but it'd be kind of like awkward you
know what were we talking about before
that oh yeah yeah we released also check
our medium we did a nice tour through
open pilot this is pretty good good
just engagements are going down I don't
really have clean data to share it's a
hard thing to measure it's it's uh no no
no we're not to his thought up preview I
can honestly guys I just feel bad for
people in this space I feel bad
it's like LeBron going to a high school
and dunking on the high school team
that's what it's like no no they're not
it's not even it's not even that it's
like it's like the Jacksonville Jaguars
man it's like it's like when Bill
Belichick beats the Jacksonville Jaguars
all right that's that's what I'm saying
um
ya know it's it's getting a lot better
what's going on please explain well
launching the FC a harness this guy plug
it into your FC a Yeti you know what's
sad I'll show you something sad everyone
at comma was really happy about that
that AV analysis post you know we all
thought it was cool and then like here's
the truth so we come out with the AE B
we get 247 claps I write a poorly
thought out post shit-talking other
companies and we get two point one
thousand claps right so like this is
probably one of the best things like
like like this is a really unique thing
that only comic can do we analyzed
millions of miles and we looked for all
I II be events definitely worth reading
247 claps
and that's the problem you got to give
the people what they want thank you I'm
glad you appreciate it
we're still waiting at this traffic
light we got to engage open pilot let's
engage I want to refactor so you can see
this is actually this is just UI this is
like UI dot C it's the same one that
runs in the computer I want to refactor
the background to be here
we'll get the vault man glad I'm glad
you read it um
I want to add like all the settings
stuff to here we'll take all that out of
Android that should give us some more
CPU performance launching message queue
that's gonna get a similar CPU
performance there's so much performance
to still be added to the Aeon there's so
much performance we can squeeze out of
that thing Linux Linux alright 45
minutes I had 90 more seconds we sold
one Fc a harness that's one more than we
sold Subaru harnesses I trust that
they're gonna trickle and slowly over
time one-year storage yeah yes order of
magnitude I I think the one year is
gonna happen
performance equals more steering if you
want more steering just buy a Toyota
Corolla it has all the steer and you
ever wanted
outtie howdy is the same as VW for some
outies the ones that use flex ray is not
gonna happen there are there are people
on discord hacking away at flex right
maybe they'll make some progress but um
it seems it seems really complex we have
a lot we have internal data analysis on
driver monitoring maybe well maybe we'll
do one of those public right we'll put
it together performance equals more
Headroom I mean you know we got more
Headroom LED on those new models that I
showed you guys they're huge
you good models for X bigger than the
current models and that doesn't even
make the Box bigger yet we're gonna make
the Box bigger as well
I will not for EXO cuz we're reading
that 18 to a resident 50 so you know
real deep learning models resna 50s or
what uh opening I used
you can use it young on a Tesla yes you
can come asking discord on the Tesla
channel whoo guys thank you all for
joining today I'm glad to have you all
here this has been coming on she's
probably gonna be our last livestream
for 2019 no Christmas gift we're gonna
really start 2020 off with a bang and I
think it's gonna be good see you in 20
hello we'll wait for a little bit for a
few people to come in here you guys know
I love freedom but you know as they say
freedom is under attack freedom isn't
free you know all those general-purpose
slogans about freedom so we're gonna
have a little conversation about freedom
and we're gonna announce our little
discount and yeah that's what we're
gonna do today
yeah let's give it at least this way for
at least 20 I'm wearing a freedom shirt
right now what do y'all think I'm
keeping this freedom shirt so actually
we're gonna make it 18 freedom shirts
for freedom not 19 it was originally 19
but I'm wearing this one I'm not gonna
give you the one I wore I wouldn't do
that
Yeah right this is the most limited
edition comma merch ever to drop oh can
we make them tighter yeah so that's kind
of the problem yeah of course I work out
bro gotta work out you got to be jacked
yeah yeah freedom shirts right no no if
you purchased it a week ago you can't
get the shirt all right you got to buy a
new one and no tolerance on this if you
try to like do some crap like I'm gonna
return it or I'm gonna cancel my order
you'll get a freedom shirt because
freedom isn't free are they legal in
communist countries I don't think we
shipped to Venezuela I don't think so I
don't think so
are they legal and uh yeah you know okay
let's talk about freedom okay so a few
things we made some changes to this cord
freedom does not mean anarchy freedom
does not mean that everybody can do
whatever they want whenever they want
this leads to a terrible society this
leads to a terrible community so we're
uh you know we're gonna we're gonna
crack down a bit on the discord
um you know just against general like
shitposting derailment low-quality
comments if it's a high quality
community we're gonna make it that way
no Anarchy doesn't mean freedom at all
anarchy just means that the tyranny you
don't get to choose who enforces the
tyranny anarchy just means that any any
you know Joe Schmo with a gun can can
can be your your Lord so yeah I mean you
know this is important it's an important
time to have discussions like this about
freedom if you guys don't know I really
love freedom I really do I really do you
know okay so the other thing we're gonna
talk about is I know the last stream we
talked about hiring and we get a lot of
emails from people who are like hey bro
I know I'm not qualified but I'm willing
to work for free you're not working for
free you're asking us to educate you for
free if you genuinely wanted to work for
free and some people do and we love
these people
they're sending pull requests on our
github to open pilot you can work for
free all you want right but if you're
asking to come to this office and you
want to work for free what you're doing
is you're lowering the bar in the office
right that you'd be doing I like every
person we hire here I really want them
to bring up the bar which means that
every person every new person we hire
has to be better than the current
average at comma and that's how you get
a a community a country a world that's
continually improving because if you're
hiring people who are worse than the
average
your your your community your company or
whatever is declining and you know I
don't know anything about Amazon
leadership principles um but yeah so
we're cracking down against you know
general junk in the discord - it's a
high quality developer community um
that's what our products are - right our
products are all development gifts if
you come in with the mentality that your
consumer
you join the comic community intending
to extract value to extract more value
than you give back the problem with that
is um well you know if everybody comes
in with that mentality it's not a very
nice community it's not one you want to
be in either there's that really great
post about about subcultures and how to
make sure they don't to climb so yeah
hopefully everybody understands you know
you just got in a big conversation being
had now about content moderation on the
internet yeah you you empathize a whole
lot more the people have to make the
decisions so I mean what the comic
community I hope there is there's
there's no questions it's not a
community for general socialization it's
not a community for shit-talking it's
community for discussion about comic
products and comma software and
improving them and kind of your status
in that community and we're gonna make
this more explicit is have you submitted
pull requests have you submitted code
have you improved other people's lives
in that community and you're giving back
you know give back to the community
right or you know get that get the boot
just purchasing a product purchasing a
product entitles you to that piece of
hardware it doesn't um and we're gonna
make this clear as well look if our
hardware is broken like the hardware is
broken like we shipped you something
that's broken
this is absolutely our problem uh and we
want to fix that if the problem is that
you can't figure out how to use the
product that's a problem with you and
this is why we have the the 30-day
money-back guarantee okay uh now that
stuff's out of the way of course I hire
people smarter than love to hire people
smarter than you got to bring the bar up
and my the smartest guy comma hell no no
no I think I think better marketing is
in a way exactly the problem right one
of when my co-workers brought up at
lunch today that if you're Wendy's are
in and out right the only things you're
competing on basically our customer
support you're not competing on burgers
we're competing on a technical product
we're competing based on the quality of
our level two driving system and
compared to other people's right another
thing that I think a lot of people don't
get about , is this is the company
mission solve self-driving cars while
delivering shippable intermediaries
right it's not to continually make more
money we need to make enough money in
order to accomplish that goal but money
doesn't necessarily know having more
money doesn't necessarily help you with
that goal it maybe can hurt you I'm so
our goal is to keep you know profits
basically to the point where we're
covering expenses which we have for the
whole year are going beyond that we
don't care we're not trying to expand
this community to everybody if you don't
have what it takes to you know not even
what it takes you know what I shouldn't
say that because it's not really a skill
based thing it's a mentality based thing
if you come into the it doesn't matter
what skill you have maybe self-awareness
you need self-awareness but other than
that it's not like you have to be like
some you know ten years of experience
program or anything like that this is
for joining the community not for coming
to work here
um but you have to have an expectation
that you're not good you're not there to
consume product ban from reddit you're
there to join a community where you're a
fellow developer right you're buying a
development kit if you're just here to
to take I want an experience I want an
experience there's a hundred thousand
other companies that are out there
begging to cater to you and all they
want from you is their money we're not
one of those so you know that's what it
is that said I'm gonna change we're
gonna change it now that to only uh
to only that's that we don't want your
money it's not that we don't want your
money and we certainly appreciate our
consumers are our customers but not if
you know they're there to demand more
than what they purchased right okay so
we're gonna limit the number of times
this can be used we're gonna change it
to eighteen the discount code goes live
tomorrow on July 4th
and the discount code is freedom shirt
so you will get a free freedom shirt
with your comma to purchase if you
purchase it tomorrow
freedom shirt I will show you some of
the freedom shirts you can put in the
description make sure to get your order
in as close to midnight as possible
these are the sizes that we have of the
freedom shirts you can see we have many
freedom shirts in this freedom shirt
bucket there's a lot of freedom in here
so much freedom so much freedom so much
freedom so much freedom so much for you
you're in the freedom shirt box um now
you asked George why aren't you doing a
discount on comma twos I'm wearing a
medium right now this is a medium no I
so yeah they run a little bit small you
can really see my chest so we're not
discounting we're not just counting
comet twos period but we've never done
it discount in the comet two and I'll
tell you the truth why this is the comma
to production facility this the bins
marked past are all the comma twos that
we have so we have about 58 comma twos
and then we have these ones up here
testing to the green ones past red ones
failed notice why these ones failed CPU
temperature too hot so we fixed a lot of
the heat issues by screening out well
this has been true for a while so yeah
that's why that's why there's no
discount on the comma to is when there
was eons we had many many eons in stock
you know we had we had boxes and boxes
of eons and of course I wanted to you
know move that product right now if you
guys are under 100 comma tools tomorrow
yeah but I'm wearing the freedom sure
you want to say hi to the the youtubers
yeah I'm sliding
yeah yeah check out the freedom shirt
man I think I look good in the freedom
shirt
yeah this 18 freedom shirt cuz this is
19 I stole the freedom shirt to women's
largest sevens mas oh it's a woman's
lawyer medium weight the women's largely
smaller the same size I'm wearing a
medium yeah this is a compression shirts
for working out yeah it's for working
out it makes you muscles look big when
you look in the mirror like that yeah
you know Sam I like the arm kama yeah
arm coming this is this is the most
exclusive merch honestly you guys
there's 18 of these in the world so you
better get your order in at midnight
tonight that's midnight PDT I'll show
you what I set it to in Shopify and I
swear I'm not gonna to change it so I
don't know what time this actually is in
your time zone bye
yeah yeah I think we're gonna limit it
to one use per customer you know one
freedom shirt per customer
you don't need more freedom shirts than
one don't be greedy with the freedom
there's plenty of freedom for everybody
what Nozomi there's only eight it is a
limited supply that's true you're gonna
flip it on eBay for profit yeah so it
only comes with a comma to you use the
code freedom shirt a check out tomorrow
starting at and I already said if
anyone's like oh I want to return it
till I can get a freedom shirt now
well you can buy it tomorrow but if you
cancel an order and then you try to add
freedom shirt later you don't get afraid
of shirt if you're trying to pull some
shit no freedom shirts for you I was
talking a little bit about discoid yeah
I did talk to them about working for
free and I talked to them how actually
it's kind of disrespectful because what
you're actually doing is you're asking
us to educate you for free and if you
want me to educate you hook up with
Harvard charges I've charged double
[Laughter]
it's twice the education it's twice the
education exactly for twice the price
that's right so that's what if you want
to come to kama and be educated you pay
us 100k yes if you just go out there and
find our programming challenge you're
great you know what else
if you submit if you contribute dean lee
special shout out to Dean Lee doesn't
join the discord just submit pull
requests on github see that's the kind
of contribution we like you want to work
for us for free do that don't send an
email saying you want to work just go
work bro yeah you're asking me to manage
you for free is that what you're asking
permission how people want permission
how their life works I mean I don't know
how to live work you're gonna be in the
frame you got to be in the frame here
you know take a chair welcome to the
chats touch chats with the executive
team Akane I yeah yeah we're gonna talk
to y'all about culture today our lunch
chat today was how much the discord
sucks and how we're gonna remove a lot
of the low-quality shit from it I think
you understand where we are in our cycle
as our as a company I don't know
anything about cycles we're not a
corporation that's right we're never
gonna be a corporation that's right the
customer can be wrong I mean look we
like her cos they're wrong they're just
not right I mean you know what yeah
actually that's not true whether the
customer is wrong or right we judge you
by nature standards whatever nature
standards are right have we considered
becoming a non-profit no nonprofit
company so in a way we're really not
that dissimilar from every other tech
startup out there right a lot of tech
startups brag about being pre-revenue
honestly I'd rather get money from
committed users who want to help develop
who want to join look do you say it all
the time we're incredibly open I love
being open with you guys I'm more open
with you than I am with VCS I think a
lot of Biscay to see source coming here
than a lot of you
um but the flipside of that is where
technically I mean in a lot of ways
we're pre-revenue startup commas
multi-billion dollar exit doesn't come
from us selling a comma to to you it's a
laughable amount of money it comes from
us solving self-driving cars which is
our mission right yeah we're just trying
to solve self-driving cars we're not
trying to yeah build a massive
corporation we're not trying to build a
consumer I mean we sell these products
as dev kids basically just so people who
want to come develop with our stuff have
an easy way to enter the ecosystem you
know you don't have to pay us a dollar
you can figure out how to build all of
Comus stuff all the stuff you need is
post it online for free if you know how
to find it right now it's a big part of
it no comma - is not free but you can go
you can build a neo board which for the
most part still works you can buy the
cheapest phone off ebay you can 3d print
your own case right if you want to join
this this this ecosystem you can join it
for nothing but if you want it to be
easy and nice so if I covet ooh right
now if you want support easy and nice
that's a lot easier sure for the most
part if you buy if you buy a comma - and
you don't have any unrealistic
expectations like a torque mod for your
Honda you can have a good time I think
it is not managing expectations and
we're working on doing that a little bit
better the bar used to be a lot higher
it's moved a little bit and we're gonna
continue to try to talk more about what
is what a good community member looks
like a whole lot of uh look if you um
purchase a comma - and you never send us
the support request and you figure out
how to do everything you're good we like
you alright if you expect support if you
expect to be treated a certain way you
shouldn't buy the product from us right
yeah I think it's pretty clear but the
flipside of that
and like why I feel ok saying all this
is because well if you have a problem
with all the pilot you don't have to
rely on us you can rely on yourself
no it's open source right and that's the
beauty of open source it's very unfair
for company says there's no support and
if it doesn't work get bucked all right
we don't say that we say there's no
support if it doesn't work you have
access to most of the same stuff we have
access to almost everything this is also
why we have a one-year warranty on the
hardware the hardware is not open source
but we warranty yet we make sure it'll
market there's any actual defects in the
hardware we will fix them we'll really
try to do a great job with that if
there's a problem with the software or
if there's a problem with you figuring
out how to use the software it's open
source bro
you shut them all the testing they're
doing yeah yeah you want to get yourself
some testing if I call comi I support
there is no comment I support somebody
asks for a phone number and we laughed
at them I mean there's an email there's
an email support a comment i but most of
what's the point of comma a I will tell
you is if it's a hardware defect we'll
look into it
otherwise fix this offer yourself we
have a 30 day money-back guarantee yeah
I think that's pretty clear
oh really I'm much more to say about
that yeah oh yeah no we've been working
really hard luck no there's some talk
about well why don't you like gated why
don't you make people like do a
programming test for them to be able to
buy stuff like we don't want to add
artificial difficulty to this right very
talented
you know programmers are people who are
on the community or are busy they
shouldn't have to it shouldn't mean that
they shouldn't have a good experience we
want to make the experience as good as
possible right but think of the
experience more like maybe the hard part
of the experience not the soft part of
the experience mistakes maybe we should
change our email to the hardware support
a comment oh it's not a bad idea yeah
yeah I think that does make it a little
bit more clear yeah because to be only
said yeah cuz we only sell hardware yeah
yeah yeah
there's lots of people on discord who
were very helpful and I would I don't
know how much you've said but we're
really grateful to our moderators and
people who have to help everybody in
discord there's a lot yeah yeah there's
a lot of great people great content in
the discord we really you know by
getting rid of all the less good stuff
we really did Stu let them shine more
than anything else yeah yeah uh yeah
order support
yeah but order like people think they're
entitled to support for open pilot
they're not I do see what do you think
that
because you know they didn't really like
look into what it was they just like you
know try they cause some software they
just followed some tutorial they read
online not put out by us and then in
that case think I asked them for support
right oh yeah if you ordered a Bosch
harness and you received an ID act
absolutely we had to read three people
this week I heard there was an amount we
shouldn't even we didn't make up set it
back but you said it free we sent a new
ones what seven free new ones yes right
when we deal with that right what
percent of the emails are crap um we do
ignore stupid emails I mean we do our
best to ignore thing but there's a lot
of inbound we're very small team so
continuing trying to just stop the top
of the funnel for being so big yeah make
a helpline for the software they didn't
you about the Nintendo Power out line
back in the day should we charge two
dollars a minute
just imagine you purchased Super Mario 3
and you couldn't get past the third
level in the fourth world do you think
you can call Nintendo and ask for
support we're just not there yet
we're never gonna be there we saw that
kids today we felt that kids are we
gonna stop that guy I think it's clear
what you get dev stands for developer in
case anyone's confused about yeah duh
dev watts of sport if you're not a
developer we don't recommend you buy
this product that's right but remember
that being said like I really don't want
to exclude people because they think
that like I don't know how to program
right you don't have to know how to
program things just be patient you
having to learn willing to learn that's
it I know we asked sailfin
self-aware self-aware your
self-awareness yeah yeah snaps for
self-awareness uh software support with
Prime subscription and why does
everybody what support does everybody
need so they don't want support you see
they they get it and then like they're
Hana doesn't have enough torque so they
want the Torquemada alright which is
super dangerous by the way
safety is very
she's very important um that's one of
our main issues in the desert or you
know there there's lots of like yeah
cool you take them back there yeah yeah
we took him back there briefly are there
secrets
I get nervous taking chunk people around
back there - from where out a little bit
more and then we'll do one more pull for
the free shirt categories for aired wait
a pole what you say polar pole a pole
just a show
uh-huh no the pole Church wants people
to work for free whoa no I well people
email us and say hey I know I'm not
qualified for this job but I'm willing
to work for free and like you understand
that that costs us as a company more
than we gain I mean oh comma pencil yeah
people you know we weren't talking about
how comma pencil is one of the nicest
channels on discord it's really nice
people are contributing doing the great
work you know we're sending out Eric B
and PJ la are gonna get free comma twos
when we uh I mean I think they've been
the biggest two contributors maybe some
of the other people who can contributing
and give like a hundred bucks off or
something we are gonna do um maybe some
new merch let's yeah yeah listen the
fillings act people here's you know
here's your kind of like here's you
where you start out right every time you
contribute something you go up every
time you know you say something stupid
oh yeah ask for support you go down
karma I knew there's no expectations are
are challenging yeah
don't have expectations don't have
expectations that's right under promise
over performance we are here to under
promise the shit out of all evil that's
right you won't get anything they'll
send us money and we won't send you
anything that's a lot we really try to
come up every Monday and Tuesday you
guys something is gonna happen with the
common points or something I think we
can tell them the word it doesn't mean
anything
Epcot grows you heard of Epcot get ready
for the up hide turn are you leaking
it's not leaking it's just a pot it
doesn't mean anything
I mean they can do Google does Epcot
mean something if you google it know
what they know where it's derived from
yeah they'll never figure it out man
they'll never figure it out
it's a comer is it a rash guard what
nuts is this a your birds are for him
you know it's just like papi who knows
man well this was an ambitious former
comma employee project it'll push ups
grows if it's built all right my
battery's dying wait I love this on the
label did you show them what they're
showing the label it says made in the
USA freedom I can't read it's backwards
it says seven days no training makes one
week that's right that's how we calm a
phone you know performance fabric all
right I'm gonna show in the back a
little and then yeah chill for how you
can get a freedom shirt you're not on a
gimbal you're sitting on the table sorry
do we even have a good book yeah we had
one Mona where it is can I buy a comment
to a doge coin I mean you can convert
your doge coin to cash and then by a
comma - that's right pet name for common
customers is calm I don't think we've
ever come on come on come on discuss
scope is done but a periscope died
George you were out to scam us
we want comic of oh the coveralls were
the best you feel scary good maybe we'll
do a special edition cover all um
they're expensive though can you use a
common tail with a board I don't know
man
a comet - is just hardware we sell you
hardware can you use it with a
television maybe I don't know , boxers
George couldn't hack aboard
our commenters are like it's like
discord in here no they're pretty bad
can I use common Russia you can use it
anywhere there's roads I think the
freedom sure it's free all right guys
I'm gonna put my mask on when you buy a
comma - wait why are you putting a mask
on you know it's important to be safe
from coronavirus I'm worried about some
of those people in discord giving me
kind of ours
I'm within six feet of them you know all
right we're going all right we're going
you want a sweat flip the camera on you
can you can hold the camera no you're
better at it than me it's unclear well I
don't know yeah the secrets I'll show
you could show them this guy's the dance
the data center is growing yeah the
models are getting huge yeah just this
oh this is good George is using a mask
because we're toxic production we just
we just reorganized all the shelving uh
really ramping up production but comment
who's irate where they're selling so
fast oh thanks guys
this is how we manage and measure our
yields every week here's our past band
and yeah yeah that's really long
these are from our 3d printers also
we're looking for Moore's or tracked
m200 no we're not moving production to
China anytime soon we produce
can we meet production guy guys can see
the team beautiful flash and uno boards
oh man do they know we do a really
thorough testing yeah got to get that
success one off here damn look at the
back guys can see virtually Chris back
here also if you're interested we got
sweet acts of UPS's I don't wanna buy
these Oh
oh my god shirts we're giving them away
tomorrow only tomorrow this is the most
exclusive car mentioned in history
wow you own something Wow yeah I'm
keeping this one we have 18 more they're
gonna be given away to the first 18
people who buy tomorrow with code
freedom sheriff tomorrow's at midnight
starting
yeah PDK don't mess it up those are
great shirts
chase oh hi so alright know what should
we let unlimited people use the code
freedom sure and then only the first day
team will get it how is that that much
different from just giving a clean out I
think we have a good system going
there's only 18 for you insurance then
there was a only up rate a mess we can
get people to buy
what if whoa we know I got an idea okay
no new play no seriously play better
rated to get money we're gonna you as
many people as want to use freedom sure
tomorrow if you use the code freedom
shirt you enter into the freedom shirt
lottery every time a to you by enters
you once into the freedom shirt lottery
okay yeah and then we're gonna do dice
to determine which order numbers get
free of insurance Oh that'll be great
stream oh I love it
oh well not stream there's no more usage
limits on freedom sharing every comment
to you purchase don't show them this to
make sure people know you know when it
is what it's scheduled it's not illegal
it's a look it's a loot box actually go
um no you can have it you could have a
lottery I believe the lotteries allowed
is really can I show the Hyundai Sonata
it's illegal banned for life we could
use some more high-profile officers if
we could George doesn't have that enough
high-profile lawsuits in its life um
loot box is not a lottery that's correct
[Music]
we request it yeah they are very rare
yeah
I entertain requests time I said uncle
your local Hyundai dealership
these are ultra radar creatures they
look so soft
no pretty nice yeah I'm gonna put one on
later all right
tomorrow we did it to PDG every tomorrow
everyone gets a free t-shirt if we get
less than 18 everyone gets a freedom
shirt we get more than 18 lottery sorry
leaf box whatever the most legal way to
stay that says you're looking fit raffle
thanks alright alright I think that's it
alright yeah discord we're really trying
to make everything higher brow higher
brown community if you're here to be a
leech don't fire Chelsea have you
listened to anything we've said today if
we buy a common tool you show me the
Hyundai Sonata
Barnaby says sure can they listen to
anything we've said today how many more
times do we need to say it yeah yeah
encourage things like that you know back
when we needed money
watch all right we calling it yeah I
think we called it yeah oh my god my
house is a car manufacturers lock the
comma to zap answer this question all
the time why why do people think it's
gonna happen well we can't yeah they are
aware that Apple and Sony couldn't keep
me out right like software companies do
they think that like Honda and Toyota
can keep me out bro what did I say last
time that was asked dog means never
having to say you're sorry I think we
under it create a wiki for FAQ I think
we did all right bye-bye
sale
what's up
what do you want
that's a slate
oh it's a google pixel c
uh
i don't know 40 bucks
40 bucks is yours
welcome to the comma garage sale we have
everything here we have 30 90 boxes for
three dollars we have computers high
quality computers we have development
kits gps development kits
radar development kits and video
development kits we have a thousand
dollar zortrax adventure printer
um what else do we have we have 40 ups's
uh oh did all the monitors sell
oh
wow we priced the monitors way too cheap
uh welcome youtube so we are at 1441
state street if you'd like to come down
we are here till three o'clock
everything must go bargain basement
prices
uh we have a few i believe we have two
hot ticket gtx 1050s for sale
uh 100 a piece for these guys i'll sell
you this gpu despite it being larger for
only 20.
uh
nvidia quadro i don't know 30 bucks
yeah you what you want it no
no even sadder we're selling this what
is that 400 it's an nvidia drive px
yeah we have we have all the real dev
kits too tx2 tx1 new inbox
tk1
a nice soft is it a gp you know it's a
development kit
um so it's a it's like a raspberry pi
but good
uh it's actually the same processor
that's in here for only 50
but it's a development kit so charge
more great we sold a gpu machine with a
gpu what a deal they're good machines
you'll enjoy them these weren't training
machines for a long time 250 bucks they
cost us like 2 grand
everything must go
um
so yeah we are here at uh 1441 state
street this is the comma garage sale
uh come on down
buy stuff yeah yeah the 1050s 100 bucks
uh this guy 30 bucks and that guy 20.
and we'll get some price tags i got to
go get some price tags
goodbye youtube thank you for watching
come down to the common garage sale 1441
state street we're here till 3 pm thank
you very much
it's completing it says there's someone
in the middle seat who's not strapped in
I don't sure they I can't okay so this
is comma two running on the pulse desire
branch and let's just make sure
so we'll go for a little drive around to
the highway
the guys were working also on the
autopilot in the in the city or now well
I can show you what it'll do so we don't
we don't block where it can engage or
not ah so we'll just uh let's get the
highway first but yeah so the first
thing you learn about self-driving cars
if they're actually extremely bored when
it works well it's super boring when it
doesn't work well it's exciting but you
know that's not good so as it gets
better these demos get more and more
boring
so the Corolla is a out-of-the-box it's
the best car we have but a torque modded
Civic is slightly better because the
Corolla has some issues with the rate
limiter
so let's just do it automatically in
change here
pulse desire stuffs good oh it used to
be so aggressive and they change
so yeah yeah the problem with these
demos and like we learned this quick
doing demos for the press is when it
works this partnership
oh wow yeah so I'm not an exciting part
again you know what I mean like I'm not
like doing anything you know yeah look
back at you don't do that watch a rut
guys there's a girl are complaining yeah
it's not just kind of probably a bat
there you go oh there you go
yeah we don't to make the DM too
aggressive because it's too aggressive
and just piss people off
we'll try closing my eyes we'll see if
it detects that watch the road guys
waiting for Tesla to update their yes
activation for that if ever
yeah so
we know really bad accidents yep that
could happen a few where drivers fall
asleep so it turns out that like 1 in 20
drivers has fallen asleep in the last 30
days while they're driving
suffer scary
yeah are you waiting for Tesla up to 30
M they'll never do it and the reason why
is they don't have it for LEDs that's
what I was thinking yeah I was thinking
that the cameras are insensitive
and that the display has enough to show
some my own driver but probably
no it does not we know this we know this
from experience
yeah no one's actually seen an image
produced from that campaign really yeah
that's what I want to get done today -
that's just let's go in here
automatically change we're gonna
integrate real soon with the blind spot
monitor late it's gotten so much better
yeah pulse desires sick post desire we
used to put it we used to constantly say
lane change they change they change
elite actually change and now we just
say they change once
all right we'll go for the demo or it
might actually mess up this when you're
on highways like this it just never
makes mistakes unless some driver does
something like really stupid
yeah it's smoother than our patent on
the upside is it's smooth the downside
is it
not as tight for things that do require
Titans
I really like that we disengage on gas
you're thinking it's a domestic visit
because it goes over the Torah yeah I
don't know sometimes there's model
failures see what does on this merge up
here
we're not great at merger our
longitudinal policy just isn't great
problem like if there's a car like right
there kind of cutting in and it doesn't
detect it as a lead it'll accelerate
into it
I'm doing nothing
[Music]
it used to be more aggressive on the
accelerator well so at first it wasn't
aggressive on the accelerator at all and
then we had people complain that it
wasn't aggressive in accelerated
aggressively so then we had people
complain about their fuel biology so we
reverted a lot of the accelerator
aggressiveness we're still kind of
aggressive and stop and go traffic but
like that like get on and get in front
of somebody it won't do
auto pilot to a more aggressive
accelerator phone plenty of an electric
car you can't be you think yeah
you don't feel it as much because it's a
lectric you know it's not about you
don't feel like I feel less compared to
this look at how chill this it's alright
like our slogans make driving chill we
really try to we really try I like
optimize minute oh you know it's just
driving is this
I just don't model three-four fortunate
models inherent you have probably met a
thousand on autopilot and the first time
driving a pilot and a couple of weeks
and it's it's a different experience
like autopilot feels like it's
aggressively keeping you in the center
of the road and like it's like a you've
got a machine and it's like you know um
you know maybe like you know I think
like BMW slogan like ultimate driving
machine I mean that's what like
autopilot feels like a little bit of
element yeah that's not great we got out
we gotta fix that it's not like terrible
like it doesn't split the difference
anymore use this what the difference
take you right to the milk just get over
here
give me second automatically change
maybe my miss car nice job Oh violet
yeah
everybody happy with that
at first is something that competes with
the auto family does really well it's
just it is so much more of a autopilot
really like you know test the talks all
the time about my full cell driver plus
I'll drive a full self-driving we don't
do that we embrace the fact that it's an
assistant alright so I'm gonna have to
take control here because we actually
don't want to get off that sixth Avenue
and not be in hillcrist
still when you got to do maneuvers like
this
it's still all you
I haven't tried the full self-driving
stuff like Tesla might be able can Tesla
do that if what I just did there
not that wall not that well
so we got lane changes around corners
automatic end you're never gonna get
nagged as long as you are paying
attention to the road Amen you watch me
both look away and close my eyes so I
called me both times so it is definitely
so this stuff's actually quite harder
than it looks you look at her like oh
this is a normal turn yeah it's really
easy to read but look at the bank of the
room right
just a heads up and it might mess up
there a lot of times when we give that
warning we should we should actually
really quantify that like what our
percent of false positives and true
positives is on that we don't want to
well there are people too much but at
the same time if there's like really any
chance that it's gonna mess up
also our torque limit is so much lower
than Tesla's it scares me to keep my
hands off the wheel sometime for auto
pilot because it might just target it's
never
that's all that's all enforced by the
Panda it's not even don't like none of
the Python is the safety code the safety
codes all in C it's got great you're
gonna test this around it and we limit
the ramp up of torque so it can never a
jerk to realign that's why I'm so
confident having my hands off like it's
not to say that it doesn't mess up but
what it does mess up it's a Sheila reach
out and turn not
they're going to go I had thought that
Oracle that's were provided in that car
they are but we do additional we don't
actually you can use the max torque of
the Corolla but we it takes about two
seconds to ramp up to photographer so we
we put additional safety restrictions in
front of Toyota
we don't put additional safety
restrictions in front of Honda because
the Honda torque is so crappy to begin
with that we're like there's no way you
know it's gonna be fine alright so now
we're adding a little bit of stop and go
let's just get over here
it's an assistant so we don't put this
engage on steering but unlike autopilot
we do disengage on gas
I can tell you're pretty familiar with
where it disengages or where the I've
driven yeah
so his turn exceeds what that torque the
Macan do especially I'm taking at 50
miles an hour
I think that's one thing that really
does well
the miles from its users driven
to take those heart turns we can do it
too it's a safety thing it's not a it's
not a model thing or model critics are
turned great the problem is well if you
allow high torques right if your policy
is to allow high torques when the model
says high torque is okay then well what
if the model says high torque is okay
and it's like not so in cities how well
do we work this is where I think we are
comfortably better than all on my
location I think auto pilots better at
hard turns
I think auto pilots way better emerging
we do almost nothing for merging but
when you're in scenarios like this where
it's kind of like subtle maneuvering
we've on that water where's all the
pilots like all there's a plane over
there oh let me move over there oh
there's a lady over there over there
I think there sounds more applause than
August
so like look at look at the maneuvering
through I mean these are straight
intersection so they're not that tricky
but look at how we've like moved a
little bit out there but not too much
right like really like where a human
would position themselves on the road
so this vehicle have radar returns yep
now and you integrate those when doing
fusion
but yeah I mean this is this is the
tricky stuff look at look at look at how
it just look at what moved like a little
bit there and it's so subtle I'm to like
put you in between where the parked cars
and where the oh man and this isn't even
be efficient
yeah we've been 31 32 miles-per-gallon
with the new longitudinal policy and
went down to like 28
okay cool wow thanks George thank you
very much
do one more
yeah we
once across the other lines actually
kind of start with me around so the
question is whether I think around the
same amount every time or if it's like
unpredictable we're trying to maybe see
if it's possible to drive a car would be
better
my strategy is to find the areas where
things are changing the simplest places
yes pesky where it's dropping this big
gaps in those dances the truck driver
really kids there's no picture
[Music]
so there's we say thank you from you're
only looking forward to the part that
looks like this
so once we do a little bit more refining
on this we're thinking of trying to
inject our own thanks is it am I on the
Wi-Fi yeah
Oh Street okay
[Music]
what I've been complaining there
complain all you want the tripod man we
don't have it
[Laughter]
you can't be nice to people on the
internet yeah that's true
if you yeah and yeah it's so rude that
there's that mountain right there and
we're just holding this one that one's
beautifully mounted but whatever after
yeah yeah sorry both its this one sorry
the iPhone 10 - 10 - this is a nice
phone George back from Rome actually
really get it yeah yeah the battery life
lasts seven days Wow yeah pretty good
it's true you know get the iPhone
honestly guys we're selling too many
cartoons don't buy them no George not
always by always by Colin if you wait
[Music]
yeah it's also cookies were also kind of
shooting ourselves in the foot no no
$1,500 covetous that's a
due to and basically the project we work
on with image segmentation specifically
and kind of dialed around the comment a
new dataset and basically were able to
model data self-pity and we basically
tried to classify the images you can
[Music]
and one of the other projects we wanted
to do was to even trade on the common
technique data set but later I noticed
had the data so it wasn't good enough
there was like a lot of missing people
and basically the only thing left is
there was like sighs it's separated
sides from the extra traffic signals and
then there's like three different types
of persons in far away person so we just
ended merger zone with one women persons
one legged person fully yet they don't
have Lane
[Music]
oh this makes more sense because this is
it like every single cover there is
people are always gonna be yeah because
they labor the road
there's quite a bit of difference is you
can see up there that is sorry
that yellow that's inside maybe you can
see all useless passive pcs this
specific video was actually referred
using like the 24th responses but I have
a feeling we actually made if we can
burn the output to how we did other nice
everyone here is also going to be asked
to vote which presentation you'd like
kvass when you camp yourself say their
vote out loud that's so intense yeah
Jake's well I think I'm here to heckle
yeah
[Music]
[Applause]
[Music]
so I just want to show the example so I
was able to get the image stream into
Ross and then as a result be able to
load up one of my loss packages which
takes in a single image and produces the
death and so this is our business it's a
tool that's built into Ross them like
these are when you get messages this
into boss you have this tools in the
ecosystem so we're going to see that
this is the image streaming from a log
on the right you see a 3d visualize few
of the actual of the actual in 3d space
so you can see like it is quite slow you
see this but it delay of course you have
staying on the GPU but there is a good
amount of bottleneck with the actual
bridge that's because I actually pick up
the messages from CMP not directly from
the shared memory message interface so I
think in the future I'd like to work on
into X this is to go directly from that
shared memory interface directly to Ross
so this is the one I was only getting
able to get the images across I've been
working on getting to a gamma tree data
as well so that peasants
I have able to get that right but once
I'm able to bead up then you'll be able
to visualize the Adama tree over time
two minutes there
[Music]
[Applause]
who's next
yeah
oh wow pencils it's based on take it
detects edges which
[Music]
I can actually just take you through
their demo just here to these features
so this is dedicated like cluttered for
example Russia so this is a quick pitch
strike so let's say I went to this this
is now what to do flat filled we enter
to this so if you have some region
yeah example something at this day so
it's hard to see so I did it as I which
is working on this and I decide to I
just wanted to add these features for
better annotation so what you can do
here is that again you can further put
this and then if you have some sports
left you can just click on the platform
and then you can fill it and then you
can go to a particular image of these
things but one of the reasons to do this
was to go leverage one of the things I
want to tell you was checking out words
github submitted it which is a really
cool so what this allows us to do is
here's some
so this is basically you got a minute
so you to pay attention because this
stuff's all gonna go live and you guys
are gonna label the 10k this is actually
the highest leverage way in a long time
for you to actually improve open pilot
our segment is total garbage that
underlies all the open pilot models so
if you're upset that open pilot doesn't
detect the lanes by you you're gonna be
spending a few hours and come pencil
content sweet nice did everyone realize
that I spelled limit wrong on every
single sign no one no one caught that
limps over there - oh there's one a good
eye okay with that one there's no way
I'm Alan yeah you got us really
[Music]
[Laughter]
- I wish it was on purpose no it's
embarrassing I was like how do I miss so
many eyes so many do I would shit I know
I'm with myself I don't know what
happened well they do and you think
you're doing an eye because you do the
movement of the M and the T you know
it's all very very NSYNC it's tough Wow
mmm these people are rude about the
tripe I'm gonna shake a little bit you
know there we go shake them yeah yo and
get ready for Carl pencil guys ya know
we actually really appreciate
he's possible
join us and discord for the greatest
common crowd source heard since like the
last one of these we did mm-hmm
no but like this one matters the comic
colouring data is all this matters it's
a lot more well thought out 10,000
images I believe in you guys comp pencil
the reason I believe in you is your pull
request was gonna be reviewed by the
community yeah and if you're not it's
all accurate but all those labels
they're gonna boo like just gonna this
might work this is great reflection of
the common neon sign okay yep
the buncher doesn't know about 2x DPI
it started and first thing can it be
now technically if the Wardrobe in their
clothes so
[Music]
we were that we were checking the old
sensor that's a feature we don't want to
disengage at the passenger remove this
highly concerning but tests already
finding bugs
what's the mountain
and over charger battery is that what B
is no I always wonder that it's like
driving slow oh that's a great feature
but yeah it is figuring out which one if
you're making a fort or something like
that if all the variables are correctly
there's one collection
yeah we found out that after we happy
after all the data
it's just nicer to be actually
we work on we also work on a different
one where we were trying to say
cool
[Applause]
sweet 2/3 you want to comment 2/3 build
a free arm
how's YouTube 58 almost pathetic is it
don't go tell your friends come watch
our channel I'll tweet maybe you know
from people who didn't think that comma
is actually gonna do this we did and
everyone in Disco oh yeah yeah that's
better
okay okay yeah can you do that yeah
yeah we can turn off the me on I guess
two three
thank you very Chris I think so too
don't mind me just having a conversation
you know
probably already linked it I mean the
it's very difficult to make up which
signal to work and so we should have to
do is they try to forget the automatic
filtering signals and ultimately to
suggest from from all the logs from a
signal Rockpile open pi will be able to
know which camp the steering
acceleration operating so we doing it so
we took the and expected everything in
CSV file so we had all the data based a
reference which time
[Music]
actually all I fights all the vines yeah
yeah but what if what if it's in the
least significant byte yeah yeah yeah so
for some of the messages here but at the
bow make sense even message and you got
lucky because in the first two bytes
[Music]
right so anyway after that the idea was
okay so now you see that
can we actually train a neural network
to differentiate between the two so we
go to the file before and victim in the
friend shorter randomly selected hey I
read a few seconds and pass them on to a
neural network actually try to
differentiate between steering and um
steering signals and the accuracy test
occurs ended up being 89 percent which i
think is fair okay not for like
generating BBC but at least in the US
are showing the steering signal yes yes
just to show you what it looks like so I
can I can run this for example this is
like this so of course if you run this
probably is
[Music]
[Music]
are you doing YouTube how many we got
130 130 they complained about the
microphone
they were complain about the mic when I
talk yeah you're very close euro said 20
percent
oh my battery nobody lasts forever oh
that's true oh I was worried cuz the 90%
more normal yeah exactly and iPhone 10
died so quickly right
so hi everybody I'm Campbell I took the
bus here from Berkeley I decided to take
on this cabana challenge auto figure
printing Cabana
so basically auto finger printing in the
Candida there's information about the
car and normally through Cabana you need
to manually choose the DBC file and
interpret all that Candida and so I
built a feature in Cabana that can
automatically detect the Equality in
automatically applied the proper right
now it's not automatically deploy
applying it but it's kind of getting
smarter suggestions then these available
and then I also went around and kind of
talked to people that used Cabana and
figured out you know what they liked
about it was they didn't I kind of made
some some UI changes I had any more data
to the UI and kind of made it more
modular I also enabled I the ability to
customize there
that you're sourcing here you can see
files from and then just generally went
around and kind of reverse-engineered
out in you know maybe I'm planning on
cleaning up the work preventive on this
and submitting a pull request and I'm
also you know I've gotten a feel for
this app so I kind of want to keep work
night and you know for feedback if
anybody got a new feature request yeah I
really enjoyed it I enjoyed you know
talking to everybody that they didn't
it's 48 hours yeah cool cool challenge
and I also kind of service more
information from the camp pilots that
that were previously available so kind
of you know went through the process of
interpreting this this can data and
displaying it on the front end or for
the ability but kind of manipulated on
Cabana I wasn't able to get all of the
canned data converted into bytes so you
could play around with it but I kind of
got some of the legwork gained and
some of the signals like some of the
live tracking data some of the path
planning data and more of the car
parameters able to be accessed in Cabana
yeah cool
[Music]
[Applause]
one more
[Music]
yeah Mary oh thank you thank you thank
you you know what I want to see just how
long George's battery lasts at this
point that's gonna help him out and then
I figured well youtubers welcome to the
intermission it takes people time to
plug their stuff in you know that we
have to keep you entertained constantly
it's so important yeah but you can't lie
there's some people who lie up yeah yeah
but then people are so mad about the
video you know it's a real delicate
balance Wow charging yeah we have so
much plugs here I know so much plugs
it's crazy
keep talking George 150 people watching
you guys are interested we sold a lot of
two's yeah they're great software did
the interview process very fun I'll
interview myself
fun but
fine fine it's fun it's just fine Joe
but driving chill if you fire come to
but don't buy come to Seoul too many
yeah now I'm done with that I'm done
with that reckless played out limits
without the I was happy is what are you
gonna do to the screens not work when
you want to plug them and plug them back
in Oh No Nvidia fix your driver Nvidia
if you're watching fix your driver way
mo if you're watching shutdown you'll
never make money
[Laughter]
zooks if you're watching we are hiring
[Laughter]
we are reaching from a big level five
company today
I'm sorry level four
hmm I think the presentation is gonna
get down here
Oh what yup yup just just the monitor is
uh some things that monitor don't judge
based on that chip that's right
computer because the Nvidia drivers are
terrible going on plug you plunge of mud
and Eric over beer yeah you will regret
it okay
that system program problem detected
started after I installed the Nvidia
drivers by the way look guys manager
runs on Ubuntu now it's like people are
so quick yeah I wrote this code so the
brakes first oh no no you know the
problem is we got to run calibration D
open up another window yeah that's the
rain by the way so dry
she's a location location date just
that's good I'm da / calibration date
Wow
about to be crazy fingers crossed
that's super combo wait is the framerate
right why isn't the model running should
be running right we need anything else
oh maybe it's there I don't think it's
working
no I don't know restart calibration day
restart your model he's not gonna be
bothering Model T is not gonna run the
model unless nobody should from the
model because this super combo Oh
control C model the entire even gotten
into the work you didn't change you I
know Chelsea ma do you run it again
that was not right there click on though
yeah but don't tell Caesar
Oh
yeah why didn't Cambodia least are you
running comedy - yeah oh that thing lies
and says - oh you have health - yes nice
I should start model Deepak it worked
for like three frames this is exciting
who's gonna be the first person to go
out and put a youtube video up driving
with your logitech webcam the future is
decentralized all you need is this all
you need is a webcam and a gaming
computer and open source software to
drive your car yeah and a panda I don't
know that but there was the yeah really
someone having adapter that they were
used yeah there you go
No
we can you can show it on the laptop
yeah let's do that
[Laughter]
so hi Kenzie I'm super happy and proud
to be here I appreciate you all giving
me a chance um so I'm probably by me not
probably I'm definitely by orders of
magnitude the least experienced person
here so at the very beginning of this
event George mentioned two reasons why
we're here one of them was as a
recruiting event to find machine
learning talent clearly I don't fall
into that bucket yet so the other one
was to beta-test some software so I was
more focused on that aspect as a person
who is maybe more savvy than some people
but is still just like trying to figure
things some of these things out so I
guess I was representing that end of the
user pool perhaps but in any case also
George mentioned externalizing things
and so I decided to focus on that Jo
[Music]
wanting to see torque displayed maybe in
the EON but an indication in the
meanwhile I started working on showing
torque but not in the beyond instead in
the in the UI interface so um I'm not
sure how many I'll work on this aspect
but there's the unlocker which we start
running and then it starts spitting out
data and then we can run the UI module
on top of that so
let me just first demonstrate the UI as
it was originally received by me
so Iran Isis currently exists on the
repo so we get the data running here off
of a public route public on lager thanks
to anti-age - yes so you can start
spitting out data you come over here and
[Music]
yeah we run the UI and the UI should pop
up there it does so for those who have
tested it this is what the UI looks like
there is an issue here right off the bat
which is basically that the resolution
of either the VM and/or my Mac are
making it such that the lower part of
the UI is cut off I don't think I have
well it's fine I don't think I have the
capabilities necessarily to change that
I tried to mess around with a resolution
I could not get the bottom part of the
UI to show up but I was intending to add
torque to this anyway
so that is the UI as it exists and so I
started making some changes on the route
to get any torque to show up so I'll
just quickly go through these I know
what these invasive so the short
presentation so the first thought I had
was making it resizable I started
digging around in the UI and also one of
the UI libraries and I was able to make
it resizable but that did not make it
such that you can scroll things I've
done the next thing which is that okay
so I have a screenshot here of the UI
where you can see that UI is five years
old now oh yeah I wrote that during the
smoking weed era of common
[Laughter]
so here's a speech I made of the next
part which is that I was started messing
around the elements and I appreciate
very parsimonious commenting I think
that's an under best circumstances an
indicative of good coding and so that
was the case here sorry how did you
start manipulating things to see what
was what
so first thing I found is that this text
was the thing that was off-screen so I
changed the orientation to be zero zero
so that I could see the text and it
looks better on the picture there looks
like the tehsil ones I agree yeah that's
that's one of the things I realized so
thanks Tesla
so yeah so this text which is not
visible on the UI with my current setup
is now visible and I agree with George
it does look better with the picture as
the background so but then I noticed
there's this new line break between
those two sets of data so I asked Gregg
is there a reason for that because you
can see actually apparently one of the
ways in the smoking weed era to show my
break is to just do none and that added
the line break so but clearly that was
an atom for no reason so I asked great
great what the reason was he wasn't
quite sure but he guessed that there is
some sort of categorical separation
there so in an attempt to retain the
category separation categorical
separation without without having a new
line there because it was taking it more
space I just removed the new line and
then change this lower frost to orange
had to find out how to do all that and
was successful and there's gonna be sort
of a reveal at the end or whatever I
just show you all that change limit
anyway give us the reveal in one minute
ok ok other other change I did was there
was there's a video that shows the
trajectories on top of the area of
interest and I wanted to put that up
here because there's a lot of wasted
space just from a usability perspective
there's a lot of wasted space going on
up here and basically anything outside
of the bounding box we don't really care
about so from a visual perspective it's
better just to have it in there so I
kept this text
move it over here get it up here put
that put the other box up here to the
divinium video which is a shout out of
it and then yeah and then starting
something massaging text moving things
around massages and then the plot moves
out of the way so I started massaging
plot spacing in my UI oh so so yeah so
now we have the video in video so as
we're taking advantage of the wasted
space above all so it's aligned with the
image below in order to basically have a
little easier visual acuity this is
still taking advantage of being on top
of the background and now because the
default setting on the text for enabled
and brake light is black we can actually
see you know when it's not being engaged
effectively also I moved this map up so
we can make sure and see the car and the
reason why this text is alright to
overlap is because the farther we get
away from the front of the car the less
is effectively so it doesn't really
enjoin the on the you whatever the
debugging aspect of which is what we're
using this for and then I got the plot I
you know matplotlib as we all know is
not easy to use but I was able to
massage these into space so that we're
still seeing the data and the last thing
that I was working on but wasn't able to
do was get these labels to match the
color of the gas line that would seem to
be that makes a lot more sense than a
little parenthesis that we have the UI
has not been shown much longer okay so
now the very last that was that was
that's mostly what I did and then the
very last little thing is that as we can
see here with this system is based on
pygame and pygame
works quite well but here's the thing
pygame quite understandably has self
promotion needs and so as you can see
every time we invoke the UI piking gets
their little
husband in that hello from the PI game
community which is overwhelming you know
okay well so then I didn't like that I
don't want I mean no offense the flag
game we love them and all that but I
just personally didn't want to see that
so I first got rid of it and I thought
no but we still want to prompt so I
added a combo prompt everyone in 2%
preventer no no all right I said we were
gonna shout it out but we're not really
gonna oh well actually gonna all go in
the back home employees after this and
decide who wins the prizes oh we can't
be bribed yeah but you're do that
dashboard
people love dashboards I don't know why
and so basically what I did
2092 k-19 and flipped around the process
readers to a non processed readers it's
running currently on a branch and might
get a hackathon if you want to get a
ticket do whatever you want with it but
it's really cute I to be aware of that
instead of numpy basically we're just
burning all of everything this one it
should be what is that
yes we're downloading the entire 22 K 19
data set right and then we go and we
extract all the values which was kind of
hard to do but that's good so I just
simplify the whole bunch for loops and
then I brought them in and I made a
dashboard which doesn't really work but
should eventually we have some display
issues around saying there's a for some
reason and so you just go down here just
running off iPod widgets as well a few
other simple technologies and you should
be let's do just put spacer and we'll
get the full dear friend there with the
query and then we can do is coordinate
map which is not gonna be out
it was taken I like this one I think we
can do better and I think we can scale
it and then the speed verse bearing just
to show it's kind of possible and this
is the Geo map to show that a map was
supposed to be there but I couldn't get
a display that's all hey yeah could you
tell people to get their asking you okey
whoa cool
okay um so remember how I said YouTube
was gonna come in the back to the
judgment session they're not sorry you
two bye bye you two
[Music]
yeah
oh no I gotta sign something again so
much signing all right we're good or
that in there looks good
cool don't you do me a big favor
what's up you will be see the survey
from Toyota yeah all right all right
perfect
I understand there you go new car
delivered I have as you go excellent yes
oh we got some people talking in chat we
got a brand new
excellent thank you very much Steven
have a good day
if you guys didn't see this were at the
world's largest toyota dealership right
now long ago Toyota
welcome welcome well I'm so happy I
tried to stream like three times and
then I rebooted my phone and then it
worked so twitch made it work you know
this is my friend Tom he's gonna be
holding the camera for you guys while we
install open pilot on this brand-new
Corolla that we just got from the
dealership right we gotta get out of you
let's get out of here let's go let's go
let's coach whichis let's go let's go
all right all right
quite apart spy camera
this car is literally brand new how much
miles does it happen we have fourteen
point two miles on us show on the miles
how do I sweat you oh you can switch it
with that there we go perfect
yeah so it's a brand new Corolla right
here all right first he posts a pixel of
Ferrari on the gram the dreams of the
Corolla you ever hear of a
bait-and-switch guys all right you think
we could find any parking spot with
shade I mean it's like I'm bad with
these you know it's actually kind of
good just barking like a general let's
go all right
all right so guys I'll show you this
guy's super confused look at his face
he's like what the fuck are you doing
you're not this isn't child friendly no
no no this is not no but this is a
Christian channel so Oh Christian
channel so you know don't blaspheme the
name of Jesus all right so this is legit
a brand new 2020 Toyota Corolla xse we
got the top trim with the fake leather
seat glad I got the PAP it's brand new
oh yeah they got look at this thank you
for coming in you know lonely take
sapphire far guys it was terrible
Vicky's keys are stole in the back these
are in the bag this is the legit brand
new car all right
so in the trunk I have a backpack and in
the backpack
I have some stuff that I purchased at
become a I shop that's at shop comma
Dada Y you can go buy everything that
I'm about to show off in this stream I
swear it's not an it's it's still an ad
if it's your own company and they don't
pay you know
although it's not as nicely packaged as
the one you'll buy we have some stuff
right here and beyond decorative this is
a common power they're $20 and they help
power your giraffe I thought there are
pandas don't know we have Hanna next is
enjoy app these are $60 you plug the
power into the giraffe the power looks a
whole lot like a panda it does look like
a panda but it says powered all I see
okay I can't move Han so this is
actually a pair to consist paintball I
see this is a giraffe so your power goes
in this giraffe all put your power in
that draft guys your panda goes in this
giraffe hole now you say like why don't
you do that at the factory and the
answer is we should it's gonna charge $1
right we have some mounts right here so
I can mount my e onto my windshield and
of course we have a comma a ie on right
here I'm afraid it might be dead
which would be terrible but I don't look
that right good so guys what are the
odds that it's just gonna work out of
the box love because this is a brand new
Toyota Corolla that's not even supported
yet you know the pilot we're gonna try
our best to make it work and now the
long part of the street starts let's see
how long it's gonna take you to get this
set up
alright so it's like that mount on there
like that
that's looking pretty good this thing
moved up
then let's take the trip off right here
this piece comes right off like that I
swear this is a brand new car guys this
piece they're saying you should have
khamenei I speedruns
[Music]
I look at that glove box no space no so
many manuals wait does that curl a
hybrid man you wanted buy a Corolla
hybrid all right so we're loading up
open pilot right here it's got to build
the latest stuff and so some of you guys
think you have to be really careful
about where you stick their young the
truth is you don't because all the
calibration is incredible and automatic
so it's not like China Center kind of
yeah that's utter no that's not so no no
they've done every Center with the car
it just has to be like oriented around
go do I have enough space to slide it
now that seems perfect I did it cost
he paid two thousand dollars he's quite
a good negotiator for the Corolla yeah
you can get these things super cheap
super cheap use that no negotiate it was
like mm like 240 whatever we like to
give them a little bit of a useful tip
so guys um first thing to do when you're
negotiating for cars ask to see the
invoice
and the invoice stick the car dealership
will tell you but this is what we paid
for the car man come on we can't sell
any food less than that then we don't
make money they do use what's called
hold back Toyota has a 2% hold back so
it's about 600 of the car so you want to
get a car about four hundred below
invoice essentially they just sold you
the car for $180 bra pretty much that's
pretty much what they made but like I
said we aren't the largest Richie in the
parking lot like chef guest parking and
shit all right
cool we have some okay so let me show
you guys how easy it is now to just
install this common equipment here I'm
just gonna take this wire don't unplug
it I'm gonna plug this wire into here
and then click that up into there and
then we're good all right we've got a
bunch of malfunctions but that's okay we
love malfunction Coast fair about to be
fixed as soon as we install open fire
all right so now my Panda has power
just gonna rouse this coma power down
here that goes into a convenient
we gotta get down there on this one
okay someone goes doesn't appreciate it
you never you don't drive it off a lock
[Laughter]
huh no no no this is crazy today I have
an obd and check if the 20/20 coral has
an obd2 port oh where it looks like it
should be some cars have them on the
console oh it's just detached that's it
- it's there wow it's ernie out well
that's kind of a scam this car is
falling apart it legitimately like the
over--he part was like popped out of its
thing
all right well so much for that
legendary Toyota build quality
alright let's just shove in this cup of
power right here
this alright we are comma power good to
go alright that's plugged in now we just
got to take our USB cable connect it
right here from this little panda
over around back here so inside the role
is our disposable car 31 all right
just from this in the front so we don't
get the table in the hammer all right
how do you know if it works we just have
to turn like some of these switches like
those two or something oh god there's
like four switches here and even though
I like design this product I don't know
which switch to flip but maybe we did it
right let's try uh-huh
no wait wait wait give the seconds go
build things
well now now it didn't work
should be good
here is the switch
switch
all the switches
just don't seem to matter at all
and not flashed her something
it says panda active no matter what I'm
an alter-ego alright well that's an SSH
into the ER guys so a common a I we are
trying our best to make this stuff as
convenient and user-friendly as possible
but some time of course we fall short
but that won't stop us from trying
let's wouldn't it be great if that was
all we had to do that would be amazing
yeah now we're gonna be here for another
30 minutes because we've gotta figure
out how they like SSH in and have a
fingerprint and bullshit right but don't
worry we'll call Comi and I support all
one who support how I you know what will
go on discord will log on to the comma a
discord will say hi I'm a new user and I
need help setting up no one's gonna help
you it's Sunday nobody will know what is
it what are the twitch chat people
saying
do they like this stream so far me
people got 233 holy shit that's a lot of
people we got to do a good job they all
they all keep saying Joe Rogan oh no I
told them no yeah you have a Joe Rogan
Army move little people I know Joe Rogan
wait why is this a payment oh now it
says nope and okay so well not
unplugging the pandan this is panda
active oh wow very respectful someone
said thank you for declining thank you
for declining yes of course you know the
kind of person I'm alright let's try
this this should go into cars started
I'm not sure why it isn't doing that
giraffe is properly seated
guys already broken
walk back MBA hey think something's
wrong with the software I'm certain
you've had this for five minutes
what do you wait so I sir I've never
seen this before this switch is what's
connecting so that switches what does
this started
this switch is something else George
someone said hurry up because it's 3
a.m. and he needs to go to sleep oh ok
ok you really got hurry up now man yo
he's got a sleep laptop that we always
keep in the car with us they're saying
it's gonna die before it leaves law
[Laughter]
laptop that we always carry with us and
we go in here to settings and then we
are guys like this is really live see
that's the difference between my twitch
gym and other people's twitch streams um
a lot of people like you know pre
rehearse what they're gonna do I
wouldn't do that we make it up as we go
along
alright turning hotspot on
or she keeps reminding you he's got a
sleep man Wow shit
right
so we're right here on the laptop we're
gonna connect to wheedle they're all
named wheedle have two Pokemon someone
keeps posting an X an excerpt from your
own a little violin thing about the
draftsmen oh yes make sure that your app
switches it's gonna go in a second one
oh I should turn to off I actually think
I don't want three on because I have a
comma power so we definitely want the
frc connected to the perfect that's good
goals when you're twitch streamers know
more about your products than you oh you
know they have the Internet so they're
cheating it's going to terminal here
zero zero zero zero open pilot no
resistor comma zero one zero one open
pilot resistor comma power oh wait a
second do we not have a resistor no but
that shouldn't affect whether the
started line works see what I'm confused
about is why this isn't even detecting
that the car was started it should
but that's confusing to me
all right well it's given an IP address
maybe we can show on the screen that
works at all alright so we're gonna give
you the IP address
we're gonna say um but you know there
really is our goal at comma to be much
better about this out of box experience
right now I can't connect to a host
phone network oh did you try that
someone said just just try saying I'm in
I mean yeah like like do you type
something and go on in and I think it
works
oh that's what we see your movies oh
that's a fair point yeah yeah I usually
say yeah yeah but you know the problem
of movies is they got like script ideas
and shit I know long ago guest
einat's perfect wait but how come I
can't connect to wheedle I was connected
to read only oh we don't write well you
just conveniently reboot your phone
right there um see guys one thing I
promise that we will never do Akane eye
is lie to you he broke the wheedle we're
not lying the wheedle broken have you
tried booting without obd connected
might be newer outies where obd
disconnects unless out ii can bridge
enabled director home we'll set that we
have our stuff properly installed for
some reason the panda just isn't
detecting a started signal
which is interesting
but as soon as we get into the wheedle
we'll be good you got any master balls
no dammit oh yeah they're they're back
at the office you know wait but this is
really what if this doesn't work did I
break this e on some now okay open
tethering settings
portable Wi-Fi hotspot' on
okay acting perfect it's now I can doing
my laptop we connect to the Nissan Wi-Fi
- oh it really isn't talking to the
Panda because I see the pandas pandas
Wi-Fi here and open pilots should
automatically disable that if it was
working so we don't actually run in
public open pilot we run a special
internal version of a pod and there's a
chance that's also what's causing the
problem
if somebody in CI is something somebody
broke if somebody broke commas build you
have engineers that are known for
occasionally breaking builds a lot
better about that we started really
using like CI and stuff I don't
understand why I can't even ping it oh
this isn't the right IPA no no that's
the internal IP what's the public IP
avidians
does anyone know I'm sure they can look
that up anyone know the public IP of an
yacht someone said check your Trello
check my Trello
a trowel oh this is like like shit it's
supposed to like someone said one 19000
I think yeah no no I think I got it
it's one into one six eight dot
twenty-three dot one okay so now let's
SSH in on four uh-huh
okay now I'm getting permission denied
for the key you know
all right so we're just gonna have to oh
you want to turn your hotspot on yeah
yeah so if I can get data you got rekt
me on no no no none that I need to
download like 2k of stuff
my server
I can't connect to their guests in her
top tiles the passwords right there we
won't show to be twitchy's
perfect alright we're on the internet so
let's go here let's just SSH into my
computer back at home
no mine ssh over hot spots oh yeah that
was happening to me at sometimes hot
spots
get fucked oh shit I don't even know how
to get the
all right we'll just make sure SSH is
enabled the problem is I don't think our
reruns use the public key or maybe they
do let's say wait so now I can't even
get on the Internet
got a github calm
connected sure
works
maybe DNS
oh well
oh we could go drives that Starbucks
right there oh you wanna drive that
Starbucks
yeah well another sporting spot up there
would actually just go to the Starbucks
download the key and then come back here
I think you can park afar the Starbucks
and just download the key we can try not
to write there yeah let's go 85 guys
what if we fail we really might okay
let's go to the Starbucks
it's the dealership Starbucks this is
the largest car dealership in the world
they have a subway and a Starbucks and
they are very proud of their stuff look
subway at Starbucks the sales man
compared it to their own tiny small town
there's their tiny small town they're
very excited about all the obvious it's
just not connecting to the Panda person
this might be an easier problem than we
think I might just be able to take the
Panda
you know what I have in my backpack walk
I have a USBC to a converter and I can
flash the Panda right here for my
convenient computer maybe that's the
problem maybe the problem is just in
panda flashing there so I have a park
over here I don't think every used car
by the Starbucks they're gonna try to
sell my Corolla they're gonna try to buy
now they're gonna try to buy irinka
trade it in all I think you can work
here yeah they're gonna think you're
like a terrorist or something about
young kids sitting in his car outside
with the other cyber terror that's a bit
of a stretch so we are conveniently
parked outside the Starbucks let's see
if we can get Wi-Fi
oh well long ago guest:i networks here
yeah real Starbucks guys we weren't
lying absolutely Starbucks no we should
have probably tested to see if we could
you know connect to the oh but I like
back when we were at the house like
gigabit internet yeah yeah very
reasonable oh shit well now it's just
because I have a I have an IP address
let's just switch this convenient thing
back to you with DHCP cuz this is real
shit though
and that's why hopefully you appreciate
my streams I would never lie to you all
I was going to Safari let's see if we
can get on get up you are not connected
to the Internet you are not connected to
the unit
why am I not welcome github doesn't work
from your tether whoa there's a chance
we can tether to her we dolphin that'll
work now that I fixed the IP address
issue and a nun crashed okay we're in we
let see everything
around the host
work I actually don't have to get to my
computer if I can just get to github
we're good
Oh get up work sorry perfect
so let's just go in here to our secret
repository yeah maybe we maybe we don't
show mr. down you get to see the Aeon
you get to see the Aeon art so let's see
um so I just download this key oh wow
that's actually the private key yeah I
don't I
we have a key hey let's just try this
kid SSH - nai drsa we control the screen
again alright let's connect to wheedle
estate CID RSA or 80 22 and now we're
gonna do well we don't even need to be
parked here we can go back to where you
are yeah let's go buy Starbucks five
star marks a d'Artagnan and add I'll be
back for my free coffee well actually
let's see if we can SSH in first hey
blend in perfect kid they're gonna take
a customer here and be like look at the
beautiful car we got for sale well they
are lockboxes on all the other ones just
have the keys in them so if you guys
want to steal a lot of Corollas don't
say that file too short what
- pile to shore oh I see they're faster
because you don't use the capital I use
the lowercase
bad permission that's fine so I can just
chamalla at 600 600 IDR I said come on
Connect connect connect oh yeah we're
connected to the Aeon guys but we are
now connected to a neon and it's waiting
for DFU that's why the pandas fought so
let's just um fuck the Panda me a second
yeah say somewhere according to George
quote George Hobbes advocates for
stealing cars some tech magazine great
flashing guys some hackers shit alright
let's try it again this we're in last
alright alright it's goin opening panda
no wait why does it have an old version
huh make her copper boys be not in not
in we're not in voice they all got
really excited cover all right don't
worry I'm making recover I can't it's a
friend oh shit I didn't bring a pause so
if I fuck this up that's it
oh if you break it you're fog if I break
it I'm fucked a cop t fu you birthday oh
no the new knee OS doesn't have d fu
util oh oh god C it is because we have
weird eons
okay wait I'm can I access the internet
from the C on I can't we just have to
download DF your you tell from the old
me OS okay so DF your util is a tool
that talks raw mode to the processor the
problem is we updated me OS internally
which is the internal build of the neo
operating system which actually this bug
doesn't affect anybody else in the world
just us internally the question is
everyone's everyone's doing that
emoticon with two hands on their head
the question is where the hell am I
going to get a DF you util under short
notice are we
um they're disappoint yeah yeah yeah
okay so if somebody could extract from
the OS the da-fu util that has a
reasonable we do it live guys we do it
live all right
no actually I know where it is I know
where it is we can download it quickly I
have the perfect place for it just I
need your hot spot again it's still up
no I turned off no it isn't it is it
isn't really your internet it never
turns off no it does even no one's
connected you bro
still fucking on stays on toggle your
Wi-Fi the problem is when you buy a new
panda this bug is also gonna be fixed
with the July first hardware the problem
is moving buy a new panda the I know
exactly where the file is on github we
just have to get it so give up that
comms I not be sure I'm get our back on
size coming Isis user this is all public
so we have to go in we have to find DFU
you tell and then maybe
in DFU okay we just got to searching
this repo for DFU you tell I think it
has to be in here so that's been maybe
no local someone said just do got cloned
EFT util got clone got close yeah make
sure there's got it
I found okay so wait let me just copy
this download link so we can actually
download it right here on the eon but
actually we're not connected to the eon
anymore so let's download it on my
computer to make double sure okay we
have DF you you tell on my computer
let's go over to we'd all oh yeah
fuck that we tool up yeah and we can't
see the problem is we can't connect to
both all right so we're back connected
to the phone now let's just go in and
we're gonna curl that you are being
redirected what is curl to follow
redirects alt and then we'll say o DF
Naruto what it couldn't write the file
right
um all right we're downloading could not
resolve host DFU Utah is that not what o
is for or we have a faculty of Utah
let's run it
oh yeah right we got to give you you
tell all right now I just need to mount
actually a system already mounted they
go to system bin can I touch something
here right now - Oh remount RW system MV
1 DF you you tell here mount - OH ro
system me recover all right fingers
crossed guys cuz if I fuck this up we're
just done no I didn't fuck it off I
don't know why that's failing well cuz
the pandas in that mode
pottery was true
she's not entering bootlegger let's just
power cycle the Panda
you know we can do we can just turn the
car off and unplug that and then we plug
that back in let you power the pan to
back up did
make torque up
okay good good good win-win-win look at
that shit we're downloading
this is some real hacker shit guys oh
fuck yeah all right mainframe breached
mainframe priests right so now let's
just restart manager right here oh my
god and we already did the SS aging so
the fingerprinting is gonna be easy
we're gonna be up on the road in 15
minutes if everything else works real
life hacker shit this is real life
hacker shit guys cuz you mic our next
manager cool so it's booting yeah don't
call yeah Mel dot load guys it's booting
up Oh
so restarting everything now I'm the EON
who wants to take bets on if he bricks
it I'll take a line on that I'll give
odds wait all right so I think we're
connected now okay let's just try Pat
booting the car and now it should
hopefully if I didn't fuck anything else
up go to started mode Oh guys did you
fuck the we don't know okay okay yeah
notice how we're in dashcam mode with
unsupported car right now yeah this is
actually okay we're just gonna need to
add a fingerprint which is gonna be less
annoying and I hope calibration process
yeah yeah it's got a calibrated but
so there's a tool in self-drive debug
called get fingerprint let's just get
the fingerprint for the car I think this
works alright perfect this is the
fingerprint this easel this is the
fingerprint of the Corolla ecstasy it's
public knowledge you got alright because
we're gonna add it we're gonna push it
right now alright so now we just got to
go into one self-drive where the
fingerprints go in like saw your cables
probably part of your family that's
right oh yeah we will fix that in a
minute
get grap fingerprints where are the
fingerprints oh it's in let's just go in
here to car Toyota values yeah yeah here
they are alright so we have a Corolla
we're just gonna mm see okay the only
one we actually support here is the O
rav4 2019 I say you know what for now
let's just hack it and add it to the
Corolla hatch the same car we actually
don't support the 2020 coral which is
copy and paste this fingerprint into
this convenient Python file here
now let's restart manager and hopefully
we're not going to get any more dashcam
bullshit in before we get some more
dashcam bullshit if we get more - damn
bullshit we'll fix it because we're
genius hackers ok starting manager these
guys saw this last time don't break it
I'm not gonna break it don't work no
Paul no Panda Paul no we have no Paul
vez no no we're past where we could
break it
okay guys successfully reflashed if we
had unplugged it not like a split second
there's a chance we would have break
down now that would have been
devastating okay good
we rebooted we're connected to the Panda
everything looks good can't see ya know
I can't ever get we go good let's go no
dashcam oh it works out are you gonna
kill me no stack em up why is it in
dashcam
Oh
it shouldn't be in - camera let's just
look at the code and see what's
happening by the way you're running chat
story is that you you stole a car from
Toyota you're trying to hack a flaw
perfect now let's get advice to run that
a hat should have that where is - down
mode and when do we go into us when do
we choose - but notice how it doesn't
say anymore that it's uh this is
probably just because we have weird
internal controls live alerts so I'm
just looking reducing the screen this is
pretty good this is useful it's a wind -
come out so this is when it's throwing
an alert of startup no control so that's
happening here
startup no control and not controller
available why is there no controller
available maybe there's some other thing
and not understanding get startup alert
so this is a new stuff that's going to
be in a pilot pretty soon control
ah CP an able camera and not passive so
what's enable camera oh I think it's
just in I have the switches in a wrong
orientation
I think that you just might have to flip
a switch
I think think that that that that thing
was wrong all the twitches wrong
I think the twitches were wrong damn it
twitches no let's uh you want shit your
dirty screen really triggered a lot of
people by the way what thirty scran yoga
laptop oh I'm terribly sorry
um wait I think it's the switches I
think maybe would try switch to and not
switch one or something
maybe that'll work they said if we were
wrong that means you were wrong so they
copied it from the first oh wait I think
we're good I think we're good
yeah don't trust any of the posts guys
guys don't trust any of the post cuz
it's wrong it was wrong the post lied oh
yeah everyone's seatbelts on
I let's go are you ready to take over at
any time I always keep hands on the
wheel alright alright I'm gonna have to
calibrate it we chose down for it dog
let's get on the highway and go open
pile-driving hi this is a completely
untested car nobody has ever driven a
2020 Corolla before but we just did some
extreme hacking why Packer man yes you
can drives it off look out it's a hacker
man you back my cars here ya know just
we're just gonna go for a quick spin on
the highway and confirm that we're using
the greatest self-driving system
available for a Toyota Corolla this is a
brand new Corolla how long did that take
us how long from its dreaming flat yeah
I don't know how long and how long that
took oh wait do I have to show my
license yeah I don't think so you bought
the car walk the car that's right yeah
no just drive let's go oh this guy
bought a new car too but he doesn't know
how to drive he's gonna like take
forever to second 40 minutes 37 minutes
38 minutes 38 minutes so that's how long
it takes to set up a new open pilot
all right we just gotta wait for the
calibration to finish up here it's
pretty fast it's got to drive above 60
miles an hour if you guys saw that movie
speed it's just like that oh the movie
with the flaming boss yeah yeah it's
just like that yeah yeah yeah I feel
bright like I'm on the flaming bus right
now
all right this is a brand new Corolla we
just installed I'll compile it in it we
finally I hopefully got the switches in
the right orientation I'm happy we
didn't start hacking the code to fix
that that was incredible - cam oh I wish
it actually told you that your switches
were in the wrong orientation I mean
that would be nice but like you know you
can't expect a lot this is beta software
always beta software oh I can't engage
because my calibrations not done we have
to finish the calibration first
oh yeah we're only at 30 right 30 so
this is right now for sale on shop
account a TI for $5.99 and you can buy
one always plug always plug yeah always
all right so we're going at a decent
speed here for calibrating thing I think
we got away yeah they're still driving
this is the same route the guy took us
on right how do I get to that highway to
go oh it's down here on the right yeah
you turn to the KFC car ready oh your
stream cut out or something and just got
back at what uh oh they're good oh
that's a good point we're we're like
streaming
60 62 64 66 let's get in there yes yes
the car was legitimately purchased there
was an invoice to prove I know he's not
a law requires wasn't a joke
he was driving this car back to San
Diego in an hour it's got a p.m. days
gotta be there Oh
cable in front of the camera oh fuck all
right moment of truth
okay there you go let's give it a shot
radar crews active cruise control
malfunction visit your dealer get fogged
yeah oh yeah it just gives me a
concussion
dude good lord now it's fine nothing's
as rough as a Ferrari that is true
right sure all oh shit what fun ways
call this out man we swapped cars which
is which is chella near the wheel is
really show the wheel look at that
2020 Corolla aunty 20 Corolla only 2011
52 minutes 52 minutes to set up a new
product that changes your iPad do a
quick spin on the highway and then drop
this guy back off at the dealership I'm
then you're going to San Diego to San
Diego and I'm not Streamwood I'm not
bringing you twitches with me I'm sorry
this is wait it lost it
no yeah freeway right here how about the
torque house pretty good how many people
we got good 99 oh wait we lost hundreds
of people yeah they'll come back
hundreds of people think I died yeah
thank you other people think you
probably died guys this is so little in
your life can be the difference between
a complete success and a total failure
and now hundreds of people will go away
and think of me as a total failure and I
will never be able to recapture that
audience
yeah famous last words what was it
dealer it what auto lane keep assist
malfunction
a good thing we got the sport mode maybe
that works right yeah good thing you pay
for that 430 horsepower pay for the
extra 30 horsepower guys we did that
live that could have gone so much worse
you know see
oh don't worry someone said they thought
you were a failure before tonight well
you're probably right all right we were
on a beautiful Los Angeles I don't even
see any of you can't see anything to the
ER not see or you mean them no me yeah
let's just get over to this lead right
here we're gonna just press this button
- let's see how it works cool guys
the flame arts or shit
no hands no hands speed up a little bit
I heard there was a song about that look
ma no hands I mean that one I can drive
my car with no they say can you please
turn back so you don't stare okay I
won't point it at the Sun then you can't
see it your mom it's still coming oh
there we go such about
these lanes are pretty crap
someone said what the fuck happened - no
comment hey I on twitch this is the one
day we broke that rule guys we broke
that rule for the love of a brand-new
Toyota Corolla normally there's no
comments what you know what that's a
good rule and we're gonna leave the
stream right there my my twenties bite
which is how I ended Oh bite to it
cheese Oh how's the Instagram dream he's
gonna be there soon bastard
yes here
Hansol phone
et of yours
so the lateral needs a little bit of
tuning you can see it's ping-pong a tiny
bit in the lane that's because the 2020
Corolla is an unsupported car and we
just added support for today in the
other live stream which was pretty
insane
the problem with leaving you at that
other stream it gives you the impression
that open pilot is like mostly getting
into work
but that's not true it's mostly chilling
while you drive
I don't know we see and this is another
thing to thank you thank you and this is
another thing to like Arnott which
dreams about kama AI they're not they're
not like the periscopes when I was on
the periscopes you know I would like to
talk about self-driving car companies
the twitch tombs are about my life and
driving back from San Diego with old
pilot was kind of just a part of my life
in here we are
I don't know why we only have Turkey
viewers are where the viewers would
because the streams crappy something
drive back Sandiego
it's because I'm an crap you know that's
useful
this is the appropriate ending for the
video
the appropriate ending for the video is
just watching open pilot drive down the
road
it's my legit drive back to San Diego I
have a date at 8 p.m. tonight just
barely gonna make it
Oh what it took to get it working was
literally just turning the car off and
on again the problem is it's because I
didn't turn the car fully off when we
were sitting there I had the air
conditioner running because we were
sitting in the car and it was cold
I wanted to be called so I didn't turn
the car fully off after I reset it so I
just turned it off going again
you saw the hard stuff
you know real dog is one time I was in I
was in Korea and I was giving a talk and
this was probably the precursor to live
streams and I was at like a Korean
Spotify and I hacked their DRM onstage
in front of them but I didn't get the
last part done
I got the last part done 20 minutes
later when I was on the train it was
kind of devastating because I could have
kept going and I would have had it done
all right 28 minutes but here we are
we're cruising I show you both hands but
the other ones holding the phone they
bring a mount
so always keep your eyes on the road
when you're using any one of these
systems their level two
as long as you keep your eyes on the
rain pretty king
I don't know
I'm old guys mamas 30
take road trips across the country was
great time to reflect
Oh Oh the faster
[Music]
yeah shoutouts to come AI archive when
you're uploading this now stitch the
three parts together
this is an appropriate last 10 minutes
now how about we don't talk about that
many I because we have to talk about
coming out because it is part of my life
and that's the struggle right
everyone's brand these days
it's joke
yeah it's an actuator I bought it today
at the dealership we hacked it in the
dealership parking lot
we're just gonna cruise we'll leave the
stream on on the view of perception
all the software that you see here is
open-source
github.com / compromise / open pilot
you know check it out
a little hard just need to connect a few
bar top
the physical installation took five
minutes the bug in the software that's
not in the publicly released version
took 20 and then adding the fingerprint
took another 10 and then realizing I had
to reboot the car to 10
Travel and outdoors traveling I thought
it was an appropriate category No
so yeah you can see that my eyes are and
on you guys have a second they might
make mistakes I think we're going about
20 minutes now without mistake hope they
do make mistakes they're very small
minor mistakes
make driving shelf
excess thank you I hope you are healthy
and wealthy as well
unless you made your wealth by taking it
from others
and then in which case I hope you go
broke I'm sure you're not that kind of
guy
it's very similar so this car right now
isn't tuned to the best so it's a little
it's a bit underperforming autopilot you
see this little bit of ping pong in the
lanes but this is a brand new car we
bought it today so this is just the out
of the box with a new unsupported car
after we tuned it and we're gonna spend
a week tuning it it's gonna be it's on
par with autopilot it's kind of
different
um autopilot is a little more almost
aggressive and how they like market
things and want to do things
big targets
and we used to have a six minute timeout
so it used to be every six minutes you
needed to touch the wheel but now if you
see this little icon here the little
icon in the lower left corner that means
that open pilot is watching me and
making sure they're not keeping my eyes
on the road as long as you are you can
cruise forever
I don't want babies scare me
No
you know who stops to think about things
that they did bitches and work and do
anything else always be thinking about
what you're gonna do next
always thinking about how you're gonna
be better even as I decline into my 30s
and you really think people decline in
their 30s actually made in the 40s and
I'm 30
I don't know we can look at my face
we're gonna look at the wheel we can
look at the Aeon I kind of got three
shots
I'll get eclis try to read your chats
this is the real open pilot experience
Gus you set it up it's frantic it's
exciting
and then
there's a song
I like
and one of the lines so we just drive
wide eye and full of spots I like
traffic driving high I've driven across
the country alone a bunch of times gives
you time to reflect
world but not unlike what you've done
right like that's kind of off
don't you ever start thinking about like
old what I did was so great like what
I'm gonna do is so great you know
I've been able to auto lane change now I
mean so auto lane change the problem
with auto lane change is
and I just I just lost the chat see if I
can get it back show chat the chat with
auto lane change
is this car can probably do it actually
combined with I wouldn't want to add an
auto lane change until the car could
automatically make sure the lane change
was safe and right now we don't have all
the hardware required to do that but
it's really easy to do I don't know I
could do a lane change guys but I
haven't touched the wheel in 30 minutes
I don't really want to
just chill it changes our chill
hey baby that's the difference you don't
pollen autopilot you know in a way like
autopilot it's like look at this cool
gimmicky technology and I mean yeah sure
if you're Tesla and you're trying to
like sell cars that meeting quota Wow my
insulting test lawn here I don't need to
do that I don't mean to do that I have
nothing but love it's a different
product because
they they're pushing like navigator
autopilot and they're talking about full
self-driving what I'm talking about is
to take the driving experience of
millions of say Americans and make it
just more chill make it more relaxing
you don't have to adjust the car
thousands of times per minute I think as
I got an average the driver does like to
actions of seconds 1:28 p.m. or I don't
know how often you turn it maybe it's
less than that but still it's certainly
multiple times a minute
it's uh needed work and stress
yeah the rule for a violin is if it
doesn't make driving more chill it
doesn't go in 120 APM
at 70 here
this is the new model now this is to
Paris Kofi this is to periscoping we're
not we're not talking about that it's
the white female month tomorrow mild and
well model coming
cars gonna cut in here we're going to
slow down a tiny bit
fine
I always kind of wall you know
tiny bit of pink on that wheel
what will save VR I don't know
if you ask me if you can ask a question
the answer is gone if you just ask the
question I'll read it and decide whether
I've entertained by it or not
but yeah right now if you're on
if you ever support a car and you're on
highway like this you don't need to do
anything anymore except pay attention
most of the time
maybe once an hour you have to do
something
so if we stream for now I'm sure you'll
see me have to take one like corrective
action
we usually chill things Cotton's are
calming
really poorly painted thing lines
[Music]
thank you ma'am
this cars got a moonroof let's place me
this is a sunroof
he's bigger
[Music]
smile
we're us as we travel away to some
basement we do it for the sentiments it
started with a self asserted promise
I will be okay everything
muumuus has solid cloth cover know when
I'm answering questions about combi I
guys this is just my life that's the
difference
periscope was about comedy I and we
don't do that anymore comedy was a real
company me as George Hotz
there's not really a wedge rather be
coming back from LA right now
I wish the tuning was a little bit
better effects like this week
you know you guys like yeah I don't know
we don't either talk on the way down
here about what's genuine and what's not
being genuine is really important to me
but not signalling that I'm genuine
right because if those two things are
different
if being genuine is signalling that you
are genuine that this is phenomenon in
society day of like truthiness things
that feel true but aren't that or
sometime they feel more true than the
truth and this is a problem if I'm ever
not genuine I don't do it for you I do
it for me
people say that on these two extremes to
like you know if you put time and effort
into planning his content it would be so
much better maybe but I don't do it for
you I do it for me
but I do it for me for you do you see
what I mean
like em I was trying to optimize if
there was a way that I decided like I'm
not gonna be myself I'm not gonna be
myself because that would increase view
numbers that's worthless to me because
the moment you've given that up the
moment you've given up actually being
yourself and not having people believe
that you are yourself you're a worthless
piece of shit until of course you know
and like like it's not saying if you
ever did this right like everyone's been
in the scenario where they were
uncomfortable and act in a way that
wasn't like that but there are people I
see who do this all the time why be
whoever you are
and accepting you don't know why I mean
you gotta find who you are but yeah too
long of a rant it sounds like a song
from frozen right what's that what's
that oh no it's from Book of Mormon are
you and me but mostly ever since I was a
child I tried to be the best so what
happened my family and friends all said
I was blessed so what happens it was
supposed to be all so exciting to be
teaching of Christ cross the sea but I
allowed my faith to be shaken oh what's
the matter with me I always longed to
help the needy to do the things I never
dared that was the chance for me to step
up so then why was I so scared a warlord
who shoots people in the face what's so
scary about that I must trust that my
Lord is mightier and always has my back
all right
should we do the course
who knows the song guys it's a great
play by the way if you haven't seen
Book of Mormon I've been watching plays
on YouTube lately but I would be happy
to pay someone money for that content if
they made that good but I'm not gonna
like fly somewhere like I watch like
what do i watch i watch the if then I'd
be a Manzo I'm nobody's her it was her
understudy was Jackie who was the girl
death I started to watch next to normal
but I got bored
[Music]
so we got some you see with zip and by
these cars on the left here so you gotta
we've got to pay extra attention
that's doing fine far away or Apple just
what do what do you think I'm American
you know I love China but I'm an
American
and apples a good company I bought a
home pod recently I'm just thinking
because I think nice to get about like
how an Apple did USBC and how that's a
lot of that is largely thanks to Apple
Apple pioneered removing floppy drives
or moving cd-rom drives and they have
enough almost authority in the industry
to doing it when Apple comes out with
something it's good I respect them I
respect their business model god I said
the same thing years ago about Google
now but you gotta just look at the
business model if the business model is
not consumer aligned it doesn't matter
how a line do you think the founders
might be like it doesn't matter how cool
you think Larry and Sergey are and how
they want to do good things for the
world
if their business model is is that just
showing the wheel well I don't know
Highway Patrol
we've got another I've got another 50
minutes drive
what about hype around interfacing with
the brain
you know is there hype around that now
you want to learn Kali Linux Oh kitty
hawk the little flying thingies is that
what these are I mean that's what the
periscopes used to be just Shutt talking
companies I don't know I wish everybody
the best except for the people who get
up every day and make the world worse
and I wish that they would you know die
no I mean okay you know the people who
genuinely get up and are like you know
what we are gonna get this new
regulation passed that is going to make
filling out tax forms for Americans
three times more complicated but at the
same time we're gonna sell them our
software they're evil like if you're
making people's lives worse you're evil
if you're like like like like I'm going
to create a problem for you and then
provide the solution like the model of
crack dealers you know I'm gonna provide
the problem for you which is crack
addiction but I'm gonna provide the
solution which is crack oh yeah look at
how smoothly it deals with those
transitions oh we're losing the lanes
here all right good job open pilot good
job good yawn I pet the EON but
phone
we'll cut in right there did it right if
you take the hob Lane
you take a half
I can't really read chat cuz I don't
have a mountain fortunately I'll hold it
here chat some tiny Thanks TurboTax
right
any good Callie or I don't know all
right guys no say I wanted to show a
genuine experience of what open pilot is
like not just the set of experience
so hopefully this gets tacked onto the
end of the video comment AI archive
hello hello hello we haven't done one of
these in a while fixing up fly bugs you
know not UI bugs but you I do UI not
happy to talk about all that um yeah
maybe you are 10x faster hello hello
we're really here to talk today about
hiring but we're gonna throw in a few
zooks 'as i know you guys want to want
to talk about that I know that's what
people are interested in I'm just gonna
go through we're gonna go through
Twitter and we're gonna see what people
are saying
Burton County welcome the Mahindra ass
will be supported as soon as somebody
wants to pay us 250 grand to port it or
somebody else look we're not gonna trash
talk is OU's I mean look if you're an
investor and tzuke's you got your money
back if you're a founder of tzuke's
you negotiated a payday for yourself if
you're an employer is excite you didn't
get shit but AM cares about the
employees anyway that's that's um we'll
see we'll see what happens uh I don't
know why I was on bottom
there that much I think yeah
damn you know Bezos wants what the view
on right OK ROCK accompany yourself
driving company you know and put it this
way if you're going to the space station
do you want a ride on a SpaceX Blue
Origin
no no nothing hey don't base us look you
know except for the 40 billion he lost
in the divorce he's great but let's see
let's just see what the Twitter staying
about Zuke's and we can't even go
through and I know I know that's what
you guys want to talk about so amazon
acquires self-driving startup dukes for
over 1.2 billion
so they raised nine hundred ninety
million so it is a little bit more than
they raised but my understanding is some
of the later investors had multiples on
their investment which means they're
guaranteed a payout you know if we go
back to two comma a eyes medium you guys
can see this is what this is what I said
in October um so you know it's not it's
not quite as bad as we will have it the
easiest when they're shut down the
employees there will be reabsorbed into
Google Cruz will be in the middle when
they're shut down the employees there
will attempt to be absorbed into GM &
Zuke's let's just say I'm glad I don't
work there right if you're tzuke's
employee you're now an Amazon employee
working at Amazon all right all right
all right so three points X oh my god
the car manufacturers locking me out the
car manufacturers locking me out look do
I even have to talk about this again can
you guys in the comments say what I'm
gonna say to that person who'll always
ask this question oh no oh no Toyota's
gonna lock me out Honda's gonna lock me
out um sug means never having to say
you're sorry yeah all right um so yeah I
mean you're you're you're now a you know
an Amazon employee you know what not as
bad not as bad as Drive that AI but uh I
mean it really comes down to no I wasn't
pissed when I saw zoogs got it quiet
about that it's not it's not that
surprising right and I've always said
it's not that Zuke's has nothing it's
that the whole idea doesn't make sense
our girl I think has now thank you
oh you know I gave I gave tzuke's props
those videos when they came out you know
they started to explain it like like
engineers is zooks worth a billion
dollars well they put nine hundred
ninety million into it so a one extra
turn a one exit so when you look at a DC
return multiple high start it's like a
classic 101 X 2 X less than max let's
see if I can
don't know how to find it
VC returned mostly though we're here to
talk about hiring for come AI easier
time I don't know you know what to be
honest hating on hating on the good good
for Zuke's I hope everyone there got got
the outcome they wanted I mean if I woke
up and I was an Amazon employee know
there's worse things there's definitely
worse things percent of investments by
VC return there's like a chart
percentage of investments by
I saw a really good pie chart that
explained that we just got it we're just
out here what yeah perfect VC fund
return on investment right
so 50% of the company's return less than
one xDrive that AI is here
zooks is here and then these five
percent of the companies that that the
VCS are super happy they invest in it
these are these are they these are the
big-name tech companies and these really
heavy seas make all of their money so
yeah
1.2 billion well let's see we can find
stuff about that deal so it's possible
that like so zukes raised basically they
raised a 790 million in their earlier
rounds they were trying to raise a 700
million dollar round they only raised
200 of those 700 million in convertible
notes so let's see if we can find
something I think oh there was a word
no there's nothing if I search resume to
be see multiple
9:55
what ratchet is what
yeah due to ratchets on later rounds
I've never heard this before but yeah
the company raised 1 billion in equity
and convertible debt investors are
basically gonna make their money back
and some will make a positive return ah
while the pre-money valuation was 2.7
billion in 2008 those investors know I
mean look it's oh it's a large
acquisition right do I personally care
about Dukes you know they've just been
with the story for a long time so it's
nice to see the story arc of tzuke's is
a story arc that we've been following so
it's good to bring nice closure to
everybody what's our plan for qtt with
us I just I just made this nice change
to UI which helps improve the
interaction between UI dot C and model
dot C but mostly what we're here to talk
about today is hiring for filming yeah
unless there are there any last
questions you can see there was some
interesting research coming on Twitter I
searched this morning and I saw some
interesting stuff uh yeah you know myth
Tesla leads autonomy right like some
totally fake shit oh yeah why doesn't
count
AI on there and you wonder would have
expected us to become a I um coming I
could do mostly what Tesla so I could do
on a smartphone
two cameras zookas team was highly
regarded as crashing well what do I
think of this deal how about this
they're a real thing to think about this
deal is Bezos lost 40 billion in a
divorce no concern for comma the concern
for comma here's here's what I would be
concerned if I was comma if tomorrow the
auto OEMs fired all their CEOs and put
in software people that would be like oh
well comma was good while it lasted
the good news is that's never gonna
happen actually another another bit of
news which is kind of interesting so if
you guys heard me rip on Nvidia in the
in the third or Tesla podcast
so this this story came out
mercedes-benz an Nvidia partner to bring
software-defined vehicles to market in
so Nvidia's chips are extremely
overpriced they're trying to get like
$500 to put their stuff in the car
mobilize about $50 , in huge quantities
is about $50 as well Nvidia is 500 so
what cars can support actual $500 costs
for an add-on well the Mercedes s-class
all right and that's the car that is
going to come to in 2024 not that set
rim a quiere Mac is also how much is a
rim at car does their Mac actually sell
cars it's it's hard to keep in my head
which one of these are scams in which
one of them are not scams just from
Excel design innovation oh yeah that
type of car do they how many cars have
they sold it starts at like Rimac lucid
Faraday future
Vivian some of them are scams some of
them are good what's that of the one
that has like five cars and their lineup
but hasn't actually shipped any cars yet
I rode in the Faraday future wasn't that
once in a scam they had one car they
showed it to me I sat on it we did a
launch hardware I seemed pretty nice the
software and I saw there's a little
thing on the window it's like a window
is little LCD screen nickel and nickel
is the one that like oh we announced
five cars but um are you planning on
expanding my product fleet want you buy
a comic too bro yeah the new medium
poster coming from our head of research
our head of alpha pilot and our new CEO
yeah yeah yeah so did you see anything
okay
um where else what else did I want to
talk about I said I wanted to talk about
something else oh oh this is kind of
interesting too today my software update
the model 3 also asked to start
recording on the interior camera alright
alright Tesla
we'll see we'll see when you I've always
bet the Tesla's gonna come out with
driver monitoring before they have fsd I
will see if that is true or not but if
anyone like to bet me ten thousand
dollars on that I'm down to take that
back before Tesla has FSD when they say
you cannot pay attention during their
commute Tesla will add camera based
driver monitoring penny would like to
bet ten grand on that roundabout ten
grand oh yeah this so um I'm gonna call
right now that there's a 50% chance that
this car ends up running open toilet now
you say George um how is this car gonna
end up running open pilot have you been
in talks with Mercedes and NVIDIA and
the answer to that is of course not but
what's gonna happen as they approach
this date the software is not gonna be
done it's not gonna have millions of
miles of real Road testing Mercedes is
gonna take it out they're gonna complain
to Nvidia about you know all those
normal mats the neural nets you know um
so what's gonna end up happening is
they're not really gonna have a choice
they're gonna have someone in the team
2020 probably even 2022 is gonna have is
gonna have a comma device in their car
I'm gonna be like you know this cold
open-source so we could probably get it
to run um and they will and the rest
will be history so that's I gave it a
50% chance that this Mercedes actually
ends up running you're not running up in
Thailand Europe is important tell me
more about this common needs Europe to
succeed tell me what do you mean what do
I not do for Europe yeah we don't I
don't need shit right what do I need to
succeed software engineers that's what I
need do we hire people from yeah
absolutely
um if we can the visa situation is a
little difficult right now but um yeah
we have a whole bunch of people from
Europe who came here now yeah I mean
that's a separate thing right do we hire
European software engineers absolutely
absolutely brilliant software engineers
in Europe do I somehow need to go to the
European market in order to succeed no I
have more data than I know what to do
with right now all we need right now is
software engineers and that brings me to
the main point of this post we're
getting very serious about hiring you
know we're happy to sponsor h-1b once
h-1bs are back to normal
h-1b J 101 if you I mean we've sponsored
on ones before as well
I've happen to be Sivan sir chef hold
also if you're in Europe and you're
interested in working for comma we have
an interesting announcement coming in a
bit but so the uncontained triangle of
success at comma our mission is to solve
self-driving cars while delivering
shippable intermediaries everything we
do is derive from that mission and as
the narrative unfolds it looks
increasingly like we will win alongside
Tesla and Mobil I um so like just talk
about how different that is from from
another company's post what guarantee
does someone have if they move across
the country or a world that you won't
fire them for no reason no one gets
fired for no reason if you're adding if
you're brilliant and adding tons of
value to kamo why would I fire you it
makes no sense if you're slacking and
causing trouble and requiring a lot of
management then yeah of course I'll fire
you
so what guarantee you have no guarantee
and if you're the kind of person who
needs guarantees
I don't think commas for you if you're
the kind of person is willing to comment
should never fire people
oh it's terrible but you know you got to
do it right because otherwise you'll end
up like Google with a lot of bad people
where all the good people left right um
yeah no I look one of the biggest things
for me if I'm thinking about how to you
know I'm thinking about a company I want
to look for I want to work for a company
full of great people right well you know
you can do a lot in the pre-screen but
you got to make sure the bar stays
really high not just for who you hire
but also for you keep around
I really don't recommend starting your
company oh you're the guy who borrowed
the part of the vote from it's come
pretty well it's come pretty well if
you'll see actually on your on your obd2
harness there was a little mistake and
how the voltage regulator was put on so
there's a bunch of bond wires and glue
that's gonna be fixed in all the
production ones , shouldn't fire people
and should give their product away for
free yes absolutely absolutely power to
the people workers of the world you know
alright um back in reality ah so we have
three teams we have the open Paulo team
the research team and the operations
team the open pallet team in builds and
maintains you open piles software the
research team builds the models the
operations team makes the product money
the website and the app so we can go
through a few of the jobs we're hiring
for you do not need to know anything in
particular about self-driving cars in
order to work here so if you think oh I
don't know about self-driving cars how
could I work here that doesn't matter we
don't care basically the two things we
really look for or be smart and be
motivated also know how to program
be smart be motivated and know how to
program competitors if you've done
competitions math competitions science
fairs competitive programming CTFs we're
interested that's a great thing to have
on your resume contributed to open
source projects have a great github easy
if you don't you know you should get
help with with stars on it and get up
that shows that you shouldn't you write
a lot of code right how do you get good
at writing code you write a lot of code
and then people who are people who are
good at like thinking things through and
don't just you know type Lots code all
our positions are full-time and on site
in downtown San Diego though if you're
in Europe they'll be they'll be an
announcement coming
you know to deal with that to do it is a
situation comic has full free lunch we
have a we have a chef who comes in and
cooks a hot lunch for everybody every
lunch we do if you're in the office feel
free to order will breed to go to dinner
almost every day so we're looking for
senior software engineers software
engineers to join the open pilot team
we're looking for m/l engineers and data
scientists looking for safety engineer
this is somebody who's gonna think about
safety some people think they can apply
for this and not be able to code no no
no you absolutely have to be able to
code you know someone's got to write
like the code to do when we do comma AED
and stuff infrastructure engineer tons
of tools need building I stopped driving
is largely an infrastructure problem ml
is largely an infrastructure problem so
yeah I mean you know being able to deal
with big data being able to dispatch
things to a thousand machines all that
stuff thousand cause you don't you have
a thousand machines full stack engineer
we're very excited about hiring this we
got to get somebody in to make the app
good to make the API good prime is
starting to become a real profit center
for the company well not quite yet
actually prime cost a ton of money but
soon prime will make money and we want
to make great quality experience for our
users we don't use kubernetes use docker
for a bunch of things communities
confusing
navigation designer so yes we will
eventually be adding navigation I into
open pilot open pilot needs to know
where you are going there's a lot a lot
of trolls in the comments today man you
know from what I heard Oh operations
assistant oh it's been changed yeah we
didn't talk about that one um
that one is uh this is really what we're
looking to get really really what guys
this year we've sold a lot more stuff we
started selling at a 3x increased in
revenue this year versus the same time
last year
I'd rather work at a big company where I
don't need high motivation it's great
it's great people select themselves out
but no I mean it's a problem and you
know I'm judging it a bit from you guys
in the comments - it's like we're
getting a lot we're getting a lot more
regions but they're just not from people
who are good not from people who would
hire uh yeah the bar is like really high
to solve these problems
look self-driving is gonna be solved by
20 geniuses it's not gonna be solved by
a thousand people it just I don't think
any research problems in history have
ever been solved that way alright you
have some like you know on the extreme
end you have things like the proof of
from Oz Last Theorem right which is
solved really by its one lone genius
it's one lone genius building on top of
a lot of other people's work and of
course you're always gonna be building
on top of other people's work that's how
any science or research or engineering
works but you know in reality there's
nothing self driving is gonna be solved
by 20 people and no a thousand computers
right if you believe in like an ml
solution to self-driving there's not
gonna be a lot of open pilot in and of
itself except for adding navigation to
it like the the whole UX and stuff is
kind of done like it can use some
refinement and stuff but like it's it's
there we have some good stuff as we
approach one point out
I'm brutally not you have to be brutally
honest look if you want to get anything
done in the world and you're being
dishonest you're only hurting yourself
[Music]
yeah I mean it's really the two things
that we look for fundamentally our
intelligence and motivation and then
both of those things generally overt I
mean there is some amount of there's
some amount of skill required like if
you can't program I wonder why you can't
program we don't hire remote employees
though like I said if you're in Europe
and you're looking announcement
announcement coming
I don't know I'm not sure this this
judging from the comments here I'm
really not sure that this yeah think
about it I'm gonna have to think about
like how where yeah the regions have
been getting worse right I was hoping as
we grew I was hoping as we grew and we
got more users and we do we have a lot
more attention now our google trends are
up but the quality of the candidates has
fallen ah so yeah I don't know I don't
really know what to do about this I
think maybe one of the things we can do
is start writing up a lot of technical
see I mean I don't know personally I
think a lot of education is just a
straight-up scam like what should you
study to prepare I almost don't care
like you should program and you should
practice programming but it's not like
it's studying right it's like it's
practicing way more than studying I
don't care if you memorized a book who
cares I thought what I think of what I
think of studying now
have you put 10,000 hours into
programming that's that makes you good
yeah I think I think maybe that's
something we can do we can start we can
start documenting our code better how a
lot of the stack works better writing
like high quality but somewhat dry
technical documentation I think I think
might help though
wooden buy create an open-source
community I'm gonna slap a foundation
label on it and incorporate it as a
non-profit what do you think that
changes man you know this is the the
cargo cult of business when people think
it's things like that
when will comma go in public never the
more i've the more i've looked into that
bearish on that so look the comma - sold
3x more than the yield if the products
keep increasing in the way they've been
increasing the thing about exponential
is it gets it gets real big real fast so
if this stuff works I'm thinking in a
few years even with our current we're a
consumer electronics company we're gonna
have really large cash flows and we do
fuckin a new sector
all right the the self-driving add-on
thing I'm an SRE can I apply any my
permission
apply we'll do it with Google phone
screen and we do a carbon challenge we
do well on those look it's a real uh
it's all merit-based man I don't care
what your title is I don't really care
that much what's on your resume shirts
are out of stock what's our current burn
rate negative bro it's negative because
we make money because we're profitable
company no I hate remote remotes parable
the only way to possibly get considered
for a moat is if you've contributed tons
of pull requests to open pilot and then
we can consider bringing you on but
there is no way we will hire someone new
for a remote position these people that
you hard to manage honestly I think a
lot of people who ask for a motive cuz
they want to slack off ah you thought
the purpose of a startup with the Byrne
VC as quickly as possible that's the old
so no decade is 2020 everything changed
why do work experience again how do you
get hub look alright you want work
experience show me like you open source
projects you made that are in use Wow
damn that's good that's good work
experience
um did our investors make money already
no I'll give them the money they want
their money back God doesn't owe money
back I'll give them just like Zuke's you
know how can comma to beat all these why
do you think they're my competition why
do you think Derek competition why do
you think why do you think we compete
with Amazon and Google we don't
I can't get a job in programming because
I can't sell myself can you help
yeah I've tried to be nicer in the
interviews I've tried to be nicer
oh yes going Joe Rogan oh that's gonna
get me a whole a whole lot of inbound
that I want all right yeah you know what
more technical stuff will show more
technical content this is what I've been
working on this week thinking envision
features right when you think and your
brain about driving you don't think
about you don't think of pictures
you think features so we have a great
vision model a bunch of coffees and then
we're building these models auto encoder
decoder you can you can visualize it all
we got to put that we gotta put that on
Twitter that looks cool I love impatient
model dynamics model hardware people I
mean maybe our new again if you do
hardware and you can also code yeah
we're interested if you just do hardware
and can't code and I don't think so
let's see oh yeah and this is kind of
like show you guys
so this is one of the things I've been
working on
so what this is here this is the how
this is the box that open pilot is using
in order to drive and this is a
visualization model from the vision
features so I trained an autoencoder
to take the vision features and bring
them back up to an image this is what it
looks like when it's a video you see how
that thing appeared there look at the
lane change so this is how open pilots
actually seeing the world
I mean we're gonna start doing a lot
more stuff what we think in these vision
features right you're gonna see
something interesting up here when a car
comes across yeah I know the auto
encoder doesn't perfectly capture it you
know the loss functions not perfect it's
not sampled it's averaged yeah well you
know it's decent here part of the
problem also is this a small model we
need big model I'll show you guys
another one
it's not one
it's not a VA II it's not variational
I'm not doing any sort of bit
restriction on it we're training the
vision model separately supervised and
then we just take the features and bring
them back to the image space
I'll show you guys another thing
what's holding back 0-8 a lot of work
yeah I love a lot of hard work we're
making some big changes to the models
we're getting the models ready for level
5 so you can give this a second to load
here
how's the simulator coming along this is
the simulator envision feature space
yeah I'm reading the comments yeah we
use a finite state machine for lane
change I'm not really sure how else
you'd do it
so we can actually move so like I can
here this is ways D so you move around
with WASD just like a video game so I
can like turn I can also strafe and this
is thinking envision future space
I'm sis is using a transformation model
inside of the space that open pilots
using to reason yeah I can also I can
also was D with a so if I don't use the
ml transform model all right whoops keep
on to
give this one a second to load this
one's actually using the image and just
doing a normal augmentation I can't
drive I got to turn so slowly
yeah but we don't actually go back to
the RGB image when we do any of the
training yeah we are
we had a big we had an off-site last
week we are level 5 summit where we
discuss very seriously what it's gonna
take to get the well we settled on level
3 there's some chance we think Tesla is
gonna be first to level 3 with us in
second we think there's some chance
we'll beat them yeah we can augment the
Layton space basically it's not
something I mean it's the wrong thing
but it was something it's better than
Cruz I think I've said that way before
their acquisition too I think the bigger
problem is and then known as ooks and
Cruz look similar so what are the
outcomes for tzuke's employees they're
gonna look similar to Amazon employees
LSD slam uses photometric losses the
comma - is not that good at photometric
loss very good at geometric loss but
yeah everything we're doing is is
geometric not photometric oh my god the
more camera question no no I never
planned to add another camera
never never we're always gonna be on one
camera I'm getting paid by big one
camera to make sure we only ever stay on
one camera don't see us 21 yeah you want
to order our comma too so bad what are
you currently doing to address what am i
doing
but normally she's our gonna get better
yeah they're gonna get better oh there's
a few problems with it we're doing a
bunch of tests tonight if I go 2-0
cameras big one camera I won't pay me
I've pointed out of three cameras all
pointing the same direction with similar
field of view so that what you guys want
well that'd make you all happy uh what I
most shirts being stock again bro I
think shirts didn't make us enough money
I think shirts weren't a big profit
center for the company
we need profit Center I love profit
ah why are we so open because no one
listens to us anyway you know and that's
gonna be the real joke and that's gonna
be the real joke when all this stuff is
over you could be open you can say the
truth people don't listen they hear what
they want to hear their inner echo
chambers you know a lot of them have
yeah when you're invested when you put
commas been around for five years right
if you're at Wave low and you put ten
fifteen years your life into this in
your link are you gonna be like you
don't wake up one day and be like you
know guys I don't actually think this is
the right way to do it
what else can we talk about about hire
we have a hacker rank challenge and we
have a we have the programming challenge
and I speed prediction challenge it's
still actually a surprisingly good
challenged it's just a video and the
question is can you from the video
figure out how the car is driving how
fast it's going just how fast it's going
Wow Wow looks so weird with the old view
before HDR Kumbi yeah just output the
speed if you're the type of person who
chooses where to work based on free
drinks and good food and I don't know
man I don't know there's no name for the
Dukes is not a public company there's no
name for the stock of tzuke's this is
cool yo let's look at this one but in ml
transform land never mind
can't find that one again would have
been cool to look at that one an m/l
transformed land though we could look at
that same we do look at that same route
but instead of looking at it through the
eyes of a camera you can look at it
through the eyes of the model uh yeah
flow why you think I want a miniature
you think you think how I've gotta be a
little more precise than that don't you
think
um modafinil is a schedule for
controlled substance
Adrina Phil is not that my grief Anila
miss Polly still true is that 3d model a
custom library what reading all yeah I
don't know guys I'm bearish on the
streams
that's why I haven't been streaming in a
bed I'm bearish on the stream being
useful for hiring where's the hacker
rank email an email in a resume are the
hacker and cost us like a dollar so I
think we ask you a few pre-screen
questions first so you feel worth a
dollar
most people worth a dollar yeah I'm
bearish I'm bearish on the utility of
these streams maybe that was just an
error of comment yeah that's over we're
a real company now we got we got
executives we got three divisions we got
profit you know I'm still the same guy
hey you know like gonna people don't
change right yeah hire some recruiters
put people to a process get some
bureaucracy up in here what y'all think
can you know click the simulator sounds
like yeah I know you like hearing from
you but the question is like ask not
what these streams can do for you but
what these streams can do for me stream
is important for selling products I
don't need to sell more products we're
profitable we're making cash making cash
boys yeah take a look come for Shopify
let me just look it over a little bit
and make sure everything on the screens
okay you don't like we don't like
leaking information about our customers
but as long as it's fully anonymized
data it's all good
yeah buddy I gotta have money
look at that money look at money um yeah
so that's that's enough to run the
company
enough to uh yeah we're still selling
phone meetings thousand bucks how many I
slash services you could buy a meeting
wonder if investors don't best until
they raise again so the investors own
equity in this company um and its
preferred chair so they're totally
welcome to sell it at any time I think
right now it'd be pretty easy if they
wanted to turn a profit to sell it to
somebody else
so welcome to go
yeah if you're applying for a job here
think about which division you'd like to
apply for it's we've three divisions and
we have a different interview process
for each of the divisions we have the
Open File division the research division
and the operations division why don't
you open a small crowdfunding for a
small portion of your equity but I don't
need money why do I need money why do
you live in the bare a dying place
I mean why don't you make cryptocurrency
see you're why I don't do streams man
you're why I don't do streams
we do hire interns uh the bar is almost
higher for interns not similar the bar
so if you're really good you hire isn't
intentional here's kind of it yours kind
of like how I think about it right you
got all the column employees you can put
them in a ranked list and then you have
the mean of that list right we want to
hire new people that bring up the mean
that's how you make sure our company is
continually improving am I looking for
marketing why would I do marketing I
don't need more sales and more engineers
to solve self-driving cars remember the
mission of the company is to solve
self-driving cars while delivering
shippable intermediaries right so what
we need to solve something cars well
that list there we really need someone
we really need someone to build out
navigation any navigation is gonna be a
big thing for the next year we have a
whole back-end mapping effort we need to
hire people for well so do more
engineers solve the problem more
engineers are only good if you have
different things that need doing right
if you know you know the same right
three women can't have a baby you know
if one women if one woman can have a
baby in nine months three women can of a
baby in three months so I mean this is
true if you're having one baby but three
women can't have three babies in nine
months right whereas one woman would
take 27 and she probably not even gonna
wait a little bit but see that's I mean
that's what I mean if you can if you can
break it up into different like tasks
that need doing in order underneath the
big umbrella task of solving
self-driving cars then having more
software engineers definitely helps
right another way to think about this is
on dolls law right like problems are
parallelizable to an extent
this is a classic it's um like it's
gonna bad money and stuff
Oh simulations are good for testing not
good for training simulation is doing to
succeed if you train a simulation say
the stuff all the time don't wanna so I
write it all up write it all up the real
solution to self-driving which I pull uh
Sebastian thrown and start at Udacity
course for self-driving right like
Sebastian throws like Shimon was gonna
take him in the ten years to solve I'm
out I'll just train the people who did
it right what I think about mapillary
getting bought by Facebook well that's
the end of mapillary right who bought
who bought open open the street cam that
was bought by some company - it's sad
you know these things just go to die
where two semi trucks fall for me what
about semi trucks but yeah um the the
whole point of the company is the
mission so think about how well I mean
you can see kind of what my breakdown is
I'm pretty open about how we do it um
we're trying to be the alphago of
self-driving the thing about alphago is
entering the self-driving car market now
all right what self-driving car market
what cell driving car market are they
entering it's not market
well we're like the biggest market that
there's no there's no where's this where
is this market what are you what are you
buying right are you guys happy Tesla's
making a lot more off those off those
fall self-driving yep
but zooks isn't in a market zooks is a
research lab
I want to tap into ourselves by
commenting she'll talk over there
I don't care about average I don't care
about ours what is the average skill
level hey look at the code right I think
it's quite high yeah it would boost my
revenue yes but I don't need more
revenue I mean I need more talented
software engineers right like I didn't
come here and win you know
oh it's winning is winning just out of
out of out of phase in the world right I
want to have a job at Google where I do
nothing with my life and I tweak rest
endpoints to make sure we have
accessibility for cripples in
Czechoslovakia right like that's that's
that's really yeah that's what it comes
down to that's what these that's what
these you do not think up these
companies
no no but yeah yeah like like why is why
is the software engineering talent their
software and talent also goes to finance
they paid you play it a scam game like
you're playing a game with you take you
take the money and and oh look I'm
making all this money it's all fake
right more exposure equals more
engineers well so I was hoping that I
was hoping that this year it seems to
not be that true but you need to know
about slam before it now I didn't know
about slam four years ago I told me what
I hired myself right I don't I'm not I'm
not gonna ask you if you know slam in
any in any in any interview
what did most current engineers come
from reach and reach out I'll do it
right like you just you know it's the
top one percent of the people who apply
but none like okay half the people half
the people who we want accept the offer
and yeah that's where they come from
right what's the first question I ask
what's the derivative of x squared
not all engineers want to be an engineer
don't be an engineer do what you want as
I'm paid a 1.2 billion what do I think
zukes is actually worth what's hard
thing to value if you're thinking about
future returns of Zeus's business model
it's worth negative money if you're
thinking about repurposing this
technology for making your deliveries 20
percent faster than to be honest it
might actually be worth 1.2 billion to
Amazon it might be worth more right if
you could figure out how to get all
Amazon if you could do Amazon deliveries
20% more efficient that's easily worth
the money so I don't know if this
technology can be repurposed for that
I don't like Ross I think it's build
libraries not frameworks I think Ross is
a framework and not a library we get a
lot of the same stuff we know of a
library called serial comma die slash
cereal I know github it's again out of
cereal and it does multiple rastas we
use cap and proto for the binary packing
format we used to use zmq for message
passing but zmq puts the bite to the
kernel which is slow so now we are head
of open pilot wrote a custom one that
uses a ring buffers in shared memory
mr. everything a master timeout you need
solve leak code how to keep the model so
small they're growing and getting big
they're getting big yeah that we got it
we got to change it right now the models
are being stored on disk is float32 but
they're only being used the way to only
be used by the GP is float16 so we can
know we can change that
I don't know what Elite code 500 problem
is the spammers are yeah yeah yeah I
don't know maybe use the format of these
streams right I'm gonna do it on Twitch
I did it a lot to just kind of blow off
steam kind of shit talk but maybe that
doesn't attract the best sort of
audience so I'll have to do a bit of a
bit of reflection on how to get the
right to other people and maybe the
right sort of people are out there and
they're watching this there's not
commented or they they click around on
it they read the comments
when do I think , will reach level 3 3
years that was kind of that there's kind
of the consensus the offside level 5 is
still too far away to think about we
were all pretty convinced that it's more
than five years away but level three can
be reached significantly sooner it's an
achievable goal and it's what we're
pushing towards we need to get our
models to be so reliable in fact when
you're in level 3 level 2 has a
completely different safety paradigm
from level 3 in level 2 we don't trust
the models we have lots of stuff after
the models to prevent like high torques
on the steering wheel for example right
and this is good in a level 2 system
because we expect if a high torques
require the user code but at level 3
where you can't rely on the user at
least can't rely on the user quickly
that stuff becomes a lot less relevant
so in three years world comma P well
you're a spammer so you don't get an
answer I was gonna give you an answer
but you spammed so now you get a timeout
and no answer yes
we're not working remotely we never
worked remotely you know I'm 30 years
old right a lot of people here pretty
young lucky for you I'm good at me the
periscope era was awesome
it's for a different thing right like
we're not here to do we're not here to
I'm not here to promote the product I'm
here to promote the company I'm here to
promote put it this way you show me you
show me that uh you're great engineer
you show me you're great engineer and
you're skeptical that comas gonna win
and you're skeptical that we're gonna
win
self-driving cars do my programming
challenge they were programming
challenge you the hacker and get a
perfect score it's easy and then I'll do
it through a phone call with you the 30
minute phone call with you and if at the
end of the 30 minute phone call I
haven't convinced you I mean I'm sure I
will I'm it's if you truly think about
this space free of preconceptions and
you look at what's going to be required
to solve this problem your and your
burst and you know the direction ml has
been going the direction of the legacy
self-driving car companies have been
going direction Tesla has been going I'm
sure after 30 minute phone call I'll
convince you
redundancy is something to think about
after the software is good enough most
of the problems now are not caused by
hardware failures but by Stauffer
factors I just have to be people within
the US know we're happy to get you here
we're happy to look if you're super
talented we'll make it work we'll figure
out how to not remote not remote I'm not
gonna go that far but perhaps we'll have
an office outside the US
if DISA things become an issue or if we
can sponsor your visa we're happy to do
it
honestly why you should work at comma of
Google pays 3x well so two things about
that
one assure Google salaries our Google
salaries are 2x higher um but your
Google equities not gonna 10x alright
your Google equity is there's no 10x
growth for Google there is very easily
10x growth for comma so the OP side
could potentially be much larger working
here instead of Google um so from a
straight monetary perspective you can
make arguments for comma above Google
but if you're into the straight monetary
arguments you know it's boring the
second reason is what are you gonna do
at Google right do you think you're
gonna build something revolutionary or
do you think you're gonna look into a
Google Docs bug on ie6 and have to go
through three stages of code review and
you know sit through sit through three
meetings every day and if that's what
you want to do with your life and that's
what it's worth to get oh I'm getting
double the money in the bank right now
you know I started as a risk right happy
I know if you're talented with the
amount of equity you get you stand to
make a lot more money here
if you're not interested in software
development please go argue you'd have
an impact but honestly you will make
more money probably too if we succeed if
comma actually gets to level three
within three years yo yo don't make more
money game for what Google do I have any
advice for early age stage startups shut
down while you still can't give the
money back to your VCS tell them sorry
about the 30% haircut and be like I'm
out bro
what if google buys , Google's not
buying , not selling the Google himself
to Google two billion two billion or
sell to Google then I'll take the money
and start a pasta
that's an hour-long stream I'll go back
to working a little bit it's almost
lunchtime product design Menkes not
really I'm pretty much can you code
let's hear from someone in the
background they got things that don't
like it a distractor it's bad enough
that I'll distract our boss
we used to flow I don't know I know
there's the movement all I gotta use
fight towards yeah I think cross is nice
Google may take that offer yeah Google
takes that offer yeah I'll go start
apostrophe with the money after I you
know and get rid of my handcuffs after a
year right two billion two billion and
you know what you want to talk about I'm
not just gonna talk with you got a wire
two million first two million to come to
the come to the table the hours do I
work for week 200 bro 100 how many hours
am i awake it's more than a hundred
that's right always working work is life
what is a posture if you do it well the
same thing is common are we hiring
front-end dance um it depends yeah maybe
if you think you can qualify full stack
will hire you if your full stack with
more emphasis on the front end will hire
you if you're good with UI stuff will
hire you so yeah if your if your react
JavaScript sure
how good is Luke's compared to Kama it's
totally different I don't care if
full-stack does not require any ml you
won't be touching any of the ml stuff
you're looking for graduates or senior
experience levels I don't care um yeah
but we have an intern here it's 20 it's
genius
you know if there were if there were
five more people like him I'd uh give
them all full-time jobs
what type of job security can you offer
[Laughter]
look here's the thing about that
question you actually have quite decent
job security but if you're the kind of
person who's interested in job security
you completely
you'd never you'd never work here you'd
never you'd never like like we're trying
to do something new right we're not
trying to maintain Google Docs for ie6
here with respect to like to ask the
question seriously all right this is
saying look if your program doesn't
finish in one second it won't finish in
two if the program doesn't finish in two
seconds we won't finish in four four
eight eight sixteen so on so forth , has
been around for five years we're a
profitable company we've raised 8.1
million dollars which is laughable
compared to what we have so yeah I mean
the company's not going anywhere
so with respect to job security like
that'd be worried about the company
disappearing I wouldn't worry about that
if you're worried about getting fired
that's a personal thing between you and
your skills um you know I mean there's a
job security question like is comma
shutting down next week I am I going to
announce tomorrow sorry guys you
couldn't raise any money you're all
bought by Amazon no of course not all
right that's an hour thank you for
joining coming I slash jobs you want to
win three years to level three being a
part of the winning team get rich change
the world that's right
see like
look youtube
let's wait for a few people to get in
here and then
we shall talk honesty on a friday night
you know
existentialism on prom night that kind
of stuff hello
welcome to my stream it's friday night
and we're here to talk about
comma because we're on the official kami
youtube channel
dot com ai archive which is actually an
unofficial youtube channel
but they do a better job being my social
media
manager than i will ever be
and hopefully they're making buku
dollars
off the advertising revenue
what's up what's up okay first thing to
talk about
on discord today you know it is
interesting it's interesting to see the
vibe of new discord
with the slow mode in the lobby i mean
you have to do it right as the company
scales you have to do it it's honesty on
a friday night
um you can't keep going on
uh like you were going because if you
keep going on like
we're going you're never going to grow
you're never going to be more
and me i'm a big fan of growth uh
so boring though i know it is boring
right i know i know but
i mean that's part of becoming a real
company
um i think we're barely gonna hit four
million dollars in revenue this year
hopefully you guys come through buy some
common twos especially when that zero
eight is going to be released
um next year we're hoping for 10 million
in revenue
i think we can do it we have some ideas
um yeah i mean that's look hockey stick
growth isn't real
exponential growth is real um
i don't chronovirus don't worry boys
uh hello from russia
uh you know youtube doesn't really you
guys got to hit that bell you guys got
to hit that bell on the subscribe menu
i'm sure you're the 31 who did this
doesn't notify people nearly as fast i
get way more on instagram and twitch
um maybe we should have done this on
twitch but no we're here to talk about
comma and we're here to talk about
honesty you know
for the first time working at calm is
not so terrible you know i hated it i
hated it last year
you guys remember that stream from july
where i was like holy shit we're gonna
fail
you know we're gonna be on one of them
failed startup blogs you guys can
make fun of me in hacker news comments
but like
you know we're not gonna fail anymore
shit we might even win um i did lex
friedman this week
so that was nice alex friedman's a great
guy man
real positive energy you know
uh
we are hiring we are hiring we're not
hiring for a bodyguard we are hiring for
an
office manager um now remember as an
office manager if you think you're going
to come in and get coffees and shit
no no no no trust me the questions are
still really like
pretty much just what's your iq um
but you know now they're they're they're
you're gonna be asked the same sort of
questions right
they're not math-based they're more
based
uh when am i doing jre uh yo that's a
red light
nebulae uh never doing jerry
i can go into why but yeah i know if
you're not a programmer and you're
interested we do have an
office manager position uh that we're
hiring for
what's the reason that we're more
positive that i'm more positive than
last year
because we're gonna win boys
like kama's gonna win um
yeah no the problem with uh jre is uh
you know it kind of defines you that
doing that podcast becomes who you
are um look i mean joe hogan's great but
he's not a technical guy uh and a lot of
my analogies and a lot of my thought
processes
are tied into to to technical stuff
but we're here to talk about a few other
common things so you know look look look
look look
research research research zero seven
nine came out zero seven nine came out
shout out
look it's you know it's a deeb who did
that release
um if you guys know a deeb uh
willem's been working on a secret comma
project
um a little helped out with the release
a bit but that release was really a deep
you know
the fact that he's got cpu down so much
guess what's coming out in
zero seven ten
we are down clocking the comma two cpu
not just one notch not just two notches
but for the big core three notches we're
going down three notches we're going
down to 1.44 gigahertz
and you guys are like what that shitty i
get a slower product
no you get a product that doesn't
overheat anymore
um and we've done it in such a way that
the
cpu usage on zero seven ten is going to
be lower than the cpu usage
on zero seven eight despite being down
clocked three notches
um so huge victory from a deep uh and
that's what's coming in zero seven ten
zero eight is the new model guys i know
the new model the new models are delayed
way more than i would like there's a
branch there's a branch on open pilot if
you wanna drive with the new model it's
shit
um we did
some big refactors
both conceptual refactors the model
reasons completely in three dimensions
now not in two dimensions but of course
you know three dimensions instead of two
dimensions that's three times
the bugs and you're like you know why is
it three times the bug shit man
it's not even you know it's okay maybe
not three times but it's a lot more bugs
um you know because you know no no it is
three times the bugs because normally
you're just off in like
one yaw but now you got your pitch and
roll to be often
you can make mistakes in all three
dimensions
instead of really effectively what's one
um
so it's three times the bugs we got a
lot of bugs to fix we've also migrated
all of our stuff from tensorflow over to
pie torch
so that's been a big you know now you
got all the pie torch bugs too so we
gotta fix those bugs
we're moving off a stack that's
crap code but uh you know worked
because we riced it to shit uh versus
you know a new stack which is clean
which is well written but there are
gonna be bugs so it is gonna take some
time
um so that zero eight there's gonna be
at least a zero seven
ten there may be a zero seven eleven
even
uh depending on what open pilot team
wants to do and there's also been a big
drain on kama's resources for a project
for the secret project that you guys
know nothing about
uh so you know that's where a lot of our
resources
have been going uh but when you guys see
it you're gonna be like
holy shit city almost
um nah shit's unreal but
for now enjoy your zero seven nine
zero seven nine is a solid release you
do not
want features you want stability and bug
fixes trust me
everyone who thinks they want features
has no idea what something
why is open pilot i drove i drove i did
a road trip
i drove thousand miles that was four
thousand miles
at least three thousand somewhere
between three and four thousand
and open pilot is so
good hyundai sonata i'm doing like
mountain roads up in colorado i got the
thing engaged
it doesn't make mistakes um pay
attention at all times of course i was
paying attention at all times
uh but you know hours just watch the car
drive so chill
um if you have a supported car and you
don't have a comma two
why comma twos are great
uh buy one um and you know the comma two
the comma two is gonna be around for
quite a while
uh we just ordered i just ordered
another two thousand
uh i just approved the order for another
two thousand of everything today
um we've sold about 2 500 of them right
now
did i sit in the back seat no don't do
that degenerate shit
um no i sat in the driver's seat with my
seatbelt buckled and i watched the world
go by
uh min iq needed to work at com we don't
actually iq test
um but you know there's a real there's a
real truth to that we're looking for
intelligence and motivation
um and that's in every employee who
works at comma
um you got to be intelligent you got to
be motivated
uh will it help eons as well if you have
an
eon and a black panda yeah if you don't
have a black panda
uh get a black panda he owns with black
pandas
they're eventually gonna be deprecated
but we're in no rush
because it's very easy i saw on twitter
people were like bring back support for
white panda
we're never gonna bring back support for
white panda and let me explain why
all right do you want us to bring up you
see i'm not a no child left behind guy
right
i'm not trying to bring up the base i'm
not trying to bring up the freon with a
white panda person
i'm trying to bring up the comma 2
person right i'm trying to bring up the
high end
so i'm not gonna deprecate things just
because i want more money from you i
mean i do want more money from you but
that's not why things get deprecated
all right we have a plan for that we're
gonna release a medium post you have one
year of support
if you buy hardware from us now you have
a one year warranty on it
and you can expect that that hardware is
going to continue to run
open pilot for one more year um
beyond that you know
i mean look we're not apple we can't
support io we can't support the iphone 6
right i mean android you don't even get
support for a year
be happy if you get an update right um
but it's not done it's not done because
we're trying to you know take money from
you guys
god i don't care about that um it's done
because
it takes effort for us to continue to
support that old code
right if we want to bring up the high
end well
think about it right when we write the
new params learner and the reason why
pandas got deprecated
um is because the new params learner
needs a high precision gps it doesn't
initialize without a high precision gps
it won't learn the parameters without a
high precision gps
well could we write a version of it that
works with white pandas we could
but why should that be where we invest
engineering time
right it shouldn't and also remember
10x better than most companies if you
want to invest the time
you can right it's open source if you
want to invest the time to backport the
new params learner to white pandas you
can
um you want to get a cheap supported car
for common it's all pretty cheap right
it's all pretty cheap
um i'm hoping that the zero eight models
are going to be
mind-blowing uh
3d what i've been working on guys you
heard of batch normalization
you know what i came up with yesterday
unbatched normalization the layer is
called
denormalize and it's literally batch
normalized in reverse
and it works um you know
if i wasn't lazy i'd write it up in a
paper but uh
this is all the summary you get
basically take your running mean and
your running variance
uh put some momentum on that and just
instead of subtracting and dividing
add and multiply right denormalize batch
norm
turns inputs into mean zero variance one
right on the output denormalized takes
zero
mean one variance inputs and turns them
into whatever the real outputs are
so yeah if you're a machine learning
researcher and you're doing a regression
check out the denormalized layer
i'm very excited about denormalize just
a little little
little new tweak in our new models i
mean you guys can decompile the models
when they come out
we switched it's all in pi torch now
it's so easy in tensorflow
so in tensorflow it became pretty easy
to do multiple gpus in the same machine
um in pi torch two things are different
tensorflow used a
single process to feed all eight gpus
it's terrible you know because i have to
get so much bandwidth through that
process
if you do mem copy mem copy only works
at like 2 gigabytes per second
memcap is pathetic compared to the
memory bandwidth of your computer
um unpopular opinion use batch norm
after activation
what get out boo get out
uh i don't know what kind of activate
using swishes using swishes
yeah you probably swish um
now look um denormalize
forget what i was talking about oh yeah
distributed data parallel in pi torch
it creates a process for each gpu it is
so much better it uses basically raw
nickel to synchronize the weights across
the things
and it's free to go across multiple
machines
we got a we got a 400 gigabit we got we
had
two hundred gigabit infiniband cards in
each one of our gpu machines that's 400
gigabits from each of the five machines
going into an infiniband switch
i'm training it we the bandwidth is so
overkill we didn't need any of that
the 100 gigabit into our main switch
would have been fine but
you know we get to play with infiniband
right yeah it's super sweet
uh so yeah we got five machines on this
on the sick infiniband setup
and yeah the model that i'm training
right now it's training right now but
you know
it's so nice we trained our vision
models like the vision model that's in
uh it's still the same one from zero
seven six um that vision model
was trained that took like 10 days to
train
now on our four gpu machine on a four
gpu rig we train them in two
um denormalize makes things a little
faster too
takes two days to to get these models to
work we'll probably do a fine tune of
the model
for another two days but uh it's still
it's super nice
um yeah
is your seven x move over for semi yeah
yeah you know you can already do that if
you
really want to do that you can already
comment out the lanes but it doesn't
drive as
stable uh what torque limitations do you
have a honda
there's really not torque limitations on
the hyundais and toyotas
toyotas have other issues toyotas have
shit angle sensors and they seem to lag
but other than that uh really buy a
hyundai
hyundai that you get torque
and you get oh you got honda torque well
how many of you guys have torque mods
now you know
as long as you're keeping it as long as
you're doing it safely you guys doing it
safely with the torque mods
if you're doing it safely with the
torque mods torque mod gang right
uh you know we can't release that uh we
can't release the torque mods uh we
can't even really like
you know look i don't wanna get sued by
honda man
um but if you guys figure it out hey
shit you know you can modify your own
car
i can't release honda's proprietary
firmware that's copyright infringement
so we don't do things like that
but if you guys figure it out more power
to you it's nice that people have
figured out torque mods
um yeah
make a discord server
comma has a discord server the problem
with the discord server was moderation
moderation's a hard problem across the
internet now so we just clamped down on
all talk that wasn't like
very clearly related to comma and it's
made the moderation much easier
you know what am i going to hire a
full-time discord moderator who
understands the nuance of the community
think i got a budget for that i don't
um no bosch accord mod yet i think we
have one of those
i think we have a bosch record mod um
wilhelm has a bosch accord so hello
uh
today's a great day to buy a comma 2 if
you didn't buy a comma 2 today is a
great day to buy one
if you want to come work at comma two
things
we're hiring we're hiring people who we
don't usually hire
um you want to build you want to build
apps come work at common
someone's got to make a comic connect
app good we have the budget for it now
right we got
we got you know 2 500 comma 2 users to
support
i don't have a coupon look i'm sitting
on a bench you think i got a coupon
yeah i can pull a coupon out of my ass
what you think i had a coupon
oh god shit um i don't even have to
shopify my phone
in what certain uh situation is dnorm
useful
so d norm is useful when your outputs do
not have
um mean zero and variance one and you're
like why don't you just rescale the
outputs well if you have multi-headed
gaussian uh
predictors just rescaling the outputs
would only give you one rescale where
example for example
we've announced this we have five plans
in the new model we want each one of the
five plans to have a separate
learned mean adjustment
um you can't program see if you start
out with that if you start out with like
i can't
probably not i mean we're hiring for an
office manager who we do not expect to
program
but we expect to have very high
conscientiousness and intelligence right
uh we're hiring we're hiring app
developers
we're hiring ui oh come on someone needs
to clean up the open pilot ui we need a
ui developer
um you make games you want to make games
it's the sickest game ever it drives the
cars right
um well i can't talk about the secret
project
it's a secret if i talked about
the secret project it wouldn't be a
secret anymore you know
um thomas working on stuff behind the
scenes the secret project
uh the model is not the secret project
we're working on 3d models and pie torch
just popped in any ground rules for
questions if you're asking me questions
about me
that's the wrong place to ask if you're
asking questions about common i ask
whatever
um multi-cam whoa whoa whoa
whoa whoa we are not near the limits of
the single camera yet
we haven't even shipped big model yet um
i don't know about big model there's a
lot of other problems before big model
why does the car not slow down for turns
my sister my sister came to visit me
last week and she's like
but can't you just like you know like
like like
make something that can like look at the
turn and tell you what speed you should
take it at because like all the humans
who drove took the turn at that
speed and i'm like yeah that sounds
really smart now actually build it we're
working on it 0.8
um narrow wide main cameras whoa
whoa who's got all these fancy cameras
one camera
two cameras comma two it's got two
cameras
you know it's got a forward camera and a
backward camera
yeah whoa whoa
look at all these fancy cameras all i'm
saying if they're ever going to be more
cameras are going to be very expensive
um how good are our maps maps are
useless
maps are useless um we're getting all
the outputs from the new stuff if we
ever do want to make them
but you know someone wants to come here
and work on maps and you're smart i'll
hire you
um i think maps are kind of useless but
like we have the best
we have we have devices that are
gathering stuff that's like centimeter
accurate like if someone wants to stitch
that together and throw that into an hd
map and put deep map and all those sad
companies out of business
shit i'll hire you what's my take on
waymo going live
what do you mean is it live can i hire a
huevo if i download the app right now
can i hire a wama
um red light detection is the wrong way
to think about it ghost hardware
is vaporware uh nvidia buying arm
thumbs down thumbs up to risk five um
in in in phonics uh in phonics so i can
go to phonics and i can get a wemo
um
what do i care about the rimac concept
too hardware subscription model oh my
god
ghost's ridiculous subscription model
um it's another fake launch waymo is
going to be fake launches
until they go out of business right
the problem with waymo isn't even
technical the problem with waymo is
product
you're paying for a slower uber you're
paying less money for a slower uber i
have news for you you can already do
this it's called uberpool
um oh yeah yeah i believe that that
reddit video yeah that's really a
community reddit video waymo you
fooled me oh we got to make it look like
we got to make it look like it's coming
from the community and it's not
paid actors never mind we're not here to
talk about waymo we're here to talk
about winners
um we'll go for 30 minutes we got we got
we got eight more minutes for questions
on honesty friday night honesty
friday night uh
come over get into the wallpaper
business i don't think so
any improvements on wobble well you're
gonna get improvements on wobble sooner
so
wobble or ping pong happens because um
we don't have uh i don't care about the
anti-trust hearings
we don't basically every time you reduce
latency
and you increase um real timedness you
reduce wobble
how do you decide when to be honest yeah
it's friday night it's a good time for
being honest
wait seven nine wobbles more than the
previous no way
no way you'll show that to me in some
repeatable way and we'll look into it
i don't believe um
i've been driving around on zero nine
best quality autopilot
it's still friday night here this is
california common europe is doing well
common europe's doing well we got three
people over there uh if you're
interested in joining common europe of
course
email in it wobbled a bit what car
hoping pilot 1.0 you know like never
make any mistakes and be perfect
uh i'm driving the camera yeah yeah i'm
driving the honda sonata biggest failure
of 2020
um
[Music]
i don't know we were out of stock for a
while on comma twos
production took a bit to get under
control production's going really well
now
did any company fork open piling yeah
there's chinese knock-offs of comma twos
um i mean ghost and mercedes are going
to knock off open pilot at some point
they just don't know it yet
there's great companies like epilogue
um oh there's all there's a malaysian
fork of open pilot
some kid in korea made bank selling
knock-off combinations
is common mission focused like coinbase
you mean do i care about
you know is comma gonna come out in
favor of of bullshit political
initiatives no
um was i serious when i said i'd train
the net on waze
like kind of um the problem is like
running ways and then what if they
update it
uh we need to build our own navigation
we're hiring for that
please come work here please build it
how do i hear about the korean knockoff
i hear about everything uh
how will i know if a big company uses
open pilot you don't think that thing is
riddled with botnets and phone home
things it is you can read the code and
you can look for it
we know everyone who's using it for
everything right
is there a chinese competitor look let
me explain to you how competition works
here's the pie
of after-market self-driving systems
right
every person who builds an after-market
self-driving system that's a competitor
with us they're not competing with us
they're not
stealing market share from us they're
growing the pie
right like like it seems like it's gonna
win
every new person who comes along is just
making the pie bigger you know what the
great thing about big pies is
you can eat big pieces um big pieces of
big pies
you're going to win well did android win
tesla's going to win ah
open pilot is great there's a lot
there's a lot of room for improvement
you know oh man if i could drive with
open pilot 1.0 right now
it'd be great
no you don't understand the layman
doesn't understand or doesn't trust c
this is a myth people think it's like oh
i gotta dumb my shit down for the lowest
common denominator no you don't
there's people who do that for you right
it's it's
it's it's trickle d everything's
trickled down
everything good is trickled down right
shit man
who had smartphones before smartphones
who had pdas running windows ce where
you could buy the cell phone adapter
card that was like yay big and put in
your
2g edge sim card so you could get whap
you know before the cardi b
song right like we had that
i don't know i don't know if you're the
wii but i had that shit
you know 2002 right that's who had
you know i had a pda you opened up the
little thing and you could stick a phone
wire in there
and you could connect to a dial-up
service through your your
your flip top pda right
that's how this all works
you know it's not it's not the thing the
new thing is around for 10 years before
the normies get it
you guys are here you know everyone is
buying comma twos and
you know all the future comma shit like
you guys are on board with a with a
revolution and you're like oh the
revolution's never gonna happen it's
gonna be embedded in the cars
yeah man and motorola is still making
cell phone os's right
no wait they're not does motorola even
still exist
i think i think google bought them for
their patents or some shit
right
what benz and audi
no
have you been in those cars have you
used those systems they're shit
if anything the only other reasonable
system out there is super cruise
right and you're like oh they have the
secret good version no they don't
guys let me let you in on a little
secret you know the secret version of
open pilot like we talk about it thomas
driving around with the secret version
of open pilot
it doesn't exist there is no secret good
version of
anything anywhere because if it did
exist the company would have shipped it
yeah man you can buy zoops go on amazon
get a zooks delivered to your house
don't worry it drives backwards and
forwards we got you both ways
what if i want to drive sideways need a
callow platform
bmw was trying to sell subscription
eating seats
i saw them as funny as shit um
what's mao love donuts
what is will's honda mod is it unsafe
don't do anything unsafe uh
if someone kidnapped you can you make a
self-driving missile
not build an iron man suit i bust out
man george hopps made this in a basement
with a bag of scraps that's right
um nah it's all just pr oh what's our
monthly active users
uh i think like 30 duh
[Music]
it's above 3 000 might be at 3 500 now
um any progress on pure vision i mean
it's all coming with the new models
new models will come
iron man suit i don't know arc reactors
seem pretty hard to make you know we're
paying for power here
actually less than i thought but it's
still 25 cents a kilowatt hour
we're running the new segment we're
running the new segnet right now across
all the segments
you know we're going to fix up some
stuff with the new segment thank you 10k
uh contributors uh and that segnet run
is gonna cost us 600
in power are people doing actual pull
request good pull request shout out to
dean lee tinley's doing great pull
requests
um do investors ever call begging to
give you more money
a16z doesn't really like us uh
well i don't know you know chris dixon
hey man if i you know
said crypto was the future and crypto
went the way it went i mean it's like
yeah i got into 20k now it's down to 10
but don't worry it's gonna go up
um no look i don't mean to rip on a16z
but no we don't talk to them anymore
uh do people email in like every day to
invest in comma of course but what would
i do with their money buy a yacht
right should we raise a billion dollars
and buy a yacht
and just live on our yacht and be like
yo kama's just this yacht
uh no because that'd be irresponsible
with the investors money and i'd never
do that
we're a profitable company we make money
by providing value to you
uh shit man you know our product costs
twelve hundred dollars
and once people get it set up and start
using it they're like oh my god this
thing
how did i ever live without it um
would boston dynamics or any non-car
company have used for a comma product
probably not
all twitch subs invited to chill on the
yacht let's go
san diego let's go we're going to sail
out we're going to
we're going to uh hawaii you know cost
like six grand in fuel to get to hawaii
i can drive across the country for like
you know
100 bucks in fuel in my prius uh
like is that actually right let's say
hundred dollars
let's say two dollars a gallon let's be
generous 50 gallons
60 all right fine fine 200 bucks in fuel
right
um but still six grand to get your yacht
and fuel to hawaii
what do you need to know you need to be
intelligent motivated
uh open yacht all right let's support it
man let's support it
we're at a space like yo did you guys
know that you can just like book a
spacex rocket on spacex.com
they give you their prices they went to
this data center company
and they couldn't give us their prices
no no no you got a call you got to
request the quote but if you want a
rocket launch
just go to spacex.com and you can book
one how unreal is that
um you know i hate when things are like
oh contact us for pricing
spacex will just tell you the pricing
for a rocket no contact us
i'm kidding about the two billion
honestly if i didn't respect them and
they offered me two billion i'd be like
fuck off with your fake fed coin
uh seeing a lot of quality issues on
discord
it's a lot because of more users um
i mean we're selling we're selling you
know we're selling three times as many
as we were last year right
so you're gonna see three times as many
complaints i think also what people have
come to expect is a bit higher
uh but we're tracking the quality issues
we're we're
we're they've been getting better
they've been trending upward over time
the quality has not been trending
downward i can definitely say that
updates to our museum approach yeah it's
all working on dreamer v2 no i have to
read that
uh i don't know what the deal is i don't
know if that happened people at comma
last for like a month
uh is there a new product in the works
i mean there's always new products in
the works you guys see the obd2 harness
that thing's sick right yeah i'm never
contacting for pricing
100 billion um what are the personal
costs from being famous i'm not famous
but i got 136 people in here you all
think i'm famous
uh when can you leave your comment too
in the texas heat and not have it burned
up
zero seven ten with the down clock cpu
i'm not watching any sports ball
um i don't know what a tc is man i don't
know anything about tc do i miss doing
presentations
yeah kind of i don't know just vacations
do i miss vacation sure
you know everyone comes to me they're
like well i can really learn something
from this conference the company should
pay for me to go i'm like company's not
going to pay and if you want to go it's
a vacation i mean you can go that's what
i how i treat it you know
when i gave that berkeley presentation
you know why i went because they put me
up in the claremont for two nights that
hotel's sick
um what are you being for halloween not
anything inappropriate that's
right um are the down clocks in master
ci yet no they're part of the new
version of neo s
um oh
dehazabus far over sam altman
uh all right that's off topic question
do we have any other questions about
comma if we have any other questions
about comma i'll answer
them uh if we don't
do i already have a memorial date isn't
that in may
uh custom silicon probably not
uh you don't really need i mean if no
company can provide us what we want sure
uh conferences are a scam
common mileage is way back up i mean you
can go you can go on
any of the websites that track traffic
uh covet is mostly over
um using lstm we use a group
oh the quality bar is super high for
common pencil i know
um i mean yeah the new segnet
the new segment the segment that i'm
running right now that i'm paying 600
in power to run is 2x better than the
previous segment
that means for every mistake the number
of mistakes is literally half
which is unreal um
yeah the the core shielding kind of
works it's it's a kernel tweak
it's gonna be in zero seven ten uh
when will common be available in india
we ship worldwide
longitudinal on hkg don't run the forks
they're not good they aren't good and
nobody's read any of that safety code
yet
um they if they're interested they
should try to upstream that safety code
that's the first thing to do get it
upstreamed into panda
uh what city you're in when san diego
we're in beautiful san diego in the san
diego
city college campus right here um you
think com is already perfect for highway
no good yo so i took lex for a ride and
we did some driving around the city and
he's like
this is really good and i'm like yeah
that's what i said
uh congrats on the new segment
deployment thank you
um we're running it right now it's
burning power right now at the comma
office
uh oh the commercial segmentation
i know i mean you see the commercial
segmentation that we paid for
uh i mean they're working on they got to
get the quality act together though
uh like i'm the volunteers have really
been catching the bugs and i really
appreciate that
because you have to get the look every
other company is just using the
commercial companies and they're
accepting it you think any employee
there is actually looking through each
piece of data guys i really appreciate
you
you know you guys the reason pile is
going to be so good
um any case we see regressions not
really
comma can't drive in india people don't
follow rules don't worry about that
it doesn't matter need new projects on
twitch
uh oh alex i like some talk about his
company
i like his his social network idea um
dufour saw the 10 second limit i don't
think new ones do but i'm not sure
anyone has confirmed that
traffic lights and stop signs are
largely a gimmick if done wrong i don't
like the way tesla did it with maps
we're never going to ship it with maps
next interview is over uh yeah the comet
is way way better on roads without lane
markers compared to tesla
of course yeah like that is really where
that is what we've been working on what
do we what do we talk about we talk
about end to end
it's working the thing i promised on the
last last lex interview about being able
to drive without lanes like it's mostly
there
tss 2.5 should not be hard if anybody
has a tss 2.5 car here's my here's my
here's my challenge deal
if anybody has a tss 2.5 car and you
want to come down to san diego
you want to come hang out for a couple
days we'll do the port i think it's
super easy
um volunteers are selected for actually
caring yeah i mean we care
karma is selected for actually caring
you think people call up and like they
answer the questions right and then like
i ask them and they just don't care you
think i'm gonna hire them no
uh can i explain the open pilot
architecture read the code
um how can i get in contact with you
you're in contact with me right
now if you expect me to send an email
and talk privately here's the bar for
private here's the bar for public it's
way lower come on i answered a question
about like
you know uh uh coinbase is
whatever approach you know who does the
car ports at comma now
yeah we get around to them open pilot
team's pretty busy with like
you know the high leverage stuff but we
will do tss 2.5 that carport's very
important to me
other carports not so important to me oh
yeah you can pay me a thousand bucks if
you really want a phone call
thoughts on using transformer models for
vision lex asked me this too
and i said yeah we'll try them i i mean
i think
driving is way more markovian than the
language sometime when you're parsing a
sentence
you have to like think like oh what was
in the paragraph three paragraphs ago
you almost never have to think of what
happened 30 seconds ago when you're
driving
um because driving is way more markovian
so i think stuff like we use agree i
think a group is fun
uh we'll release the training code no we
will not
the training code is comma's secret
private ip
and the thing about the training code is
if i thought it could help you know joe
and jane
open source yes i would absolutely
release it it does not help joan jane
open source
we are training everything on a half
million dollar super computer that would
cost you 5 million to rent in the cloud
like what can i tell you right like it
would not be useful for you to have the
trading code
at all do you have 32 gpus ready to go
do you have like two petabytes of
spinning disks
half a petabyte of ssds right like this
is the scale that things are happening
at
and the training code will only help out
companies and fuck companies
that's right if companies want to work
with me
they can have a phone call for one
thousand dollars
how do you get 32 gpus the gpu store
um yeah i know attention is all you need
hey look that stuff was in people are
like oh this is some radical new idea
that exact same idea
was in pack eight for the hutter price
uh which company do i hate the most i'm
upset with nvidia
i think jensen should follow his heart
and not his mbas
uh you want a 30-90 so bad yeah me too i
do have four 30 80s though
play some sick games on them we spaced
them out we spaced them out a bit you
know
uh can i explain in layman's terms why
labeling lines accurately is important
beyond model doesn't really use any
lanes
um they're used for benchmarking they're
used to determine like whether our
thing is thinking correctly they're
going to be used for mapping
and they're also used for like uh
alignment
so like one of the things that you can
do super accurately with lanes is like
you can check your calibration right
because if you're
if you're sliding at all your lanes are
gonna are gonna slide
right but if your calibration is perfect
your lanes are gonna be perfect um
so we use lanes for a lot of like uh
subs like like like
ground truthy like tasks uh
not necessarily for training the final
policy model but you know
what is your actions right you're still
going to have to recover those you want
to do semi-supervised learning you still
have to recover those
the lanes and also it's not just lanes
remember the segnet is also movable we
have to filter movable out
um in order to be able to use older
features to recover the pose right
so that's why um
can you what company holds a youtube
live like this none of them
because they're oh we gotta run that by
the pr department
oh we gotta make sure that the ceo
doesn't leak any new stuff
uh why am i at the college campus yeah
i'm going in there to recruit right
after this
um schmidt uber gets all the credit uh
i don't know who richard hart is can my
computer's running crisis yeah probably
elaine's are the original sin of comets
true but no we've
we've gone beyond lanes um
manufacturers aren't contacting us they
are but they're not contacting us
correctly
they're contacting us with the wrong
kind of people asking the wrong kind of
questions
i'll tell you what's going to happen
those manufacturers are going to have
teams of engineers
who start to incorporate open pilot and
those people are going to reach out to
me
and those people i'm going to want to
talk to the people who want to
can we figure out some way that we can
work together
no if you don't know what you want from
me i don't want to work with you
um because george is the company in the
advertising team the soup nazi policy
yes that's right no open pilot for you
no open pilots for everybody
who understands how to read code open
pilot's not for people who think they
have to talk to somebody
uh no i'm not flipping the phone uh
the pr department yeah yeah yeah press
secretary right
internal press secretary what is up with
the shields for swift for machine
learning it's stupid
um someone just needs to make
fast python some critical master cars
blah blah blah is tesla watching
who's tesla is elon watching this i
think he's watched some of the comment
yeah
archive clips but he's probably not
watching right now i'm pretty much sure
he's not watching right now
um new segments help lead car detection
help with that too
what tiny car oh we go i don't know man
we realized that partnerships were
stupid uh
sutton bartow i don't know that is can i
do 10 push-ups yeah
but i'm holding a phone not while i'm
holding a phone i can't do 10 one-armed
push-ups
what company do i hate the least you
think how could you
how could you hate spacex man how could
you hate the company that's literally
going to like bring people to mars
you can't hate them is go lying fast
yeah going's fast
way faster than python um
i am not voting in 2020
uh oh the popular rl book i read that
book yeah it's pretty good
why is radar so bad at the technostatic
objects it's not but you have to filter
them out because it gets false positives
um
what about blue origins no it's just
bezos trying to show off his dick size
uh no i don't i don't know about blue
origin um
ordered a comma two for your card they
ship mondays and thursdays
yeah what's our next major milestone
zero eight is a big milestone
all right all right all right i'll let
you in i'll let you in on a spoiler this
is not my spoiler the team was working
on it and i put my foot down and said
no but maybe it'll happen for zero eight
we're thinking of turning the blue to
black
we're thinking of turning the blue to
black what do y'all think about that
uh so that might happen
that might happen i've seen some
mock-ups of the blue of the black
black looks very nice uh
the seven zero seven eleven maybe it
depends it depends on if research team
gets their act together
uh and makes
good stuff and gets the model zero eight
is the new model so zero eight it will
be called zero eight once we have the
new model
pi torch 3d way more data than ever
before
free slurpee version
maps are going to be so accurate that
you can drop a railroad tie
and you'll be within the railroad tie
it's actually pretty accurate
do i think i'm changing the world no do
i think the world is changing
we're always changing it's just so weird
to think that we're always changing
it's in a real friend's song
all right all right if we're up to
complaining about spacex
name then we're over how many segments
is new segnet trained on oh you mean the
model called new segnet
oh it's interesting you call that model
oh that new segnet um
i don't think that many i don't know
uh yeah we're releasing our own car yeah
yeah the comma car
it'll only support the common car we're
gonna drop support for all the other
cars
only the copper car no we're not making
a car
open pallet ever going to be a phone app
no not officially
we don't have enough control
these maps are helpful for some things
mostly navigation
who cares about ghost ghost doesn't
knock off comets three years behind um
you know here's what i'll say about
ghost
ghost there's like a
what is it it's like the the the maybe
the donning krueger effect or one of
those things
where someone is like like they don't
know what they don't know
um but you know i'll leave when i see it
any new comma prime features in the
pipeline when you come here and work on
them
um right now there is sadly nobody
working on common prime features
common prime is kind of sad i know i
know buy it anyway
support us no i mean it works for what
it is
but i want new features i really want
new features
if you want to come here and work on
those new features we'd love to hire you
um give me a job at comm ai work at
comma ai
or if you're really if you think you're
really good
but only if you're really good you can
email george a common ai
uh yeah
thank you all for watching my stream
well if anyone admits that it's not
happening then people are going to be
like i want my money back for full
self-driving elon
uh ghost isn't here
you enjoy your isabelle man enjoy your
isabelle
uh you do need a new job hey come here
it's a nice place to work yeah flagged
events for the accelerometer yeah common
security i want to do that yeah
yeah yeah yeah the first pioneers but
the second coming profits ghost is 3 500
no ghost isn't 3 500 ghost isn't
real stop falling for
shit i could put up a website saying
that i'm going to sell you a jet pack
for 3 500
we're taking pre-orders now jet pack
easy to fly nobody's ever crashed
yeah nobody's ever crashed because we
didn't make any damn jet pack
right believe things when you see them
don't believe it because there's a
website
uh yeah we just posted a new bounty all
you literally have to do
is get python to build on your comma two
and be patient enough to wait 12 hours
for the optimizations
um i'm sure jet packs are real
i've never seen one
uh is mla holistic field i don't
understand the question
is that light blinking on and off i
believe so
oh shit actually that's a good point if
ghost is charging 3 500
damn are things real we can charge at
least 3 000
i think we should raise the price should
i go raise the price tomorrow comma 2
29.99 it's 500 cheaper than fake ghost
it's real and 500 cheaper what do you
all think
you better buy your comma twos right now
i might just i might just fuck around
and raise the price
compared to our compared to our fake
competitor
this is charging 3 500 but something
that isn't real
you can get your comma 2 right now for
29.99
plus plus 1.99 for the harness of course
so it does come out to 3200 all said and
done
but hey it's still 300 bucks cheaper
than ghost
i'm going to raise the price tomorrow
are you allowed to do drugs in common no
i mean i don't want to know about it you
guys always think i'm on drugs i'm
really not
um you will sell your old combat 2 for
1.5 k on ebay yeah appreciating asset
it's an appreciating asset
uh you're allowed to work on your own
projects no
you're here because you want to work and
solve self-driving cars can you go work
on your own projects in your own time
and your own shit sure
um please raise the price see that's
what i'm liking
shit i think it really might go up
should we just make it should we just
make it like
11.99 starting on saturday and see what
happens
i think after we release 008 the price
is going to go up
that's what we're going to do for black
friday instead of a discount
it's going to be you know we're going to
raise the price
uh do common employees have to sign an
nda of course
what it's a normal company
oh use the computer after work time at
comma what you really want to use it to
i'm not even answering this um do you
need to know about open pilot when you
apply for a job it definitely helps
yeah we're going to increase the price i
love raising the price yeah we'll meme
someone into making an article about it
could they please just talk about how
even at 29.99
we're still 500 cheaper than ghost and
we're real
gang gang comment in stocks
wow this almost went for an hour
such a deal that's right so if we raise
the price people just think they're
getting more value that's what i'm
talking about
no you can't work remote well the remote
employees we ever hired were slackers
no remote employees
um
i find bitcoin 10 years ago yo you could
buy like 10 comma 2s right now
will we raise the price and then resell
them on ebay just like 1080s
sorry sorry 3080s and 30 90s you know
yeah we're recruiting of course it's a
normal company you work here you get
paid you get equity and you join the
winning team
uh microsoft permanently last yeah do i
look like microsoft
expensive take cake tastes better than
cheap i love you guys goading me into
raising the price i'm gonna do it
tomorrow
i'm gonna gonna you know what shit i'm
gonna work right now i'm gonna raise the
shopify no
they're 9.99 you get a good deal
san diego is better than san francisco's
dying
do we ask lee code of course of course
be prepared
be prepared to code
comma bundle with random things that
just might happen are you
interested in a 60 pound cyber power ups
we're going to sell you guys remember
the bag of crap on woot we're gonna sell
comma bags of crap whichever around the
office
are you interested in a hundred
honda night act giraffes you just might
get that in the comment bag of crap
um
oh you need part 300x investment no no
no no no no the world's still getting
around to believing parts one and two
uh you are you interested are you
interested in a hundred honda night act
giraffes
email me an offer and i'll hook you up
um not my city san francisco's dying i
moved out
you watched my regex stream
you convinced investors you think we
need investors we got a profit
we convinced people to buy it because
shit man
even at 29.99 we're still 500 that are
cheaper than our cheaper than our
closest fake competitor
all right all right we gotta end the
stream at some point i like your
questions i like the energy in this
stream
this is honesty friday nights um
you know come work at comma tell your
friends man join the winning team you
know you get it now you'll get rich you
get in later you won't get rich you
think you can get rich now working for
microsoft
you can't you join now you watch us take
over the world you get rich
and you build something sick you know
this thing
the comma 2 is a new class of consumer
electronics
sure it's a 3d printed phone and a case
but like you know what is an ipad but an
iphone just made a little bit bigger new
class
um the new nvidia chips are great can i
buy them
no gotta buy them from scalpers on ebay
you'll be buying comma two some scalpers
on ebay after i raise the price to 29.99
uh no we're not hiring for i.t
just for usa we ship worldwide worldwide
anywhere in the world
we will ship you a comma too
open pilot is game changing that's right
to turkey i'll ship to turkey i'll ship
that anyway i don't think i can ship
iraq and iran if it is illegal for us to
ship to you from america we will not
ship to you
i don't think we can ship to cuba but
anywhere else fair game
i'll ship you whatever i don't care
reporting open pile to golang wait you
don't like python
the python it barely even runs python
palettes written in c plus plus
i don't think we're allowed to ship to
north korea i don't know if anyone has
29.99 in disposable income to buy a coma
two with
[Music]
no no we do everything legal boys
there's no geo-fencing it's open source
software
commonwealth on another country streets
no it detects if they're non-american
streets and turns off
of course it works we even have a toggle
so you can drive on the left like the
brits
think we could ship to morocco yeah
is money a problem for a startup not
when you're making bank because you got
a sick product that everyone wants to
buy for 29.99
um
okay all right all right all right we
got we got it's nice to make these
things around hour
we got two more minutes with the seville
theater
check out city boxing
of course we shipped to canada we got a
lot of canadian users you know
someone's got to get to their hockey
game we got you open pilot
what else the canadians do you gotta go
tap your trees and get some maple syrup
yeah we got you open pilot
do a backflip i can't do a backflip i
can do ten push-ups but not with a phone
in my hand
um i did hear a nice song about how
canada's really big
yeah we shipped to australia of course
can i go buy a sandwich yeah probably
probably have to walk a bit more
downtown to get a sandwich
i don't know what park ore is but
parkour yeah sure why not
thoughts on waymo's pr push yeah
seen it before i do 20 push-ups alright
you're pushing it
uh when you're ready to sell to
dealerships we are never gonna hire
sales people
that's never gonna happen
no one wants some massive sensors they
want a small little comma two sized
package
and try a backboard
uh look
all i learned from gym class heroes is
all press is good press kids
you know see but you want to be famous
like kanye west you don't want to be
famous like oprah
yeah you know that that's not this is a
comma stream we're here to talk about
comment and we got 20 more seconds
i'll count you guys off
important big boy um op comma setups as
a service i think there's a few now
don't be a noob i don't know you'll have
to ask lex friedman about when that's
going up
but um thank you all for joining honesty
friday nights
zero eight coming soon zero seven nine
just came out
open pilot gets better all cars that can
ota
stay the same and we're out doing a
backflip
in five four three
two wait i got
yo yo yo
[Music]
it's been a while since we did much
streaming
uh from the road so i thought we'd do
one
people a little bit of time to get in
here youtube's pretty bad about
notifying like twitch is much better
um when you go live we'll have speed go
a little faster
what up leo
uh i've been listening to i've been
listening to high growth handbook
you know uh you gotta learn
when you when you're when you're
starting up this
boys for breakout success they gotta
tell you
about how to do it you know
are you getting it confused with finland
uh
look look there's a person it's in idaho
what up brevin
um yeah it's been a while since we've
done an open pilot cruising stream
um that's a bit fast the speed limit 70.
70. i'm on my way to salt lake city
getting back to work on monday uh
you know got a lot of we got a lot of
growth to do
this year next
um we have some unbelievable things in
the pipeline
uh can you do 80
there's the refactor model branch i was
driving on yesterday it's not as good
there's a few
bugs in the new model but i think we
know what they are and the cool things
it shows like road edges and red
it detects four lanes uh these things
won't be used to actually control the
car but they will be used for mapping
efforts
we're getting back into mapping but
we're doing it
uh in a very cheap way
and then one of the big things that
we're trying to build out next year is
navigation
so by the end of next year it is my
dream
and i'll look at you when i tell you
about my dream it is my dream
that we will have our first trip to taco
bell
without a disengagement
um yeah right now the speed's limited to
73 it's only going 72 there's a tiny
mismatch between the speedometer and the
retail speed
that's less than hyundai than toyota um
[Music]
no not through the drive through not
through the drive-through i'll be happy
if it gets you it's not gonna drive in
the parking lot either but
it's gonna get you to the parking lot of
a taco bell
yeah it's gonna do turns bros
you guys know open pilot can already do
turns if it had enough torque
um just there's you can send uh
you know desires to the model um we have
six desires
there's lane change left lane change
right keep left keep right
the keeps don't really work due to bugs
in the ground truth but the other two
are turn left and turn right
and if you put those in and you have a
car with sufficient torque
um it will make the turn
i believe i mean we've never tried it
it's not that practical yet
um you know you know
[Music]
something something more cameras
something something
all right ready we'll do a lane change
here folks
yeah look at that lane change
speed up a little bit gotta pass this uh
what's that thing carrying it's kind of
like some
some girders building a bridge somewhere
bro
[Music]
so i've been driving i've put almost 2
500 miles on open pilot on this road
trip
um it's almost perf
uh at least for like any boring kind of
roads
i was using it up in the mountains in
colorado very impressed
um places where no stock lane keep in
fact
i did have i did have one place where i
ran into can errors which are hopefully
going to be fixed in the new neo s
so i fell back to the stock hyundai
system
you just can't it's unusable
when you expect a system where touching
the wheel is an anomaly
and not a frequent occurrence is so much
of a different mentality that you have
to be in
you know it's the hardest thing to
convey i think we
i saw that tweet where we showed open
pilot driving through a rainstorm
and like a dense rainstorm like some
florida
some florida downpour kind of rain
uh how do you convey how do you convey
that you're just
so much better than all the stock lane
keeping assist
um so i'm not on i'm this is just master
not on any of the new
um hadeeb's been doing a great job
uh stability reducing cpu usage
one of the things that's going to come
in neos 15 is we're going to down clock
the cpu slightly
so we should be able to get much better
thermals out of these things with a
slightly down clock cpu
uh
messenger tracked i don't know what that
means
but yeah we're chilling if anyone has
questions it's question time i got an
interview
at three i'm in mountain time here
um volvo support oh there are dozens of
you wow doesn't that sounds like
something to commit engineering
to um oh when i was sick in january c
yes no i got an antibody test i don't
think i've had covert
um i think i'm immune though you know
ah i just think i just think like i have
natural natural immunity or something
what's going on here why did everyone
get in that lane
oh because there's a thingy over there
um there are dozens of volvo people
yeah so i don't know about flex right
what i think about the new apple maps
now maps pretty good
my eyes are on the road it would yell at
me if my eyes were
did he yell at me
[Music]
good job uh don't hit any cones you know
be kind of embarrassing if you hit a
cone
yeah you know the new laneless policy
should keep it a little more to the left
here i would like i would like
slightly more left
once we get better with layla's out
we're rolling through a construction
site here
i've got my hand on the wheel right now
that's why i'm getting that beep
i'm just pulling it more to the outside
of the lane than it wants to go right
now
this will be fixed once we depend more
on laneless
so it's a trade-off um
you can trade off like rock solid
stability for being able to deviate
slightly outside of the lanes in cases
like
that uh so
you don't have to explicitly detect the
traffic cones we don't explicitly detect
uh yeah moving over for semis and stuff
yeah
that's um i mean you can switch right
now you can go in and you can disable
the lanes
and it should already do that with the
path but
then it won't feel as stable in the
center of the lanes
so let's try it off uh but we can work
to
to get better at both um with new model
releases you know i've been working
really we've been working really hard on
the new
on the new model um hd maps is good
so the one of the other things the new
model does is the new model doesn't just
have two lanes it has four lanes
as well as two road edges and this is
largely possible thanks to what people
have been doing in the
comma 10k project
so if you check out comma 10k
you can see people
contributing and now it detects tons of
lanes
ah my face is uncertain because the
phone is being held in the way of the
camera
see
wow
jordan peterson as a comma
it's news to me
uh yeah but so once we have once we have
four lane outputs and road edges
we should even be able to use just the q
logs
to stitch together good enough hd maps
we care about lane accuracy for two
reasons um not not we're not going to
use the maps for any kind of um
policy but we can do two things for the
map
we can know where disengagements are
more likely to happen
i think this is going to be a
requirement for level three i think it's
gonna be very hard to do level three
without a large fleet and maps
because or at least some kind of
implicit maps saying
i have been in this lane 10 000 times
and have never made a
mistake ah
so but again it doesn't actually
influence the policy it influences kind
of the meta policy
oh i wish you two kept the chats around
because you guys post and then it goes
away when i look over
um
do you have any ideas why the driving
assistant systems are so bad because
they're very hard to build
um
they're oh we can even up the speed a
little bit um
they're very hard to build there's so
much subtlety that goes into it
for example uh so unfortunately
my windshield got hit by a rock and you
can see my crack in the windshield right
so this sucks because you know we're
gonna have to get the windshield
replaced
and replacing the windshield requires
recalibration of the factory eight ass
camera
and it's because they just you know they
didn't write a good calibration routine
it's something we put a lot of time into
um there's a ton of subtlety in being
able to deal with banked roads
uh there's a lot of subtlety in what the
definition of elaine is
if you're trying to do things based on
lanes and cars you will hit a ceiling
pretty fast
i think the ceiling on lanes and cars is
super cruise
like if you're using lanes and cars
explicitly you can never build something
better than supercruise
and you'll always be you always have to
geofence to places like this
uh was this road uses training data
honestly i have no idea
we don't really track that that doesn't
matter
um but it works
uh make sure we don't we don't actually
explicitly exclude roads in the test
uh where's the cowboy hats in the
backseat
drive around with the cowboy hat oh
i don't want to bring back general chat
i think i think that as we grow we need
more structure in the discord
i think there's lots of places online to
should talk about self-driving cars
uh what gpus we use for not are not a
data center
well well in our in our in our in our
small research cluster
we use 1080 ti's
and i would love to have some 30 80s but
i don't know if you guys followed that
this morning
what a fiasco did i buy all the 30 80s i
wish
i don't think we got a single 30 80. um
despite everybody waking up
the speed limit's 55 hanging i'm going
to slow down here
despite everybody waking up and trying
to get their orders in
and we all spammed the website we spam
best buy
i don't know i don't think there were
any 3080s i think it was just a troll
they just went to nvidia employees
all right hang on i gotta pay attention
here
more so than usual how do i use cuadro's
how rich you think i am you know we
didn't we didn't we didn't raise buku
dollars
what's your weibo question again sorry
let me just
i gotta deal with this we gotta uh we're
we're driving
into a construction zone
i mean i don't have to deal with i'm not
doing anything but we just gotta pay
extra careful vigilant attention we
don't wanna hit a cone you know the cone
would feel bad
you see i wish our policy could move us
slightly more to the left side of the
lane here
not bad and it will do it here look oh
it does it so well there oh look when
the lane lines disappear oh
that was beautiful um
but yeah like one of those cones was
slightly out in the road you can see the
car in front of me has moved over maybe
maybe 20 30 centimeters
um i wish you two kept the chat around
because i'd like to respond to all your
things but i'm gonna miss them because i
can't really look at the chat right now
so watch it's going to move over here
it's going to move over oh so nice
so nice let me get it back in this lane
get my speed back up
sometime i feel when i'm driving with
open pilot i feel like i'm a conductor
you know
what was your question
if you just literally paste the same
thing again i know it sucks but you do
i start with my own pc as a training
machine oh yeah
yeah the first thing was training on one
titan x that i had in my machine
the driver facing camera be fooled by
the sunglasses it's not gonna track your
eyes so yeah i mean
um if you if you manage to fall asleep
staying you can't see through the
sunglasses
uh so if you manage to fall asleep
looking perfectly straight with
sunglasses
it won't catch you um
but no i mean you can it still detects i
think you saw it you saw trigger on me a
few times
we use meta reinforcement learning i'm
not sure what that is
uh so we're closer to level five yeah
yeah we're very exclusive thank you
waymo question why does waymo not use
mu0 stuff ah
next year we're really moving into museo
stuff
the the big thing on top of my board
in my office is thinking and vision
features
um we made up we made a hire uh recently
too
who's gonna who's gonna pie torch expert
he's gonna help with this stuff
we are how does it behave with no lane
lines
sometimes it behaves better i mean if
you saw if you saw that cone scenario it
actually behaved better
uh when it has the lane lines it uses
them to enforce dead center
we'll we'll figure out ways to trade off
this policy nicely um
humans look at look at this guy like
look at this guy in front he just
drifted over the lane line
uh and you know you'd be upset if your
open pilot did that
so it's
again put a mimic human policy exactly
but we'll figure it out
oh my hackers they're not real uh thank
you
where does comma ai fit now that car
drivers are working on their own
self-driving they've been working on
their own self-driving for five years
the problem
the problem is and i've been listening
to high growth handbook and it becomes
really obvious what the problem is
um
let's imagine you wanted to paint the
sistine chapel
right and you're not even a clever
startup
you're you're waymo right or cruz you're
you're you're like look at calvo right
you know he had success in the past with
startups he has the startup mentalities
and and it's no longer disruption if
you're inside of this box
right there can't be formulaic
disruption that's an oxymoron
and self-driving cars
are not going to be solvable by a team
that views their people
almost as like fungible tokens
the the approaches that worked
previously to managing software
engineers are no longer going to work uh
when we have
things that aren't just there's no more
boilerplate code anymore
um boilerplate code has all been
replaced by
well we've gotten to a very high level
of abstraction with things
uh you know the just just the python
ecosystem and the
um did will have ever get as a dark
modded
uh yeah i think he did um
you're if you're a skilled reverse
engineer you too can have a torque
modded car
um there's almost no more boilerplate
code
and in with machine learning it doesn't
require a lot of code it requires a
small amount of very good code
so of course yeah ml is holistic
exactly and it's holistic nature
just like building a great piece of art
imagine the statue of david was made
by a committee it wouldn't be beautiful
it wouldn't be good it wouldn't be
quality and that's what you get from
these companies
they're built by committees the person
who builds the lane detectors not the
person who built the car detector who
builds a cone detector
who builds it just yeah
there's not enough you know you can't
build this like you build crud apps
um do i think open pile is beautiful
yeah
uh i think
[Music]
it you know it wasn't at the beginning
at the beginning
it was kind of stupid code um
oh this guy's going mad slob should we
change lanes around them
like 50 miles an hour i don't know
um yeah i think this whole thing
comma itself it's a work of art
you know what kind of what kind of a
company is this
right it's a hacker company it's a
company founded on the principles watch
this
lane change without even a lane line oh
that's unreal oh
how does it do that what is a lane
change without lane line
oh how are you going to put that in your
definition manual delphi
pro tip you can't
[Music]
oh yeah look now cruising around these
people let's go
i'm just gonna steer right to start the
lane change
let my car do the rest
exactly exactly
um well hacker culture has has
values that i think are very amenable to
solving this problem
uh hacker culture doesn't have if you're
trying to build like an e-commerce
platform to empower
no that's not built by hackers
built by psychopaths man
when you look when you look and i've
read the code for all of them
when you look at the code for windows
and the code for mac os and the code for
linux
windows and mac os windows especially
windows is so
unreadable it is so
inelegant and you can tell
that it was
not built by people who don't really
care
um and there's a reason linux is taking
over the world it took a long time but
[Music]
better there remember mac os is is open
source
um at least the kernel is and
it's better but it still has deep
inelegance about it
um well so predicting the next frame the
problem
with predicting the next frame is what's
your loss function
[Music]
your loss function can't be the beauty
of predicting the next letter is
categorical cross-entropy
is so good
um what's zero i don't know what that is
but yeah we're moving a lot more to
thinking in vision figures
uh implementing some museum stuff
dynamics models
we have to rewrite everything open
palette is a project and it will
eventually be done
right or at least feature completely
the last feature
um we're going to have to have
navigation
[Music]
um and the the second part of that
mission the shipping uh delivering
shippable intermediaries is kind of just
to keep us
honest right sometimes i get a little
too
pie in the sky when i'm like oh it's all
going to be one magic trick it's all
going to be one mu zero
um but i mean you might see that and
that's how deep mine may look externally
but i'm sure there were many iterations
that they didn't publish of those things
and i figure you know why not publish
them switching from c
plus plus to c who would code and see
anymore
all right stuff even pilot is
is python open pilot is mostly c plus
plus
it is true that the main control loop is
still in python now
but there's no reason not to
we had a phone mount we should put those
in all our cars
i will auto tuning use lqr and the pid
controller is mostly fine
how's the navigation app going we're
still hiring
uh for it no we're not implementing
counterfactuals yet and i think even the
first round of the dynamics model still
won't
um the counterfact our current
loss function probably doesn't support
counterfactuals
we know how to do it but you know it's
all gradual
level 5 is not really more of an
insurance issue if you build something
that's 10x better than people
insurance is easy no rear view camera
have i tried rust you know rust is the
new haskell
controversial opinion rust is the new
haskell and it's going to go the way of
haskell
go is inelegant crap yet you know
[Music]
got a big following rust is beautiful
and elegant so is haskell
um dynamic follow distance no i'm not
implementing anything like that
you guys are just gonna if you want that
you're just gonna have to wait for nth
and longitudinal
and to wait for antenna longitudinal
you're first going to have to wait for
true end to end lateral
like we have an end-to-end lateral
policy but it's not yet good enough to
completely remove the lane lines
that's going to be the first step
harold's always saying there is no
reason why our car does not drive
perfectly on a highway without lanes
and he's right uh so you know until we
solve that problem
i'll walk before you can run my speed
limit went down apparently
now this is this is where they love to
pull you over you know this is
this is where they're like oh yeah so we
would make the speed limit
very fast and then we'll make it very
slow for no apparent reason except that
we can have our cops sit there and give
tickets so you know we gotta uh
[Music]
all right all right
and then we have to get on the 15
south
oh we're going to go to argo really
try to meet their quota uh yeah we think
mapbox will be involved
the navigation stuff is very early on um
if you're interested in working on that
we are
hiring aggressively for that we
basically have to build
out that team from scratch i think it's
going to be a three or four person team
uh who's going to come to own all of the
open pilot uh ui
uh ux and and navigation and making sure
it integrates seamlessly
[Music]
and then we think what you're going to
do we'll be able to enter your
destination
from the uh
from the device but we think most people
are just going to use the comma app
um you know i think hopefully we can
like work with apple to get
integrated as a navigation app hopefully
that's not too hard
and like if you're in like airbnb you
could just say like you know
navigate with comma why is the city
listed on the home screen always wrong
nobody works on that shit i'm sorry um
it's all kind of terrible no one works
on it
uh we're hiring we have money now we
have profit now
uh we'd love to hire yeah well there's a
common app hopefully you guys already
have it you'll just be able to like
click on your car
and then you'll have like a default car
selected so you'll just
it'll be from your phone it's kind of
the point of the experience and the
phone will kind of push it to the device
and the device will do the navigation
for you
yeah we've been profitable or close to
profitable all year
uh we had an actually profitable q1
um our q2 we ended up with more money in
the bank account that we started it with
but partially that was thanks to um you
know free government money
uh and then things look good for q3
where we're spending there's a lot of
layout in q3
uh for a new
now for your watch the real
legit linux phone oh speed limit 80 hell
yeah bros
oh let's go fast
uh have any car manufacturers shown
interest they have no idea how to do it
uh yeah of course they've shown interest
they have no idea how to show interest
properly
um they show interest by reaching out
through their business development arm
and that's not going to work um the way
that
they're actually going to show interest
is they're going to get ignored
repeatedly when their stupid business
development arm reaches out because you
know what
and i'll say it wow maybe this is not
that appropriate for a work stream but
kona's not their bitch
you know a lot of companies think
startups are their bitch
and they think oh this startup oh their
startup will we'll we'll take whatever
little crumbs we want to give them
no i'm gonna disrupt you
you know think about this can we buy
ford
i mean how much do we have to grow in
order to buy ford
[Laughter]
you know well actually the other
question is how much does ford have to
shrink
for us to buy ford right we grow for
drinks natural order of things
you think i'm responding to some
low-level bd person who's like
we are very interested in what you're
doing if you could please schedule a
call so we could learn more
i'm not educating you for free man
thousand bucks thousand bucks i'm happy
to educate you but it's a thousand bucks
um phone calls have been a hot selling
item
but now you can say like look look this
is arrogance right like why are you
talking like this you know
uh obviously but i mean look at tesla
right look at tesla imagine tesla was
like
well all we want to do is supply
batteries and drive trains to bmw
no why do that
um oh well and then yeah that's the
other aspect of it too i'm not sure
these business peop business development
people are actually interested at all
in integrating open pilot in next year's
toyota corolla or even the toyota
corolla five years from now
they want to declare partnerships so
they can like they play some like stupid
game that i don't really understand
um so no i mean here's how it's going to
work
um what's going to happen
is and it is already happening in some
companies you know we track this better
than they think
uh i think
i think every major car company now has
bought common devices
um and their engineers are going to
start
you know one of their engineering
managers
is is going to hear about this and
they're going to have a team the
exploratory team for open pilot
and the exploratory team for mobile is
going to try to get open
pilot working on their car or they're
going to reverse engineer it they're
going to read the code
and then when these people reach out
these are the people who are going to
talk to
these are the people who i'm interested
in talking to once
they have shown that they have like a
serious team of a couple of engineers
working on open pilot integration with
the car
we'd love to work with you and here's
how we're going to work with you get up
you know wow wouldn't it be great if
toyota submitted a pull request
little thing on the hyundai actually let
me see if it's fixed there's a chance
fixed upstream if i
tap no it's still broken um so if i tap
the blinker
the blinker state that we're actually
measuring for the hyundai's
is whether the physical blinker is
depressed not whether the light is
blinking
so i can't do a tap lane change on the
hyundai um
this is my very minor bug uh it has no
it has no real
implications um but it'd be nice it was
fixed in fact if someone wants to submit
a pull request for it now
uh i'd appreciate that but wouldn't it
be great
uh see so when i tap you see that steer
left to start lane change only appears
for such a short amount of time
even though the blinker keeps going
wouldn't it be great if hyundai
submitted a pull request to fix that
um yeah
that's that's how i'd like to work with
these companies
and then start okay you want to start
building your own open pilot hardware to
integrate or you want to make open pilot
work on your hardware
we're happy to work with you on that
like i'm interested in working with you
on that but you have to come to me
speaking that language
i mean if you come to me speaking a
different sort of language
uh it's you know we have no interest
kama has zero interest
in in in working with those kind of
people because hey
it's
really a brokenness in their org
structures and
some companies are going to be able to
fix this brokenness
uh and they're going to succeed and
there are still going to be car
companies around
you know samsung made phones long before
android um
i think even huawei used to make like
like bar phones that were clones of
nokia or something i'm not exactly sure
about that but um
acceptance rate is like two percent are
you mean for comma yeah it's harder to
get into common than harvard
um
watch out for nails on the road well i
got hit by a rock in montana
all right we're gonna we're gonna we're
gonna do a passing maneuver here
let's go
auto lane change does my arm i'm not
getting tired it's getting a little
tired
um thank you sucking terence tower all
right all right
what would the world do with the
non-geniuses all right they're off topic
off topic off topic
no i don't think the crack can be filled
because it's longer than a dollar bill
that's what they say
why do you need gps returning we don't
um
gps is not the gps is used for um
it's just used for calibration really
i feel negatively about a video buying
arm for the reasons that everybody else
has talked about it
would you work with corporates that have
dedicated innovation labs no
i mean if they if they reach out if
toyota innovation lab reaches out
i i think those companies are structured
in a way
that those things are basically vanity
projects uh
no i mean look our company com is a
mission driven company
um we're not we're not focused on uh you
know maximizing revenue or maximizing
profit or maximizing prestige or we're
focused on
solving self-driving cars um they're
part of
solving self-driving cars there is a
technical aspect to it there's a
deployment aspect to it
if you have one self-driving car you can
kind of say you solved it you know
obviously i'd like to
to ship it um our old slogan was ghost
riding for the masses
uh can i ran a bit about tensorflow yeah
we're switching it by torch
see it tensorflow
um let's move let's let's let's move the
phone
over here for a little bit yeah but then
you guys can't see the open pilot you
see
i mean if we continually show the
product on stream by the way
if you guys haven't bought one yet buy a
comma two they're 999 dollars
uh do we need a designer only if you can
code
um like just just somebody who stops at
the figma sketches no
but if you can take that and you can um
implement that in qt or html5
yeah we're interested and you go through
a different process
then uh yeah reach out um you go through
a different process we're not going to
put you through aggressive programming
challenges
maybe we'll do some like storyboarding
kind of stuff uh
yeah but yeah if you can code
if you have yeah like like you think you
could do qt or react or that kind of
stuff
we're interested total miles driven by
open pilot
uh i think the website says 25 million
we're probably close to 30. it goes
really fast now
i mean i added i added 3 000 myself
at least i will by the time this trip's
over
uh yeah i think nvidia's purchasing of
arm is going to accelerate the adoption
of risk
five
react react native well
it's all the same
utilize all the driving data no um our
current model is trained on i think this
model is trending like 250 000
segments so it's 250 uh thousand minutes
of driving
the new one is 400 and hopefully by the
end of the year we'll be at a million
high precision gps is needed for
calibration to understand
how the car is moving through space you
can do this with other sensors but
the gps just helps a lot um
[Music]
harold explained this to me you know i
wanted to use like visual odometry to do
a lot more stuff
and then like we looked at the drift of
visual odometry even in the
state-of-the-art papers
kind of has exceeded the state of the
art now we do have the best pose net in
the world by far
but um opposed net isn't like we know
how the car moves like that
but it's still uh nothing over any sort
of distance compared to gps
uh yeah we going fast this is good this
is good we're making progress
a salt lake city tonight i love when the
arrival you know the arrival has been
ticking down
i do have to stop for lunch at some
point and i also have a phone call
at three with a candidate
my dead reckoning you can dead reckon
nick and dad reckon very well
but you know it's always nice to have a
gps
uh to help you out yeah pigeons they're
integrated in everything
uh we ship it's the same the same gps
that was in the gray pandas in the
is in the comma two yeah we're doing
fine
uh how does the loss curve look over
increasing distance
on a road like this you'll get out too
so we go to 192 meters
or 10 seconds
um oh the stream of what a software
engineer does this is twitch you know
this is youtube this is comma related
you know
you realize something our investors
don't really care about us you know
they're still look
basically invested in waymo look at that
right
just shows that i mean do you believe in
disruption or not
every time every time you hear this
every time you hear this
where it's like this is it man these
tech companies they're going to be
unstoppable
no they're not
right google facebook like wow
okay you people are like oh but
microsoft and apple are still around
yeah but for every microsoft and apple
there's all those 90 error companies
90s era tech companies that are not
around anymore
right like you picked the two that
succeeded there's so much survivorship
bias
right these companies are all going to
fail at some point
oh but google they're unstoppable they
acquire all their competition
google can't even recognize their
competition
um yo okay i will i will chill for a
second by the way if any of you guys
have used uniswap
ever you can go get 400 free unicoins
i got like my upi last night i'm just
hanging out last night
and i got i made like um thirty five
hundred dollars in
free crypto that was handed out by
uniswap you know like this shit's all
the future man
and i love i love the disdain and the
mockery for uniswap on some of those
things you guys took vc money it's
disgusting
you know sushi swap didn't take any pc
money
i love it you know i love it you're
seeing the future already
um it was uh someone on twitter
you know i forgot i forgot exactly what
it was it was a little it was little out
there
um but they said like
you no longer have the the market
selection procedures
no longer work at all to determine
what's good
um all you have is kind of consensus
and comma is that consensus
the future is written in salinity
salinity is here to stay for way longer
than we'd like
you know like viper's not going to get
traction there's going to be formal
analysis tools around solidity
i i'd only go off a tangent to my crypto
but
i'm very bullish on the space
why won't we support grey panda forever
um because of fingerprinting 1.0
grey pandas are going to go away pretty
soon black pandas
as much as i want to deprecate eons
i mean eon classics will be deprecated
um gray pandas will be deprecated black
pandas and an eon gold
you know we're going to become
the only problem that you're going to
run into with the black panda and the on
gold
is we're going to become more aggressive
about the wheel touch at night
driving alone to relax man big driving
chills chill
why not fly it's not about the
destination it's about the journey
but i think nvidia buying arm is a
threat to the industry no
i think i think that what nvidia buying
arm is going to do
risk 5 is coming around just in time
you know chris lattner is now working at
uh si5
to build tooling around that stuff um
in a way if you've heard about like
accelerationist philosophy
nvidia buying arm is just going to lead
to arms demise
faster
you didn't believe i'm driving with
autopilot take a look
i haven't touched the wheel in forever
you don't believe
believe believe believe believe believe
um
i would feel better knowing that it was
like monitoring that truck next to me
it's not like if that truck swerved a
little
it should swerve too and you know you
know multi-camera multi-camera blah blah
blah blah or something like that yeah
all right let's get past this truck
blinker touch
on blinker
is comma just a meme no comma's an
incredible piece of software
have i seen silicon valley yeah
yeah yeah yeah multi-cam yeah yeah guys
we're gonna build multicam eventually
we're not ready yet
we're not ready there's so much
improvement still to be done with a
single camera
thinking of vision features if you can't
solve the problems with a single camera
multi-camera's not going to help you do
you need multi-camera
yes but we have multi-camera sure get
ready to pay out the ass for
you know it's going to cost a lot of
money
um you know what you can decide i mean
we're gonna let the consumers decide do
you
we're gonna sell common tools for a long
time um
comma twos comma twos are here to stay
for a while like i said it's 1.0
hardware
um you know people are like oh the
thermal issues the thermal issues
we're fixing them in the next neo s with
uh
with uh a slight down clock to the cpu
i don't put anything on the roof as soon
as you're outside the cabin you expose
yourself to
all sorts of annoyances
well the thermals you have to tolerate
out there or even crazier
i mean that's that's operating thermals
not just uh
i mean at least we can say system
overheated uh and we can fall until
because you know
it turns out electronics are comfortable
in the same range as humans the same
like temperature range
um i wonder why that is what if that's a
fundamental fact about the universe or
if that's
uh yeah you know you only lie to
yourself
um if you fake things yeah no and we're
gonna
we're gonna let people decide right if
you think of the comma two as like ap1
hardware
uh is there eventually gonna be ap2
style hardware yeah it's gonna cost more
your company a billionaire probably
probably not yet um
so a we have a very hard
lower bound on comma's valuation at 200
million
i'm not going to go into y but that is a
very real lower bound
um upper bound on comma's valuation
you can make arguments for a billion i
think next year billion is going to
become
even more obvious and is going to become
kind of the
accepted valuation maybe even a little
bit higher
uh if we get some of these things
working thinking and vision features
works
you know
um if by design more expensive yeah yeah
you want to buy the parts that are rated
for higher temperature ranges they cost
more
[Music]
all that sort of stuff
no computer can work on venus i don't
think that's
true i mean you just have to
i think you'll just have to build like a
cabin for it right
i don't know i don't know what the
fundamental limitations are for like
designing high temperature silicon
and stuff
um
i'm holding the wheel a little bit
because i don't want to hit a cone
yeah it's a dash cap and that beeps and
that shouldn't be
i was complaining about why that beeps
we're gonna get better at it
willa mentioned the alert reduction
project for zero eight we're gonna try
to reduce the number of asparagus alerts
i don't know that much about graphene
no nothing roof mounted nothing goes on
the roof you know you know do you know
how happy
our localization team would be if we
could put the gps antenna on the roof oh
they'd be so happy you know
you lose the signal is so attenuated by
the shady windshield
but yeah i'm not holding the wheel
anymore
i'm like if it hits a cone it's a cone
it's like an icon
uh does it record the driver facing
camera recording is optional
what they closed the highway
all right i gotta go i gotta figure out
why the highway is closed
thank you all for watching
um we'll close the highway
i gotta figure out how to get around
this um maybe now's about time to eat
some lunch too
all right thank you all for watching
we appreciate all of you we are hiring
especially if you're interested in
building navigation
give me a job at comet ai um
or coming i slash jobs or if you think
you're really good just email me
uh georgia coming out again
bye
you
that's not the right camera
just I'm just posting up that was
shelling yo this is something you can do
this is something that you can do to
help right now there we go
you know fire blasts what's up hey
what's up yo welcome hi guys so what
we're here to show for today
it's called pencil there's been a lot of
people already hard at work so you can
go to our github URL right here uh
that's github calm / comment / Tomic
comma 10k and its 10k images for
training cigarettes yes it's comma
colouring 2.0 it's comma color 2.0 so
tesla has this thing called data engine
car path he loves to talk about it he
talks about it a lot of talks we of
course are too poor to afford a data
engine so we're relying on the kindness
of strangers and these strangers over
here this is our discord if you don't
know it's a discord comedy I have been
incredibly kind we're gonna go over to
comma pencil and they've already labeled
the first thousand images for us so we
can go through we can just take a look
at some of these here what's up Previn
they're really they're really beautiful
I think and it's easy because you don't
have to label things too many different
colors alright so um if I go here by the
way this is all open source so unlike
with comma pencil any work you do here
is available for anybody to use for any
purpose under the MIT license you see I
can go winning out here so one of the
beautiful things about comma segments is
we don't have many classes we don't have
many different kinds of stuff that you
have to label you don't need to know the
difference between someone who likes
watermelon and someone who doesn't like
watermelon or maybe those are three
different types of categories or you
know what's the difference between a
truck
and a pickup truck all right when is it
a truck when is it a car I don't know
but what I do know is that commas
categories are very simple five
categories see this purple here this
category is called my car anything that
is inside of your car and moves with you
some guy put a pizza box on the
windshield this is the my car category
this red here is a lane line we have
lane lines that dark brown is a road we
have everything else oh yes well the
green is movable so that's like cars and
pedestrians and horses anything else
that moves and then there's everything
else which is just that that grey there
all right
so yeah I mean you can see this is just
labeled from our users right here on our
github remember all this is open source
so we're going for ten thousand images
we're up to the number labeled so far
know what happened don't modify the
images folder oh we got a we fix the
test cuz I modified the images folder
but
that is how many we've labeled so far
ten that 1049 images so you can like
look at them they're really beautiful
you guys can look at me for a minute
I'm George my name is George when you
are on the internet sometimes and you
can find me on how many I just scored
well you can come help out right now
with the comet a eyepencil project while
I come fix this test we're going to fix
this test don't modify the image fall
that way what oh no
I need somebody else to fix this I don't
know how to fix that don't modify the
images follow thank you thank you I wish
we're just going in here we're gonna
we're gonna you guys want to see the
keyboard and I love seeing the qiblah
oh I'm just gonna go over got we gotta
fix this test because I don't want
people thinking that my test is broken
just puts just sad
oh this wasn't the right way to fix this
[Music]
just do it like that perfect see if this
one works so alright guys we fixed the
tests now we can get back to comma
penciling with you guys check out how
beautiful this image looks look at that
every little lane line right where it
belongs
and you guys can contribute to this huge
corpus of work that's publicly up on
github and is about to now have tests
that pass let's say if the tests pass
fix tests did I fix the tests oh I don't
know we're gonna find out so you ask
yourself how do I contribute to this and
Eric B has written this tool that you
guys can use called Image labeler
um image labels like the comma pencil
tool but it's better uh you can type in
like say I want to go to 50 or show the
existing mask this one's already really
well labeled but I can go to one that
like isn't labeled yet let's go to 1600
I'll show the existing mask for that oh
look at that look at that bug it's
really obvious you know especially if I
lower this down
no I don't you know it's not a bug no no
nevermind it's not obvious it's oh yeah
look okay you can see it you can see it
if the mass capacity is not that high
you see here this is actually not a part
of the truck it's a part of my car so I
can just go select my car here
go around this yeah yeah beautiful I
don't know if I see any other bugs with
this I think there might be some stuff
on labeled over here let's zoom in yeah
I think that's supposed to be a car
doesn't that look like a freight truck
to you I will just got a moveable label
this guy movable
drag those out a little bit well I want
to do that yeah yeah drag that there all
right cool all right
oh my there's like a little blah cheese
over there that aren't great but either
way this is a whole lot better than what
we had so when I'm ready I can just save
this mask it's downloaded here and then
you can commit that math on github I can
use the up and down arrows to change
opacity oh that's nice
awesome quality software oh yo Edwin
knows what's up um so yeah now I've made
this mask and now I you know if you're
gonna do it you should put a lot more
love and care and do it than I did we
really want these masks to be pixel
accurate and not have splotches like
that this is too low quality to commit
to our repo right over here in the comma
discord over in the comma pencil channel
and you guys can come help out so you
know Tesla has this they call it data
engine we don't have data engine because
we're poor guys we're poor comma doesn't
have a lot of money if you want to give
us money go to shop comment on the I and
by comma twos but I got the tool use pin
to all we should definitely do that oh
that's a good point yeah let me just so
I'm Eric B wrote this on discord it's a
great tool if he's doing a great job PGA
Laos done tons to you know actually
labeling images himself getting all this
stuff merging on github virtually Chris
has been helping out that got we've got
a great crew
shoutout to John Smith for buying a seat
- did you buy a commentator just buy
right now anyone who buys one right now
on this livestream I will shout you out
I will shout you out John Smith's cuz
play Oh guys guess what we sold today my
love would we sell these ok so I don't
know if you guys have been to comma a I
slash services but we sell some
ridiculously overpriced services to
people and we sold a meeting today we
sold a 30-minute phone call for $1000
John Smith bought one for one I don't
know my shout fight doesn't scroll back
that far that was so long ago um now you
know people aren't people aren't driving
as lunch with the UH you bought one
yesterday Michael horn no no I can I can
I can see you if you bought one
yesterday you did buy one yesterday Wow
oh yeah I'll ship tomorrow uh no I'm not
gonna show ya 30 minutes for $1,000
phone nope we're building something
incredible right now there's a quick
picture of it up on the discord but all
the comma twos that ship out from now on
are gonna have stress testing that's
super important but remember how can you
contribute oh I can't show you Shopify
um but I can show you comma 10k how can
you contribute go to this github URL
actually do I fix the tests well I fixed
that don't modify the images photos
that's good
the images are really honestly beautiful
so these are the ones that have already
been labeled now we can get to some of
them that haven't been labeled yet
yeah yeah so like these ones
well this one was automatically
generated so you can see that it's quite
good um so this this is an automatically
generated mask which means we just ran
it through the the comma automatic so if
you see that's quite good here it's
quite good here but it did miss this car
over here so you know we need somebody
to go in and just label that car maybe
that edge should be cleaned up a little
that's a little it's a little janky
looking yeah I don't know maybe that's
okay uh what do we have here again these
ones are all completely labeled by the
computer this one looks very good
already I don't know if there's any
problems with that one the only problem
I see is that if you zoom in here
there's a little bit of a little bit of
red there now remember that we don't
label crosswalks as Lane lines because
they're not lay mines they're crosswalks
now what do we got here oh this one's
pretty bad so you look at this unlabeled
Lane here remember every bug you see in
these images is a bug in open pilot so
every bug that you fix is a bug that
gets fixed and open pilot we're gonna
use this to regenerate all of our ground
truth once we have this segment um so if
you guys come a to our github come to
our discord remember that's discord
comedy I come in this channel right now
I'll post what you chatting on screen
right here yeah but people will help you
I know that we're gonna get play of this
later people will help you get set up
what is a segment a Sigma it's just
something that automatically labels that
so it's the machine that I use to
automatically generate this mask so
remember this one again and was
automatically generated by the machine
and that's why it's not perfect where
the human ones were much higher quality
cuz see it's not really a lame there
it's missing a little lane here that
stuff still all a road this one looks
pretty good it was like blotchy stuff
and that's a bug down there you see that
should be my car I should be part ball
again we're missing a center lane line
you know
ever had open pilot not detect your
center lane line well you can fix this
right now by contributing to common
pencil we're apparently missing an
entire semi every time you label a
picture the AI gets better exactly
exactly
you guys can contribute guys can label
data help me out this is the thing that
I've been using to test them off you
guys heard about big model look at big
model this is what the model currently
sees this is big model you know it's
like an ad for a widescreen camera we're
missing an entire salmon you guys want
to see we're missing an entire semi
what do you do if someone missed labels
we don't merge your pull request so this
is on github we have a system we are a
complex system place of checks and
balances we have an executive branch
allege no so like here this one ah see
and now we have virtually Chris came in
here on our public github here and it
was fine for you and it tries to put you
in another Lane well you guys you know
contribute see look look look look at
the detail here look at the detail
that's being called out all this is
incredible
see this is the kind of quality that's
gonna make open pilots so good I've been
super impressed with people's attention
to detail here uh yeah virtually Chris
has really been the guardian of the
guardian of quality so if you submit
something that's bad someone will call
you out on it and we'll get you to it
will get you to fix it up but yeah oh
yes you don't wish you were missing up
those people should be green and they're
not green those lane lines should be
colored an they're not colored an oh
this is pretty bad this one's pretty bad
we can do better here guys we can do
better you guys can do better we label
this one all this one's crispy
I just want to cite from like a few
mislabeled ley lines far off in the
distance that looks pretty perfect
this one's very good um big improvements
already one of the big improvements that
we didn't have before was all these
things used to not be labeled cars now
they're being labelled cars thanks to
thanks to people labeling them so that's
really nice
so few labels yeah we don't need a lot
of labels we're not Tesla is there no
way to use tinfoil contacts to improve
segmentation while moving so we actually
do that um we actually do the only
reason do we do some tutorials come into
common pencil and people will help you
get started um so we use temporal
context in the final ground-truthing
model like in the in the Ottoman so
these models are used as a component of
our automatic ground-truthing system for
the big models and the fact that they've
worked at all even with the super low
quality of data we've had is testament
to how good that temporal smoothing
works we don't want to put that temporal
smoothing in here because then you're
gonna get to poor correlation the beauty
of this is it's iid so we can you know
you can it's much easier to train models
when things are ID and you don't have to
deal with you know if you're gonna put
it into a filter later right like you if
you're gonna put some in a cow in felt
if you don't want to become poorly
correlated so that's why we do this like
this we don't try to exploit temporal
information here uh yeah let's look at a
few more let's call it a few more about
this one see this one is almost perfect
the only thing I would say here uh well
I wouldn't label those things Road
though they kind of are Road driveways
kind of our roads sometimes I don't know
I don't know if I'd call that a driveway
I don't know what people have been doing
coming to come with pencil and ask about
that um any thoughts about the
University of Toronto software and
Carcross I don't know anything about it
oh there's a bug there look that
shouldn't be powerful that's not part of
your car it's just a splotch on the road
leaned that up
that's that image by the way if you want
to come off yet hub right now fix that
one that one can be yours to fix for the
low price of zero dollars and cleanup
that maybe maybe add a little more I
think that Lane goes out a little bit
more I think you can kind of see it if
we zoom in a little bit there oh yeah oh
wow we're missing a vehicle off in the
distance oh that could be bad that could
be bad we want to definitely get that
vehicle labeled
yeah let's see that shouldn't be that
shouldn't be rode there
oh look at that one little lanes watch
never did a pretty good job with his
vehicles they remember these are the
ones they're being automatically
generated so if we look back at some of
the ones that were human labeled the
humans have really done a great job look
at this I don't know I bet we can't find
any bugs they've done a great job look
even got like a car over here and stuff
um so yet big props the humans because
really like how good this is saying in
machine learning
it's called garbage in garbage out but
you can take that saying and you can
also say quality in quality out maybe if
your machine learning is good you might
get garbage out but if you put quality
and that's where you got to start cars
and trucks green yeah the color standard
so the colors are all listed in the in
the readme here and we talked about what
the categories are here so oh yes you
guys are correcting the AI um the
categories are pretty simple so there is
no more we don't care about sky we don't
care about signs in traffic lights
anymore we just care about five
categories road lane markings
undriveable moveable and my car so Road
is all parts anyone nobody would look at
you funny for driving the driveway looks
real private know if a parking lot yes
don't include non lane markings
undriveable is anything you can't drive
on like the sky or like a concrete
barrier movable are like people and
vehicles and signs are also undriveable
right hand countries work fine yes
absolutely you know and on my desk
we've yawns and common tools was that
this new hardware um I have a neon
because oh no I did make a change today
notice how it doesn't say panda anymore
it says vehicle no GPS I'm not sure you
guys can really see it but this is
actually yellow because you're gonna
need to cuz this is a white panda this
is the greatest project you've heard
about so far thank you thank you so my
white panda and my comedy bug
no new hiver yeah so if you guys can
come onto our discord somebody will help
you out and yeah that's pretty much all
I have to say oh yeah if you want to
schedule a meeting
it's $1,000 we sold a meeting today I'm
so happy I love him we still meetings a
great victory so I might be meeting
tomorrow my $1,000 phone call
any idea why your Don your ego has your
default location wrong bro I don't know
I didn't write that code source check
that check source code check the check
the source all right cool any other
things for this dream well just look at
a bunch more pictures while we answer
any last questions beautiful these are
human label this is this is a testament
to what humans can do when they're
motivated look look at how far those
Lane goes oh yeah yeah beautiful is
there a channel yeah it's called kama
pencil in discord in the comedy hi
community discord yeah ah Oh beautiful
beautiful look at that look at that blue
reflection Oh still a vehicle 10,000
images to label yeah I mean so the thing
about 10,000 images it's already getting
a whole lot easier to label the images I
think by the time we're at the last
thousand we're gonna have to change
maybe a hundred of them and I think nine
hundred them are already gonna be
labeled completely correctly so we're
doing this iteratively I'll show you
yeah
let me find what I'm looking for this
one so you can see this is this is a
segment that I've been learning this
isn't a good example I've got a better
example up here I'm playing with
dynamics models here we got a second
extra day yeah yes you can see like
we're just we learn segments and then we
use it to predict and get these so as
you guys label images this ignites get
smarter the segment's get smarter we
have to label less and less things yeah
we trained entirely with
right-hand-drive stuff it'll be fine
we're gonna start paying you for column
points no nobody has bought the data yet
no nobody has bought the data we won't
pay you for comma points when reddit
pays you for karma that's that's what I
like to say about paying for common
points nobody's bought the data yet
unfortunately unfortunately guys and I
wouldn't sell the data to people if they
suck if they want to do ads you know
fuck you no way mo sent us sauce and a
sent us I shouldn't say that I shouldn't
say that but you know fuck Weibo I will
say that apparently apparently there's
this podcast and the podcast bleeped out
way mo and replace that with Taco Bell
because but just wait no socks no but um
I know any weird edge cases oh yes yes
and actually we'll show them to you
so hey virtually Chris welcome welcome
to the channel we'll show you the hard
ones
so we went out of our way to find a
hundred of the hardest images wow this
one's already been labeled by a human oh
this one's been labeled by a human as
well but wait till we get to some of
them that haven't been labeled by human
look at this guy
these are the hard ones wait'll we get
to the ones that haven't been labeled oh
yeah look at that look it's total trash
so we did a search yesterday for where
the models the most confused and then we
we put them we put them in oh yeah look
at this look at this trash it thinks
that's part of your car or that's junk
okay that one's good
someone probably do that goes oh look at
that aw it doesn't work at all those
police cars are clearly movable vehicles
can't even tell what they are
oh this is this is the worst one oh
what's the discord list discord comedy I
wow yeah this one's really bad you guys
can fix that one it's called H zero zero
nine and it's called H cuz the H stands
for hard Oh terrible oh that's terrible
oh this one's someone dead like this
pretty beautiful oh oh look
all that vehicles is coming right for us
bro is coming right for us someone
better label it real fast
look it fix those lights our lane lines
that's how atrocious this is Wow look at
that mislabelling terrible terrible
didn't do so bad at that one but yeah we
went through and I filtered out what the
hardest ones were yeah we got AK master
the Carl had us come on label label
label huh so yeah if you can come in and
help out on how to accept lane marking
tab enter I don't know what that means
um but look oh look at this look at this
terrible image look look at how bad it
is at this poor car he has clearly a car
plans for zero eight white pandas no
longer supported look at that vehicle no
GPS no we're gonna we're doing lots of
stuff with the localizer to start to
actually drive using the localizer to
put information back into the vehicle
basically we're approving the vehicle
model so it won't like drift out on
turns anymore we're looking at the
hugging issues and we're looking into
big model if we ship big model if we
ever ship big model it'll ship in the
zero eight I think zero eight is a
beautiful time for big model look at how
much more model we can see there's the
outline for zero rates on on the Oakland
pilot uh github is ball GMC yukon XL no
no don't buy that no fire open power
compatible car but I can't ice nada look
at that I've got to fix that move over
for Sammy yeah it's hung cruises I have
one song on Spotify parking lines or
lane lines no parking lines are not line
lines now only if they're used to mark a
lane I'll look at this also I think
someone labeled us why this one was
already just good you know I think
someone labeled us oh that's nice us
crispy crispy all right I'll leave you
guys with one of my favorite I think it
was 57 57 is one of my favorite yes
Ritchie's English enriches your English
Hyundai harness I don't know what to ask
the gender harness team yeah that was
labeled it makes a huge difference this
one looks kind wasn't really labeled
look is that stuff still wrong but this
one's already pretty good Ritchie's
English and riches are English so I'm
gonna leave you guys with thank you for
watching make sure to check out calm up
pencil on this cord everywhere label
images help us out
don't make us you know like Tesla had to
like pay a lot of money for this and you
know like let me tell you something
who cares more you when it's your open
pilot that's gonna miss the tech delay
nor miss detector car or some random guy
in the Philippines who can never afford
a Tesla in his life that's right you
this is a community-supported project i
really value you all thank you so much
for coming in to help out if you have
and if you haven't come in and help out
if you have no intention to come and get
to help out and you're just here to
enjoy the show that's all good to thank
you all for watching good night well a
lot of people want that Hyundai harness
alright alright alright I hear you I
hear you I hear you
yeah Ford sucks don't buy for
wait i gotta i gotta add everybody on
discord
but where's this live is it on the
website
how do i get to my lives
guys i don't wanna use computers
we know where it is oh yes oh perfect
all right at everyone live
on youtube
we got people are happening we got
people how much people we got
14 so far oh look i'm chatting and you
can see me chatting
is so meta by the way check out this
guys i just want to show for it because
i think they did a great job uh this is
a hacker
app it's a software defined radio um
they're great and you should buy one we
didn't make it
i'm not sure in fact this isn't a common
product i'm showing for you buy one
amazon they're made by new elac
cool um you can tune to all different
frequencies and stuff it's pretty cool
uh this is a tease oh no it's a comma
two
uh yeah check out the comb too you can
have a comma too
um this is the boot loop experiment this
is the com2 that i fixed boot loops on
uh so yeah
what else we got that
was a black we got black panda over here
um buy black pandas all right we got
when we get 100 people
we'll tell you more about today's
special day yes that's true
nobel day
did a hundred oh we got 84. did you just
lost 10 people
you guys come back we can't announce
nuke bro says it's at 100. hack rf is
dank
uh you know what i gotta oh i have a
hole in my tooth and i'm going to the
dentist in an hour
what's nabil day all right we're real
close to our 100 person announcement
threshold four more people check out
this red bull
get in here so we can make our
announcement at 100. all right we're at
103.
it's ready george we're ready by the way
this stream is brought to you by the
summer mask
it's a mask but it's perfect for the
summer it's breathable
all right all right don't make them wait
any longer all right all right you're
right
um
first i'm going to read you who is nibia
um
nabil is on discord um
and nabil clearly is a comma prime
subscriber that's why
um he has the uh orange
uh and i'm going to read this this this
quote to you
how coma 2 works with your vw golf
is it really that great to have it
nabeel
it's amazing so worth it
knowing what it's like now i would have
easily paid double
jason replies put that in a tweet you
could probably get comma to promote
retweet it
nabil haha i mean it's a bit of a
double-edged
sword because i never would have tried
it
if it was double the price however have
tried it
i would now gladly have paid double so
in honor of nabeel
this one you gotta look at me in honor
of nabeel and in honor of the crazy
inflation that's going on in this
country right now
we're doubling the price of the count
too
the new price of the comma two is 21.98
get your comma twos for only 21.98 in
honor of nabil
uh don't worry don't worry nabil's a
good guy
the bill's a good guy this new price
only applies today
on nobel day maybe
if the nobel day uh on sale is is going
well
maybe we'll keep the high higher price
um and
because chris isn't here yet this price
isn't live yet on the website so
you know if you buy it right now you can
still get it at the low low price of
of 10.99 but uh you know seriously the
new price of the com2 is 21.98 in honor
of nabeel
um you know i think that it's i think
that it's uh
knowing what it's like now i would have
easily paid double
well you guys can trust nabeel know what
it's like
and pay double we all think we all think
is this exciting do you like this
exciting announcement
yeah yeah yeah slow clap yeah all right
cool
um when do you get chevy volt support
we'll see how many people buy on the
bill day
uh we do it we do have something else i
didn't i didn't bring you all in here
but
just in case you missed the nobel day
announcement i see we got a bunch more
people in here now we got 295.
in case you missed the nobel day
announcement we are doubling the price
of the comma too
to 21.99 um
you know look have you tried to buy a
car lately
here let's look up buy a used car price
not videos i think it's a news oh
how much have used car prices going up
in each state
wow crazy amounts
now up by 30 wow that's
crazy so you know i think that between
nabeel's quote and between
what we know about the economy doubling
the price is an insanely reasonable move
uh and one day only nobel day sale all
day sale
just 21.98
yeah get in 21.98 let's hope some
corporate people buy out of 21.98
they're looking on 21.98 wow that's
cheaper than like
changing five light bulbs
um
[Music]
all right guys but i really didn't bring
all 300 of you in here just to tell you
that
do we tell them why the other reason we
brought him in
all right i think it's time is it time
wait july 31st
july 31st all right guys we uh
leaked it a little bit a couple days ago
uh did you guys see when i posted the
budget the
25 000 we spent on marketing and that
was just the first half of the payment
you guys heard about tesla's autonomy
day we're throwing a
comma autonomy day um so you guys know
it's my dream to be a famous
rapper uh we rented out this this this
place if you tell me where it is
yeah should we tell them like uh maybe
we don't tell you
look the venue is amazing the venues
look it's like a place famous rappers
would go man
um this is going to be sick a lot of
famous people have played there
we got all of comma coming together to
present
uh what we're working on our strategy
for autonomy it's going to be just like
tesla autonomy day
and you guys can buy tickets uh but not
yet because none of that stuff's live
yet this is the pre-teaser announcement
but
if you email alex yeah alex.com ai
uh get in early on comma autonomy day
uh the tickets are reasonably priced and
you know what it will be livestreaming
every person who buys that comment what
do you think of that every person who
buys a comment too on the be
oh if you buy a coma two today today at
the nobel day price
yes you get a free ticket
before you even know anything about the
tickets you get a free ticket
um to comic-con
uh our our july 31st
extravaganza uh autonomy day style event
right here in san diego uh so you know
nobel day is
is is is a great day for everybody um
yeah and there's a very limited amount
of tickets
it's an intimate event it will be live
streamed it will be live stream that's
true
not all of it uh uh the day time will be
live streamed but it's an all day event
is it all day event uh yeah yeah only
the daytime
live stream we hired professional live
streamers so we're not gonna let's talk
about that for a long
time um yo
yo we spend a lot of money on having
professional live streamers it'll be
streamed on youtube
july 31st wait d grant 22
said if somebody said i didn't really
like the comma but if it was half the
price i would love it
you don't understand you can't troll
nobel day
department when the prices go up
department heard about nabeel
they were like this is a great
opportunity
[Laughter]
there will be uh pizza yes wait at the
event
yeah at comic con they'll be pizza oh we
got like i paid a lot of money for food
it better be not just pizza
there's gonna be there should be burgers
burgers there's lunch and dinner
we have lunch and dinner who is nabeel
nabeel's a hero
nabil is a hero he's semi-loosened
i don't know what that means but
we know that um so yeah guys comic-con
uh july 31st in san diego
book your plane tickets early before
hyperinflation comes for them too
um how much are tickets
well that's not announced yet but what
is announced is if you buy a comma two
on nobel
day at nobel day prices you get a free
ticket
that's right and i will tell you the
event is gonna sell out
there's a very limited amount of tickets
um
there's gonna be no masks at the event
am i allowed to say that who knows
what's allowed anymore
we have 322 people do you want to answer
maybe some questions
yeah do we have any questions
i raise price geo hot yeah
uh we love high prices guys you want to
see something we didn't read the price
on eons because they're out of stock and
terrible
see what this young says on it no for
sale
someone said nabil means profit in
hebrew
that's even better it's like a pun
profit make money and profit
in the future um comma do you believe
you're amazing
uh will there be vegan food yes it'll be
food and allergy friendly food
are the prices only raised for nobel day
yes just today
well the prices will go up again but
this extravagant price increase is only
for nabil day
how can i buy in bulk if you add 10
comma twos to your cart you'll get an
automatic discount i want to try that
right now let's yeah let's make sure
that still works
check it out so if i go here to buy and
i wanna buy a comma two i click buy now
of course i agree with the thing
if you add more all right watch this
so we're at nine and that's the price
i'm gonna add ten
boom discount buy nine
get one for less than free boom discount
there you go that's how you buy in bulk
that's what you buy in bulk right there
we built it right into the website so
that we never have to do any business
development
ah your combo was
literally five minutes ago i feel like a
sucker for having paid half the price i
know
some people are going to buy them to be
all day and they're going to know
wait those are they're true fans they're
too fast that's right they're people who
know that no matter
how much they pay for the common two
they're going to feel good about it
because of the value it delivers that's
what nobel day is
all about return it and buy a new one
now you know what you don't even have to
return it you can just buy a new one now
official reveal day um
yeah we'll come with a frisbee will they
come with a frisbee
oh we're thinking about frisbee i'll get
the frisbees today
frisbee we're gonna get comma frisbees
um
what if people buy one on the blda and
get a free ticket with no
intention of attacking comic-con oh if
you return your device within 30 you'll
get your ticket after 30 days
you can't you can't buy your device and
return it and keep your ticket no of
course i don't know he's saying that
if you you buy it on reveal day and you
don't want your free ticket
oh what can you do with it it's
non-transferable
it's nonsense horrible well that's
that's what it's not on the bill day
there's no calpers for comic-con there's
not going to be like
people selling comic con tickets on on
ebay
i mean i guess i'm okay with that i'm
okay with that too i think your ticket
is going to be an erc20 we did
talk about doing uh wait should we make
the tickets
nfts on cheapy i think now you're
talking
we're gonna put them on a curve pricing
by the way yeah don't worry about we
thought about doing a bonding car for
the pricing
um don't worry about by the way uh
uh your gas fees on jp they're very
cheap
how can you return your uh device and
get nobel day pricing yeah you can
if you want to guarantee your ticket oh
where can we send the
1099 to upgrade their current comet 2 to
the nobel day model
oh just buy another car
right now buy it right now at 10.99
right now
in the description just wanted the nobel
day pricing and we'll give you the free
ticket to the conference
they like the no masks i push for it
boys
our policy at the event is is to just
calm as you're comfortable oh yeah
i'm not like i'm like you can wear a
mask if you want you can do whatever you
want you can wear whatever you want
if you don't want to wear anything
that's fine no no you got to wear
a shirt and shoes
actually i don't really care about the
shoes
you got to wear a shirt i think bottoms
are the most important are the most
shirt talkers no
[Laughter]
good morning nikki heard about nobel day
yo we're um so nabeel said that
uh if the combat 2 is amazing and so
worth it knowing what it's like now i
would have easily paid double
so today on novel day we're making this
possible and we're raising the price of
21.98
yo it's fun ready it includes a free
comic-con ticket so
[Music]
comma autonomy day um i will say this
um yeah the the screenshot i posted the
discord of our marketing budget was real
uh so the 25 000 was just the deposit
for this event uh so yeah the event's
pretty it's like have you ever been to a
wedding it's like that
but for autonomy
[Laughter]
push-up competition there is going to be
a competition
there's going to be a competition it
won't be push-up stuff but let's go
let's go push-ups in honor of the field
day let's go boys
four five two eight
53 17
12. uh we're getting
tuck them elbows george whoa whoa that
was sick
boys that's sick for him got to do
push-ups
been honoring
free comma merch at comic-con there's
gonna be special
comic-con merch exclusive shit uh it's
in the back
after the band you can go to the table
man the band was up all night spray
painting the tie-dye
uh
[Laughter]
show them me and show their name
priceless
any special guest at comic-con
i don't know is there anyone you guys
like to see i think um
eric's going to be the most special
guest um can we book jar rule
how much does john woo
comic-con is is not fire festival
blink 182 pulled out they didn't think
they could provide
the kind of experience their fans were
expecting oh it's not twitch
twitchcon either um
i wish i could love something as much as
george loves hoodies nabil is famous he
has a day named after him
uh soldier boy how are we counting
soldier boy he's into
blockchain now uh
all right boys what else we got
soldier invented autonomy carpathi oh
we'll send him an invite
we'll take care of happening
there's no common beanies it's the
middle of the summer
nabeel should get a should we give him a
deal a free ticket only if he buys a
comment
on the builder that's right i mean does
he want to be a legend
and that's his choice um
can we book elon musk i don't think so
we might be able to put grimes though
leaks on um uh actually adeeb has some
announcements he's gonna make
a deep down for some announcements he's
excited
the art oh a couple people are just one
more time on nabeel day
oh yes do you want to post this on our
twitter yeah i think that's a good thing
to post on twitter
uh hang on i got an internal slack so
just
we are thinking about uh letting some of
wow
oh thanks chris did the price already go
live
wow wow the price is live no well i
don't know
refresh i think oh it takes like five
minutes to deploy
yeah yeah because it's got to go through
our oh no
wait it's live here but the subtotal
i don't trust this website oh
sweet yup right here this is the nobel
day pricing it's only partially updated
uh there's a new comma coming what do
you mean a new we have comma twos bros
uh but we are gonna show off so okay
here here's a few things that we're
gonna talk about at comic-con
um so you know we shipped blameless
models
uh laneless models are one of the
biggest breakthroughs for comma and
perhaps you know
uh i mean
i'll tell you guys this went to la
and i went for a ride i didn't drive i'm
happy i didn't drive tesla
tesla fsd is not chill
uh i went on the same roads with
laneless model and
laneless model was chill um blameless
model is a big uh
a big uh
well breakthrough for for us and then
one of the things we're going to talk
about
at comic con is how we did it and then
how we're also going to apply that
same style to longitudinal and like our
lateral was already quite good
it got better our longitudinals total
crap at least according to consumer
reports weightless longitudinals on park
on lateral so that's one of the things
we're going to talk about
um hadeeb has a bunch of announcements
developer oriented announcements
we're thinking about doing community
submitted lightning talks we're still
working out the schedule
every uh comma employee is probably
going to speak and then at night
comma jeopardy you guys know a hacker
jeopardy from defcon
comma
um no but uh
i think that everyone who comes to the
event
is going to uh you witnessed a part of
history
is it going to be dev focused or
community a little bit of both
yeah tell me something will be something
for everybody i think there really will
be something for ev
every comma for every believer
that's right that's right there's
nothing for the haters july 31st
we could give the haters something i
like haters something all right
[Laughter]
how much is a comic-con ticket the price
has not been announced yet
but if you buy a comma two today on
nobel day take a look at the price
oh nabil day pricing field day pricing
uh
sweet sweet i'm glad oh it's nice oh
good the subtotal shows up right
have we had any sales yeah
do you check uh if we've had i can't
check on that spotify login
website fully live um i think soldier
boy as a rema
branded comma two
i don't even follow that you know what
chris do we have any uh
blue oh do we have any special blue
do people know there's a there's about
eight
blue comma twos
they're the most rare i don't think
they're built into real combat twos
maybe we send one out on a field day
ones might be blue
yeah i think we send at least one i
think yeah one lucky nobel day buyer
will get a blue on
my god you raised up price yeah it's
21.98 now in honor of nobel day
meal day it's the bill day yeah we'll
make one of them blue
they did not raise the price we did
though no no you wrote money printer
what's that rap song
this is a meme price uh
yeah yeah yeah yeah you guys know uh
send it up by kanye
this is what i'm thinking of let me be
clear the sides of the common two are
black
but the actual device is blue
are we gonna get struck oh for copyright
only if we play a couple of seconds
[Music]
yeah well you know so let's just say
that i'm gonna set this pitch up and
like it might not go down
so you know you guys might this might be
the best price you can ever get in at
but it might not be it might be like e
we'll just feel it out tomorrow we'll
fill it up tomorrow like we tomorrow
might be extended novel day
um yeah like you know look at the price
of e
well max s says it's a great price
it is a great price it ends with eight
bar that's a great sounding number no
fours no
be a week nabil
yo that's a way to make money did you
invite media
uh to the yeah we're inviting some media
but who's the media anymore
you know what i mean you are the music
uh oh claw 320 wants to buy one for
three thousand dollars
i know that you want your own day too oh
i know but
nobel did it first bro yeah sorry
like rage at it uh i think we should 100
feels quote for at least a month
yeah nepeal is og
oh people should be able to type in an
amount they want to pay it'll only go
through if it's over a certain amount
i do think that's funny uh are we
launching something new at comic-con
uh yes we're launching something new at
comic-con and you will be able to get it
if you have a commental
it's something we've talked about for a
bit i think it's going to line up
perfectly with comic con we're obviously
not gonna tell you what it is
um but it's coming to your comma two uh
so yeah there's that alex you know what
it is
what is it just
oh yeah it's going to come to the
comments i think i think that's when
we're going to announce it comic con i
think is when that goes live you know
free live stream of comic con yes there
will search money for the live stream
or maybe we make it if you buy if you
own a common device you know a common
device can come free otherwise you'll
buy a ticket to virtual comic-con yeah
we can do a virtual comic-con ticket
buy a ticket everyone can send their
disdain to that guy
um i'm just you know
big big yeah you guys know
you guys know no please free no we'll
probably make it free
i like free streaming but i do feel like
if you pay for it you're more likely to
watch
does start with a b and end with an l
i don't know where and when july 31st
it's in san diego
um all day to saturday
and uh here let me let me let me i'll
i'll i'll i'll leave you guys something
else
uh check this out
what is it oh you want to show them the
goods yeah um
temporal with stop lines do you guys
know what stop lines are
how are stop lines doing oh they're not
even overfitting anymore
um stop lines are red lights and stop
science
uh and you know big model is what's
going to make that possible
uh so there'll be some some some great
talks about stop lines and big model
uh at comic con um
but yeah i mean you'll see they then
you'll you'll see what it is
uh we're going to announce comic-con
tickets
through discord um so if you're not in
our discord already
the way george just sits on his computer
with his legs crossed just exhibits
you're like an anthropologist here
observing
recently and i found out i'm in the 96th
percentile for testosterone
and this made me happy um nebula
genomics shout out nebula genomics
uh i also found out that i also have uh
what's that like asperger's or something
someone asked if you could buy with
common points um no but we will be
sending advanced invites to
all the top comma points holders that's
true everyone with top comma points
uh top contributors mostly you know
recognized contributors everyone else is
gonna get an announcement
the day before it's public is it gonna
go at green lights
you're gonna have to wait for uh comic
con to find out about that
and uh yeah if you're if you're if you
have a lot of common points
we'll send you the secret invite uh link
early the tickets might even just sell
out to those people
yeah i mean the only way to really
guarantee a ticket is to buy a
client yeah sure
um show you top ten comma points we
still have a leaderboard on the website
yeah
just like still is it like still the old
crappy leaderboard yeah
no no it's oh my god it's so crappy wow
i haven't seen this in so long i can't
please go to the top let's go to the top
box these are everyone who's going to be
invited wow i don't know how much brevin
drives
yo brevin's crushing it
um probably the top 20 here bugsy
uh who else we have superscape kevin
david z
c sours sjm maybe we can offer free
tickets to some of the really high
comm avoid people
wow yeah if you guys if any of you are
watching just message email me alex
comma
yeah dot ai see what we can do for you
uh now i was in the bottom four
percentile for things coveted effects
according to nebular genomics which i
recommend to everybody
and the hack rf those are my two product
recommendations
along with comma twos ticket price is
going to be at least 99
there is going to be a vip ticket
that's going to be a little bit more but
at minimum
around 99 and that's going to include
lunch and dinner
yeah the tickets are not going to be
extravagantly priced
we're going to do this more based on uh
you know like
the city uh
the tickets when they would no we're not
you know comic-con is a it's it's a it's
in the marketing budget place it's not
in the it's not in the make profit
budget
thank you so yeah
but uh we might all you guys know about
bonding curves
like unisocks
i just want to see a big curve that goes
up
ah there you go yes um so
maybe maybe we'll do a a bonding curve
style auction on cheap
for uh comic con tickets
um isn't marketing selling out no
advertising is selling out
marketing that gives back to your
community is great there will be special
comic con
memorabilia i think you guys are really
gonna like it
um yeah advertising supports a scummy uh
business model it gives money to like
google and facebook
marketing like we're giving money to
like a local venue
and like some local caterers to put on a
cool event for the community
that's not a scam bros
self-driving hoodies oh hector wants to
know uh
can we sum up where we're at can we stop
where we're at all right all right all
right so
we saw this quote from the beal let me
show the quote
in discord in discord and um we got
inspired
we got inspired when we heard that there
were people out there who would have
easily
paid double uh we we made that a reality
and we doubled the price of the karma
too
today only is nabil day
um and a neobiel ability comma two comes
with a
ticket to comic con
which is gonna be a sub 200 person event
we're waiting for the final head count
numbers
so i'm very certain it will sell out if
you want a guaranteed ticket
you can um acquire x number of
uh comma points be an important
contributor uh
or buy a comma 2 dev kit today
i am wearing a hat comic
wow those were may exclusive those are
never going to be again
no they're all gone there's no more
comma hats
wow i left one at your house because i
knew you'd forget but they're all gone
do you guys know about unisocks
this is the use you can do uh uniswap
made a pair of socks
and they put it on a bonding curve take
a look at the price of a pair of
unisocks
pump no but it's like actually those
socks like
flex i have 46 000 socks
let's see you're european is comma
allowed here the spirit of comma is
allowed anywhere in this
period of freedom is allowed make it a
vip ticket that's included with today's
purchase no that's a little much
it's a little much i think oh we'll give
you an option to upgrade your ticket
do we want to let someone who buys a
a device today vip ticket i think they
can upgrade it when the vip takes care
now we don't know what vip price is
going to be yet but we do know that vip
is going to include a sit-down dinner
with the whole common team and it's
going to be very limited so it's like
half team members and half of the yeah
yeah we're really looking like you know
to get that like maybe it's gonna be
like five thousand dollars for a ticket
we're trying to get like
automotive executives to pay that kind
of money it's like a phone call but
longer
um it's in an in person
we just make vip extravagantly
overpriced yeah
like 99 for a normal ticket and then
five g's for a vip ticket
yeah uh how will we handle fan boys we
don't want those
i mean i mean if you want to like like
fanboys are really in
oh fanboys are really annoying like if
you want to show up to san diego and
like like buy a ticket and you're a
fanboy like
that's kind of the point of the
conference like you look at them
you know you're not getting you're not
going to root that out
but i mean one way that we handle it is
this is why we do it exclusively
right this is why we we limit like bb we
make the tickets
launched slowly launched through the
community right like you didn't spend
your whole life gathering comma points
just to uh
you know be a fanboy you're committed to
the community you are
a community so of course you're welcome
what even is a fanboy
um george what keyboard do you have
anyone who asked that question oh got it
i'm a happy hacking keyboard
professional too uh this is a 300.
uh if you spend a lot of money on a
keyboard you will not be any better of a
hacker
i just bought it because i can't
since you didn't get a hat with your
mayor or can you order some other
apparel in a discount why didn't you get
a hat
because you ordered too late get in
early yeah we just we had a limited
supply
um july 31st
first yes
saturday the desk is uh
jarvis it's made by uh tony stark's
assistant
uh is that where you can follow this
one's on stock open file no but we're
working on a bit
this is all gonna be announced at
comic-con we got some big stuff
in in the in the in the gas and brake
department coming out
at comic con which includes you know
uh 1995 compact
keyboard
i've never seen george stand at his desk
it does go up
all right you got to head to your
dentist appointment
we got we got a couple more questions i
bought a
tooth camera yesterday and i stuck in my
mouth and i took pictures of all my
teeth
wild and one of them has a hole in it so
we're gonna fix that
um what kind of carpet is this it is
lawyer standard number three
this used to be some office of some
lawyers oh yeah we're looking for a new
office
what does it mean for hardware going
forward it means risk fine bros
risk architecture is going to change
everything
yeah we're launching a car at comic-con
the rumors are true
the comic car is coming out it's going
to go in both directions
um yeah let's see do we post on twitter
to explain the deal there yet
oh you know george uh spent a long time
in australia
not yet ah just like the moderate um
classes that frequently pick me up when
i called over yeah doctor
should make some uh asmr videos of him
labeling uh
images oh yo we would put that on in
between talks if he wants to make that
kind of content
it's gonna be a comic-con and a a doctor
spector pj lao would like to get up and
talk a little about you know labeling
um you know they're at ten thousand now
and i also think this is the highest
quality second data set in the world
like when you compare it to cityscapes
or um
uh the napillary vistas
or god forbid canvid uh
our data says higher quality like
there's less mistakes there's
way less mistakes in our data set than
all the other ones
um because you know it was done with
love like i'm serious about that right
like like
you know the people who work at scale ai
didn't care
they really didn't uh they were like oh
let's just get through the picture the
people here are like
yeah you can mislabel the lane but you
know it's your open pilot bros uh
so yeah okay we love brazilians
as a brazilian there'll be at least one
me there
uh please make a ticket announcement on
discord yeah i mean discord is one tier
like we have like it's going to be like
tiered and like i hope it doesn't sell
out by the time it gets to this board
but the ogs are the people on this
youtube who bought comma twos on the
blda
or you know just paid uh yeah
upgrade your comments you do a new why
not hire people to do the labeling
because you can't motivate people to do
a good job
if you want people to do a good job like
you know we've tried to
you can't pay people to care we hired
these people we hired super annotate and
it was awful
um like there were so many mistakes and
they were just like there's no way to do
it better and like
we have a community that shows that's
clearly wrong you know who i hope is
coming
deanly whoa
we'll help dean lee out team lee gets a
free ticket shit i buy dean leah take it
from china
um if deeply reaches out like yo i want
to come like let's make it happen
i agree
um
cool thank you for watching the stream
okay
great day to buy a comma two it's a
great price
sometimes lower prices aren't always
better i want you to think about where
this higher price is going
it's going to fund development of open
pilot so uh
shout out to nabeel shout out to the bl
have a good day you for joining
everybody
oh yeah oh hello I was also post on
discord just to tell people that you're
alive
late it's 9:00 a.m. not late night I
know we live man it's late here
hello Russian yo yo yo you're go no no
we're flashing we've been here all
weekend well no these guys have a
slacker I went out and party today but
uh we're preparing you are your comma
tubes
these are the ones that flash good and
those are the ones that flash bet and
those are the ones we haven't flashed
yet oh yeah yeah there's a lot more well
we'll go look at the more in a minute
yeah but you know we're yeah no leaks on
any of this stuff this is this is what's
provisioning all your karma twos they
show up as comatose in the database yes
all good look we have provisioning
castes is really nice Robert some really
nice provisioning tests we want to make
sure that none of these have bugs for
you guys you know oh look we're doing
power breakdowns so yeah you know
oh yeah the the desert white edition is
that only can we show the doesn't read
edition that's never gonna sell them
we're never gonna ship them desert white
Oh this was the internal prototype you
know how Apple never shows you the
internal prototype no you got you get
black comet ooze yeah no no this is too
disgusting desert white yeah yeah we're
gonna clean all these comma tubes off
we're gonna put them in some boxes for
you guys as soon as they're done and
they pass all of our tests I can't
believe I'm drinking this Buble shit we
ran out of spin draft
all right look at this we got boxes I'm
gonna put them in these boxes
just good boxes we got foams over here
tons of foams for comma twos that's the
back seat yes
oh wait oh yeah I forgot about all these
comma twos yeah we get we get all these
common tools over here yeah we got
common powers here all the phones
oh yeah we're making a lot of comma twos
guys yeah we're making a lot of comet is
these are these are just boxes full of
unprocessed phones yeah this is weird
they want to know where the harnesses
are oh yeah beautiful
we got enough powers too
we got we got shipping 300 comment who's
on Monday is gonna be is gonna be crazy
should should we tell them that if they
still buy one they can still if you buy
one you can still get another 300 but
just barely just barely you can still
get in but we've sold almost 300 of
these oh you might get a hoodie oh yeah
yeah yeah we're the authors those the
hoodies that we're giving away yeah yeah
check them out just not what's inside
the car just to welcome to the fleet
yeah yeah Oh get off in our discord yeah
do we ship the hoodies to India we ship
the hoodies worldwide DHL goes will ship
them wait we don't ship to Russia
anymore oh wow no do we have like a we
don't ship to Iran I'm sorry it's
illegal for us we'd love to we don't
want to reject our any in business but I
don't think we're allowed to I think
there's sanctions but will absolutely
ship to India , two's yo you know what's
in those boxes over there more comma
powers and harnesses 3000 we test all
the phones
how long to prep a comma to write now
way too long right now it takes so long
we're practically losing money on them
now that's a lie but you know it takes
longer than I'd like we're spending more
money than I'd like they're really nice
though I hope I've been I've been I've
been talent I've been saying over and
over this week I'm like we got to make
these ones really beautiful because I
know that you guys who bought them are
gonna uh they're gonna go tell your
friends about how beautiful it is and
they're gonna buy more and that's gonna
continue the cycle Oh
should I should I show you we'll take a
quick look at it we'll take a quick look
at it for a minute it's unreal yo it's
unreal that's this month well not this
month it's a little bit more than this
month but uh yeah so a lot of these
things comes a suit well we are
profitable for the month of January and
you guys are gonna have fun
whoo to catch this video live you guys
are gonna have fun check it and uh check
in the replays for this
yeah test them out in Seoul over here
you know I know you guys all can't wait
to install that dash cam saw her oh yeah
yeah yeah we meet we may be a store real
fast um remember that if you're in
America would you say that prime is us
only right I could if you're in America
you get three free months of comma Prime
with your device and that means that
you'll be able to install the software
without even having to connect to Wi-Fi
nice just a quick video that's pretty
much all I wanted to show you I don't
really have 34 this late it's late it's
really late
yeah now we can have coatings James
maybe maybe we can go back to coding
streams but I just wanted to show you
guys that the comma twos are real and
hopefully hopefully assuming assuming
this all works
assuming all our provisioning works I'm
sure well assuming it all works we will
be shipping them out on Monday
do you guys
yeah
that's that quick you'd apply
we're not gonna make the hardware
schematics open-source this is how karma
makes money we appreciate all your
support if you haven't bought one yet by
a comment - it is the best product on my
eyes ever made it's the EON without all
the books there's been a big spike
that's been a really big spike in Oppo
traffic lately we've got Andy's YouTube
video which which did wonders for us and
then and Hubble sphere was also in that
video
if you guys haven't checked it out its
autopilot versus open pilot self-driving
test more competitive where it were
competitive with with the best systems
car and driver also did open pilot
comparison which went out in the print
magazine yeah it's not even online yet
it's in the print magazine so if you got
a car and driver print magazine you can
check out open pilot compared to auto
pilot and super cruise definitely people
we want to be compared to um the other
piece of big news you guys read the
medium post is that ultimate Isle is not
being developed on master
we've already merged in quite a few pull
requests it's gonna be much easier to
work with everybody on developing it to
open source 1.0 hardware that's it
cuz it
bye have a good night everybody enjoy
your comet oohs when they arrive you
haven't bought one yet shop comet III
you can still just barely get in in the
first 300 just make sure to do that do
you mean well I make new hardware for
1.00 no this is the hydrophone point Oh
the Karma - is gonna run open pilot 1.0
do I plan to provide long support for
TSS P cars yeah bad if you remove the D
s here which we don't recommend because
it disables a B what can you do with it
now well it makes a great paperweight
umm you can tell people you bought one
uh what's the number at how many have we
sold almost three hundred I wanna see
you have - I - are you guys we've made
two hundred two hundred fifty four
thousand dollars in the last 30 days we
rich boys we rich um vision is fully
open the model is fully open I actually
actually I know there was a complaint
that the models are encrypted there in
DLC format which is not encryption at
all but there's actually a tensorflow
model in there right now
hey do you have the cross ball I think
we even have the cross model if you go
right now to come open pilot yeah I'm
sure we have the cross model yeah
they're in there they're just our cross
files
um it's open I mean I don't know what's
more open than that you want the date
it'll be open no no no no do we do
quantization and pruning we do
quantization for the monitoring model
also if you want to buy they may even a
hit me up we sell data where we're
sketchy like that Zuckerberg you know
someone was like someone I read it was
like they're gonna be sketchy like
Zuckerberg and sell data
yo I wish we could be sketchy like
Zuckerberg that guy's rich no I'm
kidding I wouldn't sell data if it was
for shitty people like ads but if it was
for self-driving car people
yeah then don't we sell the data so yeah
do we do our ell models hair looks
better thank you come on in grab get the
models if you just go into open pilot
models directory now they're fully open
they're cross files enjoy let me see if
I can merge oh sweet I can merge this
pull request oh I love merging pull
request is such a good feeling um isn't
the day to your main advantage no anyway
we have look put it this way this is
just real talk we have thousand daily
actives how much does it cost to hire a
thousand people to drive around remember
that kind of driving hour two hours a
day so thousand people two hours a day
let's say pay them so you pay them ten
bucks an hour
so that's 20k a day dude twenty twenty K
a day is what way mow probably spends on
janitorial services yeah let's see 7.3
million for away most janitorial budget
I could almost believe that so the data
is not you know that's that's even like
paying people ten bucks an hour you can
you can ship out stuff to people
anybody can compete on data now that's
not what our advantages our advantage is
not being delusional like a lot of
self-driving car coming how long does it
take to train the entire driving model a
long time now we don't buy data um last
24-hour activity yes someone's got to
write that wouldn't an engineer for that
hey now we're gonna go 15 minutes on the
stream any last questions in the last 20
seconds yes they were talking about sale
again I know I know
thank you all for supporting us thank
you all for buying common tools we're
very happy to have you here with us on
this journey if you haven't bought one
yet shop comma dot a good night
[Music]
there we go
well who knows this is i have four
viewers
youtube's like broken is it working yeah
let's go did it stop hey logan
hi george
yo we got 135 people
can someone post a link in discord all
right relax we're done ready
we are going on an adventure
thanks all right so tesla
what are these things man what is this
are we good yeah i'm just getting a good
recording yo this thing's got lots of
options
so we got auto sphere beta definitely
want that
yes do i want navigate on autopilot
yes do i want to customize it look you
can do
like god exit passing lane no
or yes i don't know look at that it says
saved
saving and saved oh we could we could
write that
um lane change notification
uh okay i don't get that i don't know
why i don't get that
all right customize summon oh we have
summoned oh yeah we're going to use that
later let's go somewhere and try it
green traffic light chime customize why
oh this does not make your vehicle
autonomous
are you sure you want to disable any
change confirmation yes
we'll do both
hey if the tesla crashes this is this
level three right
joking boys all right let's uh
where's the key wait i thought you had
the key
wait uh oh no is this a joke though
oh we have a pen we have a pen uh yeah
it's in my
text though oh it's in your text oh
we're never gonna get that it's gonna
break
all right uh i didn't hear the engine
start
oh yeah
oh yeah let's go all right
um we do the loop yeah but where do we
want to navigate to let's navigate oh we
can never get to something that's
already been in there
oh i don't know yeah i guess this person
lives in san diego all right you want to
go to the zoo
yeah i guess we'll go to the zoo yo
how do i do voice san diego zoo
how do i enable autopilot
oh my god okay what is that wait
i don't know what was that
[Applause]
i pressed oh that's park that's not
autopilot what this car's impossible to
use
sorry i'm a new tesla driver i'm a
vlogger
first avenue all right let's go oh my
god
uh how do i enable autopilot i pull this
stalk twice
now turn left oh it's in first avenue
hey it should turn for me right
oh there's there's a button that says
navigate on autopilot on the screen
okay press the blue button press the
blue button okay
uh hang on let's go autopilot
okay stopping for light navigate on
autopilot
no i think it was already on did i put
it on take the interstate
five south ramp
is it going to take the ramp for me okay
this is worse than open pilot why am i
over the lane line
is it going to follow this car oh my god
this is so
stressful oh my god why is it beeping at
me
whoa own past chill man all right let's
go
so stressful all right
is it gonna make it
yeah it doesn't have the full
self-driving beta just the package
just the package the california one 63
north all right i do like the calling
voices
that was nice yeah it's nice that was
good that was good all right i gotta
remind it that i'm here by pressing the
uh
volley button oh this is good well okay
it's slowing down too much for this turn
now too much slow down for turn but what
i'm gonna do here
it oh well on the cotton detection there
i love that it froze at the absolute
perfect moment while we came to that
four-way merge
no i did not do the merch i had to
disengage for that sorry guys well this
is good this is good that was good
youtube froze that was that was that was
open
pilot quality we're back though all
right
we are alive we have 200 people
okay so i want to see it do some
navigating because otherwise this has
been the same as open pilot
elong musk wiped us out we did not crash
we launched ssh into the tesla and
crashed it
no youtube crashed ultra richmond street
okay this is pretty solid
george is impressed i mean to be fair i
haven't seen any navigator on autopilot
it hasn't done anything that open pilot
can't do yet
but like it does okay is it going to
take the exit
oh just the exit whoa
accelerator to resume turn around
we're back sorry guys
turn off 5g
we do need stalling so far it's pretty
impressive
we have a stop sign move to upside
wow stopping for traffic is it going to
make the turn
there's no one here it is resumed with
the accelerator we were supposed to make
it right yeah well it didn't make the
right
i don't know if you wanted the right but
we
oh we have to do the right part oh we
have to do the right well will it stop
from the stop time
oh my god
[Music]
oh my god i mean it stopped
you shouldn't describe it as comfortable
but the stop signs are pretty good
yeah this is this is impressive we need
this where's my stop signs
all right we're shipping stop signs boys
tesla stop signs i want stop signs
[Music]
that's pretty good that's good yeah yeah
that's good
wait the beeping is almost here
unavailable for the rest of this drive
what why did i get locked out
no it just i didn't get locked out it
just lied to me
oh no or is this just cruise control
it's very confusing no it's not steering
because i'm locked out of auto turn to
stay on richmond street
okay we gotta turn the car off and turn
it back on because i got locked out
because i didn't see it stupid dm props
that was terrible but okay the stop
signs
are pretty good except for the one that
is slammed on the brakes turn right on
to herbert street all right we're not
going to
cancel
well yeah that's just the stop signs are
good the stop signs are good
oh it doesn't make right turns but right
turns our stupid feature anyway
uh it did take an exit for never getting
autopilot that was pretty good
yeah one year one year openpilot's gonna
do that
overall the the lane centering was quite
similar to openpilot
the cut in detection was it couldn't do
the merge
uh it did two cutting detections pretty
well which is similar to what we have
in the in the latest um
yeah all right let's see can if i turn
it on now am i gonna the driver
monitoring is of course atrocious
do i have autos to your back or no
it turned the hazard lights on and said
auto steer was unavailable for the rest
of the drive
and to be honest i'm not even sure what
i did okay auto steer temporarily
unavailable
what does that mean also one of the
tires is flat no this is not
on a comma two we're just driving around
in a tesla model x
uh experiencing the latest why is auto
steering available is it because i'm
locked out or is it because
wait do you think it could be from the
guy we rented it from
no no no we borrowed this i think it's
because from a very nice guy in san
diego
it's because i didn't respond to the dm
prompts quickly enough
we do have one tire that is uh we have a
flat tire
and all the steers temporarily low psi
we're gonna get out of the car
and we're gonna really make it a new
drive cause maybe you just can't turn it
off maybe that's not considered a new
drive
get out of the car and get back in you
have to pull over and open the door
i have to pull over and open the door
does anyone know this no people some
people are saying no it's true
you never know what the comments are
true you're not so excused for stopping
you're beautiful i'm not familiar with
tesla's crappy ass dm we gotta close the
door so we'll drive
okay um
that stock sign was rough then stopping
but otherwise it's pretty good we got
330 viewers
wow yeah so we have to pull over
should we get some air in the tire
i did uh
yeah i mean i don't know
[Music]
oh what is it what's the pen you're
gonna make me look up the pin again
i don't remember it was there's anyone
was it oh three two seven
three two seven sounds right all right
we're good
do i have autos to your back it's the
only thing
no we don't have the full self-driving
beta this is just whatever's
available to everybody is what we have
on this car
sorry we're on the iphone
i don't know what else people want us to
stream on what do people stream on
we don't do it for them we do it for us
all right drive honest to your back all
just you're temporarily unavailable
am i kicked out
wait how does this work oh there we go
okay we're back we back boys we back
we're gonna press the dm thing a whole
lot more
oh you need to a lane line to activate
chris's need a lane line to activate it
thanks chris
this isn't where i want to go i want to
go in that right there
god sorry it's bumpy so you tell me i
can't activate it here
okay because they don't have lameness oh
we're so spoiled by our lane like
disabled use of ley lines targo tesla
needs kale
open pilot can work less go to go to
mcdonald's
go to mcdonald's yeah let's go
uh no let's go over there and then we'll
take this we'll take this windy road did
george steal this car
no we rented it legitimately through
turo highly recommend turo it's a
wonderful driving experience
yeah oh this thing's nice oh
nice car got some power
you know tom should get tesla
used a lot of things
got some power it doesn't say why it
can't activate
no it doesn't temporarily unavailable i
wish
all right let's go shout out to uk
viewers wait why can't i engage it here
oh it's because i was exceeding the
speed limit too much that's
oh george was exceeding the speed line
it didn't happen i wish it told me but
okay stop it all right all right it's
going to stop for the red light and then
let's see what we get
wait does it stop for the red light it's
awesome yeah yeah it's nice
it's really nice i'm pressing i'm gently
stroking the volume knob over and over
again so i don't get locked out from the
dm thing again
can i bring up like the thing here
what like the big autopilot here is that
only full self-driving beta
oh i i don't know
[Music]
does anyone know can we can we change
the visualization here
what's going to happen when this light
turns green
is it going to go automatically only
full self-driving beta crisis
only full self-driving beta okay is it
going to go automatically or am i going
to have to sit here
that's what i want to know oh here use
accelerator oh my god
i just tap the pedal okay yeah it's
violent i know what the test oh my god
okay
not great knock you see open piles just
okay yeah stop for the green light too
great yeah get me rear ended
it stops for green lights apparently too
but that's what it was doing
i saw it was uncomfortable in the car
all right
okay okay good distance from the parked
cars that's good
uh oh my god what was that
you guys it's not my bad phone skills
it's the car that was the car just
wow the car is terrible understand what
i'm in oh my god oh my god this is
terrible
this is terrible okay there should be a
toggle disabled to stop
how for lights yeah yeah how come that's
crazy but then no lights will work
or it'll only stop for red lights i
don't know you have to
control unavailable you have to press
gas or confirm with stock to proceed on
green
you guys i am sitting back in the seat
it's terrible so you're telling me it's
going to hit the brakes here hard if i
don't
press the thing i don't know or it's not
just not gonna detect this one okay
it didn't detect that one that was awful
it didn't detect that light
well i just have no idea what it's gonna
do it's stopped for the other green
light i agree that
they're they're not communicating
clearly about what it's gonna do so can
i not have this
like insanely close following distance
yeah this is scarily close
do you want to fix that here we do have
seat belts on
uh okay okay
okay we're gonna try to change the
there's no one behind me now
forward collision blind spot
i don't i don't see that adjust the
the uh i just figured out how to adjust
the temperature of the car
oh here is it this oh here we go i found
it you found it yes where is it it's a
little long look you can see
why are we stopped way too close to that
parked car
okay there's a there's an ambulance here
we're gonna stop in the ambulance
i am so confused using this thing
i guess you get good at it with time i
think you get good at with time but i do
feel like open pilot's a lot easier to
use out of the
box okay don't let's set my max speed to
something reasonable
okay let's follow this ambulance okay
we're stopping for this
green light oh it doesn't disengage on
gas though so i can just gas through it
that's nice a d everyone
says that you really should only use it
on the highway yeah clearly
what's up i don't know i'd feel
comfortable using open pilot here
i also would feel comfortable using open
pilot here
i don't like it i'm way too confused at
everything that's going on
i don't know if it's gonna stop for the
lights i don't know if it's not gonna is
it gonna resume right now
i don't know i also agree that it's very
confusing is this considered a red light
where it won't
zoom is it going to creep that far
forward and then
tell me and then stop
no i have a lead car so it's gonna
follow him okay oh is this an
ad it should chris says it should resume
since there's a lead
should resume since there's lead okay i
resumed it was good
we need a destination in the gps its
placement here is worse than ours okay
you wanna put the office in
okay sorry guys
you can't see our office we de-listed
from google maps
oh you found it
why isn't chris in the car with you well
he didn't come in early enough to get in
the car ride
that placement was not good we miss you
though i mean it like it like brought me
over to the lanes i should have done
that much more smoothly
i mean it was it wasn't like bad but it
was just inhuman
oh i'm sorry i'm getting oh it says ap3
isn't this bad when used by a competent
driver
oh okay what about this guy okay i'm
gonna disengage for this
and for some reason even though i
stepped on the gas we're still engaged
that just confuses me
oh we disengaged the auto steer when we
turn to the thing
it explicitly tells you to keep your
hands this is is this ap two or three
how come i can't it's three how come i
can't it's three
how come i can't engage i don't know
when it shows a yellow
i know sorry guys i don't know where the
gimbal was maybe you can't see the lane
yeah
that would be a good guess in 500 feet
turn right on to b street got you b
street
okay we're back it's a nice noise
the sound is more pleasant than ours
their sounds are nice
how's mine driving oh there's the
mcdonald's
[Music]
you guys you're just experiencing how
bumpy the ride is for me
i mean is there a steering wheel icon
when you can engage
uh oh maybe
i'm gonna put you guys on the dash all
right we're back on
let's go through this intersection here
okay we're coming up to a red light here
okay good good job on that that was good
oh there's a gray steering wheel icon
that was good
this is not the beta if someone has
access to the beta though we would love
to take it we would love to try it we
will
happily pay you if if it's anything is
this
ship test
it's blue and engaged i see it now yeah
i understand it
and you know i will get better at this
some of this is me just trying to figure
out the ui
okay so i gas to resume oh my god
okay i didn't build it
if i wrote the code i wouldn't do that i
agree it's stopping for this one too
okay i'm gonna guess through it
oh you guys through it i gas through it
yeah not guessing if you're gonna have a
stopping on green light you cannot
disengage for gas jesus is so very jerky
in the car right now
you know okay my foot's lightly on the
gas now we're not going to do
advancements
500 feet turn right onto that we got to
cut in from this truck and it kind of
okay do what a human would do here
oh they said you can use this stock
drive down to fifth avenue i can use the
stalkers
okay okay that's nice disengagement for
necessarily
what disengagement for gas no we love
disengagement for gas
disengaging for gas is bad if you're
gonna this is not georgia's first time
in a tesla
this is my first time trying to like
autopilot really the only time i really
used it was on the highway
i was in a car that didn't have navigate
on autopilot and didn't have all this
500 feet turn left onto ash street
okay okay and what about this guy
but that placement was good good
placement there
a little too close to that park car but
still
open pilot would make that same mistake
we got about 350 people no sorry thank
you oh good job good job with that park
car
now turn left onto ash street it's
really bright here
it's a little better with its
positioning on parked cars and it's a
bit worse with positioning on like going
through intersections
which is what we expect
oh my auto steer speed is restricted to
30 miles an hour um
george might still be banned from buying
a tesla we don't know he hasn't tried
again no you want a president
you may not he would like you gonna stop
for this red light okay
good good good okay you're telling me i
can press the stalk to resume
which direction do i press the stone
yeah what do we do to this and can i
press the stalk now
to resume or do i have to wait till it
turns green
down down darkness if that lowered the
speed
wait till green and down okay i pulled
it toward me and it resonated thanks
dork mo
down low is the speed okay it's going to
stop for this again i'm going to press
thing to resume okay that was pretty
good i pressed the thing early enough
okay if you press it early enough it
won't slow down for the lights
but this is still awful ui like i feel
like it's one of those like like little
little mobile mini games where you're
like you know you gotta like press the
button
it won't let me go faster oh my god okay
in 500 feet
turn right on to state street our
traffic light thing is not going to stop
for fucking green lights
this is definitely not a stream for
children
oh my god oh my god the acc is still
engaged
oh my god uh i'm stepping on the brake
why is it break why is this oh man sorry
guys it is
it's really bumpy on the roads too here
um this car is bumpy
open pilot's so much better buy a 20 20
on a sonata
buy open pilot turn on that kale toggle
you'll have a much better time
should we take it on the highway
everyone says the highway is good yeah
let's do it
we have we've almost 400 viewers all
right let's go to the highway
the highway is good guys everyone
go pick me up chris you want to come
outside oh okay chris wants to come just
come outside
we'll wait we'll make a right in front
of uh we're chilling by the 7-eleven
in the bike lane they can they can give
me a ticket
run chris you better run wait can we get
some air conditioning open
yeah we let's let's take a minute maybe
we could put some some music on
we had machine gun kelly in here are we
are we gonna get a
strike or whatever copyright strike
uh oh we got here we go take us to my
downfall radio let's go
with spotify now good for tesla
you open the doors oh yeah look who it
is
fam we gotta be virtually chris here who
can't figure out how to get in the car
because it's impossible physical
button on the left
you guys know what i always say about
tesla right now chris you gotta press
the button don't worry i got it
wait you know what you know what our
slogan is
a comma it's make driving chill you know
what ours you know what tesla slogan is
is look at these cool features and a lot
of them suck it's a cool door though
yeah yeah i got it i got it
oh get that balcony no buy a 20 20
sonata and a common two you know
all right highway time
george is a gentleman yes he opens the
door for chris
oh i gotta put the pin in again
should we bring the gimbal no
the gimbal can't even tolerate the jerky
not bad at all like i think that's just
that someone who's really
sensitive it's it's really good i've
been trying hard to keep it stable it's
really good
you mean the stream or autopilot stream
yeah
look at the text that cone that's so
useful
wow great job good thing they put time
into that
and not into like you know going on
green lights
wait well the driver door automatically
closes when you step on the brake
is that true that's cool can we really
talk about how tesla's traffic lights
are worse than nothing
because they don't go on green lights
like open pilot goes on green light
tesla doesn't see color
i mean it goes on red lights too but you
know
at least that's better than this yeah i
agree
i feel like i'd rather disengage if it's
red than have to
engage everything or like do something
exactly exactly
yeah um our lights are gonna be way
better
just like i think our lane changes are
way better okay it's in it's in standard
lane change mode it's not in like mad
max or anything
so hopefully we'll get an automatic lane
change they're supposed to be unprompted
we'll go north yeah we'll take five
north it's not in mad max certainly
no no no you won't put it in mad max
yeah i can't wait can i change it while
i'm driving
or because open pilot doesn't let you do
any of that
so all right customize navigating
autopilot mad max let's go
we'll also rent a model three or noi
this is just what was available
on tour oh no i'm never gonna do another
one of his crappy
put it in mad max i put it in madness
someone said you can't
i got mad max don't worry what is mad
max who knows
so yeah that mad max just know isn't it
like a movie
great film
do have to say tesla's nav experience is
great i love the map
super responsive all right will it get
on the highway
it's aggressive it's very aggressive be
careful
well open pilot wouldn't make me
disengage to do that turn
yeah it should be that'd be on autopilot
though nothing around the exit
all right uh i guess you have to put in
a destination
you want to put in a destination
pick a destination where are we going
all right is it going to make an auto
lane
change okay because you're not going to
never get an autopilot
or something now see what's close
um why would you go to utc mall
uh yo yo yo yo utc yeah taipei
tc tc utc
mall westfield utc
[Music]
okay bring me toward that truck there's
a disengagement
there's an idiot
that's not the jersey slide bro when you
do the jersey slide you gotta be
chill it's the pushing the blue buttons
really confusing
like are we navigating on autopilot
or we navigate on it's just it's really
do we need to push it no this is this is
too far
let's go to sea world oh navigate on
autopilot will only
change lanes for you on the highway you
have to press the blue button we're on
the highway
sea world instead now yeah yeah maybe
see what's not to go sea world
seaworld oh my god
[Music]
2.1 miles wait can i make it can i can i
tell it to make a lane change
if i put the blinker on will it make it
lantern okay
do i put i don't put any force on the
wheel i just turn it on i think
you keep the confirmer there with four
cylinders i think it's like ours is it
like ours okay go make the lay change
they're saying you have to press the
button i'm pressing the button
it did it wait that was that was that
was mad good that was mad good everyone
says you have to push the button
no that turns it off we have we have
navigate on autopilot by default on
hello it's doing this automatically
apply slight turning force to the
steering wheel oh that was just for dm i
think
yeah everyone is saying multiple times
you have to press the blue button
it's already pressed okay upcoming lane
change tap to cancel
whoa wait where does it say that right
up there oh wow
okay this is good this is good on the
highway this is solid driving
it's gonna get over at least one lead it
is confusing
but i think you get used to it it's
taking
[Music]
okay lane change tap to cancel
so it's just going to do it on the
coming rain change tap to cancel
oh it canceled itself it cancelled it
itself okay let's see we'll do it
it seems to be like steering force yeah
yeah
there we go okay that one was not as
good
it wasn't terrible though it wasn't
terrible no the first lane change was
better but it's clear that their lane
change policy is not
like it's not like ours it's not learned
why does it center on things like that
charge
well why did it center there because
they don't have any kale tesla doesn't
know the kale
[Music]
all right i don't want to change lanes
into this motorcycle okay changing lanes
to follow route
all right he's behind me we're good good
all right we'll make a change okay okay
now take exit 21 i guess i would learn
how to really trust that we're in a
model x
oh no oh that was there's a lot of
uncertainty
there's a lot of uncertainty there
[Music]
stopping for stop r ah
not great not great not great it had so
much time and it had so much time yeah
that was not great
yo let's go to sea world chris you're so
right sea world is the right choice the
destination oh it's stopping for traffic
control
in 200 feet oh great so really that's
what's going to happen here it's going
to stop at this thing
i think it's going to turn left or is it
going to stop
you have to take over okay did it only
stop because
okay okay not chill
chill man i turn the wipers on or
something with that
i hit the wrong stock you turn the
wipers on guys
listen buy a comment too when a 2020
scenario have a better time
no okay to be fair the highway was very
good
i had zero complaints on the highway
there
the lane changing seemed a little
glitchy
um the first lane change was solid the
second lane change
was not as good though again like you'll
occasionally get lane changes that
aren't great with the comma two either
so okay hang on uh oh it's stopping here
okay
okay i'm pressing the button all right i
have to pull it toward me to resume
that was really confusing because i had
a lead car
good movement around that curb
this is very like bumpy in uh
some things okay once again it's gonna
stop for this green light so i'll pull
the stalk toward me and then it won't
up or it will up okay i don't know why i
did that that was not great
okay okay i'm here in here here we go
[Music]
what we got 20 battery left oh wow we'll
head back
we'll head back soon
it's gonna stop for that light again
yeah can we turn traffic lights off
they're terrible
okay knock right it's not great to those
intersections
they're doing some some hand code
replacement policy there
good luck with this road out this road
is so bumpy it's not me it's really
funny
all right it's time for a stop car
that could be more smooth on the brakes
on the phone yeah
it could be more smooth on the brakes
than that
okay i'm turning off this stupid traffic
light shit
cancel auto stealer dear to disable
car must be in park to enable okay well
i'm turning off traffic lights and stop
signs because they're terrible
i don't want it now i assume it won't
stop for green lights now
okay guys like i said before if someone
has access to the full self-driving beta
i'm happy to review it i'm a vlogger
i mean yeah this kind of placement is
hard to mess up even super crews could
do this oh and you can't engage it here
but if you could engage it it would
probably work
speed up a little i'm gonna piss off too
many people i'm a vlogger and tesla
keep some sea world action over here
maybe one thousand feet yeah rides are
bad right
fun all right we're turning around sorry
that was rough
oh this road's just really challenging
we're gonna make a u-turn here we're not
going to see world never get on
autopilot
off actually you guys yeah george is
probably not banned from buying a tesla
anymore he tried to buy one many years
and then the next day they called him
and let him know that they were sorry
but he couldn't have one
yeah this is many years ago and he
hasn't tried to buy a tesla since
all right let's go back to the office
navigate
we got things to do here we go we got
work to do boys
we got work to do we're going to ship
our own our own traffic lights and it's
not going to stop for green lights
and we you know we ship dm that doesn't
lock you out randomly
all right stop car at light let's go
let's go
oh oh my god oh
that was so bad that's terrible oh
that's worse than open pilot
i thought tesla was really good at that
uh
i guess we just got a lot better i guess
we did
that was brutal i mean to be fair i was
going 60 i don't know
is not that great at that we might have
done the same thing
this is like a rv town you want to show
them all the all of the stuff
look at all the stuff what are we
looking at i don't know let's navigate
on autopilot oh it's already gone sorry
i
can't do this so confusing so confusing
there are some things that are a little
hard but i guess you get used to them
but for a first
it's my first time today not good
placement not good
no human will move over there
okay and he
look at that human you see how he's you
see how he's not centered in the lane
kale will put you over there
like every human wouldn't realize you
want to be closer to that side
1000 feet that's right okay so let's
what are they try you turn can't believe
they haven't had phantom breaking yet
we did we had two hits of phantom
breaking
or at least the car hit we
they stopped for green lights and
terrible and you just want to um
so it won't navigate off it's not good
the subtle placement open pilot's way
back
all right we're losing viewers and i
think it's because we disconnected
yeah but it seems like it's back are we
back guys
we're back all right
all right all right it's trying to do a
lane change
[Music]
okay uh oh it makes okay
the dm is linked to the lint change
pause okay we're not gonna make it
we're not gonna make it oh god
rough disengagement oppail would have
been chill there hey brevin
let's put all this to your back on
because george has good credit
that's not why he was rejected great
credit boys
great credit 800 boys uh
[Music]
alex want me to get a middle shot of
yeah
that's great the navigate on yeah
all right their high replacement feels
more solid than ours
definitely less ping-pong when the tesla
they really got that they really got
that dialed in
uh we know we can better make this but
the trade-off that tesla makes that we
don't is they're
much more abrupt on the wheel than we
are so that's the trade-off right how
tight you want your controls to be in
tesla's controls are much tighter than
ours
uh but tight is also you know abrupt
corrections which we never do
um their drug monitoring
is terrible uh and their traffic lights
are useless
uh their lane changes are stressful
uh their navigation interface is very
nice
uh the taking exits from navigate on
autopilot if that's like reliable
it's very useful it seems um
i mean it feels reliable they don't like
give as much feedback as open pilot i
don't like their cartoonish you buy
as much but maybe that's just preference
um making a lane change
now mad max
you have to go out to the right
eventually oh oh okay changing lanes
into faster lane thank you for telling
me why you were making that lane change
i did really like that that was nice
that was the first thing that was nice
the whole car i mean it made me it made
me touch the wheel in the same way
it was the same as opponents like the
the nudge stuff
yeah um some of these stuff is like
toggle in the settings and maybe if you
turn off all their beta ship this is
much more usable
um i did use autopilot for a thousand
miles
my only real hilarious complaint about
it was the phantom braking
like it almost got me to max
[Music]
oh i mean we'll take it it was good it's
good good place
good place no actually it felt like the
longitudinal policy adjusted there to
make that lane change
so that was good changing lanes to
follow around okay so i do have to like
acknowledge them with the touch of the
stupid even though i told them not to
which is fine i'm supportive of that i
just wish it would like
be consistent
[Music]
uh the navigator autopilot toggle is
terrible oh the
not centering it oh yeah that's bad
placement bad place but our place is
better than that even with
a landfill should have saw that cutting
a long time ago
okay and we have a lead car
okay navigate on autopilot on autopilot
ending
okay now now it's now it's okay
um okay good placement there why is it
stopping
we oh press accelerator to resume
because then it
because you ended up getting it never
getting autopilot so you press the
accelerator to resume even though i was
still in auto steer
who would test this and thinks this ux
is good
but at least would please not stop at
this green light oh perfect didn't stop
at the green light
is it picking up the cones george oh yes
it is yes it is
oh it seems the cone i mean
oh i had a person walking on the screen
did it yeah
was with his legs moving correctly i
think they were moving the backwards
generic walking legs i think they were
moving the wrong way
all right so it lets me engage here it's
not going to move over for that is it
well i don't like the i don't like the
resisting of the steering wheel like i
don't find that i felt like i could
correct
that in a much more chill way
uh but again maybe that's preference you
know disengage on gas is preference
is on the right cone guy should get a
raise he's done excellent work
i mean he does a great job of detecting
she they whoever runs cones
yeah we'll make them back from sugar bag
on cones
all right boys any other questions
about my tesla experience i'm going to
give this tesla well let's see so
if i were consumer reports i would rate
open pilot number one uh
this number two and super cruise number
three
great some of this might be preference
and you get used to it with time
i found all their fancy features to be
totally useless except for taking exits
i'd never get on autopilot
uh their automatic lane change again
it would only take one if it made like
100 lane changes and on one lane change
and tried to change it to another car i
would never trust it again
so like that's the problem with that if
it's really if it never
makes changes and like makes unsafe lane
changes that i feel good about i felt
all the lane changes that made her safe
um so yeah i mean that was something
that i would just trust over time
uh their traffic lights are totally
useless
i didn't even really get to try their
stop signs because they're linked
together and i can't just turn off the
shitty traffic lights and leave stop
signs on
uh yeah any questions
we don't really have any questions
people agree um
i think that's it great slow on curves
though
thoughts yeah not good i didn't see any
i didn't see any serious that it would
slow
randomly for reasons that i didn't
understand on a scale of one to ten
what do you give the lane keep
performance 10 being perfect
on the highway i give it a nine um uh
going through an intersection i'd give
it a six
uh and i would give open pilot on the
highway and eight and i would say open
pilot going through intersections is the
seven
oh will we try again at night how much
different will it be at night
all right a giant screen interface well
oh if we had a giant screen interface we
would definitely do things differently
um new open pilot hardware will ios 4 oh
my god
all right guys this is just garbage none
of your limitations of the hardware slow
down
we need slowdown for turns we want to
try the full self-driving beta we need
slowdown for turns it's actually good
um i was something where i thought tesla
was better
and it might be just calibration on this
car i thought they were better at
stopping for stop cars
i tried autopilot when we did the cometh
2 demos
in vegas and the comma 2 demo autopilot
did a better job stopping for stop cars
than us
and now i would say it's about the same
um their merging seems
a bit better but only marginally so uh
it didn't do the hard merge but it did
do some civil merges that i
think you're going to get on the new
open pilot with the cutoff detection but
i drive a candidate sonata which has
stock
acc and the stock acc won't get itself
george will we ever had a toggle for
disengage on gas
no no you disengage on gas
stop not disengaging on gas it's it's
the mode confusion on this deck
if if there's anything that i really
hated about this experience
it was how confusing like i had no idea
what mode the car was in
i do agree it has weird icons sometimes
it just said
auto steer unavailable and didn't tell
me why
uh so no we're never but the flip side
of that is tesla disengages for steering
which i think is terrible
because every time i like turn the wheel
and want to make a correction
to it it fights me until it totally
stops fighting me and just as a human
like my controller them overshoots
yeah i didn't like that there when i was
like in that like you know it was too
close to that car door and i wanted to
subtly adjust the placement it did not
let me
you know hyundai long is the dream you
like hyundai long
no no someone someone's saying hi
hyundai long island along with open
pilot
i thought that was pretty good it's the
best long of any of the cars i've seen
um honestly like i'm part of tesla's
pretty much it's also a little better
oh yeah someone's never been inside a
tesla it's quite nice you can see the
giant windshields
pretty impressive it's very big the ride
quality is not that good though well
what did you think golf cart i mean it's
always the tesla ride yeah i guess
i don't know i would not get if i was
gonna get a tesla i would not get this i
would get like a performance
model three i rented a performance model
three and i had a great time
uh but you just have to remember that
you're not driving a car you're driving
a golf cart
wait what's a performance model three
the dual motor performance
oh this has dual motor too yeah this has
dual motor but like
again when i'm driving your car that
looks like this i want a
i want good ride quality like if i was
gonna buy a car
in this class i'd buy like
i don't know like like a like a mercedes
or like like an audi you know q7 i get
audi like q7 or something
or uh or that
xc90 volvo like that's the kind of car
i'd buy i buy a car with good ride
quality not this
um if i'm gonna buy a tesla i'm buying a
golf cart and like i got to be okay with
the golf cart style handling performance
and ride quality
but you also get that golf cart style
torque which is cool
torque is cool oh
no i mean we're working on hyundai long
an open pilot that's a
big before we can do countdown long we
need vision all day long
and we're not a visionary long yet greg
has
the palisade or had the palestine
open pilot golf cart support when good
question yeah whenever you do it man
you guys an end-to-end status report
it's a work in progress
and lateral which is way better than
tesla and the placement those are
those in those intersections and the
test i mean the other thing that it does
and like oh pilot we'll do this more
with the lanes on but i still think even
less than the tesla again tesla's
controls are very tight
when there's like a lane kind of merging
in tesla'll just go right to the center
pretty much
uh if you put laneless on we don't do
that at all because humans don't do that
if you put lane full on it does it a
little bit but i still think not as much
as tesla
do we like the ic visual feedback or do
we prefer the open pilot screen on the
windows
pilots i think that this is cartoonish
and tells me nothing
uh the full self driving one though
looks much better because the full self
driving one is like like there's too
much
processing you need to do um
the full self-driving one looks much
better because they do less processing
this is too processed to tell me
anything useful
and then there's these alerts that show
up and they're like very confusing it
can tell me like multiple reasons why it
can do things
and again this is probably something you
get used to with having the car
but it's not an out of the box wow
feeling which is like you know what
we're going for
george can you show for our open jobs
show for our jobs
um all right so y'all want to help out
with uh
all right so you know what i said about
machine learning right machine learning
has nothing to do with math i don't care
if you don't know calculus i mean okay
remember high school calculus because
you're a smart person but like you don't
have to know any fancy calculus you
don't know any fancy math
machine learning is all an
infrastructure problem so you got to
know infrastructure when i ask you about
like you know
how like the sata interface works on a
computer and what pcie is and what that
looks like and how that shows up and
mm-io and those kind of things you don't
know about that kind of stuff right
so if you want to come to infrastructure
uh that'd be great
if you're interested in doing research
uh you know research is not actually
research it's infrastructure
but if you're interested in like you
know uh big data analytics kind of stuff
uh come work here okay so we're doing
red lights and stop signs we're gonna
use stop lines
we're gonna basically ground truth we're
gonna take from our ground to
all the places where the humans stopped
and then we're going to
predict that and we can use that to do
red lights and stop signs so that should
be pretty good
as like a stepping stone to end and
longitudinal uh
if you're just working on those kind of
things if you're interested in just
increasing performance of things what
else are open jobs
um if you happen to wanna just like you
know come
like like chill and build circuit boards
for us that'd be cool too
uh nav you know mad chill oh nav
yeah yeah yeah we need someone i mean
look nav is mostly like i'm gonna ask
you basic questions like do you know
what geocoding
is and if you don't know what geocoding
is like yo you're building nav uh but
like
nav isn't like like you don't need to
know like a star we're all just gonna
download valhalla and call mapbox right
uh but you do need to know you have to
have some design sense you gotta be able
to do
like modern c plus plus qt
uh you know this is this is this is qt
this is this tesla's uis qt
we've recently switched the open pilot
ui to qt uh
c plus responsive you know no more no
more android bullshit no more reacts no
more javascript
uh we don't have any positions for
technical non-dev people
right now what would you do i don't
understand what you would do there's two
legitimate roles in a corporation
there's operations roles and there's
engineering roles
right like what would a technical
non-dev person do why are you gonna be
on the phone all day
i don't know like internal tools i don't
know oh well internal tools is
development
yeah i know i don't know right uh
we have talked to carpathia in the last
few years operational roles supporting
the customer and that side of things and
there's the engineering roles but like
oh well i'm a technical knowledge
fucking pm electrical engineer
yeah we'd hire an electrical engineer uh
particularly if you like can come in and
be like yo here's why your your
your rf stuff is annoying rf that's
really annoying you're like an rf genius
like
not like you know like i got like a phd
in rf but like yo i've been building
radio since i was 12. like that's what i
want to hire
no car insurance um no
car service is boring we're we're we're
out on the car insurance
uh no there's no plan to separate the
comma screen from the common camera oh
my god they always talk about why do
they want that so badly
because they think they want it and then
they're going to build it and they're
going to be like wow this is really shit
is this what ghost is building
that's going to be a ghost go buy a
ghost you know i don't know what's going
on over there if i was building
vaporware i'd name it ghost too
brutal brutal all right george closing
remarks
uh closing remarks yo yeah um you want
to stop self-driving cars
come work here uh like you know like be
smart
like you're smart and you want solve
self-driving cars com is a
cool place to work uh you know people
here are real smart
there's no bullshit there's no lies like
we're not lying about anything there's
no
there's no pretense right all these play
out too simple just did their ipo you
want to talk about pretense and bullshit
well that's all they have because they
don't have a product right
we have a product you got to see what it
is it's going to incrementally get
better
if you compare open pilot 0.8 to open
pilot 0.5 you're like wow it's way
better if you compare 0.5 to 0.2 you're
like wow it's way
better right so like get ready you know
um what's that gym class heroes line
it's like you know 08 is going to be
great imagine 2011.
it's like that kind of thinking you know
like just imagine how good this thing's
gonna get until we get all the way to
level
five and you know superhuman
self-driving and then we push into
solving all of our robotics right we're
gonna pass the coffee test
um now we gotta solve self-driving cars
first stay focused
uh great yeah if you wanna come work
here jobs
at comma work at kamehameha give me a
job at call my eye
no it's actually say we're
chris what's up we're heading out yeah
all right bye guys have a great day
thank you
out
we'll leave them to work because it's
getting cleaned
but yo
we are purchasing a kia
ev6
in order to take comma to the future of
electric
because environment does that make sense
ah
yo yo yo yo yo yo
what's up
it's leaving it's leaving i don't know
where it's going
it's leaving check it out
we bought an ev6 yo you guys you you
don't want to know how much i'm paying
for this thing
you don't want to know how much i'm
paying
what up bugsy
good to see you back
still got a subaru look it's going it's
going over here it's going to get
cleaned it's blue
we got a blue
ev6
uh we're five grand five grand over msrp
is our is our markup
uh we called them all
some of them were doing even more
so uh we'll take it
we raise money for a reason
no no we're paying five over msrp
what else we got
yeah i don't believe we'll leave them
but why are these all ev6s
oh they have a lot of them here
this silver one looked good
yeah yeah but this is the all-wheel
drive we don't want the all-wheel drive
useless
that silver does look good though
what do you guys think the silver
look at all of them
we got blue
oh this matte silver is really nice
looking though
nah but oh it doesn't have the white
trim okay i don't like the interior as
much all right all right i like that i
like that white trim interior
you think blue and red are the best
looking all right all right thank you
thank you
i see does this one have the white trim
interior
nah it's all black no no the interior is
so much nicer on ours
oh yo
all right so we're here at kia north
county in escondido
uh what are these things are these
tellurides
oh sorrento
um
so you know that we're splitting the
cars up we have gold cars silver cars
bronze cars uh no it's not all-wheel
drive
it's just rear wheel drive we are in
sunny southern california
what is this thing
nero do we want one of these
should we buy a neuro
what are these oh these are stingers oh
stupid gt line rear wheel drive hey
um but yeah no we bought an ev6 uh for a
bunch of reasons
one
um
it's got can fd
two
hyundai's are
we have two gold tier cars really our
gold tier cars are toyotas and hyundais
hyundais have the torque
they have the longitudinal
uh this car has four corner radars
uh so we were doing tests today
where we were like can you drive the car
to taco bell with a joystick right so
can you joystick drive a car to taco
bell um remember as long as joystick
driving is okay
as long as you're still obeying comma
safety model right
of course we got a gt line of course i
bought that hda2 we have the front
radars as well
um
so yeah we have hda2
my hope also
is that uh what is this one up here
oh wind all-wheel drive
what am i going to do with an all-wheel
drive
i'm in calvin california
um and the the rear wheel drive is uh
gets better mileage
is you all will drive faster though
does your wheel drive have more
horsepower
toyotas are better quality than hyundai
i have some real doubts about that
[Music]
wow
[Music]
how long are we keeping it for i don't
plan to get rid of it
i'm gonna think i'm gonna trade my
sonata i think i'm gonna be driving
around in the ev6
wow that thing that that delorean silver
though is very nice
wait the all-wheel drive is faster how
much faster should i go inside right now
and say we'll get the all-wheel drive
instead
225 horsepower now the other one's 225
horsepower too
this one's all-wheel drive
some of us are in financing right now
oh wait this is all-wheel drive what's
this one
there aren't many rear-wheeled
rear-wheel drive comma drift yeah right
i don't i like real drive cars which one
of these is
george you can't put chains on the tires
wait no no no this definitely doesn't
have a 320 horsepower motor
uh
this is all will drive it as 225
and the last ev6 in the row they're all
all-wheel drive and they all have the
same motor
uh if it's faster it's only tiny bit
faster i'm not sold
just because i can get more
more go power i guess not get more
horsepower 225 you know
but yo it's responsive it's got that low
end torque
um
yeah
comments on common body well
did you oh it's coming along nice it's
coming along nice
um
no silicon shortage for all-wheel drives
right
what charges does it use i don't even
know i've never owned an electric car
before but um you know we care about the
environment and we're going to the
future
three slims not happening
then the there is going to be a rev in
the comma 3 but the rev is mostly just
so we can save money
um
and we can decide whether to pass that
savings on to you but the answer will
probably be to pass the profits on to us
what cars can make it a taco bell on a
joystick that's a great question no
nothing's 320 horsepower there's no cars
here that are 320 horsepower
um
this here is a gt line
all-wheel drive
and it's 225 horsepower
oh wait that's standard rear-wheel drive
features oh my god it is 320 horsepower
oh i'm kind of sold
oh i'm kind of sold
look at this look they dupe you
they've the standard look at this here's
the standard gt line i'm sorry for ever
doubting you youtubers and here's the
all-wheel drive with 320 horsepower
[Applause]
all in 426 feet pound of torque oh my
god wait should we actually switch
am i buying the wrong car right now
should we switch to the all-wheel drive
oh
all right we're gonna go we're gonna go
alex isn't financing right now should we
switch
do we want to switch
keep the blue though keep the blue
switch it's less than 4k more it's not
less than 4k more it's like
oh they want all-wheel drive yo
yo 320 horsepower it's pretty nice
that's pretty nice no no no no no no we
got to be responsible with money boys we
got to be responsible with money we're
buying the rear wheel drive automobile
we're buying a rear drive automobile but
when we buy the second one of these
we'll buy all-wheel drive wait alex you
want to switch
you're the one sitting there and
financing i don't know
i don't like the i don't like the uh
it is only three comma threes
oh
oh switch
switch to the silver
uh
does the business need 320 horsepower
that's right okay listen listen listen
if three of you buy comma threes right
now we can afford it
no
it's my yeah right i lose range it's
just i lose range
i lose range i lose range
same battery no same battery less range
because something's got to drive all the
all the extra horsepowers
silver all-wheel drive wait alex do you
want to switch can we actually switch
i don't like the seat as much either the
other seat has this nice white trim on
it and this one doesn't
but the silver does look nice
what's the benefit
yeah what's the benefit no that's a good
point the business does not need 320
horsepower
yo but they really if that sticker was a
little bit more
yeah yeah yeah keep the blue seems nicer
all right all right we're keeping the
blue we're keeping the blue we're going
with the rear wheel drive ev6
uh
yeah yeah the range the range is less
good
the range is less good with the
all-wheel drive also the all-wheel
drives are more common
you got one second alex
rear wheel drive
final answer
um
more tire you have to replace all the
tires
spend the difference in tackle valve now
but
yo yo yo we are getting uh we're getting
an ev6 we are bringing comma into the
future and i'll tell you the future is
actually probably about 80 gas cars 20
electric cars until we upgrade our grid
alex is in financing right now
purchasing this car
um
how much horsepower does this have
didn't even tell you
sticking with blue we're sticking with
blue no i'm looking at the silver more i
like the blue it's also that car has
really nice has this white accent on the
seat
it's really nice
um no the kia ev is
uh look i don't care about the
environment you all know me
uh but i do care about nice stuff and
this car is nice electric is nice and
that's really how you have to do it
uh you like the silver one better alex
oh
no i don't know
i'm looking at it up close i think the
blue is the right choice
no but we don't buy evs because they
save the environment we buy evs because
they have low end torque and more
importantly
regenerative braking what maybe you pick
the ev6 over the ionic 5 i like the
styling on the i like the styling on the
uh
on the
uh alex we're not going with the
all-wheel drive
i liked the styling on the ev6 more
um
but yeah i mean it's the same platform
it's pretty much the same car
uh it's interior it's black it's black
with his white accent that's pretty good
uh i'm going to go look at our car
oh it's out of detailing where'd it go
i think it might be around front
uh just comma three matter kia or
hyundai they're basically the same car
though the kia to buy access to the kia
thing is is i don't know i didn't buy
the kia one but the hyundai one is forty
dollars and the genesis one is a hundred
dollars i was looking at the tech infos
when am i going to show you the car well
where is it
where is my car
as soon as we buy it
if we wait around to buy it i don't know
um
we can look at these other cars
does it have the lockout honestly we
don't know
we don't know i am here to gamble
um if it has the lockout
uh
alex says you don't need me anymore i
could go home no i want to drive the ev6
home
uh
sorrento
love the silver
uh is this going to be my daily driver
yeah i don't know
we'll see it'll be around the office no
i like the blow why not
look you got i mean i'm i'm i'm tempted
by the horsepower you know i like the
horsepower but uh
you know we'll stick with the blue
uh
you should you get a tesla with fsd or
comment three on a new used card look if
you're asking me that question bro
buy the tesla they'll have someone who's
gonna give you support
um
yeah we're looking into a firmware mod
for the sonata
uh you know i think the lockout is an
anti-safety feature i think the lockout
actually makes things less safe like
what kind of stupid system drops torque
at 90 degrees
uh so stupid that's not a safety feature
right like less torque is generally
safer than more torque you can make the
argument that less torque can be less
safe in certain scenarios but overall
is this because the corolla can't get to
taco bell yes we were gonna buy a lexus
es if the corolla could get to taco bell
but i think our future is hyundai
um no no chevy bolts
toyota's yeah toyota's are gonna add
security oh uh
the future is hyundai kia and genesis
of course i have a common three in my
hyundai sonata just bought a comment now
go get the 320.
no no we're already it's already done
it's already done look how rare blue is
you see any other blue ones no it's
because blue is great it's actually
called yacht blue
um i've read this form thread
the the issue is steering wheel
well the issue with the sonata is once
you get the steering wheel to 90 degrees
it stops applying steering torque
um
so you know expect to see a lot more
love
for kia and hyundai
uh kia hyundai genesis this stuff's the
future of comma toyota is still the
future too honda is not the future if
you bought a honda you're not the future
um
[Music]
we were doing that we're doing this new
star system and the problem is the
hondas uh don't have torque they don't
have steering torque we can never ship
mods
so you know
uh
oh those white seats are nice look at
this car oh look at them white seats
pretty nice
um
ooh ooh the gv or they make an electric
gv70 i was looking at the g80
and i just couldn't with the uh
i i didn't like the steering wheel i
thought it looked so ugly
like did they and that was like the top
comment on youtube like i was thinking
it before youtube yo so i wasn't like
influenced
who's honking
[Music]
going on
yacht blue
that's right
that's right yacht blue
uh
the worst part of any genesis is a
steering wheel it's such a terrible
steering wheel like i couldn't i
couldn't buy that car
i couldn't be happy oh they're honking
just
honking solidarity
someone with an all-wheel drive song
uh wait what's the via oh oh yeah i
heard there's some stupid like the
genesis tries to sound like a sports car
and plays sports car noises in your
stereo that's just disgusting
it's just i'm just disgusted by that
integrated comma three whatever happened
i do like the uh what is wrong with
honda hondas don't have steering torque
honda's don't have steering torque how
much worse is the big model delay lay
first master i just shipped an optimizer
so if you're on the comma 2
you're out of luck
but if you're on the comma 3 it runs in
20 milliseconds which is only 6
milliseconds more than the old master
um
oh yeah wait can i disable the fake
noise on my on my ev6
um
should we go back to my sonata
see if it's still there uh what's
steering torque it's how much you can
turn the wheel
um ev6 does it have the 90 degree thing
honestly i don't know
uh
i don't know
[Music]
oh i'm in the way of this parking spot
i'm gonna go chill in the sonata
um what killed the hopes for a potential
corroded cruel taco bell run low end
torque
it doesn't have torque on the low end
um
yo you guys want to go look at other
cars we can just walk across the street
you want to go cadillac's
what's the ev6 the ev6 is kia's hottest
new car i had to pay 5k over sticker to
buy one
uh you can disable the fake noise sweet
we good we good how we good like we're
getting the car soon
like like i can stay on youtube while we
get the car or we're good like we're
going to the next stage of financing
low end tour low speed torque sorry
sorry uh yeah yeah torque at low speeds
well i ship something to correct the 90
degree lockout well my real hope is that
it just doesn't have it
like how awesome would it be if it just
didn't have it
hmm
ah
no i don't stream in church anymore
um but yeah so let's check out the
sonata here
this is the comma sonata
here is our flagship product the comma
3.
uh you guys can check it out you guys
can buy one
uh if you don't already have one i did
test drive at the other dealership i
feel like i need to test out the other
one
um
oh i didn't realize open pilot laundry
oh
wait if i turn this off
does that work
oh that's awesome i think i think i
don't know if that's actually shipped
maybe we'll ship that to the hyundai
oh i think it's probably just because i
have a special uh mod the screen is
stunning on these things you don't want
to know how much i paid for it they're
over a hundred dollars
um let's see if there's updates oh did i
get any updates
oh the sim issue yeah basically um the
pink cell phone carrier canceled all the
unlimited plans so we're going to be
switching to a blue cell phone carrier
um
yeah the blue cell phone carrier
it's registered to you no no no no
you're taking the hyundai sonata home
i'm taking the ev6 home
uh
you can go on road here
yeah check it out we name the branch how
difficult will it be to remove the uh
the the the lockout i think we can do it
yeah i know they're they're the
uncarrier we're very upset so now we're
gonna have to pay per gigabyte with the
blue people
uh
so yeah the pink people are out
um
alex's going to steal my ev6
i'm going to be driving home in this in
this in this sonata
it's like a ev6 it's just not ev
uh greg removed it on the palisade not
on the uh
on the sonata they're different this not
as more security
uh but it's not a problem we can get
around it
all right guys
general comma questions is hyundai more
torque than toyota
it depends um
on
silver one
all right well we'll open the floor up
to general common questions and then
we'll stop the stream
uh unless we're gonna get the car soon
alex we gonna get the car soon or is
there like 17 more paperworks because
i'm sure
youtube would love to see the car up
close where we can turn off the vass
um
[Music]
so yeah if you have a comma two we're
canceling comma two prime
uh you're gonna have to
yeah either get your own sim card and
buy prime light or not a prime
uh no there's no support for german cars
because of flex ray
um is comma on a yearly hardware release
like the cell phone industry not quite
yearly
um think about i don't know what yes
means think about it more like uh
18 months
to two years but we don't do major
refreshes right so you can look like
like the eon gold and the comma two are
quite similar
um
we're going to be on the comma three
platform so the eon the eon gold the neo
the eon the eon gold and the comma two
were all basically the same platform so
the next the next three hardware devices
from comma well the next two are going
to be on the same platform as the comma
3.
um
so yeah common threes are pretty future
proof we were even talking about going
forward if we ever wanted to change the
camera configuration again and the
answer might be no like we have 360
360 plus the radars that are in the ev6
should be enough
uh you're happy with the 90 degree
lockout now eight newton meters is
dangerous yeah i know the key is nice
right you got the key wait let's go
let's go we got to show the youtubers
the car
um more engineers in rotterdam yeah
we're hiring and rotterdam if you want
to go work there
uh absolutely
oh she's grabbing the car from the back
oh nice
nice i can't believe we're already
through all the stuff
um
palisade has the lockout now eight new
meters is uh you can't do that all the
time there's some serious safety issues
there uh
it's also it's interesting how they
measure torque like is the torque before
the amplification or torque after but
the 93 lockout is an anti-safety feature
and we could totally remove it uh you
wish i started twitch again that's good
for you um how is the current failure
reliability rate
no
no no the the comma three failure rate
is is is is we posted it it's like seven
percent or something and falling
um the early ones had some issues but
all the common threes are under warranty
uh the other difference between the
three and the two
is we have uh
we have the parts store for the comma
three so if your comma three does break
out of warranty it's not like you have
to buy a new one like you can fix it
with the parts
um but the reliability seems to be about
five times better than the commenters
uh we're putting a lot more effort too
into tracking down all the failures on
the comma threes oh just pre-order comma
body i don't think we have many more of
those pre-orders left
um current price for comma three plus
amount it's 21.99 for the base model and
then 200 bucks it's you can buy three
comma threes and still not be able to
afford the difference between the rear
wheel drive and the or wheeled or
all-wheel drive
mazda long i'm excited about mazeline
i'm actually very excited about the cx-5
i think the cx-5 has the potential to be
a gold car it's on all of them it's one
of the top 25 cars sold in america
is the remove unreleasable
it's more releasable than the honda mods
it's more releasable than the honda mods
i'll say that uh the comma two updates
for the comma two stop in june
uh
eta on anti-long the new models look a
lot better
uh the new models look the new models
are nice
um we we found some some some bugs
uh promotions uh i mean we do raises
about every year
i don't know like titles are meaningless
you can have whatever title you want we
used to give people titles just because
like titles are cheap but like
you know like there's a few like major
promotions i mean like harold was
promoted to cto
uh are we still profitable hell yeah of
course um yeah yeah we are we are very
profitable in fact we raised 10 million
dollars and our bank account is still
above 10 million dollars so we're not
spending enough money and i've been
saying this we've got to spend more
money so here we are you see i can't
even bring myself to buy the all-wheel
drive um end-to-end teaser videos we're
not doing any more of those i know they
were nice but uh
you know what they do
you'll get it when you get it that's
good
um
we need
uh yo if you can do like like hardcore
infrastructure like you're good at like
like we have to like refactor
basically we need our pipeline to go
faster if you okay
i'll explain one of the problems why
models are taking a long time we have a
firm
um models are taking a long time because
we have a data center that's kind of
small
and
everything's taking too long to run now
we have big plans to build a new data
center but we don't have enough power to
run the data center
uh
so yeah things are a little bit slow but
if you are looking uh to come work here
and you're great at infrastructure is
that my car did i just see my car go by
there's my car
this is my car
where's it going
are we ready
wanna show them the key
yes thank you
do you want to see on a sonata key
check it out boys check it out
i'm sorry did it lock
uh no
rotterdam is only a software development
house rotterdam does not ship any
hardware
great
thank you
do you want to come do you want to come
say hi to twitches checking out our new
all right
yo yo yo yo check it out yes we're still
looking for a new office
uh we are definitely still looking for a
new office
yo i mean really what i liked and why we
couldn't switch the silver is i love
these white accents on the seat and none
of the silver had it
yeah they test the door handle yeah
oh it's locked
look at this thing
is this a spaceship or or what
right
thank you well we're gonna have to leave
the youtubers while i drive but we can
drive around the parking lot with
youtubers
yeah yeah
in the parking lot for a second yeah
yeah yeah
yo
like look at this thing guys look at
this look at this look at this look at
this
oh wait they're capacitive
look look at this empty space here
look how sick you can't really see it on
the how sick is that yo you know what
we're making better though by 320
horsepower if i knew the all-wheel drive
had 50 more horsepower i would have
considered it more and then not gone
with it but i would have considered it
more you can see it all now look look
someone finally built a responsiveness
it's so quiet the only one who can build
software oh and apparently the noise
that it does make is fake and you can
turn it off in settings
they have a fake noise mode
like look at this wheel you know you
know why i couldn't i looked at a
genesis g80 i couldn't buy it the wheel
looked disgusting
really yeah
what did what did it look like it looked
like an old man wheel
look at this
i love this look at this accent like
this is even more pronounced than the
one on the sonata oh interesting the
shape yeah the shape
huh
what what
is this car fully charged no she said it
only has 100 miles on it when we walked
in she said she prioritized getting it
cleaned
so we could get out of here on time we
only paid five grand over sticker though
right correct
wait wait will you see these things go
for 20 over sticker
now we think these are going to be like
the uh the rav4 primes
it's not even yelling at me for having
no seat belt on i know because it's
chill i love this car i love this car
wait but where are we gonna go charge it
we'll take you to l.a i hear they have
chargers there alex we can't make it to
el it's gonna go to your house
i don't have chargers in my house you do
yeah but i can't park in those spots
they're for other people
they have numbers on let's go to the lot
the dgs lot
you can pay i think you have to sign up
with the company great
you want to take this car i don't want
it anymore no i want to drive it home i
want to show also we could plug it into
the office briefly we could plug it into
the office yeah yo it's beautiful guys
this is the future of comma i'm gonna
stick a comma three right there
you're gonna sit back you're gonna chill
does it have creep
can i turn it off can i turn creep off
yeah we got a kia i hope i can turn can
i turn creep off do you guys know
creep just upsets me on electric cars
you know creep
no
you know that tlc song
no no when you take your foot off the
gas it goes oh
um and like there's no actual we take
foot off the brake it goes it rolls
forward there's no actual reason for
this it is charge car or train models
uh yeah
wait active sound design provides a
driving sound for evs off
why would anybody want this are you
showing me using the thing
yeah all right um
smart regeneration system
yeah wait can i turn creep off
i feel like you can't turn creep off on
this car
we have to put it in secret mode how do
i put the konami code in
why would i want that
would you want to ask your building if
we can get one of those spots
i don't know is this going to be the car
drive now am i going to stay with the
sonata
i said it's sad that's a stupid question
do you really think i'm driving this of
course i do
maybe electric cars are kind of
inconvenient
now the question is does it have a 90
degree steering lockout
hda2 is crazy too
a ton of evs don't let you but you have
a break hold
oh i have a break
hey alex we do read the chat
wait wait wait
i will be so offended turn on auto hold
to turn off creep oh turn on auto hold
to turn off creep okay auto
okay good i'll let's do it put on track
okay good
if it is actually applying both the
brakes and the gas right now i'm so
offended
you know what i mean like it could be
doing that
what car this is the kia ev6
gtl version
i think it actually does use the breaks
in the mold
you can see all the details what is this
oh it's um
the wireless charger it's so nice yeah
just put your phone down here i think it
works it doesn't work one has a case on
it no it might work too chimtan laundry
that's right
oh my god she's a real beauty
okay
i do have great nails for touching cars
[Music]
oh did you did you reveal our temporary
license plate number it's gonna it's
gonna be a huge problem isn't it come
find us
they already do
okay
george in the car our wonderful sales
lady christina
did you make a drive already
i'm sure it does but george probably
needs to charge his phone
too turn it off
i assure you george showered
recently
[Music]
i think those under lights are illegal
in california
don't quote me on that yeah
look at the lights in the front
there's settings inside there that you
can basically hit while you're really
okay so the black one has like a texture
trim here
which i really liked but it was very
yeah i'm glad you distinctive like the
blue we were really um unsure about it
earlier today all of that stuff right
now when you go down the window i'll try
to make it pretty quick thanks
in case you guys ever get locked out of
that car there's a key
back here
you're getting the whole experience now
guys
didn't know we were streaming i would
have brought the handhold thing
george is 5 10.
my fingerprints
this is the kia ev6 gtl
you guys want to see what it's like to
be in the back
me too
back here
look at the white trim sonata has most
of these features on there as well yep
you got the blind spot collision
avoidance assist anything that doesn't
fail is actually going to act for you
um so the forward collision avoidance
assist if it notices anything in front
of you um in front of your sensors it's
going to go ahead and almost like bucket
seats
not until you hit the gas again a little
bit more girls got that new car smell
blind spot collision avoidance assist it
detects the car next to me and you're
trying to turn into that right lane
torch has no idea when any of this stuff
is over um but you can go ahead and turn
that off inside the setting
you don't want any of those features on
okay
like the lights in the back have a
button
it's going to do the same thing as the
forward collision just in the back so if
it detects anybody about to walk right
it's going to be ev6 gtl lead keeping
assist and lane following assist you're
going to find that on your steering
wheel it's a little car on the road no
we got a center it's gonna happen can't
see it sorry guys
there is the sunroof
see how we open it though you got the
dual panoramic with displays and the
navigation
right here in the car
which i do want you to connect that
that's going to go ahead and um
basically just make an emergency 911
call for you in case your airbag's never
going to can't happen
oh look how nice the door details are on
because not only does it stop and go for
you um if you turn on your blinker to go
into the right lane you literally don't
have to switch it'll switch for you on
the gt1 yeah i thought that was super
cool
um dual zone automatic climate control
the smart power tailgate wireless phone
charger
vegan leather
seating seated ventilated front seats
power adjusted driver's seat noise you
can alert you can turn that off too if
you don't ever carry passengers but a
lot of boxes so it's not constantly
telling you
um
outside mirrors with the turn signal is
you got the towing package pre-wiring in
here so if you didn't want to add that
in there all you need is the accessory
okay
you got 10-year 100 000 on the
powertrain just like i think hyundai has
that and then you also have it on the
battery
and then you have five years sixty
thousand on roadside assistance
um pop
pop out outside door handles believe it
or not
you have to talk about yourself
[Music]
you got the wide sunroof in here the
auto dimming rear with the home link um
it's very easy to set that up you
literally have a qr reader that can show
you how to set that up okay
remote smart parking assist showed you
how to use that blind spot view monitor
basically the eagle eye cam
parking collision avoiding persistent
rubber smart cruise control with the
machine learning and then the forward
collision avoidance
highway driving assist too and then you
got the um floor mats and that wheel
as well
is there any questions you have
regarding the car the only thing is this
looks like there was a sticker on the
back you guys it has machine learning
is
[Laughter]
uh we do we are going to set up your
first service for you um
here's the trunk it's pretty nice
george the people want to see the sun
touch base on everything the people want
to see the sun right now
the team also wants to know what machine
learning is machine learning
it's
the most advanced cruise control that
you have on any car right now um it's
basically going to switch lanes for you
versus just reducing the speed and
speeding up
[Music]
wow pretty nice pretty nice yeah like
the wide-angle view on here yeah yeah
yeah huh
cool you can use the apple carplay or
android auto in here but because you do
have the navigation in here um you will
have to plug it into the usb port down
there in order to use it in the car okay
got it do you have auto hold in any of
your cars i've just used all the holes
yeah i was excited that it doesn't uh i
hate when the electric cars creep
there's no reason for them to do it
uh so yeah it turns it off
you got the wireless phone charger right
underneath your hand right there okay
um
the phone charger
all doors need to be closed really you
can't charge your phone when the doors
open
i don't know why but yeah
they said they're scared to let a
machine drive the car
[Laughter]
yeah yeah yeah it's really neat when you
use it it's really neat
it makes it worth it no i mean when we
when i test drove this car at the other
dealership that was the only thing i
checked out yeah the news controller
yeah yeah they're good you know they're
doing it really well i think that uh
hyundai and kia have a have a bright
future yeah uh you know really like you
hear all this stuff evs gm and ford i
don't know anyone with a gm and f4 tv
like i don't want to bolt yeah so i got
a bolt forty thousand dollar car and it
had uh manual seats
i used to work for charlotte when those
first came out in 2016. i sat in the car
for 30 seconds and i'm like there's no
way i'd ever buy this
yeah yeah yeah really all right your
phone battery's dying you may actually
need to plug it in i'll use the
convenient wireless charger
you want
okay cool
great
let me say bye to the people
are we done we're done great thank you
very much
both keys i have both keys yes
i do thank you so much thank you guys
we're so excited you're really proud
yeah yeah thank you you're making a move
so quickly
thank you guys
thank you
all right
yeah i'll see you back at the office
show the sunroom
bye youtube
goodbye
thank you all
can fd port coming soon i mean yeah this
is gonna be our first canon fd car
level five let's go
level five let's go
bye
it's good
dang i'll just get the map up here so i
don't uh don't miss an entrance
uh we got seven more miles to go i
thought i'd come back on and show you
give you my critique of hda2
um so first off
the first thing you notice is look at
this uh you don't see it right now but
when the cars get next to me you can see
them appear on the radar uh you can see
that the radar is tracking two lead cars
which is all pretty cool
their lateral policy is good but it
ping-pongs
and there's that
um and it gives me alerts
you can see it can do automatic lane
changes though i'm not sure we're gonna
see if it'll ever actually make the lane
change without
i think i have to nudge
or keep my hands on the wheel let's see
if it'll do it
no it won't
it won't it cancelled it okay so they
require a nudge as well
um
yeah a tiny bit of ping pong but overall
this system is very usable
like this system well outperforms open
pilot uh in some of the lower end open
pilot cars on the highway
uh so congratulations kia i mean it's
good is it running open pilot
no no they uh
the sonata wasn't really good like the
sonata one wasn't really usable
uh on anything except for straights but
they they finally did a good job with
this one uh who knows and like you know
your thing is you're never gonna know
what version you're running
uh
the car is
the car itself is is it's not as noise
deadening as the sonata i actually don't
like this car as much as the sonata
um
but the car itself is dead silent i can
hear all the road outside
the navigation experience was decent to
use yo if you're in the market for a car
and you like this you know you're
looking for the fan right here let's do
one of their lane changes
so this is their lane change
it's it's good it's it's it's blinker
and nudge the same as open pilot
you can see that the radar is tracking
multiple leads in different lanes
just displaying it which is kind of cool
uh
they claimed that the acc is using uh
it's using quote unquote ai so i wonder
what that actually means
ah let's get back over here
give it a nudge
pretty good
the road is more noticeable because
there's no engine noise so yeah it might
not actually be deadened uh but i i
don't know
i prefer the sonata as a car
but uh
the
this is the first other than super
cruise
this is the first
uh autopilot system i'm impressed with
i mean this an autopilot aside from
super cruise in autopilot this is this
is top tier
um i like that it still has instant
torque even at highway speeds
see it's too close to that truck
the lateral policy in subtle ways is not
as good as other pilots
but
overall
pretty impressive
you can see like look there's a little
bit of ping pong look you can see it on
the wheel and i'll turn the light on
now it's doing a turn it doesn't seem to
ping pong in the turns
this is this is this is this turn is
great
uh
first impressions phenomenal car
uh you know if you guys are hanging out
for the stream let's take it on the 163
and we'll try it on an actually
difficult road let's do an automatically
change here
it feels the system feels very intuitive
like i i almost i forget
that this is okay make the second oh
that's not good okay that ui was
confusing oh i don't know what it's
doing now
okay you have to wait for the you have
to wait for the steering wheel to turn
green
uh once the steering wheel is green up
there it means it's like locked on
uh
it's really easy to forget that this car
isn't open pilot
[Music]
but now let's see if it can do anything
difficult
all right all right i'll keep my hands
on the wheel they have some attentioning
when i go like this
it says my attention level is high i
think it's just based on
timers
i don't think it does any driver
monitoring of any sorts
it lets you keep your hands off the
wheel for a surprisingly long amount of
time
let's see so i'll torque the wheel now
and now i'll let it go
i also like that it says it says on the
the hud
uh
hda nav so i wonder if it's at all
integrated with the nav like will it
take an exit
uh so you guys see the timer for how
long i've had my hands off the wheel
uh kia i'm trusting uh your light i'm
trusting my life with your torque limits
here don't don't make shitty torque
limits
uh i don't think they did
yeah
very very usable all right so this is
the first like real turn let's see
okay
so it gave me an alert to
put my hand on the wheel but overall
great
wow the thing is like this isn't
conveyed to consumers at all
like like like ford does all this stuff
about blues crews and i heard it's
actually terrible
and then no one talks about this system
which is good
tiny amount of ping-pong on
straightaways but that's it
i mean this makes me think that we
really like red lights and stop signs
this comes to open pilot is gonna be the
the feature that crushes it i mean this
is okay this is also you know it's too
clear lane highway driving so i
shouldn't i shouldn't hype it up too
much
uh
but
you know considering most of the
manufacturers can't even get two
two highway lines matching
two highway lines good
uh
i'm very impressed by this
all right we're gonna we're gonna go
somewhere tricky uh in a bit this this
road turns into a tricky one does it
feel like it's driving lane full or
laneless it feels
completely laneful it feels like it's
not doing anything with the radar
information
um
i mean i don't know like i i certainly
prefer the laneless policy i don't proud
to the landfill policy because it like
moves a little for cars
uh so no it it feels landfall it's
definitely using lanes we know it's
using the lanes uh
but
you know it's not just about lane for
like the entry and exit from the turns
is competent and this is something that
took us a while to get good in open
pilot like we it would it's not
undercutting or over shooting turns
which
almost all the stock systems do
what's the sweetest sensor so we have
four corner radars
we have a forward-facing radar
and we have a camera module which i
think is just one camera it has
ultrasonics but those are connected to
the parking ecu
um the two rear radars are kept on kind
of a legacy system so i actually have a
theory that
so you'll see like when the car comes up
next to me i actually think that's being
captured on the front radar and the back
raiders are still just doing blind spot
monitoring but i hope i'm wrong about
that
um you see you see how that that the red
shows up yeah no okay yeah you see the
car it's pretty good right
it looks like the autopilot display
uh let's see if it'll follow my nav
i don't think i have any nav
instructions coming up soon
uh but yeah i i it is on this on this
clearly marked highway uh it is very
easy to think that open pile is driving
right now
so yeah props to uh
props to kia for for building something
decent
or probably
um who has the best display ui tesla's
is nice i don't know i like cars that
actually shows the camera though
uh yeah yeah we have to we have the
blind spot infotainment it'll do that if
that's what we mean
uh how does the driver monitoring work
there's no driving monitoring this car
i wish
you know okay
uh it will eventually on sharp turns
it's related to the curvature of the
road
it comes up with things saying uh you
gotta take over
or you gotta put your hands on the wheel
and then i think it's torque based i
don't think there's sensors
i tried just putting my hand and didn't
do anything
vacant in support of chinese cars i
don't know what that means
stream
uh all right well i really
s you want to stick with me guys till we
get to the other side of the i8 and
we're going to take this thing on the
163 and see what it can really do
um overall this is just like bare bare
levels of
competency uh you know it's just the
fact that the fact that no manufacturer
aside from
autopilot super cruise and now this one
have gotten
like moderate highway turns to work
it's just
a
wild
thing
but some other thing um super cruise
couldn't do the 163 because i don't
think their roll compensation was good i
don't think this car has ota updates
though i might be wrong like i don't
really know it certainly doesn't
advertise it anywhere
um
what's in the next one after this update
you can read uh we got a blog post
coming out tomorrow i think the release
goes live tomorrow all right here sorry
we got some more serious turns now it's
telling me to keep my hands on the
steering wheel though i'm curious what
it does if i don't we can try letting
the driver monitoring
timeout
um their longitudinal policy the
longitudinal policy in this car is
better than our longitudinal policy
autopilots is better as well
but this is
going to change with n10 longitudinal
um i'm still confident open pilot has
the best lateral policy in the world
uh yeah openpower's gonna support kft
for this car
no i'm not getting on i8 staying right
here in this lane okay you guys ready
for the test
this is going to be the real test we're
going to see what it can do
keep my hand on the wheel but loosely
it's a little too far to the right in
that turn
um
[Music]
late entry into that turn slightly
good cut in behavior
oh it's beeping at me
this is good so far
[Music]
this is good so far
okay let's say
[Music]
cool
all right
also you can't see but it's doing a it's
doing like an augmented display i think
you can see it through the hud on that
car which is pretty cool
okay speed up for the turn
cotton cut in cut in nope nope nope
okay
spider all right all right
uh i like it it's one button to
re-engage
okay
so
[Music]
good
and yeah it's very good it's very does
it disengage on gas no it doesn't
disengage on gas
i can gas right now and it doesn't
disengage
uh cool guys that ends my review of hda2
uh i gotta drive on the streets
so i gotta leave you
but uh yeah this is a great car uh the
system's great
it's it's
at least on highways
it's a similar quality album pilot
depending on the car
which makes me think
what's up oh I hope the internet works
maybe it will god there's so much crap
about how you have to be like a prove to
stream on YouTube you know this is the
direction the tech companies are going
is we're gonna have a real stream who
remember Skokie Sunday back in the day
right and wait for some people to show
up I'll put on Twitter
let's go to Twitter I'd say here you to
come AI you know just like back in the
old days you guys still scobie's oh here
we go
my first hardware is canceled
come on
all right guys no nobody was seriously
castled away for a few people to get in
here I know no one even knew what the
new hardware was you know what guys I
was an idiot for announcing shit I
shouldn't have announced anything what's
up barn welcome to my youtube stream I
shaved a date last night I was thinking
you know it's a coming I archive yeah
that's cancel the new giraffe harness
whatever it was it's cancelled I'll show
you what we're thinking of do it instead
but then you know I have some
self-awareness got our self-awareness
you know I think this lacks a lot these
days all right
you only hear me good sound quality good
well iPhone eight over there like
alright good
look Oh excellent Oh perfect look see oh
you have a sound shit on our last video
but it's like it's me and I sit here
with my iPhone and it's good
um perfect so let's see what we're gonna
start with us um I watched my last the
last stream I did the last comment I
stream I did about the API Docs and I
hate it it disgusts me it's like we got
like like a legit like tripod and we had
talking points and like the comments
were like George you seem uncomfortable
like yeah cuz it's bullshit like once
once something is something like once
it's like a thing it's like I'm gonna
set up to do it right then there's
expectation and then it's not real
anymore
alright it can't be real it can't be
real once - this is real all right
I came in here today you know what I'm
doing you don't do when I'm around a
circuit board he wants to see the
circuit board I'm Riley right I got a
route circuit boards I'm pretty good at
it you know Oh
[Music]
and then I think back to the old
periscopes and I'm like well at least
they were real honest and genuine and
I'm gonna tell you guys something if the
ship sinks you know I'm gonna be real
about it and I'm gonna be honest about
it the new hardware didn't work
we got boards back those bugs um I don't
want to sell buggy hardware we never
sold buggy hardware before so it's
cancelled when it'll be done I don't
know we have to figure out this
decentralize all right we got to figure
out how to how to decentralize the
company right so here's some like ideas
that I have right you think that maybe
you know we can make open pilot run on
any phone um but this doesn't work this
doesn't work because you run into the
shipper problem you know we cancel
chipper are you running to the shipper
problem of people aren't gonna mount
phones I'll show you what we guys what
we're gonna make instead but you know I
look at them and they look shitty so you
know not actually gonna do it but like
here we go we've got some plastic Aeons
some miniature plastic Aeons
who wants a miniature plasticky on
miniature plasticy odds they didn't come
out that great stop them so we're not
even gonna sell me if you're black
jion's like tesla solve the miniature
plastic tesla
so yeah the hardware's canceled so if
you were thinking about like you know
not buying the car no hardware cuz the
new heart is coming out well there's no
more new hard right so also guys we got
it look we came out with the new website
right new website we think Oh new
website looks professional sales are
gonna go up well I mean I guess you
gotta be patient with these things but
sales ain't up so you know if sales
don't go up we can't we can't fund this
operation and I'm gonna be real with you
about that you know I was on I was on a
podcast hopefully it comes out soon I
was on a podcast last week and like
thank you yes all right I don't do a
great job I think the website looks
awesome
no we're not broke we're not broke we're
we're a start-up with runway right yes
that's that's that's the term for this
shit
no the affiliate program had no effect
on sales at all I wish it did say also
not down there just the same
um I don't hear enough about comma
outside of what at what I'm gonna run
ants no one cares right um it's it's not
a competitive product really in the
modern world no not more advertising
right it's not a head which advertising
barely okay I could do like influencer
marketing or something you could market
end-users honestly if I stuck open pilot
on the devices told nishta I was gonna
do it would it really change anything I
can't make it work for old cars it's
impossible well it's not impossible but
you know you can look at X Matic trying
to do it if you had if you have to put a
motor on the steering wheel
you're gonna lose if I put a on on
Amazon I get more sales well that runs
into a few problem you know we put
pandas on Amazon once they got kicked
off Amazon for being too shitty I mean
it's not that they were too shitty it's
that the marketing was good and the
product was well a developer product
right so we're gonna making the product
better um I think I'm gonna be going to
China we're gonna get the new stuff
manufactured but you know a long time
from now I'm not doing Joe Rogan you
know again I had an opportunity okay
look at what happened after Elon did Joe
Rogan right like this is not where I
want to be in my life the world is kind
of toxic all right like the media is
toxic and I just like you think back in
the day you think back like money might
unlock the iPhone media it's like a nice
story they don't do that anymore the
media is just it's not that Elon wasn't
smart about it and and you know I feel
bad for the guy right like you know the
hate that he's gotten online recently
just just heard for bullsh
I know it's like but that's the best you
can hope for right the best you can
possibly hope for is to be is to be Elon
Oh like speeding will be better well I
just think oh I just think about that
yeah right um you know here so I was
talking about how open pilots open you
know and the car companies are here's
the real joke right anybody who thinks
they're like trying to license and make
money off of self-driving software we
are giving it away for free and open
pilot especially zero six which is still
coming out tomorrow is getting really
good and we can make it a lot better
we've built we've build great
infrastructure that you know we can
really just do it all the disengagement
is pretty much um you don't even know
hardware it can be done in the EON
platform you know cuz the problem of
self-driving is not a hardware promise a
software problem a better way that's
that's the other reason we can't do old
cars like you can't if you're trying to
build something mechanical that's gonna
go on a steering wheel you're giving it
away without the expertise right so you
think oh oh just go to the car companies
oh and then license it to them it's you
can't write to to understand like what a
car company is it's wrong to view it as
a person it's not like you can talk to
it
it's a it's a it's a massively
inefficient conglomerate super
intelligence and that's what these
companies are yeah you can put open
power on your Tesla it's its own look
yeah well I mean to say it's not a
person it's an entity and you can view
people as entities - it's it's an
intelligence
[Music]
yeah well Matt emphasized we're right
good luck this is why I left last year
you know after the 0.5 and the the press
push you know we did press last year it
was flawless
we did we did an hour of press on the
highway zero dis engagements the system
drove perfectly in the Civic um and I
realized that it almost doesn't matter
if it's perfect we can still do better
and like there's we can we can fix the
set of bugs we can start pushing on like
and make sure it doesn't take exit make
sure it stops or stopped cars get to red
lights or stop signs but I'm not sure it
matters it's not like you know get on
QVC does anyone still watch this right
you QVC is a scam it's not QVC is not
like a place you go to push here you
don't see iPhones for sale on QVC right
um at that point you're you're at that
point you've sold out and you know I'd
it's not worth it right in a way in a
way maybe maybe you know I can't win
because I'm not really willing to do
what it takes all right if what it takes
is selling out it's not worth it yeah
it'll work works great
what ml sets
it's for your morals it's not just that
it's it's not like stay true to your
morals right it's like the only thing
that makes any of this worth it is that
maybe the world's gonna get better maybe
the world's gonna move in a direction
where you know you say your products are
open-source right like there'd be a nice
direction for the world to move in
instead of instead of a small number of
people controlling the products that
billions of people use and you know you
you you see it I'm not going on Joe
Rogan you have to think of the personal
cost right I don't want that I don't
want that kind of attention what
hardware is gonna come out why is it
canceled if it was hardware it's
canceled so don't delay buying a neon if
we don't have enough sales in July we're
gonna pivot to being a boat company
we're gonna build one boat and I'm gonna
piece the fuck out that's right thanks
VC's are we gonna build a boat one boat
well Don did it no the probably helped
the system do what it's perfect like III
fear that I fear that even if I made the
system like actually perfect it wouldn't
matter
yeah go on joe rogan get more sales
right personal cost I don't want to do
that it's not worth it and something I
don't like joe rogan I liked your rogan
um but the problem is okay so so once
something becomes mainstream it appeals
to a lowest common denominator audience
and it has to because well this is kind
of I think what happened to the internet
over the last ten years the internet
used to be this cool place
you know and they do is it's the reason
that a a a Facebook didn't exist
back then is because well it wouldn't
have appeal to the clientele of the
Internet you know think about just think
about it think about how far gaming has
fallen right think about world of
warcraft versus candy crush or Angry
Birds uh who was at the YC event I
didn't go I'm in San Francisco of course
no one knows ,
I'm not down though see I'm not down -
exactly I mean that is not exactly the
problem like you need more attention I
don't want to compete in the attention
economy I have no interest the attention
economy itself is a legitimate bullshit
what advice would I give to a CS grad
who's going into self-driving car as
well um I mean here's a cool thing it
probably doesn't even matter what we do
the technology is going to be
commoditized just as every so if you
believe that that uh every deep learning
breakthrough so far has been replicated
in a few months you know we have we have
we have replicas of alphago
we have replicas of GPT - everything
that comes out we have replicas pretty
soon because deep learning is a very
open field and there's no companies with
real monopolies on it even Google look
they made tensorflow open-source right
and you can say that oh there's there's
uh yeah what do I want to run Instagram
ads is that what I want to wake up and
do yeah we have more than 500 users um
there's like seven hundred daily actives
uh for $100 well you know the pro K so
now I sell it for $100 how much of that
is profit and then how many of those do
I have to sell and then how many cars do
I have to work with this model doesn't
even work at that kind of uh that kind
of scale um I'm running Instagram ad so
I'm gonna wake up in the morning and
check my Instagram ad board
like if I found some value aligned
influencers that's kind of different but
uh you'll make new hardware see but
alright so now I run into that problem I
don't want to be in the hardware
business I never wanted to be in the
hardware business but you can't do it on
a phone you can't do it on a phone and
we learned that I should start a YouTube
you mean a YouTube channel or a YouTube
competitor like bitch shoot yeah what no
but then what I'm a fucking content
producer god yeah so we're working on
making the product better and easier to
set up I'm not even sure that actually
is the barrier to mass adoption in sales
it might have more to do with just
there's a reason no aftermarket products
succeeded on cars before and here's the
sad joke the sad joke of all of this is
we flex all of self-driving cars um but
it doesn't matter I like like it's if if
you're at the point where you're on the
highway and you have zero diss
engagements ah all right like like you
can't do better it's not a system that's
that says don't there's no no you kind
of -1 dis engagements right so you can
talk about a certain level of
reliability if it gets you to level 3 um
I mean we're we're a long way away from
that and there's going to be such a long
tail of absurd things because humans are
such good drivers well is it an
awareness problem that's a hypothesis or
is it a problem that just nobody really
cares um have we ever been approached by
car makers you there are no car makers
that can like approach you sure we've
had reach outs from car makers but it's
not like they're serious right like what
does it mean for a car maker to reach
out some low-level person and bizdev
reaches out I even spoke with the CEOs
of some of these companies and it's
there isn't really a path
forward unless you become mobilize
immobilized circa when was this date I
think was 2015 mobile I at the lowest
R&D spend of any chip manufacturer I'm
not getting bought out by the car
companies I'd rather sell to lyft or
uber oh it's not no ad the problem is
not the people are scared of the
technology the problem is that like the
machine that it would take to make this
successful
in today's world is so extremely
distasteful that I don't really want a
part of it right the machine that the
like advertising machine the marketing
machine that the you know I've come to
the new regulators I respect we were
making the Panda code mr. compliant the
hardware already follows at FMVSS you
don't remove your mirror anymore and
we're gonna justify our safety which i
think we're the only company in the
industry with an explicit definition of
what safety of level 2 looks like to
open piled safety md and yeah well
ground that in in ISO 26262 which is the
standard that the automakers use and
they're validating their cruise controls
no link assists I don't where comma
Marche anymore that's not you know I
could build high-end March and then it
might be cool what am i doing right now
I'm sitting on my computer I got a
router circuit board that's what I'm
doing
when is ml gonna play a bigger part what
do you mean by that we train your models
using ml whoa gang does an interesting
phase
yeah I'm from storage cheaper the clouds
of scam porting what vehicles we already
support all we already support 80% of
the vehicles it's possible to support
the problem is like oh sure we could add
Subaru support Nissan support but nobody
has Subarus and Nissan's right we added
we you know why the super giraffe was
canceled because we sold three of them
we sold three of them I made I made $200
I've had 60 bucks last night you know
out of dinner it's three dinners I got a
tip to rice it was three dinners HD man
so oh that's another one of those
companies all those HD map companies all
they're gonna be in for a drug that I
just failed you know I should be I
should be saying I told you so to
everybody right way to zooks fail yeah I
told you so I told you so
it doesn't matter um yeah maps have been
scrapped HD Maps in general aren't
really gonna be a thing most of the
value of HD maps has already been
captured by like super cruise and uh
sure the idea of precisely localizing
yourself in a map and then driving
according to it only solves the static
problem of driving and it turns out that
the static problem of driving is pretty
easy
in general the hard part is the well the
dynamic and the really hard part is the
counterfactual the counterfactual where
your actions affect other people's
actions like merging on the highway
merging is extremely hard I'm watching
weibo car try to merge right I'm not
sure you really can and code rules
you're gonna have to do reinforcement
learning and that's what people are
doing reinforcement learning out on the
road look we let kids drive man you know
yeah and he stalks a comma uh why don't
I start a digital identity startup and
address the billions of people oh my god
disgusted by that uh we're gonna be a
trusted source and authority what I
think of drive that a I think you felt I
mean shit but like you know I'm not even
hey look you know test Tesla
oh I can go pitch myself to youtubers hi
youtuber I'm down on my hands and knees
could you please review my product for
your stream I'll send you a free product
and I'll send you over and never mind
hookers and coke
are there roundabouts in the u.s. some
of them like yeah I'm standing out I'm
sending out what I'm sending out emails
to partner with media companies really
that my job which would run better if
you compare test autopilot with a pilot
it depends on the scenario open-mouth
better and some autopilot is better and
some auto pilot chooses to feel more
confident trading off being ok with
catastrophic failure versus open pilot
chooses to feel wobbly it's this is a
bunch of different trade-offs made in
autopilot an open pilot our torque
limits much lower not only because of
the cars just because I think that
Tesla's a little bit aggressive with
that Tesla's hardware is a lot better
than ours you know we have a phone in
the plastic case we don't have an office
in San Francisco we moved out
multi corner I don't know what that is
just got here what happened well the
July 1st hardware's canceled so you know
if you're waiting if you were waiting to
buy your Aeon for the new hardware
there's no more new hardware so you know
if you're gonna buy a neon via neon
hopefully sales go up right our Tesla
still making offers for you I haven't
heard from Tesla in 3 years no one's to
blame for the bad boards doesn't work
like that the companies to blame yeah
they're as verified can't run a can't
run shit yeah the EON de on isn't nearly
even in its limits of potential right
for example open pilots not that good
when you have like when you're coming up
with a stopped car at the radar vision
fusion this has everything to do with
the code and nothing to do with the
hardware when open pilot gets off an
exit this has nothing to do with the
hardware and everything to do with the
code
would open pilot pulls you aggressively
into a left turning lane this has
everything to do with the code nothing
to do with the hardware no see but the
twitch see if the twitch became a thing
I just wouldn't want to do it anymore
it already kind of became a thing is
everything good what do you mean by that
all I can promise you guys is I'm gonna
go out honestly that's right
yawn really only helps lateral movement
well it depends on the car some of the
cars have good longitudinal some of them
have terrible longitudinal like the
Civic stock longitudinals way worse than
the Aeons oh the new hardware it's not
it's not a neon it was never gonna be a
neon replacement anyway can the new
hardware be community produce like the
pedal mm too complex look if we couldn't
get it right then I don't know about a
open sourcing if the pedal was simple we
already had pedals any plastic Aeons who
wants to buy a mini plastic healing what
was the new hardware anyway the new
hardware was mini plastic eons but they
don't look very nice
so we cancel them roll call may I have
in 10 years probably none most out of
sale
what channel would source everything god
I'd open source the back end I mean if I
thought someone could use it and I
thought that the value would be captured
by people and not by entities well
there's no point in talking about what
it was because well it's canceled so and
then like we're gonna do like a fake
event tomorrow where it's like oh we're
gonna win ounce plastic Aeons and like
it's funny at first when you think about
it but then you realize like wow okay
look up intel the odyssey right if you
want if you want something to laugh
about
oh please consider ah now I'm a magnetic
sticker manufacturer really ship black
rain to 21 million people in a week and
now I make magnetic stickers that 26
people are gonna buy pathetic you don't
need more care you don't even really
need more cameras we're not even nearly
at the limit of the EON camera for
example cut-ins
alright when cars cut you off the e on
camera can see this fine the problem is
it's just not in the field of view or
vive there the model or the radar right
we can fix that
it's don't challenge and left driving
countries we could just care about it
the problem is we have like 20 users
right so let's see 20 users maybe a
lifetime user value of calm AI is like
$500 so 20 times 500 that's $10,000
right so I can devote maybe one
engineering month to it that's the
problem all right
no it doesn't detect gardens haifa
Tesla's battery event you know what it's
gonna be
I gotta promise something they're gonna
be like kind of there and yeah you all
probably win at the end of it is open
sourcing everything really a good
business decision well keeping some of
it closed wasn't a good business
decision so at least you know with open
source there's a legacy right
why not flip the camera out but you mean
flip it like that um so we've discussed
that uh I don't know maybe it works
iPhones are dying sell the company -
what - losers why have a merchandise
section on the store I don't know
something I guess I guess cause it kind
of made sense so okay with open sourcing
we have a lot of people contributing for
free a to an extent um the truth about
the truth about open sourcing is you
then you then just become a manager
right like a lot of times I'd rather a
lot of times I'd rather write code then
have to manage external people writing
code that's like bad all right like like
there is there is almost more overhead
than just writing some of the code
myself we've gotten some good open
source contributions but the idea that
like this can be developed organically
is not really true and you can read the
open pilot commit history for that I
even merging in a fingerprint takes like
an hour of an engineering engineer's
time here um Bosch killed the Civic for
kamma used to be the best car why cuz
boss doesn't have longitudinal shall we
do it we could do it is that gonna fix
things probably not the Toyota cool is
the best car if you're buying a new car
for open pilot definitely by the the
2020 Corolla you can argue that Bosch
stock is kind of better than Vostok is
quite good I mean yeah we can improve it
let me know Android auto what's that
mean Oh Toyota has no Android auto yeah
I know you finally ordered the open
pilot it arrives tomorrow was that a
mistake you know why was it invited to
be a mistake works like it does it works
pretty well what will grey pandas be
used for now well if you have a great
panel your data's included in the model
I mean all right Doug feels that way
about Corollas yeah yeah one murder two
one wears you out back what other
projects I know it's amazing
doesn't matter though
yeah what's the bike column I'll give
you a good price awful I think he
promised that he was gonna have a fleet
of level 5 taxis by the end of the year
right if only I could go on augur and
short that shit can't though
can't and that's the problem you know
this is a general a general sort of like
media problem in general the the
accusation is printed in huge in huge
texts or the claim is printed in huge
headlines and then the follow through or
lack thereof is printed in a little a
little line down at the bottom you want
being full of it right like like it's
like you know people who thought Trump
was gonna change after he became
president he's the same guy right like
Elon just cuz he lands Rockets like this
now it's pretty incredible achievement
right like he's not gonna change he's
always gonna make these these that's
just who he is as a person right he's
always gonna make these claims that will
someday will you on have a level 5 taxi
network you probably will
I still think Tesla's gonna win even be
at the point now where open pilot like
oh my god Elon called me in my birthday
you see this just it's a narrative thing
right like it doesn't like like that's
not it's not even that it's not true
right and that's what a lot of fake news
is it's not that the news itself is
wrong it's that the narrative is kind of
misleading right
Elon calling me and my birthday is a
it's like a red herring kind of thing it
doesn't mean anything right but you say
it because it creates a compelling
narrative the Elon is the Aeons were
selling right now our lake all the pro
threes yeah I mean welcome to hoarding
for an Elon company in the pace office
the yards are double but you're
contributing on a mission to make the
world better
some people that's worth it is long
improved no maybe a little
maybe targeted niche abusers yeah we're
8.1 million dollar VC back startup you
think I can you think I can target
initial users right sound of doing with
my life a car path you might have ever
having just did a new lose like ICML
talk is pretty good what features can
you look forward to know more features
we're not doing features you can look
forward to some stability uh-oh
oh great oh I'm gonna saw the outback PR
I'm gonna I'm gonna sell me to sell to
more yonce oh oh my god two more eons
yeah you make tacky minigames right yeah
why don't we sell many plastic eons
right no I'm not gonna start a cult
jailbreaking reality because I gave that
talk and the only people who reached out
to me we're quacks and schizophrenic and
that's the problem right you can't you
can't make any claim like that because
it's like if you ask the people in the
office whether they want to use sequel
or no sequel for the database solution
no one really cares nobody has an
opinion on that because nobody can
understand it but if you ask them what
color they want to paint the wall that's
what we're gonna have a two-hour meeting
for right someone needs to fix messaging
what's wrong with messaging right
messaging was was pretty good back in
the day oh oh yeah oh I'll just all work
out it'd be a mutually beneficial
partnership you scratch my back I'll
scratch yours
I'm just not like I can't tolerate the
bullshit right shippers dead she wanted
an open source that if anyone really
cares no I won't open source it's not
gonna help people it's only gonna help
ya shippers been dead for a while oh you
know what I can plug this into you know
what I'm gonna plug my iPhone into the
charge I'm gonna plug it into a panda
orientation is locked rotate device back
I know I'll call the wall be painted
panda perfect yeah so you know what
we're gonna do we're gonna try
what do you mean is funding drying up we
have the same funding we always had like
you get more if I cared as Talent drying
up no we have the same talent we always
had we're better at using it now but it
just maybe just structurally doesn't
work um comedians work right three C's
hate me um yawns make a nice they make a
nice side business they put good money
in my pocket they could fund a great
lifestyle for me you know you can really
do this as far as I can tell as far as I
can tell you know the VCS on equity not
debt um so you could just decide that
your company is gonna be a lifestyle
company pay yourself I mean you couldn't
pay yourself a million dollar your
salary even if you want to pay yourself
you know 250 K you can justify that
pretty easily called a nice lifestyle
business keep it going and yeah hey yeah
you could do that right oh can i
elaborate on that board oh I'll finish
routing it yeah please a little trace in
place right that's great that you
believe in commenting on makes uh you
know one of us um no it's not that
I think no one really wanted this you
know you guys do what peak self-driving
cars was you guys know what yeah you
ever go on Google Trends and look up
self-driving car kind of funny
keek of self-driving cars floating oh
yes oh yes yes you see that peak that
was when Hoover killed somebody
that was the peak of self-driving cars
humans are banned from driving oh yeah
yeah you know what just really I don't
know what to do about this
I think he'll one person yeah oh yeah
Alain Herzberg we all know her name
right um it's not nobody is punished for
hype like if you go back and you watch
all right real talk real talk
if you go back and watch my TechCrunch
Disrupt I said to my sister a week
before I'm like what I really want to do
is go up there and take a dump on the
stage right I just want to take a shit
pull my pants down take a shit right um
so you can't actually do that right I
think that would be a little bit too
obvious so I tried to do it verbally and
metaphorically but what people saw was
not a mockery of hype but hype itself if
you're truly dumb enough to believe that
a piece of green 3d printed plastic is
the solution to self-driving cars then I
can't help you right like like if you
are dumb enough to believe that then how
can you be critical at all about any
other Heidi claim right you're not
nobody is
and like it's you know it's Crowley and
daraprim right like the guys like look
you know I took this one obscure drug
that nobody uses and I jacked the price
massively on everyone books it shkreli
is the bad guy but the only reason they
look at shkreli is the bad guys because
the language he uses the truth is the
pharmaceutical industry is doing that
every day just to like less of an
extreme right and they couch it in like
lawyer resounding language and you know
nobody really sees it for what it is
right so shkreli is in jail for eight
years and the guy who uh you know
marketed oxy to the kids as uh this all
had to pay a six hundred million dollar
fine Oh Purdue Pharmaceuticals is gonna
go broke right sure sure you could right
but here's the thing about your tech
your tech you want you want to save
people's lives
you want to reduce car accidents you
save five people's lives to kill one hmm
what is the world focus on what does the
news focus on what are the people focus
on do I inspire the hype looking Paul
the death Vigo never ends I put it now I
like her I like to tweet is like a
milestone is the thing that doesn't make
headlines right like one of those one of
those truck companies one of the worst
ones not embark
oh we drove a truck down the highway
with no person in it for the first time
all right they had leaden Ihnen and then
chase cars with people in them but like
it's not that's not a milestone right
but it doesn't matter because Ford is
partnering with Domino's to use
self-driving cars for pizza the Lemery
right you need to take advantage of a
bunch of fools right if that's why it's
my panda not charging my iPhone if I
need to take advantage of a bunch of
fools if that's really what it's gonna
take then I'm not down not down not down
anyone figure how to plug this shit in
it's not my computer I'm gonna lose my
computer if I do that oh no these eons
are flat these pandas are flat with
different firmware so they don't charge
phones anymore I'm gonna go get a new
pan
anyone want to buy pandas I got a lot of
them panda buy a panda made 10,000 over
oh that's unplugged now great plug that
back in turn this on there we go now I
can park my iPhone it
what do you mean no new features are
coming I didn't say that
well no new features are coming
stability is coming 0.6 comes out
tomorrow people like it
thousands shipped like 5,000 pandas or
some
I didn't make autopilot you got the
wrong guy
oh oh you want to look at logs from
explores last year I got some bad news
for you we keep the data around for
about 30 days you know why because
someone's got to pay the cloud down all
in clouds expensive oh yeah free date
all right is Tesla gonna win all right
so you get into Tesla right look at
Tesla's stock fell massively right does
that mean Tesla's doing badly no it just
means didn't live up to the hype and
that's again the problem they created
hype for themselves and brought their
stock to an unsustainable level where
Tesla was valued at more than Ford and
then you realized wait a second nobody
actually buys model threes in the f-150
is the top-selling car in the country
all right all right guys um we'll go for
an hour so we got we got 15 more minutes
that's today's livestream we're keeping
it real I don't know how much the stocks
really related to how are you on tweets
um no so yeah we're not doing features
anymore features aren't really what you
want what you want a stability and user
friendliness we tried features we tried
maps they were janky remembers our
feature features removed how would I ran
companies doing autonomy today like
don't get me started on way moe like
there is no way they're gonna ever
recoup the twenty billion dollars they
put into that thing Uber's never gonna
recoup it at all can't believe all the
money blown on that uber has nothing
they have less than nothing they have a
dead person right and nothing to show
for it
um Weibo has something but you know how
are they gonna recoup 20 billion dollars
for it I don't see it so yeah how how
our company's doing well try open pilot
the only thing that beats at his auto
pilot in certain scenarios
Apple Apple bought the remnants of a
failed self-driving company but that's
not what you see in that aligns right
yeah someone should do walking in VR
well no you see you want features
because the system is stable enough a
lot of the people who buy a lot of
people who don't buy Aeons are not not
buying because they're waiting for a
feature they're not buying because it
looks like a hobbyist product because
you know it takes 20 minutes to compile
and you get random black screens and
sometimes your panda light flashes green
these are the things we're fixing and
and what you'll find is that in order to
succeed in order to succeed with any
sort of market you don't want a lot of
features that kind of work you want one
feature that works extremely well
why can't we have traffic light and stop
sign stop and go that's not what you
want like you think that's what you want
but it's a gimmick the truth is you know
what you'd probably much prefer when
there's already a car stopped at the red
light wouldn't you like to be able to
stop for that right now it's hit or miss
now it works sometimes you don't want
that so we'll fix that
it's a dev device though not a consumer
product see this is what I mean and
maybe I just don't understand how people
think about the world there's no
difference all right well it's a deaf
device and not a consumer product
I mean it's rough around the edges we're
working on cleaning that up at what
point does it stop being a deaf device
had become a consumer product when I
change the couple of lines on the
website and start shipping them with
open pilot don't think it changes
anything all right can you yeah people
can use it over consumers if you're
willing to put time McCullar right and
that time is what we're trying to reduce
so like okama is not doing anything
you're not doing any new features no
we're gonna work on like for example the
green flashing light of the pant is
about to be gone in 0-6
the models are much better in zero sex
I'm not playing the profit maximization
game if Moloch kills me Moloch kills me
kodaline this tech tips again what did I
tell you about begging youtubers
youtubers come to me you know what I'll
say shop comm that I buy any on review
it give me your honest opinion right
this isn't gonna be some sketch backroom
deal like I shouldn't have to go to
anybody if they want to review it they
can review it if they don't they won't
write well why is this why does this
have to be centralized and not
decentralized uh yeah until it plugs in
place oh we're getting there
we're getting there you know a lot of
the stuff that you think it's like it's
not typing in open pilot comma that I on
the URL screen shipper is completely
dead and there's never gonna be updated
again
um can your mom set up IKEA furniture or
install a GPU that's probably gonna be
the bar until oh you sell it in
dealerships right you build a product
you can sell in dealerships Wow I go to
the dealership so I'm gonna walk down to
the dealership I it's Fred eggs my boy
Fred you know um no no because it's
below me I'm not saying that what I'm
saying is like that's not who I am or
anything I want to be associated with
right I don't be a brand and it's not
like oh why don't you hire somebody to
handle the branding component yeah
that's my boy
yeah well we'll see about sales but no
we're working on improving all compiled
quality that's exactly what we're
working on
you should be more open to opportunity
for the company not yourself what do you
mean by that what is the company
corporations are people my friend
nope the sources aren't gonna be
released it's cuz I'm an asshole that's
why all people will trust the dealership
own good you'll be able to update
compound self updates turn it yell off
and on again it just updates oh the
visualization of the HTML shows your
simulator I have a simulator now imagine
Sony doing soft I agree
well you should trust what's
statistically verified to drive your car
what time is zero six going live
tomorrow oh no well you want to know the
truth we have a meeting at 11:00 I'm
gonna be like I'm gonna say to Yelp I'll
team a you want to push zero six and
they'll be like okay well pushes your
sex my coding a streamline I don't feel
like doing coding streams anymore I'm
playing online chess badly
what about porting the EON to work on
any phone well the problem with that is
people don't want to mount their phones
on the dashboard how are they gonna
mount it stapling what are we gonna do
when that phone has some weird process
that you installed because the Android
has spyware all right can you buy shares
in the company don't for private do I
not believe in it anymore well you have
to know you have to tell me what you
mean by that right
like I guess I believe the same thing I
believe for the last couple of years if
the success of kamma AI is a function of
my belief in it something is seriously
wrong but I fear cava will fall behind
fall behind oh we're years ahead it
doesn't matter though right like like
years ahead in a race that like at least
we have some revenue right way Mo's
years ahead they've never made a dollar
uh now I'm president now it's like being
CEO except you know you don't have to
like put on a good face you can just say
whatever the hell you want cuz you're
president right as I learned that from
our president just say whatever you want
man uh we're not here to talk about me
this is on the cob AI channel just like
we don't talk about comm a I on my
twitch channel right see it's all
complete push me the water in the middle
of the Atlantic I mean look it's not
like it's not like oh it's not like I
point to somebody else and they're doing
better I mean maybe the company doing
best in the space is like not oh you
could do that you won't do that somewhat
honest business model
[Music]
the older car question I've answered
that a bunch of times not gonna happen
oh there's no main takeaway there's no
action items it's just an hour-long rant
that's all it is I just thought that you
I that's not simple enough it's that
there's a lot of subtlety that's wrong
and yeah I think you can and I think
that's what working to improve and I
think that's what the zero six here is
gonna be about just flying Jones for
wheat delivers don't pitch it doesn't VC
somewhere I don't know what an eye cave
body system is the own poly UI we just
open sourced it so there's a bunch it's
it's partially in sea and partially in
react native this is a bunch of apk is
calming I open pilot apk and then
there's you I dot see in the main open
pilot repo oh yeah well so one of the
one of them off-road is written in react
native and then frame is written in
Colin what about six again you know what
I mean how may I could be profitable
zooks
I don't see how you ever make back the
billions you've spent I don't think you
can not weaponizing shit man oh oh can I
put forward to education all yeah you
know what I always say you know what I
always say to people it's not my job to
educate there's tons of great resources
out there if you can't figure out how to
educate yourself I don't know what to
say um II on be a dash cam with safety
functions oh oh that sounds like a
terribly boring product we warn you when
the driving is unsafe
like yeah yeah you could build that
sounds boring and then why you got to
sell safety
I thought that safety is not good safety
is great but like you know what cell
safety I like you sell like oh this
makes driving safer it just reminds
people how dangerous driving us Oh
Malcolm is quite readable I think I
don't know we can refactor it I want to
work on that we're gonna work to make it
better
Jay Lord welcome to the streams
I think Aisha Evans got put in the
rubber room at Intel for tanking their
modem division you didn't hear that from
you know what I say love Elon Musk
offered me 400 million yeah
depends will you let me keep it open
source ifs others sure it's all for less
than that if you'd let me keep it open
source if he says you got to make it
close source and we're basically just
buying you to kill open pilots a lotta
pilot born of any competition give me a
billion dollars sick fuck now what am I
gonna do with money buy bullshit I'm
gonna buy some cardio bracelets i'ma buy
Louie Vuitton bag buy more Saint Laurent
hoodies is Python the best tool for AI
programming sure cuz tensorflow works
with that ten smells like heavily bound
to Python they Swift now as a layer on
top of Python it's kind of cool
well cars aren't gonna be shipped with
good a TAS for a long time for two
reasons one they have no connectivity to
get the data back and two they have no
ability to OTA update when they fix bugs
those two things are probably really not
gonna be done until 2025 at the earliest
so you're looking at six years before
they can be remotely competitive I mean
it's a bit of work now but if we have
the tech to make it I mean you know
we've been collecting data now for three
years we have huge infrastructure
designed to process them but you see the
problem with like sending them info like
is this my job now is it my job now to
like raise awareness all let's raise
awareness why don't we start a campaign
why do we have a self-driving awareness
to her oh we tried that
Oh joke man no new hardware actually
legit is cancelled by the old harder if
you want you sold them pilot we didn't
hire a market I wouldn't hire our
marketer the whole thing is disgusting
right like why our designer it will make
websites look nicer hey that's that's
engineering
empathy ain't your thing you tell me
what empathy means man you tell me what
it means did you talk about school
shootings on here again he would be
banned from this channel
yeah exactly right so don't tell me I
don't have something if you can't define
it probably I mean the way empathy is
used a lot it's a scam right it's a form
of it some way you can control people's
behavior right you could say like well
you shouldn't do that you should have
more empathy you shouldn't buy Clorox
you should have more empathy and by dawn
you know it's a thing that you're
supposed to have but wait was that just
an ad for dawn
tailored you're about to get banned a
lot of people on here get OH
put user a timeout Oh get bad I love it
you know come AI his new slogan is make
driving chill
alright guys who spent an hour thank you
the new websites nice let's hope it
improves sales
education its biggest scam in history
guys of course it's marketing right why
don't we mark it it'll give your
children a future to the parents and
it's a four year party to the kids and
government pays for all the debts and
though I love education scam yes be
honest I'm not snot my job no one voted
for me to make America shut down so it's
not my job
san Diego's are right
how many aeons have been sold a lot but
not enough ah thank you thank you ok
trying to hope you enjoy my stream today
we're keepin it real if I ever try to
bullshit you be like George I can tell
you're trying to bullshit me like if I
was gonna try to sell you plasticky
aunts tomorrow is tempting me trying to
bullshit you but if you want to buy a
plasticy on they're not for sale they're
exclusive they're extremely rare with
these little plastic eons on my desk not
being on joe rogan thank you what is
this dream for it's to tell you all the
hardware's canceled you should go shop
that comment buddy i invite you right
now come on come on get my sails up make
me happy you know i come in in the
morning I checked my Shopify if sales
are big I'm happy if sales are small I'm
unhappy
I don't even agree well you got a virtue
a signal to some losers that you like
you know sat somewhere for four years
and paid a boatload of money
yeah yeah right you could do that if you
want but then you're in a system of
losers take view see you money like Elan
see that's the difference right
Elan thinks there's some greater purpose
to it all you on thinks that like
the ends justify the means I don't know
I don't I don't have a degree
come on info voice Oh God
dan from youtube don't and you said the
i-word VC's help push you VC is help
push you toward annual recurring revenue
in surveys are you're doing it up
consumer surveys you know have you
noticed that everything is now it's got
a survey a survey a survey create a GI
to rule the worlds here I like that plan
I like that plan I think the Chinese are
gonna beat us all to it I not make the
community my sales force I tried it
we had a very generous affiliate program
didn't do shit he sees capitalism human
centered capitalism right yeah I mean if
capitalism becomes this long term
capitalism is great short term
capitalism and like we got to make sure
we impress the guys on Wall Street next
quarter yeah that's why we live in the
world today right am i a socialist or
capitalism
I am capitalism I am Queens Boulevard
right um I need made voting machine that
votes for you yeah what if we just made
voting machines and we figured out how
to use AI to vote so we can cut the
voter out of the equation right audio
out a thing now alright that's a perfect
time to end the stream all right thank
you all thank you all for watching
is the audio back in sync already done
what AI voting machine without the voter
honey I girlfriend I love I'd love to
have an AI girlfriend you guys my audio
is a nice thanks it's been it's been 64
minutes unless my phone's lying to me
you try to get more time
make some joke about hookers and
therapists I'd like to send my dignity
to you
no I don't want to take off a non-3d
girlfriend real smart you know real
smart go
hey what's the solution to lack of sales
you all gonna buy mine I don't know
we're gonna make it easier to use we're
gonna make this thing great even just
for the sake of making it great I'm
gonna do it
after markets humble heading for rockets
yeah really hit Ilan where it hurts man
hey you got your you got your Atlas you
got your your your Atlas five rocket
just just stick a neon in it it'll land
itself think about all the money you'll
save
thank you for our moment
proofs of car computers I like the
tittie printer maker come get the angle
there is no end goal stream rap new rap
oh maybe no you can't tap into the stock
camera this is not how good the same bad
ideas get repeated over and over and
over again look at the pin outs of the
stock camera and see if there's any way
you can get the picture a trick no you
get some shitty post process outputs
pushes the reason your car drives badly
with the stock camera in the first place
so we hear that bad idea a lot and we
hear the idea why don't you make it work
with all cars oh you know I never
thought of that before I never thought
of that before the only reason I make it
work with the cars I do make it work
with is because I'm a dick and I don't
like the other cars you know it's just a
way of like you know getting one out and
poor people right if I knew car man what
are you poor oh there's a young work
with the stock camera we leave the stock
camera enabled now we're soon gonna like
proxy a V and stuff thank you please any
more live streaming no this this was a
special treat I was feeling some type of
way you know some type of way
yeah oh yeah making work on tricycles
that's a big market you know there's a
lot on tap market I get those kids man
get those kids you know we'll put in our
Sock'em boppers sock about buying Eon
for your tricycle why did you send you
go out into San Diego man so right now
San Francisco sucks all right come on
yeah we'll be around here for 30 years
don't be buying me on sevens now you
really want to make money today jewel
look they made a lot of money just take
something that's addictive and repackage
it in a new farm um well I like on my
pizza pepperoni not San Francisco yeah
okay like BAM jewel there oh yeah you
want to buy a cigarette so that's fine
but you want to buy jewel yeah we kind
of get kids drooling and vaping man it's
messing with the kids man do I consider
pineapple a legitimate topping it's not
the topping I would choose but it is it
is legitimate I don't question the
legitimacy of piden how do we get out of
the simulation yeah I could forward you
a bunch of crackpot is from people you
want to hear like a 14 page essay about
like you know how the Illuminati is is
conspiring with the license plate
manufacturers to put the letters in them
yeah wqr I learn how to examine and exit
the simulation yeah I see you know what
in San Francisco we had cars broken into
three times three times we had cars
broken into the office was broken into
once the amount of clunk that city is
now the highest crime city in America
for for non non violent crime in some
cities that are more violent but when it
comes to like like like property crimes
San Francisco's the highest in the
country all right CY to get out right
damn right damn so don'ts kind of downs
like with the with the weed in the other
the the blowtorch smoke to dab once what
did i watch i watch some i watched some
like television show it wasn't Rick and
Morty it was like like Family Guy or
some I just laid on the couch like long
watching watch your family guy dab on
the haters right Oh dad like that like
that yeah yeah yeah I was down again
then I'm straight and sorry and if
you're if you're female you know to
email me but I do know that 93% of my
audience is male I've looked into my
demographics well then and then uh you
know you know me but ya never missed the
iPhone jailbreaking stuff you can't know
what it's not it's not there's no one
well guys I do know that 93% of you were
men okay that's all I know I'm just
saying I'm looking at my demographics we
need to increase diversity and inclusion
on the cob a on YouTube channel
what's hire a chief diversity officer to
do that um no I've never been to South
Africa here there's a lot of crime
wearing like young guy giraffe be sold
to all seven yonder users we have a few
more than 70 and I users yes we have HR
absolutely and my tolerance for bullshit
is zero you want to like do some
bullshit like some harassment bullshit
get the fuck out um
right and that's you know how it should
be you know the Linux go to contact this
is you know the fact that we're even
talking about that right and that's the
real problem these people just like they
monopolize discourse to say nothing to
say things that are either so obvious
harassment is bad you know shit um and
then they monopolize discourse you know
like but but how bad is it
right why do we even pay for office
space oh thank you like the API why we
even pay for office space that's a good
question should decentralize the company
we don't go remote maybe we'll do that
um what business model I don't care
whatever code of conduct is lame or not
just like you know if it makes some
people happy put it in there and like
you don't have to read there right like
who cares
don't let these things get to you man
gasp go remote no go go over mode new
office space Starbucks we'll work it we
works right like the Millennial children
we are which business model we'll sell
you all car insurance right is that a
good business model sell-off seven
hundred users car insurance well no cuz
only like four hundred then were in the
US and then I know you can't sell health
insurance across state lines I don't
know about car insurance but I think
we're in video now yeah and then you did
something to me last year they kind of
like screwed me over
I sold half my Nvidia stock I really
wish I sold it all cuz it was the peak
fidgety what is the Instagram followers
I was somewhat serious about that you
have to have an Instagram these days
it's gonna go on dates you know girls
text you they're like what's your
Instagram got a man Instagram
this is another myth that like driver is
like I get this about India a lot like
you just got a tree money media drivers
then you learn how to like really drive
know if you want to train a model that
drives in Pittsburgh you train on
Pittsburgh drivers you want to train a
model that drives in South Africa
traveled South African drivers right
that seems very clear to me Nvidia it
wasn't always this way they started like
you know believe in their own bullshit
videos I really what I should have sold
all my Nvidia stock was the minute they
added that thing to the License
Agreement
where you can't use the gaming GPUs and
data centers like really can't use it
for that the second a company tries to
put like restrictions on how you can use
the product legal restrictions not
technical restrictions it's not even
like it's not like like it's like okay
fine you want to put it you know a legal
restriction again it's like piracy fine
but like this isn't even an intellectual
property thing this is just protecting
your ability to upsell losers am do you
gonna beat Intel well we'll see um Intel
Intel has made a lot of bad decisions
where's the ten nanometer chips right
yeah yeah NVIDIA banned you from using
gaming GPUs in data centers to protect
their their their ability to upsell
their higher product that's gross
I'll just wait seven days nvidia did
more stupid things until missed the
mobile market a long time ago Nvidia
missed the molten market the mobile
market is dominated by Qualcomm and
Apple and then like okay you got
Kieran's over there and you got got
Samsung but that's that's really just
about it
yeah no I hear I hear this is that a new
is that the old rise in our new rising
Thank You Howard I learned to code I
climbed down to the bottom of an
Indonesian volcano and found this source
of coding scroll the scroll of coding
ability and I read it but I drew it into
the sulfur check it out the volcano is
called ijen why not manufacture in the
USA where I'd love to I'm a big America
fan but when I can pay people in China
$2 an hour
no I burned the scroll I burned the
scroll we can't let we can't let future
generations get access to the forbidden
knowledge i gen ije at google it it's a
volcano Indonesia where I found the
skull of scroll of big coding ability
thoughts on risk 5 risk architecture is
gonna change everything man what movies
at home I don't know whether to ban
hitting on me in the channel it might
get banned I'll give a warning this is
about your good
we don't have to go that far the mute
streamer no-risk architecture is gonna
change everything it's an Angelina Jolie
line in hackers hey Nathan Levin douse
kill you related to anthony levin dosti
by chance robotic process automation
yeah the robots are coming for your job
yang 2020 damn I wanted these at home
too
nice key points oh yeah yep get old
people like them yeah man the boomers
got please the boomers man could be
beneficial to do more wait I just got a
text I wonder what it says but if I
click on it I think my stream will stop
um like Genesis like Sega Genesis
Hyundai Genesis Genesis is a separate
brand now right yeah it works it works
at the owns what successful tech company
would you say calm areas boss like well
uh you know and they make good no it's
like not just sex BOTS but love man love
Jack love Tech is gonna is gonna be the
next revolution get an early on love
tech all right like you think you guys
think it's like weed stocks and like
whatever else is hot today love tech
tensorflow
hey levin dosti look at pronto ai
they're literally just copy comma right
like it's the right idea it's just a
question of how much patience you have
um yeah if it still likes a comma yeah
yeah I went to the bottom of I Jenna I
found the skull of Cole's bowl of amends
coding ability
yeah catgirls us definitely
rust this fun but not practical go was
boring put a very practical language
some of the people who work here better
than me at some things alright alright
streams over thank you guys once week
once we get into programming language
debates
that's what shoes over thanks power how
do you deal with self-confidence you
don't ask that question you just have it
seven simple steps to raising your
self-confidence by
Works uh here I put product and quotes
all right let's go let's go hello
we gotta
mad tasty here
if anyone ever if any drink companies
ever want to sponsor comma you know we'd
uh we'd love to have you
um
preferably something a bit light on the
sugar you know
uh
Link Works you like you link to my
background this is this is my poster in
my office
um so let's give everyone a minute to
get in here my board just says tiny grad
a comma
uh
it's my large monitor I set up plant
automation today look at this automation
love automation guys
um what do we have to show you
oh is there any secrets on the I don't
know if I can show you we have like
fancy new metric sports but I don't
think I can show them to you
um
oh
it's that thing what what is that
what is that
I'm zooming in what is it it's moving
are those are those cat ears
[Laughter]
wait it might even talk
oh yeah look it's making its way over
here wow let's see if it's a friend
hello friend
can can can you oh you you hit down
there can you talk
you can just blink your eyes
oh that's cool
can can you hear me
all right you're right all right all
right all right
um yeah I mean you know it's it's a will
it fall in the way it's got wheels
um
yes so uh you know
there'll be some cool announcements at
Comic-Con
at Comic-Con you can you can come over
here you can come on in here that's
that's good
um there'll be some cool announcements
at Comic-Con related to The Comma body
uh look guys is it come here come here
it's using machine learning technology
for this and by Machine learning
technology I mean it's remote control in
the same way the cruise cars are uh
I mean I I wish you could you could talk
and the talking worked
oh
okay it said something it's like Pikachu
it just says Pikachu
okay all right well you know he's just
gonna Kenny's just gonna kiss his Kenny
or Bob or Billy I don't know
okay okay I hear you
um
George You Banned Me on Twitch but you
can't ban me everywhere bro
I just banned you easy okay
uh so so so
we are uh yeah no we banned him it's all
good uh you know some people that's
their moment of Fame okay so we're here
for a product announcement we're here
for a product announcement uh does does
uh does our friends here know what the
product announcement is I don't think he
does
okay okay I hear you I hear you
um
is that a comma one on the body no this
is a comma three oh oh you like it
because it's green no it just has a
green uh
green side
um
we have a product announcement today and
there's 213 people here that's a good
number of people uh there's Secrets
everywhere so I can't you know there's
so many secrets for Comic-Con uh if
you're not coming by the way Comic-Con
guys let's see uh this is in secret this
is just tiny grad
um
let's let's look at the web page for
Comic-Con let's go through Comic-Con
here
want to understand the true future of
self-driving cars and Robotics
okay you can you can you can go home
and you can chill if you want but you
can also go home
oh he's listening oh that's great I
think he can hear us bye
bye bye bye body oh he's a little drunk
that's that's you know it's a holiday
um
uh I want to understand the true future
of self-driving cars and Robotics come
to Comic-Con an IRL event full of
technical talks from our people
uh
deeb's gonna talk uh Dave's ahead of
open pilot Harold's gonna talk he's our
CTO uh
wait Shing is going to talk uh he works
on driver monitoring uh and then we got
burgers for lunch uh roby's gonna talk
he works on our Hardware Greg's going to
talk he runs our infrastructure your
scene's going to talk works on our ml uh
training and I'm gonna talk
uh and then we have uh Jason from
Discord who's going to talk happy hour
in The Comedy Awards flatbreads
attendees I heard we got demos and they
were delicious and then um some up close
demos so uh you can get tickets right
here uh there's only 23 early saver
tickets remaining and then you'll be
stuck with a general admission ticket so
I recommend buying your tickets uh right
now uh will it be recorded probably but
do not miss it come in real life because
things happen in real life not on the
internet the internet is all fake
um also VIP uh We've sold three VIP
tickets so far
um I think you'll be very happy if you
buy a VIP ticket uh we have a candle at
dinner there's going to be candles
um it's it's gonna be good
uh it's just like the cruise guys the
bodies just like the cruise cars it's
autonomous if you consider that
autonomous
um VIP also it's in San Diego uh this
was some pictures from Comic-Con last
year it's at the same place
uh so it's uh gonna be uh fun uh the
product is not just a shell the product
is not just a Shale to get you in here
um but I don't know if the product's
ready yet let me uh head over to open
pilot and see if the product is ready
how's our product coming
how's our product coming
we we are there secrets everywhere
oh there's Secrets okay okay what
okay you're merging our product now all
right great
uh where are the secrets
oh yeah that's far away they can't see
anything on this desk you're gonna get
some like zoomed in blurry picture and
they're gonna be like damn we figured it
out comma selling puppies
um
wish it worked on early C3 no it doesn't
work on early c3s it only works on c3s
that have come out in the last year
um so so 261 we're still growing we
can't do the product announcement yet we
got to build up the hype you know after
this commercial break
okay the commercial's over but don't
worry we're still not going to tell you
who gets eliminated from the island
because otherwise how would we fail a 42
minute TV spot with this reality show uh
okay we have like metrics over there
they're too blurry for you to see
um should we visit Alex let's visit Alex
uh
you can't visit Alex because there's no
Alex we're gonna go downstairs
I know you're excited about the product
announcement but it's not time yet it's
not time yet we'll give it we'll give it
a few more minutes let's go take a look
at downstairs let's go to our Factory
uh by the way if you want to come work
here
uh this is a very chill place to work uh
you can come work here and like we're
gonna we're gonna win guys uh you know
and I know I've been saying this for a
long time turns out winning just takes a
long ass time but like you've seen
everyone with the driving simulators
like commoditize your compliment love it
there's going to be simulators we got a
network we're ready to go
uh let's go in over here
um work sounds bad well if work's not
for you then this is not for you but if
you'd like to work
it's very chill place to work on
and just swipe into this door here
let's go
we don't have any secrets right
these are normal comma threes right no
secrets
I'll check out these are the common
threes before they get made
these I think these boards are half
populated or they're just empty
just empty boards but they go in here oh
look it's an Alex
and then this is a jet printer
this machine is a pick and place machine
puts all the parts on the board we're
fixing up some old boards here
uh this is our Reflow oven
hey Alex
we're live
what do you mean you got news for me
oh oh it's live oh
oh no I didn't tell anyone what it was
that's what they don't know
oh no
well good the website takes a while to
push anyway
um great uh yeah this is our inspection
we inspect all the commentary boards I
could super precise cameras okay I gotta
go we gotta go do the announcement I
mean maybe this is the right place to do
it yeah
yeah right here in the middle of the
production floor
we have some comma threes here on the
stress test all right we're doing it
we're doing it we're doing it
today the comma
three comma care extended warranty goes
live you guys have been asking for it
for years for years
and today we are finally at a place at a
company where we can actually do it and
I'll tell you guys this is going to
print money
uh this is going to print money you know
because the failure rate is low but if
you want warranty if you want that peace
of mind you should buy it at 400 and it
just extends your factory warranty to
two years instead of one
uh so yeah that's the product uh is the
website really live do you want to like
bring it up on your phone and we'll
stream from your phone
oh we have a computer in here
over here
oh we use this to buy things off Amazon
I see
oh okay just go to the go to the website
I think so
oh good website oh wow you can buy a
comma three and when you buy a common
three wait wait wait where is it a body
all those oh comma care whoa the comma
care extended warranty now you can buy
this either with a new comma three or
with a comma three up to one year if you
do not have a common device you can buy
the extended warranty but it's a
donation
um we do love donating purchase an
additional year of warranty coverage and
then you can read a bunch of fine print
Alex would you like to read some fine
print to the people yes
[Music]
not apply to bulk discount orders and if
you made an international purchase and
you have a warranty claim same as our
current warranty situation where these
familiar advice to us and we will cover
the shipping costs back
um it's not apply to Common twos so
please don't ask and uh it's just just
like our limited Hardware uh warranty
against defects it does not apply to
Accidental damage so if you drop your
device break your screen wait I'm
literally we're literally getting booed
right now they're booing why this has
got to be a prank what do you mean don't
buy it if you don't like it
yeah if you're not interested we're not
forcing it on you but it's just like hey
if you're worried about your device
you know you just can't make people
happy man it doesn't the warranty
doesn't affect you if you don't buy it
wait maybe it's just one guy booing
[Laughter]
after watching this
[Laughter]
you look guys
uh
calling a warranty a product oh they
wanted a product Oh guys you're gonna
have to come to Comic-Con for that oh oh
you wanted a product announcement that's
why product was in quotes whenever it's
in quotes it's never what you want today
you learned about quotes
[Laughter]
crying right now
that's right
want to sell 100 200 warranties you're
welcome to but we sell them for 400 and
we make a shit ton of money on them but
to be fair people are always asking
about this they're like what if I break
my advice out of warranty guess what uh
three two year warranty is cheaper than
a comma three was last year
for 1900 you can get the comma three and
the warranty for less than a comma three
cost last year
do it for three years it's two
um
should raise the common three prize and
include harness we can think about that
the parts availability is amazing thank
you thank you thank you we're getting
rid of it now that we sell extended
warranties no just kidding uh look we
support the products the comma two
failed the comma two was not our best
product
uh you know we were
it's hard to run a profitable company
it's hard to run a company when you
actually try to make money and don't
just want to do scams
um
but no it's okay I mean it was decent it
was cool for what it was but it didn't
have the maturity that the comma 3 has
we now have a big fancy factory making
all these things
um
companies failing
it's news to me bro
uh
behind this door we have profitability
uh is this a no fault warranty no if you
break if you like break the screen I'm
not going to give you a new screen but
if it breaks in normal usage we'll fix
it
uh how are sales sales are way up uh
since uh we lowered the price
sales have doubled since we dropped the
price to 14.99
so they don't they went up so much that
we actually want to back order for the
comma three
um
if you think 400 is too much I don't
think it's that far off from Apple
uh
uh you know it's it's an option people
are always asking we're giving you an
option
lovely option for the peace of mind
thank you thank you for the positivity
good sir
um how much is a steam deck I don't know
I don't sell steam decks
all right let's uh oh yes and if you're
just joined uh Comic-Con
Comic-Con is our yearly conference by
yearly
um
what typically kills a comma
does it count if the body falls no but
we have something to address that and
you'll have to come to Comic-Con for
that
um no Icom has been
comfortably profitable for the year uh
we got the sales boost we needed what
we're focusing on now in that factory
um we're doing a lot of stuff to like
okay so like our Counting
historically was just uh was just like
asset based accounting we weren't
tracking cogs correctly uh so we didn't
exactly know how much a given comma 3
cost to make we had a ballpark idea but
um we're working on just improving this
a ton uh We've made some parts changes
to the comma three completely seamless
to you screen has changed the cameras
have changed
uh and we figured out how to get
they're they're both cheaper and better
they're like literally if if you if you
buy things in bulk and you plan things
you can get things that are both cheaper
and better and this is how you build
incredible consumer electronics
uh do I expect additional price drops no
right now we're working on it's not
about dropping the price it's about
increasing our margin that's right so I
did I took a hit to margins when I when
I uh when I lowered the price
um you know I'd like to get our margins
back to 60 and they're not 60 right now
how much do we pay software engineers at
comma uh
uh again if you're looking to like well
I'm gonna maximize my TCO yeah go work
at a Fang and do nothing with your life
uh but if you want a comfortable salary
uh I think we pay between 80 and 150 uh
and then you can choose equity and how
much Equity you choose depends on how uh
the salary
uh how much Equity you choose depends on
how much salary you get if you want more
Equity you get less salary if you want
more salary you get uh less equity
uh I mean look
we had an employee buy a house off his
comma stock there's money in it
um
any remote opportunities we don't have
opportunities periodly uh period I I
hate that uh word what the hell is an
opportunity you want to work remotely
contribute to GitHub right uh you want
to job remotely well I'll think about it
after you contribute to GitHub for a
while
um the tiny Corps remote uh my other
company the tiny Corps is on remote uh
but again the bar is even higher to get
hired so
heavy device falls off the glass and I
have to glue it back constantly buy a
mount follow the instructions and I
promise you won't have to do that make
sure you clean the windshield good and
make sure you leave it up there to dry
for like 24 to 48 hours and you'll never
have to stick it on again
why doesn't comma register some
Representatives yeah
someday we'll have to do this
uh someday we'll have to do this we'll
have like like qualified installers and
you'll go through like a I just you know
what I really I'd like someone else to
manage this and take the profit from it
um but we'll set it up if we have to
uh it can verify you're paying attention
if you're wearing sunglasses
again a lot of the DM Now isn't to end
it's just like looking at you like if a
human in the deceit next to you can tell
whether you're paying attention the
comma three can tell
um you have side cameras the comma 3 is
a 360 cam
great work on the new Cabana that's all
Dean Lee I believe I think Dean Lee and
uh and Willem wrote that
um
what about an Upstate on the comma 3
lifespan I mean lifespan of devices is
however well you take care of it and
stuff you know
they don't like they don't have an
expiry day it's not like eggs bro love
the new product thank you thank you I
love the positivity
um let's figure out how many we sold
let's see if we can get that
uh can we can we get out how many we
sold if someone at comma is watching
this and wants to post it on uh on Slack
uh
was the DM model trained on hand labeled
data yes some of it
uh it's boosted we have some we did some
hand labeling and we did some automatic
classification it's it's a combination
uh does it work with Chinese EVS I'm not
sure I don't know any of the two uh the
3D print for your ODB Port disconnected
I don't think so what you mean your
comma power the 3D printer I don't think
so
um
didn't I leave the company I'm the
president of the company I don't work
here every day
um
I do uh no I mean the company's mostly
independent now I mean you know Alex and
Harold uh run the uh deep let's have
another deep in the company
um
what happened to marketing intern well
my deal with comma about being a
marketing intern and someone said you
know I thought about this a little bit
it's like we've never had a thousand
common threes in stock once we have a
thousand comment threes in stock the
marketing intern will return and I got
some sick marketing ideas
um
it did disconnect
what do you mean
like post a post a picture on Discord
and we'll take a look uh when are we
where are we on navigate on open pilot
come to Comic-Con come to Comic-Con and
you will hear all about navigating on
pilot
uh
can you develop a magnetic easily
removable amount why do you want to
remove the device leave it on your
windshield
how does he affect the comma 3 should be
fine
uh I mean sometimes
uh sometimes
you uh
okay stop spamming chat if you spam chat
band
um
can I tell you a digital pass the com
con do you think I'm gonna sell digital
passes you think I'm an IP scammer bro
um what will give you the VIP digital
experience come on come on you think I
do that it's gonna be streamed probably
I don't know we'll see if I want to pay
the streamers
um where might you find more information
on the design role do you really want it
if you really want it you don't have to
ask me that question you'll find plenty
of information
where do you really find more
information you you want to get hired
for design it comma go contribute to
open pilot go contribute designs to open
pilot get people to start using them in
Discord and I'm like damn that's who we
want to hire you know what I mean
um literally go you know what's terrible
our lane change UI go commit a better
Lane change UI to to open pilot and show
that you have design skills by doing
that I mean even if you know you should
be able to code two everyone should be
able to code but
um
what the heat the commentary should be
fine I mean sometimes it overheats and
it'll tell you that it overheats uh
pretty rarely but yeah if you leave it
out in a baking sun it's going to take a
little bit to cool down
um but it's not gonna break the device
no it's not like Elon saying I'll pay
you if I like your system
that's that's doing six months of work
I'm asking you to do a week of work and
if you're not willing to do a week of
work to get a job you're going to have
for five years I I don't know how to
help you man
um
how does the latest build compare with
FSD we're focused on different things
from FSD but like we're getting there
we're we're working on the same uh you
know sort of stuff navigate on open
pilot is going to uh
we're getting there right that's a
different approach it's end to end it
approaches it from a different angle but
when navigate on open pilot launches
come to Comic-Con
uh you will uh
be able to type in a destination and the
car will go there watch the Taco Bell
video if you didn't
I love the navigation that's already
available in master awesome uh I don't
think navigated open podcast you might
have to enable some Flags I'm not really
sure what it is any plans for outside of
U.S
are you from India I always get this
question from India like it just works
man I mean I've seen some of the Indian
roads and no it doesn't work there
nothing works there
um
what are you hiding behind that mirror
what is it like the Arsenal's punch line
and
it's not a mirror it's it's a whiteboard
uh any plans to remove the can FD
Hardware
ah you know either you gotta talk to the
hardware team for road maps I'm the
president I don't do road maps
um
works like a charm in Norway awesome
uh
uh encrypted can buses by votes like I
said once Maine oh I drove around cones
oh look and we didn't even need to
detect the cones look at that
um
oh should you wait for the next release
I mean what next release
I don't know what to tell you like what
do you think that the comma 4 is going
to have that the comma 3 doesn't right
like for the comma 2 everyone was like
man oh yeah no it needs more cameras it
needs more cameras and then like we ship
the comma three and it has more cameras
well I don't know what else you're
waiting for
navigating an open pot managed to turn
that's good
uh can I talk a little bit more about
the longitudinal strategy of cars so 60
uh 33 of cars use open pilot
longitudinal 33 use stock and 33 use
stock but have open pilot longitudinal
available that's 66 that's pretty good
for me
don't chase long tails
uh buy a car that's supported
constant follow this and profiles yeah
didn't you see didn't you see the toggle
there's there's a toggle now you can set
aggressive normal and chill uh and it'll
determine how closely it follows and a
whole bunch of other kind of
aggressiveness Maneuvers because in
general people who follow claws also
want aggressive driving in other places
quick acceleration
uh slowing down less returns all that
kind of stuff
the comma 3 comes jailbroken that's true
that's true the common three is a dev
kit you know I had someone ask me about
that about the dev kit thing people are
like comma doesn't sell a real product
they only sell a dev kit what do you
think a Dev kid is bro it's a word if
the word Dev kid bothers you it's not
for you
but
if you're not bothered by words and can
see what things actually are what's the
difference
uh uh
thank you
select profiles on a button some force
will do that I'm sure if something's
really good we'll merge it
let's look at the warranty
wait how do I buy it
was the buy button
oh this is like a oh I'm in some like
weird website thing
here we go
extended warranty
um everything works oh experimental
works much better on freeway is awesome
um if you park it in the sun where it's
really hot it may take a few minutes to
cool down before you can engage but it
won't break the device
um
right because like the device is rated
to handle really like 85c but kind of up
to 105 for some components and you're
not going to get hotter than 85 just
sitting on your windshield you can get
up to like I've seen 80. uh but once it
turns on it might go over that so it's
not going to let you engage but it you
know it keeps it locked until it cools
down but again this is only the most
extreme uh weather conditions don't sell
out what do you think I'm gonna sell out
what do you think the world could
possibly offer a man
uh you know we're going to sell
self-driving cars and it turns out
everything just takes a really long time
I think it's gonna take seven more years
uh I think I think by the end of the
decade
the common devices will be able to
you'll be able to put in a destination
and
um
let's say 99 of the time it gets you
there
um
well yeah right and that's the other
thing too like having open source
software kind of makes you structurally
impossible of certain kinds of selling
out always be afraid when you're using a
thing like even if the people are nice
now if you're using closer software or
you're using God forbid some web thing
you know watch out for like things like
GitHub you know
um they might be nice now but they can
flip a switch
it's for charity sure why not
we love charity but only like a Good
Charity like like a charity that's gonna
like make Power cheap
boxing for cheap power I love it uh do
we need more decam images more decam
images are great I'm not sure the last
time we tried to train a segment but you
know more is always better
um and we are going to train and ship
that model
uh
in a bit so I want to do a complete car
no I don't want to make a car whether I
want to make a car
don't make it free make it cheap it's
much better
um
F-150 Upstream to master I think it's
going to happen
I think there's really blockers on that
how annoying is the install on that car
punches for power yeah I love it cheap
power let's figure out how to make Power
cheap for everybody Cheap's good free is
dangerous
on freemium someone subsidizing you
would I fight Zak Zuck looks Jack now I
don't know
uh yeah yeah yeah so the only thing the
comma 3 lacks is compute but that's why
we put the expansion port on there it's
going to be hard for us to keep up like
you can't buy Nvidia chips so just buy a
cheap gaming laptop shove it under the
seat and connect wire
um
I think Zuck could beat my ass to be
honest
uh
I mean now zoc not old Zuck I'd have to
I'd have to practice fighting too
um
no I wouldn't fight that's not I don't
know anything about Destiny man
uh let's bring that one up I don't know
he's a YouTuber
uh
uh does that include EU roads oh because
they're so different it includes
everywhere except India roads okay
because I've seen India Rhodes now
and
I don't know maybe it'll even work there
I don't know might work everywhere
I think that matters though you think
like that's the limiting factor oh does
it work in the rain so stupid it's all
about intelligence right you build
intelligent things and they'll work
anywhere that a human does
can you drive on EU roads if you're an
EU person can you drive on U.S roads
right so why is there a difference stop
discriminating between silicon life and
biological life
um
wait what
the VIP tickets sold out
wait no no that didn't just happen
wait oh my God
wait this is actually selling tons of
tickets why did you guys buy general
admission tickets and not only save your
tickets but I don't know what to tell
you yo
though the early birds sold out but the
early saver didn't
I don't know 12 people can't read and
bought general admission tickets instead
of early saver tickets but I don't know
what to say
uh wow
the candlelit dinner got you guys all
right all right I mean we can't do more
it's VIP I don't want more than 15
people if those are legit then you got
the 15 VIPs man you should have watched
this stream
uh
right
um yeah well we'll include like maybe
we'll include like five more shots for
five more spots for the Mega benefactor
VIP and it'll be like 10 racks
um you guys are making Comic-Con
profitable you know I love to make
things profitable
all right uh uh do we have anything else
you like my five lighthouses that the
other body the thing on the top of the
body was that was a Vive tracker used
for calibrating our slam system
uh C3 works better in the rain than you
can see the C3 never works better than
you but it's not because the cameras
can't see I actually believe the cameras
can see better than you can in the rain
I do not believe that it's anywhere near
as intelligent as you are
um even if you're rather dim-witted the
comma 3 is even more donated
foreign
what do I do all day
well I have I'm the president of comma
and I founded a new company called the
tiny Corp and I worked there
um you can watch my GitHub you can just
like I do all my work in public you can
go on my GitHub and watch all my
commands that's where I do all that I
code
um
cameras can see better you can see in
the rain part of the reason for that is
the camera is right up close to the
windshield so when you have raindrops
hit the windshield like you need like a
wiper to clear them away but if it's
close it's just like it's out of the
depth of field so you can just see
through it
um another nice thing about the common
three is it has two eyes so like if you
happen to get a raindrop in a bad place
the other camera can see and that
already all works is putting both into
the model
what are you using for slam we built it
why should you buy the Box this is not
here we're here to talk about comma
um
what do you think we're gonna run the
comma model you're gonna have to put a
tiny box in the back of your car and
then connect that to your commentary
give it some super powers
uh display simulator I don't have any
simulator stuff planned maybe Harold
wants to do a uh a stream next week and
show it off
foreign
what oh now you're getting double band
bro
um what is slam simultaneous
localization mapping it's the asking the
question uh what's the map look like and
where am I
um supercharged comma 3.
sweet uh uh next week sounds good
uh yeah just like drive around the
simulator just like driving
forever.jpg.jif.mpg.getex
played and went up
um can you download the weights of a
slab model it's just it's the same model
super combo with slam
I mean not exactly but
it's yeah
I'm he hears I don't make I don't think
training should be open source
um but I do think weight should be open
source weights for local inference
should be open source and uh
uh obviously the runner should be open
source and that's like what album pilot
is I mean that's like my view on open
source machine learning I think like
llama and llama even llama could have
actually made the way it's available for
download we make our way to available
for download in open pilot uh we have
since the beginning
so yeah the weights are free to download
the architectures are open but the
training stack is closed uh because
again the training stack doesn't benefit
individuals the training stack benefits
large corporations there's only a few
people who can run that training stack
are our our uh super computer now costs
over a million dollars uh and you just
need a million dollar computer in order
to train this stuff so
um Acura MDX I don't know why that one's
not supported
show your server room now we're not
going to serve a room today
uh uh I have the open pilot lost
landscape is picture to the right oh
that thing yeah uh no no here uh you
know what I I saw a cool thing I can
show it off with waiting uh was working
on this
we're working on confidence
um that show you how confident the uh
the open pilot is in this area so these
are places where the confidence is red
uh these are places where we you know
engaging probably won't really work and
look you see parking lots uh parking
lots driveways right like it's not
really going to work there
[Music]
um
what
oh man
wait this is not loading
oh we have to like download yeah
uh uh these are all videos
it'll be cool when it loads but yeah
then we have yellow ones down here and
you see those are
uh hang on let me let me fix this
uh bad Chrome
bad crap
my life so much okay so much memory in
this computer all right there we go
it's just broken
Firefox maybe Firefox works
do I have Firefox
Firefox
I love Firefox all right cool
uh yeah Chrome well Chrome just broken
all right so these are red confidence uh
places where engaging probably won't
really work you see like there's like a
left lane and a pass and where you're
hanging on a lane line
um can I send a link to buy the warranty
uh you can find it just go to common.ai
so then we can look here these are
yellow areas so yeah these are places
where it's going to kind of work
you know tight traffic
[Music]
roads neighborhood and then we have
green areas and these are places where
uh
it's totally just gonna work
you can look and they're just mostly
boring highways
um is it easier to hire a guy in India
to drive the car remotely you have two
problems latency and incentives
um
is there some calibration of the
confidence yeah so it has to do with its
expected number of disengagements per
minute
uh so you see here
uh this is transitions from green to
Yellow this is expected to have
you know one disengagement about every
um
well that many minutes
that unit's not great uh but yeah there
we go so green is over 10 minutes
yellow is over one minute and red is
less than one minute you're gonna have
to disengage in
uh so we're gonna ship that that's gonna
be like cool we need a designer we're
hiring a designer uh if you want to come
work your own design the best way to get
that job is to fix something up in
GitHub look I'm not asking you to do six
months of work I'm asking you to do a
couple days of work and if you're not
willing to do a couple days of work for
a major life change in your life like a
new job
like I don't know what to tell you bro
um but yeah fix up something show that
you can do it even just if you just put
some beautiful mocks like if you're like
you know I can't really code that well
and open pile it's confusing I don't
know the harder to run it put some
beautiful mocks and GitHub issues yeah
um additional discount for C3 extended
warranties who paid full price no
and come on what do you what are you
hassling me for come on I try my best
look guys like using comma we make money
now but not like shit tons of money
so much you know so much money I've made
off this company
I haven't sold a single share
um and I've paid myself my average
salary has been like
under six figures certainly
um so you know I haven't paid not much
money but you know it's not about now
it's about the future right like it's
it's about you know eventually this
thing's gonna print money
um
exponential growth
hockey stick guys hockey stick
uh no it's not 78 000 anymore I'm
actually getting no salary right now
because I really only come in like one
day a week and it's mostly just for shit
talking
um
so I don't get a salary right now
uh also I have another company which
also doesn't pay me a salary
um that company will pay me a salary
sooner though because we're gonna start
to make money
uh
uh is the square painting a secret
message yes can you decode it it's
steganography try the LSB and XR with
the Bible
um
what else we got
uh one time actually Cynthia
uh yeah at least this is cool we're
trying with them any corporate
Partnerships in the near future
How's that gonna happen
I mean maybe I don't know who bought 15
VIP tickets during this stream maybe
like the whole GM executive team is
going to be there and then you know
we'll see
um
wow I can't believe the VIP tickets sold
out like who bought them
that's just crazy
and what about all the VIPs who are just
hearing about it now you just don't wow
oh maybe there was I don't know what
happened
whatever
it looks like there might be VIP tickets
back
okay it's only six were sold I don't
really understand or maybe we just added
more I don't know what happened but
there's a few VIP tickets left but it
seems like we sold a lot
oh if someone has them in the car oh
that's interesting
uh interesting
there's a commentary void manufacturer
warranties
there's plenty of stuff to Google about
that uh uh your warranty is between you
and your manufacturer but no no if your
engine breaks they can't avoid the
warranty because you stuck the thing on
your windshield
does it void the warranty on the car now
look up the it's like the Magnuson Marsh
Warranty Act or something don't break
your car nobody's ever had a car broken
I think the worst thing that happened
we've had a few fuses blown and I think
the worst thing that happened was a
camera ECU uh the camera broke uh and we
actually covered it because it was due
to a miswiring in our harness and I
think that happened to one person so the
worst thing that ever happened to anyone
uh was 900 of damage and we covered it
uh and then people have blown fuses
which two bucks bro
um so yeah if this thing like breaks
your car in normal usage a we're very
interested in figuring it out and B if
it was actually normal usage we'll cover
it
um again we've had that happen to one
person and it was our mistake and we
paid for it
Partnerships would be easy with some
Vision please tell me more about this
please tell me more about how you think
this actually is going to happen
uh does comma warranty cover the car no
again
if if like your your tire breaks bro
like no
um
but yeah no like I said it's not gonna
break your car
uh these things are very uh robust to
that uh
yeah I mean you know what don't take my
word for it look online
um it's all electrical it's not a
mechanical mod so it's it's talking over
the can bus and it's getting power
um
can you send back your broken 3D print
for warranty did you break it or did it
break in the course of normal you is if
it broke in the case of normal use it'll
get a new one
um if you broke it no buy one
um we'll open power stack eventually use
tiny grip what do you mean eventually it
started using tiny grad six months ago
uh and like not even a like we ripped
out smpe for the main model it's all in
tiny right now
how does this guy keep coming back
remove
all right we're gonna do like five more
minutes of stream
um
I get low IPC what's IPC I don't know
what that means
inner process communication
can you get drunk yeah but don't drive a
car
um
it's never it literally it's never
broken a car like how would that even
like happen look at a car and then look
at the the
um have I tested FSD beta FSD is you can
read there's a lot more comparisons
online that go into a lot more depth
than I'm gonna go into and I've only
tried FSD beta a few times
um but the big difference is kind of how
chill they are right like FSD is like a
I'm driving now whereas open Pilots like
uh bro I'm helping you out all right our
slogans make driving chill
do I still drive a Kia
um
my car is actually not supported by open
power very sadly
um but I'm probably gonna sell it and
get a new one that is
uh is comma rev G
pre-production or production Hardware
that's production Hardware
uh dirty tested in a comparison it's a
fair comparison
say like I think some people prefer one
and some people prefer the other
some people will tell you actually I do
find that most of the sentiment I read
says they prefer open pilot to FSD but
I'm probably looking at more open mild
sentiment
um no I do not I actually have a Rolls
Royce Ghost uh
open Power Dealership packages would be
dope any dealerships welcome to offer it
right
um
looking for a designer yeah guys we're
trying to hire a designer Alex I shield
for this a whole bunch I really think
the interview is that they should just
put some mocks or put something up on
our GitHub all right like if you want a
job here you know how to get one
I you know I I hope the whole world
moves to this I mean the tiny corpse
entirely like this I really hope the
whole world just says like
you know I don't want your resume I
don't want to do an interview why would
I do this stuff like this is what we
make
can you help
right because that's the question that's
the fundamental question that's being
asked at a job
um
and then for things where it's like okay
like our research Stack's not open
source so like we have a programming
challenge there we were just saying in
the meeting this morning saying every
single person who still works at comma
either did well on the calibration
challenge which is a like a difficult
computer vision challenge or
has contributed to open pilot before
they started working here
and if you're not either of those
why would I hire you
like you don't work out well you get
fired
and that's just historically what's
happened
uh injection molding designer we have a
hardware team
um who by the way
uh
the hardware team got hired through the
same process
everyone on the hardware team actually
the three people on the hardware Team
all either were external contributors or
did well on the challenge despite doing
Hardware so
um how's the comma body I mean you saw
the common body watch the beginning of
the Stream
are we considered languages other than
python let me show you something
how much of open pilot do you think is
written in Python
right this is some myth that open pilot
is written in Python
uh uh why is they get up here
well it's more python than I thought but
it's a 35 C plus plus
so all the stuff that's fast is already
written in
see product designer UI ux designer
brand designer I don't know what any of
this stuff means you see open pilot I
want it to look better and communicate
better whatever can do that
all right like you saw the lane change
thing it looks terrible comes up with a
bar that blocks the bottom of the screen
that says bro you're making Lane change
like don't do that you know
um
we'll detect speed humps and
experimental mode I will share
how do you detect speed humps do you put
a box on a speed hump in your head like
I just I can't even like tolerate this
anymore you know
who still thinks like that man
um
we'll navigate an open pilot ever be
capable photo automatic Lane changes yes
uh yes in certain supported cars right
like you know it's a spectrum of how
well supported the car is but if you
have a car if you have both a comma
three and a car like the the ev6 which
has good Corner Radars yeah sure I think
I can I think I think we can make Lane
changes more reliable than you
cone guy needs his job no he doesn't man
no he doesn't
why is experimental mode so slow we're
working on it it
there's challenges there's challenges in
the simulator and I can talk about why
there's a bias toward going slower and
going faster but
like this might not even be true but
like one theory is that the simulator
only has a certain amount of
longitudinal range and obviously slow
things are less likely to fall out of
the simulation range so the RL keeps it
I don't know if that's being corrected
for it but we're moving to third
Paradigm models we're using simulators
it's all going to be better
um
the common body is going to do that
common body is going to make ice no
we're going to open comma coffee you
guys hear about Kama coffee we're doing
a mall store too we're gonna open a
coffee shop at our office and the robots
are just going to serve you coffee and
it's just going to print money because
we got robot labor man
um and then the software Engineers of
course get paid a lot more to make the
robots good but someday man someday
three common bodies are gonna get inside
an Acura ILX and they're going to drive
it to Phoenix and they're going to open
a donut shop and they're going to be
bringing me back a box of cash every
month and like George why are they
bringing you back a box of cash why
don't they just send them money
wirelessly and I don't trust that put
the money in the box and drive it to me
that's right
um
to have a partner from the community
what do you use a product fix whatever
you think the problem is
you know what I mean like do you have
something you don't like about it fix it
I suggested one thing but you can do
something else
thank you thank you thank you I
appreciate that
um
you can't use native campus you can't
use native cams you can't access them
installation is already hard enough
um too many people start with forks hey
man it's your product
come on whatever software you want on it
that's the beauty of it
um
motorbikes fuck no
nobody has died nobody has gotten
seriously injured with a comma part of
the reason is because the cars are very
safe
um
not support motorbikes
can you get a job validating video data
are you a computer
um
none of boats
uh live stream yeah I want to do that I
want to do that from connect I think
that's with the body stuff
I'm not trying to like measure the band
it's like make driving chill like you
have to get it or you don't
um
look we've done no marketing you don't
understand like like advertising that's
great what devices am I going to sell I
don't have enough little boxes to sell
but this year we 2x the number of little
boxes we're selling and now it's too
many little boxes the factory can't keep
up so we've got to expand the factory
and get little boxes by the way we're
also hiring ahead of production
um I'm so shocked at how bad all the
applicants are for this role I want
somebody who knows every part in a cell
phone I don't think this is that hard
I'm not gonna like ask you I'm not gonna
like troll you and ask you about like
some like random you know transistor but
I'm gonna ask you basically like what's
in a cell phone and who makes it and I
don't know how people don't just like
know this
um do comma devices upload video clips
to us yes is there an option to turn it
off yes it's open source software it's
not a toggle you got to go in and edit
it
um it doesn't upload the front camera
has a toggle the main camera uploads by
default but again it's open source you
can turn it off
Nick is still at comma yes who makes
Snapdragon CPUs that's a good question
um don't give away my interview
questions
um what is the new product it is an
extended warranty it is a two-year
warranty for your comma three it is four
hundred dollars
um look
it's not for everybody but I asked about
this on Discord and I said what are
people willing to pay
and like at 200 it doesn't make economic
sense for me uh at 400 it does so we did
it right it didn't make sense for a long
time and again it's not because the
failure rate's high it's because of the
increased liability on the company right
like that's a liability what I'm selling
right
um so we have to say are we going to
support the comma 3 for two more years
and the answer is yeah so there you go
right like it's going to be still under
warranty and then so we're gonna
basically it's a commitment to kind of
support it for two years
warranty tangible I know what that means
um but yeah you want to look at it let's
take another look at the warranty
comicare extended warranty
come move into iot I don't know what iot
means uh no no it's one more year for
200. so it's a total of two years of
coverage
uh that would be committing to support
it for three years and we're not willing
to do that we are willing to commit to
support it for two more years
we don't send we don't send things to
YouTubers Linus Tech tips reached out
you know I'm not sending to a device you
can buy one if you don't want to pay for
it you can return it within 30 days if
you want to review it give me an honest
you know we're not like I'm not here to
like partner and do like that kind of
like scummy like oh well we partnered
with this this this YouTuber and uh not
doing that I just think it's gross man
like I like what Tesla does they're just
like yo man buy a Tesla and talk about
it cool bye come and talk about it
um
one more year yes one more year
uh
uh this video is sponsored by Common AI
I know they're actually not paying me
shit bro I swear they're not paying me
shit my salary right now is zero My
Equity has been zero for a long time so
you know Do It For the Love of the Game
I do it because I'm a shareholder I'm
sorry
would love to comment three buy one
today
um
oh they know about comma but like again
I think they were expecting something
different from us
like I think that they reach out to
these consumer electronics companies
they're like oh lightest
Tech break and I'm
gonna oh like review it if you want buy
one if you want talk about it I mean we
appreciate it but like
don't do it if you don't want right
can you buy our shares not really some
are very few are available on the second
Market uh
the only real way to get comma shares is
to come work here
one year warranty is actually uh
mandated when your manufacturer warranty
is actually a mandated at least in
California
um 50 discount on parts now if you break
your if you damage your screen those
screens cost me way too much money I'd
like the new screen is a bit cheaper but
they still cost me way too much money
I'm very upset at how much I'm spending
on screens because I know how much phone
people are spending on screens and it's
a lot less
I'm never going public why would I want
to be owned by Bankers you're not going
public right there is no public
is the oligarchy and the oligarchy is
the banks right so if you want to be
owned by Bankers then you can go public
if you want to be owned by people then
you know you stay private you'll send in
your PR all right how is this guy how
come there's no ban
there's no ban maybe I'll add them as a
moderator you know we'll do a full 180.
um can't buy it through the Toyota TSK
buy uh we have votes for that
all right two more minutes
don't ban you law band
two more minutes any last questions uh
how hard is buying a comma for a brand
new car and fingerprinting it for a
software engineer very easy
should just work uh if you're saying
your car is not supported it depends if
the model is not supported but the brand
is it's probably an hour of work if the
Brand's not supported well I think we
kind of support all the brands now but
if the Brand's not supported it's a lot
of work
what older Toyota do I recommend a 2021
corolla's fire a tss2 Corolla it's great
car I mean look it's a great car for
comma I personally hate the Toyotas but
that's just me
um I just think they're like loud you
know buy account a Sonata if you want a
nice car
I got my parents by Henderson
what music are you listening to hyper
pop
um
how long will it be before a comic can
be used on all types of vehicles it
already can't it's Tesla supported not
really
it's like saying like do you want to own
Android and iOS
um
you should make it possible to search
cars by type I mean how many minivans
are there the new website's the best one
we've done
um I bought any new cars no we're kind
of done buying new cars we're gonna
improve the ones we have
um by the way can you believe that GM
canceled the bolt like they finally got
a car that some people are buying and
they're like you know what we should do
let's cancel it yeah that's brilliant
I've loved your executive thinking let's
go make Partnerships
um
why don't I advocate for stopping AI
why would I want to do that I love AI
um stopping progress
why would you want to stop progress
aren't you a progressive I want to
Progressive of progress
only conservative
GM dissolved after they cancel The Vault
oh with a V oh we're really going back
now
um
hiring remote people comma does not hire
remote uh tiny Corps does uh comma has a
strict no remote policy we have a
beautiful office here uh no remote uh
but tiny Corp will hire you remotely but
you got to contribute
um
you missed the product announcement the
product is a comma care one-year
extended warranty for your comma three
it's four hundred dollars and this is
the fine print and you can read it
um people always ask George but what's
going to happen when this is out of
warranty you should really offer a
two-year warranty now we do you can buy
it it's 400 but that's so much money
cheaper than a comma 3 was originally
comma threes originally were
1999 now common threes are 14.99 so for
the kids in the back what's 14.99 plus
400 that's right 18.99 you still save a
hundred dollars and get a two year
warranty what uh deal
oh
have sales gone up yeah sales have 2X
and that's the price decrease sales have
2X it's hard to disambiguate but between
the Taco Bell video and the price
decrease we are 2xing the number of
devices are selling
are there any oems that wanted to
integrate it oems have reached out again
like buy a phone call we sell phone
calls if any oems would like to talk to
us we sell phone calls for a thousand
dollars
um hotel conference rate discount codes
I don't know Alex can we do that can we
like promise like 20 people are going to
buy something and get a discount on the
hotel it sounds like a good deal
um thoughts on app Tara uh you know I'll
see let's see what they have when they
ship uh you know I also I'm curious how
safe that car is uh but if they ship
something and it's safe good for them
I mean again it's probably safer than a
motorcycle but
that is one of my concerns about that
car it's not like you know is it as safe
as a Toyota RAV4 yeah Prius yeah
you know I've seen Prius has hit
concrete barriers that uh at 70 miles an
hour and everyone walks away
um
I never seen a motorcycle do that
uh but no look abtera look abterra is an
example of if companies want to use open
pilot they're welcome to just use it
it's open source software it is our
trademark you don't have to acknowledge
that's our trademark if you want to use
open PAD if you want a fork open pilot
MIT license is super permissive
um
uh your comment thanks for Banning my
comma three your comma three will be
banned from our network uh only if you
mess with safety code
if you mess with safety code if you mess
with driver monitoring or you try to
raise torque limits uh you'll be banned
right like again I'm not here to stop
you from doing this stuff what I am here
to say is I don't want anything to do
with you or some guy was asking a
Discord like can I disable the seat belt
check and will I get banned yeah you'll
get banned right don't mess with the
safety
again getting banned doesn't mean that
the police come to your house right it's
just it's just saying that we don't want
to associate with you if you want to
mess with safety but if you don't mess
with safety by all means look tons of
people out there uh go out and run uh
and run Forks we're very supportive of
forks
um Forks the change you can change a lot
of stuff without touching the safety
uh no actually we don't send no but some
someone did uh did try a return scam on
us and we sent a pi to their house we
took the device back and I'm filing a
police report later today do not steal
from comma
uh no like I'm very serious about this
he's going to be super upset when the
police come to his house but do not
steal from me like you're stealing from
me
um what does it mean to be in the
network it means that your device can
connect to our servers and use our
backends and all that stuff
uh I will only go after them if they
associate themselves with comma Now if
you you can run whatever code you want
you bought the device for me I don't
care I'll just ban it from the server
right I'm not going to go after you I
will go after you if you buy a device
from us and try to do like a fraudulent
chargeback oh hell yeah I'll go after
you
um
all right
thank you for watching today's stream
the stream has been brought to you by
the comicare extended warranty comma
care extended warranty only 400
uh you can buy it for either a new comma
three or a common three you purchased in
the last year obviously for obvious
reasons I hope you can figure out I
can't sell you an extended warranty on
something that's not in warranty
um also sponsored by automatic plant
watering systems bought from Amazon it
Waters the plants for you so you don't
have to
um
I said it wasn't sponsored well I
probably lied
uh thank you thank you all for watching
today's stream
um
it's not weed
what was the new product the new product
is a warranty that's why product was in
quotes
uh
uh have I tried home assistant I don't
know what that is
all right guys thank you for watching
the Stream
have a good day
buy warranty come to Comic-Con and if
you want to come work here
it's pretty easy
uh can you buy a warranty even if you
don't own a comma you can
but it's a donation
thank you
bye-bye
thank you
um we post this
on discord wait for a few people to get
in here and then we will start
our office tour
give everyone a few minutes to get in
here
take a little bit of spin drift no more
leaks bros
no more leaks i'm so happy you know i'm
so sad when we're uh
when we have secrets i hate secrets i
hate keeping secrets
it's like lying i hate lying
uh so we don't have any more secrets
we're here to show you everything
content in production let's wait for a
few more people uh to get in here
and then we'll go for uh an office tour
wow there really are no more secrets
like i can show you guys the board
uh i can show you all everything
oops all right cool 44 let's get to 100.
let's get to 100 and then we'll uh we'll
uh we'll walk around the uh
the office
we've been working on the common three
for like three years now
uh all right let's go
so here we are this is all the comma
three boxes
wow that's a lot of boxes oh yeah look
oh we got more boxes over here
oh more boxes over here these are where
all the cases come from
this is what they look like before
they're sandblasted kind of gross
that's why we sandblast them uh this is
the heat sinks that still need to go
through final finishing
uh oh i guess we did get some knight
giraffes back from the jeopardy prize
look at these boxes look at these boxes
everywhere everywhere
um driver monitoring metrics
we've improved low light
face detected comma 3 a lot
these are new priorities now
uh yeah office is up there open pilot
1.0 you guys have seen that before
accessory boxes foam inserts
so much stuff this is the lens focusing
room
[Music]
comma three cameras being focused
continuous positive air pressure
so that we don't uh oh it's so nice to
show everybody everything now
yeah yeah so nice no more secrets no
more secrets
yeah you want to talk about what you're
doing i'm fixing the focusing setup
uh so this is the sound we use for
focusing on the lenses
now it's set up to focus the wide-angle
one so it's pretty short range for the
monitoring we also have these mirrors to
simulate like a longer distance from
the narrow angle cameras yeah i wish i
could use the mirrors for filming
we've got quality quality focus pattern
over there is that really what we're no
no we're
have you guys seen a virtual eye test
it's very similar to that
um these cameras are bad
oh but yeah wow that's that looks so
professional
listen these we've got in here
oh more camera boards
yeah i'll see what we got
infrastructure room the remnants of all
the failed la
eco's from the comma twos
ah what else we got
the remnants of the donuts from
comic-con
these are some common threes being
tested
you see that like we're catching
failures this one doesn't have a camera
plugged in great
um
still we have a card out here comma twos
these got to go away
some new comma threes for final
provisioning
all of various failures
um a beautiful set of comma three boards
just getting their psalms
and all this stuff's cool
some lenses of various sizes
injection molded fronts
oh you feel that the biggest holding
back in self-driving cars is software
not hardware well i mean that's
definitely true but uh
better hardware helps a bit we don't
want to disrupt the production people
too much we want to get you guys your
commentaries
as soon as possible got some boxes ready
to go check out that beautiful
cross country edition logo
um
you want to say hi to the stream hi
i have a lot to do today yeah it's nice
to not have secrets anymore
it's so weird to not of secrets you know
what are the secrets now it's not
secrets
guys we're we're planning a comma 3s
like in like two years
is it feasible to do some model training
on the comma threes no
comma three circuit boards you wanna
show them anything nick
[Music]
it's not really like a secret anymore
like some of the later
this is the new camera that's in
progress for the comma threes
it doesn't have any difference for you
the functionality of it's identical
but we're using these rigid flex boards
so there's one less wire that people
have to plug in
lowers assembly costs
yeah what else is there anything oh
should we show them like old wrap oh
yeah
see these these are the the old crappy
revs of the comma threes this one was so
crappy that they didn't even cut out the
hole for the dm camera
we fixed that on ref c and then we
realized that it looked disgusting
so we went to the uh non-square dm
camera
that you see now on the rev h's which
are the ones we're shipping
um calendar yeah yeah this is
the plans now batch one batch two
no secrets that's so nice i hate having
secrets all these are some so you got
more songs
guys you know how much all this stuff
costs an outlier
tons what are those inductors
are we using solder wick at scale yeah
we gotta buy it we gotta buy the world's
supply
uh whenever igor gets back he wants to
show off the red pandas
we're gonna build our first bunch of red
pandas
uh we don't have a trade-in program
unfortunately uh
guys we're not apple i can't do
everything at that sort of scale
um but you know you guys can just buy
you want
ah
red pandas that's the whole box full i
think
these are all red pandas let's say oh
yeah look
individually wrapped red pandas
we went with a different manufacturing
company for these
uh yeah lots of red pandas
you know every comma three has an nfc
tag in it
it's one of these nfc tags
old revisions yeah failures failures
that's one of the common dudes that blew
up when removing the battery exploded
this comma two that was left in uh
ultrasonic cleaner for three weeks
oops accidentally
yeah solder paste stencils
yeah different oh yeah this is when we
were moving each individual hole on the
back of the comma three
oh you mean the original comma three
that became the six well that yeah
or just the the bend beam flex rate
board
oh that's the ben yeah yeah this the
hardware museum
yeah yeah yeah the museum
vip office two or five grand let's put
on this
site
hey chris you got anything to say to the
streams what's up everyone
can i show them anything this is a
board what's wrong with it this is uh
old boards that's got some
warm issues but whatever is it so rev
it's the one we're shook oh it's h
check it out yeah we didn't we we didn't
write h on it i don't know what we were
thinking we should have rotation
right well we were like we'll delete the
rep because this is the final one
forever and then like well you know
[Laughter]
no there's no known bugs with h
that's why it's the one we're shipping
there were known bugs with every
that's why we didn't ship those it's
kind of why it took so long
uh where's the not the data center it's
over there
yeah oh it's so nice to not have secrets
we've got red pandas we're going to ship
them out soon we got to work on some
testing for them
can fd plugs into your comma 3.
uh the version numbers became something
different we had one schedule for the
version numbers and then we switched it
but the comma two will be left with
something good uh you can see our neon
cameras over uh
commas over here uh yeah
that was just so much it's all to go
away somewhere
foam pouches i don't even know what we
do with those
this is what happens when you put a
common three box together backwards
we ship them all black so it's stealth
uh i don't even have a comma three in my
office everyone took my comma threes
hey look it's our youtube video
oh is the traffic light the traffic
light represents the ci tests
uh so you can see that it's green right
now because all the tests are good
uh here's lunch you guys want some ribs
ribs are pretty good
[Music]
uh do a reaction to the live stream who
am i bo burnham
we're not going to disturb the research
office they have important research to
do they're out working on your
longitudinal
um
uh yeah uh
yo guys should i show the shopify
numbers they're really good
we rich boys we rich um
we're rich we rich we rich
ah uh we needed to make three hundred
thousand dollars this weekend
or you know we were gonna have to raise
money uh we
uh blew away the target of three hundred
thousand dollars we now have extra money
i love having extra money you see what
good mood i'm in when we have money i'm
in a good mood you know
um no i don't even have a comp all i
have is a comment too i don't even have
a comma three in my office who took my
comma three i don't know where it went
count three very rare it's probably
shipping uh
numbers nah no numbers no numbers it's
not yet o'clock yet
but we were talking about transitioning
the company 100
off of shitty spinning discs and over to
ssds
we can now afford ssds uh by how much
did we overshoot our goal
big money not that much but enough that
we feel very comfortable
uh yeah
watching live in temecula cool brevin it
was great having reverend was great
having you there
thank you for manning the comment three
booth um
that's it that's kind of all i got you
guys saw the cool stuff that lens
focusing rig's real cool
uh why don't we combine it into a hand
engineered perception layer
in your perception layer yeah gross we
do want to end here
yeah we need a new office if anyone
knows a good office we want an office
around san diego area
i share my injection molding per unit
price yeah the molds themselves aren't
that
expensive i think we're only paying like
like eight bucks for the case
uh but getting the molds made costs a
lot of money
getting the molds fixed costs a lot of
money and then we have to hand
individually sandblast them
so that uh i didn't even go to the top
see there wasn't it there was an after
party i didn't even go
uh i went home i was tired still
streaming
yeah yeah yeah we got them for sale tell
them if they buy one during your stream
are we pumping right now alex this is
adding complexity to shipping
oh there's just too much complexity for
shipping all right i'll show you guys
which
ones these are ultra rare there's a few
left
these are i think we keep them okay you
want to keep them or you want what do
you want to do with them
i don't have any preference i was just
coming i was just cleaning my office and
i found them
um three comma
says comma on the back is that screen
comma join the three comma club my head
is too big
well a lot everyone knows that
no no it's too hard if we like to like
say like we're gonna ship some you know
all right
i'll put one on the website for one for
500 bucks
it's the last though well how many we
have left there's four
yeah i think i think um i don't know
what's a good price for the hats what's
a good price for the hats guys
gift whoa that's not a good price
1k oh wow that's really what they're
saying
420 i like that 420 salt no no
69.69 is good we did that ones with
beanies
we sold 6900 beanies yeah we still do we
sell 675 oh sick
can i keep this hotties can i keep this
one
and we have to sell them you didn't get
sick bro you look like a real bro with
that on yeah yeah yeah you guys want to
go
uh you know anyone got a keg bro anyone
got a keg i'm interested in a keg
wait never mind employees didn't get
them you can't buy them
can't buy them yo check out the three
common hat though this is the official
hat of the common three
that was better
all right boys um yo if you're out there
from the media
uh send me an email happy to do uh tell
you guys about the common three we have
a press kit ready
we have a press release coming out
tomorrow when everyone has free time
again
uh all the lane changing possible yes if
your car
has uh good blind spot monitors
but it's not high on the priority list
very low on the priority list
am i going to participate in advent of
code this year
only if i'm having a good time if i
start to not have a good time i'm not
going to play i had a very good time the
first year
second year and i still had a good time
it'll be chill it'll be chill
you know i can't beat myself uh up if
you know it's like oh you got to be
there it's like no man i got things to
do all the way up i play having a coat
you know we only do it if we're here to
party right
when does the consumer version get
released
long-ass time um so we were on the comma
2 platform effectively the comma 2
platform for like 4 years
we think the same thing is gonna be true
for the comma three platform so the
comma two platform
included the uh eon the neo the eon gold
and the uh comma two
how can you request a press kit are you
press press at comment ai
you must be legitimate press
one come before a
long time you want an ipo release
yeah gross start making money off the
backs of others
that's what losers do start making money
off your own back start creating value
in the world
is any immediately noticeable difference
between the c2 and c3
the beautiful oled display uh the
stunning crispy picture crispy hdr
picture
uh yeah
cool no i will send it to vloggers i'm
just playing send
email press the comment i will send you
the top
uh yeah no we have to use the integrated
radar system if we want to see the blind
spots
and also to see if cars are coming up
fast so you need cars with good blind
spot monitors
part of the reason we made the red panda
is this puts can fd and some of the
blind spot monitors are on canfd
um your c2 demo window closed two weeks
ago
are you no
the return of two weeks ago could i have
three weeks ago now guys we're either a
company of laws
or we have nothing right
is the model open source uh yes uh the
training code's not
uh the training code would only be
useful to you if you had a half million
dollar super computer and the only
people with that are evil corporations
um so that's why the training code is
not open source but the model itself is
open source it's energy license just
like everything else
people are like common needs to open
source their model architecture well we
did you just didn't look very hard it's
an onyx file bro it's the most common
shared model format there is
just go into models and you know dump
the onyx file load it into whatever you
can run it on a pc you can run a comma
two and you can run another commentary
can you sleep while commas being used no
um
is there a panda inside the c3 like c2
yes uh the panda inside the comma three
is called the
dos and the panda inside the comma two
is called the uno
all right any other good questions
uh we don't ship from the netherlands we
don't ship from europe the europe office
is just a software development
contractor we do not do any hardware out
of the europe office uh
you're gonna have to deal with those
regulations you know um
has an oled display should i be worried
about burning we can wanna go to the
testing closet i can show you the ones
we've had up for weeks there's no real
burning
um so that's all i can really say about
that like we did test for it they seem
pretty good
they're samsung they're samsung oleds
like they're nice oleds
um so yeah if you like keep up one
graphic on there for a long time but
open pilot should never do that
uh
the 360 view will require neural network
retraining we need you all to buy comma
threes
we need you all to buy comma threes so
you can give us the data so we can
improve your comma threes
and you guys know if you're one of the
first people to give us data
you're going to probably be included in
the network forever
uh you ordered your cross-country
edition yesterday do i think it'll
ship this week
maybe if not this week than early next
again i can't make any promises uh
but maybe soon
you're definitely i promise i can make
this promise we are going to ship out
every cross-country edition
before we start shipping out the other
ones uh
so you know it should comfortably be in
two weeks
when will vws and audi's be supported
they are
uh how can i buy 35 of your company you
actually can't
you can buy every available share of
comment and it's still not 35
i'm not selling you shit um
can you buy commentary and put in a zip
car i don't know how zip cars work you
probably put it on uber and put it in
some i'll put it in turo i mean that'd
be great
someone should put in a turtle i'd show
you on twitter if somebody gets a turo
car and puts a comma in it i tell peon
tara
you can't buy comma shares we're not a
financial instrument we're a company
that creates something
um no upgrade program sorry you want an
upgrade program go on for sale sell you
two coin buy three coin
uh that's all i can really say about
that um also actually even better
sell your comment two to a friend uh
sell your comment to a neighbor sell
your comment to somebody with a
supported car
uh like just because the comma three's
out it doesn't take away from the comma
two the comma two is still great
and you wanna work there that's a whole
different thing we're definitely hiring
um if you have the right sort of skills
uh we'd love to hire you uh if you're
interested in research we have a
research challenge if you're interested
in an open pilot team the best way to
get hired for open pilot team is to
start contributing to open pilot
i wouldn't say that uh will new features
become difficult too yeah
some will some will some will be three
exclusive look if there's a new feature
if we develop a new feature
i'm not gonna like be a dick and write
an if statement and be like if comma
three work else don't
right like i'm not gonna i'm not gonna
be a dick if there's a feature and it's
like well it would be an extra couple
weeks of work to make it work on the two
well then it's gonna be three only um
but
like a lot of the longitudinal
improvements are just gonna come to both
can you contribute to the open source of
your html and css skills well
open pilot is written in c plus and
python so those are the skills you need
uh do we offer employee stock options
absolutely yeah um being an employee
here is one of the only ways to get
comma stock
uh or to buy it from an employee uh or
next employee
uh yeah so that's like you know who owns
who owns the company the people who
create the value right and then once
they you know create the value of course
when you're an employee uh you have
stock options
you can access there's a one-year cliff
but once you uh
own the options you can exercise the
options at any time and there's no we
have no transfer restrictions
uh so this is another thing that was an
important thing to me i hate those
companies that do the uh
like oh well you have a lock up period
for your ship like we don't have
anything like that
if you work here you get stock you can
sell your stock
uh
is burning covered by the warranty um
what do tvs do for this uh what are
phones though
i think i think we'll do the same thing
uh like i said i haven't
really seen it be a problem and if we
start to see if anyone starts to show
signs of burn in
we'll fix it in the in the ui but i
don't think
i don't think the oleds really burn in
um so no if you run some weird thing and
get burning no of course that's not
covered by the warranty
but if you're running normal open pilot
using it normally it shouldn't burn in
and if it is
we'll really look into it um
would you guys rather an lcd do an lcd
ah
we are a private company uh does the
better vision of the common three result
in better performance i get chiming less
about distraction when the driver is not
distracted
if you're having that happening do you
upload the front camera if you upload
the front camera and you're getting
false positives for driver monitoring
we'll look into those right away that
shouldn't happen
um in for a devops yeah we hire for that
absolutely
uh he wanted in for devops job
yeah just just just reach in i think i
think that will go through like the
hackerrank pipeline
um
if you make it through the hackarack
pipeline you'll hear from greg
uh you'll hear from me i'll ask you a
bunch of questions you know
know about you gotta know a lot about
computers and like how this all works
and we're gonna go all across the stack
uh so if you like learned if you
memorize like one set of certain skill
like i know this cloud platform
you probably won't get hired for infra
here but if you know everything from
like
you know okay if i tell you in a
motherboard like um
you know uh tell me about how pcie is
connected to the cpu right like i'm
interested in things like that
all the way up to like tell me how dma
works tell me what a kernel is tell me
what a sys call is
right all the way up um so know the
whole stack
longitudinal control come to the comma
three on the honda accord i'll do you
one better
uh that's one of the features that's
platform agnostic so if it comes to
three it'll come to the tip
the main the big push now for the three
is going to be on uh the navigation
stuff
and then you're going to get just some
passive benefits by the camera being
better
um and you're also going to get some
passive benefits by the cpu being better
it's nice to have an eight core cp
instead of a four core cpu
how many pull requests in open pile to
get hired for an internship if you're
thinking like that it's not for you
right if you're thinking of mentality
like i'm gonna like check
xboxes if you create value for the open
pilot repo i would happily give you an
internship right that's the right
mentality
um
well support stop for eon gold same the
same as the kamato
the eon gold and the black panda and the
comma two are effectively the same
um we stopped support for the original
eon because it required us to maintain
kernel patches
as we started to dive deep into the
kernel we wanted to make sure we were
delivering a uniform experience we
offered
everybody a free trade-in from their
original eon to the eon gold
assuming that they bought it from us so
uh yeah you know and
people like oh you deprecated the gray
panda yeah but we offered everybody a
full money back we offered people a 200
discount
if they sent in a great panda which was
the full price they paid for a grey
panda
we're pretty good when we deprecate
hardware i don't know what like the hate
on reddit is about this i think there's
just like
two haters out there who are just
looking for things to hate it's like
you know we're pretty decent about about
uh hardware
uh life cycles uh how are we gonna
manage the different stacks it's unified
go and master right now uh master on the
open pilot repo now supports both the
comma two and the comma three and
ninety-five percent of the code is the
same
we have good hardware abstraction layers
for all this stuff
uh no discount for the comment the price
is the same buy a goosebump
um you missed the trading hey pay
attention i mean i don't know what to
tell you about that
um with the comma 3 cross country can
you connect it to the computer and
access videos in the ssd yeah of course
i mean you could like it has wi-fi you
can do it over wi-fi can you do it over
the usb
port actually you know what you can do
get a usb to ethernet
uh again get one of these uh you can
plug this into the expansion port on
your comma three and it'll just be
on your internet with gigabit you could
sap the files off
uh did i really name the company after
smoking pot in silicon valley on hbo yes
absolutely
um names are mostly stupid
uh
will comment three work for cars in
pakistan see why not
like my thing about countries it's like
i don't know we depend on whatever data
we get
if there's a bunch of people in pakistan
using them they'll have data and roads
maybe looks similar enough to everywhere
else it'll probably work
um who designed the logo
i think i did the original one
uh longitudinal for honda accord being
worked on uh
yeah yeah yeah working on that um
i want to support the f150 what's the
worst mistake comment ever made
shiffer uh yeah we made a phone app it
was kind of uh
you know the comma six was also a big
mistake we made a few mistakes they
weren't like huge but
schiffer turned out to be just
completely not necessary and the comma
six
nvidia turned out to you know uh
when leadership changes make sure your
deals are iron clad in writing
i regret the name of decision.com is a
sick name uh
have we been approached by oems yeah a
whole lot but the problem is they don't
really know how to approach us right
like i'm not interested in
some shitty development deal like if an
oem approaches us i'm like okay how many
comma threes you want to buy we'll sell
you a bulk discount i'll even put it in
a different box if you buy enough you
want
you want a little one in a silver box
you can snap in your little thingy i'll
do that for you
you know send me 10 million dollars for
uh you know 5 000 of them and we're done
so sold um
yeah so but no this isn't how the
automakers work they they want this
ridiculous stuff and like
you know it's not like i said it's not
going to be ford buying comma it's going
to be comma buying ford
uh how can somebody ask me for a youtube
interview
uh i'll likely only do it if you have a
good chance at a million views
um maybe you can send an email and ask
if you if you have a channel that has
like a bunch of million view videos i'm
probably interested but
um
android auto compatibility not
officially again it's something that's
annoying to support
anything that's per car specific com is
not that interested in doing because
it's not the highest leverage thing we
can do right
like we have a limited amount of
resources i'd much rather apply those
resources to something that's generic
that we can apply across our entire
fleet than applying to something that
only targets certain cars
and then android auto every screen's a
different resolution
we really like a uniform experience that
we can apply across every car when we do
it because that's like the best use of
common engineering resources
um well comma three have traffic light
and sign detection
yes will comma two maybe like i said
with all features look if all i have to
do is like i'm not to put an
if statement in that says if comma 2 you
know make them buy the new one i'm not
trying to be a dick like that
um but if it does require some serious
extra effort to support it for the comma
2 it is only going to come to the 3.
uh it's also possible and we don't know
like this is something we won't know
until like we build it and start doing
the big data analytics on it
there's some traffic lights that you
can't see
in the comma two's camera so the comma
three has a fisheye camera and
you can see them all
um would i ever allow tesla to buy a
comment not anymore
uh i offered it to elon uh before the
comment two came out
do i have plans to go on on lex's
podcast i think we did one recently
enough
um are you planning supporting the
commentary for longer than the two
well so the two is kind of the end
combination of a platform right like
you can say that the two has been
supported now for basically four years
uh so do we plan on supporting the three
it's going to be kind of like the
the you know how long ago did we sell
eon gold right like
when the three iteratively gets upgraded
it's not like
it's all going to be on the same
platform so the support will all stay
um there's big differences between the
two platform and the three platform
so it's why it's advantageous for us to
drop the two platform but like i said we
promise at least a year of support
and if it's easy we'll keep supporting
it right
it's only we're also going to look in a
year and see what our network looks like
right
if in a year our network is 90 comma
threes and 10
comma twos then we're gonna put all the
resources into the comma three and then
we're gonna that's that's it for the
comma two support
if our network is 5050 and we're still
selling common twos by the way and if
people buy the comma 2 we'll make more
um i'm happy to uh
you know like the comma 3 costs a lot
more
but our profits aren't really higher
right like the commentary costs a shit
ton of money to make
those fucking sensors cost thirty
dollars of sensor
and that's just for the sensor never
mind the whole camera around it you need
a lens
you need to you need a cable you need to
focus it so you know when all said and
done like the cameras are
expensive right you know how much the
common two cameras cost
10 bucks right 10 bucks for the front
one and like
five bucks for the back one i was
talking 15 bucks both cameras in the
comma 2
cost less than half a single camera in
the common three
so you know i'm happy to keep selling
them both combat 2 is much higher margin
product
than the common three percent wise
um we make obviously more profit on each
three but the gross margin on the two is
higher
uh yeah well so zagnos absolutely
we don't sell in safety all we say is
that our goal at comma with safety is to
make sure that we don't make driving
less safe than driving without a car
right we're not we very much do not want
to make things less safe
more safe is just crazy right like our
goal is on par
i mean our goal is as safe as possible
but like our target is on par
is the company making any money yeah i
showed this off in comic-con
uh yeah we are we are profitable the
majority of our funding has come from
device sales not from investors
um how quickly did we start working on
the con before nobody has worked at all
on the con before
i swear i just walked you around the
office no one's even given thought to it
people you know we've given thoughts
like things we want to upgrade on the
comma 3 and we're going to
hopefully slowly upgrade them over time
but a lot of these things are not really
things that are going to change the
experience
the biggest thing is we have to figure
out how to make these devices cheaper
the comma 3 costs us a ton of money to
make
um who are our investors at the moment
a16z
a16z we did two rounds uh
google left on crunch baseball are the
green hoodies for sale i don't think
anymore i think they were event
exclusive
um if you beg alex and offer a lot of
money maybe
uh how bad are nvidia sales people
nvidia's a sad case and this
is a they're gonna lose nvidia has
flushed
down the toilet their future of ai and
their future of automotive
uh by a crazy
over-the-top like kind of
or really a really a really like bad
pricing structure and a really bad
like like they're just like like they're
just they're just trying to screw over
their consumers it seems like right like
there's no reason to say like
we prohibit the use of this thing for
this application
contractually like ew
um should you watch the replay comic con
yeah it's awesome
um so yeah we're committed to qualcomm
for the future uh i think all future
common devices can have qualcomm chips
in them
um eventually maybe qualcomm will reach
out and be easy to work with
a qualcomm in some ways is easier to
work with nvidia because
uh if you want to buy qualcomm chips you
can buy these from multiple
you can buy some from like 10 different
companies
you can buy the chips and the chinese
marketplaces with nvidia they're the
only ones who make the som and the chips
are not available in the
chinese marketplaces so like why are we
using video we can't we can't and i
regret the six months we wasted uh you
know some guy from nvidia reached out
and like he's like oh yeah you know he
heard that like kama was kind of
mistreated by nvidia
uh we want to like you know uh we want
to have a phone call to discuss this and
i'm like they're a thousand dollars and
the guy never replied
like so you know and video doesn't care
um and they're throwing away their
future in automotive it's so sad
yeah partner with mercedes that's the
future that's the future in video
that's ice bro um
realistically what cost reduction do we
think we can get on the comma three
uh like i said it's costing us a lot now
to make these devices
we are profitable but not we are making
money on each device but not nearly as
much as i would like
um i think we could maybe make them for
50 cheaper when all said and done
and no the prices aren't going to go
down the margins are going to go up
uh in fact we probably will raise the
prices a bit so
as we start to launch these features
right so what we've always done to comma
is we
start it low and raise it slowly over
time as as
the software provides more and more
value how'd the vip gen session go good
some interesting conversations
ah crazy that everyone kept the comment
through for secret so long yeah addition
to the epoch people too
um make cheap common threes is the
primary goal right now
what's up oh you want to know what hey i
showed them a little but
you guys here at the red pandas hi
everybody
so that's
the board and also you can see we have
these golden
pads this is gpios for those who want to
do
something interesting maybe to
to make their own device
use them for anything uh they plug right
into your
so uh this just plugs right into your
your commentary expansion port
uh they come in these beautiful little
red cases uh for sale right now
when we'll ship them probably pretty
soon we'll do the tesla yeah i think
close closer to two weeks than eight
weeks
very cool uh yeah they seem to be
working and we got
yeah and hardware support for sbi
iac uart oh on on
output of 12 volts 5 volts and 3 and 3.
so pretty everything
awesome abc also those
we gotta we gotta post a pit out
somewhere
and post a little uh pdf yeah a little
bit
uh yeah uh redpad isn't nice
the latest in the panda lineup
eventually all comma hardware
is going to move to uh to this but not
too many cars have can fd yet but we
like can fd
we like can fd a lot more than uh
then flex right because it's reasonable
cool yeah scraped up
red panda dope
uh what's our plan on getting
commentaries less expensive to make
give you all guys an lcd instead of oled
you know what i'm paying for them damn
oleds
now the gold's nice steel it's nice um
uh is something cheaper for the customer
planned or is it just going to be
getting more and more expensive
uh more expensive but more capable right
so so
it's a it's a trade-off of cost for
capability right and like
we keep the old product and the old
price around so if you want to buy a
comma two
it's the same price i don't think we're
going to raise the comma two's price
again i think that's probably the price
for the rest of the life
uh we're paying more for the oled on the
comma three than we paid for the entire
late eco phone in the comma two
yeah i'm curious about big model two we
haven't seen big improvements from it
a lot of the things that we think big
model are gonna improve actually comes
from data bugs
how many active users are there right
now i have like i said what
3 500 weeklies their good ips screen is
okay try
i'm not shipping a shitty screen trust
me the screen will be good i'm never
i never want the device like slip
qualitatively we're all about quality
here
you know when we first started out we
got a sign that said quality and the
sign was a little ripped and we were
like the irony we can't even make a
quality sign right
the company's moved a lot in the last uh
in the last three four years
um yeah you can play kanye's new album
bumping three watt speaker
still needs a little bit of tuning the
sound out of the box is not perfect but
it's not hardware it's software
tuning speakers is tricky and then like
there's all this like dsp frequency crap
we'll get it
it's pretty good it's pretty good it's
not bad but um
it's not hardware it's software uh
linux sound also so the commentary is
linux it's not android
and like in almost every way um
you know linux is better than android
but linux sound is a nightmare
uh my plans with partnering up
people always use this word partnering
can you define it for me
uh is there a notable development in the
temperature yeah the comma 3 in the
stress test
runs at like 60 degrees celsius the
comma 2 in the stress test runs at 90.
with the cpu at full tilt it's 30
degrees celsius less on the cpu course
do we have dedicated ux designers yes uh
do we hire ml engineers without hardcore
cv experience absolutely uh we think of
ml engineering a lot more of an
infrastructure problem so if you have
like
big data and like uh like like
experience with big data experience with
it's really infrastructure
uh we're happy to hire you i don't care
if you know like
the latest and like winograd
convolutions or whatever
um we're only here to talk about comma
this is the common channel
uh spotify or some kind of media stuff
no
we thought about this you know the
original eon had spotify
um but what happens
people are very happy with the media
solution on their phone people are
generally happy with the navigation
solution on their phone too
the problem is with the navigation
solution on their phone there's no way
we can
integrate uh navigate an open pilot into
that uh with music
use your phone how much is the c3
underclocked quite a bit
similar to the c2 uh
what's the difference between oled and
lcd screens google that
tell you more about navigation uh i
think i think
i think are in a blog post
does the comment three way more than the
comma two no it's lighter a little bit
lighter it's not that much lighter
our plans were to make it a good bit
lighter and then like things kind of
crept up so they're
uh but they're lighter than the two but
just a little uh it does help though
that like the comma two
has this absolutely ridiculous looking
mount
um the the comma two has a the comma
three is not like that
i don't i don't have one someone took my
commentary
um if you guys want to see the pictures
just look on the website
why does the com3 need so much storage
because files are big
can be used dash cam absolutely it is a
dash cam
uh do the folks at research also publish
stuff everyone's welcome to
it's just like we've published a few
things mostly a question of like time
it takes a lot of time to put those pdfs
together check out comma 2k19
original paper learning a driving
simulator uh
we wrote that blog the blog post on the
antenna lateral was kind of uh
really nice oh thank you i don't know
we found a dirty-ish pre-polished old
comma three
that's pretty nice still pretty nice
okay random comma three sitting in a
deep's office
um yeah but you can see that the uh the
the mount in the comma three is not um
you know stupid looking sorry comma two
owners
we put a comma two up on the wall with
the comma threes and we made fun of it
can i summarize the difference between
the comma three and the comet 2 features
we'll just like look at them first off
two cameras second off much better
cameras third off
two usb ports fourth off big driver
monitoring camera instead of little
driver monitoring camera
fourth off it's not like stupid and big
and have these big
plastic ears on it just all screen
pretty much
uh those are most of the benefits of the
360 obviously you can see
out here it can see out here it can see
actually out in every direction because
360 is all the degrees
uh the 845 gpu so the flop number is
only like 50
more but you see in practice it's like
twice as good
because the limit is actually not the
alus it's the memory fetch pipeline
i've looked a lot into this i've looked
a lot into this so the 845 gpu is really
about twice as good as the gpu on the
a20 the dsp is a ton better
uh we barely even tapped that um
on the on the three i think we're using
like 12 percent of the gpu
our dsp on here and we use like two
percent here it's nothing
do i think it'll stop on red lights
absolutely
uh i will say with almost
put it this way one of two things is
going to happen either comma is going to
go
out of business or the comma three's
gonna stop at red lights
um i'm hoping for the latter no it's
gonna be the latter it's gonna be the
latter we're
we're somewhat close on red lights the
the i
there is no way in hell i can imagine a
world where comma solves red lights and
it doesn't come to the comma 3.
the combat 3 hardware is definitely
capable of doing red lights it's unclear
about the comma 2 hardware
will it keep going on green lights
absolutely i'm never shipping stopping
on green lights
uh uh his contractors don't have stock
uh stocks only for a full-time place um
no interns get stock either does it have
a touchscreen of course
uh yeah we switched to pi torch tesla
beta versus comma three i mean tesla's
slogans look at this crazy feature our
slogans make driving chill that's the
difference
stop signs and red lights will come at
the exact same time although
red lights it will auto resume stop
signs it will stay stopped and you'll
have to either hit the gas or tap the
button to resume
actually i think it'll only be the gas i
think at a stop sign you're gonna have
to tap the gas to resume it's not gonna
auto go at a stop sign but it will auto
go when a red light turns green
um how does it handle yellow lights does
it speed up or stop early we are going
to leave that to whatever the human
policy is
um whatever humans do depends
um if you just saw the light turn yellow
and you're close go for it if
no don't go for it right um and if you
don't like it obviously you step on the
break
it's level two uh i don't know super
chat is
planning on self-driving cars with only
cameras oh the outputs all it'd be so
much more rich if we had lighter no it's
better like calibrating lidars
the update on voacc progress no we're
just talking about commentaries here
nice comma logo on the front of casing
thank you
thank you um if the lens gets smudged
should you clean it yeah we ship them
with microfiber cloths
i wish i had one of those microphone
cloths now um i'm gonna run it here give
me my five o'clock
uh so we could we could clean it they
come with these little microfiber cloths
too nice
thinking of hiring any cone guys there
is no openings at comma for cone guys
i'm sorry
what will you use the extra processing
power for nav more models all that stuff
um did you rent did you buy no you guys
did it it's all community
uh will german cars be supportive enough
x-ray probably not microfiber short is
real no we got some microfibers
we're gonna ship with them um so if you
bought all three it'd be over four
thousand dollars so much for free
software
well the software is free but the
software if if you bought every version
of open pilot right when it came out it
still would have cost you zero dollars
if you bought hardware well yeah it
costs you money you do understand linux
doesn't run on free either you have to
buy a box to run the linux on right
um you can run open pilot on a pc if you
want to like you actually don't have to
buy anything from comma
it's going to be a pain in the ass right
like a lot of the stuff we built was
just to kind of make our lives easier
why is having an old screen so important
it's like not but like they're really
nice
i just wanted to be really nice big
model on common three yeah big models
coming to common three
big model might come to comma two
probably will um
but we haven't seen advantages yet from
big model
by partnering i mean working with a
company that can mass produce oled
screens
wait that doesn't sound like partnering
that sounds like a purchase order
yes i would love to buy oleds from
samsung i think we sent them an email
they probably said
do you want to buy a million otherwise
fuck off right that's not partnering
like i hate this word it's like vague
it's like hooking up yo i hooked up with
her last night well did you make out or
did you
you know stop with that stupid word
um yes would we like to buy the oleds
directly from samsung absolutely
um is your back gonna stop hurting if
you buy comma three i did this is this
is not an fda approved medical device
any reason to not use the 888 yeah
because the drivers aren't there
the 845 is like the only one you can
really get linux support for
um there's no 8088 dev kits yet there
are 865 dev kits but there's no good
linux for it right we're going to be on
the 845 platform for years
for years i don't see us changing the
processor for a while
um the biggest limitation i mean the
combat 2 had ran into some processor
limitations
but the biggest limitation with the
comma 2 and the biggest upgrade from the
comic uh
2 to the 3 is not the processor it's the
cameras
uh we really started to run into
limitations of this camera
a lot of the reason so like you know
when you want to stop for a stopped card
or red light and you're going too fast
and the combat 2 doesn't see it until
the last minute
that's a camera limitation uh the three
doesn't have that limitation
because this camera has both double the
resolution
and half the field of view so that's
effectively 4x the resolution so we can
see cars hypothetically out to 4x that
the distance
uh why not 4k because lenses um these
lenses can't resolve 4k
getting a lens that can resolve 4k is
actually really expensive
um these lenses can resolve 1080p 484
4k lenses you're talking like slr style
lenses that are going to cost hundreds
and hundreds of dollars
i have not seen a lens this size that
can actually resolve
4k resolution um so if your lens can't
resolve the full resolution you have to
make a trade-off
do you want more pixels on the image
sensor or do you want larger pixels and
i'll make the trade off every day for
larger pixels
ah so yeah that's why um
look like this this camera has a 16
megapixel sensor
these cameras have two megapixel sensors
the picture from this camera
looks way better than the picture from
this camera
and it's do the lens and do the pixel
size and due to the
you know just the all the quantum
efficiency on these sensors like through
the roof
um ar0231 if you want to look it up
uh is it from a sony phone nah
um no it's it's custom
uh the the panel is used on the phone
but the screen is not uh you see that it
doesn't have any uh
phony holes do they have carl zeiss
lenses i do not believe so
they're good lenses though they can
resolve so we did the test if you want
to test how good a lens is
we did the uh test with uh alternating
white and black lines
you know and then make sure we could
actually resolve
perfectly uh the lens um
like the the lens can actually like each
pixel can actually land on a line and
there's not too much power
are we using all the cameras for the
driving model nope right now
at launch we're using the little one um
we will them though we can't really use
the cameras until we gather the data
so the model that we're shipping with
the comma three is the joint model with
the comma two we just did a little bit
of
augmentation to make it compatible with
comma three as well and i posted
yesterday on discord the
results of the comma three are actually
better than the results of the comma two
uh the model performs better on the
comma three data already just because
you know it's not blurry
uh nav data will be streamed live over
comma prime uh will they do good and
rain and snow as good as the two
probably better ir headlights and lamp
posts kill light pollution
i don't know about that what about the
people on the road uh will black friday
be more expensive
um
[Music]
i don't know uh black friday disc i'm
not even thinking that far ahead
i don't think we'll do a discount
probably not it's probably to know maybe
we'll see
um will the common three os ever be
rebased on a newer version of ubuntu
yeah probably
uh if we at the office change so we went
in the office from 1604 to 2004.
if we go in the office to like 2404 then
we'll upgrade the version
um it's not like uh stupid uh
android which you can never upgrade oh
you want to upgrade to android 8 oh yeah
that's going to be a multi-month project
if we want to upgrade the user space in
ubuntu i think that's comfortably uh
let me put it this way it took about two
weeks to move the whole office from 1604
to 2004. in fact
the first comma threes had 1604 so we
already did it once we'll do it again
um we'll double the price when you build
it yeah that sounds good
uh can comma take monero as payment soon
let's
uh no uh i don't trust moneros
i don't know i'll take monero maybe you
don't like bitcoins and ethereums
um no if drug markets use it we don't
com is a legitimate operation
uh two cameras viewing the road on the
comment three you can see them there is
little camera and there is big camera
this is the f camera this is the e
e-camera this is the d
camera um don't ask why
[Music]
remote work no comma doesn't do remote
work um
you can work in europe uh we have a
rotterdam office and we have a us office
but we have a
zero remote policy um you know it's just
how it works for us
what's left to do before open pilot 1.0
whole list of things
uh eta new blog post on nav whenever
wilm does it
i don't know i think he was hired for
already things at first but he did
mention doing it
uh any plans on moving to the bay zero
we got out of there
uh probably going to stay here i don't
know we'll see
ridername's cool i haven't actually been
i haven't been to the rotterdam office
yet because it started after covid
and uh i left the country once to go to
mexico and even that was kind of
stressful so i haven't left america much
um external gpu yes very possibly
um so if we do just if we do realize
that the model
size is the limiting factor and we can't
run
uh the we can do better with a larger
model than what can run on the comma
three
the comma three is capable of streaming
its entire sensorium out of this usb
port which is a super important feature
so we could potentially ship a comma
compute which is like a 30 90 in a
little box
that uh plugs into here and then like
does the model
over there and sends it back i mean you
can totally do this with timings
none of that stuff's a problem we've
tested this already
so yeah it's if the comma three is
expandable if we do decide that the size
of the model becomes a limiting factor
uh yeah you can't do that on the two
there's another downside to the two
uh again you're gonna have to tell me
what partnering means and we don't hire
any biz dev
uh will the ford machi b can fd
community a can of d's can of t you can
already buy a red panda and plug it into
here and it works
or it will work in open zero eight eight
um we already have our prius driving
around with a comma 3 and a red panda so
again
this expansion port tons of flexibility
say you need both can fd
and a model computer we could do that
too just put a hub in there
um so no they're not from a sony phone i
told you that
i mean might sony have used it i don't
know it's a samsung oled panel
uh it's been used in a few phones
um i don't know what partnering means
was there ever a fan in the three
three there's a fan yeah there's a fan
in here
there's a fan uh the fan is for the most
part pretty quiet you will hear it if
you left it out in the hot sun it orders
up at the beginning kind of like the
gaming laptop
uh similar to the comment too uh will c2
do
will c3 do navigation on open pilot
absolutely any plans of making common
prime more affordable no prices are
going to go up yeah we lose money on
comma prime we lose money i'm telling
you
uh maybe the only thing we were
considering is maybe we'll make it 16
a month if you bring your own sim card
tethering will not be supported though
in order for you to be able to buy this
plan
you have to have a dedicated sim card
for the device
um
a little driver monitoring can't let me
go over here driver modeling camera be
using the driving models in the future
yeah
it will hopefully uh ssd controller
overheating
uh we tested this it's pretty good um
we don't maybe if we ran it at like full
tilt for a long time
but we don't so um we track this too
give you a bulleted list why buy a c3
because you own a c2
uh we were joking about this in the
meeting this morning about like making
fun of how companies do this like look
i'm not going to convince you man if you
don't want to buy it don't buy it
uh if you do want to buy it buy it why
why should you buy a comma 3 because you
want a comma 3. why shouldn't you buy a
comma 3 because you don't want a comma
3.
um highest temperature comet three can
withstand so what i can say about this
is uh first off these things have been
in the melting i mean i i've
landed 30 minutes east and it gets up
that's like 95 out there
um it's it's it's it's scorching
i got once back in the car and it said
118 on the hyundai thing
uh and my three survive fine um
we've tested these at 85 celsius in an
oven for 24 hours and they don't break
so uh that's what i can say about heat
heat's always going to be a problem
also like the thermal policy takes is
going to take some big data to really
refine and make good
like it took us a bit on the comma 2.
when the comet 2 first came out when
summer hit
everyone was complaining about the comma
two's uh overheating
and it was bad um but it wasn't it's not
hardware it's software
uh so we fixed that uh is the sonata the
comma flagship yeah i mean it's in the
pictures right
um can i make a ten thousand dollar
version that's water cooled with a full
size 30 90
well i mean what you'll be able to do is
you'll just be able to plug a 30 90 into
here
uh so yeah no need to uh
make a device that has it integrated
does it still disengage
at 65c and we may be up i don't know
well again all this stuff's got to be
tweaked
uh cool on the heat yeah the thermal
solution in the common three is much
more capable than the one and the two
because the heatsink's touching the
processor
right in the comma two the processor
actually faces the screen
uh and that's just how cell phones are
because you can't jump into the user's
hand the only place you can dump heat is
into the screen on a cell phone
but the comma three is not like that the
comma three the processor faces that way
right onto the heatsink with a fan
that's good
uh well ethernet can be supported
someone can make an adapter again that's
the beauty of this
expansion uh why not white molding for
the case i'm not sure black and white
matters that much i think most of the
heat's in the infrared spectrum
not a hundred percent on that uh blacks
are nice to color than white how about
that
um a45 has internal gpu that's true
uh why use such a high res screen
because it's beautiful we'll see three
do auto lane change just a stupid
feature guys
uh why usb for external gpu and not
thunderbolt 3.
the qualcomm chip does not support
thunderbolt 3.
um can you mirror your common three
screen to another screen yes this is a
display port as well
this is a displayport 1.2 connector
there's a little switch inside
that switches so if you plug this into a
monitor uh it won't work because the
software is janky but if you fix the
software
the hardware supports it um will comets
redo u-turns or even
stupider than auto lane change make your
own u-turn
um does it read speed limits who knows
it's a model who knows what it does i
never taught it to but it learned some
things
on 90 degree turns oh really we're
really in the stupid feature land today
you don't want it be in a car doing an
autonomous 90 degree turn you're like
please don't ever do that again
um will it do it yeah it probably will
in fact have you seen the comma two can
do 90 degree turns watch some videos
um there's a whole bunch of toyotas
making 90 degree turns with the comma 2.
uh did i change the sound effects no
it's the same sound effects if you want
them changed
submit a pull request if someone makes
nice sound effects
i will merge them if someone makes nice
sound effects and shows that they can
continually improve open pilot we'll
even hire you
we'll comment eight fly maybe
um
what are the specs of the device google
how many we sell we selling
one one since this game started
uh
it'll fly off itself does comma three
come with a cup holder
uh oh my god we already passed an hour
on this no
all right now we're getting stupid
questions the questions got stupid
all right any more good questions
but i want to leave people with good
questions hanging out try to google it
comma dot ai go to the thing
uh what i think the current best vehicle
is personally i think it's the sonata
uh it's not a longitudinal stock as well
maybe i just think that because comes
longitudinal needs a bit of love
um the sonata lateral is
really keyed in really dialed in um
any regulatory risks we've been in
contact with regulatory agencies
like i mean again we don't sell safety
but uh
the data's pretty promising so there's
that that's always nice
um how's the commentary powered right
here it also has super capacitors in it
so if you pull the power
you get like five seconds of emergency
power that we can use to alert the user
that we can use to write logs
we only sold three we sold a lot more
than three we made more than three
hundred thousand dollars and we sold
more comma threes in the last three days
than we did comma twos for the whole
first week
and that's not dollars that's in units
so in dollars
um any theft protection we're not
insurance company work with your
insurance company if you want that
protection
uh what cars do i wish the community
would jump in to help support encrypted
toyotas you guys can do it i believe in
you
um if someone ships flex-ray
if someone ships good flex right i will
chill for you um there's a
guy in discord who made a adapter to get
the
honda accord that uses serial uh they
did a serial to can converter and we
gave them a channel on discord and
they're selling these things
so if you support a car in a safe way
it's very important that it's safe but
if you do it a safe way
uh yeah we'd love to chill for your
thing and you know so uh yeah flex rate
community let's go
um you do not have to order a new
harness nope it's the identical harness
and we give you all the wires you're
gonna need uh to connect the comma three
the comma three uses a right angle wire
that like sits in here like this it's
super nice
um does it use the modem inside the a45
soc unfortunately
not uh the som doesn't come with a modem
so we have an additional cocktail modem
on there
i told you this device was expensive
part of the reasons it cost a lot to
make i'd love to use the 845 soc but
good luck getting that from qualcomm
uh can you buy the right angle wire
separate i believe so
um i don't know if we put it up yet but
we are certainly going to put it up and
they're going to be twenty dollars
um they're not up yet but i think we'll
do that pretty soon
it's our main bottleneck right now bugs
uh why is auto lane change stupid
we have auto lane change it's just the
the user
does the lane change i have not liked
like i don't like being in a car
when it makes a maneuver that i don't
expect um
it's doable i think auto lane change is
less stupid than some other features
but i think features like slow down for
turns automatic
highway interchanges red lights and stop
signs are much better features now to be
fair
i used to say this about red lights and
stop signs five years ago i was making
fun of red lights and stop signs
because five years ago like we couldn't
take every turn on the highway
now it's time to stop making fun of red
lights and stop signs and you know what
in five years i'll stop making fun of 90
degree turns and auto lane change
but i think those are like further out
and more gimmicky than you think
uh i think the core things that you want
are things that don't
ever have the car perform in a like the
thing about an auto lane change is
you don't actually have to do a lane
change right so it's it's
clearly very much just a feature you do
have to stop at a red light
so the fact that we don't stop at a red
light is not great um and that's why i'm
much more excited about like red lights
and stop signs than i am about all the
lane change
um any chance of comma prime for a lower
price bring your own network yes i think
we're going to make it 16
a month uh when we refactor the billing
code
uh i'm um yeah i'm that's not a bad idea
i think that'll probably be out if you
buy a comma three right now your three
free months prime will be included
and then i think by the time the three
months are over we'll be able to lower
the
you do not buy a sim from us plan to uh
16.
i think the future harness won't be
needed no i think the same harness
community forever i know i can't wait
for red lights and stop signs either i'm
very excited about that feature i'm even
more excited for slow down slow down for
turns
slow down for turns slow down returns
means a lot more than turns slow down
returns means that if you have the
cruise control set at 65 and you're in
the city
it's not going to go 65 it's going to go
a reasonable speed
um you know anytime we're doing things
also that involve more braking
i always feel better about more braking
right because brakes are safe
um slow down for turns hype slow down
for turns hype yeah but it's not just
turns like
i shouldn't say turns basically here
here's what i want you to think of when
i say slow down insurance
imagine you're in an exit lane of the
highway there's no battery in the
company
uh imagine being in the exit lane of a
highway
automatically slowing down for the exit
and then being on surface streets
without ever pushing the cruise control
thing down you'll be able to
keep the cruise control thing at 65 but
if you're on surface streets it'll only
go 25 or 30.
um yeah so you're just in the exit lane
you can do the auto lane change i mean
we call it auto lane change right like
i'm sorry you have to
tap the wheel but like you know again i
think it feels better i think it feels
better to like
it's a way of it's a language for
talking to the car it's like
make me a lane change right um when is
end of life for the comma two software
support
ends in one year so uh one year
uh from when the common three was
announced
why can we optimize your lower g forces
when driving we do uh we
absolutely do read the npc code um are
you missing data or time
always time not data definitely not data
have too much data i mean we're missing
comment three data we do need some
comment three data
uh the common three data we're excited
about getting i have too much coming to
data we're throwing a lot of it away
um can you start your three-month prime
title at a time no
uh min support length for the comma
three look
guys we're a small company um
i mean our minimum support our absolute
minimum is a year but it's gonna be a
lot longer than a year it's
this is the new platform right so if you
think about when you bought an eon gold
and eon gold is the same platform as
this neon gold and a black panda
so an eon gold in a black panda was
almost two years ago so
that's a comfortable support time it'll
i mean if you go back all the way to the
eon that's a year before that if you go
back all the way
to the to the neo it's like a year
before that's like four years
this platform's gonna be supportive for
a long time well navigation be on c2 no
navigation's never coming to c2
um maybe fork can try to do it we tried
a little it was just a pain it's a pain
to make it all work with the stupid uh
uh android level two forever is there a
battery in the comma three
there's a very very tiny battery uh in
both the comma three and the comma two
used for the real-time clock so that
when you lose power you don't lose time
you don't lose the date uh but otherwise
no no battery
uh well the high data rate of c3 data
make it harder to get back uh
connected to wi-fi um how is it in stop
and go traffic
good um where do people sell their used
comment to is you can check on discord
uh there's a for sale channel now
actually if you're looking to buy a used
comma two
this is probably the exact time to buy
them
um have we delivered any common threes
yet no the first ship out on thursday
slow down on curve soon soon um
can you use nav on c3 in asia i believe
so i think willem will clarify this
i know he uses it in europe uh so
i don't know i haven't tried it in asia
but yeah i think we should work
maybe i don't know depends where in asia
too i know china has a lot of like weird
rules around mapping
um does kama own any other companies
no what do you mean own any other
companies
like do we have like another brand we
sell things under no
i'm like okay facebook owns oculus but
oculus is just facebook right it's
interesting
um any way to invest in comment not
right now um maybe someday
look like if someone sends me a pitch
occasionally people will reach out to
invest in comma and i like like them i
like like them as people
and i'm like yeah if we ever looking for
money you know that's that's who gets to
invest
uh a lot of people reach out and they're
like i'm a banker
and i want to invest in you so i can
diversify my portfolio and i'm like oh
boomer phi um
camera-based longitudinal control
absolutely coming soon
uh no but sometimes people invest and
they're just like cool people like we
get a bunch of people who are like yo i
made a lot of money off tesla
uh i want to put some of my gains into
something and i'm like ah
uh if we do any investment yeah you're
the kind of person i want to let in
uh you know people who like someone who
invested in tesla is the kind of person
who's like they're like betting on a
good future and like
that's who we want right we don't want
the kind of people who are like well i
manage my
portfolio to headphones and index funds
and lots of different weird funds and
mutual funds and we trade options and we
trade all this weird stuff and it's
it's not even that weird it's boomer fry
um
yeah sometimes we get cool crypto people
too i like when like crypto people are
like
y'all man i made a lot of money in heath
uh i'm interested in that too
boomers go burn no no oh yes yes hi this
is the united states fed
we just printed four trillion dollars
and we'd like to offer you some in
exchange for a piece of your soul
do you want some fake money in exchange
for a piece of your soul
um no um
what if you make money off gamestop yeah
you know
no we're not really looking for
investment what will the limitations of
the comma three be
there's no obvious limitations right now
uh so we don't know
we really don't know like the comma two
you know it was clear that like it
didn't support
yes the commentaries will stop on red
lights eventually i promise you that
or common will go out of business one of
those two things will happen first
[Music]
um a lot of money flipping bricks can i
invest why are you going to show up with
your
will your dollar bills be covered in
cocaine
uh what's the next feature we'll bring
to the comma 3. uh
navigate on open pilot is going to be
the huge feature and that's like the
prices go up kind of feature
um can you find comma 3 can you want the
specs
here i'll paste you a link
slow down a curve yeah hopefully that'll
come to both i will try to ship this
thing on curve on comma 2 as well
um but the you know stopping for faraway
car is going to be a lot better when we
start to get data back
Hello
Let me just let people know we are live stream. Oh
We got a post on Twitter, too
You just put this on Twitter
Happy YouTube live. This is happy you could live. I'm gonna be happy to that
Hello I
Don't want to distract these guys too much I newest employee started today. I
Think do you want to say hi to them did you do you want to say hi to the streamers you can wave?
Um
Patient. Yeah, so it were launched at this way shank. They'll be working on driver monitoring. We're gonna get dr
About it to 100% so you guys can't cheat anymore
Yeah, no phones. No sleeping. No
Looking at the nice side of the road keep your eyes on the road open pilots level 2
That's it okay be safe guys. Yeah. See you guys
Okay, um
So this is the 0.6. No, I'm not gonna go with Joe Rogan. It's not a band question, maybe so this is the 0.6
Stuff virtually crest nice to have you here. The biggest thing that we have is a new model
We've managed to ship a new model. We've managed to reduce the CPU on every line of open pilot is now open source our
Panta safety code is is misra compliant
Which means it's you know, the safety code is all it's written in like the same standard of see that every car manufacturer uses ah
Yeah, the hugging bug, ah, well, you know what if you show me a hugging bug we're gonna go for a drive
and
We'll see if there's a hugging bar right now. Oh
Well, you know what we'll grab viv and we'll take you by the data center I'll show you guys the data center
Oh, it's lunchtime. Oh, we're gonna miss lunch bed. We're gonna miss lunch. So we got to go. We already started the stream
Should we eat lunch and further YouTube live do his money lunch with us
We a health in it
It was gonna be hard to keep it steady
Oh
This is fantastic and I think there's lentil soup - wait, are you really eating lunch George you have to do a stream?
Say I just watched Georgie and I don't get to eat here I'll hold the phone I have to eat
You'll eat. I'm just doing a live stream. I just need to have a little bit
Okay. I don't know if I'm a great phone holder
Nice just like pretty girls doing these eating streams Oh George. Oh
Let us hear the mukbang voice, I don't know what that means
We have two mics it says that's good. I
Mean it grew is just it's just another step in making
Making the AI sentient, you know now remembers it holds grudges
Opening eyes dota player have one like 2048 unit. Yeah
Yeah, I mean they seem to remember a lot of things it was pretty cool you can just blind them sunlight
It's the sunlight blinds camera. They seem to just completely remember the road and keep going
Wait, why did people not believe will them was real?
See
also the gurus also use the speed of the car to
Determine the relevance of the lane lines implicitly consider eight
so now Lane lines
Need to have a life expectancy to be considered relevant for driving
Yes, so that's the solution to the exit problem that's why exits now are better without any hacks or you know weird if statements
Everyone knows George is favorite food is rice
There we can see George contaminating our food live on stream
Yeah, yeah and the streams canceled yeah, but we should have actually started on LT cuz the worse is switching
You think like naturally and so just turning it off
Yeah, we should turn off fuck yeah. All right guys we're taking you to LTE if this doesn't work
It's better than fireworks this is one gigabyte of storage
Did they say the quality's terrible they say they're bored and now we're back I think it was bad
You're really trying to hold it there, yeah because I get motion sickness when I watch videos that are like people
You know moving about terribly. Oh
No, we never found that stabilizer, I think it's upstairs, but I'm I have to climb the ladder which seems unsafe
The ladder is not safe
Should I get in the back and film would that be a better view?
Beautiful thing about cars like this is it's just like everything is done by hand. Nothing is automatic
So if there's an issue, you know, you can fix it
I mean
I'm not opposed
Insurance for other people not for us
Someone has already done to its car. Look at that
No, no too close natural, oh, yeah
All right guys welcome to
0.6
I'm gonna go to the highway. This is a happy stream. This is a happy stream only happy things
Yeah. Yeah, this reminds me of the road trip. This was like the angle the entire road trip. Yeah. Yeah. It's a great angle
So you see we have a we have a neon gold right here, which is available for sale at shop. Kamidana. Yeah, I
But so let's get them a highway and we'll cruise a little bit and then
I'd say I really want to find a street like the one when we drove to Connors house that night
Yeah, I got to test on that. Well, that's just a really nice Street to show off right? Yeah. Yeah models are a ton better
at making turns
At
Intersections just like all the things that are into highway driving. Yeah
I'm still gonna show you highway driving because I know how to go to the highway. That's right
I'm in San Diego. I feel like those streets are everywhere, you know
Hey, hey Scopus, do you see where we are?
you're gonna
Yeah, it's where are we guys fine is a good thing
I'm making sure that this is a decent stream of not too much bumpiness, but
We're engaged right now
We get a fuse for the stopped car
Well top cars come down the next in the top
Do you need a pedal for the 2020 Corolla? No, you know what?
We have no panel full stop and go this is the best car open pilot supports
Yeah, I'll hold the camera higher that's a good idea
You guys always talking about like turning off your lane changing I don't find a problem
Just like fighting it little I really like made like pulls me into the lane
You know the stupid video on a website and drive so slow it makes you think that open pilot is slow
You can set your speed so, you know
driving slow
It was me but it's you know, I had set it at my dead set it slow
I actually almost like had your voice in my head and I was like George is gonna be upset with how slow this car is
Driving it was like, oh well
You're very conservative driver George you're a very conservative driver
Going fast as a big problem a lot of accidents happen because people are going too fast and they lose control
Lotta accidents happen when people try to through sketchy shit like, oh I'm gonna cut across these
Someone just call it a slow roll and I love that
Guys here, we are difference. It's the
Confidence with which it dries
Part of this is the the incredible
That's alpha Corolla as well this by the way works on every 2020 Corolla so you can buy cheapest 2020 crow
I think you can actually get them from less than
$20,000 Wow
Raising the price system
Well now be a good time Maya because crisis only go up
Yeah presses when we go up folks. Should we try one of these rooms?
Yeah, see we'll see we'll drive is actually really fun beats
That's not the greatest of film on but we can try like yet towards PP. I
Don't have confidence while iana's on what should I do? Well, you should always pay attention. You're human. Yeah, well car
Look at that good steering angle sensor. Yeah, big Sara
How is this view for you guys?
Drive around the back. Is it gonna be new hardware upgrade to the Aeons?
What's on the windshield next the L cast cover
Yeah, it's really bumpy but we can do it right the road itself is very bumpy
Because we went with the videographer and Andrew. It's the car running all current hardware. It's yes all current hardware
Can great pan to be used to read and clear dtc codes with linux or other OS
We're still engaged we're just lowering
That's a stop guys
Always pay attention folks that's important
You should have got the phone gimble, you know what we had it we'll find it
What's upstairs? We did not almost crash
This is so meta because I'm also traveling with open pilot right now
If your trunk open file, you should not be yeah, you should be paying attention
Not watching YouTube. Alright, so guys like check it out. Like this turn would have been completely undoable with the old open pilots
Beautifully done
Wait, there's a car
So it's all that one, I don't know stop cars coming in the next version
So it resumes from a stop and now you're gonna see the legendary ability of 0.6 to go through intersections, oh, yeah
Yeah
Beautifully done
But yeah, you know, we're pushing where would you push engage time up?
So we should well, we don't even have a lane on this road. What's it gonna do?
What's doing actually? Yeah, it's doing a pretty good job
Turn still suck on Honda Civic Bosch due to limitations
They're better in the new model just a new model can
Roll if you're considering a new car they recommend the 2020 Corolla
From Longo Toyota if you're interested to
Stock car detection has always worked better for me to open pilot than Prius prime stock
You want to make it like perfect I want to have no questions about
Autopilot did not do this
Well at first and then some updates really approved it for autopilot and a Tesla can do what we can do it to
SDSU engaged or disengaged on its this is 80s sp2 car so it doesn't matter
Where they open pilot is doing
What trim is our Corolla highest trip
This is the poor man's autopilot well depends on the definition of poor man's
Things about it, they're better. There's some things about it that are worse
It's we emphasize like we're more conservative than Tesla our torque limits are as high we have driver monitoring
Here
Back to the office
No wonder that everyone's been quiet, can you run open pile on a PC mount in your car like yours?
this
is this is an Ellen for sale shop calm down AI for the low low price of
30-day return policy. That's right. You don't like it
But just go to our website comment on AI the top link just click check compatibility if you have a compatible car
Even if they're not that tech-savvy you'll probably be able to get it up on market. Yeah
lots of good YouTube videos
Good community on disco diversity Chris pushes or sex? I didn't see it. I saw he said a privately go. Yeah
Oh, the guy means a huge touchscreen like are like your old videos, oh no, no
No, is it dead system was terrible guys you mean that was the comma 0 you want to come at 0-0?
Given way mo bought a fleet of 65,000 Pacifica hybrids
More exciting virtually Chris video coming half hour almost done good. We're excited for Avicii. Yes
The squirrel has a power boom
All right, so we're gonna try driving by an exit. We're gonna see what happens
To stay in this lane
and we're gonna see if the
Legendary 0.6 nected fixes actually work. Someone wants to know where the graph is mounted. It's in here
with the cover on with the
National
Zoo can make your giraffe special - just like - Simon pliers
This isn't an exit. This is an urgent support for the 2016 Honda Accord with Honda sensing
Solidity on this turn
Yeah feels almost better than a human honestly
It's not we can go a little boy that is just as the new tour d'azyr never better
Yeah came a little bit out there because we're interns
You wanted you want to maximize?
Even just beer. So the old all odds you couldn't really stay in the right lane
because they could get on exits just
ask my
Does it do the same for left exits exits -
We've completely removed - all our left-hand drive people
We used to have something where it would hang to the left lane
That's been completely removed and the angle offset learner has been completely removed because the models are so much better
Someone's asked if there's any plans on flex, right? No. All right. So, let's see. We got a real exit here really likes it. Oh
No problem
Didn't even wiggle at all not even a question
Yeah, the old audible wiggle a little bit on the old the first autopilot
Did that too Tesla solved this at first with mapping which is kind of absurd now
They've solved it the same way we have
Mapping out every exit. Yes. That's our Tesla. Did it originally the ap1 marker?
Well, that's what Cruz um, supercruise does super cruisers mass average. Yeah
If you don't have
How do you write tests for such a thing as open pilot
Well, a lot of our tests the church is open source
We test run multiple deployments if transit has to be approval tests and hit all tests. I stole these terms of SpaceX they're real but
Moodle is hardware and out of the loop, which are alike
You can check out panda safety has very good
Testament up which are things that run on a computer and then middle
We have 13 Yuans in our office constantly running open pilot on historical data and making sure works
We have 112 they said the street cut out at one point, but I think it's back to being good
Okay, so this is an exit I take every day to get to the office and it's always a little schedule
Slowing down for turns was removed because it used the maps but now it's back to will and it back
Does open pilot roll slowly
Right now while you are using it
It doesn't learn while you're using it learns after you upload data to our data center
And then we have all of those computers crunch all your data looking to roll to this intersection. Look no
Been watching a loading open pilot for about five minutes
That's only because you're on davell if you're on release two you have to wait a little bit longer to get the updates
But you don't have to see that screen anymore. We shipped pre-built binding we ship pre-built binaries on released. Oh
Yeah
Can't wait to install this on my 79 Honda Accord sure
30 day policy
Don't buy it if you have an old car, where is your open pilot data strongest there's our data strong
Where's the donate button oh, I like that shop
Donate buy a hoodie bioody just buy a bunch of pandas buy a bunch of white pant.if. We have so many white pandas
Alright guys, that was it folks. Thank you for joining. Yeah. I hope you enjoyed it 0.6
again for a lot all right so you don't
look everything just lit up we'll give
people up at a time to come in here for
those of you who don't know beer comedy
I this is our open source driving
attempt open palette let's drive the car
right now
and this isn't some fake stuff you can
what everything you see here is already
public you can just go download it this
is an eon you can buy a shop a shop
comet REI
that's very nice now of course since
this is a YouTube live we're about to
show you something that that's not
public so maybe you guys will find it
exciting
blink are here a little bit to the right
and it'll automatically change lanes
[Music]
so you see here with another curve going
left see how it does lead to her
you go downstream eel I'll share the
wheel
there are 15 people we got 15 people to
do this away for a few more people
demonstrated again all make a u-turn
[Music]
yeah bucks you want to see the steering
wheel so how do you do yeah so it's not
um it's it's automatic but it requires
you to look it doesn't know when it's
safe to make the lane change that's your
job as a person
[Music]
spin the car around I'm here
get some viewers
I don't even think I think that I'm
gonna do for myself does that's how I've
always done in the past you don't have
to anymore a walks Harris has kicked up
blind spot monitors it's not linked to
the blind spot monitors yet so any of
the cars that you can get them on we're
gonna add it in before their ships live
and for reference guys this is e zero
seven feature so this you're gonna see a
few open pilot releases without this
there's more to this feature then that
just Lane changing
but just Lane changing is all we're
gonna demonstrate for you guys today
watch the I don't know if you guys have
seen them at the full self-driving Tesla
video
[Music]
full self-driving cast the video is very
inspiring and I think we'd like to be
Tesla to shipping all those things see
what a ship full self-driving maybe
maybe some scope he's not what Tesla
promised you guys what a Tesla promise
this year no no it shouldn't be say yeah
yeah it's very alpha feature but if you
guys watched my maybe it doesn't say you
can and we should be able to use the
blind spot monitors on the Toyotas yeah
- oh and it's still doing it yeah we
kind of any hacks to detect when the
lane changes over not so I know there's
some Forks with lane changes um this is
not hacks this is trained on probably a
million lane changes that you guys did
in real life
[Music]
yeah yeah I think I think in order to
make this model it has watched you
humans users of open violent to 100,000
Lane changes and that's how it learns to
do the perfect lane change for every
situation so yeah there's a secret input
to the model that we normally set it to
driving straight but when we do the lane
change we just ask the model to do a
lane change so there's a question how is
speed controlled during the lane change
and so that we don't do anything special
with the with the speed but once it
starts doing the lane change deletes
should switch very aware
[Music]
here's a full blinker on gotta watch
that guy in my rearview ya little notchy
change lunch automatically change
I wish we can I wish we could all return
the blinker oh yeah that would be nice
yeah so we could yeah we could keep
doing it oh we're back we're back
yeah I think I'm in the mill yeah and
then start
yeah and now we'll cancel yes yeah yeah
feels like it like costs that's the
beauty of neural networks that was all
fuzzy
and you can make multiple languages just
give it one notch for this one change
lanes yeah you get one notch for this
one change legs again yes at the
procedure she turned on the blinker and
then you get for the lodge when you
think it's clear and this is how we're
gonna proceed with a lot of these sort
of features right my experience in
navigator autopilot is that it increased
anxiety in a lot of ways because you
borrow a sure when the car was gonna
make the lane change I'm sitting there
and I'm like from my perspective it
looks totally clear I have no idea why
the car isn't going on part of that can
be fixed with communication but part of
that is you want to be in control of
everyone on some magic wand
everyone wants a wand that they can wave
and like make the leg change right but
they don't want the wand to tell them
what wishes they want
no okay ideally it would monitor your
blind spot and tell you what it's safe
to go with you just have to press you
know engage Captain Picard but uh but I
kind of like the steering wheel to
acknowledge that engage it's like it's a
nice button - yeah now this is not in
devel right now this is a very very
early preview of CRO seven there's gonna
be a bunch more sera 6 releases first
we've actually stripped these weights
out of the model so good luck trying to
add it yourself
there's a secret 512 dimensional vector
that will enable a change can I scroll
back you guys are killing it thanks guys
I can't see all the messages I wish I
bought it when they didn't
this the time of day affect the lane
change performance not children the way
this thing learned to change lanes by
watching all of your lanterns so if all
of your lane changes happen at all times
of the day yeah yeah you have to keep
the blinker on right now during the lane
change but that might change maybe it's
like 50 yeah like everything is deep
learning yeah this needs some work they
wanted to go for the double yeah we need
a better way to detect when the lane
change is down which it's done yeah and
now we have some hacky way by looking at
the lane oh yeah I guess yeah I guess
that was the problem we just thought it
was yeah this should be and this is an
example of like people think open pilot
is only for the highway but
this guy off just because I find
speeding people think about is only for
the highway it's not I it works decently
well
[Music]
yes yes Larissa text Xtreme command to
turn the blinkers on but that's like a
ferry debug a command and it stops
working when the car moves so maybe just
a different one but haven't found it
[Music]
yeah but then the stalk is still there
so no I mean maybe if you put it in a
debug mode well it won't work anymore
but no I'm wondering is there a way to
electronically pop the stalk or is that
yeah I think it's mechanical hmm yeah I
mean my parents new BMW it's just not
physical anymore
so I just like a double press talk
but Alexi sets its mechanic OMA oh yeah
maybe that's the wrong it's like really
weird oh yeah oh we're gonna make a
small detour it's weird like yes I made
a mistake I have to make like three
rights not a mistake so any more
questions about the lane change 24
people I guess we didn't post on Twitter
yeah well 24 people apparently and it
was nice about disco feast and everyone
got a notification oh it was Twitter
related so a while ago apparent you said
we're we're never gonna ship automatic
lane change and what changed all right
so you ever changed
Tesla we're never gonna ship stop signs
until Tesla does okay so we're like you
know we use a waste of time to even
think about stop signs until Tesla's
figured it out right cuz maybe it's
really hard and we can let them figure
out whether it's really hard or not but
they've already figured out lane changes
and it actually turns out to be easy
let's say oh look at this a lane change
through an intersection
see now what can do that only us
so we were never gonna ship adjustable
following distance we can I say we were
never gonna ship automatic lane change I
don't know maybe you then it's not it's
it's it's um you do the lane jam it does
it for you but yeah I think we should
called assisted Lane in this thing
that's like much more regulated friendly
yeah Greg came up with that I like it
yeah yeah that's like automatic is that
a real thing or did like or make that up
I think us are in the minute all right
Thank You scobie's oh when it's the next
minecraft stream Oh actually I was
thinking but maybe nap first in those
dream not all in craft um Hank
alright
what oh we gotta yeah make sure to make
sure to hide the
the secrets are there any secrets are
there any
just put the secrets in the cabinet uh
don't worry it's just facing me right
now
no one can see any secrets you're going
to cover it with a cloth is it covered
no it's not a cover do we have something
to cover the secrets with
there are some secrets not yet not yet
we gotta we gotta
give some people some time to get in
here someone want to someone want to
ping him on discord
oh shit i went vertical orientation is
locked
yo we're streaming no no we'll go we'll
go horizontal
we'll go we're going horizontal we go
i don't know if that's horizontal oh i
didn't plan this out
is this still vertical i don't know
nope we can't we're doing a vertical
stream today it's all vertical boys it's
all vertical
yeah yeah look at this the turn does
exceed the steering limit
we got open pilot wow
would you like to talk about it yeah i
mean we have
carla which is a simulator and then now
the car here is being driven by open
pilot
so thanks thanks guys
you can actually increase the speed how
easy is this gonna be to set up on my
computer at home
oh it's two lines wow wow two lines
wow yeah yeah yeah set up to increase
the set speed
see we increase the speed to 30. it's
just like open pilot in your car
except just car law
yes in order
yeah it's gonna run a red light
yeah i don't know it's going to it's
going to oh guys we got to add red light
detection
oh it was green oh that was good that
was good that's close
wow that that model's that model is
working well
oh that's oh that's solid
oh that's solid
wow i didn't know open pilot could make
turns like that
yeah yeah yeah let's let's make this
let's drive it faster
oh no all right so who wants to want to
talk to the camera
sorry you're you're it's all it's all
it's all vertical
i know it's friday night i see what
you're doing
thank you thank you uh
i'm just waiting for it to finish the
time okay crank it up
we want to see a crash virtual cars are
cheap
but why is it not accelerating
[Music]
it's because it's in a curve it's in a
curve it doesn't accelerate in curves
the end-to-end longitudinal model is
telling it not to accelerate
we have good cover oh that's the secrets
under there
oh yeah good oh that's covered that's
good
that's good i think it's in a turn which
is why it's not accidental
so what's going on here we have open
pilot driving this virtual car
oh is it going to accelerate
it's virtually a car wait can we add
some traffic
yeah we can i mean yeah we can just put
uh just just
like does that work oh we haven't tried
oh we should try it yeah the streamers
love it when we try new things right in
front of them
in fact you guys can connect to our
server right now
[Music]
well maybe this car is maxed at 32
or is it not throttling enough what's
the throttle that's a lot of throttle
already yeah
i think it's i think this is the max
carla clips it at one
which it only takes inputs from zero i
think i am clipping it
0.6 i think yeah it's running to panda
safety
yeah oh we're telling it it's a tesla
yeah the car frame is there also guys
we're switching the pie torch who else
is done with tensorflow
uh that's what i've been doing all day
what else this is this is pretty good
who else who wants who's got anything
else to say
[Music]
what are we missing oh oh something's
happening
oh wow it's still driving that was close
it was crashing
all right how do we make a crash hello
from the amsterdam office
you're in the amsterdam office
rotterdam i can i'm i think i'm manually
increasing it
in europe right now yeah i think this is
the max oh but you're in manual mode now
yeah that's why i turn exceed steering
limit you know open pilot does that in
real life too
can you hand it back to openpop yeah i
can hand it back
yeah it's back cool
so that was the max throttle yeah i
think that's the max for this car
well what kind of weak-ass tesla is this
it must be out of batteries do we set
the battery though
yeah it's actually yeah it's the desktop
frame tesla wheels with the civic dbc
oh that's like yeah yeah i mean who
knows
all right that was today's today's
vertical stream
uh hopefully that's coming to an open
pilot near you it's just two docker
commands
yeah it's carla's docker right yes so we
just run carla's docker and then you run
sim is a new docker image we're
publishing every hour nice
open pilot sim we want to make it as
easy to use as
baidu apollo easier easier to use
george we've got some new products that
we haven't talked about
what do we have got the nissan harness
oh yeah yeah yeah
all right what you got new products to
talk about yes so we got
the nissan harness which works on pro
pilot this is a big
this is the largest connector i've ever
seen are we charging more for this
no it also comes with a long usb cable
we have all these wires
and an extra long usb cable for the same
price
you guys that's the steel tomorrow i
might find out about this and raise the
price
we also have the obd2 harness which just
came out
um it's for volt people that looks like
a comma power why i already have a comma
power why do i need to buy another one
totally different because there's a usbc
port yo can i charge my phone with that
probably not i don't know what happens
if i plug my phone in
don't do it nothing
um yeah what now for all those volt
people who have been stuck on eons you
can now
upgrade to the comma two of this does it
have gm land
has gm land yeah no way how did you fit
gm land in there
ask robay uh
yeah uh this guy wants to know if he can
charge his vape
no i think it'll explode bro
yeah yeah does it conform to obc
manufacturers all these people will be
millionaires yeah that's right bravo
that's right it should have crashed
oh
would have been great if we got that
live live footage of the crash
minecraft can we reset it yeah wait how
do we put another car in there
how do we yeah well it's the same carlos
server right you can just
[Music]
is this like a one-liner that we can do
now
probably oh yeah we need we needed to
follow a car
that'd be cool that'd be cool yeah
don't kill us all in your hubris how am
i gonna kill you bro
don't worry a poor gps
don't worry guys no no no real cars were
harmed in the making of this video
oh oh
oh legit well that model is legit is
that new segment model
uh no it's not it's a secret good model
oh the secret good model
was it trained using infiniband and
melanox yo
no real talk guys we spent a lot of uh
money on infiniband network cards
and i don't know about them
everyone's been gambling for all the
office furniture
alex alex doesn't like any of our
furniture
so we got like new stuff oh you guys
want to see it i'll show them the new
little area look
wow this is this is pretty nice yo this
is a cool office
it's improved significantly since before
um this
is our yeah you can like sit here
and this is our large traffic light
um these are going in our not a data
center
oh we're hanging the traffic light we
hanging it up there yeah
nice yeah these are going in are not a
data center
does open pilot have parking assist
here's here's where everybody's using
open pilot right now
here's all the drives from today vivek
made this it's very cool
yeah look at them this is yeah we got
god mode yo
this is our driving evaluation metrics
page
beta uh
yeah wow office has come a long way
look people have started driving only on
the weekends now
instead of the weekdays
we're at 25 million miles
how many parameters will be needed for
level four well that's a good question
uh was our canadian yes
oh yeah
two hours ago it only ran for two
seconds yeah
how many people got this with uh
on their real on their real eon you only
get this one
what if you have a white panda open
mouth doesn't support you anymore that's
right that's right buy new hardware
people
if you have an eon you're next buy a
comment too
[Music]
sounds good
goodbye youtube thank you for joining us
i know you wish you were here
but you're not but if you want to be
here you can
send an email to give me a job at
comma.i
and maybe we'll hire you just grilling
some meats
bye everybody
hello
today's it come how does this work wait
can I go on YouTube level let's see go
go on our Twitter Oh God take that
painting down though that's true but
let's we saw 14 people maybe linked it
to discord all the channels yeah
YouTube lives would have a discord it's
a channel and I think why is Andy
dressed up why not be dressed up you
guys
tell us how good this quality is cuz for
me it looks fantastic oh happy I know I
have you both know I gotta figure out a
little more had fantastic quality thank
you
oh yeah no no no yeah I was acqua hired
by Apple so we know yeah details have
not been money and that's why you gotta
make money and that's what well you're
gonna know they're cost increase for
hardware let's get the time like a
couple of people have let's just oh we
have a hundred a lot of people ok few
minutes yeah all right guys I'm gonna
roll this dice and we got a 17 the good
news is we're not increasing the price
so yeah we you know what's the good news
is today the 17th no oh why well
nothing then we could have played a
little you know it's the 17th that we
rolled the 1700 not sponsored yet but
all right ok let's get started with nine
people watching
Oh someone was trying to sleep and they
got added all right sure yeah
you off comma connect on Android and iOS
just called complex comma connect to the
App Store yeah comma connect you know
they make the font size smaller you know
we might drop the connect at some point
but yeah this is gonna work so I can
like click on my Honda Civic here it's
not black and white in real life by the
way oh yeah it's a color oh my gosh I
keep my phone in black and white so it's
less addictive
don't be so Silicon Valley George but um
yeah you can like see where your car
drove it's gonna load up the video here
this was just me driving around the
block last week in my Civic why don't he
goes take a long time to learn this one
works Kinect is using start with that
yeah we could do more announcements all
later um so guys if you want to go right
now
- I'm gonna tweet it out right now we
have any public API at API kamidana hey
I and you guys can go there and you guys
can check it out so is that
yeah yeah let's do that
[Music]
yeah and that's important for you can
use it today everything on there is
available in production and used by
comma Connect Explorer Cabana and
hopefully the tools that y'all are gonna
write with this you know this has been a
you know we're highly requested desire
feature for quite a while
release so yeah I'll post that tweet and
Twitter of the Queen in discord
yeah so all the data that you upload to
us is uploaded through this API and then
redownload through this API we make
things available to you well you can
like just interact with your devices you
can download all the raw files you can
see things about routes you can see your
device location through Athena yeah
Athena Athena is the service that runs
on your ego on and then this API if you
go down to Athena lets you actually
interact with your device live on the
network so our server exit proxy server
it's the server goes back down to the
bus that's over
yeah that's very nice - exactly like
Newman on this monitor so they can move
the tripod I'm gonna move the tripod oh
they couldn't even like see what I was
doing the computer I know I would like
to get a tripod with wheels you know
yeah yeah so next you guys know all your
eons have dongle IDs and the segment is
one minute of driving and then a route
is a bunch of segments we use JWT use to
authenticate you go over here to JW t
comma Dada Y you can grab yourself a JWT
not gonna do that in front of you
someone someone will type it all in
somebody would go to all the trouble you
think to type in the date I'm gonna be
truncated actually does hmm you can get
the first so many digits characters yeah
yeah but um yeah the way so you can just
go right in here to the Combinator VT
portal it's like a quick login yeah you
login with your Google account
yeah you can paste it in on the API
Doc's here and then all of the example
requests on the right column you can
paste right into your terminal and try
it out with your data nice you can get
stuff about user stuff about your device
all your routes the data live will not
live video streams video streams iceborn
Cabana use that derive data we're
talking about stuff about vehicles how
open pilot talks ena which is the
service of talk to all the pilot all
your annotations that use an explorer
and one global leader boy yeah it's
actually just the top 40 oh but like you
used to see in the community page so
yeah highly encouraged cost them
leaderboard customer we're at 153 where
have you been man
yeah I have a definition section Oh does
that mean you can build your own
Explorer well you could do one better
than that and you mean one better than
that and use our Explorer five is gonna
make - the thing but we're gonna make
the Explorer Explorer is open source oh
[Music]
yeah I'm gonna hide the you're right
you're right I'm just gonna look at you
and II oh you'll see them in the API
Doc's yeah common points if you guys
remember what explorers really
appreciate all the annotations that have
been provided whenever you disengage or
nauseous steering wheel a bit and you go
on Explorer and commit an annotation
especially all the comments we've
received associated with the annotations
are incredibly useful so we go back and
improve the driving system based on your
feedback yeah but now explores open
source really you know once you see
issues created want to see issues
resolved pull requests are accepted you
know comments really been you know
accepting a lot of pull requests lately
and comments team and our open source
ecosystem is as healthy and active as
ever so you know we're trying to get
everything out there so that so that we
can build calm a on alright
no but then other people said it was
fine but you know what we're gonna get a
proper mic audio you can get that from
your eyes hold a boom we're gonna get a
boom that you just like plug in one more
thing so Explorer is the tool who are
annotating the drives and reviewing the
drives cabaña is the tool for exploring
the can data on your car we have this
great project called open BBC which has
been in the works for yeah we came up
with it spring 2017 so all the cars have
they don't have public eight guys the
car is the way our modules communicate
with each other is all secret the
manufacturers have this documentation
file called the DBC
but you know you can try asking them for
I don't think that's gonna go over that
well or you can reverse engineer it and
in open DBC here we have really all
mainstream cars now reverse engineer by
people and they're pretty complete and
it allows you to get things like your
your wheel speeds you can get your
steering angle sensor right here but we
used to have this thing called Cabana
issues where you could publish your
issues about Cabana Cabana have bugs
we're doing we're doing one better than
that now we're not just gonna you know
look at look we can hire a full-time
person to fix all the Cabana issues that
cost money and we're company we're
trying to make money so we're gonna do
one bed we're gonna open source it so
you guys can fix the issues yourself
right here at the comic
Wow is it it's really that easy huh also
explore and oh we should put licenses on
them that's a good bow these
applications are based on react and we
are using the latest , API and DM
package which is also under comma API on
our github which implements the I
suspect that we showed you earlier so I
hope that everyone plays around with
these and customizes them in the ways
they want and the ways that we all deem
fit to merge back in will merge in make
it good yeah someone's asking how does
anyone start contributing to the
codebase is there any tutorial on
walkthrough of the codebase yes I write
the instructions to get started on the
project there in readme at the root of
each repo and you know since they're
written in JavaScript can react very
cross-platform you know pretty pretty
easy to get familiar with it should be
easy to get up and running and make
simple changes and see them reflected in
front of you that's the beauty of the
web you can just make a change and the
tools are so good that it'll
automatically reload in front of you and
show you what you did so yeah read names
arcs yeah so was asking to post that
link and we
maybe just perfect this guy yeah yeah
cabanas 2017 brainchild we were all
sitting downstairs in the basement of
the old office and we were like how
are we gonna afford all these cars we
came up with open D BC and we came up
with Cabana just some one one random
evening so you know ideas blossom and
open DBC is a incredibly successful
project and we wouldn't have been able
to do it without all of you it's not
done yet every time new car comes out
and all the cars that haven't been have
the map yet we still need your help so
hop on cabana get an e on and help
reverse an engineer every car that we
can cuz a Kyle boat was on legs creep
and you guys can watch the watched the
podcast and you know cruisers virtually
making an aftermarket self-driving kit
but they gave up not because there
wasn't a market but because it's
technically with a guard how are you
going to support Carl I believe said
twenty to fifty cars well support
[Music]
16 17 18 19 20 21 22 23 24 25 26 36 37
38 39 40 41 42 43 44 45 46 47 48 and if
you include the model years we probably
got like 65 right there so and that's
dude tools like Cabana I'm making it
possible to crowdsource this kind of
work
we don't own 45 different cars this is a
similar idea right how are we going to
get rid of the long tail of issues so
always remember open pilot and every
other driving system today is level 2
which means it works in conjunction with
a human not alone pay attention at all
times and correct its mistakes now its
mistakes you're usually you can do these
things Explorer was this to kind of show
you what the car was thinking at the
time we draw the models we draw where
the car was going and we've already
open-source least amount of the tools
that we use and explore so the libraries
we use to draw the HUD and read the logs
are already open source under common AI
organization I'm p.m. so we have common
a I log reader to read logs in in
JavaScript coming we have our old
JavaScript engineer shadows Chris bakery
Road Cathy NP JavaScript tooling so you
can read all your log on us you can even
check them out yeah you just think about
how bad all the other throughout the
people modded cars well you the tools
are terrible like we try to ball I don't
want to build anything I never want to
build anything right if I can download
something I'd much rather gallery you
think I wanted to build pandas by
shopping
yeah we built Cabana kiss you know you
got back your tools which are
proprietary for Windows and cost
thousands of dollars and we thought
there's no reason that good free tools
shouldn't exist now now cabanas pretty
truly free MIT license and an
open-source
cross you know compatible across
platform doesn't require 200 mega
Windows download you gotta know oh I
need these I need visual C components
redistributable 2015 oh now you just
need Chrome yeah yeah stream is choppy
it's choppy you don't think we should be
on Wi-Fi well I know because I'm on why
fine fine cool yeah check out everything
was released today submit issues give
feedback on discord and Twitter and
everything and you were excited to see
what you build yeah we'll take
reasonable questions no product
announcement guys it's for developers
remember
oh yeah bring back the old office I love
comma but work out how to appeal to the
normal drivers
that's what's what's happening in the
announcements that aren't for developers
as announced this announcements for
develop July 1st through the masses yeah
definitely good analysis track to the
masses row we have a new slogan about
our new slogan oh yeah check out her
Twitter check out our Twitter you know
how it used to be go sure I get rid of
the hashtag anti-hype I think we should
just like make driving chills simple
enough you don't need to make driving
chill period right that's our that's our
new slogan mix ride and chill it's like
ghost riding for the masses but it's
make driving yeah
how many retweets what about the dataset
though ya know soon your date actually
what about the Dennison you know what
what about the day is that why don't you
go to comment search for comics who k-19
what about the dataset I'm just gonna
link you back here on Twitter what about
the data already published bro we open
source data at the end of last year how
do you plan on growing your data set
it's already too big guys it's too much
alright maybe we should take them yeah
we have 119 over a 200 we'll do that but
yeah I know
oh let's talk about the eons without the
extra costume scoffs bro I'm not making
any money off of your costumes why
should I pay for cuz you made poor
choices I said we live in a democracy
I assume you made poor choices when you
voted about Netflix on yon no yeah we
have a lot of data data is really
expensive to store you know so who's our
largest yeah yes which is going down
well we're bringing all the data right
here to San Diego mm-hmm yeah it's like
retirement 30 data common navigation no
host stream start kar komak connect it
seems to be a gimmicky feature that
people want and the only business car
bug is early in there oh wow this stream
is lagging it's terrible you still have
a country
0.6 when we don't make comments on
future products and ETA navigate an open
pilot I'll say this anyone who wants
navigate on copilot should read the
Consumer Reports review of navigator on
autopilot now soon reports for anyone's
company no not there not there not
bought out and all sold out at least as
far as I can tell and they're very Pro
autopilot but navigating autopilot is
not good when it makes lane changes it
doesn't worse than human right
you should we only try to do things
where no driving miserable Lane it's
pretty easy to do better than a human
people's aren't that good even if you're
not like super distracting sometime like
the wheel drift a little and jerk it
back right control loops are much faster
and when you're making a lane change
there's so much human intuition that
goes into it that unless you can
actually do it in a better than human
way you shouldn't be doing it at all and
that seems to be like most of what
navigate on autopilot is now combined
with navigation in like intelligent
place this is something we're interested
in the future of a building something
that looks like navigating an autopilot
and works like navigate on I got an
original bottle three boats great very
little pop I tried out navigate
I wouldn't shut that I think it's I
think it's a alpha you hear low Danica's
people definitely don't like it someone
say in statistics show that auto steer
is what people really use this is a
great article Kristen Carosa great
journalist oh the one that breaks 200
this one oh I think we're talking about
the one that breaks down like which
features people want you know yeah
what's the latest development on the
Corolla it drives
okay maybe I should carry tweets move up
retweets people buy things by the way
please buy things shop up da da da di we
love when you buy things
that's exactly right it makes it very
easy to buy what we should call it the
role or not the Corolla yes someone just
caught that that's brilliant patron why
am i buying you a trip to Europe bro
because someone in community bought
chase and a few others - why yeah camera
will man thank you I am a woman I know
that's true someone wants to know the
best car for 0.6 parole law yeah Corolla
check out Longo Cleo - yeah give a shout
out to the guy who helped you yeah I
think it's Steven it longer do you just
hear any new announcements so what we
announced today is that we now have an
API I will post a public API it is right
there
we've also open sourced Explorer and
the tools that you've been using for the
last three years let's have a call to
action wrap-up those are good to have oh
yeah yes you can go and comment a I
Cabana issues and we're gonna turn this
off and you could port the issues over
to combat AI Cabana we already have
issue though these might be internal
vegetables oh yeah remove the stupid
three minutes go by yeah all right yeah
cool
and we should love to hear from and what
better if you just finding it you in
this town misdemeanor George Ford saw I
don't know if many of you know but
George's the CEO of Commodore AI they
just launched a amazing a product of
which I use personally so I'm a big fan
of George and Georgia is the people know
that he's the first person to Jailbreak
iOS and thanks to him we have you know
this capability huh he he will be
sharing his perspective of autonomy from
his vantage point and what common area
is doing and and you must have a part of
the product and out so I think they're
fun to make sure few quick points are
one thing that I want to highlight is
and it shows the enormous of this
problem that is that the trying to solve
so first of all the hardware range from
said and that's something that George is
trying to address right now if you build
a nice fancy car with my girls and all
you talking but 7250 killed your
daughter is doing it that you know maybe
like less than flu case you can have in
the garden which you fifty second point
is how many miles that we need so it
keeps increasing so twenty the right to
wear that twenty billion miles that we
have driven actually so what it means is
that the more data you have the more
accurate your model would be and that's
a chocolate that you need to solve and I
think how do you solve it at the
interchange format that is all vegan and
then I think the data is in a problem
that be generating tons of amount of
data from one terabyte
[Music]
these numbers keep changing but at the
end what we say is that a lot of data is
generated from these kinds of sensors
and that we have what problem are you
trying to solve so the problem we're
trying to solve is that 1.3 million
people that die in road accidents every
year $30,000 in North America and we
trying one of the business case or use
cases to make that completely you know
address that and then you get there and
then obviously that out of the problem
that suggestion and then the other areas
that we need to perform so but I think
that's abundantly the foundation and
then I would like to invite George to go
over his presentation and
[Music]
this whole space is insanely sad
there's don't listen to what is put out
by marketing people and my business
people that's all you're hearing from in
this space please look at it for
yourself how many of you have actually
gotten to ride in one of these cars
probably if you guys have experienced
what it's test autopilot
all right how many have written in a way
moment how many vary the test autopilot
today we go right you see what's real
and you see what's not real and this is
it this is it honestly it depresses me
so much you know why play a game if
everybody is playing by a different set
of completely rigged rules where you
know what does drew Carey say and shows
like it's all made up and the points
don't matter I mean that's what it seems
like
so my name is George Hotz I'm the
president of coming I in 2015 I rigged
up an acura to drive itself you know
I've never be one and like we wanted to
build a vision system thought about
those days my mobile I know like I could
use a few months that I did then you do
this and then you're like okay well this
will be easy right that you are on
autopilot this will be easy to sell to
the car makers right oh no no it's not
easy because the car makers I mean
finally now it has to stop
again sad there's a Paul Graham tweet
from five years ago saying the Model S
is the iPhone of cars of the difference
to the Model S the iPhone is when the
iPhone came out all the phone
manufacturers like oh well crap together
we go
catch up to that and all the carmaker's
laughs anyone else I kind of know what's
gonna buy an electric car all right look
what you are today so yeah we make this
thing this is only one is called comma
two it's 999 dollars you can put it in
your compatible Honda Toyota chief GM
Chrysler that supports 63 different cars
and it basically gives your car Tesla
autopilot equivalent functionality you
can drive for hours on the highway
without touching anything actually in
that way it's even better than autopilot
we use a public facing camera to monitor
the driver I was do it GM does this with
supercruise to this really there's three
good systems on the market today is
autopilot there's super cruise there's
us so maybe go to the next line this is
what this thing looks like mounted in
the car
it's our slogan is make driving chill
that's another thing people are always
like all self-driving cars our goal is
to reduce accidents or call the safety
no safety is a necessity thought it cold
right safety doesn't sell products what
what are you gonna do you hear Monica
right like this isn't know let's look at
is big driving champ safety is just an
added bonus right the purpose of cars is
not to be safe the purpose of course is
to get people from point A to point a
safety is just something you need to do
and need to have in your product so I
hate this rhetoric around it but again
you who comes off of all of us so we're
are completely open-source all the code
that runs on the air it's called open
pilot it's 100% open-source honestly you
can't get this stuff away you can't get
this type of way there are companies now
there are eight house companies now
trying old game is
they're trying to pitch to OEMs and
they're trying to pick something that's
worse than what we're literally giving
away for free with an MIT license this
thing is really good it's a thousand
bucks if you have a supportive car go
buy them and try like going in to search
for open pilot you'll find drives nobody
else again it's not a marketing material
these were users sitting at the wheel
watching the car drive for hours and
hours and hours so yeah we have on the
user things old we have over 1500
monthly active users and that's our
cumulative miles all the way home is 20
million miles you're 15 right like it's
it's not this nothing this is this is
nothing like I've shown you Tesla's
billions and billions of billions and
that's another great myth of this thing
I call twenty million miles it's so much
it's really nothing
this thing is just getting started we're
growing exponentially and you wanna
solve all the five economy that's how
you do it the only way to really do it
is with big data the incremental
improvements and with an end-to-end
solution when people are trying to break
things down into perception and planning
they already lost 0.15 negative comment
earlier from this target in the area and
announcement
I think the necks are all the time I
would say our good friend Alex Roy is
pizza podcast podcast which is a very
good podcast keep anonymous bait he
always say that in the levels of
autonomy only they even ever counts
because I love to I think we really saw
the problem of Keaney in the driver
alert on before and after car also for
commercial vehicles level 40 is the
first level you can't take the driver
out and see if you can accomplish a lot
of but you need not meant what by dreams
doe level 2 level 3 and level 5 probably
are not so much having a business value
level 3 as you may know is supposedly a
very fully or better economist but the
driver need to be engaged at full time
it is very difficult for the driver to
trust this vehicle and to keep alert but
at the same time so that really leads to
some safety concerns from from our
perspective and of a 5 is I think for
the completion of the for the levels
right you are asking this to be able to
drive a process that there no back
wheresoever you know anytime anywhere so
we believe that level 4 is the good use
case for trucking just given the
situation I have mentioned in the
parking space and level 2 is good for a
passenger car probably in the near
future to be implemented for for you and
I use it's a total myth that the levels
are different 2 3 4 & 5 are exactly the
same the only difference between the
miss was taking liability for level 2
the drivers homes liable and level 5 the
drivers never liable
this is made by business people it's not
made by engineers she could say this is
a level 2 system what
that mean it means that on its own it
makes more mistakes than a human would
but it's not a qualitative difference as
we drive mistakes down to zero
eventually one day well okay when does
it become level five when it's ten
percent safe of any human to X 1/4 10x
safer right it's just a question of how
many statements you have this whole
dichotomy of look if you're building a
system if you're building a level 2
system that detects the lanes on the
road you've already lost
pleasantly oh good for little white
marks they've lost all right the way
that we train this is completely untamed
we look at where humans dry to the
scenario what is the definition of
driving it's what humans do when they
dropped if you're thinking about a
limited operational domain you're never
gonna solve level 5 but you're not even
gonna build a good level 2 system so why
not solve the whole thing and then they
get you know quantitatively better over
time
there's no qualitative difference thank
you
next question is no you seem to get bit
in the
between senses to be used there the
whole night on camp everybody and there
is a visual sensing it's a test that is
permanent and it's been going on for a
while and nothing like a dot mentions
that the only car that actually is in
the road whether it's dead 2 to 5 we
call it our the testers so the question
to all of you would be that you feel
that Richard only sensing can be a
solution for solving these problems or
data is a monster I'll be fast
how many you could drive a car how many
you have a lidar I would say
pragmatically we gotta get rid of the
lidar but we use it down University
currently because it makes some things a
lot simpler so yeah
to symbol is also a vision based
solution our camper actually can be over
a thousand meters away which is quite
substantial especially for turkey you
have to longer stop with a search for
big rigs we do believe a camera based
initiative will be much stronger the
entire base solution just because of
that range of reception distance for a
best our system today your problem can
see around 200 meters but four cameras
can see much more them what I think the
combinations are really increasing
redundancy and bring out somewhere in a
stable system yeah it's just all about
redundancy and kind of giving the
impression to people that they are safe
I mean yes we do have dual ice and we
trust our eyes sometimes we take them
take our bikes off the road and instead
expect a partner to write itself but
leaving that aside I mean if I gave you
a car with just one camera people do
tend to get a little bit nervous so it's
probably more of a phase where we need
to tell you that no there's more than
one non sensor that's taking care of you
so it's all about no pun intended
perception but over time yes I do think
mission will I mean there's nothing grew
enough to communicate of us being safe
in our cars but it's just more of an
inherent missing
let's run and see more inputs to make
you feel much safer quick come in an
interception I want people to be scared
using these systems I don't want people
to feel safe because none of we're
better than humans people should be
scared and people should be ready to
take over at any time I thank you I'm
just curious if you think that 5g with
its low latency and high reliability is
important or a necessity for level 4
level 5 and if that's not the major
impediment what are the two or three
major amendments to the adoption of
level 4 5 thank you it's all completely
AI there's no difference at all between
40 and 5g Archie's mostly German my
height is IJ still nowhere near reliable
enough to have any cloud in the loop for
a level 4 dragon system I think you
leave me impression that all these
redundant sensors and cameras and
wonderful is working about a perception
of safety rather than actually required
for
a bit yep sorry I didn't mean to leave
that impression what we are saying what
I'm saying is that yes the technology
will get better and better over time
definitely it's it's software it's it's
science we can solve the vision problems
you can make it very very safe today you
know we hear many many potential
customers asking this question okay you
know what I'd like I mean I don't feel
very safe as a Tesla I mean this is an
encoding someone do you have a lighter
so that question comes up very often do
you have a rate of how many radars do
you have it's to take people's people
definitely feel safer when you have
multiple redundant sensors so we do have
to address that as well because we are
at the end of the day selling a vehicle
or leasing a vehicle to an end customer
people with one eye can drive cars very
safely when they do crash it's largely
because they're drunk distracted or
asleep not because their iPad thank you
so much I think you might give a big
hand
[Applause]
[Music]
all right guys this is if you still for
some reason are subscribed to get our
periscope notifications just how many
people 505 give it a little bit up so
when I use in periscope anymore cuz like
it sucks it is dead but we're gonna get
future streams to not lag we're gonna
like do speed tests beforehand and make
sure the Wi-Fi is good and stable Oh get
microphones yeah yeah we get microphones
we'll do it really legit for the July
1st announcement oh we didn't shell for
that and oh by the way guys when I use
in periscope anymore we're moving over
to YouTube live so make sure to check us
out there follow us on YouTube follow us
on on YouTube and you just missed the
stream so they can still be scopes
yeah nobody scobie's that's fine that's
fine they can be Skokie's I mean like
you know I'd only keep YouTube many
perhaps exactly it's terrible no I mean
YouTube's not a brand that has beliefs
that I believe it periscope might be I
don't know anything about them except
the third like that
I've been can barely afford to keep
their servers online so you know I don't
know I mean I don't understand why I'd
like so much maybe it really is just us
but uh no I feel like periscope cuz I've
done twitches and they're much better
twitch is very good yeah anything but
yeah YouTube live so how many people do
we get with that 2500 2500 we don't have
any reach it's also terrible
we'll talk about that stuff yo ya
welcome welcome you guys this is some
pipe this is yo all right all right
first off we some caffeine so let's go
go into the fridge one of the common
fridge you know I get real hype for this
 this is amazing product launch
we're launching a USB the a two mini
beat no no no not don't worry I wouldn't
launch that what's up uh sure bro a sure
bio what's log - well log - in base - I
believe is 1 because 2 to the 1 is - all
right we don't have any to give Benny
got T all right we got some some pure
leaf tea Antonio I didn't ignore you
and E is not here welcome welcome
welcome
alright what's Ln - I don't know that
 mod C so if E is uh know what he is
he is like - I'm not gonna embarrass
myself I'm just gonna import numpy MP
dot ye yeah 2.7 all right I was gonna
say two points an X that's embarrassing
that I don't know what he is by pi
3.14159265 three five nine seven nine I
let's go we are in general with the
YouTube yeah well in general with the
YouTube what's the news we got news
today we got news today yo Chris you
want to hit that button
do it alright alright ah
oh that's the product you can't show you
that what's the derivative of e to the X
the derivative the ito yes I believe is
e to the X and the integral of e to the
X is also e to the X that's why you DX
is so awesome everybody should use
they'll use and not rel use all right
we're just gonna give everyone a minute
to come in here we're at a hundred
people that's nice got this on
we're let's put that on Twitter we don't
want anybody to miss anything
drink some tea we got it we got to be
calm I know I know it's it's exciting
let's go dark mail let's go uh uh put on
my nicest sweat pants today I got my
Hyundai with small park not rel UL use
better than Relius nice and smooth no
sometimes you want values but envision
models all you seem to work better we
ask you to test on this that's why we
use L use in our vision Bo and really
use in our heads G on guys are great but
guys this what if it doesn't even have
to do with young guy what if you all got
tricked you know and we're launching
commas sneakers what's happening this
dream we're launching products and
there's an S on there it's plural def
cons cancel don't know y'all who wants
to have Underground Def Con we'll call
it make Def Con cool again I'll put it
on all right you guys some CTF problems
will be sick make Def Con cool again
sneakers grads would be profitable thank
you thank you
we're actually last month was not
profitable off our obvious reasons we
don't have to discuss but this month
we're looking profitable again we hired
a great production engineer we're gonna
go back we're gonna look at the
production facilities a bit today it's
gonna be pretty good idea oh my favorite
artist I don't know any artists
who's a great artist a good artist Elon
Musk
Hockman um what's my opinion the lottery
can hypothesis this is a nice dream oh
man I forgot the s in the plural all
right what we're gonna go to the title
guy and we're gonna give the title guy a
week of unpaid time off cuz you did a
bad job on the title uh no I didn't
watch new Elon and Joe Rogan uh Banksy
I've heard a Banksy I don't know who
else who else a visual art visual arts
kind of hard these days who do I like
the world is a beautiful place I'm no
longer afraid to die there are artists
Shinigami
I listen to who was it the Dixie Chicks
song this morning it's pretty good bear
philosopher plain EJ you choose like got
look you feel like you feel like a
certain like when you read it you know
you feel like you feel like strong and
powerful and then you read Heidegger and
you're like what's this guy saying I
have no idea man being in time his go
links a passing Python in the future I
don't know why not make it a lot easier
for people buying all compiled what do
you say what are you saying what do you
want make a PR and github that's what I
like to hear
that's the way to interact that is the
future um you believe in something what
do you believe in whoa whoa whoa panel
who's heard of the pan of Jumonville all
right all right I think it's I think
it's time let's get that up that let's
get the view count up to up to 200 and
then and then we'll really start this
stuff out
oh yes yes we are looking good
where is your order it should have
definitely shipped all right where are
200 people let's go
so we're gonna start with a cute little
product we're gonna start with our
smallest of the products xx xx 979
Hyundai bro absolutely boy not I'd love
that but this isn't young guy this whoa
Hyundai car harness whoa whoa whoa what
are you guys doing whoa we're starting
with this it's really small so I'm gonna
bring it nice and close to the thingy so
you guys can see it you see this this is
a comma key okay so use your story you
adventure it off of release - you wanted
to try the latest mods you are cutting
edge so cutting edge in fact that you
bricked your comet oh you can brick the
coma - if you're right bad panda
firmware um but no fear if you have a
comma key a comma key makes your comma -
almost unbreakable if you really do bad
stuff you can still technically break it
you can fix it if you take it apart but
this makes your comment to effectively
unbreakable all you have to do take your
comma key plug it into the back of your
car - right there and then when you hold
this button down the Panda goes into DFU
mode so this is a comma key uh there are
99 dollars and they're available right
now at shop.com Adani I slash products
right here with a nice little story
apparently they only have one picture
this is a comma key yeah $99 damn I know
yeah comma keys are expensive but you
know do you want to solder all those
little tiny USB shits no you don't so
that's a comma key a comma key is like a
pan to pull off but it's for the comma -
and also potentially
for future products with the OE DC
connector how does it come and get power
with the key you just plug it in right
here you plug in a second USB over here
so I can just plug this guy in right
here and there you go yes small price to
pay if you brick it alright so that's a
comm this is just a normal comma - let's
move on to our next product and that's
right over here this product here is the
Panda jungle alright so we've had to
build you know what maybe before we
announce the jungle we're gonna go take
a lot a look it's $2.99 it's $2.99 it's
a good price let's go take a look at
some stuff that we've built yeah yeah
we're on Warren live stream right now
yeah iced coffee alright welcome oh
they're gonna boot up now welcome
we have 272 people alright but I'm just
showing off the jungles aren't they
ready to go all they're firing up right
now there's gonna be cool this is how we
test the comet to us before we send them
to you they're actually really well
tested now and each comma two is powered
back here by a pain panting rig oh yeah
yeah twelve one you want to show them
the power supply yeah we to put heavy
gauge wires for each panda because they
were overheating you couldn't burn your
fingers on the water that's some nice
thick wire yeah all right so we're
connecting to them right now yeah yeah
they're all gonna start right now this
is what you can do with your panda
jungle this is what's possible if you
read along if you write a lot of code oh
wow that's crazy
floor gang yeah floor gang yeah so they
just they just will come up and test all
through the convenient panda jungle
which can be yours for the low price of
$2.99 let's go take a look at it oh by
the way also
we sold a thousand pandas to an unnamed
buyer for 69 thousand dollars they're
purchasing a Killa panda or first ever
kill a panda so that's boxed up ready to
go the other bit of exciting news is if
you buy a comet to see these comet twos
they are unclaimed one of these can be
yours right now we have 40 in stock
ready to ship on Monday so now is the
perfect time to buy a comet - and
there's gonna be many more comet oohs
where that one came from as you can see
by we are the world's largest
refurbisher about Lego phones yeah so
that is that let's go back to our
computer and let's take a look at the
other product all right go back to shop
here scroll down go to the developer
shop down here you'll find the Panda
jungle what's better than a debug board
pandas in a jungle by the way you can
plug in up to six comma twos in one
panda jungle one two tres cuatro Cinco
seis that's a crazy amount so you can do
that with oh and the jungle was of
course for sale for two hundred and
ninety-nine dollars so so far we've
announced the comma key right here
perfect for I'm breaking your comma - if
you do stupidly brick it and also the
Panda jungle you're about to buy a comma
- congratulations now is absolutely the
time to smash that buy button get a
comment - you'll be like wow I bought a
comma - I'm so happy all right how many
jungles can you run in series as many
jungles as you can buy
we're running a whole wooden rack full
of jungles that's a whole like I don't
even know man that's a whole South
America back there
alright so let's plug this wire in
I don't know what a GI means what's the
common jungle I'd say the Panda jungle
so for example your comma to indoors
it's not a very expensive way you don't
have to make sure that switch yeah
there's also a switch to get the power
and you can see that it's booting out so
there we go the Panda jungle can you
connect a jungle to a jungle absolutely
you can connect a jungle to a jungle six
times actually this is the control port
for the jungle which you can connect to
a computer the jungle has basically a
panda on board we're gonna open source
the firmware probably later today maybe
Monday I has four can buses on it as a
panda it's got some nice voltage
regulator you can trigger ignition here
it's got some some LEDs that show you
yes we shipped to India we ship
everywhere the common jungle looks so
nice panda jungle buy your panda jungle
right now
okay 324 people let's let's take a
minute and let's go through our
whiteboard I cleaned off things that
were secret on the whiteboard notice
that the secrets have been removed but
kama has come a long way and you know we
really appreciate having all of you here
on the journey with us
they bought white pandas they bought a
lot of white banners one of our goals is
million dollar July you guys will be
hearing a lot more about million dollar
July you know this is the other this is
the other crazy thing notice how our
competition is wilting look at zukes
right okay I'm not talking about the
competition we're talking about open
pilot 1.0 look at all these things
I'm talking about all of this stuff
level 5 platform profitable q3 and q4
noted failure of others disengagement
analysis you do all the things that
we're gonna buy with all our crazy new
amount of money whoa timeline for the
comma three no one said anything about
the comma three though there is one
other big product announcement there is
one other big product announcement today
but we're gonna we're gonna we're gonna
we're gonna can we get to 350 people
before we do the next product
announcement Oh a six might happen a lot
of stuff might happen brought up common
your recent job interview and murders
that a good thing that a good thing I
don't know can I tell but this is a
common key if you guys don't have a
common key you can buy one for 99
dollars this is a panda jungle you guys
don't have a pan jungle you can actually
order it right now let's see if
anybody's ordered any of this stuff
murder killed in a good way oh that's
great that's great
yo wait sale
those are going crazy waste sales are
going crazy how many pandas and jungles
have we sold that's all I'm interested
in right now pandas and jungler I don't
think we've sold any pandas and jungles
oh you just bought that oh whoa whoa
whoa I don't know where you heard about
that alright we're almost at 350 people
this here is the key to my Hyundai
Sonata I've been driving it she undies
are going to be the best car for open
pilot and in order to support that we're
launching the Hyundai harness now now
you say oh this is a harness how
exciting could that be gross the shunned
eye harness is actually five harnesses a
B C D and E and there's an F G and H
coming soon that aren't ready
Hyundai is a terrible manufacturer and
makes every harness different yeah so if
you have an a harness you need this
wannabe harness you need this wanna see
harness don't worry this is conveniently
done with our compatibility flow and I
bring you live
[Laughter]
so there's some fun as I will just work
out of the box is not a 20/20 it's
supported community supported by the
comma - no issue you there but the
hardware teams not great job checking a
bunch of these different cars like this
is a giant list and all these cars will
be checked so let's say we wanted to get
a cone a harness you'll get the second
screen that says that you probably built
in a movie camera I'm gonna say yes and
there's a smooth page that's likely
candidate and just because it's not
supported by open pilot yet doesn't say
community support it but we still do
sell the harness so you could click buy
it adds the right harness to your cart
we have the ones we have the ones in
bold that are yeah yeah we can go
through this that's pretty good so wow
this is we should we should uh we should
open source us yeah yeah yeah we get we
got to do this cuz this is confusing
 I could scroll down and there are
some Hyundai available here as well as
some Kia's wow this is getting so long
Wow look at all those Wow yonder ice and
then there's some key as well yeah yeah
wait so someone was asking about the
Sonata 2019 oh but it is supported by
any yeah so if you do it you'll just get
out tell you what jungling Kyary if you
don't understand what the jungling key
are they aren't for you should we look
at best - yeah sure so I'm gonna post
this in the discord this just shows this
type yeah 1 2 + S which is a so either
your connector look at what wires are in
it and you'll know what Wow as well so
that's gonna go out in the discord for
people who want to check what car they
have yeah we should actually you want to
write a medium post with like links to
these things talking about what a pain
he Hyundai is and maybe encouraging
to changed I already own a comma -
Hyundai e is not listed on the car
harness shop page so go to the car
harness oh yeah by the way wait you know
not car scroll down go to harness
connector yeah by the way we've raised
the price of the harness connector to
$100 oh wait no it's not here no it's
not gonna be here you can't get the very
bottom oh I see so any car that's
unsupported you can still select at the
bottom
Hyundai e development wow that's the
biggest pain yes the biggest pain Wow
shun dies the worst
alright a dandy you just make sure it
works cuz some guys said it didn't work
alright yo Hyundai II wait is that also
at the bottom of the car harness so if
you go back to okay I don't make sense
you could of course buy that with a
black Panda if you want that too but
yeah the Hyundai is not look at this
look guys who wouldn't do this why did
they do this you know the comet team has
been working really hard to make this
possible for you guys yeah let's let's
just link those resources in discord now
if you guys are not in our discourse at
discord comedy I yeah we'll start with
that picture and then medium poster be
nice the difficulty of the Hyundai
harness I think that's a great medium
post people know that we put a real
effort into that and that's why all the
stuff is uh so he's been soo
don't take me CoA from comma pencil well
yeah I mean you know come on pencils
very important but John Knight harnesses
bring in money and we love money so yeah
we need to win that win that money so
you guys should buy those gondii
harnesses I heard about wonderful I
heard wonderful things about you know
how many people were gonna buy this so
I'm really hoping for everybody to come
to come buy this
you guys have choices you can buy an a
you can buy a B or you can buy a see you
can buy a D or you can buy an e the
discount code for the live stream is you
better buy one of these before they run
out you think we're keeping five things
in stock that's a crazy amount of things
that's as many fingers as I have and
just wait'll we launch F G and H we're
gonna have to get into toes just kidding
I know I have ten fingers all right what
else we got what else we got
that's most of the stuff we had planned
for today we're gonna go to 30 minutes
here oh man I've been playing around go
commas trying to become a we're trying
to get the comma twos to have custom
comma IME eyes let's see how my new
models coming along on the models coming
along okay losses going down that's good
any extra if you call all right all
right all right I guys we're gonna do it
I'm gonna make a discount right now this
was not part of any plans but I'm just
gonna make a discount for you guys are
you guys ready for the discounts all
right all right the discount code is
gonna be lucky yeah well do it right
here okay the discount code is going to
be live stream one and it's gonna be a
fixed amount and it's gonna save one
dollar if you know the code live stream
one $1 off your entire order and you can
only of course use this once per
customer
no limit the number of times okay you
know what we're only gonna have not
another another no I think everybody can
use this and we're gonna have it go for
the next hour let's say everybody who
gets in during the live stream you guys
can use the code live stream one to get
one dollar off your entire order that's
how generous we are commenting on a I
hear you guys save $1 right now smash
that Buy button you'll never get it
cheaper than right now save $1 until
3:00 p.m. so it ends it then at 3:00
p.m.
$1 you guys can save $1 you guys can go
donate your dollar to Doctors Without
Borders or something or whatever you
want to donate your dollar to but it's
$1 off the entire
order for everyone let's see how many
people are gonna start to use this
amazing discount code
let's get these orders and I don't know
what Mahindra Scorpio is save a dollar
everybody save a dollar I'm gonna go get
those hair dye harnesses so I can I can
caress them while we have more
livestream
yeah yeah harnesses all right let's go
over quickly everything that we launched
in today's live stream yeah save the
dollar yeah all right who's spamming hit
is spamming you are in timeout Mahindra
Scorpio I don't know what that is you're
in timeout okay we have the type a horn
type B or as well as a so much stuff so
much stuff how many people right now
I've saved a dollar you better get that
order and fast should I put a limited
number of dollars that can be saved
Wow nobody's using it we need we need
some dollar we come on spend some money
we got we got 11 orders today already
all of this stuff ships all this stuff
ships Monday so when you guys get your
order in ships by Monday talk to your
dad right now spend your stimulus check
this is a great place to spend your
stimulus check well that's some
delicious tea this is a delicious jungle
okay well we have one last jungle now it
was delicious was the best $299 I ever
spent
yes oh so is that here's economic II
don't want have another jungle right
here wins Volkswagen harness you guys
you guys we make something for you and
you just ask when's next we make
something amazing for you Hyundai
harnesses look look at the detail that
goes into this it's like that's the
connector
that's crazy stuff Dada Dada it's got a
type s connector what is the comma key
for if you break your comma - you can
unbreak it with a comma key thank you
thank you give you a shout out I'll give
you a shout out if you use the discount
code whose use the discount code
livestream one all right you know what
we want to incentivize some people to
buy some stuff so here's what we're
gonna do we're gonna blow wait people
didn't even use the code but we got new
orders we're at 14 orders now that's
crazy okay should we increase the
discount you place the order can you get
$1 back if you contact support bro bro
no you order before discount all right
all right all right all right all right
we'll give everybody we'll give
everybody $1 off but there's a $5
support fee I like that you know what
buy a meeting
you're just use the discount code wait I
don't know maybe this is just broken it
says zero use but I think it's just
broken cuz we now have 15 orders yeah I
don't know maybe Shopify is just broken
yo discount and get a dollar off
anything $1 off your entire order if
you'd like your if you'd like the
discount code retro actively added to
your stuff might I recommend purchasing
a meeting and we can do that
so for $1000 you can buy a meeting you
can also save a dollar on the meeting if
you proceed to checkout um and you use
this great discount code oh may 500
meetings not a valid discount code
anymore but if you use the discount code
livestream one you can save one dollar
that's crazy that's crazy that's the
biggest savings we've offered in a long
time II see bee
ah D and a get the whole family in here
like alphabet soup
the shirts are sold out your shirts sold
out wait we sold out of shirts nikkor we
sold out of shirts some sizes Wow
we got to get some more shirts we're
gonna do what you say oh yeah I don't
know about that I don't know if we're
gonna get that crazy nice bag look at
these we're now filtering out comma two
is that overheat stress test failed look
those ones fail we take him out we don't
ship them to you comma two is are the
highest quality they've ever been if
you're thinking about buying a comma
tube with the crazy one you know I offer
to 100 discount yet live stream one oh
nice sweet sweet bye Paul wait they got
a $19 Paul that's too cheap oh well okay
5% discount what do you think this is
you save a dollar be happy you're
googled what some a hindu Scorpio oh
it's a cool car alright um these are
more testings I kill a panda you know
did you know you could put metric
prefixes before pandas bring back the
comma vini
we're apparently out us from shirt sizes
we're gonna get more shirts in one of
these days yeah these are our values
externalization sustainability its
ability and quality not growth and not
short-term profit million-dollar July
you guys have been hearing a lot about
that we're trying to shoot for 8 million
in revenue in 2020 this is how many
years everybody thinks until we get to
level 5 self-driving so we got 225 s in
there we got some twos and threes and
fours and fives
I was the 8 a gig of Pantera tariffs and
we don't have any pandas we don't even
have a mega Panda
how many comma 2 is are we shipping each
month now about 250 I'm more than that
actually
yeah that was last month it's about 500
now
yeah check it out
kama jungle how good is open pilot bro
I'm not convinced to give a you
don't know how good it is don't all buy
it when is nissan support coming
official we have nissan support i've
streamed is your 0.75 model fix you know
we have some issues with that model well
uh we're gonna do 0 75 next week to make
sure that comes out before the hyundai
oh whoa five people have used the
discount code even know what's going on
Shopify is just weird
five people did you guys actually email
support so you can get it reg who
actively added your orders yeah um just
for the rest of this live stream you can
use the code live stream on if you don't
think $1,000 is affordable might you
consider a Tesla
we're both self driving costs is it
seven thousand or even get a comma two
for just 999 what a crazy low price we
point out how beautiful comma twos are
they're so beautiful
Hyundai support is already here Keanu my
support is already in master and we're
gonna ship that in zero 75 with chips
next week so if you order a Hyundai
harness right now by the time it gets to
you he and I support will be in open
pilot um do we support the Russian
language we're working on multi Lang
multi Lang is a requirement for open
pilot one point out um what phone is
modified so it's not really a phone
anymore we just like use the phone case
and like the phone motherboard but like
it's not it doesn't have a battery it
has a replacement front camera so we can
see in the dark it's kind of like a
bunch of phone parts you know what I
mean Elan built it what it was it what
is it Tony Stark built this in a cave
with scraps yeah bro by a comet oh
another great the testing has improved
leaps and bounds so if you buy a comma
today you're getting one that went
through a really rigorous testing that's
24 hours of non-stop perfection how much
longer will Yuans be supported if you
have a black panda you'll get a bit more
out of it if you have a white panda
going away soon if you have a gray panda
results may vary depending on your
fingerprints if you have a Black Manta
it'll be well your black banner will
continue sporty out for a while but um
yeah before that you know it's been it's
been it's been almost a year now it's
just we launched the black Panda like
nine months white panda we launched grey
pandas so long ago so white pandas are
going away
well it'll be an affordable calm
assistance don't like to comment too
little and if you don't think the comma
to is affordable guess what I have for
you I have for you a sick discount it's
called live stream one uh and you guys
can get one dollar off your entire order
Aryan stop spamming five people have
already used this incredible discount
that let's let's just pretend that
you're buying a comet too
let's let's do that right now we'll take
out this sick discount code out of our
cart you're not gonna buy a meeting the
meetings are legitimately a scam don't
buy a meeting the meetings are just you
know it's kind of like but actually sold
three meetings so why they bought the
pandas we don't ask those questions we
just sell we just sell okay ah let's say
I wanted to buy a comet too
let's say I'm buying it for my beautiful
new Hyundai Sonata 2020 which is really
a great car that's gonna be the top car
that's why it's the a harness by now it
doesn't ship with any software that's
fine I know where to get software we're
gonna hear proceed to checkout
and guys it's never been cheaper right
now to purchase a comet too because I
can use this incredible discount code
livestream one and I can save one dollar
you get one dollar off a white panda you
can get one dollar off everything with
that discount code alright let's take a
look at some of our products oh this is
a black panda
we have black pandas there in stock you
don't really want one because guess
what's inside of a comma two black
and technology that's right you know
it's right here
GPS antenna inside the mount kama tombs
are incredible futuristic technology
that you'll only be able to find right
here at shop comma dot AI so you just
plug this guy into here this is the OB
DC connector in the comment who has one
wire it gets power any data over the one
wire then you'll plug that into your
convenient harness block which is
included with the purchase of a car
harness which you buy with your comma to
you just take that guy plug it into
there and then let's say I was getting
that 2020 Sonata so I have the a harness
right here I take the a harness gives a
nice satisfying click I can write this
all in my trim and that lets my Hyundai
Sonata experience most incredible level
to self-driving this side of autopilot
and super cruise this is a bomb your
comma to broke when you dropped it why'd
you drop it
No okay oh and then you also need the
comma power so this here is a comma
power next image Ethernet wire this
provides constant power your comma to
which can put it on the comma Connect
app which if you guys haven't read my
medium post you guys should go read my
medium post about the time my car got
towed and I used comma connect I see
Honda is getting super cruzi I'll
believe that when I see it this is a
great excuse to buy another comma to
with a live stream one that's an
incredible idea too much money we've
made so far tonight how are we doing
yeah that's not that good that's not
that good you guys can do better you
guys can do better this is our total
sales for the day I believe in y'all you
can do better than that oh we sold two
comic Keys developer car harnesses those
Hyundai harnesses we got to start
selling a man you know what you guys are
better than the Subaru people though
right I believe in you
you guys buy a lot of counter harnesses
don't make me regret all the absurd
amount of work we went to to make eight
different types of Honda harnesses yes I
think I'll compile it will get
longitudinal control for the young guys
we're working on that we're pretty
excited about that how can you add a
2020 Sanada the car just go to 2020
Sanada shows up his car harness young
guy a you don't need to carry it in
Wi-Fi you just get common prime it's
included three to three months with the
comma to think the power of the phone
that there's so much power in here guys
it's been coated in Python we'll just go
to C++ free ECB you yeah I'm regretting
the discount already you know what you
know what guys discounts over discounts
are you sure you should have bought it
sooner you should have bought it sooner
five people got this incredible
livestream one discount but now the
discount is over delete discount oh we
sold 10 killed ionises wait am I just
not looking in the right place well
that's pretty amazing we've really sold
tenth hang on
yeah we bring that up I'm bringing it up
right now and chop fine let's do today
oh wait I think I was looking at the
wrong day uh car harness oh yeah whoa
yeah we're selling young guy bonuses
they're moving I mean I don't know how
you got ten or just say five I don't
even remember but we've already sold
five that's pretty good Wow so much
better the Subaru resold zero Subaru
harnesses we solve a two FCA harnesses
we're only halfway through this live
stream and Hyundai is already at full
arm you were gonna play with a $1
discount not anymore I'm sorry I'm sorry
you know you got to move fast if you
want to get that - all right we'll bring
back the discount all right all right
we're bringing the discount back all
right calm down
well I really just deleted that hard all
right all right I'll bring the discount
back all right all right I know I know I
know the only thing worse livestream the
only thing worse than missing out on a
discount is being so close I fixed
amount discount $1 applies to entire
order everybody's eligible and remember
it ends in just 25 minutes at 3:00 p.m.
$1.00 off the entire order livestream
won its back its back boys livestream
one Wow livestream one oh yeah let's
let's promote this yeah this is dill
oh I don't even know
guys this pretty good livestream thanks
for looking out for karma today's a
great day to buy with the $1 off
discount livestream one
oh well sessions are to the moon though
well there's seven people on the website
right now okay look it's sessions there
to the moon even know something
something weirds going on here eyes Ida
Pro running I'm working on something
hundred dollars off whoa what we never
do discounts like that we see you can
save $1 right now that's the best
oh yeah we're using the hexacopter yes
peter around the driver monetary model
which runs this is a big picture of a
comet to see one of these guys as a
camera the top one that's a camera right
there do $3 yes you do you showed your
discount cards no we can go through the
discount cause I don't think any of them
are that good ah
wait a second yeah some of these are
wait this just shouldn't be here right
yeah why are all these discount codes
still active whoa hang on
Wow there's all these secret discount
codes that were given to people Wow good
thing or they're limited no I think
these are mostly for so if you buy
things in bulk we'll hook you up with a
discount code if you want to buy more
than 10 of an item from the comma store
you can you know let's see last time
we've done like a real discount
oh we had discount code shirt discount
code shirt was pretty fast
ah no I'm not they're already all gone
oh yeah we sold two meetings with the
meeting discount code we sold one
meeting without a discount
yeah but wow we haven't had our real
discount a real discount a while yeah
I'll work for Yano for Labor Day Labor
Day was the last real discount yeah we
usually do Labor Day discounts hunter
dollars off no get out of here with you
hundred dollars off two hundred oh wow
no no we gave him a dollar off they
should be happy with that
I put the discount code back it's only
till 3 p.m. if you email in later if you
really before and say you want the
dollar and you ordered before 2:00 we'll
give you the dollar but if you order
after 3 no dollar for you ok we're done
talking about discount codes I know I
had a hundred dollar code all active I
don't know how that got in there it
wasn't for it wasn't for you I mean you
can look at these codes they've barely
been used by any buggin we're done
talking about discount codes but we will
quickly look at discount codes like um
so like you see these are like one
person discount codes they're not like
real the last legit discount code we had
was shirked or you could buy one item
and you would get a shirt that's why
we're out of shirts uh I regret doing
the discount so badly we're out of
shirts cuz we gave them all away for
super cheap we're using a resume we're
using an efficient map it's even better
so save a dollar right now with this
town called live stream one this is a
comic jungle this is a comic e is a
panda jungle a comma key don't plug your
common keys into here my short out your
jumble they're designed to be plugged
into comma twos like that you
look at this comma - this can be yours
for the low price my hair looks bad well
you know guys there's a little something
going on right now that's a little hard
to get a haircut
um big models going pretty well stopping
the traffic lights kind of works there's
a common to overheat not really
sometimes some people are experiencing
overheating where they leave their car
out in the Sun it takes like five
minutes to cool down we're working on
that but it doesn't overheat while
you're driving it's pretty quiet - yeah
all right let's take a deep breath let's
do a few questions well we just wait for
the sales to pour in and people to use
this incredible discount code livestream
or if you're interested in gondii
harness there's never been a better time
you can purchase this Hyundai harness oh
wow that's a lot of sales no no we have
that
got about your office's your back you
ordered a comma key excellent
you're gonna love a comma key it's a
great product chill meditation stream
Tama - yeah I don't know I mean what
else what else do you guys want to see
what is that what is the title about
today we've launched the Hyundai harness
all different kinds of Hyundai harness
just go to the website the compatibility
flow now works first order to Hyundai
vehicles
yeah we launched the comma key which
allows you to unbreak - comma - like
conveniently plugging them in we have
the common jungle it works for the an
Ikea and Genesis on forgetting things I
should tell these things these work for
young guys Kia's and Genesis so if you
have a Hyundai or Kia or you happen to
live in Saudi Arabia and Ola Genesis
these things are perfect for you what
are the best Hyundais I love my 2020
Hyundai Sonata it's really a great car
business is business is booming so we
need sixty nine thousand dollars
yesterday selling pandas we're hiring a
lot of people this year - welcome to the
big year of expansion you see this is
Zuke's
this is ok so that's good if you guys
are interested comedy I slash jobs with
a beautiful office here in San Diego
guys can come join it's a nice office so
nice forgive everybody like you know how
like the tech companies are like
cramming people in it like you get a
little like you get a little desk and a
shared office we have like a real nice
like everyone is like 100 square feet of
space everyone's got lots of space what
about interns a new job posting for
Executive Assistant well that's exciting
um how many employees now we're like 15
we have interns how much is the rents
the 13 km um
how is security considered what how did
you throw me into reading that um this
gender I have more experience work than
Toyota it's similar
I haven't had torque problems yeah
it's a lot better than Honda I'll say
that well I pay for relocation yet we
have relocation bonuses
what about entry-level jobs not really
common to repair program if you're calm
and choose broken they're all still
under warranty it's uh we have a
one-year warranty I almost of course you
like dropped it we don't drop it
but yeah or we also have a 30 day no
questions asked money back guarantee on
anything bought in our store so if you
buy something you don't like it doesn't
work with your car to send it right back
you own your money back do you let your
employees anyone's welcome to work from
home ah but I don't know I mean I like
coming to the office um is it made in
America yeah it's been right in the back
it's made right in the back down here in
San Diego I swear we're not Mexico um
well don't make false claims about
coronavirus we'll get booted off YouTube
I need more data scientists maybe then
we don't like like if you're just a data
scientist probably not but if you can
code well and you want to analyze data
yeah yeah we got a lot of data analytics
we got to do
it'll be more globally targeted I don't
even know what that means you're the
same guy who asked about security
if you're looking for the executive
assistant job we're looking for people
with really like experience in that sort
of role we're trying to grow come a lot
this year
like operationally we're trying to go to
20 people by the end of a year now is a
great opportunity
you know guys you know the old saying
it's like step one become worthy step to
accept power step three rule we're still
working on step one but step two has
never looked more closed so that's
really exciting do we take paypal maybe
I'm not sure maybe you can check out
with PayPal flex raise over no remote
work yeah a flex rate flex rate no flex
right not gonna happen
do we accept Bitcoin no I don't think so
just sell your Bitcoin and you know buy
it with a normal credit card how about
how are sales doing
24-hour bodyguard mean no oppai CVE
if you can find bugs just file them on
issues if you have like a real security
issue you can email me um is there a map
of comma users we are everywhere Wow
total sessions you guys I see you on the
website I see you just thinking about
making up your mind about whether you
want to buy it for another 15 minutes
you can save $1 when on IR any marketing
people get out of here with your
marketing boo boo marketing no flex rate
harness is not for sale
no we were we focus on late ok guys just
look come on our shopping you know walk
on the shop page we'll go we'll do
computer together go on the shop page
and I want you to look at how far we've
come
you know so the what are the jungle and
the key really the jungle is really
replacement for the debug board right
compare this product which is like three
traces on a two layer board to this
crazy thing all right like that's how
far calm has come in the last two years
Mahindra Scorpio guys back huh
who's ever Manning the YouTube can we
can we can we can we yeah change the
order of the products yeah we might
we're gonna change up the store a lot I
think giraffes are going away bye-bye
giraffes nobody's gonna miss you you
were the shittiest product comment ever
made alright Mahindra Scorpio is a funny
joke it's fine um you only said it once
but if you say it more than once yeah
the comic he compared the comma key to
the panda paw wow this is like something
like look at that look at this
engineering this is like look at look at
that caught on the board ooh
it's terrible look at the comma key
beautiful it's beautiful it's comma
crime worth it yeah kind of depends
guys how's that the unde I posted going
we have those who died things posted up
somewhere you only come back down Oh C
or D refer to the image I don't owe you
some one DM me and told me that I leaked
it one of the discount codes there was a
tiny minute when you could have saved
the hundred dollars with a discount code
and then we would have been validated
your order
um can I share that sheet yeah we're
gonna share the sheet will share the
sheet when we're done
are you fund a great journey with Prime
no prob out like Prime is what it is
it's an unlimited the SIM card for your
thing I like it but I don't really care
about the money so you know but if
you're trying to like like penny pinch
and save money conference probably not
ready yet the big thing that's gonna
complicado prime is navigation so the
real reason that we smoke weed at the
office what do you think this is the
what was I saying I got distracted
talking about the Hyundai harnesses Oh
navigation yeah comma crime with
navigation that's right um if you have
come crime you're gonna need that in
order to get navigation to get navigated
an open pilot navigate an open file it's
gonna be like a phone comma experience
it's gonna be pretty cool uh and of
course you know prices only go up oh
yeah we raised a price today we raised a
price today so we used to sell these
wires these harness connectors for $50
they used to be only $50 but now thanks
to the insane complexity of Hyundai we
were actually losing money at $50 so
they're now $100 for all of them you're
not good at any of those can you still
get a job no
best way is to close this stream and
purchase things with discount code
livestream 100 it would be for Honda
John died in that way we have great
stuff for Honda tab I don't care what
degrees you have you're gonna come in
here and you're gonna we're gonna ask
the following question do you say smart
things and you not say stupid things so
as long as those two things are true
you're probably pretty good and you got
to know things right so you know when I
ask you questions like what's the output
space for segments you better know right
what's categorical cross-entropy let's
go let's go
hey following distance your following
distance is just social distancing for
your car's floor gang I believe before
gang chill the floor for bed oh you
always playing with us playing with this
lady go yesterday no support for the
Mahindra Scorpio there are great offline
navigation apps why needing Kama Prime
no not for ours what it's gonna be
does the compa to make sure you're
paying attention to the road yes it does
yes it does it has driver monitoring
even at night powered by infrared LEDs
so I'm number one car makers you look at
to get the best experience right now the
out-of-the-box best experience is the
2020 Toyota Corolla though if you're
thinking for the future I have one we're
gonna work on it really hard the 2020
Hyundai Sonata is gonna be a great car
it's already supported right now for
long offer for lateral its longitudinal
policy is better than Toyota's let's
just say that no navigation in Europe
then yeah probably America only yes it
watches the eyes and it watches the head
position just come from allow remote
access come to cameras in the vehicles
parked absolutely yes so that's that's
in the app when you click on the device
it'll take snapshots it's great you know
my car got totally ago and it was great
get out of here with the hacking and
exploitation stuff
we're talking about we're here to talk
about comma if you cover up the camera
will still work with steering wheel
nudges yes it will yes if you really
don't like driver monitoring you can
fall back to the the Tesla like mode of
nudging the wheel but I think driver
moaning is a lot better yeah coming in
five weeks that's awesome
tell us about navigating on paths like
navigating on autopilot gonna be shitty
here for you everything we're gonna get
better than them because we're sick
crazy machine learning ideas that's
beyond the Tesla house does it check if
you are drunk don't drive drunk what
comments for traffic light recognition
that's the wrong way of thinking about
it will it stop at traffic lights that's
a better way of thinking about it think
end-to-end guys you got a thing fourth
dimensional II yeah you're driving from
New York California enjoy man gonna be
fun drive traffic lights Awards comma
recognition that's enough talking about
right now that's stupid vehicle to
vehicle communication is extremely
stupid and vehicle to infrastructure
communication is only slightly less
stupid except that's what comma Prime is
so make sure to buy comma crime if you
have stuff all right for anyone just
joining the stream today we launched a
common jungle Panda jungle panda jungle
is there a public road map you'll find
some stuff in the github if you look
around is driver monitoring video stored
in the TV not by default by default we
do not record it at all
but you can opt into an optional in
settings but if you just install it
straight up now it's not by default it's
entirely local to device what's
virtually Christine virtually Christa's
are head of communications he is our
head of communications who was the worst
employee you've ever had you really
think I'm gonna answer that I do have
one in mind um
did Andres talk prove to you that you
were ahead yeah yeah we're ahead of
Tesla machine right we're ahead of Tesla
machine learning Tesla is ahead of us
and hardware and obviously have us a
fleet I see this alex work at Commodore
Alex was a seasonal employee at comma oh
by the way you can also use your panda
jungle with a black panda or a comma -
you get so many choices you can even go
crazy you know I don't know where the
wire so here's another one of these USB
fires you take this USB wire and you can
plug in both blind spot integration
coming soon ah you can plug in both a
comma 2 and a black panda into your
panda jungle and you can only unlock the
comma two with a comma key of course the
Panda uses a pan of pong it's all very
straightforward and clear what is driver
monitoring do it beeps or does it tell
you to pay attention to the road it
tells you it watches you and if you're
not paying attention it tells you to
look at the road and then if you don't
look at the road for long enough it
stops accelerating it's all level to man
it's all level two features over
bugfixes boo bug fixes over features yay
yeah we love fixing bugs fixing bugs is
our favorite thing to do to ever get a
ride one of the gimmicks cristinaw ain't
give me all right so you know maybe it
was the scam um yeah yeah yeah we'll get
we'll get those blind spot monitors
integrated that's gonna happen that's
still not gonna be autonomous lane
change it's just gonna block the lane
change if there's something in the blind
spot is 0.5 I would be released to next
week um do we have pipelines we got
big-ass pipeline in the garage yeah how
do we support any trucks I think we
support the Honda Ridgeline is that a
truck yes it is a truck let's see I
think we support the new Ridgeline no we
don't support thank you Oh check out my
large Dunkin Donuts iced coffee
Oh banger free doughnuts even better I
hate to eat dogs yesterday though no gas
pedal disengage will not be optional you
don't get out of here with that Tesla
beating hardware in 2020 I don't even
know what that means
surround monitoring with yeah it
functions dash cam if functions dash cam
it's all integrated with the common
connect app it's pretty nice when will
we get our L to actually work we're
using our out the new models you can
take the lanes out of him and they still
drive pretty well the internet update is
fixed to the nearest six five zero seven
five I'm sorry about that it's fixed but
leave virtually crystals a Honda Civic
but I'm not sure about that you'll have
to ask him yeah so we're coming close to
three o'clock where our great live
stream one discount code expires
it does work with a face mask with
sunglasses just us what hours do I work
non-stop
I heard elan name the baby influenza
musk how does it interact with the
heads-up display I mean I don't know
I've never used this in Ottawa thout I
used it very briefly with the stock
system and the stock system did some
weird stuff that I didn't understand and
then I put in well I didn't put it in be
great hard-working people of kamma put
it in and do I think Tesla could change
the AI approach of coma yeah maybe but
not everyone of that organizations on
board with that
kradic knows what's up how many cameras
did it have this two cameras it's the
comic - so it has two cameras it has one
camera right here looking out at the
road that's solid driving camera what is
my point of an address get out of here
and it has this camera which watches you
the driver monitoring camera what is the
new product okay a new product is really
the real product that you're gonna want
to buy it's not like a super development
product is the hue of a harness is if
you know dye harnesses are for sale
right here there's five of them there's
gonna be more yonder harnesses than
other harnesses that's how crazy the
hyundai ecosystem is we're here we're
supporting it we got you there software
is pretty good pretty generic so yeah
check it out it's a flat the wrong
nobody cares about you um guys I don't
know I think Hyundai is gonna be our top
car soon
what is the coupon code do live stream
one you could save $1 what resolution
you're asking the wrong question it has
way more resolution than it needs we
downsample the pixels you want big
pixels you don't need big resolution so
gonna be a new hardware after you
release the softball so this is 1.0
hardware so we're gonna get the comet to
to go all the way to 1.0 this is why
like we have a one-year warranty on this
product you know the Aeons some of them
kind of broke especially if you left
them in the car comma two should not
break they're really well tested so yeah
this is 1.0 hardware so this is gonna be
this is gonna get us the 1.0 software
what's released except Hyundai harness
if you have a Hyun died you can get a
yunda harness what I merge with test
ah I thought about it a little but now a
new bundle of images you got to figure
out the old ones yeah chill for comment
m'kay
if you guys want to go fill out thingies
go comet and cake who's designing the
hardware right here in the house we got
an amazing hardware team yo good
describe yeah it's a great meme I love
this does it work in right-hand-drive
countries yes it does zero seven five is
going to support right-hand drive it
actually puts in a bit to the model that
tells it yo stay on the other side of
the road we worked really hard on that
it's a toggle in the settings I'm here I
can just bring it up paranoid on my eon
let's go to my eon here and right here
you can just toggle and it says enable
right hand drive that also makes the
driver monitoring look out the other
side too
so it's pretty crazy Hyundai harness is
live W harness you guys are always
asking for the next thing you know maybe
maybe a webby next week we'll do the VW
on us does that mean you guys happy um
but yeah check this out yeah one about
0.75 here that's it right here so just
any yarn did I fix the metric system
option was it broken if it's broken yeah
we'll definitely fix it I don't know I
don't know what broken pencils going
pretty well
that's come pretty well talking about a
new segment one of our car manufacturers
next to be included so let me see the
picture I have a picture and I think
I don't know was it in devil come oh yes
yeah here we go
so guys this here is all the supported
cars we support them all now every
single one in green we have at least one
bottle supported by the car and what's
wrong with the red and what's wrong with
the yellow who knows what's wrong with
the yellow
nope I don't even think Mahindra is on
this list actually I've never even heard
of them why our car harness is $200
they're gonna be 300 soon so I buy it at
200 be like damn that was a good deal no
what's wrong with the yellow ones who
knows what's wrong with the yellow cars
we have the link in the Mazda and the
Ford 10 second time out exactly so those
cars have timeouts so you can't control
the steering wheel for more than 10
seconds at a time
what's wrong with the red ones who knows
what's wrong with the red cars
nope flex yes the red cars have flex
right now flex race supports never gonna
happen so we've actually supported all
the cars that we can that's every that's
this is these are car sold in America
that's like every brand
yeah the business is going to vigils
going crazy you know you guys so I
posted the sales numbers on Twitter
yeah so you guys remember you know
remember when I did that livestream
where we just like uh you know
complained about how terrible everything
was that was our sales numbers after
that how crazy is that I misspelled Jean
dye your meetings right there
and I I spelt it right young died yeah
yellow yellow cars are a week no it's
not even stock diem what's light green
versus dark green um I think light green
we don't actually support any of them
but there's no reason we can't shun died
Sunday I don't know but yeah so you know
things are going things are going really
well
alright everybody hit that thumbs up
button on this YouTube video right now
could we get a hundred thumbs up a part
of it ecosystems not open-source so
hardware is not open source because open
source benefit hardly a hundred and five
well that was so fast open source
hardware doesn't benefit 122 that's
crazy
124 um open source hardware doesn't
benefit anybody except for the you know
the knockoff maker self not really
looking to help them out we're looking
to help you out you the individual
person car companies will start to try
to lock me out oh my god I get this
question all the time Apple tried to
lock me out so he tried to lock me out
and they tried real hard you think you
know this is this is this an egg no it's
in it's in it's in forgot about Dre you
know when he's talking about his guns
people running around talking and saying
 about guns like I ain't got no and
what you think I sold them all cuz I
stay well off what you think I forgot
how to hack you think they're gonna stop
me nobody's gonna stop me nobody's gonna
stop Karma AI we are unstoppable
we're actually I'm stoppable I mean you
know what I mean like they could shut
this whole thing down they could bring
this whole didn't bring this whole
building down they can put me in jail
and comma is unstoppable because open
pilots open source software and you
can't stop the speech you can't stop the
flow of information oh yeah um what if
they put on Ford like lockouts yeah but
it would also apply to them and that's
the
problem and honestly could I figure out
how to reflash the fort yes do I care -
no it's for hire new people
yeah well hire new people they're still
Lincoln for 20 yr people get on commie
and I slash jobs apply can the model
still work without a radar almost we're
so close
we're so close to - ray darkness ah
Oh what if they getting encrypted oh no
where they're gonna put the key oh the
key oh it's gonna be so hard to find I'm
gonna have to dig deep can't I
longitudinal support like next one two
months what about selling your own
powered steering - garages what you can
just buy it yourself it's super easy to
install it takes five minutes a harness
also open-source yetis things are
open-source we posted them all okay guys
thank you all for joining there's never
been a better time to join the comic
ecosystem how many can die harnesses
have been sold
same ones same aah Oh No six-six yun
dialysis yeah how many suru zero there's
no advise me super ten they make changes
politically yeah they can stop me but
are they gonna stop the the unlimited
flow of comas from China but you know
there's no reason to stop me you're here
we're out making driving better we're
I'm making driving safer we're out
making driving kill that's our slogan
make driving kill just the warranty
cover theft no okay you should have
stolen um ask about the window manager
gonna get banned uh we come in other
countries no the warranty doesn't cover
you drop it no you can't drop it but it
covers manufacture defects if you have
any problem and you use it normally then
um we're happy to help you what is uh
okay all right all right all right thank
you all for watching everybody go buy a
Hyundai harness young guys are the new
officially supported cars we support
Honda's Toyota's young guys and a whole
bunch of other a kind of unsophisticated
I our Honda's Toyota's and our latest
yonder you think I would build who did
we build all these harnesses if if we
didn't care deeply about Hyun diet we do
is the car list online yeah commodore
guys often pilot
check it out know the training all the
trainings all closed source the
trainings all secret guys you know what
about the training like we could open
source the training and unless you have
a half-million-dollar supercomputer and
can't run any of it at myself it would
only benefit zooks
and you know Wow Zeus
[Music]
but comma whoo all right
no flexure will not give any profits
flex raise the biggest rabbit old
flexure is worse than Subaru
yeah actually those are really nice cars
but sorry we're not sporting flex a
Mahindra hi we're gonna look into this
Mahindra Colombo whatever it is does it
work in UK yeah it works everywhere now
we support right-hand drive so we got
everywhere on his Greyhound bus support
coming Subaru works so well but nobody
uses it because like guys think your
average Subaru driver take your average
fee on that driver yeah now we're
talking get in Hyundai drivers today is
a perfect day to get in through the
common community and purchase stuff what
happens 1 million or July we'll get
there we'll get there we'll get there
all right thank you all for watching
they'll never stop us yes the driver
modern filter view does work with the
right-hand drive you don't want it I'll
be Hyundai 500 tota well I hired zukes
employees absolutely yeah yeah yeah
absolutely
if you worked at Suk's and you see the
air on your ways nice this is a cool
company I should rip on Zeus too much
good on them when putting those videos
out and I hope they uh you know what you
want to start being honest about
everything they put those videos out
where they have engineers talking over
an hour that's beautiful thank you thank
you that's being honest you want to talk
about your cruise origin on stage get
outta here get out of here it's the
current year we no longer tolerate that
 a born-again suit just come to come
I come join the winning team for
self-driving cars right here in good old
San Diego all right thank you all for
watching goodbye
uh
official comm ai uh attempting to
install a comma ai device
for 15 minutes
uh well it's uh 30. no well we've never
installed one on this car before we're
fast now like we're so fast on a toyota
but uh
still takes some time on a brand new
limited ram
1500.
um
this is all part of our project to
listen to the users
we're listening to users uh we want to
give you guys what you want
uh
so we can sell more devices
the top consultants yeah on the users
the spokesperson for the users
uh no this is not an ev6
uh this is a ram 1500
one of our wait so this is different
from the pacifica yeah
oh that's so lame you think this is the
new one though yeah
even though this is a 2019 car
oh i'm clear
i don't think it's different in the new
rams it hasn't changed
it's different
you know what i think it's 2019.
um
well yeah so comma's about to support a
truck uh if you do get this truck make
sure you buy it with the acc trim
i believe it's called like
active safety something
uh yeah so
wait googling how to take the trim off
no i saw a video yesterday i gotta find
it again oh
maybe we should make videos for the
different cars
okay i'm just link to them we already
have that youtube stuff set up on the
compatibility flow oh that'd be nice
yeah an install for your car yeah
yeah um but yeah so this is going to be
comma's first truck
um it's got a 400 watt outlet here
got usbc ports
oh that sounds like progress
oh or snapping
who's in the car does everyone wanna say
who they are
yeah we're we're all we're here we're
vehicle researcher
um we've got a whole bunch of vehicle
researchers here
yeah we we just purchased this brand new
oh
we just purchased this brand new combat
three at the comm ai shop
we cheaped out at the 250. uh we cheaped
out we didn't get across country
yeah check out the new case the new
injection molded case
super nice
got rid of all those little divots and
imperfections on the last one
the cameras fit perfectly yeah
if you buy a comma 3 today you get one
of these
pretty much perfect cases
all right we have our trim removal tool
set here we're gonna make a red one for
the fourth of july i don't think so
here the ram is basically a luxury truck
all the trucks are expensive especially
when you get the four-door ones
like people think f-150s start at like
27 000 but it's the cheapest f-150 it
has two doors and has like nothing
um so yeah getting getting a super crew
costs some money
uh we made a custom harness for this car
and apparently it doesn't have a radar
it only has four wires on the harness so
we're about to see if that's actually
true
drive it to nebraska what are we gonna
do in nebraska
nebraska's corn
[Music]
um
yeah guys no i'm serious we're trying to
expand into uh
right now like our top tier cars are
toyotas and hyundais
but um we think there's a big future in
subaru and chrysler as well
uh
maybe we'll buy uh buy a jeep grand
cherokee tail
yeah
yeah
and a pacific we need all the chryslers
are chrysler is good
we should get away mode too oh should we
buy away now yeah
um all trucks are luxury yeah
people are happy with their pacificas
because it takes most turns
well so it's on all the pacificas now
it's standard on both the pacifica and
the new jeep grand cherokee
um but yeah common needed to get one
truck
so yeah we got we got a truck
there's lots of hood for these two
popular trucks
uh well i wouldn't go that far well the
fort should be a good platform oh
gm and ford we found out how much money
the government pays them today
boeing and then gm
yup
uh
fast forward an hour that's worth it
fast forward an hour
finally after an hour
wow we're empathizing with the users
right now this is what the real uh
install experience must be like can you
invest in common not right now com is a
private company
ford's naming system for driver
assistance is so bad yes oh yes we have
we have co-pilot
co-pilot
co-pilot assist
and co-pilot active 2.0 oh and there's
the 2.0 and the non 2.0 it's worse than
usb
that's usb-c
speed full speed
what
usb high speed full speed which one's
which one's greater the way i got it oh
usb yeah well high speed is faster than
full speed i know that but then there's
super speed which is faster than
everything
you'll see
this guy's using a screwdriver always
using nylon pry bar
you sure you want to pry
there you go
no i didn't break it that sounded good
actually
should we hype up the rocket league
model merged oh
yeah yo if you're on master i haven't
even tried it yet i have been driving
with torque control though i'm very
happy
i'm too lazy to merge the branches
i merged all the branches this morning
drove on arnold driving on the ev6 with
torque control
and end-to-end long with speed limits oh
yeah we have speed limits now the date
is not that good yet but oh yeah no what
i'm saying is like it's fine to spend
like a dollar of people's prime fee to
get them good speed limits
especially if we can get them not
navigating
steering's better you said
oh yeah did we fix the ev6 steering yeah
it's a lot better
what's wrong with taking the dash cam
mode if we find the last stupid bit
i'm going to work on the cars next week
very cool
yeah the ev6 is going to be in the next
release too
finally after a lot of work
uh
the ram is the third most popular car in
the country
it's up there yeah well the trucks are
one two and three i i don't i don't know
whether there's two or three
i think it's f-150 and
then silverado
uh no i don't read the news
[Music]
i don't know i didn't realize taking
these trims off was so hard
it's super hard usually it's not this
bad usually it's not yeah
oh switch the cam yeah i got you
you gotta look at me
is that it
suspect you can just pull it down
wow those clips are strong wait i think
you got one of the metals in there yeah
that's fine we could take that out yeah
it's there
it's all good man oh i see
oh these ones are usually easier
all right whoa look at this radar
oh the radar is right here
wow
okay so let's take a look is there
really only four wires on that that's
right here yeah there's four wires and
then why is there there's two to the
radar oh no it is the whole unit
no it is the unit
oh so this is not going to output wait
how does this work how are we going to
oh it's only using stock long yeah
ah
there's only four wires on that
connector
only c4
yeah
all right yeah
uh does it have always on power
let's see
oh yeah that's a good point
okay so the hardest part of your common
install is getting that piece of trim
off
once you've done that you connect the
convenient harness uh this one you
actually have to make sure to not put it
backwards because it's not a real
harness but all the ones sold in the
comma shop uh there's no way you can
plug them in
yeah yeah we'll we'll make him good by
the time
all right let's zoom out a little bit
here
let's see
20 plastic cover
all right do we have power we have to
connect the comma power
no
i gotta connect power
silver rock will reach out to you why
there's a second right lighter up there
oh oh also check in the uh in the glove
box there's some like weird uh or spare
parts that look like camera connectors
yeah
i don't know what is this one
i don't understand that it has the same
connector
you can just have people submit their
install for the car and yeah yeah well
we could just put them on the website
it's enough that we can do them manually
high quality
all right are you okay
no blood no blood all right
oh it did snap that back plastic thing
too
no look at the back one
no on the back there yeah
is this something we're not doing right
maybe we should take a look at the uh
tech info
yeah
um there are two pieces of plastic
though
all right so then you connect your comma
power down to the obd port
someday cars are all going to ship with
obdc connectors
and now we should have power
nothing
nothing
the covers are very fragile wow casey
auto doctor those covers are very
fragile what do you mean specifically
the ram one
cool all right great
we got power to our comma three
what's installed on here nothing nothing
brand new device from the shop all right
we just install stock master do we have
a special url for our internals
oh yeah we have a special url oh don't
show them the special url is the secret
i mean no just installs our keys so oh
all right
you can use this it just installs our
keys so it gives comma full access to
your device which you don't want and we
discourage
we're not tesla and we don't want to see
this now tesla got enough hate today i
know hating on tesla today we love
thessal
all right
let's go through the setup huh
do we have a sim card on that one
yeah
oh it's not accumulated oh
oh oh now i didn't go through
fulfillment so we're going to have a bug
where it's like why did this one not
we now have a car and
never too far no
i want my free trial of prime
what is this car this is a ram 1500
and you're getting some of the best
people to set it up setting it up
and it's we're still struggling
never mind it's too hard
ramp cancels
what is the newest supported ev we're
about to support the ev6 which is
actually i really recommend the car i
think the prius is really the newest
important one could you say it was
supported before that shitty steering
the prius oh
oh yeah oh wait wait will you guys
driving the
2017 prius try out uh 0 8 15.
well we made huge changes uh
torque control finally works
you'll see you're the prius is night and
day
we're gonna delight people with the new
release
i was delighted with the speed limit
shame people are happy with your work
eric likes the truck
and i know i'm sorry it's not a toyota
how come installations has to wait 48
hours because
look if you want to mount it and you
want to go for one drive with it and you
take it down that's probably fine but
you really do want that the uh adhesive
to cure without weight on it
look is there any way around this
yeah what it's just gonna
have these solutions you can put them
they have solutions yeah yeah
for the tape yeah yeah
oh we use it in the place always using
the tape of the plastic yeah yeah
especially use a bonder yeah
well we'll damage your windshield if we
do that yeah it's gonna stick a lot
stronger i think there's a removable one
too right
yeah there you can you can use chemicals
and
uh 815 is only for comma 3 yes
all right you want to go here you want
to install custom software
oh we have
openpilot.internal.com
it doesn't get you anything guys don't
install it
what is our url for master uh
installer.com
rumor comma 4 is coming out in november
i promise you it's not the next device
is called the 3s uh it's not coming out
this year and it's not really an
improvement over the three except in
manufacturing cost
i know you guys don't believe me when i
talk about new hardware anymore but
that's all true
ah
do we have a branch with the ram stuff
built in red panda on trace that might
happen
oh no but that doesn't have the ram
stuff
if you put up a bench on
on
something yeah
yeah
oh the common bots coming soon yeah you
guys we've been testing out the knee
and we got some we got some actuators
for arms this morning
but no arms are on hold we're really
just gonna sell the body and the knee
for like a year uh until we make at
least i think it's 250 so we sell 250.
so we we need to make 250 grand to uh
make the body project uh
we already beat elon elon put a guy in a
thing dancing okay
and gave vague promises they're going to
show it off at ai today again i heard i
heard the speed limit will be ready is
speed limit just pulling from a database
yeah it's pulling from map box and their
database isn't great uh we're definitely
not doing gonna do sign recognition i
can't even do that as a human um
nothing how about selling dancing people
on stage
uh you'll wait till the comet 3s plus
pro comes out
okay
uh no the commentaries are really good
the cover too sucked i can say it now
guys it was a phone and a 3d printed
case what do you expect
i mean they were good for what they were
they they you know they they didn't suck
compared to the eon
and the neo which managed to suck even
more
uh
no the the model does not run on our
server don't worry about that you think
you think it's uploading to our server
when can we see comma four there's no
plans for a comma four there is honestly
no plans for a comma four
what would we even put on it
we got to figure out how to make devices
cheaper
plans for zero nine the taco toggle
this one is almost should we just call
this one zero nine
i mean we're close to the taco puzzle
we're close to the taco taco yeah the
taco toggle is gonna be uh the big thing
with zero nine zero fifteen is still a
revolution though 0-8-15 torque control
on the optima is incredible
uh
0-815 is
shaping up to be yeah the nicest release
we've done in a long time
temperatures are going right down off
our power's gonna go way down
are you trying to get that clip out yeah
once this goes on we're never taking it
off
which cars can we do just over the obd
porn
yeah you want to merge master into that
control yeah
are there any cars we can do over just
the obd you have a bolt uh yeah i think
so volvo uses the lvd2 harness i'll use
the obd2 harness yeah of course oh wow
if that's the install yeah oh that's a
really nice install yeah
we use the obd200 we use the long usb
cable no but i think there's some other
astm
yeah they have to like take off yeah
it's not that great i wonder if on any
of these cars like i wonder if that one
can bus is uh
do we still need labeled data for dm yes
please go label it and comma pencil we
appreciate you
should we just close it at 1509 it's
gonna have full frame dm
it's a big release
it is a big release but is that
multi-line
it's gonna multiply
well maybe love the taco toggle too
i mean have we just tried the taco taco
yeah
not that great it's not that great
no a deep that was the bug
that was just a bug we weren't parsing
the model outputs right
i've never used end to end long
but maybe the next rev of uh rocket
league model will just work hopefully
you think arm is going to be running ai
mostly in the future whose arm
oh like arm chips yeah bro risk
architecture changed everything
does it take so long to install
we're not close to wi-fi oh
so can we put the download speed
yeah yeah
on the installer
yeah let's file
someone want to post an issue about that
if there's not an issue is there an
issue all right great oh we're not here
you want it in the act
i want it everywhere i hate just a bar
it's like what the hell is it doing oh
my
basically i know but still
it's not that hard to write
uh problem with using phones no the
problem with using phones actually the
variety in cameras is not the issue with
phones the variety of cameras is not
really an issue at all like we thought
it was an issue and it used to be an
issue with the old model but we do so
much augmentation now that you can like
put the dumbest camera into the open
model as long as you get the intrinsic
somewhat correct it'll drive
the problem with phones is twofold
um
one
uh they don't have the right cameras
uh so
the road facing camera is okay the dm
camera doesn't have any infrared uh and
you don't have enough you you really
need the full 360.
uh so phones don't have the right
cameras um phones also don't have the
reliability
uh
even good phones
you're not you can't make a phone run on
the windshield and expect it to not fail
every year
a lot of this is because they do not put
the heatsink
right on the
processor the processor is on the other
side
okay we're reinstalling a clip
imagine the future you could just dock
your phone and use it to drive a car
yeah i mean you could i think that
you're gonna you're better off going
with things that look more like common
bodies
um
as long as cars are still designed for
people i mean someday they won't be
designed for people but
you go back on
yeah somehow
ways to make comma cheaper
well no i mean we can get down to the
price of phones uh
would i recommend the ev6
yes
you have to buy a red panda too though
[Music]
it all fits nicely on the cover though
so it's not too bad
on the ev6 if you spend like half an
hour i think nicely as a
if you don't have to put it in there
it's nice
it's a lot nicer with it inside oh did
we fix the usb do we hack around the usb
thing so we don't use that rgg cable
no
you just get a long otg cable though
why can't we just make walkable cities
guys stop trying to change the
environment for you change yourself for
the environment you'll be a lot happier
uh ridgeline we don't have a ridgeline
we have a ram 1500. what is the honda
trucks like tiny yeah the original is
tight but we do support it
we just support it yeah
and it probably has uh you know 0.5
torques
we now have a system for measuring
torques
three is the maximum legally allowed
torques uh according to european
standards so a few cars have more than
three those ones are the only ones that
are gonna be limited in panda everyone
with less than three
um you're allowed three torques and five
delta torques oh there's a new mdx
oh the airport
is so important
sell you a mirror mount no no you can't
sell mirror mounts nisha yelled at us
for mirror mounts
you don't do paramounts
um
i mean if you really don't want to see
it just put it up uh
just like shove it all the way up look
at that screen
all right guys i think that's a youtube
video
uh that is a common ai install in a ram
it turns out it takes more like an hour
because we've been here for 25 minutes
and we still have another like
you know the common power is pretty
nicely done
um but yeah
uh we'll update you guys when the ram is
driving they should get into zero
fifteen which might be zero nine as well
uh any last questions
um make sure to buy a comma three today
tell your friends to buy a comma three
uh the toyota's a lot easier to install
yeah it's true is it hot in the truck
wow it's pretty chill san diego
yeah under a nice tree longer tree in
the shade
when is comma coming to rwanda i think
we shipped to rwanda
do we ship to africa uh the countries we
don't ship to are north korea and russia
we have blackness and iran
from iran
shipper maybe but no we don't ship
products to north korea iran or russia
we actually might not ship to china
anymore
oh yeah no china no china china's out
too look it's not because the other
three countries uh
china it's cause addresses are weird
libya
oh yeah no sorry libya
i don't know i've never like i've never
like
i i don't know anything about libya or
syria i've never considered going to
those countries
um
can we train it we drive it without
training it in rwanda probably okay
your roads look like decent if your eyes
look decent yeah
well sure i mean it depends where you
are in rwanda if you're in like rural
rwanda i don't know it's like a dirt
road i don't know a comma really works
on dirt roads if you're in a city i'm
sure it works
how powerful is the next comma going to
be it's not about power it's about the
software
if we devoted the whole company to
making everything work on the comma 2 we
could run everything on the comma 2.
we could sell a 10 adapter lens to give
you more
uh view forward
right that thing has a ton of uh
but you know you got to move forward and
that's why we have the common three
um
it's all about the software it's really
all about the software the comma two can
probably drive a car
uh better than a human with like if god
wrote the software
i was like thinking if god wrote the
software how good could it be oh like
software is so far away from how good it
could be
uh when will common come in a car
company's car package i'm not involved
with that that sounds boring
you're shipping rivian to brazil uh i
think we can run it
do we work with reviews
dorians have eight bass i think they do
how many ribbons are sold
oh not that many
four ribbons hey that's still hey four
rivians are still more than the two
lucids that shipped
uh we could support all these cars it'd
be pretty easy i think
we should support tesla soon
as model three yeah
oh you got it yeah oh
yeah
[Music]
um why don't we advertise because
advertising is for losers
ah
no seriously why don't we advertise
because like when i want
don't buy it you know you should buy it
and look you're watching an ad right now
look i'm an ad guys i'm an ad hi
uh can you put it on a tesla yeah we're
gonna dead
we're gonna put a arivian driver plus
isn't great at all oh you should try
comma
um
yeah waste the money advertising i agree
uh no we're gonna support tesla i think
it's really gonna matter for tesla once
we get more some fsd style features
because like why would you spend 10
grand when you can just buy a comma
three and get like the same features and
i think the highway stuff's actually
better
it's probably already worth it on a
tesla without the fsd stuff yeah but it
won't sell as well right like there's
not many people who are going who ha
because autopilot comes with all the
teslas
yeah but someone mentioned comma going
bankrupt uh no bros it's true that's why
we just bought a new 50 000 car we
decided to you know
go out and style
in our ram 1500 yeah we have 1500 that's
right
um
now we're moving to a big new office
uh
kama's not profitable that's all i said
uh but that's just because we're
spending money on lots of stuff
no
wait did you what do you say
well what before that
oh forgot it was something i had to come
back to when i remember
oh uh
yeah oh is it already worth it on tesla
no i don't think so like autopilot's not
that bad on the highway no but there's
no wheel knight i think there's a big
value out the wheel nag is nice
um people love resumed spam and i think
the wheel mag is just like a way worse
version of that yeah
uh would we still consider ourselves a
startup yes
in many ways go full open source what do
you mean by that like the hardware open
source hardware helps uh chinese clone
makers and chinese clone makers
uh and that's it
we were profitable in the commentary
yeah we were quite profitable on the
comic tale
uh we were a smaller team the comma two
had higher profit margins than the comma
three
how was the funding coming along for
toyota are we getting more votes today
nixon check on the votes right now
um
how are we gonna face challenges with
security locks oh my god you guys
uh actually no all the cars are gonna
become secured and then calm is just
gonna have to close
yeah i don't know what to tell you
no no more no more oh you guys better go
buy votes you want us you want to see us
crack security go buy votes
what's wrong with chinese clone makers i
mean nothing we're fine with it we're
just not going to help them out like we
don't have a problem with them but
there's a difference between not having
a problem with someone and like helping
them out
um
right like we can't we're not going to
spend the r d and then just have clone
makers make exactly our stuff
uh can you order an empty case you can
go in our case
why can't it be cheap or well it's
expensive to make uh yeah someone in
combat just bought a tesla
uh so we're gonna support it i mean you
know he's gonna get fed up with the
wheel nag pretty soon
we can't drive you guys
why can't he drive it
in his home
oh
what are my thoughts on blue box well
it's not real
like you can go give them money well
they just posted a video
wow
no incredible video it runs the model at
like 2 fps oh sweet i don't know why
they didn't just uh it's not even a car
they could have just did this on my pc
it looks like it's doing inference on
the device they posted a video of the
model running yeah
with the shittiest ui you've ever seen
oh i saw that on discord yeah look guys
if blue box is fine i like blue box i'm
rooting for them i'll tell you a few
things about the blue box though i have
a prototype
um
and
it has a two dollar camera sensor
uh
you can clearly see this in their video
too
yeah the camera sense that the
omnivision sensor in there costs two
dollars
like our camera sensor is what 28 now
it's even more our camera sensor is like
35 now
right we spend more on lenses than blue
box fans on camera sensors so like
there's a reason it's expensive like you
can buy something cheap but you know
uh no i mean it's good and there's
definitely room at the bottom for open
pilot devices
uh you can ask about the body yeah would
the interior camera be used for dm no
the common three one can be used for way
more than dm
uh yes a lot of the silver and bronze
cars can be updated via software i think
we're gonna try to do the subarus and
chrysler we'll see how far we can push
them for this release
rebel science that sounds political my
thoughts on politics are they're stupid
um how much does the commentary cost for
us to build about a thousand bucks
uh not including the cost of warranty
and support and shipping and yeah so now
you see why we don't make money on the
com3
what is that
oh i said we're gonna push up subaru and
chrysler to uh gold for this we're gonna
try oh yeah as far as we can yeah we
should be able to get the
bunch of subarus to gold uh are we going
to be able to get the crystal skull they
can't steer down to zero
yeah we'll have to look into that
without any of that configuration we can
change the eps yeah yeah we'll have to
look into the chryslers but i do think
that subarus are to become gold soon
yeah
add all these nice things like resume
spam
they'll be top tier experiences yeah
should we give a half star if we have uh
acc plus
acc plus yeah we offer acc plus on your
cars i think what's the real value after
people i definitely agree
it's not stock acc it's uh
somewhat uh the onyx tesla tiny grad
pass yeah we're gonna start using tiny
grad to run the model on the
device um and get rid of smp on the gpu
can i explain how the rl driving model
works and why it's the future
no i can't
uh what about honda oh well
we're still installing it's installing
yeah
we should just reverse actually and
we'll get wi-fi uh
that's our car back there use your
attack padawan i don't read the news i
haven't heard that
um
the news is stupid and designed to make
you stupid oh
uh where'd i cop the margiela hoodie i
don't know back up
yeah
what happened oh you want to get on the
wi-fi better yeah
is open pilot training exclusively on
common three data no we're still half of
common today i believe
but that's gonna change really soon
is there any value in junior dev
contributing to open pilot i mean i
don't know you gotta just
what's a weird question man
how much percentage is left on
installation it's done we just need to
like clean it up
that was it that was insulation
if we put the window down it'll get
better wi-fi i think the people should
know we check their resume before we
merge pr's
[Applause]
that's right that's right you got to be
a senior dev if you went to harvard
so if you open the garage you get faster
speeds
yo i put so many access points in the
new office we're never gonna have this
problem again
submit a pr and get grilled for it bro
exactly yeah if your pr sucks we'll just
close it without feedback
if it moderately sucks we'll give you
feedback and
if it mega sucks
if it's oh if it's good then we'll merge
it
there's only one way to know if you're
good at something and that's to try
doing it
it's actually kind of true
uh it does not take this long to install
if you have release
if you buy a comma 3 it's instant uh
it's just because we're installing the
internal branch which it also is much
much faster even on our internal stuff
if you have a wi-fi connection that's
decent which we don't
because the wi-fi is inside that metal
box over there
i think the fax is pointing
up on the garage
it actually speeds them up i believe it
yeah
you have the tech padawan not only do i
not read the news i don't really want to
hear about the news
i'm going to open the garage and see if
the wi-fi gets fast
what happens if you invest in comet 2 3
and later models and come out and you'll
just be able to update old models via
software update i mean sometimes
the combat 2 no more but the comma 3
yeah should be software updates for a
while
we're going to be on this platform for a
long time well
probably it's still downloading we have
no wi-fi reception out here
yeah i'm still going to do sub modules
too
oh we have to it has to specify
kilobytes
is there a comma four in the pipeline no
legitimately there's not
uh what's in the pipeline is a cheaper
comma three but probably only cheaper
for us not for you
uh with silver and bronze cars with
emergency brake have longitudinal
support yeah we don't care about that uh
if we can support the longitudinal we
will the problem actually why they don't
have a compiled longitudinal is a lot of
them don't have radars
oh yeah no it won't stay open
man
uh we should just set it up inside yeah
all right guys thanks for watching the
video i just finished oh
oh oh
oh now we gotta update agnos
oh great hey how come you guys made a
comma three if you said software's
important why not just keep updating the
comma two uh the comma two had a few
problems uh the cameras were not enough
uh to see uh they were both the front
camera was both not high resolution
enough and not wide enough
um we had no vision on the sides of the
car so you did need
360. the other problem with the comet 2
was it was very limited by how much heat
it could dissipate
because it was a phone and a plastic
case
and the third problem was the
reliability they were unreliable and it
wasn't because of anything we did it was
just the phones aren't reliable
uh yeah we'll let it cure for 48 hours
it's not a joke guys like you you can go
for one drive with it but then take it
down otherwise your thing's gonna fall
off after a year
all right
uh i've ended this movie like three
times like the lord of the rings all
right so
uh
yeah rocket league models are all the
future
uh becomes a zero nine model yeah well
once it supports the taco taco you guys
know about the taco turtle red lights
stop signs slow down for turns all in
one toggle the taco toggle you're like
hobbit thanks bro
um
I just want to let you all know that we
have this room here
you see this room look we got a desk
uh we got a desk got two desks right you
guys see Field of Dreams if you build it
they will come this room is a room for
web people you can see that the word op
has been crossed out and we're looking
for web people uh we're looking to hire
two people
um front end back end Azure react
uh
if you're interested
on site in San Diego as usual uh so
we're getting to the point where
disengagement analysis is starting to
matter
uh hello oh my uh we're getting to the
point where disengagement analysis is
starting to matter meaning the dream of
Explorer uh is finally going to be
realized but we need to approve Explorer
we need to figure out we need to give
users a good way of basically labeling
mistakes then we're going to add
mistakes to our data set we also have
another web tool called Cabana Cabana
lets you look at the can buses of cars
look we just need these things to be
good uh with the shutting down of comma
Europe we lost a web guy
so when we lose one we're gonna we're
gonna hire two
uh see we have one we have this desk
here
uh for our for a web guy and we have
this desk here for a web guy or girl you
know we we take discrimination is bad uh
all kinds of discrimination sucks so we
don't do that uh we only discriminate
based on skill uh so you know you got to
have skill
um
yeah that's pretty much it that's all I
gotta say we're hiring for a web guys
see this is the room for web people
connect Azure web and other web I don't
know why this is Rip Cabana but I think
it's because we don't have any web
people
uh so yeah we're trying to hire two web
people uh
we're trying to hire
in the operations uh division we're
always trying to hire uh trying to hire
a head of supply chain uh if you do
reach in for head of supply chain and
you'll have a lot of like
whenever people talk about passion or
things like that I'm just like oh this
ain't it bro uh you know just someone
who wants to be honest and wants to be
uh ruthless with our suppliers
uh
and make sure we could get the best
price on things you know and also like
another thing for how to supply chain I
need someone who knows every component
of a cell phone all right I'm going to
ask you what's on a cell phone and
you're going to give me a list and then
you're like you mentioned something like
flash and I'm going to be like well what
kind of flash right and like you better
know like what you know ufs is right uh
and then I ask you who makes it you
could be like Samsung and SK hanix right
I'm literally going to ask those
questions so but maybe I'll ask it about
other components
uh so you know I gotta you gotta know
these things uh if you want to be had a
supply chain uh we're also hiring an
office manager
uh uh yeah uh if you want if you want to
work here as an office manager uh uh sit
at our receptionist desk
uh you know that kind of stuff
man you're right it is nand that's right
that's right it is an end now how many
LCS is this SLC mlc or TLC can you
please tell me what that is thank you uh
so yeah you gotta know these things
right
um that's what we got uh we're hiring
yeah yeah Cabana and explore are fun uh
you thought managers suck what do you
mean
supply chain head of supply chain that's
that's that's the phrase we're looking
for
uh we're also look if again a web we
know website too I want like I want like
a website so if you're more on the
design side of things uh you could
totally uh work in this room as well
um
yeah we're moving a webflow for the
website uh but you know just some basic
server knowledge ability to deploy
things make them work make them look
nice check for bugs all that kind of
stuff
uh so yeah we're hiring uh jobs at comma
dot AI you'll be given a programming
challenge
uh I don't know if these things work
sometimes you know sometimes we just get
lucky man it's like dating you know you
just gotta you gotta you gotta sometimes
you get lucky man sometimes you're like
wow I can't believe I met this person so
I'm hoping that'll be you uh uh come
work here you can work in room 51.
room 51 can be your room if you're the
first person here you can have this
whole room to yourself it's a really
nice room uh has a great view of the
outside got a window with some sunlight
our old office no windows and sunlight
no office lots of Windows and sunlight
um no no nothing remote we don't do
remote work
um like Elon says you can pretend to
work somewhere else
uh in person San Diego
uh salary ranges from like 80 to 140
depending on how much Equity you want
uh gotta post to salary ranges now it's
California I don't know why we took it
down I'm always Pro posting the salary
range if you're looking to make you know
350k go work at Fang uh if you're
looking to write cool open source
software I can work here
uh no no no no no no no no I'm parking
extreme
um
oh we have some very exciting
announcements of the body department
they might have to wait for CES though
uh C plus plus lib torch
uh coming from
yeah I mean look it's not really here's
the thing like we don't really hire
programmers much based on language uh I
don't really care about language you're
good at programming's a universal skill
you'll pick up any language uh pretty
quickly uh so yeah we're not gonna
um regardless of what
language you are good at apply uh and
you'll be asked pretty generic questions
about computers and how they work
uh yeah comma's expanding we are we are
um
a large corporation now
uh
uh yeah
that's it we're we're getting harassed
by a patent troll
uh that's happening uh you know it's
just like man I'm not someone you want
to mess with like really
uh but you know we're gonna we're gonna
we're gonna we're gonna do that right
um how do you guys feel about patent
troll awareness week it's probably the
first time I've said it but I I think
that it'll be a a good event we'll get
some hats that say never settle you know
how many you would buy a never settle
hat
like some nice some nice never settle
merch
um
but yeah we are hiring Two web
developers one to sit at this desk and
one to sit at this desk and whoever
comes here first can move this TV mode
we probably have a TV in here too we'll
probably set up a TV with some metrics
I'll be pretty nice you got a Zuckerberg
you know what I can't say that anymore I
can't say you got a Zuckerberg because
look at meta stock oh man I lost some
money on that too
um full self-driving timeline soon soon
uh
uh yeah there's one plus this tagline
all right thanks
um
uh uh no it's a generic phrase never
settle
um
what was I gonna say oh when is full
self driving coming we're working on it
uh we need better testing you know it's
all about testing and testing starts
with uh being able to annotate a lot of
mistakes uh so this is what the web team
will be building
um data Gathering
uh yeah our slogans made driving chill
I think we gotta we gotta stream for 10
minutes in order to hit the YouTube
monetization
um what's today AI day yeah we'll see
let's see what tells us to say
uh
we're not really hiring for if you're
really really good
um we'll hire you for research but
that's the hardest division to get hired
for if you want to get hired for open
pilot uh contribute things to the open
pilot repo and if you want to get hired
for the web division just reach into
jobs.com.ai we're also hiring an office
manager and head of supply chain
uh for office manager I mean that's you
know you're an office manager you know
what that is be organized be
conscientious all those kind of things
uh for how to supply chain know all the
components inside of a cell phone
absolutely we have paid internships
um
the thing about the paid internships is
it's only well
no if look if you're good you want to
intern here oh it's similar to most tech
companies
um but the internships are our working
experiences not learning experiences I
mean everything's a learning experience
too but uh you know we had one intern it
was a bit of a confusion you know wow
you go to work
uh you hear the prettiest value
you'll buy a comma 3 of Tesla mentions
comma I don't think Tesla's going to
mention comma
yeah comma three is uh by Common threes
if you haven't bought a combo three yet
by a comma three uh you know before the
price goes up I don't know if the price
is going to go up but if it does you
know you'll be like man I bought my
comment three before the price went up
that's how common two people felt
uh
cool that's 10 minutes thank you for
watching the video uh jobs.com AI uh
come work here uh
we shouldn't really do visas for interns
anymore we might still again again look
if you're good enough everything can be
can be worked out
um I have met Elon
uh zero nine this year this year's
Anna's gonna be this year uh best car
for comma three
probably uh I mean the curl is very good
too
uh should we do ads should we should we
start advertising for our products no
not yet not yet we gotta we gotta lower
the cost we're working on lowering the
cost and one of the ways to do that is
we're hiring a head of supply chain
um you have end of the year in your
Tesla bingo today no no zero nine by the
end of the year right uh solving
self-driving is going to take another
four years
uh you know it takes 10 years it's gonna
take 10 years uh we've been in business
six I think in about four years we're
going to be like yeah you know what guys
we kind of saw self-driving uh so there
there's a real estimate on when
you know just extrapolating some Trends
been reading a lot of papers dreamer V2
Iris
um the the dream of learning a driving
simulator if you read comma published a
paper in 2016 uh if you read that paper
that dream is finally becoming possible
uh five years later like five years
later people are actually starting to
make architectures that look like that
autoencoders work Transformers work in
2016 Auto encoders were like look we can
generate a five from mnist
encoders like bro stable diffusion uh so
you know they're a lot better
always azure because they give us the
most free money
uh
uh Google gave us no free money AWS give
us some free money and it actually gave
us a lot of free money so we went with
Azure I like free money you know that uh
we don't have any free money anymore we
actually pay them so we don't work for
them right I think actually it was
actually probably worthwhile there are
total lifetime values of customers
probably uh worthwhile are we buying 40
90s yeah maybe you know we buy h100s or
whatever they're called right
uh well actually if anyone finds any
blower 4090s I'm very interested
um one of the problems is the only 40
90s I've seen are these massive three
slot non-blower ones
uh so we need we need two slot blower
4090s
or we might have to transition to water
cooling
all right we have 85 people here we've
already kind of gone over time uh this
was just supposed to be quick to talk
about how we have one desk here and one
desk here and we will get chairs as well
uh we're doing another Comic-Con yeah
maybe you know it's a lot of work maybe
we can do it right here at this
beautiful office
uh yeah we'll water cool the gpus I mean
they just draw so much power now too
common needs AI day and Comic-Con was AI
day go watch all the Comic Con
presentations we explained everything
we're doing
you know
the truth is I don't even do that much
here anymore oh yeah check out our UniFi
um
I don't really do that much here anymore
I'm like it's already all figured out
you know the whole plan's figured out we
just gotta like
slowly move forward and fix all the bugs
and then one day we're going to be like
oh my God we solve self-driving cars
right remember that time like it was
like go right like it's slow and there's
a lot of pieces to it you got to make
them all work and you got to fix all the
bugs and then one day
yo we still have to go and it's gonna be
like that fish self-driving cars
um sounds like I'm the current supply
chain head uh
uh I do play chess but I'm only like a
1200 I'm not that good
uh
what is going on with comma points
nothing what's my main role head
cheerleader it's been that for a while
um
yeah we have one desk here
uh and one desk over here
uh to come work here and work on web
and yeah I mean like I said the point of
web is to allow us to uh
really start to annotate our data with
with the release of zero nine uh so you
guys know what zero nine is going to
have right
um first we're going to push the
software and boom level four
self-driving cars I don't say level four
anymore that just has to do with
liability bro ask about common points
again and get banned uh
uh all right all right all right all
right we got Fanboys man Fanboy alert it
was a class on
ah
God the only Fanboys watch this
I'm collaborating with a car
manufacturer oh my God my plan is to
solve AI okay first self-driving cars
then AI
uh
uh
first self-driving cars then AI
uh a web Tech stack
it's react uh I think it's the kind of
stuff I'm least familiar with I mean you
can look it's open source you can check
out Cabana and explore on our website uh
do we use scrum I don't really know what
that is what like some some agile or
something like that no we like you know
you
we have very small teams who work on
each project
uh uh yeah I like the sweater
AI on what I mean look I want to build I
want to build a person
right I want to build like I want to
stand next to a person I I know it's
react yeah I don't know specifically
more than that
um
is it typescript I don't know
um it's not that different
what will I do after self-driving and
robots but there's nothing else we're
going to solve AI
the AI person thing is whack why do you
think that bro how about an AI dog what
if we start with an AI dog would you
like an AI dog
I want to be God look we're gonna yeah I
want to solve AI right
I mean I wanted to solve AI since I was
15.
and like here we are it takes a really
long time to actually do anything it
turns out
but uh yeah we're gonna do it
longevity and biotech they think about
that is you just have the AI do it for
you uh does a comma Model come with
pre-trained features what do you mean we
propose all the way to open source
can use the weights comma Dynamics yeah
yeah yeah no I'm serious
um all neural based on device learning I
wrote some blog posts about this
um no no that's not the difference
between a dog and AI person the person
has like
a 100x the compute of a dog 10x at least
why do I need to sell my soul to VCS man
our our rounds have been increasingly
giving away less and less equity for
more and more money look the truth is
not that many people are actually doing
things in the world
when we release like you've seen how
good the comma 3 is right you're seeing
how good open pile it is who can I how
many teams in the world are capable of
building things that are that complex
and making them work that well not that
many
um
so yeah I mean there is a myth about
like
that you need you know why someone said
this on Twitter they're like uh in order
for comma to succeed you guys are going
to need uh
hyperscale you guys are going to need uh
tons of investment this is a capital
intensive business it's not a capital
intensive business this is completely
wrong
um was solving go a capital intensive
business it wasn't right solving
self-driving cars is the same
it's it's a the code Carmack talks about
this the code for AGI is probably going
to be like 10 000 lines right uh in the
realm of where an individual can write
it even
um now I think it's helpful to have like
testing and uh support from a team
um but I don't think that team has to be
very large I promise you it's under the
Dunbar number
uh so yeah
no I don't think you need some I do not
understand how these tech companies have
thousands of people working there
like you look you take like a stupid SAS
tech company and over a thousand people
work there and you're like what do they
do all day
um I don't know Ma po algorithm
what do I think the algorithm will be
um
like I like it's probably not something
we exactly have a name for now uh you
know it's gonna be soft actor critic
version nine
um I mean these concepts are going to
exist for a really long time the idea of
like a Dynamics model and a
representation model and a policy model
are we bottlenecked by Hardware no not
really
I mean better Hardware is always nicer
and you can pave over this is I mean the
same thing was true in like graphics and
everything with better Hardware you can
pave over crappier software
um the better the better the hardware is
the less efficiently you have to write
things the less close to the edge you
are so this will get easier over time as
Hardware gets better but are we
bottlenecked by Hardware I mean like not
really
you know it's all just uh
it's all just a slow and steady grind
forward right uh like you think you
think about what was done on the old um
end-to-end longitudinals coming to the
common three
uh
and yeah I mean you'll say
intelligence people's gonna be crazier
than that lateral you're not going to
believe some of the things it does and
you know what no one else can believe it
either because like you can code a
pretty competent lateral policy you
can't code a confident longitudinal
policy
um
I mean I was going to end this stream
but we keep getting more people can you
tell your friends come work here
like who thinks we're gonna win
who thinks we're gonna win
who thinks we're gonna win AI
thank you
uh right yeah
I mean let's start if I solving
self-driving cars right
uh was an example of something anti-line
screen will do that's surprising well
like humans break very differently for a
stop car to red light and a stop card a
green light
all right
um no we're not releasing the 3D printer
files for the capital
uh don't fold and you will eventually
right yeah just slow and steady progress
yeah I mean we have to we'll pass Tesla
at some point I think
um yeah exploring Cabana needs some new
designs I agree
[Music]
um
you don't but you have a chance well
thank you I mean you know there's a
chance we won't win of course but uh
hiring amazing talents like 10x harder
than fire I think people here are very
smart
um
higher car path yeah if carpathy wants a
job you know I'm not gonna I'm not gonna
Shield him about that
um but yeah if it's interesting
uh will there be a toggle in a17 foreign
that's the definition of zero nine
uh no the device CPU will not be
upgradable where are you from bro the
80s the 90s I think that's only the 90s
in the 80s you couldn't upgrade the CPUs
it was just some weird error in the 90s
in the early 2000s where you could
upgrade like CPUs and RAM and stuff
um there's no age cut off what do you
mean what do you think I'm gonna like I
said discrimination's stupid man I'm not
discriminating on anything but skill
uh what an always-on lcast gather more
data No in fact the only data we train
on is the data from Human driving
uh I would probably only hire two
percent of zoox's employees
uh can I make money from alpha full two
no well I don't want to do that
it's just some like IQ like there's some
supervised like that's one of the more
boring things deepmind did so much cool
stuff and then like Alpha Falls kind of
like
oh we did supervised learning on protein
folding
eh
eh
um I think that's one of the more
mediocre things they did
like yes you can make that work no one
doubts you can make that work the
question is like okay did it Advance the
state of the art and AI
um I mean look Nvidia
I like a low stock price of video low
stock price Nvidia nice Nvidia High
stock price and video dick and video all
right that's just that's just the Nvidia
um you guys know I'm excited for the
recession
is it getting more easy for you to hire
good people over time no it's been
pretty constant it's been the same
um
do you have another chip maker because
I've been quite upset with Qualcomm
these companies are impossible to work
with I think that there's going to be
some good Chinese upstarts in two years
we're talking like Risk five nvdla uh
Mali gpus some licensed GPU uh
maybe tends to aren't maybe I mean come
on Jim you got it you gotta ship the
chip man they gotta ship the chip I'm
happy to use tan storm right we're going
to need more uh neural network
um yeah I think Qualcomm is making some
bad choices uh I think Nvidia I mean
Nvidia might even come around Nvidia
might even come around their new Psalms
are much more reasonable than anything
they previously shipped uh if you guys
saw the the Oren Nano
it's 200 it's on the verge of shippable
um
in the same way stable to Fusion one art
uh photonic why why do I need that
uh
I kind of want to make a chip
not the cut not for the comma form for
the comma five we'll make a joke
so the common for the comma five will
make a we'll make a risk five chip
um a common four we're gonna have to buy
from somebody I hope some I hope some
Chinese manufacturer Rock Chip all
winner uh is like we're gonna make a
serious chip
it's sadly it's getting more expensive
to buy the like the The Cutting Edge
wafers
[Music]
um
open pilot and autopilot are just
different things they're they're
optimizing for different things they're
both very good at what they do
uh
yeah you can you know for people who've
used both you can read there's tons of
comparisons on the internet
I don't know it's just boring to me like
I mean the product's kind of cool like
the product's pretty cool but like
they're real cool things they're the
solution to AI
did you miss a comma three plan oh after
the comma three we're gonna be on the
common three for two more years
but we're gonna be able to come through
for two hours it's not there's zero
motivation here to Port to a different
platform
um
um like there's there's a lot of work to
still do on like newer variants of the
commissary uh that have really just down
costed stuff
where can you buy a comma body at comma
body.com
ship to me
um comma 2.5 no that's so boring guys
every time I think about these things
I'm like oh I'm bored I'm bored you know
you make it man you make it open source
just make design your own Hardware make
it oh it's so easy man just do it
um
no like here's my dream for comma in
like 10 years you go to the comma store
at the mall and you walk out with like
like like a a friend who comes home and
cooks for you and cleans for you I loves
you yeah that's my dream that's my
long-term dream
um
maybe we'll we'll start with a dog
when can you buy a comma body right now
on comma body.com go click buy it's 9.99
Now is it going to cook and clean for
you no don't get your hopes off is it
going to stand there in Balance yes if
loaded appropriately with software and
paired with a comma three
ah all right this has gone on way too
long the yes we're hiring for web this
desk and this desk
um
we're hiring for infrastructure
uh yeah absolutely we're always hiring
for infrastructure
uh Greg's very picky about who we hire
for infrastructure uh you know really
really
uh Senior People ready to ready to hit
the ground running
um so spend money on weird scary robot
yeah
come a body with an app store for all
your household choice but I won't need
an app store you just teach it you know
on device learning man
um EV trucks no we just we're pushing
any of these we support the bolt now we
support the ev6
ah
I don't care about iPhone security
anymore
it's the nation-state
solve AI yeah that's interesting
it's kind of the only problem with
solving you know
I mean everyone thinks about it really
kind of says this what what else is what
else is really worth solving in the
world
um
AI
well yeah and of course it'll love you
you know everyone needs a friend man be
a therapist it'll listen to your
problems right that's that's where we're
going with these things
all right all right now that we've
gotten through investment advice thank
you for watching the stream we're hiring
two people for web a head of supply
chain uh an office manager and look if
you can convince me you can do something
else here to add value I'm interested if
you want to work for free you actually
want an education uh and you got to pay
for that and we don't provide education
but if you want to come here get a job
we pay you you do work you increase the
value of the company capitalism all
right thanks for watching bye guys
what up bros
all right we'll give people a little bit
of time to to to come in here
we have a real um you know how we don't
talk about ty on this channel
this stream is the exception
let's wait for a bunch of people to get
in here
hello what's up uh we'll be chill about
who can talk to
uh yeah it's pretty good hello
what's up
uh we're going to talk about calm ai and
in just this stream
um this is my last day in
in new york uh
this is my my last day in this apartment
um so yeah
i'm uh i'm going to go
back to comma i'm going to make models
train fast
so
maybe we'll start with
uh
we'll start with a a open ai post about
gpg3 scaling
um does this paper go into the actual
scaling curves of it
uh twitch hasn't gotten back to me yet
about whether i'm a partner or not
uh
yeah so this these are these are
winograd schemas
um by the way if you don't know what a
winograd schema is these things are
really cool
um
like where's the where's the classic one
yes
uh the councilmen refused the
demonstrators a permit because they
feared violence
who does they refer to
[Music]
um so the they here
refers to the the city councilman uh but
then if you change the word from feared
to advocated
uh the council city councilman refused
the demonstrators of permit because they
advocated violence
the they refers to the demonstrators and
there's no way
by doing sort of technical analysis on
that sentence
um that you can say what they refers to
you have to have a a a semantic
understanding
you have to understand that city
councilmen will be more likely to to
fear violence and demonstrators would be
more likely to
advocate violence um
it's not about common ai we're talking
about self-driving cars
um so it's interesting to note
uh how well this scaling works and it
may be just
a question of scaling up language models
to get things that even pass the tiring
test
um so the question
is is the same thing true about
self-driving cars
let's see how many let's see how many um
how we doing on 295 okay
somewhat decent we'll get started in in
in a little bit
um so yeah i mean just
scaling is is unreasonably effective and
i think that the solution to
self-driving cars
is going to pretty much be the same
thing
is going to be designing now when you're
building language models
language models have a very simple uh
loss function
maybe we'll we'll go back to we'll do
some some vim writers right
um so language models are basically some
form of this
you want to predict uh the next symbol a
symbol can be a character a symbol can
be a word
i'll say let's say the symbol at
position k
given um the symbols
uh 1 through uh k minus one
right so given the previous text so if i
were to say something like the quick
brown right um
and you can you can decide you know
everyone uh and then like symbol right
so what's the probability of symbol
um yeah and people already know it's fox
right what's the probability of symbol
given uh the quick brand
right um so fox is maybe maybe 95
percent
but you know maybe maybe someone's like
making a joke about it
uh dog uh duck maybe if it's you fuckers
you're right keyboard
uh you know we can we can we can give
them all probabilities right
um so this this loss function
is called uh categorical cross entropy
uh it's a very simple loss function and
it's it's mathematically beautiful
so what you can do and what basically
what gbt3 is
is just this really scaled up
i think that right now people are hyped
on things like transformer
it's unclear how much the model
architecture even matters
it's just training on a lot of data
many many data many many params
uh many many many compute
so that's mostly what it seems to look
like and um
you know let's say clean loss function
so uh it's it's pretty cool
so this is the common ai strategy the
comic strategy
is do you want to know how to drive a
car well
so um so this is
language models uh if you want to know
how to build driving models
um it's basically the same thing so we
have the probability of the action at
time t
um given uh the actions
uh from time one to t minus one
right uh now there's a few problems
uh so i should spell that right
categorical
uh so um categorical cross entropy
uh doesn't work right well i mean it can
work
you could think about how to do it but
then you have to ask the question what
are the categories
um by the way you don't you don't
actually have to do this on symbols you
could also have like the quick brown you
know
fo uh and now you know
uh you're asking the question of what's
the probability of the character
given the string and then i think x is
extremely high
uh maybe it's the quick brown four
or the quick brown foul um
but uh yeah so if
for this but the important thing to note
here is whether it's a word-based model
or a character-based model it's easy to
see what the what categories are
um the other really nice thing about
categorical cross-entropy is it's
outputting a full probability
distribution over the space
so fox dog.keyboard
uh you're outputting the probability for
every single word
um not just outputting the most likely
word
uh which which helps something to train
uh so when you're doing driving models
categorical cross-entropy doesn't work
what are the categories
um so and then also well another kind of
related question is what is the output
um so oh let's also ask the question
what is the input
uh so i think this one's pretty easy
it's just a video stream
you know cameras uh it's all you really
need to drive a car
human has two eyes what is the output is
a little bit trickier
so you can go all the way through uh to
controls
so um this is you know multi-dimensional
uh huge huge
you know let's say it's like um 512 by
256 right
uh so that's something like um
what is that like uh
i don't want to do that i don't i don't
want to do the math wrong i think it's
something like um
an eighth of a million uh
yeah so it's an eighth of a million and
actually let's let's give it a bit of uh
let's give it a bit of color
oh let's give it a bit of temporal
contact so let's just round it up let's
say it's about one million dimensions
right
um so the output uh from driving a car
is actually uh really uh how many
dimensions is it
does anyone know
come on chat i believe in you
um so i hear three uh why three
three is it good three three's a good
answer
um so who for the people who said three
what are the dimensions
ah that's better uh
left right straight gas break turning um
so i don't know where you guys are
getting four and seven from and i don't
know about upward and downhill
uh two is the answer i like right um
because gas and break are on a spectrum
right uh so this is the
uh long let's say long excel
and then for uh
yeah yeah or or or speed uh and then we
could have like steering angle
or we could just call it like um you
know yo ray it doesn't matter
but yeah um cars are fundamentally
a it's long in lat yeah our cars are
fundamentally a two-dimensional control
problem
um because you're operating in an xy
plane right um so how do you move
well no that's not exactly true right i
guess if you had a like a kalo platform
in an xy plane
uh it would be three dimensions so i
shouldn't say that but cars are
basically a two-dimensional control
problem
so um why not just output that
uh output the two dimensions
so you run into a few problems with just
trying to do this
um so this is putting the vehicle model
vehicle model in uh end to end neural
network
it's kind of a bad idea because what if
you want to support different cars
you could train a different model for
each car
you could parameterize it um
and then there's another problem which
is like
neural networks are bad at controls
um because they can't search
well at least modern neural networks
can't search so modern
modern neural networks are almost always
just a feed forward pass
um it never backtracks right if you
think about search
search is frequently backtracking so
what we use in openpilot is something
called mpc
npc is model predictive control and it's
a constrained search it solves it solves
a search problem at each time step
uh so
what's the output of model predictive
control it's you know uh
let's call it excel and steer
and the input is a path all right
um the other problem with this is how do
you integrate maps
to you integrate
maps um very very
uh temporal right if you can't just
output the two dimensions at an exact
time
step um yeah so
we have this uh extra thing in open
pilot called model predictive control
and we've decided to operate on paths
and not directly on accelerations and
steerings
um what are the downsides
well so there is more code
but not much else right um
so for people who are trying to build
self-driving cars and operating at a
level where like they're talking about
perception outputs
they're talking about like oh well
there's cars here and there's people
here and there's lanes here
what's a car what's a person these
things don't mean anything um
paths have a very clear physics based
definition
um not much else because
the paths are still
physics based
and with paths it's much easier to debug
uh a question that we frequently ask a
comma is
will what we're building now be in the
final system
um let's talk about level five right
the levels don't mean anything but it's
kind of what comes
is uh will
what we are building
be in the final system uh and we think
that paths
yes but otherwise it's all a very simple
thing to think about
the input to the neural network is
camera
uh the output well then there's compute
right are you all remember this who
watched my stream about this
uh your compute and then you have output
which is paths
right um
so this is the you know neural network
part
uh and then we have this controls part
where the input
is paths and the output for some compute
and the output is uh driving right
cool uh so this part is
almost done
all right um this part is not even close
so we're actually missing one thing
um the control specification is complete
but we're missing something something
else needs to be input into the neural
network besides just the camera
who knows what it is and don't worry i
assume it's a 360 camera
what do you mean by planning
well so yeah you say map why
not radar you don't need radar you
definitely don't need lidar
you don't need depth that can all be
inferred from the picture
what do you mean by driver
ah toonless chan is the closest yeah
um so you ready for
my theory about how to um
let me not do my location
but yeah
uh
so how do you put in how do you put in
the destination uh what's the best way
to put in uh your destination right
wait why can't i navigate what i can't
navigate if it's not from my location
i'm just going to put this in right
yeah i'm just literally going to put in
um
i'm just literally oh you guys can't see
that at all can you
yeah there you go i'm just going to like
put that in right now knows where to go
um so the input is also going to be
let's just call
it waze um so we have to input we'll
input literal waves like how do humans
do this they're literally just taking
ways
so you know we can point another camera
at your car's navigation system
and that kind of solves a problem
doesn't it um
all right so yeah i mean you do need to
put in
uh you know let's just call it a nav
system right
uh so we're gonna integrate that into
the neural network but
even if you haven't integrated that into
the neural network you can still do
a lot you only get a little bit confused
when there are choices
um so one way to deal with this without
having nav
is you can also parameterize this thing
as input camera
compute output well i just actually
wrote that's just path but this one
can actually have multiple paths as an
output right and then you can choose the
most likely one
so that's what openpop does right now um
but you see how this paradigm very
easily scales to integrate navigation
uh so we we
break down the neural network a little
bit further we break down the neural
network into two components
uh we'll call them perception and
planning
um but
here is the here is the thing where we
differ
uh from pretty much everybody else
working in the space
um there is
no human understandable
uh uh state
here right um so
your your your perception and your
planning model
have to be connected by some
if you think you can hand label
everything that connects those two
models
you are doomed to fail uh there's no
human understandable stay here
we can train them separately but so we
have a perception model
that takes in a camera and outputs a
dimensional state vector
and then we have a planning module which
takes in
that one or two four dimensional state
vector and outputs a path
outputs paths uh but it's trained
uh and to end
uh tesla is figuring this out um
carpathia is now talking about this
uh they know they know
um i mean tesla
tesla's probably a year behind comma
on the machine learning stuff uh they're
probably two or three years ahead on the
hardware
um maybe
a little ahead maybe a year ahead on
like the overall
code rigor uh and i still think i still
think they're a year behind on their
data ingestion pipeline
um
so yeah we wrote some really nice medium
posts about this and they they got
they got very little traction uh and
it's so sad
um you know the the the self-driving car
space makes me sad
uh you just see total idiots winning the
day
um something that
uh it's from the same how to drop out
guy
um which is something that made me think
you know okay i gotta
let's put some time back into
self-driving cars uh this
is actually kind of important um
crimson xx mana thank you for gifting
subs
uh so this
i'll link it in chat um
he goes into judging whether technology
is is good or not
and self-driving cars can very easily
end
so badly uh do you think you want to
live in a waymo world where you know oh
you made a racist tweet once
oh yeah no you can't go you can't
transport oh yeah no that's not for you
yeah that's too bad um you don't want to
live in that world right you don't want
to live in a world where
uh a company basically owns uh
transportation or like two or three
owned transportation
oh i gotta worry about my waymo rating
um right
so it's i mean it's already kind of a
problem with uber and lyft
uh oh it's so funny what's happening in
california
you know these idiots deserve each other
honestly
these these idiots deserve each other um
with the with the ab15 these idiots
deserve each other
those those lawmakers who oh yes oh yes
all the worker oh
oh oh shit oh shit ah yeah we're gonna
have to shut down oh shit
um no my business model is not to sell
insurance
i don't know you know what com is a
profitable company so i can
do and say whatever the fuck i want um
as long as we're improving the product
and making the users happy
uh you know
uh i'm not selling insurance fuck that's
just boring
if it's boring i don't do it no that
world's not coming soon
the world is not coming soon um
don't worry about it uh
they're dying and everyone knows they're
dying and the reason you're seeing
hysteria around it now
it's like the last gasps of a dying
animal
um we all know what the future is right
uh the 2020s are going to be a swing
back to decentralization
hey for example like google's dying
right google's dying
um the the the old guard the people who
ran the u.s government for the last 40
years you're dying
look the two major parties in america
have um
been taken over by a completely
different group of people
uh you know
um google's not dying
google has built so much complexity they
can barely maintain it
where was um here i saw there's an
article on tector
uh yeah why there are currently no ads
on tech dirt
um and
actually reading this article um made me
more
realize yeah neocons and neolibs get get
btfo exactly
um
this showed me that you know you know
you should never tribute a tribute to
malice what you can attribute to
incompetence
um no microsoft well microsoft went
through some rough stuff microsoft looks
a whole lot better now
um microsoft yeah it's
they're not uh they're they're not dying
in the way google
um well ibm is a joke
does anyone take ibm seriously anymore
what what is their market cap
i can't believe some someone still
thinks it's worth 110 billion dollars
uh they came up with some joke power pc
chip but whatever
um we're not really here to talk about
that
uh we're here to talk about and you guys
can watch this video in three years and
be like
oh wow you know george was right about
self-driving cars yeah you know i said
the same thing three years ago i'm so
sick of saying the same thing over and
over again
and now like you know everyone kind of
accepts now the hype cycle has gone away
right and the hype cycle's gone away not
because
of anything that's changed i've been
saying the exact same stuff now
for almost four years and it's just set
well why don't the self-driving cars
work why aren't the robo taxis ready
um so i don't know i mean i guess you
really just have to win
uh just build the software
right and then you know laugh in
everyone's faces and then
i don't know like there's something i
think about a lot too like
personally you know this isn't like
going to mars right self-driving cars i
don't think i don't think
matter in the in the grand scheme of
things uh you're just making people's
lives a little bit easier
but what i would like to do and what
i've said for a long time is my goal
with calm has always been to change
culture
um we're gonna clown these people and i
don't know i don't know if they're gonna
learn their lesson i i kind of don't
think they will
um i kind of think they'll chalk it up
to something else just like the ronos
you know
they didn't and i wrote i wrote i wrote
multiple medium posts about that too
these ones got a bit more traction
because it was oh
george hawt's being angry and calling
out people these are my my two posts
about that
i think microsoft and apple will be
around a long time
because they fundamentally provide value
to people and businesses
uh facebook and google not so much
um you want to save lives
don't go outside guys don't go outside
um
it doesn't it doesn't give humanity any
new abilities
ah yeah so so
this is how we we arrange the company
um and i think all of this stuff you
know when i talk about
all the things we build technically the
company structure i want to make sure
can survive until level five as well
everything that's built to comma should
be will this be
in the final system um and i think it
kind of can be
uh so we break we break comma down into
into three
divisions we have the open pilot
division which is responsible
for kind of the plumbing testing
uh releases of this piece of software
called open pilot
so openpilot is a is a glorified wrapper
around these driving models
open pilot will be finished long before
the models themselves are finished
uh so open pilot is now at
i think zero seven eight is about to be
released
um 1.0 is going to be going to be a big
milestone for it um
hopefully at that point we have open
pilot
as like a system uh done
the models won't be done um but openpile
will just be it'll just be cleaning up
it'll be research it'll be but the code
for this
will be written a lot of the code for
research is already written as well
it's just kind of a question of scaling
it up um
well here we have some descriptions the
open pilot division uh builds and
maintains the open pound software which
is an open
source driver sister system used by
thousands of people every day
they focus on safety stability quality
and car support in that order um
so openpilot also uh compiled team also
maintains the panda code
so we have this other project
unfortunately because of the way that we
have to link them
to make it work for forks um
i can't click but we have this other
project called panda
and panda is responsible for
implementing all the uh
iso 26262 checks uh tesla calls it
i forget their exact name for it but
basically if openpilot tries to make
uh a bad request or request would
violate the safety model the panda code
blocks it
um so
yeah that's that's the open pilot team
we now have an office as well in
rotterdam so we have an office in
rotterdam
and an office in san diego uh you know
uh
out of fucking stupid the immigration
policy
you know you have you have people who
are coming here getting paid six figure
salaries and paying taxes you want to
kick those people out you're an idiot
um
so yeah we have an office in in uh in in
rotterdam
uh we have an office in uh
in uh rotterdam netherlands yeah uh
yo i don't have any draws in atlanta
that'd be kind of cool though if i did
um
so the research uh
[Music]
rotterdam i don't know i let i let the
uh
the the european contingent of the
office pick the location of the office
um so yeah uh we were we're hiring we're
hiring for the uh the netherlands office
as well
um why the netherlands uh countries
ranked
uh by personal freedom um
you guys know freedom is very important
to me uh
well not so much for that one anymore
right
but uh terrible
terrible tragedy um
but uh yeah so
very very high on on personal freedom um
switzerland's way too damn expensive new
zealand has more sheep than people
uh australian canada you know they were
right
um but they're not europe uh europe has
a lot of
very smart people
um they actually do better two one
on uh number one number one for personal
freedom look at that
um
so yeah uh before i get distracted more
um so that's the open pile division a
lot of them are now based in the
netherlands
we have the research division um still
based
in in san diego i've been looking into
south dakota for freedom but
um they make infrastructure to collect
data and produce the largest supervised
training data sets in the world much
larger than 14 million samples in
imagenet
um so the current models the ones well
the ones we're about to ship
are trained on one million minutes of
data um
minutes two years so a common
misconception
from even people who are like who really
should know better
um is that oh oh tesla has so much
data oh the data is what gives them the
advantage it's not
it has nothing to do with it you need
data but you don't need that much of it
um so we're trading our models now on a
million minutes of data
and we think the final models will just
be 10x greater than that
10 million minutes of data is 19 years
straight what's interesting about 19
years straight well it's how long a
person takes the drive
right no no no two-year-olds can drive
cars
but 20-year-olds can um so there has to
be enough information there
in order to train
uh no no i didn't say that's why tesla
would get to level five first
um what they have is a rebel they have a
repel advantage
uh it's not just the data and if it was
just data
god you know how easy it would be for me
to scale comma ai
guys if i wanted more data you think i
you think you think i'd charge
999 dollars for it no way if i was data
limited i'd take the vc money and give
these things away for free
but you know i'm not
uh he's talking outside there's always
people talking
um no humans don't learn to drive in six
months this is a myth
so humans are building that driving
knowledge off of all of their visual
priors their priors about objects the
prize about shape
color and all of that stuff driving and
walking are pretty simple to map to each
other
um
there's people talking outside i'm just
i'm just i just want to listen you know
um so
large supervised training data sets um
the biggest ones probably uh in the
world
because the supervision is done
automatically
the supervision is not done by labeling
each frame we do not have
we do not have the the philippines
division
which is labeling all the images uh we
just don't have it okay
and then
the operations division makes the
product the money the website and the
app
uh they gather feedback from users to
incorporate into further versions of
open pilot they design and improve our
hardware
and they ship that hardware out every
monday and tuesday monday and thursday
um is it is it unsupervised uh sort of
so we have another post here which goes
more in depth
um into
yeah tesla has a big data labeling team
data labeling is gonna fail
um we have we have uh
i mean we have some amount of labeling
but it's
kind of more for our mapping efforts uh
at this point
we care less about so these labels um
except for lanes uh our labels aren't
semantic
i guess lanes and roads are both
semantic but the green things
are not labeled green because they're
cars they're labeled green because
they're movable
and movability is a true is if you have
a physics based definition for
movability right
there's three kind of motion frames uh
involved with driving
um there's the motion frame of like the
purple things are literally your car
they stay fixed with respect to the
camera
there's the motion frame of the road
trees all the things that are fixed with
respect to how like the earth
and then there's green things which move
of their own kind of volition
no we just have a github uh people have
been shout outs
pj lau uh people have been helping out a
lot with labeling these
uh we've gotten almost 4 000 images
labeled so far
um well
yeah so the segmentation labels are not
used
the they're used more for um
recovering the ego motion of the vehicle
uh how does your slam algorithm know
to exclude things that are uh moving
like because if you if you detect pixels
on these cars and you try to use them to
recover your ego motion
you're going to have a bad time um
especially with these things too
um depth is less important than you
think uh
like you don't need depth from a single
image you can get depth using structure
from motion
um is it tree movable what if it's
falling down
i mean how often do trees fall down if
it's off sometimes we have outlier
ejection as well
uh so yeah
um this is this is an
output of our automatic annotator uh so
this
all of these labels are created using um
are created by running by running an
algorithm over it nobody drew lines for
each one of those lanes they gave it
like a vague idea of what a lane is
um you need to re-up your medium
accounts we're moving off medium fuck
medium for this
um
against optical flow is poor man's image
segmentation i mean
you have to be depth aware in order to
say that right
like you know you can imagine
this gets into weird stuff where if your
stuff relies
none of our segmentation relies on being
particularly accurate
um yeah i know i know we'll we'll
we'll move off medium uh i'll post my
own blog
you know i'll put github i'll put on
github man
um no there's uh
whatever vitalik was using for his blog
that's that's what i used for mine as
well
right like here
it's jekyll it generates a static page
and then you can host it with github
pages
how good is monocular depth estimation
pretty good now
um we haven't one of these days we're
gonna push on that
uh we can build we can build really good
unsupervised depth nets we haven't
yet for a few reasons uh that are that
are long to go into
but um so
um most attempts making a superhuman
planner involve making a perception
stack to detect certain human
understandable
aspects of the environment such as cars
perceptions and lanes a planning stack
then makes plans based on these
perception outputs
the problem with this approach is that
the planner is limited to only make
plans
on what is described in the hand-coded
perception layer which is doomed to
never be good enough um
here's here's a uh on that yeah the
tesla
is um leverage where carpathia goes into
describing it
when you start if you're if your voyage
and you're driving around the same block
over and over and over again
you think that this approach is is
feasible when your tesla or comma and
you start looking at
just the diversity that exists in
something as simple as a stop sign
you realize that it's never going to
work um
so yeah we believe the most promising
way to make a superhuman planner is to
make a planner that mimics human policy
um a planner that learns to predict the
most probable human policy for every
scenario would make less mistakes than a
human
so the way that we separate the vision
model and the planner model
again is with these a thousand non-human
interpretable features
this is again visualizing what's in
these features and if you notice
the important things about the scene are
kept constant
the position of the cars the position
and type of the lanes
uh where this wall is but then the
things that don't matter at all like
this sign or where the sky is or
you know all of this stuff it has no
information about because none of it is
relevant
to the the driving uh scenario
um and this is i think a huge key
you can't just train an auto encoder to
do this it has to be a task aware auto
encoder
we also have a driver monitoring model
uh
i don't i don't understand well actually
i do know why tesla hasn't shipped it
yet
but uh level two is gonna be here for a
long ass
time you know uh car companies get this
tesla doesn't and waymo and uber and
uh argo's the worst
uh are just so far off the deep end i
mean you know what do you do when you're
in a ponzi scheme what do you do what do
you do you keep digging
yeah i mean you do keep thinking every
because locally keep digging is what
you're never gonna get how are you gonna
get over that activation energy that
hump and be like
shit man sorry we wasted your three
billion dollars uh
yeah you know uh well they certainly are
not gonna start being like wow george
said all these things three years ago
damn i mean what's worse than wasting
three billion dollars wasting three
billion dollars when you should have
known better
mm-hmm yeah
sad sad sad
uh we also have a post here about open
pilot
um written by the open pilot team where
we go into uh
what our vehicle planning model looks
like like i say we're still doing that
path
to um path to action
translation uh classically you can you
can do this classically superhuman um
and there's a whole bunch of advantages
to doing it classically
uh it also lets you reason much more
about like the safety
you can reason about the safety you can
reason about the smoothness
whereas all that stuff was baked into
the neural net the neural net just kind
of says where to go and about how fast
it'd be going and then
the planner uh takes care of the rest of
that why does open pilot work better on
tesla with roads with no lane lines
because you don't really rely on lane
lines
um i mean for this picture we show you
lane lines
because it you know they look really
nice but actually what we're much more
interested in
in uh because people are like oh look it
automatically ground truths and lane
lines wow connor has normal self-driving
car stuff too
um but uh
the mq man the mq uh
you know it's like the j cube but like
it matters
the machine question what will we do
about the machines how will we
incorporate the machines into society
um so yeah
it's really the reason it works better
without lanes is because
uh of the path being uh such a core part
of how we learn am i gonna sell maps and
i don't really care to
um we built all the stuff to build maps
and then we asked kind of the question
how useful are these things
could we scam a company into giving us
lots of money for maps yeah probably but
why do that we don't need to
whenever you scam you give up your
integrity
ah the machines are learning yeah
um so mostly this is a shell stream
uh to come work at comma
uh we're hiring we're hiring like five
more people
over the next couple months um
[Music]
as i've learned from the tests uh most
at least most of you who talk on twitch
uh are not qualified
to work at comma um vips
uh you guys i'm i'm much more interested
in
um i don't care what your qualifications
are i'll give you the same kind of test
we're not hiring any business people uh
um yeah i do hope
i do hope that um
if you're from india we can we can we're
we can definitely get visas
uh maybe not right now for america but
maybe for europe
um we do not do any remote i don't
believe in remote
uh so you have to be willing to come to
either the san diego office or the
rotterdam office
um and
you have to have a lot of skills and
you know really you have to want to
solve the problem you know i think a lot
of companies
come in a lot of ways isn't a company
it's a project after we solve
self-driving cars i'm done
i'm done i don't care at that point what
would i do with money you know i'll
build a college right
i don't build the college with other
people's money at that point right um
we do internships uh remote just
remotes just just people who work remote
wanna slack off
um you're not you're not part of a
culture either
oh yeah we have a rotterdam office and
we have a um
a san diego office uh we don't care if
you have self-driving knowledge
um we're less interested in interns
we're really only interested in interns
if you can convert to full-time
um
europeans can work in yeah europeans can
work in san diego
um we'll put money into getting visas
look i mean
you research it i'm fine with sponsoring
or doing whatever for that
um if you're asking what should you
learn to apply
uh oh cool um if you're asking what
should you learn to apply you're
probably missing the point
so what are we interested in now well so
we talked about how now i want to add
navigation
um so i think we're going to code it in
qt
so if you do you know qt
uh can you build nav
um we have some really beautiful
let me uh
here's a figma of what the new what the
open pilot refresh is going to look like
i don't know if i'm supposed to be
showing this off but we'll show you
we'll show you a little
uh how big is the current team
like 15 people
um
yes this is just like like what the what
thinking of the new open pilot
um yeah if you're not qualified then
you're not qualified
uh we're interested in navigation
putting that in there um how much of the
strategy using the research repo do we
still use
i mean it's not just scaled up um so
yeah we're interested
in in for this is a role for a
navigation designer
do you know qt can you build nav i'm
also interested in a machine learning
engineer
um it says this this is not
ml this is infrastructure
um so
you know if if i told you i want
a 10 terabyte
you know hard drive array
uh and i want to read from it at 100
gigabits per second
right how do we build that um so if you
saw you know i wrote mini key value it's
related to stuff like this but then
going beyond that we have a great
infrastructure engineer handling that
side of things
but now on the other side of that is
okay how do we
scale up our ml algorithms
we're finishing up a 40 gpu cluster
right now
um it's going to be pretty nice uh
they're not very expensive like look
people who want to be paid if you want
to be paid 250
000 yeah fuck off to some scam company
you know
i'm not gonna pay you 250 000 uh if you
want to come and actually you know solve
a problem
well that's what really comma has to
offer uh
perhaps um yeah so
email give me a job at comma ai uh
i'm going back to work starting uh
thursday so maybe i will take calls
with the most promising of you guys
uh no we're paying we're just not paying
000 cash uh we pay we pay
we pay we pay appropriately for the
stage of startup rat
oh no we don't pay 80k
we pay appropriately for the stage of
startup we're at
um
salaries can be discussed after you uh
uh pass the uh the the this stuff
um it's enough to live extremely
comfortably
um it's not an nba thing
uh
it's six figures you know pretty much
all our starting engineers now will get
paid six figures
okay um and we offer options as well
um we offer uh we pay our interns we pay
our interns pretty well
also um yeah we offer options and that's
how you
really end up making money off of this
but again if you're the kind of person
who wants to run business scams
get out i wouldn't let you i wouldn't
let you you know i wouldn't let you near
a comment with a 10-foot pole
um but if you're the kind of person
who's motivated to solve this problem
um our company mission
uh
uh our comma at comma our mission is to
solve self-driving cars while delivering
shippable intermediaries
um everything we do is derived from that
mission and as the narrative unfolds
it's looking
increasingly like we will win alongside
tesla and mobileye mobilize like the
windows of the space tesla's the back or
the linux
what's our interview process look like
for a full stack engineer
uh programming challenge phone screens
and then we do on-site paid micro
internships
i'll got on board talking about this
stuff i don't deal with this stuff the
operations division deals with this
stuff
i'm i'm just here to chill i'm not
hiring for a hammer hammer is a joke man
i'm not hiring for common ai comment ai
is higher
all right like i'm not you know it's not
me man
uh
yeah look can i sponsor a visa i'm happy
to tell the government whatever you want
me to tell the government i'm happy to
pay for it
if you pass the technical stuff i think
it's all bullshit
and uh you know kama will use its
resources to make that bullshit go away
um can you just explain more about what
we're doing right now sure
so the idea
is to scale everything up we've built
something that is fairly end to end
uh we've built something that can output
the new models now
output full uh lateral and longitudinal
plans
jointly um so they jointly tell you
here's how you should drive the car
here's how fast you should
go uh when you do it uh but we need to
we need to scale all this stuff up
how do we go from you know training on
on this much data to training on this
much data
how do we improve the quality of our
data right so we have this automatic
ground truth and how good is it
well it's like 99 good but you know what
that one percent really starts to be a
big chunk
uh once you get into um
once you get into uh the scale that
we're doing it
all right if we can fix that one percent
we'll see our losses in the model go
down
uh so we want to have perfect data uh
shit tons of it
and cram it into huge models right um so
this is the other beauty of these kind
of language models it's like
the data is just web scraping you don't
mess up web scraping
um so uh
yeah this is not ml it's infrastructure
how do we how do we scale up our ml
algorithms
uh how do we make uh all the data
perfect
um yeah these are these are these are
the two things that i'm
person we're hiring for a bunch of other
posts but the two that i'm personally
interested
in in speaking with are machine learning
engineers and uh navigation designers
um like like can you build ways right
open source ways
right basically what we're building um
we'll say like mapbox backend
something that we can switch to our own
openstreetmap if we ever choose to
uh yeah can you build open source ways
that that that people actually want to
use
um do you know react
uh add so the we have like the comma app
kind of the flow that we're thinking
about for navigation
is we're going to go in here
like here's like here's like the comma
prius
it's connecting to it right now that's a
live screen shot from the prius in the
office
uh the car battery's at 12 volt too
that's a little low
um but what we'll be able to say is like
you'll be able to click a button on here
start a new trip you'll be able to
search right here on your phone for
where you want to go and then say send
to the device then the device is like
ready to go
um so add uh nav
sending support to app
this is going to be a comma prime only
feature
um no we don't use anything like django
i don't know what iconic even is
oh they're watching my stream
watching our stream at the office um
[Music]
we don't add support for cars anymore uh
community members add support for the
cars if you want to add support for the
renault zoe
uh you guys can do it um
yeah i think we i think our apply right
i think it's actually harder to get into
common ai than it is to get into harvard
uh i think harvard accepts like eight
percent of their applications i think
coming i accept less
um no most people we've recruited from
around uh like what you say like oh
we're in the bay area
do i want to hire the people who are
like i moved to the bay area so i could
be a thought leader blockchain
influencer
yeah you're not you know who comment
wants to hire um
so yeah i really want i really want
someone who's going to come in and own
this navigation project
this is what elon does when you want
someone good right it's just like he
like tweets about it
maybe this kind of stuff works um no i
mean
a lot more people you filter themselves
out before they before they send an
email to
to to to give me a job become ai oh
harvard's at 4.7 oh we got to stay
competitive no that's a bullshit metric
wouldn't it be nicer if everyone in the
world was just smarter
um
no we're allowed to talk about
self-driving cars now uh
how does the infrastructure engineer
interview look like
what you want you want to know the
questions what you're trying to pull a
hillary clinton for the debates
you know um
woke need not apply i i don't
you're not going to be asked any
political questions i don't give a shit
man
um you're going to be at you know you
want to come here you got to focus like
that's just what it is
um
no we're not open to remote positions no
remote remote is kill
uh it's called osm
and yeah i've looked at them except
they're all crappy
right like has anyone
oh this actually has a surprisingly good
rating
is it open source
huh
wow i feel like i downloaded this and i
was upset by it
let's try it let's download it on my
iphone
the ux sucks yeah we'll try to navigate
somewhere on this wow
it has good it has good ratings though
um yeah i mean yeah we want to write our
own front end basically we want to use
mapbox
i think mapbox can generate nav um map
to gl looks pretty beautiful
uh
yeah no no no no they have like
beautiful 3d looking ones yeah i want
like 3d looking we want to make the ux
good we want to build a really usable
navigation app
uh that we can then integrate with
openpilot
um
we'll pay for mapbox well this is why
it's a common prime only feature
so this covers uh mapbox
api costs
um yeah i think we'll do a good job in
the ui
uh yeah fuck google um google google
maps
google what google did with google maps
as evil uh they
priced it really low they scorched the
earth of all the competition and then
they jacked up the price
anti-competitive um
classic anti-competitive tactic you know
hey hey doj hey you know if you're
interested hey
um
did i interview anyone who passed the
test but in the interview is extremely
unskilled
we do a pretty good job um
to repeat which maps i want to we want
to use i think we're going to build
something custom i mean
there are map box there are apis which
will give you the navigation pretty much
all we need to build
like can you build open source ways from
it let's just say it's the front end uh
the actual navigation i believe mapbox
uses something called valhalla to do the
planning
uh
yeah they hired the team who made it
overall we like mapbox
uh open source routing engine so we can
use we can use this routing engine
we can even use map boxes servers to get
it i'm not that worried about the cost
i am worried about making sure the front
end looks good it's built into open
pilot and we get people to actually use
it
um and then yeah
machine learning engineers who are going
to come in and and
scale up the ml so you know better
scale better data
all right better scale better data
uh why are we building a nav because you
know
we talked about this say here's your
input right if you
if all you have is a camera you can have
to output paths how do i know whether
i'm turning right or going straight at
the light right
um
what's hard about the scale i don't
actually build it right can you build
something that scales the gpd3 size
i think that's what it's going to take
uh
any potential for using audio perception
in cars you ever get that thing in uber
where it's like yo your driver's death
and then they get you where you need to
go yeah that's what i think of audio
perception in cars
um with maps we can beat what tesla's
currently doing
at least last time i use navigate on
autopilot i think their integration
approach is pretty bad
um yeah i mean look we gotta build it
right it's not
no shit we gotta build navigation
everyone knows this
uh there's like some false starts on the
project but you know
there's false starts on things and then
like it's third time's the charge second
time's the charm
we'll get someone good in here to build
it uh
security what do you mean by security
man everyone is like what is security
security is just good software
engineering
uh yqt what else would we use um
i don't want some like heavyweight ass
react html
javascript typescript
transpiler shit no
um yeah c plus plus
that's a programming language uh
tesla uses qt as well
l will be big
uh google maps does not even offer
navigation
and mapbox gives us an approach to move
away from them because it's open source
and it's not that we actually will look
i'm happy to pay i'm happy to pay their
costs if their costs are lower than ours
but it's you're not going to get locked
in the same way you would with something
like google
oh maybe i could compile qt with wasm
self-supervised self-driving car models
coming from mr yan lacoon
uh protection policy under uncertainty
i don't know if you've seen this
how old's this paper
this is an interesting paper learning a
policy using only observational data is
challenging because the distribution of
states induces at execution time may
differ from the distribution observed
during training
holy shit this is super smart
oh my god this is kind of what we're
doing
this just shows you that like no ideas
are secret
you're supposed to train a policy by
unrolling a learned model of the
environment dynamics over multiple
time steps while explicit wow i can't
believe this is a year old and i didn't
see it
um we're doing something similar to this
these are these are the common ai
secrets that you find out once you come
to work here
because this is an extremely hard
problem um
let's see how they're actually doing it
so there's a few problems with this
namely well okay so a learned model of
the environment dynamics
what's your loss function on that um
it's two years old i don't know how i
missed this one
[Music]
uh
it's weird what they're doing though
it's not like
and then how do they make us well then
that's the other question about this
rollout right like you can't just train
straight up supervised
you want to be able to sample um from
the distribution of the future
we have like like this is similar kind
of to what mu zero is doing
um
yeah th this is this is just
this is a very succinct way of of
explaining what the problem is
um learning a policy using only
observational data is challenging
because the distribution of states that
induces that execution time may differ
from the
distribution observed during training um
so this is the there's another paper
that goes into this more
invitation to imitation
i like this one uh that like like
go really goes into depth about this
problem
it encourages the policy to stay in
situations it understands yeah
well we'll have to look we'll have to
see uh how exactly we can we can
integrate into this so
what we've built at comma we've built
basically this um
yeah we built this around the same the
same time horizon i guess
you know like really this this is just a
reminder of something that i definitely
believe
it's that there are no ideas trust me
whenever you came up with the idea
someone else came up with the idea too
um
so we
we do it slight yeah that's not even
exactly true
we do something pretty similar to this
now
we don't have this uncertainty cost we
generate
we generate new ground truth to deal
with the state divergence problem
um and we generate that new ground truth
in an environment dynamic simulator
so we we've built like an explicit
simulator uh
we haven't had luck yet with learned
models of the environment dynamics
but this is another place that we'd like
to take this right so you can think
about
so we have some we have some feature
vector that i think i'm very happy with
so we have this like one or two four
dimensional uh
vision feature vector
um now we have that vision feature
vector you know
um from one to time t minus one
now like you know we want to generate
uh vision feature vector from like let's
say t
to like t plus you know 100 right so i
wanna i want to generate
that um so a few things about this model
i need to be able to sample from it
right not one rollout
uh rollout um the
i mean samples
must come from
uh the distribution
right so given just those two
requirements
i mean like what's your loss function
here
uh and what's your you know sampling
mechanism here
uh it's kind of what makes that stuff
tricky uh just use bert
well see and this this this gets to what
we spoke about up here
which is uh categorical cross entropy
um allows you to sample
uh in a way that this stuff doesn't but
uh
this is cool and i will definitely uh
read more about it later
uh and maybe there's some insights we we
haven't exactly had on this problem
um but for now a lot of it still is
uh like how do we scale up our ml
algorithms how do we make all the data
perfect um we think that
even with our current approach um our
current
approach we'll get to level three
right without fancy
fancier loss functions
uh yeah loss function is the entropy
between the two distributions okay how
do i calculate that
right sure that's great in theory yeah
um i mean this is right so i could have
a discriminator
uh which takes in you know uh real fake
and
uh outputs like kl
level three meaning the system knows
every time it's going to make a mistake
oh that's that's kind of the technical
definition of it the system never
messes up and doesn't know that it's
messing up
uh if anyone would like to bet against
elon getting to level five by the end of
uh i'll take your i'll take your action
uh
the levels are stupid
level is a scam can't roll up to
actually
sorry for money yo yo yo yo real
question
what has more revenue oh sorry not
revenue sorry sorry sorry
burn rate waymo or chandler arizona
think about that it's how many people
are there in chandler arizona
chandler arizona
[Music]
um
okay okay i mean that is a lot of people
but like some of them are children and
stuff
right uh
so then median uh household
uh income well i guess i guess
median per capita
income in chandler does that like
include like
children and stuff wow
peoples in channel are rich but now does
income per capita
oh here we go the total number of
households is that
and the average household income
is that okay
so
six billion dollars a year
right now what's the waymo uh
burn rate 16 billion dollars eh
oh no that's that's that's all of them
combined
um did what does waymo burn i mean i
would say it's comparable i would say
waymo and chandler arizona are
comparable inside yeah
kodak after giving up on photography
blockchain and drugs is now a
self-driving car company
um
what the importance of calibrating your
deep models
it sounds like they're gonna like sell
me a calibrate or nine thousand
hmm
multi-class classification problem
huh oh no i see what they mean by
calibration
this is interesting
this is like the rationality meaning of
calibration
it was cool we'll check out this paper
towel
uh oh by the way if you're interested in
calvin filters check out our beautiful
kalman filter library comma ai red nose
beautiful kalman filters uh i wrote the
c
plus in it myself it's very fast uh now
harold really wrote the whole thing
i just i wrote like 10 likes um
yeah yeah learning about calibration and
checking out the john le coon paper
uh cool like you guys give some good
paper suggestions i'm happy with chat
today
i'm i'm happy with you guys you guys
have redeemed yourself for being
generally shitty
um
wait there's ads in the stream am i a
twitch partner
wait yo am i a twitch partner
i didn't do that
did they make me a partner oh i'm not
allowed to look at my creator dashboard
on screen you guys yelled at me last
time i did that
well maybe i'm a twitch partner
good to see 900 yeah i got that blocker
two bros you gotta get your ad blocker
up you know
um
if a comedy meet on the road do they
fight to show dominance
[Laughter]
eventually some stupid academic is gonna
write like uh
driving is really just a game of chicken
played out many many many times and
that's why self-driving cars can never
exist
and then that's why com is gonna include
in the new versions of open pilot uh
how like chicken are you and you'll be
able to slide the chicken-ness
um and like if you challenge someone to
like the traditional game of chicken
uh you know if you slide the chicken
this all the way up it never
the chicken this all the way down it
never swerves man you know chicken
ah
yeah this is appropriate
[Music]
[Music]
here with the air
[Music]
wow the special effects were bad
all right well that's chicken
you can also play chicken where you
drive the two cars at each other
and then the first person to swerve is
the chicken i think that's the more
traditional
version of chicken that i've seen
uh you know you two cars and like river
and then you drive at each other and
then whoever swerves is the chicken
um why'd they destroy their cars yeah
you know the flint effect bros
all right guys um
i think that's today's stream
from osm end maps oh my god the first
thing it has to do is download
many megabytes
willow rk thank you for for gifting subs
uh yeah but the main moral of this
stream
is if you're interested in a job um and
you want to work on
improving uh our machine learning stack
or you want to work on building our
navigation
uh i'm interested in in hiring you
um and i hope you know i think i think
these things kind of get around
uh like uh
we're gonna win you wanna join the
winning team
um
you know i mean tesla tesla's gonna
tesla's gonna win too if you're
interested in going to work for tesla
you can go work for tesla
come work on ai if you want to be
eventually strangled by middle
management from intel go or get mobile
eye
uh if you wanna like you know
i take down big buckets of money while
doing nothing to actually advance
anything for the world consider a
company like waymo or argo
um how can you apply
uh comma dot ai slash
jobs uh we're working to solve level
three in three years
i think we can do it um i don't say
things like
level five in 2020 also level five in
2018 2019 2020. um level three
uh in 2023 i think is actually an
achievable goal
uh by what we based on what we have now
um yeah
uh tacoma we gotta update this we gotta
include rotterdam
why isn't rotterdam on here do i just
need to refresh better
no rotterdam
um
but yeah uh software engineers uh
ml engineers where's my navigation
designer yeah can you build a waze like
app people will use qt5 um
how new is rotterdam i think it opened
like uh
like a week ago or something it's pretty
new uh
but see do you see that do you see that
federal government
all that happens when you ban
immigration
is now i'm sending a big wire transfer
to europe every month you know
dum dumb dumb
no remote work uh if you're interested
in rotterdam if you're interested in
questions who's managing it you'll find
that all out
uh later we got a uh i don't know if
it's true i
look i'm not going to go into who did it
man it's just fucking stupid
uh you know you know the george hat's
immigration policy is very
straightforward
you want to come here one rule pay
fucking taxes you want to come here you
want to
give more money to the government than
you take congratulations welcome to
america see that's how you run a good
business boys
um duh
i don't know how big is the rotterdam
team i don't know these things man
that's not the team i'm on i'm on team
shell and i'm on the uh machine learning
team
uh machine learning engineers i'm
working on
our current model is taking nine days to
train
that's nine days on eight gpus so we
just built a new machine
um we built a new machine we built a
nice 40 gpu cluster
connected with 100 gigabit interconnects
100 gigabits infiniband
yeah and we got the melanox connect
fives which means
that we can dma directly from
gpu memory on one computer to
gpu memory well we can dma directly from
the gpu memory to the infiniband card
uh without having to go through the cpu
and then we can you know blit that over
that infiniband fiber
to the other computer so if you like
playing with stuff like that
um very excited for nvidia's new gp as
much as i hate nvidia
you know like as a business i look i
don't hate nvidia i think they've lost
their way
i think that when their stock went up
they became you know like nvidia
look jensen's a good guy man he's he's a
good guy and
you know you start seeing that stuff you
get kind of you get kind of like caught
up and like we're going to own the
future forever
and yeah that's what every company
thought that had their their their uh
their stock price run up like that and
they're like now we can just overcharge
everybody for everything and the stock
will go up more
yeah well you know it's not working for
everybody who tried this yeah
yeah too bad yeah yeah intel died yeah
isn't video wow nvidia past intel wow
nvidia has
blown intel away
wow wow nvidia's oh wow this shit's
overvalued man
wow this shit's overvalued
you know what one of these days they're
going to push me and i'm going to start
building ai accelerators
one of these days they're going to push
me and i'll build the right thing i'll
build the right thing and nvidia's
competitive advantage
well nvidia owns melanox
fuckers man
uh wow this shit's insane though really
really though i mean i guess all the
intel lost money had to go somewhere
uh oh my god please don't let the buy
arm please don't let them by
arm lock that block that
uh yeah no actually i saw that gpu i saw
the gpu that has the port
um
no wafers for intel yeah intel has a 10
nanometer coming
uh at least nvidia's pushing tech phone
it's true
it's true um two things two things that
i think are
nvidia at least the last or we'll see
what happens with ampere
we'll see what happens with ampere um
turing
was the gpu's first game um
and then like nvidia knew it but they
didn't really care they're like look
we're in video what's anybody gonna
gonna do with us
um yeah so
if you want to build a competitive by
the way if anyone out there builds ai
accelerators here's how you build a
competitive ai accelerator
one whatever bullshit you're saying is
going to distinguish yourself like
we've hand tuned it on transformer blah
blah blah blah nobody cares
right get rid of all that shit don't
like
oh we're going to sell it to cloud
providers we're going to provide an
exclusive ai cloud
don't do that build a card
build a pcie card 300 watts
right pcie card 300 watts
sell it for a thousand dollars and
you put um you know you
build builds now you probably have to
sell it less if nvidia is selling their
gpu their consumer gpu for a thousand
dollars
price it at half the price of nvidia's
gpu have the same number of flops
and then make sure you get it integrated
with upstream tensorflow
whatever it takes get it integrated with
upstream tensorflow
um ati whatever amd
whatever it takes get it integrated with
upstream tensorflow no i'm not
downloading and building
rock m from source um
every time nvidia does something stupid
they're like look well we could do this
this this trick and if you just use the
nvidia stack
no nvidia wins for one reason they built
a 300 watt
pcie card that has a lot of flops
that's integrated with tensorflow build
the same thing
price it for less
um and don't scam like nvidia don't have
like oh
this is the version for data centers and
this is the version for consumer don't
do that
um yeah integrate it with pi torch as
well
you're gonna have to do pi torch and
tensorflow um
we still use tensorflow should we switch
maybe we should switch
uh we train at fp32 but
let's just because we have 1080 ti's
we'll switch to fb16 when we can
uh yeah it's working well for tpu google
do you want to own this market
you're going to have to do something
that's on googley or you're not going to
be able to sell because nobody uses
google cloud
you're going to have to put it on a pcie
card and sell it to people for 500.
um i don't know they they kind of seem
even
you you have tensorflow is gross but
google throws so many people at it that
it kind of works
allen roberson thank you for subscribing
uh will the nvidia tf oh nvidia's new
scam 32-bit that's not really 32-bit
we'll see
um you can't build an auto-encoder the
problem with an auto-encoder is just
going to memorize location of all the
trees
it's useless uh you've wasted waste all
your features on that
um pie torch is great but apex sucks you
mean the video game
this girl who plays apex uh
do i like fortnite not really uh should
i
i was thinking of playing uh fall guys
should i play four guys on stream
uh should we play four guys four guys
ultimate knockout
maybe we'll do a four guy stream
uh maybe we'll do a fall guys stream uh
next time we have time to stream
all right i think we'll leave it on that
note uh if you're interested in coming
to work come ai
uh if you like you know solving problems
uh open source
yeah you know you just you just can't
take you're fed up with the lies
you want to come to a place where we
don't make ridiculous promises
all we promise is that regressions are
going to be really rare
if every day we're making the system
better than it was yesterday
if you're stuck in a hole and you're
trying to climb out of a hole
doesn't matter how fast you're doing it
it just matters that every day
you're making more progress up than you
are sliding back down
and that's our real philosophy for
solving self-driving cars
um you like being lied to yeah you
wouldn't be a good fit then
yeah oh my god
i hope i hope that that that anybody
who's seriously considering working at
comma ai isn't like
but they only have one camera i wonder
if george is an idiot and thinks that
you can build the whole thing with one
camera no i don't think that you know
how easy it is to add two more cameras
mad easy you know how easy it is to get
to the performance limitations with a
single camera
insanely hard it's all software
nope can't show the new open pilot ui
again that was a one-time offer
that was a one-time offer uh
[Music]
my fall guys on my machine with 40 gpus
it's not it's it's five machines
interconnected with big melanox cards
uh why open source your software because
freedom bro
freedom it doesn't matter if you're
trying to rent seek off software you're
a loser
um you know like
i mean who still does that even
microsoft doesn't do that anymore
uh software is hard yeah
uh those five machines are like 35k each
uh
a bit less uh but yeah we have a huge uh
we have a huge data center um we got
like i think
we're up to like 1500 cores now the
thing draws like 60 kilowatts of power
uh no no we're doing a
four guys stream yeah four guys dream uh
no the whole the whole data center costs
like
what are we up to now it's like half a
million
maybe more um yeah
big electricity bill uh yeah we have
two petabytes of spinning storage
whatever four times four times 20
320 terabytes of uh ssd storage
uh why not rent a data center because
look
if you rent a house it'll be paid back
in 30 years
rent a house like if you rent a house
versus buy a house right like it's like
this is different for different cities
but the average is like like 20 or 30
years
um for cloud ship pays for itself in
under a year
especially if you're buying used
hardware
um use the new efficient net b7
you mean like the norm like is there a
new one
we use efficient nuts
uh i haven't seen anything now
um
yeah we don't even call it we just we
have in the garage
um even cola is kind of expensive we
just we we're we're training models for
so much less money than everybody else
um see the correct way to use uh
yeah i gotta i got a 1500 core computer
uh
it's got like it's got like 50 something
gpus
um it's not big enough to train it can
change gpt too i don't think it can turn
gpt3
building your own cloud is so much
cheaper than renting um also
it forces you to think in better ways
if you believe in the unlimited compute
of the cloud you're scamming yourself
right like your your your efficiency per
compute
so companies that build on the cloud um
because they're not actually physically
building the data they don't really care
about the efficiency of it at all
right and this is fine if you're all
about like the vc model of like okay
we're just going to get tons of money
um but it's much
easier if you currently have a model
that you're capable of training
like on your local machine i can scale
that up 100x and i know how to scale it
up 100x if i really wanted to
if you've already built at the cloud
scale
there might be nowhere to go right we're
still working out a lot of the
like when i talk about this this
infrastructure right this is not
getting more gpus this is making sure we
build the stuff that efficiently
utilizes the hardware we have
to the point once it becomes once it
makes economic sense
we can flip the switch and we can scale
it up and make it crazy huge right
um you needed to build gpt before you
built gp2 you
t2 you needed to build gt2 before you
built gpt3
our data center is capable of training
things that are gbt2 scale
not gpg3 but we can scale that up when
we have to
um why not use an asic yeah we're not an
a6 scale yet
uh tesla's using an asic
i don't think we have to own that part
tesla's way more vertically integrated
than we are
um i trust that some
company will eventually take my advice
and build
start with the 300 watt accelerator card
and then build the edge thing
don't start with the edge thing and then
be like eventually we're going to ship
like google
you know google actually sells our tpus
but they sell it in the stupidest form
factor you know they sell in a usb
stick well why don't you get a usb stick
to accelerate your ai
my cpu does that better right i don't
understand who this form factor is for
all the people out there using raspberry
pi's
seven people all right oh wait no no no
the hobbyists right
a million hobbyists and seven serious
people
um yeah they're so stupid uh
they build these like little like nobody
wants this
oh here look i stuck it on a raspberry
pi nobody wants this
300 watt accelerator cards
yeah yeah yeah yeah
build me that but with a good chip
that's supported in the software
um what's wrong with hobbyists it's
nothing
there's nothing wrong with hobbyists as
a hobby but when a company like google
thinks they're going to like can't
resist man
they cannot resist they cannot resist
injecting their
ideology into a chip
right it's chip man
i'm gonna buy it google and i'm gonna
build
malicious and privacy destroying ai
[Laughter]
carpathi built mini gpj
wow cute man carpathi good to see you
still have time for stuff like this
no you know who's evil people who are
shoving your ideology down your throat
with the purchase of a chip
oh it's going to improve strength
strengthen society improve the
environment and enrich lives
like just when you think is it a parody
or is it not you can't tell man you
can't tell
you cannot tell uh let's see who's
serious about
i see jim keller's name in there let's
see what we got
are these all the people building
yes these people they're they're really
bought into the cloud model though
and you shouldn't buy into the cloud
model
um because
like one of the beauties of one one of
the reasons
uh the cpus work so well in the cloud is
developers develop locally
and then when they push it to the cloud
it's the same cpu right
the same docker container that runs on
their local machine runs in the cloud
if you have custom ai accelerators that
only exist in azure nobody's going to
want to develop for that
um oh comedy has his own twitch
[Laughter]
um you know look look i
i think i think
he he's he's been saying a lot of the
same stuff you know we we
welcome to to to team truth about
self-driving cars
am i suggesting risk five i like risk
back
um oh graph course you know yeah
yeah yeah let's see what they got
okay i can buy it how much is it
can i buy a pcie card or i got to buy a
custom crap that goes in my data center
oh wait oh wait no no don't tell me this
is the company who's building a really
large
chip oh my god the wafer scale chip
company
oh my god
you know you know some vc somewhere who
doesn't know too much about chips it's
like oh it's way for scale man
bro it's way for scale
why'd you put it all in the same chip
why
see that this is the right thing to
build each one of those chips draws 300
watts
put four of them in there you know put
four of them into one u oh that's
beautiful
um what do i think about the apple arm
transition
fuck intel intel yo because this guy
is like intel x engineer
what's wrong with intel
uh yeah yeah this guy this guy this guy
went on a youtube brand about what's
wrong with intel
um fortunately
at the beginning it's a bunch of
technical stuff um at the beginning he
like talks about
like specific technical decisions like
you know linus torvald says like
abx 512 is stupid an avx fact 12 is
stupid but that's not really the problem
with intel
right like how do you end up at avx 512
next the mbas
oh you know
yeah so this was the this was the old
culture of intel you had constructive
confrontation
um when meeting external people when
designing you know
nice guys on the top cancer people with
skills on the top
good right uh
doers over management open cubicle
modern intel
oh my god intel's breast relations i
want to win
no it's not even security of like intel
is an example of a truly broken company
um pro tip the more you see
ideological garbage on a company's
website
uh the more they're failing as a company
um
if i go to tesla i'm not gonna find
anything about you know there's not
gonna be an ideology
right
just sexy pictures of a car
cheap solar panels for roofs solar for
new roofs
it's cheap you can also buy
that see let's see
notice notice how none of these things
are like you know
safety high impact protection right
cool man i like that look at that that
looks that looks safe
it legitimately looks safe you put a
huge battery at the bottom very low
rollover it's good i like this look
they're informing me and educating me
oh it's fast yeah i mean they're fast
that's true
right coral
it's flexible enough for startups and
large-scale enterprises
can i bend the board that's what i'm
thinking about
oh industries building smarter cities
manufacturing more efficiently helping
people get around
all right wait we like graphcore i don't
know graphcore is not the idiots making
the way for scale chip right
oh it's these people yeah uh so
oh no never mind i think these colossus
mk2s are they
is that wafer scale
colossus mk2
okay um
can you put one of these on a pcie card
and does it draw
how many watts just tell me watts
no no no no see this is wrong what
software do i want
tensorflow and pi torch and if it's a
fork
for a while that's fine but once you
become dominant google will merge your
fork
sorry i'm not using the poplar sdk and
i'm definitely not using the pop vision
visualization and analysis tools
it supports both of those okay look at
the diagram
oh there's a diagram good good all right
good good they wrote their own xla
okay fine fine fine fine it sits on top
of that all right i like that
oem pcie servers okay i like that
packs one pay to flop so i'm not exactly
sure what that means
teraflops of ai compute is that you and
aid is that
float32
um
i mean this isn't selling the machine
like this isn't necessarily bad
i mean if you're trying to this looks
like a straight up competition with
google
uh i mean it's not it's not water cooled
it has these fans
but like yeah how many how many watts is
that whole thing drawing
wow that whole thing is just cooling
oh and those are the chips okay cute
um wait wait wait wait wait wait wait
wait wait
why do i have an ipu gateway sock
um okay i mean maybe that's how google's
doing it with the tpus maybe that's okay
all right can i buy one let's buy one
ipu machine m200
and 2000 by now
okay i can watch video
um it's radical that's you know
concerning
um all the
people who have qubits use them
so where's that where's the buy link
it's 32k wait
how is that competitive with it with
intel oh and it's going to take a couple
phone calls
oh sorry how's that competitive with
with wait 32k for a pay to flop
why do i have phone calls i don't want
phone calls
i want to buy one how do i buy one oh i
got to contact their sales no
no no no so you build card
i want a card i want i want pcie card
and i want to go to amazon.com or i'll
buy it from your website you want to
have a shopify that's fine i'll buy it
from your shopify
uh all right all right blog blog
why do they do that because you know
yeah i'll tell you why companies do that
right
the reason companies have a contact us
for sales is because they know their
product isn't actually profitable
right if anyone had a product that was
actually profitable
uh they would just put it up for sale at
a price right
but if you know that the real price
trade-off
would be made some other way then you're
pulling a scam
right whenever you see this whenever
they get you and force you through a
sales person
it's because if you were free to make
your own decision you would not choose
them
right there's no other reason to do that
if you truly have a product that's
competitive put it on amazon
or fine i don't care if you don't want
to deal with amazon do a shopify i dealt
with amazon i get why you might not want
to put it on amazon fuck amazon
um but you know
a shopify some fulfillment stuff
okay can i buy this taboola who's
taboola
the first company that sticks them on
amazon
you know didn't that didn't bitmain make
ai chips
can i buy these well
no but see no no no i've seen this one
and they failed because it's only 75
watts and they didn't listen
when i said it has to be through oh 30
watts so that's even more pathetic but
this one 75 watts that's not enough
watts
put four of the chips on there now we
got a good number of watts
um yeah they don't know the price they
they're just it's whatever your it's
whatever you're willing to pay man
you know i'll sell you this this can of
soda
how much what are you willing to pay me
for
um no no no okay i like amazon
i like amazon as a consumer purchasing
off amazon is a great experience
selling on amazon is a nightmare
um guys you know i talk about a lot of
companies i don't like let's talk about
companies i like i like amazon
i like apple for the most part i like
microsoft
um i like tesla spacex why is 300 watts
important because you know that's
i want to fill my server up with this
thing right
i want to buy some cheap shitty servers
and
i i wanna fill them up with these cards
i like pornhub that's a good company um
i don't like facebook i don't like
twitter
no what do you mean i think like most
companies i feel kind of indifferent
about
right like you know whatever company
made this mask right
i don't you know i might not like masks
but i don't have a problem with that
company
um reddit's a bunch of sellouts i like
wikipedia
fuck tick tock uh tick tock's the most
degenerate shit you know
like at least instagram glorifies beauty
tiktok is just like people being
degenerate
um
does higher wattage mean higher flops
well
you basically two things determine the
number of
like unless you build something that's
really inefficient which i don't think a
lot of these people have
two things are really going to determine
your amount of flops um
your process that you've used and then
your number of watts
right so if it's a seven nanometer chip
it's watt scale with flops this is true
all the way down to like you know uh
little qualcomm socs
uh so does this does this can i buy one
here
can i buy one of these things no well
they're just sticking in v
100 tensor core gpus
do i think insta thoughts are beautiful
yeah a lot of them
i mean they put a lot of effort into
that stuff man like some of those girls
like they'll take like a picture in a
private jet and they like you know they
just like they rent the jet just to sit
on the tarmac and take the picture like
you know what but props for them they're
supporting the economy
you made up some like stupid tick tock
dance like boo
um instagram glorify is a
beauty i like instagram i know despite
despite
uh despite not liking facebook i don't
like facebook as a product right
facebook is a company it's like yeah
i dislike actually i just like facebook
as a product but like facebook is a
company
i feel better about than google
um instagram is a great pickup website
too
uh well amd actually can be competitive
amd
if amd got their shit together with
software
all right all right radeon instincts
see what we got um
how much watts
oh oh 300 watts
okay i mean it is rock m but maybe
rocking will get
good
how much
wait it's it's only uh nvidia a100 is
only is only
20 teraflops i mean actually the bigger
thing that matters too it's not just the
flops it's also your memory bandwidth
i've been upset with rock m i've just
been mostly upset with like trying to
get it to build and work
uh no wait they're not claiming
they're only claiming
13.3 that's not that much
those are lying flops you know
lying flops i don't want any lying flops
real flops
oh this is if i'm looking for a dell
rack amd is pushing so good i good
good guy amd man how's amd stock
well they deserve it you know amd
deserves it
but i hope they don't become scammers
great i can buy a ups good link
um how much are these
they have a good amount of memory
bandwidth
you think their stock will drop after
next gen announcements
uh
um
well the performance to value ratio yeah
but that's only because
you know you can't compare with nvidia's
scam pricing
you have to compare with the real
pricing of these things
which if you want the real pricing look
at their consumer gpus
those are the old amd cards the new ones
come this fall wait you're telling me
these are the old ones
oh yeah it's vega
yeah so does this is this up to date for
the
no
huh it's really not many
the g4 is oh wait where's the ti
is the 1082 and 2080 ti
yeah so these are the numbers that i'm
familiar with it's like 13
uh well let's just say a titan rtx
another two here
let's let's give it 15 15 gigaflops
right
so you're telling me there's newer
there's newer ones than this
and here you got a link where i can buy
them
oh my god oh that's crazy expensive you
gotta compare to nvidia's
uh you gotta compare to nvidia's
consumer gpus
um again
that that's a scam but when is in video
is this still big navi
sorry i i haven't kept up to date with
this stuff
wait they have pictures now is that a
real picture of a geforce
we are leaks
no that's that
so that's what it's going to look like
how they do the heatsink is interesting
because it determines how many of these
we can shove in a box
the second picture was the leaked design
you mean this
this is the scam picture that i've been
seeing all over the internet you're
saying this one
old ones this is supposedly the leaked
design yeah i don't know
um
all right guys uh i'm waiting i'm
waiting for somebody to build
nvidia is priced okay for the consumer
gpus they just need to stop trying to
segment the market
artificially um
and if they won't do it maybe i will
should we build should we pivot commerce
should we build should we build uh
tpus
um just wait for a blower heatsink
version and rip the blower part off
yeah we could we could raise the money
to do it not gpus
just just tpus um
you know i mean i really like i don't
want to be the one who builds them
i would design even that
you know what tesla should just stick
their tbus on pcie cards
um
yeah you get tsmc to build them it's
fine
no i don't want to have to do this i
really this should be a completely
commodity thing
anybody should be able to build this
right anybody should be able to build
this can somebody just go
steal a tpu from google and build a
duplicator machine
that is tesla dojo yeah it is exactly
tesla's dojo project
generic data center picture um
tesla ai chip
yeah they need to stick
a whole bunch of these whatever they're
using for dojo
they should sell
dojo is only on an fpga implementation
now how do you know that
um
if anyone was able to build it they
can't sell it as a service yeah
these people need to get wait elon
tweeted it
oh
wait why don't they sell them
yo elon let's let's go in on it man
let's go in on it
i will help you out we'll help you out
with software
or just just elon here's the deal i'm
willing to make
we'll do free software support for dojo
you just need to sell the chips
open dojo come on man just sell the
chips
you'll make money i'm not saying sell
the chips at a you know
sell the chips at a reasonable markup
sell the chips at a 10 20 percent markup
right
um free money
uh fp16 is fine
open dojo yo elon come on man come on
let's open up doja
dojo has multiplied yeah i i've seen
i've seen i've seen presentations on
there on their other channel i can do
most of the stuff
we'll help you with the software we'll
switch to pi torch
you guys using pi torch we'll use pi
torch we can all use pi torch
fuck tensorflow fuck google let's pick
come on man let's
do it let's do it let's build the
competitor let's crush her man
fucking video fuck google come on
um
i believe i believe uh open dojo
elon here i'll think about it all right
all right think about it you think about
it all you gotta do is sell the chips
man that's all i'm asking
um
uh how many people we got people still
watching this crap
here we go we got how are we doing
ah a thousand people not bad
um but yeah good to see we got it we got
another
you know i do the haskell stream no one
follows the hassle stream
sad
i'm verified on twitter but i don't care
about being verified on twitter
because the women on twitter are not
what i'm looking for
it's women on instagram that i'm looking
for and that's where i want that blue
checkmark
um
actual elon tweet i have twitter blocked
on my computer so i can't see that
okay guys uh come work at comma ai
uh you know we're the underdog to tesla
let's be honest you know i'm not even
gonna say that like
if you want to win we're the underdog to
tesla but trust me we live in a world
where we both win
uh build android we're gonna be two
years behind apple
uh you know but we're gonna
we're gonna capture most of the market
share i think um i mean i think that's
what has to happen
i think that these companies they're not
going to have you know
oh that might oh yeah george hartsman
there goes a clone man you know he
doesn't he doesn't work in the normal
business ways but they're not going to
have a choice they're going to have to
use open pilot right
i mean it may not be me selling them
open pipe but i don't care uh
maybe maybe maybe some some some some
mba guy is going to be like yo
yo you see this open pilot thing man the
kid who runs it's an idiot
you know i'm going to package it up and
i'm going to sell it to hyundai
yeah thanks bro thanks you work for me
except i don't have to pay you and deal
with you that's great that's what i'm
talking about right
um no linkedin is not a good site for
dating
i was going hard on linkedin recently uh
and
you know it's not a good site for dating
um
yeah no but that's what i'm saying right
like i'm gonna let some other some some
mb oh yeah i'm gonna capture all the
value
yeah you capture the value man you could
do that right
uh
do i think hinge where they ask you the
questions
if you were a fruit how pointy would you
be
uh open tinder tonight
um
do i think any old car companies have a
chance yeah i think i think
can you leave up the video yeah if
you're a subscriber i don't take the
videos down
um i think that the car companies aren't
gonna have a choice
uh but to use open pilot um as as
autopilot becomes
eventually tesla is gonna deliver on
these promises
um i don't post them on youtube somebody
else does that
uh eventually tesla's going to deliver
on these promises and autopilot is going
to become such a distinguishing feature
of the car
and then at this point the car companies
are
or like you know mercedes is partnering
with nvidia
uh to ship uh their video gpus in their
s-class 2023.
who's writing the software for that um
so they're going to try
they're going to have software teams
they're going to be over funded they're
going to be terribly mismanaged
are they going to have all the wrong
ways of going about the problem
um and then it's going to be like
a year you know the hardware team is
going to work on that and someone's
going to realize
hey you know georgia's right we're going
to have to use open pilot um
and then you know uh welcome to how to
do business development without ever
doing any business development
just make things inevitable you know
just like like the universe
think of how the universe think of how
the story is gonna unfold right
think think about think about the
narrator think about the story and think
about how it has to work out
um and then you realize that you win you
can't mess up right like there's
there's always opportunities for for
pitfalls there's always there's always
pits to fall in there's always
there's always wrong turns to make and
there are certainly ways that we can
make mistakes but really the future of
self-driving is ours to lose
i think um
yeah i mean at what point at what point
was it inevitable at what point was
android inevitable
right at what point
and you you you had and what makes me
think they won't go to other
self-driving companies
um name another self-driving company
that has something that looks like
autopilot
of course winning means everyone uses my
software for free of course
yeah everyone uses the software that's
how you win
um uber doesn't have anything that looks
like autopilot who uber has
broken stuff that killed somebody
at what point will linux be inevitable
i think i think for a bunch of years
past that one bro
um
uh who's linux is competitor it's
windows and mac right mobile and tesla
those are our competitors uh oh this is
the year of the linux desktop oh yeah
yeah i'm sure i'm sure man i'm sure
uh linux is supposed to be internet all
right linux one
um
you wouldn't hear about uber killing
someone
dude this is terrible it's really it's a
terrible story um
this is a terrible story actually
watching that video is why like
like after i saw that video i'm like
holy shit we need to ship driver
monitoring
uh like driver monitoring is gonna be a
big
uh there's going to be a big piece
of the next five to ten years in
self-driving
um yandex has something uh
again who's built something that looks
like
autopilot not something that looks like
waymo things that look like waymo
will never really be economically viable
things that look like autopilot will and
this is why openpilot's inevitable
um i think it might i think it's too
late now also
like it's too late now to start a new
company right so it's not going to be a
new company
it's not going to be a project inside of
any of these these car companies
uh it doesn't look like it's going to be
a startup
i mean you have some like helm that i uh
who are saying helm and wave who are
saying like similar things to us
but they're years behind us um
i mean again yeah if we stumble and like
those people could potentially take take
the reins from us
uh though i also haven't seen i mean
baidu is the only one saying open source
uh
your competitor is going to have to
really be open source
um i think it's i think i think we just
passed it
in uh in stars but yeah um baidu is
going open source they're using the
right rhetoric they're saying the
android of self-driving cars
but then they went on to build something
that looks like waymo and not like
autopilot
um
so yeah we pass on the stars it's
inevitable it's it's it's
yeah if you're reading the story
what if tesla starts licensing the
software so what if apple started
licensing ios
all right i think it is more likely that
tesla
will sell the dojo chips than it is that
they will license through fsd software
uh what's stopping tesla from open
sourcing after they solve fsd what have
they open source in the past i mean it's
possible
um it's also their software is probably
much less flexible than ours when it
comes to supporting multiple cars
like how baked in is it to the tesla
versus open pilot supports over 85 cars
now
and we support all these different cars
what about new economy you mean bought
by active
the swimming are bought by active right
how about nvidia as a competitor
nvidia had a shot when they were working
with tesla
um where's mazda
the problem with mazda's oh my god this
is this is too common ai now i don't
care about that
there's a problem with mazda's you can
you can read about it
why is open pilot not available for
volvo there's a problem with volvo's you
can read about it
um
uh what do i think of apple moving to
arm yeah
yeah buddy i want to buy one of the
macbooks man i love apple
uh a push towards standardization of
self-driving sensors
oh first people got to get over the
lidar shit you know
not everybody i mean like not
everybody's on the same page yet you
know
some people are still they're still lied
aren't believers don't
uh how can you accelerate your progress
i mean again i'm reading the book right
how does the book how does how does the
book move faster what is
what are what are the plot events that
are going to
make things move faster there's a few
people we need to hire to build certain
things
but the end team that's going to solve
self-driving cars is 25 people
it's not
it's not going to be a ton of people so
yeah there's a few key roles that we can
hire for
and maybe help things move faster though
to be fair
probably 70 of the people we've hired
have helped things move faster and 30
percent have made things move slower so
you always have to be careful with that
i don't own any chain link but i hear
it's going to the moon man
this is not an endorsement of chain link
it's stupid
uh i got i can't believe what's the new
people only use coin market cap anymore
it's like a new one people use i don't
know it
um wow wow the link marines the link
marines
i'm you know i i think tether is going
to go up
tethers tethers going up you know um
all in on tether bro
uh
no i i don't i don't i don't understand
why chain link's pumping
link marines
what's keeping open pile from being
level four level five
it's chris we don't have a lidar
did i just talk about all stream big
connect
yo i bought the dip man and it just kept
dipping so you know
um you know i think he renamed his child
to something reasonable and just about
to troll the media yams bro
those yams wow a lot happened since we
last talked
oh there was like uh no no no no no
oh the the yam commits were funny
oh it's just like reading the
is it this one um
no oh
oh there were just there were just some
yam posts
probably not correct typos probably not
pending
uh warning oh yes
it went from it's a great day to save
yam
to remove liquidity from the yam uniswap
pool uh
oh wow this is this is this is really
going off the rails now this is
this is a shill stream for you to come
work at comma
um come work a comma
uh we're gonna win uh
if you're interviewing for this position
or this position
and you get past the initial hurdles uh
well we'll do a phone call um i'll ask
you a bunch of questions
if you do well in the questions uh we'll
invite you to the office
uh for paid micro internship
well we could talk about joining the
team yeah we could talk about uh
winning you could see all the all the
real common ai secrets right like this
is the public side this is the things we
talk about
not the all the subtle tricks that are
actually going to make it work
um yeah i don't know why it doesn't
mention the rotterdam office you think i
do the website i won't do the website
man
i'll do the website complain the website
team i'm a machine learning engineer
i'm also have a personal hobby of
the navigation and i want to see it
exist
uh are we vc funded we're profitable
we are funded by people buying common
tools uh
so yeah i mean if you're interested i'm
i'm less interested in chilling for this
i don't really care if you buy it or not
like in aggregate enough people buy it
but yeah like we sell these little
things they're pretty cool actually
they're totally worth the money
uh if you get it set up um
we've helped people with their green
cards yeah yeah we can help with all
sorts of immigration stuff
um i mean i don't i can't give you a
green card but we can sponsor it yeah
um let you work for free at comma on a
temp basis so
let me tell you about that right
people ask this kind of stuff a lot and
the answer is straight up now
right because what you're asking is to
be
managed for free you are a cost like i
said
i'd say 70 of the people we've hired at
comma have been a net benefit to the
company
30 percent have been in that loss right
and if you're asking if you could work
for free you know it's not even a money
question it's just
it's just a productivity question what
could we do if we had 100 software
engineers
honestly have a bloated hard to maintain
code base
um would i say everyone who works
at comma they don't work for me who am i
right they work for common ai i come in
as a corporation corporations are people
i'm a guy i work there right
um i'm not your boss
you know uh but i would say that
the people who are in ai are very smart
yeah um
well we don't really have any vc money
anymore we spent the vc money now we
have profit money
when will we go full open source papers
and shit okay let's talk about that so
do you think
inside of common ai we write papers and
we keep them closed source
yeah i've got to write papers but we're
going to keep them closed
um if you're asking me what you need to
learn
it's not like a set of things man i'll
probe your whole knowledge graph you
know
that's that's what my interviews are
like right i just start with like i
start with some abstract bullshit
question then i'll go wherever
wherever you take me right it will go to
the leaves of the knowledge graph
and if it turns out you can go beyond me
and the leaves of the knowledge graph
and you could teach me something
oh i'm interested all right those are
the good interviews right
um the ones who like here's like think
of the knowledge graphs right if you
think of knowledge it's like a big tree
and you can think about like people's
overlap
uh you know with with my knowledge graph
and you know people who extend
further than me on certain branches are
very interesting to
to to to be hired um
yeah shit's documented to some extent
it's not like a beautiful paper i don't
know
uh yeah i think i think once we're uh
once we solve the problem i i'm
i'm certainly not opposed to to writing
papers i think when we have something
good to say we won't write it up i don't
think like i'm not like
it's the it's not a secret
like there's nothing there's nothing at
comma where i tell people hey don't talk
about that
uh well actually that's not true there
are some secrets but they're not in the
ml division
you can imagine where the secrets are um
yeah so i mean we talk a little about
like what kind of people
uh we're looking for i mean this is kind
of old
but like competitors if you've done well
at math competitions
if you've done well competition
programming before as a meme
science fairs in high school capture the
flag competition
um if people have contributed value to
open source projects
if you have stars on your github if
you've
um got pull requests merged into major
open source projects we're interested
uh and then people who are good at like
architecting stuff
these are kind of what our interview
questions are i'm like if you're going
to build this system how would you
architect it and like people like make
the right decisions here
and the way that you learn to make the
right decisions there is you've
architected systems similar to it three
other times so
yeah um what's a regular run-of-the-mill
dev i mean
there's no there's no rote work at comma
um i mean it's not like like like
everything if you have if you have other
things going for you it's not like oh
yeah i don't know github with stars you
can't be hired
um but notice how none of these are uh
anything to do with a
degree or some kind of education yeah so
we do we do yeah we only hire people
better than the average or at least
that's the goal right because if if
you're at a company
um and you're hiring uh people better
than the average i mean this is an
interesting
this is you can talk about this with
immigration too right like that should
be this is this is another nice
immigration policy idea for america
right it's like
here's the average right is this person
who who
who wants to come to america are they
below the average are they above the
average if they're above the average
please come to america you're bringing
up our average as a country right
um they're bar raising right um
i mean you know yeah like it's the same
it's the same things as uh
it's just similar to the tax thing right
if you're gonna bring more money into
comma then it's gonna cost you well
actually there's other costs to that too
so
but um you don't give anyone an iq test
uh what about research people so what do
you think research is right if you want
to sit there and you want to discover
some new mathy bullshit research is
actually just
it's it's infrastructure uh but you get
to do cool math occasionally
like there's a lot of cool math stuff
like you got to write like
all like the hopefully you remember how
to do like rotation matrices in three
dimensions and shit
you got to deal with all the different
frames yeah i'll show you i'll show you
this one
pilot all um you know if you want to
work in the research division
you better understand like this kind of
crap like here's our reference frames
you know
uh you mess up so much you mess up like
like there's so many little subtleties
here it's so easy to mess these things
up we have cameras we have normalized
cameras we have calibrated
things relative to the camera relative
to the imu relative to the earth's
surface and we have this library which
can transform between all this stuff
um
the only purpose we serve is twitch chat
is to stroke george's ego no sometimes
you guys are good like i said i've
complimented chat this time
we had a nice conversation about ai
accelerators
uh we had a nice conversation you guys
showed me two papers which i'm gonna
read after this stream
uh
you have a pr immersion to open pilot
well that's good
um didn't have to ban anyone nice
uh good good stream today good stream
good good evidence everyone you see this
that's that's a nice uh
nice squirrel to see how many how many
viewers we at
uh wow still up at a thousand um
i'm not even going to shield for
subscribing on this stream i'm just
going to chill for coming to work at
comma
and you know tell your friends man
ban you then sure absolutely you know
it's even it's a pleasant ban
you're banned you see there you go
um
what's the interview process like uh
interested in the navigation designer
role
uh so email give me a job at comma ai
you're gonna get hit with
one of there might be some screening
questions there might be some
uh it might be a small programming
challenge that should be pretty fun
um then usually it's it's one or two
phone screens uh
with with com employees we have like an
initial there's like the weeder part
uh and then there's the the phone screen
part and then we bring you in
uh we'll fly you out for a micro
internship uh you work in a real code
base for two days
uh good luck finding someone good
willing to do non-remote i found a lot
of people who are good i want to do
another remote
you just like like what are you here
here's my real problem with remote more
than anything else
um you come because you want to join a
culture
right you can go work on code i mean you
want to work on open pilot remotely we
won't pay you just submit pull requests
right
maybe we don't even pay you a little bit
like a per project kind of thing if
you're doing well on pull requests but
you're not
you're not you're not an equity employee
of the company right
um if this thing does succeed uh there's
gonna be a lot of a lot of money
um and you know it's it's like
well who's the team right the team is
is a group that's in a place
remote is great if you hate your job see
yeah that's exactly right right
if you hate your job like this isn't a
place to work if you hate your job
um remote is great if you hate your
peers see yeah that's that's another one
too like this is
sure and these big companies i i think
you know google used to be so good about
about about culture
um and about building a kind of culture
and about building a kind of place where
people like just wanted to hang around
the office like
you go back to google and set you know
you go back to google like 12 years ago
that's what it was
um i'm not talking about the people who
did it for cove and i'm talking about
like the companies who
who hire remote employees you can bring
your own keyboard sure
uh san diego is a nice place yeah uh you
know we're not in san francisco we got
out man we got out
we got out ahead of the curve you know
um
can i explain where the equity value
will come from oh well
so i mean like i said right think about
think about it like this um
a lot of people are very concerned with
capturing value
right um and if you're working in a
market
say like real estate sure that's the
only thing there is to do right
it's not like it's not like there's
going to be a big growth in real estate
or anything there's no there's no
new value to capture you better capture
value you better be competitive with
other people right
self-driving cars and software like open
pilot is going to create immense amounts
of value
um what i've always found
is it doesn't really matter
what are the jailbreaks and i asked for
donations
it's unclear how much better i really
could have monetized them
right just by creating and building this
value
the money will come to you how much is
linux worth
so for reference um
red hat sale to
ibm um
red hat which is a company that supports
like really a linux like like
distribution or fork
got acquired for 34 billion dollars
wait are you trolling about the business
people i'm looking for zero business
people
ever i don't know what a business person
does
uh yeah yeah i think we're out of them
office it's a nice office you know
it's building it's filming an
environment
um
yeah it's a consulting business as well
there there's a lot of ways to uh
but don't like like worry about winning
don't worry about capturing value
yeah there really is an office in
rotterdam and we're really hiring for it
um how's the full stack interview
different within the machine learning
one
i don't do the first step of it after
that they're honestly not that different
i'll probe your knowledge graph in
different places
um
you need some photo proof for the new
office
let me let me find your photo proof here
you go
uh we got do is expensive we'll we'll
pay you long enough to live comfortably
it's not i was i was kidding about like
the 80k
everyone just paid six figures who's a
programmer
um
yeah right dude we're a multinational
corporation you know
maybe i'm being trolled i'm not allowed
to go to rotterdam they won't let me in
now my u.s and my australian passports
don't get me in
um
you don't think you're annoying as my
grandson
oh well i mean that's a this is sneak
dis bro
nice nails are they real who said i knew
about the mystery method
um going multinational don't be evil now
i'm not we're not evil then
um we do adjust to local wages yeah
yeah no shit you guys think i'm you know
do i adjust to local wages like i said
you're not coming to work for me you're
coming to work at comma ai
common ai is a business with like people
who like you know do this stuff right
now me
i i'm i'm like i said i'm the troll
i'm a cheerleader and i
write some code occasionally
uh we're in san diego fuck san francisco
they gotta clean that city up you know
it's the board of supervisors
can't build any housing there's hopes
people everywhere
uh the city hates you know anyone who's
bringing money into that city is
sad um
how often do i go to the office when i'm
there i work there full time
uh san diego like like you know
beautiful
by the beach um the other problem one of
the other problems with san francisco is
it's politically homogenous
or like it's a one party this is one
party state uh
san francisco is is san diego is two
party
um you know it's like like you have more
just you get you get like saner policies
uh san diego as well
um that's the human poop in the street
no i mean also the crime in sf is
unbelievable
uh we had we had two car windows broken
i had my car broken into
we had a homeless woman who broke into
our office and spent a night there
it's just what are you paying for
um
yeah austin austin's an interesting yeah
no seriously we we we had a homeless
woman spend a night in
in our san francisco office
um
just just you know it's like it's not
this these aren't crimes there
uh
yeah austin has some things going for it
california
california you got the ocean man you got
you got
it's it's it's it's beautiful it's chill
uh i think do i agree with teal
not about many things but about sf sure
um if there i would i'm flying back i'm
flying i'm flying to la tomorrow
uh if there's rolling blackouts in
california i'm gonna be mad pissed
um how's dating in san diego
better than san francisco
yeah well i like the legal weed too i'm
big on legal weed you know
i got arrested in texas for weed ones
um no i'm not wearing a mask bruh
yeah amsterdam we got we got legal weed
too legal legally
all our offices are in places with legal
weed
all right no weed tangent um
no i didn't go to jail i was arrested
and i was i was wrongfully arrested the
arrest was expunged for my record that's
right
um
when office in amsterdam only rotterdam
amsterdam is the same it's the same it's
so expensive to live there um
well yeah but texas doesn't honor my
medical prescription for marijuana
but they do if it's thc man you know got
my lawyers thinking but
no we're not we're not we're not talking
about that all i can say is i've never
been convicted of a crime i was
wrongfully arrested
um
is the speed challenge optional if you
dwell on the speed challenge i'll be
impressed
uh honestly if you write an email to
give me a job at comma ai
and you like make a compelling case for
yourself and i think a lot of people you
know
i shouldn't say that because what a lot
of people think is a compelling case is
really not a very compelling case like
i will work for you for free all i see
is you're gonna cost a lot of money to
manage
um i know i said i was ending the stream
two hours ago we got so many people here
oh it's it's declining a little bit now
so so maybe now
now we can we can we can end up the
stream am i a twitch partner now
that's what i want to know twitch made
me a partner
i'm i'm a good person i'm on board for
the bezos revolution i support bezos we
only say good things about amazon
i said good thing i said it was
constructive criticism you know
about i was talking about the about the
about the uh
the the the uh experience being subpar
my purchasing experience is excellent
and bezos
i wish you best of luck on your on your
space internet and on your on your
on your rocket company and on you build
an electric car yet
um oh no yes you're oh yes you are
building an electric car you're zooks
yes yes
i didn't rip on zuke's once i'll stream
come on jeff bezos let me
let me be a twitch team if you're twitch
[Laughter]
partner
billion dollars man
and people think comedy is not you know
zuke's is worth a billion dollars and
they have nothing in common with
openpower with thousands of users
are we a unicorn i don't know
tune in next stream to find out and
actually we're going to play fall guys
on next game
uh yeah if you want to work kamehameha
less jobs
uh hopefully this gives you an idea of
of what we're about uh
level three in three years real promises
not big promises i think it's actually
doable we had a long talk about it as an
office
uh yeah bye everybody
oh
i just want to do a quick update
people a little bit of time to get in
here so
we got our models training today across
32 gpus we got a melanoc switch
an sb uh
gpu direct rdma potentially
the switch has sharp uh
you know you can uh so it can do
hierarchical reduces
inside of the switch allegedly if your
nickel is the right version we should
update our nickel
well if we update our nickel i bet it'll
get faster but it's already
mad fast um
i'm streaming
i say hi no you want to say hi
not in the mood oh hi uh yeah so much
parallel right so
actually you guys aren't looking at the
parallel right now so here i am ssh into
four machines
gpu seven nine
eight and five don't ask where six went
this is the model it's converging tons
faster than the old model
not only these epochs happening faster
yeah look we're already at negative 2.5
losses
and if we go over here to the model that
was trained on a single computer if we
want to get over to negative 2.5 losses
man we gotta scroll for a while
it's like here is that epoch 102.
here we're only at epoch 30.
um no i'm good uh so it's blazingly fast
um we're going to take you on a quick
data center uh sorry not a data center
we we have a not a data center it's
definitely not a data center
uh we're gonna show it off to you guys
right here live in this stream
you know why i do these streams we're
shilling we're looking to hire
new people for the research team if you
want to come here
it's about a three year push
probably now to uh sell self-driving
cars maybe it's less maybe it's less
all the pieces are coming together um
we all should have seen the writing on
the wall with value prediction networks
that was a 2017 era paper there's a new
one there was one from
jan lacoon at iclear last year and then
of course there was mu
zero at the end of last year and mu zero
uh dynamics models are the key to
solving self-driving cars
we just need to put it all together we
have the data sets required
uh we have the gpu power required
uh we just need a bit of code
written and debugged and uh
in some ways we're kind of in the home
stretch it's a long home stretch
but uh all the pieces are are finally in
place
so let's go over to the data center
um you know for the for the haters
who are like oh comma comma you know you
know it's not it's all fake man it's not
fake look at that money
look at that money does that money look
fake to you that's 323
thousand dollars in 30 days we're rich
uh so yeah calm is profitable you guys
know that look at all this trash look
look at all these comma twos ready to
ship
buy yours today these are ones with
cosmetic defects
waiting to be fixed these are all the
ones that are ready to ship
um yeah but let's go into the nada data
center
all right so it's loud as hell in here
mostly because of that switch oh it's so
loud look at these beautiful things
[Music]
look at that this is to prevent the dust
from getting into them
[Music]
[Applause]
[Music]
look at this it is so
scaldingly hot back here you guys
wouldn't believe how hot it is look at
all that
ethernet interconnectedness
oh look at the switches blinking lights
here's our brand new melanox switch
[Music]
wow yeah that's our data center
look at our racks and racks
[Applause]
of 3d printers we got racks on racks on
racks that's what the rappers were
talking about
they're talking about racks look at
these racks
[Applause]
whoa crazy this switch is so loud
and we got more machines over here
[Music]
yeah the cloud boys the clouds
oh that's our data center here's our
big array of harnesses look at all the
different kinds of harnesses you can buy
look at all of them get your harness
today we have one for your car
it doesn't matter what it is unless it's
a ford then we don't have it but
it's one of those cars we have it here
all the things that fail qa
a surprising amount here's our big qa
board you guys seen this full of comma
twos look at that money boys look at
that money
all right uh yeah we have a vw harness i
think
uh oh these are gonna these going in the
computers
their new backplanes got a bunch more
computers there and guess what is over
here
even more computers these are going to
be the new ssd computers we're scaling
everything up
get ready for some really big models
we have a micro intern coming tomorrow
for the research team which like i said
we're expanding
the research team fast because we're in
the home stretch boys
we're gonna sell self-driving cars you
know it's been
five years we're gonna finish the
project
like it's what it is what we build uh
it's alphago it's really just alphago
tiny twist
uh you need to ensure two things uh you
don't have a uh you can't use a dynamics
model
that you hand coded like alphago so you
got to use it like mu0 you got to learn
it
um and then you've got to ensure that it
stays on the map and doesn't go off
policy
but there's great tricks for that it's
just a question of implementing all this
stuff and building it
we have a beautiful vision vector
feature space that's actually what i'm
training right here
um this is a vision model which reduces
the driving down to a 2048 dimensional
feature vector
um with one line i can scale this up
this is running an efficient net b2
but uh we can run b4s on the comma two
so you guys are gonna be getting a b4
uh we gotta make big model we gotta
scale the box up
uh but this is all
coming soon this is this is this is the
home
uh stretch i get i mean it's not you
know
it's all coming together about that
uh our goal is to solve level three in
three years
don't ever said i said some unrealistic
bullshit i did not uh
but yeah we think level three within
three years is actually achievable
um the definition of level three that
we're using
is every time the car is going to make a
mistake which it may still make mistakes
but it knows it in advance
um the problem's not hardware you know i
always say that level three in three
years
three years the photo coloring project
the photo coloring project is doing
so well oh it's doing so well
um let's go over to come
ai uh hang on just in case there's
secrets
can't show off any secrets yeah check
out common 10k it's coming along so well
they've almost labeled 5000 images and
give me a second i'll bring up some
stuff to show you
uh
you think i don't know how to stick
another camera on something
when it's time for the next camera it's
time for the next camera
we're still using like none of the
camera that's on there
the problem is not hardware get your
lidar companies acquired by scam specs
for 3.4 billion dollars
it's all the wrong way of thinking about
it
doesn't help if you can't solve the
problem of one camera
you can't solve self-driving cars
i tell you what the solution is deep
learning big deep learning
alpha alphago alpha zero mu zero
you gotta take it a little bit further
because we don't have a reward
function you got to deal with that how
do you deal with that stay in the map
right drive like a human right stay in
the map i think that's actually the only
reward function you might need
um so yeah check out check out the yan
lagoon paper i talked about it a few
times ago
what do you need for level five the same
thing just more of it
um now here i can show you what that uh
what concretely
what the uh new labeling is doing
so we have train train three
and here we go
so this is this is my uh trainer for the
segnet
i'll just bring it up here uh
i get this okay
um let me let me i gotta zoom this to
match okay
that's not even close to matching well
okay nevermind it doesn't match but look
at this so
this is epoch
260 with only 3 000 images labeled
and then once we've got 5000 images
labeled look at epoch 260 there
the val set and the law set are alright
the valset and the trades that are on
top of each other
um what we're saying about how it can
invert data
uh yeah so if you guys want to join
before the big take off um
now's the time tesla is not at level
three no
nobody is at level three
uh the deep learning model cannot invent
data
what like lane changing how do you think
we get the lane changing
how do you think we ground truth that
right just another deep learning model
um we have uh so the path
and i can show you i was writing loss
functions today in pi charts i can show
you the loss function
um
xx tools
so here uh this is the loss function
we're using
um so if we look
in i
think it's in model oh my god
why do you think the action space needs
to be discreet um
oh should i update my chrome chrome is
out of date don't know
uh why do you switch from tensorflow to
pi torch because pi torch sucks
now where's uh i think it's in train no
it's not in trains
super combo yeah there we go so
if you look here um we have plan mhpn
equals five
meaning that it's actually outputting
five possible plants
for the car
uh lift level five has a new kaggle
challenge
let's let's let's see what their kaggle
challenge is
oh it's 3d object detection
is this is this the one
ah god
3d object detection not something
anybody needs you think you're detecting
3g objects you're not
you're definitely oh we gotta we got to
make the thing reason
using this stuff because otherwise how
can we prove that it's good
you know you can't prove that it's good
but how do you prove that humans are
good
you can't yeah who's writing the cone
detector got to make sure you got a 3d
model for that cone
um
that's the old one what's the new one
did they did they give up on this stuff
did they give up on 3d object detection
what's the new one called
you think corporate espionage could ever
be a real concern for me
dude i tell you guys everything
you know you want to be a spy you just
got to uh watch the streams
they're concerned about corporate
espionage
why they were also on which ends
they no no no no that someone's gonna
come corporate espionage us
they're also i mean that'd be delightful
they're also
very uh concerned about the single
camera
single camera well they say you can't
solve self-driving cars with a single
camera
how can you solve some cars i mean not
with a single camera apparently
we're only doing single camera forever
yo guys we're buying lidars all right
luminar man luminar get your specs here
did you talk about that yo my friend
texted me this morning he's like
have you considered a spec yeah
no no no my friend from home he works
finance
um i think we should do his back
solve it with half a camera yeah now
we're talking
no no a man with one eye can drive
twitch did not give me a partnership so
i stream on youtube
now oh you're on youtube yeah
twitch didn't give me a partnership deal
did they at least formally reject you no
they did not
they just ignored you i'm i'm i'm in i'm
strings i'm in twitch purgatory right
now i don't want to pull any strings
either twitch accepts me for who i am or
i stream on youtube
hey if it's good enough for doctor
disrespect it's good enough for me
no come on this isn't a twitch stream
this is an official comic ice cream i
showed them the data center
for our official channel yeah i showed
them the data center i showed them the
money we should talk on our official
chat i showed them the money we've been
making
i showed them the 32 gpu pie torch
trainer it's incredible
i know no alex like this is this is it
we're in the home stretch level three in
three years
we're in the home stretch oh yeah just
combine new zero with
yellow goods paper one and one camera
guys can you drive a car from the eon
feed
what can you not do
no you can't why because you can't check
your blind spots well guess what
the hyundai sonata 2020 limited has
blind spot sensors
should we take them on a drive this week
uh yeah maybe
i'm gonna drive a long time no we
haven't
what if what if it throws a model lag
error we're fixing it i'm doing that
we're fixing it um
we gotta we gotta complain more we gotta
be more you know the model like
everyone's bad the out of focus hours
when you take when you take one this
week friday
yeah we're fixing it don't worry what
else are they complaining about i'm on
it
best car for open pilot corolla probably
still
when is this gonna be the best uh they
want to see you
if there's a physical thing they're
looking like they don't have any pants
on
they're like who's the other person
speaking you just pull a chair over
you're good
um
i like my i like my addition uh alex
wants your anonymity
uh you tried your challenge to get into
the company it's pretty hard but you
have an idea yeah and the challenge is
pretty hard nah it's not too hard
i've been sending out to a lot of people
uh we've we met on
linkedin searching for opportunities in
business
please stop messaging me on linkedin
some of the worst parts about working
here
the linkedin spam the linkedin's yo
yo yeah no the linkedin spam really um
so look come work here
and solve uh self-driving cars
for real uh you know with like deep
learning
not with well i gotta draw a 3d box
around my objects
and then i will gather all the boxes
together and then i gotta make fun of
everyone else's technique
because i don't know what else to do
you're going to get more boxes right
you're going to get boxes
and then someone's eventually going to
realize guys we can use the lidar for
more than localization look it can help
make boxes
flatter's worth a lot of money
[Laughter]
guys i'm calling it now spax are the new
icos
no they really are you nailed it yeah
um less risk
when launched the common token on
uniswap yeah
uh all right i see your dreams are over
we need to be able to map all the cones
in the world in real time
you need to know the dimensions of the
cone the
3d spatial position of the cone that's
how we're hiring the
person it's like like i say it is a joke
but like there's really guys doing that
you know
you know let's pour one out for the cone
people
can i get the thing the stick
oh you found the stick well we lost um
keyboards
wish i was two years in the future i
wish you were two years in the future
tesla has cone models i don't even know
what a baller it is
but you know who probably does know what
a ball it is the open pilot vision model
because he was trained end to end on
shit tons of data
um it's like doing it the hard way on
purpose you mean with the boxes or with
the end to end
i mean yeah there's some things that are
hard about the end to end it involves a
lot more like
thinking and debugging than just like
you know boxes can be done by very
mediocre software engineers
we could take they want to see the what
are they always like the dashboards oh
you guys want to see dashboards
ballard is a pole
uh what do you want to see on the
dashboards
oh tell you stats okay so um our total
miles
ever is 29 million
our open pilot models miles is 25.8
million
they've grown tremendously in the last
year
here's where around the world people are
driving right now
you see some over here in asia some here
in europe
you got you got a few guys over in the
middle east
no users in africa and we have no users
enough
we have brazilian users i wonder where
they are let's zoom in on them
nope oh wait no no they're right there i
can see them here on the route map oh
you can
yeah they're right down there yeah this
is like the density map of comma
um so i hope that the
uptrend in the deviations is fake
this is us measuring the average
deviations of
how much uh the model and controls
aren't listening to each other uh here's
our
devices we have like
1500 daily active users
almost 2500 weekly active users
yeah and a lot of miles like just six
months ago
we had 18 million miles it's amazing
it's like 50 percent growth
oh here's the four so colorful yeah he's
got forks dragon pilots kegman bagiver
shane um
uh do we separate miles of right-hand
drive countries no we don't
um we do separate the model now has a
separate
has an input which says yo are you
driving on the right or the left
um but yeah because you're on your
personal stream
have i thought about targeting
government organizations
as potential customers that sounds
boring
okay you know what just for the haters
on youtube
we're gonna do this once we have
thousands of users
are making hundreds of thousands of
dollars every month
are profitable have the second largest
network of self-driving cars
why would we like go out and like seek
out new customers or seek out investors
or change our business model you know
who should change their business model
everyone who doesn't have users is
losing millions of dollars every
month
right oh no no no no but they're putting
boxes around cones that's that's the
right way to solve self-driving cars
um now don't worry don't worry don't
worry if your box strategy doesn't work
out
you can just do us back i think the
sentiment is that they want us to be
successful
what's that with the questions oh no
yeah yeah i'm sure i'm sure i'm not i'm
not hating on the youtube people so you
know
i've been doing this for so many years
now and like
no one listens people are why do you get
the sense of people not listening
takes too long it takes too long for
them to listen
i mean yeah zooks did get sold at a fire
sale i haven't heard it from cruz in a
long time
who's thought about buying zooks
if someone has too much money
yo yo yo yo yo i'm a blind guy i'm gonna
hire a blind guy to lead me around
[Laughter]
what do you think the next thing we're
gonna see from cruz is um
well they're gonna um
take the crew's origin and they're going
to put up polycarbonate shields between
the seat
and talk about how the cruise origin now
is uh corona viruses
that one cruise origin cost more than a
comma
oh yeah yeah yeah um
i don't think people fully comprehended
that any big hardware in the next six
months
we so we we're now we have an official
policy now on hardware deprecation
all hardware that hasn't been sold
after it hasn't been sold for a year
it's deprecated in open pilot
that's the policy going forward i think
it's reasonable yeah
um so big hardware you mean comma twos
they already launched
big models on the other hand uh those
are coming soon to every comato zero
eight is going to be
a really nice release
you gotta fix the model x if it's all
plus we are gonna fix that
it's all gonna be fixed for zero eight
we're coming out with the new segnet
model finally
comma 10k is gonna uh
can we do a shout out for the 10k people
um
a shout out yeah shout out to pj lau who
else who else let's let's let's do some
shout outs of the people who i've seen
contributing to comment tom
comma 10k of course pj lau has been our
great coordinator
of uh of comma 10k i see
cedric ske
um i see vacu on here a whole bunch
let's look at closed pull requests
that's going to be a good one
cedric ske definitely spector 56
dr sleepless uh you guys are all
improving the future of open pilot
you know we wouldn't be able to we
wouldn't be able to to make the data big
oh
a thing that's already in the new models
it outputs
four lanes now and the edges of the road
guess what that's for
guess what that's for who knows who
knows why would i want
four lanes and the edges of the road
if my driving is end to end
could i explain that hd maps there we go
you guys know what's up
it's finally happening the trick to hd
maps
is you have to do the map making almost
entirely on the device and that's why we
have the localizer that's why the model
is going to output four lanes and road
edges
um and then the reduce is going to be
something cheap
because the reduce used to be so
expensive like we were doing all the
localization in the cloud and clouds are
really expensive
but getting people to buy the hardware
and then running it on their device now
that's a win
see it's a cloud but other people pay
you for it make sure to pay your comma
prime bill
[Music]
you don't only use your eyes to drive
you use the existing models of the world
yeah what do you think's inside
the the model you know what do you think
what do you think it's learning right
now
it's learning all about the world from
our 25 million miles of driving data
um the dude just asked that the common
two was suitable for tropical climates
where the heat issues i know there were
some issues this summer
uh they're going to be better next
summer as open pilot becomes more cpu
efficient we're going to do a slight
down clock on the cpu
um and then very happy about that i
think yeah yeah yeah the down cloth will
make a lot of people happy
it's running kind of at the edge
um because we ship we shipped also a big
driver monitoring model
the driving monitor model is an
efficient mat we quadrupled the pixels
when will common go ipo why do i want to
ipo i want to solve self-driving cars
distractions ipos sound expensive we're
a profitable
company we don't need to scam investment
banks out of money
so what's an ipo right sorry i might
want to work with investment banks in
the future i shouldn't say things about
them some investment banks have reached
out to us
oh investment banks uh
[Music]
there's autopilot work it'll work on
dirt roads do i ever re-watch your tech
crunch pitch was funny and insightful
yeah
that's all right um
stay private if you can we plan to stay
private
uh we don't want people telling us what
to do or trying to tell us what to do
why am i on adderall
no because george is not on adderall he
is on
hold on
[Laughter]
are the dashboards public no
yeah yo yak check we haven't we have
been on the yak check
the whole company yo check them out we
got a fridge full of them
come work here drink some yak check do i
recommend adderall
no follow your doctor i'm not a doctor
i'm a self-driving car guy
can you check sponsor us yo yak check if
you want to sponsor us seriously we'll
chill for you man
i'll put an ad on commodore i'll put it
out on the website
um you missed the server tour yeah
you can watch it later come on chill
later
i understand not just eyes but what i
see is interpreted in full details you
mean with your visual cortex
your comma two has one of those
yeah what kind of question is that um
boo dad on the comment two list of
people you hate
savage um
you guys missed the office tour uh
self-driving horses
we give a lot of office tours we do
merch plug
do you even have merch anymore new merch
is coming soon
oh the new merch is coming soon tm all
right all right hoodies for the fall
um not gonna be cheap though
oh yeah yo i just remembered it because
i posted in discord if you have comma
prime and you didn't sign up for the
trial and you're like
oh wow nobody remembered to cut off my
service
i'm coming for you i got 430 something
sim cards they're about to get
deactivated
by the way if you want to come work here
and write a cron job to do the
deactivation script automatically uh
full stack engineer infrastructure
engineer
react if you went to boot camps probably
not
no one who's been to a boot camp yeah i
know it's sad
um
what do sres really do everyone here is
expected to code
everyone's here is expected to be on
call when their code breaks something
you just prefer good i don't care where
you came from
elon has rockets man i think
you see he got rockets you know you just
got to realize that all you got to do is
type in a different uh
well the space station or
i don't know what do we want to hit with
the rocket you know
what's here icbms are rockets oh that's
sick bernie what one does have side
you don't have
you guys who do you think can drive
better open pilot or you
looking at the open pilot camera
what are you going on lex friedman oh
like streaming part two
it was disgusting i don't know am i a
part two guy
i think elon's a part part two guy he
was a part two guy i think you're gonna
be a part two guy
maybe
you should do it again i agree i think
we have something
uh after the thing next year okay
good thing yeah whatever you want
thing no no no no no i don't care if
you're about see
the problem with 2d boxes weren't that
they were 2d the problem is that they
were boxes
and a lot of companies like they put 2d
boxes around things and then they're
like
if only the boxes were 3d are
self-driving cars would work
they won't work better my
the reason follow-up was good yeah it
was different it was really different
but i thought it was good too
yeah i mean you know it was 2017 we were
hyping everything man we were hyping
brave we were hyping every every every
shit coin
and then you know by the time it's like
well you know bitcoin and ethereum bros
so what's the next big thing for this
four cameras
i mean obviously otherwise how would
people know you're rich
you know like show show yeah see look
people know she's rich
because she's got three cameras yeah oh
uh they're complaining about the sugar
in the month
look i told the team there's too much
sugar but you know
those young metabolisms are still good
it's at least oh look the caffeine's
organic
[Laughter]
um oh my god you can't drink this george
it has 33 grams of sugar in it do you
have one of these today
yeah it's disgusting
i mean drink your yerba mate it's a good
amount of grams
no i would i would appreciate 66 of your
daily total value is this why you want
dinner
no i already got dinner i went to i went
to crosstalk
does it need the uh sugar
no ah yo you guys make us a costume
we would like a custom reaction how many
what quantity do we have to order to get
a custom yak check
wait red ball has triple wait how much
sugar and red bull
[Music]
this is 34. wait but this
can it's a lot bigger than that is 16
ounces am i right
15.5 ah a red bull can
is 12 ounces
reusable rockets all right guys i think
we're good yeah thank you all for
watching the stream um
get ready to see the solution to
self-driving cars become
obvious in the next year become
implemented in the next one or two
uh if people want to come be our janitor
like we do need people we don't though
we don't see that's
the problem with all of those people is
they're going to require way too much
effort to manage
i don't know cutting thermal pads is not
very hard oh you'd be surprised
you know not everybody puts the boxes
together in the right orientation
[Music]
all right guys thank you for watching uh
big models coming soon open pilot 0.8
hiring a hiring a com ai
uh work authorized person to be our
navigation designer
we do the mean later yeah we're doing
the the bce logits
uh what do we mean outside
looking forward to the side cameras jump
in the discord
just a question if we were to sell the
commission camera how much would you pay
for it
yeah that's a reasonable question yeah
well everyone goes quiet yeah how much
a lot all right all right let's hear
some dollars sixty nine dolla
two hundred dollars oh they're never
getting side cameras oh
four hundred 500 to a thousand all right
now you're getting closer
yeah you're 500 you're you're getting
closer that's on top of a comma two
right
it was a special comma two with the side
the side camera edition
um 476 is it a 12k
camera 1080p
what do you guys think 1080p is that a
good is that a good number you're too
good to know
7 20. um no all right
did you show comment you're up 19.99
now we're talking that's a good price
for side cameras um we also have an
office in europe
i'm not allowed to go there right now
but some of you all are if you're
interested in a job on the open pilot
team
uh software engineers they're hiring out
at comma europe
uh software engineers that 1999 price
you know that's that's that's that's a
price i can get behind
if there's ever side cameras that's how
much they're gonna cost at least
at least yeah 2020
wow that's a better price um
whoa whoa whoa whoa whoa whoa cameras
don't cost twenty dollars
you gotta get a lens for that camera too
i think yeah
at least thirty dollars thirty dollars
[Music]
yup yup yup stocks are the same in the
eu
we open the door um
you guys it's not just the camera you're
buying the
the the the work that goes into putting
the camera
on the comma two you know the duct
taping the gluing
right that's labor that's labor you know
minimum wage in california is like 15
bucks
12. 12. in addition to a common tourist
do you mean 22
um
subscription model that's why we have a
firm
ghost on here no we control ghosts uh
the framerate's 20 fps
uh look man if some company says well we
got space age safety and we don't test
on cars i mean you know
you can decide how serious they're
charging a massive install fee
well what's the install i think 3 500
bucks wow we're
charging way too little you guys i'm
optional just to install
uh no no ml and eu only only open pilot
um wow and they're saying it could even
be more
wow all i'm hearing is that
i should go into shopify right now and
raise the price of the comma too
should we get the dice out
we're in here somewhere yeah who
remembers the good old days of rolling
the dice
why are those so good all days i could
be today two cameras buy two comma two
see
all right all right i can't i can't i
can't wait i can't wait
um
until
i don't know 2020 all included
that's not all included yeah by horns
too
i would love to access what more access
to can buses
what what do you think that the cameras
about the truck have to do with cam oh
the f-150
yeah i thought about buying an f-150
because i want to see if i'm a pickup
truck guy
and then i was like all right we're
going to pour it and pile up the f-150
but then i remember that it's the ford
and we didn't do it
so we would take another carport person
hd maps you guys know what's happening
oh yeah yeah we'd hire a cardboard
person you know what's happening next
year though with the hd maps guys
navigation key part of the road map
shout out to the chewing eyes club
um well com ever support the model 3 no
does android support ios
what kind of question is that yeah
um
yeah all right guys
thank you all for watching why do we
need hd maps for navigation
lane changes the problem with uh
so if you have most navigation routing
you have to know in advance when you
want to do the lane changes
you might be able to do it without it
but um
if you really want to get to level three
like there's a certain kind of hd map
that plays a role
it's not a role that's used for uh i
mean it's used for navigation it's not
used for precise localization and
driving
um i think we're going to use mapbox at
least kind of to start
oh i'm telling you someone brought in
today
alternative solution wait who
oh they trying to sell me some solution
it's correct someone from openpilot
reached out to them
you've seen it what all i know is if
someone's trying to sell it to you it's
crap because they can hire a sales guy
and not hire an engineer who's actually
going to make it good
it's not fun when you're not on twitch
you can't just go into your browser and
look at stuff
yeah that's true i don't like it it's
just watching me yeah
well twitch make me a partner um
no i want any government money guys it
comes with strings attached
we're talking about government money
you're talking about government money
yeah it comes with strings attached
before you know what you're filling out
you're filling out some like environment
and like you know how many like
you know americans did you hire or
something you know like
you're opening an office in europe you
took government money you can't do that
see there's just like rules then
um how would the model interact with hd
maps
you guys will see uh how would
think about it like this we're going to
get a camera
and we're going to get a waze and we're
going to point the camera at the waze
except it's hd ways and the camera is
virtual like that
very clear thanks for watching the
stream hiring.com.ai or something
what common device jobs yes yeah that's
what i'm talking about hiring
comma dot ai perfect bye
yo yo this is quick today quick stream
guys quick stream hmm
wait for all I should go at least put it
on on Twitter yeah well we'll do it with
the Subaru harness is live nick is alive
on the site right now no wait what
I don't have Wi-Fi or something Oh yo yo
we live we learn Subaru varnas going
live wait hang on I got to find our
Channel I got to find our channel I'm on
Twitter what's up we got an announcement
for everybody here in a minute in a
minute
youtube.com he's alive
hey come on there's a lot I know I just
push it to the uh-oh no push is what
side yeah yeah
alright alright alright alright alright
alright
when's the test jumper coming oh no test
Jarek but if you want to see the new one
logger I can show you that check it out
I wrote this beautiful UI myself this is
like engaged it's like Explorer of it
fast
alright I do we are we good
live chat welcome to live chat oh yeah
you think July go again why I worked I
worked hard on this UI that's the speed
of the car so then like you can see this
is like you I you know yo yo yo alright
hello world it's a short announcement
today just short announcement think like
too short
I blocked Twitter in my Etsy host file
because otherwise I just go on Twitter
all that how am i doing today we're
doing good today
what do it good today alright I don't
really know there's not too much to say
in live streams this is gonna be mad
short but um so this is uh this is open
pilot here if you go down to supported
cars we already support the Subaru
Crosstrek and Impreza we also have a
pull request which means we're gonna get
support pretty soon for the Subaru
Legacy and the Subaru Outback no
promises on those but if you have a
cross tracker and present today and you
buy we're gonna refresh this webpage in
a little bit but first we're gonna go
for a walk
these are Subaru harnesses they attach
to your black panda in your harness so
this is just the standard , 28 pin
connector and that's your pass through
four Subaru neither of these connectors
is 3d printed they're both real
connectors why nobody's gonna come to
the stream today we didn't announce it
we didn't plan anything but Subaru do
you see what this says it says ready to
ship so that's just because it's ready
to ship do you have any comments on the
on the Subaru harness oh oh there's all
secrets Oh secrets Wow
wow there's so much so many leaks in
here no no nope we can't have any leaks
does anyone does anyone have any
comments on the Subaru harness eyesight
required yeah it should work with all
cars with eyesight all right oh no I'm
not you they can't see your screen don't
worry Wow wow this is this is this is
leaked said Julia wow there's so many
leaks going on and there's leaks on this
ticket what is that thick you know it's
a tiny leak is there any leaks here
where leaks rinche weeks all right
that's it for leaks let's we'll just
wait till it goes live right now but
with the Subaru horn
Subaru is it live yet it's not live yet
but just so you know we make the
development vehicle this is like that
stream when Elon announced the model y
and nobody really cared it's like that
but we're announcing the Subaru harness
let me go get a Subaru harness so I can
hold it up every time I say Subaru
harness I can't show you oh
leaks no no no we're walking down here
so so nobody can see any leaks no leaks
no leaks no leaks no we will show you
the datacenter you know I love showing
off the datacenter wow it's beautiful
it's so big we did can't leak to you the
door code well they're gonna be
analyzing those leaks for a long time
yeah oh you wants to print a farm we
gotta go look at printer farm this is a
Subaru harness print farm Civic
Oh Oh is those FCI not launched yet but
that's an FCA connector walk so don't
worry you didn't miss anything we're
just launching the Subaru harness today
we have a black band around our harness
thingy that I can plug it into so this
will be mounted inside your Tsuru it's
the same one that goes in the Civic in
the Toyota Subaru harness if you by
Subaru harness for $400 yeah one only
half only half the FCA is this alone
yeah look at that look at how satisfying
this Joe anything to say about the
Subaru harness yeah with this is what
we're showing I haven't even seen this
oh look at that Wow it's like is it nice
nice plastic huh yeah okay are these the
real we didn't print these no no we're
together right don't plug it in like
that when you get it it intercepts your
Subaru it should work with all new
Subarus with eyesight I believe and you
see this it passes through five of the
wires the Subaru harnesses back do we
have the old Subaru harnesses around to
show them now it was bad it was bad we
sold three of them so I'm hoping Gilly
I'm acknowledging your message by a
harness for your Subaru today when it's
common doing an IPO that's a
forward-looking statement I'm not
allowed to say that no you can hack your
own Subaru with the Subaru harness buy
it today prevent low speed lockout oh
I'm excited about the smart TSU
intercept you're gonna sell them what is
it going live alright why don't we go
live to our sales team and we ask when
they're going live
Subaru harness : life super harness is
almost like we got we got 81 people here
they're very excited for Subaru harness
it's gonna be a 20-minute yeah hey you
know do you have any comments when the
Subaru horn is good any comments on the
Subaru harness it's finally time whoa
whoa whoa no torquing acceptors Petar
see how thank you for buying one you
make it worth it for us you're just
gonna drop down I think we're adding
reading uh just crosstrack and uh yeah
cool and that sorry is it on the leg
harness nice nice Subaru now officially
supported by comma a we're doing FCA
soon to sew the harness you know harness
technology Oh exclusive leaks for come a
prime subscribers okay everybody else
cover your ears wait wait we actually
have an exclusive league for come over
I'm subscribers we actually have one
can we easily show them take pic they
ask for leaks for common prime
subscribers yeah yo check this out look
at the pictures it's taken pictures
right now alright so this is the
front-facing camera and this is y'all
look at me it's me guys look we did it
yeah so that's an exclusive that's gonna
be a comma prime exclusive feature
you're gonna be able to take a picture
with your car make sure to sign up for
come from before we rate the prices yeah
yeah gamma prime prime just incredible
do you intentionally stream on data to
minimize leaks no not streaming a data
eric moraga whoa finally something cool
baa what what we'll celebrate with it
when the Subaru harness goes live I
don't know what that is look a
skateboard ssh become a prime now with
camera
wait youtube showed you an ad what am i
getting new revenue for that i don't
think so the leak I think we cover like
50 something cars yeah yeah so just so
if you already bought a harness for some
reason um you'll be able to buy just
this table for 50 bucks but if you buy a
harness it includes the harness it
includes the common power v2 it includes
the Black Panda yeah we'll buy Google
man no you know what we'll buy like one
of those car companies one of those
American car companies when they don't
get bailed out we'll bottle that's right
and we'll fire everybody and replace
them with robots
so saya any robot any roadmap for flex
right cars no you are out of luck buy a
cheaper car bro trade in your car you
know when you go to a dealership you can
trade in a car and they'll actually give
you money if the trade-in value of
hire the new car don't buy GM um if I
buy Faraday future yeah bloated
I'm fingerprinting to point out yeah
we're working on it we're working on it
what was the unlocker stuff is just
something that's what I've been working
on this week it's actually already like
if you go and open pilot tools and you
look in Nui how's the sound division
doing sound division is killing it we
love the new sound clarity uh-oh I don't
know about that one oh yeah I'm sorry
you bought a weird car if you trade it
in your car you'd ask for money well I
don't know how to uh leaks all right
let's see this is my new auger Dearing
controls for
and you Pam but their their $50 black
panda , power v2 includes the correct
wire for your Subaru USBC cable Ethernet
cable and that's what your yun looks
like mounted well these aren't leaks
this won't live a while ago you want to
see leaks these are the websites that I
block um is it lagging he's a quality
bad oh wow wow it's real potato quality
that's bad that's low-quality crap Queen
increase the quality
wow that's I don't know man that's bad
but ya know Subarus gonna go live any
minute now
we'll just sit here we'll just sit here
I'll wait with you guys while suber goes
live no I'm on my Wi-Fi I don't I don't
get it
Oh yo you know what I got in the mail
today but I don't have it my air pons
air pod pro that was no leaks on the
board the second I'm paranoid about
leaks Oh Oh guys guys it's live it's
live right now you can pick your Subaru
Crosstrek or your Stuber Oh impress out
and you can add to cart' you know what
this guy's a known hater you know what
happens to known haters hide user on
this channel perfect uh-oh the accordi
PS oh you want to show me according PS
[Music]
yeah so so Subaru right they're only
three ninety-nine that's a good price
you're good bro I like you I'll give you
a harness for 399 super easy just buy it
right now I'm just gonna check quickly
to see if anybody's buying it you know
what if we've sold if we sell at least
if we sell three of them in the next two
minutes we're gonna show you guys the
accordi PS but if we don't sell three of
them we're not showing your decoy TPS
anyone buy any yet come on bye bye bye
no one's bought any yet if our harness
is a fantastic product thank you
where's nougat cosmos leagues leagues
all right let's go and just go ahead and
see what the live live leaking situation
is Subaru people yeah come on you know
you want to see the accordion you got it
you got a buy no super people buy
anything
Oh Subaru
oh so quick all the leaks got covered up
the leaks are gone oh you didn't get any
leaks people might be buying a Subaru um
if you're going out and buying a Subaru
may I recommend it to Lyoto Corolla but
if you're
the situation will you already have a
Subaru come on we go we got we gotta
sell a few of these zero sold so far but
only 90 viewers I know I know I know
because we didn't do any real press for
this because it's like you know it's
low-quality crap you got an exclusive ,
prime leak yeah take picture bros mah by
subaru but also another thing if you
don't have a harness for your car you
should get a harness even if you don't
have a Subaru um
Oh Bugsy I mean if yours has the same
pin outs as ours and you're using the
same harness absolutely keeps telling
him we're just we're not making a lot of
money on these cables that's why they've
been debunked glad you enjoyed the
medium article 2020 Corolla hybrid I
think we fixed that oh sorry we fixed
that in the secret good version of open
pilot don't fix it
it's up what if you buy a hundred two
weeks from now if you actually want to
buy we have we have bulk discounts um
we've gotten a few orders in the last
couple weeks of 10 Yuans
and we offer decent discounts for buying
ten so you can just reach out supporter
comment I have you're serious about
buying in large quantities if you're
buying a hundred will give you a
phenomenal price yeah
oh yeah zero six six I think I think let
me just double check but I think zero
six six is gonna support the the Corolla
hybrid yes alright alright you want to
see some more leaks I'll show you some
more than leaks leaks thanks walk so
alright guys I'm glad to have you all
here with me
but unfortunately uh I don't think
anyone uh yep no people and he's super
honest I really does anyone actually
have a sugru or is it just trolls oh
crap that was a leak
oh we leaked that oh yeah yeah yeah yeah
Jay Young has done a great job we're
super happy no trucks no how many
versions before zero seven well that's
that so that's too much of a leak no I
think the issue is that nobody actually
has a Subaru if you buy if you buy your
stuff today well I promise we'll support
your uh your Corolla hybrid by the time
against their depends you know like I
know some like I know some like like
people who have Subarus but they're like
Subarus from 1992 I don't know anybody
who buys a new burro
so I'm just I'm just okay so we sold
exactly zero Subaru harnesses so guess
why uh you don't get you don't get to
see the uh yeah if you buy me a super
exactly exactly
oh you have a nineteen Forester all
right let's the point that soon I think
I think of all the cars have it now you
don't have a neon yeah yo okay I'll show
you guys I'll show you get yeah yeah
we're working on the Outback but we got
we gotta merge that I know I know
ten sales ten sales will be great you
mean ten young sales that'd be
phenomenal who'd be so happy with Kenny
on sales but I did leak how much money
we made this but we're rich boys
Subaru's torque seems pretty good yes
super or nice cars if you get over the
fact of our supers but I don't mean to
discourage anybody with the Subaru if
you guys were if you guys were all you
know buying up this harness really fast
I'd be like man you guys are all great I
love Subaru people but well nobody buys
anything well you know how do how do I
handle em how am I supposed to feel um
but I believe in you Subaru people I
know that maybe you take your time to me
to make a decision
I'm not running ads I don't know if
there are ads if you buy a Subaru
harness right now will I make the Kia oh
they found out one yeah yeah we're
working on that you a Kia kiyow kiyow
Hyundai are the same car right superhot
is canceled out now when I cancel it
anymore
okay we know we're doing we're doing the
q1 as well
all right what other what other car
ports we want buy a Subaru one right now
and what we'll do the key light will do
it even if you don't buy Subaru harness
but somebody's coming refresh on the
sales page nope nope nobody nobody buys
Subaru harnesses but if you're excited
about that , prime leak make sure to
find kama prime go in your comment app
is very convenient and easy it could
somebody please buy us a new harness
Great Wall SUVs I don't know about that
nope we're just gonna we're just going
to leave this stream where absolutely uh
you know last time we did the super
harness we sold three how many people
have a Subaru that open pilot
I can't believe nobody bought them
either this is the website broken Subaru
harnesses are a great deal okay they're
only 399 for your Subaru I mean it makes
your Subaru like like way better you
know those things you forget you have a
Subaru oh because you already all have
harnesses okay oh I think we can check
the stats yeah bring that up once I'm
fingerprinted vehicles relative let's
say 30
oh you can't process payments what Oh
let me show to work um almost you guys
are early adopters who already bought
all right cool I know we're not going 30
months ago although 30 days ago I will
update let's see oh oh oh we see you
here
here we go so our most popular car of
course is the toyota prius followed by
nun civics see RVs vaults city civics
Corollas Accords Corollas rap fours
Accords rap fours
Honda's Odysseys Camrys rap force
Accords CRV is Camrys we hyundai oh oh
there we go
15 Subaru Impreza limited
there we go that's Subaru I think
they're all upstream cars yeah Wow three
likes on the three likes on the on the
Subaru and one of them's our car to help
your parents have a Subaru
I add more add more yeah yeah yeah what
will it more but this isn't encouraging
this isn't encouraging for Subarus who
set up I acknowledge them they were
gonna buy one can you get a tutorial
yeah if you search for open pilot
carport and do a medium post I did all
these leaks for you I won't be pretty
bought a harness alright alright alright
well you can't process payment I don't
know what there's no new hardware you
guys got the new hardware the new
hardware already came out it's called
the car harness go check it out it's not
a pin post on Twitter
you'll have to wait till 2020 I knew we
all know I don't know about that yo if
you guys want to see how many lay echoes
we have to continue making yawns Gilly
come on and cold quick let's if this
dream gets to the 30 minute mark and not
even a single sugru harnason soul I'm
just gonna I'm gonna sit at my desk and
I'm gonna go get ice cream actually
that's what I'm gonna do and you know
what if one is sold I'm gonna go get ice
cream too but the difference is that if
one gets sold it's gonna be celebration
ice cream and if none get sold its gonna
be feel better ice cream guys Legos are
the future toppings where's no toppings
now we're not getting toppings we're
going to a shukshin scoops no no no
short lestrade that's it okay okay okay
at least we got seven likes on the on
the Subaru harness no no no no we're
gonna eat a moderate amount of ice cream
we're gonna eat in moderation Wow
well you know what I was thinking about
doing a stream for the FCI harness but
now there's no FCI harness stream and
you know why the FCA people the FCA
people can blame the Subaru people for
not buying any Oh nonono shippers /
shippers / you know why shippers / guys
because they're no longer giving us any
free cloud money when they gave us lots
of free cloud money we ran chipper and
then the free cloud money runs out and
then the shipper runs out cuz shipper
didn't you know make any money but
apparently Subaru harnesses don't make
any money either oh no oh yeah you know
about that is that Arduino Uno that's
what I'm talking about yeah I don't know
I don't feel like streaming on Twitch
anymore this is a stream that you get if
you want if you want to stream this is
the stream you get 30 more seconds of
stream come on come on buy a super
check them an Apple watch
quick Gilly get in I'm just gonna show
you guys the accordi PS I'm gonna show
you more great leaks but nope nobody
blows horn all right we'll see all you
later thank you for joining me for the
stream have a nice evening and today we
learned the truth that there are no
people out there who actually own a
Subaru just people who say that they do
bye bye
yo yo
wanted to show you guys
this can be a quick video
[Applause]
foreign
I gotta put these rails in that's my job
[Applause]
today we gotta take a rail
let's look this is a left front rail
once we put it in
here like this
I'll slide this guy out
there we go
this is a right front rail
uh yeah yeah we're hiring for
infrastructure
if you want to come to Common work on
infrastructure let me know
all right we gotta we gotta Slide the
rail we gotta get that
[Applause]
yeah see this one's hard because because
we don't have a big hole it's only a
small hole
[Music]
yeah there we go
[Music]
[Applause]
[Music]
right front
[Applause]
and there's the computer that's going to
go in
[Applause]
thank you for watching it's probably the
70th largest supercomputer in the world
if you go by the list okay there's
probably other secret ones but um yeah
actually I'll show you better
[Applause]
we have uh a100s
a100s in our in our uh small compute
cluster uh top 70 supercomputer
hoodie logan paul with maverick by logan
paul
i had a sad realization about maverick
by logan paul but we're not going to go
into it because this is a happy twitchy
happy twitchy hey all right
you listen to that noise it pisses me
off bros
all right let's go
we have today's song
it's dead island by kitty pride this is
this is this is
dude this rap is just fire bro
no but like yo
you don't know why all the boys flock to
me bitch draw your eyebrows on then talk
to me
that shit is fire alright
so now that we got some people in here
we'll listen to one more kitty song this
is this is another this song is
beautiful as well it's called florida
um i don't know what happened to this
girl
let's see what she's up to let's check
out wikipedia this promise is not all we
do on this
she joined some indie rock band miami
garden club was not that good of an
album sorry kitty pride
um
but this shit was fire bro
here she was dating this guy named hot
sugar
[Music]
this is maverick i don't know i don't
know what it means
this is back before she had like blue
hair and shit away
and i promised i'd be gone and forget it
by 2012 and i thought if i got i'd never
visit i wanna talk and think you're all
a bunch of bitches and never listen i'm
having positive smallest that i could
fit in
getting restless and a fidget and i feel
so great in the city
[Music]
oh she's beautiful bro
you don't balance shit for our work is
life go hard
disappear and never stay i'm spirited
away i don't think i'll make it here
another day
this line is
[Music]
[Music]
deep breaths kitty very brave face chest
out remind myself i deserve this even
though they'll be whispering that i'm
worthless my mama said to show them what
i'm making of the day where you know it
all and that's what i'm afraid of
fire bro
[Music]
[Music]
i bet kitty bride's a nice girl
i mean she has some issues to get over
but
you know like that's fine bro like
taylor swift here's the thing actually
taylor swift sounds like a nightmare
imagine they had reviews
like like could you like look like like
it's like yo you guys know glassdoor for
jobs
imagine there was a glass door for
taylor swift what is dating taylor swift
like i don't know
uh no more over the wire games no no no
no no we don't do that shit anymore but
what we are doing today is we're going
to bit bang gm lamp so these are common
ai pandas
and this is a kana ai debug you guys
know where you can get this you can get
this in the store right here at shop.com
ai which is fire bro get it right now go
to the store buy
buyer things
i'm like a real twitch streamer we have
products buy them at least buy a t-shirt
you know support the cost twenty dollars
include shipping anywhere in the
united states even
i believe hawaii and alaska if anybody
actually lives there
this is a comment and i debug right here
so this is the debug board
um so it's 100 it's beautiful if you
want to debug your code
it lets you set up some pandas on your
desk
that's what we got yeah today's a big
bang bro banging shit this is a sunday
special no slam today look at this thing
look at that diva board all right so
you're just like plugging a panda here
i build up my powers and tower 2
and devour you cowards i'm spending
hours and hours on sims and sour patch
kids
uh a controller for what
yeah no amazon bro we're gonna do that
we'll do that we'll do that but all
right so we got some paws we got some
pandas
so
pandas have a
bunch of buses they have
three cans two limbs and one gm lamb
i'm real tired
uh
i had a friend over
last night and we stayed up all night
kind of
i don't know i was kind of awake all
night
but you know like all these things we
got yerba mate your vermont is great
brought to you by yerba mate
and the comedy i shop where you can buy
all these great things
no i'm not creating shit bro
i am
not creating shit
that's right
um
yo well wayne with his deposition
is fire man he's like
wayne did you did you mr mr dwayne
carter did you did you hire a
photographer to to follow you around and
take pictures and
lil wayne just looks and smiles he's
like
yo
i'm a superstar man i didn't hire nobody
i got people to do that for me
will wayne
is great
we love lil wayne all right but
bro we shall plug it in the debug and
now we should have two pandas connected
to my computer
let's see if we actually have two pandas
connected to the computer we're here in
the gm land folder that's right look we
have two pandas with different serial
numbers that's just five bro
all right
oh man i don't know if you're actually
good i mean if you're not good enough to
work at google we don't want you here at
comma if you are good enough to work at
google maybe we want you um you can
apply our hiring process is hard
we're kind of brutal
i actually have work to do you know got
to know things you know things all right
so let's check out the panda repo this
is open source code
um
so
the problem
is this
the chip that we're using only has three
can buses
can one can two and can three
now the gm lan is multiplexed with can
two and can or can three so basically
you can only use three at the same time
but the vault needs four
so we are going to write bit banging
today to try to get
all four at the same time
all right
let's create some new tests
oh i know you don't like my coat over
there we'll go there
close out the kitty pride stuff
she's beautiful though cloud wrap dog oh
this isn't a snowman song
snowman it's like young echo
now
snowman
packages from overseas
no no that's actually practical charging
up my solar beam
yo you guys know that venusaur shit
yeah that's what i'm talking about
xavier wolf oh how could i forget xavier
wolfe
soundcloud clown rap bro
they use cookies
no
no how is snowmen by xavier wolf gone
how do i find on youtube
by people who i don't own any of this no
copyright infringement intended
guys that line is absolutely fire
dreams come true do you think about me
too i got gucci on my shoe i got you
google and my crew
that's fire make sure to like and
subscribe to snowman song
okay so the reason we're not receiving
anything is because the default safety
mode of pandas
is
to not be allowed to send
so before we send we gotta do p1 dot set
safety mode you know that fire safety
mode that lets everything be sent that's
one two three seven that's right
um okay well that didn't really work
still i probably need to sleep you know
sleep bit
it should be okay so you can see that
when i did that this panda here
turned green
you like this
nice bro
all right
um so we're connected to both pandas we
set the safety mode one camera set the
safety mode cameras
this is a test no safety
you can actually use the proper define
tool
safety all output
okay
does that jam land not work or something
or do we not loop back the gm lan or
some bullshit
okay like it works as long as i'm
actually on bus two
but when i set gm lan it doesn't work
oh
do i have to use this define how's this
defined
well that's a joke
gm land can two
well that's really confusing i don't
know if anyone's actually used this
stuff
okay cool
so that's being sent now i believe over
gm lan i can't be 100 sure about that
because this is confusing as shit
let's try on three and see what happens
ah i know a way to be sure it's actually
being said on gm land
me change the bus here to none
not received
okay so that's not being sent on jamlan
at all
timeland can two gm lancam3
now bus equals two is fine actually
do i just not loop back the gm lane on
the debug
do we make the schematics public for
these
i'm actually logged in let me make sure
i'm not logged into github
i'm not logged in cool this is all
public
let's see if we made the schematic i
think we did
oh but of course
i have to open it in real eagle
i got gucci on my shoe i got you google
and my crew
gotta rename it to the right thing
so eagle will actually open it so let's
take a look at the hardware here did we
link the gm lands we did link the gm
lans okay that should work
you see the gm lands linked right there
so this is the schematic for the panda
debug board
um
oh does it need no it doesn't need
termination this doesn't make sense
does champlain just not work i don't
know if anybody actually tests this crap
i'm not selling shit to pan to waymo or
google
bro i just don't care
why do you think i care that's a great
question
all right
so i don't know why this isn't working
um
oh i know why okay so when you want to
say okay i got it when you want to send
on gm land you actually say the bus is
equal to three here
um we've changed it so wow this is
confusing how does anybody actually use
this product or a piece of shit uh
so to send
on gm lan
set bus equal to three
so it doesn't matter which one you
actually set like if i set this to three
or actually if i set it to one
it'll just multiplex it the other way
and that should still work
so what's basically going on here
and you see that it's being received
right here on three
what's basically going on here is
well panda's not an open schematic but
we can take a look at this
it's actually in panda
i got gucci in my shoe i got you google
and my crew
so this is what the pin out of panda
looks like
um
this gm lam is like an extra can but
when you enable gm lan
it replaces either can two or can three
now what i'm working on today
is a way to
uh bit bang gm lan
such that uh
you don't need to replace one of the
other cans in order to use it
i have some command to get the version
here don't i
self.getversion
so i don't actually know what versions
on these pandas
i don't know why opening takes forever
okay cool so one of these has released
and one of them has a newer version
debugged now of course we can we can
build the panda code like this
if i go here to board
type make
it's actually going to build and program
a panda
now
you'll see that it went in constant
flash in green mode
and the reason
tilt this down a little bit
the reason it's in constant flash and
green mode is because this panda is
flashed with a release bootloader and
the release bootloader checks the
signature
i upped the brightness on this monitor
and it's brutally bright
just turn that back down over here all
right that's better
um
it's a little too dim we can make it
brighter
your little peeps dead bro rest in peace
he lived a real life you know
so we can do maker cover and that's
actually going to reflect the boot
loader on the panda as well
it's downloading using the dfu flasher
okay cool
oh you see that panel detected look at
that look at that fire bro
usb
panda.comconnect you can use pandas
right from the web browser it's pretty
nice um so panda is an arm processor
um
but yes and now you'll see when i print
the versions
yeah you see how this one is on debug
now
so that was pretty easy to do very easy
to use code all of panda is completely
open source it's developed bizarre style
i'll probably push this to the panda
repo after done with us
okay
um
so now after i did that one reflash we
can just use make
because now it's just flashing the main
code and not the bootloader and that's
fine because it's being signed with the
debug cert
okay cool
so
what we actually want to do now
is be able to set gm lam to bus none
and we want this shift to bit bang
but it's right now it's not big bang
because you didn't write your big bang
so we're probably going to need to go
downstairs and get a logic analyzer or
an oscilloscope so we can actually see
what's going on because we can't see
what's going on life is difficult
you guys know lg life's good well this
is life's hard um that's too bad
who's thomas
uh no i only fall asleep last night i'm
pretty tired
lh
uh
i'm never going to deathcon again fuck
that gun
some of you might have heard my rants
about why but
let's just say like my slogan is keep
hacking elite
and defcon has been moving away from
that
um
it's a conference right
and the problem with all these
conferences is you have a whole lot of
people in the world like liberal arts
majors who don't have jobs
so the problem people don't have jobs is
they don't have anything to do
and they show up to conferences and they
become what i refer to as the perpetual
conference class they're at every
conference you name it they're at basket
weaving conferences they're at hacker
conferences
they're at uh they're at um
and just anything there's a conference
for the real professional conferences
are a little bit exempt for this but you
know you want to go to a nascar
conference you're a football conference
it's all it's this perpetual conference
class that shows up
and they are you know political they
want to push an agenda
um so
and the thing is
their politics are this relentless kind
of everything must be political
so what you end up with is kind of
politicized conferences where defcon
used to be about you know let's let's be
hackers let's be elite let's be hacker
culture
it's drifted away from from hacker
culture to
anybody can use arduinos to be a hacker
okay
that's not where i'm showing up
um
i think there are still some i hear ccc
is actually still pretty good um maybe
i'll go this year
you know what i mean y'all know what i
mean right
okay cool
so
[Music]
i have to make this a little bit smaller
i'm sorry about that so i can see
where is this code
well
so we can go to the main and we can find
the set gm lan command
click can set jam way
i did write this code that doesn't mean
i remember how it's laid out
okay so set it's the set can
mode
gm
off
is that defining gpio
okay so here's where we actually set
the can mode
and it looks like it's
gm lan is on either b2 or b
b12 or b13
okay isn't the defcon seat the f4 i
thought i don't know i don't really play
cdf anymore
um maybe i'm not sure who's organizing
it
um yeah comma comma we could definitely
use the c plus library for panda if
someone would like to write that
we certainly appreciate it um
okay so we'll even make it backwards
compatible with rev b
we're using pins
12 and 13. so we can go to stm what's
the chip inside the panda it's f4 it's
this
this is a reference manual this goes
into like everything you've ever wanted
to know about the chip inside the panda
oh i think they have pin outs in here
no this isn't what i want
um we talk on the panda webpage about
what chips actually in the panda
this chip
just get the data sheet with the pin out
so we can know whether we have to bang
on
we have basically we have to figure out
which ones transmit and which ones
receive
so this is the chip that's in the pan
now
uh and we even have which no no no it's
this one
lqfb64.
so if we go to
b12
maybe this what's on these things yeah
here we go
it's called pb12
here we go
so pv12 is can to rx
so
what we want to do here
that sets gm land mode
but okay so if b12 is rx then
pb13 is tx so that's the one we're going
to want to get
13.
you do this anywhere else
i think we call set can mode
in setup or something yeah okay cool we
i should call that
so we're good banging on pin 13.
no i didn't read all the things um
all right guys we should really just go
get an oscilloscope um so i will be back
in a little bit with an oscilloscope
my microphone is acting up a bit
i'm sorry about that yeah i want to be
an engineer man i hope i don't have to
be the social media guy forever
there's no future in social media
it's add
well
okay guys
do you want to just do it blind let's
just do it blind
let's just do it blind i'm i'm um this
is hardcore it's not gonna work
but we'll try our best to actually just
write it first
um
so if
let's just write if bus number
equals
we'll make a function here called bit
bang
gm land
so when can't send this call it's going
to call into big bang gm land and we
actually have decent debugging stuff on
pandas called bit bang jim land
so let's see if our debugging stuff is
going to work we can make here
land panda test we have this thing
called debug console
well that's just because it's building
cool
so that's flashed
yeah look this is all the old messages
so let's try this now let's see if big
bang gm line gets called
yeah cool so you can see here
called bit bang gm land and that's on
green panda not red band
um
guys i'm coding at c why does torvalds
love me
love me
um
okay
so now we actually have to do the bit
banging of the gm lamp
so can
which is the same as gm lan it's the
same it's the same exact interface
um
let's see who's bit banged can before
i think implementing the can protocol in
firmware only will be difficult and will
take a while to get right it is not a
good idea
well we're gonna do it
so let's look at wikipedia i can
and we can even write
slow-ass shit right now
no no no no here we go this is what i'm
looking for right
so
it looks really easy it looks like we
just need to send those bits
let's first try to send exactly that
message
so what speed is gm lan
who's going from zero oh
is my stream
lagging
um so can high is going like that and
can low is going like that
see that's the thing i don't even know
from the output of the gm land whether
we want it to be high and go low i don't
know whether high is one or zero is one
but okay you know what let's just let's
just make a function we'll extract that
we'll try both ways
like pete wentz
cool
and then we'll clean this up and we'll
factor this out into like uh oh yeah
you guys i swear i'm not high today
um i did have coffee and mate
i just spoke with yesterday yesterday
was good day i went for a hike hiked 12
miles yeah
it's hardcore
you hear that buzzing do you guys hear
that
the lights in this place are broken
um set bitbang gmlan so we know
set gpio output
gpiob
you know which gpio it is so it's gpio13
b and we'll just set it to a and then
maybe try later we can try not a
okay
so
gm land speed
you know what we actually just have the
speed right here in the uh
no no no
here we go
yes 333 so we're we're bit banging at
33.3 kilobit
let's just type literally this packet
out and hope we get something good
and a frame is ones
is this a thing i don't know whether one
means driven or not driven
so you guys see what i'm copying here
remote transmission
request
must be dominant oh yeah get it boy
dominant for data frames yeah let's do
that
ide
yeah that sounds good too
reserved
where do you set the speed so you can
call there's a function panda which will
set the speed for you just say uh char
[Music]
test
packet
backslash value probably
must be dominant but accepted as
must be dominant but accepted as either
dominant or recessive
plain
okay we're gonna need to compute the
stupid crc but this looks like it's just
sending a one
first byte
another crc zero one zero zero zero zero
one one zero zero zero zero zero zero
zero zero
the crc i count the zeros right one two
three four five six seven one two three
four
no i counted them wrong
crc field is that 15
how can we check if it's 15 bros
python
this should be 16 which is 15.
cool
don't think just type
now crc delimiter must be recessive cd
limiter
[Music]
ack
[Applause]
one two three four five six seven
i don't know i don't know what version
of c this is or some crap
i less than size of test packet
you guys only see me coding python i can
code to see kind of too
i'm trying to work my way up the social
media guy
all right
so we want to set big bang gm land test
packets of i
and then we want to delay
now there's a few ways to do this but i
think what we really want to do we're
going to have to go back to our
reference manual here
is we use it one of the safety modes i
believe
just check it
we want to find the timer
by the way if you guys are new to my
twitch i love it when people give me
money and subscribe to my channel uh one
day i'm gonna be a famous twitch
streamer and you guys can say you were
at the beginning
well i mean so really what we should
probably use here is a timer
should we just set it up with a timer
now
no because i'm going to mess that up
there's an easy there's an easy thing to
do right now
we do it in like safety toyota i believe
uh
used next time no i use like real time
yes gets elapsed wherever this function
is
get yes
last
i'll do a recursive search of oh it's in
safety.h
you guys make me use a really big screen
so you all can see it i hope twitchies
appreciate this shit
no not get okay this isn't even what i
want
what's the input to get to yes so what
i'm trying to find now is a
rt interval
no where do i should get ts from
okay timer two dot count
so i don't actually know the speed of
time or two
but what we're gonna kind of wanna say
is
a knit
speed with three e's
say a thousand a while
timer count minus the net
is less than speed
cool
so that should be
yeah thank you for subscribing yeah hey
thank you for subscribing to my twitch
channel it's the best twitch channel
um
okay
so let's try to figure out where do i
set up timer to
maybe we can try to figure out what unit
it's in
or maybe i wrote a comment about this in
safety toyota
see bros this is why you gotta comment
your code because even when you wrote it
you don't remember shit
um
so rt interval so it looks like it's
milliseconds
no it's not milliseconds it's
microseconds
so if we have 33.3
kilohertz and we want to know how many
microseconds that is
so it would be the same as 33.3 hertz
and
oh god my head hurts that's terrible um
okay basically how many microseconds do
we want to sleep for between each one
so if it's 30
how many microseconds in a second one
million
divided by
33.3 times 1000.
oh 30. beautiful thank you who trusts
that did i do that math right bros
someone want to double check that if i
got it wrong it's going to blow up
so speed is 30.
uh
put that up there
cool who thinks i wrote that right
what are the odds that this crap
actually will work
um
bit bang done
called bit bang because you're banging
each bit out of the thing instead of
using the classy mmio
best twitch channel bro
i love my twitchies we are lit
okay well that's great so it bit banged
and
as expected uh
didn't do shit
so there could be 27 million things
wrong
um and that's great because there could
be 27 million things wrong
well
i mean we can at least try that as the
first thing
if a
say
i'm saying not a i'm saying that that's
right
so that might be
well we actually i can look up gm land
trans
gm land transceiver so there's actually
a gm land transceiver chip
just like this one inside of the panda
single wire can transceiver
i assume the mode is set correctly i
don't reset the mode and set camo do i
wow is the most misleading bullshit
[Music]
i wrote bad code and i should feel bad
drivers can
no
yeah
um i'm pretty sure we just set it up
correctly
the question is so so if zero is
dominant i think we actually do invert
so txd transmit data from microprocessor
to can
that seems right
a general motors corporation
specification i love it sounds official
gotta do it official bros
okay none of this is telling me anything
i want
um
i'm going to guess we want to invert
that so let's just compile the inverted
one and see what we get
and actually we can figure out exactly
what we're sending so we can actually
send the same message
so this is sending
first byte is just a hex one
uh and then the id here is well that's
four
and that's 16 and four plus 16 we all
know is uh 27 right
what's the meaning behind the username
tom cruise well you guys know james dean
the porn star
he's got two e's so i was originally
going to be tom cruise with two o's but
my roommate when i lived in la was like
bro
you know what's better than two o's
two zeros
and that's where we got tom cruise i
might quit calm ai and do twitch
full-time if i can make a salary i try
to make i got to make 100 before twitch
will pay me any money i am a twitch
thought if you would like me to strip on
twitch
i'll consider it if i thought it would
make me money i think i would i think i
would do it
um i would do it no shame that's right
i guess uh
yeah don't hundred dollars bros yeah
give me bits
give me bits give me the my free cam
dollars
i probably shouldn't advertise this on
the comm ai channel to be clear this is
not comma ai
i would almost do it
[Music]
we should say like i don't know i should
really tweet about this like
this is uh my personal life this is what
i do with my personal life
um this twitch channel promotes
degeneracy it promotes smoking weed on
the twitch channel that has happened a
few times on this twitch channel
okay
so let's actually try that oh that's not
gonna work either um
okay
well we gotta write this logic better
anyway
so
can push
if bus number is three
and
can look up can num look up minus three
equals minus one
so that basically says we haven't set a
if we haven't actually set the gm lan
properly
smoke weed on twitch
uh
can numb look up is minus one okay so
that should actually fix that and then
at least this test should still work
right
so then we're going to have to get the
oscilloscope not to be confused with
scopies
um
and we'll get the logic analyzer that
might be better all right let's see if
that works now
cool so that works
we're going to actually look at the bits
that are going out on the wire
you gotta get that gorilla glue
um now let's go
see the problem is if i get the
oscilloscope you won't be able to see it
on the screen
it's probably easier for me to use
though
so i will just
show you the oscilloscope maybe that's
never gonna work
should we have should we go on periscope
and just watch the oscilloscope live on
periscope
and then we watch the
streaming live on twitch we might be
able to do that
i love it i hope you guys have both
platforms i'm gonna be right back i'm
gonna go get an oscilloscope and an
adapter cable and we're gonna plug it in
and we're gonna start making this shit
actually work we're gonna do it by the
end of the stream stack overflow said
you can't but they don't know my skill
bro
and don't worry twitchy's
i haven't forgot about you
here's my oscilloscope
so let's get this shit set up i don't
have the adapter wire yet
so we're gonna have to go find that
still which means unfortunately
very unfortunately i am going to have to
leave
you all again
while i go find that
but uh so we're
dripped up and draped out
you guys know that song
oscilloscope yeah i got i got a
tektronix tds
3012.
um
we don't talk about where i got that
oscilloscope from
ah
but so we got we got a probe right here
you know what
should i just peel back
i can peel back this thing on the back
of the debug a little bit
let's take a look at where i want to
actually attach it so it's there
uh
hang on i've got to do a lot of mental
rotation in my head well there's a panda
so when it plugs in it goes there okay
that's doable
we're peeling back
the shit on the debug a little bit
um so we don't have to go find another
cable
it's not going to work well though
i can see the pad
yeah we really should like break this
out better on the debug
give me a credit card
um
this is what i found
i know you can't see the oscilloscope
that's why the oscilloscope is going to
be live on periscope
who thinks that's appropriate i think
that's appropriate
you allowed to live stream an
oscilloscope on periscope i don't know
is it against periscope's terms of
service
i think it depends
is your oscilloscope
open and friendly welcoming thing my
oscilloscope definitely is i think it's
welcome on periscope
all right so let's uh
clip that shit
cool
so let me just enable channel one here
don't worry i won't oh wait when there's
actually something on the oscilloscope
worth seeing
i will
stream it live on periscope because it's
an oscilloscope that seems appropriate
uh
menu no no no
what how do you use this thing oh god
i want this channel that channel off
this channel on
off no that turned channel one off
channel two off
turn channel one on oh it's just off
scale okay cool so now let's see if that
actually works
[Music]
trigger
the oscilloscope needs to be triggered
sweet
all right guys
so let's move this wire a little bit
let me finish my mate
now there's no good way for me to really
show you the oscilloscope
on twitch
unless i have another camera you got to
watch both
if you want to see coding you watch
twitch and if you want to see the
oscilloscope
you watch
periscope
well the wire fell off now that we're
good we're good to go
okay so with my phone
need my phone
to get on periscope
but i don't know where my phone is
oh there it is right behind the
oscilloscope
my battery is almost dead
so then you plug in the phone to charge
you know the things that i do for you
twitches
you don't have internet speed to watch
both well that sucks bro that sounds
like your problem you know what we say
on
twitch
not on periscope because periscope we're
politically correct because we're
representing a company but on twitch we
say that's your problem be rich bro
okay
that doesn't work
my phone charger
doesn't reach to see the oscilloscope
oh
no no i know it's not live because i'm
trying to figure out how to charge my
phone and periscope at the same time
no see i don't think that's gonna work i
don't think that's gonna work i think
this is a
problem
i don't know how to do this
ugh
i i know if you just take my word for
the oscilloscope being cool you're gonna
be like you know what i'll just show it
to you occasionally sorry that's the
best i can do
we're taking off the maverick hoodie
that's right no more maverick hoodie
there might have even been two frames of
left nipple please give me four dollars
i am
a uh twitch stop
we're here on twitch
okay cool
so let me show you what a gm lamp looks
like
so this is being set using the proper gm
lan interface this is what we're trying
to replicate with the big bang
hang on
let's get a good capture okay cool we
got a good capture
so that's what it looks like you say
so you see those pulses okay so let's
count
let's first off see if i got where the
zeros and the ones are correct
okay so it looks like we have a whole
shit ton of zeros
and then one and then that looks like
more than one zero
i think i might have done the id wrong
check it can let's jump guys you did
that right
there's your um
i'm buzzing drives me crazy
okay
so that's the actual legitimate
uh gm land
let's also check the timing we'll check
the timing of the zero
you guys are just gonna have to trust me
that the oscilloscope's cool
don't you wish you had an oscilloscope
and could play at home
that would be great
when new people come into the channel
just tell them that you know what's
going on there's an oscilloscope
and uh they don't get to see it
people love things that are exclusive
and special tell them you guys know how
to see the oscilloscope and they don't
okay
so the timing
appears to be
oh okay hang on i gotta get it actually
on the edge there
okay so it's 30 microseconds so we got
that right
assuming that
we can actually even do this better
let's do this better let's say a knit
here and then let's say while
time to a count
is less than speed times
i
yeah that's better
that's more
timings
good
okay let's first see if they look
similar at all
scarcity bros
fuck scarcity
i have a plant over there that i love
more than a lot of people
um okay
so we programmed it now
remember this is still using the
official interface
let's see if my thing looks i'm going to
show you i'll show it to you i promise
uh so we're going to set gm land bus
equal 9 for panda 1.
so let's go single sequence there
didn't do anything
you didn't miss anything it did
absolutely nothing
so it's not even wiggling the pin
that is shit
all right you know what new plan
first off let's make sure it's actually
big bang gm lan
it's not big bang banging gmlan
okay so that's just a straight up
software bug
bus equals none
if i set plus equal to none
then
can num lookup sub 3 should be -1 i
believe
you're not missing anything this
oscilloscope has done nothing
disable gm lan on can
3.
why isn't the bit bang actually firing
then
like notice how here it's not printing
out called gm lan bit bank
if boss number equals three and candle
look up three equals minus one that
should be right
i'm certainly sending it on panda one
so that's where gm land is there
let's reprogram it unused variable and
net that's concerning
wait what would my line go
okay well that's stupid
it just disappeared you see how this you
see how this keeps time better than the
other thing
shitty oscilloscope
yeah i know downvote you guys can
download
try that maybe
gm land on can't three disable gmlan on
cam3 but even after we disable it it
still doesn't work
can numb look up did i like pick the
wrong thing
no that's right
sub three
okay i mean
i don't know why this doesn't work
let's actually print that out too
i've wrote super sketchy print routines
inside panda
to actually print that out
you insulting my oscilloscope i'm sorry
i'm poor guys you gotta donate to my
twitch
um okay that was weird
it did something that time
i think it actually bit banked
yeah so it bit banged
f f
no but like okay wait that's exactly
right
and candle through lookup equals minus
one
i don't even know bros
but guess what it bit bangs now
we'll deal with that that sounds like a
later bug we love later bro
okay well
so
now there's things on the oscilloscope i
will show you what i'm seeing in a
minute
so this is what i'm seeing
it looks like this
very disappointing
doesn't look like anything
so it just pulls it high
which is not what we want
so that might mean i got the polarity
reversed
let's switch that back and see what we
get
not
the last thing we are sending is a one
right
but that's not right
like you guys see the problem
it should be one normally i don't think
it is until i say septim gm land
oh
oh yeah
let me show you what i'm seeing
now i guess it is one normally
or float and one is the same thing
all right so this is what i'm seeing now
look it looks better guys
that looks a lot closer to like
something real
right check it out
now let's actually measure those things
and see if i got my timing correct
well let's take another shot
run it
okay so
you guys can see looks like that
let's measure
measure measurement measure measure
measure
zoom zoom
well what ad is that i love advertising
bros
okay i got the timing correct
it's 30.4 microseconds you guys can see
i did get the timing correct
so the question is
let me drop the oscilloscope guys
so the question is that means that just
the date is wrong
okay
no this is a little bit annoying
um
i mean i don't know is there a way to
save something on this oscilloscope
i know what i'm gonna do
i'm gonna get the real one and put it on
channel two
i just moved it over to channel two
uh now unfortunately because of this
thing being uh
stupid my
check here don't work
and cannot look up three equals equals
minus one
understand
what the fuck
you ain't ate tea
that's just wrong who made it a you it
savages
well yeah of course it's not going to
compare favorably to minus one
boss equals equals minus one
because it's a euit who wrote this
savage shit
to do
y
you went eight bro
only intake
so you and you got to know your casting
rules for c who knows they're casting
rules for c
not me oh shit about c
all right so we're good at that that
doesn't matter
let's see if it's still a bit thingy is
it still goodbye
all right
it's still good thanks ah cool
let's listen to
tough luck by nothing though
who knows why my test broke
i have to sleep here we have to sleep
here
no it doesn't work did i
what's up good banging don't bit bang
i don't think so
he said gm lamb boss 2 said gm linebus
two time not sleep cannot send okay why
my test break
now it receives it doesn't make sense
okay we just rebuilt the code that's
fine
um
so
let's try the good bang
it's possible that the bit bang somehow
like just breaks it
now when i set it back to two it's still
broken
uh okay
you know what i know what we should
actually do
um remember i re-enable remember where i
set that bullshit about like
in gpio i should actually change that
yeah okay so we should actually let's
just set it to an output mode for the
shortest amount of time we actually need
it
um
let's try that
and then we can set this to mode input
because i don't actually think that
set gpio alternate the problem is it's
like staying an output or something
maybe
i don't know could be fake news
did you guys see the problem now
don't worry there's nothing on the sls
go
if you were worried
sometimes people worry about things
okay
so let's set bus to none and now it's
gonna bit bang and it's gonna fail oh
you know what could be happening
it could be putting the bus into like
some kind of failure mode
now okay it works now cool
so let's try getting rid of that and see
if that still works
does that work
cool that works so now let's send it
there with the big bang
let's confirm that it actually get back
so the idea is i really want both to
appear on the oscilloscope screen at the
same time
so we're going to bang and then we're
going to set up the good way and one day
dude you guys didn't see the
oscilloscope but that shit was fire i
got it i got it i got it
okay yeah all right all right all right
so that's the scopey bros now you see
how there's the one on the left and the
one on the right
the one on the left is the one on bit
banging and the one on the right is the
one the actual cam transceiver is
sending so they look very different
um i think that's right or did i do it
backwards
now we send with bang them without so
um
with bit bang
looks like shit
guys i mean
you know what the problem might be hang
on i know what we might have to do
okay so i see
no like that doesn't look right is there
bug here
did i write bug
because it doesn't look right
like look look at that picture and then
see how like it doesn't look right
there's only one two three
four dips and there should be one two
three four five
six dips
well we still don't really know which
one is zero and which one is one but
that shouldn't matter
scope was screenshotted bro
screenshot that scope
okay oh good look something's responding
to it oh that's hot all right
so but i don't understand why it looks
like shit though
like
is that repeatable yeah it's repeatable
shit right like it makes sense right
so we're definitely setting the bit
banged one before we're sending the real
one
that's the bit banged one
it just doesn't look like what i'm
sending
it doesn't look like that in any way
shape or form and it doesn't
make sense because it's not like the
code that i wrote is very very
complicated here
time to count ah
that shit bros
set gpio mode might take a long ass time
let's try that
and i have another idea for what we can
do
it doesn't work
nope
still looks like shit looks the same
looks the same okay
well let's just write it oh did i not
do not recompile
the gary compiled
that's the downside of c you always
forget to recompile guys yell at me if i
forget to recompile
okay no no no no
it's only has four dips
well
the truth is i can't really tell which
ones which right now
did i write something stupid is this
stupid for some reason
did i have bad code should i feel bad
i know a good thing to send
that should be
undeniable
undeniable
fire
yeah okay so that one looks okay
um aside from a big bullshit at the end
it looks okay right so that's what i
sent out
right so that's the zeros and ones i
sent out let's actually count them
um 1 2 3 4 5 6 7 8 9 10 11 12.
did i write twelve
one two three four five six seven eight
nine ten okay i wrote twelve
i wrote twelve so it doesn't really make
sense maybe
let me let it go high and that's okay
um
well let's finally settle the debate
once and for all which one is zero and
which one is one
i actually think we're backwards still
this still doesn't explain why
we don't have the right number of uh
switches
that doesn't make sense
but yeah i don't know
one means it's low which it shouldn't
so let's add okay so we'll have that and
we'll just add a bunch of ones here
so we want one to mean that it goes
is one dominant or zero dominant
yeah i think we want to mimic can high
so one should mean that it goes
um
high
yeah so if we're setting ones it should
be high so it should be high in the
middle it's not high in the middle we
have to invert
who thinks can be high in the middle
see if it's high in the middle let's see
if it's high in the middle
[Music]
oh god you know what's happening just
fucking interrupts oh i'm dumb
all right so uh
enter
critical section
yeah bro we forgot that this section was
critical
oh my god is this going to work
look at this like screaming about
interrupts
yeah critical section guys is critical
uh
we should do up here we should set
banging land to zero
recessive
there's one recessive and one is
recessive
we shouldn't own the bus
all right so we turned off the
interrupts that's good because we were
getting interrupts and they were making
everything they were making my timings
crappy how did i forget that it was
stupid
all right dumb shit yeah bros
wait this looks dumb
this looks really dumb
i understand why it looks so dumb
oh it's really dumb
i got diamond locks
is that what i sent it's not what i sent
why's it look stupid
look at that
rolled around in that subaru like i'm
can block when i'm coming through
uh
[Music]
it's dumb
except bang lan
hi
oh did i forget to compile if i forget
to compile no i don't think so i don't
think i had to recompile would i change
oh in our critical section i think i
recompiled i forget
it definitely did recompile
but we'll try it again
no looks like shit guys
why does it look like this
this is a great question if we if we can
answer why it looks like that we might
be able to like get at the truth of this
thing
yeah i know i know i know i'm dumb and
i'm just projecting that's a thing
people do
looks dumb okay
i should be sending a whole lot of ones
i don't understand and then i should
send pulses but that's not what it says
it sends bullshit followed by bullshit
speed times i
should be okay
set bitbang gm land literally does
nothing except call set gpio out oh wait
is that gpao output like a complex
function it might be
ah
you guys see the problem we're setting
gpio mode we don't want to do that
um
so we'll just copy and paste that
into here
um
yeah so we're setting the gpio mode so
that might be doing dumb crap
that'll do less dumb crap cool
garbage in garbage out bros
i'm gonna go get a tim tam after this
who's excited for a tim tam this guy
no it looks like shit did i compile
i do compile it looks like shit okay it
actually looks absolutely identical
i'll show you i'll show you guys in the
scope
it looks just as broken
just as broken
well i'll show you tim tam is in a
minute but i don't think i deserve tim
tam right now i think i wrote bad code
makes you feel bad
i was given a 24. maybe it's a time
thing
i mean it's vaguely possible
that this is messing it up
we don't need that to test right now
that's just a change here
oh wait the wrong panda got reprogrammed
damn it reprogram the other panda
i don't know what to do about that
do that
okay well
i have to be a little careful of which
panda we're reprogramming
i didn't want to do that
okay
so that shit works
maybe there's just some rule about like
how many bits can be dominant
maybe you just can't be too dominant
it's a problem
so let's put two of those in the middle
and see we got
ah okay well at least we finally have an
answer to what recessive means
so you guys see the gap in the middle
so one is making this go low so one is
recessive that is working
so i got the polarity correct
now i still don't know why i can't do
long ones
but maybe we fixed enough that this will
just work
acknowledge slot bit transmitters on
yourself so then any receiver can start
a dominant okay
so
refreshed
how is one recessive
because that's how it identifies
all right so now we're getting a signal
that looks better it looks a lot better
um let's see if this okay so one two
three four five six p
six peaky things
so let's try adding that back in
and a seeing if the test works and b
seeing what it looks like on the scope
okay well the chest is broken now
uh probably because i broke the other
panda
yep i definitely broke the other panda
damn it
look what it did
it's broken
okay so we have to re-flash the other
one let's just unplug this one
flash
so i just unplugged the panda
cool
so now they're both flashed now let's
plug this one back in
we gotta just switch the order back
sorry i'm doing this so poorly guys
i am noob i know i know i'm a noob okay
we're flashing that one first great i
don't know why it chooses to flash one
and not the other
these are great mysteries for the
universe
to know and me to find out
let's try that
wait there's two now
did that just work
no no no no that's just because it's
sent
okay that's fine
this 131 here means that it's sent
ah my wire fell off
okay cool
i think it does have to do with it
switching back too quickly so look you
can see now there's only four peaks
again
so i think it does i think we're just
going to need to add a bit of a time
sleep
so we're on the
a millisecond wouldn't kill it
well i should do two more seconds
i don't know if python's that precise no
no no it looks like shit okay
one two three
it has three downy peaks and then a
solidy
so that looks wrong guys wrong
i can go there and go crazy with it
uh okay wait no it looks shitty i don't
get it
i can't know that i'm gonna do that
okay still look shitty
look at shitty
what is panda check out shop.com.i
all right it looks shitty we're gonna
stop yep bad bad no good
i'll be right back i'm gonna get a tin
tan i'll show you what timbers
uh
all right so this is a tim tam
um i don't think you guys will ever see
a whole tim tam
i couldn't resist i took a bite
tim tam deliciousness
all right
we can try this but like i don't know
why it would be better
it's possible that like pulling high
takes more time than pulling low or
something that doesn't make sense
is vaguely possible we're getting timer
rollover
we don't deal with that case right now
we're going to get into the fun stuff a
little bit when we start talking about
the protocol
no it looks the same
okay
i mean
it's possible there's something i just
don't understand
about how this thing actually talks to
the transceiver
trim down bro
okay i think we're having better luck in
understanding the deep mysteries of the
universe with this approach
i should send 12 pulses
a little reprieve
and um
this is what it looks like
i don't know why it then jumps back to
high
that doesn't really make sense maybe
when i unset it to maybe when i set it
to input
for some reason
maybe add a pull down or something let
me definitely do that
okay but that works okay
what about a longer one does that work
okay
and then you know guys a lot of hacking
is just binary searching by hand
so then we're just going to try and see
how many ones we can send before it
breaks
yeah and now it's messed up
let's see what's messed up because i
don't have any more
you know jumpies anymore right look at
that crap
why does it do that
it gets bored i think after it sends too
many ones it's like bro you didn't
really want the bus too many
ones um
all right we know well we all know four
is okay but
we know 12 is too much
okay let's see what that means
i mean it is possible we're getting
timer rollover
timer rollover would squish the rest of
it that's true
uh i mean it wouldn't have been the
other case
okay
show you guys what it looks like
i'm not really sure why i'm going to
measure that stuff
and let's see what's going on
so the first
thing
should be four
byte timings so that's uh
see if it is 120.
it's 152.
uh well no it's actually going to be 152
because it's one more because this is
actually five now
all right so then this one
so that's broken by the time we're up to
five
now to be fair
those are all high
oh and that last bit is the transmitter
asserting a knack
ah sorry the receiver is starting a
knack
trying gm land yeah we're trying to
we're trying to build a gm land let's
see this bullshit in the transceiver
i think this is the transceiver that it
uses
zero under voltage
produces a
yeah so zero is dominant that's good
internal pull up that's right
try for a comma or
something right well let's try to try
the other test let's keep the bus
recessive here
oh sorry let's keep the bus dominant
here
see if that works
oh we need stuff bits
okay okay this is making more sense
we need to figure out how to add stuff
bits
um well so already that looks a lot
better
but yeah so
yeah okay that works
this looks correct
you guys see how that looks correct
yeah my problem is bit stuffing exactly
um
so we gotta we gotta actually do the bit
stuffing
do you know what the docks are greg
all right how do we stop bits um
problem is exactly that stuff
so if you let the bus be recessive for
too long it thinks gg bro
we can't let it think gg
that's a lie
yeah the hardware is probably checking
for bit stuffing or at least if it's not
the hardware it's uh
[Music]
let's see
i mean it looks less degenerate now
i don't know why sometimes i get this
like degenerate behavior
looks pretty quiet
it's at least what i'm sending
can't bust bit stuff okay
all right let's stuff bits
bit stuff oh-ho-ho
bro look at this hot fight this is a
super hot fire
what are the rules
okay
um
so this end of frame stuff kind of just
seems like crap
i don't need that
well no we do because it's timing but
okay
what is ifs those are new
hmm okay
so where were we
id 10 through
id 7. you know if we just scroll down a
little in the wikipedia page
stuff
good stuff
after reserve we have to stuff a one in
here do we ever stuff zeros and we only
stuff once probably in this one we only
stuff ones but sometimes we probably
stop zeros
first
fight
i know we have to write this more
properly but let's get one message
sending first and then we'll figure out
how to do proper
okay so we gotta do bit stuff here
and then the crc fields
too lazy to actually add a comment
um and i don't know what ifs is but we
should do those too
oh i think i know what ifs does for guys
inner frame spacing is that right
probably not
all right is it going to receive
that is way too much to ask for of
course it's not going to work that would
be way too much
to ask for
works
well it did something
so basically we want the signal
on the screen to match the signal here
this is easy to think about at least
this is can high
okay so
it didn't work oh what did i forget to
do
got to compile bros
gotta remember to compile don't forget
okay well
we got something on the oscilloscope
looks pretty good
don't see the oscilloscope cost don't
ask me where i got this this little
scope bros
um
no it's not that expensive
okay so we have that dip
a little spacer of that dip a little
space we have that dip
a little space with that okay i'll show
the picture to you maybe screenshot it
and figure out what i'm doing wrong
figure out why this doesn't look like
that
put a recompile and run on the same
command i could do that i should do that
but yeah we won't do this too many more
times
and that's how massive amounts of time
get wasted
okay
so we have those two dips space
that dip and the little space and that
dip
no big space and then a little space and
then a double dip
and then let's face and then a big dip
we've got space and we have that dip
and then we have yeah okay
so
that dip
those two dips
patch up that tip that's face the double
dip
big dip
this happening
then after this
we've never seen it go high again
so we're just not seeing acknowledge it
looks like
like it should acknowledge i don't
actually have to
um
seriously delimiter
acknowledge slot
let me see it go low and that's just it
it never comes up with acknowledge
make sure that works
okay so something's getting received we
can look at where these differ i'll try
my best
this oscilloscope's not that great like
if you buy like really expensive
oscilloscopes they can like overlay them
both
all right
so they do look very similar at least
so this is what we have
get that printing and i might see ours
[Music]
yeah we can check that's a good point
it's possible we're getting sc ers
that prints by default doesn't it
i don't know
but i mean before we even try to go to
that we can just like i have i have one
example of the actual chance you were
sending and one example of my bootleg
transceiver sending
um i wish the oscilloscope had a way to
overlay them on top of each other it'd
be pretty lit
but of course
it doesn't because i'm cheap
ah okay
so i think we might misunderstand what
the bites that it's sending is
i think instead of setting zero one
this might actually be sending fb
i mean that's not gonna affect like why
it doesn't show up but at least might
make these things look similar
no it doesn't
they look the same until a certain point
the id matches
id matches
did i forget stuff
rtr
ide
reserved
good stuff
the length
i liked it better when it was zero one
oh you know what it could be two
i don't know how any innocent can work
so that looks
no it's still wrong
so after the first four dips
one dip two dip three dip
four dip
we were getting something else oh okay
no no so it is it is zero one
500k this is like a
2 000 oscilloscope
um
they look different once they get to a
certain point like the crc looks
different i think
we can try we can go downstairs and try
to get the logic analyzer
that might do something
okay one two three blank
two okay three dip
45 dip that's fine
the crc field is completely different
does the wikipedia example not at the
right crc
or is the other transceiver trying to
talk on it by that
can i connect my oscilloscope to the
computer not really
i wish i could
it has a print button
but i have to insert a floppy disk into
the disk drive
see this is what happens when i press
print
now this oscilloscope's too old to
connect to a computer
um now we're gonna make this work
okay so the crc looks completely
different
i almost think that the wikipedia crc is
wrong
is there another example anyone could
find on the internet
you know what we're gonna have to write
the crc bullshit anyway so let's just
write it now
so there crc is a lot more recessive
than this crc
the crc only has a little dominant
all this crc is mostly dominant
so
i might even be able to recover theirs
blah blah blah blah blah blah okay
mathematics of crc oh that looks so hard
yes
the can 2.0 document says exactly how to
do it
guys what if the wikipedia demo is wrong
you have a valid can receiving device
you can see that it works this here is
the other packet that's being set by the
proper transmitting device
and that's actually being received on
the receiver right so i'm receiving i'm
receiving on the other panda panda can
to receive and i'm not trying to like
get bang the receiver or anything
okay okay okay okay should we get the
logic analyzer
i have a logic analyzer somewhere
unfortunately this thing really likes to
break the usb ports on my mac
which kind of sucks
but all right we'll go get a logic
analyzer we probably should have done
this in the beginning
uh
i'll be back downstairs i'll be back
downstairs go find a logic analyzer try
that
okay twitches
we have good news and we have news
the bad news is that we couldn't find
the logic analyzer anyway
the good news
is that we found this oscilloscope
regal
we found a wriggle oscilloscope
and this oscilloscope
has a usb port
so let's connect the wriggle
and let's use that
yeah that's right some of the videos are
missing
and if anyone posts them on youtube
i'm gonna get you banned from youtube
for copyright
that's right
because forgetting is a lost
virtue
we have a wriggle so we're hooking up a
wiggle
um
i've got a usbc
to b connector guys everybody
how nice is this
that felt nice okay
let's hook this shit up
all right well you got there's only one
orientation that you can plug this in
there we go that felt nice too
okay we've got the wriggle connected
and the wriggle is on
oh snap
snap
yeah wriggle
all right so now let's figure out
oh
okay
wriggle
oscilloscope mac os x
oh
i don't like that already
okay so this is allegedly like a
four-channel nice oscilloscope these
things are cheap on amazon these are
like the classic like
i'm cheap oscilloscope
it's laggy as shit i don't really know
how to use it
that's right we removed the best ones
now if i hold the button down it does go
away
okay set the position
set the voltage divide
no that's frequency
no
this is terrible okay
mode single
nope
i don't know how to make this let's go
work
autumn
the wire fall off
we haven't been using a ground
that could be a little uh
problematic
it's plugged in good
well i really didn't like set my probe
to 10x is my program 10x my probe is on
10x go 1x on the probe
nothing
it just doesn't work at all
oh
oh okay you see is it okay i want you
guys can't see the telescope what am i
saying
there's a single that's broken
maybe my trigger is ah my trigger source
is channel two i have to set my triggers
for challenges not even enabled
why would it let me do that oh this
thing is so hard to use
trigger
oh yeah oh that's crispy
[Music]
get it scopey
now oh i kind of like this oscilloscope
what's growing on me
i'll show it to you
all right so this is what it looks like
on a wriggle see there we go
now let's see if we can get this like
live stream into my computer or some
shit
[Music]
i like this wait i actually really like
this oscilloscope did i say anything bad
about it i regret that
this is a great oscilloscope this is
better than the tektronix
and even better it has a usb port
okay now let's see if we can do it
without installing a kernel driver
oh
yes
oh love hackaday bros
let's see what we can do oh figured out
how to use a wriggle scope
with python oh who's excited about this
yeah and we can mod it to operate at 100
megahertz should we install custom
firmware on oscilloscope
should live streaming still script now
don't worry
yeah this looks good
okay
easily modded
nice set of buttons it works very well
sound
usmc
first i create a rudimentary device
no
no we have to install a bullshit we're
gonna have to reboot
no
it's not portable at all
i just got this to work on mac os x
mavericks
follow the instructions here oh okay
all right all right
i don't have any of those os x's
i have high sierra
shit
oh i don't know maybe we can get newer
ones
lap
ni visa runtime mac os x
okay
so
this is very concerning
what's the newest version
pi visa
download navisa
is this one good
there are newer ones do i want the newer
one
i have a fucking user account
ni vista is not available for your
system
it needs to match the
bitness
this is the worst website
i just what if i want a newer version
i don't have any of those mac os x's i
have 10.13
this one
can i brew install this
that'd be great this one works okay
all right
my name is no my last name is no my role
is accounts payable
my email address is mr nullman
679 at malinator.com
my password is mr no man 89.
i gotta confirm my account well good
thing we signed up with malinator
mr noman79 let's get it
oh we're gonna copy and paste this
that's great yeah sweet
okay can i download it now
great
that was fun
i'm no man bro
no man's everywhere sign up for your
websites
all right
you will need to restart when this
software finishes installing yeah i
agree don't worry
no
no i don't want to restart
fuck you
all right
no no
all right all right
let's go
oh my god
this is doing to my
colonel just installing lab view in my
kernel you guys ever use labview what a
piece of shit
oh
did it update oh yeah updating the
pre-boot that is highly concerning
oh tam tam bro attempt him yeah that's
right all right hang on
so now let's try this and maybe we don't
actually have to reboot please be fake
news
pi visa tip install
pi visa
oh
oh
oh that's good it's my ethereum's
incompatible
okay
okay who's excited up
import visa
print visa get instruments now
oh
no module named vpp 33
that was nice while it lasted
everyone has its own unique set of
commands everyone is special that's
right oh my god let's fix my eyes
guys i might have to reboot
i'm very sorry
i don't know what to do
i tried our macros x and it worked well
over land
wrinkle
okay all right we installed that shit
oh
wait oh was that just the visa run time
was that some weird chrome extension
what just happened
i don't know
i just get pwned i feel like i got
pumped
so that was
wait a second
did i install that
no i installed the run time of course i
messed up
now we need to install visa
the other one said i just needed to
install the runtime but i think we can
actually use this
yeah restart and then come back you guys
know i'm never going to come back you
guys know if i reboot that i'm never
coming back
all right let's install visa
good thing i signed up for my national
instruments account
love it yeah optimizing system yup
that's great
can i restart without restart yeah fake
restart
i'd buy that
download more restart
guys if i restart like i lose all my
screens and stuff is this oscilloscope i
have a touch screen
no
it's kind of nice though it's really
cute little oscilloscope
it's called
visa
should we get a windows computer up in
here i'll hold it up to the screen like
i did the oscilloscope
oh okay
visa
no
all right guys i'll see you all later
i'm going
guys guys if i don't come back
oh installer interrupted restart oh
no
obs
properties we start to see the mic and i
bet you can hear me now
i don't understand
that one
that good
can you hear me now
all right cool
we're going to the bullshit that is
using computers
all right now let's see if any of these
things actually work
scope.ask for values
so who the fuck named it oscilloscope
who's typing that all
right
am i gonna work
oh yeah oh yeah
blah blah blah
oh that's nice don't you think
all right
okay what is this stuff
i don't know why is that bad
what about that
oh you have to do that okay
oh now we're talking yeah
data oh yeah this is what i'm talking
about we're getting data now
love data
if you guys know me i'm a huge data fan
oh that's nice
great thanks for writing fucking
oscilloscope driver that's great all
right cool yeah get it boy
now generate a time axis oh that's too
much effort
is that better
format what
um
well i was nice walt didn't last either
do i care
not really
[Music]
wait i don't understand i thought we
weren't coding slam today why am i on
python doing bullshit
oh yeah because i have to write an
oscilloscope driver that's right
um well that doesn't work well okay cool
well let's go back to
canada
[Music]
let's check out a branch
cool
i'm going to push that
oh wow that's great
four or three okay well that's fine
we'll do it that way
deal with that off
stream data love data bros
data is one of my favorite things all
right so get this happening
he had
a test gm big thing
yeah okay okay okay
okay now we occasionally will see some
blinky on the screen
all right
there chan one maybe i don't know
there's a trigger i don't know about
triggers bro
spam that
yes more shit
oh i don't know what that means
ascii kodak cannot decode
i i don't like
i don't even know what to
do do i have to pass in an encoding
does not work in python 2
ascii kodak cannot decode by 0c6 and
position 242
ordinal not in range
this is the worst library i've ever used
scope.rightstop
oh chunk size bro we love chunk
um
i don't don't think it's gonna work
ordinal not in range
self. okay so now we're gonna have to
read the library because it's broken
i don't think i did anything wrong
if self dot encoding is not
so this is a
encoding equals ascii
for a message-based resource
encoding.setter
scope.encoding
encode argument must be
string
not none
utf-8 kodak
binary is that an encoding in python
unknown in color okay
well that's delicious
i thought no no no
python and coatings
coding utf-8 no it's not that
is there one just called like binary
latin one
utf-8
no not utf-8
i want
hex
is this going to work
oh
well that's a new error at least
my chunk size is crazy
i don't know what 20 what
my timeout is 20. i know that but 21
time not expired before operation
completed okay that's great well
i didn't do that when i did that
just gives me errors um
okay and at least that's a new error
that's better
um
how does it know how long i want to
stream for
all right stop
timeout why don't we set the timeout for
something longer
i don't even know if that works to be
honest
no no no that didn't do anything
oh
wait what
okay well
that's a fix of these
ah okay we got numbers
numbers bro we got numbers
up our trunk size
20 is not much time
this is exciting oh yeah oh yeah oh yeah
pulley d yeah dj pulling d yeah
theta dot shape
okay well
um
that's not how many i asked for
i i asked for millions
run
oh whoa you guys aren't seeing what i'm
seeing but
there's a reason it's give me the same
thing every time and that's because it's
not run
ah cause this is stop okay no don't stop
no
run
run oh look now it's it's the same no
it's different numbers okay that's
exciting
all right can i plot this there's no way
how this is gonna work
that gonna work
no
of course not
oh yeah oh yeah look at them cans yeah
get them cans yeah look at them cans
look at them cans get cans
oh yeah oh yeah dj probably d yeah
all right who thinks that looks exciting
now we can do
proper analysis yeah oh yeah get them
yeah cans yeah
[Music]
okay let's uh let's put this useful
program
in the pandora folder
you want to use a wriggle you can use a
wriggle
they're common oscilloscopes tests
panda tests
and the shebang
oh yeah
oh yeah okay that's the highest quality
shit i've seen in this thing all right
get
it wait where's my camera oh i don't
know
that broke too
ah
i don't know where my camera went
it's my other camera
yeah there we go yeah
all right
wow do we have everything working right
now
i almost clicked the x that would have
been a tragedy
okay
so
should we write like analysis now i
don't even know
shit
do better there you go
after all this work should we run
analysis
okay
so this is the bit bang one
and this is the real one
now
it's kind of nice
okay like notice how they don't look the
same
i can write a report i will get a a
spell server oh shit man my guardian
leviosa is not going to work anymore i
lost the connection to the spell server
bro i don't fucking know don't actually
subscribe to this shit this is the
lowest quality channel on twitch
i don't know
we like that one look like that one yeah
yeah like that one yeah
they don't look the same the crc is a
lie
wait this also now we can like now it's
easy at least
oh shit
there we go
now it's easy at least to compare this
one to wikipedia right
okay wait so the thing about crcs though
is if i have one bit wrong manual can
change
so we're gonna just have one bit wrong
does this look like this
okay you know up for a little bit down
down
off a little bit down a little bit down
awful lot
looks exactly like that one
yeah bro because honestly you know what
i've never seen anyone doing it live
because this shit takes people like
years
people spend like hours doing this shit
and i'm like it's just slow don't be
slow
[Music]
yeah go get a phd in computer science
well i am tired today
um
i'm tired
like it's like bedtime you know
maybe after i beat some people at chess
first okay did i get the id right
well
so i mean here we can send other things
in my test that's easy
yeah
is there a mistake
is that not what this one actually is
zero one that looks right
like the crc doesn't match
now there could be a lot of reasons why
the crc doesn't match
but probably most notably because
i messed something up
let's double check my logic here
16 plus 4 is 20.
tell you what this message actually is
somewhere
no
they don't
can we not just use the crc
jim get more sleek a small
um
no i think actually what i'm gonna do
is i'm gonna take a nap
and then we'll come back to doing this
so i will be back on later tonight but
right now guys i got to sleep
uh
kind of made it pretty far
we have
this signal on the left is the one being
bit banged and we have this signal on
the right
and that's the one that we're actually
um
sending
let's check it quickly i don't get it
big ups
down
and the crc is different
all right let's at least try one thing
how long is
this
we can we can at least try this let's at
least try this
data
new shit
i'm thinking i'm going to do is like
screenshots and stuff and that's just
how tired i am
well that's not right
they're different plt plots i don't
understand i don't understand why i plot
them like that that's not how that's
supposed to work
what
oh god sorry guys i'm saving it to the
wrong place i'm tired
okay cool
we want those two to line up
so
we can just say
one
you guys don't watch me sleep
that's weird
don't be weird
um
i want the first index of the true you
know what i mean
first
true index
wow
search sorted
you got
arg max
oh shit you know what i got you know
what i really want to do
oh i want to order mcdonald's and go to
sleep oh that sounds incredible that was
the best idea i've had all day guys
order mcdonald's go to sleep
i don't think i deserve that until i
make this work though don't you think
that's kind of fair
saving it to the right place now at
least
it's not working
[Music]
it could work or do the internet lie to
me
it should work right
hate when the internet lies to me okay
cool
all right so we see they pretty much
line up like we have a little bit of
timing but that's fine like
we can maybe do it a little bit better
but that's so close
it goes so well
we're gonna do now please stream for at
least one more hour and watch westworld
in peace
i could try let's see where we are
okay
so we have this little high part
we have
oh well we gotta look at the bit stuff
one here
so we have that
that's the arbitration field
so we have that bit stuffing there then
we have that one that goes low
we have the data that's been stuffed
and then that goes low there
but it doesn't go high again
wait wait this doesn't make sense right
so here is the data
this should absolutely match can high
so it goes
low
it's those two it goes low for the data
and then it goes low for the data again
but it doesn't go high on the orange one
so that's because their crc doesn't
start with zero
literally the only difference is the crc
like all the bits are identical until we
get to the crc
okay well let's just try typing a
different crc in
let's just type in what they have right
okay so if we're looking at the
orange one
it looks like if it's
oh this is gonna be hard
one
one
one
zero
three means high
how many bits wide is this
three
one one one
zero one zero one
0 0
1 1 1.
enough
should be enough
might even be off by one
crc from real
message
so the program is the right panda
fingers crossed
panda board
make
okay
i think we messed it up again like this
is an iterative process it's not bad
bro
do you bro see those two messages there
do you bro see those two messages you
see those two and there used to be one
that's right that's because the two
things perfect the line
i am hella elite
and that shit works and now it's time to
order mcdonald's and go to sleep because
really what is there in life besides
ordering mcdonald's and going to sleep i
just type those zeros and ones just like
boom and you know what else the example
on wikipedia is wrong
bro
bro i just unlocked the secret code
i just unlocked the secret code and now
we're streaming two messages
bro
bros okay match bros
yeah
yeah am i coming back tonight hell yeah
i'll be back tonight
you know it but we're gonna go to sleep
i'm gonna wear mcdonald's because see
them two messages bros there's one of
them
from
mine and one of them from the real
transceiver
oh who would have thought that was
actually gonna work yeah get it boys
that's right
that's right
nice g
um
good i don't know if
i'm so tired guys i'm so tired
oh yeah oh we're testing the new model
for open pilot
bros
sing a song no no no but i will order
mcdonald's with you guys let's talk
about what we want what do we want
spicy chicken sandwich from the
signature menu we could get that
directional mcdonald's kind of nasty
yeah i kind of do
i tell it's not that bad for you
actually
like that's fake news just don't eat too
many calories don't be fat
uh don't be fat and don't be poor that's
good life advice man
like honestly a lot of people will be
real with you a lot of people will tell
you like look man it's okay to be fat
it's okay to be poor but like it's not i
mean it's like okay but like it's not
good
you want to be good you want to be
crushing shit mcdonald's not gonna kill
me
will mcdonald's kill me this is bad for
me let's say
let's see what i'm gonna order you know
you have any options at mcdonald's
we're just ordering mcdonald's now
should i even stream this this is
terrible
this is terrible it's bedtime we're
definitely gonna get a medium fries so
that's only 340 calories um and i
learned something today salt does not
have calories in it
but you get no salt
or extra salt
it doesn't have calories
natural food is all bullshit it's all
fake man what's natural
what you mean like corn have you ever
seen a natural corn it has like six
kernels on it
oh yeah man you ever see that video i
love the videos like bananas are proof
of god no they're not bananas are proof
of evolution
because humans were like well shit man
let's get the good bananas and grow
those you know all bananas have the same
dna they're different from the bananas
they were 50 years ago
uh should we get an apple pie
or we get apple pie well
wow
wow
that's a lot of you could get a 10 piece
buttermilk chicken tenders and two
medium fries
um shit's reliable too
notice how it hasn't dropped any packets
all right hang on no no what did i
really want mcdonald's this menu has so
many items on it
that's gonna make chicken
definitely without mayonnaise
now
oh it removes wow 110 calories and
mayonnaise disgusting
um maybe a mick chicken a fries and an
apple pie
does that sound like a healthy balanced
meal
maybe a few nuggets maybe ditchy apple
pie will go a few nuggets you'll feel
better
i don't know
two-piece buttermilk crispy chicken
tenders
guys like we're not doing anything else
in the stream if you want to leave i
totally don't blame you for peacing out
and we're just ordering mcdonald's what
do we got here more attendees get four
piece tandies yo i do love tandy's bro
tendees i don't know what that is
no i don't want no chicken but i'm not
no
no no i want nuggets no i want nuggets
that's true i don't want tenders you
guys are tricking me
all i can get is ten
nuggets well 10 nuggets is actually a
pretty good calorie deal
i can get 10 nuggets it's only 440
calories
[Music]
i get 10 nuggets and no yeah you're
right why don't i get rice that's a
better idea
no but
now what mcdonald's
that's what i want we've got a mcchicken
we got a few fries we'll get an apple
pie that sounds like a plan
230 calories is that a good deal or a
bad deal i don't know
i wish it added up the calories for me
no we don't have too many calories we're
good we're good costs eleven dollars i
love the presents
i'm very excited about the future
the world
is a beautiful place
um and i'm no longer afraid to die
because i won't we're gonna live forever
that's right all right get an oreo
frappe dude like
sometimes we get
uh
mcflurries and that's a lot okay so i
will see you guys back on streaming
after i take a nap and eat my mcdonald's
and we're going to actually code this
all up kind of nicely more philosophy
all right guys
there's two types of people in the world
winners and losers and those who don't
divide the world into winners and losers
now
at first glance you might think that
that's three types of people but
two of those types of people are
actually contained in the same category
and i'll leave it to you to figure out
which one made that shit up deep
philosophy see you later
god
[Laughter]
wow
wow
that nicer
yo i know i took a long nap now i went
out for food too i did get my mcdonald's
and then i went out for eight rice
and a uh thai basil and a sticky rice
the base is too loud the walls are too
thin it's making it hard to sleep
that's how i feel in life guys
oh but see now we have a problem
the panda make files or utter shit
let's start on h start today so that's
on drivers
camera yeah cool
i did okay there
all right guys so
what we have to do is we have to write
this bit stuff the rule is actually very
simple for bit stuffing
um the question is is there a bit stuff
here
i don't think so crc has 15 bits
well but that's 18.
i might have one too many ones actually
so
these bit stuffs we can actually uh
we can just write this better right
get some
marks don't worry there's nothing on the
oscilloscope
it is running now i kind of like seeing
it blink
the base is too loud the walls are too
thin it's making it hard to sleep
i probably should have gone to the
hospital but i decided to let it breathe
what do you guys think the chorus is
about i was thinking about that i was
talking my friend about this yesterday
all right so for the bit stuff um
last
[Music]
so if
um
um
so hang on
this is like a macro for send a bit
something like that i don't know
um
well it kind of goes one because you're
actually seeing one of those
so we have to write the bit stuffing now
the term bit itself may be the first of
four or five consecutive identical
events so
the stu see the stuffing bit itself can
actually be one of the bits too
so we'll say
last bit equals
not bit
and then we want to
send last
okay so this isn't exactly right um
you guys see the bug
so we actually want to like just inject
a bit kind of
we can do that what if we just did it
like that
the size is bounded by this i don't know
what the hell n is
i don't know
it's probably too short
um we'll do the stuffing here
there's no reason like we don't we don't
want to run anything one more
so i don't know if the
[Music]
oh god who writes see
dennis ritchie
saying set the thing gm lan we actually
want to do is say
expected stuff sub j plus plus equals
did i write that right who knows
oh the same
[Music]
seems right right
equals my bitch
test back and study because last bit
bitcoin equals one
this is a new bit
so we're going to get on the first one
but we don't actually set there we have
a setback
that's it
i don't even know why that doesn't work
because i didn't even build
um
size of test packet undeclared
oh shit
okay it's wrong but good thing we got a
regal bros
like sometimes it misses you see
like it missed there
i think it's too long is why it's
missing
no come on
these don't light up anymore
i don't even know
it's pretty good stuff to buy so that's
right
i'm sure
my comment about the bit stuffs
well
well coming out the good stuff
is my no my code shit this is louisiana
without
i know i wrote bad code i should feel
that okay that works
so
oh well
okay
so there's a little problem where once
you're at the crc delimiter you don't uh
bit stuff anymore
yeah so this stuff's just not bit stuff
that was the problem
even if i did write the code right
twitter
that's kind of gross
um
okay
um what do i say again
sub one plus plus
and whatever
thank you
bro
okay this doesn't work
um
so let's go through this loop
god how does anybody code and see
um
like we could make a message builder
library separate from the actual banger
i have an idea
get
yeah
let's do this for now
as always let me test it
so
no no no it says you don't bit stuff the
crc delimiter um but actually the
example wikipedia is even worse because
the example on wikipedia has an
incorrect crc as far as i can tell
the last thing i need
every other person who wants every other
to leave
now
and find some will get message isn't
that what i call that
i'll get bit message
what's your apm bro
okay
that's not exactly what i want let's get
rid of that stupid uh
[Music]
so i messed up
um
okay if bitcoin ow
well
[Music]
hmm
do your thing is okay so
i think this actually has to go above
this
okay so i don't actually think what i
program i just type
um which is why you need tests
okay so
you
[Music]
back up it's tough that looks good zero
one okay it looks good
i'll see if it works
except the fact that we actually deleted
the part that actually gets the
message it's not really a test pack
anymore
and we should really be a little more
sane write like a
max thing but
44.
what the hell is n
can they actually tell me
plus
the floor
so i don't know 66 64 plus 44.
plus the floor
of
34 plus 8n so let's say that n is eight
again
so 34 plus 64. i think as the number of
bytes
floor of that
let's say 25 for safety
declared
yes you say wikipedia is wrong
no so it doesn't say you don't yeah it
doesn't say that all fails in fairness
topic the exception of the seriously
delimiter so that's actually this last
bit here that's not stuffed
okay cool
get stuffing support
all right so now we actually have to
write the code that generates the crc
um that stuff is crap well
it doesn't hurt to leave as long as
we're doing a test packet
um the other thing that we have to write
is we should actually start looking on
the bus and make sure nobody else is
sending i was reading all about how
arbitration works and can it's actually
beautifully done
uh the cameras designed by geniuses
no
don't want cabana
okay um so can the fact that these
arbitration ids are here
is uh
like right at the beginning like this
it's really cool
the the way that they deal with
collisions is like very well thought out
i like seeing this little scope link
like diamond cutters
okay um so now let's figure out if we
can actually compute this crc
so
let's make uh
the seriously i'm sure happens before
the bit stuffing
here's crc
char out
how's that weird when i do the pluses
max bits
um
i'll just try a cute little loop
what else can we listen to let me write
this shit
so
what's your problem with the formula
given there for the generator bullshit
all right
um
this looks good
perfect
what do you want to knit it with
inch
crc
okay
[Music]
plus
crc 14 and one
is that what this is supposed to be
i don't know guys i'm just copying bad
pseudo code
this code was written by noobs
oh so this is the code of copying sorry
someplace you can't say
why do i never tweet on twitter
twitter is evil
forget what you know believe what you
see
believe
[Music]
okay well that doesn't look at all like
that
it's right length anyway
okay so i don't know
it's not even the right length anymore
how does that happen
does it matter what i set that to how
does that determine the length that
doesn't make sense
that really just doesn't make sense how
does that change the length if i change
the crc
does one have a longer length
no
that one does
fascinating
now well
that still doesn't explain that
like how is that longer
i'm counting to 15.
that makes no sense
how is this one longer than that one it
makes no sense
[Music]
there's definitely something missing
from the crc calculation also
oh this is because okay all right all
right it's cause they're stuffing the
vets that makes sense right
they can totally be different lengths
well it's high quality shit
stop saying hi to all my new friends
learn to get by
only new trends
let's see what's this in uh
i don't know if that's supposed to be
okay i don't think this shit is right
no this is wrong
thank you for writing wrong say
um
oh there's an example oh that's exciting
the hell is this java shit
that looks disgusting
that looks better
okay well almost were idiots wrote this
um but no okay
so
[Music]
just give me
thank you error establishing a database
connection this one looks okay
[Music]
so that
doesn't make sense
you do invert um
i want to say something like
that
it kind of matches that code close
you know they say that crc's close is
the same thing as nothing at all
stop saying hi to all my new friends
learn to get by
new trends
no that's not right either
let's see
um
what was here c14 okay so that's right
we take the top bit of the crc
xor with that if that's true we do
inverts of
not bit 14 that one's useless
yeah but this code looks a whole lot
more right
shift it over one
14. so 14 is which number
that's a buy now it's a buy and that's a
buy and that's half a bite
because i don't think this is right
oh i see
so that's actually assuming that it's
already shifted
this i think this is actually correct
i really don't know if it's this
or if it's this and i might have my ones
and zeros backwards too
okay i mean this could be wrong for a
bajillion reasons
let's get this number
learn scripting language bros
makes you go to chat
that's the number we're going for
that's not right
which is just just for
this one's always an option too
it can actually also be the nod of both
of those
um
did i talk about which crc they're using
can this is the too common word
well we're bit banging can bro
we're not optimizing we're trying to
make it work so we're trying to
calculate the crc
let's say
oh hang on that's actually definitely
not the generator polynomial we're using
as someone pointed out the polynomial
for cancer c is apparently that
that doesn't seem right
um
that's kind of bullshit
so shifting that you want to say that
oh that's not right
no be correct
is the audio muting
is it because i listen to copyrighted
music
is it still muted
no we have audio
oh no bros
oh oh you know what my init could be
wrong too i don't know it was zero
oh yeah look at that the numbers match
bros get it boy
[Applause]
she actually works on the device
believe what you see
look at that
what is this being done for is being
done for nothing it's being done purely
because we can
no wikipedia is not wrong it doesn't say
that the crc uh
isn't bitstuffed
it says that the crc delimiter isn't bit
stuffed which is after the csa
wikipedia is wrong about the actual
value of the crc
okay
so now
let's choose something else
so
[Music]
[Applause]
these zero ones here let's change the
zero twos
now unfortunately because of the way
we've coded this
we're going to see zero one and zero two
because we're not actually using the
bullshit yet
but the minute we start using the
bullshit it's gonna improve drastically
look look at this quality
oh yeah look at that okay so that's
that's zero one and a zero two
now
unfortunately
do we really put the out as the first
thing or should probably put the out as
the last thing
don't be a savage
now make the out the first thing be a
savage that's right
okay
[Music]
um
all right now
the
footer thing
like i should use appendix here and say
test packet
uh
no
that's that's what we're appending so
zero
test packet source size private source
okay
um and this is cool because we can say
and plan
we can do the same thing
just pack it
there should be a point where we just
don't call it test packet anymore
out
when
twitter
[Music]
all right good refactor
um
so i'm gonna swap this up a little
that's not even right
um
start
greater than equal to zero i plus five
minus minus oh yeah know that c bros you
gotta know that c let me tell you if you
don't know that c
that's like not knowing how to speak
english gotta know how to speak english
gotta know that c you know
all right cool um
val
and
one shift shift left i yeah buddy
uh i just want a true false thought
so
y equals zero
it's good
it's not gonna be that chill it's not
actually gonna work is it
of course not
you could say a pendant here
who forgot to return it len
yeah forget what you know believe what
you see get it bro
that's good wait that's just wrong okay
because this isn't there's a little land
in here right now it's going to be wrong
because i like how wrong it
is identifier
pendants
you know what let's do it probably
um
all right let me say i'm 20.
120.
you're doing 20. uh 11 bits
so we have rtr
ide plus reserve
all right this is that guys
you know you wanna do something count
for sesame street shit one two three
there we go
um
lane
uh you know i'll just make this a little
cleaner
the data length code
um
we can write this properly we'll do in a
minute let's just make sure to mess up
uh the first piece we send is of course
a1
that's data sub zero and now we have the
crc
beautiful
we don't need that crap anymore
i guess we'll call it test packet i'm
not changing all that
packet
yeah boy
all right
let's go
yeah bye all right
now my test is very sadly going to break
because this is unknown type name
um
god
fucking
um yeah funny
let's read the safety for i'm sure
that's
i want to get the address we do rar 21
what's that
so we just say two bang
rar shift 21
that's the identifier
if i get the data length
or ldr no it's not there
oh i know where this actually is
reference manual
we do everything in the yeah you like my
little shit boys that's right
uh
no but
no it's not no no these are what i want
we should do everything in the
using the same registers as the can
this doesn't make sense
just
don't can't i can
you know like can
it just can
well here we go bx can
guys i've read this whole manual it's
fun
all right
so this describes it somewhere here
wow look at all this fancy ass shit
so these are the canned mailboxes here
we go
so 21 we're getting the stid
um the dlc
is in
all right all right so this is
tr
two
two bang
yeah we're doing the can bus that's
right
our
i don't have high hopes for uh streaming
programming is like a thing
[Applause]
then
you know what
let's actually do this nicer than
that's fine
tldr
tldr law
especially rlvr
by
um
it
odds i wrote that correct
no
[Music]
where's that defined put that in the
test
make your tests proper
oh yeah oh yeah high quality test
yeah to i o
does that work
that works i do it right
now i wrote bugs include students
gotta include student
uh
what
81 but i forgot a semicolon
i hate c all right
initializing an n with an expression of
unsigned char
okay fine
i i regret my decisions
cast
from unsigned char
to smaller integer type oh god what does
this even mean
there we go
that's actually that was a bug
i had my like angles wrong
okay
so
i don't know that might just be the
whole thing let's see if it works
if you are going to get bit message of
course because you're going to pass in
the
bang
stuffed bang
did it work
oh yeah two get that two yeah get that
two
is this the only working implementation
of campaign banking in the world maybe
it's open source
um all right let's see if we can send
more than two now
oh you guys that works
haha yeah first try get it get it yeah
get it no bugs yeah
get it no bugs yeah
all right we're done
okay
now there's like crap to implement
that's like
good see that was the fun part
now there's actually the whole boring
part to do which is like i have to kind
of write the receive thingy it's not
that hard but like it's just annoying
because then i gotta figure out a way to
test it
hello
that sounds like work
it was fun when all i was doing was just
get deaf master
that's disgusting
all right
enjoy your working implementation of
canned bit banging
oh no don't tell me a dot out got
committed
yeah i'll get committed but that was
close
i have nightmares about committing adot
out
um if you guys want to see it what it
looks like on the oscilloscope
there's a beautiful bit banged
shit right here on my regal which is my
new favorite thing i love these things
you can buy one avatar for a couple
hundred bucks
apparently you can reflash them to be a
100 megahertz
plugs into a computer you only have to
install one sketchy kernel driver
yeah everything's easy bro but like you
just got to do it that's the problem
no we should do we should do the
receiving
um
and basically it's just going to be like
shit can fail
we'll get the input i have something
lgpl
get gpio input yeah
so it's on pin
um
so
if read
equals equals zero
and last equals equals one
plus
driven
oh buzz driven
okay but so we can write that
and we can try it but actually that
should throw an error because of the uh
that should actually throw an error
because of the
acknowledge so if there's no error we
actually messed up
right because the receiver is
starting to
succeed wow
damn do i even this is just
my life's easy bro
easy
so the ack is zero one two three four
five six seven eight nine ten eleven
back
and fit equals one minus eleven
foreign
i don't know if i won i was right
but yeah so if that's true then what we
want to do
go to fail
doesn't remember go to fail
it would be nice if we had some way of
actually
well
okay there's something else we have to
do too
okay
so the bus has to be silent for
well i mean six i guess
it's one more line i don't like lines
say so
you
[Music]
was there a silent bob because i really
made a silent
pop i i appreciate that
uh no so
wait for bus about silent for seven
frames
send my message with optional failure
and then we just exit the country well
we should actually um
guys we live in the future it's just
easy
all of the future
futures great
um
check out all right now where i left
stupid comments around everywhere i'm
sure
i'm sure
cool
there's no little windex bro
[Music]
foreign
uh we just watched a little windex now
that's that we did we wrote our code
and we'll do a pull request so i'm
actually logged in downstairs
canadian money
[Music]
good thing we only got one more minute
of this
any last thing to do in our last minute
this shit can like freeze up
you know what no no no we gotta do
something else quick
wow
oh i just closed all my internets
all right twitchies i'm gonna make one
little change without you
um just just to do get yes elapsed but
peace
thank you for joining we did some
streaming today it was good
bye-bye virgin master
cool
go yoga morning
what the hell does this mean
okay cool
computer is absurdly slow this morning
you see it it's being slow
running
i don't even know
okay so obs is using a good bit
chrome is using a good bit what's that
system library framework is it more
chrome
metadata framework what is that
and terminal is using okay i'm closing
crop
no
still crazy high
what is this
what about lag
okay i want to cut the stream for a
second
got my gold mata here
so
here we have to check to see all right
so let's get the reference manual up
now
it's a place
there's a place that i check for this i
forget exactly where it is um
but the real thing we have to do today
is we have to uh
use a timer because we can't just
disable interrupts like a savage right
here we go
yeah so it's bit two of t of r i r
f
two bang
rir
and
four
identity
um so i have 18 bits here so we're just
going to shift that by four
and how many bits did i
well if the say
thing is 29 we set 11 then it's 18.
actually you know what um
where do you need that what if i just
i shouldn't rely on that behavior
okay
that looks right
now i also have to send
reserve bits which must be said dominant
but
okay
now we're on to the next one
so what that should let us do after i
build
my mcdonald's is delicious guys
instead of saying one two three here we
could say something like
18 000.
don't seem good
crashed
it's low quality
hello
it crashed
i don't know if we need a cell scope
that much anymore
figure out what
happened yeah this panda crashed
i flashed the other one high quality
so first let's set the identifier back
to one two three and see if it works
okay that works fine
i just want to add extended that it gets
mad
did i do something stupid
it should be okay
i
can try something at shorter data
it's possible
that the oscillator is getting out of
sync
okay that works
and when i set item to something large
no it worked
well okay actually it didn't totally
work
so this is wrong
yeah you see so for some reason set nine
thousand there not eighteen thousand
do i have a bug oh yeah what am i doing
let's shift left three
right
cool
all right it still freezes when i send
large messages now
there's some chance that i miscomputed
the
max bitscan package thing
that might have not been for an extended
frame
and it's crashing because it's
exceeding that
okay
so let's let's recompute this more
problem
so we have the starter frame the
identifier
oops
let's do all the header stuff one plus
11 plus one plus one
plus 18 plus one plus two plus
four is
39 oh yeah that was wrong okay so 39
plus 64
plus
16 plus one plus one plus one plus
seven plus three okay so that was just a
buffer overflow
ah let's just be uh
safe
yeah i know the stream is still titled
sunday special all right all right i'll
change it
okay now it's monday normie
if it actually updates
okay so now let's see if my test passes
the pan was crashing because buffer
overflow but now it works cool
commit that
support
extended
address
monday
all right cool
so now the real thing that we have to
change is
this whole thing is terrible
this whole inner critical section crap
knobs are disabled for a long time
that's shitty
so now we need the oscilloscope back
and try to do it
noscope no scope
a stupid prince
we definitely shouldn't do that from
with inside
i see i don't remember these puts from
inside that critical section like it
doesn't matter that much
okay and also this is kind of really
stupidly written
um
that
because
yeah that was bad
[Music]
okay
this is shitty
um
why does it still say sunday special
stupid twitch
okay so what we really want to do here
is use a timer
we should figure out which timer we're
not using
and then i'm not sure if we have to
sample at double the rate i hope we
don't
let's take a look at what timers we're
using
um
here's timer 3 for the fan
use timer 2 for the system
let's see what timers we have available
on here
i'm going to want to enable that
interrupt tail
gpio or something
all right so we used to enable timer 4
but apparently we don't use timer 4
anymore
well
let's also check the
manual for the chip
those are both reference variables
it is vaguely possible
no that's the reference but i know i
want the data sheet
okay so it is vaguely possible that
we're going to be able to use like the
uart or something
i doubt it but you know there's been
crazier things
yeah new tom cruise you know what's up
that kitty pride
um so if i recall correctly we're using
you know using b12 would be 11.
wait what
thought there was a you are here
am i reading the wrong data sheet or is
this the wrong data sheet
this is the right data sheet
here we go
look at all these alternate functions
and this is the wrong data sheet because
the other ones down five and six i don't
know how i got this data sheet
okay github panda which which chip does
it use again
oh this is that
okay she did she's download
oh i want an excel spreadsheet of
disgusting
there we go
okay cool so we actually do have a ui
there you are at rx and you are
tx so theoretically if we could figure
out how to use url five i don't think we
are using uart five
uh oh and panda we are oh we'll use it
for k line damn it we're using uart5
um
what else do we have
event out
time one
show on in
i really write this well we could
actually make it like um
your five tx we'll also get we also get
pb3 which is connected to actually the
same thing
or pb4
so we could just use your seven so if we
wanted to use a uart we could certainly
use a ui
we could also use a spy if you like miso
let's look at the uart
see if there's a way to send the uart
without any stop bits
you know what i'm saying
we could write some incredibly clever
bullshit
yeah
oh yeah there's probably a delay in the
stream i don't know
everything's lagged bro
you are
i mean the nice thing about using a uart
is then we wouldn't be uh
trapped by our
[Music]
basically if we miss an interrupt it's
not that bad
we have to turn off the stop bit
support for one or two stop bits but i
want no stop bits is that possible
i want no stop bits and no start bits
one half stop it no i want no stop it
ah
yeah i shower
wow that stream is really laggy bros
over sampling method for clock tolerance
we love tolerance here on this stream
guys i do need the money thank you
thank you i love
money in framingham fractional pod
lin
no but like what i really want to do is
set the stop bit to zero can i do that
let's buy miso
that might be a better bat
so i can use pin
so the pins are actually physically
connected
um
pb4 and pb13
so we can use either one of them
i can also use an i2c
well
so let's think
yeah i do see my work i2c is not going
to i does that you see your stop bits
i'm trying to use like an i2c peripheral
uh
to bit bang can
right you see let's see if that's going
to work
no
[Music]
no no no
what's a serial audio interface
okay
why do you see master features start and
stop generation
but i never wanted to stop i want to
keep going
i to see you good bag
stop condition but like is that per bite
does i just see like cereal per bite
like that
does it have stop bits i don't want stop
bits
see because can i just want to be able
to basically send any bits on the back
on the bus
oh wait standard speed and fast speed up
to so i should be able to set any speed
too that shouldn't be a problem
no stop generation
this might be doable though
i2c might be our hope
that's kind of ugly
and of course i'd send the clock to
nowhere land
no see i don't like that see look it has
this no
i want to just keep going
no stop that
oh and can i not set the speed to
anything
it said up to
yeah there has to be some way to like
light it which doesn't know real speeds
which is a start condition
arbitration see i don't want any of this
stuff i just wanted to bang bits on the
bus
so complex
i believe that sets the blood right
over on under on
start condition
i don't know if this is gonna work
let's check spy
the problem is all these things have
concepts of bites and we don't want like
look see how it has bites like
separately like that we don't want that
we wanted to just keep streaming
i don't want bites see like it has that
i want that gone
okay i don't have high hopes for using
spy or something
you are i2c
oh tim three channel one
hmm i don't know about that
i think identical memory is a scam
okay
well let's use a timer anyway
it's at least better than what we have
i think we can set it as like the
highest priority interrupts
so we're using
tim
1 and tim 2 and tim tim3 so we can use
tim4
when we set up tim2
this is where we set up tim2
the only place we set up him too
timer
why don't we call that there
call that anywhere else
no we call it
only call it there
um not everything is a scam just a lot
of things are
you have to always be aware of scams
avoiding scams is very important
um
okay
so first over here that really doesn't
have to go there
i don't know why i changed it to this
those can certainly sit outside the
timer
loop um
yeah man
well rappers talk about that all the
time how they got rich and some of them
you know i made a g today but yeah you
made it in the sleazy way
god i don't know all this shit bro
is the stream broken
if we ever get over 100 people in the
stream we're going to debut new tom
cruise music
new tom cruise music
but then we'll be famous and they'll
have to stop streaming
all right
um oh god
okay we want to use
use timer for
where do i enable interrupts
is
thank you for subscribing
thank you
see i don't know what what timder uie
means
well
okay so let's actually quantify how long
the timer can be disabled for if the max
bits is 200
and we're transmitting 33.3 kilobits
and then
it's actually up to six milliseconds
yes i care yes please subscribe please
like and subscribe my shit it makes me
feel good about myself
and six milliseconds is a long-ass time
bros
long-ass time bros
that's true too can only watch the
things if you're a subscriber
okay um
no i like the idea of using the spy more
probably easier to set up
there's such nice cans i really want to
use the cans
i can't use the cans kansas we only have
three of them
that's the whole reason we're doing this
that's right capitalism that's right we
love capitalism
that light's buzzing
look guys i bought a wemo it's a grammar
it's a woman
it has wi-fi it puts your lights on
wi-fi
mars girl is in jail guys it's not funny
it's not funny fuck those assholes who
put martin shkreli in jail that's a
great man he made great content
he did disrespect the wu-tang clan
though
you know i just made it in life makes
choices
i would i would never disrespect the
wu-tang clan
i know you don't fuck with the wooten
clan they told me that and i believed
them
dude we could watch wu-tang clan and not
fuck with but then i think we'd get
copyright straight striked and
ghost-faced kill it show up in my
bathroom
beat the shit out of me that's right
don't fuck with the tank clan
yeah free scrolling
so down bros
we are turning the lights off because
they're buzzing
why not guys yell
you made a g today but you made it in
the sleazy way
that's how i feel about ico
yeah sure man look i love
let me tell you look if if you if you
no i'm not even
[Music]
okay so we're going to have to enable
timer irq
where does it list all my irq
now
this
okay so much iq
let's see which one we want
we want
tim for
no
yeah tim 4i or qn okay that sounds good
you know we want that air up
i like twitch dollar yes
yes i like twitch dollar if i make 100
twitch dollars twitch will pay me money
and then i will have one hundred dollars
just like do i have one hundred dollars
maybe i have one hundred dollars
nope see all i have now is dollar
dollar i only have dollar
over here maybe i have twenty dollar
but i don't have one hundred dollar
i didn't did i not show that well dollar
yeah it's twenty dollar i have twenty
dollar
but i don't have hundred dollars
bros look you can
what the hell would i actually do with
money i just like getting money because
like having money is great because it
means that you're rich
and being rich is a great thing
for anybody else not for what you can do
with it just for you you wake up in the
morning and you know that you're rich
it's a great feeling
it's a great feeling it's something that
people who aren't rich like poor people
will never experience
unless they become rich and that's the
american dream
look at von neumann i think he's dead
okay so we gotta set up tim4
um
i don't even know what this stuff is
well i do know this
so if that's my prescale
then we need to multiply that by speed
yeah get it boy
uh
and wherever
did i remember who enabled him for i
think i illegal back what
is illegal but i'll stop it
uh
hmm
[Music]
so i think we need to enable other
things
like cr1 we need to enable that
okay eventually we're going to have to
go to the reference manual
figure out what these things mean
looking for tim's
no
no
here we go
general purpose
timer 16 bit
up down auto reload counter
16-bit programmable prisk
interrupt dma on the enable
in up counting mode
also
down counting mode
also pwm mode
we can maybe do eating streams someday i
won't walk i'll do it
all right so we enable the counter
up counter not one pulse mode
we need to enable interrupt we need to
enable interrupt
this is all complicated stuff
there's interrupt
press capture compare
dma wow that's wow
where do i enable interrupt
dire yes that's what i want i want
dire
last one
trigger
terrible
oh dude be smart oh yeah well that i
mean we don't even talk about that
because if you're not smart like sorry
bros
um the guess what's good but like it's
not like like the thing about being rich
is everybody can be rich
everybody who puts their mind to it can
be rich but not everybody can be smart
so that's why you don't really talk
about that
uh
well
probably
go ahead and see what happens
speed is undeclared of course because i
forgot an e yes
kind of idiot names variables things
like that
who's date who's going on dates i love
dates
what
okay now nothing works
oh i know why nothing works because i
set the thing to output i never put it
back
um
okay
do i really do that
do i use the other tim ir cues
how about tim too
no i use that one
that one uses tim three
in the pedal
you guys know the pedal
i'm gonna just set the status to zero or
the interrupt doesn't work
now
no we didn't do it twice
i understand why it doesn't keep hinting
though like that don't make sense
no many end
it's just slow
wow so slow
[Music]
let's uh and figure out why
might not understand what update is
trigger
update interrupt
and overflow or underflow
oh so that's just when the timer
overflows okay i see
so we're getting ins but
not enough
not everyone learns at the same rate
well
there might be a thing i can compare it
to i have to like set the max value if i
can set that to speed
speed
look at the speed for now
trigger
reserved on the other timers
d-mar
what's a d-mar
do you want to use a d-mar
oh i think actually you know we just
need to set ccr1
speed
oh you know what actually we'll just do
with the arr
we just say like
is that gonna work maybe
i'm probably like off by one but
um let's also not have this print
stupidly
let's just say
bang gm
so we'll just do a pulse train
[Music]
never give up never surrender
no with my fucking pulses and get shit
okay i did that right
update interrupt i mean get rid of that
i don't know it was printing shit before
no nothing on the oscilloscope
it's nothing it's just
oh that's wow
that worked before i don't understand i
mean i guess it was multiplying my speed
but
still
nothing
thank you thank you for subscribing to
my shit bro no i'm not smoking weed i
got work today
they're gonna work let's smoke weed
before work don't be a degenerate
yeah they're cute
i understand it's literally just worked
you know now there's irq
okay so it's double tapping the irq
but i don't understand why this doesn't
oh i mean i guess i know why
get rid of that crap
oh
[Applause]
okay well now it's at least tapping high
okay
um tim for arr let's figure out what the
arr means are
oh god no no no no
no
oh it's an address
what a reload register
go to this section for more information
in up counting mode
the counter counts from zero
to the auto reload counter then restarts
from zero and generates a counter
overflow event oh
so we'll just do that then we'll do that
this should work maybe maybe work maybe
oh i did it too fast sorry speed
oh yeah look at speed
all right now we're seeing shit on the
oscilloscope so i'll hold it up for you
guys
see it
yeah
all right
so of course i'm sure
that put shut is gonna be full of spam
it's broken
right
but we can definitely do away with that
um
and we can even check so i have an idea
that two interrupts are actually
happening
updating our flag yeah there's both an
overflow and an update happening
oh okay so there's the overflow
interrupt and then there's the update
interrupt like right after and that's
why we're getting bullshit
so let's avoid bullshit because we hate
bullshit that's right
don't be a savage don't be a degenerate
live a clean
and healthy lifestyle that's right
update interrupt enable trigger
interrupt enable trigger
sr
trigger interrupt flag
update in our append
if
tim4.sr
and
tim
sr
[Music]
yes
ah yes oh so look at the high quality oh
yeah look at that square wave that's a
square wave bros look at that square
oh beautiful
all right
i'm actually going to use this
oscilloscope measure
i miss my old oscilloscope should i just
go get it
frequency 16.1 kilohertz
wait i think that might be exactly what
i want
um so we actually want the frequency to
be 33.3
so 16.1 times two
32.2
scam
speed minus one
huh
that'll increase the speed
so what frequency do we expect
sixteen point six five oh yeah that's
better okay good we fixed that cool
um
okay
so that's good we set up the timer
enable the interrupt that's good
now
well we can disable the wafer boss
silent for now
and we'll say something like
sending
minus one
you have to put this over here
we'll get rid of this for now we'll just
say this
set bang land packaged up subscribe
um
well
disable the interrupts
and disable that
thing
cool
savage
okay let's try that
so now we're sending it quality on the
timer
what quality
that works
damn bros
my life is just so easy first try shit
works
be smart
and be rich
oh
hope you had a great weekend
though you must be busy ramping up the
business but didn't want this to fall
through the cracks still would love to
speak
why the fuck do i want to talk to you
do you know things i like people who
know things
okay
now it's being sent on an interrupt so
that's actually much improved okay now
let's put this other logic here
um
this logic up above set different gm lan
okay gpi input if three equals zero and
last equals one
well
we could use last or we could
um
sending is lynn
we shouldn't say this we should say gm
land sending
these unfortunately are all in a stupid
global namespace jamland senmax
that's pretty good
okay
no put h is not a typo actually it's
actually right except actually you're
right it should be i
should be
um that's right
so
we don't use last anymore
if
tim landscaping is greater than zero
and
zero and
packet stuff sub
gm lens setting minus one equals one
then we said one last time
and
we should also set the priority that
ended up really high i don't know if it
matters but
cool
it's like broken
oh i know why it's broken because it's
not actually hanging on the send anymore
there's actually hang on this end
anymore right
i'm gonna even be getting dropped it's
high quality shit
okay um
so
wait there's something else we want to
do we want to add the
silent count
gym land silent
okay
was not than seven that's right it's
less than seven
if
um
what snapper is
cool
that will wait for the bus before we uh
there's all sorts of like weird race
conditions in this still too
we can't actually send if one of them is
sending
we can fix this a little bit okay cool
that's good
so wait for the bus to be sound we
didn't actually test any of this crap um
if
chamberlain
send max is not equal to minus one
return
i want to set this interrupt as the
highest priority too we can look for the
invit command to do that
cool
get it bros
let's see who emails me
no one useful
get a lot of emails on monday and most
of them are useless crap
it's quality shit bros
cool
to do
make
failure less
silence
so this stuff like might fail
occasionally
that's good
we actually shouldn't do that if we're
exiting there's a slight subtle bug here
else
cool
we're not even triggering that air
condition who knows there could be like
serious bugs there
we should write tests for this
who wants to write tests who loves tests
right
speed is a defined is kind of stupid
all right guys
um
so i'm just going to commit this
looks pretty bad
use a timer
um and now it won't now it won't use the
interrupts
well now we won't turn off interrupts
for like you know
60 milliseconds anymore
wait what
oh i just got a travis ci saying that i
broke the build
all right we'll go downstairs we'll deal
with that
time to go to work guys thank you for
joining says i broke the panda belt i
don't know how
i'm very happy with this
yeah so we're getting an interrupt for
each bit
which is kind of okay
it only tries to send it once which is
probably good
the bus is full of stuff
we could play a little windex cleanup
song again
but we
won't okay thank you for joining us
today's stream
make sure to like and subscribe
have a nice day everybody happy monday
uh
yeah that's it bye
that's great what up scope ease do we
have scope is f11 scope ed3 scope is six
copies so T's copy
pfft damn fast
Thanks
we were just talking about friend texted
me saying uh turns out that a BMW you
know and some other company are
investigating blockchain technology for
automotive and they've partnered with
iota it's crazy
okay guys wait is this common knowledge
so I'm gonna turn to Lansky oh whoa whoa
open the little lock you really want to
make him which could have done landscape
for the beginning I know they like it
yeah now we're gonna do it we're gonna
do it maybe people like because I can't
get ya
yeah yeah it's kind of weird
io does fake news dude okay honestly so
dumb um iota rolled their own crypto
it's a centralized thing tangles do not
work but this is an example of what's
wrong with like the world the fact that
like something like iota first super
hard Josh I'll thank you
the fact that's something like iota like
I don't know what you have to give iota
is they do have the best shells like we
get tweeted at maybe like you know once
a week for someone like if you consider
blockchain okay you can say what you
want about blockchain you know I'm a fan
of Bitcoin with etherium
Roger Miret tried to save it oh I saw
that actually yeah 600 million people
are six hundred people on Twitter were
like sell your Bitcoin cash
[Music]
does not comma that was asking with the
meaning of life you let us know
difference we're still trying to figure
it out so now you guys know what the
meaning of life is to win you can
interpret that to mean that was
something that was balanced out but that
was not good Oh Lane was weird well
Amy's here yeah go get the new waters
let's see any models
yeah what do you do like what do you do
what you do why do you do what you do I
think I might have missed the turnoff
did I miss the turnoff to 101 I don't
know if it's coping Oh put it in our
little ways ya know if I miss the
turnoff
no no we'll never get back figure it out
before it's too late why don't we use
this system how we gonna get all the way
over to Fremont to go to Fremont
Cadillac - but I had GM with Supergirl
oh damn ah
Fremont Fremont George always gets
distracted when scoping and driving I'm
not distracted am i distracted no you're
very you're very if we had everything
you'd be doing fine good things okay can
anyone read this I think might want to
try to get over here let's try
while we're exploring let's go to Milly
brain we've been on this exit either way
so ago and we got his because we
couldn't pair the phones and answer the
phone to the Civic and so we got off
this exit and pulled over to try to
parent remember yeah and then it was
like a weird sketchy road I could be
wrong but I thinks
where are we going to Millie bright
Millbrae Millbrae okay that a Cal Tran
there they do they do
oh no wait that's not what should we
just go back let's do it let's explore
Millie break
Oh milk raise a lovely place we've been
here have we yeah I really don't think
I've ever been here but I know we have
when well I definitely think I thought I
was here with you and we were trying to
go again come on we're trying to go to
melody Toyota we all right we're not
going to melody Toyota guys all right so
we have to get to over there yes all
right well let's go I have a Civic yeah
they're really good though I think
that's about how much is it apart
why is your light on you're right thank
you
yeah bottle for swarthy wasn't yeah that
was not great I can't believe that light
was a good point
I know
but yo guys what El Camino Real
private congratulations I got Mary know
he's finishing the last question of his
last final of his last class until
graduation
Wow boom College is important college
support wait are you lost
it's not a through Street dude look
where we are in the map or nowhere but
nowhere nothing no comma this is the
suburbs one day we'll have a good
self-driving car in the suburbs I won't
date last night guys
yeah tell us about this girls kind of
mind-blowing no are you no but I think
she hates be excited so you're totally
in love that's right that's the best one
I don't think so I don't think I think
Jackie you thinks I'm a bad influence on
our life
oh geez that's real yeah it's not okay
to be about it yeah drop out man turn on
tune in drop out right
scope EEP it is done don't take us far
as that girl the girl from last night
my god she's watching she's watching
tell her I'm in love with her I'd love
to see her again
but she
No if this isn't go anywhere
I mean I'm as lost as you are we're
nothing but I'm just trying to follow
this and I don't know why we're now like
that way we are literally so long
they're so lost how do we get lost on
the way to mili braces so we're not even
going to mill mili Bray we just said I
was that way yeah right no it does the
ocean let's get to the ocean that's very
good haha what's my role I run
operations maybe you should use Waze
don't y'all have navigation no no this
is the point of life you guys asked
we're bringing you through that's right
welcome scope ease you think you have
navigation and but you don't and you're
lost you need comment you see maps not
get lost I've kind of edge the maps that
would be driving right now check out our
positions page check out our hiring page
yeah
this makes the scope 10 times more fun
what makes the scope to attach my fun
though we got lost
don't you get lost distracted you guys
oh it's that it's sad that people think
that that's what it is to be on drugs
like have excitement you know guys no
honestly though like we don't want drugs
some more normal not what I'm not
smoking wheezing yeah that's right man
telling us was more saving he's ever
been yeah and then that guy who was
interviewing him it was like I'm gonna
therapy every Thursday because sometimes
I feel like graffiti from The Lion King
something like that it was dope
scobie's if you haven't checked it out
the Kanye West to Young's the interview
is gold
this leg stand it up and like he's
talking with two people in the newsroom
by the end of the interview the whole
newsroom is quiet and listening to him
talk oh really
wait did he bleach his hair did he
bleach his hair I think if I saw the I
think he bleed she's fair yeah okay well
we got train tracks in the way how we
get over the train tracks really tried
oh that's tight
damn homie oh don't worry if I hit that
minivan it's all the improvement yeah
and maybe a full coverage on our car oh
yeah let's do it really we got a special
Pacific demolition derby okay right no
but seriously I gotta go to the other
side of those train tracks
Oh forever we should use the map says
it's good to know and yes that's what I
heard that's why there's a million oh
that's like the one thing the problem
with these suburbs soon as you feel like
you've been in the same place for 15
minutes beautiful baseball yeah that's
really nice the only kids go outside
anymore - so probably more no no they
don't
nor do they let them eat romaine lettuce
really hurt yeah is there a problem of
lettuce yeah there's a problem with
lettuce
what's wrong with us some kind of
disease oh you gotta watch out you gotta
be safe yeah the usual
no but seriously you should not be
buying lettuce from your local grocery
store unless they like
why do you believe the news and it's all
frayed with lettuce it's not a bad thing
to believe right it's not like they made
a big seller
[Music]
Cole go I heard Taco Bell had that no
fully closed off man I get my Mexican
fast food mixed up we're back folks
comma Papa Murphy's have a Murphy's what
is that Papa Murphy's I went when I was
in Chico with Chico bruh
oh it's like a pizza place Oh Papa
Murphy's Murphy's kind of like Papa
John's little isn't Papa John's like
racist or something are we not allowed
to support that's what I heard
do you like Papa John like lose it or
something I thought um I mean are we not
allowed to support Papa John's anymore
oh you're right Papa John's Papa John we
can't support them that's right we also
can't support KFC there any
chick-fil-a's around here I can feel
like over tick bliss yes for chick-fil-a
all of it
they're good you ready yeah it's good
and they don't come with mail oh that's
the best thing about chick-fil-a wow it
is just like a chicken sandwich right so
[Music]
I don't have never been nobody to Jersey
dude and the first time to
jack-in-the-boxes we did that route oh
I'm sorry jackin the-box is disgusting
ever tell you about jackin the-box
wrongs meanwhile I'll never go there no
yo man one night and I was like you know
what I want right now check about food
and there was a jack-in-the-box
I wasn't that picky right so you guys
never realize that I really want food
they had like the orange smoothie a
check of us their orange cream so that's
just like for ticktick no Josh barro so
it was a glass in the picture yeah one
of those amazing okay no it didn't come
out this oh oh what do you think
happened I think it wasn't in the glass
no I carried a paper cup yeah yeah yeah
shit this falls out of time use a bait
and switch did you ask for to go wat one
of those and I didn't get that and I've
never you know except for that time in
Vegas where I probably protest up and
said I didn't want to go haven't been
back to a jack-in-the-box sense damn
don't go to Jack in the Box Wow all
because of that you know like cut one
small thing man I mean the world is
small sure someone from Jack's box well
I'm not even gonna say we have a deal I
think we're gonna do it guerilla style I
think we're gonna get a bunch of guys
dressed up in Pampa suits outside of
Panda Express and sell common AI pandas
and every panda purchase comes with a
five-dollar Panda Express gift card
Ram marketing budget all right we gotta
go left here I think this takes us to
the highway yeah that's kind of fun
really good penalty they do yeah they do
by the pie wall yeah delicious oh that
wasn't really fun for the people or
people Union City the reason we went
although the people yeah we robbed some
people yeah we're gonna take the bed to
thank the bag that's right
if it fits were taking the bag this
looks like you go somewhere that's a
chevron you know I got gas that one's at
a Kia Soul resource cop he's watching
this I like pious Souls they're kind of
fun what's that it looks so sketchy I
think it should be an abandoned town and
it's the only thing open
yeah maybe coffee's gone cause
everything else
ghost towns are weird I really set set a
good scene for the American War
Millbrae look at this little bridge
that's sweet the transit hub didn't
sweet wait you know we should rename the
George Washington Bridge that's right
I'm assuming you want to keep the George
card so we just got to find a good last
name for it no I think George can go
George can go I mean maybe we just get
rid of them just bridge just the bridge
the bridge not even live dog there's
like an Apple product not the iPhone
just iPhones bridge the iPhone the
Street Bridge bridge near a Brad it's
all a DAT that sign yo love my life
Jackie and I we did this trip we walked
along like that was like a highway like
this we just saw all of my I love all
yeah yeah Erica is the greatest country
in the world there's so much opportunity
in America you could open a Panera Bread
you could open a jack-in-the-box you
could open in McDonald's mmm
yeah but you can't paint your McDonald's
purple and that's the bubble whoa whoa
yeah they got franchise rules we got us
down you know freedom is freedom until
you you know realize maybe we can paint
it purple you gotta have some like a
freakazoid I'm huge freedom fan but like
but you want to go to a purple
mcdonnell's that my dad was the
McDonald's breeze I wouldn't go to a
purple one but I would go to
well they started doing green McDonald's
you know for people to get into that
health mindset you know I would go to a
blue McDonald's like look at that our
cosine if there was McDonald's with that
sign I'm gonna in and out where is the
internet I was problem
that's why there are bears up low
McDonald's in New Mexico yo let's go to
Mexico and really I'm so there
let's just go yeah dad wait let's get
our super cruise catalog first
self-driving civic say this no problem
no problem
munches are the best part of getting
high yeah you know I hear the food
industry did really well with
legalization Colorado
yeah
it's fine
I'm still 54 loyal people
no that's driving your low-power mode
Oh No not have a charger no I don't
think so they were done and that was
today's scoping and you gotta have
enough power to be able to KBB it kelly
blue that's right yeah didn't bring my
negotiating papers shit
Oh we'll just have to turn around turn
around come back
let's go right back to Melbourne yeah
yeah yeah could have been here so long
ago
[Music]
we tried to go to the unit now we saw
the other side we didn't even try it be
like decided really shit it's really
about the middle of Dumbarton bridge
definitely middle of bridge bridge no no
they can't be bridged dumped what was it
jump Bart and that's an okay babe I
think dumb pardon don't fart yeah that's
not bad yeah you set up pretty good
success right don't barn bridge all
rights go peace we're gonna leave you
yo yo this work for some people
check check my Twitter their work I'm
feeling it didn't go through Twitter no
comma but your RAF ship o'clock yeah
welcome welcome welcome
oh it's working right this is exciting
man I'm off periscope you all know I
love periscope is is the quality guy
because sometimes I go he's got good
let's see you know check the quality I
think I'm on Wi-Fi with my phone yo
check out all these giraffes y'all look
at him sahand a variant so guys we have
a we have a confession to make
oh yeah we have a little confession to
make there was a bug in the Honda
giraffes um on certain uncertain Havas
there was also an indicator light that
was staying on in the Civic so we have
fixed all the bugs um the three people
who already received Honda giraffes will
be receiving three replacements no need
to send the ones that you got back feel
free to do whatever you want with them
they are yours but you will also be
getting a brand new edition Honda
giraffe the latest and greatest in
giraffe quality oh you know I really do
like to stay in the other products dude
I wouldn't ship this stuff I don't think
it was good so that's why there was a
bit of a delay in shipping
but yeah so that's why there's a bit of
delay in shipping we want to make sure
that everything is really good before we
send it out so yeah we caught that in
testing we have extensive test plans for
all of our stuff we'll be pushing the
new yes so yeah kind of bugs I mean look
if it's working for you it's not like
it's some like bug that's gonna appear
we just forgot to connect some things so
we'll be pushing the new schematics to
to github giraffes are 100% Hardware
open-source I would love for the Chinese
to come and build knockoff giraffes and
sell them to rid of me because making
giraffes was a huge hassle but we did it
we did it we did it and here they are
they are all ready to ship we test each
giraffe individually the silicon them
yeah you'll be if you got one already
you'll be getting a new one even if you
haven't seen anything wrong oh I guess
you built one yeah it's it's just we
didn't we forgot to connect the
indicator line it's a stupid little
thing but you know we really like to
make sure everything's perfect before
you ship them because giraffes are gonna
be around for a while you know they're
they're not just for pandas but they
also have this port which will connect
to Neos or potentially new special
purpose hardware for driving cars but
obviously if you want to connect this
through your Eon panda to an eon giraffe
I said the name of the thing you know
the family guy the movie yeah that's
great okay do you have anything to show
off you know what each of the
combination of switches does for your
giraffe and that'll be shipping with
them today yeah this is the and Eddie's
gonna cut them himself for you yeah
we're gonna cut them with with a nice
paper cutter straight and we'll push it
to the go push this to the github also
so
you know no more questions about what
all the switches do hopefully as we like
to you know make things that are quality
and explain things rather than answer
support questions that's true we don't
like answering questions I'm subtle oh
you know what I do like overpriced
hoodies man look at the symphysis it's
embroidered men 129 dollars you can
dress like a comma a I employee and you
can just ships now hoodies ship now a
wheel get in hoodies in stock get in on
hoodies we're gonna change we're gonna
change both hoodies and giraffes to ship
within a week yeah giraffes pandas and
hoodies all ship immediately me I'm
waiting well Wednesday we ship on
Wednesday everyone says everyone's
everyone's days the shipping party yeah
yeah getting your hoodies tomorrow Yeah
right where do you get the hoodie shop
comma dot ai I'm shop that comment that
I buy hoodies Hale put put away it's
gonna be quick and fast if you order a
hoodie it is coming your way like within
the next week
we don't do turtlenecks do I look like
Steve Jobs we wear hoodies yeah 30 isn't
real nice jobs you know okay um welcome
thank you thank you all for watching
this periscope shop comm AI a buyer stop
I'm gonna update it right now
to say that the stuff is shipping right
away and updates on eons coming along
they're coming along we will definitely
meet the deadline as promised on the
website new sensor teaser no it's all
about the new said mission you know
about the new sensor no will it work on
a Picasso I think he's dead um yeah -
he's buy some overpriced hoodies man
they're great they really uh they're
nice and I like I said I stand behind
the product saltycomb AI we offer a
30-day
full money-back refunds if you send the
product back we buy it you don't like it
when your warranty on everything so if
anything breaks just send it back we'll
make sure to get you
we test the hoodies yeah we test the
hoodies they were pre worn not just
kidding just kidding they're new not
even made in sweatshops that's what the
box says um they're great hoodies free
hoodie rental no no nothing's free man
there's no such thing as a free lunch
put it this way if something's free look
for the small text oh I saw the new
Tesla's oh I really want a roadster man
like put it this way I was tempted to
buy a truck that's how much I wanted the
new Tesla's and then I split roadster
all right cool well you know the hoodie
the hoodie does not know promises they
might hey man the hoodie might inspire
you that's what hoodies do but giraffes
shipping out today and they'll ship out
really quick if you order I'm so yeah
shop.com may I check us out thanks for
watching
oh yeah we need that we do need that
yeah we don't need that so we have to
figure out why how do we need that but
we need that because we have to short
can but if we just love to count quite a
bit no because then they can't marry
sending stuff I don't think so basically
we have just connected to camera and no
one run or oh but I thought you could
leave the camera plugged in no you sure
I'm pretty sure because the camera is
the one that stands the steam command no
but the camera doesn't sound any command
if it's like not talking to the SDM oh
there's some there's some trick waited
yeah not use that okay I'm pretty sure
because they'd like they were talking
about like the minimum were talking
about the minimum required stuff for the
Vols oh yeah you don't have to talk to
the camera cutting that crew now
actually different crew different firms
the board group George Rodney's power
what they had that means the power he
said no patience ins power from the back
yes yeah so we cannot no I mean I think
we're gonna do like if everything to do
some like you know janky board at the
back plug in
about like Texas this cat right arm like
that yeah oh let's see if anyone
mentions it to see how attempt of scope
these are it's not these diseases a very
dark fast wait why can't I engage her
well because you have enough ability
much power and your brain
America stay plugged into Oh the camera
can stay plugged in and this is today's
this is the oldest not today's model Jim
Gina well there is not really GM G ruff
I mean in a certain sense no I'll be not
being acquired sitting at the back and I
think we'll sell it that plugs in to the
ASEM connector yeah because I wanted to
just be one thing you unplug the SEM
connector you plug it into all right
there we are engaged
got them all feels good
oh yes not the latest but yeah it's not
the latest um you guys saw so the
problem I was having with the model on
our on our drive to the off site it only
exists in the rav4 and we're not exactly
sure why it happens we think it has to
do with the height of the rav4
well
so now it should go in Arizona yeah okay
so now you have to press resume horses
are kept near the camera bugs out on
that thing yeah that's the way Flickr
frame okay so knowing your mother
yeah it is your mother this is not the
new new new it's just in your new it's
probably not the one we're shipping oh
we gotta fix Flickr Fred you have take
your frame yes yeah the Skokie's no it's
good there's no Flickr frame on your ear
yeah sort of like specially specially on
you the new hardware guys which counties
obviously it's the vault some can I
presume it'll stain yeah three seconds
we have a guy from Grand Valley watching
us endeavor Moya ganda God welcome does
it faster net you got it ya know the the
resume uh there is nobody around we
can't sell about we can we can probably
spend the bottom
or the times working time so I would say
party thirty percent of the time okay
okay thanks I'm work they did not go
spamming the resume programmatically no
but we can I think antenna right now
we're driving with a antonella's gray
panda well yeah
I was gonna try doing that yes James
thanks
that autofocus bugs
it's gonna fix their autofocus and the
flickering well the autofocus is uh
I mean I might just be yeah that might
be appropriate actually I don't know
yeah it's like
oh yeah it's like
yay detects for the accelerometer and
then it's like you can turn in the focus
thing GTS I'm guessing is the vault no
we're not we're in a vault right now oh
I hate that's hate that have to press
the button
yeah with spam resume because that's
like sets the state machine and that but
we're running our own crews I don't
understand hmm
we're running our own cruise control you
tell me the accelerate command just
doesn't work if it's no we're running on
our cruise control but they when you
stop the car they go in a special state
that they don't pay the PCI becomes non
responsive unless you press that button
it's not like we do anything they just
least in their acting to the bottom yes
[Music]
did but I'm sure we can figure out like
winning Kings are safe though yeah we
should we should look into that and we
should get those charts to be harder Sam
do that okay oh yeah and I think there's
a lot for it
the Tooting was just like go wrong on
the steering or something well you
needed like the 80 meter this deferred
lose what next burn no this gets
released this print money is the society
bothered it's not well we I want to
drive a little bit new parameters on the
couch
oh you shipped other parameters for the
cars yeah I know I know you do it's good
on these low cars
that was weird what do you do well I was
rolling and it said press resume to move
well probably because he's I can't check
this one he should because it's linked
to the states also as the state preserve
these safety the father reduced the wall
well it's not the safety depend it's
garlic tuning control staff by there is
a whole new safety for steering of Banda
but I think about the safety for
steering by the way
we're good no wobble yeah is it the
model or is it uh it's a mixed model
plus you
some puny
that wasn't nice yes
I feel like we're a little too far too
right to the right
well so we're still having I'm gonna
have all day so one thing that we want
to do for the next for the next three
entities are removing the sitting ankle
offset yeah with the feedback and he
said exactly for the next i think the
breaking feels pretty good the final
point sometimes it does a little there
is basically no wobble with intel we'd
open pilot yeah the heat here the best
actor in the world of course
yeah I think it has to do it they all
said Lerner
yeah I like that
I like the way I like the red how much I
like that go when he is a person of
these stunts together shit well though
based on it gets ran over based on the
velocity differentials oh yeah that's
right good if I mix right there you see
can I get brighter like brightness
[Music]
I guess modern leader to a two-leg yes
we are it's it's considered in modern
political control
we have different parameters the
different forms yeah and we are gonna
cheaper so every carriage is on delay
and this this week we're gonna ship a
specific parameter for each car
if you're done a premise prime yet it is
it is supported fish Brian yeah GM is
the last of the new cars we're gonna
ship the GM branch the next open pilot
and then we're not gonna be up streaming
any other cars
this is it
I like that it goes up by we control
that goes up by five yeah we've got
other because we control the yes nice
right
yeah goes on high five so yeah when we
change like the speed that you can stop
by if I like the set speed you don't
need to keep rushing forever
let's see this is when the new model
shines yes
this is supercruise quality
supers actually can engage you
and wanting some eat and not anymore now
the new model is real guys look at that
solid those lanes are on their model
yeah we have anything more than yeah
get ready crease chest and fast
now that screams like this purse
super cohesion part before GM
you guys this is really nice we're gonna
lose this doesn't wobble yeah
and you plan to support us a certain
vault sort of thing
unfortunately you need the stupid option
packages yeah so you need the premier
package which still doesn't include
driver confidence - well this is so nice
it's
yeah
you fix the pond you force it yet yes I
do father overshadow but I'm sure yeah I
think it's saturated the control how can
we make it a morning because what yeah
explain why do you remove it well
because no we need it well so I think
what you did but then we need we need
some new things that actually we should
put also for to the author
yeah I gotta move because
[Music]
when playing o ver like manually yeah
you like the comte also to raise about
that jar yeah bitch I worked yeah
because we're a bit banging that time
I'll be uh no we need we need awarding
of the control saturated okay but then
okay I need like more general change
which is fine
[Music]
like oh they're writing yourself
right
the juicer the gym is that weak
yeah it seems we care the better but
that's a requirement to see how I can
okay well I put there even if it comes
off at the wrong times
yeah it's just we need something yeah
I can just ship the Lord like it's it's
like it's one time I didn't I need to
change the thermal torque limit
cars have torque limits guys
a lot better at low speeds which work
basalt or
I don't know
because when you go highly speed that
you to eat that order
our Louis beating would return high
speed because the redlining moment on
the way it's getting your speed for the
same thing for the same shit again
interesting yeah so I mean I guess
there's some there's a best possible
there's like you know because obviously
it requires time to talk to go to zero
speed oh wait yeah having to good deals
because you have a plan of like static
for infusion and everyone is not gonna
work
I mean yes now there is he works
probably as good as the old one mm-hm
you got it about like a 30 page
okay so asked if we like the finger
everything I don't know oh yeah oh yeah
you really like that that's all that's
that's one of the secrets
Oh your secret economy I know how about
that television hack some other ways
February those are all cancels all PCM
hacks are canceled but if there is going
to be a flash all three flashes are
can't know the only reflex that might be
considered is any Bosch radar reflow it
gets us more data we love data all all
functionality re flashes are canceled
for business reasons not for technical
reasons
bye-bye nice supportive car here comes
to yoga PETA panel oh I mean yeah that
might happen
I'll feel good no my legs well but there
is a whites better is because when
they'll they'll modern when it's
uncertain it was telling to write it's
not like it was trying to take the
Exeter it was just the consequence of I
don't know where to go go right what a
crappy model yeah I can't believe we
shipped it for so long is that the young
fan were here now I'd say she she's on
oh yeah yeah young fan is similar in
loudness to your car racing
fucking year by the fudge doesn't even
turn around the author
I think can't write the tuna isn't the
one that isn't luxury yeah
Jesus a or something I think he doesn't
have some feature that we need
yeah if you gotta eat me up a pilot you
see if it's actually support you if you
can't be supported on
so here's the thing I don't know whether
this turn exceeds limits
yeah I can change it yeah I can change
it but it's gonna be annoying when you
when you write your self it's always
going to throw it but it's fixable I can
probably fix Bart beings today
but by Deniz Easter Easter eggs
yeah look there's two pigs let's do the
Easter egg it's a glitch frame if you
hit the pedal during the glitch frame it
disengages
booting you need a minimum of two
cameras don't do it away with that other
no no no what comes up in one camera
yeah mobile I can do it we can do it
people can die with one eye
so nice so nice look at that
it doesn't cut into turns early anymore
it seems I feel like the old model will
just cut into that turn pushed out a
little still
new model yes it is not even the latest
I know the newer new model is gonna be
even better
yeah
a lot of people from working
it's all part of our new mapping
architecture
guys there's a lot of great stuff coming
unbelievable stuff
now if you have a G app you'll be able
to get it all should we make to make the
GM
the GM draft bill in the back we should
probably make something like well be
nice the Africa like auto switch the
radar power based on the presence of cat
messages simple analog circuit for that
ah
yeah wow that that uh the skyline back
is almost flawless the only real
disengagement switch
in here and there are people who stuff
very soon very soon guys yeah
well although I mean the first of the
unbelievable stuff will be the model
yeah no it's not like you know this
bottle is not it's the same architecture
it's not like radically do we just the
data quality has gone up from fast
that's appendage enough we'll work on
2018 a quarter no were you going to
draft us they're gonna come up with on
you on the job
yeah bullshit we both don't worry that
discontinuing the old one yeah
OSHA found of Australis all
yeah I think this is probably
comfortable to the new new autopilot
model I think so
now the volta are not on delay trick
they are it balls are just electric yeah
and the bolts are not supported
is the stopping for red light still I
think there's not a problem with that
yeah yeah we don't want to ship it until
we can make it really reliable we got to
do maps first guys
we're hiring a mapping engineer
the sooner we get back her the sooner
Maps happen
we're monthly you saying max torque
stealin 0xff it can do more really
mottely tell me how can we do more
torque
well I mean this limit is probably a
little lower than they tend to yours I
would say
get that wobble it's more in honde at
least mother has known torque as we
disappointing about its work we're all
over the place
right
fusion of stock car infusion Lusaka I
think it was really moving and get all
the way but oh man
how I was gonna be happy with his drive
back just an improved yeah well he's not
gonna have youth on this we ship today
we can go in Devan I guess
Oh model you get a whole model guys what
you love old model this model has two
problems I think one of them is fixed in
the one that was trained last night in
sharp turns it gives up and goes
straight and a rav4 does Mark know maybe
he just won't get it helps get old old
yeah he's gonna do it stuff should we
make extreme devel it's like to hell but
it gets even more so monthly says we
can't just go I go then 0xff interesting
okay yeah well I took the safety was
saying that if we commend more than that
he's gonna fall Tower I actually never
tried should have tried
one time like why didn't that go oh he
didn't go through review got yeah my
first was oh I was like I was on a hill
okay
sure snap
now this is gonna the shares all the
same protocol category right I'm just
gonna I need to do the marriage but like
that close I just need to hurt them
let's do that what we still have this
corner yeah
what happened there
do not have stereotype available
right well I miss Tito sadness oh yeah
be nice we got our new tools to review
these great things up yeah I got that of
your dish finger got a good old America
put back the large I felt so nice that
I'll have to press the stupid resume
button would you would you shit mother
okay if it's there
maybe
cool
definitely shippable
i supercruise quality on the highway
guys almost if anything he was available
I think ISM we wouldn't have who never
had super Crowley's the for the entire
driver you know I was no it was no part
of that time the Super's development I
think cool
all right thanks focus o
0ff is to never fault limit it can fault
above that Oh
yo yo periscope what up I said we were
back we almost didn't come back cuz our
trunk is open and we have a large
television hanging out the back but is
this amount of extra stuff we have oh
you can see Oh oh my god oh god I'm
trusting open pilot to drive the
televisions home I'm gonna make a change
here nice and smooth
[Music]
[Music]
we have a big TV in the truck that's
right something pulled over we did say
we'd come back we're kind of like I
don't really want to come back but you
know for the live streaming people we
are honest live streamers oh and there's
doing any good no I don't think so I
think that boy that the TV's gonna stay
with us it's the more it's gonna lose us
and then we have watching me yeah you
know what I mean like maybe we were too
crazy with two TVs
oh we were the guys like two TVs yeah
begin Amino this is reflective of how we
actually use open pilot it's a lot like
autopilot just well um you know help you
out with a lot of scenarios
assistant system - is press conference
well it's a press conference so we're
inviting the press by for appointments
on Wednesday and Thursday
could you see live no you can't it's
actually gonna be an embargo until
Friday at 6 p.m. but we're gonna be back
live Friday at noon I'm gonna demo the
new product fabulous that'll be so much
more exciting
it's good
we got to be over there wouldn't be nice
of open file help us out with that
Comstock
coming soon zero points for comments it
well people came back quick I know
people were waiting for it um so maybe
we'll continue down Route one and we'll
take slope huh okay yeah yeah just cuz I
don't really want to get to that Lane
yeah this thing might kind of work on
Route one let's see what we can do so I
think this next turn is gonna be above
the torque planet now that's another
great advantage of mapping we're gonna
know exactly which turns are above the
torque limit we're already putting our
dis engagements on a map
spoiler alert maybe that's one of the
things we'll put on the big TV oh we got
tickles we've got a table TVs
TCL I can't even show you because we
don't even have the good size but
[Music]
truly did it again are we gonna get
breakout we're gonna get breaker breaker
no gap created self-driving cars because
we failed with flying cars here uber is
working on flying cars next we're
chopper you know they do real news
super chopper is pretty fun old at North
Cal recently itself of a pilot on his
father's car
exciting exciting wait really fifteen
year olds drive you are aware that if
you're using open pilot you still need a
driver's license right nor account maybe
they got like farms out there really
farming kids driving the father's car
yeah but
we'll take the barking fruit again yeah
I think use it responsibility is that
shooting laser at the top it's not have
any lasers
you see this turn here yeah so this is
what open pilot has gotten so much
better at recently this one is a little
bit alright wants to go that way let's
go
one-lane yeah so notice that I'm right
now it's driving with one lane marker
and again we're gonna get a
disengagement here for the red light
okay we're gonna look into all that it
will be fixed well I'll tweet that
shouldn't be it's not in release it's
only in our stuff you can't give the
best - you know because we test and then
we make what we release next even better
if you would think that we would be
driving with the best of the best
oh no everybody when you worked at
Facebook internally you use internal
buggy Facebook yeah sounds awful you use
the beta of your product every company
does that I will sign on to a fatalist
oh that was something sliding yep chunk
is open trunk is open is the TV on the
ground
let's put twit this blinker on just we
can see the outside of this oh wow that
was that was a responsive
um so yeah I mean open pilot is is just
learning how to start to drive these
sort of streets it doesn't okay job
yeah I mean this is this is stunning
there's no like trick here that you can
have already in release open
one of our top drivers was driving at 14
yeah yeah yeah I mean yeah some of the
states some of the states really Alaska
does our last damn sure 17 No
[Music]
turning here oh my god did you forget we
have TV I forgot we had beauties I think
we're good I think the TV has made it
alright well just we'll get out I'll
show the people the TVs any last
questions questions I'll show you the
TVs Thank You Honda Honda what was
terrifying that turn yeah show him a
tickle tickle
and any Best Buy near you
oh no we bought them at Target no no now
listen listen that's pie's cool we went
to Best Buy every possible target and
then we price match with Best Buy yeah
we did they would only price match one
TV all right thanks later people
hello
periscope three people we have one
person we have one person two people the
Tesla says all right so I think we
should kind of go through this all right
because this is kind of a lot of what I
see is wrong with how modern companies
communicate I'm so changing the world
with with AV that's all great this guy
then you have a big a big a big
statement cautionary note on
forward-looking statements basically
it's saying like we can't predict the
future right so this is this is like
thing one no shit right this is this
shouldn't have to be a thing I'm not
sure what kind of world we live in where
it's like you have to make a claim that
we cannot predict them but let's move on
GM's world you know I'm not gonna be
able to do this that well because I was
just I was just talking about it with
Vivian and like why something like this
is absurd so you know if you have
something like the trade-off between
socialism and libertarianism there's
arguments to be made on both sides right
if you have like a trade-off between
cameras and lidar there's arguments to
be made on both sides and you could have
a camera you could have a company that's
committed to cameras are committed to
light our committed to socialism
committed to libertarianism but in order
for that to like make any sense you need
to have like a reasonable not like a
like a really stupid straw man you would
need I'm gonna go reasonable you know
thing that you are in order for you to
be saying anything you have to be able
to reasonably imagine
somebody's saying the opposite right so
let's look at these things zero crashes
zero emission zero congestion so good
could you imagine somebody coming out in
favor of crashes good good boy could you
imagine some company coming out saying
well yeah like that's not a everything
in engineering and this is Yuma shows
you that these people aren't engineers
they don't think like engineers is about
trade-offs right if you're designing a
microprocessor you make a trade-off
between say speed and power or you can
make trade-offs between like reliability
and cost engineering is all about
trade-offs I'm not sure what this is
right everybody who wants there to be
zero crashes but to say like gee I was
worldview like this is actually a unique
and distinctive worldview it's not this
says nothing zero emissions zero
congestion nobody wants those things
right even you might have some people
who may not care about emissions but but
they're not opposed to zero it's
something that like everybody knows is
better this is not this is saying
nothing we are redefining the future of
personal mobility right so you then go
through all of these things and I mean
they're not these are all different
companies you talk about electric
vehicles maybe you have like Tesla's the
leader you talk about autonomous
vehicles maybe have way mostly there you
talk about shared mobility maybe you
have Ober is the leader I'm not okay but
I read about it so these sort of things
yeah committed to the future of strong
cores the foundation for investing in
the future electrification um so here's
another interesting thing that I noted
in here where they talk about Eevee is
the foundation for autonomous vehicles
up why because it supports our zero
emissions future again your companies
are not being led by engineers and this
is why you will lose
um you know or they say like there is no
AV without Evie I mean of course there
is right look WAY Moe's doing it right
way most Pacifica they're hybrids but
autonomous vehicles are very different
from electric vehicles because if you
had one autonomous vehicle it would be
incredibly useful just having you in one
autonomous vehicle is useful having you
in one electric vehicle is not that
useful because you need infrastructure
to support it so sometimes I think to
say things very quickly like you know
Evie is a shared infrastructure problem
but it is you don't need infrastructure
to support autonomous vehicles and it's
important to notice all the people out
there talking about like V to V and V to
I you actually need you you yeah
electric vehicles of course the main
thing that you need is is charging
stations so unless you have quick
charging stations like even if you have
a car that's capable of charging in five
minutes
when you look at how many megawatts of
power you'd have to pump through the
thing but this isn't gonna be that long
let's let's see Lea my AV strategy right
uh you know traffic fatalities are
caused by human error everyone knows
that parking okay we believe all a V's
must be V's on I have no idea why that
like are you making an argument here or
these just like statements independent
you know what else does this like TED
Talks you ever see that like and when I
press this button words will appear on
the screen so let's see if they get into
the technology Batman look at that lines
will go up bad lines will go down but
most lines will go up Oh
okay first mover escape velocity your
transportation service again um the
transportation of the service I'm not
really sure why autonomous vehicles make
transportation as a service cheaper but
I'm not sure there is some truly
critical threshold for it's the reason a
lot more people for a lot of people
using uber would be cheaper than then
car ownership but they're not making a
rational evaluation about this they're
not making like a rational decision
because most purchases are irrational
does a huge advertising business which
support this um so they're still talking
about how they're gonna do any of this
safety is the gating metric yeah okay
sure sure sure
GM is uniquely positioned in the IRT as
I say the word uniqueness in this in
this presentation oh okay so it's so
execution um talent is the foundation
right
so so when you brag about talent you
brag about how you've recruited people
from uber and Google boo at Google our
competitors in this space how do you win
if you are bragging about it's okay
there's lots of ways you could you can
still win but you need you need
something else right um and I'll explain
a concept in in in poker called called
domination and domination basically are
look like if your hand is ace king this
is a pretty good hand to have unless
somebody else at the table has baseness
alright this is Texas Hold'em if seventy
nine wow people are into this man okay
so so listen if flop comes over right
let's say let's say so so figured you
have a go-go player one sitting here
with an ace and your player two sitting
here with a scam right um if the flop
comes over and there's an ace on the
flop let's say
something like ace seven six right
player 2 thinks through in a good
position to aces but they're really not
because player 1 has has three aces
right let's even say it it's Kings at
six right player two still believes that
they are in a good position
even though player 1 is right now
player 3 is of course sitting at the
table with you know eight nine eight
nine maybe there are suited connectors
right player three is in a better
position than player two right because
think about how many outs player 2 has
versus how many outs player three has
even if they came up the only real way
player 2 wins this not with another ace
right another ace player 3 is three of a
kind to two pair but even if another
king comes up that's the the only way
player 2 can win as if a king comes up
right versus player three which could
win of either a a 10 or 5 cuts I write a
lot their strengths minister it's gonna
be so you do not want to be player 2 and
I'll mark you why Cruz is player 2 right
now all components need to be six I
developed for a successful launch right
the problem is the exact same slide
exists at lame-o but way mo has more of
these boxes filled in you know I'm
really hoping like like why am I doing
this
I'm really hoping some investors will be
able to hopefully like start to
critically evaluate what this space
looks like and realized why if you're
the Ace King if you're saying I'm going
to build what way mo is building how are
you going to beat way mo so you know
silver bullet for AV technology I mean
really that's at least a statement
that's at least a statement where
something's being said it's
but their compote is an engineer this is
a section right he is he is an engineer
you can tell that he's thinking like an
engineer because he's making statements
that have another like you you can argue
the other side right now I'm not saying
your side is wrong but you are wrong by
default if there is no other side or
you're not even wrong you're just saying
nothing and this is something that
everybody should use when they evaluate
anything in the world right like think
about the other position and whether
it's a viable position right if people
stopped like like likley please start
evaluating what is being said right and
now you'll think about the other side
and don't attribute Mouse to the other
side if there is another side right but
if there is no this type realize you're
saying nothing cool
so no silver bullet for a check for any
technology I mean maybe there is right
there was a silver bullet for a girl
playing I mean maybe now I'll get into
I'll do a little bit of contrasting this
with what comma believes um so there was
a silver bullet for go playing right if
you can you can kind of think of all the
same stuff if you are trying to build a
go agent you can imagine a company
trying to build a go agent um you know
they're like well okay so we're gonna do
some sort of some awesome some endgame
study some some opening moves study some
jokes Seki study you right and the truth
is that none of this matter at all I
mean in fact so much didn't matter at
all that you didn't even need the
historical data you just needed to build
one maybe a silver bullet your magical
reinforcement learning algorithm and
alphago zero so this is a this is a this
is a state and maybe it wasn't even made
this way maybe it wasn't even made as a
statement that could have another side
argue but I will argue the other side
and I will argue that the silver bullet
for maybe technology is reinforcement
learning is is sophisticated machine
learning because we if you we live in
the alphago's 0 world that changed the
world um deep simulation capability
right
does Cruz think their simulator is
better than huevos when was this thing
called car crafter it's a very
sophisticated simulator um best
simulator in the world right now
great simulator wish I had access to it
right just cruise think they're they're
simulators better than weightless right
um HD map they can route it who's miss
mafic company in the world
what are you use Maps well you use you
use one of three everybody pretty much
uses one of three you're either using
Google Maps ways or Apple Maps and
you're not using Apple maps cuz it's
your first choice you're using Apple
house cuz it came to your iPhone um
Google Maps and ways are actually owned
by the same company called Google which
is also my alphabet which is the same
company that also owns way mode right so
so who is the best HD mapping and
routing company in the world
Google proprietary AV sensors okay so so
now you're telling me you're gonna build
custom light so so so so let's talk
about the three things we have
simulation mapping and light swipe these
on the right that's really that's really
because this is this is like a strategy
for maybe company right maybe I should
have kept the poker hands on the board
because that really is the analogy um
you know your simulation mapping
and so this is one path to self-driving
cars um it might be the right path I'm
not arguing like like like whether it's
the right path or the wrong path can be
argued on the other side might way mom
win self-driving cars I think it's way
mo loses I mean they have a huge
technology lead right now they Google
has a notorious problem with rolling
things out maybe this is somewhat what
Cruz is betting on but you're in a very
bad position if you're counting on your
opponent to make a mistake right if
you're counting on your if you have like
a fundamentally different strategy from
air quality you're in a much better
position than if you're counting on your
opponent to mess up I never would plays
chess or any sort of strategy game knows
this right you don't want to keep your
down pieces you're like but I know that
week I know they're gonna they're gonna
stupidly lose they're wrong and he may
be but when you look at advantage right
now advantage Google advantage Google
advantage Google so maybe maybe maybe
execution has advantage Cruz but you're
arguing
it's an execution by them by do it
excuse me
hmm does actually know how to ship cars
and the way mouth you know builds like
satin they built their own for each
other it's not well Scott right
I don't think GM cars are great but if I
had a choice between are you like I
would remember that time for the Chevy
Cobalt
forty thousand dollar card it doesn't
power seats it has that it has a
eight-inch resistive touchscreen like
really about my model three minute I
want to model to if anyone out there was
to some new model three moment but um
yeah but you're fundamentally like
execution kind of has inhabitant
right - you're counting on your opponent
to make a mistake of your cruise so
maybe this is the you know traditional
right um now there's another stack the
other stack is the amount stack and this
is kind of where comma lies and we're
testing lies so if you think about big
data and machine now you can of course
like the same argument for for comma and
Tesla between between Google Cruz are
you talking about I tell actually both
the advantages here um but we
acknowledge this fact right and the idea
is Tesla has a disadvantage Tesla has a
substantial disadvantage and Tesla's
disadvantages the following proprietor I
don't know how to spell that word so say
it's a less and they also had easy use
right so if you believe the following
two things about Tesla if you believe
that Tesla's never go into licensed
autopilot technology probably pretty
likely um then you can talk about you
know this is working okay for comma and
you can also believe that Tesla will
never build non electrical um and the
thing here is autonomous is going to
happen before electric because of that
network effect that I talked about
before
about how we can't have the advantage
here because I mean you know my zero
emissions I'm a fan of zero emissions
too but you know it's not my worldview
right so let's go back to the this is
really the main point I want to make
right like how are you going to be
justice Google Google understands their
execution problem like at least they
understand what their own mistake so
they can bring it out of a car company
CEO they brought me on that guy you know
you watching the robot summon is that
right he's right he understands where
Google's previous failings are now if I
were label of course but I would be
doing is I would open that the Pacifica
platform all right now to people right
just just just do it man just ship it
you know who actually this firm we
talked about some time in the office
right imagine instead of Google Fiber it
was called uber fiber you know that shit
would be everywhere they'd be crushing
ISPs left and right Comcast would be in
a corner crying like the taxi companies
are right now that's why we slap Comcast
don't interrupt our service Comcast yeah
we pay on time oh we pay on time cool
yeah so yeah yeah yeah yeah I go to
market are ok so this uh this go to
market again it's the exact same slides
right now that way my eyes right this is
literally way most for requirements for
launching as well um anchored by
valuable franchises yeah China Australia
right business business business
business business business I cool things
that nobody understands in disclaim okay
cool um but yeah do you have questions
not really people are excited
for uber fiber fiber is gonna be sick
man yep
whoever I was gonna be sick some someone
has before Colliver sway my like why why
do you think that's dead well okay so
you can talk about the traditional stack
or the ml stack right um which one of
these wins is it yet to be discovered
fact about the world
um maybe maybe this is even like like
lidar versus cameras right it's not uh
we don't know yet which approach wins so
comment is a bet comment is a bet comma
I mean to be fair way Moe's got the Aces
and we got the the nine-eight of course
of course when most got the Aces cruises
the Ace King we get their name right so
we go back to my poker analogy here the
nice thing about you know waynebow was
valued at uh at 10 billion dollars and
they become as valued at 200 million so
that's that's uh that's a pretty big
differential we're talking about you
know 500 x right 500 x is actually a lot
lower than the real odds of winning
these hands all right so I'm fun to do
for nine day I just don't have these
camera I really don't have any use king
of the stairs a scheme has very few outs
when someone at the table is holding is
holding places I could flush to or you
know that guy doesn't know any updates
for new users I want to convert to um Oh
converting you're gonna buy any on that
have you come on conversions come on I
mean this here's what I say about music
I know some NGOs that I feel about rugby
Tampa's reveille pandas right now still
work
Neos will continue to work they just
won't be officially supported it won't
be tested they won't be but we're not
gonna do anything to gratuitously break
right it's not like you always want to
be always wonder it's like an apple
they do they make it looks like very
difficult to run on it oh yeah there's a
physical build Nate's talking in town
sounds good Hey look man in town
you guys keep building faster processors
and we'll keep building slower operating
systems so yeah I mean what what are
what are our advantages over Tesla you
see like the equipment is if way mo wins
and beats crews they beat crews if Tesla
Widow really launches their service a
year before crews has a service ready to
launch they'd have to be the dumbest
people in history to not be able to
scale that up and to not be able to like
come on that's an easy problem compared
to like the technical engineering
probably software right if Tesla wins
and thoroughly wins we went to we went
to in the same way
iOS is never going to have 95 percent
market share because iPhones are too
expensive and they're only supported
well they're supported by one company
and they guess there's no real
corresponding infrastructure problem and
there's no fundamental reason that Apple
won't build things that might look like
Android phones right which is why what
you see in the iOS and so why is comma
different from way mo because we're
trying to completely different approach
whether this approach or this approach
wins remains to be seen this is a fact
yet to be discovered about the world and
whether Tesla or comma wins I argue that
there's no income losses even if Tesla
crushes it even if Tesla in fact there
Tesla autopilot like you know by the end
of this year is level 3 thank you for
the existence proof right thank you for
telling me that I know I can build
something that good right even if I
don't know how it works just kind of
know it makes it a little bit easier you
kind of think okay well I know that
works I'm sure I can figure out how to
do that all right you see this in
science all the time you see that things
get discovered really really close to
each other so yeah if Tesla wins , wins
if Weibo wins
I just don't really see it right I was
GM wants to of course sell cars to
Google and below dealership prices they
went a little can keep the temper set
margins while you can right look at the
Bob Liberty does it wobble over deal
right do you want to be Volvo in that
deal you just got a huge purchase order
and to be fair you're now Foxconn right
that's what this one doesn't have any
phones to be phone makers that really
wanted to differentiate themselves with
software lost and phone makers that were
like we're just gonna build really nice
Hardware one black bear you're gone
Samsung was doing great
LG is doing all right but remember the
phone Samsung and LG used to make these
to make the crappiest flip phones 2006
any other questions nope eighty-six
viewers then 86 viewers we should we
should convert these we should like try
like play an ad right now and like
periscope will pay me all right this is
a comedy on comet eons are the
replacement for your car dashboard it's
everything you should have wanted and
you're kind of unfortunately this comet
Aeon doesn't have any software in it
because it's a very impromptu
advertisement but this is a great
universal computing platform for your
car this is really don't get yours it'll
have something when you have you doing
you guys one song we don'twe this song
isn't something where's the software
game yeah this is the
yes um is it panda pandas are universal
car interfaces um they turn car ports
that look like this into is everybody
leaving because it's a happening we have
more people with people about like SUV
Honda Odysseys Oh Honda Odyssey which
has the upside-down connector oh no I
mean it works it kind of works yeah let
let let some other people kind of figure
out the Odyssey first be connectors
literally upside down so the giraffe
doesn't physically fit in the car it's
ridiculous it's they probably did that
on purpose they never attribute to
malice but you can tune on in confidence
oh by the way this is not sold as a
self-driving car kit none of this stuff
is sold as a self-driving car kit we
sell dash cams and minor car peripherals
we give away free software which which
is a driving agent Honda Accord the new
Honda Accord is gonna be easier to do in
the old Honda Accord the old Honda
Accord used this weird L cast hearing
the 2018 hotter chord actually every
Honda Accord comes with I think they're
still calling about a sensing so yeah
it's a panda
there are $99 they convert this plug
which is available on every car made
after 1996 well what you're good we got
a hyper that's this is great this is
great yeah um you got to stay with us
for the rest of the and after this break
we'll tell you who gets the roads will
tell you oh cool so this is a yeah I've
got Wi-Fi USB bridges your car two
things that look like computers phones
of course look like computers keeps in
the future yeah you can do it yourself
man it's open source comma officially
will support Honda's and Toyota's
everything else is gonna be community
supported but you seen pretty good
community support does one last serve
all speaking of community support we've
got a tour coming up oh well no no we'll
get there we haven't we got an advertise
for the last thing we saw the responding
30 product today so that product yeah we
have a fourth product - I don't have one
where's my hoodie oh people are asking
about shirts are we gonna sell no we
only sell hoodies and they're only over
part No oh is that a hoodie yeah yeah no
this is an old one this is an old buddy
no no you're not gonna you're getting
you get much nicer orders man um yeah no
yeah we got hats bro we got hats yeah
yeah you know I feel like I feel like ah
so the giraffe giraffes connect pandas
even deeper into your car this
connectors are available on a lot of
Toyotas are you pan down like this like
your connector in like this and then of
course you have here a USB cable I'm
going here your panda we're
mass-producing he owns right now yeah
just place it like that be an excellent
dad yeah okay let's talk about our tour
cool um so it starts we're gonna have a
kickoff event for the press who doesn't
know about this yet but um we're having
a kickoff event on the 14th to kick off
self-driving car Awareness Week
self-driving car worship leave that like
on the board that should always be there
should always be there so on the 14th
we're gonna have the kickoff for self s
pellet right I'm really bad at like
writing with like a penny driving car
awareness we terrible marker you know
you know what know who else you know
would still be CEO of his company if it
was profitable who would so we see you
as a company of those profitable with
Travis yes
this is dedicated to Travis and I
seriously hope you doing Walter yeah
I'm a big fan Hoover's done so much good
for the world so much so much good ice
cream truck music like lick were like
been aggressive and push it out to every
city no way man you needed someone to
beat those taxis up yeah
so I'm 14th we're having a press event
um and yeah we're gonna let the press
drive our alright we're calling them
demonstration units demonstration use to
demonstrate our open source software
open Pi and then we will be traveling
across the country all right so we are
right here in the middle of the country
people think of San Francisco being
north but it's not really this is where
we're starting for the self-driving car
awareness to we're gonna be driving
across the country all the way back to
tour that's right yes right
never-before-seen we're gonna be driving
from San Francisco to to New Jersey in a
self-driving car we're gonna be doing a
lot of periscoping to make sure that can
you follow on periscope or is there word
Twitter's orders following so follow on
yeah and that gets tuned in tuned in
then follow his ass like Twitter what a
good line what are you like yeah cool so
we're gonna be we're gonna be plowing
through California to Nevada really
boring here's like Reno I don't think
we're stopping I know I've already spent
to Burning Man and stuff to green I went
too many times which was once we're
gonna fly through Nevada here or it
passed Windham you good you guys know
what am yuka you would not win a mucus
you drove to for gas a lot of times
actually there's one great thing in
Nevada and that's down here that's Las
Vegas but we won't be going on and what
we want to LA this weekend for nips
though here oh that's good because we're
not going to land a lot of people ask
about LA no that's just conference
that's saying so say guess I guess
there's Wyndham UK we're gonna fight to
win em you go and we're gonna stop right
here in Salt Lake City Salt Lake City is
the first stop on the self-driving car
awareness tour we're still followers so
people still watch this any point is
work that I worked for a man what kiss
blow us out better yeah what we're on
the periscope where we're showing for
this ultra now around this to it nice we
yeah we just ranted about the cruise
yeah was watching upstairs with Harold
this on that shit show
what
really reasonability I assume it was
like an eight-hour presentation or
something if I have to actually sit
there for that oh I like applaud for
like the GM executive he had GM except
nobody should let me around the company
we're getting distracted and we're
losing folks okay so it's the song so
slowly City and then we're gonna drive
over here to Kansas next agenda oh whoa
stopping in Denver Denver but we've
actually never tourists off the number
but we're not anywhere stun oh yeah yeah
we're chillin in Denver so purple we
will circle the tour stop in purple
right cool so don't went driving like
the long distance over here to Kansas
City Missouri campus it's the one knock
Hesston Kansas only Kansas City Missouri
yeah we're not going to Kansas yo one
time I was in Kansas City and it was
tax-free holiday but only in like one of
the states so I went to the Apple store
in that state part of Kansas City I'm
not the other state part of Kansas City
that's confusing it's true yeah all
right cool and then we're gonna be
making the trip up here oh I've never
actually done anything in Omaha yeah
you're slapping them to stop it on and
then a tour stop in Sioux oh oh well
this is gonna be hard I really can't let
go you X I really can't smell anything
without Google guys don't don't take us
in the general intelligence all right
and then we're going up north nor in the
appleís oh well I guess I'm in the
apples hitch or something no nuts were
stopped let's go at the mall America
yeah
I was ready because that's new yeah you
know okay down over here to Chicago
yeah where we also wanted to talk to a
stop but we will it to a stop
in Pittsburgh burg with me okay not
Pittsburg California and then we're
gonna head down here Philly Philly Pitts
and definitely stopping and that's gonna
be the last stop on our tour and I will
drive home to New Jersey yep
so Philly happens on the total third Wow
so we have one two three four five six
stops as well as the press event in San
Francisco which you can kind of
extrapolate out from the 14th we're
gonna be publishing it it's gonna be
like warp tour man yeah you know what's
the last year Warped Tour it's the first
year of the sub driving awareness still
looking to minors we're still looking
for partners your crews do you want to
partner with some no but but enough but
seriously I'm gonna hear in any of these
cities you want to set up an event we'll
have the car there dude
live in Eddie from , also driven and
until Chicago are joining until Chicago
absolutely I'm so there will be the lead
three of us will all be in comic gear
we're gonna make up some nice software
and car where's tour t-shirt man I've
always wanted a tour the country like
little peep so now we're now we're doing
recipes yep but I've always wanted to in
country are so we're doing this as a
sovereign power we're just or we're
gonna have the self-driving car
available for people to try out how you
can try a self-driving car yes with come
AI you can hopefully we can have open
town 0.4 out by then when the software
team shows up resources enough yeah I
hope the software teams if I'm watching
this and we're all counting on them
we're all counting on them
that's right so yeah we're gonna that
out and we're gonna let you guys try it
and then we're also gonna have our dash
cam pandas and your apps available for
sale right on the spot we're gonna get
one of those little swipe ease so we can
have coordinators car readers s that's
the word we're gonna get one of those
then you guys you know what let me tell
you about starting a company I used to
say don't ever start a company but we're
amending that don't ever start a company
if you're not gonna have fun we gotta
have
man you know who's not having fun
whoever wrote that long legal disclaimer
in there someone's asking us zero point
three point nine when's that coming up
oh well almost everything would I cut
out touches on the list when that list
is done that yeah a little lunch it
would be good night my sadly not gonna
have a new model um I take that they're
failing for this but it should still be
pretty good cool any more questions
people are still alright alright guys up
tempo awareness to it thank you for
joining us on periscope and I hope you
have a great day thanks guys
it already did watch the old scope these
they all have you okay where it's
working it's working
wait do they like it help you put it on
Twitter right like you click to Twitter
did you pick the Twitter button I mean
I'm only here did I click the Twitter
button
I'm only here through Twitter ask the
God no but you have to click the button
to share please leave 22 people already
well they could be notification salon
Eric can you tell me if I click the
Twitter button
it's on Twitter okay cool cool we were
just talking about how well this car
drives yeah this is an a chord yeah this
is the awkward it's really really smooth
there there
we don't use the proper
ready like anymore can buy one this
isn't like today this is like these ooks
yeah right you can't say it's answers
doesn't make any sense that's it guys
we're driving down to Campbell to pick
up some servers before our presentation
I got us a great deal on servers man I
found George you destroyed oh my god I'm
sorry
Wow that works it works its own this car
needs 2x torque the torque is a little
weak
you know our Civic has 2x torque
it's very nice but new models so good
nice hair George Wow oh yeah you did
this but yeah we're going on a like
experiments to finish fast so we'll
increase research productivity
yes yes if I get investigated
yeah we have a paper trail oh yeah we
gotta stop because we gotta keep
presentation 4:30 by the way guys
yeah we're dropping cash on servers
who's doing it that's like the time Jake
pull up on the Lambo with pennies no he
didn't stage thing yeah that's why it
was crazy
cancel the product announcement well
chase being CEO is worked worse fake
news than oh I don't know Paul I have
some political examples and we don't
believe it I mean absolutely we don't
discuss politics now we discuss politics
a lot we just don't judge people let's
say no judgement guys the world needs a
lot less judgement and a lot more love
the county last element looks like a
safe space he's all about the luck yeah
it's Commons the safe space for everyone
yeah can we also mention we're bringing
back the mobile store store file the
4:30 in Mountain View we're doing this
presentation yeah if you guys want to
drop by I think we'll be done around
5:00 we'll be standing outside the
Computer History Museum with the mobile
store come look we'll do an IRL man one
day we'll have so many followers we'll
do like flash mobs oh that'll be
but this car drives amazingly yeah and
now there's a charge in his shoes be
fixed
yeah we just we have the charge against
you on the way back from camping it's
$150 a ticket yeah I know
are you serious I know well you know I
feel like on this right so no no but
we'll we'll bring the mobile store
outside well we do have a comma meetup
right there in the park exactly if
anyone shows up we'll show you this back
you can check out our end a cord yeah
this thing drives so great yeah the way
back from camping we hit the charging
issue oh that's right and you were
really fun I was so bummed not to have
it that really like turn my mood or out
well and then it hit me that I walk 90
miles
oh my god
oh my gosh
scared to hit the gas pedal um yeah but
this car does need to x-torq so if
anyone's got that 2x4 c'mon our Civic
has to explore but if anyone's got that
2x Torquemada out there for the Accord
conspirator sponsored by yerba Oh
I feel like you always are drinking at
your Vermont a in the periscope they can
sponsor soldier who can wear this to a
party dad the stork is hitting it right
here yeah it just feels better with the
2x4 guys we got to do torque more
someone just said I'll trade you torque
months so you have a court or poon gym
it I would trade Civic for quad for
court or quad so someone just said I'll
trade you in for the sip of the Civic
Tour c'mon yeah but do they have a court
or club do you have a chord I would
trade a court I would trade center for
Court
like at that point like here's the thing
about the tart pot it's only unsafe in
the hands of news in progress they said
if someone's good enough to figure out
the award or not like I'm not worried
about you also having Pacific tour I
have 20 18 accord no they don't have
much torque mod torque was so hard
exhibit my baby ref maybe maybe 20
people in the world get to tour pot well
maybe at Hell fish is the one for us I
don't know if those guys can do torque
torque one is hard accurate torquemada's
easier but civic torque mode requires
dumping the firmware and like I kind of
told people half how to do it in my code
blue talk but it's really hard maybe you
should do a live periscope of how to do
it you're trying to trick me Scotty 4:30
p.m. Pacific Standard Time yeah we're
dropping a new product we got a
presentation prepared yeah it's gonna be
crazy it's gonna mine they're not on the
wheel this way cuz I got driver
monitoring what it's looking at me
yeah look away
there you go keep looking away oh yeah
yeah it's gonna be scope we're gonna put
it we're gonna lie to you but we're not
gonna ask beg for forgiveness that's
right do you think it was gonna ask yeah
I mean maybe they've seen my stuff about
now we don't ask no just like do it like
can stop you know keep it like under
your breast pocket that's right you know
why this character is doing the right
thing when nobody's watching and
periscoping that we'll be doing the
right thing nobody will watch no we
already don't hear this thing about
characters it's a beautiful quote
character is doing the right thing when
nobody is watching characters are doing
the right thing like character that your
characters are doing the right thing
Wow so you tell me if I got a piece of
paper with some characters on it they're
doing the right thing even when nobody's
watching that's good yeah you can do the
right thing and put some characters on
paper you don't I'm saying that's right
I love language man you see George
Carlin talking about how he loves
language George Carlin is that damn
Carlin's brother no I'm gonna be cool oh
yeah no George Cohen was a comedian
back in the day
rolled in his grave if you saw the world
that I you guys on doesn't way better
than a onus now like just in general I
love this car
this car as a car I this is my favorite
of the comic cars by far I drove the
Santa Fe I know I was saying good things
about you and I yeah but somebody is
nice from a like torque and latency
perspective but from like a car
perspective and I kind of hated it yeah
well it's just so big if it were smaller
it be I like it but I like this car
anymore this is this is an incredible 0
to 60 times and my Benz yeah but your
Benz is a boat yeah I know but my Benz
had like a 400 horsepower engine it's a
blocky video that's the worst
purrs go sucks okay the Lexus is you can
also download more torque for this car
down a little more horsepower for this
car um but no it like honestly this car
doesn't need more horsepower because if
you slam on the gas at the light you're
already getting tire stick we can I
block box yeah you can block whoever you
want fit if they piss you off you can
block okay I block people block resists
sometimes we have wrasses Scott Walker
gotta try the Chevy's maybe Chevy's brow
we have Cadillac it's I I don't like the
Cadillac like this car I mean they like
this car better than the Cadillac I like
the Honda and the Hyundai the best no
but this car is by far my favorite
I wish we had Torquemada and I wish we
had stop and go and then we can do the
awareness tour in this car you so me
atopic stopping though no or stop and go
oh oh we're gonna start slowing down for
turns once we ship slow down for turns
then it's gonna suck if you don't have
kama stopping up yeah is it one slow
down returns for you actually
I think these buttons are on can we
could probably smooth them maybe
probably slow the speed down I know
we're spamming the resume
this is the Honda Accord 2018 2018
latitude yeah
2018 2.0 tour and this car has crazy
horsepower Jeff
like I said I can get tires with of like
as far as a front-wheel drive car goes
you're not really gonna do that much
better I don't know what is the fastest
0 to 60 on a front-wheel drive car
like I don't think it can like what's
the fastest it can be but you know the
problem the funnel drive cars right they
just press around 60 times well no you
um your car leans back when you're
accelerating right and then you don't
have downforce on the front wheels
anymore and then people who put spoilers
on front-wheel drive cars you're
literally doing the opposite of what you
want you got a rear-wheel drive car
right you're getting downforce on the
back wheels that you can accelerate and
then for a lot of cars obviously great -
this is - will this was - it was peril
drive car yeah like I don't know what
the best 0 to 6 this can do 0 to 60 I
think like five seconds
it's like 5.3 stock and it feels fast
yeah it does feel fast all you need is
wider wheels ok I'm not sure wider
wheels help you I mean they probably do
but now you have even less downforce
right like your psi on wider wheels is
gonna be lower all right but basic
physics if you have the same amount of
weight
I guess you have a heavier bar needs to
transfer more energy and put a spoiler
on the front does some guys have that
baby more weight with a giant battery
now while no charm or weight helps you
because the problem is more weight is
now you need to transfer more energy to
the road right like blow about how much
energy you can transfer to the road how
quick
like if this car had a thousand
horsepower engine I'm not sure it would
even accelerate that much faster at
least must stop like the zero to thirty
part of it
the 30 to 60 you could probably give it
to the horseman you're not gonna
continue to get tires with Vietnamese
stop for a second zero to sixty four F
cars
everything we got 74 driving there are
so blocky is it so Pocky
oh man that smoke
those who does raise a type of thing
test sound like crazy but I mean those
Tesla's that have to crazy zero to sixty
s are all are all the drive or even like
yes first up for front-wheel drive cars
but with slicks oh it selects a careless
are there any street-legal from hill
drive cars that are sub floor
it has us to do you tell us of some
three but yeah those are all the drive
and a heavy car which again I don't know
if that helps apparently still blocking
what sleek could someone look it up
what's that what's the best front-wheel
drive 0-60
I wonder if it really is this car like a
civic type-r Semak type archive or is
the best is that does that choose civic
type-r
this is I mentioned to you three is four
point seven yeah yeah do you taste 4.7
lb cuantos p3 is Oh a three somf hades
overdrive yes I'm victim ik both they
for it I make both okay all Quattro I
don't know I know the ones you can rent
from silver car for over this we're
gonna go we were gonna go Madeline I
we're gonna go drive to the snow I can't
talk to your phone
I shouldn't use my phone when I Drive a
periscope no Civic type-r is low five
seconds there - six a five second second
it's not some time
really
I could do a 4.9
maybe there's a tuning for it surname is
hot sounds made up
it's Jeff I'm like Britney Spears I made
my name up before I was famous that's
right yeah yes I know Britney me yeah of
course you did I think no it's not I
think it's a real name I mean you know
Christina Aguilera didn't make her name
off what the hell kind of name is that
Christina Aguilera is that is to me guy
no no I'm pretty sure it's a bigger name
I don't think I guess her sister is
Jamie's Jamie Lynn Spears Spears any I'm
sure there's like but I don't think
there's any other mass-market
I mean it would be one of these like
hi-spec Japanese probably but like
Lancer Evo's are four-wheel drive
I don't know like can you get like an m5
and know those rear-wheel drive even the
ones that are affordable
do you know what we're going this way
okay gotta get to Campbell thank you I'm
trying to be on top of it with the bots
just gotta get rid of it bad bot iscope
got any questions this question our this
things are driving without a
disengagement now for like 50 get
disengagement so I was careful you're
going to feel like Silicon Valley's
crumbling or is it just us but I think
everyone feels that way about it you
know our get everyone's business
America's crumbling so we're doing well
in the world that's what I'm gonna find
on my grand adventure no oh god that was
yesterday I'm triggered did you go oh
goodness that was a terrible thing I
won't poor what goes on at the Folsom
Street Fair but it shouldn't be on a
public street and it shouldn't be in the
middle of the deck you can remove any
one of those things and then it's okay
yeah but in the middle of the day
there's like like nine year olds out the
middle of the day it's fine public
street is a little weird but if you
weren't on a public street or like 11p
I'm like all right fine
you know all the kids are asleep no cuz
then they're trying to sleep and they're
getting you you know who's loud but like
okay there's loud stuff occasionally at
night
I'm like you know you if you're in that
kind of area all right like think of the
Castro don't try these crazy jam-packed
people yes and that's all cool because
just nighttime
no no cashes us no prizes listen during
the day try these a little bit better
it's a little bit more corporatized oh
now we're just getting to the falls
no no I'm triggered by the Folsom Street
back it's too much man
it's a new product new or just a
reimagined current product hey man
everything is ever see Avengers 3 which
is the Avengers 3 of products we want to
see the third spider-man before it's
spider-man how many spider-man's were
there waiting and they weren't even like
new spider-man they were all the
spider-man origin story yeah I got overs
by him it was the Tobey Maguire one it
was that like other one with her like
Tobey Maguire and whoever played the
girl weren't pretty so we're gonna make
pretty people play them who did they use
it I think tell you the buyers totally
pretty
oh my god no the old like the original
spider-man total Maguire and who's that
girl not pretty
wait who was the original Mary Jane I
don't know I was hoping but wires
attract I think so oh yeah first and
done here's the doors oh yeah then the
new Spider that the second spider-man
came out and they used attractive people
ooh they use I don't know but they were
good-looking
like Tokyo glaring Kirsten does are
perfect for each other they're both like
fives as far as Hollywood goes I'm sure
person actually extremely yeah Kim
Kardashian - Ian's good luck in there
been transparent Ian Purple Panda what
Purple Panda
they used Emma Stone yeah see now we're
getting pretty girls right who's the guy
who's the guy that you know was the guy
I'm not talking about the most recent
spider-man or eBay where they had like
Iron Man in it and stuff is that was
that spider-man or we get back to me I
can't believe I'm talking about
superhero movie rebates so terribly jus
Garfield oh yeah yeah yeah you do know
that is she was I think using the social
network
she's Sabourin no I don't know oh I
remember
yeah
social networks y'all real Facebook shit
guys when I was there this in turn was
like mr. Zuckerberg at like TV yeah you
know that's Google real Google shit
Facebook at gjs - well no they call them
like social Fridays or something mr.
Zuckerberg can you like tell us like the
story of Facebook like what was the real
story oh wait crazy is Google has also
like scrubbed references to that from
the internet yeah like I tried to find
it I couldn't yeah and they're like hey
a happy happy event the guys
Tobey Maguire filets me I support that
movie they could get the throw to Elijah
Wood I would be okay with that
oh yeah yeah hey Elijah if you're
listening let us know
Orlando Bloom would make me look stupid
yeah the guy just doesn't look sour
looks smart he looks pretty he looks
like like uh like on a sculpture and
then he talks yeah these people still
relevant
No Hollywood is crumbly I've been an
ugly soul stone article with Johnny Depp
it was so depressed honey jab that man
is just done Johnny Depp was eaten like
likely lately pirates went to his head
pirates won the game was great back like
Pulp Fiction and stuff yeah but then
pirates comes out no no Pirates of the
Caribbean one he was pirates can be one
was the great movie actress that was the
end Antonio Epps correct any made like a
creepy Charlie and the Chocolate Factory
yeah there is that terrible singularity
movie he just like and then they kept
trying to make weight he was in Pulp
Fiction
wasn't it pop fiction said no Jackson
was in Pulp Fiction who was the other
guys giant app wasn't it
no that was like how he got his start
he was an Alice in Wonderland that's
right oh that was bad never mind Johnny
Depp was great Wow think if possible I
haven't even a lower opinion of trying
to he's never been in anything good how
did that guy get famous like what did he
get famous from he's pretty and he was
an I think price of the Caribbean was
real is that really it was that it's
like debut movie no this is bad
celebrity memory history our absolutely
Nightmare on Elm Street
Oh was his first 21 jumps you never saw
it never saw it touch it I did see 21
Jump Street but that was like way later
to get to a straighter we should look
and see where the servers are guys we're
going to buy servers yeah we're going if
you ask more questions will answer
questions instead of bad celebrity
gossip our everyone let's go well we
haven't really driven that much weight
someone's someone's worried that him
blocking on BOTS know they're all BOTS
the ones who repeat and put a little
emoji emoji those are all BOTS
why are we buying service because we
need servers to run Maps
we have a little cluster which makes the
maps did new good ml KY accept offer
this is our new good mmm elk I haven't
you written up yo get this model that
was me yeah he also does a little bit of
social media but it's a little much for
him so you know anymore so smart I don't
ml and hype hype yeah we're doing hype
today it's gonna be crazy
response ignite is my second part I am
really yeah coffee
wow it was secret better ml coroner I'm
not know about better yeah different new
model is awesome great set for it thank
you no no you see the thing about anti
hype and hype is they're the same thing
you know you guys know about the thesis
and the antithesis of a synthesis for Co
or whoever those Deborah do whatever
those assholes were get it always live
in a postmodern world
yes
I wish people who we're delivering yeah
that was a totally a mistake I miss
click then if you were blocked pointing
out a Bob but you got back in which is
the good news it's a mouse slip
I wish to figure out where we're going
laughs it is I know I got called out for
not reading out the comments but we're
not just close know we are close
14 minutes 14 minutes oh that's it yeah
we're so close
when I take the stereo let's go around
the truck
[Music]
well Gilroy the garlic capital here No
exit 12 this one yeah good thing we
check if they reach s it's the garlic
capital of the US did you know that they
have garlic ice cream in Gilroy
damn do they have like the world's
largest hamster wheel - probably cool I
love roadside attractions ya know this
this self-driving awareness - we got two
more roadside attractions the the yeah
one of the greatest roadside attractions
was little America will American Nevada
and we got girls club it was not Nevada
what America was into Prescott no it
wasn't it was the full earth way before
Nebraska was like date day one or day
two no no it was right after Salt Lake
City yeah Ben yeah after so execution
nowhere Nevada is right all right it was
after Salt Lake City yeah but it wasn't
in Nebraska might have been in Wyoming
it was in Miami yeah yeah I do I agree
that it was pre Nebraska yes we didn't
really do roadside attractions Nebraska
we were tired of trying to get to
Chicago he's wait Chicago we didn't go
to Chicago yeah we did we ended it yeah
yeah
now well so what was the day maybe
nebraska's what we just drove through to
get to Kansas I mean know if we went to
Nebraska we did omotchama
we got good stuff that's pre kiddo
that's like in the same level as Kansas
that was after Kansas City that was
after kids yeah we can just check the
back of my shirt
hey great shirt oh yeah do it again yeah
it was fun I also want to go down south
I just kind of want to go down south
really no I also want to check out like
the Texas settings I've never been to
you know Houston have no zoning laws I'm
down I'm down to go deep south do it you
know let's do it let's meet some
southerners same I'd rather take ya
court though
no no in the deep south of food and
better with a bigger santa fe no we look
like like like liberals from the Pacific
Northwest that's what we are progressive
we all believe in progress like better
models and and you know slowing down for
turns and saying all the great kind of
progress that's progress
stay on 85 south 6.1 miles to Winchester
Boulevard did George tell you guys he
got it the new phone oh yeah you like my
new phone Apple guys actually I went to
the Apple store and long story short
they wouldn't let me buy the phone it's
not what you're thinking
but you know they wouldn't let me buy
the phone so I bought a case instead and
told people on the phone yeah
does new product support little big
model new product is going to support
everything last products points
they're the same codebase it's a better
product we're excited for you guys if
you see there's a better product I think
yeah yeah it's more polished yeah you'll
see and it comes in a box that sounds
I'm leaking this week's you're leaking a
lot I know
hey revin dropped some bar from Comikaze
drop some bars from Kamikaze what were
we
I know and did come in a box but this is
a better box
all I'm thinking of the only bar that
I'm thinking of it was something like
three albums when I was 29 that's when
my career blew
I'd rather be 80 year old me than 40
year old you come back to MGK yeah
that's right
kamikaze bars I got a couple of mentions
still I don't have any manners I got it
you got a couple of ghost writers bunch
of these kids that don't actually matter
Oh Oh mmm for the win yeah
all right Scopus maybe I'll leave you
guys we'll leave you guys we're gonna
remember every tell everybody product
launch 4:30 p.m. today 4:00 p.m. 4:30 I
think you're on at 4:00
no 4:30 best with the website sad oh
really
we're gonna keep you guys up to date
yeah they don't follow us on Twitter
what are you doing follow us on Twitter
that's how Logan Paul talks get sure to
click that like and subscribe button
what happened to Logan Paul that guy
fell off hard all right all right
all right so i am greg hogan
i work on infrastructure here at comma
um
yeah let's see if i can figure out this
clicker we go
all right let me turn this a little bit
that's better
all right so who's excited to hear about
infrastructure
wow
i didn't think it'd be very many people
that's good
i guess that's a lot of pressure though
now if i feel like people expect a lot
or something all right anyway we'll see
what happens
um
so the goal comma is to solve
self-driving caller solve self-driving
cars
uh we're gonna do it with machine
learning
and
uh we're gonna need really good
infrastructure to be able to accomplish
this we gotta be able to iterate fast we
gotta be able to train models you know
with reasonable speed and so forth
so
at comma we call
everything supporting our customer
facing applications and model training
infrastructure so that's hardware and
software we call it all infrastructure
so
what do we need uh well one thing we're
gonna need is data
and so luckily we have thousands of
users every day collecting data for us
and somehow we need to get this data to
train models
so
uh we have devices out in the field that
have this data
and they upload it to
a storage account in azure
that
data when it comes in we throw it into a
queue
and then it goes into
it it gets picked up from things get
picked up from that queue
from virtual machines that run in an
auto scaling group
and then we do some processing on it and
uh decide what's good for you know what
what data do we have what are we getting
that's good for training
and we save some metadata about it off
so we want to minimize the cost of
processing this data we get a lot of
data
and we don't want to spend a fortune
processing it
um so what do we do well these cloud
storage providers pretty much all of
them now have this great feature where
like they have all this spare capacity
and
no one's using it so they have something
called spot instances or low priority
vms
and so you can use their infrastructure
that's kind of spare
for like 20
of the normal cost
so but what's the downside of this
infrastructure that's like super cheap
well they can pull these vms back
anytime they want when some other
customer says oh hey i would like a vm
of that size uh well then they kick you
off and they give it to someone else
so
how do we manage this how do we keep our
processing costs low and keep our
latency low uh because we need to get
this data processed so that we can give
our users access to it and we want to do
it in a timely manner
so what we do is we spin up multiple
sizes of these scale sets
uh with different cpus different memory
configurations
and uh the probability of us losing any
one of these scale sets losing all the
vms in one of these scale sets is
independent of the other scale sets
that are the same size
so what's the probability of us losing
all of them well
it's exponential as we add another scale
set of a different size and another
scale set of a different size
so
so that's why this works
and it works really great
so now that we have all this data
we need to be able to use it for
different things like some different
applications that we have
um
the data isn't public but like the api
we use for our applications we made it
public so that people can get their own
data
so you can go to api.com.ai for example
and you can see the documentation so
that you can you know if you wanted to
build your own application on top of
your data
we also have some nice tools that have
been in some of the other presentations
cabana for example it uses that same
public api
connect or it was previously explorer
it also uses that same public api and
this gives you you know nice dash cam
type functionality for reviewing your
data
and another nice thing that we offer
people
is what we call an ssh proxy
so
we sell a dev kit
and uh
it'd be nice if you could you know ssh
into your device from anywhere if you're
doing like development type stuff
but normally like if your cell phone is
on a cell network mobile data
they block port 22.
uh because there's actually been
problems where like people accidentally
leave port 22 open and then people can
get into devices because you know they
did shady like the same username and
password for every device or something
like that
so how do we get around this
so what we do is
the devices whenever they have an
internet connection
they open a websocket connection to a
server that we have
in azure
and then when you want to connect to
your device what you can do is you can
ssh into the hostname ssh.com.ai
from your computer
and your username is your device id
and you have to present a public key
that you had previously already set up
on your device
so then what our proxy server here does
is it bring it looks at your connection
and it says oh you're trying to connect
to this device let me go ask that device
what public keys are allowed to connect
to it
it pulls those public keys it then sees
if you can successfully authenticate
against the proxy server with that
public key
and then if you can then it lets you
tunnel an ssh connection
through the proxy server through the
websocket into your device
and then the device just i mean it's
literally port 22. like then your your
device then is going to authenticate
again with that same public key
this is like what they call like an ssh
jump server we just tunnel it through a
websocket so that everything's making
incoming connections and it doesn't
matter if you're on a mobile network
with your device where port 22 is
blocked
so
in case anyone's wondering comma doesn't
have ssh access to anyone's device
uh ssh is off by default on your device
you have to turn it on and then you have
to set up you know what public keys you
want to have access to your device
and all the authentication you know
happens on the device we can't it's you
know the way public key authentication
works is you know even though the
traffic is passing through our proxy
server it's still encrypted with your
keys and so we have no way to be able to
look at any of that data
so all of that
uh infrastructure we just talked about
uh it's hosted in the cloud and it's
hosted there because you know the cloud
has these great features and we're
willing to pay a premium for
high reliability scalability and
availability
all right so we got a little sidetracked
there we're talking about you know
training models uh
but we needed some good stuff to uh we
needed a good pipeline of data coming in
and and you know that's kind of all the
stuff that supports that
so let's get back to let's get back to
training models so what kind of hardware
do we want to train models
do we want to run it in the cloud
well
the most important thing to us is that
we maximize the compute we get per
dollar we spend
on that infrastructure
and
we can tolerate some failures the cloud
is great you know because it's so
scalable and reliable but for research
you know we don't really need
all of that there's a lot of data that
we can like regenerate if we if we
needed to and so forth
um so what meets these requirements
so it turns out that refurbished
equipment running in a garage
actually is it's really cheap and it
works really well
so
if you consider the cost
of just the cloud data storage
for
all the data that we hold for for doing
model training
the cost of that cloud storage that we
would need to have equivalency
we would recoup all of our costs in 10
months
buying all the hardware that we've
bought
so like our our return is so is so good
like
this here is a dgx super pod this
thing's brand new probably looks super
clean and nice so let's let's see if our
servers look like that
okay
so we started an office in san francisco
and at some point someone bought a rack
and put some servers in it
and then that rack turned into two
and then it turned into three
and
the power wasn't very stable in the
house at this point we had like a lot of
voltage swinging going on
when like gpus would hit really hard
uh model training
or you know running the segnet or
something and
so we need a lot of power conditioners
so you can kind of see here our ratio of
you actually can't see
the gpu servers here but you can see our
kind of ratio of power conditioners to
actual you know use of compute it's kind
of it's kind of high
another funny story so we actually uh
when we were in this house
uh something kind of weird happened
we had like a water leak at some point
and so they were in the front yard
digging up the water line
and all of a sudden like the two phases
on the house one went up to like
300 volts and the other one down to like
100 volt 100 volts and we're like what
that what in the world is going on
uh and so
all of a sudden it went away and it kind
of correlated to when they buried this
this water line this copper water line
that was going into the ground again
and so
i take a clamp on amp meter and i'm
going around the house i'm trying to
figure out you know what the heck is
going on
and i clamped this clamp-on amp meter
onto this copper pipe going into the
ground
it read 30 amps
30 amps of power getting dumped
into the ground through the copper pipe
so why is this happening well
it turns out that on the pole not even
in the house the pole where the house
gets power
the uh
the neutral
was completely disconnected like
corrosion
had
completely electrically disconnected the
neutral so when you have an imbalance in
between your two phases where's the
difference go it goes through the
neutral
back to the transformer well we had no
neutral so what's the next best thing
well it might have actually been the
copper water pipes which the ground is
is clamped to
through the ground to the neighbor's
house which also has the neutral clamped
or the ground clamped onto the copper
wire and you know in your panels the
neutral and the ground are bonded
together in your main panel so that's
why we had 30 amps of power going down
into the ground
so
uh
so that was pretty funny
uh you know i don't know how gosh i
remember just like scratching my head
for days like really frustrated like
what the hell we got these nice power
conditioners and all this weird stuff's
going on but anyway
it's good good story i'm glad we glad we
figured it out
[Music]
so
right now we're running these servers in
this garage in the basement
and
eventually
the garage that the servers are running
in well the garage doesn't have enough
power anymore to power these servers so
we need to find power somewhere else
so
what do we do well there's more circuits
in the basement so we start pulling
power from other circuits
but eventually
the
the bottom floor of the house
doesn't have enough power
so
well
kitchens have a lot of circuits
a lot of 20 amp circuits
so
you can kind of see here there's a
there's a black thing going down from
that window to the garage
that's a bundle of really heavy duty
extension cords
uh
powering some of our servers in the
garage
uh we also had a bunch of 3d printers in
there too so that didn't that didn't
help those things the the heated beds
can obviously draw quite a bit of
current too
uh but so you know
this can't go on forever
the house wasn't going to have enough
power we really wanted to buy more
servers like we always want to buy more
servers
[Music]
and so
we get a real office we moved to san
diego we got a big garage
we got three-phase power
everything's great
well
when you're using 60 kilowatts of power
you're generating a crap ton of heat
and you got to get rid of that heat
somehow
so
there's a few ways you can do this you
know the obvious one is if you run a
data center you have like climate
control right you got hvac
well air conditioning
is really expensive if you want to you
know get rid of 60 kilowatts of heat so
you know what do we do
well we're in san diego the temperature
doesn't swing that much right it doesn't
get super hot here
so we put in two 10 000 cfm two ten
thousand cfm fans we got an intake fan
and exhaust fan put in a partition for
separating the hot and cold aisle of the
servers
uh and
you know that that worked pretty
well but then we had another problem
uh
so
it turns out
that uh we started seeing signs of
corrosion like this fried capacitor this
is a backplane on the server so there's
a lot of dirt here
and we've got this capacitor that's
fried
so
what's going on here
it turns out there's this thing called
equilibrium moisture content or emc
and it's really important so
it's basically so equilibrium moisture
content is the amount of moisture that a
material will hold and it's neither
releasing moisture into the air or
sucking moisture out of the air so like
there's no such thing as dry or wet
there's there's a continuous scale
and depending on what the relative
humidity and the temperature together
are determines what this equilibrium
moisture content is
uh so you got to manage this or else uh
you know all that dirt from this dirty
garage
you know it's it holds moisture and
that's
that was kind of a problem
so you to manage this basically uh you
can look around and like find numbers
uh you want to keep it below this 10.5
number generally if you go above that
it's considered corrosion or it's
considered a corrosive environment if
you keep it below you're in good shape
um so so how do we stop this corrosion
um
so it's this scale right where like as
the relative humidity goes up the
temperature goes down
the uh
the emc goes up
so
how do we keep the relative
humidity down
and the temperature up is the question
or
how do we how do we keep this number low
and so you know the the obvious solution
here is again air conditioning
but
that's kind of expensive do we really
want to do that
no we don't there's a cheaper solution
so instead of sucking moisture out of
the air i'm sorry instead of lowering
the relative humidity by
taking moisture out of there with
something like air conditioning we can
just raise the temperature
so
when we buy these used servers they've
got like metrics you know from whoever
owned them last so this here is a
picture
of you can see the
the black and gray on the far left here
is what temperature the server was
running at before we got it and then
there's like a dead zone where it wasn't
on because no one owned it and then you
know the temperature after we start
running it so you know they ran it
around 21 to 23 c it sounds like a nice
life for a server
uh but then you know we get it and it
runs like 35 c to 42
so uh you know we our our goal is to
keep it under 43 c 43c is
109.4 degrees fahrenheit
so you know we kind of we kind of abuse
them but everything in the server can
handle this like the the lowest
temperature i think of anything
like the lowest operating temperature of
anything in the server is probably the
spinning drives and the ones that have
spinning drives and that's like 55 c
so you know 43 is not that bad
so we also decided you know this is this
this is a lot of dirt maybe we should
try to keep some of the dirt off the
servers so now we put this filter
material just right on the front of the
servers because you know to get a 10 000
cfm fan
with a filter on it is like
10 grand or something crazy so that
seems stupid we've got all these servers
they've got all these fans in them the
only place they take in air is right on
the front of them so we just throw the
media filter right on the front of it
we also decided you know we want these
backplanes to last a while they're still
going to get dirty and this this isn't
going to filter out all the dirt this
garage is you know pretty dirty so we
put like 10 layers of conformal coating
on our backplanes and we use like a
potting compound to uh seal up these
exposed leads on these drive connectors
this is there's a picture of a backplane
that's been all sealed up so that you
know we don't have this uh corrosion
problem and this is really only a
problem in the front of the server
because
the temperature needs to be kind of low
for the emc
number to be high
so in the back of the server it's always
really hot but in the front of the
server that's where you're going to have
problems and so you know that's kind of
what we saw the back planes you know
catch a lot of dirt and they're it's the
coolest part of the server generally
all right
so what do we have in these racks
we've got
1888 cpu cores
72 gpus two petabytes of spinning drives
and 516 terabytes of solid-state drives
we've got basically two classes of
servers we have servers that we use as
compute nodes and we have servers that
we use as trainers
so here's what our compute nodes look
like this is a rack of them
every one of these servers
has 10 spinning drives they're 1u
servers they were new back in like 2015
or 2016.
but they work great we have three racks
of these
here's what our trainers look like
they're also old servers
basically you know lots of ram lots of
gpus and lots of network bandwidth
we also buy used networking
equipment so
it's it's it boggles my mind how cheap
you can buy this stuff
uh
this is a 100 port that you're looking
at here this picture 100 port 64 or i'm
sorry 100 gigabit
64 port switch
this switch costs us 2
that's 6.4 terabit of switching capacity
and i remember at one point i bought a
new
netgear 48 port switch for comma
and that netgear switch was only 10
gigabit 48 ports it was almost 4 000
and i can get a 64 port 100 gigabit
switch
for
2.8 thousand dollars yeah 2 800
so we have multiple of these
and then we also have an infiniband
switch for the for the trainers to get
even higher network bandwidth between
them
so how do we use this hardware to train
models
uh well we've got all this data and now
we need really high bandwidth high
performance file system
for the different servers doing the
different tasks to pull the data
and work with it so originally we used
nfs for a long time
and yeah that doesn't scale
it's pretty bad so we looked around at
distributed file systems that existed
and everything was way more complicated
than what we needed
um
it's crazy how like complicated like
ceph is and all these things so we built
this this uh we built this distributed
file system called mini key value
uh it's open source it's on github it's
less than a thousand lines of code
uh it has an http interface you know
kind of like s3
and
the one of the reasons it's it's such a
small amount of code is because we use
nginx for the volume servers to serve up
the files
so
so how so let's take a look at this this
is kind of a
a picture of kind of like our
infrastructure in our garage
and uh let's see how for example you
write data into mini key
value so the first thing that happens is
the client trying to write a file into
the into any key value makes a put
request
to the mini key value master
the mini key value master then takes
that
and
depending on how many replicas you want
it then makes that many copies
across that many machines so each of
these machines are called we call them
volume servers so there's the master
handling the requests initially and then
there's volume servers that hold the
data
so these are our machines with you know
10 spinning disks each and basically if
you have
three copies of your data it's going to
put a copy on each of the uh on each of
the servers so um if you've got three
copies then you know you can lose like
one or two entire machines and you
haven't actually lost any data
um
so that's what we use for our raw
driving data
we use three copies and so that's how
you put data into many key value
uh the the volume servers again are
nginx so basically it's just using you
know
http requests passed through to nginx to
write out these copies of the data
so now how do we read data back out of
any key value say you want to say you
want to pull a file and you want to like
run through the video or something like
that
so the first thing that happens is the
client again makes a get request it hits
the master
the master then looks at the it looks at
the list of it maintains an index of the
list of volume servers that have the
data that it that you're trying to
request and then picks one randomly
and it returns a 302 redirect to you
so then what does the client do it just
follows that redirect
which you know hits an nginx server
directly that is hosting the files and
just returns it and so uh
our master is really simple like our
master is just a level db index of all
the files on all the servers the files
on the servers are actual like physical
files and they have a name that is the
hashed key or the base64 encoded key so
like if our master ever disappeared for
like if our master ever failed for some
reason and we lost our we lost our index
we can actually regenerate the data that
was in the master very easily just by
spinning through all the files
unbased 64 encoding them and
repopulating that that master index
all right
so now that we have a high
uh a high performance distributed file
system
um let's let's run some tasks that are
going to
generate our ground truth
uh for training models
so
the way that this works is um a
workstation uh we have some software
libraries custom built that we have that
we use for submitting jobs to our to all
of our servers
and
basically it builds up a list of tasks
uh each task can run independently in
parallel of all the others
and it kind of manages it manages
dependencies and gets results and so
forth and submits them as as uh
as they can be submitted
so then all of these um
these three racks of compute nodes that
we have they're all pulling tasks out of
out of consumers
and
they then
read
data from our spinning drive mini key
value we have a mini key value instance
that's just spinning drives
they then you know to run tasks they
need to read data from you know like
let's say the raw driving data that we
have
and then they write the results back out
to the mini key value instance that is
solid state drives so that way like our
model trainers have like really high iop
really high bandwidth
file system that they can pull uh the
data from for training
so
let's see here and go back one
there we go
so our spinning drive right here um
it's 40 machines
it has 400 spinning drives spread across
40 servers and so that's our two
petabytes of storage that we have
which is about 10 million minutes of
driving data
and then our
our mini key value solid-state drive or
mini key value that's you know all solid
state drives is 20 machines
and that's our 516
terabytes of ssd
all right so now we've got our ground
truth generated um
let's train a model so how does that
work
so we have 10 servers here that are
model trainers
um
we can run a lot we have 10 of them so
we can run a lot of experiments in
parallel each of these model trainers
has a 100 gigabit ethernet
network connection to one of those 100
gigabit switches
and then one of our racks has another
400 gigabit per server hooked into an
infiniband switch so we can do things
like rdma
and do like parallel uh training and so
forth
let's see i went too far
okay so when we kick off uh model
training
uh
it's it's something that's running on
one of the gpu servers
this is our mini key value ssd
instance and you know it pulls data from
pulls data from there each of those
machines has 20 gigabit of network
connectivity so it's a really high
bandwidth um
and then
each epoch
it
generates some metadata
and it writes it out to
what we call our
our reporter server
which i'll talk about in a minute
so
you repeat this you repeat this about a
thousand times
and then we've trained a model
so this is our reporter server this is
what it looks like
um
one of the screens in our reported
server it's kind of like
it's kind of like tensorboard um
it has a lot of charts and images
uh it's pretty simple something we
custom built just to hold all of our
experiments
we looked around kind of at like the
other options that were open source and
available and free and
they didn't really have all the features
we wanted
[Music]
so that's why we ended up building
something custom
and it really wasn't like this wasn't a
big project at all
um another another screenshot from our
model reporter this is
um
this is uh example of like where you can
pull up worst losses
for an epoch
and so that's pretty much all the
infrastructure that we have that we use
for uh
training our models
um so
our user base grows like 50 every six
months at least on average
um
we we need to scale up a lot of our
infrastructure as we you know doesn't
take us too long to grow another 10x at
that rate
um so we've got a lot of work to do you
know there's always ongoing work to
really scale things up
um
we want to build a 10x larger data
center
so we've got all kinds of
exciting things we would love to do to
uh
you know uh
train on
maybe 10 million segments uh of driving
data
and running the ground truth for that
takes a long time would take a long time
on our on our current setup
so
um
let's see
so yeah if you uh
i don't know you think this stuff is
exciting to you you think
uh you think that's cool stuff uh we're
hiring and so
uh it looks like i'm
pretty much out of time here but uh
yeah i'll be around and
find me if you have any questions
[Applause]
oh
hang on
if we have
i thought i was gonna be really cool and
i didn't get any questions like like
does steve jobs take questions after he
like talks
i don't think he does does he
uh okay
hi i'm in the back on the first floor
hello i i can't see anyone
what's up oh hey
all right thank you for the mini key
value presentation was very interesting
um
i i okay maybe i maybe there's not a
good answer for this but like how did
that not exist
like there must be like other companies
trying to build their own training
pipelines in their own data centers
yeah i mean it's it's pretty it's pretty
the functionality is pretty limited
right like a lot of people want you know
like super high availability
and uh uh you know more
a lot a lot you know kind of better
assurances than what we have we've got
mini key value has this kind of
bottleneck for writing data which is the
master we've got a i've got ideas how we
can improve that like
we've got some pretty specific
how do i say this we don't need a lot of
these crazy features that these other
distributed file systems have so like
for example
our data
our mini key value instance that has
three copies of the data uh this master
is a bottleneck all the writing goes
through the master right now it manages
getting three copies out to three the
volume servers so like that that can
obviously be a bottleneck right so other
distributed file systems they're like oh
well that's that's never going to work
right but for us it actually does
because
the amount of data we take in like we
take we we don't if we could generate
like we have a thousand users if we
could generate 10 times as much data
today
would that actually be good data for us
the answer is no unless we have 10x more
users too like we need diversity in our
data so
our data comes in slowly
and we don't need a ton of bandwidth to
this uh mini key value instance that has
a bunch of redundancy
but on the other hand
we do need really high write performance
for our mini key value solid state
instance right because that's where our
our reporters read data and write
well we need to be able to like
massively write out our gra our ground
truth from all of our from all of our
consumers and so
uh there's a solution to this because
there's a good solution to this because
we don't need multiple copies of that
data we only need one copy
because if we ever lose a drive
that's like a small portion of our data
number one like we don't really care but
number two if we did care we can just
rerun the ground truth and regenerate it
if we have a disk fail
like who cares we'll replace it we'll
re-run ground you know the ground truth
for that so what we can do
is we can actually use redirects to
write data
uh if all the master is doing is doing
redirects like it's it's you know we
don't have any performance problems um
so when you only have one copy of your
data like our mini key value ssd
instance
your writing can be redirects too you
don't have to funnel all your data
through through the master we could also
do like crazy stuff like have the client
write out multiple copies but like again
like you know when
when it's uh when you're really focused
when you understand your own problem
while you're really focused you can you
know come up sometimes with really
simple solutions to those things
you that gives me a lot of insight yeah
no problem
you mentioned the humidity is a problem
in san diego it's about 60 on average in
in would it be beneficial to move
the
compute cluster to somewhere like 29
palms where the humidity is half
uh i don't know like why do i care if i
run my servers at 43c
do servers have i don't know does anyone
like advocate advocating for server
rights like they do they get like is
there is it what is it like uh
child uh
whatever you know like children can't
work in like hot conditions
we're gonna have that for servers
someday too
yeah i don't know
yeah i mean
it would we wouldn't have had this
problem that would be nice but
uh it's kind of like you know it doesn't
really matter
um what's been your
largest challenge in terms of growth and
scalability of this hybrid cloud
environment and then also a second
question is why did you decide azure
when there's more mature cloud
environments out there like aws oh okay
uh yeah okay i got answers for those
things so the biggest challenge i think
in scaling any of this stuff
is like finding simple ways to do it
that doesn't require us to hire like a
team of people to manage it right like
like why do we care that mini key value
is under a thousand lines of code we
care because like
george wrote it i can sit down and look
at it and like fix bugs in you know
sometimes a matter of minutes
and and and you know i can i can i can
read the whole code base in like an hour
right and understand everything that's
going on
and so
uh
you know finding good solutions to these
problems is
is uh
uh you know less code is always better
and
i think a good example is
we used to spend a lot of money
processing transcoding video processing
video files as they were uploaded to us
and
you know we were doing this and i'm
always trying to figure out how do we
lower our cloud spending and i'm like
well
this is obvious like it should happen on
the device
why are we transcoding in the cloud so
you know that's what we did we didn't
like build some crazy stuff to like do
caching and be smart about oh someone
requested the first video of this file
let's start transcoding it and then the
second and the third and the fourth one
minute segment you know you could go
really complicated and build something
that probably works
really well but you know
finding a simple
you know that's that's like writing a
lot more software and and you know
scaling that thing sounds like a
nightmare and you know it's still
probably kind of crappy so you know it's
that you know that's the real that's the
real challenge i think you know finding
a way to do it really cost effective
second question you asked so why are we
in azure so we
uh
we weren't always in azure i don't think
i've ever really told anyone this story
so
before i started at comma everything was
in aws and why were we in aws well the
reason we were in aws was because
if you run a startup
these cloud providers they'll give you
they'll give you so much money
yeah and why do they give you all that
money well they give you all that money
because
you know
if you
if you build this really expensive
system with all that those free credits
that they give you well you got to keep
paying for it when the credits run out
you know even if they give you hundreds
of thousands of dollars it comes with an
expiration also so if you don't spend it
really fast it's like they incentivize
you to spend the money really fast
because it expires and then
once it expires
well how much is your cloud bill every
month now and you gotta start paying
that
so we got i don't even know how much
money we got from aws
that money ran out so we shopped around
we said who else will give us free money
so number two was azure
and i want to say they gave us
360 000
of credits
that was also a little bit before i
started
and
after i started
um
after i started um
i needed to transfer this subscription
to my email address i'm like this will
just be so much easier so i'm going to
do it well it turns out azure's
ridiculous you have to
like they can't transfer a subscription
they have to cancel your sponsorship
with all these credits
and then they have to set up a new
sponsorship with the new email address
so
guess what happened when they set up the
new sponsorship after we spent most of
our money
we started back over
at 360 thousand dollars
i didn't complain actually there's a
little more of the story than that
actually what happened was
they
so they train they did it and we didn't
have enough money i'm like what the heck
you guys are screwing us over they're
like oh no oh no we'll fix that yeah
they fixed it
so
anyway that's why we're in azure so we
we didn't we like like now we're you
know we're trying to we're trying to run
our infrastructure in a way that's you
know maintainable and so you know we
just now we're just decreasing our costs
we pay them now
hi um
uh awesome presentation uh really love
your passion about the subject um
question um
what about like backup and what what is
like your dr plan
do you have one
uh for what right like for
for
the data that we use for training
uh
there is no the the disaster recovery is
bottlenecked by how fast we like worst
case it's bottlenecked by how fast can
we collect new data from our users
right
so
uh we back up some data like like our
reporter server we send it you know to
like cold storage or whatever
inexpensive storage and azure you know
we run on-prem the reporter just like
the the trainers and everything
uh in the cloud you know it's just kind
of the same thing we
uh
one of the first things i worked on was
you know really making everything
infrastructure is code deploying things
in an automated way
uh so you know a lot of our disaster
recovery from like an infrastructure
perspective not from a data perspective
is uh you just redeploy yes redeploy
things and you know i'm huge on putting
everything in scale sets you know so
like your recovery is built in right
like every time you scale up you're
practicing your recovery which is great
thank you yeah
so you mentioned um
the like spot instances and stuff and
kind of balancing between
instances of different sizes can you
talk a bit about how like
generally particular workloads fit
within particular instance sizes i don't
really know
what your compute needs are but how how
do you balance that out if you have like
uh
uh certain memory compute sort of ratios
that you're trying to maintain yeah so
uh one of my goals at one point when i
was one of my first goals at comma was
to
get our processing time like the latency
from when we receive a file from a user
to when it's available in like explorer
connect cabana to be under 10 minutes on
average for like 99.9 of our data or
something like that over the over the
like over the course of a month
so i worked really hard on that
and i'm happy to say that our data now
uh is processed like on average under 10
seconds after we receive it
and
so
we used to do like heavier stuff like
um like processing video files and so
forth so you know a lot of the solution
to this was was eliminating that stuff
pushing it you know pushing someone back
to the device
uh using the q logs for every like
really pushing people hard to use our q
logs for you know our processing needs
um
for customer facing stuff uh you know
like figuring out what data we can train
on
i always you know tell people it has to
be based on the q logs because you know
we don't want to pull the
the raw log files to to figure that
stuff out
um
so we need
the long they're the short of this long
story is basically we need very small
vms we we spin up the smallest possible
vms which helps right because
uh
when when when we're out bid
uh and we lose instances we lose these
spot instances the more cores we're
using the more likely it is that someone
is going to steal our vm like say you
know say we use four core machines
versus two core machines well
if someone needs a two core machine
there's only four cores
well then we're gonna lose the four core
machine but if we're doing two two core
machines and someone needs two cores you
know we only lose one of them so we use
we use like the smallest i i pick the i
picked the least expensive
um you know the least expensive skus
uh and um
always do like the
uh azure has this great thing where you
can run the operating system out of the
super fast cache so then the vms come up
like super they you know they we scale
up and down really fast um so yeah we
just use we use the tiny instances
and um
yeah that's all we need because we we
really squeeze down the processing as
much as possible
obviously there's very little processing
happening if every file we process is
done in 10 seconds
got any more questions
nice hat
a quick question about infrastructure as
code do you guys use like a terraform or
ansible or what does that tech stack
look like yeah we use terraform
uh
like in my previous job
things were also in azure and we used to
use the like the arm templates i think
those are great too but i mean if it's
if it's not broke you don't you don't
change it right we just always use
terraform and it works great
yeah we uh so we use terraform and then
i guess you were asking like ansible so
we use terraform and then i like really
try to use uh
cloud in it to bring up the vms
basically
i try to keep those vms as simple as
possible so
most of our vms that run in the cloud
it's a cloud it's uh it uses cloud in it
to
install the azure cli so that it can do
like integrated authentication to do
things like pull keys for storage
accounts that have been given like
role-based access so we need the azure
cli so that the vms have access to
things
and then and then docker
so everything that we run runs in a
docker container so we just need to
basically
install docker and the azure cli
hey
um so i guess i sort of wonder in the
long run um
how much data do you guys keep like i
guess it sounded like you weren't
particularly concerned if there was a
case where you have like some video or
other piece of data you want to train on
and it gets lost because i guess one you
can get it back but like did you guys
store all the video you've ever
collected from customers or do you clean
it up as time goes along and you like
upgrade the cameras and becomes less
useful etc uh we we don't store all the
data that's ever been uploaded to us we
retain the
um we retain retain the raw data that we
get for only 14 days
um because
like the data i mean again like keeping
our cloud bill low
like i mentioned at the beginning the
storage is so expensive
like that's how they get you and you
really can't separate
things from the storage very well like
who has crazy high bandwidth
for free to you know cloud providers and
then they charge you if you want to pull
data out of the cloud outrageous rates
like eight cents per gigabyte so uh you
know if they if they get you hooked into
that storage
they really got you hooked
uh and so
uh yeah so we we just keep the data for
14 days uh because otherwise we'd be you
know even now even keeping the data for
only 14 days our storage is by far our
biggest cloud expense
and then the lower quality stuff we keep
for at least a year
so like if you have prime you can you
can watch your uh low quality video
and like connect should be able to back
a whole year
great thank you so much greg
you
alright guys a few people to get in here
I did put it on Twitter right sometime I
forget to put it on Twitter um so what I
want to show you all is this is a shelfs
copy so if you're not looking for
shelling during the wrong place but if
you're looking for shilling you're in
the right place because this is a shill
sculpey okay guys so
here in this box look at them look at
these beautiful very pandas they all
want homes they all want you to buy them
whether you buy them for $200 or as part
of the upgrade where you send back your
white panda and you get a gray panda
gray pandas are the highest quality
super high quality GPS
they have great GPS is inside them super
precision me ome chips very good very
good
same as Tesla the upgrade is $1.00 so
it's one of the dollars you said your
panda back when we get your panda yeah
yup it's still going on it's going on
until Friday we've shipped out our first
grade pandas from the upgrade so make
sure to get in today let me just show
you how well tested gray pandas are so
this is a testing rig these are the ones
here that failed testing this is our
testing right here for great patties so
you can see that we check to make sure
they all get GPS signal they all have
working can buses we basically make sure
everything about your gray pan to work
so when you get it you'll have a great
experience I just show you guys what the
test looks like on the computer so I
just go up here run gray test dot pi
yeah gray test all right let's see if
these ones pass oh yeah
op that all passed okay now it's gonna
test the can buses on the pandas - ah
you'll have to email support if you want
some special requests and those succeed
as well so these are the untested gray
pandas don't worry there's a whole lot
more of them - we'll just take a little
peek there and if you think that's it
wait'll you see just how many great
pandas we're doing we are moving weight
around here
so make sure to go to shop kamidana yeah
you know that you are a look you
kidnapped a bird you know that URL make
sure to go there is there a new revision
no it's the same revision well they're
all pretty good the newer ones are
probably a bit better tested but you
know that's how it is when you buy new
hardware but ya know they're there
good very high precision they come with
I don't have any right here but they
come with a great antenna they come with
a $50 antenna how do you initiate the
trade go on Twitter your left to scroll
back and find the link check out the pan
to upgrade your just ask on slack slack
that confidant I go they'll point you to
what I'm sure yeah so yeah check it out
these are these are the ones that failed
testing don't worry they won't be
shipped to you these all panas testing
so we could take them look we've moved
yellow caps for them right here
what's grape and to support like for
right-hand drive well that's why we
support so that's good yeah look at
those you're putting out on that
electric scooter it's it's Nick's
electric scooter actually hey scope is
remember when we had staples copies
that's a lie
but yeah guys that's all the shilling
I'm doing today this is a form to its
kind of man and he kind of used it it
makes things dirty
we can leave we'll leave we'll check out
the printer farm no scope Sunday but oh
yeah no we're having that indicator ya
know we'll add that indicator
yeah look at these look at the army oh
look at them great panting of Tanna box
look at these scrape and a antenna box
cacheable where's the fusion fusion but
yeah oh oh yeah miss I guess I guess it
won against chase works for us now so
that happened
all right scope ease there's a service
this is me make sure to go to shop
comedy I and buy our great panelists
today by thanks shells don't be good bye
bye
oh good morning
what's up happy happy for the job
everybody
you all know that I love America
America's great this is one of those
periscope that's gonna get deleted
quickly but yeah what did I want to talk
about today nothing
I got nothing to talk about yeah well
good thing come on Tay I'm actually
finished with the mati the secrets mmm
we're not ready to reveal any secrets
yet Wow we have 62 people in here Oh
nope we're not gonna reveal any secrets
on this periscope we can look at the
airports though whoo air Potts oh yeah
they put one in that's nice oh yeah look
at that air product but what do we want
to talk oh we want to talk about the
latest in height wave AI let's talk
about
the first example of reinforcement
learning on board an autonomous car let
me tell you why this is hype because
nobody doubted that this would work
right they drove down this same stretch
of road multiple times and then
eventually reinforcement learning
learned how to drive the car hi oh we
could talk about cachet i - anthony
levin Donsky is back at it building
trucks I mean it's a nice picture I
guess no it's not what I did
I wouldn't use reinforcement
reinforcement learning is largely a scam
it doesn't really work that well part of
the problem is your rewards a super
sparse and to try to learn a real policy
so we're gonna do something similar the
long-term plan of kamma AI you'll see I
mean it's one of the secrets alright so
we have some great secrets we're gonna
reveal during the press know
reinforcement learning is very not data
efficient and it doesn't it doesn't
scale like what are you gonna do you're
gonna put this policy on all the cars
you're gonna you're really gonna run the
gradient on the car I don't think you
can do that you have to do it in one
place
alright guys you want to show off one
secret well what press out let's find
out both good ones you got good ones I
got the best press now I'll show you
guys one secret there's a secret shoot a
secret all part of open pound 0.5 you
guys you know 0.5 is not gonna have ways
and it's not gonna have Spotify happy
4th of July
absolutely it's a great day today is a
wonderful day today we want our
independence and our freedom from the
tyrannical British
alright guys I don't have that much to
say this morning mark that's right
check out my come a share this is
self-driving awareness to a shirt these
are extremely rare it's exciting
Spotify anyways are gone that's right
don't drink and drive kids good morning
Anthony levity is back to making trucks
maybe in China where the long arm of
Google can't reach them the beanies are
ultra rare much that is true they are
more rare
if you bought a beanie you got great
stuff what is 0.5 outs coming out not
this Friday but the Friday after um so
there are three secrets that are gonna
be revealed at press one secret is
already known by a few of you one secret
the second secret maybe you can guess
and the third secret is findable on the
Internet
so if you know the right place to look
you can find the third secret first
person to find the third secret what
should we give you what should we give
you if you find the third secret you
know one of the secrets okay okay and
CPF is a recon check out this beautiful
panda in a box look at this box I'm sure
to go to shop.com at AI and buy things
today is the 4th of July it's a great
day to buy things yeah I mean that is
true if you find the secret you get did
you get to be the guy in slack who told
everybody else
the secret yeah the secret look at it
it's a panda this has nothing to do with
the secret of course
but there's a great secret if you know
how to look but that's it that's mostly
what I wanted to talk about today I
almost forgot questions do we have
questions are there any questions
good I hate questions yeah the Volvo's
sold we sold over 150 dollars in Vegas
bro now we're not going downstairs to
the 3d printers let's talk about how to
talk about Eddie yeah I'm going on a
boat tonight I think Oh what is press
release oh not this Friday but next
Friday next Friday we'll be doing a
press release oh also I know I on
it a lot but what do you all think of
Python 3 open pilot is gonna be Python 3
compatible so we can start doing some
static type checking all very exciting
static type checking all faults on
infrastructure for data labeling maybe
that's related to one of the secrets
Tom's yeah I've been coding if you've
been watching me do my my twitches I've
been doing them in Python 3 oh yeah I'm
not gonna die because I'm putting new
hardware it now I can show you a little
see what you want to go down there we'll
go down there and then that's where I'll
leave you are the things printing maybe
they're printing hey NIC we pretty the
new hardware oh yeah Skokie's want to
say oh yeah we're free
can't show you what's in any of the
printers because of course it's secret
oh yeah pretty wide ones pretty
it is printing secret so we can't show
it to you now just kidding guys we're
printing onto the giraffes around
flippin eons ollie on shipping now are
flipped i'll show them the top of
connectors yeah they're made on the form
too so this is a special 3d printer it
gets its own room no no the work today
no one has to come to work any day
except for Mondays when we have the
meeting it's very important to come to
work on the Monday meeting very
important all right I think that's the
periscope you guys saw the 3d printers
that's all we can really ask for the
biggest thing that we're talking about
you know the driver won't be bored when
they're being monitored by driver
monitoring that's it guys the biggest
thing that we're really hyped about in
the press is hiring we're trying to hire
five people I know I did like ten but
it's five people
let's get user or you can put the new
user I just add some to it all
right
where do you put up is a hot dog burger
Wow
welcome to dreary San Francisco is there
any more toys oh no there's no Wi-Fi
outside we're only gonna be here for a
minute we can look up at the commentary
this is the calm a Labor Day celebration
we put charcoal in the gas grill who did
that
we cooked burgers and hot dogs and beer
and vegetarian food there's not much to
say in the scope II accept two things
one midnight black eons are only on sale
from those six hours make sure to go buy
some too
if you had work today
congratulations you have a real job and
three don't forget about the video
contest we'll be judging it on the ninth
so get your open pilot videos together
we'll all be judging it will be a joint
they'll be like the American Idol
for videos thank you for joining scope
ease I hope you have a great Labor Day
and that's Labor with an O are not a no
you are like the Brits might say so what
Labor Day with oh you is another time
yeah yeah doesn't May yeah yeah they
have like but like in America is like
afraid of Communists so confuse that
with made it yeah that sounds communist
we're afraid of them is America fastest
copies do the video do the video earn
$1,000 and go buy midnight black peons
while you still the chance to see if
it's crazy low price
and refer your friends oh yeah yeah I
mean that's what these things really are
um
affiliate all affiliate link like that I
was thinking if you want to come work at
coming I we're hiring two people we're
hiring a test engineer and the machine
learning engineer I had a full stack
engineer I'm so if you're interested
give me a job Akane I and you could join
things like our great Labor Day a deuce
be challenge yeah if you're ml juice be
a challenge the other two just like be
good we're Kearney Mazda has puppies
that buys job
[Music]
all right what up alright so we're in
the common in our backyard that's the
more of Khmer I this is not gonna be a
long periscope we found a weed whacker
in the hobbit door and you lost your
cord we're going to attempt to grill
grilling might happen there's a grill we
found it but we had to whack away to it
is it an IOT weed whacker Oh Oh quality
I'll plug in the ethernet port yeah it's
good we need wireless power like the
essential phone power reason it that's
true well we actually have 71 people
right now look at arrows it's also a
dilapidated Toyota Prius
so this is the Wow we have 113 people
holy shit what's up with all the feel
good we got some more extension cord all
right so no no what you're doing it real
nice
[Music]
now with safety goggles it's OSHA but
where's the new Accord it's in front
we're taking the new Accord to go
shopping here's my motorcycle it's like
the DeLorean at the end it back to the
future but when they hide it in the
bushes shoes are sad Prius Wow how are
you all here that's that's the bundle of
wires powering the 3d printers here's
the Prius is flat tire sad do you guys
see my slam you guys see twitch slam oh
yeah no let's whack that let's whack
that table we're gonna eat outside like
civilized memorials these are cool first
we're working to come a high you get to
do yard work
[Music]
happy Memorial Day everybody
look at that equality wagging alright yo
look I'm wearing it I'm wearing a
brightly colored shirt whoo all right
I'm gonna go we got we got some some
Memorial Day celebrating to do
happy Memorial Day from everybody to
come AI should we plug the shop should
we plug the shop yet check out the
Memorial Day sale shop kama dolly eye
everything's for sale that's not we
didn't add any money it's always for
sale it's over sale um no but seriously
uh I'm gonna have a good time with your
with your families your significant
others your co-workers whoever you
choose to spend this Memorial Day with
there's no Memorial Day sale that was
fake news Gloria Borger never would have
reported that no one 2088 nan midnight
black eons are never coming back
cycle yeah boys not on sale for sale
that's right you can buy for eons
it's a Memorial Day sale all right later
scobie's
good morning good morning
so i'm harold from research
and i'm going to give an overview of the
kind of work we do at coma
so our stated goal at coma is to
build a superhuman driving agent
which is basically a level five
self-driving car and i'll talk about the
way we're trying to achieve that
first i'm gonna
test my uh
pointers
right that works
hmm
oh
that's something so before we can talk
about how to build a self-driving car
it's important that we have a very clear
definition of what it is that we're
trying to achieve
so to build a real self-driving car i
think
the first obvious thing we want is that
it doesn't crash
crashing would be bad
we can't expect it to never crash
because that's very difficult so
crashing less than an average human i
think is a good minimum goal
another problem is that you also want to
get you somewhere
if it doesn't get you anywhere it's not
that practical
and for it to be really useful we wanted
to drive on basically all the roads that
a human would have no problem navigating
so just your average driver with a
driver's license or self-driving car
should be able to do the same things
it shouldn't oh i don't know why that
happened
it shouldn't have to satisfy it
shouldn't satisfy these things just by
being super slow and avoiding hitting
anything just by driving five miles an
hour so it should be somewhat efficient
so that humans don't get frustrated by
using this
and then the last point's a little bit
more nuanced um we want to build a
self-driving car that doesn't require
any infrastructure at all what i mean by
infrastructure is
we don't want to have to change the lane
lines or the road or change the traffic
signs and change the traffic lights also
it appeals a little bit more to our
self-driving system
we want something that works exactly on
the roads that humans can drive on now
if it can't do that you're basically
just building a train in a slightly
different format so no infrastructure
okay
so first we'll think about the the
classical approach that people use when
building a self-driving car
it's kind of seen generally as a
robotics problem where you have some
environment in this case you've got the
road
and then you've got a whole bunch of
sensors that tell you things about this
environment you've got cameras
radars some cases lidar imus
and all these sensors go into some
perception layer this perception layer
can
analyze what these sensors are doing and
can process it in some way in many cases
you have machine learning models running
that will
parse the camera data and tell us some
things about maybe where are the lane
lines where the other cars where
pedestrians
all this information then produces some
perception output which is a list of
things that you think might be relevant
for driving which is like you said lane
lines where everything is where the
people are where the traffic lights
and then this would go into another
layer which is the planning layer
the planning layer is generally some
kind of hard-coded optimizer that tries
to optimize several different goals
which is like don't hit things try to
get somewhere follow some traffic rules
and then the planning layer outputs some
trajectory that you expect the car to
drive
which is then executed by some kind of
control system robert talked earlier
about what that control system kind of
looks like and here we can see the
steering wheel turning
so we'll look a little bit more into
what one of those perception systems
would be here are some examples of
things people use for self-driving cars
so you've got a machine learning model
that just looks at the video of the road
and it's labeling all these things that
might be relevant which is like cars
people
traffic lights it's probably also you've
got systems that label all the lane
lines and the sidewalks it's laboring
the bus is a different thing as a car
and then you can compile all this
information together with some other
sensors maybe like lidar into this 3d
representation of the world where you've
got all these cars all these lane lines
you know where you are and you know kind
of
some some version of what the
environment looks like
once you have this perception output
let's go back one
i can
oh yeah there we go
so we have just a classical planning
layer you'd have some objectives that
you try to stay so like stay in your
lane don't hit other things don't hit
cars stop the traffic lights and let's
give an example here for this scene
how do we do that well it's pretty easy
right you just drive straight stay away
from the other cars don't don't try to
go over the lane lines so this seems
pretty easy to write an optimizer that
can satisfy those requirements
then we go to the
next scenario
here this is a little bit more
complicated oh no let's go back
where we have
an intersection
and
let's say we want to turn left at this
next intersection
now you're trying not to hit things
you're trying to stay in lanes
and you're trying to stop the traffic
lights now this all doesn't seem like
much of a problem the light's green so
you can drive through the intersection
that lane's open so you can just go over
there drive there and then you turn left
at the next intersection that doesn't
seem that hard we can write some code
that does that
but if we zoom out a little bit in this
scene
i'm really confused by which button does
which on my clicker
the top one goes forward
oh there we go all right so we zoom out
a little bit in this scene and there's a
pedestrian standing on the crosswalk now
this person looks like he's paying
attention and it doesn't look like he's
going to cross if there was a car
driving but we still kind of want to
keep a safe distance you know our
optimizer has a target which is don't
hit people so we try to keep some
distance from all the pedestrians that
uh we're trying to avoid
but what does that actually mean
you want to drive in this left lane you
want to keep some distance from this
person but you also want to stay in the
lane so what's the compromise like are
you going to drive in the middle of this
lane or are you going to drive a little
offset
there starts to be a lot of these
competing costs in this optimizer and it
has to be very confusing how you tune
this to get a desirable trajectory
personally i would just drive in the
left lane and stay a little bit away
from this person and that'd be fine
but it's hard to actually implement
these compromises correctly
and then if we change the scene a little
bit
imagine it's a child that just dropped
his ball
for me this would completely change
things i would not go in that lane and
i'd keep way more distance but this
introduces a new problem which is that
our perception layer doesn't output
whether this is a child or a normal
pedestrian or a child that's holding a
ball or just dropped a ball
so now it's kind of unclear how we can
write policy that deals with pedestrians
correctly because pedestrians can
encompass all these different things and
the more of these kind of more
complicated scenes we look at the more
and more we run into these edge cases
that we really have no idea how to deal
with
so that's the classical approach
it honestly seems like the back button
works and all the other ones don't
so the flaws with this classical
approach are that
you require machine learning models that
do perception based on some camera
stream or some lidar stream and
generally these are hand labeled that's
very resource intensive and not very
practical
the planners are some hard-coded
optimizer logic which has generally has
to have code for a whole variety of
different scenes and environments and
this list grows and grows as your system
becomes more and more capable and has
some unbounded complexity
and then there's the other problem which
is that the planners need to take in
information from the perception model
and any list of things that we can come
up with that we think will be good
enough for the planner tends to be
incomplete we always run into some new
edge cases and actually need to add new
information
and this list of things the perception
model needs to output also grows
endlessly
so the result is you have this stack
which is massively complicated
impossible to maintain
and this is why you see many
self-driving car companies that use this
approach make a lot of progress for a
few years and then they start to
stagnate because they're working on this
huge stack that is so difficult to alter
because of how complex and intricate it
is
so what can we do
a friend of mine used to say
every time you get in a car you show it
how to drive
the problem is is that it forgets
and this brings up a very powerful idea
humans don't drive by memorizing some
very long list of rules of how to act in
every environment
instead they learn some basic traffic
laws maybe but in general they observe
how other people drive they observe how
their teachers drive and from that they
learn how to operate a car
so we can very easily collect data of
humans driving
so how can we
leverage that in the same way that a
human would to
teach the system about how driving on a
road works
so we call this an end-to-end approach
we can just build machine learning
models that take in some raw sensor data
like video or other sensors and can
immediately just say drive like that
so it's kind of like having
video and asking a human based on this
video where would you drive
so we can very easily collect this data
set and then we can show the model where
the human drove and have it
predict predict that and then you have
this system that will tell you where
things humans would have driven and it's
actually a very powerful idea because
when you have a data set of thousands of
users then the model will predict where
things thousands of users would all
predict on driving together so it's kind
of some consensus approach which can be
much more robust than just asking a
single person where they would drive
and what's really powerful about end to
end is that
all you need to make it handle more
complex scenarios
is to make the models bigger give it
more data
and it will just become better and
understand more it doesn't require more
code it doesn't require hand tuning some
things and it doesn't require adding
extra logic for every new scenario we
support all we need is bigger models and
more data
so given that we can redraw the diagram
and look at the new approach
so
we've deleted the perception layer all
we have is raw sensor data it goes into
some big planning machine learning model
that outputs where it wants to drive
and then that gets sent to some controls
interface and operates the vehicle it's
now much simpler and should be far more
scalable to
actually dealing with the huge variety
of complex situations that appear on the
road
so
to start
we need data and we need a lot of it so
that the machine can learn from it
openpilot collects data from all over
the world in one minute chunks
we collect currently over a hundred
thousand minutes a day collectively it's
over 50 million miles of data collected
and that equates to a few full lifetimes
of driving
humans can learn how to drive in a few
lifetimes so it doesn't seem
unreasonable to expect that under some
conditions a machine learning model can
too
on the right you can see just a couple
weeks of data collection from the united
states you see we have a pretty
widespread
data collection across the entire
country
i think there's some ai in this clicker
oh
i see
all right let's go oh
maybe i should just stop for a while and
let it catch up
okay this is oh that's the one i wanted
that's the one i wanted great so just to
give some examples of how really diverse
this data set is i just made this quick
tool where you can click on the map and
it'll show you some video that's the
closest i picked some places i thought
look would look cool so we've got the
golden gate bridge utah
joshua tree national park
san francisco bay bridge
new york city the colorado mountains
and so when it's exposed to all these
scenes our model can learn about how
driving works in all these different
environments
this is some international data we've
got thailand
some rural roads in scotland
nigeria belgium singapore
taiwan
so you can see driving is really
different in all these scenarios and
it's very important that we have this
massive amount of diversity in the data
set so the human so the machine can
start to understand what's different
between driving on some farm road in
scotland where you drive on the left and
driving on some you know cobblestone
street in belgium
so we've got the data
and now we want to start thinking about
how we train this model
we want to clearly define what the
output of the model will be
we talked previously about how the model
is going to output some path of where to
drive this path is going to be in meters
it's going to say over the next 50
meters you know turn a few meters left
or turn a few meters right and after
that straighten out
getting this information about where a
human drove in this representation
for all the video we have is actually
not trivial we need a localizer to do
this
so a localizer answers the question
where am i right now
where am i looking where am i going and
where did i go
once we can answer those questions we
can then generate the ground truth for
our machine learning models
on the right here you can just see some
satellite view overlaid with
some images we use to represent cameras
of video we've taken so there's just
four parallel lanes somewhere in the bay
area
so to build a localizer
we start with gps or if you want to call
all those constellations
including the chinese and the europeans
who call it gnss
gps doesn't exactly tell you where you
are it has these satellites orbiting
around the world
and it tells you kind of how far away
every satellite is from you if you know
that and you know where the satellites
are you can then kind of estimate where
you are and this is what most gps
receivers do the thing is they use
pretty simple algorithms with not that
much compute to do that when satellites
tell you how far away they are there's a
lot of error in this measurement
it can be influenced by the humidity of
the atmosphere by the relativity errors
in the satellite's atomic clocks it can
be influenced by things in the
just ionization in the atmosphere and so
we can get quite a bit more accurate
results if we just take these raw
measurements and do our own processing
so we built an open source project
called leica which is capable of doing
all this processing
and we can get much more accurate
results one of the cool things that we
can do by having our own library is we
also get the doppler shifts to every
satellite at doppler shifts you can
measure the difference in frequency that
you're seeing from a satellite and it
will tell you the relative speed of your
receiver to the satellite and this
actually gives you such accurate speed
readings that the gps gives you far
better speed readings than the
speedometer of your car
so this is very useful for the kind of
localization we're trying to do
one of the examples of things like i can
do is
if there's activity on the surface of
the sun this ionizes the earth's
atmosphere and can cause a few meters of
localization error in any normal gps
receiver
we can download some reports from nasa
that tell us about the solar activity
and compensate accordingly making our
localizer even more accurate
so we've got raw gps measurements that
we process a little bit massage a little
bit to get low errors and
we can use that to get a location and to
get speed but it doesn't tell you where
you're looking it just tells you the
position not the orientation
another problem is that gps is great
but not always
when you're under trees in a tunnel in a
parking garage gps either works worse or
not at all
so to be able to have ground truth in
all driving scenes
we want to
have a system that always works so it
needs to work when gps is spotty and
sometimes even when gps is not there at
all for intermittent periods of time
so we want to do sensor fusion with
redundant sensors
we made an open source project to do
this it's called red nose and it's a
pretty large kalman filter which is a
type of optimization filter
that takes in all these different
measurements including gps
and will output its best estimate of
where you are and the orientation of
your vehicle
one of the so we use imu data here
speedometer data
but the most important is actually uh
camera data so we can look at the video
of uh of the dash cam and we can see how
things are moving in the scene and we
can track those with things called orb
features
and we can use those
pieces of information in our in our
sensor fusion system and it'll give us
accurate information about not only
where we're going but also what
orientation we have how the car is
turning
if you have
very accurate localization of both your
orientation and position across many
frames you can start to stitch things
together so here you can see kind of a
cool example of how well our localizer
works we take all these points that it's
seeing while driving along this road and
you project them all down and see this
beautiful top-down view of you passing
an exit but staying in your lane
and
localized is very accurate and that's
great but the most important thing about
it is that it is robust
oh no no
it needs to work in
all the situations we want to expect our
car to drive which is all of them
so
it needs to work when the scene is dark
when there's not many things going on
not many features uh to tell you about
where you're going in this case we still
have a sign
and but once you pass the sign really
you've just got a couple lines on the
road and this can really confuse the
camera odometry system
this is actually an example of a bug we
had only a few releases ago where if the
lines were continuous then it would
match features to itself and get super
confused and start cutting the turn but
that's now been fixed and
so far the system has become incredibly
robust
so now we've got ground truth we know
where the human drove for all this video
we have so all we have to do is we train
a neural network that takes in a couple
of video a couple frames from the video
we just use two
and predicts a path of where a human
would have driven in that situation here
you can see the system training it's a
little bit noisy at the end but it's
already getting right that you have to
go mostly straight
the model we actually use is an
efficient net b2
takes in the images here which are that
size and then goes to some head and
outputs this path
no no no
okay
so we've trained our machine learning
model
and now it's time to find out whether it
works
so
generally in machine learning you have
some training set of data
that you've worked on
and then you've got some other data that
you keep separate to test on just to
make sure that it's not overfitting so
we've got all these examples from our
validation set
and we look at them it looks pretty cool
we've got some lane lines in there as
well that was easy to do so we just
added those and you can see it turns
turns there you can see it even gets the
3d parts pretty pretty nicely here it's
pretty things going uphill
and
going over a crest of a hill over there
but in general this looks pretty good
this uh looks like what i would have
labeled if i were to say where to drive
so we're ready to try it out on a car so
we take this model we implement it
we make it so that its output is
executed by controls
and
it doesn't work at all we drive on it it
completely drifts out of the lane almost
immediately
so there's this quote about software
engineering that i think is really
applicable we do these things not
because they're easy but because we
thought they would be easy
and so this applies here too
but this brings us to
what can we do now we thought it would
work
it looked like it worked on the data we
tried it
but
in the real world it fails completely
we could keep trying things and then try
it on a car but this is very time
consuming and gives us a very very slow
iteration speed
so
we want to have some way to test it
online from offline from our desks
before we go out and try it on a real
car again
to do this we would need a simulator so
that
in the simulator the model can predict
where it wants to drive we can have some
simulated control system execute on that
trajectory and we can then see how it
behaves
hopefully if the model is driving on its
own path and this is simulated in full
rollout we should start to see similar
results we saw in the real world
so
what kind of simulator can we use
um you can use things like gta 5 or
carla or truck simulator
i mean there's roads there and they look
kind of all right
but the problem you get with those kind
of simulators is very similar to what we
talked about at the beginning the amount
of environments and scenarios one of
those simulators can simulate is always
going to be limited to the amount of
scenarios you engineered into it it's
never going to capture the full
diversity of human driving
if you want a self-driving system that
can work in nigeria or in the country
roads of scotland
you also need a simulator that can
represent that otherwise if it fails
there wouldn't we'd never know about it
so we want to build a simulator that is
based off real data and can simulate the
entire spectrum of our data set
so we use a little bit of a trick which
is you just take video
and you can just warp it a little bit
left and right make it appear as though
you're driving in a different location
than you actually did
you can see as it's moving around in the
simulator that things are warping a
little bit
and obviously if you go very far from
where the video was taken there'll be
nothing left
but this simple trick seems to be good
enough to do some simple simulations
and those simulations tend to be good
enough
so
let's try the system we just trained in
one of these simulators and see what
happens
so on top we see we just have this
segment of driving down a road behind a
truck and we have the model that
predicts your path and we try to execute
that plan you can see it kind of already
starts to drift out a little bit but in
reality it started to drift out much
much much quicker than that
and then we realized this is because in
the real world there's a lot of
disturbances that act upon the car
there's little bumps in the road
the tires aren't perfectly aligned
and there's things like wind gusts and
all these things push the car around a
little bit in a way that
the model didn't want it to so we can
simulate those disturbances too and this
is what you see in the bottom frame and
you see it drifts out in a matter of a
few seconds this is exactly what we saw
in the real world
so trying to understand what is actually
happening and why
just having the model predict what it
thinks a human would have done in this
situation isn't enough is kind of
difficult
it's something we argue about a lot and
it's kind of is worth the whole
discussion in itself
but i'll try to give as clear of an
explanation as i can
which is
imagine the car is on the right of this
lane so it's not perfectly centered
what would a human do in that situation
you could imagine that the human would
probably correct and go back to the
center of the lane
and this is probably true
but
when would the human correct
you can see here it tries to correct a
little bit at the end but in the
beginning it still goes straight
so if that's what's happening and you
have this car at time t0 which predicts
to go straight and then recover
then tells the controls to do this
it goes straight
and it's still in the same position in
the lane and you ask it again what would
a human in this case but nothing has
changed so it answers the question in
exactly the same way again it says go
straight and eventually recover
and if we run this in a loop
the system never recovers it keeps
predicting just go straight for now and
at some point recover because that's
what a human would have done
but with nothing keeping track upon the
fact that it's never actually executing
recoveries that it had in mind it just
continues to
accumulate error and if there's any
amount of disturbance like wind pushing
this to the right it'll just drift out
of the lane
and so this is what we see in the real
world and it's also what we see in the
simulator now
oh
almost
so how do we solve this
like we mentioned really the problem is
is that the model is never learning to
recover from mistakes it gets pushed out
of where it wants to be a little bit and
it doesn't recover
so
one of the ways we can solve this is by
training directly in a simulator in the
same simulator we've been talking about
push the model left and right a little
bit introduce these disturbances
and tell the model recover right now
and that's what you can see in these
gifts right here so we've got the black
path is where the human actually drove
in this situation
and we push the car around a little bit
and we tell it that's where a human was
driving get back there immediately
and that's what you see the white path
is which the model is predicting so
you're seeing we're pushing the car
around
and the model is seeing that and it's
shifting this path to where the human
was driving
you can see the same in this situation
there's actually
a lot of details involved in getting
training in the simulator like this to
work and that's the culmination of a few
years of work echoma we've got some more
technical write-ups about the details of
that but in essence this is what it is
so we've got this new solution and we
think it might work
but how do we know if it works we
already talked about the importance of
testing before because we don't want to
test in cars testing in cars is super
time consuming we actually have this
rule at a research tacoma that testing
in cars is not allowed if you can't
reproduce it on your desk it's probably
not worth looking into
so
we want tests that work completely
offline and give us indications about
how the model will perform in the real
world
everything that we don't track or test
explicitly will probably regress or
break at some point we've experienced
this through a lot of trial and error
and we are now very aware of the fact
that every situation we want to work
correctly needs to be appropriately
tested
so we put them all through a whole
series of tests
give it a little eye exam
so i'll just give some quick examples of
the kind of tests we can run that just
give some indication about what's going
on
the first thing is we can just
ask it the model how fast it's driving
we know how fast the car was driving if
the model doesn't know exactly its own
speed
that's generally an indication of some
kind of failure
we can also
we can check the accuracy of how closely
it's matching the path that the human
was driving how closely it's matching
the predictions of some lane lines if
anything here looks weird or there's a
lot of outliers that's usually an
indication of a failure that we would
want to look into
we also have this simulator
so we can actually just let the system
drive in simulation and do all kinds of
tests of how it behaves we can introduce
lag in the steering rack and see how it
reacts to that we can introduce
disturbances such as wind we can make
the steering wheel offset pretty large
so that it's just pulling left all the
time and we can see how it reacts to all
these situations and kind of get an idea
of
how it would fail and how many
disturbances are necessary for it to
fail
so we drive the model in simulation on
thousands and thousands of minutes of
driving and we see kind of what the
overall results are we check how often
it deviates from the human path we check
does it cut turns too much does it
overshoot turns too much is it just kind
of too aggressive all the time
and all these things we can find out by
just doing metrics on thousands and
thousands of minutes of simulated
driving
um
so one of the other tests we do is
just check overall
when did the model predict to do
something
that is
completely different from what the human
actually did in this situation so we did
the model ever predict something that
looks like a swerve compared to what the
human did
and here are some of those results of
those tests as you can see they're
basically all lane changes
the human made a lane change which is
the white path
and the model predicted to stay in your
lane
this isn't a bad thing but it brings up
this interesting point which is that
we expected the model to always output
the right answer which is what a human
would have done
but that's not there's sometimes there's
more than one correct answer whether or
not you make a lane change both making
the lane change or not making the lane
change is generally acceptable and it's
definitely both safe
so
we need to give them all some context so
that it can
understand how to deal with this
we need to make sure the model
understands where it wants to go so that
i can
make a lane change if it's necessary or
turn right or left if it's necessary
here's some examples of this happening
so you've got a human making a lane
change past this car
and here you've got an intersection
where there's a turn left lane
and there's a go straight lane
and here in this case the person kept
left to make the left turn but might
have just as well just gone straight
so to deal with this problem we just
have like a small set of hand labeled
classes which is you can go straight you
can make a lane change you can keep left
keep right you can turn left turn right
and we label those we give that model
the model that is context so it makes
sure that
when the model's making a lane change
it's doing that when it's told to make a
lane change
um
and then that brings us to there's
really only one correct path given this
information
so we fix this problem by labeling that
you'll hear later in in the talks a
little bit more about how exactly we
label that
and so this kind of works
and it more than kind of works this is
an end-to-end system that we've shipped
and since a few months has been running
on open pilot you can go into settings
and disable lane lines and it will just
work completely end to end in the way
that we've described this is as far as i
know the only kind of end-to-end
self-driving system that works at all
and it's definitely the only one that
you can experience
so
i'll just go through some quick
examples of
kind of the power of this end-to-end
approach and things that it allows us to
do
i think the button's sticky i think
that's what's going on
oh oh did i do that
wrong talk
but the clicker definitely has a mind of
its own
anyway so
uh quickly i'll give some examples of
lane changes which are one of the things
that's possible with this end-to-end
thing we can we've told the model about
lane changes during training
and so
we can also tell her to do a lane change
like a human would
i'll take a drink break while we're
oh we're taking a break anyway
the lane changes are too good yeah
it's trying to keep it a secret
trust me the lane changes are going to
be worth it when they're finally
revealed
[Music]
yeah we can we can talk about it in the
q a as well but uh
i will take a short break everyone can
think about the questions they're going
to ask later
i guess this is kind of a good place to
take a break that was how we build it
and then we'll have the grand reveal of
the results
okay i can take some questions right now
yeah we'll do a couple questions until
we've got the
laneless results
model training takes a long time
[Laughter]
yeah somebody's trying to get the gpus
up and running
any questions
sure so um
i saw on the slide you had an efficient
net and then a fully connected layer
and that corresponded to
um vision and planning could you go a
little bit more into um
like
are they separated or are they all
trained at once
um is there any separate training of
those two model components uh no it's
just uh it's just architectural
separation so you've got the conv net
which is so the b2 is fully calm and
then you've got some dense layers on the
bottom but it's all trained together how
many parameters on the bottom versus the
the top i don't know or roughly just a
few million in the bottom and i don't
know how much inefficient that is that's
several million too
oh we're back
back back back right so this approach
works
and we've got end-to-end machine
learning working for self-driving
here's uh the first example of this is
we've got end-to-end lane changes so
this system was never explicitly taught
about lane changes uh lane lines it was
never told that a lane change is
crossing a lane line
we just teach it
these are the lane changes that humans
did try to do them like that and in fact
these lane changes will work perfectly
fine if there were no lane lines if this
was snowy or it was just a badly
maintained road lane changes would jerk
would work just as well as they would
for humans
next example is
just driving
lanelessly in a variety of situations
so on the left we've got a road that's
completely snowed in if there were lane
lines we can't see them
and a classical system would struggle
here there's not really much to go off
you could say that maybe the road ends
there and you try to stay on the road
but
a lane the system can clearly see this
is where a human would have driven
because that's where the tire grooves
are and it can smoothly just do exactly
what a human did
this is the power of the end-to-end
machine learning on the right here you
can see there's a turn to the right and
there's quite a bit of oncoming traffic
that looks quite intimidating and the
lane this model does what a human did
which is cut the turn aggressively to
avoid this oncoming traffic
again these are all just
features that it can learn just by
observing humans we didn't ever tell it
to avoid traffic we didn't ever tell it
to follow the grooves in snow it's just
observing humans and doing what a human
would have done
so what about longitudinal this entire
talk has been talking about lateral
control of the vehicle which is just
controlling the steering wheel there's
more than that to controlling a vehicle
you also need to control the gas and the
brake
we've been working on this for quite a
long time and only the last few months
have we really been able to ship
laneless models that work well
and so that's been the main focus but
all of the lessons we've learned and all
the strategies we apply should work
perfectly fine for controlling
longitudinal as well
so recently we just started working on
that and i'll give some quick examples
of
what some end-to-end longitudinal
features would be
so we've got uh model-based fcws that
was shipped a few releases ago
so we can just ask the model a question
you know how humans drive
tell me if you think a human would break
in the next few seconds
and so that's what you see here when the
fcw pops up the model is saying whoa
whoa i think a human would have break
hard here
and so this is shipped in open pilot if
you're engaged and you're in a situation
like this you'll get a warning from the
model saying you might want to break
pretty hard here
here's another example
so again this model we're never told it
about cars explicitly or anything like
that we're just asking it tell us when
you think the model would break when a
human would break hard
another thing we can do is we can ask
the model tell us where you think a
human would stop again that's basically
the same ground truth as the paths we
just check where the velocity becomes
zero and a human driver becomes
stationary for a while
so here you can see the model is
predicting
a stop line which is where the human
would stop right by the red traffic
light
and here you can see it by a stop sign
so this is completely end to end
seeing the traffic lights because it
knows that's where humans generally stop
and the same with the stop sign it's not
explicitly looking at the stop sign it
just looks at the scene and knows a
human would probably stop here
so what's next for comma research
stop lines is one of the features that
we haven't rolled out yet that's the
only thing in the talk that's uh kind of
still experimental we might want to ship
that soon if we can get it to work
pretty well in general we're really just
looking at making this models bigger and
smarter and understand more and more
complex environments so this is going to
keep improving
end-to-end lateral control
and then we also want to move more and
more to end-to-end longitudinal control
currently open pilot still uses lead
card detectors and
just normal acc commands to control the
longitudinal control and we want to
start moving that to exactly the same
full end to end architecture we're using
for lateral
questions
[Applause]
guys
sure yeah
um
it is used for
some parameter estimation of the vehicle
controls yeah
i'm not really i'm not sure why that
would be necessary
the model shouldn't require gps for
anything at runtime are you saying
because you want to make a map of this
places to stop or something well i don't
want to be restricted
right right so we do rely on gps for
ground truthing but like i mentioned we
do support spotty gps and gp and so the
system should work completely without
gps and so currently our data set should
capture all the situations where gps
doesn't work just because if you had gps
40 seconds ago um then that's enough to
carry through through the entire chunk
of data we analyze so that's not another
requirement
i'm going to start with questions down
the row here
i want to ask how you
look at training data and decide this is
good driving and by that i mean what
happens if in your training set uh
you look at night and the driving in the
area of this bar at night after 3am is
kind of weaving all over the place or a
human tends to roll this stop sign
or
uh
somebody's just weaving on the highway
or quite frankly you drive like i do
when i'm not driving an open pilot how
do you get rid of all my driving data
and train on the chill people
so we kind of
uh think about it as
you're not just looking at mimicking one
person right we're looking at this whole
data set
and we make the assumption that
when humans make mistakes
they tend to do it in noisy uncorrelated
ways and so if you have a system that
behaves like it would the average or the
median of thousands of different drivers
would that's generally a very good
approach if you ask you know 50 people
to look at a video and exactly what they
would do
the consensus of that should be very
stable and i think good driving
if that ends up that the average driver
is perhaps too aggressive what we want
openpilot to be we can start you know
doing some basic things to differentiate
some aggressiveness and tune it down a
little bit so a little bit more
conservative i can see how that would
work for most things but just how would
you control for saying rolling a stop
sign
uh which quite frankly the average is
going to show that a fair bit
so right now we're just really not at
the stage where it makes sense to think
about things that detailed i think
we first want to get to what an average
human would do and if for some reason we
want the system to behave differently we
can think about that then and there's
some tricks to do some filtering of
certain types of human behaviors but i
think average human behavior would be a
massive victory for the entire
self-driving space
thanks again
question here how do you train out like
unwanted behavior
one thing that they've seen with this
end-to-end approach is sometimes car
tries to follow
what driver in front of you does
it kind of ignores lane lines it just
if that car goes right left it just
follows it
yeah so that's kind of similar to
jason's question and like i said
generally mistakes humans make are very
noisy and uncorrelated and so if you
take the average of lifetimes of
thousands of different humans
the behavior should be very consistent
and should be
pretty desirable
yeah i mean like like i just said i
think uh
average human driving would be a huge
victory for the self-driving space no
system in the world is anywhere close to
that so that would still be uh
much better than anything in the world
so in regards to n10 lateral control
if you let's say had a camera on both
sides of your vehicle so you had a wider
field of view and you were training on
that
would the ai start to learn to move over
to the left side of the lane if there's
a semi on the right side like a human
would assuming there's no car on the
left side or would that kind of get
washed out in the training no i'm pretty
sure that would
consistently i think humans try to keep
distance from cars next to them in
highways and so i'm pretty confident
that model should learn behavior like
that you can actually see
in some cases if there's a semi on the
left side of the lane the end-to-end
planning will deviate slightly
awesome thank you
uh yeah so first of all thanks again for
the presentation super informative and
amazing technology um but um kind of
like inverse to the two bias questions
that came before
um
have you found um either any places
where it's relevant or where it's useful
to have explainability backwards like if
the model does something that's
particularly weird one time like it
swerves out a particular type of lane or
it takes certain types of exits
um are you able to go back and tell
what influenced the model to actually
behave this way yeah so that's i think a
very interesting question and something
that i when i started working on these
things was much more worried about than
i am now i think generally these models
are seen as kind of these black box
things that can predict behave in
unpredictable or weird ways and there's
no way of explaining it but so far every
case that we've seen of it behaving
something that initially looked weird
we've been very easily able to reproduce
and explain to give one quick example of
an issue we used to have is
everything was fine the roads looked
fine and it was sometimes randomly start
predicting lane lines in the center of
the road
and this was a bit of a mystery for a
while and then you start to look at the
ground truth uh that has you know lane
lines in the middle of the road and you
find there's some person that had like a
fluffy thing at the front of his car
which was kind of colored orange which
was detected as a lane line so this kind
of made it into the data set and then
the model sometimes behave that way but
so far every single weird behavior we've
seen we've been able to explain
same yeah
what's your intuition on continuously
making use of larger models and keeping
just sort of taking the traditional ml
and just scaling it forward uh because
in the case of like real like real world
like you have distributional shifts uh
in that case examples that occur very
rarely
would be it would be unlikely for the
model to make any sort of generalization
on that sort of data so how do you
sort of augment the data so make use of
examples that occur very rarely
i'd say so far we haven't really seen
much of the issues with that yet
if there have been issues where the
model struggles in rare cases of that
it seems to be that generally the model
is just limited by the quality of our
ground truth if there's you know 0.1
percent of data that looks completely
broken because of some bug this will
usually manifest itself in the model not
being that smart in the end and not
being able to see rare cases but as
we've improved the ground truth quality
even with the same size of model we've
seen the model become smarter and
smarter and can learn more and more rare
events maybe someday some kind of
sampling would be necessary but i think
so far uh we're making very good
progress without that
yes so my question is uh specifically in
regards to driver alertness
so one of the things that i've noticed
that as i'm driving
there's some scenarios that i run into
that i'm particularly on high alert so i
was wondering if there was any
consideration with a comma team into
developing a predictive model uh maybe
you have different levels of alertness
that that
could either be communicated to the
driver or that the
that you recognize as as like high risk
scenarios
yeah so
currently we actually have the model
tell us how likely it thinks that open
pilot would be engaged right now and how
likely it is that a user would take over
from open pilot in the next few seconds
either with the brake pedal or the gas
pedal or with the steering wheel so the
model already completely outputs all
this information um we've thought about
communicating this somehow but just
really haven't gotten around to it but
we do have tons of introspection in
how much confidence the model has in
that the situation is weird or that a
human would start to feel uncomfortable
have you and uh one follow-up question
have you thought about like creating
a project for
you know kind of like a take home
project type of type of thing for uh
where you could let's say you could
export a csv file and
ask a few questions you know and and ask
someone to like predict to develop a a
model like based on you know uh 10 data
points or 20 data points that that like
oh
if you if you think this would be more
more likely to be a high impact scenario
so like say for example you could go to
a
insurance company look here are the top
uh reasons for car incidents and then
you could you could ah you could have
like specific questions based on that so
just like just not entirely sure if i
understand the question well just in the
same sense that you have like um if you
look on the website you had you used to
have the 500 bounty so i was asking like
it would have you
was there any consideration or would you
consider like potentially having
something where you took
um just some general instances and then
you you gave that as a project to the
community that we could potentially work
on i mean if you're talking about
developing on the model that's kind of
infeasible for anyone that doesn't have
access to all the data and all the
infrastructure that we use so
that's not something that's easy to
distribute development on
we got a question upstairs hi
a question regarding the evolution of
this approach i mean
my impression that it can brings you so
far like what you do but in building
like a very nice l2 and keep assist but
at some point you probably want to go to
you know like end to end trained
unprotected left turns and going to the
l4
and can you do you think you can push
this approach where like you may like
use the imaging date and the trajectory
of the actual driver for training or
you'll have to do some like paradigm
shift where you know go to zero approach
and like where you have to rewrite the
whole training pipeline
um
so i think in general this end-to-end
training scales
much further than any other approach
i mean you mentioned things like mu0
it might be possible that a distribution
shift of that level is necessary that we
can't use the simulator the way we do
now and need something a little bit more
advanced with some kind of learn
simulator or you know other other more
advanced machine learning techniques
something like that but it's like
ideation it's this is not nothing like
roadmap where you think okay i probably
go do it this way like in five years
uh we've got some internal discussions
about that but not nothing concrete okay
cool thanks
great thank you
all right um i screwed up my last
question luckily somebody else asked the
right one so this time i took notes um
so two quick questions and one thought
um first question uh do you so with your
human example under crossing do you um
consider the bounding box movement if
you
make sense if not because even tesla i
don't think you didn't do that wait i'm
just looking for where you are actually
oh i'm here oh okay sorry i'm like the
voice so what do you mean by the
bounding box oh yeah if you so your
example of the human on the border
crossing uh on the lane line crossing on
the lane lane crossing yeah would you
consider the bounding box and the
movement of it like the acceleration or
um what do you mean by the bounding or
for predicting well you make the
bounding box of the human you you see
that there's a human there right so you
make a rectangle around him oh okay like
now the movement over time right so
would you consider that for example as
to better predict like with stopping or
going right um down the line something
like that no so we don't want to do
anything like that so we really want a
fully end-to-end approach the system
should completely learn that a human
would slow down or avoid a human and
that behavior will come into the
end-to-end system right we never want to
explicitly track these things okay okay
oh okay so that goes with my second that
was the thought like of thinking
differently um instead of like finding
out if it's like a kid or adult you
could like do maybe post estimation
right like you could um train a model
like using epic mega games um meta human
stuff right right so that's that's the
kind of stuff we want to avoid we really
want a system that is very simple
architecture you take in training data
behave like a human so that we don't
have to write any of these code or
scenarios to deal with any complexity
right i figured you could kind of just
make a model that
extrapolates like the movement right the
skeleton and yeah sure but the problem
is this there's an endless list of these
things right right and it never ends
yeah okay um and then last question um
it's more for me like i work on the vr
operating system kind of thing and the
slam stuff is really not great the open
source slam stuff in some ways um your
system the sensor fusion um slam
tracking system would that work also for
like lower velocity and like vr kind of
systems or is it more yes should
completely work uh so we haven't really
been able to spend much time into
documenting or you know putting effort
into really making this uh library
accessible but it is open source you can
see how we use it and i think it has a
lot of compelling features compared to
other solutions
great i'm going to move to the back of
the room we'll come back to the front
i feel like we have a lot of questions
down here
hi so you mentioned kind of the machine
learning mantra of more data bigger
models and you've been working with
these models for a while
uh do you have any sort of kind of
estimation of how big these models are
going to have to get in order to reach
that goal of driving as well as a human
or are we not even at the point of
estimating that
um
i think it's difficult to estimate that
but internally we talk a lot about
you know what's what kind of animal
would be able to drive a car
would a cockroach be able to drive a car
probably not
i think that's kind of the scale that
some of the large models people use
these days are at like insect level
i think pretty confident that like a
bird or
or a small mammal would probably be able
to drive a car so if you want to have
some very rough estimation i think that
that makes sense to think about how many
neurons do these animals have that seem
to be show complex enough behavior
great we also should have plenty of time
for everyone's questions so
hi
um so you described that the um
end-to-end approach is essentially
predicting the trajectory that the human
would take in the picture right um
isn't that strictly speaking not fully
end-to-end because
fully antenna to me would mean that you
record all of the inputs that the human
took in the car
and then predict those raw inputs from
each frame a number of steps into the
future yes so it's not fully end to end
i think i glossed over that a little bit
too quickly but uh
we still make the separation between
planning and controls uh what you're
saying is you could skip that as well
just taking video out with the car
commands the problem with that is that
it makes very difficult to abstract
different types of cars so we support
all these different types of cars so we
already need some kind of common
interface there
that's one reason the other reason is
some level of introspection is useful if
we're just seeing the steering inputs
and the gas and brake inputs it becomes
harder to see what the model is thinking
and we really don't think that much is
lost in this abstraction layer between
planning and controls uh it seems like
it's reasonable to think that some plan
some trajectory is planned and then you
should just always be able to execute
that with controls i don't think there's
that much nuance
okay we're back here right
similar to a couple questions but
as far as the level five and
uh somebody mentioned the model but i
was curious more on the hardware do you
think
the the camera and the sensors that you
have now is sufficient or
is it going to require like mimicking
more like a human like binocular vision
or
you know
only cameras or is there any kind of
idea of
hardware wise what the future is going
to hold
yeah i think there's some limitations to
the current system and there's some
reliability concerns but
in general this isn't the limiting
factor given the video that the system
is getting it can do much better and
this is true for all self-driving
systems they're limited by the compute
and by
the software not by the sensors
hi uh i'm curious if you all been
thinking about this or if it's even
appropriate using data visualization or
dimensionality reduction techniques to
try to peek into the black box of the
model so to speak a little bit to see
what features of the world your model is
starting to learn and pick out for its
processing
yeah we've done various experiments with
this at some point tried to train the
gans that try to kind of reconstruct
some representation and we can see it
what things things are important and
stuff like that but like i mentioned in
one of the earlier questions we've never
really had issues trying to understand
what the model is doing with just a
little bit of effort we've always very
easily understood why the model is
making a certain mistake and extra
introspection wouldn't really help us
that much if it was necessary we could
build more tools but it's not a huge
part of the way we work right now
hello so a quick question
as you're ingesting data into the
knowledge base are you capturing video
for all active sessions or is it simply
a sampling of the population and then
secondly how does my active session
benefit from the contents of the
knowledge base
i'm not entirely sure what you're asking
so you're just saying is all data being
used to train the model um
no so we do some kind of diverse sample
with some basic logic to enforce some
level of diversity and then we train on
that um if we see
benefits from training on larger data
sets then we can move to larger data
sets but currently that doesn't seem to
be the limiting factor
how do you plan to gather the context of
a curvature
what do you mean by the context of a
curvature whether that curvature is
going to um say do a full 90 degrees or
what's
i don't see how you can understand the
curvature unless you have a top-down
view
like a map
i mean
you're talking about the ground truth or
how does the model see this um i could
think that you could ground truth and to
win longitudinal by using open street
maps and then using a test track with um
no no so this is all just ground truth
by using a localizer on human data we
know exactly how a human moved through
the world from the localizer and so
that's the ground truth and that's what
we make the model predict
does the localizer see the context of
the curvature like the future of it yes
the view the localizer knows we use the
whole future of the of the drive so we
do we do know that yeah
hey um has this been tested on
pedestrian crossings like does it stop
if someone's crossing the street so we
as i mentioned longitudinal currently an
open pilot isn't uh that end to end yet
um we've done some basic experimentation
with end-to-end longitudinal and we
haven't gotten that far with it yet it
does react to some things and it doesn't
react to other things we're still
working on that we only just started
really working on end-to-end
longitudinal but i imagine it would
react pretty appropriately once we start
working on it actively
so my question is more related to the
switching of the lanes so
does the model take into account the
the state of the blind spy blind spot
monitoring is that
is that input data taken into account in
the model that's not taken account into
the model i think open pilot on some
cars it will just prevent you telling
the model to lane change if there is a
car in the blind spot um
yeah
did i have some questions in the middle
all right i'm headed back front
uh this is a question about the
simulator so
you train off policy and this induces
distributional shift and to account for
that you throw in some noise which you
do with your warping
for richer more more dynamic multi-agent
scenes like going through an
intersection d do you think this
approach will scale uh what will this
work and if not do you have to have a
multi-agent dynamics model like wave ai
where they predict the trajectories of
other agents
uh
yeah i mean well like we were talking
about earlier it's possible that we need
a little bit of a paradigm shift away
from this
type of warp simulator that we're using
now but i think just right now it's not
really a limiting factor we have quite a
bit of ways to go
and then maybe after that we can see if
there's different strategies that can
simulate some more dynamics for example
do you guys use some sort of like
self-supervised learning setup like um i
guess cathartic and his talk cvpr he
talked about like how tessa is like
building sort of self-label annotation
engine on training
examples where the model didn't predict
was the accuracy of the prediction
wasn't that high do you guys see that as
some sort of
useful
pruning of data
right now we don't use that and i don't
think we have a need for it right now
um so in this new like what would a
human do type of training for your
models um are you still
like hand labeling for like anomalies
right when you have a dog that runs in
the road or maybe an obstruction um
does this new model remove the
the requirement of that like is there
still a use case for comma pencil
or is that legacy now um so comma pencil
has a very important use in the
localizer
the localizer assumes that everything in
the video is an enviro static
environment and by how that moves it
knows how its camera is moving
so that doesn't work if you assume that
moving cars and moving pedestrians are
part of the environment so comma pencil
is incredibly important there to filter
out the things that are moving through
the scene which are not static and the
static background which can be used for
localization so common pencil will
always stay for that common pencil also
we get lane lines from that and lead
cars which is currently still used in
open pilot and
we can conceive beings useful for at
least some level of filtering and
introspection forever but it'll just the
policy will rely less and less on these
kind of things as we move forward
um yeah i think someone you touched on a
little bit but um
when your
model is uh making mistake
i guess i'm just wondering is generally
the confidence high when you're making a
mistake and
is there any kind of approaches that
you're taking
to try to anticipate whether i'm going
to make a mistake or i'm more likely to
fail uh yeah
yeah so uh like i mentioned earlier the
model does predict the likelihood that
it thinks a human would disengage or
take over the likelihood that you are
engaged it's very rare for the model to
be confident and still make mistakes um
generally if that does happen that was
due to some crazy data bug that we've
fixed
i can't remember seeing any cases like
that recently
um this is a bit of a philosophical
question because from
what i've gathered it seems like you
guys are trying to build a model that
behaves like a human more than just like
an object prediction model
what impacts do you think this will have
on agi in the future say like five ten
years from now
um do you think it'll
help out with that at all or do you
think it'll make it more possible
i mean i think this is just a step
towards agi i think this is more you
know
more generic machine learning that will
scale and
sometime might create
superhuman ais
hi uh so first a comment i work at a
wave ai
and we have a end-to-end lateral and
longitudinal
right that yours is the only one you can
buy and try yourself
i appreciate that
uh i don't know if you you could have
seen the videos in the cvpr uh workshop
we had um
i think i've only very briefly seen
things i don't think i really looked
into it um
the question you've mentioned that
most of the stuff you've been doing to
improve the model is improving the
ground truth
but if it's end to end i'm not sure what
ground truth you're improving is that
just failures of the localizer yes
pretty much so the localizer failures uh
they can fail in many different ways
mostly because how much of it relies on
video and you have all these different
types of driving scenes so we didn't
talk that much about the localizer but
we started two open source projects
based on it so it's clearly a big part
of what we do
probably spent
two
two to three years really iterating
through the localizer making sure that
it's robust you have you know other slam
systems like orbslam
stuff like that that is very accurate
and works most of the time but they tend
to fail in rare cases which are still
not that rare and need to be fixed so we
spend a lot of time working through that
thanks we've got another question
upstairs
oh hey i'm just curious if
the self-driving models that you're
using primarily seem to be used on
highways and i think of
driving in general to kind of really be
split into highway driving and sort of
city driving with stop signs and people
and stuff like that and i see those as
two kind of distinct problems do you
think that the models that you're
building now
actually can work safely in city
environments or do you see any
challenges looking ahead to level five
in that regard
so we currently focus on highway driving
just because it's the most useful we
want to make self-driving cars but we do
want to ship cool and useful things
along the way
i don't think there's anything in this
strategy that's inherently limited to
highway driving or any specific scenes i
think it will scale perfectly fine but
it is significantly harder to drive in
the city i think than on highways
hello
i have a bit of an open-ended question
do you guys see like any differences in
the average of the way that people drive
in like tijuana
and like la and san diego
i can't say i've ever looked at the
differences between cities but there's
certainly a difference between
continents
uh hi i have a question since you say
you uh uh finally like uh let a human
kind of teach the agent to learn how to
drive so when is the day come plan to
let us teach it when not working
i mean implicitly that already happens
because
when a user disengages from the system
that's a signal that the user wasn't
happy with the way it works so
there's already this kind of feedback
loop we have very good ground truth for
you know when a user didn't think the
model should drive so we actually have
very accurate
metrics on how confident people are and
what it's doing
we're back here
hey harold
um in your blog posts on lateral
planning you talk about ways that the
model will cheat in the simulations
could you go through some of the ways
that you all detect and
mitigate against the model cheating
cheating
um so just quickly on that um
when we move around in the simulator the
image warps and this can be detected by
the model which is what the cheating is
so one of the ways we can detect that is
by
introducing warp without
actually having real data so we can have
fake data introduce warp and seeing if
the model reacts and so we have tools
like that that allow us to measure some
level of cheating and we had some
introspection into that
great these are our last three right
down here
i wanted to ask how your model training
process scales or doesn't scale and this
is my ignorance on machine learning in
in general when you
iterate on your model are you throwing
away the previous model and starting
again from scratch
like if i had a new human driver 16
years old and they had an oops a
collision they would learn from that and
move on and become a 17 year old driver
instead of 16 year old driver but
i'm curious if you have to start that
over
and if that has implications for scale
and the the kind of long tail of weird
little problems you have to figure out
to reach true self-driving right so
yeah so that's an interesting question
currently we train everything from
scratch
most of the time
it doesn't cost that much time so it's
not really a reason to try to avoid that
maybe in the future the training is so
costly that it makes sense to start
training incrementally uh
um i don't foresee that happening soon
we don't seem to be that limited by the
size of the models right now but if we
do have to scale the models to get the
performance we want then maybe
incremental learning is what we want to
do
uh yeah um so
uh
i know that you know eventually you want
to get to level five and
you know ideally you would be there
tomorrow
um
and then on the other hand some
companies seem like they'll maybe never
get there like waymo
um
what's like
like what what primarily is influencing
the velocity of your model improvements
right now like what what work inputs uh
do you find are
like the biggest barrier to like getting
to that next major milestone for you
right now
i think if i were to list one limiting
factor it would just be the
infrastructure to test the models in how
well we can predict that they perform
so
if we have tests we can run immediately
on a trained model and immediately says
it messes up in these ways and it's good
in these ways then it's very quick to
iterate on that
and i'd say it's building these tests
and building these metrics that is very
time consuming and if you mess it up it
costs even more time because you find
out later and you have to go all the way
back so i'd say the quality of how well
we can evaluate the driving offline with
tests i think is one of the limiting
factors
so you mentioned this bug that you had
with the
mapping continuous lines to themselves
individual odometry how did you fix that
bug
so we fixed that bug in particular by
doing some basic filtering on the old
features that are tracked so we do have
a gyroscope which tells you how the car
is turning and we have some gps data
neither of those are accurate enough by
themselves but they're accurate enough
to just do some basic filtering throw
out really bad orb features and then the
ones you have left are good enough to
deal with the rest of it
i'm coming so
harold told you guys a lot of things
today
but there's one thing that he didn't
tell you guys and that
it's his birthday today
[Applause]
so
will you all join me in singing happy
birthday to harold
happy birthday to you
[Music]
happy
birthday to you
[Applause]
i was gonna try to eat this with my
hands but that seems like a mistake
you
we're trying this again we're going live
I am going to fill the questions
[Music]
[Music]
now
and then we should write in
functionalities where the car is driving
so similar to what the peyote and so
right now the device that you see and
this is what right now the only devices
possible pilot but we are very opened
and like more and more devices that
actually could support the support of a
part which is one main reason why we
move the pilot of this sort so that
people can actually port it they're
aware
we have any plans to use that or did you
actually use any simulation when you do
that with payment system or is it all on
life days we might know we do we do is
already simulator so we do use
simulators to plan regression tests to
develop our features it was like we have
to use simulators so my cartoon again we
extensively use simulators but the
interesting simulators that we are
building is the simulator that we hope
is gonna allow us a flying personal
learning to try this is kind of a
different simulator that requires us
having like a very good understanding of
the surrounding and then creating a
system where the car can be
automatically rewarded if he drives well
and being like the same honest when he
doesn't drive well automatically
understanding how to drive this is like
one of the research projects that we are
working on which allows us to add like
other models more scaling and having
more leverage of the data that we have
without having to work all the features
for planning so it's some sort of like
how do we copy apply machine learning to
the block if it does like the planning
of the Sodra here and so this is what
like simulated everything
can you select the particle of
communication in SoCal's like a
different light it's use the way that
these issues communicate with each other
is true and is a and protocol which is
they are coming up communication area
network I mean my hand itself is off the
network like you can't like any as I can
as can portable communication seems like
many years it's actually mandatory to
use to your scanner since I think the
eight is so now I mean you have to have
physical access to the car in order to
have like any sort of like issues like
issues like devices that are connected
on internet and yes you have to be you
have to make sure that you cannot ever
you are going to have a tax through the
internet connectivity of your device yes
our device is interconnected and that's
how we yeah you know the same thing
basically that like the same processes
but like many many many many cars like
software software like on the same
problem as before we're gonna see more
and more cars having capability of being
like updated over yeah right this is the
kind of thing that we believe it's
absolutely so it's kind of like we
believe is like super strange they're
like $30,000 object that you buy today
cannot be updated over yeah like if you
need a software update and regarding
like safety yes I mean of course it's
our concern right but like how many cars
have been act in the last like how many
classic you or they have been hacked and
they made some damage because they be
not
I had heard about about one so it is a
concern clarify what she said earlier
about reading the censors so if there
whatever sensor suite is in place for a
task that comes are you're able to use
those sensors and incorporated into
quick and then towards the answer you
were saying about items that are
available for purchase you mentioned
something about if you wanted to know
more about positioning of your vehicle
what how precise is what is it
so do you some lousy oh so it's like so
this is like you blocks I'm not sure if
you are familiar with this use like a
new blocks processing antenna
wherever you have access actually to all
GPS and so thought about like how much
post processing you do about it and you
can get like very precise that you can
actually like you use the correct like
post processing and so in this regard
okay this is like a little spoiler but
this week we're gonna release idea here
so this week we're kind of like there's
an engineer like our health organization
who is actually going to going to make
an open source of post processor or GPS
data and get like the best across it is
you can get the type of response team I
mean like so no micro GPS as opposed to
regular
the difference Thank You procedure yeah
well so we do the post-processing not
assuming that you do like any vision
feature magic which allows you to be
even way more precise so just by GPS
a-gps processing and some sort of light
filter like you're playing a Kalman
filter and you're like sense of a like
accelerometer you can get between like
helping me there procedure well you
would be able to localize all but if you
have the map that you can centimeter
across because once you know which lane
you are into then you just have to find
like some visual feature like line lines
and localize yourself within very are
totally within centimeter within the
lane lines so yes I mean this is not
assuming any visual organization if you
want to use visualization then you can
get like centimeter accurate because for
example I necessarily you know which
lane which lane you are into you see
where the lane lane lines are and then
you just localized yourself relatively
to the main lines for which you
perfectly know the position because they
are on your high-definition maps and
then you can organize yourself at least
in one dimension which is dimension that
matters within like Yousaf meter how
much is it obviously like subtyping to
me that I really like
[Music]
but I'm funny that I'll commute that we
post-processing yes we're gonna lose the
tools do I should achieve that and this
is all every all the software that goes
into a source yes
oops sorry we have our Canadian crew
that's downstairs so maybe I'll have a
tour
film you guys while I go get that
Canadians oh sorry to interrupt
yeah he's talking there's there's 24
people Greg can you do me a great big
favor can you hold them until I'm back
I'm just gonna run to get the Canadians
you know
[Music]
you know
I think stay the hardware yeah any
thought that might be enough but if it's
not they're gonna replace the hardware
is that still kind of industry
with sooner the thing is something today
whether it's writing applications when
the machine learns it creates a solution
you are you are yeah
[Music]
yeah
I studied like many engineering
I was busy - yelling at bachelor and
then I switched to automotive mechanical
engineers for master I moved to United
States I need some work in the vehicle
so I moved to Tesla Tesla for about like
five six years and the pilot then I
joined I met George which there is the
founder combi and I got very excited
about the project and I'm still happy so
I'm very excited about like the idea of
like solving practical problems like SCU
job I get excited about problems where
is it a huge opportunity of like making
things better and I just see like a huge
proportion of like investment other
sources like overnight level 4 I just
feel like okay well let's picture like
let me chew Stephanie like over a loop
and so I'm excited about solving
problems divide like positive actually
impact on people's life
I understand thing there's issues of
propriety this about people's are so
currently and replace any money
OS in most us jurisdictions in the world
you invalidate warranty do you have
plans to so obviously I said before like
our our plan is to work with it is to
work with humans player we have to work
together like in order to make apparel
successful we need to ship it like we
need to work together to yes and so yeah
this is the plan like the plan is like
it's not in part in anything like the
work with aftermarket product it's
actually working working with them and
working together like exchanging
information about like how there are the
interface of the cap works and making it
compatible like what I'm saying
compatible at the point like they do
with the polar project they're trying to
do the same thing I think like their
approach is the totally different from
us we try to make it working on tasks
that people own which is why like we
want to make it accessible right we want
to make like open pilots something that
people can access and so we to like
definitely try to achieve our end goal
but the way that we're doing is very
different like we try to make it open
pilot working on to the ACE car there
try to make a map I like they are polar
projects working on we with cars that
cost more than $1,000 and just research
projects and so they're like and it only
works on like very heavy computers like
we use by consumer we use things that
you can find in focus liking the smart
phones you can buy today is they argue
that is sufficient to run a pilot so the
direction is very different we try to
value like accessibility
and orally like transparency and early
adoptability of the features while while
I think Apple is taking more like and
testifying like something that means
like very heavy they basically didn't
consider like any constraints in term of
like a car accessibility and so the part
to get there is different we have seven
million miles we plan 12 like people
live in a year they said like more than
100 ma and 100 medium eyes I don't think
like the polar project is ever gonna get
close to that like Apple is now gonna be
able to define their own HD maps on
different the day today their devices
collect because the amount of people
using their devices is it's possible
it's possible but like I mean okay so
which which which hardware do they need
that do they need like they need like
lighter so do they need which I mean
like I have not seen like a car driving
with the poor law and having like
satisfactory level to system so like
I've seen like they most of their
expensive cars with gliders coming
Estrada so Atlanta car probably driving
at the polar but like it doesn't seem
like they are on a part of ship ability
in terms of like are they on a part of
like shipping their product anytime so
they are they ready to ship it anytime
soon so we try to behave in that sense
by developing it on cars and
hardware that can be found today's today
development cycle automobile if it sees
five years for to build into a car etc
and you're talking about level two and
hopefully level four will have taken off
and completes at least in some parts of
the world then what is this selling
point so if I'm in Tier one or I'm an
OEM what are you going to tell me that
is going to make me say yesterday yeah
so before they said that it's not gonna
make like mockingly majority of people's
life that they're it's only gonna work
like in very limited environment it's
not proven to work yet I know like way
manaus that they ship this month like
they are their first like project
program community like a tire behind
behind the wheel economy works we very
climate where they're like in Arizona
I'm not like I don't think like a level
four he's gonna he's gonna anti
ownership this is like the main point
like people are still gonna buy cars for
many many years like decades from now
so the problem like we are not competing
with wait wait we are not competing with
with this idea of like creating data for
system I actually oh but they succeed
I'm not so sure they gonna make people's
life better because like partly san
francisc is like traffic is traffic is
the main proper right and so making
transportation cheaper in cars does it
make talking better now for is gonna
make it worse like it's probably gonna
make like way more working some assist
people and me is probably gonna make
like our commute board it's coming the
public cheaper third wars like it's
gonna spend more time job so
I am saying the comet doesn't try to
make commuting cities cheaper he's gonna
try to make it better but not cheap
he's not trying to make your commute on
highway definitely better today I just I
just think like trying to solve like
think that is trying to solve we could
be solved in different ways maybe better
public transportation like we already
have what we need
not so sure it's gonna solve practical
problems but I'm excited about the
project I'm excited about like detecting
a challenge it seems like a body project
- let's stop there so people can get
some food and engineers are here we have
a we have a shop we have a mobile shop
with us so if you want to get tour
t-shirts if you want to get Aeons if you
want to get your a Spanos whatever Nick
will be working that back there or
wherever Nick outside yeah help your
guys to pizza and thank you so much for
coming like I said people will be here
to continue answering your questions and
yeah
thank you guys all right bye scobie's
I know you'll never be able to hide the
location of anything I mean mostly this
is just showing off how great it is to
work at koumei I still do perhaps the
greatest place in the world to work
that's right yeah to the comments in car
panties presentation yet I was gonna
watch it tonight oh yeah
when are you hiring a support person
when are we hiring a support person
yeah we're not yeah yeah well come here
a little bit far away
we can fix that I'm gonna park jealous
stop talking
are you having a support issue
no I do support so I need you to hire me
you're right we get it
well you open-source your semantic
segmentation no we'll show you the beach
am we clamped out the next year for
commentary
very good at asking the question now we
bought it with all the profit
this way like share their inner workings
very little transparency we have not
common at all
future the future many things be
discussed today yeah
they did all my questions what am i
doing all the primary
or you just get me on answers
let's go bees oh how is Honda Accord
support cats what they want to know no
hey no questions no speech what do we do
when they all offer level to agree well
we I mean that's the only place to go
right you guys know about the green
flash at sunset how is ford fusion
support going well bro I have bad news
for you know you know it's a joke
oh did you hear that I copy
was murder
all right good thing Isis bacon it's
emotional
stoplights are road map yes there's also
no way together
it is burgers my hobbies the flippin
anguish that is JoJo's I have it the
flippin they trying to pee outside
[Music]
it's all just to get people to think
about IHOP again no one's done that in
years
what about just add an executable to
Samantha secretary we don't ships member
we only ship fissioned it
when is it
oh yeah when dry on fire
how are you drinking for nugs you missed
us swimming we already went swimmin
we're gonna put the team picture up we
took a team photo on fire George hire
Wendy social media person I don't think
we have that kind of money guys not my
house you're too dumb to understand what
is grape and to do well white pandas are
white and gray pan is it gray yeah
they're different for a sec I had to
text my friend back
should I tell her we're on periscope she
wants to check it out
really what a lovely place
yeah me too
alright Skokie's we'll leave you with
full autonomy
Tesla fully autonomous by September guys
if that's true we'll closed out
accommodate don't worry about work I
never worry about where we're gonna live
ya know but if you are actually some
full self-driving like I can get my
tassel up by 4 I'm going to fall asleep
here we're gonna we're gonna take the
rest of the VC money by everyone who
works here Tess lager beer shit go for
it
[Applause]
no scope is alright
otherwise they wouldn't know if I jugged
it alright yeah oh you got you got a
pincher with your fingers yeah alright
so it's not full periscope is but I'll
see you later thank you for joining us
become AI off site give me a job at comm
a I'm gonna come work here
we're are only five people that's what
we decided you do I do I really do oh
can I ask me let all right later guys
now I know your scope he's like being
horizontal let's go be alright alright
guys so this is this drive is to
determine whether we will be awarding
energy behind a Bosch bounty or not know
what it might be
[Laughter]
we can always baby ever try to always
maybe here we are driving in our on
their awkward
aarrr 2.0 litre awkward yeah
so we're using a petal procedure wait
well he's fine yeah you have to restart
after he stopped yeah yes oh really can
we spend the button well yeah so the
public yes I want to do it before
emerging yeah the public we spamming the
button is that so if you press it so if
you press it multiple times then you can
increase the speed and so you have to
press it when they go in stop this
you're gonna be seeing I'll stop okay I
start to bother why don't you guys see
yourself instead of dealing with
adership
what am I here how is how is Ottawa why
do we do it the way we don't do it our
ourself instead of letting other people
doing it why don't we do what deport Wow
well the bounty program was we're
winding down the bounty program but it
was a nice way to just pay some money
yeah I mean we don't have what the cops
do right so we didn't have this car
before and the 90% of the cut was done
it's great like especially for these
people to maintain the car afterward
yeah if we want to bring in some of
these cars make an official we were I
have said we're only doing Honda's in
Toyotas officially everything else we're
gonna kind of we change up the back
carbon whole now we're gonna do James
officially jail yeah so Honda's Toyota's
and GM's
so like right now I just engaged like
that shouldn't be allowed I shouldn't be
allowed to engage it stopped about well
so disease unfortunately we don't know
like we can't detect it because it's
deceased like we don't know if there are
objects change that I just made
necessary like before I wasn't allowing
the system to engage even behind the car
because we talked there were no objects
but that's there enough yet yeah so I
changed it but I'm surprised that the
actual system allows you to engage
yeah me too yeah sure well to be fair
you're stopped so even if you release
the brake it's not gonna move to Allah
brake
well that's fine remove right yeah
because we're in stopped yeah well is
there a race like what if I see that's
weird
yeah it's it took so long to say stopped
yeah like I was a race condition well I
mean whatever special stage all right so
carbon tax
anybody should just go there straight to
stop stay in transitional place guys you
know I'm excited for tomorrow I can see
all of it on the heads-up display here
too which is pretty cool yeah um it's
okay if it's like the I think it's like
the C because X era yeah
does it have it has Honda user we don't
do the special user stuff like we do
internal NGM no no yes I tried it it's
like accelerating it also seems to steer
down to a lower speed not much power
it's not I think it's lower as far as
the below 5 kph it sends out the state
that I didn't see before
step 3 and maybe it's day three even
four massive torque
oh cool state mad and but that's like 5
kph right that's much better
but I'm not sure so I like that just
engage on gas for it wouldn't do that
the video exactly scope is what were
there fantastic
like that like the Honda for good I feel
very safe with
that's nice I cool
hey guys it's looking pretty good so far
we'll do our standard Allu yeah put test
against Iran deal on maybe they're
protesting against people trying to make
housing affordable cheap housing
overpriced what do you think of
Microsoft blankie table neutral on it I
know I don't have much ill will toward
Microsoft um I mean like you can say
like Windows was bad but like no in 2001
it wasn't it was the best thing to use
right we use Azure okay about it
um I hope they don't like try to
Microsoft to fire too much but
what could make it get home better off
they put good search back in but search
to begin is too much it wasn't like
seven points I simplified to my steel
man mr. macho you get shit for you
finally becoming a million dollars yes
ping-pong anger why does the boss just
is also sending this this ping-pong is
pretty bad
well it was like a bit offensive because
that's the Bosch system not us the
wobble is yeah well I mean it's like it
was like shadow not shadow
yeah mounted there with the rearview
mirror removed or lovely we can't
officially tell you to remove every
mirrors but that's the lovely Aeon
placement right there
like Africa is back up camera now
you want to see me no idea just use a
side mirror yeah
I just take up they take up valuable
window real estate if it could be spent
on screens
there's a ping-pong game just bad like
that 45 has been highway 10
no I think it was but see well you know
what I don't like we can't get anything
about the what okay so I just looked at
that I freaked out for a minute I'm what
you're talking see the car doesn't see
the car yeah I see that's the problem
wait but it must see the car cuz how we
doing that clipping
well that's vision base yeah I think
it's a vision but you see the problem
right but it makes it more this is
pretty good I'll say it's not vision how
are we getting the distance to that car
energy energies online how are you well
you're doing it somehow do you see oh
mercy it's just luck with our speed yes
[Music]
okay I don't like that I mean I don't
like not being able to see that heads up
[Music]
I'm gonna try my best to hack the radar
guys I have something else to work on
you're gonna love it it's gonna be great
but we had some great things planned for
you guys no very very exciting things
not just new models but new models will
happen too
I really like this that's not just
binder yes yeah yeah you can send it I
said it on there as copies can see it
but like there is a display
but we display the much rather stuff for
this no because that violates the
purpose right
but we couldn't we at least get one bit
of information about whether there's
meat all right yeah yeah we do me after
that I did that
where's that turn so bad and what no I
think maybe we don't then why did it
and is it going - max - ours is a tuning
finger no like a tuning is the same as
the Civic and it's like the city is it
the same event yeah
I really felt as the center
that victim was less on the highway
I didn't feel like it's a lot this is
not supercruise quality not even close
oh come on don't get that ping-pong okay
so it does torque yeah
wait it's a steering temporarily
unavailable what no but just because you
all be riding is that what do you want
oh okay okay that's interesting yeah
yeah
not before it doesn't beep when you over
I just keep it a warning when you hear
the beep
the torque is crappy yeah I think we got
why am i why am I Oh guys you you didn't
do it in experience the GM torque yeah
the GM has torque it has low latency
there's only two by Cadillac ct-6 s and
then you'll use super cruise to be like
not by the end of the year you'll be
like wow
don't you wish Jim can update super
cruise energies right that this is half
of the target that we use in our city we
have lead Civic Torquemada lead Civic
Torquemada
the posh ACCC is good yep
much better than the other yeah
when do you expect to be better than
Superboy's end of the year and to the
Year Bowl so we're gonna roll it I'm
gonna roll out our maps before then so
I'm gonna be better than supercruise in
the highway everybody is the same but
he's not the same affic strategy
right-hander required
you don't think we have time oh well
Vasquez knows this right now yes I mean
[Music]
therefore power check it out
we've maps be free absolutely
as in beer or lunch or whatever they're
good for us I don't think we're going to
quite do dedication at the public domain
I think we're gonna have an attribution
clause but other than that we'll be
completely the super gross tight to take
a seat
I've seen it disengage for exits but no
it never tries to take it's all based on
the map like the curvature of the road
is to turn to driving happens to seams I
mean it seems to me requires at least
the one lane line
we've looked at the lanes you can look
at the laser just on the canvas so we've
looked at the output from the mobile eye
quality oh yeah so yeah there was a
lookout steer fix yeah just don't send
us the well no don't send this steer
enable beat to zero when a steer command
is actually zero anybody found found a
bug that was affecting these cars yeah
well this gets us what so this is the
Accord what else these guesses the
kohrville the new CRV and over the third
car was a tough car and you helped me
out so I call the CRV 5g and oh the H
back yeah so we're gonna we're gonna
make we're gonna make an official comma
Bosch giraffe oh yeah I'm gonna add an
Ethernet connector we're gonna add a
comma power connector to it
girls are for sale eventually
[Music]
yeah we needed you're awfully job we did
power because these castles in the right
power constantly to advise
I see ping-pong here is it is it a model
park or well let's see I need to see oh
wow yeah likewise but you shouldn't do
that
Subaru's doesn't own a transaction
you don't like that it doesn't fit I
just use the car this is the car better
job well I'm having a really bad GM ACC
breaking events I got the gossiping
strong ones you got goes bringing GM
with this one missed yeah yeah yeah I
got a couple of the other strong one Wow
pretty good something yeah
I guess
maybe we should try to figure out how to
work my torque into the UI
how to somehow like they that did where
the talk is being applied yeah
yeah
yeah we I think I think we are we are
spoiled to by just how much better in
our Civic us yeah
[Music]
as your team able to compete with large
companies like Tesla it's just your own
Talent
Tesla's my child people - it has think
about how a Pikachu competes with an
Onix
quick attacks agility
a lot more probably slips through the
cracks of Tesla - and a lot more kind of
kind of crap anyone complained about in
this last letter we don't uh real tight
graphic over
yeah I mean we also have laws to do
right like we're not building your car
oh the stock wait so we're just
forwarding the lane detect as well but
we're doing our own oh no no that's
foger that's ours or well the lanes I
think we are sending our sure that there
are different packets yes it should be
their stuff it's being proxy by unser
it's actually there can message because
look the lane departure warning is
working out there in departure warning
yes it's working top of top of that
what's the top of this okay well that's
cool
I think it's a different message
but yeah they need about your work so
this really needs more torque like the
Toyota has no problems here
what's a replay everybody do we know the
Italians card it's the same one Oh
what's the exact same Minister justice
ever yes okay and it smells a melon ah I
like the steel here is a little
different it's definitely not the same
but exotic same as zero this one sells
like a different status that could be a
tuning um like the Acura and the Civic
have completely different steering
program they don't share a single line
of code they made by a different company
[Music]
really does not like standardization
which I don't understand well energy
says it's defined what its different
steering state module
I really have to do a third back so wait
you're saying that like the Aqua and the
city done share knows you deserve it's a
completely different processor
completely different manufacturer
they just kept the same API yeah
it's gonna be our demo car for the cross
yeah he doesn't even think it's the same
motherfucker well it might be one of
this he might be back there I mean we
can't read it we can't use this is a
press deck my car
one better yes wait I I almost like ours
breaking to a stop more than me breaking
to a stop yeah no I wonder one of those
days like we went out with like the
newest MPC change just like wow oh
that's actually good the same sort of
right message well I don't know that
this car
can open vitals work with the Tesla the
old Tesla yeah there is a fourth kind of
working on it but we're never gonna
support that main line yeah we don't we
don't compete with Tesla it's it's kind
of like think about an Android port for
iOS yes one was done and maintained by a
few people but in reality you're on iOS
under I'm sorry I never record for idle
so that's why
it's getting that lightweight over there
it's like hard it really like switches
yeah I think that's a you're really
getting a couple foot change to them yes
well the new one thing is old I know
what
the new model is trained using all the
same stuff that we use to make our maps
so if it's mapping quality it's
certainly model quality
like all the lanes just come from the
same plant extract abuse of maps
what's the verdict so far can tell if
the complains means it's bad news oh you
get about me I know it's not good it's
on par with some of the other cars I
just generally Drive about how open tile
it should be better but I think I would
have a lot of these same complaints if
we went grab the Civic and disabled
some of them are specific like not
saying I mean the biggest complaint I
haven't really is not saying weaker and
breaking being kind of crappy and my
biggest complaint is the torque guys I'm
who can I contribute to that bounty for
hacking the torque terrible yeah it
sucks that it's dangerous guys oh you
wanna see dangerous oil you see the GM
do we post we show the scope is like the
real Jam torque yeah so the GM message
God should we tell them this they might
no one has that car okay we're good so
you can send the message from zero to
150 and that's like the Lane Keeping
Assist and that's like similar torque to
what's in the Toyota but then if you set
the supercruise bit you can send up to
300 300 torques is a lot of Tours yeah I
never seen it even in the angle control
for the angle interface parking he was
focused on oh yeah I was like bouncing
at the end of like you showed me that it
was unbelievably strong
I don't know I mean do you think GM have
you ever seen to go above 150 I don't
know I never seen going above 150 but
never supers I never see anything didn't
like I looked at to long routes and I
never seen it going about 250 so I would
not be surprised if they have the same
safety we do yeah
all right they're just like well we're
gonna put it in the thing Oxford mean
aunt Cass it's like if you send 150th
high speed it's gonna flip out so you
know Cassie definitely has like
different safety yeah that's super gross
I was very hard to work with that gas on
the Cadillac we can use that's fine
alright guys so yeah we're gonna
upstream this at the end of sprint so uh
ten days Tom will pay out the bounty
energy if your watch off half the value
right now I'm eternity merchant or
internal code base
congratulations you have the second car
big bounty Claire not that big it's too
good that's a respectable $2,000 oh yeah
nice job we'll get this out and that's
it and that ends the car bounty program
we're actually on there's still one
bounty available Toyota Camry
if anybody can do the Toyota Camry this
is still a bounty available for you um
you do why should we do lateral only
only Cameron Kelly was it you don't
lateral only on the Camry pretty easily
right well I think so yes because well
but people if you do some proxy where do
we attack so well it's no that's fine
it's fine we should be able to do like
lateral and easily matter only but but
boxing is probably our first camera yeah
dress supports that I think maybe it's
kind of going with the radar
Robert Lee slaughter should be able to
no problem yeah I don't know sense the
lateral control but I'm pretty sure
it'll be the camera yeah yeah we're kind
of okay with shipping some lateral onlys
what we're going try to make loans you
did another one on these guys that's
alright
if its lateral only it will still ship
look at them rocking out depends by on a
bike with big headphones on cool alright
alright skull piece when will we start
selling boss giraffes we make them open
either puppies gonna come sooner maybe
after the tokens
[Laughter]
What up, Scopies? I got Con shirt on
today.
Let's wait for a few people.
Uh, so while we wait for some people to
get in here, I'm going to flip you guys
to the other camera
and I'm going to show you my brand new
desk.
Who wants to get localized? Oh, does a
localizer work well? Yeah, we're on the
Periscope. We're talking to Scopies. My
new desk. Look, this a standing desk.
You know, I'm even going to put my phone
back in color for this.
Color. Okay, cool. Okay. Um,
but yeah, I mean, we're partially here
to show for the new desk and the new
beautiful office. No, I don't really
stand. There's no way I'm actually going
to use the standing desk. I'm honest.
Um, do I play PC games? Yo, I play Age
of Empires 2 and I play Super Smash
Brothers. That's what I play. Yeah, we
got to play. We got to play, man. Um,
but yeah, so check out this is the
internal shop.com.ai shop.in
internal.com.ai.
Um, check out the pandas,
the eons,
couple of paws, few GoPro mounts. We got
Wi-Fi modules.
We got a Kama over here. Um, oh, look at
the pedals. Here are some pedals for
some cars. So, the one on the left is a
Honda pedal and the one on the right is
a Toyota pedal. Who is disappointed by
the Toyota pedal? Look at it. It's kind
of disappointing looking. How much
hardware products is too much when you
have enough hardware to make your car
well to make driving better? And that's
really what we're here to talk about
tonight. It's got a greenish tint to my
camera, so the white balance isn't
working well. Um
yeah, we just uh everyone got $100 to
improve uh their desk. They can even
spend it on chachkis like Bab
bobbleheads. That's okay. That's okay.
Um we have this is a this is the this is
the ECU that I bricked in the Toyota. Um
I unbrricked the one that's in there,
but I bought a spare one.
Okay, let's get to the main topic. How
can driving be better? This is really
We're going to try to have a
conversation on Periscope. I don't know
if this is going to work. But the two
things that I think of when I think
about driving, I think about it's it's a
lot of boredom interspersed with a few
moments of stress.
So maybe you can focus on these two is
like kind of different regimes. You want
to alleviate the boredom and you want to
I I think what you really want to do
about the stress part is you want to
alert in advance,
right? things are a lot less stressful
if you know you're going to get an alert
beforehand
um that something's about to about to
happen, right? The real the real thing
that keeps you on edge and kind of what
anxiety itself is is a fear of the
fear of kind of the unknown like you
know that you might have to do something
but you're not exactly sure what. Uh
fear is like oh I'm afraid literally
that there might be you know a mugger
down that alley, right? You're actually
afraid of something. Anxiety is you're
just walking down the street and
something feels a little bit off, right?
So, so stress stress and and and well,
anxiety leads to stress, right? So, how
can driving be better? We have to work
on alleviating boredom and alleviating
stress. See, gamification
I wonder about that. I wonder if that's
the idea. Um,
if you want to gamify like maybe it
makes it more exciting. So, okay, we we
we'll add we'll add that as an idea.
Like, how can we make driving more
exciting? Is that what we want to do in
the first place, right? Like, there's
kind of two paths maybe you can take. If
you guys read Alex Royy's article about
like the human driving rights manifesto,
I thought a lot of it was kind of eh,
but um well, games cause stress, but I
don't think they cause anxiety,
right? Um so so you know this stress
leads to anxiety
and this is a big problem in the modern
world and really what we want to
eliminate right
um dopamine release when uncertainty
rewards. Yeah. I mean it's kind of true
and that's kind of that's kind of
sketchy. I'm sick of wasting my time
driving. I mean yeah that comes really
back to the boredom factor, right? Like
the idea that driving is a waste of time
really has to do with boredom.
Um so I don't know. I mean, I don't know
about about uh about more exciting and I
shouldn't put a line to anxiety because
we haven't eliminated it yet. So, we
will erase the line and we will come
back up and uh
yeah. Okay. Um
yeah.
Did you guys like the last Periscope by
the way that we had an actual like the
rest of the phone up against something
so people could so people could see? How
do you guys feel about that?
But okay. So, boredom. People want to
drive less. Hello, JustJ Jess. Uh,
now this is this is there's lots of like
this is scenarios that are particularly
boring. Um, long drives in the highway
when you're not doing much. Camera like
this was great. Okay.
Um,
yeah. Okay. I mean, you guys probably
can't see the board then.
Oh, and now I can't see anything for
Periscope. Yeah, the front camera. Okay.
You guys like the front camera. Um, we
can we can we can go here. Life swings
like a pendulum backward and forward
between pain and boredom. That's a
that's an all right quote. Um, but okay.
So, how can driving be better? We want
to People like the rant ones more. The
rant ones get a lot more views. This
isn't a rant. This is talking about
improving the world, people. Um, now
see, this is hard to do. Like you can
see me now, but it's hard for me to hold
the phone out here. Okay, let's go back.
So, so, so let let's do you guys agree
that there are so boredom I mean a fix
for boredom maybe we'll we'll do it like
that. Like a fix for boredom would be to
make driving uh more exciting and a fix
for for stress and anxiety is basically
reliable alerting.
Um, if you know, I mean, you might
become anxious about the alert, but that
has more to do with how the alert is
designed, right? If the alert is like
something terrible might happen in 10
minutes, then of course you're going to
have a stressful 10 minutes, right? But
if the alert is, you know, literally in
15 seconds, you know, that guy is looks
like he's coming in too fast. Um, just
make sure you hit the brakes, so you do
this. As long as it tells you exactly
what to do and you're you're good about
that, right? And this is obviously all
before we get to level four or five
because you know that stuff is mostly uh
it's mostly fake news um when you're in
a way most cars not it's not safer than
people right it's it's not it may be
cheaper than people but it's not safer
than people plan exchange responsibility
of driving AI drive for easy parts only
make it commitment I don't really know
what that means
um so well the other solution is the
other solution instead of more exciting
to the boarding problem is something
else,
right? Like what if people could just do
something else
way? What's that? Like lai, like the
PewDiePie thing. Um, and the solution to
to stress and anxiety is is is reliable
alerting. So now what would it take?
Well, okay. So more exciting can just
get work done while driving, right? So,
so maybe maybe um you know this is more
exciting you can do easily with level
two right like you don't need you just
want to make something more exciting you
can you can ship ways and that's
effectively you think of ways I mean
ways as a driving assistant right we
don't think of ourselves as really that
different from from ways yeah naps fall
in the realm of something else so that
would be level three level three is um
you know when the car gives you enough
of a warning to my waking up for a nap
is kind of uh it's kind of loud yeah
shout out to energy for getting the
reported. Uh, that's awesome if it's
done. Wait, wait. How'd you do that?
I thought the Camry I think there's a
bounty for that one, right? That one
doesn't have a DSU.
If someone managed to get one of the
undsu the DSUS cars working, we'll do a
we'll do a bounty. Um, but yeah, so
reliable alerting
depends how reliable.
Just lateral. Okay. Um, reliable
alerting is is L2 and L3 and L4
depending on how reliable uh you want. I
guess actually L3 is already full
reliability. Um, L4 would actually be
able to do the scenario for you. Um,
maybe yeah, if you want alerting, it's
L2. If you want reliable, it's L3.
Uh, still using stock ACC. Okay, so it's
using lateral with with stock ACC.
That's pretty cool. That is pretty cool.
Maybe that's half the bounty. I don't
know. No, I don't think that's about I
think the longitudinal is the hard part.
Um
but uh yeah, radarless stuff coming
Sunday. Um but yeah. Okay. So, how can
driving be better? We want to do Am I
missing something on like the bad
column?
Some roads are L2, some roads never L4.
Am I missing the like maybe, you know,
we'll we'll divide this. I just got new
markers, which I'm really excited about.
Look, I have like all the colors of the
marker spectrum.
Um, so that is very exciting. Uh, okay.
Maybe over here on this side we'll put
the problem
and over here on this side we'll put the
solution.
Will there be alerts when no lanes are
detected? No, lanes are going to go
away. Lanes are stupid. Will there be
alerts when it's not confident? Yeah,
there should be. There should be and we
can we can work on that kind of stuff.
Um but yeah, so am I missing anything in
my in my taxonomy?
Like what's what else is wrong with
driving?
Think about the city. You're constantly
having to pay attention to seven
different things or you think about
driving on the highway and just you know
the crushing the crushing boredom of
that.
Um,
suggestions, people, suggestions,
people,
other drivers. The problem is other
drivers. Well, I mean, I don't think
other drivers cause boredom. I think I
think other drivers fall into the stress
and anxiety category, right? You're
you're stressful or anxious about what
other people are going to do. Um, Uber
drivers, attention divide. Yeah.
Inability to be otherwise productive. So
that's that's that's a boredom thing,
right? That's that's that's the boredom
problem with driving. Always other
drivers. Yeah. Other drivers are
terrible. I mean, you know, people like
break down problems. Like people talk
about this like in in politics. Um you
know, there's three types of solutions.
There's solutions that need few to buy
in. There's solutions that need many to
buy in and solutions that need everyone
to buy in. The former are likely to
happen.
The second are unlikely to happen. And
the last is completely impossible.
you'll never ever get any everyone to
buy in. You'll always get defectors. So,
I don't know what we can really do about
other drivers, right? But we can put it
over there in the problems. Um I mean,
you know, you can have like stupid crap
like like, you know, maybe Nexar will
say like, "Oh, well, you know, we're
going to build up a database of drivers
and then the thing will alert you when
other bad drivers are in the area."
I don't know about that. Like, it's just
not going to be it's not going to be
it's not going to be good. You're not
going to be able to do that kind of
stuff. Well,
um, detours, construction. Well, is that
a problem? Yeah, potholes. Actually,
that's a good one. That's a good one.
What what potholes and stuff fall into
is the problem is like the physical
motion of the vehicle,
right? And bumpiness.
And that's fixable through a lot of
electronic solutions.
Um, potholes is comfort. Yeah. like like
motion, bumpiness, comfort, um other
drivers and traffic. Again, the problem
with even like really thinking about
that is that's not solutions that you
can that you can individually build. And
anything that requires buyin from a lot
or everyone is absolutely impossible. Um
so I I think that we're just going to
strike that one off the list because I
mean here's the thing, right? There's a
certain symmetry in other drivers which
is you know everyone hates other drivers
but
you are an other driver.
um scope of what you look at. I'm not
sure what that means, but but this can
be this can be fixed, right? So, this
can be fixed with better controls.
This can be fixed with active suspension
pension.
Um there's cars that are doing it. I
think the Maybach has this like dual
camera system that's supposedly reading
the road as you go. I I don't know if uh
if that if that works.
Field of view of human versus machine.
So field of view is not like field of
view is a problem. I mean it's not a
problem with driving.
Um it's a problem with specific
implementations of driving you guys.
Like you know field of view is is it's a
really easy thing to fix. Just stick
more cameras on the car. Notice how
Tesla has solved the field of view
problem. Yet autopilot is still about as
good as open pilot. It's It's not The
problem isn't more cameras. I mean, the
solution, sorry, not the solution is not
more cameras, but like field of view is
not really a problem. Um, but yeah, the
motion bumpiness and comfort, that's
that's a good one. That's a good one.
You can literally make the car
experience better. We can do this by
breaking better. We can do this by, you
know, if you're localized well enough,
you can avoid potholes. I you can like
have a database. You can know exactly
where the potholes are. You can active
detect, right? Um, I mean, think about
it. If you guys have gone skiing, you
know, uh, you always head for the smooth
snow, right? So, you can detect smooth
road. That's that's an interesting it's
an interesting like cost you can put
into your driving optimizer.
What? You're having trouble spending
your $100? I'm at 60. Did you buy a lot
of chis?
Identify potholes. Notify the city.
Again, I really couldn't care less about
like, you know, fixing the problem like
that. I think identify pothole, drive
around pothole. That's what humans do.
But what if you did that every time? And
what if like you could like drive around
micro potholes and stuff, too? What? I'm
going to I'm going to talk to the city.
Oh, I'm going to like Oh, yeah. I'm
going to talk to the SF mayor. This
sucks. What sucks? This Periscope.
Sorry. You don't have to watch. Go watch
PewDiePie videos. They're pretty fun.
Um, but yeah. So, what what is the
question? I mean, what else? What else?
I I liked the motion, bumpiness,
comfort. Yeah, that's a problem with
driving, right? So, what else? What
else? How can driving be better? That's
the question. It's at the top. It's a
little bit washed out by the lights.
What are we doing here? Well, you know
what we're doing.
I mean,
everybody saw the Gen Zero hardware.
demoed it at Vegas. Everybody's noise
cancellation. I like that one. Uh
drinks. I mean, that's a that's a that's
a
uh Wait, let's let's uh wait. Sorry.
What was what was that before? What was
the one I liked before? Drinks.
Periscope doesn't let me scroll up.
Um I liked that. Waste less fuel. Okay.
Okay. Cost. Yeah.
Um, in general, people are willing to
trade off cost for convenience almost
always.
So, I'm not sure
how much can really be done there. Oh,
what was the one I liked? I forget it. I
was going to write it. Who said it? Um,
yeah. But what are we doing here? So,
save gas. Yeah. Yeah. Cost like Yeah,
you could say save gas, right? I mean,
you know, again, no one really cares
about the environment. Some people will
signal that they care about the
environment. Oh, I didn't get water at
the restaurant. I'm saving the job.
Ability to pee in a car. Noise. Oh,
noise. Yeah. I mean, noise probably
falls into the motion bumpiness and
comfort kind of one. Um, so apparently
like uh the Acura has has&c stuff. Um
like Oh, drains without making a mess.
Yeah, that falls under motion bumpiness,
comfort, give AI personality. Nobody
wants that. Um every Oh, come on,
Clippy. Oh, it looks like you're writing
a letter. Oh, an animated paper clip.
Um, keeping sensor clear in bad weather.
That's mean that's not a problem with
driving. That's a problem. That's an
implementation problem. The question
we're asking here is how can driving be
better? Distance.
I mean,
[Laughter]
get rid of Subaru. Distance. That's an
interesting one. I mean, actually, you
know, that's a good one. I I forget
distance. I mean, you don't care about
distance. you care about time. If we
could figure out how to get people time
back so they spend less time in a car,
that's good. Um, a lot of nav systems
are trying to do that, but they're not
that good. Oo, I like that one. I like
that one. Um,
accident avoidance. Yeah, I mean that's
that falls under that falls under stress
anxiety. Anticipate stop lights. Yeah,
again, stress anxiety. Make driving
easier. I mean, what do you mean by make
driving easier, right? Like what's hard
about it? What are the problems? Problem
is it takes time. Problem is it costs
money. Um the problem is that the the
ride is uncomfortable. The problem is
parts of it are stressful. The problem
is parts of it are boring. Raise speed
limit. Again,
the last thing I ever want to do with my
life is ask government for anything. So
what will never work to raise speed
limits? Um I don't know. I don't know
why the speed limits are what they are.
I don't really know who sets them. I
don't know if it's uh
Keep me in a better lane, not behind
this idiot.
I mean, yeah. Yeah. That that falls into
like
that is something, right? And and that
is something it's similar to motion,
comfort, bumpiness, noise. But some of
those are more characteristics of the
car. Maybe maybe we'll call that one
skill,
right? like unskilled drivers, you know,
the kind of person who like slams the
brakes and sell your driving data. It's
not for sale, bros. Um, auto drive
though, or save on insurance cost. Yeah,
I'll put that under cost. Save gas.
Here's generally how I feel about cost
savings, though. Like, I don't think
that that very often drives the calculus
of many things. The number one thing
that makes people do something more is
if it's more convenient, right? Right.
And everyone is like startup stuff. You
got you got to think this way. Push bad
drivers off the road. Um what's the
question? The question is how can
driving be better? Um yeah. So skill and
I think skill is kind of what you're
getting at with the uh you know you want
to not stay behind like a bad driver,
right? Auto react to stock cars. Again,
these are these are implementation
things, right? Don't don't worry about
that. Think about the the the highle
problem of how can driving be better? Or
maybe maybe I'll phrase it in a
different way. What's bad about driving?
Keep driver engaged. Why?
Um is that a problem? Like is that a is
that a something bad about driving?
Um it cost save gas insurance do all
those things if you could use less time.
I mean this is really like you know
magic nav we'll call maybe that's what
we'll call magic nav. Maybe that is what
we'll build with all of our maps. Um,
driving involves attention. Yeah,
driving involves attention. I mean,
that's the that's the boredom problem,
right? You falling asleep while driving.
I mean, yeah, there's movies on the
display. Yeah. I mean, that all falls
under the something else category.
Like, how do we uh
Someone's getting a call. Um, too many
unwanted updates and no options for
customization.
Yeah. You rather not be engaged. Yeah,
I'd rather not be engaged. I don't know
what unwanted updates to cars to open
pilot.
Um,
customization is not something people
really want. Like people might say they
want customization, but in general, like
the only reason people want
customization. The only people people
reason people jailbroke their iPhones, I
mean, there was the piracy reason, but
it really wasn't piracy in the
beginning. And now you can still pirate
and almost nobody jailbreaks. Um, it's
because it was missing features, right?
Like there were key features missing
from the iPhone that you had to
jailbreak for. Uh sense mechanical
problems before they happened. Okay.
Breakdowns. Yay. Yeah, we can we can put
that. We can put that like reliability
breakdown kind of stuff. Um ability
breakdown. I don't know if I'd really
call that driving though, right? Because
that's once you're off the road. But
yeah, I guess it improves the whole car
experience.
Um, I could care less about remembering
the positions of my seats and my
preference in music. Yeah. I mean,
honestly, universal income was that
shit. No, you want universal basic jobs.
You don't want universal basic income,
right? You got to give people jobs.
People need something to do. You want to
make money, you got to do something,
right? Uh, universal basic job.
Anticipatory understanding. Yeah. I
mean, that's to reduce stress and
anxiety. So maybe we'll put that as like
it's not just reliable alerting, but
it's like I mean alerting is maybe too
strong of a word. Reliable communication
is maybe the key here.
Communication with the car. Yeah.
Anxiety about safety, dear ice. Um
all right.
Okay. No one's hacking your car over the
internet.
That's fake news. Don't read the media.
You read the media and then people get
stupid things in their mind, right? Um
V2V, we can talk about my V2V is dumb in
a minute. Like deer and ice are actually
problems. Let me tell you, in my life,
I've had to swerve to avoid deer and
I've slid on ice. These are real
problems. I've experienced them. H Let's
see. My car has never hacked been
hacked. And I don't know anyone whose
car has ever been hacked. I know tons of
people who've hit deer and crashed
because of ice. So those are real
problems. And that's you can tell
something's real or not, right? like you
know it's it's hard in today's world of
uh massive massive amounts of
information. So like V2V is not a I'm
not understanding any of these requiring
V2V to solve, right? V2V are you know I
always talk about how the Eon already
has V2V uh you know it looks at the
brake lights of a of a problem.
Pedestrians are a problem. I mean
pedestrians are a problem in the same
way other drivers are a problem. So
we'll add it to the crossed out one on
cyclists. Nobody likes cyclists man. It
doesn't matter where you're pedestrian
or and no one like oh cyclists.
over V2V chat of passengers. You have
this, bros. It's called text messaging.
Everyone does it while they drive. They
shouldn't, but they do. What can you do?
It's convenient, right?
Um, keyless is a problem. Yeah, keyless.
Actually, I shouldn't say that my car's
never been hacked. It's never been
hacked like that, but it was almost
stolen once. Um, yeah, there's the
interface. I mean, the interface is bad.
Yeah. Yeah, we'll add that. Yeah. Um,
bad interface.
Uh, see, does it go under any of these?
No. No, I don't think so. But like,
yeah, bad interface.
I I I totally agree with that. Um,
we can we can we can we can fix them.
What else? What else we got? What else
we got? Yoga while driving. It all falls
under the something else category in the
boredom. I don't care what you do. You
know, people like who think about
self-driving cars will think about stuff
like, "Oh, well, you know, we should
figure out what the driver should do
when they're not driving." What? They're
going to use their phone, bro. What do
they do when they have a minute to sit
there? What do people do on the train?
Whatever. Yeah, exactly. Drinking and
driving. Of course. Of course. That's
what people want to do, right? Just look
at a train. Whatever people do on a
train is exactly what they're going to
do in a self-driving car, right? I I
don't get it. Like, people think it's
going to be new. Yeah. Massage seats.
You can buy a car with massage sheets.
Just don't be poor in car bar. Yeah,
these aren't like Okay, fine. You know
what has bars in it? Trades.
Is it working well? Not yet. Some of
these have good ideas. We got We get We
got get a whole We got a whole lot of
stuff. Yeah. Um and I'm going to put
this I'm going to put this on our on on
our wiki on our internal wiki afterward.
Accurate GPS and vehicle sensors. Yeah.
Yeah. There's a whole lot of ways to
mitigate sliding on ice. I mean, in some
ways, like ice is already dealt with, if
you guys have used a modern traction
control system, it's super good at
dealing with this and like deer probably
already dealt with by AB uh by sorry uh
emergency
AEB. Sorry, the acronyms are hard to
keep straight. Um, so there already are
like pretty good solutions for those.
And like honestly, those things have
I've never I've never been in a car
during an AE, but I've been in a car
plenty of times for for traction
control. And uh I I just sort of wonder
how people, you know, didn't go off the
road in some scenarios before it.
Gamification. Yeah, it falls onto the
boredom problem. Like make driving more
exciting.
I don't know. Like you're not going to
be able to compete with Candy Crush,
right? So why not just let people play
Candy Crush? That's probably the better
way to deal with the gamification thing,
right? You know, yeah, augmented reality
game for driving and then let somebody
else, you know, put it this way. Let
Niantech build the driving game once the
self-driving car already exists. Make
driving great again. Um, I don't think
driving was ever great. I think driving
is better than it ever was right now.
Um, what you think of Ipace? I don't
know what an iPace is. Is that like a
pacemaker made by Apple? iPace.
I trust I trust that anace would
probably be pretty nice. If I needed to
get a pacemaker, I would probably get an
IPAC.
Okay, guys. The board is pretty full.
We're almost at 30 minutes. Thank you
for joining. Make sure to hit that that
subscribe button. Legalize go-karts. You
should lobby your local people. Jaguar.
Do you mean the animal or the car? Yeah.
Get a new car. Stop being poor. You
know, it's something we always say. Uh
comma steering. Yeah. Yeah. Yeah. Well,
we'll start with the comma pedal. Uh
comma pedals in good progress, but um
Yep. Yep. Yep. Elect Oh, electronic
tolls. I mean again the problem with
electronic tolls is yeah that would make
it better but it requires governments um
building new models okay models are
models will come in time. Um thank you
for joining the how can driving be
better uh periscope old cars with
steering eject button. Okay okay okay
future I bet they have one of those. Get
a eject button in your truck. All right.
Make sure to hit that subscribe button.
Thank you for joining Kama Army.
good afternoon uh I'm Rob I'm part of
the the hardware team here at coma and
today we're going to talk about how the
device is built
so first of all I think a lot of people
when they think of comma they think of
an AI company like we do a lot of
research a lot of our people are working
on software on on machine learning but
fundamentally comma is also a consumer
electronics company like I mean we
launched a new product this is what uh
what funds or development so this is a
pretty pretty important part of what we
do
um it's also not like we're selling like
simple Electronics like we're selling
electronics that that's somewhat
comparable to like a modern smartphone
like if you think about it we have
we have a high quality screen we have
high quality cameras
um we have a bunch of compute to run the
machine learning models we have
connectivity we have network
connectivity we have LTE we have Wi-Fi
um so yeah it's not a simple product to
build
so we started out a few years ago with
the Eon ion was a pretty simple product
to build I mean we basically uh
we didn't really care about all the uh
the advanced features we just we bought
a smartphone like all the advanced
features already in a box we slap the
heatsink on it to manage The Thermals uh
put in a 3D printed case
um yeah it's easy to produce uh it's
it's simple it works but it's it's I
mean it's not really a consumer
electronics product right
um after that uh I think it's about four
years ago now we launched the comma 2.
this is basically refinement of the Eon
um product uh so that the most advanced
features like compute sensors are still
inside of a metal box we didn't have to
care about that but we integrated the
electronics that talk to the car into
the case
we refactor the way that we connect to
the car so we can support more cars
um and things gone a little bit more
complex like we started to have to build
more procedures and have to like make
sure that the changes we made were
tested well that the production
processes were good but then two years
ago we launched the comma 3.
um it was a pretty pretty big step
George always talks about the fact that
comma 3 is the hardest product that
we'll ever have to build and I I do
believe that that's true for a few
reasons
for one
like all the sensors all the the display
the compute the electronics they're all
custom built in-house they're designed
in-house this is something that we'd
never really done before on this scale
so it took a lot of engineering effort a
lot of time improving all the processes
to get this to build
uh not only to design all the individual
customized components but also to
integrate them nicely into one like
little box that looks nice that
functions well
that is a form factor that people
actually want to use
so so that's when we did back then then
this year like we've obviously launched
the 3x the George talked extensively
about already which is just a refinement
of the three with with kind of D added
um it's a little ready on the downslope
in terms of complexity
um
so in the future I think we can go even
a step further once we get to a larger
numbers of devices sold we can actually
start talking to manufacturers to also
get the modules that we still use to do
connectivity like we still use the
Crackdown module for LTE we still use a
system or module as we refer to the sum
for the compute but we can start
integrating that all into a nice device
and then we handle back to something
that looks more like a smartphone
um
again like if we get to those numbers we
actually uh can customize these uh these
these individual components more so that
the integration will also be easier
uh so I think it'll only get easier from
here
so how do we do it now
so there's actually quite a lot involved
in the whole process so
to uh to give you a sense of that I've
made up this little nice design of uh
like a basic life cycle of a product
within company with it within coma I
don't think it's too dissimilar to other
Hardware companies but uh it's good to
go over it anyways so we start with a
concept so we basically think about like
what the form factor will look like
um what features we want to have
uh once we've got that nailed down then
we go over to a design step where we
design all the electronics all the
custom parts the mechanical Parts the
case
then we get prototypes built
then we get them tested if they're not
good then go back to step number two uh
usually we iterate like six seven times
before we get a prototype that's ready
for manufacturing
then we actually can put it into
production
and after that we can ship it out to
customers now if it would stop there
that would be nice but we live in the
real world so we'll also get warranty
returns
um
for the 3x
um compared to the three getting the
concept down was a lot easier we
basically have the exact same features
except for the addition of kind of d uh
we still have the same kind of form
factor of all the components stayed in
relatively the same position so that
that part wasn't actually too hard I've
actually found a picture of the the
Whiteboard where we sat down and wrote
down all the all the changes we wanted
to make
and you know there's
a lot of times we mentioned we mentioned
the word no in the in the feature list
so we removed the pcie lanes because we
don't have the nvme drive anymore
removed the 3.3 Power Wheel so that made
the power actually easier we
we removed the the external siren like
we used the the speakers we already had
on the device to do the siren part
we removed the USB hub because the panda
Now talks over spy to the main device so
it's we removed a lot of stuff and as
Elon always says no part is the best
part so uh that's the general goal here
um
so once we know what we're building then
we get to the design phase so the
biggest part of design I would say is
the the electronics part so the main
board which starts out as the schematic
on the left
so that's basically where we do all the
like we selectable Parts that'll make up
the whole design
um we
get them to work all together like we
think of all the edge cases device might
be in like like when you shut it down
after a while like the power draw needs
to be low like attack on stuff all gets
integrated and fall off when we do the
uh the schematic design
after we're happy that we and we think
that we made all the changes that we
needed to make in the schematic then we
move out move over to the board layout
uh this is actually a picture of the uh
the PCB layout of the comma 3. so you
can see it's it's it's relatively
complex so this is the part where we
place all the components down in a
sensible location
um to make it fit on the form factor we
make we designed the outline of the
board and then we connect all the
components together with uh with the
traces on like six copper layers to get
all the uh the requirements that we want
um
this is actually a pretty manual step
still because there haven't been very
good software packages out there that
can do this automatically even though
you might think that it's not that hard
they can just connect stuff up together
that needs to be connected up it turns
out there's a lot of
a lot of design requirements that you
need to think about for example all the
high-speed traces that carry a lot of
the data from like the cameras to the
compute they need to be impedance
matched they need to be on layers and
further and far enough apart from model
stuff that they don't have crosstalk
with different Lanes you want them to
not have any uh Electric magnetic
interference
you don't want to admit any RF noise
that you're not allowed to because I
might also degrade TPS or all the
devices in the neighborhood but it's
actually quite complex so this process
like if you start from scratch it
probably takes one and a half two months
to get it down uh not future revisions
obviously easier because most of the
stuff stays the same
so let's talk a little bit more about
the part selection because in the recent
years that has proved to become more
difficult because of all the shortages
going on
um and not only that but there's also
the thing where uh
there are multiple Parts on the market
with a similar functionality so getting
an optimal design where you can actually
mix and match parts to get the same
features it's pretty important
so how do we internally keep track of
all like the substitutes that work
together of all the inventory that we
have for production
um like what components all the designs
use so we can reuse the same components
well we don't always need to reinvent
the wheel so we actually found this
software called Parts box it's made by a
Polish company there's this one guy who
writes this in the in his spare time
it's actually really cool it introduced
us to the concept of a customer part
number of CPN I sometimes also think of
it as a comma part number but
um
so this is basically a part number
that's not like an actual physical part
so that basically just specifies the
requirements that we want for that part
to be so we just say okay we want like
100 kilo one resistor that's one to show
now in an 0402 package that's like a
relatively standard component and
there's dozens of Manufacturers that can
can make parts that fits that fits these
specifications
um so that's the parts you see on the
bottom so that's the parts that we can
actually buy and that we approve
uh to be like a suitable part for the
CPN
and we can then order them to make sure
that we have enough for for production
runs the other cool thing that Parts box
has is API access
um
so we also do a lot of CI on our Auto
designs so we can automatically pull
from our inventory numbers and that kind
of stuff and I'll go into depth a little
bit more in the next slides
so this is a commit that I made to the
hardware repo in the last month
finishes rounding of one of the camera
boards uh nothing too interesting but uh
this shows us like all the steps that
are run automatically every time we make
a change
so the first thing we have is it checks
the cpns so it goes over the design that
you just pushed and make sure that every
part in the design actually has a CPN uh
like allocated to it so we don't push
designs where we don't specify like what
a part actually is because that makes it
harder for production like you have to
go back and forth I'm like asking how
much part of the list
so that's that's automatically uh check
that that's uh
all filled out
then the next step is one we added
because one of our earlier prototypes we
made a mistake of putting a capacitor
with a lower voltage trading on a
power supply line that was slightly
higher voltage so uh like in in a few
weeks we would see failures with this so
now we actually have a check that goes
over every capacitor and all of our
designs and checks that the the ratings
are actually uh good enough for for the
use case we used for
um the third step is a fiducial's check
for people who don't know what a
fiducial is so that it looks like this
it's a little dot that you put on a PCB
doesn't have any function in the end
product but it's very useful in
production because that tells the
machine like where the board is actually
located in the machine so it can more
accurately calculate where it needs to
place the components
we tended to make the mistake sometimes
where we would order boards without
placing fiducials on them and then we
would get them into the manufacturing
line it would be a huge hassle to get
prototypes out of them so now you add an
extra check so every time we have a
design and it at least has three
fiducials on the on every board
next one generate gen get files so
that's something that's the file format
that the machines use so we don't have
to manually make that every time we make
a new revision then we also generate
board diff images
so for every commit it tells you where
the copper was added where it was
removed so we can easily like go back
and see which commit actually changed
which uh what what part of the design
because I mean the files look like XML
codes so you can't really see what's
going on with the actual design on
GitHub so this is a pretty nice sanity
check to make sure that you actually
committed what you wanted to commit
um
then we have generating schematic PDFs
because not everybody has the Gap
package installed on their machine so we
just generate PDFs from all the designs
so we can just pull the schematic as a
reference anytime uh we back up some
stuff that's an automated thing and then
recently we've also added the new parts
bot so every time we now push a revision
to a design it checks and it accesses
the parts box API just talked about and
it checks that all the components we
have on the design are actually in stock
like locally
and if they aren't then we just generate
a message on slacks saying hey please
buy these components when the pcbs
arrived and we actually have all the
components to build them
so uh
except for the electrical designs we
also have the mechanical designs
obviously so we do the injection molded
case we do also all sorts of like
holders for GPS antennas for the dcams
the mounting plates you see on the right
I don't go into too much detail there
because that's that's not usually what I
do that's eager on the back there
we yeah regenerate these machine
drawings that we can send off to the the
manufacturers we do some simulation
tests to make sure that all the things
stay within the lens that we want them
to be
Etc
cool so we're done with the design we
got a bear prototype pcbs
this one's blue you've noticed in
Georgia's talk that the PCB was black
that's one of the ways we make it easy
internally to track like which Pro which
thing is a prototype which one is a
production device
also we tend to change the goal of the
PCB everywhere Vision we do so if you
have like three four revisions on a desk
like you can easily check like okay this
is a ref B this is ref c
um it's been quite helpful
um
so now we have blank pcbs obviously they
need components so what do we do now
well
some people have already talked about
our internal production line that we set
up a few months ago so that's the part
that'll actually put the parts onto the
PCB
the main advantages we've seen from
bringing this production in-house
because people ask us like why do you
bring it in-house you can just pay
somebody else to do it and don't have to
care about any of the stuff uh us two
things so first of all it drastically
reduces the cycle time
so with our old manufacturer it would
take like between six and eight weeks to
get a new revision
and you'll only get like two boards and
so you hold back and forth and second of
all it's way easier to fix issues like
for example we got a board made on our
line somebody plastic component like 90
degrees rotated we just literally walk
downstairs change the value in the
machine work back up and an hour later
we have a new revision on your desk with
the required fixes
um with the old company it would be an
email chain of three days and then we
might get it right
okay first machine so the board goes
into the machine
and that machine applies the solar paste
so to stick components down to your
board you need some solid base that
melts in the oven to create the solder
bonds
um
most Mass manufacturing uh
manufacturers they use a stencil based
machine so you get these um
stainless steel based stencils with
horse guard on them and you have a big
squeegee that just squeegees down your
solid paste
um it's very nice it's very fast so it
only takes like a second or two to paste
the PCB the problem is it's very hard to
iterate with like if you make a new
change you have to make a new stencil
you have to reload the stencil in the
PCB every time you change the designs
out so that that adds a bunch of time
with uh switching designs and making new
revisions this one just as a as a tube
with some solid paste in it and it just
dispenses tiny little dots on the bats
and uh it's just CNC controlled so we
can just put any design in it and it
works
as also the cycle time is not very
important in this step
because the whole production line is
pipelined so even as long as this takes
less time than it takes to populate the
board this won't hold down the total
production rate that we can achieve so
there's actually not that many downsides
to doing it this way
next machine pick and place machine so
the pick and place machine is loaded up
with a bunch of reels of components and
it does exactly what the name suggests
it does it as nozzles Picks Them Up from
reels places and then on the board
our machine also has an extra cool
feature that I really like it does
electrical testing as well of every
component a very passive component so
for example if it picks up 100K resistor
usually these parts have tolerances
because we live in the real world
it'll listen down on the dashboard it
will measure the exact value log into a
database somewhere like related to the
serial number of abort that's in there
so we can in the future always look back
and see exactly which value resistor was
placed in there
um it's pretty cool
next up in the line the oven
pretty States pretty straightforward so
you just put the board in moves over the
conveyor it gets hot it's all the melts
that's pretty much it you'd think but
then there's a lot of tweaking in the
oven so the oven has about eight zones
they can all be set at a different
temperature
and then the conveyor belt speed can
also be modified and it's it's a
balancing act between like multiple uh
parameters that you need to tune
for example in the first five zones on
this uh this slide you'll see that the
temperature slowly moves up
and that's to give the flux contents
that that's inside the solar base some
time to uh to clean up the oxidation of
the pads which makes it way more likely
to get good solar Bond then it moves
into zone six and seven where the
temperature rises up quickly to above
the melting point of the solar balls
that are in the solid paste the bomb
gets formed and then there's a
controlled cool down in the next two or
three zones to make sure that that
everything settles down nicely
a lot of the components that we use
actually have limitations on for example
the uh the the the temperature rate the
temperature gradient that they that they
can can sustain so for example the image
sensors I think you have to heat up less
than three celsius a second I cool down
less than six Celsius a second and
that's also something that you have to
keep in mind when tweaking all these uh
solo zones
next up in the line we technically have
a functioning board if everything went
well the problem is we don't know if
everything went well like what if
somebody like bumped the PCB some
components moved or we loaded the wrong
part into the machine or failed to pick
up a part and didn't notice well that's
why we have automated Optical inspection
so it's that machine it's basically a
fancy camera with a bunch of lights that
can move
um
just flies over the board and checks out
every component and makes sure that it
matches a reference picture from a known
good board so this is especially useful
in production where if you're running
like thousands of boards you know that
every board actually has all the
components and it doesn't have any any
failures that would be easy to detect
this this way
uh
doesn't know the benefit the family
machines announce is that we can do a
lot of vertical integration with them so
we talked about parts parts box having
an API all the machines also have an API
so uh this is some software we wrote
in-house to um
uh program the machines because if
you're a contract manufacturer you
usually get like an Excel sheet of all
like the parts and amounts positions
that the parts need to be placed at then
somebody has to like sit there manually
enter like the hundreds of components
that are on the design
um let's select from which CPN like
which npn is actually in stock which
one's on machine which is which one is
not well I mean we've built a software
it query Sports box so to check which
components we actually have in inventory
it checks which parts are actually
already loaded on the machine so if you
have multiple accepted mpns for a CPN
again like prioritize the ones that are
already loaded and then we just throw in
like the cap file that we have
automatically generates all of this it's
literally a five minute process and we
have programmed all the machines
so we have built prototype devices does
everything work well
to verify that everything works you need
test plans
so we have very extensive unit tests for
every single feature that we want out of
the device
so this functionally test that
everything works that's on the board
like you expected it to work based on
the design it also checks for extreme
environments so we do a lot of tests in
like thermal Chambers to make sure that
it goes up to the that everything still
works at the temperature that that it
might reach up in the car it goes down
to a certain temperature
um
it also there's some some minor stress
testing where we like
um inject voltage transients into
certain lines to make sure that their
protection circuits we've built in uh
work uh we make sure that if you plug in
a wrong cable into the wrong hole
nothing breaks like all that stuff is is
validated before we move on
then if we think that's all good then we
have some more compliance tests so those
are actually mandatory if you want to
sell consuming Electronics you have to
bring it to like a certified test lab
and then make sure that a you're not
intentionally radiating any RF noise on
frequencies that you're not allowed to
radiate on like
and then there's the second part of the
tests which make sure that the modules
you've integrated that actually you want
to transmit don't transmit at a power
level that's too high or that they don't
create any modular
effects
and then there's a third step we do
field testing so we first put them in
all our cars so we have 12 cars and a
fleet it covers most of the platforms we
support but then there's some some other
ones that Community only has so that's
why we do the the Apple program so we
have some few members here I think you
guys here
yes
um
and uh that's actually proven to be very
successful so in this round of Apple
testing for the 3x we've actually found
two bucks
um one of the bugs was a software bug
with the um the new panda that's
integrated on the board it was used in
slightly different ways than the red
band that was in the past so we fixed
some some bug related to kind of D but
there's also a hardware back that was
discovered that we didn't discover with
all the test plans we've previously done
which was with uh Jason's third-party uh
long cables
VW uses all this weird stuff it occurs I
don't know so yeah we always use the the
official cables because they're laying
around in the office so I
it's it's good to get some coverage from
the community as well
so once that's done
and we're happy with it it moves on to
uh production so we now buy all the
parts in bulk we so that's like the
cheapest components we make sure we have
everything in stock and then we get the
pcbs both in in Black like mentioned
before we apply the QR code stickers
actually data Matrix not a QR code but
same thing so this adds a unique serial
number to each board such that we can
later on if we if it comes back to the
heart of theory we can double check that
like the oven was set at the right
temperature when it was run that all the
electric components measured their uh
their respective values uh we can check
the aoi images like to see if that
missed anything that that it shouldn't
have
uh so that's a pretty nice addition
then when it I mean it runs through the
whole circus book line the exact same as
the
prototypes so then we have assembled
boards and then we move on to all our
provisioning steps
so first of all we have initial
provisioning so this is a step we've
added for the 3x
um
and it basically takes the bare boards
that came straight off the line we just
put on the lens holders the lenses in
them uh puts them in this nice jig and
it does a bunch of like very preliminary
tests so it checks that all the voltage
rails are in intolerance it checks that
we can talk to most of the components it
does like an initial flashing round of
the internal panda
um and then it has the the focusing step
so it's very important that the lenses
that we place on the devices are like
perfectly in Focus because it's fixed
Focus so we can change it in the future
and would be a hardware return if
they're not uh so we made this this UI
thingy where you just turn the lenses
you try to get the green line to go as
high as possible and then we know that
the the devices are in focus
now obviously on the bare boards we
haven't placed the Som or the compute
module on the board yet so we needed to
design something else for that so we
designed what we call a fake zomb which
is basically a separately
like a a separate module in the same
form factor as a song but that can be
powered externally so you can just keep
it alive when switching between boards
just make sure that we don't have to
like reboot Linux every time before we
run tests so that increase the cycle
times plus it has like the voltage
testing stuff built in and all that nice
stuff
then the next step is we built them out
into full devices so the heatsinks got
placed on uh d-cam gets placed on the
GPS gets placed on that they get put
into the cases the screen gets placed on
that's quite a lot of steps uh in the
case we also add an NFC tag and you'll
see where that's useful for Lake
after they've been built into the final
form they move on to what we call final
provisioning this is a wooden rack we
have set up in our production
environment with some some mounts
so they they get connected up there and
then we run through like a full Suite of
Hardware tests so we make sure that
every piece of Hardware that's inside
that's that's uh on the device like the
Imus the GPS the Wi-Fi the screen all
that stuff that's all tested so we make
sure that that
we know that everything works before we
ship it out to customers
this is also a place where like from
time to time new tests get added because
we've seen failures from the field for
example a few weeks ago we had some
returns of display panels where like the
touch wouldn't work in like a certain
area of the screen so we just added a
test where you just like wiped the whole
screen so we make sure that the whole
screen works and so we that's that's
like the procedure we follow to reduce
failures more and more
as time goes on
after that we move on to the stress test
so that's another bacon wooden rack this
is only a small portion of it
um
where the devices are placed on for a
24-hour uh cycle test so on this test we
put them under high synthetic loads so
we just max out the CPU usage Max our
GPU usage DSP usage we run the cameras
at full speed run the fans at full speed
um
just to make sure that the device is
actually stay working for like a
reasonable amount of time because
um
sometimes like stuff works but then like
it heats up and then stops working so
that's the kind of feelings we try to
catch here this is also the place where
we do some longer running tests like we
make sure that the GPS signal doesn't
drop for 24 hours
we make sure that if we toggle fan on
and off once in a while that it starts
back up
we make sure that the camera doesn't
drop any frames during the whole 24
hours
and those those things have really
reduced the amount of fails that we see
in the field
after they've gone through that they're
ready to ship so they could move over to
fulfillment where we automatically test
using the NFC tag because we know where
the device has been so we put the device
on there
on our reader let me know if the device
passed all of the tests
because then he always used to be the
case in the old coma two days in the old
office like device would get misplaced
and or like not all the tests would have
been run and then we would get shipped
out anyways so now we explicitly
confirmed this uh for the comma three so
you have to make sure that we're the
correct type like if you buy one
terabyte one you get a 32 gig one people
will complain the other way around not
so much but still not still not great
um
domestic orders we include a SIM card
for the comma Prime trials uh
International all the stones so that's
also something that's verified
this also tells you which harness the
customer bought so we place the Right
One In The Box it also checks that we
have the latest software uh flashed onto
the device because if it's been sitting
in storage for a while like if we we
have some some access inventory it might
be on an old open battle version and the
first clone would take a lot longer
so this is something uh something we try
to prevent and then there's the final
cosmetic inspection before they get the
box gets shut there's also an aoi it's
not automated Optical inspection we call
it Ada Optical inspection because she's
the one that has the Fulfillment
um
so yeah
and then the heart of failures
um
we used to get emails all the time that
said oh my device doesn't work anymore
and I mean there's not much you can do
about that except for ask the customer
to return the device and then in most
cases it turned out that the device was
fine but it was installed wrong or the
software didn't support that car yet or
there was some other software bug that
we didn't know about yet
um
so we recently changed that process and
made sure that when there's harder
complaints people actually provide us
with a route where the issue occurs so
that an engineer first looks into the
into the the
the alleged failures and if there's
actually someone normally going uh going
on then we get it sent back otherwise we
tell the customers like what's going
wrong and we don't have to do any
unnecessary shipments
this is actually reduced or inbound for
for uh
influx like the inbound for the failures
by close to an order of magnitude so
that's been quite good for us
um but then devices that do come back we
have to take him quite seriously because
usually there's something we can do
about it
um
for example one of the earlier failures
of ecommer 3 had to do with the Somme
stopped failing and it turns out that we
used to use a thermal pad on top of the
main CPU
and with manufacturing tolerances and
thermal cycling that would put too much
pressure inside on top of the dye which
caused some solar failures
so then we change the procedure to go
with a body-based thermal compound which
reduced the the total pressure on top of
the chip by
2X and that practically resolved the
issue overnight
another thing we can do is add
additional testing like for example the
touch issue I talked about before like
we just add a lot of tests to make sure
these don't these devices don't get
shipped out in the first place or we
actually can also improve the design
like if it's a an actual design bug we
had one a while back with red pandas for
example where we didn't account for
people plugging in a USB cable with 12
volts on it on a port that one's
supposed to get 12 volts and then would
blow out the camera and Civics so that's
just fixed we made a new revision it
doesn't happen anymore
and that really translates in the
failure rate so uh Georgia already
alluded to this but the all-time failure
rate of gamma 3 has been at 9.2 percent
now
um
it's an interesting number but it's
actually more interesting to look at
what's failure it's been over the last
year
so we load it to 3.9 already
just by improving all these processes
um
to put that into a little bit of expect
perspective George already did some of
this but uh iPhone 6 is 22 recent
iPhones three four percent
um Xboxes 22 percent
PlayStation 3s was it 10 percent
we're actually close to a Wii that's
pretty good Hardware apparently
we intend to do a lot better with the 3x
I I think with some uh some more
improvements and with a more reliable
design I think we can get there probably
get it down to like one to one or two
percent
so that's that's pretty pretty good
so uh I mean George gets to announce
Hardware products why don't we also get
to announce something
um
that's not on there
um
you guys know harness boxes
a lot smaller now we don't I mean
they're in the final stages of testing
so they'll come out in a few months
probably uh injection molded case it
would be a lot easier to fit on the uh
the covers and more scars
then another one that we're coming out
with soon a new panel jungle so it's a
can of the V variant it adds a Z card
support it adds per channel effuses uh
per Channel as bu line control all that
stuff that uh has been very nice for
developers internal and hopefully
external as well
so okay I've been talking for says 35
minutes now I'm only I only have 45
minutes so
there's still a lot more that we haven't
talked about
let's part shortages let's talk at all
screwdrivers this packaging this
injection molding boom optimization
cable testing suppliers
harness production mounting plates
through hole soldering display
calibration laser deep analyzation
pandas comma bodies you name it the
hardware team has a lot to do
so uh if you're interested reach out to
us we can definitely use an extra hand
or if you have more questions then feel
free to uh
ask him now
[Applause]
all right thank you robba we got a
question up here in the front
thank you
um you talked about compliance testing
are you planning to do only FCC or are
you looking goals so European one like
easy and others
um
we've done the FCC one now the European
one is very similar um
so we'll uh we'll probably be complying
with that as well
great
so the um
the harness connector is changing
because you've got a smaller box yeah so
how do you make that what's that
equation like for making the trade-off
or is it time to
uh yes so the the I think the old one
was a 24 pin if I'm not mistaken the new
one is a little bit smaller
um I mean we had to because otherwise
the case wouldn't be smaller uh the new
connectors will just come with the new
harnesses so we'll have to move over the
production a little bit but functional
functionally that's not that big of a
difference it doesn't have a mechanical
relay anymore by the way so we'll get
rid of the little click you hear when
open pilot starts but it'll be a lot
more reliable hopefully so yeah that'll
be good
we got any other questions
oh in the back I'm coming
hi um so I was impressed by your
automated testing on on commits to the
repo uh how is it that you do the diff
between the old board and the new boards
um oh it's it's not super efficient
computationally but we've gotten uh
Eagle the cat package we used to run
inside of the CI Docker container so we
basically just spin up you go open the
files generate uh girl books then
generates pngs from the girl books and
then we just do an image diff on the two
images
sweet and we're also looking for
Hardware Engineers are there any uh
like networking events that you know of
in San Diego where we can all uh I don't
really know of that many actually no
the truth is that robe is based in
Belgium that's also true
so he definitely does not know about uh
the happenings in San Diego
oh we got a question back here
I'm wondering um do you have any
interesting stories about weird issues
that took a long time to track down and
end up having an interesting cause
um
we have so many good bug stories we have
a lot of them there's much bugs Nabil on
both the comma 2 and the comma 3s we've
we've had a lot of GPS troubles
um
this apparently like uh the the the
845s the main chips they leak quite a
bit of RF across the whole Spectrum so
you have to isolate them very well to
not affect GPS
the Commodus we had an issue where the
GPS Santana has this internal LNA
amplifier
and so it amplifies the signal but then
we had an issue where it leaked out
after the amplifier into the heatsink
and I got coupled back into the antenna
so now we would get like a feedback loop
that one took a long time to track down
um
well all the ones that we got how about
last week when a vendor sent a wrong
component and mislabeled it oh yeah
that's another great one so last week we
were placing uh inductors on the boards
on the three axes actually uh don't
worry we fixed it but uh
um
so we got we ordered uh one micro Henry
inductors from a reputable Supply they
came to us we loaded them into the
machine and then uh Eagle Hardware guy
he like he needed one so he just took
one off the line and when taking it off
we looked at the Reel and it was like
hey there's two labels on here one of
them says one micro Henry one of them
says 2.2
it turns out uh it was the wrong part
so uh yeah
got to be careful even with official
distributors
so we heard George talk about custom
Asics where does this stand on the
hardware roadmap have you guys thought
about it at all uh I think George has
some architectural plans but I don't
think that's uh that's that's going to
be concrete anytime soon yeah quite far
off from the budgets needed to uh to to
spin out H6
so people frequently Express concern
over the thermal resiliency of the
devices can you speak about the steps
that you take during production for both
the C3 and now the the 3x
um to mitigate Pat uh yes so I mean the
basic process we follow is we just pass
them at extreme temperatures and then we
make sure that the parts don't fill at
those temperatures we just cycle lots of
times and then we fix the issues that uh
that arise
the second part of the thermal issues is
also not necessarily for failures but
also for uh like user experience for
example when it's like sitting on your
windshield when the sun's blasting on uh
the device can get quite hot they want
to cool down as fast as possible so you
actually want to reduce like the total
thermal Mass on the device uh so yeah
there's quite a lot of consideration
going on in the in that regard
but so far with like all the improved
soldering processes we don't see that
many thermal cycling failures anymore so
hey
you know occurring Hardware or there's
like automation inside all that
um well when we get failures back we
often just run them through the
provisioning tests again and that
usually gives us uh like that narrows
down the component that actually failed
and then we disassemble the devices if
you look at another microscopes and then
Trace down what the actual issue might
be
so it's it's mostly a manual process but
we use some of the the production tests
to guide it
all right we've got time for a few more
questions
um yeah I had a question about the GPS
module in the qutel uh how's that
compare to I think you were using a Neo
m8p yes oh what do you think like is it
worse better
um I think performance wise it's pretty
similar I think we got on the crackdel
into a mode where it sends us the actual
raw measurements uh and and turn off all
the processing that it does inside
um but the I mean the correctol module
uses Qualcomm chips inside and I mean
phones have pretty good GPS these days
so the hardware level is quite good so
we got about comparable performance with
uh with the EU blocks modules as we do
with the uh the correct else now
Robo what's your favorite part of the 3x
process the favorite part yeah which one
probably the most Joy
oh that's a difficult one
um
I really like the new image sensors like
the nicer easier throughout we have
better specs
cool components
we got any additional questions
all right
how do you manage being in Belgium while
they're here
you're the hardware guy well you get
used to it it's uh I used to be in San
Diego for a year so I know the team very
well as well
um and then we communicate over slack so
I make sure when the US is awake that I
got all my questions answered and I can
continue working the next day sometimes
it's nice as well like you're just
you're sitting by yourself quiet in just
plow through it
[Laughter]
a quarter yeah every Wednesday Rob and I
have lunch meeting yep yep and every
Monday we do a team meeting
commas it's super low on meetings yeah
uh we have an all hands and then a team
meeting every week and that's about it
yep
all right thank you so much rubber
[Applause]
[Applause]
hi
hi good afternoon I'm Rob I'm part of
the the hardware team here at coma and
today we're going to talk about how the
device is built
so first of all I think a lot of people
when they think of comma they think of
an AI company like we do a lot of
research a lot of our people are working
on software on on machine learning but
fundamentally comma is also a consumer
electronics company like I mean we
launched a new product this is what uh
what what funds our development so this
is a pretty pretty important part of
what we do
um it's also not like we're selling like
simple Electronics like we're selling
electronics that that's somewhat
comparable to like a modern smartphone
like if you think about it we have
we have a high quality screen we have
high quality cameras
um we have a bunch of compute to run the
machine learning models we have
connectivity we have network
connectivity we have LTE we have Wi-Fi
um so yeah it's not a simple product to
build
so we started out a few years ago with
the Eon ion was a pretty simple product
to build I mean we basically uh we
didn't really care about all the uh the
advanced features we just we bought a
smartphone like all the advanced
features already in the Box we slapped
the heatsink on it to manage The
Thermals uh put in a 3D printed case
um yeah easy to produce uh it's it's
simple it works but it's it's I mean
it's not really a consumer electronics
product right
um
after that I think it's about four years
ago now we launched the comma 2. this is
basically refinement of the eom
product so that the most advanced
features like compute sensors are still
inside the metal box so you didn't have
to care about that but we integrated the
electronics that torque to the car into
the case
we refactor the way that we connect to
the car so we can support more cars
um and things go a little bit more
complex like we started to have to build
more procedures and how to like make
sure that the changes we made were
tested well that the production
processes were good
but then two years ago we launched the
comma 3. it was a pretty pretty big step
George always talks about the fact that
comma 3 is the hardest product that
we'll ever have to build and I I do
believe that that's true for a few
reasons
uh for one
like all these sensors all the the
display the compute the electronics
they're all custom built in-house
they're designed in-house uh this is
something that we'd never really done
before on this scale so it took a lot of
engineering effort a lot of time
improving all the processes to get this
to build
not only to design all the individual
customized components but also to
integrate them nicely into one like
little box that looks nice that
functions well
that is a form factor that people
actually want to use
uh so so that's what we did back then
then this year like we've obviously
launched the 3x the George talked
extensively about already which is just
a refinement of the three with with kind
of the added
um so we're already on the downslope in
terms of complexity
um
so in the future I think we can go even
a step further once we get to larger
numbers of devices sold we can actually
start talking to manufacturers to also
get the modules that we still use to do
connectivity like we still use the
Crackdown module for LTE we still use a
system or module as we refer to it the
Som for the compute but we can start
integrating that all into a nice device
and then we handle back to something
that looks more like a smartphone
um
again like if we get to those numbers we
actually uh can customize these uh these
these individual components more so that
the integration will also be easier so I
think it'll only get easier from here
so how do we do it now
so there's actually quite a lot involved
in the whole process so to uh to give
you a sense of that I've made up this
little nice design of uh like a basic
life cycle of a product within company
with it within coma I don't think it's
too similar to all the hard drive
companies but uh it's good to go over it
anyways so we start with a concept so we
basically think about like what the form
factor will look like
um what features we want to have
uh once we've got that nailed down then
we go over to uh design step where we
design all the electronics all the
custom parts the mechanical Parts the
case
then we get prototypes built
then we get them tested if they're not
good let me go back to step number two
usually we iterate like six seven times
before we get a prototype that's ready
for manufacturing
then we actually can put it into
production
and after that we can ship it out to
customers now if it would stop there
that would be nice but we live in the
real world so we'll also get warranty
returns
um
for the 3x
um compared to the three getting the
concept down was a lot easier I mean we
basically have the exact same features
except for the addition of kind of the
we still have the same kind of form
factor of all the components stayed in
relatively the same position so that
that part wasn't actually too hard I've
actually found a picture of the the
Whiteboard where we sat down and wrote
down all the all the changes we wanted
to make
and you know there's
a lot of times we mentioned we mentioned
the word no in the in the feature list
so we removed the pcie lanes because we
don't have the nvme drive anymore uh
removed the 3.3 Power Wheel so that made
the power actually easier we
we removed the the external siren like
we used the the speakers we already had
on the device to do the siren part
we removed the USB hub because the panda
Now talks over spy to the main device so
it's we removed a lot of stuff and as
Elon always says no part is the best
part so uh that's the general goal here
[Music]
um
so once we know what we're building then
we get to the design phase so the
biggest part of design I would say is
the the electronics part so the main
board
which starts out as the schematic on the
left
so that's basically where we do all the
like we selectable Parts that'll make up
the whole design
um we
get them to work all together like we
think of all the edge cases the device
might be in like like when you shut it
down after a while like the power draw
needs to be load like attack on stuff
all gets integrated and thought off when
we do the uh the schematic design
after we're happy that we and we think
that we made all the changes that we
needed to make in the schematic then we
move out move over to the board layout
uh this is actually a picture of the uh
the PCB layout of the comma 3. so you
can see it's it's it's relatively
complex so this is the part where we
place all the components down in a
sensible location
um to make it fit in the form factor we
make we design the outline of the board
and then we connect all the components
together with uh with the traces on like
six copper layers
to get all the the requirements that we
want
um
this is actually a pretty manual step
still because there haven't been very
good software packages out there that
can do this automatically even though
you might think that it's not that hard
they can just connect stuff up together
that needs to be connected up it turns
out there's a lot of
a lot of design requirements that you
need to think about for example all the
high speed traces that carry a lot of
the data from like the cameras to the
compute they need to be impedance
matched they need to be on layers and
further and far enough apart from model
stuff that they don't have crosstalk
with different Lanes you want them to
not have any uh electromagnetic
interference
you don't want to admit any RF noise
that you're not allowed to because that
might also do great GPS or all the
devices in the neighborhood but it's
actually quite complex so this process
like if you start from scratch it
probably takes one and a half two months
to get it down
future revisions is obviously easier
because most of the stuff stays the same
so let's talk a little bit more about
the part selection because in the recent
years that has proved to become more
difficult because of all the shortages
going on
um and not only that but there's also
the thing where uh
there are multiple Parts on the market
with a similar functionality so getting
an optimal design where you can actually
mix and match parts to get the same
features it's pretty important
um
so how do we internally keep track of
all like the substitutes that work
together of all the inventory that we
have for production
um like what components all the designs
use so we can reuse the same components
well we don't always need to reinvent
the wheel so we actually found this
software called Parts box it's made by a
Polish company it's just one guy who
writes this in the in his spare time
it's actually really cool it introduced
us to the concept of a customer part
number of CPN as sometimes also think of
it as a comma part number but
um
so this is basically a part number
that's not like an actual physical part
so that basically just specifies the
requirements that we want for that part
to be so we just say okay we want like
100 kilo on resistor that's the one I
showing now in an 042 package so it's
like a relatively standard component and
there's dozens of Manufacturers that can
can make parts that fits the that fits
these specifications
um so that's the parts you see on the
bottom so that's the parts that we can
actually buy and that we approve
uh to be like a suitable part for the
CPN
and we can then order them to make sure
that we have enough for uh for
production runs the other cool thing
that Parts box has is API access
um
so we also do a lot of CI on our Auto
designs so we can automatically pull
from our inventory numbers and that kind
of stuff and I'll go into depth a little
bit more in the next slides
so this is a commit that I made to the
hardware repo in the last month
finishes rounding of one of the camera
boards uh nothing too interesting but uh
this shows us like all the steps that
are run automatically every time we make
a change
so the first thing we have is it checks
the cpns so it goes over the design that
you just pushed and make sure that every
part in the design actually has a CPN
like allocated to it so we don't push
designs where we don't specify like what
the part actually is because that makes
it harder for production like you have
to go back and forth I'm like asking
which part of this
uh so that's that's automatically uh
check that that's uh all filled out
then the next step is one we added
because one of our earlier prototypes we
made a mistake of putting a capacitor
with a lower voltage trading on a
power supply line that was slightly
higher voltage so uh like in in a few
weeks we would see failures with this so
now we actually have a check that goes
over every capacitor and all of our
designs and checks that the the ratings
are actually uh good enough for for the
use case we used for
the third step is a fiducial's check
for people who don't know what a
fiducial is so that it looks like this
it's a little dot that you put on a PCB
it doesn't have any function in the end
product but it's very useful in
production because that that was the
machine like where the board is actually
located in the machine so again more
accurately calculate where it needs to
place the components
we tended to make the mistake sometimes
where we would order boards without
placing fiducials on them and then we
would get them into the manufacturing
line and would be a huge hassle to get
prototypes out of them so now I add an
extra check so every time we have a
design and it at least has three
fiducials on the on every board
next one generate gen get files so
that's something that's the file format
that a machines use so we don't have to
manually make that every time we make a
new revision then we also generate board
diff images
so for every commit it tells you where
the copper was added where it was
removed so we can easily like go back
and see which commit actually changed
which uh what what part of the design
because uh I mean the files look like
XML codes so you can't really see what's
going on with the actual design on
GitHub so this is a pretty nice sanity
check to make sure that you actually
committed what you wanted to commit
um
then we have generating schematic PDFs
because not everybody has the cad
package installed on their machine so we
just generate PDFs from all the designs
so we can just pull the schematic as a
reference anytime
uh we back up some stuff that's an
automated thing and then recently we've
also added the new parts bot so every
time we now push a revision to a design
it checks and it accesses the parts box
API I just talked about and it checks
that all the components we have on the
design are actually in stock like
locally
and if they aren't then we just generate
a message on slack saying hey please buy
these components when the pcbs arrive
and we actually have all the components
to build them
uh
except for the electrical designs we
also have the mechanical designs
obviously so we do the injection molded
case we do also all sorts of like
holders for GPS antennas for the dcams
the mounting plates you see on the right
now don't go into too much detail there
because that's that's not usually what I
do that's eager on the back there
um but we we yeah we generate these
machine drawings that we can send off to
the the manufacturers we do some
simulation tests to make sure that all
the all the the things stay within the
limbs that we want them to be
Etc
cool so we're done with the design we
got a bear prototype pcbs
this one's blue you've noticed in
Georgia's talk that the PCB was black
that's one of the ways we make it easy
internally to track like which Pro which
thing is a prototype which one is a
production device
also we tend to change the goal of the
PCB every revision we do so if you have
like three four revisions on your desk
like you can easily check like okay this
is a ref B this is ref c
um
it's been quite helpful
um
so now we have blank pcbs obviously they
need components so what do we do now
well
some people have already talked about
our internal production line that we set
up a few months ago so that's the part
that will actually put the parts onto
the PCB
the main advantages we've seen from
bringing this production in-house
because people ask us like why do you
bring it in-house you can just pay
somebody else to do it and don't have to
care about any of this stuff uh also two
things so first of all it drastically
reduces the cycle time
so with our old manufacturer it would
take like between six and eight weeks to
get a new revision
and you'll only get like two boards and
so you hold back and forth and second of
all it's way easier to fix issues like
for example we got a board made on our
line somebody plastic component like 90
degrees rotated we just literally walk
downstairs change the value in the
machine work back up and an hour later
we have a new revision on your desk with
the required fixes
um with the old company it would be an
email chain of three days and then we
might get it right
okay first machine so the board goes
into the machine
and that machine applies the solar paste
so to stick components down to your
board you need some solar base that
melts in the oven to create the solder
bonds
um most Mass manufacturing uh
manufactures they use a stencil based
machine so you get these um
stainless steel based stencils with
horse guard in them you have a big
squeegee that just squeegees down your
solid paste
um it's very nice it's very fast so it
only takes like a second or two to paste
the PCB the problem is it's very hard to
iterate with uh like if you make a new
change you have to make a new stencil
you have to reload the stencil in the
PCB every time you change the designs
out so that adds a bunch of time with uh
switching designs and making your
revisions this one just as a as a tube
with some solid paste in it and it just
dispenses tiny little dots on the bats
and uh it's just CNC controlled so you
can just put any design in it and it
works
there's also the cycle time is not very
important in this step
because uh the whole production line is
pipelined so even as long as this takes
less time than it takes to populate the
board this won't hold down the total
production rate that we can achieve so
there's actually not that many downsides
to doing it this way
next machine pick and place machine so
the pick and place machine is loaded up
with a bunch of reels of components and
it does exactly what the name suggests
it does it has nozzles Picks Them Up
from reels places and then on the board
our machine also has an extra cool
feature that I really like it does
electrical testing as well of every
component a very passive component so
for example if it picks up 100K resistor
usually these parts have tolerances
because we live in the real world
it'll place them down on the dashboard
it will measure the exact value log into
a database somewhere uh like related to
the serial number of a board that's in
there so we can in the future always
look back and see exactly which value
resistor was placed in there
that's pretty cool
next up in the line the oven
pretty
straightforward so you just put the
board in moves over the conveyor it gets
hot it's all the melts that's pretty
much it you'd think but then there's a
lot of tweaking in the oven so the oven
has about eight zones they can all be
set at a different temperature
and then the conveyor belt speed can
also be modified and it's it's a
balancing act between like multiple uh
parameters that you need to chew for
example in the first five zones on this
uh this slide you'll see that the
temperature slowly moves up
and that's to give the flux contents
that that's inside the solar base some
time to uh to clean up the oxidation of
the pads which makes it way more likely
to get good solar Bond then it moves
into zone six and seven where the
temperature rises up quickly to above
the melting point of the solar balls
that are in the solid paste the bomb
gets formed and then there's a
controlled cool down in the next two or
three zones to make sure that that
everything uh settles down nicely
a lot of the components that we use
actually have limitations on for example
the uh the the the temperature rate the
temperature gradient that they that they
can can sustain so for example the image
sensors I think you have to heat up less
than three celsius a second I cool down
less than six Celsius a second and
that's also something that you have to
keep in mind when tweaking all these uh
solo zones
next up in the line we technically have
a functioning board if everything went
well the problem is we don't know if
everything went well like what if
somebody like bumped the PCB some
components moved or we loaded the wrong
part into the machine or failed to pick
up a part and didn't notice well that's
why we have automated Optical inspection
so it's that machine it's basically a
fancy camera with a bunch of lights that
can move
um
just flies over the board and checks out
every component and make sure that it
matches a reference picture from a known
good board so this is especially useful
in production where if you're running
like thousands of boards you know that
every board actually has all the
components and it doesn't have any any
failures that would be easy to detect
this this way
uh
doesn't know the benefit the family
machines announce is that we can do a
lot of vertical integration with them so
we talked about parts parts box having
an API all the machines also have an API
so uh this is some software we wrote
in-house to um
program the machines because if you're a
contract manufacturer you usually get
like an Excel sheet of all like the
parts and the mounts positions that the
parts need to be placed at then somebody
has to like sit there manually enter
like the hundreds of components that are
on the design
um
select from which CPN like which npn was
actually in stock which one's on machine
which was which one is not well I mean
we've built a software at query Sports
box so to check which components we
actually have in inventory it checks
which parts are actually already loaded
on the machine so if you have multiple
accepted npns for a CPN again like
prioritize the ones that are already
loaded and then we just throw in like
the cat file that we have automatically
generates all of this it's literally a
five minute process and we have
programmed all the machines
so we have built prototype devices does
everything work well
to verify that everything works you need
test plans
so we have very extensive unit tests for
every single feature that we want out of
the device
so this functionally tested everything
works that's on the board like you
expected it to work based on the design
it also checks for extreme environments
so we do a lot of tests in like thermal
Chambers to make sure that it goes up to
the that everything still works at the
temperature that that it might reach up
in the car it goes down to a certain
temperature
um
it also does some sort of minor stress
testing where we like
um inject voltage transients into
certain lines to make sure that their
protection circuits we've built in work
we make sure that if you plug in a wrong
cable into the wrong hole nothing breaks
like all that stuff is is validated
before we move on
then if we think that's all good then we
have some more compliance tests so those
are actually mandatory if you want to
sell consuming Electronics you have to
bring it to like a certified test lab
and then make sure that a you're not
intentionally radiating any RF noise on
frequencies that you're not allowed to
radiate on like
and then there's the second part of the
tests which makes sure that the modules
you've integrated that actually you want
to transmit don't transmit at the power
level that's too high or that they don't
create any the modular
um
effects
and then there's a third step we do
field testing so if you first put them
in all our cars so we have 12 cars and a
fleet it covers most of the platforms we
support but then there's some some other
ones that Community only has so that's
why we do the the Apple program so we
have some few members here I think you
guys here
yes
um
and uh that's actually proved to be very
successful so in this round of Apple
testing for the 3x we've actually found
two bucks
um one of the bugs was a software bug
with the um the new panda that's
integrated on the board it was used in
slightly different ways than the red
band that was in the past so we fixed
some some bug related to kind of D but
there's also a hardware back that was
discovered that we didn't discover with
all the test plans we've previously done
which was with uh Jason's third-party uh
long cables uh VW users do all this
weird stuff it occurs I don't know uh so
yeah we always use the the official
cables because they're laying around in
the office so I
it's it's good to get some coverage from
the community as well
so once that's done
and we're happy with it it moves on to
uh production so we now buy all the
parts in bulk we select the cheapest
components we make sure we have
everything in stock and then we get the
pcbs built in Black like mentioned
before we apply the QR code stickers
actually data Matrix another QR code but
same thing so this adds a unique serial
number to each board such that we can
later on if we if it comes back to the
heart of theory we can double check that
like the oven will set at the right
temperature when it was run that all the
electrical components measured their
their respective values uh we can check
the aoi images like to see if that
missed anything that that it shouldn't
have uh so that's a pretty nice addition
then when it I mean it runs through the
whole circus book line the exact same as
the
prototypes so then we have assembled
boards and then we move on to all our
provisioning steps
so first of all we have initial
provisioning so this is a step we've
added for the 3x
um
and it basically takes the bare boards
that came straight off the line we just
put on the lens holders the lenses in
them uh puts them in this nice jig and
it does a bunch of like very preliminary
tests so it checks that all the voltage
trails are in intolerance uh it checks
that we can talk to most of the
components it does like an initial
flashing round of the internal panda
um and then it has the the focusing step
so it's very important that the lenses
that we place on the devices are like
perfectly in Focus because it's fixed
Focus so we can change it in the future
and would be a hardware return if
they're not so we made this this UI
thingy where you just turn the lenses
you try to get the green line to go as
high as possible and then we know that
the the devices are in focus
now obviously on the bare boards we
haven't placed the song or the compute
module on the board yet so we needed to
design something else for that so we
designed what we call a fake zomb which
is basically a separately
like a a separate module in the same
form factor as a song but that can
depart externally so you can just keep
it alive when switching between boards
just make sure that we don't have to
like reboot Linux every time before we
run tests so that increase the cycle
times plus it has like the voltage
testing stuff built in and all that nice
stuff
then the next step is we built them out
into full devices so the heatsinks got
placed on
dcam gets placed on the GPS gets placed
on that they get put into the cases the
screen gets placed on
that's quite a lot of steps in the case
we also add an NFC tag and uh you'll see
where that's useful for late
after they've been built into the final
form they move on to what we call final
provisioning this is a wooden rack we
have set up in our production
environment with some some mounts
so they they get connected up there and
then we run through like a full Suite of
Hardware tests so we make sure that
every piece of Hardware that's inside
that's that's
um on the device like the Imus the GPS
the Wi-Fi the screen all that stuff
that's all tested so we make sure that
that
we know that everything works before we
ship it out to customers
this is also a place where like from
time to time new tests get added because
we've seen failures from the field for
example a few weeks ago we had some
returns of display panels where like the
touch wouldn't work in like a certain
area of the screen so we just added a
test where you just like wiped the whole
screen so we make sure that the whole
screen works and so we that's that's
like the procedure we follow to reduce
failures uh more and more
as time goes on
after that we move on to the stress test
so that's another bigger wooden rack
this is only a small portion of it
um
where the devices are placed on for a
24-hour
cycle test so on this test we put them
under high synthetic loads so we just
max out the CPU usage Max our GPU usage
DSP usage we run the cameras at full
speed run the fans at full speed
um just to make sure that the devices
actually stay working for like a
reasonable amount of time because
um
sometimes like soft works but then like
it heats up and then stops working so
that's the kind of feelings we try to
catch here this is also the place where
we do some longer running tests like we
make sure that the GPS signal doesn't
drop for 24 hours
we make sure that if we toggle fan on
and off once in a while that it starts
back up
we make sure that the camera doesn't
drop any frames during the whole 24
hours
and those those things have really
reduced the amount of fails that we see
in the field
after they've gone through that they're
ready to ship so they could move over to
fulfillment where we automatically test
using the NFC tag because we know where
the device has been so we put the device
on there
uh on our reader let me know if the
device passed all of the tests because
then he always used to be the case in
the old comma two days in the old office
like device would get misplaced and or
like not all the tests would have been
run and then we would get shipped out
anyways so now we explicitly uh
confirmed this uh for the comma three so
you have to make sure that we're the
correct type like if you buy one
terabyte one you get a 32 gig one people
will complain the other way around not
so much but still not still not great
um
domestic orders we include a SIM card
for the comma Prime trials uh
International Auto Zones so that's also
something that's verified
this also tells you which harness the
customer bought so we place the Right
One In The Box it also checks that we
have the latest software uh flashed onto
the device because if it's been sitting
in storage for a while like if we uh we
have some some access inventory it might
be on an old open battle version and the
first clone would take a lot longer
so this is something uh something we try
to prevent and then there's the final
cosmetic inspection before they get the
box gets shut there's also an aoi it's
not automated Optical inspection we call
it Ada Optical inspection because she's
the one that has the the Fulfillment
um
so yeah
and then the heart of failures
um
we used to get emails all the time that
said oh my device doesn't work anymore
and I mean there's not much you can do
about that except for ask the customer
to return the device and then in most
cases it turned out that the device was
fine but it was installed wrong or the
software didn't support that car yet or
there was some other software work that
we didn't know about yet
um
so we recently changed that process and
made sure that when there's Hardware
complaints people actually provide us
with a route where the issue occurs so
that an engineer first looks into the
into the the
alleged failures and if that's actually
someone normally going uh going on then
we get it sent back otherwise we tell
the customers like what's going wrong
and we don't have to do any unnecessary
shipments this is actually reduced or
inbound for for uh
influx like the inbound for the the
failures by close to an order of
magnitude so that's been quite good for
us
within the devices that do come back we
have to take him quite seriously because
usually there's something we can do
about it
um
for example one of the earlier failures
of ecommer 3 had to do with the Somme
stopped failing and it turns out that we
used to use a thermal pad on top of the
main CPU
and with manufacturing tolerances and
thermal cycling that would put too much
pressure inside on top of the dye which
caused some solar failures
so then we change the procedure to go
with a body-based thermal compound which
reduced the the total pressure on top of
the chip by 2X and that practically
resolved the issue overnight
um
another thing we can do is add
additional testing like for example the
touch issue I talked about before like
we just add a lot of tests to make sure
these don't these devices don't get
shipped out in the first place
or we actually can also improve the
design like if it's a an actual design
bug we had one a while back with red
pandas for example where we didn't
account for people plugging in a USB
cable with 12 volts on it on a port that
one's supposed to get 12 volts and then
would blow out the camera and Civics so
that's just fixed we made a new revision
it doesn't happen anymore
and that really translates in the
failure rate so uh George already
alluded to this but the all-time failure
rate of the comma 3 has been at 9.2
percent now
um
it's an interesting number but it's
actually more interesting to look at
what's failure it's been over the last
year
so we load it to 3.9 already
just by improving all these processes
and
to put that into a little bit of expect
perspective George already did some of
this but uh iPhone 6 is 22 recent
iPhones three four percent
um Xboxes 22 percent
PlayStation 3s was it ten percent
we're actually close to a Wii that's
pretty good Hardware apparently
we intend to do a lot better with the 3x
I I think with some uh some more
improvements and with a more reliable
design I think we can get there probably
get it down to like one to one or two
percent
so that's that's pretty pretty good
so uh I mean George gets to announce
Hardware products when we also get to
announce something
um
that's not on there
um
you guys know harness boxes
a lot smaller now we don't I mean
they're in the final stages of testing
so they'll come out in a few months
probably uh injection molded case it
would be a lot easier to fit on the uh
the covers and more scars
then another one that we're coming out
with soon uh New Panda jungle so it's a
can of the V variant it adds a Z card
support it adds per channel effuses uh
per Channel as bu line control all that
stuff that uh has been very nice for
developers internal and hopefully
external as well
so okay I've been talking for says 35
minutes now I'm only I only have 45
minutes so
there's still a lot more that we haven't
talked about
let's party shortages let's talk at all
screwdrivers this packaging this
injection molding boom optimization
cable testing suppliers
harness production mounting plates
through hole soldering display
calibration laser deep analyzation
panels comma bodies you name it the
hardware team has a lot to do
so uh if you're interested reach out to
us we can definitely use an extra hand
or if you have more questions then feel
free to uh
ask him now
[Applause]
all right thank you robba we got a
question up here in the front
thank you
um you talked about compliance testing
are you planning to do only SEC or are
you looking goals so European one like
easy and others
[Music]
um
done the FCC one now the European one is
very similar
so we'll uh we'll probably be complying
with that as well
great
so the um
the harness connector is changing
because you've got a smaller box how do
you make that what's that equation like
for making the trade-off is it time to
uh yes so the the I think the old one
was a 24 pin if I'm not mistaken the new
one is a little bit smaller
um I mean we had to because otherwise
the case wouldn't be smaller uh the new
connectors will just come with the new
harnesses so we'll have to move over the
production a little bit but functional
functionally that's not that big of a
difference it doesn't have a mechanical
relay anymore by the way so we'll get
rid of the little click you hear when
open pilot starts but it'll be a lot
more reliable hopefully so yeah that'll
be good
we got any other questions
oh in the back I'm coming
hi um so I was impressed by your
automated testing on on commits to the
repo uh how is it that you do the diff
between the old board and the new boards
um oh it's it's not super efficient
computationally but we've gotten uh
Eagle the cat package we used to run
inside of the CI Docker container so we
basically just spin up Eagle open the
files generate uh Gerber's then
generates pngs from the girl books and
then we just do an image diff on the two
images
sweet and we're also looking for
Hardware Engineers are there any uh
like networking events that you know of
in San Diego where we can all uh I don't
really know of that many actually no
the truth is that robe is based in
Belgium that's also true
uh so he definitely does not know about
uh the happenings in San Diego oh we got
a question back here
I'm wondering um do you have any
interesting stories about weird issues
that took a long time to track down and
end up having an interesting cause
um
we have so many good bug stories we have
a lot of them there's much bugs in a
deal on both the comma 2 and the comma
3s we've we've had a lot of GPS troubles
um
this apparently like uh the the the the
845s the main chips they leak quite a
bit of RF across the whole Spectrum so
you have to isolate them very well to
not affect GPS uh become a deuce we had
an issue where the
GPS Santana has this internal LNA
amplifier
and so it amplifies a signal but then we
had an issue where it leaked out after
the amplifier into the heatsink and I
got coupled back into the antenna so now
we would get like a feedback loop that
one took a long time to track down
um
all the other ones that we got how about
last week when a vendor sent a wrong
component and mislabeled it oh yeah
that's another great one so last week we
were replacing uh inductors on the
boards on the three axes actually uh
don't worry we fixed it but uh
um
so we got we ordered uh one micro Henry
inductors from a reputable Supply they
came to us we loaded them into the
machine and then uh Hardware guy he like
he needed one so he just took one off
the line and when taking it off we
looked at the Reel and it was like hey
there's two labels on here one of them
says one micro Henry one of them says
2.2
it turns out uh it was the wrong part
so uh yeah
got to be careful even with official
distributors
so we heard George talk about uh custom
Asics where does this stand on the
hardware roadmap have you guys thought
about it at all uh I think George has
some architectural plans but I don't
think that's uh that's that's going to
be concrete anytime soon yeah yeah quite
far off from the budgets needed to uh to
to spin out H6
so people frequently Express concern
over the thermal resiliency of the
devices can you speak about the steps
that you take uh during production for
both the C3 and now the the 3x
um to mitigate that uh yes so I mean the
basic process we follow is we just pass
them at extreme temperatures and then we
make sure that the parts don't fail at
those temperatures we just cycle lots of
times and then we fix the issues that uh
that arise
the second part of the thermal issues is
also not necessarily for failures but
also for uh like user experience for
example when it's like sitting on your
windshield when the sun's blasting on it
the device can get quite hot they want
to cool down as fast as possible so you
actually want to reduce like the total
thermal Mass on the device uh so yeah
there's quite a lot of consideration
going on in the in that regard
but so far with like all the improved
soldering processes we don't see that
many thermal cycling failures anymore so
hey uh
another car
unbox or you know occurring Hardware or
there's like automation inside all that
um well when we get failures back we
often just run them through the
provisioning tests again and that
usually gives us uh like that narrows
down the component that actually failed
and then we disassemble the devices if
you look at the amount of microscopes
and then Trace down what the actual
issue might be
so it's it's mostly a manual process but
we use some of the the production tests
to guide it
all right we've got time for a few more
questions
um yeah I had a question about the GPS
module in the kyotel uh how does that
compare to I think you were using a Neo
m8p yes what do you think like is it
worse better
um I think performance wise it's pretty
similar I think we got on the crackdel
into a mode where it sends us the actual
raw measurements uh and and turn off all
the processing that it does inside
um but the I mean the Crackdown module
uses Qualcomm chips inside and I mean
phones have pretty good GPS these days
so the hardware uh level is quite good
so we got about comparable performance
with uh with the EU blocks modules as we
do with the uh the correct else now
Robo what's your favorite part of the 3x
process the favorite part yeah which one
probably the most Joy
oh that's a difficult one
um
I really like the new image sensors a
little nicer easier throughout we have
battle specs
cool components
we got any additional questions
all right
how do you manage being in Belgium while
they're here
for the hardware guy well you get used
to it it's uh I used to be in San Diego
for a year so I know that the team very
well as well
um and then we communicate over slack so
I make sure when the US is awake that I
got all my questions answered and I can
continue working the next day sometimes
it's nice as well like you just you're
sitting by yourself quiet and you just
plow through it
also he comes in about 1 once a quarter
yeah every Wednesday Rob and I have
lunch meeting yep yep and every Monday
we do a team meeting
commas with super low on meetings yeah
uh we have an all hands and then a team
meeting every week and that's about it
yep
all right thank you so much robba
[Applause]
uh hi I'm wishi I work for research at
comma uh today I'm going to talk about
uh how we view driving with open pilot
as a human machine uh cooperation
problem and how we use machine learning
to improve
things so this is how we drive uh
without open pilot as a human basically
the driver uh is the only actor here but
with open pilot the the driver's roow
slightly changes and uh they will now
work cohesively with open pilot
uh with the driving model specifically
in some way so today's talk will be uh
focusing on different aspects of the
Dynamics between the human and the
driving model uh shown in this
graph um so we will cover how we use the
power of machine learning to uh learn
about the driver and then learn about
the driving model and how we ship uh
many impactful improvements uh along the
way uh as we know uh open pilot as a
driving assistance system uh requires
the user to be able to take over at all
times uh in simple words you need to pay
attention uh we already covered how
driver monitoring Works uh in open pilot
uh from the last ComiCon uh talk two
years ago so today we'll be focus on the
progress we made since that time so this
is what the driver facing camera looks
like on the old comma 2 uh is a bit
noisy but uh mostly uh it's only shows a
limited wheel of the
interior uh for the driver uh due to a
very small wheel on the comma 2 uh to
make things worse uh due to limited
compute on the comma 2 we had to crop
the image and uh fit it into the model
uh it's not fun to do to build a DM like
on inputs like this trust me uh for the
model it was like watching a movie like
with all the people standing in front of
you like blocking the wheel that's
basically how it felt like uh moving to
the comma 3 this is the initial model we
shipped using uh the comma 2 Data before
we had any real uh amount of comma free
data to train
on uh and this is the new model we
training on uh the new comma free uh
data uh and the model we ship currently
uh it's
shown it's shown with the green box uh
which basically covers the whole
interior instead of just some part of
the driver uh now as we can see we can
see the full body of the driver and hand
and even the steering wheel uh and then
the same is true for also the
passenger uh with that uh now we have
achieved on the comma
free Almost 100% of a phase detection
rate uh with that we can remove the
wheel touch uh when the camera is not
blocked and use Vision only for DM uh
yeah because it's it's not the best idea
to assume the driver isay paying
attention when they are touching the
wheel because that can easily be cheated
like in a Tesla uh so another thing we
can do was to uh remove the right hand
drive tole with the model now can uh now
being able to detect whether uh which
side the driver is driving on uh say
you're in like the US you're on the
right in this image or or you're on the
other side if you're driving on the
wrong side of the road um
so with that we can remove the right
hand drive Targo uh one last too is
always better as ad deep says uh we will
come back to that uh passenger thing a
little bit later um so in terms of uh
true
positive we have achieved a net gain of
almost 2x in true alert true POS true
positives by using a model a bigger
model box and then now we have we also
have the extra benefit of the extra
contacts we have with the full interior
camera
um with the extra context we are able to
build upon it to do this so last time on
my uh ComiCon presentation I mentioned
that we will explore moving to a more
endtoend
approach a more a more endtoend approach
uh for DM uh now I think is a good I
think it's a good time to do that so in
a classic DM policy we have the model
that predicts some attributes of the
driver and then those are fat into some
stay machine to determine whether the
driver is distracted but in the end to
endend DM world the model should be able
to tell from the footage like whether
the driver is paying attention or not
directly so here is an example of the a
deep
driving as you can see other than uh
when he was looking right uh on the at
the row or when he was like like
straight distracted by his phone there's
also a lot of gray areas there uh as a
human even as a human is tough to tell
like whether sometimes he's paying
attention or not so we need
to Define attention to be able to like
have good ground through for N2 and DM
to learn
from uh here's a hint DM doesn't live in
a vacuum it's part of the system a part
of the open p system so what is
attention
really so the answer the answer really
is quite simple uh we are to know that
open pilot is a driving assistance
system again uh the driver should always
be ready to take control so with that in
mind uh we are ready to get our gr with
that with with that in mind it's simple
that the paying
attention definition should be whether
the driver is ready to take control at
any
time with that in mind we're ready to
get our ground TR for the end to end DM
system so uh we make two two simple
assumptions the first one is uh the
probability of taking control is higher
when the driver is driving or taking
control that's pretty obvious and the
second one is uh the probability of not
not taking control is higher when the
car is at a sand
Feld so turns out we already has those
things in the in the locks for a long
time uh therefore you can just use them
to train the model uh to predict from
the driver footage whether uh the driver
is ready to take control or
not um so with
those uh
naive ground Trigg adjustment mentioned
we train uh vanilla n2m model that
predicts whether the driver is
distracted from uh some frames and you
can see that uh it sometimes reliably
detects uh when the driver is really
distracted like the was looking out the
window he was definitely not ready to
take control here but the all the model
also thinks the was not ready to take
control here which where he was just
chill driving and so it's this he was
looking at a row while turning the radio
which in a taking control context is
fine so we need to fix those false
positives so we we realize that the only
way to fix all the
ambiguity which it's probably a it's
most likely a finite set is to have the
re a real human to label some of those
difficult scene uh cases uh because of
the fact that uh we already have a
helper model that's trained on vanilla
DM uh labels we can use that model to
find how us find all the interesting
stuff and then only 2% of our entire set
ends up uh needing to be uh labeled to
get the perspective we outsourced the
laboring work to a thir party and it
took them only one person in less than
three days to do our labeling we pay
virtually nothing to uh gain a lot of
improvements in our ground
tro so with that improved ground tro and
our n2n DM model train on that uh the
model is now able to pick up additional
subtle distractions like uh using phone
uh without force triggering on CH
driving poses like in this examples uh
in in this example shown here uh
whenever the timer drops it means the
system things a DE is was distracted so
you can see this is very accurate
because uh the when the timer jobs is
where ad was really not able to uh be a
to take control so uh to put it in a
number with a number um we have metric
showing that the net result of adding
nend to end policy is to have a 15% gain
in false in true positive with no false
positive
gain so now let's uh change our Focus
onto the driver uh by looking at some
behavioral
metrics uh remember in uh fullframe DM I
mentioned earlier we are now able to
detect uh from DM model if there's a
passenger or not so by overlaying that
with the driving data we came to the
surprising conclusion that
um when when people drive alone compared
to driving with passenger they are four
times more likely to take a corner over
half a
g and two and a half times more likely
in uh heart bre
heartbreaking and twice uh as like twice
more likely to uh tailgate
someone um so
that all that uh
aggressive all that aggressiveness
difference in uh
driving from having a passenger not
inspired us to uh do a whole driving
style analysis on our Fleet we basically
classify driving style using matrics
like heartbreaking uh heart heart
acceleration or like heart turning
Etc and then those things I use as a
conditioner to uh fit into to the
driving model and as Harold mentioned by
using like the chist profile we actually
make uh Taco Bell Drive much easier by
making Drive
smoother so another metrics that is
super important to our company is that
uh we need to understand the relation
between making driving chill and
potentially making driving uh more
making drivers more prone to
distractions uh as always we we talk
with numbers and we have metrics for
exactly
that um so the first conclusion from our
metrics is that uh drivers generally pay
more attention to the role when you
using W pilot then not using W pilot oh
so here the green curve shows uh the um
distribution of segments with different
percentage of distracted times when
engage with open p in uh green or not
engage open B in Red so essentially uh
the more left to the curve the more left
the curve uh the less distracted the
drivers are
so we can see that uh when engaged uh
drivers are generally less distracted uh
that number actually is around
40% so that's a
big big Improvement so actually it's
actually not too surprising to imagine
these things because with open pilot um
it first takes away the taxing stuff
from driving and allows you to pay more
attention pay more attention to the
surroundings and also it it's hard to
not pay attention when like it yells at
you when you get distracted
um the second one is actually more
interesting uh there's a common doubt
that if you been using open p for a long
time you start to lose attention and
become complacent and in the long run so
but our long run uh metric disagrees
with that uh this is an aggregate of the
same bunch of drivers in the long
term
um distraction Trend Trends and the
lines remain pretty flat uh for
different percen of distraction
durations so we are confident that
um the driver our users don't get more
distracted as time goes
by so now uh with the driver out the way
now Tech uh talk a little about the
driving model itself so the model is a
integral part of the of our human
machine system uh and it's crucial that
we understand how the driver can
interact with it and how it can uh
potentially interact back with the
driver and make the experience more more
coherent
coherent uh the human driver mostly
interacts with the driving model by
disengage by disengaging or overriding
uh those disengagements give us a strong
signals of when and uh hopefully why uh
the model doesn't do well and therefore
we've been putting a lot of effort uh
into building and looking into um
disengagement metric uh we have been
tracking the longest time uh open pilot
can be engaged which is e uh which is
easily in the in the hours uh it's good
to know open pilot works but this kind
of stuff all look like this and uh it
can't really help us improve it's like
similar to someone uh who learn driving
on the highway only and they can't
really learn anything so the question
have been we have been asking lately a
lot is uh where do open pilot users tend
to take over and we build
this uh this is our automatic
disengagement uh
reports
um so is a tool that enables us to uh do
large scale up to dat dis engagement
analysis so it runs steady automatically
and it's shown our on our biggest TV in
research essentially it gathers all the
lateral and longitudal override data as
well as the unexpected uh disengagements
and uh and then with all the locks uh
pared we are able to uh
group group all the disengagements by
the by the dis disagreements between the
human and the model uh so that we can
split them in different classes as shown
here and here are just some examples of
different kinds of uh
disengagements
um so basically uh we show a list of
random example for each kind of
disengagements on the reports and then
everything is visualized with the
necessary data uh like in the gift here
we can see uh in this
report uh there's been turn cutting and
we we can like go to the turn cutting
person in comma which is one person and
say turn cutting team which is one
person and say oh there's been a lot of
cutting lately uh what's going on and
then uh hopefully it can have it
fixed so here uh here is another example
of how we uh use this report to fix uh
real
complaint so there's
been as people know like there's a lot
of noise about um people asking oh we
need to adjust the following distance is
following too far on the highway
sometimes like this Discord user
Johnson and uh yeah we we listen to that
and but we need to back that out with
data so we look at the disengagement
reports and we saw this H there's like
uh so you can see there's a more than
30%
of our longital disengagements is due to
the model fallowing too close or it's
breaking too hard too early for a Le car
so we know that this is a real problem
and then by like giving this to the the
right person we were able to figure
out not only this is a real problem but
also we know how much we need to fix
this problem so we come up with uh the
latest longital personality toggle in
our
settings uh so the last point I want to
discuss is um how the driving model can
potentially give feedback back to the
driver to communicate his
uncertainty so uh first of all how do we
know if the the model is uncertain uh
for some given scene so well we can we
can we can try to ask the model itself
since we already have the model output
uh some
disengagement predictions for a given
amount of seconds in the
future
uh so actually here we have Matrix to
that com compares the actual
disengagement disengagement numbers
versus the model predictions and we can
confidently say that they match pretty
well so um we can rely on the model
itself to tell oh whether it's certain
or
not uh here is a spectrum of scenes that
the model is feeling
different degrees of confidence on the
left we have the the boring stuff the
it's just like straight Long Highway
roads and in the middle we have traffic
and some interesting Country Roads and
maybe sitting behind an MPD car at a
traffic
light uh which makes the model more un
certain and on the right side we have
like things where open scenes where open
product can would probably not work like
merging this UK narrow row or turning
onto this busy street after stop
sign so the first step uh we can do is
to show uncertainty in some kind of uh
confidence indicator in UI this is
actually a work in progress we we're
doing now uh so remember that in uh 094
we ship the always on border which means
it always communicates the engagement
status so we're thinking oh why not we
can use that and change that to
something less green when the model is
less
confident so that so say in this example
here it's just like one lane row it driv
fine but here then like 2 seconds later
it sees this
potential Divergence and it becomes less
confident and might might need your
attention so it's nice to have that
dynamic between the model and the driver
and also like say when the bur finally
poops on your car it probably becomes R
so um yeah that was my
[Applause]
talk
all
right hey great talk um couple questions
for you uh what's your overall thought
on this the
long-term uh time and investment that's
going to be spent with DM um as we
actually every day get closer and closer
to level four level five where
conceivably you don't care that if the
driver's asleep or in the back seat
completely what what's what's your
general thought on that uh how that's
going to evolve I mean in the context of
open pilot we probably always we require
the the user to pay attention but in
terms of level four level five I would
say the there will be in the future some
interplay between like how confident the
model feels and how the DM policy should
adapt I think that's the final goal okay
that makes sense so maybe certain times
it might be needed but other times it
would be fine and may alert the user to
hey we need you to probably pay
attention now safer but in general
you're okay yeah we already have some
adaptive DM policy uh in place so that
may be a good place to start okay and
then just quick question on um the
actual eye like eye gaze and tracking on
that yes um I know with like uh Teslas
you can just put on sunglasses and it it
says yeah he's paying attention even
though your eyes can be completely
closed um does this system have anything
with like eyewear or glasses that you
know that it's not detecting eyes and
does it assume that you're fine I don't
know if that's it's common knowledge of
how that works or not I think whenever
your eyes is invisible visble it just
falls back to a head pose and uh the end
to end policy is actually really good
that when you have some Weir poses other
than you know just normal driving
position say you're sleeping when you're
wearing sunglasses it can probably pick
that up and say oh there's an anomaly
here great I got a question here in the
back hello awesome talk uh they think
that near symbolic approach with some
something like um propositional logic
will be viable solution for deeper
understanding of actors in
environment uh sorry can you repeat uh
do you think that in future a near
symbolic approach with uh formal logic
declarative logic with uh sub symbolic
models will be viable to deeper
understand the uh behavior of actors in
environment to predict future
I'm not sure about symbolic near
symbolic it's like U deep learning plus
uh declarative logic oh I
see uh I mean our end goal is to have
end to endend driving model that just
looks at the scene and tells us where to
drive and potentially like how confident
it is about like doing this path and I
think in the future as the driving model
gets better it should just be able to
tell like naturally with our end to end
approach does that make
sense I wonder if you could share a
little bit about um how you classify and
what uh breakdowns of data you get from
classifying drivers as chill or not it's
a fascinating topic for me I I've gotten
old and I use open pilot a lot so I
mostly Drive chill but every once in a
while while I throw my car uh on an
autoc crosscourse and I use open pilot
as a Data Logger so is there a memory to
that are you classifying per segment per
route per device and uh rout as a
off-the-wall question uh how many open
pilot users would you say are good
drivers I mean we classify them into
five categories basically um but I don't
think we track like that's Dongo ID we
more like focus on the route I believe
yeah got anything else wish Shing that
was a lengthy question you satisfied
with the answer
Jason you kind of dodged the one where I
asked how many open pilot users were
good
drivers it'll be op in to share this
with your insurance
comp all right we got a question
upstairs
uh thank you uh if if U if you come back
to like U two slides but in terms of
like giving feedback um to the customer
about uncertainties um communicating
um I'm thinking uh if if it's possible
at all but uh yeah not exactly that but
where where you had like um uncertain
um model being are certain about
specific and trying to communicate back
to the to the
driver uh not not this one like uh the
the real like um Mo up of the road like
with a vehicle like the picture like few
more slides uh few more maybe like
forward not not back oh the one with the
driving behavior yeah yeah yeah here no
no no no this one of the last ones like
uh uh which
one yellow one oh this one wait no no no
with with the RO like oh sorry sorry
yeah yeah sorry
so this one uh no no more
more no no you're you're going to the
right direction to the to the end of the
presentation yellow forward looking
statement oh that sorry that's this one
almost I'm thinking uh I don't know if
it's possible at all but it would be
nice if uh if it could also communicate
some areas where it does not want to go
like like for example if there is like
vehicle parked or like you know some
blockage or whatever so like uh like
maybe in like I don't know in the red
yeah we can have a hard cut off like
ideally for like some sketchy of the
scene and say oh you should probably
disengage here and give you a super
short timeout anyway does that make
sense yeah cool stuff thank
you all right
I'm coming over here
hey aome talk um you mentioned you make
some assumptions to determine whether
the driver is attentive yeah like um
like if they're driving they could be
more attentive if they're at a stop
maybe less attentive so I was wondering
like I assume these are neither
conclusive nor do they always hold so in
the future do you think it's possible to
also use data from the driving model
like maybe if someone's drifting out of
the lane or if they sto more suddenly
than the model was do you think that can
be used as a negative signal for the
driver
monitoring uh do you mean when engage or
not um I I guess either way either way
um yeah I think desktop is a little bit
more far away from like what we're
looking for because in here although
those things might not seem immediately
obvious you can see in the data there's
a distribution shift from say taking
control not or like being stand or not
and we picked up that signal and we
Capital capitalized on on that to
determine whether the driver is ready to
take
over I think that's good enough with
some we find
them uh oh I have like a kind of a
farfetched question but uh have you ever
considered using driver monitoring to
not just communicate like uncertainty
between the model and the human but uh
somehow have the human communicate
intent uh back to the driving model for
example uh during a lane change yeah if
the human is looking in the rear view
mirror you could use that as a signal
that the human wants to like is
affirmative that it knows it can turn
that yeah but we cannot always assume
that
there will be a lot of force positive
so whichever way all right we got
interesting form one last
question do you measure the driver
takeover or disengagement reaction time
somehow uh in like when model is
uh uh open by the driving for 2 hours
and uh do you see that uh it affects
driver's reaction time in case it he
needs to
disengage uh what's the question again
uh do you measure somehow the uh
driver's reaction time uh does it change
uh if the open B has been driving for
for example two or 3 hours without
disengagements you mean the the DM
pressure of time mouse
or the
model
confidence SL engagement if if there is
an
uh uh if there's oh that uh we don't
have metrics for that but I think like
the the second long-term DM metric is
pretty conclusive
about like people using own Val for a
long
time okay thank you
all right actually we got one one more
question someone over here have a
question we
good all right thank you so much wishing
thank
you
[Applause]
hello hello uh hi I'm wishing I work for
research at coma uh today I'm going to
talk about how we view driving with open
pilot as a human machine cooperation
problem and how we use the machine
learning to improve things
so this is how we drive without oven
product as a human basically the driver
is the only actor here
but with open pilot the drivers throw
slightly changes and they will now work
cohesively with open pilot with the
driving models specifically in some way
so today's talk will be focusing on
different aspects of the Dynamics
between the human and the driving model
shown in this graph
um so we will cover how we use the power
of machine learning to learn about the
driver and then learn about the driving
model and how we ship many impactful
improvements along the way
as we know open pilot is a driving
assistant system requires the user to be
able to take over at all times in simple
words you need to pay attention we
already covered how driver monitoring
Works in open pilot from the last
Comic-Con talk two years ago so today
we'll be focused on the progress we made
since that time
so this is what the driver facing camera
looks like on the old comma 2 is a bit
noisy but mostly uh it only shows a
limited wheel of the interior
uh for the driver due to a very small
view on the common two uh to make things
worse due to limited compute on the
comma two we had to crop the image
and fit it into the model
is not fun to do to build a DM like on
inputs like this trust me for the model
it was like watching a movie like with
all the people standing in front of you
like blocking the wheel that's basically
how it felt like moving to the comma
three this is the initial model we ship
using uh the comma 2 Data before we had
any real amount of common free data to
train on
and this is the new model we train on uh
the new common free data
and the model we shipped currently uh is
shown
is shown with the green box which
basically covers the whole interior
instead of just
some part of the driver now as we can
see we can see the full body of the
driver and hand and even the steering
wheel and then the same is true for also
the passenger
uh with that now we have achieved on the
comma three
almost 100 of a face detection rate uh
with that we can remove the wheel touch
uh when the camera is not blocked and
use Vision only for DM uh yeah because
it is not the best idea to assume the
driver is paying attention when they are
touching the wheel because that can
easily be cheated
like in a Tesla uh so another thing we
can do was to remove the right hand
drive toggle with the model now can now
be able to detect whether which side the
driver is driving on uh say in like the
us or on the right in this image or
you're on the other side if you're
driving on the wrong side of the road so
with that we can remove the right hand
drive toggle one last toggle is always
better as a deep says we'll come back to
that uh passenger thing a little bit
later
so in terms of true positive
we have achieved a net gain of almost 2x
in true alert 242 positives
by using a model a bigger model box and
then now we have we also have the extra
benefit of the extra contacts we have
with the full interior camera
um
with the extra contacts we are able to
build upon it to do this so last time on
my common confrontation I mentioned that
we will explore moving to a more
end-to-end approach
a more end-to-end approach for DM
uh now I think it's a good
I think it's a good time to do that so
in a classic VM policy we have the model
that predicts some attributes of the
driver and then those are fed into some
State machine to determine whether the
driver is distracted but in end-to-end
DM world the model should be able to
tell from the footage like whether the
driver is paying attention or not
directly
so here is an example of the deep
driving
as you can see
other than when he was looking right on
the road at the row or when he was like
straight distracted by his phone there's
also a lot of gray areas there as a
human even as a human it's tough to tell
like whether sometimes he's paying
attention or not so we need to
Define attention to be able to like have
good ground true for end-to-end DM to
learn from
uh here's a hint DM doesn't live in a
vacuum it's
part of the system a part of the
overhead system so what is attention
really
so the actual the answer really is quite
simple uh we already know that open
pilot as a driving assistant system
again the driver should always
be ready to take control
so with that in mind we are ready to get
our Branch with that
with that in mind it's simple that the
paying attention
definition should be
whether the driver is ready to take
control
at any time
with that in mind we're ready to get our
ground through for the end-to-end DM
system so we make two two simple
assumptions
the first one is uh the probability of
taking control is higher when the driver
is driving or taking control that's
pretty obvious
and the second one
is the probability of not not taking
control is higher when the car is at the
same seal
so turns out we already has those things
in the in the logs for a long time uh
therefore you can just use them to train
the model to protect from the driver
footage whether the driver is ready to
take control or not
um so with those naive
the ground true I just mentioned we
train vanilla end-to-end model that
predicts whether the driver is
distracted from
some frames and you can see that it
sometimes reliably detects when the
driver is really distracted like the day
was looking out the window
he was definitely not ready to take
control here but the all the model also
thinks adiva is not ready to control
here which where he was just
chill driving and so is this he was
looking at a row while turning the radio
which in a taking control context is
fine so we need to fix those false
positives
so we're not we realized that the only
way to fix all the ambiguity
which
it's probably a it's most likely a
finite set is to have the real human to
label some of those difficulty uh cases
because the fact that we already have a
helper model
that's trading on vanilla DM labels we
can use that model to find help us find
all the interesting stuff and then only
two percent of our entire ends up
needing to be labeled to get the
perspective we Outsource the laboring
work to a third party and it took them
only one person in less than three days
to do our labeling we pay virtually
nothing to uh gain a lot of improvements
in our country
so with that improved ground truth and
our end-to-end DM model training on that
the model is now able to pick up
additional subtle distractions like
using foam without false triggering on
chill driving poses like in this
examples uh in
index example shown here
whenever the timer drops it means the
system thinks a deep is was distracted
so you can see
this is fairly accurate because
the when the timer drops is where a d
was really not able to be ready to take
control
so to put it in a number with the number
um we have metrics showing that the net
result of adding end-to-end policy is to
have a 15 gain in force in true positive
with no false positive gain
so now let's uh change our Focus onto
the driver
by looking at some behavioral metrics
remember in full frame DM I mentioned
earlier we are now able to detect from
DM model if there's a passenger or not
so by overlaying that with the driving
data we came to the surprising
conclusion that um
when
when people drive alone compared to
driving with passenger they are four
times more likely to take a corner of
half a g
and two and a half times more likely in
heartbreak heartbreaking
and twice as like twice more likely to
uh tailgate someone
um so that
all that uh aggressive
all that aggressiveness difference in
driving
from having a passenger not Inspire us
to do a whole driving style analysis on
our Fleet we basically classify driving
style using metrics like heartbreaking
heart
heart acceleration or like heart turning
Etc
and then those things I use as a
conditioner
to fit in to the driving model and as
Harold mentioned by using like the
chewiest profile we actually make Taco
Bell Drive much easier by making it
drive smoother
so another metrics that is super
important to our company is that we need
to understand the relation between
making driving true and potentially
making driving more making drivers more
prone to distractions as always we we
talk with numbers and we have metrics
for exactly that
um so the first conclusion from our
metrics is that uh drivers generally pay
more attention to the role when using
movement than not using Google pilot oh
so here the green curve shows uh the
distribution of segments with different
percentage
of distracted times when engaged with
open in green or not engageable but in
Red so essentially uh the more left the
Curve
the more left the curve the less
distracted the drivers are
so
we can see that when engaged
drivers are generally less distracted
that number
actually is around 40 percent
so that's perfect
big Improvement
so actually it's actually not too
surprising to imagine these things
because with open pilot it first takes
away the taxing stuff from driving and
allows you to pay more attention pay
more attention to the surroundings and
also it it's hard to not pay attention
when like it yells at you when you get
distracted
um the second one is actually more
interesting there's a common doubt that
if you've been using open pilot for a
long time you start to lose attention
and become complacent and
in the long run so but our long run
metrics disagrees with that this is an
aggregate
it's the same bunch of drivers in the
long term
um
distraction chance Trends and the lines
remain pretty flat for different
percentiles of Destruction durations so
we are confident that um
the driver our users don't get more
distracted as time goes by
foreign
talk a little about the driving model
itself so the model is a integral part
of the of our human machine
system
and it's crucial that we understand how
the driver can interact with it and how
it can potentially interact back with
the driver and make the experience more
more coherent coherent
the human driver mostly interacts with
the driving model by disengage but
disengaging or overriding those
disengagements give us a
strong signals of when and hopefully why
the model doesn't do well and therefore
we've been putting a lot of effort into
building and looking into um this
engagement metrics
we've been tracking the longest time own
pilot can be engaged which is which is
easily in the in hours it's good to know
open pilot works but this kind of stuff
all look like this and it can't really
help us improve it's like similar to
someone uh cooler and driving on the
highway only and they can't really learn
anything
so the question have been we have been
asking lately a lot is uh where do open
pilot users tend to take over and we
build
this
this is our automatic disengagement
reports
um
so it's a tool that enables us to do
large scale up-to-date disengagement
analysis so it runs daily automatically
and is showing our on our biggest TV in
research essentially it gathers all the
lateral and longitudinal override data
as well as the unexpected disengagements
and uh and then with all the logs
parsed we are able to group
group all the disengagements by the
by the this disagreements between the
human and the model
so that we can split them into different
classes as shown here and here are just
some examples of different kinds of
disengagements
uh
so basically uh we show a list of random
example for each kind of disengagements
on the reports and then everything is
visualized with necessary data
like in the gifs here we can see uh in
this report
there's been turn cutting and we can
like go to the tone cutting person in
comma which is one person
and say
a term cutting team which is one person
and say oh there's been a lot of cutting
lately uh what's going on and then
hopefully I can have it fixed
so here here is another example of how
we use this report to fix a real
complaint
so there's been
as people know like there's a lot of
noise about um people asking oh we need
to adjust the following distance
is following too far on the highway
sometimes like this Discord user Johnson
and uh
yeah we listened to that and
but we need to factor out with data so
we look at the disengagement reports and
we saw this
hmm there's like uh so you can see
there's a more than 30 percent
of our longitudinal disengagements is
due to the model following too close or
it's breaking too hard too early for a
lead car so we know that this is a real
problem and then by like giving this to
the the right person
we were able to figure out
not only this is a real problem but also
we know how much we need to fix this
problem
so we come up with uh the latest
longitudinal personality toggle in our
settings
so the last point I want to discuss is
how the driving model can potentially
give feedback back to the driver to
communicate his uncertainty
so uh first of all how do we know if the
the model is uncertain
for some given predictions for a given
amount of seconds in the future pretty
well so
um we can rely on the model itself to
tell a piece of traffic yeah the traffic
lights
which makes the model more uncertain
and on the right side we have like
things where I've seen where umphalic
can would probably not work like
converging this UK narrow road
or turning onto this busy street after
stop sign
so the first step we can do is to show
uncertainty in some kind of
confidence indicator in UI this is
actually a work in progress we're doing
now so remember that in 094 we ship
the always on border which means they
always communicates the engagement
status so we're thinking oh why not we
can use that and change that to
something less green when the model is
less confident
so that so say in this example here it's
just like one laying row it drives fine
but here then like two seconds later it
sees this potential
and Divergence and it becomes less
confident and my my need your attention
so it's nice to have that dynamic
between the model and the driver
and also like say when the bird finally
poops on your car it probably becomes
red so yeah
that was my talk
[Applause]
all right
hey uh great talk
um a couple questions for you uh what's
your overall thought on this the
long-term uh time and investment that's
going to be spent with DM
um as we actually every day get closer
and closer to level four level five
where conceivably you don't care that if
the driver's asleep or in the back seat
completely what what's what's your
general thought on that uh how that's
going to evolve
I mean in the context of open pilot we
probably always we required the user to
pay attention but in terms of level four
level five I would say the
there will be in the future some in the
play between like how confident the
model feels and how the DM policy should
adapt I think that's the
final goal okay that makes sense so
maybe certain times it might be needed
but other times it would be fine it may
alert the user to hey we need you to
probably pay attention now to be safer
but in general you're okay otherwise
yeah we already have some adaptive DM
policy uh in place so that might be a
good place to start okay and there's a
quick question on the actual eye like
eye gaze and tracking on that yes um I
know with like uh Teslas you can just
put on sunglasses and it it says yeah
he's paying attention even though your
eyes can be completely closed does this
system have anything with like eyewear
or glasses that you know that it's not
detecting eyes and does it assume that
you're fine I don't know if that's it's
common knowledge of how that works or
not I think whenever your eyes are
invisible it just falls back to a head
post and uh the end-to-end policy is
actually really good that when you have
some weird poses other than you know
just normal driving position say you're
sleeping when you're wearing sunglasses
it can probably pick that up and say oh
there's an anomaly here
great I got a question here in the back
hello awesome talk uh do you think that
symbolic approach with some something
like a prepositional logic will be
viable solution for deeper understanding
of actors in environment
uh sorry can you repeat do you think
that in future
nearly symbolic approach with formal
logic declarative logic with sub
symbolic models will be viable to deeply
understand this behavior of actors in
environment to predict future
I'm not sure about symbolic
symbolic it's like deep learning plus
declarative logic oh I see
uh I mean our end goal is to have
end-to-end driving model that just looks
at the scene and tells us where to drive
and potentially like how confident it is
about like doing this path and I think
in the future as the driving model gets
better you should just be able to tell
like naturally with our end-to-end
foreign
does that make sense
I wonder if you could share a little bit
about
um how you classify and what uh
breakdowns of data you get from
classifying drivers as chill or not it's
a fascinating topic for me I I've gotten
old and I use openpile a lot so I'm
mostly Drive chilled but every once in a
while I throw my car
on an autocross course and I use open
pilot as a Data Logger so is there a
memory to that are you classifying for a
segment per route per device and as a
Off the Wall question uh how many open
pilot users would you say are good
drivers
I mean we classify them into five
categories basically
um
but I don't think we track like specific
dongle IDs we're more like focus on the
route I believe yeah
anything else wishing there's a
lengthy question
are you satisfied with the answer Jason
I think you kind of dodged the one where
I asked how many open pilot users were
good drivers
all right we got a question upstairs
some I'll send you uh if if you come
back to like um two slides but in terms
of like giving them feedback um to the
customer about insertment is
communicating
um
I'm thinking uh if it's possible at all
but uh yeah not exactly that but very
very had like um
I'm certain
Model winner so uncertain about specific
and trying to communicate it back to the
to the driver
uh not not this one like uh the the real
like um mock-up of the road
like with the vehicle like the picture
a few more slides a few more maybe like
forward not not bad or the one with the
driving behavior yeah yeah here no no no
no there's one of the last ones like uh
which one
the red and the yellow one oh this one
okay no no no it was the road oh sorry
sorry yeah yeah sorry it's uh
this one uh no no more
no no you're going to the right
direction but it was like to the end of
the presentation
oh that
that sorry
yeah
I'm thinking uh I don't know if it's
possible at all but it would be nice if
uh if it could also communicate some
areas where it does not want to go like
like for example if there is like
vehicle parked or like you know some
blockage or whatever so like uh like
maybe in like I know in the red
yeah we can have a hard cut off like
ideally for like some sketchyness of the
scene and say oh
this report is engaged here
give you a super short timeout anyway if
that makes sense
yeah cool stuff thank you
all right
[Applause]
coming over here
awesome talk um you mentioned you make
some assumptions to determine whether
the driver is attentive yeah like um
like if they're driving they could be
more attentive if they're at a stop
maybe less attentive so I was wondering
like I assume these are neither
conclusive nor do they always hold so in
the future do you think it's possible to
also use data from the driving model
like maybe if someone's drifting out of
the lane or if they stop more suddenly
than the model was do you think that can
be used as a negative signal for the
driver monitoring
uh do you mean when engaged or not
um I I guess either way either way um
yeah I think desktop is a little bit
more far away from like what we're
looking for because in here
although those things might not seem
immediately obvious
you can see in the data there's a
distribution shift from say taking
control not or like being extensive or
not and we picked up that signal and we
capitalize capitalize on on that to
determine whether the driver is ready to
take over
I think that's good enough with some
refinement
uh oh I have like a kind of a bark batch
question but uh have you ever considered
using driver monitoring to not just
communicate like uncertainty between the
model and the human but uh somehow have
the human communicate intent uh back to
the driving model for example uh during
a lane change yeah if the human is
looking in the rearview mirror you could
use that as a signal that the human
wants to like is affirmative that it
knows it can turn that
yeah but we cannot always assume that
there will be a lot of false positive so
whichever way all right interesting one
last question
what do you measure that driver takeover
or disengagement reaction time somehow
I think like when model is
open pilot is driving for two hours and
to see that it affects drivers reaction
time in case if he needs to disengage
uh what's the question again
do you measure somehow the driver's
reaction time uh does it change if the
open bud has been driving for for
example two or three hours without
disengagement you mean the the DM
special timeouts or
the model
confidence
investigations if if there is an uh
okay
uh
we don't have metrics for that but I
think like the the second long-term DM
magic is pretty conclusive about
like people using umbrella for a long
time
actually we got one one more question
do you have a question again
all right
thank you so much wishing thank you
all right
guys about wearing any comma mark I'm
wearing an augur hoody though I'll have
auger
I got great merch all right up to this
sculpey I don't know is it broken
all right we can't go inside the office
anymore
this is working I can't see my followers
a49
wow we have so much followers okay we
can't go inside the office anymore
because honestly guys there's too many
secrets in the office there's too many
secrets everywhere you look there's a
secret
look here like Here I am on the hood of
my Accord if you look carefully there's
actually a secret in the image right
like there's secrets everywhere
um but what I am showing you all today
yeah
bra bra look I shaved bras yeah all
right look this is a a super-secret see
like I can't go anywhere without there
being secrets look at this this is a
super secret your dad your ass super
secret oh look at that secret I'm glad
you guys are enjoying open pilot we love
to have you on board with the comma army
if you guys saw the label article it
makes me so happy
not that way most doing badly I'm not
happy that way Mo's doing badly I'm
happy that the truth is being revealed
all the maps I told you I'll show you
the maps last time we can't go inside
guys there's just all that I said this
is a current monitor this is a USB
current monitor so we just can make sure
that it's outputting enough current you
walk the EON and you can get a sticker
who said stickers would be included if
you show me where terrible I don't know
let's go in the back let's go in the
back you guys want to say highness go
peace
yeah yeah well say I don't look at that
yeah check out our Cadillac guys we're
pivoting we're pivoting to light are
unspinning light are all this law we
need Wi-Fi outside I think we did an
Access Point outside just for the scope
is on the comet tree is that banner I
think we even have worse cell reception
it's so terrible look at the comet tree
look at the comet tree up there it's
beautiful I can't even watch it it's
working look at the beautiful comet ray
no we just don't have good reception but
you know we wanted to show you look we
have line ours and then to solid state
light ours the line aren't you know
maybe the lighter is using the Wi-Fi no
I switched to sell congrats George light
ours the smart you guys we're trolling
you only this car has lidar and it's to
calibrate and validate our maps okay
we're proving that our maps are how
accurate 10 centimeters that's right
that's right because if we don't use
lidar we can't show you how accurate our
maps are to 10 centimeters no no no no
lidar for validation purposes only on
this beautiful Cadillac especially these
solid state light arts they work great
all right guys umm if we didn't see it
we're gonna take a quick look at the
Hyundai Santa Fe and this is just a hype
scope II don't worry we're not really
using lighter we're not gonna make you
know what's that light our costs that
things are twenty five thousand dollars
twenty five thousand well let's look in
here look you can see 3d printers oh
what's plugged into the Panda oh that's
a USB current monitor but this scope is
all that hype and that's most of it you
guys saw the hype we got lidar on our
Cadillac that I touched the light are
good lidar alright this is our this is
our hand i Santa Fe
hopefully the quality is a little bit
better now that I will leave you guys
right in the Santa Fe look at that yeah
anyone looks kind of funny
that's crazy Eon yeah right
no that's crazy yeah look at that II
know that's crazy Wow crazy yo all right
bro yeah I know right ladders so
expensive you want us to use ladder now
if you thought eons were expensive at
$6.99 which by the way get in bye bye
bye no no no this is a this young case
yeah I'll just I'll just show you guys
look look look at look at the craziness
oh look at that beautiful all right
I'm sorry about the lag yeah yeah yeah I
know just when you guys are seeing
secrets
where are the maps real Oleg you know
exactly when the maps are coming out you
know exactly when they're coming out we
have some more stock not too much though
eons are gonna run out and probably like
a little under a month at the current
rate um no STL file come on I'll give
you the STL file all right let's just
I'm just gonna will leave the last scene
of the periscope will be me touching the
lidar thank you thank you look good
lighter good light are good lighter you
cost you cost one quarter of an
employee's salary for a year good
lighter oh okay bye vice Covey's all
hype
yeah it's gonna be a really short
periscope cuz it's not quite ready yet
but guys I just got my Aeon in the mail
this thing is awesome like this thing is
super nice I think you're gonna be happy
with it you know I got I got Spotify
here I got ways over here just give a
second to load here I drove home with
one of these on Schaffer plus shipper
plus is nice it's pretty nice yes press
combo you go home your settings menu so
yeah you'll be able to do things like
naval phone collision warning honeywell
ssh so you can turn ssh on the off Wi-Fi
notice the Bluetooth settings your eon
is going to support bluetooth connecting
it to your car this one does have a Sun
coordinate it will also work without a
SIM card and Neos I know need SIM cards
at least like boot logged out I can
reset my calibration there's my dongle
ID yeah but it's not quite finished yet
but we're getting close like check out
the new sidebar doesn't that look nice
to be able to just press new destination
it will take you right here two ways it
shows your current destination on this
screen like the weather right here it
knows where you are yeah yeah it's based
off it's based off of one Plus Android
device of course it's just logging here
I like to Spotify a throwaway for
Spotify you know I'm not gonna shake as
my secret Spotify login you
what's up
so you just log in same way I'd log into
anything else in my Spotify
check it out bros of course you probably
want to do this over over bluetooth the
unity on sound system exists it's good
enough for ways and be probable turns
into a console system we also support
the old school that's a headphone jack
so you can plug that right into your car
or your radio thing losing like pop
songs but quick periscope just want to
tell you guys how excited I am that I
got my tea on in the mail today and it's
pretty cool that's that thanks for
watching
what up I'm just telling scoping for
giraffe yo so re from slack cent come AI
a beautiful Ford giraffe
not that that's a wire Ford giraffe
alright so let's go get some cable ties
out of this box here yeah yeah re
all right let's go out and I got the
Ford key in my pocket
let's go to the Ford I hope no one took
before someone took the Ford a few
nights ago I woke up was like three in
the morning I wanna go to McDonald's
true story
oh we got a lot of cars alright I
probably just lock myself out of the
house but I got my Ford key here am i
right year of the four
you're the floor da so here we are
climbing aboard my beautiful Ford Fusion
I love this car
now we don't a smartlock I'll trust that
shit man hackers you all watch out for
hackers man what about hackers alright
so I don't know if you really see
anything phones not very good in the
dark Oh in here oh it's up here cool so
just go right in here I'm gonna
disconnect this connect it well first we
can just connect whoa we lost all the
lights here let's get some lights on in
here
yes p8 2 6 6 the hackers bro what about
hackers though have you considered
hackers yeah I know I know I know I've
come around on the fusion guys you know
I changed my mind when I'm wrong I was
wrong about bubble I um I know it's
wrong about Ford I was not wrong about
zooks and I was not wrong about Drive
that I got but maybe I'll come around on
them too you know I can change my mind
that's I'm not a politician no no see
that's just too far man Subaru is too
far all right yeah yeah things change
yeah shot back home today alright let's
go V sorry I need to hold you like this
I cool so
eyeliner you know I've never been aunt
eyeliner um so we got these connectors
here so let's plug this dongle into this
dongle don't save dongle it triggers
area Richards or whatever name was all
right let's plug in this dongle
sorry it's cookies I know I know I'm
being rough is it fed I don't know if
it's just my for giraffe outfit am I
gonna have to contact oh well I'm gonna
put you guys right there well I try to
do this with two hands oh that's gonna
go in like that I say ah plugging it in
backwards I got ya alright so let's go
here alright look at that for giraffe
installs look at that cool okay so we
don't need this wire down here anymore
unplug my grape and uh come down here
there's my great panda down there you
know we got the latest stuff from shop
comm about AI because we are comment on
the I and you can go to shop like come
over there and you can buy this kind of
stuff too and therefore draft aspect so
let's see plug this guy here we go bro
this is fourth year right now
I know it's your the Ford that's right
and thank you are we can even make this
for giraffe so all the Scoobies are
about to find out live whether you're
for giraffe works or not let's first see
if we have power oh yeah we got power
all right all right cool cool little
smooth jazz we can we can definitely
lose the smooth jazz yeah yeah that's
better
yeah right we got a rap hang on I gotta
put your sax coppice she don't want to
be saved
yeah Jay Coleman shit bang alright so we
got my grape and a wire right here
and we got my wire that can with my Aeon
no I'm over Sony you guys I don't think
about so many much anymore all right so
you all check out my flippin Dion
this is a normally hunt not not a weird
prototype you have a prototype the ads
are canceled they kind of sucked not
secret oh it already detected started
Wow
I don't know about this is crazy so I'm
just undoing this wire we can so you
guys see that I got a already flip Durio
nice where's my comma shirt and I went a
code did shut all right so we got we got
my grape and a thing up here
I'm always looking crazy guys I'm gonna
shave the beard oh yeah I'm shaving the
beard tomorrow this show only if the
release happens it's gonna cable tie
this up
all right I think we are ready to Ford
these cable ties am i oh no Lane keep
assist malfunction
no no that's not good all right that's
it that's it what's up I think we're
good let's go I'm gonna pull my seat up
let's go for a little Drive we'll go to
cabana and see we see
thanks for driving a hybrid you're
welcome for it it's missing a little
piece you might have to promise losses
Kofi's I I think we're good I don't see
errors now ready to drive let's go bros
we're gonna need some lights
where'd you get this by the way
I love tennis so if you own all of to us
what does this my girl shouldn't know
who I am
but if I ever did I would date Taylor
Swift a letter a song about me all right
you know what guys no I don't even know
if we have to drive I have a new idea I
think if I go into the settings here I
can actually get it to vibrate the lane
no not that that's entertainment
he's all we gotta use this one all right
oh there we go help no ah there we go
great you have to press the left arrow
go to KFC we ain't gonna care zebras
we're driving right now so pay attention
to the road we don't have open power but
you do have all pot you still have to
pay attention right what's in the
settings menu no we're gonna try the
settings menu once we get home driver
assist lane keep system intensity if you
change the intensity I see look it
vibrates the wheel intensity high so
we'll just remember that I did this
mirror up that we like all let's go
so let's remember I do that that light
I'm gonna check it out with your battery
oh this guy wants to race I'm not racing
some guy at a red car man I got a white
hybrid here let's go to cabana cool cool
boss alright so now I gotta wait for my
Aeon to upload should already be coming
mmm good city I don't know about that I
can't leave my lights on there by my
Ford let's go to cabana
[Music]
hmm let's see let me close what's up on
my computer
no I don't like showing you guys the top
of my computer oh no no that's closed
get me for a little bit while I find
that route yeah we got a grape and of
course but then again let's see what's
up
oh yeah my burgers coming soon that's
exciting
Oh see you change your desk again no the
same desk all right let me just connect
to the fusion here I hope routes are
processing yes how's the processing oh
they upload it so fast oh you guys won't
wait what no that's yesterday's that's
literally no bad thingy
it hasn't processed your upload is
running nope we might be out of luck we
might just be out of block any noises a
giraffe make that's a good question no
my route hasn't uploaded yet I don't
understand
yeah rap battle brah
your bun 2 equals spy doesn't spy just
said connected to the Wi-Fi so we have
an internal interface here where I can
manage all of our company eons put me on
inside all this so much effort I have to
go get the Aeon honestly it seems like
Wi-Fi is broken no that's yesterday's
Drive you guys you guys guess who's
starting on Monday we have an
infrastructure engineer starting at
Monday that's gonna fix that problem
no you bumped it's fun I mean I
installed X Mona Dan got shit um no this
is terrible I'm gonna go wait okay hang
on now I'm connected to the Aeon it
moved though when connected over
cellular to be you know capable Wi-Fi
okay so I'm connected to the cameras and
shit I understand why the route didn't
process though Andy Andy among periscope
my route didn't process I'm on periscope
I don't see my routes like a nice like
your dog's ID yeah ah dear time to STP I
froze we gonna see fate you wanna ask
you if you have video of me will see
your food we can use a front camera I'm
saying about ID there should be this
route yeah I know we hired it if you're
such a guy he starts Monday so now we'll
have somebody to I'll blame if things
take forever
I'll go through the checklist here's the
checklist for zero for floor guys go to
the checklist I gotta make the front
camera work at night never give up never
surrender absolutely that's the motto
you guys 64 you were watching you guys
don't know shop comedy I make sure to
buy we got the dopest merch in the game
you can buy Aeons like this one here you
can buy deep up boards pandas pause ah
yeah a rough Monday coming up I know yo
guess what else
you know we hired today we hired over
prudent we hired a recruiter we have
heard a lot of people we hired a lot of
people lately you know we've been hiring
cuz we got money but we're not talking
about that what any plans to keep my
cars on the rails like crews I don't
know what that means but let's let's
download a picture of my face and see if
we're gonna watch a video of me that's
SCPA I guess CPR phone so calming I bug
bounty now if you find bugs go hack
people we don't care just kidding
there's no bounty just report them cuz
you're nice or you can like I don't know
how is the HD mapping coming no you want
to go visit the HD mapping team getting
a visibility team can go into that menu
right here here's a recording for the
front camera it's not very good at night
you see that giraffe toggling there you
can kind of see my face over there okay
I'm holding the skull piece
while we wait patiently for my route to
process all right band up no but you
want to go visit you want to go visit
upstairs team and talk about why we
don't have maps yet let's go visit off
Jays team and you know you always play
McCallum filter problem to the scope
ease yeah
[Music]
I understand it just explains come on
okay so we're trying to write a new
Kalman filter architecture that
represents attitude in a new way so you
can represent your attitude in the world
using Euler angles which is three
different angles and that's just those
three angles represent how you rotate
your reference frame to get into the car
frame yeah um but that's singular and
like nonlinear because when you go over
to PI it comes back so there's like to
trillions which is a better way of
representing it but that's a
four-dimensional vector whereas guys how
many dimensions is rotation how many
dimensions to get where does the other
dimension go it goes over here yeah you
need to get one of those matrices that
big like the big fight big be this big
we need big five matrix but you can't
get the big financials because it's not
a Jacobian these F matrix is Jacobian
and that's good
big five matrix is not Jacobian guys I
really tried hard last night typing
Jacobian to get it we tried like a bunch
of different combinations of Jacobian
you only do that so so now just just so
you guys know just who use copies when
you ask about the HD maps okay you
dropped out of math in high school but
that's why Khan Academy exists it's
absolutely bro
yeah so just you guys know that's where
the HD gaps are who want to change the
world come work at come AI let's see my
rap process yeah do the process no it
didn't
this is a tragedy engineer Johnny Monday
and then like you know give him some
time give a few months like you want to
do slam right because even with a gray
panda if you want to get that crazy high
accuracy you know you got to allegedly
ya know the even uploaded that's not the
problem it just seems like the pipeline
didn't process them yeah guys it's gonna
get better
this year we're gonna you know get a lot
of people this you I don't a lot of
people yeah give an update on Monday
we're gonna increase the yeah yeah I was
gonna I was gonna Cabana like them we
got a Ford giraffe in the now so we're
gonna take a look at yeah um less
measures of the giraffe with obd
interesting which phone are we using
after the oh oh no only the one plus
three teeth that's it ever this is the
jet right like look we got like
debugging right here at coming on well
let's check Twitter that's what I do and
I have nothing to do it's kind of
terrible yeah we're running all this on
Anton if by Anton you mean a flown yet
bra
no no no phones are phones are
incredible man
phones are quad-core yo guys free the
DSP comm check it out right now it's
just a tweet but they'll be way more no
yeah we use a Windows server we use ms
sq what do you think
dance team of freedom shoes don't tell
anyone yet the DSP got freedom no but we
got lead DSP exploits you know used to
be hacker in a past life yeah it is this
well you know waiting for the right time
to announce the freedom the DSP um just
use AWS servers but not in either yes
we're using Azure why can't you make
mine from the maps because we're a
hardware company we make money from a
hardware and then we give the maps away
for free um no wait the Qualcomm DSP
wanna call come DSP yeah you guys you're
uploading so many drives that we can't
keep up no but seriously guys growth has
been you want to talk about moon it's
been moon around here this store yeah
how we fulfilled twice a week we might
have just start fulfilling more and not
because we want to ship quicker but
because that's just how crazy things are
flying off the shelves
we've moved like move like hundreds of
eons thousands of pandas you know okay
we're getting to that we're getting to
that thousand and ten thousand mark tip
which is which is getting crazy oh you
guys saw the pandas right
zombie Netta phones you're right bill
the pen off the compounds crazy thing so
I don't know if this route is gonna come
through and process oh oh yo okay well
at least I can see my files now so those
miles this is our internal tool that's
my dog lady there's no secrets on there
um get around guns yeah we are kind of
you know get ariane early we've probably
made to few yawns okay so when we first
sold yawns like nobody even understood
what it was and nobody like bought any
and now we sell like lots and lots of
eons and yeah so we're looking into
someone's got to call me back about some
big purchases so we can make a lot more
eons right all right so let's watch the
camera watch the video of my drive okay
here's here's the video that
high-quality hd are all blurry but I
don't think it's blank this is blur cuz
I didn't clean my windshield yeah dirt
LayCool s1 yo do you know where I can
buy ten thousand of them if you could
hook me up you know where I could get a
lot of Legos oh yeah you know you don't
want a neo bro yeah but you're gonna
want it you're gonna want to switch the
problem with switching is you want to
get that uh I know right if you know how
to hook me up with a lot of Legos got a
lot that's the laughs I Drive a lot
let's see my round finished processing
we're gonna give you guys more access to
this tool to this is we call it user
admin no they haven't processed yet oh
man you know crispy these pictures look
Oh actually I don't think the focus
really had time look at yourself crispy
that picture locks
that's a crispy looking picture
called user admin you know doesn't
remind you of anything like that that
sounds like someone they don't want to
come here and intern and write that
what about why Dart
I bought a lidar a long time ago I
regret it I don't need a lidar shoe
expensive man we have money like now we
have money again but you know we're
frugal very frugal
it's got to be frugal we pay people well
there's always votes no money oh come
right that I hire from New Zealand no
you gotta get a working California
see really guys just on the DL if you
know where to get like a couple thousand
Legos or one pluses let me know we're
gonna be Eddie and I are gonna be taking
a trip to China soon I don't know bank
account is actually not going dry we're
almost profitable now we're like we
would be profitable if we just hire all
these new people but we hired all these
new people she don't regret it all cuz
they're great people I am so it's like
not processing yeah you guys are
uploading too many yeah oh I will
definitely periscope from the People's
Republic of China absolutely Auto
high-beam I'm alright in that shit what
are your tips are raising money if
you're asking me that you you change
your idea or like change your pitch like
you just let me tell you the how to
raise money just act like you don't want
it because if you want it smells like
desperation build a good product right
we didn't need the money like you know
but we got on great terms so you know
you notice said no to great terms um no
the money's gonna help us grow I mean
the money's gonna help us build
something that we've been one of the
biggest secrets of kamma that we've been
working
oh you can't go profitable you know I
love profitability guys you know I love
it you know I love making money I love
money
I love making money I love capitalism
build cool shit and people notice
there's no only people with money to
sell to a lot of people right well
hardware startup people think you can't
make money in hardware and like yeah if
you do Sarah you can't but doing a
Shenzhen hardware trip yeah yeah
anything are gonna go to China
well times go from China taking a
paycheck yet now no I still don't get
paid anything cop detection or that I'm
interested in I do love profitability
I love profit I love money I love making
money I love capitalism all right guys I
don't think these routes are gonna
process unfortunately so you know we're
gonna have to we're gonna have to wait
now we're gonna have to do this on
different periscope but that was the
first step and then there's the step of
waiting for Khamenei eye to finally
process your house which needs to get
better I'm not getting acquired by Tesla
when I get acquired by Tesla that's like
Android getting acquired by their play
recognition travel the concert
capitalism is good and shooty the
Cavanaugh's non-zero day the climate for
real you know I feel about that
capitalism for the rich socialism for
the poor no we do it the other way
around that it's terrible about just
capitalism for everybody there is no
current infrastructure guy there's no
current infrastructure guy take selfies
in China with dudes and soul I'm not
doing that man I love China I love going
to China and you know what I learned
from PewDiePie how to go to foreign
countries and be respectful no Google
doesn't get to away the Google's over
capitalism for the win that's right
no Google's over guys you know Google
nobody a quick google if you're a good
engineer come work here Google's not
building the future I do like kind of
food did I just need the files no I got
the files
got files need Cabana oh I say it's okay
no guys no so actually the route didn't
process it would have processed for you
it's just not gonna process for us
because we're running 0 for 4 and we
haven't updated the pipeline to process
0 for 4 rounds yet yeah no all routes go
to command accommoda I - he's insane
obstruction you guys are and it's just
shit for sure but we hired an
infrastructure to start Monday
that's all very exciting we also hired a
recruiter so I'm gonna show you the
recruiters desk get my Hep B um - guys
don't worry about that stuff hire from
New Zealand would you assist relocation
yeah we could do a relocation bonus sure
Tom Iowa this works on HTTPS doesn't it
hi guys this is this is the desk for the
recruiter um so we can have a recruiter
sitting right here and we got him this
beautiful piece of artwork you like this
artwork that's right I kind of like this
artwork no it's not guilfoyle
yeah yo yo it's exciting it's exciting
high schoo piece thanks for joining
sorry we couldn't periscope with you all
today we got Andy a new iMac problem and
that's why there could get the iMac who
was the recruiter yeah reach out give me
a job at comedy I much beep cool I know
I'd seen mr. robot peace
all right well they really have a lot of
cones out here okay so here's the
joystick alright guys so I'm sitting in
the backseat of trees here um this is
some people have nightmares about this
okay you have a way to push the prank
good Hey but it's not engaged I can't I
can't break okay okay use on expressway
only good we're only on the expressway
okay yes all right so no look at the
driver oh look he's gonna turn wait
I guess one oh no I turned it off no oh
I forgot to twist this to you okay there
we go all right let's go
oh yeah who wants to buy a comma
drive-by-wire prius $50,000 we will sell
you a drive-by-wire prius you can have a
prius just like this one where you can
turn the wheel huge amounts huge make
tight prius turns never get locked out
what else can we do in the advertisement
for these self-driving prius business
driving itself guys look at China itself
I'm done with a combination of software
mods and a few extra pandas and by a few
I mean one we use the extra panda oh
yeah look at that acceleration free is
acceleration
we're not gonna go faster than that yeah
well and you're so limited by what the
cool
yeah it's dragging a car the joysticks
kind of hard but um so you guys could
see I can turn it this way we all goes
like that oh you
that's rate limit oh that's that's with
a rate limit you guys yeah yeah oh wait
oh wait guys we gotta strap in hang on
push forward to go forward there you go
okay twist the joist up can its ultra
everything you know it is the ER guys
it's the EON doing this oh my god gentle
gentle gentle reduce jerk oh yeah
so this is this is why we came out to
the to the airfield today so we could
test our drive-by-wire Prius
acceleration isn't limited but break is
that seems weird this is a toy guys this
is the favorite vehicle
Yolo live demo what do you mean a Yolo
live demo this is a live demo we're
rolling
that's what he's saying she hook it up
to an Xbox controller what you don't
like our top con Joyce deck you turn it
on the car is slowly moving car oh my
god can you control them outside the car
we're not gonna control it from outside
the car we did this once before yeah I
read up one of the Kama panel plans I
don't know if anyone's reporting Mazda
that's the bad question Bob wait we were
moving the weight limit yes okay guys
like you should see this wheel can
really whip wet
where is Florida it's like over there
maybe why did it take off myself
that's it creep Oh why'd it take off by
itself because it just creeped it did
the system disengage
yeah hey back on
no doesn't like it doesn't like it
there's a Fault in the excel wait turn
engage okay we're good up sorry I think
it's because all my okay that faltered
out Oh
if faults when he goes too fast it's
probably went too far with the rate but
the right I don't know let's just leave
very little bit on there's nothing we
can't do with that other rate limit I
mean I can do five instead of three
click twice
should I wait you turn off now I'll turn
off the steering yeah hey so now cruise
controls turned off
I'd only hit those things what are those
things
sorry that's pretty good
oh yeah this is the model with the Park
Assist that's called Park assess its
assisting us with parking Oh see that
time it did it you feel like stayed on
the brakes a little things lots of Drive
is that not an iPad pro or what now this
is a touchscreen so the problem is what
happens in ESP kicks in oh it actually
kicks you out yeah what don't I use peel
[Music]
wait IPA and Toyota isn't that good well
hacked IPA is that good no what we
didn't buy the car for this test this is
just calming eyes Prius
how do you break with the joystick
pullback doesn't let you turn on with
the SPF okay I mean that's sensible
well that steering really doesn't kick
you out yeah I mean we can use another
f7d panda and tell it that it's never
ESPE yes and the go system doesn't know
I guess I mean okay you know what there
has to be another interface that it's
using for a EB you know yeah maybe we
just need to find it yeah but those
usually have like low-level limitations
like much on deceleration speed yeah
probably
really high because it's a B what do you
mean 1480 you can do oh so 25 miles per
hour deceleration it's max Delta and
then what happens and it kicks you out
did I stop stop breaking oh you a BB at
more than 40 you create accidents the
Delta speed the due to a V is more than
40 kph yeah but it doesn't know like the
braking controller doesn't know that
what when you send the packet to the
braking control I'm sure there's just
some packet we can find that we can send
it as braking control it'll just trigger
the brakes oh yeah yeah yeah maybe we
can look for
yes yeah so we have no we have no track
to track she chose turned off her house
we don't have a longitudinal control on
the car we only have lateral control the
Carters trying to make the car stop it's
not stopping that's easy to turn on and
off yeah now we can go we will we will
drag race the cars later guys all right
right shall we drive back to the Ford
yeah so we're gonna be testing some
autonomous stuff we're gonna see if it
can look at a role in going way faster
to roll it
well don't hit the floor without a
tragedy if you just read you get the
steering control we golf into those
grasses over there
all right scope ease thanks for joining
into this fully self-driving Prius on a
closed test course bye-bye
yeah it's a joystick if you didn't see
the joystick there's the Dresden tape
the phone to the driver's seat we got
any on up there the Aeons actually this
is your the Panda on the enemy of the
Panda on the car why not use controller
guys it doesn't matter what joystick you
use what's the purpose of this we're
showing off our fully drive-by-wire tree
and your prius can be fully
drive-by-wire or two for only $50,000 oh
you know I got a call from Davis feeder
right yeah yeah very you know I'm just
saying our competitors charge more than
double what we are charging you come to
me $50,000 and you bring me Prius and
we'll make that Prius drive like this
place to fish
you have to think
we love organism difficult
until it is
truly
and everyone
and
[Music]
in the garden
no more
yes
how are you
ah
as
to goal we do
not wish
ah
and
[Music]
again two fires
cha cha cha
Julian
[Music]
as
the conventional ship
[Music]
America that has worked
but it is not
ours
many dates ago
well
the den ping
well
of greetings
no companies to realism to the flat
but it is
a new love
my accomplices
[Music]
debacle
the noise as grave as very good
on Windows
[Music]
love
is good
i
but the maximum
h
to our basket
table tennis
s I
would like to stay they pay you I
 
mean
[Music]
is a spy
rest
billiards
the expression
everyone will be affected I would
not have done
online
without news
the conversation
or not
no
of arriving
[Music]
i
and one
if the folder is arriving where it
can escape
am
you are at this time
is to lose
m
com
and
in fact
and nurseries
and Gordon
Korean
on top let's go ship
for me
Thomas
why
more than physics
the  Americas ica
[Music]
way
nothing more
or more
merckx
to search 32 x
is a knife verb
[Music]
before we leave the unparalleled moment
they
in fact
type
and open
a house
efe
enters this star
see me
[Music]
we're not peaking
james jones
well
not
well
but once
as
[Music]
benson
chao
kuito
following
[Music]
e
[Music]
[Music]
are sold
very good in this masters
[Music]
o
roll from the dream
stein as that
 
says danger
wow
we hope
am let's get
better
usda
if I eat it
well
I have it
if it goes
but
will continue with 4
[Music]
l
in Aragon
yo guys what's up dude a late night late
night mapping Scobie it's kind of cool
so the first thing that I want to talk
about gonna flip you guys the other way
so we released a driver monitor and
challenge today to come AI yeah I know I
heard this so should we cancel Ford is
it not the year of the for it anymore
the car would cancel Ford don't buy Ford
guys but yeah so the kind I travel
monitor challenge but I'm not going to
tease you I did promise mapping so I'm
gonna show you what I've been working on
today it's called depth net point cloud
we have a really low quality depth net
that I trained in GTA our machine
learning team over here has been working
hard and it's hopefully gonna get me a
better death nut this is what we have I
move you over to this monitor look at
that when I talk about the precision of
our HD max so I'm generating this little
mapping area right now this is from 100
frames and the craziest thing is I can
zoom out and that's a 3G that's a little
piece of 3d world that's been generated
now there's nothing special about this
route so I asked on slack for energy to
send me another route unfortunately it
does take an absurdly long time so
you'll have to bear with me on it but
yeah that is fully three-dimensional I
can see that building over there you can
see the point clouds that have been
generated here yeah and that is with a
really low quality depth cam
well we've been working really hard on
is our master riser so we're recovering
precise locations of everything using
the gray pandas so I'm going to close
this one out here and I'm gonna copy and
paste energies around now I think it's a
night time route which we've never
actually tested before it so I have no
idea if this is gonna work and it takes
about ten minutes so we'll try to find
something to do
that's all do party okay here we go so
yeah
this runs part of our pipeline it has to
do all the processing and yeah I love
the super hearts by the way guys let's
talk about the monitoring challenge for
a bet so what we're trying to do is
you're trying to track people's faces
and you're trying to track their
eyeballs and see where they're looking
so you can see let's see who's
distracted in this photo so you can see
Vivian's looking off to the that way
there it's kind of hard to tell with
Eddie you know he's got the sunglasses
on I did all of the super hearts Carlos
looks like he's paying attention but so
I can so you can check that out on
github so that route over there is still
processing it takes a while yeah so in
order to track through sunglasses you're
gonna need some infrared stuff but we
can take a look at these videos here oh
yeah I should probably disable this wait
this is your route you just sit in
traffic well this is gonna do you energy
you're just sitting traffic wait minute
500 do you actually mean 500 I don't
think you mean 500 I tried minute 8 but
this is just sitting in traffic I'm
sitting in traffic yeah okay you're
doing it starting to move maybe we'll
try the next minute maybe the next
minute I'll have less traffic yeah so
these are the videos from the the driver
monitoring um I can show you another one
that I have prepared it's not as good
let's see what this one's gonna do
so a lot of the quality issues here are
because I've got the notes bad but our
mesh risers pretty good so let's see if
we can make a tiny little chunk of 3d
map out of this let's see what we can
kind of see what happened and what
messed up there and we zoom out
it's zoom out so you see that I'm in a
canyon yeah it looks like the depth not
really just messed up there but it looks
much better yeah
so we're building 3d maps of the world
now if you have a go over Greg Hannah
and you're earning gold star routes I
think we're gonna make these maps
available to you we can look around in
here and see that's actually pretty good
she goes grass off to the side here you
see the trees here you see the trees
over here yeah pretty cool so yeah and
Archie was just sitting in traffic and
yes we want to sit in traffic guys but
um so no we're not displaying gold stars
yet uh hang on let me just set oh mmm
threads equals one the right it's slow
let's see okay this is better look we're
not sitting in traffic anymore that's
pretty cool oh that's gonna work well if
that actually works I don't know why
your times are so labeled wrong though
if we're doing all this matching we're
finding all these features it's pretty
cool
I said well just let that run for a
while yeah what's up about Scheffer plus
why don't we work so late cuz you want
to win then it was the stayed up late
the Toyota Research Institute they don't
wanna win I've heard from the other guys
told me like cool what's your opinion on
bootcamps of data science look you're
not alone
here's the thing about a boot camp right
if someone told you that you could learn
Chinese in eight weeks
would you believe them oh no right yep
someone tells you you can learn data
science or Python or programming I don't
know why you believe them right I did
shave the beard it grew back
I shaved I shaved that Friday throwing
out that night
if you move your GPS antenna should you
recalibrate oh by the way so you can see
the routes processing here we're just
you know generating all the features on
here and getting the matches oh no you
don't need to recalibrate after you
remove your GPS antenna how long for the
driver attention software is open source
as soon as you write it I'm very
disappointed by Ford's announcement I
knew Ford would let me down a new Ford
had let me down gross alright so we're
gonna see energy we're gonna see if your
route works oh this is taking forever so
slow look at that guy pushing that
carriage across the road with those slow
feature back there
that's brutal oh that's brutally slow
guys what's the use of the depth map so
once we make it good no it's not
obviously we get rid of warps I mean
Harold wrote Harold slam it's better
Harold you want until the scope is about
Harold slam you want telescope is about
Harold slam no they asked if we were
using web slam and I said no yeah yo
guys it doesn't just use cameras it uses
grape handed GPS is it uses I am use we
got full sensor fusion is crazy oh yeah
this thing
[Music]
you're moving through space and all the
blue things are things your camera seen
through gold things are the GPS
satellites the red ball is where you
chased me cuz everyone's chasing the
ball yeah yeah we think you know Ford
canceled all their cars yeah so
downstairs we're running mess 3d
everyone's very sad how slow it is I
didn't pull all right good I won't pull
comments competing with space legs no
and I'm competing this face likes and
the Rockets aren't they keeping fusion
no I heard it's just f-150s
of police interceptors and the folk is
active which hasn't been introduced yet
no I really think that's why Ford did it
because they hate us ah look at that
that's taking way too long it's not even
running nice did you yeah oh no scope
ease
it's so slow it's so slow what are you
gonna do we gotta kill ten minutes not a
columnstore no speed what what car do
you have
oh you have a weird car let's go good
car yes a CRV photos like exactly Ford
got rid of the cars it's a
scorched-earth policy I love that you
know that's what I would do if I run a
company one will shiver plus EGR we
really never shipped to really chef
released
HDR which I love you guys I'll let you
in on a secret
if you run an open pilot with passive
equals one it's the same thing as ship
replies yes Tillie the session reunified
it um so energy error running mesh 3d no
speed I can try to hack Messer eg if you
give me a second
no speed oh no oh it's not even using
speed oh this is stupid okay
it doesn't even use speed don't worry
guys I hacked it now kierra speed T and
sure sorted use it for no rod okay we'll
get rid of the no rod observations they
really need them all right so we got a
download some shit from NASA you guys
know where the satellites are don't
worry NASA doesn't know where everything
is this doesn't run this is a tragedy
and we're gonna just quit this mapping
scope being disgrace it's downloading
some stuff whoo hourly will that's
exciting
Harold you don't use speed but if cars
don't have speed it doesn't work yeah no
yeah now it's working like I got you
blocks GPS ten that means you've got a
great panel no we're good we're good
we're good
I fixed it no don't worry your car
doesn't have speed because it's a weird
Civic right like you have some weird
here you go CRV you're not supported in
the back end oh we should do that unify
with on pal oh oh so the full courser
panda you mean yeah okay cool I'm so
energy I think when you get your stuff
up streamed it'll work because we use we
use the car library right okay cool yeah
we got us chickens gonna work
alright guys so mr. D's running down
don't worry I hacked it for now we have
five minutes left and it's running so
let's download that video so we can take
a look and I'll see what its gonna look
like so let's go in here and you've been
uploading oh you've been uploading d
cameras to me thank you thank you for
your d cameras
d cameras or driver cameras some most
happy when we get those anymore why do
you Road videos no okay so this is what
we'll be napping right here oh look at
them gold marches man for the depth not
understands golden arches so the depth
note wasn't trained on videos that look
anything like this we have a new depth
net coming out and I will show you guys
so I want you to remember how bad this
way so you can see I'm good the next one
I so unfortunately now it's taking even
longer it's decided it wants to be slow
which is lame
this is good footage right yo the HDR is
so good no you can't get a 99 Wrangler
to dry itself and if you ask again
that's a bad question
I'll penny from the periscope I know
it's late but we still got the banhammer
don't worry how old is the depth net
from last year that was a bot all right
so I'm arguing with BOTS let's see what
we're at here we go that's how much we
have left so you guys can like do the
countdown up Network to eight minutes
great high quality should you sell your
Ford yeah probably
I don't think no no maybe I'll ship
something the main reason we got a
fusion is because data speeds using it
and we were disappointed yeah she's nice
car talk about the challenge for eight
minutes okay that sounds good so let's
take a look at these videos and think
about what we wanted to do videos this
okay so here's Vivian's video so you can
see your face here you want to track the
position of her face so a face you can
think of this like I it has pitch and
yaw and then once you have the face you
can track the eye position as well so
you probably want to get these corners
and then figure out the rotation of the
eyeball
then you can project a ray out of the
eye
and you can figure out where the driver
is looking doesn't that sound like
useful data to train a self-driving car
yep I was always thinking you know um so
download our challenge go to komete I
get up and you'll see that it's linked
it's one of the hope I can't show you
that that's the private data they've
been recorded with me on videos right
here on shopback oh I got AI it's taking
even more time that's a route with a lot
of stuff um so we're hiring a full-time
driver monitoring engineer come join us
at SF to work with these videos if you
guys didn't see our medium post about
safety and driver attention I would
definitely check that out
look this guy made an open-source
allegedly thingy but it said will be out
soon so it's not yeah I want to do a
little bit more than just glam
classification with a neural network
aren't you want to extract some vectors
about the face um usually transaction to
classify the drivers looking yeah I
don't just want to classify the drivers
looking I want to get like a
multi-dimensional vector
I want to effectively like represent
people with like cartoon heads right and
if you could overlay like a nice cartoon
head in a person with big like anime
eyes you know do I think over stays in
the driverless car industry yes yeah
yeah I don't know seems like I don't
just want to do glanced classification I
want to do more than that
yeah I like like anime eyes let's Google
anime eyes and still read yeah no no
there with big eyes yeah yeah I want
like like anime eyes like this you know
like big eyes that are really very
visible where someone's looking I could
not get a rule 34 it here um oh we're
not in the home were in the office is
glare Caucasian better just a six minute
timer absolutely lot can happen in six
minutes
what value do you see in doing more Oh
more than just glance classification
well so here's the thing right it's
optional for people to upload their uh
their video to us because you know you
don't wanna take everyone's video from
the front-facing camera wow this is
taking even more time Harold mr. et is
so spoiled 22 me too it's per second
how about waking sleepy drivers yeah
that kind of stuff - you know how open
people's eyes are that could all be
important stuff know what and what do we
do Freddie here
thank you sunglasses we could track is
the track is oh yeah guys go to our
github submit that challenge do well on
the challenge and we'll bring you out
here for a micro internship ok so I got
over you right I got ours what I'm doing
tomorrow me right in the Kalman filter
and say we're not gonna like it's if you
take your eyes off the road for two
seconds it's ok 10 seconds less ok I
really just got this probably isn't even
gonna be that cool we're probably gonna
wait and it's not gonna be that cool
it's taking for ever bros
nope let's see let's see what our
notifications are on Twitter
I'm checking Twitter let's copy that we
shouldn't be doing all right what else
can we show you while we wait nothing
all we can do is wait it's terrible
terrible I do why I got a bot just
repeat your message I don't know man I
don't know why there's boxing yeah I
understand what periscope can't clean
their house up is this worth waiting 12
minutes oh yeah okay you want to go
check out the GPU farm right I'll go
check out the GPU I know where we're
going
what's the next development least
tomorrow no actually have something cool
in the GPU far we've been expanding the
printers look at them look at our 3d
printer are me when I go to my bedroom
nice but look at this printer are me
yeah so these are the GPUs over here
these are the storage machines over here
they're multiple I do the 3d printer
armies getting uh getting really huge
look you can see some great Panda
stuffing
and looking to get finished printing
Jesus crap who pays your power well we
pack let's see these ones finished
reading all of those look like quality
those look like quality gray panda
pieces right here or electricity bills
crazy high lights we're going we don't
need lights pistachio why don't you have
your light on
let's say settings light turn lights on
in sleep mode absolutely love lights
ping DJ you need some lights in sleep
mode to enable sleep mode that turn
lights on and sleep mode power is cheap
guys light turn lights on in sleep mode
yo having a lot of something is a whole
lot of fun so I'm gonna have dim lights
the Valerie's like two old dim over
there oh these are some great Panda
pieces some great panda backs
oh great pandas off of like a nut left
it let's say this is trash what do some
of these are good you just that one
there is bad so we go through them the
QA everything we assemble them know
what's up this one need some whites
yeah I saw this crazy expensive power
it's like progressive taxation on the
power system furs are pretty anything
right now
Eddie's sick
all right let's see if we're finished oh
well we have a male person their home
right now check out our new fulfillment
center
this is rolling your star chips from you
see this this is the last 128 gig Eon in
existence so I don't know if someone
maybe already bought it but when that
one sells we're out of stock guys were
running low on us you're running low on
eels
we could've bother you on to that it's
not even close to done no it's not even
close to done so let's go peace you guys
don't get to see anymore Maps mapping
scope he was a scam
tell your friends come AI as a scam no
go to shop that comedy I think sure to
buy stuff plenty of midnight black
laughs to the new hardware platform ooh
where'd you hear about that all right
that's it we don't get to see anymore
maps maybe I'll post a screenshot once
we're good and slack but mesially these
too slow we got to make much to do
faster
all right ladies go peace
hi everyone uh my name is Yin I work uh
in research here at Kama and uh I was
excited about some machine
learning
yes I heard that I haven't started
presenting yet and I already have some
questions so I guess I'll answer them
later not
forget so uh today I'm going to talk to
you about our progress in learning a
drive-in simulator um so it's been a few
months of of of this project and uh we
have some exciting results and I would
like to talk to you about them um before
I start I would like to show you
approximately where we're heading after
this presentation so as you might have
guessed none of these videos are real
all of them are imagined all of them are
are predicted using a machine learning
model uh of which we give a few frames
of context and then ask the model to
predict the next few frames in here uh
about a minute of frames and um yeah as
you can see the videos look pretty good
um the tempor consistency is pretty good
too um so this is a minute of roll out
as I said um they exhibit some really
nice properties you can see that um some
Physics is learned some some great
Dynamics is learned as well uh for the
night videos uh you can also see that
the lighting looks pretty good uh which
is something we really care about
um and I will come back to this slide
after we're done but pretty much by the
end of of this presentation you should
pretty much understand uh how we build
this and why is it useful to us and what
are our next
steps but before let's go back to the
basics why do we even need a simulator
Harold talked about this this morning we
talked about this two years ago in the
previous ComicCon why even a simulator
uh without a simulator the driving model
model will never be exposed to any kind
of significant noise or any kind of
significant deviations especially the
noise introduced from its own mistakes
so if we train a model outside of a
simulator without a simulator uh what's
going to happen is if you end up outside
of the center of the lane the model will
always say um just keep doing whatever
you're doing and recover later recover
in a few seconds and the next second we
will also do the same thing also say
yeah you're you're pretty good just just
keep going and then recover the center
um in a few seconds and the result of
this is what you see in the bottom video
it's uh basically a model that doesn't
recover to the center of the lane and uh
just drifts outside of the lane so this
is a problem and we need a simulator for
this now a good question to ask
ourselves as well is why not a classical
simulator why do all these complicated
things why not just build a Unity or an
Unreal Engine simulator a GTA 5 kind of
simulator and why not just do that well
I'm not saying that this is a bad thing
um these simulators are good for testing
we want them we want them for testing
because they're good for um you know
deterministic they're fully um you can
build whatever you want you can build
whatever scenario but we want to use
this for training and training it is a
whole different Beast first of all you
need to match the training distribution
you need to match the real world
distribution of driving data and what is
even that how do you even quantify that
and how do you even know that you did
that you matched the the real world and
even if you tried to do this you would
actually need to hardcode a bunch of
scenarios a lot of them and every day
you'll just be building a simulator you
never do self-driving you just be
building a simulator and that's not
really a business that we want to be in
um so as you understand as you might
understand this is not a scalable
solution you don't want to be hardcoding
simulators for training at least
so we came up with this thing called the
small offset simulator and Harold talked
about this this morning as well it's
basically a um simulator in which we
shift the image a little to the right a
little to the left a little to the
forward a little backward uh to simulate
little movements uh from the original
position and when we train the model in
this simulator in closed loop we
actually see driving we see a model that
recovers we see a model that stops for
stop signs you show all that stops for
red lights and this is quite amazing so
this is a small offset simulator and
that's what we've been running with for
a few years now uh but as you might have
guessed we're trying to go go past it so
why are we even trying to go past here
what's wrong with
it well Harold hinted at at the problem
this morning uh which we call cheating
so uh in order to have a very good
simulator of the sort of this small
offset simulation you want to have
really good ground rout you want to have
good height estimation good road plane
estimation uh good pose estimation and
so many good things they need to be
pretty much perfect uh and the problem
is as soon as you start to get some
imperfection some error uh you will have
um simulator artifacts and those
artifacts um can tell the model which
where which way you came from or how to
how to drive basically so the model we
learn how to drive just by looking at
the artifacts instead of learning how to
drive like a normal human being and
trust me the model knows how to cheat so
this is the first
problem the second problem is well it's
in the title it's a small offset
simulator it's not a big offset
simulator um so as as long as as soon as
we try to do some kind of big offsets
you can see that the images look very
funky and they really don't look that
good we don't want to drive in this
world um and that doesn't matter for
lateral that much because you don't
deviate so much left to right while
driving laterally but in laudal this
makes a big difference that highway
speeds plusus 10 miles an hour it's
really a big distance so uh you really
want big offset Simulator for
ludal so this is it this is our state
right now and why do we want to go past
it so how do we do this
well I'll tell uh some history here in
2016 Eder and George wrote a paper
called learning a driving simulator and
I stole the title of my presentation
from this
paper um you don't have to read the
paper you can read it if you want but
I'm going to basically explain what the
paper is about today um the paper
basically described what we're doing now
is just read 2016 Tech you don't want to
be doing 2016 machine learning we want
today's machine learning 2016 machine
learning
sucks this is what what 2016 machine
learning give you and um as you saw in
the first slide 2023 machine learning is
a lot better than this so what's an ml
simulator so we're trying to build an ml
simulator an ml simulator is basically
three parts three components um and I'm
going to go into each component
separately and explain what it does and
um yeah by the end uh we will go back to
our first slide so three components
image tokenizer a poach tokenizer and
the dynamic Transformer I'll explain
every part
separately so an image tokenizer is
basically a fancy image compressor it's
an ml image compressor that takes in
images and compresses them into a set of
tokens now what's a token a token is
just a fancy name for a discrete number
a number that can only attend a a small
set of of values from a dictionary so
taking images images with a lot of
pixels um then encodes them into this
set of tokens that are discret usually
these tokens are not too much 128 512
tokens and um then with this tokenizer
usually comes a a det tokenizer or an
image decoder that can bring you back to
image space and in which you can see
what you actually compressed and then
compare it this model is trained with a
gan loss with a generative adversarial
loss and uh this is what is usually
referred to as a VQ gan
um so yes this is a our image
shizer and uh in this slide I show uh
from left to right um a source image an
image compressed to 5,820 bits and an
image compressed to 1280 bits so I want
to point out a few details here that are
that are pretty interesting uh do you
notice this e logo here notice how it's
a little funky around here here but it's
still some red things around that area
but notice that the 1280 bits just
completely forgot about the cious logo
you don't really need that why do you
need logos in
life um you can also notice that the
building uh a little at the distance
here looks okay for the 512 for the
51200 for 5,20 bit bits image but the
1280 image looks pretty funky uh the
traffic light also looks a little funky
um so yeah these are completely
classical compression artifacts that we
get
here um so the image this image is
there's a lot happening there's a
traffic light there's a logo there's
buildings so it's a complex
image for a pretty classic highway
driving image you really can see the
difference this looks really similar to
me and um so for highway driving um
either 512 or 1200 that really doesn't
make that much difference and in order
to iterate fast so we we want to iterate
fast and we know we can improve the
quality of our simulation by just
scaling up the number of bits in order
to iterate fast do some good
experimentation we're working now with
this with this model but we know that in
the future as as our models improve we
can always scale up and get better
simulation so for now um 128 tokens 10
bits
each now what's supposed tokenizer what
what's supposed to start with the oppose
is basically six floating points numbers
uh there six degrees of freedom
basically your X speed y speed Z speed
and then uh your roll rates pitch rates
and uh your rates so we also need to uh
to tokenize these numbers uh just
because of the next component that I'm
going to talk about but trust me we need
to do that um and we tokenize them with
a very simple tokenizer we basically
need to digitize them or to quantize
them so we just digitized them with the
uniform Bing very simple nothing fancy
here um now to the beefy part the
Dynamics Transformer who knows what a
Transformer is yes who's used chat
GPT same people some people more people
I see you cool so yeah Transformer is is
basically the same architecture as a
large language model chat GPT llama this
kind of these kind of models um uh for
large language models a token is roughly
speaking one word um a sentence is a set
of tokens and the document or paragraph
is a set of set of tokens for us an
image is a set of tokens a video is a
set of images so a set of set of tokens
and we train it with the same way the
large language models people do uh very
nice L function cross entropy predict
the next token so um very similar to log
Toge language models um this
is uh this is the architecture of a
transformer for those who don't know
what a Transformer is it's basically a
fancy machine learning architecture
that's a stack of fully connected layers
and attention layers so just a black box
of a machine learning
architecture so we use this Dynamics
Transformer uh one token at a time so
it's autoaggressive sampling uh at each
time we ask the model what is what do
you think the next next token will be we
take that token plug that back in in the
inputs then ask ask it again what would
be the next token plug that back in in
the inputs and do this until we reach a
number of frames these number of frames
will give us a sorry these number of
tokens will give us a frame we take that
and then do this as many times as we
want until we reach whatever number of
frames we want so this is what people
usually refer to as autoaggressive
sampling um autoaggressive sampling so
predicting each uh token at a time so in
theory doing this is really powerful
because um you could cover the whole
distribution of your training set um so
you could cover the the whole
distribution of possible roll outs given
um given a context given a few frames uh
this could imagine any type of Futures
which is really desirable because you
don't want to restrict whatever happen
next whatever the driving model that
will be trained in the simulator you
don't want to restrict it to something
specific you want it to be as general as
possible and this is really desirable we
tried a few things um to uh speed up
this autoaggressive sampling so it's a
little slow we're trying to speed it up
we tried something like uh diffusion
like sampling uh some fancy techniques
mask good and and things like that but
we didn't really um succeed at anything
like that but we keep trying and um um
something will will work and we
basically want to speed up the
autoaggressive s which is a little
slow so we do all this and it works this
is our uh Dynamics model this is our
simulator so in here we just show it we
just tell it to drive straight and as
you can see drive straight um it's a
pretty nice Highway Drive uh straight
driving but we can also ask it to do
some things like yank the steering wheel
to the right turn right as much as you
want
and as you can see turns right changes
Lanes even goes out of the road even
drives on the grass that's pretty
impressive I guess some people did that
in the train training
set who did
that you can also tell it to turn left
cross the median drive in drive to the
opposite lane even get close to uncoming
traffic who did that that's okay I don't
want to
know you can also tell it to accelerate
so notice the uh lay lines it passes the
traffic it passes some traffic so as you
can see there's some acceleration
happening in this in this roll
out you can also set it to break so
again notice the late lines they will
slow down um
so as you can see successfully
breaks and as a side not we open sourced
all this open sourced a data set of
100,000 minutes of driving tokenized so
these are all tokenized with the
tokenizer that I've showed before we
open source the image tokenizer and the
image decoder and we also open sourced a
Transformer that's very similar to the
one I'm showing you today and that can
generate rollouts that look like the one
that I showed you today um we also have
two $11,000 bounties so if anyone uh
feels um feels like a weekend project uh
we want to decrease inference latency we
want to make this model run fast today
they run at 2 FPS so we want to run them
really fast uh so if you improve the
training Laten the inference latency by
50% you get $1,000 and if you decrease
training loss by 5% you also get $1,000
so if anyone wants a weekend project
really
fun another side not um so I've been
showing you all the these images that
went back to image space so these videos
that look good it's always good that we
can go back to image space and debug
these Dynamics these Dynamics models and
see what happens but in order to train a
driving model we actually don't need to
go back to Vision space you don't need
to go back to the image space you can D
you can train the model directly on the
tokens which is interesting so these
images are compressed to these tokens
and the these tokens have everything you
need to know to drive which is pretty
cool so instead of having like a
convolution u n network that takes in an
image and predicts the plan and predicts
the lay lines and and such um now we
have a Transformer and then you have uh
a plan and the Lan line and all that and
as you can see here um it works it
predicts the Lan lines predicts the plan
uh predicts some reasonable outputs so
you don't need we don't technically need
to go back to Vision space in order to
train a model we can directly train it
on tokens which is pretty
nice another side note is that you've
noticed that the images are a little
flickery so they jump a little bit the
clouds jump a little bit the cars jump a
little bit so and we're aware of that we
know that our our encoder is not smooth
and that's because our encoder is frame
by frame there's no temporal consistency
because there's no nothing that's
stained temporally um so we want to fix
that uh then there's multiple ways you
can fix this we really want to have a
tokenizer that's video based that's not
image based what we're doing now is
a little naive you don't want to do this
frame by frame you really want to do it
for a set of frames to get some more
some more quantization you can get more
compression if you compress multiple
frames but uh there's a technique that
people have been trying and we tried
that as well is to have a uh to just uh
freeze everything and then put a
recurrent layer in your decoder which
essentially gives the the decoder like a
state that get passed from frame to
frame and the decoder can use that uh to
smooth
the roll out so as you can see here in
the left is the raw roll out and uh to
the right is the smooth roll out so much
more much much
smoother so this
works um another side note is okay how
do we use this to train how why and
what's what's what what is missing for
us to use this to train um we need a new
loss function and why do we need a new
loss function uh well for a sufficiently
long roll out um the simulator is going
to imagine things that were never in the
context right there it's going to
imagine traffic lights it's going to
imagine turns it's going to imagine
curves on the highway and these are
going to be very far from the context
because we don't condition on anything
we just tell the model to imagine
something um so the human path that we
have been using so far to train will be
Irrelevant for sufficiently longer
rollouts um um so we need to come up
with something new uh we don't exactly
know what to do and how and how to do it
but the idea is going to be something
close to like a value model uh that U
like either a g loss or something like
uh like something to minimize dis
engagements or something to um basically
another model that's trained separately
that quantifies whether your roll outs
or you're driving is good or not based
based on based on the roll out that
you're showing it so something like a
value model as a l function instead of
just Mae that we've been using for a
long
time so what are the next
steps a few uh weeks ago we uh tweeted
sorry we xed uh we xed the video of our
um
simulator um and uh the response some of
the some of the comments were funny but
uh most most of all
they uh they really show what we need to
work on and what we actually work on so
I'm going to show some of the comments
comments on the
comments Harrison uh really wants to
play this he says please let me play it
we want to play it too it's really fun
uh but as I said it's at 2 FPS we don't
want to play a game at 2 FPS so we
really want to make this faster and
that's something we're currently working
on have bounties on it and um yeah we
just want to make this faster
John said there is a left turn on red
and uh uh this person said oh this is a
green light and we know we know this we
can see we have eyes too uh this this
potato quality image and as I said this
is 128 tokens 10 bits each so we know
there's compression artifact but in
order to move fast in order to
experiment fast we're using this now
we'll scale up for when we have either
bit better uh video tokenizers uh better
sampling strategies so we will scale up
uh we just need to work on these
problems
first Leo said I feel like building the
simulator is not that
hard trust me Leo Sim
Le Leo we do things not because they're
easy but because we thought they were
easy so this is basically what I've been
talking about uh the autoaggressive
sampling
using yeah using actually using the
models scaling the bits and scaling the
Transformer as well and we need better
video
organizers so uh going back to this
slide these uh these beautiful roll outs
like to point out some nice properties
uh look at this lead car here where the
the the headlights turn on when it stops
and then they turn off when it goes on
so it's pretty nice uh some of these are
actually really good how do you know if
this is a fake video or not this looks
really good this one as well looks quite
nice um in this one the model takes an
exit in uh this one the model takes a
does a lane change then takes an exit is
quite interesting the Night videos also
look good look at these light light HS
that look really uh really
realistic um again fancy buildings weird
weird looking buildings as I as I've
shown in the token slide and this is
really because the tokenizer is
terrible um but yeah you can see the
building move like it's a really good
physics understanding uh the problem of
this image has the cabl and some people
don't hide the cables from in front of
the cameras which is not a big problem
but you can see that the cable stays
there um pretty consistent in the frames
uh this one here it's a Snowy Road and
the snow persists uh after the roll out
so the snow is still there at the End of
the Roll out which is really interesting
uh in this one the model just want to
stop and takes a picture I guess of of
uh of the surrounding I don't know maybe
a Mountain Road or
something um
so yeah this is this is it this is Drive
GPT any
questions so you mentioned that you can
get like an initial image and then and
then you can also say that move straight
or like move right so are you
conditioning on language at all like the
tokens um okay so we don't conditional
language uh uh I was talking about the
pose which is the six numbers six
numbers are essentially moving so the
your speed lateral speed longitudinal
speed and z in the z-axis so those are
the the numbers that we use to condition
the model to go left or right or to go
faster or slower so we have those number
baked in the model so those are special
tokens call them the POS tokens and
those are used to condition so we can
either let the model Go free falling so
the the model also also uh predicts
those tokens so the model knows which
are the most likely next pose so we can
either run the model with those and we
the model will be unconditioned so we
just use those from the model or we can
just go in and say tell to the model no
no no this is not what we want we want
to go right
and then put those tokens in and the
output of this thing will be a
conditioned video does that answer the
question we have a question here oh well
great
question come through here can I
squee awesome talk thank you um I have a
question about the bottlenecks in your
pipeline what's the like top bottlenecks
in pipeline 2 it for real
time so these models are quite big uh
even though they're not as big as CH GPT
and Lama they're they're a little big
and we we currently bought neby software
we're not
reaching Ram bandwidth or not even
reaching flops bandwidth so uh we just
really B neck by good software
inferencing GPT models Transformer
models uh currently we just use Onyx
which is a pretty standard inference
engine um and and there are some fancy
ones that that are coming up and uh yeah
so currently we're bought neck by um by
software
um when we reach the limits of the
software we will probably need either to
uh to do some tricks on the architecture
to make it faster um or just use more
gpus all
right thanks for the talk um So
eventually maybe these uh rollouts will
be at least human indistinguishable from
real rollouts yeah um what applications
open up when you get
there so the first application we see
here is really learning the mod learning
in this driving simulator so we want to
use this replace completely replace our
small offset simulator and the the
driving model is basically going to live
in this world uh and it's going to drive
around go grocery shopping go to the the
movie theater theer and uh just learn
how to drive in this in this in this
driving simulator um I mean other
applications might pop up I don't know
like a game or something but uh for now
we're focused on learning a driving
model in the
simulator
um are you worried about uh using too
much of this learned uh simulation in
your models and causing a model collapse
a model
collapse um so I guess you're um
referencing um training on iteratively
training on models um and that would mod
cause a model collapse uh well that
happens when the models are are we have
proof that this happened for models that
are similar so let's say you train chat
GPT on chat GPT data on chat GP data and
you do this tively the model will
collapse it also has been showed to
exist for image generation data as well
uh but the models that we will train
here are very different this model
that's a simulator is going to um is
going to basically learn learn how to
imagine driving data but the model that
we'll train on it is a completely
different model it's a model that learns
how to drive so these will be very
different and we're not going to do this
iteratively this is going to be just a
one-step process and uh we will improve
both of the models uh independently but
there's not going to be any any
iterative process so we are aware of the
model collapse but we don't see it as an
issue for now um and yeah does that
answer your question
yeah I have two question one do you
consider your mask or to includer that
can compose about
90% uh of the image and the second one
is you talk about a video encoder if you
use a video includer then forward to
the uh Transformer model it should be
output also a video as well is that
correct
mhm yeah so your first question was
about mass auto encoders and that's what
I was referring to as MK git or similar
approaches to train uh image tokenizers
and such uh we tried um it didn't really
work that well
um but yeah it didn't really work that
well what worked well is the cleanest
solution the most obvious one worked
well we tried to go fancier and it
didn't work so I guess there's something
to learn here uh then your next question
was uh can you repeat your next question
I
forgot if you have a video incoder that
means if you put this audio incoder the
code to the Transformer mhm okay if you
go to the forward you it should be gener
every token is a video is that correct
uh so what what I've uh was referring to
as a vid as a video decoder is something
close to like an i and B frame uh kind
of tokenizer so some different types of
tokenizer what one would be like a like
a general I frame and then a p frame
that's a smaller set of tokens or
smaller basically more compression in
the diff frames so this is what I was
referring to as a video Talk video
encoder but again this is something we
haven't done yet and uh uh I guess we'll
we'll see we'll see what we work and
we'll see what other people are trying
and uh try to try to try to navigate in
this um in this research
area um is
the so uh is is the output from the
simulator only is used to train the
policy model because the way I
understand there's two models there's
the vision which is like efficient net
B2 and then the uh policy model okay so
you're you're one of the questions from
before right
no no okay so I guess I will answer both
questions um uh there was one question
before about why we say there's two
models while we also say that we're end
to end uh so there are two models and uh
when we say we train end to end uh it's
because these two models really have the
same loss function these two models
predict the same thing these two mods
predict what is the plan and then uh
they just predict the plan what and this
is the only thing we use we use the plan
from the model the vision model predicts
the plan and the policy model as well
predicts the plan now why do we need two
models we need two models exactly
because we need a simulator so these two
models are living in two different
worlds the vision model lives in the
real world and the policy model lives in
the simulated world so we did the split
because these two model need to be
trained uh in different worlds and um
and yeah so we're still end to endend
because we're not using any bonding
boxes we're not using any perception
kind of layer that says oh these These
are traffic lights and such so um so
yeah I I hope this answer the first
question and uh the second question uh
uh yes this uh simulator will so the
policy model will be trained on this on
this simulator but not not the vision
model all
right hey great presentation um my
question as you as a researcher I'm sure
you know there's been so many
advancements in AI so my question is
regarding how do you balance researching
testing and you know playing around with
all the recent developments in for
example tokenizers that's the topic that
I want to focus on you know all the new
tokenizers that come out how do you
focus on testing out and you know
working playing around with all those
new developments from other teams but
also clearly developing your own stuff
since you're a researcher you you want
want to build your own stuff so H how do
you
balance so keeping up with with
state-ofthe-art is is it's pretty hard
there's a lot of things that are that
are happening right now machine learning
um is growing very fast but there's one
signal that I've I've noticed is that I
mean you don't want to be the first one
to replicate a paper this it's kind of a
useless thing to do unless you really
unless you're doing it to learn or
unless you're doing it to practice or
you're interested in disp personally but
replic being the first person to
replicate um it's not that that good so
you want to wait for other people to
replicate and see see feel feel the
waters and see if something looks useful
or not and um usually this takes about a
week or two people are very
active uh and then uh pushing the
stateof the-art again uh you you really
want to balance being at the edge of
state-ofthe-art or pushing it a little
far and uh
I I come over trying to push it where we
need to push it and um there's a lot of
researcher outs outside of K there's a
lot of people a lot of labs that are
working on the same problems and um it
would be good if they did the work for
us but sometimes they don't um so we try
to leverage their work as much as we can
and we also open source our stuff so
it's not like a one-way Highway here uh
we open source our findings we write
blog posts we publish data sets so when
we see the need to push the stateof the
art we do it and then we share with
people it's not it's um yeah just a
little line that we need to balance but
uh but so far worked
great uh my question is where do the
model names come from what do Nicki
Minaj and Nicholas Cage have to do with
driving great question I don't know if
I'm allowed to say am I allowed to
say let's see trade secret we don't have
a lot of Secrets but trade secret sorry
we're we're going to keep
these I had some questions about just
the tokenizer aspect in general like
what motivates to stick to like these
discret tokens in I'm Sor repeat can
what's the motivation between sticking
to like this discret token
representation versus um like maybe a
more regressive like doing regression is
that just because like cross entry belw
is so simple and nice or is there
something else and then couple more
questions about the tokens is there like
some position dependency on those have
you tried looking at like the interpret
like have you tried interpreting what
token 95 means for example oh yeah great
questions so we tokenize because
crossentropy is the best loss function
everyone knows that whatever else is a
just a scam doesn't
work uh but yeah crossentropy is the
best L function it's really simple uh
it's um yeah I I can talk a lot about
why crossentropy is good but it's not
really the The Talk today um your next
question question was about interpreting
the tokens so these are like visual
tokens so so you can you can like feed
an image of just token 111111 and then
see what the decoder says and these will
be like basically colors or basic uh
basic um um patterns or you know zigzags
and stuff like that edges and things
like that so these are visual patterns
and they have they do have positional
information um and uh the Transformer
has a POS positional en coding as most
Transformers but I heard that we don't
really need this positional en coding
but we still have it uh but yeah they
have we can interpret them we can see
what each token looks like we can see if
our tokenizer is efficient or not we can
see if like all token all all the tokens
have been utilized and all tokens mean
different things so you can somewhat
interpret these tokens and they have
positional information as
well uh say driving is very different
around the world uh I was wondering if
you looked into conditioning on
geolocation uh that's a good uh that's a
good question there's multiple ways we
can condition these things we can
condition them on weather we can
condition them on on GE location we can
condition them on type of car and so and
so on uh we don't even want to go in
this detail we just want to build the
most General simulator possible if
someone wants to condition them on on uh
on Country look the data set is open
source uh they can they can condition
them on on on countries and and look at
data from Venezuela or from Mond or
anything so um yeah we just want to
build the most General simulator we want
to condition it on the least possible
things thanks for the talk um I was
curious I know Harold mentioned the
long-term goal of comma being um from
going from just cars to broader areas
like robotics so I was wondering first
of all if you plan to use the same like
GPT style simulator and just how you
think it scales to something like
robotics where you have more degrees of
freedom and maybe a different like
distribution of output
spaces yeah great question this is one
of the main motivators of using this
simulator is that it can scale to any
type of Robotics problem um it has more
more degrees of freedom but um we use
the very simple post tokenizers which is
EMP digitize if you have more degrees of
freedom you just use a more fancy
tokenizer for that um this really scales
to any type of of Dynam of of of
Robotics problem you want to want to do
and as you can see most recent robotics
uh fancy looking Solutions now use
something that looks like this um so
really excited about how we can extend
this to uh something outside of driving
as
well hey thank you so yeah kind of
related so uh I'm thinking about this
scenario say this is for uh this is for
the inut for the driving model right so
right now I was saying okay I want to
drive from a and to B for example please
give me uh please give me the scenario
of driving to the nearest tle Bell but
this is language right I'm just curious
why we don't put language as the you
know uh the first input and generate the
you know xray the driving uh video sors
yeah we don't really need language um I
mean we can condition anything with
floats with floating points numbers um
language is very inefficient um why not
use something that has a lot more bits
than uh Than Words um we
condition it on text some people are
doing it um we we really can do it you
can just connect this to an llm connect
this to LK 7B and then put the put the
text and get the embedding and then plug
it back into the GPT that's something we
can do uh we haven't been doing this I
mean these are really cool demos right
they they're cool for papers they're
they're fun things to do uh We've really
been trying to to make something as
general as possible and um yeah again if
someone wants to do this really easy
um just uh you know plug it back with
the Lama 2 and see what happens it's a
could be a cool project we got one last
question here in the
back cool um could you speak a little
bit more about the temporal consistency
aspects in particular I mean the the
training data is temporally consistent
so kind of what's the intuition behind
why the predictive model is unable like
has some flickering and why it's not
able to learn temporal consistency and
then what the ideas between like like I
know you had a slide on it but I didn't
quite understand the the core ideas that
enable the loss of flickering okay
so me go back to it it's it's it's going
to be white light
mode um so why does the model not
predict Smooth video on its own uh well
because the data is not smooth the data
it's trained on is chiz frame by frame
so the data that the model is is is
trained on isn't good it's FL FL
flickers so even the ground through data
of this model
flickers um and it flickers because the
tokenizer is frame by frame doesn't have
any temporal memory it doesn't have any
smoothness to it it just frame by it
just it just flickers and I mean a good
question would be why does it flicker
why ises it not pretty smooth and it
flickers because just compression right
we we're asking this model to really
compress this really hard um so um it
will Flicker and we notice that the more
bits we use the less flickering we see
so this is to answer your first question
uh what does it flicker then uh the
smoothing decoder basically is just
sticking an RNN layer just taking a
layer that has a memory and uh at each
step we share that memory to the next
step and then uh doing this we we have
like a running stage and doing so the
decoder has more information now and
knows how to smooth um the decoder
didn't have that information before
didn't know what happened a second ago
didn't know what happened the frame ago
so it couldn't even smooth now it can
smooth and as you can see uh it works
does that answer your
question okay all right give it up for
your scene thank
you
foreign
my name is Yasin I work in research
comma and
who's excited about some machine
learning
yes
I heard that I haven't started
presenting yet and I already have some
questions so I guess I'll answer them
later don't forget
so today I'm going to talk to you about
our progress in learning a driving
simulator
so it's been a few months of of this
project and we have some exciting
results and I would like to talk to you
about them
um
before I start I would like to show you
approximately where we're heading after
this presentation so as you might have
guessed none of these videos are real
all of them are imagined all of them are
are predicted using the machine learning
model
of which we give a few frames of context
and then ask the model to predict the
next few frames in here about a minute
of frames
and uh
yeah as you can see the videos look
pretty good
um the temporal consistency is pretty
good too
so this is a minute of rollout as I said
they exhibit some really nice properties
you can see that some Physics is learned
some some great Dynamics is learned as
well for the night videos you can also
see that the lighting looks pretty good
which is something we really care about
and I'll come back to this slide after
we're done but pretty much by the end of
this presentation you should pretty much
understand how we built this and why is
it useful to us and what are our next
steps
but before let's go back to the basics
why do we even need a simulator
Harold talked about this this morning
we've talked about this two years ago in
the previous Comic-Con why even a
simulator
without a simulator the driving model
will never be exposed to any kind of
significant noise or any kind of
significant deviations especially the
noise introduced from its own mistakes
so
if you join a model outside of a
simulator without a simulator what's
going to happen is if you end up outside
of the center of the lane the model will
always say
um just keep doing whatever you're doing
and recover later we'll cover in a few
seconds and the next second it will also
do the same thing also say yeah you're
pretty good just just keep going and
then recover the center
in a few seconds
and the result of this is what you see
in the bottom video it's basically a
model that doesn't recover to the center
of the lane and just drifts outside of
the lane
so this is a problem and we need a
simulator for this
now a good question to ask ourselves as
well is why not a classical simulator
why do all these complicated things why
not just build a Unity or an other
origin simulator a GTA 5 kind of
simulator and why not just do that well
I'm not saying that this is a bad thing
these simulators are good for testing we
want them we want them for testing
because they're good for you know the
deterministic they're fully you can
build whatever you want you can build
whatever scenario but we want to use
this for training and training it is a
whole different Beast first of all you
need to match the training distribution
you need to match the real world
distribution of driving data and what is
even that how do you even quantify that
and how do you even know that you did
that you matched the real world
and even if you try to do this you would
actually need to hard code a bunch of
scenarios a lot of them and every day
you'll just be building a simulator you
never do self-driving just be building a
simulator and that's not really a
business that we want to be in so as you
understand as you might understand this
is not a scalable solution you don't
want to be hard-coding simulators for
training at least
so we came up with this thing called the
small offset simulator and Harold talked
about this this morning as well it's
basically a simulator in which we shift
the image a little to the right a little
to the left a little to the forward a
little backward to simulate little
movements uh from the original position
and when we train the model in this
simulator in closed loop we actually see
driving we see a model that recovers we
see a model that stops for stop signs
which is a model that stops for red
lights and this is quite amazing so this
is a small offset simulator and that's
what we've been running with for a few
years now
but as
you might have guessed we're trying to
go past it so why are we even trying to
go past here what's wrong with it
well Harold hinted at the problem this
morning which we call cheating
so in order to have a very good
simulator of the sort of this small
offset simulation you want to have
really good ground fruit you want to
have good highest estimation good road
plane estimation good pose estimation so
many good things they need to be pretty
much perfect and the problem is as soon
as you start to get some imperfection
some error you will have
similar artifacts and those artifacts
um can tell the model which which way
you came from or how to how to drive
basically so the model will learn how to
drive just by looking at the artifacts
instead of learning how to drive like a
normal human being
and trust me the model knows how to
cheat
so this is the first problem
the second problem is well it's in the
title it's a small offset simulator it's
not a big offset simulator so as as long
as as soon as we try to do some kind of
big offsets you can see that the images
look very funky and they really don't
look that good you don't want to drive
in this world
and that really doesn't matter for
lateral that much because you don't
deviate so much left to right while
driving laterally but Elon should know
this makes a big difference at highway
speeds plus minus 10 miles an hour it's
really a big distance so you really want
big offset Simulator for launch should
know
so
this is it this is our state right now
and why do we want to go past it so how
do we do this well
I'll tell some history here in 2016
Edward and George wrote a paper called
learning a driving simulator and I stole
the title of my presentation from this
paper
you don't have to read the paper you can
read it if you want but I'm going to
basically explain what the paper is
about today
the paper basically described what we're
doing now is just read 2016 Tech you
don't want to be doing 2016 machine
learning we want today's machine
learning 2016 machine learning sucks
this is what what 2016 machine learning
give you and
as you saw the first slide 2023 machine
learning is a lot better than this
so
what's an ml simulator so we're trying
to build an ml simulator
and Mr simulator is basically three
parts three components
and I'm going to go into each component
separately and explain what it does and
yeah by the end we'll go back to our
first slide so three components image
tokenizer a post tokenizer and the
dynamic Transformer I'll explain every
part separately
so an image tokenizer is basically a
fancy image compressor it's an ml image
compressor that takes in images and
compresses them into a set of tokens now
what's a token a token is just a fancy
name for a discrete number a number that
can only attend a small set of values
from a dictionary so
taking images images is a lot of pixels
then encodes them into this set of
tokens that are discrete usually these
tokens are not too much 128 512 tokens
and then with this tokenizer usually
comes a detorizer or an image decoder
that can bring you back to image space
and in which you can see what you
actually compressed and then compare it
this model is trained with the gun loss
with a generative adversarial loss and
this is what is usually referred to as a
VQ gun
so yes this is a our image tokenizer
and in this slide
I show from left to right a source image
an image compressed to 5820 bits and an
image compressed to 1280 bits
so I want to point out a few details
here that are that are pretty
interesting do you notice this EVS logo
here
notice how it's a little funky around
here but it's still some red things
around that area but notice that the
1280 bits just completely forgot about
the CVS logo you don't really need that
what what do you need logos in life
um you can also notice that the building
a little at the distance here looks okay
for the 512 45 1200 for
5920 bits image but the 1280 image looks
pretty funky uh the traffic light also
looks a little funky
um so yeah these are completely
classical compression artifacts that we
get here
um so the image this image is there's a
lot happening there's a traffic light
there's a logo there's buildings so it's
a complex image
for a pretty classic highway driving
image you really can see the difference
this looks really similar to me and so
for highway driving either 512 or 1200
that really doesn't make that much
difference and in order to iterate fast
so we want to iterate fast and we know
we can improve the quality of our
simulation by just scaling up the number
of bits in order to iterate fast do some
good experimentation we're working now
with this with this model but we know
that in the future as as our models
improve we can always scale up and get
better simulation so for now
128 tokens 10 bits each
now what's a pose tokenizer what's
supposed to start with the opposes
basically six floating points numbers uh
they're six degrees of freedom basically
your X speed y speed Z speed and then uh
your roll rates pitch rates and uh your
rate so we also need to uh to tokenize
these numbers uh just because of the
next component that I'm going to talk
about but trust me we need to do that
and we tokenize them with a very simple
tokenizer we basically need to digitize
them or to quantize them so we just
digitize them with the uniform bidding
very simple nothing fancy here
um
now to the beefy part
the Dynamics Transformer who knows what
a Transformer is
yes who's used shot GPT
same people some people more people I
see you cool
so yeah Transformer is is basically the
same architecture as a large language
model gpg llama these kind of these kind
of models
for large language models a token is
roughly speaking one word a sentence is
a set of tokens and the document or
paragraph is a set of sets of tokens for
us an image is a set of tokens a video
is a set of images so a set of set of
tokens and we train it with the same way
the large logos models people do very
nice loss function cross entropy predict
the next token
so very similar to large to large large
language models this is
this is the architecture of a
transformer for those who don't know
what a Transformer is it's basically a
fancy machine learning architecture
that's a stack of fully connected layers
and attention layers so just a black box
of a machine learning architecture
so we use this Dynamics Transformer uh
one token at a time so it's Auto
aggressive sampling each time we ask the
model what is what do you think the next
token will be we take that token plug
that back in in the inputs then ask ask
it again what would be the next token
plug that back in in the inputs and do
this until we reach a number of frames
these number of frames will give us a
sorry this number of tokens will give us
a frame we take that and then do this as
many times as we want until we reach
whatever number of frames we want so
this is what people usually refer to as
Auto aggressive sampling
Auto aggressive sampling so predicting
each token at a time so in theory doing
this is really powerful because you
could cover the whole distribution of
your training set
so you could cover the whole
distribution of possible rollouts given
given a context given a few frames this
could imagine any type of Futures which
is really desirable because you don't
want to restrict whatever happened next
whatever the driving model that will be
trained in the simulator you don't want
to restrict it to something specific you
want it to be as general as possible and
this is really desirable
we tried a few things
to speed up this Auto aggressive
sampling so it's a little slow we're
trying to speed it up we're trying
something that division like sampling uh
some fancy techniques for Mass git and
things like that but we didn't really
succeed at anything like that we'll keep
trying and something will will work and
we basically want to speed up the other
aggressive sampling which is a little
slow
so we do all this and it works
this is our
Dynamics model this is our simulator
so in here we just show it we just tell
it to drive straight
and as you can see drive straight
it's a pretty nice Highway drive
straight driving
but we can also ask it to do some things
like yank the steering wheel to the
right turn right as much as you want and
as you can see turns right changes Lanes
even goes out of the road even drives on
the grass that's pretty impressive
I guess some people did that in the
training set
who did that
you can also tell it to turn left across
the median drive in drive to the
opposite lane even get close to oncoming
traffic who did that
that's okay I don't want to know
you can also tell it to accelerate so
notice the Ley lines it passes the
traffic it passes some traffic so as you
can see there's some acceleration
happening in this in this rollout
you can also set it to break so again
notice the late lines they will slow
down so
as you can see successfully breaks
and as a side note we open sourced all
this open source a data set of 100
000 minutes of driving tokenized so
these are all tokenized with the
tokenizer that I've showed before we
open source the image tokenizer and the
image decoder and we also open sourced a
Transformer that's very similar to the
one I'm showing you today and that can
generate rollouts that look like the one
that I showed you today
we also have two one thousand dollar
bounties so if anyone feels
um feels like a weekend project
we want to decrease inference latency we
want to make this model run fast today
they run at 2fps so we want to run them
really fast
so if you improve the training latency
the inverse latency by 50 you get a
thousand dollars and if you decrease
training loss by five percent you also
get a thousand dollars so if anyone
wants a weekend project really fun
another side note
and so I've been showing you all these
images that went back to image space so
these videos that look good it's always
good that we can go back to image space
and debug these Dynamics these Dynamics
models and see what happens but in order
to train a driving model we actually
don't need to go back to Vision space we
don't need to go back to the image space
you can drive you can train the model
directly on the tokens
which is interesting so these images are
compressed to these tokens and these
tokens have everything you need to know
to drive which is pretty cool so instead
of having like a convolutional neural
network that takes in an image and
predicts the plan and predicts the Ley
lines and such now we have a Transformer
and then you have a plan and the
landline and all that and as you can see
here
it works it predicts the landlines
predicts the plan uh predicts some
reasonable outputs so you don't need we
don't technically need to go back to
Vision space in order to train them all
we can directly train it on tokens which
is pretty nice
another side note is that you've noticed
that the images are a little flickery so
they jump a little bit with the clouds
jump a little bit the clouds jump a
little bit so and we were aware of that
we know that our encoder is not smooth
and that's because our encoder is frame
by frame there's no temporal consistency
because there's no nothing that's
trained temporally so we want to fix
that then there's multiple ways you can
fix this we really want to have a
tokenizer that's video based that's not
image based what we're doing now is a
little naive you don't want to do this
frame by frame you really want to do it
for a set of frames to get some more
some more quantization you can get more
compression if you compress multiple
frames but there's a technique that
people have been trying and we tried
that as well is to have
a to just freeze everything and then put
a recurrent layer in your decoder which
essentially gives the the decoder like a
state that get passed from frame to
frame and the decoder can use that to
smooth the rollout so as you can see
here in the left is the raw roll out and
to the right is the smooth rollout so
much more much much smoother
so this works
um another side note is okay how do we
use this to train how why and what's
what what was missing for us to use this
to train
um we need a new loss function and why
do we need a new loss function well for
sufficiently long rollout the simulator
is going to imagine things that were
never in the context right it's going to
imagine traffic lights is going to
imagine turns it's going to imagine
curves on the highway and these are
going to be very far from the context
because we don't condition on anything
we just tell the model to imagine
something
so the human path that we have been
using so far to train will be Irrelevant
for sufficiently longer rollouts
so we need to come up with something new
we don't exactly know what to do and how
and how to do it but the idea is going
to be something close to like a value
model that like either a gun loss or
something like like something to
minimize this engagement or something to
basically another model that's trained
separately that quantifies whether
you're roll out whether you're driving
is good or not based based on based on
the rollout that you're showing it so
something like a value model as a loss
function instead of just Mae that we've
been using for a long time
so what are the next steps
a few uh weeks ago we tweeted sorry we
axed uh we X the video of our simulator
and the response some of the some of the
comments were funny but most most of all
they they really show what we need to
work on and what we actually work on so
I'm going to show some of the comments
the comments on the comments
Harrison really wants to play this he
says please let me play it we want to
play it too it's really fun but as I
said it's at 2fps you don't want to play
a game at 2fps so we really want to make
this faster
and that's something we're currently
working on we have bounties on it and
yeah we just want to make this faster
John said there is a left turn on red
and
this person said oh this is a green
light
and we know we know this we can see we
have eyes too uh this this potato
quality image and as I said this is 128
tokens 10 bits each so we know there's
compression artifacts but in order to
move fast in order to experiment faster
we're using this now we'll scale up when
we have either better video tokenizers
uh better sampling strategies so we will
scale up uh we just need to work on
these problems first
Leo said I feel like building the
simulator is not that hard
trust me Leo
[Laughter]
Leo we do things not because they're
easy but because we thought they were
easy
so this is basically I've been talking
about uh the auto aggressive sampling
using yeah using actually using the
models scaling the bits and scaling the
Transformer as well and we need better
video tokenizers
so going back to the slide these uh
these beautiful rollouts I'd like to
point out some nice properties uh look
at this lead car here where the the the
headlights turn on when it stops and
then they turn off when it goes on so
it's pretty nice
uh some of these rollouts are actually
really good how do you know if this is a
fake video or not this looks really good
this one as well looks quite nice
and this one the model takes an exit
and uh this one the model takes a does a
lane change then takes an exit which is
quite interesting the Night videos also
look good look at these lights light
Hollows that look really uh really uh
realistic
again fancy buildings
weird weird looking buildings as I've
shown in the tokenizer slide and this is
really because the tokenizer is terrible
but yeah you can see the building move
like it's a really good physics
understanding The Prompt of this image
has a cable so some people don't hide
the cables from in front of the cameras
which is not a big problem but you can
see that the cable stays there
um pretty consistent in the frames
this one here it's a Snowy Road and the
snow persists after the rollout so the
snow is still there at the end of dorola
which is really interesting
and this one the model just want to stop
and takes a picture I guess of of uh of
the surrounding I don't know maybe a
Mountain Road or something
so
yeah this is this is it this is Drive
GPT
any questions
wait you see we know there's lots of
questions oh yeah I forgot should we
start with those
who are the people who had the two
you've seen questions before
over here
all right
so you mentioned that you can get like
an initial image and then you can also
say that move straight or like move
right so are you conditioning on
language at all like the tokens
um
okay so we don't condition our language
uh I was talking about the pose which is
the six numbers six numbers are
essentially moving so that your speed
lateral speed longitudinal speed and Z
the z-axis so those are the the numbers
that we use to condition the model to go
left or right or to go faster or slower
so we have those number baked in the
model so those are special tokens call
them the post tokens and those are used
to condition so we can either let the
model Go free falling so the model also
also predicts those tokens so the model
knows which are the most likely next
pose so we can either run the model with
those and we the model will be
unconditioned so we just use those from
the model or we can just go in and say
tell to the model no no no this is not
what we want we want to go right and
then put those tokens in and the output
of this thing will be a conditioned
video
is that answer the question do you have
a question here
well
great question
come through here
awesome talk thank you um I have a
question about the bottlenecks in your
pipeline what's the like top bottlenecks
in pipeline to inference it for real
time
so these models are quite big even
though they're not as big as GPT and
llama they're they're a little big and
we currently bottlenecked by software
we're not reaching
Ram bandwidth or not even reaching flops
bandwidth so we're just really
bottlenecked by good software
inferencing GPT models Transformer
models currently we just use Onyx which
is a pretty standard inference engine
and there are some fancy ones that are
coming up and yeah so currently we're
bottlenecked by by software
um
when we reach the limits of the software
we will probably need either to uh to do
some tricks on the architecture to make
it faster or
just use more gpus
all right
thanks for the talk
um
So eventually maybe these uh rollouts
will be at least human indistinguishable
from real rollouts yeah
um what applications open up when you
get there
so the first application we see here is
really learning the learning in this
driving simulator so we want to use this
we replace completely replace our small
offset simulator and the driving model
is basically going to live in this world
uh it's going to drive around go grocery
shopping go to the movie theater and
just learn how to drive in this in this
in this driving simulator I mean other
applications might pop up I don't know
like a game or something but uh but for
now we're focused on learning a driving
model in the simulator
um
are you worried about uh using too much
of this learned uh simulation in your
models and causing a model collapse
a model collapse
um so I guess you're
referencing
um
training on intuitively training on
models and that would cause the model
collapse well that happens
we have proof that this happened for
models that are similar so let's say you
train charge gbt on charge gbt data on
charge TV data and you do this
iteratively the model will collapse it
also has been showed to exist for image
generation data as well but the models
that we will train here are very
different this model that's a simulator
is going to
um let's go into basically learn how to
imagine driving data but the model that
we'll train on it is a completely
different model it's a model that learns
how to drive so these will be very
different and we're not going to do this
iteratively it's going to be just a one
step process and we will improve both of
the models independently but there's not
going to be any any iterative process so
we are aware of the model collapse but
we don't see it as an issue for now and
yeah let's answer the question yeah
I have two questions when do you
consider using mask or to encoder that
can compress about that in the person
of the humidity
and the second way is you talk about a
video encoder
if you use your waiting cradle then
forward to the
a Transformer model
it should be output also a video as well
is that correct
yeah so your first question was about
mass auto encoders and that's what I was
referring to as mask get or similar
approaches to train uh image tokenizers
and such we tried it didn't really work
that well
um
but yeah it didn't really work that well
what worked well is the cleanest
solution the most obvious one worked
well we tried to go fancier and it
didn't work so I guess there's something
to learn here then your next question
was uh Theory period next question I
forgot
if you have a video included that means
if you put this
audio encoder the code
to the Transformer okay if you go to the
forward it should be General every token
is a video is that correct uh so what
what I've uh was referring to as a vid
as a video decoder is something close to
like an INB frame uh kind of tokenizer
so some different types of tokenizer
what would be like a like a general
iframe and then a p frame that's a
smaller set of tokens or smaller
basically more compression in the diff
frames so this is what I was referring
to as a video Talk video encoder but
again this is something we haven't done
yet and uh I guess we'll we'll see we'll
see what will work and we'll see what
other people are trying and try to try
to navigate in this in this research
area
um is the the
so it uh is it is the output from the
simulator only is used to train the
policy model because the way I
understand there's two models there's
the vision which is like efficient net
B2 and then the uh policy model okay so
you're you're one of the questions from
before right
no no okay so I I guess I will answer
both questions
um uh there's one question before about
why we say there's two models while we
also say that we're end to end uh so
there are two models and uh when we say
we train end to end uh it's because
these two models really have the same
loss function these two models are
predict the same thing these two models
predict what is the plan and then
they just predict the plan this is the
only thing we use we use the plan from
the model the visual model predicts the
plan and the policy model as well breaks
the plan now why do we need two models
we need two models exactly because we
need a simulator so these two models are
living in two different worlds division
model lives in the real world and the
policy model lives in the simulated
world so we did the split because this
model needs to be trained in different
worlds and
and yeah so we're still end to end
because we're not using any bonding
boxes we're not using any perception
kind of layer that says or these are
these are traffic lights and such so um
so yeah I hope this answer the first
question and uh the second question uh
yes this simulator will so the policy
model will be trained on this on the
simulator but not not the visual model
all right
hey great presentation
um my question as you as a researcher
I'm sure you know there's been so many
advancements in AI so my question is
regarding
how do you balance researching testing
and you know playing around with all the
recent developments and for example
tokenizers that's the topic that I want
to focus on you know all the new
tokenizers that come out how do you
focus on testing out and you know
working playing around with all those
new developments from other teams but
also clearly developing your own stuff
since you're a researcher you you wanna
build your own stuff so how do you
balance
so keeping up with with state of the art
is it's pretty hard there's a lot of
things that are happening right now
machine learning is growing very fast
but there's one signal that I've noticed
is that I mean you don't want to be the
first one to replicate a paper this is
it's kind of a useless thing to do
unless you really is actually doing it
to learn or unless you're doing it to
practice or you're interested in this
personally but replica being the first
person to replicate
it's not that that good so you want to
wait for other people to replicate and
see see fill the waters and see if
something looks useful or not and
usually this takes about a week or two
people are very active
and then pushing the state of the art
again uh you really want to balance
being at the edge of state of the art or
pushing it a little far and uh I come
over trying to push it what we need to
push it and there's a lot of researcher
outside of coma there's a lot of people
a lot of labs that are working on the
same problems and it would be good if
they did the work for us but sometimes
they don't so we try to leverage their
work as much as we can and we also open
source our stuff so it's not like a
one-way Highway here we open source our
findings right blog posts we will
publish data sets so when we see the
need to push the state of the art we do
it and then we share with people it's
not it's um yeah it's just a little line
that we need to balance but uh but so
far worked great
my question is where do the model names
come from what do Nicki Minaj and
Nicholas Cage have to do with driving
great question I don't know if I'm
allowed to say am I allowed to say
we're gonna keep these
I had some questions about just that
tokenizer aspect in general like what
motivates to stick to like these
discrete tokens
what's the motivation between sticking
to like this discrete token
representation versus
um like maybe a more regressive like
doing regression is that just because
like cross-entropy loss is so simple and
nice or is there something else and then
a couple more questions about the tokens
is there like some position dependency
on those have you tried looking at like
the interpret like have you tried
interpreting what token 95 means for
example
oh yeah great questions so we tokenized
because cross entropy is the best loss
function everyone knows that
whatever else is uh persist Camp it
doesn't work
uh but yeah cross entropy is the best
last function it's really simple uh it's
uh yeah I I can talk a lot about why
cross entropies is good but it's not
really the The Talk today
um
the next question was about interpreting
the tokens so these are like visual
tokens so you can you can like feed an
image of just token one one one one one
one and then see what the decoder says
and these will be like basically colors
or basic uh basic um the patterns or you
know zigzags and stuff like that edges
and things like that so these are visual
patterns and they have they do have
positional information
um and uh the Transformer has a position
encoding as most Transformers I heard
that we don't really need these
positional encodings but we still have
it but yeah they have we can interpret
them we can see what each Joker looks
like you can see if our tokenizer is
efficient or not we can see if like all
token all the tokens have been utilized
and all tokens mean different things so
you can somewhat interpret these tokens
and they have positional information as
well
say driving is very different around the
world I was wondering if you looked into
conditioning on geolocation
uh that's a good uh that's a good
question there's multiple ways we can
condition these things we can condition
them on weather we can condition them on
on geolocation we can condition them on
type of car and so on uh we don't really
want to go in this detail we just want
to build the most General simulator
possible if someone wants to condition
them on on uh on Country if the data set
is open source uh they can they can
condition them on on countries and and
look at data from Venezuela or from
Uganda or anything so yeah we just want
to build the most General simulator we
want to condition it on the least
possible things
thanks for the talk um I was curious I
know Harold mentioned the long-term goal
of comma being
um from going from just cars to broader
areas like robotics so I was wondering
first of all if you plan to use the same
like GPT style simulator and just how
you think it scales to something like
robotics where you have more degrees of
freedom and maybe a different like
distribution of output spaces
yeah great question this is one of the
main motivators of using this simulator
is that it can scale to any type of
Robotics problem
um it has more more degrees of freedom
but we use the very simple post
tokenizers which is MP digitized if you
have more degrees of freedom you just
use a more fancy tokenizer for that this
really scales to any type of of dynamic
of of Robotics problem you want to want
to do and as you can see most recent
robotics
fancy looking Solutions now use
something that looks like this so we're
really excited about how we can extend
this to something outside of driving as
well
hey thank you so so yeah kind of related
so I'm thinking about this scenario say
this is for
the driving mode right so right now I
was saying okay I want to drive from a
and to B for example please give me uh
please give me the scenario of driving
to the nearest Taco Bell but this is a
language right I'm just curious why we
don't put language as you know the first
input and generate the you know actually
the driving videos nearest
yeah we don't really need language
I mean we can condition anything with
floats with floating points numbers
language is very inefficient why not use
something that has a lot more bits than
uh Than Words
um we can condition it on text some
people are doing it
um we we really can do it we can just
connect this to an llm connect this to
Lamas 7B and then put the put the text
and get the embedding and then plug it
back into the GPT that's something we
can do we haven't been doing this I mean
these are really cool demos right the
the code for papers they're fun things
to do we've really been trying to to
make something as general as possible
and yeah again if someone wants to do
this really easy
um just uh you know plug it back with
the Llama 2 and see what happens it's a
could be a cool project
we got one last question here in the
back
cool um could you speak a little bit
more about the temporal consistency
aspects in particular I mean the the
training data is temporally consistent
so kind of what's the intuition behind
why the predictive model is unable it
like has some flickering and why it's
not able to learn temporal consistency
and then what are the core ideas between
like I know you had a slide on it but I
didn't quite understand the core ideas
that enable the loss of flickering Okay
so
let me go back to it
it's it's it's going to be white light
mode
um so why does the model not predict
Smooth video on its own uh well because
the data is not smooth the data it's
trained on is tokenized frame by frame
so the data that the model is is trained
on isn't good it's flickers so even the
ground data of this model flickers
and it's because the tokenizer is frame
by frame it doesn't have to need some
portal memory it doesn't have any
smoothness to it it's just frame by it
just it just it flickers and I mean a
good question would be why does it
flicker why is it not pretty smooth and
it flickers because just compression
right we're asking this model to really
compress this really hard
um so it will Flicker and we notice that
the more bits we use the less flicker
when we see so this is to answer your
first question uh what is the flicker
then the smoothing decoder basically is
just sticking an RNN layer just sticking
a layer that has a memory and at each
step we share that memory to the next
step and then doing this we we have like
a running State and doing so the decoder
has more information now and knows how
to smooth the decoder didn't have that
information before I didn't know what
happened a second ago didn't know what
happened the frame ago so it couldn't
even smooth now it can smooth and as you
can see it works
does that answer your question
okay all right give it up for your scene
thank you
Yes. All right. We're reconnected.
>> All right. Looks like we're connected.
>> All right.
Hello from CES, guys. We got a little
bit of a crowd here at the booth. Let's
uh see what we got so far.
>> Let's see. All right. So, less is more.
Less is more. Let's see what the guesses
are.
Someone says ET headless.
>> Yeah. Yeah. Free small TV with purchase
of 3x. Uh,
>> no. Footage of the world's smallest
violin. Headless with a mobile app.
Headless with an Apple Vision Pro app.
>> Should we do a Vision Pro app?
>> We can make a Meta Quest app.
>> Maybe I can sell my Vision Proa
4X. Uh, did you skip one? $1,000 says
comma 3x is extra 3xs. It's too many
letters
isn't making any new card. So I dropped
you
a lot of uh
>> let's see let's see.
>> Are we live? Everything working good for
everybody? It's a little blurry.
>> How's it now?
Karma robot upgrade. Uh, it is a robotic
upgrade for your car.
>> Show you guys the boot.
>> So, we got a 10x20 this year.
>> We got the same uh similar uh video
displays going as last year. And then uh
we got these nice time lapses.
>> Tiny box of red.
Nice
tiny logo
>> AI for your car.
>> So fun.
>> And then uh got some more time lapses.
These videos here are videos from you
guys on YouTube. Um super cool to be
able to show people and say like, "Hey,
these are all just from real users."
>> Um
>> got another stand here.
>> Make driving chill cones.
and then uh giving out these air
fresheners.
>> Yeah. We we don't make the hardware.
We're writing the software.
>> All right.
>> So, I think we'll wait a little bit.
We'll wait for 250 people to be in here
before we announce the price.
>> You gave him a tour.
>> Yeah. I gave him a tour of the booth.
>> Hey guys, what's up? Welcome to CES.
Anything you want to point out about the
booth?
>> We're excited to have you.
>> Um, did you show them tiny box here?
>> Yeah, I show them tiny box for your
carame.
>> Yeah, it's that way now.
>> Um,
>> any more guesses what the announcement
is?
>> Yeah, we'll wait until 250
>> and we'll start the announcement.
>> If you come by our booth, we still have
any hats, we'll give you some. If you're
at CES, come by. LVCC West Hall 6475, I
think.
>> We're having a great CES. People are
really responding positively.
>> Yeah.
>> Yeah. I feel like there's a lot of hype.
>> Oh, I didn't show the
uh setup diagram. Want to show that off?
>> Oh, yeah. Yeah, sure.
>> Finally made it easy to understand how
to install the device in your car.
>> Yeah, people really like this. They
understand like, you know, this is
what's in your car. This is what we give
you. We just give you an upgraded
version of the lane keep camera in your
car. probably.
>> Okay. But tell them we're no longer
calling it installation.
>> Oh, we're also not calling it
installation.
>> Installation is banned even though it's
it's right here.
>> Um,
>> first offenders.
>> Yeah. Um, we're calling it plugging it
in now. You know, nobody's going to say
I can't plug in the device into my car.
Um, all right. Let's see. Power commas
models. We'll talk about that in a bit.
Comma 3 thin. Comma 3X AI flops. Uh
yeah, it's got tons of AI flops.
>> Where's George? He's not at the booth
right now. Um
>> plug and pray. No, no, no. Plug and
play.
>> Plug and play has always been a good
saying. Yeah,
>> less talking is better.
>> We agree. We agree. Um Nvidia Cosmos
impacts um
>> nothing. It will not impact profile for
you.
>> What does a car need?
>> When will be a model that drives M
lanes? Uh our models do that pretty
reliably. MLSM update. Yeah, we'll talk
about that. Functions in the car and you
just
features
updates.
>> ML. Yeah. Yeah, we'll talk about that.
Live stream is still pixelated. It looks
good on my end. We don't have anybody.
>> All right, we have 247. I think we're
ready.
>> Shane, let's get started.
>> All right,
Shane is going to unveil our
>> Yeah, let's do it.
Check out your plug in, put the trim
back on, and just like this guy, you
already drive it.
>> Is it already in use?
>> You guys see that?
>> Ready? Ready? Wait, let's build up to
it. Let's build up to it. Can we get a
countdown?
Five, four, three, two, one.
>> Get to do it slowly, though. That's what
it'll feel like. [laughter]
>> All right, let's do it.
>> Bit anticlimatic.
>> All right. You guys remember Black
Friday?
>> This year, every day is Black Friday.
>> Yeah.
some of our audience is uh you guys will
be clapping.
>> Um
>> yeah, [cheering]
>> $9.99. We did it.
>> Um
we were here 2 years ago. We dropped the
price to $14.99 on the 3. Um we're
finally at $9.99 on these beautiful
3Xs. And I think uh Shane, we got to
merge the PR.
>> Can we deploy the website? Let's
deploy the website and then uh
>> we got our first uh99 customer ready
here
>> as soon as it's ready.
>> Yeah, we're already on Shopify on
everything.
>> Shopify.
>> We're Black Friday C. They got the same
deal. I don't know why Black Friday
people should be happy.
It's actually crazy when you think about
it. Yeah, it's the same thing we were
able to ship you for $2,200 originally
on the 3, you know, three and a half
years ago. Now it's $9.99. Um, thoughts
on H1B. We love H1Bs. Um, we got them
for people all the time. Props to Com
for continuing to lower the price. Yeah,
it's what we spent all year doing. We
last year we really tried to get these
3Xs down for you guys. Um, still so many
more. Um,
>> Black Friday sale did really well. Um,
last Black Friday sale. Yeah. Nice. I'm
delighted.
>> Do I have to buy a new one?
>> Yes. When? 8.99.
>> Um, so this,
>> you know, this is it for the 3X. Um
we really hoping that we can just uh
you know we uh we've kind of like
reached the right place on the price.
This is what we've been aiming for. Uh
we did lightning hard which is the
custom 845 SA um that shipped last year
E3. We lowered the price of that. Um we
really been working on design for
manufacturability, better supply chain
um and operationally being more
efficient on this stuff.
Comma 3X is a big big big um improvement
on the design front
>> and uh
you know this is what we've been aiming
for for years and years. Um we launched
the common 3. It was all the stuff we
wanted to build and then you know it
took us a few years to get it down to
the price um
>> to the price of like Coma 2. We're back
to three digits. Price drop benefits
everyone. Nobody's getting screwed over.
More users for more training. That's
right. That's right. That's right.
>> Are we ready on that?
>> Deploy.
>> Internet is down at the convention
center. Okay.
>> 99 is the best price. I don't think a
lot would have the same emotional
marketing. Yeah. I mean, it's not about
emotion or marketing. This is probably
the optimal. Um, this has been the
target the whole time. Um, and we've
lowered it as we were able to. Um, as
we're able to improve things. Difference
between 3 and 3X mainboard is night and
day and good for reliability. Yeah, if
you see those pictures, it looks
beautiful. Um, the common 3 is cool. It
was the first thing we did like fully in
house and then 3X is, you know, we
learned a lot of lessons. Um, 3X is
beautiful. Lightning heart is beautiful.
If you've seen that, shout out to Robot.
Um,
>> does really, really great work. Um,
what's Rob with Open Pilot and Tidy
integration? Um, so now Open Pilot as of
a few weeks ago is running like straight
up tiny master. We bump it regularly
now. Um, so that's super cool. Um, we're
in like all the normal code paths now.
Chen, do you want to talk about open
tiny a bit?
>> So Chenu's uh, we're borrowing him here.
He's doing common pitches for the week.
>> Uh, so it's nice.
So K was using a one-year-old tangy
bread and it's very nice and it's to the
master right now.
>> Yeah. No, we we are on as of last week.
>> Yeah. So we make hard to make tiny
rounds fast on your device so that you
can
>> so that's open and tiny. Um
>> straight from tiny themselves. Nice to
meet you.
>> Um, all right. This is better than a new
product, TBH. Yeah. Um, so some people
have come by the booth and, you know,
they're talking about new hardware, you
know, comma 4, 5, and we ask them what
they want and they say most of the time
experimental mode. Um, they want
experimental mode to be good. And the
good news is that's coming to your 3X.
It doesn't need any new hardware. Um,
and this is largely all the companies
working on um, working really hard. Um,
you know, they always think it's going
to go faster. Um,
>> oh 99.
>> All right.
>> It's live.
>> Yep.
>> All right.
>> Where's our first customer?
>> You head out.
>> You head out. It's live. Anybody ready?
Anybody buy already?
>> Any word on the Atera collab? Um, I
don't know. I saw their booth.
They're just uh
>> they are integrating Open Pilot and kind
of following the the guides we've
published publicly. Um we've have blog
posts about this. Um
>> when can I call someone and ask? If you
want to talk to anybody at Kama, this is
kind of the the one time a year you can
do it.
>> Um
extended warranty plans. We did that.
Nobody wanted it.
>> Um any updates on Toyota security? Yeah,
there's a bunch of RAV 4 Primes driving
around. Toyota Siennas. Um,
does this training stack run on tiny
drive? Not yet. Um,
>> anyone who complains about the pricing,
you see the additional cost, eight ass
packages of traditional OEMs. Yeah. Any
thoughts on a headless device? What does
headless mean? You want like a screen
separate or no new device today? Well,
you know, same 3X, lower price. And
that's the real victory. It's the same
thing. It's a Comma 3 that we were able
to sell at $2,200 for $9.99.
Show the team and names. Uh, yeah, we
can do that. We got Shane here. Shane's
making sure the new price deployed. Um,
Shane's the car team at KA. All 300 cars
on the list. That's all Shane. Um, along
with the community, of course.
>> Real improvements are coming to your
Toyota.
>> Yes. Yes.
>> Real improvements for your Toyota. Um,
lots of cool content on Twitter, lots of
plots. You guys saw Alex, you guys saw
Chenu. Uh, Mitchell is around somewhere.
I'm not sure where right now. Uh, I
think he's checking out some other
booths and Julie is uh doing a comma
pitch right now. So, we'll talk to Julie
in a sec. Um,
>> more common merch. So, we have merch at
the booth. Grab CES. Come stop by the
booth
and we'll give you some merch.
>> Regular software.
>> We got our first order. Nice. Nice.
Nice.
>> No screen for head. So, you guys don't
want a screen. That's interesting. Uh I
think you kind of need a screen.
>> Okay.
>> I don't know.
>> If the community like this is something
like I think the community can actually
do a pretty good job of um like forks
innovated on end dog. Forks are you know
they offer a lot of value with mads. Um
>> maybe this is something like some hard
fork.
>> Um
no display on the
second order is in. There we go. There
we go.
Um Black Friday sale would really wipe
us out. We sold 2,000 devices that
month. Um, it's pretty crazy. Best month
ever by far. We had our best sales day
ever on Cyber Monday. Um,
yeah, I think this new price is going to
crush it. Starting 2025 off. Less is
more is kind of the theme for the year.
ML Sim, you know, less code, more neural
network. Um,
>> Shane from Shane's Toyota tune. That's
that's the Shane
from the Frog Plat. Oh man, we had a
real a funny frog pilot story. Um, so
shout out to the forks. We had some
sunny users come up. We had some frog
pilot users come. Um,
>> we had this one woman come up and she
said, "I got to stop by the common booth
cuz my boyfriend's a big fan."
>> Oh, you just bought your $9.99.
>> Excited for your device.
>> Absolutely.
>> All right, great.
>> This is my third one. So
>> nice.
>> I have a 3X. I got a two and a three and
now I have a Rivian. So you guys better
make it work for the Rivian.
>> All right. Yeah. Oh, I got to hype up
the hackathon.
>> Okay.
>> Yeah. Okay.
>> Make that priority number one for me.
All right, we'll do
>> cuz I got a coma 3x that doesn't work
for my car. So,
>> all right. They want a headless device.
How do you feel about headless device?
>> Headless? Yeah. I mean, you don't
necessarily need the camera, you know,
the screen on it.
>> So, you don't think screen is necessary?
>> Interesting.
>> Um, I don't really look at the screen
when they use it. So, I could definitely
see one without a screen. Although, it
does build a little bit of confidence to
have the, you know, to make sure that it
actually sees the lines and sees the
path that it's going to be taking. I
guess maybe a bit of a reassurance, but
>> maybe different price options. saves you
a lot of money to not have a screen. You
can lower the price and
>> have the screen's 40 bucks.
>> Okay. So, um keep the screen then I
would say
>> yeah
reverse engineer Android Auto and then
make it make it appear as a as an
Android device or
>> Yeah. I mean that that gets brought up a
whole lot. It's not really feasible to
do like what do you do? What do you want
to do if you want to plug in your phone?
Right. For example.
>> Oh yeah.
>> There's a whole daisy chain. Yeah. Yeah.
>> Yeah. Exactly. So, you don't sound super
passionate about this the headless, but
what is like the number one thing you
want to see?
>> Say it was a $300 screen and you got it
down, you know, $6.99 with no screen.
That would be a different story. If it's
>> No, screen doesn't contribute much.
>> Not that much of a difference. Then I
would say keep the screen.
>> No.
>> Okay, cool. So, you like screen. What's
the number one thing you want you want
to see in open besides Rivian? Where is
car support kind of the number one thing
for you?
>> Compatibility, you know, cars. I mean, I
I like a lot of cars that aren't
compatible. So, I mean BMWs, Porsches,
Audi's. I know there's different reasons
that those don't work, but you know that
would be great just to have a lot more
broad compatibility with all different
brands. Um to really not even have to
worry about is this car compatible, is
that car compatible?
You know, know that my com is going to
work from one car to the next no matter
what I buy. Um
>> would be nice. So I guess maybe maybe
focus on that front. The device works,
you know, as long as it's compatible
with everything.
>> Cool.
>> All right.
>> Yeah.
>> There's our first 999 customer.
Um
I don't know.
>> So a lot of suggestion. Oh, somebody's
talking about an app. All right. We uh
we had a web engineer start this month.
Um so you'll see some stuff on that. Um
would like better prime features. Yeah.
So the web team is working on that. Hi.
What's up, Trent? Um nice to see you.
What center are the air fresheners? I
think they're ocean. I think they're
ocean.
The air freshers have been a big hit.
Um, the displays have been a big hit.
Um, I think we solved a lot of things
about the messaging. I think people are
getting it more, you know, I think
they're getting it a little bit more
here than last time.
>> Oh. Oh, yeah. The frog pilot story.
Okay.
Um, so this woman came up to the booth
and she uh she says, "You know, I got to
stop by take a picture of the comma
booth. My my boyfriend's a big fan." And
then uh she asks us, "So you guys are
the the ones who make the device that
makes the the frog sounds and the has
the frog pictures.
That's not quite us. We have to explain
the uh the uh
the uh you know the the nuance of the
forks and stuff.
>> Will you pay fee from N or Sunny? I
don't know what that means. Uh Chen, you
want to show off the uh the merch? Our
new merch? You want to model the new
jacket?
our CES jackets. So, calm on the back,
>> calm on the front, make driving chill.
Make driving chill.
>> They look great.
>> Yeah. I don't know. Does it play sounds
or maybe she was just talking about
pictures? I'm not sure. Never driven
frog pilot. I have driven with Sunny
Pilot. Um, got to try Frog Pilot.
>> Will the comm air freshers be available
at the comma store? They should. Yeah,
maybe we can. Yeah, it'd be kind of cool
to put them in the box, too.
>> Um,
>> that's why I think
>> ordered in December. If your device
hasn't shipped, um,
>> yeah, it should have shipped about the
upcoming hackathon. Yeah, so we got a
car hacking hackathon next month,
February 21st. Um, it's our first car
hacking hackathon. We rented out a bunch
of big parking lots by the office. Um,
and if you know, car hacking is a broad
term. Um, we'll have comm bodies there
like last time. Um the hope is we'll
we'll get like Rivian, we'll get F-150,
Maky, uh and we'll get to push a whole
bunch of cars through to upstream. Um
and kind of accelerate that process for
a whole bunch. Um and then maybe
there'll be some people working on some
cool stuff like maybe an Audi, maybe a
Cyber Truck. Um
>> if you're interested in the hackathon,
um best way to get a job, best way to
get an internship or if you just want to
have a good time, work on car porting.
If you have good programming skills, um
it's super easy to pick up. Car hacking
isn't like some like nebulous skill. We
have really great tools for it. Um can
team up with people. You'll get to work
alongside the comment team. Should be a
lot of fun. So if you want more info
about the hackathon, go to blog.com.ai.
Um it's our latest blog post. Um you'll
find all the details there.
>> Um we love students. We love, you know,
anybody who wants to come and have a
good time in the hackathon. The bar is
very high though, so thank you for
coming by.
>> No apply. And uh
>> we will we're fairly selective on the
hackathon.
>> Yo,
>> we are super excited about the car
hacking hackathon. Do you talk about
Rivian?
>> Yeah, I told him about Rivian.
>> Great.
>> Yeah.
>> F150 Rivian. Any other cars?
>> Someone asked for the Cyber Truck.
>> Yeah, I told him about Cyber Truck.
>> Yeah, maybe Robin might do that.
>> Did Chenny do any of the work on the
port of the Qualcomm? I mean, I think
the cool thing about Tiny Grad is all
the things everybody does with Tiny Grad
largely affect the speed
>> similar to autom 010. Uh, we can talk
about that.
>> Rubian desperately needs it. I know it's
it's kind of embarrassing that they're
shipping a $100,000 car in the current
year that doesn't have
>> a lot of people come by.
>> You know,
>> a lot of people have come by the
Caribbean,
>> but you know, you can't sell to your
customers at that price point and that
type not offer
>> lucid. Um,
>> all right. We have nobody from the
autonomy team here, but I'll give a
quick email. Sim chat hiring.
>> Yeah, I will.
>> Customer service.
>> Customer service. We want to automate
that. If you want to, if you're a
software engineer who wants to come
automate customer service
>> still requires some amount of human
intervention.
>> It's like level two. Our customer
service is level two.
>> Still have to pay attention to all. If
you're a software engineer who's excited
about working on the shop, about like
working in the factory. Um, you know, a
really good software engineer can come
and like run the comma factory. Um,
there's all sorts of cool stuff you can
build. [clears throat]
Um, software engineer with like some
hardware knowledge or a hardware
engineer with some software knowledge.
Um, or be good at both. Um,
>> excited to be at the Comack. Oh, that's
Sunny. Yeah, we're excited to have you.
>> Did you tell them that's a band for
dinner?
>> We don't talk about the
>> No, it's not a band. We love the forks.
Another joke.
>> I made a joke about it and then somebody
was like, "Why do you hate the forks?"
And I love the forks. We love our
community.
>> We love the forks. Um
>> Rivian does have ADS. They do. All these
cars we support.
>> No, no, we're not saying
embarrassing.
>> It's not as good as open pilot. You
should use open pilot.
>> Um Rivian does have adas very limited.
Yeah.
>> Sad.
>> Any updates on new OP driving modes? All
right. So the update is um things have
gotten better. So things have gotten
better. They have they will get better.
Um
autonomy team is working super hard to
ship you MLS sim.
>> So they were here every day over the
holidays.
>> Yes, they were here every day over the
holidays. Um
I drove to SF from San Diego before
Thanksgiving. Um and you know
>> lane changes would fail all the time. It
would cut turns. Sometimes it would even
change lanes uncommanded. Um, and then I
drove right before Christmas and it was
night and day difference. Um, you can
really feel the progress. Um, so we're
just going to keep improving it,
improving it. Um, we thought we'd have
shipped it by now. It would be really
cool to launch it with the price drop,
but uh, didn't happen.
>> It's kind of an open resource problem,
right? It's hard to predict. Um,
>> yeah, we're going to keep chucking away
at it until it's ready to ship.
>> It's kind of the name of the game.
>> Thanks for tuning in, guys.
>> Are you heading out?
>> Yeah, I'm getting food.
>> Oh, okay. Cool. All
right.
>> Uh,
um, Shane's still here.
>> What else? We got to talk about hiring a
little bit, but any other So 010. Um,
we're thinking about shipping a release.
Would you guys want to see like a 098?
Um, with the stuff we have, we've got
Toyota long um with massive improvements
there. We have the Tiny Grad Runner. Um,
we have ISPD bear. Um, we have somewhat
improved DM model. Um just much fewer
false positives. We have gas skating for
you. Um so we have good amount of stuff
for release but it's not a must yet test
going to be upstream next month. Yeah.
So the goal at the hackathon is to push
through a whole bunch of car ports um
that are kind of like in a decent state
and then we'll finish them up and do the
validation. So we want to get Tesla in,
we want to do um Rivian and we want to
do Ford. Those are the three big ones
and then maybe like if somebody wants to
bring a Subaru Pre Global, we can get
that in. Um, does the system work in
Europe? So, there's no geoence. It'll
work anywhere. Uh, we train on data from
all over the world. Um, you can look up
these beautiful maps we posted on on
Twitter of where our data comes from.
Um, so you can engage. It works
anywhere.
Phil Shane, you did an amazing job with
two attitude. Yeah, you did. Um, we were
driving around the Vegas streets with
it. Um,
it's good.
>> Uh, is each model separate from prior?
Let me make some different model of
what? Oh, the the driving models. Um,
yeah. Yeah, they're different. Why isn't
it such that he's better than the last
with respect to long lap? Um, so
longitudinal is
and we aren't really working on that
right now.
>> So, that's why you see that's quite
different. Um the lateral is very
different because we essentially we
rewrote the entire training um from
scratch and uh you're just seeing us
like kind of get it up the new stack up
to the the quality of the old one. Um
and that just takes a long time for
refactors. Um even regardless of open
resource problems and this is an open
resource problem um nobody has anything
like this. Um you know obviously there
there's a system that's far more capable
than open pilot but it isn't trained in
this way. Um
so It is an open resource problem. Hard
to give timelines. We're really pushing
to uh to get it out as soon as possible,
though. Um we just set up a whole bunch
of Tiny Box Pros. Um tons of new
compute.
Where is Torque Boy? Uh Torque Boy is
still in San Diego. Um he had a
he's working on another kind of neural
network. Um he'll be out for a little
bit, but uh you'll see him soon.
So the cluster was not greatly affected
after moving to tiny. No, we did get a
lot more compute. Um you just ported the
driving models. So we ported the runtime
to tiny grab on the device which was a
big help. We had S&P um which had a
whole bunch of issues. Uses a bunch of
CPU. It's very clunky to work with. Um
you know not super efficient. You can't
it's hard to export models. Um
Torquo is Herald. Yes, Herald. Our CTO
runs the autonomy. Um, what about my boy
Billy? We didn't bring Billy. Um, wants
to focus on the driving on tiny boxes.
Um, maybe next CES it'll be time for
Billy to shine. And Eene uh got sick.
Uh, so he is not going to be here
unfortunately. Um, but I can almost
guarantee he's at the office training
new models for you guys. Um,
>> yeah.
>> And show with DM. Uh yeah, we're working
on temporal DM and to NDM. Um
some of this stuff should ship pretty
soon. Um you should feel a DM policy is
just a lot smarter. Um
hey, I save money by waiting a week to
buy. Yeah. Yeah, there you go. Let's
have Shane check on sales, but he's not
talking to somebody. Um curious how many
we sold so far.
>> Yeah, we're really pushing on the less
is more theme for the year. um
>> because we finally got down to this 999
price point. Um and then next up is MLM.
>> We want to ship that ASAP. Um less lines
of code, less NPC. Warner.
>> No, I'm serious. I looked up.
>> Once we ship MLS, things will really
take off. Um and then it's the march to
open pilot 1.0.
>> Bring old model back. So old model is
back on master. Um, master should now be
largely just somewhat better than
release if you have a Toyota or
analogous to release.
>> Google search.
>> Any interesting questions you got from
people at CES? You say people are
finally getting
the thing.
>> Yeah, we've got some interesting
questions like you kind of refine the
pitch of like what the product is. Um,
you know, we're thinking of changing
this to just say like it drives your
car. No, really, it does. 9.99 buy now.
>> Um, you know, our hall is a lot of like
concepts. We're in West Hall. Um, we're
thinking of moving to another hall next
time. Maybe something with more consumer
electronics stuff you can buy. Um,
different vibe. Oh, you see in the
comments? Yep. You see, training new
models. Told you. Yep. Um,
any potential pricing issues with
tariffs? It's always a possibility it'll
pop up. Um, but this is something we've
gotten better at tracking like which
parts we have to pay tariffs on, like
just optimizing like when things get
shipped, all this kind of stuff. Buying
quantity. Um, this is how we got down to
this $9.99 price point. It's one of the
ways.
>> Yes.
>> So, what does it as far as
>> I am not married? No. Um,
>> I got no tech support is uh make driving
chills best motto. Yeah.
>> How does it wash my face?
>> Do you not get to pick where the booth
is? Um, I'm not quite sure how that
works actually. I I'm sure we get some
choice.
>> Uh,
what else? Calm. Take a breath. Let it
do the driving.
>> Yeah. Yeah.
>> Yeah. Um
>> it drives your car. No, really. Yeah. I
think that's what Shane set the banner
to on the website.
>> All right, cool.
>> Um that's kind of it. Um we're hiring um
we're hiring software engineers,
hardware engineers, um operations
people. Um you know, we run a factory.
Um you know, we're shipping the world's
best ads and solving self-d cars. Um,
>> tons of stuff to do. Um, hardware
engineers, software engineers,
operations. Um, that's really what we're
hiring for. Um, we have some roles on
the website, but, you know, the roles
are just, you know, to give you an idea
of what the jobs are like. Um, if you're
a good software engineer and you're
interested in the problems, um, and you
think is cool, sounds like like it looks
like a place you want to work, um,
you'll probably be a good fit here. Just
go to commai/job.
Um, we got challenges, we got bounties,
a lot of ways to get in, um, that are
super straightforward. Um,
yeah, it's going to be a great year.
Cloud 1.0. Less is more.
In your opinion, what's the best car so
far? Uh, so Lexus ES is our demo car.
>> The 99 is just Nope. Nope. That is the
price. $9.99 is the price now. That is
the price for a comic 3X. Uh, we make
money selling it for $9.99. uh like
we're maintaining a profitable business
um and we'll be able to keep shipping
you guys open pilot updates with $9.99.
Um it should be like a nice optimal
price point um for the product.
>> Yeah. Wish you growth for 2025. We had
tons of user growth last year. Um we had
some revenue growth. Um but you know a
lot of what we were doing last year is
really validated um the things that
we're going to ship this year like
harness v3 these directions like
simplifying the install. Um, you guys
see like the new setup video. Um, it's
like a minute. It looks super easy. You
can see in the comments. Um, people like
kind of see they see the stuff we're
doing. Um, now the goal is to get that
video to look just as easy but
completely uncut. So that means like
removing the 48 uh 48 hour cure time for
the mounts, making the mount super easy
to position, all that kind of stuff. Um,
>> yeah. What's the greatest thing you're
expecting to ship by end of this year?
Ant long if we can ant long shoot in
chill mode that you know that's going to
change.
>> Well hope you guys can do ES you can
hack TSS3 we have the latest ES um
doesn't have security
>> magnetic mounts. Uh I think Shane bought
it on the test um last week.
Um
>> cool. Any final questions? $9.99 less is
more theme for the year. Um, we're set
up for incredible growth um, for the
year. Really fun time to join. Um, you
know,
>> you look at some articles, Tech Crunch
from like 2016. Um, $9.99, $24 a month.
Um, you know, learning a driving
simulator. All those things are 999
happened. $24 a month happened. Um,
well, you know, $9.99 plus harness. So,
we're not quite there yet. We're not
quite there yet. Um, you know, it's
going to take a lot more work to get
there. Um, you know, you see the price
cuts have gotten smaller over time. Um,
it's harder and harder to squeeze out
these gains, but uh, we'll get there.
We'll get there. Um, if you want to help
us get there, it's a great time to join.
Um, you know,
Common 3X was designed by, you know, two
hardware engineers. Um,
>> software team, um, on product side is a
couple people. Um, factories downstairs.
It's, you know, you're going to come
here. Um there's not a whole lot of
places you can come and build the
future. Um you know, you get to come and
you get to sit in the CES booth. And
when people come by the booth, they're
like, "Yeah, so it like watches the road
and then like it looks like I'm paying
attention and it has like a GPS. It's a
dash cam." They're like, "No, no, it it
drives your car. It, you know, drives
half of your miles." Um
so I don't know. I don't know how many
places you can you can work um that you
can say that at. It's a lot of fun. It's
a lot of fun. talk to users to show
people the product. Um,
you tell guys what car you are driving.
Um, so we all drive, we have like one of
each brand of car in the office and we
all like rotate between them.
Um, let's say do you sell most units in
California? Maybe we could change that
this year. Maybe we can uh I think more
than half of all devices go to
California, including the whole world.
Um, you know, it's kind of reaching a
more mass market audience now. Um, maybe
you should offer demo rides. Um, we do,
you know, buy it on the website, return
it if you don't like it. That's the best
demo ride. Um, that's be better than any
ride, like a 15-minute ride that we can
show you. Um, you know, this thing isn't
a demo. It's a thing that you live with
every day and that changes the way you
drive. Um,
C 3X is more heat resistance. Yeah.
Yeah. 3X. Um, we haven't really seen any
heat complaints with the 3X. Um, we
improved a lot of the software on that,
um, a couple summers ago. Um, it's
really designed at the hardware level to
live on your windshield through any
weather. Um, so no concerns there.
>> Oh, I mean for CES specifically.
>> Yeah, you know,
>> external, you don't want an external
display. I I don't think you want this.
Uh, you know, anything that was external
that isn't just like the main thing
stuck to your windshield. um you know
doesn't have nobody really takes you up
on that. Uh common pedal didn't have
that many users. Um you know we used to
have the gray panel that you have to
stick on the windshield somewhere else.
Not super great. It's all in the device
now.
>> Worth upgrading 3 to 3x. Um no if you're
3 is working fine. Um it's the same
thing.
It's refactor.
Uh cool.
All right, guys. Thanks for tuning in.
If you're at CS, stop by the booth.
$9.99. Um, try it out. 30-day return
policy. Um, no questions asked.
Thanks for joining us,
all right guys we're doing it we have no
one maybe I didn't click the Twitter
button you didn't click the Twitter
button hello did you click the Twitter
button or no I mean I think it's clicked
by default
I don't know broken why is this printing
up shit about if you didn't follow is
this on Twitter Bros oh yeah we've 38
just turn it on it takes a little bit of
time no notification spot okay okay okay
so maybe we're good notifications it's
good they just saw just said
notification squad notification squad
yeah you hit that subscribe button to
get access and notice gang is this on
Twitter you guys see five it must be a
lot of people have signed up all right
guys it's terrible you getting that for
yo did you talk to these people don't
sleep whoa yeah I don't sleep your heart
do his work work work no matter what I
got on Twitter cool it's on Twitter
that's something right cool
oh yeah so guys we are going to buy a
car
who knows what we're buying people know
I know yeah didn't know what those are
mounts for Dooley on technology that's
right we can't even go to quality on
Tripoli on technology go crazy yeah I'm
taking lemon lime Gatorade this scope is
brought to you by lemon I'm Gatorade
okay if you want to sponsor me we don't
have to do hashtag ad if we should show
four things because we like them it's
not a hashtag had no but we should look
okay but once Gatorade pays us we're
gonna let you know I will sorry Gatorade
night George ate the perfect amount from
Panda Express sponsorship that'd be fine
yo I actually got contacted by a guy who
knows an executive at Panda Express
really yeah oh I knew this Panda well
yes we have a big guy we were big
announcement coming about panda pretty
soon you know we're moving into new
methods of online distribution you guys
can probably guess but we are looking
for an exclusive IRL distributor of the
common type an and we think that Panda
Express would be perfect
yeah so if we could like get it in like
to Panda Express stores you know maybe
like we'll give them each free ten
pandas
alright I'm making like so much a
restaurant Panda Express of course
okay that's why it's funny oh that's why
cuz like partnerships are dumb as fuck
but like that's humorous right scheme
and we can put out like an official
press release about how come AI is
partnering with Panda exactly would you
like an e on with your meal they got it
yeah right it's a happy meal exactly
it's like Pizza Hut and it's like
dominoes and for teaming up on
self-driving yeah that's the thing is
people take that seriously right like
hopefully that'll trigger something in a
few people's minds yeah I see expresses
you mean the like the shooter chicken
place yeah sugar chicken place why you
don't think oh yeah I just got mine
there yeah we have a lot of snow peas we
have a hundred scope we loaded scope
these guys we're going to buy a car big
we're going to the Ford dealership Bros
that's what we should do market research
for we should hire someone for that by
the way this is one HDR and it's banner
I fixed a bug in HDR last night too I
found like one last little bug and it
makes just the quality like little salty
how nice is that long
you guys all the pasta I'm getting
really good we're gone for us whoo that
was definitely illegal right like that's
the thing like I was judging that like a
very normal speed puff puff don't slow
yet hi so we're going to car dealership
now we got a cutout up here
this is a it's a diffusion problem it's
never been an issue before no that's
always an issue when you're coming up on
a stopped car it fuses but it fuses late
it's uncomfortable breaker yeah but it
will fuse like it'll give you time and
if you but yes stop cars are I mean
there's you know autopilot is the same
problem there's a few word to infuse
does this like footage on your grandma's
cars nice no really I love the red core
here we have the rav4 is my favorite car
but we were about to go buy a Ford
Fusion we'll go on a Ford dealership do
you know what exit we get off to the
Ford dealership yep I should know
dealerships all the time there's ones
closer than this one's close to the
melody of Ricardo when I went there okay
so you guys know that uh
I don't really like Ford so uh yeah well
exactly like what if someone's in the
dealership watching we're kind of like
infiltrating Ford well okay so we showed
up to this dealership once and we asked
if we could plug in a panda just sniff
the canvas on the car and the guy like
like looked at us and they're like we
hate you I'm about like Big Dave like
really hated us like I'm not even
exaggerating Ford
Dana speak it uses
so that's what I'm saying like wherever
the Honda one is is the same place
return car put in the more acceleration
of accelerate except they're often the
acceleration on all the cars the the
exodus can't like them you can tell them
47 that if any scope is want to come I
know she ate hard yeah why by Ford if
people already working on for people
already working on the pork uh because
the data speak in a lot of the other
self-driving car companies are using
this as a base platform and we want to
make sure that we are at least a
superset of them right all right Sara
Monte right we want to make sure that
we're a superset of the other self every
car companies he really tries better
with HDR I haven't like yeah it feels
really good it feels good
here's like yeah you don't even like
think about on file anymore because okay
so we have you know big things coming
this year it's getting so easy for us to
park cars yeah
I'm wait
is there going to be official port for
form tasks what he presently doing
I think there will be I think we're
actually gonna remove the bounty and
to improve current lighters
why aren't I have a long Skokie last
night where we talk about line I rap for
the scope is tough
what yeah shit shit we're down
you got his cookies
yeah people are really excited to
present like shown in the wheel totally
showing off all the pilots are we Brian
are we buying a hybrid plasm we are
buying the nicest watch already got I
don't know I don't know Eddie got a
Volvo and you never showed me his car
yeah it's an old Volvo it's really
pretty but it's it's old salt
it's dangerous bro it's super dangerous
for trees and safe they better be Connie
produced um whoa yo I would settle for
like like hot sugar the guy you used to
produce for kitty pryde to produce a Tom
Cruise nevermind Kanye you got to start
small man not sugar if you're out of
tannin kutsher's Kenny price producer
and then she ended up dating him really
true story okay project Oh Paul Paul
those are awesome love it you should
talk to many about that he doesn't oh
yeah he's stoked on it
when they can see the wheel look at this
it looks right on this screen but it's
actually very nice no I think that's uh
yeah of course
alright welcome to sur Oh Monty for yes
Monty Ford where the Sun never shines
but the people always smile do they
smile cerimon before yeah going down
here prepare Oh what is this oh this is
the tiny parking lot at Sarah Monty Ford
where you can never fall there's no
parking I'm not breaking the rules
already no no it said no part but I
think it's a no remember that's how I
got banned from Tesla well the time
we've bought a Tesla and then we got a
call the next day and they're like you
don't get a Tesla we put the incorrect
type you really should have bet on the
Model X too expensive we didn't have
that much money back then but now Oh
Eddie we're not to see your car no all
right we're gonna bring moving this
gobies to the door no fees we're gonna
bring you in on that on the DL okay sure
they were shootin
watch the truck and I will bring him to
the door we will respect the guys
because look have a look at me with a
head look guys it's all about some
respect
just saying I respect you I respect
[Laughter]
arting overlap yeah does it no look at
that my gaiter is gonna be warm we go
back to the car yeah bring it in it like
shows a sense of like authority that
you're walking in with you know the
Gatorade yeah where did I walk into with
stuff go you just walk at Nobu with no
shoes this is intense
does that even know
please keep stoking it's gonna be
low-key nice you really need one of
those things that you hold and it like
stabilizes your phone I don't know
what's asking service in parts do I need
them I didn't really do Scorpius it was
nice next time you see me I'm gonna wait
you left already
no we're still there you know yep yeah
oh yeah
next time you see me would be the pad
owning uh-huh a fusion hybrid and I'm
guys make sure to hit that like and
subscribe button you know make sure come
in and check out that comment that AI
slash shop go go buy things ships today
if you buy visible fulfill it
oh whoa that's not a stereotype to
kansas people
are we live
all right uh we're live um we're gonna
have this truck so we're just gonna go
around this trunk
but yeah we've been driving all morning
to sit out real early out of denver yeah
yeah we've been driving all morning
we're off to our second meet up let's
meet up in uh kansas city missouri
okay city of missouri we're in kansas
right now
right now what brought you by
get there don't
course of course of course
this this this leg of the trip is being
sponsored yeah
once you know them yeah we'll let you
know
yeah we gotta text our friends
that's right text our
friends oh that we're about to do the
shout out mr smith yeah and text him
i don't think he's up yet
we're an hour ahead now right now it's 9
41. i woke up so early we woke up so
early y'all
so early so far away
yeah it's been driving well here yeah
that's been driving well you're doing a
lot of the driving
yeah where are we going in kansas city
another
maker space
[Music]
[Music]
german yeah last name
it's movies
there's kobe's yeah yeah we have 59. wow
they get awesome
right now
let's see if it's gonna go for this like
yes we should have uh sculpey's come to
our 11 a.m meeting
yeah
everybody at 11 a.m tv
so many hours
has one meeting a week
um it's on mondays at 11 a.m and
everyone has to be there
and people are still late people are
still late it's time for unbelievable
truth it's really cool you get fined you
do get fined one dollar per minute
yeah
and with that money we buy boba
yeah they
yeah so this is
guys the prayer is really pouring oh yo
you know what it is i think on this trip
but i did this last time we can see the
world's largest prairie dog
really you go to the yeah there's a big
big it's it's paper mache it's like a
big stuffed prairie like you had a dog
you're a real fairy dog but that's so
good no but they have real prairie dogs
too
oh i love prairies
they're the ones that like stand up
yeah yeah yeah this is what they have in
kansas we can't auto change lanes
why do we need to who's asking who's
asking
you know you know the banned question
right yeah
yeah the bad question is don't ask us
what car this works on well don't ask
yet if you want to know what car works
for that's fine that's on the github but
don't ask when will it work on my ford
mustang gt 2004
i don't know bro whenever you make it
work on it
check out github
some people this is a legitimate
question does open pilot void your
factory warranty no probably not
um so
the way warranties work so there's a
long history of modifying automotive
outside of the dealership right
in order for them to void your warranty
they have to show that the component
that they would be replacing under your
warranty was actually broken by the
aftermarket mod you installed
so for example if your you know head
gasket closed
and you installed open pilot i mean open
pilot has nothing to do with that so you
have to replace it now if you you know
change the boost pressure on your engine
your head gasket blows they're going to
look at you and be like well that was
done yeah but i mean most mods are like
engine mods most mods are like edgy
lights yeah yeah so if you do like an
engine mod and like you know your air
conditioning brakes yeah they got to fix
your air conditioning right yeah but you
probably want to turn off your mod
but yeah i mean you know it's just it's
just like jail breaking your phone just
jailbreaking your iphone voyager
warranty no just restore it yeah
we're driving a rav4
there's actually even way more consumer
protection laws on on automotive than uh
yeah like phones
we have 75 scopies that's way more than
what we do is that like 3pm how fast
we're going
75. yeah it'd be nice if like i could
just say like yo car go around the truck
yeah okay eon plot a course around that
truck
and it'll be like is it clear on the
left yes this is an aftermarket kit
so we don't sell any self-driving kits
um we sell we sell hardware and we give
away software
yeah so this is a dashcam developer
oh yeah yeah yeah um so we have we have
waze up here
uh we got we got
and 6.57 minutes to uh
kansas uh city doesn't have reception
right now you can play with t-mobile for
that
spotify over here
that little people's astounded album
just in case we
less than six hours someone's asking
where we'll be in pittsburgh we'd be
doing any style wow oh that's yeah
that's something yeah
yeah how much is the hardware for the
rav4 so this dash cam development kit
the eon which is for sale for 6.99 6.99
y'all at uh shop.com
and um
let's go around let's go around the
walmart we're going around walmart
what else we have a panda in this car to
interface with the car that's ninety
nine dollars we can show them control
just pass these trucks passing tricks
and trucks
we gotta make our cover look fancy like
everyone else ah we're lazy
i like water
even though ricardo hates this power
wire got rid of the power wire power
wire
yeah so you just need
your panda to interface
um with the radar in the car you need a
giraffe carrier board for your panda so
this car has tssp it means it has
adaptive cruise control and uh lane keep
assist system
so using those things
you can actually control the car just
via software
it's frodo strapped to a child seat
who's froze that's me yeah wait we got
frodo now yeah
i don't
that these know are really comfy in the
front fifth seat kind of sucks yeah
i've been switching i haven't been in
the bathroom i don't know it seems like
two years ago they're not as nice as
dude last night
um our friend rented a audi a4 from
silver car oh yeah and that might be the
flagship next year because that car is
not nicer than the tesla oh my gosh i
think it is i think
i i don't think the model s is like a
luxury car i think it's nice about a
tesla i don't see it
the speakers are better than the shitty
other speakers are better than that
absolutely
yeah driving well oh yeah there's like
nothing to do for like just like look
around yeah like we're cutting right
through kansas straight through take a
look guys this is pretty boring the
metropolis this is harry on the left
prairie on the right
i hope you like prairie because it's all
day and night
people look like missouri stole kansas
city from kansas like isn't that a big
deal
they only stole half of it they actually
did only yeah no did you hear about the
great the great missouri kansas war of
1842 and stole half the city yeah
no missouri missouri missouri one hands
down man
and then uh
missouri's like but we're nice i mean it
is called kansas city so we'll you keep
the shitty half
no we're really the missouri citizen i
say
wait i don't know if there actually was
a great missouri war i don't actually
know how it happened but the missouri
side
i thought kansas city in kansas was like
way further away
this is real shit i'm not even i'm not
even lying about this you go to hungary
you go to budapest there's literally
buddha and pests yeah and there's an
opposite side of a river yeah really i
didn't know that that's just better
the more you know
buddha and past
you've been the hungry
do you miss coding while driving
we can't code while driving yet uh yeah
no that was fun
at the racetrack on close courses you
can code while you're driving yeah it's
still scary though you can't do that on
open road
um yeah i like coding and driving we're
just listening to physics lectures y'all
yeah black holes black holes and shit
how do they work yeah why can't we see
them that's right because we need
earth-sized telescopes
that's right
we just built a lot of tiny parts and
send them around to space and assemble
them
yeah where's our dyson sphere man it's
working
how many scopes
64. are they asking any good questions
babe you got to read the questions
there's really no there hasn't i mean
you gotta you gotta read the comments
this is what we talked about yesterday
right yeah they're both g-y oh they're
both gi's g-wise honda clarity i want
this
wait is that somebody asking about this
i'm reading out every single question
but here's the thing guys we're not
answering questions about supported cars
just because you can find that on the
github and otherwise that's right
you want to know when your car is going
to be supported you guys are like the
jailbreak people who would always ask
when is it going to work on my iphone 3g
ask bro
don't be sorry it's totally fine
the truth is the reason it's not a good
question is like i don't know man why am
i gonna make it work on your car why
don't you do that shit it's open source
oh oh man cross a little bit a little
bit over to the left there yeah it's
coming back what's speed we're going 81
75 should probably go slower
how will open pilot deal with low torque
in the flight they're going to pull me
over we're going six miles over the
limit and this is recorded forever
i'm going six miles over this video see
this is what happens
we'll
um what do you mean do you want to do
more to work well eventually eventually
we'll
or their iphone they want to run open
pilot on their iphone oh i'm distracted
distracted that's kind of go away right
away when i touch it
andrew if you're watching this that's
not andrew that's it that's ricardo
that's regarding yeah
he implements it it's it's controls yeah
while driving
no i don't know
we live in a better place if everyone
read atlas shrugged and one of the kids
who didn't grew up out of drugs the
world needs a solution a lot of doubt
it's hugs and peace and stuff that you
thought of mollied up with 25 of your
parties still a flip cup and beer pong
and your resume your skills deluge
clearing the weed bar or hitting the
nightlife out toying with girls while
gawker and facebook are destroying the
world
hey folks friends don't let friends use
facebook friends only friends use
facebook yeah wouldn't let your friend
smoke crack in the backseat that's right
that's right if you wouldn't let your
friend smoke crack don't let your friend
use facebook yeah yeah
it does eat your brain a little bit
that's advice
i was talking to my friend i was going
to visit chicago he used to do the
social media shit he's like yeah man i
see that you're into it yeah i agree
that wasn't a freestyle that was totally
totally yeah how do you define freestyle
i obviously wrote that before but he
said
freestyle is like right now you just
gotta go oh come on when do people go on
sway in the morning and they freestyle
they totally wrote that shit except for
a riff raff he actually just made his
shit up but they didn't but
think it's a little delayed because no
one's throwing out words oh man
i was lagging
tell him it was shit okay it was shit
they didn't like my freestyle scoopies
let's go come on george what you got
scope
see me walk around as droopy kind of
mopey i'm gonna perk up with the sight
of all my scopes
that's you guys
eon
driving toward dark town all of the
signs neon but none of them as bright as
my shiny new comma eel
that was good that was good
tonight stop that coming down ai let's
say this is carl's truck
truck pass
shittier
coffee got him feeling himself coffee
got me feeling myself
see these are the comments i don't read
out but now i'm reading them out because
you guys asked them out i mean they're
pretty weird maybe because this is
possibly weird
never stop saying weird shit uh no it's
actually a fun game you go you're
searching like random word generator you
just try to make up freestyles and use
all the random words
uh i don't know man freestyling in front
of people is hard it's hard it's hard to
do this i do this i do this and yeah i
do this in my room and i'm like
you guys smoke some wheat and then you
just can come up with free styles but
like you know like one and three is like
damn that's fire and then like the other
ones are like
yeah that didn't make sense yeah it
didn't make sense say some gibberish
shit yeah right
yo but sharon does this shiron does this
on youtube now
by the way the same
i'm not i'm just going to say i'm not
even going to say his name right now but
i'm about to be
we got the sun right look it's picking
up that lane there
i'm about to feature on some big name
rapper shit yeah yeah this january we're
shooting a video he's only messing
that's cool we get it
big name big name shit man thanks casey
yeah
yeah you're not
not gonna type too yet no i'm not gonna
dive too in case it doesn't happen
right no no seriously my rap career 2018
that's going to be the year
2018.
this is george's dream by the way are
you going to spend under tom cruise you
make it big i think so yeah tom cruise
with two zeros man yeah it's like james
dean with two e's
yeah right two threes guys
i'm like yeah yeah i was originally
gonna be tom cruise with two hours but
my buddy his name is goose and he's like
nah i'm goose with two zeros
someone
little people yeah yeah they might be on
the lills you know yeah yeah yeah
there's a lot of those there's a lot of
wolves my lows are in these days yeah
babies out a little bit
biggie's out walls in right big pun gone
any other big
open pilot errors on rav4 hybrid
does it you gotta fix it bros
fix it send pull request instead of pull
requests yep
yeah big crit big crisp pretty good
this big this is still relevant
yeah he's big he's big that's from like
he's from mississippi
man that's not
missouri yeah what else happens in
missouri
it's the only place i've ever really
been in missouri is kansas city because
you want to know kansas highlights we're
still on campus we are telling you i'm
telling you the only thing in kansas is
the world's largest prairie dog it's
about halfway to kansas city and stop
there at like
five six pm last time right as the sun
was going down we rolled into kansas
city around ten
went to the apple store the next morning
tax-free oh we gotta stop at the apple
store tax-free in kansas no it was like
a special holiday
we're currently in kansas for the person
who has been we need to we need to get
you some airplanes
man where's dorothy's house can we go
for this that's what i'm trying to find
that's right yeah we gotta get we gotta
give you some airpods yeah yeah we gotta
get me something that was one of his
holiday bonuses coming out
there's no place like kansas
there's no place is that their slogan
yes
live free or die there's no place like
that do a radio show in omaha tomorrow
morning hell yeah the thing is we're
waiting to hear back from a kansas tv
station
so if we do that we can make it good
morning folks if we do that um if we
don't do that we'd love to do a radio
show in the morning in omaha absolutely
can we call in because we have our
meetup at 2pm but we're gonna our
meetup's at 2pm we're going to leave
tomorrow morning
and then our next meetup at sioux falls
at 10 a.m the next day so and that's
three hours too so we can do our thing
why don't we make it so early because we
have to go to the school oh we're going
to go to school going to the toyota
dealership and then the school but
toyota dealership can only do 10.
oh yeah guys we're going to toyota
dealership at 10am
yeah and they're like contacting media
for us so shout out to billionado toyota
you know
toyota that's right
yeah yeah yeah it's a baller dealership
i'll totally let you know let me let me
see if i have service to check my email
with this
woman right now
uh wait when are we going to a school
we're going to school are we going to
let the press drive
i think it depends like this it could be
fun
all right that works pretty well that's
a whole lot better than the stock toyota
just don't don't expect a self-driving
car you can sleep in you know yeah
absolutely so far on the periscope we've
had two disengagements oh one and a half
yeah
not bad it's not bad it should be better
now
are we gonna let
the fourth grader go
we're gonna let a fourth grader drive no
that's illegal even in south dakota
a channel now what is
the driving agency
there's probably no limit
oh no like alaska it's like 12 or
something
you know
well you need one man
what are you doing in alaska right
you get paid to live in alaska you do
of course
you get paid to live in uh saudi arabia
yeah there's so few people there man
so they can afford to pay them all yeah
ah nice job not going for the exit
yeah
good job
any questions
none just i i know i work on their
airplane
and what is your favorite car who's the
airplane i don't know we like what is
your favorite car maybe you got to read
these questions i just got that one we
talked about that yesterday i really
wonder if that's the box from yesterday
just copying it that doesn't make any
sense but um yeah no we don't meet with
legislators we don't meet with
politicians no we don't we don't we
don't we are we are we are friends with
politicians but the kind of friends you
keep at arm's length yeah
we you can buy our product from russia
we we can ship it to you
we ship russia we've gotten some money
we ship anywhere
except maybe india no i'm calling out
bots at atletico three
bot go away
viv the bots can't hear you
if people know that the bots are there
then maybe they'll you know
they'll well they'll what they'll get
ashamed
but they're gonna teach bots how to get
achieved spots how to feel ashamed 41
action news morning show all four i walk
i love morning news shows
honest alyssa hasn't responded so i'm
going to call her call up alyssa
call her text me is that it's that
aggressive to do that after i've texted
it's always better than calling man
you're right you're right
oh come on we're millennials
like i feel it's kind of inappropriate
when people call it as a business for
like a business oh for like anything
right like not like a friend though
what are you calling me for because you
get you get like 100 times the
information okay do you want to like
plants like hey i mean you know hey i'm
up in the city tonight what are you up
to don't call me and say that shit text
me but then like an hour later you're
like what and just responding please not
an hour later i respond quickly on text
how can you contribute to the comment ai
revolution uh go on our github go on our
github man pull requests
are the best form of collaboration yeah
yeah we have bounties out there this is
seriously
i'm not distracted relax you don't relax
so when george takes over the wheel it's
because there's a six minute timer on
the uh
there's this bar on the left yeah
it gets lower and
lower one day we might have to justify
why it was six minutes and it's honestly
just because of the line six minutes
slim shady you're on yeah like that's
really why it's six minutes
as most of your life
yeah i like
yeah i've given up on my dream of taylor
swift but lindsay lohan yeah that's like
an achievement it's an achievable dream
yeah
[Music]
shit um it's on the camera the camera
thing is flipped around so the giraffe
doesn't really like like it plugs in but
it doesn't fit
yeah why is it upside down oh well that
is a deep exercise you should ask that
is an existential question i wonder when
those connectors are going to be back
and forth um
we're lower giraffe can you contribute
to cloud back end or modeling
no so those products aren't open source
these are the parts we keep uh as a
company
um it'd also be hard to sort of like
crowdsource any uh useful stuff for that
we did common coloring for a little bit
we did tell the coloring i mean that's
like yeah the simplest way sort of for
people to contribute to that but we
don't really have that anymore
because we have new stuff that doesn't
require that unsupervised bros
unsupervised segments
so you can't do it on supervised
segments oh how can you report the bots
that's a good question i'm not sure i've
never used periscope from a user
perspective but maybe if you like click
on their profile i don't know what you
can do on periscope but it'd be great if
you could click on the profile and be
like this is a bot
i like to hold the wheel when we're next
to no i didn't i said back what's up fam
to your salutation don't worry i didn't
ignore it
don't ignore this between cars that's
everyone's dream zoom
like to zip between cars that's
dangerous bro yeah don't do that drive
safe
we gotta say if we drive we sit right
here in a very safe following distance
we're staying in the middle of the lane
safe because to be honest this is what
most of driving is and being in traffic
i mean especially in kansas my god is
this place just straight yeah kansas
needs open pilot can you make an adapter
for it
for them to flip the connector either
flip the yeah
uh for just the odyssey another skew
another skew yeah cool he's also
watching roger versus ama oh roger
is doing that jake just told
oh okay so so since there's no traffic
lights we're gonna make bridges yeah so
we're gonna pass under this bridge and
i'm gonna tell you who this bridge is
brought to you by ready wait wait let me
record this for our homie record this
for our homing all right all right guys
up at the bridge all right
this bridge passing under this bridge
safely and smoothly with autopilot has
been brought to you by bitcoin cash
don't get it twisted it's not bitcoin
bitcoin has high transaction fees and uh
you know it's it's it's small the blocks
are small it's too expensive to get in
if you miss the bitcoin bubble you
should get in on bitcoin cash it's the
hipster of bitcoin it's the future of
bitcoin it's the real it's really like
he's watching both at the same time you
gotta you gotta do bitcoin cash i wish
we had a wallet prepared right now we
could have our bitcoin cash uh donation
address yeah set up a bitcoin cash
wallet show the people how easy it is i
think i did bitcoin.com download them
download the app they have a wallet wow
for shit all the time
um we're honestly not being paid by
bitcoin
i just put up my address put up your
address yeah absolutely
we'd like to be paid by bitcoin cash
though so put it in the address we'll
just put it put a show it to the scopies
uh this is this is our bitcoin eddie is
just gonna get this if you want to send
us some guests to everybody if you want
to send us if you're enjoying this uh
but you can't send us bitcoin i'll share
only bitcoin cash that is bch um it's
super easy to get just buy ethereum or
litecoin on coinbase and then send it
over to binance where you can do a
crypto to crypto ah well
one day it'll be easier
bitcoin cash bros
i feel sketchy just throwing my address
up i know it's not sketchy
i don't know there's nothing sketchy
about public keys only private keys oh
shit i think i put up the private job
don't put up the wall you put up the
private key oh they're gonna steal all
your zero dollars wow
stealing my cash you can steal your cash
bro another bridge another bridge
this bridge
has been brought to you by bitcoin cash
bch they have some version of bitcoin
uh don't call it be cash some people are
trying to exchange
some exchanges bcc they say bcc that's
the old way it's bch don't get it
twisted bros
so many trucks so many trucks i think
i've seen a house since we got here no
this is you know a little house on the
prairie that's just fake news it's just
prairies
i am withdrawing from your wallet
yo they jacking your money dude it's all
gone
and it's gone
damn
you guys want to send gas money i
haven't gotten any yet
no no everyone's still trying to buy the
litecoin on coinbase and then sending it
over to finance
don't buy bitcoin
how it says maintenance required
honestly that's just
wait let me see obviously if you have
your private key shot
oh that's fine
yeah yeah you have a little bit more
cash in there wait is that just did that
just get sent in or did you already have
someone i already had it oh you already
have bitcoin cash all right eric says
all right good luck trying to scan that
qr code from the paris community yeah
that's not gonna work all right we'll
read out the address under this next
bridge
is that better you guys should we write
it down on a piece of paper no no let's
read out the address because you know
the bridges you know they're brought to
you by we were originally gonna make no
bitcoin cash out it's so much fun i know
be cash i kind of like it i don't know
why they're not down
all right this bridge is brought to you
by
be cash the address is one l
c 6 6 o r o s
uh h w q n x
e m j j
w
j e
no the capital letters are just a
checksum it doesn't actually and also
george hawks what did you say about
litecoin
like when bros uh i don't have any
litecoin so i shouldn't show for
litecoin just by ethereum bros i have a
lot of ethereums yeah i had more i had
more ethereums but then i deleted some
and that was a great tragedy
yeah oh my gosh jake is finally watching
this by the way i just this is amazing
he's been talking i just read his
username and realizing we've been
chilling hard every bridge there's no
red lights here so bridges brought to
you by bitcoin
why is there a wire by the mirror
this wire so the toyota unfortunately
can't get power
from the uh
the connection from the connector up top
except for when the car is running so we
had to run this wire all the way down to
the obd port
um working on a better solution to get
power from here yeah
and you can you can get while the car is
running this is only for when the car is
stopped
so it will work just out of the box if
you set the switches right on the
giraffe yeah if you flip switch three on
your giraffe that'll tie the ignition
power to your panda power and charge
your eon whenever the car's on
this pro's going kind of slow should we
go around let's breathe let's go around
let's go around this problem but the
bronx is also going i know
yeah it's not like we got too many
choices here yo you guys like this is
really this is the kind of shit that
should be level three
yeah like this totally this is absurd
and i know but seriously for trucks
though just imagine you could just send
your truck go to kansas city yo let's
give a shout out to that man we met who
did 3.8 million miles 48 million
we met a truck driver at our salt lake
city meetup your grandma's car is nice
thank you it was totally a grandma car
all right so i just one night i was 18.
i just got my porsche boxster right
manual stick shift car right i pull up i
pull up at a red light these two girls
in the car next to me
and and i go and i stall and they're
like how are you liking daddy's car
yeah that was that was that was an
experience
it was an embarrassing moment yeah
stalling is such a high pressure moment
it really is then you're stressed about
like putting it out it's just i remember
i rented a motorcycle in the azores and
i stalled the motorcycle and it was just
very stressful to get started does the
draft have to sit at a fixed position
yeah
what do you i guess not it's just the
commission finance is fine okay good to
know finance is fine is that is that
jake saying that yeah but he's
responding to someone who was asking oh
yeah yeah george will you ever work with
elon musk i mean give me a call bro yeah
i mean we're not opposed to it yo elon
right now
just just yeah like like you got my
email send me an email it's chat on
periscope right now let's do it
yeah why not
shoot an email let's do it we know
you're busy mr musk but we're busy yeah
this guy's going a little slow i don't
know six months six miles an hour
we're still going over 70 this is the
future it is what up comma if we go if
we go below 70. we'll go around yeah
this is this is this is the future guys
yeah you are you are you're living in
the future with us right now oh wait is
this this guy dude this guy's getting
dropped
he's slowing down it's gonna take
forever
yeah when zelon gonna drive across the
country yeah elon i'm waiting for you to
do this grudging you promise by the end
of the year what are they going to do is
a busy man he has three companies i know
well no no no no no elon has two
companies now
tesla bots always said boring company oh
the boring company and neurolink and
open ai
man
yeah i want to start all right all right
let's let's let's let him in and see
what the scope is think so you guys know
that there's a communist bakery
in the mission it's called arizona cisco
uh you know workers of the world united
i'm a fan of stuff right um but i want
to open a fascist bagel store
hats is vegas like there's no good place
for bagels in san francisco it's really
not right i think the fascist angle will
bring lots of press
um i think it'll be a super popular spot
to hang out for a good bagel we could
have protesters even they could come in
enjoy our hotz's bagel yeah only butter
though and only like one amount you want
more of them you want like less or more
it's not no no no get out get out it's
like the soup nazi but for babies right
that's kind of really lightly toasted
with butter
no i don't like a toasted you know like
yeah why don't you toast your baby
butter gets all runny this is the best
part of the butter so that's that's
business idea one business idea two is
okay so you guys can go to
privateislandsonline.com you can buy a
private island right the real question
is how do you monetize your private
island and here's my idea
it's called the lost experience
yeah for like ten thousand dollars for
two weeks you're put on the island with
79 other people and you get to
experience lost in the real world right
like we'll set up like mysteries and
shit and it'll be it'll be crazy and you
know things will go down and everything
this is like my transition to actually
building westworld
george someone says hi who says hi
at
p06 ninja one sounds like a bot i don't
know who that is that sounds like a bomb
yeah ours ours goes
uh beijing bitcoins ask how long they go
uh depends how long we feel like talking
to you guys yeah these scopes
i mean what what else are we doing like
yeah we don't have much to do out here
smells like a newer smells like manure
is that us
no it's not us bro it's prairie it's the
prairie lots of prairie i like those
things do they have like motors in each
one of those wheels they drive right
they definitely drive but like no no his
foot is not on anything so you want to
see you want to see my feet yeah
uh this bridge is brought to you by
bitcoin cash yeah everyone go out right
now get some bitcoin cash is the future
of bitcoin they got big blocks
no like the cars the car is driving you
guys yeah
trust me the gas and brake are a lot
easier to do on a road like this than
the steering
mpg is going up
oh our mpgs are up to pretty decent
27.6 we're still in eco mode yeah did i
get any cash sent to us
i don't think so this car is actually
pretty fuel and efficient
we're going to kansas city missouri
we're going to kansas city
it's just really divided down the line
you're sure i can't totally it is it is
nice
yeah he's from the kansas side oh that's
just there like a lot of beef like
between the sides still even after the
war after the war yeah i don't know it's
been it's been a while is there still
beat between the north and the south
and there's like a missouri river that
divides her
oh is that the river that divides yeah
missouri river oh they even named the
river after missouri wow they got a lot
of that war
it's not the kansas river right
that's so screwed i got so screwed i'm
out of coffee oh that's weak there's a
national world war one memorial this is
20 ounces of coffee
and then we have to stop for the
bathroom run you know yeah that's
already gonna have to happen
did you have to go to the bathroom like
yeah
but i only had two once we started to
pull out of the the oh
we'll stop for the bathroom in like
three hours did you imagine oh my god
did you measure how much curving eon can
do safely without disengagement
um depends on the car the torque limits
are different
uh it's not really about the curving
right so there's a lot of factors that
go into it one of them is obviously your
speed so what the eon limits is the
amount of torque it can put on the
steering wheel
uh on the toyota we don't we limit more
than the torque we also look at the rate
at which torque can be applied because
you don't want to like instantaneously
apply even the full small amount of
torque that it can apply
um ford pickups are selling pretty well
what made it not uh what made us not
want to do a port oh this is this is the
car question
that bridge by the way thank you it's
brought to you that bridge was brought
to you by ethereum no no no
we wouldn't dare shield for cereal they
have enough they do have a lot of chills
you know we never would chill for though
iota
bitcoin beijing bitcoins post us on
reddit oh yes iota is a terrible uh
cryptocurrency tangles aren't real bro
but you look at how that shit's supposed
to work it doesn't work
they also invented a quantum resistant
hash function that uses trinary this
makes no sense at all yet iota is still
like the
it just shows how irrational the crypto
bubble is i'm not distracted no we don't
only drive on straight lines but this is
all you have in kansas this is all
you've got i really have a choice
if you want to see something else you
can watch our periscope from yesterday
where we drove through the urban sprawl
of colorado yeah
um that was a lot less straight i mean
it's not like you know we get like i
mean we could go right but it would kind
of be the wrong answer yeah yeah yeah
we can do that if we cover the camera
we did that in last year
it's getting better we'll be complaining
about them in the 11 o'clock meeting
eddie keep chilling for gas money oh
no post my address
we're on reddit now yeah be cash bro
wants to send us some hey we got we got
something that's brought to you by uh
zero four four four how much how much
cash is that
that much cash wait a second
like nine bucks thanks guys you know
what cause to be honest i got some great
showing to do when we hit this bridge
that's amazing yo
yeah we're gonna we're gonna make more
off bitcoin cash than we did off of the
sale yeah
yeah but van wants to buy some comma
product products
this bridge right here is brought to you
by bitcoin cash
bitcoin cash let me tell you something
it's impossible to send nine dollars
with bitcoin because you have to pay 19
transactions exactly this is true
bitcoin cash has transaction fees that
are under a cent they're incredible
because the blocks are are big bitcoin
cash is the future of bitcoin you heard
it here first guys
less than a penny thanks
that a penny less than a penny i feel
like those guys who i make fun of on the
podcast it's like this podcast brought
to you by audible yeah have you ever
been in need of an audiobook and you
didn't have anything a little npr show
right here download audible
don't forget to use it if you're
listening to me right now you'll also
want to listen to this podcast this
podcast bro and that one is brought to
you by squarespace take your website
show the qr for more gas mileage i'll
show the qr yeah
scan it through the scope does it work
should we write it down on a piece of
paper
should i read it out again
did that work oh what's your bch address
have a surprise that's oh yeah we got
that right here
surprise concerns
has all the security of bitcoin built on
real crypto technology unlike iota which
is built on bullshit well double shift
post i got a pen
keep us stable can you do that beyond
stabilization stabilize when are you
supporting level three oh
that's all wait that's me that's me
i'm buckled
wait it detects the back of him no
that's not that's the the rav4 so if i
unbuckle my seatbelt it's annoying it
says take control i mean at least he
felt unlatched yeah but mine is just
beeps
yeah that's just the wrap yeah they got
a detector there
so they can call you right now we're
gonna do it this way we don't want you
unboxing for our seatbelt for obvious
reasons what up scorpios
eddie get in on this do you have a piece
of paper or something
what ups
what's up what are you going to call me
now how many we got
we got 74
people watching this shit should i write
it on here no i don't think they can
screenshot it they're going to have
paper vivian is also on the tour we have
have you got a piece of paper no um
honestly i do but but why don't we just
show it one letter
yeah
inspiring billboards across the country
dude yeah billboards here are different
billboards here are different we kind of
want to buy like all the billboards on
one stretch of highway so it's literally
just all kame i comment
but i have to fix myself well we just
got a lot of bitcoin cash coming in no
way
this is the best thing we ever did
someone just sent us like half a bitcoin
cash holy shit we're rich shit guys we
love you guys thank you so much
happening you're all great guys
literally amazing we found what to chill
for what's happening
anything else wow awesome thank you so
much wow
you made this trip profitable
that was the oh man thank you so much
[Music]
we're not doing an official stop in
minneapolis
guys
honestly why are we even talking about
self-driving cars this is the bitcoin
cash awareness
yeah let's pivot let's pivot what are we
doing with our lives
oh man
you rock thank you so much what's this
this is their username this bridge is of
course yes
brought to you by that guy who is a
bitcoin cash
it's honestly like making a road trip
profitable yeah
wow
thank you scopey thank you scobies i
guess read it read it did the job read
it read it did it man wow
yo you ever seen that like reddit where
they like it's like crypto millionaire
they're like we're going to turn one guy
into a crypto millionaire and everyone's
like commenting and then they think and
everyone everyone comments and they like
pick somebody and they just send some
crypto yeah it's great what a world i
know i love crypto crypto has done more
for redistributing the wealth yeah it's
gonna do it like seriously
now they're like you know now that like
vc's are buying yeah
we are redistributing the wealth
seriously love it
give it to the give it to the
techie hey watching from tampa
what up
i'm from tampa what up tampa
where's kitty pride from l.a
no no she's in florida man
like like uh she worked at claire's in
florida please yeah remember that space
yeah
they pierced your ears
i could sketch it out get my first
it's kind of nice chilling nice and slow
behind this guy yeah
doing all right
someone watching from belarus
that's fine oh man that's long distance
internet that's going to cost me more
yeah
don't worry we're quick as red that's
right
dude i can't believe it
we should start accepting uh
at be cash watch
in the store i heard i heard some rumors
we love to talk about those i heard
bitpay is going to start accepting
bitcoin cash yeah um which is going to
be so much better than bitcoin because
the transaction fees are absolutely
insane with bitcoin
um yeah
bitcoin cash well we will accept it to
be honest if big pays we're just a
bitcoin cash but we'll accept it
is that public information george maybe
not
who knows
crypto man there's no such thing as
entire trade you're right this is just a
great reason to buy bitcoin cash
and i'm happy like back when bitcoin
cash was like 700 people like sell sell
sell i'm like nah bro
what's going on they already did they
already accepted it but sell your
bitcoin gold um that's never going down
that was a mistake that i have not done
yet i gotta sell that i gotta sell i
gotta sell my bitcoin gold what was that
for
gold yeah recent just like uh
oh
no it was the end of october for bitcoin
gold yeah that's what i got mine really
yeah um yeah they switched the hash
algorithm
on the ongoing fight against asics
oh bitcoin's fighting against asics oh
yeah bitcoin works with but we do like
pay works with bitcoin cash we do like
things that use gpus to mine because if
things use gpus to mine that is driving
the price of gpus down driving the
volumes up and making our models trend
faster
so we are a big fan about gpu mining
yeah we need better gpus anyone wants to
send us a gpu oh yo we just bought one
of those v100s or one of those one of
those no the new ones the titan v so
happy that nvidia finally found a new
letter
not x
pay taxes cash
go away yeah absolutely of course we
always pay taxes always pay the
government you guys the government is
your friend yeah absolutely many
governments here look they like built
this road and shit yeah yeah and we're
using it we're using that we're freezing
well not for free man you've got to pay
tolls but there's no goals you gotta pay
a lot of taxes right like nothing's free
man there's no such thing as free lunch
except for free bitcoin
you know that was free that was kind of
freaking sweet that was amazing yeah
that was that was amazing it was
incredible that was yeah that's
wild world series future is so cool
z cash ether litecoin wallet show it
please
no not all we gotta say oh we're down
because the bridge is coming up
and you all know that
bridges send us some more
same letter as bitcoin cash
this is uh
this uh bridge coming up here is brought
to you by
the letter
b
like on sesame street it's brought to
you by
bbb
big wide letters with big big homes
two big humps just like that black eyed
peas
if you'd like to
please it's your donations that keep us
to donate
alive yes yes
donation what's the number
this is npr 1-800-865-8850 can send
be careful
oh sorry i need my answers for my honda
odyssey please answer um the flip
connector the flip we don't know bros
you can flip it you could you know what
you should do you should write a letter
to honda be like hi i'm 12 years old and
what is this i'm 12 years old i'm 12
years old and what is this um no but the
schematics for the giraffe are online uh
you can see
you know what what pins you need to flip
and you can make you know a board that
flips it right in there right in the neo
repo they're an eagle cat making it very
accessible for everyone
yeah you can make a upside down honda
giraffe and we'd love it if you would
contribute back speaking of
contributions we're doing a contribution
drive right now
will
uh eddie could you show that uh put that
on the screen
this is our bitcoin cash address do not
send bitcoin to it only cash because
it's impossible to send bitcoin without
high transaction fees and
cash is the future of bitcoin you
already here first folks
amazing it feels good to talk like that
yeah yeah right it's like it's very
smooth relaxed very soon
you know i like it like i think it's
like you ever listen
that guy does not seem very calm
guys you need relaxed music by driving
so safe oh so safety so
what do we got who's got suggestions
do some air apple pie that's pretty
that's pretty easy what are you talking
about what's that you know android pie
that's who it is
what is this i i don't know we'll listen
to uh
oh what's that man good weather for an
air strike that's good
um
no internet
um
that's that's what
oh which app you use to manage bitcoin
cash easybitcoin.com.com yeah the
bitcoin so all we really have downloaded
is like some rap and maybe some more
[Music]
a little too dark right now we're all
feeling kind of kind of we're feeling
yeah
yeah this is bitcoin.com wallet hold up
buddy let's get let's get that on on my
livestream as well
the address or the address
all right everyone's going to come try
and steal my bitcoin now all right you
ready for ready ready
once we get uh wait how does that phone
have a perception wow att really
is better than t-mobile they really care
about middle america hey t if you're out
there and listening if you could pay my
cell phone bill this month okay
um these scopes are not scopes are not
free but uh
i know just we have a great sponsor uh
sponsors
no
quickly before it goes away
let's go please do it project file the
way have fun i'll drive safe peace
thanks dan
fox wait no internet connection
available i don't understand i have
internet we should be talking like this
should actually show you we should just
show bars we should show whether you
have internet
oh it's broken
let's press search
uh i want to kill the app and start it
again does that work no it doesn't work
yet it's not real i'll complain about
that in the meeting
you did it once
um i think the meetings i got i got
actual time for the meeting let me see
let me see hold up let me get up here or
our 9 30. we got an hour and twenty
point four four
hours bch is almost finished well the
eon play apple music really we got the
receiving i don't think it would no that
was the person
our
be cash fundraiser on my on my grandpa
oh on your ground you know tom will send
us up
oh man i gotta be careful now like now
you're up my public key is
we should have synced more music
why offline we stop that you know that
you want me
you know i don't know i can't people
right now
really
yeah yeah let's see maybe we have
something why is there no audio feedback
from neo
what do you mean like to speak to you
well aeon
all right
he knows you you he knows me you said my
name wrong uh okay
p06 ninja you know
is that the guy who gave us the p cash
no i know someone else so why was shout
out
because he said that you know him and i
said his name wrong
www.whatisbeatcash.com there you go
killing that as well thank you for being
bitcoin branches brought to you by
www.whatisdcash.com
and also jimmy world's
you know about posix right can you talk
about your ideas about oh that went too
fast disengage audio why is it
distracting
[Music]
uh sorry
man
with the with the zero just like tom
cruise yeah yeah shout out to george
shout out to pause extension
and of course shout out to bitcoin cash
great of course well now yeah www what
it is we've got any more coming in josh
all right we got enough got we got them
yeah we got one we got more than enough
yeah we got no we never i mean
yeah
the donation drive never ends have you
seen jimmy wales
do you guys know that your wikipedia
money is going to fund jimmy wales first
class
tickets
on the road again that's right
guys instead of reading the news you
should just read wikipedia wikipedia
learn something learn something download
the wikipedia app every time you feel
that urge your past experience didn't
catch your deathcon wanted to say what's
up oh i don't go to deathcon anymore
i'll tell you scooby's um so i asked to
speak at defcon this year
they were ridiculous about it
um you know
all conferences start out cool and end
up becoming either
professional or run by social justice
lawyers
so i don't know maybe i'll come back to
defcon we'll see but nepcon's kind of
someone just reported the bots i don't
know if you're a bot who said that but i
really hope you don't oh my god the bots
are reporting themselves
yeah you know whose report made wow so
our theory about the box is that they're
made by facebook to try to make the
periscope experience worse
um
[Music]
there's no exit man there's like nothing
for miles you guys by the way
that's a great book no exit go exit you
guys should all read that it's a great
book it's good
it cuts the uh truth of human nature
i reported about not a bot awesome
like how do you know if someone's not a
bot now i like question everything you
know i really don't believe you're a
boss but you really honestly can't tell
the difference anymore like we really
should start thinking about that yeah
why are we discriminating against people
just because they're silicon based right
yeah that's the next i mean like you
know
so you convert bitcoin to be cash no you
don't to pay cash you don't need to you
can buy bitcoin cash but yeah you can
convert
unless i'm a bot that doesn't know
it's a bot but let's be real aren't we
all
thoughts that we don't know we're
bothered
beijing bitcoin is a self-aware bot
that's true
yeah now you know facing bitcoin is
don't give it up
where are they don't spend again
now this truck
i mean guys there really
isn't that much of a difference my dream
in 10 years is to be dating an ai yeah
seriously i hope you guys heard that
like i'm not kidding
i'm really excited for the future y'all
george and james i have an ai girlfriend
no but like i mean like really like she
could be
my soul mate
i'm not excited
oh i am she's just gonna be an
advertisement for coca-cola yeah you're
just gonna yeah you're scared of getting
advertised your life the way george
what's happening with your girlfriend
not if i build it then we build it with
value don't build your girlfriend that's
freaky
i mean woody allen built it
i don't know if you're basing your you
know freakiness
yeah meet us in kansas city yeah
i think people are receiving their meals
today but some people say today
yesterday which is an absolute shock
because
we didn't think we're just satoshi
nakamoto
yeah yeah
all right
someone called out elon as satoshi
nakamoto
guys it's craig right can you hear him
like an ex-monster great movie great
movie no that movie sucks okay movie
that movie no there's no bathroom that
movie had so much potential at like the
red scene and i'm like oh this is gonna
be so good and then kind of just
i read the script of transcendence and
loved it and then i saw the movie and
i'm like
it's terrible
johnny depp sucks
yeah
johnny depp fell off hard after pulp
fiction and the first pirates
turned up was in pub fiction yeah yeah
he was good back there he was like the
guy
eddie hold up the tour t-shirts for
folks to see oh yeah nice yeah
wow why should we even sell more to the
silver bitcoin cash yeah we don't have
something awareness tour folks here it
is here it is really cool
it's a good good shirt good quality also
one of a kind you can only get it on the
road you can actually honestly only get
it on the road you know what we're gonna
do with the shirts we don't sell give
them out we're gonna burn them we're
gonna we're gonna give them a good will
no then someone can get them yeah no no
we'll send them we'll do like what they
do
let's give some to people who donate you
know like last year who was who was the
super bowl was the patriots versus the
cardinals yeah yo he wasn't in pulp
fiction
john travolta john travolta
damn
hey johnny depp the only thing he's ever
good and then was the first pirates
movie yeah he was amazing weird ass
charlie in the chocolate factory movie
murder on the orange express more
recently
can i buy one with bitcoin cash at this
point absolutely yeah
honestly if you send us 30 bucks to be
cash right now bitcoin cash right now
but you got to send it to me you know
you got to pick up the t-shirt in person
yeah yeah that's you got to pick it up
yeah
like kansas city and omaha get excited
dude this is not good they're even
holding cattle in there
is it cattle or sheep or cattle are you
sure yeah i just saw them wow it's
brought to you by cargill cargill the
biggest farming conglomerates that
nobody
you want your family farm to be
purchased up
if you want to literally
watching this
city or in the surrounding area and
we'll see you tonight
and minneapolis the same day well no so
we're not hosting anything in
minneapolis but we're driving to
minneapolis that night
the dates on the t-shirt are slightly
wrong no dates are completely right
locations where we're holding meet-ups
are slightly oh we should have put stars
on them
oh yeah oh well you can add that with
whiteout
oh my god it smells like cattle
there they are there they are i won't
show you guys
it's all right y'all you eat burgers
it's good to know where they come from
one day we'll all have
lab-grown meat it'll taste better than
any meat you've ever imagined and we can
end all this terrible suffering i'm
excited for the future
the transport they would just kill them
where they were
well maybe they're not ready to die yet
yeah maybe they're gonna be in uh
what do you do with cattle decide to
kill them or milk them
let's make them into leather are we even
we've internet again
maybe we put on some nice post draw 3g
how fast can your car break like house i
guess how strongly can your car
pilot can do 0.3 g
what up I know you like to be held the
other way but you know um so guess what
we're doing right now thank you you're
welcome you're welcome
guess we're doing right now well I'm
eating a sandwich hmm
eating sculpey but yeah we have a patch
that maybe will enable stop and go on
our rav4 wouldn't that be nice
mmm that IO like says everything that
our Lex has a torque mod the isle X has
a official Tama built , pedal I didn't
make the model bus our head of machine
learning and our head of localization
did I'm the social media guy I also
occasionally brick cars we're gonna find
out right now are uning
ants on a log no I mean your sandwich
bro want some sandwich Kobe's no Sam I'm
all guys not a myth and localization
that guy did get a race um como space
forest well you know I think aliens are
one of the biggest threats to human
society and we need to mobilize our
governments resources to put military
bases on the Moon and Mars and Venus
shit even mercury no more no more
military bases and in Iraq and Russia
and shit only only space I'm a fem
I'm sure give me a job to comment I
didn't say you're hired you do print 3d
printing things for us a new complicated
lock on our door
cool time now
freestyle Tuesday go to Berkeley tonight
guys taking the a chord all right
so you see this rap for
this is the rav4s final resting place
because we're about to brick it split
around there looks go bezel splitter
right here apart oh hey guys if we drove
a long us bead we won't find one of
those two laptop right here is that an
extension once an exception pandas are
super reliable so that's why they work
with extension cakes so we're now using
a panda to flash by choosing attack
tricks to flash and we're using the
official Toyota calibration update
wizard software wizard Wow okay all
rights go peace was that a little dizzy
so I'm sitting here on my macbook pro
here's our here's our patching software
here's the Toyota stuff loaded up in Ida
oh yeah this is from when we had Tripoli
on tech no Dooley on tech is
discontinued
well this PC @mods work on all Toyota
hopefully so my job
Ricardo's job is to run the flash my job
is to sit here and run the sniff all
right oh I'm not connected to a panda
sorry I put you down wait no was off
well sorry for putting you down scope
ease let's see if we no connection turn
the switch off oh well now it probably
went into bullshit CDP mode so just
power cycle data yeah okay cool just
make sure I stay connected all right we
are connected to panda I don't know I
just lost connection is the Porsche yeah
yeah left a single part of the pan well
but okay okay something's wrong turn
power off and the pompously no and panda
loses power
how does it make sense powered by the
RAF
[Music]
turn that off and it loses power yes
what does make any sense at all write
letter broken that'd be weird you guys
make sure to buy this buy quality comma
we test your pant is better than we test
ours it works now so splitter sucks that
doesn't make sense
she's like Sheldon good no we don't saw
the comma splitter that's the problem
this is off Amazon can I take your gray
pan to bag why is it broken
did you break it chase now if you broke
it I don't want a diagonal broken panda
I'm just like you would you want a
broken Panda do you want off oh now it's
working cool oh good alright so this is
a really low-quality periscope Kris you
should have got very bad here the camera
person no messages turn the car on ah
not really messages accessories fine
right yeah accessories fine if the
default if the reason your panda broke
was our fault we'll send you a new panda
if you did something stupid shout that
comma da di bro alright so here we are
in the Toyota calibration update wizard
yeah running a special patched version
downloading karma combination so I've
hacked this cue file to reflash over
already-existing
cuz it's not actually
[Music]
alright we're downloading currently
chase yes I yes I know I know okay he
did something stupid to break his pen I
know alright so this is the current
calibration ID it was actually a real
update for the rav4 too and this is the
new calibration ID model named rav4 okay
so it looks good
there's now no way back now watch you
have the vehicle one which has to go
back but what I'm gonna do it oh it's
being censored by potato res no wait is
the resolution bad some guys suggested
some app oh I'm sorry scope ease why are
they so low quality can somebody fix
periscope yeah we're good we're good
it's just Kim oh well now you turn off
doesn't matter yeah you see a black
circle it's great okay wait is there any
way to fix this okay another man hang on
hang on hang in hand
I okay is that better
oh yeah you're bored anyway bye yeah but
I thought you got Wi-Fi out here is that
worse it's worse
okay well it's a low quality Prius bring
sck oh no the scope is are disappeared
George you look like a Lego let's drag
it into why my bitrate
how often if I can broadcast details
oh is it better
oh it's better oh good good good is it
good or just like mildly better good
enough let's know where the battery dies
cool turning vision on a sniffers
restarted I don't think we can actually
have this car started I think you have
to get one of the things flash
calibration update and progress to the
service last night or not no we never
went to this point oh oh good I saw the
country on the flashing cool we're
flashing oh yeah don't touch anything
Daivari scobie's were staying very still
right now I know you have a little
quality flash calibration update in
progress I see a Toyota black line all
right we're gonna seriously look into
periscope quality we're gonna hire a
periscope this is good okay do you guys
see flash calibration update oh I moved
no no
if we stay very still yeah kids wolf no
stupid
Tommy's fake yeah the time it's fake
good this is this is the stuff flowing
through the canvas it's flowing chase
wants to be periscope follow me man yeah
I see a blue line in a white truck I
mean yeah that's basically what there is
to see right now no no no no we're gonna
get better periscopes we need an outdoor
access play baby
they only see the matron I see the
things scrolling by yeah I've missed New
Jersey to file all right there
yeah I think everything to try then we
can try with the joystick cool actually
no yeah then there's some chance we just
like broke please control entirely yeah
Wow we're literally just live-streaming
a progress bar going up yes yeah it's
almost done flashing yeah yeah we're
breaking the onboard firmware you guys
will get to go through this lovely
process if you won't stop and go and
your cars to actually we will probably
write a panda base flasher we're not
gonna recommend our competitor oh look
at all the malfunctions huh well that
one's normal that one's normal yeah oh
okay been loaded successfully we're
ignition off very careful then next
please wait ten seconds the battery is
too low yeah you want stop and go in
your Honda you know what you need
[Music]
alright well this is where we know if it
bricked really successful despite that
terrible red stuff that's what's good
yeah onto puddle all right so let me
just commit that flash log should've
called it rav4 PC every flash is dumb
yeah okay so none of these are safe free
flashes they're PCM so let's start the
car and see what works yeah like if the
cab rides well yeah I guess yeah well
let's see if yeah the engine still works
no EPS flash no no ups flashes band okay
okay so let's try it with the joystick
no it was a live flashing guys and that
was all fingers things gonna work I
don't know my skull piece you got to see
the cool part it didn't break psyche it
was clipping
okay I know they're working I know I
can't see the chat oh maybe it's working
now okay cool
see you guys joining can someone try to
chat and we are back okay cool
right now for me the stream looks frozen
is that true for you too
I hope we're good so I'm trying to
actually broadcast my not frozen okay
cool
excellent alright so we can close that
out you don't need that so what we're
gonna be playing with today is I'm
sitting here in my rav4 and if I want to
see myself I gotta look over here
alright so I'm streaming for my Mac this
time you can see that I've added
something to the Panda examples repo
called query VIN you can see right here
this is the VIN number of my car what
we're going to be playing with today is
it turns out that a lot of cars don't
actually have messages being sent on the
canvas you're gonna have to send
commands to it in order to get the car
to tell you things if you look at these
obd2 pigs so you know when I talk about
every other car dongle this is what they
can get these standard PIDs close up the
window standard PID so to show you PID
supported engine load fuel pressure rpm
vehicle speed that kind of stuff so
we're gonna try to make some of those
queries today so I've written a script
called query VIN I committed it to panda
examples this morning we take a look at
what it is
it sends some stuff it's really kind of
terribly written code um so we should do
a little bit of refactoring so can you
guys we'll see if I make them that big
ice OTP is a standard on top of can that
let's it kind of packet eyes can because
can has only a eight byte limit per
message so if you want to send things
that are more than eight bytes you got
to packetize them
so first let's try something so I'm
actually setting the safety mode on the
panda remember pandas can't transmit by
default setting the safety mode to wall
output so let's see if we can instead
set the safety mode to elm isn't
documented here so we're gonna add this
we can find this in the board go get a
safety cage yeah e3 to 7 is Elm let's
just add this here also we have safety
toyotas board here better way yes make
sure my panda repose update everything
origin that's very cool already okay
cool so let's see what happens if I set
the safety mode so first of all I'll
show you guys what happens if I set the
safety mode to no out shouldn't work
yeah so it sends but it doesn't actually
send it sounds nothing so if I set the
safety mode instead to elm327 I'll try
to look up every once in a while to see
you guys on the chat still doesn't work
works if I set it to all output but only
all output when I was working I set it
out interest maybe LM isn't actually
triggering a reinitialize ation of can
read the code so if I look in main here
this is set safety mode should trigger a
cannon at all
why doesn't work so it's weird if I
toggle from no outputs or it doesn't
work then I changed elm327 it still
doesn't I don't know it works the second
time okay so the first time I just must
be clogged up with crap cool so that's
good to know
so now let's see if we can make some of
these other queries to the car the
request that I'm making for the VIN is
own I know to equals gab move in and
then I'm doing a iso TP receive so I
believe if I recall correctly 7d F is a
broadcast address and 78 is the address
I expect to hear back from the ECU on
let's see what other queries I can make
here I hope this is still visible to you
guys yeah I still read the Wikipedia I'm
just on the obd2 bids Wikipedia
yeah this will be in the Panda repo I'm
gonna push whenever I'm done um that
wasn't the can bus that was finicky I
find the campus is actually super
reliable so you see right now I'm
sending a PID 9 yeah text is hard to
read okay I can try to zoom in a little
bit more mode 9 PID 2 is the vehicle
identification number it's really
unreadable shouldn't be it's pretty
readable here oh yeah okay I can see why
that's kind of hard to read let me zoom
in a little more I'll keep it at 100
I'll make it fullscreen if I have to it
is 4 bytes what's 4 bytes so I want to
send a mode 9 that can request the VIN
message count in pit usually value will
be 5 calibration ID what's a calibration
ID so I found that cars call things I
need to start live streaming on YouTube
you have people tell me this I'm a
Twitter fanboy you know you know I love
the Twitter let's see what the ECU name
is let's see if we can request that Oh
ECM engine control cool so I'm gonna
break out my ISO teepee library a little
bit I think we can actually eventually
just make this part of Panda so this is
a 2017 rav4 so up here is kind of the
ISO TV library so let me just break that
out to ISO GP dot
so much worse at using computers when
people are watching me even anonymous
people on the Internet oh yeah cool so
now I can say from ISO TP in porch
I said TP send this computer see you
pass in the Panda as the first argument
so won't push this little library here
on so you guys will be able to do this
stuff in your car so that's got a
broadcast let's see if we can find any
other ECU's in this car
let's also just text up that red because
I don't actually think I think I'm
getting more information than what's
there yeah look I'm getting this well
that's just part of the response
interesting just what I have in response
to interesting luring it thank you
yeah it's part of the VIN response oh
I'm not you unpacking that cool I'm so
4902 Lotus and that's like a response to
my to my command ECM probably engine
control model and this is engine control
so let's see if we can get any father
easy-to-use to respond and ask them
their names like looping through some
stuff almost longer for stop signs and
traffic lights so it looks like if I
send it doesn't matter if I son to which
is broadcast or I think 750 is actually
the ECM ECU itself
my thoughts on supercruise I haven't got
to try it if anyone has it and we wants
to let me try I'll be happy to give you
my thoughts mama no we can just set the
safes I know what I'm doing my garage
it's a neighbor's garage yeah cool so I
can actually send it to that one as well
I can send it to three so let's look up
Toyota like clear my history your
history comes up still enough and uh
incognito load um how much long until
you've run out of money we're not
running out of money man oh my guy is
coming is we are gonna be more serious
about sales of our products though why
do I need to see inside what box am i
looking inside boxes I just got a chrome
preferences here and clear my history
person one edit person why do I have to
look inside OBD is it part of advanced
when I look at all this chrome stuff
clear since the beginning of time you
can say those those are fine browsing
history download history yeah it sounds
good
bye bye cool how may i I see oh yeah
funny
any upcoming open pilot updates well
that is coming very very soon zero point
three point seven and it comes with
silky smooth lateral control so I hope
you guys appreciate it it was a web
service use a prediction surface some do
not shout Wow chromis all the stuff man
well formed it we definitely only -
hosted app date I don't know dad cool no
vision only you guys with that I've
never actually met someone in your life
who has a Subaru I'm looking at my phone
I'm not looking at you that's you over
there cool yeah so silky silky lateral
not not longitudinal yeah that is uh
people are working on that right now um
so let's check out Charlie noise thing
actually has some good information
Toyota car hacking media cracking porous
and by panel you know we hope like like
I said we ordered we ordered ten
thousand pandas I hope to sell these all
next year come to Australia 50% of sugru
guess your showroom you're out think
you're our ACCC is too bad the vision is
only if the lateral only uses vision so
that might be what you want so oh
manufacturing no no we're shipping out
okay so this is the anti-lock brake ECU
it should be on 760 so let's try to send
760 see if we can get a name that looks
like something reasonable so we would
expect a response on seven six eight No
so I think you want to all-out but what
in their work
they got the he doesn't respond to a
name query so maybe they're all the
seven continents this is probably
something I should do more googling for
sending things to my car never turns out
now I should know like Python one-liners
for time outs nice just like the one I
know it works yeah that works
no that one's responded to me
Oh D responds to me as well that's
interesting
D responds with an invalid cool so to
see so it was big age is not okay so
there's something at B C and D they just
seem like they don't have names look I
could write like I've given you guys the
deal with the vision only ACC before if
somebody shows me that they have a car
that they can control then I will
happily spend some time and fix it for
you it already kind of works too I don't
know if anyone's actually tried it yeah
if you comment up the other radar it'll
work okay cool so it looks like I'm
actually getting responses from these
ECU's what's ever on B 0 C 0 and D 0
they're just not so what I'm trying to
do right now is two things first off I
have to add Elm support to a not male
but like ad standard PID support to
shiver um the other thing I have to do
is figure out how to knock out the
driving support ECU in the Toyotas so
the driving support ECU is what's
responsible for the onboard fairly low
quality adaptive cruise control we want
to knock it out and we wanna replace it
with comet adaptive cruise control
because it's way better so for the
lateral we can actually just unplug the
the camera module the driving support
ECU is hidden much deeper in the car and
we want to keep our brand-new rav4 as
pristine as possible so we're gonna try
to do it with software now realistically
probably the right idea here is for me
to get the Toyota text stream software
hey do I want Japanese food that's kind
of tempting but then I gotta switch off
periscope um yes oppa violet can already
do vision uh yeah yeah I could go for
some Japanese yeah she ball sounds good
I don't know if you're watching I don't
have slack I can't get to slack it's on
my phone if I switch off of periscope
periscope man Josh Andy I got your
Aussie ball alright I give that up 50%
heads working so you can't just comment
out radar D it's gonna take a bit more
effort than that no no no we have an
internal slack but we need more
computers no we need that we walk the
talkies right I need more phone so have
another phone right here let me you know
what I'll send him an email
I know his email I'll send him an email
from this phone okay I got a phone yeah
sure she ball please okay so now I think
my odds are getting across your bowl get
up to 70% that is good
well yo good all right I sent you an
email from the test phone okay cool so
let's go back to obd2 Pitts we're gonna
want to send the request we're just
gonna deal with the main ECU for now but
it's interesting that those things do
respond Jessie the contractor who wrote
the panda elm software for us had some
pretty good comments about this stuff
let's see what you wrote so our stuff is
here that's actually the co knowledge
was in the safety it tells you what the
spec is it's actually being implemented
here yeah so this so the Honda uses
these really high up addresses check or
someone said if an address is 7 TF or
address and okay that's good to know
this is the Honda one
no open bottle does not have emergency
safety features it's not really to be
viewed at as a safety device we do think
that it makes driving safer but now it
doesn't oh oh it's been it's been it's
been updated by this one oh how much do
I have to pay for this okay so first off
it's a hundred thirty-eight I do believe
that Swiss francs okay let's get this
for free
well let's preview man ISO standards a
pricey an Apple lock meow lock me out of
watch you rich paying how many chips
look like I'm paying them any chips
mommy figures
Oh perform Broadway Val I'll have to buy
if I want that okay
who knows how I get free ISO things oh
did the Swedish make it available free
Swedish my girls like that
PewDiePie Swedish he's the most famous
youtuber ever oh yeah oh no it's a it's
a it's a Provo sings like example our
yeah Pirate Bay yeah for some reason I
don't think there's gonna be up on the
Pirate Bay okay alright let's just see
what we can find that's not I self and
so this is like yeah how to request you
game this is how I figured out how to do
that VIN request you know what we'll
just figure it off a little Kapiti pay
just can't be that hard
so these pigs are like the standard ones
they're used by like emissions people
see mode five just modify redo they come
in with the different modes of arson
where this motor mold want the
exceptions are PID one which is only
available in mode one and PID two which
is only available in mode tool oh here
we go show current data all right so
that's mode once
let me just try sending a100 and seeing
what happens so we're sending engine ECU
we're receiving it from the engine ECU I
just read that it's supposed to be +8
let's see what this does
well cool gives me some stuff okay so
this is allegedly the PIDs supported and
I believe it's bit encoded yeah it's
been encoded okay so let me just start
writing this standard quickly um very
poor dead PIDs then it looks like the
cons responds from MSB to LSB he's our
first aw I guess it starts with 1
because 0 pit is always supported and
that's what I'm sending ok so just make
a get PID D I should name the thing
correctly the mode 1 what didn't want
where did they use get get current now I
just say red equal get data for PID 0
that's the works I remove this extra
debug crap from here yeah you know I
don't really write in a Python 3
compatible way Python 3 is a disaster so
we can find out this getting bin doing
any more cool so those are my supported
pets
now it's MSB for
so what's the easiest way to do this
support it equals that I wanna do this
too strong and I should see anything
page 132 was the max you see below X 20
is the max 20 yeah y equals 1 to
infinity I mean you can do that if your
language is lazy I think your Friday
equals 1 to infinity I mean just wow I
plus 1 box if supported and 1 2 3
watch it watch oh I support it if left
equals y guy should standardize
something I shouldn't call one of them
query and one of them yeah let's did I
take that word query from somewhere I
try to make things as standard as
possible unsupported types for tuple and
Aunty add extract okay cool so those are
the supported pads for the car so we can
get calculated engine load we can get
long term fuel trims we can get intake
manifold pressure wait I can't get
engine rpm now that's weak I just made a
mistake trihex thumping get current-day
- my flat for PID 168 I'm just
data for PID let's try okay so 12 should
be the engine rpm seem like it says it's
not supported and yet stepper motor
designed to control car all question the
safety of those things uh but if you
have one I mean I'm not sure we can
really review it I mean I can look at it
like you posted on everything really the
way to do it is like posted on github
and yeah so you got you got to make sure
you do it safely so if you're gonna
build a external steering control you
need two things to be enforced by the
hardware practically you need a torque
limit and you need a disengagement
fuckin side so yeah I mean posted on the
Internet
we have a community going our slack and
see what you love to say okay so I
understand
oh that's the PID wait
mode 1 PID zero our quest for this PID
doesn't make sense
like I'm sure this car can fetch the RPM
between monitor idea supported okay
let's look at this mode thing happens if
Neo CPU fails um also they'll stop
sending messages to the car
so the dashboard will turn orange you'll
get the lights you'll get beeps well I
can request trouble codes with mode
three wow that's actually really easy
updo that only other easy use as well by
the way I'm watching the stream and it's
really laggy is it lagging for you too
well you're actually seeing up to the
minute what I'm doing like when I talk
I'm like I ran query van I ran query van
does that work no like okay it just
likes for me weird um that's why I
thought it was broken before
silky-smooth that's what I like to hear
okay so that's the engine rpm um let's
see community according to this can we
request the throttle position position
is 17 which isn't here either yeah I
know it works
weird did I write this code wrong all
maybe things aren't sent as MSB
you
each bit from MSB to LSB I did that
right seven eight nine oh oh oh
cuz this is that after after the big
endian here actually let me actually do
proper big endian like that ah much
better
okay that's a lot more sensible now can
I get things like the wattle position in
rpm yes I can 17 and 12 so let's make a
little loop here want extract the
current data for the pin so I know that
that's two bytes
untaek so this is your RPM and let's
also get what else can I guess throttle
position that's what I was gonna get and
the level three autonomous a know fully
fake news so you have to realize how a
lot of auto manufacturers view
self-driving they don't actually care
about it and they actually really don't
like it um because you know if you
believe all the predictions about
mobility as a service yeah yeah yeah
they sell less cars so they're doing
this the only reason they ship any of
this stuff is for press the Audi a8 the
l3 Audi a8 is a press stunt GM
supercruise is a press stunt right they
ship it on one Cadillac they're not
actually shipping it on their cars they
ship it on one Cadillac that car sells
five thousand cars a year it's a PR
stunt practically do I think
Ilan gta4 what
do I think Ilan zga for his drive across
the country is realistic maybe chess is
about six months to a year ahead of us
requires an argument for that number is
required
this is some like trick okay so this is
100 times 255 can you jailbreak your ps3
with your panda I wouldn't know anything
about that would I okay cool
let's see if it works let me get over
here into the driver's seat and now
let's press on the throttle and see if
it changes oh yeah look at that kayaking
with pandas bro car hacking with pandas
that's nice
oh you're starting up see if we get some
RPMs look at them RPMs I think I did the
math wrong I don't think that's the
right number of rpms
okay 256 times a closed B also I gonna
divide by four it says oh that was so
easy you guys bro so easy show you Oh
show you me stepping on the throttle
like that well you can see like the ref
count on a car and it matches what's on
the screen process called car hacking
all right it's turns off it's loud boom
boom okay cool um who knows what boost
is we were having a debate last night
about what boo sticks none of us really
knew and but none of us I mean I was
talking with our designer who's made
shiver look awesome by the way and he
didn't know a boost wasn't like really
Oh boosters either but I think no not
Boost Mobile no way yeah I mean boost
okay so let's see what else we can get
from these things
oh we can get the PID supported 20 as
well 20 gets you more pids for to get
you more PIDs okay so we'll have those
two might get supported pids function
all right
let's write this in a not crappy way but
you knowing me I will write in a crappy
way pit equals one rangy pit boss head
cast is through 21 plus pig pig pig and
range zero see how many goes work Pig
supported air
oh sweet it works all the way up let's
see easier although so we won't send a
zero alright alright does not work you
make typos oh it's on the car accessory
boats what we're all four here not the
normal mode data yeah so this is just
normal mode data yeah when I'm not
getting past any gateways right now
okay so it looks like it doesn't even
support the last request hey it says
that standard scam Oh unless that not
right no scam like time out okay so
these are all my supported pits see what
this Bwana Juanes woggs iller en put and
out push yeah I know I am
Toyota socks with standard peds that's
too bad well it says it supports 96 how
does that how is that possible that must
mean I made a mistake
oh I know oh that's clever
okay alright I understand now wild one
kid plus equals twenty if did not and
supported break variable pitter four
side Oh rats
alright yeah that makes us all right
let's do the trench sweet
so that returns all your supportive pits
and we'll add this code to pant I'll
kind of clean it up
totally off stream some lights on yeah
Toyota lights oh yo ice cream light this
up Joe that's a real life not like just
nothing at all John Dylan alright so
those are our supportive pads what do
you think what do you guys think the
coolest pads to display will be like by
default on shiver as I'm writing this
stuff now well I get the temperature of
the engine that's kind of cool
use your phone flash on your flappy
mirror thing wow that's bright it's too
bright can't do it what's the coolest
one of these fuel pressure see how do
you know how torque is getting yeah can
we get that so I don't see it here I'd
love to see fuel usage but yes a house
torque doing that I've seen that in
torque does that actually work or is it
just estimated because I don't see
anything here that would let you
actually get that rpm speed gear
consumption torque a transmission
battery voltage we're gonna get you guys
so that's actually I don't think on here
either
huh okay well that's interesting but no
go back to that later
um non-standard PIDs oh very limited
information Oh should reverse engineer
them and make it available for free cuz
I love free I love free yeah I think it
does math current current of what I can
get you current from the Panda pandas
have current and voltage sensors in them
um but okay yeah so that's the speeds a
good one to get vehicle speed km/h he
tells me the vehicle speed accurate to
literally one kilometer per hour week
I like accuracy you know you don't have
another bite
your phone's GPS you don't know but you
yes because that's you could they
couldn't afford another bite they
couldn't give me the speed two to two
bits of precision all right well this is
where we have open dvc
[Music]
so we'll move the query all ECU's things
somewhere else Kevin's kind of cool
shouldn't really send the PID if it's
not supported seven is fine let's rename
it MV queries in which we name it very
very thin stats that's cool this is a
code that's gonna go into Schiffer
obviously not the pipe shiver is no
longer written in Python it wasn't one
point but it's not anymore
so what else do we want speed revs
throttle battery voltage anymore see no
it's written in JavaScript huh the
futures JavaScript runtime since engine
start well that's interesting because we
should be able to query at least if the
engine is started with that
and watching we send this so in cars
with more it's in cars like the Honda
we're gonna have to use that one try to
comment there oh did open pilot zero
point three point seven just got pushed
it might have it might have been pushed
into Val I'm pretty cool stuff in there
no I'm not logged into anything here
let's check it out
open pal zero point three point seven
release check it out guys this one's
exciting yeah we have we have lots of
improved stuff yeah go to get up coming
I open pilot checks out but let's go
back to what I was doing
haha should work it's gonna update your
panda to the latest panda firmware - let
me just name this thing properly what's
happening right now so I'm setting some
standard queries to the car you can see
that I'm getting the speed the rpm and
the throttle right now
and I've managed to clear the supported
pids I'm also getting the VIN number
from the car actually want to be better
about this oops I should really write a
parser for this and I'll just do two :
but hey you know so what happens if I
Google this then that's good idea Toyota
rav4 and I'm gonna find out all the
terrible stuff that happened to my car
did I get a good price let's check let's
check to history melody Twitter's plus I
bought it from mmm look at this oh yeah
I think that's the price they're asking
I got a good price 34
you know I think car dealers is one of
those industries that like makes all
their money off like a few suckers
alright cool
that's what happens when you query then
that's a little crazy though that you
can just like query the van you like no
so where someone bought the car and
stuff oh mode 21 for Toyota the voltage
of the traction battery and a hybrid
electric vehicle that's exciting I
should probably ask for store DTC's as
well
Java's car has any make that Turkish
effort as well what does a dtc that's
not a did you say cool
yeah extended warranties i probably tell
scammy business all right
control model module voltage job
exciting no
so oven pilot won't update on reboot
we've only pushed to devel we haven't
pushed to release yet so if you are a
developer you can check it out if you're
not a developer you probably want to
wait till a few people check it out
first
i'm still visible it's good oxygen
sensors engine coolant temperature well
definitely check that one no it's called
temperature call him okay so I'll just
subtract 40 from this one PID 5 it's one
bite okay no now you're looking at this
no charge why you're a terrible code
okay well to clean up
I did write a really terrible code
truly atrocious well 39 degrees Celsius
it's that warm or cold
I don't know how Celsius has worked
sounds kind of warm though can't blow
water though are you cool mom one more
stat I need one more stat engine load
yeah it's probably pretty cool I support
that load yeah load no it's one of those
percent once does that really what took
away from that point zero to where you
want it I don't even have that many
degrees of significant figures
cool cool guys I'm pretty happy with
that
so we'll add ice OTP will add craving
stats what I do doing that I think I
need that get the gif well unless it's
vicinage change yeah yeah oh I did
change this yeah I added I added those
okay that's a cool
probably refactor eyes OTP to be
somewhere else but yeah we can be that
later can I make it honk well we'll do
that on the next session what do you all
think about that we'll try to do some
crazy stuff we're even and stats ok guys
I think that is live let me go to OBS
let's what my food is here I'd be real
happy if my food is here a shell cool I
just pick myself full screen here all
that's so pixelated let me just make it
less pixelated oh but now it did that
come on OBS why would anybody want to do
that wrong choice broski all right
thanks everyone for joining this
periscope and it's a little dark and
you'll try some white so let's turn some
lights on any last questions wait it's
hunk actually a code I really don't
think hunk is a code but if I'm wrong
and we can make the code hunk very
easily a car honk very easily I am sold
oh no I don't think that works what's
your question I'll try it next up I'll
tell you next time we learn for next
time next time I got a point to the
right place
how's vim but you gotta ask man just me
tonight I hope my foods inside who
thinks patrasche was inside uh yeah you
should have got an email you sure got an
email if your Panda has shipped
um which should be almost all the pandas
now are you sure got an email what's the
goal of what of the goal of this the
goal of this was just to get some cool
stats so those five stats that I just
wrote that Python to do we're gonna hand
off to the app team and they're gonna
add them to shiver
what is sync up and drive well know what
that is
sync up and dry let's go
thank you thing sync up and drive oh
it's like some t-mobile oh they make
like crappy dongle so I say why they all
make dongles this is like a new pivot
for the broski's the the phone carriers
phone Appetit alright alright cool guys
see y'all later thanks for joining wait
wait wait
post that again send 750 I'll do that
I'll do that what do we got
I'm counting on you 750 oh for
okay next time next time
what up scobie's all right we got
exciting stuff today check out what I
got right here some ultra rare merch but
I promise this is not a merge scope II
no more mirja scobie's I lost my voice
Oh screaming a lot in Vegas we're not
talking about drive that I I I'm talking
about you don't even shout him out bro
oh yeah I got a haircut I got a shave -
look I shaved I got some mapping stuff
today yeah what's up
I'll even try it we'll try it on a user
route - so I show you that this isn't
just bullshit let's see if RC Richmond
comes back I'll tell them on scope now
so first I'll try it on one of mine
so this is what it looks like while it's
running takes a little bit it's got a
boot up here got a filter out all the
crap yeah there we go
now wait hang on it's just kind of
reinitialize if just fast-forward a bit
alright now we're initialized let's map
so I'll move this guy out of the way
here and now we're making a map I'm
gonna turn you guys there we go you can
see that this is a map this is done
using sensor fusion this is a great
panda route I just disable these we
don't need that look at the lanes look
at the quality of that stuff here guys
could the quality of those lanes being
recovered stuff precise to ten
centimeters okay so I've actually
already made this map and now let me
show you what it looks like when you
real oka lies in the map so when you're
like figuring out okay where is the
picture with respect to the map and I'll
show you what it looks like now remember
this is all in world frame coordinates
so we actually have all of these points
every single one of these little points
we have in full ecef coordinates so
let's take a look at this I think this
is gonna be pretty cool look at that
guy's
that's the precision to which we're
covering the lanes in the world 10
centimeters that's what's gonna be used
to train the newest models coming out in
the next open violet look at that
precision guys look at it boom
yo I love shipping you know I love
shipping I let's try it on another one
we're gonna have to do a little
processing on it remember this is live I
haven't actually tested any of this so
who knows if anyone's gonna work but
yeah so if RC Wriston gets back to me
it's sad to be a rout we'll try it on a
user-contributed round as well yeah so
that's that I have others that I've
already made the map for mapping takes a
bit of time mapping takes about about
five minutes for a minute but the good
news is who cares just buy more
computers because computers are so cheap
y'all alright see where else we got
let's go over here - we also said we
also have the 26th minute of this
process so let's take a look here you
have to do a little bit of running
alright using the vision data we're
filtering this all together in a
beautiful unified architecture look look
look that's not coming along guys
alright processing process process
process
yeah we don't need more machines by all
the machines we want from the cloud
right then it processes gotta save all
the stuff to disk it saves all this
debug information to desk oh yeah look
at that look at that turn yo is that
model gonna be precise or what
that's localizing itself in the map now
we'll wobble that won't nothing using
the flat world hypothesis look at that
precision s amazing y'all finally are
getting some good results with napping
and I swear I'd never tried this I've
never tried this section before that
just localized us in the map look at how
it's seeing the lane right through that
car beautiful yeah look man don't
believe the hype how about over
correction what over correction I didn't
see any over correction loser over
correction it's common using this so we
know what you have a new model yet we're
working on it okay we have it we have a
route right here
unfortunately it takes so long hang on
let's just let's just take a look at one
more of mine oh we using the cloud we're
using the cloud for parts of it the new
ml guys pretty good let's just look at
this one that's almost finished I will
try it on use it around quickly too
so remember what this is doing right now
is localizing us in the map so this
stuff will also all run at test time as
well so all the Aeons will be able if
you guys saw that we shipped orb D in
the last release using those features
will be able to put every eon live into
a map with this sort of precision yeah
take a look at that oh that's pretty
good
don't know a little bit more it could be
more precise I don't know we're gonna be
you're gonna far exceed supercruise yeah
we're making point cloud maps of the
whole world we're gonna we're gonna give
parts of it away for free we're gonna
give where all the lanes are in the
world away completely free our HD Maps
like equivalent to what all the other
companies are making is HD Maps we're
just gonna give them away for free I
don't care
I just love winning me a user
you give me times in the real world time
now to use that what minute is good okay
well if it starts at 48 then try it on
some side girls let's try us inside us
I don't know what we're gonna get all
right guys
we running a user route right here this
route is user-contributed with a grey
panda no voice I mean no voice you get
you guys sometimes say you can't hear me
I think that's a lie
yeah I knew that was a lie all right so
we've got a run sad net cuz we got to
filter out the cars the problem of cars
they don't move like the rest of the
scene so this stuff is also all hacked
up to kind of be single threaded so it
runs nicely on cloud machines all right
wall frames here notice possible
overexposure auntie cam yeah I know I
got to redo the exposure oh I was like
halfway doing it but I have date luck
that night I went out and then I didn't
finish fixing expose around the driver
camera I don't have to do that next
release y'all next release oh you guys
know what Eyring we're trying to hire
someone to come in full time to work on
the driver monitoring stuff so if you
know anyone got any smart friends tell
them give me a job and comment on any I
the car properties I like that important
you just called them in let's see we got
here yeah that's fine
not always crash is the first time
because the best a little GDK gtk is
broken
all right cool all right I don't issue
lies fast RC risk man here's your route
being mapped right here
you snap it and created this guy it's
hard to hit the keys here's your map you
create it right here tell the people in
slack tell I'm not lying
give a great panda you have any yawn we
can make maps out of your stuff look at
the lane lines you can see them all
there ho-jon as far doesn't display time
i'm not support man you know support
come hey i definitely you're out there
you go
notice how the cars have all been
filtered out let's thanks to you guys
with comic colouring the driver video
challenge we've gotten very few
submissions no good ones yet I don't
think it's that hard we've one candidate
who came in in person who I'm excited
about hopefully I'll do a good job but
yeah so we're at Frank 861 so
unfortunately mapping takes forever yeah
I mean this is all part of the pipeline
so we can just enable this in the cloud
how I was hacking supercruise you know
Ricardo he's on vacation this week so
there's no super cruise hacking can you
map the route without lane markings
absolutely we just it doesn't matter you
got have a great panda though if you
have a great panda because you need a
great panda to avoid scale draft um
Opie drive while training maps yeah
that's fine here's why we make maps but
yeah this stuff is really all starting
to work we'll see how long I hang out
with you guys if I hang out with you
guys long enough we can actually look at
the lanes we can relocate math looks
pretty cool right do it yeah we'll see a
long hang out so this is a visualizer
from warp slang
we've hacked in all our own sensors to
it as well
some people might say oh why do you show
this all off because guys Eli was
talking about I'm so happy when he talks
like this um this isn't like this isn't
a secret what we're doing here none of
this is secrets but if you try to
compete with us you'll find that we are
just doing it better than you like other
companies are all trying to work on the
same problem as well and you know it
took us a bit you guys have watched the
other mapping periscopes and you've seen
how it's been how it's been worse and
now it's starting to get better oh so
that was finally done listen we're at
frame 384 so we got another 400 to go we
could track farm roads maybe on the next
one
but yeah I mean there's no there's no
secret in the idea there's only secrets
in the execution the secrets and how
we've actually wired all this stuff look
at those lanes guys look at that look at
that precision and these are all the all
these points are globally accurate so
these aren't some points and some
relative space these are in global ecef
space do we use lanes to calculate we
use lengths to calculate where you are
and then we know where to draw okay no
no no guys look if you want like open
but look here's the thing about open
palette all right so first off you're a
bottom and open pilot is beta is alpha
software we're not like looking to add
this is maybe why I get overly
frustrated when people ask for features
like we're not looking to add features
this is not a consumer product we're not
looking to build a consumer experience
if you want it to do whatever like
suspend on blinker
whatever it's open source that stuff is
well within the realm of somebody to add
with an hour of hacking if you want to
yeah so we record the beginning and end
of all the lane lines perfectly in our
map we actually record all these 3d
points in our map
so every single point you see here
actually has a point in the world so
let's save the map it's gonna put the
map in the database all right
saving the map and then that's gonna
finish out once that's done takes a
little bit the maps are kind of big
because you see all the points they have
and the stuff is horrendously slow
because it uses like JSON and crap okay
so that's yeah you don't want features
just drive in the middle and we're good
you know we're again it's gonna be
better the lateral control is gonna get
better better is not a feature what do
we do when someone goes through the same
route again yes we go into the maps and
it'll it'll that'll get better with time
how bigger the map specifically alright
so now we got a download that GPS chip
from NASA let's post process all the GPS
to make sure that this stuff is all
actually correct within the world to ten
centimeters not just locally correct to
ten centimeters what was your question
before that yeah grab that shit from
NASA what are the difference in the
retina black the residents visible right
now the red is what's visible from the
current frame okay so now we're
reprocessing dual grape and of RTK it's
not necessary
you just download all this stuff from
NASA and it's pretty good the common
base stations are kind of on hold okay
so oh we got to process that oh that's
gonna take forever
hey fix that bug guys I can fix this bug
up fast it's not a bug it just processes
too much stuff when we don't actually
need to process all that so that's in
test so Sam from all from route cameras
that we don't need all from let's try
that
oh yeah there we go
oh look at that so this is good stuff
that we can then go train on as soon as
we're ready
look at that precision guys look at that
precision that's all three dimensionally
accurate it's cached lovely
it's totally guessed locally I just have
many Maps on this computer we catch all
the NASA data look at that precision
boom yeah I see your ping pong don't
worry we'll fix it cool guys let's watch
it one more time this is a user route
that I didn't know about before this
periscope started this actually works on
all the routes now pretty much I think I
think we're down to like maybe a 10%
failure right and of course you're
training them all you don't actually get
to work on all of them that's now added
to our completely global map next time
next time we'll do it downtown it's
actually easier Drive integrated 3d map
with open pilot working already yes it
already completely works I just hold it
back from you guys cuz I'm cruel and
evil oh no time for the same we have
canonicalize errs there's some key ways
to do it maybe I'll talk about it
sometime alright guys I hope you
the first successful mapping periscope
everything worked we put a user route in
you can see the top of the board they're
going to be better than supercruise how
do we plan on processing all the world
using lots of come six copies thanks for
watching make sure to buy shit shop
comment that a you know where it is
right I'm right with the most lip
self-driving car team on Twitter make
sure to follow us at comma AI if you're
asking every time someone asks for the
ETA for something we push the debate out
one day we push it out one day so if you
ask 7 times the 7 days late we actually
already have it all incredible we just
keep it secret no that's a lie but make
sure to borrow a chit shop.com by follow
us on Twitter , underscore hey I watch
out for fake news it's a lot of fake
news out there
props to way mo by the way for releasing
that video of the crash
totally totally not way most vaults I'm
a car literally jumped across the median
and hit them so always good to see
people being transparent and open that's
what we love to see thank you for
joining
what UPS coppice a little bit of time
for people to get in here remember you
guys like the last mapping ones so I can
say what's up
yeah yeah I think you have to be careful
because I think if this loses the track
then it's not gonna work but as long as
we move it slowly and see the or
features over here yeah those are the
futures being streamed from the device
we're computing them on the Qualcomm DSP
y'all never never go to bed never sleep
are me did you sleep you know who
doesn't sleep now Ford sleeps man but we
don't sleep and that's why we're gonna
win so you can see them live streaming
the video over here so you guys can see
me holding the periscope with you that
is meta so you can see me I'm holding
you guys right you say yeah probably I
mean this is the same technology that's
in Apple's AR kit it's really very small
here we have an actual 3d map so this is
the same stuff that I was using to map
the roads except here it's a map of my
room so if I tilt it up you can see it
tilt up okay I'll make landscape sorry I
locked the rotation on my phone who
doesn't lock the rotation on that phone
yeah but so this technology is coming to
all your yawns very soon and then
combined with a great handle for the
places where our map does not have good
coverage this is going to give us ten
centimeters yeah new chair it's squeaky
I stole it I stole from someone else
yeah you want to come grease the chair
it's a little off it's terrible I'm
sorry guys sure it's terrible I check
out the comb pedal here's the comb
federal development station I'm very
upset with Eddie that he printed this
collar pedal in black because everybody
knows that comma pedals are light blue
a little LED blinking here tonight look
at that look so this is a common pedal
yeah I've been working on so that firmer
is pretty much done notice that we're
using all the Collard products this here
is a comedy bug
there's we're using it just exploded
giraffe you know what else we gonna use
I mean there's taken apart kama petal
good morning but ya know what's really
exciting is the mapping is the mapping
and uh yes here's oh I guess I need to
show you guys what was actually doing
the mapping here's an e on just sitting
on my desk again plugged into a comedy
bug yeah so now when I rotate this see
it map in real time over here yeah right
the mapping is exciting so I mean I
showed you guys in the last
late-night sundae mapping periscope
about how this actually works on the
roads
orab slim doesn't really work on a road
but if you combine it if you combine
these features let's see the features
over here if you combine the features
it's me and orb if you combine the
features with all the other stuff yeah
so what we found with the radar is the
problem with the radars is that they
have internal Kalman filters and if
we're putting that measurement into our
Calvin filter you can't double Kalman
filter like that unless we knew the
standard deviation from the raters which
we don't um obviously shame shame on
these radar people you know every time
like Tesla autopilot
accidents where it hits a stop car it's
really it's the radar like you can do a
much better job with this you know
radars killed a few people it's true
common radar I don't know so you want
you want to talk about um the visual
spectrum and why lidar is stupid I kind
of think actively emitting photons on
any spectrum is kind of stupid what do I
need to act the photons for look at what
I have working right and like this isn't
like this demo is not I built this demo
on a signal see for you guys this one
over on the left here I just piped the
frames into uh into a modified version
of orb slam but yeah you can see that
attracted this isn't using behind you or
anything we're working on the night is
scary well the night work at night as
well look it's me on the periscope
filming you it's like a triangle yeah
I've learned how to play chess you know
it's like yeah yeah just last night I
was reading about triangulating your
queen in the endgame triangulating yeah
it's gonna be functioning um dude like
honestly do we build things we don't
ship this is all gonna ship with with
the big gray Panda update and then we're
gonna start making precision maps and
we're gonna start real oka lysing you
and your precision maps so some of y'all
are gonna be part of the vakama commuter
Club the car needs to download what deta
yeah needs to download map data I'm
still be downloading map data from our
servers like I've said our maps are
gonna be open source the stuff is
starting to work really well if you're
an investor in a mapping company get out
now get out yeah wait no I point you
over there and I look over here get out
now
that's right don't be a mapping company
when can you join the community club
yeah I heard about the Iowa in the free
RTK I don't know sounds like I have to
yeah sure yes seriously I don't know man
I shorted mobile I once lost money I'm
over shorting anything on the stock
market
I only long clicked up which isn't doing
so long right now but don't worry crypto
will be back always long crypto but yeah
we can we can look I'm sitting here by
my by my three monitors like that to me
mom there's a pretty nice right oh yeah
we were going over we were going over
some companies
one of my slogans is convenience drives
success maybe there are the three kinds
of companies there's the uber - the
person company which is like way mo
cruising uber no mom the mom is not 4k
they're 1080 you don't really want for
came all of us let me do everything slow
so we stand a 4-man for your map data
I mean it's honestly just gonna be
coordinates in ecef ecef is Earth Center
earth fixed so these are these are
reimagining companies and then they make
cars better companies those are the two
companies honestly really aren't even
our competitors our competitors are just
just the status quo who wants to keep
cars the same or make cars worse you
know I've grown a new respect for mobile
over the years as I see we talked about
in the last test go
yeah that was that was the demo I have
prepared for you guys uh oh yeah if
you're with a mapping company get out I
mean here's why right so what a lot of
these mapping companies are doing is
they are spending a lot of money to
build one map and to try to maintain it
right so their overhead for mapping is
is very high our overhead for mapping is
actually negative we're providing value
to the users who map for us in the form
of open pilot right so you get open
pilot for free and we get data to make
maps I think that's a pretty good deal
and you also get that data obviously to
make your drives better you're going to
see immediate improvement once you start
mapping an area so if you are part of a
mapping company who is now spending
thousands maybe millions of dollars
compatible cars are on our github at
github.com slash comma AI slash open
pilot it's also I think it's linked from
our main site if you're at a mapping
company and you're trying to make a map
once if you're trying to spend a ton of
money on lidar cars and then you're
going to rent seek yeah yeah I SEOs I
SEOs are all on hold have you heard
about the new securities laws you guys
been seeing that the New York Times and
stuff you know I like that idea
you guys know I like that idea but um no
I mean look what we're clearly providing
value to the users right not only to get
not only get the dash cam to get shiver
but like open pilot Oh pile it's a
pretty good deal um we're not gonna map
your garage we're gonna try to only map
things that we deem are on a roads I
don't want a map in your garage I don't
want to know
contrarily Metroid's VA knows that
they're gonna be on our on our open
source map and it's going to be
contributed to and healed by all of our
cars just driving a cross at all right
and in like pokeymon mapping I mean
here's the thing right this is a Ark it
but for the world so
if you think about it like that right
you think about a are kitten a our kid
can like do my one room this is a our
kit for the world you want to put a real
like who stole what's though who stole
the a are cute guys actually doing
something similar doing whose company
called Napper AI I'm all the Erica
people left Apple they were startup
anyway who basically built that stuff is
that a heatmap originated from my pandas
car kid yeah mapper a I um so that's a
better idea I mean you have like mapper
today I and your little five Traver
I mean you know it just they
misunderstand what the hard problem is
[Music]
yeah so we're gonna start building we're
gonna start building this map out you're
gonna be able to get to it at a map Maps
dot comma dot ai once it's done is there
Pokemon or no should we put Pokemon on
our map I mean it's yeah we think we can
aar the world right I mean why don't we
sell the advertising in the AR right toy
sell advertising is that the kind of
person I am
what am I gonna give more details on
comic commuters so maps are first first
we're gonna launch the very early beta
of comma map I mean everybody who has a
gray Panda and neon will be able to
contribute to the common map if you have
two gray pandas your stuff will show up
on the map instantly if you have only
one gray panda it will take longer um
and that's because we need to wait for
for data to download from the UH from
the US government and we know that
they're not very fast which car did he
get and he got his own car I don't know
what car you got I think we might go buy
a Ford Fusion tomorrow you guys know I
was talking about that earlier on the
slack but yeah so um if you if you are
friends with someone in a mapping
company you know tell them the
apocalypse is coming if if if you how
will I make you rich buy buy a Ford
Fusion
I'll make me poor around I'll give money
to Ford I don't feel great about that
but you know hey everyone else is using
Ford fusions and you know what they say
most of the time when everyone else is
doing
something by a semi I'm not doing
Sammy's common team is 12 people
apologies what ghosts driving yeah yeah
fusion yeah no it turbo all those s got
turbo
I got a turbo in my Ford Fusion what the
finance was a great man we're killing it
shop down calm down oh yeah are we
shield for the merch oh we show for the
merchants hoodie you can't even get bro
you can't even get this shit if you've
got a hoodie you got in early um ml guys
still there well you know ml is ml ml is
a tough tough tough field guys still
here yeah but you know don't expect new
models I know some of your L expect the
new models um you know when we come out
with a new model you're gonna look at it
and you're gonna be like holy shit
that's like a year ahead of anything
Tesla's on autopilot we're gonna crush
him are we gonna crush him because we're
finally doing away with the original
Senate comma a I which is lanes lanes
are very bad and we don't have lanes in
our new model under model won't have
lanes our new model will just be like go
there and go there is exactly what you
want from model sandbagging the new
models are gonna be great but the new
models are still a long ways away so yes
the ml team is still here but you know
ml takes a long time aha so there's
there's that we have a bunch of things
to do before the new models and we don't
really talk about our ml strategy
because it is secret but you know it's
not secret our mapping strategy our
mapping strategy is 100% public for open
source maps and it basically looks like
this
we're running a super modified version
let's not even orb slam anymore on the
back end we're just running gto which is
the optimizer orb slam uses to build
maps then once we have maps will stream
them back to our devices so you can
localize in them and then once we have
maps well when you have a map see that's
the real way to do more torque safely
right you don't you don't want swerving
when you're on a highway oh but if you
know places where you can
need torque you can limit the torque
based on where you are in the map and
this is a great safe way to roll out
higher torques so we can we can talk
about that if you don't have a platform
ie Tesla car itself Tech's less sticks
its customers with its own property you
will launch on what car brow have you
followed Khamenei I do you have a Honda
or Toyota go right now to come at AI
github back on slash comedy I slash open
pilot and you'll find that there's
actually some free software out there
that can drive your Honda's and Toyota
so what car are we gonna launch on the
Honda's and the Toyotas and maybe also
of the tasarov I see some great progress
with that GM port we'd love to see it
upstream get you paid out that money you
know we're thinking about buying a Ford
tomorrow that's gonna be Honda Tesla GM
Ford lexus lexus is already supported we
already support the lexus RS that's
right acura Honda's are just Acuras
Toyota's are just lexus lexus they're
just Toyota's Acuras just Honda anymore
car hacking going on right now we are
always doing car hacking you guys want
to see a pre CC you I'll show you guys a
Prius steering controller what pothole
detection well yeah who likes potholes
man no not infinity check it out they're
really cute actually he this is the ECU
the Toyota uses for all the steering um
so what you'll find if you look at this
is the guy over here is where the power
comes in this one here is where the
motor goes out and notice how many wires
it has it has two so it looks like
Toyota's using like just a brushed motor
um which is a little sketchy
I mean the reason to brush motor is a
little sketchy is because if you have
that latch up that's kind of a playful
torque to the motor which isn't great
especially also this thing oh it does
have a relay okay alright so it does
have a lockout relay here you can see
this relay I think that that is locking
out the fats to prevent that latch up so
that's a good thing
um so there's a bit of safety in here
which is good but you know brushless
motors are inherently more safe than
brushed motors because if you get fetch
feta you don't you get like weird
behavior but you're not going to get you
know slamming the steering wheel to the
left or to the right so then you see
right here this port is where you plug
in the torque sensor and this port here
is where you plug in the power and the
can and these are the little cute Toyota
steering controllers that look like
they're in most of the new Toyota so
it's nice I don't know what chips
actually in here this one looks like a
FET driver this one is the
microcontroller running the code so the
Prius has parking assist I don't know
why this is only in the Prius I don't
know why this isn't in the other cars
I'm so the Prius you can actually put a
lot of torque on the steering wheel it's
enough torque to do South Park but I
don't think it's the steering column
that's different but the Prius does have
other weird qualities so maybe there are
some differences in the steering column
I didn't build this house I didn't hang
the chandeliers
I do like another kind of nice right
yeah Prius ECU
here's another Prius CCO this is a
hybrid controller Prius ECU this is the
one that I bricked well this isn't the
one that I bricked this is the spare now
in case I break it again but I own brick
tit so it's all good yeah the ref will
just have ultrasonic it doesn't have
active Park Assist it can't like spin
the wheel
am I still into iDevice hacking I
couldn't care less
i device hacking had its time back when
phones were bad in 2007 phones were bad
you needed to hack them 2008 phones were
bad you needed to hack them you know
with bad in 2018 cars that's why we had
cars gotta make cars good how did i
brick it
I did I forgot it I missed a checksum
all the Toyota code when you add it all
together needs to add to a a 5/5 I don't
believe in passions I think that that's
a stupid way to look at it people are
always like find your passion in life
that is stupid advice um just do
whatever the hell you want alright
work is the only thing I've ever really
found satisfying I mean what else is
satisfying sitting around spoke a weed I
like smoking weed but you know what you
can smoke weed and work that's great
janna works the only thing I've ever
found really satisfying in a long time
so yeah I did this this is what I do
women weed and working
how about Nissan's any port guy smock
ass Oh check out my Omaha
check out my omaha sweatpants brevin
gave these to me when i visited omaha um
smock ass i don't know what that shit
means smock ass i like yeah check out
the quality sign that's too much you see
you know no I don't really cook the
works don't know I just I just made a
mistake
am i high now no what did i do today I
had I had I had a mate' oh and I have
one of these these things really do get
me wired though no I'm not high we could
have this much energy if I was hide
these things man I did have one of these
today they kind of do get me wired I do
have more respect for mobilize yeah
mobilize not as bad um yo maybe we'll go
smoke weed after this maybe maybe after
the scope he goes away well uh smoke we
don't play some chess right that sounds
like something to do um yeah I do it
more respect from oh boy you know I
still don't really have respect for
sorry guys
this is our Zuke's poster this is why we
don't build cars yeah sorry zukes I
don't believe in his future this is a
big house you live alone right now yeah
I'm the only one living here oh this is
the office right like this isn't this is
my house this is the company I office
yes a nice poster right check out these
there's this one this this is made by a
micro intern check out our h-1b
application forms it's really hard to
give visas for people what now I'm never
gonna say superglue bro
but yeah so for those who aren't here at
the beginning of the periscope looks
like we got a few more people
check out the mapping set up so this is
just our I have an e on here on my desk
that I'm using and now that crashed yeah
it's not I like it's not really orb slam
it
doesn't real oka lies because what do
you need to realize for when you have
GPS what are our micro interns doing we
have two micro interns coming this week
one is interviewing for the
infrastructure position and one is
interviewing for the JavaScript position
to work on Cabana and shiver we have two
interns coming this summer which we're
very excited about
we have a great Android hacker coming in
to improve stability and quality of knee
OS really get neo s open sourced and we
have a phenomenal ml intern I got this
guy on the phone and he just you know he
knew yeah he had similar ideas on how to
actually solve this problem no we don't
do remote work only in very rare
circumstances on machine learning
interns yet we have a phenomenal machine
learning intern coming this summer I'm
very excited
interns sleep in the basement no you
guys want to see what I could take you
at an intern sleep we do have we do have
intern housing would you offer intern
housing a comment I of course right
because I always wish that like like
other things offered intern housing what
kind of company do I run we r comma AI
and we're gonna win self-driving cars
that's what kind of company we run a
winning company that's right no but like
seriously you guys see what we're doing
we're very open what kind of questions
do I ask for ml during the interview
well you got it you got an interview to
find out if I tell you my questions and
other people will watch the periscope
and then all of the answers and then it
won't be a good test you can make good
lemonade listen to gucci mane song
lemonade that's what i have to say to
that how do you apply give me a job at
Khamenei I um take more money from VCS
and hire faster we have a lot of money
our problems not money um the problem so
like there's this myth and this is one
of my contrarian positions that more
people solve a problem faster I don't
necessarily think that that's true yeah
we can help you with visas we would
definitely help with visas I don't
necessarily think that like just
throwing more people at a problem will
solve
faster I think that if you want to
problem-solve faster it's really
important how you set up like management
structures and the way that people work
together because management and I'll say
the word collaboration is really really
hard alright let's go up to enter in
housing I'll show you guys in turn
housing scobie's yeah no it is about
quality it's really all about quality we
hire honestly with the average IQ income
AI as it's got to be insane
so alright alright alright we're going
into housing
welcome to intern housing so we have a
bunk bed here so we can fit two interns
I'm gonna sit down on the intern bed
here a little desk for interns to do
work at that light doesn't work let's go
plug the wagon oh there's no plug
oh there it is there we go alright
scobie's hope that was fun to join me
yeah right is this intern housing umm
you live right where your work so you
commute it's pretty good I mean it's a
few room in San Francisco guys what am i
doing these days
car hacking I've been on the car hacking
team this week we are gonna do a pop-up
shop I'm really excited about the pop-up
shop but don't tell the regulators cuz
we're just showing up man I don't mean
like the regulator's like dish to end
stuff we're cool with them now I mean
the regulator's like whoever regulates
pop-up shops because I heard that Logan
Paul who am NOT a fan of anymore fuck
Logan Paul that's too harsh - Logan Paul
I think Logan Paul will get his act back
together but I have a fan of pewdiepies
to go out there and watch our PewDiePie
Oh dev kits right yeah no no we sell
deaf kids no it's not that it's just
like I'm sure you need like a permit to
set up a pop-up shop and you know me I'm
gonna show up on a corner with like cart
maybe we'll like open the back of the
rav4
automatically and we will you know just
start selling alright where do I see
coming in five years I think we're gonna
win self-driving cars um
I mean okay look guys look obviously you
can look at me and it could be like well
I'm delusional right like how could how
could we possibly win you know we have I
say we have a lot of money we do have a
lot of money but not compared to you
know these people have poured like
billions into it but I don't think that
matters I think what matters in the
future is like avoiding regressions and
shipping if you manage to build and you
manage to ship something a little bit
better and a little bit better and a
little bit better yeah Pass Elon is
looking easier and easier
where is he launch cross-country Drive I
thought that's where he would be by now
right I thought that that was gonna get
done I'm a little bit surprised that
hasn't been like I say I'm nice
delusional than I were two years ago
that's probably true I'm surprised it
hasn't been done so yeah I mean if e1
doesn't like this year is still ahead
but by the end of this year I think we
will be able to do that cross-country
Drive are we doing stock options to
employees absolutely absolutely if
you're trying to start up early stage of
course stock options good eventually -
um no it's not that success no community
right like the community is a great
asset I do love you guys I love a comma
are me proud to be a member of the comma
army um the community the community is
great and like what it gives us is is
feedback um if we're shipping bullshit
you guys will tell us right if Zook
spends their days doing bullshit who
tells them right so by actually shipping
and by closing that feedback loop it
gives us a really cool advantage that I
mean who else has that advantage like
Tesla alright now I can talk about where
Tesla stopped and why there haven't been
autopilot updates lately I think what
Tesla's done over the last year is built
something that we've been building from
day one and that's really good
infrastructure to gather all the videos
from the car
because you know Tesla just didn't
really have the kind of training data
they needed yeah yeah I feel good about
the current sensor suite it's not just a
single camera we have another sensor
that we've shipped obviously you guys
know what it is who knows what the other
sensor is the sensor I promised it for a
while I will do that self-driving
awareness to again next year and we'll
have less disengagement that's I think
that like that stuff's kind of gimmicky
too like rice it for one GPS exactly um
so we shipped the gray panda which is
another sensor in conjunction with the
open-source comma AI map yeah so you're
gonna get that great sensor as well if
you haven't if you have great panda and
an internet connection you get a second
sensor after the single camera no
there's obviously some stuff you can't
do with a single camera and we know that
but we do still feel good about it till
the end of the year there's a whole lot
of the problem to solve on a single
camera and you guys know we're cellphone
company right first year the absolute
first year of karma I we built the comma
zero I showed it to Bloomberg the second
year we built the comma neo then we
called it the well we built two comma
one and we called it the Neo when we
shipped last year we built the comma E
on so next year we'll build the comma
three right yes we're cell phone company
we're looking to ship new hardware every
year just like any cell phone company
will continue hopefully to support the
old hardware for one year after that but
no real promises on that but we'll try
our best on the you know it's quite a
good platform there's a lot of stuff
that's still unused on that so like I
said that thing that I showed you the
vision thing was running on the DSP
which is another completely unused part
of the chip in your D on the depth map
using camera are working on that no no
no no the commentaries nothing fun but
we are like a phone company we're going
to ship new hardware every year
why no love to BMW because it uses flex
write anything that uses Flex ray is
difficult no not a different smartphone
no I think I think that this is going to
be the last smartphone , product though
the EON will be said
ordered for quite a long time I mean of
course there's gonna be an update you
know I'm not gonna ever lie and say you
know that's it that's it
the Aeons gonna solve software in cars
it's not right you need more hardware
than that obviously but I think by the
end of the year and maybe with a demo
that we have coming up in a few months
you're gonna be like wait did you really
put that in the yawn yeah we put in the
EON right um no cross country is cross
country is it who cares I care about
people's commutes I care about making
people's computes have less
disengagement making people's can be
what's nicer do I think new cars will
ship with some extra security people ask
me that question a lot I always say
Apple couldn't stop me and Sony couldn't
stop me what hope to Honda and Toyota
have when are we gonna run out of 1+3
never never never never never actually
no I shouldn't say that
what do I'll show you guys this document
we have stacks and stacks and stacks of
eons I should get a stock room we have a
lot right now but yeah we'll probably
run out middle of this year so we'll
have to figure out how to get more yeah
we're gonna develop our own hardware
platform ah because I mean we have the
EON is a hardware platform all right oh
we put a phone inside of it yeah we put
phone inside we're who cares what was
the other question there's another
question I forget what it was
can you make self-driving bikes no that
means you want it to pedal you want
electric bike you want to steer for you
you want the balance for you you know
who did that though
Anthony Levin to ask you right hype for
auger yeah of course I'm alive trogir
man I think my reps gonna fall in price
but I'm still hyped for it
um Snapdragon Hardware no probably not
you know who will use it do you think
ways actually makes people more stressed
I don't think so I think it makes it
less stress
thank you virtually Chris thank you good
to see you again yeah no we just went
over we just went over mapping and yeah
we talked some shit about some companies
not really I think I choose a pretty
positive periscope trying to be more
positive positivity you guys
I love positivity this is a nice fruit
when interns move out I'll probably move
in here and then my rooms in this house
too and
can move out and put more people in
there tensorflow on-device we do that
already
what do you think that model was trained
with the one that shipped envisioned a
stencil off I can't even guys I'm trying
to be positive on this periscope I get
even room to her no no no this is the
only room you guys get to see today what
did I love prior to mapping we love
mapping and mapping the big thing this
year I'm the one from the GPUs man is
Kama HQ moving to LA now I like to talk
about that right you guys know team ten
you know Jake Paul's thing we're gonna
be team eleven we're gonna be twice as
lit team eleven it's logarithmic deal
eleven TV 11 bro no comma army for life
make sure to hit that like and subscribe
button it's no like bought on periscope
if you can hit that make sure to smash
that like a subscribe button
move to the east coast now that moment I
love these coasts but here's what they
say about your company your company's
valuation is 5x higher in San Francisco
yeah we're mapping bro what happened
take the survey will you start sending
the e on with the 1 + 5 now nope yawns
we'll all be one plus three T's and yeah
that's what yawns will be you do a lot
with that phone
um when moon guys so how many eyes
growth has been um well you know what
they say about exponential it looks
linear at the beginning but I think that
these nuts right I've voted for Deez
Nuts I tried to but you know I just out
of the race yeah 2016 Deez Nuts no but I
think I think the virality of commenting
eyes a little bit different from the
virality of okay alright come on man
what kind of a name is that invited Bob
black I love blocking people am i dating
uh no
No you know you just got a dating like I
don't even know what that means anymore
man
like dating really confusing what you
gotta like I don't know I don't know
what it means in the modern to know in
the modern tinder era
what does dating mean right that's
something to think about like it's not
well we're gonna get married and have
kids and move in together I don't know
am i okay
yeah I'm okay I'm good I'm good I trip
to Thailand I went to Thailand I found I
went to some of those places this is
kind of a little shady right like you
see like the kind of guys you show up at
those things I'm way the name comma come
from so if you want to have a successful
company it's got to be two syllables and
it's got to be between four and nine
letters did I meet ladyboys there are
yeah you see some lady voice that is
real Thailand stuff who hurt you don't
cry do I look sad what's sad super-shady
you gonna tweet when pop-up shop happens
uh yeah we'll tweet when the pop-up shot
happens
what does dating me guys you guys got
you guys got me psyched out man Oh name
was coming from um nobody understand
what I'm saying right like it's oh I
found one gray panda I found one gray
Panda when I was cleaning the basement
we of course will periscope the pop-up
shop uh no like there was this storm and
when I showed you guys this door and I
thought about I thought about going
there papa
periscope oh yeah no I did that's the
last girl I dated I did I did I dated a
girl uh two years ago before before the
company no it's it's I'm not sure if the
world's changing her arm changing see
that's something you always have to
think about who's changing is you or is
it the world
you don't know cuz there's only one
world there's only one you these are the
things I think about
the world I mean the world is changing
right but you see that's the thing like
can you really know that I think we're
both changing right there's a there's a
real friends you know you're good thing
you abandon I know this place is the
same and I'm just changing right and
it's about going back to like your you
know your suburban home that you grew up
in and you know the place is the same
and you've changed is the bounty
mechanism for supporting more cars a
long-term plan bounty is one of the
strategies using the Deep Web no he's to
do drugs I don't really do drugs that
much anymore so what am i buying on the
Deep Web
I smoke weed you know Slee Galia the
California uh y know South by this year
they didn't invite me to speak um I
probably would have went it's kind of
fun to use a thing right the first year
I gave this and you can see The Verge
article about it the first year I gave
this speech where it's like I'm gonna
hand capitalism who thought leadership
right and then the second year I'm like
okay wait number like this is actually
what we're doing um you smoke weed and
are able to code and run a startup I
don't smoke I don't like wake up in the
morning and I'm like smoke weed right um
why don't you use eye glasses why do I
need eyeglasses have perfect vision Bros
anymore car hacking tools for the
community coming out cabanas gonna get
improved what phone am i using you guys
know what phone I'm using what phone am
i using those very much check is pretty
sexy right um no in trucking in trucking
way most strategy makes sense I don't
actually use tinder tinder is a terrible
terrible dating app
shipper is ship is a better app to news
it's tackle um let's play there's plenty
of women if you know where to lock you
know but they so got yelled at me for
not being politically correct on my
periscopes last time he sent me a
message on twitter is like be
politically correct bro and here's what
I said back to him like if we live in a
world where people are too afraid to
speak their mind then I don't know what
kind of world we live in but that's not
an excuse to be a sexist or racist don't
do that that's that's bad beautify
I think we talked before crying I'm not
gay sometimes I wish I wasn't be pretty
cool I think being gay in San Francisco
be a pretty cool experience um this is
this is personally guests a real
personal periscope telling you deep
thoughts you know it's more personal
than like Apple or Amazon Amazon Amazon
because Apple has already dominated
their markets Amazon actually still has
a lot more to grow I have investors in
both though I do believe that both will
grow but I do think Amazon will beat
Apple to be the next trillion dollar
company um I also think that Apple is I
mean look are they trillion topples not
trillion um Tim Cook is great at running
things and that's the kind of person he
is but like will Apple be the leader in
the next thing I don't know I kind of
don't see it whereas Amazon you know you
still have Bezos they're right jobs Ian
Apple would be an Amazon any day cookie
and Apple maybe not we did use AWS until
we ran out of the free money and now we
use our free money on Azure I'm not
touching anything Sony you know guys
have a permanent injunction and allowed
to hack any Sony products um I couldn't
care less about the Sony products either
what I sell to Jeff here's the thing
about selling right if I thought some
company could help us could being bought
by that company could help us achieve
kamas mission faster which is winning
self-driving cars then I would be good
with that um but I mean you gotta you
got a win right okay I won't tell anyone
you're good bro um test your software
hardware outside the USA we ship
worldwide bro we don't test we ship we
simply test a little bit we test them in
the basement of the testing closet can
we trade in a white pen of a cheaper
gray pen and a bro cave Jeep oh my god
integrating with a large clubs better
than selling for a chunk of change yeah
maybe
what's winning for comma I mean wouldn't
it be nice if we could sell a box that
you put no those refunds within 30 days
if you don't like the product if you
just want next year's product I mean you
can't like buy the iPhone 7 and then the
iPhone
comes out you're like Apple could I
trade in my iphone 7iphone is not a good
example I think that's actually true am
i a good programmer I mean you can read
my code I'll go my github github.com
such geo hot um I guess I don't know be
doing that recent up there Kiera's
probably the last big thing I wrote so
you can read my code and you can judge
for yourself whether you think of a good
program or not okay better hacker than
programmer
yeah I do I submit connect I bought the
dip I bought the dip
I thought big connect might rebound and
I lost that eat so let's just say that's
one you don't never see again
oh my Amazon Prime now order will arrive
soon sweet about some hard drives her
computer we had a micro intern coming
tonight don't get to get him a computer
uh Toyota firmware hack soon TM yeah PCI
max soon
why pandas so expensive panda not
expected a pen a not expensive only $99
cheap umm what language do i code in
Python mostly um I'm pretty good at C as
well no I bought SSDs of course I want
access to is what is the hard drives
these it's just an SSD I'm pretty good
at sea
I can read C++ you asked me to code
anything and C++ I'm a lot worse at it I
realize I don't know any modern
JavaScript anymore um you know I know
like jQuery or JavaScript
so that's true I spent like two weeks
learning rust um yeah I built some
things takes a long time uh I made this
one thing in go and realized absolutely
hated go I like rust I like the idea of
rust just winning mean always staying
open source and not staying to a single
car company winning means shipping um I
don't really open source is nice I think
open source has a lot of strategic
advantages that are really
underappreciated how old am I'm 28 if
pandas expensive comply dad's a lidar
Java programmer program I have a wait
like do people not like think I'm a
programmer I mean obviously I'm a
programmer right
UI mods it doesn't really work that well
uh-oh yeah you can bet it knob you can
buy a knockoff you can buy a cheap China
oh btw dunno then like try to use it for
like driving your car and I like won't
work bro like this fine I don't know
like you got to ask yourself do you buy
nice things if you buy cheap knockoff
things you can buy cheap knockoff things
don't work well some cheap knockoff
things are good to buy it when someone
makes an actually good knockoff panda
for $30 tell everybody to buy it no
that's the thing like what do you think
I am some kind of like business CEO I
could certainly code
am I like a great like programmer like
Jeff Dean I don't think so uh neither
publishing papers is kind of overrated
what I consider common level three by
December probably not I think level
three is more like a year and a half
away um to actually be level three I
think that we need I mean okay I think
you get the kind of reliability you need
for level three you're gonna need both a
really good ml model and you're gonna
need maps and with those two combined I
think you can get to level three does
open pilot work well in Europe try it
yeah I think so
not not know they drivin left Germany
right now I kind of work see today I'm
gonna left - I think Carmack is better
than Dean maybe a cart Carmack Carmack's
a good programmer as well yeah he's you
know he wrote fine he's kind of doing
small like stuff to us you know writing
there I think if you are can yawn get to
level three probably not maybe depending
on the car lane change part of level
three it doesn't have to be I'm so level
three basically just means looking for
the best programmers guys I think I have
a set of skills I think are very good
systems thinker like it is Elon Musk a
good programmer
I don't know coming not that good um I
think I could probably go better than
him but you know it's not like
programming is a it's it's a it's a
almost a rote skill to some point like
systems architecting is where it's
really at but if you can't like prove
yourself programming which I think Ilan
did and I think I did when I was younger
if you want to see if you want to see
some good code of mine I wrote this I
wrote this exploit I wrote a the
Chromebook exploit and Google made it
open source you can find like geo hot
zip and he can read an exploit of mine
and it's it's quite well liked commented
and document it and stuff like I'm
handing this code
you know I want to impress it right
that's what I kind of still respected
Google it's sad we're good to go
but that's that's a topic for another
day that's definitely topic for another
day it is sad that Google uh I think
they've lost away Chromebook Expo yeah
just come back x-play I want $150,000
for it
back in the day back in uh 2014 I don't
talk about my past much can you use it
for open Network attacks knowledge I
handed it to Google I I responsible
disclosed it right not that I think
responsible disclosure matters but um I
will responsibly disclose an exploit if
you'll pay me $150,000 now I haven't
done a CTF in a while and this CTF says
good at them no I didn't reserve a model
three
I don't think Tesla wants people buying
their cars what do I do now
you said an intern housing in periscope
what about Google would that Laffy
Taffy's I wish I could scroll back in
the chat I can't
yo guys you want to hear something
that's actually like shitty Mars Chris I
got seven years in jail like that's not
even like a joke because super shitty
for for not losing anybody any money
like I I don't want a billion dollars I
think we talked about that last time I
don't know what I would do with a lot of
money I don't really want money I don't
care I want to build better stuff are
you
ADHD what does that mean why did I leave
project zero um
project zero I was an intern there I
don't want to do that as a full-time
career free scrolly I agree I agree I
you know I was with some people we
protested outside the Twitter building
when he got banned from Twitter uh have
I drank alcohol
not tonight have I drank alcohol with my
life yes um you could go skiing every
day with the billion dollars yeah you
guys don't understand like I'm already
rich I go skiing every day already it's
not what I want to do with my life um
are you OCD I don't know what these
things mean bro I did go to CMU and my
OCD and my ADHD you mean some like quack
who went to like like that darah you
know school
they studied how to like when the
marketing reps come and offer you a free
trip to Hawaii for marketing wa tughda
say yes
that's what they learn in med school
baby I don't know yeah chance again
weird net worth I never very low
maintenance leak on the floor it's just
not that kind of stuff doesn't matter to
me
I'm comfortable enough that I could live
off the interest of what I have are you
soap my son of a bitch no don't dairy
dare insult my mother like that
um battery died I think my battery's
alive everyone's keen on figures huh you
know I was younger
ah what neural thing yeah I've been here
two years and we got three more now
let's go you guys being rich is a scam
I've always felt that you know actually
if you haven't seen check out my raps
soundcloud.com slapped Tom Cruise that's
Tom Cruise with two zeros inspired by
James Dean with two E's damn I'm feeling
okay it's really getting late I'm
shilling for my rap account we saw 66
people will go to an hour in here what
are my thoughts about Facebook's
platform Facebook's a media company but
actually I have seen some sort of like
self awareness this year which I like
from Facebook and from Mark Zuckerberg I
don't know I mean maybe he doesn't know
what it means to make the world more
open and connected and he really is
trying yeah the Kolar more track is
pretty good I did put a lot of effort
into that new tracks oh man I did oh all
right all right all right all right you
want to go get my laptop I'll do a rap
track I got this is this is something
most I was I was writing right because
of those work enough I'm not gonna
release it on a on soundcloud so I
figure I can just get my laptop and
perform a few guys you know like the
quavo style rap yeah if you care about
self-driving cars this is nothing to do
with self-driving cars this is this is
just getting late
it is late though I'm waiting for my
Amazon Prime look it's still running how
stable so stable all right chop it up no
one lets the other rap track although I
got here no no it's not it's not
self-driving
[Applause]
what Amazon Prime package yeah I'm his
longtime delivers late we love Amazon
Prime all right I have it I have like I
have this song according to Roger no
we're really gonna do the rap I don't
think we're really gonna do the rap
should we really do the rap here's the
beat I got if it doesn't come I'm going
to be very upset with Amazon look we got
like a quavo be right
that I his we got yo I just I download
these beats off the internet and I'm a
terrible I'm like a YouTube rapper II
know this is not where my talents lie
we're gonna put in video in every car
maybe I'm flipping a gremlin - spatula
down in Atlanta with Georgia's the
Capitol I made a pinky from my pan and
I'll bring back a spatula poured and
flap it up
time to go merry-go-round people don't
marry the ground the dirt is so this
isn't sleeping around I hear this
because people will sleep with you now
Seraphim brother don't wrap it up look
what I'm making to stack it up you can
all watch it go put some ice cream on
that bitch and some fruit like bananas
and outta there got a few jets in my
haters back to the kitchen in the break
you know I got so much money wondering
what they will say now I find them and
ask if they want a pancake and they eat
but they all look so big now know which
is good but they gotta admit that y'all
can see just be getting paid now looks
like I got the way now you can tuck it
with a pole now y'all be my pancake I'm
the king of the playground
alright that's very shkreli ish play
with that like quavo shit right I can't
want to go sit in the room boy yeah
thanks thanks Bros I'm sorry me alright
alright I think on that note we will
leave it now I gotta finish the track
right maybe maybe I'll finish the track
I have a lot of Blake unwritten wraps
that are kind of like crappy only wait
you see on Tom Cruise's Ali scrappy
which is really not saying much man I
wanna be a rapper when I grow up but you
know what I got better things to do you
know what you know I realized today and
we'll leave it on this note the sky's
funny man no but here's what we're gonna
leave off with today but I'm not a
rapper alright um know what we gonna
leave off with today is guys I'm down to
do this you know for the last like last
year I was always like okay
how do you put the board away right you
play the game of chess you know it's
great about chess whether you win or
lose you put the board away board goes
away you shake hands good game we can
all appreciate a chess a little bit more
right but companies don't end that way
companies either last forever or die and
it sucks it sucks and but you know what
like if I want to live forever then why
shouldn't I make the company last
forever this is this is this is what I
want to do and this is um I wanna look
forever I gotta make the company last
forever I don't know guys like uh when's
the next big product release it's all
coming in time right we're a lot like a
cell phone company we're gonna come out
with new hardware every year
um just print two organs I mean no it's
just about it's about the future I want
to live in right and I think that
there's way too much just so much
negativity in the world that I really
and I'm just not I don't feel negative
anymore I think that we can build a
great world I think that things are
really exciting I think that crypto is
really exciting I think that
self-driving cars are really exciting I
think that AI is really exciting I think
that these things are gonna I'm not
gonna say like like people talk about
people talk about like empathy and stuff
and then you read like there's a book
like again so much has it oh my oh my
friends been delivered whoa yo let's go
get it boys oh I love packages man you
know that's what they say never never
grow up and never stop being excited
when your packages arrive let's go let's
go see what I got yeah boy look at that
look at that oh by the way I don't think
you guys can really see it but it's
beautiful out here
I don't think you can see it all but
it's really beautiful
um packages like Christmas presents
exactly right when you're an adult
Christmas is all about like that person
from the family's coming right but
that's Christmas I got to see people I
got to interact I got to be polite
Wow Christmas I love my family guess you
got a lovely folder
let's see what I got okay right here
this isn't that exciting I have a three
pack of HDMI cables I got him a brand
new hard drive Samsung SSD 580 Evo it
was on sale and I also got us every
system Amazon does trihard I also got
another ebo you see this whole area
we're throwing these couches away we're
gonna we're gonna put some desks there
this is H not hard drive it is an SSD
it's SS these are hard drives but what
is it okay it's hard man like it's hard
hard drive PC but I don't guys honestly
I play Age of Empires Super Smash
Brothers 64 and Jess these are the games
I play I'm old I'm old but no I'm the
note we were gonna leave it on is you
guys we're on an amazing journey where
they are and I don't know I mean they
always say look for me yeah smash of the
night play I go 64 I got a second floor
I got a CRT TV it's never that good at
Starcraft I was good when it first came
out and then everybody like just
memorized build order isn't like I don't
play this game anymore
yeah that's it's exciting and from an
outside perspective you look and you're
like okay I mean look I got a seer I
like like like how can uh how can you
win right how can how can how can calm a
win but then again from the outside
perspective like who's shipping nobody
we're you know I drove I drove autopilot
ooh and a model 3 I mean it's some parts
it's better than open pilots some parts
it's worse it's a matter of taste
how is that possible I tried out GM
supercruise it's good one common isn't
one yet it's good when it works but did
you know it just drops out a lot of
times and you don't really know why it's
just like sorry I can't engage here I
have no idea why I write like open pilot
kind of gracefully degrades supercruise
is like you got a drive bro Google's
gonna ship lidar sensors I think one of
the greatest things in the world
okay we're definitely not going past an
hour with this I think one of the
greatest things in the world it's like a
problem is kind of like like maybe the
word I use is virtue signaling why lidar
right like like the people who are
always so pro lighter can you really
articulate why it's better than cameras
Oh super cruise does monitor your eyes
ah visiting random chat was go be some
day no agenda we always have agendas but
then they devolve into this they devolve
into sitting on the couch I'm sure
talking about I trying to be positive
trying to be positive cut positive
because positivity big fish all right
we'll leave it at that
all right a little bit that if you're
investing in a lighter company what if
the dirt on your lidar if you're
investing in a lighter company or you're
investing in a mapping company get out
if you're investing in comma a I you're
gonna be rich
no promises that's not a stock holder
promise or something
he said you uh five hundred II mean I'm
not gonna keep you FAC underneath bro
but yeah all right thanks for joining
later scobie's
I hope the quality is good because the
stabilizer is so sick
oh but I'm not really understanding
having you
yes
cake icing like rotated like
[Music]
pretty cool right
thanks for the great Spanish reminder
you're surely welcome Oh
oh yeah we've got 42 this is this is not
YouTube live yeah what missus Bible in
Portuguese - what you're using the most
creative language shout-out to him I
like the new white shirt says here thank
you do people like periscope again is it
okay for YouTube why I think it's just
like way worse quality but it's like
it's all we have like we don't to give
all of our information
and like no one gets alert while any
good you all really pretty girls
wait-wait-wait
we're in the vaccine
to Mesa Arizona yeah
- Mason we dismiss you - blood for one
session because we got complaints of
periscope but then it was like just
really different
but then periscope with soaps that we
left that they improve the quality
that's right
periscope contacted us so thank you guys
for apps we're back
you just have to subscribe on youtube I
never does a lot to ask people to
subscribe to YouTube and like Obama's
really into pairs go for some reasons
like what do we call the people that
watch YouTube live sorry
liars hey developers sure yeah
they on yeah Harold has a new scheme for
creating generally oh there's the police
patrol oh we just saw a car that was on
fire you guys
we have lemon city know
oh yeah it sort of leads Tomas Tomas
knows we're coming from Burbank school
we sold a lot of sorry see that the
profit is a few Blake destabilize for
one second and freaks out why does it do
it's some unstable control
you think they use MPC how come doesn't
drift I'd understand doesn't treat why
would it truth going on my free silver
pilots name bracelet Pacifica awesome we
hope you enjoy it
oops sorry do you guys hope to get out
of your visit to heatsink tomorrow
what's a good question that's the
makerspace is called Itza yeah
what are you get out of it we're gonna
just present up over two weeks we're
gonna have a mobile shoe store for you
guys we also want to see Mesa Arizona
never been if you have any heat sinks
we'll fix it
we're also trying to go see some wheat
Mo's when we're there you know say hi to
our fellow friends yeah we're gonna
track down some wave over in Jackson
there's cars happening we working on we
thought those a panda somebody's
complaining about the cables being
untidy I agree this yeah see I'm so
sorry
what was the where the Hyundai so like
the giraffe sticks out this way
you know any guys really well
mr. bast yeah well that
my god something's happened
funny oh my god it's fighting back
someone hacked our TGI stabilizer DGI I
think like okay I let it go it's gonna
go he's a big dater probably you can't
fight it turn it off and on again
okay so I guess it does it changes in
the joystick mode where you can pins
okay
great
what else
what does anyone have any dinner
recommendations on the later
oh shoot I just flipped the cave this is
so terrible I'm sorry and I don't I
don't know I have to switch it back yeah
we've had technical problems I'm just
trying to reflect those
oK we've experienced technical problems
our monkeys are working well what's but
the problem is that this stabilizers are
no longer works I've like literally lost
like half the viewers I'm just gonna
have to hold it because that was like
really really dick you we have 34 we
have 45 yeah
pre use most part Isaac how may I open
source Chris black these cars are so
amazing because we have like a full moon
roof back here they say oh we played the
alphabet game yeah there's this game
where you try and find the letter of the
alphabet
if we sold final yeah we should sell
decals because people would put them on
their car and then we didn't own the
alphabet game has a Wikipedia page
really it's just called alphabet game as
called the Alpha the alphabet game is a
card game played to amuse travelers on
long car rides soundtrack version is on
the one we're driving final seven
Thank You Beth yeah we got three or five
seven
should do a comment ama yeah I mean you
can always say don't put any kind of
sticker on my car but I would totally
put a comment so good oh hey secret good
version I'm gonna cover Magnus you know
you can put a sticker on your laptop or
your phone oh it's a Monday no say
Saturday
why what's happening orders ship out
Saturday Monday last night yeah that's
our last day of shipping if you want
something before Christmas order it
today understand what we want from
perhaps is they really the first
question it's not obvious like everybody
don't supportive demands like if there
was like clear definition what a man is
maps are clear how you define lower
swoosh of maps like Google Maps Apple
maps they will do the same thing right
it's clear and what information you want
from them the HD match is not obvious
they really depends on which kind of you
wanna do with them
and so we really like try to understand
that what's going to be useful for the
pilot right so well yeah and so that's I
would say the main F for the last week
was very clear with that then we have
the data we just have to do it is the
this latest version on yeah yeah so you
have to switch to develop branch if you
want to be like that like our tester
yeah thank you for coming to the meetup
in Burbank we had fun Burbank's a cool
place except for I was told that it's
not cool to sleep every school really
got doughnuts in Burbank
she's all my Tech's come up on here
that's so sketchy
it is my god I don't want them apple
carplay sucks ready I'll read your text
are we gonna check that Tempe maybe
we're getting in at like 11:00 p.m. so
we gotta figure out the traffic Toyota
will totally be on sale at the data
store yeah absolutely we'll have some
with us
and apple carplay is bad like you can't
use your phone at all if you take if I
try and use another app we can mash goes
away so embarrassing like and I can only
use these few things I can use Google
[Music]
Brannigan make it brandon has city with
don't worry quality so bad we will do
side-by-side comparison we'll do both
yeah we'll do YouTube live tomorrow yeah
QA about the car face if only we knew
someone that could jailbreak
no I was talking about this with with
Andrew like I can't believe Apple even
lens like this is the only place that
you can run something like something
from Apple on non-apple harder yeah like
I'm surprised they give up the
experience it's like it's the only place
they really do that the next time they
don't be sure how it works and like it's
not good it's so much better but I'd
rather have a good phone mount that like
just went there than any kind of carplay
the screen is like barely bigger than
mine
I love Android auto seems better cuz you
can like switch between
just a good amount
right yeah it's like no point
I can only use that format
and like all my music is being displayed
to people we listen to a good podcast
yesterday by Lex Friedman for the expert
did you figure it out you know but I
didn't realize you can spin it there's
pretty Funko in a different mode I'm
like spin it it's kind of fun I think
it's good rigs most exercise that's
super unstable let's put the scobie's in
that
we got 4 hours and 44 minutes
to the table table city
it's pretty easy
speed limit apple says 55 we say 60
right right check 65 right off we can go
now it's three lanes it's gotta be 65
yeah
[Music]
we get our data from spoken stream app
there's another chick-fil-a
we should get we should get a milkshake
at some point tonight yeah
I guess would be gonna be ashame yeah
love milkshakes they do an ice cream
stop hu before did it yeah you're gonna
ruin your appetite
like don't articulate real chicken - oh
what's gonna make an sheykh stock on a
GPS it also displays speed limit
obvious bath
next
but people ask you we have a new secret
heart over yeah because I'm do anything
he just sits in the basement
and just like come up with new names for
your ass
it makes cool keychains oh yeah the
keychains look good anyone out there has
it she see this is where it gets like so
bumpy I mean having the stabilizer
explained Matt I did it work
it's just you know I don't know I don't
want to put them in and then smash out
again
has to buy a historical district I don't
know what goes on
hey very personally Chris how's it going
yeah we're in the Hyundai it's going
well it drives super nice so just like
love in the back this thing is equipped
for children like you'll have a warning
when you open the door that make sure
you know you didn't leave your child in
the backseat it's a truly phenomenal
family Ricardo cute every one of us in
this they both say 65
[Music]
you're pretty slow to talk you do we
have 40 is that a lot so it's something
that's so like the 40 miles my heart
Fortuna then there's snow on these
mountains on the left yeah yes you
didn't really miss much virtually Chris
we kind of just have been doing this the
whole time just chat
been driving
we want the scope before the Sun went
down lighting Otto
well you guys know that we're gonna look
for huevos for you you know we're gonna
make sure they're safe like maybe Eddie
you consider the front of one and just
make sure it stops baby chemistro at all
are we gonna do some live coding in the
car
good what do you want live code yeah
I'll do some live coding and
[Music]
you could do like lying with your life
that's fun
snake in Python is a game snake I had to
do that for my introductory yeah it was
fun
hoping next step now that doesn't sound
as fun a snake hello world in CSS I feel
like that's someone's like College and
we're like on the brink of doing it
really yeah yeah that's good I was
interested at snake I mean I think thing
could be a good YouTube channel coding
in the car the car would it be good
Eddie
no they said oh don't make that
I think we can make something in the car
you can make it work you mean yeah I
don't know I don't know how to make
gooeys in Python
I thought you use like my game all the
time to build the deal you're going to
really hide nothing how about my octo
map integration is super awesome
just saying
slows down yes without four curves are
you real not yet
but
it says
let's import this group is like into our
yeah yeah no yeah we can keep going with
like oh yeah the debate we had yesterday
night yeah a stethoscope is what you
guys speak about consciousness and
intelligence do you believe there can be
consciousness without intelligence or
intelligence without consciousness
what business without until our
intelligence without conscious
conscience
they did put together like are they
linked they need
are you guys saying I don't think they
need to be like no identifying
consciousness in the podcast fi yeah
that you Dante we see the young gets
driving data consciousness less and how
it is update what does that mean so I
wrote consciousness let's intelligence
update itself
are you defining consciousness
consciousness update teachers updating
self
like eons have experiences right like
they they have like a route that's what
we call them that's what they're
experiencing I suppose they have no
subjective experience right they have no
notion of self it knows it till the eco
and another one plus tau zero one open
pilot oh it's flat okay no some
arbitrary notify something does it like
you can't it can't communicate in any
way just how does that have to do with
inexperience the communication part
super no I mean it it doesn't know what
its limitations are and what its body is
and we know that because it can't
communicate that any way like it I guess
it isn't necessarily what do you mean it
just can't communicate but if they know
or you la dia might have subjective
experience but we just don't know
because it can't tell us
you might have a very rough form of
subjective experience like the thingies
so clearly like I have subjective
experience I think I don't know about
you guys but I assume that you guys had
me do because you seem very much like I
am right but at the same time I conceive
of things not having subjective
experience and being intelligence right
so you can create that you can put
together molecules and create an
intelligent creature so he says the
state of being awake and aware of one's
surroundings
yeah I don't know it has to be more
strict than that right limit the
findings should never feel bad about how
we treat computers yeah is it like what
you guys think should we have a field
band on now between computers
killing robots here named Robert killing
a robot that's what you're saying yeah I
mean badly even a dignity we were all
but you can ever dignity that we have to
care about
the best the best from the podcast is
how who wasn't that max the professor's
there wasn't lek so say you didn't want
to be carbon chauvinistic which is like
goodbye Carbon chauvinistic looking very
lion especially in the future we live in
them
we're like you don't necessarily need to
be Parvin based to be saying that I got
not a carbon chauvinist pig I think
anything could have an experience that
was like a dog has experience right does
a fly have experience yeah but there's a
bacteria
because the form of intelligence left in
your system is like just because there's
less intelligent way but you'd say a fly
has subjective experience well if they
can't express like the dog we have some
part of the communication that you can
express with each other even if you
cannot express it doesn't mean perceived
is expressing yourself is not an issue
speculation to be intelligent to or to
add subjective experience but that
depends on how you define subjective
experience
I mean consciousness Ryan conscious is
your subjective experience thank you Dad
I don't know it's very hard to define
but India that basically you perceive
that's the very definition of subjective
is that it doesn't define but like
whatever is going on that we Tina's Safi
that is gonna have been too intelligent
for but it's gonna be the future like a
computer yeah yeah that's seems
reasonable I mean I was listening to
some research that they find
consciousness that's like the ability to
realize that you are one entity until
ability to understand your own
perspective and realize that other
entities have different perspectives and
so I kind of know that you have you're
like this one entity with a place in the
world and that other entities have a
similar subjective point of view that's
different but isn't that all part of
what you could define an intelligent
system like this seems like
we might have very good definition about
intelligence and everything that you can
say about the definition of
consciousness actually seems just really
apply to intelligence and doesn't
clearly define well but this is why some
some researchers also claim that
consciousness isn't a thing right like
Daniel Dennett is one of those things
that says I mean consciousness just
doesn't feel like people should stop
talking about it
well that may be that make sense right
but why do we care about defining any
ethics right consciousness and the fear
of hurting other people for imagining an
alternative like you could be earth is
what what's making us defining like
maybe x-ray but holding on to the idea
of consciousness just so you can have
ethics so you don't die is if this
sounds like
and enough that that's in Portugal
like you shouldn't hold on to
consciousness so just so that you can
create ethics like ethics wouldn't be
justified if I'm actually convinced that
other end it is probably older than me
or video/dvd knows have consciousness
right so I would be defined would we
ever be able to define anything about
about computer sure about like Robinson
we are at pretend like I mean if robots
are gonna become very intelligent like
human their favorite develop the product
like new research like the current
experience we have ya know buzz put like
the experience we experience the how it
feels is pretty well defined by new
research is showing that there's a small
part of your brain that conglomerate's
information from other parts of your
brain and creates this experience and
that if
and that if the if that part of your
brain fails which is only a very small
part of your body functions mostly as
normal but you lose consciousness so
that the consciousness is clearly this
very small part of your brain that acts
as a like like you saying this in the
talk is like a CEO it's not like
consciousness is the result of your
entire brain it's a result of a very
specific illusion that happens within
your brain
yeah I understand but to me it seems
like that could be simply be part of
like intelligence like you need to be
that part of your brain to actually like
be able to to compute yes I understand
but what the point is like you can cut
out your vision system in your brain and
you'll be just as conscious and you can
cut out your fu consciousness system and
you'll be great at seeing things still
but you won't be conscious anymore the
experience of consciousness happens on a
specific part of your brain of plenty
but we also refer leave we always refer
to consciousness
remember those two things seem tightly
linked as well right like when you're
unconscious
we don't have memory of things but
things still occurred to you but it's
but there's a difference between so
according to some research when you are
really really drunk it's not that you
lose memory but it's that you are not
conscious right that you lose the
ability to store memories right so
wasn't happening that's different right
why
I mean being that were using the word
different here is it but screwy there's
a difference between experiencing
something and forgetting it and never
experiencing at all but not to you know
not to you awareness raised
consciousness yeah
yeah yeah
all right then I gotta top the last week
but what was like regarding
consciousness right does it make sense
to think about consciousness as like a
Unitarian thing like consciousness seems
like a property of an individual but
what is it really like an individual
that has consciousness or consciousness
is something that is actually a surprise
across several like intelligent
individual like what like clearly like
if you lose our we are still like the
same person you can say we're same
consciousness remains then if you lose a
certain thing eventually like part of
your brain and maybe you lose
consciousness required what define
myself Italian conscious this is the
classic like split brain argument right
there's like these people who they cut
their brains in half and then both their
brain halves are still conscious but
have no means of communication
you have to conscious then you have to
conscious brains within your brain
so we're there to conscious brains to
start with like this is something that
happens in dream so I think I told you
guys already but like sometimes like you
are in a dream and you dream about
somebody telling a joke to you and you
laugh at the end of the joke but it's a
brain chip off yeah no yeah you're
definitely not consciously simulating
the joke it's simply it's by different
part of your brain
yes I know there's not reasonable and so
I think there is one
I think conscious probably stays in one
part and the other part of the box like
oh yeah this is there is a lot of
research pointing that this is true that
this is like so there is actually two
specific parts that cause consciousness
one in the central every hemisphere
which is why it seems that if you split
your brain you can have two fully
conscious individuals inside your head
but then there must be a third that can
for instance
well this is the interesting part the
researcher that they're completely
independent and conscious but somehow
can create the illusion of cooperation
just sometimes one we just help they
individually make decisions and the
other half has the illusion that they
were complicit in the decision he has to
rule they come to hemispheres control
completely different parts of your body
and the other half just rationalizes why
that was a good idea this has been
researched extensively it seems like any
stalkers used a lightweight tool or
things that but - there's time -
dictatorships but they must be the they
must counterbalanced and they have the
illusion that they control each other
well should we end it there discover
anything you call it the sample
consciousness I'll do it oh that sounds
legit wouldn't name it something more
fun yeah the back seats are super comfy
thank you for asking you know there are
other questions good we'll see you guys
tomorrow hopefully if it goes by its
spot some huevos we'll uh we'll show you
about it vici scobie's thank you
hey everyone my name is Mitchell I'm a
machine learning engineer at comma and
I'm going to talk a bit today about all
the work we've done to ship navigate on
open pilot so this is a project we've
been working on for a while I think I
started on this late last year and then
we showed off an initial version of
navigate in our driving to Taco Bell
video at the end of last
year uh the idea
is well the driving model already takes
the videos from the two cameras on the
Comm 3 as inputs
so we're just going to add a third input
that's a video of Google Maps and this
should just work
right so the great thing about training
our model end to end is we should just
be able to pass the map in as an input
uh and since the model is trying to
predict where a human would
drive and the map has a lot of useful
information about where they the human
is going to drive uh the model should
just figure this out it should learn to
use the map figure out where you're
going to go when to take exits when to
make turns and generally do whatever
Maneuvers are necessary to follow the
route and get you to your
destination so this is what we built and
it works pretty well uh so I'm going to
talk a bit today about how all of this
works all the little details that make
it work better and all of the work we've
done to validate this feature and get it
ready to ship for open pilot
094 so I'll start with how it
works uh the first thing we're going to
need if we want to build this is a good
map
so fortunately
there's a lot of really good open source
tooling we can take advantage of here uh
open street maps overpass to serve up
sections of the osm graph balla for
routing mapbox GL to render the maps all
of these tools have been really useful
in building
this so uh we need
Maps uh we train our driving models on a
large data set of 60c video clips so
we're going to need maps for all of
those video clips and again the good
news is open pilot already has
navigation the comma 3 launched with
built-in nav using the mapbox GL native
library and so we can just use this same
library in our data center and we can
render as many Maps as we
want uh MOG jail is pretty nice you give
it a lat a latitude longitude coordinate
you give it a route and it will render a
map for you so you can see this at work
here in open pilot and we're going to
reuse this same
system these are the maps we're going to
draw uh they're intentionally styled to
be very Bare Bones we just draw the road
in white the route to follow in Gray uh
and we just draw these
as uh 256x 256 pixel images 2 pixels per
meter so this is half a kilometer on
each side and uh these maps are nice and
simple and easy to reason
about so we want to render a lot of
these maps and like I said we need two
things we need the latitude longitude
for each map and we need a
route so
the latitude longitude is easy enough
the comma 3 has a built-in GPS so we can
just get the GPS coordinates from that
the route is a little bit trickier
so you can see here a visualization of a
little chunk of the open street maps
graph the Junctions are marked in blue
and we have some GPS measurements from a
comma 3 uh marked in green with the x's
and you can see here uh that the GPS
measurements don't line up exactly with
the road so uh they can be shifted a
little bit they can be noisy uh for lots
of reasons the GPS measurements uh may
not line up exactly with the uh open
street maps graph so we need to fix this
to get a route uh what we want to do is
take a list of all of the GPS
measurements from one of these video
clips and we want to figure out which
roads were actually driven on in that
video clip we want to match these GPS
points up with your clip uh to the osm
graph and then we want to snap those GPS
points to the right rows so fortunately
we do not have to do this ourselves uh
this is somewhat complicated to
implement um but there's lots of
services that'll do it uh mapbox has an
API for it uh but there's also an open
source routing engine called Valla that
does exactly this this is called map
matching so you give it a list of these
GPS
points and it turns it into a proper
route marked in red snapping all of the
points to the graph and giving you the
exact route that you
drove so this is exactly what we want
we've got our lat long coordinates we've
got our route and now we can draw our
Maps so now that we have our Maps uh we
just need to feed them into the driving
model
somehow the problem is uh on their own
the raw maps are 256x 256 pixels so
that's like 65,000 numbers that's way
too big uh so we can't feed these
directly into the model
uh we're going to have to squish them
down somehow to make them a little bit
easier to work
with so how are we going to do
this
well we already do this for the camera
images uh those have the exact same
problem so we have a neural network
running on the comma 3 that takes in a
frame from the
cameras and compresses it down into a
vector of numbers this is called a
feature vector and this Vector should
represent all of the details of the
scene that are relevant for driving uh
so this is about 2,000 numbers for every
frame of the video and these get passed
into the driving model so we want to do
something similar for the map model uh
we want to train some kind of neural
network that's going to take in the map
it's going to compress it down into a
vector that has all the information the
driving model needs and then we'll pass
that to the driving
model so the way we're going to train
this map model is as what's called an
auto
encoder so what this
means is that the neural network is
going to have two parts an encoder and a
decoder
so we're going to feed these maps that
we render into the encoder and the
encoder is going to squish these Maps
down into this little feature Vector of
a couple hundred numbers and then the
decoder is going to take those numbers
and try to get back to the original
image it's going to decompress it and
try to get as close as possible to what
we originally put
in and if we train this all
correctly this feature vector should be
a complete representation of the full
image it should have all of the details
of the map that the driving model needs
to know
about so we train this thing and then uh
we can just throw away the decoder we
don't need that we just need the encoder
the encoder gives us some features and
we just feed those features into the
driving model so now we've got our nice
squish down format we can generate these
map
features
and you can kind of see here uh what the
autoencoder is doing so on the left we
can see the original maps that we render
with mapbox GL and then on the right you
can see these Maps after being squished
and then decompressed by the neural
network you can see a little bit of
detail is lost it's not a perfect
reconstruction but it does a pretty good
job at capturing all the highle details
and uh all of the information about the
map that's necessary for the driving
model to figure out where to
go so now we've got our Maps we've got
our map
features and all that's left to do is
hook this thing up to our simulator that
Harold talked
about train a model with it and cross
our fingers then that we did everything
right and this will just work so we do
this
and it works pretty
well so you can see here these are some
videos from our Simulator the model's
predicted path is in Orange and the real
path driven by the human is in blue so
you can see as the model gets close to
the exits uh its prediction moves over
the model uh switches its trajectory to
take the exit and follow the route just
like it's supposed to so this is great
uh we can do the same thing for turns
you see here uh the model does a pretty
good job as it gets close to the turn it
adjusts its prediction so that it's
going to try to follow the
route so this is fantastic we have a
driving model that's going to try to
follow the route that we give it from
the map uh and now we just have to run
this on the comma
3 so fortunately this part isn't isn't
too
complicated um we're going to add a few
new processes to open pilot that'll let
us do all of this stuff uh so we'll add
a process called MSD and a process
called nav Model D uh MSD is going to
render our maps for us using mapbox GL
native and Model D is going to take
those Maps run them through our encoder
and get our map features out and then we
just need to make a little change to
Model D which runs the main driving
model we'll just make a change so it
takes in those map features from nav
Model D it passes them into the driving
model as a new input and then everything
else works just like
before so we do all of this we put it on
a branch
and it works uh you can see uh open
pilot is taking an exit here following
the route on the
right and uh if we've done everything
right uh this all just works it works
pretty
well so uh to to give you a sense of
perspective this is roughly where things
stood for the Taco Bell video at the end
of last year uh so we've been working a
lot since then to get this ready to ship
it always seems to take longer to
actually get things deployed and test
all of the edge cases than it did to
build it in the first place
so I I'll talk a little now about
exactly uh what it took to ship and
specifically some of the details uh that
you have to get right to make this all
work better and uh some uh some details
that uncovered some
bugs
so one obvious problem that you run into
right away when you're building this
stuff is that uh if you look at Google
Maps or Bing Maps or any of these online
maps and you just pan up and down you'll
see that the scale at the bottom right
of the map is
changing uh it changes from uh 500 miles
in the middle of the US all the way down
to 200 miles for the same length uh at
the uh Northern end of
Canada uh and the reason this
happens is because the Earth is a sphere
and maps are rectangular and so you have
to take a spherical globe and somehow
project it onto a rectangular map and
you can't do that perfectly you have to
make some compromises so the way that uh
most Maps these days
do this is with something called a
Mercator Projection so the Mercator
Projection keeps these nice straight
latitude and longitude lines but the
problem with this is that the areas near
the North and South Pole get way blown
up
um so you can see this happening here
and for humans this isn't really that
big of a
problem um but for a driving model this
is a little bit inconvenient because
this model is going to use the map to
predict in 3D space where it's going to
drive so without any extra information
the model doesn't know if it's making a
turn in 200 M or 500 M because the the
scale of the map could be totally
different so we need to take care of
this uh it's not too difficult we can
just dynamically adjust the zoom level
of the map to get a constant scale
so like I said before we're going to
render our maps at a scale of half a
kilometer on each side and we'll change
the zoom level as necessary to make that
happen another problem we run into is
that well we did all of this work to
make sure that our routes were accurate
to the roads that were actually driven
in each video clip but we actually did
too good a job and uh so the problem is
that sometimes when you're driving a
with your comma 3 uh you maybe miss a
turn maybe you miss an exit uh or
sometimes you just don't want to follow
the nav instructions maybe uh you think
mapbox is telling you to do the wrong
thing and so you just do something else
um and the problem here is that be with
the way we've trained this model so far
it's basically never seen a wrong turn
before so the model is going to get
super confused if you miss an exit uh it
might try to take an uncommitted Lane
change or it might try to break in the
middle of the highway all of these
things are really bad so we can't have
this we got to fix
it um so there's a couple different
things that you can try that we've tried
uh but what seems to work pretty well is
we can uh generate these artificial
routes that essentially have wrong turns
in them we can uh take the open street
maps graph we already know exactly what
route was driven in red uh and so we can
just pick one of the Junctions in the
video go off in a different direction
and then do a random walk of the graph
from there to generate these artificial
routes and we can train on a small
percentage of these to make the model
more
robust so there is a bit of a trade-off
here
this is a delicate balancing act because
if you train on too many of these the
model will learn that sometimes it
shouldn't follow the route and so it
won't be as diligent about doing the
right thing and trying to follow the
route when it can but if you don't train
on enough the model won't be robust and
it can have bad behavior so you have to
balance these two things out and we
found that uh training on roughly 5 to
10% fake routes uh maintains a good
compromise between making the model
robust while also not harming its
performance at taking exits and
turns so now we have our model we've
fixed some bugs and the last thing we
have to do to get it ready to ship is
write an a ton of tests we want to
validate this behavior in all of the
cases we can think of in a bunch of edge
cases and we want to know exactly what
these models are going to do when we
deploy
them so like G was
saying we have a saying at
comma that goes no testing in
cars and the reason for this is uh
especially for
research um even though what we
ultimately care about is that the model
drives the car
well we don't want to test our models uh
by putting them on an open pilot branch
and seeing what happens this is way too
slow uh if we uh if we have a model that
we think maybe will be good we don't
really know so we put it on an open
pilot Branch we let some people drive on
it we drive on it ourselves We Gather a
sample of data and then maybe it turns
out our model had a subtle bug in it and
now we've just wasted days or even weeks
waiting for this data to come back so we
can evaluate so this is a huge waste of
time uh and so our rule because of this
is no testing in cars um instead we try
to write as many offline tests as
possible so before we ever put this on
an open pilot Branch we want to have a
pretty good idea of how it's going to
behave when we do it
so these offline tests can take a lot of
different forms we can test by running
the model on real driving data and
seeing what it does we can test the
model in our simulator we can test them
in more traditional simulators like
Carla or GTA uh we can run a bunch of
different tests uh in different cases
and see exactly how this thing is going
to perform so what should we test for
well there's a few obvious ones uh we
want to make sure that the model takes
exits when the route says to take the
exit so we can test that in our
simulator I showed some videos from that
exact test earlier um we want to make
sure that the model doesn't take exits
when it's not supposed to we want to
make sure it takes turns when it's
supposed to doesn't take turns when it's
not supposed to
uh we want to make sure the model
doesn't misbehave if the route is
incorrect if you miss a turn or an exit
if the GPS location is a little bit
wrong and it snaps you to the wrong road
we want to make sure uh that it doesn't
misbehave if the bearing is inaccurate
so the map is like pointed the wrong way
a little bit we want to make sure uh
that the driving behavior doesn't
regress at all all when you're not using
nav uh because we're just shipping nav
in experimental mode right now and so if
you're driving in chill mode we really
want to make sure that behavior doesn't
regress in any way and if anything it
gets a little bit
better uh and we want to make sure that
the behavior of these nav models is the
same when we run them on the comma 3 uh
compared to when we run them offline so
we do all these tests plus a bunch more
more tests uh we've spent the last few
months just writing test test tests and
uh validating all the behavior we can
think of lots of different edge cases
and making sure that these models behave
exactly the way we
want so we've uh finally written uh
enough tests uh
to uh give us the the confidence to ship
this for open pilot
094 and you can try it out today it's
available in experimental mode and uh as
we keep working on navigation and we
drive the reliability up to 100 we hope
to ship it in chill mode as well so
it'll be available for everyone that
uses open pilot with
prime
so that's my
talk
we give time for a few
questions all
right Jason over
here I wonder if you could talk for a
second about how speed limits figure in
that you get from the maps I know that
you want the endend model to function as
independently as possible you don't want
to depend on map data but do you foresee
a future and using that as an imp put
more consistently especially when not
navigating I'm given to understand the
mapbox API doesn't really lend itself to
giving you speed limits uh if you're not
navigating but I I think there was some
sort of way around that with the Ser I
don't know much about it and I guess my
question is really long term do you see
that as an input or a hint into the into
the overall
driving long term I think probably yes
um right now there's uh a lot of
situations uh where the longitudinal
Behavior still isn't perfect that has
nothing to do with speed limits so we
want to fix that first like if you're
driving on a highway and the model is
only driving 55 you shouldn't need speed
limits to know it's driving the wrong
speed so we want to fix that behavior
first um and uh like you say mapbox's
API is not super conducive to uh giving
the speed limit there's a lot of areas
where speed limits just aren't even
available um but long term I think
there's a lot of cases where you can't
really tell how fast you're supposed to
be driving without the speed limit so I
imagine we will eventually need to add
this as a model input
yes all right got a question in the
back along the same lines any um thought
on future input for real-time traffic
that would then allow for you know
changing of
routes um sort of so mapbox already
takes care of this uh it has its own uh
traffic tracking system and so uh
ideally the routes that go into the map
in the first place should already take
into account the traffic now mapbox's uh
traffic uh system is is not perfect uh
and it does sometimes uh over or
underestimate the amount of traffic in a
particular area um but hopefully this is
something that'll improve over
time uh hey have you put in any thought
into like text based navigation using
like I can see from your navigation that
you have like take the next exit for
example like do you guys use that as
inputs ever yes
so we have a branch right now that uh
hopefully will ship for open pilot 095
after some more testing and validation
uh that puts not just the map but also
the nav instructions into the model uh
and we find that this uh reduces the um
the failure rate of the model to to take
exits and turns even further so yes this
will probably probably be coming to a
comma 3 near you sometime
soon um thank you for your presentation
um I just have a question have you ever
consider using Vector Maps instead of
this render V Maps uh could you say
again have you ever consider using
Vector Maps instead of the render B Maps
ah
um yes so we do get the vector tiles
back from mapbox directly and so we
could consider using those um and there
are some advantages to that in that uh
there's there can be a bit of ambiguity
just with the rasterized maps uh in some
cases where you have a lot of roads
really close together so this is
something we may look into in the future
uh mapbox's tools kind of make it
easiest to just render a map normally uh
and then you can just use a normal conf
net efficient net to uh to process this
and compress it with Vector based Maps
maybe you'd want something more like uh
like a graph neurl net uh and these are
a little bit more complex and so we
wanted to start with the simplest thing
that could possibly work U but maybe
this is something we'll look at in the
future uh I used this uh navigation uh
feature like uh uh a few days ago and I
found a a problem when I uh used it that
it works for the first maybe a minute
and then it just quit by itself any
explanation on that I'm not sure we'll
have to look at your logs maybe this I
can uh I can get your information
afterwards and we'll see if something
weird is going on all right another
another question is um uh have you ever
thought about using the map for for the
uh just uh to the very original input
maybe map it to the perspective view
together with the with the with the
image oh yeah
um so the autoencoder we train uh
actually also predicts the trajectory
that you're going to
take um in addition to uh just
compressing the map it tries to uh
predict in 3D space where you're going
to drive uh and so we
could uh potentially use some of these
additional outputs uh to show extra
information on the driving view uh but
this is not a super high priority right
now this is something maybe we look at
in the future as you know the main
functionality of nav gets better and we
have time to think about some cool
additional
features for the map encoder is it
trained primarily on a reconstruction
loss or is it trained jointly with the
driving model so it can more
intelligently like select which features
are
important uh it's trained separately uh
we do this for a couple reasons uh one
because uh we want to run this model on
the DSP instead of on the
GPU um and so the map model has to be
quantized and so we train it uh with the
quantization OFW hooks in pytorch uh
without this it it doesn't really work
properly uh and so in in that sense it
sort of has to be uh uh trained as a
separate
model um
and then also training full comets with
the SIM is a lot of compute and so it's
a little bit easier to split it up uh we
have looked at doing it jointly as well
uh either with the vision model or with
the policy model um but the autoencoder
does do a pretty good job of capturing
the all of the details of the map and so
for now at least uh we think that it is
probably doing just fine uh to just
compress it to this feature vector and
then have the driving model process it
from there I've got one last question
here so um when you started uh the talk
you talked about how you you know at
first wanted to just feed the video data
of the of the directions into the model
and hopefully it would work and then it
and it worked pretty well but I would
think that there's like kind of an
inherent conflict between the original
video input and the the map like
directions input are is does the model
just synthesize those two like magically
or do you have to really like weight
them or like try of give inputs on which
input is the you know the primary to
follow or how does that work in the
model you're talking about uh resolving
like the video coming in with the map
yeah the idea that the video tells you
know one set of sort of inputs on how
you should direct the you know the
driving output versus the map now
suddenly might say you know actually I
want you to go this way so like I kind
of feel like the two different pieces of
information might give different outputs
how do you how do you train the model to
know which to follow in which in what
circumstances sure um so this is exactly
part of the reason that we train on uh
some percentage of these fake routes uh
we want to make the model robust to maps
that either tell it to do the wrong
thing or don't make any sense uh and so
we always want to trust the video
because the video is always right uh or
at least it better be uh whereas the map
could be wrong for any number of reasons
um and so we uh do a bunch of stuff when
we train these models to try to make
them more robust to failures of the map
uh if the route suddenly goes out or GPS
suddenly goes out or any number of uh
things that might happen road closures
uh taking a wrong turn all this stuff so
we really wanted to trust the video more
than the map
all right thank you so much
Mitchell
all right hey everyone
my name is Mitchell I'm a machine
learning engineer at comma and I'm going
to talk a bit today about all the work
we've done to ship navigate on open
pilot
so this is a project we've been working
on for a while
I think I started on this late last year
and then we showed off an initial
version of navigate in our driving to
Taco Bell video at the end of last year
uh the idea
is
well the driving model already takes the
videos from the two cameras on the comma
3 as inputs so
we're just going to add a third input
that's a video of Google Maps and this
should just work right
so the great thing about training our
model end to end is we should just be
able to pass the map in as an input
and since the model is trying to predict
where a human would drive
and the map has a lot of useful
information about where the the human is
going to drive
the model should just figure this out it
should learn to use the map figure out
where you're going to go when to take
exits when to make turns and generally
do whatever Maneuvers are necessary to
follow the route and get you to your
destination
so
this is what we built and it works
pretty well so I'm going to talk a bit
today about how all of this works all
the little details that make it work
better and all of the work we've done to
validate this feature and get it ready
to ship for openpilot094
so I'll start with how it works
the first thing we're going to need if
we want to build this is a good map
so
fortunately there's a lot of really good
open source tooling we can take
advantage of here
uh open street maps overpass to serve up
sections of the osm graph Valhalla for
routing mapbox GL to render the maps all
of these tools have been really useful
in building this
so uh we need Maps
uh we train our driving models on a
large data set of 60 second video clips
so we're going to need maps for all of
those video clips
and again the good news is open pilot
already has navigation the comma 3
launched with built-in nav using the
mapbox geonative library
and so we can just use this same library
in our data center and we can render as
many Maps as we want
is pretty nice you give it a lot
latitude longitude coordinate you give
it a route and it will render a map for
you so you can see this at work here in
open pilot and we're going to reuse this
same system
these are the maps we're going to draw
they're intentionally styled to be very
Bare Bones we just draw the road in
white the route to follow in Gray
and we just draw these as uh 256 by 256
pixel images
two pixels per meter so this is a half a
kilometer on each side
and uh these maps are nice and simple
and easy to reason about
so we want to render a lot of these Maps
and like I said we need two things we
need the latitude longitude for each map
and we need a route
so the latitude longitude is easy enough
the comma 3 has a built-in GPS so we can
just get the GPS coordinates from that
the route is a little bit trickier
so
you can see here a visualization of a
little chunk of the openstreetmaps graph
the Junctions are marked in blue and we
have some GPS measurements from a comma
three
marked in green with the X's
and you can see here that the GPS
measurements don't line up exactly with
the road
so they can be shifted a little bit they
can be noisy for lots of reasons the GPS
measurements may not line up exactly
with the openstreetmaps graph so we need
to fix this to get a route what we want
to do is take a list of all of the GPS
measurements from one of these video
clips and we want to figure out which
roads were actually driven on in that
video clip we want to match these GPS
points up with your clip to the osm
graph and then we want to snap those GPS
points to the right roads
so fortunately we do not have to do this
ourselves this is somewhat complicated
to implement
but there's lots of services that'll do
it mapbox has an API for it but there's
also an open source routing engine
called Valhalla that does exactly this
this is called map matching
so you give it a list of these GPS
points
and it turns it into a proper route
marked in red snapping all of the points
to the graph and giving you the exact
route that you drove
so this is exactly what we want we've
got our long coordinates we've got our
route and now we can draw our Maps
so now that we have our Maps
we just need to feed them into the
driving model somehow
the problem is uh on their own the raw
maps are 256 by 256 pixels so that's
like 65 000 numbers that's way too big
so we can't feed these directly into the
model
uh we're gonna have to squish them down
somehow to make them a little bit easier
to work with
so how are we going to do this
well
we already do this for the camera images
those have the exact same problem so we
have a neural network running on the
comma 3 that takes in a frame
from the cameras
and compresses it down into a vector of
numbers this is called a feature vector
and this Vector should represent all of
the details of the scene that are
relevant for driving
so this is about 2 000 numbers for every
frame of the video and these get passed
into the driving model so we want to do
something similar for the map model
uh we want to train some kind of neural
network that's going to take in the map
it's going to compress it down into a
vector that has all the information the
driving model needs
and then we'll pass that to the driving
model
so
the way we're going to train this map
model is as what's called an auto
encoder
so what this means
is that the neural network is going to
have two parts an encoder and a decoder
so we're going to feed these maps that
we render into the encoder and the
encoder is going to squish these Maps
down into this little feature Vector of
a couple hundred numbers and then the
decoder is going to take those numbers
and try to get back to the original
image it's going to decompress it and
try to get as close as possible to what
we originally put in
and if we train this all correctly
this feature vector
should be a complete representation of
the full image it should have all of the
details of the map that the driving
model needs to know about
so
we train this thing
and then we can just throw away the
decoder we don't need that we just need
the encoder
the encoder gives us some features and
we just feed those features into the
driving model
so now we've got our nice squish down
format we can generate these map
features
and you can kind of see here what the
auto encoder is doing so on the left we
can see the original maps that we render
with mapbox GL
and then on the right you can see these
Maps after being squished and then
decompressed by the neural network
you can see a little bit of detail is
lost it's not a perfect reconstruction
but it does a pretty good job at
capturing all the high level details and
uh all of the information about the map
that's necessary for the driving model
to figure out where to go
so now we've got our Maps we've got our
map features
and all that's left to do
is hook this thing up to our simulator
that Harold talked about
train a model with it
and cross our fingers that we did
everything right and this will just work
so we do this
and
it works pretty well
so you can see here these are some
videos from our Simulator the model's
predicted path is in Orange and the real
path driven by the human is in blue so
you can see as the model gets close to
the exits uh its prediction moves over
the model switches its trajectory to
take the exit and follow the route just
like it's supposed to so this is great
we can do the same thing for turns
you see here the model does a pretty
good job as it gets close to the turn it
adjusts its prediction so that it's
going to try to follow the route
so this is fantastic we have
a driving model that's going to try to
follow the route that we give it from
the map
and now we just have to run this on the
comma 3.
so fortunately this part isn't isn't too
complicated
um we're going to add a few new
processes to open pilot that'll let us
do all of this stuff
so we'll add a process called Maps D at
a process called nav Model D Maps D is
going to render our maps for us using
mapbox GL native
and nav Model D is going to take those
Maps run them through our encoder and
get our map features out
and then we just need to make a little
change to Model D which runs the main
driving model
we'll just make a change so it takes in
those map features from nav Model D it
passes them into the driving model as a
new input
and then everything else works just like
before
so we do all of this we put it on a
branch
and it works you can see openpilot is
taking an exit here following the route
on the right
and uh
if we've done everything right this all
just works it works pretty well
so uh to to give you a sense of
perspective this is roughly where things
stood for the Taco Bell video
at the end of last year
so we've been working a lot since then
to get this ready to ship it always
seems to take longer to actually get
things deployed and test all of the edge
cases than it did to build it in the
first place
so
I'll talk a little now about exactly uh
what it took to ship and specifically
some of the details uh that you have to
get right to make this all work better
and uh some some details that uncovered
some bugs
so
one obvious problem that you run into
right away when you're building this
stuff
is that
uh if you look at Google Maps or Bing
Maps or any of these online maps and you
just pan up and down you'll see that the
scale at the bottom right of the map is
changing
uh it changes from uh 500 miles in the
middle of the U.S all the way down to
200 miles for the same length at the
Northern end of Canada
uh and the reason this happens
is because the Earth is a sphere and
maps are rectangular and so you have to
take a spherical globe and somehow
project it onto a rectangular map and
you can't do that perfectly you have to
make some compromises so the way that uh
most Maps these days do this is with
something called a Mercator Projection
so the Mercator Projection keeps these
nice straight latitude and longitude
lines but the problem with this is that
the areas near the North and South Pole
get way blown up
um
so you can see this happening here and
for humans this isn't really that big of
a problem
but for a driving model this is a little
bit inconvenient because this model is
going to use the map to predict in 3D
space where it's going to drive
so without any extra information the
model doesn't know if it's making a turn
in 200 meters or 500 meters because this
the scale of the map could be totally
different
so we need to take care of this uh it's
not too difficult we can just
dynamically adjust the zoom level of the
map to get a constant scale so like I
said before we're going to render our
maps at a scale of half a kilometer on
each side and we'll change the zoom
level as necessary to make that happen
another problem we run into is that
well we did all of this work to make
sure that our routes were accurate to
the road that were actually driven in
each video clip but we actually did too
good a job and so the problem is that
sometimes when you're driving with your
commentary uh you maybe miss a turn
maybe you missed an exit or sometimes
you just don't want to follow the nav
instructions maybe you think mapbox is
telling you to do the wrong thing and so
you just do something else
and the problem here is that with the
way we've trained this model so far it's
basically never seen a wrong turn before
so the model is going to get super
confused if you miss an exit uh it might
try to take an uncommitted Lane change
or it might try to break in the middle
of the highway all of these things are
really bad so we can't have this we got
to fix it
um so there's a couple different things
that you can try that we've tried uh but
what seems to work pretty well is we can
uh generate these artificial routes that
essentially have wrong turns in them we
can uh take the open street maps graph
we already know exactly what route was
driven in red
and so we can just pick one of the
Junctions in the video
go off in a different direction and then
do a random walk of the graph from there
to generate these artificial routes
and we can train on a small percentage
of these to make the model more robust
so there is a bit of a trade-off here
this is a delicate balancing act because
if you train on too many of these the
model will learn that sometimes it
shouldn't follow the route and so it
won't be as diligent about doing the
right thing and trying to follow the
route when it can
but if you don't train on enough the
model won't be robust and it can have
bad behavior so you have to balance
these two things out and we've found
that uh training on roughly five to ten
percent fake routes uh maintains a good
compromise between making the model
robust while also not harming its
performance at taking exits and turns
so now we
have our model we've fixed some bugs and
the last thing we have to do to get it
ready to ship is write and a ton of
tests we want to validate this behavior
in all of the cases we can think of in a
bunch of edge cases and we want to know
exactly what these models are going to
do when we deploy them
so like Good Deed was saying
we have a saying at comma
that goes no testing in cars
and the reason for this is especially
for research
um
even though what we ultimately care
about is that the model drives the car
well
we don't want to test our models by
putting them on an open pilot branch and
seeing what happens this is way too slow
uh
if we if we have a model that we think
maybe we'll be good we don't really know
so we put it on an open pilot Branch we
let some people drive on it we drive on
it ourselves We Gather a sample of data
and then maybe it turns out our model
had a subtle bug in it and now we've
just wasted days or even weeks waiting
for this data to come back so we can
evaluate so this is a huge waste of time
and so our rule because of this is no
testing in cars
instead we try to write as many offline
tests as possible so before we ever put
this on an open pilot Branch we want to
have a pretty good idea of how it's
going to behave when we do it
so these offline tests can take a lot of
different forms
we can test by running the model on real
driving data and seeing what it does we
can test the model in our simulator we
can test them in more traditional
simulators like Carla or GTA we can run
a bunch of different tests in different
cases and see exactly how this thing is
going to perform so
what should we test for
well there's a few obvious ones we want
to make sure that the model takes exits
when the route says to take the exit so
we can test that in our simulator I
showed some videos from that exact test
earlier
um we want to make sure that the
model doesn't take exits when it's not
supposed to
we want to make sure it takes turns when
it's supposed to doesn't take turns when
it's not supposed to we want to make
sure the model doesn't misbehave if the
route is incorrect if you miss a turn or
an exit if the GPS location is a little
bit wrong and it snaps you to the wrong
road we want to make sure
that it doesn't misbehave if the bearing
is inaccurate so the map is like pointed
the wrong way a little bit
we want to make sure
that the driving behavior doesn't
regress at all when you're not using nav
because we're just shipping nav in
experimental mode right now and so if
you're driving in chill mode we really
want to make sure that behavior doesn't
regress in any way and if anything it
gets a little bit better
uh and we want to make sure that
the behavior of these nav models is the
same when we run them on the comma 3.
compared to when we run them offline
so we do all these tests plus a bunch
more tests we've spent the last few
months just writing test test tests and
validating all the behavior we can think
of lots of different edge cases and
making sure that these models behave
exactly the way we want
so we've
finally written enough tests to
give us the the confidence to ship this
for
openpilot094 and you can try it out
today it's available in experimental
mode and as we keep working on
navigation and we drive the reliability
up to 100 we hope to ship it in chill
mode as well so it'll be available for
everyone that uses open pilot with Prime
so
that's my talk
oh I'm gonna give time for a few
questions
all right
Jason over here
and over I wonder if you could talk for
a second about how speed limits figure
in that you get from the maps I know
that you want the end-to-end model to
function as independently as possible
you don't want to depend on map data but
do you foresee a future and using that
as an input more consistently especially
when not navigating I'm given to
understand the map box API doesn't
really lend itself to giving you speed
limits uh if you're not navigating but I
think there was some sort of way around
that with the real house or I don't know
much about it and I guess my question is
really
long term do you see that as an input or
a hint into the into the overall driving
long term I think probably yes
um
right now there's a lot of situations
where the
longitudinal Behavior still isn't
perfect that has nothing to do with
speed limits so we want to fix that
first like if you're driving on a
highway and the model is only driving 55
you shouldn't need speed limits to know
it's driving the wrong speeds so we want
to fix that behavior first
um and uh like you say map boxes API is
not super conducive to uh giving you the
speed limits there's a lot of areas
where speed limits just aren't even
available
but long term I think there's a lot of
cases where you can't really tell how
fast you're supposed to be driving
without the speed limit so I imagine we
will eventually need to add this as a
model input yes
all right got a question in the back
along the same lines any
um thoughts on future input for
real-time traffic that would then allow
for you know changing of routes
um
sort of so mapbox already takes care of
this it has its own uh traffic tracking
system
and so ideally the routes that go into
the map in the first place should
already take into account the traffic
now map boxes uh traffic uh system is is
not perfect uh and it does sometimes uh
over underestimate the amount of traffic
in a particular area but hopefully this
is something that'll improve over time
uh hey have you put in any thought into
like text-based navigation using like I
can see from your navigation that you
have like take the next exit for example
like do you guys use that as inputs ever
yes so
we have a branch right now that uh
hopefully will ship for open pilot 095
after some more testing and validation
that puts not just the map but also the
nav instructions into the model uh and
we find that this uh reduces the uh the
failure rate of the model to to take
exits and turns even further so yes this
will probably be coming to a comma 3
near you sometime soon
oh thank you for your presentation
um I just have a question have you ever
considered using Vector Maps instead of
this render ba Maps could you say again
have you ever considered using Vector
Maps instead of the render be way map ah
um
yes so we do get the vector tiles back
from mapbox directly and so we could
consider using those and there are some
advantages to that in that uh there's
there can be a bit of ambiguity just
with the rasterized maps in some cases
where you have a lot of roads really
close together so this is something we
may look into in the future
map boxes tools kind of make it easiest
to just render a map normally and then
you can just use a normal confnet
efficient net to uh to process this and
compress it with Vector based Maps maybe
you'd want something more like like a
graph neural net and these are a little
bit more complex and so we wanted to
start with the simplest thing that could
possibly work but maybe this is
something we'll look at in the future
uh I use this uh navigation feature like
uh
a few days ago
and I found a problem when I uh used it
that it works for the first maybe a
minute and then it's just a quit by
itself uh any explanation on that I'm
not sure we'll have to look at your logs
and maybe this I can I can get your
information afterwards and we'll see if
something weird is going on all right
another another question is
um uh have you ever thought about using
the map for for the uh just the uh to
the very original input maybe map it to
the perspective view together with uh
with the with the image oh yeah
um
so the auto encoder we trained uh
actually also predicts the trajectory
that you're going to take
um
in addition to uh just compressing the
map it tries to predict in 3D space
where you're going to drive and so
we could
uh potentially use some of these
additional outputs to show extra
information on the driving view but this
is not a super high priority right now
this is something maybe we look at in
the future as you know the main
functionality of nav gets better and we
have time to think about some cool
additional features
for the map encoder is it trained
primarily on a reconstruction loss or is
it trained jointly with the driving
model so it can more intelligently like
select which features I report to
uh it's trained separately we do this
for a couple reasons uh one because
uh we want to run this model on the DSP
instead of on the GPU
and so the map model has to be quantized
and so we train it uh with the
quantization aware hooks in pytorch
without this it doesn't really work
properly and so in that sense it sort of
has to be uh
trained as a separate model
and then also training full confidence
with the SIM is a lot of compute and so
it's a little bit easier to split it up
we have looked at doing it jointly as
well either with the vision model or
with the policy model
but the autoencoder does do a pretty
good job of capturing the all of the
details of the map and so for now at
least we think that it is probably doing
just fine to just compress it to this
feature vector and then have the driving
model process it from there got one last
question here
so uh when you started uh the talk you
talked about how you you know at first
wanted to just feed the video data of
the of the directions into the model and
hopefully it would work and then it
worked pretty well but I would think
that there's like kind of an inherent
conflict between the original video
input and the the map like directions
input are does the model just synthesize
those two like magically or do you have
to really like weight them or like try
to give inputs on which input is the you
know the the primary to follow or how
does that work in the model
you're talking about uh resolving like
the video coming in with the map yeah
the idea that the video tells you know
one set of sort of inputs on how you
should direct the you know the deriving
output versus the map now suddenly you
might say you know actually I want to go
this way so I kind of feel like the two
different pieces of information might
give different outputs how do you how do
you train the model to know which to
follow and which in what circumstances
sure
um so this is exactly part of the reason
that we train on uh some percentage of
these fake routes we want to make the
model robust to maps that either tell it
to do the wrong thing or don't make any
sense uh and so when we always want to
trust the video because the video is
always right or at least it better be
uh whereas the map could be wrong for
any number of reasons
um and so we uh do a bunch of stuff when
we train these models to try to make
them more robust to failures of the map
uh if the route suddenly goes out or GPS
suddenly goes out or any number of uh
things that might happen road closures
uh taking a wrong turn all this stuff so
we really wanted to trust the video more
than the map
all right thank you so much Mitchell
[Applause]
okay your lives your life all right
you office make sure it's shared on
there we go
alright alright people talking got like
20 people
okay so let's draft in your office and
around here in San Diego guys some stuff
to feel like putting the proper place
but operation City a fancy hide all the
secrets pretend to be working hard work
in there yeah I work in there yeah I
think yeah it's not the simulation for
Nick Castellanos well no exactly like
not yet but so gaming room we have a
game where a bunch of you are going to
be testing the code in loops
infrastructure team
down there so three people Craig Craig
is probably working on thing that we're
gonna show later
yeah she's our new power center well so
these are the research team she's
actually doing research on the videogame
sure she's probably like the best of
them actuator officer of the company we
do have promoted to officer hey sailor
oh yeah Eddie your other screen this
have two computers three monitors and
then this is all Windows right now but
if i press this hdmi switch boom Linux
and windows one Mouse one keyboard goes
back and forth shout-out to synergy
synergy don't worry cut off cut off the
words
all right so now we go to the real stuff
you can hear it key here we can you eat
so we're gonna have God we cannot focus
ID because very loud
[Music]
Pickard out here
somebody understands above I obey now
needs
siddhappa
this box is empty there if they write
one for the left one is actually to
speak they speak something
and so the eland
Rize Fox down there
so yes
there yes
some was confined in a corner
not all my parameter editor to turn of
the printer
and the thing
they're so steamy Zach
how many of us a 25
so yeah without the questions
let's see you back up to the cloud
yeah I mean like the data yes certainly
I did it out the car will be clarified
what's it all for
oh this computing it's processing it's
like mainly CPU and GPU with all the
training lock hello Cheryl how much
what's the drive size I think
what's the capacity of all the drives in
there by before one's out everything
that we're gonna stay here you know so
is the best room block has prehistoric
[Music]
okay so what can we say show off the
kitchen we didn't shut the kitchen now
there's the new kitchen
we can also talk about that coming
release of oven pilot for all the
previous users we finally found a good
way to have decent control it's not
gonna pimp on you anymore all the props
go to villain who actually is gonna use
like a completely different control sir
let's go to the IM di and some advanced
technique very better than PID it's
gonna work right
I've seen people starting to change the
EPS module please don't replace that
part of the EPS module done to the point
part that going to the PSO strongly not
recommended we came up with a good fix I
think so 5.12 you're gonna be happy with
if you have a Prius and use up a pilot
kitchen it's the new Nikola flavor
because it's Cola but without sugar or
artificial sweetener just essence it's
naturally essence and I wrote this to
work today he did I can't verify Andy do
you want to say hello disco peas just
grab the one that's just sitting there
cool any question yeah any questions off
fish anything let's see where do you
store the interns for now when I roll
thirsty space rooms yeah yeah figured
out who should be in 20 but but we do
have to garage we did show the big one
we do I like another small garage does
the new office cost more or less than
the SF house oh it costs more than I
suppose but it cost about like two times
less than the same office in the same
spot like equivalent equivalent spot in
downtown San Francisco
I mean thought bigger then then it's
it's twice the size of the of the house
who's funding all of this I mean you can
go on ranch base and see yeah yeah go
and catch these type comedy I usually
check those filings no no that's not
next model no torque issues then no
that's some different next on Honda no
no we were talking about we're talking
about the Prius
that's right drew you smile yeah we'll
come ever make their own car actually
it's a good question
so we I mean like we just we were making
fun of zoo explorer making their own car
and we had like a poster saying why we
don't make cars and showing the Zuke's
car so no we're never gonna make our own
car
where are we hiding George I don't know
are you see hiding but he's around
around is what's Greg driving Greg what
are you driving
what are you driving Greg your life you
have like how many people watch there 50
people alright what you're asking about
you this is for the simulation okay any
last questions yeah I mean I think
they're gonna do a periscope we can you
control it on the previews tomorrow I
think it's pretty good then so yeah oh
we do have hoodies somebody asked about
hoodies we do have goodies yeah we do
yeah on the shop
cool baseball caps ooh yeah yeah yeah no
it's that moment you're not the only one
Chris our three pan is needed for ct-6
they are you need three pendants yes
no mister we can open source on the
boards it's a lot of work honestly but
I'm super quiz isn't bad but if you want
to if you're an open pilot we're open
palette on the city chicks watch it
works right well you have to have access
to flex ready but it works really well
so if somebody wants to do the
experiment is doable we can open source
all day with the work that we did on the
board
mmm no office tours only periscope
office tours yeah yeah cool what can I
do if my Aeon storage is full and I
don't have access to Wi-Fi all right
CalFire off Larry but it is coming up I
go to Amber for ya it's gonna be like a
smart out of the leader that the least
like all data and allows you to keep
driving without stop logging which is I
mean it's what you wanted
it's not a hack it's Aria fix
yeah yeah that was a big problem for
quite a while plug ins versus Forbes so
lucky investor sparks what do you mean
why sure that means HD maps question
America HD maps I mean like again if not
we are using account rules that depends
on high accuracy localizations so we are
building things that depend on having an
eye accuracy like localization and
definition of cars paths in warframe so
we are using that now what what HTML are
I mean there is really no a unique
definition of them what are they like is
there a presentation of what like late
things like features like lane lines no
I don't think that's probably useful to
us what's very useful to us is
understanding in warframe what every car
has been like which is the part of each
car and yes of course we're doing that
is very useful for training our models
so what we do we do keep track awfully
nice to also train the model but we have
our own HD map so that serves the
purposes of training but our mothers
Lisbon
yeah and I mean we do an extensive using
our Ferber Street Map as well so we are
also considering like putting our own
layers in top of of a street map and I
need more features so that's like
another good way possibly of planning
defining HD maps but not the only one
yeah any plans on big model v2 yes yes I
mean the big bothered was like too big
there is definite plan for like a big
mid model meet mother is probably like
better big mother was just to be again
and it was unnecessary to be good so
Riccardo they say your voice makes me
want to buy whatever you're talking
about buy a t-shirt or a hoodie okay any
other questions before we leave anything
else you want to say Riccardo
I hope you enjoyed the new the new
office is like a bigger plane we're
gonna show you it again when everything
is like in Peten place like especially
like the hardware in the loop rome is
gonna be like a big array from literally
a closet that we have in there in the
house so there's gonna be a lot more
Young's running there and Stockholm is
gonna be clean so we're gonna show you
together yeah yeah okay all right bye
guys
all right
what UPS coppice I share it on Twitter
what up guys so we have an announcement
to make today
or for my 4th well will hide you for now
maybe uh - where do you want to be out
your desk can you introduce yourself to
the Skokie's so welcome to the new kalbi
we've moved the cabbie into here what -
secret prototype yeah I mean it's kind
of like kind of vaguely visible in the
okay we won't talk about it all the
sales numbers are you'll see all right
Toronto announced do you want to uh
introducing our new employee
let's go peace do you guys know what
this is no I don't know
so EPS 2019 huh call him the when moon
nope this is not the new ml guy nope
it's not Obama
oh yeah BG that's right oh I believe I
believe he goes by Nick now and he's
next to all of the beautiful fulfillment
stuff so when you buy something on shop
comment on AI yes we have stock and
we'll ship it out he is handsome you got
a compliment
yeah that's a first yeah so what we're
also doing today is the naming challenge
so do you want to introduce the naming
challenge yeah we got 3d printers today
all right installed today setup today so
we've named them
we have print emic print face Donald for
Donald Glover and this one's blank so we
needs best suggestions no peace come up
with the name for the printer nice or
traps to sort X M 100 it matches uh all
the others or tracks at 100 s say all of
names just get an industrial laser 3d
printer Y filament BS tweet me an
industrial laser 3d printer oh you get
love alright so guys yeah we do need to
be doing the name here for this printer
all 3d printer with the B that's a
pretty good meme that's a good that's a
good meme yeah I know about dole dippers
never name the printer chase okay we're
gonna we're gonna put a vote on slack
yes and we will honestly take your
advice so if you brigade the vote and
you want to name it North Korea that's
okay show for your vote she'll she'll
for your vote that's it that's all we
have to talk about on this Kofi we're
gonna get that on slack I'm gonna post
it on comma get your votes in pulp the
garage door e 11 millions all right all
right get those suggestions on slack
what products do we produce oh we go
through the products
so we produced Wow many promise oh this
is the new GPU computer by the way it's
GPU slave double zero you have to run
quiet Sh
no no no no this fan blows outside guys
no accord yet so these are our products
we have 64 gigabyte eons
I love the beaming we have 128 gig eons
oh wait no we don't those are out of
stock and we have midnight black eons we
have grey pandas in various states of
production we have Palace we don't
produce them here
pandas are made externally but you can
buy a panda at shop that common today I
for only $99 maybe even on Amazon soon
we're gonna pull a Kanye West oh you
know how Kanye said his music was only
gonna be on tidal um what are you up to
what are you doing just finish it
another prayers yeah print up some
shelves from a storage giraffes and gray
pandas and powers and debug boards this
maze is the common trademark infringing
space one day China will find out what
we're up to
we'll have to rename it yeah we use GPUs
in-house we don't use GPUs in the cloud
is karma a school project yes yes I hope
I get class credit
pen holy cannoli I'm not really a pen
student this girl who I'm madly in love
with and I broke into pen holy last year
but now she doesn't talk to me anymore
she got a real job and thinks I'm a bad
influence
it's too honest on the scobie's alright
honestly our you can only trust garbage
with this year we like a sure do you
sell your know-how no no I'm not gonna
sell out man I learned that I'm a punk
don't sell out can you ever talk
[Laughter]
you can apply give me a Java comma a I
why did we break up she got a job she
wanted to be a real functioning member
of society unlike me she thinks I'm a
bad influence when I talk about how
societies a scam but it is guys can you
be the floor sweeper we already hired
someone for that it's the Roomba um
common guys probably a scam probably I
decided I was honest with you guys on
once Kelpie no but like it Scott like
the thing is if it is a scam it's an
ethical scam because we're very
transparent with you maybe one day I'll
find out it was a scam and I'll be like
damn why do I work on a scam all those
years but uh yeah yeah yeah alright
alright scope is I get on that that 3d
printer naming oh how do you know he is
working at comma I think he starts in
July um you're too transparent no
company should have scopes okay all
right you know you got you are right no
more scopes this is the last one cares
man
that's the best thing about winning is
even better when you tell your opponents
what you're doing every step of the way
and still win name your printer Ford
Fusion that's true we won't have a ford
fusion anymore when moon I bought bit
Kinect and I lost money yes we're very
excited about Southtown joining us to
work on
this is here and we're not gonna tell
you what it is but there's a lot of them
in these boxes what I think way my
waiting is self-driving the race
unlikely I'm greeting over a bit connect
neither put a bra you guys ones or
attracts boxes so good chase has the
most votes I'd slack is there a vote one
vote can you vote for anything bud chase
Oh chase it I don't know if you could
vote for yourself Chase has one thumbs
down that's true that's that that Roy
more guy showed up on a horse to vote
for himself all right a maximum we use
vim we were trying to ship Emacs in the
next neo ass but it was too large so we
had to take it out you'll accomplish it
all right later guys
yeah yeah gentle ER did you subscribe
did you like and subscribe to our Paris
guys all my hair is particularly messy
today
oops copies alright so guys I should
have put not clickbait in the title so
everyone would know that it is clickbait
yeah chill periscope all right so it's
your it's your product you made it you
know your copyrighted you download
inside of a periscope just to follow
comment no it is a party um it is fake
news though there is no product it's not
a product Eddy pointed that out to me
but who knows what it is we're in the
kalbi right that's what products come
from Oh make sure you close all the
stuff for the actual secret right
definitely secret yeah it close the
secret all right guys
yeah you know it you know it
you guys are the front camera here's
some panda and various states of undress
official Subaru port today we're
officially launching with a common pedal
it's the pedal no no ref where where we
go check it out check out shit mark this
day forward absolutely alright so do we
have the files are they ready to go
pretty much there's some weird des
numbers you want to copy them into that
so to make the two folders make the
board in the case yeah this is a coma
pedal people here there's a j15 but no J
four five six seven eight nine ten
that's fine um we can update it later
okay does it actually work now yes the
comic pedal actually works now yeah well
and we've been driving into the correct
that is it or nearly this nice yeah we
have the correct connectors so this
connector we bought from Express and it
comes with all the pins you need also
it's like 20 bucks for five room both
sides we're gonna be printing the other
side though just cuz it fits nicer in
the case you see that black up there is
3d printed of 3d printed it's quality
you can't buy it it's not a connector
cuz look it's like one injection molded
piece with metal here
nope it's Honda only and it's also not a
product pedals will not be for sale but
the software is already open source in
the Panda repo and we're about to open
source the hardware right now let's look
it over yeah
please tell me you can buy an assembled
well not for me you can't um
so the pedal is extremely DIY and be a
little bit careful so the reason we
don't we wouldn't sell this is absolute
worst-case scenario you could get
unintended acceleration in your
meaning if this thing messes up it can
completely floor the gas pedal now a few
things neutral still works and your
brakes will always overpower your gas
I'm not 100% sure about the Honda's I
know in the Toyota if you step on the
brake it won't even accelerate is it bad
to ask if the pedal works with older
cars the pedal is completely open source
no that's certainly not bad to ask no
it's bad to ask questions about like you
know will this product actually work
with the car if you're actually
legitimately asking the question it's
just bad to ask when will Subaru be
supported that's bad window by Mazda
mx-5 2005 be supported old cars is a
good question
um so every car made after I believe
it's like 95 is is gas by wire so you'll
be able to adapt this open source pedal
and you will get it to work with all
cars so this is the closest we're
probably ever gonna come to an old car
release so let me show you guys how to
use it while Eddy prepares here's the
pedalboard guys know we're not selling
kits we are just going to release this
board look Eagle as this flip feature
now it's pretty cool nice we're gonna
release the board schematic yeah we're
gonna have schematic a PCB bomb and some
nice CSV format so you just like order
all the parts on digit key and I'll
Express maybe someone will make a macro
fab file
cool we could do that too but someone
else can do too yeah yep the files are
Eagle files use eagle so well that's
what we'll be releasing put a PDF of the
schematic down so he's a good idea yeah
so here's the pedal I just got that even
a cable so let me show you guys how you
connect your pedal so here I have a
Honda giraffe that is available for sale
at shop common oh yeah yes the pedal
will allow your car to do stop and go
so our Acura ILX can do stop and go so
you can just take this ethernet plug it
in here to your color palette snake this
up and then you'll just want to plug
this guy so yeah finally a use finally
so now your kettle is connected to the
accessory part
well the pedal doesn't work on brokes
but I assumed you meant breaks no it's
only for go yeah this is the one use
this cable stuck in there yeah that's
kind of like a clip is that way yes a
part of the youth when you get these
connectors you have to modify the clip I
guess we gotta at least release a guide
for that like it comes with this clip
but it's embedded in the case so you
can't unclip it so you just cut it off
like this so driven to navteq that is a
fake news there's not actually a product
the title was clickbait I didn't lie to
you I didn't say it wasn't click babe
but we are releasing the Kama petal oh
it's the latest in non products from
common AI it's just like the common
kneel so the common neo was not a
product
um and you say about that just snap off
this tab here so that you can pull it
out easily or you could leave it in but
then good luck getting the pedal off so
petal giraffe Aeon yeah I mean once you
have you know once you need a giraffe so
that's this is just a generic expansion
port on the giraffe that you can use for
anything so yeah the pedal is not it's
not a product oh well you need a pan
you're still gonna need you're gonna
take a panda
oh we got caliber okay caliber yes you
just plugged your panda into here do you
guys know where I can find some heroin
around your hood fusion update no I
ain't really done anything on the fusion
but this is the product this is the Kama
pedal yeah I think it'll work on all the
Honda's so you know petal is not a
product so what is the new product the
Kama pedal is a pedal interceptor it's
not a new product so the title was
clickbait um no the pulsing of the Civic
is fixed in the new version yes this
will enable stop and go uncertainly and
condos but remember that the pedal the
product thing was fake news you will not
be able to buy a coma pedal from common
AI we will be releasing it under the MIT
license in our repo with the Neo
Hardware yeah all right this is chilly
I'm gonna close that close I close the
closed now so secret no your screen size
yeah how do you buy it you can't buy it
only make the difference is build
ability you can build your very own
comic panel um no it won't work with a
neo it'll only work with a giraffe I
guess but yeah it's just a different
connector on Toyota you could certainly
modify the collar pedal for Toyota but
we already have fermer mods for the
Toyota things so there's that shipper
plus update soon TM you know we've
reverted the open pilot update oh all
the focus is fixed virtually crisp and
helped me out
I think auto focus is well it's a lot
better than was yeah we'll be we'll be
continuing to improve auto focus it
won't it won't like to do it
doing before okay yeah so here you go
call me pedal so then that just plugs
into your car right so it's an
interceptor here's the connector that
goes and the nice I'm glad you like it
yeah the source is already open source
it's in it's in yeah so you just click
that on there like this and then you
plug in the wire how do you buy the
parts we'll be releasing a list and you
combine like digit key and stuff no I'd
say a firmware modest significantly
safer than the pedal the pedal is no you
don't replace the stock gas pedal it's
an interceptor oh but yeah I mean this
is really it's really only if you want
to be DIY that's why it's just not a
frolic thing really you think you won't
be able to buy these from us but oh fast
calibration no not next release but yeah
if you want to build them if someone
wants to build them and sell them that's
on that we're not gonna stop you we you
know you know my feelings are no actual
property I think intellectual property
is a dumb ass shit and yeah you guys can
build your own common pedals just um you
know really be careful with these things
um can I show you what it looks like in
a car show you what it looks like in a
car right see that car that car has a
common settling why is PCM bond safer
because you're running on automotive
grade hardware I mean yeah I suppose you
could build an automotive grade no but
doesn't support anything man
but it just worth comma pedal on the
actor I like so if you do bill to come a
panel we are open sourcing this we've
tried our best with the you know giving
it a bit of safety you guys can read the
code we drive around on it but yeah
really no guarantees on this no no real
need for it acidic that's all about the
other Honda's estimated cost to build
[Music]
it's like about 20 bucks yeah I feel
pretty cheap yeah
can you daisy chain other devices over
failure tonight yes you can
oh yeah really fat you can easy change
fake you can daisy-chain all the cans
that's right thank you yeah but also
like this is the board it would also be
a great thing to just you know if you
want to put something on can yeah just a
great little board you know it has ADCs
and DACs if you want to use any of that
stuff
yeah don't use this to intercept your
steering wheel torque sensor helps my
pedals are these vaguely safe pedals are
simple the and this is better than that
but no details probably gonna take out
of hakkon oh yeah it was like an op-amp
to like to get the correct values on the
output a little can transceiver there
three three regulator a good three three
reckoned it's crazy how bad most
regulators are like their response rate
behavior change it changes the current
yes the other side we got like the same
micro as the Neo board if you have some
of those left it's the same one
different crystal just to make a little
smaller and USB a for flashing it
there's no USB well the device is
actually running it's in the back you
can't plug it in yeah it's in the back
so once it's on your pedal you can't
plug it in but you can reflash you can
reflash over can well oh yeah you can
reflash Trevor can we did write a can
bootloader which has already been pushed
you can also if you do brick your common
pedal you can use show him how Paul fits
into a finalized pedal
your petal you'll just plug it in while
holding the boot button while it's
plugged in the USB mini-b and then
you'll be able to I just run make in
that pedal directory yeah it works the
new flash of panda with petal firmware
and maybe connect the inputs I think
some of the pins are already used on
panda probably cool pedal we can't do
this in the car because this is against
the wall did you get a lot of new hires
lately or just cut positions why do you
say that oh you changed the hiring page
oh no we just thank you again and we
just hired two new people yeah yeah
we're not here yet they're not here yet
one is starting next Monday and want to
starting in two weeks and he is working
out you're working out man that's what
I'm saying no actually we're really what
we're gonna really increase hiring
where's Cass they look like alright
can they keep it up can they keep it on
the DL we're not gonna say anything
about how much or anything we got a
little investment recently we got some
monies we got we get we got money but oh
you said we could buy a form to will get
a buy for a minute my form to 3d
printers so we can start printing more
connectors yeah Eddie you're gonna hate
it
I did say goodbye violence - oh yeah so
we're not gonna announce any details of
that but we did we did come into some
big money recently so we're gonna be
seriously expanding everything
everything and them you know I've also
talked about this we're a lot like a
phone company all right we're gonna
release a new product every year better
a better you know thing for your car um
so we're very early into the EON cycle
there's a whole lot of Eon updates to
come and then like this holiday season
we do the next one right and the next
holiday season we do the next one so
what's the pedal all about the pedal
allows
gas pedal in cars that like how the
cruise control cut out at 20 miles an
hour like the Acura this is the second
time they came into money is it like we
actually came to money like I think was
the same but we actually chosen
everything recently oh oh this is our
this is our second row yet calm security
I called security definitely that's
being talking about yeah we have a lot
of plans but today all we're announcing
is the color palette yeah so one of the
plans up shortly may be simple guide and
there was some people in this life at a
party always be showing always be
showing the project I got their bill
thank guys you see that one pedal there
how much would you pay for it
pedal not included no just a comment
just to comment yeah are we using
blockchain no blockchain right houses
new awfully TNF you Eric they said ones
a new model coming out Nebu airy we got
a bid 100 that's 25 100 I hear 200 do I
hear 300 in 300 it obviously if you pay
me 300 I might even be the Jaguar CEO is
so like say they're gonna drive around
for I thought they like announced like
you can go download the way mo app right
now that's what I was waiting for now if
they were buying 20,000 Volvo's wonder
what they're doing with all of us now
was like the next step in self-driving
and then like the next do not the next
to my Jaguar 2.70 Jaguar I don't need a
lecture and you have a comma pedal yeah
but leave a boycott
sky-blue element only compare comic
panels and sky booth yeah you guys know
what's wrong with the ball ball right
you know what some of the ball the way
are they on the commenting I know you
can't buy petals they'll be open but
yeah I'll show you where you can buy you
can buy some things that work with the
panel you can buy a giraffe which has
the fake Ethernet port you need to plug
your pedal into and you can buy a pop
which can be used to reflash big jokers
huge jokers localisation no no we're
gonna talk about the pedal there's a
panda there's an injection-molded paddle
so much great kama stuff yeah good buy
one of these pedals if you want to play
[Laughter]
tell us about Rover MTG rover Magic the
Gathering heroines good yeah
vocalization
oh yeah here's my keys great name he's
gonna find this here's freshly brushed
cases yeah the inside of the case anyway
that's a lot of looks a lot of great
pain free pandas are in stock well those
ones are encased yet yeah we got a case
more because I'm showing our guy go for
a driver the pedal again maybe we'll do
that tonight you could go in the Acura a
pretty great padded for time you want to
go in the accurate I mean I can go get
the keys we can come on the Acura it's
the skull pieces
and do I write Twitter responses myself
now we hired a social media coordinator
this actually this actually isn't me
yeah Harold I know it's wrong oh the
actual gas pedal is just a potentiometer
not exactly this is like a Hall effect
sensor all rights go peace okay all
right so you guys I don't know who you
know if you don't follow us on Twitter
you got you got to follow us on Twitter
on twitter twitter twitter there's a lot
i post a picture of a lot of space check
out the space are great available on the
come and shop oh oh racing yeah we got
we got 207 i think yeah ricardo we're
actually releasing the drive on cabaña
of our race so you guys can can check
that out they retweeted our self driving
awareness to it awesome can you download
the version yeah you'll be able to
download the pedal oh can you download
it off Cabana I don't know
base station guys there's so much to
talk about but today we're talking about
the pedal base station is part of a
whole thing that we're releasing okay
someone's we got to release something
Anders and we totally about a thousand
more right yeah they're coming most
adapt icture of it being done which is
cool oh yeah we're trying a different
manufacturing partner we're trying out
circuit hub they posted a picture of it
done what don't show Mike the cost right
they just show oh this is that one
already know what I can show you that
yeah what's the can address of the pedal
forgets to a wanted one yeah we're
trying to hurt enough to change it but
like I don't think we did
yeah we should like how do you know
something about the same address still
need a station base station cheap Panda
yeah I mean we're gonna be releasing
some great crepe and O'Toole soon yeah
like all the base station stuff is
parents working on the house working
well Harold the thing the thing is
Harold's also working on your
calibration so you guys got to decide
which you want more do you want fast
calibration or do you want a base
station high or if you're talented you
want to come work here and clerk isn't
it yeah I know you want calibration
that's what we're working on guys we're
working on calculation I've a look in a
calibration yeah yeah they all want
calibration I know they want calibration
right we know what you want you guys you
know what we don't do something it's
like Oh calibrate it
no we're good on calibration calibration
is also part of localization focus
afford focus or like focus on things
chase will come all right guys oh you're
old show-off
that's nice yeah hide the other window
in the other monitor no the other window
the web browser minimize that and then
we can bring the scope he's over there
chef applause soon guys we had to pull
the open pilot release
well the Florida standout is zero I have
no idea
we have those two here's like like
eagles pretty cool now you can just like
XY what's wrong become can export your
boy but no I didn't tell it it was
purple no it's some of its gold for some
reasons but like Eagle lets you export
which is cool and I just download these
models this one's a this rj45 is an ass
man guys be careful when you build a
panel you got to get high precision
resistors check it out yeah yes we use
those on the outputs of the op amp as
well as the inputs of the ADC when
you're reading don't be seriously only
1% 1% SAR probably fine ones probably
fine
tens or not you get these point ones
they'll probably like 80 cent teachers
you do want your pedal to work just get
the high precision like this connector
we made this one we made a model of but
we bought from Aliexpress but yeah
having super ocular models is important
this will retain retail we're not
selling it guys we're just releasing it
open source because we're nice like that
someone said 200 followers yeah 300
wasn't the bid yeah do you have a 3d
scanner scanning then you import it into
fusion 360 and then you just trace it in
extruder
yeah and then you print it on your form
too because it's higher precision you're
gonna what's the bomb total it's like 20
bucks and super cheap pedals are
incredibly cheap it's a neo board really
with an op-amp on it yeah another form
factor damn Subaru here on a couch
someone bid 300 through here sold to me
scope you know oh you guys get burgers
oh yeah there should always show the
merch even though it's not for sale guys
the current bid is too under the
christmas i virtually curtain oh yes I
think it's what's my salary come zero I
get no money until we're profitable we
just rejected a verses great pan itself
every profitable for corner first
profitable quarter I get a sound I know
yeah but we're not problem well that's
why we had to get investment for us you
know but you know well we'll be
profitable we're profitable we want to
grow thou growth is important alright
you could store you know yeah if you
stored your big no one will ever find
your Bitcoin this is my bitcoins there
in the pedal you can buy the penalty
iota 1k for a forgery let's yeah we're
sure
oh so maybe please know about the pedal
but we know this actually does this is
the same microcontroller that's in a
treasure and the treasure is also open
source could get the farmer to run the
treasure from her to run on this yeah
yeah the common pedal board has a one
led but the LED is not visible through
the
other than rain or need your pillow
virtually curse I forgot you have a
civic you don't need a pedal don't don't
put a pedal on the Civic it won't work
you'll be disappointed check out our
testing rig for great panels look at
those antennas yeah those are those are
broken grab it's like a lot of mounts in
the three
and act more common power hisses power
powers are caps shut the new printers do
do things the same cap as a family oh
yeah that it's a little skinnier really
distinguished so just push this is a
different cat yeah they're different
well it has to be different because a
little on fire oh the wire comes out
yeah sunroof okay for antenna yes all
right let's go visa Skopje
let's just go back to the calm pedal
we're just talking about the palace 30
minutes 30 minutes the showing for the
pedal guys you can get this pedal oh
wait no that's right you can't buy it
that's right only free you can buy that
vacuum-powered let's hope we sell a lot
of common pedals oh wait no you can't
buy them they're just free yeah do you
make the pedal make the Toyota pedal and
the way then when you have unintended
acceleration you Toyota you can see
Toyota and get rich I didn't say that
don't do that so those brave guys
uniformed you know I've come around on
Ford who do I not like what are we
selling lots of stuff go to shop to our
colleague on AI and buyer merch we sell
yawns we sell pandas we sell giraffes we
sell t-shirts we used to sell though DS
but not anymore
ya know but it's not like on the page
just selling hardware logs we just Chris
haven't Yellin he doesn't he'll arrest
yeah if he doesn't we're gonna drive yes
and virtually Chris dude you don't have
a Toyota your apples anyone
yeah yeah yeah if you're like thank you
yeah next next product we'll send you
one
um you know we've given out was gonna
have few eons now people who
substantially helped with car parts or
with knowing quality yeah you know just
just think if the stuff would help them
how we do it why should i owners use a
PCM hack instead of a pendulum that's
not only works for all those you guys
could modify it
alright guys that's 30 minutes yeah
gotta keep these scobie's 30 minutes yes
weekly comment videos I love it
what obscure piece
all right so you guys saw yesterday I
reviewed a 20-17
Oda for so this is my dad this is my mom
and this is this is me on my dad is a
one of the many shipper plus users we
have out there by the way I didn't
realize that FCW works in ship for plus
Samba dads use that is the audio with
shipper plus the shipper plus it's not
self driving so this is I think it's a
is it a midnight black I don't think
it's a midnight black I think if there's
128 gig iam right guy thinks I'm 28 kg
out I gave it to my dad for Christmas
should I get an accident so if I give
you no no I mean the real tragedy is
guys if this is part of the review of
the car I've been trying to pair my
phone to this stereo system how long
that's my security put in that
got about 10 minutes something that's
okay I don't think was ten minutes like
that's a little bit exaggerating but but
oh oh I didn't really look at systems
over there
I mean your car had a screen over there
I drove this car to the bagel shop this
morning now you know my dad keeps it
impeccably clean oh yeah this is running
chef replies we have an updated chef
reply yet we'll push that update when I
get back
here's EZ Pass that could easily be
incorporated with wait Haley
but yeah break easy that's it we should
be able to do that no I don't believe it
has lks or ACC have digital up does this
have electric or hydraulic power
steering I don't know it feels it feels
hydraulic any paint oxidation
mom you have a name stethoscope he's I
love my son cute
yay , buy the merchandise bro oh we
shall I've been showing him a jig Paul's
music that's what I was trying to play
on the Bluetooth audio but no luck you
know well some a fan of guys Danielle
we're Goldie check out high bish remix
her last verse on their fire buy them
their fans alright guys so this is yeah
I don't think this car is self-driving
[Music]
my parents also have a 2006 x3 BMW yeah
time where we're on our way to a wedding
we're no way to a wedding my dress nice
yeah we shout no we shouting that out
just get me gift
oh I gotta go so I got a gift alright yo
you guys come hoodies our house knocking
get them a compatible car that's what
they want it's wedding time give them a
neon
that's a good idea
did she now is it does have a Touring
package to work well if it's doing is
that car that's a Bosch radar isn't it
isn't it or me
Bosch Reiter I was time to support them
yeah I was telling I was telling my mom
rav4 hybrid yeah yeah is that what is
that would you like no way what did it
know what you like the best
I mean what do you want is a replacement
for the BMW well those have guys well I
can't why don't let's let's ask I'm
gonna switch you guys to the front
why don't we support BMW
the German for the chairman that's okay
it's not the German assets' the problem
up the bounty we could up the bounty
flex ray yeah oh that's right yeah so
yeah my dad my dad's got a panda down
here
panda um no they would suck I don't know
I like BMW sir right beaten his dad says
BMWs break is that true mom my mom did
get rear-ended on the highway though not
not that fast it's all right but uh BMWs
BMWs break that's what that's what a
scope he was saying tell you about flex
rent so flex raise 10 megabit um so
unlike can it's a scheduled protocol
which means there's like Windows and
schedules the messages it is more
real-time but it's annoying it was only
like expensive chips and stuff supported
um it was a dying standard I'm shocked
at its in as many cars as it's in I'm
surprised they don't move to Ethernet
you've got to move to eat than that
death mono class use Ethernet all right
they should you think that's a good
choice
there's nobody that does believe I know
anything it what season it bloody the
debunked Ethernet Ethernet was named
after or the the intoxicant either what
are my parents do for a living you guys
want to talk about that I run the
networks at a girls Catholic High School
I don't like that wise mom I don't like
that was that's right that's right
just work is life grows right Marcus
that's true thank you
you know what happens yeah good good
does you know what happens to people who
don't work their minds start to
deteriorate you gotta work know your
mind is fine mom you just gotta work
work good job building the wall I had to
be more politically correct in my
periscope okay we got to be politically
correct um we support everybody's right
to a long wait is that
a job yes some global warming did Cruz
hacks microwave for their first Audi
cars I don't think so I think those
Audi's didn't have flexpay I actually
think the a4 last generation whoa mom
de-escalating deescalate to escalate
conflict good strategy don't be excited
by the shop , da di gray pandas are
coming back in stock as soon as I fly
back to California
I feel so professional doing this in a
suit but yeah don't buy a 2013 Nissan
Altima I think that's the conclusion
with us they've cleaned it up first
I did I did really enjoy renting that
Audi yesterday I rented it with silver
cars shoutout to silver car they didn't
give me a discount
nobody ever gives me any discount just
show for him anyway why aren't I hacking
flex ray no the Ford doesn't have it you
know this is the year of the Ford this
is the year of the Ford last year was
the year of the Toyota the year before
is the year of the Honda
take sure you know it's something we do
casually know this cars running Scheffer
plus see the drive time up there no open
pilot in nissan altima
your the honda should come back any
update on racing today I haven't heard I
haven't heard for the team
I should we should check in we'll go
check in but we'll get an update to you
Skokie's hey oh cute Fleur yes who's the
NiO team there's no meals lag will i
periscope the racing now because I'm
here and I'm coming as social media
coordinator but best have locked a team
, are me in the race today
I'm sure they're gonna kill it she's
gonna get around that track no problem
maybe even kind of fast
we got great steering on the Prius now
we got good acceleration the braking
leaves a little to be desired team come
army yeah we should check out how we're
doing alright scobie's thanks for
joining
that was today's pass go say bye mom all
right vice goes
good morning scobie's good morning good
morning first I'd like to show off some
hardware that I just purchased in the
comic AMA space
this is inferior to one you'll buy
because it's a crappy one here's a brand
new Toyota giraffe I know we're it
afford right now and then we have a
lovely one second I don't think that's
how you do that no I think it goes the
other way you just hold over now 60
years 60 people this early yeah 64 high
so there's a cow power I just bought it
at the comedy shop
I'm just gonna plug it in down here to
my convenient OBD port of it oh wait
shit no we can't do this oh we didn't
think this through at all what oh that's
terrible
cuz now we don't have any kin how does
anyone overdue there's only one OBD port
oh we didn't think this through at all
I'll never have to go get the wire again
maybe the wire inside I put the water
inside oh that's the tragedy we didn't
think that through no no we really
didn't think that through we can't use a
Toyota giraffe and a Ford because the
collar power isn't gonna transmit the
cans now why did I think that would work
I thought that was to OVD Vegas well
there's an obd on the power which will
give the pan of power to be fair we'd
have power we wouldn't have camp do we
one can we walk in alright because
otherwise what are we taking the Ford
for so we go to the racetrack today guys
in preparing for self racing cars so
what up with that creep into them but
this is this is what
oh my God we're like clowns where is
this shit is it now show them our
beautiful antenna map for 114 viewers
wait we have 140 people watching us be
idiots yeah Oh No inside we have to go
with the wire I think anyway okay
alright let's go inside let's go back
inside
oh there's the wire no wait there's the
wire oh this way oh why is down there
found the wire
okay well that's half the battle I'm I
don't really don't think I left the
great pan inside I mean maybe I did it's
a little bit annoying
unfortunately this USB wire is just
slightly ever so too short um also if we
lost that great Panda we don't have too
many of those yeah that was my test we
can't just go to the cafe I shop and
Biograph a McHenry no no okay so that's
just gonna kind of snake down there just
loop that like that we got a white panda
we had a white panda I put it inside
really is why is it called a gray panda
that's great oh I was sitting on it guys
alright so let's plug in our USB wire to
our gray panda here check it out
there we go nice grape and equality this
is a high quality great pan you know we
put the crappy ones in our other cars
put all like the demo units in our other
cars all right we'll snake the antenna
wire down here good thing the antenna
wire is long
ah well I don't know well we got a lot
of scope is this point I was expecting
like 30 people probably dropping off
this is terrible
you've got 90 now Oh 90 people watching
this content yeah yes it does have GPS
great pandas GPS look I'm screwed in the
GPS right now well so that was just
total whale a sitting on there no no no
no like we're gonna get the giraffe in
the column of power none of that shit's
gonna work this is a Ford we need a
forger F you know in the Ford Fusion we
won't tell the scope he's about the Ford
Fusion tragedy can you guys stop the
race later oh well so we go to the race
this weekend or go to self racing cars
um but today konna a I rented out a
track we rented out an airfield and
we're gonna go test our high-speed Prius
um so Ricardo's already on the way there
and now Harold and I are gonna drive
down and we're gonna test it so there's
an amount someone said George is out of
breath setting all this up I know
wouldn't it be great if you know the
thing could now tell us if we set up the
Greg hander properly Wow our front of
turn usable shit all right cool that's
that's paired oh look at look at how
nice that is with the uh with the fact
that it goes like that
oh yeah sure reboot it so we don't
because that's the old branch these
things are supposed to reboot on update
I don't know if that actually works
somebody asked about the woman that got
killed by the uber car we don't talk
about that investigation with nobody I
will say this about the woman who got
killed by the uber car nobody has all
the facts yet when the investigation
comes out
be very interesting to read and discuss
but right now it's all just speculation
yeah runway tends to be straight good
for ping-pong Prius fix Oh ping-pong is
that what we're doing today wait okay so
can I Drive why is it blinking is that
good that sounds good there we go
Coolidge or it just start press oh the
door is ajar wait I don't have power
steering passenger door enjoy my do it
oh you are right just start press brake
this cars too
oh hey gotta put it in park then press
Gregg okay now we're ready to drive no
difficult up what the hell is that merch
in our branch
oh this probably isn't the latest code
real it's not a lot of update anymore
they do should we get the laptop I guess
so let's all vision D oh I call it works
Wow yeah full screen timeline I don't
know what that means full screen
timeline bro have you heard that's so
good I don't really know where we're
going I'm just gonna go to 280 cuz I
don't want to go the other way
well we're definitely not going to the
Bay Bridge I think that's the fastest
way no no I don't Joe I don't take the
Bay Bridge in the morning you want to go
through San Jose yeah which can't be
hundred miles longer that doesn't make
sense
sorry an hour long now but I'm no way
I'm going to Bay Bridge this morning
oh it's laggy and you're probably on 40
oh I think it's just shitty here yeah
what are they cold look we have a lot of
Skokie's because they're the mapping one
yesterday was exciting and now they're
like it's just like I should talking in
a car but doesn't even sell drive this
Ford does not sell Drive I'm driving the
Ford just so when I crash we know whose
fault it is
oh my god oh my god alright that was
overly stressful is it what are we going
to the races
what is he cold oh I don't know don't
like people know those kind of things
so this is running Schafer plus we're
driving a shipper plus car we are
driving is really hard you guys like
that you're driving much easier oh you
definitely need to take the Bay Bridge
no it's two hours and no traffic
wait first off it's two hours fuck that
second off really I have to take the Bay
Bridge yeah I mean it said it was two
and a half hours from where Ricardo
lives so it's much better this way
it's furthermore Ricardo though yeah cuz
you can't cross the mountain you need to
go all the way all the mouth okay well
how do I get to the Bay Bridge from here
wait why don't we just use our improved
ways experience and yeah let's do that
sorry woman yeah dress frozen landing
Crows Landing rose Landing Road in
Modesto fits of yes done let's go
let's get started drive safely yes wait
turn right father if you turn right well
I don't know if your orientation
libraries working is that right all
right I probably think they're going the
other I think it thinks I'm going the
other way this is my orientation with
his new boxes
what who wrote this shit
things are going that way are you
stationary
I wasn't stationary when it got the fix
it should know that so this is the wrong
way let's help follow this road go
straight oh good we go good we don't
have the crappy yard we got the high
quality phone there better need all
these wires it's like got a broken
screen though no GPS this ball can tell
you which direction you're going might
turn on I suppose but we were already
driving the great panda should have way
got in to fix I honestly think that's a
bug in the orientation library honestly
no you know what maybe ways computes its
own orientation this might be a way ease
interface issue that's true because I
probably don't want to rely on you know
oh now it knows there we go I think ways
I think ways did it man yeah man we knew
all about look at that high quality
grape and a shot so oh that's nice where
we are the actual location all right so
I want to turn on Ocean Avenue stay to
the left
there should be towns where they name
every street after emo songs
yeah let's blame ways exactly please you
guys totally ways we started ways late
it probably computes its own orientation
which can you really blame ways for that
miles turn left to I to eighteen or in
one point twelve miles in fact how many
people are watching this show when it's
64 now alright good they're all drop
this terrible this is tax is a worse
this is a horoscope you really don't
have anything planned for you guys we're
just driving two hours to a racetrack in
a non self-driving car but it is oh
that's true which can are you going to
race the Prius well okay so we're gonna
know Ricard is gonna repair to go to
Walmart to buy cones this morning we'll
set up a drag strip who wins a Prius
hybrid or a Ford Fusion Hybrid let's go
let's find out
I'm sure II periscope that no it's too
exciting we're definitely gonna drag
racer cars if we periscope anything it
needs to be that if we're paying $600 to
run out of track we're definitely drag
racing our cars I'm excited for the
jacket we were gonna bring the Acura but
you guys know that's my least favorite
car oh my god they're small children up
ahead
somebody asked about Kira I don't know
what that is Oh Kira water back here I
don't know something about why you
committed that to github or something oh
I took it back I just put it back on Geo
hot no no the other guys didn't didn't
contribute anything to it so I took it
back all right so now this starts the
little pile of comma hardware we have in
every car look at how smooth that weighs
this Google Maps that just seems hard
$600 for an hour no no no no no the day
we get the whole track for the day we're
any other an airstrip I don't know you
probably didn't have to do it but
whatever now we'll have a track George
do you use Ida Pro for all the time
do you like item that's right I mean
here's the thing how many people try to
like oh I'm gonna make something better
than I died and then you don't you just
use Ida that's always an absence but we
are gonna make something better than a
plan X oh my god Waze is better than
Google Maps I don't know about that is
it I'm convinced that ways sometimes
takes you stupid ways because you're
like a baby way there I mean it's kinda
like a we're gonna take people to Taco
Bell if you don't bike on a I premium is
this a play I know here all right
driving in San Francisco is super
stressful
I'm a Muni should we stop and pick these
people up bye people
any progress on fusion giraffe interface
oh well you saw that you see all the
progress right look at that blinker look
at that that just makes it hard for your
she learning to classify right there Joe
how do you guys like the HDR chto nice
what do I do with my becoming what are
you doing your VidCon I don't know if I
was about to be worthless did you clean
this thing someone asks don't talk to
you about this Decker don't talk to me
about the sticker are you guys using
Sprint t-mobile yeah we got t-mobile oh
no that's my phone I ain't a they
looking really likes HDR yeah virtually
Chris says his is blurry when it's
focused that's amazing no I fixed add
new folks come in yesterday dude did you
test the new one is it still blurry know
if it's still blurry in the new one I
don't know what you did I worked really
hard on that I spent like an hour I
retuned the loop he says still blurry no
oh no you didn't pull right no it can't
be still far it's impossible I removed
the blurry
no send me around I'll take a look at it
I you really don't know how it could
still be blurry I wrote the best
autofocus ever to admin zero my keys to
admin keys program
what's an admin key does somebody have
rude on my car that isn't me
now to your Anna Ford talk about Ford
problems oh no we're in a four talking
about Ford problems actually we took
this car because the actor Sox it's not
driving at all and I just AM making a
wrong turn because that's not right if
only the car if only that was augmented
reality in a heavy traffic oh my god how
far did you think it was it said three
hours yesterday I was already confused
why you oh my god why am I gonna this
guy's I don't know why I ever agree to
do things I usually regret it will old
grape and drives get one two maps all
only good ones
if you're grape n is blurry you saw
yesterday you saw yesterday about how
many so we tried three drives and one of
them was good enough for maps but maps
are super cool where's this bundle
that's a little gear probably oh and
what is that energy drink I don't know
that's the orange exuberance curve
amante
let's see if we can pair this to the car
while we're driving
oh no way we can't cuz we can't press
the Settings button you okay
why not being able to press the Settings
button yeah like our products och I
don't know why anyone bought them I'm
very upset about that
yeah okay no no I've complained about
that a lot if you're not racing a GTR
then you should not race well what I'm
racing a Ford Fusion Platinum Hybrid
that's right
what's the ETM a new model well how
about this let's change the let's try to
use the intelligent features of this car
adaptive speed cruise to low to activate
we go now oh yeah we're going
oh yeah we're in adaptive cruise mode
alright the Ford is driving the Ford is
driving well kind of I don't see if it's
gonna stop for this car oh my god I
don't really really does it see the car
now or is it going to try to accelerate
into them
you should give extra points for mapping
new roads
I got accelerate here and not use the
Ford driving because I want to make that
light alright let's go
get ready for heavy traffic yep
okay the word is driving but just didn't
see that car at all if people think our
fusions bad okay let's see if the lane
keep is gonna work that's what I'm
really excited about Blaine keep I paid
$1,000 for this option I really did oh
my god oh god boat America I gotta help
America American economy this is the
number ship Shh
I'll buy whoever makes a better car
aside from porting cars what projects do
you want people to contribute to well
whoever works at Ford could contribute
to making this less shitty wait why
doesn't it see the lanes I don't
understand camera out up there hope I
didn't cover the lens
this is supposed to see the lanes
oh maybe have to engage no no it's
already engaged this is a Ford stop and
go though it's really not that terrible
it's quite smooth yeah not that terrible
doesn't think there's not a girl
yeah is Lane keeping his malicious no no
no it doesn't see the lanes for some
reason they were dropping viewers 48 I
believe the scope is here so you can
listen to music oh my god
okay okay okay that was terrible you're
watching the car why'd you do that it's
like I'm gonna accelerate and then hit
the brakes activates above 40 miles an
hour oh that's why it doesn't work
should we at least wait till we get to
40 miles an hour that's not gonna happen
anytime soon
oh my god why did I agree to go this way
we gotta cut out we gotta cut out oh it
did it good God Timothy viewers take
something up
hmm take off my logo Punk maverick buddy
what um oh my god
I was at the train station and this girl
whispered to the stomach turned around
what I just looked at that in the I'm
like yeah you didn't lo guy she's
mortified oh that's good
I only liked him we was controversial
now he's like trying to like rebrand
himself is like whatever I don't care
but you know oh by the dip that's right
by the I supported Logan Paul when he
was down by the dip all right I don't
even think we're gonna get to see Ford's
uh yeah this isn't gonna happen
but the stop it go is is not terrible
it's quite smooth it's good actually
yeah like this is quite usable when's
the next rap song we're waiting yo you
guys I wrapped my wrath let's go peace
unity to growing again all right people
do want to sit in traffic with us
but I need to probably like confirm that
we're going to the right place the right
place waze's got us oh you sure I'm sure
Waze is goddess brow it sounds about
right though doesn't it Modesto that's
what we're going no we're definitely
going alike like Cesar Chavez wrote or
whatever it is okay that's good yeah
we're good
your flow is surprisingly good thank you
I'm working on my flowers about your
wrap
I gotta be a better rapper all right we
gotta cut out here it's like overly
oh we were gonna run a Tesla this
morning but all right let's put them on
blast get a riff on socks their customer
service people don't talk to anybody I
get on the phone with don't lie can I
speak to a supervisor they're like okay
please hold I please hold it for 30
minutes and then they're like there's no
supervisors available but now what can I
do you think that's forgivable okay
maybe there really are two supervisors
available I call back an hour later they
do the same thing to me they don't just
tell me there's no supervisor better
like please hold
I think they just want you to hang up um
no you guys know it on the Facebook and
this doesn't work because get around oh
yeah and then they won't tell you why
they rejected your application and it's
because I don't have any friends on
Facebook because I don't have a Facebook
I have one Facebook that I used to sign
up for Jase wipe so doesn't we're in
cars the people under 30 that's the
problem like nice cars
yeah you can't rent a Tesla antero if
you're under so me that owns a fusion
says you need to set it to keep an aide
or something okay yeah hang on we can do
this let's try it oh it has various
levels alert eight and alert an aide and
you should put it to alert an aide okay
let's add it to alert innate how do I do
this this button this button oh here I
got you go driver
alert all this on available where is it
unavailable of eighty-eight percent
energy returned or unavailable driver
alert unavailable on involution that
picture it has a little picture of a
steering wheel and a cup of coffee and
it's unavailable I don't know if
anyone's ever complained about the Aeon
UI but uh sit intensity too high I think
I've already done this but I don't know
why it's unavailable right now
unavailable very tutorial without that
low arts a tutorial oh my god why is
this thing letting me do this
shouldn't I keep my eyes on the road
okay I can't do that one cuz I gotta
keep my eyes on the road but I can
certainly do the tutorials of all
traffic no honestly like our UI isn't
even bad compared to the Ford one it
says go to settings and it sounds
incredibly complicated a where I mean oh
settings oh I found it Oh driver's test
Oh boom boom lanky be says system mode
alert and aid we're good on that I'd
stop doing regen when I did that
intensity high good very good
cool good Brad alright David oh my God
we're never gonna get up to go fast what
was it doing it no shit
we're never gonna go fast enough thanks
David do they say this control no no you
can't be CEO and know how to code I know
about business I know about business
development I know how to make
partnership deals with large companies
those fuckers
so there's some kind of channel now who
claims that there's a way to do this so
if it turns out that I'm just an idiot
then I'm just an idiot but as far as I
can tell you can't actually run your own
programs on Qualcomm's DSP if you want
to run programs on Qualcomm DSP you have
to work with the OEM to get your thing
signed for production
now this isn't done for security this
isn't done for quality this is just
literally done to make some apps
shittier than others so basically it's
like you want your app to be not shitty
well you can pay the qualcomm money I
know but that's really what it is right
that's called digital protectionism
it's called rent-seeking and that's what
we are fighting against in addition to
nature okay so are we gonna go fast go
fast for it trying the stabilizer again
it's right yeah you have to press the on
button oh okay
I don't know it's actually kind of
confusing but sometimes press the on
button like it doesn't work I'm trying
to stay oh no no no no you got to press
the button it says button or something
there we go it's mites are blinking
oh that's improvement I don't know the
thing is hard to use I get it wrong all
the time stabilizer was working nice
last night huh yeah it was so stable
last night can we go to North 280 even
though it doesn't take us where we want
to go there's less traffic there that's
probably cuz nobody wants to go there
they just make all the roads go where
people want to go I know how this works
guys I'm sorry low battery can't be low
battery that's a lie
a little battery going back to manual
stabilization we brought that thing and
doesn't even work and I'll charge me the
micro USB to charge we're gonna add our
charger I am oh can we connect it to the
fort maybe it'll show up as a afford
connect to my guest so he keeps asking
if you like rice if I like rice did I
love rice like rice what race will be
going to well we're going to test track
mountain itself racing cars this weekend
self racing cars is this weekend um we
would periscope but I'm not gonna be
there because I'm going to a wedding I'm
going to flying to New York tomorrow
guys oh yeah no we're gonna race and we
should do well it's taking forever
two hours oh oh this is an hour 33 I
like ways yeah but is it correct says
we'll be there 1029 so reasonable and
that's even with waiting 50 minutes in
Bay Area Bridge traffic wait it doesn't
that doesn't add up the worst people are
such idiots on the bridge you know what
I wish I had right now the Civic the
Civic just drives all of this
I took the Civic to Oakland once what
the scope is like I did nothing I can't
do the wheel look at this look at this
non self-driving car correct it look at
this
how many interventions it requires this
is a level zero car six pretty close
okay fine
I've been on Mount because the locals
agents were okay that's true the grape
and up
what's your favorite car now George um
aside from a few incidents that we're
not going to talk about I like diffusion
this is nice this is like it's just it's
a nice car Ford has really stepped up
their game I mean okay everything about
like the electronics are shit but the
interior is is nice thirty it feels fast
[Music]
cars just really don't see you at all
and then like yeah you got to be quick
or you're gonna get hit survival of the
fittest
honestly you know Google is evil right
like I trust someone who says don't be
evil
I don't trust someone who says be good I
still trust them they're evil no no
Google's been nice to me over the years
I should really say that Facebook was
nice to me too but I'm kind if they got
me to use their product which
and not not even because of any new
political revelations just delete your
Facebook you should have deleted it
months ago years ago did you turn el
cast on on the stick someone else I did
turn our cast on on the stick so I can
see the ladies go away and now the
ladies are back I think it's just that
we're not going fast enough
I don't know why this car won't Lane
keep at low speeds okay somebody says 40
miles in the cutoff hey you want to get
the laptop out and have like a hackathon
while we drive and see if by the time we
get there we can get the foot or if that
means I'm gonna be doing that we could
switch no I can't look at a car you get
sick yeah I mankind look it's grandpa
like I have to spend at least half the
time looking outside but maybe if I'm in
an ultra-smooth for fusion platinum
hybrid oh you were just gonna cook
pecans pick them up no but like
seriously that's how far we made it in
an hour but then she's gonna waste her
tea - no no no we kick fib up we go back
to the lump it oh I see put this gonna
give it yeah I tried that but it's not
the gimbals I had a bad show me get
bolts out of batteries resistible try
the bottle I press this button what is
it now few light sounds bad
doesn't sound very stabilizing that
sounds bad it wasn't doing this doesn't
seem right but it look at say it looks
stable oh that's good to put the phone
in there that's destabilizing yeah well
we should have put it in a special
stabilizing case I came with this
ridiculous looking like mandolin case
wait there's a stabilizing knob on the
fact I have the same
okay discard us blind spot awareness
system but apparently even the data
speak it can only get what I understand
oh really I think so what does an op-amp
know so you can put the orientation
electronic oh we're gonna go fast now
for Leakey whoo yes it sees the lanes
oh yes go fast okay it's gonna lankey
let's say very okay we're allegedly
going if the lanes are detected now
everything is is it way keeping I can't
tell Oh
who wrote that autofocus did it
stabilized okay well this Lane keep
isn't working very well either
okay David is warning us that it will
definitely ping-pong Wow
why doesn't the ceilings unusable
but it's doing this it turns out
actually it's not that argument you've
got like you don't have to do that much
like I'm not touching anything right now
it's kind of driving but it's not
actually putting any torque in the wheel
which is going straight yeah it's
horrible these new evil 22 steering
wheel Platts 3d scanner and on the we
are I always thought that all these
systems except Tesla's but no torque of
the wheel and then Tesla it's a
horrifying amount of torque on the wheel
I'll figure out the stabilizer after
this
up to 42 viewers who I have to get over
here that's still a lot oh my god okay
why would I step on the gas does oh it
doesn't cancel on gas
now maybe not dangerous to be used what
did the huts mean impersonal the hearts
and means they like what we're doing I
don't know though I've never actually
use periscope as a user there's also
many different colors of Hearts kuia
whoppers yeah I'm really like Wendy's
makes like jr. bacon cheeseburgers I
don't think it's the same thing as a
whopper but like I couldn't tell you
what Wendy's is walk for us doesn't mean
we need have square burgers I think so
yeah why don't you stream on Instagram
it's the stream does this a Facebook I
do i do have an instagram you guys if
you look around you could find that now
I kick off people usually who I don't
actually know from it goodnight oh we're
gonna go fast okay all right let's try
at least one attempt at lane-keeping go
slow I'll go faster my fourth
who's that oh my god it just it just
forward collision warning thank God it
didn't ATP forward collision warning wow
this sucks
okay let's see if it's gonna okay thank
you blankie blankie blankie doing it
putting any torque on the wheel baby
doesn't seem to be moving much well here
we got a turn I think it might be doing
this okay guys that's the scope for
today make sure to hit that like and
subscribe button always check out the
shop coming guys slash shop buy things
they're good for you
that's it let's all we have to say maybe
we'll scope it the drag race between a
Ford Fusion Hybrid on a Prius hybrid who
will win take bets now everyone's
already found the fuse gambling not
legal in all jurisdictions please check
your local laws always comply with
regulations yeah merica right this is
the great shout out of American versus
Japanese hybrid muscle alright my bass
goes
now you push down and you can stop
broadcast
yo Scopus I did promise that I'd be back
tonight I promised so here I am I'm
sitting in the Acura it's me Riccardo
daddy we didn't actually test to see if
the receiving part of the firmware
worked so we might have to wait make
some firmware changes on the flight oh
hey don't worry the scope the scope is
you down to chill welcome to coding with
comma
you should've smashed that like and
subscribe button subscribe though you
don't want to miss Sunday scope e this
weekend big sunday Scobie it's not that
big we're just gonna make we're just
gonna I'm gonna discuss the stream nice
okay so see this wires copies this is
from the comma pedal I scoped it down
there Eddie's out yeah so this is from
the coma pedal down there no we're not
driving when I
there's a tree and you can't really see
it too well got some more lights in here
here's our nice screen get some code
yeah Oconee and chillin you know so we
plug this in here we hope the campus
doesn't short this is the high quality
cable it was a bug in the board minor
bug but we fixed it by cutting water so
if you notice with the , pedal the pedal
still works and this is gonna work 20%
all right oh yeah check it out my foots
off my foots off here you can see my
foot sounds good man so with the common
pedal you can use the joystick actually
I'm not sure he gets to 100% you're
doing good
oh no the car was doing that before it
doesn't okay I was like why is it
revving to 7k it doesn't represent when
you step on it and then I was like oh
maybe the pedal is cutting it out but no
it's not that who's running far as
protection to park yeah what is the
pedal cop the pedal is down here you
can't really see anything
white gonna flash how's the screen
mounted Oh many years ago but yeah yeah
oh yeah look at that you can Rev the
pedal with a joystick that's what the ,
pedal does watch those revs okay so
there's one thing we're redoing pin
oppressor and it's not brushed oh that's
probably just because that changes from
car to car
right like that's a calibration
parameter yeah why are we reading
oh we're reading press you're eating
breasts and then the values like five
six so like your stuff interesting so
what is it normally so you're telling me
this pedal has a slightly different it
learns can you do that remotely yeah
sort of but now we can do it more
directly okay so you're saying that this
is not the zero back no well so it's the
biscuit I'm reading five percent I think
and the car is always reading five
percent yes wait where are you getting
that five from two one no no no but
that's okay that's fine uh what are you
a car gasps reading if you run like
candle right oh I thought you were
telling me that yeah does your position
of a pedal changes over time actually
and it has to learn it right so I think
I need to anything yeah there's just a
number that like zero is five is just
like a fake map thing I think it's
actually always been on my tail so you
can look there in oh did you think that
zero is actually zero well yeah well you
two are well that's kind of the logic
that we were doing before yes so because
in the DBC file like we are playing
offset there was the officer who was
making it zero are you pointing a same
offset so yes there was applied like in
the onboard oh I don't think I'm
applying anything in the board gonna
read the firmware
yeah yes let's go baseball yes check
that one
that's the deck we need to propel the
firm where we may be fine
well I don't really want to like put
things like this on the firmware really
I think this is by design
so you'll you guys will actually see the
firmware already shipped to one
pandaboard pedal not one that's ours but
just hand aboard pedal how does the
pillow look and we still ask o4o how
does the pedal work well so see this is
very sad
- no I just said I just send the value
from the ADC okay I don't do any offset
applying oh yeah it's done in the DBC we
should yeah yeah I don't think when
you're parsing that is that using the
DBC or not it is using the Machine yes
okay so let's see what it says the 0
value is let's just do the math now so
if I look here at the 201 I'm getting
like hex 160
3:52 so you know you guys knees open DBC
same as all y'all
text emojis 550 yeah okay so it's
getting - 83 after I divide by six
clause right and I multiply 89 yeah I
don't know this do destiny first right
yeah that's why would it seeks yeah yeah
but um I mean the petal then has
physically changed on the car that's all
I can say right because otherwise why
else would this happen or the micro
controllers aren't calibrating well and
the different micro controller has a
difference yes but I mean honestly that
should kind of be learned is that saw
the car doesn't it yeah yeah yeah it's
but well how hug you learning how do you
know what zeroes we compare it to car
gas it's actually really easy this is
really yeah because cut well but okay if
it says car gas is zero
yeah it's amazing to respect okay I
guess well I wanna we don't know whether
it's the panel that's changed over time
all of you the new kama petal has a
different value yeah oh you know what
else it could be
the clock race has changed let's just
change it for now yeah that's fine
what do you mean the clock really does
change this panel is also trickier let's
um it's an Allen signal let's wait we
have a hospital reports you can
calibrate it for that for now yeah
that's fine yeah and so okay but so you
still like a problem like if you drift
so I get to do shifting problem no not
over any sort of time yeah this guy said
the car does really can't watch all plus
minus hundred millivolt but yeah so if
you guys see the 201 there and you can
all read this firmware I'm you're gonna
see that it's gonna go up and with a
step on the gas
yeah
changing for this value animal test
across five panels the fight figure out
was the pedal yes thank you
so far now I can just put bike 89 and it
was like yeah I should put like a little
more that's like if you're actually
checking for equals zero well I like to
yeah he needs to be greater than zero
basically yeah write a check for greater
than zero so scope is the reason we're
discussing this is because we want to
detect if the user presses the pedal
because we disengage on a gas press and
when the computers pressing the pedal
the way that we usually detect it using
car gas is still true you have to
distinguish the user from the computer
and now the comma pedal actually looks
like it's uh it just looks like it's the
user yeah well I mean that honestly I
kind of shook it off and EBC in the
first place well I think we should we
should separate it like yeah it should
probably been opened if you see but
shouldn't be in like since now we have
the generator yeah they have a different
file which is like a comma specific
messages and yeah we oughta generate
when you auto generate the file called
Acura ILX we shouldn't put the pedal
interceptor in there right section or we
can we can reload to DBC files what if
we just do that we can like we can
change the faster
you see fights and we merge that in
comparsa that's the love that
where is kama army yeah we don't want to
have to have 201 to every TVC I think
what we should do is just have like
special pedal a nurse like ,
ya guys and this is a note of all the
car manufacturers out there - Oh one's
ours think about it
we use 200 and 201 series we said
say you sent 200 that's what really
power but notice how 201 doesn't change
we do that because that's being applied
after the comma battle if you don't know
what the Kama pedal is check the
previous periscope but I did promise
that you guys would see a working comma
pedal tonight
and I press on this joystick so quick
Parris thank you for joining do I know
who that is no you already you started
using 203 that's fine it's not 201 don't
use 200 all right thank you for joining
in the follow up sculpey we do make
things work we ship we're common a I
make sure to go right now on your
periscope and hit that subscribe button
subscribe got to hit that subscribe
comment pedals never for sale but will
be open-source next week thank you
oh yeah and then you know start the car
oh yeah we have a button at the car we
can't we can't ask too much afford it
definitely just started unlocked it now
start did it oh wait you know there was
like a little guide that came with the
other key I don't know there's too hard
yeah yeah it's too high just hurtin this
car is seriously so sweet you guys first
of all look at these blue lights they're
so swanky and then when George starts
the car they turned red did you notice
those George
yeah oh it's so take the sticker off oh
no it's gonna be hard
why would they do this sticker is gonna
leave sticker resident it's a really
sticker yeah automobiles the components
replacement parts and maintenance
they're off contained chemicals don't
wanna bro no fuck California man making
me like deal with this shit now that's
on my car sweet let's go
wow this is a lot of things oh that's
that's kind of bright yeah that was good
alright maybe not all the bad things I
said about forward we have a few
criticisms but this is my new car
oh yeah the cupholders that light up
alright go there's a civic over there it
looks so quaint yes
oh it's nice this car is actually real
nice um I mean look okay their logo like
their logo needs help but apart from
that apart from that so okay we
downloaded their first app like the my
Ford Connect app and it was rated 2.5
stars I'm more like okay that's what we
expect from a car company the other new
apps apparently rated 4.5 Wow so that's
pretty good I don't even think Ford paid
those reviewers it was Duke so I would
say they paid a button some people but
not for it anymore cuz hate for Ford's
over hateful Ford is over not only is
hate for Ford over but if 2016 was the
year of the Honda and 2017 was the year
of the Toyota 2018 is the year the for
its 40 year that's right there's no
that's Vivian's last name that's true
that's you that means it's my year
that's right all right let's get on the
road okay so this car does not drive
itself which is a everybody for that
notice take this outside
I'm not self-driving car let's see other
downsides of a not self-driving car wait
wait
so let's engage the for its self-driving
features so let's engage into active
cruise control okay okay it's also got a
lane keep assist alleged
but it doesn't see the lanes they show
up green when it sees the lanes we're
gonna hack this with some open pilot
goodness real soon getting good at
hacking the cars bro but okay so this
car does have adaptive cruise control
and Link you persist and self-park yeah
now the adaptive cruise control the lane
keep assist with southpark all come in
completely different packages so you
have to buy three upgrade packages to
get all of them or you can just go ball
out and buy the Platinum package which
includes them all affording complain is
it that's right it's nine is it nine
it's ten what that was a terrible
experience doesn't have a GPS f-150 Broz
yeah maybe yo you guys know when it was
the Toyotas do we buy your the four and
how many Ford's are we gonna buy but our
gear let's see if we get the link
certainly keep it all and so allegedly
this cruise control works and stop and
go
trying struggling I'm struggling here
how to use it let's sweet breath into
two two this is wide open pilot has one
button phone oh that's a tragedy
I'm sorry Skokie's well we'll be around
your little power mode will last it will
kinda last yeah but ok so notice how I'm
like way over the lane line over there
I'm in adaptor cancels yeah how it
cancels out to 3 seconds okay oh wait it
automatically resumed okay that was
scary and um yep you cancels it should
not if you cancel this should not
automatically resume that bad design
okay so this car doesn't have like the
lane keep allegedly supposed to do
something by the way we heard that forth
you want to show up the thing that's
supposed to be sure was lovely she was
so much more lovely she's watching she
was so much more lovely than the people
at home the the last guys at Honda don't
deal with them you go home I wasn't
going home during fourthly we had good
conversation Kristin you girl alright
we're gonna go to the highway no we're
gonna go home because you guys have
already seen everything in the Ford the
list all there is to it might seem that
doesn't work they didn't try adaptive
cruise control on we did we did we did
but with the break we did it did break
no it did three well kind of and then it
canceled oh that was the car doing yeah
yeah you didn't mention it
so let's make u-turn here oh my god this
is so hard alright
no those radius the turn radius is
pretty nice and for the last thing when
we get back to the house we will show
them will storm so far yeah see if we'll
see if the south part is going to work
the year of the Ford no what about the
what's about the year of the fort this
is a great year guys you were two blimps
this is a great year yeah that's right
mark fields is that his name or did that
guy get fired okay so the lane keep is
on now so it's gonna lane keep allegedly
keep hands on steering wheel okay I
understand
okay no it cancels one two one two okay
so it stays on for about three seconds
so my press resume I'm that time outs
not in the PCM open pilot just might not
have that restrictions like super cruise
I think but guys if you guys saw like
the difference between me driving here
with open highlights yeah but let's see
if we can get it to park all the Ford
the Ford logo really does need help yeah
it just still looks so it just looks
like when did I buy this car like Ford
and coca-cola are really stuck on their
old logos okay coca-cola fine no
coca-cola looks very similar it's the
same type of it's different chemical is
a softer you want a classic soft drink
you don't want new technology you're
softer but I want a classic car you know
good Ford Tough that feels very cool a
fine fine maybe it's an appropriate bad
for the pickup trucks but here they are
trying to put in all this technology
right like it just doesn't look right
except by that yeah porn if you're out
listening if they said I had any
problems at all gonna bring it back I'll
return it no return it bring it back
classic car I'm with cancel cancel
cancel the year the Ford go will buy to
suit
you're gonna drive a Subaru next year's
good sorry Subarus don't get your hopes
up but this is the Earl afford 2018 is
the year the Ford my Ford GT instead
uh-oh
high 42 yeah I'm not that rich guys this
is the other Ford I don't know what you
it's gonna be next year but this is the
other part okay let's try this that
button now notice how it looks like it
was made in like god I don't even know I
mean kind of oh I have options here
about that okay perpendicular parallel
okay I stopped the vehicle I really I'm
worrying about this cuz like there's
just three cars
[Music]
oh we're gonna crash the house okay okay
this looks okay the UI looks horrendous
it's except for the fact that we're
parking right in this person's driveway
oh and that seems like it's tight it's
good it knows what it's doing
but how - is that moving steering way
all right back up prepare to stop
finished okay have you done honestly to
check the car yeah well I wanted to see
it for we did really well
oh good job Ford but I think we're in
their driveway in the driveway through
backup well they warned you know before
so we definitely they've given you a
note yes that is some passive aggressive
as sorry neighbors we love you fire
classic fire alright and that is a Ford
Fusion Hybrid energy it has this
terrible sticker on the window which I'm
deeply upset about it has practically
not why do I like this car I honestly I
got sold because it looks really also
got ripped off at the four - also not
really ripped off the grass they did
they did pull a little trick it has like
all of this nice stuff that you want you
know this car has tiny buttons never
mind I hate this car let's go back they
wanna buy a Ford Fusion will give you uh
let's see how's the stereo
[Music]
here with the Sony oh did someone say
you can't have this it's a Sony I didn't
see it I didn't I didn't see it I don't
think it's anxious somebody I think Sony
just like this is a brand name Dupree
shit yeah how many showbiz you got 50
sick yo check out the movie if you can't
see a thing all right well that is that
is our Ford Fusion the tape over it we
will so do you Matt part two George here
we go no no no we're friends with Sony
now we're friends with Sony you guys are
friends I don't know why I like this car
I'm looking at it now okay all right
this leather this Coco leather is really
nice do you like the cold air it's well
it's a you want to take less cold oh
okay no stop being dual you're messing
it up wait it's 61 degrees outside why
is it blowing 70 degree freezing it AC
it's not that doesn't even wait Oh click
on that there we go oh I see if machs AC
does that but can I have max
this is so cold we want you don't want
the coin this is so confusing okay so
you're getting to show this to them you
can do max AC which is that you can turn
that off and shut that off but then I
can turn that on and then what's that is
that max it's AC coming from I
understand yeah but notice that you
can't have max AC without that okay I
turn that on I turn that off it turns
off oh wait why did it go too low oh I
think cuz I've been on Max's let's check
out let's do a review of their nav
system oh my god oh my god oh my god
what they'll know where we live Oh
oh my god I would like honestly if I got
an iPhone and it was like that I'd be
like screaming the Apple Store that's
way more like good oh and now it's going
a hot air that's so hot so you put it's
okay never mind never gonna solve
self-driving cars the shit is unusable
[Laughter]
audio sirius satellite radio because
they know the sticker on the windshield
nice what apps do we have yeah
oh we can oh that's cool oh you got a
sink you're here for ya power flow oh oh
it's going from battery to other how
much on a charge do you get this is
total crap even the Toyota ones better
okay nevermind I okay what do I like
about this car let's be positive
interior is on point interior for has
come a long way on it on their interior
this is really nice it feels really
Pleasant this honestly is nice for the
Model S I would not go that far I was in
ok again maybe it was an older model X
but I was in a Model X if I was upset
with the interior a lot yeah the
interior of this is very nice yeah they
did a really really good job it feels
really nice the leather feels super nice
this Coco leather accenting the white
leather nicer than the Civic for sure oh
this is nice oh ok
interior is good yeah all the
technologies they have all the
technology at least at least they
haven't have it I mean that's not saying
much
pretty good South Park was ok ok I like
that I like that it turns the steering
yeah I know they have no way of knowing
it's a driveway but they could know that
you have to put a camera on it
but yeah I think those are the two
things we like about this car I think
yeah obviously the interior kind of sold
me know it does have nice ride quality
yeah it actually does um you know it has
terrible ride quality
the Acura ILX yeah I think that like the
Civic has really nice ride quality I
would say this is like riding car we
have to yeah also we can't say this cars
1550s sorry
$35,000 yeah the Raveis 33 it was like
33 yeah Wow dissimilar okay this is way
nice for me Acura the Acura sweet 15
though I know it's been 2 years no no
the interior and ride quality of this
car is like the most luxurious totally
it's so pleasant and it feels like
there's so much space like I can't
really explain the space but it feels
spacious it does it just feel spacious
you know weird thing over there their
technology is I mean I can't compliment
any of the manufacturers on this yeah I
can't I can't say any of them like okay
which ones better to be honest like
that's only like a little wacky yeah
Toyota what is completely the specific
is the worst because the volume control
the volume control knob yeah this is
like when you're comparing it to some of
these other person so whatever do you
know some employees who are wrecked cars
and put shit everywhere I can't come in
the night with you guys that's pretty
much there's gonna be the next car
supported by open pilot if you're a Ford
person buy one okay I don't buy it until
the end report done but yeah it's not a
bad car it started that car I'm one of
the things we're excited about is how
much that wheel can turn
yeah we hacked up the past of the Prius
as well
so we got we got some real goods a real
target the wheels now gonna be carefully
carefully put talked to the wheels and
then we're also gonna get a hack all the
for DC use now till we got all the hacks
to the Honda's ECU's we got all the
hacks authorities use don't have parties
yes just have them all we got everybody
out of town that's gonna be an exciting
day cool
let's go fees that's been my review of
the Ford Fusion 2018 titanium Edition
2018 year of the Ford jenefor thank you
for by Scopus
yo yo what's up guys did I remember to
share it on Twitter sometimes I get to
share it on Twitter yeah
no it is broke no it's terrible it's
terrible it brokes coppice i had demo
for you but it broke gotta fix up any
second
whoa Texaco peace stop cheating days I
know it's copy Friday that you know
honestly the real thing that I wanted to
talk about is something I can talk about
which is kind of terrible so much goes
on here I like I just can't talk about a
lot of it it's terrible
I can't talk about this oh yeah I'm
upstairs I'm upstairs I'm sitting in the
upstairs I'm working on grape and
development for you guys let me just
show you what grape pandas are capable
of give it a second you see that so
that's like where your car is gray
pandas make super accurate Maps so this
is also using parts of orb slam look at
the accuracy of this map and what's even
crazier is this map is 3d with a grey
panda and with the camera already in
your yawn we're making maps that are
accurate to 10 centimeters look I can
zoom in here these are trees and then
this is what it looks like
okay let's beam Genki but this is the
map is the mapping from a depth net used
to slab no actually the depth that's not
integrated into here so the way that we
get depth is using a technique called
structure from motion ah but yeah so
this is this is just generated from an e
on route with a gray panda look at the
precision accuracy up now you can say
that okay why don't you just use orb son
the problem with just using warm slam is
you get scale drift from one camera so
what we figured out how to do was
incorporate a GPS so you don't get any
scale drift this is a map of our
neighborhood created with a gray panda
and with the camera you know so our
promise is that we're going to
open-source our HD maps by the end of
the year so mapping companies should be
afraid do you combine data from multiple
passes yeah sort of coming soon oh but
this is where we are right now
that's it finding itself in the map
you're doing a nice app project pretty
cool um but that's one of the things I
wanted to talk about the other thing
that I wanted to talk about was great
handes I've arrived so I know you guys
got the great pandas here in the mail
here's a great pan is sitting in and out
of stock comedy bug or maybe some of you
were sticking these on the windshield
pretty nice right at that VHB but here's
a grape and these guys know all this
stuff is for sale at shop comma dot a
hike or I made it work coming out I
slash out so much goes on that I can't
talk about y'all check out my auger
hoodie pretty nice right
I got team ten hoodie chose my team
penalty I bought team ten hoodie yeah
bought team that honey
yeah what out you can keep secrets not
you can't keep secrets this is the
internet Braille there's no secrets on
the Internet
but tell me tell me tell me what are we
gonna talk about on sculpey Friday yo
the reach outside get from people of
ridiculous and again I even feel too bad
to let you know what should i do I
should post their ridiculous emails on
Twitter and make fun of them guys maybe
I'm maturing maybe I don't do that as
terrible it's really terrible you know I
always give this advice to everybody
don't start a company need to promote
call me out with look I'm kind of over
Logan Paul I still really like the
Maverick joggers like they're really
nice pants
but since Logan Paul came back on
YouTube he's been weak I'm a PewDiePie
fan though yeah what days of super is
bad every day bro yeah props to props to
Greg for that right oh man but she went
down today bro shit went down oh man
check out our checker boards gonna
calibrate your cameras and calibrate
your cameras with checker boards look at
him we got a mobile checkerboard and we
got a wall checkerboard
oh yeah the problems with some of the
Toyotas apparently they don't have DSU's
and they've integrated the DSU in the
radar you guys you know what like man
there's so much we work on now that like
we just don't talk about and it sucks I
mean it sucks that you have to do this
right like now I understand why startups
are in stealth mode but you know we have
we have some we have some amazing things
happening all compatible with with yawns
with pandas you know with with with all
the comedy I merge so get on there guys
we need you know buy buy stuff man buy
stuff it's good buy stuff go to shop
back home today I tell your friends
which do affiliate marketing for pandas
that's gonna come soon let's do
affiliate marketing
you're gonna be on Skokie Friday there's
nothing incriminating the way but I
locked okay well yeah showing up four
sizes to go peace yeah special modify
door slam um you need help with I didn't
watch that guys talk help with the
Toyotas we can talk about that and what
helped is how many I need we're looking
for react we're looking for
infrastructure looking for just people
who are like like guys no physics like
no things you don't mean no it's not
about our deeds it's just about bullshit
um what are the negative impacts of
sharing our MD not that many I don't
know can I build hype you know hype no
we're anti high oh I got I got to keep
that straight um does open pilot work in
Gran Turismo
why shouldn't you start companies bro I
started a company once I don't know I
mean I've never had a kid that might be
that might be worse but I'm just saying
you know you know having kids makes
people less happy than before they had
kids it's real shit um be looking for
react we're looking for infrastructure
we're looking for social media
coordinator but we're not actually oh
yeah but no but but but honestly guys
know things this is my general rant like
I look around at the world and I'm
always like how does that shit work like
little things like guys how many you
have any bites on a DVD say I thought
this was common knowledge I thought this
was just like everybody kind of knows
this like just not surprise me
price on the social media coordinator
that's right
let's take a look at our view
y'all high-definition maps of the world
see what you don't see about this it's
like okay you think like oh we just took
works on them right on the videos yeah
you can take course let me run other
videos but this stuff is all accurate to
10 centimeters
thanks to gray panda technology 4.4 GB 4
point 4 GB your closing is four point
seven it's not too bad though what are
the black dots oh the red dots are the
ones that are currently a view of the
camera it's being really slow but the
black dots oh they're just like features
they're like points on the world right
so you can see like like they're trees
and stuff
maybe if we turn that off you even like
zoom in somewhere we have lanes you'll
see the lanes see the lanes don't follow
camera this is called panda Lane it's a
piece of open-source software
yeah you guys see those lanes look at
those lanes I'm so each one of those
points represent a feature in the world
that you can track how precise is Eon
GPS for Panda the you know the grape and
is about ten times more precise than the
eland GPS so yeah get on there get
you're a great pianist and it's really I
mean it's not that it's 10 times more
precise it's like it's like 10 times
less noisy it really comes down to the
fact that there's an antenna and the
antenna is mounted on the on the like
outside I'm not hidden deep inside this
phone
it's like want me to reverse 10
centimeter yeah it's more like 10 meters
first 1 meter GPS isn't very good
those are soccer players I know that
like they're kind of kicked the ball
around not the American footballers man
you asked me like Tom Brady or Peyton
Manning
I might have an opinion maybe um
Manning's retired yo Eli still around I
think how much was gray pan 2 depending
on whether it doesn't care
oh yo you guys want to look at the comma
tree let's go look at the comet
my bathroom um we have a comma tree here
base station D pretty well so we're
gonna release our first stuff it's
actually gonna let you guys use gray
pandas I'm in the next shipper plus
release coming up Monday so here's our
here's our gray panda for our base
station which our base guys hang whoa
look at the comma tree if Caesar light
whoa look at the comma tree you can't
even see it so tall it's so tall smoke
time that's I think yeah sounds like a
plan tonight all right let's do that
oh yeah no it's really tall you can't
even see the top guys I don't know how
to turn the light on on periscope can I
do that oh yeah I think I figured that
I'm a tree is where our GPS antennas are
so they get a really good view of the
sky this is just made out of a four by
four we bought at the hardware store I
actually scratch the roof of the rav4
trying to get that home oh that's the
comma tree you can see it out there um
it's GPS base station for your home
all window here and it connects right up
here to this gray pandas gray panda we
also have a Trimble receiver - Tom are
greater than load and Rita looking is
not lit anymore I am over again I am
over over Logan Paul I like the pants I
might buy more maverick joggers but just
as they're very comfortable
when will the tree be percent yo if we
figured out how to ship you guys a tree
check out the jacuzzi in the combat
house yo yo I don't think anyone's been
in that for months
I'm GU thinking about going up with
balls but then we realize that Logan
Paul already did it - bits going on a
comma this week we shouldn't happen this
week we switched with you Sprint's now
two-week Sprint's figured out how to
ship 4x4 us you know it's not fun today
calling FedEx because my package was
late don't tolerate that shit tell them
they gotta get the package on time are
you going to refuse the liver all right
this was a good sculpey Friday the map
still here
still there yeah I can show you guys
something - I've been working on we've
been working on moving past orb slam
been working on our own orb stuff so ice
a little more colorful just go in here
so this is this is this
oh is this an age do you want is that
why it's not working I see why this
isn't working
I made the map with a not HD route this
is the new HD camera look at that guy's
but now I'll play back a non HD one
you'll see the difference so that's like
a picture of a full HD one well amazing
that it worked at all okay try to figure
out what isn't working but like now you
see the green thing and it's moving
through the space as this moves through
the space there we go so we have this
tool called unlocker which can replay
any of the routes that's a dongle ID and
that's a route ID there we go see that's
not HD better so we're moving through
the world got all those points up this
distorts empathy that's not even wearing
its Lambo right now it's just running in
like la mode this is doing the law and
flag it won't be like no one just do for
speed but look so you can see you can
see it moving through space right there
whoa look it's moving through space
well it's moving through space so why is
this needed in the first place Oh to get
things really really precise right what
we want to the final system probably
won't have maps the difference in our
version of orb slam is that everything
is actually precise to the real world
so we know where each one of those
points are in ecef coordinates which are
the coordinates that determine a point
anywhere on the earth put that happen
you want to buy this one I just cleaned
this that's what I did last Friday
night's telescope you Friday I cleaned
my keyboard get on nice and clean it
yes let's go here you doing here and
follow the camera look look we're
driving we're driving Bros is there any
point in mapping traffic lights or signs
yeah we're gonna map them all
photogrammetry library this is using
parts of warp slam - and parts of just
Python we wrote and this is actually not
a loop closure so a lot of slam relies
on loop closures so we actually didn't
close a loop just cuz the route didn't
close the loop no so this is done this
is a fusion of the camera the GPS and
the IMU
so what does orb Savina check it out
it's a piece of open-source software
it's pretty cool
oh there we go with driving driving
driving driving all right so it's
basically we're going to show you guys
guys there's so much more stuff that I
can't talk about yet but come AI this
year man this is gonna be our year 2018
2018 yeah it's pretty cool that was
pretty cool a shipper plus auto focus an
HDR is coming next week coming next week
you want to talk about the Toyota
problems the world doesn't change that
much actually
I'm gonna talk about Toyota problems
what are you total problems about the
other radar oh no Bruce you're probably
gonna have to figure out maybe how to
change the firmware on the radar maybe
do lateral only winter HD that's coming
out by the end of the year will have HD
maps are those are soon TM we'll see
we'll see about the HD Maps but they're
gonna be good and they're coming by the
end of the year and mapping companies be
afraid be afraid be afraid you know why
because every time you want to get more
Maps you have to buy a car and drive we
have a network of people all you guys
the cama army out there improve
this could be anybody's Drive there's
nothing special about this drive join us
or die as the theme for 2018 all right
No thank you scope ease for joining it's
been a great scope you Friday I don't
think we're ever doing a scope E Friday
again we'll keep it to Skokie Saturdays
and scope e Sundays later if a major
automaker wanted to acquire you know
he'll know do I want to wake up in the
morning and work at Toyota Navy do I
want to wake up in the morning and work
at Ford
hell no do I want to wake up in the
morning and drive a Subaru no no sorry
sorry Subaru people's like the power
glove those funny whoever posted that
slack all right all right thanks RB bye
bye
all right
eddie you know how to camera no
oh
i'll try
it the best angle is to get it up here
so you got you should switch your seat
to there so you can get george steering
wheel and thing i mean i basically
killed it you know i like did a
wonderful job good morning scopies
[Music]
got we got we got some weight where am i
going that way yeah go that way
good open pilot
i got 19 people rolling in got 90 people
rolling it with my shit all right all
right guys we just did we just did 41
action news don't bother watching it no
no no we're not gonna say that um
you know the reporter is very nice
there's
unrealistic expectations
around what self-driving cars are
um you know you start out the interview
and this is why we're never really going
to do press demos again
um
at least not until they are like
flawless door-to-door because this is
what people expect right people don't
understand really what a hard problem
this is now you just saw what the car
did right you saw it take that exit you
saw it no it's not been messing up um
for like five minutes and
i'm impressed by this
but
your average person is not right
um it works in the mirror which is kind
of cool yeah so usually we usually
switch to horizontal oh should i switch
strokes
you you guys like this better
horizontally to work better um
a completely unrealistic expectation for
what self-driving car technology is for
me i'm impressed if i do nothing for 10
minutes
um they see one mistake and they're like
oh this thing is horrifying of course
it's horrifying if you put it on the
road without a person right
um and i think tesla's figured this out
this is what we were talking about like
you see right here i actually didn't
mess up there but like if it went for
that exit i would still call it pretty
good dude that exit was viviane did you
see that no that's funny
um
no but you just have to yo if we ever do
a press demo again we have to script it
so well we have to know and it's just
not worth it
it's really just not worth doing guys
like you know
and you you just have so much out of
your control
um versus i mean these periscopes like
you really see what the technology is
i don't know so i don't know how you
deal with this problem maybe you uh pay
overpaid media consultants to uh
you'll know i'd never do that shit like
they know wait if i apparently
oh i thought it was gonna oh i rebooted
didn't i yeah i thought they fixed that
bug
the bug with the i thought it would show
the set speed when you were in ways yeah
they haven't done that yet no
um but yeah no doing doing doing press
is kind of a kind of a bummer y'all
yeah so eric moraga is saying the
self-driving car should be renamed to
enhance cruise control well but okay so
enhanced cruise control is fine but you
know that's not a very splashy marketing
term right
um and you can even use the worst term
driver assistance system and nobody
knows what that means right and saying
self-driving car triggers the dmv
i mean i kind of love triggering people
we love the dmv we respect their
authority but like triggering them is
just kind of fun
ah
of course you know you can say whatever
you want because this is america and we
have the first amendment it's the
internet
all this data you can really say
whatever you want on the internet right
um
how do you read these comments when
we're horizontal you got to kind of tilt
your head eddie oh
oh that's just because i have
orientation lock on my phone
give me the phone i'll remove that
i can't wait anyone who likes
orientation
oh i love working walking watching this
sideways no no one was watching it
sideways
see i'm super impressed by that
yeah did it do this with her
yeah but the whole frame is right away
why can't i enter my destination why
doesn't it work at red lights like
you don't understand like this is most
driving yeah
um but i don't know i mean i guess
people don't see
the usefulness of a 90
self-driving car
yeah
well certainly not people who like walk
to work and then you know who don't
really drive around and who
don't use a car like a majority of
people
there's a car people i have people in
kansas city definitely commute it's it's
just uh
i don't know
um
what do you do about it you got any idea
scobys scopies what do we do to better
make the public aware aware self-driving
questions and reasonable expectations
you know
yeah we're on this forever
uh welcome as sons it's their first day
on periscope that's right you guys go
first
sons um
yeah
easy suns
you know what's nice we can be out of
kansas soon man you thank god team four
is asking why in god's name are you
driving to omaha omaha nebraska omaha
nebraska is a sweet place we're doing a
presentation at the university of
nebraska we're going to the metropolis
of america that people don't yeah man
we're going we're going to america's uh
vanilla gorilla
how the news is going how did the movies
go
you missed the little rant it was okay
we missed them it's okay it's okay it's
okay the reporter she was very nice
um but there is a there is a
communication issue right so okay so
first off i mean let's break it down
right you know i'm very honest with you
guys obviously you have 41 action news
right so already what that does is like
set up the frame of stories they can do
in canton we're like okay let's do 41
action news you know there's no way this
could be a head piece right
um unlike reuters there's a terrible
news organization
writers is banned from comma um
seriously seriously reuters is banned
yeah um
no we're like okay so the frame of this
story is always gonna be it's puff
pieces right
the problem comes in to you can't
promote something as a self-driving car
now you can fix all of this in editing
but then it's then it's fake and i
really don't want it to be fake right
the truth is there's very little news
that exists to actually inform the
public right
uh news plays on your emotion it doesn't
exist to educate
so this is the
smartphone we don't do that on periscope
do i play with your emotion people just
go fees do we play with your remotes do
we play with your emotions they only
send us love man they only send us the
way you always can man
but that's the frame of periscope right
you can talk about the frame of 41
action news you can talk about the frame
of periscope right
there's also some hate on periscope well
there's something there's always going
to be there's always going to be some
hate you know what i'm surprised by any
time our shit gets posted on reddit it's
nothing but hate
anytime i should get posted on youtube
it's nothing but love man and hacking
news is a bit of both uh hacker news a
lot of hate
hacker news is is just yeah hacker news
is hate i mean hacker news is is the
truth is
the people who read hacker news are very
distinct from the people who comment on
hacker news yeah a lot of people read
hacker news and they're generally the
positive people the people who comment
are kind of like the that's not so hard
man i got a guy who could have done that
in
three days that's the case the people
comment are different than the audience
yes no but i mean it's particularly true
about hacker news because hacker news
you have a lot of you know
um
you're like uh like
maybe uh armchair engineers is the worst
news arm chair engineers yeah
um they sit in their fucking castle and
comic con i'm impressed every time this
thing like gets down to the six-minute
ball yeah right but that's also kind of
a hard thing to convey
on a short news session right right
because the truth is what this is for is
people who are just driving for like an
hour
which is a lot of driving is inherently
this incredibly
boring thing when you think about it we
are self-driving right now team four
there is no knee driving not doing shit
um yeah i wonder how many people think
it's like me driving so many people
how many people think we're cheating you
guys the reason you think we're cheating
is because the whole world is cheating
right and there's no penalty for
cheating because truthiness beats truth
yeah
no there's only reward for like these
these amazing videos that people make
yeah sell 800 products no like we fail
we live in a world today where
truthiness is more believed than actual
truth right like truthiness is the the
like first glance believability
reset the bar
um
yeah
so i don't know man
just when i think i'm thinking last
night that like you know we're about to
have a paradigm shift and realness is
about to come back in you see that and
it's not even it's not even like the
fault of anybody you can't really point
fingers but just just it's a structural
problem
i'm really sure you deal with that
we shouldn't subscribe to their
emotions
well but it's not it's not like bullshit
right like like don't again there's
really there's no malice there right
they're just like operating in a world
where certain stories can spread
you could talk about that a lot with
outrage today right yeah it's hard to
even attribute malice outrage just
happens to be a more viral emotion
than um well then like positive emotions
oh absolutely
why do people watch the news why are
they watching action 41 news anyway you
know they're not there to get like a
nice pleasant no well at least like you
know you're always hoping morning shows
are certainly better than like like the
five o'clock news and the seven o'clock
news five o'clock news did you know
about these seven things in your
household that can kill you
make sure you're tuning in after this
commercial break yep
barbies
eat bacon cheeseburgers they're not one
of the seven things that can kill you
but to be honest
the most likely thing to kill you know
and they're talking about like yeah this
woman had a stove fall on her
and she died watch out for stoves there
in your house is your stove buckled to
the wall
this fucking bullshit man watch out for
baking cheeseburgers they're actually
more like me to kill you right
and it's actually likely to kill you car
accidents yep if you're young uh well
actually there's one so i'm i'm a 27
year old white male uh 28 28. my number
one risk of death is suicide
um
followed by drug overdose followed by a
car accident yeah
um so that that's that says that's a
little hard oh we're almost in missouri
i think we saw the welcome center
in missouri been in missouri we've been
oh we've oh we've already left kansas
wow we're going to afghanistan we just
cut through kansas now we weren't even
saying the makerspace was fun last night
yeah
we went through a nice space um that was
a really cool space
not even i just structurally don't know
what to do about this
but it would be interesting to go back
when tesla first introduced autopilot
and see what did they do right did they
just sell it to the people who were
buying the cars and they were like you
can also get this and you know it's an
upgrade and blah blah and it'll assist
you in your driving or did they do a lot
of press no i remember the early
marketing we could talk about that was
in a minute but first off i want to say
that this sign is brought to you by dan
carlin's common sense
dan carlin has this this great show he
also makes this other podcast hardcore
history
um this is what we're listening to the
seasoning
a lot of this sort of like
it really it really helps teach you how
to think yeah um so i i recommend uh
both common sense and hardcore history
uh yeah no that's what the little
signing just that one not all just that
one
no what tesla did for autopilot was
they announced it they didn't really
talk about what it was
interesting i'm like i've been in a car
with autopilot
and and you watch these videos and to be
honest so so so talking with the
reporter this morning she said like you
know tesla autopilot is way better
and the reason she probably thinks that
um is because she used tesla autopilot
on a stretch of road like this with
different expectations right
so we we've been driving for for like 25
minutes now and i've done nothing yeah
um but when you're in a 41 action news
segment and you're trying to get a shot
it's it's a different it's a different
frame
yeah
yeah
guys reverse engineer everything you
know reverse engineer
i mean the people that that know that
it's better
they they get it
we don't we don't need to to hype it up
to people that aren't gonna it's not
even really better look it's the
identical thing no no no i mean it's
better than what comes on their car
right people buy something that oh yeah
but these people would not the people
like in actual 41 news would not buy the
stock system on the car they would not
pay the extra thousands not only no no i
wouldn't even say that right it's not
even no disrespect to actually 41 news
they probably would they probably would
right but they wouldn't like think of it
in the same sort of class right and
maybe this is our fault for calling it a
self-driving car right
look we're driving better than that
truck look at him look at him weaving in
and out of his look at do you see him
drift a little out of his lane yeah
you know i see trucks do that and i
don't know whether to blame the truck
driver or like the wind it's the wind
they might be i mean i've never driven a
truck i don't know i mean i think it's
pretty uh tan dan 90s asking what state
is this for uh stone missouri
missouri missouri wait
when do we get to oh we're in missouri
oh we've been in missouri the whole time
we we just had this conversation five
months ago
no i didn't forget that we're in
missouri obviously but like
when do we get to nebraska y'all yeah
that's that's what i'm wondering yeah
i'm just like the show
is the show me state kansas or missouri
show me what
it's like the slogan it's like to live
free or die for kansas it's kansas so
what's missouri's slogan oh it's
missouri because the restaurant we were
in was this rogan is literally it's
missouri no no no it's missouri slogan
the show me the slogan oh the show okay
so what's kansas's slope um probably we
got a lot of prairies yeah
and like single oil rigs on the side of
the road
we've had so many of those
so weird oklahoma kansas city great song
wait is there a kansas city oklahoma no
no but oh no oklahoma oh
isn't there another musical
guys i'm bummed out this morning yeah
george at least it wasn't live there he
is show me state any chicago upstates
no time for here you know no it's not
even it's i'm not bummed about how the
press went i don't care about that what
are you bummed about that the world
isn't uh opening their eyes well not
that the world
it's that we live in a world that is
completely incapable of thinking
critically
right
i mean like like like like this is not
think do this problem on a high level
and think about i mean
so okay there's a saying in the media
right the second you're actually
educated on a subject you realize what
bullshit the media is right like you you
look at the media talking about like say
you say you know about like you know say
you're you're a pilot you know about
airplanes right you look at the media to
talk about pilots and airplanes you're
like wow they have no idea what they're
talking about yet these same people
still trust the media on other issues
like artificial intelligence right i
don't know maybe the media knows but
people are not like people don't think
like wow i'm a pilot and i know they're
bullshit on pilots why do you not think
they're also bullshit on artificial
intelligence or things like that right
it's a structural problem that's what's
bumming me out
maybe it is better with things like
youtube and periscope i mean you
actually can kind of see the truth right
you you remove the middleman things are
always more honest but
yes maybe the world is going in a better
direction
but then you have you know sites like
facebook which maybe facebook starts out
as you know you're seeing updates from
your friends on news feed
but now it's you're seeing buzzfeed
articles
right you're seeing shit like that
people who have figured out how to game
new media yeah the systems are
exploitable
and like the exploit for the system that
i'm talking about is kind of like the um
truthiness
is better than truth
and i don't know how to overcome this
and like on any platform you could start
out with this
very truthful guys
i want you all to scopies right now see
look it messed up a little bit there but
you know that was the first time it
messed up in like a while um and we were
honest about it we were honest about it
right scopey's i want you all to hold me
accountable if i ever become bullshit
please let me know
but still not listening because you will
have become bullshit
i know i know i won't listen and that's
see that concerns me right like do
people grow up thinking i want to be
bullshit when i grow up no it just
happens then they just come in it just
happens they just fall
into it
gotta put it put it on the blockchain so
like it gets executed whenever you
become bullshit oh my god have you seen
what bullshit blockchain is
like here you have these people oh my
god and this is why we can't do the ico
hi guys we were gonna do an ico but we
can't do it because crypto's full of
immature idiots who want to be crypto
rich we don't want them no we don't
because they ruin a community right
um
yeah right like you can't you know
bitcoin starts out is this really fight
for like liberation and truth right i
mean this
this is the same complaint i you know
you have about like punks right and
everyone is still a real punk is
probably complaining about this
saying like punk became a brand we
literally tried to be anti-brands
guys this is really bumming me out here
i don't know man i want to know what you
would feel like if someone else had
built this and you just came onto this
into this car and rode the system for
the first time
i mean that was very hard
but
i would have technical criticisms and
complaints right
um
but then you know if you talk to me
about like the machine learning and talk
to me about like what's involved i'll be
like yeah i think we can do better but
like i get that it takes to be honest
i don't know i thought i could i didn't
think i could actually solve elon's
vision problem in in the four months
what he asked for was basically a
replacement of mobilize iq3 and that i
thought that i could actually do but i
mean hello we have two lanes a holistic
path predictor and a lead car predictor
it's you know where do you think we got
those ideas right they're obvious ideas
but
yeah
it's it's you know it was what was after
me in the tesla contract right
um and you know finally now we're
talking about how to move to a new
architecture
that would be an interesting perspective
i guess yeah but i think you'd be more i
think you'd be more harsh than you think
you'd be oh no i would absolutely be
harsh right but it's it but it's even
beyond being harsh it's like
he's critically thinking in the right
way yeah yeah outrage
no no no you see the thing is like i
might be harsh for the first like couple
minutes yeah but then i think that i'm
the type of person who you can sit down
and have a conversation with and i'll
like
you know i i do want to know
yeah but scopies who are watching who
used our system for the first time like
what were you thinking yeah were you
guys
in the first moments that you used it
were you
freaked were you comfortable with it
impressed depressed
have drinking thoughts
no one's used it someone's
i guess they had low expectations right
it's not even that right it's realistic
and it's also that they were like they
drove the car before the system for long
periods of time and then they put the
system in and they're like and the stock
system so they can see how shitty the
stock system is yeah maybe they even
tried the stocks but to be fair like
there is no stock lane keep assist on
the toyota yeah but you can still have
adaptive questions
said he tried it uh
for the first time was like oh my god
this is a whole new world right really
but that's exactly of course no no like
i believe that the people who actually
understand especially the people who
build it certainly feel that yeah right
but this is the whole i'm not you know
the system like like is what it is and i
think we're doing you know just you know
we're doing are we doing great i mean
everyone can always be doing better but
like you know hey it really is way
better than what the honda and the
toyota are shipping right and and theirs
is dangerous
dangerously and how thankful were you to
have a system yesterday the system's
nice right
not even that like it's it's bullshit
does anyone really need any of this no
one really needs any of this
honest george
no one really needs any of this right
like no one really needs like anything
in the world
you know like one percent of people make
all our food and like
you do but where are we gonna get growth
from
oh i don't know about i don't know about
like you can't have all this like lack
of necessity for things and massive bro
but i'm not saying like it's bullshit so
we shouldn't do it i'm saying it's
bullshit and we should recognize that
it's bullshit and then do it anyway
because like hey man what are we doing
everybody's doing bullshit like that's
just
so expensive brownie face what the
hoodie is so expensive
it's like the supreme logo like if you
get it you know what you know what in
honor of that guy when we get home we're
double in the price of the hoodie okay
but seriously it's give you 249 240.
249. 249. it's a little less than double
yeah but seriously the hoodie's going up
to 249. so buy already right now
in honor of the world being bullshit
it's now
yeah yeah can we can we edit that from
shopify on your phone
let me see
bitch says i cancel my tesla p100d order
to get a car i can run comma on your
pace and lack of bs is good
right like yeah i mean there's this
people who do appreciate it it's just
not most of the world
but you can't like make people
appreciate
let's just pay them in here
something that they don't understand i
mean
what are you trying to convince people
don't let me forget scope i have a
couple times hoodies are going up yeah
you have a couple things to remind me
guys okay no i'm trying to experiment in
january
i'm buying a fat suit
and then i'm gonna wear it around right
and if i like i buy a suit that adds
like you know 30 40 pounds to my body
i'm to get ripped just by pacing yeah
george paces he paces throughout the day
he gets like 10 000 steps
when he just talks to you guys we should
periscope more at the office
it's actually a fun time
yeah um live transparently y'all yeah
start the real pin out the cunts got the
real panopticon right
um
tattoos think it was gonna do the ico
the panopticon foundation yeah
jamaican joel says can i sell my own
counterfeit hoodies for a much lower
price no that's trademark infringement
we have a trademark on the comma fuck
off we're gonna sue you we'll see you
we'll see you love soon people our
lawyers will sue you we love the worst
to be honest if you sold knockoff
hoodies
if it entertains me i would let them
stay if you put it this way if you did
it as a joke i'd be totally fine with it
if you did it and tried to like
seriously make money doing it and you
were serious about it fuck you i'm suing
you
tan dan 19 says where are you going
we're going to omaha we're going to
omaha we'll be at a mantle hall at 2 p.m
on the university of nebraska's campus
yeah will they go by ufn
we're gonna go to you event and i
believe there's gonna be hot chocolate
that's the word on the street and maybe
some some snacks but i'm not sure
it's like elon's pat thing you know elon
likes like like lets people use his
patents according to election license
screaming i like that if you don't take
the world seriously use our shit
do you take the world seriously
spread the word about truth
right
truth and realness
yeah
it's one of my real values
reverend said there's cookies coffee
hot chocolate
coffee
yeah yeah alex benitez is asking is
anyone working on open pilot for semi
trucks
is that the banned question yeah cause
we've gotten that a lot oh no that's not
a car though that's not a car you said
people can't ask about what
that's less of a bullshit question
um
i don't know man
i don't drive a semi truck i build ship
for me
like it's sounding like a like a big
truck yeah yeah yeah i see y'all
i don't drive those i mean it's really
really good they look like fun
baby if we get a new ceo next year
pandas are not compatible with uh 24
volt systems out of the box oh no semi
trucks don't actually have it they have
a different connector though um they
have a notch in the obd of semi trucks
so that you don't plug in so that's that
is good yeah don't plug a panda but
someone should make a 12 a 24 volt to 12
volt panda that dude that'd be cool
we can make 24 of all pandas for ten
thousand dollars a panel yeah
yeah and if you complain about the price
it's doubled so you know yeah that's
right yeah brevin seven semis are 24
volts no but seriously hoodies are grown
up in price yeah buy everybody before
jan first
at the beginning you actually got two
hoodies yeah because it was the medium
large size now you get one and then
hoodies are about to double in price
yeah yeah i love it yeah right like
those people who have hoodies man that's
an appreciation
get in early get in early on hoodie coin
but hoodies are not a security yeah they
do not pass the howie test they have a
functional use people bought hoodies for
many other reasons besides an
expectation of profit
when the people who claim to be
educating
are the biggest scammers in history
no one wants you to really be educated
yeah
well
i think people have forgotten how to
educate her
you see like you say this right and like
like i mean this is like a this is
almost like like the the the fantasy of
make america great again right like it's
i'm not sure people were ever better
yeah the same bullshit man i really
think it's the same bullshit like you
know you had people back in the day
selling like snake oil elixir down here
um yeah these people are a little more
informed now you know yeah maybe google
it and like find out some hard facts on
wikipedia yeah come on out there don't
use facebook download the wikipedia app
today
and just read wikipedia but also people
i feel like confirm their own biases so
much more today than they ever did
before
it is easier it is easier on facebook
you can find you can find news that
supports literally whatever like not
even whatever opinion you have but
whatever truth you have and studies
studies as well yeah right
like did you guys know you can't get a
speeding ticket if you're behind a car
that's going faster than you guys let's
go in the same speed
let's hard code
someone said i want to buy the full set
panda giraffe and the neon and the
hoodie for 250 but i need a support
we don't do shit no support there's no
support
just so let me tell you seriously when
you send an email to support we give you
two support choices right
support choice one it's open source fix
it yourself
support choice two send it back for full
refund
i'm not i'm not like oh someone someone
sent a support question they sent like
educate yourself a screech out of the
camera right yeah like the camera always
has like a kind of halo around the edges
yeah it's cool but they're saying the
camera is dimmer than it should be yeah
what's it called again all right vision
netting vision netting yeah vision
vision netting
yeah what does it do you know like some
snobby french photographer yeah exactly
visual netting i like that right
no that's just it's an effect of the
lens of you don't see it on most cell
phone cameras because they're correcting
for it and software right that's that's
truth right there right yes
big netting it's spelled like vignettes
magnetic yeah
oh guys i'm just bummed about the world
so to get exact directions on what to do
with oh you can uh there's no directions
like university but there aren't there's
a get home you can find
if you don't know how to like like at
least like read code this is not for you
but we appreciate your business no we
don't we honestly like almost don't like
like even though we don't appreciate
your business but like if you want to
buy okay so i have a saying right i have
a saying it's a saying i don't want to
say it's keep hacking elite right
um and people first hear that they're
like oh keep hacking the lead you mean
you only want to keep hacking confined
to the elite few people no
keep hacking elite means recognize that
hacking is an elite skill
that anyone can learn but only a few
people have right in order to get the
skill you have to put in time and learn
it
and it's the same thing with this right
like self-driving is a journey
and this is something that is really
lost i'm not on a like a fast
yeah eric is talking about the community
support though that that has been
heavily there's great community support
but like you don't have to be willing to
put in time yeah right well this isn't
for you
like look it'll get easier and to be
honest what's probably gonna happen
longer term with common ai is somebody
else is gonna figure out how to package
our bullshit and deal with consumers
um
but i don't know i mean
i'm here to actually try to change the
world right
you don't change the world if you just
like keep it on the same trajectory but
faster right
you know you're not like like changing
your course i wouldn't be changing
anything if i you know sped up to 90 on
this highway right
you can change what is in faucet nobody
knows man nobody's ever been there
dude it looks like that just look
nobody's ever taken that road before
yeah open balance isn't good i hope
impala wants to go right open pilot
cycle
this thing is passing me again the rav4
is going to be on one of those we're not
driving back look at that nice wrap yeah
look at that right what in front of us
is that a round 40 it's a shutdown it's
a rav4
no yeah there's burgundy
oh oh hold that i think about that
every car looks the same now
that's right
all right go open pilot go go go eon
engage come on go go and go
nice yeah
uh wiki fm radio said could you ask
george about the time complexity of lord
floyd marsh
floyd marshall's album oh floyd marshall
that's that's okay so that's um
complete graph traversal
i think that's like dykstra from all the
paths naively off the top of my head i
think
okay so so floyd marshall is is dikes
it's like it's like pre-solving dijkstra
right so so dijkstra is given two nodes
in a graph what's the shortest path
between them
um
so if your graph has v vertices
uh
[Music]
v squared e
or just like n cubed if you're kind of
like like just oven cubed that's the
shortest i think it's v squared you know
so so floyd marshall solves dykstra for
all the paths
um i can think about this a little bit
more right so you want to know basically
the shortest path between any two
vertices in a graph
and the graph edges can have weights
um i'm pretty sure floyd marshall has
three loops inside of each other i have
written it before
um this is the downside of being allowed
to use the internet during competition
programming we would use the internet
during competition programming practice
and then we'd go to the actual
competitions and they wouldn't let us
use it like flip through you bring the
algorithms there you bring like
interesting stuff
you can print stuff out too
so you'd print out i'm sure i'm sure
you'd literally have a floyd marshall
implementation there ready to go you
just kind of shove it in but yeah okay
so let's see what you do
um
so oh god even if you ask me about the
complexity of dykstra i have to think it
through it these are not things that i
know off the top of my head but the
truth is you don't want to know shit off
the top of your head you want to be able
to think things through right but you
have to have
some basic information
so let's let's go over a little bit of
basics do you guys know like what a
graph is
yeah
yeah
he said o v
o v cubed okay it's v cubed all right
all right all right so i had i was close
to the order of magnitude but for some
reason it's not
o v squared e
and the number of edges apparently don't
matter
yeah i mean okay you can see kind of
intuitively why that's true
right because i can't imagine like a
complete graph taking
um
i could pick it true i could i could
rederive the uh the algorithm anymore
any more comp side questions uh
marshmallow no we're not reading uh car
compatible
you know what let's let's let's derive
and let's figure out why it's a cube
right
so you you have a you have a graph so a
graph is is is when i say a graph you
know i don't mean like like a time size
i know what do you mean by yeah what
graph are you talking about so a graph
has like vertices and edges okay right
you have like like think of like a point
and then like edges connected right
and the graph is like a structure when
they talk about graph theory it's not
about you know what
it's not
yeah yeah i mean i guess you could graph
y equals mx plus p but no it means
something other than that right alright
so let's rederive flood marshall
uh so so first off let's figure out the
time complexity of dijkstra so if you
have a graph right
think about traversing a graph as you're
trying to get from this think about okay
here's the simplest way to think about
it uh it's very relevant because we're
on a road trip think about each city
like a vertex right and each road
connecting them as an edge
um
and then
each edge has has like a cost right so
there's a cost to traversing that edge
right so you might think of costs as
like times right so we're taking the
highway from kansas city which is one
vertex to omaha which is another vertex
and this maybe has a cost of you know
since it's let's say 180 because it's
180 minutes right
we could also stop by you know whatever
like like rubber or faucet yeah right
faucets maybe this edge over here right
and maybe it takes um
you know 300 minutes to get from faucet
to omaha and then 100 minutes to get
from kansas city
so you could take this path in the graph
for a total of 400 or you could take
this path for for for one eight okay
so if you're if you're running dijkstra
see these are things that i just should
know off the top of my head but i don't
it's been a while um
you want to figure out what's the
shortest path from point a to point b
yeah
so the way that you do this
is
you think about a star and a star works
if you have a heuristic function right a
star is just dykstra
dijkstra is a star without a heuristic
function right so heuristic function you
could think of is kind of like
an estimate for how close you are right
an estimate so say you got to uh say you
got to faucet right and you say there
was like a lot of nodes between faucet
and omaha you wouldn't necessarily know
your distance from faucet to omaha off
the top of your head without actually
traversing right so the algorithm is you
start at a vertex you expand out all of
the edges right
um
then you go to another vertex and you
expand out all of the edges as well you
go to another vertex
uh yeah so you're going to each vertex
once in dijkstra so you think about the
complexity as v
and then
you're
traversing
each edge
at most once right because the trick is
when you get from here to here you don't
have to save all the slower intermediate
you just want the fastest you only have
to save the fastest right
so the space complexity is one number
per vertex and the time complexity is
the number of vertices times the number
of edges
right you can think about why because
the most you'll ever have to do is
traverse each edge once and visit each
node in the graph once in order to get
to uh
the end right
um there's probably some reason why it's
smaller now i think i think dijkstra's
is is is ve right
um
so if floyd marshall is v cubed that
means you're doing something in the time
complexity of the number of vertices uh
cubed
ah okay you know what i mean yay okay
all right you can see why this is
obviously true because originally i said
it was v squared e
but you're not gonna have to traverse
edges
unless they are
shorter because you're computing every
path right so you can think about
imagine pre-computing dijkstra for the
whole graph right between every vertex
and every other vertex so that's naively
v squared e right because if dijkstra is
v e well that's from one vertex to one
other but then
you know one vertex what vertex does
every vertex is also v e and it doesn't
matter that there's one target because
it might be the last one you explore
to be honest there isn't even a space
complexity difference you have to save
you have to save all the just following
us
there's my there's my there's my there's
my computer science lecture for the day
right you're going to end up now you do
have to safe
so if you're doing dijkstra you're going
to end up saving so if you're trying to
get from point a to point b right you
just need to know that path well but at
all the intermediates you're going to
save the shortest distance from that
intermediate to point a yeah
because eventually
eventually one of your intermediates
will be one hop away from point b
and then you can get a total a total
path wiki fm said dijktras is e log b
okay it's e log v right so i'm thinking
about that now y
i was thinking it had to be less than v
e right but but i don't see naively why
okay so so
why would you not have to explore all
the vertices yeah
and there's another version of it that's
v squared to get to i think
i took a graph theory course for a
little bit
yeah you guys all get the advantage of
being able to google shit
i'm i'm you know tell us
all right so if it's if it's if it's e
um
okay
so
you can think about
yeah maybe that is the hourglass okay so
you can think about putting things in a
in a uh
i'd have to oh god i have to write a
proof for why it's not the e but okay so
you can think about
a a a vague heuristic function to get to
to get to
the
the endpoint right
and you want to start by okay
you're at point a right you expand out
this edge has a weight of 20. this edge
has a weight of 10 and this edge has a
weight of five right
so if the first one you're going to want
to expand out is the one with a weight
of five because you're trying to find
the shortest path
um and then from the weight of five
right if this one has a if this only has
like one edge away from it from a weight
of 30 then you're going to want to
revisit the one with a weight of 10
right so you're going to want to keep
them sorted
you're going to want to keep them sorted
like that right
um
e log v
well okay
so if that's the data structure you're
using
you'll have to prove to me that like
some vertices will never be explored
um so let's think of some examples where
this is obviously not
true ah okay okay so you can think about
dijkstra from from point a to point b
and you have like a really really long
graph right like say like it's ten nodes
long right say there's just literally
one straight line and you're just
proceeding along that
you're obviously gonna have to visit
every vertex
but that complexity is already covered
in the edges
so that would actually be just o of e
right because there's if there's one
uh vertex between each right so now
let's think about the opposite example
which is a complete graph a complete
graph is a graph where every vertex is
connected to every other vertex every
edge is is possible on the graph
quick how many edges are possible on a
graph
if every vertex is connected every
vertex is connected to every other
vertex
well what about a complete graph with
with one
one with one node how many edges are
possible
and assume that it's it's a normal graph
oh one node and no one node and just one
node how many edges can i point there
are no edges there are no edges because
you can't there's nothing
um now you have three notes
three three now you have four
yeah it's a little notes right yeah
what is it it's like n is it
what's this n squared minus one well is
it n squared minus one no because four
nodes four nodes so
let's let's look at the first one how
many edges does it have
it is zero this one has three the first
one is three right oh right right
so three two one three two one right yes
six so that's four squares so it doesn't
so it's four two n is two n minus one
would be seven so we know we know that's
six so yeah
um it's three plus two plus one so it's
so it's so it's the n minus one but
expanded out so like n minus one times n
minus two over two is that right
[Music]
it's just n minus 1 times minus 2
this is factorial right what's that
factorial because factorial is
oh yeah you multiply sorry
yeah so when there's five there's like
four plus three plus two plus
five six yeah four plus three plus two
plus one so five is
ten
five
really what you do is you type 0 1
3 6 10 into the online encyclopedia of
integer sequences and it tells you
exactly what that is right n times n
plus 1 over two n times n plus one over
two is that right or that's something
right n times n plus one over two yeah
that that that sounds naively right
um
well so let's see so so let's see if it
works for five so we said five was was
ten no that's not
oh it is ten this ten um so five times
five minus one over two that's well that
works oh five times all right so that's
twenty number two right yeah there you
go
magic the magic of google see this is
why nobody ever has to think anymore
just google it unless you actually
derive that at your house which which
good for you and if you actually wrote
it
if you actually derived it at your house
without paper then then you beat us it
looked like he copy pasted it from it
was in like some latte formation
no no no no no no you derived it in his
head and then wrote it up in latex let's
let's give it let's give the scope we'll
give the scope he's the benefit of the
doubt
how long about touching the the steering
wheel right now i don't know our timeout
haven't touched it really yeah we
haven't really touched it
i touch it to reset it yeah the touch
resets the bar so we can't really reset
the question but scope scopy viewership
is still high scope you're shooting with
all this even with all of
lecture y'all this is how to think about
shit
someone said i shouldn't understand
self-driving a reinforcement learning
problem supervised
okay so that's that's that's right we'll
go off the topic a little bit into
machine learning yeah um so okay you
think about it very naively and it's
it's obviously it's a supervised
learning problem right so given a
picture what did the human do in this
picture
so that's supervised learning because
you have your x's which are the pictures
and your y's which are what the human
did and then you want to learn a
function
f of x equals y and then you can run
that function usually to drive the car
if it was that simple our car would work
way way way better than it does but it's
not that simple
because
of the problem of okay
in a supervised learning like the
typical scenario the one the academics
always write out you make this
assumption that your data is iid
independent and identically distributed
what this means is that every data point
is independent of every other data point
right you can think of like when this
would be true like if i am you know like
sampling without sampling with
replacement right like if i have a bingo
top right and i pull out one number
and then i put that number back in
the tub and spin it again and pick out
another number right those two events
are completely independent events or two
coin flips are independent events right
but if i'm sampling like without
replacement if i take that ball out well
then the next event depends on what
happened in the first event or think
about drawing cards from a deck of cards
right if i'm holding two aces in my hand
that affects the probability that the
next card that i'm going to draw as an
ace unless you're a cheater and you've
filled your deck with aces
um so
that's what independent means and
identically distributed means that
any sample of the data looks like any
other sample of the data under any
statistical test as this goes out to
infinity right
so this is again true about like uh coin
flips right
but um where might this not be true
if you think about like predicting the
next letter in wikipedia articles right
your data is not identically distributed
because if the article is about bananas
i mean the the word fruit is likely is
more likely to show up right so that's
actually dependent on your context right
um so it's not something kind of right
but supervised learning makes these two
assumptions that it's independent and
identically distributed right so now
let's talk about whether these examples
actually apply to self-driving cars
is one frame independent of the next
frame
if there's a car in front of me in this
frame
does that affect the probability of
there being a car in front of me in the
next frame
yeah
so you violate your independence
assumption there now how about
identically distributed right yeah well
do edge cases fall identically
distributed well
yeah
i mean you have to talk about
identically distributed under like what
model yeah
but um
so so the real way that this stuff is
violated is it it's so you can say okay
well i'll shuffle up all the data and
there'll be enough of it and then it's
iid and then it actually is iid but the
problem is that isn't what happens on
the road
on the road you're executing your model
like sequentially right
and you have your output of the model
actually affects what the next state
looks like right
if if the
thing told the car to turn left
in the next frame it's likely to be
further to the left
which is the whole problem which is to
the left which is the whole reason that
self-driving cars are not a supervised
learning problem
so in the literature this is referred to
as behavioral cloning or cascading
errors
uh and it's very hard for them to fix
a reinforcement learning fixes this
um
reinforcement learning fixes this
because so another thing that would fix
this if we could trade in a simulator
because in a simulator if you're
actually letting the
model act
then you don't have this problem
um but when we're testing it on the data
that you guys sent to us
we can't let the model act because what
actually happened is what happened kind
of like the lost theory of time travel
we can test in a simulator oh well can
we test on the simulator that perfectly
mimics the real world
not perfectly
no that's the problem yeah
test a little bit in a simulator um but
again you're only testing the simulator
you're not training in the same way
if you train a simulator
to build a simulator is kind of like
hard hand coding the self-driving car
it's graphics instead of vision but it's
still
not something you want to be doing
yeah that's interesting
so yeah
yeah supervised learning man i liked
computer science one-on-one questions
more that would be fun
i love right there yeah i want to learn
some crap
we still got 44 scopies out there wow
i had a great grandfather professionally
at cmu yeah and then for the half a
semester i took this course until this
girl broke my heart that's right
hey kylie
calling it like it is
like it is gonna be real people yeah
so wikifm radio who asked you the
question before what is george's
favorite language to programming python
python
you're a big rust fan oh
god you just like the chill for us i
like to chill for us and then let other
people try to code in it
but python's just the shit
is very simple you know
you know what they say man
if you're good it doesn't matter how
shitty your tools are but if you have
good tools you're even better
yeah pee i had two cups of coffee this
morning three
yeah i drink your coffee too
i went for a while help solve the
simulator problem you
described dance well okay so what you
can read our paper learning a driving
simulator
um
and guns are kind of ugh
the ants are just they're really hard to
get to work well
i don't know if you can pee in amazon
you can probably not no no like it
doesn't look like it right yeah it looks
like we literally get i mean we go to
someone's house you could pee right next
to that tree that's like your best uh
option in amazonia
yesterday we were in the middle of
nowhere in nebraska yeah i don't think i
think so we would have seen a sign right
what's the nebraska motto
oh
yeah go grab the view
um yeah so my talk today is going to be
a lot of complaining about the lack of
realness in the world
but i'll try to refrain from talking at
colleges about how college is the
greatest game in history
i'll try i'll try to refrain but guys it
really is the greatest scam history when
you look when you look at the the wealth
that has been extracted from our
nation's youth
we're still in missouri
we almost don't know
we're almost there
yeah we're going to get up i'll turn
over
omaha is like pretty far down in
nebraska
west again you gotta go west
go west
yeah
what time is the event i think it's at
two 2 p.m
2 p.m are we streaming the event we'll
stream a bit for the first time
yeah yeah we have a little bit of
presentation and i hopefully like if i'm
standing by a podium yeah yo you'll have
a podium you know we got obama to come
speak in tits and he was real pissed we
didn't have a podium yeah yeah
yeah um
i spoke about crypto kitties i made some
serious cash off crypto
kitties are real folks are real problem
i don't know anymore we either believe
in true realness or complete bullshit if
you haven't realized
it's not that i believe in bullshit it's
like you just enjoy bullshit it's just
that i really hate hypocrisy right
but then you can't say you love real and
honest and then chill for cryptokitties
no no no but like like like the thing
about cryptokitties is it is real and
honest because it doesn't pretend to be
something else right it's not like
they're talking about cryptokitties how
they help the underprivileged youth
they're just cats on a blockchain man
buy them trade themselves
right like they're not trying to be
something that they're not
yeah it's hypocrisy that's the problem
right because if you live in a world
where everything has to be rational and
true what kind of a boring world is that
right but we could live in a world where
everything is at least honest
yeah
well brevin's trying to set up a live a
youtube live
youtube live would
but don't even think about a facebook
live because friends don't have friends
who's facebook yeah i'm playing with the
focus now because there have been no
bridges to give you our sponsors
this is bridgeless missouri
missouri
missouri show me state just don't show
me in britain
can i pee and fill more
you definitely probably not there's
nothing there oh there's nothing there
how about raw there's an r8 there the
best
the best is when we passed country road
11 country road 12 country road 15.
14. and then country road 16 yeah you're
like what happened yeah what happened
there
don't take me home country road 15. does
it go oh
take me home country road yeah we should
listen to that i think it's literally
the country roads that he was taking
those country roads
yeah no
you can definitely pee there why
oh why do you think that's far away from
the highway though yeah i agree i i'm
i'm good coaster no i gotta pee
hold it
but no i gotta pee y'all dude
flex your bladder it's a muscle let's go
george exercise work it out yeah
this is this is a why don't we do
anything guys
go make the turn make the turn look at
that look at that nice nebraska model 41
news if you need more footage we got
that right there for you action 41 news
wants to enter in a destination and take
a nap yeah they're tired the nebraska
motto is the good life this is life
i like the good life of nebraska see the
problem is okay so here's the problem i
have an interview if you guys want to
look it up ndtv where i show for bagels
oh yeah
your hair is uh blonde i wear my hair is
bleach blonde uh i just want a ctf they
pulled my friend aside and they're like
is he high i swear i get high a lot but
i wasn't high that morning
um
and
yeah and none of my stuff was this right
the difference between attack and
defense and security right when you
attack you always win because if you
don't exploit anything nobody knows
about you if you do you're a winner
right when you defend you always lose
um because say you fix nine out of the
ten exploits you still get grilled for
the one you missed we still completely
do this right
the problem is i view self-driving cars
like an attack
and i think like if it makes that turn
it's a success
right
versus the defend which is if it ever
makes a mistake over you know a huge
amount it's a mistake right
i mean it's terrible do you think it's a
bad way to view it as an attack oh i
think attack is a much more exciting way
to view the world right eventually you
want to attack and then we have some
people who are like self-driving clothes
will never be allowed until they get to
zero
those people are literally sentencing
thousands of people to die every year
right if you could build something
that's twice as safe as people you save
fifteen thousand lives well we shouldn't
even save fifteen thousand lives until
we can save thirty thousand
said terrible people right yeah
um
and you kind of stop hearing people say
that i think there's still a few people
that do you wanna be honest like this
kind of kind of gone away oh man volvo
this morning that's so funny you guys
the idiots on our self-driving cars that
were giving us shit are like volvo's
already shipping a level four system in
in 2017
yeah you know what
they pushed it to 2021 which is another
word for never it's not even soon tm
we're gonna call that never tm and now
they're shipping a level two system to
people to get them comfortable with it
they're shipping volvo drive pilot which
is shittier than open pilot
people need to be comfortable
no but it's like it's like it's like
stop it with the pr spin
self-driving cars were harder than we
anticipated
oh okay
yeah okay
can i pee in mountain city guys rockport
seems more like it oh it's like
i feel that it's a good city oh that's
so far are we almost in nebraska yeah
really
we have an hour 38. before we get to
nebraska even oh no
oh before we get there oh all right
but you picked a gas station we could
uh
yeah
it turns out when this car says it's out
of gas it actually has like two gallons
left in the gas tank it's really good to
know yeah
it's like what a scam we lost so much
time slowing down we're like freaking
out yesterday going to neutral to try to
coast
and this car can't coast yeah
in old cars when it said you were
actually out of gas right
dishonesty but like dishonesty probably
works better
there's the
the odometer
you know i feel like i'm going fast
right truthiness is better than truth i
don't know man i think we're just doomed
it's okay
so we're all doomed
we're all doomed
gas station's about 15 minutes away
oh i get to pee in 15 minutes
see you've been talking about pink
sponge now i have to pee
oh excellent now we all have to stop
good now it's nice i don't have to pee
i'll pick you guys up later
but i want to get a coffee so then i
will have to oh let's get more coffee
more coffee
yeah
all right periscope i'm sick of holding
you but there's a bridge coming up
should wait for this
no no no no that's when i was sponsored
today they sponsored yesterday i don't
want any when any more
pc no no no no yeah let's leave let's
leave the scope all right yeah we just
ranted along by scorpios
[Music]
sup guys
Oh pilot zero point three point nine
I'm rollin with the new model
so yeah
it's pretty good it's cutting a little
on left I'm gonna review this stuff in
the replay the silky-smooth feels
amazing check it out when you're coming
to a stop behind like like a car at a
stoplight or something it's so much more
smooth than it used to be in the Sun a
Honda Civic there's also minor bug fix
it feels really good
dropping an employee off at the airport
like holidays or something
it's being presenting
hey Kirk 3d
take control oh yeah just cuz the term
is sharp and hit the torque limit it's
alright
what's up today nothing much so yeah the
so compiled at zero point nine zero
point three point nine it's actually all
the way already out in the development
branch so you guys can download and
enjoy we've also shipped support for the
Toyota Prius so Prius support can be
yours if you download zero see what it's
gonna do here
nice
which Jen creates so all the Priuses
with TS SP
it doesn't like a priest to priest a
priest for that doesn't matter we have
the latest gen but it work on the
previous gen as well I think actually
all the message isn't the same all right
coming in hot
and to control was to break get my foot
on the brake that's my age but you can
also engage now with your foot on the
gas but you can't if you press the gas
it will disengage so if I press the gas
here let's see if we can get one of
those silky smooth with MVC stops right
up here I'll feel this guy's this is
this is silky smooth that's better than
Tesla and they have regen too oh that
that's like sometimes you would want to
like disengage and you do a hard stop
was coming not not with this
so how come my comma hoodie you can buy
these at chop comma dot III by OD by so
yeah we can go through yeah the test the
breaking definitely sucks on AP one we
can go through let's go through what we
have here
so this isn't yawn hoodies aren't
comfortable right this is a giraffe
this is a pandal and this is us going
to do here and help out the steering
so that was about the only tour coming
anyway which car performs the best
probably a Honda Civic still we want it
to be the Prius the Prius has a few
annoying things about it we'll see if we
can fix them no we're never going to
support phones other than the one plus
three this here is a Honda Civic and
it'll be na Jersey no no no no only the
one plus three and three teen is all
that will be supported
Civic doesn't have phasers not only
cruises have phasers man we found the
phasers arms could be great only with an
open pilot gold subscription gold masks
like 4chan gold you know no one no one
should let me run a company man
e Honda cr-v the only of the 2015-16 one
and we support all a Toyota rav4 which
is the third most popular car in the
world right now so yeah they're good to
have look at this look at this silky
smooth break behind this FedEx truck
silky smooth oh that feels good no no
Subarus man I don't know what any
Subarus I don't actually know anyone in
your life well it's a Subaru I'm
convinced that the whole Subaru channel
is just Subaru employees doesn't work on
curvy back roads the Civic has a very
restrictive torque limit so not really
the rf4 works pretty well yeah by all
means port to a Mercedes Class A I don't
know what country you're from we don't
have class ace here we have C Z's and SS
yes
what about inclines seems to rev really
high trying to keep the set speed
where's the little peep yours listen to
little peep the whole way here but now
I'm on periscope so I don't think my
father can Spotify in periscope at the
same time
doesn't have a left lane here okay
that's not great there we go
no torque flash no torque flash
definitely not no Tesla's yeah kind of
open a tassel support little piece
popular everywhere man oh you mean
Mercedes class A's your late cut in oh
look at that MPC breaking I know it's so
sad
even headlines like you know you'll love
me when I die and there's like it's so
true yeah clear sense there's no no yeah
put your own radar on it it's not that
hard this turn is crazy
get over to this Lane and see this new
model miss detects the other side of the
bike lane at the lane yeah just like
splits
fireable as well
we need a better solution to this
yeah we're running with the new model um
so the new model is not out on the
development branch yet we're still
testing the new model it just got
finished training last night we had some
issues in the machine learning
Department there's been some personnel
changes so I made this model myself and
it's kind of well it's coming along can
we make a left turn across traffic now
no why would you want to do that
unprotected laughs sir a huge problem
I'm doing protected laughs kids
now projected love so I should you
choice of accidents
now I'm going to run this route through
the ground truthing pipeline
no you're saying I have a bad connection
there probably I'm gonna run this route
through the ground truthing pipeline
don't go there
[Music]
is pushed out okay this model needs some
this model needs some some some love
exits exits pretty soon aren't that hard
yeah well rav4 is here there's our Prius
there's our trash cans fuck this someone
took my parking spot anyway to get sharp
returns on the Civic now fired any
feature car for 2018
keep cool always keep them cool man uh
we'll be back on Wi-Fi 9-1-1
what about 9-1-1 don't call 9-1-1 Broce
why why would i call 911
Kamri TSP support what's up with this
911 YouTube live like periscope pros you
can reach SSP support that'll be soon
and watching this in the highway don't
usually phone and drive kids no who
cares about parking park your own damn
car other new sensor the sensor is
exciting what is up with you call mine
what it's like some wine and a brand new
song I think home no no parking no
talking on a car okay alright how do you
ban people on periscope next person says
neither one gets banned
it's called alarmism you guys it's the
media does the media's evil what park
only like a woman that sounds sexist
don't be sexist any news with old car
support I don't know man go on the old
car channel and slack oh no no no you
can park your own car
alright alright between 9 9 9 1 and an
auto fogging know the old car you gotta
ask the people on the slack my favorite
car oh man I said Mercedes s-class I
like that car all right this guy's band
block yeah oh man I love batting peoples
and stuff I said number one and I won't
want insta ban that's one nine nine nine
that's a little bit close to 9 1 1 now
I'll ban you good alright this is just
turned into a stupid rant yeah so enjoy
open pilot zero point three point nine
and hoodies you bought a hoodie if
you're if you bought a hoodie yeah
they'll ship very soon yeah bye how do
you say shit pretty soon cheers guys
0.09
I'll go get it rap for you
yeah fat rat for all right no I see oh
no all right all right all right all
right you guys lit
so I gotta wait for this thing to
calibrate
so y'all know the craziest thing about
0.3 0.4 0.4 your yawn and I can't show
you my yawn right now because it's
specially modified but your yawn we
flipped upside down so if you unscrew
the screws from the top and unscrew the
screws on the bottom you can switch the
position of the two places you can
switch the position of the two places
and then you can uh speaking of bums we
got more right here we're gonna cruise
past it yep boom yeah so I got a
calibrate so that means I got a drive
above 45 miles an hour it's a little bit
like speed here unfortunately the new
version will not zero point four point
four will not be shipping with the new
calibration I mean you can blame the
calibration team for that and we don't
blame anybody there's no blame everybody
loves everybody because it's a beautiful
world but what's important is zero point
four point four we'll have some of the
best stuff and one of the fate my
favorite feature is zero point four
point four is I'm being recorded right
now by the front camera mom it's
optional you can turn it on or off your
yawns also upside down which allows the
front camera to see the driver much
better it kind of just makes the
experience just kind of makes the
experience better so I can't engage yet
because calibration is not finished so
we're gonna go on the highway and hope
it calibrates
but yeah we can uh we can take questions
any any questions for this this dopey
Tuesday show you guys well I can't show
you the e on I can't show you the Ian
because it's a secret e on secret e on
I'm doing a little bit more than testing
each and release Friday looking at
Friday when will I shave Friday Friday
last stuffs happening Friday big big
event
why recording the driver so this is our
push towards eventual driver monitoring
for safety as our system gets better and
better and better you know we're gonna
need to start making sure yeah chef
pleasantly updated to you know you know
this time I always say it but this time
I'm serious
shift+ will be updated what's the
five-year vision for coming do I look
like the kind of guy who has vision I
don't even shave it's good damn Friday
just like just like Rebecca Black said a
new model nope there won't be a banana
that's a new calibration before new
model guys new calibration almost is
ready to ship that will ship probably in
0 for 5 but um a bunch more UI
improvements we're trying to make this
like a nice so gold star stuff is
already live gulf try stuffs already
live we just haven't built the dashboard
for you guys to see it yeah we have a
pipeline stage internally which runs and
checks if you've met your routes gold
star unfortunately it all the way tell
you yet I am driving here with a grape
and I can show you my grape and I can't
show you the e on its secret but grape
and I can definitely show you look at
that great panel what a nice great panel
alright
recording for safety feature yeah
recording is a safety feature no so we
don't actually have any of the detection
yet what we're gonna do is we're gonna
collect data I mean it's easy to write
an attack here to see if the driver has
the rise in the road but we want to
figure out what policy we want to put on
that detector and that's kind of what
we're gonna crowdsource
calibration work in this thing
how does the camera being offset
slightly affect driving quality all of
the flip we've corrected for it 0:44
will include front camera uploads
absolutely we have a way to view them
but they're getting uploaded
yeah the e on camera we very we've
already corrected for therefore the
six-inch things don't worry about that
it's a little rainy here in San
Francisco today
you said you collected he oh I'm nothing
like Zuckerberg man you can change the
difference yeah I'll tell you the real
difference to Nelson Facebook right
Facebook is trying to maximize
engagement for you we're trying to
maximize engagement for the machine our
dream product is a product you put in
the car and never think about we're not
gonna pressure you to drive more we're
not gonna send you an email hey your
friends have said you haven't driven in
seven days consider driving consider how
Ashley would feel right I feel Facebook
is emotionally manipulative and evil and
sucks testifying in Congress right now
no that's going but you know I would
never do things like that right we're
we're a product like you buy it for
utility right we're we're a lot more
like like an Amazon or a Microsoft or an
Apple I'm not really like a Facebook or
Google all right what am I doing with
your data just making the models better
man I don't know I'm too lazy to sell
your data I'm too lazy I'm too lazy what
I have to do business development with
people it just sounds like a lot of
effort I have to transfer the data have
to make a portal it's too much effort we
use it to make the experience better for
you guys no I stated my facebook a long
time ago
I believe in my facebook in 20
13 better year after I worked there I
know I know chef applause coming soon we
hired two more people for that team so
that's pretty exciting
new ship lasya douche ever fly settle at
they laugh
anything else what I'm talking about I
don't know guys just bought it on talk
to us go peace review a facebook
employment it's not a bad place to work
no so accepting face reporting is
completely optional it has nothing to do
with safety on what won't be optional is
when we ship the driver monitoring so
you don't have to like record your face
does the data will never be recorded but
we will run a neural net on it to
determine whether you're paying
attention no I'm in a Civic right now so
I don't need the pedal if you like
forefoot if you like four three two
you're gonna love for for what else is
new on for for just a whole lot of
stability fixes guys it should just be a
you know that's what the big big number
means what I think of D Central and I
don't know what that is what is d
Central and
sommore autofocus improvements two four
zero four fours come Friday what do I
think of Pied Piper
I think middle-out compression is gonna
change everything big architecture is
going to change everything
driver monitor will disengage quickly
upon driver distraction but as an
advantage to that you don't have to deal
with the six minute timer anymore as
long as you're paying attention it won't
time out once we shut the driver
distracted alerts
and we'll be using so it won't be out in
0 for 4 but when we ship new calibration
new calibration will live on the DSP you
guys who got the DSP lurking don't tell
anyone does the new model use mapping no
no no guys because everything takes a
long-ass time you know has it been a
long-ass time since we did mapping
periscopes not really oh man look at all
this traffic on the way back
it is calibrating one person Wow
calibration sucks I'm gonna have to
drive all the way to Mountain View for
this thing to calibrate oh it is
exciting though Oh 2% I haven't
calibrated an open pilot and so long
this is a new device Oh free the DSP Sh
well I mean you know maybe it's time
favored you free the DSP maybe we should
free the DSP how does the model predict
the road Oh how does it do that I'll use
the maps
none of that stuff shipping it works but
it doesn't think of the shaft yeah
eventually
everything takes forever it just takes
forever to build anything guys
oh man this is terrible you're telling
me I have to drive while it calibrates
these brutal calibration shouldn't take
so long it takes so long uh uh you know
I'm not gonna say anything bad you know
it's just it was written a long time ago
before we understood everything about
computer vision before we all got PhDs
in computer vision we have much better
calibration but it's only internal but
it will ship soon got a ship it got a
ship you get put on the device and we're
gonna be used the DSP for that well
we're gonna ship something called orb D
or 'buddy is gonna compute great orb
features right there on your DSP only at
11% this is terrible
it looks calibrated - sorry guys
user-experience got to get better yeah
for diffusion on nobody's done shit
how'd y'all get the DSP I used to be
when I was 22 I was probably the best
hacker alive I'm not anymore but you
know I get still I get ESP right it's
worse than this traffic yeah yeah no
come on open pilot Oh 13%
what's the calibration for it figures
out where your cameras mounted with
respect to your car so in order to like
drive the car we have to know where to
go guys it's all like foggy here too
it's pretty cool I'll flip you around so
you can say the DSB is just another
that's what my young seeing right now
guys I can't show you that yell because
it's a secret specially on but uh oh
it's bad foggy is 16% oh my god this is
really gonna take forever
no you don't need to recalibrate this is
just this is just because I'm on a new
device only if you buy new devices we
need to read
you're currently trading a depth on how
you trying again what's a channel
five miles oh man this is brutal
I just wanted to casually go out and
test open Pilon humans go peeing while
you're training definite what one plus
five no no one plus five you can't have
the secret eh I can't show you this
secret secret yeah there's a secret code
name to it as a code name that's pretty
cool you get the Z distance from the
camera what do you mean how do you get
the Z distance in the cavity back oh man
calibration takes days
really it you shouldn't have to take
this long Oh Oh terrible experience
Oh oh you have the death net from unity
oh so you're not just gonna kill the
Kamera I understand okay so it's not a
real camera there's a civics probably
the best car for a pilot show Honda by
Toyota new face filters on comics back
whose face filters I know what that
means
to the road guys
like the phone is mounted almost like in
my line of sight
I'm using a hands-free phone like I got
both hands I can't really keep them off
a wheel because all piles only 33% is
terrible it's a terrible experience you
guys I am gonna email support and
comment on the eye and I'll tell them
that calibration is taking way too long
and I'm very frustrated very frustrated
guys know I hate calibration takes too
much time I agree I've never really
experienced your pain guys but like now
I have we don't gonna have to sit in
this traffic on the way home no I've
asked her a refund support Akari i'm
viviane my eon takes too long to
calibrate i want a refund largest prize
ever 150k 150 k for my chrome full stack
trafficker 38% boys 38% it might not
like I might press the button and it
might not even engaged to be honest this
is a very untested experimental secret
Eon we're hiring new we're hiring new
support representatives we're hiring
were hiring Zoe and Zelda I'm talking
about new funding Shh
who talks that new funding okay if I
reporters all day yesterday and I didn't
pick up cuz I'm like no coming guys calm
is kind of a stealth mode you guys are
kind of in on the secret
and he hints on new wheel it's not cool
guys it's not cool it's really not cool
it's shitty yacht you don't want one of
these you really tell it it's worse than
the Aeon do you have well right now
anyway it might get better but you know
it's a long time right now it's not
custom hardware
so we'll drive down to San Jose while it
calibrates we'll drive back with new
calibration
which pretty dim - yeah
3a is hard but yeah we should use the
tx2 for a new who said anything about a
new hardware platform new funding new
hardware platform it's actually almost
like that it's not Nokia it's funny it's
funny though
yeah it works the traffic laughs yes yes
it works with traffic lights
51% oh my god this takes years
all right we're gonna we're gonna make
calibration good when I get home I know
all the bus keys are running out no no
Pete - guys are too smart can you have
an option to uninstall - no no options
you know support company all right no
you want to install it go in SSH NPM
uninstalled you can understand the
hesitation about what fine good what's
good nothing's good it's all shit yeah
everything's great purse I love the
world and I love life the world is a
beautiful place
added to for for what no no options no
buttons no you give a user button no
presently you don't want to they won't
press it when you want to that's the
button saying whatever that should be a
good slack my response whenever the
slack whenever someone's saying like
look we have a button to do access you
don't give users buttons I'll just stop
like oh something's really good the
stoplight is insanely good because we've
coated the locations in using about um
so we have some maps now we have some
maps we have the first bunch of maps of
San Francisco Logan Paul beads yo I
don't think I can connect to my phone of
course this car things unusable but I
would totally play the number song help
me help you right now
no I know the Logan fall songs yeah I'm
a little Oh gang member I love gangster
that's right
no I'm overlooking Paul on both songs
look all sellout
that's right but the Maverick merch
which I am wearing right now is the
softest wear to the game so does that do
we use semantically labeled of maps
auto-generated we use the same pipeline
we used to generate our training data
for the maps
and you guys probably don't even think
we have training data because there's
never any new bottles just Kali
that's Kali
alright guys I think it's about time we
turn around my calibrations at 74%
that's pretty good
this is so exciting though if I was a
new person getting this thing I would
expect wonderful things what's new in
four I mean I'm sorry I can't show you
guys this thing because it's a secret
Aeon but it's good it's just a lot of a
lot of polish a lot of Polish 0 for 4 is
going to be pushed to release so
remember how like the warrant release
push to release new for supports going
to release total focus has been largely
fixed so HDR is live 0:44 is going live
on Friday and will do new Scheffer plus
to a secret Aeon don't worry about the
secret the secret iana's is just get a
lot disagree to you it's a downgrade
from your car D but that's just why I
can't show you I don't know I just
didn't want to be alone on this drive
alone without for calibration so I
thought I'd bring Muskogee's with me
yeah 0 for 3 is released quality good
guys like 0 4 3 0 4 3 2 okay
counsel hierarchy CVP asked me I should
have the same DPS it said the gray
pattern pretty much I have the same like
chips that series
did you record Maps yes if you got a
grand Pantheon yes you absolutely
recorded max no no nothing ever gets
cheaper calm my things only get more
expensive do you guys know that pandas
used to be $88 so now they're $99 should
have bought a panda when they were 88
save that money now get on Black
Mountain Road yeah
all right calibrations at 90% this is
very exciting
I've never been so excited to get a new
product it's a u-blox m8o that's the
Highway Patrol I got a watch out now you
don't just not doing anything illegal
I'm an upstanding sense pig the $88
Pentastar nephew arey um though you guys
know the pandas aren't going on Amazon
that is happening
little bit of Tyre squeal off the line
there base station D is on holes cuz
it's not gonna make anything better
how you gonna market panda on Amazon
this is way better bros have you used
Cabana and then you bought an OPG and
you've used PI L 11 we don't believe in
marketing if you don't want it don't buy
it you know I think it's the best if I
could have bought cheap OBD dongles I
totally would have
instead of pandas if I could have not
made that and just watching fo BD
Dominus we're doing it right on the
merch we were already doing fulfillments
lianying it's good price on those
t-shirts at 20 bucks
I've new download video from your
chauffeur drives I think you can it's
kind of screen capture software now
we're gonna work on that every file you
upload to us okay let's download
oh it's calibrated what controls
mismatch what oh we're in controls
mismatch okay that's not great oh all
that work doesn't work restarting on
restart car guys I don't even have an e
on is it the e on I gotta restart
restart car I controls mismatch it says
take control immediately controls
mismatch guys I want a secret debug e on
and it sucks it's not even in the e on
ok that's how much it sucks
yep Wow okay you know it's good for
people to experience their own products
yeah I mean really support when I get
home I'm very upset
oh man I should show you guys begun I
wish I could show you the yen are you
using me only I'm not selling me out why
are you using because we're testing it I
don't know why it doesn't work he's done
a good job yep you talk to that shit I
did that once in the acura the acura
does not restart alright we will try we
will try rebooting the car we'll pull
over
we'll try rebooting the car yeah well I
missed that exit skyline Boulevard next
exit
cool skylight college skyline college
guys
Civic will restart when in neutral yeah
we're not trying it go will take Skyline
Drive up top that's kind of nice
it engages for a minute I really don't
even think this is caused by other
issues man
Zach
[Music]
in the toyota you can disable the cruise
and then you can restart the device oh
the drive constellation I don't know
Zuckerberg what's he's doing how's that
going I can't watch that I'm driving
it's live right now he's sweating
bullets now I wish you the best of luck
I mean guys you know if you don't like
Facebook at least like Facebook does
look good for the world he's testifying
in front of Congress Congress
you listen to it on CNN I heard didn't
really think news I don't watch CNN but
I've heard rumors that they're extremely
fake news I don't know if those Turner I
keep an open mind of a skeptic is the
earth flat
I'm a skeptic
Oh Honda Bosch is that shit working but
if that's working guys okay I will tell
you I will tell you since this periscope
it's been a terrible periscope I will
drop some who knowledge of a secret kama
product don't get cyclists and some
javelin cyclists I will drop some
knowledge Congress shit man this is not
a reflection on Americans as a whole
do not take Congress to reflect the good
people of the United States of America
no controls mismatched no all right now
I need to find a place to pull over on
this road actually tow supercruise on
this road and it didn't work no no it's
not the kama radar stock acc okay so you
got lateral only on the Boche it's
impossible to do the longitudinal if we
had vision only
bringing
no it controls it for like half a second
I don't understand what's going on
I feel unplug and replug the Panda
alright guys know the secret new product
you know no secret product now it'll do
it we'll do a real announcement
where are you co-pilot what's a co-pilot
oh why is no one else in the car alright
a red light alright let's reboot let's
reboot let's reboot now pull over to the
side here I don't have chrome boss just
me in the car
only on testing the new prototype yeah
and three but it makes a different noise
when it reboots because it's a prototype
secret Aeon
rebooting turn my hazard lights on
rebooting rebooting its booting booting
right because I have a grape and a tow
sitting by the side of a road where
people go fast as scary well the front
camera of HD I know doesn't have a GTR
god I gotta make work a little better at
night wrap no come on work work all
right it's booted starting up all the UI
crap let's go let's go I wish I could
show you guys the secret e on the secret
e on his monitoring know all the yawns
you guys this is flipping Deion's I'll
show you some flipping Deion's time
Chris how's the mapping going pretty
well
and that thing's pretty good you know
I didn't work at all okay the USB is
kind of janky on this prototype I think
that's the problem it's connected to the
Panda let's go
please keep hands on wheel be ready to
take over at any time love it alright
come on
engage Oh works it works yeah whoo oh
this one doesn't know that we have oh I
don't have upgraded torque on this whoa
I'm a pilot what's open pilot all right
guys let's shake no I can't show you
cause it's on the secret prototype
beyond whoa
secret prototype works whoo love it
whoever said booboo car that guy
Oh hitting the brakes oh what a good
prototype its prototypes I gotta keep my
hands by the wheel got a car in five
foot by the brake wheel
alright prototype ping-pong and getting
fixed we developed the prototype this
guy no it's not true
Eddie worked on it a bed one of our
other engineers worked on in a bed I
just came in to the car I put it in the
car
what's different about secret here it
sucks it's like in normally-on but
crappier I just know I'm not getting
increased torque because it doesn't know
that I'm gonna modify it Civic
whoo cruising through a red light right
now oh don't go there
all right
what talks about the prior right guys
you know what who would I be
won't tell you anything about it but we
will show you all the pilot there is
open pilot and it's driving yeah
this is the first time given on a new
secret prototype be on there like eons
but crappier because their secret
prototypes but it is notice how it is
upside down
notice how the fat parts over here and
the skinny parts over here you're
driving through the fog
of course it's a civic so I have full
stop and go this is open pilot that cut
out here we're good you like that look
at that triangle it looks secret no the
triangles gonna ship no hands are gonna
hand right here I mean I'm not you know
I don't need to it's doing itself but
just mess up you know no no no plenty
more OPP threes plenty more OPD threes
this is just a prototype but actually
unless you want to end up with one of
these player er today
it's not a 5t it is definitely not a 5t
notice rain effect that it doesn't care
what's OPG 3 I don't know what that
means
but you know this is the latest version
of all compiled and this is pretty good
I'm not very happy with this experience
look at the new UI look sick
yeah faster Excel from stop and it gets
fixed
mafic gold star when engaged or not
engaged don't care an app still look the
same no matter who's driving you are
looks fancy right that's zero point four
point four you guys really stuck around
so you know even though it's the secret
prototype it's really really low
visibility today I think I got a radar
that cuts right through that fog
nice to help a little on the sharp turn
we had the torque limit of the Civic
no no no it's not a Samsung what sensor
jeez our only phone we use all these
sensors in the car
as well as the phone and we also use a
grey panda check out a grape and all
right there
check out my antenna oh wow that is a
janky antenna mount I'm gonna go get in
gameplay we added some green color what
is this sorcery is a cell phone driving
a car guys that's no big deal
it's a cell phone driving a car
it's wrong here can't really see cuz the
fog
unless the Americans time
this one's a little junk here
so yeah this is this is not a neon if
you buy any on you'll have a actually a
much better experience of this this is a
janky scrap
I shouldn't insult it too much because
future he hunts may look like this I put
you guys back in the mouth
what is this explain answers it is open
pilot by common guy the only best free
open source car driver no it's it's an e
it's a neon guys it's a neon it's a
crappy Aeon it's a prototype beyond you
buy any on today you get the latest and
greatest a neon technology you buy this
eon you're like this is crappy you can't
buy this eon it's crappy and sold the
choice yeah check it or github
github.com / comment i / open pilot that
might go to the highway how much can we
vary by a best buy nope you know where
you can buy you go to shop calm or
dining I now it doesn't come with any
software that drives a car and yawns are
sold as dash cams they really are just
designed to be - cabs if you are crazy
and adventurous and want to go to github
and download open-source driving
software it might just run on that
dashcam but that is of course your
choice as a free individual in a free
country shop comma dot a yeah I go to
that store and then you two can have a
cell phone drive your car
is it a shaman dumps not shouting no no
no we're pushing nothing nothing don't
worry there's plenty of new updates to
come zero four four has this new
beautiful UI who what turns the wheel
we actually use magic I mean it's just
magic I don't know what else to say it's
like turning the wheel to go around this
turn yeah yeah I don't know if your car
has magic built into it that open
palette interfaces with magic and that's
how it turns means telekinesis yes open
pilot gr44
does require flipping your jaan model
based on to York someone asked me about
models model shop that I play shit I'll
show some more footage of this thing
I mean this is 0 for 4
I'm thank you for sticking around while
this calibrated and what I painfully had
to reboot my car all right we'll look
into why that happened but yeah so that
right there is a cell phone driving
their car zero point four point four
which is available for free and
opensource honor github at get our back
home slash coming on the show pilot
notice how you see that triangle there
so it's detecting the car in front of me
and it's gonna come to a nice smooth
stop we had an intern this summer right
a phenomenal model predictive controller
that's being used it the brakes probably
smoother than you can
it works on Honda's and Toyotas and this
is the year the Ford so it will be soon
to work on Ford's
it's glitching out a little distracted
by the time the software is running on
main yawns that bun you saw earlier was
probably not a software probably that's
why issue with center dividers and you
like Tessa's issue can I always pay
attention you know I don't know try it
post a comparison video you want this
for your rav4 rav4 is a great car to
install this and check it out look at
that look at how that path goes away man
this new UI looks good we hired a
designer almost a year ago now he's
absolutely crushing it a huge fan how
does it handle cyclists it doesn't you
handle cyclists
what's the device on the left of the
yeah oh that's a Rove Rove I don't know
Andy was trying doubt can ask me what he
thinks about this is open pilot this is
a cellphone driving a car sorry we're
not gonna say self-driving car anymore
we're gonna say driver assistance system
so I'm a driver
I'm in the driver's seat I'm legally in
control this vehicle at all times I'm
paying attention but as long as I'm
doing all those things from this device
right here this is a common AI beyond
well this is a crappy prototype
commentary on the non prototype retail
ones are available at shop not come
another guy this is a crappy prototyping
a panda the band itself is good it has
this like antenna mount which is really
bad I'm so it's blue when I'm disengaged
and then I just pressed this cruise
control button right here you can see
sat so I'll just press it and then back
engaged is driving the car
does it run on Windows Mobile no it runs
on neo s the only operating system I was
going to see certified but I shouldn't
say it's not certified for anything it's
a crappy part of Android if you have to
flip and redo the Mount know you don't
do recalibrate calibrations the same
we-we-we we dealt with that we dealt
with port in your calibrations they're
fine my car needs maintenance I'm sure
it does Grove new convert inspiration
now I wasn't impressed
y'all test it and snow yeah bucks and
stuff I wouldn't use it when there's
snow on the road just like any other
cruise control system but people think
like this is like something that matters
in software in cars it's not
face it's the one plus three Oh the
triangle is just um the car in front of
you so it shows if it's detecting on a
lead car in front of you that's what
that that's what that red triangle
surrounded by the yellow is how much
data does the service user oh you wait
I'll wait the data patch I'll give you
guys something I'll write the data patch
um so if you say only upload over Wi-Fi
it won't use much data anymore that term
is solid all these things are good throw
out a type e on throat earth API lurks I
don't have to we'll have to go home and
we'll have to check the quality of the
data kill the wobble you won't put your
dough with the wobble I don't think the
Civic wobbles sounds perfect to
supercruise but I feel like the Civic
drives just as well as I do
Toyota might have a little wobble
particularly tall Toyota's like the rav4
well the Prius has tons of wobble well
that's just because the Prius is
actuators crappy but I'm very happy with
this
made up of data speed bandwidth uh sorry
it's not really going to the internet
guys you don't actually think Corolla
non-typical is a little bit better yeah
we have a global map not a big global
yeah we're building a global HD map it's
being built right now by the end of the
year at the end of the other maps are
gonna be out and we're gonna of course
give it away for free
guess what you guys back to look
so cruising at a nice gentle 42 miles an
hour he will be coming in for a stop
behind this car notice how it detects
the car and it sees that triangle right
there that's a you know your gut so
we're gonna come to a nice stop in this
car good job open pylons the green is
the currently oh yeah rav4 doing full
speed yeah I could do that let's stormy
life go we accelerate no look it's
accelerating faster good job whoever did
that only controls team in the car now
I'm very happy with acceleration was
cruising down the street with my six
phone
all right so now we're getting a little
bit too suburban II hear what you got
back in the mouth and flip you around
what's with the tape oh I don't know
these are Prototype cars
does it know how to drive stick no it
does not but it is open source so if you
want to write that and like build an
actuator you actually probably can't
really can build a little servo thing
but your Chooch a new rap track I don't
know man
but that too much time for rapping
lately so this is the fusion problem
fusing with lead cars that are stopped
so I had to intervene there if you press
either gas or the brake pedal the system
disengages how do you make money if it's
open source we get money from VCS no
kidding I'm kidding B C's we have a shop
where we sell hardware that's compatible
with our ecosystem check out shop comma
dot ai
cruising by the police
I'm over rear view mirror in this car I
just have me you but I think is legal I
got pulled over once within yawn
and the cop asked what it was and I said
it's dashcam the cops like oh cool he's
like you look like an upstanding citizen
I'm not gonna write you a ticket it was
really because I was driving a Prius
if you drive cheap cars you're less
likely to give tickets I use the drive
expensive cars they always give me
pickets like come on man I Drive a Prius
come on chef that coming that AI is how
we make money we are a hardware startup
we sell hardware like badger no I didn't
get pulled over for anything related to
that I got pulled over night my lights
off this was the second day I got the
Prius and I forgot that the lights were
not automatic officer pulled me over at
news I was drinking I was like no
officer like it's a new car it's the
second day I had it means like what is
that like a dashcam that's what we do we
make dash cams we sell them at shop that
comes that I you should check it out put
one of your cruising I didn't say that I
should chill to the police we are hiring
we're absolutely hiring I give me a job
at comedy I is the email for that you
can check out our hiring page coming on
air slash hiring we're not pretentious
enough to call anything careers careers
spend 20 years we're gonna solve
self-driving cars and two and a half so
get an early on that all right
does this car have a huge comment on it
nah now where's stealth mode bro like if
you watch these periscopes you know what
we're up to
but like we did like funding shelter the
police right so saying please needy on
tonight put an eon in your cruiser think
about how many hands you'll have for
doughnut-eating who donuts
double-fisting bro with it yawn no no it
sounds like it'd be too much
bureaucratic paperwork to sell to the
police
um and I love doughnuts too so you know
this match is copying I love doughnuts
too I thought it's a delicious I would
eat a doughnut right now if I had a
doughnut nope
so to bed oh so this doesn't work on a
commercial truck now bro what is own
path zero point four point four that is
the latest release of open pilot and you
can see open pilot right here running on
my crappy prototype a yawn yeah I know
please shoot I live by yeah follow
perpetrator mode is it legal to have no
hands on the wheel where I live
yes as long as you are paying attention
and in control of the vehicle there's no
legal requirement but I do I mean you
guys can't see it on the periscope but I
keep a hand pretty close to the wheel
down here while open pilots driving wait
till you get pulled over by a
self-driving police the one from the
self-driving police Neos yeah oh I
didn't even think about Neos you don't
want to do any more get an e on just
just ya know the up new update won't
work on no and yes
very sensitive we're good we're good for
nighttime driving it'll read stoplights
and everything well
oh let's not ship yet um how is
self-raising cars pretty good pretty
good you can actually check we posted a
Cabana link if you go on our if you're
going to Twitter neo depreciation last
week Neos are over if you're still out
there driving on a neo we have the neo
de on upgrade program we did get second
place we lost by one second but only
could stay at an Acura and we had a
pre-assessment one were cool but yeah I
know if you saw the Neo out there make
sure to get on that neo Dion upgrade for
dollars I don't know what you say a
question mark the problem is things go
yes pandas have api's pandas are
completely open-source we have an API in
Python and we just launched panda Jas
which is a JavaScript API for
interacting with with if your relative
needs a dash cam tell them to go to
Walmart and buy one for $40 to be honest
I'm an honest person how many locks
swimming lines of code for what for a
pot don't we run slop count on it
not that many
yeah if you're looking for like an
easy-to-use dashcam click til fighting
on this you need a herbal come to
California is legal bra
I know right the Colorado really caught
on that really started that train I
don't know if you had a medical card in
California that was always pretty nice
as well oh don't drug test don't be
coming to work fucked up you'll get
fired your dash cams for periscope
broadcasting they probably should
Wow just to think the company's drug
test that's crazy
that's crazy to think about
smoke weed is coming I don't smoke we
didn't drive a car guys do you feel it's
probably better than drinking to driving
a car but still they'll do it
waiting for my car accident thanks brah
I play music through the car speakers
absolutely you don't have bluetooth you
can just pair it oh that's another thing
zero for for ads you can now get to
settings you can now get to settings
without having to go to the Y on
periscope support yeah no no no it's
still turret now it's pulling you really
not don't drink and drive call it uber
or lyft if you don't like uber wow that
was really close to me I'm driving
all right I think the test of the
prototype was pretty successful
we'll take you guys inside for a little
bit we'll walk through the make sure to
keep the headphone jack
oh we're gonna use the headphone jack -
sure - fighting on now we should have
fun now hey we're Apple we're Apple Bros
oh no yeah the headphone jack is uh
getting me on now
no drops coppice
that's right guys we have finally done
it
after years almost a year I know bro I
didn't sleep last night I took a nap
today I'm kind of tired after a year of
shipping the same model over and over
again
we are finally shipping a new model 0.4
0.7 begins the release of the latest and
greatest thanks to all of you for
contributing all of your data back to us
we've taken all that data if you have a
gray panda by the way if you have a gray
panda the model is probably going to
work better for you because you were
involved in the training set I think we
have like we have like 80 of our users
who've contributed if you don't have
great panda I shot that commented AI get
a great pant in the day and you'll be
included in the next model training so
you'll get an even better model so
that's the first thing we're here to
talk about the second thing we're here
to talk about is we have shipped our
official GM volt support thank you thank
you all to V tasarov you know the
claimer of the GM bounty
he's done a great job getting that code
to us we paid out the $10,000 bounty to
him we've cleaned it up he actually lent
us the car for a week and now we have
pushed that upstream you guys saw the
periscope vault support is top-notch
it's really it's really one of the best
supported cars right now
GM's actuators are pretty nice we have
also shipped thanks to energy GM Bosch
lateral support
I should really include the thanks will
include the thanks in that in the
release is all edit it um so so our
energy got a two thousand dollar bounty
for Honda Bosch lateral support which
has now been up streamed as well thanks
to energy for that we've improved
actuator modeling to reduce lateral
wobble we're now taking into account if
there's a delay that's the large cause
of wobble it's not caused by models it's
caused by lag in the whole loop the Volt
has both lateral and longitudinal
absolutely we've also shipped support
for the lateral only Cadillac ct-6 so in
case anybody has that car our CD six is
super nice we have a button now you
could switch between open pilot and
super cruise um so if you want super
Cruiser press super cruise button if you
want to open pilot just put on the
adaptive cruise and you get off the path
so it's a nice is us a nice of sikhi six
anywhere it's a great car if I was less
tired I'd take you guys out for a ride
but I am kind of tired this is a good
release zero point four point seven we
refactored the car abstraction layer so
we aren't gonna be ops trimming any more
cars um maybe if somebody hands us know
so we can talk about why no Volvo in a
minute a 20-18 camera yes absolutely yes
Honda's Toyota's and GM's will be up
stripped
we're not up streaming anymore brands
because we don't want to maintain
there's some chance if people do like a
Hyundai port or a Nissan port we'd
consider it but things like the Tesla
port unfortunately
it's it's it's too much effort for us to
for us to maintain all these all these
cars um so that's it if you top Honda
Toyota GM we were gonna do Ford Ford is
over we're never doing subaru no Subaru
absolutely not but uh Tesla bounty what
I've said about that is
you know they worked hard on a great job
to to collude and Zacks
one-two-three-four the test report if
you guys saw the electric article they
got some great press about that good for
them great press for us too
so you know big big big props to them
for doing that and we will if they
manage to get ten people using the port
we will pay them the bounty even though
unfortunately we won't be up streaming
yet we've talked about this on slack so
we factor the car abstraction layer that
we refactor the car abstraction layer to
make the cars as much like plugins as
possible so other people can maintain oh
yeah we're really not gonna be up
streaming anything else but ideally we
want community maintainer x' of these
other cars and what we will try to do
our commitment to you guys is we'll try
to make open pilot as modular as
possible have the api's change as little
as possible
so if you write a carport it should be
relatively easy to know bring it through
to the new versions and hack around or
be startup issue
I shouldn't even included that that's
kind of gross I just sort of descriptor
like tries it a bunch of times
Starro terrible cop bad cop and I should
feel bad but yeah so let's take a look
so here zero point four point seven
these are the things I promised new
model that's of course envision D vault
lateral vault lateral and longitudinal
ct-6 lateral Honda Bosch lateral so
that's the Accord
that's the gets the chain flog in a
minute that's the cord that's the CRV
and that's the Civic hatchback those
should all three of those cars should be
supported and we will be shipping a
Bosch giraffe next week probably okay so
see we got here what up no yes so you
can look through into the changes here
the resource is we've got a little stuff
oh if we've merged in the Tesla
little-endian support thank you for that
we've also shipped our half Ford port so
there's a there's a four port here
there's no car control or fellowship
that too but there's no official support
for the Ford Civic yep yeah all the
civics without supporting yeah have fun
with the ten seconds for Jeff Ford's are
a real disappointment ship that but we
shifted the GM port work in the volt and
the Cadillac port into one a couple
changes to Honda change the Toyota minor
changes all throughout the thing and of
course the new model binary file not
shown envision D as will enjoy it
bull endian foot so it works with Cabana
yeah yeah if you say if you say - did
you see the Cabana was a little Indian
open pilot should now respect that so
respect we got Le'Veon that's it that's
really what we want to talk about we did
the release we dropped it is live let's
go for a drive Wow
I think as I we got a life let's go
oh yeah got that key bro mount for you
guys no not really no all right I will
take a job we'll take a drive pretty bad
boy shoes on here got my shoes a rav4
good now I haven't tried it I don't know
it might be a little bit worse but
hopefully it'll be kind of okay alright
let's go people working on the weekends
left with my people working on the
weekends ain't turn off Wi-Fi turn off
Wi-Fi I don't know this just isn't gonna
work well oh well yeah so here we are in
our ct6 I'm just gonna reboot it make
sure I got the latest stuff just make
sure I got the latest stuff on here
check the version 0.4 0.7 right there I
don't think we broke support for the
pedal but you guys know the pedals not
officially supported so 104.7 here let's
go for a drive
so we can look at UI oh my god I can't
see door neighbor's hate us having so
many cars now cuz they're not usually
here
don't cast this you have to give it
above a certain speed I never go right
yeah go up and pilot
and what up guys so we're just driving
through the neighborhood with
neighborhood pilot seeing those lanes
pretty well oh this is so good the new
model is really good guys it's great
victory
remember keep your eyes on the road at
all times
every self-driving car in the world
today is the level - whoa who is this
gonna work
so actually that's not even a hit on
Oakland pilot that's the GM longitudinal
so the Cadillac is actually only lateral
an Oakland pilot we're using GM's
longitudinal control
nope new model guys not gonna get fired
nope nope nope
we're fans of new model the new model
was early we have ground truthing guy
ground truthing guy got a promotion the
head of mapping and localization got a
promotion he's now a VP for doing a
great job with the ground truthing of
this model I'm an ml guy came through
and trained a model alright on here
but yeah so we're actually using GM's
adaptive cruise here a new model is
released now yeah yeah so there should
be a new model every release all of this
stuff is finally back I've been working
with beautiful infrastructure we hired a
great infrastructure guy well close with
that following there's a button for
following that here we go oh yeah
someone set it to near I like far on my
gap you know mean old man
um but yeah so this is open pilot 0.4
0.7 with the newest greatest model when
you're on my way mistakes are down yeah
you love that fan sound bro I know the
last model is sold at new walls pretty
sick though yep I got a press resume
because open pile is not doing that
actually even the vault you have to
press resume it kind of sucks I don't
think we shipped resume spamming but
yeah look at that quality oh love this
model guys it feels so good no new
calibration hasn't shipped yet that's
coming probably in the next release um
that guys on vacation for a week now so
you know but ya know the new model is
sick
it feels like I'm dead in the center of
the road right now
but this supercruise quality guys this
is a really super creased quality no
traffic lights no no no no no updating
zero point four point seven let me know
how it works we think that this model is
similar you know Tesla came out with
their new model and people were big fans
all the talk our problem well darling if
you have a tall car you might be a
little disappointed I don't like the
problem with open pilot being a lateral
only it's like I'm seeing a blue fuse
here lit fuse infused okay on the realm
of the open pilot being lateral only is
we can't show we don't show the radar
point
RDX yeah RDX worse
oh yeah look at that driving across that
intersection and keep me in the lane so
quality is that Eon new no this is one
of our yawns what's wrong with taller
cars we don't know just a bug
I don't know they might agree or it
might work look internally is a team I
don't really know what the latest on
tall cars but ya know it's pretty sick
if you have a civic really gonna work
well or a Korg I hear great things on
the team driving the hacker would zero
point four point seven get it down
worried right now github.com slash
calming I slash open pilot you've got a
civic you're gonna love it
still thinking about camera yeah a
hacker Dan a cord will do that yeah I
was thinking about the cavalry I think
we gotta trade the ILX in for Camry but
there's a contingent in the company that
doesn't think we should trade in the ILX
because it has sentimental value what do
you guys think
open pilot 0.4 0.7 new model it's sick
if you don't have an eon we got plenty
of food for sale shop combinati i don't
get a sugru you're gonna regret it
you're gonna be like why did I get a
Subaru I already know how you're gonna
feel right so this is a tricky part
let's see what the new model does here
let's see if we can do this
whoa whoa little out of there but that
felt pretty good guys that was all open
pilots you saw that crazy shit all those
crazy lanes didn't matter I'm just gonna
op my speed here send me back speed to
70 let's go we'll switch over to super
cruise at some point in this drive too
so we can really compare the tip but
this is open pilot the over your lesbian
friends have a super you can't upgrade
your 64 4:128 we don't know for that
yeah that was nuts that just worked do a
little sick bro this feels this feels
amazing
what powers Drive you know look at look
at those solid legs look another right
on the things this is as good as super
crystal
one of the reasons okay so this tourism
supercruise appears better than over
pilot one is that it only works on this
car and this car has particularly good
actuators
not a link cut in here the other reason
is that supercruise only allows you to
engage in very conservative areas so
like even that Lane merge might have
been a disengagement for supercruise
direct sunlight can't drive I don't know
maps will probably help a bit
I've got some real turn up ahead oh yeah
I get it open pile I get it
this is this is the best release yet I'm
so happy
all right so let's see when supercruise
becomes available this has been open
pilot driving we're going to switch over
to super cruise in a minute so you can
see that there's no super cruise yet on
the dashboard cut in here we switch over
to super cruise super cruise blinked on
for a second this turn is beyond what
super cruise can do actually so this is
still open pilot but this feels as good
as super cruise guess I can not I can't
even tell about it so confused to be
honest
this is unreal
yes gotta love this
thank you for sticking with us in the
year it took us to produce a new model I
know we're terrible
so what we're gonna do in a second when
that supercruise logo appears we're
gonna disengage open pilot with a switch
over to super first we're gonna see if
we can feel the difference
hahaha no wobbling Oh unbelievable
now you know your mobile data it's
recommended but you don't
where's the supercruise logo
listen Bogg do we break supercruise in
this car
up there yep it blinked on for half a
second why come on super cruise on super
cruise she's super cruise logo appears
right there guys I can't even tell him
not here we go okay let's get on super
cruise disengage all pilots I'm driving
now let's see if super Christmas show
chosen for half a second no no we might
have broken something
all right now supercruise is on
so this is GM's this is GM's driving
system you see those infrared lights
turn on
it feels almost the same
as super Chris feels a little bit
tighter I don't know or maybe it just
feels more convincing and a green turned
on and stuff like it looks like it's
doing something major EPS firmware
difference is not that major enough that
we can check own you do have to command
them a bit differently but why the
Cadillac has all this extra redundant
safety stuff but yeah so this is
supercruise it does feel a little better
it's hard to describe it's not exactly
clear what's different about supercruise
versus open pilot but this feels a
little better it's subtle it's very
subtle I'm hoping by the time by the
time the end of the year comes around we
will be we will be better than
supercruise we will meet this promise no
problem
it feels smoother yeah oh supercruise
feel smoother no it's very hard to say
I'm gonna disengage supercruise in a
minute we'll go back to open pilot and
we'll see what the difference we'll see
if I can still
alright we're on here
this turn feels good I'll switch back to
open pilot
yes it cruises off such an act open
pilots
yeah it doesn't feel as confidence
it's a little it wobbles a little more
around the turn it turns a little later
into the Turk do you feel like you're on
a rail with supercruise we're with open
pilot you feel like you're it's like a
kid just learning to drive is there a
new chime yeah yeah so that time is
being set over GM loud and realize it
worked in the catalog that's actually
being bit bang GM lamb which is crazy
what steering button so I'm just using
the supercruise button to engage
superfruits and I'm using the adaptive
cruise control button to add a chapter
cruise control
I mean really what we have to do is
here's what we're gonna do I'm gonna get
in the passenger seat and we'll put a
put a divider up between me and the
driver and we'll play the open pilot or
supercruise game and then we can we can
advertise in a double blind taste test
open pilot compares favorably to
supercruise but okay it's weird I don't
understand why it's not showing up like
I'm not really sure how that detection
works hopefully we can hack supercruise
to appear everywhere I Cho we can really
get ahead - honestly guys I can't tell
him about servers right now it feels the
same
at least on that turn so there's a
little bit of a sharper turn coming up I
think supercruise is a little better
when the turns get a little sharper
there is a very subtle amount of wobble
still present on it
no it can also just be my perception
like I know it's an open pilot I know
it's in super loose
I've also seen open violent make
mistakes I've ever really seen
supercruise make mistakes all right so
let's let's just engage a pilot
let's so let's give the supercruise logo
a second to show up
we're back on supercruise
it feels better it feels better um so
we're gonna I'm gonna take this drive
back we're gonna look at the cabana tres
and yeah it's confidence it feels it
feels more confident we'll look at the
Cabana trace and we'll see what the
actual commands to the actuator how they
differ
I'm so happy you bought this car too
this is this is one of our best
purchases so I could really I love that
I have both right now I can switch
between them with the press of a button
cool
all right guys yeah again blinded by
that's doing real light thank you for
joining this periscope that is today's
comparison between okapi live and super
cruise
good morning scorpius
all right
we got relaxers
oh my god this thing's huge
is it a very cold one no well it's
hybrid
it's hybrid
it's the best lexus it has breakout
though right it has brick holes yes well
actually i don't know if this break
holder
it has uh the e3b
[Music]
this
people who are smart and motivated
aren't motivated we're gonna know stuff
right yeah
um our interview questions are actually
like you know some people make a code on
the whiteboard we tried this early on
and it didn't work at all um it just
like stressed people out who were
probably good like i'd be stressed out
if someone asked me to code on a
whiteboard um so now we just ask like
simple questions
uh and they're like stuff that like if
you are actually like familiar with the
fields
you will just know off the top of your
head
and if you're not then you won't
like simple machine learning questions
and the question that i'm really trying
to ask without asking is have you ever
actually done any of this stuff or do
you just talk about it
do you like ubuntu yes i do yeah we love
it
i say oh i hate this turn well i guess
he's flying up there
oh yeah his turn is bad yeah
there's just still one tomato tree
uh i mean i don't know i heard bad
things
yeah i heard i want a model ass that's
what i heard i want
okay let's see how it's done
what is your favorite car of all time
my favorite car of all time i don't know
paying attention to the lexus right now
he's gonna fuse
yeah
yeah
did it what was it what's up with that
i did feel it
yeah why is it so late on the race uh
well it's usually it feels like okay
are you guys testing yeah
this is this is our first lexus um this
thing looks like i feel like i actually
am in a boat right now
um you can do stop and go which is
really nice
does the character is from zero much
power yes so it does the same thing as
the uh the previous the first okay it's
because it's a hybrid yes well actually
it because it has the abb
i think
that's the station
so italian yes
um
yeah it feels kind of boaty
oh someone else on openpower was
complaining about the wind
because it's the wind is the wind is
terrible yes um like that was the
biggest problem on the road trip yeah
well which car which car this was on the
rav4 i mean yeah you know no you went
under the floor i don't know it was the
guy
oh the other guy is on a stomach
are you saying yeah like when the wind
would cut out when you'd have like
something that breaks the wind it just
would not adapt quickly at all like i
mean we know why look at that look at
how look at how different the
perspective is from up there
yeah that fuse late before it didn't
feel like it went hard on the brakes
maybe it didn't like wind up or
something
um
oh on the brake
yeah uh no before before before yes
i can look into that what can we do
about the wind
well so what can we do with the wind um
so partially is like for the toyota so
um we have uh i mean different like
integral gains so it's gonna adapt less
faster than on the honda but you think
it's that well i think it's more the
angle offset learner right because
that's kind of how wind shows up yes do
i have to press that
well it does generate like a windows
offset how about the ping-ponging issue
uh so well ping-pong is uh mainly like a
problem for the prius
yeah the prius is significantly worse
than the other cars so
um yeah this is a quiet relaxed scope
it's early guys i stayed up real late
last night you know what i got you know
i got done last night
i decrypted the rav4 firmware
um
so i have all the uh toyota encryption
figured out
we're going to um
um
we're going to uh
maybe really go release a pcm reflash
that will let you
have your rav4 do full stop and go
um but now we know that it's just the
cpv thing to be honest we should have
brought the hybrid car hacking's such a
waste of time yeah
uh you know i feel very accomplished oh
man it's a whole it's a whole mess
toyota's stuff but it's all pwned now
i'm very sad that there's no read
command
um
though yeah i mean
just an exploit but
it's not uh
won't let you read
there's no good way to just read ecu's
um without like opening them up or
something i thought i had something
clever last night it doesn't work
no do i have to press the button
yeah you do it's just not coming up
because of the blind spot monitor thing
okay uh yeah yeah
uh will you buy a test site
will i buy it why would i buy a test
site i have a test right here yeah um
buy it how rich do you think i am guys
well i'm gonna buy something called a
castle like waymo
so yeah there was a question before what
is soil about the previous and if it is
a different hardware
uh yeah we believe uh it's it's
different like the place in particular
has like a different
steering module than all the other
casual at least when it comes down to
controlling it
i mean yeah priest is the only one that
can do um
can do
uh
parking yes so maybe it is different
what is the cable on the left for power
oh this is this is the karma power yeah
it's nowhere near as nice as the common
powers we're gonna sell it's like it
could constantly power the giraffe so
that's actually a for sale bd support
right now in the shop uh you can buy
your very own variant of that the one
that we're selling is even nicer than
the one we're using right now comma
power it's twenty dollars
[Music]
open pile it's not going to pull over
for emergency vehicles quite yet guys
with a big truck
you know i'm always a fan of the fire
trucks going by they got somewhere to
pay
there's a big fire in our town
uh burned down a hardware store
now with the cruise control we actually
like we can't command going 42 even when
it says 28 or something
uh i don't think so no it's uh well
if we send the 28 we can't have the
vehicle accelerating above 28. yeah
they're going to block it but can we
stand 42 well that's the thing that we
need to try so we might need to try to
send like 42 even if the if the
pcm sends us 28 yeah
can accelerate up to 42 i mean this is
another thing we can fix with a pcm mod
like we can have this all fixed on the
rav4 yeah um
it's actually uh
so it's encrypted but um i i didn't even
have to read it they released a firmware
update for it on december 21st
um so i just got to use the
can
um so there was a question can they find
a drive by wire
from 2009 well the answer is no because
that's the that's the banned question oh
that's a good question we don't even
entertain that
and you know what buy a panda and do it
bro i believe in you
um
yeah let's go this car fails
passenger side what's her name ricardo
so does the white spot monitor error go
away when we plug back into stock
well we can clear it right
nice are we using glg yes
the giraffe right there toyota giraffe
is lexus compatible so this is the most
popular lexus this is alexis rx yes uh
we just wanted to make sure that
wheel
it's decent
um
we were talking on the way out here this
thing is like half the torque of the
corolla yeah
not because the actual torque is any
different because this thing is a boat
yeah
why she felt blocked iran
dude i'm not even touching that
[Music]
we didn't try to block it in iran but if
you put effort into trying to unblock i
don't know man i'm not touching that
yeah i think i think to be we don't do
anything to block it
i don't know if it's your government or
our government or somebody's government
but
you know you guys all know out there
that i'm not about pissing governments
off you know i'm friends with
governments
they have a lot of power getting respect
their authority and defense
you still limit you your setting limit
or car limit you just refer to uh no
it's good in this case car limit like we
do use in our own limit for like rate so
how fast we can combine torque
but as far as max start we use all the
door that the car allows us to use
what is your feel about microphone
windows
what do you want to know about it it's
all right it's very popular a lot of
people seem to really like it
this is not confusing
you guys know we have a problem with
stopped car fusion if you're using open
pilot you know be really careful when
you're coming up on a red light going
faster than like
maybe in 35
we might need to do the warp before uh
i think this one is even higher
wait really i have to press the button
twice if i resume it from
uh
only once but if you start to have a
stop and then you have to press the end
you did that i pressed it to engage in
it
okay well this is another reason we're
hacking pcms bros
yeah pcmx would be nice
plus
yes we do
uh do you recognize have division can
you not check other and combine to say
rather miss this
uh yeah we do uh the radar
hardly miss anything the problem is that
the other has a lot of false positives
so we need camera confirmation to
uh to recognize or stop the vehicles
that have never been
that i never seen moving before
cool
let's go basically
uh where did i say
i don't know what's up
um
i don't know maybe we'll turn the
scopies off
we'll uh brainstorm about wind noise
stuff
about the wind
thanks for joining this is the first uh
lexus rx uh on open pal this is the
first lexus was there much different
from the toyota
oh
i mean in terms of like code changes
yeah no
we'll just change our reporting guide to
be the toyota and lexus porting guide
um you know ricardo worked really hard
getting uh getting a great guide
together so you can port your
unsupported toyota this is good
um so you can get your unsupported
toyota or lexus working with openpilot
also buy your eons
pandas and giraffes today i also buy
clown power it's the newest product come
on
out let's go
yo nice movies about water food real
quick you guys can watch me order food
I'll see everybody my name is George my
email is George and I must case you be
able to see we got Mosab alright so
whatever want to order guys order garlic
fries whoo I like garlic fries
definitely order some of those what a
weird time no no no no I got I got
something I got to show you guys why
would I want sauce
I don't like sauce oh um so we
definitely wanted some garlic fries I'm
gonna get a burger
yeah lettuce wrap yeah no sauce yeah I
hate sauce all right with good brows hmm
ooh can I get ice cream holy milkshakes
I only get milkshakes ah okay
okay cool
hi guys here's what we're going to talk
about today panda in a box yo is that
hot or what panda Panda panda look it
when you get a panda if you would have
an order one by the way all the pandas
are shipping out and they're coming in
these beautiful boxes we have tons of
Panda
so neat and this is the latest panda
injection molded case technology you're
gonna be getting a pretty printed pan up
boxing right you guys that well who's
that guy Bryan Bryan comedian who's
funny man you just get a box $10 um oh
yeah so this is gonna be our new URL
it's not live yet this is the official
UPC for the Panda it's order one today
or if you haven't gotten yours yet
you've already ordered it we're gonna be
shipping it out in a beautiful cardboard
box how crazy these alright so let's
open one of these up let's see if this
is a 3d printed one or an injection
molder this is a 3d printed one we can
look inside we can see panda Panda right
actually great packaging though right
how much to autograph the box that's 20
that's a 3d printed one let's see if we
can find an injection molded one the box
is a little hard to open but that's good
oh yeah look at this injection molded
panda so how to walk guys Panda I'll
play for tonight
I'll beat anyone at age of empires
anyone wants to bet me $100
vampires let's go alright so this is an
injection-molded panda these are still
pretty rare we've run into a few
manufacturing difficulties with them oh
so you all can be getting pretty pretty
pandas this is a 3d printed panda what
is the age of empire is my parents best
game in history compares to browse
conquerors exposure um but yes that's an
injection-molded panda that's a 3d
printed panda
order today get your panda we'll listen
to the Panda song that sounds good no
these people working distracting enough
but well we are gonna do is go
downstairs and look at bags and bags of
pens Oh what's open
over here crazy yo guys let me tell you
what else
pandas are indestructible look at this
no damage
beautiful panda I did break one when I
threw it at the floor really really hard
like Logan power plates but for the most
part they're pretty indestructible let's
just go downstairs we'll say hi to Ed
you real fast and we will show you this
huge box that pandas came in guys pandas
are back in stock go right now to shop
comedy i buy your panda and we will ship
it out on Thursday hey you wanna say out
of the scope ease what I want to say is
go visa to show them all the pandas well
we got lots of pandas y'all show you
guys at the inside of the Panda looks
like check this out that's a pan pandas
red boards black bass board
look at that panda beautiful 3d printed
founders are totally limited edition
Eddie's right over here disassembling
panda he's assembling great panda Panda
there's a great fan of top carrier board
for our u-blox module
there are three ready to go all right
guys thank you for joining come get the
hottest panda in the game uh hottest
panda in the game check out I got the
favorite hoodie alright um come get the
hottest pan in the game right now shop
comedy I go by your pandas they will all
ship out what's that on Thursday right
15th yeah guys these odd scobie's we
never support Subaru no no you can
support Subaru
yo yo yo welcome to the kana ai
periscope we are here i'm george and i'm
here with eddie hey guys um we are
manufacturing
uh pandas don't think anyone heard that
no one was in our periscope yet
so these are panda cases
we have many many many panda cases
this is a small amount of the number we
have oh we have many more than just
what's here
um
so i'm picking out the ones that are
good
many many panda cases you see this is a
good one it doesn't have any of that
raft crap on it you see this is a bad
one it has crap on it this one is no
crap so
it's all 3d printed yeah we were
originally going to sand the cases we
have a lot of sanding equipment set up
but sanding sucks
oh so
i mean you know they look pretty good
we're figuring out what we can do if we
can do a little bit better than the
finish
you want to do videos for common ai
please do videos for coming yeah where's
that scale
yeah let's get the scale so we're gonna
figure out how many of these we have by
way
bro pandas are in danger no more you
don't need to manufacture you know china
owns all the pandas in the world
um so do you want to show the people a
raft
uh you get to show them a printed one
and show them like what they look like
when you break them off
that's something oh there we go those
commas are pandas those are pandas oh
these are pandas look this is what a
bunch of pandas looks like when we
manufacture them
i'm sure they have plenty of pants in
shenzhen
well so this is the kama side of the
case we have a homicide in the case and
the panda side of the case
we're about to go get the scale to
figure out how many of these we have
so we've manufactured
we've we've we're not going to announce
the exact order number but i will say
that it's over one thousand
and i will say also that it's not over
nine thousand so we sold somewhere
between one and nine thousand pounds
um
so yeah it's about time for these guys
to start shipping uh the first finished
pandas are right here
this this little batch of six right here
it's pandemonium you see this is a
sanded panda
so some people are going to get sanded
pandas but yeah oh excellent
um
so this is our scale how accurate is it
you know they they watch you after you
buy a scale
really yes it's a blue skin it's a food
scale all right cool so that's
grams hair
yes we'll tear it to the box
and now let's weigh one panda two panda
three panda four panda
seven eight
10 pandas weighs 34 grand let's do 20
11 12
14 15.
is liars okay so 20 pandas is 70 grams
let's just do 25 so i can do math easier
[Applause]
21 22 23
24 and 25.
okay so 25 is 86 oh 86 that's not a nice
number
oh this is computer again
we have computers to do math we have
computers to do math i think actually i
want to fix my phone
to not
so 86 is
what's the best way to contact me right
here on periscope if you have something
secret to tell me we don't like secrets
um so i don't want to know okay so 86 is
25 we should write that down somewhere
25 86.
oh prius is coming along well
uh we got with our top guy on the prius
um so 86 86 is 25.
100 is 344. yeah
that's a better way to think about it
okay so that's 249 right there
wow these things i thought there were a
lot more in these boxes than all right
so we're going to sort them between good
and
good bad
bad bad
you know
you know like
the truth about being ceo of the company
is when things are you know when people
say like not my problem
um well it's my problem or what's what's
yeah that's that's always my problem you
know it's never not my problem it's
always my problem
like counting the paints
344 okay
we should batch these off in batches of
is it possible to pay a visit to our
office unfortunately not
this is not a museum this is not we do
not we're not google
uh we don't have vitamin water in the
lobby
um we have water in the sink
oh google yeah you can walk into google
my ex-girlfriend's in pittsburgh i think
i don't know if i want to go there
wow 47 people hello people
um you know how many times do i say when
i periscope that i need a tripod
all right so what did you say 100 344
right 344 grams okay we're almost there
ye
oh that means
a new curse word
alt-right
some guy wrote heat on that thing i
don't know what that means all right
that's 342 grams worth of comma side of
panda cases
that's pretty good
yeah there's probably another 200 in
there yeah so let's get up to
what was it three three three forty two
three forty four three forty four so
that's that's i gotta get to six eighty
eight
get to six eighty eight
let's see how many fit in the box right
if you make good stuff we'll tweet it
um i like twitter what
let's measure the volume of pandas
would be proud
um
you can shut that door so my periscoping
doesn't bother the employees who are
actually working
is
and then we can see if they're scamming
us and this isn't actually made of abs
but it actually is abs and you know
maybe it's 15 ethanol you know yeah corn
subsidies yeah
can you make plastic out of ethanol
bla is mostly is this one
yeah that sounds like the kind of thing
they would like to sell in america
that's why pla melts yeah
when are the first hundred shipping
probably tomorrow
i don't know we gotta finish we gotta
finish the firmware which is what i
really should be working on not carrying
panda places but it kind of kind of
gives us a whole lot of fun
a secret
it's not a huge secret you can download
it you just don't have the source code
to it
not a secret everyone knows about vgd
otherwise tell us what the car see
you know true story and this doesn't
leave periscope we were originally going
to call it mobile id um and but then we
decided not to
we called division
you know wait we're working on something
now called location d or in other words
apple next date
uh yeah we gotta we got a guy we're just
we're we're just bringing him on full
time now to work on uh
localization real quick i missed that
message if someone wants to say what it
is again
okay so what we're doing is for those
who just joined
these are cases that are going to go on
pandas we're going to get
688 grams of them
and once we have 688 grams of panda
where are the boards well the boards got
delivered this morning
to
one of the places that's doing final
panda assembly addresses we do have we
have 1 000 boards
[Music]
in holding right now after these ones
get shipped out we're gonna authorize
the next thousand to be made
yeah and they look kind of like lego
right like they're kind of cool we
actually thought about building a lego
finishing machine for pandas
um so what we bought and what's getting
here today
is uh
is is is a uh
ultrasonic
uh wash
and maybe we'll just put all these cases
in the wash and make sure that you all
get clean pandas you know
um so panda cases are 3d printed and
then they're glued together uh because
there's no user certificate parts inside
um
a nice analogy board
report this is this is what the new
logic boards look like guys someone
hasn't seen that before yeah
beautiful they are they are pretty
beautiful i like them this is pretty
close to a work of art yeah we're
originally going to do white and
blackboards why don't we go with the
whiteboards so whiteboards apparently
get really gross when they go through an
oven oh that's too bad yeah it's kind of
changed but at least we learned that
before hey you know what that then if
you get something with a white board you
know it was hand soldered
um
like a really expensive white
um
well we can't afford that
that is definitely nothing
oh no the scale turned off and it would
what save my tear
oh this is a tragedy
oh okay you know what another empty one
yeah yeah yeah yeah stickers on it
stickers on it are you sure they weigh
the same i don't know what's the
manufacturing variants of these things
i love sterilite
what's sterilite is that what makes up
tomato
no that's the company oh what's that
remember
okay so i think maybe we'll put 250 in
each bin
okay
so what's what should that way
360.
860 grams okay
we don't do we don't do marketing and we
don't do branding
um we don't do advertising
because i don't know i mean like
we're they're gonna build a good product
and win or we're not i'm not gonna try
to like
scam people with advertising like
awareness is one thing but i really
think if you have things that are like
10x better as comma starts to succeed
and a lot of people start saying
you know
dude i have a self-driving car right
like it's something people are going to
talk about
you don't need marketing when you have
virality
um and if you don't have virality
what it means is that your product just
isn't good enough
um it will build a better product
and you know that's really what we're uh
what we're motivated by here building
the best products we possibly can
and what do i think about sendax well i
do yeah i don't know what centex is
so if you tell me what's the number guys
uh 863
[Music]
yeah right that guy um i don't know is
that they're going to send that to maybe
that's in the comments i don't know
how many cars did i trade the first
hardware unlocks for just one car but
also three phones right so when you
trade one phone for a car and three
phones you definitely win
how many rev bees do we have left none
they're all gone
do you have any red bees left i think
there's some uh
[Music]
you know we wanted to see how people
would react to pandas we wanted to see
if it worked and we wanted to test our
own manufacturing
um red c is really where pam is at and
of course everybody who paid for a panda
will be getting a red free and contest
winners will also be getting revzies
because i just don't want to do a friend
boobs anymore
um
so yeah we're going to be getting we're
going to try to have the cases finished
up
can we get could semester come in this
weekend
yeah if we get the cases finished up um
yeah
well this is it's a whole lot easier if
we're not getting the standing
yeah
oh they're fine with that they're fine
yeah what's the biggest issue we've
overcome while creating the
manufacturing pipeline
i don't know just you're making a lot of
something i've never made this many of
something before i shipped hardware
before but
um this is a lot
and this is i mean pam is not a super
complicated product product it's not
like a phone or anything
but it's not that simple i'm at 862.
okay you're at 251 maybe eight so should
i be at 8 59.
no
all right we'll put in one more for good
luck
so now we know like an approximately
full satellite is about 250 of them all
right
all right
these are all common these are all
common
and they all pass the hots goodness we
all pass the hots goodness test yeah
yeah
250 so we're going to try to we're going
to try to get a thousand of these
these kids do you have more comments for
me to break off
i need a little tripod for my house
all right we're going to try to get
another 662 gram of pan
this is the comma side of the comma
looks broken
broken
[Music]
see the broken you see it's got like
that crap on it
i'm not sure
yeah
and then our ultrasonic washer gets here
today should we should we show them the
nice folks on periscope the ultrasonic
uh
washer can we get it yeah yeah
they're not right
these are all comma yeah
get a chest strap or mount the phone so
this is what it looks like see that's
comma
and this is what they look like when
they're
off the
panda production
clean slap
off of this whoops
doing everything one-handed for you guys
man
prius is going well we have our best
folks on prix
what if the comma gets contaminated by
panda
look at all those copper
will the civic get increased programs
during the civic already has increased
difference oh you mean more increase
than the six percent
um we're 12 people
uh
no we don't plan to ship any firmware
updates at least for a long time to
increase torque beyond what it is
um
silky smooth is yeah we we're working on
silky smooth um so if you see rick blass
in the chat he's our uh he's our
controls engineer
uh it might be my soundcloud i do have a
soundcloud
um
he's the guy who's working on our silky
smooth controls we also have an intern
coming
uh starting soon and he's gonna be
working on controls as well so controls
is about to get really good
yeah rick does a great job he does
how many panda do you have
a side yeah
i guess we can put them on a scale
yeah
yeah so how much for a feature
hey if you know what i'm at this stage
of my rap career where if you can get me
hits and views i'll throw a verse
together i got 16s all day man
uh the a8 no no one is an a8 we're ghost
riding for the masses
right man if someone buys me an r8 i
will make open pilot work
buy me a personal alright not for
comment right now you buy me an r8 i'll
make i'll make open pilot work on it
there's an a8
you really got something going on
yeah that's not the largeness i don't
know actually i used to have mercedes
s-class was pretty nice
um yeah rev c is going to be two boards
like ref b but
what's what's what's gonna what's going
to upset the uh fine folks about the rev
c's on the board
they're not socketed no they're actually
soldered together
oh mentioned no no no they're talking
about a8s because they're level three
autonomy all right so you see like i
don't know i have mixed feelings about
that level three autonomy can you see
rev city yeah
what is the panda um check out our
medium if you wanna know these are fcs
um
so let's see do you haven't assembled it
here this is the rfc that i was working
on debunking with
just arrived to see
[Music]
is what they look like
there's about the finished strategies
notice the case looks a little bit
different from the raspberry
all right
which printer we used our zortrax m200s
should we show on the printer yeah
some prototypes
oh the prototype so i can't show the
photo
they're sealed in the front there i
won't open any of the printers
um
just going in here
and you guys know about our data center
right
so data center
um many many pandas
uh here's our printers
uh we fill more schlapp
dom
and abby
they're all printing some of them are
printing secret stuff
um
yeah so this is what your pan is gonna
look like
in this slightly unsanded case they look
pretty good
um this is
this is a really good alternative to
injection molding
yeah i saw the atlantic story today
um
8 million miles per day maybe in
simulation
not in reality
the
i don't know i mean simulator might work
uh yeah the ship the the data in the
shipper app is of course being used
including trainer models
um
i don't know about simulation working at
the end of the day it's not like
simulation is a bad thing and it's
certainly a good place to test
but i'm actually using a simulation to
develop your algorithms and what you're
doing there is you're hard coding your
simulator what is the giraffe
they thought the giraffe was a joke
that's real uh do we have like a nice
giraffe minister
how old
it doesn't have any of this new switches
oh okay okay we'll show them today
so that's the idea of the giraffe
um
you see that this plugs into the uh the
mobile eye and the honda
this is where you plug in the wire and
this is where you plug in your pan so it
lets your panda connect to whoops
it lets your panda connect to the uh
special place in the honda that you can
control the car from so this is a
giraffe um
i think we're just going to open source
them
la timer is already selling stuff that's
a lot like this
open board openboards.i o check it out
um
so you know yeah we're not trying to
we're just gonna probably open source
this uh anyone who wants can can make
and sell them
uh updates for open pilot
um how has it been in the giant panda
should we should we should we
okay
giant panda was like apple you know we
were not planning to support giant
pandas long term
um there's a lot that we haven't
announced but i wouldn't invest too much
into giant pants
but that's all it's like a giant pants
i mean less than alpha very low not
giant giant pandas were were just really
for us to test pandas and for rev b
panda holders they're not really going
to work with refsea pandas
um we have better stuff planned
than giant pandas
um we can't let them know the big
secrets
what next animal is coming up well there
were common koalas briefly yeah the
intel discontinued the jewel
oh yeah remember that joke the jewel and
the other thing what's it called oh yeah
edison the jewel yeah or no is it just
the jewel that got killed no no i think
they actually canceled i can't tell i
mean it's not intel's a disaster that's
cool but yeah i mean
like the support files they released you
find a lot of bugs in what
an open pilot
what bugs
well do you mean bugs or do you mean
like uh like you know places where uh
you have to disengage
cities to make infrastructure changes i
don't think that's really worth it
um like the truth about self-driving is
the whole hard part
is interoperating with humans
like if you
you have to make a change that's so
radical you'd have to like take all the
humans off the road
and i don't really see that happening
anytime soon
maybe in like very restricted areas in
some cities
um we don't have a common store should
we call our store
so what i'm trying to figure out now is
like when i'm breaking these things off
are some of them predestined to be bad
or is it about my technique
uh i think some are just pre-tested and
i think that's what it might be but some
is ripping tanks what bugs have you
found in open pilot um finally issues on
github if they're real bugs we'll
absolutely fix them
oh i saw the one about the rear view
mirror yeah we'll work that at the next
release sorry about that
what was that um it was uh
just just
this is a stupid bug no the the
disabling of the rearview mirror mode
didn't work uh in this setting the
settings yeah
people like the rear viewer
people like disabling your room
um if you have a oneplus 3 it's really
not useful the 3t it's a bit more useful
um
you've been around for a while that's
definitely true
uh
you found you found bugs still in open
pilot yeah let me know let me know what
they are what kind of stuff
is there going to be a neo s4
i don't know maybe probably
yeah i mean we have some things planned
that i think they're going to need an
update to the os i'm not 100 sure on it
um but yeah i mean we have we have all
the updated infrastructure replacements
so if we do decide that we need to
modify the underlying operating system
if you see there's now a sub module in
open pilot called pi extra
pi extra lets us change the python
packages
without having to change the operating
system
[Applause]
all right guys um this is getting
difficult with the uh
holding this and doing things you're
taking a ride in uber self-driving in
pittsburgh how was it
is it any good
yeah it's just a work in progress it's
sort of here i i've been an uber
self-driving car as well
um nothing too impressive
so yeah i'm gonna let you all go for now
we'll be back on later if we get another
cool step in the manufacturing we want
to be real open with our panda
manufacturing processes and no to
everybody who ordered it you will be
getting them
pretty soon yeah
we'll definitely meet our four to 12
week deadline
uh thanks everyone
bye bye
bye
swipe down to stop
yo yo for boxes pandas are here anyone
periscope yeah right they're here oh
that's smaller than you imagined right
that's a thousand pandas get a knife
from macro fact they are exclusive not
exclusive yet
good good tight tight time hi-yah just
cross out aunty so yeah yeah yeah Andy
I'm got Eddie we got pandas oh yeah
because pandas are going on Amazon you
guys know about safety that's in two
boxes I'm not gonna tell you guys but
loop is who knew calibration of DSP with
the DSP we got to use the DSP for DSP
guys all right all right
so macro fab is our manufacturing part
and one of our manufacturing partners
for pandas one of our many occupiers
exclusive we're getting a parent express
to be the exclusive IRL distributors but
unless yes let's open a box alright if
they're not good we're gonna put now
live on periscope to react the DSP knows
outraged so fine line yeah no it's good
oh one is good oh this is a good panda
it's a great man oh man wait let's plug
it in its use with a great these are
nice it good job macro found coming
through
yeah no we had some quality issues but
it looks like we've worked through them
let's plug this pandan to make sure it
works oh yeah
nice nice nice look at that panda dude
and there's literally you see all these
boxes just really
so we're gonna put them through our
rigorous QA procedure going back to the
manufacturer that's what we're gonna do
when they don't work the foam on the
side they don't work they go back to the
manufacturer wait put that one to take
that one and put it in the box you can
put it back put it back in no no no
discount we don't ship anything bad
quality we're going downstairs we're
gonna take these pandas into QA why did
they how did somebody put it you know
what 99% of them look good no no no the
first ones were made in-house yeah but
all these ones have been made by an
acrobat what is a panda a panda the
nicest universal car interface ever and
you can buy one right now in shop comic
valet guy you can even get one of these
you want to say hi to the periscope
people this is Chris love so newest
comment I employee and we're taking four
panels I asked absolutely
Chris the jar right yes yeah Chris is a
jar yeah so no there's no flex on pandas
guys but yeah that's Chris and these are
pants
so we're gonna box all of these yeah
pandas are small but wait yeah we're
gonna unbox oh I got some bags we're
gonna unbox and test all of these pandas
or you're planning on expanding what do
you mean by expanding Chris is working
on JavaScript he's working on Cabana
panda Jaya these nice big all of this
stuff to truly make Panda a five-star
experience as a nice bag to truly make
Panda a five-star experience because
guys
pandas are going to Amazon you all know
it that's why they have real UPC's that
look good
actually it's a GTI M GTI yeah maybe
we'll just test this box we'll see we'll
see at least look at all the box if not
a single one of them fail well yeah you
gotta look at all the boxes why is panda
J is so important because javascript is
the future you guys yeah we're gonna
code the new open pilot in we're gonna
move from Python to JavaScript
JavaScript OVA pilot drive my car dot
today we own the domain
applications with the panda so if you
have a specific car and you can unlock
some fancy feature and with the cars
electronics you can use panda je s in
order to write a simple script or ship
it in an application on the web or on
mobile apps or on your desktop to unlock
your car against all your features get
everything you can out of your car with
kind of je s good pitch ya know
javascript is a hugely growing language
um you know I I'm a Python guy but um
yeah for everybody's like making apps
today using react and stuff we really
want panda to just be the most
supportive best car to face ever and
also we want Schiffer to use passage is
what about those know how to code you
can use Java scripts great language you
can also use Python we have a Python
library for Panda an open pilot we have
a C++ library for panda called boardy
you can use that we're moving to a
bigger office
no with there's a lot more room and
there are like three rooms in this house
you guys have never seen why would you
buy a white panda instead of a gray one
half the price comes with Wi-Fi can you
make a pigeon antenna with a shorter
cable we don't put the cables on the
antennas guys when's the house gonna be
full I think we can fit at least five
more people in this house
there are literally three rooms you guys
have never seen yeah well they've never
seen that room no and they never really
seen this room yeah and they've never
seen the tiny room where Willem used to
live all rights go
yeah good this issue is now been fixed
the boxis you can you believe that I
mean that's like someone builds these
how would they know what I can move out
there's my room as well um builds these
yeah I understand yeah boxes are good
well these all look good there's no glue
on they look like a good product yeah
oh you have seen the internal okay you
guys have seen that room though there's
still two engines you know like you see
these look good you know we want to ship
you guys only the best stuff if the
antennas not directly above the camera
how could it be so accurate calibration
bros yeah it's live in the closet no no
no no we're trying to hire a recruiter
so they're crude oil be joining they've
in our office
how good is macro Fair's been a few
hiccups recently and getting any
manufacturing that's ok that's hard
we've been happy yeah and they're way
better than like you know these local
board houses in oh oh yeah price-wise
price-wise that's right yeah we're gonna
quote from someone in like San Jose yeah
like insane they're not transparent
about what's going on that comes great
because they show you literally what
you're paying for the part don't maybe
the cost they may be your main boards
and labor we will show them the circuit
how grand palace yeah these are from our
other guys working with our github Sarah
come home with a set of samples we're
working on it
no macro fats actually been great like
you see we get those pandas just all
like that in the box from macro fine
yeah we sent them a procedure and a
laptop and they program oh oh you saw
they want to USB kina getting one
another I wasn't only one USB but we
know so it's made our life it's made our
life a lot easier yeah we used to play
look good cool and your mate and testing
CTF days yeah a lot of people work here
man factory injected midnight black yo
you want ejection welded Aeons no it's
not happy
no they're not you can't make them on
other than Jackson long we're big fans
of 3d printing here guys by the way yeah
we're looking if anybody knows we're
looking for 2001 plus 3 TC like has got
a truck yeah
how much is macro crap nu du shell
nothing nothing Vidya was a good deal we
made a good deal with manufacturing
families we tweeted about them once yeah
look put it this way when they get us
the remaining of the Panda order and
their QC great we'll have great things
to say about Mack around yeah yeah
definitely some again this is our first
big shipment yeah so we're excited oh no
you can't send in a phone and have it
converted to a neon I don't want to I
want to thousand why not upgrade from
the three T to the five T because the
five T is too extensive five hundred
dollars and we don't make profit anymore
and you guys know that I'm a capitalist
greedy bastard and love profit am i we
can't exist without profit right like
someone's got to pay for all this guys
you think Ratan San Francisco's cheap
why can't we use the new one pluses
because you can't buy them cheap and in
quantities custom hardware Eon Wow hey
you know is the next Aeon r1 no no no no
no the Aeons will always be Beyonc
if you bought an e on it will never
change its name one day
it's damaged at all in it then you put
it in the bag look at like the box
tearing like it's something well this is
a new cue season they sent us more what
they need foam on each layer like it's
not that big a deal because we have
extra boxes yeah that's like yeah well
if the only problem is a lot of them put
foam on each will the next one be called
env2 maybe I don't know guys who said
there is the next one females for life
yeah yeah I mean if this is shipping
damage and it's like honestly it's like
it's like boxes get them though I just
don't care what I do for box we get down
they cost me nothing we have equipment
boxes yeah but does not because like one
day we want them to send and I think if
every one of these passes qce except for
the box
can we won't even have to open the other
boxes okay what did Eddie do before come
on you want to tell them oh I worked in
New York for a year now actually 360 how
many three 265 but I worked there for
one year so I didn't have to pay them
back for my moving expenses and it was a
leap year
so I like saved a nice oh we do have
something very serious to ask miss go
peace guys when Pam was going Amazon who
right now honestly would give panda a
five-star review stay you should get a
ponytail that doesn't okay yeah no guys
like we're really working on panda
quality we're working on making the best
libraries yeah and once it does go in
Amazon we really would appreciate only
if you feel that way about the product
if you don't feel like the Panda
deserves a five-star review don't leave
don't leave marina but don't don't leave
a five-star review if you don't really
believe it's a five-star product um
don't you need to be a buyer only
amazon.com
first I don't know like you have to have
bought the product well I mean you guys
all did buy the prod like don't leave a
five star review if you don't own a pan
that have used it it is way better than
the other candidate offenses like we I
think if the shipper pairing is now good
and we have panel Jas launched I think
this is very clearly because you know
reviews a super board on Amazon how much
support in Europe does the whole kind of
platform have you guys pass ridiculous
data protection laws so less talk to God
love your covenants really we're focused
on US Canada Mexico also your import
taxes we're big fans of NAFTA here yeah
yeah yeah global free trade global
America free trade that's right what
user demonstrate that case is all look
good yeah any that are marginal there's
one well they have prime shipping
absolutely that's a good print yeah we
love Amazon nice she's all about working
consciously driving the left I don't
know ma'am I've never tested every we
leave we only tested on the right by the
boxes okay just some of them can you
seen from the outside no it's just like
doesn't fold nice okay maybe something
else
okay shipping is already super fast you
know guys but we got to get a non-prime
this Tesla going down
no Tesla's doing super well 5 star if
supports most el maps okay well we'll
make sure we what we want to do we both
are is one el maps but with most couple
with with cars and with El maps we're
gonna make a list of ones that are
supportive make a better app than
Scheffer yeah maybe maybe we should make
it yeah
put the El map features in shipper well
but we're gonna take select features
that he'll maps will provide you really
shipper and shipper is too we have a
looking manager drive we have a look
into the other negotiation stuff no well
so although bought is a different thing
negotiation no but like you know some of
the people are saying it like makes the
check engine light turn out in their car
you gotta figure out what that is before
you go Amazon yeah certainly if you have
a car where the pan is please ping me in
our slack and coming to her shipper
panda channels and feedback yeah yeah if
you're having if you're having a problem
with with like torque on your car we
want to know will rent your car and make
it better
is this a Kickstarter video this is not
a Kickstarter video okay
we considered Kickstarter
expenses and also like we have money to
layout for product we don't need to
raise money from the crowd you guys know
I've talked about on periscope a few
times we did raise a new funding round
recently we have we have too much money
too much - give so much back that's fine
I reaction look we actually raised I'm
very happy with our race and the fact
that we managed to do it without giving
up the boards yeah if you order an e on
today we will ship it you tomorrow for
equity what do you mean for equity how
do you start a self-driving car
companies don't start a company only
this year am I happy I started a company
for the first three years I was not yeah
yeah because the only reason I'm happy
now but I started the company is because
we're doing well products exactly like
and you don't we're buying more products
and the products are getting better and
you know the industry is shaping up kind
of exactly how I thought it was yeah
like what like no I took two years ago I
told you that in two years
wham-o is not going to be driving
everybody around in all the cities with
an easy app and sure enough I think
stuff is just not human level yet maybe
it is super hard and you know the way
that you do it is not with like 100 cars
in your fleet it's like we're like
Tesla's different we have way more cars
than way mo now wait last year it was
close before we were selling Eon now
it's not even close we probably want to
double as many cars is waiting for us
when Moe's gonna get 20,000 cars win in
two years we passed them these you
realize were actually in second place
right that's right Oh 20 2000
how many you're driving with comma five
hundreds yeah it'll be thousands by the
end of the year cool guys well thank you
joining ya pandas so all the pandas that
you get now from us will be the new
style injection-molded opens off the
website the old one I think there's one
picture of it laughter we can delete
that picture but all the pandas that
ship now are injection molds $99 comes
in cute little box
yep they all ship we ship to Canada
absolutely yeah we ship all over the
world thanks to DHL we do ship all over
the world but I think Amazon I think
we're only doing u.s. Amazon
I like items are very restrictive I
don't know if we will ship to other
countries hopefully we can support you
in the UK suit I mean you can certainly
buy a panda that you okay yeah you get
rid of your ridiculous data protection
laws guys oh come on what oh let me be
GDP or compliant um some European
regulator is watching me right now
seizing all my orders and customs not
allowed to say bad things about the EU
not saying bad things about the EU just
the GDP are amazon.ca yeah thanks bro
that was on CA I don't know it's like if
it's like one click and I can click like
Canada new model will require Maps no
but it'll be helped with maps if we want
to get to like the insanely high levels
of quality we want you know like look at
if Tesla had to have maps like the
autopilot crash wouldn't happened not
blaming Tesla blaming the drivers not
paying attention pay attention guys
but um yeah yeah you can't you can't
rely on maps you can't rely on like you
need in order to get safety there's just
a huge mixture of things yeah the new
model for you don't write the new
European law just says to encrypt the
password and make anonymous public
information we do both of those things
but I don't know man
some people like edit detailed
instructions to get started Google
update on website for getting new UI
fullscreen but only full screen do we
shut the screen shift full screen yeah
mapping with that great pant I know I
looked at one of your routes America
first guys and I don't mean like America
first like a combative way I just live
in America it's easy for me you know a
born in America I love America but yeah
cool
thanks for joining fire Panda and make
sure when we're on Amazon you leave that
five-star view
we love five star reviews.i by
well back Skokie's photoshoot
exclamation points
I don't think I should get on Wi-Fi
don't you think
well was pretty good my ulti is better
no it's not it's not it's not divided
are you guys happy with the Wi-Fi Scopus
what's up this is my photo shoot look I
might hand you I'm ahead um I hand you
over to Vivian
yo yeah comment nowhere ha has always
been here yeah we're doing a photoshoot
folks doing a photoshoot okay it could
be mine no purple night so I'm proud of
my purple fear uh y'all guys 2:49
hoodies I'm gonna be real I tried this
hoodie on shocked at how cool it is and
I I literally hadn't tried one on since
making them all the hoodies yeah exactly
I did yeah Philippine it's professional
developments right yes
but guys we got to be profitable in q1
we're gonna be profit I was hoping for
an Zevon Shay photo shoot Oh y'all I
didn't buy the cheap on check guys all
right remember how I used to talk about
little people all the time but what
people lo people oh yes have a lot to me
the peeps dead honestly who keeps dead
and he was kind of 2017 you know who's
2018 you guys no no we're shilling for
Logan Paul bro ever since I found Logan
ball my life has changed I've had so
much 22 he lives in LA in a mansion
there's been so much positivity in my
life Logan I hope you're hearing this
that's right don't by the way like if he
wants to make that Yeti self-driving I
don't do it I would actually think you
two assuming are profitable in q1 yeah
no we got we had some amazing the y'all
should know so the yetis not a real car
the Yeti is just what he named his big
bend's you know you gotta like step all
the way up into that thing yeah so you
guys get there we're doing a photo shoot
right now
are we loyal willow we're like always
the boy so much everybody but it go to
comedy I slash shop that links not live
yet for now yeah really soon understand
you were live kamidana okay when Logan
Paul does it like the words appear on
the screen it's Christy and it's videos
we should do that we gotta start do it
no yeah think I'm gonna do that real one
yeah that'd be good let's hold up with
these paper then be just as good but
know what we're doing we're doing a
photo shoot today the reason reason I
don't know I don't know obviously Reggie
interviewer watch the interview I got
600,000 views on YouTube which is a lot
less than bug and fall but you know one
day one day LP you know one day you guys
got me yes me honestly
PewDiePie might actually talk about us
yeah cutie pie I'm a big beauty we're
big beautiful fast we I didn't know
recently no but honestly guys lacks for
the 2019 we're moving to a mansion in LA
yeah
after comas this is gonna be our success
yeah this is it this is really this is
the year 18:18 emerges the merchants
flying off the shelf over should really
watch it is we have an entire mushroom
would you have a merger oh that you but
we do shipping us know we can show on
the Mercer we don't know the numbers
yeah but let's just say millions of
dollars yes the sauce all will say I'm
also in good care yourself or the scope
these are 3 p.m. Pacific time tomorrow
we're gonna do a CES presentation we're
not at CES we don't go it's too full of
fake chills we like real shifts you know
what I mean Logan Paul like his friends
dog dies and he's like
sad but you can check out the new
maverick merchandise and like oh my god
bless shop yeah when duty on ship in
once the key OVR say they just made it
so pragmatics okay like what you guys
here for don't you just want to see us
be the photoshoot yeah everybody it's a
beautiful day in sunny San fits aboard
yeah they're interested in the
photoshoot and join explain with that
does do I show my motorcycle oh man
rules this is George's motorcycle it's
dead
yeah yeah and I need more - a foldable
pizza board winning yeah p.m. tonight
Wow 50m Pacific time tomorrow tomorrow
we're gonna be announcing a new product
we're gonna be announcing a new product
you read out your new variant of a
product there oh yeah very exciting
stuff this guy's great
he's gay we're gonna be on periscope for
you guys periscope for you 3 3 p.m. it's
gonna be like CES style but what our
products I don't know yes do you guys
know what's really happening in C at CES
it seems the usual yeah I want to see
alright let's go we'll get the group all
right who wants to be in the photo shoot
anyone before we need people Eddie yeah
yeah yeah we for sure sure yeah we are
sweatshirt miss Richards so
so we're ordering new ones so for for
the people who ordered sweatshirts we're
ordering new ones don't worry about it
yet so we have hats for the people wait
a second now I'm just I'm just having
skill fees in this there's nothing
happening scope is hanging yes
sixty-three don't miss this face seeing
him 20 minutes every day when we gonna
what are they gonna call me now you've
got for me so says Eddie Oh vanilla
gorilla obviously hit vanilla hey any
friend yeah I don't nobody spend
whatever trips I any Tosh noises it on
Hamra yeah I guess we're out oh this was
a great photo shoot to show you guys
look at this
we're printing but more importantly
how cool is that right yeah but it's for
photoshoot what are you wanting to be
word on the street is that the media
thinks that it's only George who works
for so they're like we should show that
your other employees so we're showing
you
Hey Oh Andy you want to say hi to the
Scopus yeah we're doing a photo shoot
yeah
you got some merch yeah merch sorrows
ghosts great good good we're still doing
this mother bleep 68 views maybe they
should be ended with this whole double
homeless coppice can't really see them
though that's kind of sad oh I'll just
still show it like you know I know
you're right but then they people know
how much we love our school they've been
here on this journey with us skull peas
is it gonna be Scopus forever like we
need like low gang or Jake Pollard's you
know comic thing right she's pretty
squad three squads out driving yeah um
grab some merch come on down research
that oh yeah grab no just grab some
sweat you've got we got whatever I got a
roadie oh oh yeah there's more of those
dents no they're not bad they're just
not for sale car awareness tour with us
you can't get one of those yeah well you
guys there's actually a real shortage of
what he's told this go babe yeah we're
getting more likes you would not believe
how much hoodies sell yeah you really
wouldn't believe it yeah we're gonna be
profitable off hoodies alone commit to a
hoodie company no I will be like supreme
if people is to prove Nate wait Oh
we got all kinds of merch dope is know
about all the for sale yeah it will be a
bit alive we need more shirts is that
we're saying merch wise up we are going
to do a t-shirt for you guys
how much scope is how much should we
charge for the t-shirt how much what are
you thinking
how much did Kanye charge for his will
be cheaper than Kanye I promise
50% off guy money people sex is funny
what about it free money a lot of
them are sleeping what a free shipping I
told you 20 man we're really gonna price
our shirts of 20 30 35 I think I think I
think we might be able to do $20 only
you know I you know what it's gonna be
25 but we're gonna put exclusive coupons
right here on our periscope you'll be
able to access it directly from
[Music]
how can you not look at George yeah
all right I mean to feel like that oh I
gotta get the car okay George sit up a
little bit
no I'm telling these guys though they
won't believe some of us if we have plan
for 2018 is back good
I spoke with that I spoke the journalist
this morning about you know why do you
always keep saying Tesla's ahead we
think the hustle is behind right did a
birch article last year at the end last
year and we told the reporter that we
could 50 people in the back of like this
tiny garage yeah and I think we'll wait
average projection we lie to reporters
sometimes they're cool reporters when
it's like how much is this costing me
per hour guys oh okay we have realized
you know like we're not even kidding
wait in there we're here
[Music]
[Music]
What up, Scopies?
We'll be uh we'll be starting soon.
Presentation starts at 2:00 p.m.
Nebraska time. I don't know what time
that is, California time, but it's soon.
I think the minutes are the same. Two
hours different. Yeah, that's Yeah, it's
the same minutes. So, whenever the
minutes go to 00, that's when the
presentation will start. Maybe we'll
give everyone a few minutes. We got a
bit of a crowd here. This is off season
for the college. So, um
yeah,
let's show for products while we got a
minute. Here's a here's a 128 gigabyte
Eon that will be available for sale
right here in Omaha.
We have a box full of KA AI pandas. We
are going to be presenting. What's up,
Vanilla Gorilla?
Uh, and we have a Toyota Giraffe right
here. Midnight Black. Who's talking
about Midnight Black? Where do you hear
about Midnight Black?
All right. We got some We got some
people here. We got some media here.
We're going to be nice to the media.
Yeah, we're going to be nice to the
media
on the tour. Yeah, some of the some of
the cities are fake news.
Am
I going to talk about Slam? No, I'm not
going to talk about Slam. Um, it's a
pretty straightforward overview
presentation. It's going to be similar
to my WebSummit presentation, but with
less Bitcoin Cash wallet. Uh,
no. I'm not going to talk about Bitcoin
Cash. Uh, though, if you guys want to
check out something new, I found it last
night. It's called the Swift Life. It's
the number two app in the app store. It
is a social network which gives you
direct access to Taylor Swift. And you
guys know that I'm a I'm a Taylor Swift
fan. So you guys might want to download
the Swift Life. I'm a level two on the
Swift Life. I'm working on my Taoji
game. You got to get Taojis.
I'm such a shill. These people don't
even pay me, man.
Um, no. No, no, no. There won't really
be unveilings.
Slam anything on mapping.
No, no, no. Nothing new. I mean, you got
to realize that a lot of people who are
coming here uh don't really know that
much about us. So, it's a pretty uh
Yeah, make comma for trains with oversp
speed warning. Seriously. Um no, it's
it's really sad whenever trains crash.
I'm just like, dude, positive train
control has existed for years. Unions
are killing people.
Yeah. I'm excited for the future, too. I
love I love the future. You guys know I
love the future. How many
disengagements? A lot. It's like one,
it's like it's, you know, we're a little
beyond one every 10 miles now. So,
considering we've driven like 2,000
miles, probably around 200. Uh, we can
we can maybe compiled together some
statistics on number of disengagements.
Any insurance stuff? You guys know I'm
not talking about businessmen.
Um, am I missing for hacking? No, not
really. Self-driving cars. I like
winning, you know.
All right. Gonna wait two more minutes,
guys. Two more minutes. I know it's as
bad as the Bachelor when they're like,
"Who's gonna get the rose?" Oh, yeah.
The Bachelor. The Bachelor was the
original. Yeah. Sorry. Bachelorette.
See the video of the pilot port. Oh, you
guys got one off. That's pretty sweet.
Say hi to the Scopies. Hi, Scopies. I
thought you didn't like the way your
voice sounds. I don't rewatch, but when
I'm talking, if I didn't like the way my
voice sound, I would never say your
voice. Your voice sounds great on
Periscope. That's great. No. God,
you want to say hi to Scooby Daddy? No.
No. Eddie doesn't want to say hi to you
guys.
Um,
shame about slam. If you want to talk
about slam sometime, we'll talk about
slam sometime. You know me. No secrets,
bro. No secrets, bros. Five minutes.
Come in. Come into the Come into the
Scopy Lounge. join all these people.
Real life scopies.
I'm good. I'm good. I'm good. I got my I
got my Kab beanie on.
Am I about to give a talk? Yes. How's
the weather? It's a little cold.
Um am I still working on deep learning
SLAM? Sort of. Yeah, kind of. We're
working on unsupervised depth nets. Um
like slam requires memory and deep
learning doesn't really work well with
memory. So there's that. Like people
talk about it, but it's it's there's no
memory, right? Um whereas like slam in a
room is quite different from slam on a
road. Uh any tips for people working on
self-driving cars? Join us or die.
Um that that is going to be one of the
themes of 2018. And the other theme is
going to be outwit, outplay, outlast. I
came up with that myself. Don't think I
ripped that off. No, you'll know I
ripped it off. You'll know. You'll know.
Am I nervous?
I swear to God I ain't nervous. You know
the Lil Wayne. Lil Wayne.
Um
Lil Wayne, man. That guy's a genius.
Uh no, actually I'm really not nervous.
Um hats for sale. No, we don't sell the
hats. And guys, if you think hoodies are
overpriced now, we're going to we're
going to be like Martin Skrey where
we're raising those prices.
All right. We ready to start? Yeah. I'm
gonna do a quick announcement.
Who's Who's holding Who's holding the
scopies?
Thank you everybody for coming. Um,
quick introduction. This is George from
my eye. As most of you know, we have his
team here, Eddie and Vid. Um, and we'd
also like to thank the supply chain
management program at UNL for sponsoring
the refreshments to cookies. Give them a
round of applause.
Hey guys,
and our slogan is no driving for
self.
Self driving is a journey, not a
destination, not a problem. Um, so we're
going to talk about four things that we
built uh along this journey. The first
is shipper.
is an app. It's available in the Google
Play Store and the Apple App Store and
you can download
so you can mount it up on your
windshield while you're driving. It
records
um what's on the camera, what's in the
GPS, what's on your sensors.
And then when you watch the video, you
ask the question, could I drive a car
looking at this footage?
And if the answer is yes, You should be
able to make a machine do the same.
Today
driving is a dance. Some companies
working on self-driving cars think that
they can code in all the rules of
driving. And this isn't really possible
because driving doesn't have a
definition aside from what humans do
when they drive. If you try to build a
definition of driver, you'll
build self-driving cars knows that it's
important to predict what people the
around are going to do. But what a lot
of people don't think about is it is
also important to be predictable because
all the generations of the road all
people are trying to predict as well,
right? People are in quite a similar way
to drive cars as self-driving cars. So
this is footage from our dash cam app.
On the left you see semantic
segmentation. Cars are green, roads are
in the ground.
And over here we have
train.
So,
so we have 2.6 million miles uh in our
train station, meaning we have 2.6
million miles of video of cars driving.
This is a lot more miles than most
people drive in their lifetime. We did a
truck driver in Utah
3.8 million less. So,
really
this is what our machine learning learns
from and you can treat it naively. looks
very much like supervised learning,
right? Over here you have the picture
and over here you have what to do when
you see that picture. If the road looks
like this, you go straight. If the road
looks like this, you turn right. Um,
this wants to do it, but that's
basically the idea.
So, if you're going to build machine
learning models, where are you going?
You're going to run on a computer.
That's a whole problem there. Say you
had a computer that knew exactly where
to make the car go. The computer knows
exactly how much to turn right, exactly
how much to hit the brake. You actually
have to do that. You actually have to
put torque on the steering wheel and run
the brake pump and open the hydraulic
valves
interface to interface computers to
cars.
That's what Panda is. for sale mobile
shop.
Um, yeah. So, this has three CAN buses,
two Kine buses, and one GM. GM has a
very special bus of course.
And that's on the side. This is a OBD2
connector available in every car in
1996.
And on this side, we have a USB port and
Wi-Fi. There's a computer
that cost you're looking for
universal.
Now, the Panda pair is a shipper. So,
when you're driving with our dash cam,
you can connected to your Panda and you
can record all of the
sensors from your car. Think of a modern
car
sensor, individual wheel speed sensor,
steering angle sensor, steering torque
sensor. Um, how hard the doors are open
is locked, whether um
gas
tool. So, after you've recorded your
driver, you can access all of these
sensors in your car. You guys can try
this out at
synchronize with the video. So you can
see over here this is like your car has
accelerometer. So you can see the
accelerometer compared to the video.
So next step of the journey is that we
have a model and we have a interface. We
need a place to run
a computer.
when I was
in my car
whenever computer
for a few reasons.
Phones can't dissipate that much heat.
So, if you have a phone mounted on a
windshield, you dissipate maybe two or
three watts before it starts to
overheat. This has a heat sink in a fan
and can dissipate up to 15 watts. Um,
now if you're generating 15 watts of
heat, you also need 15 watts of power.
How do you get power? So, suppose
phones can either fast charge or
communicate over USB. We've modified
this phone to be able to do both.
Connect it to your Panda with a USB
cable.
And it can charge 5 vol 3 amps as well
as communicate with your car over the
story of the ground is open. Open is
free software freely available on our
at the end of 2016. 2016 we were uh
rolling around the idea of selling
consumer product called one ship in
$1,000 will ship a self-driving car,000
by the end of the year
for free. So that's what we see on the
left, the common which is kind of like
the gen one of the Eon
that purple you see there. Some of that
stuff eventually went into Panda
and we open source our dragon agent. So
be available on GitHub and it's called
Open Pilot.
Open Pilot is like Tesla autopilot for
common cars.
It's pretty much the same thing. We
support select Hondas and Toyotas.
Pretty soon we're going to support six
of the top 10 cars sold in America as
the top three trucks. The next six and a
position 10 is a Nissan Ro.
Now it's cool because it's open source.
So there are support people have
modified to work on the Chevy Volt Model
S.
So we have a little video here.
[Music]
[Music]
You're
Just like
[Music]
[Music]
[Music]
[Music]
point
steering wheel.
But as you can see, the car is the gas
experience.
We stream
our our experience with the system.
There's lots of videos out on YouTube.
Just a lot of iOS is
I have a question. We noticed that the
speed was changing. What made the speed
change? Was he touching the accelerator?
No.
It uses a combination of a radar and a
camera to read the road around and it
always maintains a safe following
distance to the front car. It always
makes sure that even if that car slams
on their brakes, you are capable of
safely and smoothly stopping the D,
which is a lot more than people do.
People tail way too much. So if you
wonder why is so far back
to collision tell people are driving.
So it understands that
well it doesn't do
it.
Thank you. Sure. So yeah, if you think
about the phone market, right?
If you think about the phone market
before 2007,
every phone manufacturer made their own
operating system. Samsung had their
Nokia,
LG had theirs and they were all pretty
terrible.
The world kind of unified around two. So
Tesla launched autopilot and about a
year later we launched autopilot which
mimics iOS
iOS had a bit of attraction at the
beginning was pretty big but people
don't realize like every iPhone sells
more than the iPhone before the iPhone
this huge cultural phenomenon which took
like three or four years and we're going
to see a very similar thing with Apple
uh now iPhones are very expensive and
most people don't have way more people
than us but there's no reason you can't
have good software even if your phone is
not an Apple phone.
If you use any of the stock systems on
these cars like ACC, most of them are
pretty terrible, especially like
users today. Think about this as an icon
of realness.
When you watch self-driving car video,
that's not real. That was crafted by
team. They may let the curtain slip open
a little bit. They talked to one of the
articles about how there's seen in the
video where just out front of the car
was a paid actor,
right? There's no there's no room for
this isn't what driving is. You're never
going to self-driving cars if you think
about it like this. There's only two
systems out there that actually have
videos on YouTube
now.
You can prepare those as well.
Every out there send data back to us and
that machine learning algorithm that I
talked about in the beginning of the
presentation
ingest all that data every time it
learns and hopes to never make that
mistake again
2017.
This is a dash kit. We don't sell this
private car.
We sell this and then we give away
selfriv.
So, um, what makes a car good for
some way to control the gas steering?
Almost every car after 1995 is a gas by
wire meaning your gas pedal is not
physically connected to the engine of
your car. Um maybe we uh leave the
scopes here. You want to leave them for
the presentation?
what up scopies
all right we're gonna give everybody a
little bit of time to get in here five
minutes just like hq trivia
this is scott scotty mcscotterson your
scotzer whatever other stupid names he
has for himself but you know
he does make you miss the guy right you
watch enough hq trivias with scott it's
like some scott holmes stockholm
syndrome
you know welcome welcome to our product
announcement um we're viviane right here
nice guppies your role on team comma
team karma oh oh that's awesome that's a
new thing team kawa right yeah team team
kama you know like the low gang and the
jake paulers come this is comma ces look
at our power look at how much power we
have wow so much power yo you guys you
scopes let me show you something
so we ran out of power in the basement
so we bought some extension cords and we
ran them from up here to down there so
you can maybe we'll go we'll go take a
quick look at them yeah right we have
power that is right and we have power
because we're not beholden
to agencies like see yes right check it
out this is the bundle of extension
cores that's power man
okay um
i think we're gonna switch you to
horizontal
yeah we were tripping breakers all right
we've got a hundred people in here all
right
and viv
you ready to bring it in and eddie eddie
is going to say a few words about the
product i think too
if he wants to
for sure
um so
welcome to our new stock room and you
see some of the stuff is censored with
commas
[Music]
uh that's our internal stock
um here's our presentation monitor
yeah i go straight for the masses right
off my laptop here here's our current
product lineup if you're unfamiliar with
it
we have the uh
right right look at that look at that we
have the panda all the way in front here
this little guy
we have a honda giraffe on the left a
toyota giraffe on the right we have two
eons in the back there one of them you
can't tell but one of them 64 gave one
of those 128 gig
uh
i think i want to
rotate them
landscapify
all right do you wanna stronger maybe
we'll give them another let's go in two
minutes give him two minutes two minutes
come on come on come on um these are our
new laptops that we've been using for
debugging
they're they're predator helios 300s
yeah when you guys order stuff you know
where it comes from now this is the
smallest room yeah yeah
we work hard
this is uh
behind you on boxes
um
oh my god
that is so i'm doing inventory
downstairs and we have like 200 more
downstairs yeah we have to have we
better have more because that's not
enough yeah we've changed them up that's
not enough
um so yeah we have a little uh little
slideshow prepared for you guys uh today
guess what's in this box
brand new
come ai hoodies
super comfortable super comfortable only
two hundred forty nine dollars yeah
that's cheaper than givenchy it's a very
cheap price i think it's the supreme
auto chief supremacist i don't actually
own any supreme merchandise you know you
said you would um
yeah this used to be the headquarters of
crypto scams llc
um but we uh crypto scams llc went out
of business
of all of crypto today is very
legitimate yeah
it's all very legitimate
um
okay
cool one more minute
yeah let's do
one more
yeah let's see we gotta wait till three
before we're just sorry our mistake on
the road trip because we would start too
early we're gonna start twirling and
then we would come through yeah come in
here
um yeah we're putting up we're putting
up some real high quality security in
here yeah so don't mess around don't
mess around with our stock room you see
the censorship but these are our prices
of existing uh stuff from 99 pandas we
have oh we can't show them that one that
one no i know i know we haven't
sleep it's up there oh ooh good secrets
um it's not sensitive
no it's not blurred out in the
post-production
it knows by the way i was watching i
sometimes like watching up to what i'm
doing comma dot ai slash shop i was
doing the slashes this way
yeah commentary
shop
all right it's so embarrassing
all right team comma team comma what's
poppin everybody welcome to the come ai
product announcement you are not at ces
we are not at ces either they wouldn't
pay for my flight and as you know uh you
know as as as as a member of team comma
we like things like flights paid for
so yeah
uh our slogan is ghost driving for the
masses and we have
2.7 million miles in our training set
and that is all thanks to you guys shout
out to karma the best self-driving car
team on the internet better than team
tesla better than team waymo better than
team cruz i don't even think zoops has a
team i think they got all right um yeah
so shout out team congress self-driving
car team on the internet now
you all know about the eon right this is
the eon
the eon is great universal computing
hardware
got two eons right here a whole lot of
eons over there when you buy when they
ship out
uh
so today we're announcing
the midnight black yard
just let me just wipe this
down it really is it really is beautiful
uh so we start with
all black everything and we finish with
all black everything black
anodized heat sink guys how how hot does
that does that look right
midnight black eons
uh the the phone is black the screws are
black we pay attention to detail
they are all black everything maybe
maybe we'll even make a custom exclusive
black theme for midnight no we're not
going that far but but you can buy your
midnight black eon for 829 dollars
um they're all one hundred eight twenty
eight gig
eight hundred twenty nine dollars and
shop.com ai that is already live
um midnight black eons
uh they are really really that you you
you have one of these in your car it's
it's a nice addition to your car
um
midnight black
eon so that's it guys thank you for
joining us for the for the product
announced no i would would i do that to
the scopies for a second i was like oh
that's so quick these poor guys that's
it i mean we're just the midnight blacky
on that's all we're doing too
yeah um
no you guys know about the panda right
pan is the nicest universal car in our
face ever
we shipped out a lot of canvas a lot
we're actually seriously almost out of
pandas you want to show them how many
pants are left
let's see how many pounds i left guys
we started out with 2 000 pandas
um
than two thousand i can get 2200 and
that's that's what's left
uh but
never fear
we're getting a new order of ten
thousand pandas
we're really gonna try to make the panda
a five star experience uh because we
want to eventually be on amazon prime
and to be on amazon prime we really have
to offer a five-star experience this
starts from the software all the way
down to the hardware all the way down to
knowing whether your car is supported or
not before you buy a panda knowing what
you can get access to automatic
fingerprinting uh much is your pairing
process this is all the stuff we need to
provide a five-star panda experience
and one of the things that we're doing
that we're announcing today is the brand
new injection molded panda case
check it out
so it's actually slightly smaller i
didn't even know this was possible but
you know we got we got great people
working for us
putting pandas in injection molded
cases these things look real nice
getting 10 000 of these they're gonna
come in a really cute little box um so
if you buy a panda from here on out
you're getting a panda in an injection
molded case
so uh yeah guys thank you oh come on we
got a real product announcement today
right right we're just we're changing
the case we're changing the color
these are the same these are exciting
yes um but you know we got we got one
more thing we always got we always got
one more thing guys
oh
yeah one more one more thing how many
skulls again i'm 61.
161. oh people love product
announcements
should we
yo eddie
yo eddie
eddie
161 sculpey's want to see you
what are we talking about you know what
we're talking about we haven't we
haven't announced it yet but uh to have
a seat maybe maybe you can you can pull
it out from behind you guys remember
eddie from the road
oh it comes trips that'd be kind of nice
all right guys good job just hanging
out
involved
yeah
one more thing yeah um
you can you can pull them out this time
they're right there they're right
so
[Music]
we got uh
red lights and stop signs
um
so you know team comma you're all on
with team comma
we are probably unless tesla comes out
of nowhere gonna ship the first
after-market system capable of doing red
lights and stop signs
um now
as you know
we've talked about needing one more
piece of hardware to do it
it's not a very big piece of hardware
it's definitely capable on a neon
it's been referred to as the pigeon yeah
although that that's that's that's not
the final name
team combo killer
team team combat team comma shout out
team
uh yeah red lights and stop signs will
be made possible with
the grey
this is a great panda um the case is
still a bit of a faces in progress uh
but uh it's still early prototype the
cases will look good but but yeah it's
gray
it's a panda but uh we got rid of wi-fi
and replaced it with a high precision
gps
that's this uh sma connector you see
here here's what it looks like on the
inside so we're using a u-blox module
george posted a tweeted a pic of that
um
yeah so that little antenna connector
sticks out and then you screw in your
external antenna we have a nice mount
for this that'll stick to your
windshield so get a good reception
from gps's
or you can put it on your roof your
choice yeah
yeah
that's pretty much it so this would be
compatible with with eons ship applause
so basically if you have a giraffe you
know you never go great
they're real great they have a great
panda so you'll just you'll just you
just plug in your
your gray panda instead of your white
panda yeah just screw this guy in here
and so when when you connected your
panda to your eon uh wi-fi shuts off
already
um
since you have a usb connection so we're
getting any talk about the difference
between grey panda and panda people are
asking sure so yeah we got so like i was
saying when you plug in your panda into
your eon the wi-fi mod will get shut off
because we have a usb connection
so you weren't using that module at all
so we replaced it with a gps module
that's a big difference one has gps one
as well
so this is what the whole system is
gonna look like
so you just you just got your gray panda
here instead of a white panda
um and it adds this gps now open pilot
is still going to totally work with
white pandas yeah um
or ways it's all going to work with
white pandas but if you really want that
super high precision you know the kind
of precision we need for red lights and
stop signs you're going to want a great
panda yeah we need that external
gps to get a better reception drop-in
replacement how much are they going for
well we'll get there
these these uh
the gps in here is so good um so i'll
explain why
uh the gps and the phone
is this one the main thing actually has
more to do with the antenna than the
module itself so these are really nice
antennas uh
it was in radio knows your antenna makes
a huge difference you know
and you mount them in such a way
that it's
this is like parallel to the ground
so you're not gonna get uh multi-path
off of the ground
what we can also do with this module
that we can't do with the other one
is carrier phase and doppler shifts
by getting doppler shifts so you guys
know the effect like you hear an
ambulance siren and it's like high
pitched when it comes and low pitched
when it goes
you can use that same effect with
satellites to determine your speed super
precisely
so that's something that the grey panda
uh will enable additional carrier phase
our target for the end of the year
combining our open source hd maps
grey pandas and an eon so just with what
you see here
we'll have you localized with 10
centimeters of accuracy
we'll know where you are within 10
centimeters anywhere in the world and
we'll be able to use this to improve the
driving experience and obviously do stop
signs and red lights so how do you get a
gray panda yeah high precision gps plus
all wired panda function so you have
like it has the same three cam buses two
lane buses gm land yeah everything else
is the same everything else
how do you get one
for sale right now
i'll shop back out without ai right now
shop.com dot ai maybe we'll just do that
not coming out shop just shop comments
shop you work that works no more it's
just for one person but we're not gonna
do it one person we should do it we
should change we should slash slash
all right so
shout out to the it's easy
but comment down all right all right
we're trying to come up with a jingle no
no like logan pauses
i know gorilla said it's not live yet
it is live it is live oh no no shop.com
no comment that i slash shop is not live
but the gray panda is live you can do a
great you can do a drop down uh right on
the panda um for 199 dollars you can get
yourself a great panda um shipping in
four to 12 weeks
you know you still have a few uh just a
few things to work out there's a few
things to work out
but they do work always they do work um
or
the gray panda giveaway
if you're one of the top five eon users
in january by miles oh sorry by minutes
uh we don't care if you're using shifter
plus or open pilot by minutes where
you're moving no cheating minutes
um the top ibn users will be mailed free
of charge a great panda prototype that
will let us gather statistics on how
well these things are working in the
field to make sure all the paying
customers get the highest quality
they'll kind of be
great pandas and we'll eventually ship
the rev c
gray panda so
yeah okay um the reason it's not the
pigeon the reason we didn't name it the
pigeon the pigeons the code name is
because some people are going to be like
oh i need a panda and a pigeon no you
just need a gray panda or a white panda
open pilot will continue to work with
white pandas and if you have shifter
shipper only works with white hands
schiffer does not work with grey pandas
vanilla gorilla order place is amazing
what if you have an open order for white
panda belong gray
guys if we haven't fulfilled it yet yeah
just send an email to support.com.ai
with your order number and then um we'll
go ahead and do the exchange um if you
don't know though you probably want a
white panda unless you're sure you want
a grey panda and does it come with the
antenna someone does come with the
attack absolutely
antenna included
um that's kind of why the price is so
high yeah i'm not sure it's going to be
this antenna but full disclosure these
antennas cost us like 45 bucks um and
it's gonna be in some kind of mounting
solution that sticks to the windshield
do moderators get one
top five top five top five end users why
would you want a white panda over a gray
one um because it is wi-fi and because
cheaper yeah
um white pandas are kind of gonna be
that the main stream of pandas if you
want to live on the edge
great maverick panda will it come
supporting
red stop signs and red lights
probably not
uh
but we it will support a better
localization experience by the time we
ship what about neo users
no i could buy a neon
uh great grey pandas are not not
supported on else
you guys are the future guys
are the future yes and now it is time
for questions and if anyone from the
press is out there watching uh you can
email me for a quick phone call to get
any questions answered except for banned
questions you'll know the banned
questions
don't ask me when your fiat's going to
be supported and definitely don't ask me
when your subaru's going to be supported
yeah
because location is so accurate do you
need to make sure your antenna is
centered on the car
um
so
[Music]
no uh
the last bit of precision is done by the
camera
so you need to make sure your eon camera
is centered on the car but your antenna
centered is probably better but i
wouldn't worry about that
um what does better localization mean to
the user right now
right now uh really just anyways
right now it's better ways
um but
yeah waze will be off sometimes right
because your phone gps
gets crappy if we can reinject this gps
signal into waves if you relocate there
order a grey panda now by the time it
arrives it should improve your driving
experience so the other thing that we
can do we found a problem during the
road trip with wind
like the wind would blow the car
um and it would take a long time for our
thing to learn that the wind was blowing
the car are humans realize this right
away
because humans have a very good
localization system
how do you know the wind's blowing your
car oh i feel it pushing my car look my
car's going this way you know to correct
the system that's doing this right now
is fairly weak
um we're gonna start tying the localizer
in with that system so if you have a
great panda um your like steering angle
offset learning will be improved
by the time
gray panda shit
for 12 weeks
you only accept usd folks sorry no
cryptocurrency no cryptocurrency
when these end up being pushed in car
infotainment system
no it just runs on your eon uh you
wouldn't want it to be pushed to your
car infotainment system because those
things suck oh will the dimensions be
very similar to the white panda they're
identical yeah it's the exact same
except for the antennas taking out why
do red lights require gps
um so the hard thing about red lights
isn't detecting whether they're red or
green right
we get we get emails from people or
slackmasters and people who are like
look man this kid built a red light
detector in five minutes look how come
you can't ship this well the hard part
about red lights isn't detecting the
light it's knowing where to stop
it's knowing given this light where
exactly do i need to stop the car and
that's what requires high precision
localization
also knowing does this light apply to me
right it's really easy to detect humans
mess this up too
um those weird corner intersections yeah
diagonal streams really easy to detect
is there a stop sign in the image really
hard to detect okay given that that stop
sign is there where should i stop
you know some cities will have a stop
sign on the other side pointing towards
you have you seen that yeah it's weird i
think it's in denver
um like that would be confusing
so oh and how are we gonna get this data
you're gonna be able to enter from your
own red lights and stop signs i think i
think that's what we're doing like
common coloring style but yeah live
common calling style but live on the map
you'll be able to edit your route and be
like here's a red light here's a stop
sign uh let's just let's just show the
scope because the midnight blackie on a
bit more
have you announced that we did we did
yeah that was that was the earlier yeah
it's got the black people it's between
like what's the real difference between
a midnight black and then the regular
and a 128 gig
it's midnight black
sick is black it's prettier but it does
only come in 128 gig it does yeah this
is this is this is the premium yeah and
the the side of the
oneplus is black yeah
no more gunmetal yeah no more gunmetal
yeah yeah come on
oh man now you know why you get midnight
yeah now you know folks but you still
get a white cable
should we get some black cables
yeah are they back in stock yeah i think
they're back okay if they're back and
forth midnight black eons will include
black cables yeah
um
these are these will ship out in a week
should ship all the units next week
right yeah yeah yeah
we'll ship all next week next wednesday
we ship something this wednesday
uh
pandas are
a little bit delayed they shouldn't be
delayed too much oh yeah did you show
the injection i did yeah
um but yeah
what time is it
what time is it it's uh it's 3 18.
139.
priority shipping for midnight black
we should be on no swag no no swag but
we'll show you this tag that we already
have all the
comments more hoodies
yeah
yeah we thought we found the music it's
good um the hoodie apocalypse
i don't know some people accuse me of
hoarding hoodies in my room you've
hoarded
very many of the older ones you've
hoarded quite a few whoa
it shows the slides like on the house
[Music]
what do you mean oh my god can i show
them yeah you guys look good there's the
red light stuff
you can just like damn
it
oh come on that's so cool all right
let's uh let me take the skulls back
action molded protection molded paneling
yeah
cool i got a slightly different uh
profile but
you guys will be happy with these
all right all right everybody that is
the periscope thank you for joining us
for a product announcement today quick
recap
we got the midnight black eon
midnight black
and we have the
i i spelt it with an a
is that controversial yeah
why
how does sasha gray spell her name with
any
but the grey album the grey albums with
an e the color
the color but what about a
grey
you know one of those smooshed aes what
are those nice let's do that
whoa whoa i think that uh
shopify doesn't support that um so yeah
here's a gray panda right here plugged
into a honda giraffe you can see that
gps antenna
uh on the other side there sasha is an e
uh midnight is usually dark blue it's
gray in the u.s with an a thank you alex
yeah yeah i'm not do i look british to
you
grey eagle all right thank you for
joining us
uh
yeah bye-bye
comment team out team karma team come
we're gonna do we're gonna make a thing
it should be
schedule an appointment with your doctor
and there's a Clark doing that as part
of the scheduling you also a car is
going to be sick that's kind of like a
high level application that we'll be
able to use they the underlying
transportation plan but that's also from
a hacker perspective and I can add you
to that and trigger a bad team commander
so basically the duh the end result of
our solutions is we call that incidence
of the cybersecurity incidence probably
would be a little hard to read but you
can see this is one example our product
is used by something another trend ugly
scene Ottawa which is
the building of a security operation
center which is where the surface of
being monitor is being tracked after
violation in this specific instance we
see a stop engine command that was sent
to the fleet at a bad time at that time
could be like as the people is driving
you're not supposed to about an etic
kill engine for me that's actually a
feature in some of the telematics
providers have but it's only enabled in
places like South America but in the
u.s. it's not illegal to use that to use
that specific feature so they disable it
in to cover but what the hacker gets in
and even if they weren't supposed to do
that something
that we're looking to find together the
key idea is to find it you know not
after it already took place but like
after the horses that were born that
meant some ladies trying to play with a
lot and we give like it's like an early
detection facility where the Oleum tent
work for those lead operators so Mike my
last slide pretty much this having said
all that security and I think anybody
that's that's been into space there's no
you know one solution that is assault
everything it's like there's there's a
concept called defense in depth and this
in this area we look at lead vehicle
security is something that will find
this way makes me to be equals over time
definitely not today there's I don't
think there's
Tesla they haven't publicized whether
they have it they have liked it some
elements of a people components but I
don't think there's there's many others
that have implemented that inside their
cars it will be a part of the overall
solution over time but we see the place
that most aliens are starting is
disliked about base where you can
actually have a level of detection which
is what it's actually prescribed work
for the automakers you can happen today
if you have a basement data that you're
already collecting and this is the only
way to actually offer protection across
the fleet and not only individual
vehicles would we see both of these
solutions working together and
ultimately be consumed by when you see
here in the sock which i think is you
know the acceleration of the stocks
being built product but it was we dived
across the world
I think us may be ahead of the curve by
affecting
like a huge other thing for them yes
again preciate all of your information
is there's a lot to go through here we
don't have a lot of time but let's just
talk real quick so couple things your
company finds things happening in dis
numbers misbehavior
solution for everyone out there how what
is the role of it I mean is it a
subscriber only it's everyone
so we sell to two types of constituents
one is OEMs we some of them directly and
we sell to OEM a OMB does not benefit
and if they're not our custom because
it's away of the data and we will
predict their vehicles based and the
other constituent that we have is
complete it's not only isolates like
enterprises that have connected people
police trucks or our companies that's
very similar but a slightly different
organization but it's basically they
they share the same problem because if
you know I was during lunch I was
telling this example imagine something
like the FedEx late day before Christmas
somebody accidentally nope no driver can
turn on the FedEx what I was thinking
this all the presses were coming to me
there but what are they herded - OH -
whoa
yeah but what about you know again this
whole conversation we've been having
about you know how important it is and
again I understand collaborates from the
CRC and everyone said this is but a
certain extent as we're talking about
our learnings on the autonomous cars on
parts of that works and don't work or
processes or algorithms on the other end
on the cybersecurity you know that all
of a sudden you realize oh my gosh this
product or or double or om you're going
after or they're going after the breaks
north of the steering you know that type
of thing is that become a shared economy
to work where does that what's the
balance between you being an independent
company and you know that's you helping
out so we share with the community in
the community shares with us and there's
been you know I think just last week we
were at Auto eyes that which is a data
sharing environment or both
for vendors to share share finding
spirit we're part of that having said
that I think with anybody even you know
we can find things it's not to say that
you look let's say we're serving okay if
he does not have capabilities to do
something with things that we found we
can share it and they might know about
know and they might not be able to do
anything about it and if you have I mean
we're not number of poems or tabs or in
the danger zone
we've published privately nada nada the
public I can tell you that you know be
from this base the I wouldn't say like
the best like the nation's some some of
the components not the best title
security practices have used and was
rated so things that we know in the IT
side do not so true
and here's you still see it like so it's
so happy we know it didn't happen for
well people I'm talking about how the
the components were created so things
like no encryption on the data transfer
using UDP binary like kind of like basic
stuff are still there because you
haven't you have trucks that have you
know somebody put a dongle into five
years ago I thought about cider
latest and we got around after you still
seeing people be lazy or not being this
exciting I think there's way more on
understanding today things are
definitely improving but you still have
coding cars and that is very old but
final question on the test that you
brought them up and of course one of the
things with someone unique and then a
single box architecture
it says the way the future is that
prettily
a confident way to avoid this type of
thing I think Tesla are I said GM is
ahead of the curve I think Tesla are the
most ahead of the curve they have they
are red team which is kind of like the
way that they tried to attack himself
bigger than anybody else's in the space
they the poverty since it's like 2011
nobody you would've read to us probably
some of the aliens back then so they are
that's one of their approaches they're
using you know another thing that was
announces like how they use bounties
which is like you pay actors or quite
has to try to attack you and find
vulnerabilities which is some very
common practice in the enterprise side
they are one of the leaders produc know
and I think that those types of things
are what helps them become more mature
in terms of security but I think their
code is there a software company at
heart yeah
damn of course we're out of time I
really pleased and to introduce our next
speaker please welcome Anton to the
stage in time it's an important river
with wise he does something out there in
the media world what we won't tell me
what it is but I know I'm gonna stone in
front of sliders already next feature of
course me to introduction to rich folks
he was here two years ago as our
involvement I think he showed one of the
earlier versions of this product which
much much better level to driving
experience you obviously want to hear
where the project that's gone and for
instance now and what the strategies
going forward another thing that
happened in October of 2016 was
something closely related
my entry
system at a press conference right here
in town and sort of read you the very
first sentence that Elin law said at the
press conference and that be the
background to what we might expect from
upgrades in the future any senator basic
news here is that all cars exiting the
factory have hardware necessary for
levels by autonomy so that's in terms of
cameras compute power it's an entry car
we made on the order two thousand where
so we can are shipping at home with
level five literally meaning hardware
capable of full self-driving for
driverless capability so we've almost
would love to hear if a product
aftermarket product that someone maybe
just George's Lord somebody else could
develop would possibly deliver on a
level five litter the promise that he
lost beta two years ago
[Applause]
[Music]
[Music]
research but yeah
Shifa wanna stop actually should stop we
should pick stuff in the space big balls
that open-source RHD maps that make
mapping companies cry a little release
HD maps are everywhere in the United
States but the NBN and they drop a
little for the year so these are
entirely active users so we have we have
the second largest connected meet so
we're getting that video take a cam data
and we're actually you know
[Music]
if your car does make a mistake you can
but this is what it looks like when
you're inside the car you can see even
in this residential Road if you take
that curve quite nicely we also have
tried Margaret I have to be refreshed by
the way Google Translate lookup
self-driving cars in fact the top peak
self-driving cars was the organic so you
don't think about that you're like
really dark and potentially we don't
make sure they pay attention we ship
drug monitoring not just a new product
but retroactive leave our products then
we trade small models that we can
actually share with our devices can a
normal scale to level 4 but
unfortunately not really that's why
research to solve this problem the green
is the map the blue and the yellow are
the lanes and then we just have cars
weapons but this little problem with
this approach our latent cars are fakes
there's no such actual there's no
physics based definition of a lane of
the car the only temperatures we have
planes and cars are like human based
definitions and the problem with those
are hard to ground
CCO the bathroom on this slide is
automatically generated none of this
ground truth is done by and labeling us
like a seventy five point seven billion
miles of data we get a note back we
automatically grab it and we training
behavioral models up drive well ideally
we drink mechanical model of driving
that's your really good
or we cheat a little bit down to avoid
your opponent by using weights on the
legs apart eventually motivation that's
what we're working on income research
three open source HD max you see here
this is just about San Francisco where
we have sufficient coverage to generate
the mass and this is what it looks like
you can see these restrooms this green
clover this green prostitutes here and
each one of those is a picture that we
got back from our video world local logs
and all these pictures so that happened
in accuracy and with tons of pictures
localized to half a meter accuracy you
can post process that character HD maps
but at ten centimeters of accuracy you
say okay how's this different of HD not
a company that's out there every
generation you have a company that's out
there has to pay money to get parts
they're completely lost stem money
record for that tribute car we had the
argument we can pay people pay to the
world we're gonna get the mouse away for
free we have to rent the post processing
software anyway to do they are mattad
random true thing so yeah here are
complicated the advanced commands come
enter into a business development
this is last year's model sell sell
track markets we sell software many
believer in people
when you're in the business is so
expensive to be the premium meal that's
just how much we're cutting prices here
it coming on when people are like eighty
on gold that's so futuristic that can't
be available anytime soon no no it's
available right away in fact we will
have a mobile shop set up outside we
must become $4.99 and my gaming goals
they'll bake yourself right now you can
put them in a Honda and open source
software yeah
for supercruise nothing looks like once
in your car and maybe they're talking
for the question
[Music]
[Music]
GNN research alex net all into object
classification before that right this is
like you're trying to move flour from
here here and all the spheres aren't if
you make the right decisions you budget
your speed to do it right sometimes
yellow is boiled in this if you were so
in San Francisco
in this area meaning the tire
engineering standpoint is when you're on
a slippery surface in your cornering and
you know things are starting to happen
the vehicle that you know again most of
us but should be react in a certain way
how does something like this know we
don't do anything with that and we will
disengage in fact if your car activates
traction control system we don't
I'll stop in the car all that stuff is
still manufacturer and who detect that
TCS engaged we get a microphone with
Jorge what happens this will stick to
this dashcam in a dump car or on this
mouth supported can useful engine
so we also have over there the mobile
star we have great pianist great and
there's our client decision GPS but none
of the mapping stuff relies on the other
stuff in the car that's all done with
just stuff built into the ER and stock
builder to be right and also far forward
collision warning that our driver
monitor don't depend on the car so you
still get those features in every part
other questions out there later parts
from understood right here the one
[Music]
[Music]
so right now we're using the camera and
the radar I think that graters interplay
of diminishing role over time I think
you can do it almost all cameras because
that's a and people are the only example
of our tracking system existence so I
think they don't really need radar again
in the less sensors you can use clusters
to fail I think maps are a great check
maps you can do you can do functional
safety and that's the ways you can turn
functional safety and say education
system so mask you know you can say that
if you're on the stretch of highway
never allowed to be able to do this so
it can you time here for your product in
just our car the most recent speakers
are two before that that have to do with
like again cybersecurity Cisco I think
most of the cybersecurity industry and
systemic I used to work in this industry
right oh you have my book we have safety
and security the same thing they're not
and let me tell you why
safety is protecting from a random
attack security is protecting from a
targeted attack security is in
[Music]
after-market
entry into a vehicle system would seem
like if there was a possibility that I
couldn't open a door - right like what
would the trick poverty in this case
once again if I somehow got through to
your product and I could have your cars
just stopped up a road or get away or
not
so these Safety's not them on this
device is all of our Mis devices that
this device will detect if you press
home and guess that'll work right now
and it will prevent that twice we
sending any signals to the car but the
safety is not here pretty compromised
this device
here it's probably not again if you
can't build secure code you just have to
raise the attacker bar at a point that
it's not worth it for them the automatic
system at that point but um regardless
like there just aren't these evil
malicious people out there this is why
the whole cybersecurity industry is kind
of
[Applause]
[Laughter]
we're doing a periscope right now we're
gonna show up
showed everything so this is a neon gold
people you can see their beautiful
devices yeah we got a cooling fan
solution look at this grill alright
look at the improvement look at the
improvement here you remember how it
used to have those terrible screws on
the top it looked a little janky look
this ankle fits in check out this
beautiful gold the thermal is a bit
better on this than the EON - I think if
you buy any own gold you'll be quite
happy
there's the accessory bag that comes
with it we got two lengths a USB cable
we got a sim tool we got to go for a
mount with the VHP yeah Charlie's good
charging is great well that's why we
don't ship the extension cable we
shipped six book so therefore 99 no
one's bought anything yeah I think it
kind of reminds us of the self-driving
car but plenty of already ordered if you
haven't bought one of these will ship
this out to you like Thursday maybe
we'll even ship it out tomorrow
we couldn't ship it out tomorrow we
can't rip it up tomorrow thing I'm not
gonna make any promises
yeah we need from a civil ship before
Thursday yeah that's the promise I will
make yeah they're great they're really
nice and you know we were really looking
for growth yeah that's why they we
dropped this price so crazy low
yes we love girl fell over engineering
it's easier now than ever um so we have
a great we have a great community on
slack who've created tutorials and
YouTube videos and if you can like you
take a Saturday you won't have it you'll
have it ready to go honestly if you know
what you're doing it's a five minute
install but to really like read
everything you'll need to get the speed
it's not even 4:00 it's a weekend
morning you'll be out cruising you can
see through good stuff you can't just
sell anything it's all right when you do
the hard work we we make hardware for
less money than we sell it for and then
we make a profit I know this is a crazy
business model in Silicon Valley today
yeah but this is what we do these a lot
of these companies here I don't really
understand like they hired this thing
called business development
yes we don't do that we just like we
make product and then we posted on the
website at more price than it cost us to
make product and then we bake and we
want to sell more products so yeah yeah
yeah it's not fans of that was it's a
two-year company of a small company with
like 10 ish people and that's exactly
what comment is now and it was just I
never disagreed with what Ilan said I
knew that like you know obviously what I
had in the garage wasn't ready to go to
market and this honestly it's still a
developer is it is it a consumer product
will be there will be there he's a plan
the plan is obvious but everything takes
time and he wants us to hear so
realistically the timeline is that for
four years so Ilan is right it's nice to
know that Ilan is not just wrong about
his timelines he's wrong about other
people's time I do but hey he's an
optimist works it works and it motivates
you right like did I think it was two
hours
again those really really showing off
and get in your orders right now before
we sell out there's only a limited
number is only a limited number of
beyond golds in the world calling
limited number of lay eCos in the world
so we bought the ball we literally
bought them all and show them look it
comes with a little bag and a big bag
get on right now oh the bucket shop it's
at oh man no no no we're really like
this is a box yeah this is a nice good
beer yeah you get one of these you're
like I feel good yeah
George are we being open about the phone
that it runs through yeah Lee you can
buy one of those and try to use it
yeah actually gold yeah the phone is
gold
yeah or take a look and if you can't see
the gold you can call it it is 64
correct short size 64 yes hopefully
someone got all this information right
on the website I think so this product
doesn't come without the market this
product comes at the dashcam if you want
to install all the pilot you have to do
that yourself
yeah for legal from a legal perspective
we don't sell any hardware that old your
car we just sell general
Elster
of course intact in fact it goes even
beyond that we have driver model so this
camera will actually watch you while you
drive to make sure yes and if you're
engaged and your eyes are off the road
bbbbbb y de new ver have that in fact we
didn't have it before
uber either with the uber and Tesla
crashes that happened this year that
we're like okay we gotta get serious and
within six weeks we turned around driver
Bob berry and it's it's hitting a par
with jams it's industry
Jean used supergroups not only when they
assistant engage I'm super cruise GM's
good level to chickpeas linked on the
website are only our galaxy to see it
$5.00 Adam oh yeah so we have Kronberg
we have gorgeous cards we know you can
you can body you can buy a t-shirt for
$20
[Music]
yo yo good morning
good morning periscope hello periscope
good morning
wait for a few people to get in here
I'll show you what we're working with
today um so you're welcome my name is
George if this is your first time
joining us we are common AI and like I
said two years ago we're gonna win
self-driving cars so let's flip you guys
around here thank you thank you it is it
is a lovely hoodie it's it's similarly
priced to Kanye West's t-shirt all night
I know I slept a little bit I was on I I
conferenced into Paris autonomy this
morning I was actually supposed to be in
France right now but due to some
manufacturing issues with our products I
stayed here but they've all been sorted
out we are good to go and that's why we
went ahead with the launch today so
let's flip you guys around and let's
take a look
so on the left here this is the common
AI shop down on the right here is the
new common a I website and that's our
slogan ghost riding for the masses do we
have it patented
we don't have Pat xergiok we ship
products they're high quality well we
try our best to make them high quality
like our website all right thank you
thank you you know patents I I saw like
a infographic comparing like the
autonomous race to who has the most
patents who cares who is the best
self-driving car right now if you want
to buy one I'd say it's Tesla if you
want to steal one into its way no don't
steal away no card and encourage you to
steal away no car but you another coding
Paris ago maybe ghost riding for the
masses joining our expensive network of
drivers and improve your car experience
today so this is our product lineup this
here is the e on dash cam dev kit yeah
it's pretty nice that's kind of what it
looks like from the back this is ring
shiver Plus which is an upgraded version
of our dash cam software which runs on
iOS and Android you can get them right
now thank you I'm - conduct get chronic
page it will run Spotify ways and chip
applause
giving you basically everything you need
on a dashboard what's the major
difference with neo few things we
integrated the fan solution built in it
just has one mini USB port this is a
much better cooling solution it can
charge much faster it can draw much
higher power yeah and it looks a lot
better it doesn't replace your rear-view
mirror anymore you know we're a big fan
of keeping regulators happy so is there
a rearview mirror mount attachment I
mean right now what we ship is a GoPro
mount attached
which you can put on your on your
windshield assuming that's legal in your
state you'll also be able to switch it
so it's actually symmetrical from the
top and bottom but you'll be able to
switch it and put that mount on the
bottom and actually stick it on your
dashboard as well so you'll be able to
go over ways with it as far as rearview
mirrors go like if you build one that's
that's that's you but no we won't be
shipping without everything their
replacement so yeah this is the shop we
have you know dash cam dev kit we also
have the Panda obd2 dongle um
unlike a lot of hardware startups you
know a lot of hardware startups are like
okay we're gonna price the thing as high
as we can and then we're gonna lower the
price over time we're gonna price it as
low as we can and we're gonna raise the
price over time we want to reward early
adopters so pandas have gone up a little
there now $99 but there's still a great
deal you know a lot of the software that
was just promised when we first launched
the Panda like elm327 and J 2534 are now
live or almost close to live the
software is a lot more stable so far is
open sourced by the way this is the
panel firmware got a few giraffes I'll
go get the to the 128 gigs I'll figure
out a fair way to do it here's our
giraffe line out on the left that's a
Toyota giraffe on the right it's a Honda
giraffe Mohandas giraffes are going into
production you can see that they're
nicely filled a little bit with epoxy
yeah I know I know hundred of these
cases downstairs they look pretty good
to try to ship that soon the Toyota
giraffes take a little bit longer which
shouldn't be too long you see the purple
board is in there so it's still a nosh
park board purple eyes for the prototype
but we have these Boyd's we have any 200
these Boyd's on order in green so
they'll be plenty of giraffes to go
around we can spin up production
so fast we have an army of 3d printers
now I've been showing that off on
Twitter I love our army there's another
Rhian over there and here's a little
pyramid the pyramid had kind of seen
better days here's a here's a neon
without out with that amount it's really
easy to just undo those four screws and
pull that out they're interchangeable
different different mounting angles are
supported so depending on like how steep
your windshield is we're going to
include what I believe - the one on and
then the replacement one you'll just be
able to take that off with a uh with a
hex screwdriver
figure it out we'll see everybody we
have videos actually these are all these
are all one plug boxes here I'm so we do
have we do have quite a few one pluses
there's a lot more in the basement so
you know
now we've shipped out 1300 pandas and
1300 if something is a lot of something
not as many as grains of rice and as a
Mitch Hedberg Joe but it's like rice is
really good when you want to see here's
that
down here we were just using this
possess the Aeons um so yeah if I plug
in I plug in this USB cable here so I
 that USB cable connects over here
to the Panda
I'm we're gonna include a short USB
cable on a long USB cable there's a
Honda giraffe there's play think Honda
simulator right there so I can just like
turn this on it will go to dash cam mode
I'm gonna put this UI a little bit
type-c know it's me be um the original
prototypes head of it had a C connector
here but uh we switched it to mini B
because it's a really a more reliable
connector like you know you want you
want to be able to like put a bit of
force on me as well make sure it's not
gonna break we had we had some issues
with the secant if there's also much
self driving so no so the UM we don't
ship any self driving Harbor due to
regulatory reasons we ship we just ship
open pilot and you can install open
pilot on your on your support hardware
but no this is visited dash cam that run
ship the plus working our way up working
our way back to selling a self driving
kit but the regulator's approval we love
regulators before making regulators
happy
yeah there's a bunch of us what's the
benefit of chevre Plaza worship a few
things I mean the easiest one the most
practical benefit is the fact that you
don't have to like hug the phone on your
dashboard this just stays up there Auto
Start Auto stop
you also get much higher quality the the
camera runs I believe right now it's 20
FPS but I believe we're gonna get that
up to 60 super high quality videos that
you know well beyond what you can get
from a phone because we can we have a
lot of we have a lot of thermal budget
and a lot of power budget we don't know
interruptions are going to happen this
is another thing you're not gonna get
any interruptions also you get much
improved localization so if you upload
to the comic cloud and all these things
are in the shared comic cloud so you'll
be able to log in with new shipper
account on iOS
all your shifter plus routes your open
pilot routes your iOS routes our and
routes like they all came from the same
place but you get a much improved
localization so if you look on Scheffer
and you see like when you drive around a
city you know you get like the phone gps
like this i'm with this mounted in a car
we can run much better location recovery
stuff
the other big thing about shiver plus is
hopefully at launch even we're gonna
roll out forward collision warning in
here so if you're about to crash into
something in front of you this will give
you an alert we can start looking into
lane departure warning path departure
warning and these will all be software
upgrades that'll just come out on your
device you didn't have to think about it
OTA is Kiyo's making fun of GM this
morning for not having OTA then someone
was claiming GM does i don't know i
haven't seen it I know tested us Tesla
the iOS we want to be the Android when
to the sweet hoodie ship is for day
because I think we can get the hoodies
fashion that I'm they really are super
nice hoodies the cava is embroidered
like important it's like a sewing
machine we really want to just get the
nicest hoodie and price it at an absurd
price but they are nice they come in the
medium/large size medium/large so let's
see what else do you guys want to see
I can show off the new ship perhaps you
need a dedicated sim that's up to you um
we're gonna make it work over with the
sim or with Wi-Fi and you'll be able to
sync it just like the shipper app it's
gonna have the same toggle that you have
in the chauffeur app that same upload
over cellular toggle any thoughts on
dual camera phone deployments they're
not that useful
now the bokeh effect is only useful at
really short distances so yeah these are
our our development phones here
I got a high phone a and galaxy s Sh so
you guys have all seen this is just
Scheffer will it run open pilot No so
the eon runs schiffer plus at least when
we when we ship it though they are you
know very hackable so if you decide to
run something else on it that's up to
you
we don't ship any stuff running up about
open palette is open-source software
forward collision warning eventually
coming to regular shipper eventually
eventually so it'll come to shiver plus
long before it'll come to shiver show
the battalion of Zorro axis yeah we can
we can take walk let's take a little
walk you want to go I want to go I want
to go visit our printers go visit our
printers remote start from phone that's
pretty cool websites new products next
step well ship these products and
deliver a great experience you can check
out our pack
pretty cool
here's our army apprentice they're not
Frankie's early it's very early here
these critters are broken the place we
bought becoming something you got to fix
them tonight
thoughts on GM's effort let me tell you
it was level 5 at Hertz I believe Google
and Tesla may even cruise Navy crews may
be cursed I wouldn't say GM kind of boat
you know as much as I make fun of the
guy
pruners look at the printer as I love
printers here's our data center all the
data center got moved around a little
bit
what's the price
yawns are 699 and hoodies are 129 oh man
look at all those cooler went bad Oh oh
poor GPU sleep one but we have GPU
slaves five of six now we're expanding
our GPU army oh good it looks like we're
training something that's good thank you
see what we got back here testing out
this panda that's pretty nice it's
pretty nice
Honda giraffe case is all here Honda
giraffes are ready to go yeah cooling is
much better than the
sup guys I'm excited I'm gonna go for
some breakfast I'm really excited about
breakfast when was the race and he's
doing pretty well he's doing great
uh uh we're super happy with the new
Schafer app we also hired designer
Andrew so that whole team is a handy and
Andrew phenomenal work you know really
great job on though on the website in
the shop good morning that's my desk
because my desk is my passion and I
should have anything up on the screen my
desk
I'm cranky right it's alright I'll give
him a bonus today he's actually Hawaii
he's my wife what he gets back with
Philip said comma dot ai if you want to
go to the shop it's just shop calm about
AI their slack here's an empty screen no
I can't have a guy us 11 so will feed on
partnering or even really competing as
much as we trash talk we're big on
building so we're gonna build the
hardware that you need to make your
Honda's in Toyotas great volt board
compatible I don't I don't have a whole
board know much about the Volt
but maybe uh yeah if the vault board has
USB yeah should work what do i pitch to
investors what do I need investors for
buy my products let's get rich let's be
profitable
we love you LAN now have you guys
look at that
shiver pluses running on your phone let
me know if you like it um yeah the the
VAR b ard is cool guessing this poster
this is why we don't build cars all that
pitch to the investors well it went well
and then I was like me we don't get more
money maybe we should just sell our
products and see how they sell
yeah our products sell well we won't
need more money if our products sell
okay we'll get more money we might get
more money anyway we'll see we'll see
the money is definitely on the table
when we want it you know just compare us
to the other startups you started in a
similar time to us in this space I think
we're killing it it's computer broke
this computer
we put it in the car and the inverter
kind of went crazy and it broke the
motherboard on the poor computer
any other questions guys open pilots
security features I was talking about
common security yeah so again these
things will all roll out and shiver Plus
first I would love to see shiver Plus
start to become a security system for
your car right if you leave that in
there you'll be able to you know none of
this is launched yet this is planned
you'll be able to basically it'll
function as a car alarm right if
somebody disturbs your car while it's
parked and you're running shiver plus
it'll send that video up to the cloud
you'll have like a security route do
push notifications to your phone you
know all that good stuff what we want to
do is build what the car manufacturers
never could as aftermarket stuff and
that's really what what ian is um
shipper plus we'll work with neo or only
panda no promises on Neo support for
shipper plus it may work it may not
we're not gonna go out of our way to
break it but we're not gonna go out of
our way to support it either ship
applause is really designed for aeons a
lot of because it uses all I use a lot
of power that way isn't spotify uses a
lot of power does it record both cameras
um so we're gonna add an option for the
front camera definitely opt in not opt
out for like uber drivers and people who
want that it's it's certainly on the
list and we're gonna get a lot more
serious about these kind of features
now that we've were shipping eons we're
shipping ship for plus ya audio will be
an option as well again I'm gonna throw
you're gonna throw a warning up on the
audio option front camera the audio
option you know you don't want you don't
want to activate that unless you know
exactly what you're doing you know just
just recording audio and your sound
recording audio on your car what
toolchain did we use i didn't do it
one of the people who work here did I'd
have to ask him I think we just use
whatever check out the Android thing you
like use that repo command you build you
wait six hours and you're gonna Android
Rob haha but yeah we'll be shipping
we'll be shipping out a new version in
the US as well should work we should try
to keep the back work battle of Neos
but definitely for aeons what up with
common points comments are great we love
common points guys check out the quality
so I've seen the quality side
lane-change support for open pilot you
know what you know what I always say Oh
a lane change means a sensor there who's
in the office right now me uh what's fsd
full self-driving yeah yeah we see it
commoditize cuz we're gonna do it
and uh
hippo I got become a hippo not for sale
maybe few I don't other people in Tamil
if you yeah but it's 6:00 in the morning
and they're home sleeping cool huh
you could maybe go find the Cole the
Koala was like it was a bad idea they
would call it was a bad I wanted uncle
Wallace
Eddie of the madam I told you guys about
koalas
is my here's my collection of books can
we make a profit yeah
we can make a profit Oh will you make a
profit it's not huge but hopefully
enough to stay in business
um what will be our advantage the fact
that we're going to actually work in
cars that already exist we're the only
one I know is like we're not gonna build
cars we're gonna build user installable
after
and that's that's the key so the user
can buy it we want to put this stuff on
Amazon Prime man and I was on prime
yourself a self-driving car someday
someday for now it's only a dashcam we
do still have a cook
we like cook to cook his grades great
guy making great food I love food cooks
hell I'm eating would be on work with so
would be on work I mean yet yield and
chef or plus will work on any car as a
dashcam um if you want to use the like
the functionality that taps into the car
that's that's that's hit or miss
depending on the car but ya know as far
as a dash cam ways and Spotify don't
work on anything you put it on a bike if
you want to maybe even try to no pedal
pedal in your little track down the
street and got your yeon mount at their
Haven Scheffer learns from everything
cool thanks for joining
um we've got some press coming out later
today so let's hope today goes well
thanks guys
oh I'm still here would training take
longer if you went 60fps no wood
attachment of an external stereo camera
work that's hard to do because bandwidth
from the USB camera is a very very high
bandwidth and thank you wait how do I
swiped it Oh
iOS 11 thing okay I figured out I found
the X now it's really by
yo yo periscope
periscoping yeah periscope yeah don't
hold it
people
no hands it's driving then you see the
rav4 has quite a serious torque limit
does no trouble with with turns unlike
some other cars where the other cars
outright on the speedloader behind 64
is not a limited so no don't Stefano
elevation so 75 up there which is our
max speed we're only going 64 because
the car in front of us
it works it works many people we got 42
rap for limited but the left we're limit
is on the edition of the call graph or
limit is that what this is yeah it is a
limit that they are asking limited we
bought like a platinum we bought the
highest trim yeah yeah they said he's an
interior looks like a limited right what
is nice really like that that's why you
got it tears nice
oh there's a
yeah that's that young Fed the retail
eons have better have a better family
the retail he loves a better fan
Italians have better fan it's nothing
worse than it's better than they you see
I know the retail eons are the
high-pitched whine is gone it's because
of noise about power line Georg dudes
why are you taking a self-driving car
awareness toward Las Vegas cuz it's not
all the way to Jersey you guys I got a
Vegas allow those niggas some time look
at this torch by the way serious torque
that's a real tour come for
now a self-driving car awareness - it's
really truly it's looking like the
Midwest we got some really cool about
slide up we'll get some press for them
we'll talk we're parently talking to
where classroom with fifth graders about
how you can achieve your dreams turn on
tune in drop out you know two-minute
drops right never too early Leary these
kids
now this Hill very nice that you can
just I mean we have to sit here places
to enforce exactly then you will make
some mistakes too which is the shittiest
part like it's not like you trusted to
not make mistakes it's zero guaranteed
DIY we are guaranteed the oh I
absolutely
it works pretty damn lucky haven't
really seen it like make mistake you
know it's been fine sweetie if I don't
do something yeah is the tour one way
the tour is one way yes the tour is one
way yes
she wears one why where's your first pop
song City Salt Lake City which table
when we go some do some ski to Winter
Park to George why do you hate Ford
fusions Oh God have you ever driven a
Ford fusions
I love these a crap move to the police I
police that was double paulie's huh how
many miles would have this engagement
well right now right now probably and
[Music]
they've been like minor things like a
mole frustrated let's slow this guy's
going that's not your fault
that's yeah but this current actually
we're gonna read you an open file to
excel like it should be accelerating a
little bit faster I feel right now you
can be a little bit more aggressive than
that see what is it six yeah
like kickball
what stop are you looking forward to the
most stop my looking forward to the most
I can see my friends in Chicago that's
always good it's not a real tour stop
we're gonna see a lots gonna shape up we
get some t-shirts made we would do like
that it's gonna be like the Warped Tour
it can be like the Warped or you know
just do you consider steering
Corrections just engagement oh yeah
so the only thing I've really had to do
was touch the wheel when that thing gets
low so I'm gonna touch the wheel right
now you haven't tested no pilot copilot
rav4 gravure have four and six five four
three no and a cure Lexus Toyota Priuses
Toyota Prius are now officially
supported however I think the rav4 and
Pacific is much nicer than embrace the
rav4 this car works particularly well
nobody's like a nice car too this is the
third most popular car in America for
what it is with the cost I understand
that's like 30k for a fully loaded one
it's nice right
replacing the minivans of the world yeah
yeah no one so many bad thing going
sport activity vehicles when is the
five-minute timer being removed never
right now the timer will be the timer
will be different probably in 0.4 or in
0.4 we'll roll out the new timer so the
new timer is going to be more based on
the confidence of the system at an
actual time it's also going to reward
you for responding quickly and punish
you for not responding quickly that's
fine though it wasn't there would have
been okay that's the thing I feel like a
lot of the when you actually have this
engagements there it's like they're
overly cautious there are you making the
decision abcess engage because i don't
want to see if this is going to work
yeah the way a lot of the way a lot of
the companies that reports as engagement
to the fourth loop is they only report
things they consider would have been
critical had I not disengaged yes like
when I'm urging lanes fucking I'd rather
just do it well exactly like that if I
touch the wheel that's a failure of the
system right the system should do better
I'm not trying to build us we're not
trying to build a system that optimizes
for some like idea of what driving is
we're building a system that optimizes
for you having a better experience right
so if you felt at all unsafe that's
actually a failure of the system whether
it was unsafe or safe and reality
doesn't matter all about how you feel
we care about our consumers like
Calma hey I had what was this time you
comrade cares about feelings or
something how feelings matter feelings
matter bro that's what it was
any other questions and embarrassments
shownu's he said and center your cover
and I'll modify it for you to fit with
the draft oh yeah you can do that or did
we want this up here yeah so you can put
the cover back on you could like Dremel
out the thing someone did that I get to
look pretty good
please ask is he has new sensor
installed
Oh new sensor are you talking about the
pigeon they talking about the pigeon sir
the pigeon no this car doesn't have a
pigeon so it was gonna have a different
name but we actually really liked pigeon
too much so we're calling it the common
a pigeon what is it I'll tell you after
we're we haven't announced what the
pigeon is yet but we will announce that
the name is Pitt officially decided this
morning officially decided this morning
the name is pigeon pigeon however no
further details have been released on
the pigeon at this point they will say
it is gray like a pigeon we are driving
to Los Angeles from San Francisco for
nibs guys and how many aeons will ship
in the first batch like the first batch
the the first two batches are gonna ship
really close to each other but we have
ten Aeons made in the basement right now
we have six sounds made for us this
actually isn't even a retailer yawn and
they asked if we wanted to stretch it
out
this is development version yeah
development you agree they're almost the
same the fan circuit was cleaned up a
little George would you ever give Trump
a ride
that sounds intimidating man that sounds
intimidating no he does not have his
hands on the wheel keeping hands little
wheel all times gross evil lurk of the
wheel now you gotta pay attention at all
times I'm actually but your hands on the
wheel if it messes up as long as you're
paying attention you have plenty of time
to reach out grab
went on saw three-point-nine release
coming
Oh also soon TM maybe maybe maybe today
no no don't ask controls team oh that's
much sooner than most people soon Oh
three point zero point three point nine
is very soon okay
yeah zero point four look but Chiffre
plus zero point four is going to ship
before open pilot zero point four
what do you think of the Neo driven guys
big fans
those wasn't right that made that Oh
Tessa guy yeah he built videos you would
sell them back before coming I saw the
owns do you use the factory lean keep
assess display for radar yes
so you see that there's a car visible
and that means that there's a car in
front of me which there is
two minutes left can really see the
timer
yeah Oh so yeah the downside I think I
said the bad news was everybody but no
new model model team is not doing so
great but model team might have some new
incredible stuff and then actually
announce with all the stuff is intense
just do it yeah it'll be kind of funny
you know if it actually comes out like
there's like ten papers talking about
what I figured out yesterday in like six
months it's actually it was first at its
george hotz moon what about the fall
just in spot another people yeah
father's this is stupid don't have that
that's stupid it doesn't maybe we'll
like repurpose it for like Siri coming
up on the or whatever we use - Siri what
well it will include all accent we want
to include one of those like voice
assistants make it better I think the
Google one is pretty good right what
supposed to be the best liar
I don't like my life so she's not that
smart
what are you doing in LA George go to
nips
go on and it's worth nip stand for
neural information processing systems
fuck lips it's better than like I Clark
or CDP are you guys are pretty shit
conference aims all like you like weird
foil other things it's actually makes
the most sense we don't name our things
like block chain watch a watch Jane are
fucking checking like comma a I invest
conference like the consensus in those
deaths just curious wondering it
conflict with rav4s built at Lehman
blame changes now you're rid of shit
George what you take on Bitcoin it's
made me a lot of money you know are you
speaking in them sorry god that's
beginners
did you ever fully flash the ECU on the
rav4 for full dynamic cruise no no
unfortunately below 20 below 20 it won't
accelerate they'll break all the way
down to zero which is la fed up the
scoring system oh yeah the other stocks
you don't the stock system does it just
disengages and will smash you into the
car in front so it'll just roll you at
20 miles an hour and so far zone yeah
that's worth the high quality right
that's very small but no we break all
the way down to zero this is 2017 right
20 step 2017 rav4 limited rav4 Limited
any update on Acura TLX support
No and you can do it will you flash my
civic ApS on tour no no no no no Tour
green flashes Oh
enjoy your stock torque be happy with
that learn to appreciate your stock
torque stock fork man or buy a Toyota
and your fake it'll hump or torque look
at this look at that torque bro that's a
real torque really there how long before
nine lane keep assist features like
stopping at red lights
I heard red light for scams no no no no
no red lights it back on the agenda oh
yeah when the pigeon launches yeah uh
okay
the pigeons gonna let you stop at red
lights the pigeon will let you stop yeah
oh why we're all the party in San Jose
oh shit oh let go oh yeah that'll let go
somewhere hold on yes we're nearly great
if open pilot came with weighs 0.40
am I taking 87 is the only question
I'm not gonna take one a wonderful wire
yeah we take it like that like thing
where it like cuts across you know I'm
talking about
you know you don't like that little
sketchy thing looks like yeah no no but
to get to five there's like some like
it's like it's like a like a subway on
it you know no this is you're just gonna
stay you know say on CA one one get to
do to get to them yeah look it stopped
detecting that laymen's abbas docile
week which one should be detected
nothing the monster doesn't like don't
worry the new revolutionary machine
learning system will fix this the
revolution and bro autopilot is on bro
autopilot on bro
wait why do why do you think this is a
joke he's not driving though there's a
guy in the back with an Xbox controller
on the back show movies actually no guy
actually no guy we have some you on most
cardboard cutouts on the way back there
that we can hear the Aeon fan with the
headphone on the periscope does that
business is the spam feed variable
yeah the fan speed is variable the
retail edition is better about it we can
also change the policy a little bit the
policy is a little you only hear it when
it's out like its highest level and it's
well the pigeon also do stop signs yes
yeah the pigeon will not go from stop
something stuff so basically it's gonna
stop and then you're gonna have to tell
it when it's safe to go okay that's fair
yeah because detecting whose turn is to
go in a stop sign is actually well also
there's actually I but at red lights
when they turn green it'll go
automatically yes because that's much
more so than some guy thinking it's his
turn to go exam have to stop talking
with you can yeah so yeah can you
straight on 101 prefer for 2018 Los
Angeles Los Angeles well we got a ways
to go over that was driving wouldn't it
be nice yeah nothing like it sketchy but
I just my concern level just one up five
points
yeah you know we'll be nice now if a
pilot like known about Oh
your cousin iPhone annex there goes that
phone it would have been nice is if open
pilot like knew about this and like get
it early on for us like it could
you know when will you sell sensors
between lane changes when will we sell
pigeons locations are only free whoa -
big talk to big torque
- big dork this is this is a lot of
torque right now this is a lot of torque
we're going fast around the sharp curve
so that's beyond the torque that they
have even the Toyota someone saw your
speed on the thing when you Florida only
cuz I was going too fast once they saw
my speed I was I going fast you say
cruising at 90 I'm gonna get some
traffic up here let's hope we don't fall
below 20 because if we do fall below 20
open pile is gonna disengage but we're
40 so all right someone asked where is
Biff his bad visit home easy huh yeah
how do I do it
wow that's a lot of lights um Viv's at
home yeah
and I go faster go fast scrolls columns
Co I really help 156 know bird I don't
want to want to throw in her feet we're
in there and then you're gonna stay on
here until you were John to 152 or
whatever yeah you have 28 files on here
does the system detect detect objects in
the middle of the road yes yes
you won't alert you it'll stop feeling
it it'll stop do not yell if it's a car
yeah yeah what's bibs relationship to
the company she's VP of Operations right
visit home shipping your Aeons while we
sit in the car for six only five and a
half hours know what's going down yeah
would you share what would you share the
STL for the e on GoPro support for a
custom windshield angle yeah we can do
that what angle do you want
so the Aeons gonna include 20 degrees
and 28 degrees and then calibration is
good to plus or minus 4 degrees so that
actually gets you all the way from like
16 to 32 which is a big set of
windshield angles
um but if you really want something
outside of that right like like luckily
look at this calibrates right I can
stare the Box move down you can handle 4
degrees of calibration just the camera
alone
what year will the car drive itself goes
to coast well I mean it's gonna be 99%
no television no car awareness to her at
sad today at least on the highway we've
been 99% autonomous we have enough
drivers on the phones right now we're
not going coast to coast of Alaska
that's at the hello though la once we
get on five it really like well what you
got a five you can really forget about
you don't have to take any exits or you
know stock blind spot indicators yeah
their stock I don't know we should tell
controls team to do that ah that's the
controls he needs to do if controls team
controls team if you're watching I'd
love to know if we can actually get
access to those side radars then we can
have some auto lane tation right
Alexa change left yeah that's cool all
right
I like Saturn me lot Alexa take exit it
before we're going too slow
I do love these white spots temptress
out
like they make driving a lot nicer even
the stock ones Toyota it didn't okay job
number one once a lane change they even
said pretty please George oh pretty
please please please pretty please
lane changes after red lights and stop
signs after pigeons eat pigeons did you
get a no win lane change is possible
all right because the blind spot
detector is actually not enough right
you have to know if there's a lane there
that you can change into that is true
when his own alligator ship elects a boy
service soon now that's a 0.4 feature
like 0.4 is gonna be a lot of those
features
the truth is red light will stop signs
may not fully work until 0.5 you'll
start seeing beta support for than 0.4
what was pigeons original discovery of
those pants on
zone live well I can't talk about what
the original name was because it gives
away what it is but the good thing about
it being pidgin it's just like who knows
what a kitchen this man you just gonna
have a zoo of animals yeah I'm gonna
ready in the shop to the zoo my bad idea
go to the zoo zoo bro I paid their draft
you know if you think about a pigeon
it's actually a piggy on someone said
latest open pilot is so good at just
reset during the car when it's in half
the lane isn't that very close to lane
changing oh yeah yeah you can do yeah
that's always been you can do half my
judge oh so what if you just get into
the lane it already center itself yeah
you're saying there's like just push it
over here and I'll let go
whoo yeah that's a partial lane change I
mean that's that's what what Tesla does
right now right so no Tesla you actually
turned the blinker on an auto lane
changes but that doesn't work I've tried
without without turning the wheel at
work point but there's a few major
problems with Tesla's doing first off
they don't have to side radars they're
using ultrasonics don't use ultrasonic
sprawl ultrasonics are terrible
um the other problem yeah like I get
sketched out in places like that the car
drove totally flies I know I well the
thing is honestly I'm not afraid of the
car goes we're all afraid of the guy
yeah maybe that's the beach threat with
driving a car is a bullying look at like
I'm like why are we slowing down so much
because you have that look that thing is
slowing down right you don't see it the
radar is superhuman oh that truck is
slowing down
yeah yeah right that trucks going mad
slow takeover
we'll see so yeah we when we tracked his
engagements we track what was done for
the disengagement so there's four kinds
of disengagement right there's gas brake
steering and can't
so dis engagements with the gas are
considered not safe differently because
in general if you want to give it more
gas than open I was giving it it
probably wasn't doing something unsafe
that probably just was pissing me walk
yes brake disengagement SAR the worst
ones yes you're just engaged with the
brake okay that means something went
wrong does that mean something went
wrong and steering dis engagements are
not great either particularly sharp
steering disappearance so we pay most
attention to those but ya know 2018 is
just gonna be a race to drive down this
engagement ride over again last and last
and less and less until they were so few
and our hardware is so reliable that we
can make it level 3 yeah
wait when do the levels change I've
noticed this no you're like five and
bullshit yeah yeah yeah no like when you
like first started , it was what you
were level three you need it to get to
level four right and now it's like
you're level two and you did level three
the the levels change what is this shit
last two numbers in it really changed it
just kind of became legally advantageous
to always only calling yourself level 2
okay how much curious because that was a
level 5
right well I lost little five was always
level four which is fully its bullet
okay so the distinction between five and
four is four means it's fully autonomous
on certain routes five means it's fully
autonomous everywhere cars control
yes so you can have a level four car but
it's just limited in the places it can
take you a level five or my particular
that's the distinction so someone wants
to know if you removed the the message
telling you to regain the wheel in this
car no no I don't know if they just saw
it and they said yeah absolutely not and
don't do that
don't remove the message that's bad yes
six minute timeout is still absolutely
functional we don't take it out it's a
good safety feature Oh
as far as the one that talks about the
torque limit I mean then comes up much
less likely on the Toyota the Honda
because the Toyota has much higher
torque the one that says like you know
sorry that turns to sharp yeah turns are
just way more likely to be too sharp on
the
what are we kind of nice I haven't
driven a lion to eat is over by like
that's right I got pulled over once
those bottles for doing wanna speeding
95 that's bad to know in 74 we're good
no like when it flashes Ward and demands
you to hold the wheel every 20-30
seconds yes we're talking about no it
was never removed and it's not open I
never demanded that you hold the wheel
over 20 seconds
no it demands every six minutes that you
touch the wheel to prove that you're
still there yeah exactly those things
are not those things are not good like
like so there's a difference between an
actual safety and liability right so you
think about that thing we're like Toyota
will like disengage at 20 miles an hour
and just like let you slam into the car
in front of you right yeah that clearly
was done for liability reasons if not
for safety reasons yes and if that's the
distinction I will always favor actual
safety over liability Lagos just which
manufacturers is this neon currently
compatible with what cars are so
remember that the EON is a dashcam you
have to modify it if you want to work as
a self-driving unit the Aeons we sell
cannot drive leanness you have to modify
and we don't publish instructions about
how to modify it you're on your own
finish such as so everyone knows eons
are a general purpose - game general
purpose a dash cam developing kit not a
self-driving car you can modify them and
do whatever you guys with whatever you
please might be such a hypocrite my time
to control yeah he promises you won't
see you like so that's right that's
right don't get you won't get sued do
whatever you would like with the exactly
you buy in a store but yeah so so open
pilot is compatible with there's a list
of supported cars on the website it's
hot as a Toyotas and that girl no okay
right the same car Lexus and Toyota is
in the same car
just a badging scam it's actually quite
we're in the middle lower you're always
better off buying a high trim of the
cheaper brand and a low trim of the more
expensive grant a lot of people don't
know this they don't know what I think
I'm gonna touch us again I'm just to
reset the thing so masters I like we
have a Honda Civic touring and we have
like a base-model dialect the Honda
Civic Touring is a much nicer car
you're better off buying a high trim of
the cheaper brand then a low trim of the
luxury brand mmm like a low trim Lexus
is a worse car than a high trim Toyota
obvious light trim Lexus better than hi
to figure out of it they charge you more
for a low trim lexus than a hydro to the
other and the hydro period is better car
they're built like largely on the same
platform
I'm like the aisle accidents have a code
of same car the same car let's say
platform now there's lots in court well
now there's a few because a few changes
made to it but like it's the same
platforms and Jesse's it's actually even
worse turn the I Alexa yeah like so we
have us at 9th gen Civic in the 9th gen
Civic bad reviews really Pacific where
is tension tamers much better
do they still think it's a trick no
there was there's one guy thought it was
trailer guy thought it was a chick
there's a white guy thought it was a
trick we're faking self-drive you're
actually driving any me over there
it's as real as it gets
we'll open pilot disengage if another
driver merges into your lane and if you
get rear-ended ouchie that's a good
question will it a notice if somebody
make you and stop the car
yeah no hey wall huh can't you do that
in there crash bar over our that you can
tap into or something
like when the crash bars hits off the
car no actually it will it will open
pilot will disengage if like ya know it
will and actually well if all the pilot
detects like a set of faults with the
car it will disengage okay so um yeah
that would be that would be considered a
fault backseat driving is illegal and we
will not do that for example a if the
air bags go off yeah definitely
okay if you just gently lightly tapped
No
can you explain what the upside down
with the Honda Odyssey
oh so the Honda Odyssey the connector up
here is literally upside down from the
Civic so when you try to plug the
giraffe in it plugs in upside down and
it doesn't fit really yeah
that's bullshit he apologizes how
difficult is it in your opinion to get
open pilot to work with other cars it
depends on who you are depends on who
you are and what car how difficult would
it be to get to work with like a Toyota
Camry not hard at all how difficult
would be to got to work with a Ford
Fusion disgusting because you have to
sit inside a Ford Fusion I'm still
waiting for somebody to pour this over
to a luxury exotic car I'm waiting for
the first open pilot rolls-royce make
you a deal if you buy me a Maybach or
rolls-royce ghost I will pour it to that
car you hear that you have if you have a
Maybach or rolls-royce ghost I will
personally do it separate from comma buy
one for me growls right back he will
attempt to get your rolls-royce Silver
Bay back this all drop that's right no I
totally will man love one of those cars
someone's got to have the crypto gains
to do that this year
right someone's gotta buy me a little
bored
got to get rolls-royce to do it sponsor
you you know about when you thought you
were gonna get a rolls-royce and then
you do it's really absurd so you know
about um what was it gah
crystal or Dark Crystal right the guy
who made Cristal the guy who made
Cristal was once being interviewed um
and like Walt you know upstanding Kyle
French guy you know very very well
dressed he's like I don't really like
the way if it be on a certain
demographic of rappers and people who
aren't members of upper society are
using our product you know we were just
rather they didn't buy it
Christophe went from being the top
selling luxury champagne to light below
like really
jay-z called for an absolute ban on
Christoph fuck this guy nobody if I see
you treated crystal that's so not cool
and completely plummeted um yeah and
then Dom pérignon became a thing does
the doctor joke I was like we love
anyone who buys our every great man I'm
soft
I feel like Rolls Royce is a similar way
like Rolls Royce expects like the stuffy
British executive to buy a Rolls Royce
yes and it's actually like post below
yes expect like the Exxon CEO
are we close to somewhere wait where's
my phone there it is
shit did I miss the exit no I don't know
tap for George know your point I would
like to point out that plenty of miles
to get to 180 time for the plug is the
issue for the Honda Odyssey Howard the
other car mechanic connector of
diagnosis diagnosis no it's not the pan
of plug giraffe giraffe is a lot of hand
grandpa pants fit in all cars you know
how hard we worked to make pandas tiny
really hard and as a Chinese they fit
everywhere they're banned out there yes
there's no fan up there we're dry right
now on a panda panda panda panda all
right yo George what was the ML Legend
tweet about haha
yo guys if that shit works you have no
idea how good oh yeah revolution which
car model does okapi work best him
a porcelain it depends there's some
advantages specific and some advantages
to the rav4 I think in the long run
I bet on the rav4 grab for you heard it
first 2017 rav4 limited beautiful cards
at 33 ounces it is a beautiful car
because we're much more likely to ship
the reflash that fixes the 20 mile an
hour thing than to ship a reflash the
fix of the tour much safer when you're
reflashing the engine it's much safer
than reflashing is what's the worst an
engine bust accelerate step on the brake
what's the worst the steering does the
experience as well d the accelerations
have to be I know my safe
there is more of a problem in the truck
all of them so I said you can have a
GoFundMe campaign for the different
models but you have about the system we
have bounty it's not even a gofund means
we pay you if you do the pork if you do
the pork come to come little baby 10k
like those cars all right you gotta
office treatment so since I'm remember a
little more than that guy well yeah I
mean here's the cool thing
why don't you set up whoever you aren't
brokest it ever go fund me a your car
supporter go set up a go fund come set
up a go fund me get someone to do it
like a pilot open-source go contact the
guys like github that are ported
previous cars right there's two of them
there in the pleura cross section
mr Hayden like I hate to give his even
when I'm I hate trucks as well when I'm
driving to our fire
would also work on the rav4 hybrid
should
what is this it's a carnival
Wow is it kind of looks like a carnival
no it's a farmers market Christmas trees
there's some kind of adapter the
draftees look at the pillars of the
website slash buy one that really should
be zoo dock a little airport just like
the Gilroy Airport or something
[Music]
and some white whales
that's God Jesus lifts when are we gonna
work on those lifted f-150s one-minute
Lincoln ever plays on mobile I hate you
wanted the Tesla Model S pull request
right now pretty soon actually that
thank you would probably be really easy
to really yeah that's probably better
view is never expected yeah no that one
that was on the bad people are excited
about the Tesla Ford's the cars that
people are excited about our Tesla's and
Chevy Volts but here's the thing nobody
owns either one of those cars
Jim sold like seven Chevy Volts someone
said I have a feeling we're not gonna
see many Audi's no folks most popular
car manufacturer in Europe so if folks
might now do the same
somebody else might be working on those
but you know how much faith I have never
actually what the how do you guys yeah
but uh how much do you absolutely hate
the factory to have oh I don't bro do
you think we use the factory in haven't
never even used them we've never used it
how about you has these factory NAB's
this isn't that bad of a factory now no
I think yours was different from mine
but it was horrible of my pens what I
liked but really what I want is ways
right here and that's come out really
soon is open loud only supported in the
u.s. those open source it's like what do
you think of Alex Roy is the bro balance
sort of problem and we love to as the
bro he came to the Christmas party last
year
yeah he asked if he could be a partner
for self-driving car Awareness Week
absolutely Alex Roy I'm looking for
partners for soft rented car Awareness
Week many of you would like to thank
interfere we want to make people aware
that this is possible today sorry good
driving across the country who driving
across the enjoy everybody to show
people be aware like this works Toyota
if you work for Toyota understand how
you're not like shitting yourself right
now look at this this is the Toyota this
is a Toyota we've been talking for an
hour and a half that we put on a
cellphone and a panda and that's really
what this shit is
well no that's what the shit is in a
very low alcohol a cellphone a panda of
course and lots of very complex software
is literally running Android right now
that's Android hope we don't get like a
text message you know as Amber Alert the
umbrella used to crash open pilot don't
worry
downtown is that the name of the town
you have two miles
any more resources for reversing canvas
of a panda and slash Cabana
I need dish no resources you can watch
it once on a periscope I have like a
medium post about it going slack the
inviters fixed I'm nobody's slave but to
get the high respect go to slack dock
amadhatter I you'll find good people
there Oh
they're right up the ass truck and we'll
do a little bit of periscoping on this
road it's a little bit different then
we'll turn the tires go off right there
mr. got people yes somebody's calling me
from San Francisco
choice Pam thank people get 56 I'll get
more
you've had 670 total love those viewer
numbers
wish I had this funeral my way if you're
bored mr. plugging for my soundcloud on
all periscopes soundcloud.com slash mom
remove a new music recently that's Cruz
with two zeros see R 0 0 se I was
inspired by James Dean you know the porn
star with the two V's I was like I'm
gonna be Tom Cruise with two O's and my
roommate was like nah man
one two albums with two zeros I got a do
an album one of these days Tom Cruise
with two zeros and his name was goose
with two zeros
yeah we should get you on a future with
little Windex an actual robbery like
what witness will fly you to has to have
to do a future yeah you should do a
future with little Windex so like check
out that torque let's slow down and see
we can even do this okay now you're
going no go right go right
sorry what no what laughs laughter
laughs that's what I thought
nice navigation flopped I got a
voicemail
oh it's fucking gusto don't call me boys
custom calling because they try to
upsell you the payroll service
oh you have your number in there for
that oh yeah they could hi Thomas just
like to let you know if you'd like to
you know upgrade your control provider
so what the payroll platinum no no you
get him to do like your health insurance
and they do all the other stuff for you
then what would I use benefits for you
zenefits yeah we don't use other folks
myself
you give them health insurance I mean I
deal with oh great yo we should buy a
sandblaster yeah well we got to figure
out how to make it neon heatsinks look
nice
[Music]
hello quickness so you're going yeah
you're saying like free woman
please answer why did the manufacturer
made the connection that the draft goes
in why did the manufacturer make it yes
because that's what manufacturers do
manufacturers suck yeah okay so this
you're gonna see look so now I'm going
to me gasp quarter tang
we should stop eventually I got I just
don't know where the next gas station is
there's this stuff on the truck
okay it was like a Best Buy yeah yes I
didn't know if we get POW we're below 20
so I have to resume driving manually if
you saw that warning what is used from
it what is use from what I'm assuming
he's referencing the connection and Oh
like radars and shit no guys leak this
is all documented on the Internet
George have you not learned by now that
people don't like looking things up I'd
much prefer to come into a periscope and
ask that's the only skill that you need
to have in life okay look at that
serious Toyota torque right look at that
said it couldn't do that
so the can't turn
sure stop there for gas pretty good
price
[Music]
how long before rideshare uses common AI
without driver soon sure use Connie I
with driver whoa some some people now
I've heard I've heard from people like
yo man like like people reach out to us
like yo I was in an uber and they have
this thing that was driving they said it
was made by common AI really becoming I
well that I wonder if we would ban you
for doing that as an uber driver if did
not out they guess I'll cut your
contracting for a reason of course they
can you know about those people who are
like having people fill out surveys in
the back of the UV is saving money yeah
who ever tried to ban those and like
they weren't allowed to yeah I mean I
guess I don't know when it comes to the
safety of driving they have some more
control unsafe back it'd be questionable
if uber could that's interesting maybe
it certainly have like requirements on
the car I don't know well that's such a
good idea that for filling out surveys
for a free ride at the back seat well
they do that yeah I know guys like fill
out the survey don't stop you're right
five minutes yes exactly
he makes six dollars because you thought
the lots of survey yeah that's a great
idea
yeah
we is that Sonic the fast-food place
that exists out lost i thought sonic was
east coast only oh it is it's sonic
burger is damn
[Music]
so like this road and stuff is good for
open pilot unfortunately this car can't
do stop and go which is super
frustrating about oh you were talking
about a subway store you feel like
subway yeah and three people in the
channel we're like what the fuck what do
you mean I recognize this one subway in
the middle of nowhere and I remember
then use that as a reference point daily
we stop there every time usually like
you know with someone of the curves
gotta get out of this car
ooh that drug
feel the power of the Rav
go-go-go-go opinion on caps Nets Nets
it's a net that takes your letters in
and puts them in cap cap also eight so
it's like when you do text-decoration
uppercase in CSS or one but that's right
the text transform uppercase to behave
like text decorate half soul networks Oh
cat so Jeff Hinton's thing oh I don't
know to be honest I haven't seen the new
stuff I saw the early stuff on capsule
networks like here's the thing you have
to realize about Jeff engine all right
like the man is an absolute genius and
invented a lot of great stuff but like
everyone who's invented a lot of great
stuff they've also invented a lot of
crap
nope so I don't know I mean I'm not
really a believer in it how am I
thinking this idea of like like extract
things I have to read the new stuff to
really get like a fair thing but when I
first saw and I'm like no this just
looks like like you're still believing
in features right not only do I not
believe in feature engineering I don't
even really believe in features like
sorry what's the future I don't know
it's just like this 512 dimensional
vector space look at this open pilot
look at that boy over pilot however it
did all the way up to here on this one
thing I did that's good now it's just
the problem was there were two double
yellow is you see the two W yes it was
confusing it it was locking on to the
other double yellow Oh add the center
prize yeah like now it's good so that
was that was a model failure
where the hell are doing your goai
traveling across the farm country
no hands
this is easy yeah this is you're not
gonna get much easier driving the mat it
was pretty nice roads are well painted
unlike most of California yeah that's
true okay these houses actually kind of
fun to live out here I think no I don't
think you can get like anything a me an
Amazon Prime
it was our friends everywhere I was on
prime yes yes some guy was like writing
about how he like lives on an island and
Amazon Prime delivers to him up look at
that we got a forward collision warning
amazing
well not was stupid though but you
didn't get forward collision no it said
brake risk of collision and it beeped
three times collision warning but it was
while the system was on and it braked
fine interesting so there was no actual
risk of collision whose fault is that
who's the Ford wind warning team no
feature engineering foam I mean that
wasn't like the worst false positive
like they're really annoying false
positives for fraud collisions
we get above 20 it can like make this
time we have to be above 20 because it's
stupid around 4
avocados three for a dollar I'm pretty
sure Whole Foods charges like six
dollars for a avocado
yeah well new Whole Foods is gonna lower
the prices because they're owned by
Amazon you know Amazon strategy for
lower prices zamboula doesn't believe in
making problem which is great i lose
greatest charity never exist they are I
don't know where I'd be without some of
the toys are for grandmas you're gonna
take that yo-yo this is a fast life we
are on a crash course what you think I
rap for it what's your fuckin rap I mean
look there's a lot of them yeah
regardless of what demographic it cars
for there's a lot of them on the road I
mean you know that's always the question
like are there more English teachers or
truck drivers that list Shakespeare as
their favorite author
truck drivers probably like like uh you
know who's that chick really no no but
the truth is just so many more truck
drivers that like you know you're just
better off going with that so that's why
we choose these cars personally no I
would not choose to drive around for but
if we drive the company cars the company
pays for gas which is which that's yeah
however I do have to say this is not bad
for a like non nice car that I chose the
second ride it is is very good very
other like really nice thing is this car
has open pilot which is super nice
yellow it is very nice I would much
rather take a rav4 that would let me not
have to actually draw have the entire
time versus driving like a nice person
you know like honestly when I had my
Mercedes I would get so mad that I
didn't have open handling drive what is
this shit that car didn't even have
adaptive cruise
like driving with so much effort driving
a lot about her driving is a lot of
effort
fuck drive it
like this is like it's it's doing the
giraffe connected to the ER no this is a
panda right now the giraffe is connected
to the panda which is connected to the
e/m yeah
all right yes that's open paya today on
perhap for oh you know yawns do not come
with open pilot you have to modify your
yawn you have to do yourself
we can't help you with that we just
released open source software and
instead over some hardware yeah yeah we
should leave the periscope yeah work it
we're getting out an hour definitely any
final questions fashion speak now or
forever hold your peace
cuz he'll never periscope or down power
no one ever last one now let's go from
tips maybe well walk around nips and
make fun oh yeah if I have a vote
without driver assistant / radar is it
possible to retrofit for the Aeon
driving America wait really
someone just said fuck driving should
buy it we should buy that dude one
little pigeon be released we don't know
yeah no no soon TM
yeah well ask any go everybody everybody
to end it and he tweeted any right now
but now to have Ewell's any Samuels
when's the pigeon coming out bro
everybody turn right there
everybody Samuels tell them you really
want the pill start working on it
no other questions all right later bro
later guys
[Music]
hi guys sorry we're a little late every
time you I I logged out of Twitter and
it logged I wasn't even like leave them
in there for like a mask on we need some
air thank you Eric I know it's very
smart so exciting
Oh feels like so I guess yeah I guess
like let's talk in the order of what's
exciting okay what's the most exciting
ones there's this walkway here that's
kind of new it's actually really
dangerous and there's lots of cars that
are like accidentally crashing over the
crosswalk okay I'm sorry that must have
like made people feel really freakin
with 0.546 coming out hopefully tonight
and it's gonna bring good stuff for
users so most important thing is well
okay so there is like a stylistic update
there's a new setting asking about the
most common thing which is for everybody
calibration algorithm is always active
on the road yeah this turn is so
dangerous
settings look great thank you Andrew
okay
it's a takeout is it still green either
oh it's still bad okay so the other
thing that are cool is we changed the
standard G offsetting so if you ever
known that stop doing zero zero zero
zero four zero setting actually do zero
one one one one of us what this do is
it's gonna put back the camera stock for
anything that is not needed by open pile
to drive the car so if you have like one
of the new one does that have Auto high
beams or all the other features they are
gonna work because there we are gonna
pass them through using the panda so you
you will be alerted when you turn on the
car you will receive an alert if you
have like the GF back to the old
configuration which is like zero zero
zero zero yeah where he would attack you
alert you to go to the correct settings
exactly will tell you the new
geographies change actually you can do a
live type of state probably Apple oh so
if I change the wrong switch back we're
good live same thing works on Toyota two
Toyota's great doing these because I
call the Toyotas have how to high beam
features people were we're missing it
their only problem with the Toyota is
they're you
the 120 ohm resistor to terminate the
can the camera can mm-hmm so we started
to ship the 120 ohm resistor you
probably received if you receive the
giraffe we know that would be like the
next step the next step would be do
everything entirely like in software
it's a good question
so we are gonna keep the key you're
gonna stay like physically on this
setting before they wonder like 0 1 1 1
and then of your software you can switch
between stock and non stop by since we
so you oughta cheer after don't support
these configuration because they don't
have the resistor we don't want to fire
people yeah we don't want to force
people want to be that compatible not
airsoft people that don't have the
resistor so we're thinking about it but
definitely yes there and that's where
we're going now is no more switches
giraffes are kind of this is the first
step Oh Danna this angle is amazing yeah
we're totally give you guys news about
okay so other stuff exposed table but
that was already merged into the main
evidence so you guys are not like last
calculation public for sure
well the kid they honed the acceleration
is still better again everybody
complained because he wasn't fast enough
then we made it faster but until you saw
their problems I think we release we
have the best of both worlds so no
drawbacks but find acceleration so you
who said private forever and then when
is this release coming they try to ride
tonight I need a stir
like all the cars but probably tonight
yeah
so what are the questions this
acceleration limited by Honda well so
what allows a pretty good acceleration I
would say it's limited by yowza
like we use less than acceleration and
actually all that allows because it's
very abrupt of the way that the
acceleration is done by Yolanda so we
have kind of like how to limit it to any
update so the car will not try and take
exits we've been pretty good about that
for the pad since like the previous
release I mean we kind of disabled exits
in a way right left biased we I think
he's gonna I mean like new mothers are
gonna be better I'm back there I
wouldn't say that these model is gonna
be particularly bad there but like yes
like once we starting to create more
from the maps and this is gonna become
like very soon car for sure yeah the
speed limit is like a first intro of
tying the maps in well because like so
you'll need to do is do we drive like we
drive guys don't try to change your
settings that's specially Toyota doesn't
work
now one does like a little more amenable
of it but you weren't able to engage
though because like when you switch the
gene off like me we try you have some
fault there's like double features on
this release no you don't need you don't
need actually okay so for these are
these you don't vote for them like this
in the future so to get like this people
ladies which is not it is but it's gonna
be like in the next up did you have a
gamepad is gonna work back there yeah
because we're going to be watching
yummers up here external antenna gives
you more integrated features like this
little case so there is there's two
things one thing is like how do we take
advantage of like maps like low
resolution maps if this is something
that we started right now this is
actually not using any of HD maps but
the other thing that we wanted oh by the
end of the year is a start but is HD
maps and we try to have some like
limited our HD maps released and gave
basically the idea of scalability like
as we get more data how can we stand the
HD maps Aria coverage and so then it
will become just a bit of a scalability
problem but I give the ear at least like
portion of
California from the Bay Area's the
corner by um seats
yes we're building the right now so
those are existing GPU CPU D sp3 sp3 the
DSP calm yeah we used this before or D
some part of the ungrateful corpse
well this seems like it's good a time as
any to announce the fact you know where
to car we're periscoping we're
self-driving and we're in San Francisco
but this is also gonna be true through
the states of California New Mexico
Arizona Texas and that's it is there one
more thing
well Louisiana but we're not wasting a
minha we just want to party Louisiana we
are we are officially announcing the
self-driving car tour today did we
already announced this I think we may
have done it again we're doing it again
and we're coming down south we're going
to LA we're going to Phoenix we're going
to Dallas and we're hosting meetups and
we're going to have exclusive slag that
you can only get on the tour we're also
gonna have the common mobile shop
and can we announce the crew or is that
gonna be a surprise
we can announce we can a salsa team
the team that's going on this fabulous
road trip is gonna be Eddie
Ricardo Harold and myself in person
which a lot of people do so get in line
it's gonna be very exciting
oh I forgot to announce one more meetup
in San Francisco
our first ever Bay Area meetup which is
really ridiculous that's taken us this
long it's going to be yeah you can get a
haircut at the meetup I'll bring my
[Music]
that's fine actually if I fight if I'm
legally allowed to do that and say it's
I'll totally give you guys oh yeah we
are having a San Francisco Meetup and
it's gonna be December 12th it's gonna
be at the Airbnb headquarters to Airbnb
for hosting us mark mark LV and Mark
Hill BK December 12 and think at 6 p.m.
we'll announce we'll have like a medium
post with all of these links it's
practical to sign up for the SF beat up
because of Airbnb security policies they
just have to get you I was like an event
right or some prey it's pretty fancy
so yeah they'll be food we'll make sure
there's food on all of our meetups will
like bring pizza any good maybe some
Arby's apple turnovers yeah because
we're also looking for sponsorships with
a self-driving car tour so are these if
you're listening we need our be a
channel we need gasoline peace it go
will be basically come six out goes yeah
if I could pick any gas company be 76
they're the most stylish me I'll get you
got haircuts no progress
I'll bring your clippers but seriously
we are looking for a sponsor the yeah
this is exciting news so we'll have more
more information about all these places
and locations the location that is like
almost for certain right now is we're
hoping to do it at the fuse makerspace
in I believe that thing's an Albuquerque
it looks pretty fancy and hopefully the
Dallas makerspace in Dallas there are
nonprofit and so they're hesitant to
allow us to come but I was like that
ceiling
P an express sponsor yet we're so DIY
like all of our giraffes or open sores
yeah you know that's gonna remain in
effect yeah we're open sourcing some new
tools oh yeah in the next few very
important so we're gonna open a pilot
we're gonna open source it because we
figured that it's not the best way to
the communities we physically community
you know in our same spot the way that
we develop should be the way that the
community develops here or there cam so
we're gonna open source a lot of our
attention open up our tools maybe you've
heard of unlocker that's a we might
mentioned sometimes on these scopes
that's a tool be opening soon yeah
[Music]
yeah so we're seing tools people are
excited sourcing tools like you know
this is what you need like some social
drive to make tools and products good
like if they're not open if they just
remain internal they're not going to be
very good for us to use and it's just
better when you open it yeah it drives
you to it forces you it puts you in the
spotlights you they have to look good
yeah exactly
so no more excuse - Aiza yeah you're f
tucson Peterson like don't make it
better for us and obviously for you guys
those policy expands toys as well yeah I
mean along with tools you know tools
should be you know we don't use too many
comments because comments get outdated
well code does not but like you know
they'll be documentation long or not
because la maker spaces are part of
contents
message me on slack about where your
office is because that could be great
Irvine California we're not coming to
San Mateo but we are going to be Airbnb
offices are in soma so so ma San Mateo
that's pretty food right now we're
driving my coma it's like whole motto so
Morgan kept going down our living that's
what they said that's what they said
people just die are you guys getting
that that's insane
that's cold they have a heart and stuff
[Music]
what else yeah we're saying to explore
the great southwest of the United States
yeah if anyone wants to you know join us
for some of the torrent for a raid where
we line up across the highway
yeah HD mmm the door is really great for
people who came out last year was a
great time and if you help us organize
we give you some free swag which is also
an even better time yeah
any other questions what's going on in
there
76 people are still here is there a blog
post on the update for the release week
there's like a github release notes
Japanese no as you know we're about
delay um likely like a I don't know
downtown LA LA is huge is something yeah
I was like map looks like hosting two
hours skin from one end to the other but
we'll let you guys know I wanted to be I
wanted to be
their accounting actually another good
thing about that is we are now
supporting the and there's GM giraffe I
saw zona as a lesser and support that
you ladies I'm actually selling the GM
tear yeah there's a GM giraffe out there
so you know as I'm working out of the
box by the Jeff here yuppie tasarov's
been really no other ports searched so
the noise emerged but it's like a yeah
we don't we don't we're not that
comfortable like officially supporting
these cars that we don't like have
access to kinda makes us nervous but
there's enough people doing it well
there's enough people doing it
definitely and we are a beautiful that
receiver you like the safety seems
pretty good
good job so we paid out the man yeah is
this now mr. diets for me to sponsor
there's a GM Tesla community ports
jun-tae we are teaching support these
internally here supported you guys
really good this it said the Hyundai is
like any of your driving on 2019 Carson
like I said any of you you've seen the
open pilot on 2019 cars like to know
because we would like to lease them into
their EP and actually we don't have any
really turned about many many people
using it but maybe I'm sure you guys out
there you see t6 was on point five five
with Subarus do you need three pandas
five full on a Cadillac picks up
everywhere yeah we find us
you need pandas and like some special
connectors well yeah you need like a
four yeah it's kind of a it's pretty
janky we can open source it I can have
like Nick touch it up and release it
it's kind of complicated to use but but
yeah it's got a complicated like there's
pandas running doing some forwarding
that aren't connected today eons it's
like they can't evacuate campus
yeah but it is a bit like the Cadillac
actuators are so nice like open quite a
lot of kind of expanding well it's
really good I think Greg uses no no he's
been using stock yeah
turning out to be exactly the same as LS
600 2008 to 2015 is it a Lexington
thanks yeah wow so complex but will be
needed for 2020 escalate
2000 there's gonna have super cruise on
this they should they should have super
cruise on more cards like it's it's
requires like you should have a huge
metallic cover like double but it on
that see you that there's like they cost
check each other it's really over
engineer there's like flexpay cameras a
lot of things to be going on other for
other luxury it's just complicated
what's really like the like you know pmw
or like somehow DS uses the Cadillac
uses it but like there's just not a lot
of support for it on like hardware wise
or driver-wise whatever
so it's never gonna be it's never
actually gonna overtake us my Prudential
but yeah like they own the mold they
have like HD maps on the car they're
able to ship updates to the maps but
there's the system itself what we really
need to find before the road trip is the
stabilizer because that's gonna make
these pairs go so much better yeah I
think
the rumors on George's that he's still
in the closet closet
he told us like he's living he's going
to try living be our hundred has el Casa
nice to see bunnies to pandas so far
what is that what about Toyota pedal
support so what is a toilet pedal well
we got this we got the pedal I think
we're gonna try it depending how good it
works so we might actually merge in the
code that supports the like we will
never like a feature you support the
fill it up
but we can merge in the code that makes
it compatible like Honda so we will see
later I don't remember who sent to us
but I guess we tried you need the pedal
for stopping there no yes well there are
certain Toyota's where they don't do
stop and go but we talking pilot you can
do stop and go but they did majority of
Toyotas they cannot do something go you
still cannot retreat open Toyota rav4
yes no not for I believe you can we
should put in our and we don't have any
cars with a pedal now that's right go
for seven go oh yeah the Acura was the
only car we had with the pedal and
that's long yeah you don't need on this
Civic are you do beyond telling recorder
to look straight ahead yeah yeah it
won't be bit you unless the cars movie
if you're not if you're just stopped
it'll just kind of remind you
driver monitoring is really good it's
really good can you change follow
distance now on Honda Civic winter zero
point five point six no no we don't do
that that's not a thing don't change I
don't know you can do that on Toyota's I
think but not with open pipe but like
with the stock system I don't know it's
not really something you want now to do
we just puts the optimal distance what
is the offset on the eon in that in this
car in this cross o
Indus can respond to like about like
whatever these are coded like six
centimeter maybe but why yeah the camera
I'll sit with respect to the center sure
if that's what they are asking still got
68 good users we really used this mount
remember that remember we mounted a
GoPro on this like ball joint we can't
find the other side though oh really
but that's really we need to mount a
camp well the greatest is when there's a
rear view mirror and you can get like
the fully yeah oh sorry
we have flipped giraffes oh I think
being added to the store next week we
got flipped giraffe so that's like
Odyssey not sure what other cars on its
also nineteen cars engine has a nineteen
like the this connector on the camera is
flipped around like on this one it goes
the tab is on the bottom and on summits
on the top I don't know I would like so
someone made I think someone
did a flip of it first and now we have a
production version we just got like 100
I think manis yes I'm Nick we'll be
adding that to the store next week add
to the many many jurat that we have
yeah that's more news we got hoodies are
in stock you need a hoodie chili great
buddies are great they have they got a
white string on a black background
yeah someone had a gray in the SoCal
meetup picture there's one had a gray
hoodie with a black comma it looked
pretty good I don't know who that was
yeah but so cool hello any black friday
cyber monday deals yes yes yeah
that's all we're staying there yes there
will be yeah maybe like an apple style
3% off they do 5% either yeah yeah no
we'll have some good deals
[Music]
pandas a great stocking stuffer easy to
get started yeah if you really love
someone get them a great panda really
love someone get him an e on Black
Friday yes I've already started like I
went on Amazon and it was like early
Black Friday I'm like November 9th then
they made their own day of it all yeah
cyber monday crazy oh wow okay it's
going around the whole weekend oh but a
note about the fulfillment all orders
ordered after after on - on Monday
nights and ongoing that they will not be
fulfilled until the following Monday
just cuz we're closing fulfillment for
Thanksgiving so actually maybe we can
have a filming don't Tuesday but
regardless your onesie is he here
Wednesday okay so clearly winces yeah
but if you order on like Thursday and
Friday that'll be on fulfill
Monday we're dropping the Thursday
delivery this week yeah yeah we miss you
yeah everything's gonna be at home yeah
enjoying Thanksgiving yeah
it seems like kind of it cool so look
out for that release and all the other
information they save out there with
smoke hey Steve have a this Thanksgiving
my snow peas
oh hello hello
welcome to the comma AI office as I
promised we'd be doing a livestream at
people to get in here III I do want to
apologize for the sunglasses I don't
think that they make me look cool
I hurt my eye so that's why I'm wearing
them and that's why I wore them in the
press you know you hurt your eye right
before press what do you do your wear
stupid look at sunglasses but uh trying
to make it work
Oh someone's at the door we have a chef
now we have I think it's the shaft am i
whispering can you hear me well I'm in
the office there's other people here
working and kind of maybe look around
all that so it's gonna be a little more
quiet than my usual periscopes but
hopefully you guys can hear me well I'm
pretty good all right I like that so
yeah we're gonna be reversing the Prius
today using Cabana I am pointing my own
camera at my monitors because I don't
know had a livestream on periscope and I
was talking to press for most of the
morning so I didn't have time to look
into YouTube streaming um there's
something else we're also gonna be doing
on this livestream so let's switch over
to the other camera
so here is cabana and over here is the
number of pandas we've sold 336 pandas
now I wish that map was actually where
the pandas went to but that was kind of
hard to do so that's actually the map of
the shipper users for the last 24 hours
but yeah here we are pointed at cabana
can i zoom out no I can't
hey Peter bench so I have my phone on a
mount I'm using a mount like the same
ones we use for Scheffer maybe I can yes
Kawika van up yeah I need viv back to
hold the camera yo st. bad this'll work
um so everybody check it out if you
haven't seen it here is a comma AI panda
the production pandas will look even
better than this this is a remedy panda
all pandas that are going to be sold
will be red sea pandas are FC pandas
function as phone fast chargers as they
have to GM lands they can plug into your
computer without an extra cable and we
got another Panda sale that's 337 pandas
keep it coming keep on buying pandas and
I will show you some of the stuff that
you can do with a panda and this tool
we've created called Cabana so if you
guys tuned in to my other livestream not
my most recent one where I streamed open
pilot go on a Best Buy
I used the this stuff on the Toyota
Prius so let me just move here to when
we're actually driving I'm so this is my
driving video this was actually captured
with a neo but it looked exactly the
same if you capture with Schiffer
probably even looks better because
phones are better at knitting the camera
Neos are Neos are needed for machine
learning phones I need it to make
good-looking pictures so let's wait for
this to load up here there's a lot of
load on our servers today you know a lot
of people are getting into Khmer I for
the first time I'm so I've already found
a few simple things you can see this is
like the wheel speed plot oh no no
that's not buggy I get gold just loading
yeah those lines on the graph are a
little annoying we'll have to we'll have
to check them out that's perfectly
synced up with where I'm clicking it
should be let me just refresh this page
here you'll see what we get twe hundred
and thirty-eight pandas so I'm also on
Twitter I'm looking at the news and I'm
looking on slack I will also try to look
at this periscope screen so um what
we're seeing here is the video from my
Prius Drive correlated with the messages
that were actually on the Prius canvas
at the same time okay we can we can we
can go to landscape mode let's let's see
what we can do here these phone mounts
this isn't really how phones are meant
to be used I don't think this does this
that I think the the portrait was better
um an update to do what so we will
probably release a firmware update in
the next week that starts to add some of
the so all of the software functionality
like the elm327 emulation mode and the
windows support and the linux driver
support that's all gonna work on Revie
as well support more car as well if you
want to support more cars oh oh the
support more cars with the pandas yeah
so yeah I mean some cars don't expose
that much on the OBD port and will be
constrained to getting sort of the same
things that the typical dongles get
because the manufacturers just didn't
put the data there now you can get
around this by wiring the Panda
correctly into the canvas of your car
it's it's less hard to do than it sounds
and okay here we are so this is a plot
of the wheel speed and the Prius now
let's see what we can find here so I
think this signal is the brake see if
that's true this is the brake amount now
on a Prius you have two kinds of brake
you have the regen bike and you have the
physical brake now I don't like when I'm
clicking here how it's jumping to the
next thing I thought this bug was fixed
let's try refreshing again and see what
we get and we are up to three hundred
and forty one pandas 'im one of the
really cool things about this whole
ecosystem is you're not constrained to
use like when you log the data
it literally logs all of the data from
your car
it doesn't just log what we understand
now so when you log it you can look in
the future if somebody figures out where
a signal is on a car you'll be able to
get access to information on all your
pasture outs as well all right now it
looks fixed looks fixed until I scroll
this
also yeah we need to stand up a bit more
so the demo link has been posted all the
articles and literally we're getting you
know hundreds of hits per minute to this
interface so that's why everything's a
little bit laggy and slow okay so now
you see what's happening when I click
there it's jumping clicks here and then
it jumps let's see if we can uh let's
see if we can go on slack here and get
Andy over here to take a look and
speculate at what might be happening so
this app is written in react it's really
easy to go in and push changes out
seeing a cabana bug on the live stream
yeah so these these these lines are here
which has something to do with it at
times not being synced correctly hey
welcome to the welcome to the
livestreams everybody want to welcome my
aunty
so Andrew here is the one who wrote
cabana and I'll show you the bug mercy
so when I click
here it jumps
I mean I'm cooking here and it's I
thought we fixed this I'm also still
seeing the lines in the graph it doesn't
seem to happen on the first Prius
segment it seems to only happen when I
scroll to the next for your segments we
play a live internal version so I can
use the live internal version on the
periscope and then once we do all these
bug fixes we'll push it out Devon so
yeah this is why this is why we have
teams of people working to make this
stuff stable and great let's go over
here and look at our pan anniversary so
344 keep become more pandas more pandas
more pandas so some of the things we
want to look for in order to make the
Prius supported by open pilot is how the
Prius is actually controlling the brakes
and the steering so this brake packet
here looks to be the actual brake that
the car is doing but it's not
necessarily the command that you send to
the car in order to trigger a braking
event so for that what we have to do is
we'll find in the video so if you guys
remember everybody saw me do this Drive
we can find where the the ACC hit the
brakes
probably this thing yeah right so you
can see that I'm coming to a stop there
see how it's out of sync right now
that's the bug we gotta fix it should be
much better in sync and then what you're
seeing right now if we go over the demo
route could show you how long
we think it is so actually anybody can
go to this URL community.com AI slash
Cabana question mark demo equals one so
this is the demo route from the acura
you'll see on this one when I pull out
the steering angle when I go unlike to
the powertrain data I plot the
transmission speed you'll see it sync up
really well so you see when I click on
this here we're gonna see the car
decelerate at the stop sign you can see
how that's correlated right there we'll
come to it was that not a complete stop
that graph did not touch the access
fortunately the police don't have api's
so we can't report you to the police so
we'd never do anything like that because
we're not terrible people but yeah you
can see coming in first stop and it's
cool we can actually use speed profiles
that look like this in the machine
learning to determine where stop signs
are without having to use any visual
features at all to determine the stop
sign so yeah I mean you expect this here
to be a turn you can see it's a turn
that's the steering angle so we have a
lot of stuff already figured out on the
Acura but there's a few things that we
don't have figured out so there's these
like xxx 4 packet so if you look at this
packet you'll notice that there are no
signals labeled for it this one always
seems to have that value let's highlight
it and create a signal let's plot it and
see if it ever changes nope it looks
very boring maybe there's nothing
interesting on xxx for about xxx one
it's pretty boring as well so you can
kind of see how interesting a packets
gonna be by looking at how red it is
over here in the signal explorer red
means that it's changing so if we look
at these ones down here these are
actually packets from the radar so
they're not filled in on this DBC
because this is the accurate DBC and not
the radar did you say but if I go here
and I plot this signal you'll see that
it's going to correspond to how close
so I am to the car in front of me so let
me just zoom in here and you'll see if
you can see in the video you can see
that car off in the distance there you
can see that we're getting closer to it
I'm sure there's even much better
examples of that yes that's the first
radar the first radar thing usually ends
up being the lead and this route is
available to everybody so you guys can
actually play along with me at home um
so let's say we coming up on a car here
let's move this over and let's see if
that works on the demo route
hmm I'm seeing the same sync issues on
the demo route that I was seeing with
the other route so I just have to wait -
let's fix so there's so much can data on
your car that it's hard to load it into
the memory of the web browser all at
once so that's why we have this slider
here which lets you select the portion
of your route that you're currently
working with needs to only work right
now on the first portion of the route
I'm sure that I'll be fixed up soon
let's see I didn't email so they should
be sure we have public email or
everything else very interesting they're
probably not interesting I usually get
emails for people who want to and I
quote like collaborate on ideas and I'm
like okay so what's the idea I tell them
to be concrete sure if they know what
concrete means because I very rarely get
like a concrete proposal like I want
this or we have this or let's make these
two systems work together it's more like
let's meet for coffee and chat and you
know I would drink way too much coffee
if I took everybody up on those offers
and that wouldn't work I mean any any
sorta and it like VCS complain about
this all the time - it like come to me
with like a real pitch let's check out
the panel's it's a panda huh okay
someone sent me a email with the subject
batteries I think it's interesting do I
know anything about batteries let me
read the email we'll see if it's
interesting while we wait for Andy to
fix that bug we can also check out how
many pandas we've sold how many pandas
you guys think result being sold 350
pandas this is it's pretty exciting it's
a few more than we expected to sell 420
420 would be nice I mean let's let's
let's keep it rolling so if we do manage
to hit 5,000 over the next month we're
gonna give all the early people the
option of a 3d printed case or an
injection-molded case and people after
that we'll all get injection molded
cases I think the 3d printed case looks
pretty nice but the injection molded
case might look a little bit more
professional yeah you know our main goal
for forgetting pandas out there is to
have people start reverse engineering
all the cars in the world let's look at
what sensors are on these cars let's
look at how to control these cars and we
thought about offering the Panda Ultra
Edition which is a Black Panther and the
Panda in a black case and that would be
one hundred eighty eight dollars does it
get you anything better no it doesn't
but it would be one hundred eighty eight
dollars it would be a panda in a black
case if anyone wants to buy one of those
email me I'll sell to you personally
when will drive sharing be available in
Cabana yeah we should work on drive
sharing so right now they're share
features built into shipper but I think
they're limited to like gifts and videos
and small pictures someday someday for
now you just have to let someone log
into your account but um I mean you can
also do it with with api's you can also
do it with the with the ship or API if
you grant if somebody writes an app they
can grant API access using the
shipwright api and that's all on our
github what's the difference to clab car
I don't know what a clap car is on
Twitter here this is somebody I should
show you guys the Twitter when I mean in
with Twitter okay can I just do that
here there we go
what is the difference to cloud car
let's see what a cloud car is I should
cause my email to have secrets and that
doesn't receive it fits Google News
that's my slack with Andy if I fix it
months
LabCorp well that's expensive 99 euros
see so my problem with all these are
their dongles is that they don't tell
you what it's an L like like the elves
do not let you read all of the data off
of the canvas they also don't tell you
what port oh wow oh wow we just sold
five more pandas they don't tell you
what actual our connections there are on
the on the obd-ii port obedia and we say
ODB it sounds better but it's not it's
obd so we actually show you exactly
what's exposed on our dongle right here
so we show that we have the three cam
buses to LAN or Kaline buses and then
1gm land oh and that's like what it you
know the actual electrical Hardware
interface is this pin is another ground
they're tied together on production
pandas this pin is not really used it's
used on some cars as like a special
clear mode but our panel doesn't connect
anything to that and this interface we
call the J shade interface no modern
cars really have it so we just we just
don't made it at it was it was extra
worthless hardware this is what really
lets you get access to light so every
one of these canvases plus the GM LAN is
on like the Chevy Volt in the Chevy Volt
for example so we want to make sure you
can get access to really all this stuff
about your car like can three on the on
the on the vault is just a battery can
it talks about the status of each
battery in the Prius in the in the vault
the Prius only has the amount of two
kids I don't know but we wired in the
Prius we actually wired the Panda in two
I love Twitter we wired the Panda into
the
the same place that the stock camera
system connects to so if you watch that
video I'm going back to my driving
explorer here and maybe things will
start working these are my drives of the
Prius let's put this one here
what's up from India 357 penis 357
slowly Perlas oh I remember what I did I
had hit that window let's go back here
don't open to many cabanas it is a
pretty intensive web app which vehicles
are we most interested in next the more
people have the vehicle the more
interested we are in it newer vehicles
have more sensors but yeah so let's
let's sex out of this one here and let's
go back to this this pretty strap here
yeah it doesn't it just seemed to be a
problem only with this when I select
things that are not the first andis type
unless you guys decide
can't repro with the Prius rap I recode
with a demo Wow yeah
maybe I'll wait doesn't seem to always
do it so maybe I have to wait for the
first part to finish loading let's try
that so let's just refresh here we'll
wait for the first part to fully load in
this might be a problem with just
zeroing your time then also check out
where our shifty users are on this map
here so we have a lot of our ship users
in America someone down there and the
Dominican Republic and this is just shit
for users in the last 24 hours
scattered all over Europe
yeah Southeast Asia
either look over there cool so let me
scroll this now and see if it doesn't
happen
oh yeah
the wines are gone but the junkies are
no reverse-engineering is a slow slow
process happening even after season yeah
when I click here it shouldn't like jump
there like that maybe this is it's not
even sync to operate so if you see like
when I click here that's actually at the
peak speed of the car it just looks like
the line is in the wrong place
yeah I think we can make this work for
versatility right but we really want
these tools to be a a wonderful
experience to use as a program that I
used for a lot of binary reverse
engineering called Ida and it really is
it's a wonderful program to use and you
can just spend hours exploring all the
stuff that's in a it's in a binary
so yes you click here it does that click
here so yeah wherever I click is where
it's actually going so you can make that
work that looks like where I changed
lanes and we get affirm that by turning
on the steering angle plot
oh snap
365 pandas I do promise that these bugs
will be fixed long long before you get
your panda they'll even be fixed tonight
because I want to start dating in and
reverse engineering the Prius I bought I
bought some cool stuff for the Prius
about this thing here is a USB monitor
so we're not gonna put the big touch
panel in the Prius we're just gonna put
this guy in there I also have a gaming
PC coming in the mail today anylock yeah
alright I'll show you what I'm doing
maybe I'm maybe I'm clicking wrong with
this let me put this monitor away it
comes with like a little carrying case -
it's cute
what Asus thing
so I love it Prius route you're very
fresh um so I can't even wait it still
happens
so now that I'm loaded I drag this over
to here I mean a lot of times
bugs are caused by people clicking wrong
yeah 368 pandas um if you have a panda
can others go through the data so know
if you have a panda that data we don't
share your data with anybody um we could
people are asking a lot for that feature
if they want to be able to share their
routes tribest make it happen okay cool
so now it's just just being slow no well
know sometimes people click wrong you
know I mean sometimes it's broken but
sometimes people click crop Faculty's
fast
oh come on crowd
and he disappears when the bug happens
he's not here we go
save your GBC progress I did I already
saved it come in today github so if you
see cabana integrates with the open DBC
project 370 pandas um cabana integrates
with the opened DBC project so I can
load my DB C's here and I can fork it to
my own github so then if I want to save
my progress I can just go to save DBC
and notice how its forked to geo hot
open DBC I can just click commit to
github and now it's shared on my github
okay
so Andy sent me a link to an internal
build of Cabana so fast will make the
real one faster we'll stand by our
caching server in front of the web page
so let me just log in to this can I log
into this with github is that gonna work
no oh
because it won't redirect me the right
URL okay okay so no DBC but let's see if
the bugs that I could save to a text
file so you don't have to save your DBC
is to open DV city you can save them to
text files so I like scroll to here
speed now you know where that would be
I just called my get up here go to my
personal gate on github geo hot open BBC
there we can look in these DBC file so
DBC is kind of the industry standard
file for car or specifications a shale
is sensors are in your car so these are
the wheel sensors for my car so you can
see their own packet 170 which i think
is a a and hex what's not doing it now
oh you made a change
oh you made all you fix the bug alright
alright alright well the uh oh this is
this is exciting
um and yeah I mean I think we'll leave
it up for today but I think we'll make
this go away on the other production
ones okay cool the way the bug is fixed
thank you all right all right it's fixed
um so yeah we'll get that we'll get that
out what's great about it being a web
app you're we're on the periscope you
want to join it you want to say hi to
the periscope
periscope can they can they hear you I
don't know hey yeah Cabana Cabana is a
web app yeah wow that's true that we had
an internal betting pool for how many
pandas we were gonna sell and if you bet
on a lot of pant as you want
a cow that we have bug-free open DBC
that bug-free you'll always be bugs bugs
are bugs are on going forever struggle
um so yeah you just paste your DBC in
here so it's gonna raw select all copy
you go here paste continue editing from
paste oh I see very high quality okay
cool so now we have those signals we
were working with before and look look
look the lines are gone and now when I
click on the graph notice how it
actually goes to the correct place so
let's try to find where where the
breaking is happening so the car had the
adaptive cruise control on I believe at
this point you guys probably watch this
video how does a t-mobile sync up differ
from a t-mobile sync up drive device do
you think t-mobile would ever make an
interface that looks like this I'm sure
the t-mobile Drive device tells you how
many miles you drove maybe so much I
sure but it's so much from a screenshot
of that so how does it differ it gives
you a whole lot more access to your car
than any other reasonably priced dongle
that had come before in the past if you
wanted this kind of access you were
buying things from companies like
cabassa
for for $2000 this competes with really
the dongles that the manufacturers use
not the consumer grade ones ok cool so
let's assume that this braking event
here so you can see it's a braking event
because we lose a lot of speed quickly
let's assume that this braking event
here was caused by the ACC being
triggered right so I have down here a
new message one one of these is ah here
we go see that this one here track is
zero is the so these you can see that
some of these are zeros and some of
these are ones zeros are on the first
canvas and ones are on the second canvas
so I can go down here to this track is
zero one and I can plot the longitudinal
distance to the car in front of me and
this makes a lot of sense you'll see
that as I approach the car
well I think actually the target changes
there so I think here this is a packet
from the radar in the Prius so you can
see that here it's tracking this car
over on the left and then once that car
leaves like the cone of influence it
switches over to this car and you can
see that kind of parabolic parabolic
braking this by the way is not how you
want to really do it this was kind of an
uncomfortable braking event I talked
about this during the last livestream
but but a limo driver school they tell
you be hard on the brakes at first and
then soften up as time goes on okay so
we have our wheel speed we have our
longitudinal distance let's take a look
here at the brake package so to confirm
that this actually is the brake pedal I
would expect oh it's not really the
brake pedal because I didn't press the
brake pedal this was done automatically
by the cruise control so I think we
should rename this to something that
makes more sense maybe this one will
call brake Bri J you know when you're
reverse engineering you just take a lot
of guesses at names and then you make it
better and better over time and this is
gonna be an ongoing project and we'll
call this one brake mount you can see
this is all reactive that version is
deployed live now cool the bug is
already fixed for everybody that was
that was quick let's say thank you Andy
on slack what do you say thanks because
it'd be stupid if I said thank you Andy
on the slack Channel that's a DM Jam
let's check the Twitter I love Twitter
cool okay so back to finding the break
packet so it's possible that one of
these things was actually the trigger
for the break though doubtful I'm one
way we could test this as we could find
another place in the route that I know I
braked without using the adaptive cruise
control for now let's just unplug these
and I know that it's not gonna be on the
radar can so I can use this filter here
how am I going to say 0 : is the filter
so it has to be one of these packets
let's see if we can find one that
changes right yeah
how's kind of tempting this new message
one over here and this signal here let's
try plotting that seeing what we get
okay well there's a lot of a lot of
bouncing around zero that's probably
because it's actually a it's signed
maybe it's signed 102 zero just has a
special meaning interesting I wonder I
don't know what that signal is doesn't
have any ideas don't think it's the
signal that actually triggers the break
though I might have also kind of lined
it up long so let me try going there
okay so that looks a whole lot more
sensible notice how this graph really
improved a lot um this looks more like
to me is probably something like an
accelerometer right so this is Excel or
on excel um and then when you are
talking in a car frame of a car the car
travels forward in the X direction and
then Y is to the left so I'm gonna call
this excel X so I missed that question
haven't been good at keeping up with the
periscope because the things a little
bit behind what my eyes are looking when
I'm on the screen yes and that looks
like that just looks like an
accelerometer you know what this one's
probably Excel Y to Y value so we can
actually confirm if that's correct so
that's a lot of noise I don't look at
how small the numbers are but we can
confirm if that's correct by plotting it
with the steering angle and finding a
place in the segment where we actually
steer the car so that's Excel ax so
that's breaking of the car but do we
have a place where we steer here was
first year still a lot and you reduced
you a lot okay maybe that's not Excel
why
maybe that's Excel Z what was another
thing in there but yeah it could just be
like acceleration in the Z direction but
that's a whole lot harder to test so
let's shift record the phone
accelerometer it does um we should make
it so you can graph that as well that
would be a good idea we can then just
correspond them you know very simply
I spell that right these Google things
to see if I spelled it right - I spent -
right okay but that's not we're looking
for we are looking for the brakes so
let's just remove that signal there or
get on plot hold this and let's go back
to our good breaking event so this is
our good braking event here so the radar
is gone let's so you can go a little bit
before the braking events let's see if
we can figure out what changes look over
here
figure out what changes in order to
trigger that these packets look like
they become active but that might just
be the speed over here no it's not it's
not I always plot bad and you can tell
it it's assigned value so let's um let's
make it signed
[Music]
hmm okay that looks like something maybe
this is the signal that controls the
brakes a good kind of way that I found
to do this was let's look at what else
is in this same packet maybe we can
guess so another thing that we're gonna
have soon as well is live cabana mode um
so you're not going to need to upload
your route to shiver wait and then
process it in the past you'll be able to
do this all locally in real time we're
gonna write some JavaScript code using
web USB which will just let you plug
your panda into your computer go to
cabanaconde i and then run it right
there kind of like if you guys have used
like my ether wallet you know it's a
JavaScript based if you're in wallet but
it can talk to your physical like
cryptocurrency like just ledger so it's
the same kind of thing okay so these
signals might be something to do with
the brakes they're kind of interesting
oh well okay so the thing that we're
gonna have to check and compare it to is
other places where the brakes are used
we want to find the one where it was
autonomous on the brakes and I don't
think it's this because this just looks
like it correlates with that looks like
it correlates with the acceleration
there right like so yeah I don't really
know what this signal is just offhand
but it's not what we're looking for I
can tell you that
it's are tempting because they're quiet
and then they come alive that stuff when
the breaking happens yes panda can read
and write to the canvas but when it's
used with shiver it's only it's only
using a rebuilding mode shiver doesn't
write to your canvas but if you're using
it in like most like Linux socket can or
using it with something like open pilot
yeah that's gonna write to your canvas
you know there's a certain amount of
caution to exercise what you're writing
but it's it's not it's not like you're
gonna mess something up probably the
first time you do it do urge you to be
careful but at least when it's in
read-only mode you know that you cannot
mess anything up is a 2011 Acura TSX
compatible with Panda to take control of
the gas steering in breaks I don't know
I don't have that time but if you watch
what we do for the Prius you can use the
same procedure to determine if you can
if your car has adaptive cruise control
and Lane keep assist like if you've seen
the car hit the brakes or move the
steering wheel then there's a good bet
that you'll be able to do with Panda um
if you've never seen the car move the
steering wheel by itself then they
probably can't
all right so let's focus on what we're
doing all the Twitter notifications are
so tempting I love Twitter
so you see what I'm looking for here I'm
looking for a signal that's gonna light
up right when that breaking event starts
so now there are there are worse
possibilities it is remotely possible so
these signals you notice they have a lot
less frequency than these signals and
this is the count that happened in the
three minute chunk that I'm currently
looking at so it's probably one of these
more frequent signals than breaks
usually update pretty fast yeah so the
common neo the board that's in the
common neo is kind of like a rev one of
the Panda I'm finding gas break events
is actually really easy you can get
finding the speed on a car it's just
usually you know trivial you can just
spot it because it's Carlino with the
video but yeah we should be plotting we
can get GPS speed we got accelerometer
and we can put all that data in the same
format that you see here and you'll be
able to graph it coming soon to cabana
yes so and you know actually if you have
a neo right now you can go on the day I
think Explorer and you can use Cabana
and you can do what I'm doing right here
come on your own drives panda is kind of
just like the v2 of that hardware if you
put your car into a lower gear the brake
does push in automatically you're
talking about like like engine braking
or actual like braking so even if the
car can't move the steering wheel or
brakes there's a possibility you'll be
able to control it but it gets it gets
tricky and fancy at that point you might
need to like change the firmware that's
running on your car it is it is doable
but um you know be careful
this is the break it's it's kind of nice
that the break that the computerized
brake shows up on the same graph as the
human brake on the Honda this isn't the
case then it just doesn't break hold for
you that's pretty smooth pretty cold
let's confirm that that's actually the
brake all the time even when I'm using
it
yeah the ACC was not driving there I was
driving there so that is a human brake
event and it's on the same axis I'm
gonna break hold see that you see that
see that linear see that linear up right
there that feels super uncomfortable you
want to brake hard in the beginning
which it did but then it looked like
whatever its controller was wasn't well
calibrated and had this linear op not to
be fair that's after the car looks stops
so maybe it maybe it's this because I
remember the brake event feeling really
uncomfortable
oh okay so I'm not actually on the
remote one I'm on Andy's local one and
do you erase my DBC and said you
refreshed it yeah also ejected the rila
no eyes I didn't have anything really
figured out anyway that was the leader
was not at the driving school so let's
go in here to route we were looking at
and let's see if that bug fix actually
did go live well so that doesn't
actually happen on the real one that's
just cuz it's in our reaction debugging
mode oh man it feels slow on the server
big proxy gonna put a big proxy
yes yeah of course you can talk it with
iPhone on the App Store shiver Panda iOS
support went out this morning or maybe
yesterday we tried to get it expedited
to Apple but
Apple didn't expedite it for us yeah
that will that will go out soon Andy the
bugs still there did I not refresh well
I spammed refresh a lot that's a good
idea say oh yeah no it's it's coming iOS
soon let me tell you pad stop
oh it's fixed yeah I just found
refreshed oh no no no it's still
happening how do I force for control was
a reload the cache does this disable
writing to the cache for only reading
from the cache
I miss Cassius they make things fast
it's broken charlie yeah why are you so
sure about that I disabled cash okay
inspect right click on refresh Oh hard
reload oh look at that look at that look
at these people come and go do it is
that kind of do it though I don't I
don't feel like it's the same show you
deployed
can we put out a little version my
Cabana no I see in the bog let's check
it out while we wait I love Twitter
make sure we actually this is this was
that one today right how does it look
you bought a panda - I think it'll work
on Mazdas maybe
reverse engineering requires a lot of
patience
well we will stick a a version on cabana
so you'll be able to know when which
which which version you are or 10 to 20
employees that's true should we update
our CrunchBase I don't know how to do
that can we do that do you guys do that
know how it works
we're gonna get to we're gonna get to
400 pandas probably on this stream and
then we'll do the Panda telephone thing
where we all chant ill we get to 404 you
guys can buy a panda and watch a number
go up on the livestream chopin to
counter so we are at 377 right now maybe
I'll just leave the livestream running
point it at the Panda counter so you
guys can buy pandas and watch it go up
by app and watch it go up can we also
depend affirm reverse monk shivers yeah
we're gonna get better about the
shippers Panda firmware management I
think you like 30 pandas um oh by the
way if anyone is watching who's
interested we have some bulk pricing for
pandas too if you want to be a panda
resell air yeah we did have we did have
someone come in and buy it by 10 pandas
last minute will the price increase yeah
maybe I don't know say no I think it'll
be it for a while we might be it might
be 88 for the pre-orders and then 99 we
put it on amazon coupon code pandas yeah
I think I think we will send out maybe
we could send coupon codes do people
have a lot of californica that's a good
idea yeah already 30km sales are doing
we're doing quite well I'm happy with
how many we sold so our hope was to sell
a thousand over the month but this rate
even with this is this is doubling my
projections so I think we'll end up
selling 2011 there's some chance we'll
get to 5,000 we're gonna be doing some
live streams are gonna be showing off
more and more panda features as they
come in what's the margin on
Panda less hi than you might think
especially at this scale we are making
some amount of money but you know it's
more about about getting this getting
really high quality car interface
hardware out there because everything
will do in the future depends on it you
know this is the standard VC model kind
of stuff right yeah okay are we fixed or
can I use the other one and not have it
refresh on me no he's gone right click
Oh empty cache and hard reload wow that
sounds even better
deployed version works in your machine
no no no no so I found a new button that
might have actually fixed that I found
the right click and empty cache and a
hard reload button
yeah it's fixed yeah Chrome loves
caching typical developer andis great
man we wouldn't have we wouldn't have
these great tools no man if you guys
can't revote I don't know it's working
now it's better now so we know the empty
cache and refresh buttons which is
pretty cool right 377 are we gonna get
to 400 we get to 400 pandas works for me
won't fix it's got to work for me you
know how things work around here
all right so let's go back to where we
were we labeled that accelerometer but
it's gone we'll never see that again now
I remember what it was as we can add in
those signals real fast again so if you
remember they were sine signals are you
designer too you should be able to not
have to click like edit and save you
should be able to just don't click on
these things so I'm gonna call this one
Excel Z all well I can't press ENTER to
save all right we're gonna order to make
that work it is going to get much better
but actually if you use the actual tools
that cost a lot of money to do this oh
they're they're way worse and cabaña of
course is free for people who have
pandas or Neos you don't even have to
give us any money to use cabana you
could just build Neil you know just
camera to landscape um I tried that and
it didn't work well it was it was it was
just
pointing the results were disappointing
because our Cabana probably not is
falling not maybe he'll think about it
look better on your screens when I when
I rotate please do it is it is it is a
reactor well think about we don't want
dongle makers taking our great software
and putting it in crappy dongles all
right all right landscape but you guys
really want that landscape ions Geoff
I'm gonna stand this up maybe this will
work no no that did not work oh you know
what I think what'll work is if we spin
this around so I'm just using a mount
like one of the chipper mounts from my
phone you can actually read the words
okay
okay what's gonna make this work its
first we go like this then if you don't
like my keyboard hey that's an expensive
keyboard man cost more than a panda
alright landscape is upside down and
only looking at the keyboard is that
better guys yeah okay that's chai okay
this this isn't working
you know this is why I'll never be a
YouTube celebrity because I'm not good
at pointing cameras of things I could
make it on YouTube oh okay oh you know
what we have oh I know what we have
oh this is a good amount to system I
audio tool which you can buy from our
shipper page and we get with all money
so it's a good deal um cool I should get
a head mount ya know and I'm killing you
I know I know all right
is that better don't know how these
hearts work something you guys are happy
with what I'm doing my audio is what I
have in my STI yeah it's pretty good
maybe we can even even edit this to put
the Panda number down here
so we can put that Panda sales right
save alright 377 pandas and now I'm
feeling I'm feeling a little off alright
alright it's better alright cool I'm
glad you guys like it
alright so let's go back to finding
signals the bugs are fixed everything
takes time you know that's something
that's something you learn starting a
company you think you're gonna you think
you can I saw self-driving cars in a
year know some part of my brain maybe
thought that but the truth is everything
takes a long time shipping is free
shipping is for you anywhere in the
world mostly because I didn't want to
have to deal with charging for shipping
so you know if you're in the u.s. you
are amortizing the shipping costs for
those in Indian Switzerland and stuff
but you know hey again it's really just
about getting the hardware out there I
mean about about these I always say like
like people are asking me about Baidu
and help I do stole are the Android of
self-driving cars line like yeah I mean
that's what you know they but the
dinner-hour competition the battle is
between open and closed so yeah you know
the more of these we get out there the
more open hopefully cars will become
okay
so let's rename this message also had
auto population of the size of these
messages cuz actually think this might
be a shorter message I mean we know how
big the messages are on the bus yeah
most of this is just trial and error
just kind of guessing and drawing plots
and being like hmm
does that look right like I don't know I
don't know what this is so let's just
draw a graph of it and let's say it's
very noisy well that's probably because
these aren't all the same signal or
maybe just is that noisy oh no there's
other things you can tweak too like the
nd in this so actually we have it if you
drag it like this it's little-endian and
then you drag it the other way it's big
endian you can also change that nd in
this right here but let's remove those
signals those don't look like anything
good so yeah I mean things just a lot of
fun to play with you can sit here and
just look through all the signals in
your car and take good guesses of what
they might be but we are on a mission to
find how the cards the break so there is
some chance that it actually isn't on
here and it's hidden in some other bus
of the car we didn't log all the buses
in the car so I'm gonna have to get to
with by sending the right sort of
commands to bypass gateways now one of
the interesting things that panda is
going to offer is being able to be used
with these these up I don't think this
is refreshing being able to be used with
these windows tools that you can get
from the manufacturer so you can go to
Honda tech infocomm you can go to Toyota
tech info and you can find all of the
these manufacturer tools which let you
act as your car in there they're mostly
for mechanics but um they'll be able to
actually use those with pandas and not
have to buy the $1500 Bosch interface
which is pretty cool I'll put that
filter back on 379 come on let's get the
400 guys we can do a Florida baños at
some point let's chat as a subject of an
email 1200 by Monday that would be nice
I got distracted by email what was what
was your question say it again I'll
answer
what is the best that's kind of
interesting
so please like signals on a car what are
they yeah the bbc's that you create in
cabana can definitely be used by open
pilot actually if you go to the open
pilot really file you'll find that it's
actually using this open DBC project
here an open DBC is the same project
that Cabana interfaces with when you go
to load DBC and save DBC so these can
directly be used in open pilot if you
find the right messages 3:81 come on
let's keep it going four hundred four
hundred pandas what do they do on
telephones is the Panda eventually gonna
replace the Neo well the Panda can't
replace the Neo um the Neo is a hardware
that runs our self-driving software but
there is a board inside of the Neo and
yeah I mean you can already replace that
board with a panda we have this board
called the giant panda it's in the Neo
repository our automakers gonna encrypt
the can bus I get this question all the
time okay look Apple tried for years to
stop jailbreaking they eventually
succeeded but it took them almost 10
years and that's Apple do you really
think there's any way the automakers can
keep me out by the way you offer your
the right to do this stuff - there's a
bunch of bills in Congress like right to
repair a DMCA on cars I mean you know if
you're if you're adding functionality or
you're repairing functionality on your
car it's well within your rights we will
be at 600 by tomorrow morning I could
see that I could see that yeah we take
it would take them something in ten
years if it's even sort of possible I
mean can you know a can message is only
eight bytes or this is think old can FD
which can do more bytes but that's
that's a long way away - right
pressing on the brakes where are we
pressing on the brakes this one looks
like it's changing but it's changing
slowly this is something but it doesn't
look like the brakes that signals kind
of interesting
ah this could be the signal watch
so what this could be is kind of a no no
no no no no this looks more like maybe
what's happening with the suspension of
the car maybe the tilt angle of the car
right as you think about how the car is
gonna come tilt audio will help you log
things uh yeah I mean it will probably
will probably add that to neo and
Scheffer at some point it'll be very
much opt-in audio and front cameras are
very sensitive stuff we're never gonna
log those by default but ya know I mean
it would be a helpful tool to reverse
engineer if you could record the audio
as well 384 guys alright so I don't know
what this is either but it's like
fascinating signals in this car probably
not that one
so maybe we'll just name this one tilt
shit maybe
cabana opensource uh we'll see we'll
think about it
maybe the land oh you mean like the
derivative I shouldn't call this tilt
shit maybe I should call it something
better than that
those things just seen all over the
place too
I mean they might be part of it maybe
this is just a super big signal
does this work with 32-bit signals maybe
it doesn't work with 32-bit signals okay
all right well that's the list of bugs
we shouldn't call it till shit maybe
I'll call it just been shit that is not
how you sell suspension that's why to be
a pooh-bah thanks google sauce pen oh it
is hazel suspension
we not what we're looking for
spoons are active a halt
okay look at this packet this packet
starts to do stuff once the breaking
starts so you see it's nothing
oh okay I think we're onto something
notice how it's nothing glitches a
little there and then there we go now it
starts breaking okay and that looks like
it's going down with the yeah dude is
this the one we found before let's make
that that's clearly signed so is that is
that the brake actuation command
so this makes sense breaking Forsman
break is fairly linear with maybe not
check out this one
now imagine doing all of this stuff
without cabana
it was super tedious and annoying like
every one of those things that I'm doing
now with a couple mouse clicks would
take you know you'd have to plot that in
Python you'd have to write Python code
in a notebook
hello I'm watching you you have to plot
that in a notebook and it would take a
lot of time all right so this definitely
has to do with the breaks
I think this last thing here is some
sort of checksum but I don't really know
how it works
just call Jackson
I know the Honda checksums work so one
thing I actually like about this car
less than the Honda is the Honda doesn't
just have a check so it has a counter
and counters are really cool to make
sure that your interface is not
replaying stale data um this car doesn't
look like it has that so you can
actually go in here if you want like
expand one message you can expand it you
can see what the actual values of these
are at anytime I can throw those on the
plot real quick close that off at play
okay so that definitely has to do with
the brakes so the way these messages
work is they usually come from one of
the one of the modules of the car so
there's a chance this is a great command
and this is break actual ah
so now let's zoom out and see if there's
any way that's correct because we should
not see that wherever we know we see it
here - it's very clean now wait again
this is where I was before
how does this go up when the car
accelerates oh I might be really dumb
you know with this no but how come it
totally drops out there this stuff
almost looks like it could be like rpm
or something see what makes this car
extra tricky is the fact that it's a
hybrid
I've never reverse engineered a hybrid
before so this has a gas motor and an
electric motor I'm doing doing different
things let's see all right well those
are not what we're looking for
387 let's get to 400 you guys
you know the hybrid nests of this car
makes it kind of tricky get better about
this you know maybe I just need to read
up more on hybrids um you know what
let's do a little reading um so one of
the ways that I've found to learn things
about cars is you can go sign up on tech
info Toyota comm a secret password check
slack
yeah maybe the best way to talk to me is
on slack because I can actually look
over at that at that monitor would this
help you oh oh I forgot about this
deke Wow somebody did a communicating
with the toyota prius
ho-ho this is exciting all you slack
bros you guys are great um alright
alright we got somewhere to start let me
just make this focus up here ok so we
have this PDF communicating with the
toyota prius decoding the can protocol
[Music]
alright yeah so they're wrong this is
actually only a 500k bus you know
there's also the Charlie Miller paper
and we can learn stuff from they're not
telling me okay okay
alright here we got some numbers so
these numbers are supposed to correspond
to these numbers here it doesn't even
look like we have the same signal so I'm
looking for like the gas pedal position
one or the steering one no no they've
changed it this prius is too new it's
too new so you see these IDs here I'm
searching for them in the data and the
ID by the way is that like number next
to the zero it's - no it's - do you know
what you know where I have a resource
I'm coming I Bounty's see this one
here we go speedometer toyou don't see
if this one matches up today so I put
pages but they don't actually put the
page number so by the way yeah these
graphics were taken from this Toyota T
is thing okay
so this breaking what's fine me let's
start with the easy ones like if the
speed doesn't match up then it's not
gonna be here speedometer Toyota is on
zero B for now I don't have a zero B for
oh yes I do I do have a zero before all
this look sightings okay so they're
claiming that the first they're claiming
that it's gonna oh this is really
exciting I think this matches right so I
just move this over a little bit
knows what I want okay so if this is
correct
we're gonna put this you can see let's
put it over here you have a question
about your fur before using they tell
you question it's okay so these look
like they're all zeros that's true this
is a counter according to the chart
another thing so yeah look it's a
counter now it doesn't look like it
iterates constantly looks like it
aerates based on speed okay it looks
like they didn't maybe do the best job
of reverse engineering themselves but it
I mean it is a counter maybe it's I mean
that's like the odometer itself right so
let's not call it counter let's call it
odometer or maybe maybe the better word
is even encoder you know just like it's
like a shaft encoder this one I agree
with them that it's the checksum oh now
we're finally breaking some stuff open
so yeah just search for it's actually on
our Bounty's page if you want to get
access to this resource as well will I
do this so yeah it's an encoder and it
depends on your speed like that's how
depends how what like the slope of these
lines alright so they're claiming that
this is the speed that's true and maybe
they talk also about where the speed
comes from yes that's the speed look how
well it matches up okay we are getting
somewhere this is very exciting you guys
this is the most exciting part of this
periscope yeah this will even be more
exciting than when we solve four hundred
panelists so what is this okay so this
is man you know I bet you the guys who
wrote this paper wish they had this tool
[Music]
because they did the painful old-school
way all right so do they talk about
where so this is the speedometer speed
so that usually comes from
the transmission and then the wheel
speeds or the packet that goes to the
braking system but okay so the
speedometer is kind of more let's see if
the braking packet matches up so they're
saying it's two eight three look at this
two a three see if it's actually the
same pack
it actually looks like it does nothing
this packet does nothing okay so you
know what they call that they call that
fake news pack it is fake news more
comma points will the raw data know the
raw data is not available to the public
yes I'm still images may be available in
comic colouring that's definitely true
what's the guarantee that comma will be
open I mean never get a guarantee of
anything in a life the incentive well
you get a great dashcam
you earned comma points you're getting
cloud storage for free like to be honest
it's costing us money to store your data
and your training open palette come it's
a company you've a promise that the
driving model will stay public well we
talked a lot about what our I'm reading
off the slack by the way thought I
shouldn't do this on the periscope do
you have a promise the driving model
will stay public we published pretty
openly what our what our model is gonna
be what our monetization and what our
what our plans are as a company okay
so what's interesting is even though
this packet is empty right now
this document is referring to it as the
pre-collision system so let me create
this signal and we'll call it free
collision because even though it doesn't
send anything it might be different from
the adaptive cruise control we may be
able to spoof this packet and hit the
brakes of the car so that is a good
thing to know acceleration acceleration
could be directly linked to a single can
ID so they're talking about this is 37
no now they've lost us we don't have a
37 no 37
ah 266 and this is supposed to be the
steering packets oh yes okay I think
this is how we control steering nearing
control oh okay you know what we're
gonna do
there's actually a place in this video
where we use the intelligent self
parking system all the way at the end so
let's scroll over to that next that out
oh this is this is this is very exciting
oh look what's happening again look it's
it's glitching again I guess I scrolled
way too far
Charlie Miller's paper matches what
we're seeing on our Frias Sonic 392
somebody hand us let's get the 400
all right so let's plot this what are
they claiming these things are flag and
angle nature well yeah they have they
have like a weird biting coating of this
stuff in terms of nipple and minor angle
so actually what this should be is we
can actually remove this signal they're
saying this is the angle so this is
where the self-parking here happens it
looks like that fog is rearing its head
again with some multiple in the graph
393 let's keep it going let's keep it
going okay
let's scroll back to here hopefully the
bug will go away and we can test it over
here
alright let's save this DBC to github
and I'm gonna refresh this page and
we're gonna look seriously into why this
keeps happening you don't actually have
to save the DBC if you refresh it and go
away it's saved in local storage web
browser I have a signals all over the
place
I don't really think they have it right
it might have something to do with
steering but seven more and you could
experience all the joys of reverse
engineering your car like I'm doing
right now so okay that is when I turn
the wheel so it's certainly related to
the steering angle but I think that they
went too far I think maybe it's that
maybe not that all right it's just that
one there oh no I'm dumb I'm dumb look
at what I'm doing guys so you see how
this is a and a n that's actually only
twelve bits I was looking at 24 bits so
that's in the wrong place there right
I'm wrong remove its dude okay this is
our auto endianness detectives just go
in there like that go in there like that
go in there like that oh this is fun
what I love and things just work okay so
that is a flag and that says whether the
intelligent Park Assist system is
enabled and this is an angle claim does
that no that's too much
and then we want this to be a signed
thing because there's a better side
because you can turn this chair a little
both ways all right oh that's a clean
signal take a look at that so that's
gonna be a steering to the left and this
is gonna be a steering to the right I
assume my mother just texted me she said
great press excited I hope you sell 1
million we could we can make a lot of
pandas if we actually sold 1 million I
would I would get on the next flight to
China and we would really have to well
ramp some things up yo you see the Panda
numbers we are at 394 we're right now on
a live stream with the good folks at
periscope reverse engineering the
printer watching that number go up right
so yeah viv owes you $10 I already pay
daddy his $5 hey hey my my moderate
probability chart where I was a market
maker and it was hard for me to lose I
know right
no no I mean it's it's it's it's double
what we predicted yeah so we'll see how
that we'll see how that continues out
yeah yeah the articles have been good
then I've been fans all right cool
so let's see now let's plot this flag
right so this flag never changes but it
should according to this document be set
to 3 when I pass is enabled oh now we're
getting now we're getting all the emails
from the VCS all the VCS only give us
money after they read the articles we
tell the VCS know
that's about that we need to fix too I
mean it's not a huge bug but we should
make the things all look at this all old
guys will you look at this will you look
at this lot of this thing here you see
that three that means we're in I pass
mode Charlie Miller you did a great job
with this reverse engineering thank you
very much for helping us out in creating
this DBC file and watch the cars about
to park itself
and it's about to command to angle and
that is what's gonna let us drive the
Prius around the city so I didn't find
the brake packet but I did with some
great help find the steering control
packet and can i should'a plan to
purchase now hey what if I had it no
these are low tier pcs I mean some of
them are some of them are right but like
you know you don't want you want people
are gonna add value in your company this
is why I always talk about ICO stuff you
know who's gonna add more value to the
crowd I think it's really aligned with
value creation more so than the
traditional VC model which maybe makes a
few people rich we do crowd make a lot
of people rich well don't apply to shark
tank that's that's that's the lowest of
the low if an idea is fun shark tank you
know I mean there's taking money from
the Crown Prince of Dubai and then I
think even below that there's our shark
tank
oh yeah so look at this look at this
this is as the wheel turn so that's the
steering control packet this thing is
amazing
although the smoke right so according to
this documentation although the servo
packet has been reversed the car still
requires the current year to be reverse
oh oh oh this is the current year can I
do okay cool cool oh man these people
are great okay so that's what I called
suspension maybe shows you how much I
know okay it's it's car movement kind of
stuff
data v1v variably used to designate
state of the car state of the petals PD
is car movement gr is gear and counter
okay so I'm wrong that's not a signal
the state of petals let's let's plot
that PE thing car moving it's that here
it's an 8-bit signal and it's signed lot
about this
car movement okay so this is car moving
forward and this is braking or reverse
no I guess that's breaking okay so they
call this car move I'm gonna stop
calling it suspension we're gonna call
it is usually like maybe the body
packets of the car I don't really know
here
[Music]
so that's the car movement and then
these next things are the gear encounter
so this is the gear the car is in this
is counter and this here is the checksum
sure figure I can keep these checks up
soon or start sending these messages
alright so you can see that yeah so they
say three is drive and one is reverse so
we should actually you can set that kind
of stuff at DBC and then one is park so
you can see that I'm in drive here
you're gonna need to plot maybe that no
we're gonna put that let's just pluck
our movement all right so you can see
that I go into reverse here back and
drive for a little bit here and then
with Carson Park right look at this
license to car manufactures license the
car manufacturers is a scam hey maybe
someday I don't want to think about it
really is like a license deal I want to
think about it more like Sirius
satellite radio they include the
hardware with their car and will provide
the software the software is free
I mean it's offers a service so you you
know install the software and then open
pilot has a monthly subscription fee
once it gets really good so we can label
this one here too this thing counts when
moving that doesn't even really seem
like a useful signal I'm not even a
label Ellen oh this is exciting
let's save our newly found information
to my github so by the way this is going
live right now on my github if you go to
github geo hot
you think I have too many embarrassing
private repos they do but yeah you'll
see that this is going right now to
Toyota Prius with the open D BC updates
there you can see the pull requests that
are automatically being created when I
click pull to github and you can see
that this is that a gear package that we
just reverse engineered in the in the
DBC file form so it's pretty cool sweet
let's see what else we have there's
another speed packet okay so this is the
packet responsible for reporting speed
to the system and that does the steering
lock out I already have that one figured
out I just gonna call it speed guess
they already posted it in their paper so
yeah you see that the speed is not
forward or negative it's not positive or
negative it just go negative in Reverse
because of how the wheel encoders work
they're not quadrature colors they're
just normal encoders 398 folks 398 ok so
then they talk about what packets they
said oh then there's also an LK a packet
exciting exciting I don't so you can get
that one this is the steering LK a and
then let's rename the other one oops
I don't want an X naught to be steering
control but we'll call this one steering
intelligent Park Assist system wall
alright so let's do this one quickly see
there's actually a lane five packet I
think should tell us that this guy here
is a counter major angle
carry over I don't know why they
describe it like this just talk about it
like the way DBC is talking about it but
that's an angle this is called LK a
state and this is a check something
alright yeah we're going to move away
from this because that's the intelligent
Park Assist stuff let's see if we can
find where I actually use the lane keep
assist system
let's let's plot the angle right here oh
oh look right there look right there it
does something all right now of course
it's signed so we're gonna have to go in
here and change that to signed yeah okay
all right the bug is back but either way
okay this is where the lane keep assist
system triggers thank you Charlie Miller
you've done a great job and actually
let's think let's really thank the all
this is paper because it's pretty
awesome
as Charlie Miller and Chris Vlasic you
know really some of the early pioneers
in car hacking and they've published
this nice information for us and it is
still relevant today and will be used to
create our Prius DBC on so let's save
our new changes to github and I think
that's mostly what we're gonna show
today so that's how you can start
reverse engineering your car with cabana
data was recorded with a panda you can
go right here to buy pandas I'm sure you
guys have all seen this page because I'm
sure all 61 of you have bought pandas
but if you haven't now is your chance to
make that number go to 400 let's sell
400 panelist so yeah maybe the bug will
go away so I'm gonna sit down with Andy
after this live stream is over and we're
really gonna work on hammering that out
never want to see that happen again
you wanna pan that congratulations
um pants are pretty cool when you win
pans are pretty cool when you buy pan is
pretty cool unlike me in the sunglasses
that's not cool I've heard you loud and
clear YouTube okay cool
so now let's zoom in on this and now
we're gonna see the lane keep assist
system trigger we can go over the
steering packet 399 pandas let's keep it
going one more panda and we can actually
plot the angle here too wow it looks
like this car has a lot of angle sensors
all right so watch watch I'm about to
drift out of the lane and now Lane give
us this triggers to push me back we're
gonna switch up that Lane keep assist
system with open pilot which does a much
much better job I love how simple these
packets are this is super nice thank you
Toyota for making cars that are easy to
hack you guys are gross you are gross is
that what pewdiepie sauce on big PD PI
fans not big enough to know what he says
I've only watched like ten of his videos
but you know PewDiePie is the most
famous youtuber of all time
Wow they show you how to honk the horn
oh this is gonna be great actually even
if someone Wow this is the super useful
stuff yeah yeah crappy OEM Lane keep
assist and that is 400 pandas guys that
is 400 pandas I'm so proud of the Pam
team everything we've done and hopefully
we can all come together as a community
and start creating these DDC files for
cars so I'm gonna do one last commit to
github right here and I think that is
going to be me signing off unless there
are any last questions let me tilt this
back we can take a look
how can panda be used on Tesla yeah it
can um you're not gonna get too much on
the old be deport like there's an
instructable that shows you the right
place to wire it in and that for the
Dubai Crown Prince I shouldn't say
anything bad about the Dubai Crown
Prince I mean is the conference in Dubai
I'm just saying like you know there's
who you want to take money from as a
company and uh you know like what top
tier VCS and I think you know I like I
said I'm a big fan of I CEOs I think
that's a great way forward um we're
actually at 4:01 pandas that's too many
pandas we're gonna stop the video 400
laughs now you just need to get a car
that is supported yeah I mean you know
the pan of stuff is entirely open as
well
does Tesla have similar tools internally
I bet they're nowhere near as good as
this to be honest I bet they're nowhere
near as good upcoming giveaway pandas we
have a bunch more rev B's to giveaway
but yeah eventually they're gonna be Rev
sees as well so there are still panda
giveaways organized by our
administrators on the forums I'll give
away a couple pandas every week what car
works the best with open pilot right now
the 2016 Honda Civic that was last
year's flagship model but we've
announced that this year's flagship
model is gonna be the 2017 Toyota Prius
so if you want the car for the future
get that one if you want come on the
Civic is a pretty good experience it's
not gonna be quite as good as Tesla
autopilot it helps a lot the Tesla's
deeply you know Tesla made the car but
actually a lot of that we can fix we can
fix with software so pretty good
experience in the Civic good experience
in the Civic better in the ILX
but you know this year's flagship Toyota
Prius ah the Accord I wrote half accord
support and then I got bored somebody
can finish it especially now that I just
really wanted to make sure that the
Panda hard work and support the Accord
and I can tell you that again because
I've seen everything get done get
triggered it's just a question of wire
hair all up and making it nice and if
you did this this $2,000 for you can you
order Khamenei I oh the swag items no I
extended I was nice I extended it from
100 to 200 do I plan to celebrate no I
plan to hack my Priya
I'm gonna go do live stream again once
we actually have the wheel turning
but yeah cool well thanks for tuning in
guys that was reverse engineering of the
Prius bye-bye
oh I swipe down okay
few words about myself i'm ricardo
bragini and I'm chief System Architect
at the commodity I John I joined come in
2016 and prior to work at comma I worked
for about five years at Tesla I was
working on electric powertrain
technology and then in autopilot and
before that I did some research at the
State University for about one year on
electric vehicles I think a good way to
start talking about selling cars is to
introduce them by the 11th by the
Society the SAE divides self-driving
cars into five different levels so the
first level is a level one which is
level one well is what we can buy today
pretty much every new car that we buy is
considered level one the human is fully
in control of the car and the car
provides some driver of system features
so for example it can provide adaptive
cruise control so something that
maintains the distance with the car in
front
automatic emergency braking and lane
keep assist that allows you to go back
in the lane if you are if the car
detects that for example you are
strapped and you are departing the lane
but the point is you are fully in
control of the car and you're constantly
interacting with the car the next level
is called able to probably the most
notable example of level 2 system is the
test auto pilot and here the the
behavior of the car is completely
different the car is now fully in
control of driving and the driver when
the system is activated system watches
that the car is actually doing the right
thing so it's different we go from car
driving to the front from the driver
being fully in control to the car being
control and the driver assisting the car
the next step is is level trip I the
marked the transition to level 3 we do
it like a vertical line because here the
departing change like the main
difference is that the liability goes
from being from the driver from level 1
level 2 no matter
happens the driver is responsible for
driving from level 3 and above the car
is actually takes the responsibility
whenever they sell driving features are
active so what level 3 allows the driver
to do is allows the driver to be
distracted does not require the driver
to be ready to take over immediately and
it works a limited environment and it
always guarantees a few seconds of
safety operation even when the system
detects like a situation that cannot
handle so you imagine that you're
driving you are like reading a book or
reading your email the car detects
something that cannot handle then is
gonna beep at you and it's gonna still
perform safe operation for maybe 5 to 8
seconds that's what it's considered like
a good transition time and then you have
to take control
the next step is level 4 I think that a
good a good example like of level 4 car
C is what we see in from deployed from
way more like there are many other
companies
zooks or crew is GM they're all working
on level 4 so what level 4 is well if
taking the driver out of the loop like
let's take the driver completely out of
the car and let's have like a driverless
vehicle working in limited environment
the next example the next level is
called level 5 level 5 is devolution of
level 4 is likely before but instead of
working in with the environment is
supposed to work everywhere at any time
without a human so it needs to work at
least as good as human everywhere I
personally believe that it makes sense
I the two levels that are interesting
where people are working on are either
level 2 or level 4 and those are the
ones that we should pay close close
attention in the evolution of their
technology so what why do I say that
I like level 2 and level 4 are the most
important one well let's look at the
number so let's look at how many cars
like what are the distribution of the
levels on the cars today on the market
in United States it is 7.2 percent of
cars deployed like that we see on the
road today a level zero so they have no
assistance if you look around pretty
much like
one one in seven like six out of seven
cars that you see I have no assistance
at all then there is about like 12% of
cars that have level one so they have
limited assistance pretty much all the
new cars going to this category and then
there is about like a 0.2 percent of
cars that are considered level 2 I would
say the 0 2 percent is like in large
portion made by Tessa auto pilot and
like less less extent from like crew GM
and few other example that are popping
out from from automakers so what why do
I say that for example like level 3 is
not so interesting and I don't see level
3 being the next evolution like the next
step to us like a driverless future
well because level 3 by definition needs
to guarantee few seconds automated
driving we anything counter situation
that you cannot handle doing that is not
easy at all imagine that the system like
it's driving a highway at 70 miles per
hour
like maybe 775 and it encounter a
situation that does not how to handle
well doing safe operation for
five-second means that you travel pretty
much like more than a football field
doing doing and so yeah keep the car
doing something safe it's pretty much as
other solving for level four even if you
only have to guarantee those those few
seconds when the current counter
situation that you cannot handle well
you can say well yeah but it's true what
you're saying but there is one car that
actually shipped on the market the test
level 3 and it's true it's called a e8
is the Audi a8 it that it did not ship
us for regulatory reasons but let's look
at the limitation of such system so you
need to be on a multi-lane you order you
need to be you have to have bar in
between lanes so pretty much like on a
high-speed highway you need to have
structure along the edge to make sure
that there are no pedestrians your speed
needs to be lower than 37 miles per hour
and the speed of the surrounding
vehicles is also low
so the
this is almost impossible situation to
meet and it's not what level Terry's
supposed to be is just like an extension
of level two if something goes wrong in
this situation nothing bad can really
happen and so yes the car can take like
liability for the situation it does not
scale to situation like requiring faster
reaction time if you're driving highway
at high speed you you need to be able to
handle the situation and probably you
need like level four technology so what
about there before level so it's
interesting it's an interesting
technical challenge there are a lot of
companies working on it but what woody
is live at four what does level four try
to solve that well let's think about it
which is the definition of likely before
so like we have level four car so how do
they work
well the idea is that they allow you to
go from point A to point B without
requiring you to drive and if you think
about it these already exist like the
taxi there uber I can I can use public
transportation so they're trying to
replace a service that already exists
it's not gonna be more practical it's
not gonna be more practical the rubber
is not gonna be more practical in
certain cases in the public
transportation if you live in Manhattan
you want to go from point A to point B
probably taking the metro is the best
way to do it so what's the advantage of
living for well the Vantage is the idea
that they are going to cost less why
because the idea is to remove the driver
and to remove the cost of the driver
which I personally have some some doubts
by when you pay dry you will drive it's
not a big portion of your fare that goes
to the driver the big majority pays for
the car maintenance their insurer gas
and the fees to Ober so level four by
definition since it's not supposed to
drive anywhere anytime
does not compete with Kenosha P is that
meant when the car ownership but this
idea that whenever four succeed the
people we stop owning cars so it's just
not what level four is going to give us
and it was like very unclear how long
such a service will take to be better of
uber lyft public transportation in terms
of cost and practicality so what about
level five like I said I when I show the
slide before about the levels I didn't
show any example of companies working on
level five because literally nobody is
working right now on level five it's
very our problem those are two famous
quotes that I usually put in my
presentation one is from Iran in 2016 he
said that in about two years someone
which is the function that is supposed
to call your car out of your garage that
is working you press a button in the car
like slowly crawl out of your garage
well he was predicting there in 2016 and
in about two years so 2018 the car was
able to have this function working from
New York to LA for example so he was
imagining a future in 2018 where a car
could drive completely without human
intervention without a driver in the
seat from New York to LA and another
quote is from Chris Armstrong back it
was like the ex chief of the cell
driving from a Google before he became
way more and it was respecting that his
son which was 12 was not gonna need a
driver license by the time that he was
going to be 16 that was in 2015 his son
was 12 now I'm pretty sure he's more
than than 16 years old and I'm pretty
sure he got his driver license why why
it's actually like our to to solve
before for level five and nobody's
working on it
well it's very it's very challenging
problem you have to solve for situations
that are very hard to train a system for
a new man are very good at it
because they actually use like things
that they have learned outside driving
the first time that I drove a car myself
I did okay how come if I never drove a
car well I did okay because I was I was
actually I was actually transferring the
learning that I did outside
driving to to driving itself so how much
of of driving is actually you
skills that have nothing to do with
driving it's possible that to be able to
replace the driver entirely in any
situation you might need some sort of
like artificial general intelligence
systems being developed first and so
this is this is something that it's
definitely gonna take a while and I
don't see it being like in a closer eye
so while it will chew that well so
what's interesting about I will show is
people spend five percent of the awake
time driving and while you drive you
pretty much take and one action of
compacting the gas core I think the
brake or correcting the steer pretty
much every second so if you dry for
about like 20 hours like three hours so
straight that's about 10,000 single
intervention that you have to make to
your car and that's actively stressful
another thing that is worth noticing is
that there have been last year to the
seven fatal accidents in the u.s. that's
an increase of 15 percent from the
minimum reach in 2014 this is like quite
interesting because an unfortunate
because for many decades fatal accidents
in US have been going down the reason
why has been going up since 2014 is that
people are more distracted while driving
they look more therefore and
unfortunately this made more fatal
accidents and so there is really the
need of making sure that there's a
system monitoring the driver paying
attention so another very important
thing to know is and this is great if
there's a level 1 cache on today so
pretty much every New Castle today
already have the hardware to be a level
2 system to constitute to our level 2
system like if you think about every one
cars since they're capable of
maintaining distance for the car in
front of you are able to steer you back
in the lane if you are about to depart
the lane it means that they had ways of
controlling the gas the brake and the
steer and so those those actuator can
actually be controlled in a better way
not only to provide level 1 features but
actually level features the reason why
cars that we see on the market today
have only level 1 features and not level
piñon is because of cars are developed
with a very long development process
it's not possible to make over-the-air
update in pretty much like every car on
the market today
except for Tesla and the car the car
like the arguer that makes your chassis
like your actuators is very integrated
with the arguer that makes your
computing and the software that comes
with the car and if you think about the
lifespan of a car average lifespan of a
car is 15 years think about how much
like computing and computers have
changed in 15 years so I do believe
there is this need to decouple the
armour of the cars like what was the
chasm was your actuators and was like
what makes the hour before you can from
your computing hardware which is what
actually makes your your
driver-assistance features so well in
order to the sky whatever to is we can
just look at the video this is this is
our system that we developed at comedy I
if you can see the system itself like
they are where is mounted on the
windshield it connects with the can
which is the communication system off of
the car and this is retrofitting a
level-one car which is a 2016 conceal so
how does a level-two system works well
so the idea is that you press a button
you engage and then the car handles
driving for you you have to pay
attention but the car will keep in the
lane will slow down will accelerate
depending on traffic conditions and
other information that they can gather
from the environment so it's very
different way of driving of course as
the system gets better it's very
important that the driver keeps paying
attention and so every level to system
as the level to system gets better it's
very important to monitor the diver and
so in our system this is done by a
camera that is also watching the driver
so there are two cameras one looking at
the road and one watching the driver so
how does driver monitoring works so the
idea is that the camera is watching you
and
if you for example while driving you're
being distracted so you're looking away
from the Honda or for example you're
falling asleep or anything the system
detects that you are not looking
straight then the system is gonna start
to alert you it's going to start to beep
at you and then eventually if you don't
take control the system goes into a mode
where it's gonna force you to disengage
the automated feature and it's gonna
slowly bring down the car to a safe stop
so how does like self-driving car works
like before introducing and talking
about data let's spend a few few words
about how an architecture or some
driving car is well you might have seen
this before it's a very standard kind of
like layout of the system working in a
in a self-driving car but more in
general in manual bollix systems so you
have an initial like your input comes
from your sensors you use sensors to to
sense the world instead of in cars the
sensor typically cameras liders rather
ultrasonic sensors and all the sensor
that you use to perceive the state of
the car itself like accelerometers
gyroscopes and like magnetometer GPS to
understand your positions and so once
you have the data form from the sensor
what you use them for well two things
one is you localize yourself you
localize yourself in in the world
reference this is very important because
well if you if you are working towards
like a system with a car like drives
itself it needs to be aware of your
position to better Drive you why the
system is active and it also uses the
input from the sensor to make a semantic
representation of the environment
you go from a dense sensor output for
example for cameras you have these like
million of pixels in RGB format so it's
very dense it's very it's very high
dimensional output to something that you
compress
and you extract information that then
you need that people know how to
interpret and then you need to keep
going with your flow of operation so in
to make some example in still driving
cars so usually the the perception layer
determines where lane lines are where
cars are and we all the values obstacle
on the road are so then you use this
input to your next block which is called
planning so once I know we're like
obstacle ours I understand my
environment in a semantic way then I can
plan for it I can generate a trajectory
that I want the car to take once once I
have the trajectory I actually have one
last block which is called controls and
if the block the heart weighs the car
physically activates the car to make
sure that the car follows your plan good
news about the current state of
self-driving cars and sensor
localization this is already at
superhuman level like you can put as
many camera and as many sensor you want
around the car you can have at any given
instant perfectly under 60 view of your
surrounding human of course have to turn
their head and they you have to
sacrifice some field of view while they
are looking around in selling cars this
is not necessary you can put as many
sensors as you want and the localization
is also super human I mean like for
example like last year we drove around a
closed track without using any any
vision input just by using our GPS and
doing a sensor fusion with with the
sensor on the car like accelerometer and
gyroscope and we were able to
continuously loop around the track
without having any sensor and we add
like I would say probably a precision of
less than one meter like less than three
feet in place in understanding where the
car using what the reference this is
already superhuman like human of course
don't understand where they are in world
reference which such accuracy controls
are good enough
they are definitely better than human
when they work in their specific domain
of
operation where they have been developed
for they don't work or like they're a
little bit trickier to have them work as
good as human when the condition
suddenly changed so imagine that you're
driving and all a sudden you eat a bump
or your steering gets misaligned well
then you have to have a Largo a to
understand that for you driving straight
means applying a little steering on the
side well so this is you have a lot of
the situation that you need to handle
and and you know the situation is a bit
trickier and I think human can do these
currently better than machines so
adapting to sudden change of your model
but I I think what Russ I could
definitely like pros and cons with
respect to human and they are good
enough it's now resorting back to
driving cars the thing that are like
highly subhuman human do better than
machines is a sense of fusion and
perception implanting suspicion
perception like understanding the
semantic representation of the world
human are better these typical examples
there is a long tail of events where
shell driving car have a little bit hard
time handling them so imagine like you
see a plastic bag tumbling on the road
well so that I mean car might recognize
that there is like an obstacle but then
you have to decide is this something
that I can eat or is this something that
I should break for and this decision
becomes very important if you're driving
at 65 70 miles per hour down the highway
planning is also is also very hard the
way that human things like planned their
trajectory
I personally believe as I was saying
before it has more to do with skills
that not necessarily people have learned
from from driving but things that they
just understand they have some sort of
like intuition about the physics of the
world they just apply and they generate
those trajectory and it's very are the
creating algorithms at the base so maybe
a better approach which is what we are
torturing at , is putting together and
try to solve at once sensor fusion
perception planning all some sort of
like more like an end-to-end approach
and I think this is gonna scale better
than trying to separate these two blocks
so what are they
useful for well that are useful for
improving those those two blocks because
they do need machine learning a machine
learning can work with with data so
let's talk about data why are they
important in in cell driving cars well
of course first first thing is to train
your network so you have you collect
your data you collect your data from
your devices from your fleet and then
based on the behavior or the correct
behavior that the car took on the road
you try to train your network that
understand how to drive as they got from
the example of driving another thing why
data is important is that you can use
data to build your own HD Maps this is
an example of our of the maps that we
started to build based on our data you
can in this case we generated a cloud
point data set that for example
described the very poor Aging in the Bay
Area and this is important because
having these informations helps you
localizing very precisely in water
reference when when you're driving data
is also useful to simulate Andy bargain
when you can let back data from from
your fleet you can you can use this data
to see what happened and you can resume
elate the data you can you can use
messages are one of our debugging tool
and you can actually a play part of your
code on the data that you collected to
see how for example some changes of your
code will affect the part of the data
part of the output it was that was
actually collected and then of course
you wanted to collect it in case of cell
driving cars adventure if you offer a
service to your users at the product
that we sell is called the chameleon is
the device that I will show that I shown
before in the video and it also work as
a smart dash camera so you have cameras
you can collect data to the cameras and
of course like the user can have access
to their own data and we built our own
like Explorer so if you are like a comm
you
user then you can go on explore the
common CI and review your drive and
everything that happened so one thing
that's important to talk about is also
the cost about data collection because
we talked about the benefits and someone
might have the idea or like the the
impression that more data is better well
you have to consider also that there are
costs associated to data and it's not
always true that more later is better I
think good a good plot is the one on the
right which separates between companies
that have a like a product in the field
and they can collect their data through
the product that they saw the versus
companies that actually have to make
their own fleet and they you have to pay
in order to collect data I mean if you
if you think about how much it has like
a how much like individual profit maybe
Tesla can make on each car and you work
out the math I believe that Tesla makes
money for each mile that they collect
because it means that they stole more
cars and I would say like same way is
true for us the more miles we collect it
means the more devices we have solved
this is definitely not true for
companies that are working on level 4
they have to make their own cars they
have to make their own devices and you
have to pay drivers at least one in some
cases even to that at any given time
that I scare around and you have to pay
basically for their salary and so if you
think about the matter how much you pay
each driver but it costs to level four
companies about I like estimate these
are my estimates I estimate that they
pay about 2.5 dollars about two point
five dollars per miles if you think that
companies like way more connect pretty
much the same amount of miles that we
collect I believe it's around several
tens tens of thousands of miles each day
well if they paid two point five dollars
x let's say totally thousand miles
there's about 70 thousand dollars per
day that throughout here that's like
about like 21 million dollars and yeah
it's the budget you used to have deep
pockets
if you are owning like 11 for Fleet then
you are collecting data through your own
fleet another thing that you have to
consider is like connectivity in Casta
you have these devices that collect your
data how do you get data back well if
you own your fleet this might be a
little easier because the car gets back
and you you basically can can stream
back the data using like physical
connection but for our distributed
devices yeah we can use Wi-Fi but it's
very convenient for users if can
actually upload their data through
cellular connection so a connection is a
cost and so these must be considered
when you when you when you stream back
data to to your database data center
other thing that has cost if you use
data for bit for training in machine
learning you have to label them and the
label is something that is generally
done by humans so you have to teach
what's right to your neural network and
so you do these by having like usually
done by having like humans like taking a
picture and telling and like taking
notes wearing the picture of things are
what everything in the picture is in
this case where cars are where orders
lane lines buildings etc will come move
completely away from human labeling and
we try to do everything automated so we
use neural networks to label data that
we used to train other neural network
another thing that if it's like that you
pay for is of course processing training
and data transfer if you have your data
stored on the cloud and you're like oh
the Descent you do spend on data like
processing your data you spend
electricity to train your data because
they run on GPUs and you do Spanos data
for data transfer if you go if you have
you audit on the cloud you have to
transfer your data to something like an
eventual if you want to train luckily
and this also has a cost and probably
the most important thing is the cost of
storage the data one thing that a camera
we quickly realized is as the number of
users that we have keeps growing we saw
that I really like steep increase in
storage cost if you think about it and
if you assume that the number of users
that you have it's sort of like growing
linearly over over time well think about
how much storing their data indefinitely
is going to cost you I mean generally if
your function of user increase is called
f of X where X is your time well they
can't the cost of storing their data is
the integral of of f of X because you
have to store their data all date a new
data over time and so no matter what
your business model is in the case of
the driving cars where data are
particularly expensive because in our
case every hour of driving is between
five and ten gigabytes in the case of
level-4 car so I would not be surprised
if every hour of data it's gonna be
hundreds of gigabytes well you're gonna
quickly start to skyrocket your your
cost of storage if you don't act on it
and you don't start like to delete all
data as your user base actually grows so
some some tips about that data storage
and use of data I think unless you have
as I said before like a lot of lot of
money people are invested money on you
and you can build your own fleet and you
can you can afford of paying tens of
billions of dollars per year in that
collection
think about making a sustainable
business model around collecting data
early on in your stage so in case of
comma the first product that we actually
released with a dash cam app you could
download from the App Store or from
from the Google store Google Play you
could not load our app which was called
shiver and it's a dashcam and through
the tap we were collecting data the app
was free but at least we didn't have to
pay for for every day that we collected
the second product that we released is
was generator
it's a nobody to dangle it's called
panda and this is the first time that we
started to make a profit with a product
so by syncing your app with the kanri
they're not only we add back vision like
camera data from from from the car from
your phone but also we were able to sync
the data with your can with all the data
that was running onto your communication
area network which is the protocol of
communication of your car and this was
great because we could like seeing what
the cow everything that was being
recorded from the sensor of the car
together with the video data coming from
your phone and then we evoluted into the
product that you are currently selling
which is called the chameleon it's a
smart dashcam
it's something that you can install on
the wishes of your car by default it
provides a passive driver assistance
features and with passive I mean
warnings so in the text if you are
instructed it warns you if you are about
to collide and then of course it
provides all the functionality of a
dashcam but at the same time is also a
completely open development platform
which can be coupled with our open
source software which is called open
pilot and so it does support open pilot
and open pilot is the software that I
show you before in the video that can
actually like drive your car I don't
think that you you might want to to
consider about about data is I think if
the cloud services is worth it like is
it worth storing storing your data on on
the cloud is definitely a good starting
point which is where like we started as
comma we we started to upload all our
data on the cloud also cloud services
like companies that provide cloud
services are very good in giving you
some
sort of like intro grant where basically
you basically use their service for free
up to certain amount of expenses and
this is a great starting point but then
as your user grows if you really don't
have like a back-up plan or a way to
continue your cost you'll find yourself
once you run out of the free money
provided by the cloud service that you
are going to spend after that a very
high monthly cost because as I said your
user grow is growing quickly and so
consider that keeping your data on the
cloud is actually a good thing
especially if you use your data for
training and you want to stop like using
for structure to transfer that around
maybe actually transfer it luckily it's
a good solution and we definitely
thought it was a good solution for us we
did the math
buying our hard drives allows us to
repay the cost of the cloud in about two
months of course we don't have the same
redundancy that we have on the cloud but
at the same time as I said before our
users keeps going and so for us there is
no much value in today's data there is
more value in the ability of collecting
new data select and upload only the data
that you need currently a camera we are
uploading all the data from users but
will soon start to think about well
maybe not all the data so relevant
most of the data about driving is
somewhat boring it's about driving
straight on the highway and after you
have enough date of these maybe you
don't need any more data and instead you
can select your own data based on
certain criteria that you define at any
given time it could be for example any
time that the user intervene any time
that the user corrected the action of
your system is very interesting data
because it means that somewhat your
system failed to do something right and
so that's useful data or maybe like
turns or maybe adverse climate
conditions etc and ultimately disease
for some psychological reasons they
companies tend to keep around data that
they don't use my recommendation is
discarded in you de news as you progress
in your hardware you'll have legacy data
legacy
means data that you are not using it's
incompatible with newer data and so
instead of keeping it around and
thinking maybe I will find a use of them
in the future
think about that you are paying a
constantly a monthly fee for them and
maybe like a better idea is is discard
data that you don't use don't keep that
around if you don't have a good use for
them at any given time thank you
[Applause]
[Music]
yeah definitely I think level level five
cars anything the reason I need to call
them level six I think level five car so
we actually be very similar to what what
you described when they're gonna be
applied I think a lot of it will be
around like entertaining it's pretty
much like flying like the idea of giving
entertainment to the driver I mean we
start to see maybe I mean we see a
little bit of these like in cats when
you take a taxi you have some taxi you
have like like you can watch a video in
front of you and I definitely see this
way more like passenger center like
those like level five vehicles being
deployed in this way I don't know like
yeah it's gonna be interesting I think
the first deployment of level four is
probably gonna be retrofitting existing
cars building new cars is very hard
getting like the good reliability Zarda
and it's a lot easier to retrofit
existing existing models with with the
other and there and the sensor that you
need but then out like the technology
progressed and I do believe that cars
are going to be optimized around the
customer experience definitely I think
we're out of time okay thank you
[Applause]
hi everybody welcome to the fireside
chat so today over the last few days
we've been listening to experts talk
about machine learning AI
and applications to different industries
and I hope you've enjoyed the sessions
for the last few days now we're gonna
kind of deep dive into autonomous
vehicles um the hype and the impact in
the industry and so I'm going to let
would you like to introduce yourself
again yeah definitely so my name is
Ricardo Vizzini
and I'm with the commodity I I joined
come in 2016 and I'm chief systems
architect and prior to come I worked at
Tesla on the autopilot system and
on the development of electric power
trains and before that I worked on
researching electric vehicles at the IU
State University
so autonomous vehicles and and automated
vehicles let's talk about let's start
out with definitions just level set and
I'm sure some of y'all were at this
session this morning but for the
newcomers yeah I think a good way as I
mentioned we have any presentation for
the people that we rank here for the
presentation it's important to
distinguish between levels of automation
the sae defines the five different
levels level 1 2 3 4 and 5 and level 1
is pretty much like the car some assist
the driver so the driver drives all the
time but the car make makes intervention
and makes driving safer and easier in
level 2 because the car is full in
control of driving and the driver
actually assists the car and an example
is Tesla Tesla vehicle GM supercruise
and what we develop a comet the eye and
then from level 3 and above the driver
is not responsible anymore
the car is responsible for for the
driving actions so the driver is not
required to pay attention at all time
with level 3 the driver is only required
to take control of the car after a few
seconds of safe operation of the vehicle
when the vehicle encounters a situation
that cannot handle and then for 11 4 & 5
is driver is completely driverless
vehicle and in level 4 is limited
environment in level 5 is full full
automation in unlimited environments so
basically making a robot that can drive
as good as a human when when are they
coming into the market yeah I mean it's
a good question and the answer is
certain certain levels of automation
already here level level 1 is what you
buy today if you buy a new car and in
you're on the new to your author like
the most popular cars have 11:1
automation a few cars on the market and
represent about the 0.2 percent
the fleet today in us are level two
mainly our test autopilot and then there
is no like release the car in u.s. that
is like level 3 or above and so when
when are those car comings when I would
say first we should we should try to
increase the number of cars on sublevel
2 how do we make the existing cars like
smarter how do we how do we make the
fleet how do we change the fleet
incremental ii and i would say the
natural like way that it's going to
change is cars are gonna transition from
level 1 to level 2 and then when level 4
level 3 4 & 5 are gonna be applied well
I would say like I would said before in
the presentation I think one interesting
level that we should be paying attention
to is level 4 level 3 does not make much
sense because solving for level 3 is
pretty much as I have a solving for
level 4 guaranteeing this certain amount
of time of safe operation it's not it's
not simple task and solving for that is
as our in my opinion solving for level 4
so what what we are going to see at
certain points is the deployment of
fleets that work in limited environment
and with driverless vehicles that can
bring you to point A to point B so
hopefully we are going to see that in
the near future but these level 4 does
not compete with level 2 level 4 what
level 4 aims to is the replacement of
existing services such as uber such as
Poli transportation is just meant to
make those services cheaper by removing
the driver from from the loop conference
I work in the automotive aftermarket and
one of the things I do is I watch the
car park and watch how it's changing and
and how it's gonna be changing the next
15 20 years to keep my company
competitive so when I thought so od BC
connectors oh we need two connectors
those are the little you stick something
under your dash used a lot for some
basic diagnostic functions that that
it's not smart enough that's not
connected and the right way to make it
make my dumb car into a level 2 car no
yeah so what we do at karma and it's
taking existing car so so proving that
level 2 technology can be applied to
existing cars you can take any new cars
to tell level 1 capability and we prove
the individual that I showed you a
representation that you can actually
turn it into a level 2 car because a car
that are new and comes out today have
already backed waiters and a way of
communicating of controlling that
waiters such as gas brake and steering
in a way that you can actually have the
car driving itself if it is marked
enough it has the right software and
then I compute so yeah I mean like if
you the way that you interact with the
car is tapping into the can system of
the car and it can be done through video
pores or it can be done from any under
and present in the car the technology
needed to really hit the level 2016 well
you eat the you need to do you need
actuators you need they are the weather
comes with the car be ready to be to be
upgraded basically so you need pretty
much like a new car so from 2016 above
but really in 2019 almost an in your car
could be could be retrofitted way to
meet a level 2 in theory does anybody
want to guess what percentage of the car
park is 2016 and above anybody who's
brave you're pretty close it's 20% so
that also means that right now we have a
lot of dumb cars on the road that won't
be able to have the full benefit of you
know some aftermarket accessories
there's still some programming you can
do through there's lots of obd2 port
platforms so for the novice car person
who knows just enough Python to get in
trouble and github x' that can help you
get there but it doesn't take it quite
to where it's the driver assist and have
the functionality to
if you want the car to actually be
driving itself you need you need
basically access to to that to eight
hours so the age of the vehicles is
another thing that age of the car park
has been something interesting that
people in the aftermarket have been
watching because people are holding on
to cars way longer
in 1996 the average age of the car who
is eight point five years and you had
you had it on the slide earlier just in
the the current age according to IHS of
an average car in America is eleven
point seven years and it's been
predicting to increase even when there
have been movements like the cars cash
for cars that only took six hundred and
seventy thousand old cars off the roads
so yep there's one challenge I think
you're gonna have is getting around
those dumb cars well so definitely those
cars those cars like are gonna be around
for a long time and it's highlighting
one important fact that is if the
average life of car is about like to be
to twelve years and it's actually like
increasing over time there is really
this need of the coupling the hardware
of the comes with the car so the car
itself like the chassis actuators those
are not meant to last maybe fifteen
years or more from the part from the
brain of the car that should be
something that instead we should be
treating as consumer electronics should
be something that we should be able to
replace update and I'm not talking just
about software updates or software
updates which none of the car that's all
today except for Tesla is capable of
doing it but I'm also talking about like
being able to replace the computing
hardware in the last fifteen years if
you think about cars fifteen years ago
and you think about cars today you don't
I I don't think it the perception of the
change of this car has been like so big
like still has four wheels they cost
pretty much about the same amount of
money and they serve pretty much the
same purpose what's changed is the cost
of computing particular like GPUs they
reduce the cost of computing in the last
fifteen years by Toyota of magnitude so
if ten thousand times cheaper has
buying GPU so having the same computer
today that it was 15 years ago and so if
you think about it well why I think
about cars that you buy today and think
about them in 15 years from now how
outdated they will feel an analogy that
I make it's like you are buying a house
and you are not allowed to replace the
washing machine
that's how cars are going to feel when
you buy them now and they are not
structuring the capital in the proper
way so this is what we're trying to
solve , we try to make a feasible key
that can work with your existing car and
you treat it as a consumer electronic
you treat that device that you install
on the windshield connects with the can
system of your car with something that
after maybe every two years when a new
system comes out you can replace it
there is there is really no reason why
you should replace the old car to have
better driver system features and that's
also what we're seeing partnerships
we're seeing large autumn automobile
manufacturers partner with different
technology company to start treating the
technology in the car more like a
consumer electronic and that way you can
have that upgrade ability and as you
mentioned before Tesla's the only one
who does over-the-air update so it does
require some you know handling and care
to get the data updated but change in
perspective like that is going to help
treating it like the development cycle
for electronics I think will help keep
you happier when you have your eleven
point seven year old car in a few years
yep let's see so issues with driverless
you talked this morning about data
collection is there how did how data
collection using your tools so is that a
limitation still for three and four the
higher-end cars and commercial are there
pictures available if we're talking
I mean commercial vehicles comes up to
that was very yep lots of you know
magazine covers with being a fully
electric 18 wheelers how close are we to
their well okay so I think the
distinction needs to be made between
data collection that is made through
like devices and product that are
current results so if you work on level
two like for example
Tesla tells us the ability of collecting
everyday 4 million miles like they have
enough car that everyday they can
collect 4 million Minds a comma we are
we are about thirty thousand miles per
day that we can collect and so if you
have a product that you actually sell it
becomes a lot easier to collect the data
and you can actually be a little bit
spoiled by the amount of data that you
can collect
you can select you can decide which data
to upload that you don't need to upload
all the data definitely test is not
uploading four million lines of data
every day so if you work on like level
tree evolve on something that has not
been released yet to the public then you
cannot collect this data from from
people from your device that are out in
the field but it's also important to
distinguish between which type of data
you can collect from people just driving
a car which type of data you actually
need from the car that you prepare that
are driving themselves so think about
like a fleet of driving car like level 4
well like if you are trying to learn to
drive on data you can you can gather
this data from simply like people
driving around they don't need to be
driving with your own car you need to
make sure that they have enough sensor
and the sensor representative off of the
car that you plant eventually to Elise
for your for your final system but you
can distinguish between your fleet that
you use for testing to test your
algorithm it that are driving themselves
versus the fleet that you just used for
data collection so even if you are like
working level for example in tracking
you don't need to have like self-driving
tracking on the old in order to be able
to collect data from tracking you can
like retrofit existing tracking with the
right sensors and learn how to drive
from manual from people that are
actually driving just to stocks so yeah
I think doing that distinction could
help like getting into like the segment
where it's a little are them to be like
big big networks and there's we've seen
automation go into agriculture first and
see having a large area you know
good opportunity for development know
some software stuff is so needs to get
worked out yes right to repair culture
is a great example of automation that's
easier than driving because the safety
aspect of it is not is not like Samantha
but it's a good example yeah how
automation works and then we talked for
the last few days about having the right
kind of sample set
how different are the videos and how
applicable are the models from the
different driving style so people in New
York Drive very different than people
here places like Georgia we have the
long commute like Houston so what is
their prioritization yeah that's a good
question so for level two like for what
we do I mean with more variety we get
from data the better we try to be the
system is somewhat works decently in
pretty much like every driving condition
if you try to build something like a
fleet of level 4 vehicles I think you
should focus on your first application
so if your first application is a system
that is going to service people like in
a suburban place where like speed is
limited maybe like to 30 miles per 30 5
miles per hour and like there is not
like huge traffic then maybe you should
like focus on collecting data from those
aisles because those represent your
first like go to market application and
you shouldn't try to some sort of like
mixing with data that's coming from
environment that are outside the scope
of the first release of your product so
it really depends I would say like if
you're focusing a level for now don't
trying to get data from New York try to
try to focus on where where you're gonna
have your first application and it's now
going to be New York and we'd also
talked about the applicability of car
videos being used for like larger Class
eight vehicles you know camera it's
going to look different even for your
modeling so that's a good thing there's
a lot of data out there and micro
processors have gotten cheap super
although your cloud storage bill might
go up a bit
yes definitely like due to the sensors
i've super each output like a cameras
like you think about the stream of
camera
it's like mega mega mega pixels and so
think about how much data that is sure
you can compress your video but still
like we are talking about i mean in our
case like our device collects pretty
much between 5 and gigabytes of data per
hour if you talk about like level 4 you
are probably talking about like a
gigabyte per hour collected by your
system and so yes I mean like processing
this data becomes like feasible now on
like real time but at the same time if
you're storing this data you have to
think about how expensive is going to be
your your storage bill when you are like
uploading all these data to your to your
servers you know how can you know if
you're interested in in working with you
know autonomous vehicles and car tech
the the problem presents a good
opportunity for developing new models
for we saw some models for that the our
CNN with picture refinement and
different ways to classify images so
you're closer to it so you know how are
different ways to get in to be involved
or the other development opportunities
that aren't necessarily in the card type
you know yeah well so self-driving cars
are mainly like a software problem it's
not really a problem that has been some
sort of like I see solved I and I see it
like I really frame it as a software as
a possible problem how do we how do we
make like a robot that they can drive as
human or can at least like assist human
driving so yeah you don't need to be
caressed better to be involved you need
amino free to have like passion for for
software and that there are like many
aspects of it you can you can work on
machine learning you can work on
planning controls that management
infrastructure there are really really a
lot of aspect about it that people like
engineers can can get can getting ball
to it
I mean if somebody's interested into
into getting more involved about it
we have like all our software it's open
source like comedy I makes all the
software open source it's called open
pilot you can go and get add you can
read the application you can read the
how our software start works and that
software is software that supports the
Arbour that we sell which is called the
comedy khmer on so the other that we
sell is a smart dash cam and if you
you're interested into being like a
developer and learning more about
solving car so you can actually put the
two things together and you can have
like a level to retrofit that cell
driving car which is the one that I
showed in the video and everybody can
imagine the the adjacent industries and
even the service industries as people's
mobility patterns and habits changed
they've already changed first with lift
and now you can get anything delivered
to your house so that opens up as we're
talking fleet slates have come up a few
times either how could your business be
changed by it is there some different
model that we're seeing you know be
thinking of this when thinking of a
tongue which I'm sure everybody has been
thinking of it to be it the impact of
autonomous vehicles to your business but
fleets and adjacent services are
interesting the utilization rate yeah
yeah definitely they want one good thing
about the Thomas vague like driverless
vehicle is that they respected like
utility sure it is gonna be much higher
than any of the car existing which we
really think about like the trucking
industry the trucking industry when when
we are gonna see 11 4 trucks on their
order
well tracking is going to become like
radically different because you're not
gonna be any more constrained by the
maximum I think it's eight hours like
maximum continues driving from from
driver so you can have those trucks like
driving pretty much like no staff but
for for as long as it takes to go from
point A to point B and so yeah certain
industries and I really look forward to
tracking industries are gonna be
radically changed by a for example you
to musicians right other things are
gonna change I would expect like
the first application I'll add before
being I there is gonna be a company that
owns the fleet like I do really see
especially because at the beginning
there is gonna be a lot of like
iterations like on they are on the
services of the maintenance there are a
lot of like unknowns and so I do see
making sense that there is gonna be like
a company that owns the fleet as opposed
a little as opposed to what we see today
with uber drivers where it's very
distributed single drivers that own
their car and contribute to the fleet
instead I rather see those fleet being
directly managed and central is the by
the company that provides the service
and it's upgrading is a bigger deal with
the these smarter cars getting software
updates and good have to happen fleet
management makes more sense and that can
make a lot of sense in that context yeah
exactly what I was mentioning like there
is this need of being like closely
connected with your fleet being able to
upgrade your car so and especially like
at the beginning so definitely it's
gonna be like the first implementation
it's gonna be like our own fleet does
anybody know the utilization rate for a
consumer car unless you're like an uber
driver because that's or you know in
your car yeah I've heard you end up not
using your car its parts around 90
percent of the time whereas you can kind
of flip that model with an autonomous
vehicle in delivery services you can
have like at last mile issues you
actually might need to have a human
doing some interaction but again you
know looking for ways you can interact
with this new vendor industry that's
that is something if there's not a
driver in the car how would your
business work with them and serve them
so would that change anything any aspect
of what you're doing now let's see how
about consumer adoption of babies well
so okay if we talk about level two it
really something there it's it's hard to
convey so you just I just have an idea
like how many of you have been in a
level to sell driving car like raise
your hand if you have been why I would
say it's like temperature
10% of you have been like in 11 - well
consider that there are 0.2% of cars 11
- on the road today so 10% yeah you this
audience definitely got a good exposure
to them and it's something that you need
to experience you need to realize how
better your driving can be and how safe
it can be because you are basically
relieved by the stress of constantly
having to interact with your car making
sure that you're keeping the proper
distance with the car ahead of you also
a car drives itself as a much shorter
reaction time because like you have a
computer like watching the road and
taking actions and then at the same time
you have a monitoring system it
constantly reminds that you have to pay
attention and I mean it's debated there
are certain I mean there are voices that
say this is actually going to be harder
to manage from the driver because it's
gonna push people to get more distracted
I've been driving these systems I've
been developing this system and
everybody that I talk to that has been
like an elaborate systems as a political
opinion about how level-2 can actually
like improve people's people striving so
I think it's something like the man will
grow as the offer will grow as more and
more cars we pushed or three would be
will be keeping level two systems I
think the acceptance rate is going to
grow as a consequence I would say for
eleventh for I I think it's gonna be
literally like a question of costs as I
said before
11400 really exists and you can you can
be driven from point A to point B
without having to drive it's just a
matter of can I offer something that is
like practical can bring it up from
point A to point B we eventually same
amount or less time and the same cost or
less if that's true then acceptance rate
or like level four it's gonna be is
gonna be mad it's gonna it's gonna
happen otherwise they're not gonna
succeed and it's not populace that is
gonna be the case definitely I don't see
it being the case for quite a bit so the
National Highway Transportation Safety
Administration has been a proponent of
some of these these driver assist
because they save lives like the safer
you can make cars I think that helps me
work through acceptance of like letting
my
Siri yell at me about staying in my lane
just as the balance of you know
inattention does you know accidents
happen when people are not paying
attention so I think that's gonna help
be at least a driver for it and it's
definitely a messaging what he needs to
do definitely I did the safety aspect is
very important I think there is a huge
opportunity for level truth to make a
car safer that the starting point is not
greater like Fattal accidents are the
number one cause of death among young
people between age 16 and 24 and they
represent about like two percent because
of death worldwide so there's definitely
a big opportunity there to make a car
safer and smarter regarding 11-4 there
is a little bit like nah I see a lot of
like unfair comparison when we talk
about safety related to level four
because what what one of the thing that
is being said when when you people like
talked about that before is oh well it's
gonna be a lot safer but again you don't
have to compare 11 4 with like you
driving the car you have to compare
level 4 with the services it's level Pro
compete with which is public
transportation which is the driver which
if you take aware I would say it's very
like another of magnitude safer then you
drive your car if anything because is
offering your service and is paying more
attention that if you weren't in the car
so when you talk about safety for level
4 you need to contesta lies it and
comparable to a poll which I don't see
it done like very often while in level 2
well you need to be better than people
to have in the car after is earlier yes
great question I think
see any potential for complacency on if
you're at level two for too long before
technology hits level four does the
average driver out there that's tweeting
looking at Facebook on their computers
become complacent and get distracted you
see accident rates going higher than you
anticipate it's currently level two
drivers they know they're in a test law
they know they're supposed to be in
acting so they're participating more if
the lag between level two and level four
is years do you see that people will
trust too much in the increase in
accident rates no I think it's actually
going the other way around I think like
people that get into level two cars
today are more confused about this
technology probably are not completely
aware of the technology one thing that I
I wish Tesla was doing that it doesn't
and actually we do is driver monitoring
so how do we actually be monitor that
the driver is paying attention that's a
good way to like educate on this part
about what's the proper behavior to take
when you're on a level 2 car you have to
pay attention and yeah I mean if you
have like camera watching the driver Jen
does that once with supercruise there is
like a video camera an infrared camera
that looks at you and can tell you if
you start and we do the same thing and I
think this is very important so as we
move forward I think there will be as
the acceptance and understanding of what
leverage system is I think like drivers
and users will be better educated
because they understand what so no I
don't I I expect that over time things
are actually gonna get things people are
gonna be better educated than they
currently are and not to be punitive
that I think the other thing that
naturally comes from that as the drivers
are monitors you know that would be
introduced as evidence in a court case
at some point so I think knowing that
you have a camera on you
also will affect you know your
interaction with it not just you know
fall asleep on the 405 hopefully well I
mean yeah I mean it really depends like
I'm currently done we don't collect
people's people's face unless they
consent to and they Yelp I was like
training driver monitoring models
somebody needs to actively
santé to be able to for us to record
their data otherwise we just provide the
feature but we now record the data but
yes definitely yes okay so I hope I can
ask this question properly but if I'm
Ford and what how will I be adopting all
of this so what will it look like so
you're saying today Tesla is the only
company that has this software update
well all cars have that what will Ford
be doing over the next 10 years what
will their production look like to be
able to start adopting this what do you
think I can say because I I'm in the
industry so and I've seen Toyota's been
doing partnerships with uber on both
autonomous TVs and retrofitting like
Siena's so like a regular internal
combustion engine cars and what what I'm
seeing evidence of is they're hedging
their bets it might move this way it
might go way more electric you know is
the supply chain to support you know a
more electric car part in place but they
they have for years although they might
not be on the road there they are doing
R&D and and I'm not just saying for Ford
I'm saying in general for the car
manufacturers we're seeing them partner
there they've started forming alliances
you can start seeing different clusters
of ones that are working with others so
I don't think they have the full answer
yet but at least we were level four for
the different levels of development they
have been investing money in that so
yeah then we let us see it like I I
don't know what they are waiting for
officially because I mean if you think
about that like for software Ricola
they have like let's say you have a
software glitch and a tap and it have
been lagging Toyota's like several times
I compress right so you have the other
software Ricola and the software recall
you have to recall millions of cars how
much of a cost is that like quantifies
that it's like hundreds of millions if
you have to recall like millions of cars
that's the equivalent of money that you
have to spend for software update and
then also like the development cycle
your learning cycle is much longer right
so you I mean when you're at least like
the fact that you can do so over here
update does
mean that what you learn is isn't safe
right so you need to work out the safety
part of your software before you release
it and that part doesn't change but then
I would say there is like an extra
probably 70% that is just like user
interface things that are not safety
critical that if there is a glitch is
not the end of the war that you can work
out those making updates over the air so
how much shorter will the different
cycle be if you don't need like to test
for so many hours the fact that if you
click a button the the proper answer on
UI happens right for example so I don't
need to understand what they're waiting
for
but the actual answer is I mean like
this company is very good at making cars
making reliable cars they have a little
B to invent themselves if they want to
be up to date wait we sort of problem
it's an infrastructure problem that you
have to build and it's something new so
but there you have to do it if they want
to be relevant if they want to survive
they have to get in today so that why
it's like there is no way to compete
with the other companies that actually
are making this a possibility there is
like there's a huge cost opportunity
there there's a lot of value and people
doing what they excel at companies too
so if you're awesome at making cars you
know partner with people who are awesome
at the technology problem Karl yeah just
I want to return back to this the
concept of safety as you move through
the different levels here you talk
extensively about that what are some of
the the AI approaches that are being
developed to address adversarial type of
threats to smart vehicles for example I
you know you can have like obstruction
of signage for example and trick a
vehicle
thinking that oh that's not a stop sign
so I'm gonna go right by so what are
some of the solutions in the AI space
that is being explored to make sure that
as you move through those levels yeah
about time is it that these vehicles are
getting smarter and not so susceptible
to tricks and adversarial tax definitely
so I mean like the problem gets a lot
easier the more mice you can
collect because you have the choice of
deciding which which they thought a
favor so for example like as a show
during the presentation the large
majority of data you collect from from
cars so if you don distinguish the one
that is good anyone that is did one that
is use from the one is not is like
boring data it's like you driving on
there is not much to learn after certain
point and so yes you need to favor those
events that are somewhat events from
which you can learn so like having a
horror mystery Bhushan of your data that
are represented by by specific events
from which you can learn and you can do
that in many ways like one way that you
can do it is like mark every
intervention that the try like if you
have your system that is like a level
two system every time that the user
intervenes to correct the car it's
somewhat like a disengagement is
somewhat like something that they can be
didn't do right and so you can actually
collect those event in favor of those
events to learn something specific that
well so the first one learning is a
little bit yes when first learning well
that's important if a like a personal
learning in the sense that you deploy
something and you use like the user as
so sort of like your feedback there is
some sort of like ethical aspect to it
that should be you can see that because
you're using like the user as you're
like reinforcement loop but in a certain
sense it's fair to do it as long as like
what you released at any given time is
safe no more interesting like you can do
it for smell owning like completely like
offline so you can you can train your
model planner a personal learning so you
tap you set up like a simulator like we
doing that come and you make the card
learning from from reinforcement
learning system so you generate the data
so you you generate situation where you
put the car in a situation where it
shouldn't be and you learn from that it
straight it's not it's not a simple
thing but we have like good approaches
or calm that we that we are
investigating and we actually like using
right now on on models that we are
deploying
yes
so I know you've been asked this
probably a hundred times before and this
question is not new at all but I'm
interested on your take on it
so the safety issue if you have a car
and there are pedestrians and the car
has to decide if it's going to crash to
save the pedestrians or the people in
the car or maybe a way to crash to save
the people in the car and the front
versus the back how would a car make
that decision great so you're right I've
been asked a lot of times about this and
the answer is IIIi don't think it's like
very very relevant problem at the moment
like it's not at the point where like
this kind of decision matters and also I
don't think it's very relevant even if
we were at that point I think the answer
is very relevant at the point that you
may need like a car that is like driving
safer than a human like the sort of
decisions are really down the point
where they don't matter I don't see such
like I don't see it even from an ethical
point of view I don't see it being like
that like let the engineer on the side
like as long as the overall output
system is like safer it does not really
matter like what what would a human do
right the only reason why we don't ask
this question to human is because we
think that it's happening fasting after
the human doesn't have to think about it
but so what would a human do let's say
you have enough time to think about it
in some case you might have enough time
to think about this situation what would
a human do and I would say another
possible answer is well how to prevent
this sort of situation beforehand so you
want we want to be able to minimize as
much as possible situation where you
have no good options
so that would be step one and then step
two is like I mean like what do you mean
I think it's not a girl question that
applies to robust I think it's a legal
question that like could could apply to
you man if you want ask the question I
think I know during startup we drive a I
did a presentation and that question
came up there and for their models they
trained to stop so like even if it
doesn't have to be an immediate safety
thing and this is it was in limited
deployment but it was to take the car
safely to a stop before they got to
where it was collision closed
yes well our complaints is already it's
already happened it's not it's not full
automation but like I would say like
planes are the closest thing to what we
intend as level to level to driver like
Suzanne driving cars in agriculture
already happened why do you have these
like big tractors doing doing the field
work without human assistance ships I'm
not an expert in ships but I would say
that yeah most of the ship work can be
done without a human constant like
interacting with it and there are
probably like good warning systems to
avoid colliding with icebergs and other
fields like train I'm trained already
like people automated like me to meet
metals there are like me it was like um
it was don't even and like I Drive like
a Macanese like a person that stays
stays in physically looking into it
being into the into the metal itself and
into the path so yeah I mean it's
already happened I think it's gonna
happen and it's already happen sooner in
other fields before it's gonna happen in
so dragon capsule so I think also
probably gonna be like the tail of of
these things which is why when we talk
about like level 5 this idea of having
like a curve it has complete itself
without the assistance of a human as
well as a human boon it's not something
that it's gonna happen without us
noticing it it's gonna be I think at the
tail of many how they are filled that
are gonna be automated first so we're
gonna know when we're gonna be close to
level 5 we will know it if we now we
don't know it means that we're not close
I think one good thing that comes out of
it though is a lot of the technology
used to detect things and solve problems
in
to end up cars can be used for assisted
technology on other modes of
transportation so they've already had
kind of independent aids that can help
you know people navigate who are
mobility challenged so I think that is
one just ninth nice natural consequence
of the development that's happening in
your space
so obviously you as a company and all
companies will have tremendous
tremendous incentive to make it an
accident free environment because one
accident is going to drive your share
price down so that will necessarily
limit what your car will allow the
passenger to want to do so if I want to
speed in my own car and I'm driving I
have the full autonomy to do whatever I
want and I'm taking my full risk when
the decision is is delegated to the car
manufacturer they have the the incentive
to minimize accidents at the expense of
individual passenger or owner autonomy
can you express your opinion on that
yeah I mean I think like people
shouldn't speed and I mean say I don't
see why cars like and we are able to go
up to 100 miles per hour
like if the max limit is like 70 like
let's say 7 let's say 80 miles per hour
I can limit the speed of 80 miles per
hour like the large majority of
accidents are caused because people are
driving in a way they're not supposed to
drive so limiting the the way that the
car is capable of what the carriage
capable of doing is not a limit to
freedom of like owner of the car to
drive the car it's actually like a smart
thing to do but I want also like comment
on the first thing that you said which
is like one accident the for autonomous
vehicle is gonna be very bad and it's
gonna there is a need to push for
accident phrase well I mean perfect is
the worst enemy of good right so let's
focus where we are now and let's try to
make things better let's not
overemphasize of
yes there's gonna be accidents but we
have a lot of accidents now we need to
make something that is better than now
if we if we if we emphasize too much
like for example we do with planes when
there is a like a plane accident we
emphasize it too much then people are
gonna have this like over a perception
for what safety is and yeah we need to
avoid we to do our best to avoid to get
into these like force perception that
some driving her are not gonna be safe
because we are worth a lot about one
accident we have to wait it with actual
data actual numbers we have to wait it
with the 37,000 fatalities that happen
each year in US and so yeah I think I
think we need to have a database
approach when when we talk about safety
and it's very important that we push for
that yes so you're talking about an
autonomous vehicle is there any
development that a vehicle is part of a
network and they will exchange
information like intent what a car like
intent what a car is going to do it's
going to turn alright and then other
cars no so you're talking like vehicle
to vehicle communication exactly I have
two traffic lights or whatever yes okay
so I I think it's different things I
think one of them is good one of them is
now going to happen so what is now going
to happen I think is very good a
communication the problem with a connect
to communication are public I would say
to one problem is it's gonna be very
hard to make every car manufacturer to
agree on a protocol of communication I
just don't see this happening like so
which type of the ATAG an exchange
because like you basically need to may
have many developers agreeing on a
common standard and also I don't see it
being necessary like you understand what
the other car is doing by observing
other car you don't need to know in
advance of what the other guy is going
to do and also like how do you trust
like you are not the developer like if
you're talking about they convey
communication between your cars probably
you can do something but you're not
going to have a fee that is large enough
to be relevant and to be something you
can rely on so if you have to rely on
somebody else development of like
attributes like in
path accelerations those things that are
not even simple to measure and to
predict in the future
well imagine trusting not something to
battle but trusting somebody that
somebody has developed so I don't think
even if it was the case I don't think
this being being useful like I don't see
I don't see one thing that instead I do
see happening is vehicle to
infrastructure communication between v2
ax so v2 action genera like this idea
that like the car needs some information
from the first structure so for example
like traffic light you want to optimize
for traffic you want to optimize for
like going from A to B you want to know
the state of for example of traffic
lights and so yeah you can know that but
that's different because there is like a
manufacturer or that makes the standard
and then it's up to the car developers
again to a standard that they didn't
have to admit to the Indonesia start to
comply with so that's that's a little
bit easier to push under standard and
also I see it being useful
I see like yeah I mean knowing in
advance informations that's useful and I
mean a certain size it's already
happening like v2 acts like if you want
to know like I mean like your GPS
position like in some senses be two acts
right
you're you are you are communicating
with with satellite so it's just an
evolution of what's already here yes
so standards for inter communication
already exist in the development world
why do you think it would be different
for autonomous vehicles like well why do
you think developers were in create come
together and create a set of standards
that they can develop on well because I
mean fundamentally there is really no so
I mean the death like a reason I mean I
saying yes you can be standard part of a
communication but if there is no I
really need for that like a real
advantage there's another reason for
that not to happen so it's two of the
course not only one so again on
something is not the course not being
useful he's another obstacles if you put
these two things together that's why I
see is not going to happen for for
because I'm not saying it's impossible
to agree on
as I'm saying that if there is not to be
like a big push for it it's not going to
happen
yeah I think if you like you people I
mean the companies should invest not
like understanding environment
understanding what other cars are doing
but it what are their like players on
the environment are doing based on what
you observe from them rather than having
them telling you what's like it's gonna
happen my work okay for cars but what
about cyclists what about pedestrians
and those are like equivalently are the
players on this on on the film like on
the environment that you have to deal
with and so yeah even if you if you
could help it's not something you can
rely entirely because not this
information cannot even come from all
the players in the environment security
measures you guys have been taking not
to hack your software yeah so I mean
like okay so you know when you develop
systems for for like level two is
different than when you al when you
develop like safety systems from level
two in abhava when we develop system for
like level two the driver is always
responsible in the end and so you need
to make sure that every action that the
car takes in autonomy is never gonna be
too abrupt to make the driver are not
capable of really taking control of the
vehicle if they if the car is something
wrong so by doing this you're limiting
for example the amount of like the
operational domain of your actuators
some example like the braking system you
need to make sure that your braking
system is never gonna command too much
braking deceleration because if you are
mistakenly braking when you shouldn't
think you are driving a highway at high
speed then you can cause an accident so
the way that you make the system saves
for level two is you limit your
operational domain what that translates
into is you are making a system that by
design is now going to be able to handle
100 percent of the mice that you drive
to give you like some numbers like
people that drive with the tez autopilot
from Statistics some people from the
University of MIT collected a large data
form from a fleet that they monitored
and thirdly I think it's 32 percent of
the miles driven are driven with
autopilot on for us for people to drive
with open pilot it's 52 percent we are
working towards the 80 percent maybe 85
we know we are not like by design of a
level system is now gonna get to other
percent there are certain environment
where if you have the cooperating in
autonomy there it's just not going to be
safe because in order to be able to
drive in this environment the car is
taking actions that you might not be
able to retake control quick enough for
example taking like 90 degree turns in
an environment where there are a lot of
pedestrian around like this is not a
place where lever to system if you want
to work environment you need level any
party no I think I mean like I would say
I
I recommend like if you want to get
involved with it a little bit more with
comma go on comedy our website or go on
our key time explore our code see what
we do and see what is like our approach
of trying to make the existing fleet of
cars smarter than what they are now
[Applause]
hi welcome everybody how's everybody
doing
good
great
let's wait for my presentation to start
cool so i'm rob i'm one of the hardware
engineers and today we're going to talk
about how comma actually works
um
click on working
oh there it is
it's a little slow
you go to the next slide please
no
so today we're here to answer the
question how can something like comma
exist
so
like we support most of the cars
that have been shipped in the last five
years and like how does this actually
work because if you think about it like
we have all these different brands
uh they all work slightly differently
you would think they would all have like
different standards but somehow we
managed to build a system with only a
few engineers which works on most of the
cars that are sold in the last few years
so how does motorcar actually work i
mean almost probably most of you already
know that most uh that most cars are
filled with a bunch of electronics uh so
we have a bunch of connectivity going on
we have the comfort system we have the
powertrain stuff which runs the engine
uh we have an infotainment system but
most importantly most modern cars also
ship with an ada system so what does ada
stand for
this click is not working great
there it is
i'm pressing the top one it's not doing
anything
one back
there you go so an advanced driver
assistant system so this means this is a
system that's built for safety and for
comfort so it has both lane keep assist
which keeps you inside of the lane if
you're not paying attention
probably doesn't work very well on your
car but it also has
stuff like acc adaptive cruise control
to keep distance with car in front of
you and what we really care about is
that the system has control over the gas
and the brakes
uh this is really important for us
because that's obviously something we
want to control
cool so how does this this ada system
look in most cars so usually you have
two systems uh which do the adas
which is the radar and you have the
vision system
so those are used uh the radar system is
used to measure the distance with the
car in front of you and you also have
the vision system to look at the lanes
and and give some more visual clues into
the system
these then send messages over to the
actuators such as gas brakes and
steering
which then
control your car
so if we look at this from like a
topology perspective we have all these
different systems uh so you usually have
the adas camera and the radar which we
already talked about you have brake
systems power steering engine control
sensors diagnostic stuff
does infotainment user interface all the
buttons in your car like everything
that's electrical in your car is
connected over these bus systems
on most cars these are actually divided
up into three different buses
keep pressing
oh it's the bottom one i seen it
uh so you have the power train bus which
is the most important one so this runs
all your engine control stuff uh you
have a body bus which is a little bit
less important this runs like your
infant demon system
um and all the other buttons in your car
and then there's one extra bus which is
a radar bus usually they separate this
one out because there's a lot of data
going on it so you don't want to
have all that data on the other buses
so if you want to control the car like
where do we want to be well first of all
we want to get the rate of points but we
also want to
uh
see what the camera is actually sending
so you have all these bus systems what's
actually going on on these buses well
all these buses use a protocol that's
called can bus
this is used in most cars and it
basically consists of these messages
with which have an identifier and a data
portion and they get sent around the bus
providing all the data to the auto
modules
so this is for example one of the one of
the messages that goes around on the bus
so you can see there's two two lines
there they go uh out
out to each other which means this is a
dominant bit you have recessive bits and
these that make up the identifying the
data portion and some model stuff you
don't really care about
so why do all the cars use canvas i mean
this is kind of a kind of a wonder right
like you have all these cars they're all
made by different brands and somehow
they all ended up at the same kind of
bus system
well it turns out that in 1996 when cars
weren't very electronically complex yet
they all uh
all were mandated to use a diagnostic
sport so which is called an obd2 port
you guys probably have seen this already
like below your dashboard there's a
sport which is useful diagnostics
um in the specification like it mentions
that you can use one of five buses of
which the most common one was canbus and
so all the car manufacturers just chose
the can bus and just went with it
um
now cars weren't very complex back then
so we usually only had this one can buzz
going on but after that like they uh
they merged out and when they built all
the all electronic systems they just
went with what they already knew and
they just went with can bus
cool now you know how a car like kind of
works on the inside like how do we
actually take control over the car
so
controlling the car is basically three
different steps so first we have to
connect to the can buses
after that we have to figure out which
messes is rich because they just have an
identifier which is a number and they
have a data portion which just looks
like random garbage
um
and then after that we have to
intercept it and send data control
messages
so let's first look at how we connect to
the canvas so if we go back to this
topology like like i already said like
we really care about the data on the
radar bus and we need to we care about
the messages which the adas camera can
send to the rest of the car
uh so the adas camera is in control of
uh joining the radar and the vision data
and then providing all the acc messages
which include grass and brakes and then
also the lane keeps test messages which
can
put torque on the steering wheel to
steer your car
so where do we want to tap off we want
to tap off
there you go
back there we go so you want to top off
at this point
uh this point is kind of ideal because
it's right in the cabin like uh this
eda's camera is located behind your rear
view mirror so that's the ideal spot to
tap off these buses
you don't have to mess around in the
engine compartment or anything you can
just take this connector take it out and
then mess with it there
so if we simplify this diagram so we
have the radar system which sends
messages to the camera and the camera
system sends messages to the rest of the
car
so what do we do we just connect to the
radar we split apart the camera and and
the rest of the car and then use a scan
to usb interface to actually talk to the
car
the scan to usb interface is called the
panda
and the open pilot device is the part
that runs all the application code all
the machine learning models which
actually then figures out which messages
to send
so to connect to the car we used to make
this thing called a giraffe
maybe some of you who've been around for
a long time still remember the giraffe
then we have the panda
if an africa comes up there's the panda
there's the white panda this is the
first one we sold
and as you can see this is basically
just an obd2 port which has three can
buses on it and it has a usb connection
to go to the open pilot device uh which
we used to sell which was the eon
this is just a phone in a 3d printed
case with a heatsink uh it's pretty
simple
cool so if you put this all together it
kind of looks like this so it's it's
not the cleanest setup like a camera
cuff is gone um like giraffe's just
bungling down there there's a panda
plugged in you have usb connection which
this kind of flaky
and then the device mounted to your
windshield
it's all about these these giraffes so
we used to have basically like four
types of giraffes these are the main
ones that we sold so we had the toyota
one
um which is common for all toyotas then
we had the honda bosch one which is for
honda cars but then with
a bosch camera installed and then we
also had honda harnesses for the nida
camera system now we actually have two
versions because you can anybody spot
the difference
um i mean disconnect those upside down
on one of them so with one day like
night i decided it would be really funny
to like fill up the connector around so
we had to make another harness
cool so she wraps so it's not a very
clean install you saw that in the
picture uh there's a bunch of switches
on it so if like an open pilot device is
not connected uh the car buses will
still be separated so your car thinks
the camera isn't there the radar isn't
there so it throws all sorts of faults
uh there's also like a lot of variants
all very different they're hard to
manufacture because they're so different
and it's also terrible naming like who
knows what you're talking about if
you're talking about your giraffe
so drafts are cancelled
so then we went
on 2019 we rethought this whole
ecosystem and you came up with what's
called the car harness so car harness is
a very clean install you can put it all
behind your camera cover uh there's no
switches anymore so if you disconnect
your device uh it actually has a relay
inside
which switches your buses back together
so if you unplug your open pilot device
your car would just think there's
nothing nothing happened and everything
will work great car is happy
so this whole system is very generic
[Music]
so we have like the cabling system we
have the stuff that plugs into the obd
port which is generic for every car we
have the harness block which we
manufacture this has the relay in it and
the auto switching logic and then
there's one custom connector for every
car which is the car harness
connector so this one's very easy to
manufacture because most things are
common and it's also a great naming
scheme like everybody knows what you're
talking about if you're talking about
harness
cool so we have all these different car
harness connectors because like at this
time we support i think 134 different
cars uh not only toyota and honda
anymore
so we have all these different
connectors we we got all of these made
so we have two for honda which we
already saw we have the nidak one and
the bosch one
like now that there's a harness
connector we can actually just flip it
around and still fits
um we have the toyota one we have the
nissan one which also has two we have a
vw one we have an fca one a subaru one
and then let's see undy
they apparently didn't think it was
necessary to make a standard in the
company like most of these actually use
the same connector but some of the like
buses they just like pretended it was
funny to flip the the high and the low
pair and it's like okay ship the car
that way
so we connected to the car buses this is
already figured out
now how do we know which message is
which because we have all we have all
these messages going on as you can see
like uh we did a log of all the messages
on the can bus this is a video of the
actual drive any of all these messages
going on there's actually a lot more
there's a there's a whole bunch of
messages you all have this identifier
and then a bunch of random bytes like
which like change during the drive
so how do you figure out how to
uh what part is which all this takes
quite a bit of reverse engineering
effort um
which we built a tool for called cabana
i think drew's gonna do a lightning talk
he's gonna talk a little bit more about
how to use this
but as you can see like you can label
all this data once you figure out which
is which and then we can actually see
like okay this message uh it's actually
for like wheel speeds so you have the
four different wheels of the car
uh so we figured that out you can plot
this value so you can see it corresponds
with the picture now where it's
stationary for a while and suddenly
start moving and see all the wheel
speeds of the car
cool now we have all the messages
figured out
where do we actually store these
definitions um
so what industry standards for these
definitions is called a dbc file which
is basically a definition file for every
can message on the bus so it's just this
this large text file which specifies
like okay this identifier is called this
message uh these bits and this meshes
say this
now these aren't
available from any car manufacturers
because there are like internal secrets
so we created this project called
opendbc which you also on github which
has all these reverse
dbc files for all the cars we support so
as you can see this is the one for the
civic which we were looking at before so
this is for example the wheel speed
message we were looking at with all the
four wheel speeds and then also it
checks them to make sure the message
arrived correctly
so what's what kind of messages go
around on the bus so you have sensor
values button states so if you press a
button like a bit toggles uh there's
control messages going on saying like
okay i want to accelerate by x amount of
meters per second squared uh there's
stuff about like what shows up on your
dashboard so you can throw arrow
messages on the dash there's a rate of
points going on from the radar
etc etc
okay we figured out which mesh is a
switch and how to connect to the canvas
what's left
well we just need to figure out like
which message to actually send like how
do we figure out what a battle message
is to keep you inside of the lanes and
not just like drive out of the lanes and
then bounce back so we actually want to
stay in the middle of the lane
well for this we need to look at
openpilot without all the fluff
so openpile is made up of these all
these services which talk to each other
uh each service has this one specific
purpose
um we call them demons so that's why
everyone and every one of them ends with
a d so it's camera d model descends and
he controls the etc so we have the
camera d which is responsible for
sending camera frames to the model
and a model d just runs our ai models on
them and actually outputs the
information we care about so for example
we have camera frame with small input
overlaid um then we have sensibility
which takes all the values
that the sensor outputs and then
those get all sent to controlsd control
z is a big blob of code
it's mostly mathematics with like path
planning and stuff which we'll look into
a little bit more
uh control z then actually generates the
car specific messages you want to send
which are then forwarded to the panda or
can to usb interface and then the panda
sends them over to the car such that the
car is happy
so that's our
let's go back to one more so that's a
panda inside of that coma too if you
open up the case that's what you'll see
so there's an sdmi controller in here
which provides usb to the phone and then
it has this obdc connector which outputs
the cam buses back to the car
and then here's the harness connector
installed on the car
so after that
we'll look a little bit into uh what
controls he's doing uh so control z
basically exists with like three big
layers so the top layer is the general
longitudinal and lateral planning so
this basically means okay the mole
outputs we want to be on this path which
are actually over here like what's the
actual best plan to get on the path that
the model wants you to be at
uh this then gets output to the control
loops which are very generic so they're
all um in si units or in like meters and
meters per second squared and stuff like
this
and they actually
um go from the path to like the
curvature you want to be in
uh and then the curvature gets
gets uh converted into an angle and an
angle gets into a control loop which
then provides how much torque you
actually want to put on the wheel to get
to that path
beneath all of this which is all generic
there's all the car interfaces
so each
car make we support has its own little
interface which basically specifies okay
like how do we want to send these
messages what rate how do we fill them
in
etc etc what are the card specific
limitations
and on average we managed to support 134
cars with only on average 45 lines of
code per car so this is really easy to
maintain we also don't really have to
own all these cars because a lot of this
code actually comes from the community
we only own i think six cars at coma
so a lot of this comes from community
contribution which is really nice
okay so now we figured out how to
control the car right so talk should be
over
well
no there's a fourth thing you have to
make sure that it's actually safe
uh because obviously you don't want to
be on the highway and then you will
suddenly start spinning like this
that's not a good thing
so how do we figure this out well from
the beginning comma set out to be very
safe so
we made this one text file explaining
very concisely
what our safety model is and this
basically boils down to two points uh so
the first is that the driver always
needs to be attentive and ready to take
over at all times so
uh comma 2 is a level 2 system which
means that it it requires the drive to
always be attentive and if it messes up
that the driver needs to be able to take
over
we
do this by enforcing that if you for
example press the brakes
or the gas that open pilot disengages
and you have full control of the car
again
the second part
means that the vehicle shouldn't alter
trajectory too fast for a human to take
over
um
so for example if you're going fast on a
highway you don't want the car to swerve
suddenly and steer you off the road
this is enforced in
our panda safety library
so the panda safety library is this
piece of code which runs on the panda it
runs on an stm32 which is an slb rated
microcontroller
is meant to be very simple so it doesn't
use a lot of external libraries it's
very easy to reason about and this
basically has
this basically enforces like for every
message if it's safe to send this
message or not so if you're going on a
highway and you want to suddenly steer
very hard the band is not going to allow
that so if even if like somebody messes
with open pilot code and you introduce a
bug or anything the panda will not allow
this message to be sent to ensure that
you're safe
so
quick example for example on the toyota
there's this acceleration message which
has id number 0x343
and it in it it has a 16 bit
signed value which basically tells the
car to accelerate or decelerate it's
divided by a thousand so in in the end
you get up uh with the limit you end up
with the limits minus 32 and 32 meters
per second squared now i'm sure that a
lot of you know that 1g is like 9 meters
per second squared so this is quite a
big range so you don't want your car to
suddenly slam on the brakes with three
g's of force
uh so the panda enforces these limits
so we have a limit between minus three
which is pretty heartbreaking and we
have a limit of mine of 1.5 which is
pretty fast acceleration but still
within our safety model so the panda
gets messages it checks if it's in
between these limits and if it is it'll
allow the message if it's outside of
this limit it'll block the message and
you'll be safe
so
to circle back to the beginning of our
talk um
how can something like comma uh exist i
think it boils down to three different
points
so first
more car the cars are more similar than
they look at first glance so we know
with all the the obd2 stuff that they
all ended up using can bus except for a
few german brands which use flexway but
whatever um
so they're all using canvas they all
have the same generic setup with the
radar connected to the camera and then
the camera sending messages to the rest
of the car that's very nice they're all
accessible from the cabin so it's very
easy to build the hardware
then the second point is that most of
the code based code base is very generic
so you saw that for example controls d
which should be the one generating the
messages is even mostly
car independent so all the planet stuff
all the control stuff is very
independent and then finally
um the heart of difference is also
abstracted away with the car harness so
most of our harm
or heart most of our hardware system is
very generic
with only the car
harness connector being the the part
that really differentiates them
thank you so any questions
[Applause]
um
yes i'm not sure if everybody heard the
question but the question is do we run
into issues with
oes oem systems detecting that we are
sending the messages inside instead of
the car itself
yes
now this this
this doesn't really happen
uh because for one we just got the can
bus in half we have all these messages
and the panda forwards every message
that comes through which we don't care
about so there's something with like
button stays or something it just passes
it through and the card doesn't even
know it was there
then second of all we use the same
structure that the ada system uses
itself
so we just replace the control messages
it would send so the car doesn't really
know who is sending the messages like if
it's either the ada system or if it's
open pilot so it completely mimics the
internal car system
yes
so questions about tesla uh actually i
own a tesla myself
so that's probably why it's one of the
carports
so i have an ap2 tesla
there's
the the autopilot module which is behind
the glovebox it also has this one
connector which goes to the radar and to
the car so we also built a harness for
that so i'm intercepting that and i'm
sending messages as if i was uh the
autopilot system now there's also the
people who
have very early teslas which don't have
the the ap system so which don't have
autopilot
uh so those are
also pretty big in our community with uh
adding open pilot to their car
it's it's i think open pilot is a lot
nicer on the highway at least um
i don't have uh longitudinal control on
my tesla yet uh so it does are still
doing gas and brakes so i still have all
the ghost braking issues that hazard
deals with uh but on the other hand i
think the longer journal is the lateral
control is really nice from openviolet
thanks
first thanks for the presentation it was
really great thank you um
how do you come up with the values like
the 0.3 for deceleration like is there
any better way to do it besides just
following each other around and break
checking each other until yes there is
actually a battery so
there's this body called
iso
which enforces these limits on car
manufacturers themselves so they publish
all these specs all these standards
which say like okay do you have to have
a safe ada system a safe ac system you
need to be between these limits so we
looked at those limits and we actually
enforced those i think on some of our
actuarial values were even like slightly
below the iso limits
so there's just from from testing
ourselves we found that we find out
these limits
to be very safe
um
so the question was how are the claims
about safety validated uh well the panda
safety is this
part of the c code which is very generic
so it has
it doesn't have a lot of interface with
the rest of the panda code so we
actually built this into a shared
library ourselves and then every time
this changes it runs through automated
ci tests so we
actually tried to break it so we have
all these unit tests on the code which
that's every limited enforces and make
sure that that these limbs are always
always
enforced also we try to
be
uh
implementing the iso 26262 standard
which is also one of the
one of the c uh safety
uh definitions uh which is i mean it's
just good practice if you're writing any
of these codes
yeah actually i was going to ask about
that
iso 26262 and if you need to be
certified to it and how are you reaching
that through software testing or
and and the hardware
um
well some of this uh just comes down to
static code analysis so for this we also
have automated tools to test this
but on the other hand um
it's um
it's still a level two system so
we need to ensure that this
uh
code doesn't mess up which we do with
our automated tests and other than that
we also still have the limits which are
usually present in the ecu's of the cars
so if you send a torque limit that's a
torque value that's too high and for
example a homework car it won't even
accept that message so even on top of
that there's the ecu safety which is in
the car itself
also iso is a standard not a regulation
so there's no certification body you do
self-certify
you're also looking for business oh miz
receipt yeah that was the name i was
looking for so so okay so mr you're
using mr c or not src plus plus or
we're using c uh cpp check to check all
the mystery regulations
um i was wondering how do you get like
the right can you get radar data from
the blind spot monitoring the two radars
on the back of the car
yeah so on
[Music]
that depends on the car so on some cars
uh the blind spot radars are actually
available from the the power chain
canvas and sometimes they aren't but
also on a lot of cars we see that they
don't actually output any radar points
um so they actually only output like if
there's a car in the blind spot or not
so it's only one bit so it's not
extremely useful um we still use it
though for our lane change stuff so we
check that there's no car there if we
have the data
but we're also working on trying to get
more data out of the blind spot radars
because they seem very interesting for
the future of comma
thanks for the presentation the
car harness is it
um will it have ability to accept more
cameras in the future or i know george
is uh all about the one camera because
it's you know the potential is not
fulfilled but going forward we don't
actually use the camera images coming
from the adas camera because it doesn't
actually send that data out over the
canvas so we use our own internal camera
in our open pilot device uh so the comma
2 which we now sell which has one camera
and for most stuff we do that should be
enough
um could you maybe speak to your
hardware failsafes if there's like a
catastrophic failure in the comma system
that reconnects the can bus and the car
is able to yeah is it is it like a an
analog sort of thing on the board it is
implemented in hardware yes so we have
this relay which is powered by the panda
so the panda says okay i want to be in
control which then actually is a relay
splitting the buses apart and then
actually starts forwarding the messages
now this can fail in two ways so either
the relay stays
uh closed which is very easy to detect
so you just see like if a message still
went through which you didn't expect to
go through
uh and another way it can fail is that
it uh stays open and then the card just
will fall because it doesn't see all the
messages because we're not sending
everything
oem cars tend to fall in the safeway yes
yeah
anyone else with a question
my question is also in regard to the
range limits um do you always know that
if it's out of range that you can safely
throw it away or would you consider
limiting it and um second one is if it's
like on the lower end of the range and
the higher end of the range is that also
kind of something you consider when
executing those messages
yes so a lot of these limits in the
safety code are actually based on speed
as well
so torque limits are based on speed
second
if we drop a message like this in
practice this shouldn't really happen
like this only happens if the open pilot
code uh messes up if it doesn't bug
because in the open pilot code we also
tend to uh want to stay within those
limits so usually we stay in those
limits and everything's fine uh if you
do go outside of these limits and this
would pose a safety issue then we would
just block the message and uh go on
today if this continues for a long time
and a lot of these messages get dropped
then the car will start complaining
because it does expect a certain
a certain frequency of these messages
great i've got a question back here
so i think i have a question about
hardware and oems potentially in the
future locking out
foreign parts and the reason why i have
this thought is because i saw videos on
like the right to repair and how
different companies make it hard to
repair their software without
you know they're assigned specific
hardware and i was wondering is this
something com is going to consider in
the future where it's not a problem now
but oems might make it so that only
certain
pieces of hardware can communicate with
their systems to control the car
uh yes so well first of all
we tend to use the same message
structure as the internal components
itself so as long as there's not any
signing going on the card doesn't even
know the difference between their own
internal modules and uh what we are
sending
uh second of all there has been some uh
very recent car implementations which do
use the signing and that's that's
something we're uh working on
i'll break it if i need to
[Applause]
all right
so i just have a question i think it's
similar to what was asked before but
rather than dropping the package would
it be better to just clamp it to the
maximum value that
uh the limit you enforce well that's an
interesting question well
we don't do this because we don't want
the panda safety code to actually start
generating messages so dependent safety
code is designed from the bottom up to
only be able to read messages and block
them
if we don't do this if we actually allow
the panda to generate messages
this will make the system very hard to
reason about so you'll have open pilot
which we lock then sending a message and
a car reacting differently than what we
expect uh so we've we just dropped the
message and then we know this is very
easy to reason about and we know what
the car will actually do now in practice
this doesn't really happen because
openpower is pretty good at keeping it
between the limits
great and we're sending a mic upstairs
so you guys can
we can hear you
um does anyone else have a question down
here
did you guys ever or do you plan to
maybe modify the firmware on any
existing car modules let's say if you
need to get around some limit that's
arbitrarily too low or too high on the
oem side
this is something that's been
going around in the community a little
bit uh we don't actively endorse this or
support this
but there is some people who have
figured out how to alter these limits
especially on the honda cars which have
a pretty low steering limit
so yeah
we do block these users if they if they
change them to unsafe values
thanks again for great presentation um
one note um would be nice if you guys
put it into some kind of uh
document like explaining uh
architecture and all that because it's
very useful for somebody starting
another thing i wanted to ask um
with the cars for the cars with the
weird arrangement like hyundai
they have radar connected to different
place what what is coma planning to do
about it um
while some of the cars have a slightly
different apology uh so i know on one of
the cars for example the 8s camera sends
to the radar and the radar forwards it
to the rest of the car uh usually we do
find a way to tap into those cars as
well though
sometimes
we just tap it off at the camera and
only control the lateral part of the
steering so we just control steering and
not gas and brakes
um which is an easy workaround but
there's also other harnesses floating
around which actually do
pull it off on a
split the bus at a different point which
makes us control the rest of the car
great got a question down here
um given that most of our cars are only
designed to keep ourselves within the
lane and we're extending that to you
know more active uh use of the steering
motors have you done any research into
if that shortens the lifespan of our
steering motors what the implications
might be there
um well
i think we can say pretty certainly that
this doesn't because these motors
they're not actually meant to provide
the ada system so not for linking assist
but they're actually there to provide
power steering so they actually put so
much torque on the wheel when you're
like just flinging the wheel around
yourself they actually put way more
torque on the wheel than we would uh
just driving it through the adas
messages so this wouldn't be uh this
wouldn't hit any hardware limitations at
all
for the dbc's you guys reverse engineer
do the companies care do they say
anything provide you guys feedback
i'm not sure if we ever got any feedback
on it but i'm pretty sure they don't
really
they don't probably even know it exists
um out of curiosity how does can fd
affect things is that something that you
guys need to consider and what are your
thoughts on it oh kind of d that's uh i
think we're going to talk about a little
more today so
i'm not going to say too much
so um
when you connect a device like carista
to your obd
um and you can unlock some features like
cracking the windows from your
key
do you have any messages like that that
you can use it's not really related to
self-driving but maybe you can detect
that the car is getting hot or something
and then just crack the windows
well yes i mean we have access to the
canvas so we can send any message we'd
like um
this is not something we'll support uh
officially of course but if people are
running forks uh some modified versions
of open pilots like they can certainly
implement this stuff
great do we have any more questions down
here
oh god here i'll
is there any plans for
weather related or or road condition
uh you know speed limits or checks say
freezing cold uh mountain pass
and uh
you gotta limit the uh torque
a bit so that your
safety uh increases
i think it's more of a question for the
for the next speaker or research uh
research hat
um this is more uh an open pilot
question there's not really any any low
level implementation needed there
so we hear a lot about tesla over the
air updates do they go deep enough that
they would interfere with you would they
be able to um break your connection uh
and break your control over the car with
an over-the-air update
i don't think so um
no i mean we're just tapping off the
bus
they don't even know we're there so
are there any um are there any concerns
with manufacturers like forking open
pilot and creating their own
version of it in some way or like are
they concerned with you guys at all do
you have any comments on that
uh i don't know if they're concerned or
not but uh i mean it's an open source
project it's mit licensed so they're
free to do whatever they want with it
okay is there another question over here
sorry could you quickly speak to what
kind of hardware you use are you mostly
microcontroller based do you have fpgas
on board and
what kind of latency throughput problems
do you have between sending receiving
messages to like the core
open pile back into the system
um i can't really come up with a number
about the total latency
but we do run all of our stuff at 100hz
and that seems to be more than fast
enough to get the throughput we need
canon is also not a time triggered
system so if the message comes a little
bit later like nobody cares about this
as far as which kind of hardware we use
on the panda is mainly an
stm32f4 microcontroller
which runs all the low-level embedded
real-time stuff
and then on the hardware side we have a
a phone
which runs all the open pilot codes
basically
there are several features that use obd
ports like some of the insurance
companies now have dongles and t-mobile
has a dongle
have you had any thoughts about
integrating with such things or ways to
make them work do i have to pull my
comma if i want to get a better
insurance rate
um
we don't work with these kind of
companies uh we have a pretty small team
so this these are all features that are
not really that related to self-driving
uh so i don't think we will spend much
time in uh integrating this but as i
said like it's an open source project so
if you anybody wants to make these
modifications they're more than welcome
to
because are there any other evolutionary
changes that you guys are thinking about
like car to car communication or
anything else
uh there's some stuff going on as uh
alluded by one of the questions so can
fd is an upcoming standard which
basically uh
makes sure that canvas can handle a lot
more data throughput and this is also
something we're looking into
great do we have any other questions
down here
all right thank you so uh so for
combustion cars you guys voted like a
sending message to uh vcu first and
obviously you're gonna do send the talk
command to the uh engine but like for
you cars the panda probably can do
uh it can it can directly send the total
command to uh inverter have you guys try
that
i mean how do you send the commands to
the inverter of an electric car yeah for
e cars you can use panda directly send
the torque command to invert and kind of
bypass the
ecu
fundamentally these systems aren't very
different so they still they're still an
acc system which is very similar to
non-electric cars and they also still
send the command which says like okay i
want this amount of acceleration of
braking and the invertible handle is
exactly the same way as a regular
fossil fuel car would
great
if we don't have oh we got some more
questions down here
a lot of questions
is there any worry as more cars have
over-the-air updates that they could
roll out something like the rav4 prime
encrypted can bus where you could have a
vehicle that works and then over the air
that encryption is rolled out or is that
too low level to worry about that in the
future
i wouldn't be worried about that if you
have a car right now which doesn't have
any encryption going on
they're not going to be able to do this
over the air like most of these cars
don't even have over-the-air updates
i think that's the only big manufacturer
which really has that at the moment
but also this this encryption stuff
usually requires a more advanced
microcontroller than all of the ecu's so
you can't just upgrade that over the air
so wouldn't be too worried
hey um can you also elaborate a little
bit on the next version of
hardware what is what is in the
to-do list like what you guys working
for i'm sorry i didn't fully understand
like uh next version of the hardware
what uh what is uh what was in uh i mean
what's in the pipeline however
oh
it's not my point to talk about today
have you considered building like a
flash utility in the open pilot so you
can actually do updates at the ec level
like true ota updates like for your
car's controllers
well no because for once uh
for one part we don't really want to do
easy up ecu updates uh this attaches a
lot of the safety stuff which is
internal to the car
and second of all we don't really need
to do this like most cars have a pretty
good interface as it is so
this this is pretty complex and we
wouldn't want supports for the different
cars obviously
great if that's it i will thank you so
much roba
[Applause]
you
yo I wonder if anyone's gonna show up it
is Easter alright alright alright now we
get people so you know it's uh this is
this the theme of this dopey Sunday is
safety maybe I should put my safety
goggles on it safety let's go be some
that no I actually bought these because
my eyes hurt from staring at computers
constantly so it's like flux for your
eyes scope II Sunday is back yeah um
because it's Easter you know so I bought
these actually because it's flux for
your eyes right oh it's able to lose
their - pretty crazy right I'll take
them off they look fun of the office no
but we actually was serious topic to
talk about today we're gonna talk with
safety
um so you know there were two uh two
crashes recently there was the uber
crash and the Tesla crash you know
sometime they like to call them
accidents and they are accidents but you
know crash is a more descriptive of what
actually happened um so first of all I
haven't really said anything about them
until now I wouldn't go that far
I'm sorry I wouldn't go far enough to
say that it wasn't
Uber's fault I think actually most of
the blame in the situation lies on the
safety driver remember guys there's no
such thing as level four self-driving
cars there are no self-driving cars that
can drive better than people some of
these driver assistance systems when
used in conjunction with the person nope
so open pilot is not anywhere near a
level four self-driving car and
everybody who uses it should know this I
question I question uh if you don't know
this I question a lot um so it was it oh
burrs fault I wouldn't blame the
engineers
Uber's fault invaded a vetting and
monitoring their safety drivers I would
say some of the blame lies there I would
say most of the blame lives with the
safety driver themselves not looking at
the road and you know the person I mean
don't blame the victim but she wasn't
being very careful so what's the take
away what's the take away so who's also
a a Tesla crash if you guys saw the test
the crash that hit the the concrete
barrier model acts totally burnt out in
the front so Tesla released a blog post
and then a follow-up blog post turns out
the car was on autopilot and there was
no hardly anyone could get there open
pilot working with their cars to come a
wholly fine I mean to be honest so when
you look at Tesla's statistics they're
they're pretty fair I mean look to think
that you're gonna have a system that
prevents all accidents is ridiculous the
goal is to make things safer and you
know Tesla obviously interprets the
statistics in a favorable light but I
don't think they're very far off from
the truth
uber statistics on the other hand do not
look good
we have a fatality on the roads I
believe Tesla said every eighty eight
million miles will usually go with the
number about one in every hundred
million and yeah Ober had only driven a
couple million miles so that was that
was probably far too soon there was an
interesting article that came
a computer segment of no I know no I
where you guys post the memes and I lead
them um this is an interesting article
former uber backup driver we saw this
coming I mean it's it's a clickbait but
um it actually the most interesting
thing I found in this article was yeah
you know this was one of our biggest
rules no phone in the left seat you know
we'll get to after we'll get to we get
to shit-talking Scobie Sunday in a bit
um so look at this so far roughly a
dozen operators have been fired for
using cell phones on their job and they
absolutely should be they absolutely
should be honestly if I was in if I was
Anna nuber and the uber driver was using
their cell phone in a way that I thought
was kind of unsafe like looking down for
five seconds I can say something I would
certainly give them a bad rating so yeah
guys don't don't use your phone and you
drive but the bigger problem is maybe
this when you guys drive with open pilot
one of the things that I think makes
open pilot a bit a bit safer than the
uber thing is you guys aren't driving
for 12 hours straight knowing these
people who were probably pissed an hour
early and they probably drive constantly
for 12 hours or eight hours or whatever
you get tired um but I do think that the
way forward for the space is driver
monitoring so if we look super cruise
has great driver monitor
I should have my links already
so maybe they show yeah so right here
I'm sorry I tried out supercruise on
Sunday I was very impressed they have it
they have a camera monitoring the driver
it felt very unlikely to make mistakes
which in some ways is bad because it
reassures you but in another way they
are they are monitoring you so I do
think that's the either way forward um
so this is my draft medium post that
I've been working on safety and driver
attention this is an interesting link
let's take a look to the left is the
original video in the middle is a
detergent glanced and action last
classification on the lots of images to
the Neal Network and then then you'll
know what produces on the Euler network
so happy Easter yes we're gonna start
doing similar sort of stuff so here we
can see yeah this was pretty good so
here's me in the for infusion um yeah
that's the uber video yeah um so this is
recorded with the front camera of Annie
on now this is recorded with the front
camera of a right-side up beyond I
deleted the one I recorded with the
upside down beyond but if you guys have
seen this is the way forward for iOS
come with the next release we're gonna
ask you to flip the top and the bottom
pieces we're also gonna start to offer
optional front camera recording and
uploading um so the the front camera
upload and record will be optional uh
when we do ship driver monitoring stuff
it will be mandatory um now I still
think we're in a were in a pretty ok
situation because you know open pilot
still makes a decent numbers
and as long as it does make mistakes you
won't confuse it for a superhuman system
also I hope nobody is driving 10 hours a
day you feel so sorry for the safety
driver I mean again if we had to if we
had to you know put blame you can also
break a lot of safety down into into
three categories right um so with a lot
of car companies talk about safety not
not all of them you have legal safety
which which which legal safety is very
concerned with okay who's to blame here
you know how do we how do we make sure
we stop down on this behavior that's
somewhat of an okay problem um then
there's signaling safety signaling
safety is to me absolutely disgusting
when you see you know oh my god like the
way they they write up these like you're
not helping the problem you're just
trying to virtually signal and I think a
lot of problems in the world are caused
by very sickly um but what we care about
is is is statistical safety right so we
now have hundreds of people out there
driving with all the pilot and we want
to figure out how to not just make open
pilot you know as safe as you doing but
how do we how do we move forward toward
making it safer right so open pilot is
always watching the road and then with
you always watching the road the most
cars in the road have at most one and
you know sometimes a little bit less
than one may be the expected value for
most cars in the road of a driver paying
attention is like 0.98 honestly if you
look at that situation if there was no
uber or anything criminally charged a
driver
you get their phone they tell somebody
maybe you do oh yeah you know I'm not
really interested in in who's to blame
I'm interested in how the industry moves
forward so who's that
uber
but yeah so we'll be releasing in two
weeks we'll be releasing the front
camera recording option and the
instructions to flip around your so as
you can see we haven't uh no I'm I'm not
interested that's the concept of legal
safety right like I'm not been
interested in determining the truth I'm
interested in getting the facts that's
why I didn't really say anything about
this you know everyone who said things
about this especially before the before
the the dashcam footage came out but
yeah so no actually so this is the
difference between organizations like
NTSB initiative right initiative
turbines like who has to pay and who's
to blame and what the but then a
organizations like NTSB who look like
they're really just trying to get to the
truth of the matter um so interesti
report on autopilot blasts if you
remember it they went into oh yeah you
like my big mouse pad big mouse pad
right I bought it before PewDiePie was
on the big mouse pad thing - how does it
handle running both cameras at the same
time both cameras have been running the
same time the whole time we run the
front camera the whole time we don't
upload it we don't record it but it's
been running so I would worry about that
we used it we used to use it for that a
rear view mirror thing which which
pretty much no one uses anymore but um
yeah so you'll be able to record both
cameras at the same time we're gonna
make it so you'll be able to access all
your front count and we haven't been
monitoring you don't worry we got our
first front camera footage today from
Annie on and one of our yachts no we
don't record the front camera we don't
record the microphone now we're gonna
have optional front camera recording but
it's gonna be off by default I'll begin
like I said if we do ship yeah bro III
know I don't wanna know you doing the
front seat like that's I don't really
want this video though but I think it is
a good step for safety could I display
the back of camera on you and you can
display the back of camera
um yeah facebooking back right right I
certainly don't want the mic I don't
even want to do optional microphone to
be honest guys I just I don't want that
data right you know that's certainly not
not a safety thing
the front camera I think it's the way
forward I think it is the way forward
you know Tesla shipped they called the
selfie cam in the model three so that's
kind of my take on these things I think
both of the recent accidents and that of
course the auto pilot truck accident in
Florida the auto pilot death in China I
think all four of those how much meth am
I on I think all four of those would
have been prevented if the driver was
paying attention
the new model doesn't use the blockchain
I have a left rolling okay this is
serious sculpey Sunday no oh oh you have
a giant panda if you have a giant panda
and you put that in the Neo I'll take
that back and you can I'll leave you the
discount me I'm sure you want audio to
catch other side admitting fault focus
focus so not interesting you guys what's
interesting is like just how can we how
can we improve statistical safety period
right anybody who's actually right you
know I think the computer security
industry is particularly like despicable
when it comes to a lot of this yeah well
not just drivers should pay attention it
you actually have a this this this may
be the word is uncanny valley for glad
to see you and yo we've kept I cannot
safety a lot right I just don't like
those safety is at the heart of
everything we do
what's that even mean like what you're
doing there is you're emotionally
signaling right please show me if you
care about safety please show me the
facts which test the crash so yeah I
mean Tesla has also gone billions of
miles with autopilot so to say there
have been three deaths that we know
about maybe some that we don't but still
the numbers I'm sure and far from what
you would expect
mandatory upload no no so mandatory
upload there's no mandatory upload for
the front camera I really I don't want
pictures your face if you would like to
share that we would certainly appreciate
it and will reward you with common
points but which facts but much
different discussion than ASCO P Sunday
should use this is a higher brow version
of shit-talking our competitors right um
yeah we can go somebody died with
autobot well again uh a week ago someone
died in it in a car crash to say that
like it was autopilot I mean autopilot
was on but we don't know again not maybe
I'm talking too soon about both of these
right you you still you have no idea
what what really happened all right bro
you're banned but yeah um do I know
Jimmy Jimmy so I don't know who that is
it's not like one of those things you
say like I want to see you pee or
something are you gonna buy a CD six
unfortunately we're not they're
expensive great pandas are a great pen
if you order the gray panda I'm sure
it'll ship Monday um if you if they're
out of stock then you gotta get a
getting quick when they go when they get
in I don't have facebook what I mean
yeah no shit I Drive the car right like
oh my god I don't care of course I care
about about safety it's like you you
have to there's no point in signaling
right and this is not you know this is
not signaling him I'm here to talk
honestly about a change that we're gonna
make to our to our open source a
self-driving car you know why we're
asking you guys to to flip the Aeons
over and anything else so maybe we'll
start a we'll start a slack channel
maybe we'll add a channel to the main
slack hash tag safety
and it's really a constructive
discussion about how we can move safety
forward yes we do keep stats on that
I mean people recover people touch very
quickly after after the awareness limit
I don't think there's like hitting the
limit is not necessarily bad I'm getting
special open pilot update for grey panda
users so that's coming but no this this
this sprint so we work in two-week
sprints this sprint we're really gonna
focus on
all right the things that we have on the
board are safety was there ever a crash
with open pilot um not that I know about
was there ever a crash wall open pilot
was engaged not to know about there was
there have been a few crashes in cars
with eons that we know about while the
system was off and the main one thing
was actually talked about on slack as
there was a rear ending if someone was
rear-ended it may be 10 miles an hour
not fast yeah it's interesting to you
know view that in in Cabana
well front-facing camera impact the
awareness limit so yeah I mean this is
kind of the replacement for the
awareness limit going forward so what
we're going to ship in the next release
is just front camera recording not front
camera monitoring yet interested in a
research paper on self driving unsafe
driving behavior maybe so again you know
we don't we don't even sell anything
that drives your car we give away some
free software we trust that the people
who here's the thing here's a here's
another thing where we're you know these
are my personal feelings on a company
and consumers we trust that you're smart
we trust that you guys the users have
open pilot you know aren't out there
doing stupid things now when you have
you have us so when you have Tesla this
is generally true you know you have a
certain sort of consumer who's probably
more more educated on this kind of stuff
when you if you want to reach millions
and millions of people
you've got to uh got to make it more
idiot-proof right oh the EON is a
dashcam the EON is absolutely a dashcam
it's old it's a trashcan like it really
is it really is a dashcam you know we do
make dash cams do we make a chipper app
we give away some free software called
open pilot um it does run on the EON do
you think factory sensors have fast
enough response or self-driving I think
almost every sensor is gonna have a
faster response in humans talk about
Aeon flipping
so the reason we flipped the Aeon is
because it puts the camera where it can
see the driver it puts the the front
camera where it can see the driver
what would classify as a non aware
driver a driver not looking at the road
you can see check out the MIT thing we
don't know yet so I suspect that okay
okay
okay some people just need to be blocked
bam bam we got a BAM people men
telescope show you better I thought I
loved batting people you know there's a
good there's a good eliezer yudkowsky
thing which talks about communities that
don't oh my god there's a good eliezer
yudkowsky blog post where he talks about
communities that don't ban people oh my
god oh good I lose some gun in the
Internet come on come on come on bro you
know I'm sharing my location on
periscope let's go um chat going crazy
today yeah oh yeah so we're gonna build
our own machine learning driver
awareness monitor from those people who
are nice enough to volunteer their
front-facing cameras
freaks on the internet guys but you know
what for the most part the Internet's a
lovely place you know positivity 105
scope is safety safety sculpey sunday um
sunglasses are show off the safety
sunglasses
I didn't actually get these for safety
it's like flux for your eyes yeah makes
my eyes feel a bit better will volunteer
thank you very much
um yeah we'll be recording on our
cameras we'll be recording on our cars
as well so I think kind of the way to
move forward and I think it'll be pretty
standard here's the thing - ah the only
one here today guys it's Sunday
he saw that autopilot worked without
lines oh how it works without lines kind
of I think works very similar to has a
Khmer I consider doing a security token
offering when there's a regulatory
framework for security tokens perhaps
well a smiley face balloon considered
eyes on the road absolutely not
front facing camera required for girls
for a minute no it's unrelated to the
Goldstar minute program the goldstream
minute program is just whether we can
make an app for your data from your data
so we will give point 5 camera comma
points per minute
for each person in a if I'm facing
camera what does the industry need to
focus on it under make something better
so you guys see here I'll show you what
I was working on and working on depth
we have much better depth nuts than this
but this one was chained unsupervised
just kind of cool so we can look at the
image down here and we just hide I'm
totally doing self-driving for winning
hey I'm not opposed to saving lives guys
but I'm doing it to win I'm not gonna
virtue signal and say anything else what
would I do is head of uber self-driving
think I'm doing here
I don't know I'd probably fire a lot of
people I think uber has a lot more
tolerance or bullshit than I do
everything torrents bullshit guys
whatever the problems to solve winning
is good keep winning I like winning no I
don't think that you have to go there
I'm sure that's that's like Chris our
instance take on it Chris Urmson steak
after somebody fell asleep in the Google
car was that there's no way to ever do
safe anything except for full autonomy
let agree with that conclusion but I do
think that you do need to monitor the
driver I had always kind of thought that
the current level of systems wouldn't
require driver monitoring because they
just aren't that good but better to
start now it's better to start now on
this kind of stuff who's the most
underrated autonomous car company zooks
will gray panda follow road track
smoothly without a base station so no
you can't using GPS alone you can't
localize accurately enough to follow a
track whose fan of AI isn't that the one
that like rear-ended somebody no the one
that we ran did somebody with the
reporter in their car if nobody gets
hurt it's still funny guys it's only not
funny when people get hurt what's comma
missing to take them to the yeah it does
fanime I
that was great it's not funny if someone
get hurt but if Noah gets hurt
this is no permanent consequences is
funny Oh Otto axe know what they're up
to
they're you know the guy's a computer
vision expert the car got all the poor
car yeah that's it's still funny it's
still funny if the car gets here all
cameras yeah they're all cameras I don't
know what their execution strategy is
you know they came out kind of a year
after us where you place it exactly
doesn't matter that much drafted AI is
way overrated I forget it but you know I
think the company's practically my best
camera just just their their rhetoric in
their blog posts they raised this overly
inflated there is 50 million dollars
right that's not a good thing um so we
raised money recently we haven't
announced how much or what valuation or
anything like that but I will say this
it's a lot less than 50 million dollars
because we're gonna do 50 million
dollars I don't need that right like you
shouldn't need that unless you've
ballooned your company to some inflated
size until of course you're a company
that's making you know tens of millions
in revenue we're not making tens of
millions in revenue yet
how does comma fit petal fit into safety
plans the coma petal is totally not a
product that's totally just for people
to mess with you know be aware that if
you're using a comma petal the absolute
worst-case is unintended acceleration
where you can step on the brakes put the
car in neutral but that's pretty
unlikely to happen what's a lot more
likely to happen is your car will lose
acceleration well either lose full
acceleration go to limp mode or lose
acceleration entirely that's QM in the
new auto industry yeah I'm surprised all
your people are here so that's
considered QM so you know you don't
really have to worry about that me
safety perspective that's just like you
know yeah you want to work I know come
she's never coming out guys I don't know
I don't know who's trolling with comma
steer I mean a lot of if you guys read
you know since we are talking about
safety
we'll go through the document that ships
with open pilot if you guys haven't read
it
chips the Dalton pilot called safety so
[Music]
basically our guys eat the effects of
super dangerous don't do them um you
have to two requirements in order to
make our system safe the driver must
always be capable to immediately retake
manual control of the vehicle by either
stepping on the pedal or pressing the
cancel button now this assumes of course
the drivers paying attention but yeah
the driver must always be capable we
could phrase that better
why was climate change the vehicle must
have altered the trajectory too quickly
to safely react meaning that's where you
get into torque limits so we limit the
gas to brake and the accelerator the EPS
mods you know there's a reason we don't
release them they are they have the
potential to be extremely dangerous so
with a bad EPS mod what you could
theoretically do is you could give
you're trying to steer the car the motor
is a lot stronger don't mess with EPS
plants guys unless you really know what
you're doing if you really know what
you're doing and I hope that whoever
figures out the EPS month doesn't
release a three step guide to EPS modern
right
so yeah the danger of EPS mods is that
motor has you don't need full turning
you don't eventually eventually maybe
but there's a lot that needs to be done
before them that's why we haven't
released that kind of stuff yet this
much easier ways to get full turning
besides EPS pods guys though no I don't
go to comic-con
I'm not I'm not a very deke guy like I'm
just not that i don't like cosplay anime
but yeah the yeah the property PS mods
is the motor in the car has more
stronger than you are so it can turn the
wheel
regardless of what you want to do so
that's why it's a little bit a little
bit dangerous whereas your braking is is
is is is always kind of considered to
safe action yeah at least it's strong
enough it is strong enough what
alternatives to EPS but I'm not gonna
I'm gonna tell you guys you know you saw
us driving the Prius around that wasn't
an EPS boy oh but there are ways to do
it
there are ways to do it and if you if
you figure them out then I you know
you've earned all kind of a you know I
believe if you if you're smart enough to
figure it out I believe you're smart
enough to be safe with it because I
believe you're smart enough to
understand the real dangerous any path
what does Tesla use flex right no I
don't think so
these Ethernet I think there's a lot of
their cars connected with like hundred
megabit Ethernet legit put an electric
that's what X Maddux doing right wheel
brakes for turning guys have you know
you know now okay see here's the thing
about EPS models the honda torque is
extremely low even probably for xing the
honda torque you would still be lower
than Tesla's torque and you'd be kind of
on par with Toyotas torque so there
probably could be quite a bit more
torque and have the system still be safe
now unfortunately they didn't allow this
by default so if you are super super
careful with mods and you know then you
make them on it's your car I'm not like
trying to stop you I'm just not gonna
help you right that's my it's my
prerogative as a free individual in
society right um but we have two other
things on the board
she do Berliner have detected the
pedestrian hit the brakes see the
problem with talking about that is
you're only looking at the one situation
where it didn't you don't even know kind
of what the success rates were until and
you know at least have a Tesla for
releasing the blog posts the blog posts
show something to the company I think
ubers released absolutely nothing on the
crash which this is bad PR perspective
really state family okay but doesn't
give me any information I mean I don't
even know whether that's true or not
anybody can write those words whether
they believe it or not you give me
information Wow
let's see that's that's that's you know
something I think I'm JSP yelled at
Tesla but Stewart things on the board of
the two more things on the board are
Amazon and ship plus and Amazon means
pandas will be going to Amazon and
shipper plus means shipper plus will be
made good we have to do a religious
checkup losses but it's been far too
long I want to let you guys know like
when I do releases anymore I know you
know we did the last release new all
complete more release ever no that's not
- you're gonna do we're gonna do 0.4 0.4
as a release why three commas on the
board well because you know how long
before worth a billion dollars right our
valuation is not a billion dollars yet
almost maybe maybe it's closer than it
was four three two is good good I'm glad
you like it
pandas do have SKU yes we bought
official SK use I don't know why jump
disapproves of Amazon Manas that's
between Trump and Amazon I have food I
like Amazon you know I like that was on
you know I find though there's a lot of
companies out there I don't like but
it's cheap it's good I don't know you
know I don't know anything else to
discuss on safety scope II Sunday
do I like Zuk Zuk sis incredible comic
relief yeah Nvidia self-driving yeah I
like Nvidia which company do I hate the
most
the Kinect I hate anybody who gotta take
themselves too seriously you know and
people have bad technology if you both
take yourself too seriously and have bad
technology I really don't like you if
you take yourself too seriously if you
have good technology it's forgivable if
you don't take yourself that seriously
and you don't have great technology
that's forgivable - OH
Desalle around terms yeah absolutely
once we have maps will we do you sell
our on turns and I know we show the
alert too much we can we can do better
you need to be am i chilling fun I'm
pretty hardcore guys I'm pretty intense
well I sell in European Amazon totally
not that sounds hard
what about using an existing EPS system
in a different car I wouldn't do that
open tanda you in the case are you guys
working on a board - you know if you do
it you do it I'm not I'm not opposed you
know you guys know my feeling I know
actual property I'm not gonna send you
the board file but if someone remakes it
uses the firmware like I know the case
yeah good you know the case is not the
kids ain't a big secret you could take
our case off and use that using 3d
printer the case is a big secret on the
e all now not open e on what else it's
gonna look at me PS flash guys but theme
over the next two weeks is safety so I
mean if you're the French website yeah I
don't know if someone wants to buy me a
Pew Joe I will still not support it cuz
I don't have time I already told ya go
good it was just
I got rice krispie treat plan yeah yo
you guys know I've come around a lot on
mobile hi and mobilized blog post where
they released
tactic new pedestrian that was your
savage that was your savage like when I
saw that I just couldn't believe mobile
I did that
pure savage props to Omashu uh-huh yeah
boo boo drivers EPS mods increase save
do you know they don't pay attention 1k
for for giraffe but you mean like a
bounty or you're willing to pay me a
thousand dollars were for giraffe
what about Yolo what just like like as a
life motto that's like or like Yolo net
yoga meeting meeting rice crispy lamb
we're gone
alright I'll put it up on the store
shipping time four to twelve weeks
Yolo self-driving Yolo net it's I think
that the idea of like detecting a type
of object is dumb I think that the right
solution is you want to whitelist not
blacklist right you should never listen
to the thing is that you will not hit
you should have a list of places you can
drive this is known as like free space
detection I think free space detection
is a much better idea than like trying
to class up identify and classify a
pedestrian right um
just do it so someone to learn I I if
you ask my TTA nephew Eric it's
somewhere in between February and March
you don't know your money but you
Shepherd alright alright um well Neil
continue to work yeah I mean I'm not
gonna like I can't reach into your neo
and break it you guys know we are
offering a neo to egon upgrade $400 and
sending your neo and we will get you a
brand new like new phone one plus three
T 64 gigabyte eon
when will ship with cash in the box you
can't send cash in the mail bros the
drug dealers made that illegal
you used to be able to sing cash in the
mail but then that drug dealers messed
it up for everybody
[Laughter]
don't you need pedestrian detected to
predict their behavior yes maybe but
that should be in a do you not really
know you actually need to detect the
evolution of free space over time
oh is the DSP only unlocking with the
Aeon bootloader maybe
oh yeah the DSP oh free the DSP calm
guys how do you keep focused when coding
so like I sit in cold for like 12 hours
I wake up in the morning I code for a
couple hours I should talk for a couple
hours and sometime I caught a night
multi vehicle convoy mode stupid
I do like Mountain Dale I'm one of those
guys called red man
Code Red Mountain do they know they know
their target audience no that shit's for
me favorite Twitter accounts who do I
like oh you know they've been blowing up
lately like like um neva and that whole
crowd you got like the guy with the with
that with the half face I follow a bunch
and you see you my favorite Twitter
accounts of the people I follow you know
people who are interested in truth I'm
interested in truth I love truth guys
model predictive control even even if he
hates me man he's awesome that I'll
always think that even if you all let me
buy one of his cars I forget there was
something I was gonna respond to there
but yeah my dad's an OG right but that's
pretty cool what do you think I learned
this shit from guys but you know ma'am
adjust following distance know what's up
with the comma sign on your hoodie bro
we're calm a I know we're high we are
calm a I check us out comedy I we make
open-source self-driving cars our slogan
is ghost riding for the masses
can you come visit common HQ no you
can't no we don't do we don't do visits
but you can watch on periscope where can
you go to PewDiePie's apartment no won't
the car be unable to stop for a waiting
pedestrian well yeah but there's there's
other ways to track it right like you
can track the evolution of free space
over time yeah of course we can hold the
address I'm not gonna give you a tour
like you could just show up here and
we'll be like no no door and close the
door and you'll be like why did I come
here has anybody got a comma tattoo yet
not that I know I don't have any tattoos
oh man yeah we got our cream of dads uh
he's got he's got a nice on man I can't
use his wheel speed sensors maybe I can
run my dad sniffer plus I do you want to
be interviewed in your radio show in
Minnesota yeah if you send a so viv viv
VI V at comedy I reach out and yeah if
it's easy we'll do it am I gonna do
another cross-country tour absolutely
the self-driving car awareness tours
every year bro you know the three commas
in Silicon Valley yeah yeah yeah of
course the free space would not be
affected by a pedestrian waiting a
sidewalk no not the free space at the
time but a prediction of future free
space would which is probably the space
you want to operate and you want to
operate in pixels and not objects yeah
what up dad random but how old are you
how old you think
yeah my family's back in in New Jersey
I'm here in the coma mansion am i famous
I used to be famous guys I didn't want
to be famous sauce a scam I'm 28 I'm 28
now you really don't to be famous I
think that was the last time like the
periscope went on too long because I was
bored I started really telling you guys
about like yeah I'm 28 I'm 28 I'm 28 how
does factory Toyota pedestrian detection
work not well what was it like when Sony
sued you yeah yeah come at me bro you're
27 didn't do shit with your life well
you know today's the first day of the
rest of your life go do shit right what
can I say thank you
today is the first day of the rest of
your life that was a line from clerks
too which was an incredibly sad movie
like clerks was okay have young guys
work in a convenience store clerks too
is about like some 30 year old to work
at a fast food joint that's sad
operating pixels not objects is that a
clue no radar can operate in pixels as
well so what I mean by pixels is like
area delimited not object too limited um
the objects are all done later on in the
radar so you can certainly you know you
just what do you want talk to you listen
to him talk about Oh Gracie I've found
the golden egg man um you can radar
cameras are the same thing kind of I
mean Raiders are a midden they emit
but like you can still just talk about
them as like they're fundamentally you
know just listening on frequency right
and that's what the cameras doing as
well but a camera is passive and not
active oh wow bidding light up guys I
really will put that up if someone wants
to pay $1000 for for giraffe we'll build
it it'll shift in four weeks uh yeah
we're summer entrance um gold star
portal soon - and soon
yes summer interns give me a job at come
AI what I ever join the army for free
med school I have absolutely no interest
in going to med school I'm a little bit
more interested in joining the army to
be honest if I could go for like a six
month basic training I would volunteer
I don't really want to be deployed but
um if they could put me through basic
training and basically if somebody comes
to invade America I'm called up only if
someone calls to invade I'm not going
over there I'm not fighting anybody over
there but they come here if somebody
comes here to America you know them down
to fight hacker are you gonna hack it
I'm an X hacker I'm retired
just like Julian Assange I shouldn't say
things like that you're scared of being
deployed - yeah I wouldn't want to be
deployed uh in the army
we should talk about oh yeah that won't
you talk about let's go bro let's go
let's talk about working together let's
go hi thank you for coming on periscope
by the way that's this is the way that
we can interact with companies anyone
who sends me an email the Deaf doll man
yup I'm thinking about it yeah you know
I'm not sure what the Army's like today
but I support the idea of like an
organization like that I'm building
those skills thank you for being here
you're welcome
yep I don't think I'm actually gonna
join the army but there was something I
considered at one point my life my
mother told me I can't though what am i
eating I'm eating rice krispies treat
lamb my mom said it's me X hacker I'm an
X hacker but okay so let's hear about
this plan for working together with an
electric car company any chance we'd
open another office location absolutely
not no I didn't try again to buy a Tesla
by one they don't want me to buy one I
mean I'll respect that you know I got a
respect respect for someone I didn't
know you know it's just cuz I respect
Tesla's because I respect Elon with
someone I didn't respect I get your car
but you can't stop me basically using
all the Tesla patents for the drivetrain
now no no no no so so here's what I'm
saying how far you along how many
how many cars do you have well yeah how
many have you built that's that's that's
the real question right your five
prototypes okay and then what's your
what's your ramp up plan when do you
plan to when do you plan to ship cars to
consumers okay but when do you plan to
ship cars to consumers okay so you're
past the prototype phase only for a
ride-sharing no consumers okay I mean
but when do you plan to like scale up
production and then if you're only using
it for ride-sharing I mean okay um so
what I would say is here's how we can
work together if you want
cama AI to write a port for your car
it's one hundred fifty two hundred fifty
thousand dollars and bring us a car
and put two hundred fifty thousand
dollars in escrow will write a port for
open pilot and then that port will work
similarly to other to the other cars in
the open pilot fleet and you'll be able
to buy Aeons and you'll be able to
install them in the car so yeah
basically what we can offer to aspiring
car manufacturers is a 250 K port
package will port it and we'll push it
in the open source code or I'll compile
it will push an open source version will
push basically a branch that works on
your car
$250,000 now if you're thinking about
making cars $250,000 shouldn't really be
a consideration to you has anyone in
Australia engaged open palette yes we
were few Australian users yeah no I mean
look it's 200 decays really incredibly
cheap um so we don't basically we don't
do meetings we don't do we have so many
meetings where nothing happens um that's
my deal when you're ready to move
forward with let's say a $50,000 down
payment and a car then we'll invite you
to the office to go over any any
specifics you know you show up with the
car you show up with a $50,000 check you
pay us the balance when we do the port
we push it open source the truth is most
meetings just go absolutely nowhere
I'm so once you're ready to work with us
like that we're happy to do it but you
know yeah it's basically you know if you
want more if you want to know what
you're getting go out and buy a Honda
buy a neon try it out if you like it
then basically you will get that on your
car assuming it has assuming it has
actuators assuming it has some spec for
actuators that we can tap into so then
why are us the money why are the 50k
down payment we'll meet and bring the
car will do the port it should take us
about two months and then we can when
we're done the rest of 20 toward UK but
we don't really do meetings anymore
I found that most meetings go almost
nowhere Honda's actually do work a
little bit better than Toyota's that's
what I'm saying by Honda and the Civic
will be more representative of what
you're getting assuming that you have a
good spec for how to actually control
the stuff on your car if it does need
radar you need a forward-facing radar
right now um we can try to do vision
only but the quality is not going to be
as good but any any normal radar is is
good but I assume that's something
already shipping in your car I do it on
periscope
daddy you ready we gotta get those great
pandas back in stock um teasing new
model for Toyota that we're doing new
models it's coming it's coming it's
coming but ya know I mean there's
there's nothing that you know uh maybe
the next level will be will be will have
like a Skype conversation that we
periscope know if when I first started ,
we met with like everybody we had
meetings with all the car companies all
the tier ones okay you'll have the car
yeah yeah yeah I'm always down to talk
on slack so you'll have the car done by
November okay okay um so in November
once you have the car once you have the
50k down payment will sign a contract
you wire that down payment over bring
the car by will chat we'll go over any
specific details to your car if we can't
do it if for some reason we can't get
the port quality to match the Honda will
give you your car and the money back I
don't believe in being paid for a work I
didn't do well oh but yeah I mean you
know don't expect level for yourself to
having client stuff's not real cool ah
yeah a great job with the pedal right
that's not even his main job excellent
look at the successful look at the
successful periscope meetings can I tell
the test the story now yes sure um so
mune VF went to the Tesla dealership oh
it was such a great experience we were
sitting like a Model X with the moonroof
I was beautiful
I'm we're like okay we're gonna buy one
of these cars so we're like we get one
tomorrow um so we're at the dealership
we set a delivery date of tomorrow at I
think it was 11 a.m. I wake up in the
morning I'm super excited I'm getting a
Tesla today then I get a call from the
dealership at like 10 a.m. and they're
like you know we're sorry your orders
been canceled by the main office I think
that they want to reach out to you you
know let them know when you're available
so I'm like look I'm around all
this is all I'm doing today I'm getting
a Tesla and yeah then I got a call from
Tesla's head legal counsel at at 2 p.m.
and I was kind of like look man if
you're gonna like call me up with your
legal things I'm not gonna like I don't
know you know we didn't even get to the
point where he was asking for things
like I would never sign anything special
to buy a production car so you know I
was a little a little upset by that
but hey man you know let's do business
they're allowed to do that we banned
people from the periscope they bad
people I thought we were pros but if
we're not pros is cool too man I mean
they're not you know you can buy so if I
wasn't doing , what would I be driving
not a Tesla I used to have a
mercedes-benz or you don't get why they
did it uh you know they don't want I
mean he was notorious about this oh I
could certainly get one I could
certainly get one this isn't actually
stopping me from getting a Tesla but
like also I kind of wouldn't trust
buying a car from Tesla where they've
singled me out like that
you guys know they have SSH they have
root and Hall of cars I don't want to be
singled out if I did buy a Tesla by it
under my alter ego named not from a
Tesla dealership from from a third party
and yeah no one would ever know and guys
maybe I have a Tesla time just trolling
you all and keeping the the whole front
oh right yeah what would I be driving I
have Mercedes s-class they're nice there
were really nice cars
I wish the autonomy was better right
away it does look nice no way Aipom
cruise yeah that's a cruise without two
zeros sir do you have zeros in your name
that's right I have zeros of my name
cool and dr. James Dean the point star
Woody's in his name right not not the
guy who wrecked his portion died not bad
James Dean um I would ease all I rented
that a for you guys know I love that a
forever you know the problem without him
who knows
problem with Audi motorcycle autopilot
Nebu arey
yeah the post curated reverse-engineer
it or they're scared I come on periscope
shit talk about a bad autopilot the
seesaw winner that's right I didn't win
the seesaw those were the days
do I think Wei mo is getting any
significant market share they bought
20,000 overpriced Jaguar shit mobiles
I'd the stupid announcement like why
doesn't way mo use Toyota Priuses oh can
you reverse engineer a neural net well
not the weights themselves but you can
certainly look at the net architecture I
don't even have to reverse engineer it I
can just read there's public stuff on
the Tesla motor forums where somebody
always does it for me so I just read
periscope I just read I test the motor
forms sorry I read the words and
sometime the words get caught up in my
mind what happened to safety we talked
about safety and now it's shit talking
to our do i still play playstation i
never play playstation no i mean it's
like it's not that i pace is bad right I
haven't been in an i pace
I hear it's kind of nice maybe but it's
just it's a poor choice like for example
why would you use an electric car like
you just have to deal with that now
which you didn't have to deal with
before with your Pacifica minivans right
later man
yeah the next step in south tribe and
that's more what I mean it was more that
the hype didn't match the reality yeah
and they bought twenty thousand of an
untested first year production car I
wouldn't do that like that's just a poor
business choice oh and then oh my god
are you guys want to bring up the video
oh it's it's so laughable but good bad
guys I bought some Kinect
I bought the dip and it didn't recover
and I was devastated I lost my house I
got to move out that's not funny some
people actually lost their house it's
still funny because nobody got hurt
[Music]
electric cars feel futuristic see that's
but I'm not about to feel
man all right so let's find the way and
let's go on way most Twitter and let's
look at this announcement and I just
can't
yeah I know nobody thinks about it that
way
all right you can probably the people of
waynebow who made this decision opinion
on uber what do you mean my opinion on
uber I don't know um I think they could
have been more careful
but you know maybe they were my opinion
uber hasn't really changed you guys know
that I was a fan of Travis kalanick the
new over is just it's just corporate
shit this one oh yes
or your best investment if Bruce
digital versus analog the steering the
brakes are the same in electric cars you
know red then this guy this guy so you
know I'm not with you guys some of you
might know the story when I met with
Jaguar Land Rover but like okay opinion
on Nutella negative opinion of watching
this current capability and innovative
advanced technology and you all know
that Land Rover invented the premium SUV
or check or the disc brake for cars both
brands have a long track record of
creating so let's pause the video and
let's talk for a second about the word
he used both brands have a track record
and that's how these car companies view
themselves and that's kind of what I
would like what I'm anti right I don't
want like what is this he hasn't said
anything Jaguar and Land Rover always
deliver
okay but like you haven't shown me any
fact that you improve that you've just
said those words
it's practically Trump esque the game
changes everyone is you know in the
automotive industry wants to create a
game-changer an icon everybody in the
automotive industry wants to create a
game changer and icon what is that what
is that
of the truest roses the opportunity to
do so is very very rare
and now what's the I place the first
consequently designed and engineered
bacteria clean well away okay so the
first consequently electric designed
elect battery electric vehicle no that's
not true but then he actually follows it
up he actually follows it up with
something from a premium brand from a
premium brand what does that he's
speaking to his audience but like guides
us into smart sustainable mobility and
the pace dramatically guides us could we
just like visualize this for a minute
like like here's an eye base and like
we're all like walk-in behind the old
guys the eye pace is leading us yeah
he's like the Genghis Khan of electric
vehicles man he's like leading us into
battle grace space and cookies a product
for game changers creating unprecedented
ladies and gentlemen electrification the
technological prerequisite for
autonomous drive in the future
electrification is the technological
prerequisite for autonomous driving he
finally says something that's a fact and
it's not true that doesn't even make any
why that doesn't even make any sense
and be led and we have a clear vision of
smaug mobility enjoyable entertaining
and exciting Chinese giving our
customers procedures available time back
okay I'm I'm over this guy um but what
we should talk about is who has redeemed
from
self's um we're gonna we're gonna leave
off with where's the time like the time
used to be on periscope I think they got
rid of it so they wouldn't know how long
I've been doing this for we are gonna
talk about the biggest redemption of
2018 award we're gonna hand it out right
now biggest redemption of 2018 from who
got made fun of to who's not gonna be
made fun of anymore who you guys do you
think who do you think
no no super he's still gonna be made fun
of but not because of anything super who
did just because of like supers who do
you think 2018 it's the year of the No
oh it's been over now I really gotta go
I got things to do today Ford it's the
year of the Ford you guys got it it's
the other Ford guess what Ford has just
made all these features standard on the
2019 fusion which we love to see we
can't wait to support the 2019 fusion
you guys know we have a 2018 fusion I'm
gonna leave you with Ford is redeemed
there will be no more making fun of Ford
on these periscopes Ford has redeemed
themselves
congratulations round of applause
clapping with one hand for Ford Ford has
redeemed themselves
Ford's back up at the sticker I was not
happy about this bigger don't get me
started on this picker but Ford has
redeemed themselves so Ford is out of
the ship in Jaguar has moved themselves
further into the ship in IV this
standard on 2019 thank you scope ease
thank you for joining for this safety
scope II Sunday our next two weeks will
be focused on safety and we'll be
starting the safety channel on slack so
we can discuss safety constructive
positive things only absolutely no fear
mongering fear-mongering is never
tolerated make sure to click that like
and subscribe button and make sure to
bio your shit on shop comet day I gray
pandas will be back in stock next week
if you've been looking to buy a gray
panda Happy Easter
I don't think Ford on the Jaguar Happy
Easter do everybody and to all a good
night bye-bye
[Music]
yo yo
what up periscope what up periscope it
should be shared on twitter now nice we
still check it yeah check it's actually
shared on twitter
yeah i know i don't know what happened
yeah salt lake's everywhere salt lake's
everywhere
all right
is this where we get all our salt still
we just want to small likes
we probably import it
probably environmental impact statement
we're not allowed to take the salt from
the salt lake city right all the like
protozoan
high genders living in it yo what up
generous gender
tending
um you guys it didn't drive nearly as
well in nevada
um because nevada paints lanes weird
yeah but now that we are in utah they
know how to build roads in utah
utah you for utah let me change lanes
then with you for utah yeah you for utah
utah
you we're soldier boy
man that's such a good song right crank
that
um
you know it's driving it's driving super
well
we're just on the phone with so we're
like the away team
notice how none of us are wearing red
shirts because we're all going to
survive
um yeah if you missed the periscope
before there was a bug there's a stake
in our periscope yesterday we said the
t-shirts were going to be twenty dollars
but i looked up how much little peep was
charging for t-shirts
and he was charging 30. so we're
charging 30. yeah yeah
and he's running he's wearing one of the
shirts right now yeah eddie let's get a
little show for it oh look at that
that's so fly all right
driving awareness to her
we got asked by some guy at a gas
station what we were uh what we were
demonstration uniting we showed them our
dash cam
yeah you weren't ready
no i need to fill him out but he like
understood it all right he did he did he
like did the music and the map yeah yeah
and he was like yeah he he was like when
you get this you know yeah it was like
when you get this working
for self-driving cars that'll be the big
thing right yes i'll drive cars
like how he called us out for saying san
francisco was silicon yeah yeah it's
true why he's from california right yeah
if you're talking to like someone from
like wendover nevada
oh i've never been more happy to be in
utah it sounds nice yeah right it's so
straight
there's no more rear signaling when uh
there's no more rear view mirror when
signaling because you have your
beautiful rear view we have a really
really new mirror right
deep in it we do uh windshield mounting
now yeah we do windshield wiping just
love us
love us
no we're not violating fmps anymore
yeah
um there
was a violation
that's why uh we changed it yeah
we uh listened to regulators and respect
authority
this mirror is pretty nice you guys by
the way like watch if i unclip my
seatbelt
look at that it's so safe
oh we're just engaged
because i unclip my seat belt don't do
it for the inland mountains should it be
in the very center
um
a warning
yeah center center center is good uh
we're a little bit the rav4 is a little
bit higher than the other cars so we're
trying to the uh
home crew is trying to fix this in the
software right now
but oh this feels so much better than
nevada yeah nevada the right lane was
like probably four times as thick as it
is yeah
and it was it was a probability problem
yeah we can we can we can mention that
to record it so yeah
ricardo if you're listening that's what
we're doing yeah what was happening is
the right lane had a much higher
probability than the left and that's why
the straights were a little dense yeah
um or maybe that was even affecting like
jangle ware or something yeah
but yes we want to stop at one of these
uh salt lake outcropping so we can like
touch the salt you can touch it oh yeah
you can touch it it won't burn you no
no but but i think you can even take
some with you but if you go to white
sands national park you cannot take the
white sand they'll search your car on
the way out it's on your boots
they'll take the grain
apparently they had a problem like white
sand hijackers
how many how many uh scopies you got 50.
oh good see when you put it on twitter
they all come i see yeah oh we'll listen
to eminem before a new album
disappointment isn't that great
wow that'd be a good name for your album
disappointment yeah
let's shoot disappointment
oh set the expectation that i was about
to say yes
you're right
right
would that be honest
would that be real guys tyler the
creator shit
yeah after schmucker's but his second
album he's like sparkles is good that
one kind of sucked
i love that
it's like yeah i made it it's not very
good i can adjust my lumbar support
do you have a long bar wait is your seat
no mine's manual yeah what premium trim
what is this we're talking about we
don't really like this car before it's
okay
yeah the civic is just so nice
heated seats in the back
yeah
oh i didn't like
don't try to do it because we'll we'll
end it yeah
t-mobile didn't pay the uh
the salt lake tower fee yeah
i hope there's more of those out
problems
or you can pull over
yeah the speed limit is 80 miles an hour
here too which is real nice that's
pretty cool
do you have any questions
uh philly's first off is what we're
getting but oh that might not be
happening might not be happening oh yeah
you gotta come to the midwest
midwest is where we're doing tour stuff
that's right it's salt lake city park
boston yeah we're in mountain time
all right
you guys know the story of salt lake
city right
also unsure so yeah joseph smith used to
hang out was it pennsylvania
yeah
middle of pennsylvania and they were
they were being very intolerant of his
boobs yes so like moses he led a trek
out here and he discovered the most
beautiful salt lakes found in salt lake
city which is actually really it's
actually pretty nice yeah
salt lake city yeah well you're gonna
see once we go further east of salt lake
city you'll see a few places thought it
was nice to salvage it
uh i'm not gonna name names you don't
offend anybody
um
yeah it seems nice
uh someone's saying salt lake city
midwest salt lake city's not the midwest
what is
what is up with that fake tree yeah it's
a weird looking big tree never seen a
tree like that
wait so what is salt like saying that
like
just the west not bad do we want to meet
with some gm engineers in detroit uh not
this tourist well we're not yet we're
not going to detroit yeah
um
gm engineers yeah
who do we want to meet with local news
outlets that's who we want to meet with
yeah local news outlets if you're
watching if you're the latest
ai to send an email right i would love
to be on a morning show shows that's
right radio we're cool with radio too
you know the kind of morning show where
like four people sit around like shit
talk i'm down with a cup of coffee cup
of coffee yeah i'm i love that i love
that did we drive through battle
mountain what's the battle yeah we did
battle front mountain
about the bathroom i think so that was a
little
town
um yeah did i see the wheel and stuff
they see the where where yeah yeah i got
some good shots of like your angle like
this yeah it's the second angle i don't
know
oh just overtook it
this is a scene from a geeky film yes it
should be i'm doing an excellent
excellent job with this camera hey good
films the scene is where geeky film this
is not a geeky road trip it's a real
road trip
it's a real shit oh man that's so great
not so great
video killed the radio stars do you guys
remember that song
good filming thank you appreciate it
screech
ew the salt is dirty
it's all look gross i don't really want
to touch it now there's nice salt back
there i'm going to stop would you rub it
on your skin or something but like it's
a bad word hard to purify that salt
swift i don't know taylor swift's had
our own lines of trust look at that yes
we're trucking yeah
you gotta lead them
i'm on his wikipedia page now
dustin diamond preach yo the other chick
jesse from saved by the bell
starting show girls
a five million dollar budget
designed to be nc seventeen movie it's
like quasi pornographic yeah but it was
jessie i think she might have had a meth
problem but i don't want to slander her
so i'm gonna say mighty
this is
we're supposed to stop too maybe we can
give him a ride you know maybe you want
to trade yeah yeah you're gonna spend it
yeah yeah it's like a model x man look
hey try the autopilot we'll try okay
wait screech did a sex tape too it's on
wikipedia no way
in 2006 diamond directed and released
his own sex tape keep screech saved by
the spell
that's
a bad name that's really terrible
but there was a stunt double that
performed in the sex tape he just
directed it
oh this is weird that is so
really weird
with speedometer check next five miles
let's try it
ours is wrong and our speedometer is
really wrong it's way off at 80 miles an
hour one mile it was 45 seconds okay we
need a stopwatch
yeah you guys were at 77. get the
stopwatch on all right stopwatch yeah
all right we should be going 80
according to the uh at least at my set
speed sorry
going to our eon so we're going to see
who's more correct eon or toyota
i don't know it's like
there was some signs that said something
about a speedometer check so you think
it's these yellow markers we should be
no i think there's going to be more
signs to tell us what to do
dude they never have to salt these roads
it's just like seriously
oh yo
i don't think we were on the scope when
the when we saw it we saw this tuning
that was freaky we saw three trucks off
the road in one pickup truck yeah oh
overturned like they just had like slid
off
i didn't think the road was that icy but
it was sketchy semi trucks like they
flipped over and then the cab was upside
down yeah yeah virtually chris i think i
would plan on it being a no for now
yeah overfilling we'll see
we'll see we'll see we'll see all the
first steps here we'll see let's see we
still have t-shirts left over yeah yeah
yeah 40 t-shirts
five of them are reserved for people
who've been helping us out we have 35
t-shirts for sale yeah i think we have
eleven eons for sale eleven
uh yeah we got like 35 pandas got a
bunch of giraffes
got dressed up
we got some overpriced hoodies
yeah someone came to our house to buy a
hoodie we gave them a discount on the
box in person and that was the 100 bucks
that i lost on the bat that we talked
about in the last periscope right
yeah you got to pay attention it's like
a sequel
references back references we should
back reference to all the periscopes so
you got to watch them all
if you want to be on the inside
hey does someone out there okay we're
kind of like here i don't know i think
our periscope has live location sharing
on so if you could if somebody out there
in the world could figure out where the
next stop is to stop and touch the
surface yeah that would be awesome we'd
be super happy oh wait start the time oh
it's time
no it's too late no we gotta start it
exactly when we see the mile four sign
then we're gonna see the mile five sign
and we expect to be 45 seconds right
how well can eons keep speed we're gonna
have a little bit of a problem cause i
think we're gonna come up on this truck
we're gonna hit this truck
we're gonna hit this truck
virtually chris has watched every
periscope in full nice yeah that's so
awesome
chris we're excited for a new episode
yeah i'm stoked for that
episode four yeah yeah yeah we did
before happened no no four is coming out
oh no but no here's the sign okay all
right restarted ready
don't fuck this up eddie oops ready
what is it three minutes zero okay yeah
that's right so when we see mile five it
should be 45 seconds yeah we didn't
start the stopwatch at the right time
right utah really didn't give us enough
of a heavy box car right now to buy for
putting the eon on it to be honest the
honda civic still works the best but the
future probably is toyota
the rav4 does not work as well as the
same
um yes
yeah we're all a little disappointed by
this oh but no it'll get better it's
just we look we've got a lot of time to
tune the civic and make it good we're
going 80 miles per hour we're going 80
miles an hour which is the speed limit
here
despite my speedometer saying 84. 38 39.
41.42
wow eons keep speed please show the
scopies the uh toyota speedometer
and see what a scam it is can you see it
check it out it's really a huge scam
it's five over it's five over
like this says 80. this is actually
correct
this says 84.
you guys know why they do this right so
you don't see them there we go we set
that in the first one
we gotta have new material let's just
make you go slow oh we're gonna show for
we're gonna shield for dan carlin's
hardcore history yeah yeah that was good
all right they're calling hardcore
history we're learning about the goals
and the kills the goals and the celts
yeah
what they say about caesar is like
caesar just like thought and talked like
four times faster than a normal person
yeah caesar did everything yeah the man
was an absolute genius but he was so he
was a military leader and then became
emperor i mean how do you ever remember
oh he was that he was he was the first
emperor of rome kind of and then he
would go and did he ended the roman
republic
he didn't start out as emperor right so
caesar was born oh there's a dance a
great thing about this um
no caesar uh cesar was like a military
leader
are they talking about the triumvirate
which was caesar pompeii crassus
uh which were like these three like big
roman bros who kind of ran shit and
caesar's like well actually i'm taking
over is that snow
no it's definitely snowing it's snowing
hey look all the pilot works in the snow
yesterday for all those people wondering
all those people inclement weather yeah
it's all good
it's all good
i don't like passing trucks oh this
i don't like passing trucks even when
i'm driving yeah never mind when opening
this always feels closer
and that one truck was like oh that one
literally was yeah
well it was also really unsettling to
see three trucks slipped over yeah
yeah i know right
that really freaked me out that was real
freaky man yeah it's like you have to
think like what got them all right we
were thinking knockout gas and then we
started to smell something right we
started to spell something right
actually we thought knockout gasps when
we started to smell something yeah thank
god we had open pilot on here if we had
stolen one of those tesla model x's you
know we would have had a nice epic
filter this is some it looks like a
filthy you see that yeah but all right
present just do it today i don't know
is that just normal outside oh no they
just the scopies haven't been good at
figuring out where we can stop the salt
lake
yeah you guys where should we start
we're gonna have a look in the toyota
manual it's snowing how many people we
got we have 52 one of them can look an
obvious it's beginning to look a lot
like uh
it's it's really like christmas man it
just looks sad
okay i love this weather
it's pretty gray
it can help it a little to not go over
that exit
what are we trying to figure out we're
trying to figure out where we can stop
to see salt lake so salt lake i want
like a nice place to pull over and touch
a little bit of salt yeah so we want to
touch a little bit headed east where
maybe well here let's click on the
frozen ways and see how far we are out
of salt lake city no please where is
this grove i think you can see our our
location but maybe not
maybe not yeah we're right here
we're near this we're like we're like 20
minutes
yeah oh they can't see our location yeah
so if any of you guys see kind of like
an area we can pull over stop some rest
stop or whatever
it's about an hour
i think we'll
we'll start seeing the great salt like
in like half hour well that wasn't even
the great one no that's not even oh
we support that we love jailbreak
jailbreak our shit back our shed
you know what you know what there's two
types of people in the world assholes
and hypocrites and guys i'm not a
hypocrite
imagine we were streaming 360 video yeah
oh man imagine we had an andy rubin
essential phone yeah yeah we do we do
actually but not with us
the samsung get handheld 360 says
that guy's a samsung chill man it's like
a ton tom shell on twitter
the guy loves them that guy loves
talking a lot
guys wow look what we got we got coming
up behind us looks like an official
truck
that's up
so you know what's really good on this
car like
when you're in reverse someone's driving
by you and it tells you it beeps at you
if you're backing up you know what's
great be like yeah it has like a 360
camera yeah the 360 is cool too but like
someone's driving speeding by you you're
trying to back out of your driveway
the color of the car what i'm i'm
showing them the color of the beautiful
car how nice it is it's just oh two-tone
her name is autumn because it just looks
so
good
great
yeah this is a rav4 should i start
driving do we trust it to do this we
trust it just like be ready to take over
ready i have my hands on the wheel ready
to take over and maybe get the
windshield wipers going faster wow okay
yeah we want that cleaning if i learned
how to not care about windshield wipers
that was one of the coolest things to
solve learn it's kind of sweet yeah i'm
kind of going to keep my hands real
close to the wheel now
just in case it decides to do something
i'm actually less afraid of open file
decided or something more afraid of the
road being slippery yeah i'm so yeah
this system does not know what to do
about like slippery roads or anything
uh this car does have traction control
so that is nice
yeah if traction control starts going
we'll have to uh we'll have to slow down
that guy's going fast
i don't know we should we should look at
i don't know what tires it has
you guys love because it's decent we did
not get the best time check that out
there were better tires we could have
gone
remember there was that model that was
like really nice we decided to go for
this one this is the we got the highest
trip this seems nice i thought the dark
gray one was higher no this one's the
highest
i'm probably the best tires oh we have
options for the salt lake yes oh nice
nice
joker can't spell that's right that's
right shout out to that
so you gotta read the comments i love
the comments there's not many comments
there's not many comments i live for
comments
i mean there are some comments but i'm
still waiting on you guys for the salt
lake stuff
yeah we're going to stop we'll get out
we'll get out of the scope it's a little
salty there's antelope island
wow is that like juggalo island here's a
comment thanks genders
okay great salt lake park is about 50
minutes away from where we're at
great salt lake
do you have to pay money to get in there
here's another comment thank you guys
this is great jailbreak tesla
uh we wouldn't jailbreak those ones that
we saw on the side of the road there
literally we we stumbled upon seven
teslas do we have to pay money that's a
good question yeah i think the parties
we got to pay money just to drive right
like ten dollars i want to like touch
that and then we'll probably like search
you for salt on the layout and marijuana
don't bring marijuana to utah kids yeah
wait for colorado drugs don't bring
drugs to utah what's your top five
choice um
yo i love them barbies apple toys
apple turnovers they're disgusting
though rv is disgusting otherwise and i
always end up getting mozzarella sticks
and apple turnover which is disgusting
okay open plan starting to struggle a
little bit with the snow
lake state park because it looks good
it's getting a little comfortable yeah
looks like that's over
yeah
that lane is a little hard to see
yeah see what i'm talking about
you know we got to put some of these
pictures on common color because you
guys can call it another thing
now the new nets the v-nets don't use
lanes anymore
i'm so v-net should be a lot smarter
i'm gonna go for that exit
yeah all right now now it's starting to
get a little shaky yeah
it has no not much of a left
lane this is a good answer to the
weather you know this is a good answer
to weather i mean look it's like gradual
yeah it's not it's not something that
like we're still engaged and we're still
doing it
just very very excited you just be a
little bit more cautious and that's just
how it is
we are self-driving cars is that even a
question what we are self-driving cars
oh man
i don't make i do not recall i make
self-driving cars
that's right yo
you tell you about self-driving cars
they're not real
they tell you about weed it's real
hey hey man what are the guys using
super cruise
super cruising yeah
gm engineers so we could meet if we go
to detroit apparently they could buy
pandas if they want they can go to our
website right now
you know who recently brought it bought
an eon i think we should out them yeah
not specifically their name just their
company no no not obviously not the
person's name no no
who recently bought neon was the palo
alto innovation center of ford
so we'll get around shipping there yawn
yep
yeah we're stopping
in salt lake city not just for food or
drinks but we're also hosting a meet up
at make salt lake it's the maker space
in downtown salt lake city are we gonna
have pizza we'll have pizza we'll have
all of this gear for you there's another
event happening so their parking might
be a little tough in the lot
competing with another other
musical event or something it's like an
artsy event
you can't compete with musicals i know
so i was like maybe you know maybe i'm
going to that event you guys
but yeah all of those people out there
watching from salt lake we're coming to
you yeah yeah
chicago is also dvd we really got to see
these guys
we got we got the four on the schedule
check out the medium post if you want to
know more about them
or the back of the shirt or the back of
the shirt not really no you don't forget
to know the actual style
you just can't see everything we're
driving through the city doesn't mean
like some of these cities i got like you
know people to do there you know yeah
things to do
yeah right
yeah we're gonna be there at seven
absolutely so
major the meet up is still happening at
some point
depending on unless there's a line to
get into the great salt lake yeah it's
four o'clock now this is wrong
oh yeah it's four o'clock somewhere like
here
right here right now three o'clock
somewhere back in california exactly
black rocks salt lake in the gps black
rock salt lake okay wait wait can we fix
ways
like a black rock all right you want to
reboot the eon no no we will do it
yeah this is good for you guys to see
but don't do this while driving no no
that's fine uh so just actually as long
as you turn off radar cruise on your
toyota so you can actually reboot the
eon so you have to press this button on
the front of the stock
as long as it's off it's gonna throw up
some warnings now like lane departure
alert malfunction but that's okay when
the eon boots back up you'll see those
warnings go away um what we advise you
to not do is turn the car off and on
while you are driving
that is a bad idea yeah but this is this
is fine some people used to do that some
people used to do that
do not encourage that
yeah visibility is not great good thing
we left that radar we left that radar
improvement in
yeah right yeah don't turn your car off
while you drive kids
but it works in the city well in the
acura you can't turn it back on
all right
you have this thing where you're rolling
with no brakes and no no power brakes
and no power steering you have some
brakes and some steering all right where
are we wazing to all right let's waze
somewhere
let's check out where the black rock uh
salt lake is how far it is
black rock salt lake minus the way to
the alert to go yeah there you go
well eon only support usa roads no no
not at all we support
roads that no no we don't support left
roads only right right
okay um you should lobby your
governments to change yeah there's
nothing we can do about that
is black rock salt lake or is it free i
i just heard that was a good spot is it
free is it free
oh man
what
this sound
guys a good way to type on your eon is
to rest your hand here you always thumb
don't put your hand in front of the
camera no this is good though yeah
black rock micro systems that doesn't
seem right that's not right i can't find
the one they're talking about
but the the great salt lake state park
looked pretty good all right they're
checking if it's free
yo it's got to be free man we haven't
made any money yet on this tour
hopefully
yo what if we sell out tonight that'd be
big do we just call it a night then
let's just ship the
great salt lake national
that was state park
oh state park good i suppose
it looked really tiny so yeah it's right
next to great salt lake state park oh
there you go there you have it there you
go
okay i should actually drive
yeah it's a little treasure it's a
little treacherous now
we'll sell at least one eon tonight cool
yeah awesome cool you have 128 and 64.
128's that's 64. you get choice because
you are early yes yeah you know
wow actually you're going to be the
first person to get an eon
oh yeah that's true yeah i don't think
any of them are right yeah they haven't
they'll arrive early next week let's
give this instruction a thumbs up yeah i
love contributing the ways yeah we've
been we've been contributing all the
police back to race calling out the 5.0
yeah we want to get on local utah radio
shows oh yeah we do to call in we could
do that we could call in sure
i got i got phone we could call in from
the car yeah right now i mean i kind of
got to drive this is treacherous
let's see what okay
oh we could switch yeah go find it
that's pretty good i can see
engage
with the reboot and engage i didn't know
that works yeah you can reboot oh this
we finally got updates too yeah we
probably got uh whatever
whatever that's uh ricardo has been
doing cool
yeah it's driving okay just like really
you know
i can't see yeah
don't want to go 80 now
now it's a little over the lane
is actually driving fine the thing is
look at how the tracks are way more to
the right yeah than uh the lane line
right final count of eons was what 11
uh we have eleven with us yes oh final
count of ship dion's high
yeah
eleven was literally what we had left
over well actually that's not true how
many elves do we have in the car we got
one x you got twelve this one right
there
yeah um not for sale so it's not even
driving the wrong place the problem is
generally when you're driving these sort
of conditions you want to drive in other
people's tracks right yeah even if it's
wrong even if it's like not the center
of the lane yeah um i mean you have to
yeah you kind of have to so this is
something that like v-nets are going to
fix
our new machine learning models um are
not going to rely on lanes anymore
and they should be smart enough to
understand like even this kind of
driving
which is really important something like
google's thing can't understand it like
it's yeah it's a snow up ahead yeah oh
is it no no no that's just what someone
was asking oh it's snow yeah it's so
snowing man
let's go let's go so i'm going to saw
like until snowballs at each other so i
guess these snowballs
yeah i don't have a coat i don't have a
coat that's yours
if you live in salt lake you're coming
to the make salt lake let's hope we make
money tonight
yo this is like going on tour man i want
to make technology cool you know yeah i
mean this is cool
man
got a tour oh it's really dark so lake
city is pretty dry downtown that's good
news okay that's good i really
we got live updates
should we pass these people or is it two
characters it's two it just doesn't
matter at this point yeah
we can barely see
i can see fine
how many hours
yes
i haven't driven this car a lot so i
don't really know like what the traction
limits are also we don't really have
this weather in california so
no it's not that like i was fine in the
snow
in my bends because i driven it in snow
so much like i knew exactly you know
when the traction control was going to
fire and what like the the limits of the
car was
i've never even been in the car this car
with the traction control at all
2017 toyota versus 2008 fans
it's probably um you know actually it
probably is better
but like even better the thing is you
have to know well it works with the
person right like it's a driver
assistance feature
um
yeah
yeah
i'm so just like yeah just that you know
i we don't recommend using uh pilot
in uh conditions where the road isn't uh
where you don't have good grip on the
road just like you wouldn't use cruise
control in the snow
when there's actually snow on the ground
obviously if it's like raining a little
bit right now folks you need to eat
vegetables okay this is important yeah
that's true it is important i eat
vegetables vegetables man how many miles
of autonomous driving have we logged on
this trip
we should figure that out
well i think we'll do a medium post yeah
we can conglomerate all the video yeah
gps and give a percentage
of an autonomous person yeah
in some parts of nevada we were a little
disappointed because of the lane issue
uh utah was really good until we hit the
snow
it's always like 100 percent of the
market
we can get a cheap jacket at flying j
it's before salt lake that's a great
salt lake dude let's go yo i love flying
j yeah let's go fly jay what is it nice
thank you for that truck
thank you for that
new channel we're definitely going to
flying jay
all right i should probably give this
guy wait we don't even see a lean car
right now
why
because it's not engaged
i think that snow might mess with the
radar oh this is this is good testing
it's too cold for you
i don't know gender says twenty dollars
on selling out by the way i wonder if
the radar is having issues with the
reason i reset it it's weird though i
haven't seen that before
i don't like that it doesn't have a
leaked car wait someone right there and
driving feedback
eddie i'm periscoping can you remember
that you could put that in driving
feedback right now
well right now yeah i'm not seeing a
lead car it's also letting me engage so
what it should do in this scenario is
israel
it's hard to find healthy food along the
road
it is so funny that was a nice place to
work this morning yeah it's good yeah
last night we saw daddy's actually
kicked up their health menu a little bit
oh denny's was dennis was top-notch
we went to a denny's in california it
was great
no uh open pilot cannot read road signs
like speed limit yeah no actually i'm
quite concerned how i can't say what we
call right now
um i don't know are we getting any radar
packets actually if the guys are home
uh just ssh into this phone
and see if we're getting radar cam
messages yeah
yeah so this is 0.4 result pilot 0.4 we
talked about the first periscope how
many people we got someone says 34
someone says radar in their honda works
great in snow
yeah it might not be the snow it might
be related
yeah
um yes we will uh definitely look into
that
all right how far we've been flying jay
how far are we from salt lake maybe
another hour
telling people
40 minutes ah
how did it not get fixed
uh scott boggs you gotta fix them bugs
uh this is open pal 2.4
uh on this road trip we're debugging
we're reporting all the blogs back to
headquarters i'm gonna get a little fix
for you guys yeah flying j is coming up
how soon
wait flying jason you know i might get a
good question too if it's so much it's
so great and flying james the flying j
is great
let's get a coat and let's get a cv
radio look i'm not kidding we're getting
sick we can buy
tv radio we're gonna talk to truckers
man this is the kamehameha demonstration
unit important
snowy up ahead snowing yep real snowy
don't go to nevada the lane lines are if
you're looking for a coat flying j
yeah
all right i think maybe we'll leave the
periscope here yeah we'll see you guys
soon and don't forget salt lake city
tonight we'll probably we'll try to
periscope maybe below if it makes salt
lake yeah yeah that'd be cool
trying to scope is anyway like to return
yeah
no shelling in this periscope
goodbye to friends oh that that was
misleading
what goodbye to friends saying goodbye
to it doesn't matter so just ride
goodbye to floor I wrote saying goodbye
to friends I yeah that's good man
but that's pretty misleading no it's not
why is it misleading because like they
could think little really saying goodbye
to them cuz they're its clickbait relax
it gets more people to watch the scope
ease I learned that from Logan Paul
focus that's true focus guys yeah but no
we're just talking this is a nice car
it's really nice
this white leather yeah it's so soft
they did something to the cow man who
just touched this
I know it's so this record is no way
gonna be this is such a pleasant car
like you look in it and you feel happy I
enjoy driving this car and you heard
that driving this car not sitting fine
but you know why we're trading it in
yeah we heard about this great piece of
open-source software called open pilot
which will drive your car for you you
guys heard of it yeah and it doesn't
work with Ford's yeah it only works with
on doesn't Toyota's we're trading in for
a hot
the cruise control what's your level of
a quarter beginning oh it's true of
course we never do anything cheap um but
guys this Ford was going away that's
pretty sad if you guys have any last
things to say we should have just said
saying goodbye to friend friend yeah it
is one friend yeah if I could figure out
how to pair my phone quickly we could
listen to great songs about loss I know
some great ones whoa whoa well let's not
go crazy you know connect a glitch
you're right there
yeah but then like you know you can't
you can't yeah yeah virtually Chris
yeah guys but I hope you enjoyed
watching this for Drive deaf when we go
home
can we take a montage of our periscope
yeah
the buying before do you guys remember
episode 10 of Pokemon where Ash almost
says goodbye to Pikachu they have this
song oh we should have played that
closing time by Green Day that's your
traditional good fact that closing time
is by Semisonic it's not it is it's semi
song because it's absolutely green day I
might we might both be wrong I really
don't think it's green the closing time
is Green Day is that what this copy
someone just said not Green Day
absolutely closing time
Wow everyone sing it's not I think it is
it's definitely but green they covered
it it's any sonic
time of our lives
time never clear made wonderful they're
all the same songs all the gde
F court no G Dec corporation you're
right it's me minor it's you hit that F
sharp G sharp is vulgar and the G chord
yeah but it is all G minor C yeah yeah
that's great song by the way yeah guys
the Ford oh man you guys don't even know
about the Ford drama where I broke the
door oh yeah fix that we fixed it it fit
any Ford dealership or for the
dealership that we're going to if you're
watching it's fixed so don't worry about
it it's done the ASME certified mechanic
sure you guys know that George drives in
one lane he never switches lanes
cuz it's dangerous yeah but I just
really started to realize we surgeries
how I don't change you ever change Lane
because it's dangerous sometimes you
change lanes when you get annoyed but
always that was doing the minimum lane
changes to get to Burns just notice how
I keep the craziest following distance I
try but very safe driver
yes I've driven a lot and I don't want
to die did you guys have a 3d printer
naming poor dead
Oh what was the winner I'm worried that
chase chase chase is coming to work for
us
it was really pretty boy but this is a
sad periscope we're going to say goodbye
to friends yeah friend friend
bad words
there's just no way you can be honest
did you do the New York Times thing yeah
it really lets you quantify how much of
a Johnny or how much were you I was when
he went down 20 percent I became along I
got it to the one point where I could
some time here yah yah is rhyming like I
think you could train your hearing
totally incredible well like it's like
what Chris is telling us if you look
here the Yanni like
just shows how your brain is scamming
you first part thank you
it's freezing
the scope is saying that or no but it's
very cold
the lane keep assist system just went
off at an absolutely random time those
great trading is a scam what your brain
is scamming you yeah why dude it's like
the one thing that's not scanning your
brain is totally scamming your why does
some time your audience I'm very here
long I never hear Yanni my brain is not
scamming them change the slider and find
the absolute critical Yanni Laurel I did
but at that point like when I changed
the slide I was just clear that these
people were hearing weird things and
that it was no longer true Wow remember
when we bought this for this can be part
of the montage look at the Ford
dealership dude remember too much do
they hate us
we're here to trade we've gotten so many
cars in the past year I really liked
like this car you used to be your
favorite it's still kind of is do we
have to get rid of that kind of yeah
it's all about focus
it's not the year of the for they don't
even sell these anymore no the year of
the Ford was short-lived those false
enthusiasm well we could still go to
babies r us were you offended by that
guy sitting no the road yeah that's a
good line
focus they're not the Ford Focus Honda
like that is about to see this is
acceleration advanced but it's
unnecessary there's a red light that
you're coming to wear but it's that's a
hybrid to work and now you have to like
really Jones yeah I lost no energy there
was no need to get here faster cuz now
we're just sitting at the red light now
even more pleasant to roll through we
should abuse this car before me baby
then we drop it I really don't drive
maybe you just yeah you're unbelievably
safe driver
yeah but you have to fit a lot so you
really do have to be a safe driver
that's right we've gone across the
steering controller for the awkward guys
is it the same as a second
they don't know Oh sister Jesus well
Jesus enemy too so nice
[Music]
it's bringing us to
the line
[Music]
yep virtually Chris you can email me
about my key pad for sure
[Music]
[Music]
alright scobie's we leave you there
[Music]
What's
up, Scopies?
Sorry for putting you up there. Let me
see if I turn you like that.
The Civic is not as nice as the Prius
for this stuff.
Um,
but yeah, so we got we got uh
my uh Eon driving and stop and go
traffic right here. It's pretty nice.
Uh, you know, it's nice that my Civic
turns below 12 miles an hour. It's one
of the nicest things about my Civic.
Um, that lane looks like it's going
faster. But see, I like being behind
trucks cuz if you're behind truck,
uh,
the ACC is so much better cuz trucks are
so much smoother.
So, this is just very smooth.
Like, I'm very satisfied with this.
Oh, t-shirt shipping right away, man.
right away. That's the commitment.
That's the commitment from the Kama
army. We're going to start shipping
everything out within 3 days cuz we got
to ship quicker. I should have cut him
behind that truck.
I Googled nothing nowhere this morning
and it came up for do you like Lil Peep
or this guy. So, I'm listening to this
guy. It's all right.
All right. It could be accelerating a
little bit more. We're kind of creeping
along here.
All right, let me use the other Well, I
like using this camera.
So, I'm over going to Oakland right now
to shell for shit.
See, you guys get mad when you get cut
off. I'm not mad. No, I could have been
following way closer behind that truck.
All
right, my top speed's 65. Come on. Come
on. Let's go. Let's accelerate. Come on,
let's go. All right, I'll talk to the
controls team about this. I want to go
slow. Yo, check it out. I got my
Maverick joggers on. Yo, real Logan Paul
shit.
Yeah, I know. I know.
I don't drive that much, you guys.
How do you find the check sums?
Just skill, bro. I don't know. Look at
them. figure out what it is. Just like
look at it. Get a few examples. Get
examples that are one bit off. Or you
can reverse the firmware. It's kind of
an extreme way to do it.
All right. Sweet. We're back behind this
truck. I like being behind the truck.
Open does well behind trucks.
What happens if I fly? I don't know,
bro.
Yeah, this thing should accelerate more.
I I don't know. Maybe our limits are
really low.
I'm a software developer. Nah, bro. I'm
I'm a I'm I'm the CEO. I just chill. I'm
the social media manager for K AI.
Uh no, I'm a software developer. Why?
What do you want to know?
See, let's see if I can put you guys
here.
You're right behind that steering wheel.
Nah, I don't know. I don't like that. We
can come army time, right? All right,
let's see if we can do this big turn.
Come on, Civic. You got this, boy.
We can come army time. All right,
everyone else is going faster than me.
I'm really I'm going the speed of this
truck. I'm going to be late. You know,
ways, am I going to be late? Let's see
what ways.
Oh, ways didn't change my ETI.
Um, but yeah, I mean, I'd rather have
I'd rather go slow and have the car
drive me there. What's average salary
for So my salary is $0, guys. Um, so if
you're a good CEO, you really shouldn't
take a salary until your company's
profitable.
Uh, does my Civic have the torque limit?
It has a higher torque limit than yours,
but not much higher.
It's just a nice experience following a
truck, right? I don't know. Mets
companies.
It was very chill this morning. Listen
to this Corbin guy. I'll slap your face,
bro. Banned? No, I'm too lazy to ban
you, bro. I don't even care.
That sounds funny. Well, I'm blame. I
don't know. What' you do to it?
Thanks, bro. Look, we got a cutting.
[Music]
The Boring Company is great, man. could
tilt the steering wheel and put the
phone on my dash.
Can I do that? Is there a button for
This guy's terrible. I'm over Corbin. I
mean, I shouldn't say he's terrible. I'm
just really not in the mood right now.
So, but I got you guys in one hand and I
want to change the music.
Self-driving cars don't give you three
hands. Come Army. Buy all the merch. Yo,
can you dev a Slackbot for band
questions? Yeah. Oh, hang on. I got to
drive for a sec. It's not going to
change lanes for me.
Oh no, I made you face the vents.
That was a terrible gyroscope. Sorry,
bros. Have a good cutins.
I know what I can do.
Oh yeah, check out that dashboard
experience.
Oh. Oh my god. All right. All right. I
got to get over that lane. Wait a sec.
Uhoh. Hey, I think the truck's in the
same boat as me. Well, he's done.
All right, bro. Well, you know, you can
be mad, but I'm getting in.
All right. Now, let's change your music.
We'll start with that.
real late cutting.
Okay, let's see what we got.
Let's do my daily mix one. Let's see
what we got. Oh, moving mountains. Ode,
we will bury ourselves. Why aren't I
running a midnight black eon? I actually
have a midnight black eon with me.
How long did it take me to learn Python?
One day, bros.
Check out Midnight Black.
Uh, why don't I just keep periscoping? I
mean, we can. I don't know. I wish I had
a better way to this thing.
I'm amazed we don't have mounts in these
cars.
There's a mountain here.
Oh, I found some duct tape. All right,
let's prop you guys behind the duct
tape.
Oo. Oh, that's that's decent. That's
decent. All right. All right. We got
something. Yeah, I'm doing a fireside
chat today in Oakland. That's what I'm
um
got. Bro, being a follower is a powerful
political statement. That's why I'm a
member of Lok and I will whatever Logan
Paul says ride or die. You know the AC I
will turn it off. I'll sacrifice my
comfort for the for the quality.
You can listen to a little moving
mountains. You know what I'm talking
about.
Um you really can't see anything there.
What do I think of Xmatic?
The Verge gave up on me. Oh, The Verge.
Oh. Oh man. Oh god. What will I do if
the tech press has a negative opinion of
me? Got any advice to young people
wanting to learn computer security?
Don't. It's a waste of time. The whole
industry sucks. Uh, what Civic trim we
using? This is a touring. This is a 2016
touring. Oh, yeah. Oh, yeah. We're going
a little fast now. Going 19 whole miles
an hour. Guys, this is what driving is.
It's boring.
That's why you need a self-driving car.
Uh, when will your car park itself
by a Tesla? That one's actually pretty
good. The rest of them are pretty
terrible.
Will the phone fit in the visor?
Got a motorcycle here. I like to hold
the wheel during motorcycles. I don't
know about that.
Uh, advice on learning SEC. I don't
know, man. Security is a waste of time.
Just go hack shit, man. Like I would
never call it security. Oh, that kind of
works.
[Music]
But now I can't read what you guys are
saying.
No, I don't like being in this lane,
bros. All right, hang on. I'm going to
get over. We're going to make some
moves. Oh no, that guy already made
moves. I can't make moves now. I wish I
had a LAR on the roof.
I could see everything.
Um, let me do this merge and then let me
turn off rotation lock on my phone. No.
No. I want to do the merge. No. Is it
better to train an area? Yeah, kind of.
I don't know. We haven't to be honest,
guys. We haven't trained a model in a
while. Um, so I mean, you know, training
helps.
Uh, no. Okay, I got to turn the air
conditioner back on. It's too hot in
here. Where are we heading today? We're
going to a fireside chat in Oakland.
All right. You know, you guys say I need
a tripod. You know what? I think we're
going to make all Oh, we don't have a
lane line there. I think we're going to
make all Comet eons come with parasite.
Best way to learn Python code. What's a
fireside chat? I have no idea.
H
FBI probe. I'm not worried about them,
bro. They got their own problems. I saw
some memo yesterday. They got some
problems. YouTube. What about YouTube?
YouTube. Put it on the Eon. Nah, bros. I
don't know about that. You shouldn't be
looking at your while you're driving.
Too much. Mandatory popup of live
periscope. That's right. You build
fences. I think McLemore does, too. How
often do I talk to Elon? Every day, bro.
I talk to Elon. Why do I talk to Elon?
I'm
trying to
First building
weird,
New Jersey. I hate California.
Diners,
shopping malls, good friends. New Jersey
is incredible place, bro. Sorry you
can't hear any. I'll fix that. Okay, we
got duct tape. Turning off the air
conditioning. Turning the music down.
Okay. Can you hear me now?
Hang on. We got We got some cops here.
Got to got to have a hand on the wheel.
So, hand on the wheel. We got cops,
bros. We got cops. All right. So, now we
have duct tape. I'll stick some duct
tape and stick my phone. Is that going
to work?
All right,
traffic's picking up. This is a good
deal. All right, we got some duct tape.
Let's just duct tape, you guys. All
right, cool.
Cops love come AI. Did I put the duct
tape over the microphone? All right, you
guys listen, bros. All right, hang on.
Let me get over in this lane.
Duct tape built civilization. Yeah,
good. We're all good, bro. It's every
day, bro. All right. Well, I know we're
good for sound now, but we're not good
for air conditioning.
All right, let's put the speed up here
and let's cruise.
What's successful? More car models or
better features? Yeah. Woo! This It's
hot in here, bros. I do a lot for the
Scopies.
You want to run Open Pilot on your
computer? You kind of can. It kind of
works. Like everything, it kind of
works.
It's 10°. Where are you? Sweaty fireside
chat. Bros, project. Who's project
Titan? Wait, wait, wait, wait, wait. I
got an idea. I don't actually know how
to use this thing, but we might be able.
What if I just direct the air
conditioning at my feet?
Is there noise?
Yo, you should have seen. Good, good,
good, good, good. All right, we got some
air conditioning and we got no noise.
It's the best of both worlds. Like that
movie they talk about in Clerks. All
right, cool.
Noise. Good. All right, look. I got some
pure tea. Pure leaf tea. This stuff's
great. No calories, caffeine, pure leaf.
What's the worst PR issue? Bro, PR is a
joke. You know what the honestly? Um, I
learned every lesson I know about PR
from one line in a gym class hero song.
And I got to try to remember what it is.
It's, uh, it's don't tell me it's over.
Um,
and he's like, you know,
if you want to see me gone, then I
suggest you keep my name out of your
headlines. Right? So, the truth is, as
long as you're still making headlines,
you're good.
Sit up real tall so you can see me.
We're going to get cold test. We get
cold feet. Periscope is com. Bro, it's
not even common PR. I'm sitting in a
self-driving car. What am I going to do?
Trump is PR. I know, right?
I mean, you know, you you just look you
want one of the best predictors of who's
going to win elections is you look at uh
Google Trends. Shop.com AI, what up?
Always be plugging
your only interaction with the
government. Bro, the regulators are our
friends. I talk with them every weekend,
too. No, just kidding. That's a lie.
But, um, no, they're fine. Can a mini
computer with a 22-in touchscreen work?
I mean, I don't know. Maybe. What would
an accident do to comma? I don't know,
bro. Positivity. You know, that's what
Logan Paul taught me. Positivity.
You want a Teslaike experience, but not
a Tesla.
Well,
I don't know, man.
You can have somebody else buy a Tesla.
Take the Tesla badge off. Stick a stick
a Ford logo on there and then it's like
the same. What about Windex? Yo,
cleaning it up. Yo, h I don't know if I
could talk about it. The Tesla
experience is hype. We are anti-hype.
I'm overhyp.
Hype is played out.
Ah, you guys being duct taped to that
vent. That works great.
All news is good news. Well, no. There's
bad news, but it's not actually what a
lot of people think it is. I don't know,
guys. Like the PRs. You ever see how
PewDiePie talks about it? He calls it
the PRs and whamming. You know, there's
a reason that he does that. And it's
because,
wait, hang on. I got to figure out where
I'm going here. One sec. You know what?
It would be great if this thing was
actually a self-driving car and could
actually take me to places and not just
stay in the lane, like a shitty lane
keep assist system. Somebody should
really work on that. Anyone know anyone
who works at Comm AI?
No, they're going to work on that. I
think I heard that's what I heard. I
heard it's coming soon to Yna.
All right. Changing lanes is incredibly
stressful. That was super stressful. I
just had to change across like four
lanes. That was super stressful, you
guys.
Um, it's super cruise control. Yeah, I
know. How's the new model coming? Yeah,
you know, soon. TM Tesla Roads should be
the first car on Mars. I think it's
targeted to orbit Mars.
I mean, I I wouldn't say that it makes
it to Mars if it crashes on Mars.
What's dangerous,
Ken? You mean like the cryptocurrency
for that stuff.
For level four, you will need to handle
pedestrian detection. Yes. Do I think
level five is possible without AGI? I
don't know what AGI means. Why not do
all bounties instead of employees? We
need some employees. Bounties are okay.
Comm AI is the first I'm not going to
Mars, bro.
No, like you have to make it there
somewhat intact. Like if you crash,
there's like a little ding on the
bumper. I think that's okay. But um
I think this turns beyond the torque
limit. No, we need more torqus.
Oh, no. Never mind. With our double
torque, it can do it. It's still not
exceeds limit. It's all right. We're
kind of staying in line.
Vicarious is AGI. Yeah, I don't know
about that. Um, I don't know if it's
going to be streamed or recorded. I
don't pay attention to what Apple's
doing to be honest. Like Tim Cook is a
brilliant executor. If you want a
slightly better iPhone every year, then
you're going to get that. But if you
want anything new, I don't know. I
wouldn't count on him. Any new
Soundcloud tracks? Check out nice. I
wrote nice is Nice is pretty good. up.
There's police visible in point4 miles.
Ways, thank you for having my back. I
love you, Ways.
We are going below the speed limit, so
the police shouldn't be bothering me.
Uh, if different groups develop shit and
try to put it together. No, the truth is
it's going to be a joint model. Yeah, I
know. The chips in the iPhone X are
crazy good. Um, I have an iPhone X. The
second best purchase of last year. Top
purchase was my MacBook.
If Steve was still alive, I bet he would
join comma. I strongly doubt it.
Um,
no. I mean, like, the truth is the
companies you've heard about that are
big, they're not like, oh, comma, police
detection. No, no, no. I really want to
do that. Um, we got big things planned,
you know. Hello.
All right, we have 7.6 miles to cruise
on this road. Let's get over to the
middle lane because I don't want to deal
with merges.
Now, let's re-engage.
Am I the only guys behind the ideas of
decision-m? No, I'm just the front man.
You know, it's kind of like, think about
a band, right? I'm like the front man,
but you know, it's always like some guy
in the back who actually writes the
songs and never gets any credit. So, com
is probably like that. Uh, do I think
Google will merge and kill off ways? I
don't know. Self-driving semis, I don't
care.
I've had other people do that. that
needs the BD, you know, the business
development if you want to do that. And
I'm not doing that. I mean, I'd have to
build a really big vertical if I wanted
to not just own trucking, but also own
the halls of shit that I was pulling,
right?
Um, no, the BD is really bad. Uh,
because if you truly want to be a
Maverick, you can't depend on other
people.
Um, because then other people can stop
you.
How do you merge comma army
contributions? Uh, is comma profitable?
Close. Uh, what do you mean PRs? Send uh
send PRs. Not not not not the PR, but PR
requests. Uh, why do you take control of
the steering wheel when I don't like
what the car is doing? Pickups, bro.
Yeah, I don't know. I don't think
there's too much crossover in the pickup
audience and the comma audience. Um, the
other thing, too, is they don't come
with these features standard. like the
Accord and a bunch of Toyotas now have
these features standard and that's where
we have to be as K AI if we want to sell
millions of units so we can be a million
strong army
blockchain car
ICOs bro
uh hang on we got hard breaking up ahead
breaking pretty happy good job system
you did that better than I pull
requests. Okay. How do you get your
employees? Uh yeah, give me give me a
job at commai. Most of them email in. Uh
no, you got the Toyota support guy.
That's all we got. We swipe them. We
swipe some of them.
Uh we do have hoodies left in the HQ,
but they're not for sale. What happened
to the Kama ICO? Multi camera. Multi
camera coming. What do I think of
Tesla's new autopilot announcement? I'll
believe it when I see it. V2V is a joke.
V2V is a joke and the blockchain is
certainly not necessary for it. I really
don't know if you are trying to trigger
me. Um, and if you are, I'm triggered.
You win.
V2B. V2B is the dumbest idea I've ever
heard. You know, the comment the Eon has
V2V. It looks at the brake lights of the
car in front of us. In this case, it's a
Ford F-150. What would it take to do a
private setup? What do you mean a
private setup?
Oh, the police. There's a lot of police.
Don't they have real policing to do in
Oakland?
Uh, Mercedes. Yeah, they self-driving
stuff is uh disappointing. Oh, those
numbers came out. Yeah, V2V with the
police. Yeah.
Um, no. No, nothing will make turning
your Subaru into not a Subaru will make
it easier to support it. If you turn
your Subaru, if you go to a Toyota
dealership and trade in your Subaru for
a Toyota, then it'll make it easier to
be supported. Um, where am I headed? I'm
going to a Fireside Chat in Oakland.
It's this place called Circuit Bridge or
Circuit Launch. Circuit Launch in
Oakland. You guys can actually come if
you want, if you're nearby. Um, I'm just
going to talk Periscope shit, but try to
be a little more coherent and sane. I
have my laptop. even have a few slides,
you know. Well, I put my hand on the
steering wheel when there's a
motorcycle. Uh or when I'm like within,
you know, if I feel like I'd have under
a second to react to something. Yeah, I
saw the Phantom I crash. Uh I don't
know, man. It just sucks.
What time is the chat at? It's in 12
minutes.
22 in Kons. Yeah, I got Kons spinning
spinning Kons.
Uh yeah. No, no, we're not good. I'm not
good with the PRs, you know. PRs.
How many React developers we got? We got
two. Uh we're hiring more. Uh if you
want to come here and develop React. Uh
we hire two more.
Um level four motorcycle detection. No,
it's not that motorcycle detection is
difficult. The thing does it okay. It's
just kind of a like, you know, it's
you're scared enough driving a
motorcycle. Just make sure to give them
space. Let's drive a motorcycle. Um, am
I supplying the cars for Ready Player
One? They had cars in that. I read that
took a while ago. What news interviewer
has Trist? No, man. The news. Like, stop
viewing the news as like they're trying
to convey facts. Just view it as
entertainment. And like, it's kind of
like being roasted on a late night
comedy show. Oh, no. Oh, the late night
comedy show took my words out of
context. Yeah, they're a comedy show,
right? The news is entertainment.
Um, it's all entertainment. It's not
facts. If you want facts, go on, uh, yo,
I heard about this app last night called
Citizen. It's like a decentralized crime
fighting app. I'm really excited about
it. I'm excited to go Periscope some
crimes
if we open source through React. Uh, I
mean, we'll get an open source cabana
this year probably. Gray panda update.
Yo, I got one right here, guys.
I got a gray panda right in this bag
here.
Oh, yo. Yo, this thing is nice, bros.
This thing is nice.
Watch dog for your phone. Okay, you're
doing okay on this turn. All right. All
right. All right. All right. T turn
limit exceeded. Yeah. So, our Civic
actually doesn't have that much more
torque than your Civic.
It has very moderately more. Why is the
GPS and the phone not enough for
localization? It's all the antennas,
bro. Oh, I should actually have a grave
installed in this car. I could show it
to you when I get out.
Um,
there's a construction zone here.
Construction zone combined with bots
dots combined with poorly marked road.
Soon as gray panda ships. All right. The
gray panels will ship uh soon. Bro, how
many Toyotas have we sold? No, the gray
panels have an injection molded. They're
printed. The new printed case is nicer,
though. Um the injection molded case are
nice, too. But um yeah, we're going to
switch over to that in a bit. Injection
molded cases for the for the white
pandas. Got an order of 10,000 made.
All right. 2.7 miles
Prius Prime on sale for $20. That's a
good deal. print the future.
Why do people care about the cases? I
don't really know.
The injection molded case was actually a
nightmare to do. Uh doing injection
molded stuff is just I don't know. Maybe
I just don't have experience with it.
Maybe when I get better at it, I'll hate
it less.
How many 3D printers have we ran
through? We have uh we have an army of
them. We've seen pictures on Twitter. Uh
I don't know, like two have broken.
They're pretty reliable. Zortrix M200's
though the support from the company. Uh,
no actually really. All right, I'm not
going to call anyone out negatively.
This is a positive. This year is all
about positivity, man. Phil Peep and
Logan Paul have shown me the way for
positivity.
Injection molding, it's just hard to
prototype is the problem. And like, you
know, the people making the molds are in
China. So, we got to do the Chinese.
It's got to like get on a plane and come
here on a plane and you know that takes
a while.
All right. It could be it could be
better right here. I'm a little a little
upset with Open Pilot's performance
right now. It's okay.
It's a little wavery cuz we got we got
bot spots in like a non-existent left
lane.
Release the 3D print files. Nah, we're
not going to do that. Uh shirts. Yeah,
shirts are flying, bros. Um shirts are
flying. We could sell more midnight
black eons. Midnight black are the only
thing in our inventory that's selling
meh.
Um, and I don't know why cuz it's really
such a nice product. They're so good.
Need some comi sweatpants. Yeah, we I
got I got my Maverick joggers on right
now. More police.
Lot of police out.
Imperial to metric. What about Imperial
to metric? Sell some flamethrowers. Not
selling flamethrowers, bros. It's bad
enough getting this shit through
customs.
All right, we got a cutout.
The radar, I'm sure, knows exactly how
fast that car is going.
Oh, it used to say, and I kind of don't
like that it doesn't say anymore. Oh, I
got to get off here.
The PRs.
Exit 36.
Have fun at Fireside Chat. I can I can
Oh. Oh. cringe during job interviews,
dude. Like people who try to like suck
up to me. Like that's going to help you
at all. Like I only care if you know the
right answers.
Suck up to me by knowing the right
answers and knowing things. Not knowing
things offends me.
I mean, not not knowing things, but like
honestly, here's what gets you in a
common AI interview. You'll say
something that isn't right. I'll explain
why it's not right. and then 10 minutes
later you won't incorporate that new
information and then the interview's
over.
Um, no, I'm not that mean to people.
It's more like like really what I'm
looking for in interviews or are people
going to think with me? I look for this
on dates, too. Like I like people who
think with me. Should you work for the
NSA? Probably not, bro.
I don't know. I mean, you can. I don't
know. I hear government jobs don't
really pay well.
And like you're part of like a sketchy
state apparatus that should die. Yeah.
Do you also have a meme question? I
don't know what that means.
Pole question.
I don't know that one. I know the one
where the guy talks about, man, I went
to Burning Man last week. What's wrong
with knowing things and sucking up? I
mean, I don't really mind sucking up,
but like the knowing things is the
important part of that. I'd actually
rather someone like told me I was an
idiot and like knew more things than me,
then you're definitely hired. If you
know less things than me, well then
maybe you're not hired. I like to hire
people who know more things than me.
How do you handle disagreements where I
end up being incorrect? I try my best to
handle them well. I'm wrong about a lot
of stuff, guys. I mean, is that right?
It's part of saying a lot of stuff. Um,
I just try to be right next time, right?
There's no like there's no the way I
view the world is like um it doesn't
matter like there's an actual correct
answer and the correct answer is on
behalf of nature, right? Like nature
provides you the correct answer. If you
get the wrong answer, you're just an
idiot, right? Like there's no I I admit
when I'm wrong all the time or at least
I try to.
Do I have a reality distortion field? I
don't know, man. And I feel like the
whole world is a reality distortion
field. And I try to keep it like
reality.
Um I mean, yeah, confidence is
important, right? But it's not like it's
not like actually confidence and you're
like the worst thing is fake confidence,
right? Like being not confident when you
don't really know. Is this good? I don't
know. Do com employees get stock
options? Of course. All right. I'm
somewhere, bros. I'm somewhere. Uh all
right. Let's see. Is this a parking
spot? Oh, yeah. But we got a parking
spot. Oh, we probably should do that for
him. All right, we're somewhere. Cool.
You know what they say? I'm right on
time. How many interview requests
resumes? We get a lot of interview
requests.
Um, most of them are
most of them are crap. Um, what's a
trait we look for in an employee? We
really look for two things. Intelligence
and motivation. If you are both
intelligent and motivated,
um, I don't care uh about much else. I
mean, know some physics. Like, know some
no high school physics. No like high
school computer architecture.
Literally stuff you should learn in high
school. No. If you want to work for
free, we probably aren't going to offer
you a job.
All right. I'm somewhere.
Let me lock my What if you show up in a
three-piece suit and tell me I'm dumb? I
mean, I'll probably like We'll probably
like laugh about it over like lunch. All
right, we're at the fireside chat now. I
don't know. There might be people inside
who don't want to be scopied.
Um, so I might have to turn you guys
off. But thank you for joining me this
far. We are in Oakland at Circuit
Launch. If uh you want to show up,
cheers. Yes. No, honestly, if you
contribute, I mean, that's another great
way to get hired if you're out there and
you make contributions that are like
all right what a day what do you think
can we take a second to chill for local
falls products
for
this brings back all good old memories
of the road trip road trip yeah i
remember getting really good angles here
because you could see your face through
the mirror too ah
so sadly oppai doesn't see very well
right now because it doesn't have hdr
it only has some dr
george play fortnite with me yo that guy
fortnite is now a band topic if he says
it again battle banana okay
i don't know what fortnite even is
um i just know that i'm not playing it
we're playing age of empires though
right that's right that's good that's
gonna happen
yeah
yeah wait let's give a little context
yeah so this is the 2018 comma ski trip
yeah it is the first of the you know
potentially more 2018 ski trips
it's great it's the only official common
section ski trip this is the first ever
comma company trip russia no the
self-driving car awareness tour was
there yeah yeah but that was three of us
single comma eon yeah
so you're coming you know we i don't
know where our dually on technology went
to the developers um we got we got a
single yawn right now
i'm sorry about the shakiness but that
is the vehicle
and not not open pilot that's just the
[Music]
we gotta wait for the camera improvement
project
let us help you with your merch george
sure
yo yeah what are you doing
show for the merch bros tell your
friends
all right so a big announcement to make
sure you tell them the big announcement
no no no no no no no no no no no no no
no no no no no no no no no no no no no
all right yeah it's a discreet
announcement just create an answer all
right if you guys know what's up you
guys will find it exactly if you know
what's up you'll know what's up and if
not it's really no big don't don't feel
bad no biggie that's right that's right
biggie would be happy but no big
hey this is the softest soft lunch
you can't get many good radio stations
up here in tahoe
lte though
we got 55 people we got to give them
some something entertaining
i don't know what we should do we're on
the common ski trip you guys ever go
skiing and it's been like a long day of
skiing yeah and now it's like after like
way later than you want to
so this is sculpey saturday yeah is
there a bounty on the 2018 accord hey
bravin
what's up bravo
is the oneplus good enough is oneplus
camera good enough to handle all tasks
and situations well it's made by sophie
so you know you don't owe people
duh whoa thank you reality check
damn
this is one of my life motto damn
uh but you know this is a very mellow
scopey saturday
if there's any questions you can read
about i am reading them i'm reading all
the questions i get i think
for the most part i just got schooled
you like what you're doing and would
like to work with you okay
that's great can it handle extreme
weather conditions heavy fog rain at
night
no definitely not they can't even handle
this this is extreme sun
yeah because the dynamic the dr
you guys running a great panda yeah i
think we are right now
heading towards or out of tahoe uh still
in tahoe for the next day yeah we're
headed back to the place that we're
staying in tahoe the place that we have
stayed they slept on a couch last night
yeah
benches couches they're all the same
yeah but you know we're gonna do tonight
guys we can play monopoly
i feel like you'll get really
competitive
yeah i love monopoly no such thing as
competitive monopoly
competitive and it's not fun for anyone
else well it was designed to show the
negative effects of a monopoly right no
monopoly was designed to show the glory
of capitalism
will extreme sun get better with new
camera person yeah with the well not on
the ground camera person i think it was
just me
like a few people reached out
yeah okay you might um my girlfriend
said hand off wheels she doesn't believe
she doesn't believe i mean what do you
mean
tell your girlfriend to tell you right
you know my legs they're in beautiful
maverick merchandise i know um and
there's the thing like believe man if
you think that seeking is believing then
you should believe sorry my app crashed
is there a bounty for 2018 in court
i don't know man i don't think so
there's no bounties for hondas or
toyotas really speaking of extreme
weather conditions did you guys now
unfortunately our rav4 is not yet modded
to do stop and go
so i'm going to have to drive here see
look comma canceled
we're working we're working on the mod
it's like the engine computer in this
car is half modded
yeah
but look how good that focus is what
it's in focus george worked weird
let's go don't you feel like uh it's a
it's a common thing heard around comma
wait but like why is there traffic
what is that how's the stop sign
the resort is closed and there's not
that many directions to go in tahoe so
it's cool guys how's the stop yes coming
good thank you you can answer too harold
well yeah i think we'll be here hello
bye great
actually we probably were out of stock
there were two left yesterday
great pandas are fairly exclusive
product but white pandas there's many
many of
many of them sure they come in very cute
boxes cute yeah oh we have new boxes
real nice now actually i'm excited for
the gray panda unboxing videos you guys
are going to make we worked really hard
on it you guys still having people
assemble eons nah it's over it's over
they're all
you together
ship out real fast you get neon chips
out within three days real fast yeah
real fast i don't know
should we play any games in the skopies
should be playing games
does his girlfriend believe in him does
your girlfriend believe us
so we have our destination here in waze
it says he'll be home in 16 minutes
[Music]
he wrote a little note to me in french
periscope accessible to the english to
the english speaking audience
you know actually they kick you out of
poker table in vegas if you don't speak
english oh really yeah that kind of
makes sense english is the language of
poker tables it's the announcement that
great pandas are supported and working
sure yeah oh yeah yeah that's funny
i mean
very supportive like the newport he said
yes she believes us fabulous the new
board d does work with panels
i'm not sure what you exactly expect to
do with birdbath no no we'll support
that in the next release she was what
was she
guys we used shiffer to find our parked
car today
our car was parked and we used shiver
yeah that was exciting
exciting can we run snow scooters
oh snowballs
no no no it's not going to work cause
there's no snow exactly it's the same
problem as cross-country hey does the
enough breaking alerts for older cars
that don't have the tech i.e camera
based alert yeah no not camera bases you
get a radar gotta get a radar put a
radar in
do you have a radar
oh
oh it's the clown motel we were here
last night
i want to show them the beautiful view
of the water but i just missed it
unfortunately
sorry folks oh i thought that's a 10
vacancy but it actually says no vacancy
the scopies know what there's to do in
tahoe tonight yeah what do you scope no
well actually last time we met a scoby
it was yeah we met scott
no no no we have to listen this is our
audience it was great but you know
company ski trips for you know companies
for company but you got you guys are
here to see the company ski chip we
gotta drive all the way back
you know this is a tire
low energy periscope i know are there
still people well it's like 36 but
they're dropping pretty quickly they're
driving pretty quickly
i mean i don't know what else are we
doing
they're here they're with us
do you think we should end it
i don't know
i'm impressed that now it's 38.
look we got new people coming on joining
their scopey right now so just use a
chill scopy it's going to be saturday so
it's going to be sunday i was ranting
about the car companies this morning
but you know after a long entire day of
stuff all the things you can ask about
no i'm not slack but after a long entire
day of physical exercise you just don't
like feel like ranting as much anymore
can we add radar to cars
ever heard of duct tape yeah no but like
seriously if you duct tape a radar to a
car and connect it to a neon it would
work
kind of duct tape to the front
like the original didn't we were you
duct taping some radars to our car in
the very beginning yeah
yeah we had a duct tape right now in the
accuracy remember we thought it was
going to break yeah exactly
a sketchy pedal interceptor
i almost went to that taco belt last
night this is a beach
looks like it's so pleasant
now let's try this again slightly better
let's try to move it
all right that kind of works I upgraded
the app no no no no without doing a new
product I'm good good good I'm glad it's
better no I'm not switching streaming
platforms if periscope doesn't work
that's just it for that's just it for
streaming because reddit's a waste of
time no there's a new product is Monday
is today Monday does it look like Monday
um you know what I'm happy with a CEO
I'm never gonna deal with hiring people
or managing people again I hate that
shit I'm not really a fan of people you
know I like technology technology's
pretty cool so I got a few things to do
all your Geo hot signs box that's right
that's right
we did we did box now I'm I'm doing
marketing today I just have to kind of
cool things to show off for research how
long Eon and new product share the exact
same codebase
so don't worry about that Eon will be
supported for exactly as long as new
product is supported get off don't type
well open piles driving you get off the
phone level two bros level two who's
tired this guy's tired Davin engineer
that's right that's right can you have
statistics what do you want statistics
about miles of autonomous mode let me
see if I can do
I want to show you all of these when I
was broken that day some of these I can
show you
let's do last six months
so these are daily miles driven
is our graph of daily miles driven so
you can see that it's up around do about
14 K miles per day so that's pretty good
and then yes that's about 14 K miles per
day and then I'll show you the other
graph so this is percent miles engaged
that looks like that but it's not too
broken so we're engaged about 50% of the
time so about 50% of the time
open pilot is actually doing the driving
miles wise so we do about 7k autonomous
miles per day cool cool cool
begin though so I have two things to
show you today first off this so this is
what we're gonna be showing off we were
hoping to have a Maps launch ready by
the thing oh I don't know about that
stuff but you can check out the maps
they're kind of beautiful right yeah you
see the lanes so these are all the
things they're localized and the zipper
still has major bugs in it we gotta
figure out but so you can see these are
all the orb features that are being used
all these all these blueish dots yeah
and this is just like what resolution
will the maps be we're trying to make an
accurate to 10 centimeters so you can
see like these lanes have a lot of
spread and variance but the average of
the lanes is quite good because that you
can see that it is galaxies so you have
Gaussian distributions on these lanes we
can improve the zipper and fix this a
little bit oh yeah Tesla Tesla the six
months to a year ahead of us they always
have been and just unless they stumbled
a there there won't be a change look you
can see like someone changed lanes here
aah yeah hopefully if the Maps done what
Willie says at the end of the year um so
you guys know to everybody who works at
a mapping company Oh what are the maps
gonna ask not ask not what maps can do
for you but what you can do for maps
let's say just Shefford plus user on
camera if you turn it on
okay shiver'd plus an open pilot are the
same code base the only difference is
that schiffer plus is read-only it
doesn't output anything to your car um
goldstar miles yeah you know we have
that internally yeah someday we'll
expose it I don't know guys
I worked in research now I don't do any
of that stuff I'll show you this other
tool I was playing with I was pretty
cool so this tool lets me visualize
episodes and what the model was say it
and give it a little bit made what
so don't be racist look at these little
episodes all right she can see this
episode so this is just five seconds of
driving up the highway
well you're hacking my computer your
band - no more hacking for you who's hi
what hi it was brah
you talkin about me you want to be man
and ones getting banned today look at
this shit look at it okay so that's like
the path over time so this one it works
pretty well but we can see ones where it
messes up a little bit more so let's
wait for the next one to load and these
let you explore in terms of five-second
episodes that turn just pretty well well
yeah so right now the field of view is
just the the red rectangle um but big
model uses the whole thing let's see
what we got can we build maps from night
logs yes of everything I don't think we
exclude the night once I don't think it
matters that much
um I mean most of the alignment stuff is
done okay look you can see a little bit
of behavioral cloning here that's
because the user shifts a little to the
left in the line you started some dill
kind of exciting yeah let's see let's
see what that goes yeah so we have we
have maps beautiful maps this is only
one we're using s2 tiles this is only
one s two tile you can see this side the
processing is broken but it's hard to
get this stuff to work well we'll do it
people always that's a stupid question
why do people matter explain this to me
like you asked that question
hang on so I think you asked that
question is like a proxy question for
how productive is research I have no
idea why you think number of people
correlates with productivity right
number doesn't matter I think that we
might have the first real release of
like large-scale HD maps I don't think
other companies have this and with
nothing this was smart we think about it
at what point might new hardware be on
its way to data no it's not I know it's
not your intention don't worry you're
not bad
the banhammer is coming out today though
you know I'm really I'm really an
abandoned people kind of mood what are
you doing with the map well we're making
it beautiful and precise and accurate um
no you know what the idea is right so
right now we have a level-two driving
system and there's always going to be
level two you gotten feedback from other
companies do I look like the kind of guy
who asks some people for feedback oh
yeah feedback might as well read the
internet comments oh that's what I'm
doing right now
don't you think Wow I'm leaving the
internet comments you guys are internet
comments mapping the whole world is a
big job yes for computers for people we
just write the code we don't write bad
code and then we run it it's a big Map
Reduce on the world it's literally a Map
Reduce
and it makes a match see what I'm saying
just big model incorporate time little
model incorporates time little model
uses ten frames of context you are scope
is that's true you're not random
internet commenters I know some of you
yes almost a I want to show off this map
and this tool
not only I'm not worried about other
companies stealing my maps they won't
even be stealing right like this is a
stupid way to think about it like okay
let me tell you something if you have if
you have a diamond ring
all right on your finger and somebody
steals your diamond ring you no longer
have a diamond ring if we have maps and
somebody else uses our maps guess what
we still have Matt nothing was stolen
the world just got better
intellectual property is the biggest
like okay this isn't this isn't this
isn't the twitch this isn't which we
don't we're not gonna go off on rants
like that um but no no no I'm so not
concerned about companies stealing my
map we're gonna give the maps away free
I'm not sure that I think we're gonna do
something like Creative Commons
Attribution because I do like the idea
of everybody using I'm having to stick
come AI and there I do kind of like that
so we might reserve that right
we might reserve that right justjust you
gotta say like yo man come AI coming
eyes is lit go to shop that copy that
about products liability
oh no I'm definitely disclaiming all
that shit don't use this map for
anything I don't even trust that if you
look at the map and you're epileptic and
it gives you a seizure I'm waiving all
that liability that's on you man
so yeah maybe well we'll do that too
maybe that'll be can we do the maps
under the MIT license now but I want
attribution does that my to license have
attribution I don't even know oh my kara
lies about attribution but I don't want
like Google using my maps without like
sticking that Google won't use my maps
Google actually has good Maps but you
know losers might use the maps and on
the mall to be like yeah them commie
guys maps all right let's read this MIT
license yes the above copyright notice
should be included in all substantial
parts of the software excellent perfect
people thank you about the quality of
the map will be pretty high-quality
don't be as high-quality as anybody
else's especially so we're doing
highways first yeah yeah what make it
downloadable how can your device control
the car brewery the code I don't know
what to say about that let's look at it
more
ah are we still focused I don't know
what that means yes you always have to
keep your eyes on the road
yes 104 is a scam it's sad that we only
have this one little area now well you
know we also have this who can't show
you that we haven't got any sales yet
today that's true
has anyone approached me from Bosch let
me tell ya so first off I'm not CEO
anymore if somebody from Bosch wants to
approach the new CEO he might be a
little more kind if somebody from Bosch
approach to me I'd be like okay for
everybody else they're free but for you
ten thousand dollars maybe ten thousand
dollars and then you could use the maps
you could also use the maps for free but
if it would make you feel more
comfortable paying me money you can pay
me money no no the maps aren't for you
to look at therefore open pilot to look
at and no you can't look at the maps
while you're driving no no it hasn't
really gotten better oh I know where I'm
going yeah we can say this stuff as well
yeah yeah they can buy some I don't know
man
if the new CEO is gonna do scary
business models like this I'm fine with
that
there we go cool
oh yeah this is like the whole Bay Area
so like all of that stuff you saw in
that one little area we have for the
entire thing
we just haven't you know well there's a
few issues with releasing map explore
apparently these tiles are of course USA
only we love America I'm apparently
these tiles the terrain tiles are loaded
from cesium and you have to pay a lot of
money to license them so we're gonna
like try to put it on map box or
something I don't know hasn't been
driven yeah we'll eventually do that you
guys want to see model bugs we can find
model bugs I have a cool list of model
bugs we can look at - yeah say lucky
you see that you see that span you can
see why it's happening the model there
yes starts to predict the lane change
I'll first say go straight but it's like
no you want to change lanes right you
can see this behavior here as the model
eventually gets to a point where it says
go straight when it's trying to pull you
back into the lane you get lyft or uber
drivers to map for me well this is the
debugging model tool alright so I could
show you guys you want to see the list
to my official research lip
neither sm PE and dil that's what's on
my official research list we should
write official research but we also
bought these new markers if you remember
me getting angry at markers on previous
ones throw a little scary and
intimidating looking so let's do
official oh this is so solid research
let's go order together no so unordered
list look it has dots it doesn't have
numbers it's an official official
research list
guys but actually eons aren't sold out
yet we have kept two eons left let me
bring up this webpage and then I can
show it to you because I can't show you
the pages in the meantime lidar is a
scam no look I mean look man that's the
thing you know maybe sometimes when I
say things like I like to say things
that are provocative because they get
the people going but the truth when you
say something like lidar is a scam
there's a one-hour conversation behind
that that actually talks about a lot of
nuance right so whether light lighter is
a scam lighter is not a scam what what
is this is this like is this like to
team politics the truth about lidar is
there's two worlds who are potentially
living there's one world where lidar
technology becomes cheap and ubiquitous
before computer vision gets good at
perception there's another world where
computer vision gets good at perception
before lidar can be mass-marketed i
think we live in world too right
i think we live in a world where
perception is actually already almost as
good as lidar and you know the only like
this was not true obviously in 2007
they were doing the dark urban challenge
and stuff derp Grand Challenge but today
things are different because we have
deep learning okay cool
yeah
to eons by eons we have two left I don't
know that's it that's most of the day's
periscopes could be a short one today he
used to tell me how long I was scoping
for and now it doesn't say about anymore
can you recommend your chair yes this
chair makes you better gamer yes it
makes you a better gamer no but uh yeah
I know long scope is there long scope is
your over
scope is were on their way out why by
yawn instead of new product even when
new product comes out it won't work as
well as he on because we have to trade
models using new product it's pretty
much the same stuff there's two left
there's to steer down to zero for Civic
I mean you know how to do that I'm not
helping you with that you know what you
have to death
three people let's let's chill four
things leave that leave that model yeah
I'm kind of tired today when we have one
mater this morning it's nice here so
this tool this one not the other one
so this doesn't have anything set yet
are you actually the colors are switched
you can click on these frames oh man
this is slow
that's trash my browser Maps crashed my
browser okay guys there was too much
data in the maps Oh
Burkhard timber five apps let's try
again
making
yeah you guys got a buyer products than
we get I don't know I'm not CEO anymore
rats
WebGL hit a snag oh I know what happened
stupid tensorflow used all my GPU memory
so I was like zoom in here see this they
see this one let's see what this picture
looks like so you can click on this and
that's that frame Wow look it's a
picture of a San Francisco Street let's
see if we can line it up with satellite
imagery it's the right one there oh yeah
you can see it winds up well with the
satellite imagery yeah pretty nice um
yeah so that's it so we have to talk
about on today's scope is Trump use the
neon and I strongly doubt Trump who's
the neon I will do let's do let's do a
few more we'll do some questions will do
is this random question time that'll get
us up to 30 minutes yo yes I need some
r-tx it can anybody get me a RT X 28 et
eyes I'd buy some on what is eating
stream oh we do love eating stream Wow
Tesla's down imma buy some Tesla stock a
buying big Tesla stock here's here's a
scam here's we do a three line right
allegations crash cash low price be
barred from so it's okay no no it was
not going to jail but here's here's
here's some Elon level thinking here
here's an idea
Elon gets barred from serving as an
officer at a public company he's kicked
out of being CEO of Tesla the share
price plummets then he gets the Saudis
to buy Tesla to take Tesla private and
then he comes back on a CEO the share
price goes back up good scam right take
that as you see Sarah fight you
I don't know man Oh politics is for
losers
naturally CTA soon TM especially amazing
clemency that's it I'm doing a right
what else what else we got we got good
questions
you're a PHP programmer bro no one's
coded in PHP since 2004 and Facebook
though Facebook Google I used to hate
Google s I hated Facebook ever since I
quit
where's twitch now I don't winches
anymore
I don't know stop light detection yeah
someday
Tesla hasn't shipped it yet either guys
if you live in a country where you have
to pay taxes you should lobby your
government rust bro what would I do with
the frost you code we code in one light
we really just code in Python yeah you
code Python FCW and I would shiver the
app ok guys real news we took pandas off
of Amazon the shipper app is never gonna
be updated sorry
did I make the ps3 jailbreak we're
definitely not talking about that
reactive elephants I don't know apply I
don't deal with this anymore I do
research I show you these cute little
things can I work at coming yeah you can
apply you know I would I did it it was
like give me a job at comma a I because
I like people so I really think about
what they're doing but maybe the new
administration will change it to careers
at comma AI or admin or get careers
that's the word that's like the
politically correct euphemism for the
two and a half years you're gonna spend
right yeah I got to know things right
now that's the old regime I don't know
about the new G man can you go somewhere
to learn more about big model yeah check
out exception check out
the papers just that a thoughts on going
I think it's disgustingly verbose I like
Haskell
the problem with Haskell is that those
people have like you know they value
mathematical purity more than working
programs they've got any working
programs but like mathematical purity
and then working programs have you met
the new CEO yeah it's Ricardo you've met
him
hello oh yeah what iris code my thoughts
on the Cardiff five is pretty good it's
pretty good it was the whole thing yet I
wouldn't say it's like like like
kamikaze mind-blowing but I'm decently
happy with it what do I think of solid
what is solid wait wait you are PHP
programmer I know that scam you're lying
to me I don't know what any of that
means
check out destroy all software comm they
have some pretty good like paradigms
this seems like I don't know nikka
substitutional principle it seems
needlessly complex okay you're banned
you're bad you're just bad good bad I
did a good big model on your Roomba no
Roomba socks didn't use it anymore
has it been 30 minutes yeah let's say 26
minutes you guys got four more minutes
for question you do Java what would I do
with job solids number one on a hacker
news right now oh oh solid reshape the
web as we know it let's let's let's
explore solve
solid was created by the inventor of the
World Wide Web
okay so first off this concerns me here
right this is is a appeal to Authority
right so you know if you talk about like
fallacies okay
this concerns me as well I don't want a
programming language that empowers users
like I don't even know what that means
this is for everyone what does this mean
okay build on solid this literally just
looks like it's designed to be like
marketed they have a they got some
influential guy to stick his name on it
this is this is complete BS if it's
feel-good marketing this is for everyone
right how it works
you own your data you decide where to
store your data you give people apps
when I see oh I see oh now I'm going to
the etherium hackathon next weekend guys
okay listen oh this is complete garbage
let's see what happened you saying about
it after reading what little okay now
what solid doesn't seem to work
following instructions for how to
authenticate my singulars all right oh
no I'm not up on the latest JavaScript
frameworks I use jQuery you are bought I
know but do the new comma a I have new
plans do I like go like no I think it's
insanely verbose I like rust
I like rust I like what they're trying
to do I think the concept of like the
way they do memory management was like
ownership is nice but it's really hard
to code it like it's hard to think about
do I like see no one like see I like
Python
Oakland style side slideshows on the Bay
Bridge I don't know what that means
any ml resources recommendations bro
like people ask me these kind of
questions like I don't know
google it PI make your life easy are you
geo hot I don't know man are you geo hot
we're all I have Secretariat I do like
pizzas too
all right thank you all for joining this
scope e I will leave you with
on research on the next prop model to
evaluate no bubble game recommendations
get off all mobile games oh look at that
since that solid that model Asst we are
all do hot that's right what version of
Python Python to all toast yeah toast no
they don't put no and I will take a
minute to talk about this toast doesn't
put butter on the toast you have to put
your own butter on the toast and then
when with a friend you know I'm the kind
of person who mostly for the most part
just like like whatever you know they
don't put butter and you toast the best
their policy you know everyone has a
right to conduct business throw away but
she asked she's like can you put butter
on the toast and the toast people said
no that it was against their policy but
they could bring us out softer butter
and they brought us out softer butter
and this made the whole thing worse and
then I went to another diner and they
had butter where there was two pieces of
wax paper okay um thoughts on migration
to Python three Python three is the
single greatest disaster in programming
language history now it's sadly kind of
is but it has burned up probably over a
million hours of developer time and
Python 3 is just a tragedy where nobody
wins I love butter on toast to you think
common need a C programmer to work with
hardware ok you could apply give me a
job of come III I do research I don't
work with hardware's ok bye bye scobie's
welcome welcome welcome welcome
we make sure don't everything up on my
computer that I can't show you guys no
it is not like that it is not clickbait
you know I wouldn't do that to y'all you
know I wouldn't do that to y'all it's
not laggy skokie Sunday this is high
quality Skokie Sunday shit wait
do mi o fi who's here from my Wi-Fi yeah
my wife asked
no no clickbait okay guys if you're
watching this periscope right now if you
go on the shop at shop taka Medina and
you add a midnight black Aeon to your
cart hang on
oh we can even apply the discount
multiple times per order it's fine oh
yeah $100 off
with the code labor day bro
there was no upgrade program no no no no
no no so this is only active through
Labor Day if you were thinking of buying
a midnight black Aeon I think we'll ship
we'll probably ship Tuesday cuz it's a
holiday oh no we don't sell spray paint
no no no no um but if you use that code
for day bro alright so maybe here's
something else we should uh we should
talk about
so let's first tweet about that which
treat about that is there promote get a
shareable link yeah I got tabs bro get
$100 all midnight black let me make sure
I get the capitalization right you know
you gotta get the subtlety right you
guys you gotta get the subtlety right
$100 off oh yeah no no it's all capital
midnight black beyond - cab dev kit
that's right let me just make sure this
link works oh you know no the link only
kind of works
oh well good enough with
with the code labor J bro buy it soon
discount over tomorrow night shop calm
about AI that's right code labor day bro
at checkout let me see if this actually
works I don't know I've never actually
used a coupon code on our website before
let's continue to check out discount
code let's try it
Labor Day bro let me show you
don't midnight black yonder my car I'm
gonna apply the discount code Labor Day
bro
oh yeah $100 off look at that look at
that $100 off at check-out not chicken
clothes
check out buy it soon discount over
tomorrow night
wait what plant multiple times bullshit
if you cheat we cancel your order cuz
that's how we were all Akane I know you
can't apply it multiple times what I
think you can do I think if you add more
than one to your car you get the
discount applied to all of them yep yep
yep that's right that's right
I two of them you still get this 200
it's $100 off each midnight black
because we want to incentivize think
there isn't even 100 in stock there are
100 midnight black eons left in the
world you get yours today
and you'll be happy you don't get yours
today you'll be sad but it soon discount
over tomorrow night lowest price in
history
exclamation point lowest price in
history exclamation point
yeah why so low guys it's Labor Day you
know it's not Labor Day with you you
know how much I love America
midnight blanking you I miss nice it's
got lots of space for long drives what
models next after they sell out well
price ISM prices only go up bot you got
but yeah price is only and it's even
lower with your affiliate link yes
that's true you can go crazy don't go
posting affiliate links on the slack but
you know we're trying we're trying to
get our user numbers up I mean uh you
know what wait
no see no I capitalized it wrong it's
terrible we got we got to delete this
tweet so much space for drives we will
also include midnight black yawn dashcam
dev kit buy it soon discount over
tomorrow night so much space for drives
lowest price in history so much space
for drives lowest price in history
that's right shop I don't got anything
using Twitter watching me on periscope
just counting over tomorrow night so
much space for drives lowest price in
history yeah
that light eyebrow but ya know get yours
and get yours today who's a bot I'll be
on the bottom because they wanted the
real question is why hasn't periscope
caught on to this pattern check it out
Annie made me tea I'm gonna drink it
tastes delicious thank you Andy wait but
now I don't know if you end your message
with a heart you might be a bot oh now I
understand why periscope doesn't bit
yeah I know
guys I know where periscopes of dying
platforms should we move to youtube live
is that what we should move to look at
we got more followers on Twitter how
much follows is label half so that's our
followers 17.2 way way mo twitter
alright alright guys we can beat way
ball was caught up to we can also beat
way mo and miles so Wavell has 9 million
miles we have is it up to 5.3 million
yet oh yeah it is we have 5.3 2 million
miles so we are more than halfway to a
window to ship for miles really count
yes I did yeah we got all the miles
most of them honestly today open-top
miles this is a panda you guys know the
pandas I wish we sold more pandas we
need to sell panthous is that a bot I
don't even know that's kind of it
see like look now that we talked about
the hard thing
these are pandas by a neon HealthBeat
way mo today is the best day to get in
with the midnight black you know I'm
Michelle that's why we go on periscope
we got a shill for that buy that Merc
you know
has anyone used the code yet no users of
the code yet sales and good guys sounds
that be good we've been we've been you
know July was the highest sales month on
record for , August was really close see
how close August was now damn me why not
have remote-control driver like way mo
regulators feel comfortable don't worry
by that merge by that verse doesn't Jay
Paul song you know Jake Palmer song it's
a great song actually merge song all I
want for Christmas
well I didn't even know it had a video
[Music]
guys honestly the pawls are kind of
cringe-worthy now they were cool last
year
you all know when Logan Paul was cool
he's not cool anymore we're over Logan
Paul don't worry don't worry we're not
going there we're going to talk about
self-driving cars today um I was driving
around in my uh my Honda Accord this
week and I've been I've been happy it's
pretty good guys oh I was talking to my
friend yesterday and I'm like I'm
talking about how I got sunburned right
you know I got sunburned I wanted a
sailing trip and I got really badly
sunburned because the water doesn't
block the sunburn because the Sun burns
you with UV not with infrared infrared
is heat so the water does block the heat
but it doesn't block the UV now an
interesting side effect of water
blocking IR it means that light ARS
don't work in the rain and ladders also
don't work not even in the rain but just
when things are wet oh you're pretty
sure I got ADHD bro let me see your
medical degree
you got medical degree bro oh you got a
summer from welding yes that UV right uh
no you're not giving a summer from lie
down lie down won't sunburn you just
will never work in the rain a way to
avoid regressions during releases guys
um so yeah this is the rolls we're
hiring for right now right down here um
I've given up like when I release
engineers in firmware anymore those are
kind of ridiculous rolls actually there
aren't really real but we're hiring a
test engineer we're hiring an m/l
engineer or hiring someone to come work
on explore in Cabana um if you've seen
exploring Cabana they could always use
more love the other little third they're
a little janky and we want to be better
here's another here's another
interesting thing to think about you
know I've been asking you guys on slack
we're trying to get to a thousand daily
active
users have it asked you guys what you
want general things are more stability
less battery I don't care if you have a
comp side degree you can go to our
github and you'll find this repo called
speed challenge if you do well on that
challenge I'll hire you no matter what I
don't I don't care about anything else
unless you're weird real high or weird
people
now I'm kidding everyone here is weird a
vision a CC of a challenge is the its
speed prediction challenge so we give
your video predict the speed of the car
from the challenge no no no I'm weird
Braille look at me I'm a weird I have
ADHD that guy said so oh no we don't do
adjustable following distances it's not
safe
so some of those cars will let you
adjust the following distance is
something that's really small um if you
right now with our following distance VG
still works here absolutely um if you
adjust the following distance to be too
short you won't have enough time to
react if the car makes a mistake so
that's why we fix the following distance
to one thing salary equity yes we have
both of those look if you're trying to
come here and like oh I'm gonna get paid
a crazy high salary oh you know oh I'm
gonna make equity and I'm gonna be rich
then and then and then that you're
missing the point I mean you might do
those things look if we win when we win
I mean I don't know like guys you see
that you saw the way motion right turns
out like we've always mostly fake news
and doesn't really work like obviously I
said at my medium folks you know uh how
many scope is that we hired we've hired
two people from the community obviously
you know VG was talked about and someone
else so we've three main focuses one of
them is a secret which we can't talk
about it one of them is Maps you know
we're doing maps by the end of the year
if you get hired can you get in a
private round
Oh like investment I don't want any more
investment we got the best terms from
VCS who cares and our third our third is
daily active users so daily active users
maps and super-secret projects you know
that's true that's true you guys know
you guys know who's here um yeah oh man
has anyone used that coupon code yet
okay have you use that coupon code yeah
go work for him if you want a big salary
that's good
someone did buy something our t-shirt we
saw the t-shirt oh yeah it's plenty you
you will live comfortably it's starting
salaries are like over Harvick a crude
for software you can live in SF
comfortably I mean that's a thing right
like you know wait you're a bot you
thought way Mo's the furthest ahead I
mean the furthest ahead towards what
right
I don't think way Moe's business model
works I think that their cars are way
too finicky and way too expensive the
Civic tremor hack right now you know
what needs a firmware hack the Accord
drive around the Accord all weekend two
things the Bosch ACC is great on the
highway
no I lie you know the transparency thing
is all I we're all chills and hype here
it's all it's all lies no but uh the box
as you see it's good on the highway I
was happy with it on the highway but
it's stopping behind a stopped car is
it's it's terrible so I'm just like I'm
uncomfortable yeah I want to stand firm
we're have for my Accord to because
somebody get on that weight Accord go on
how much of a technical challenge is
firmware happening how many ml people do
we have all right so there's no teams
here like we don't have teams we have
individual roles like everyone here is
an individual contributor the problem
with team
is the dilution of responsibility right
um but you know this is kind of why I
don't like working on teams like if I'm
like three people are on the same
project it's terrible because you spend
most your time communicating with people
unless you're time coding it's much less
efficient then you know just sitting
down coding so yeah I mean our ml people
are more so we'd make the model you
could work on the model a big model you
guys know about big model I talk about
big model big mall is pretty cool no we
got rid of the recruiter recruiting was
kind of dumb um this is this is big
model yo big models sick okay all right
I'll show you guys I'll show you guys
something since you're all here on the
periscope so this is the model that's
currently shipped on the car this is our
like internal model tracking tool it has
a validation loss of negative two point
five nine three so you can see this is
how it trained this is big model big
model has a validation loss of negative
three point two three five crazy guys
big model also little model has 1
million weights big model has 23 million
weights no toll cars actually the
problem with the rav4 we thought it was
the model but it's not
it was calibration and that's why we
shipped new fast calibration I hope you
guys are enjoying that what alright
alright no racist shit roomy cab is a
bot next time roomie cam talks I will
ban them
what the hell was this all right we got
we got we've got a no racism policy in
the periscope raises get bad that's
right get out of my periscope advantage
is a big model other than more weight so
big model so little model only looks at
little part of the screen big model
looks at big part of the screen um big
model big model trains on crazy amounts
of data I can let me show ya bring up I
got some infrastructure here so big
model
six point two terabytes of data big data
browse this periscope broken did I come
up with a big model name ten big t1f no
oh it's not as great I was driving
around in hentai I should I should have
brought you guys I was driving out with
you and I Thursday night binary exploits
you've written for Mac OS your band
Batman let's say and we're commonly as
Batman you come here you get to be
Batman you're a bot Wow
my periscope is full of like BOTS and
races and terrible stuff tonight band
man that's right we drop in the hammer
let's uh do I have a midnight by the
young we can look at this is my young
she's my young Cinna young that's black
screws as we mark the internal ones um
the car manufacturers can't walk me out
remember that Apple and Sony couldn't
lock me out big models not in production
um big model doesn't fit on the on e on
quite we got a shrink big model we got
to take big model and then do weight
shrinking does midnight black get hot in
sunlight not any hotter than the other
Eon I know some of you guys have been
talking about yeah the thermal issues if
you keep it plugged in and you get a
comma power you always have power it
will run the fan even when the cars not
on so that does pretty good things for
the battery campus encryption yeah way
he's touring the key small big model
yeah you're the small big model right
you think it's an oxymoron but it's real
shit how big is the binary the model so
this new big model is 23 million weights
so the current model that shipping
about a million weights so it's a little
over money so it's like 20 times bigger
don't worry don't worry big model will
run on midnight black eons and normal
eons yeah I've never had thermal issues
either but it's for people and we keep
all the eons in the car but it's for
people in hotter areas you know where it
gets up to like 95 do we use GPU no we
only make model on CPU no Krispies you
want to see you guys here training
computer lessons ancient or any computer
oh here we are at my prompt ssh GPU
slave double zero yeah look at them we
got ten we've got ten ten sixties in
there they're working on training a
different big model right now where I'm
playing with some high prefer a meters
I'm playing I'm removing the dropout and
seeing if we have enough gated actually
just not used dropout at all I didn't
write it it's called Nvidia semi but
yeah so we got we got an army of GPUs
down there
oh the comment ASCII oh yeah yeah go
sorry for the masses right we got yeah
these are timid ease yeah we have we
have 10/10 ATT eyes in this box you
thought inside was too many secrets yeah
well I hate some of the secrets when and
how did I learn them now you guys will
see when big model comes out um new
calibration is is probably you'll see
you'll see what harmonica do it's it's
cool the other thing that we're working
on is the cutting problem so small model
can't see the cuttings but big model
should be able to big model should be
able to see if there's a car merging
over into your legs the radar has a very
narrow field of view
um the camera neon has a pretty wide
field here it's actually like 70 degrees
so it's enough to see cuttings but the
model right now can't see them because
it's small model you know everything is
better in big model big model and it's
also it's a much more modern machine
learning architecture so like small
model is not that different from the one
we started out with when Connie I
started big mall is a its exception it's
based on exception so we got those what
do they call those stupid convolutions
depth-wise separable convolutions so you
have I could calm if you have like a
three by three columns
and it has a bunch of channels can it
play crisis that doesn't matter
oh yeah people merging in yeah I know
we're doing that
what's the predicted support timeframe
for an eon who said there was support
did someone tell you there was support
someone lied you know moving to a new
one plus model no no no no so the the
Aeon put this way the Aeon compatible
code base will be sold all through next
year as well we can definitely fix
cartons with video I'm kid big mobile
identify box sorry that's not with big
model is turned on you are by I can
identify bot so I have really big
hundred trillion ways is crazy
why do you think the camera aperture has
anything to do with the Sun yeah we'll
see well we'll see we'll see what I'll
have one go by what skills required for
the ML engineer well ml and engineering
with GPS coming into play no we're gonna
do maps first right so we do have apps
this year and then the Aeons will
hopefully start using maps but you know
if you for open piled 0.6 if and when
open 0.6 comes to eon you're gonna need
a great panda yeah I really don't think
the aperture things a problem
the focus algorithm could be a little
bit better yeah that's pretty good
amines actually but yeah by panda by UN
that shop comedy I tensorflow required
denim out we use chorus which features
are using in your maps lanes and the
same as the super good map if you check
out like our map stuff it's similar to
that
we have like ley lines and paths and all
that stuff
our gray panda works on Mercedes I don't
even know what that means you can stick
a gray panda in the Mercedes it'll work
I guess maps topside the big model new
hardware stop signs yes thousands in
traffic cuts yeah yeah those will happen
someday
no you can't train your white panda for
gray panda you can buy a great panda for
$1.99 you can also wait you know you can
you can just buy the eon you can buy the
grab handle later we have we have a
bunch in stock so great pandas will be
around for a while they'll be sold well
into next year pandas are gonna be sold
for the lifetime combo you know many of
these things we have I'll tell you how
many pairs you think we have all the
column please protect you what are we
doing with the rest of our white Oh what
feature descriptors it's uh a bunch of
different things or yeah we do we have
10,000 pandas I have boxes and boxes of
pandas so pandas we got lots of them
think about pandas firmwares open sores
it only gets better with time I'd like
to hire somebody to make the firm but
panda firm or even better is this is
this some affiliate marketing going on
in my twitch channel sorry sorry
periscope I gotta I gotta keep it
straight I mean you guys know just like
GB ASMR has another channel on twitch
tree that's a twitch comment I gotta I
gotta stick to the periscope we're here
to talk yeah Jesse Jesse definitely made
some good contributions to to the Panda
firmware will you give any extra white
pandas to needy zoos honestly if a su
sent me an application I would think
about it we tried to partner with Panda
Express to sell the pandas who was Neil
McNeil still exists Oh pandas are
indestructible guys don't worry
about that what would improve Panda
firmware Joe I don't know like something
I'm not sure what Pam's do right now no
like we need better elm support and
better J shit support so it works with
like the manufacturer tools yeah yeah
yeah
[Music]
when does the comma pop-up store
please make cabana functional yeah well
we're hiring somebody you want to come
here and work here make cavanna
functional and every nice so they're not
work videos broken andy the scobie's are
saying cabañas broken let's see if i can
get to the great is the test a longer in
Cabana wait what is this cabanas broken
let me smoke him little smoke on
periscope sometime we spoke on twitch
what video doesn't work
hang on I'll ping Andy scope ease are
saying video broke in Cabana it broke
when he fixed little-endian really Oh
Explorer looks nice guys this is this is
my Explorer
my drive in the Civic 1+3
yeah I don't know why these ones aren't
loading that could be better
my Explorer is looking sexy like this
takes forever to load was the hide why
hasn't it loaded yet I don't know how do
I open open in Cabana video works fine
for me guys I don't know what you're
talking about video works fine I don't
know why it's a laggy but like as
Explorer is using tons of stuff but yeah
the video vitiates fun
guys I just went to this videos fine
load up my Civic DV stay
all videos broken in shared drives we
gotta be specific
oh it's just the demo drive okay this
Dopey's are saying you guys I'm trying
to fix your problems now I'm thinking
about I'm thinking about ya Bugsy checks
slack message and see we got here
yeah you're right there's no video I
hang on alright I've done my part of
sending that link to relevant people
[Music]
[Music]
Australian X for most Eon whoa whoa you
guys uh how was fake news I'm back I'll
show us ridiculous job requests do you
want to go through we were having a good
time responding to some LinkedIn
messages Australia needs to lobby the
government to drive on the right side of
the road with the EO not benefit by
going to the why not no no it's not
happening it's not happening to
expensive you guys phones got too
expensive here we have like this Eon it
looks like there's like vadi on top like
we're not looking at that Eon right now
but get your midnight blacks it is gonna
be the cheapest way to get a 128 kg on
if you want a 128 kg on so make sure to
get in and get that the code is Labor
Day bro yeah that's no good not sure
what the issue is they're just looking
since you mention it yeah cool
yawn too should just get a price bump
well yeah yeah yeah yeah yeah I mean we
talked a lot about the price point I'm
not sure a higher price point would be
particularly good you guys are gonna be
priced similarly similarly to what to
what we've been doing and we can't
really do it if we use new phones
if they also really wouldn't help that
much I mean a lot of the problem with
the phone is the battery we don't really
want the battery but it's in the phone
can we get the battery out of the phone
unless your kitty pryde phase-in
take the battery
solid gold a on gold is a metal it
conducts heat I don't know if that's
good or bad it was a specific heat of
gold all right Scott that was a very
upbeat skull piece under who likes copy
Sunday so we do Moore's copy Sunday's
you're a bot you ruins copy Sunday is SF
region most eon sold no that's not true
all over America well one of these days
the bots are gonna start calling out the
bots and I'm gonna be like it's the bots
you can't even tell anymore like two
BOTS come in one bot pulls out the other
BOTS you ban the bat bot common still
absolutely has a chef working a comma is
a great experience it will change your
life
yeah
those things well I hire you if you
write a balk detector now I'll hire you
if you do out on our programming
challenge we got some good results from
our face detection program a challenge
that's how we have the driver mom right
now
never mind pretty good thanks floor is
really nice okay liking Explorer I
thought it was worse it's pretty decent
I can choose from all our these are all
our company cars
you know what's a neon gold I don't know
Prius
what no one's been driving the Prius oh
that only just doesn't work yeah the
rav4 it's just been sitting there
there's a bit of Mexico when I rename
this every name and it device device
name Oh share by human I don't even know
what that does Oh what were the bad
submissions of the programming challenge
I don't know something we'll just do so
badly I don't know why there's all this
orange as well where's me driving around
in the Accord that's me
for some nice drives yesterday
oh yeah Gordian gold said that oh yeah
me dropping my friend off this morning
yeah this version of Explorer is public
I'm just from by that coming out of AI
seems everything else isn't me driving
my friend's house only engaged a little
bit
yeah cool thank you
none of people know about my that coming
oh yeah yeah cuz I don't market chips
marketing for losers um oh you didn't
know that might not comment on it I oh
it's nice feel like you support a
vehicle with less than 400 horsepower or
more than 400 horsepower I think you can
download up we're looking into the
Cabana issue right now I think you can
download more horsepower for your Accord
you didn't know that might not come
about I
promote it much yeah this might outcome
another guy you can see like lucky you
see if the model doesn't work here
because we need big model I was engaged
here so it clearly was working this was
pleasant
pleasantly driving through West Portal
someone to load was the stuff why is it
loaded yet let's take this off
you are bad you're a bot
you've been anywhere you're not real put
a link on the homepage he had we could
put a link on the homepage that sounds
kind of nice I wish she'd kind of shell
for explore on our homepage yes probably
good idea I don't know man
see why disengage there
why did this engage here guys because
cuz we came up on a red light I look at
that red light yeah reason I needed to
take over for safety I wanted to take
home oh that's a little I don't know I
feel about that speed limits with big
model or Maps speed limits be part of
maps
you know maps are coming maps of all
highways all the other states in America
we're gonna roll about I thank you for
joining us Cobie Sunday that's been 40
minutes
I'm going out to get a pizza cuz I love
pizza I hope you all have a great Labor
Day thank you
ground loop I appreciate that wait'll
you see what's in the store calming eyes
got a bright future ahead of it we're
happy to have all you with us
vice Kobe's
morning's copies we zip up my maverick
joggers here maverick joggers brah most
lit merch in the game after our martiai
it's not even true Logan Falls where
it's just way letter um
so I'm in downtown West Portal take you
guys there let's go for a little walk
and I'm not walking right now I'm not in
the car um I went out to breakfast man a
coffee shop right over there go to the
really depressing bar yo yo I'm not
going to the depressing bar I don't even
know what the depressing bar is like
midday on a Sunday bro but what I'm here
to show you guys is some retail space
right next to edible arrangements this
retail or lease it was a travel agent
and we know travel agents aren't really
doing too well so can you guys hear me
well I got the air funds the retail
space right see is it open
locked um but what do you guys think of
a comma a I store
oh yeah sounds good bro got that got
that air pods yo what do you guys think
of a comma a I store we'll get a store
it's gonna sell yawns it's gonna sell
pandas it's gonna sell Commerce maze
it's gonna sell debug boards it's gonna
sell everything yeah pop up my shop man
we're gonna get no the merch has got to
get we got to really step up our merch
game I don't want to be like a tech
company I want to have the best merch
and I think we can do it have we
considered a kiosk you mean those things
at the middle of the mall no respect
they get no respect right like the
t-mobile store but it's not the store
it's like the little kiosk with the two
people and they don't have anywhere to
go
considering the niche audience but I
mean you know hey yo look look you guys
let me tell you about why I do khamenei
I am I trying to be profitable I mean
yes am I trying to build a successful
business yes but we really do it because
it's fun if it wasn't fun why would we
do it and and that's what I'm saying
right doesn't it sound fun
we'll open up the comma a I retail store
um we've also recently come into some
money so we have money and that's the
real reason that's gonna be the topic of
Skokie Sunday we're hiring the product
team I'm talking about Schiffer I'm
talking about open pilot we need people
we need infrastructure people and people
who know react JavaScript developers um
there's a comma army if you guys know
anybody I probably look weird walking
like dad this isn't LA you know I don't
know if you can just do this like walk
around West Portal with periscope get
that selfie angle right
let's go
let's go more to the backroads here by
the way I just want to take a minute to
thank the omnipresent modern cell phone
network that makes this all possible
it's just it's just amazing I got an old
comma hoody on this is this is old hoody
stuff but yeah so we are hiring if you
guys if you guys know anything no no no
no no don't think of it as a retail
store think of it as the comma
experience store I'm not in London I'm
in West Portal so that's kind of where
our shops gonna be yeah but do you
consider react phonons from outside the
US only if you can work in the US so we
don't do we don't do any remote work I'm
all work is in our San Francisco office
it keeps the team all on the same page
but yeah if you're outside the US it
depends on what country you're in if
you're in a country with an e3 visa
that's easy h-1b is a little harder if
you qualify for no one look at make that
happen
we're hiring for people what do I think
about the immigration in Sweden I have
no opinion I'm not in Sweden bro
I know PewDiePie moved to London that's
all I know about Sweden I didn't move to
London what do you move Brighton yeah
and that's not the same Brighton that
mmm talks about on underground the only
good song on on relapse yeah yo what up
so so yeah that's really what I'm here
to talk to you guys about today we are
hiring react infrastructure guys the bar
also is insanely high our interviews are
just they're brutal but but but here's
the difference between startups and
comma AI they say their change in the
world we are actually out here doing it
that's right comma army well I partner
with Logan Paul we don't partner with
nobody man but hey if Logan Paul wants
to shout me out I wouldn't I wouldn't
object but yeah last big hill I'm
walking up guys big hill what's the
salary like ah
120 maybe 140 um do we pay with exposure
yeah I'm burning calories right what's
what's exposed it's about fun it really
is about fun we just want to make the
best products um that's why it's really
about you know I was reading sometimes I
read some time I read yeah we do equity
I mean it's a trade-off right if you
want to get 140 K you're not gonna get
too many shares if you want to take a
lower salary you get more and more
equity right it's just a trade-off did I
bring water
hey Eddie's here you can't buy fun
that's right you can't find fun but you
having a lot of money helps we're gonna
move to LA we're gonna rent a mansion
we're gonna call ourselves team eleven
yeah team eleven yeah yeah he's a
trade-off equity versus salary but yeah
so we are we are we have recently come
into some money which is great we love
money and not just from selling our
products though it's profitable you guys
and you guys you guys are making that
happen yeah what 40k in San Francisco is
pretty good you'll be you'll be doing
fine that's more than anyone's getting
paid right now but like I said we
recently uh we recently came into some
some money so you know money is is
always good how big is the team uh I
don't know somewhere between like 10 and
13 I got a count yes so so we look
honestly here's what I look for in the
interviews can you think can you think
that's it that's it like I love
questions like how much would you charge
to wash all the windows in Seattle right
that's a great question not a
brainteaser question brainteaser
questions are stupid because that's do
you see the trick but like you know
you're asking about washing windows and
in Seattle it's about how people break
that question down and think because
that's super relevant to to everything
you want to do do I have a car with
doors that open like this you know what
guys I started out I learned about
business from three places
I watched the Silicon Valley TV show I
read Donald Trump's the art of the deal
the best business book of all time I
heard
and I watched Eric Cartman but I've
learned that none of those were really
good sources of business information so
no we don't have doors that go like this
I Drive around in a Prius with antennas
on the roof and an apple in Ex that
actually costs more than the fries
anything that has helped me in thinking
a problem-solving bro just thinking
everyone's gotta think thinking it's out
these days but we're trying to bring
thinking back we're trying to bring
thinking back that's what we do in the
collar army you guys read books always
think always ask why you can do it
do I know what ROI means return on
investment bro if you got in the comma
seed round your return on investment
whoo
radio on the Internet you want to bring
open pile to indoor moving platforms not
only talk cars different routes people
take to solve problems yeah I mean
really the question is like are you
gonna think or are you reciting
something you've heard before because
you're reciting something you've heard
before how are you ever gonna make
anything new we are making new at
khamenei I listen guys I know look okay
I know a self-driving car end of the
year under $1,000 that sounded cool
right um everything you've seen from us
you know like pandas and eons it's stuff
that exists we have three announcements
lined up for you this year and all three
of them are things the world has never
seen before all three of them are things
that are really gonna push push the
future forward because you've got to
build a solid infrastructure before you
can push the future forward and I think
that's what we've been doing with the
Aeons and pandas is that a Nissan Leaf
as a Nissan Leaf the Nissan Leaf honked
at me I guess it got angry that I called
it a Nissan Leaf Oh bro bro why you
angry bro no BS you started the
singularity hasn't happened yet our
money from investment um bro you think
I'm selling IP no we got money don't
worry about that we got money yeah the
singularity has started I agree ha the
world's getting crazy the world is
getting crazy every day it just gets
gets a little bit crazier it's hard to
keep up with everything
but um you know you got to filter out
the fake news you got to filter out the
crab you got to stay on top of what's
real what do I think of way mo uber oh
god I don't know man I just hate the
company sue each other
it just doesn't move the world forward
who knows who actually did what it
sounds like somebody like paid some
somebody did something sketchy somebody
paid somebody whatever do you that's the
thing you don't even want to play that
game right you just gotta be you know
it's like when the regulators came to me
right you don't want to play that game
you don't want to buy into their frame
you got to make your own frame you guys
got to be a maverick and dent the
universe out I can write I can't just
deal Logan Paulson catchphrases um okay
how does comma AI compared with way mo
and Tesla so you can google that but
everything public lightweight maps are
the way to go no we have a different
strategy the problem with the
lightweight maps is you're really
constraining the axes on which you can
localize they're doing lanes and science
yeah I don't know what if you don't have
lanes or what if you don't have signs
those are very like feature dependent
our Maps are much more generic than that
we using features but not lanes and
science using that computers in the
traditional TV sense what up guys I'm on
a bench thoughts on crypto currencies
hot Oh bro huddle I huh
doing good I wish coming I bought some
but she wasn't Eve man if we bought some
eath right when kama started uh we'd be
doing great what's my IQ I don't know
why um people who like talk about like
the number it's like Oh 160 IQ and I
call it on YouTube and talk on your
video okay bro um you're buying a black
e Oh Oh guys that's the other thing I
want to talk to you about um well never
using litem I see other thing I want to
talk to you about when will things ship
starting the 15th and you know when I
say something on Twitter I'm no Elon
Musk I come through on the date on the
15th we are going to be shipping
everything out from our store within
three days of you ordering it not not to
brag on Elon Musk but his Twitter
predictions like if he was putting his
money where his mouth is on Twitter
predictions you'd be good betting
against them big fan but you know you
got to be real I'm being real is
important but our experience guys you
know we just want we just want oh man I
love winning I run I want to win so bad
I love winning
oh man winnings great George Hotz is Ida
about Ida there's anyone at the house
love this man let's go go through the
comedy backyard we'll go comment I
backyard where are we now greats go for
good Skokie yo where are we right now we
are outside the comment not the team 11
management that's we're gonna get that
in L I know but seriously guys what do
you think retail spot we're gonna start
shipping everything out mad fast we're
even thinking about putting some of our
products on Amazon but don't bet on that
buy I'm shop that calm down yeah I go
you know comments on a I shopped at
comedy I go right now gray pandas - yeah
you guys what are a ton of gray pandas I
mean it might be hard to meet the
deadline but uh no we've done actually a
lot a lot of people have ordered a lot
of a lot of gray pin is can you invest
in comma AI know private equity only uh
other than working on Toyota what's the
main thing we want to accomplish guys
this year is gonna be crazy
this year I'm telling you we got three
things lined up and I can't tell you
about any of them yet but you're just
gonna see one thing after another you're
gonna be like that's crazy and then
you'd be another thing you'd be like
that's crazy and those give me another
could be like that's crazy
alright cuz they're new they're new
they're the kind of things that the
world has never seen before and and
that's what we're doing here come a I um
oh yeah oh yeah this year that this year
did I cut my hair myself no no no no no
we have oh we have in office haircuts um
I don't really care what I look like I
don't really care what people think of
me I care about what I'm doing I care
about I care about making things better
it doesn't matter what my hair looks
like oh you know I get
[Laughter]
SAE level for lidar why do you need
lidar are humans level for a Corolla
support has shipped if you have a
Corolla you can install them pile zero
point four point two right now on your
Corolla and it'll work thank you fam
form them um yeah Coelho support has
shipped presenta bility and impressions
matter bro if I thought that stuff
mattered when I get on TechCrunch and
scream like I'm hyperventilating talk
really fast no because that's the point
that that stuff doesn't matter this is
the future of the PR man you gotta be
real it's everyday bro buy a fighter
yeah um you gotta fight gotta stand up
for what you believe in
my biggest accomplishment so far I
haven't done man
next play with the points who the points
points are gonna be good
next plan features um red light stop
signs 0.5 is gonna is gonna hopefully
change the game rather stop signs come
out in middle of the 0.4 series you are
gonna need a gray panda self-promoting
on periscope this is what I'm doing with
my Sunday school be Sunday this isn't
self promoting calm about a nice little
shop comedy I go buy our stuff right now
I wish that like Luca Paul is making a
killing off merch but you gotta you
gotta wonder how I mean he does have a
much bigger audience maybe that's how
he's doing it but like it's like if this
wasn't fun for me I wouldn't do it right
I do it because it's fun I do it cuz
like what else am i doing man this is
what I'm doing
make sure there's any more how's life
life is life is good um favorite other
AI company anyone is open sourcing stuff
man gotta open source your paper as open
source your code I do want some Tesla
stock I do own some Tesla stock I don't
some video stock i shorted mobile I lost
money on that shirt I bought some Fitbit
stock off that bad
and uh gone well nah man commas life
that's it do I like open source yeah
because I'll tell you why I like open
source because old-school hacker value
right no X market was a terrible movie
um because no problem should have to be
soft twice right like there's just this
is no point where one world man but one
world I think we can I think we can we
can move past it and come up with better
business models that don't involve like
like intellectual property is is
literally I talked about this in a
recent interview like you're really
ready to put a gun to someone's head cuz
they took your idea I mean not so you
have to be ready to do if you believe in
intellectual property if I wasn't doing
this what would I be doing oh no man
trying to build an AI girlfriend now
could I'd be building AI girlfriends for
the masses right seriously there's a
there's a big untapped market there I
mean imagine like you know shiver fur
for sex yeah
do I like black mirror yeah as a great
show that's a great show I don't know
this season I'm gonna say I wasn't a fan
of this season but like guys my face is
real washed out do I like Trump hair I
do for work in San Francisco I don't get
a salary you guys I don't spend money I
hobble crypto and I make money that's it
you got to keep it real bro there's a
lot of fake stuff in the world today and
that's why you got to keep it real like
fire festival kind of fake my iPhone
jailbroken no why would I jump right my
father who cares once I win then what
there's always more winning to be had
there is always more winning when you
think you've won never rest on your
laurels always just win harder think
about how to win do I listen to local
radio know what I think that you want to
take on AI think AI scares Elon for a
few reasons
I don't know I mean you think about like
someone was a very modernist view and
yai might scare them I mean that's said
that's kind of what I see and what I see
in Elon
I'm surprised that he talks about
getting government's involved that's
horrifying bro and think about any
weapons control treaty ever in history
you guys think of AI just like any other
weapon right it's a nuclear technology
right nuclear technology is incredible
it could be used for great things a bad
things um
Tesla vision chip I don't know why you
don't need to do that it's fine I would
sure like you biggie biggie like BAM
because honestly bro when you watch that
rocket launch you just feel so hyped for
the future you feel like that future
that we dreamed about is kids reading
sci-fi books is real right and that's I
mean that's all I want
all the winners of the great end of
February end of February biggest to
young users for the year and a failure
we'll try to do it do I know people that
went to fire festival bro I wish I went
to fire festival well I launched a song
very good space huge I mean that's
that's a very like modernist view right
like I can I can like it and I can
appreciate it it's not I mean my view is
very much more hey I want to move to
virtual I would if he one wants to die
on Mars I want to live forever in
virtual reality difference between
computer and Tesla three neon that Tesla
three has a much bigger computer I'm not
sure how much that matters Khamenei I
have racket we give racket do we play
tennis woo you know that song tennis
court by Lourdes and I saw but yeah so
I'm back at the house the main things
that I want to talk about airplanes
don't drive brother fly um
the main things that I want to talk
about the three things are the comma a I
retail shop probably not happening but
wouldn't that be cool but the things
that definitely definitely are happening
are number one we are hiring
four people four people we're looking
for people with react infrastructure
honestly reactive infrastructure could
easily fill four roles people who could
test people who can do a really good job
on making our products we got to get to
a five star experience you know because
that's what we got to be on on Amazon we
want all our products to be rated five
star and then some of them are if I
start quite yeah quite yeah you guys are
early adopters you'll know it the other
thing that I want to talk to you about
is we are gonna start shipping
we are gonna start shipping selenium you
mean the element that they killed the
bad guys with at the end of evolution
choose to move in LA no no a reselling
Pro is absolutely not bro
Tom I Oh s hardware support No why would
I do that
as I'm past hacking it was a cool way to
learn get over at jailbreaking is over
that error is over jailbreaking phones
is over phones are incredible you can
buy some great phones that are as
customizable as you want or if you want
the full Apple experience you you
understand like the reason you had to
jailbreak the first iPhone was because
you didn't have a choice
now if you want something to be open go
buy an essential phone right it's a
great phone um or go buy I mean there's
a bunch of open androids you know I'm a
big fan of one-plus I mean that's what
you do just just just just just spend
the money right um there's no point in
trying to like like to have our iPhone
anymore that era is over but the era
that's not over is jailbreaking cars
because you can't buy a half-decent car
except like Tesla's are pretty good but
you know they're very closed right
there's no there's no like Android
alternative to Tesla okay and they're
electric which like in theory I'm a fan
of electric cars but like if you like
live in an apartment proud were you
charging your electric car um I'm
actually my backyard right now and
consoles yeah it's all like a consoled
jailbreaking was always like bro PC
games PC master-race what's that on
reddit Google go to wine Google's gone
to how about that uh hey Google
Google Google has gone sharply downhill
in the last couple years it said it said
no I wouldn't I went is the beginning of
it in 2014
sad no I think that was his point
control custom rate like the thing about
piracy is it's just boring but stop
being poor just buy the
infrastructure people want to think
people who want to thank the people who
want to change the world because that's
what we're doing here comma or I mean
we're taking over I've never heard of
mythic AI but yeah so
recruiting and and shipping if you buy
stuff now it's gonna ship soon no more
no more long ship lags we're done with
that am I worried about way mo creating
massive rideshare Network yeah just like
I was worried about Google glass and
Google Fiber yeah alright alright
you're my rap fan I like I like my raps
to not that much it's okay my raps are
okay I could be a no I don't put enough
effort into the raps bro I wish I put
effort into some striving cars
bro Apple couldn't keep me out and Sony
couldn't keep me out you think Toyota's
gonna keep me out good luck for us
uber glass ya know I / fiber that's real
right
imagine uber took over the ISPs Comcast
to be crying to every on a jetpack uber
made over fiber I can't tolerate it now
but Hooper's / ubers / Travis if you're
out there and you're listening bro it's
turn on his pee pee let um what do I
think of uber I'm a huge uber fan um
just just just just the way Ober has
made my life better in the last five
years it's great I love you goobers
everywhere um so I'm a huge again I'm
not talking about the company but I'm
talking about like the idea and the
execution right
good morning scobie's so I haven't done
one of these in a bit I figured I would
do one this morning and keep you guys up
to date so I'll first off the Maverick
uh Devo is the only time you're gonna
see me not shilling per my own merch
I am shilling for Logan Paul's March so
throw out this weird
all right all the scope is get in here
yeah no we missed you too um so a few
things I want to talk about uh what's
first okay I promise I promise this this
periscope will not all right bro your
your band ID that's just get out of my
Scott now you're out
uh the first thing I want to talk about
I do it with Davin the minutes
definitely matters yeah um all right so
no the first thing I first thing let's
talk a little bit about Gio I promise
that this whole periscope will not just
be me making fun of GM I do promise that
but I saw a post on random
as opposed to random I'm working on
grape and affirm well I'm not shilling
for any bitcoins today um Tesla is about
to suffer the same fate as Ford and you
know this is this is this is just a
fascinating like it's so clear to me
what journalists don't understand I say
it here like Tesla views their car as a
computer on wheels if you go back to
2007 smartphones souls there's a
Wikipedia page that goes into this list
of best-selling mobile phones so if you
look here there were actually there was
a phone that outsold the iPhone it was
called the Nokia n95 and you look at
this and if the year is 2007 you don't
really know which one is gonna win if
what you're looking at is features if
you're comparing the n95
to the iPhone based on like features
they actually look surprisingly similar
so let's let's bring up the Wikipedia
page for the iPhone 2g and actually do
this so you know if you look at if you
look at the CPU if you look at the
memory they're really they're really
very very similar the n95 has has more
memory or more storage similar CPUs but
what was the difference right why did
the I end up out competing the 95 to the
point that Nokia went out of business
climate change isn't ruining everything
you guys can can you can can somebody
tell me like one way in which their life
has actually been ruined by climate
change
um but they're not going off on that uh
Tesla is following a car is super Chris
is pretty nice super Chris is pretty
nice but it's one of these things that
doesn't scale test the will scale to to
at least probably level three with with
with what they have in the cars
um Wow you can't believe I said that
yeah but so just just like like I really
I
um no the coughing in china the
pollution in china's are a problem yes
said climate change' the yeah so that's
that's that's that's that's GM but
that's not what i'm going to talk about
today i'm here to really update you guys
on production so we're gonna go into the
stockroom i've decided in the interest
of transparency to show you numbers so
here are a whole lot of phones that were
unboxed um this is our first production
on this is our production run for the
first quarter of the year so just so you
can see this is our manufacturing
operation here we got all the phones
unboxed so these are the bags that ship
with the with the eon yeah we're what
we're doing it we're doing it uh so
there's gonna be some yeah i'm so yeah
we're gonna ship out hopefully wednesday
let's let's commit to the scope ease if
you buy if you've bought an eon
it's gonna ship out pandas right now are
a little bit delayed what was this a
return yeah we have for you got for you
yeah we got for eons returned oh wow we
got it we got it we got a refurbished
those will ship out me we have people we
also not have internal stock which will
show you guys too
we're thinking about maybe adding these
things as sk news so this is a this is a
space networking adapter and you can use
this to get ethernet on your eon a
volkswagen giraffe so i think i've
talked about this
um we are not going to support any other
cars besides honda toyota this year yeah
everything else will be will be
community oh good you got your panda
this week good um yeah we're a little
we're a little short on pandas um but
macro fab macro fabs gonna pull through
for us and we're gonna get we're gonna
get we're getting ten thousand pandas
they're coming in beautiful injection
molded cases so if you ordered one
it'll still be in the 3d printer case
but the new ones are going to be
injection molded I'm just saying like my
day-to-day there's problems and none of
them are causing climate change so no no
you can use Ethernet so I'll show you
I'll show you another kind of common
stock item yeah we are producing great
pandas at the office
here's another here's another internal
item this uses two pandas to connect a
computer to an eon for debugging would
go that far I mean it's real it's just
the effects aren't you know killing me
tomorrow there's things that actually
might kill me tomorrow and those things
are scary like nukes MA iron ship
look at these gray panda oh I got to fix
my fire alarm you're absolutely right
just like stick your hand in like a big
box of filter mouth that's pretty cool
yeah so yeah we're doing great panda
production here do we have a new case to
show the scope ease for the great Panda
greater collaboration Rick Perry as fast
mm-hmm see what the information we can
get from the blinds both sensors so this
is a radar reflector we bought off
Amazon we're using it to try to trigger
the toyota software to return some some
information I don't know yeah something
with more information how do you mental
health the tripod I just used a
double-sided tape nice very janky yeah
so that's the set up today
you ever seen boxes of phones like this
is 80/60 for new phones this is like
each one of these is a phone grows have
you ever fired somebody fired a few
people you know you don't perform you
get fired that's just how it is
what else we got
these are pause if you haven't seen
pause you can use these to reflash your
pangas
here's Aeon production I got all these
things coming off the 3d Center we got
giraffes giraffes are in stock many
giraffes in stock do we get the phone
straight from Foxconn no no we buy them
through oneplus
Oh late shades you can stop less now and
I'm not talking about those today we're
not talking about those today do you
still need pause you don't need a paw
if using your panda but you do need a
paw if you are trying to if you break it
basically if you brick it to the point
that it won't boot into the st2 get into
to get into bootloader mode yeah so this
is this used to be the headquarters of
crypto scams LLC but yeah guys thanks
for joining the periscope today just a
little some day update about where we
are what we are doing
arrested we have a whole lot of cables
as well does anyone want us bc2 any
cables we have we have many many of them
um but yeah thank you for thank you for
for joining what's let's let's take one
more look at a midnight black midnight
lucky on over on my desk let's just take
a look at it and admire it's midnight
blackness I'm drinking Mountain Dew Code
Red
they should pay me they really should
pay me when I show for their stuff um I
bought this dead stereo camera so
hardware is kind of nice I was a little
bit disappointed with the software the
semi global matching okay now we know
the gray panda case no we don't sell the
ealing case we only sell complete eons
how many young sweatshop labor is
already signed up the eon is it is a
very nice minimum-wage job um assembly
um a grape and a shipping date so I
think we said four to twelve weeks and I
think that will be uh will be true um do
come employees work seven days a week I
work seven days a week most people
around here work six but sometimes
people never sell people will people
hustle hard man we gotta we gotta win
look at look at look at the midnight
black us twenty-five hours of day that's
right I don't know I work constantly
life is work you guys win um is it all
Python yeah what soured well not neon
Timothy couldn't take a present paid
hourly is it all Python the neural
networks no is this gonna be every
weekend yeah we could try to do Sunday
updates see kind of what we're up to
oh we were drawing we were drawing
bicycles on the board what do I consider
a win um I mean winning right shipping
the best system to the most people
so I'm gonna spend my day so here I have
over here this is this is a Toyota Prius
ECU and
[Music]
unless I could talk about that and yeah
I'm gonna try to hack it so we can
update our rav4 to work in stop-and-go
traffic and that would be my project for
today I've put a bit of time and do it
so far it's not that easy Toyota has
better security than Honda but not
because it's like good security like
they didn't like like understand how
you're kind of supposed to do this stuff
they just made up better crap um so
there's that but yeah thanks thank you
thank you for joining uh and I will see
you all I don't know maybe we'll do a
midweek periscope me a little something
cool to show off rest of the Toyotas
okay that's the band question um can we
not send crews pushed up by iana people
live in the well you have people live in
the office the band question is whether
the car is gonna be supported the truth
is guys open pilot is is open source so
if you want your car to be supported you
can write your own Oh Navigant oh now
I'm not on Navigant Board of Navigant
the people who think Ford is doing well
on Tesla's lagging behind looking for
Life team , that's right team , no you
need like yeah team , we gotta like make
that a thing you know it's better than
Jake polish it's not as good as low gang
but like what is it Jake Paul er
well I assist ER laborers with ECU
flashing no what can i we're gonna open
source our ECU flashes if it's the
engine control module not the steering
modules alright because the worst thing
the absolute worst thing that can happen
if you bad reflash your engine thing is
unintended acceleration and that's
nowhere near as bad as like torque on
the steering wheel unintended
acceleration you can the brakes beat out
the gas on any car and that's assuming
things like neutral and the power button
don't work which I'm not sure how how
integrated these things are but ECM mods
are also something that's much more
accepted there's plenty of companies out
there that are already doing like East
you tunings where they remake where they
change like the the tables which it's
the same reflash we would do in order to
remove the low-speed restrictions no I'm
not mad at for because they have Sony in
them
I'm mad at Ford because of how they do
their marketing and branding right I
just read something Oh Bill Ford is
smart cities may be closer than we think
stop talking about that stuff like talk
about what you're actually gonna ship in
in a few years I'm talking about what's
real don't don't give me PR hype I
really don't like PR hype our active is
lame apt it was okay bro I got a lift
more bro I should get more Olympic after
was okay I've met Glen Davos um he's
better than most he's he's a lot better
than most their demo was nice at CES
this year Oh
great pain the case is pretty incredible
I'm more seamless than any kind of case
ever designed before I think it's my
best work but but Eddie it's not great
it's easy Oh so guys we're low on gray
filament so we're prototyping in white
to preserve filament we have a lot of
white filament we have too much white
filament so we have to use some white
film in prototypes it will be great
don't you worry the LED shines through
really nicely
dude this square you still got that no
no buddy whatever shape we want we're
printing from this side oh we gonna put
common Pamela Maggie whatever we want
yeah it's a white print endless but look
at that look at Billy's are endless but
no no like she really show him how
seamless it is it is literally can't see
it well don't even show them where the
see Michelle the other thing you try and
find the Sun like pharmacy that's right
it's pretty incredible and you know how
we got to this case design very
penthouse constraints to be in the red
again this antenna zoomed out of the
great fan of case we couldn't do the
sliding that we used to do oh no this
led to the newest innovation that come
here you want to do a fun challenge on
the board Oh Neil gave this to me and I
was surprised kind of how bad I did so I
raced a ping and then draw a bicycle
erase this yeah no no that was the power
truck but um draw basically yeah draw
bicycle I I'm surprised how badly I did
oh and then I tried to build stairs and
I didn't even worse at that okay well
how you make stairs okay okay the
mainframe like another bar here and
[Laughter]
okay okay where's the seat that's not
important those get stolen a lot of
times that's right okay okay so I've
never actually seen a bicycle that has a
frame that looks like that oh no - one
thing here might look weird - yeah there
is something there are Eddie's doing the
job bicycle what we're on the path we're
on the periscope so if you don't want to
be on that you're gonna be a little cars
go it turns out that all bicycles are
two triangles like you don't even see it
until you like lock but like what that's
a trying like that yeah
triangle hey viv is not here so we have
we have employees at common a I who you
guys don't really know because they're
secret yeah kind of similar to that I
don't know it was pretty set on that
board what I really missed was the fact
that the seat bar goes all the way down
to the pedals like and that's almost
true on every bike yeah well I let other
self-driving car companies use our
self-driving hey guys it's open source
Bros bicycle challenge
thoughts on Chris Chris Latner laughs
Tesla I don't know what he's working on
right now I the guy from Omaha come
through who can you tell who's using it
I mean I don't care like that's the
thing right you know this is I got I've
got arguments on Twitter about this no I
I did see that I did see that I think
that's a great use of his talents um
Chris Ladner wrote I wrote like the the
first iteration is Swift did a lot of
LLVM improvements all the nullify guy
yeah we never ever interview with him I
think I think Tuesday oh we got it we
got an intern for the summer too excited
about but here's the thing right you buy
the hoodie for 250 guys hoodies are back
hoodies are back at 129 what is your bag
at 129 and actually we're gonna remove
the lid from the site hoodies are gonna
be hoodies are gonna be super rare we
are gonna put up some t-shirts pretty
soon yeah yeah cool um look I don't like
use our stuff don't either stuff I don't
care I mean like I like you guys using
it if you want to contribute positively
to the community I'm a fan if you want
to like be a consumer go consume some
other people's stuff pink hoodie yo I
mean I gotta step up we gotta step up
our merch game we got it we got to step
up our merch game copy it's good from a
purchase yet no no yes look what we got
on the board it's everyday bro what's
our next big feature milestone for open
pilot so we're shipping we're shipping
the gray pandas out and then we're gonna
really focus on the localizer and once
we have a good localizer we already have
HD maps which I told you guys we're
gonna open source by the end of the year
we're gonna open source our HD maps and
you are gonna be able to add in traffic
lights and stop signs - I'm gonna have a
million points localizers there be field
tested right now no known as a million
points I guess there's no free hoodies
but better than open street view I mean
we have video back none of them are
really getting video instead of I was
driving to build Maps
yeah yeah follow your common point
suppose could we scrape the data from
ways know what I got to scrape any data
from ways we don't have to we have
everything we need to build a map the
truth is like I don't care what the name
of a street is right yeah we have we
have we have stoplights we're working on
stoplights how can we contribute to
localize our data to script ASAP so we
have a we have a very complex localizer
we're building on the back end here it's
almost better than you buy a yawn and a
gray panda you're gonna get a better
localizer than a plan X um do I think a
map is necessary in the long term I
think map is a good idea
even if you have a car that can drive
without a map and our car will be able
to drive without a map you still want
one because it's an added degree of
safety right if you can if you can
remove 9 out of 10 of your dis
engagements by looking at the map and
being like no cars ever done that before
model you're probably wrong that's
that's a good deal how many more pieces
of hardware will you have to buy I mean
it all depends on like to get to full
self-driving more obviously nobody
nobody believes that single front-facing
camera can get you all the way to level
4 but all of the hard problems in
self-driving cars can be solved with a
single forward-facing camera detecting
whether there's a car on the side of you
is not a hard problem deciding how to
read complex situations at distances of
like 50 to 100 meters ahead and deciding
what to do that's the hard problem or
you're giving out free bitcoins you go
to telecom something some bitcoins viola
free bitcoins um any problem with video
only got recorded one direction no no
all videos good yeah coming I will we're
into level 4 I mean you guys know it
what everyone's working toward level 4
eventually the only question is whether
you're gonna stay in stealth mode until
you ship level 4 or you're gonna ship
intermediate milestones and we've opted
to ship intermediate model
don't a lot of people are thinking look
here's one way to look at it right
here's a here's a difference between
between like whammo and Cruz versus
awesome Tesla every time way mo and Cruz
want to add a car to their network it
costs them money every time we want to
add a car or test the ones to add a car
they actually make money and we actually
make money and that's the key I mean if
you want you know how are you gonna grow
a big Network if you're paying 150
thousand dollars per car I mean you
can't you can do it but then you're
taking on investment right you're you're
you're okay fine if you have way mo
money you're getting the money from
Google like that's not a good thing it's
not it's not sustainable um so that's
kind of a key distinction there guys are
keeping me on with the questions no yeah
the phones are fine eons we'll be able
to get HD maps it's the the localizer
can even run on the server you don't
need you in the rental you can run you
can run an API which is something that
we're probably gonna ship this year to
that will send you down basically GPS
Corrections right I take a picture I
know where you are from the map I'm like
or here are the lanes here are the signs
okay let me send a correction back down
you couldn't it's it's a simple
algorithm it can totally run on the
device and if you have a great panda
you're gonna get all this stuff first
but it might eventually come to people
with white pandas too so what a
localizer does is determines where you
are really precisely why don't all
makers buy my philosophy well you know
here's the thing right
you can't view auto makers like they're
like a person that you could talk to
reasonably ranked at the bottom of the
recent report look at the guy behind the
report and then realize that he
literally did PR for Ford for ten years
right like did he stop you know it turns
out it turns out that that um people
high up in the yard now we don't go
there but um they tend to get Logan
Valda slobs are I don't the guys you
want sponsor me more devices yeah I mean
look I'd love to get uh you want to eat
on in the Yeti we can we make that
happen a gray panda what is its benefits
I mean look I'm not I'm not I don't
market you guys like you see what it is
I'll tell you what it is I'm not gonna
tell you like buy it I mean I only shill
if it's ironic it's not even though
automakers want no risk it's that they
are procedural companies right
don't don't view them as people view
them as like a system right imagine
asking the question why like LS can't
concatenate files why does it LS just
just concatenate I mean that's just not
what it does right you have to view it
that's why view the world right a view
the world is like like like systems like
that alright we'll go to we'll go to it
will go to 30 minutes I just want to
know what it does it's it's we replaced
a Wi-Fi module with a high-precision GPS
chip and then we we localize well I'm is
there a way for comma to be more
productive
not really um I mean yeah more employees
yeah if you can find her right employees
right the whole key is the right
employees not more important I don't
know if like jobs that like wow if I put
10 people on this instead of one it
would get done faster wouldn't more
money we'll have more money this year
among employees cost productivity yeah
they absolutely do I really think like
half of Google is a negative a negative
weight on Google if I if I showed up and
I was a CEO Google I would I would fire
half of them all the cars will need to
communicate with each other no they
won't
why how do they communicate with each
other now only my philosophy works
I mean works for what there's there's
other ways there's other successful
companies in self-driving cars today you
know you look at you look at like embark
Vardhan labs right
of approaching this from trucking the
first place you guys are gonna see level
4 is on trucks and until you see it on
trucks there's no way you're gonna see
it in cities so building a building a
trucking company is a good way to
approach self-driving cars if you want
to go b2b no we're not gonna do an IC
o----
you know I've talked about the IC o----
we might uh we might be involved with
crypto in some way shape or form but
like just look at the telegram ICO for
everything I hate about AI cos so it's
not gonna be anything like that have we
tested it on trucks who cares
no no not Eddie
Eddie's been here a while and it's been
here a while mechanical fix on the ps4
the stupid steering know the way it's
called linked backlash you just need to
overcome it by like putting up to get a
bit of a torque to jolt it and then it
will start going it's a controls problem
I need thoughts
okay like who builds engine who build
sky who builds uh who builds who builds
cars engineers build cars right and no
engineer would be like whoa we should
make it drive equally well forwards and
backwards right like that's just the
thing on the surface that tells me
there's really no way you can take Zook
seriously because that base knows that's
right you have like a design space for
cars why would you design something that
drives equally well forwards and
backwards what it goes in one direction
99% of the time that makes no sense and
it's clearly not an optimal point in
design space why is Tesla still not
visit what do you mean by visibly
working my understanding is like who
cares they buy the chips they ship them
in the cars right visibly working oh
let's announce partnerships and do it
would PR do I think overriding the
dangers of AI I don't know yeah I mean
they're overhyped
if it's the kind of thing where like I
don't know you never want politicians
thinking about your stuff it's not
helpful when you are in like talks about
that stuff but maybe it is like in
Miriam's up getting more money and stuff
because it is something really to think
about just not like next year um of
course Tesla is Nvidia in their car
right but you don't need I mean what do
you mean what is the PIO Domino's and
Ford are partnering for self-driving car
Pizza Delivery who cares why don't we
use in video because it's a lot easier
to ship Qualcomm we will I mean I'm not
a postman video cz2 chef I'm talking
about just easy to ship shipping is
really important Tesla's making a chip
is that necessary not at all no
invidious chips are great there's
absolutely no reason to make your own
chip unless you want I mean look you can
always do that as like a leveraging
point like you think about Jeff Bezos
and the meeting with ups where they
negotiate prices every year Jeff's like
I'm gonna start my own delivery service
and UPS like not another era will be
competitive will be competitive but just
like okay you get a pass this year stop
talking to me cycles you're at
motorcycle for fun you don't ride a
motorcycle this is a practical um I
don't know all right cars are too big
cool guys I said it'd be on for 30
minutes one more question
what my thoughts about the Udacity soft
drive a car course there's some good
stuff in there there's some good stuff
in there you know I don't care about
credentialism you can get access to a
lot of the materials for free Oh a
Vienna's next weekend oh man I have you
need to get the same time I see yes
everyone used to be a good time he'll go
this one's kind of fun
I wouldn't like I like three years ago
it's a good time if you know black
married now what am i up to today I told
you guys I'm hacking Toyota's I'm
hacking Toyota's right and I'm playing
with it's hard to aim a phone backwards
and play with that stuff
cool all right thanks for joining see
you later
thanks for coming I follow us on Twitter
tell your friends did that smash that
subscribe button
welcome rage a yeah I can't wait for tax
time by e on by e on every
buddy always chill for your merch that's
right go to shop comedy I
you guys should should buy stuff always
buy stuff always be shilling always be
plugging and always do it for the views
yo I love all you guys you're you're the
commenting I scope is your what makes
makes coming i great leave a like
subscribe team called a hash tag team
comma Y a alright peace
alright guys let's see if that's gonna
work is it better I'm holding the phone
in the best possible way oh is it good
is it high-quality now much better okay
excellent sweet sometimes you just gotta
restart the periscope like I was saying
everybody what do you want to do you
wanna Zuckerberg Oh what do you not
wanting to happen you don't want to be
colonic that's right
desire burgum don't get to LACMA okay
cool well so now that that's out of the
way I'm gonna reveal corporate secrets
and I can do this because I am yeah I
got a sucker program that's right
because I'm the majority shareholder and
soul board member of comedy yeah I keep
control of your company kids even though
Steve Jobs did lead a heroic comeback
I'm not sure the same move is in the
cards for mr. clack Nick um so you got a
Zuckerberg um don't get khalaq Nick
alright now that that's over let's talk
okay so we are coming it could be the
Android and self-driving cars so if i
zoom down a little bit here you'll see
that Android runs on LG Samsung HTC One
Plus and many others come a I runs on
Honda Toyota GM and Ford
despite the automakers not wanting to be
a phone manufacturer they are because
the car is the phone and the real reason
people buy the phone is for the Android
not for phone it's kind of interesting
how that works out so I'm sorry car
manufacturers if you don't want to be
Foxconn you will lose if you want to be
Foxconn you got shemail in I'm sure
that's the right strategy for the
automaker really focus on what you're
good at manufacturing um you know you
guys are crushing your crush some tests
that manufacture you know if you guys
saw Elon Musk's letter oh man you guys
this letter dude yo let's go through it
it's actually pretty good you on must is
an absolute boss for writing this letter
some of the things that he says
some part suppliers will be unwilling to
achieve this level of precision I
understand that this would be considered
an unreasonable request by some that's
okay there's lots a lot of car companies
with much lower standards they just
can't work with Tesla see that guy is
great that guy's great because there
isn't a reason to do this
he just likes the idea of things being
good and that's what we need in the
world in order to drive the world
forward you want to say hi to Vasco peas
on Scobie Sunday terrible yeah yeah oh
well we're revealing purpose secrets
we're talking about how you know always
the theme you want to Zuckerberg them
and you don't want to get collabnet but
if you're Elizabeth Holmes and you
commit massive fraud you get off of that
yeah have later on fine so I you know
I'm not reserve judgment on whether you
want a why'd you want to be able to pump
but you certainly don't want B Martin
shkreli you don't want to be Martin
shkreli you gotta be Elizabeth Holmes
you got to be you got to be pretty and
contrite and not you know shkreli
looking and a dick lessons lessons to
learn lessons like thank you say thank
you okay
priests Crowley that's I am all for from
shkreli you guys know that up for free
and shkreli I think that what you did
was you know being a dick is not a crime
this is America we have freedom to be a
dick I love America and I love freedom
yeah fraud yeah if you actually like if
people actually lost money he should
like Pam back maybe a few times over
um but okay cool I don't think that that
really happened I don't know how much
money was lost on her on us but you know
him and the Chang album you know he did
he did you know
ain't nothing to fuck with right and he
fucked the hotel clean so you know
that's what happens all right cool um
any show you the secret project I don't
know what the secret project is um this
is very funny if following your company
rule is obviously ridiculous and it
would make sure Craig Tilburg cartoon
then the rule should change
notice how important he is in the
importance of very clear communication
and I'm a big fan of this to like you
know don't use acronyms or nonsense
words you're objects a lot of things are
actually really simple if you just
explain them in straightforward ways um
one of the you know groups of people in
the world is people who benefit off of
keeping things complex and dad like
turbo tax so don't do that okay excess
means to the plight of big companies
yeah everyone wants to get rid of
meetings get rid of meetings I like this
is not rude to leave it is rude to make
someone stay and waste their time just
just just a great thing about today is
this oh it's frozen okay well I'm sorry
if we tried its back is it good
frozen oh okay is it actually fine okay
it's good all right cool back to Mexico
side cuz if it's not good I'm over this
okay guys what we're gonna try to do is
we have two week Sprint's here where
we're trying to get open pilot release
every sprint we got to move to being a
more serious company yeah yeah so so so
so new models localizer calibration that
will get us all the way down to 0.5 so
we're on we're on 0 for 5 now working
our way down to zero five zero five
we're going to be focused on models and
Maps Honda Toyota GM Ford and the first
0.5 is gonna use maps for red lights and
stop signs and we're also going to have
for the first time driver monitoring so
we're getting back all your front camera
data thank you to people who are helping
out and giving us front camera data wow
talk about 0.6 let's talk about one
thing at a time I don't know if we're
actually gonna do close pilot I think
it's gonna stay open we are on 0 for 4
because guys it's always day one I don't
know who that even that's that's Jeff
Bezos now um how does driver monitoring
work at the dark it that it works how do
you can someone see can you see in the
dark well you can and so can the camera
you just gotta crank the games up it's
day one at Amazon that's true it's not
dead wanna comment I it stays zero point
four point five oh we want to get to day
one it's not even dead one yet did one
you know one point I was gonna be on our
consumer product release that won't kind
of everyone kind of knows at the arc of
calm a guy is actually incredibly
straightforward you know I've been
saying the exact same thing for years
and years now but see the thing is we
are going to ship a self-driving car by
the end of the year for under a thousand
dollars it's up to the end of the year
part hangman but I don't know about that
so zero point five models and maps we're
gonna use zero point five the maps will
be used for red lights and stop signs
we're gonna ship driver monitor and
we're gonna have support for Honda
Toyota GM and Ford new models are
finally happening our head of machine
learning starts again on Monday we got a
new head of machine learning start
something like that and we're gonna make
models and if he doesn't make models I'm
gonna fire and I'm gonna make the models
myself so that's what's gonna happen
we're gonna have models in ten weeks no
matter what whether we have to fire they
had a machine learning or not no the
other one did not last long they don't
do well I will do it I'll do it myself
if it doesn't work so yeah dad over over
yep they're gone gone so that's why
there's new models
yeah a lot of God you can fix the fan
yeah no people get fired a lot around
here like do work and do well and be
smart or you're fired
um but you know it makes it makes
quality and it makes us like it makes us
an office opposed to work because you
may just drive by smart people no
pressure new guy well you know a lot of
pressure the new guy no no I'm no fresh
new guy just do well okay cool um so we
are also hiring for three positions um
here's our current layout of the company
we're hiring for two people on the
mapping team and one person on the
monitoring team not Linux admins we're
looking for a full stack developer
looking for somebody knows about sensors
and hardware and we're looking for
somebody knows that ml and data science
to monitor all the users you know what
we're monitoring the driver right so
we're gonna write some some sick some
sick face rack and he's actually kind of
got someone joining him you know we're
gonna try to sales have been sales seven
skyrocketing so we're gonna try to do
filament maybe even more often I know we
do a lot of training in the basement um
no civil engineering jobs
definitely not there's only two
legitimate roles at a company on the to
legitimate roles at a company are
engineering and that's what these first
five are and operations that's what the
bottom line here is so engineering build
things and operation ships things and
ensures they continue running I'm not
really sure we need QA it seems our be
false and just got a big team and he's
got a four-person team now but you know
any killer we're very happy with Andy a
fusion going pretty well
Ricardo's been working on it this week
um but no who are we hiring for we're
hiring a full stack engineer for the
mapping team basically we have the maps
we just need somebody who can build the
UI build like a nice UI for us to
explore ante
and improve the maps you don't look for
bugs and stuff so looking for a full
stack developer to do that you know
stick the maps of the database yeah we
have two interns coming this summer if
you're interested in an internship give
me a job at comedy I and you can be an
intern so we're looking for someone here
who's gonna do sensors and hardware and
timing timing is very important you know
you want to make accurate maps it's very
important to get your timing right and
then we're looking for somebody to own
the driver monitoring project so I wrote
the code that records the front camera
we're looking for somebody who's gonna
work on interpreting that code so we're
hire there are no no opportunities and
operations you see the question marks
the question marks are the places where
there are opportunities no it's not
infrastructure monitoring if the
structure falls under product its driver
modern so we need ml and data science Oh
compensation is quite good okay well and
I don't know if you believe in our
equity but oh yeah this girl was texting
me back how exciting well that's great I
know we don't have a remote employees
what about that prototyping or cancel to
cancel absolutely cancels so over that
prototype beyond yawns have been used
but if you guys know so we're gonna go
to China we're gonna look for more one
plus three T's because you guys have
been buying yawns at an astronomical
rate which is great we love sales but
you know it just means we got to make
more so yeah guys we're hiring for these
three positions if you know anyone Oh
any improvements on ping pong well
ping-pong is gonna be fixed when we have
this and when we have these we need to
localize it may need calibration and we
need the new models but 0.5 should not
paint how much call your friends is
telling you I don't want a sony phone
today honestly standing there yawn back
we don't sell Goosby on zorg only sell
new yachts so yeah we're trying to do a
release every sprint so that's every two
weeks you're welcome for horizontal
video I understand you guys like it Tork
approve it's a Honda never never you
worry never know happening when I
releasing epsp flashes at least for a
long time because the dangerous let me
tell you what can happen if you reflash
the EPS alright let me tell you why
they're dangerous if you do it wrong you
do it right it's not dangerous but you
do it wrong stages okay so if a torque
sensor in here and you have any PS here
and you have a motor here all right I'm
sorry this is connected here this
connected here this is connected to the
steering column here the wheels your car
and your the wheels and here's the
steering column through the motor and
here's the week right here's the problem
this motor is stronger than you and the
only thing we can get to by the pedals
much less dangerous in a second the
motor here is stronger than you um if
you flash the wrong software here you
will make you can make the wheel turn
and the user literally not be able to
override it
um so EPS three flashes can be quite
dangerous why is the pedal much less
dangerous who knows who knows why the
pedal is much less dangerous than you
asking for just a few petals up here
I'll go we also have an EPS is the toy
80 PS yeah you can just hit the brake um
you can hit the brake you can put the
car in neutral you have a lot of options
in the absolute worst case if you get
unintended acceleration right um yeah
the brake is stronger than the gas and
there's a way to override it right also
the other thing too is if this thing
even jerks the wheel you're in trouble
um yeah cars have live mode they're
quite good if it jerks the gas that's
you're fine all right you'll hear the
engine rev opulent
the brakes maybe maybe a pedal would be
much more dangerous on the Tesla but a
pedal on a rav4 you can floor the rav4
and it's not going anywhere yeah
assuming the disengage still works but
if you put the wrong code on the EPS you
could be in trouble
so what's not dangerous if you do it
right the problem is who's doing it
right right um so no epsp flashes stop
complaining about the park you know what
you know what you know what Eric moraga
would say if you want more torque it's
al fondo by Toyota GM seems to have more
torque as well I don't know about the
words torque but by Toyota um so no I
can see flashes okay notice how that's
not on board for anyway but I mean look
like if so many figures it out I hope
they will have the sensibility to not
release it be so anti yet there are ways
to do it safe um vault progress we're
thinking about buying one we thinking
about buying a Chevy ah Sal Honda by
Toyota
what we do with the red lights or stop
signs well we'll do exactly what you
think we will stop at red lights we can
actually also automatically go at red
lights as well um so we can stop any go
at red lights stop signs we're gonna
stop and then we're gonna ask the user
to press the button and then you can go
when the user decide that it's safe
because we don't have enough cameras to
see we don't have enough cameras on the
common Eon to see red lights and stop
signs they're coming out in 0.5 cool
bros I think that's mostly Skokie Sunday
yeah that'll be in zero five um I tried
ml the student data on the previous I
don't know Lane changing the lane
changing it's not that useful I don't
know I tried on the Tesla I was I was
pretty uh underwhelmed a 0.5 will be out
before the end of the year yeah when
does the Sprint timer start well so
we're gonna do a release
0 for 5 in a week 0 for 6 two weeks
after that and you can predict when 0
for 5 s 0 fast enough 0 5 will be out
before the NBA gets exciting stuff so
we're given we have a seven week machine
learning plan to get you guys new models
and then if this doesn't work out you
know we fire one more head of machine
learning and I do it myself
periscope is plug
I kind of agree yeah well commas next
product be level three next product whoa
how many of you fires six people some
people well not exactly
you run exactly five it's a long story
it's a launch third we're not gonna not
go discuss the details of employees here
HR might yellow gotta watch out you
always got to make HR happy that's your
job any company tell no facebook HR
operations
alright scobie's it's being look at me
stream on YouTube I don't know man I
honestly like Twitter's platform better
than Google
I'm sorry periscope sucks we should make
our own periscope um have you had open
file stay again just stop sending torque
to wheel and not really it shouldn't
happen any new debug tools no no no you
know all the debug tools we can go look
you want to go your quality's amazing
excellent love it you wanna go look at
the at this stuff oh yo ho y'all wanna
hear some crazy shit guys you see these
these are the last 228 gig eons in
existence
that's it when these two get bought
no more 128kb yawns so the main thing
that we're talking about on this copy
Sunday how long are the internships
twelve weeks main thing that we're
talking about Muscovy sunday is the DSP
yeah probably
probably maybe the next one yeah I've
been working on DSP code guys know has
been that's been my little project
when is China trip soon soon soon soon
yo-yo yes seriously
you know it was might be a good
investment oh if we run out I don't know
really what's gonna happen maybe we
should raise prices you know a comma we
always try to read prices of our
hardware remember that time pandas were
$88 I can't find an 88 dollar panda now
hoodies man buyer shit's good investment
all right scope ease thank you for
joining I don't know where is head talk
Michael public yo check out free the DSP
calm that's free in the DSP for all the
people to use I don't know why I give
this shit away for free we should keep
it all secret and then charge people a
lot of money but not we give it away for
free because the pie will be big and
every will be happy you got a panda for
50 no way not for me again bra overview
of how I freed the DSP I don't know read
the code man you're on to moon haughtily
on coin yo seriously
yawns our limited-edition yawns are also
you know come a I look
we're phone manufacturer right yeah that
$88 pan at we're for manufacture and if
you guys have seen the trend uh with
phones oh we got plenty of men i blacks
but 128 gigs are low so there's that no
but um if you've seen the trend with
phones phones are expensive these days
and I think we're gonna get on that
trend whoo so you know get your Rhian no
naughty on - there's no we on - I
promise you there's no e on - there's
not even gonna be in yon there was we
were thinking about a neon with a
different phone but they're definitely
not be any on to why no active marketing
because marketing is stupid right um we
have X budget as a company right and we
spent it all on engineers and operations
anything you spend on marketing is a
sunk cost we don't need to market we
just need to make a product better if we
can make our product so good won't you
marketing there just won't be anything
like it
imagine only one company made
refrigerators would you need to market
them food want to keep it cold buy a
refrigerator no does everyone have a
refrigerator that's right yeah cuz a lot
of people don't know that's what I mean
like the refrigerators aren't that good
yet but once it's as easy as convenient
as a refrigerator leahy go cool yes you
tell me where to get a lot of lady Co
cools I'm interested
Georgia common yeah hit me up ya know
Tesla Tesla believes in the same thing
about how's that I do they just want to
build a better cheaper car right don't
waste money on it just keep talking
we're having no scope ease I gotta go
this girl text me back I'm excited I'd
text her back miss you wait a little bit
wait a little bit to CPU pixel to CPU
yeah the speed limit so just doing the
map she's not on the scope um she's on
the text wait three days wait three days
to text her back so I went through this
place okay you make a way bra no no no
no was she doing it nails that's the
thing else Joe
[Laughter]
morning's Kobe's good morning it's my
room now moved check it out
brah
what's up my new room my bed on the
floor back there thank you now I plant I
love my plant
happy Sunday happy Mother's Day
everybody honor your mother and father
its commandant y'all should do it
check out my my Mondrian my
ex-girlfriend painted this for me it's
kind of nice we haven't sold the Ford
Fusion yet we're gonna go trade it in
for a Honda Accord thank you thank you
so my map record II I'm no longer a
logan paul fan but I do think the merch
looks good
where is my family back in New Jersey
bros know we only hire engineers comma
only hires engineers because it's
engineers that move the world forward
that's not sure we hire a few other
people but it's mostly engineers
um yeah Honda Accord steers down to zero
okay so I'll tell you guys what we're
talking about today welcome welcome
welcome thank you I like the pink - all
right so you guys have all seen this
room guys have all seen it
we're hiring two positions we're hiring
a bunch of positions ml guy is still
around he's doing pretty well pretty
happy with the new ml guy but what I'm
really here to show off is this room
here this room is gonna be full of
engineers guys we're hiring okay all
right all right all right so let's go to
the board downstairs and it's confession
time about to tell you all something you
have my old bedroom now to fill with
engineers okay guys so I haven't told
anyone this yet but we're gonna tell you
right here on periscope
uh a couple weeks ago we raised five
million dollars so we have we have five
million dollars and we raised it at a
100 billion dollar valuation so yeah
here's a thing right
I'm not big on you know it's not an
accomplishment right it's really not an
accomplishment to raise money if you
think it's wouldn't raise 100 or raise
50 million but I valuation is a hundred
it's an accomplishment to raise money
what you're really doing is you're
you're you're selling off your company
but yeah so you like the diagram I will
get a better marker for the rest of the
stuff I have tried okay so guys the key
word from here on out is focus we know
exactly what we're building not ready to
tell y'all yet we know exactly what it
is we're building it's gonna take about
18 months and by the end of it I hope
that we're going to be worth 1 billion
dollars because if you're starting a
start-up your goal is to be unicorn 1
billion dollars
I was checking list of unicorns there's
not that many of them we're not building
a bullet train no you guys could
probably guess we're doing but yes we're
trying to 10x this hundred million we're
trying to turn a crack rock into a
mountain yeah that's the plan guys 1
billion dollars we are hiring so if
you're good if you know people who are
good we're looking for you we have
something incredible to bring to the
world guys you look at the EON you look
at the Panda
you think you think I did this to build
yawns Amanda's bro I did this to build
revolutionary shit that changes the
world and that's what we're here to do
so we're hiring we're hiring engineers
and more engineers and other engineers
yeah I know I know we're at the hype
it's not hype guys it's not hype if it's
real I'm not promising you bullshit this
is real like this is actually I gave a
realistic timeline a realistic plan yo I
did some CEO shit on Friday
I calculated like evidence and
annualized recurring revenues and did
market research and shit this is
actually achievable if you're coming
here thinking that you're gonna make a
huge salary this is not the company for
you it's a Jimmy world quote do you want
the work more than the reward you come
here if you want to change the world
ah if you're looking to make 300 K check
out the Toyota Research Institute I hear
they pay really well okay um so that's
that but yeah focus 18 months 1 billion
dollars um
no better than Google no we're not we're
not better than Google but that's okay
Wayne was valued at about 70 billion
dollars Cruz is probably valued at about
10 so 1 billion is is small in
self-driving car game I mean even am I
good at math I'm pretty good at math I
ain't got perfect scores on my math SATs
but yeah so we raised we raised we
raised five million a hundred million
dollar valuation don't raise a lot of
money don't sell a lot of your company
never ever give up a board seat because
you don't want to get khalaq nicked you
want a Zuckerberg I'm absolutely we
offer out we offer options to people who
work here
um if you work here if you join now and
we succeed you probably make ten million
dollars
if we succeed and you join right now
your your stuff will probably in four
years out of even with ten dollars if we
succeed and that's the game yo you know
what I've been reading guys the will to
power this shit is super relevant today
do we have a pool um no no it's not ten
million in eighteen months yes it ground
for four years and we really got a we
really got to ride out the tail but
that's the main thing I'm here to talk
about what am i drinking right now I got
a I got a venti iced coffee from
Starbucks really we're going hard today
get things to do but yeah so a few
things to show off to you guys
vesting schedule you know this is a for
you four years one year cliff the
standard what am I gonna show you guys
today I could show you our latest
training machine so our new models use
reinforcement learning and in order to
do reinforcement learning you need big
computers so I got this guy right here
that's my latest and greatest 10 GPUs
one box
we've got some more 3d printers the Army
is the Army's not printing right now no
these are falling off
[Music]
nvidia ten nvidia gpus all these people
down here I'm moving upstairs old guys
wanna know what's in these boxes
yeah boxes browse there's a oneplus of a
TP you know how many transistors a lot
but yeah guys so this is scope II Sunday
we're not here to to to to shit on
people today that's not what this Co P
Sunday's about we don't sleep we go hard
welcome to comedy I we're getting a
Honda Accord but that is really what I'm
here to talk about today your bike just
fucked Andrew focus 18 months 1 billion
dollars get we're mapping you guys know
we're mapping you saw the mapping scope
ease the mapping is starting to work
Harold bro Harold slam it's the future
we have our own slam system it's quite
good but that's really all I'm here to
talk about today we're hiring give me a
job at comma a I get an early get rich
get in late get fucked yeah that sounds
right I'm tiring a PID guy if you know
things about controls will hire you do I
work on ml today I'm working on that
well today yeah no we're a little - now
you know why because this isn't here's
the thing about hype right here's the
thing about everything don't be a
hypocrite so many people in lives are
hypocrites they say shit that they know
is not true to like build something guys
if I didn't believe what I wrote on the
board there I wouldn't write it why am I
here what am i doing I'm rich I have a
great life but we're sure to win
self-driving cars and that's exactly
what we're gonna do
why am i a Python guy I'm code in C++
kind of I know a little super sports my
codes evil flows pretty well ml is going
off ml is going well new models new
calibration oh-oh that's the other thing
I want to show you guys yes we of course
building artificial intelligence eons
are about to get some serious
stability improvements we've had a
full-time engineer working for four
weeks on Eon stability we haven't
shipped any of these improvements yet
and what we have here is the Eon testing
closet what guys rich for a while now
this is the Eon testing closet and we've
had eons now run for a hundred hours 100
hours straight driving a car so we don't
want Young's to crash anymore and we're
working hard on stability on system
stability oh I can show you what I can
show you at the front end of that looks
like we'll go to we'll go to testing
calm in our life bro common needs car
hackers yeah if you're a car hacker I
will hire you okay really just here's
what we hired based on we hire based on
two things intelligence and motivation
intelligence kind of in an IQ sense and
then you're not allowed to talk about IQ
anymore but we do we don't IQ test you
but you got to be smart you know you got
it you got to be intelligence and you
got to be motivated and you got to be
motivated right like you know if you're
asking like well I could good 400k
Toyota great bro go work at Toyota if
you want to change the world maybe do it
all right so we could see up here ya'll
watching Death Note pretty good
every more power it's pretty good
programmers need focus um yeah yeah City
why and gonna like those nagging high
schools Stuyvesant Burke County
academies college doesn't matter causes
a scam there's great new podcast out a
16z with this guy is like education is
all about signaling in this crap huge
waste of money you guys want to learn
stuff you have the greatest tool in the
history of the world to learn stop what
is that greatest tool in the history of
the world you can learn anything you
want
wouldn't sell afford time training for a
court next week training for Honda
Accord Google yeah we have the Internet
the internet it's it's the Internet has
changed my life guys but yeah so this is
testing open pilot CPU usage RAM usage
how long it's been running for now it
looks like it's down I will have to look
into that but yeah cleaning up all the
memory leaks for cleaning up all the
crashes stability but we really got to
come back to if we focus for 18 months
will be worth 1 billion dollars by the
Internet's change my life guys I'd be no
one without the internet got a credit
bro you got a credit Oh guys I college
college like you're the Roman fire
brigade the Roman fire brigade were
people who basically used to come around
and they'd be like oh I see your houses
on fire
maybe you should go pay us some money
and we'll put that out if you didn't pay
that go to your neighbors be like a fire
spread real fast you know maybe you
should not pay up those guys those guys
is a scam our current valuation is 105
million dollars so that's an some new
shit dropping right here for you guys on
periscope I was rejected from MIT
I own the domain I hate MIT calm yeah
how is not very good student in high
school you know cuz I'm dumb that's what
my husband my teachers would tell me
that's my gay teachers I love high
school but I did do really badly in high
school say what do what oh I can scroll
up and see common uh I went I went to
Carnegie Mellon briefly I took some
great classes I learned some great
things but few very talented professors
it's all about finding like the few
professors who actually want to teach
you things
here's the thing the systems in place in
the world today do not incentivize value
creation
they do not incentivize actually
teaching you anything
but there's some people who like against
all the odds just have this intrinsic
desire to create in this intrinsic
desire to teach other people how to
create and that's who you got to find
now none of these systems are worth shit
what I think about coding dojo I don't
really like those bootcamp things
motivate yourself I'm telling you what
I'm doing today
yo this is paper really psyched about D
correlated batch normalization so I'm
gonna try to implement this intensive
flow and we'll see what goes so if you
guys know what Bachelor realization is
uh D correlated batch normalization
there's a projective transform on the
vector space 2d correlate the things
right because if you're if you're things
in your neural net are correlated you're
wasting capacity but if you can D
correlate them you get capacity back so
it's really exciting and you could do it
you can do it you see like you can't D
correlate in a nonlinear way but you can
if you're talking straight-up
correlation in a linear way you can
actually do that transformation um
who'd have thought that linear algebra
was gonna be the science that was gonna
change the that was gonna determine our
future linear algebra and a little bit
of calculus heõs to know much calculus
it was perfect it's this perfect like
the things that I was good at happened
to be the things that were like good and
like multivariable calculus not so good
looking house it was cool no no we
didn't hack before it firmware I'm given
the Ford back I'm over for it's not the
year of the for it anymore part of our
focus alright guys let me tell you
there's really six cars that we're
focused on if you have one of these six
cars you're in luck
if you don't have one of these six cars
you're out of luck we have the CRV the
Civic and the Accord in the Honda
Department and in the Toyota department
we have the rav4 the Camry and the
Corolla
right rola there we go um these six
these six cars of the future if you have
one of these six you're in luck
what's the cheapest I don't know
couldn't tell you I'm rich what Oh God
because everybody's using that stupid
data speed Oh super cruise Cabana little
seem able shit I don't know um Andy's
out driving our Cadillac right now he's
gonna move to that upstairs upstairs
pretty nice alright let's go chill up in
that room for a little bit um is Eddy
paper rich yet you'll have to ask daddy
that I don't know man
we're kind of got it on crypto early to
everyone around the office so we got out
hopefully not everyone got out I got it
I'm now over crypto no I'm kidding
always keep your portfolio balance when
crypto appreciates you're gonna keep the
same percentage it don't good investment
advice I also bought Tesla stock yo I
bought Tesla stock when Ilan like
flipped off the people during the
conference call I was like that is such
a boss move um that I bought Tesla stock
and it's up 10%
what a deal no minivan no we support the
Civic the Accord the CRV and we support
the Corolla the Camry and the rav4 and
that's it
if we hypothetically start releasing a
cup of Reef lashes they're gonna be for
those six cars or no others you on musk
work
I don't think I think he lawns got
better things going on the work I come I
mean commas lit but like I SpaceX is
cooler like it's just cooler than in
like a but that said if you go work its
basis you're gonna make way less of an
impact because it's a much bigger
company SpaceX is a is a six thousand
person company now and we are 15 we're
hiring we hope to be twenty by the end
of the year so we're hiring five people
this year
yeah crossovers code like let's see are
bees those rappers rap for is the third
best-selling car for a bit oh yo check
this out balcony for our newest software
engineers come out hang out on the
beautiful balcony where is viv it's
Sunday guys only I'm at the office on
Sun there's no a few other people here
but viv is probably home talk about life
what do you want to know vape wild out
there not smoking weed yesterday I don't
think we smoked weed today that was that
was my yesterday
smoking weed cleaning this room hood up
clerical work sorry
when did I wake up today thirty the cord
sport if it's the same stuff yeah come
on drugs I did drink that big coffee
today though that is that is real I did
drink have that big coffee yesterday
smoke weed maybe once every once a
weekend Bros Willow gang no I'm over the
little gang I don't know I haven't
watched logo ball got bad after he came
back because he tried to be like
politically correct and like appease
audiences Oh week never apologize bros
don't get collect nicked you know didn't
apologize Zuckerberg cuz you got a
sucker burger that's right we use Azure
because they gave us more free money
never give up never surrender absolutely
yeah sucker
thoughts are on tensorflow vs. pi torch
I use tensorflow
no real reason it kind of came out first
ego votes pretty nice now - so you got
like that same PI torch niceness yeah of
course of course new products yeah but
it's gonna take a bit it's gonna take
eighteen months um how much for a verse
yo I will do a verse if you have a
following and you actually want me on
your rap track I will absolutely write
you some 16 bars reach out to me on
Soundcloud sify.com slash Tom Cruise -
two zeros what positions
okay so we're hiring for driver
monitoring so you got to do like ml and
data science we're hiring for firmware
Panta firmer hypothetical firmware and
bring up for future of hardware products
that may or may not exist know things
about barbarian like see and drivers and
stuff we're hiring for mapping there's a
Roch Roch Roch bro nice that would be
funny those that actually haven't done a
periscope
when will young be replaced he also be
supported certainly through the rest of
the year guys were a foam company we're
gonna release new hardware every year
what do you want to do with 10 meters 10
centimeters bro we're hiring two people
for mapping we're hiring a full stack
engineer and we're hiring like a data
scientist pretty much those four if you
know things about ml data science code
and Python low level stuff drivers see
that's all good if you know things about
controls vehicle dynamics so always hire
people like that really you come in here
I'll tell you what our interview process
is I ask you questions and I kind of
probe your knowledge you do the same
thing to me pro bono but then like if by
the end of the interview we're having a
conversation where we're both teaching
each other things are really if you're
just teaching me things if you're way
smarter than me
absolutely hired here if you're teaching
me things by the end of the interview
we're having like legit conversation
that's what it is like that's what it
that's what it takes to get hired around
here know things this is I see the same
thing on games to like know things I
don't care even really what you know
things of that but like know things you
know so if people just don't know things
seeing C++ developer looking for a job
give me a job I comment on AI we got a
phone screen set up what's the speed of
light bro do you know life is work what
else is there to do Jordan Peterson is
this great thing he's like look man you
gotta believe you got to believe it you
gotta believe in an evil
you gotta believe that some things are
bad because if nothing is bad that
nothing is good and it looks good what
do we wake up and what are we what are
we work toward all day know if you teach
me things about history during an m/l
and ever you know you don't get the job
but I would love it like I went on a
date and some girl taught me things
about history that would be great there
you go Greg you know this beetle light
but the problem is everyone can google
it right now you do that in person too
that fast
do I believe in God Lee I mean maybe not
the judeo-christian god but like
somebody created the world right rice
what about ask what the implications of
the speed of light are I mean that's
faster than anything yeah you can get
into it's communicating fashion the
speed of light possible what if I use
quantum entanglement bro we didn't talk
Iran people say this I honestly someone
else probably did it we do nothing with
Iran we just just does not we live in
virtual reality
yeah probably something like that aliens
created us yeah I mean something created
us and that's what I called God right I
need some philosophical teaching what
the reading reaching bro I didn't get it
much when I was younger like I read
Nietzsche when I was like
and it was confusing to me I didn't like
to understand and then I read an R and
when I was young and I understood it's
very easy and then you grow up with that
and you're like okay let me find a
slightly more nuanced philosophy here
yeah yeah oh god Randy they're good
books they really are good books if you
guys haven't read like Atlas Shrugged
and Fountainhead like they're very
enjoyable to read as a lifestyle
philosophy you know it's fiction
come on but it's enjoyable like it's a
good book God is everything yes God's
nature job's collective as a user and
fan yeah do I believe why does Torvalds
do I believe he exists it as a person
yes very easy to understand
misunderstands objective is I mean it's
objective I don't actually think is a
way to like live life but it certainly
has good core points you probably have
with coding is you hate the theory you
don't need that much theory yes that is
Torvalds once at a conference I think
he's I think he's incredible I think the
best song for engineers in the world the
fact that he still does like the merging
in of the pull requests to the kernel
the Linux kernel is much higher quality
code than the windows I've read the
Windows kernel code I've read the Mac OS
kernel code oh man well there's kernel
is way better if God is good and
powerful who said anything about God
being good that sounds like some
Christian stuff I told you I believe in
God I just believe God is powerful I'm
hope I'm good I think good is a human
invention have I addressed the great key
I don't know what that is do I know
about kernel what do you want to know
yeah I know
Colonel I know what exists do you want
to know have I addressed the gray key
what is gray key
what's my IQ and I could talk about that
I don't care cracks iPhones anymore I
have an iPhone don't have my iPhone
I'm sure I'm sure it works I'm sure
someone's making money off of it stop
light stop and go a new model oh yeah
yeah always coming soon no they'll be
out by the end of here the new model is
coming sooner models are working can i
hack Google again what do you mean by
that
I probably could hack Google I probably
couldn't hack Google and get away with
it and that's a lot harder and again
like yeah what do you mean by hack right
could I get access to people's data yeah
probably so the real thing is you don't
go after Google why not just go after
the person directly can I change the
front page of Google com
yep probably it would probably take like
a year new calibration is gonna be sick
new generations so fast um new
calibration is is fast yeah when we map
the rest of the world that's not America
I don't know man
after the GE PR I'm very bearish on
Europe
I'm very bearish I'm like touching any
European stuff yeah talk to you talk to
your representatives tell them that laws
like that are crap how many hours do I
work every day how many hours of my
awake life is work how interactive I am
thank you I'm like a cam girl except
nobody pays me
that's about Google Group like this is
sick demo women is work is Google or the
NSA more secure probably the NSA only
because they have less outward-facing
services right Google has a lot of
points that you could attack ever
alright bro you're bad that's that's
just vulgar what do you think we can do
about the roads in California you almost
can't see the lanes but you can and
people don't crash so I'm sure machines
got into not hacking Iran I don't care I
like the counter alright except nobody
pays me I hated the Google president no
no but you have to make the computer say
on because people do like it sounded
good and what that's really going to I'm
absolutely not a white supremacist you
guys but why have the computer say oh
because really what it is is all right
you're you're asking me if I can hack
shit you're banned the white supremacist
guys ban we don't need that talk here
guilfoyle doesn't like the arm I don't
even know what you mean by that sativa
duplex beating time-tested it kind of is
in a way well what that's really going
to do what Google duplex is going to do
is make humans a very expensive endpoint
so it's gonna make it very expensive for
humans to you know if you're a
restaurant you don't have an online
booking system you're gonna get calls
from computers and I know who Gilfoyle I
got like guilfoyle the actor Gilfoyle on
Silicon Valley like gig that's I'm
talking about like what level of the
meta this is on yeah like something
called ensalada this is great there's
gonna um you're both gonna have a
legitimate conversation but there has to
be a reason that exists right no no
evolutionary algorithms let's start with
Zuck we got to talk about weather sucks
human before we get to me we don't use
evolutionary algorithms because they're
not as powerful as
search like they're not as powerful as
convex optimization right if you think
about what gave rise to humans maybe
evolution design the architecture but
the learning the real power comes from
economics optimization I love machine
learning algorithms then the search is
just way less powerful you can show that
convex optimization is just more
powerful there's a guy on periscope that
hates the Zuckerberg because that breaks
over what are some of the problems
people will be working on so winning
self-driving cars I mean that's that's
the whole problem right like how do you
win self-driving cars so you'll be
working on things like things like map
and things like machine learning you
know how do you so we have maps right we
gotta put them all on a big map we got
to do we got to put that in a database
so we can quickly access it when I
upload my brain on a computer okay I got
to be a little bit careful with that
what do I think about Bill Gates or
Steve Jobs something like Bill Gates
versus Steve Jobs I mean they both have
things going for them it's hard to get
real information still about Steve Jobs
because he's kind of a deified after his
death so throwing planes not to be
honest actually to be honest if you're
talking about cities these like small
hop drones are pretty good however I
don't do machine learning read the
Internet
hey breakthroughs in depth detection
we're working on pretty good to punch
supervised stuffs getting good mask this
off store locally now will stream them
over the internet with database to be
used my sequel are you using acid or
base databases we use my sequel
do you believe set a V job I don't even
know what that is my safe is pretty good
like it's just like what else are you
really gonna do come on go bro I'm gonna
go with that no sequel slow
he's my sequel on the back end what does
comma hardware look like an 18 months
well you'll say just a cramp
it's I'll tell you I'll here's the end
here's the hint I'll give you it's gonna
have more cameras 360 each base cuz I'm
one of the Apache things I should know
this stuff better way case
do you work with no sequel big data
stuffs um so a lot of art like big big
stuff is stored as flat files no so we
don't like put them videos in my cygwin
stuff that's all done as flat files 360
[Music]
but no I mean it's gonna be like if
anything comes out with a 360 down it's
gonna be a lot more expensive and it's
not gonna be much more at first we gotta
get there everyone will go yeah cloud is
a great idea right everyone should go to
the cloud except for like GPUs now
unfortunately there's still really
expensive in the cloud so it's worth it
to have my premise but if you're talking
about just compute and keeping servers
off and reliability and stuff like that
you want to go cloud maybe stereo say
what I think about quantum computing I
think it's mostly a scam yeah even the
other side is actually this is a a
quantum computing probably mostly a scam
I believe that P equals B Q P if you
want to get real in depth about this I
don't think there's any problems that
quantum computers can solve faster than
classical computers I do think there's a
classical time factoring algorithm I
think will find it like ten years of
privacy guys get over it get over
privacy if you're interested in privacy
you just you gonna lose you build a
recommender system why
seems like all manufactures gonna come a
self-driving future yeah just like all
phones come with smartphone feature
except they run Android right all phones
are gonna come with internet browser
well yeah and like some of the
manufacturers tried to make their own
phone with internet browser and we know
exactly how that ended up miss your
Nokia n900 bro
yeah don't use the Internet if you think
about privacy that's absolutely right
you want privacy go live in a cabin and
honestly people still find your I
absolutely love my work
yeah convert to pickle in a Berlin
computer we're gonna do partnerships I
vomit when I hear that word yeah it's
disgusting our manufacturer is going to
be allowed to use our open-source
software on their cars absolutely
sidekick to best phone made by Andy
Rubin
surveillance state yeah I mean the only
problem is that we're not surveilling
the surveillance day all right
distribution yeah you can sure what do
you mean you could communicate securely
that's not like a problem right like
like like you're misunderstanding what
partnerships aren't really a bad
question they just kind of disgust me a
little bit no I'm not gay
kind of cool to be gay I think that
partnerships are a new band question no
what was the thing before
oh about key distribution no I mean like
that's not likely the NSA can't crack
your photography yes do I know about
Stallman yes he exists but the problem
has a lot more to do with the analog
code right like any and it's not the
it's not the like communication that
they can intercept it's like well why
don't they just hijack your phone or why
don't they just like send a guy to tell
you or there's much cheaper ways to to
violate your privacy than cracking your
409 six bit RSA right like don't don't
privacy's a scam guys security is a huge
scam I went to RSA this year I could not
believe the entire floor is just filled
with scammers trying to sell you their
box I don't know I mean I think if
you're gay you're into that right
physical access is way easier yeah
license plate readers are everywhere
yeah yeah cameras are everywhere man you
want to know about the license plate
reader Network so shit for them we
process all the license plates what's my
favorite engineer like people I don't
know how many people guys yeah if it
digital secured I mean it's not a West
role tonight I don't know I don't really
watch the season yet I've heard mediocre
things I probably I should I should
catch out I've been watching definitely
what do I think of Andrew McAfee you'd
be like the guy who killed his neighbor
and beliefs of bath salts you know a I
can write own code well sort of that's
what I kind of is localized shadows in
the road of sunset yeah HDR is a real
solution too
that was just having up to Namak range
of the cameras we've shipped HDR a
future cuck streaming live rod pink
hoodie yay you know I brought your bad
no I don't know I got it nope oh that's
my favorite noise together application
the hunter prize the hunter price the
hunter prize is sweet make the smallest
self-extracting archives Kenna for Cappy
dia I think the winning entry might have
analyst um no there's a guy Byron all
working as open source thing called sea
mix it's really cool
we should worldwide alright bro
man thank you for commenting again I
love banning people feels great we
expect to light it up for Tesla anytime
soon no I'm kissing Tesla look so he's
one of my losers Tesla's were quite
awesome people I want to beat them
legitimately in a here's the thing like
I don't think he'll on busca actually
likes me I like him I'm a big fan right
that he looks at me like some like you
know to ban before why I banned everyone
cause it's banding right Sunday sorry
what function is working best with
backpropagation I like Adam Adams pretty
good Tesla isn't so hot
you gotta get to use debt man Prius is
absolutely still supported what I saw my
entire company Tesla maybe I don't know
I don't know if musk aids me good chef
on Twitter I love that he does that man
was the CEO gee I'm doing that I don't
think you are Mosca's jealous of my
talent
I think he's smarter than me right now
maybe I'll be doing in a few years I'm
light enough was good I know yeah I mean
no there's no such thing as a perfect
self-driving cars just like superhuman
self-driving cars I mean maybe there is
right but it's like you don't need a
perfect chess player go player to build
something that's far superhuman
I don't go to DEFCON anymore I wanted to
speak there last year and they said no
I sort of don't like what Def Con has
become um so I don't go anymore
nope I don't want to be famous and I'm
not that much I don't care
it's money is worthless to me how'd it
become smarter bad news I don't really
think it's possible I think IQ is pretty
fixed throughout your life and you can
become dumber but I know if he could
become smarter thoughts on TP use ah not
a fan I think Def Con has because it's
run by it's run by like the perpetual
conference crowd I'm like all these
conferences are kind of becoming
homogenized by the kind of people who go
to conferences you have a merger of like
like industry and maybe some like like
social justice warrior ask themes you
know you see the people with like pink
hair or the organizers of the conference
is like like that's cool if you want to
have a conference about that but like
it's becoming everything I heard good
things still about CCC I heard good
things still about CCC I don't give a
shit I don't want any famous bro I don't
want to be like super rich I just want I
want to know everything you can train
your brain to become smarter yeah I mean
you know you can just become stupid or I
kind of think about these I don't know
that maybe it's okay but DEFCON DEFCON
this you can definitely do things to
increase productivity and maximize
ridiculous yeah that's my job am i doing
any CTS not a place if you have said
anymore all right guys
maybe we'll do it we'll do three more
minutes make it 45 minutes I can't wait
till some journalist like goes through
this it is like the problematic things
about common eyes periscopes thanks for
the attention bro can you win at DEFCON
I did a few years could I went solo
there's probably one year I had a chance
I do drink coffee
wisdoms not fixed yeah juicy GFS they're
pretty cool did I see Avengers and
advocacy the superhero movies there look
beautifies about the superhero movies
they're taking up room where there could
be good new movies it's the same story
repackaged every single time could I
wouldn't Def Con right now I'm not a
poet to practice for a year Reed Scott
Alexander stuff about growth mindset
it's it's a nice fiction but I'm not
really sure it's true can you buy the
Ford giraffe I think we'll open source
it coffee's only a carcinogen in
California good thing I'm not as away
now I'm in California I had a code
faster make a plan musk aids me yeah I
fell it does know San Francisco Ida Pro
is good because sleeping the ones me
anything better what deep learning
papers do you recommend to read um I'm
excited about D Carly Bachelor ization
that's what we're to do right now life
as a carcinogen that sounds about right
oh don't be so worried about how you're
gonna die just be worried about how
you're gonna live forever map Europe not
only America and Canada maybe Mexico -
we like Mexico I'm with the Mexicans
pretty nice but I went to I went to like
they played pile-on Carmen and stuff a
buffer overflows I think we kind of
passed by froze I sold over the wire
void things like that do this show like
she's hard I don't really talk about
security much anymore
it's kind of boring did we sell the for
no not yeah next week can use her map
Europe yeah will do God won't consider
European I don't know what's good the
America Maps working first cost of
living in San Francisco is insane yeah
man Peter teal complaints it's like I
give money to these companies and then
they paid it employs maybe the employees
panel landlords I'm really just helping
these new be landlords out I was that
name were he growth mindset Scott
Alexander he writes this blog called
Slate star codex it's really good check
it out West Hollywood hoodie we get
already do our merch that's what I was
telling to them yesterday I'm like I
want to get some mercis like nice what
am i doing today I'm reading some more
in EJ and I'm gonna implement that paper
why am i happy all the time because
courage do we keep always sad
five is great we live in paradise I went
out for breakfast this morning I love
going out for breakfast I'm like
sometimes I got a deal with stuff and
I'm not happy but today I don't have
much to deal with I'm hanging out it's a
good day come a pocket key I don't know
what that is men hackers are sad I'm not
sad favorite breakfast food oh I mean I
love waffles but I don't feel good after
I eat waffles you know life is great has
nothing to do it
I honestly think if you have a mentality
that life is great you end up just like
getting money and if you have a
mentality but life is shit you like
don't I love pizza I've been eating a
lot more McDonald's lately too Donnell
sex pretty good be careful where you eat
don't eat more than 2,000 calories a day
they'll be fat you need a comma hoodie
do have any furniture in here we're
gonna put some desks up in here
oh my dolls kind of nasty that's kind of
true don't you one 2,000 calories daiva
be sure to think it matters what you eat
as long as you eat I think all of like
nutrition is a scam as long as you eat
2,000 calories or less pretty that's it
no I was never fat bro am I gonna jazz
up the place you're at right now we're
gonna throw some desks up in here do I
care about my body I care about nothing
fat but beyond that what if you're
Michael Phelps oh you see me in a pool
okay Michael Phelps this is maverick
courage it is about a perch I kind of
like it I'm over Logan Paul no I think
nutrition is mostly a scam like I think
that they change what's the new hip
nutrition every once in a while where's
my girlfriend Vegas with this girl two
weekends ago that was pretty cool
last weekend that's pretty funny what
made me get a Roomba
I bought it I'm very disappointed with
it actually it's kind of crap it cost
way too much money do I exercise not
like really focus sometimes I walk
we just don't know yeah like I don't
know maybe there's some answers to
nutrition but
I think I think they just don't know do
I exercise I can do something I could do
some push-ups having a girlfriend is
cool if that's that that's a personal
decision then money has influenced you
know absolutely like they like put out
some like new scam like don't eat carbs
or like gotta eat like don't eat gluten
or you know you got to eat kale kale
also superfood I think I do a backflip
on a trampoline yeah oh I'm sorry you
don't like how I look your thanks bro
really help it out by my self-esteem
here drop money influences all research
unfortunately am I gonna announce
speaking next time who's my first
girlfriend other song I'm not gonna say
her name who was they who's they what do
you mean did I say they they the great
conspiracy and he upgrades for the
adhesive I don't know girls I don't
think I'm woody get gets a test because
he wanted was a girlfriend he did he had
this interview where he came out he's
like look man I would just be so sad if
I like build rockets and like had no one
to come home and share was a really
human moment I kind of liked it where
will I be in 30 years old probably on
this couch talking to you guys no I
don't think about the future that much
like that I think about the future in
like grand broad strokes like it'll
where's like technology going the like
in terms of my future who cares
all right scope he's winning
self-driving cars I hope do I plan to
teach my dad's a teacher I don't think
they'd like me I don't know if
credentials what is common look like in
two years unicorn bro unicorn that's my
new thing
unicorn where is technology going
I mean that's a long and complex
question 18 months Apple turns off the
fancy computer you start Siri that's
pretty cool it's good nice quiet sculpey
what I think her veganism again it's a
personal choice if you choose to be a
vegan good for you if you just stand on
the corner and scream about how non
veganism is immoral but no no no this
periscope I call my one yesterday no
phone call I did I wish to have mother's
day sorry I was watching some more
videos yesterday they're pretty cool all
right I should get back to work too
thank you for joining we are hiring come
work a comma a I ask voice Co covered
cow may I
good Sunday yeah Andrew entering office
really he's really killed his reputation
yo-yo peace out bro
yo yo yo welcome viv I'm gonna hand this
over to you we are here you know why the
best shitty music turn off this thing is
so commute alright so we are here in our
Honda Civic and we are going to self
drive to Best Buy so let's see this this
one any this one's hard for humans so
this one you have a pork
[Music]
so 2000 the best place well then I'm in
a coma yeah yeah one of these days you
know once we have the nav integrations
gonna be a good day
Wow 41 people already 40 more people are
ready to show me so this is zero point
three point three this is the latest
open source released which has the best
model of all the models I've ever seen
with open paws
um and it's really thanks to the crowd
it's thanks to you know we're now
training on all the data from every
other user of open pilot so all the cars
make each other smarter people always if
people asks I'll just read it out
Bonjour
can you buy this no it's even better you
don't need to buy it free yeah we've put
the plan so this is running this is a
common deal which we have free plans for
available on the internet or there are
third parties which have taken our plans
and made them available for sale um this
is software's called open pilot and it's
one under set free licensed under the
MIT license and you can just go to our
github and download it so I do need to
disengage here because this is a red
light and open pilot does not yet
support red lights or stop signs
is this a neo with is this a neo with
panda this is actually the there's a
panda inside of this neo so yes it is
the neo with giant panda compatible cars
um but it also works with the old neo
board compatible cars right now are the
Honda Civic the Acura ILX the newest
addition the Honda CRV and soon once we
get it up streamed the Chevy Volt so I
did have to disengage for this red light
doesn't work in traffic yes yes it works
in traffic
um if you saw it was just working in
traffic
let's wait for this light to turn green
I'll get us up to speed well you ever
make a video tutorial on how to port
cars maybe so if you saw my last
periscope stream we are
yeah and that's good oh you're holding
it to try to not cover the antenna I
remember antenna gate and that bummed if
you watch my last stream I show off the
initial stuff we do for the Prius which
shows you how to maybe connect a new car
now we're gonna get another
disengagement up here probably unless
this light magically turns green so it
will work as long as you went up the
first car at the light it works at
lights but you know we're not the first
car at the light so I'm gonna have to
manually disengage it for this red light
up here just like Tesla autopilot Volvo
Drive Thailand every shipping system
today there's not a single shipping
system today which will stop for red
lights but red lights are not really
that hard and you know we don't just
make open pilot we also make a dash cam
app called shiver we use this ship for
data and not just training the
self-driving cars but also to make maps
now the trick when you're making maps
isn't just to know what intersection the
lights are at but it's important to also
know exactly where the light is that
corresponds to the place that you stop
if you're chewing gum on the Paris yeah
come on with Casey Casey nice that you
can I do this in a brand new Civic you
can do it at least brand new Civic it's
super easy you just need to unplug one
wire and plug it into our thing and then
when you want to switch it back you
and you know what your back why I red
lights hard and when we think was
supportive red lights are not that hard
and we will see certainly moves in that
direction this year when will math major
getting to open pilot oh yeah well we'll
be moving in this direction this year as
well
little hard on the brakes there the
reason it was a little bit hard on the
brakes there is because the radar by
default filters out stopped cars but
when it fuses with the vision system it
can stop for car to stop cars so that
was a fully stopped car it's kind of
hard for the radar to see it hard for
the radar to distinguish them say like a
manhole cover anything with Honda
sensing radar aligner so it uses the
built-in radar from the car obviously
there's no lidar lidar is overpriced
someone's yeah there's not that much
that a lidar really helps you with as
part of the driving problem that you
can't do today using modern deep
learning and computer vision with
cameras oh asking for wine will level-3
itami be available when the statistics
show it's ready um so I would expect it
first from Tesla slowly followed up by
us
so let's see how it does here look at
take a look at the lines on the road
they're very confusing
alright so steer control saturated is
when we've exceeded the steering torque
limit of the car on the torque limit is
a safety feature put there by Honda not
by us to prevent any sort of these
systems from jamming the wheel super
here we're just gonna put the speed up
here manually 265 yeah once we do maps
will integrate the speed limit
automatically
the speed limits actually only 45 so
we'll be going first absolutely yeah
well it is open source 150 MIT license
or do we support them we give them
support you know but can they do it of
course license yeah we haven't we
encourage in the city now one of these
days the neo will tell you this stuff -
Sarah Monty Boulevard all right
when dishonored by myself having heard
[Laughter]
jokes man friendly jokes override the
haunted for better we already can but
for safety reasons we don't
Wabble there
you know they got acquired for a lot of
money they're not the worst they're not
the worst there's there's there's much
worse people out there to mobile I you
know the CTO really did start to change
his tune about self-driving I think they
were took a ridiculous position on the
Tesla thing why is it better than Tesla
system why is ours better than Esso
system because you can put it in your
twenty thousand dollar car test the
system what is the pan to do well the
Panda is a universal car interface so
the Panda basically allows computers
like the Neo or like a computer or like
your smartphone to plug into your car so
the Panda basically allows full access
to your car over either USB or Wi-Fi to
keep driving for a bit so you can keep
talking
what's our company name or kamidana add
your comment on a I uh and actually we
are doing arms forgot our work we're
launching our first product of for sale
this Friday so we announced this on our
Twitter first product for sale this
Friday we're open to press Wednesday and
Thursday by appointment price free so
open pilot I'll brief the product the
product price is obviously not been
announced
because the product hasn't been
announced yet but it will be for sale
point two oh this is your yeah I know I
know for a little bit
you know what does the end goal for a
kid like this - cosmic future um well
the entry-level stuff should be under a
thousand then if you want fancier stuff
maybe I'll keep it under five minutes
would there be a subscription fee very
possibly yes
not yeah no subscription fees an open
file it will always be free it's not
like we're ever gonna start charging for
the current version of exhibit we love
our civic we did just buy a Prius top we
love our Prius - but we love our saving
as well so we've been self-driving now
for about four minutes you can see
that's the bar right there
when that bar runs out the system makes
sure that you're paying attention by
forcing a user action to happen at three
on six minutes if that bar runs out the
thing will beep and ask you to take
control which can also happen for
several other reasons if I can to torque
without raiding potentially will offer a
camera only solution no pilot without
the actuators you need you need the car
to be able to turn the wheel hit the
brakes in to get something really launch
a product like sensors for cars which is
not as senses
yeah I mean that's sort of what it is
the knee out of the neo is the census we
again we don't we don't sell them house
insurance coverage work with
self-driving well so right now these are
level two systems so Tesla show them at
level two systems make driving slightly
safer when used in conjunction with a
person so you are I'm still the legal
operator of this vehicle
all right I'm a legal operator of this
vehicle up even though it's in yes they
can um so you can buy we recommend the
Delfin ESR 2.5 it's a really nice radar
if you want to use the simplest one to
get started with is the night act that
ships in these hot might I might um
this model feels good yeah right like
it's no waffles this is a big
improvement
well the 2010 pre has worked with ok if
you have a Prius with lka maybe l kan
ACC to really be supported but the Prius
but because it's a hybrid hybrid usually
have brakes that are more activatable so
are you gonna see what happens right now
when the health bar run down its gonna
start beeping and it's gonna ask me
at sunset of that
nice
does your product work in bad traffic
good on gas product where's your traffic
and it's excellent on gas like most
critical systems way better than you
save the environment baby look the
health bar is really about to run out
right now so let's say I'm not paying
any attention take control to regain
speed and eventually the car will start
to us I'm gonna take control back
is 0.33 master version 0.33 is master
version yeah it's actually shipped I'm
so I'm just gonna reengage here freak
error no no no this is this is caused by
something else so this probably won't
happen in the release version of open
pilot this is actually trunk open pilot
so I'm gonna have to power cycle the car
so I'm just gonna get off the next exit
quickly power cycle the car and there be
a short periscope guys can you take you
to any time yes you definitely can
course you can if you step on either
pedal the system will immediately
disengage and the amount of torque that
it's capable of putting on the steering
wheel is super small so if you steer the
system doesn't disengage but you can
override how much it's turning the wheel
with one pinky what if you don't take
until after the alert it slows it it
slows down yeah it stops accelerating
will continue to steer but it stops
accelerating
and soon we will probably have support
if you have the right connection to turn
your hazard lights on yes right right
periscopes forever you guys will there
be shops offering installation and setup
oh do you want a shop yeah do you want a
shop Accord support a court support is
almost done rose driveway we do not
endorse with this guy
nope all right there's got a power cycle
yes if this happens when things lag a
little bit so I'm gonna go home and I'm
gonna review this event like I said this
actually isn't zero point three point
three um this is an internal version of
open pilot which probably has this box
it's called a regression for a
reasonable Cydia the iPhone jailbroken
Appstore um so comedy I kids are based
on Android um so
it's estimated insulation install and
setup oh the times it's super fast it's
like I said it's really one connector
I'll show you guys when we pull into the
Best Buy parking lot just how easy it is
right let's get back on the highway here
this is not running silky smooth a silky
smooth is very beta right now you know
we're a little bit behind Tesla in that
way petrol to get us on the highway here
I'm gonna have to do the lane changes so
open toilet itself can do lane changes
but the reason we don't support it is
because we don't have a safe way of
knowing whether your blind spot is clear
the phone only has one forward facing
camera disengage our website is kamidana
high for that question and what's on the
Best Buy shopping list what is the best
buy shopping list well so let's just say
the press is coming by on Wednesday and
Thursday so we're getting them know so
the law for most states just states that
you have to have two mirrors I can see
behind the vehicle and I have them
they're called my left there and my
right now
-
oh if you've already found the blind
spot messages well uh let's talk do we
have any tech components
not really no I mean I figured we'll
start to see them soon once everyone
figures out how often this ideas but I'm
so getting off Sara Monty Boulevard 47
article
forget it 47 I will show you guys in the
parking lot well right now if your car
has Lane keep assist and adaptive cruise
control it's a good bat that it's
compatible I was actually the hardest
time again for Oakland pilot to because
the Sun is so low in the sky doing
pretty well
people think nighttime is hard item is
actually easier than daytime because
there's so much contrast between the
lane lines and everything else now the
machine learning goes to our trailer do
we think kids are short-term business
yeah I mean eventually you know I think
about I think about like a serious
satellite radio right it used to be that
you would buy a radio and put it in your
car then it just started to get included
with all the cars some of them by the
manufacturer but some of them at the
dealership
so the path forward for kamma about
working with car manufacturers is
impossible these companies are dinosaurs
now working with dealerships is a whole
lot more possible so we expect that a
lot of cars you buy will have self-drive
capabilities pre-installed but maybe not
from the manufacturer
getting a lot of good shots you know
they know I'm not doing anything right
there's a self-driving car you know
we're not just periscope with me shipped
on put your feet higher up so you can
see yeah you can see what the yeah so we
sat at 70 miles an hour now we're going
48 because it's broski in front of me in
slow
are you gonna work on left right turn
season 2017 Kristensen as partners
yes
Tech stop signs and speed limits we
don't have to detect a speed limits or
stop signs you know what they are right
so as long as you know where the car is
you know what to do a red light you have
to just detect whether they're red or
green not necessarily I ever thought of
taking about my approach and licensing
Oh mobilize seems more concerned with
how many units they sell and less
concerned with the quality of those
units I'm a lot more concerned to the
quality of the units
one point two miles
they're stoked I mean we're fun that's
sort of the way it is like to say Toyota
wanted to put this in their cars or say
we're in a Honda say Honda wanted to put
this in their cars we'd be happy to give
it to Honda under the same terms we'd
give it to any individual which is right
now if Honda would like to use this it's
free Honda could literally ship their
cars with this stuff for free and it way
better than their system it's gonna do a
lane change here without disengaging
I'll show you what it does so I have my
blinker on I'm just gonna turn I'm gonna
let go of the wheel here it's gonna pull
me right back and point what do you do
with the shipper data we make maps and
train so technical
are you the creator yep sure
we have cutting everything to see a
thing
garbage
that's a John Daly Bulevar oh don't you
see I have notice this one all right
very cool let's go that way car when we
have auto lien change like Tesla as soon
as we're in cars that have the right
sensor so Tesla's using the ultrasonics
for that which is a little bit sketchy
but for example the Prius we actually
shipped a 6% increase to torque in the
in the latest version co-pilot you know
a little bit more than highway it's
obviously very good at highways but um
for this kind of stuff like on south and
north
yeah the limit is six minutes before
yeah best part as far as pies not that
far we drove a little bit extra for the
for the good folks on the
yeah I mean soon maybe even before we
ship ride like the stop signs will ship
navigation built in to open violent
she'll be able to type in your
destination and even if it can't make a
turn it will tell you we're starting to
need to take it we'll be able to make
some turns when there's like a fork in
the road it'll be able to choose Ken
McGann's be used to generate driving
data reducing the need to
you can't you again expert you want come
work build me some good cans some
whoppers a PK oh let's get Walker's love
BK we do well at Best Buy we get some
whoppers do you still use the CNN
architecture that you polish on github
last year no we never use that
architecture man that was that was just
some research code not by an intern our
architecture is not public but you can
reverse-engineer the vision deep on air
we ship with open file this is me
driving so yeah yes of course if you
have a supportive car which right now is
only the Honda Civic see that turn is
diamond
yeah so the Civic support stop-and-go
it'sit's just a limitation of how you
control the gas on the car
so our ILX actually supports stop and go
even though it doesn't by the
manufacturer because we built a gas
pedal interceptor and maybe we'll
release instructions about how to do
that
the codes already notice a single lane
support they're asking women single I'm
sure if you're like a one lane road so
wow the most people came on favorite
American people care about Best Buy you
want a live stream best buy two people
have asked that a large investor install
parking can make slow turns yeah I mean
you can't make it can't put a lot of
torque in the wheel so if you gotta like
really turn the wheel basically anything
you can do with a finger it can do where
are we single lane markings not singling
oh yeah
show us how to shop George show you had
a sharp show you livestream Best Buy
today gas price not gonna stop me
alright alright alright let's let's do
you have people all right let's
livestream Best Buy let's see if we
start to get a lot of drop-off well I'll
leave but so I'll reveal what we're
doing we're gonna buy some big-screen
televisions to show off our analytics to
the press we have some awesome analytics
now we have like big maps of where all
our users are and stuff so I'm gonna
show this all off to the press when they
come by Wednesday or Thursday for our
launch which will be available for sale
on Friday follow us on Twitter I'll show
you a little bit about how installation
works right so on this Civic I remove
the rear view mirror I can't encourage
you to do this because the Ruby mirror
is considered a safety feature here so
we actually encourage people now to use
a GoPro mount and mount it underneath
but if you do individually decide to do
this we believe it is legal so this
isn't new so you can see this is running
base UI here this is an internal
internal build not as good as the
external builds that we actually um so
these are like all my previous drives so
I can go through and I can see them on
here let's see what they look like this
is a little slow because we're actually
restricting this app to one core because
we leave the rest of the cores available
for the self-driving system but now that
it's clearly not self-driving it should
be able to use more I'm so I can kind of
you know pan through my route here this
is all in the cloud so you don't have to
worry about storage space on the device
you can see the little car icon is no
because we're not connected to a car but
um yes this was a drive looks like
someone went to the airport I don't
always drive this car this cars
available to our employees so yeah that
we're going to Best Buy we really were
self driving y'all missed it I don't
think we should show up we'll come back
we're coming back
on the way home and periscope that too
yeah baby so what we bought yes it's
it's exhausted I love Best Buy and I
don't like ant show off all my
enthusiasm parents let's go through this
so this is a common neo we built it
are the instructions are available for
free at our github github.com slash
comma AI also you can buy them from to
third parties have sprung up and set up
little neo sale shops um they usually
include this cable which goes from this
rj45 it's not Ethernet it has two can
buses on it and power to this Jie
connector which is how you plug into the
Honda alright so if this was a new car
whatever rearview mirror and I will
cover here you just pop off this cover
this plug is usually plugged in to this
thing here so this is the stalk self
driving system in the Honda you know
some people say that your sting only
supports the same stuff as the stock
here's what I encourage you to do buy a
Honda
try this talk and if you're happy with
that you don't need our stuff like a
little cute camera it's got easy links
Zink FPGA inside of it we used to call
it the mobile I actually did not have a
mobile ID chip in it um so we shouldn't
what's the word libel eyes mobile
acquired for a lot of money if that was
their goal then you know judge people by
their own goals so yeah this is the
stock system and you see that our thing
has the same connector as the stock
system so let's put that back in there
you don't even have to remove it you
just leave it unplug this one wire like
just one wire into here take this wire
plug it in Junio remove your rear view
mirror that's done with one screw all
right but I can't tell you to do that um
and then just slide on like this and you
are good oh this is a J connector we
bought off of digi-key um you can find
other connectors on dookey yeah if you
wanna know where we get the aquarii get
the equipment what equipment they're
saying where'd we get all the equipment
like this thing yeah so the plans for
this are available on our gear
you can also buy them for a few third
parties but a lot of it you gotta make
you know this is still this is still all
very early we were talking about selling
a product last year we announced it but
then you know for for regulatory reasons
and for you know we just couldn't
provide a true consumer product so we're
like let's go the hobbyist route it's
kind of like oculus let's ship some
things that are a whole lot more like
development kits and then let's work up
to an eventual consumer product now the
kind of thing soccer moms can use we
will be back we will be will be back
well we won't be that quick I love best
oh and bobbers and watch him eating a
whopper while the car drives sob does
the point if you join if you join when
we parked you will see a self-driving
yeah well you can just go back and you
can see
what up for us has it in a bit let me
get on the Twitter here it is it is
Skokie Saturday today yo oh I have three
messages on Twitter
hi sir can you teach me how to hack in a
blink this is actually a
that's the person by putting your name
but like hi sir
can you teach me how to hack what is
this crap on hack man I'm the head of
research I do research be reseller of
your product you buy and we'll sell you
we we email support that's how we have
bulk discounts you guys know that right
we have bulk discounts so I have not
social engineer teach you how to hack
EPS well okay guys yeah I'm promoting
them how to research now
inventory we have 2764 Yeon's left this
is how much eons we have if we could
sell them right here on this periscope I
would be blown away by the power of the
comic community the other thing that
we'd like to do on this periscope is you
see this for 9:00 to 3:00 could that get
to 5,000 could you and tell your friends
5,000 okay so I don't know what to talk
about anymore because I'm not a CEO but
I do have some ideas we're gonna talk
about two things today we're gonna talk
one about bubbles and about by the way
you guys know that we are um open
sourcing the maps by the end of the year
maybe maybe yeah hang on hang on hang on
let me just let me just check out
something quick yo Andy you got a map we
could show this go peace do you get time
bring something up in like 20 minutes
all right cool all right so we're gonna
have a map for you guys but later and
that's only if we reach one of our goals
which is either 5,000 slack users or all
27 yon salt and we'll show you guys a
map but here's what we're gonna talk
about today we're gonna talk about balls
so let's erase this board because you
know there's secrets
Arkana AI research right so
let's not but we're here to talk about
bubbles today so let's talk about
bubbles right so you have a mapping
company right that so you have a mapping
company and so you have a lidar company
right these companies are all supposed
to feed into self-driving car companies
right say like fleet operators so you
know you have mapping lidar self-driving
car right but here's the problem with
this kind of stuff where do these people
get money where do the light our
companies and the mapping companies get
money maybe maybe we'll draw the arrow
the way the money to us right so the
arrows represent money so the money goes
from the self-driving car companies to
the mapping and the lidar companies but
the problem is this all of this money
this is the bubble all of this money
comes from VCS right so you have VCS or
in the case of way more Google funding
the self-driving car companies which
then pay out the lidar in the mapping
companies right so the light on the
mapping companies can register large
amounts of sales so they can increase
their evaluation in order to funnel
money back to the VCS right so here's
the problem right over here you have
consumers and consumers in our
neoliberal society is where wealth comes
from but consumers don't buy line our
consumers don't buy maps and aside from
us and Tesla consumers don't buy
self-driving cars so there's no arrow
connecting the consumers to this bowl so
this is a bubble it's just literally
companies passing VC money around um no
the cool thing about this is you have
this thing called fractional reserve
banking and the way fractional reserve
banking works is like this okay and this
is a real thing
the banking system I don't know if you
guys know about it or not but if I'm Bob
and I have $10,000 I deposit $10,000
into my bank account right so Bob
$10,000 into account the bank can
actually lend out my $10,000 up to a
certain amount so let's say it's
actually pretty high I think they
actually have to keep like 10% of cash
reserves on hand so Bob can lend out
9,000 of my $10,000 to you boy Carl
but then Carl can open an account you
know what let me do this in a different
color because this is nine thousand
dollars of debt
right this is nine thousand dollars of
debt Carl can open an account and fund
that account with the nine thousand
dollars do you guys see the problem
what's the total summoning accounts it's
19 thousand dollars but only ten
thousand dollars of real value was put
into the bank I don't know about Carl I
don't think we should marginalize Carl
like that but all I'm saying is this
kind of shit is unsustainable
right this is the self-driving car bomb
consumers are over here now there's this
hypothetical line which will draw on
yellow that talks about ride-sharing but
I don't see ride-sharing ever
well not ever but like in the next ten
years being able to compete will remain
[Music]
so now the bank will write it in yellow
since it's just as fake as the consumers
and the ride-sharing the bank has
$19,000 except they really only got
$10,000 in do you see how this works
it's the exact same scam that's being
perpetuated here vc is invest in a
self-driving car company the
self-driving car company predicts that
there will be demand for 1 million lai
dollars so they put in a
pathetic Elora for 1 million line ours
then the lidar company valuation goes up
then the VCS report back to their of
course you know VCS are just middlemen
they report back to their LPS that they
made a lot of money but they didn't
actually make any money because this is
a closed system if you guys study
physics you know about energy you know
about closed systems right um oh I could
show you guys something crazy today I'm
really tempted to do it you know you
know really no no no no no what I could
do I'm not going to do it um but this is
a cell phone so have we sold any Young's
have we sold any yawns we're 27 come on
come on guys buy heels who's bienniums
do we sell the Aeons see oh it's
refreshing it's refreshing her slack
coming if you tell your friends to get
it no we have 27 left you tell your
friends also to get into our slack tell
everybody join our slack should we post
this on Twitter let's post this on
Twitter you guys can watch me while I
use the computer I also have a pure leaf
tea for the purest leaves of tea what
are we working on well we made new model
we have new model now a new model should
be shipping pretty soon but we have
peoples in our slack you can be you can
still be in the first 5,000 people to
join if you join today and historic
opportunity opportunity and now let's
include the link is it a historic or an
historic slack hamadan a I
all right let's look at my tweet
oh we can look at me on periscope which
I don't even know how that works man
all right but back to bubble economics
Oh Oh Maps Devcon without life Oh Oh
guys what we have something for you
today
no but guys honestly if we don't even
sell money on I'm not showing you the
maps someone's got to go out if
someone's got a buy anymore oh wow oh
wow these maps like hardcore wow that
looks too good I'm not showing it to you
because nobody bought the Aeons or if we
can get five thousand people who are
slapped this is doable you guys the map
is sick but you know we can't do it cuz
cuz no bond Yeon's yet today use your
fur coat is for all right guys but see
the problem here
this line is yellow and will remain
yellow for ten years VC's don't think on
a ten year I thought that the thing you
know when you could see them out VC's
don't think on a ten year time frame so
here's the question that I ask to all of
you guys when will Weibo go out of
business
well way mo let's say die alright like
how much money is Google willing to dump
into way mo for some hypothetical future
profitability that just doesn't make
that much sense so we have women new CEO
around here I'm a CEO anymore I'm George
I've had a research and had a bubble
speculation shit and the new CEO started
making charts of company financials and
I'm amazed by this cuz I never did this
I was a terrible CEO um and it turns out
you can like predict in the future how
much money your company's gonna have now
I wonder who's doing this for whele now
some of these companies are straight-up
scams some of these companies I think
are straight-up scams and then here's
another thing guys here's another thing
about you know you know if you're ever
thinking of starting a company I know I
tell you not to but but here's something
to think about
don't raise a lot of money because if
you end up in a place like Zuke's you're
worth nothing
right think of a house that has a huge
mortgage on it and then the housing
market goes down your house is literally
worth nothing even if you put money into
that mortgage right so when you raise
too much money when you take out to
larger to mortgage your property can
literally go to zero but if you manage
to do everything with little money you
don't come my eyes raised a point 1
million dollars it's pretty easy to make
man that kind of money falls out of
trees
um but yeah back to my point so
here's an interesting thing if there's
no way that money gets into this bubble
by consumers because consumers aren't
buying light our consumers aren't buying
maps oh now you have some new one
awesome new one I can't believe I'm not
gonna name any names of stupid B C's but
someone invested in a simulation company
this is unbelievable
right um and the companies like voyage
you know so boys you know guys no voyage
I'm really gonna call voyage out about
this because voyages let's look at
voyage guys by the way I'll also show
you the maps but someone's gotta buy
Aeons or join our slack oh we got we got
four people in our slack our slack is up
to four nine twelve hundred to nine yeah
okay you guys keep making that go up we
get that up to 5,000 I will show you the
maps but we got to get that up to 5,000
how's are we on sales coming we have a
cool live view here don't we we have
live view live there we go you guys are
quiet today we have one visitor right
now I hope they're buying in a line
because if they buy yards by your yard
today oh I can't show you that well
that's too good that's too good all
right um what did I want to show you oh
yeah voyage okay so another voyage it
was a great Star Trek though so voyage
oh wow they actually got to the first
for all voyage come on
so voyage partners with everybody
they're buying all this crappy
technology from every company where
where do they have press ENTER wow this
is a nice website man well how this cost
a lot of VC money man let's look at
voyage I'm CrunchBase and let's see how
much money there right so boy isn't one
of these companies that makes everybody
happy in the self-driving car world what
operating system is Linux with exponent
so voyage histories don't that's not
that much money actually they've only
raised their only raise that 20 million
dollars okay well can't show you that
that was too much you go see your
community do some cool things I go up on
autonomous safety you know anyone who's
open I'm always happy with uhm but
here's the problem right so voyage gets
ten million dollars here twenty million
dollars here and then partners with
every company and distributes the money
to these other companies but like this
isn't sustainable as long as there's no
dashed line so let me tell you about the
common business model gears come up here
we take money from VCS then we take
money from consumers and then we don't
work with anybody else and then
eventually we take more money from the
consumers than we took from the VCS and
we pay the B C's back you see how that
works why is the Maps page on oh well we
couldn't see maps but guys we got to get
to Oh what are we up to in slack for
three nine two four three nine two guys
you just gotta get in sixty eight more
people you get sixty eight more people
in slack I'll show you guys the maps
someday we'll do a Twitter Twitter or
follow a thon - let's see I was a
terrible CEO yeah of course man yeah
I'll heart that let's heart that that's
true all right
Tesla how's mom how's elan doing man
what I'm telling you though you don't
pay a return percentage to VCS it's all
it's all a scam it's all like I can talk
more really about how the Silicon Valley
scam works
you don't actually ever have to pay the
VC's back technically um the VC is are
kind of like a crack dealer they give
you good terms at the beginning you
build this unsustainable thing and then
they end up getting control of it
this little aduba right so how did you
how to trap
from nothing how does he how does he
lose how does he lose control and it's
because he built something as amazing as
it was and how much it did for the world
it was unsustainable so the VC sink
their claws in they get bored seeds they
get majority shareholder and then wow
that's the end of your company right
I'm sinking to avoid these things but
these things are pretty easy to avoid if
you understand what the scam is these
things may not even care if you
understand what the scam is because the
whole VC business model is predicated on
you know 95% of their investments
failing and then the success of 5% is
what drives the rest of it
so the VCS at , the VC don't 17% of the
company so there's 17 percent
shareholder so another thing for you
guys to know it is to clap there's
preferred stock and common stock so the
VCS have preferred stock and employees
and founders have common stock this is
very common at companies um so what
preferred stock has a few advantages but
one of the great things that actually
helps with the whole preferred stock
scam is your foreign na valuations
so the 409a valuation the evaluation
which you can grant options at is valued
on common stock you know what appalled
that I learned all this crap get in here
join the kulluk why should you you
should I'm get in here join the comment
I slack if you get up to 5,000 I will
show you well I'm looking at comma Maps
right now damn these look pretty good
Wow and parts of it could be better well
but no that's dense pros that's dense
well we can't look at until we get to
5,000 people or we said let's say 70 on
70 owns is a good number that's actually
a feasible thing can we sell 70 OS come
on 5k let's do it let's do a 5k and I
slack I like that number it's a good
number right yo user growth you guys we
have taken 300 we've smashed beyond
that we're trying to get to a thousand
by the end of the year that would be
some crazy shit
eons are $6.99 we used to have midnight
black eons which were eight twenty nine
but midnight black healings are sold out
never to be made again yeah so that's a
true thing radians but okay so
about bubble economics do you see what I
mean if there's no revenue stream from
consumers how all of these companies can
exist in this self-perpetuating business
development loop where they all spend VC
money on each other and that it's like
fractional reserve banking and then like
the VCS can talk about how they have
more value than they started with
without ever creating any value right
you know just like the Bob remember Bob
deposited ten thousand dollars into a
bank account the bank whelmed nine
thousand dollars to car who then
deposited that nine thousand dollars
into account now the bank has 19
thousand dollars when you sum up all of
its accounts but clearly well so is the
bubble going to burst I mean this is an
interesting question
so despite knowing this and despite
everybody knowing this you can't really
say when the bubble is going to burst
right if you could know this you could
make money that depends on what form of
the the efficient market hypothesis you
believe but um yeah yeah yeah yeah well
I'll tell you guys Esther this is
okay this is where we train our models
the new model that's going in the car is
this one here this is this is the
fine-tuning training but look at this
crazy loss negative 3.07 talking to you
perhaps a joke you guys um when google
just wouldn't Google just say you can't
load that snaps are ready yet but no no
if we can get if we can get to five
fifty five thousand users or seventy on
sales but we have no Aeon sells yeah
come on people come on the Saturday is a
rough day for young sales I do like this
number of I do like that up everyone
likes their graphic it was not a sale
was that a sale oh I don't know um been
following your career I don't know the
career that's kind of a lofty way to
describe it a view in self-driving for
the safety of everyone or are you
motivated by you know this is like a
Stalin thing man like Stalin's always
about your motivations right like your
actions don't even matter we just got a
look at you oh we have one visitor right
now look at that one one visitor yeah
visitor Oh visitor all right come visit
our shop shop comma dot ai you can buy
things on it please buy things we love
when you buy things cuz we're a company
that tries to make money you know we're
not like but not like scammed you know
scam just tries to take money from from
other people we try to make money we try
to create value come AI not scam um is
there any accidents with comma not gonna
know them we should there should be some
um it's surprising that there's not oh
oh you know what I will show you guys
something else too that we just thinks
crazy
open about this stuff oh wow well I look
at how much miles were up to there's so
much violence there's so much - that's
crazy
wait but we were looking at something
else okay I don't know where it is right
now but we did some we did some looking
into our data
you guys keep open pilot engaged for
over 50% of the miles it's really good
um that's one of the metrics that we
started tracking we want to go up we
want to increase your engage time on
drives you know we want to drive down
this engagements but we also want to
really well you really want to do we
really want to do with already on and
all future products they're kind of like
eons is make value for you and I said
but I say we we're Reese I'm research ok
so eliminate York so that's the other
thing that we're gonna talk about a
little bit today and then if we can get
our slack up - oh come on people you
gotta joined you gotta join the kama
channel and slack we're up for no I'm
3-3 just 67 more to go we're gonna keep
this scope be going if all 77 of you
you're probably all in slack already if
you all get one friend to join our slack
go on AOL Instant Messenger go on IRC go
on ICQ I don't know what the kids are
using these days but get them into the
commenting I slack it's a big party it's
the most lip party on the Internet
I don't like talking like Logan Paul
anymore that guy's a loser
fuck the KS I fight you're not on slack
go to slack combat AI um me I hate my
friends - I think I don't know that
feels
I know those feels alright let's check
our Twitter notifications I love
checking my Twitter notifications I was
a terrible CEO I liked that alright
Jerry Lewis who's Jerry Lewis is related
to Jerry Seinfeld or Ray Charles the
blind guy I saw some documentary about
that guy would you want my dad's
trucking business start logging my
it's not really alright we'll let me in
on a secret
y'all love when I reveal secrets we got
too much miles training the model is not
trained on all the miles um we have too
much miles
we have 5.6 million miles and that's a
lot of cloud money in order to process
all those miles drop slack and use
discord no no no no no no no no that's a
bad topic that's a bad ought to four
nine three five guys you know what I'm
doing after this scoping I'm getting
pancakes yo listen to the Mac Lethal
song about pancakes wait wait no no this
isn't degenerating into the same
bullshit I do on Twitch
by the way follow me on Twitter switched
off slash Tom Cruise that's Tom Cruise
at 2 0 & 1 3 yes right you'll find it
dude hook it up no no no that shit looks
like some pancakes right
waffles trumping yeah I couldn't do
waffles I could but you'd get one waffle
you get three pancakes okay um what you
want to talk about the research agenda
let's talk about the research agenda
since we are coming I research we hired
someone well he hasn't signed the offer
yet but if he comes on board we're very
very excited that would make comma
research three people so you guys know
us me it's Harold and then it's new guy
and new guy remember the old machine
learning engineer new guy is old machine
learning engineer doesn't work here
anymore
I'm machine learning engineer right now
but new guy is the best machine learning
engineer I know real shit
so we'll talk about our research agenda
oh you have an accident what happened
are you trolling of I always put post
and slack we'd be interested especially
if the system was engaged I'm sure the
way you smirks it couldn't have been
that bad so here's the truth about car
accidents guys so we're at yeah we're
always hiring good engineers we're at
5.6 million miles
humans get into accidents about once
every 100,000 miles so we should
actually have 56 accidents at our data
set yeah guy back then do you know but
like like this is the kind of bullshit
most accidents really aren't bad um and
I think that hundred-thousand only
includes accidents where there are
insurance claims or police reports I
think there's a whole lot of accidents
that are just like you know tiny bumps
and everyone gets out my car my car
alright everything's fine let's go um no
but I don't think those accidents don't
count I don't know what the numbers are
on those but I think it's about every
hundred thousand for like you know
accidents usually would nobody's hurt
it's just like dude you really messed my
car you gotta buy me new headlight right
now Americans really keep their cars
pristine you go to other countries in
the concert like beat up some countries
not all countries at all minta you are
great what happened yo Ronald you watch
ten our twitch slam yeah I don't know
ma'am I did that shit alright so let's
talk about our research agenda
for nine three eight sorry it's hard for
me to read numbers um if everybody could
get just 62 more people into our slack
we will be super happy with you guys you
guys no one's born yet then we gotta we
gotta buy yarns you got a body on fire
yes bye you guys bye yawns yo you know
what you know what told me recently the
Carter five who thought the Carter five
was gonna okay sorry this is twit shit
man this is twin shit we can't do twit
shit all
you know I come on everyone just get 61
more people in here we need more slack
users so we can unlock the slack 5k gold
package and then we will click on this
tab right here that says comma Maps
you've all seen some stuff
all right who's messaging me on slack
sorry you're getting out it no I won't
oh oh yeah of course this is public on
YouTube
I guess you paused it now let's watch
let's watch an accident with open pilot
I hope this insurance paid for it as
long as we keep all the accidents we
have to accidents like that we can all
laugh and be amused tad out at that well
it's clearly not comma issue yeah it's
not like you went reverse slow do I
actually type that fast nice I have a
production team they edit it and post
you know yeah you do everything with
editing these days Saul fakers
these copies are all scripted too you
know we got script writers that's really
like I tell you guys we got hundreds of
employees that come AI most-most script
writers for the periscopes the script
writers wanted to acknowledge themselves
and that's why they put this line in the
script that's too much all right let's
look at how much uses we have do we have
users Oh
41 keep it going keep it going
by the way big shout out to
it is j4x right forget an OPC a IAP this
is a unofficial open pilot community oh
it's loading there we go like you can
check out your car you can see if your
vehicle's supported you see if have a
chrysler pacifica any videos of this one
oh it's hard that I need to sign in and
see videos well you need a bigger box
yeah Prius prime okay let's talk about
our research agenda so you guys know who
knows with the original sin of comma a
is does anyone know when lagging it's
gonna lag but supposed to simulator
lanes lanes are the original set of
comma AI so we want to remove lanes from
the model and you think if you remove
lanes in the model how is it going to
keep driving on the highway um it'll
look fine the problem with lanes is you
have to ground through the flames and
it's unclear what the definition of a
lane is so by using more sophisticated
machine learning techniques we can
remove the necessity to ground truth
lanes in our data set and we can move to
path we really want our models to output
a path of the car and then you can turn
the path into trajectory using MPC so
what's the second sin of Khamenei I I
don't think I've ever talked about the
second sin of comma a I publicly but
they're really pieces of shit and
they've been responsible for god knows
how many deaths you know a few a few
deaths I can think of few auto pilot
deaths the radars so the car radars
are garbage and the reason the car
radars are garbage is because they give
you back objects they don't give you
we're all information and all the
cameras which give you pictures they
give you post-process cars but on the
radar you can't tell the difference
between a car and a manhole cover or a
car a stopped car versus manhole right
and if you remember the so you guys have
seen this at home I mean ours isn't very
good at it at all the when you're coming
up sometime behind a stopped car
sometimes it will stop but sometimes it
won't it's all about whether the vision
fusion triggers so you can look at
things like Tesla autopilot remember if
you remember the truck accident or the
divider accident both the truck and the
divider were very visible to the radar
but they were classified to be more like
manholes than stopped cars you can't
tell the radar doesn't give you any
indication of height so what I want to
do is do away with the radar and do away
with the concept of cars entirely like
right now we have this thing called lead
car but I want it to go away and I
wanted to just be implicit in the day so
the new guy doesn't know yet but these
are gonna be these are gonna be his
bonuses these are gonna be his his his
bonuses if car may I research can
deliver models test those one radar as
far as I know it's a Bosch mr R if he
could deliver this kind of stuff you
know we're all here this is what we're
all here to support because if we can
build models that just output paths and
speeds that shit scales to level four
bros i don't play CDF's anymore
i got it got it got formulaic like she
gets used to be cool and then like it
turned into like chess to Starcraft or
you just have like grind openings I'm
not grinding but there's a great little
main song called on it but this is not
twitch so we're not gonna play it let's
see how much people we got in slack oh
four nine four nine you could do that
you could do that you could do that
let's get 51 more people in this slack
and then we will show you the map we
have to do it in the hour - so we guys I
gotta we got to really accelerate this
we got
25 minutes before I'm leaving to go get
pancakes so we got to get we've got to
get more people in the slack or we got
to sell 70 yawns have we sold who'd buy
neons thing no one's by any aunts today
oh I want Peggy Sue I'm talking about
right I want some real syrup on my
pancakes I'm gonna look at the maps you
guys can watch me while I look at the
maps you know didn't like shkreli do
this on his live streams you put the
headphones in and be like yeah I'm
shkreli I'm listening to the Carter 5
and you're not no Scully shit okay cuz
you sick kamikaze was sick
kill shot then you know you got it this
is something that gives me hope for the
world I listen to revival uh you know
Eminem's like just just angry like DISA
Trump and it's like oh man this guy's
over like this guy's like what he's
trying he's trying to bake the president
he's coming out with a shit album oh my
god he comes out of nowhere with
kamikaze with with with like like
something people can relate to
um and then he did kill shot Eminem
Eminem has blown me away recently
so Eminem gives me hope for doing good
shit when I'm 45 um yeah man I rather be
80 year old me than 20 year old you what
this bro it's taking eons for someone to
buy any yeah no I don't know they don't
sell us mall on the weekends you guys
know what the number-one sales day for
Young says Mondays more people buying
eons on Mondays than any other day what
lies you want you know we'll wrap these
like these are official comedy ice
copies how's life in Silicon Valley
comes shit so kind of I kind of sucks
guy's a vest real shit
oh oh no yo I got something like youth
group from Princeton come and visit me
and they want to hear about
entrepreneurship I would tell them the
truth that's right that's right you'll
tell them the truth
Ben they're full of thieves where was
these to you so we got to remove lanes
and we got to remove lied ours we're not
here to make any kids cry we love the
kids we are here all the kids the
Princeton kids yo man make college kids
they 18 they ain't kids they got to
handle the truth man everyone talks
about the truth like it just sucks it
just sucks like don't start a company
it's not it's not worth it no actually
here's what I'm really gonna say right
I'm gonna get into why they want to do
it right I'm gonna get into why why they
want to start a company and if it's like
some like vague feel good like I want to
make the world better shit that's not
gonna motivate you that's not gonna keep
you motivated to do anything all right
like they talk about how it is but you
know these people all they think they
burn out there it's just it's it's
signaling right and if they're trying to
be an entrepreneur to signal I'm really
gonna talk them out of it but if they
actually know things well then you know
if you know things you know sorry you
know we get to do you know what you're
talking about I really like when people
know things finding people know things
is hard I've been happy I've been I've
been doing research for the last two
weeks and I've been like I've been
thinking of like you know all my all my
old machine learning stuff I learned um
do you need more cameras not really I'm
not sure why you think you do this is
this is a topic that would come up a lot
if you want to change lanes you do but
like lane change is a gimmick
lane change is more of a gimmick than
red lights two stop signs um because
what else should you do if you don't
want to start a company to be honest
like don't go certainly don't go work
for a big company the truth is if you
want to be happy in life um find passive
income streams like it's very easy in
the world today if you're a bit smart to
make enough
money to live you know you're not gonna
be the supportive family you're not
gonna support some like stupid
consumption habit of yours whether it's
like drugs or handbags or you know nice
clothes or anything like that if you
don't have any of those habits you know
inexpensive vices you can easily get a
passive income stream that will support
living don't live in rip-off cities like
San Francisco in New York either like
there's great places especially around
the world where you can live be what
musk I don't think he started SpaceX to
help humanity I think he wants to go to
Mars and I think he found a way to get
other people to pay for it which is
brilliant yeah he wants to go to Mars
he's got quite it's great that's the
classic healing let's go on a dying boy
it's not on impact there's a modernist
you know he wants to die post martyrs
that would die
he doesn't wanna die but like he accepts
the natural lifespan of humans and you
know but she's aspires type of modernist
things like if you think of Elan
fantasies or anything reading one closes
his mind and closes his eyes he thinks
about like a Giga Factory in the middle
of Nevada and sharp corners are improved
in the new model sharp corners are not a
limitation of the current camera really
you can anything the car can do you can
you can see with the current camera
maybe not like a 90 degree turn
but 90 degree turns ro42 go 40 to go
guys we got 20 minutes and 40 to go that
means we need to see to come in every
minute or we're gonna we're gonna cut
the scope e and we're we're we're not
going to show you the maps but if we
manage to get in 40 people by the time
that little counter hits hits one hour
we will show you guys yes we need this
growth we need growth man growth I'm I'm
here um chief shilling officer now and
we need growth love growth
growth fixes all problems ma'am
you can have the most shit as backward
government but if you can show the
people growth
people love fro 6161
oh no the guy says Elon you're gonna
come on that moon trip I think the first
things he thinks is shit the rocket
won't blow up the Japanese guy about
like I'm so grave you know you're so
brave for doing this yeah yeah brave guy
Brad guy and like it's not like it's not
like really brave in the face of like
nature it's not I do like trying to
cross the darién gap I'm like a student
talking about like he wants literally
the guy who has more control than
anybody over to say get that rocket yeah
we should we should do a test
we should not yeah I think we should
test it first before we put the people
in it yeah that sounds like a good idea
whoa I don't want to hear any distance
of the Japanese guy that guy is look BAM
he's not building rockets but think of
what like what's Warren Buffett doing
with his money Bill Gates says these
like vaguely charitable enterprises but
like are more billionaires should be
spending their money on art man we got
some sick art in the world
if I'm ever a billionaire mark my words
mark my words guys if I remember a
billionaire I want you to tell me hey
George remember that time you said you
were gonna spend it on art and I'm gonna
spend it on our cuz that's the only
thing that makes life worth living man
you know it doesn't make life worth
living grinding capital is a Maalik
bullshit
62 words 62 the growth rates right now
we're 2 / 1 / 2 minutes and that's not
high enough to show you guys the maps
you put a motor to turn the wheel yeah
there's a motor on it yeah right I don't
know man things are changing all the old
things I used to say are played out of
rockets alright yeah kind of
I think a lot of technologies are but
yeah so just so you guys know about the
bubble scam does ever know about the
bubble scam
Admiral retro who's in these periscopes
but like you know when friends ask you
when when people ask you like you know
about the self-driving car space unless
the worst is our self-driving cars
they're the biggest they're just the
biggest way motions you've ever seen um
so this was the question I wrote on the
board earlier in the scope II when will
way mode I like when is good luck and be
like well I mean the outlay of cash to
achieve the expansion we want with why
why did joining our slack not work 66
guys we're getting growth we're getting
girls just just just 34 more people or
the major interstates mapped just like
the human genome project mapping is
going to be very nonlinear you know we
don't talk about percentage we talk
about how much good stuff we have the
link is slack comedy I please join our
slack welcome to the slack shilla thon
thon this is worse than a PBS telethon
man I guess this is an expensive
purchase you guys aren't going to
impulse buy it all right guys let's do
something crazy who else to do something
crazy I'm doing this with no authority
who wants to do a $20 coupon on Elance
should we do it 21
$20 coupon should we do it $20 20 off
let's do it let's do it
only for the remainder of this periscope
let's see if we get anybody to do it
create discount go be 20 discount fix
them out $20 apply the specific products
Eon dash cam dev kit and applies once
per order active for today we're gonna
turn this off after the periscope stops
just just guys I'm pasting Lincoln slack
scope e20 scope you two are $50 $50 off
three 250 all right guys let's go crazy
let's go crazy let's go crazy scope e-50
let's do it let's do sculpey 50
let's just go to 50 if I get in trouble
for this then you know promote get
shareable link
let's do Skokie 50 no wait wait wait
wait wait no that's not copy link oh
yeah that's copy 50 $50 off if you buy
it during this scope $50 off that's
right only for this sculpey who's right
now to buy any on change your life I
don't know about that man we're not
gonna show that hard but it is $50 off
if you buy it
during this periscope but I don't think
I don't know man
you know what sells just saw a strong on
Saturdays so getting right now $50 yo
let's go be 50 no wait guys we might
actually do it with slack for 972 we got
to get 28 more people take it you know
we don't take tripped up is anybody
gonna use the $50 off crazyyy on coupon
shit's crazy
we can never lowered the price on eons
before you can get it off $50 off right
now you do it right now we added up the
discount just the discount code is scope
e 50 scope e 50
when and what is the next release so
next release all I know because I work
in research is we're gonna have new
model so we're gonna have new model a
new model is a lot tighter you'll see it
when you'll see what you see it people
on slack know we're going for 5,000
people on slack so what we need we need
27 more people you guys can do it you
got you got ten minutes twenty seven
more people scope e50 get in by your
yarn scope e 50 will this beg ah to
marry you puts it in a new account so
yeah I mean so no like I think you
actually can I think you much she can do
that yeah I think you can I don't know
what the laws are up fractional reserve
banking but yeah yeah let's let's just
give it a Mary - um wait for $50 no it
is $50 guys it is $50 right now if you
buy I don't know this is an experiment
I'm not sure we're gonna get sales we'll
see I don't know who's in here right now
gotta buy it right now
during the scope e but the outstanding
orders are gonna be like I want my $50
off I don't know if we can do that yeah
buy it now Eon is 50 bucks right now 50
bucks off no not $50 right against man
oh okay okay come on come on Sally on
stellar yes sculpey 50 if you use the
code scope e 50 a check out on the
common I website will give you $50 off
the US and it doesn't work with those
you want to buy Eon with 50 bucks no you
can't buy you own with 50 bucks no 50
bitcoins you can buy you if you send me
50 bitcoins
I also need I'll send you my you check
your slack message
wait that's public hey Andy
now we're good okay guys
maps maps aren't public the some naps if
you know where to look I didn't realize
I didn't realize something was public
but uh is there a yes sir we should
hang on let's see
oh no that map doesn't have any of the
data check yo says you're just buying
the yarn did you just buy any on live
right here on the periscope dad be crazy
if you did yo we just sold the yard
what are
that's right we got one order 679
dollars
wait seven people are checking out right
now holy crap
well now this is crazy I've never seen
that number be so big he's gonna sell us
guys man
using this coupon is good well no I
don't know about that no sculpey 50 yeah
get that Gopi 50 right now the website's
not good an iPhone yeah yeah our
designers on vacation okay guys we got
to get 21 more people in here the price
is 649 that's right with scope e 50 got
the craziness discount away little wait
so how much people are checking out
right now wait zero seven seven no it's
50 off it's 50 off I listened to you
Scopus we listen um you do oh you only
have a few more minutes though well I'm
just gonna work I love when we can offer
discounts for you bros I don't know me I
might have to pay this discount
out-of-pocket cause it's not authorized
yeah no that iPhone excess max is pretty
nice though to say and yeah shipping us
30 bucks International International
shipping is 30 bucks that's true um
domestic shipping is free I wouldn't I
wouldn't charge you if I didn't get paid
some countries you have to pay more than
30 bucks to ship any on to international
shipping is scam first 5000 oh man oh
this is close sit with 16 people away
we're 16 people away do we just get we
got six visitors right now
now this is the most exciting this thing
has ever been can trump museum and I
don't know you could try Yanis for
everybody
do you have reps in Santa Monica we
don't have reps anywhere I've got 80
people checking out come on guys convert
be purchasers right now get in the first
5,000 people on slack
this is Skokie's thunder Saloth on yon
Saloth on yeah that's true Trump would
be like what is this shit I've seen
cameras on The Apprentice make better
shit than this you're fired
you'll rep Santa Monica won him
model look at this model model where's
my china models oh oh
all of them sales yo that's crazy
there's craziness one thousand three
hundred fifty eight dollars - it is
crazy
we're gonna keep this selleth ongoing
we're gonna keep this selleth ongoing
should we tweet about it now because
then people are gonna complain later
they're gonna be like I wanted the $50
off it's just for people who are
watching this periscope and who are on
our slack right now if you're thinking
about joining the comment 'i'd community
today you get $50 off Oh
moving to the moon 1300 $36 we got three
orders right now look at that crazy
trend line going up
oh we're gonna keep the Skokie going
we're gonna keep the scope ego and you
guys are gonna get to see maps even if
it goes a little past an hour that's we
got 11 more people we got to go we are
live we are live periscope get in to the
periscope join the common community has
never been a better day you can get $50
off Annie on with promo code scope e 50
yo okay
okay we got we got
I'm zero over here we got four nine nine
zero just you remember last self-driving
cars are scams and bubbles let's draw a
merry up on the board here yeah we could
do Mary that's right and now the bank
has crazy amounts of money right
we're really getting into the red here
yeah let's say this is fractional
reserve banking if you guys don't know
what it is looking off you're being
scammed Oh $20 for panty you want $20
off panda okay $20 off panda let's do it
let's do it
Panda 20 panda 20 by your pandas right
now get $20 off panda Panda 20 no just
kidding
10 of the $99 let's bring up a picture
of troll face that's dry
hey we're not lowering the price on
pandas let's not get too crazy here guys
beep Amazon Amazon and all mad okay okay
okay okay okay okay all right I was
offended by something recently and I'll
show you guys what I was offended by we
got a one star review on Panda
P X huge disappointment
worthless patrol face okay wait I'm
actually gonna do that I'm actually
gonna do that can I make a coupon create
discount discount code troll face
in here fixed amount discount value
negative $20 specific products panda
oh my god I think I just heard you guys
the stock numbers on pandas that's crazy
limit to one use per customer
that's right okay you guys know no
discount value must be greater than or
equal to zero it can we do zero
let's do zero oh yes
you can also buy pandas with discount
code trollface let's tweet about that
get zero dollars off comma AI panda with
discount code troll face wait we need a
link there we go Ling now let's get a
picture of troll face save image yep go
yup Twitter tweet downloads troll face
oh yeah
Oh yo I'm allowed to give $0 discount
get panda's all Panda wait it's not $0
today you know it's a zero dog discount
it works on both pandas you can only use
it once per cart though yo guys guys
5000 that's crazy that's crazy I love
you all thank you so much for reaching
5000 thank you for buying for aeons are
people still check it why we got seven
people checking out this is crazy this
is crazy
convert convert convert convert as long
as this keeps going will keep scope e-50
a lot as promised let's take a little
look at the maps over here right so
we've just been working on the bay
we don't have the lanes processed well
yet you can see that we are pretty good
covered to the Bay Area we have full
coverage of all the highways it looks
like it stops right here so you can see
these are all the routes now we don't
have the the stitcher task running right
now
oops but you can see that each one of
these is a frame so every single one of
these little things that you see is a
frame somewhere in our data set so like
let's look at that frame right
we have lanes here as well so let's
let's hide these for now
now unfortunately the lanes are not post
processed right now so this is just with
the gray panda as it purely is but we're
working on the script right now which is
going to merge all of this into one it's
called map zipper but that's where we
have lanes we have lanes on all the
interstates in the Bay Area and
hopefully this will be done by October
first GPS is not being used division D
yet we're going to start using GPS in
0.6 0.6 is probably going to require
gray panda so you can see like look here
we can see like what's this this rotor
look like let's click here and we can
see it load up here for that frame right
this is beautiful let's see if we got
worms
okay we have warp still oh yeah look at
these so these are all the points that
cluster in the comment
let's disable that yeah look at that
look at that 3d map of the world too big
we're suggesting the point size here
not 43 bad no three okay so this is this
is a three-dimensional map of the world
you can see this is a bridge here those
are on ramps and off ramps you can see
the how could it be 3d map with the
earth it's like guys III do have
something I'm sorry to tell you even
though we all know the earth is flat if
you make maps where it's a small
percentage of our Bay Area drives um if
if you make you like the fact that the
stream looks anything but good the truth
about maps is if you make them not flat
if you make sure if you try to make flat
maps you know you they come for you so
unfortunately we had to use the the
traditional round map we are copying
Google with around I know that Google
promotes the round propaganda and we are
on board I'm very sorry about it but our
maps are going to be based on a round
earth I will announce this right now
exclusive leaks but what do you mean the
quality is really bad so we don't have
the stitch you're running yeah the
stitcher is gonna fix a lot of this
right now we're just working on the
infrastructure to get all the routes
processed so we can stitch it like this
just know oh the quality of the
streaming quality is bad I don't know
about that
I know we're sellouts to round arts scam
Oh guys come on come on all right
anything up periscope quality's bad I'm
sorry but about small flat countries
like Holly well we only make maps of
America oh well bad about this all this
moving makes the stream look bad okay
let's make it zoom in oh we can
picture on both like a good map so this
is our map of the Bay Area and the green
is where we're gonna have Lane coverage
why not incorporate GPS and addition
division like people say things like
that where people say things like that
I'm like oh that's a brilliant idea I've
never had that idea before what if I use
the GPS in conjunction with vision yeah
we know as hard
no why have the whole world if it's just
America because it's cheaper to license
map of the whole world and my license I
mean download because you'd have to
write a script to exclude only America
my pandering panned over shit but if you
want to get zero dollars off a panda you
can use discount code 12 pays not funny
it's a part
people people
please go bees I'm not high this morning
I was gonna smoke weed this morning but
I didn't I'm gonna good mood I'm gonna
good mood this morning life's good my
high this morning I didn't have a whole
pure leaf tea and amante earlier where I
played some Jess I woke up I woke up at
like 8:00 this morning I had a Monty and
play chess
today's no it's not girlfriend day today
I'm laying off girlfriend for now I'm
out of that game you gotta focus on you
got to focus on me like why company
buses earth-dog this gate it's I'm happy
about pancakes what have to twitch maybe
we'll do twitch later girlfriend misses
me maybe she's watching Pascoe um she's
not my girlfriend
if she's watching Tasker um how did you
learn electronics and robotics when you
were young I don't even know what that
means man can you use an e on in is that
Brazil Toyota pedals company buses are
dumb today's comma a I'd a
all right guys
are those people who are checking out
right now the dis is about
one more look at the beautiful map
remember that we're gonna try to have
all the interstates done by the end of
the year look at that one no and they
were driving an auto ship go over there
we're not running the zipper right now
but that'll be that'll be fixed so thank
you thank you I'm glad you appreciate
that preview of the maps look at all
this and like you can see like the
bridges down there on the texturing but
yeah that's that's see that's that's GPS
is really bad in the high taxes who is
George Hotz
how can you learn about slam tiling I
don't know gross but I love that people
are liking this on twitter and 5,000
solanki so I'll just I'll just I'll just
leave this last chance I'm about to turn
off the discount code we're about to
drop that discount code not tow face
troll face will stay forever
we love twelve days total face is great
this town but we're commenting I servers
we really we really appreciate all of
you first 5000 khmer i is gonna there's
no memory leaks we fix them all is it as
we yeah khmer i hopefully under the
reign of the new CEO is about to grow
like crazy when I've shown the office
off today I work in this office I work
in research you guys see my chair yeah I
got gaming chair you can game harder and
more Pro with it that's what it's out on
the website glad to show you guys a
little bit of preview of maps and I'm PR
Bros on PR I'm useless as a developer I
can't code man I can't code man
well things are Ricardo here let's get
rid of that discount let's get rid of
that scope e-50 discount two lucky
people got Skokie 50
disable but ice goby 50 whatever the
wider one experiments being done but
check and we're working on making sure
our maps are very precise right now
[Music]
no we're keeping the topes just got
don't worry don't worry we're not we're
not getting rid of the topes discount
let's just tweet about this first
yep love you all
hash tag first 5,000 oh yeah no we got
to say goal reached love you all hashtag
first 5,000 I'm an Instagram thought
that's right goal reach love you
thousand why am i rich can i scammed
people have money that's what you get
rich in this world talk about the new
model okay so here's a model
architecture see these drop outs so we
use a lot of drop out to regularize it
but a new model we remove those dropouts
because we have so much data now that
you don't actually need the dropouts so
I hope you guys enjoyed the P model just
a last minute by Vasco B's
really still.
>> Are we live?
>> We should be. Let's wait for some
comments.
You have a good view.
>> Uh, can you make it ultra wide?
>> It is ultra wide. It should be.
>> Yeah.
>> Good.
>> Are we getting comments yet?
>> Uh, did you announce
>> Cameron's here?
>> All right. Great.
>> Did you announce here?
>> Let's show everybody the car from the
outside first.
>> Sure.
>> Welcome, guys. I think there's 34 people
here.
All right, guys. Check out our new demo
car. 2024 Lexus ES.
>> Pretty nice.
>> Is that gray or dark?
>> Like a shiny black.
>> Yeah.
>> So, it's just like a Corolla except uh a
little nicer, a little quieter.
That's basically what we were going for.
Looks pretty good. Anything
so far?
You guys see this?
Nothing.
>> And it says 2022.
>> Okay, cool. You guys can hear us, right?
>> Are you on the Wi-Fi?
>> No. How's
your
>> Okay, cool. All right, we're ready to do
the install. So, you want to introduce
yourself, Kevin?
>> Yeah. So, I'm Kevin. I don't work at
KMA. I work at Tiny. But
>> how much?
>> I've never done an install before.
>> How much experience you have with open
back?
>> You get installing the development
experience and that was pretty good.
>> You went for one drive, right? Yeah.
>> Okay. Cool. Here's your brand new 3X.
>> All right.
>> Straight from fulfillment. So, we'll see
how fast you can set it up. You guys saw
our Best Buy Dream where you can go to
your local Best Buy. You go and pick out
a 3X from the beautiful display. And
then uh you walk out to the car, you
tear it out of the box. It's show the
unboxing.
>> Unboxing of a box
accessories. But yeah, you go pick up
your comma from Best Buy.
>> Guess we're not doing comma power.
>> And then uh you stick it on the
windshield, plug it in, and you're good
to go.
>> Oh, not the water.
>> All right, maybe we should do this
inside the car. [laughter]
>> That's okay.
>> We'll get inside. That's good.
>> Yeah,
X seat is pretty spacious. This seat is
just really far back cuz I'm tall.
>> Can they hear the person behind the
camera or no?
>> Not very well.
That's okay.
>> Okay. What have you got in there?
>> Open these boxes behind.
>> Okay.
>> So, we chose this car, guys, because
it's uh what about 40% of our user base
has as far as an open pilot install and
the rest of the experience torque uh
open pilot long. Um basically the same
and then it's a little bit quieter. So,
Lexus.
All right. You want to tell them what
you're doing?
>> All right. So, just following steps on
the setup guide. Remove rear view mirror
screen.
>> Show them your comma 3X.
>> Alex says, "Why does your why did your
screens always look like mosaic and
dropped frames?"
>> We get this.
>> Are they dropping frames?
>> Yeah, a couple people say that.
>> It's the same as the Toyotas. I
>> mean, we're not on Wi-Fi.
This is the same as Toys. You watch the
videos? Did you prep for this?
>> Not really.
>> All right.
Okay.
>> So, this is one of the trickier parts of
the install.
>> Yeah,
>> it's easy once you know the trick. Um,
and there's like, you know, 12 tricks,
like one per car brand.
>> Don't want to just yank it.
>> All right. So, you check the setup
guide.
>> Check setup guide.
>> Slide outwards.
>> Uh, outwards clears. I'm assuming it's
towards the windshield.
There's also a video
>> there.
>> It's not very obvious.
>> So, we're working on a whole new website
um with an improved setup guide that'll
launch very soon.
Okay,
>> that clips it on.
>> Mhm.
>> Okay, you're getting closer
somewhere.
>> So, so far this looks like basically
everybody setup experience for the first
time.
>> I see.
>> Maybe a little faster, actually. There
you go. There you go.
>> Now it's off the
>> thing off.
>> And then
>> and then now we
>> So we should show off the harness. This
is slightly new and it's been a new
harness.
All right, guys. We're reconnected. Does
it look any better?
>> Better.
>> Let's give them a sec. Let's confirm
it's it's going better. We were on the
Wi-Fi.
>> Even the scene said glitches.
>> No, I know, but that was before we fixed
it.
>> Is this going to come on YouTube?
>> Yeah.
Okay, they're saying it looks better.
All right, we can proceed. So, let's
give them a quick overview again. So,
this is what your device looks like when
you get it. We just took the cover off.
We can show uh
>> it's better from this angle.
>> All right, cool.
>> Uh plugging camera harness
in and then harness it as well.
Okay, clicked. So, that's good. Then I
just want to stick this somewhere.
>> Uh,
>> I like how you didn't watch the video. I
just got one until it was completely
cold.
>> Yeah.
>> Are you guessing or have you seen other
people do this?
>> Nothing.
>> He's vaguely heard us talk about it a
bunch.
>> Guess we can kind of shop it over here.
You want to stick this just says
somewhere empty.
>> So, this is the tricky part. This varies
per car. Some cars have tons of room.
>> Um, so you have this little sticky on
the back.
>> Yeah,
>> you can stick it somewhere. You want to
make sure the OBDC is coming out
somewhere convenient.
>> I see.
So, probably want to have it facing
upwards then.
>> But we're eight minutes in, so we're
still making pretty good time.
>> Uh, probably over here. It doesn't quite
reach. It's a short wire.
There is no really inconvenient either.
The standard harness mark is not.
>> Yeah, Max seems no more props. All
right, cool.
>> Cool. We put it there.
>> Yeah, we're getting new internet at the
office, so we were connected to the
Wi-Fi by mistake.
>> Should be fineish,
I think.
Yeah. I mean, you can always try again.
It's not like super permanent.
>> Okay.
>> Okay. Cool. Yeah. So, now we have the
stock Toyota camera with our little
harness. So, we can plug in a common 3X.
>> Mhm.
That might be inconvenient.
Um,
next step.
I think we're skipping this.
>> So, we're skipping comma power.
>> So, comma power is
>> not necessary anymore. not necessary
anymore as of Open Pilot 098.
You can install it if you want those
extra dash cam features. It uploads
while your car is off. You can SSH in.
Um eventually we'll do sentry mode.
>> But if you just want to drive and you
want to get driving as quickly as
possible, don't need to install it
anymore.
>> Now we're doing mount.
>> That's good progress.
>> Two mounts.
>> Can you update the comma 3 to interface
with semi-truck? So, it doesn't need any
updates to the com 3. Um, it would just
be like a normal. I mean, the
semi-truckss are a little bit different,
but uh it doesn't need any extra
hardware wise.
>> So, you want the mount centered?
>> Yes.
>> Flat
uh somewhere around here,
guessing.
Okay.
Yeah, I think Shannon and I shouldn't
provide any more instructions going
forward. This has got to be completely
wrong.
This is our demo car, guys. Um, we have
a first- time installer doing it. It's
that easy now. It's still going to get
easier, but it's that easy now.
Wipe the area.
Okay.
We can take general questions while uh
this install is going. We'll probably go
for a few more minutes.
>> Um
I don't think we pushed the secret good
open pilot model since we last streamed,
but uh progress is still going on that
trucks are mostly 24 volts. All your
stuff's compatible to higher voltage.
That's cool. Um
so the device I don't think will work up
to 24 volts. Um
but other than that you should be fine.
So yeah, secret open pilot. Um we're
still targeting September, October for
that first model merge into master and
then uh yeah, that's kind of the the
definition of open pilot 010 0.10.
Um,
and there's a couple other things, but
that's the really big one. How are we
looking at a time on goal on N10 long?
Yeah. So, that's the definition of 1.0
is when we have the model trained in um
our new simulator and N10 long is in
chill mode and there's essentially no
experimental motor anymore. Um, maybe
experimental mode goes back when we
reintroduce nav.
>> Oh, you move that.
>> Yeah.
>> Okay.
>> It's going be a bit of a pain.
>> I don't know how many of you have done
Open Pilot installs and how similar is
this to your experience? So, we're 12
minutes in. Um, when I did my first
install, probably took me like half an
hour. Most of the time spent on the
combo power, and I still didn't do it
nicely.
All right. So, just reorienting it.
>> Yeah.
>> Okay.
>> Has anybody played with the development
environment recently? Um, it's gotten a
lot better in the last couple months.
Um,
especially Agnos has been really cool.
Um, we have a whole bunch of
contributors on that now. U we have this
really cool CI that'll push you a brand
new Agnos build and then you can just
share the manifest and uh it's like
ready to install. Super easy to test the
stuff now.
>> OBC.
>> All right, we got the OBDC going in.
Getting off the cover without breaking
took a while. Yeah, that took about 2
minutes. For some people takes even
longer. Some of them are really tricky.
Um so the plan for that is we'll just
enumerate all the tricks on the website.
There's like maybe 10 to 12 of them um
for the different cars and we'll say,
you know, most Toyotas look like this,
most Hondas look like that. Um and then
you should be able to just kind of piece
it together and try all the various
tricks. Um it doesn't require a lot of
force. You just have to kind of know how
it works.
We got a lot of extra cable length.
>> Yeah,
it's quite amount to slide in. Really?
Oh yeah.
>> What's going on?
>> Upside down.
>> Um and then even before open 010, we
have 098 shipping this um later this
month.
I don't It's not full. You got to slide
it anymore. Yeah, there you go.
>> Cool.
Then
>> so you can turn it on now to make sure
it all works or you can slide the cover
back on.
All right, let's see if the logo pops
up.
>> Cool.
And
>> got that beautiful Lexus animation.
[laughter] How long do you need to let
the mount set after sticking to the
windshield? Um, so there's it's 3M VHB
tape, so there's a very nice curing
graph you can look at. Um, for the most
part, if you just leave it overnight
with the device off, it should be fine.
Um, you can generally go for the first
drive without um, letting it cure and
then just take it off after. This is all
discussed on the setup guide, but this
is something we want to improve. It
should be easier to remove the mount.
Um, you never want a step that's really
easy to do, but then hard to undo.
That's kind of the worst kind of step.
Um, so we make it easier to undo
>> and not have as long of a cure time. How
much difference would it make if the
mount was offset towards the driver by 6
in? Yeah. So, you can't do that. That's
the one thing. The mount has to be
centered with the car. Um, we don't
calibrate with respect to any position
difference there.
So, for poor functionality, no more need
for the other cable. Correct. This is
literally it now. Um, you got to put the
cover back on nicely if you want. Um,
which most people want to do, but this
is it now. Cable's a bit long. Lexus
Safety Sense 3.0. I think this car is
like 2.5 or something, I think. So,
>> yeah, it's not 3.0.
>> Uh, plus.
>> Okay, now we got to get the cover back
on.
Best Buy incoming. Not yet. Uh, and it's
not like, you know, it's not literally
Best Buy. Maybe it's like a common mall
store. Maybe it's it's just about the
idea. Can you go to Best Buy? It's like
the Best Buy test, right? Um, can you go
to Best Buy? tear open the thing while
you're walking out to your car and then
stick it on the windshield and drive out
and engage. Um, that's kind of the idea.
We're not quite there yet. It's really
getting there, though. Um,
>> putting on the cover is hard.
>> You might want to take a look at what's
going on on the other side.
>> Yeah,
>> I mean, I think this product is actually
a lot better than, you know, a lot of
things you can buy in Best Buy in terms
of value and even, you know, it's very
reliable, very stable. Um, we don't talk
about the failure rate as much because
it's just
uh there's very little benefit to
talking about it at this point. Um,
guess it's on par with modern iPhones,
but uh,
>> so we just passed about a year since we
shipped the first 3Xs. Um, failure rate
is um, a little more than 2%.
>> Which is really incredible.
>> So, this is not as good as the very best
iPhones, but it's on par with like the
average iPhone. I was open about curly
handling traffic control like light,
stop signs, construction sites. Um, it
like vaguely does the correct thing down
in experimental mode. Um, how much
information or tap to proceed is
necessary? So, we never do anything like
tap to proceed like if open pilot is
uncertain. Um, if it's uncertain, you'll
kind of feel it and how it's driving the
car, but it'll never just like try to
seed control back to you in that way.
All right. So, I don't think you're
going to have the cable. Yeah, you're
going to have to route it above. It's
covered in the video.
>> Yeah.
>> Video time.
>> Yeah. Let's check out the video.
We should probably emphasize watching
the video a little more.
>> Mhm.
>> Or split up the video into the steps.
>> Yeah, that would be better.
>> Yeah, if you had a picture and a video.
>> Mhm.
>> Maybe it's even like an autoplay gift.
>> I'm thinking maybe we'll make the
website open source so then people can
make PRs for this stuff if they want.
Would a test mount be a good idea that
allows you to tell if the device is a
good fit or not? No. No. You just want
like the
>> You know, you don't want to like add a
second case here. You just want to like
fix the first case.
>> Really?
>> Any concerns about being mass marketing
people trying to hold one liable for
damaging something? Trying to get
comment installed? Damaging something?
Trying to get like damaging? There's not
much to damage here. If you damage the
little cover that goes here, um that's
like 20 bucks. Um super easy to order.
There's not too much and the user
installs it themselves. Um,
>> cool.
>> All right. Most launch launch features
like stopping for traffic lights and
stop signs are still experimental.
>> Um, but we should be able to make
awesome
>> very quick progress on this with our new
simulator.
>> The hope is that this stuff is just free
once we're training in the new
simulator. Um,
>> it's going to be just fineish.
>> It's kind of surprising how well this
stuff works um given what happens in the
current simulator.
just resets all the time. All right, so
we're 18 minutes in. Um,
it's not too bad. Have a C3 and it play
on Pius Prime. Experimental mode still
sucks. Um, yeah, I mean it's it's
experimental mode. I drive with it every
day. Um, I personally like it. Could you
publish a video every month or every
release with the same route to compare
show improvements and capabilities of
that version? Um
the changes are more subtle and
we we try to show this with aggregate
data in the release blog posts.
>> Um so we'll show things like DM
improvements and like the true positive
and false positive rates. Um or we'll
show like
>> you know kick fits there
>> um performance of the model in some
aspect that we were trying to improve
very locally. Um,
>> yeah.
>> Uh,
>> the you won't notice much from drive to
drive.
>> Does the device tell you if the mount is
sideways or is the way to adjust? Yeah.
So, it'll tell you if the the mount is
like in an invalid position.
>> And it'll tell you exactly how much.
>> Where can we put this?
>> I think this covered pretty well in the
video. Are you sure you watched the
video enough?
>> Yeah. I mean, it doesn't really say
where to put it. It kind of just
generally puts it somewhere.
It says pointing upwards. So, I'm trying
to point it upwards.
Doesn't really work. So, the way I like
to do this is I put the cable in and
then I figure it out and I get the cover
on.
>> Would be better.
>> Oh, yeah. That's interesting. You also
haven't driven most of our cars, so you
don't you haven't like just seen how the
cables routed.
>> Yeah.
>> Okay.
>> Yeah. I think we found some interesting
stuff here. Um
interesting.
This is very interesting.
>> Mhm.
>> It is too short.
>> I mean, mount is not straight. It
doesn't have to be perfectly straight.
Um you do have a lot of leeway. Whenever
I install a mount, I just kind of stick
it on and I eyeball it. Um and it always
works out. But we're thinking about like
making some kind of guide make it super
super easy.
>> Harness blocks placement is always a
little tricky. I agree this is the
personally this plus the wires not being
wrapped were the two big issues for me
>> uh and the common power but that's
fixed. Um so we wrapped the wires now
>> um
>> on all the V3 harnesses.
>> Harness box placement is a little
tricky. When I do an install I take some
zip ties with me usually. um a little
extra VHB tape. Um we can potentially
include those in the box. Um but then
again, that also has the problem of
like,
you know, I have some extra parts left
over. Was I supposed to do something
with them? You don't want to make the
stuff too complicated.
>> Mhm.
>> All right, we're getting closer here.
>> Closeup.
>> Product placement issues. What do you
mean by that?
side is not sitting. The connector's in
the way.
All right. Well, this is happening, too.
I'll do a quick shout out for jobs. Uh
we just put a bunch of rolls up. Um for
a while, we just put challenges up and
then we had people kind of sort
themselves into like, you know, what
challenge you do and then we'd figure
out a roll after. Um we're trying to try
something new, put the rolls back up.
Um,
if you want to check out comi/job,
um, we're trying to grow the team a
little bit. Um,
hiring designer, we're hiring electrical
engineers, we're hiring software
engineers. Um,
>> remember how you got it off? Need to
slide it.
>> That was at the beginning, though.
You know what might be a good
recommendation is if we had them after
you slide it off, you slide it back on
>> just how that works.
>> This mount is not very good.
>> Feel like having VHB on the harness
blocks can be a little misleading.
>> I agree with that. I'm just not sure
it's strictly better to remove it. This
this needs some kind of We need to think
about this some more.
>> Um I agree with that though.
>> I don't think I've ever used it on my
personal cars.
>> I see.
Yeah. I think it works really well in
some of the Hondas that have lots of
room.
>> Mhm.
>> There's not a lot of room here.
>> Yeah.
>> So, makes it harder.
>> But do you realize where you're getting
caught?
>> Yeah.
>> Yeah. There you go. I think that'll
work.
>> This cable though.
>> There's some There's some setup
improvements we can make like labeling
things as optional on all this.
>> Yes. We just need to up we need to
update our current stuff guide. You
mentioned the old chem power and
everything.
>> Uh yeah. Well, we don't even mention the
Yeah, it's not updated for
>> Yeah.
>> Oh, shit. Lost track you guys after the
latest upload. How's the company been?
Uh yeah, we just did the we had a Fourth
of July sale moving 3X's. Um lots of
device growing stuff.
>> Um the network's still growing. Um
we've been doing some hiring pushes. We
have we had two people start last week.
Um hiring's really picked up. Um one of
them's working on some cool new stuff.
We're going to have we're going to
launch a a new uh open source hardware
repo
and start documenting that stuff better.
Um not that much new content, but it'll
be kind of a new format and it'll be the
place where all Hogwarts is documented.
Um, and then the other one's working on
rewriting the website. And then we'll
make all these big changes like we we
want to do a new setup guide, uh, new
homepage with like a nice time lapse
that says, you know, 50% of Comet 3x
miles look like this with a a chill road
trip. And you you guys all know what
that looks like. Um,
yeah.
And then after that new website is
shipped, we're going to work on new
connect. Um, give all the web stuff some
love. Yeah, things are going well.
And the autonomy team is, you know,
working really hard to ship uh their new
models by October.
>> The sign is really hard.
>> Yeah, this part is pretty hard.
>> Doesn't really video doesn't make it any
easier, that's for sure.
>> Really? You don't think so?
>> Yeah. No.
>> Having maybe brand specific videos would
be nice.
>> Mhm.
>> Yeah, we can do that. level talks about
carporting or talk about your own
infrastructure. Yeah,
we build a lot of infrastructure here.
>> It's all these problems are just
infrastructure problems. Have you seen
any effort of the OEMs so far to block
access to the cars controls? Um I mean
it's not clear these are like responses
to us but yeah some of the cars are
getting some authentication on their cam
buses. Um GM Toyota I think Subaru also
does this now. um the new Fords.
Um there's exploits.
There's some people driving around with
the new RAV 4 Primes um that have the
security and you know they have their
com X installed.
Probably be easier and faster for per
model harness. Okay, so per model is
really hard. We support almost 300
different models um per brand we can
likely do.
All right, Kevin, there's a lot of
pressure. You're uh you're hitting up
almost 30 minutes.
>> It's surprisingly hard to get this on.
>> And I spent like half of the 30 minutes
just getting this back on.
>> I know.
>> You can call it Shane. Do you want to
finish it up?
>> Um if only if you are giving up.
>> All right, Shane. Let's Let's just
finish this up and then we'll we'll go
for a drive with this.
um
community could probably help with that.
Yeah, I think so. Um the website just
has to be redesigned a little bit to
accommodate it. And then we'll have a
little thing on top that says like pick
your car brand and then the setup guide
will be tailored to your car and it'll
say like you know this is how you remove
the trim. This is how you slide the trim
back on. Um
and then whether you even need a comma
power or not. Let's go see how it works.
Yeah. I see you.
>> So, this is a real professional
installation. Shane here manages all the
cars um at KMA.
So, any kind of stuff related to
carporting um you had a bug fixed or
anything like that. That was Shane's
work.
It's an insane amount of complexity to
manage um for one person, but I think we
do a really great job with it.
>> This part is not on though.
Okay.
>> All right. Cool.
Let's rout the cable a little bit and
then where's the go over the cover?
>> Thanks.
>> All right. Cool.
>> Yeah. So, once you know the tricks, all
this stuff is really easy. We just have
to be better about communicating all the
tricks for each car.
>> Yes, that works.
>> That's on. It would be nice if the
cables redesigned to where the cable
goes straight up through the roof
instead of around the device.
>> Um
>> like here.
>> Yeah, we're playing around with like we
have some little clips and then you can
come you can hold the cable and you keep
it constrained. Um I want to start
shipping stuff like that.
What framework are you guys exploring
for connect and others? Uh we'll talk
about another drive. I think we're ready
to go for a drive now.
>> Is this the wipe?
>> Yeah,
>> it's already dry.
>> Yeah.
>> Get the camera cover back on. Come out
your arms. Yeah, for sure. It doesn't
work.
>> Okay. So, now we have the stallware
setup time. Let's see if we can finish
it before 30 minutes. Shane, we're at
>> You want me to do this or Kevin?
>> Oh, yeah. Kevin, you want to do that?
>> Okay. So, now this should be the easy
part.
>> Uh,
can we skip this?
>> No, you got to connect to Wi-Fi.
>> Yeah. Do you want to?
>> Yeah, that's fine.
Yeah. Okay. No Wi-Fi password.
[laughter] So,
all right. Cool.
Can you see the screen on there? I think
they can see the screen for the most
part.
>> Oh,
>> yeah.
>> This is new.
>> Yeah, it is.
>> Super easy. Okay, let's see how long it
takes. We have 30 seconds until 30
minutes. Let's see.
You ready with connect?
>> 10.
>> So when it's pre-cached, it goes from 10
to 100. So we pre-cache open pile on the
device. So it's super fast
and then it'll register real quick.
And then you're terms and conditions.
>> Yes.
So, we're working on a web version of
this and then this won't necessarily be
part of the initial device. Um, it won't
block you from from engaging.
Essentially, you can do this, you know,
after you purchase the device, well
before you even receive it. Um, and then
you can come back to it. It'll be a
little bit like a more like a user
manual than a training guide.
All right,
cool. We're already on road.
>> Yeah.
>> Wanted to connect set up.
>> All right.
>> And the fingerprints.
>> It fingerprints. Yeah. So, that's the
machines work from earlier this year.
>> Yeah.
>> All right. Let's switch
on to the drive.
30 minutes. Can we
>> uh as of now it's 52 seconds.
>> Okay. All right. Cool. So that was less
than 30 minutes. Um we also need a
little bit of time to show off the car.
So this is some of the other stuff that
comes in the box.
Cool.
All right. So,
that was about 30 minutes.
So, we're 6x off where we want to be.
You know, 5 minute install. It's less
than an order of magnitude.
So, we're driving with the latest Open
Pilot 097.
>> So, we're calibrating. This takes about
a minute driving at about 50 miles an
hour. So, before we get on the highway,
it'll already be finished.
We like to joke that it, you know, it's
designed exactly for our distance the
highway right there.
In reality, we can probably make that a
little bit faster now. Got ask Harold
about that. Harold, if you're watching,
can we make that faster?
All right. So, we'll do our standard
test loop. So, fresh install, fresh
device.
You can see Kevin just threw up the
mount. Um, and it calibrated just fine.
It's able to uh deal with any kind of
like a very large range of pitch and yaw
as long as you centeri centered the
device. Um, it's generally able to
figure it out.
All right, engaged.
This is very smooth, actually.
>> Mhm.
>> Mhm.
>> This feels a lot better than the
Corolla.
>> Is it quieter?
>> I think it's cuz it's quieter. I think
the open is the same. It's just quieter.
>> Well, it could be different. It might
have a little more torque, I believe.
Just a little bit, though. It should be
very representative of basically all the
Toyotas that we support right now.
>> It's pretty close.
>> Yeah.
Um,
>> this experimental.
>> No. So, we're just in chill mode here.
Um,
going to hit a little bit of traffic.
Ro does very well,
but I'm liking this so far. This is a
really great open pilot car.
So remember with open pilot, you can
always collaboratively steer. Um that
may change very soon with the Tesla
port. Um so Lucas, our new hardware
intern, um did the Tesla Model 3 port
and unfortunately with the Teslas, we
won't be able to do the collaborative
steering. Um and this is why we haven't
supported Teslas in the past. Um but I
think it's time to reevaluate that. We
just have to decide whether we want the
Model 3 supported or not.
Um, so I think hardware 3, Model 3s and
Y's, is that it chain will be supported
with the new harness.
>> Yep.
>> Yeah. So I think we'll get that port
merged very soon in the next month or so
at least behind the dash cam flag and
then you guys can buy the harness on the
shop um install like normal open pilot
um and it should just work.
I think he already sold like 70 of his
handbuilt harnesses. So that's pretty
insane. Um I think that's the most for a
community built harness. Um, it's really
hard to build harnesses. Um, this is why
they're $200. Um,
we're just now getting to the scale
where we can, you know, we can like work
on the supply chain. We can work on
manufacturing getting that price down.
Um, but really at the scales we were
working at before and if you're like
designing a harness and building it by
hand yourself, um, it's really a massive
effort.
So, I mean, people complain about the
$200 price, but this is really just how
much it costs. Um, and if we were just
not sell them at a loss, this is how
much we have to sell them for.
Yeah, Tesla port coming soon. Um, this
is open stop and go traffic. It was like
a normal commute. Um,
open just stops and goes. It's very
chill.
Very quiet in this car. I really like
it.
Really makes you realize how loud the
Corolla is.
It's a quiet Corolla.
I don't know how many Lexus ES users we
have. Do we have like even 10% as many
Corolla users?
>> I believe it's at least 50.
>> Oh, that's 100 that 100. That's decent.
>> I have to check.
>> Yeah,
but now we're among them. And uh this
will be our demo car.
>> I think there's only a couple of this
model year though. They're pretty rare.
I mean, it's pretty cool. So, our demos
over time, um, you know, the most
demoare style thing we've ever done was
Taco Bell. Um, and you know, we did this
in like a very comma style where we did
a a demo drive that was not on like
release Open Pilot. It was not even Open
Pilot Master. Um, it was a special model
and like less than 100 lines I think of
mods, but we gave the branch out for
everybody to read. Um we open sourced
the full logs and everything. Um
so it was a demo but you could see
exactly what kind of demo it was. There
was no like you know we cherrypicked a
route and then we um like we wrote in
all these like things with nav um and we
like pre-programmed some route. It was
all exactly what you see in that branch
and you could inspect the logs. Um
but other than that our demos have been
with like a torque modern Honda Civic.
Um the at the last CES we used the Kia
EV6 with open pilot master with like a
couple bonds we fixed at the last second
but this car was open pilot release um
with a common 3X we just picked off the
manufacturing line hit the open pilot
button um and it's a very smooth
experience um so really the focus now is
getting this like we want to turn that
30-minute install process into something
that takes five minutes for like the
average user. Um, and for a very
advanced user, probably less time. Um,
and there's a whole lot of things to do
that.
It's a it's just like a long list of
refactors like hardware, experience,
software. Um, Shane and I were talking
about, you know, do we really need
internet to pull Open Pilot? Um,
yeah,
that's kind of what the Best Buy test is
all about is how quickly and how easily
can we get people into this experience
that we're in right now.
>> So, how much have you drove with open
Kevin? This
>> basically zero.
>> This is your second drive?
>> Yeah. No, I've driven more than that.
like be able to take me out.
>> Okay.
>> But
>> how would you rank this on a Is this
like an average open mile drive now? Cuz
you've driven in a few cars, I think.
>> I think most of them other than the Ram.
>> Oh, the You didn't like the Ram?
>> I haven't taken the Ram. Oh, yeah. So, I
don't know what it's like in the Ram.
>> The Ram is decent. The problem with the
Ram is the steering angle sensor I think
has a half a degree resolution.
>> See,
>> it's I think it's half degree, right? Or
it's a tenth now. I think we were able
to improve it. Yeah. Real Fast found
some signal that gets you a tenth of a
degree, but I think a whole bunch of the
Chryslers are still half a degree.
>> Is there backlashes on it as well?
>> No, I don't think so. I I think it's
literally just the steering angle
sensor. You can only get it to half a
degree, which is pretty crazy. Um,
yeah, every car has its own controls
problem. Um,
we've tried these different strategies.
Um,
>> speaking of that, somebody asked, "Since
we called the Lexus a good open pilot
car, what do you consider a bad open
pilot car, and what have you done to
support it?"
>> A bad open pilot car. So, I think the
Bolt wasn't great until recently. Um,
with the new controls, the Bolt was a
little janky. Um, what else is not a
great open pilot car? We kind of just
removed the ones. Everything on comai/
vehicles should be a pretty good
experience. We called the list there's
like maybe 10 cars we removed from that
list um that were not great experiences
either from like a hardware setup
perspective uh which was some GMs like
the Chevy Volt um
that's actually I think we only removed
GM ASM cars which is mostly the Chevy
Volt and a few other models but the Volt
was um by far the most popular of those.
Prius used to have steering issues, but
we fixed that in a software update.
>> Yeah.
So, I think like we're providing like
Open Pilot is a providing quite a bit of
value on every car listed on
common/vehicles. That's kind of the
definition of that page. Um,
we just don't merge and enable things if
they're not going to be a good
experience. Um, for a while we had
community supported cars and we had all
these distinctions. Um but and you know
we had to decide are we just going to
trim the list down to like the cars that
we have or are we just going to be
responsible for all the cars that we
support in upstream open pilot and we've
decided to just be responsible for them.
Um and it's been much more manageable
than we expected. Um the last frontier
for this stuff I think is really um
these general control strategies to have
good tuning on all the cars. Um, the
ones that we've spent a lot of time on
are pretty good. Like the Corolla, the
Prius is good now. That took us like
four or five years. Um,
the Bolt is a lot better. The Bolt still
isn't perfect, but it's a lot better.
Um, here, let's open Pal a lane change.
Oh, why is it doing that?
Okay, cool. Oh, the mirrors just folded
in. Um Oh,
>> don't put it in auto.
>> Auto.
>> Sweet.
>> They fold in.
>> Um but yeah, every car listen/ vehicles
should be a good experience. Um and
that's the definition of it. Um we have
a lot of cars in that have code in open
pilot that are not enabled yet and then
they just have like a nice path. They
have to get good and then we'll ship
them. Um,
and we're working on exposing the full
state of all car ports in a single page.
That should be a lot like comi/vehicles.
Um,
and then you can know like exactly what
state it's in. Here's the PR you can go
to if you want to contribute to it, if
you want to be a tester for it. Um, or
if you want to know if whether there's
some blocker on it, like the new uh GM
Global B cars,
we have uh Jason from the community
coming to work on that. I think in about
a month he'll be out here doing some
on-site work.
Any other good questions? You guys have
any questions about hiring, Open Pilot,
um like upcoming Open Pilot stuff? Um
3X support. Um,
so I do all the all the hardware support
for Open Pilot
>> for about uh Toyota security.
>> What about it?
>> Uh, any plans to break it on newer cars?
>> Oh,
it's the same as you know. Did you buy a
boat? Did you
>> I mean there's people with RAV 4 Primes
driving around um and they're having a
good experience. It's unfortunately also
a substantially different car from what
I understand. Um
like lateral and longitudinal API wise
at least longitudinal is different,
right?
>> And then lateral I think is LTA, right?
>> Yes. There's a couple messages that are
different.
>> Yeah. But
>> so they changed a whole bunch of things.
Toyota was really great in the beginning
because TSSP and TSS2 were all the exact
same. Same connector, uh same software
essentially. It really didn't matter
what platform you had. The only thing
that was different was like the mass and
the wheelbase. Um but now the Toyos are
diverging like almost every other car
now. Um Hyundai's are so different for
every model. Um the complexity of the
cars are really growing with the modern
ones. Um likely due to like probably co
supply chain stuff. Um and then you know
the car manufacturers are okay with
dealing with lots of this complexity for
some reason. Um
>> somebody wants to know if we're going to
update the Kama Connect app. Um yes.
>> You can tell them about new connect.
Yeah. So, we have a web intern who just
started um last week and uh he's doing
really great work. He's rewriting our
site. Um
and then once the site is rewritten,
that should be launching next week.
It'll look the same at first, but then
we'll be making a whole bunch of changes
incrementally, like a brand new setup
guide, um new homepage, and then I want
to redo the Common 3X shop page. Um but
after that's launched, the focus will be
on shipping new connect. So, you can go
to the repo right now. We have a beta
repo up. The community's been working on
it. Um community has done some really
great work designwise um implementing
the features. There's a road map for it.
You can see um but I think in the next
month or two you should have new connect
and it should be way better than current
connect. Um
yeah, first we'll just replace current
connect's feature set and then we'll be
able to do things like sentry mode or uh
this car is not that great at cutins
right now.
We'll post some driving feedback,
>> but uh
>> Do you know which Tesla model years are
in that PR?
>> I don't know actually. I want to say
like 2021 through like 23 or 24.
>> I Which one did they win at the Defcon?
Was that 2021?
>> Yeah, it was 2021.
>> Okay.
>> Yeah.
>> So, a pretty good range. Similar to the
Bolt at least. Yeah,
I think the Model 3 will end up being a
popular car, especially if we go by
community harness sales. Like, that's
pretty insane. 70 community harness
sales.
>> Um, the F-150 is also pretty popular
community-wise. Um, the F-150 was
actually the next car we wanted to buy,
but we needed a good demo car first. Um,
so F F150 or Maki will be next, likely
F-150.
Um,
yeah, just a chill normal open pile
drive. So, we got into this experience
in about half an hour. Um, for those who
were watching before, um, you know, it's
half an hour right now. We want to make
it 5 minutes. We have a very clear path
to get there. Um,
yeah,
I think a lot of it will just be in
proof setup guide.
>> Yeah. Uh, somebody asked if the Tesla PR
was public.
>> Yeah, all this stuff is public. Um I
don't know why that really uh even asked
at this point. So all open pilot
development is now public too. We used
to have like a private slack channel um
where we internally discussed open pilot
um but we deleted that very recently. Um
so all open pilot discussion is on
GitHub or on our discord. So if you're
ever curious about open pilot stuff um
we don't even drive on on anything
private in our cars because it's just
less convenient. Um, so all the models
that Research is driving on, they're
public branches. You can always find
them and people do most of the time now.
Uh, you know, it's community members
driving on our model branches way before
we do and they hit bugs and they're
like, you know, the branch wasn't ready
yet.
Any other questions?
Yeah, com X's just work
hardware wise, software wise. The whole
thing just it like kind of works at this
point.
The insole is already very clean, too.
>> Yeah, if we just told them exactly how
to do that, that'd be perfect.
>> Yeah. Oh, the follow distance button is
very new. That should been 097 or six.
Um not sure.
>> So you guys can adjust the follow
distance now. Um so it's not actually
follow distance in open pilot. Um follow
distance is like kind of analogous to
our driving personality. Um right now
that is input to the model but
eventually it will be and then it can
drive a little more aggressively. Um you
get to choose. Do you want it like
driving chill, normal,
aggressive?
Um
and then it works with your steering
wheel buttons.
David California wants to know who has
the most miles with the comma device.
>> Oh, we had a leaderboard for a while.
Um, I don't know anymore. It used to be
this guy, Old Dirty. I think he drove
around with like a common Neo.
>> I think he means uh like the employees.
>> Oh, the employees.
>> Probably the person who's been here the
longest.
>> No, it's probably Wayen. We has like a
45minute commute.
The rest of us have like very short like
5 10 minute commutes.
>> I think I have at least 10 or 20,000. Oh
yeah. Yeah, that's probably a good
point.
Shane is like a model CI
every night. He goes out and tests all
the new models.
>> You ever cherry pick stuff off Porter?
>> Sometimes.
>> Do you ever actually do that?
>> Yeah, I reference it. [laughter]
>> Uh, somebody was wondering about the
road map of the body.
>> Um, yeah. Yeah. So, I mean the last
project we worked on was what Arman did.
Um, and he kind of used the same
>> This is only one experimental mode. Um,
>> can we switch easily?
>> Uh, the toggles.
>> Switch it.
>> Tap this.
>> Toggles.
>> No, you got to switch it for the first
time.
>> I see.
>> Yeah. There we go.
>> You didn't click it. You missed it.
Oh.
Okay.
Okay.
That's cool.
Um, all right.
>> No experimental.
>> No experimental mode right now.
>> So, Arand.
>> Yeah. So, the last common body update is
uh so our mod made this pretty cool
thing that just outputs um essentially
in like was D space like you know um you
can think of just like the four
directional arrows where the body should
drive just to roam around the office. Um
and you set up simulator a lot like our
new driving stuff. Um so that was a cool
proof of concept. Um
and I think security is still like a
good first use case of the body but
right now everybody on the autonomy team
is focused on driving stuff. Um,
not sure what's going on here. I'll have
to look into that after. Um,
but yeah, pretty smooth drive. Um,
yeah, autonomy team is working on, you
know, making this drive a little bit
better with experimental mode and enter
long and chill mode. And, uh, us on the
product team are working into working on
getting this experience to you way
faster. Um, we want to make it more
accessible, more reliable, um, just way
easier to get into and then providing
you some features on top of that with
connect and common prime.
>> Somebody was wondering why we don't use
the built-in cars uh, like alert sounds.
>> The alert sounds. So, we used to use
that. The problem is the alert sounds
are all different. Some cars have
multiple alert sounds and some cars the
alert sounds aren't sufficient. the this
one I believe doesn't have anything for
when it disengages.
>> Yeah.
>> Yeah. So, some cars have the alert
sounds. It's also an extra thing to
reverse on every car. Um, which doesn't
sound like a lot, but when you support
300 cars, it really is a lot. Um, so we
just canonicalize this by playing our
own sounds. The sounds are actually a
pretty important part of the experience.
Um, I find without the sounds that it's
really hard to understand what state the
system is in. Um, I think I internally
like use the sounds to go through the
state machine in my head. Um,
like you can hear the engage or
disengage.
All right, take our exit here.
Yeah, it's our new demo car. Very chill
open pile driving. Um, no fancy taco
stuff, just the stuff that, you know,
kind of works every time. And we want
more stuff to just work every time.
And if you want to, you know, come help
us make things work every time, consider
uh consider a job. We've got the
controls challenge going right now. Um,
even if you don't want a job, it's still
uh pretty fun challenge to do. You can
get on the leaderboard. We have a cash
prize out right now. $500. Um, I think
that ends September 1st,
so that should be a pretty fun
challenge.
It's also super easy to get into. You
get clone, you like run one command, and
then you have you're steering like a
simulated car. Um, and it's the same
sort of stuff we used to uh make the
bolt steer really well.
Um,
all right. We'll end the stream when we
get to the office. Are there any final
questions?
>> See what we get.
Uh integrating more cameras.
>> Uh no plans for that. I mean, what do
you want more cameras for?
>> I think they were talking about the the
sides for the lane changes.
Um, so I mean our biggest disengagement
was going around that big curve. Um,
with experimental mode it would have
done it, but experimental mode isn't
good enough to leave on all the time.
Um,
the way we kind of look at this is like
go and connect, see what your most
common disengagements are. Um, and then
as soon as they're the camera, we'll
look at that. But right now it's not the
camera at all. It's just that open pilot
needs to get better. Um,
so it hasn't been cameras for a long
time.
It probably won't be cameras for a long
time. Um, there's still a whole lot to
do.
That's about it. Any other questions?
Nit.
Uh,
>> see just click stop.
yo yo yo you're all on periscope
welcome to periscope come a holiday
party where we have merchandise store as
you can see here to buy cries this is
the self-driving car awareness week to
check out the EON playing music if you
would like your very own eon just go
right now
the shop.com yeah you don't even have to
be here there's a verbal agreement why
do I just remove ease
[Music]
$6.99 can be yours let me tell you when
they're shipping even if you buy them
today any working hard it's not
Christmas all the common team will sign
it yes no that's not the Macintosh I'm
not Steve Jobs you know all Macintosh's
inside Macintosh case it was signed that
every member
[Music]
somebody is very angry that you guys are
not going to New York our awareness to
our team is pressed not from San
Francisco not from technology and not
from automotive we're looking for local
press in Midwest states politician local
presses like chill you know what I'm
gonna call those guys still be chill
press somewhere that isn't crazy
Journal you have a radio host in
Minnesota if you want me to channel
somebody requested a freestyle from
George
I'll be making my money and smoking my
weed that's why she texts me and tell me
she loved me she know that one day
because I got it coming those are the
teaser George TT I mean no come on does
Cersei no no no no no be serious
rhetoric isn't real please feel God be
real look let me tell you about Silicon
Valley you guys this place is full of
bullshit these people are already
destroyed but you know some people are
trying to fight back anyone out there
come and visit online
[Music]
Omaha we've got lots of people out there
being aggressive
someone just say coke boys like like
cocaine like pain or like brothers
there's honestly no cojes party okay so
I go on this baby
Rufus yeah what is that if that comments
a lot though so what you said something
I heard we do yeah some oh okay okay
they're just by seed of the I don't even
I don't even know that I all I can do
all I can do is move your back up to
sixteen talking to me that's why we said
when you're talking to me because we
only get one conversation a week can I
get one conversation at least shout out
to everyone making my beats you helping
me preach the music's the only thing
keeping the peace when I'm falling to
pieces
[Music]
we need yours so we could try to play
Benny's chop but no because we respect
Spotify terms of circles and a deal all
right we got more people here I'm going
to go thanks for watching thanks for
joining us my periscope
from Oviedo,
 
the valves are safe, and Gretel, the Assumption
of this city,
training, and
 
 
 
to the heart,
how was it, is
cardiac,
Burroughs,
yes,
William,
no.
[Music]
Ah,
thank you.
[Music]
However, he wanted a poor man,
and
what? And he
writes,
and
[Music]
And
h.
[Music]
And
Diego Ruiz, civic, more absence in being,
some doubt,
a Texas juice.
 
thanks for coming out to San Diego
it's good to see so many of you are
users
so like Alex said I'm oh it's all full
screen
all right
all right I'm adeeb I'm the chief
product officer here at comma
I lead the open pilot team and I'm going
to talk about how we actually ship open
pilot
so we have a saying at comma we say the
difference is ship ability we've been
saying this since the beginning
it's a pretty important core tenant of
comma everything we do is designed to be
shippable we don't as Harold show we
don't really spend time on things that
we don't think we can ship we always
develop something to be at least have an
intermediary that we can ship first even
if we can't ship the very final system
um
so Harold showed you a bunch of cool
things that the research team develops
they tell the car where to go
um but then what do you do after that
you've got these really fancy machine
learning models they tell the car where
to drive how fast to drive and they can
even navigate now but how does that get
to you in open pilot
so first we need some Hardware
and this is what comes in your car it's
a lane keep camera
it's got a very tiny amount of compute
so unfortunately we can't run open pilot
on it
um
it's also got no video output so we
don't get a raw camera stream out of it
um and it's different in every car so
that means for every car we'd have to
not only reverse engineer the messages
to read the state from the car and send
the actuation we'd also have to figure
out how to interface with it possibly
get a camera stream out of it
um and figure out how to run it on that
processor so this one has a mobile eye
chip
so instead
since we can't use this what we do is we
ship the comma three we launched this at
last Comic-Con
and has everything you need to run open
pilot
it's got three cameras
it's got a Snapdragon 845 so every
single one has the same processor
whether you have a Toyota Corolla a
Hyundai Sonata or Honda Civic
and it's got enough compute to run
modern machine learning models and it
interfaces with every single car exactly
the same way
and the way we do this is we take pcbs
into our office and comma threes come
out
so the first step in this process is
something called circuit spoke
um the original comma 3s you may have
bought towards last year's Comic-Con or
two years ago were made by a
manufacturer called circuit hub we
replaced them with something called
Circus book that's in our office ever
since we moved we've been running comma
threes there they come in with bare pcbs
just like that
and then they run through this line we
have a jet printer a pick in place an
oven and some fancy aoi
and then they get headed off to the
production room right over there
and then it goes off to assembly you can
see a bunch of combo three boards here
lots of stuff on them
and then they get provisioned stress
tested
and you order them at shop.com at AI we
fulfill the next day we fulfill every
day
um
so
now we've got some Hardware
um next we need to run on a car
so we know self-driving is entirely a
softer problem
um but now we explain why we need to
start with Hardware
but fortunately we don't need to build a
car modern cars are more than good
enough they've got Lane keeping so we
can control the steering by using the
same inputs and the same with the gas
and the brakes
so here's the Toyota Prius very early
supported car for open pilot
um
so for each car we had Hardware to
attach the comma 3 that's a little bit
more specific than the comma 3 so every
pin out
um on the camera connector that I showed
previously is different
so we have a little bit of special
hardware for your car but the compute
isn't
and then we need some special software
for your car to read and write to it
and we've done this about 250 times for
the 250 officially supported cars and
there's many many more in community
supported Forks
thank you
so this is the car harness
this is the uh
this is the end that goes into your car
this is the end that goes into the comma
three
each car and brand uh each brand and
model tend to need a different uh wiring
harness
they provide Power and access to the can
bus and that's how we talk to the car
we have 34 different harnesses that
cover our 250 supported cars
um
so now that we're attached to the car we
need to be able to read and write from
it
so each brand again has its own messages
that needs to reverse engineered after
we've already connected to the car
um
and then we read a bunch of signals like
speed steering angle whether the cars at
standstill the steering torque that
you're putting on the wheel we read out
a whole bunch of things and then we need
to be able to send steering gas and
brakes to your car
all right now I'm going to talk about
something that's pretty exciting open
pilot safety
so this is something you don't expect or
you might not expect you know you have a
machine learning model that tells you
where to go we have a planner we have a
control stack
um but how do you constrain that output
how do you make how do you ship this in
a continual way where you don't have to
think about these things in this stack
how do we abstract out the safety from
this
so we have something called the openbox
safety model and it guarantees a couple
things
so first it says that the driver must
always be able to take control of the
vehicle by stepping on the brake pedal
or the cancel button so this means
you're able to engage openpilot and take
control whenever you want
um
and then we have this next point which
means
essentially open pilot can't react
um or do anything too quickly for an
attentive driver to not have enough time
to take over
so we enforce this safety and through
that openpilot is able to pretty much
make whatever decisions it wants and
it's constrained by the safety model as
long as we do a good job of enforcing
that
so there's some pretty good standards
around this that allow us to formalize
the safety model give it specific
actuation limits and give us a good way
to think about safety
so ISO 15622 gives us some good
guidelines for ACC
um
and then there's another ISO standard 11
270 for Lane keep we recently updated
our safety documentation with some of
these actuation elements so that they're
more they're more formal you can go in
you can read these documents they're
very readable they're like 15 page PDFs
this stuff is very accessible
um and then you have ISO 262 which is
just kind of a general framework for
thinking about functional safety for
road vehicles
and then we have something called the
panda
um
so the panda in your comma 3 doesn't
look quite like this
but this is an external panel for can FD
cars
it's a secondary processor that directly
talks to the car
so a common thing you might see about
openpilot on the Internet is that you
know I don't want a phone driving my car
well the phone isn't driving your car
this is the thing that talks to your car
um I think it's an important point
because this is one of the coolest parts
of open pilot you know you can have a
fork and the panda protection you don't
touch the panda and uh you should be in
good shape
so the panda has all the code that
enforces the safety
and it allows open file to be something
called qm
so there's this framework for thinking
about safety called Azle and it stands
for Automotive Safety Integrity level
and then there's something uh below the
Azle ratings called qm this stands for
Quality Management
um and what that means is
any
anything open pilot wants to do as long
as it's constrained properly by the
panda safety it's worse considered bad
quality it essentially has no safety
implications in regards to the safety
model
so when you're talking about open pilot
safety
first you should read the safety model
and then you should go okay is the panda
properly enforcing the safety model and
if that's the case then whenever open
file makes a decision that you felt was
unsafe you have a proper way to think
about
um
whether this was
actually unsafe it provides a very
specific language to talk about this and
we're quite strict about how we
communicate this because it's really
important to think about it in this way
and the panda goes through loss of
testing and it has very rigorous code
standards we observe miseracy at all
relevant Automotive safety guidelines
there
and now I want to talk a little bit
about testing so you've got a system
but how do you continually ship it so we
ship open pilot updates to master
several times a day and we ship open
pilot updates to our release users
roughly every month
and you might be surprised to know that
the releases go through very little
specific testing we have really great
testing infrastructure that we try to
get as early as possible so that means
when we're pushing code directly to
master we expect to find those failures
pretty immediately on Master by the time
something hits release it's pretty rare
to find a bug you might have noticed we
don't really ship hotfixes anymore
things are getting quite stable on that
front and the zero nine open pilot
series
so back in 2016 there's a fun quote I
found this Commit This was uh well
before my time towards the start of the
company and it says one day we'll have
CI
um
so today we do have CI
and the test Suite looks a little bit
something like this we don't test in
cars this is the first principle if you
have to go down to a car first it's slow
all the cars are different
um it's not a good Loop
so we run regression tests in the cloud
with GitHub actions
we have Hardware in the loop tests that
run on tons and tons of real common
threes
um
and then we have dozens of comma threes
running open pilot continuously but the
CI is getting so good that these dozens
of comma threes really don't find
anything it's getting quite boring you
just see them driving and driving and
driving and uh it's
really pretty incredible the way we can
ship things now to open pilot master and
I don't know how many of you run master
or try to run the bleeding edge I
suspect many of you do if you showed up
here
but I think you haven't seen a
regression in quite a while
so I want to talk a little about one of
our tests it's called process replay
and it allows us to deterministically
replay all of our driving processes so
that means you have the driving model
for example we give it the same video
and then we say okay what did the
outputs look like do they look exactly
the same for the same inputs
um
and this essentially outputs a diff in
the outputs of the process given two
commits so you can say I have this good
known Commit This is good known behavior
and what is the deviation from that good
known Behavior you get a green check
mark if there's no difference and if
there are differences it's really easy
to go in and say okay this is an
expected difference and then or this
isn't an expected difference and I
messed something up
and the real power on this is it makes
refactors essentially free
you know when you're doing a refactor
and you you're chaining something you're
like I don't really know if this is the
same you know you run it a little bit
and you're like okay this looks roughly
the same with process replay uh your
coverage is only constrained by the
inputs if you want more coverage you
throw more data at it you can generate
data that'll be relevant for what you're
doing but
um we just throw in lots of segments
from lots of different cars and we get
great coverage that runs on every single
open pilot commit and gives you a diff
from the last known good open pilot
commit
so this allows I think research right
before the release merged a fairly large
refactored rate Rd
they are able to run it through process
replay and a larger version of process
Replay that they maintain and uh it was
I mean nobody was concerned about this
before the release it was just business
as usual
all right so this is uh kind of the most
important thing in testing green check
mark means good to go if you don't trust
your CI then it there's almost no point
so every time you commit you should be
very confident when you get that green
check mark that you're ready to merge
this and nothing is
nothing unexpected will happen
essentially
um sometimes there's there's good uh red
X's we have some cool tests like a power
draw tests that asserts that essentially
every driving process doesn't use uh
more or less power than expected so
we've had some fun ones like that where
we've done some optimization you got a
red check mark and it's like okay I
lowered power usage and then we can
adjust the thresholds and we can say
this will not regress in the future
because we test this explicitly on every
single commit and it's similar with CPU
usage memory usage all those kinds of
things
all right so this robust testing
infrastructure enables us to ship open
pilot updates extremely regularly
there's essentially no uh bottleneck on
shipping to master you have a green
check mark then you're you you feel very
confident sometimes you might you know
ask somebody for a review but uh really
the machines are doing your reviews for
you
um they're enforcing essentially all the
behavior we want to enforce and this
allows us to support all the 400 plus
contributors we have now it's nearly
double since last Comic-Con
um and it's pretty incredible we hit 10
000 commits we've have
of those 10 000 commits I I think about
30 of them are from external
contributors
um who you know you can't expect an
external contributor to Too Much
validation it works on their device
works on their car improves their
experience
um but it's always hard to expect them
to do the validation when they're not
the ones clicking the merge button so
we've really removed that burden on
ourselves in the same way that they go
through the same workflow that we do to
validate our changes
and I think a really cool feature of
this is we have 250 supported cars this
has grown again double since last
Comic-Con I think it was 134 last
Comic-Con and it's a single engineer
maintaining all those cars we're
expanding car support we support all
major brands now we recently merged
support for Ford
um and it's uh
it allows the community to really uh
the community is really able to uh
leverage our CI and we just
um we're able to validate their stuff so
quickly that uh we can have one person
who just builds tests and infrastructure
for them and then we merge their
carports and it's a really great
pipeline now
all right so I want to talk a little bit
about what's next for open pilot now you
have an idea kind of how we ship up and
file it we ship little boxes to you guys
I showed you a little bit about the
procedure for that
and then you know there's some
unexpected hiccups you know you need to
do some safety you need to do some
testing so that you can ensure that
you're continuously shippable but what
are we shipping next
so this is something from the taco video
we had to bump up the low speed torque
the way we implement the safety for our
torque based cars right now is
um it trades off some implementation
Simplicity for maximizing torque at all
speeds
um because for a essentially for a given
uh
you could only maximize
your lateral acceleration for a given
torque at
um but narrow speed range so that means
at the low end you're not getting as
much torque
um so in the future what we'll do is
we'll be able to look at the speed and
the panel will say okay you can get a
little bit more torque at the low end
and then we'll be able to give you a
consistent amount of lateral
acceleration across the whole speed
range rather than at one narrow point
where we maximize on the highway
um
and then this is another interesting one
coming up a lot of cars are coming out
as Vision only they don't have Radars
um so we've got to start doing comma a b
we want to this is a milestone that we
need to hit for openpile 1.0 this is a
video from when we did our first a b
tests
um when we were doing
some more of our
some safety work on uh
we want to validate that essentially we
pass through the a b messages and that
it still works so this is the first time
we did that we built this car this is
how we do it
and some systems are a lot better than
others you should go to read the blog
post I pulled this picture from there
it's really great we analyze the
uh the manufacturer a b systems and we
we compare them we Benchmark them and we
can compare them even to open files for
Collision ordering which is really
pretty uh pretty good and really
suitable enough to ship an aab but then
again there's a lot of safety work
that's needed to ship aeb you don't want
to just uh trigger at any time it also
extends the safety model we're going to
trigger when you're not engaged so
there's quite a bit of safety work that
goes into this
all right and then we want to shift to
more robots Harold talked a little bit
about this this is going to require some
brief factors to support cleanly the
common body fit in pretty cleanly as a
car but we want to support more robots
you might have noticed the self-drive to
system refactor and open pilot we're
going to keep working on that and it
should be really easy to integrate in
any of your robotics projects
and then uh we're trying to make
everything more Plug and Play you might
have had to fingerprint your car I see
there's a lot of users here hopefully
you didn't have to but this is a metric
we're starting to track now we refer to
as ttff that's a GPS acronym that stands
for time to First fix the open pile team
is kind of commandeer to mean time to
first fingerprint so what this shows is
how many users every day didn't hit a
successful fingerprint who should have
essentially they bought a comma 3 they
saw their Toyota Corolla was supported
they put it in their car and it said car
and recognized so this is something
we're fixing it turns out we uh we were
very conservative in the beginning we
pinned to exact like these firmware
strings we get from the car
and it turns out you know they don't
change their apis that often we can look
at these firmware versions a little bit
more and we can essentially if we say we
support the Toyota Corolla you plug in a
comma three it'll just work so we ship
the first version of that for Hyundai's
in 093 Toyota's are coming up next and
we'll extend it to all the cars
all right and now I want to shout out
our external contributors we have 474 as
of uh this morning
so
if we can get a developers developers
Developers for external contributors in
three two one
Developers
all right time for questions
[Applause]
so you can ask me questions about open
pilot the product the production process
really anything like that
fantastic
no so we actually run these on the CPU
in GitHub actions
yeah yes
um so there's actually some Brands where
the EPS does this for you
um so like the Chevy bolt is like this
um
yeah yeah so the question is
um like what's the best car brand or or
even model specific model that has like
the uh the highest low speed torque
limit
so there's some cars that are uh all
these apis are different amongst the
cars the Chevy bolt happens to be one
that already has good low speed torque
because they already compensate for this
when you request the torque so that's
one you can get right now that'll have
really great low speed torque
all right I'm back here
yeah
yeah thanks so much for your
presentation I always love anything on
CI
um so
in in your replays I guess you're you're
kind of trying to see if the car or or
the new release yeah does the proper
behavior again you don't have a
regression do you have any and I'm
asking this because I'm kind of
interested in this this project called
Vision zero okay right
um
do you do you have any testing
techniques or know of any testing
techniques for say reproducing Adverse
Events like collisions like can you kind
of test for hate as a certain type of
behavior in a car actually cause a
collision so these tests are a little
bit different they're lower level than
that
so what we test for is we take each
individual process and processes really
only do uh they have very narrow Scopes
so we'll say like is the car parsing are
we taking can messages and we say did we
parse the same car state out from this
um so it's much lower level you probably
want to ask the research team this
question they have really great tests
for this stuff
thanks so much for that feedback it's
super useful
uh yeah can you talk a little bit about
your segments you use for testing and
validation you mentioned um do you are
you kind of continually changing those
out over time as you get fresher data
for off of more recent open pilot
versions or is it kind of just one big
list of segments that you're
continuously building on over time
so the big list we build on over time is
the ones for cars
we have several test segments for each
car we support and we have like this 200
line unit test it's really great and it
basically ensures the cars never break
um this was this turned out to be a
problem
um up until maybe a year or two ago
where uh you know there'd be some minor
regression in all these cars especially
since we don't have one from each
platform
um so that one we continue to build on
over time for other tests you generally
get a pretty good coverage
from so we have to update them
occasionally when there's new outputs
and new inputs but uh largely no we
don't have to the next step for this is
like fuzzy testing and you want to
really search over that whole space and
make sure you get full coverage
and generate the data
hi I have a question um which car brands
are the easiest to support and the
hardest to support and do you have any
thoughts on their software engineering
practices and quality
um so easy as a sport this is really
changing now actually
um the software platforms and the cars
at least for the 8S we're pretty stable
for about like three four years and we
did a lot of this initial work maybe
three or four years ago and now we're in
this cycle where you know Honda Toyota
Hyundai a lot of them are changing their
uh their platforms right at the same
time so that's the hard part right now
is we're getting kind of this influx
that are all different right now
um the hardest ones now are the ones
that Implement
um the autosar secure onboard
communication
we haven't spent much time on it but uh
that'll be a little bit of a project it
just adds more overhead to porting a car
yeah I think you had a second question
oh
um I mean we reverse everything so
sometimes we see some fun stuff but
largely it's you know it's the practices
of the tier one
um the worst part is sometimes the apis
just don't make any sense at all and we
have to hack around that
hi I have a question on the community
collaboration so
um what's the expectation as far as for
you know proper communication and also
the quality of the PRS that we do like
what's that like and uh we have a lot of
PRS that's been you know being
um opened with cut with the open pilot
repo but yeah always getting a lot of
time like the time to get a merge or get
them you know even review is a long time
so what's the expectation that the
external developers or collaborators
should be expecting
so
as far as communication
we tend to merge the things that are
pretty immediately mergeable pretty
quickly and then we have to prioritize
essentially what is valuable to us right
now there's a lot of the ones that are
open are
um
maybe there's like a lot of refactors
that are like of questionable value that
maybe we should just close
um and perhaps we should have some kind
of Auto close mechanism that's we can
certainly improve this but uh for things
that are like pretty immediately
valuable we'll try to provide good
feedback immediately and try to get them
merged but it essentially goes through
the same prioritization as the stuff we
work on it's it's really quite a small
team that's looking at this stuff
hi so um for all the testings are being
done on open pilot what's the process
like of uh developing a test case
developing a test case Okay so usually
the way this works is you write
something and then you say okay I'm not
sure if this is uh this is going to work
quite the way I expect then you are the
test case
um so generally we have a lot of the
kind of General test cases that are end
to end just written already and then now
it's more of a specific unit test cases
that get written I mean you could look
at the I was looking at the open file
commit history this morning actually
um to get a nice picture for something
and uh it's like mostly tests so that's
what you see these days things that like
regress a little bit and we write a test
for them we say okay this is never
regressing again
hey uh just wondering if you could share
any insights into your AEV deep dive
which brands did well which brands did
not
so Honda Bosch I believe was uh
was the worst performing um it was
actually fun when we were testing it we
had to put a license plate on it I think
we have to put a German license plate to
get it to trigger
um yeah so the funny thing is they
released the testing procedure so you
can kind of engineer it
um it's kind of like the fuel emission
stuff where you know sometimes they
engineer a sort of demo essentially for
when they do the test
um but again it's we'd have to like
fully reverse the systems to understand
how it works it might have actually been
looking for something that was real
um but it's probably time to redo that
test we support a lot more cars now and
we can redo that blog post
um I had a question on steer torque do
you only do you only use torque for for
uh rate limiting or do you use steer
angle ever
uh so it depends on the car uh we
essentially want to limit the the two
things we want to limit our lateral
acceleration and jerk these are actually
specified in ISO 11270
um so we have to limit essentially what
the car gives us we develop a safety
model or a safe an implementation of the
safety model for each car as it comes we
recently supported the Fords
um
and those you know they don't take
torque
um we give it curvature we have to
develop something around that
fortunately for a lot of the eps's or
don't provide enough torque that exceed
the iso 11 270 limits some do and
we but we implement the safety of
nonetheless for all of them
you spoke a lot about Cloud testing with
CI but you sometimes do Hardware in the
loop tests so can you elaborate more on
how and when you do those and any best
practices you adhere to yeah so the best
practice here is we do them on every
single commit
um they're
if the test is something you have to run
manually it's just not going to get done
sometimes you're less likely to also
make the change that you want to make
um the the best feeling about CI is like
you know when you're at home you want to
make a change and you're like you know
oh well it's public it's really easy to
like go in the GitHub editor it's like
oh let me make this quick change uh and
it's like do I commit to master the
small change do you open a PR
um
and uh you see the green check and you
just merger uh it's like I don't feel
like it's gonna
you feel really good that it's not gonna
break master and I do this pretty often
where I go home at night I'm like oh I
want to make this quick change I end up
merging it that night go to sleep and
I'm not worried it's gonna break Master
because we do have like 400 users who
run the very very bleeding edge
um so if it does break Master they'll
let us know pretty quickly
uh hi
um
it sounds like you do a
a
CI on pretty much every commit
um does that also go for uh hardware and
loop testing or is that more less
frequent rather nope okay on every
single commit and in that case
um
how how long do you run those Hardware
in the loop tests because I've seen open
pilot bugs that don't manifest until the
comma has been running for a few days
um like what kind of bugs like uh uh low
IPC rate errors
um failure to engage after being on
um doesn't turn off when the battery
gets low things like that do you run a
fork no just a regular release channel
oh okay we should talk about that after
maybe but uh so we have some different
infrastructure for that we call it the
testing closet because it actually
started in a closet in our maybe two
offices ago when we were in a house and
it's essentially just dozens of common
threes running continuously
um
and the hardware and the loop test are
like normal unit tests that need to run
on the real Hardware to validate some
some things that we can't reproduce on
like Cloud CI Runners like using the DSP
and the 845
a lot of question what motivated the
desire to actually assemble the pcbs and
Boards in-house like what problems did
you guys run into from so contract
manufacturers we uh use this company
called circuit Hub and you know we got
bored under the bus
yeah
we're good for the karma too they
weren't good for the commentary yeah
things got too complicated and now that
we have this it was uh it's really
incredible for prototyping we can like
essentially have CI order boards every
Friday and it makes so much sense it's
like 200 for a bunch of boards we just
run them through the line it's really
fast and easy uh doing revs of the comma
3 took forever
um
so it's uh it's really a superpower in
that regard too but we've been doing
some really great tuning over the last
couple weeks on the line and uh find
like the really littlest things we cash
into production we stop the line
immediately we go and fix a thing you
know and we're able to do the same
things we do in production but on the
boards themselves
here we can tweak every little detail
yes
I just have a question on capacity we
ever have capacity shoes ever and
multiple users you uh using the software
whatever or something like that it does
that ever called Peak and have to
distribute it
I'm sorry what kind of issues uh
my question is related to capacity so oh
capacity issues yes I've ever run out of
capacity issues and then how it
distributed multiple user using same
time like does that the peak you know
the peak volumes
multiple users are using at the same
time yes
well everything runs on your device so
there's no issues like that you don't
need to connect to the cloud except for
navigate on open pilot but that just
hits like a tile server and a routing
server so uh the load is pretty low
there
uh do you have any kind of special
process to integrate tests for driving
feedback you get from users for like
consistent disengagement spots across
open Violet versions like for instance
there's an express lane that I drive on
and it's consistently taken tried to
take the exit across you know
op0909192 it did good on the way to the
airport a few days ago on 9-4 but I had
a lead car in front of me so I think
that definitely played into it
driving behavior questions are generally
best asked for the research team wishing
is gonna have some really great stuff on
this
um on like this engagement analysis
um we have a driving feedback Channel
Discord where there's like a nice form
you give it a route as long as you
upload all your logs so the if you ever
want something looked into by us we love
looking at the bug reports but they have
to be you know you have to put in the
effort to make it really high quality
um I mean just put in the effort and
it'll be high quality so don't worry too
much about like don't worry whether it
is high quality so just continue to make
the reports because I've reported them
all you know I try to talk about the
feedback but um just was curious if you
had a specific process to like
prioritize those or you know kind of
make sure that there's no regressions
um so we do look at everything in that
channel we look at everything that's
reported essentially and we
if it's something that looks a little
bit concerning or that looks like a
regression will evaluate whether it
actually is or it progressed in like
some very minor cases and we we
prioritize that way we do look at
everything that comes in so thank you
it's not always easy to respond to
though
yeah generally I would just like to
thank everyone who's made a good bug
report I think people don't realize how
valuable yes give it up for bug
reporters
um
yeah that slide really should have been
bug reports bug reports bug reports you
truly I think people may um
fully rely
ing so small and we have about 12 cars
ourselves I feel like we don't talk too
much about our cars but you know so
we're testing things but I think people
don't realize how many varieties of cars
how different each car is
um and so it's super helpful to the team
to have that information when they're
doing bug reports
we have time for a few more questions
down here I'm gonna great I will come
back over
so I'm just gonna reword a question I
think I heard because I think it was a
really important one okay so you have a
closet or room of Hardware that runs
hardware and loop tests you might also
have some infrastructure that can run
tests like unit tests yeah when are
times when that
Hardware or infrastructure sort of maxes
out because you have too many requests
to run tests or do you not observe
it's this is our open source project
GitHub gives us um GitHub actions
Runners for free
um we actually like upgraded our GitHub
plan so we get more concurrent Runners
and it was like I don't know a few
hundred dollars more a month and we just
get unlimited CLI from GitHub uh every
month because we're an open source
product so that's really cool and then
as far as the hardware test we have to
scale those sometimes
um and we just add more devices in the
closet that's a little bit hard to
maintain
um because the team is so small but
um we're generally able to keep up with
that
you guys the testing closet is like a
nightclub which
it's very loud it's very important yeah
I keep it right next to my desk I don't
know how a deep Works uh around all the
alerts
oh yeah I just have a question about
like um safety uh which is related to
like a total model failures so I had a
situation one day it might sound just
unbelievable but like a bird like took a
dump and it hit on right where the
camera is looking and it covered a lot
of the camera and then the car uh the
model didn't like it didn't give any
warnings or it was a model failure and
the car just went straight and I I had
it immediately disengage and turned on
my windshield wiper yeah
um so like for and also others like uh
sometimes the model like incorrectly
predicts where the curb is and it rides
on the curb and stuff like that but when
it does that it there's no indication
that there is a model failure happening
um and it doesn't there's no loud beeps
or anything like I have you guys
considered maybe like putting in like a
warning system for like yes so two
things that you use the word safety we
have to be very careful about how we
talk about safety so I talked a little
bit about this we have a safety model uh
and to recap that it guarantees that
if you press you're always able to
retake control by pressing on the brake
or the cancel button and it'll never do
anything too quickly for an attentive
driver to take over
um so if that fails that's perhaps a
safety failure
um but anything that the model does or
openpile does is essentially considered
qm so your events are considered bad
quality
um
so it's just important to make the
distinction there and then as far as
those things we had this alert that kind
of detected device following model
uncertain we just found there was too
many false positives you would be pretty
annoyed if you got one when it was very
clear you shouldn't have gotten one so
we we can revisit this this was maybe a
year ago that we removed it but uh
I mean I I hope that the bird one was
pretty obvious for an attentive driver
I do have a question on safety so uh
earlier we mentioned that there's uh
we're going to increase or maximize the
low speed torque so there are some
collaborators in in the community let's
say for Subaru or for Hyundai hkg
um that they want to get involved in
this take the implementation of the low
speed torque now uh we talked about that
we have to do injection testing and
we're getting more data and more
documentations on how the testings were
done so is there anything that you know
moving forward from the open pilot team
that can provide some of that
documentation publicly on how the
community can get involved with that so
we can kind of speed up the process or
you know anything like that so the thing
that's a little bit hard for the
community to do is to get from zero to
one on this
um so I would suggest that the community
you know Waits until we do it for the
first car which will probably be our ev6
because that's what we did for the taco
car there's a the first implementation
of it in the taco Branch for that car
and then the community is really good at
taking from what do we go to zero to one
and saying okay let's ship this on all
250 of our cars so I think that's the
appropriate time for the community to
get to get involved but the safety stuff
is pretty accessible if somebody wants
to just get ahead of this breed ISO
15622 and ISO 11 270 they're very
readable they even provide testing
procedures
um so yeah we've got a question of
stairs
hey thanks a nice presentation I was
curious if you guys uh also track the
code coverage
you do okay cool uh what tool do what
tool do you use uh so we track it with
codecav um that's at 70 right now
but uh it doesn't really cover
everything uh I mean that 70 doesn't
cover everything so it's really quite a
bit higher
um but we really
better code coverage than just like line
count uh that's probably a project that
we should do soon because it's not
completely obvious it's something that
like a few of us have in our heads
um
but it's not completely obvious to an
external contributor like I'm making a
change is this covered by the tests
generally the answer is yes especially
for the things that the community tends
to want to change
but uh
it's uh yeah it's something we should
drive up and we should really
communicate when you're making a change
whether whether it's covered by the test
and how well it is
I think that's what you really want with
code coverage yeah yeah cool well sense
we've got one last question here
hey yeah uh general question what does
your system look like for learning from
Real World edge cases
so that's another question for the
research team okay
thank you so much team
all right I'm Adib um I'm the chief
product officer here at comma I lead the
open pilot team and I'm going to talk
about how we actually ship open
pilot um so we have a saying at comma we
say the difference is ship ability um
we've been saying this since the
beginning um it's a pretty important
core tenant of comma uh everything we do
is designed to be shippable we don't as
Harold show we don't really spend time
on things that we don't think we can
ship um we always develop something to
be at least have an intermediary that we
can ship first um even if we can't ship
the very final
system
um so Harold showed you a bunch of cool
things um that the research team
develops um they tell the car where to
go um but then what do you do after that
um you've got these really fancy machine
learning models uh they tell the car
where to drive how fast to drive and
they can even navigate now um but how
does that get to you in open
pilot so so first we need some
hardware and this is what comes in your
car it's a lane keep camera it's got a
very tiny amount of compute um so
unfortunately we can't run open pilot on
it
um it's also got no video output so we
don't get a raw camera stream out of it
um and it's different in every car so
that means for every car we'd have to
not only reverse engineer the messages
to read the state from the car and send
the actuation we'd also have to figure
out how to interface with it possibly
get a camera stream out of it um and
figure out how to run it on that
processor um so this one has a mobile ey
chip uh so instead since we can't use
this what we do is we ship the comma 3
we launch this at last Comic-Con and has
everything you need to run open pilot
it's got three cameras it's got a
Snapdragon 845 so every single one has
the same processor whether you have a
Toyota Corolla a hondai Sonata or Honda
Civic and and it's got enough compute to
run modern machine learning models um
and it interfaces with every single car
exactly the same
way and the way we do this is we take
pcbs into our office and comma 3es come
out so the first step in this process is
something called circuit spoke um the
original comma 3s you may have bought
towards last year's Comic-Con or two
years ago um were made by a manufacturer
called circuit Hub we replac them with
something called circuit spook that's in
our office um ever since we moved we've
been running common 3s there they come
in with bare
pcbs just like that and then they run
through this line we have a jet printer
a picking place an oven and some fancy
aoi and then they get headed off to the
production room right over
there and then it goes off to assembly
you can see a bunch of comma 3 boards
here um lots of stuff on
them
and then they get provisioned stress
tested and you order them at shop.com a
we fulfill the next day we fulfill every
day um
so now we've got some Hardware um next
we need to run on a
car so we know self-driving is entirely
a software problem um but now we explain
why we need to start with Hardware but
fortunately we don't need to build a car
um modern cars are more than good enough
they've got Lane keeping so we can
control the steering um by using the
same inputs and the same with the gas
and the
brakes so here's the Toyota Prius very
early supported car for open pilot um so
for each car we need Hardware to attach
the comma 3 that's a little bit more
specific than the comma 3 so every pin
out um on the camera connector um that I
showed previously is
different uh so we have a little bit of
special hardware for your car but the
compute
isn't and then we need some special
software for your car to read and write
to it and we've done this about 250
times um for the 250 officially
supported cars and there's many many
more in uh community supported
Forks so this is the car harness this is
the uh this is the end that goes into
your car this is the end that goes into
the comma
3 each car and brand uh each brand and
model tend to need a different uh wiring
harness they provide Power and access to
the can bus and that's how we talk to
the
car we have 34 different harnesses that
cover our 250 supported
cars um so now that we're attached to
the car we need to be able to read and
right from
it so each brand again has its own
messages that need to be reverse
engineered after we've already connected
to the car
um and then we read a bunch of signals
like like speed steering angle um
whether the cars at standstill um the
steering torque that you putting on the
wheel we read out a whole bunch of
things and then we need to be able to
send steering gas and brake steer
car all right now I'm going to talk
about something that's pretty exciting
uh open pilot
safety so this is something you don't
expect uh or you might not expect you
know you have a machine learning model
that tells you where to go we have a
planner we have a control stack um but
how do you constrain that output how do
you make how do you ship this in a
continual way um where you don't have to
think about these things in this stack
how do we abstract out the safety from
this so we have something called the
open bout safety model and it guarantees
a couple
things so first it says that the driver
must always be able to take control of
the vehicle by stepping on the brake
pedal or the cancel button so this means
you're able to engage open pilot and
take control whenever you want
um and then then we have um this next
point which means essentially open pilot
can't react um or do anything too
quickly for an intentive driver to not
have enough time to take
over so we enforce this safety um and
through that open pilot is able to
pretty
much make whatever decisions it wants
and it's constrained by the safety model
as long as we do a good job of enforcing
that so there's some pretty good
standards around this that allow us to
formalize the safety model give it
specific actuation limits and uh give us
a good way to think about
safety so ISO 15622 gives us some good
guidelines for
ACC um and then there's another ISO
standard 1127 for Lane keep uh we
recently updated our safety
documentation with some of these
actuation Elms so that they're more uh
they're more formal you can go in you
can read these documents they're very
readable um they're like 15-page PDFs um
this stuff is very accessible um and
then you have ISO 262 which is just kind
of a general framework for thinking
about functional safety for road
vehicles and then we have something
called the panda um so the panda in your
comma 3 doesn't look quite like
this but uh this is an external Panda
for kfd cars it's a secondary processor
that directly talks to the car so uh a
common thing you might see about open
pilot on the Internet is that you know I
don't want a phone driving my car well
the phone isn't driving your car this is
the thing that talks to your car um I
think it's an important point because
this is one of the coolest parts of open
pilot you know you can have a fork and
the panda protects you you don't touch
the panda and uh you should be in good
shape so the panda has all the code that
enforces the safety and it allows open
pile to be something called qm um so
there's this framework for thinking
about safety called azil it stands for
Automotive Safety Integrity level and
then there's something uh below the Azle
ratings called qm this stands for
Quality Management um and what that
means is any anything open pilot wants
to do as long as it's constrained
properly by the panda safety it's worse
consider bad quality um it essentially
has no safety implications in regards to
the safety model um so when you're
talking about openpilot safety first you
should read the safety model and then
you should go okay is the panda properly
enforcing safety model and if that's the
case then whenever open pilot makes a
decision that you felt was unsafe you
have a proper way to think about
um whether this was actually unsafe it
provides some very specific language to
talk about this and we're uh quite
strict about how we communicate this um
because it's really important to think
about it in this
way and the panda goes through lots of
testing and it has very reg code
standards uh we observe misery and all
relevant Automotive safety guidelines
there and now I want to talk a little
bit about testing um you so you've got a
system but how do you continually ship
it so we ship o Open pilot updates to
master several times a day and we ship
open pilot updates to our release users
roughly every month um and you might be
surprised to know that the releases go
through very little specific testing um
we have really great testing
infrastructure that we try to get as
early as possible so that means when
we're pushing code directly to master we
expect to find those failures pretty
immediately on master um by the time
something hits release it's pretty rare
to find a bug you might have noticed we
don't really ship hot fixes anymore um
things are getting quite stable um on
that front in the 09 open pilot
Series so back in 2016 there's a fun
quote um I found this Commit This was uh
well before my time um towards the start
of the company and it says one day we'll
have CI um so today we do have
CI and the test Suite looks a little bit
something like this we don't Tes in cars
this is the first principle if you have
to go down to a car first it's slow all
the cars are different um it it's not a
good Loop so we run regression tests in
the cloud with GitHub
actions we have Hardware in the loop
tests that run on tons and tons of real
comma 3s
um and then we have dozens of comma 3s
running open pilot continuously um but
the CI is getting so good that these
dozens of comma 3s really don't find
anything it's getting quite boring um
you just see them driving and driving
and driving and uh it's um really pretty
incredible the way we can ship things
now to open pilot master and I don't
know how many of you run master or uh
try to run the bleeding edge I suspect
many of you do uh if you shut up here um
but I I think you haven't seen a
regression quite a
while so I want to talk a little about
one of our tests uh it's called process
replay and it allows us to
deterministically replay uh all of our
driving processes so that means you have
the driving model for example we give it
the same video and then we say okay what
do the outputs look like do they look
exactly the same for the same inputs um
and this essentially outputs a diff in
the outputs of the process given two
commits so you can say um I have this
good known commit uh this is good known
behavior and what is the deviation from
that good known Behavior you get a green
check mark if there's no difference and
if there are differences it's really
easy to go in and say okay this is an
expected difference
and or this isn't an expected difference
um and I mess something
up and the real power on this is it
makes refactors essentially free um you
know when you're doing a refactor and
you're changing something you're like I
don't really know if this is the same
you know you run it a little bit and
you're like okay this looks roughly the
same with process replay uh your
coverage is only ConEd by the inputs if
you want more coverage you throw more
data at it you can generate data that'll
be relevant for what you're doing but um
we just throw in lots of segments from
lots of different cars and we get great
coverage that runs on every single open
pilot commit and gives you a diff from
the last known good open pilot
commit so this allows uh I think
research right before the release merged
a fairly large refactor radar D they
were able to run it through process
replay and a larger version process
Replay that they maintain and uh it was
I mean nobody was concerned about this
before the release um it was just
business as
usual all right so this is uh kind of
the most important thing in testing
green check mark means good to go if you
don't trust your CI then it there's
almost no point so every time you commit
you should be very confident when you
get that green check mark that you're
ready to emerge this and nothing is
nothing unexpected will happen essent
essentially um sometimes there's there's
good uh red X's we have some cool tests
like a power draw test that asserts that
essentially every driving process
doesn't use uh more or less power than
expected um so we've had some fun ones
like that where um we've done some
optimization you get a red check mark
and it's like okay I I lowered power
usage um and then we can adjust the
thresholds and we can say uh this will
not regress in the future because we
test this explicitly on every single
commit um and it's similar with CPU
usage memory usage all those kinds of
things all right so this robust testing
infrastructure enables us to ship open
pilot updates extremely regularly uh
there's essentially no uh bot on that on
shipping to master you have a green
check mark then you're you you feel very
confident sometimes you might you know
ask somebody for a review but uh really
the machines are doing your reviews for
you um they're enforcing essentially all
the behavior we want to enforce and this
allows us to support all the 400 plus
contributors we have now um it's nearly
double since last Comic-Con um and it's
pretty incredible we hit 10,000 commits
um we've have of those 10,000 commits I
I think about 30% of them are from
external contributors um who you know
you can't expect an external contributor
to Too Much validation it works on their
device works on their car improves their
experience um but it's always hard to
expect them to do the validation um when
they're not the ones clicking the merge
button
so we've really removed that burden on
ourselves in the same way that they go
through the same workflow that we do um
to validate our
changes and I think a really cool
feature of this is we have 250 supported
cars this has grown again double since
last Comic-Con I think it was 1 134 last
Comic-Con uh and is a single engineer
maintaining all those cars we're
expanding car support we support all
major brands now um we recently merged
support for Ford um and it's uh it
allows the community to really
uh the community is really able to uh
leverage our CI and we just um were able
to validate their stuff so quickly that
uh we can have one person who just
builds test and infrastructure for them
and then we merge their car ports um and
it's a really great pipeline
now all right so I want to talk a little
bit about what's next for open pilot now
you have an idea kind of how we ship
open pilot um um we ship little boxes to
you guys um I showed you a little bit
about the procedure for that um and then
you know there's some unexpected hiccups
you know you need to do some safety you
need to do some testing so that you can
ensure that you're continuously
shippable um but what are we shipping
next so this is something from the taco
video we had to bump up the low speed
torque um the way we implement the
safety for our torque based cars right
now is um it it trades off some
implementation Simplicity for maximizing
torque at all speeds um because for a
essentially for a given uh you can only
maximize your lateral acceleration for a
given torque at um a narrow speed range
so that means at the low end you're not
getting as much torque um so in the
future what we'll do is we'll be able to
look at the speed uh and the pandel will
say okay you can get a little bit more
torque at the low end and then we'll be
able to give you a consistent amount of
lot acceleration across the whole speed
range rather than at one narrow point
where we maximize on the
highway um and then this is another
interesting one coming up a lot of cars
are coming out as Vision only they don't
have Radars um so we've got to start
doing comma a we want to this is a
milestone that we need to hit for open
pilot 1.0 um this is a video from when
we did our first a tests um when we were
doing uh some more of our uh some safety
work on uh
we wanted to validate that essentially
we passed through the the ab messages
and that it still works um so this is
the first time we did that um we built
this car This Is How We Do It um and
some systems are a lot better than
others you should go to read the blog
post I pulled this picture from there
it's really great we analyze the uh the
manufacturer AE systems and we we
compare them we Benchmark them and we
can compare them even to open pilot for
Collision warning which is really pretty
uh pretty good and really suitable
enough to ship an AE but then again
there's a lot of safety work that's
needed to ship AE you don't want to just
uh trigger at any time it also extends
the safety model we're going to trigger
when you're not engaged um so there's
quite a bit of safety work that goes
into
this all right and then we want to ship
to more robots Harold talk a little bit
about this um this is going to require
some Bri factors to support cleanly the
comma body fit in pretty cleanly as a
car um but we want to support more
robots you might have noticed the
self-drive to system refactor an open
pilot we're going to keep working work
on that um and it should be really easy
to integrate in any of your robotics
projects and then uh we're trying to
make everything more plug in play you
might have had to fingerprint your car I
see there's a lot of users here um
hopefully you didn't have to but this is
a metric we're starting to track now uh
we refer to as ttff um that's a GPS
acronym that stands for time to First
fix the open pilot team is kind of
common deared it to mean time to first
fingerprint so what this shows is how
many users every day didn't hit a
successful fingerprint who should have
essentially they bought a comma 3 they
saw their Toyota Corolla was supported
they put it in their car and it said car
and recognized um so this is something
we're fixing it turns out we uh we were
very conservative in the beginning we
pinned to exact like these firmware
strings we get from the car um and it
turns out you know they don't change
their apis that often we can look at
these firmware versions a little bit
more and we can essentially if we say we
support the Toyota Corolla you plug in a
comma 3 it'll just work so we shipped
the first version of that for hondai in
093 um toyos are coming up next and
we'll extend it to all the
cars all right and now I want to shout
out our external contributors we have
474 as of uh this morning
so if we can get a developers developers
Developers for our external contributors
in three two one developers developers
developers all right time for
[Applause]
questions so you can ask me questions
about open pilot the product the
production process um really anything
like
that no so we actually run these on the
CPU in uh GitHub
actions
yeah
yes um so there's actually some Brands
where the EPS does this for you um so
like the Chevy bolt is like
this you yeah you want repeat yeah so
the question is um like what's the best
car brand or or even model specific
model that has has like the uh the
highest low speed torque limit so
there's some cars that are uh all these
apis are different amongst the cars um
the Chevy bolt happens to be one that
already has good low speed torque
because they already compensate for this
um when you request the torque so that's
one you can get right now that'll have
really great low speed torque all right
I'm back
here you have a
Chevy
yeah thanks so much for your present
presentation I always love uh anything
on CI um so in in in your replays I
guess you're you're kind of trying to
see if the car or or or the new release
yeah does the proper behavior again you
don't have a regression mhm do you have
any and I'm asking this because I'm kind
of interested in this this project
called Vision zero okay right
um do you do you have any testing
techniques or know of any testing
techniques for say reproducing adverse
events like collisions like can you kind
of test for hey does a certain type of
behavior in a car actually cause a
collision so these tests are a little
bit different they're lower level than
that so what we test for is we take each
individual process and processes really
only do uh they have very narrow Scopes
so we'll say like is the car parsing we
take in can messages and we say did we
parse the same car state out from this
um so it it's much lower level you
probably want to ask the research team
this question um they have really great
tests for this stuff thanks so much for
that feedback it's super
useful uh yeah can you talk a little bit
about your segments you use for testing
and validation you mentioned um do you
are you kind of continually changing
those out over time as you get fresher
data off of more recent open pilot
versions or is it kind of just one big
list of segments that you're
continuously building on over time so
the big list we build on over time is
the ones for cars um we have several
test segments for each car we support um
and we have like this 200 line unit test
it's really great uh and it basically
ensures the cars never break um this was
this turned out to be a problem um up
until maybe a year or two ago where uh
you know there' be some minor aggression
in all these cars especially since we
don't have one from each platform um so
that one we continue to build on over
time um for other tests you generally
get a pretty good coverage um from so we
have to update them uh occasionally when
there's new outputs and new inputs but
uh largely no we don't have to the next
step for this is like fuzzy testing um
and you want to really search over that
whole space and uh make sure you get
full coverage and generate the
data hi I have a question um which car
brands are the easiest to support and
the hardest to support Sport and do you
have any thoughts on their software
engineering practices and
quality um so easiest to sport this is
really changing now actually um the
software Platforms in the cars at least
for the ad ass um were pretty stable for
about like 3 four years and we did a lot
of this initial work maybe three four
years ago and now we're in this cycle
where you know Honda Toyota Hyundai a
lot of them are changing their uh their
platforms right at the same time so
that's the hard part right now is we're
getting kind of this influx that are all
all different right now um the hardest
ones now are the ones that Implement um
the autosar um secure onboard
communication we haven't spent much time
on it but uh that'll be a little bit of
a project it just adds more overhead to
porting a car and I think you had a
second
question oh um I mean we reverse
everything so sometimes we see some fun
stuff but largely it's you know it's the
practices of the tier one um the worst
part is sometimes the apis just don't
make any sense at all and we have to
hack around that hi I have a question on
the community collaboration so um what's
the expectation as far as for you know
proper communication and also the
quality of the PRS that we do like what
what's that like and uh we have a lot of
PRS that's being you know being being um
opened with C with open pilot uh repo
but uh always getting a lot of time like
the time to get them merg or get them
you know even review is a long time so
what's the expectation that um the
external developers or collaborators
should be
expecting
so um as far as communication
um we tend to merge the things that are
pretty immediately mergeable pretty
quickly and then we have to prioritize
essentially what is valuable to us right
now um there's a lot of the ones that
are open are um maybe there's like a lot
of reactors that are like of
questionable value that maybe we should
just close um um and perhaps we should
have some kind of autoclose mechanism
that's um we can certainly improve this
but uh for things that are like pretty
immediately valuable we'll try to
provide good feedback um immediately and
try to get them merged but it it it
essentially goes through the same uh
prioritization as the stuff we work on
it's it's really quite a small team um
that's looking at this
stuff hi so um for all the uh testings
are being done on open pilot what's the
process like of uh developing a test
case developing a test case Okay so
usually the way this works is you write
something then you say okay I'm not sure
if this is uh this is going to work
quite the way I expect then you write
the test case um so generally we have a
lot of the kind of General test cases
that are end to end written already and
then now it's more of a specific unit
test cases that get written I mean you
can look at the I was looking at the
open pile commit history this morning
actually um to get a nice picture for
something and uh it's like mostly tests
so that's what you see these days things
that like regress a little bit and we
write a test for and we say okay this is
never regressing
again hey uh just wondering if you could
share any insights into your AEV Deep
dive which brands did well which brands
did not so Honda Bosch I believe was uh
was the worst performing um there was
actually fun when we were testing it we
had to put a license plate on it I think
we had to put a German license plate to
get it to trigger um yeah so the funny
thing is they release the testing
procedure so you can kind of engineer it
um it's kind of like the fuel emission
stuff where you know sometimes they
engineer a sort of demo essentially for
when they do the test um but again it's
we'd have to like fully reverse the
systems to understand how it worked it
might have actually been looking for
something that was real um but it's
probably time to redo that test we we
support a lot more cars now and we can
do redo that blog
post um I had a question on steer torque
do you only do you only use torque for
for uh rate limiting or do you use steer
angle ever uh so it depends on the car
uh we essentially want to limit the the
two things we want to limit are lateral
acceleration and jerk um these are
actually specified in ISO
11270 um so we have to limit essentially
what the car gives us we develop a
safety model or a safe an implementation
of the safety model for each car as it
comes um we recently supported the Fords
um and the those you know they don't
take torque um we give it curvature we
have to develop something around that um
fortunately for a lot of the
eps's don't provide enough torque that
exceed the iso 11270 limits some do um
and we but we implement the safety
nonetheless for all of
them you spoke a lot about Cloud testing
with CI um but you sometimes do Hardware
in the loop tests so can you elaborate
more on um how and when you do those and
any best practices you adhere to yeah so
best practice here is we do them on
every single commit um
there if the test is something you have
to run manually it's just not going to
get done sometimes uh you're less likely
to also make the change that you want to
make um the the best feeling about CI is
like you know when you're at home you
want to make a change and you're like
you know open by public it's really easy
to like go in the GitHub editor it's
like oh let me make this quick change uh
and it's like do I commit to master
small change you open a PR um and uh you
see the green check and you just merge
it um it's like I I don't feel like it's
going to you feel really good that it's
not going to break master um and I do
this pretty often where I go home at
night I'm like oh I want to make this
quick change I end up merging it that
night go to sleep and I'm not worried
it's going to break Master because we do
have like 400 users who run the very
very bleeding edge um so if it does
break Master they'll let us know pretty
quickly
um
uh hi um it sounds like you do uh a a uh
CI on pretty much every commit yep um
does that also go for uh hardware and
the loop testing or is that more less
frequent rather nope okay on every
single commit and in that case um how
how long do you run those Hardware in
the loop tests CU I've seen open pilot
bugs that don't manifest until the comma
has been running for a few days um like
what kind of bugs like uh uh low IPC
rate errors um failure to engage after
being on um doesn't turn off when the
battery gets low things like that do you
run a fork no just uh regular release
channel oh okay we should talk about
that after maybe but uh so we have some
different infrastructure for that we
call it the testing closet because it
actually started in a closet in our
maybe two offices ago um when we were in
a house and it's essentially just dozens
of comma 3s running
continuously um and the hardware and the
loop tests are like normal unit tests
that need to run on the real Hardware um
to validate some um some things that we
can't reproduce on like Cloud C Runners
like using the DSP and the
845 lot a question uh what motivated the
desire to actually assemble the pcbs and
Boards in house like what problems did
you guys run into from like contract
manufacturers we uh use this company
called circuit Hub and you know got thr
them under the bus what's
up they were good for the comma 2 they
weren't good for the comma 3 yeah things
got too complicated and now that we have
this it was uh it's really incredible
for prototyping we can like essentially
have CI order boards every Friday and it
makes so much sense it's like $200 for a
bunch of boards we just run them through
the line it's really fast and easy um
doing revs of the comma 3 took forever
um so
it's uh it's really a superpower in that
regard too but we've been doing some
really great tuning over the last couple
weeks on the line and uh find like the
really littlest things uh we catch in a
production we stop the line immediately
we go and fix the thing you know and
we're able to do the same things we do
in production but on the boards
themselves yeah we can tweak every
little detail
yes I just have a question on capacity
have we ever have capacity issues ever
and when multiple users you uh using the
software whatever something like it does
that ever cause Peak and have to
distribute it I'm sorry what kind of
issues uh oh my question is related to
capacity so oh capacity issues yes I I
run out capacity issues and then how we
distribute the multiple user using same
time like uh do that the peak you know
the peak values for that multiple users
using at same time yes well everything
runs on your device so there's no issues
like that you don't need to connect to
the cloud except for navigating on open
pilot but that just hits like a a tile
server and a radic server so uh the load
is pretty low
there uh do you have any kind of special
process to integrate tests for driving
feedback you get from users for like
consistent disengagement spots across
open pilot versions um like for instance
there's an express lane that I drive on
and it's consistently Tak tried to take
the exit um across you know op 090 91 92
it did good on the way to the airport uh
a few days ago on 94 but I had a lead
car in front of me so I think that
definitely played into
it that um driving behavior questions
are generally best asked uh for the
research team wishing is going to have
some really great stuff on this um on
like this engagement analysis um we have
a driving feedback Channel Discord where
there's like a nice form you give it a
route as long as you upload all your
logs so if you ever want something
looked into by us we love looking at the
bug reports um but they have to be you
know you have to put in the effort to
make it really high quality um I mean
just put in the effort and it'll be high
quality so don't worry too much about
like don't worry whether it is high
quality so just continue to make the
reports because i' I've reported them
all you know I try to try to do the
feedback but um just was curious if you
had a specific process to like
prioritize those or you know kind of
make sure that there's no regressions
um so we do look at everything in that
channel we look at everything that's
reported essentially and we if it's
something that looks a little bit
concerning or that looks like a
regression will'll evaluate whether it
actually is or it regressed in like some
very minor cases and we we prioritize
that way we do look at everything that
comes in so thank you it's not always
easy to respond to
though yeah generally I would just like
to thank everyone who's made a good bug
report um I think people don't realize
how valuable yes give it up for bug
reporters um yeah that slide really
should have been bug reports bug reports
bug reports truly I think people may um
not really fully realize how valuable
the reports can be to the team you know
we're team so small and we have about 12
cars ourselves I feel like we don't we
don't talk too much about our cars but
you know so we're testing things but I
think people don't realize how many
varieties of cars how different
different each car is um and so it's
super helpful to the team to have that
information when they're doing bug
reports um we have time for a few more
questions down here I'm gonna great I
will come back
over so I'm just going to reward a
question I think I heard because I think
it was a really important one okay so
you have a closet or room of Hardware
that runs Hardware in Loop tests you
might also have some infrastructure that
can run tests like unit tests yeah when
are times when that Hardware or
infrastructure sort of maxes out because
you have too many requests to run tests
or do you not observe that happening so
it's since we're open source project
GitHub gives us um GitHub actions
Runners for free um we actually like
upgraded our GitHub plan so that we get
more concurrent Runners and it was like
I know a few hundred dos more a month
and we just get unlimited CI from GitHub
um every every month because we're an
open source product so that's really
cool and then as far as the hardware
test we have to scale those sometimes um
and we just add more devices in the
closet that's a little bit hard to
maintain um because the team is so small
but um we are generally able to keep up
with
that guys a testing closet is like a
nightclub it's just it's very loud it's
very important yeah I keep I keep it
right next to my desk I don't know how
de Works uh around all the
alerts oh yeah I just have a question
about like um safety uh which is related
to like uh total model failures so I had
a situation one day it might sound just
unbelievable but like a bird like took a
dump and it hit on right where the
camera is looking and it covered a lot
of the camera and then the car uh the
model didn't like it didn't give any
warnings or but it was a model failure
and the car just went straight and I I
had it immediately disengage and turn
turn on my windshield wiper um so like
for and also others like uh sometimes
the model like it incorrectly predicts
where the curb is and it rid on the curb
and stuff like that but when it does
that it there's no indication that there
is a model failure happening um and it
doesn't there's no loud beeps or
anything like have you guys considered
maybe like putting in like a warning
system for like yes so two things there
um you use the word safety uh we have to
be very careful about how we talk about
safety um so I talked a little bit about
this we have a safety model uh and to
recap that it guarantees that if you
press you're always able to retake
control by pressing on the break or the
cancel button and it'll never do
anything um too quickly for an intentive
driver to take over um so if that fails
that's perhaps a safety failure um but
anything that the model does or open
pilot does is essentially considered qm
so your events are considered bad
quality um
so it's just important to make the
distinction there and then as far as
those things we had this alert that kind
of detected device folling model
uncertain um we just found there was too
many false positives you would be pretty
annoyed if you got one when it was very
clear you shouldn't have gotten one so
we we can revisit this this was maybe a
year ago that we removed it but uh I
mean I I hope the the bird one was
pretty obvious for an attentive
driver uh I do have a question on safety
so uh earlier mentioned that there's uh
we're going to increase or maximize the
low speed torque so there are some uh
collaborators in in the community let's
say for Subaru or for Hyundai hkg um
that they want to get involved in this
the implementation of the low speed
torque now uh we talked about that we
have to do injection testing and we're
getting more data and more
documentations on how the testings were
done so is there anything that moving
forward from the open pilot team that
can provide some of that documentation
publicly on how the community can get
involved with that so we can kind of
speed up up the process or you know
anything like that so the thing that's a
little bit hard for the community to do
is to get from0 to one on this um so I
would suggest that the community you
know Waits until we do it for the first
car which will probably be our ev6 um
because that's what we did for the taco
car um there's a the first
implementation of it in the taco Branch
um for that car and then the community
is really good at taking from when we go
to 0 to one and saying okay let's ship
this on all 250 of our cars um so I
think that's the appropriate time for
Community get to get involved but the
safety stuff is pretty accessible if
somebody wants to just get ahead of this
um read ISO 15622 and ISO 11270 they're
very readable they even provide testing
procedures um so yeah that's what to say
about that we've got a question
upstairs hey thanks uh nice presentation
I was curious if you guys um also track
the code coverage uh you do okay cool uh
what tool do what tool do you use uh so
so we track it with code COV um that's
at 70% right now but uh it doesn't
really cover everything uh I mean that
70% doesn't cover everything so it's
really quite a bit higher um but we
really need better code coverage than
just like line count uh that's probably
a project that we should do soon um
because it's not completely obvious it's
something that like a few of us have in
our heads um but it's not completely
obvious to an external contributor like
I'm making a change is this covered by
the tests generally the answer is yes um
especially for the things that the
community tends to want to change but uh
it's uh yeah it's something we should
drive up and we should really
communicate when you're making a change
whether uh whether it's covered by the
test and how well it is I think that's
what you really want with code coverage
yeah yeah yeah cool that sentence we've
got one last question
here hey yeah general question what does
your system look like for learning from
Real World edge
cases so that's another question for the
research team
okay all right thank you so much
ad
don't worry we're back we're back we're
back and we back and we back and we back
we're back we didn't we didn't
i i some some some scopies were mad
that you didn't get to come to the gas
station with us it was actually really
cool uh we met a nice guy
traveled all around
uh the country because it was in the
army
i forgot to shake his hand and then he
called me outside yeah that's right be
nice to the people we meet sorry
george people are asking you to do an
impromptu freestyle on my instagram
that's crazy all right they might be
they might be
remember everybody might be a potential
comma ai customer yeah so in the
interest of new corporate communication
right you have to be nice to people and
that's why we went back to the school to
talk to the fourth and fifth graders
genders we didn't we didn't buy you a
slurpee he was asking for honestly but
we did buy water joe we did buy water
joe yeah caffeinated water
contaminated water what the heck don't
you we should really just
what if we really figured out how to
monetize next year's self-driving car
awareness tour no like i really think we
could when we do this next year we have
to figure out how to get real corporate
sponsorships yeah we could
we're shilling to thousands of dedicated
fans this is like better than like
instagram models
right
um
people who are like in our demographic
we'll just have to set up sponsorship
deals we're gonna get the next one
sponsored but this year it wasn't
sponsored it was a good lesson it was a
good lesson but but that's why the
title of this periscope is what it is
yeah because without your continued
support comma ai does not continue
exactly oh wait i love that idea we'll
get a sponsor next year just like jimmy
wales and wikipedia
um without jimmy wales wikipedia without
your donations wikipedia doesn't coffee
for two dollars that together we're
really trying to save money and we
talked about me not eating food but two
dollars i thought we could splurge
coffee and a doughnut two bucks i got a
cinnamon sugar i got vanilla blaze
reminds me of cy days i got something
sugar too
great choice
we are going
oh my god are we going north or south
north going north it looks like
59 no way we have 55 subscribers
55 scopies 61.95 we have 59 yeah
39.59 no someone says the internet's
crappy
i'm sorry i apologize for south dakota
hey maybe you're holding it wrong
come on block antenna gate all over the
internet all over again no there's wrong
ways to hold cell phones people don't
like yourself
oh no that's why eons are mounted like
this that's right
yeah no i'm sorry we didn't bring you
guys at the gas station i feel a little
bit oh my boy sean what up
no it was cool though it was actually
nice to meet the the
guy but like it would have been like
you're meeting like 60 people here it's
a little overwhelming overwhelming you
know yeah
you know those like youtube stars just
like walk around la and live stream or
whatever i don't know how they do that
right yeah
i could totally do it could you yeah
we really want to be on your show to
reach all of your no casey neistat sucks
i don't know i don't like like his older
stuff was okay but i feel that he's just
become so corporatized oh he's so
corporate but that's the point i think
he's realizing and he's like getting
depressed about it i mean he should be
depressed about it that's that's like
what i mean right all the videos were so
good everybody should be depressed about
becoming corporatized because like then
what are you what are your values right
that's a question that you really have
to ask and yeah
i tried i watched his videos once and i
was like
i'm watching someone live instead of
living
i was like oh yeah
it kind of freaked me out i was like why
am i watching someone
do shit
their lives are just better than ours
you know but you can make your life but
the reason why it's nice watching casey
neistat live and living like his mini
vlogs are almost like tv shows when
you're watching tv shows you're watching
the same thing we're not spending our
air time showing for casey neistat dude
we
we shield for beat cash we can chill for
casey neistat that sucks i show for
water joe because it's amazing oh you
know what i show board
guys if anyone's out there anyone out
there ever has trouble uh packing their
bags you gotta get some packing cubes
packing cubes change by the lights
if you're on a long trip you need
packing cubes you need your your socks
and underwear separate from your shirts
you need your warm clothes in one one
small cube a large cube showing for this
trip
i love packing cubes apart from casey
neistat i'm sorry i'm sorry to
dude i'm just a little worried he's
gonna watch this i mean i don't think
that highly of ourselves but i'm still
just what have you been showing for this
i don't think i should
don't show yeah i'm just saying like
this is an interview to potential
sponsors next year we're putting on a
show for you oh you're right right this
is how good we are chilling okay
i want you everybody to look
two days ago we shield for bitcoin cash
now bitcoin cash is on coinbase and gdax
we didn't know by the way we did not
know i'm not saying that correlation and
causation are the same thing but i'm
just saying if we show for you good
things happen to you yep
we made 1600 today so far maybe even
more
um but guys what we're really showing
for here is common ai
yeah that's who we are this car is
driving itself right now with hardware
from the shop at shop.com.com
also believe it or not these periscopes
are not scripted this is very good
[Music]
this is real would anyone believe they
were scared i don't know what else
they'd be like you guys are amazing i
can't write this yeah you can't write
this yeah you can't write this you can't
write this
script you're trying too good
imagine trying
no these are not pre-recorded virtually
chris
no they actually are pre-recorded we
predicted you were going to say that and
now
uh more talking is telling you to eat
more protein george
what i mean
dude when are they going to make water
with protein in it they're going to make
water with dawn
need more protein did we purchase last
night yeah we did
on pizza but still
we went to this place old chicago yeah
we're gonna have like a 2.8 on yelp yeah
we have no idea why
it's lovely yeah good pizza good service
kind people i think it deserves like a
4.1 yeah hey how much you want to bet
their sales are going to go up
we shell and we don't even know it we
don't even know i don't know we just
chill by the way sweets
sweets have been nice s-u-i-t yes
three beds yeah i didn't even know these
things existed man
sweets have been great sweets have been
great um somebody's asking wait wait
time considering we have no money we
have to cut back so we're sleeping in
the wrap four tonight yeah um okay
we're sleeping we're sleeping in the
rav4 in la crosse uh
wisconsin yeah
no unless unless people buy things right
now give com ai employees a place to
sleep yeah that'd be nice yeah i'm part
of the interruption uh this upcoming
bridge is brought to you by have a
shield for every product or we can
reshell we'll reach brought to you by
the eon
this is the common eon right here and
look it looks just like that one just
like that one redundant just like this
one you can have your very own eon at
home this eon oh
the build quality of this eon is
actually no it's really good but don't
you want black screws in there no no no
black screws are only for our internal
yachts oh gosh oh wow jordan kevin is
asking when you're gonna drop it on the
track everyone's asking
i know i really i want to do something
i'm going to work on it when i get home
like i'm not even kidding like if you
guys listen to 5am in silicon valley i
put some real effort into that one last
year
i try to put effort into like like
and and the one i have on spotify it's
called the cold war because russia is
cold
um
are maybe uh
the only tracks that i really put effort
into the other ones i kind of do it a
day i want to do i want to do a good one
this year
you can reflect on your past week and
you know how maybe your dream of being a
rapper is no longer the dream no i want
to reflect on my last year to be honest
yeah guys
i know like every music musician says
this right and and you're gonna hear
this and everybody all the fans are like
oh yeah come on man that's not true
you're so cool right it says what being
on tour sucks oh yeah but being on tour
is is this like kind of miserable
just you you have to just go go go when
you're going from like place to place
and they don't even have self-driving
cars because they have bus drivers well
shout out to the small bands that go on
tour in like fans and like they're
outside
and do like random shows that you don't
necessarily get paid for shout out to
those people bro like that's amazing i
know there is something so like romantic
and honest about that life though yeah
that i worry that like this sort of
wasn't like here we were at billionauto
toyota come down to billionaire toyota
they have the best prices on the
december to remember like
george you like arby's we're going to
get you all of those tantra clementines
why is george always in the driver's
seat because only i
dropped the pilot
yeah i drove for an hour
this was originally gonna be my road
trip you guys george how would you do a
periscope george how would you have done
this how would you have done the store
eddie and i took charge of selling seven
things within the entire
we spent extravagantly on this tour yeah
we did
not really you guys we've all like 80
dollars 100 dinners for three people
yeah i mean i don't know if that's
extravagant how many disengagements this
store someone's asking yeah of course
they've been disengaged because you've
seen we're gonna we're gonna make a blog
post about how many disengagements what
percentage we were driving adversely
really
i would like i mean i wouldn't
conglomerate all the video of america i
would like conglomerating the video yeah
yeah we'll try to do something but to be
honest it probably won't happen yeah
it depends how many sales we get if we
can get to 10 000 in sales today today
that's it we can get so we're we're at
we're at 1600 right now if we can get
that up to 10 000 today we will write
you guys the most beautiful blog post
you've ever seen we'll really go over
this maybe let's make it a more
achievable goal seven thousand seven
thousand seven thousand shop.com dot ai
um shop.com dot ai if we can sell seven
thousand dollars
worth of worth of merch
um if you wanna check it and see if it's
going up at all
i'll let you guys know oh tech tim's
saying we should ask elon for some of
his hat money
yeah elon guys i feel bad elon's broke
too
elon is so broke like trying to make
those model threes
like the investors tesla's like the
highest most shorted stock on the market
oh i like tesla so why i think a lot of
them i think a lot about
and you'll get them on you'll get them
on twitter there's people who are really
emotional about shorting tesla i'm like
oh my god you're gonna lose money and
you know what the worst part is you're
going to lose money and you're not going
to be able to admit you were wrong yeah
right it's like the people with bitcoin
holy shit two more orders we're at 1828
1828 yeah we love our scoopies we love
our scopies you get us up to 7 thousand
dollars reverend is joining us hey bravo
hey reverend what's up tell your friends
we're having a come ai shopping drive
today you get us up to seven thousand
dollars
we lowered it from ten we made it fair
it's not being lowered again only seven
seven thousand dollars we will put
together the the best
blog post from this trip showing
disengagement showing when we were
engaged with maps with everything with
everything video conglomeration of
america yeah we could yeah you guys
joined us for this road trip but you
will join us
you will really like like data if you
like facts and data with your seven
thousand dollars we will be able to uh
afford a bit of engineering time to make
this happen yeah but we don't get to
seven thousand dollars by the time we
get to la crosse yeah lacrosse lacrosse
if we get to seven thousand before we
get to la crosse blog post if we don't
no blog posts yeah you know what i mean
so sometimes corporations reach out to
work with me and i basically do this i'm
like okay tell me exactly what you want
what you're willing to pay for and wire
me 10 as a down payment by this date
and they'll do it and they'll go back
and forth with bullshit and bullshit and
bullshit right and then the date goes by
and then they still want to talk about
more bullshit i'm like guys no you have
to send me the thing by that date
there's nothing to talk about right like
that's just how it is um so that's how
it's going to be with the blog post but
if we do get a 7000 it'll be beautiful
it'll be beautiful guys where should i
post this live stream right now uh some
some restaurants
just get it out there yeah reddit so
good i feel like i need to i feel like i
put down the rv's um free uh apple
turnover so i just need to chill for it
a bit more and say thank you arby's
thank you because that was really kind
and thank you
wow harvey's actually gave us apple
turnovers yeah we had some real
corporate sellers we do appreciate this
a lot we really do really like the high
point of fucking can a scorpio out there
post this on our our self driving
or some r
something post it wherever you want just
just get it out there i mean i think
what a lot of people really don't
realize like we'll get questions
sometimes where it's like
is the car driving i'm like guys i know
you got to like put your hands higher so
they can see oh my god like guys what
what no no we actually brought like a we
we're hiding a midget in the backseat
with an xbox controller you think we
have the budget for a midget and an xbox
controller
a little person an xbox controller these
are george's feet
they're off
yeah maybe we'll just just remind them
uh every once in a while every once in a
while here eddie so we are that we are
self-driving oh they're is it their
first day on periscope yeah oh
congratulations no wait you know when we
really clap when people buy stuff
don't show anyone's personal information
though
we're not gonna uh we're not gonna like
call out your name on anything unless
you call yourself out on periscope and
we're happy to shout you out yeah
don't worry don't worry yeah keep those
orders up
let's see if we can get to seven
thousand dollars seven thousand by the
time we get to uh
by the time we get to uh the car maybe
we get to 100 000 more release the honda
eps flash yeah
oh man
just piss some people off um so yeah i'm
going to reset the thing right now see
that's my timeout oh you know oh we have
to test it we have to test it
out
so i'm going to show you guys what
happens if you're not paying attention
it should eventually slow down
it should stop accelerating we make the
safe decision of continuing to steer and
break not just a bp but a disengagement
that's actual safety not legal safety
vanilla gorilla is upset you teased
about the eps i'm sorry vanilla gorilla
and then the people were upset that we
didn't bring them into the gas but i'm
just letting people down today you know
i didn't let down though fifth graders
the class of fourth graders and fifth
graders i was almost like i'm actually
first of all yeah that's true they're in
the second and third graders
no well the
the fourth and fifth graders they wanted
demos i hate doing demos you guys okay
so now allegedly i'm distracted i'm not
don't worry
um
but we're gonna we're gonna see what
happens
so that's the bar you can see there's
only a tiny little bit left
the pigeons be available for contests or
community videos probably not we want to
just get them out there
now it's saying take control to regain
speeds we should start losing speed it
looks like we are i think we are yeah
yeah 64.66
so that's what happens but now if i
touch the wheel oh that was beautiful
this upcoming bridge is brought to you
by the comma ai panda the panda
[Music]
probably sells cars pandas are a good
friendly brand yeah we reached out to
panda express on twitter to be the
exclusive in real life distributor
ai panda they haven't gotten back to us
yet but if anyone out there we didn't
get why i don't yeah i think that but if
anyone out there from express is
watching right next to your sugar
chicken sugar chicken and sugar chicken
you can put common ai pandas and it's
never too late to start sponsoring next
to yourself driving road trip you know
you just have a trigger yeah seriously
no i really think we'd get sponsored
why why people with uncompatible cars
should buy a panda panda lets you
collect more data on your car lets you
reverse engineer your car
see sensors like
door sensors individual wheel sensors
rpm speed
anything you want to know about your car
you can get with a panda
and it is also except for their dash cam
it is also the first step to making your
car path yeah so you'll need a panda to
get into your car find out what's going
on and make your compiler compatible
with your car
does all of alex roy's cars have comma
i really i don't think they realize
enough but like got to buy the common
giraffe
how many copies we got 65 65
yeah these are the common giraffes it's
a honda one it's a toyota one they have
little switches on them to switch the
switches
i think a lot of people don't realize
that we really are in a self-driving car
right now
yeah i think they don't realize they
don't get it no i mean i think they're
like like they're like
what is this right yeah a lot of some
people were really confused like someone
was like what did i just stumble upon on
this pair what did you stumble upon you
stumbled across three in the future
damn
it was called a draft because it has a
long neck like a giraffe
which came first the honda or the toyota
yeah right yeah
yeah these commas feel real nice when
you're on your finger across it yeah
yeah that toyota giraffe is the highest
quality print of anything i've seen on a
3d printer i don't care why it's
something about the design
it is it is good yeah
yeah really cool
um we 3d print all of these in our
basement yeah
uh someone's asking can you switch lanes
and self-driving but no lanes are kind
of gimmicky and yeah i mean look like
you can right the truth is what i've
heard from actual tesla owners who have
that they're like it's kind of stupid
like i press the blinker and i wait for
it to change lanes you want to switch
things to this system yeah put on the
blinker i'm not even disengaging notice
i'm putting on the blinker recharges the
health bar go like this
put yourself into the lane and let it go
and there you go i just did a lane
change right yeah it's like
it's faster than the system would do it
it's like it just like i've heard like
people are frustrated by the tesla
system right yeah i'm going to change
this lanes back here like yeah i put my
blanker on and just like like look at
how little i go to the wheel right and i
kind of it pulls us in behind that car
a little bit let it go you guys someone
at the car dealership was telling me
that back in the 70s he used to do like
the drive from kansas city denver all
the time and he was so bored he would
take a broomstick and just shove it on
the gas pedal and keep it at like 65 70.
that was his version of christmas
yeah how brilliant is that
it was like too bad i didn't think about
it at first i was like yeah uh chem
thick is asking when do you guys think
you'll reach level three
when we do real question is when we're
going to reach the cross yeah because
that's when we have to be at seven
thousand dollars if you guys want a blog
post also uh this bridge is brought to
you by the kamehameha
which is on sale and
we don't have any right now because
they're so exclusive guys let me tell
you something
hoodies are only going up in price like
they're really you know processing power
doubles every 18 months hoodie price
doubles every three months
it's even less honestly we've already
kind of doubled the price by only
shipping one hoodie instead of two read
the comments on the comment ai buddy at
shop.com ai where we tell you about
choice yeah it's really not something
you want to lose no honestly
everybody out there right now even if
they're not looking to buy something
just go to shop.com
experience experience videos cool come
come come into our store uh campfix
asking about our deathbed
oh our depth just like what it is how it
works it's at home
it's not here with us it's not driving
the car you can't buy it and you can't
buy it
but
it's definitely it's tapping on the
camera takes in a picture and it tells
you how far away shit is i'll tell you
guys a little bit about it um the
architecture kind of looks like a unit
architecture
uh it was trained mostly on grand theft
auto because you can get easy ground
truth depth on that
um
yeah i mean there's lots of papers that
show this kind of stuff off we're
working on supervised depth nets which
are working like sfm learner um to uh do
reprojection from right you think uh
depth you know this car has two cameras
right
you see the two
well it only looks like one to you
because you only exist at one moment in
time
but if you look at two moments of time
you have one camera in each moment
they're actually different places
i have to hold it here uh so it doesn't
go for that accent i didn't want it to
go to spirit
someone's asking so shifter plus now is
fcw for vehicles without radar no not
without radar now but if your vehicle
has radar connected to it it doesn't
need open pilot support it just needs a
radar yeah um so like all the hondas and
all the toyotas will work with shifter
you see this scenario here he's slowing
down so we're just going to keep going
that was kind i know he slowed down he
didn't have to i wouldn't most people
didn't yet yeah people here are crying
they're not like california drivers yeah
it's true
but they do they do like they like see
right the car is sleeping yeah yeah
eddie hold it so it's like i'm fixing
about like memory issues with neural
networks
uh what do you mean by memory issues
you're talking about how they don't
remember oh yeah yeah
no
forgetting it's not going to be a
problem in depth
um forgetting is going to be more of a
problem as our driving models start to
get more sophisticated and we have more
edge case-like behavior yeah
they would post this in our self-driving
yet we'll post it on our self-driving
how's it doing i don't know i don't have
a
reddit account we had one of the top um
posted ourselves driving when we did an
ama from like an early version of car
yeah
i read that before
it was jake was a comedy we are
literally in a self-driving car right
now ama
yeah
uh tech tim's asking when you buy an eon
you can install open pilot yeah so if
you go to github.compilot
[Music]
virtually chris has a video out there
how to do this well okay we have to be
clear though there's no official support
for that yeah um after you modify your
own we do not officially sell anything
that drives cars we do not officially
support any hardware or consumer
products that drive cars um so you are
on your own that is kind of a uh
some emergency vehicle up here i'm going
we're using the car's built-in radar the
eon has one forward-facing camera the
neo did not have a radar the vo is
pretty much
the same uh
capabilities as an eon
eon has a better thermal solution it's
able to dissipate about 15 watts instead
of about
five beyond as shitty shitty heat sinks
you could do seven i guess but um we
have like thermal paste with a custom
heat sink on the eon that's what lets it
uh
do so much more 0.4 draws more power it
draws about 10 watts instead of seven
the fan has been so nice too yeah that
was upside down that's the fan policy
channel
changed wow this car has gotten softly
thanks to ricardo this thanks to
ricardo's gotten better this trip thanks
to ricardo and andy
the home the home crew yeah uh they're
doing a great job can you hold this for
a second yeah i got you take off okay
yeah no problem
what's the car it's a rav4 what was that
beef
that's what you're taking my belt
oh my god that's terribly annoying
yeah you got you got to stay alert for
beeps you know it's a level two says to
make a dislocation
0.4.1
new models yeah they're coming someday
soon
um no we're actually
this sort of model with like the two
lanes and the path and the lead car
this is the last version of the model
that's ever going to be like that
um the new models are a new architecture
we're working
yo hold on reverend just said ricardo is
tied for my favorite comm employee and
i'm a little worried who he's tied with
so previn if you don't mind sharing yeah
we got uh some you know curious people
yeah he's gonna say andy
andy yeah
yeah
how's this upper angle the people like
this
yeah that upper ankles
the selfie angle
so see here's the thing
yeah what up reverend he said i'm pretty
awesome
we're going through this piss
virtually chris is asking what the new
architecture will look like
um
so it's going to just directly predict
the path
it's going to like the path is going to
be a direct output of the model no more
lanes
the guy in front of us just swerved a
guy in front of us see that's the thing
like people think oh dude hit the rumble
strips once
um do it all the time the other thing
too is like he probably does have a
cruise control set at like 70 or
something yeah
but his 70 is not a real 70. it's
actually 68. speed limit is 70 here
so r70 is a 370.
the car says it's 72
what do you guys do for jobs
hey jobs
the ai's taking all the jobs guys yeah
no one's gonna have jobs
i mean our job is to put our jobs at
adam that's right mission
we're working hard towards it it's good
man but we're all gonna be real rich so
that's the hope well well we'll see if
we be real rich now we can tell if we'll
be real rich orders orders go to
shop.com
right now just touch the wheel clearance
like we want to know if we really need
more cameras so we wanted to do this
disengagement tracking
system when we
do feel limited by our single camera
we have uh
scenarios where the system disengaged
where another camera
would have helped us not just
we want very deliberate motivations for
hardware
additions to the system yeah hardware
costs money hardware has recurring
expense software only has non-recurring
expense so you always want to do
something you know
if you can in software that's like
featuring obviously this box you always
want to fix your bugs and hardware but
you don't want to work around hardware
bugs and software but if you can replace
more or more expensive hardware with
software you should always do this this
is why cameras are going to be lighter
but you know something
ricardo right now i think that this open
pilot is ready to release to the public
um so we're going to push it probably
tonight to devel
you guys can start checking out
0.4 with all of its goodness a little
bit of retuning
we've been we've been constantly
iterating on this as we go
this things i complain about so by the
time
you buy stuff right now you'll have the
hardware ready to go
when the software
launches how exciting they got the final
thing about the announcement how many
scopes
48 48. we're losing people yeah we
dropped this up 50.
it might be because we have bad signal
uh it was a bad signal
um that's fine you should without that
what
what
um the bug is fixed we just have to
think about how to actually ship it
i just don't
that first think
you know no i don't think so i think
that's why i think we ship without it um
that bug will be fixed soon
like actually soon not even suits you
yeah
vanilla gorilla got his new rear view
mirror
nice printed nice gotta push the neo
does it work
this relationship with violent only
right
uh i think we might have a bunch of
improvements with survivor plus as well
we had a bug with some some wheeze in
her face
was crashing i'm not sure exactly what
the bug was but uh it's fixed now
yeah
it's a little tight yeah
it'll loosen up it should be a little
tight too yeah it's better to be tight
than too loose
yeah it's so annoying i mean it's good i
don't think it's it's good yeah yeah
that is annoying i'm just taking my i'm
taking my uh sweater off you know normal
things that you would do when you're
driving without open buying right
maybe what we should do is we should
increase the time out there now the
issue is we only give people time to get
out of the car exactly
yeah no it's important so we we
disengaged the system if you unclip the
the driver seat belt obviously not the
other seat belts um or if you open the
door
because this is not
right
um just just good general safety things
to have
uh a good cruise control system should
have it too
jake stop coming check jake stop the
game okay stop the car
kept going where was he driving
if he missed an overpass and there's
another one coming out i think maybe
we're done with it yeah yeah yeah we got
44 scoffies
44. i think people are here people are
dropping people are dropping all right
all right well you know what
always always pull a kirk obey to
cripple your head
that's pretty much good
all right yeah we did we did like over
an hour like an hour and a half but yeah
that was that's pretty good we'll be
back wait a second what alex ii just
super hard at us i didn't even know that
was a thing oh my god is this like some
tinder david i hope you're still
watching got it
wait how do you super hard
alex royce says don't leave us is alex
right here alex was here all right all
right i don't have alex choice
no but tim clemons says alex roy says
don't see it leave us so i don't know
alex roy show yourself we can yeah alex
or share yourself we can give him a
little more time let's see we back up
over 50 45.
brutal oh brutal oh someone post this in
our self driving no no we'll be back 11
orders 1957. oh 1957. thank you people
buy thingsshop.com
we really want to sell some eons
there's never a better time to buy an
eon than right now because they ship
right now
um
if you order neon like next week
it'll ship next year i'd say oh if you
want a neon right now it'll ship
tomorrow
yeah
yeah yeah all right how many we got 49
oh they're coming back all right we can
we can hang out for a bit more where's
alex roy i don't think he's really cute
i don't think he's really here but now
we can hang out for a bit more you know
we're just kind of hanging out looking
at the windmills just hanging the
windmills
someone's waving to us now i don't know
what that means did you scoffies like
the one last night
the silence nothing nowhere yeah
yeah panda needs to be out of safety
mode to work for open pilot that's
correct heat nation oh no not out of
safety so pandas have multiple safety
modes oh sorry
the default safety mode is the panda
doesn't allow anything to be sent and
this is the mode used by shiffer plus
and shifter
actually shifter can now switch it into
l mode which only allows elm things to
be sent
um then there is an all access safety
mode which open pilot never uses um the
ones that open pilot users are the car
specific one so there's one for honda
and there's one for toyota
all of this code is open source uh in
the panda reba so github com ai panda we
have the different safety profiles for
the different cars
and they enforce things like torque
limits they enforce things like um you
know if you press any pedals it
disengages all of those kind of things
all right i think we'll leave them here
you know what
we should schedule when the next one is
yeah that's good you think more people
will show up well i think yeah so give
give the scopies that are out their time
to promote it a bit yeah um well we can
like post it on our self-driving cars
say maybe this is the last periscope of
the self-driving car tour we could talk
about our seven thousand dollar goal
which we were actually two sevenths of
the way too yeah um at the beginning of
this one we were only at like twelve
hundred we made eight hundred dollars
since the scope that's almost as much as
we made showing for bitcoin cash aj
lesson is
go go to github and check out what
language the code is written in python
python and see i found it safe but uh
check it out bros by the way python's
driving this car
oh no what if the gc runs oh no
it's fine don't worry about it
uh we checked that
all right
uh what time is the next what time is it
now
15 39 39
all right
5 p.m yep
5 p.m we will be back on the periscope
yep tell your friends we're gonna really
show off the self-driving car i think 5
p.m tonight is a good time to bring in
some new people good 5 p.m 5 p.m guys oh
wait what time zone oh no wait what time
is it now it's it's central time what do
we have i don't even know it's central
time okay it's an hour and 20 minutes
from now yeah
it's an hour and 20 minutes from now
central central
that's like uh 3 p.m pacific time
6 p.m eastern and if you don't live in
america
i don't know what to tell you man tell
your friends enjoy know your own times
Apple.
Um,
you guys are going to like the iPhone
17s.
We got an announcement today.
Got an announcement today.
Are we live? Someone want to confirm?
Tiny coffee. Uh, tiny coffee. There was
going to be comma coffee. Uh, that might
still be a thing one day. We got the
machine, but we didn't. Uh,
we never did comma coffee. No audio.
Audio working. Cool. Cool. Cool. Audio
working. Great. Oh, Nibil's here. What's
up, Nibil? What's up, Nibil? Uh, Nibil,
I think you'll like this one. Uh, if you
know what's what's going on. Seems like
the title is about me. Uh, you know, the
title title is
title first of a lot of things.
Uh, we got House MD in here, too. Cool.
We got 200 people. Uh, I guess people
like this announcement. Uh, maybe we
have some other things to share first.
Just uh some general general vibes. We
can uh we had I bet a bunch of you guys
are users. Uh, I don't know who's driven
on uh 010,
but 010
is the first open pilot release in many,
many, many years that has a real uptick
in uh engagement.
Look at that little uptick.
Look at that little uptick. Uh so even
you can see experimental mode even at
high speed. So, usually what would
happen is experimental mode at uh near
standstill and low speed and midspeed
would be a lot better than chill mode
and then what you'd see is um it would
like really fall off at high speed. But
we're like starting to make up that gap.
Um and there's like a real tiny but very
real uptick um in engage percent for the
first time in like four years I want to
say. Um,
so things are looking things things are
looking exciting.
I don't know if you guys have uh have
you guys experienced the uptick.
Uh, is George at the office? Not today.
No.
Uh,
big tiny grab model. No, it's something
tiny. The announcement is something
tiny. Uh, but you will not get the the
announcement is about an announcement
for something [clears throat] being
tiny. It's an announcement of an
announcement. So, uh,
what's up, Sunny? What is up, Sunny?
Sunny, we got a I've got some questions
for you once we do the the announcement
of the announcement. Uh,
yeah, experimental mode is a lot better
now. Ideally, experimental mode. Uh, so
I commute like 15 minutes. I'm on the
highway a little bit. Um, on surface
streets a little bit. I got some
roundabouts.
Um, maybe we can pull up my engagement.
We can pull up and connect.
Let's see.
EV6.
Yeah. Look at my commute today. See how
green that was.
It's pretty green, right?
That's uh mostly not highway either.
So, definitely getting a little bit
better. Um, experimental mode is kind of
at the point the way experimental mode
has been so bad and so experimental such
that you know you kind of measure its
performance and like if you accidentally
toggle it on, how long will it take you
to notice and switch back?
And uh our rough estimation of this is
like you know you're at like you can
kind of get to the point where it'd be
an hour before you really notice um on
the highway even.
What do you guys use for the So, these
dashboards are like some custom plotly
thingy. Um, but we have some other ones
in Grafana. We should really standardize
it. Um,
350 people. Wow, you guys are really
excited for the announcement. Uh, maybe
we should go check out uh we've been
doing a lot of construction recently.
Maybe we should go check out the
construction. Um, we should do some
we'll do we'll do a little tour. We'll
check out production before we uh do the
big announcement.
Um,
show you guys in the open pilot office.
Look at all these 5090s.
Got the chief tiny box builder over
there. I saw him, but uh yeah, look at
all these 5090s we got.
The computer's getting bigger. Uh you
can see how many devices we got
and then uh how many overall monthly
devices driving around in the fleet. You
still there's still a couple comma 3's
those green little green comma twos. So
there's still some comma twos driving
around. And then we got the little
uptick like we mentioned the engagement
uptick. We want Shane uh Shane works on
a uh really his own schedule. Uh Shane
will probably not be here for a couple
hours.
Um,
firsterson view.
Does com work for right-hand drive cars?
Yes, it does. Yes, the model just knows.
And it'll even tell driver monitoring
model which side to use um on the road.
Comma 40 with 5090.
You do not want a 5090 on your
windshield.
Oh, this is kind of relevant actually.
This is our wall of stencils for some
older products. Um, well, that's
relevant in a second.
Very nice here in San Diego.
And we're going to enter a circuit book
now or SMT line.
So, now
we're in Circus Book. Last time you guys
saw this, it was a little smaller. It
went up to uh this line right here.
There's like a big wall here. And then
we have our original line there.
And uh we're working on standing up a
second line right along here. You can
see there's we're working on some
storage stuff right now, but uh in the
next few weeks, we got a brand new pick
and place. Um, instead of this nice my
700 jet printer, the new line will have
top-of-the-line stencil printer. Um, I
don't know if there's some other stuff I
can show you guys now,
but uh
yeah, so we're going to have the new
line will be uh for like way higher
volume. Um, it's basically the top of
the line SMT line you can get. Um, we're
going to get some like nice uh
electroform stencils. Um, super high
throughput. Uh, we're going to get an
inline vapor phase oven. And then now we
got
the rest of Comp 3X production.
So, you can see they're already pretty
far along.
Got all these nice devices being built.
All's putting the final cases on them
here.
And then they line up on the stress test
later today. We got 55 in stock right
now.
And then uh this is some other
construction we did. You guys probably
remember the fulfillment room was a
little bit smaller before. Now it is
this nice big area where there's a
little bit of storage right now. Um this
is where 3X's are focused.
But this station is very temporary.
We're going to be moving this pretty
soon to our brand new camera room that
we just finished
like yesterday.
You can peek in here. It's our camera
room.
So, we got this brand new expanded
camera room where we have this is where
your D cams are focused. You got a
little D cam.
Drop it in here.
And then uh you focus it up against this
nice little car. And then uh this is
where the lenses get put on. Got a
little jig. West goes here. It gets
these nice lenses.
And then uh yeah, we got two of these
little assembly desks. We got a focusing
desk. And then we're going to move. So
this is for driver cam focusing. We're
going to make like a little fancier jig
and be able to do all three cameras um
at like one station like this. A little
throughput.
That's uh
those are our little production updates.
Let's see. what you guys are asking.
500 people. Wow, you guys are really
into this announcement.
Why does my damn comment is suddenly
after two years not calibrated? I have
three mounts. It sounds like maybe your
you got something loose. My guess is
either your uh VHB tape is a little bit
loose or uh your mount got a little bit
loose. You might want to just pick up
some replacement mounts. Um,
the mount getting loose is unfortunately
like it's really hard to just alert when
this happens. Um, we should work on it
some more. Um, try to provide some
better alerts, but my guess is it's a
little bit of a loose mount.
Comma 4. You guys don't like 3X's? Look
at this guy.
We spent a lot of time making these
nice. We keep refactoring them. Uh
we uh
we're working really hard to make these
quickly as we can. You saw we only have
50 in stock. We're trying to build up
stock again. Um they keep selling too
fast. Common with external cameras. I
don't think you want that.
External cameras are kind of a pain.
Tiny bot.
How many use can you crank out daily?
Um, so if we're really trying hard, um,
we can do about 500 a week. Um,
but we we're building like tiny boxes.
Um, we'll go see tiny factory, but um,
how many days of inventory is 55. It's 2
days of inventory. Not really two days.
So, they're working on building a big
batch right now. We'll get the inventory
back up in the next couple days. Um,
into like 100 plus.
Will the announcement of the
announcement work on the TC? Uh
uh
TC is uh on long-term support. Just do
announcement, bro. We're getting to it.
We're getting to it. We're getting to
it. Is a big consideration. Yes. So,
we've got these like nice that we use.
Um but we're working on something a
little nicer for the whole room to make
it just make it nicer to work in here.
Um it's really important. The factory is
like fun to work in. Just like you know,
you want a device built by people having
a good time. You want software written
by people having a good time. Let's see.
Why else? Why else do you want to do
this if you're not having a good time?
Um, can we get a public dashboard?
That's not a bad idea. We can work on
that. Any news on the headless comma?
What do you mean headless? You don't
like the screen on the screen?
Uh, comma's got a not kamu. Kamu just
had a hardware announcement. If you guys
like a kamu, go vote with your dollars
and then buy a bunch of kamos and then,
you know, reveal preferences greater
than stated preferences.
What's the number one comic car metrics?
It's still the RAT 4. Um, in terms of
individual models, the Rivian shot up
there. The Bolt is kind of high up
there. There's a couple other Toyota
models that are up there. Um,
can't believe George is you guys are
crying. No, George is George's working.
We're all working. We're all chilling,
too. We're all chilling. We're all
working. It's a good time. It's a good
time in here. Um, we we made this one
bigger. Make it more fun. You know, it
should be fun to build this stuff. We
want a comma sweat shop. No, no, no, no.
You want stuff built by people having a
good time. You want your software
written by people having a good time.
Uh, you want your hardware built by
people having a good time. The people
building these 3Xs, they love building
3Xs. Um, and I hope you guys see that
when you get it. I think a lot of people
do. Um,
you know, we're not the biggest team.
We're 30 people. Uh, about half work
down here building 3X's and then half
are engineers working upstairs. Um,
that's it.
Next comment. Grab pressure from the
bottom back of the device.
Protective metal to protect the SSD. Uh,
there's no SSD in the 3X.
Are you seeing much update from Tesla
users now that it's supported? Yeah,
there's a decent amount of Tesla users.
I think once we ship really great end to
end long, um, we'll see a lot convert.
Our device is too big. Please make it
small. Include dash cam. It's kind of a
dash cam. He's
reading all the wrong comments. I don't
know. Is there Maybe I'm not getting all
of them in this app. I'm in the
Streamlabs app. Uh Harold is not here.
He's out this week. Harold is not here.
Who's Harold? Harold's our CTO. He's the
one who pumps out all those models for
you guys along with your seat. Um let me
go check out the tiny factory now. Yeah,
I'll give you guys the circuit spoke.
And look how big it is now. Look how
much room we got for our second line. We
got these nice dry cabinets in now. Um,
yeah, we're getting a My Pro. I think
it's coming later this week. And then,
uh, my 300 DX with two heads. Um, so
very similar to this guy, but, uh, it's
got two heads that move around. Um,
yeah.
What three printers you use? Oh, we can
show the video upstairs. What we got? We
just got a bunch of bamboos. They're
really nice. All
right.
Now, let's check out factory.
Look at all these tiny box Pro V2s.
This is a tiny box we're taking pictures
of. We're making nice marketing
materials for tiny boxes are moving.
Um, yeah, these are Tiny Box Pro V2s.
Custom design for Kama.
Super easy to build.
Um, we stood up like a rack of eight of
these in about a week. Super
manufacturable.
So, we got a few more racks of these
guys going up soon.
And then, uh, we got all these Tiny Box
V2s in inventory. If anybody wants a
Tiny Box V2K
for a short short time,
this is some uh Tiny Box Pro V2 prep.
These are the mother motherboards
yoga room. Where's the
All right, I think it's announcement
time. I think it's announcement time.
Maybe we'll go to Eine. But you see to
do the announcement
since Harold is out today.
Show off your GPUs.
What do you think? GPUs.
More GPUs.
Is this enough?
We are not messing around now. You know
how many commas but serious have been
tried? Turns out we were the real comma
but serious.
Who would have thought?
Who would have thought?
All right, ready's office. Mr. Yine,
>> welcome. Welcome.
>> We haven't done the big announcement.
>> What do you think? You can merge it.
>> Oh, really?
>> Can you go to the website repo?
>> Yeah.
>> You haven't seen
>> Welcome to my tiny office.
>> You see got a new office.
>> Look at this beautiful office. It's got
natural sunlight.
>> Natural sunlight. No AC.
>> No AC. We're getting the AC fixed today.
>> All right. You want to go to pull
requests?
>> Pull request. I had to pause you here.
>> Oh, go CC banner.
>> Anyone know what CC stands for?
>> It's CC.
>> Let's go. Let's click merge.
>> Well, I trust you. I just trust just
trust in merge.
>> Yeah. Yeah.
>> Wait, let me see the
>> This is a good contributor. He's pretty
good.
>> Who's this?
>> Angry washing machine man. Hi, come to
see him.
>> Squash emerge.
All right, you can go to the preview
link in the meantime.
>> Uh, in the meantime,
>> all right,
Comic-Con 2025 is November 8th in San
Diego. You want to click on the link?
>> Let's go.
>> All right. You buy your ticket now. Um,
>> San Diego, Saturday, November 8th, 10:00
a.m.
>> Yes.
>> Wa. Let me buy the tickets.
>> So, we got 20 available. Super early
adopters.
>> 19.
>> 19 remaining.
>> Someone already bought.
>> Oh, maybe Julie tested it. We got to
refund that one if someone was to test
one.
>> No, no, no. I'm going to I'm going to
buy as many.
>> No, this is not Twitter. You know, let's
let's You want to be Twitter? You scene?
>> This is Twitter. You scene.
>> That's not
>> We post him from X.
>> No. Well, he's not X anymore. Not
anymore cuz he's right here.
>> Yeah.
>> Cranking out your models.
>> We got very limited 20 tickets. Super
early adopter.
>> You can get some nice merch, too,
to be swaggy during the event. Nice. X
small. Great. Yeah. So, we have a
schedule.
Whoa, I'm speaking. Nice. [laughter]
This will be talking about some not so
tiny stuff.
There'll be some tiny stuff. There'll be
some big stuff. Something tiny is
coming.
>> And the event is in San Diego.
>> Yes, this is indeed an announcement of
when you can hear the real announcement.
>> Announcing the announcement.
>> Yes, this is how things work. It's 2025.
We announce announcements.
>> This is how things go. So, what's the
tiny thing? You got to come to
Comic-Con.
>> We'll have uh This is so tiny. This is
not so tiny.
>> Well, let's go back to the schedule.
Let's read people the schedule.
>> Schedule. Let's go.
>> It's a big thing. Let's show people's
schedule.
So, all you guys asking about George,
he'll be there. We'll be giving a talk.
Maybe about some tiny stuff. We got
lunch. Uh I think we're still testing
vendors for lunch. Maybe the taco truck.
We'll see. Uh this will be a little bit
different from the last couple comic
cons. Um different vibe, different
venue. Um
it'll have a little bit We're testing
out some new stuff, I think. Uh, we've
got a good vibe. So, we'll see in a
second, but I've got some questions for
the community. Uh, but yeah, we got
lunch. Then Harold will give a talk or
CTO maybe about some not so tiny stuff.
And then Robick, Rob from the hardware
team will be talking. Um, Mitchell, you
did a nav talk last time. Will it be
about nav this time? You got to wait to
see. You got to come.
>> Uh, then a devil talk and then a Q&A.
Then we got booths. So this year we want
to do some fun booths. You know when you
go to like one of those uh you know like
a science fair or something and
everybody's got a booth and you got a
presentation and you talk about your
stuff. We'll have some booths. The
production team will be there. The
hardware team will be there.
>> Can I have the
>> autonomy team? Yeah. Anybody Anybody at
Como who wants a booth will have a
booth.
>> I'll make a little booth for uh for MLC.
>> Yeah. We were thinking of this booth
where there's a whole bin of like 3X
parts and uh it's like you know you know
that Lego bin you accumulate over like
20 years that has all the random Legos
and you have to figure out how to
assemble a 3X and you know if we did a
good job designing 3X's and like really
rediffing it down then you should be
able to figure it out and I think you
can maybe we'll have a race we'll have
like a little leaderboard at the event.
Um
>> if you can make it 3X we can keep it.
>> May yeah maybe we'll figure something
out like that. Yeah, we'll figure
something out.
>> Keep yours. Um, if anybody from the
community wants a booth, anybody who
does like community hardware, Sunny
Pilot wants a booth, let us know. I
think uh Jason's talk was one of the big
successes of uh ComicCon last time. Um,
I love linking that talk. Um, people
love watching it. So, we want to try
something else along those lines. Um,
so if you are a community member and you
do cool stuff in the open pilot
community, then uh let us know. Hit us
up if you want a booth.
Sunny, are you there? Do you want to
commit to a booth right now?
>> Blog post. Uh, I don't think we need a
blog post for this. I heard Shane was
going to do a musical performance. I did
not hear that, but maybe
>> Shane's going to play music for us in
the comma band.
>> Yeah.
>> Well, we we got hit by copyright last
time.
>> Ticket includes a three. Do you want a
comma 3? They're on long-term support.
>> What's a comma?
>> Can I have a ticket, boss? Uh, you know
what? If you get number one on the
controls challenge, you can have a
ticket. We will give a ticket to whoever
becomes number one on the controls
challenge leaderboard or hardware. We'll
give you controls or hardware challenge.
Nine for the first 20.
Thought it was just 20 tickets. No.
Nope. Um there are plenty of tickets. If
you buy today, who knows about tomorrow.
Um tickets will go fast.
>> So the 20 is just for the early bird.
>> Yes, 20 is just for the early bird.
>> Super early bird. Electric Valent.
Great. Great. It'll be nice to meet you.
Uh, love watching your videos. Um, will
there be new hardware? We'll have to
see.
>> Oh my god. Only five remaining. You're
selling like
>> Wait, really?
>> Is that Is that legit?
>> You're too good.
>> Shit.
>> You're too good.
>> Cool. All right,
>> guys.
>> Let's You got to get in.
>> Get in before it's too late.
>> Maybe we can count it down. We got to
>> I need to buy one, too. Oh, [laughter] I
need one for my friend.
>> No, no, no. New York. You have to buy
one.
>> Can I have a plus one?
>> No, no, no, no, no. Com employees got a
plus one. If you want to come to the
event for free, you can also befriend a
comma employee. Um, you know, you got to
just figure out where we hang out. You
got to work your way in.
>> What do you mean hang out outside of the
office?
>> We have to check. No, no, no. Don't do
that. That's That's a bad way.
>> Have to check our schedule.
>> One remaining. Okay.
>> Now, come on, Sunny. You got to commit
now. You got to commit now.
>> All right. All right.
>> Uh, but of course, Sunny of Sunny Pilot
gets a free ticket. Um, it was great
meeting Sunny last time.
Sunny of Sunny Pilot. Even if you don't
want to do a booth, no pressure. No
pressure. But, uh, Whoa, Nabil, you
can't come this time.
>> Come on,
no.
>> No. No.
Oh, no.
>> We're trying to announce it early this
time. We're doing a little earlier than
the previous years. I'll give people
some time to u
>> might also have some invited speakers
too from from outside of com. We can u
we're we're considering that
>> this will be a more of a variety event
where uh we're trying to branch out with
the comic con be a different vibe this
year. It'll be fun. It's not going to be
like a repeat of the last couple comic
cons. Um new venue, totally new vibe. Um
partially new team, too. We we're
growing a little bit. Um you'll hear
from some from some new people. What is
this live for? It's an announcement for
the announcements.
>> It's an announcement for the very
exciting ComicCon.
>> ComicCon?
>> Not to be confused with Comic Con?
>> No. No. This is San Diego's premier
Comic-Con.
>> This is the best. [laughter]
>> Only one left. Is there really only one
left?
>> Um,
>> Mr. House MD.
>> Yes.
>> I was just watching House yesterday.
>> It's all gone.
>> Nice.
>> All gone.
>> Open to end user. Yeah, of course. So,
we love meeting users. We absolutely
love meeting users. This is open to
absolutely everybody. Um, the VIP is a
really good time. Um, have we sold any
VIP tickets yet?
>> Um,
>> there were like five and 10 of those.
>> Uh, I think one Yeah, one
>> Comic- Con is way cooler than Comic-Con.
My only experience with Comic-Con was it
was like next to my old apartment and I
couldn't drive anywhere and I was really
confused. Uh, so
>> yeah, we already sold one VIP.
>> Nice. Nice. We sold a VIP. Uh, when is
this? November 8th. 99 tickets sold out
already. Wow.
>> Yep.
>> All right, then. I believe it's 1:25
now. Or if you want to be a VIP, um the
VIP is a really cool time. Um
>> going to have dinner with us.
>> We're thinking of also maybe doing a VIP
lunch for like cool people, like a
hackathon vibe, but that one's still a
work in progress. It' be nice to have
more info on models. Uh you know what?
That's exactly what Comic- Con for is
for. Everybody knows we don't really
have secrets, but it takes a lot of
effort to talk about stuff. Um, so we're
kind of just bundling it all together.
Comic-Con VIP has four left. Wow,
everything's moving fast. One free C3X
with every Comic- Con ticket. What a
great deal that would be.
>> What a great deal.
Um, sold out for early adopter. I mean,
you know, we appeal to the early
adopters. It makes sense.
Makes sense.
>> Mine's early enough.
>> Yeah. I don't know. That was that's kind
of it. We uh we've been doing a lot of
refactors uh physically at the office.
Um trying to crank out three axes. We're
uh cranking out models these days. We're
really uh working on the machines that
ship you. You know, the product is the
factory. How do we buy no link on your
website? Uh yeah, just go to comma.ai.
It's in the banner and then click on the
banner. It'll take you to the ticket
site and then you can buy there. Um you
might have to like clear your cash.
Control shift R or command shift R if
you have a Mac.
>> Command shift R.
>> Command shift R.
>> Yeah, it's deployed.
>> Yeah, it's fully. Oh, yeah. Yeah, I wait
for it to deploy.
Comic-Con 2025.
Nibil, it's uh we're sorry to hear that
really. Um
it's always a good vibe having you on
Comic-Con.
>> Wait, Niel can't come.
>> I know. I know. Can you come if it's
double the price?
>> Yeah. Yeah. If we double the price, uh,
we'll be able to make it out. I'd love
to attend remote. We'll have a live
stream, but of course, you know, it's
hard. You can't really ask questions.
There's a little delay. The live stream
people always kind of fuck it up. Um,
somebody wants to like if you're a good
live stream person and you want to like
do it, that'd be great. I want to live
stream all the booths too and record
those. Um, so if like has a thing, um,
if Autonomy has like a little
workshopppy thing, um, we want to also
stream those things. We're going to try
to put a lot more effort and dollars
into the whole streaming infrastructure
and then uh we wanted to come out like
right after the event. It's always been
like a we we kind of messed those up at
the last couple comic cons. Uh well, the
people we hire mess them up, but you
know, of course, you know, it's it's
ultimately your fault, you know. Um
yeah, Nibil, I'll cancel your other
thing. We're going to peer pressure you
on this. Uh we're not ending the stream
until Nibil commits.
>> We'll even give you a booth if you want
a booth. Talk about some comma stuff.
Thank you demon team for helping out
with the out of warranty device last
month. Oh, I'm not sure what I did. Uh
my contribution was putting that on the
website to to the shop instead of it
being like a secret support thing,
but in spirit I tend to
>> making uh been making a lot of progress
in uh in making the support experience
better. Uh
>> they announced a thing already. Yes, we
announced Comic-Con. Comic-Con 2025.
It'll be like a variety event. Um, you
know, we went to CVPR this year. Um,
Mine will probably talk like reive his
talk, give some updates on that stuff.
>> It'll be a little more broad. It'll be a
little more general. Uh,
>> yeah, we'll we'll talk about simulator
machine learning in general.
>> It should feel like a little bit more
intimate and like chill, too. I'm hoping
it's just like we'll have nice booths.
You can talk to people, maybe some
interactive stuff. Um,
if anybody has any ideas for what you
want to see, um, I don't know. If you
like some work somebody does here, you
could just email them and say like,
"Hey, I'd love you to talk about this
stuff." Um, we don't love getting this
stuff. It's much better than like a cold
sales email. Like, fuck that. This is,
you know, nobody likes those emails. But
if you're like, "Hey, you see, I love uh
I like the GWM model. Uh, I read your
paper and I had some questions." He'll
probably send you a nice email back.
It'll make his day. Uh, there will be no
fist fights. Comic-Con is a chill event.
There's a common body song. Yeah. Yes.
There may be some announcements
regarding that too at Comic-Con. We have
to come to find out.
Looking forward to see what's next.
Yeah. Will there be a link to buy
tickets on the website? There is. You
just got to maybe clear your cash.
Um that's about
Oh, you guys have any more questions for
today?
Dumb summon. Let's go. No, you don't
want that. You want ant long.
Regardless, we're building ant. We're
not building summon.
Antan log is going to be great. The link
in the banner. Yes. Yes. Yes.
Um I'll show one more time for the VIP
tickets. It's a really great time. Um
this year we're doing an Omicasi dinner
which should be fun. Um we do the dinner
out in the courtyard. Um so we set up
like these little tables. Um you'll be
like the whole team is there. You could
talk to Harold. You can talk to me. You
talk to Yen. You talk to Mitchell. You
could talk to Henry who's new on the
hardware team. You could talk to Nick,
our new designer. Um, you got to Robo
who's on the hardware team. Okay.
Anybody on the team. Um, you get to poke
around the whole factory. Will you build
some 3X's?
>> The good thing about dinner time is that
it uh,
>> yeah, I was saying the good thing about
dinner time is that Shane will be there.
>> Oh, Shane will be there. That's true.
That's true. If you guys want Shane, if
you want Shane to tune your car, you
know what? If you're a VIP and you bring
your car, maybe we'll even tune it for
you. Uh, I'm not going to commit to it,
but if like one of the VIPs wants to do
this, uh, maybe we can do this. That
might be fun.
That might be fun. I did support day a
couple years ago. Um, we can offer live
support if you really want.
Did you guys bait us? Uh,
it's just a little teaser. Little
teaser. It's ComicCon. It's so exciting.
>> If you've been paying attention, you
know, you you probably maybe there won't
be some surprises, but you know, I think
it'll be at least maybe the the thing
that'll surprise you will surprise it'll
be a different surprise
if I made the change. C4X. What is that?
C4X. Do you not like C3X?
C3X.
23x.
>> The tickets are really going fast.
>> Are they really?
>> Holy shit. They're moving a lot faster
than uh last call.
>> Wait, the VIPs are gone.
>> No, that can't be.
>> VIPs gone.
>> VIPs are gone. Should we make more VIPs?
We just fit however many people we can
put in the courtyard, but we're down to
put more VIPs. You got anything else for
the people?
>> No, you guys, you guys should be should
be excited about Comic-Con. I'm going to
talk uh about machine I'm going to talk
about machine learning in general at
comma and when we do ML sim uh we'll
have some good models um we'll have uh
we'll have another stream this week
right
>> oh oh yeah maybe we'll do com coffee
>> yeah we'll do comma coffee
>> we'll be on Twitter we'll be on a
Twitter space
>> yeah that'll be on a different different
thing and I think by ComicCon
I won't be GPU
>> if you want to come here and work on uh
building building out the compute
cluster. We'd uh love to have you.
>> Yeah, we'd love to have some more nodes
in here.
>> We have all the stuff. You guys seen all
the hardware?
>> Yeah. Oh, yeah.
>> See,
>> always has this open.
>> Yeah, this is my uh my T-Max
T-Max setup. I can see like how many
nodes are are working
uh and who's training what and uh yeah.
>> All right, cool.
>> Things are exciting. All right, you can
catch you scene next on our Twitter
space.
>> Maybe tomorrow.
>> Maybe tomorrow.
Uh we checking out on the hardware team,
but they're also on the chain schedule.
Uh
these tiny again, all those tiny boxes.
Com.
That's about it. Comic-Con 2025. Buy
your ticket now. Um, the VIP ticket is a
really great deal. Um,
you know, maybe we'll even we'll do like
build a Comma 3X before dinner or
something. It's so quick to build that
we can really do that. Um,
you know, that wasn't possible last time
with a Comma 3, but so quick with the
3X.
I'm dumb. I don't see a banner. Just go
to comma.ai. It's the green strip on
top. Click it and then it'll take you to
the ticket site.
That's about it though.
Get your ticket. Get in early. Uh the
early adopter tickets sold out faster
than I thought they would.
Um should be a great time.
Maybe do one more question. Anything
else?
Yeah, try to make it out. Try to make it
out. Uh it's always a good time having
you out here.
Oh, Chris, what's up? What's up? We will
see you there, Chris.
I'm waiting for Black Friday to get a
3X. Uh, and I don't know if we're doing
any more sales,
but the good news is you can buy a 3X
today and we'll ship it out tomorrow.
Let's [laughter] go the API secrets.
You can come here. You can come work
here if you want to see the API secrets.
Um
yeah, I mean you don't see that much
stuff working here. You got you guys
have API secrets. That's about it. Um
you guys have lunch with us. Otherwise,
everything else is public.
Uh oh, there there is some community
people working on FlexRay. Uh maybe
we'll send a ticket to the Flex Trek
guy. Maybe the Flex guy wants to do a
little booth or a little talk. Do a nice
community talk. If you guys want to
nominate people, that would have been
cool. We maybe we'll put that on the
site. like a little space to nominate
people for uh like a community booth or
community talk. Um we really want that.
Yeah, we want to have a little more
community focus this time. I think it'll
be more fun. Um let's have like a big
stage and like we're just talking at
you, you know? It's more of a
conversation. I think it's a little more
fun when it's a conversation.
Um so the schedule, you look at the
schedule on the thing, it'll be a little
bit different vibe. So don't uh I won't
just be talking at you the whole time.
It'll be a lot more interactive. But I
think it'll be I can put a lot of effort
into some like nice displays and stuff.
You know, at like the Apple events when
they like go and talk to Tim Cook and
he's like, "Oh, look at the iPhone Air.
It's so beautiful." And you know, you
can come talk to Rob about the Comma 3X.
And like he can tell you all about the
Lightning Hard and the refactor he's
done recently.
Um, you know,
and I won't be like Tim Cook with like,
oh, we made it so thin by building it
from the ground up and it uses eim so
it's really tiny. It's not tiny cuz he's
using an e. Tim Cook has no idea why.
you can talk to the people to like the
two or three people who built the Comma
3X and you can ask them why they did all
this stuff and sometimes the answer is
like, "Oh, we just didn't know any
better." But sometimes it's like a cool
answer. Um,
so yeah.
All right. We're looking forward to
seeing you guys there. Thanks for
stopping by for our announcement for the
announcement.
Go get your ticket today. comment.ai
and hit the banner.
I'll be distracted for too long Vivian
chefs I distracted if you want I think
you look so good
I worried oh there you go I was watching
the road you were fine
just wait just wait it gets worse
oh yeah you'd have to touch the wheel
what's up have you guys ever seen me not
at the wheel scope is I'm letting
somebody else drive the car I have
control issues the only reason I'm ok
with this is on posture oh yeah I do I
feel so relaxed with open pilot driving
yeah Oh guys we have driver monitoring
you don't really have to keep your hands
on the wheel you just have to pay
attention at all times and be ready to
take over doesn't take long to move your
hands
it's a secret
why what you're fine my god you're fine
it wasn't it wasn't I was watching viv
you drive way too far to the left
yes stop-and-go works - look we're
driving on super cruise with two zeros
super cruise guys check out my check out
my sin card icon slash Tom Cruise check
it out to get my maverick fans to get my
comedy
great guys
yeah how many disengages have you gotten
that yes a don't do me you can't talk
about the G word yeah this is the secret
good internal oniy we have the good
version that thanks good and doesn't
make mistakes
oh and there's no more six minute timer
because I'm on top being distracted it
has nothing to base so it we could do
that you want to be fifty whenever I
think those where they could Portland
it's good for us to give is commenting
that the light here should have
something to do with anything
it doesn't hit the camera lower - oh no
hands it should have something you doin
anything else complete she be on Twitter
do you want to tell the stuff about your
Twitter yeah light is about battery yo
chase knows on top he also wants you to
hire
[Music]
great great Drive it's some big mistakes
anymore this is a good version of a
pilot this why we need driver monitoring
it's too good
secret cut version all right you board
yet yeah No all right Scopus
read the questions Civic or court no one
Civic right now throwing 69
what happens if you slam on the brakes
completely and lock up tires open pilot
can't do that and if you do that your
dominance where they go with the free on
chase
no is knock off beyond it doesn't
have like a fan or any like good stuff
it's like it it's just it's a phone in
it in a case yeah the free are yeah
that's right pay attention
remember how little attention we paid
during the driver yourself having
awareness to her yeah I know but now we
have to because we have driver monitor
we go back I won't we can't show them
the secret and the scope is I hope you
enjoyed this zero disengagement drive at
all
good morning scobie's my room but trying
to vacuum the floor
oh yeah get in there get every corner
what up drinking a amante I got scope
he's one hand they got Mata and the
other a laptop in my back
it's morning guys I love morning
mornings my favorite tired day seriously
nobody's awake yet to ask me questions
no questions mornings I wake up maybe
I'll play a little chess maybe I'll read
a little bit I've been reading Jordan
Peterson's book it's pretty good yeah
early scope yeah so I might lose some
reception when I walked out right on my
talks at 9:45 come find it
come find it I'm going to be talking
about pandas neons and , and you know
I'm dropping fire right you always drop
fire alright will it be online I don't
know but I will tweet out the fire part
of the talk after it's done oh I love
super hearts man yeah I know
well okay so but I'm also doing a
workshop apparently I'm not really sure
what that is but I'm doing a workshop at
1:00 p.m. so if you guys are around for
that that is an option as well took my
MOT a laptop of my back on my air pods
in my pocket I bought a new pair of ear
pods read this survey this morning our
Tesla is the most trusted brand in
self-driving cars interesting to think
about
no no no we got fire man we got fire you
know a fire is we don't talk about what
fire is yeah we'll talk about what fire
is afterward
I'm common next hey maybe I don't know
do I look like the kind of guy who can
be trusted I don't know about that um ah
there's a different pass for Expo and
speaking I don't know man I don't know
who actually goes to these conferences
probably people who want to get away
from their shitty jobs I don't blame you
find a shitty job and there's 72
conferences
I go - yeah I'm gonna learn about the
Cyberman the cyber security notice how
everything that puts cyber in front of
his bullshit but even wired said that so
that's kind of bullshit I'm quoting the
news here the media safety support an
actual safety you know it's not
important talking about safety so I'm
not gonna talk about it anymore
am I on something you people always
think I'm on drugs I'm not on drugs most
of the time sometimes I am people think
I'm more normal maybe but no no no just
just woke up submit my mottai you know
when I smoke and get like normal man
this is the Hyper's is just the hyper is
just my life I got to have a lot of
energy good bye
all right so we're gonna buy a Muni
ticket you guys on bottom you need to
take it with me taking the Muni downtown
they miss the Muni ones the next Muni
come heels good ma'am
another interesting thing that about
that survey was wammo wasn't very highly
rated and you don't really think like
how much does Google believe in their
crap if they won't call it Google right
alright let's buy Muni ticket by Muni
ticket adult single trip okay now let's
put $3 and OH
oh man let's go let's go let's go
I should just have Muni tickets you know
[Music]
take my dollar
sweet
[Music]
this community to go let's go let's go
let's go no I don't need to repeat only
my quarter just little homeless yeah
let's roll
oh man that pew meets packed so no one
really knows you can watch the way about
cars they drive like grandma's alright
scobie's I'm sure I'm gonna lose you
when we go in the Muni oh man oh man
excuse me
the health bar
yeah we're live and we have one viewer
it's giving them all a minute to show up
is there a word for like periscope ease
Scopus we gotta we gotta wait for the
skull piece to come off
Oh George you know what I wanted the
team to get you for Christmas
what a like a handheld selfie stick that
you can like film around with oh yeah
this is the I'm happy to control
so little not calibrated it looks great
yeah what about to be a tool here we
have a tool thing though we have a thing
yeah
oh we do can you get open polar drivers
right to the fast-track plane oh we have
to get it out by the way people are
asking what's different with zero point
just look at it Bros Bros that whose
money is this mine did I not say it's
mine right yeah we have a fast track oh
nice love it love it
prepared um so yeah I know what's Devon
with 0.4 just and what got it right
landscape cycles all right yeah Thibault
don't switch him along the scope he's
don't like that okay take a look
right
so see 0.4 is not out yet we are going
to be driving with it and finding bugs
during the whole trip and then we will
release it so I'm gonna disengage here
at a faster
listen to next of the warm
oh no the other one also that disengages
pretty nice disengaged yeah
I just get back up to speed oh no it's
just traffic okay
so unfortunately guys you know how I
have to move you know how I have cool
firmware flashes Pacific won't happen
you for the Raval are so yeah the rav4
doesn't work at speeds below 20 miles an
hour right now
um this is also true and release open
pilot too but you know we're not gonna
release EPS flashes but PCM flashes were
a lot more violent so yeah we got about
a five minute traffic already can join
us for the traffic no this looks good
we're chillin with our scope he's the
hallway um yes and welcome to the common
self driving awareness tour we're
getting a much later start than we
thought yeah um because oh man we
would've left two hours earlier if we
didn't talk about physics for two hours
I lost I lost $100 if you throw a ball
off of the ISS it will not go back to
earth yes it takes a lot of Delta VD to
return to Earth okay we're back engaged
here
for over 20 years over the remain in
orbit that's what hairless
like The Herald was right that's why you
wanted we have smart people are coming
[Music]
today
he did he did he I think that Cory Cory
as Cory's come a personal chef so what
do you guys do what do you think of the
new UI we're the hearts come from I
don't know I think that you can tap that
you love it oh you tap can you turn off
the video playing and sugar plus it's
illegal in my state to have video
playing up front yeah what do you want
instead you want ways you can dress you
can go two ways you can go to Spotify
we haven't even linked up the Bluetooth
right and what Catholic ology running
back down to I mean oh it's just whether
it's engaged or not right
so thanks ways that's right there on
your yawns oh we're back engaged here
well this great new UI come to me or is
it just shiver oh well we'll say I'm so
it is coming out with with open pile 0.4
yeah yawns yawns we'll get some of it
I'm just some event goods
I need us look at some of it
unfortunately you know Neos aren't that
great with the thermal and the new
version of Neos is not released yet
which kind of some of those defenses but
this is so this is the same as ship
applause the only difference the
chifforobe losses it doesn't actually
drive your car it's the dashcam the way
Spotify pretty much the same interface
down
come on available but I don't really
know them oh it's that comma unavailable
speech you love that's the that's the
warning we get in question about the
pigeon no no we don't have any pigeons
are delayed yeah production was young
productions alongside we yeah solid we
shimmy out we shipped out all the eons
today we don't talk about the number
it's huge I don't really don't know if
people think it's a lot who drives
George well technically you oh yeah I'm
Tom Drive so we just drive it you get a
control of this view at all times
completely this is not an autonomous
vehicle upcoming it oh my god it has two
L's wait really
I didn't even see that doesn't kids love
to else no no no your open windows at
your office that a growth could see your
whiteboard trump could see my white
throne a draw
well I think I wrote it before with
multiple else it has to elves I'm sure
do you look up it sounds like a British
spelling or something we're driving on
an eon for the person asking with all
Kamala
if you botany on it doesn't come with
bulk and pilot becomes + shift+ ways we
love to always experience the ways
experience has a few bugs honestly by
the time it gets to Google probably
defects cracked Americans prefer one and
Brits like to else what is the
difference between supercopa pilot great
question great question
open pilot actually controls your car
shiver Plus does not
this car needs to do needs to do stop
and go yeah
is that possible for it
is it possible we have to reflash the PC
so I need to install open pylon you can
if you want
you are completely on your own if you
make modifications we're not gonna stop
you can make modifications like kind of
what sort of a hypocrite would I be if I
tried to stop you from making
modifications to the products that you
paid for so the rap floor will come to a
full stop but which is a bit different
from the stock system well use a mutex
how's the priests coming if they crash
into each other I feel like a nice like
video Prince has launched zero 43.0 it
works it freezes when it says cancelled
yes you have to drive
yeah the stock system beeps once and
then you're just rolling on it'll
actually only cancel if it you want to
accelerate because it can break all the
way down to zero just can't accelerate
once you fall below 20 so this is why
it's only a PCM reflash PCM is the
powertrain control module they used to
use the word ECU engine control unit but
now everything is just the ECU it got
kind of genericized
watch out vehicles stopped on shoulder
ahead this ways tells me this one I wish
I could disable that alert because I've
never cared that there was a vehicle
stop on shoulder is the piece just as
good as the rav4 when she looking dirty
could put the clean is similar well
Windex will wear the shouting out bro
this one you have pull it towards you
again notice how it's filtering about
the exclusive t-shirts available for
sale in person on this tour let me tell
you something if kama succeeds that
t-shirts gonna be worth like 80 bucks on
ebay we're selling it for way less than
80 is 20 points are the border states we
like the border
got a good eye it like removes maybe
that was more party yeah
we gotta we gotta put place in Spotify
box
to your investors Confucian has improved
right lane these dots dots are hard
we're just as good as the have four
people keep asking similar sibling does
not do it does stop and go
the priestess I've got a box yeah you
actually stopped to press the button to
resume where's the little insects bees
for Nick beetles
I have some hearts like where's the
dislike yeah no dislike I'm yeah from
our perspective only love that's great
the connection drop does the device that
you shouldn't open presents dollop yep
yes the connection dropped Oh on on yeah
well I've iPhone accent o'clock club
chips unsecured chips now
our next trip will have Alex Roy right
Alex Alex Roy is a partner he is a
partner yes we could be a partner he's a
part what he'd be doing for you since
zero but that's the kind of partnership
some be like that's all I understand if
anybody out there wants to say that
they're a partner with comma AI you're
welcome to if your name is Alex Roy soon
better always dance man let's learn it
it's a little still not quite
calibrating we get more calibrated after
acknowledges yeah you get more caliber
therefore now basically Cowboys always
running
are you Chris packing a caffeine
we pack shipments in order you know what
attacked I packed my wallet my laptop
and my passport yeah it's all you need
mine
I know you know they check all your
passports those you won passport for
more than one task per person it's
sketchy I thought you couldn't do it
okay like a mini passport here to you
there's actually our state license which
will let you go to complain three one
mature states
what's point three one five two point
through it
a Michigan enhanced license that's a
thing
4:31 it's the legal ownership you guys
have for collision winning yes
oh but only if you're in a car where you
can connect to France so you need a
giraffe as well but chipper Blas
absolutely
a Washington also has in his hands to
license that works for Hannah thinks we
learned this is fascinating
so there must be a deal
federal government Michigan there's the
fridge from Detroit to Canada
yeah unconscious time
Detroit's a Cadillac crossed that bridge
from Canada to true and then I saw my
first house on fire my second house on
fire in a bring span of an hour I don't
know Detroit making a comeback yet yes
actually
actually yeah but it definitely is
beginning to come back there is always
rock-bottom a song called oh yeah you
know what happened to that house that
was on the front of the Marshall Mathers
LP like this old house they burned out
of course interesting so the bar isn't
getting reset when I up the sets eat on
the Toyota signs and kilometers for
Canadians that is kind all right we got
I always hit politically correct thing
so it's gonna stay with me yes
I don't think we should make such
accommodations to Canadians I think here
we have miles and there they have
kilometers and we should celebrate our
diversity yeah decent diversity what are
we gonna start working with multiple
cameras
what multiple cameras throw you got to
George should like Detroit because of
all the good rap I'd like to try I'm not
saying I don't like to try to just say
it I've seen two houses on fire in my
life one in Detroit and the next one in
Detroit 20 minutes later I almost would
do I almost want to a hip-hop Club in
Detroit that's what I was gonna do but I
was late for Chicago Wow
I was in Buffalo and I'm like oh man I
look up through Canada to get to Chicago
bad choice man Canada speed limits oh
god please
as they coming back across the border
they grilled me because I was like six
no no it was rude that was okay they
brought me into the room and stuff oh
wow because I was only in Canada for six
hours and they like what what to pick up
I'm driving to Chicago from Buffalo and
yeah and they're like your dumbest you
know it's like that takes two hours more
I'm like yeah I'm Canada and see the
nice Canadian sights
wait I've never I've never heard about
our free HD maps are absolutely free HD
maps existing to troll
deep map now honestly like TomTom deep
map here maps I want to see all these
companies go out of business because we
open-source something that is better
than what they have and like I don't
mean open trust like OpenStreetMap I
mean like just bsd-like do whatever you
want
when will we release them
thank you what do you think of Tessa
moving out of mobile I'd given that they
have good tap
um Tesla didn't move out of mobile I
mobile I terminated the relationship
with Tesla so it's not like Tesla had a
choice what do I think of mobile i
severing ties with Tesla that all
depends how mobile I thinks of
themselves that's one way to think about
it is yeah you're gonna sell another
300,000 chips you know making 50 bucks a
chip you're looking at you're looking at
revenue you look at a profit there's
another way of saying those chips are
gonna help them more transition to be
one of our competitors so I mean I think
mobilize boomers are insecure I didn't
so it wasn't a stress
I'm a competitor in the sense they're
gonna take some well they're taking a
chunk of it
like they're not gonna start test if I
gotta sell the other
what's nice exciting thing we can avail
on this would you actually what which is
actually why mobile I should have showed
us ultimate yeah maybe they'll get
hooked they might continue to ship the
chip forever yeah no I mean there's
actually the key distinction if you
believe that Tesla wasn't gonna ship a
competing from any future cars coming
for 2018 any what feature cars I'm
assuming it's up to more cars I don't
know is true as an honest man oh yeah
we'll be doing will be doing all the
Toyotas we're gonna like rent a camera
to crawl and make that work though
as long as you see this bar keep going
down I'm not touching the wheel the gas
or the brakes we test something
the microphone works on it yawns yeah
it's a great thing on software updates
man okay
George how hard do you think would be to
get a car without Lane keep assist to
work with open pilot depress the car I
think that GM is you can kind of do it
because they seem to have shift the
steering command even on cars without
outcasts on the Honda's it's disabled in
the steering firmware so you'd have to
do a reflash in the Toyota's I don't
know but almost all of them Chevrolet
keep so security updates 40.4 security
we had a security
kind of security and then top five
bathrooms Oh your top five rappers man
yo Drake drinks the best rapper alive
not little peep go index the way Eminem
has fallen I do and that I do I do
LP to was just like what forgiving your
mom Oh
security is like people stealing your
car like oh I'm a security no we'll get
to that next year yeah I'm sensing a
little bias here I like that good vibes
yes a little
all the best rappers used to be big in
the world it's just like that's a new
thing man you don't want to be an
oppressor you want to be a little biased
is that is that a real thing no no that
is a bad thing
why who will buy if I get it no we are
friends with all of the regulators you
like regulate when you like regulators
we don't like formed when to expect to
reflash for Toyota so we had to
disengage I mean before it used to be
because you know this is actually faster
than your go ankle stop unless we tell
you the actual speed Oh these match no
this doesn't match this this this tells
you the actual see unlike your carbon
it's so stupid that they don't tell you
the actual your car is your trip
bullshit you yeah most most speedometers
and cars read 2% faster than you're
actually yelling they do this so
basically you can't try to get Toyota to
pay your ticket for you oh it doesn't
actually work it's not like you can even
say yeah why would you ever raise money
um so we don't have a fudge factor on
the speed you know come on we're
engineers right we're putting the real
speed that's how fast your cars going
okay
and the distance the distance to your
lead car will always be in meters this
was briefly changed to feet you might
even see the comment and you I if you
really want feet you can open source it
but I said meters for forever even when
you change but there's still a metric
slides
where did the name come from there is a
metrics or the name of a comma come from
uh you know if you don't have a
successful company it's got to be like
between like four nine letters and two
syllables mom go
Facebook fan control seems on and off
yeah the fan is a little policy we
couldn't probably rewrite the policy to
do better it's open source check out the
code and manager you can check out
shipper plus is already released the new
chef for plus so you can go to a github
comedy applause before chef replaces
already released Oh like I said the end
of the trip on the end of the trip after
we you know track it make sure there's
no above like yeah do test on all cop
cars yes we tested on all comic cards
though I think 0.4 you're gonna have to
manually update to because we are no
longer testing Neo compatibility we're
only going to test Aeon compatibility it
should still work on the O's but we'll
leave that up to the community
every dollar cars get daily used yeah
boys
I named this car autumn yeah look at the
seats it's very very fitting
[Music]
oh yeah hard that driver's seat is
pretty that's why we get the premium
package
[Laughter]
I really wish this thing work and stop
and go yeah but the good news is I don't
think there's gonna be much traffic
where we're going bro Nebraska doesn't
even know what that word means demos in
LA in LA I hear there's no more party
[Music]
video of that guy who was like talking
about house parties to some town hall
meeting and he was like they were
thinking about shutting down house
parties and he was like me and my Bros
really love house parties let me tell
you did you guys not see this video no
oh you would love it you would it's like
the funniest that yeah I will show it to
you once we're done periscoping it fruit
those periscope e's they should take a
look at a world war rush cookies to be
like you know how like cutie pie is like
cool guy to browse the internet with
yeah 140 most copies that's a big road
trip man we need a bus to fit all
at 40 mine I don't know hearty books you
guys can play the license-plate game
with us though I've ever been on a party
bus yeah the 1i Manhattan once I get
ahead like buses get around the no
seatbelt
they're like part of the government some
some actually do seatbelts okay Lane no
yes school buses have seatbelts that
like law changed some coach just
seatbelt helps you wanna bus if it flips
what it's gonna hold you in your seat by
your seatbelt I don't think that's how
seat belts work man their construction
is actually saver so they don't require
a seat belt you continue at that train
of thought we're a little confused with
the construction part yeah like their
frames probably
flying through the air like through the
front windshield well you'll kind of hit
the seat in front of you right they're
supposed to plate could lake lake lake
mostly well it depends what kind of
collision you're really talking about
right you let's the other thing too like
if you're talking about like a multi
vehicle collision the bus doesn't move
that much never seen a car in a bus yeah
I don't like if a bus hits a tree well
no but again you're still like okay so
say you're in like the middle seat of
the bus right like momentum is all it's
just like you know your velocity right
so see even the whole front of the bus
crumples right this is why you sit on
the back of the bus kids always wondered
where is the safest place to sit in an
airplane but turns out there is no
safety spot so no I actually heard that
it's safer in the in the in the back
oh or maybe like by the wing it's
probably the safest the front not always
I think the front is substantially less
safe I think when you look at likes like
the the well yeah would you look at like
their plane crashes that people did
survive I think they were like balloons
are probably your best bet the backs
pretty good the Front's not good you
know but that's the thing man you got to
decide what you care about
[Music]
I like I like flying first class that's
all I'll say I have done it you know got
a free upgrade because I was hungry
there was a meal and she was like no and
I just had like the biggest look of like
oh my god what am I gonna do I'm late
for my flight it's just like click some
buttons and was just like okay your
upgrade to enjoy your flight that's like
that stuff like that happens it doesn't
happen to me sometimes Eddie yeah
do you wish we lived in a capitalist
society where we could just bid on that
seat I flip four times in a bus only out
of bloody lip Wow bro family car why are
we taking a bus here this feels like a
family car totally buses buses are
actually super safe yeah buses are
trains which is more safe a train I
think well they derail so that's we
don't I don't I know you don't I don't
know accidents versus deaths there's
different view horrifying training
ye truths could be so safe because
self-driving trains are so easy but
unions are literally killing people no
so I took the train home last year and I
took the tracks and like Chicago to DC
those dirty was fast enough and safe
enough so no like I should sue the train
company butt off serious bump oh I got
woken up out of my sleep and I landed
weirdly on my elbow man that's so freaky
honestly sometimes on Cal train I feel
like the conductor goes way too fast no
no this is way worse than like any train
I've ever been on the ride from
California to Chicago wasn't right but I
took the weird route so I didn't take
Chicago to New York I'm like well it's
less money or I get more time on the
train I have a really sweet sleeper
cabbagey time I went through like DC up
to New York I think the Cardinal if you
guys are Amtrak fans
damn tragedies no no no people on the
train or like Europeans who don't know
Americans don't take the train yeah yeah
drug smugglers and Tom oh we should have
had a GoPro camera attached separately
to create a time-lapse video of the
whole trip that sounds like a lot of
work and charging the battery and
keeping all that you know you know what
you know what we have a camera to create
a time-lapse video of the whole trip
it's built into the seal this is all
getting uploaded right now
why would I train also finds a terrible
experience no it wasn't about these fit
the train was literally something to do
the Train cost me more than flying and
took more time it's a journey it's not
about enjoy the journey shout out to
Kelly for that she doesn't watch these
unfortunate watch I skull piece I don't
thinks she's not one of our skull piece
Vanessa that she's on when I'm gonna
give her a holler and Tyler watch it
[Music]
yeah every week what's the most fun
[Laughter]
[Music]
buses no little bit how many others a
dumbass is being hit by trains you have
to separate you know no suicide by train
I don't know maybe I'm biased SEO
stories about Palo Alto the like there
how many people were killed on the tree
think that's what this numbers this is
do the trains no no what we're gonna
change the way we do the timer when we
switch model architectures
Tigers go fees grab 37 37
you know the pedestrian killed by a
train
this is open pilot it's not how over
here I'm not driving you guys yeah I
mean I'm driving over control of the
vehicle at all times I am monitoring the
system but the system is operating the
steering wheel brake and gas just like
an adaptive cruise control ranking
system but good no new time around 0.4
no zero before it's got the same timer
0.4 we changed some of them just the way
things are managed to grab CJ see you I
see that pink pink means the car is
doing it now if I take over colors man
our designer follow us on Twitter and
absolutely
how do i factory such heartbeats that
money on to install fresh shipper plus
again thrown in so fresh different plus
you can go to recovery mode by holding
power and volume down and then it's just
I am engine mod recovery you could just
say reset that wipes the data partition
you'll be reset with the US Senate
when your Eon arrived so it should be
shortly yeah there you know we should
ship the Bell
when do you think you'll add support for
flying cars Oh show us a fine car after
we built you oh you know what I did see
the life-size drone economy yeah
switches to work okay it's like it's
like can you unplug or plug in a hard
drive all the computers on it you can
the best idea baa
now if you want to if you want to switch
back to the stock system
there's time yes which is at the same
time
maybe if we run into one of you on the
tour we can try this almost Raven Falls
go
I'm gonna wake up tomorrow and I think
Skokie's is inspired and brilliant or
terrible yeah I've done it doesn't hurt
the car quotes which just stop now
won't push the stock okay it's not gonna
hurt they it's surprisingly hard to hurt
cars
like if we actually track the percent
that open pilot is driving although it's
gonna be driving for over 99% more
yeah 99 well I never said of the miles
Oh with the stop-and-go thing yeah this
topic I think it's actually probably a
bit less certainly like over 95 percent
and that's why guys you know you know of
all about fact-checking the media
whenever you see like Delfy claiming
that they did a ninety nine percent of
time of his trip across the country they
did on basically this is 99 percent
autonomous as well the last 1% with all
the hard stuff
[Music]
we should actually figure it out wait
yeah we can actually do it we can see
what percent the system was engaged for
me
maybe we'll do the impulsion some
statistics disengagement is what caused
disengagement stuff in it would be sweet
put Trump in charge of your stats it'll
be the best the best that's number one
stats has 100%
waynebow there they probably could they
probably could
when was the only company that can watch
Elon backed up a little bit on his claim
that he's going to do it I didn't we'll
see we'll see I'm rooting for him but if
I was a betting man
if auger had its prediction markets live
and one of them was is Tesla gonna make
it across the country and it was set at
50/50 either way we meet deadlines I
think pigeons are in the soon TM
oh really hi i'm leanna Jeff Bezos fan I
am I have like no Japanese ji electric
business
[Music]
uber talented I am a collective fan how
am i do I pronounce that I think it's so
let's let's let's see what happens when
we run out of health bar it's gonna go
our yeah we'll say
yeah I have a lot of options
use your face Oh
still there sorry you're so gross
though it's really appreciative it yeah
what did you do I didn't do anything
done anything oh there you go taken told
you look at that LD a steering wheel ok
so now let's let it run out what we do
it well and I won't slow down it'll stop
accelerating right so effectively we go
limp on the gas but for safety reasons
we continue to do the brake in the
steering wheel right like you know
[Music]
take control - against Peter I'm gonna
take control I'm gonna listen to it
yeah good so when we do that that was
good when we do replace the health bar
we are going to punish you for not
paying attention and now I'm taking
control by light log outs yeah it's
gonna be kind of like hey man take
control even when you don't need to this
is how we make sure that the user stays
though the system isn't good enough yet
for this to be a threat but all with our
new head of machine learning don't think
we'll announce who it is but we have a
new head of machine learning starting
next year right Tom used to it I don't
think we should if Tom blows his own
cover that's on top yeah
Oh
why is it always telling us you know
normally yeah that's useful I handed
about the car on the shoulder please
tell me about the police police up ahead
I thank you which I really like to know
that feel better I feel like I got one
step on the police please don't step on
me you know what we should give back to
waste that's a great way to give back to
ways what's what's your so that's Auto
reports please yeah it's like we could
have Auto reported that place let's put
that in let's put that in class let's
put that in driving ideas yeah no it's
good way to get back twice to estimated
date for Camry with gssb compatibility
soon TM to be honest you can I'm sure if
you rented a Camry and like know how to
code even a little bit you can make it
work I think it's really close to the
ground floor
cops apparently monitor ways to throw
like wow like for the cops on stuff
damn so we gotta have yeah we gotta have
at the new this is just an arms race man
now the truth isn't any arms raised
privacy news isn't openness wins the
location of the cops will eventually be
on one great moroder's man I solemnly
swear I am up to no good
right who gets my Harry Potter
Wow y'all seen Star Wars or I didn't
know honestly I shouldn't say this out
loud is Kobe's we're supposed to be cool
to hang out with man like Disney
bullshit to see like 1 2 3 but everybody
needs to see four or five and six and I
understand yeah I learned that there are
forty hours everyone we're in the middle
of nowhere wait
40 hours of footage uploaded to YouTube
every minute under every day
I have never watched is not illegal
really is not okay to be honored that's
right when I was 19 and I had it when I
was 18 and I had a van I drove across
all Nebraska watching Veronica Mars
to be I'm sure if that was illegal I'm
sure the statute of limitations has way
expired I have had upper drivers who are
watching something while drive okay
that's that's read stars man
three stars two stars no you either give
one serve five stars you can't be that
it no no no no I definitely give
in-between yeah all the time I've never
given a one star
I've given I think I've given one one
side where it's just like because the
thing is they match you if you give them
if you give them anything lower than two
you don't get matched with them again
and if I really didn't like something
someone did I don't want to be matched
well why did someone do to deserve a one
star rating oh he turned off the
navigation and you need to direct me
like I can direct you but and then you
like turn it on again and then drove if
that's a horrible reason to give someone
I gave a guy to star who literally
deliberately drove around the same block
twice to get a higher fare he didn't get
a higher fare to severe a day was not
back in the day he used to not be this
is back in Miami well okay I also feel
bad about giving lower stars because
their rating is really affected on
whether or not they can drive yep
don't feel the whole point of it is to
like avoid the kind of like someone who
drives like like not smoothly I get four
stars to like if that's my only someone
who someone who drives in a way I
consider not the safest I give three
stars to someone who deliberately fucks
with me I give two stars too and some
other doesn't get me where I'm going or
like doesn't be so terrible that's what
I would do for one star but yeah I don't
think we've ever gotten there
one guy one quite drivers absolutely
asleep at a stop sign
yeah I would say this is this that's it
that's it oh you guys what's your rating
because it says a lot about you for a
second 804 savita's mojo chlorine mine
249 you guys just a broad category you
know why because I'm a very pleasant
person in cars no black mare yo I think
that's the Burger King that I stopped
that for a whopper
on the way to self-raising cars part 2
what happened there false positive
breaking events what do you guys feeling
Eddie should we sit down the Kali and
sit down family restaurant and eat some
pecans in the park or get some big
dollars in the park whoever remembers
that by the way yeah
we will notice what you have a new AI
model oh they do the hollows off the new
model is going to be unreal man you'll
notice that it drives completely without
lanes you'll be able to like it'll work
on like residential streets
that's what I was good
we don't and our new or new head of
machine learning is gonna make them
incredible yes I hope he watches I hope
you watches this and realizes how much
trust and faith yeah yeah that's gonna
make you an MLA dude well I do know
since we have prototypes we got to just
finish implementing it soon - yep Anna
pigeons will happen first
so consider the pigeon to be the canary
in the coalmine
no we're going to need to get some
pigeons out there in order to gather
some higher precision data that's why I
see Izzie oh yeah because o because it
says demo oh my god I forgot that we're
not Stella we got a drive really soon
you're gonna do that anyway
alright fuck it we can't watch Star Wars
that's right try that will you keep your
eyes when you're driving
I've never been to a Cracker Barrel
Jackie and I looked at a Cracker Barrel
and we didn't think any of the food was
healthy of course not but you know kitty
pryde has a great line about a cracker
bow we ought to Christmas that's all
that's all that kitty pryde Dead Island
by Kitty Pryde should get herself into
Kitty Pryde changed name to kitty she
dropped her prize but you know why she
mustered a lover you know why though
maybe she's scared of being served by
Marvel it won't drive to the Kitty Pryde
character yeah see look it just have
like a greenish tint to everything now
or is that just like an optical because
if you just focus on the structure like
just put your that should go away right
away that's above can you add that drag
feedback oh it should juicer distracted
should go away literally as soon as I
correct
yeah George because if you look at it
without the green background assessment
I say
or Reno
in between Sacramento and Reno I feel
like a nice Starbucks at a nice wooded
area that I went to one time when I was
listening to battle raps drinking so
much a lot
both driving kind of
all of adventures yeah
Benny
I think maybe we leave the periscope for
now yeah we'll be back
we've got a lot of time together a lot
of ways to go but you follow us twitter
or come okay I for all the ladies two
periscopes we will have some awesome
announcements we've been asking about
today what we're showing you is the
volunteer work for you I am saying that
we will be releasing this again and
we'll see some of you guys soon we'll
see something Sofia
yo yo
i'm back on the periscope
we love the periscope
um you know what i realized i didn't
emphasize enough
so what you are seeing right here so the
car's driving right now
um what you're seeing here is open
source
and you can build it today
you can go to our github
um
there's our device the common neo which
you can build there's also a company
called neo driven selling our common
deal
i mean that's the hardware component the
software component is called open pilot
and it is free and open source
um so i think it's like it's really
important to emphasize that this is what
you're seeing here
is
israel you can go and get this today
on your acura ilx or your honda civic
and it'll drive man
um so it's
driving now
um
that guy's a little close to the lane
ah
well yeah
ate my whopper it was pretty good
got chicken sandwich
and
they put
mayo on my chicken sandwich
which was no good
i said i try to find a better place to
mount it i don't really have any ideas
i'm open to suggestions
yeah but
open pilot bros
all right now i have to figure out where
i want to get off this highway too
sacramento fairfield
i did this once
where i ended up going to sacramento and
not doing the 550 cut across i believe
it's the 550
uh because i got my periscope up and oh
guess what else i have fixed which i'm
really excited about so the internet for
some reason my drive px2 lost its ip
address
uh which is kind of sketchy i mean look
like ubuntu does a really bad job of uh
well it's not that ubuntu does a bad job
ubuntu itself does a good job but if you
put things like etsy network interfaces
network manager and then i think like
nvidia's got some other thing running on
this on the internet breaks which sucks
but
i
now have spotify back on my large
touchscreen which is nice and i'm very
excited about spotify
oh user distracted
that's right i was distracted how did it
know
do i speak french no i don't
what do i think about french
i don't know i don't speak french
yeah
now we got some music bros
this is better
listening sitting in the car you know
that song car radio by 21 pilots
that is what
um
they describe it very well when your
radio doesn't work
drop an ios jailbreak they're worth like
a million bucks now
again and now i know that there we go
no
how long am i driving three hours i got
a date tonight in chico
so if y'all want to drive with me
welcome
oh
traffic
luckily we got open pilot makes traffic
easy it's open source you can download
it on our github github.com
[Music]
is the music good quality at all
drop a freestyle yo that's a lot of time
what i do when i'm in the car by myself
i try my best to
freestyle nah i sound stupid sometimes i
get real good freestyles and i'm like
damn i wish i could only have good
freestyles oh now you get to see that
yeah
so my this is my discover weekly it's a
mix of like
emo music
and rap music
and all the best kinds of music
uh we got some cars up here pay
attention
have i looked at tesla's autopilot no i
don't own a tesla i tried to buy a tesla
and oh the cold war track um i get
distracted too easily this paris cut um
not like from driving i just mean like
from what i'm saying right you know half
of it's kind of hard to keep a train of
thought while you're also driving a car
um
it's interesting you know like the whole
dynamics of
let's change music
[Applause]
[Music]
i was feeling that 303 let's go back to
that so i'm running x86 spotify
on uh my arm 64
in qmu
so it's really slow and crappy
and i think the spotify linux app has
some bug where if you use it with a
touchscreen
it breaks
um
it breaks
x
oh yeah there we go
what do i think about neo-driven
neo-driven is cool
um they sell neos what do i think of
martin scrolling martin shkreli is
banned from twitter and that's sad
because i enjoyed following him on
twitter
oh oh there's qt no it can't just be qt
because okay qt like yeah uh spotify
linux does use qt i believe
um but it can't just be qt because it
actually breaks like other windows from
working so maybe it has something to do
with the interaction with gnome or i
don't know i don't actually know that
much about x-windows
but they should if someone from spotify
is watching
they should build an arm 64.
yeah i
[Laughter]
that's what i say the car companies are
going to be like man
i mean like getting better right look at
nokia look at blackberry
and the real irony is it's going to be
the high-end car companies that like
really think they're going to solve
self-driving themselves that really
suffer from this
um
because
the
low-end car companies are going to be
much quicker to adopt android i mean
that's what we are so we are we we make
this um software called open pilot open
pilot is an open source version of tesla
autopilot it's what's driving the car
that i'm in right now
and
some car companies are going to embrace
um
open pilot
and they're going to be like the
companies that embraced android right
like they're going to be the samsungs
and even the htc's i mean would you
rather be htc or nokia today like you
can say htc's not doing great but nokia
was written off entirely as a loss right
nokia did other things too like but
really the phones is where they lost it
symbian os i had one of those in high
school
um
you said some
guy remind me what you said
oh ninety percent of commutes by the uh
ninety percent
maybe
it's gonna be it's gonna be a stretch
it depends on how well our mapping stuff
starts coming together
so we have
six minutes
uh
so that's six minutes
on open pilot
um
if you don't interact with the car for
six minutes it beeps and it has you
take control
all right vodkaville in nine
miles i have to turn and chico is mad
faryo this is mad far
i met this girl she drove down from
chico san francisco to hang out and now
i'm like man she goes mad far
you don't hear about kasha anymore do
you
why after six minutes um it keeps the
driver engaged right
you don't want uh
you don't want people lulled into
thinking that this is a level four
self-driving car it's not
even if it doesn't make mistakes that
often
you still need to pay attention at all
times because it still does make
mistakes at a higher rate than a human
um and this is true for every single
self-driving system this is true for
google this is true for tesla's sugar
uber
um
would you need more than one camera to
drive down disengagements yes probably
but we would at least need a fisheye
right i think it may be possible to get
to level four with one really good fish
eye
and
um like sideways
don't buy level t
i don't know what level t is i'd
probably buy it too
i'm a sucker for buying things i love
buying things
consumerism is great folks
see
it could be less hard on the brakes
there so you see that situation where
the lead so the car to a head is at a
dead stop
i know that the car in front of me isn't
going to move anytime soon
so i can
get on the brakes even earlier
um
right like a lot of driving smoothly in
traffic has to do with predicting what
like the cars in your lane are going to
do
if you knew exactly what the car in
front of you was going to do say like
you know a couple seconds ahead you
could drive
so smoothly
freeway is 90 of all driving that's true
um
man
and traffic
like this
i don't know how people do this every
day i have no commute i live in the
office
i don't know how people sit in this kind
of traffic
this drive.ai legit uh no
um v to v is a joke um if the driver
doesn't take control after six minutes
uh the car stops accelerating
so the the cruise control stop stops
going um v to v is a joke uh
v to v is a bigger joke than
a16z is cool
uh we like a16z
uh zoox
x-man zoox zoox no no so like on a scale
of legitness there's probably drive that
ai is the most legit out of zuk's v to v
and
drive that ai
zoox is the least legit i mean it's not
that like
it's not even that zooks doesn't have
good people or good tech it's just that
they're never gonna succeed like what
they're aiming for is this like
everyone's gonna be riding around in a
zuk's boss and like
i just don't know
like you're not gonna you're
i mean okay fine your valuation is like
two billion dollars but like
if you really are gonna revolutionize
all these different parts yeah that's
the reinventing everything um have i met
metallic of course i met metallic yeah
um
yeah zuke's you you can't reinvent
everything
uh at comedy i our goal is to own a very
small part of the driving horizontal
um we want to basically replace the
driver with software and that's it
we don't want to build cars we don't own
fleets we don't own matching networks we
want to work with people for that mobile
did get a big payday
um
why chase or wait for the last one yeah
so please sell the 90 for the freeway i
mean we do better than sell it we give
it away right so what you see right now
which is just it's been driving the car
right like i'm paying attention but it's
driving i'm not doing anything
um
so yeah why sell it it's even better we
don't sell it we give it away it is on
our github for free the thing that
actually drives the car
um what do i think uber joining auto
driving uber is hungry
i do admire uber's hunger
um by the way uh if you're you know if
you you look at the neo and you're like
this is too hard to build you can buy
one from a company called neo driven um
and then installing our software is
super easy uh open source
uh self-driving car
it's not exactly what you see right here
so this is open pilot 0.3
um
plans to come to vegas soon
maybe
what do i think about waymo versus uber
i don't know
i just want to see the technology built
see this guy next to me needs open pilot
he's weaving in his lane
up six minutes
um
if you want i can show you what happens
if you let the six minutes run out so we
gotta cut in up here
i'm going to switch back so you guys can
see
waymo versus uber
i don't know
pleading the fifth in a civil case
doesn't look good
i should know i should know i was i was
involved in a civil case
five years ago
um
yeah
your lawyers tell you whatever you do
don't plead the fifth
who's gonna win well
we'll see how much effort people put in
if the bar is where it was last year we
will win uh we didn't put that much
effort into it our car is not really a
race car our car is not really like a
live following robot it's a highway
cruiser um because 90 of driving is done
on freeways and i'm sure far less than
i'm sure 0.01 percent of driving is done
on racetrack so
um i threw something together for the
racetrack
uh eddie and i were testing in the mall
parking lot a couple nights ago
it was pretty fun
um
it's better than it was last year
is it fun to watch the event this
weekend as a spectator i think
yeah i mean look if you're like
interested in this stuff all the
absolute best people in the space are
there
um
you know it's it's sad that the
automakers don't show up right they're
they're they're missing
this is this is the homebrew computer
club of uh
self-driving cars right you know
homebrew computer club apple one know
your history
um yeah yeah well the way about it
allegedly you got to put allegedly in
there
uh neil's on subaru's not that i'm aware
of i think it's been mentioned
um oh oh oh late cut in late late late
he really didn't have much room there
i mean we saw but like
um
can your ilx with acura watch do level
two without a neo um i mean
how about this
you go try your acura ilx and you see if
you can drive six minutes without
touching anything
i'm gonna guess that you can go
15 seconds
so while like level two
stresses like think about the difference
between every other manufacturer and
tesla
but here's the thing
it's not like you know go buy the acura
if you're happy with that system keep it
i thought it was crap i put in a new
system it's called open pilot it's free
and open source runs our common neos
comma ai
uh github.com ai check out our github
also linked to our website comma dot ai
by the way
we were doing dot ai before it was cool
well not really before it was cool i
mean like you go back at like api dot ai
way back in the day but now check out
vector dot ai vector dot ai is comma ai
see clone i can get this to exposure a
little better
it's not bad
it's beautiful driving up here
what other self-driving races if we
don't really do races it's kind of more
of a tech demo
um the big thing we're going to be
showing off is that we got our torque
limit really upped
um so we have we can put a lot of torque
on the steering wheel now
with certain modifications
but yeah we don't really race
uh what music should be this why does
singularity happen i don't
know um
what music should let's do i'm bored in
this theater i was actually bought this
dude as soon as i put it on i like that
that one song
but um
yo let's put on some og lil wayne
um what's the issue with getting the
wheel to move with proper force well
it's a safety issue right
um
if you're increasing the torque limit
like right now my hands are not on the
wheel right um
but i'm watching the road right and the
reason i feel okay doing this is because
the torque limit on the steering wheel
is really really low even if this thing
decided to completely jerk the steering
wheel
um yeah let's switch to some little way
in here
no problem with chance the wrapper i
don't know if i've heard this yet oh i
gotta plug in my air plug in my phone
here
[Music]
he's now plugged in
and we're about to get to that six
minute limit again open pilot's doing
really well today some combination of
the new model
temperature not being too hot
cpu headroom open pilot 0.3 also has
some like
we refactored controls into controls d
and planner d
um
a lot with like latency and system
stability
uh which is really exciting
um and of course if you have a neo
you're going to get all of these
improvements
uh as soon as open pilot 0.3 ships
yes we're about to get to that six
minute limit again
six minutes
touch the wheel a little bit and we are
going again
oh here we go north
uh
505. how does connie and i plan to make
money
well
uh yeah i can show you the neo in a
second once i feel good doing that um i
gotta do some changes now uh i gotta get
on this uh exit here
how does convey i plan to make money uh
the joke is that once you have a fully
self-driving car we are going to get
taco bell to pay us money to
well like say you went to a destination
is like your grandmother's house right
and you want to go to your grandmother's
house
but because taco bell yeah we'll deliver
people to taco bell right well we'll
drop them off we'll take you right
through the taco bell drive-through and
then like you'll just look stupid if
you're going to the taco bell drive-thru
uh
uh woman and you're just kind of like
could
this kind of looks stupid if you uh go
to the taco bell and i'm not gonna order
anything my car took me here
all right so hang on let me pause this
little lanes it's it's
not what i'm looking for right now
all right cool so yeah we can re-engage
here
can i show you the new yeah
there is the
let neo put my speed up here to 65
oh it's 70 here all right
go fast
um you see those solid green lane lines
uh the variance is real tight these
lanes this road is well marked i'm so
pretty good here
is there any concept like seo
optimizations for what
what would i do with seo optimization
um i'll show you guys you can see now
that it's like detecting a car in front
now there's a chance it'll go for this
exit let's see
a little bit a little bit of waiver
sometime it goes for the exits when
they're like really well marked like
that
we're gonna fix that with some mapping
uh the moving rectangle surrounding the
lane markers that's the calibration
and that's where the neural network is
looking right now
biggest problems with lane markers not
that many the markers are pretty chill
um we're also using the drive px2 to
connect to the lidar
so we have expensive sensors on this car
as well but they're not being used to
drive the car they're just being used
for assistance with ground truthing
right
if you want a really nicely calibrated
camera use a lighter
why does the car take you to taco bell
one instead of taco bell two well maybe
we could have a an auction like google
uh where we
auction
what uh taco bell
right like whichever taco bell bids more
[Laughter]
i mean like it's kind of like watching
driving bro it's kind of relaxing
talk about i love taco bell yo i just
got a whopper and the whopper was good
but i also got a chicken sandwich and i
said no mayo and they put mail on it and
i really hate mail so that's too bad
there's like
a chicken sandwich with one bite of it
there's a chicken sandwich with one bite
of it in this bag all right let's see if
we go for this exit here i'm going for
the exit a little okay i touched the
steering wheel a little bit there
um yeah if you're driving in the right
lane
it likes to go for the exits
um so that was our first sort of
disengagement
it was a very casual disengagement you
know it's kind of like one of those
disengagements that there's no way it's
actually going to cause a problem
if you hadn't uh
intervened but you know just always my
safety is number one um okay cool so
let's uh change lanes here i'm gonna not
disengage the system i'm gonna move us
over to this lane i'm gonna put the uh
speed limit uh the uh max speed up a
little bit
and let's go
self-driving car videos
so i used to stream on twitch i used to
do i used to live stream hacking on
twitch
and the thing about live streaming
hacking on twitch is twitch uh twitch
was cool with hacking but i don't think
they'd be cool with self-driving cars
because it's not a game
ironically i know kyle vogt was involved
with justin tv right
founder of cruz
who by the way on the spectrum of
legitness cruz is above drive that ai v
to v and zeus
um open pilot can you know probably in
japan they do have a left in japan don't
they
yeah
we don't have anyone uh
doing um
left-hand
driving yet
we filter it out in the training
and the truth is things like highways
that would probably do okay
um how do we handle working with
directions with just neural nets so
we're not integrated with directions
just yet um think like tesla autopilot
right we're just go
uh take the most probable route um very
soon we will be integrating with
directions we have some internal demos
of this stuff which are quite cool uh
what are 28 people in here for i mean
maybe maybe people are uh hoping for the
crash
why do people watch car racing you know
no um this thing's incredibly safe
and yeah the thing about the safety of
this device is it is as safe as you make
it as long as you are paying attention
and ready to take over at any time
it's never going to like jerk the
steering wheel
um and that's that's a guarantee so yeah
i mean it's the safest you make it
compete with uber i miss what you said
before i have no interest in competing
with uber um the thing about uber is
they lose money
like uber loses a lot of money
um my next demo video taco bell busted
freestyle do i love tacos hard tacos
soft tacos big tacos small tacos huge
tacos tall tacos
this freestyle
uh oh it's completely autumn uh i i will
tell you every time i interact i almost
never interact here all right let's
sample
i'll show my hands for a bit just
all right fine don't focus my camera
um yeah so i tell you every time i
disengage
so let's see um we've had a bunch of the
six minute limits and you hear the beat
by the way um if i disengage you'll hear
a beep bars for days we got flyers with
days uh you'll hear a beep if uh i
disengage
and the beep is definitely all over the
video um no fools he really is driving
uh let's see we had one disengagement
due to an exit we had one disengagement
due to a motorcycle
we had a very near disengagement due to
a late cut in but it wasn't actually
just engagement disengage
i have like a like internal thing in my
head i know like how long i have
um you know and i make sure that i
always have at least a second
my reaction time is way faster than a
second so
we're good there
um civic or acura i am in the civic uh
sorry i'm in the acura i'm in the acura
ilx
um
yeah so we'd be cruising
i mean this is this is easy driving
right this is the the stop and go stuff
before was a lot more complicated than
this
um we are just cruising on a straight
well marked highway uh this is this is
the kind of stuff open pilot lives for
we're in the left lane
um we're going 70.
this is what our pilot looks for
by the way open pilot i didn't emphasize
it enough on the last stream open pilot
is free and open source you can go to
our github and you can download it today
i've been asked a couple though my i'm
just my hands are just tired trust me
they're not on the wheel um i'm gonna
switch back to the other one
uh
hands up you're under arrest um
i've never had a hand up you're under
arrest i was arrested once but i've
never had a hands up
um
what i think the way my uber lawsuit
yeah
i don't know i just find anything sad
that impedes the progress of the
technology
i think that there's two very separate
claims that google has made um claim one
is that anthony lewandowski uh stole
documents
um if this claim is true that's not cool
uh don't don't steal that you you have a
trust relationship with your employer
don't do that
um
thing two is about patents i have a very
negative opinion on patents
so thing one uh
if it's true i hope justice is served
um thing two
google don't sue people based on patents
just win
suing people for patents is for losers
but google google also has built up a
lot of um a lot of goodwill in my book
google doesn't necessarily google
doesn't bring frivolous lawsuits right
if this were oracle right away i'd be
like get out get out stop suing people
come on larry ellison don't you have
enough yachts
um
but yeah
how does it compare to tesla autopilot
v2 i would say it's better i would say
it's better than v2 i'm not quite as
good as v1 as much as i rip on them
mobile is not that bad
there's much worse out there than mobile
eye
um
mobile's new stuff there's actually a
pretty good talk by mumbai my position
is softening on them over the years
um
uh that's six minutes i just had to show
the car i was here so i touched the
steering wheel
um and i will tell you that in
the interest of complete transparency
i'll show you video for a second
let's see
what do i get up to when i'm taking a
break from comma ai oh i go on dates i
like dates
uh what else do i do
read your network papers
play with other stuff
there's my touchscreen thing record logs
what do you mean by logs i can show you
the touch screen right now i'm using it
to record the light arm i was talking on
the lidar
um does my touchscreen record locked
what do you mean by logs uh the neo
records logs yeah this whole trip is
being logged right now
um and then it's going to be uploaded
it's actually being uploaded as we speak
uh to the cloud oh if you want to work
it come ai um so absolutely we are
hiring go to comma dot ai you can see
both our open positions page and the
sort of people we look for
um the bar is very high
uh you know we're not we're not a big
company we're a small enterprise and
everyone who works here is
super talented like the level of talent
trust me
i've interviewed people who work at some
of the other self-driving car startups
the level of talent here is is unreal
um so what are the skills you need
in general here's how our interview
process works after you get past our
phone screen um
our operations uh department does phone
screens
and then you sit down with me and you
manage to not say anything stupid for an
hour
i'll ask you questions about a lot of
different stuff
um
just like you have a basic understanding
what's the head count um
that's that's the one secret that is the
one secret of kamehameha we don't talk
about how many people we are
um
yeah
oh yeah so so things to like learn i
mean
what we really value at common ai is
ship ability
right so what i look for in people is
people who shipped awesome stuff people
who've won competitions
uh network papers and ideas that i like
um
facebook just came out with that pretty
a pretty nice video segmentation
network
the thing looked absolutely massive and
hard to trade
but um yeah we could do it how do you
redeem comma points well you earn common
points and column points are great um so
we are giving out our first ever we give
out some swag to early comma point
holders but we're giving out our first
we're doing our first ever big
uh comma point swag giveaway we're
giving away the first comma pandas if
you want to be one of the first people
in the world with a comma panda which is
of course
i would have to say at least at least
within the consumer electronics realm
the most advanced car interface on the
market
um you'll be able to get things you'll
be able your car has a plethora of
sensors that you'll be able to get
access to with a panda so how do you
redeem comma points you earn them you do
well and we give you awesome stuff
um also every comma point makes our
self-driving car a bit better so you
give us the data and we give back
well
open pilot
which wouldn't be nearly as good as it
was if it weren't for the contributions
from all our users so um thank you users
especially a special shout out to old
dirty
old dirty is
on the
common point leaderboard he has a common
neo and a honda civic now he's been
getting us
so much high quality training data that
we've been using and that's part of the
reason open pilot 0.3 is cruising right
now hey check it out i got a thing
um
this is this is just this is just
cruising you guys like you have no idea
it feels it feels so safe right now too
like it's just
you know i'm just i'm just i'm just
cruising up the highway it's doing a
better job driving than i could
uh aipac region i don't know where that
is um after raising vc money and being
in charge of people of course i still
have time to hack
um
this is
i'm very much involved with with with
with the day-to-day
um like you said we hire great people
they mostly manage themselves
uh yeah sure i mean it'll work anyway
right the video doesn't uh
discriminate uh based on location it's
not like we don't use maps
right
um
i use them
uh of course
uh
panda is good for what
um
i think i just had someone i know passed
me in uh e63 amg
um any chance for the public to invest
in comet ai not at this time we're a
privately traded company oh what does
the panda do um so the panda is gonna
get you access to all the sensors on
your car the panda's gonna get you
access to
uh all four your wheel speeds your
steering angle very precise speed
measurements your odometer all that
stuff
so it's kind of like a cloud dashboard
for your car that you can view in the
past
um also
it
if you have an electric car like if you
have like a nissan leaf you can view the
how much each cell of your battery uh
how much power it has uh what would i do
with that access i mean it's just look
at this is every one of these odb
dongles and torqued and these messages
fade away too fast
i think we're about to hit six minutes
again
you know here's a joke like we put those
videos out and there's disengagements in
the videos
like
we reflect that's what's real
like this is this is
absolutely unstaged and unfake we are
cruising
in a uh
here we go six minutes
touching the wheel
we're good
um let's get back i'm good people are
passing me in the right lane i'm going
fast we're going fast from the speed
limit um
but yeah we like to we like to cruise
responsibly why vam over emacs um
who knows who knows why people make
decisions like that
i started using them early on and
kept using them
it just seems lighter weight
uh i i like it like
actually oh you have problems with
screen i use screen as well i don't use
i actually the neo uses tmox
um
the fed's still on my ass no not at all
not at all the the look a lot of that
was fake news
um we did get a letter from nishta we
chose not to sell the product
but the truth is i'm not sure a product
like that works at like a scale of one
thousand so we just decided to open
source it instead
and we're slowly building out a network
and hopefully by the end of april the
end of next month we will have the
second largest network of self-driving
cars after tesla
um
yeah the disengages so i'm i'm in the
right lane again i'll switch back and
i'll show you
yeah yeah well i'm going i'm going fast
i'm not quite going 85 but um
ever since the afroduck incident you
know
uh ubuntu
so yeah the exits you have to pay
attention pretty much to that like at
every exit it might oh it's probably
going to want to take this exit yep yep
yep yeah see you want to take the exit
now uh that's going to be fixed
probably not in 0.3 but soon after that
it's really not very annoying
um and like it's not like it ever uh
splits the difference anymore it picks
either the exit or the road because the
car
uh because the car in front of me took
the exit it decided to take the exit as
well
so yeah disengagements due to exits are
one of the big
sources of disengagement still on the
highway
um we'll fix this with maps pretty much
uh tesla autopilot the old one have the
same problem they've largely fixed it
with their fleet learning we'll fix it
with our fleet learning in the same way
yeah no you might always usable out of
the box right i'm not
oh who has the best chance of winning
well
my money's on tesla
um my money's on tesla
and winning
look take a look no lane lights
no lane lines oh
there we go there's a disengage
um we lost the ley lines for a sec on
that bridge
it moved maybe
maybe a foot too far to the right
more than i liked again that's one of
those disengagements where um nothing
bad would have happened if i'd let it go
but just for safety and just to really
drive identically to a human i'm also
every time you do a minor disengagement
like that you train the system
um so that was a disengage right there
and you can see it you can see it deep
when i did it so
no i'm not driving of course not
full on
fuel on what
no i'm not driving it kind of the system
shot
on maps localization progress
okay so there's a way we can solve the
lane lines and there's a way we can
solve uh
okay
so maps localization progress very good
very good we made we made great progress
this year and finally starting to do it
let me see we have an exit coming up
yep it's going for that exit all right
um
the
what can you do without lane lines it
can do better it can do better without
my lungs um what we need is kind of more
of a look ahead distance
and what we also need is a bigger box if
you saw that box on open pilot
no there shouldn't be a law that uh all
roads need lane lines
humans can drive fine without lane lines
we'll be able to drive without lane lens
a lot of times we do okay without lane
lines um just in that case it happened
to be a disengage um
the minor disengages like that do a
great job to uh
to train the system yeah i got a couple
great hires uh we hired a phenomenal app
developer
um andy you can follow him on twitter
andy h2
he's been responsible for uh
the big improvements to the ios shifter
app
and
it's mentioned on our forms which if you
haven't signed up beta.com.ai
um yeah yeah we'll fix the lan i think
uh
beta.com we announced the android beta
okay this guy's going slow we're going
to change lanes here so my hands on a
wheel i'm doing a switch
and open pilot is going to do an
overtake
that's out of focus
um
yeah there's always going to be areas
with no lane lines the system right now
relies on lane lines a bit too much we
can remove it
we just have to kind of change the way
between our bill
just a little bit uh how do you deal
with snow
snow on the road or snow off the road
uh snow off the road doesn't matter
uh obviously
snow on the road you should be driving
for now i'm just like you wouldn't use
cruise control on the snow you shouldn't
use something like open pilot when it
did when there's snow on the road
obviously if there's piles of snow on
the side of the road the car does fine
it's not looking to the to the air for
clues or anything
upcoming milestones um
open pilot 0.3 uh in probably like a
week and a half uh it's significant
improvement
for the people who have
0.2.9 how do other automakers compare
tesla's the only one that's even close
um tesla might even be better if you
have a v1 tesla it's probably better
than autopilot
um if you have a
v2 tesla i'd say open pilots better
and then of course if you have a honda a
mercedes a ford or gm
um those they're such jokes that
it's not impressive
oh yeah
yeah i mean lots of things can cause a
disengage anytime there's kind of
ambiguity
maybe these disengages they're not very
harsh events
they're mostly like as long as you're
paying attention you'll be like all
right all right you're a little too much
to the right hang on let me fix that
any new tech advancements surprised me
not really not lately
well i was unsurprised by go
um
probably i would call that the biggest
like advancement to tech
things have been generally following
moore's law
uh yeah comedy i is absolutely fine in
the rain uh we drive very conservatively
with distance to the car in front we
hate tailgating um it's self-driving car
data about downloading data for the edge
cases i'm i'm more interested in
gathering the statistical normal
so i'm gonna go back into the right lane
here so i'll watch what i do
right
um so i put the blinker on
and now i nudge the wheel a tiny bit and
then i can let it go and it pulls me
right back into the lane
um
the
automatic lane change is really easy if
you have a good blind spot detector
right so i am the blind spot detector we
thought about implementing a feature
where you could like press the button
and it would do the lane change right
away
but um obviously you'd be responsible
for checking your blind spot
so uh we chose not to do that
if your car has a side radar you can
access it adding weight changing is near
trivial
um how can you contribute memory safe
languages more than one camera okay
um how can you contribute simplest way
to contribute go to get shiffer.com or
shiffer.com
think chauffeur with no vowels it's a
tiny chauffeur
um shivers our dash cam app you can
mount this on your windshield when
you're driving you can earn comma points
and you can contribute to our data set
to help train self-driving cars
if you want to go beyond that get your
hands on a panda connect a panda to your
car
it makes the training data more valuable
and it makes the data more valuable to
you as well
and if you really want to go all out get
a supported car and get a neo
uh and if you have the technical ability
get an unsupported car get a neo and do
a port
uh what's my opinion on memory safe
languages exit coming up oh it didn't go
for this exit at all okay
um notice engage there
udacity's cool i like udacity
um
we got a stopped car up ahead so i'm
just going to change lanes as a courtesy
so my hands are on the wheel
um now i'm going to pull us back so
unlike a lot of other systems our system
doesn't disengage when you use the
steering wheel it's kind of more like a
lane keeping assist system i really is a
lane keeping assessment oh support from
my camera i'll get there um don't let me
forget um we don't disengage when you
touch the wheel
we do disengage when you hit the gas and
i'm surprised more systems don't if cars
are breaking when you don't want them to
the natural human response is to hit the
gas so we disengage on uh on gas we
don't disengage on steering so i didn't
we still call it like a disengage
um
from a uh
like when we track this stuff in the
back end but it's not like i actually
like just engaged the system it kept
doing the gas in the brake
more than one camera uh this guy's going
slow hang on we're just changing lanes
here
um
yeah most of them handle okay so first
off let me get to the more than one
camera question so what we're more we're
gonna roll out before you see more than
one camera is we're gonna roll out a
fisheye lens for an existing smartphone
right
so a lot of times what you want from
more cameras is just i look scared
scared
um
a lot of times what you want from
multiple cameras
is just uh more view of the road
and the fisheye will get you there and
the advantage to only using a single
camera is your kind of guaranteed
synchronization right if you have
multiple cameras you got to deal with
synchronizing them you got to do it
calibrating them with respect to each
other
things are just hassles all right here
we go for a bridge here
all right i'm lowering the speed
manually but open pilot's going to take
this turn
this is all open pilot
um so i lowered the speed i lowered the
cruise control speed down to 55 to take
this turn it won't accelerate on turns
but i was going uh faster than i'd like
to say on the video
um
so yeah this is going to be tricky let's
see if i can do this all right
so take a look what's coming up uh no
lidar is not critical that is fake news
put out by the lidar people i'm actually
putting the speed up here
um i just put the speed back up to uh 69
and if this was all done by openpilot
all i have to do is press the cruise
control buttons
i'm going to do the lane change to the
left right now i'm touching the wheel
um no letter is joke is editor coming
back you'll have to ask editor that
uh
yeah so it's a function of speed as well
if you have like a
this car has a slightly upped torque
from stock
um
so this one can do a lot better
yeah so we're more on the camera we're
mostly interested in a fisheye and side
radars and i think we can provide a lot
of autonomous functionality for that
multiple cameras right now might just be
a
it'll get you some edge cases but a lot
of your cases can be just outlined in
front down
what unsupported car models um so some
of the hondas like the honda crv is
probably the easiest one to port to the
2016 crv has the same connector as the
civic the 2017 crv
has a different connector but it still
has the stuff you're going to need on it
and so i would say that's the easiest
uh honda accord has a slightly different
steering interface
uh it uses k-line but uh k-line is the
same thing as lin and pro tip pandas
speak lin
uh can we implement low speed following
cars that don't have it so
this car the acura ilx 2016 does not
have low speed follow
and
open pilot does low speed follow but
we're actually using a piece of hardware
to do this that we haven't released the
plans for yet
so publicly that's kind of hard oh we're
going for the exit
let it disengage i let it go
it went maybe a foot to the right
um saw the exit and was like nah just
kidding i don't want to do that
uh which model years of accord um so any
accord
if your car has acc and lkas it's going
to be a whole lot easier
um
insurance i don't even know what rm is
insurance is boring
uh i mean i'm happy to like work with
insurance companies i do believe systems
like this make driving safer um maybe
like insurance companies policy
discounts that kind of stuff i'm happy
to work with them but i don't find the
industry particularly enthralling
that we're going for this exit disengage
um yes you're seeing the accord is
actually yeah it's it's it's fine on the
highway
uh the real test of any acc system i'm
gonna do a lane change to the left
because of this truck up here
um the real test of any acc system
is it's stop and go traffic
uh the accord one can't do stop air
traffic
uh the brakes can work all the way down
to zero the gas pedal does not and
that's what you're going to need some
hardware to replace so we built we call
it the pedal interceptor we built
something that just like intercepts the
pedal
um yeah
what's rm
besides the thingy that leaks things on
max
audi
uh why do i keep speed
tailgating
why do i keep speed
my uh my cruise control's set at 75 now
all right so i'm pretty happy with that
um
if someone behind me won't do it faster
so i'm gonna change lanes to the right
and let go and it'll pull me back
audi uh yeah yeah you can probably do
audis if you have an audi with yeah i
can't throttle over can below 20. um
only the senate can do that uh and it
allows me to follow i think there's
mostly shipped on the crv
audi
has yeah if you get an audi with these
features i'm sure you could like pull
out their crappy stock camera and
replace it with ours
um cars are throttled by wire but
they're not throttled by cam
so the throttle is done by connecting
physical potentiometers directly to the
uh in the honda it's called the pcm the
power chain control module
um
so
yeah you can't control that over can
even though it is by wire now it is by
wire so if you want to build something
with a bunch of analog digital and
digital analog converters to intercept
the pedal then you can turn these cars
into working low speed following
machines um and that's what we did
we haven't released the plans for that
because of uh questions of safety
it's not that it's like particularly
unsafe
but
for everything else uh so there was an
exit that didn't go for it
went a little hit the rumble strip a
little
um
yeah we didn't ship it for questions of
safety not that we feel it's unsafe it's
just that we feel that we're like kind
of violent we're not using the same api
the other system is using
so
we're kind of like violating that
assumption for you
and we don't want to do that until you
know we're sure we really know what
we're doing
um it's not like it's going to mess up
it's just if it does mess up like
everyone knows what to do if you're ever
if you're ever in a car with um
uncontrolled acceleration
uh hit the brakes a first try neutral um
neutral is not guaranteed to work
because neutral goes into a lot of the
same uh pcm stuff
uh but the brakes will always be able to
overpower the gas on the car
um
yeah
and if you're experimenting with any
sort of this stuff um what we do is we
put pieces of tape on the on the fuses
and i can pull the fuel pump fuse out
quickly if i want to kill the engine
um it's kind of like an e-stop if things
really get bad but we've never got to
use it
uh how many employees are coming hi
that's the one secret of karma ai
all right this guy's going real slow i'm
gonna drive for a little bit
okay i'm bored
how long before non-8s features so what
would you call a non-8s feature right
um the thing about non-8s features is
it's unclear how they're regulated
so right now all open pilot really is
just like tesla autopilot is an adaptive
cruise control and lane keeping assist
um i think we could
consider things like stop signs and red
lights to be part of an adaptive cruise
control as well
to go like really beyond that
i'm not quite sure
um
i'm not like yeah that that's that's
contention on a lot of stuff where am i
driving i am driving up to self racing
cars
well i'm actually driving to a date
tonight in chica
so i'm going to chico california i've
never been in chico california before so
um yeah
that's gonna be uh gonna be fun
how many people have watched all our of
this stream
just limit non-adas to texas i mean we
could
oh the traditional automaker is this a
joke it's an absolute joke especially
with their approach right their approach
is very similar to google's approach
and if google in 10 years hasn't been
able to solve it i have no idea how
these automakers think they're going to
be able to solve it
you know they're a joke they're really a
joke
they're also just politically
these
uh behemoth
organizations where it's impossible to
do anything
um i do not see that playing a big role
in the future of self-driving
i'd say in the lead right now is tesla
[Music]
i used to say uber but i might say comma
ai now
oh i'm changing lights
this is not automatic now it's back to
automatic
if i ran waymo
damn i would put i would put 10 000 of
those things on the road tomorrow
i would get a maid i would never have
built my own car so stupid um i would
have bought some car that i liked i
would have put ten thousand of them on
the road
not with
like you know i would have put them on
the road with uh i don't want to think
of passengers i would have put them on
their own mountain i would have started
shuttling passengers around
right obviously still safety driver in
the driver's seat but shuttling
passengers
then you're getting all this
disengagement data you're getting some
revenue back from the passengers you're
building up a network like uber
that's what i would have done hey maybe
i don't want to give them too many ideas
but hey that's not really an original
idea i'm sure they thought of that many
times
nvidia's cool big fan big fan of a video
uh full disclosure i do own it video
stock and it made me a lot of money last
year
um
i also shorted mobile eye and i lost
money on it so
hey you know maybe i was wrong about my
why
um i liked i liked uh amazon shishua's
new presentation too um it seems like
they're talking about a lot more than
like crappy the latest chips
uh vita v is dumb as shit okay
let me tell you you want v2v what
there's something on the road and open
pilot dodged it a little bit
um that's pretty cool
the vv is dumb uh you want v2v uh i have
a camera and you have brake lights and i
will look at your great lights and
i would decide if you were breaking and
that's b to me
a video with radios makes no sense at
all
um how does open pilot differ from video
solution so nvidia
just has a net for steering i believe
you know 5g doesn't create new
possibilities liter v is dumb as shit
um you're going to see you guys see my
exp
b2b is dumb as shit it really is it
really is um
how do we differ from a video well
nvidia doesn't have what we have right i
had to correct there i had to correct
for that exit
um i just do it almost second nature oh
we got a big turn
hands up like a roller coaster
big turn
um
there's a spot where you pull them right
this is designated see now uh i wish i
could text her back really easy tell her
watch me on periscope you know it's my
date tonight
you
[Music]
stop it
yeah let's see oh we got one person yeah
welcome to four look at this oh do we
not we're not posting on Twitter there
we go
should be hello shared on Twitter
can we go there we go okay so we've got
61 people Wow 61 people all right so
these this periscope is to get the world
know our port to a new car which is a
Subaru yeah nobody would have I mean
like I guess buddy would have expected
that cannot see because the new GF is
hidden under the trim which is why the
new GF is actually great so this is like
a first car that we ported using
something that does not require you to
permanently remove dreams from your car
and so you can put back your dreams it
would be very bad especially like for a
super or having to remove the dreams
because all these piece is like a single
trim so and there is not much space
underneath so the really the only
solution is developing something very
tiny and I just shuffle it in there and
it's working great so some things it
doesn't have any any switch so all this
which are controlled so the stock and
non stock is control to the Panda
so we repor pizzelle can and can control
relay and the relay decides if passing
through the stock system or actually
passing through open pilot so when panda
sees ten messages like ten messages that
open pilot wants to send to the car then
it automatically open the relay
and you disconnect the camera from the
rest of the canvas of the car and then
you can you can decide what to forward
and walk to a place so people can
actually water again so what else can we
say about is there any question see I
missed a lot of questions okay
where's Jorge yep let's see let's see
no it's not it's not your giraffe we we
built our own let's see yeah no radar
everything's done with the cameras so
yeah let alone implementation of open
pilots because there is no operator in
this car we can't use the red so we let
the camera the eyesight system still do
the longitudinal controller and we just
take control of the data value it's
similar to what we do with other cars
like you and I drew says how some other
in San Diego oh well you don't come to
San Francisco very often true this is
the San Francisco we still have to move
yeah we're gonna be moving through soon
can't wait actually a good day today see
it's this 0.6 no no it's not zero six
six is we're gonna release its own is
5.11
see any other questions Oh gia frog see
it was a super heart well great the head
is aprox with you see oh yeah we did
bring we did bring some giraffe to show
off oh yeah so this piece up here which
has the Panda this so you have the obd2
rj45 and you have a 10 pin connector and
then you have what's actually doing all
the work
he's got a relay yeah yeah do a nice
water through yeah it's great beef ten
pen 26 pin which is you're gonna be your
car harness and that connects to the
camera this is just a prototype one the
other ones look a lot better yeah I mean
what has you do skies every day yeah the
relay which controls everything the 17
is what like go connects to your pan
announces it is on your car to 10 10
cozy Spears up to the Panda up to the
giraffe yes camera cover and the 2016 is
the single pin connect to do the single
connector that like connects the car to
the camera yep so if you lose if you
lose connection it'll actually switch
back to stock automatically yeah I mean
we can test it basically yeah what
happens is like if open pile of stops
working or get disconnected after five
seconds the relay will automatically
close so if for example you connect the
yin or the enforce whatever reason stops
sending canned messages the car will
fault because you stopped sending
messages and then after five seconds you
will the relay will actually close and
you go back to stock of course you're
gonna still have some faults in the car
but the idea is that when the car is off
you can disconnect your own and that's
the very simplest way to be back stock
yeah so the relay will not open if open
pilot is not sending Cal messages yeah
yeah
so okay how's the torque the torque I
would say is definitely better than they
wound up it's probably a little lower
than the Toyota there is a huge lag in
controlling in actuator controls so if
proof of weather is familiar weight of a
pilot code there is power there is one
piece in the code where we are called a
leg doctor it looks like and that's set
2.4 seconds for four for the Subaru
which is a lot but it seems to be
working pretty well so that's fine
and yes talk level talk level is descent
I would say stock ACC isn't too bad the
problem is that now we're stopped and
the car is gonna disabled so you can't
do stopping though it can bring you to
stop but then it will auto disable the
car I like is you see after three
seconds that you're stopped somewhat
annoying I believe the reason why they
do that is because this car is like a
handbrake so it doesn't have the
electronic part brake and so if you
don't have a tronic back brake and
you're stopped and something bad happens
and you want to be able to lock the car
and to block the car and have the car
standing still and so if you have an APB
you can do that if you have handbrake
you actually can so will this work on
the Impreza 2019 that's what this is any
prison chosen 18 by the way yes so this
port will work with every Subaru that is
on the global platform so pretty much
every new Subaru Impreza's started in
2019 I believe and the some of the 2018
and maybe even 17 outback are on me
somebody who wear the super can correct
me by did all the new Subaru cars are in
this global platform and so this sport
is written for for those cars with minor
modification I believe like a bunch of
people already did it for non global
platform Subaru you can't you can still
use the port so it's still like somewhat
like retroactive on cars that doesn't
have cars that don't have global
platform can still work with this port
so it's not a big deal I think a bunch
of people ready did he turn on the
community yeah so I mean few more things
again about the port I would say
I would say like its pitcher like we
could probably put a bounty if somebody
can find a way to trigger like beeps and
alerts I worked it I don't know like
they only alert and beeps well the only
beep beeping on the car that I could
find was when we turned off ACC so this
double beep these these double beep is a
beep that I can replicate I haven't
found the easy way to do other type of
beeps maybe a repeated chime when there
is somewhat like some important alert to
display or things like that sir if
somebody finds like a good way to send
like an alert with definitely the great
that you know compiled a few guys how do
you like super reverses Honda and Toyota
I would say super always work toward
Anandi the good thing about on the night
deck is that we can do ACC and I would
say OCC is definitely better than the
stock ACC with Subaru you get the stock
ACC which isn't too bad so in terms of a
pilot implementation I would say I would
say it's better than on the parsha the
car itself at least impress I'm not so
impressed this is like understanding
Impreza
is is not an STI is not like the view
that we are see or anything not
suppressed Whitaker well I don't know
people like some people like it's a it's
a full optional character this one it's
like
I wish I wish like eyesight was standard
on an appraiser you need to get like a
high train to get this down there yeah
what's new and five dollar leaven so
it's gonna we're gonna improve like
driver monitoring we're gonna add Subaru
support we are going to strongly reduce
the power consumption of the Panda when
the car is off one of the pain that
people have is of course like all right
if I leave connected the Panda and the
iana for long period when the car is off
we can drain your battery and so we are
working to to actually reduce the power
consumption in idle a lot to give you
like an idea the pond before changes
when it's idle it was consuming about
500 milliwatts and now we cut it by less
than a half so your carry is just
because of the planet the pandas Gannett
is gonna last like several weeks so you
don't have to worry about leaving the
Panda connected
and now you will also have some
improvement on power consumption on day
Monday but we will do more improvement
maybe I probably still within like five
eleven there are still few figures we
need to put you on and so everything
will be reasonable and you will have not
worry about leaving the time that
connected to your car
at least for like several weeks so
mark says we're gonna have another Bay
Area beat up before we all head south
yeah mark will meet up I'll meet up
any more support for auto-tuning maybe
yeah we want to do a better well it
won't be out of uni for a KPI we would
probably encourage try because there is
no reason to out human life you want to
find an optimal tuning for a given car
and then fix your games right so Monty
that we can work on is having a script
that analyzes certain drive well then do
outer tuning life but is now going to be
released for four compile some sort of
gay gonna be like a one-off procedure
that you do is you want to find the
optimal human again for your like
Grossmann control
and I think we're I mean I think Philip
is actually speaking
[Music]
PJ says any consideration for addressing
me on smelling up and break in Oakland
pilot
yes yeah yeah so if my even going 5:39
that's one of the biggest fear yes so
it's gone so originally we talked about
like doing it in a less like okay so
there is an open request they all become
quest is somewhat lazy and it's stop
logging when open vital fits up but I
mean it's not like gonna right now what
happens is when open pilot fills up but
and you don't have any more of them a
bit after without their the Lord care
they'll take the logging process stops
and you are not allowed to engage the
system anymore and that's a big pain so
what we are gonna do is we are still
gonna log but we're gonna add a rotation
right so you stick on lock you're going
to delete all the data and you're still
done a lot like new data and so you can
you can still drive and your stick Aloha
whatever happens like the most recent
events
my brevet yeah we pull the hardware out
again
[Music]
there's the harness
we call this the Panda interphase point
because that's where the Panda actually
attaches up there
the relay and the connectors and
all the pastor stuff on the board here
he said claisen claisen giraffe better
the one we got okay
so I don't know yeah I mean that yeah
there was the other the final rotation
and fixing the oomphel gap was the other
like faulty diamond is a decent merged
in yeah and in our internal branch he
needs some more testing so i don't know
if he was gonna make the calf I got
eleven but we did it just a lot of
testing might be factors will have it
back before the twelve we talked about
being able to update speed limits
what does it mean like update osm oh
like out update on how I am it's like I
don't know how IP are gonna be osm
people 12 like sort of like out of the
procedures like that I don't know no
tonight so the point is like people took
the same compute all the time right so
it's not like people drive like
different routes very often so if
somebody like is doing the same computer
on a daily basis
and on your router you find that in some
spot your speed limit is growing then
you can just fix it and when you're
gonna have it right for for all your
computers right so means like
they ask that people drive are not
randomly distributed across all the US
like rolls it's a given specifically ask
that people keep driving over and over
again for most of the time so we do
believe that if something is missing
from OpenStreetMap it's not a much like
of an issue for any given user to go in
and update it manually that's therefore
why we are very happy to say open
statement because everybody can actually
fix it and update it so we did it I did
it for my copy of
thoughts on side cameras for lane
changing and freeway exits
say
I mean eventually eventually I think
like putting side cameras and more like
at another 60 view is gonna help up but
honestly like we're at the point where
how much more we can do by just like
using a lot better what we have right
now like we're not nearly had to leave
it off using the sensor that we have any
capability the processing that we have
on the yield make sure we could upgrade
the processing jobs to start a process
but we could with more sensors for like
how well are utilizing assessment we
have like ie like a person could almost
perfectly driving I adjusted view that
you would have from the current camera
because you cannot safely they change
but if it happened like side the others
which most of the new cars have totally
fine you can do
there is huge traffic clear back he can
went way too far
differently we go back no no
it's gonna be a long way back oh my god
what happened to George
Pence's around
sometimes I thought Subaru was a bad
topic well it's not banned anymore so
let me look like we were like super oak
was like a pen topic like what a half
year ago because we were literally like
one in a year ago when we said super was
my topic we were supporting how many
cups they were supporting like a few on
thus and we barely started to support to
the office right now turned out that
Subaru is a low-hanging fruit so which
is yummy
it wasn't like that like what I feel
it's not bad anymore
it's just 19
like like literally support like maybe
5560 combination of like car makes car
mother's mother years because possible
provinces as the dildo thing I would say
coming out the way that we were
visioning it back then I mean the deal
intended as like a simulation when your
player L yes not not the way that to be
very beginning now I would say like
we're thinking about better strategy
later yes
but yeah I mean I ran an oscillator
still still still thing
can't go in here yes right yeah yeah
take a look - oh my god
muscle he's got doesn't that through
stopping go so he's gonna be painful
like a compiler needs to be a way to
attention to not like the 0.001 percent
of the people that might be interested
into getting like here and eventually
like ik starting on the pilot but I
would say more like let's make this
product a lot better like we can like we
are like working harder to turn these
into like letting out the sugar trying
product this is this is like use the
father's done and then of course like
making it making it better like
improving features like a lot of more
features that are related to maps we can
do a lot if you know the maps if you
know you can add like a lot of
informations like okay like speed limit
is of course exactly so any place you
can do a lot more you can we already
slowed down for turns but we can do this
pattern we can no stop sign we can no
like traffic all these feelings you know
them if if you do like a matter of
integration and you can argue that I
mean like humans don't use maps to drive
like a human can totally do I find
without knowing where it is and without
knowledge specific features from like a
database but then at the same time we're
not really at the level that like you
can have a machine that rises well as
good as a human we tell normal self and
information we have somewhat like
cheating and getting this information
from from databases so yeah let's make
let's make it a machine a job easier and
let's use as much as many information as
we can from existing databases and like
okay straight Mexican a database
so more magnification more stability
less power consumption more features
definitely like did they actually Trek
open again I'm not sure like how many of
yous like I've listened to Eva masks
interviews with the legs Freedman about
what open pilot is and what buying a
Tesla is what he says like what a game
is if you buy a Taser today you are not
buying a depreciating better asset
you're actually buying an appreciating
asset because the system is gonna get
better over time and I mean I'm not sure
if they like a mother tree that you buy
today he's kind of appreciate over time
because it costs quite a bit of money
stephannie get better over time I'm sure
he's gonna appreciate but I would say
give me the price point of the EON well
maybe yes maybe the you is really like a
depreciating asset like literally
appreciating upset because things that
the yen is capable of doing is gonna get
that a lot of time so
yeah get the neon and get them after she
gets it and then you can recite for more
because we are indeed maybe raising the
price of the yield as the young gets
better this we asked about afford but I
didn't see it for its we tried it we do
really we did release some of the thighs
honestly carol is more like we just
released some of the files that makes
you like the character face like at the
car state
so something that has like like an
understanding of what what the car can
is is saying like it's like all the
castings not like information about the
car
I didn't release the things that allows
open pilot to talk to the car because it
was in a Finnish port but honestly I
don't think it can actually be a Finnish
board because they have this 10 second
timeout after ten second that you
recommended it'll work they force you to
stop commenting the talk for a second I
didn't find that yeah a way to get
around it so let's see this is an
impressive 2018 yeah I mean how many
people are following the 50/50
with all the Subaru haters wasn't you
know they all left
that's why they're not watch as many 8's
I think who serve always a lot of others
yeah people who people have own servers
they continue to buy servers yeah it's a
lot guys so they can cancel the knish
love the car
well the EON be able to handle big
models um yeah I mean if you get smart
how to make Big Brother yes definitely
and definitely like big is somewhat like
the wrong or because we big like big is
not like Anna Jackie that I've been used
for something good but yeah I mean like
a lot better model definitely I was viv
still around of course yeah yeah should
have come but there's in charge the
scopes
my god is so painful like mascara can't
really do something girl you really need
to get like a cab with EPP you and I
have like toasted ago
well actually I think there is a way to
cheat like to make this car like having
for stopping though you probably have to
spam something and just outside the
counter can be portable compiled except
for requests right yeah
find it fine you can fix it yep we about
I definitely put up about if some people
can find like way to come to take care
more times than just like this one this
was the only time that I found any
trucks
besides the ridgeline
hi the only one I fit that common we
looked into it it doesn't add Lane keep
assist like you can't you can't come and
laying keep you can cook it doesn't have
like thank you it just has a word yes so
it's gonna go baby yeah this channel
what about the Shannon Sienna Englishman
yeah many bad
all right
they love the traffic scopes oh my god
well I mean any other questions guys
so if you have Subaru you can yeah we'll
put it up on the shop going on the shop
and it'll people open-source it - yeah
we always do
yes definitely every gif is open then
I'll get a push to github when start
selling yeah
cool okay that's it guys been a pleasure
all right guys take care have fun all
right right
it's just some title eating we're moving
very much looking to rent a home this
has been really good for us empty I'm
sure at all this there's no more no more
secrets
yeah we can't forget that poster yep and
a Calvi side whiteboard no secrets
wait is the basement empty
yeah it's great yeah oh yeah okay right
yeah oh my god yeah oh my god Wow
nope you guys realize the monstrosity of
this but this is nothing this is this is
top secret stuff yeah this is really
important don't tell them yeah okay but
this is the top yep and it's front
that's the prom yeah he did we pierce
holes in there for the don't worry about
that have you packed yeah that's fine
all right folks we just wanna see ya ray
any questions I don't really know I
haven't been like
lately gone assessment of what I walk
for me inside of them it's just
emotional you think this is the same
link this the 'saturday cell one that we
did
no not little olena yeah I think it is
no we don't have any lives for that my
folks were out we wanted to take a back
piece way it's been so long
hello
there was one wing okay so we got a
little craw
we're gonna be talking about three
things today bro
I might stream on Twitch later today so
we're gonna be exploring EOS today no
scopes this weekend
no I guess somewhere just sure though I
went hiking shop.com down I of course I
know
so first thing we're gonna do is we're
gonna look at some way mo advertising
um blame Orion's I believe is like a
Saturday morning we were all going to a
friend's house and we drove by a
residential neighborhood it was with
kids families around attention to car I
noticed has stopped all the sudden I was
like why but Shaw had run out from okay
so if you guys walk that's disgusting
this this this whole presentation is
absolutely disgusting
way mo should be ashamed of themselves
like this is the corn those two and stop
faster than I could never reacted what's
surprising is the weight of the car
seats
[Music]
those aren't users those are actors yeah
exactly
um this is not a way to present
technology this is and and this shows
the difference kind of in how maybe us
and Tesla and companies like way mo view
self-driving cars um you know just I
want you to think about the kind of
world those people are gonna create so
maybe maybe maybe um justjust justjust
just be aware when you're when you're
watching particularly I find way mo to
be the most disgusting in this matter
and it's sad because they do have good
technology look I understand when the
company like drive that AI does this
because they don't have anything else
but Wayne well has a lot to offer know
that PO I mean again the few hundred
users almost are literally actors right
it's sad because way mo has good
technology there's no reason they have
to do this they don't this isn't this
isn't making people you know excited or
more comfortable with self-driving cars
this is disgusting and everybody sees it
I know maybe this is a lot of complaints
about the media these days okay so
that's that's that's the way Moab
yeah the users have nd
they're not they're practically actors
right
I felt like our piece of equipment okay
in some way you have to kind of feel a
little bad for them because they're very
constrained by the Google brand people
Google works very very hard on their
brand like making sure oh it's googly
right and I think that what made Google
good in the past that technology which
they do have great technology has fallen
by the wayside and not just Google but
also in Weibo so I find me I find the
way more advertising to be particularly
repulsive cool so that's the way
[Music]
I notice how we're still use the word
were a worry worry worry worry
what come on okay uh we should talk
about this uber drivers watching The
Voice moments before fatal Tempe crash
up guys there are no self-driving cars
no software and cars are real all cars
are still level to make sure to pay
attention at all times well then that's
all we'll say about that um the other
thing that I wanted to look at was
Yandex released a video this is just
read it self-driving cars it's here I
don't know how it's got a million views
this is literally every single one of
the scenes in this video I think open
pilot would do a better job in their car
like this is over violent effectively
they could have literally run open pilot
on this car from his Drive and would
have done just as well I think it's I
think it's pretty oh no I can't tell ya
but I mean this is literally you know go
go to chef they come to the I by any odd
install up and pilot on it and you will
literally get dis this way no car but
you know okay
well let's let's at least talk about how
I think I mean this is just people who
are behind but I think this is at least
this tastes right like this is much like
our Drive you right this is nothing like
way more at least this is uh this is
tasteful it's nice you know everyone
likes to see nice time five studios and
people driving but it is it may be
edited out all the disengagement some
yes so just something to be aware of
they talk about how it's 99% in
autonomous mode that doesn't really mean
anything
um when 99% autonomous mode would mean
they do have a huge screen that does a
big Russian screen no but um 99 percent
doesn't mean anything because it's not
it works on 99% of roads you have to be
always be very careful when you're
looking at probabilities is actually a
great paper that just came out about the
Drake Equation they talk about the
difference between point estimators and
range estimators and how that could come
up with massively different results for
the Drake Equation which I thought was
really cool you guys can check out that
paper I did some some favorite physics
guys name I can't remember I should I
should shout it out properly no no
there's new dissolving the Fermi paradox
are you okay Sandberg and Drexler and I
never heard
before but um they can't use GPS because
it's not reliable in Russia I mean
Russia has their own GPS is called
GLONASS and to tell our reliable in
Russia though GLONASS a little thing
about GLONASS GPS is narrowband
of GLONASS is wideband and it makes it
much harder to do precise very precise
stuff because the ionosphere has
different delay times for different
frequencies for GPS all the GPS
satellites at least the l1 GPS
satellites are all don't have a actually
say that so cool I think GPS does work
pretty well in Russia we have pretty
good global coverage you can also
probably get the BAE do satellites
bay-do uses the same frequency as GPS
beta was the Chinese GPS but using
mirrors for peripheral vision um no I
don't think that's a particularly good
idea where would I put the mirrors know
you'll see what the solution is it's
probably what you expect in order to get
to anything that requires that it's more
cameras but guys a lot of the
disengagement sweer still getting an
open pilot our biggest source of
disengagement Snow's cuttings we're
gonna announce some big stuff about how
we're gonna try to really drive
disengagement down but our biggest
source of disengage now is cutting and
there are visible cuttings so open pilot
only detects the cars in front of you
using the radar it doesn't use the
camera it uses the camera for fusion
confirmation if the radar detects a
stopped object this is I mean you see
the auto pilot cars you see all the time
they crash into things in front of them
and this is the same bug because you
can't just trust and we'll get to why we
don't use lidar in a minute you can't
just trust the radar because sometimes
radars will detect like manhole covers
or bridges as stopped cars and if you
guys in the Toyota sometime will
experience false braking so it's a
trade-off right a false positive means
hard braking but a true positive means
you crash into something right so you
want to get hit from the front of the
back so you got it you got to kind of
tune these things it's a no-win scenario
the aschen marui why don't we use
lighter so um the problem thank you
thank you
the problem with lidar is twofold one
it's very expensive you if you what was
show me what lidar you can buy today
that's reasonably priced and you'll
point I don't look I can buy the slider
for five hundred dollars but just
because they're both called lidar it's
nothing like the kind of lidar you'll
find on lame-o cars so you say twelve
thousand which light are you talking
about and let me also remind you at
twelve thousand you can for twelve
thousand dollars you can buy twelve Eon
giraffe panda combinations that's even
midnight black eons
maybe maybe normally on grey panda
giraffe with international shipping so
you can buy twelve exactly there are
certain control changes that can address
that let them yeah vision mark radar
yeah those things we can do better there
why can't lie to our be made in mass
scale for much cheaper so there's no
fundamental reason that it can't but no
companies have done it yet all right so
we're not gonna spin up the comma a I
lied our division and try to make lidar
it makes no sense
Oster twelve thousand dollars is still
too much money now so there's that
aspect to it um you know could you make
ladders cheaper yeah someone probably
well and then at that point we can we
can reevaluate our usage of lidar I'll
show you a Bosch radar image not sure
exactly we mean by that ladder will be
cheap is still five thousand is still
too much and then there's also a
question of I'm not sure what you think
lighter gets you right lidar doesn't
tell you how to drive a car all lidar
gives you is a depth based point cloud
of an environment you can do very
similar things today using even a single
camera combined with deep learning
obviously you can use let's find mono
cam depth that's right yeah that's why I
mean by the $500 liners that aren't
really what you
what um so this one good this one's old
there's very good ones now let me find
the cityscapes
yep tonight
so my point is lidar is pretty similar
to a camera plus a depth now we used to
troll that we were going to put make a
box with a GPU and a camera and then
sell it as a lidar so you see the depths
there that are being returned as I
believe this is mono cabin might be
stereo cabinets it's all very similar
yeah like you can infer depth this depth
ground truth was probably taken with a
liner and this is uh without the liner
you see this is even picking up on some
things that are not in the ground truth
like that tree over there oh yeah I'm
not really sure why what you think
you're gonna get with a liner
I mean the more expensive liners do with
higher resolutions they still don't have
resolutions that even come close to
cameras so we have a thirty thousand
dollar lidar at , it's a thirty two line
lidar and it spins and it takes I think
about a hundred thousand points per
second so for comparison we're running
the camera on your eon at one megapixel
well actually three megapixels to be
precise we're really running into three
megapixels is how we do the RGB things
but three megapixels it runs at 20 Hertz
so that's 60 million data points we're
getting 60 million data points instead
of a hundred thousand from lidar so
you're getting six hundred times more
data with the EON than you do with even
a thirty thousand dollar lidar so wider
is one of these things again is this way
Mo's advertising why does everybody
think like lidar is important it's it's
really not I'm now we're lidar will do a
great job is in localization you can
localize yourself very precisely and
light our maps with a lie are this is
like the entire strategy of cruise
automation for example absolute
automation has built their core
technology was a very precise lidar slam
they've built a ladder map of San
Francisco and then they can localize
themselves in it
any more questions this is Sunday
sculpey where we answer your questions
you ask them we answer them why do
people want to ask about we can also go
through self-driving cars and see what
else oh well
so I mean
Wow Volvo premises self-driving 2021
xc90 you can ask guys
whenever you see stories like this the
engineers probably were not asked right
so um how many I is a company built by
engineers run by engineers controlled by
engineers this is a marketing story in a
lot of companies you have a structure
that looks something like this we can
talk a little bit about maps in about
peripheral vision so I mean you already
know what the solution to peripheral
vision is right the solution to
peripheral vision is more cameras of
course so you want to see out the side
of the car long you put a camera on the
side of the car right so most companies
are structured vaguely like this right
so you have really companies are run by
our business men Duvall has a tweet he
talks about how there is no such skill
is business this is true there is no
such thing as business business right
looks like business Wow um but yeah and
then you have engineer over here and you
have PR over here right so when they say
2020 probably what happened is the
business people make up 2021 and they
tell both the PR people this and the
engineers this right so what happens
then is the PR people are like okay well
we'll push this story follow will have
an XD 90 you can sleep in by 2021 and
the engineers are wait a second we can
try I mean I don't know if we can I
don't know if we can right so whenever
you see stories like that they're
complete garbage now I you know really
who the fault who I blame for for this
for this disaster fire is the media all
right so PR doesn't exist in a vacuum
I think we can find that that stories on
SEANET am i right
so let's take a look at it you know they
don't even want you to read the article
past the uh that's the title but let's
take a look here okay Volvo senior vice
president oh okay so this is the
business people right yeah see that is
trash right like this is this is a
complete trash article right this is
practically a press release from the
company so you know just just just
things to be aware of that this
shouldn't be tolerated in the world
anymore I hope that I mean I hope that
especially you know after after you know
what's happened politically people need
to stand up in this country and be like
wait a second
the media is bullshit um the media is
tons of it's just that's just total
bullshit right that's nothing that's a
journalism that's a press release um
pew news right I am PewDiePie Kenny by
saying the same stuff and it's it's
great you know we have we have people
like that calling out the bullshit um so
yeah the fruitful vision you guys know
what the solution is you put eyes on the
side of the car no I don't doubt their
desire it's my desire that I doubt
Boston when the prints come pretty well
[Music]
mapping is our graphic guys been on
vacation for the last weeks it's been
zero progress in battle sorry guys I'll
tell you the truth
you know I'm a always telling the truth
okay
will Tesla make it yes yes um in fact
here's another thing here's another
thing to think about with respect to
Tesla when you ask a question like will
Tesla make it why do you think that they
might not oh we got the car past these
presentations great big props to
Carpathia for that by the way we can we
can dissect a little bit of that in a
minute but when you hear that Tesla
might not make it
oh there was a there was a seeking out
the article that talks about yeah okay
okay okay okay Tesla is growing
massively if you have growth growth is
better than profit right I'm thinking
about it like this if you could make 1
million dollars profit this year or you
can lose 5 million dollars but make 10
million dollars next year you're much
better off I mean think about it at the
end of the at the end of the two years
right at the end of the two years let's
say gonna make a million dollars a year
if you sacrifice cars the profitability
of two million versus at the end of two
years you have five million um so when
you're in business you want to be
thinking long term now if when you have
when you're having long mosque
I mean he's thinking very long term
right here's what I would worry about
Tesla worried about Tesla when nobody
wants to buy their cars if the demand
side of Tesla dries up then I would be
concerned about Tesla's a company right
if everyone is like well I'm not buying
model threes I'm not buying Model T's
but as far as I can tell legitimately
there still is lines I mean let's see
there's some I got 300,000 people in
line for the model 3 it's like a sizable
percentage of the population of San
Francisco right um whatever three people
in San Francisco like from a demand
perspective um Tesla's crushing a and
that's really all you have to look at
the other thing too is people who are
said well you know you want promised
with all these big things he does and he
promises timelines that I aren't really
mad but but but but those timelines are
least I mean talk about a company run by
an engineer right when Ilan gives his
two-year timeline he's not lying to you
it's not the way Volvo gives a timeline
like Volvo is straight up that's
completely disconnected from reality
Elon really believes it will be done in
two years right Vermeulen perspective
now you can fault him maybe for not you
know being able to predict his own his
own you know the stuff do I believe the
employee sabotage story again it's so
filtered by the media what do you mean
do I believe it yes I believe that there
was an employee sabotage is perhaps a
strong word but I believe that he was
out to get Tesla and was working at
Tesla and was fired I think that that's
the whole story right um Tesla's issue
is about what cost i retweeted it there
was a good article that explains how
much people have to lose by Tesla's
success I don't make predictions like
that I'm never gonna there's no stupid
prediction to make that when the
disengagement is go to zero right but
when do I think their car you could nap
it will come out well I'll tell you open
pilot has X number dis engagements when
we get X down below threshold of human
dis engagements will tell you you can
take a nap right you can take a nap in
any car today
you could go buy a 92 you know Toyota
Celica and take a nap in it I mean you
might die but you know right I'll cost
to manufacture Tesla cars it's not high
it's it's really Tesla's we could talk
about where cost comes from in the
automotive sector why cars are expensive
I think that uh you're Gary you're
overestimating this what type of
hardware you process everything on a GPU
German and also that's the other thing
too like car you can take a nap in you
could take a nap in any car this is this
is another thing that just kills me
about like the media and public
discourse
please be precise in your language like
like like have precision when you speak
what do you mean by that do you mean a
car where the manufacturer will take
liability when it's driving that's a
whole different thing please say that
that's real that's something that means
something not a car you can take a nap
it I've taken a nap at all my cars
they're just worried I was moving all
right are you saying you're gonna add a
GPU in the car it's even think it's just
ignorance um no no one comes everyone
fire over sabotage the past ml guys
weren't fired but but more for you know
you see what's possible now that you've
seen the good model is location D on the
phone blocked by speeding up Brainerd
I just got that message on slack let me
respond to it yes Oh guys okay we'll
work on some great stuff working on some
great stuff so oh I guess I'll tell you
guys what location D is we can talk
about this
sososo one my co-workers just PM me and
said is location to you on the phone
block by speaking of radar D oh I don't
know what this graph means but it looks
pretty you guys want to see it I don't
know what it means but let's look at it
so this is su stiffness compensation car
speed angle offset learner yeah we're
really trying to work on the open pilots
precision we're modeling tire stiffness
now if it location date is the Dayman
that's gonna run on the phone that's
going to do that ten centimeter
localization that we always talk about
Ranieri GPU is not practical so once we
have ten cent of your accurate
localization what's running location D
on the phone it's also going to do
calibration calibration does compensate
for y'all
calibration compensates for yaw and
pitch right now it doesn't compensate
for movement it doesn't compensate for X
movement or Y movement why does the
angle offset change
we'll come furtive Expo in the future
yeah yeah so we're gonna compensate
oh we're also going to compensate for
role we don't comment say for role right
now
drive that AI is completely subsisting
on hype nothing we do will kill drive
that AI only the world becoming smarter
will kill dry that AI and being able to
see through the bullshit how many miles
do we map we've mapped well 20 miles do
we have but we're really only mapping
the gray panda miles right now you will
get will get more when we're ready
really will really do the marketing
pushes first off you know so new Iran's
in the works new yarns new yarns many
years by neon today I baited icon a shot
like home daddy I by you
sorry I mean I don't mean to be really
chilly this is Sunday Skokie we don't
show that much oh if the road is bagged
it would show up an angle offset ah we
can we have the road Bank in location D
enroll
um there's no new me on it's the same
you lose any roles in if you buy any on
today it's the same you know yeah so
we're talking about the angle offset
letter which is like what angle you have
to put the we like to make the car go
straight why do I cancel all the hacks
because fuck hacks man they're so shitty
after the bug with that with the civic
steering I'm just not doing with them in
Turkey election today I know nothing
about that I don't know if they do
pepper thanks guys I just know that the
only place to the problem of politics is
the only way that anybody finds anything
out about politics is the media and the
media is a steaming shit pile yeah they
probably give that to an intern I
wouldn't I wouldn't quite say I'm sure
Karp at these only job was to do the
windshield wipers you could do a really
good job Mia hate the media growth now
look we as consumers need to demand a
better media media that doesn't lie to
us and doesn't spread fake news I mean
that's the thing like whammo as far as I
can tell has good technology but they're
either accidentally lying or
purposefully lying I'm not saying don't
go on the media wall
oh man even Ayn Rand took her social
security you know
Wow
well I was more successful recent Evo
Bloomberg oh I have my PR guy look into
that yes the only way media will change
is a preference changes it's true yeah
you got it yeah what's wrong with way mo
it's the disgusting advertising it's
just it's disgusting
um thoughts on must claimed full
autonomy released I don't think he said
that if he did say that it was bullshit
I think he said he's going to ship some
full autonomy features it who knows what
that means
bro this is not an energy drink it's
Lacroix water
it's literally carbonated water I don't
comment on crypto I'm not commenting on
crypto and I certainly don't talk about
security and then when you call comm a
level 3 when the statistics say that it
is yells will never be level 3 can I
talk about educate young scampi level 3
because I don't think the hardware is
reliable enough to get to level 3 I
don't think the hardware the only
hardware like when you look at GM
supercruise GM has redundant modules
redundant power supercruise maybe like
that architecture could get to level 3
but the EON powered by the car with one
can actuation thing will never get to
level 3 guys we got to be real about
that they'll always be level 2 future
hardware you know you incorporate the
same kind of stuff GM Julian chip agrees
and it also depends kind of how you
define level 3 Dulli on technology
that's right that's right
what level of this engagement is level 3
level 3 just means the manufacturer
takes liability sometimes why tall big
car companies think they need lidar
I'm not sure they really think that I'm
not sure why you think they think that I
think the media thinks self-driving cars
alright I'm not sure like who do you
talk to it a big car company right what
do I think of Udacity a I was driving
down a degree um again some of the
content is good any sort of degrees in
credentialism or absolute garbage I
don't know if that was a body I just
didn't answer the question the first
time I don't mind if you were ask them
if I don't answer them outside of us
maps working will be asked to death will
community tools be released to make maps
not from us will Tesla decreased or F
cheering well I hope so
I think Tesla should lower the torque on
their steering wheel and I think they
should also not disengage on steering
but I don't know I mean again they have
more data on this than I do I shouldn't
really say that's that's what I would do
I experience this is from my personal
experience in autopilot I thought that
that torque was to us all right I'm
gonna ban aetherium security guy I'm
certainly not talking about that house
mapping that uses a great badder
progressing quite good quite a lot quite
well alright maybe should we show you a
sneak peek of something should show you
this little peek
nano sneaky
[Music]
any plans for sensor fusion what do you
mean by that is he all saying yes what
are you saying yes - yeah I don't know I
wouldn't like don't have money for
credentials man that's all right
like you're not gonna don't don't here's
all I want you to say if you are not
already like a great programmer don't
expect to ever take one of those no this
thing now this thing feeds game no sneak
peek I just canceled it it's fine no
sneak peek I found some of the content
to be good their contents good it's
always what you get out of it - with all
of those online classes right I wouldn't
pay for content but I would uh ya know
stick because it's not ready yet
I'm just gonna show you what our
internal mapping stuff looks like that's
not ready if eon don't ever get pat yeah
i mean so how may i use the phone
company right um we're gonna release you
know just like phone companies new
generations of hardware every year and
we will continue to support that for as
long as apples of course their phones
right what's kinda messed up don't we
support new hardware every that we've
launched new hardware every year we're
phone company right I've never I've
never lied about this um say there are
no level three cars but they're never us
I mean they're just like yeah oh it's
messed up that the sneak peek was
canceled no well I'm terribly sorry but
I'm a liar and a hypocrite but at least
I'm not a liar about being a liar that's
right double we plug in I'm gonna plug
in my phone to charge oh you know what I
have to plug it in to charge
I'll plug it into this convenient Khmer
I can de oh yeah perfect watch like you
guys like the periscope just dies
is that gonna work oh no thing's gonna
work you got power cycles I know sounds
is this app I don't believe that sounds
broken
are you them no sound troll it's a
little annoying it's not going into that
now it's in the mode okay now it's in
fast charging mode okay do we plan to
support European cars no nope you're
looking at the cars we're gonna support
Hondas and Toyotas that's it
cup holder er no cup holder and we do
windshield mounts I can get into why but
you want it to be on the windshield the
cup holder the windshield is much more
rigidly attached to the car than the cup
holders well phone is this iPhone X best
one you can buy wow what a lovely Sunday
scope e today is a beautiful day kids go
outside don't make the mistake I did
don't start a company you could be
outside enjoying the sunshine riding on
an ATV you know I'm saying
oh yeah Acura Lexus yet supported to
periscope app is kind of trash fuck the
pixel to fuck Google get an iPhone X I
don't know he's high school - congrats
man
but Toyotas without a DSU were
supportive oh you mean like a a no we
don't own the off site you mean like the
Camry yeah does $2,000 bounty go support
the Camry yeah we're talking about the
heat we're talking about what to do
about it
we're aware I mean take the e on down
that's all we can really say like it's
not designed for that oh cool
coming by Jim is officially supported
but um well non-hybrid rav4 do stop and
don't know there's no reflash as they're
all canceled
well non hyperdrive for do stop and go
yeah you need toyou to pedal ricardo's
OG confluence Joe was talking about
external camera no no external camera no
okay okay are you the same guy was asked
about a theorem security they just look
crawl okay
it is literally water there's nothing
else in this shit there's like just
carbonation and water that's it it's
what let's see what's in here
ingredients carbonated water natural
flavor we don't compete with cruise
turns out our cars probably ready better
than you and accent why do we buy it if
it's just water because we like to show
off how rich we are calm my guys
absurdly rich by the way we have too
much money guys his natural that's a
great question any more details oh well
they have a phone number on the side you
can call for consumer information I mean
we could call them it has been what the
natural flavors literally made of carbon
and chemicals that's literally what my
brain is made of oh I have too much fun
you have too much of on guys have I
rented a model - yeah a bunch of times
I don't know well no tell so doesn't let
me buy their cars it's cool if I had a
phone right now but I wasn't talking to
you guys odd I would high class oh oh I
think I may have left my sunglasses you
know like I was gonna text you yeah this
girl after sunglasses
in my car last night huh no media advice
dude no I'm getting on board with this
ilan PewDiePie like that I've had it
with the media Alex if you're watching
this scope you right now
I found your sunglasses you're gonna
come by I'm here all day today if you
need them today or I'm here all week
next week because all I do is work
she didn't it wasn't a date she's a
friend of mine I think she actually just
left her sunglasses so we will we will
text her back after the scope is over yo
for a lovely hike and that's why my
necks fucked up look at that sunburn you
want to talk about what bad for you bros
yeah no work good that work his life
people all people around here we say
every people is the world overpopulated
no not all just drive through the middle
of America and don't realize how not
overpopulated the world is man no I
don't get burnt down I get fed up
sometimes with some shit I don't have
Twitter personally my name is Ivan Khmer
I well adding more miles help you get
sooner to fall autonomy who said we're
coming for full autonomy doesn't matter
the world's not overpopulated it's too
bad they put dumb people in charge of
shit but other than that the world no
the world just think about this guy's
everything you like in the world it
would be like every person you like in
the world there would be another one of
them if the world had EE as many people
right what security I do deep learning I
know about AI bros no I don't I don't
even do AI you know what I do I think
management of people that's right and
that's what happens man and you know
what they say I used when I was an
engineer I was good at my job but they
promote you just enough to the point
where you're in
right that's what they always say Kansas
is fake news I've been there
isn't there I think it's real I think I
think I've been to Kansas um you got
people skills guys people skills are all
that matters because let me tell you
something people are like you're gonna
like learn a lot of technical skills
like that's great but if you learn a lot
of people skills you could just
manipulate the sucker with technical
skills and to do it in to paint your
fence for you right this is a real skill
er
yeah Pied Piper broth don't take VC
funding um it was the best
entrepreneurial 21st century Elon Musk
you see he's crushing it and not only
that what he's doing is a cultural shift
right like when you compare that with
like Mark Zuckerberg Mark Zuckerberg is
not a cultural shift Mark Zuckerberg
represents the mainstream culture Google
represents the mainstream culture right
um the mint you've got like like
advertising is uh well Jeff Bezos is
pretty good as well um now Jeff Bezos
Jeff Bezos is is the execution man right
Amazon's did a phenomenal job executing
I should should I clean myself up a
little bit I didn't shower this morning
I showered yesterday before we got
massages last night I went at once had a
massage parlor it was nice normal
massages don't get any funny ideas and
then we went to shabu shabu bro you have
a shabu shabu thank you put the thing in
the pot you cook it and it's pretty good
ma'am nama shit entrepeneurial I said oh
maybe I got a chance
no Yong Yong it will never be level
three yeah that's another way of just
saying that you know we don't take
liability for anything you do with your
er never in the future that might change
but it will require new hardware when
are you going to China
someday bro soon before the next rap I
do put a song is out on my soundcloud
this morning any companies after comma
yeah you know once once you once you try
it once since you try it once you know
you'll end up doing it again so yeah
probably I think I already know what's
next but what's he'll calm ends up first
right it's a lot of work to still do are
you ever gonna make your own car someday
no it's bad business to be him there's
no reason you want to be in that
business unless your mission already
include something like electrical call
electric cars there's there's no reason
peripheral cameras we make er them to
two cameras they look at the road they
look at theirs most of your dis
engagements in open pilot are not being
caused and I say this all the time by
the lack of cameras they're being caused
by the poor software the software will
get better the hardware will have more
sensors and more processing right like
what is a phone hack think about a phone
right
it'll have what is it phone app right
everything we are literate commonly I is
literally making housing cheaper housing
could be so much cheaper if we you know
gave some if we fought I'll say politely
housing would be so much cheaper if we
found something else for the politicians
to do like imagine the politicians
everyday didn't go and politic they like
what's a non offensive thing for people
to do play video games political
simulator that's right if we could get
politicians we do want to add we latch
on cameras Oh we'll add more cameras I
will have more sensors we're cell phone
company they make better cell phone with
the more processing and the more sensors
in there right how do you assume the
data back from you users we use the cell
phone network and Wi-Fi and the internet
and all that good stuff but yeah if we
if we could get the politicians hooked
on political simulator then house it
would be incredibly cheap guys it would
all be super cheap
what if Apple tries to buy comma I like
Apple if Apple if Apple made a good
offer and they were gonna release the
product which would be very important to
me then yeah
I like Apple and Microsoft I think both
of these companies are they've been
around a long time
I like their cultural values
I don't think apples gonna sell either I
don't think they're gonna do that much
to be honest it's kind of sad like I
wish they would I'm psyched man I'd buy
an Apple car I've an iPhone X I love
this phone I have ear pods I have a
MacBook I love my Apple products like
they genuinely make my life better with
with really very little downside um you
know you think about like does Google
make my life better yes they do but
there's a huge downside to Google as
well Facebook got to the point where
they were just making my life worse so I
you know I quit Facebook and in 2012
Apple has never you know like okay I
have I had issue like I was switched to
android briefly like around the iPhone
five time but that was just cuz like
Apple wasn't offering large screens it's
not because they did anything bad I just
like didn't like their product up at
that time and I think they've turned it
around it made it better um dapples
doing a write with the keyboard guys
I like the keyboard mine hasn't
malfunction yet and they owned up to it
you know the Apple gets shit on it for
things that just are not things like
antenna gate Tesla is a very large
company Apple has a lot of money but I
don't see them buying Tesla Apple can
afford comma very easily oh now we're
not putting open power to other phones
Microsoft again my complaints about
Microsoft see my complaints about Google
are on the lines with Google's values
like I complained ok so here's something
here's something about Facebook right
like Instagram meters out the likes to
you right if you get 10 likes on
Instagram story they will slowly give
them to you they'll like trickle in the
like so you're more likely to check
Instagram I find that disgusting right
um but that's where Facebook is at odds
with their user when Microsoft releases
Windows XP I don't know if I would take
an acquisition off from Tesla actually
and we can and we can talk about why
that is I
think that what would happen if we did
get bought by Tesla is you would see a
huge huge se stalling of innovation in
the field I don't know much about
Richard Stallman 100 times it's not
selling out guys it's only selling out
if you compromise your values if you
sell the company to somebody who will
continue your values values are quite
aligned with Apple as I think I would
take a Microsoft acquisition offer -
again assuming they were gonna sell the
product I'm not sure our were that
aligned with Microsoft um but why do I
like Microsoft together because when
Microsoft makes something like Windows
XP it's buggy and crashes they don't
want to be buggy and crash we're on the
same side here right Microsoft and Apple
are on the side of their customers
whereas Google and Facebook
Tesla centralizing self-driving cars
well look if it wasn't for like us your
choice for a decent autonomy system
right now would be like autopilot or
supercruise and supercruise is not
really a scalable thing please issue
colic horns here for are you asking
about crypto criticizing my carbonated
drinks and you're asking me about
aetherium security criticizing my
carbonated water and asking for an IC
o---- oh if you're if your comment
didn't just disappear you'd be banned so
fast what books are you reading what am
i reading right now not that much sadly
reading rainbows end actually but slowly
very slowly I don't think I ever said I
would never sell I said I wouldn't sell
out there's a big difference right I am
still playing chess I'm still playing
chess I there's a big division selling a
company and selling out I've read I've
read deep learning book absolutely oh I
don't know I don't really consider like
that stuff reading I only consider like
when people ask like what are you
reading I think about like the fiction
I'm reading oh my friend did tell me my
friend did tell me about a blow and I
um you should shave Chesham twit
I am pathetically bad at chess and I'm
not enough of a twitch thought you know
if I was like maybe sex you're looking
maybe then I could stream chess even
given my low chest level but you know
yeah if it was nice I like them well got
a little carnal gets here or until an
hour whichever happens first special X
shoe I don't know what that is
you could have invented twitch so karma
raised their last round at 105 million
dollars so our current valuation is
probably a little bit above that I read
foundation back in the day very little
to modernist for my taste
105 million bras Nadia's are to use
Ubuntu I don't know arches too nerdy for
me
seems like arches for people who like
things to be difficult X monad any
foreseeable need for capital raise not
anytime soon we just raised 5 million
dollars it was easy to raise no guys you
don't want your evaluation to go up
didn't you watch HBO's Silicon Valley
you don't have a down round grows don't
want down rounds dual clamp versus
single point is that actually a problem
how can we share your successes if
common goes very successful not with a
fucking IC o---- scam scam scam scam
what's Manjaro I don't know what that is
gonna google it
oh man John Linux is a new Linux
distribution which is based on arch
linux I haven't heard about this I'm
reading about Manjaro guys how much you
run away do we have too long too long
too long I'm ready I'm ready to go to
sleep you know
now but our enemy is too long we can't
die we're like zombies but connect your
I invest in the mechanic and I lost
money that's right I bought the depth
and I lost money let me tell you what I
don't like about Manjaro they're calling
it 16 point oh eight is that natural or
are they just doing that to try to sound
like Ubuntu
oh not you ate this no no they've been
around for a while no no no no no no see
look at this shit 0.8.1 point three
fifteen point oh nine nothing I don't
like your marketing Manjaro I see what
you did there yeah I bought the dip bros
I thought it was gonna go back up
we're not updating the phone hardware no
new phones no new phones no no sorry I
dropped you guys um no hang on I should
kind of get ready the Carter's coming by
I should kind of get ready with some
stuff some some I'll tell you what it is
it's the new Honda Civic Tour quad that
actually works yeah that's that's
happening untitled not releasing panda
schematics oh yeah yeah there's a lot of
USB ports in the display we have a
contingency plan in case one place bites
the dust don't worry don't worry
but you guys already know the
contingency plan you guys read the code
you know you guys know what we're doing
it's not that much of a secret you
probably if you won't go back and look
at the old periscopes we've shown them
to you as well and we have a lot of that
but yes okay fine one new phone will be
supported in the probably the next
version of open bar right all right you
guys already know what it is I showed it
to you I went driving on the car and one
of the periscopes we do use eagle
actually yeah it's kind of getting
better since Autodesk bought them uh we
tried to run a casual competition once
they wanted to charge us like 75 grand
it was absurd um how did the accord
actuators compare to the Civic they're
shittier you want to wear camo well you
know I give me a job to come and I you
can apply on our website you know go to
come about a I cook job in the top bar
you can apply right there on lever we
use tensorflow
I don't know I don't really like
tensorflow
but it seems to be kind of more
supported I like the way packed which
thinks about things more but you know
tense flow came out first if someone
does reverse engineering or panda we
will sue you
we do have insurance yes absolutely we
have we have interns um no I'm not
really gonna sue you like if you post
the schematic I reverse engineered
schematic up and online and move that
cool Brown will sue people suing
people's bad I got two votes it's bad
don't sue people kids don't worry Oh
relax beautiful words nice Pleasant
mayor of San Francisco your charts
nothing Wow okay yeah bad Sony thoughts
of moving company back in New York not
gonna happen are your company's value of
5x higher in the Bay Area it's trouble
they did Studies drug is bad stay cool
guys are not on drugs
today I had a mop a and half cup coffee
I'm not really I'm over here the Civic
toward mod and if you sue me whatever
your name up there with Saudi know am i
buying a Tesla Roadster to point out no
I'm gonna fire the ml guy he's doing
well he's goes over West Coast though I
believe that the company value is not 76
percent me I'm the social media guy I'm
ml interns absolutely welcome I just do
the periscopes on the Twitter guys look
you think I actually write code anymore
I shit talk and I complain and I do that
sometimes publicly and sometimes
privately but ya know trust me you were
the guy behind the guy no no I wish man
a wish
and telling y'all the truth
the whole truth and nothing but the
truth so help me God I do mostly really
that's my job I should talk in
complaints I do read slam publicly on
Twitch check out twitch slim what's the
plan for after about 0.5 old pal 0.6
won't be a great this isn't it it's kind
of true if you had time for psychotic
that wasn't really the driverless what
would it be I would like to make my rap
better
we don't do remote I've never met it
snowed in no Google did away with don't
be evil see like they did away with it
because the humorless assholes were like
oh be good yeah you scare me a lot more
when you say be good not much let's talk
about the evil in the world
most of the evil in the world was not
done on the banner of don't be evil it
was done under the banner of be good
right Stan let's see rap God Summa LUMMA
dooma LUMMA you assuming i'm a human
where I got to do it again to you I'm
superhuman innovative and emitter
episode of anything I say is ricocheting
off of me Alam never stayed more than
ever devastate me had to give another I
cannot enter films because that
mayonnaise I've ever Elsa cuz I'm gonna
make a music you make elevator music oh
he's too mainstream that's what they do
make Jay get jealous they confuse it
that's hard with rap shot guy with dark
but I found a something music I don't
actually know the words
do I wanna lose yourself and make them
lose it
[Laughter]
come at ICON stand inside of the booth
truths filaments but true films until
two films come flying about if I mouths
now rewind it payback motherfucker for
the way that you doubted me how does it
taste
when I slept the taste out of your mouth
with a bass so loud that shakes the
place I'm Hannibal Lecter so just in
case you think of the saving face you're
gonna have no place to save at the time
I'm doing this place so Drake come AI n
okay well we'll show off one Khamenei I
had before we go
[Music]
[Music]
[Music]
I'll show you today this is all you need
to drive a car
[Music]
[Music]
what up through my Prius right now when
caught my eyes Prius go down south going
hiking I don't have a phone mount so
it's very precariously put on the
dashboard and we're gonna see if open
pilots is capable of driving so well
that it won't fall but you'll probably
fall Skokie so be ready you know hang on
to something
put your put your vlog belts on what
does take pulse at all right so let me
just make this turn myself I don't have
a great pan in this car and leave a
white panda about a great panda it might
have made that turn for me gray pandas
our firmware is coming along super
nicely for them I'm some driving he's
mighty on up here you see my Comus maze
up there
what up I like how the Prius like has
this thing I just have my phone put just
like right on here yeah so what are we
going to talk about today check out my
Venice Beach California shirt this is
this California guys you know this is
this is exciting exciting shit I love
having you know this system
[Music]
yeah I don't know I really have not much
plan to talk about today mostly we're
just gonna cruise anyone has any
questions and I'm happy to answer them I
mean unfortunately I do have to press
the resume button on the Prius
so the Prius does work and stop and go
but you have to press resume which kind
of sucks that's the only real downside
and that is baked into the Prius engine
firmware but once we get Prius hacks
that is very possible the 2018 Civic
that one works
2018 Civic is good cruising here
you want to order soon how far out are
great pandas what does it say four to
twelve weeks up red light see now that
would be nice that would have been that
would have been a very nice experience
if the car had stopped for that red
light for me it should have it should we
got it we got to get them lights in
there she'll see God
yeah my my eon that bro next to me
vlog belts on
[Music]
are there steps to install for the
cinema
how many times before the HD road
manager said Tesla Hardware always chaos
a little dream I mean I don't think they
have redundant actuators I think if you
truly want to get to level 4 you're
gonna have a problem where your
actuators need like an extra level or
four guns you think about it like a
backup parachute right that was me doing
the acceleration to be honest I've open
pilot took off from that you probably
wouldn't have fallen
yeah let's go
I'm going to come up on another red
light red lights are disrupting my
experience right now we need the red
lights to be added into open pilot so if
anyone out there from Khomeini is
watching we need we need red lights
this is disrupting my experience my self
driving experience is ruined by this
terrible red light and this pedestrian
she's around she's crossing
appropriately good time oh yeah we don't
see four actuators right so here's how I
kind of think level threes actually go
um stack cream on it
so he'll shoot blogs like Logan come on
Ari um here's my thing level threes
actually gonna play out I think that
level three is basically gonna say that
most failures are detectable but you'll
still very occasionally have an
emergency failure where the human needs
to be immediately available consider
like an actuator failure to be an
emergency failure right if you're
reading a book or you're using your
phone which is what level three is gonna
let you do um you know you can be alert
pretty quickly if you have something
like an actuator failure right and we
have to make sure that that that that
transition is kind of seamless like if
everything in the car screams break
you'll be on the brake within two
seconds it's not even thinking about it
um and you know you should always have
you should always have at least two
seconds so if there is an actuator
failure we should know really really
quickly and that's what is doable in
kind of a level-3 scenario um what's not
doable level three scenario is like
sending these cars out on the road with
literally no people
so the yeah I mean you're just gonna
need more actuator redundancy and that's
what I think Tesla lacks um make your
doesn't steer full of right some
steering torque limits or as long as you
get the software correct it's not that
dangerous to raise it I mean as long as
you're sure that you're detecting if the
user is overriding this Sunday I don't
know if I could freestyle did I guess we
just put my speed up here I hate this we
got to override this to the Prius like
right now I have to like tap this button
70 million times to get any sort of file
and they sort of raise up quickest
easiest way to reverse engineer with
panda Cabana Andy on you see my Sun
Visor mostly I can tell you back a
little bit assuming we're not
accelerating or decelerating you might
fall the more I tell you back the more
likely you are to fall but yeah so let's
drive it right now and the motor is even
capable of full torque oh yeah oh yeah
this Prius motor is capable for a full a
full torque
how much for a wrap feature guys if you
show me that you have like traction and
you want me to come on and do a 60 and
I'll give you I'll give you 16 bars for
free on that kind of wrapper and one of
the chill wrappers you know by the way
if you haven't checked it out
soundcloud.com slash Tom Cruise that's
Tom Cruise with two zeros open pilot is
so much smoother on the brake to the
accelerator than I am Tom Cruise any
plans for bigger Aeon no no yawns are a
good size
we don't need bigger yachts
all right come on
let's think it use a little bit more
pickup I think in the one of the next
releases we're gonna raise the
acceleration limit from it's right now
at 0.15 G our Civic motors capable of
full torque I don't know um I don't
think the 404 hoody the hoody 404 well
oh well hoodies look good while that
lasted um I don't know about the Civic I
had some issues with the ILX even though
I had full armor mods giving me all the
torque oh it has a model bias issue this
is annoying we need new models coming
someday come except well
support for other cars now only Honda's
and Toyota
all that other stuff I lied we're
actually going to be buying Eddie a
Honda Accord so that's what we are going
to we're gonna have so Honda Accord the
reason we support Honda's at Toyota's is
because these features are standard the
features that we need in order to
support open powder standard and not
just on high trim levels if what you
need is high trim levels it's just not
going to work
no no outie I put up a 10k bounty that's
the best I can do if you guys want to
support Audi if somebody out there
manage just to support Audi $10,000 keep
pipe or some way to avoid fan noise does
the fan eyes bother you that much the
new control policy is much much better
the fan noise only bothers me when it's
at full speed I don't think we go at
full speed too much I don't know maybe
you read like Arizona where it's a
hundred ten degrees out hey if somebody
had support for Kia Soul
I'll give them I mean Morgan I'll give
Subaru but why not an application built
into car dashboards that's not a good
idea I'm not writing mods for every
stupid dashboard of every car the EON is
honestly so fine where it is
best help guide for reverse engineer got
to do it yourself man
oh the Toyota this there's no limits
really we limit the torque way more than
what the controller allows you can get a
lot of torque from these guys especially
on cars like the Corolla
so the Corolla has the same torque limit
as the rav4 but to Corolla what he's
like looks like a thousand pounds less
so that that thing will really fly
the Prius has this issue and we're
getting it right now where the steering
is a little bit sticky guys remember
from freshman physics where you learn
about static friction and kinetic
friction so once things are sliding they
have less friction but you have to
overcome static friction first the Prius
has a little bit of static friction on
the wheel so we can probably improve
this by using a better controller
I'm is it possible to do full stop and
go on a Corolla not without engine mods
not without not without PCF mods the
brake will take you all the way to zero
but right now you we can only accelerate
when you're above 20 no I don't give a
shit about building things into the
dashboard it's a stupid ways to pack
however taking an IQ test yeah exit
right to exit 43 eight checkout ways
I've got ways that my other people can
write dashboard stuff you have you wanna
waste your time it's not worth it like
the best you could consider doing is
tapping into something like Android auto
heartbreaking heartbreaking
heartbreaking I don't like that
my dad gonna become a scope yeah he's a
scope II if you watch us some of these
that wasn't open pilot heartbreaking
that was the guy in front of me
heartbreaking
opinions on tenses well y'all know I'm a
tensorflow fan I try to use PI torch but
you know where it work I torches for fun
tensorflow is for work I've been doing
that much machine learning lately like
you know the truth is a simple model
with a good product around it is better
than a complex model with a bad product
around it so we're doing a lot more on
the product side superbrain stacks only
point seven aisle xtogo so mr. Warren
I like ways when I go to CMU for was it
worth it there's a few courses that are
very good I had a few professors who I
really liked avoid any sort of freshman
shit also you know I probably talked
about this the US universities are taken
over by an ideological disease so it may
not be the kind of place you want to be
at right now you might want to wait for
that disease to be cured
so yeah I mean the truth is about any
store university education is you can
find better stuff on the Internet
probably that you'll find in any college
I took operating systems in compilers
Carnegie Mellon I really enjoyed both
those classes I got a lot out of them
how can you start learning excite
International Airport I come from like
like old-school hacker culture never ask
a question like that that's not a good
question right how can you start
learning I mean you know the answer to
that is Google Google just Google you
want to start writing greater read
trying to do great right that's that say
you know how can I start learning is not
a good question who's a great Eric
Raymond has this great blog post where
he talks about my blog post it's more of
like an FAQ how to ask good questions
and it's important it's it's a loss
scale
you can get cloned you could try to read
the code no I mean some Senate right to
exist for Sony projects that's the
attack but you can read everything and
like read the code read read our medium
post read everything and all these
things are just a Google away aim of our
ml Leto it's a secret I'm some some some
comm employees you guys have never heard
about because they like privacy we
respect respect the privacy of our
employees who choose privacy I mean you
guys know you guys know Eddy you guys
know Ricardo you guys know Andy I'm not
going to the airport actually I'm
picking a friend up and then we are
gonna go hiking there was apparently a
plane crash in these woods so we're
gonna see if we can find the crashed
plane to the left my background
all right you heard that open pilot stay
to the left good open pilot goody-goody
yo tell you about my background well I
grew up in the suburbs
I listen to emo music and it made me the
person that I am today
Indiana Jones plan what am I doing with
Indiana Jones
no I'm just you know that song him and I
continue screaming it's too easy this
morning I said I got my hand
oh the Indiana Jones I said to people
like know about this is just like a real
thing
, army yo you guys know who the enemy is
right well favorite evoke bad ice ELISA
like brandy'wyne Senses Fail and shit in
high school it's real bad
some of these emo revival stuff is it's
like the world is a beautiful place
I'm longer afraid to die I love this I
love this stuff to stay relevant
you know pianos become the teeth a list
of merchant ships last night oh that's
good that's good
Oh big say anything fan oh the DMV
approve of karma I mean yeah so I'm
gonna tell you guys something I'm gonna
tell you guys something I heard this
from a secret source we're negotiating
with the DMV how the DMV defines an
autonomous vehicle so obviously everyone
knows like Tesla autopilot coming I open
pilot or not autonomous vehicles under
50 of these definition the definition
that was clawed out of the DMV in
private was if your car can make a
90-degree turn autonomously then it's an
autonomous vehicle so that's the
definition we use here in common so
almond pilot is not capable of making a
90-degree turn
like from a stop like that you know you
come to a stop sign to make a 90-degree
turn and because it's not yeah the DMV
approved sure um we've gotten anyways we
talked with to DMV a bit more than we
let on they talk to us they harass us
but hey that's kinda their job
um so guys who's the enemy who is the
enemy in the common army you guys know
how far away is stay further to the
trailer in the next Lane does our
infrastructure support that yeah we got
a hack beside radars on the cars
Pittsburgh is self-driving back up into
place it's alright Oh actually my friend
who I'm going with today we are we would
seem you together Ford is not the enemy
you guys for it is not the enemy the
real world that's getting close man
no Tesla's definitely not be gotta be
bad supers not to get me nature there we
go nature man that's who we're fighting
against here we're at war with nature
Ford is doing big things
yeah like f-150 is with big tires I'd
agree with that it's deep matte steel
wool steel wool open source and maps and
feel all they're good people
oh no I don't care about Subarus
everyone else on the road they're
playing the cooperative game with us
driving a cooperative game you guys know
I'm complacency I don't like to play you
know I don't like complacency
complacency sucks man see I want to live
forever and if I want to live forever I
can't be complacent got awesome I was
down at the house of kangaroos I love
Tigers now look at Australia for a few
years
autonomous car more mission last nature
no I said only nature like trees and
shit I mean nature like like like like
God right I mean nature like whoever
built like the laws of physics right
that's who we're trying to beat here
what do I think of Argo AI I don't know
I haven't seen shit from them they seem
to be part of the PR form foam PR Branch
afford hi I'm a new fan well my 19 you
are troll man I know you are troll troll
troll troll why did I back off the Tesla
development I don't know they're kind of
dicks to me like I don't know you want
to be a dick to me you can I'm still
gonna respect you sorry man will we lose
the brain if they don't make it not
research if I haven't liked reason shit
guys oh my god it's don't worry about
like the environment that stuff is just
like make sure we collect the data and
can rebuild it all if we want to what
partnership
I've never partnered with nobody
how can mobilize support a lot of models
with our aftermarket product because
it's gonna be a warning only product
only inhale a bubble I actually sell
something that drives your car how do
you prevent criminals oh no criminals
but might they do they might have a
slightly more leisurely commute to go a
rob the bank what is coming iCarly eyes
lit bras look at this guy bump it bump
it whatever he's bumping over there his
Lexus
here is music
do I think a 2013 Honda I don't know man
that's the bad question it's Sunday
Oh bad question George is the criminal
yeah criminal you guys how's it look hey
Judi criminal it's gotta be a victim
who's the victim right oh no oh no you
can send a suicide bombing bro put a
fucking Rock on the gas pedal or don't
cuz you're a dick
well theoretically man yeah bro like the
truth is like those people if you're
shit like that loses dicks and like it's
not about the technology they're always
gonna find ways to be Dex like that's
the problem so he was I was the victim
man I was oppressed bro what does common
need that's not well done well we always
need to hire more people and we don't
just hire more people we honestly need
to hire people who are capable of
managing other people management is
sucks like I don't know if you guys have
ever managed people but it sucks
waise I'm trusting you to tell me where
I gotta get off Fabien Silicon Valley
man now let me do some more good people
yeah oh you always need good people
right so we always need good people I my
thing is in nine minutes we're just
checking my ways here and my yawn what
if you use a ton of his choice to pull
your building and hide the building
you're gross
didn't-didn't the UH in the other State
Building used to be around here now a
bunch of autonomous trucks come take it
away
um that's not you about smart people
people need management for all sorts of
reasons I mean some smart people don't
need management but you know
management's kind of a disaster what's
coming I'm not building anybody go talk
about liability man I can't think of any
positive uses of I'm a big fan of Elon
selling the flamethrowers but like I'm
not selling the flamethrowers bullshit
tunku's rap video yeah support more cars
and add more cameras oh my god more
cameras as a fan question the problem is
not cameras and the problem is not car
support the problem is honestly right
now we need to get our localization down
to 10 centimeters everywhere we need to
launch our bottom ass open soy's HD maps
make a soda can and I don't know my set
speed I don't like this thing
accelerates way too slowly we got out we
got a bump up that got Excel
I don't think I paired the Bluetooth
before but there's a little problem the
Aeons right now because european oh you
mean the little red lights don't worry
you can see them localization is great
pandas yeah we're no local dishes a lot
of software working on the back end our
localization software localization teams
actually at work right now we got a late
cut in here we got a late cut in bros
like cut it like cut it that's good it's
good good job ya know once we get
localization they'll be easy to roll it
out to everywhere we have like a three
million wild and we'll just spin up ten
thousand azure instances and just do it
you got to spend that as your money
right
hello men sunday scobie's i see my
driver being way more boring without you
guys attractive about is really boring
autonomous goons to do my bidding the
goons bro our harsh Jasper from 101
Dalmatians I mean private the ladies on
your dumb for wealthy clients why you
think I'm a whore you think I'm like one
of those Instagram girls it goes to
Dubai and puts other people's cars
none what's your fascination with low
gagging man low gang is the
fastest-growing gang on YouTube
we want to be the fastest growing army I
don't know what Apple tighten this I
mean that shit with like the seven light
hours on the roof
I don't like raspberry pies any big
updates before localization we got some
stuff planned localization with
lane-keeping help account gets washed
out yes forward collision alert Scheffer
and maybe only if we'll be good like
strawberry pies like apple pies man that
was pretty great
now resin fires kind of Academy yoga I
mean use a phone
honestly use a phone
no like like like it's just literally a
worse phone the people need like this is
what we do with neo ass right we made
Android actually usable yeah I don't
want to hear about more cameras gross
the problems not more cameras most of
all compiles dis engagements are not
caused by a lack of cameras to make an
iOS jailbreak well driving old wires
jailbreaks anymore why I'm County for
the fusion you know some least I could
do
I think you'll ever do camera processing
like HDR gap HDR's actually gonna launch
Ian's already support the young Harbor
already supports HDR we just need to
roll it out in software throw in
athletes we should have an athletics in
this car oh wait my sick minute I don't
the wheel
one point six miles I'm getting off at
Whipple Avenue a right Whipple
[Music]
you all hear that beep does a
disengagement there's a bit over to the
right lane so I can get off Whipple
Avenue down here in Palo Alto ever
there's a few people that call them
they're smarter than me can cameras do
better than humans yeah humans ain't
that great that's the hardest thing we
need to accomplish next uh-huh we got
some great stuff but Eddie's new car is
gonna be a Honda Accord we're gonna buy
a 2018 Honda Accord for Eddie like next
week true all Byam planets no don't buy
an apple addicts buy a grape and Abed
gray pandas are literally almost as good
as a plan X's right now wait'll you see
our software update do not mess with us
with a car me we have we have a few
issues we can see all the red lights
where's open source heading is the
future all open source parts are
anytime between this engagements I don't
know we had like five dis engagements on
this Drive and a few more on fire I can
be honest I haven't given it about the
ps4 I really I don't know one why would
I care
I've been the only games I play now we
have we have a vibe at an oculus at the
office so playing playing feed our games
on our 1080p eyes we don't just use it
for machine learning in aetherium mining
you driving a foot no driving a Prius
right now bro I said Prius there's no
ways up there on my Eon I love having
ways on the e on its policy it's a great
experience I'm so happy we kept that so
that's what I'm driving right now
yeah ps4 checkout pages pet pieces I put
a tent a bounty that's the best I can do
that's all we're doing for Audi who was
your new way I leader she's a secret um
when comma rap I don't do I don't do
third quarter man I rap without real
life I rap about I rap about emotion my
favorite video especially super hot
pretty happy with that but I'll see one
of the best VR experience is that oculus
like dumping the demo for the touch
controllers michaelis touches are so
nice just posted EPS hack guys be
extremely careful with the EPS hacks I
warned you get half a mile turn right on
Jefferson Avenue don't come to a full
stop I'd only have to press the button I
don't want to press the button go but I
let go go go
will you jailbreak the ps3 to help
market no I really I could not care less
about Sony about the ps3 about any of
that crap cars of the future Bros you
should keep your eyes on the road my
eyes are plenty on the road you guys oh
wow I don't want to hear that though 6
minute timeout yeah you know it's so
boring
driving impossible integrating with ways
to take exits yeah that's gonna happen
sort of you'll see
yeah I have one Titan b-but we have a
single Titan V it's a right pure Pixar
what's that 1,000 feet turn right
thank you ways
thank you open power for stopping me
safely beyond this lovely Honda Odyssey
Touring edition you bro should I pull up
next to him and tell him about open
pilots should I have Dan july's go
forward no no disengage me because I
press the wrong button I pressed Sat
instead of resume I regret my decision
immensely
I see the autopilot with the orange
video you mean the one with smashed into
a firetruck because these radars are
criminally bad don't even blame Tesla
for that honestly it's the radar makers
you guys we have the same problem George
can you say Billy I'm not kidding out of
bed well I just said it a lot of hacker
bros I'm an entrepreneur
no I'd never actually say that was his
joke face why Pacific oh we're not
actually supporting in Pacifica am i hi
do I use adderall I am not high right
now I had a cup of coffee and a maje
this morning honestly when I'm high I'm
a not driving cars and be a lot less
actually a lot less hyper I get a lot
more chill and I don't really take out
at all i smoke weed
turn right on Jefferson yeah he's got a
new car commas snapchat Bros should do
it should do it should we go all in on
the social Wow I've never actually been
to Redwood City
alright so I think this is my friend's
apartment right here this spot alright
true use the Prius South Park now that
shit sucks I can't see up there good
parking job bros yeah open pile of shit
park for us we could do it any more
cameras thank you for joining this
periscope I'm gonna text my friend going
hiking today I gotta pee I wonder if I
can leave my car here at Sunday I hope I
can alright thanks for joining scobie's
hope you enjoyed Sunday scope E and come
army keep you real thanks bro
geez
to us do you capitalize it I did I did
one word to one word yeah Vivian is my
father but we aren't happy anyway we
don't want to show for their product I
do want to show up in their product it's
honestly a great product this is a PEM
CAC error problem between user people
all right guys so well on our way to the
Baidu meetup in Sunnyvale
how many scobie's got 37 all right so
first off we're in late yeah we're late
now I will tell you why we're late the
scope is might like why we're late we
hired a new contractor for the machine
learning team hopefully he'll be
converting to full time in a few weeks
if things work out he'll be working on
driver monitoring so this is very very
exciting so we're on our way to Baidu in
Sunnyvale we're 30 minutes late we're
going on the Baidu Meetup we skipped the
wave on meetup yesterday because I heard
it was a total scam they they sent me an
email explicitly revoking my invitation
and then they sent one of our employees
three back and forth emails and
eventually revoked his invitation it was
basically just a scam to recruit but
we're hoping that by do is actually
going to be open because by do makes
open source stuff so open posit is shit
and don't say that these are users these
are using screen open pilot is the best
system you can get on your Honda or
Toyota vehicle that is definitely true
but once you've tried Cadillacs
supercruise you're gonna only want
supercruise I try to autopilot yeah it's
about the same as also violent but I've
tried supercruise and I'm like this is
what semi-autonomy should be this is a
great system except Viviane I'm gonna
try to engage it right now maybe show
them the batwing supercruise lock out
see owners back
so we think that GM remotely SSH tin to
our car and disabled - just kidding GM
can SSH into your car that's only Tesla
what actually happened is supercruise
disengaged something like vibrates you
see it it's like supercruise disengaging
and I was like I'm just gonna like let
it keep going like maybe it'll just keep
driving maybe it's like crap well just
start slowing down like all the time it
starts slowing down forcefully puts my
hazard lights on and then apparently if
I hadn't still touched it it would have
called OnStar but I touched it before it
called OnStar but not before I got super
cruise lockout see owners Minh so this
is a bit of a conundrum if I was the
only person in the car because I'm not
sure how I could read the owner's manual
I don't have super cruising vehicles
it's not smart of them but fortunately
Vivian's here and she read the owner's
manual and after about five minutes of
reading there were there were a lot of
pages we finally get to the part about
the super cruise lockout so what does it
say ignition without super cruise as
driving is terrible
basically we thought we had to restart
the car I told us wait to be sick I was
I had to restart the car and the owners
man and so we did what any sensible
person would do we restarted it really
where has the lights on in the middle of
I became to a full and complete stop
don't do rolling restarts we find that
came to a full and complete stop on the
highway dresser hazard it's right under
the glove box capacitive touch o Chemex
not against buttons this whole car is
covered in button is it that should be
an actual button I don't want to be able
to I'm fairly aware the one place they
should have a lock the old muffins they
get it some over and things like this
but the switch between
adaptive cruise control and normal
cruise control button
that's kind of nice actually sometimes I
wish that is it yeah sometimes I do wish
I is that really a button you want
honestly I've wanted it probably oh oh
look at this button the auto hold button
Auto hold that's important
what does it do it auto holds you so
this only breaks this I mean terrible no
I like that one come on it's not
necessarily could be just as easy to do
that can you do that oh can do yeah
but super cruise is great that's what I
was saying I know what it is but I don't
have super cruise right now we're gonna
I thought that car coming on that side
was actually the BMW time and I was like
it's way too just past those check it
out you know what's sad we could have
bought an m5 and I don't even get super
cruise right now I've been complaining
how much have I been compares open pilot
oh guys not engaged guys okay I've been
listening to this band Shinigami this is
actually just one guy and then like I
looked up like what is Shinigami mean
and I started watching Death Note it's
on Netflix you guys got to watch it the
old anime series on believe you're
probably the only person watching that
seriously it's it's so good it's so good
no but we're not here to talk about
Death Note we got to talk about
supercruise lockout what does this go be
saying actually they're not really con
they're not really
I should choose the rotation isn't kind
oh they don't like being 70 what do you
guys think about what are you my middle
school for real
that guy was your middle school day
Shinigami I think he's like 18 that you
like started a month ago maybe this
guy's death no maybe yeah yeah it's for
people like George who want to try to
see what the car yeah oh oh okay to
reset turn it off open close the door
lock the car wait at least a minute I
don't wait it this is worse than forcing
people to go through the Taco Bell
drive-thru to resume driving I would
honestly rather go through the Taco Bell
drive-thru that plane up there yeah yeah
it's got good wobble the realities got
ping-pong ping-pong
no but the reality is that you messed
that up you should have just taken
control I'll try to say like if this
lockout is this is harsher than
America's laws on drug possession you
know what I mean like this is just this
is just I was in control I just wanted
to see what would happen you know what I
mean the rules applied this is a
draconian rules
why dude a 2-speed kids work with the
Fords oh boy
ap does the same thing really it locks
you out ap once you want after the third
one what this one does to this one sit
on the third
well you clearly got alerted twice and
didn't do anything no I do what do you
mean an owner's manual but the other
gloves but the other ones I totally took
control well it says it gives you like a
1 2 3 a 1 2 3 it was a one time walking
you've been in the car the whole time
one thick Khan was rude what
how rude what do you say who is it rude
to me oh yeah don't tolerate that's the
route to me that's okay but don't be
rude to Vivian scope I thought okay you
can just restart Tesla pretty sure no
need to get out yeah nope Tessa really
give you three like I've seen the Tesla
holders he'll assist
I've turned it on that really needed a
button guys glad I had that button Oh
your poor that's a good deal
we I didn't even know you could and you
know a pilot worked on a $45,000 cars
I wasn't dollars it might have been a
different cards I hope you yeah and I
hope you didn't get you want I hope you
didn't buy a Ford shit it's not anymore
it's not
Oh Alexis no Alexis again and our exit
an rx-8 energy we're 45 oh you bought a
fusion energy I'm deeply sorry out of
Ford pilots never gonna work on for its
trade it in trade it in before the value
goes down you treated it you can use it
you can trade it in you don't lose that
much money do they know that our
particularly if your state has
reasonable tax laws we are over Ford we
are never gonna work on Florence the
gauntlet has been thrown down no far all
right that's it's go fees let's just
leave them with one more wouldn't it be
nice if I have super cruise right now oh
no super cruises locked out oh that's
right oh yeah open pilots gonna do that
same shit to you guys so always pay
attention when you drop me
I don't just test it open pilot doesn't
mess around
what up scobie's
a few people too
keep it light yeah
good plan it's kind of like pair to like
Honda's you might get carplay papa
oh no don't car politically they're
working periscope Oh for safety this
functions not available Oh excellent
cool no ok guys test drove a Cadillac
ct-6 with supercruise and so first we
get it anywhere like it I engaged here
can I engage we are driving we drive
over to route 1 I engage it on route 1
and I'm like yeah the first it
disengaged around us around a turn it
disengaged around a turn took it took a
solid two or three minutes to get the
system to even recognize that it was on
a freeway yeah and it was even when it
was engaged it was it didn't feel great
but then but then we got on the highway
we got on the highway we got on on 280
big clear open I wouldn't say the
quality was a fifth of Honda sensing I
would say it was like on par with like
Honda sensing unlike unlike route 1 but
then we got on the highway but then we
got on 280 um you know where the bends
are pretty shallow and it was flawless
it was no super cruise doesn't need
counter HD maps on huge multi-lane
highways it is absolutely flawless it
didn't so first off it doesn't wobble
both autopilot and open pilot wobble in
the lane you don't understand how good
it feels when it doesn't wobble um we
see it on the gyros okay
it's literally just edge
Oh bad a/c noise ah they don't like the
AC nose um yeah no no no ping-pong yeah
we turned it off we turned it off for
good but why do open pilot not of how
did GM do it it's a good question you
guess oh we got it we got a good way of
lava we got to get serious about beating
the evils of wobble so one way they
might have done it
is they have maps so they know the exact
angle the car is supposed to be at at
all times they don't have light are they
are using a camera to spot the lanes a
GPS and a map
behind us yeah
[Applause]
have you tried a very long turn you've
experienced some minor oscillations I
thought it was I thought it was
absolutely flawless on the highway where
his design we did get him so there was
an exit it was an exit and I'm like you
know you have his problem at all upon
autopilot where it kind of goes for the
exits um it didn't go for the exit but
it disengaged it disengaged
it just it wobbles the seat it turns red
yes surprising from GM I was very happy
with what supercruise I was impressed
and it just you know we have to do
better
wobbling
it's just something so solid about
superfoods yeah I was very much even
through the curves it was really dead
center in the lanes yeah like right here
you see a little bit of I'm gonna whop
that wobble so Chris doesn't do that
it's light so we're driving here on open
pilot and syndics I'm past economy Prius
waffles a loss I'm super crews using
Mobileye they use Bob like they use
mobile I and then they use they made a
custom HD map of all the highways so the
big downside of supercruise is where it
will engage so open pilot will engage
absolutely anywhere we just trust the
user and then that bit there's overshoot
on turns too
[Music]
we can we can be better we can we can be
better
you don't have the Prius interface mods
no no no no this is this is more of a
limitation about the pilot we have ideas
about how to really just fix all the
longitudinal control was worse than ours
there are longitudinal control I mean
every every single system is good on the
highway when there's like five mile an
hour speed differentials no I don't
think it's how mobilize doing it I don't
think they're using that I think they're
using just just the lanes really it's
detecting lanes from mobile I and it's
using PhD maps
yeah yeah so I have an idea that once
you have a gray panda by the end of the
year you've gone one of the cars that we
really try to tune well I will kill
wobble I want it to feel as good as
supercruise little gender and she maps
the lanes and will really just say okay
you have to stay in the exact center of
the car we have precise localization we
have to just do it um open pilots
longitudinal is is better we came up
behind it wasn't a fully stopped car it
was a car that stopped going at about
forty five and the braking was way too
late it was maybe it started breaking
maybe a half second before I would have
interviewed which is not good
how does camera interpret light our base
maps on chokers
so I think they've made very precise
maps of where all the lanes are and then
they just use those lane maps I'm gonna
look more into it I also bought a
subscription to the GM service manual
this morning so a few inches things
about supercruise it uses a forward
radar it uses four corner radars and it
uses a camera all connected my Flex
right that a young fan I know it's
getting hot though I mean
summers coming forth so sorry Scott it
off you know
these phones are not designed for this
but phones and our design yeah both of
the fan are designed for this yeah guys
yeah you know what will we understand
the unfair noise is one of the tiny
demerits of the e on the near gap it
wasn't set on your gap I couldn't even
see how much of the car I drove cost
should we show that no I don't think we
should show the price thank you can you
can look up the price of a Cadillac ct-6
I think it's me into the dealership show
the price I would get radicular quote
there's some chance we'll buy this
subject if this weekend I have a fit
what we have to go back to the board of
course late limits yeah you guys are
gonna see ready to ready player one
today I'm excited
you don't care about the fan noise yeah
no we should let me just okay it's like
everything that's a little bit bad about
our product we should do better and we
will do it better that's right next
product has a large fans although is it
like a symmetrical fan technology like
the MacBook you know the MacBook with
latest MacBook sat Retina display the
fans for like asymmetrical so that they
don't make noise this is a huge point in
the keynote I'm not sure that's patented
I think we're just going with the big
fans big is the way to go it works no
but actually a lot of that um fan noise
that we can probably fix with policy
certainly I think the fan policies a
little bit too aggressive yeah because
it's based on the CPU temperature it's
not really based on the heat sink
temperature right hmm I mean do you have
a lot of sensors yeah
sliding to were sliding really cool of
that work you guys do you guys like the
sliding or do you guys like the tapping
to make that appear and disappear that's
okay okay guys this is more responsive
than any automotive you I think we got
to do slide on tap it was easy
they were mostly voting for tap honestly
if you just like slap the screen
because yeah this isn't how you usually
come to work
yeah it's water on a timer oh yeah it's
on a timer to retract is that how we do
it
mmm timer to attract time when you
retract there's no well no if I just
feel like that it'll time does it
eventually oh no we don't have a timer
it's a sickie
it's sticky okay yeah cool
it's full screen mode speed related or
that's interesting hmm that's a good
idea when you're stopped we could bring
up your applications and status yeah I
kind of like I mean even when I'm
stopped
I think the fullscreen view is really
beautiful so I think I think loft how
whatever mode you want to be in it's
just a tap or swipe away well we'll give
you guys a little hint not all the
screen real estate will stay for the for
the camera we have something else if you
want to do it that's case something
that's gonna be right oh my god right
there is so good like when you look at
like you know guys the real reason
Cadillac having flex right now I don't
want any flexor that's it that's a
demerit if it didn't have flex pay I'd
be more likely to buy it
what's the name of that cab you mean the
comment and idea
that's a comedy a young running the
latest open pilot all car yeah talk are
coming soon know
honestly the other reason that I'm we're
probably not gonna buy the Cadillac is
there's no OTA updates that system will
never get better they're never going to
add support for the new roads maybe a
map such as Waze well my ways
forgot my stabilizer
let's go be like the stabilized
the subtle green is nice it's easy to
tell the engagement now I engaged no OTA
through OnStar no GM cars don't OTA
the Caddy doesn't add to the portfolio
the value of the other cars you've added
yeah we're not that rich guys you all
know if you could watch this pyro script
you know we did come into some money
recently but not enough for a Cadillac
all right so that has been my review how
much let's just say north of $80,000 the
maps can be updated not the software
it's possible they could add more roads
with a map update but I don't trust that
house breaking so good yeah our
longitudinals definitely but yeah
they're ladder on the highway
top notch so that's been my review of
super cruise I'm here with Andy hey we
are common eye and this is Ariana and
you should buy one at shop a calm day i
there was a comment a sound saying get
you 70 catch yeah I believe he goes down
to 70 so the car that we were looking at
how to infotainment package it also had
that was it I mean I also didn't really
negotiate the price we could always come
back the second time and the girl she
hit the price but all thanks for
watching email you where if he is real
oh to get of 70 K I don't know I don't
know all the stick on don't get me
started on stickers on windows HDR focus
update tonight well I'm gonna see the
movie I don't know
[Laughter]
later Kalahari
Oh an update is available should I
update later later yeah
all right guys hold the skull piece yeah
how NASA's suck huh no not that I don't
want that oh you've tied of that cable
nice okay yeah we're about to see the
the first Aeon summer yeah Oh
intelligence I don't know we tested this
Oh add I added that no regret no
regression no regressions that's right
all right so we are on our way to Colma
Cadillac
um I just called them up Oh was that
line yeah there's there's some you know
triangles I think the path is maybe
being clipped in an odd way being
clipped cuz the thing but like
we're gonna do better than that yeah why
really says tonight just it about okay
will Sweden oh cool um so yeah guys no
all right a Cadillac I called them up I
was like yo you got any super cruise I
could test drive and they were like we
have one so look at me do I look like
someone who would buy a Cadillac should
we go back and get changed
talk talk talk about how Cadillacs have
been in your family for 200 years
grandpa's Cadillac grandpa had a
Cadillac that's true yeah that's true he
swears by them that's the MPC girl that
is nice it's the new 7up line seven
uploading make seven of yours
let's forget yeah we're so where's the
where's Cadillac dealership
I'm fired we have to go another few
minutes nice like Daly City next
okoma where there are more dead than
living yes
due to the the graveyards oh I like this
mall compiling this is beautiful
interface
I think yeah I think we'll just smooth
that out it's gonna be a super Cruz
versus own pilots cup so we'll go into
the dealership how odd is it if we ask
to periscope our test drive I think I
don't think it's that odd you know today
today everyone everyone knows that if
they can use the internet as a marketing
vehicle so I think this dealership would
be very happy to have their their
products you know shown shown on the
Internet so if we just say we're
vlogging you know make sure we lock down
the chest right we're vloggers we talk
about car yeah yeah we're car bloggers
just a vlog yeah there's no like
competition here there's no like it's no
nothing bad I'm just talking about
whether we like super cruise or not yeah
certainly
I really we really might buy the car
well you're really my yeah I'm not just
saying that's go please do you believe
me yeah I believe we we can but we can
buy this car you know how popular is the
CTS honestly I they're more super cruise
users or open pilot users it's close
that's like seriously I've been sold
like cockpits no way yeah oh there
really might be more open
oh I guess so good I mean there's this
this dealership at a major city has only
got one so there really might be ya know
like they sell no it's even worse than
that they I think they sell like I think
they sold like 300 of that car last year
and then how many of those have the
option package I literally think there's
more cars on autopilot to press this is
this is true hey I mean just wait until
all these Hondas and Toyotas are
outfitted well we're gonna we're gonna
beat you but the Bay Bridge is gonna be
littered with eons yeah
yawn convoy locally on club you know
start start your local young club get
your commuter convoy for a hyper
efficient commute
I love that our steam turns below
oh yeah the civic the civic is an
incredible drive around town even answer
some questions its 4G everywhere in the
bay pretty much there's some there's a
t-mobile dead zone on the Bay Bridge
so my music always cuts out on my
commute but other than that yeah 4G
coverage is very good in the Bay Area
altameyer should be better about caching
like two songs forward I don't know why
they don't do that yeah at least have an
option you know use more of my data yeah
I have unlimited data please cache more
things I vanilla gorilla is this the new
model we can't climate or no no this is
the this is this is the old model with
HDR guys but it performs much better in
difficult lighting conditions to the new
HDR yeah I think the thing people are
blaming on HDR was actually the blame of
the autofocus and it seems like it only
affects a certain percentage of adults
are using the pedal in this car no this
is the Civic so it has built-in
stop-and-go so no need for the no need
for the pedal
but yeah no I think the I think what a
lot of people complained about I had a
lot more to do with autofocus and it
only affected a small percent I haven't
seen you said there's a little bit
where's with HDR sometimes I really I
agree with you I don't think it's any
worse with HDR I think it's only the
autofocus was the main source of you
know uncertainty on the lands fixing
tell me tonight guys
yep open release to develop we're never
doing anymore to release people just
complain open those forever develop I'll
ever develop it'll be in beta for eight
years like Gmail like Jim yeah except
there's no invites for open palette you
know it's just the barrier entry is can
you can you install this and you plug he
mounts an e one can you plug in defend
and the giraffe here under to the other
we should upgrade our antenna yeah the
cross is totally visible you don't need
the distance to the car like I felt
confident looking at that cross that it
had the car
yeah certainly yeah the system I think
you've kind of said he made some fix to
the NPC as well foot lengths right yeah
he did improve the one lane one way
invisible we've been coming up with some
theories as I've been working on as
we're working on new models and like new
measure risers that it just works way
better in the Civic than other cars
because you know the Civic has a
different like when you're going around
a turn in a car it doesn't turn around
the eel it turns around some point at
the back of that car and that point is
speed and car dependent to do so we have
to make sure we can canonicalize our
models for that which you know if
everyone's drive around this this model
was all trained all Civic data right so
we do yeah we do have a lot of cars
start we're understanding them more and
more all the time
are we building HD maps yet yes yes we
are not quite releasing them because it
takes a lot of work to build and we're
being really strict with ourselves
but by the end of the year yeah you will
see you will see HD maps from come out
in the open
you have wheelbase and such data head
yeah we have we can certainly get
wheelbase data yeah that's all all
public when we plan on releasing them by
the end of the year see the maps about
what a wheelbase will be on the maps
wise flexor a harder than can assume
that this GM dealership is the same
thing as the Cadillac dealership let's
try to use the Honda navigation system
to navigate us to the calculation Wow
first bad search enter search
[Music]
lack what are the odds this is going to
work
I'm Stuart Cadillac okay let's navigate
sorry about the video quality guys this
is t-mobile's network auntie's att's
network but why am i arriving in
kilometres this is symmetric Pacific
symmetric tonight can I tell it not to
be a metric Civic that Ian's unit units
anybody choose parsecs
oh good no miles oh now I know I tell
them all that over
I'm not gonna work on left driving cars
too bad yeah we got a Vette that little
clip of that triangle yeah yeah that's
settlements not the pretty quick
Oh
[Music]
the alert covers
there was a path yeah yeah
I felt
you want to hide the path or go past the
passport
no the alert just covers it is all I'm
saying like
yeah
guys this is the this is the existing
model stop the new my eyes your to
understand the new model was actually
not efficient right some people got it
that's impossible to do a vision I'm
looking like well beyond where the car
could reasonably say with that with that
model I mean it is a model today yeah in
the future the mock the model and the
map will be working together at least
well yeah let's talk about super cruise
works super cruise is pretty much all
about there's no real model in super
cruise except to avoid dynamic stuff it
has five radars for on the corners and
then one phone case of radar and they're
all connected on flex right it has a
forward facing camera which I think what
it does with the forward facing camera
is to text the lane lines and then it
uses dead reckoning and a map to kind of
merge that all together
I think if there are math bugs just
disengages like if the camera and a map
don't agree the officer on the mountain
we shouldn't show that if we know what's
gonna make the turn
I think I think what we should do is
currently it has a fixed the the steer
control alert has a fixed time and so we
don't we don't just turn it off when we
know you're you're you're in the clear
assume you can just will be more
aggressive about we want to be tabled by
flickering we don't want to flicker this
is true
[Music]
George is it time to do haircut me yeah
it's time for me to go do I look like I
will buy a Cadillac no I don't think I
do I think they might give too much hair
yeah Andy's in the car Andy and George
and Andy on you know honestly I went if
the carpool lane says I need three
people to drive and I only have two
I consider the EON to be intelligent
life so if I ever get pulled over in the
carpool lane for that you know I'm
promoting the future right here I had
that Yeun really mounted like right in
the middle he's like you can't you got
off though because you know you
convinced and working on safety systems
drivers wait why didn't you tell me I
even put it in the nav system full
screen is shipping to develop tonight I
put in the nav system
I like that backup
oh yeah the backup camera is really good
some people are just really tied to
their own stuff I can see on an app
sucks by Toyota honestly we should
really just be using Waze
you've got about 2,000 miles of HD maps
of look nice keep giving us the data all
the data you provide especially dated
with a great panda is fundamental to the
future of Khmer I we have told them that
I yeah you need a great panda top in
order to be part of the HDFS we can't
make a at least for now we can't make a
map precise enough that's why we made
the great panda so that we can get high
enough precision GPS yeah that we do
appreciate all of your data yeah like a
telephone still no lead car distance in
UI that's not we don't think it's coming
back if you want it you can absolutely
make that change I've seen there's some
some Forks that have already already
done that but I don't think we'll get
we're gonna be up streaming that what is
important is for us to show you that it
does detect a lead car and that's what
we have the Red Cross for yeah so we may
change the UI with the Red Cross if it
is any at any point not not clear but
it's an MPC reset right
all right nice nice San Francisco view
right here
make the Red Cross bigger yes perhaps
maybe a little bit of a glow to it
yeah if it's on a red car that's true
yeah I also heard people saying that
looks too much like brake lights it's
kind of true I think we can do better I
really like that path being cut by the
car
man that looks a lame OS - no it looks
like we like know things BAM it's fast
well I considers the car to be there for
a little longer than
driving at night in Idaho the red cross
blends in to brake lights so yeah yeah
certainly we we'd like we'd like to have
a distance independent indicator that
that works so we'll certainly keep will
certainly test any future UI change on
on brake lights at night and on red cars
and make sure that it uh it's tap how
come it's not swipe not implemented
swipes not implement wicked we can
implement yeah I mean that would that's
the natural motion for me yeah I would
like that to work if possible when our
great panda tools come in crop load to
see the position of the satellites
likely I want to say we then put in
three weeks perhaps we'll have you'll
have you'll have the ability to view the
satellites on your yawn in the great
Panda so we're also doing a big open
source release around the great Dan dodo
you know that like huh like like the
camera company okay it's nothing else
okay all right I probably know what it
is I just don't know what the code yeah
I know that's yeah that's what we're
gonna call it tip like like like like
like like the dead dogs but I saw a lot
you know I saw like it sound like that
yeah so you know great fan of people
will be very happy
the great pandas really like for its
price it's the most precise GPS you can
buy
what about Schiffer on phone using
Galileo first great panda it doesn't
matter which constellation use it right
it's on the phone this matter if using
like glonass galileo or gps the problem
that has a lot more to do with the
antenna and the update rate um so the
update rate can be hacked so we've done
that on the eon so the EON gps is a bit
better than i've been a normal phone but
we can't do anything about the antenna
our rights to a Cadillac I've been to
his GM Malak Gary pushing get pull on a
loop was get pulling on old vanilla
gorilla that's how you stay updated you
know you never know when the updates
gonna come out so you should always be
[Music]
cool visitor parking are they gonna
notice we're not driving at GM we're
allowed to park next to all these cars
all rights go peace we got to go inside
we got to go be nice to people you know
me I'm buy a Cadillac it really might
buy one of these if I really like if we
like it yeah we're gonna test drive
first though gonna test our first
insight all right all right
well thanks
[Music]
your guys
I'm in the best autonomy system in the
world right now the best one you can buy
anyway this cost me 70 thousand dollars
super Chris is really good and I don't
know I don't know if I'm gonna sell any
of these Cadillac ct-6 --iz but we
bought us 86 here I am George at SOCOM
and I ride home
in a ct-6 and want supercruise right now
I'm gonna flip you guys around
it's super good like I don't know what
to say oh my god I mean I I don't know
how much to trust this thing I feel like
I trust it too much it's too easy to
trust it is monitoring the way I'm
looking but like I haven't at least get
in the middle lane there's all of time
to correct it so turns blue
during the lane change now let's see if
it'll turn green again supercruise
disengaging this bullshit supercruise
unavailable so okay it's really finicky
like here's the dashboard this icon
appears I think I'm still on cruise
control I'm a little confused right now
bonds dots
yo but I'm riding my caddy yo that's
solo G this is the Mike Jones ship man
this girl texted me she's like I I was
like I bought a Cadillac
she I don't know man fuck that happened
yeah but like yeah I know it's a
Cadillac this is weird this is weird
that like but okay while supercruise was
engaged I was super happy now I can't
get it to engage again now it isn't very
good at telling me right here why it
won't engage
I don't know if this is unmapped or this
is just um
I can't see the lanes right now because
like the layer or the Sun yeah y'all I
got this 468 man negotiate no you can
get a good deal if you negotiate I gotta
know about like rebates and shit but
yeah I had to pay tax 208 why am i I'm
on the wrong camera
so it comes up is like a little icon
when supercruise is ready I don't know
why it's not ready sees my phone in the
frame it has XO it has a driver facing
camera right here
no but like Catholics are not cool like
this is not cool but but the super curse
is cool I don't understand
this is such a dichotomy can i
supercruise by Facebook Seattle Alliance
unavailable now um oh yeah you can
really see the LEDs they're monitoring
me and check out the review merits an
LCD GM got special approval from Mission
for this yet so while super cruise is
engaged it probably is the best system
you could buy but then when it
disengages you know you don't really
know why this car is kind of too easy to
trust - I like I've never seen super
cruise make a mistake which is kind of
bad
just stop here it's light
send us the cabana li so I don't have
any common art we're in here yet we're
gonna go home we're gonna get the Cabana
link yeah we'll definitely share one
absolutely they got some cool stuff on
cam smell but here I am in my Cadillac
with supercruise van so we'll get it to
engage again hopefully when we get to
the 101 which is coming up soon I'm
driving so I was driving for this I will
show you when I go back to to
supercruise it doesn't engage all the
time and it doesn't tell me why it won't
engage bonus is engaged it feels good so
what it's doing is it's fusing the lane
polynomials with the map polynomials if
GM's this is GM supercruise system um so
GM has already deployed maps they made
the maps they contract with a third
party company and they made the map
satellite or no we didn't get a vault oh
this is the only G I'm Carla buying
Cadillac ct-6 gonna be supported by open
pilot yeah you know it was time to buy
something a little nicer we're gonna the
EON is a Toyota and Honda level trot
product but you know the future products
is luxury for a thousand dollars
basically it's apples model right where
a cell phone company you all know it
should have bought an accord I should
not have bought in the court I love my
Cadillac you guys it's car sick let's
so unfortunately it doesn't have any red
light detection which is kind of
disappointing hope I will get that but
yeah it's got three dashi thingies I
gotta go yeah let's go yeah so we're
gonna run open pilot yep we're gonna do
a portable pop out to the city 6b the
highest-end car with open violet
that's the plan yeah so I would say
super cruise right now at least when
it's engaged is quite a bit better than
open palette they're done they have
driver monitoring which we need chef
when it's engaged right OTA updates no
jam can't do OTA updates the only thing
they can attend a update is the map
module which is a little bit of a
disappointment which is an argument to
not buy this car because there are no mo
TI updates but i mean it shows the
direction that all the mainstream things
are gonna go yeah right no this car is
so sweet
all right let's wait till we're on the
101 and then we'll get back on some
super pretty
yeah yeah we bought a CG sex it's the
Ubuntu Linux of this car ubuntu this is
likely like likely this is the list of
blackberry like they're trying no but I
mean jeans I'm working on this for a
while and like it's I don't know why
they don't hype this up I'm because it
is good maybe they're afraid people will
crash I'm not sure how many cars coming
at this size 6 15 employees 6 cars come
work at common AI and you get access to
the company cars including this Cadillac
ct-6 pretty steep I know I didn't buy
the pan or a Bose stereo with an extra
$5,000 we got the cheapest car we could
get supercruise we have to be
responsible with our spending no I can't
it responsibly spend money on bullshit
like pop up LCDs in the back and just
call exhibit if we need some of those
what is supercruise missing of any sort
of feedback on why it won't engage it
doesn't tell me anything about that it
only engages on limited access highways
which are basically freeways which are a
little disappointing
I insist
the Tesla one is good turn here bro
Daniel aim bro
I was sake ninja
this thing's got twin-turbo - so go
racetrack next year beast all y'all's
zero to sixty five point two seconds
open pilot on that car is like when they
installed Android on the Windows Phone
yep pretty much kind of what we're going
for
alright is supercruise better than
autopilot in limited access highways yes
I haven't actually I haven't tried the
new autopilot yet I haven't tried the
new model update I hear good things
about the new model update but um we try
to model three on this loop that we test
open pile it on and it was like open
pilot quality it was not I wasn't great
like I saw it make multiple mistakes
I saw it make multiple mistakes on our
drive done which is where open pilot is
as well super cruise I am yet to see
make a single mistake every time it's
been engaged it's been flawless so we're
gonna see right here live on periscope
maybe the super cruise will pick his
dick no so what I want to start doing
one of the big pushes this year is we
can really start to quantify
disengagement numbers we're gonna
quantify the disengagement supercruise
and I want to prove statistically that
we have a better system who is my core
consumer I don't think about that shit
man we're gonna build the best
self-driving car in the world just
because we can examples of what it
handles so it handles um limited access
highways
so here we are we get on one on one here
let me get over I don't like using these
systems in the right lane in case I got
it correct I have no idea what the
torque limits are on this car auto pilot
stork limit is scary high so I don't
know like autopilot I'm scared to take
my hand very far for the wheel but let's
see if we can make this engage okay so
we're on Oh super Chris super Chris
unavailable no it showed up for half a
second so workers yes we're on and it
does have a good amount of history
which it's pretty good all right guys we
are super cruising boys let's done this
thing is too easy to trust so if I'm the
first supercruise death well
historically I've kidding guys always
pay attention to pay attention I'm ready
to correct unless this thing has some
kind of crazy high torque limited but I
trust the GM wouldn't do that let's sort
of trust the testimony but I trust the
GM would do so got my hand right here
how good is it at stop cars not good I
found it's a CC system to be worse than
open pilots when I test drove the other
one oh look at that traffic um yeah so
open pilot is yeah our target is 0.5
we'll be on par with supercruise how
close open problem supercruise we got a
ways to go a lot of ways we really have
to do two things we have to get new
models working and we have to get maps
well but both are kind of close how good
is it stop car you have bought repeating
shit hate bombs brah
alright so super cruisers driving
obviously it just yelled at me for not
paying attention
all right this is super pleasant like it
just there's something about it and this
is scary like open pilot feels somewhat
unstable like it's like look at the look
there's no wobble there is ZERO wobbling
steering though right
um
yeah and like things like this like so
you see the elevation changes at least
in the older autopilot it would they
would travel with theirs just doesn't
seem too
because I think they have elevation dips
and they have maps of all the lanes that
they've downloaded so they know which
lane is exactly which it claimed to have
a one meter accurate localization system
oh yeah of course it's not gonna do any
swervy behind a stopped car like open
pilot does sometimes this is better than
oh try to steer it off a bit yeah
disengage it disengaged yeah I touch the
steering wheel it had resistance at
first and then it disengaged that wasn't
bad see now I'm disengaged which I hate
no re-engage yes thank you oh thank you
okay good because someone could tell
okay zero doesn't stop again
no don't if you're not tech savvy comes
not ready for you yet um but yeah no
super cruise is better than open pilot
now do remember that this is on a UH
there's groves $74,000 out the door so
but no we should be better there's no
excuses this is why we bought this car I
was really like you know I'm justifying
you you guys know cheap I am we were
thinking about buying a Chevy Malibu for
like thirty thousand dollars but you
know for an extra for an extra thirty
five we bought this and the reason is so
everybody can see what our benchmark is
everybody in the company could try this
car turn on super cruise to be like this
is where we need to be by the end of the
year
you guys are hearing this before the
company
what up GM if you're out there watching
no I had no excuses yeah I know it's do
you know we should be I'm paying
attention relax car
[Music]
this is good though yeah they're really
we should be this guy it's stop go now
isn't necessarily bad
many timeline on the system will be for
everyone now we gotta make it good first
like this year I want to beat
supercruise it next year I want to beat
autopilot and I have good strategies to
beat them both super Chris we can
actually be like with the stuff we have
planned for this year we can beat
supercruise a little pilot like Ilan
knows all the same strict tricks I do
we're struggling with all the same
problems the you know sir team
contracted with a company to build the
developments lidar I'm hoping zero point
four point seven one of Pinkpop how
smooth is the braking I felt better
I even think the fusion the stock ACC is
better I think open pilots is better
especially in the Prius the hybrid the
hybrid braking is better than this
da but this cars not a hybrid so you
know I mean you can't realize kinda like
comparing apples to oranges
fusion stock ACC is fantastic yeah I
just wish they had any sort of flame
keeper which is kind of a tragedy and
it's now they have this stupid lockout
on their system so we want to ship
forward we got a shape-ups reflash for
for it you guys know I feel Betty PS
reflects super cause I'm paying
attention if I move my head a little bit
it doesn't uh but it's good no this is
like this is good I think we'll do the
same thing if you're not paying
attention will blink the thing this is
this great UI you know our green is
somewhere else
piano luckily I assume you have to see
you disengagement
I am literally yet to see a
disengagement with this thing super
impressed this is where we need to be
how's the 20 1998 does that have like
the level 3 enabled I heard out he
pulled some shit with like it's not
enabled yeah we need to get we need to
get maps working this is all this is
Maps its maps that makes the system good
do you know GM just bought maps they
contracted him you guys know I want to
make my own Maps I don't wanna make them
available free for everybody by the end
of the year for Vivian's driving over
the open toilet
worth the extra cash to actually buy
this car now would not recommend buying
this car this is not worth the money if
this was any forty or fifty thousand
dollar car I would say it's worth it
well we'll see how the new air mail guy
works see if he does well how the maps
coming pretty well pretty well I know GM
does know lane change assist despite
this car having four corner radars on
flex right so that late change assist is
gimmicky I don't feel like you really
need it like right here sitting in this
traffic this is the killer app and
supercruise really nailed it Hawkeyes
the future is so cool I don't believe
this has anything to do with Cruz I
think this is pure GM well there's a GM
contractor basically what this is is GM
bought a map and a localizer solution
and map to an extent and then they just
use the lanes to fine tune your
horizontal position
you can see this this LED here is for
super cruise
it's called traffic this is the killer
app however my poor traffic's pretty
good open pilot has this little thing
where like swerves a little if you get
too close to a car we gotta fix that
coming to the next model open pilot will
definitely have driver awareness with
the front camera yeah absolutely
it's actually ready shipped at least
front camera recording optional you can
toggle it on ya guys no dis engagements
yeah this is where we need to be
beautiful
right in the center the lane is quality
I'm driving a Cadillac ct-6 with
supercruise I'm stuck in traffic and
it's kind of an okay experience master
MA sure yeah yeah resume by itself I
know uh actually I don't think I've
gotten down to zero I sure hope it
resumes by itself
yeah resume by itself when is open
public into work as well as this
hopefully by the end of the year yeah
sure what's the question I'm driving
without my hands as actually the manual
encourages one hands it my fault in what
hands on my nothing this is the Cadillac
version of hands-free driving and it is
good honestly if you're rich and you've
got money to blow by this car is there a
max time before it asked for input no I
don't believe so and we're going in the
same direction I'm so open file it as a
six minute timer right now we're gonna
do away with that once we have driver
monitoring BOTS eight BOTS this things
using corner radars to for something
over flex right
how much so this car was 68 eight plus
tax license and registration extra but
it is good
and their driver awareness really it
allows me to use my phone
ya know flex rape and I think we're
gonna buy a flex for adapter oh no you
can't use a cloudy API but you can use
whatever code you want yeah right when I
go to the deal if we're gonna say what a
different dealer the only car they had
came with the pan or a $5,000
infotainment extra package which I
didn't want nope you know one on the
pedals is like open file I mean you saw
me do this this morning in the Civic um
it's just not as good well pounds just
not as good we need to be here we'll get
here now some of it may be just the
actuator quality that we're dealing with
but GM has a special night hazel Club
video API come on we can actually ship
that
no my feet aren't on the pedals right
there what 2 foot if GM flips a switch
in this car is this gonna eclipse a p2
dial not even close I don't think Jam
can ot8 us but it is the best system in
the market today
and it just shows it just shows we got a
ways to go thought about we got to do it
we're pushing on it it's gonna happen
you guys are gonna get something
credible by the end of the year 0.5
notice engagements yeah pass Eagles 1 is
fine to train with we don't care
fantasy equals wanted not engaging or
pretty much the same thing but GM with
two super cruise I don't know why they
don't market this stuff more they got
they should ship this on every one of
their cars so
bring up to speed on comedy I google us
they go bow feel better yes I do they do
have 4G LTE but I don't think they can
OTA modules
if only this thing had a usable nav
system I'm confused
reset
get on that road and cut over to the 280
where hopefully there's no traffic oh it
looks like there's actually no traffic
once we get past that point
you believe traffic I know I know it's
kind of brutal paying attention relax
this is too easy to trust as well
oh so Chris is not gonna the head unit
how are we gonna cut in let's say as
flawless
that was flawless good job damn
the centering and non wobble I know what
little red lights
this is commas first flex red card yeah
oh okay all right it could have been
better there it accelerated and late
break for the cutter but not too late
but not to the point that it felt unsafe
just cook down that's neither
it's follow distance is conservative
probably similar to open pilots
the steering feels dead center and it
feels like a wheels not moving like open
pile it just feels like it like sways we
got to get rid of it
you are bought you are glad bad man bad
do you work for the company what company
I worked for Qi I'm no work for coming I
do you like the mirror man will give a
key sight you just followed this with
home but no I don't think you just
follow distance with this either
I don't think you can it's good you
shouldn't be allowed to just follow
business if I press the gas let's say I
just touched it barely let's see if I
can actually press the gas
no it doesn't disengage on gas
it does not decision gas which I don't
agree with
yeah
I don't know maybe we should rethink
that I don't like the idea of letting
the gas be used but
maybe it's okay
I mean no like the problem is up oh wow
okay I mean it could have been Sakai
okay fine you see you guys saw that cut
in
like that's an algorithm issue your
argument for why shouldn't be as make
sense but yeah we just need to be better
am I just a test driver you have a test
driver I'm one of colonised test drivers
then it was George Hotz googleman yeah
yeah super cruisin
why allow the car to drive itself I
don't understand that question but first
engaging your foot should definitely be
allowed to be on the gas that's allowed
I don't know if that doesn't work
professional tennis cover what Avenue
landscape Vivian's out of the car I do
portrait guys on portrait Parrish Cobra
the rearview mirror is green
screen look at that screen throw but
like okay yeah I'm very happy with it
yeah we're doing awareness to her again
this year I'm very happy with Supergirl
I'm waiting for it to mess up I haven't
seen it mess up yet like I see know all
about it messes up all the time
hmm
how do the car know when to change lanes
in the car does not change lanes where
are we closing down the 101
in my Cadillac see you sector
what happens a seat belt unbuckles Trat
stays engaged noobs
yeah it's much stricter engagement but
no I've seen autopilot an old pilot mess
up like here so it always stays in the
middle lane seems whatever Lane you put
it and open the door alright guys I'm on
the highway
this car isn't ready why I'm pretty
happy with it now get into the passenger
seat alright no dumbass shit what do you
go doing a face recognition they're
recognizing my face
yeah the autopilot is better we got work
to do guys we got work to do
the company meeting when you get back
they're using intel our mobile ID chips
I think it's called life I think there's
a bubble on mobile I combined with they
have a they called the OnStar mapping
module we don't CNN's it's not the
problem like they do this with maps okay
so this is all being done with mapped
areas which is decent strategy the
mirror might be the most underrated
thing in the car the Maris
doesn't it's like open pilot point cloud
a better CNN you're working on that
stuff yeah and I RPG and CD absolutely
guess Oh bow it's about to get a lot
better and now we have a benchmark to
know exactly how much better we have to
make it
I'm not worried about shit the old Bob
sux their grave do you know where you're
gonna demo your own HD maps see
improvement coming - for sex
um cement so lose jobs supervise love
them super hard yeah be nice quad yeah
notifications
I'm wasting gas how am I wasting gas oh
okay all right little why we're steering
too much steering too much like it's
wobbling this wobbling it's still good
it's still good but not perfect that
wobble
I don't know though I feel like you're
just nipping it this place is way better
how it makes mistakes
I should be steering why
not letting the car to be tough morally
wrong to like cars drive themselves so
we very argument is
their own ways and Castro on the
computer should GM put sanitary watch
chip
supercruise disengaging why why no it
was so good
please reengage I miss my super Cruz
super is unavailable I don't understand
like it was really good and now it's
unavailable why oh okay
the cunning detector only seems to be
good when you have super cruise on bad
now super cruise is not available great
honestly like I wouldn't put it past um
to use a different cotton detector for
their ACC and their super cruise so that
ACC we had a late caught it and if I hit
the brakes I would hit that guy maybe I
would a EB but like and now I can't
engage so I can't engage it comes up a
little thing there
engage come on super cruise come on
super cruise
supercruise not available
crews braking on adaptive cruise set 250
see now I can't turn supercruise on it
now I don't know why open pilot will
always tell you why I wish when I press
the spot it didn't just say unavailable
but their driver transition system is
pretty good it flashes red vibrates you
see
no we should have supercruise level
quality on freeways there's no excuses
guys no excuses
your hand should be on the wheel you
moron I brought your band
turn off ignition to reset that's even
it
this is done a bellboy I don't know why
I'm sure that tells me why on can i Momo
Assam crews in their back on super guru
try looking straight ahead and for a sec
with the phone down call tech support
Louis Jia did I can ask again stick a
panda then we get home
one who's the same dude statistically
Safety's better if it can be enabled
everywhere question of all it's all
questionable who knows
it's ice DGM land yeah Sam you're in on
the joke
what spam I see the spammer
morally wrong hands to be off the old
cars and right
GM encourages hands-free
pull on starman disengages all right yes
alas hey my supercruise disengaged the
car wants me to do things uncomfortable
go back to my supercruise safe space
what trick is morally wrong I agree with
that blink your lights on the steering
wheel it's not German are not blinking
light they're the American made LED up
oh oh my god okay great thanks for not
okay it's cutting detection is on par
with open planets
twin turbo and now I can't engage all
right so it's longitudinals pretty weak
its laterals pretty good backer
supercruise
it's the PWM you know that car didn't
stop when the pilot is the lower
standard yeah guys we're not we're on
par with we're not the best yeah if you
get a CAG oh yeah probably
there's no audible cues no it doesn't
have audible cues but know what you guys
don't realize is it vibrates my seat
it's better than an audible cue it's
good it sounds pretty nice and happy
with the engine
- jab marriage energy merge energy would
be so nice if the car could do merges
for me that'd be so nice can I have
super cruise back no silver cruise Oh
super cruise on the bridge would be so
nice I haven't seen it do any hardcore
curves like I don't think I really can
okay well I don't get any supercruise
here do I know why no clue
it's very painful to have to drive after
supercruise
all right here's the plan guys by the
end of the year I want to release a
video showing a super cruise drive and
an open pilot drive and I want the old
pal job to be better that is where we
need to be
Thank You belt ACC's better
[Music]
boy super creepy we're tired the long
day it took like five hours to get this
car from the dealership
any visual cues yeah that's this style
like bar up top along with a vibration
seat for yellows or Reds
all right come on Cruz back supergirls
let's go
just like I hate that like please tell
me why it doesn't work right now the
little icons not there
yes we bought a Cadillac we did
holiday
we're back
okay so no mistakes but no engage this
is definitely the next model you need
open pilot on we're building open pop
super Chris disengaging bow
oh my phone battery's low thanks car up
now it like reengaged
this like sticky crap on my hands okay I
never mind it's terrible open pilot can
do this now it sees the lanes
crews not available great oh and there's
traffic no I need snow crews do you ever
change lanes down
all right scope ease I think we're gonna
leave you in a little bit let me see if
I can get back on super cruise so I can
wave goodbye come on sir crews let's go
let's go let's go
all right I'll settle for a CC thank you
for joining that was the common AI gets
a Cadillac with some Cruz periscope and
expect to see a lot more of it and Oh
Bob's gonna be better by the end of the
year
all right all right
i got you i know i got you
you got comma twos in stock and eons
they're still here
so i'll take this comma two off your
hands if
you give me a real deal yeah make me a
deal right now
cause uh i don't have much time go ahead
comma dealer
make my day okay it's commas
take my day sales event go ahead make
our day
trade in your eon for 200 off a new
comma too
during the make my day sales event make
my day
comma dealer you send your eon we send
you a brand new comma two for last your
day is made
commas make my day sales event and soon
let it make your day
go to www www.coma.ai
trade in to trade in your eon for 200
off a new comma too
Good morning everyone and welcome to
Comic-Con version 3. Um
please uh feel free to get seated. We're
going to get started with the
presentations here in a second. You
know, KAMA's been around for basically
10 years now. Every year we have better
products. We make better software. We're
growing. We sell more and we have more
Comic-Cons and there's more of you every
time. This is Comic-Con version 3 and I
think you guys are really going to enjoy
the stuff we're going to talk about and
some of the cool new things that we're
going to be able to show. Um, there's
also some cool booths around that you
guys can explore uh in the in the free
moments. Uh to get started, we're going
to start with a presentation from the
Open Pilot team about Open Pilot
development. And uh they're going to
come up right now. Shane and Maxim from
the Open Pilot team. We'll start with
their presentation on solving simplicity
for Open Pilot development. Enjoy.
All right.
So today I want to talk to you about two
core principles that we use to develop
open pilot. The first one is testing or
requirements and the second one is
simplicity and I will show you how those
two things actually go full circle at
some point which is very cool. So let's
start with the first one testing and
requirements. you need them and in order
Whoa. Wh Yeah, nice clicker. Um, so we
believe that your test should be as
quick as possible in order to iterate as
fast as possible without fearing
regression from the past. And in order
to do this, we did a project called the
one minute CI, which as the name states,
your whole CI must complete in one
minute, otherwise it fails. And this is
very important because we consider that
the time it takes to test your code
should be part of the test itself. Your
code should be fast and quick to test.
And we use GitHub actions for most of
our CI on open pilot. And I took the
screenshot from our GitHub page this
morning. And as you can see, everything
runs in one minute. And this is all the
tests that we run every time you push a
single commit to open pallet. And we do
a bunch of stuff. We build a release, we
build a dart, uh we test the simulator,
we run unit tests, we run static
analysis, we do a bunch of stuff. And if
you want do if you want to do stuff like
this, if you want fast CI, which I'm
sure you want, if you don't think you
want it, start making your CI faster and
you will learn that you don't want to go
back to a garbage CI. So if you want to
do this, I have a few tips for you. The
first one is you should probably delete
or at least re-evaluate most of your
tests because most of your tests were
probably written at a time where you
didn't even understood your software and
now if you reread them you probably
understand that most of them are
useless.
Uh the second thing you should do is you
should dream a little bit. As Harold
said, this is the comma 10th
anniversary. And about nine years ago,
there's a very famous commitment that
was made to open pilot. And if I can
click, nope, not this one. Yes, this
one. From nine years ago that says one
day we will have CI, one day we will
have testing. And these days we have
testing and we have very good testing.
But in the spirit of this commit about a
year ago I did I replied to an issue on
GitHub uh to if I can click thank you
that says one day open pilot will
install in 10 seconds you know and what
I mean by what open pallet will install
in 10 seconds I mean that you know
before you start testing your code you
have to install python or your packages
maybe val grind or something like that
and this is a recurring cost and you
want to shrink that recurring cost as
much as possible. So testing is very
fast and these days you can install open
pad in around 11 seconds, you know, so
off by one, but we're getting there. It
used to be in the minutes and this is
insane. Now it's very fast.
Um, another thing you should do is you
should chase every second because you
only have 60 seconds to test your code.
So every second matter and if you uh if
your CI takes 17 minutes to run, you
probably don't care about 10 seconds.
But I'm going to show you one very
specific example where we save 10
seconds with our unit test. We use piest
for to run our unit test because most of
our codebase is written in Python. And
this is how we run piest. We run piest
very simply. But just before that we
also run piest with d-colcts only. And
those two lines are 10 seconds faster to
run than only running piest because it
does a bunch of stuff because we use
multiprocessing to run our test. And
many people didn't believe me when I
pushed this commit. And they tried to
revert this line because they didn't
understood why it saves 10 seconds. And
every time they did this, they actually
had to revert with a realization like
this that it actually saves 10 seconds.
I don't know if you can see this, but
yeah, Shane made this commit about a
year ago. So very fun. Um, but having
quick and fast CI is not enough, right?
Because I could write something like
time. Sleep 5. It would run instantly,
but it will be garbage. It wouldn't
catch anything. So you actually want to
be able to, you know, trust your test.
And one way to do this is you should
never have flaky test. If a test fail,
it should always be because the code
it's testing is bad, not because the
test itself is bad. And in order to do
this, we did a very very simple thing
that you should actually do right now
after this talk in GitHub action and
even Jenkins that we use for our
hardware in the loop test. They have a
feature where if a test fails, you can
just press a button to replay it for
some reason. And you know, if you have a
flaky test, maybe you have a test with a
threshold, you know, and sometime it
goes a little bit over or down the
threshold and most people just play the
replay button and they go on with their
day and the flaky test stays in CI
forever and they never fix it. We
actually disable this feature and on top
is GitHub actions, the bottom is
Jenkins. It will yell at you, you know,
don't do this, fix the test, you know,
fix them instead. uh this is very
powerful and this way you can eliminate
you know flaky test and this is very
nice otherwise the flaky test will just
hid in your codebase.
The second thing uh to gain trust in
your test and this is the most important
part because this is not enough. This is
good when you have flaky test but if you
want to actually gain trust in your test
uh most people will use stuff like line
coverage or if you're fancy like branch
coverage but those metric are not enough
right because I could again write times
slip five and run your whole code inside
a try catch block never fail I would
probably get 100% line coverage but I
wouldn't catch anything because line
coverage only checks how many lines you
actually run with your test
but this idea of line coverage is very
nice because this is exactly what I
want. I want to make sure that all my
line are covered by my test, right? They
have they check if the the line won't
change. But more specifically, I want to
make sure that all the semantic the
logic of the line are covered. So what I
really want is something like semantic
line coverage, right? And this thing
exists and it's very nice and it's
called mutation testing. And I will
explain to you what mutation testing is.
Very simple. uh let's say that in five
years, you know, uh come up pivots to a
liquor store company or something. So,
we need a function called is adult. But
don't worry, we're still open source.
So, someone submits a PR or, you know,
someone submits a PR. And since you are
the developer, you add a feature, you
add a unit test, right? And this code is
correct. It checks if you're an adult,
if you're above 18. But this test is
garbage. It clearly doesn't understand
this line. It knows that something
around 18 happened. And so it checks
above and below, but it doesn't
understand this line. But we merge it.
We merge it. And five months later, I do
a refactor and I push this commit where
I change the this sign to this sign and
I merge this because I see a big old
green check mark. That's my test and I
trust it and it was very fast. So I
trust it. But now I just change the
meaning of this code. It doesn't mean
anymore if you're an adult above 18.
Like just 18 and that's it. you're an
adult at 18 and that's it.
Uh this whole thing, this whole
experience of testing your test is what
mutation testing does for you on every
commit. It will take all your lines,
right? All your line will try to mutate
them. So it will take the operators,
flip them, make them bitwise, take all
the numbers, make them big, small, non,
null, whatever. And then it will run all
your unit tests, right? Pi test, unit
test, whatever you have. And if your
test don't fail after those mutation
this whole thing will fail and it will
say hey I changed this line and your
test didn't pick up on this you know so
either this line is like that code
remove it or your test don't understand
this line and you could push stuff like
this so this is very nice because this
gives you trust in the things that
should give you trust in your code
because how do you gain trust in your
test you can do it with stuff like this
and we did this for uh the panda safety
that's now lives in open DBC And
mutation testing is not perfect because
when you think about it, what if the
mutation you did is like computationally
equivalent to the previous thing. Well,
if you have the answer to this, you just
won a million dollars and a, you know, a
touring award. Uh, but it works for our
purpose and it's very nice. Okay, so now
you have great tests because they are
quick and uh you can trust them. That's
nice. Let's talk about simplicity.
I'm going to take one example very
simple that we did very recently
actually and that you probably use every
day. It's the open pilot UI. We rewrote
the entire open pilot UI from scratch.
We went from an open UI written in QT
with C++ to a UI written in ray in
Python. Ray is a simple thin wrapper
around OpenGL.
And you know Shane will talk to you more
about Rayb in itself. I want to talk to
you more about, you know, the the
graphics tag that we used to use and our
new graphics tag that we use now.
So, oh well, it's crap, I guess, but it
says Open Pot UI and um as I said, Open
Pot UI was written in QT, right? And
since we are on Linux, we need a
windowing system. So, we use Whan. But
the problem with Wayan is that it's more
of a standard protocol. So we need an
implementation and we use Weston.
But again in the real world Weston
doesn't really know how to speak to QT.
So we use something called WL shell to
communicate. Remember that name. It will
come up later.
And we need a rendering client, right?
So we use OpenGL ES2 and OpenGL doesn't
really know how to speak to your system.
So we use something called EGL. And I
know the order is not, you know, exactly
right. This is just so it's nice and
flow down. Um but at some point we need
a buffer right to render frame into
buffers. So we use lib GBM to get
buffers and to actually drive the screen
we use something called the lib DRM.
Yeah. And since we are on a qualcom chip
we use the MSM back end and the MDP5.
You know this goes on. I could go all
day. I could do the full slide. I
wouldn't be done with the graphics
stack. Right. This stack is pretty
insane. And I call it the three letters
acronym stack because everywhere you
look there's more three letters library
that just pops up you know uh GBM
generic buffer management DRM there a
direct rendering management you know
MDP5 mobile display processor 5 you know
it goes on and by the way EGL it doesn't
mean anything if you go on the Kronos
website which are the guy that are
developing the standard they will tell
you EGL stands for tat but tata is not
EGL so who who knows what it means right
yeah so this used to be our stack And
when we first tried to move to Ray, I
went on their GitHub page because they
have a very nice GitHub and I look at
the requirement section, right? What do
we need to switch to Rayb? And they said
we support Linux. Great. And we even
support Whan and I was like, I have
Whan. Can I have Rail? No. No, you
can't. Okay. Because again, remember you
have Whan Western WL shell. And of
course it broke at the WL shell because
nobody knows about this weird 2000 that
thing that was deprecated in 2015 you
know that nobody knew. So it it was
broken but this whole experience gave us
the opportunity to actually learn about
graphics stack and move to in some
things simpler and I will show you our
new stack that we call the magic stack.
We tried to choose a very simple word
you know not an acronym it's very simple
just magic and it's much simpler and
this is our new stack. It basically
replaced QT with rel and wayand with
magic which is a special piece of code
that we wrote. And when I say this is
simpler, I'm not saying like the idea is
simpler. No, no, like way so Western is
more than 250,000 line of code, right?
Magic is 200 lines of C and 60 lines of
Python, which is a thousand times
smaller. And I'm sure most people would
say that sometime a thousand times
smaller is kind of a thousand times
simpler, right? So this is much simpler
stack
and I know some people will look at this
right and say stuff like well why did
you change it was working what's the
point you just chase simplicity for the
chase for the the sake of simplicity
right but the expression is like don't
kill your horse if it's still alive or
whatever it is uh but we change for
reason like this okay this is the model
execution time so the actual time it
takes for the model to run on your GPU
on your device and as you can see this
is our new stack and this is on green is
the old stack and the further on the
left the better. It means it run faster
because the UI and the driving model has
to fight for the resource of the GPU. So
you want uh the model to have all the
time so it doesn't conflict with OpenGL
you know shaders or whatever
and we did this and when I first plotted
this I was expecting the inverse I was
trying to see how bad of a job I did
with this rewrite but turns out if you
choose simplicity you get stuff like
this and I love this plot so much
because it's such a representation of
what comma is you know ray is written in
Python by one guy in Spain right
is like a 900 people company, you know,
you cannot get clone get QT. If you go
on the subre of QT, it's all people
bitching about like licensing fee, etc.
So, it's very complicated. And did you
know that Python is 500 times slower
than C++? You know, I didn't know that
either, but you know, turns out if you
choose simplicity, you win.
And this is the part of this talk where
it's super cool because it will go full
circle. With this new simplicity, we can
actually get new requirements, new test.
And I will finish on this. There's two
new requirements we want to do with this
new simplicity. The first one is we want
to move the UI off from the GPU. We want
to do software rendering. So the driving
model has all the time for you know do
its stuff drive for you guys. So this
plot will look even better. And to do
this like you you kind of want to use
like the an software rendering
implementation. So if you want to do the
the messa lvm pipe thingy to do that
well you need to change what you use and
with the old stack it's pretty hard
because who even knows where the opengl
context just created you know so now we
can do stuff like this and we will do
this very very soon for you the second
thing we want to do we want to add a
strict mode to the UI where if you start
the UI with streak equals one and the UI
drops a single frame the UI get killed
instantly and this is very nice because
it would lead to a perfect UI which
never lagged essentially and to do this
in the old stack again you know what
does it even mean to drop a frame where
does it drop a frame you know is it is
it in lib gbm is it in in ray lib is it
in western spoiler it's always in
western that's why I put a big bart
around western so all the western stuff
stays in there never open that box
please uh but yeah now we can do stuff
like this we can know when you drop a
frame because every time we render we
get the vblank ID of the screen itself
and if the you know the vblank the diff
is not one when you render you
technically drop a frame because you
missed the opportunity to render a
frame. The screen was ready, but you
were not. And now I will leave Shane to
go on stage and talk to you more about
simple stuff again.
How's it going guys? Uh that was a great
talk by Maxim um about like the
low-level graphic stack and how we um
simplified that and I'm going to expand
on that more on like the ray part like
how we turned um how we um yeah so let's
just start so solving simplicity again
uh it's my idea that if you uh if you
have simple code and this goes both ways
if you have simple code you can have a
nice simple life so
yeah nice Beautiful surfers here. You
can uh go surfing surfing after this.
Great. So, sorry to jump scare everybody
so early in the morning. I know if you
get this in your uh you know email uh
poll request closed by Dee, that can be
scary. But um yeah, before I started
working at Kama, I was just a college
student and whenever I wanted to work on
a project, a coding project, I I didn't
have um any like idea of
making things simple. I just hacked
together the first, you know, the first
solution that worked and I moved on and
maybe I came back months later and it
was like totally impossible to reason
about wrote this code like it's just way
too big. You can't keep it all in your
head at once and that's why you need to
uh try to keep things simple. So how how
do we recognize whenever we're adding
complexity where we don't need to and
that's recognition. You need to be
self-aware enough to realize in the
moment when you're doing this stuff. Uh,
one case is let's say you're you're
adding something to the UI and you want
to add an edge case you want to support
like maybe a user gets in there's a
weird you know we want to show like an
error message for this specific one case
and that adds 30 lines well 20 lines or
maybe you're adding a feature that you
don't really need. Maybe you're making
something abstract. You just want to add
one feature but you're like oh maybe in
the future we want to do this other
thing. So we we make it generic and
that's just extra complexity that you
don't need yet.
And
well, that that looks good. That that
looks good, right? We're removing a
thousand lines. However, this is a
tricky case because you're using a
library. And while that can be good
sometimes, I'm going to explore why that
might not be. So, we going we're going
back, I think, eight years or so, back
to 2016. Oh, whoops. Um, we had we were
basically running like um a souped-up
Android phone. It was like the Common
Eon at the time. And we had a few APKs
that we ran. One was it was just black.
It just drew a black frame for some
reason. I think that was to hide the
blue splash whenever we switch between
the different UIs. One was the frame. So
like when you're on road if it's green
or or not, like if you're engaged or
not. One was the off-road UI, so you
could like swipe uh you could like swipe
see your uh driving stats, whatnot, pair
device. And I didn't know this, but
apparently we had Spotify and ways um
which I if you have CarPlay, I don't
know why you need that. Maybe this is
before CarPlay, but I guess you could
just pair it to your Bluetooth. And then
on top of that, to draw the like the
lane lines of the model, we had a
different graphics stack called nanog,
which is written in C. It's actually
quite simple. Um, so that was probably
the best part of this stack, but you can
see this is a lot of like working parts
together, right? So, a few years ago, we
switched to a new stack, which is Whoa,
I think there's some lag up here
as QT.
And QT is a nice uh graphics library at
the time to switch off of or to switch
to because it supports widgets, you
know, if you want to like put some text
um or if you want to like, you know,
enter your password for your Wi-Fi. It
it's just all there. It's all coded for
you. Um it has nice multi- language
support.
And if we go back to the graph there, if
you saw there was just way too much to
to reason about. You need a graph.
Let's see if this works here. But
anyway, you need a graph to like see the
whole state of QT. You can see you have
like tree widget. I don't even know what
the hell half of this stuff is, but it's
there. And this is probably just like a
small subset of QT. So this is the
problem with using libraries. Sometimes
they they do remove code. they do, you
know, put the complexity out of your
project. However, the problem is that
you have to trust that this other
developer, you know, they didn't write
bugs writing all this complex code.
So,
if we can switch here, there it is. So,
complexity is a black
box.
And I'm I'm going to briefly explain
like a few cases we ran into while um
writing the new UI in QT. Um so
basically the driving model uh for
experimental mode it like draws a path
and there's like um it's green if it
wants to accelerate, red if it wants to
break, right? So we we have this nice
hue which is a float, but for some
reason I found that if you don't round
the float from another float to a
slightly different float, it would take
two times longer to draw to draw the
path. And I just never figured it out. I
just ended up rounding it which somehow
worked which is great but it's just
complexity. Uh and complexity is a black
box right and so complex black boxes
require care. Another issue I ran into
um there just one day the the Jenkins
test the hardware and the loop test just
started failing out of nowhere uh for
high UI timings. And if you can see over
there, it might be a little faint, but
just some frames will take up to 300
milliseconds to render where they should
normally be under like 10 or 20. And
while I was debugging this issue live,
the lights in the Open Pilot office
turned off [music] and the timings that
I was seeing just like spiked. So what
was actually happening was the model was
just um on the 3x was pointed against
the wall and it's basically either
seeing light or dark. So when the light
turned off, it was just outputting lane
line geometries that were just totally
not totally wrong, but it just the the
polygon renderer just couldn't convert
it into like a nice uh triangle strip
that the GPU could run and it was just
using this entirely different code path
that it just doesn't tell you that it's
doing in the moment. Um, so that took a
while to figure out. So how do we how do
we fix this? Well, as Maxim talked about
earlier, we switched off QT to Rayib,
which is just like a simple OpenGL
wrapper. Gives you a few functions like
you can just draw uh shapes and text.
The uh the entirety of QT, I think I
looked it up last night. It's like
several million lines of code and we
just have uh a widget function
ourselves, which is 200 lines of code.
So that's, you know, that's a huge
improvement. If you want to draw a nice
icon, it just takes four lines right
there.
Uh there's no dependencies, there's no
build time. So what used to take a
minute if you want to try if you want to
change a UI component is now instant.
It's infinitely faster. And yeah, just
who wants to fix other people's bugs,
right? That's cringe.
So
how did we fix the original problem
where the model was just outputting like
lane line geometry that the QT didn't
know how to handle? you can just simply
do less. So you can see QT has this huge
30,000line function just to triangulate
uh polygons and they might be like
inverted or convex or whatever and we
don't need to support any of that. We
just need a simple fourline for loop.
It's all you need and it's way super
it's way simpler. It's consistent.
[snorts]
So yeah, that's uh that's one of like
the practical applications of switching
to a smaller library where you can
control the complexity yourself and you
can remove the bugs yourself which is
very nice. So switching gears to uh the
car interfacing uh I think it's it's
really cool how we support over 300 cars
now and that's growing every single day,
right? And a lot of the car support
comes from contributors like you guys
which is also really cool. Um, but
you know there's like there could be
there could be a lot of complexity in
that, right? You have to support like
all the different Hyundai support
different harness like physical harness
types and
as well as the software the DVC is going
to be different per car. So how how do
we handle that? That seems like an
impossible problem. Well, to give you
guys some context, last year we had a
Damon ControlsD and it pretty much does,
you know, what you expect,
uh, it takes in CAN data from the car,
runs it through the car interface suite,
which is basically like where's the
steering angle and the gas and brakes,
run it through, run it, uh, runs it
through some controllers. So, like based
on the model, should it turn left or
right right now or accelerate? and then
it outputs it back to the car.
And
however, controls D also did a bunch of
other stuff like it ran the state
machine like if you're pressing the
brake, should it disengage right now? Or
if the model is uncertain or if you're
doing a lane change. So it's just doing
a lot of stuff. This is pretty complex.
Um to keep the whole file in your head
is just also impossible. So what we did
and is this seems pretty simple now, but
this is how it was for eight plus years
or so. We just took the car stuff out of
Open Pilot which where it was all
together. We moved it to a new project
called Open DVC where the car can uh the
DBC messages already existed. So it's
just all in one place which is really
nice. And Open DVC what I just discussed
is a self-contained package you can pip
install right now. You can run all the
tests. You can import all the cars. Um
this wasn't possible before with Open
Pilot. Um we're trying to make that nice
and pip installable but soon. So what
Open DBC does is it provides like a very
small API that Open Pilot can um take
and it can read data from the car. It
can send actuation messages to the car.
But again, what this allowed us to do is
look at this API and see, oh, what is
this message that we're reverse
engineering for every single car? All we
need to know is if the user is pressing
the gas, but we're also reverse
engineering how much they're pressing
the gas, which you don't really need in
terms of the uh the state management.
You just need to stop applying the
brakes. So remove that field and that's
just one less thing that people have to
reverse engineer now.
And then also the one minute CI as Maxim
talked about that was a requirement and
it was pretty easy. Um there was like
eight different tests for Open Pilot and
just adding these onto it. It's just um
just it's nice to have that separated.
So one of the the improvements that the
smaller API allowed us to make was add a
new tool called the longit longitudinal
uh maneuver report. And that's something
that's a toggle built into Open Pilot.
You can go into your settings, turn that
on. And basically before this, if you
wanted to test longitudinal tuning
improvements, you had to like,
especially late at night, you have to
find a lead car maybe at a stoplight.
You have to engage behind them, hope
that they don't leave or run the red
light so you can like get a nice um like
stopping profile and then you you feel
like, oh, did that feel good? Um did it
over like did it overshoot on the
brakes, whatever. But now we can
recreate real scenarios. Uh let's see.
Oh, laser pointer. So, gas break. Gas
brake. You can see the Camry is
overshooting on the brakes a little bit.
Uh undersshooting and then overshooting
on the gas. Corolla looks like it
overshoots a whole lot. The EV6 is
pretty good. So, this just allows to
quantify the actual performance of the
different cars that we support.
And what that allows do allows us to do
is we can make like very targeted
changes to the tuning. So if we want to
improve the gas response on Toyota, help
that not overshoot as much, we can make
that we can make those changes and rerun
that part of the report and see that uh
if it improves it, if it makes no change
or not. And it's really cool because you
can see some of these are user reports.
So, you want to run this tool again.
It's just in your settings and you can
upload the data to this website right
here and maybe somebody will tune your
car if you can't.
And one improvement from that. So, this
is this like the simplicity thing like
Maxim said, it all goes full circle. So,
you have this
you have this API that you make smaller
because you're you're reasoning about it
now. You're trying to make it simpler.
Then you build this tool to use that new
API and now you can actually merge
improvements based on that. So a
contributor in 2020 found this bit in
the uh reverse engineer DBC for Toyota
that improves the gas response. However,
it also disables braking and it makes it
overshoot sometimes. So we didn't merge
it until just this year. Yeah, I think
just this year. And that was because of
the report that we had. So on the
Corolla starting from a stop, it took up
to looks like more than 4 seconds to
move. And now after we we tested the
bit, we can actually see that it follows
the uh acceleration request much much
more uh much better.
So yeah, if anything um if you if you
found any of this interesting, you can
port your new car. You can help us make
the API simpler. You can also get paid
if you go to the bounties website, which
is really nice. So my final message is
if you too can simplify your code, maybe
one day you can merge your PR and a D
will approve it.
Thank you.
>> Hi, thank you so much uh Maxim and
Shane. Amazing talk from the open pilot
team. Um, next I'm very excited to
welcome Yen, our head of machine
learning. Um, he will be here
momentarily when he gets miked up. So,
I'll just give a few housekeeping uh
notes uh before we get started with our
next talk. Um, there is still coffee in
the back, so feel free to grab a coffee.
Um, and then we will have lunch served
at about 12:45. Um, which will be served
in the entrance where everyone came in.
Hello everyone. Hi.
Let me see. Let's check. Clicker.
Clicker is almost AGI level technology.
So, we should all right works. Reach
AGI. Hi. Um my name is Yasine uh from
the autonomy team at GMA and uh uh today
we're going to talk about machine
learning. I'm here to talk to you about
not any kind of machine learning a very
exciting style of machine learning that
we call end to end. We're all familiar
with it right now. Everybody's talking
about end to end. It's all the what the
craze about. All the cool kids are doing
end to end machine learning. So I'm here
to spill the tea and tell you all what
it is. What's what's end to end machine
learning? So if you're here, you
probably already know what Open Pilot
is. We ship Open Pilot open source L2
ADAS system that runs on the Comma 3X.
Uh it has tons of users, many of whom
are here, I think. Uh a lot of supported
cars, more than 300 supported cars. And
recently, Linus Tech Tips said that it
was amazing. So, I guess if you guys
trust Linus Tech Tips, um I think it's
amazing.
As a famous person said while uh looking
at a a car, they said that it was all
computers. Um what I like to say is
well, it's more than that. What we ship,
it's all machine learning. So, we uh
ship this device to you called the Comma
3X. It has cameras all around and it
runs on a car that has some sensors and
it has some actuators and then
everything gets blended into this crazy
uh linear algebra that we call machine
learning and then drives your car.
That's magical, right? It's amazing. I
think it's cool.
Well,
it's especially cool because we are
doing it end to end. Um, and I'm I'm
here to explain to you what end to end
means to us and why it's important.
Uh, so in general, what we want what we
call end to end is what the general uh
literature call general purpose methods.
So these methods what you want them to
scale with is compute and data. You
don't want to them to scale with lines
of code and you don't want them to scale
with numbers of engineers. So you don't
want to uh be in the situation where you
need to ship a new feature or you need
to improve your system and the only
solution is well I need to write more
code or oh wait I need to hire a labeler
or I need to hire an engineer. That's
not what you want to be in. You want to
be in a state where well I need to make
this model better. I need to improve
performance.
The best way to do it is well, I need to
make this model bigger or I need to
train it for longer. I need to train on
more data. So that's what we call
general purpose methods. And uh this uh
little guy over there's names Rich
Sutton. And that's a photo of our data
center uh built
uh by our friends uh Tiny. And they have
a booth right over there if you guys
want to visit it. uh with some uh some
some cool uh exposition hardware. Uh so
that's our data center and we want to
scale with data, want to scale with
compute, not with people and lines of
code.
As I said, all the good cool kids are
doing end to end, right? Even people
that were not doing end to end a few
years ago now are talking about it as if
it was, you know, the uh the only way to
do it and as if they always did it. Uh
which is fine. It's it's good to uh for
people to get uh you know, convinced and
change their opinions, but it's great.
So um yeah, the cool kids are doing end
to end. Tesla is doing end to end.
Even Whimo is doing end to end.
Robotics companies are doing end to end
as well. Um you know everybody's doing
end to end.
But you see this
oh sorry
these kind of job postings a data
labeler job posting. Oh
well that's odd. It's not really end to
end, is it? Uh or even outside of the
robotics, even outside of the
self-driving uh you know space, you see
these kind of jobs like evaluator
experts, prompts, specialists,
optimizer.
Uh there's a lot of hand coding still,
but these models are end to end, right?
Well, how you train them is very
important. They can be end to end, but
the way you train these models might not
be end to end. You might still need
effort. You might still need people. You
might still need intermediary steps to
train these models which kind of defeats
the the idea of end to end.
But you can sometimes you see things
like this which are great. Sometimes you
see these in the news. AI achieves
silver medal in the Olympics. That's
great. And these are the things these
are the methods that uh I'd like to call
end to end because these not really rely
on human data, human labelers or prompts
specialists or prompt engineers or
evaluators. These models were trained
using reinforcement learning. These
models were trained uh using experience,
not using data labeled by people.
Why is this importance?
A few years ago, we were doing
prediction. 2016, 2018 was all about
imageet. It's all about predicting class
labels, predicting lane lines,
predicting this and that. Well, now now
it's now it's the grown-up stuff. Now
you need to take action. Now you need to
act on your predictions. And this is
what makes it hard. It's not just about
saying things about the world. It's
about interacting with the world, make
take making actions and then observing
what happens and being robust to that.
Welcome to the era of experience.
This is where we're at and this is what
we are doing right now as a company. We
are building agents, driving agents that
uh act in the world that act in a car
and we want them to learn how to drive
from experience too because that's how
people learn and that's how uh you reach
superhuman capabilities.
Again, the case for end to end is is
karma. This is a photo of last Comic-Con
two years ago. As you can see, not not a
lot of people in this photo. This was
this is the entire company and you get
to meet us all today. Uh this uh I think
is the entire company at KMA today. Yes.
Uh so yeah not a lot of people
end to end and general methods and the
bitter lesson in general is the reason
why a company like KMA exists is the
reason why we get to exist in a world
where other people are throwing money uh
from the window at labelers and things
like that while we are trying to solve
it in a principled way in a way that
scales with compute and data and
experience.
So thanks to the bitter lesson.
So enough general and philosophical
talk. Uh I'm going to uh dive into some
concrete concrete problems and concrete
examples of how these general methods
and these end to end methods uh were
used and are used by comma uh to solve
some concrete problems. So I want to
start with driver monitoring. Uh DM
as we as we like to call it is how uh we
make sure that uh the driver in the car
is alert and not sleeping not using
their phone while the combat 3X is
driving while the ADA system is driving
because it's an L2 system. So we need
the driver the user to be alert and
ready to take over at all time.
I'm sorry to bring this up this early
bad memories but I want to start with
this and get this over with so that we
we get the bad memories out of the out
of the pictures out of the picture. Uh
do you all remember 2020?
No. [snorts] Tough year, right? Uh well
we had this thing called uh surgical
masks and u u face masks and suddenly
people started wearing masks all the
time even in their cars. We have Uber
drivers and things like that. So uh but
that wasn't that common right uh people
weren't wearing masks in the past in
their cars so face masks. So it's it was
out of the distribution of our the train
data of the DM models, the DM driving,
the DM uh machine learning models. Uh so
we had to fix that fast.
Uh everybody was locked down. We
couldn't, you know, bring labelers or
take photos of people and do do this,
you know, how people do it usually. Uh
so we had to uh to be a little a little
creative.
This is wishing is over there. Uh so you
know an easy way to do it is is to
create synthetic data uh procedurally
not using you know not not using an
artist not calling someone to to to
paste a mask on a on a face or not using
Photoshop. We're not uh hiring uh models
to to wear a mask and then take pictures
of them. No, we use our existing data
and we use some general methods, some
easy to implement general methods to
estimate the pose. This again was done
using a machine learning model that
that's trained. Uh we're not using a
labeler to to give us the face pose. Uh
same thing with the landmark detection.
we kind of delineate where the face is
and then using these two information and
these two information these these two
sources of information plus a mask that
you can download from Google images
and then you just add the two images and
here you go you have a new data a new
data set of someone wearing a mask and
driving that's great
so uh again this example I like to bring
this one up because you could solve it
in a completely different way. If if you
didn't want to use a general method, you
would solve it probably by hiring an
artist, a Photoshop artist, or by hiring
some models or by trying to wait for
people to start wearing mask and then
collect more data. But we had to act
fast. So, so we went we went the general
way and that worked out great. Another
example I'd like to uh to uh to bring
up. This looks a little creepy here, but
uh we we we used to call this the eye
shutter. Uh the eyes shutter is well the
models didn't didn't really detect when
people were closing their eyes that
well. So, and we didn't have a lot of
data of of eyes that were shut because
when you shut your eye, it's pretty fast
and then the data doesn't doesn't really
have that class balance we used to call.
Um, so again, you get the ey landmarks
uh using a neuronet network. There's
plenty of them online that you can
download or you can train your own. Uh,
and then using some simple morphological
operations, you can just close the eye
and there you go. you have a photo of a
of an eye that's closed from a photo of
an eye that's that's open. And again,
this is really a a simple method general
and that scales with data and it's uh
you just inflate your data set very
easily without trying to call artists
without without Photoshop artists. For
example, more recently, there's these
things called VMs or uh vision language
models that you can you can give them a
prompt and an image and then they can
interact with you, right? So, um with
some very little prompt engineering, you
can put a photo of someone driving and
using their phone and then say and then
ask the VM uh say yes if if the person
is distracted from driving because
they're using their phone. and the VLM
knows Adib is using Ho.
Um, so yes, this is a more recent uh way
to deal with this and we're
experimenting with how to use larger and
and and uh more subsequent models uh
that are trained on tons and tons of
data to uh automatically label uh some
of our training training set
um which is what I like to call vibe
labeling.
That's a live photo of wishing over
there.
Uh so something more interesting about
DM is that uh we also know the future.
And that's the case also with our
driving data is that you know the
future. You know if someone is going to
take take over or not in the future you
know if they're going to override
the steering we call it override or you
take over. So if the person uh took over
in the future, that means they were
ready to take control, right? Because
they they did take control of the
future. Uh or let's say if they're just
sitting around uh in traffic, usually
you're not really aware of what's
happening around you when you're in
traffic. There's like you can look at
your phone, you can look down, you can
be distracted. So the probability of you
being distracted or not ready to take
control when you're when you're sitting
stand still is generally higher. And
then the rest uh we don't we say we mask
it out. So it's obviously not just these
two cases that exist. There's tons and
tons of other cases. But you we can
label a small amount of our data using
these huristic data that comes from the
future or that comes from other sensors
around the car. and then the other stuff
we just don't care about it. Uh so even
with a really really small percentage of
of what this covers we can we can find
some interesting examples like the one
that I'm going to send you here. Uh I
don't know if you can see but this is a
a photo of me driving and am I ready to
take control? That's that's a
interesting question. Uh I mean I'm
looking at the road looks looks looks
looks normal
and yes I'm ready to take control
because in the future I did take
control. So that's
I did override. So that's a that's a
good example
in here. Am I ready to take control or
not? Obviously not. I'm looking down on
my at my phone. Um I don't look that
interested in what's happening around
me. Well, yes, because I'm a g I'm at a
gas station waiting for someone to come
come back to the car. So, in this case,
yes, I'm not ready to take take control.
Uh and uh and the reason why is because
I'm in stand still. So, uh we we call
these endto-end labels and they cover a
really really small percentage of our
data, but it's uh it's enough to to get
some really good signals and to get some
interesting samples as well from our
data set.
And uh yeah all this all this shipped by
wishing and maintained by wishing uh
which is over here. Uh so um
the idea is that you can ship and and
and and
create really good systems and uh uh
really reliable machine learning models
uh using a very very small team. If you
do, if you go the route of general
methods and if you don't get trapped
into this uh you know trap of of of of
needing more features or improving the
system using labelers and using uh stuff
that doesn't really scale. So yes should
be maintain by wishing.
Next example is uh what we call lateral
control simulation.
Uh I forgot to ask who's here um is a
open pilot user by hands. Oh, nice.
Uh who's heard about tuning?
Oh, okay. Cool. Yeah. So, what's what's
the deal with lateral control with
lateral control in general?
This is from uh a really nice forum uh
from our friends at Sunny Pilot which
are here and have a booth. So you guys
are welcome to go visit them. Uh this
model has been fantastic on my Hyundai
Kia Genesis angle steering car.
Finally drove this model and light long
both perform really good. Smooth turns
but but some hugging but nothing too
crazy.
I can't use this model because it hugs
left too much.
To me, this model is okay, but it kind
of turns too much and too quickly. I
don't like it
with my Toyota lateral is not good.
I actually thought this was a step up.
Yeah. So the thing is we support a lot
of cars. We support more than 300 car
models and every car and every model has
its own quirk and feature and uh uh
these quirks and features materialize in
similar lateral control. Um so um
the idea is that we control the car most
of our some some of our cars using
torque. So you you put in torque on the
steering wheel and then uh you observe a
lateral acceleration and the difficulty
is the predictability of this function.
How does this translate to that? And
that depends on so many things. That
depends on your car, your model, your
how your how how much your tires are
inflated, uh how the road is rolled, and
is it is the road wet? Is it not wet? Uh
is your steering rack old? How old is
it? So, it's really complex and it's a
really difficult thing to to to model
and that's why you hear about things
like tuning, hugging, turn cutting, uh
things like, "Oh, this performed well on
my car." And then someone else says,
"Well, this didn't perform well on my
car." Well, it's because of this, partly
because of this. Um, so how do we solve
this? Um, we could do this for every
car. We could have a Python file for
every car and then kind of try to like
hardcode this using using some Python
code using some C++ code maybe.
Or we could just write this as a as a
big big big big problem big machine
learning problem. So you have your input
observations and then your input states.
And then we're going to talk about we're
going to come back to a style of slides
that are like this a lot in this
presentation. So you have inputs that
are observations in time and states in
time and actions in time in the past you
know in in in your context and then what
you want to output is the next state.
What given these observations and given
what you observed and given some actions
you took what are you going to observe
next? And we all know the only way to
solve machine learning problems is using
the transformer architecture,
right? That's how we do it. It's how all
how the cool kids do it. What's a
transformer? Uh I'm going to talk not
going to talk about it that much today,
but it's a stack of layers that that
we just repeat a number of times and
then you get to repeat them a lot. And
the more the more you repeat them, the
more the bigger these layers become, the
more parameters or weights or weights
you end up with and the bigger the model
you end up with. And that's how you you
hear like, oh, this model's three
billion parameter, this model five
billion parameters. Well, these
essentially how many of these layers do
you have? And the transformer
uh not this one the the machine learning
architecture is trained to predict a set
of numbers shifted by one. So the
transformer takes a set of context
number and then you shift them by one
and essentially tries to predict the
future which is really cool because
that's what we want to do, right? We
have a set of observations, a set of
states and you want to predict the next
state. It's great.
and it magically works.
The red line follows the green line or
the scan line. That's great. So yeah, we
train these big models using our data
sets. Um and they do predict whatever
we're interested in and that that that
is that is wonderful.
Now how do we use this? Uh, in the
autonomy team, we have this rule called
no testing in cars. It's inefficient.
You have to go down downstairs. You have
to start the car. Sometimes the car is
off. Sometimes you need to pull the
branch. Oh, wait. I didn't didn't have
the right key. Someone took the key. Oh,
uh, someone took the car. The car is in
the car wash. So, yeah, it's
inefficient. You don't want to do that.
So what this enables us to do is well
you can start with the segment that
let's say with the driving data that's
on a Toyota and then simulate as if it
was coming from a Hyundai or similar as
if it was coming from another car. Uh
and then you can see how the model
behaves using different cars using
different what we call noise models that
come from different platforms. Uh which
is really cool. So you can see like this
is a this is one segment that's
replayed. I think it was originally from
a Kia AV6 and then we changed the noise
model so that it will match uh a bolt or
it will match a Corolla which is really
cool. So you can just like swap the car
without going downstairs.
And this is shipped and maintained by
Casper and David. And they're over
there. They have a booth where you can
actually drive uh with a noise model
from which car? Oh, you can pick the
car. Yeah. So, you can actually drive
the drive using a joystick and observe
what the the model is living every day
is observing every day. Uh and it's a
really fun booth over there uh with the
the steering wheel and the TV. So you
can you can get to experience what the
model experiences uh in real life.
All right. Now to uh driving models. Uh
so this is this is the model that drives
the car. This is the model that outputs
a desired curvature and desired
acceleration
uh given given the the camera views. And
uh recently we wrote a paper uh called
learning to drive from a world model. Um
and it really um cements ce really shows
how we want to solve or how we are
currently solving the problem of of uh
training driving agents end to end uh
from experience.
This is uh from a screenshot from from
our blog post where we describe in large
details how we how we do this and I
encourage you to go check it out. It's
it's in our blog and you can also read
the paper you can look at the slides
even the talk is published uh and we
have a really nice interactive blog post
where you can click and play and kind of
interact with with the word model that
that we that we train.
What's a word model? Uh word model is
something that uh something of a of a
buzz word right now. Everybody's talking
about it like people are talking about
end to end. People are talking about
word models. Again, a word model is
something that is is a model that takes
in previous states, previous
observations and previous actions and
predicts what is the next state. what's
going to happen to the world that you're
observing given what happened in the
past and given an action. Uh, and it's
really important because some really
smart people are saying that it's
important.
That's it.
No, it's it's important because uh it
really allows us to interact with the
world and uh generate the these
experiences and give the opportunity to
opportunity to the model to interact
with the with the world without actually
interacting with the real world because
that would be expensive. You don't want
to put a a model that's not trained, put
it in a car and then go to oh you know
just go go and try things and come back
with with some data and then do do some
gradient descent on that data and then
send the model back. You don't want
that. You want you want some kind of
simulator. You want some kind of world
model that enables you to do this in the
data center instead of the real world.
Um
so our world model is uh essentially two
models. Uh one of them is a model that
takes in the observations and uh
compresses them in what we call
a laten space or laten laten vector. And
uh this compression here is important
because we use that compressed feature
set uh as a as a set of observations.
And then the word model which is a
diffusion model uh is trained to predict
the next state trained to predict the
next latent vectors. And there's some
details about how these models are
trained trained using the latest tricks
and the latest uh cool stuff in machine
learning which I'm not going to go into
uh much details today. So if you're
interested just go in the paper and then
you can read how all these models are
trained uh in in large detail.
again inputs outputs action. So input is
the states uh it's the the camera
essentially the camera for the camera
feed fcam and the ecam uh the action is
uh what we call the pose or the position
update which is a a vector of you know
translation and rotation a six degrees
of freedom input and then the output of
this model is uh also what is the next
frame so what's the what's the world
going to look like given in the past the
action uh action that I took what's the
word going to look like after that so
things move around you you move around
so it it should predict uh it should
predict that accurately but also we want
this world model to tell us something
about about driving not just the world
because this is uh this is a very
special type of model this is what we
call action world model uh we are asking
asking the word model to also tell us
how to drive in this world how to drive
in this future world that I'm going to
to to to imaginate what is the best path
what is the best curvature what is the
best acceleration to take given what you
did in the past and given what you what
the future is going to look like so this
is a special type of model uh it's
future anchored uh to kind
give it some more recovery pressure. Uh,
and again, all the details of why we do
this and how we do this are in the
paper. So, I encourage you to go check
that out. So, we use these word models
as a simulator. Again, same I've said
this before, you get past frames and you
get an action in the past. I get a an
action uh and then the driving simulator
the the world model predicts what is the
next frame and also what is the next
action. You can use this next action as
you want. You can use it as ground truth
to train a different models which is
what we do or you can just use it feed
it back into itself and do it
autogressively to uh kind of like do a
roll out uh a roll out of of a
simulation.
Um, and
these models are great. They scale with
data. As you can see, LPIPS is uh is a
metric of how good the image looks like.
So the the lower the LPIPS, the better.
So yes, more more more more
layers, a better model or a bigger data
set, better model, which is what we
want. Great. Rich Sutton's happy.
Also, this model is very this is a very
important thing to us. And when when you
train a model that wants to drive the
drive a car, you want it to be
physically accurate. You want it to if
you ask it to move 0.5 mters to the
right, you need it to actually move 0.5
meters to the right, not 25. Uh you
don't want to wing this, right? This is
driving. This is serious stuff. So, when
you're doing a a video game and you move
it, you you ask the the player to move a
little bit to the right, you don't
really care how much you move to the
right, right? But in driving, you really
need to be physically accurate. So, we
have this benchmark test that uh starts
in the lane center and then ask ask the
model to move to the right and then you
know exactly how much you can you how
much the model moved using a different
model. So you can you can check whether
the model is physically accurate and
with a lot of care with a lot of care
about how you train and and use these
models you can make them physically
accurate.
Also
they generalize out of distribution
which is pretty cool. Look at this crazy
swerve.
Wow. I hope no one did this in our data
set.
I think no one did this. You all are
very responsible.
So yeah, as you can see, uh we really
ask it to go very very far off the road
on on the shoulder and it it responds to
that pretty accurately. So uh we say
that it generalizes our our
distribution.
And if this plays, yes, this is a very
long video. So I'm not going to make you
watch eight minute of rollouts, what we
call rollouts, but this is essentially
uh uh how the world model how the the
simulated videos look like. Um yeah, as
you can see, uh all these videos are
simulated. They're not real. The top one
is uh the frame that comes from the
narrow view camera. We call it the FC
cam. And the bottom frame is one that's
generated. It's it's also simulated and
it comes from the uh wide angle camera.
So you can also see how u consistent the
views are and how the movement looks
looks consistent between these two these
two frames. They're generated by the
same model. It's one model that
generates both frames in one shot. So
you can see how consistent they are. And
there's a little installation over there
in the TV where you can see this uh loop
around with some fun captions that we we
all wrote before every video. So uh uh
I'm not going to make you watch all this
now. If you if you if you want to see
some examples, they're in the TV back
there near near the coffee stand.
Um
yeah,
and we use this model. They use this
world model that generates simulated
worlds and simulated environments to
train on policy and to gener generate
experiences. And we describe this in our
in our paper. Uh and essentially that's
how I that's what I said uh earlier. We
start with pass frames with an action.
the driving simulator, the word model uh
gives us a next frame and the next
action. We use the next frame to feed it
back in and we use this action that the
word model tells us, hey, this is what I
recommend you to do. We use this to as
ground truth for a different model that
we call the policy. And that is our
ground truth. We use it to uh train
train the policy. And then we do this
over and over again. The policy uh gets
better and better at driving. Uh and
that's how we ship the models right now
in open pilot.
No secrets.
This is a very just a little fancier way
to describe what I just said
and uh shipped and maintained by Harold
Armon and myself and generally other
people from the autonomy team. So
uh yeah that was the driving model.
Now this translates uh really easily to
other types of of robotics problems. So
driving is a robotic problem. It's a
very simple robotics problem where you
know you just actuate using two numbers
curvature or torque and acceleration.
Uh but things can get a little messy uh
for general autonomy.
Do you all know Billy? Who don't who
knows Billy here? Oh, cool. A few a few
fans. Billy Bill is our friend. Uh a
comma body. Um the comma body is uh
looks like this. It's a it's a comma 3x
on a stick on a hoverboard. Uh and it's
it's a it's a robot.
So we use the same approach that I just
described for driving. We used it uh for
general indoor navigation types of
problems. So the goal is uh well you
need to make Billy roam around the
office. Avoid objects and if uh it hits
an object or if it gets stuck it needs
to recover autonomously
uh and avoid collusions obviously. So
we open sourced a data set of indoor
navigation using using the comma body
using Billy uh in uh in our office. So
it's uh it's a few gigabytes of of uh
driving around of of roaming around the
office. It's open source
and the the problem here simple. You
have uh inputs observations of of of
camera inputs and then you can also look
at the wheel speeds. That's also nice to
have. And the actions are what the WD
the wasd inputs for the gamers the
gamers right here. Uh and then the
output is again what's the next frame
going to look like? What's the world
going to look like given this past
observations and action and also what's
the next action that that you should
take.
So, as you can see,
this kind of works.
It recovers.
This is our kitchen.
This is the open pilot lounge. So, you
can see it kind of moves around,
bumps into people,
tries to recover. Here you go. It backs
up. So, this is all end to end. This is
the model that that that is trained to
predict the future and to predict uh the
next action and recovers.
So this is a short way to show you how
these kind of approaches that don't
really hardcode things. I don't know if
if I said this, but I probably said this
in a previous presentation is that there
in no way in no place in our code you
you will find traffic lights or cone.
Only in our tests. Some some of our
tests kind of like
tries to find segments with or data with
cones and see interesting ways to to
evaluate the model. But in our training
code, we don't really hardcode anything
about driving. Everything is learned by
this model. So all the behavior, all the
driving is done implicitly. We don't
hardcode anything. We don't hardcode
lane lines. We don't hardcode any of
that. So if we just put that to just
swap the data set, swap it with a data
set of of indoor navigation and a robot,
it just magically works. So again,
general methods uh work and generalize
to to different kinds of problems, which
is great.
Uh and also we open source this model.
Yeah, this model is open source. So if
you have a a comma body, you could just
try it out at home and see if it avoids
your your coffee machine or see if it
avoids your your fancy
uh couch.
Now can you do this for input for
manipulation? So this is an SO ARM 100.
It's an open source kind of uh 3D
printed arm. uh and uh yeah same thing
we we tried to do this we open source a
data set of uh of uh something that I
like to call the coffee test which is
just grabbing a coffee pod a curic a
curic pod and then put it in this little
tray and you can train a model I didn't
do this but you can train a model uh
using this data set and to u do this
autonomously using the arm
Okay. Uh, and this was shipped and
maintained by Armo, which is also here,
Casper and myself.
And, uh, while I'm here, I would like to
advertise something that we haven't uh,
published yet, but we will do very, very
soon. And I know you guys like
compression a lot. I I don't know why
people love compression. So, we're doing
a new compression challenge. We've done
one in the past that we call the comma
VQ challenge. Uh this is called the
Comma 2K19 compression challenge and
it's essentially uh a new style of of
compression problem. Um so stay tuned
for that. It's going to be a very fun
challenge for for everyone who likes to
likes to do some some coding likes to do
some challenges. So the idea is to
compress videos
uh make make the video size small uh but
uh with with a very different goal of
not making the image look good but
actually preserving semantic content and
temporal dynamics. That's it. You can
make the image look as bad as you want,
but as long as when you put that image
into a segment or into a poset, it
predicts the right stuff. So you could
do whatever you want to that image as as
long as the segmentation model and the
pose model is fooled by your
compression, you're good to go. And the
cool thing with this challenge is that
we open source the segnet that we use.
So it's going to be open sourced. And we
also open source the postnet. So, uh,
it's going to come very soon. Uh, stay
tuned. So, yeah, we're open sourcing all
this, uh, for for the challenge and you
get to play a little bit with with, uh,
with the compression and plot things
like rate distortion curves and do
sciency stuff if you want. Uh, so yeah,
stay tuned for the Comma 2K compression
challenge.
And also stick around for more talks
about autonomy and research and machine
learning. Uh Harold's going to talk
later about how we bootstrap very useful
robots today. Uh and Mitchell is going
to talk about building a million mile
data set.
Any questions?
>> Thank you, Yasine. All right. Amazing.
We're gonna take some questions from the
audience. Do I have any questions?
Hands raised.
>> Um, how do you evaluate your world
model? I mean, you must be getting
better every day. Like, how do you
evaluate what you're getting better on?
>> Yes. So, we have we have tests for the
world model. Uh, we we described that a
lot in the paper, but in general, what
you care about is image quality. how how
well the image looks like as it's output
for the word model, how good the video
is, not just the image because we do
this auto reagively. So you want the
word model to generate good videos, not
just good images. Uh so that's the f the
the two first things and then you also
want the vid the word model to be
physically accurate. So we have this
other part of you control the word model
using some fake actions and then you see
how well the word model responds to
those fake actions. So we have these
these dual kind of word model
evaluation.
>> All right, more questions.
>> Hi. So I assume that your world model is
stereo uh and temporally consistent
because I think it has to be to be
useful. But uh you guys use two
mismatched sensors and lenses. So I
guess my question would be how much of
that is uh I guess generalizable if you
wanted to change the sensor or lens in a
future uh comet device. How much of your
your model could be reused and how much
of it would you just have to uh remake
from scratch?
>> Yes, that's a very good question. So
yeah, some some of the I mean most of
the models will need to be retrained if
you add a new sensor. Uh but we also do
uh some kind of pre-training of the word
model that is independent on the number
of sensors for example things like that.
So or or like the the temporal context
or how big the temporal context is. So
there are things that we can change in
our architecture today that don't
require retraining everything. But yeah,
adding a new sensor, adding a new
observation vector to the state will
need yeah retraining which is fine.
>> Another question.
Hey, uh did you have a version of
experiment where you're not where the
world model is just predicting the
actions and not necessarily the visual
cues and does it really help to have
both the visual cues and the actions
predicted together?
Uh the short answer is yes, it does
help. Yeah. Uh so we you can train a
model that doesn't even input the the
the the im the images, right? and it
only outputs [snorts] uh only outputs
the the future actions. But yes, uh
outputting the the the images and the
actions makes the model more more
accurate and it it generally makes it
more intelligent basically. Yes,
>> we can take a few more questions. Any
more questions for you?
So is the next frame prediction also
happening during inference on device or
is that just to train a world model for
okay for pre-training I guess.
>> Yes. So the the next frame prediction is
not done on device. It's not in the back
end uh and we we use it just to to train
the policy model which is a much smaller
model. Uh and you can see this as a
little model small model that plays in
this inside the dreams of this bigger
model the word model. uh and gets
distilled, learns a little bit from the
big model and then that's the that's the
the policy model is what we shipped.
>> Very cool.
>> And that one does not predict the next
frame. Yeah, only predicts the next
action.
>> Thank you.
>> Any more questions?
>> Uh when you were using visual language
model to determine if person has a phone
or not, how accurate was it? For
example, a person had a hat or didn't
have anything.
>> Uh yes. So we we used it in a very
specific case where it was very easy to
label because it was just asking about a
phone whether a phone was in the frame
or not. It was pretty accurate uh from
from what I recall uh because you can
see the phone in the frame. It's pretty
easy to to see. Uh some people do have
some uh very uh creative ways to hide
their phones. Uh but uh as long as you
can see it, the the VM usually sees it
pretty easily. But yeah, you have to be
careful with with the prompt with the
question that you ask. Like the the
question that we ask in this case was
very simple was about was there a phone
usage or not? But if you ask it for
example, is the person looking at the
road? Well,
I don't know. Is it the road that
they're looking at or is it the dash or
is it the steering wheel? You don't
really know. So the the the vis the VMs
doesn't know these kind of things. But
for phone usage or I think sleeping
detection as well, the these visual
language models would do very well.
>> Thank you.
>> We'll take one more question.
>> Thank you. uh um you mentioned you have
this world model that is predicting the
action but then you're kind of doing
some like pseudo distillation with this
on policy smaller model so I assume the
bigger model would benefit from data of
all cars but then you can distill uh
according to each separate car that um
you want to deploy on so the smaller
model would only see data from that
specific car model
>> uh is that the case
>> we could do that we don't do that u
>> then what's the benefit of like
retraining an nonp policy model is it
just for inference speed reasons?
>> Well, the f the first reason is that the
word model is not causal
by not causal means that it needs the
future. That's what I wrote in my slide
called the future anchoring. So the word
model cannot be shipped on device for
this first reason. This very fundamental
reason is that you you don't know the
future when you drive. So you need to
distill it into a causal model which is
which doesn't know the future and can
act. Uh so that's the first reason. The
second reason is yeah it's too big. So
even if we had a causal model we would
not be able to ship it on a device. So
we still need to distill it in a smaller
model. Uh and why we don't do this for
every car? Well it doesn't really make
sense. You you want a policy model to
know how to drive in general. This is
not a car specific problem. This is a a
driving understanding of the scene
problem. So the car the the policy
should be really independent and should
be robust to these different types of of
cars and makes and models and then the
controls is what deals with uh the
differences. So yeah
there was there was one last question
>> one more question. Yeah.
>> Would having more real world data uh as
opposed to synthetic data improve model
qual quality? Is there a way to assess
that? Did you do that?
>> Yeah. So we the the word model benefits
from real world data. Yes. The more real
world data that you train it with, the
better the word model is and then use
that word model to generate synthetic
data for the policy. Yes. So real world
data is still very very useful because
we use it to train these world models
that are very very big and very data
hungry. So yeah, definitely.
>> Thank you so much, Cine.
>> Thanks.
[applause]
>> We'll be able to take more questions
after all the talks. We'll have a Q&A
with all of the team. So you'll have the
whole autonomy team on the stage. So if
you have burning questions, you can keep
those for later.
This is Adiv, our chief product officer.
Uh, welcome to the stage and you're good
to go.
Okay, that wasn't supposed to start like
that. Clearly, this company's got work
to do on live streams and presentations.
Uh, now that the cat's out of the bag,
though, we'll uh we'll get through it
quickly. I want to talk to you guys
about the product. Uh, I want this be a
little more interactive. Um, I know you
guys want lunch.
Julie, do we know how to go back?
All right, we figured it out. All right,
good morning everybody. Thanks for
coming here. We know most of you aren't
native to San Diego. Um, so we really
appreciate you guys coming out. Um, as
you can see, Comic- Con has a slightly
different vibe this year. We had two
previous Comic-Cons. Um, and this one's
a bit different.
Comm's 10 years old like Carol was
saying. Um,
and I hope you get the vibe from both
the event and everything you see here
today. Um, things are about to start
looking a little different. Things are
starting to work. Um, and I just walked
in today and I just got that feeling.
Um, I saw the renders of this space and
I came in and it just felt right. Um, so
I want to give a big shout out to our
ops team, Julian Carly, who put together
this event. Um, if you guys give him a
round of applause.
And another shout out for uh Nick, our
new arts and crafts guy. You'll see a
lot of his work today. Um, this event
was one of them. Um, you'll see we saw
it. Um,
all right. So, obviously a funny title.
My talk will start with uh a short
little clip from four months ago. Um,
we'll watch that together. We'll discuss
it and we'll get into it.
Supposed to auto play.
Do you guys have like a any way to
control this?
Right here.
All right. Uh
George, if you want to reenact this clip
real quick. Uh I know it's putting you
on the spot here.
Oh shit. End the sale. End the sale.
Thanks, George.
We got creative workarounds for our
technical difficulties. Um, so four
months ago, we had a nice sale. Um,
$7.99. Um, many of you who were here
with us for our first Comic- Con and the
previous Comic- Con know that's an
incredible deal. Um, this is the same
Com, 3 we launched in 2021, four years
ago at the first Comic- Con. Just
refined. Um, refined many, many times.
Um, this the first time we got a seven
in front of the product number um, since
before I I was at Comma. And the site
did really well. Um, we started a bit
before Fourth of July and then the Lion
Tech video came out, 10x the views. Um,
there's good news and bad news with
this. The good news,
Linus liked it. Um, they found the
product on their own. We didn't ship it
to them. They briefly reached out, I
think once about like doing a review and
we're like, you can buy it if you want.
And that was about it. We found out they
were doing the review from the WAN show
like everybody else. We're like, cool.
We did not expect it to drop during our
big sale. We had already sold hundreds
and hundreds of devices. Um, I think
close to a thousand at that point. We
were running out of stock. Um, the bad
news, we weren't ready. We were running
out of stock. Um, we got 10x the sales.
We're just not ready for it. Um, we'll
talk about why.
So, I'm sure everybody here knows the
phrase works on my machine. Everybody's
done something that works on their
machine. Um, this is a bit what Chain
was talking about before he joined,
comma. Um, you know, everybody's good at
making something work on my machine.
That's the easy part. And everything
starts this way. Um, this is common in
2016. There's one Acura ILX. There's
many demos on you on YouTube. You can
see Bloomberg drive with it. I think
George drove with it um on the highways.
Worked like pretty well. And then
there's the ideal, like what works? What
are we working towards? Um, once you've
built something that's valuable and you
have to productionize it, what's the
ideal?
Something like a rock. Um, it's a little
dark here, but this is a rock. It's a
It's a nice looking rock. And uh rocks
just work. Um sometimes my team asks me
when they're working on a project, I'm
like, "All right, does it work yet?"
They're like, "Well, what do you mean,
does it work?" Okay, if we like sent it
to Lionus or we sent it to somebody or
if I just go and try it and you're not
sitting here, does it work? Um the rock
always works. And that's kind of what
we're working towards. Um with
everything, comma, like robustness is
the whole problem. It's all the value.
So many of you know Consumer Reports is
uh one of our big claims to fames as far
as um third parties reviewing Open
Pilot. Um they reviewed Open Pilot in
2020 on the Comet 2 and I believe they
reviewed it with a Corolla and they gave
it their highest score. Um Super Cruiser
was number two. Super Cruise is a good
system at the time. It still is a pretty
decent system. Um though as far as I
know it hasn't changed much. Um gave
Autopilot number three. Um we would say
Open Pilot was the best system at the
time.
and we still refer to this one today.
Um, what many don't know is there was a
2022 version of Consumer Reports. Um,
and I think many many people in the
company don't know this. Um, maybe
weren't around then or they just weren't
in the loop.
Do you know why nobody saw the 2022
version of Consumer Reports?
Does anybody have any guesses?
They bought the device. They got a car.
They bought a car for the device. Um,
they plugged it in.
It had CANFD and they need a red panda
and they plugged it in wrong. Um, you
guys remember the iPhone 4 and that
you're not holding it wrong. Um,
they tried, they put a genuine effort
into they bought a car, they put it in
their lab, they bought the device, they
figured out they needed a red panda,
they bought all these extra wires, they
plugged it in, and there's a bug in the
red panda. If you plug it in wrong, then
we fix the bug. But in early red pandas,
there was a bug. Um,
that's it. That's your red panda. Um,
when they reached out, we didn't know
they were doing this. They reached out
after they broke the red panda. And, uh,
you know, remember we said with Lionus,
we didn't we didn't interact with them.
They figured it all out on their own.
Um, when they reached out, we rushed
them a new Red Panda. We had just merged
support for their car, so it's totally
new. We found their fingerprints in the
logs. We added it to Open Pilot. Um, we
reuned their lateral control in their
car. Um, this is in the early days of
Torque D. U for those of you familiar
with that. Um, the stuff you seen was
mentioning with lateral control
simulation. That's a very advanced
version of it. Um,
and then we also added alpha
longitudinal support for their car. And
then I remember the next email we got.
It says, "Do we want to run the Devel or
Devel staging branch?" I was like,
"Okay." And you know,
uh, so Alex was the one communicating
with him. she was their CEO and she
didn't know the answer to this question.
Um I would suspect like maybe three
people in the company knew the answer to
this question. Like why
works on my machine that's uh that's why
you didn't see the 2022 version of
Consumer Reports.
Um so I love shipping things. Uh I
learned this a just want to share some
cool lessons with you guys about
shipping things. Um I'm a real junkie
for that green check. Uh,
anytime I can get that green check,
click merge, and I see it on master. Uh,
I just love it. Um, shipping devices,
shipping commits. Well, there's just
like deleting a few lines, fixing a
typo. It's just like you ship something
and it's in master and it's there
forever. It's version control. It's open
source. Like you pushed it forward.
This is one of the coolest lessons I've
learned here. Quality is basically free.
Um,
a few months ago we were, you know,
we're we're talking to our display
manufacturer and I'm like, you know, be
really cool. I'm really annoyed my
iPhone the olophobic coating kind of
wears. You can really see it on your
comma in the sunlight. Can we just pay
like
five more dollars for like a really
awesome olophobic coating? Um, for those
of you who don't know, the olophobic
coating is what prevents the smudges on
your comma. Um, and these coatings wear
on all products. Um, anything with a
touchcreen, it lasts for a little bit
and it wears. I was like, can we just
pay more dollars? Does it scale like
that? Turns out it doesn't. Um, here's
an example of this. This is a brand new
OBDC cable. Um, it's a very nice
drawing. You can see nice comma logo. We
put OBDC. It's a custom mold. Um, and
this is an OBDC cable. So, OBDC is based
on USB 3.1 Gen 2, which means you need
most of the wires basically. And if
you've ever used a USB 3, like a
Thunderbolt cable, you know, it's not
very flexible, right? But you ever use
like your phone charger, very flexible
because it has four wires. It's USB 2.
We managed to make this USB 2 levels of
flexibility just to tune up the install
a bit. It's cheaper than the old OBDC
cable. Um, all we have to do is like
look at it and we're like, "Oh, okay. We
don't need these wires. We don't need
the shielding on this. That's just a
USB." Um, OBDC does not need this. We
changed the mold. Uh, we changed the
whole overmold on the wire portion. It's
a lot more flexible now. It's just a
nice wire. Um,
and it costs less money. The old cable
was $4 and it's just like a standard
offtheshelf OBDC um, USBC. This is an
OBDC. It cost 306. Um, [clears throat]
and it's just so much better. It's the
right thing for a comma. Um, I just
think this is one of the coolest
lessons. Quality is basically for you
just got to like care a little bit. You
got to look at it.
There's another one of the cool lessons.
Um, so I started when we we're shipping
the Comet 2. I had a 27% failure, right?
Um, and when we ship the Comic 3, we
want to do a lot better than this. You
know, it's just it's not a good time for
anybody. Um, nobody likes this. Nobody
likes dealing with the warranty. Um,
and one of my ways for dealing with this
was, okay, I'll get every device back
from support and it'll pile up on my
desk and it's like kind of annoying. You
know, you have like some physical
constraint, right? I come into work and
then there's all these devices on my
desk and to get it work done, I got to
like look through them and like look at
them, right? The cool thing about
failures and reliability is as long as
you don't regress things and you're very
careful, it's like finite. It's not like
some super complicated bug or anything.
It's just a finite list. um which is
really cool and it works out to be like
12-ish things. Um and they're not
equally distributed of course. Um but
it's like a finite list. You like look
at them, you fix the problem,
and then it's like good. You just don't
regress it. So I'm going to show you
guys the highest leverage thing we've
ever done um to address our failure
rate. It might surprise you. It's one
line of code. Um
assert. This is literal code from
fulfillment. assert device pass all
tests serial number. That's it.
So, it turned out we had this really
fancy provisioning software. Um, you
guys know about our stress test. We have
something cool coming up too about this.
Uh, we had really fancy provisioning
software. Catch all sorts of crazy
stuff. Um, we really stress these chips.
We run them at max power. Um, we check
that the GPS signal integrity is all
good. Um, we make sure every device
passes this insanely high bar. And then
what would happen is we later found out
that 40% of devices that failed in the
field um on the comma twos we just knew
they failed. We knew they failed here
and we just put them in the wrong bin.
Um which is you know you're not going to
be 100% at that. Um so assert device
pass all tests serial number. This is
the highest leverage thing we've ever
done. Um now you have 11 things. You go
down the list and then you think it's
reliable.
Uh, this is a fun one, too. I remember a
few years ago, you know, like marble
floors were a thing and like, you know,
you see these companies raise billions
of dollars. Um, and George used to say
this thing like, "Where are our marble
floors? Are we doing something wrong?"
This is a figure robot. Um, they're a
relatively new company. They make
humanoids. They look incredible. They
look really nice. They look probably
nicer than like a Tesla Optimus. And
they have this insane polishing head for
them.
Like this is more insane than anything
in the coma factory.
And this thing hasn't shipped. And this
product, they've already moved on. It's
a figure three. And how much do you
think they spent on this machine?
This is our stress test rack. Um
we shipped 18,000 comma 3x. That's $20
million in revenue. The figure has
shipped zero things to people.
Um yeah when I was in intern 2019
uh I remember I was like okay when I
when I finished my internship I was
working on something called a testing
clause very similar to this it's like
the open pilot CI version of this
and I was like okay I want to make a
nice rack and I was like I don't know I
didn't know what nice meant I just knew
it wasn't wood it didn't look like this
it didn't have like electrical tape
wrapped around it um this has been
stable since 2019. This is this is it.
Um
really um
almost every probably all the common
devices you've bought were mounted here,
here, here. Um this rack this rack fits
120 devices. Um so this is the top of
it. But uh no, it turns out I shouldn't
have been spending the time making this
metal. Um or making I had this idea the
devices would like float and it look
sick. Um no, I should have wrote assert
device passes all tests. Um that was the
thing to do there.
All right. So, we're
eight years into Comma, we released a
not a devkit. Every product until the
Comma 3X. Uh, we'd call it the Comma 2
dev kit, the Comma 3 dev kit, the Yon
Gold dev kit. The Coma 3X was not a dev
kit. Um, many of you have driven with
one. Fortunately, you can't see the
outline. Um, but looks like that.
So, two years later, um, after we
launched the Comma 3X, it's done $20
million in revenue, we sold 18,000 of
them. Um, it works out to exactly 3x, 3.
Yeah, I know. That's how it works, I
guess. Um, it's kind of fun like that.
40% sold are daily activives. Um, that's
incredibly competitive with all sorts of
consumer electronics. You know, people
use their phones more than that, but uh,
you probably use your laptop a bit less
than this. most of the consumer
electronics I buy. I bought a vision
pro, got a rabbit, I got all those
things. Um, I'm a lot of daily active.
Um,
and it was good enough for clickbait
thumbnails. Like the YouTube videos
started popping up again.
Um, the common 3 had none of this like
organic content. We didn't send uh
advice to Snazzy Labs either. He reached
out um and we just told him the vibe. It
was like I just buy it. If you don't
like it, return it and tell people that.
Um, tell people whatever you want. Um,
we're not going to tell you what to tell
people. we offer it for $9.99 and that's
the narrative
and he liked it. He like these both of
these YouTubers really got it. Um I
invited him to comm uh we did a car
hacking hackathon and that's when we got
the Rivian supported. Um they they
really got the vibe. Um
it it goes to show you don't need to
control the narrative. Um you're not
holding it wrong. It's just the product
was just kind of ready for them even
though we might not be quite ready.
All right. So, what's after not a dev
kit?
Does anybody have any answers? Like,
what do you want in a comma? What's
after not a dev kit? Are we happy with
the dev kits? The not advocates.
>> I know Eric, you've uh I know you always
got some feedback on this stuff.
>> Well, you know, one thing I know
everyone wants quality, but in
particular, I'm curious about a 2year
warranty.
>> We'll get to that. We'll get to that.
Okay.
There's a Yeah, there's a few things. Is
there anything else? Anybody uh if
you're a user, can you just raise your
hand? I'm curious how many people use
the product. Have ever used it. Okay,
cool. About half.
>> Go ahead.
>> I want easier installation so I can give
it to an uncle or another friend.
>> Cool.
Um is like IKEA good enough? Um there's
some fundamental parts of the install.
>> Just improvement.
>> Just improvement. Okay. Yeah, that's
that's one of the things that uh you
know, we're not gonna make the product
worse and we're going to try to make it
better. Um, anybody else? Go ahead.
>> Okay, cool. Not overheat. Anything else?
>> Price.
>> Price. Okay.
Those are four great ones.
>> Okay, cool. So, we got two-year
warranty. We got We don't want it to
overheat. Um, we want a simpler install
and uh we want it to just kind of fit on
any windshield. It's just meant for it.
Uh, cool.
And the price. And the price. We can't
forget about the price. Uh, we learned
our lesson with the comma 3. We really
learned our lesson with the comma 3. All
right.
So, windshield
the call floor.
[applause]
Maybe let's take a step back.
So, it's designed to live on your
windshield right here. We we talked
about windshield. Uh it fits right there
and it's got a little bit it's got a
little bit for you to look at, but
everything else just hide it. hide it on
your windshield. Um,
it's it's more open pilot sized. Um,
let's let's watch it drive for a second.
Or we learned videos don't work. Never
mind.
All right. So, we had a nondev kit. So,
we built a real product. That's the next
step.
And a real product needs a new
interface.
So, your comma 4 has a brand new UI. We
still communicate uh driver monitoring
is still watching you. It's the same
open pilot that you know um we've got a
torque bar. Now we really want to be
able to communicate Open Pilot's driving
policy to you better. Um
we got the confidence ball. So when Open
Pilot knows that you're likely to
disengage, this ball will go up and
down.
So you know what Open Pilot's thinking.
Um you know can I is Open Pilot low
confidence? Um, you can really notice
this right now in experimental mode. Um,
it's a lot of fun watching it and you're
like, "Okay, cool. That's what that's
exactly my experience with experimental
mode." It's good that the model thinks
this, too. Um, the torque bar is super
cool, too. You can see subtle control
bugs. Um, it surfaces all these subtle
things about the driving policy that you
have these suspicions about, but you're
just not quite sure. Um, and it's just
communicating to these to you all the
time.
All right, we talked about setup. Plug
it in and drive in five minutes.
No more 8deree mount.
Instant mount cure. That was 48 hours we
took away. Um 1 minute CI. They came to
the setup experience too.
Common power is optional. Um we ship
that to your 3x2. Um it's always good to
emphasize though. People love that one.
Um common power is very optional
and we now cache the most common
software um on the device. So Wi-Fi is
optional. You can get the device
Like you buy from com Aaishop,
it gets delivered to your house in two
days. They all get rush shipping. You
unbox it. You just you're excited. You
tear open the box. I know a lot of you
guys already have 3X's. You're going to
have to remove the mount. Um you're But
let's talk about your uncle, right?
You're going to buy him a device. You're
going to grab the box, go drive it over
his house, tear open the box, stick the
mount on, take down the rearview mirror
trim, connect it up, slide it back on,
and you're going to click use Open
Pilot. and you guys are going to drive.
All right,
we got Commare.
It's three easy steps. You sign up for a
Comma Prime trial. Um, you got to get it
right when you buy the device like
Apple. You keep your prime subscription
active and you enjoy your extended
2-year warranty.
Comma 4 comes in two sizes.
Sizes are important. You got to give
flavors.
Oh, this doesn't go well with the uh the
black. Uh we'll have some on display for
you guys. You can go check them out over
there. Um we're going to have some
really cool comma four displays. Um
but this is the 10 watt variant. This is
the 100 watt variant. Um not ready yet.
Q12026.
Um,
but you plug your comma compute into
your comma 4 and it's got the same
auxiliary USB port um that your Comma 3X
has and you can upgrade it to basically
FSD levels of compute. Um, and the cool
thing about this is it scales a lot
better than mobile SOC's. Um, you want
to keep getting the latest Snapdragon,
well,
you know, you're not going to get uh
nearly the performance you want. Um, if
you want to take like an existence
proof, right? Um FSD is a system that
ships today, right? Um it uses a certain
amount of power, it's got a certain
amount of flops. Um
this will be able to match that. Um so
we've got an existing proof we can match
that u in terms of compute.
You can expect it sometime next year.
As for the 10 watt variant, we like to
call this the Snapdragon 845 Max. Um
it's got max out cooling.
>> You guys know you still got to buy the
10 watt one, right? You buy that one.
the next year.
>> Optional add-on. We got to emphasize
this. The 10 watt is the real chill one.
>> Don't wait till next year to buy.
>> It's the same one. We're not We're not
swapping out the 10 watt version to the
10 watt plus 100 watt compatible
version. It's always 10 watt plus 100
watt. Um so the chip, the 10 watt
version ships with uh sorry, it's all
the same version, but the 10 watt chip
is a Snapdragon 845 Max. Um, the reason
we call it the max is we max out the
cooling.
Yes, it's the same chip, but it sustains
10 watts. Um, and we can run bigger
driving models with that.
It's also whisper quiet. Um, so we
talked about never overheating. Uh, it's
all fixed. It's all fixed. Um, and we
have big headroom to run bigger driving
models. This thing does not make any
noise. Um,
this is one of the things we put the
most time in into the commor. Um, the
comma four, it's easier on the census.
Um, I like to refer to just being opt
in. Um, it's there. You can pay
attention to it. You can listen to it if
you want. It's got some nice sounds.
It's hard to hear the fan. If you really
want to, you put your ear up to it, you
can hear it. It's really hard though.
Um, if you want to look at a big screen,
uh, maybe [snorts] you can add it with
the oxport, but the screen is just kind
of there if you want to look at it. if
you want to peek um what is open pilot
trying to tell me right now otherwise
feel free
it's not asking for your attention
and this is a comparison with the comma
3x and the comma 4 um so if we look at
the fan power um we get about 3C per
watt better on the cooling um and this
is very close to the max you can do on a
Snapdragon 845 um we can sustain max
performance that we'll will ever be able
to ship to an 845 very comfortably on
the comma
So that's where it gets its max name
from.
All right. So specs,
it's got an open pilot size form factor.
Um, that's number one.
It's got a beautiful 536 x 240 OLED,
still a touchcreen, still color, and the
very standard 536 x 240. Um, we've put a
lot of work into the each one of those
536 x 240 pixels. Put a lot of work into
each one of those. Um,
it's got the Snapdragon 845 Max.
It's got 360 degree vision. Same as the
3X. Bit different image sensors. Um, but
you'll see an advantage of the Densors
in a second. Um, very similar to what we
showed in the past, though.
It's got the same 120 gig UFS, but this
results in 10 hours more of footage. Um,
we do a downscale on the ISP now. Um,
from these image sensors. Um, same
driving performance, same like capacity
for driving. Um, the footage is half the
size now. Um, this makes our training
stack it's open pilot sized, makes the
training stack faster. It's just it's
the correct size, you know. Um, I was I
was in the factory the other day and I
was watching the our stress test boot up
and it boots up way faster than the
common 4 and okay, why is this?
Well, everything is just a little
smaller. There's actually like the
firmware is a little smaller for all the
auxiliary things. The modem firmware is
like 10x smaller. Um it it's all just
smaller and the correct size for open
pilot. It feels you feel it. It boots up
faster. Um it's open pilot sized.
It's got an EM2. Uh
so no more sense slot. Um we got to kind
of avoid that mechanical design problem
and I think it is a much better
experience.
All right. It's designed for scale. So
when you say we're not ready for Lance
Tech tips, that means a lot of things.
Um that means Open Pilot's not ready.
The software is not ready. Um from many
perspectives. Only recently did we solve
fingerprinting. Um a couple of things in
the video that I saw that I was like
really watching out for in the video. Um
is it going to fingerprint?
Did they get a good car? Did they have
to understand any of the subtleties of
the branch names and like do I need
alpha longitudinal? Do I need to SSH in?
Should I run a fork? Um,
and then like if if the review is good,
which it was. It was it was a very fair
review. I think it was a uh very honest
review. Um, if this leads to
conversions, are we ready to sell
devices? At the time, we were not. The
COM 4 is designed for scale. So, before
we ever did any CAD, before we laid out
the board, before we did any of that, we
designed out the production steps. um
each rev, you know, the comma 2 we uh
this is so simple to build. It's like
you don't really need to do this. We
just kept building them and outputting
them. Um and then we just shipped the
best ones we had. The comma 3 we just
threw at everything we thought was
really cool and then like all right cool
we got to build them now. Turns out
that's not how it works at all. Um and
this drives a lot of cost. The comma 3x
we kind of did a mix of both. We were
like let's do a little design now let's
do a little bit of uh design for
manufacturability. Now let's do trade it
off a bit. Um the comma 4 we designed
the factory first. We're like okay cool.
How are we going to use We need to use
auto feeding screwdrivers. Um we need to
be able to build 100,000 of these a year
with the same team, same office, same
setup. Um we haven't really grown the
production team size um since the comma
2 and we built 3x more comma 3xes than
comma 3s. Um so we're going for a bit
more than a 4x uh here.
It's got 2x less parts. Um
and the parts that do remain, we have
multiple suppliers for each of them. Um,
you know, you never want to get to the
situation where you're like,
this is a fun story from the comma 3.
Uh, the screens were like a real they
they would trickle in. We were living
week to week on the screens for the 3.
Beautiful screens, beautiful Samsung
OLEDs, awesome glass, but they trickle
in like 40 a week. Um, and you know,
that's not scale, right? We ended up
having to send a PI to our screen uh our
screen center and we're like, "Are the
screens there?" We're like, "Can you
just take some pictures and see if the
screens are there?" Um,
so we're we're well beyond this now.
Multiple suppliers for every part. Um,
it's got a real supply chain.
It's 4x faster to assemble. Um, that's
just right now. Um, got a lot of
refactors planned. Uh, but we got to we
got to ship the ones now. Um, you always
got to you got to ship your refactors.
You can you do the dumb thing, then you
do it again, then you do it again. You
just do the most obvious thing. And this
is the loop. Um, it doesn't end.
It's got a real fulfillment line. Uh I
think many people will be surprised to
know that uh the bottleneck during sales
is fulfillment. Um you know our awesome
fulfillment team. It's uh you can meet
them over there. Um Ada and Marvina are
awesome fulfillment team.
They can do like 200 a day peak and then
this is just they get there and they're
like all right we can't do it. I'm like
it's all good. We do an awesome job
fulfillment. We get the two days out
right away. Um but it's a bottleneck.
The box is hard to fold. They got all
these little inserts in them. you got a
lot of little pieces. We used to have a
little towel that we'd fold like this
and somebody would sit there all day and
like fold a little microfiber cloth. Um
I like is that a real value ad for
people? Do people want to pay for this
in their bomb in the in the device
price? Um obviously we can improve that.
Um but you got to get there. You got to
get there. Um so if you want to find
Nick and talk about the box design and
stuff, we really took all this stuff. Uh
we had a lot of fun with it. Um so it's
got a real fulfillment line and we
refactored the whole factory. Um we did
a whole bunch of construction over the
last few months. Um, our fulfillment
room was, you know, it a little cramped.
It's just, it was basically storage and
then like a little area to walk in and
like you get a few boxes, you put the
parts in, then you can do a couple more.
Um, so we got a nice big fulfillment
line. Um, we have a nice big assembly
area for the comma for us. Um, it
actually looks a little sparse because
they're just so tiny and they're so easy
to build. Uh, so we got to put some
plants in there or something. We got to
we got to fill up that space. Um, and
then for our SMT line, we got a brand
new, uh, second SMT line that'll run one
side. Uh, we'll see the board in a
second. Um, there's one very dense side
of the board that looks like a phone
motherboard. Um, and then the other side
will run camera bars. Um, and the top
side of the the board. Um, so it's very
beautifully balanced. Um, and to crank
out 100K year, perfect redundancy
between the lines. Um,
it's got Open File 010. We put a lot of
effort into reliability.
How often do you hear fingerprinting on
Discord anymore? We got the
fingerprinting wizard right here. How
often does it come up these days?
>> If you got a Mazda, maybe. Um, we got a
dashboard and it just goes it converges
to zero. Um,
takes a while to fix these things. Um,
like it was only like a year ago that we
got rid of like the RTC and this caused
like all these like weird bugs. The
device isn't a clock. You got to like uh
you go back to Maxim's talking like you
go back and you revisit the
requirements. Um it's the email that
like make the requirements less dumb.
Why is the device a clock? Why do we
rely on absolute time? And this drives
decisions down from the like the
microcontroller that does this
functional safety on the device all the
way to uh the front end app and connect.
Um we deleted so many lines of code and
just a whole class of bugs. Um there's a
lot of cool things about cloud 010. Um
you'd be surprised to know we spend
basically very little time on validation
of individual commits. Um we do spend a
whole lot of time on building the CI
systems um that we talked about today.
Um but we we spent very little time like
all right this open pilot release has to
go out. All right somebody's got to get
a device somebody's got to like put it
in all the cars. Somebody's got to do
this. That's not really how it works. We
spend very little time on indiv
individual changes and we spend a lot of
time on the infrastructure. Um you know
you ever heard the quote the product is
a factory. Um,
open pile 010 is ready for scale. Um,
you you you can't tell people, you know,
go make a pull request for your
fingerprint.
So, this is the motherboard.
So, we got our beautiful Snapdragon 845
Max right here. You can see this thermal
underfill.
So, you get some uh
this is where you get some of your
cooling improvements. Um, we got three
tricks for the cooling that really
improve it. each contribute uh basically
equally. Um so this thermal underfill is
one of them. It should also massively
improve the reliability. You ever see
like the remaining camera malfunctions
and stuff? Um it's due to this package
on package um on the 845. And we've got
like the most awesome SMT lines start.
We got vaporphase ovens. Um this is
nicer than most SMT lines. Um it's
basically the max you can do. We got
like electroform nickel stencils. We
just bought a super nice stencil
printer. We got 3D AOI. Um, this is kind
of the next step in this. Um, so you get
about a third of your thermal
improvement over the Comma 3X from this
thermal underfill. And then, uh, you get
some reliability out of it. You got your
PMIX,
got your Panda, same red panda. Um, it's
all very familiar from like the Open
Pilot side.
You got a microphone and an LED. OBDC
port aux for your comma compute. You can
ignore the SIM slot. Uh, the SIM slot is
if if you want it. Um I I don't know how
many people know this uh about I'm sure
many of you know the humane AI pin. Uh
they were not able to reuse like they
couldn't refurbish their returns or do
anything with them. There was basically
like dead weight once they returned.
They had a pretty high return rate and
this is because T-Mobile wouldn't let
them reactivate the SIMs. I like there's
no actual reason for this. But this is
just how the carriers work in the US. Um
also fun story. We would not have eim in
the US if it wasn't for Apple. just
telling the carriers like, "Hey, by the
way, this generation only has EIM." Um,
the carriers do not want ESIM.
Otherwise, they're going to send you a
text message and be like, "All right, if
you switch to T-Mobile today, we'll have
your bill. Just click this button right
here." They don't want that. Um, so we
have Apple to thank for EIM. Thank you,
Apple. Um, so it's in there if you want
it. Uh, we got the fan connector
and we got this beautiful edge here and
the whole heat sink goes right over here
to beautifully shield this whole area.
And what that gives you is really
awesome GPS.
So tiny form factor, tinier antenna,
same GPS performance.
The other thing you'll notice is this is
all chip level. Um there's no SOM. The
SOM will take up about this much area.
So obviously SOM is out. You want to
make a small device, S is out. It's a
chip level design. Um
like it looks like a phone, right? It is
all the fun parts, too. It's like an
A45. Um,
the backside pretty sparse. Um, so this
is one of our other tricks for the
cooling. Uh, you see these big holes? We
just shove copper post through there.
And
yeah, so you see these big holes. We
have a big copper plate that goes on the
back here and we're able to conduct the
heat through the back to the heat sink.
Um, so this gives you another third of
your your uh cooling improvement over
the 3X. Um, there's a Quel. It's a
little smaller than the one on the
common 3X. If you want to ship the one
on the common 3x, it's this big. Doesn't
work.
Then you got board to board connector.
One connector to the other PCB
to the beautiful camera bar and your GPS
antenna.
All right, we got one more product to
get through and then we'll take
questions. I want to talk about this
thing. I want to see what questions you
guys have. Um, Body V2, it's a
prototype. Um, we got some for you guys
to drive. Uh right over there. Um so we
got five of them for you guys to drive.
Doesn't balance anymore.
That was a bit silly. We realized that
we reverted that on body v1, but from
the start, no balancing. Compatible with
comma 4 and comma compute. It's a whole
family. Um this is kind of the endgame.
We're not there yet. So it doesn't
balance,
but works with the whole ecosystem.
you're thinking for a test right at the
booth
and chips Q1 2026
and the other thing I want to emphasize
uh your comfor still your comfor
everything is still open source um we're
not locking anything down in fact uh we
got a sunny pilot booth right here shout
out to the sunny pilot team they're
really like the debian of the open pilot
ecosystem
still got kab body Um, you guys might
have seen Sim City on Twitter. Um, he's
doing really cool stuff uh with his
commas. Um, I'm sure he'll enjoy his
comma 4. It's more size for his RC car.
It's It's just the right size. Um, yeah,
your device is still your device. We're
not none of this is changing. Um, the
ceiling is still here. The ceiling we're
not moving down. We're not locking down
your device. Um, or the floor. I mean,
we just Everybody wants this stuff,
right? We were going around. Everybody
wants it whisper quiet. Nobody wants to
overheat. We want room for bigger
driving models. Um, and easy install.
So, it's $9.99 all in. No harness. Um,
so those of you concerned about the
price, don't worry about the harness
anymore. Why are we asking you about a
harness? Just tell us what car you have.
We'll send you everything. Um, and ships
in what? 12 weeks. You can go to com.ai
right now. You should be able to pick
one up and we'll try to get these out as
fast as we can for you guys. Um, the
factory will ramp up pretty quickly.
>> [applause]
>> We got a couple more things, Julie. We
got a couple more things. So, I Roba,
who's uh one of the main engineers who
who designed the Commore, uh we went to
Shenzhen a couple weeks ago, and I just
want to show you guys some vacation
pictures from our little field trip.
All right, so this is the mold for the
Commore. We visited the mold shop.
Um you guys will never guess who this
guy is. You guys will never guess it.
This guy hand finishes every mold. So,
you like the finish on your device? It's
this guy. Um, and this shop is really
cool. Um, they make like a whole bunch
of molds for like BMW like interior
panels and stuff. Um,
China is the most incredible market. You
get access to like these incredible
vendors. Um,
but yeah, you can see the main case and
then we have the top case. Um, it's two
halves that go together. Um, see little
screws that go through the case. It's
got little hexagons. Hexagons get you uh
that whisper quiet and that awesome
cooling.
This is the lens holder. Um,
so
your narcam goes here, your ecam goes
here, and then your dam. We put it on
the same side of the PCB so we can do
this all the focusing all at once. Um,
focusing was another big bottleneck that
we addressed. And then the Dam has a
separate piece that connects right
there. And then it's diecast. Um this
guy runs a diecast shop. Super cool guy.
There's a heat sink. Um this place is
also super cool. Their main business is
like they do like a 100 different
variants of like water cooling blocks.
Um Nvidia is like one of their biggest
customers. Um same manufacturer that
builds stuff like the 3X and the Comma 3
and the Comma 2 was built here too. Um
so this is their CNC shop. Um, it's like
three fixtures for the heat sink. Um,
they do these like really cool blanks.
Very cool shop.
So, now we're going to Comm HQ in San
Diego. Like I said, we have a beautiful
SMT line. This is the the kind of stuff
we're doing for reliability. Now, um,
for those of you who don't know, this is
a procedure called Dian Pry where we we
run boards and we just pull off the chip
and you look at how the soldering looks.
Um, so you got some camera sensors and
then you could see a whole bunch of
devices. So you dye them red. This is a
little cut of the the MCI board
and then you uh you want to epoxy it.
You got to wait like overnight for it to
dry. You try to pull it straight up. Um,
and you look at it on the microscope. If
you see any red, just solder is uh you
got to tune your procedure.
There's our camera focusing setup. Um,
so like I was saying, you got you focus
three devices at once with the Comma 3X
at our max rate. Um, if we had our our
very best DAM guy, shout out Juan. Um,
he could do 80 a day if he's having like
an awesome he comes in, he's like, "All
right, guys. I'm going to crank out some
dams today." He could do 80. Our target
is to do 100 camera bars per person um
in a given day. Like in a chill day, you
know, it's a Monday and you're like,
"Oh, okay." You know, you should be able
to do 100 comfortably. Um, so massive,
massive improvement on that. Um, it all
focuses right here. We have this like
complicated setup with mirrors and
stuff. Um, instead we just have this
beautiful setup. Um, and on one panel, I
should have put a picture of the panel,
but on one panel you get three devices
worth of camera bars and they're all
oriented the same way. So you just go in
a line down nine and that's it. You pull
them off and they're ready for the line.
And they got ultimate provisioning. Um
the reason it's called ultimate is this
is basically everything we could test in
an automated way on the device and this
runs at the very end. We the comma 3x
were all built something called stress
test.
This just merges all our flashing step.
We had a final provisioning step. We had
a stress test. Merges all into one
called up. Device comes off the line. It
goes right on this. You might recognize
the screen.
Same screen. Um so we basically built a
mincom before. It goes right on top of
it. And then this is the you got a
device under test and then this is your
tester. Um we call these the ups
provisioners
and they just handle it all in one. We
get to test the full bandwidth through
the USB3 port so that we make sure your
common compute is going to be 100%
reliable. Um and we have like 80% test
plan coverage. So like you know when you
design something you have like a big
list of all the things it has to do,
right? And you know, you do it for the
the once when you're designing it and
then maybe you won your first production
boards, but what if you could do it for
every single device? Um, and then one of
the things that we really looked at with
every rev of the com before was uh, you
know, is there some test plan item that
up can't cover? Should we just delete
the like should we just not expose the
interface? Does the part need to get
deleted? Sometimes the answer is it
needs to stay. Um, but often times it's
just deleted.
And then a shout out for EPOT members.
Um, we built a lot of common force. This
is our most well validated hardware. Um,
you can see it drove almost 100,000
miles. Um, got 3,300 hours. For
reference, I think the comma 3X was
probably around
700. Uh, comma 3s we took a bit longer
to build. So, probably closer to like
1500. Um, we did not build 157 of any of
the other devices. We built a lot of
every rev. Um, the SMT line is a real
superpower. We're just every time
something comes in, we're just like,
"All right, run it, build lots of them,
and you get a lot of you get to do
iterations on your whole production
procedures." Um,
so big shout out to our members for
putting up with all the bugs and helping
deliver you guys a refined experience.
So, round of applause for our AirPod
members, please.
[applause]
All right. And then this talk does have
an agenda. I try not to sell you guys
the device. I just want to show you the
cool thing we built, but I do have an
agenda. Uh, come build a five, six, and
seven with us. Um, I love this video of
Kobe from like the finals back in the
day where the reporter is like, you
know, you had a great game. Are you
happy? It's like, is the job finished?
It's not finished. We're going to build
so many more of these things. This isn't
last Comic-Con. If you want to come up
here, talk about the cool shit you did
for the next Com, five, six, the seven.
We're just going to keep doing this. Um,
there's so much more to do here.
Self-driving cars. Uh, you know, despite
what you see on Twitter, uh, it's not
solved. We're not close. Um, so, call me
jobs if you're interested. This is not a
bug. We're not hiring three supply
chainers. I just want to emphasize this.
If you, uh, just want to talk suppliers
all day, you want to just get your stuff
and count it. This sounds like a simple
job. It's a very legit job. Um,
we got some cool problems to work on
here. Um, so have to hire somebody to
make an awesome mobile experience for
Open Pilot. um supply chain obviously
and uh we build a lot of products. Um
the tiny stuff can use uh supply chain
too
and a systems engineer to work on more
stuff uh like you heard from Maxim and
Shane um ship like a new updater make
the boot time like 5 seconds um
if you just want to make like beautiful
software um you know you like writing
MIT license software all day it's uh I
really like it if you're out there too
and you want to work on this stuff. All
right, question time. What do you guys
want to know about com 4
questions?
We must have some questions. There's a
lot in there.
>> Hi. What does the 100 watt box do?
Yeah. So the common compute I we could
elaborate on this a bit more. Um the 100
watt compute is for driving uh you can
think of like we'll have two classes of
models. Um right now everything open
pilot ships runs the driving model takes
about a watt. Um and we can bring that
up to 10 on the device. But what if you
want to go beyond 10? Um there's
existence proofs in other systems like
FSD. Um,
and this allows us to effectively scale
the compute on the device a lot better
than shipping new SOC's on the device.
Um, so new desktop GPU comes out, swap
it into your common compute. We'll sell
a standard one. Um, and that'll be the
100 watt big model class. Um, and our
autonomy team will essentially work on
shipping um, two classes of models. Our
very best stuff will ship to the 100
class and then it should trickle down.
Um, you see this with LLMs today, right?
um you would love a tiny LLM versus like
the biggest LLMs three years ago. Um so
we expect a similar kind of thing to
shake out for driving where we're able
to ship way more performant high 100
watt models. Um and if you really want
to play on the bleeding edge, this isn't
for everybody. We know this is not for
everybody. Um but if you want to play
along on the bleeding edge, that's what
this is for.
Also love to answer a question about
open pilot. Anything
>> questions?
>> Tell me about the new common body. And
that's what I'm most excited about. Uh
what's the payload capacity and uh is
there anything new with the interface to
allow you to teleop it?
>> Yeah. Okay. So comfor obviously a
product. Um we've been at this for 10
years building commas. Um bodies are
much less mature. If anybody's ever seen
a common neo got a display with them um
if you want to check it out see the
progression of the hardware. Um the body
and the eGPU are very exploratory
products. They're they're just we're
showing us some prototypes today. Um
they're not comfors. um you know it's
it's not ready for your uncle for
example. Um so the body
to put it simply an intern's been
working on it for like a month and a
half. Uh we're just like it's time for
body v2 and we had an intern explore it.
Um so we're expected to like redesign it
a bunch. We're just we're basically
showing off like here's all the secrets.
I don't know. Um yeah so I just
recommend going around playing with it
if you want to load it up and joystick
it around. That's what this booth is
for. And you're like hey what if this
was right here? Um, by the way, if you
want to go talk to the the hardware team
about anything on the product, it's like
why didn't you do this or why? Sometimes
the answer is just like I we don't know
how to we don't know how to do it better
and the next one five will fix it. Um,
so we really encourage you guys to go uh
the production team and the hardware
team are uh they should be around all
the products. So if you want to know
anything about these products um and
especially the common compute and the
the uh body these are just prototypes um
you know if you want your feedback
incorporated in them let us know like
pack around with them play with them um
yeah come play along with us that's
that's kind of what this is for
>> all right we got another question back
here
>> yeah uh how long will the 3x be
supported is that to be determined I
know comma 2 was supported for like I
think six or a year six months or a year
Is that going to be the same with
>> uh yeah, we don't have any immediate
plans. Um I don't want to repeat what we
said with the comma 3. I mean what we
said with the comma 3 is true in that
it's like very similar platform and then
you you can't predict like
like when the software will diverge um
and in which ways it'll diverge
necessarily. Um so we'll say we'll
probably I mean we'll keep it around for
at least a year. Um, and you know, the
Comm 3 is still getting long-term
support like critical bug fixes, but uh,
yeah, the comma 4 um, has a bit more
capacity. It's a bit different, but
there's no immediate plans to, you know,
to do anything with the Comma 3X. They
get the same updates.
>> All right, we got another question up
front here.
>> Thank you. This is awesome. Um, I
understand the Comma 3X had like around
close to 130 unique parts, so you're
going down about half. I understand the
um thermal management is going to be
better. Shielding the GP GPS is going to
be better. I can see all these things.
What else is giving you guys the
confidence of this two-year warranty?
>> Yeah. Um so like I was saying with like
the reliability stuff, we built 157 of
these things. I think we maybe built
300, 3x's uh not 30, 3x's before we
shipped them. Um we built 157 of these
things and we saw everything that
failed. It's really this simple. Um,
I'll tell you guys our process for like
fixing the bugs on the revs. This is
like fairly revolutionary for us. We
made a GitHub issue instead of just like
posting on Slack like, "Hey, by the way,
the panda kind of like drops out on this
one sometimes. It's like it's on a
GitHub issue." And then we just close
the issue every Rev. Uh, you root cause
it as long as you like you like you
manage your state well and you just make
sure like it doesn't regress. Um, the
comma 3 is also uh sorry, the comma 4 is
also shipping on Rev I. We did a lot of
revs. Um, we basically did two big
refactors of the the whole design. Um,
so this is this is what it's designed
for. Um,
another thing I'll tell you about the
comma 4 is um the team that designed it.
Um, I think Harold and George are the
only people who were around when we
started the Comma 3. Um, and you know I
I was part of the team that chipped it.
Robo was part of the team that chipped
it. Um, this is kind of the first one
we're doing from scratch. We did the 3x
from scratch, but it inherited a lot of
the DNA from the Comma 3. Um, this is
kind of the first one we're doing from
scratch and it we learned all those
lessons from that. There's a lot of
continuity in the team, too.
>> Hey, congrats on the congrats on the
launch, by the way. Um, I was looking at
the one of the pictures and it looks
like the rearview mirror might obscure
the screen a bit. [snorts]
>> Is there I don't know, is there a reason
why you didn't integrate the screen into
like a replacement rearview mirror or
something like that looks more OEM?
>> Yeah. Um, so there's some comma forks
that do this. Um, the comma ecosystem is
growing. Um, I have this idea for next
Comic-Con where we do like fork
candyland. I think it'll be a lot of
fun. Hopefully there's a little more
diversity in the forks by then. Um, the
hardware forks are starting to diverge,
too. Um, you can check out this one
called Sidecar. Um, they shipped a few
of them and they ditched this idea. They
basically replaced uh the trim cover and
it was it was a pretty cool form factor,
but then they realized, okay, this only
works on two models a year of one
Corolla and we have to do this 325
supported cars. Oh, but this one has a
different connector and has a thing
right here. And you want to injection
mold it because like there's printed.
You want to injection mold all this
stuff. Um,
so it's not really scalable. This is
designed for scale. Um, but the whole
device is designed to be as small as
possible. So, in a lot of cars, you can
shove it a lot higher such that you
don't see it at all. Um, but you have to
mount it such that it's designed such
that you see the little strip um of the
screen in the Dam and Dams can stay
watching you and you can you can see
what Open Pilot's saying at all times.
>> Hey, um, with regards to your EIM
support, um, referencing the first
presentation, did you do anything? Did
you do your own EIM stack? Are you doing
modem manager and having to pull pull in
GIB and debus and all those stuff?
>> Sorry,
>> that's next. this next. Sorry, I'm a
little triggered with that. [laughter]
>> Sorry.
>> Uh, no, no, I was I was so happy to roof
Weston. Um, I really was pushing for
that the last few weeks. Just want it to
be like beautiful inside and out. This
stuff is I don't know. It makes it more
fun for me to work on. I know like
sometimes it doesn't matter, but like it
matters that the thing is fun to work
on. Uh, so we haven't touched the modem
stack that much yet. Um, there are plans
to to clean it up. We have a lot of
issues with this stuff. If you want to
come like work work here and work on
this stuff, uh, I think it's a lot of
fun. I don't know who else thinks it's a
lot of fun, but you like get to just
ship bug fixes all day and like make the
thing work. Like it works. Remember the
rock?
>> We got more questions.
So now that the screen is a lot smaller,
how does accessing the settings and
maybe in the future uh navigating on
Open Pilot going to work? We have a lot
of ideas for navigate on open pilot. Um
it's not quite time for navigate on open
pilot. Um but when that comes back we
have a lot of ideas. Um the comfor is
ready for nav. Um as far as the settings
you'll see. Uh you can play around with
them here. Um
Nick did a really great job with that.
Um you see a lot of this event. This was
Nick. You can imagine this on the small
screen. Um we got the keyboard. We did
so many revs of the keyboard. Um the
keyboard is incredible. Um it's actually
quite delightful because you don't
expect it to be good. Um so I think that
that's one of the cool things about the
the form factor. It totally works. Um it
wasn't clear to us that this stuff would
work and then you just build it and you
see. So totally works.
There was actually a funny quote from
Harold uh
yesterday. He posted he drove I guess
he'd been driving with a comma 4 for a
few months and he went back to a 3x and
he's like this just feels like watching
like a big TV. Um you know it's like the
opposite effect, right? If you went to a
small TV now, you know, you went to like
a 24 inch, you're like, "What is this?"
You got the opposite effect of the
comfor.
>> All right, another question over here.
>> Hey, congrats. Um, does the Comma
Electronics complies like fully formal
certification?
>> Yeah, it's FCC certified. Um, yeah,
>> it's uh it's got all the things you need
to use it. Do there are like levels or
grades like about the certification or
>> as far as what
>> about the components like safety or
>> component safety? What what do you mean
by component safety? So there's like
standards around functional safety.
Right.
>> Right.
>> Um and yeah this is it inherits all the
same stuff from our previous products.
Um
yeah we I mean we observe ISO262. Um you
know it's it's FCC certified. Um, it's a
good product, right?
>> All right, we can take one more
question.
>> Uh, with the, uh, the confidence circle
feature that you have, what's been your
experience in terms of driving and using
that? Um, is it just kind of something
that's interesting to look at or does it
change kind of how you use the product?
>> It's changed it for a little bit for me.
Um, it it's also fun because
experimental mode is just kind of
getting good now and you can kind of see
what it's thinking. Um,
but uh the whole UI just communicates a
lot more about like especially since I
know how a lot of it works and how a lot
of it is written. Um, I get like when I
see like the torque bar like do like a
little jerk or something, I'm like, "Oh,
I I see that bug that we have in like
the lateral controller or something." It
exposes a lot more state to you. Um, and
I think it communicates the same thing
to users who don't understand the
internals too. Um, just a bit more
implicitly. Um, so I think that that's
one of the really cool things about it.
Um, I'd be curious to see how it would
look. Uh, unfortunately experimental
mode got good at the same time. Um,
unfortunately fortunately, but uh, it's
you can kind of see when experimental
gets a little bit better as it has been
getting a little bit better each
release. Um, it gets a little more
confident especially on my commute. I
can see I got like a lot of roundabouts.
Um, I change highways a lot. Um,
and the it's a lot of fun.
>> All right, thank you guys. Adib will be
available for questions also in our Q&A.
He's around. Find him, ask questions.
Um, it is lunchtime, but just uh if a
reminder for anyone that preurchased
merch, it will be available at our comma
shop over here, which will be brought
out shortly. The the booths have changed
a little bit. you will see that uh the
build 3x will be now build amii. Um we
have some exciting things around. So
please feel free to go grab lunch and
then browse all of our booths. Uh we're
running a little bit late so we will
kick back off with the talks at 2 p.m.
started in about 5 minutes.
Hi guys, welcome back. I hope everyone
enjoyed lunch. Uh our next presenter is
George hot. So please gather around and
uh we're very excited to bring you the
second half of the talks. Uh welcome
George.
on the mic and then it turns green and
then you can hear me.
I'll give everyone a minute to get in
here.
I made this logo myself.
[laughter]
>> See if the clicker is going to work. I
only have one AI picture in the slides.
You'll see. Uh
yes. So, uh, you know, this whole space
really is a game of survivor.
Um, a lot of people have been voted off
the island.
Uh, so that's kind of what this talk's
about. I thought it was appropriate to
steal branding from a reality show. Uh,
so, uh, my name is George Hutz and this
is Outwit, Outplay, Outlast. So, um,
does this work? There we go. Uh, so you
know what? I don't work a comma anymore.
Uh I am still the president but you know
you uh you heard from Adib who presented
the comma 4 and you'll hear from Harold
after me. They uh are the executives who
run the company. I am a cheerleader
and so I'm mostly here to to cheerlead
sometime. I complain
uh you know like oh man you know you
think the cheerleaders ever complain
like why'd you guys lose? That sucked. I
could have thrown that ball better than
that.
>> [snorts]
>> Um, so, uh, yeah, those are the things I
do. Uh, so you know, you're hearing from
a cheerleader here. You're not hearing
from anyone with any secret inside
knowledge, but this has just been my
observations. I used to work at comma,
so I know a little bit about it. We can
talk about what the original plan was.
We were going to contract with Tesla to
replace Mobilei. Uh, that deal fell
through. Uh, you know, he got some good
press around that, though. It's fun. You
know, Elon's a great guy. It's really
it's really uh you you just got to think
about the thing I really like about Elon
is he inspires you even if you're his
enemy, if you're his friend, it doesn't
matter. It's like it just shows you that
great things are possible, right? And
this just, you know, it's what makes me
really happy. So, you know, even though
the contract fell through, it's great
things are possible, right? Um so, we're
going to build autopilot anyway, right?
My contract was to replace Mobile, the
original Tesla autopilot.
uh we build it anyway and we're gonna
sell it to car makers. You know, a lot
of people are like, "George, George, why
doesn't Kama work with car makers?" You
know, this was the original plan. We
were gonna go sell to car makers, right?
But
so we built it. [sighs] We built it.
This was the original, car. Uh I stole
this from another TV franchise. We got
engage, right? Um you know, this is on
Bloomberg. Uh 10 years ago, we had all
this like stuff. I think Adiv talked
about this a little hot added a joystick
to the car center console. A pull of the
trigger engages the self-driving system,
right?
Uh why did I use the cruise control
button?
Um but business, so I you know this this
works, right? It was actually it was
really good. Um we did a did a road trip
to to Vegas. We're driving. Yeah, it
it's not quite as good as modern open
pilot, but a lot of it was there. A lot
of the stuff we've done for the last 10
years with shipability.
So, we build this and I'm like, okay, so
now I just got to like, you know, talk
to the the Yeah,
that's the only AI generated photo in
the slides. It's kind of like, hello,
Mr. Ford.
Yes. Okay. So, you see this
this Mr.
You You don't What do you mean? You
don't know what a P loop is?
>> No, no, no, no, but like No, it's using
like an AI model and predicting the
steering angle and putting that to a P
loop, but it Oh,
yeah. Uh I mean, it might as well be AI
generated, right? The business just
there is no Mr. Ford. I was misled by
how Tesla was run because there actually
is a Mr. Tesla. You can go to Elon and
say you're using a neural network with a
P loop and he's like, that's shit. we
got model predictive control.
Um, you know, so it turns out you you
can't just like do this, right? And even
people today say, well, why doesn't
comma work with car makers? And I want
you to like take that and then think
about that a little bit more and think
about how that might actually happen,
right? Notice that a lot of people have
this idea. A lot of companies have the
idea that they're going to sell to car
makers.
And we're gonna look later in this slide
into how it worked out for them. So
giving up on this idea was the right
move. I understand that it doesn't feel
right. I understand that people have
this idea that well but you should.
That's what makes you a legitimate
business. Look at my figure head
polishing machine. Right? It is fake
legitimacy.
So we're going to pivot.
Right?
just sell to car makers. Who came up
with this idea? No, me. Fire that guy.
Um, we pivot. And what are we going to
pivot to? Well, can a cell phone drive a
car? It was kind of the original
question. We thought about all that
stuff and we're like, can we run all of
this on a cell phone?
And the answer was yes. And we did it in
about six months. And then we launched
the comma 1. Uh, the comma one was
shipping by the end of the year for
$9.99. $24 a month, right? Which is
actually exactly what the comma 4 is.
The comma 4 is $9.99 and uh you know,
optional $24 a month. We don't have a
page on the website describing it now,
but you guys should buy Prime anyway.
It's in the FAQ, don't worry. Um
[laughter]
but uh yeah, no, it's it's the exact
same thing. It's the exact same thing,
but
I didn't realize actually how hard this
was. Many times in my life, I've been
hit by Dunning Krueger. And no one is
ever going to start a company if they
don't believe that things are easy,
right? What's the saying? It's uh you
know, we we we didn't do it because it
was easy. We did it because we thought
it was going to be easy. Um yeah. So
[laughter]
uh
yeah,
I mean like and I didn't really like see
it, but like we just kind of weren't
there.
Um yeah.
And then we got a reach out from Nisha.
I'm like, "Oh my god, guys, guys, it's a
it's a it's a cell phone in a plastic
case. You're really you're already
harassing me and telling me you want
fines." And I'm just like, you know,
when they go left,
you just like eat a cheesecake.
You see what I mean by that,
>> right? It's like, you know, the saying
like when they go left, you go right.
When they go left, you eat a cheesecake.
Like it's like it's like these people
don't even understand. Nobody
understands what's happening like right
now with AI. It's so
fake and it was fake back then. It was
just the beginnings of it. Now people
are like kind of starting to catch on.
You know what I mean? But like 10 years
ago, people were like, "Oh, the media.
Oh, this is in the New York Times.
That's a legitimate news source." Right
now it's like the media, right? Um you
know, try try until you die is not what
most people would advise. In this case,
however, startup comma AI is probably
close to calling it quits/gear 2016.
Lessons from the failure of George Hots
and the comma 1 semi-autonomous driving
system Forbes 2016.
Comma is taking its ball and going home
automotive news 2016 autonomous vehicle
company shuts down in fear of
regulation.
Like this just isn't true. And it's so
interesting like when you see a media
story about something that you
understand. This is Gellman Amnesia,
right? Like like you see you see a news
article. Let's say you know you study
physics and you see a news article about
physics and you're like oh god these
people don't know anything about
physics. Why can't they get a physics
guy? Oo international politics. Wow Iran
is sure causing trouble. They must be
really informed about this. It's just
like no. They're so like like
well
skate where the puck is going not where
it has been. So this was the first video
of Open Pilot driving.
We open sourced it. Uh this was the
first open pilot release. Open pilot is
an open source driving agent. Currently
it performs the functions of ACC and
LCAS for Hondas and Acuras. It's about
on par with Tesla autopilot at launch
and better than all other manufacturers.
And that's still kind of true.
Um
so we didn't ship the comma one. It
actually took a long time. And again, it
really is done in Krueger and it's, you
know, no one's to blame but myself,
right? I don't blame Nisha. I don't
blame the media. It's fun to make fun of
these people, but fundamentally at the
end of the day, I had a phone in a 3D
printed case. So, four years later, we
shipped a phone in a 3D printed case.
[laughter]
No, I don't know. Like, look, the case
is like smaller. And look, we added some
IRL LEDs down here. We had a GPS.
There's a board in the back here. It's
pretty nice, right? Who owned a Commto?
A few people. Yeah. Yeah. uh you know,
it was something. Um and it was $9.99
and $24 a month.
Uh so then after the comma 2, we shipped
the comma 3.
Uh the comma 3 was starting to look like
a real product. The comma 3 actually
shipped pretty quickly after the comma
2. Um look at that open pilot. Looks
pretty modern. It looks pretty good. Uh
but the common 3 was too expensive,
right? Who had a comma 3? Wow, more of
you than comma twos. I'm sorry you guys
paid so much money. Um, but you know
what? Don't feel bad because however
much money you you you're out two grand
for a comma 3. We're out 5 million on
the comma 3. Comma lost $5 million on
the comma 3 project. Sales stagnated.
The product was too expensive and
undifferiated from the two. It was a lot
better. We made a lot of progress in
making the thing look like a consumer
electronic, but fundamentally this
didn't drive sales. This is the comma 2
era and this is the comma 3 error.
But, you know, we fixed it. We shipped
the comma 3x. How many people had comma
3x? All right. All right. A lot more
3xes out there. And it was sold for a
good price
and that fixed sales.
All right. So, what do you guys think?
This is futurefacing statements. I got
future facing statements here. Um, yeah.
So, uh, no, I mean, I think that
the presentation is pretty good. The
website's pretty good. The device is
amazing.
None of the stuff we've shown off does
justice to just how much better this
devices than the old one. Um the
I mean like like you see this like
picture in the UI and like it looks like
oh you know this could be like
photoshopped by some like fake company.
You know, it's so difficult today to
tell the difference between what's fake
and what's real because what makes
something real is an incredibly
difficult engineering problem. And
hopefully we conveyed some of that to
you today, how just insanely difficult
it is to make this device. And people
are like, "Oh, you want an 8-year-old
mobile phone chip?" None of that
matters. My Apple 2 was more responsive
than Apple 2 running VisiCalc was more
responsive than my M4 MacBook running
Google Sheets.
Why is this? It's just it's just due to
this insane
complexity of software. None of it has
anything to do with the actual hardware.
This thing is 10 years of refinement in
a piece of software. You saw the first
version of the software. You see the
current version of the software. I'm
hearing about mutation testing this
morning. I'm like, damn, we got to put
that in tiny like
um [laughter]
you know, but uh yeah, I mean, I think
this is the first one that is a it's a
really a top tier consumer electronic.
Um I love consumer electronics. Ade
really loves consumer electronics. Uh
yeah, it's it's really
if you buy this device and get one
shipped to you, I think you'll find it
it might actually be the best unboxing
experience you've ever had. And I don't
say this like I say this I'm actually
like thinking about it, right? Like
because when people buy like a like a
new laptop, right? It's like okay, yeah,
it's a little bit better than the old
one. And if you guys had a comma, maybe
you know some of the magic would be
lost. But for someone who's never had
this, for someone to realize that you
can buy a little device that fits in the
palm of your hand, stick it on your
windshield, and it drives the car,
that's magic.
And you can describe it to a
six-year-old, right? So, here's your
test. Here's your test for all
technology. Whenever someone tells you
that they have some NEW TECHNOLOGY, OH,
WE'RE BUILDING HUMANOID ROBOTS. OKAY,
COOL. Can I like have one over and have
it like, you know, cook me some pasta?
No, that doesn't exist.
But you wouldn't know it. You wouldn't
know it. If you consume media, if you if
you consume advertising,
all of this stuff looks possible. That's
fake, right? Oh, AI coding is going to
lay off 30% of engineers. Like actual AI
coding, right? You can't even use these
things for customer support jobs.
The the the disconnect from reality and
hype is is insane. And I don't have any
language to convey
Like I can I'm not better at hype and
better at advertising than those people.
They're actually better at it than me.
But what Kama is better at is making a
product. So I think if you've never
driven a comma and you buy this comma
before, it might be the best
um consumer electronic experience
consumer electronic experience you've
had since like I don't know you guys
remember getting like an N64 when you
were a kid. Those are the real magic
ones, right? Because from the SNES to
the N64, that was magic. From the
PlayStation 4 to the PlayStation 5, and
now I'm playing Modern Warfare 6 instead
of Modern Warfare 5. Well, it's not
really better, but they're shutting the
server down for Modern Warfare 5. And
Okay. All right. So, you know, it's a
top tier consumer electronics. Look at
this great circuit board. Right now,
that's the circuit board from the Comma
3. That's the circuit board from the
coma 4.
Uh Adiva already went through this, but
yeah, I mean that's on par with the true
state-of-the-art. Um like I said, we
have an SMT line that's yeah, doing
things that they're not doing in the
fanciest SMT lines in China. Um
vaporphase oven,
uh 3D optical inspection. They're good
about inspection, but they don't have
the they don't have the nice ovens. Uh
that's what the front of it looks like.
This is an LTE modem, GPS antenna. Uh, I
did I did have a contribution to this. I
did I did. Even though I'm a
cheerleader, I cheerled for something. I
wanted the GPS antenna to be big, right?
There was going to be a small GPS
antenna, but I'm like, if the photons
come from the sky and here's the antenna
and you got to hit the right. So, uh,
yeah, camera board connector
for um, yeah,
picture. This projector has very low
dynamic range. It's hard to see though.
Yeah. All right.
What is success?
And these are the kind of questions you
start to you start to think about. Who's
succeeded?
I should have I should have included
this in the talk. There's a great quote
from Jensen. This man owns the biggest
company in the world. And he's like
talking he's just like talking cat
interview. He's like, "Man, you know, if
I'd known how much like oh how much
headache it was going to be and how hard
it was going to be, I never would have
done it.
I love this. I mean, I love this. I
love, you know, it's it's great that he,
you know, it's it's great to see the
success of of people like that. Um, and
yeah, I mean, if if the the top
company in the world, the greatest
founder in history, this is the biggest
company in history is saying this, you
know, then what is success? And you
think about a game of chess. You think
about what success means in a game of
chess.
Success is when you win, right? And you
might lose, you might draw, but either
way, the game ends. Chess is a finite
game.
But what does success look like in an
infinite game?
Success is simply surviving.
So, uh
you
Uh this is founders fun back. Keith Bois
uh the founder of this company steals
all the comma rhetoric. Literally steals
all my rhetoric.
Has over 10x the funding.
Oh, they're going to they're going to
ship. Oh, now it's automaker partners.
But originally they were going to ship a
kit to put it on your car.
$220 million
remembers embark
did a spack. Did anyone ever do a spack
and succeed? Did anyone Oh yeah. SO GLAD
I INVESTED in that spack, bro.
Come on.
ego based. I was on a panel with these
people. You know, I hear myself talking
and I'm just like, "Oh my god, you have
no idea what the hell I'm saying.
Uh they're actually being investigated
now by the for like selling secrets to
the Chinese or whatever." And you know,
my thing is just like, "What secrets?"
Billion dollar hit on Argo, right? This
was the Ford Volkswagen
uh joint one shifts its bet to driver
assist tech. Yeah, you can you can right
now go use a blue blues cruise on your
Ford or you can buy a comma.
[laughter]
How many billions? You know, um and then
there's the really big one, of course.
Yeah.
Uh despite 10 billion dollar spent. Um,
did you know that Cruz was originally, I
talked about this in last year's Comic
Con or two years ago Comic Con, Cruz was
originally building a $10,000
aftermarket kit for Audi A Force.
Kyle Vote gave up on this dream. He gave
up. He talks about this in Lex Freedman
because it was too hard. There are too
many different cars you're going to have
to support.
Uh, figuring out how to support all
those cars is is too hard. and figuring
out a uh you know a graceful degragation
uh if everything isn't working perfectly
is too difficult. Comma solved all these
problems years ago. None of this stuff
was hard, right? But then people look
and it just it it it drives me crazy.
It's like there's still people out there
who think Cruz is a bigger success than
Kama.
They lost10 billion dollars.
I don't even like I don't even know what
to say. Like like like reality comes and
smacks you in the face and you're like,
"Yeah, yeah, that was Yeah, yeah. No,
but it was a good run, man. It was a
good run."
For10 billion.
You could have had six of these. This is
the biggest building IN THE WORLD. WE
COULD HAVE HAD ONE IN CHICAGO. WE COULD
HAVE ONE IN SAN FRANCISCO. We could have
had one in LA. We could have one in here
in San Diego. But no, we had Cruz.
Oh, yeah. Yeah. By the way, Kyle Vote,
he's looking for investors. He started a
company called the Bot Company. Uh they
raised $150 million. They're building
humanoid robots, guys. Yeah. Yeah.
Self-driving. That was too hard. But
humanoid robots,
we chose self-driving because it's the
easiest problem in applied AI. AND IT'S
STILL NOT CLOSE TO DONE. We can get to,
you know, some things about that in a
little bit, but humanoid robots are way
harder. Humanoid robots are so much
harder than self-driving cars. And so,
you know, if you like losing money, I
mean, you you can say it was a good
ride, you know, or invest in the new
Burj Dubai. I believe that someone
should build that. Or actually, I really
want to build a large statue of Taylor
Swift. Like, I want to build like a 500
foot stone statue of Taylor Swift on
that highway from LA to Vegas. Be sick.
It's my Taylor Swift statue. If I ever
get rich, that's what I'm gonna do.
Um, so this is my slide from 2016. the
players. So, we have Google, we have
auto. Well, Anthony Leandowski walked
away with a lot of money until they sued
him for it. Um, and we have Tesla. Uh,
so, you know, uh, yeah, let's, uh,
who was notably absent from the Old Town
Road, uh, you know, compilation was
Whimo.
Whimo is actually pretty cool. Uh, and
I'm not I'm not saying this like
ironically and like what makes them cool
is that I can download an app and use
it. And that's again my test for what
real technology is. It's not real
technology if you see a video. It's not
real technology if Whimo is talking
about how we're going to help the blind
get around. Why can't they just use
Uber? Like, huh? I don't get it. Stop
it. But when I can go to San Francisco
and download an app and call a Whimo,
that's actually pretty cool.
They're human supervised quasellop.
They're not a solution to self-driving
cars. They have questionable unit
economics. They use maps, but they
survived and they shipped and that makes
them cool and it's really nice to be in
the car alone. Um, if you read my 100x
investment, like I wrote a blog post
about this in 2018 and um, my criticism
of Whimo actually was not that it would
never work. I I remain quite optimistic
that self-driving cars are going to work
and we're going to get to when the
timeline is and I think that it's very
possible that Whimo will actually have
the first solution um with these
caveats. But the unit economics of Whimo
would never be as good as the unit
economics of Uber. I dated this girl for
a bit. It was an Uber driver. I'm like,
I just looked at how much he was making
on the rides and stuff and I'm like,
you're losing money. Like when you take
the cost of depreciation and gas and car
maintenance, she's actually losing
money, right? Uber's new system has
figured out ways to prey on people who
are bad at math pretty much. Or they
have like Uber drivers who are like, you
know, they they carefully like it it's
so amazing when you look at the
disparity of resources between an Uber
driver and Uber and all the little
tricks they can pull. Um, so Whimo will
never be able to compete with Uber on
unit economics,
but they actually might not have to. I
thought that I was in the minority of
people who didn't like having the person
in the car, but I actually think that's
like 80% of people. Um, so Whimo,
despite being teleyop and despite having
questionable unit economics, may very
well be a, you know, a cool successful
service. So, uh, you know, and it's
interesting, you know, they take the
same how Whimo outlasted the
competition, right? Surviving.
Um, so yeah, you know, the players in in
in 2024,
uh, right? Okay. Like who's left?
Did I miss anyone?
Zuk's okay. Okay. To be fair, Zuk says
Zuk says something. Does the car drive
in all directions anymore?
[laughter]
Uh something something something. Um but
no, I mean look, the big player here is
of course Tesla. It's always been Tesla.
Um, we can just talk about since the
beginning, we've always talked about how
far we are behind Tesla. Um, and it has
stayed that way. They have managed to
stay about two or three years ahead of
us continually. The new FSD,
I was blown away like at the leaps that
were made from like the FSD 12 that I
tried that I was like, "This is
literally worse than open pilot to like
FSD 14, which is like, all right, they
figured something out. We got to figure
that out, too." I think we got I think
we got it. But um so you can look at the
fleet size. There's the Whimo fleet, the
comma fleet, Tesla fleet. Um comma is
the second largest video connected fleet
after Tesla. Uh and these are growth
numbers.
Um so we have uh yeah almost 7,000
dailies and almost 12,000 monthlies.
Uh, so yeah, we're gathering big data.
But
again, there's really only one company
to compare yourself to in this space and
it's Tesla. So let's talk about our
distance to Tesla. Here's some
breakdowns of some different axes,
right? So when you look at the
difference in fleet size between KAt and
Tesla, we're off by three orders of
magnitude. So comma is 10K. Tesla's
about 10 million. Um when you look at
the total number of training comput
total amount of training compute that we
have so you can see the tiny corp you
see the tiny box froze over there um
you'll hear about them more in the talk
later um we have about a thousand GPUs
Tesla has about 100,000 GPUs so we're
off by two orders of magnitude there um
inference compute which is how much
compute is actually on the device so if
you saw if you heard about the 10 watt
version and the 100 watt version right
the 100 watt version is not a different
device it's literally just a GPU that
plugs into your comma 4. It's a consumer
GPU that plugs into your comma 4. Your
average consumer GPU has the same power
as the Tesla uh FSDI computer, right?
You know, Tesla will never tell you
this, but like a 5090 crushes it. A
5070, that's about the same. Um, but a
lot of this is just because of power,
right? The Tesla thing draws 300 watts.
A 5090 draws 600 watts. Uh so inference
compute Tesla's ahead by two orders of
magnitude but we'll get to that one
later. And then we have yearly spend. So
comm's yearly spend is about 10 million.
Tesla's about 100 billion. So that's
four orders of magnitude.
Um so training compute we closed from
three orders of magnitude to two orders
of magnitude by building our computer
factory.
Um inference compute we've closed from
two orders of magnitude to zero orders
of magnitude. So over there on the table
we have the comma compute boxes, but
that's what the comma compute box really
is. Uh this is a uh AMD RTX 9060 XT. Uh
it's a $300 GPU, 205 tops, and it
already just works with the comma 3, 3x,
and four. Uh the software won't come to
the three, but the software will come to
the 3x and four, and someone can
backport it to the three if they want.
Nice power enclosure coming soon, or you
can build your own out of parts on
Amazon.
Um, we'll charge we'll charge some
amount of markup for the nice box, but
you're welcome to build your own.
Okay. Um,
so how much longer to solve
self-driving?
This is Tesla fsdracker.com.
Uh, it's probably the best way to kind
of get at this. We have an internal
version of this, but it's a little bit
different. I mean, like Tesla and are
pushing on fundamentally different
things. Uh Tesla's slogan, common slogan
is make driving chill. Um our question
is like how do we achieve highway
perfection?
Uh Tesla's question is how can I ship
this crazy feature, right? Like look at
this crazy feature. It's kind of like
Tesla's unofficial slogan. Uh so yeah,
you can look at the the numbers and you
can look the uh FSD14 has really the the
felt experience is
really noticeable in data. Um, however,
every order of magnitude takes the same
amount of time. There's a simple way to
predict how long things are going to
take. Human car accidents happen about
every 500,000 miles.
If you believe FSD tracker, current
Tesla stuff is around 3,000 miles for
critical disengagement.
It gets about 2x better every year.
Right? If you want to figure out how
long something's going to take, take the
trend line and continue it.
We have eight more years.
And you know what? Whenever I make like
whenever I say eight years, there's two
groups of people. There's two groups of
people. One's like, "No man, have you
seen what chat GBT can do? It's going to
be like next week." And of course, those
people are never right. But there's
another group of people out there, too,
who says, "No, MAN. YOU KNOW, AI IS
NEVER GOING TO HAVE LIKE THE human
reasoning needed to drive a car or
something or the brain is. It's just
like you're not right either. The actual
timeline is going to be about eight
years.
Um, and that's for Tesla. Uh,
if Tesla will be there in eight, we'll
be there in 10.
So, uh, you know, we're halfway.
Uh, and this is my last slide. I want
you guys to remember something else
that's lost in a lot of self-driving car
rhetoric.
A self-driving car is not a car. I have
no idea why Cruz and Whimo and Zuks
decided to build cars.
It's nonsense. A self-driving car is a
dude.
He's the self-driving. That's a car. You
just want to build the self-driving. We
don't want to build the car.
The ultimate comma is not a device that
plugs into your car. It's a robot that
gets in the driver's seat.
Right? That's where we're going. Why
should we Why should we Oh. Oh, you got
to crack the Toyota security. Oh, no.
Who cares?
build a robot that gets in the seat and
grabs the wheel and turns the wheel.
Now, don't do this tomorrow because it's
not going to work, right? Having
accurate predictions about technology is
super important if you want to know
where to do investment. I wish VCs
understood any concept of this.
Um, but yeah, Open Pilot is a general
purpose robotics operating system.
Open Pilot. Everyone always says, "Oh,
comma, well, you're going to die if you
don't partner with car makers.
Everyone's going to get security." Or,
"Oh my god, I don't care. I want to
build a robot. I want it to cook and
clean for me." But like, actually do
this, not build up some hype, right? In
the same way Cruz told you they were
going to solve self-driving and wasted
10 billion dollars. You're going to see
all the same stuff happen in humanoid
robots. And guess who's going to be
there to pick up the pieces?
And Tesla.
same people who are there today. Uh so
yeah. No, I mean the comma the common
nine is going to be that guy. Get your
car in. Is it compatible with my car?
Yeah, bro. He sits in the seat.
All right, that's my talk. I'll take
questions.
[applause]
>> All right, do we have some questions?
I just want to say I'm ready for the
comma nine.
>> Yeah, right.
>> Do you see any reason to shorten that
two-year gap after Tesla? Would you want
to make that shorter or you fine being
at that?
>> Um, so when you look at some of the
fundamental things like that training
compute order of magnitude thing. So
KMA's new compute cluster cost about $2
million.
Um, Tesla's new compute cluster cost
about at minimum 200 million, right? So
it's even more, more like 500 million.
So they're paying a ton of premium to be
early. Uh I don't think it's worth it.
I'm certainly okay with being two years
behind. Uh in meaning if you could have
a sustainable business in the meantime.
Uh what might shorten that gap? If it
turns out the comma 4 sells wildly more
than expected and we have tons and tons
of money coming in, we may be able to
deploy it somewhat to shorten that gap.
But I can't even make any guarantees.
Right? Right? If I can make guarantees,
maybe it's worth raising the money. But
you can't make guarantees. But I do
think that maybe if we, you know, again,
the most important thing is survival. So
the question is not do you want to
shorten that gap. The question is how
much risk extra risk are you willing to
take to shorten that gap? And the answer
is zero.
I I was just curious um when you speak
about this being comma nine and you know
cooking and cleaning and all those sort
of things. Do do you mean that literally
that the final form factor of a comma
would be a general purpose robot some
kind? Okay. Wow.
>> Yeah.
>> Right. The the car thing is just again
cars are just the best applied AI
problem that exists today. Self-driving
cars are going to be solved long before
humanoid robotics.
>> Yes.
>> Um but yeah, what we're going TO STOP
OH, GUYS, INNOVATION'S OVER. LET'S
EXPLOIT. RIGHT. YEAH, let's crank up the
monthly subscriptions on people. Let's
put some ads in that shit. Yeah. What?
What am I going to do with the money?
All these people who like, I got rich.
What did you buy? [laughter]
There's nothing to buy.
>> Taylor Swift statue.
>> Taylor Swift statue. Good point. It's
actually I think it can be done pretty
cheaply. Um I'm not licensing Taylor
Swift by the way. It's called generic
female pop star if anybody asks.
See, actually I could probably do this
today, but I would need like time.
[snorts]
>> Uh, so I share the sentiment that human
robotics startups are dumb. They will
fail. But what makes Tesla Optimus a
good bet?
>> Um, or is it a good bet?
>> Yeah. Do you know what Honda Azimo was?
So Honda really in its heyday in the 90s
also built a humanoid robot. For a
largely successful car company to take
0.1% of their operating budget and dump
it into humanoid robots for press, great
idea for a startup to raise a huge
amount of money saying they're
eventually going to pay investors back.
That's absurd. Tesla's building the
Optimus. Tesla already has Optimus
deployed. They're already useful.
They're in the Tesla showrooms waving to
you, right? That's sick, right?
spending, you know, 10 million, hundred
million dollars on a sick PR project for
Tesla that may turn into something in
the future. So worth it. Raising that
kind of money, ridiculous, right? The
reason it makes sense for Tesla is
because they're a highly profitable
automaker.
>> Questions?
So to continue on and look at the chasm
that exists from where it is today to
common 9 and that what we see now is
body is kind of the beginning of the
compute core for that. What are your
insights around the grassrootsoriented
applications for come body to start
stepping towards a dude who gets in the
car? Yeah. I mean, okay. So, there's one
example of consumer robots that actually
works. Who knows what it is?
Vacuum cleaners, right? Um, so yeah, I
mean, can the comma body vacuum? I mean,
I want to do it a little bit
differently, right? Like, I don't really
want to build a vacuum. My idea is like,
can we just like buy a vacuum off Amazon
and then like, you know, have the body
grab it and vacuum, right? It should
tool use, right? Um, so I think once
we're at that milestone, we've also
considered the common body for security.
Um, but then you realize that 95% of
what you want is just a fixed mounted
camera and a loudspeaker. Um, and good
software, right? So, you actually don't
need the robot form factor for that. But
like vacuums are the first robotic form
factor to pay for themselves. So, once
the comma body, once the general
purposeness of the comma body is capable
of grabbing your existing vacuum cleaner
off Amazon and using it, then I think we
can start selling the comma body into
people's homes. But fundamentally, it
has to come and someone might figure out
an application, right? Uh I I don't know
if the body is going to be talked about
more, but our goal with the new body,
the first body was $1,000. That's
insane, right? Like how can we try to
charge you, we charge you $1,000 for a
comma 4 and you'll use that shit 40% of
your days, right? That's so worth it.
But if you buy a comma body, okay, it's
a cool toy. Like we got to price it more
like a toy. So the new comma body is
going to be priced at $200. And I hope
that someone out there with a comma four
and a comma body figures out some use
for these things and we'll productionize
it. But I mean I think like unitry is
making the same play, right? Like we
bought two of those dogs. They're cool,
but they don't make money. There's no
way to like deploy this thing in a real
application where it like provides value
to you. It's a toy. So yeah, we're
targeting the toy market for bodies.
Hopefully someone will figure out what
to do with it. The software will get
better, but yeah, until you figure out
how to make the robot do something that
makes money. Yeah.
All right, next question.
>> Hey, George. Hey, if you were looking to
put me to work, how much would you buy
me for? Negative. Honestly, negative.
Um, and here's why, right? Like, so much
of the fact that things don't scale is
due to managerial overhead, right? So,
if someone comes to you and says, "How
could you put me to work?" You're
actually asking something of me. You're
asking for me to do something, right?
And that that's why it's negative,
right? Yeah, you got to pay me for that,
right? The the real way to be put to
work is to go work on tiny grab
bounties. Just go work on them or go
work on comma bounties, right? Um but
yeah, no, I think the the uh yeah, I
mean, god, we're getting to the point
where the marginal utility of a human is
negative and that's scary, but
all right, another question.
Thank you for the talk. Um, I wanted to
ask about um the Chinese competition
especially like BU and these companies.
>> What about them? I think they make a
search engine and a maps app that's kind
of confusing to use.
>> I think they're making 500,000 trips a
week.
>> BU in China.
>> What city? Um, I think
>> I haven't been there.
>> Okay.
>> I haven't tried it. I mean, again,
probably what it is, I'm surprised by
that. I mean, B stack was open source at
the beginning. Um, autoare. I don't know
if it's still open source. It's autoare,
right? The B one.
>> B Apollo. Yeah. Yeah. Who was Autoware
was another one? Yeah. Yeah. Yeah. Um,
no, they were open source. Uh, yeah, it
was Apollo. I remember I remember their
moonshot rhetoric. I wonder what's still
open source. I also wonder how teleyop
it is. So, like I think the Chinese are
generally more open with showing you
their teleyop stuff. By the way, Whimo
admits to teleyop and you've never seen
a picture, which means that the teleyops
a lot more than you think it is, right?
I think the Chinese actually show you.
Well, yeah. Yeah, we hire people from
this rural province to come sit in this
gaming chair and drive you around. Okay.
Um, so yeah. No, I I think that a lot of
this like teleyop stuff is just uh it's
not self-driving cars. It's cool and it
might be a cool service, but it's not
the same thing as solving the AI problem
of self-driving cars. There's a lot of
other fun problems to solve on the way.
But yeah, I mean that's kind of my take
on Whimo and all of these kind of like
robo taxi kind of things. It's actually
cool and it actually has carved out its
own niche that has shipped, but it's not
AI.
All right, we got time for two more
questions.
Anyone?
Thank you. Hi, George. Um, you've been
posting a lot lately on uh, well, first
you started tiny and you you've been
selling the tiny box. Um, and then
you've been posting a lot on um,
external GPU.
I don't know know what you would call
that, but uh, some way to connect a GPU
to a MacBook. Yep. And so can you can
you talk about I guess on a small scale
with that second thing what you're what
you're hoping to accomplish and then
more broadly
uh what do you want the ultimate goal of
Tiny to be?
>> Uh the mission of Tiny is to commoditize
the paflop.
Um so what that means is right now
there's an extreme premium uh for Nvidia
palaflops. Uh we'd like to bring the
general price of the pay to flop to only
be slightly above the cost of the
silicon and the cost of the power. Uh
that's mission one. Mission two is to
rethink about how software is made. Tiny
has cut through every dependency in the
NVIDIA stack. We're speaking directly
over PCI to the NVIDIA GPU. Um yeah,
without Nvidia's user space, without
Nvidia's driver, without anything from
Nvidia, without Kublas, without any of
that. So I think that in order to get
very reliable robots in the future,
you're going to need an operating system
that matches that level of robot uh of
of robustness of reliability. And I
don't think that we're going to get that
through things that look like the
current stack. Tiny is radically 100x
simpler than the existing stack. And
that's what you're going to need to get
reliability of things that like you know
a human is never going to glitch out and
slam their head as hard as they can into
the table unless there's something
seriously wrong with that human. Like
that's not like some probability. That
will just never happen, right? With
computers. Oh, sorry. Sorry. Your kernel
got stuck in a thing where it was
servicing this interrupt for 300
milliseconds and the motor was at full
torque. Okay. Yeah. So, I think we need
high reliability deterministic
computation. That's kind of a tiny bit
for robots. Runs in comma already. So,
>> all right.
Let's George will be available also in
the Q&A. So, uh, let's we're gonna
finish up with his talk. Thank you so
much, George, for that.
>> Thanks.
All right. This is Harold here to talk
to you more about robots. Um, Harold is
our CTO. CTO. Welcome, Harold.
>> Hello. Yes, I'm going to talk about
robotics. So I lead the autonomy team at
KMA and what we're doing is we're
building autonomy software for robots.
So to start I just want to make it very
clear if that hasn't been made clear
already is that KA is a robotics
company. I joined KMA eight years ago
because I was really excited about
robots. I think any vision of the future
that is exciting that I'm excited for is
one that includes a lot of robots. And
back when I joined almost 10 years ago
now, been there eight years, it seemed
like self-driving was just the best
applied AI problem uh that would kind of
bootstrap robotics into becoming the you
know robotics future that we all kind of
dream of. So I joined back then for that
reason and even today that still seems
true is that the most interesting
developments made for robotic software
are being made in the uh autonomous car
space and KMA is now part of that.
So as part of that goal to develop that
software, you know, we want to make a
useful robotics product. That's what I
want to build. That's also what I want
to buy. I think that's the kind of stuff
that excites me to make it a real
business. You got to sell it for more
than it costs to make. You guys saw the
new comma 4. The comma 4 is a great step
in that direction. Fortunately, my
slides are not up to date uh as of this
morning. And uh I want it to be open
source. When I use products, it's really
nice when it's open source because I
think it makes it way easier to align
the product and the software to what the
consumer wants because you can just fork
it and make it the way you want. Uh if
the ecosystem is entirely closed, you're
just kind of at the whim at whatever
this big company decides. Whereas open
source, you kind of give people the
option to improve it. And then this last
point is something that I'm going to
talk a lot more about in this
presentation and that I think is really
important and also a big deviation from
what people generally do in the space,
which is no cloud whatsoever. Everything
that we do, all the development, all the
data, every experiment needs to happen
in our data center which we own, we
control and we operate.
And I'll tell more about why I think
that's so important uh in the future
slides.
So unfortunately when I said robotics,
some of you started thinking about
humanoids again. And so I think it's
important to just start this
presentation with a reality check. And I
didn't review anyone else's slides
before starting today. So this is going
to be the first of many déja vu. The
good news about the deja vu is that I'm
saying the same things other presenters
said. Uh which proves that we're at
least somewhat aligned inside the
company as opposed to accidentally
saying the complete opposite. But so
figure is dumb.
Anyone who's trying to tell you that a
robot's going to do your laundry in any
of the next few years is just trying to
sell you shares. That is completely
unrealistic. there is no intermediate
product that is being sold that there's
anything that even looks like that. So,
it's a completely absurd proposition.
Um, and you know, that's just PR.
They're trying to sell you shares and we
shouldn't buy it.
So, that part of the reality check over.
I don't want to just be a downer and
hate on fake hype. I also want to talk
about some of the robotic products that
actually exist. Uh, George already
talked about this. Whimo is a real
robotics product. Uh, I've used them. I
think it's extremely cool. You know, I
like Ubers and that they get me places,
but a way more is just a better
experience. It's really cool to see a
robot move down the street and be
useful. You're alone in the car. You set
the music as loud as you want. Nobody
complains. It's awesome. It's genuinely
really cool. Um, however, there's some
downsides on the technical side. George
already arrested there. Some form of
teleyop. Even though it's clearly a
robot, it's uh not necessarily an
entirely autonomous robot. But I think
the bigger problem in terms of a
robotics product is that you can't buy
one. Any of you here have a billion
dollars, you still can't get to buy your
own Whimo and sit in it.
And also for them, it loses money. So it
doesn't really satisfy these conditions
uh that I set out as our goals. Then we
go to an even lower level of reality
check. What are the useful robots you
can actually buy? Um in industrial
applications, there's quite a lot. I
don't know if you guys one my pastime
for a while on YouTube was to just look
through farming videos in uh in the
Midwest and it's absolutely incredible
what farming robots can do. You can have
a few operators run what used to take
10,000 people to run a 100 years ago.
And a lot of this stuff now is is quasi
automated. They live in some constrained
environment and they can have
technicians and um
it's it's very constrained compared to
like a real world environment on the
road. but it is largely autonomous and
extremely useful. Then we get to Teslas,
which you know, they are autonomous
robots. They might not be unsupervised
yet, but they're a cool product that you
can actually buy. And then the last the
lowest tier is what useful things can I
buy in my house. And genuinely, the most
useful robots you can buy for your house
are a dishwasher and a vacuum cleaner.
There really isn't anything more
sophisticated. So, I think this is this
is the status of things. Uh, and we
should forget about this whole humanoid
crap until there's something that looks
slightly more advanced than a vacuum in
my house. Uh, we can we can stop
thinking about humanoids as the next
step.
So,
what's noteworthy about all of those
actually existing useful products that
you can experience today
uh, is that they all existed 10 years
ago. Uh, 10 years ago, Whimos were
operating. It wasn't an open beta. That
was only I think eight years ago that
started but 10 years ago there were
wayos and they were driving themselves
to some extent. Um I had a Roomba 10
years ago that kind of did something.
It's not nearly as good as it is today
but there was Roombas, there was Tesla
autopilot. Uh dishwasher is obviously
quite a bit older than that. So I think
the point of the reality check here is
just that these things are getting
better. I'm far happier with the current
versions of ADAS. Obviously Open Pilot
has improved a lot. Uh I'm far happier
with uh my vacuum cleaner and my
dishwasher, but it doesn't make any step
changes.
These type of step changes of you have a
Roomba that eats your cable to all of a
sudden you have a humanoid folding your
laundry and comforting uh your dog that
is uh marketing hype. This these type of
step changes just don't happen in
reality. If you want to create a truly
magical technology that is useful like a
dishwasher is that is integral to
everyone's life, you need to iterate.
And it takes time. You need to ship a
product and you need to improve it. And
over time you start to create something
that if you look back and compare to
what was there before feels like
complete magic.
Um
I think a clear example of this type of
effect is the iPhone. Uh, a lot of
people talk about the iPhone moment as
if there was this step change that
happened in consumer electronics where,
you know, we were all, I don't know,
calling people on landlines and all of a
sudden the iPhone came around and
everything changed. But that's not
really true. If you look at this graph
on Apple's revenue, you don't even see
where the iPhone was released. Even the
iPhone, which felt culturally like a
step change, uh, still just follows a
natural exponential trend. The launch,
for those who are curious, is here. And
as you can see, they started selling
iPods, they started selling more of
them, and then they started improving
them. And obviously today, an iPhone is
an incredible product.
So, the last thing I want to talk about
this iteration stuff and really driving
this point home is this is my favorite
plot of iterative improvement. Uh, it's
about the corn yields um on American
farms. This is how much corn you can
extract from a fixed piece of land. Uh
that's something that people have been
optimizing for a long time because it
makes your farms more productive. And
what's crazy about this plot is just how
straight this line goes up from when the
iteration iterative improvements really
started. What's crazy is nuclear power
was invented there, electronics was
invented, the internet was invented, and
now we have AI. Yet in the plot of corn
yields, all you see is that things just
gradually get better because they
iteratively improve. and these type of
step changes just aren't really
reflected in the data.
So with that said, I want to have the
complete opposite end of the talk of
trying to hype some kind of future
fantasy world. I just want to talk about
what do these iterations look like
behind the scenes. We've talked a lot
about the kind of models we train and
kind of the autonomy software and how
the autonomy software works. But I think
there is a bigger picture that is worth
talking about that we rarely fully
describe which is to make these
iterative improvements to the model. You
need all sorts of scaffolding and
infrastructure uh machines and tools and
I want to talk about how some of those
work just to give more of an idea of
what I think is the stuff we prioritize
at KMA to make uh improvements to the
driving experience.
So we're just going to talk about some
concrete engineering details.
So one slide about what we actually
shipped just so that we have in context
um
the kind of improvements that the tools
I'll be describing actually helped
create. So one big thing that we were
working on and we've had presentations
and papers about this we published a
paper at CVPR about a new method to
train uh self the the policy models
which are trained in a diffusion
generative simulator. uh we some version
of that we shipped to a recent release
and that recent release uh caused a
engagement uh spike here which is what
we were really trying to go for. So
experimental mode is the mode where open
pilot controls everything the steering
the gas and the brake and everything's
completely end to end and you know there
was a lot of usability issues with that
that we were slowly trying to improve
and you can kind of see the effect those
releases had. So this is basically over
this year we went from like you know
slightly over 20% this is a noisy graph
but it's roughly a 5% increase in
engagement uh that we've been able to
achieve by doing these kind of iterative
improvements trying to improve the end
longitudinal control of the models. So
that in mind that's the kind of
improvements that we're talking about.
So
at the autonomy team our job is to
develop the models and also the control
stack to improve driving on open pilot.
But one thing we internally always talk
about is that the real thing that we
need to do is we need to improve the
infrastructure, the tools and the test.
And this has been on the whiteboard at
the autonomy team for basically as long
as I've been there, which is that
machine learning and this kind of
robotics improvements is 90% is
infrastructure tools and tests. The
actual machine learning kind of happens
by itself if you figure out the other
stuff. And it says here too on our
whiteboard, we got to make the tools and
tests that make improving driving fun
and easy. And that's really the key is
if you make the path of least
resistance, the fun engineering, if that
happens, if it's fun to improve it
because the tools are so good, because
the infrastructure is so good, it will
improve by itself. So the real focus of
our team and of really everyone um at
comma that's trying to improve these
things is to improve the uh experience
of iterating on it on trying stuff.
[clears throat]
So I talked at the beginning about uh
running stuff on our own data center. So
one really big part of these tools tests
and infrastructure that we use uh to
improve driving are the uh you know
physical machines that all of this stuff
actually runs on.
So we'll start with just the
workstation. This is all pretty
standard, but I thought I'd add it here
just for completeness. We have a
standard workstation that basically
everyone uses. It's just a Lenovo
workstation. They're connected. You we
try to connect them all with 10 gigabit
to the data center. You know, it's just
Ubuntu. It's nothing fancy, nothing
super weird. And we have a monor repo
that all of our code runs on. Uh it's
just one repository that we all have.
And there's a Python virtual
environment. So on our workstation,
that's what the workflow looks like.
It's nothing really crazy. It's all
mostly standard stuff.
So then where the stuff actually runs is
in the data center. So here's a pick of
our data center. This is a realistic
picture of what it looks like. Uh some
of our pictures are more staged where
there was more cleaning going on, but on
an average day, uh it looks kind of
industrial.
So before I move on, I want to talk
about the own and renting thing. I think
this is really important. Owning the
data center, I think, aligns incentives
with experimental development so much
better. The average engineer working in
the autonomy team trying to improve the
models. What they really want is just to
make a model that drives better and that
they can put on open pilot because
that's what makes us happy. Um, now if
you run stuff in the cloud, the easiest
way to do that is just to spend more.
You can train the models for longer. You
can train the models uh on more data.
And all you have to do really is to
change the scaling factor, but also the
spend. And so the path of least friction
into making a better model in the cloud
uh is just changing the budget which
that's not really great incentive
alignment because as a company we're
trying to make money. Um so the
incentive alignment on our own data
center is much better which is you're
using all the compute already but your
model still not improving as much as you
want. So what do you have to do to do
that? you have to change the code to be
make it more efficient to make it train
faster so that in a realistic amount of
time uh you can get to a better driving
model uh faster. So I think this this
incentive alignment is really important
and it also leads to other things like
if the data center is idle, if it's our
own data center, we're encouraged to
experiment which is a good thing. You
want engineers to use the idle compute
to find out stuff to experiment. In the
cloud, every experiment costs money. Um
so you're kind of disincentivized from
experimentation and kind of incentivized
from doing these large scale production
runs uh which I think long term costs
just way too much money for what it
achieves. So we need our own data
center. Uh this is what we have. It's
been talked about a bit before. There
about 200 machines.
Absolute max capacity is theoretically
400 kilowatts.
We haven't achieved that yet, but we're
working towards it. I mean, having more
power usage means that, you know, we're
more effectively using the GPUs and
CPUs. And as long as we're not running
some kind of burn script, that's a good
sign. We have about a thousand GPUs. A
lot of them now are these Tiny Box Pros
that you saw a demo unit of there. Um,
all of the data that we use for training
is also stored inside this data center.
We don't have air conditioning because
power is very expensive in San Diego.
So, we just have standard fan cooling
and uh that works pretty well for us.
Um, terms of software, they're set up
kind of the same way as the workstation.
So, there's nothing custom there. Again,
we just have Ubuntu running on them.
They're managed by the same software in
the back end. So, that's all pretty
easy. Uh, that was the highest power
usage I saw when I was making this
presentation, which was 235 kilowatts.
However, we made some improvements then
since then and made some uh installed
some more computers. So, yesterday we
hit 320 kilowatts and once the full
buildout is complete of the 10 bucks
pros, we should be should be hitting
closer to 400.
[clears throat] So, there's several
services that uh we use when we develop
stuff. Uh for example, we have a data
server which you can ask for the driving
data. uh we have model servers that you
can ask for model weights of a
particular model and all sorts of kind
of small services that are critical to
uh to the development that we do and all
of them run on just this picture of
machines. This is about uh in total it's
about eight machines I think that run
essentially all of the services that are
the masters for all of the services.
These are just three big super micro
machines and then we have some of these
Dell machines. I think one of them is
the climate controller. climate controls
data center is very important because if
that fails and kind of everything
crashes so that's a dedicated machine
one of them is a router we have one that
manages the data ingestion and that's
pretty much it I mean this this half
rack is really uh all of the all of the
centralized services that we use uh they
run everything everything else in the
data center is just compute or data
storage
so you'll hear a lot more about data in
the next talk from Mitchell um but I'll
just quickly give a fast overview. We
download a lot of data from the devices
when they're driving on the road. Uh
that includes camera files. It includes
open pilot logs. It's just in one minute
chunks, right? We did some work to
improve the ingestion. So right now
we're doing about um a thousand hours a
day. So that's quite a lot. I mean
George already mentioned it. We are the
second biggest fleet uh after Tesla and
I think on a per user basis we uh ingest
far more data than even Tesla. So we
we're really doing quite well on the
data aspect
and you can see there in our last uh few
months we really up the ingestion we
released the model trained on a lot more
data.
[clears throat]
So I talked about the data storage
uh so one of those servers that I showed
earlier is the master and then we have
all these nodes that essentially have a
bunch of hard drives in them. Uh I think
they're not sure how much one machine
is. I think it's like 80 terabytes or
something on one machine. Um, and that's
basically that array is all the data
that we have and it's all stored
locally. It's all non-redundant. If we
lose it, it's gone. Uh, it's cheaper
that way. We hope there's no fire u
because then we'll have to pull in data
all over again.
So, this is a distributed key value
store. It's single master. Uh, it's open
source. George open source it a while
ago. So, if you're curious how that
works, you can check it out. But the key
is it's extremely simple. Having one
master makes things much easier. Uh, and
hasn't really caused many issues. So
that's where all the data is stored and
uh it's just uh just a web server
request to get the data in whatever
you're using.
So data is one part but the other part I
talked about is that all the other nodes
are compute. Uh so there needs to be a
convenient way to use that compute. You
need to be able to just write easy code
and then run that compute on all of the
machines uh easily for the development
to be fun. So we have this tool called
mini. Unfortunately it's not open source
yet. We're open to open sourcing it.
It's just kind of hard with some of the
how it's integrated with some of our
other stuff, but that's something we're
going to work on.
Um,
basically what it allows you to do is it
allows you to write some arbitrary
Python code uh and then you send that to
some master server uh that hosts the
request which contains some code and
potentially some data. Um, and then that
gets sent to really any um any node
that's a computer that has computer
available that can run it. And every
machine in our data center that's not
doing something else is available as a
mini rate consumer. So it can consume
these jobs and run this arbitrary code.
Of course, GPUs are very relevant now.
We do a lot of GPU work. So we make it
support GPUs and have like a model
server for efficient batching and that
sort of stuff. Um but yeah, so you can
write any kind of Python code and you
can access of course any of the data
that's in the data server. So if you
want to do any kind of driving
experiments, you can do that. Um not
going to th go through the specifics of
this but I just added this here. Uh it's
extremely simple stuff. If you want to
run any Python function on all of the
machines like simple function like is
prime really you just have to write this
code. It's ex written the exact same way
as a normal thread pool executor in
Python and you can just distribute
across the entire data center. So we've
really put a lot of effort into making
this this simple. Uh you know this is
the result of many iterations of
distributed compute and this is kind of
the final result. It's funny because in
retrospect it looks obvious we just
copied the uh copied the Python
threadpull executor API which seems
obvious in retrospect but of course it
takes many hacky detours to kind of come
to this clean solution but right now
that's all you need to do to run um if
you run a one want to run your is prime
function with 200 kilowatts that's all
the code you need to write.
So just giving a quick example of uh of
how you would use this on an average day
if you want to do something cool. So
[snorts]
this function right here, this is a real
function. This allows you to get a list
of all the data in our entire data
server. So it's several million minutes
of driving and uh we can enumerate all
of the files in that uh whole data
storage uh in just like 20 seconds. So
all you have to do is do this and you'll
get literally a list of in all data that
we have stored locally in the data
center. And then you want to run some
stuff on mini. So in this case, we can
just run some easy thing like, oh, get,
you know, the hard break segments or
something that might be interesting. Uh,
and then you just display a video. And
this is real code. This is actually code
that exists in our codebase. It really
is this simple. It was a huge effort to
get to this level of simplicity. Uh, but
we're very proud of the state it's in
now. So if you run that, the result you
get is something like this. So this is
something I ran like a week ago. Um, it
just goes through basically all the data
we have stored and just looks for
heartbreaking events. And there just
like some interesting examples of just
weird things that happen on the road. Uh
this is all human driving. I mean uh ADA
systems are not even allowed to break
this hard without AB. So Open Pilot
doesn't do this sort of stuff. Uh this
is just humans reacting to weird stuff
on the road. Um and you can see all it
took is like 10 lines of code. And you
can kind of scroll through the data like
this. This is another example. This
instead of looking for hard breaks is
looking for hard swerves. You can see a
a recurring theme is we've got uh people
on the highway merging into your lane um
and then the driver kind of avoiding
that aggressively. We've also got like a
deer here. If you look through this sort
of data, you find a lot of a lot of
animals crossing the road.
Okay, so that's we've got the compute
covered, the data storage covered. Um
that's kind of the real physical
hardware and what those machines do for
us. Um now we talk about some of the
tooling that is basically used all the
time in the driving development that we
do. We call that arena. Uh what arena
allows you to do is like any kind of RL
setup. You have an environment, you have
an agent and you can run a rollout.
So that's really important because this
allows us to run driving policy in the
loop in a realistic environment and we
can kind of customize all that to either
do some kind of test to figure something
out or we also use this for training.
Um so here we have it running just the
normal open pilot policy the one that we
released um in Carla which is some kind
of classical simulator. We do all sorts
of sanity tests in check uh in um in
environments like this. We can just make
sure that you know it stays lane center
that sort of stuff. And here is again
actual code of what that looks like. We
have just some pretty verbose config. We
can config thousands of things about
these rollouts that are useful for
different things. Uh, and then all you
have to do is set the config and then
you run it and then you get this. Um, so
this is again tooling. This was probably
about a six months project to go from
kind of one-off scripts that did this
type of stuff to building a real tooling
infrastructure with usable config. Uh,
that that's way way easier and way more
fun to use. That was I think end of two
years ago we started working on that.
Took probably about six months to get
this in a good state and it's been way
way easier to do sort of stuff since
then.
Uh so an example of how we would use
this. So that kind of simulation
architecture we can then combine that
with the uh distributed compute that we
have and we can kind of run a whole
bunch of rollouts all simultaneously uh
on the whole cluster. [clears throat]
And uh I'm going to show you the I'm
showing you the results here of
basically the changes that we made from
shipping the models we were shipping
last year to the ones that we're
shipping now that have much higher
engagement uh longitudinally. And this
this test makes clear why. So this test
uh puts a car on just an empty simulated
road here like this is kind of simulates
an infinite long highway and we just
kind of put the car at different speeds
and our expectation is is that open
pilot understands the scene in a certain
way, thinks about it, comes up with a
good speed to drive and slowly converges
to that speed. Now you can see the top
plot is what we were shipping last year
basically and you can see it just slows
down forever which is a terrible
experience and those of you who've used
experimental mode will know that's how
it used to work. If you're on a just
empty event super long highway it might
just kind of slow down and at some point
you're driving 45 miles an hour uh on a
straight long empty highway which is
obviously a terrible experience. And
then here you can see what the latest
models that we ship are. So it's not
really perfect. uh it doesn't really
converge to one speed, but you can at
least see that the model is not so
stupid that it wants to slow down to
very slow speeds on the highway. Uh at
worst, it wants to drive 55 miles an
hour. So, we need to improve this a bit
more. But here you can see this is the
kind of reports that we're looking at uh
when we're shipping changes and
hopefully making improvements.
So that's so far I've described the
training uh not the training yet I've
described some distributed compute for
tests the uh the rollout infrastructure
and the data um of course we need to
train models that requires quite a bit
of infrastructure too we recently
switched I think it's been about a year
to managing this all with slurm actually
before we used slurm we would literally
SSH into a computer and run a command
and if you were running it on multiple
machines then I mean there were so many
ways to do it wrong it was extremely
inconvenient. Uh but now this is done
properly.
It's managed by Slurm. Uh one recent
feature that's probably only a few
months old is before we would have
different code repositories that were
accessible to the training machines that
we had to specify and also make sure
that we're on the right stuff. Right now
we just ship all the local code that's
on your workstation just gets copy
pasted to some shared drive and the
training run happens on that. So you
don't need to manage multiple repos.
Whatever is going on on your
workstation, the trainer is going to use
that. um training is done with PyTorch
that's I guess pretty standard
multimachine we just do with normal DDP
all very standard stuff and then one
thing that we've implemented this is a
few years old now but I think it's been
really helpful is I mentioned about
making sure that you can iterate fast
making the iterations fun this is really
important for development uh and one
thing we did is your training run just
dies after 24 hours if it didn't make it
in 24 hours well sorry it took too long
um of course it's easy for someone to
change the code but it's slightly
embarrassing ing. So this is just this
has been enough incentive to make people
uh make the training runs faster and and
so far everything we release basically
runs under 24 hours.
Okay. [clears throat] So the other thing
we need for training is we've got these
machines that do training. They do
training steps. They update the weights.
Uh but the weights actually have to go
somewhere. So we have not just a data
driving data server but we also have a
server that uh receives all the model
weights during training and also saves
them and then can host them.
So we call this reporter. So reporter is
is both an experiment tracker. Uh it
shows basically I mean it shows every
model we've ever trained since comma
started. This tool is incredibly old. Uh
it will show you all sorts of you know
training graphs on the loss and and all
the individual stuff. And then we also
have all sorts of different validation
reports attached so you can read through
um and get some kind of picture of how
the model is doing. This is partially
open source. We publish the reports and
all the models emerge in open pilot but
we're planning to make some improvements
to that.
[clears throat]
Yeah. So reporter is the other critical
part of training outside of the slur
management. Uh it hosts all the weights.
Uh it hosts experiment information for
engineers to go through.
And then the last part we need for the
models we train is I've talked about
arena before how you can run rollouts uh
with different agents and environments
for testing and for debugging. Uh but we
use this for training too. Our final
policy models are trained on policy
which means they're trained by
generating data with the active policy
running and uh then sending that data
back to the training machine.
And here you can see these are kind of
the two configurations that we've used
which we describe in the CVR paper. This
is a classic reproje simulator. So it
initializes on real data and then the
driving policy can deviate uh from that
real data by warping the scene and
reproing stuff. Um, and then this
alternative here is one that uh
simulates the entire scene with the
generative diffusion model. And all the
difference it takes, oh, I switched
these here, but uh so the all it takes
is changing the config here from MLS sim
to uh to tiny sim. And if you guys want
to try it, uh that that setup back there
with the steering wheel, you can
actually run the training rollouts and
see what the model sees during training.
Okay,
so let's take a 5-second break here and
let all these things come together. So
the most complex task that we do at
Comma uh training
or or developing anything with driving
is is running a full training job on
multiple machines where it's on policy.
So all of the data needs to come from
rollouts from rollout workers. Um and
then it's got to interact with all the
data server and the weight server. So
when we ship a model to open pilot, it's
trained with just something like this.
So it's just one line command on our
workstation that you run um some basic
config uh that that you need to do. We
show the data set. So the most recent
models we trained were trained on uh um
on 500,000 segments, the final stage.
And so it starts at the workstation
and then you send this lurm command to
the trainer pods and they pick up the
job and they start. So this is all model
weights are synced with PyTorch and then
when they do a step they send that to
reporter which hosts the model weights
and hosts all the experimental data and
then the rollout workers which is what's
necessary for the on policy training. um
they receive the jobs from the trainer
and they receive the weights from the
reporter and then they send those
results the training data back which is
what the trainers use to iterate and
then in the back there we have the uh
the data server that hosts uh all of the
driving data.
So I mean this is not super easy to wrap
your head around right now but this is a
really good overview of basically all of
the tools that we need to maintain uh to
have a good experience training models.
Some of this stuff is custom. Some of
the stuff's very different from what
other people are doing in the space.
Some of it's somewhat similar. Slurm's
relatively popular for example. Um I
think companies like Facebook have a
very similar setup to mini raid to
achieve the same thing.
Um but yeah this is how it all kind of
comes together and like I said it's
really fun to talk about you know what
the actual model decisions we make and
you gave a lot of information about that
but ultimately to really make progress
and really iterate on on the experience
with open pilot all of these things need
to be good first there's no way to make
good machine learning improvements if
you don't have really good
infrastructure around uh training models
and debugging and looking at data and
all that sort of stuff so this is kind
of the full picture of what's going on
in the data center most of the time.
Yeah. So, with that said, the last thing
I want to bring up is uh our next
hackathon. We had a pretty fun hackathon
uh with the comma bodies where we were
just doing some autonomous indoor
navigation u with the with the bodies.
You run your own software on it and the
best best people got a prize. I think
there's actually quite a few people from
that picture here. We had um
yeah we had the two of the winning
members of the team I think are here.
One's working at comma right now and uh
so hopefully if you're interested in
this sort of stuff come to our next
hackathon and it's not really clear
exactly what we're going to do yet I
think but we know the dates and uh we'll
post more information about uh what the
goal and what the prizes will be at that
link.
Right. Thank you. So got any questions?
It's now the time.
[applause]
>> Thank you, Harold. All right, we got one
question in the front.
>> Hi, Harold. Cool talk. Um, crystal ball.
When if ever do you see there being
enduser
triggering of like when when FSD
currently disengages you can say you
know tell me why it disengaged and it'll
send it to Tesla and then they'll use it
as input I guess in theory to some sort
of training.
>> Uh yeah I mean I said the loop that's
happening right now at at our team is
you know if people tell us engineers
look into it and then that that is
somewhat of a loop but obviously it's
not autonomous loop. Um I would say
rough estimate within two years uh
disengagements are very actively
changing the policy uh that that's being
updated. Yeah,
like that's something we're actively
experimenting with but haven't shipped
yet.
>> Questions.
>> Hey, great talk. I was actually curious
to know the evolution of your entire
infrastructure. Was it was it always
designed to be this way or very early on
you had an infrastructure which looked
very different from what it is right
now?
>> Um I think this design
is maybe 5 years old or so. Uh I
showcased some of the code uh to do
these things which I'm very proud of
which is why I added it. I think the
core infrastructure was there but the
things were implemented in a very
confusing hacky way and that stuff is
things that have been improving even
until recently where I for example gave
the example of the mini ray thing before
to run stuff distributed you had to do
some custom thing that was specific to
us for no particular reason um that now
is easier and it's kind of the same
thing with these training commands so
yeah the core infrastructure is several
years old but the uh tools themselves
being as good to use as they are now is
recent
>> got it and would you
what what do you think was the
bottleneck very early on to get to this
level of maturity like would you could
you not have I'm I'm asking this from a
very selfish reason like we are also
very early on in our u autonomy stage
like we are a startup and we are just
wondering like is it worth it to spend
time figuring out this entire
infrastructure very early on when you
probably do not have a lot of compute or
a a lot of data to work with or
>> um I think if you don't have an
immediate use for this type of
architecture, it doesn't seem that
useful to me. But I have to say that
again when I'm talking about these hacks
that we made that seem stupid in
retrospect, I don't see why we ever made
them. It feels like if we just made
better decisions early on, we had to
would have less iterations, but I think
it always just kind of looks like that
in retrospect.
um you showed some results on Carla. So
I'm curious like what part Carla plays
in your um autonomy stack like um is
that purely for evaluating the rollouts
or do you if you use it for training
like do you think it transfers well to
real world deployment on 3 and 3X? So
our entire training philosophy is to
train only on realistic data uh end to
end and the assumption is that sanity
checks in Carla because Carla does not
transfer at all if you train on it uh
can give a pretty good picture because
if you make good end to-end decisions in
the rest of the training stack if you
just pinpoint certain things and look at
if that works you can make some
reasonable assumption that the other
stuff works too. So yes, Carla is not
used for training. It is only used for
essentially sanity checks but the sanity
checks are very very useful.
Hey um in one of the slides you it said
that you were using PyTorch for the
training.
>> Yes.
>> Um and just now you mentioned about
distributed work and all that. Uh the
question is why are you not using tiny?
>> So tiny is incredible at inference on
the Qualcomm chip. Uh on open pilot it
is easier to compile models and they run
twice as fast as they would if we didn't
use tiny for training on NVIDIA chips.
Uh that is not true. So they're working
on it. Hopefully we'll get there soon. I
think the next step in using Tiny would
be to do inference in our cluster. Uh I
think there's a few more things that
need to be fast for training. But yeah,
basically it's just not fast enough
right now on our configuration of
hardware.
Another question.
>> Hi, really great talk. Um, have you uh
given any thought to what it would take
to do ondevice learning or transfer
learning so uh the device could update
its model?
>> So we do some level of ondevice learning
right now. Open pilot master learns the
lag of your steering interface. It
learns several things about the car. It
learns several parameters of the vehicle
controls. Uh that is some type of
ondevice learning though it's not deep
learning. I think that will evolve to
become more complicated and more
integrated with the open pilot model and
eventually there will be ondevice
learning but I think that's the state
it's in now and it's going to grow more
complex and it has been growing more
complex over the years.
All right, last question up front.
>> Thank you. Uh, do you plan to do full
uh, self-driving just using forward
looking cameras or are going to add more
cameras?
>> Right now, we're really not interested
in unsupervised driving. Like, we're
just iterating on a better supervised
driving product. I think the challenges
are exactly the same. So, from an
engineering standpoint, I don't think
this really matters. If there's ever a
point where the disengagements are
caused by a lack of sensor field of
view, uh, you know, it's just a matter
of making a different sensor suite. But
I think the hard challenges are are the
software, um, not not the sensors.
>> Thank you.
>> Thank you, Harold.
>> Thank you.
All right, please welcome to the stage
Mitchell. Mitchell is on our
infrastructure team and is going to tell
you a lot more about our infrastructure
and uh data sets.
All right.
Hi everyone. I'm Mitchell. I'm an ML
engineer at KMA and I'm going to talk
today about what it takes to build a
data set with a million miles of
driving.
So
the first question we should ask is why
do we care about this? Like what's so
important about the data sets?
Well,
you know,
a uh autonomy at comma, our team is in
the business of shipping neural nets
that drive your car. And a very wise man
once said that a neural net is nothing
but a compressed version of your data
set. In fact, I think we can be even a
bit more explicit than that. The neural
net is the data set. Uh and if your data
set's good, your neural net will also be
good. And so, uh you know, minus the
bugs in the training stack that make it
worse. Uh so if we want to train uh the
best driving models that we can, we need
a good data set. So the second question
we should ask is why do we need a
million miles? Like why a million? Why
not a thousand? Uh and the answer to
that is that KMA's data center has grown
over time from you know a 2017 we had a
little pile of servers. This is the
oldest picture I could find on our
Slack. uh to 2019 where our servers were
in a garage up to now where we now have
15 racks of machines about 200 servers I
believe uh with something like uh a
quarter of an exoflop. Uh so we're
getting up there. Uh we're still a few
orders of magnitude off the you know the
hyperscalers. Um but our our compute has
grown substantially over time and that
sort of presents us with a choice. Uh we
could train bigger models with all this
extra compute. We could train on more
data for longer uh or we could do a bit
of both. So how should we spend our
compute to get the best results?
Well, a lot of people have studied this
question over the last 5 years or so,
especially in the domain of language
modeling, but also more recently for
diffusion models. And uh what's been
found by and large is that you want to
do a bit of both. You want to train uh
bigger models with bigger data sets.
So you want to scale up both of them
together. And you can kind of see this
uh this is an old uh chart from an old
OpenAI paper. Uh every color line is a
different size of model uh data set size
on the x-axis. You can see over on on
the left side our data sets are small.
And the the big models and the small
models, they get about the same
performance. The big models just aren't
that much better. And then as we scale
the data sets, as we go over to the
right side of the chart where the data
sets are really big, uh the big models
keep getting better and better and
better and the small models kind of
plateau off. Uh so big models can take
advantage of all this extra data and
they can improve substantially. Uh but
if we want to train bigger models and
get that performance, we need big data
sets. So that's what we're going to talk
about.
So the first step to getting a big data
set is we have to collect some data.
Harold talked a little bit about this.
Um we're very fortunate that we have a
lot of people out there driving with
Open Pilot. Uh so we currently see just
shy of uh 7,000 daily active users. Uh
and we get uh I think this is wrong. I
think it's about a thousand daily hours
of driving uploaded. Um
now of course you know not everyone who
uh is is driving with Open Pilot is
uploading that data. Some people opt
out. Uh some people just never really
connect to Wi-Fi and other people are
driving on forks that aren't usable for
training. Um but despite all that, of
the roughly 30,000 devices that KMA has
shipped in its lifetime, we have data
from about 20,000 of those devices. Uh
so the majority of our users are
uploading at least some data. Um we uh
we currently get uh yeah, that's this
should be right. So about a thousand
a,000 hours of data per day uh out of
the 10,000 hours uh that people are are
driving with open pilot. So we get a lot
of data.
Um we can see you know not all users are
uploading the same amount. Uh the
distribution sort of follows a power
law. So some people are uploading a lot
more than others but that's okay.
If we look at a breakdown of our data,
we can see uh vehicle-wise, we got a
pretty good diversity across a couple
hundred different platforms, 35 brands.
Um, geographically, we're not doing
quite as well. We can see we have data
from about 70 70 to 75 countries, uh,
depending on how you count. Um, but the
overwhelming majority of it is still
from the US. So, we've got about 86% of
our data is still from the US. Uh
hopefully that'll become a bit more
balanced over time as we continue to
sell more devices internationally.
So what data are we collecting exactly?
Uh if you've worked with Open Pilot, you
probably know a bunch of this. Uh when
you're driving with Open Pilot, it's
recording data in one minute chunks. We
call these segments. And a segment has
uh a couple files attached to it. Uh we
have three video files because there's
three cameras on the device. So we have
the video streams for each of those. We
have a log file that contains all the
messages uh being passed around uh
inside of OpenPilot as it runs. And this
tells us everything we need to know
about the state of the vehicle, the
device, the control stack, everything.
Uh and then we have a quantized log file
that's about 20x smaller. So it might be
just a couple hundred kilobytes. Uh and
this contains just the very most
important messages uh that tell us for
example uh whether data might be useful
for training. So
we record this data and then we have to
upload it. So when Open Pilot connects
to Wi-Fi, like when you pull into your
garage and park up, uh Open Pilot starts
uploading Q logs to Azure. Uh so we
receive these uploads, we spin through
them, and we look for segments that we
think might be useful for training. Uh
we mark these segments and we request
the device to upload them. Uh so we're
going to ask it to to uh send the full
segment along with all the video files
and the full log file.
Uh so Athena D inside of Openpilot
receives these requests
and uh starts uploading the full segment
to our data center and then our data
center receives that data and copies it
all into our distributed mini value
storage system where it's going to live
for the long term.
So
at this point we have a bunch of data.
We've uploaded all of this raw data uh
from our users and now we have to make a
data set out of it. So uh we we have to
do a couple things at this point. We
need to decide uh how many segments are
going to be in our data set, which
segments we're going to use and uh how
we should split it into train in
validation sets. So we'll go through
each of these real quick. Uh the first
question, you know, how many segments
should we use? And you might ask, well,
we have all this data. Why not just
train on all of it? Like what's the
point of of not training on everything?
And uh the answer is you know we train
models of several different sizes at
comma uh we have the biggest models like
the world models that were very
interested in scaling to to uh large
sizes uh and then we have some other
models that are much smaller and you saw
from that chart earlier that generally
the small models can't benefit as much
from uh these large data sets. So you're
just training on more data for longer
and making your experiments all take
longer for no real discernable benefit.
So what we would really like is uh to
have data sets of multiple different
sizes. We might have a data set that's
like 10,000 hours, one that's 50,000
hours, 100,000 hours, etc. So we'll have
data set sizes spanning like a solid
order of magnitude or so uh that we can
use for different model sizes and
architectures.
So then if we're not going to use all of
the segments, then how do we pick which
ones to use?
Well, there's a couple different ways
that we could do this. The simplest is
just you know pick a random subsample.
Uh but we can do a little better than
that.
So uh you can see in this red shaded
area here remember this is the the
distribution of how many segments we
have uh for all of our devices. So some
devices have way more data than others
and that tends to have a lot of
duplication. So people drive the same
roads over and over again uh because
they're commuting to and from work for
example. Uh, and so this red shaded area
here, uh, with, uh, from from users with
the most data, uh, that may contain a
lot of drives that are less useful, um,
or or more redundant. Uh, and so maybe
we just want to shade from or or draw
from the blue shaded area underneath,
uh, which contains the vast majority of
the data anyways. And this gives us a
little bit more of a uniform
distribution across devices.
Maybe we want to uh unders sample US
data like we saw earlier. The vast
majority of our data is still from the
US. And if we're only going to pick a
subset, maybe we want to bias it a
little bit more towards international
data. Uh just so we're getting a a bit
more balanced of a distribution uh
geographically.
Maybe we want to filter out engaged
data. uh like for some types of models
like the final driving model, we don't
really want to train the driving model
to imitate the behavior of previous open
pilot versions. It sort of introduces a
feedback loop. So that's not great. So
at this point we may want to remove the
engage data from some of our data sets.
And then
uh at this point we may also want to run
experiments with different types of
distributions. So we may want to shift
it towards for example more highway
data, less highway data, uh more curves,
more uh situations that the model really
struggles with. Um this is the point at
which we can uh shift the distribution a
little bit in any way that we want to.
So okay, now we've we've decided what's
going to be in our data set. uh we make
some choices for all these all these
questions and uh now we have to decide
how we're going to split between the
train and validation sets. So the
training set is everything that the
model's going to see during training and
the validation set is what we're going
to evaluate on to decide if the model is
overfitting or if it's not learning
properly. Um so normally what you would
do is take like 10% of your data as your
validation set. But there's a couple
different ways that you can do this. Um
the standard way in like an image data
set would be you know you just take 10%
of your samples that's your val set. Um
but in our case you know well maybe we
could think about just taking 10% of the
frames out of the videos marking those
as the val set. But this is not really
ideal. These frames are way too
correlated. You can kind of see here on
the left is the first frame from a
segment and on the right is uh a frame 1
second later. It's a little hard to see
with the contrast, but they look almost
exactly the same. Like there's basically
no difference between these frames. Uh
and so if one of them is in your train
set and one of them is in your
validation set, you're you're just
training on test. Uh so this is no good.
This is leaking information into our
test set and that's going to make our
models harder to evaluate. So we don't
want to do this. These frames are too
correlated in time. So another thing
that we could think about doing is uh
splitting by segments. So we take some
entire segments and pulling those out
and marking those as the val set. Uh and
that's is this is definitely better. Uh
this is you know more like what you
might see as standard practice for like
time series data sets um where you pull
out big chunks of time and mark those as
part of your val set. But this still
isn't as good as we would like because
you can see for example here uh this is
a road uh that was driven by the same
driver several months apart. And you can
see again they're basically identical uh
where you know the driver goes under
this overpass and then makes a left-hand
turn. And so if one of these is in our
train set and the other is in our
validation set, well the model's
learning some things about what the
driver is going to do uh by uh by
looking at this data that's that's
duplicated uh in our test set. And
again, this is not what we want. So what
we'll do instead is we'll split by
device. We'll have some users be in the
train set and other users be in the
validation set. And this way we can
ensure as much as possible that we're
not getting any kind of duplication and
that we're uh really splitting our data
into clean uh train and val sets that
have as little overlap as possible.
So
uh specifically we we take about 6% of
devices plus all of the employee
devices. We put those in the val set. We
put everything else in the train set. uh
employee devices are in the val set
because we want our experience when
we're driving around San Diego uh to be
reflective of what someone might
experience with open pilot when they
pull it out of the box and use it for
the first time. So we don't want to, you
know, the the model to know all about
our commutes. That really wouldn't be
fair.
So okay, now we've decided what's going
to be in our data set and how to do our
train and val splits. And now we need to
get the data ready for training. We need
to process it a little bit. So uh what
what kind of processing is involved
here? Exactly. What do we need to do to
get the the data ready for training?
Well, the primary thing that we need to
do is run our localizer. So,
localization in robotics uh refers to uh
essentially figuring out where you are
and which way you're pointing at every
moment in time. So in our case uh what
we're going to do is uh take a segment
and we're going to run a calman filter
that takes in uh the GNSS accelerometer
gyro and some visual odometry from the
camera streams and stitches this all
together uh into a trajectory that that
uh uh recovers the the position and
orientation of the device on every frame
of the video. And you can kind of see
this visualized here. Uh again, a little
hard to see because of the contrast, but
there's a blue path uh that uh shows
exactly where the vehicle is going to
drive. Uh so this is the output of the
localizer. And uh this this particular
output is super critical. It's mission
critical for us. Uh it's required for
all of the models that we train, for the
world models, for the driving models,
for everything. Um and so we need to run
it on all of our data.
uh this includes the very biggest data
sets because the world model in
particular is the model that we're most
interested in scaling and we want to use
the largest data sets for. So up to the
very biggest data set sizes we need to
run the localizer.
Uh then we also have some auxiliary
outputs I guess you could say. Uh these
are things like lane lines. Uh the lead
car that's just the car in front of you
detecting any lane changes or turns that
might happen during a segment. Uh, and
these are things that tend to be a
little bit less mission critical. Um,
lane lines, for example,
um, are only used for display purposes.
We don't use them for any kind of
control. Uh, they're just nice to show
on the screen. Uh, lead car, we, uh, we
currently use that in chill mode. Uh,
but as experimental mode gets better,
that's also likely to become a bit less
important. And lane changes, same deal.
uh as uh you know as we move to the
future and potentially uh start doing
more work with navigation uh lane
changes may also become a bit less
important. Uh so these outputs are only
used by the final driving model. The
world model does not use any of these.
It doesn't know about lane changes or or
lead cars or lane lines or any of that.
Uh and the the final driving model uh is
generally trained on a smaller data set
because that model is smaller uh for a
couple reasons. uh we need to run it on
device but also there's a lot of factors
that govern the scaling for that model
uh beyond just making it bigger. Uh and
so making the model bigger is not uh
generally the way that we find is
easiest to improve that model. So uh
because of this the auxiliary outputs uh
we you know we run them on less data and
they they are a bit less important for
us uh in autonomy. And so I'm going to I
I won't focus quite as much on these
outputs for the rest of the talk.
Uh so now we uh we have our data set
ready to go. It's all processed and we
have to actually serve it to the
trainers. So what does that look like
then? Well, so we've got all this data
stored in uh in mini value. We actually
have a couple of mini value instances.
Uh you can kind of see the computers
involved over on the right side here.
We've got mini value raw in red. This is
the the cluster that stores all of the
raw data. That's the videos and the
logs. And then we have the processed
data stored in mini value SSD which is
called that for historical reasons. Um
that's over on the left side and uh
that's about 300 terabytes. So mini
value raw is about three pabytes. A mini
value SSD is about a tenth of that and
about half the bandwidth. So
when we need to serve the data this
would be like you know a pietorch data
set class that you're writing. uh we
need to load the data out from mini key
value. Uh for the process outputs, these
are basically just stored as uh as numpy
like mpy or mpz files. Uh so either like
a compressed zip or uh or just uh dumped
as a as raw numpy as raw bytes. Um then
uh the logs if we need those we can spin
through those just using the log reader
from open pilot the same tools that are
publicly available. And then we got the
videos which we need to decode. So,
we've sort of been talking around this
up till this point. Uh, but the videos
are are H.265 files. They're HVC and uh
we need to extract frames from these
videos in order to train on them. So, uh
we can't uh we can't do this in advance.
The when we decode the video, we're
decompressing the frames about 100x. So,
on disk, the uh the video file might be
something like 70 80 megabytes. Uh but
when we decompress it, it's going to be
like 8 gigabytes. So, we can't do this
ahead of time. we need to do it on the
fly. Uh we just don't have enough
storage space. So, uh we we need to
decompress. We need it to be fast or
it'll be the bottleneck for all of this
stuff. Uh and we need to do it for a
bunch of different things. We need to do
it every time we train. And we also
require the video frames for a bunch of
the processing stages that we'll talk
about in a sec. So, how are we gonna
decode these frames then? Well, when I
joined KMA back in 2020, uh we were
using good old FFmpeg on CPU, uh and on
a machine with like 24 cores, uh we were
getting something like 400 frames a
second of decode, which is pretty good.
Uh you're running lots of these in
parallel and uh that was enough
performance for the time. Uh but as our
models, uh get faster, we get more
trainers, and we we need more decode. Uh
that's that was no longer enough. So now
we would like to move the decode off the
CPU onto the GPU. Around 2022, we
started getting computers in our data
center with uh GPUs in them. And GPUs
have dedicated decode hardware that can
decode at like a,000 to 2,000 frames per
second on like a normal, you know,
consumer GPU. And uh so we uh we would
like to do this. The problem at the time
was that we just didn't have enough
memory to both run the models and do the
decode on the GPU at the same time. Uh
so we we got these really uh tiny little
uh like consumer GPUs. These are like I
think these are like $100 a piece at the
time, maybe less. Um and they have
almost the same decode performance as
the uh the larger GPUs that we train the
models on. Uh so we just stuck a bunch
of these in all our machines and used
these for decode and that got us like
again 2500ish
FPS per machine. But uh the problem with
these little GPUs is like they take up a
whole PCIe slot and eventually you just
want all of your uh your slots in the
machine to be for GPUs that are actually
running the model because that's kind of
the primary workload. So uh eventually
we want to kind of stop using these and
uh just run the decode right on the GPU
next to the model. So, thanks to some
slightly better memory management, uh,
we can just run everything on the same
GPU. And now on a server with eight GPUs
in it, we might get decode on the order
of like 15,000 frames per second. So,
that's not too bad. We've we've improved
quite a bit. Um,
so, all right, that's that's pretty much
everything that goes into creating a
data set. And with the the rest of the
time that I have, I want to talk a bit
about a case study of uh how our
infrastructure has changed over time and
how it's improved. Uh I remember when I
first joined KMA, as kind of a joke, I
stuck a sign on the door of the research
team that said Department of Magic. Uh
and I thought that was pretty funny at
the time, but uh uh really the research
team is not the department of magic.
It's the department of tools and
infrastructure. And everything we do uh
is really focused on writing better
tools and infrastructure because as a
team of like seven people uh on the uh
on autonomy like the only way that we
can continue to improve these models and
ship uh a better driving experience to
all of you is to make the tools and
infrastructure better and keep them
simple. So,
uh, this is going to be a, uh, a bit of
a case study of of what that looks like
in practice and how our our stack has
evolved over time. Uh, so
I talked a bit about the localizer that
we need to run. Uh, this computes the
vehicle trajectory across a segment. And
again, we use this for everything. Uh,
but we, uh, we need to run a couple of
things first before we can run the
localizer. So this is what our localizer
pipeline looked like when I joined in
2020.
Uh specifically
uh the things that are most important
are that we need to run uh orb features
and we need to run a segment. So what
are those? Why do we need them? Uh well
again the localizer is this calman
filter. We're taking in GPS uh gyro
accelerometer. But those sensors on
their own are not enough to give us the
kind of accuracy we need for the vehicle
trajectory. We also need information
from the camera stream. So one uh one
easy way to get information from the
camera stream is to use uh something
like orbs. Orbs are a classical CV
technique where you find key points in a
frame. Those are things like corners or
edges or or uh points that are that are
easy to to recognize and you track how
those key points move between one frame
and the next. And this kind of tells you
how the camera is moving with respect to
the scene.
So, uh, we can do this and you you can,
uh, see this in this middle picture
here. We're generating all of these
these red tracks that show, uh, how the
the key points are are moving as we're
moving through the scene. Uh, but the
problem here is that we want to know
again how we're moving with respect to
the static background. Uh, and there's
also all these other moving objects in
this scene like cars that are passing
us. We got a car in front of us. And uh
there will be key points on uh on these
moving objects and uh those key points
really really mess up our estimation. So
we want to get rid of those. We want to
filter those out and uh the easiest way
to do that is with a segment. We have a
semantic segmentation model that we
trained using the combo comma pencil
data set. Uh and
uh this this tells us like which pixels
are part of our car, which ones are part
of the road and which ones are part of
other cars etc. So we can use this uh to
figure out which pixels are are part of
moving objects on the road and remove
any tracks uh that get matched to those
objects.
So all of that is kind of a lot. Um
so we can see uh kind of all of what's
involved there. This was the state of
the localizer stack in 2020. And then in
2021 we launched the comma 3 which now
has two forward facing cameras instead
of one. uh and so that means that we
need to run the orb features and the
segment on two video streams instead of
one and that means everything is twice
as slow. So in 2021
uh it's again a little hard to see uh
but it took 85 minutes to run one minute
of driving data through the pipeline.
Now that's pretty horrible. uh like if
we uh if we do the math on that to
figure out like how long it's going to
take us uh we had about 1,500 compute
cores at the time that numbers for a
single compute core but even so uh to
run a million segments through the
localizer would take 40 days uh now not
only is that completely out of the
question but it also means we can't run
any more than a million segments like if
we wanted to run five million segments
that would take months so this isn't
going to work we need to speed this
So
what can we do? Well, the first thing we
uh we need to deal with is the segment.
The segment on its own is taking 60
minutes. Uh and a large part of that is
because it's it's running it was running
on CPU at the time like just just uh
using Onyx runtime. Uh and so like I
said around 2022, we started getting uh
servers in our data center that had GPUs
in them. And so first order of business
was uh we need to run the segment on the
GPU.
So uh step one was just move the decode
over. We already talked about that. Uh
then we want to run the segment on the
GPU as well. Onyx runtime has a GPU
backend for Nvidia cards. That works
great. Um but then we were running in a
in a fairly memory constrained
environment at the time and so uh we
could only have a couple of model
runners active at any given point. Uh so
that still wasn't great. So then we
switched to uh to Triton inference
server where we can batch up a whole
bunch of requests, send them to a server
that's got a couple model runners in it
and get the request back and write them
out to disk. And this way we can uh we
can have a lot more going on in parallel
and we get better performance. And then
uh lastly, we can quantize the F16. This
one's a no-brainer. Like we uh we were
running in in float 32 by using half
precision uh we can almost double our
our inference speed. So with all of that
considered, we can go from about 60
minutes down to 4 minutes for the
segment. So that's a huge improvement
already.
And uh with that change, we're now down
to 29 minutes to process one minute of
driving data, which again, that's a lot
better, but it's still not good enough.
Uh we uh we still need to improve
things. So next up is the orb features.
Uh the orb features are taking 17
minutes now. Uh so that's now about half
of the total time to process a segment.
So we need to we need to deal with the
orb features somehow.
So uh the orb features have a few
problems beyond just the fact that
they're slow. They're running on CPU. Uh
we can see from the video here that
there's a lot of uh of incorrect
matches. So this is cases where like a
key point in one part of the image is
incorrectly being matched to a key point
somewhere else entirely. And this gives
us all these outliers, all this garbage
that we need to filter out somehow. Uh
so partly because of that uh we need to
generate a lot of tracks. We uh uh so
this this image right here I think we we
have maybe like like 600 uh tracks per
frame. Um and then they're tracked over
multiple frames. So you' be like several
thousand tracks at any point in time. Uh
and partly because of that the uh the
localizer
uh is way slower than it it would be
otherwise because now this you know this
calman filter has a few thousand
additional inputs and that just slows
everything way down. So not only is the
local is the uh the orb features uh like
really slow but it's also making
everything else slow. And not only that,
uh, but the, uh, the segment is only
used in the localizer stack to, uh, to
filter out moving objects. So what this
means is if we could somehow delete the
orb features, we would get rid of the
segment, we'd get rid of the orbs, which
is the slowest stage right now, and the
localizer would be way faster.
And now the problem is we uh we can't
delete the orb features. We need some
kind of visual odometry because
otherwise the localizer just won't be
accurate enough. But what if we could
replace the orb features with like an
open- source visual odometry model? Over
the last 5 years, there's been a bunch
of really good ones. Uh models like
Lofter, Flowformer, Tapier. Uh just to
name a few, there's been a ton. And
these these models look great on paper.
Like the demo videos are super
compelling. Uh you can see the points
being tracked over time. The problem is
uh when we take these models and we run
them on our data uh it's it's not very
easy to see with these lighting
conditions but uh laughter is like
completely garbage uh in these low light
conditions. Flow former is like slightly
better but when you look at the the
tracks that are being output they're
still basically unusable. Um and the the
problem is these models uh just struggle
in a lot of real world conditions that
we see in our data set. And you can kind
of understand why when you look at the
data sets that these models are trained
on. Um like the largest data sets for
these models are like all synthetic. Uh
they're all generated with like a uh
traditional graphics engine uh like
Unity or Unreal or something like that.
Uh Kubric is a is one such data set
that's quite large from Google. Uh my
personal favorite is flying chairs. I
don't know if you can see it from there
but you can probably guess from the name
what's in it. Um so those aren't great.
And then even the data sets that are
based on uh real data like scanet and
kitty kitty is actually driving data. So
that should be perfect but it's all
during the daytime. Um and it's also a
fairly small data set. Uh like I believe
it just contains like a a a few dozen
hours of driving max. Um might be even
smaller than that. It's been a while
since I looked at it. Um so these data
sets are just not enough. Um, and these
models because of that uh really
struggle in situations where we need
them to work well. So if we're going to
make this work, we're going to need to
train our own model. And uh you know
that sounds great, but where are we
going to get the data? Like we just
looked at these data sets uh and if we
just train a model on those data sets uh
we're going to run into the same problem
as all these other models. So we need a
data set somehow. Where are we going to
get it from?
Well, the idea that we had was what if
we just train it to predict the orb
features? Like the orb features have all
these problems. Uh but most of these
problems are actually fixed if you just
have a model predicting the orb features
instead of using the raw ones. And
you'll see what I mean here. Um
so basically the setup that we want to
do is uh we'll input like a pair of
images uh that are uh just two adjacent
frames from the video and we'll ask the
model. But we're just showing a little
patch of the image here where we're
going to ask the model to predict
whether or not there's a key point on
each pixel. And then if there is a key
point, we'll ask we'll ask it to predict
how that key point moved between the two
images. So we're asking it how this uh
how this point in the image moved to the
next frame.
Uh and then using a loss function like
gausian NL or LLAS NL or something like
that, we can also recover an
uncertainty. So the model can tell us
directly how confident it is about its
motion prediction. And that's great
because the uh the localizer takes uh uh
it takes uh uncertainties for uh each of
its inputs. And so we can feed those
confidence uh uh outputs directly into
the the localizer and uh improve the
localizer pretty substantially this way.
So putting it all together, this is our
neural orbs model. And we can see that
uh right away there's way fewer of these
garbage features. Uh there's fewer
features overall because we just take
the very highest confidence ones. Uh so
that means uh we're putting fewer of
these features into the localizer. Um
and the model runs about 4x faster than
the old orb feature stage. So we've
improved this a bunch. Uh we get rid of
the segment. we'll we'll use the segment
to train this model and remove all the
the orb features on moving objects. But
then once we have that, we can throw
away the segment and we no longer need
it for the localizer stack. And best of
all, this change makes the localizer
about 5x faster. Uh which is crazy. Like
this uh this improves the entire
pipeline just from this one change. So
we can see this was the state of the
localizer stack in 2024. We got rid of
uh all these these uh parts that were
here before. The localizer is down to a
minute and 20 seconds. Neural takes like
3 minutes and 20 seconds. And the total
time is down to just over 5 minutes. Uh
we can clean things up a little bit
further even. Um we have this log
processing stage uh which was uh just
reading in the logs and writing out a
bunch of intermediate outputs to disk.
That's kind of silly. We can just spin
through the logs as we need them. So
we'll get rid of that. We've got frame
index and frame times, which is just
reading some metadata from the video
streams. Uh we can combine those into a
single stage that just does all of the
uh all of the metadata that we need from
the video and and saves that. So,
putting all of that together, this is
where we're at in 2025. We have uh one
stage to get the frame metadata, one to
get the visual odometry, and one to run
the localizer. And the whole thing is
done in four minutes and 50 seconds. So,
that's a big improvement.
We're we're booking right along. Uh and
the total data center throughput across
all of our servers now is just shy of
2,000 segments per minute. So what that
means is we can now process about a
million segments in 8 and a half hours,
which is great. Remember, we were at 40
days before to do a million segments.
We're down to eight and a half hours
now. Uh which I think is like 110x
improvement. So about 17x comes from all
of the changes that we just discussed
and then the remaining 6x comes from
just getting more servers over time uh
and and growing our data center.
But of course we're still not done. Uh
we can still make this faster and we can
have even bigger data sets. Uh so
there's at least another easy 2x speed
up on the table. Uh we can do the
decoding inside the Triton server. uh
because at this point creating and
destroying the the decoder objects
actually takes a pretty significant
amount of time. Uh so just by keeping
the decoders around for longer we can
make it faster. Uh we can use a faster
runtime like onyx runtime GPU is not as
fast uh as it could be. Uh torch compile
is like almost 2x faster if memory
serves. Uh we can quantize to in date
that's another uh free speed up as long
as we don't lose lose any accuracy. Uh
and then finally uh we could potentially
combine the neural orbs and localizer
stages uh into one since the localizer
is the only thing in our stack that
really requires these uh these visual
odometry outputs. So we could save
writing them out to disk and reading
them back in and that saves probably
another 10%.
So if all of that sounds interesting to
you, uh I'm I'm repeating uh what's been
said earlier, but comma is hiring. Uh if
uh if this uh this part of the work
sounds like fun, come work with us. Uh
do the hiring challenge and help us
build a 10 mile uh 10 million mile data
set uh to get the the next scale up for
our models. And uh that's all I got for
you. Thank you.
[applause]
>> Thank you so much. All right, we have
time for a few questions for Mitchell.
Any questions?
Great talk. Um, how does the left side
driving data uh affect the training? Um,
so we uh we explicitly detect left side
driving data uh just based on geography
and then uh we can use that to to have a
model that predicts which side you're on
just to to validate those. um it doesn't
affect things too much because uh in in
all cases like the localizer that you're
running is the same. Um so the model may
need to know which side of the road
you're supposed to be driving on but all
of the stages up till then are
completely agnostic.
>> Hi there. Another question.
Okay. So, you send back like a really
short like log for all the road
segments, but do you like on that look
for key features like hard braking, hard
steering, stuff like that? Be like,
"Hey, we probably want to get those road
segments back."
>> Uh yes. So, uh
the uh the uploading
uh we
we have some of that information in the
Q logs that we can scan through if we
want to. Um, currently we don't
prioritize uploads that have like, you
know, hard breaking or hard
acceleration, although we've talked
about doing this. This may be something
we do in the future. Um, but we have
quite a bit of that data in our full
data set. And so we can choose if we
want to train uh on more of that data or
uh to train the model to predict that
kind of thing. Uh, and so that we do do
a little bit of.
>> All right, we can maybe take one more
question.
Yeah, it's a great talk. Uh, one
question is, uh, previous talk had I
talked a little bit about the, you know,
change in the dramatic change recently
in, uh, uh, better engagement, uh,
higher percentage. Does that
fundamentally change how you decide to
choose segments that you want to keep?
>> Right now, it doesn't because, uh, the
differences are small. um like we're
seeing, you know, maybe a 5% increase in
uh in engage time, but potentially yes.
Um you know, if if we're at the point
aspirationally in the future where like
90% of uh all of our drives are engaged,
uh at that point, you know, we might
want to start to pull more specifically
from uh data where where the human is
driving uh just for that reason.
>> All right, guys. Mitchell will also be
available in the Q&A if you have any
more burning questions about his talk,
but we are going to keep it moving. Um,
next up we have Roba. So, thank you
Mitchell.
[applause]
I'm good. I think
Perfect.
Great. Good afternoon everybody. Um,
sure you've all seen my uh my title on
the uh the itinerary for today. It's
actually not the full title. Uh,
obviously after the launch everybody
knows what it's going to be about,
four. Um,
concept of shelves. It's quite
interesting. uh you don't really see any
other companies talking about this but I
think it's very important to share like
what happened during like the the the
process of getting into the the device
that we have now uh I would like to see
more companies do something like this
um so two years ago I also did a talk uh
so about hardware about manufacturing in
our office uh to recap that a little bit
because it's still quite interesting um
I talked about like this general like
flow of like how a product like comes to
be and gets into your hands. Uh where we
start from like a general like f of what
the concept should be. We go into like
first design stages. We prototype it. Uh
test to see what's broken with it. Um
then moves to production once like the
design's finalized gets to the consumers
and then we do the repair stuff. Um
so what I did what I talked about last
time was like okay so we get the the
PCBs in um we have like our own
manufacturing line. It's actually a
picture I took yesterday. Uh so all the
three axis that you guys have received
are all built on the this line you see
over here. Uh but we've recently been
setting up the second line which is
should be even faster. So hopefully the
the four axis will uh run off the line
as quickly as possible. Um so the puzzle
is solid paste. You put on the
components. You make sure that
everything looks correct and then it
goes into the assembly room um where all
the components are mounted onto the
board. And then it goes into the testing
rack that a deep and all of people have
talked about before.
Okay, that's a quick recap. Uh let's go
back to this. So last time I really
talked about like the second half. Um so
now let's focus on the first half. We
really start to dive into like how do we
get from the concept into like the
production design that you guys uh saw
today.
It always starts with a code name which
you call me Miy um and some wildly
optimistic uh thoughts. Uh if you can
read this, it's January 14, 2023. George
posted, okay, let's start with something
called the Comma Mini. Uh so it's
supposed to be small. I think we
achieved that. It's going to launch CES
2024.
I don't know if you checked our calendar
lately, but
almost [snorts] achieved it.
And really the concept back then was
like builds like the absolute bare
minimum thing that we could buy uh that
we could build. Uh that still gives you
like 80% of the value of the the the
main like 3x that we had back then. Um
and we we figured it would look somewhat
like this. Like it would look like a
stock Algass camera. Would maybe have it
be like passively cooled. It wouldn't
have a display because like we need to
display like a stock Alcast systems
don't have this. Um we wouldn't store
any training data. Uh we wouldn't upload
it back. So it didn't need any LTE. So
we could drop that. Um, we thought like,
oh, like Toyota back then was like half
of the fleet, so maybe we just only
support Toyota. We put like the Toyota
connector on there. Um, we increased the
wide the the narrow road camera um field
of view to make sure that like you
didn't need like a special mount for
like the the cars that have like the
tilted windshield. Um, and really like
minimize all the production steps. Like
if you think about it, like this is all
it really needs to be, right? Like it's
one like diecast metal piece. You place
on one PCB there. You have like the
other PCB with the cameras on there.
That's all you really need.
And I don't know if you like if you go
to this link, this is some other company
designed this and it looks so uncannily
like the thing we came up with back
then. It's crazy.
But then we we thought about it more
like having no display. I mean that's
that's really annoying, right? Like how
do you how do you set it up? Like how
you can't get this thing, you take it
out of the box, you put it in your car.
Like you have to like connect it to
Wi-Fi. Like you can't input anything.
There's no buttons. You have to like
make a good app. You have to support
Android, support iOS. We're historically
not very good at any of this. So we
thought like, okay, let's just put the
display on there. Um, from our
experiences, like getting a custom OLED
made like in the shape that you want,
that's basically impossible. Like if
you're like a Samsung and you want to
build like a Galaxy watch, all this
stuff is very easy, right? like you have
like you buy like a million of them, you
spend like a few million dollars,
everything works. Um, that's just not
really the scale we're at yet. On the
other hand, LCDs, they're a little
easier to like customize, but we've
we've tried this before, but like in the
3x stages, uh, like prototyping stages.
Uh, this is actually a picture of that I
p pulled from Slack where you can see
like, okay, we put this thing in an oven
for a few hours. These LCD panels are
really not made to to like withstand
like higher temperatures you would see
on in a on a car dashboard. Um,
and so this is also not really an
option. But fortunately,
we're looking around the markets and uh
we finally found a company that like
makes like a very nice tiny like little
AMOLED display. Um, it's like almost the
right form factor, right? Like you can
imagine like this is like this height.
It kind of like matches the the the
driver camera. Um the width is roughly
like what we would expect for the device
we wanted to build. Like this is great.
And the thing is you don't even have
like you don't want it to be square,
right? Like that doesn't really fit in
any device. Um but if you can just
replace the front glass, which is a lot
easier to customize, you can actually
make something that looks pretty nice.
And so that's the thought that we uh we
went on a little further. Uh contrast
isn't great, but I really had this
concept of this thing like maybe we can
make it look like a Mac Mini like with
like nice rounded corners. You have like
nice rounded display and it actually
kind of looks like the comma 4 we ended
up building.
And thinking about it a little more,
it's like okay like if you already added
back the display, why don't we just make
it better than a 3x? Um if you just add
back LTE, which can't be that hard, uh
we add back OBDC so we support all the
cars. So there's really no drawback in
having this device versus uh a comma 3x
and instead of calling it a comma mi
let's just skip that 4. So just build a
new flagship that's great. You don't
have to support like two different
product lines. Um this is going to be
amazing.
So once you have this concept um I mean
that's all still in like magic land like
everything everything looks great on a
computer screen like it obviously
doesn't drive your car. So you want to
get something driving as soon as
possible. That also means that you have
like a product you can hand off to like
uh for example the open pilot team so
they can start working on like the UI
like how does this thing look like in a
car? Can I uh design like an interface
that like works with this probably uh
possibly um like very well. Um
and you can also like test out the
different refactors you want to do in
the electronics. And so this is
something that we really thought about
and we really tried to optimize like the
first prototype to be driving as soon as
possible. Um,
and most of the important things, like
one of the most important thing to get
something driving as soon as possible is
you really have to select like which
processes you're going to use. Like you
don't want to do anything fancy that
would take like months of lead time from
like different companies uh or something
that like only one company in the whole
world can do. You really want to stick
to like the basics like 3D printing for
the case. Uh, or if you want to do a
metal case, you just have it CNC
machined. Like that stuff is all super
easy and you can get a ton in like hours
or days.
the electronics that's a little easy a
little less easy than the mechanical
parts to speed up. Uh because if you
want to put something like a Snapdragon
845 onto a PCB, you really can't do that
on like your standard like JLC level
four layer PCB uh which they produce in
like a week. But you really have to step
up to like an eight layer board which
has like FAS that don't run all the way
through through the board like from like
for example like layer three to layer
four. And these things like they take
weeks and weeks to produce. It's not
even just production time. Like these
things, they actually take six to seven
weeks to produce, but they also take
like three to four weeks to even just
like design and route out. Like you
don't want to do like 50 revisions doing
this because you'll just be stuck for
years.
And then for the other parts, like if
it's not broken, like just don't fix it.
Like just take parts that already work.
Like from for example the 3X, we already
had a heat sink that worked. Uh and just
like stick it on there. Like this is
also u the board that we designed for
the 3X. um which has the 845 already on
it. So we fig like oh let's just reuse
this module get it on the first
prototypes and it'll be driving like
immediately
and that's exactly what we did. So uh
from the time we started the design we
had PCBs ordered in 9 days and then
after 30 13 days after that we had the
first thing booting and so that means
that we could hand it off and get like
all the all the development teams start
working on uh on software [snorts]
firmware that kind of stuff and only 3
days after that we got the first one
driving in a car.
Now I do say driving um it did drive but
the screen is still black.
It's like obviously like prototypes make
mistakes. The screen didn't come up.
Like every time we plugged in a screen,
we see like a puff of smoke and be like,
"Oh, something's not right." So,
the connector was on mirrored. I mean,
it happens. You only make this mistake
once, right? You just design a small
PCB. You don't want to respin that that
rigid flex board because it also takes
like two weeks. You just make like one
simple two-layer PCB. You get that in
like a few days, the display is up,
everybody's happy.
So that's kind of what this board looked
like. Uh
I mean it worked. I posted it to Slack
and then uh in the same vein that Shane
got the the feedback from a deep saying
like oh this should only be 10 lines.
This feedback was immediately that looks
like way too much stuff.
I kind of agree like in the end product
you see now like at least 25% of the
components on here are just removed like
refactored out completely. like we got
the the STDM to do like the audio codec
stuff. Uh we replace the beeper with
like just driving the beeper signal
through the the speakers. All the stuff
that just you don't need and you just
reduce complexity uh massively this way.
Okay, so we had the S prototype driving.
I mean that's obviously not something
you can just refine on and ship. So we
really had to think about like okay what
is this device going to look like in the
end? Um,
and the main driving factor for that is
like what is the case going to look
like? Like you can't design like this
complex PCB and then change the shape
because all the components move and you
have to move all the traces that just
every time you do like an outline change
that takes like weeks to uh to
materialize. So we thought about a
little bit and I like my Mac Mini
design. Uh there were a lot of people in
the company that didn't quite agree and
one uh morning I woke up and I got like
this image. I don't know if you can see
it very well. This is like
like Play-Doh mashed together into like
a potato chip shape. And they were like,
"Yeah, just it needs to look organic."
Like, "Oh, okay."
So, I came up with something that looked
like this. I got really into like the
fusion design tools to like make organic
shapes and stuff. It's really nice. Um,
Eigor, our mechanical designer, did not
agree. Uh, so we completely threw that
out of the window. And also, like if you
try to fit any components in this, like
the curves just don't really work. like
anything you want to put in there is
square. It just doesn't fit. And so like
we botched it out a little bit and like
you could kind of like start to lay out
components like uh we saw like okay like
this is going to be like a nice diecast
aluminum case. It's going to be
passively cooled. Um so but like in some
cases you might want like a little bit
of like active cooling. So we fit in
like this blower fan like get some air
moving through the case. Um we laid out
all the ports that we needed. when you
laid out the camera bar, uh the LTE
module, the speaker, all that stuff, it
kind of fit. And so, um
after a few more iterations and design,
uh we came up with this, which is the
the RAV A case. Um as you can see, like
it's still like supposed to be made out
of metal. It's still diecast to like get
the passive cooling working. uh you had
like this big surface that would like
the 845 would heat sink into distribute
out over the whole surface and then
would just like mostly cool itself
passively and be quiet.
I kind of proved this out as well. It's
like I posted this on Slack uh a little
after that and I like made like a very
simple mockup that we could simulate
where we dump in like the six watts or
whatever the 845 outputs and I said like
okay if you have like 25 C air and move
up roughly 1.2 into meters/s uh over the
surface from like natural convection and
like car like air currents moving in a
car. This should just work. Uh turns out
like both of these assumptions are
completely wrong. There's no convection
in a car. Uh the force cooling never
hits the windshield. Uh it's never 25 C.
The air next to the windshield is so
hot. It's uh this was completely off.
But anyway, we didn't know that at the
time. So, we started laying out the RAF
A. Uh, we put this nice big hole in the
PCB where like the blower fan could sit
on the other side. It could suck in air
and then exit it at uh through the
through the top. That seemed like a good
thing to do. Uh, we like had some
trouble like laying out all the
components on the board. Like, it all
kind of fit. We got it to work.
We put that into like a flow simulation
like, okay, it pulls air from the back.
You can see like it moves like under the
PCB. So, it moves over the aluminum
surface to cool. It pulls it up through
the blower and shoots it out to the
front. We're like, "Ah, that might
work."
So, we routed it out. We sent it out and
that was our rev of the MCI.
Of course, as I talked about, this is
already like the the high uh complexity
PCB like an high density interconnect
PCB. So, it would take like six to seven
weeks to produce and we didn't really
want to wait uh on those seven weeks
before we could start stuff like
mechanical design. Uh, so what we did is
actually we just took the top and the
bottom layers of the PCB and we just
sent it out as a two-layer PCB. So it
looks and functions exactly the same
mechanically, but it's there's no traces
in there. Like it doesn't do anything,
but it's still very useful because it
mechanically it's it's completely
equivalent. And you can get this in a
week. We didn't make one mistake though.
Um,
usually the stuff that we intend to work
we make black because that that looks
the nicest in the case. where you think
like ah if we want to be mechanically
equivalent, we'll also make this black.
Turns out you just can't tell it apart
from like a real PCB anymore. So I
predicted back then like like how long
is it going to take before we're just
going to waste like half a day trying to
figure out why this thing doesn't boot.
And um it didn't take very long.
Okay. So once you got the the real the
Mi Rev APCBs in, it only took a few
days. We got it to boot. So there was no
like fundamental big issues. Uh except
like the cameras didn't work and the
display was still black.
We we did it again. [snorts]
Uh this time it was like just 180
degrees. So
oh well.
After fixing that though just a few days
later we have the first actual drive of
a Mi in a car. Um Mi Rev August 22nd
2024.
Okay, it's almost up and running. Like
it kind of drives like we're nearly
there. It will ship in like two months.
It doesn't. Um,
of course, Rev A, you make all these
like tiny mistakes. We track this in
GitHub. We have just make like a big
list of all the things we want to
improve for ref B. Uh, nothing too
spectacular in there. Like looking at
the thermals of that first drive, which
you could have seen like this was like
the sun was already setting. It wasn't
very hot out. It was like the the car
was like nicely cooled and aced. The
thermals of the CPU, they just kept
rising through the whole drive. Like it
just didn't really perform passively
like we we thought it would. Um
and so we we thought like okay um let's
dive into the first principles, right?
like uh you have this 845 processor that
we get from Qualcomm that's sold to a
PCB and then for because it's usually
used in a phone that very like space and
uh power efficient to put the RAM like
right on top of the chip. So it's
actually like a chip you sold on top of
another chip which is great in phones
where you have like very bursty loads.
You don't really care about thermals all
that much like with sustained loads of
open pilot. This doesn't really this
really limits like the the thermal
interface between like the die that
actually produces most of the heat and
like the heat sink you want to put on
top of it. Um the 3X we didn't
optimize this all that much. Like what
you basically have is just to put the
heat sink on the top. It just mostly
flows out of the top and it's like
mostly fine. Um but then we also figured
out like this PCB is actually like eight
layers of copper in there. There's a lot
of interconnect. So, it actually like
thermally decently conductive. So, what
if you just also cool from the bottom?
Turns out that Qualcomm actually
publishes
pretty good high fidelity like thermal
models of their ships. They can just
simulate this. And turns out like you
could get at least a third of the heat
through the PCB out of the bottom. So,
that's already like an easy like 33%
improvement that you just get for free
if you design this in. We also validated
this. Uh, so this is what we called the
the shot glass test. We just got a
copper shot glass filled it with water
and then if you run a constant load on
the CPU you can see you can just like
measure the difference between CPU cores
and the water temperature. If you div
those you just get a flat line and it
gives you the exact temperature
difference from this actual CPU die that
you're trying to cool and the uh ox uh
environment. That's the best you can do
in this setup.
And it's like it's still not really good
enough. Like is there anything else we
can do? Like you can see this like big
air gap here, right? Like it's in
between the balls. It's on the top of
the processors. And like air is not very
conductive. Everybody knows this. What
happens if you just add some epoxy in
there that's like somewhat thermally
conductive? It just fills all these gaps
in and just it really improves thermals.
Like this change alone like improved
thermals by at least like 1 C per watt.
Um which is pretty massive in the the
things we tried to optimize. And as an
added bonus, because it's epoxy, it also
like mechanically bonds the chips to the
PCB and that greatly improves
reliability.
So this is kind of what it looks like.
So this is actually this is not an chip
you're looking at. Uh this was a chip.
It's underfilled. And then you just
mechanically like break it off and you
can see like the epoxy filled like all
the empty space uh next to the bins.
Another issue we found on the the early
Mesis is it's a metal case. This metal
is at like 50 or 60 C. If you touch it
like
it's not good. It burns your fingers.
The device is still running fine
thermally, but like it just it it
doesn't really feel like a high quality
product and like it's just not something
we wanted to ship. Um we tried to
improve it. I made like this cyber mi
design which I thought looked kind of
cool. Like team wasn't very convinced
either. Um but if anybody like wants to
make this, I'll buy one. Um,
so we still have the metal case back
there
and like this is also validated in the
plots where like we didn't realize this,
but a lot of the heat input actually
doesn't come from the electronics
inside, but it comes from just the sun
like shining down onto the device. Like
especially if you drive around in
California and or like the the lowest
states in US, you could see like like
one of these is case temperature. That's
case temperature. It just keeps rising
and rising and rising. It doesn't
dissipate into the the the air. The case
just gets way too hot. It's just not
very good. We simulated this uh so we
made like a small little fake windshield
with a device on it. We had like an IR
heater that like we got to somewhat
match the sun output and we couldn't
really get the metal case to work.
So, let's just Okay, let's just cut our
losses. Let's just redesign it
completely. Um and instead of dumping
all the heat into the case, we know we
can extract like 66% of the heat out of
the top of the chip. um which we could
then put in like a a nice uh heat pipe
with like a fin stack that we would see
in like a laptop. We simulated this that
seemed to kind of work.
So we got that made. Um
and we stuck with this design like all
the way from ref C to ref. It it caused
so much problems. Um so one of the
issues you have is that you really need
the surface contact between this plate
and the 845 to be um as flat as
possible. So, we designed this to be um
on spring screws. You can see in that
picture like the spring screws are way
too big and nobody really makes the
smaller ones that we needed. So, we got
custom screws made. Okay, custom screws.
That looks a lot better. But then like
the fan standoffs, like do you want
really want to put like all the screws
in and like it has like little like
capped on labels on there that get
everywhere in production. So, we okay,
we designed custom standoffs for the
fan. Um,
we figured out like, oh, we need to
optimize the intake path. So, then we
added like a big hole in the front of
the case. We put like an extra fan on
there and it just turned into this whole
big mess. We even came up with this uh
monstrosity at some point because we
figured out that like one of the fin
stacks just wasn't quite long enough to
like be super efficient. So, we like
doubled the fin stack up. Uh, we added
backside cooling. We added a fin stack
in there. it just
it just didn't really like we could kind
of get it to work somewhat on a 3x level
in this form factor. Um, but also right
around this time, we figured out that
the GPS performance wasn't actually
quite what we hoped for. Like if you
look on this graph, like the bottom
line, that's the horizontal accuracy
that a 3x would get on a route. And the
one on top of there, that's one of the
early production me uh early prototype
mees that we built. And it's it's just a
lot worse.
So that turned into a whole thing as
well. Um,
one of the most annoying things is that
the 845 because it's like it has so many
subblocks and it runs at so many
different frequencies and PLLs that it
outputs harmonics basically like in the
whole broadband spectrum around GNSS.
Um, so you really need to shield it like
on the 3x it's like nice. It has like
its own shield. It's like doed by the
heat sink like that kind of works. But
for this, yeah, I mean, we designed in a
shield that helped a little bit. Turns
out like the the heat pipe because it's
not mechanically connected because on
spring screws, it's not grounded enough.
So, we like tried grounding that. That
kind of helped. We covered up the whole
thing to like cover any holes. That kind
of helped a little bit. Then we had to
add like shield like a foil under the
holes. Another small improvement. We had
to add like a bottom side shield.
it just turned into this whole thing. At
some point, we even got like production
versions of like the the shields that we
would like get the machines to solder
onto the boards. Um because they're like
an awkward shape, they like would bend
and like warp in production. And then
sometimes like not all the edges would
get soldered so that it also like become
became somewhat flaky.
So we ditched that and we went to like a
full like unibody copper thing that sat
on top of that like sacrificing some of
the thermal performance for RF
and still you would get like plots like
these that didn't quite match um what a
3 or 3x could do. Another issue for GPS
performance that we had was that some of
the signals that are just like happening
in the device like driving the display
or like driving the cameras, they cause
they're at certain frequencies that are
like if you multiply them by um an an
integer amount, you would get harmonics
that are right in the center of GPS
frequencies. And GPS is an extremely uh
uh low um low amplitude signal. Um so it
gets drowned out by basically anything
that's that's even close to it. You can
see this on these plots like uh Maxim
wrote this very nice piece of software
that would like turn off the screen,
turn the screen back on, turn the
cameras on, turn the screen back off.
And so like from this graph you could
see like okay the screen has a big
effect, the cameras have some effect
and some of these you could just fix
with software like we just looked into
like the display code and we could
change like the frequencies the display
was running at. We changed like drive
strengths of certain like regulators and
the 845 firmware. like it just it turned
into this whole hassle to get something
to like barely work. Another thing uh
limiting GPS was just that the antenna
was on like the edge of the board and
the antennas like these patch antennas
are not designed to do that. Like
they're designed to be in like a perfect
vacuum with like a nice 10 x 10 cm
ground plane that's like very nicely
centered which is just not possible in
the the form factor that we were
building.
This is another RF plot. Um this is
because the antenna's on the edge like
you want this blue trace which is what
you measure. You want that to be in the
middle to like be more efficient. Won't
bore you with all the details but that's
uh that took a whole bunch of like
optimization as well. But that then
changes like the resonance frequency of
the GPS. So then you have to go to like
brute force all these values. This took
literally took months to get something
that's like barely on the level of a 3x.
But in the end, we kind of got there
like on rev f.
We got to like something that somewhat
matches a comma 3. Um,
and it's okay. It's maybe barely
shippable.
But if you just zoom out a little bit,
we had this RAV F that like barely
worked thermally. We had barely working
in a GPS.
The case was still metal. It would get
like uncomfortably hot. uh eat the fan
at the run now because we didn't
passively cool most of the chip anymore
which is kind of whiny. Um the shielding
is like there's a lot of custom
components like barely make it work. Um
and we just came up with just we'll do
one more redesign and completely solve
all the in the uh issues like just
fundamentally
and that's how uh Rev H came to be and
that's remarkably close to what we are
actually shipping now in Revi. So it's
as you can see it's like a complete
redesign again like the 845 moved back
to the bottom side of the board. Um we
ditched the big fan hole for the blower
which allowed like a lot more space to
lay all the components all very nicely.
Uh this also added the space to like add
this exposed ground path so you can have
like a shield that fits nicely on top of
it. Um the shield could also be like the
heat sink we figured out. And then from
the backside cooling, it turns out that
you can just have a copper plate here
and that's high connectivity enough to
like just conduct that through the posts
back into the bottom heat sink. And this
just turned out beautifully. Even the
GPS is like no more no somewhat more
central into the board. And that just
fixes so many things.
This is the you've already seen this,
but this is the heat sink design we came
up with. This is also the integrated
shield and it just
is great.
After that, we still did a whole bunch
of experimentations um on the input
design, like the airflow input design.
Uh a lot of these had trade-offs between
like noise production and thermal
performance and looks. Uh so we we
literally built like hundreds of these.
Um the team also optimized the thermal
design on the heat sink side. So, it
turns out if you add like a nice little
cover over the heat sink to not
recirculate air and also to cover the
sides of the fins, uh, you would get
both better thermal performance and
lower noise profile or at least like
shift the frequencies away of the noise
profile so you barely can't hear it
anymore. And that was a massive
improvement as well. Even more intake
designs we tried uh before finally
ending up with what we're shipping.
And thermally, this is what we ended up
with, which is honestly quite
incredible.
If you look at this graph, like the blue
line, that's the comma 3x. So, it's
running a constant like six watt load.
Um, and then we just sweep the fan
power, wait until it settles, and you
just see whatever the the CPU
temperature ends up in. Um, that's, you
know, the threeaxis, it works pretty
well, but it's normally not the best
thing in the world. Um, so in Rev F,
like the final design that we had, like
if you run the fan like at 60 70%, you
could somewhat get close and it's
probably good enough for what we wanted
to do. Uh, and then if you go back to
like this abomination with like the the
heat sinks on the back and like the
extra fin lengths and stuff, you could
get it to be somewhat better than a 3X.
Uh, that's the green line. And then the
Rev H design. U, [snorts] I mean, that's
obviously that's in like a league of its
own. like even at like 30% fan, it just
blows the 3x out of the water.
And this obviously also translates into
driving performance. Like this is just a
log app from like a route that we drove
on the Rev H. Um like loaded while
driving like regular open pilot load the
CPU barely like uh dips above uh 50C
which is quite incredible.
uh because it's also under the 75C that
we try to control the temperature at
this the fan was basically not running
at all.
And then for GPS performance, I mean
that doesn't look any different than a 3
or 3X. So we also completely solved
that.
Of course, like you can't do all the
experimentation in house like all the
the like the test setups you build like
you're only testing like one device. You
test it for like one time. Uh but if you
wanted to get some data on like what
this thing would perform like in the
field like what are the the 1% failures
uh uh uh like then you really need to
like just get so many driving hours on
this thing. And uh we had this nice
group of people that we trusted to not
leak the the device um that we sent some
devices to. They got like the the unbox
experience. They got to test the UI
provided a whole bunch of feedback. They
racked up tons of miles on this device.
Um, which really makes it us confident
that it's it's a very solid uh design.
Other than that, we have uh testing
infrastructure from the other teams as
well. So, I already showed you this.
This is like a testing dashboard that
Maxim from the Open Pilot team built,
which is very valuable. It just shows
like every MECI drive of every day. And
you can just look at like all the
sensors that we have in the device like
see if there's anything wrong that you
don't expect. Um this slide is somewhat
that outdated apparently but it's we had
that's like the amount of segments that
we got uh driven around FH Revage. And
then we also had like the green check
mark every day from the autonomy team
which basically meant that okay all the
data all the logs that we gathered from
the device were actually trainable uh
which also is a very strict check to
make sure that all the sensors and the
cameras and stuff looked good.
After you've done all of that you're
still not done. Uh you still need to
send it off to certification. So they
put in like this big anacic chamber. You
run your standard open pilot u loop and
then they just measure like whatever RF
frequencies come out of it. The limit is
red line. Um
this stuff that's all noise. That's all
like the cabling and the power supplies
and stuff. So you don't really look at
that. But like look at how flat this
line is. Like this is basically just
background radiation. Like the shielding
we did on this thing is just incredible.
Like there's I haven't seen any other
device that looks like this.
We also went to Shenzhen. I think a deep
show already showed some of these
pictures. Um this is invaluable feedback
like this. So uh I mean this so valuable
that uh you can see like how the
processes are being done. So you can
like incorporate this into like the next
revisions like make sure that that it's
super easy to uh to produce. You don't
get any defects in between batches and
stuff like this. Um like in the right
that's like the the general flow of how
they produce like a a MC heat sink or
comma 4 heat sink where you start with
like the extrusion they mill few steps.
It's just so valuable to know how all
these things do.
That's not only the device performance
that improved quite a lot. It's the
complexity of these things. It's just so
much reduced uh from the 3x. Like I went
through like the the the lists that we
have and like the unique bomb items like
the bill of materials on this thing
that's almost dropped in half from the
3X. The amount of process steps that we
do inhouse like the assembly steps like
focusing lenses um sticking on tapes
like plugging in cables and that stuff
that's literally have and the amount of
custom parts where we actually design it
instead of just buying it off the shelf
from different vendors that has more
than half. So this is uh quite an
incredible achievement I think.
If you don't believe it, then it's way
easier to build. We have a booth over
there. Just go up to it, take like take
a look at the components, put one
together yourself. You don't need any
training. You can literally do it in in
a few minutes.
So, I think that's uh concludes most of
what I wanted to talk about. Um I think
we finally got to a design that we are
that's worthy enough to be called the
comma for.
That was it.
>> [applause]
>> Thank you, Robe. We have a couple
minutes for questions. Any questions for
Rob?
>> Do you guys um do any formal vibration
testing or is it just relying on the the
ones in the field is working?
>> We mostly rely on the field for that.
Yeah, we we've thought about like making
like a vibration setup, but we haven't
just gone around to it to uh figure that
out.
>> You know, just like you have um the SMT
line in house and that really helps with
iteration speed. Would you ever consider
bringing like the machining in house or
molding injection in house?
>> Absolutely love to get CNC parts like by
the end of the afternoon that would be
amazing.
>> Okay.
>> Um [snorts]
the office that we have now is just not
quite set up for it yet. uh like we
would need like like a decently sized
like actual uh factory building for this
but hopefully in the in the future.
Yeah.
>> I try to fit as much in our office as we
can but sometimes that's a stretch.
>> Uh h how do you find your simulation
tool relative to the testing that you're
doing? Is there any opportunity that you
get to improve the simulation tool
you're using? it I'm already had this
conviction that I'm I'm getting more and
more convinced that like most of the
simulations we do are just not very
useful. Like
like you've seen this, right? Like we've
simulated so many things that you just
even if you like get like one very small
detail wrong, the the the conclusions
that you you derive from this are just
they're just not useful. Like just spend
like the two days build a thing in house
and just test it.
Is moving to Ray Lib and CPU rendering
going to make a measurable difference to
your kind of steady state CPU load
temperature?
>> Uh hopefully, but I think uh the problem
is like every time the Open Pilot team
makes any improvements on this, it's
just all eaten up by autonomy again. So
just run bigger models.
All right. Thank you, Ro. Um,
you have to stay on stage though, I'm
afraid.
>> All right. I would love to invite the
whole team up to the stage for a Q&A.
I'll do some yoga.
>> All right. Do we have some questions in
the audience?
Oh, you've already gotten all your
questions out.
>> I don't even know who I'm directing this
to. Uh, I'll pick a deb crystal ball
time.
when uh Best Buy.
>> Uh
oh, there we go.
>> Uh I I think we got a Let's see how it
sells on the website. Uh the Best Buy is
I don't know if we want to sell to the
Best Buy person. The thing about the
Best Buy stuff, um the Mei we like to
say the M and Mei stood for mother. Um
in that it's ready for your mom. And
it's not that we want to actually sell
it to your mom. Um it's a way about
thinking the limit. Um, another thing I
talked to the hardware team about is the
$99 MIC. It's like if we had to have the
cost of this thing, you're like, "Okay,
I'm paying $4 for the cable, $12 for the
box, and then you start adding stuff up
and then you're like, wait, this is a
pretty significant percentage of my
thing." So, it's a way about thinking in
the limit. Um, we'll see if Best Buy is
that relevant. Um,
I think we're still a bit ways from
there, but uh, it's the first product.
You know, we had a nondev kit, we had a
product, um, we had a bunch of dev kits.
Um,
>> maybe 6x We'll see. We'll see how this
one sells.
>> Okay, we've got one back here.
>> Hey everyone. Uh, I just want to say
first of all, amazing work with KAMA and
to you guys to the people in the past.
Um, I had a question for the ML team. I
guess is in the diffusion space. Uh, one
of the questions I had is when you
generate the videos, are you generating
them two individual videos and then
combining them or are they one world
space model that you're generating
together? Uh, because the fact that
they're both consistent really like was
sick. So, I was just curious how that
works.
>> No, we generate them at once. Our
compressor takes in both frames and
compresses both of them in one latent
vector. So we the ward model generates
uh both frames at the same time. That's
why they're so consistent and uh uh
there was a question about adding more
more cameras in which case we'll just
add them to the compressor and they will
all be compressed in one in one in one
latent space and they all get generated
at the same time. That's how you get uh
consistency in the dynamics and
consistency in in the in the scene. Yep.
So all at once.
more questions.
>> Ask us anything.
>> We like talking about this stuff.
>> 1.0
>> 1.0.
>> Yeah. Why it's zero?
>> Uh,
>> yeah, we used to have all these uh kind
of goals for this stuff. We've kind of
simplified it. Um, we just shipped 010.
010 was defined by the uh what we call
the Tomb Raider architecture, which used
some of the new simulator architecture.
We'll ship 011 which will be the full uh
if anybody's driven the watermelon
models that's the full world model ones
and then 1.0 will be ant10 long is in
chill mode. Um yeah
>> I was just curious how have you kept the
team so small over 10 years it's still
great output
>> refactoring. Uh so we have a few teams
we can go team by we we can go team by
team. Uh I can talk about uh hardware
and production and open pilot and then
uh maybe Harold can talk about autonomy.
Um production I'll show you we refactor
the product. Um, you know, we refactored
the product, we refactored the space.
Um, we designed them together. Um, the
factory is the product. Um,
the hardware team has grown a little bit
um with this product. Um, it really
didn't get out the door until we grew
the team a little bit. Um, the fact that
it's so quiet was uh one of the big
contributions from our new members. Um,
beautiful design uh was uh Nick.
And then the the software team hasn't
grown as much, but that's uh uh we'd
like it to grow a little bit. Uh, we'd
like to ship a beautiful mobile app. Um,
I'd love to ship fast boot times. I'd
love to ship a new updater. I'd love to
ship tons of software stuff. Um, but we
don't have to grow that much. Um, we
really just focus on
uh the open pilot you get should be like
some second order effect of uh
the kind of
infrastructure that we set up. Um, so we
spend a lot of time on that and it's
it's about being really focused. You
might see us like recoil a bit when
somebody asks cameras or carports or
this kind of stuff. This is part of it.
Yeah. Um this focus.
>> Um yeah, I think the general answer is
just managing complexity and staying
focused. I think one thing that I really
like is something George brought up a
lot is that uh the management boundaries
in your company are generally reflected
in the codebase API boundaries. Um, and
so it's really important to refactor the
team to make sure that the API
boundaries in the code also make sense.
And I think one example of this is that
we used to have somewhat distinct
boundaries between controls and the
machine learning policy. But these
things are very intertwined and having
those things be two separate teams and
having essentially both a people and a
code boundary there made that there was
a lot of inefficiency. Both teams often
just blamed each other on oh this is a
controls problem, this is a model
problem. But I mean it's really
intertwined. It's usually a combination
of those things. So then refactoring
that into uh this all being one joint
problem just controlling the car I think
reduces a lot of the code complexity and
then also allows people to make better
improvements without uh you know
bloating uh the software and and
creating more overhead. And I mean you
know my talk was kind of about exactly
this problem is how do you how are we
able to develop quickly? how to be able
to ship improvements quickly and making
sure that all of the infrastructure and
stuff is in place there and it's
basically the things I talked about in
my talk is right you have really good
tests really good infrastructure and uh
you keep it all simple enough that
everyone kind of has oversight this
entire thing is managed by you know
including the data center all the tools
everything is managed by you know five
six people u so I think that keeps it
simple
>> I forgot something big actually
>> George
>> oh sorry I just want to shout out our
community um obviously we have tons of
contributors on GitHub it's open source
Um, you see a bunch of them over there.
There's a bunch more in the crowd and
there's way more on GitHub online. So,
big shout out to the contributors.
[applause]
So, uh, I mean, Kama has a mission of
solving self-driving cars and delivering
shippable intermediaries. And you have
to ask the question for a lot of these
large companies what their mission
really is. And a lot of these companies
mission is to pump their share price.
And investors haven't quite caught on
yet, but one way you can make your
company look big and important is by
hiring lots and lots and lots of people,
right? Look at these. We have a thousand
people.
You [laughter] good?
>> We We have a thousand people. Wow.
That's a legitimate team.
And until people with money just
completely stop funding this kind of
stuff, you're going to see it. But the
reason we're small is because our
incentive is to solve a problem. The
reason they're big is because their
incentive is to raise their share price.
And investors see big company, big share
price. Oh, yes.
>> Got a question over here.
>> Uh for the C4 and the 2-year warranty,
do you still get that with Prime Light
or do you get it with the full 24 full
version of Prime?
>> Full Prime, $24 a month.
Other questions?
>> We'll clarify on the website this week.
>> Is is there a reason the video segments
are one minute or like did that just
kind of how do you guys end up at one
minute segments?
>> I don't know. Do you know anybody know?
>> It's a good length, you know.
>> What's the history behind one minute?
>> Um, I mean, we had some choices. We
thought about 53 seconds, but we thought
60 would kind of just be better.
>> 67. [laughter]
>> And with all these uh forks and
variants, have you guys been thinking
more about third party APIs or SDKs and
making it easier to develop on or pull
data out of?
>> Oh, we are.
Uh yeah, so I mean we have the best one.
Um all the code's open source. You can
mess around with it. Um as far as what
happens on the back end, um this is also
pretty transparent as far as like if you
want to interface with our app and
stuff, if you're making some kind of
open pilot like software. Um it's pretty
clear how our software works if you just
mimic it. Um and then as far as
making forks trainable and stuff like
this, we're starting to move in this
direction. Um, I think it's playing out
such that Open Pilot is like, we know
Open Pilot's pretty bare bones. Um, we
want to just sell you a thing. If you go
to our website, you find your car, you
find the Honda Civic, you click add, and
you get it. We want you to set up in
five minutes, and you don't really have
to think about it. Um, this is all the
experience we all drive with. Um, and
then, you know, you have Sunny Pilot,
you got Frog Pilot, you got Star Pilot,
you got Blue Pilot who do the Fords. Um,
this is like all the Linux distros. And
some people, you know, they hear open
source and they think hacky. Um, but I
mean Linux is everywhere. Um, and open
pilot will be the Linux.
>> Got one back here.
>> Are you guys planning on keeping two
modes for the foreseeable future? Like
why not just one mode or three? like
chill versus
>> we don't want to, but
>> I mean the reason there's experimental
mode is because if we made it the
default, people would be upset. Uh we
want that to be the default mode, but
it's just not good enough yet. So, I
mean, that's what we're working towards.
Uh is making that good enough to be the
default.
>> All right, one more question over here.
So, I'm not sure if you already covered
this, but um is the external GPU going
to be usable properly on the C3X or is
there something specifically on MIC that
requires it? Just making sure.
>> So, it does work. Um the MIC has one
thing that's very specific. Comma 4. Um
the Commore has one thing that's
specific. Um we improved it. So, I don't
know how many of you know this, uh but
uh USB and GPS don't like each other. Um
and the thing is we need GPS to train.
um you saw Mitchell's talk um you saw
the localization stack works um so we
didn't know this uh until we did the
comma 4 and uh so we made some
improvements in that regard um so that's
the one big difference but for the user
we might we might not be able to trade
on your segments but as far as we know
there's there's no differences right now
um yeah
>> GPS
>> which at runtime time is no longer
required. When the 3X launched, it was
required at runtime to drive. Um, we've
removed this. Refactor, refactor,
refactor.
>> All right, we might have time for one
more question.
>> So, I was wondering how um the comma
prime works in terms of like cellular
plan. Do I have to kind of use my own e
seam or physical seam in order to kind
of get the benefits of it or do you
supply because I remember at some point
it came with uh cellular cellular from I
believe.
>> Yeah. So uh since we introduced comma
prime we would ship like a T-Mobile or
an AT&T Sim. It changed over the years.
Um and the problem with those SIMs uh
those are just normal SIMs um like pre-
SIMs and as soon as you cancel those
just because this is how the carriers
operate you can't reactivate them. we'd
have to ship you a new SIM. Um, so the
ESIM just simplifies that. Um, it's
still a very managed experience and
there's a lot of subtleties to ESIMs
unfortunately, but the ESIM that's in uh
the Comma 4 is the same type of EIM
that's in your iPhone. So, if you want
to take your comma 4 and you want to
install your own ESIM, um, we don't have
a convenient interface for that yet, but
the hardware totally supports it. Um,
and right now what the software supports
is setting up our managed experience.
So, Collar Prime is a totally managed
experience. Then we offer Prime Light
um, mostly for international people. Um,
and if you want to install your own sim,
that kind of stuff, you're totally able
to. Um, but the comma four vibe is, you
know, it just works.
>> Yeah. Yeah.
>> Can we fix that?
>> Yeah.
>> We'll work on it.
>> All right.
The team will be around. Oh, so sorry.
The team will be around for more
questions out in the space. They love
talking about things. So feel free if
you have any unanswered questions, find
them, talk to them. We have one more
talk uh which is going to be over here
by the Porsche by one of our star
contributors, Jason Young. Um if you
were at Comic Con two years ago, he gave
a talk how to port a car. This is how to
port a car V2. So um he is going to go
live. So we're going to need about five
m minutes to transition our camera over
there. Um, but we invite you to go see
his talk. It's starting in approximately
five minutes. Um, after that there will
be pizza. The bar is still open. And if
you have not picked up your merch yet,
please remember to do so before you
leave tonight. I want to give a big
thank you to the whole team. They have
worked so hard uh to bring you this
beautiful comma 4 and we're so excited
to share it with you today. Big shout
out to the people that aren't on stage.
also our production team, our
fulfillment team, they are all here and
they work behind the scenes to build
these beautiful devices and get them
shipped out to all of you. So, thank you
so much for being here. We're so
excited.
[applause]
>> Oh, uh I just want to give a live update
to my talk um Maxim and I's talk. Uh we
brief we briefly talked about piest in
the beginning uh using that for our test
suite and my again my point was that you
shouldn't always rely on libraries
because they they uh they they take out
the complexity for you and just today
eight hours ago piest pushed an update
that broke open DBC test. So I had to
fix that just now. So yeah, we should
write our own pie
All right.
I'm Jason and uh sometimes
Okay.
Check. There we go.
>> Hello everyone.
>> I'm Jason. Sometimes I work I I work on
cardboards.
Usually I do it with
people watching, but I'll see what I can
do. Um I have one slide.
Uh and then we're going to get down to
business. Um we're going to talk about
um the minimum you need to do to get
your open pilot environment set up and
get uh your new your nice new 4
connected to your car. We're going to
talk about u a demo carport that I put
together to try to make this a little
bit easier. We're going to talk about
kind of the processes I use in Cabana to
turn that big scary wall of numbers into
something usable and some of the Open
DBC tests.
That's my slide
and
we're going to get down to business. Um,
for those of you that haven't installed
Open Pilot on your laptop before uh more
than just like installing on your
before, you're also going to install it
um on a development environment on your
PC. You can use Abuntu, you can use WSL,
anything. You'll run this on your PC.
I'm not going to do it right now because
it takes five or 10 minutes to run and
you're all staring at me expecting
something more interesting than watching
a compile run. So, I have Open Pilot
Master checked out.
And within that we have open DVC
and we have well
Shane was talking about that uh Piest
thing earlier. We were trying to fix
that real quick. We're going to check
out the demo port. And the reason we
want that
uh I'll show you here.
>> Sorry, I had everything open and then we
were trying to fix that pi test thing.
So, we have a development template
carport that
um it's not merged into mainstream open
pilot yet. It's kind of an experiment.
I'd like to do this something I'd like
to do this a different way, but we're
going to try this for now. It puts in
all basic infra
um so that you can get down to
mic off. There we go. Um the interesting
part
is
our use of the all output safety mode.
Uh and particularly this mode because
with that little parameter on there um
it switches open pilot into a mode where
we're transparently forwarding. We open
a relay and we start recording which
traffic comes from which side of the bus
that's already running on the com.
And if we start the car and we do it
with key in
started up.
Open Pilot has started up and has
started recording data. And if there's
signal that we want to find in the car,
um, this is a good time to trigger it.
Like, let's say I want to find the turn
signals. I'll hit the left turn signal,
let it go for a minute,
and hit the right turn signal, let it go
for a minute, and shut off the car.
Um,
the way that I do this is always based
on uploaded logs. You can go to comma
shop and you can buy a red panda and you
can actually do this live just with your
laptop. Uh, but my method is just to
always let the device upload logs.
Let's see if my device is online.
It is.
And it has just recorded a route.
No, that's not it.
>> Come on.
It hasn't uploaded yet, but fortunately,
I have prepared extensively for stuff
going wrong.
Uh so we have a series of tests here and
I've put together a document that shows
uh some tests you can go through to
produce all the signals that open pilot
is looking for uh wheel speeds
um the accelerator the brake etc etc.
So, we'll look first at the drive
stationary test one.
We're going to grab that route ID
and
pull it up in Cabana.
And this is going to be a bit of an eye
chart.
Let me Oh, you know what I need to do is
start screen recording.
There we go. So, this is going to be a
bit of an eye chart and
nothing really useful or sensible is
happening here. We just have bits that
are changing and we're not sure why.
Um, but as there are some general rules
here we can use to figure out what's
going on. The reason we're using this
demo car port uh is because the comma 4
has
multiple CAN buses connected to it and
we can choose which one we're looking at
and just show
the messages that we care about. And
that's going to narrow down a lot. And
then we can filter by frequency or
rather sort by frequency.
And from here, uh, there's some general
rules. The most important CAN messages,
uh, safety related stuff, uh, wheel
speeds, uh, steering angle, etc., etc.,
they're going to be in higher frequency
messages, usually, uh, generally 100
hertz, sometimes 50. Uh, they're also
going to be on lower numbered CAN IDs
just due to the way the CAN protocol
works. Those end up being higher
priority if the bus is busy. um the
lower frequency stuff and the higher CAN
arbitration IDs. Uh those are all
convenient stuff. Blinkers, seat belts,
stuff like that. You don't need a hund
you don't need to know if uh your turn
signals on 100 times a second, but you
do need to know wheel speeds.
So,
you can see cabana here highlighting
just the bits that are changing. Um, and
the ones that aren't changing are being
left alone. Um, there's a lot of
activity here. Um,
my process is go through and kind of cut
through all the noise. Uh, get the
noisiest stuff figured out first. And
the noisiest stuff is going to be the
check sums and CRC's. Uh, every message
uh or most of the messages you find on
canvas are going to have a counter and a
checksum associated with them. Um, we
happen to know um the counters on this
car are usually located in um
bits 8 through
11. Yeah.
And then the check sum is that first
eight bits. Uh the check sum will appear
random, but it will cyclally repeat if
the rest of the message is the same. But
the check sum will just keep rolling it
over and over over and over.
Um, so the first order of business is to
identify all those because Cabana has a
feature where those stop being
highlighted if they've been identified.
So we can cross off all the check sums
and CRC's. Now I could make you wait and
while I go through and mark all the
check sum signals and all the CRC
signals but uh through the magic of
having done this yesterday,
we can skip to the point where all the
check sums and counters have been
identified. And as you can see, lots
less activity here. So now we're
hopefully able to better see what's
going on.
I'm going to go back to our documents on
what I did in that drive.
So we're looking for the doors. Um,
we're probably going to look for the
accelerator and the brake first. The
accelerator is nice and easy. Uh, it's a
little further into the route, which is
only a couple minutes long.
And let's see what we got going here.
Don't know what this is, but don't be
afraid of marking stuff off. Um, just to
see what's in there. Uh, see how Cabana
graphs it for you. Uh, any activity you
see could be interesting.
Uh, something interesting going on here.
[snorts]
No, that's not it.
Uh,
that's not it.
If you need any evidence that I have not
in fact memorized all the CAN IDs, this
is it.
Okay, so here's something promising.
Uh,
so
I've highlighted these eight bits here
or I've made them part of a signal and
you can see a weird pattern here. Uh it
goes up and it cuts off. Um you'll see
this when you're reverse engineering. Uh
what happens is um I marked off these
eight and it ends up overflowing into
the next one. And that's kind of a good
indicator that the signal is a little
wider
than you initially thought.
or actually maybe it starts
a little earlier.
Little more.
There we go.
So, we've got three things going on
there. I'm not sure if that was the
accelerator or the brake.
I think this is the brake because for
the accelerator we went uh to the floor
three times 100% each time. For the
brake, I didn't have the engine running.
So, this is like a hydraulic brake
pressure. And with the engine not
running, you get like a that uh Nisha
mandated vacuum boost left over for the
first couple times you press the brake.
And then there's a little loose. So,
this is going to be like a brake
pressure.
So, we'll mark that off. Uh, and then I
believe I did the accelerator before
this. So, we're looking for
accelerator activity
somewhere before
I don't know what's going on there.
Okay. I just didn't wasn't in the right
place.
It was right before the break.
There we go. There's our accelerator. I
pressed it three times, went to the
floor, and it went to a full 8 width
each time. Well, just slightly less. It
went to 250. This happens to be a
percentage. So if we scale it by
0.4,
that'll bring it down to a percentage.
0% when released, 100% when not. So now
we've got our accelerator.
We've got our brake.
Now things are starting to get a lot
less noisy. What else did we have in
here? We had the doors.
Uh
so the doors we'll be looking for
somewhere
down here. Uh we'll be looking for them
in these lower frequency messages and
they'll just be little oneoffs that
you're going to have to hunt for and see
if anything interesting happens. Okay.
So, right there, uh, I have to know when
I walked past the camera,
that was I opened driver, passenger,
rear left, rear right. That's me walking
from the driver to the passenger.
So, I'm pretty sure this one was the
driver's door. I got out, shut it,
and then I should see a bit flip for the
passenger.
And then we saw some more while I was
typing.
And that'll be the rear left.
And this will be the
All right. So, we know this one's going
to be like from a BCM or something. Um,
I think in the demo carport, I think I
called this door states. I can't recall.
Let's take a look. Um, so, uh, we've got
a named message here now. uh door states
and we can save this DBC.
Uh
open pilot
we're not scrolling.
We're going to save it over the demo
DVC. Yes.
So now I've got a DBC entry.
Now we can teach Open Pilot to read it
once PyCharm starts back up. Let's go to
another signal while it's thinking. Uh
did we get everything out of this route
already?
We got the doors.
Um,
I'm gonna skip the seat belt for now.
We'll come back to something more
interesting. Let's see if we can find
the gear shift position. Uh, this same
route. Uh, obviously we start in park.
But after I got back into the car, uh, I
went to neutral,
uh, or rather reverse, neutral, drive,
and back again.
Uh, so I know that this was
where do we put the brake pressure?
So, we know it's right after this brake
pressure, right?
Yeah. So, we know it's somewhere in like
this area. So, we're going to zoom in
the timeline
and play it and see what pops up.
Think
we got something happening here. Yes.
Okay.
Uh so these four bits here are giving us
some interesting activity. Um they are
the same for the whole drive until I'm
messing with the gear shift. So it
starts at a five, six, seven, eight, and
then back to five. So, we now know this
is a gear
position.
And we'll go ahead and call this message
transmission.
And
we'll do something extra for this signal
because um
we know
what certain values mean. We know that
five is park. We know that six is
reverse. We know that seven
is neutral. And we know that eight
is drive. Now, this is super basic. I
think the thing's got like a sport gear
and has manual. There will be more
states in here, but this will this will
do for a demo.
All right. Uh let me check how we're
doing on time. So
[sighs] going through this whole process
for all the signals um will not fit in
the time slot that I have. Um going
through an entire carport um and I've
done it quite a few times is a probably
a long weekend. But we can skip through
here and look for some interesting
signals
like
uh you know what let's actually skip to
the fun signal. Let's skip to the one
that actually controls steering
just to make sure we fit that in. Um,
this is a route from
uh a community uh Macan owner uh who uh
gave us a stock lanekeeping assist route
because this particular uh Macan doesn't
actually have the factory feature uh for
lane guidance. The car is capable of it.
We turn it on. an open pilot can use it,
but I couldn't get a stock route from
it. So, we'll come in here
and
launch Cabana on that route.
And because he was in dash cam mode
without that um special switch uh to
actually open the relay uh we don't h
all the traffic is present on both buses
zero and two. So I'm going to cheat here
a little bit because I happen to know
it's in this message.
Let's load
Let's load our demo DVC
and we're going to call this one
HCA01 because that's what it's called.
We'll mark off the check sum.
We'll mark off the counter and you'll
see nothing else is really happening
here yet.
What we're going to do is skip till he
gets out to like a main road and oh, we
got some activity now. So, as soon as he
went out to a road, uh he uh bounced it
off lane lines a couple times for us and
we're getting some obvious activity
here.
Uh yeah, so these are
force inputs from the lanekeeping assist
system.
We're seeing that uh that jagged edge
there again that kind of indicates I
didn't make the signal wide enough. Uh
so I don't recall the exact width, but
it's definitely more.
Let's call it 12. See if it
Oh, it was just the Andy and this was
wrong.
Let's do this. There we go.
So, this is
the
factory lane keeping assist system.
when you see them get close to a road
edge,
it's applying torque force to the
steering wheel uh to counter that. Um
the Volkswagen family cars, um this this
one is secretly an Audi Q5 under the
hood. Uh it it shares a platform. Um the
Volkswagen family cars for steering
angles, pretty much any angle, uh they
don't use a signed value for whatever
reason, for direction. It's an absolute
value and they send a separate direction
signal. Uh so we'll call it uh
uh LK torque sign and okay.
And there's usually going to be a bit
somewhere that's just turned on
whenever it's active. Uh, in the
interests of time, I'll tell you I
happen to know it's over there. At least
I hope. I believe it is. Make sure I got
the values right. Yeah. So, on this car,
um, it is a three-bit field values from
0 to 8. Um, if we look in the like the
beginning of the drive, there'll be
uh in a init value. Yeah, it'll knit at
zero. It'll go to three when it's ready,
and it'll go to five when it's actually
intervening.
So as you go through and
come up with
all of these values, we can take them
and plug them into
the demo car port into into car state.
Um we put in here and this is just a
test to see how it goes uh for speeding
up car ports. These are all the signals
that we need to populate.
And
did we find accelerator position? I
believe we did.
>> Maybe I didn't save it. I hope I saved
it.
Let's do transmission instead.
So as we find these values, we can come
in here
and uncomment
the places where
we read those signals.
Now that we've got a gear shift
position, every time car state runs,
Open Pilot will now know
we're in drive, we're in reverse. Um
like Open Pilot will refuse to engage if
you're in park. uh if you're in reverse,
it puts up the reverse display on your
screen so you don't look at it like it's
a backup camera, etc., etc. So, the
process you go through every time is you
got to find the wheel speeds, you got to
find brake pressed, uh gas pressed,
steering angles, uh cruise activation,
blinkers, etc., etc. Um, for purposes of
the live stream, I have a really limited
time slot. uh for purposes of nerding
out in a group of friends. I'll do this
all night if you want to see more
afterwards. Uh but I'm sure uh Julie's
going to give me the hook eventually
here. And people would probably like to
Oh, people are already eating. Good. I'm
not holding anyone up. So, um questions,
anyone?
>> Go ahead.
>> What do I type into it? like the values
that you found, how do you add them?
>> Uh so what's happening is uh when we
save this DBC, it goes into
car.
Oops, I clicked too many times. DBC
this file right here. Uh so we have a
transmission message with a check sum, a
counter and a gear position and down
lower in the file you'll see the the
value table
for gear position and then open pilot
when it starts up the demo car port
will need the demo DBC for this car and
that way when car state is running we're
referencing that DBC for these signals.
So that tells it what message to read
and then this shifter values map that we
read up here is what goes down to the
bottom of the file and reads that value
table 5678.
Um these names are made up. I made them
up just for the demo cardboard. You can
call them whatever. Uh the intent was to
kind of be able to skip all this stuff
and get straight to the fun part of
finding order in the chaos of this giant
wall of numbers.
So we can find signals in here all day
if you want. Um but again I have I have
limited time on the stream. I want to be
respectful of everyone else's time. So
uh if you have more questions or if you
want to see more, I'm happy to.
>> Yes, sir. So with the newer cars what
happens is like if you try to like
try to
see
>> that's correctable
of like
>> so the question is um why don't you see
anything from the OBD port that uses
CAN? Uh it's a good question. Uh and the
answer is there's something like there
is not one CAN bus in this car. There's
uh something like eight
um and one of them eight. So there's a
central CAN gateway uh which has six CAN
buses. Uh one of them connects to just
the OBD port. Uh there's another one for
infotainment, convenience, powertrain,
uh chassis, and extended. And extended
is where all the cool ADS stuff is.
That's that's the bus that we split.
That's where the radar is. That's where
the camera is. And that's where the uh
uh like the blind spot radars are. And
then there's two more at least. Uh
there's a fusion bus between the uh uh
between the blind spot radars and
there's a fusion bus between the camera
and the radar. Uh that doesn't neither
of those connect to the gateway
directly. But the answer to why you
don't see everything is because there's
eight GAN buses and the di the gateway
filters out everything that isn't
diagnostic relevant. It doesn't repeat
all the other internal stuff on that
port.
Other questions?
>> Will it be same for all of the same
model?
>> Uh so of all all the cars in the same
model. Yes. Generally of the same
platform. Um Volkswagen is and other
manufacturers as well. Um really good at
recycling stuff from the parts bin. it
tends to all work the same way. Um,
other Volkswagen cars that use, say, the
MQB platform, and there's 20 or 30 of
those,
it's all the exact same Open Pilot code
that supports it. Um, there's three or
four different VW platforms. They all
tend to work very similarly. Other
manufacturers, uh, I think all the Honda
cars work almost the same way. uh
including the like going all the way
back from the mid2010s to the most
current CAN FD stuff they use the same
messages
same signals for the most part.
>> So does it make sense to start with Q5
and then build on that?
>> Uh like the other like the Audi Q5 that
this is based on. Um so
it can you can just start wherever you
want. Um they're very very very similar.
um like 98th percentile similarity. Um
this is just the car that was in front
of us. It was the most interesting. We
thought it'd be cool to play with at
Comic-Con. Um and we'll come and layer
Q5 on top of this.
>> Anything else? Is it right to assume
that all information is open in the
sense that it's not encrypted or is
there any
>> uh so the question is uh is this
information open and not encrypted? Uh
yeah the information is there in the
open um it is not secured per se uh
other than it is undocumented. You get
to figure it out but we have great tools
for figuring that out now. Um
even the check sum um and the algorithm
for that varies uh isn't really intended
as like anti-tampering. Uh it's more
intended to protect against bit flips as
it transits like a CAN gateway. Um
there's CAN network level check sums and
then the payload check sum is intended
to protect it end to end. Um, you will
hear people talk about like Toyota TSK.
Uh, you're seeing some cars now, not
all, but some, uh, implement actual
cryptographic signatures on the
messages. Uh, you'll see that they'll,
uh, some Toyota messages will have very
random a very random looking signal
that's like 16 or 24 bits wide. Um,
that, um, the fun police have come for
you there. uh you it it is specifically
designed to stop man-in-the-middle
attacks, which you might consider that
to be what Open Pilot is doing depending
on your point of view. Um there's none
of that here. Um it is showing up a
little in the field. It's not hit
everyone yet. Um we're seeing plenty of
2025 and 2026 cars come out that have
none of this. So it's not been like, oh
my gosh, you can't get a car without
this anymore. some manufact Toyota's all
in on it seems, but I don't think anyone
uh maybe some new Ford,
new GM.
Uh I think those are the big ones that I
can think of at the moment, but uh
haven't seen it on Hyundai. Haven't seen
it on VW yet, but I we think it's
coming. Um haven't seen it on Honda,
haven't seen it, uh Mazda, Subaru.
more questions.
>> Great question. Uh question is, uh
what's the minimum set of signals? And I
tried to put together a little bit of
information about that.
Um so you need to fill in uh brake, gas,
uh the cruise state. You really should
have like door open and seat belt. Um,
and you'd have to have that before
upstream, but like if you didn't look at
it right away, if you're just developing
on your own, uh, things would be fine.
Gear shifter, uh, I would go for it
right away just because it's easy to
find and nice to have. Uh, but like you
can hardcode the carport to drive while
you're in development if you have to.
Uh, you'll need the blinkers in order to
do lane changes.
Um,
standill, you can do on your own. You'll
have to know your steering angle. Uh
steering torque you'll need for lane
changes and for the safety model to work
right. Uh
and you need to know how fast the car is
going. Uh things you'll need to send uh
you'll need to send whatever the control
messages for your car. It can be based
on torque. Um it can be ba or angle
or curvature.
Um and you'll have to figure that out
during the process of reverse
engineering.
All right. Anything else?
>> Well, this is my car reporting talk.
Thanks for coming.
tweet that it happened so you oh God me
now we
flip this is so awkward all right oh
this is pretty cool though this little
stand thing the all you want to talk
about what we're doing here yeah we were
uh going to Shi for the new release and
show uh the great metrics of 0810
compared to 089 but it seems like we're
having some uh technical difficulties
and we thought we'd uh we'd Loop you
guys into the technical difficulties you
know this is part of our life here
so in the uh in the interest of
transparency you get to see us uh try to
staged intro plan
but this one's more
real is there any metrics that do work
that are interesting well I mean the
ones that are really interesting the
ones that we were going for is uh these
ones here uh turn cutting has always
been an issue with uh with open pilot
especially in less mode and we've had
some fixes recently that uh sign
signicantly improved that so basically
it's just an Adaptive waiting that if
the model's very certain and you're
cutting a turn that it's more aggressive
in correcting when the model is certain
um and we had some metrics that proved
how much better this was in0 a 10 uh
which is the ones we're trying to fix
now but really this should be uh very
noticeable Improvement in the Turning
behavior when you're driving
lanel lanel keeps getting
better so hopefully you guys zero
woo I don't know if that's is that good
all right what do we got is it going to
work work record
this yeah oh there we go all right so
let's let's compare these two so here
you can see turn cutting on left turns
on average you're 3 cm too far inside
the turn and in right right turns that's
1.5 cm and this is for 0 A10 so this is
what's about to go to release and then
if we look at uh at Master you can see
that's more than twice as much so we're
really getting a pretty significant
Improvement in uh in turn cutting on
less sweet that's something great to
look forward to
awesome like some nice metric are the DM
stuff too I think people think we ignore
DM a lot do we want to look at the DM
metrics we should just show let's check
them out everybody care about yeah vm's
pretty important are least is this TV
yeah this TV you can see here some
things the alert ones are pretty cool
yeah how often people get distracted
alerts the differences between nighttime
daytime difference between comma 2 comma
3 cool stuff 3% of users got at least
100 yellow or red alerts in in the last
week pretty
cool should we show them try it too on
the we can try it on here right yeah
yeah fact you want to try to oh we got
more bringing up more and more metrics
wa look at this we got another graph
here it's a graph
shows it's just a distribution of the r
Deltas uh in left and right turn so
there is left and this is right nice and
this is for master but for but so this
isn't going to have changed right yeah
it wouldn't change much a little yeah so
this is the bias that's uh caused by by
the rooll because the turns are always
banked into the turn um so once a is
done with the rooll compensation project
those should be go inside together nice
what do you want just go on comma.ai
comma.ai does anyone have any questions
enhance the size of it like like 200%
oh all right everyone new new thing
George talked about it on on disc cord
uh but it's live and real you can now
try a comma 2 and upgrade to a comma 3
within 90 days just pay the difference
the try to try two program try two
program so uh yeah over here on this new
page comma.ai compare we have uh both of
the products we sell we have the price
differences here and underneath uh this
is my favorite part I wrote this I wrote
modified phone in a case
it's true comma 3 purpose buil Hardware
uh goes over just some tech specs and
the differences between them and uh I
should probably need to make this a
little better but Comm 3 has nav so it's
pretty
exciting it should be like the uh new
you know yeah should make it NE uh so
those are the differen has 24 more
dragons that's what I'm telling you it
has has a SSD no more pixels on the
screen it's an OLED yeah comma 3 is a
huge upgrade people know that and uh
that's why the next section is what the
community thinks and this is a bunch of
people's quotes from Discord uh so we're
not making this stuff up this is what
people are saying about their comma 3
purchase red acid Trust Red acid Master
branch is glorious right now Tri X
clam wait who's in the beal of the day
is there
it's just referencing that it's the nail
of that day oh I see of day day fil yeah
so s Sam has some uh wisdom that's a
short and sweet seems like a no-brainer
to me someone just said in chat I agree
uh so yeah just open up this first uh
try to talking about it all right go to
how it works and open up
this I got so yeah check it out all you
got to do is uh purchase a comma 2 for
drive if you like it do nothing if you
want to upgrade to a comma 3 keep going
there's a new discount code for the
comma 3 three for me this code gives you
the price off that you paid uh for the
comma 2 and then yeah you just send your
comma 2 back to us keep your harness and
everything set up and uh yeah we'll ship
you a comma 3 once it comes back so all
the details are on this page but I think
this is really great for new users who
don't necessarily want to pay everything
cuz they have never tried open pilot
before they don't know if it's worth
this much you'll find out it is worth
this much once you try a comma 2 and
check it out for yourself anything you
want to add about the try a two program
a I know you think it's a good it's a
great program progr hopefully gets
people into comma 3s or just the
ecosystem in general yeah I don't know
what else what else do I just say should
be a nice entry point in the whole
ecosystem exactly
anybody else have anything to say the
program it's exciting no I think uh
that's it we got real
call all right so look n of people are
buying common 3es that's that's that's
real talk right we're making a little
bit more money with threes than we made
with twos but that's obviously a lot
less uh units
sold um so you know we need a way for
new people who are like oh that's
expensive to come in and buy it try it
too
if you don't like the two send it back
in 30 days as well yeah free free you
know it's like nothing bro like get in
get in um yeah yeah so we got oh
fundraising is over so if you know if
you're like you send an email today like
oh I want to be a part of Comm
fundraising round I'll see you in three
years all right yeah so try it too it's
going to be great do we want to check
out the ENT long tun sure I do the I
think want to go for a dri an I want to
gra yeah right do Mazda first
or either fine it's the same to me oh I
just
want all right how about we do the Mazda
real quick and we're back in five
minutes then we do
int all right so uh let's go check out
the Mazda are we going to check out the
Mazda yeah we going to go for a drive or
we just going to check we'll go for a
quick test drive of it problem is that I
has a minimum uh steering speed let me
drop all all right let's go let's check
it out yeah let's check it
out all
right here it
is the
Mazda all right we're going in we got a
real clean install from Nick yeah look
at this Nick's always the professional
installer I'm sitting on a laptop I'm
got to get comma Prime in here oh wow no
Prime no Prime I couldn't afford it yeah
look at this interior it's a nice
interior yeah yeah it's pretty it's like
a better Rav 4 yeah it's it's smaller
isn't it feels a little
smaller uh but yeah this is the first uh
Mazda right that well we had other Mazda
supported but uh this will be the first
one that's not on dash cam only
mode yeah and so for those who don't
know there's a bunch of mazas that are
in dash cam only mode and the
reason it doesn't like that corner it's
the same Corner we cut out last time oh
really yeah everyone's saying
f are we back did they say I think we're
back yeah I think we're back why doesn't
YouTube make this more clear I
know it it it showed up a prompt that's
like do you want to reconnect yes or no
I said
yes all right yeah we're back uh so yeah
I was just saying there's a bunch of
mazas uh in dash cam only mode and the
reason they're in dash cam only mode is
because you have to keep constant
steering torque on the wheel uh but yeah
with this newer Mazda you don't have to
do that so we can make it uh yeah 2021
CX9 yeah it's pretty
nice yeah thank shout out to jakar he's
uh the one who did the Mazda the port
he's brought in all the cars so
far um and he's the one that found out
this one doesn't have a lockout yeah and
he owns it himself yeah he even switched
once he found out it didn't have a
lockout he uh upgraded his car and he
got one of these great CX9 oh he's in
here oh he's in there said yay oh
nice yeah thanks for all the hard work
at your car um he's a really high quity
Port he's got firmware query in there I
think it was our first brand to be the
only uh only have firmware query maybe
it was Volkswagen but I think it was mon
I think it was Monster yeah yeah got rid
of all the can fingerprints it was a
little easy cuz we just deleted them all
it was Dash can
moment
uh yeah great work yeah just fixing up a
couple bugs uh we were want to verify it
but I don't it's a very beepy car it is
beeps for everything whoa did you just
engage
nice y hands off look at
that oh and then it beeps we got to fix
that oh yeah so we're going to make it
real nice before we uh we give it back
to the rental company
but um when this ships in 08 11 you'll
have a great experience on your
CX9 um yeah it's standard on all trims
right I believe so yeah yeah that's
great we already soell the harness for
it so that's easy too it's the same as
the FCA harness we luck out there same
exact harness yeah so if you have a
Pacifica which you know I don't think
has the greatest open pallet support you
trade up to a CX9 keep the same
harness yeah beep is
annoying seems whenever you interact
with it h interesting we got to fix the
beep yeah I mean the steering's quite
smooth uh is it like Honda kind of
steering where it's like smooth and and
everything yeah we're approaching a turn
it's more similar to the Hundai steering
oh that's good but uh that's nice yeah I
heard your cars working on launch tual
support too oh nice that's going to be
great yeah how's the torque and your
experience uh we've only had it uh for
less than a day now but the torque seems
pretty good I haven't G on that many
drives but nice yeah I mean it seems
good better than Accord way better than
the Accord the Accord isn't that bad
though yeah the problem with the Accord
we've been talking about this is that it
beeps when it doesn't need to beep a lot
so that's something we need to work on
yeah cuz like it makes a lot of turns
but it beeps I also found with this car
that this car faults the EPS a lot um so
we found that the the red alerts are
super annoying on steering unavailable
we're going to get that fixed for 0811
um I know certain people have complained
about it quite a bit um and we fixed it
for the Toyotas but I guess it fults one
of these cars so we'll fix it once and
for all we're really trying to work on
the uh reducing open Pilots
rough edges project car said I fixed the
chime but ad doesn't like my fix no no
no we're going to fix it properly we're
g to get all the dash alerts in
there how's the longitud it seems pretty
nice yeah the longit is pretty good does
an alert come up when we go below the
steering limit yes nice
oh some traffic
here well yeah it's a really nice car so
I'm sure you know some someone out there
watching the stream maybe one of you has
one have quite a few mle users actually
last time I checked oh yeah here's the
alert oh yeah oh then there's that speed
uh speed to low alert and that's stupid
too because it doesn't tell you what the
actual minimum speed is so oh really
we'll get that fixed up
too nice get too
close traffic this will be good for n10
longitudinal probably yeah stay tuned
for the next time we just got to get
back to the office now in traffic
yeah
um but yeah how do you verify a brand
Port how do you go about I thought I
thought that was a real user question
but oh there's Jason uh nice
representing can it do stop and go it's
doing stop and go right now it just
doesn't steer
unfortunately yeah oh well we'll flip
this way
yeah yeah uh how do you verify a brand
Port like we got this car we rented it
what is that yeah that inail I mean the
first part is driving it around so we
found a couple bugs um right off the bat
like it doesn't always cancel um that's
a pretty big no no we got to fix let's
try to get in here um try to get the
blinkers were wrong and it's like this
stuff isn't necessarily the the fault of
the
maintainer oh these guys are so nice
they let like two people in nice this
car is beeping it's a very beepy car
it's like the Sonata
yeah um yeah so we found a couple bugs
right off the bat but I think this is uh
a lot of the problem is we don't
communicate what the open pilot
experiences super well
um and I think we're going to try to do
a better job of this now um we launched
our docs page it's going to be at
docs.com doai um that's going to be the
documentation for developing open pilot
as opposed to the wiki where it's uh
very handhold to kind of help getting
started um we kind of want to move away
from maybe not move away from that but
we want to segment off the development
documentation away from that kind of
stuff
um and build out our documentation a
little more um find a use compatible car
oh the there's internal conversations I
see cheapest car that works with coma
someone asked if Honda's still the best
I think Hyundai are are the best Hundai
are pretty good they're pretty good
every car is every car has its own
quirks I don't think there's one car
that's just like is perfect in every
single
way yeah but
I don't know architectur the Toyotas are
still very are still the cleanest
yeah but uh I don't know I feel like a
lot of cars are are a good choice yeah
see this alert this needs to this need
to tell you the minimum speed I don't
know what the minimum speed actually is
I think it's 28 mes hour that's annoying
you can't engage and it just sets the
speed to that that's super
annoying
um but yeah so for as far as a brand
Port though a lot of the we do is is
kind of fixing those things that we
don't communicate super well and then
the other part is verifying the safety
so we do injection testing um we go
through all the panda safety and make
sure it works properly um and that kind
of stuff so um that's what I'll be doing
later half of today right now I'm fixing
up all those little things like um just
mer the pr to fix the blinker States um
so now when you the convenience blinker
works and it's not tied to the lamps
anymore You' see like the lane change
alert flicker oh really yeah and it's
like if you haven't driven another car
it's hard to tell um or even just from
reading the code it's hard to tell what
the these things are supposed to be so
we're really going to try to fix that up
I communicate the stuff better yeah
jakar said 32 miles hour oh jakar is in
here man that's going to be hard to get
up to 32 miles hour how do you use this
and stop and go you
disengage that's like the weirdest
limitation I've ever heard of cuz like
you want to use it and stop and go but
you have to get all the way up to to to
make it work and stuff go
know huh oh well that's pretty what else
do the people want to know the pedal
pedal I don't Eric just said
pedal yeah what else do you all want to
know about you know brand ports and uh
our new documentation stuff I'm pretty
excited about it it's looking really
cool we'll have some proper developer
documentation for open
pilot I mean I think the what well
deployed uh this morning I think is
really about discoverability
right and it's just kind of hard to find
stuff right now but if you go to I'm not
sure if it's up at docs.com doai yet but
if you go to docs. ak.com doai you can
see it there
um and it really shows you all the
documentation we have um at least that's
in the open pilot
repo um whereas it's not super easy to
discover right now we kind of get caught
up in the way that we learn open pilot
or at least when like new employees come
you you just kind of GP around the code
base but this is kind of a a big ask for
somebody who just found your repo and uh
want to start poking around in it you
know cloning open piles actually takes
quite a long time we're going to fix
that too yeah car ionic we don't know
anything about speci I can engage at
zerp you think you me zero
yeah is there anything that's going to
be a limiting factor going forward
whatever uh single Panda was a limiting
factor now we have multi Panda we're
going to merge that PR yeah that's
exciting multi Panda's cool if if you
have like a car like there's a few
Nissans where the the
longitudinal like control is on a
different bus and we we ran out of buses
so you can have two pandas hooked up and
and get longit tuna working that way I
know robe is doing that for his Tesla
ap2 Model S he has two pandas so he can
do longitudinal control um but also you
know that means you can support the red
panda and uh yeah run it simultaneously
with the built-in dose on the comma
do does community supported cars have to
tune longitudinal per car every car is
Tun yeah yeah it's all got I mean all
the tuning is kind of community though
yeah though shout out to I don't know
how to pronounce his name quadas I think
oh yeah the first real tuning PR yeah we
got a nice tuning PR he put all the
plots in there
um the volt was used to be the worst car
hopefully with 0810 this has changed um
and we're going to start releasing
metrics on
this um and we'll we'll make like a nice
document every release maybe of how open
piloty is your car yeah um and then you
know you'll be motivated you'll know
that your Honda I don't know Clarity or
whatever Honda Fit Honda Fit is a shit
car and you know you should can we say
that um you should uh fix the tuning
yeah
yeah we're we're 27 mil hour We're
close oh this is so almost engage this
guy doesn't want to nice yeah making our
way back to the office then we're going
to check out intend longitudinal some
updates there pretty exciting yeah stay
tuned after the commercial
break oh we're so close put the TR two
in the middle and then that could have
been a commercial break yeah well let's
just reiterate TR to for all those all
those new entering the stream yeah you
want to do that yeah so oh we're back we
got to engage
woo oh we're about to drop below oh no
it's
not yeah I mean at least we're we're
half half all
right oh well um so yeah try it to new
program check it out just go to comma.ai
it's right on the top there's a banner
what it is is uh you want to try open
pilot on your car but you're like man i'
I've never tried open pilot I don't even
know if it's any good I don't want to
spend $2,200 to to just try it out so
now you can buy a comma 2 try it out for
up to 90 days and any point within those
90 days you're like man open Pilot's
great I think I should get a comma 3 uh
you can just like Trade It Up pay the
difference uh so it's a really cool
program it lets you just try out open
pilot also of course every product on
our shop has a 30-day return policy so
you could also just buy a comma 3 and if
you don't like it return within 30 days
y this is what we're trying to fix oh
that's so annoying we missed the alert
but it was red was it cuz you touched it
who knows yeah I think it's cuz they
override I mean a lot of cars fault a
lot of the EPS is Fault when you
override but M seems to fault for a
little bit longer yeah so that's going
to be great you can literally go in the
shop today buy a comma 2 nothing special
about it just uh buy a regular comma 2
once you buy a comma 3 use the the code
three for me and uh you get that amount
off then you just have to send the comma
2 back to us and uh yeah that's it we'll
send you your comma 3 yeah you guys to
be really happy with comma 3s they're uh
they're a real Consumer Electronic we
worked really hard to make them nice yes
comma 2 is are you know they drive your
car but comma 3 is nice
um and it'll grow with you you see all
this nice new open pilot
functionality yeah that's very exciting
for for those who don't remember like
the Comm 2 used to not be good at all
when it came out it was a cool great it
open pilot 071 yes it was good it was
good for open Pilot 071 We we've open
Pilots a lot better now we have assisted
Lane change at this we hit torque limit
did this earlier though guess you're
going too fast all right go this is this
is a torque limit roughly oh I think
we're leveling out that's not better
than a cord but nice Bank turn here
maybe ve has some announcements around
that yeah you can tell cuz we're so
slanted on the screen because the
stabilizer stabilizes just
to what perfectly straight is should we
show them some land
changes this gu is not Happ H yeah we
got to get over one
more it's really a lot of traffic today
someone said Hardware costs money
Hardware yeah unfortunately it does it
costs us a lot of money too yeah we got
to got to make all the hardware so we do
have a lot of Kos available so you know
try it out see how you like it I think
it's going to be great for all those
people who used to be trying comos and
uh that's how they got into the
ecosystem now you can keep doing that
and you still have the opportunity to
get a so bad we're also working on new
sounds for those of you who don't know
the new sounds are going to be great I
know some people complain about the new
sounds that are in that branch and
complain they're not coming to the com
that's a work in progress Branch it's
not it's not scarying it's kind of
annoying
um yeah we're working on new sounds our
sound gu killing it um yeah that sounded
really really good well look how white I
look yeah um so yeah hopefully those
none of the sounds are as annoying as
that um the new sounds are actually
quite a bit more pleasant um yeah why
does this still show up we're over the
28 yeah actually why oh there's probably
some history
of
um but yeah what else is there to talk
about I mean yeah this Tri 2 is going to
be great everybody go buy a comma 2
right now if you have a supported car
there's literally no reason not to and
just uh give it a shot see how you like
open pilot it's great oh Comm hack I got
to talk about Comm hack yeah how's the
CTF going anybody still doing it that's
a good question is anyone still doing
the CTF everybody play it and have
feedback yeah let us
know Logan said or just try a three also
true you could just try a three they're
back in stock temporarily so if you want
one buy it now we might run out of stock
real soon
again we running a stock of comos or
threes threes oh we got comma twos don't
worry we're still waiting on
screens for what comma 3 yeah yeah yeah
so uh we're stuck someone said they're
stuck on six out of eight submit if you
haven't yeah if you haven't I just like
seeing all the submissions we did give
out all the prizes already um although
there's one flag in there for an extra
prize and and uh nobody actually follow
the instructions on that flag it's
really sad so if you did find that flag
and uh you know what inst instructions
I'm talking about update your form and
we'll uh we'll get you your prize sent
up cuz quite a few of you did find all
eight how many com are left there's so
many and we're going to be uh even
making a few more comat so we don't just
have what we have we have even more
katos that we're going to make uh
production's very excited we're going to
do a commat two week one of these weeks
we're going to mix it up
after building common 3s for quite a
while get back to the old the old common
twos yeah but uh yeah if you haven't
done the CTF and want to come to kah
hack you can submit up until the event
uh the event's kind of full but you know
if you do well on the CTF you can come
um we can always use more good people at
the event yeah if you're a winner you're
always
welcome there we go we're back oh
no
no more
steering no the comma 3 you can look at
it with sunglasses there's no issues
it's correctly polarized oh should we
tell them about the should we tell them
about that yeah we can tell them about
that yeah so uh in early production we
found out that uh there was a lot of
early issues with those screens and uh
we had to reject a lot and we had to we
had to throw away a lot of screens but
uh and then at the end of all that we
found out that some of them are also
polarized wrong yeah what happened is
eor and I were looking at comma 3s and
we're like this one looks like blue the
screen looks blue when it's off so then
I was like oh let me just get a pair of
glasses like a sunglasses and let's try
it out let's check out what's going on
and then I looked at the stress test and
like half of them were black with
sunglasses I'm like oh no I think that
was right before the first batch too it
was right before yeah the first batch is
going to be like double the size it was
but uh yeah I like we got to reject all
these screens so we took them all off uh
rejected them all the screens coming out
in common 3s are polarized the correct
way it's really nice
I know that was a big issue with the
Comm twos funny enough like a lot of the
monitors around the office also are
polarized the wrong way if you wear
glasses um yeah isn't it weird OLED
displays are polarized uh it looks like
the smartphone people do this so like
you can hold it vertically and it looks
the best uh for glare so but that's
wrong like if if you're looking at a
smartphone screen like this and then we
mount it like this you got a problem so
these works great for the open pilot
application it's a nice screen yeah it's
a great screen and we have a designer uh
in the pipeline in the interview
pipeline yeah so hopefully we'll be
seeing some of his work in open pilot
some new design be awesome to make use
of that great screen it's really
beautiful anyone with the combo 3 can
attest to that and they're all the same
calibrate them I know they look exactly
the same oh my God jakar said I don't
know where all these uh loud beeps are
coming from I don't haven't gotten any
of these wait really
yeah so you have this patched out or
something Red
Alert Shields
up oh man what else is this car is
probably good for Highway cruising I'd
say that yeah yeah I'm sure it's great
for Highway cruising it
was it was great when I was driving
around when there was no traffic earlier
there I mean it it's doing pretty well
too look at that yeah jar did a great
job with the port
should we let's ask him for an update
how's longitudinal doing yeah how's
longitudinal any work on that uh good
Chum yes what
good that guy's
hilarious uh jakar said um he can engage
at zero and he doesn't get any of these
issues he probably can engage at zero
yeah wait what's the difference yeah how
do we engage at zero
torque on the Mazda is kind of like
better than the Accord I'd say maybe
what do you think maybe it's probably
more than that let's see how those
here so we're going run 40 let's
see hey that's that's but it's holding
it that's good I like when they hold it
yeah yes
ah I had to click reconnect we're
back no one said f in chat this time so
maybe we didn't cut out who
knows how many people are watching 82
82 MDA we got likes already can you you
get likes on a live stream yeah 28 likes
short F short F welcome
back everyone give this video a thumbs
up let's get to 100
likes we don't have enough people for
that but
uh yeah smash that like button any other
questions anyone has anyone buy a comma
2 yet wait jakar the blind spot stuff
also doesn't work doesn't block the Lan
change properly I haven't looked into it
yet good Chum said haha oh he's watching
yeah I don't understand what your
complaints are man do you want to you
want to clarify
here uh
voac that's kind of tied in with end to
end longitudinal once end to end
longitudinal is good enough to ship I
feel like that's when voac is coming out
we're not going to we're probably just
going to focus on intend longitudinal B
53 likes that worked it like double the
amount of likes I don't think I've ever
liked a YouTube video o what are some of
the hackathon project ideas oh we got
some cool ones so uh we're thinking of
doing a canfy carport I think that's
going to be eagor project um that's
awesome yeah red panda support and multi
Panda support finally in uh
um it was ready for 0810 but uh it just
was done too close to the release we
couldn't merge it that
close um what else we got we want it' be
cool if somebody did a see-through comma
3 so they track your head pose and then
they use the cameras on the back to pass
through like you you looking right
through it that'd be cool um we have
some uh maybe an announcement at uh for
new hardware at the
hackathon not a comma 3s not a comma 3s
or a comma 4 comma 3 forever
Comm no we're already working on the
comma 6
guys uh six cameras we need all the
cameras six cameras what else what are
the projects we have comma security yeah
we're thinking comma security we're
finally thinking about it I mean we've
always thought about it it's just you
know who was time for common security
yeah wouldn't that be neat if your car
like got hit or something like got is
the spot open again all right how do
they get so lucky today
woo we got the 30 minute yeah it's not
actually 30 minutes um yeah we got lots
of cool project lined up a lot of common
employees to do a common security stuff
yeah we're thinking streaming instead of
the snapshot featureing the snapshot
feature is pretty lame I think so it' be
really cool if you can stream com needs
less power yeah we're also going to work
on that yeah comma
3.3 work with the great speaker oh the
great if someone breaks
in what else
anything oh no the com
watch it's the comma and then you know
four letters can anybody guess it George
might have talked about it before he's
he's you know he's hinted at the
thoughts yeah but yeah yeah coming to
Comic Connect maybe after the hackathon
you guys have hackathon project that he
has uh put it in maybe the CTF Channel
yeah we'll check it
[Music]
that no we're not going to parallel part
anybody say anything about the CTF for
the heck of them no comma 4 no it's not
the Comm
four comma neck what do you guys want of
the comma for though I'm
curious yeah comma 3 has like everything
you'd want right got 360 Vision
yeah oh it takes forever to yeah the
ignition doesn't turn off it turns off
after a minute I don't I why they do
this super
strange what's the most commonly used
vehicle still the Prest by far by far
yeah there's the raap 4 the Corolla and
there's like one more Toyota someone
said no screen no screen the screen's
beautiful it's beautiful
all right was on earlier yeah we ready
to go in yeah let's go you'll uh open
the door yeah I'll open the door cool
all right everyone moment you've been
waiting for and to end logitudinal
let's let's try it out got some
improvement since last time when it
basically didn't work at
all all right driv better driving yeah
it drives better than someone who's been
driving for a week maybe we'll see
Harold it's time
look at all our boxes we have you
ready all
[Music]
right you need to show them new hardware
what oh well I think the other I think
the other bodies in there I may we show
it the hack of them no I mean these are
some parts of comma
bodies uh comma bodies are coming soon
uh you'll be able to attach your comma 3
to your comma body so like here's a
comma 3 uh the other comma bodies in
there being worked on but just imagine
this but a little narrower and like
extended up to like we're going to make
him a nice 5T
tall you know should we shit on
lumu oh well
wait how do I spell that thing
lumo lumo l m o oh l o o m o yes okay
well so it's going to be nothing like
this we
promise when I see a lumo I just want to
kick it right look I just want to kick
it right and can you kick it yes you can
right like like that's what I think but
when you guys see a comma
body it be like
wow cool um so you asked what can the
comma body 2 do and let's go for Drive
uh because that's the wrong
question it's important is that if
anything if you can see a stop sign or a
stop light that you mentioned comma
pencil can help here comma pencil I
guess I can just join for the D is
anyone penciling in uh I'll open that
well yeah how you got to come here to
complain we stuck outside
now not got my phone
um I've never tried anten longitudinal
before
uh the best it's ever been is it good am
I going to be
upset unclear
unclear how am I am I going to like this
or not I think I'll go in the back har I
think I should go in the back like all
right angles it's the Comm
garage all right uh going to you put
this in a cup holder
[Music]
somewhere all right we're
in got copyright claim yeah yeah yeah
that's
right I like parts of the experience
okay so I hope you uh feel the same way
so you're telling me the highway is
actually what's good I like the highway
I thought it did some some really smooth
and impressive things things I like off
Highway it
doesn't it only opens with the button
really is that true has it been has it
been an illusion the whole time yeah
it's always been like that I sit there I
press the button and it's on like the
sixth press that it closes
wow so Harold give an introduction what
is n10 longitudinal if someone's
watching this video for the first time
yeah so tin long tunel in this in this
case it's really just doing what the
model wants to do what the model thinks
a human would do all right no lead lead
cars only play a very small role as like
limits everything else is really just uh
letting the all do what it thinks a
human would do oh
[Music]
whoa wow it's stopped to the stop sign
all let's go good call good call model
by by pretty sick Bro I don't even think
this is some FSD shit all right let's go
let's go let's go oh that call on the on
the oh everyone's like the audio sounds
like it's coming through the cart let me
all right we stopped yes sometimes it
stays stopped sometimes it goes um what
would a human do here all right let's go
uh see this is really where comma pencil
can help I think why is comma pencil
going to help with this well the problem
is we only have a very narrow field of
view that the comma 3 oh they got to
improve the yeah do those comma 3 labels
all right so we need to see we need to
see the full white field of view for the
all right well so much for that stop
sign all right but hey two out of three
ain't
bad yeah but so to use the full comma 3
field of view we need the segma to work
on the full field of view because that's
an essential part of our offline stack
um and so comma pencil needs to work and
Comm I mean to be fair I'm not sure I
would have stopped with that stop sign
either I'm not sure if that's a good
excuse I think the lens is we got to
clean the lens to oh yeah look at it
it's
dirty dirty lens dirty lens
sorry for the weird Bluetooth audio
everybody all right uh you want to clean
the lens before I engage actually it's
fine it's not going to matter all
right we're going into some traffic all
right let's merge here all right all
right good good merge yeah so it's much
more aggressive than the normal policy
is because the normal policy is quite
you know so this is almost entirely an
10 yeah pretty much all right and uh
yeah it should uh I mean yeah so it's a
lot more aggressive which is one of the
nice Parts it really knows when to be
aggressive we have very conservative
limits in the normal planner because
otherwise it would just floor it when
you really don't want it to but now it's
really this is this is really good I
know it's impressive right I was I mean
this is like almost shippable if it just
didn't stop at stop
signs yeah I think really with the wirer
field of view you know it's really going
to be quite good yeah big model looks
like it's coming to the comet 3 only who
wants to write the code to make it work
on the two I mean you guys can try I
don't know we're going to do
it yeah it is very exciting all right
looks like the lead thing is screwing up
here yeah but that shouldn't really
matter for the policy it's really just
doing what the model wants to do so I've
noticed when it gets at low speed it can
really get quite confused and then here
oh well it can't it can't this is why we
need the bigger box comma pencil comma
pencil it's in the description go go do
it there's a bunch of comma 3 images in
there oh yeah great yeah this is the
live end longitudinal Branch yeah this
is n10 longitudinal that's a little hard
on the brakes yeah every now and again
it's a little aggressive is that can we
put an alert if it's hitting the car
policy yeah we can or maybe just a
little indicator an indicator if it's
hitting if it's using the car policy at
all yeah cuz I that might have been a
car policy based thing I don't know at
least I find in the Hyundai it breaks
way too hard for the cars but it's
probably poorly tuned uh yeah the
Hyundai is weird yeah like it like slams
the brakes it's super strange but the
limits here are much uh they're much
closer we just the what we said the
following distance still
75% oh I mean that's still and it's also
not that tightly couple most of the cost
is an acceleration from the model which
has nothing to do with the
leads yeah all right we're going to let
this guy in model what do you think
there's no way he can see that comma
pencil comma pencil let's
go I don't what I found really
impressive is just how smooth it is I
feel like in this stop and go it's more
smooth than
uh than uh the normal policy yeah I
think this is pretty
good it just has much better
awareness all right we'll go back to the
streets I don't want to wait in this
traffic
yeah all right wait model should be able
to do that right Drive aggressively it
should be Drive
aggressively well now what's exciting
when this cut out it's not going to
floor it as much as it usually would
well this is making too
l but yeah this is something that really
annoys me with the normal policy is that
it'll just shoot past slow moving
traffic which is completely unreason
well that set it to something
unreasonably high and see what it does
yeah I mean it's not accelerating that
much anymore yeah yeah this is good this
is good so you see my Max is 49 and
we're going 34 right now we're going to
slow down for this turn I mean actually
I probably wouldn't slow
who oh what's it going to do I want it
to
go oh it's for this one I I slow down
for this one when I drive this oh I
really regret going here oh yeah this
this merge I didn't mean to no I didn't
mean to the hell merge I didn't mean to
yeah we're in Cora this is what the
model wanted this is what the model
wanted it didn't know I wanted to go
home well that's
uh going to the
office wow that was good that was really
good that felt nice yeah yeah that felt
like it didn't feel like it like oh I
picked up the lead car I'll let me break
aggressively yeah no it's it's really
it's showing hints of super human level
of driving wow this is almost shippable
I know right like it's like almost
like we got figure I mean I think it
slow down too much put in now for yeah
put in that put in the
office check it out all right navigate
on open pilot Let's Go fail to round oh
boy oh there we go
that was real quick with that error
message
yeah only 8 minutes away guys when we
put in this navigation with the end to
end everything yo that's just called
driving I think it's just going to work
wild wide field of view the maps I think
that may have been in the
stretch where's where's my keeps oh look
slow down for
turns wow that was cool
look at this guys pretty wild isn't it
just doing it
yeah I guess that's not the ball's fault
well it kind of is that I don't know I
don't know about that or picking up
speed that's probably not what I would
do here cuz this is the sharpest turn
all time okay never
mind how did it
know all right he pedestrian Crossing
ahead okay the model couldn't even see
that I think I think we need to did you
see no the path was straight yeah I
think this model didn't train as well
laterally as the okay okay this is uh
yes it's it's clear that it kind of
didn't the training's still a little bit
unstable to be honest oh the
longitudinal training what you mean in
RL or though the yeah so the joint
simulator training where it trains
lateral long tun okay so I'm training
one now that is stable uh but that's
going to take another couple days to get
on the car yeah yeah what do we going to
make it faster uh
be nice but it's not a
requirement oh well that's what I know
how to do I make things bad people
people keep saying it this doesn't look
like it's shipping soon what do you mean
open pilot right now would just floor it
no matter what wait they don't think
it's shipping soon what are they saying
is saying shipping soon in quotes all
right it's not shipping soon we won't
lie to
you we won't lie to you guys I just
think the trend of improvement since the
last stream we did with this has been
very very clear all right all right
let's let's put the speed absurdly high
and see if it goes absurdly fast someone
said this is as good as FSD yeah I mean
it kind of
is Yo everyone who wants this stuff
needs to lower their expectations look
like that's cool look the speeds 55 it's
not going 55 I would this is how I'd go
that's how I'd go too nice all right is
it going to stop for this green light
like a
Tesla is it going to do that's not bad
nice I don't know why it does it's like
very hesitant it doesn't like commit to
stuff this 100% someone said I tried end
to end long today and it was super
smooth and stopped at a lot of red
lights only thing I noted is that it
drove 10 to 15 miles below speed limit
on some roads oh well this was the bug
right uh
I yeah no too lucky we need comma pencil
well do you think I just couldn't see
that time well I mean it was there right
should have seen it I should it was just
stupid that was probably just a big
stupid yeah we're back by the way I mean
to be fair like you didn't have to slow
down did he do the
math I wouldn't trust it no he's going
to stop there for a
second okay I this is pretty chill right
here right like normally it would like
zip up there and
then yeah I but the the first thing I
see this fixing is just not like floor
it when there's cutout so it goes super
fast to slow moving traffic well the
really nice thing about the uh the
safety of ENT and longitudinal is
um is uh we can leave in the car policy
and we're not going to remove the car
policy but it's just like a rail right
and you can like you
can what was that I don't
know all
right one of these lights turning red
notice by the way how my speed is set to
uh
57 yeah and we're going like 25 it's
pretty
good up up up
up look oh yeah oh yeah St for red light
yeah
nice there's no is that in the Box no
probably wasn't it's just new I think it
just remembers what do you mean it
remembers how can it remember whether
it's green or red oh remembers
fews oh rememb from a few seconds ago
it's justes not like it's like you know
well we trained on the lights and the
time of day and um wait this is so Tesla
quality right here remembers
wrong it sees a lot of red lights up
there it's oh no it eventually went I
think the car is moving next to it
sometimes that inspires a oh I see what
you're
saying all right you know this is a stop
sign right blinking red no it doesn't
know
that um all right
well what are your thoughts
H it's about what I thought it would be
actually that's good yeah someone said
Tesla quality ship it I mean it's Tesla
quality we don't we don't we don't ship
things at
a almost sh it feels kind of like MSD
although to be honest I was more scared
in the FSD car at least the wheel isn't
going to jerk exactly least at least I
know the lateral is
good um well actually not really it
really didn't
converge well if we can keep the trend
of improvement going from the last few
weeks yeah I see a good path to shipping
some of these features one of the keys
to making this work was our simulator
now understands depths a bit more oh you
see just by habit I disengage in front
of the lights I don't remember that I
can just leave it
on
wild yeah all right so and can we have
some maybe that's one of our benchmarks
we have to stop at 99.9% of Lights yeah
something like that yeah I I think once
it can see them it's really going I
think so too yeah like it's so much
harder a problem to remember
yes imagine yeah imagine you you know we
should we should ship model goggles
yeah put on your model goggles and model
for a day be a model for a day and see
how well you can drive you know then
stop blaming open pilot like
let's park in the street we'll take this
to the office sounds good sweet all
righty great seems more promising than
10.3 H well you know is low
um
all you want to grab Greg yeah yeah you
say bye all right yo thank you for
joining the stream uh look I have very
high hopes for an 10 longitudinal we
have we have almost to depth net
now um
yeah try it too oh try it two yeah yeah
uh look if you want a three but are like
wow that's expensive try a two and
you'll be like wow this two is so good
that you'll buy a three and instead of
spending $21.99 you'll spend $10.99 and
then another $199 so it'll feel like
it's only $199 but two times right have
you guys ever seen those commercials
with like you know when something's like
$100 on an infomercial but they don't
want to tell you so it's like four easy
payments of
$25 yeah yeah it's like that but this is
just two easy payments of
$10.99 um it doesn't read signs judges
speed by everything in the scene that's
true uh $99.99 all right all right
office crew bye everybody bye should we
show them the new office not yet not yet
bye
that's why few people to get in here as
a person what we'll do
looks pretty cool
alright guys hold up hellfish we're
announcing simple little yup yup yup yup
yup you guys already guessed it if you
want your routes to be as precise as
this route look at some other ones here
oh that's pretty precise if you want
your precise your routes this precise
you need a gray panda so what we're
offering today is the Panda upgrade now
this is only for people who've bought an
eon from us oh and and a grape and I
should release and a white banner we
won't ever worry loyal t-turn your white
panda into a grey panda for only $100
how it works no we're not doing enough
to look at today we're only looking at
what will he do when we're all doing
this today bro panda upgrade 7 days
special get in right now I'm gonna post
the link right now on slack and on
Twitter uh so let's just go here to
comma I'll post this link let's post it
on Twitter upgrade your white panda
today seven seven day special so we're
doing this for one week guys for one
week if you send in your white panda we
will what if you buy the eon that's
great we'll send you a neon that's yeah
that's fine yeah okay you know what what
will let me let me make those change no
no it's not $99 no no no no no make it
$99.99 for pandas or 99.99 and gray
pandas are one ninety-nine ninety-nine
so we have to make it the sum right we
have to be fair to everybody here bear
we love fair let me make those little
changes to the product yeah or if you
buy any on with the order that's fine
too if you bought an oops if you bought
an Ian from us or you buy any on with
you
order to order we want to reward your
loyalty turn your white panda and into a
gray panda for only $100 panda upgrade
now if you just have the white pan and I
don't know you can't do that you have to
have bought a neon from us otherwise
we're gonna reject it I was in the
shower yeah I just took a shower guys
all right so
but we're offering the Panda upgrade
seven days special upgrade your white
panda today I got to make the pun about
gray it was worth it
upgrade your white panda today seven
days special and you just post this on
slack here you know post this in the
Panda channel so you don't spam
everywhere now that didn't expand the
picture so that's not as good as I hoped
alright cool funding for most of you by
now if you order we want to reward your
loyalty and then your routes can look as
good as these ones here see this once
this juice is any good they're gonna be
good
oh it's pretty good guys oh it's pretty
good when will you get to see this plot
and you are out if you buy a great Panda
you should see this in like probably
about two sprints for weeks what eons
are in stock of the 64 gig and the
midnight black one 128 you know what I'm
actually gonna remove the non midnight
black 128 because we're never getting
those back in stock that's never
happening so we're just gonna cancel
that product variant let me cancel that
right now yon variant of 128 delete bye
bye
deleted variant we got 64 gigs and we
got midnight black 128 gigs that's what
we got there's no more 128 normal those
are out of stock yeah perfect
they're never coming back in stock so
that's why they're there they're out of
stock midnight blacks are really nice no
you can't upgrade you 64 Giga yon to a
midnight Blacky on let's not get crazy
and guys we only are doing this special
for four set for seven days because it's
a huge hassle
we'd like to support people who've been
loyal to come ai you're definitely going
to want the upgrade if you want any of
the new features you're gonna get faster
calibration you're gonna get driving on
maps only with grey panda no the
midnight black rider is pretty standard
but see this quality is only possible
with a gray panda so make sure to buy
your gray Panther today where do you
send them it's written right in the
thing you just send them to our P o box
in San Francisco California we're
trading in the fusion today and that's
what we have the pan to upgrade you get
a brand new gray panda it includes all
this stuff it includes and antenna
includes an antenna mount and it of
course includes the Panda so just just
send those in turn your white panda into
a gray panda for only $100 seven days
get your ship today we can you know what
I'm going to take a look let's take a
look at what you'll be getting
take a look yeah GPS antenna has a
Python library
it's called u-blox D it's part of all
compiled it we're gonna be releasing
something better soon but just to show
you guys what you'll be getting you'll
be getting a gray and the gray right
here brand new this is the shell stream
for a new product the white panda the
grape and upgrade so you're just send in
your old looking white panda like this
one right here
what oh you're right you're right I'm
terrible we are turning the white panda
into a gray panda get your upgrade today
the upgrade the upgrade yes absolutely
right the name is what makes it so yeah
if you've bought an eon all you have to
have botany on we're gonna cancel your
order but if you buy any on with the
order we will absolutely let it go
through yes we love to bring new people
into the EON community so get your great
pandas right now
little image of a big fat arrow that
goes both ways
all right cool bye-bye scope ease bye
bye bye bye enjoy enjoy the upgrade get
your upgrade today how many upgrades if
we ordered let's say you want to check
let's just check quickly let's just see
how many we've gotten so far let's see
if this is a popular product or not
let's see let's see let's see let's see
one two three four four upgrades okay
keep them coming
daily scope is new developing this
weekend I think so I think we're gonna
do it cures never getting upgraded again
no you can't send way back after you get
grey you gotta send the white first why
would I trust you you'll upgrade to
every scope it sounds good later scope
is buy shopping icon without a you
know the URL the upgrade is going down
seven days that's it seven seven seven
alright
let's go bees 33 miles away show me that
[Music]
yeah we did stop by flying today George
got Co oh yeah so we were over piling to
the urban sprawl of Colorado we got ways
up here navigating us for fix toboggan
ways last night big victory yeah it's
really smooth
yeah right anyone out there got any on
run we sold the neon last night yeah I
get there first person to get the Rio to
be honest yeah make it but Basil's got
USPS to deliver Amazon so that's the
real religion of America right
but people got yawns today vanilla girl
is telling us that really somethin Ella
girl USPS really hasn't been on the
slack I don't know what's up service
yeah they have literally Oh baby that
I'm good yeah Wyoming is actually really
nice there's just no t-mobile yeah yeah
there's no service
virtually Chris got his nice taking us
through the urban sprawl of Colorado
yeah Colorado's nicely generate you see
see where we're engaged if you're caught
up in a nice engaged up here Emily
what's the MOA said you're gonna stop at
that moment
there's bowling Wes do you have to go to
see the tour Oh Mall of America oh boy
Colorado we got a turn turn right and
I'll be nice and now you linked to my
sensor over there you know that that car
is gonna pass and now we got nobody
night you should automatically slow up a
little Jeff nice if you can do that okay
say is it clear to do
yawns happy staying cool
of course you know in this car if we get
below 20 miles an hour it turns off its
gonna turn off yeah Common Council to be
too rough
oh sorry what a big poofy
a bumpy oh yeah for paracin this Marcel
since it's a nice loft
this
just open finally give us better MSG
we're getting 32.8 right now in DG bomb
which is pretty insane given that this
car is rated for like 429 I mean any
cruise control will improve your
efficiency yeah
not specifically open palette you know
style of staying like far back from the
car in front of it will also improve
your efficiency because the less you
accelerate and decelerate the more no
it's car than the CVT but literally like
if you're trying to get from point A to
point B the less yeah like if you just
take the absolute value of acceleration
and take the mean of that the lower that
is the more efficient actually going
lower speeds is generally better too oh
[Music]
that's the same bug we've he's saying
the stock cruise on his rav4 has the
same false positive issues Oh
we're obviously using the same radar on
BC the nice thing about open pilot
versus the stock system is when the
stock system messes up nobody knows
right you just like now we know a little
but oh so we get all this back and we
can analyze that data so what's
happening is on the radar has this flag
for whether a point is measured or
computed and something the computed ones
will drift over into your lane even when
the real object does not but you need to
rely on the computed ones in the rain
on the truck as being in front of you on
a corner
yeah well corners a whole different
problem how it's just a lot better at
that because we have a model that
predicts where you'll go and does just
use your car y'all right
I'll be yes you guys are hopefully gonna
get to see a speed like a resume driving
man you'll be speed to low kind of thing
right here yeah we're just gonna get a
comma cancel speed you low again yeah
see that's cool
yes please once I'm above 20 I can hit
the button resume the cruise controls
talk to do that
well pods pretty good at urban sprawl
ready to drive the flat roads of Kansas
that we are
see what its gonna do here this looks
like that guy's going down that guy's
going there someone she confused Oh
golly good job good
we should show it so we're gonna change
it to show your scent speed when you're
in the ways you like this
so could you make it steer it steers
yeah Toyota will steer all that have a
zero as well but it's just going Prius
will go to zero there's miss Bunter
assume we fix all facts yes
turn it on Mulberry Street hurry there's
a real baby
oh man berries blueberries raspberries
[Music]
[Music]
car with auto parking but no LK can
autopilot be ported yeah Paulo we were
looking at 50s this morning around not
so much Colorado now Ralph boys are kind
of common again poor whenever you have
suburbs around yeah well I miss you Basu
bees which switching I need fun for open
pilot Toyota rav4 drive but which
switches all depends what you want to do
with your giraffe yeah Oh slash
another's get that io / Drive I think
yeah yeah that will show you what
configuration you want for your giraffe
depending on what you want to do yes
we're still undecided on how far east
will go
my f-150 has electronic steer assist
yeah we were watching some video park
assist with our f-150 2011 f-150 has
alright let's see if we're gonna get a
fusion with this UPS truck probably not
it's probably unrealistic
maybe there's a maybe that's a neon on
that
why was that if the car so it will pick
it up eventually the problem is it has
to do a fusion with vision if a car is
fully stopped cross got bigger you have
across the size weight changes babies do
you do that because you're a sturdier
shit gets bigger cross more sugar that's
smaller than it's like too small now I
agree that's a change which card is open
Patrick best I'm pretty happy with like
right here the torque from the toy is
helping us out specific this car is
struggling a little on the highway but
the urban sprawl the rare force is
killing her
good day Colorado's a lot of movements
problem that's right
Yeah right how crazy is that that that
thing is going ways and driving your car
and yeah
sounds French should you make everything
disappear
is Priya's Prius aimed to open it as
normal
the Prius taxes the case tonight because
the same as in oak trees Brian I would
love to see any stock says to drive it
as urban sprawl right now one of those
hearings on that
oh there could be I mean I wonder
villain why does he have his left
blinker on just going behind dr Brazos
right after we park the car don't do
that
she'd be quiet the exact time I like
that I was feeling that been turning bad
snow basically if you wouldn't use
cruise control you shouldn't use this
last night we sell our traction quite a
bit like there were signs I should say
to turn off your Christmas yeah I never
think you are to be fair the traction
control on this car is really good yeah
we don't even have snow time so we have
like Olson fair ball seasons yeah
turn it off go get another get higher
I'm giving em Airport this house just go
straight
[Music]
people ask me for a wrap
[Music]
[Music]
[Music]
we'll probably write a blog post at the
end of this trip we say the same thing
to a Brazil do the same questions every
school right and ignore a lot of yeah
we're gonna try and compile like a blog
post the question of is my ex car
compatible with open fire
we have the list too
we're on our way to Denver you guys I'm
excited looks like I was here like I was
driving it you can just take it
advantage with people
oh yeah I'm front of them listen
California everyone's so aggressive you
can't even big people a girl in
California we don't get the New York man
no it's way worse I know I think it's
way worse in New York no you don't
understand like so anyway there's so
many worktops in New York so like you
can't really be that again sir that's
true no one's ever gotten there's no
cops in San Francisco San Francisco is
an occurrence I feel like wow
hey joe romeiro another deadly is deadly
you're live what the kilowatt I know
we're live I can express my feelings
about the poor leadership it's a success
can still be just learned and had the
personals dad but the end of every
political career will hopefully give
birth to something new a beautiful
oh there's some of your tools in
Colorado where they charge you like
every few miles that easy enough
everybody like a few cents every mile
we're 60 miles
Wow so the normal you have to say neo
Paradis settings
when you pair it with open palettes salt
if your Neos paired you login did you
login maybe we didn't change the pairing
dialog
Oh instead of Guiana he is still running
loves himself
it's not like we said
yeah I did it just like so
61-59 my love the banshee fabulous idea
oh yeah
people who VP questions should be banned
so that group of people are just being
paste people already have some questions
later
what are you doing this for what is the
need I'd like to actually know
right where's we have pots maybe dance
oh yeah reporter all right Oh someone on
your fork oh nice oh by the police
about it's not illegal you guys wow all
streams get breaks go because they ask
question they are they've repaid
questions that people already asked oh
yeah these like they have og content but
they don't don't freak people
they take people on real people
don't worry we're not talking too fast
we're driving exact specs driving
exactly
I'm sorry
but they can't accelerate this big truck
they're trying to get over the trunk
this doesn't squeeze their way now
we should be
Beverly Hills
it does feel better when you think
there's more people looking at the neon
neon next to each other is incredible
that yeah and the sign is so good
exactly what we want to do look at an
iPhone X compared to like an iPhone 7
you're like wow but really I agree this
is the future right yeah it's scary how
quickly like you look at something new
and the old thing just looks it looks a
bird
I got a new back yourselves the neo
never looked good no but I got a new
MacBook this year just looking at my old
MacBook and if you guys think the eon
looks good well next year no I mean
things only get better right that's how
things work that's technology well some
companies make crappier second wow
that's
oh yeah any other warm
got some more
oh yeah we got we got fly has got flying
JJ dude it's already here though that's
awesome George got a triple XL xxx out
yeah I was going for the double XL
double XL like at Marshall Mathers but
right
still waiting for that exit
we have told you this
what's the O with the medicine is a 128
64 gig it's double iw like space you got
more space you can fit more drives you
can download more songs on Spotify you
can install the exclusive open pilot 128
gig it didn't just impress you just
record for longer without uploading if
you're driving across like Cordoba I
don't even know if Cordoba is a real
place but they mentioned it in Bojack
horseman you should right now you do if
you're installing it now it's zero point
three point nine not zero point four
open pilot won't boot up unless you have
a cinder
well or if it connects to Wi-Fi right
then yeah if you have the tethering
settings yeah try but we didn't like we
were out of service
we're out of service and we're only
because we're only doesn't actually
mobile so we couldn't boot our yawn this
is running a pilot chipper plus can move
without a sin
once we got service my food
and we could engage
when making videos on the end is there
anything virtually Christmas applause in
the settings like Donnelly
like clear out not really that's not
really a secret it's not like someone
can use that information to like access
your drives or anything your dog laddie
is maybe kind of like your license plate
right so if you think blurring out a
license plate is important flare out of
don't let it
but obviously everybody else in the
world can see you
I'm an assembler
there's no secret right Douglas come on
your internal user look at this driving
through this construction
a little bit more than making that
chicane
mr. Canton
just that quick tight shirt
what back in accent yeah we're losing
sir too far to the left
okay this is the thing it's afraid of
the wall it knows to stay away from
walls but like just a really a wide
it was a minimum Lane
the Scottish
remember guys oppai was a level 2 system
pay attention at all times I don't know
maybe I think cuz that truck was over
terrible to him
you can use this on places where you try
them on the right-hand side of just cuz
I don't like the idea there's still left
drivers that's why this damn it
bloppy your governments people
all right it's get again out of the
walls gone yeah there's a furball
what is there there's chick-fil-a here
there's chicken I loved you so they
walked right
chickens is that what is there one right
here
thanks that how far away your wife
suffered I guess not for chicks ouch
yeah yes yeah I mean I guess I did eat a
chicken nuggets
but the a chicken two dollars oh wow
that is Christian commitment right yeah
but it's good marketing like I want it
more now good job Scotland I didn't have
an opinion on Scottish independence
before but now that I've heard that
Danny come
yeah my life City
I really like this is a few Chick Corea
periscope at camera womaning we was into
this song last night called periscope
and we were very disappointed that it
wasn't about you guys oh yeah that's
cool what a kaleidoscope kaleidos goes
law enforcement is on interesting
tired - what all time sometimes our ways
to take exits yeah soon TM now we got a
ship peanuts first after ship peanuts so
honestly probably for that not until the
second half of next year
but yo you all see what we're doing
honestly if it's green and that bar is
going down I can't be doing this right
yeah let's do that bar if I touch the
steering wheel the bar goes back up to
fall right yeah the code is low and if I
press either pedal it disengages so I'm
gonna press the gas right now this is
the age right now obviously it
disengages on the brake and then the bar
will reset as well with speed changes
the bar will reset with sweet changes
good fix that bug yeah and I also wanted
to show your sense be here while you're
changing your speed when yeah if you're
in a different
we call these absolute I think so yeah I
mean there are literally ways and
Spotify right like they're running an
EOS which is just an Android port that's
how we can run Spotify anyways it's just
like it's just like it's an Android
phone yeah it's a modified version of
Android to go remove a lot of the crap
so he can't drive
you know that's fixed we got an Amber
Alert once you're used to get Amber
Alerts
shut it all of that
very deep work out
people are joining us against how many
pots goodbye yeah I'm gonna do out there
or bar but what do they get out of it
like I give those links in Paris compost
like it's not like they're talking about
like hey man you know when does window
0.4 come out alright check out this free
viagra okay I don't think they even let
you post links even without a link they
could still be shilling for something we
don't have that we don't have like go
here go to crypto kitties and buy some
kitties today you know who didn't
Facebook Facebook live because they're
promoting Facebook live they want to get
people on periscope right that's the
only person I could think of who would
have an incentive yeah it's a mess with
periscope or maybe YouTube maybe YouTube
YouTube and Facebook seen it like why
don't we pick periscope just because the
Twitter links to Twitter you really love
Twitter I actually think Twitter is
partially responsible for tearing the
fabric of polite society apart yeah but
I think Twitter knows this to it that's
why they have to a Canadian character so
that you can bring it back together with
another
go for that um see these two the bar
reset when I touch the wheel but no no
no because you can actually express a
much more nuanced than fit into a T then
you can at one forty one forty all you
can do is scream
there's gonna be less to eat
last week how do you measure engagement
from character for dreams
it's not going too well for that you
leave in the car do you take it out
maybe usually leave it
yeah marry ons have security so so it
takes one of our yards we can hot track
them down pretty fast
and good luck turning it off are eons
have security oh we should ship this
attorney stuff to everybody said I'm
like yeah yeah get stolen you can like
you know do like to catch a predator but
for Young's turn on the front facing
camera today
yeah posted posted on Reddit you know
this person yeah so we can trigger the
cameras with all the new stuff not on
you're not holding only on our total
wiry
yeah all our games right yeah
just like all the Tesla's all your
Tesla's are on a VPN just all our eons
are on yet we may eventually put them on
a VPN like Tesla but once it's way more
consumer we wouldn't do that for
something called Afghan
you can pull a you're fast now you
complain about me going slow can't make
it I'm happy 70 miles per hour going
downhill
climbing lane one half of my life you're
into climbing brother
check out this Lane actually you know
what people can't realize people think
like all the pilot like waivers a little
bit there so do keep yeah people hit the
leylines on blogs yeah
my County but so many times you hit the
link yeah yeah it's at four oh yeah but
like Obama still shouldn't waiver being
that should make this all a lot better
see like that was soon as well
well it's more like it's about waiting
you're doing right right and we're able
to sit back and judge it yeah like if
you were to hit the lane I'd call you
out as well no I don't think you would I
really don't think you would I mean I
make a face I don't know yeah there's
rumble strips everyone in the car kind
of good one yeah just a detective
accelerometer I know right we need
microphone it's detect honk miss awesome
honk detector of the factor we got well
we also need an actuator to hump yeah a
guy by the bay like I'm talking about
yeah we don't want to see you in a
level-4 car beside gas brake it's
tearing they're like honking I'll get
our best engineers on yeah the word is I
can actually yeah
the only question is is the button tied
right to the relay or is there some way
to like trying to contribute it was
actually electronic at least on this
contest that will add that to shiver
yeah right where you'd like having honky
music to do anything literally if you
have a panda and a car and Scheffer we
can make ship or honk for you what
exactly does that entail okay so you got
like TomTom here deep map bunch of
companies thinking that they're going to
rent seat and make money by licensing
the map to car manufactures I am going
to figure out what's on HD maps that
people want we're gonna use our massive
data sets and resources to create those
HD Maps and then we're going to give
them away to further our continual war
against rent-seeking
have a damn
see that massive arrival
it's Rocky Mountain National I phone X
looks deadly to the reality that's what
however a Apple's really gonna sell
there a are good goggles yeah yeah I've
seen the IKEA app Ben I do you like set
up your house Mikey's gonna kill it they
have the this furniture happens well you
can virtually place furniture and now
they've bought TaskRabbit oh right so
you're gonna be able to virtually set up
furniture and then click the make it
real button throw you have your blinker
on bro bro so you'll make it real see
we're about to run out of this bar so
we're gonna get a user distracted
I mean if someone's book will always
hire people if they're good so I could
just like tap this they didn't fix the
bog he didn't go away right away I
thought that was fixed
that's the plank and if you're watching
this and he's incredible we should reach
to telescope he's Andy was commas 2017
Employee of the Year
you know doing an incredible job with
chipper with with the UI you see now
growing his team goalies team and now as
a three-person team it's the only real
team okay all the other teams are one
person too
yeah productive you get a team money
image here um because we're not dama
curving alright so what a lot of
pictures do so this is actually what the
world really looks like we don't so a
gamma curve basically accentuates the
middle and drop oh sorry accentuates the
ends and like drops off resolution
around the middle we could have a curve
it we will we well but by 0.5 we're
gonna start we're gonna roll out like
all the HDR features and stuff and also
60fps video these these eons can all do
60fps 1080p HD video they look really
good we might even use neural networks
for adaptive shutter speeds so if you're
going under a bridge you'll know how it
needs to adapt the shutter speed to keep
[Music]
my dream is like for the end of next
year to make videos that just look
unreal like like you described you know
what the iPhone acts is probably doing
this right now yeah cuz they're using
waters Apple has great yeah nobody those
are you saying you're saying it looks
better than reality my gonna make
something looks better than reality
other people and not not plenty in the
next year what we say about open pilot
is like well open pilot in conjunction
with a person that drives better than
people open palette by itself just not
even close to drive as well as a person
I'm a new low for winter but yet the
safety case is you drive you know I'm
sitting here open files doing some stuff
I'm doing some stuff
they're not that much
see adapter shutter speed for that
bridge that's what your needs yeah
a guy acting like a supervisory model on
top of all the powers side you know
and predicting when it will mess up
correct
but you know it saves me CPU suck
all those video features for open
palette as well
oh yeah yeah yeah shaver buzzing all the
pilot are gonna stay pretty much in sync
shaver pluses is okay without the
controls the advantage to shipper plus
is you get a bit more cpu so like ways
it's going to run a bit faster and stuff
my 60 fps
y61
ok so right now we're doing 20 so 60 is
a multiple of 20 and no one's ever heard
of 40 MPs and it's also the max we can
do across the camera bus if we want to
keep so it's actually across the cameras
we'd actually be getting 4 megapixels
back to the sensor which is which is
double technically
but then wewe downscale it doesn't fit
in the background all right
alligator alligator
yeah
I like
we did we put whatever our spot where we
got any song requests please still going
keeping my hands on the wheel when we
pass that instructs Beyonce
I like that
[Music]
a wall
[Music]
[Music]
[Music]
Hey look everything it'll use a little
bit more
not too much
[Music]
the long song yeah I would like the long
one
[Music]
so much more
Oh Oh Louie is okay well it will segment
be running on that you know why you walk
that do it we do good I have the second
I've been running across your videos
right now
[Music]
baby uh committee offer that download I
don't know I used only see the use
school
he's in the nest mm like when asked mm
what else could it make it a little
champagne around that a car kind of uses
be tender you know about beat a like it
that car is a beat and like 5,000 rpms
like the Pistons start going further
digging deeper into the end inter and
you get more power in Tennessee Tech do
they still make us mm now they stop they
like 2004 and 2009 with two years I
think only two years Wow
or maybe all through those years I don't
know the 2009 us left
maybe so for I don't know
yeah they're great I was debating we
Pecola David I've I was debating a
Porsche Boxster that's 2000
there's a cool car thing
you know you know there are you know
it's made the motivation Wow who'd have
thought a four-door sedan is the new
cool car now the Tesla Roadster red but
ya know it's like really really there
aren't any cool cars the car looks the
same
any any song requests in scobie's
Lobo fans Chuck I found it this is the
best way to use your healing yeah don't
cover the camera you feel that
but obviously Rochester
anyone's house but your favorite cars
favorite car
I had a GTI for a while manual GTI
that's pretty sweet
it's one of my favorites no no I just
like hatchbacks a lot
[Music]
and we should recommend that you rubber
duck yeah you'll want to see this
do another time complexity of one
it's a little kid like he's in Russia in
the music video
Russian like Stalin just put some
Russian he's actually huge in Russia
like shout-out to his Russian Gustav it
might work you can also have been doing
Spotify you can obviously do it for your
from play on my yeah that's a driving
well tell them we'll all see him at the
meeting at 10 yep from the car we'll be
driving you like to drive them as though
11 yeah yeah well deserve it well be ten
for us
[Music]
the one I was thinking is that cute Jeep
that's like like a very cute city smart
card with the X lights the X ray does it
have doors yes
Oh week oh you gotta get rid of the
doors totally the cool wall I still
gotta watch Grand Tour bantha such a top
gear fan
watch enough
like you've ever been collared Oh like
you said like a side of the room and
then like we'd like to go she ate we're
like what a good TV on my side couch are
your son there's the GP they would watch
stop here
and then you have
I like GTI but if you're gonna buy a car
the Civic is really nice car my favorite
car is Maybach
was that word me
maybe maybe rolls-royce phantom he
doesn't want to blows for it
another thing about Craig could
potentially get you know yeah
no but like I'm saying like I want a car
that's like light down babe our family
used to have a Mercedes estimates you
know so it's the poor man's poor clothes
but I want a car like that I want a car
is like new bad back allegedly it has
two cameras that read the road and
adjust the suspension by matically can
do incredible things you know I don't
bet they don't they don't the phone
without like a test it's nice but like
it's a luxury clock look I would say the
build quality of Model S is worse than a
build quality of like an Audi a4
we actually we were just going we
actually recorded this video two months
ago actually
come on we're going living in it's like
the Dharma Initiative though we still
have someone set up to ship the eons in
the pan bro-bro the speed under 75 bro
bro you proud that bro gonna swallow
cooking with 57 right no I thought that
was a reckless no
what is this not distracted don't worry
you I don't like the bright side song Oh
bright side sounds like a little peep it
sounds like your feet right doesn't like
will keep all night Lavelle alright
let's see it's bright side and come over
when you're sober
how many we got see the 65 sought out
for us we respect all authorities you
expect the long one back the law guys we
reviewed the Ten Commandments
[Music]
I don't know what STPs but what is is
the prime one just mode the bigger
battery power it's a different body
everybody's telling me life's short for
I wanted not
brain
that a fourth appease the garden
always right there
the Thornton please just passed me in
the right lane
just calling them out is that legal
could check there because we got the
Panda doing the red in the loo
Colorado does have a lot of prisons
really you know bombers in the cupboard
like they they have like this place
bestowing Terrace roarsome making what
you have a big-name Terrace in Colorado
their cars in like 95 Unabomber was a
word with the code but you know because
you is the University and Airlines Bob
and now they like scan all packages for
explosive and yeah dick she's up there
for just one guy but above the shoe done
the guy put his bomb is underwear and
like we knew what that was going but we
drew a line we drew a loner yeah now we
have those devices
no you're on to be honest yeah that's
what we have instead liveability
every time one terrorist comes up with
like some stupid failed plot we now have
to spend another billion dollars that's
a new security
people are outraged about that machine
like I'm saying how it like sometimes if
I Miceli unique if I'm at the airport
early and have time to spare I will opt
out just to be difficult just like other
people are like rushing to make their
flight I'm like yeah you should get that
if you just do you say it's easy
[Laughter]
bomb 3
you have to really interviewed for
gratitude yeah like an hour I'm scared
to go to Israel like they were there
doing the grilling stuff along - yeah I
went like
[Music]
[Music]
my vision check are we like close
[Music]
[Music]
yeah that's right that's why Mathieu you
keep them
my friend actually no that's still a bug
for that but I am gonna watch the bar so
right now it's on rad I'm going to touch
the wheel and now it's back to green
I wish this roof were taller so I could
like really like this is a pretty good
spot
but this pop-up camper we haven't it any
stability hey George you should move
your seat back a little dangerous
only yeah only if it's safe
it wouldn't let you put your seatbacks
toyota that would let you see back
dancing
yo my amazing filming us cause back up
to 52 we were at 36 for a little while
oh by the way we're crushing it right
now 32 that was before me
this is what I live out will beep dream
yeah yeah
if anyone ever goes to what time I mean
last night you got to give a plug for
Homewood speeds
uh-oh the Homewood Suites in our Rock
Springs box for sick man so those senses
for dollars yeah we each got our own bed
all the breakfast this morning about
waffles so you still got a banana
somewhere
[Laughter]
[Music]
I'm sure it's a great place it's like
sad like that's what we know it
I got a hand on the wheel off
I'm not touching you we respect all
authority
some people drive with their knees look
as long as you can drive statistically
safely I don't care yeah all right you
can't drive drunk because statistically
you're unsafe yeah can you drive I
really would love to see some large
guest stars clearly not as dangerous to
being drunk
you have slower
[Music]
go go go go three three miles
you
you can get all your logs Cabana your
data is your data and export we don't do
this for like the reason like it's
difficult is really just this we're lazy
we're gonna work on flex would've every
day
same think of your CLE donor how much
your plea donor you want to put a lot of
cars on mud shiver or open violent what
we can do is we give you a back-end
account they can access or believe
just like like say someone like monitor
say upbeat Boulder wanted to buy and
kyon from all their cars and we'd be
happy to get that fielder access to all
those evils right my friend last night
was fun yeah any bless we don't do
business development you have to like
buy all the eons first and then say life
you know what I'm the buyer of all these
eons I want to register to this account
but not gonna like do phone calls with
you click literally until you go in a
store business development
well people will Tracy had a breakup
they were things I never liked they were
like made together cock boy click man
many people we got leave y'all a little
bit do you guys like want to come to
Arby's with us I probably yeah
Center that I haven't said that much
time in Denver proper really once I
think I stood
yeah it's really nice like there's a
free bus that'll like take you across
the whole stretch in the downtown
not again sandwich shop three bosses
yeah Fairless square in Portland hope
it's still a thing
almost describes it right there take off
that light round
the phallus curve was great I remember
2004 come to Poland or I'm going this
paradise man it's a free rail it's free
it's free that's all please call Perlas
marriage thought was the most incredible
thing like through that before I'm like
14 and like wow I can get her out
[Music]
this car in front of us reminds me
another cool car like is the Fiesta ST
real tiny that afford it supports the in
here is sucks with the turbine but
driving in itself all right
it's got a 1.6 liter and the only
[Music]
oscillate the only acceptable car for
makes an f-150 that's what you're really
good at yeah that's the only also sell a
one liter fiesta that gets like 35 miles
per gallon wait a jump point for though
driving is better it's just that the
experience is so much better
that's for that we did the us we WI yeah
yeah seriously night doesn't happen a
zero point three point nine yeah it's
it's the old you I know waves on Spotify
it just kind of seems like the old one
the driving is the segment
yeah
right into the Sun hands yeah hey I
can't see ladies yeah it's it's hard it
looks like there's this extra strip here
that looks like anxious trips - all
right first real disengage wow that and
the wall good we went like 50 miles
would like to indicate
[Music]
- y'all at the ferris wheel
videos
I love cities I love civilization we've
seen a lot of non cities I mean they
would call themselves
many retired and use retirement speech
you mentioned Budweiser I loved that I
loved that the first thing is I'm going
to go home with a drink and ice cold
blood wise he's saying it the second
time the second time you think I'm gonna
go home I'm gonna drink a nice called
and you're just expected him to say
Budweiser he's like beer
they didn't pay for the shoutout twice I
[Laughter]
don't know I mean that might have even
been like the next level marketing
campaign Budweiser's like the second
time sake beer Budweiser
I mean exactly right everyone's Dignan
like the second time it would have been
totally like damn you sponsored by
Budweiser like by the way guys we're not
sponsored by armies but if any of these
companies would like to sponsor us we
would love to talk but only if you make
it very easy for us like we don't want
much from you if you would just give us
like it camps you could reach out and
give us I can coupon for like a bucket
right like an eight piece chicken bucket
we would like shout out KFC in every
periscope I'm the easiest guy like but
that's the thing I know exactly what
they're gonna do they're gonna reach out
to me with their shitty business
development team we're gonna have phone
calls and they're gonna want to put in
like fifty thousand dollars like bro I
want your fifty thousand dollars all I
love for you is a free bucket of chicken
and I will shout you out in every
periscope literally tens of thousands of
committed people who now want to buy KFC
have you seen how many people watch our
periscope replays yeah drivers to use
over I'll say anything on the Internet
it doesn't matter cuz it doesn't matter
man what are you gonna do you're gonna
regret article about me and make me lose
my job I'm off CEO itch and the Lord I
am the board we do board meetings naked
they go to seven anyways back soon yeah
they can control the erosion peace to
the scopes
i like the way it
opened up
[Music]
you
i'll see
forget if you turn your back on me
yeah oh yeah but guess where we'll
listen to the ml right here
on spotify
let's see how part of salt lake
ways ask me if i'm still going to salt
lake city
i'm always the passenger bros
the co-pilot
you cannot switch lanes but you just you
just uh inch the wheel over and then
back up
but yeah so we got waze
spotify
a driver
it's all there
we got 32 scopies out there oh wow i
don't know if there's scopy stuff thing
today do people like scoopies
they never give us use that
like bros pewdiepie is picking up bros
go pros
people people want us to go 100 miles
per hour
that's against the law yeah what goes
faster it is 80 here though pushing it
up yeah go 85. it's cool there's not
much in nevada
is it nevada or nevada
nevada nevada
in colorado
colorado
sweatshirts for sale no white hoodies
are not for sale
we got hoodies uh 129.
all right so
i'm so confident i know i said yesterday
that t-shirts were 20
but i lied
uh we looked at how much little peep was
selling his t-shirts for on tour and it
was 30. yeah so considering that this is
me living out my dream of being like
well peep
they're 30.
does everyone have an estate after they
die oh no or you just call it that i
think only if you're the kind of person
who gets assassinated you have a mistake
if you get murdered you don't have to
stay yeah
wait assassinated burst murders yeah lil
wayne's got some lines about that by the
way i'm not loving this album
i don't know
oh yeah our sunroof is closed we're just
gonna open that up yeah
can you make a comma little piece collab
shirt whoa oh we have to get little
peeps estates permission yeah we got to
call it we respect
intellectual property we respect
intellectual property bros
but
only because we're in america that's
right if we was in china or my own
sovereign country yeah
then we would that's right
so yeah
oh come a little windex oh now now that
that's that's that's a lot more
achievable you know i might know some
bros and no little windows yeah
uh
tour oh trying cars on the tour just the
wrap that's coming that's ambitious to
you guys
yeah we'll see how many people are there
uh if it's only a few yeah you guys
could try the car yeah so don't tell
your friends um but if it's like 200
like we might be getting at some of
these places
then uh
look at the car yeah yeah you can look
uh no we'll see
we'll see
uh we only have this car with us though
you think we're like a convoy yeah we
programmed the other cars to just follow
us
i wish pack mule
it'll be nice when you can do that we
could just fill it up with merch yeah
all right let's give this song a try
untouchable
oh yeah vanilla gorilla's bringing his
civic
oh yeah
[Music]
what a view right
a good shot
showing them out
check these out all right like
stalactites
what is that little encampment what is
the mountain a little town
you want to go to the encampment
yo we got we got a four-wheel drive
we'll go off grove
yeah look at
porn same shit same shit social foreign
[Music]
let's go let's go all right let's listen
to uh
oh my god
it's not great
to win i think
or is it the fact that i was using
spotify
nobody knows no one will know this oh we
didn't check if the eon was the up today
oh yeah
oh man this one eminem was good
when was this what year is this
2001 i think
no like just listen to the difference
you guys sorry wait both turn around and
look at me for one second
i don't know why all the fuss about me
[Music]
son of a bitch
is
[Music]
[Music]
maintains it right
okay this shot is beautiful
what this shot is beautiful yeah this
music is beautiful
it's broken kind of coloring
look at how beautiful this is though let
me give you guys a gander
that live man
no they i see pete did a slim shady diss
track called slim anus
damn right slimming this i'm a
right
we should listen to some icp
oh we should this is this is the miracle
oh we lost service oh no
we'll have to wait for miracles yes
oh wait but the scofies can't be
watching this anyway because you're
doing a service mobile also are you
still going oh
but now the label was afraid that fred
gibson would sue them
censored his line about the kids at
columbine
uh
miracles
okay it shouldn't say no sim when
there's no
service i kind of wanted to return the
eon a few times
but now you're happy we just filed bug
reports yeah
yeah
how many people you got
wow
miranda lambert and mike stud are what
comes up when you start to type miracles
wait no
is icp not on spotify
how's your work on binocular slam doing
pretty well i have to remember not to
cover the camera while i'm using this
thing oh yes
yes
i really want to go to like a juggle oh
[Music]
spread yeah 81.
yeah someone's asking the speed limit is
set at 81.
yeah the speed limit here is
you can't change lanes automatically but
you can change without disengaging
is
look guys snow beautiful look at that
all right maybe we leave the periscope
yeah yeah we're going to leave you we'll
see we'll see you we'll see next time
you see us utah
yeah utah
Who wants to want the tape? I can do it.
The scopes like to be held like this, I
believe.
Oh, can I undo the lock?
Oh, yeah. I'll do it.
It's a little It's a little tricky on
the iPhone X. Got to go. Got to go down.
Oh, no. I did it wrong. You got to go
down from this one. Got to go back.
Morning, Scopies. Well, no. It's 2 2
p.m. here.
This one's 2 p.m.
It's noon. Yeah,
it's noon. probably 5:00 somewhere. Um,
what are we gonna talk about? All right,
guys. So, check out my visitor badge.
Yeah,
they let me speak at an elementary
school this morning.
I don't know who who allows this.
I don't know. I really don't know who
allows this. I spoke to a class of
second and third graders and I spoke to
a class of fourth and fifth graders. The
second and third graders, Elon would
have been proud of me. I told them that
they should study physics. They were
studying Newton's three laws. We drew a
free body diagram of a car. Um, we
talked about the forces acting upon the
car. They got most of them. Friction,
air resistance, gravity, the normal
force, the gas, the brakes.
Um, yeah. So, they were uh they were
pretty good with that. And I told those
kids to study physics. Now, it's the
older kids, and I'm really talking about
how the youth are woke, man. I told the
the fourth and fifth graders that they
were computers and to think of
themselves as computers and I think they
were fine with it. They were fine. The
teachers teachers the teachers were not.
They looked worried.
Yeah,
they looked they looked very worried,
right? But I think the kids uh So, I'm
just saying guys, the kids are going to
be okay. So, that is the good news. Let
me tell you all the bad news. Wait, how
many scopies we have?
Uh 50. Welcome garage door guy. It's
their first day. Welcome garage door
guys. Their first day on Periscope. All
right, so I'm going to tell all you guys
the bad news.
The self-driving awareness tour was a
dismal financial failure.
How many did we sell?
Zero.
One. One.
Oh, we sold one.
One.
Oh, we sold one.
We sold one.
Yeah, we sold one.
Did we actually?
Yeah.
The self-driving awareness tour was a
dismal financial failure. except our
Bcash.
Bitcoin Cash was the most profitable
shit.
And the guy's now talking about how his
donation at that amount was a mistake
and he wants 90% back. Now,
we're of course honorable people and
we're going to send him his money back.
I'm still trying to figure out I'm still
trying to use Block Explorer. It's not
even working.
All right, Bitcoin Cash, guys. We were
honestly paid to shill for Bitcoin Cash,
but not even We weren't even paid. We
were just like, "You just have to give
me a suggestion and I'll shill for it."
We were not paid.
We were not paid. No. Like, guys, if we
were paid to shill, we'd be rich right
now.
Um, I just set the speed up. I think the
speed limit's 80 here. No, the
self-driving car awareness tour was a
dismal financial failure. And now we
have the next thing to talk about, and
this is a very serious thing.
Commai,
just like Wikipedia,
doesn't run for free.
So, um,
I don't know how much longer we're all
going to be around.
Like, I can't bring myself to take more
VC money. I just can't do it. I can't do
it. They're scammers. Like, I can't
bring it. Like, oh, let them sink in
their claws with a series A. And then
before I know it, I'm hiring a corporate
communications department, right? And
corporate communications departments are
one step towards becoming the companies
that I despise. And Viv, what? You got a
good quote before.
The best way to not get to a destination
is to not begin the journey.
Is to not begin the journey. Oh, with
begin, it's even better. It's even
better than like I was going to say
start.
Vivian Ford of AI, you can you can all
quote her.
Thank you.
You're going to one day have like a
page. TM TM.
Um,
so everybody,
Loop 9 said, "I'd pay to watch these
live streams." Honestly,
please, please, you don't have to pay
for the live streams. That's of course
free, but please go to shop.com.ai
and buy things.
People want to buy shirts. They're
saying they want shirts.
Tell your friends to buy things. All the
swag is going massively up in price. I'm
learning from my friends at Givvonce.
Givvanchon. Yeah.
I'm buying one of those Givvanchon
hoodies, one of those $13 $100 Givvon
hoodies when I get to New York because
honestly, do you want to know how we
really made money on this tour? We
hodddled Bitcoin.
Yeah.
Yeah.
Which is pathetic and terrible. H AI
right now. You know how I talk about
profitability? That is projection. We
are right now not profitable.
Hats would be great. The the the scopies
are saying
Q4 of 2018 of 2017 has not been a
profitable quarter.
Let's start the auction for uh beanies.
Oh, we're going to auction beanies.
Yeah.
What what what are the scope? What? What
would you guys pay for a hat?
You can't build You can't build Okay.
When you look at Elon selling hats,
right, Elon maybe made $250,000 off
those hats. Do you understand that's
also the reservation price for one Tesla
Roadster?
Like all the work put into hats or a
single Tesla Roadster?
$30 beanies is the consensus.
Uh we could do $30 beanies, but guys,
we're never going to grow into a
profitable company by selling beanies.
We have to sell eons, pandas, and
giraffes.
AJ Alissa of something says if you made
it more consumer friendly, you'd blow up
overnight. You want to talk about that?
That get into that gets into corporate
communications.
Yeah. See, and that's worse, guys. You
know what they say? I would rather die
with dignity and honor than sell out.
Die on the hill of dignity.
I will die on the hill of dignity and
honor. I'm I'm just I'm just putting
that out there. You know what I mean?
I'm big on not selling out. These are
old school punk values here, right? Like
old school punk before punk sold out.
That's right.
So, that's the real problem. But the
youth are woke.
The youth are great. That's the good
news,
guys. I've had a lot of people ask me
like why why are they called pandas
and like George asked the kid and every
George asked the second and third
graders. Every single kid said because
it's black and white.
Like society makes you dumb.
Society makes you dumb. Everybody
and like we asked we we held up a neon
and George was like what what is this?
And they're like, "It's a phone.
Everyone said it's a phone,
right?"
And everyone else is like, "Uh, did you
guys make custom stuff?"
Oh no, they're really Oh my god. Okay,
I'm not going to say his name, but this
is a guy who runs something that's in
our space, right? Who was in our car and
competing and like I let him hold the
Eon and I was telling him about how we
have an external GPU in there. I just
let him go with it. He's like, "You guys
have an external GPU in there?" like,
you know, not not like not the
What do you mean?
You thought there was like a GPU.
Can you tell us who it was after?
No. No, it's not appropriate to call
people out like that. But I'm like,
"Holy shit, you're literally holding the
thing."
You're right.
The kids would know. Oh, no. It's a
phone in a case.
Like every single kid,
they're so on it.
Remind me if anyone out there seen like
The Little Prince where he talks about
he draws this picture and every adult
thinks it's it's a hat. It's like, yeah,
it looks like it looks like a a hat, but
in reality, it's a snake that's eaten an
elephant. And only a child only the mind
of a child could conceive such a thing.
And they just they know.
They know, you know.
I'm 12 forever. You know?
Yeah.
Or like Metro,
all right, I'm banning a bot. I just saw
a repeat comment
like Metro says 17 forever. 17 forever.
You know, you guys know that song's
about statutory, right?
No.
17 forever, but we can get away with
this tonight. Yeah,
dude.
Metro station, bros.
Whoa.
Um,
yeah. Wait, are we on the radio right
now?
Are we on the radio?
We did We did a lot of uh Sou Falls
radio.
Um, you guys know how the TV in Kansas
City went? I think I terrified the poor
reporter. Yeah.
Um, we did we did a demo today for
press. Is that right?
We should no long wait. Yesterday we
talked about how we were no longer doing
demos.
But I I still do demos.
George still does demos. I'm not really
sure why.
You know what? Like my wife said, I just
couldn't say no. Right. That's that's in
Kanye's last song, right?
Say Kanye says that.
Is he talking about Kim K?
Virtually Chris said he's willing to
help help support the community. We
thank you. Virtually Chris.
Virtually Chris, you are helping Chris.
Your videos help already. We are big
fans. Someone's asking, "Are you making
corrections when grabbing the the
wheel?"
The wheel. Yeah, it's windy right now.
It's windy. So, okay, we have a there's
an angle offset learner in the uh in the
code, and when the wind changes, the
angle offset learner has to relearn, and
this thing's got like a slow low pass
filter, so it takes a little bit of time
to relearn the wind. Once we have good
localization shipped, see things like
pigeons. When we have good localization,
it'll be able to adjust for the wind in
a couple seconds like how a person does.
But right now, it's getting confused by
the wind.
Uh, someone was asking when Open Pilot
4.0. It's actually 0.4.
0.4. When that's coming out,
when the release is going to happen.
Hey, if anyone from comm is watching, I
think we're ready.
Yeah,
I think we're ready. Look at this nice
shade of orange, guys. Yo,
when you change it,
you see when you when you change that,
guys. Let me show you.
When you change the set speed, it
changes that speed of orange.
Then it goes back.
Yeah. And then it goes back, right? We
worked really hard on that shade of
orange. That took three iterations.
Yeah. Beautiful. It is.
We're super happy with it. It shows the
uh I got along with speed. It shows the
uh
the
parts uploaded. We might even be merging
in uh RDX support. Acura RDX. Someone
out there got our stuff working on the
RDX. Um so I'm not sure exactly what the
status with that is, but um
congratulations. It's close enough to
the other stuff. I think we can probably
merge it into uh
virtually. Chris said, "I need to make a
new video ASAP because I think people
keep building Neos, but they got to buy
Eons."
They got to buy Eons, right?
Maybe put a link to your in one of your
videos.
To be honest, I will announce this. Eon
sales have outstripped the number of
Neos we've seen turned on.
Yeah.
So, we are selling eons. We just aren't
selling enough eons yet to sustain Comet
AI. We're actually not that far off.
Um the Shopify store is doing so much
better than this tour.
Yeah.
Um the Shopify store sells more in a day
than we sold on this whole tour.
Yeah.
Yeah.
A lot more. How many pandas do we sell
total?
Like six. six grand as I can.
Yeah. Wendy and I thought we were going
to sell out, too.
Yeah. Yeah. But um we brought our last
Guys, I don't know how Lil Peep does it.
Going on tour, it's not profitable.
I mean, Lil Peep's tour is profitable.
Well, that's You know what it is,
though? Lil Peep sells tickets.
Yeah.
Honestly, I bet we did pretty well with
t-shirt sales.
Yeah.
Merch merch sales are okay.
They're a little expensive for folks.
Yeah. No, but like that's what Lil Peep
charged and he's going to the Midwest,
too.
Are we Little Peep?
I know WWLP.
If I'm the Little Peep, why am I doing
this?
Gregory's asking where are we headed
next?
Oh, to uh What's your place?
Lacrosse.
Lacrosse. Minnesota or W? Wisconsin.
I don't think it's Wisconsin.
I think it's right on the border. I
think we can like walk to both sides. I
think most of it's in Wisconsin. Yeah.
Yeah.
Yeah. So, that's our stop for tonight.
Plan on going to an open mic night
there.
We're going to open mic night at the
cross.
George is going to do some uh slam
poetry.
Poetry, guys.
Slam poetry.
Yeah, check it out. Soundcloud.com/to
cruise with two zeros.
Kelly boy asking, "Will you carry on
supporting Neo, too?"
We're not going to do anything to
intentionally break it, but we're not
really going to test on it.
Y
um no one paid anything for Neos from
us, so we don't really feel bad doing
that. Uh, it's kind of like Revby pandas
or the original board. They still work,
but expect to have to do a bit of
maintaining yourself a lot more than
than eons where all the stuff.
Yeah, we just don't have the manpower to
it's honestly it's manpower, guys. It's
it's not even like a planned
obsolescence thing. It's like uh, you
know, it's it's it lowers our release
checklist.
Yeah.
Yeah. Loop night was asking about uh
someone who has a some kind of store
installing these for people and selling
them. Hey, we're big fans. We can
definitely do volume discounts. We've
already sold some pandas with volume
discounts. We can do volume discounts on
eons.
Um so yeah, if someone's looking to set
that kind of stuff up, can uh hook you
up with some good deals.
Definitely.
But yeah, guys, I'm like Jimmy Wales
here. You know, Jimmy Wales is he's not
going to be able to afford fivestar
dinners and first class tickets anymore.
Guys, you know what we were talking
about last night? We were like, "How can
we cut back on me?"
We were like, "We
I don't I don't get a salary." Um, I
think we're gonna
We do eat. Maybe you could stop eating.
Yeah. Arby's apple turnovers.
Oh, yeah.
But seriously, guys, I do want to Yeah,
that's pretty sweet.
Um, we're going to we're going to cancel
my health insurance. It's a scam anyway
if Obamacare allows it. Can you cancel
all insurance and not pay tax?
You still need to pay. That's the
problem. Oh, I thought we had freedom in
this country.
Freedom.
This is just no freedom.
Like Jimmy is on. He said he tried that.
Tried what? Canceling his health
insurance, I think.
Yeah. I had
guys virtually Chris says he puts a note
on everyone's car with Honda Sensing to
buy.
Oh, nice.
Thanks, VC.
VC, that's amazing.
Killed it.
I had to I had to pay one year the
Obamacare fine. I was so mad when I
found out about this.
Yeah. I told Cory that he needed to pay
if he didn't have health insurance. He
was like, "Are you kidding me?
This is a joke." Like, I thought we had
freedom. I'm all for universal
healthcare, but this is bullshit.
Yeah.
Um, someone was asking about bulk
ordering. You can email support at
common.ai.
Email support. Yeah. Yeah. Yeah. We can
we can
We'll talk We'll talk. Yeah,
we'll talk. We'll chat.
Maybe you'll talk to Tim or we like raw
numbers. We like raw numbers.
Yeah. Please, if you want to talk about
bullshit, email bullshit, aai and it
goes to Dev Null. Yeah,
to be honest, I'll respect you if you
email bullshit at com AI. I'll read it.
I still won't reply, but right away like
as long as you know it's bullshit.
We have filters for certain words. I'm
not going to say what words cuz then
people might not put them, but they just
go right into the I guarantee
you guys know what the best form of
partnership is, right?
A purchase order
or pull request.
Well, pull requests are great forms of
partnerships, too. They all start with
P, but two of them are real.
Keep in PRs for both.
Yeah, right. We're replacing the PR with
PR. RS and POS. No P's.
Yeah.
Ps. I drove the speed limit's crazy
high. Why you go slow?
All right. I'm banning all these people
that are repeating.
Banner.
Does blocking it ban them or what?
Yeah. Hey, someone bought a giraffe.
Thank you.
Yay. Thank you.
Yukon Dar 91.
That's more giraffes that we sold all
trip. Did we sell any giraffes?
Um, yep.
Oh, we did. Yeah, we sold one giraffe.
Okay, we're now tied from this. Let's
see, guys. Guys, we're up to one
giraffe. Let's see how many sales we can
get on shop.com.ai
right now. We're shilling for us. We're
not shilling for Bitcoin Cash.
Morris is asking, "How many employees
does KA have?"
Too many. We're going to have to do
layoffs.
Yeah, it doesn't matter.
Layoffs, guys. Layoffs.
If you're out watching at K AI, there
won't really be layoffs. Don't worry.
We'll just have to rent out parts of the
office.
Yeah.
Yeah. We're going to Airbnb the office.
We're going to Airbnb the office. Yeah,
there's like a lot of room in the
printer room. So, you know, we just
stick some beds underneath.
But yeah, guys, if
someone's asking about the P feedback
loop again,
if we're not profitable,
are we using a P feedback loop?
Barely anymore. It's almost all feed
forward. A lot of it's been switched
over to MPC now.
There's still a little bit of Pness to
it.
A lot of it's MPC, which is a predictive
control.
It was never even a P loop. It was a PI
loop. No D.
No D. No direct.
No D.
Why no D?
I don't know, man.
You're not into the D. No D. Uh yeah,
I'm not into the D, right? You guys know
the Crips, they don't like words that
like have B's in them.
Just like
Oh, no.
You know, the Crips don't like they like
words with
C's.
It sounds like we could actually make a
lot of money renting out a room in the
house to see how we operate. People say
they love to stay there.
Oh, rent.
Yeah. Yeah. No, what I really want to do
is build some of those. Uh you guys see
like the homeless people in San
Francisco started to build like tiny
houses on the street, right? I want to
build a few of them and Airbnb them
as like a hipster experience.
Yeah,
I think uh I think it could totally
work. Wow, really really wants to go
over there. That wind rose.
The wind is wind.
Any more comments? A lot of them came
all at once. I couldn't really read
them.
Yeah, read them again.
You guys should do an Eon giveaway. To
enter, you must buy a hoodie. That
doesn't make any sense.
That makes no sense. But hoodies are
going to be priced. We have to sell
Oh, yeah. Guys, guys,
everything's doubling in price.
Prices are going up January 1st.
If you want to buy anything, I'd say
remember when pandas used to be $88.
Oh, those are the good old days.
Everything at get it early.
We're the opposite of the normal
hardware startup that like prices
insanely high and then lowers. We price
reasonably and then make it less
reasonable.
Like, rest in peace, Navi.
Rest in peace, Navi.
Yeah. No, but if you don't want Kaii to
end up like Navi, shop.com.ai, AI, buy
stuff, tell your friends. Um, because,
you know, it's it's a hard life out
here.
Um, there's there's a there's a Wired
article this morning talking about how
startup founders are not the good guys,
we're the bad guys.
Oh, someone's asking, "Did a major
investor pull out?" This sounds like you
guys are panicking.
Oh, no. I'm I'm just I'm just I'm just
messing with all of you. Well, no, we we
really are broke.
Yeah, we're we're not panicked.
We certainly not You know why no
investor pulled out? because we didn't
let any investors pull in.
Yeah. [laughter]
I really hate most investors like like
like the way they talk and the language
they use. I'm just like I don't want to
be a part of this scam.
Yeah. Bizarling.
No, no, no, no, no. A lot of people
email us to invest. But you see, that's
the thing about investment, right?
You want to sell what you produce. You
don't want to sell your soul. I don't
understand companies who celebrate after
they raise an investment round. What
you've done was literally just sell part
of your soul.
Yeah. Someone was asking, "Aren't we
almost profitable?"
Almost.
Yeah, we're almost, you know, we were
hoping we'd be profitable on this tour,
but we weren't. No, we are almost
profitable.
Yeah, it's true. And we want to do it
that way. It's just
we we we are looking at a profitable Q1
of next year, but yeah, I mean, that's
how we got to do it.
That's how we got to do it. We have not
had a profitable quarter yet.
Beat the system. Uh we've definitely had
profitable weeks, probably even
profitable months, but um you know, our
first profitable quarter will really be
uh that's how real companies matter
shit.
Yeah. Vanilla Gorilla's joining the
scope. Welcome.
We're talking about how the self-driving
awareness tour was not a profitable
endeavor,
but Vanilla Gorilla is a huge supporter
of us.
Vanilla Gorilla is a huge supporter of
us. We definitely thank you. We thank
you.
Make sure to track your panda from Sou
Falls in the next 24 hours. We will do
that, Isaac, via the website. Yeah,
we'll see if we get more orders from the
places we go.
To be honest, guys, if you place orders
right now, we'll ship them out tomorrow.
Yeah, we're gonna ship from uh on on the
road. Someone just ordered a whole zoo,
a panda, two giraffes, and a neon.
[screaming]
[cheering]
You're making money.
Thank you. Who's that?
CB Vegas.
CB Vegas. Thank you. We're going to be
like cam girls or gamers the way we
shout out the people who bought things.
[applause]
This is the teleathon Periscope.
Yeah. Yeah, exactly. The youth are woke.
Go to shop.com.ai
right now.
I'm No. Well, well, seriously, we're
shipping out tomorrow. We have like What
do we got? We got nine eons in the car.
Um I think
plenty of pandas.
A bunch of those are kind of already
committed. But yeah, if you get in right
now, you'll get one of those eons.
Yeah.
Uh we got like 30 pandas probably. I
mean, more than half of those are sold,
but like
Jamaican Joel's asking when our pigeon
pre-order is coming out.
Oh, pigeons. Well, we're going to give
away the first pigeons. We're going to
give away the first pigeons to people
who are top eon users probably second
week of January. If you are a top eon
user, I don't care if it's open pilot or
shiver plus. If you're a top eon user,
maybe the top five will get free
pigeons.
Cutting into our profitability, but we
give away.
No, no, no, no. We're going to give away
a few cuz they're the demo hardware,
right? We we always give out So like Rev
B Pandas break themselves.
Um Rev B pandas have like a serious
hardware bug and after you flash them a
bunch of times, they break themselves.
But the nice thing is nobody paid a
dollar for every pandas. So we got to
but we got to see
commented but
well commented but it's just our money.
So that's kind of our like our alpha
hardware program. The alpha hardware
program, you know, we don't we don't
want to charge money for bad hardware,
right? Yeah.
We definitely want to stand behind what
we sell. So we give a few away first,
make sure they're good. Then once we
know they're good, we'll charge money
for them.
Uh everyone who's asking what's a pigeon
is is you can check out the pigeon
channel on our Slack.
Um All right. No, no, no. Maybe maybe
it's time we talk about the pigeon.
Um, no, we don't talk about the pigeon
yet. No, we don't talk about the pigeon.
Buy stuff shop.
Keep it a mystery for now, but it should
be coming out in early early 2018.
Pigeons will work great with your
existing zoo. Uh, pigeons connect. They
don't work with the Neos. They do work
with the yons.
People are upset we teased them.
Yeah. Well, you know, shop.com.aii buy
things.
Y
George is a cam girl, basically. He
likes
Hi. I I'll I'll take off this uh
sticker. The next person who buys
something, maybe after that I'll take
the fleece off.
Okay.
All right. Too far.
Laura Hoffin, do you guys pay yourselves
out salaries or literally the office?
Everyone gets a salary but me, guys.
Yeah,
I live in the office.
We have an intern that lives at the
office.
You guys, you guys know when I will
start taking a salary, though.
I'll take a big salary. Let's be
profitable. We got to be profitable
first.
We can't cut into our profit.
No. Seriously, to every CEO out there,
if you have an unprofitable company, you
should really feel shame taking a
salary. It's disgusting.
It's really disgusting.
Yeah.
People are like, "Oh, yeah. No, we lost
the company $30 million, but uh I get a
$2 million bonus." Why, bro? Why? You
literally had one job as CEO.
Um but yeah. No, once once we're
profitable,
reinvest most of it, everybody gets
raises, and I get a salary. But um no,
that's still that's still a ways away.
We have a lot of reinvestment to do next
year.
A lot of reinvestment. Yeah,
a lot of reinvestment. A lot of growth.
Um probably looking at a salary list
2018. But the good news is you hollow
Bitcoin and uh
don't matter.
Don't matter.
So Luke 9 shoe put a red comma.ai box
logo on your hoodies and sell them for
$300. They're going up to
Oh, hoodies. Hoodies are hoodies are
going up to $250, guys.
Yeah. You used to get two hoodies
for$129. Now you only get one. Hoodies
are about to go up to 250.
You're about to get half a hoodie for
129.
Half a hoodie.
You get a half hoodie coupon. And then
once you get two half It's like the the
thing like the ring toss game.
What is your plan to win the autonomous
race?
Oh, I almost was telling the youth about
this.
Yeah, that was a good tell them what you
told the youth.
Yeah, I told them what I told the youth.
Okay, so look, every self-driving car
company out there is learning from a
fleet of vehicles, right? There's no
other real way to do this. But every
time Whimo wants to add a vehicle to
their fleet, well, they have to go out
and buy a car. So, it's maybe
cars are cheap. Cars are only $30,000 to
30 to 40, but then they have to spend
like $200,000 on sensors. They got a lot
of expensive liars, sensors, and
computers. They probably got to spend
another h 100,000. n probably probably
more like 20,000 on the retrofit. So
we're looking at $250,000 for the Whimo
car alone and then they have to pay a
driver. So adding a car to the Whimo
fleet costs Whimo a lot of money. Adding
a car to the Kama fleet actually makes
comma money and that's the distinction
and that's how we're going to win.
Yeah, that's it, right? They're paying
for something that we are getting paid
for, right? And this is a lot like going
to college, kids. Don't go to college.
You want an education, go get a job at
Google. You'll learn more and they pay
you.
Vanilla Grill is asking if he can come
build pigeons with you.
Maybe.
Yeah, I'd accept that.
We got to We got to Yeah, we got to We
got to build some pigeons, man.
We got to build some pigeons.
Come build them. Get the first one.
Uh, when will you guys be selling
hardware with Open Pilot?
hardware with open pilot. Uh
maybe a year. Yeah, maybe a year. I
think about it. So, when we do sell
hardware with Open Pilot, um so right
now we only sell dash cams fairly
unregulated. When we do sell hardware
that is designed to drive a car, uh we
will have to um register as a as
probably I'm not 100% sure on this, but
the way it's looking now is we'll have
to register as a vehicle manufacturer
with Nisha. So there's a bit of legal
overhead there. Um and then there's a
bit of uh liability risk where you know
right now you downloaded software from
GitHub. Um so just just just remember
that when it comes to right software
liability is is is is great and it's
what allows things like open pilot to be
possible. Um for us to for us to give it
away like this um before we before we
actually sell things with open pilot we
need a few things. We need
um money for the legal overhead. We need
to make sure our uh reporting stuff is
very very reliable. Right. There was a
man in in Pennsylvania who swerved
across four lanes of traffic in his
Tesla and caused an accident. And then
when he was stopped by the police and
they're like, "Why'd you do that?" He's
like, "Uh, autopilot did it." And this
is what he was reporting to the media.
And then of course Tesla dug into the
log on his logs on his cars and he had
never turned on autopilot. So we have to
make sure we can prevent scenarios like
that with good logging. And we also have
to make sure we understand what the
classes of disengagements are and report
that to users much better. We have to
make it like very clear in the user
manual. Look, here's a scenario where
your car could mess up. We have to know
kind of what roads people should expect
it works on.
We got to we got to work up to that.
Yeah. So, I think I think uh probably by
the end of next year, we could sell even
this hardware with with Open Pilot, but
for now, we only sell dash cams that uh
that you can modify. And the reason you
could modify them is because what kind
of a hypocrite would I be? This is like
a line I give now if I uh didn't let you
modify your products however you saw
fit.
Yeah.
That you paid for.
Lawrence Hoffman is
Where can you pay for them? At
shop.com.ai.
Go buy.
Have you had offers from major
automakers to get bought out?
Yes. Um, so here's my here's my thought
on getting bought out.
I would be fine with being acquired by a
company who wants to continue our
mission. If some company if I believe
that getting bought by a company would
further what we are trying to do here at
KAI, I would seriously consider the
offer. The truth is if you get bought by
a major automaker, you're going to sit
around for years before you ship
anything like Chris.
automakers aren't going to let us not
not going to let us
letting Cruz do it, right?
Well, no, but see, Cruz hasn't really
shipped anything yet, right? I I I think
that there's going to be I don't know. I
don't know that much now. I knew a lot
about at the beginning of the GM Cruise
relationship, but we'll see. We'll see
how long before it's actually in
consumer's hands. I mean, you see how
extremely conservative Wayo is being.
Extremely conservative.
Yeah. Um,
well, they have no major incentive.
No, they Oh, they do. Oh, man. You know
what Whimo should do? They should bring
on Travis Kaknne, the CEO.
Yeah,
I would actually be afraid of Whimo with
Travis the CEO.
Yeah, but that's impossible. They never
do that.
Not impossible.
They would never do that. Come on.
That's so anti- Google.
Well, but hey, man, it would be a great
move, right? Look, look at Uber falling
apart, right? Uber just got regulated in
the EU as a taxi service. You think
Travis would have let that happen? No
way.
Travis, we're here. We're trying to help
you out. Um, I would love to see you
make a job so you can return to the helm
of Uber.
And hey, if you're interested, Viviccom
AI.
Yeah, if you're interested, if you're
looking to be CEO AI, man.
Oh, Vanilla Gorilla said he's sending
his resume to you. Viv nice was a chill
dude.
Vivid commai. If you're looking for a
job,
oh man, if you're looking to buy things,
that shop.ai.
We sell everything you see here is for
sale. All of this hardware and this
software. It's not even for sale. It is
completely free at
github.com/comai/openpilot.
Actually, not this version. This version
hasn't been released yet, but it will be
released today or tomorrow by the time
your EON arrives. If you so choose to
modify it to install this software,
you'll be able to.
Yeah. Wow.
shop.com.ai. Let's see. Are the orders
coming in? You want to check if the
orders coming in?
Let me check. Check. Check if the orders
are coming in.
Yeah. Yeah. All right. No, I'm I'm done
with the sticker, man. But no, I have
high hopes for the future, guys. The
youth be okay.
Really impressive.
Kids never sell out. I don't understand.
Are the same kids who listen to like,
you know, Anthem by Good Charlotte. Grew
up to be some of the scumbags I meet in
society today.
Um, but yeah. No, so that's the problem
with automakers. And we also got
approached by automakers who want to
work with us, right? automakers who want
to maybe put our technology in their
cars, right? And when we first started
Common AI, I thought that this actually
might be a possibility. So, we would
entertain meetings. Remember when we
meet with the automakers? It
was before my time cuz when I joined,
you were like before your time. You did
a few when I was there. It was really
funny.
Oh, yeah. We used to have these people
in, right?
They'd like walk into our house and like
not know what to do.
I will I will call them out. This one I
will call out. Jaguar Land Rover came by
and like I don't even really remember
what the meeting was, but when we were
leaving,
they asked if we could call him a taxi.
I'm like, uh, you know, this is this is
San Francisco. No one no one really
takes taxis here. You know, you want to
call like an Uber or a lift. And she's
like, I would never take an Uber. It's
not licensed.
Stop it.
No, seriously. Oh, you didn't hear that
story?
Oh. And I'm like, okay, this is
hopeless,
right? I just took you for a ride in a
uh you know a self-driving car with a
computer in the back seat. Like I mean
this is even before it looked less
polished than this. Then I'm like this
is hopeless, right? But it's not even
like you know it's it's
passed by some police.
Oh, mark them on ways.
Mark them my ways. But first let's make
sure we're not getting pulled over.
Yeah. Yeah. I think we're not getting
pulled over. Every time I see a police
and I like watch him in my rearview
mirror and I watch him go away. I hate
getting pulled over, y'all.
Yeah. Yeah, you get that feeling in your
heart.
You get that like little feeling in your
heart. I'm like, I don't think I was
speeding. The open pilot was driving. My
speed is set to 5 miles over the limit.
It's probably going a little slower cuz
the car in front of me. In honor of the
police, we're going to put it down 2
miles over
378. 378. Today's total sales 1,623.
1,623. All right, guys. You
Today's orders eight. Good.
Oh, yeah. You can make this go up. We've
made $1,600 so far. shop.com.ai
right now. Shop.com.ai.
Please buy our things. Selling our
things is the only thing that makes us
profitable. It's the only thing that
funds great things like the self-driving
awareness tour because someone's got to
spread awareness and awareness ain't
free.
Someone's asking if Open Pilot slows
down for emergency vehicles like when
there are sirens.
No,
no, we're not at that level yet. The the
Open Pilot will slow down your vehicle
when the car in front of you slows down.
Yeah. uh using the built-in radar in the
car.
Better hope the car in front of you
slows down for emergency vehicles.
If the car in front of you slows down
for emergency vehicles, you'll you'll
slow down, too.
But um you know, it is a level two
system. You are still in control of the
vehicle at all times.
Yep.
Even too low.
Oh no, we got
WE ONLY HAVE A GALLON AND a half left.
I think it's like two gallons. All
right. All right. Should we do the
Toyota gallon challenge?
Yeah.
Where we just keep going? Let's just
keep going, guys. Guys, fuck it. I'm I'm
just I'm I'm ready to die today. New
experience.
Just kidding.
Just kidding. Just kidding.
I'm ready to run out of gas, though.
Yeah.
Um, no, but honestly, I don't know, man.
How long before Okay, so the car says we
have 16 miles left.
All right, so we actually know that it
has another
at least 20. So, we actually have like
50 miles left. Toyota, you know, I don't
know why we didn't realize, you know
what I was saying yesterday about the
news? Like, if you know something about
like, you know, the news, right?
I know we should.
We'll say you're a farmer, right? and
you know a lot about farming and you
watch what the news says about farming
and you're like, "Wow, this is all total
total crap." Right? And then you watch
the news report about AI and you're
like, "It's really interesting the way
they're making a person
an AI a person in Saudi Arabia."
Right. Right.
You don't have that same critical eye to
realize that's all bullshit, right? And
I don't know why that like humans aren't
good at thinking about this, but like we
fell into the same fallacy, right?
We really did. The speedometer on the
car says that we are going 74 miles an
hour right now.
We're actually going 70.
We're actually going 70.
So, if the speedometer lies to you, why
would we not think the gas gauge lies to
you?
Yeah. Well, we knew it lied to us. We
just didn't know by how much.
We should have guessed that it was an
outrageous amount. We thought it was
like 10 miles.
Well, we we'll we'll stop for gas, chill
for a little bit, then we'll get back on
the scope and we'll call it buy things.
shop.com.ai.
Yeah. And we're just going to show
today's an all day
tele. This bridge is brought brought to
you by an eon. A comma eons that can be
bought on shop.com.ai.
Shop.com.ai. Go buy things. Yeah, the
bridges. The overpasses.
Yeah.
Sponsored by us.
Sponsored by us.
You're in charge of reminding the folks
about how the overpasses are sponsored.
I will. Every single one. It'll be
sponsored by a different item, but it'll
always be sponsored by
Oh, that's good. That's good. Oh, man.
Yeah. Yeah. Yeah.
Three for a curveball.
Yeah. Yeah, we really put
And if you guess the correct uh one that
we sponsored, the correct product that
the bridge is sponsored by, you get to
buy two.
Yeah, buy two.
Someone said those hidden gallons are
used to cool the fuel pump. You could
burn the fuel pump by running too low.
Oh, damn.
Oh, damn.
Wait, how do you use that to cool the
fuel pump?
Doesn't make sense.
Hey, let's see. Can we like Does ways
work to the point that I can like ask it
to like take me to a gas station? I'm
not really good at using ways. You have
to have a certain number of ways points
by the way.
Oh, I got to have ways points.
You really do? Yeah. Yeah.
Oh, man. This is bad as you might be a
baby Wazer, which you should check.
I'm not a
You're not even registered.
Oh, I don't like registering for stuff.
Land drives.
Much better experience.
Where are we going? I'm a passenger, of
course. Oh, gas.
See if you're allowed to.
Well, let's see if it's also smart
enough to realize that I don't want to
go 5 miles that way. Yeah, I think the
coffee. Yeah, we
know. We know. I hope so.
We should get some more coffee.
Yeah, we should.
Oh, we could always get more coffee.
Yeah, I only had like one cup this
morning. I didn't have any at the place.
Yeah, I'd like to eat my
I had two Arby's apple turnovers, which
sound like a great idea at the time,
but uh yeah, ways is weak. Uh-oh. What
if there just are no passes?
I was thinking that, too. I was like,
what if they're actually not lying to
us?
No, like guys, we have 12 miles.
Actually, Chris was saying he can't come
to Philly anyways, so he's glad we're
not going.
We're done with the tour, folks. This is
it.
This is This is someone a Scopy's
calling you out that you missed an
overpass.
Oh my god. You're right. That overpass
is brought to you by the Kama Hoodie.
Doubling on January 1st.
No, it's it's too late. We can't We
can't We can't We can't
check out these nice windmills.
You guys can also call them out if you
want. If you see a man overcast before I
see it.
Guys, we we learned something about
windmills.
Yeah, I was going to tell them about
what we learned about windmills.
You want to tell them what we learned
and then I'll tell them about the
challenge. You tell them about the
windmills. I'll tell them.
So, we you know, we're looking up at
windmills, how much power they generate.
So, most of these windmills are rated
for about 2 to three megawatt.
And I was like, no, call me out saying
there's like no way. Yeah.
So, it's more like it's more like a few
hundred kilowatt.
I don't even I think that's generated
what's generated on a normal day. I
think in a whole year we generate about
8,000 to 10,000 megawatt of power.
Well, yeah. Yeah. Advertised over a
year.
Yeah. Yeah. Over the whole year.
It's like 8 GW.
No. Yeah. 8 Gallen
see if there's gas station.
This is a challenge for humanity.
Humanity in general.
So, we looked up how much power humanity
was using. But I think if it wasn't even
a terowatt.
No, it wasn't.
No, it wasn't.
Yeah. It was like
So, we're doing a terrible.
No, it was it was it was like
disappointingly small.
Yeah,
maybe it was just America that was only
using like like
China used more than America, but we
used
China is more than America, but it was
still it was like 500 gawatt. It was
pathetic.
Um, so I think conservation is one of
the dumbest ideas ever invented. You
want conservation, go back and live in
the stone age, right? Efficiency is
great. Electric cars, great. Things like
this that can use energy more
efficiently are great. But we should
also be using more energy. So, I'm
challenging right here on this Periscope
humanity to the 10 terowatt challenge.
By the year 2025,
humanity should be using 10 terowatts of
power
a year. Well, it's not a year. A watt is
only a unit of it's a watt is a jewel
per second, man. So, we should be using
10 terles of energy per second on
average.
I think that Yeah. on average obviously
you got to like like the humanity uses
different amounts of energy at different
times right
um depending on which country's in the
light and which country's in the dark
but uh yeah I think that that oh okay 7
miles to Warington
um I think that humanity can do it 10
terowatt challenge guys but really like
let me tell you why conservation is dumb
right like a lot of people you know
they're like oh I'm a conservationalist
and I'm all for things like conserving
you know conserve the rainforest
conserve you know biodiversity these
things are when it comes to conserving
power like we can just make more power
and making more power is actually one of
the greatest things you can do to
increase people's standards of living
right standard of living is highly
correlated to how much power you use I'm
giving you a little bit of a heads up
you know all right um but yeah no if we
can use more power as a species we can
raise everyone's standard of living
conservation stupid efficiency See?
Great. More power. Great.
Yeah.
This overpass is brought to you by the
Kayi Panda. $99 by December 31st or $200
by afterward after January 1st.
[laughter]
I don't know if I was saying they were
trying to help us.
I don't know if Panda's going to go up
that much.
Just pass the gas station apparently.
Oh,
no. No. We have one in 9 miles.
We have one miles. We We got We got Man,
we got time. But this is a Kamei Panda.
They're for sale in our store for $99.
Um, right here you can see that the
Panda that's actually driving us right
now is here. This is just the exact same
Panda that you can buy um for only $99.
Uh, it's a universal car interface. It
connects the this port on your car to
your USB port and your Wi-Fi of your
computer. So, it's a bridge from cars to
computers and they are available for the
amazingly low price of only $99 right
now at shop.com.ai.
So, if everybody could go there and and
buy a panda, and if you buy in the next
10 minutes, I'm pretty sure that you're
going to get your panda shipped out
tomorrow. If you buy a week from now,
we're all going home for the holidays,
so it's not going to ship out till New
Year's. But if you buy right right now,
I think we really only have like 10 of
these left.
No, we have plenty.
Well, no, no, no. But like the other
ones are already committed. I'm sure we
got enough orders to ship out the rest.
Oh, yeah, we definitely.
Right. I mean, all our orders that come
AI are on PIO. So, there really only are
probably about 10 of these left um
available this year if you want them to
ship out tomorrow. So, you can buy this
at shop.com.ai.
That's shop, which I don't know how to
spell.ai
like artificial intelligence.
Yeah. Next item you can buy is brought
to you by uh this bridge, which is the
giraffe for a low low cost of $60. For
$60, you can get yourself a giraffe. You
see that? This giraffe already has a
panda attached to giraffe.
[clears throat] But you can just unplug
this panda right like this. Separate.
This is a Toyota Giraffe.
This is a Honda Giraffe. We of course
have these available right here in the
Kameai mobile store. But since we do not
have any more stops on this tour, we're
going to ship out all the items in the
mobile store to use Scopies at home. Go
to shop.com.ai. buy it right now only
$60.
Virtually Chris was asking about uh
updating a Panda with an Eon uh with the
restart of the phone. That is correct.
Uh your Eon will flash your Panda if
necessary. It would restart it.
It's me, too.
Uh why the animal names? We we explained
earlier how pandas are pandas. This is
very straightforward. It's black and
it's white.
Like a panda.
It's like a panda. And the kids were
they were they knew it right away, you
know.
Just don't let society make you
overthink things.
That's right.
As an adult.
And don't let society make you feel
guilt. Guilt is the worst emotion ever.
And none of the overpasses are brought
to you by guilt because you shouldn't
feel guilty about anything. You should
wake up and you should feel
unless you did something really bad.
Oh yeah. If you did something terrible.
Some people just wake up and they feel
guilty about like eating the last
cookie. Bro,
don't feel guilty.
Treat yourself. Treat yourself.
Yeah. But don't really treat yourself.
Obesity is a major epidemic in America.
Um,
remember we saw the ad for the Arby's
like double baconator and then for this
freezing your freeze your fat off.
It's just like come on America.
Yeah. Come on America.
Yeah.
We will create your problems and then
sell you things to remove them.
Yeah, exactly.
We didn't create any of your problems.
We just sell things to make your life
better.
Yeah. the day that I'm creating your
problems. I'm a miserable guy and I will
never do that as long as I'm CEO of Comm
AI. This is why I can't work in
security. Security is a huge scam. It's
fear-mongering. And then, man, let's
I mean, we're kind of doing
fear-mongering by saying that comm is
going to shut down and that you must buy
that.
No, no, no, no. But that's not
fear-mongering about something you
should worry about in your life. That's
very different. Fearongering would be
like if we talked about like car crashes
and I'm never going there.
Yeah. Yeah.
We talk about how it makes your life
better.
improving the baseline, not like
something for you to worry about give
you anxiety. It's truly terrible.
Techim says capitalism and Yeah, we're
about it.
Yeah, we are. Yeah.
Yeah. Capitalism, look, like capitalism
has flaws, especially when it Whoops, I
dropped the panda. Good thing I was
distracted. Um
Yeah, but uh no, capitalism has flaws,
but it's a lot better than what we've
tried before. And the real problem with
capitalism is rent seeking. As long as
you can avoid rent seeeking, capitalism
is great. Capitalism, the whole basis of
capitalism is consent. It's consent
between a buyer and a seller. Right?
There would be no sale if both the buyer
and the seller don't agree on the price.
We can obviously say, "Please go to
shop.com.ai and buy our things, but if
you go there, you're not willing to pay
that price. Look, we're willing to sell
it for that price. You can decide
yourself whether you're willing to buy
it for that price." And that's why
capitalism really is about consent
unlike some other isms which are about
uh you being told what to do. It's
terrible. We should give people freedom
because this is America and we love
freedom.
Yeah. Uh is this the gas station here?
It's got to be if there's a super eight.
No.
Mors Hoffens Aussie and Div and I uh was
coming out your first job after college.
No, it's my second. I work at a
marketing I worked at a marketing PR
firm.
Nice. Yeah, it's my second as well. I
worked for uh Lucky Martin, major
defense corporation.
We try to not hire people right out of
college. We'll hire people either right
out of high school or out of their first
job because college brainwashes you for
4 years.
Yeah.
Um college is a really bad deal, guys.
Really bad.
Missed another bridge.
Shoot. It's over there.
If we go over it.
Yeah, it doesn't really count.
Um do the scopies want to stop for gas
with us? How many we got?
We got 69.
Oh, I guess they want to stop for gas
with us.
Someone's in Minneapolis and said
they'll come meet us in lacrosse.
Are you cool?
Yeah, we're down.
If you're cool, you want to come to open
mine with us? Like,
yeah, I don't know which one we're going
to. We'll look it up.
But the the teacher said that uh
lacrosse is really great and it's a
great place to go. So,
yeah. Gregory Marufo said he's very
cool.
Gregory Maru said he's very cool. Hey,
man. He's cool.
He's cool. He's cool.
Yeah, we'll figure out where we're
going.
He said gas this way. Do you guys see
any gas? Yeah, up there.
Where?
Someone wants us to open a comma school.
George,
let's open a comma school. I'm telling
you, if I'm 50 and there's still no
singularity, I'll open a school.
Yeah.
Where is it?
I thought it was that truck.
You thought it was that truck?
I thought that truck was
We're just going to like pull up next to
that truck and like
I mean, I figured they were coming.
Like, where are we right now?
Yeah, this got weird. Virtually Chris is
asking, "Bib, should I apply? I don't
know what I could do to help, but I'd
love to do anything."
Yeah, just apply. You know, Viv or send
me an email. I get a lot of them and
I'll read yours. It's no problem.
It was really good at email.
Yeah. Yeah.
Did she find your uh
good email? Wait, where is it?
Your unread email, George.
Dude, that did you just need to change
how you do your um inbox? Let me find
We should go bowling cuz I don't know
what's happening.
You want to go bowling?
Yeah.
You want to stop here and go bowling?
Scopies, you want to go bowling?
It's closed. Never mind. But bowling is
great,
dude. It's up ahead.
Bowling's underrated.
Up ahead. Are we going the right way?
Yeah, we are. It's 3 minutes away. All
right. Good job. Good job, man. Look,
guys, you know, it's like driving the
air, too.
This needs to get
I think I think on auto I think
autopilot is slightly better at the
highways than us, but I think things
like this were better than autopilot.
Yeah, I think we're better.
See, we're going to stop automatically
right here behind this school bus, guys.
We'll see the What's the message?
Oh, we're going to see the uh resume
driving manually. Oh, there's the gas
station over there. Casey's General
Store. No, I'm actually going to Little
California have never seen it.
The scobbies have never seen it. No.
No. I'm sure they have.
I just saw it for the first time we were
in
No. Come on, Eddie. You're lying to me.
Lying to me. Serious. You're lying to
me. Scopies, don't lie to me. Oh, I can
go We can go to 90 that way. We can
experience some of Sou Falls. All right.
Welcome to Stoping for Gas with us. This
is the first place we're kind of
bringing you to.
Yeah.
Um, you guys can can Do you want to come
in? Can we bring You guys is that Can we
Can we bring Can we bring the scooies
inside?
Yeah. Yeah, you guys can come with me.
Wow.
This gas. So, I like the choices. Only
two.
Yeah, unleted and unled plus.
I really like that. That's nice.
Yeah, no choice is bad, y'all.
Um, see. Oh. Oh, check it out. Check out
75 uploads remaining. That's That's
the new thing. Yeah. No, that's
Go to my drive.
Go to my You can go to my drives. Yeah.
Nice.
How many parts we've uploaded? I think
that the way this is like paired to our
internal account, it's not really going
to work. Your experience will be much
better than ours. New destination will
take you into ways. Um, you just type in
a destination right there. How nice is
that?
Best live stream ever. Thanks, Tech.
Thanks. Oh, yeah. No, so we're really
we're really going to start with the
shilling. I think maybe we do leave the
scopies. I don't think we You really
want to bring them into the gas station?
No, but they just said it's the best one
ever.
Oh, it's the best one ever. Well, you
know what they say about a good thing?
You got to let it go. And if it comes
back to you.
Okay. All right. That's
You want You're not
We'll see you. Oh, shoot.
Oh, no. We're done.
We'll see you guys soon.
Scopies, buy things.
Yeah. Yeah. Buy things.
shop.com.ai. We'll see you soon.
Oh, we'll do more periscopes.
We'll do more periscopes.
i think we might have not that much
service what time is it
early we're a little early we keep doing
all of our presentations contenders have
been sold out
all through the country
and airpods oh and our floods are also
do you want a buttermilk if you right
now have buttermilk crispy tenders and
air pods
you're really doing well for yourself
um i love the two for dollar apple pies
yeah i'm surprised you didn't get that i
just saw it yeah we're literally no but
honestly after the rv's apple turnovers
today yeah i ate too many rpgs
no we're not bringing any sauces in the
nice pot we're going to eat these
yes we're eating them in the car yes
thank you thank you
um everyone just grab a grab a 10 knots
give us a try no we don't need to try it
check out my 10 nuggets
i don't think i don't think she was
happy that we were on the person no she
was not she did not you should have
asked
me and we didn't you love i love eminem
mcflurry's too eminem employees are
great
unit
here's our license plate
should have got to go we did get it to
go they messed up our order it's all
right though it's all right it's the
same thing because we took you to go
anywhere
what
oh i didn't unlock the car guys
yeah i know look look they're cold how
long should we keep them cold for got
warm nuggets oh we got super likes
oh i can't even get up my nuggets i'm
holding the periscope
all right
oh okay
no sauce in the car
all right
i'm handing you all back to vivian yeah
oh the drive through oh no i like going
in we have to pee too all right so you
see our destination is the lacroix
wellness center
what's that
i don't see that
not
what dude we show for so many things
packing cubes are great is it too much
to buy amazon basics fast to be honest
guys
this is our last periscope there'll be
no shelling yeah
um
just just just reflections on the tour
uh
we would guys come ai's not shutting
down
there is no way in hell
it's all in jail
to be honest let's be real um
because let me tell you who i draw life
inspiration from captain on a fake show
in a movie called galaxy quest
and his saying is
never give up never surrender yeah
nice
and that's the truth um we came we saw
the concrete
never give up
never surrender
we know we're in a real place because
there's an applebee's here applebee's
where is the tesla supercharger someone
just mentioned they saw it and i can't
find it you see one here
oh there it is oh my god wow
three people
joining for our last back up no really
there's no chilling on this one
no emotional blackmail we never give it
up we're gonna win
as much as i might want to give up my
life would be a lot easier
what do you feel my life could be so
easy you guys it's so easy easy's boring
you feel shame
i don't even think i feel shame and
guilt i don't really feel those things
what i would feel is just kind of like
bored
yeah because the truth is the only thing
that's exciting in life
is when new things come out of nowhere
yeah
right and
wait can we open this roof i think we'll
get more light for the viewers there we
go
i'm really on
did anyone have any new experiences on
this tour they'd like to share um i got
into a deep dark hole when we talked
about life
we talked about
neo-reactionaries
would you talk about neo-reaction
reaction areas
that was cool
question existence question it's just a
new way of thinking about things we had
good talks
yeah yeah
what else what do we learn what else do
we learn
we did talk about the silent scope
session yeah we did we reflected on it
absolutely eddie's parents were
concerned
[Music]
well we're really being real on this
shout out to mr and mrs samuels for
watching right yeah right
george did you have any uh reflections
you wanted to share
no i really just like what i was saying
yesterday about
i'm not sure i want to be a rapper when
i grow up yeah
i'm not sure i could go
around the country from place to place
and perform the same songs over and over
again yeah
i mean it's kind of what it feels like
and i don't know that's something that's
always been really hard for me um to
like do the same thing twice and not be
bored the second time
maybe it's a good thing
but um
it just means i'm not really cut out to
be a touring rapper
sure there are rappers who do not
yeah
yeah
your studio rapper
i don't know life is kind of hard to
miserable
but um now to be real we probably will
do this next year again
um
the car will drive better
hopefully left some corporate
sponsorship yeah
remember that's sponsored by like the
hilton i don't know
right
you know they're helping us out um but
no don't don't don't feel pressure to
buy our products we're not actually
going out of business
well i mean we want people to buy stuff
that chop that comment really only if
you want it yeah do you guys know what a
return policy is like if you get it you
don't like to send it back before we
find out if we do common hoodies shit
well they'll ship as soon as we get back
in the room
yeah we didn't bring any hoodies with us
yeah we should have but we're running
low on them we forgot yeah we are
running low and that's why prices aren't
going off
oh it's supposed to texture
there scoping
yeah
scoping did you guys have any
reflections
one of the last two nuggets
more nuggets in there even yeah wow 20
is a lot of nuggets
but it's only one cent more than 10. i
know no after here it was 449 for ten
dollars wow san francisco what's been
our favorite part of the trip so far i
think we all can easily agree little
america's 75 cent coast
america a little america to stop between
it wasn't about yeah
wait before denver it wasn't about cones
it was about you scopes weren't with us
that night no there was about almost
dying on the highway
yeah you know yeah we're driving yeah
we're driving through the snow storm and
ice the car's really safe the story's
really sad was the the fear of almost
dying but
there's a few of them almost dying and
then ending up in this small little
oasis called little america for 57
people guys we can't even stop we're
showing for things someone just said
yeah i was all in then out now back all
in i just ordered a new car to make this
all possible
how do you separate that from shilling
right what's the definition
how can you even communicate genuine
emotions you're trolling when you chill
you don't genuinely feel loved your
bitcoin cash no no i don't but you
genuinely feel love for little america
yeah but that's the thing like
how can you communicate the difference
right in a world so saturated with
fakeness
is it real
what is a show i don't know it's just
that word accomplice of a hawker gambler
or swindler i mean who acts as an
enthusiastic customer to entice or
encourage others yeah so it has to be
deceptively
promoting something we're not shooting
um there's this song uh marine tigers by
the world is a beautiful place i'm no
longer afraid to die
and they have a have a line i really
like in itself
george why you said simulation won't win
i don't want to talk about that
but um
you know can you still call it a country
if all the states are broken can you
still call it a business if all you do
is steal
yeah um that's kind of how i feel a lot
of uh about a lot of businesses today
why do i feel simulation momentum
because
where does the simulator come from right
you have to code the simulator
in the same way
you know hand-coded driving cars won't
win hand-coded simulators won't win for
the same reason right
it's vision it's graphics instead of
vision graphics is still kind of still
kind of hard
that's right you get all the last cases
yeah but you know i'm going to reflect
on reflecting is there anymore
is that the last nugget how many nuggets
oh last nugget
which one can we 2018 good luck doing
that
good luck and when you do it'll be the
best looking car out there
who's realness
go home
reflect on this year
try to write a song about it
yeah
i'm gonna do it at home you have a
keyboard
guys i hope you're seeing that sunset in
the uh in the side mirror
man i'm getting good at filming these
periscopes
[Music]
yeah it's always kind of depressing to
drive to the east for this reason you're
driving away from the light
yeah
i mean yeah i feel like more
go to new york city
all right are you flying back to florida
yeah fly to new york what's going on
yeah on saturday
i'm chilling from chicago for a little
bit
i've never been to chicago
[Music]
you know i'm in new york city
no i never miss chicago
yeah way more than sf well the problem
with sf is you have you have no
diversity
there's very little diversity in san
francisco yeah uh you know diversity of
thought
everyone admits that's true no i mean
it's absolutely true right and and what
you get when you lack diversity is
extremism
and that's kind of what you see in san
francisco it's sad
uh you know you don't have this in new
york new york i think things are pretty
well balanced so extreme positions are
ridiculed as they should be
and uh you know everyone's kind of kind
of pushed to the middle and a common
ground and you really do have a lot of
common ground between new yorkers yeah
we're in san francisco you just have
these these sub-factions that
that hate each other
yeah um
you know
something else we were talking about i
think
you can look at the two sides the uh
political spectrum this year one side
was maybe driven by a hate for like
you know immigrants and
the other side was driven by a hate for
the rich
um
and i think both of these are proxies
for well what's going to be hated in
2020 and it's going to be technology
um you're already starting to see it
there was a wired article this morning i
think that's going to pick up you're
going to start to see real uh hatred of
technology
and i am deep down you know curious as
to why
um
if if ai does take all of your jobs
well
isn't that a good thing
but i'm just a out of touch startup bro
right
you're the bad guy george i am the bad
guy
but um you know i never said i was the
good guy i'm just a guy
i'm the guy sometimes good sometimes
[Music]
has a great track at the end of the card
or three don't get it where he goes into
this
of people yeah it's just like you know i
am just human and i don't know if that's
inherently good or inherently bad but
yeah
yeah we're fans
[Music]
things will also get
much cheaper
yeah i mean just the theory as well like
once once
once the machines are cheaper than we
just ate a whole chicken's worth of
nuggets for five dollars right so the
same is going to be true when ai
replaces all the jobs right so you won't
need anything does everyone feel like
kind of kind of fall from those nuggets
i feel
i mean i feel a little disgusting but
like i feel also kind of full right i
got good calories it's meat i know i
gotta eat vegetables sculpey's but uh we
need some greens
some greens yeah
it's hard to eat greens on the road
it is
hard to eat greens on the roads they
should make some astronaut broccoli
yeah like why does mcdonald's just smell
like raw kale well
yeah you can talk about whether it's
expensive like that's one of the
theories i've heard but i wonder more if
it's that's really not what people are
going to buy
yeah
i don't know
oh yeah people
the expensive part is that it goes bad
it does go bad it's a lot easier to ship
nuggets buttermilk chicken tenders are
out of stock all over america yeah
everywhere we went they look great
do we want
no i don't think so
our trucks do but a lot of them are 24
volts don't plug a panda in you can't
actually yeah they would launch there's
a notch in the 24 volt obviously no
gorilla of course would know
oh yeah yeah
i don't know what the buses are on
planes there's not that many
interfaces no i'm sure there's a lot of
ecu's from like like at least like a
seven like a seven eighty seven yeah but
i was thinking like a small point
that's like playing
like a two-seater plane was probably not
like like an old cessna 172. yeah i
don't know those planes are old oh that
that's literally it's like you know
there's a little there's a linkage yeah
i don't even know if there's hydraulic
boost i think like you're making the
flap go up by pushing on this shit yeah
yeah no i mean a modern 747 probably
have this kid
something like that probably yeah yeah
i think helicopter
oh i love caffeine water water joe
in minneapolis we could have visited
water drought rods are electric on most
plants
no not like a cessna not like an old
cessna
uh sure sure most new players like if
you you're talking like you know big
jumbo jets yeah they're fly by wire
control surfaces on small planes
well
like the thing about wires do you mean a
like piece of piano
wire i don't know
control control surfaces on small planes
are literally a linkage i think
maybe new ones are different but
um
yeah
you know i think you're like oh we lost
the rudder okay climb out kind of just
like push on it a little bit right it
kind of works
that works i think that's happened
um so we fixed it now look i can press
the cruise control button to change to
reset the the health bar
that was a little change we made
trying to get this release out tonight
or maybe tomorrow
next time
yeah
this is just this is just
just realness not silent
it's not like the periscope last night
maybe this is a pretty good last one
yeah
got to come
you gotta put it back in no i was fine
we still had to go across wellness
center of course what do you think's
today
i'll
find out in 105 miles
are people pretty quiet
yeah pretty quiet
a little too much steering on this turn
oh a little lower
it's hard it's like impossible to see
the wheels so i'm just showing the
system and
no you're not quiet well you're asking
some questions but like you know like
how are we gonna support planes and i
was like no they're gonna support planes
no you know what actually someone should
really build
um so in small planes the number one
cause of crash
is controlled flight into terrain
i mean that is exactly what it sounds
like you crashed into a mountain in a
completely working plane but at first
you think you know that was really dumb
why'd you crash into the mountain
and the problem is this
you look and you see a mountain in the
distance right
you can't exactly estimate sort of what
your climb rate is but you're like okay
we'll fly over mountain
but say the mountain has like
you know
2 000 feet over here or a thousand feet
over you and your climb rate is only
like 400 feet per minute
well if you only have two minutes until
impact that's not going to work so what
you really want to do is turn around
um somebody should make an app
that you can run that just you know we
have great terrain maps this is such you
know such a preventable accident
wondering about uh getting calibration
otherwise what did what they say
apparently they like you you know they
didn't explicitly say that like you
better be bishops
like they did
well we got we got someone out there who
was team vip
notice anything different about the
performance of the trip compared to sf
experiences
some states nevada it had issues
um but other than that
yeah the right lane in nevada was about
three times as thick as it is now
thank you the model
it just this is a more predictable
safety model what is this their mode
sorry
to safety mode you can read the code for
it it's it's pretty well documented
whatever oh yeah
i'm going to ban you just kidding
people are entitled
you're entitled to your own opinion but
you're not entitled to your own facts
thanks
no don't worry i'm not gonna ban you i
wouldn't do that i do ban the boss how
hard will sometimes be in new york city
[Music]
no where do you want to self-drive
the truth about self-driving is it's
pretty boring
and when it actually like is working
well safe driving is boring
what did you
uh um name this george
name what name of periscope the last one
the last one i think okay someone asked
the last one what what's the last
periscope of our tour i'm glad you
blocked that autonomous safety lawyer
dude did we
oh did we watch on twitter
oh i block people on twitter who pissed
me off yeah really
i think i like that no i mean the thing
is like
um
they're just out there
you know
they're like just like like the know you
can't kind of people
okay i mean maybe we can't you might be
right but you're not adding anything to
the conversation by saying that right
yeah just saying no you can't now if you
have like
critical feedback that's always welcome
but if you just have hate i mean blocked
haters haters get blocked
yeah critical feedback's always welcome
unless you're funny
if you're funny oh yeah yeah then you
have a redeeming quality right you give
us entertainment yeah funny funny haters
are you gonna block funny haters
we've done a lot of stuff we've done a
lot of stops touring is kind of
exhausting we really really really want
to tour through the middle of the
country you know what i mean
i would love to see the juicero ceo do
oh there's no green box hashtag on eon
but has been on neo from start what was
that box for no well we could talk about
the box in a minute but i want to even i
want to i want i want i don't know
but we'll keep it in the queue right
there's a stack this
uh is no it's a queue because it's first
and last now phyla
now even about juicero there that was
i'm going to call myself out and be like
you sarah we we applaud you for trying
oh i like this um you know like that was
like anti-shelling right i don't even
want an anti-shill
i just wanna anti-shield but that that
would mean you're
talking about something negatively yeah
no it was like
anti-shilling is like you know to be
honest like a juicero might have been a
great product for some people right yes
but that's what i mean like
so the green the green box you were
referring to is the calibration box
it didn't convey that much information
to the user so it's been removed from
the uf ui upgrade of 0.4
yeah
look we're passing rochester oh
rochester exit
rogers there's only one rochester exit
yeah and if you miss it you're going all
the way to lacrosse what were the goals
of the tour did you guys feel like you
achieved them
so the real goal
to be honest guys
i don't know it's something to do and we
did something and that's the real goal
um i don't know selling stuff would have
been cool we sold some stuff some stuff
like honestly like
it doesn't really like you know next
year we're actually going to start
running ads for things
welcome to being a real startup right
going to run ads we're gonna track you
know our spend to get a conversion
maybe even buy uh my instagram ads
um they're kind of one of the best ways
to get um
to convert marketing to convert yeah i
mean not like marketing it just it's
just like
you gotta do it right
it's part of uh it's just part of a
machine
and that's a shout out shout out uh
scott alexander uh slate star codex
some great blog posts um
talking about like molok and how we're
all slaves to moloch and how like you
know everybody
might want the world to be better
um but it's hard to actually make that
move eleanor yokowski just came out with
a book about this too
it's like inadequacy and an equilibrium
or something
i forget the exact time of the month but
go go go check it out i mean it just
kind of talks about like even if you
have
a hundred people who all could take
collective action to make the world
better
um
each if each individual is incentivized
to do something else
then
well the collective action doesn't get
taken and now don't scream communism
please don't scream communism
at all what if we're just all workers of
the world united communism has killed
more people than any other ideology
there is
uh nice we got a super like by alex too
oh yeah
is that is that something we unlocked
i've never seen that and also someone
asked who's the coolest investor we have
oh it's too hard to answer
it's like asking a parent who's their
favorite child you know
our favorite investor
yeah no i don't know
um i also like about these about these
like other kind of things like the dan
carl and the slate star codex where
you're supposed to listen to dave we're
supposed to listen to that carlo the the
point that i want you to take away is
not to like
look at my opinion and be like i agree
with it because he said it
what i like about these resources is
they kind of give or they've given me
new ways to think
um they've given me new ways to think
about problems and
if you come to different conclusions
that's fine i just you know i did this i
did this little like quick questions
with siraj thing at the
tits or a machine learning conference
and if there's one way the world could
be better let's make the world more kind
of self-reflective right
is
everyone should learn to code
should everyone
you should have something like
basic knowledge to be able to use like
excel at least yeah i mean that's coded
yeah in a way just the like algorithms
mentality
there's uh i said they're not algorithms
but like
managing data yeah everybody should
understand like the basic ideas of the
field i saw slogan at the uh kansas city
maker space that i liked which was um if
you don't know how to fix it you don't
really own it
yeah i think i agree with that
andrew clements things coding should be
mandated i think
well mandated by who and where
the elementary school we went to the
kids are learning to code yeah yeah
that's yeah
i think that's common man it's pretty
common it should be
more than
it's a good way i mean i don't know i i
started when i was really young
you pick it up easier when you're a kid
it's like a second language yeah
could i speak a second language
well not exactly no i mean coding is
even more of uh
you speak french french and english are
not that far apart french is a practical
no of course not i could learn french
easier than i could learn chinese though
right
they they talk about like like if you're
an english speaker like learning like
french or spanish or uh you know
languages like that are much easier to
learn like german or russian which are
even easier to learn than like chinese
japanese
what's our favorite company besides
comma
we like amazon we do like amazon
amazon's great we like amazon
we like elon's companies
i like the boring company a lot i'm
a more company fan i think trains it's
the future
no i mean like
yeah um no we have to get away from this
companies that are using
psychological tricks to make people
addicted
yeah um
i'm a twitter addict i confess
it's not even funny like i'm actually
kind of sad about my twitter addiction
george it's all in your power to stop it
i mean it is to an extent like of course
it is right but you know here's the
thing about bad addicts and if you talk
to people who are genetics and drug
addicts and they'll tell you this right
you can say that it's all in your power
to stop it and it is but the truth is
they are still getting something out of
their addiction or they would stop it
right i am still getting something out
of my twitter addiction and that's why i
don't stop
yeah
and i mean it's true about facebook too
right like if you truly were getting
nothing out of it if you truly got
nothing right imagine the drugs stopped
working
well you could stop using the drugs real
fast
right you'd scream and complain about
that but you know fundamentally you are
getting something out of it or you
wouldn't be an addict someone's asking
if reality is boring
reality is boring
i mean
it's better than the alternative right
yeah you can go you can go live in your
own made-up world
yeah
it doesn't last very long
no
even if it did i mean
well that's a decision that everyone's
going to have to make probably sooner
than we think about whether you want to
be a wirehead or not oh refer to the
drug use got you
uh reality's boring that's why people
use drugs yeah yeah
absolutely
or or there's some aspect of reality
they can't cope with
yeah
man george can be a philosophy teacher
sure george also taught fifth graders
today i did yeah i taught him that they
were computers
yeah i taught them about physics
they were good they knew it yeah
alternative is dying
wire hunting and dying might be the same
thing depending on how you look at it
these questions here's the thing about
philosophy philosophy encompasses
everything that science has not yet come
up with an answer to right we used to
use philosophy to determine you know
what everything was made of right go
back to aristotle and now well
he was biggest chemistry
um
and you know when when nietzsche talks
about like god being dead i mean what
god was replaced by
was kind of an enlightenment view of the
world as it was a rational view of the
world obviously the reason the sun rises
is not because there's a man in a
chariot pulling it but because of uh
you know the earth is spinning right and
this is uh
this is a lot of you know what you want
to talk about where i get a lot of this
worldview from it's like less wrong and
rationality kind of stuff
um although it may be simple well that's
this
bob martin's is what'd you think of that
no
also this
uh we should also hire a ten-year-old
sure
do you think you'll fly to mars in your
lifetime
uh
my comment on mars
was uh i'll go there when there are five
star hotels there
um not necessarily because oh i need to
stay on a five-star hotel i would i
would rough it on mars man i'd sleep on
a martian bench
but um no that would just say something
about like where the kind of
safety and reasonability of the journey
are
yeah um the places that i want to
explore aren't necessarily on mars
they're actually a lot more sort of in
my head
do i think i'll visit mars in my
lifetime
if i had to bet on it uh
10 chance
that would just space
if i'd give space and mars similar
chances
it's gonna be like a one-year trip
temporal difference learning or
something
what
uh moon base or mars base first you guys
look at the lights they're totally off
over there
we're not that not that explicit on like
types of software development or
management
maybe it's worthwhile to learn more
about that
um
right now we just kind of code we have
integration tests
um we should get better with testing
we have unit tests on things like
the apis some of the functions
underlying highlight we have the
complete hardware in the loop
integration tests which you guys have
seen back in the house with the eons in
the closet
it's pretty good
um and then we have our army of beta
testers you guys
we tested ourselves we're a bunch of
employees driving to
doing four cars now are you guys
committed to using only computer vision
what would be the alternative
use radar that's radar
but yeah
i mean
when you look at cameras just from a raw
like even if you don't understand what
the sensor is they are incredibly high
bandwidth
cheap
available
they're really a great sensor
they they don't really compare to
anything else
just because of smartphone
they become so cheap yeah i mean there's
big there's big market pressures driving
better and better cameras
if you are a consumer if you want to do
that yeah we obviously encourage people
to do that
but we're not at the level where we're
providing consumer support for open
products night vision system wouldn't be
neat because
cameras seemed really well at night
or it drives better at night than ever
though
yeah and because there's a ton more
contrast
so i don't know y'all you all really
came on a road trip with us it is fun
this is a real this is a real road trip
oh no this time of day is always kind of
depressing too
sunsets are kind of boring
i do like long walks on the beach though
so if you're out there
sales update let me see if i can all
right
i don't think we met the 7k bargain yeah
there was a 7k target
out there joining us we'll do a blog
post if we get it but don't tell them
that
we're now even chilling it's real you
know no we really wouldn't do it if they
said the 7k but
i i don't think our sales are going to
be second camera
um i mean i'd like to see i'd like to
see a time lapse of the video
yeah eddie you want to code that yeah
give me that god mode and i'll do it
have you thought about putting your cars
and your cameras in rental cars for more
data
we're not really limited by data
we're limited by engineering
and we're not even limited by engineers
we're limited by engineering
it's very hard you know a lot of people
think
i've always kind of viewed engineering
as kind of a creative endeavor right
and if you want a creative endeavor to
get done faster if you want like an
artist man produce more paintings
produce more paintings
you couldn't really hire more people
you couldn't really give him more money
you couldn't really give him more paint
it's just kind of done when it's done
it's kind of what this stuff is too
we're working we have ideas we'll test
them
yeah sales update is the same you've got
11 orders 11 orders i like what the guys
said at
kansas city makerspace
he was talking
to
college kids there
his advice was about
you know when you build something you
build it
because your taste
is much higher than what's available
right so
you know the system that comes on the
toyota our tastes were higher than it
right we want it we we have higher
expectations for what it should be then
we build this thing that keeps you in
the lane lines some people are they come
up to us and they're like oh this looks
incredible but our taste has been
raised
you have like the taste versus what
you're capable is always kind of
catching up when you build the thing
with the
better taste it tastes rises but you
become more capable when it keeps going
like that
that was a it was a cool thought we're
going to we'll get to that one in a
minute but yeah no going off of that
it's like
i don't know man i get so frustrated
when this thing doesn't work it should
work way better
um and like
the next year it will work way better
but i promise you on next year's
self-driving car awareness tour
it'll probably do it'll be better but
i'll still be mad about how bad it is
right that's okay that's beautiful and
even when it's perfect even when it's
when it's level four you know we're
gonna get like like you know any any
sort of crash any sort of minor mishap
but it still has to be better
um i'm not saying it has to be better to
ship right they say if you're not
embarrassed by what you're shipping you
ship too late oh that's a good
you line
that
just that one of our one of our boys
our one of our anonymous employees
um
some of our employees are anonymous
kind of respect anonymity employees as
much as we can
uh so what is the end goal of the
company to win self-driving cars
to win self-driving cars it's not even
like that's not even like you know
sometimes you'll see it you'll see the
way i talk you'll see kind of in the
mindset of it um and i'll say it and i
do understand that what people take that
to me is not exactly what i mean when
they say it
but i want to solve i mean i guess i i
guess i can say this i want to solve the
problem
i want to see the solution i want to
either solve the problem or see the
solution
i'd rather solve it myself right it's
like it's like a math problem in the
back of a textbook but what's cool is
this isn't contrived if you're doing a
math problem in the back of a textbook
you know but you know donald knuth would
put uh would put math problems in his
textbook that would like unsolve
problems
because kind of feel like no one even
has the answer right
um so that's that's just cool it's kind
of like an unsolved problem yeah thanks
alex reed hoffman said that line frida
hoffman's line okay and all jobs
oh no i say that to troll more than
anything else i don't know i don't
really have an opinion on employment
i don't know if this is a question or a
statement but think wave of this little
force along the soul for some areas not
really
but like level four has to be everywhere
well level four doesn't have to be
everywhere that's level five yeah level
four can literally just be on one route
big
what was more honest
um
maybe they sort of can't be i wish they
were more honest and aggressive
their sensors are really really good
but this is what google does right
google can take an idea and they can
build the best one of it i've worked at
google a bunch of times and this is
really what the culture brings out
you can see it with chrome with gmail
search
uh they're not so good when they try to
do new things
less take google glass and
to be honest it's not even google glass
was kind of a bad product but um
yeah they're not they're not that
innovative they're they're they're
people who go like the last mile
fortunately in a weird way and this is
kind of how the world is today google
just buys up startups
the world is google's innovation lab
so what is what is the end goal for
common yeah it's not uh
to live forever
right
not as people as a
company and that's kind of the goal and
goal of every company right so what's
your view of mobile
responsibility sensitive safety
stupid viv what is your job
i run operations and vp of operations
mobilelite gives like a great
presentation at cvpr about uh about
vision and about real stuff
and then they give a whole presentation
that isn't about how to make driving
safer but about how to make driving
provably safe so we can determine who
has liability right
talk to my reason interview about the
size of a pie
well why don't we just you know
make well in this case make the pie
crashes smaller right and not worry
about the less much slice
everyone's operations
high is already getting bigger
[Music]
well first you got to define that term
um
when i was 15 i first read eliezer
yukowski's stuff
and
yeah
it's
you first hear about the doubling of
compute power
and the idea is if you build a system
that's as powerful as humanity there's a
law called moore's law which says
humanity doubles the power of computers
every 18 months when the speed of
computers are the number of transistors
on a die or whatever it is
doubles every 18 months right but if
it's the machines doubling their own
power every 18 months the next doubling
will take nine months and the next
doubling will take 4.5 the next will
take 2.25
and then at 36 months you have a
singularity where they're doubling kind
of infinitely fast it's kind of like the
tortoise in the hair problem
um
so i don't know i mean there's that
definition and then there's the
definition of the obsolescence of
humanity which is computers are capable
of doing every job better than people
so you have to talk about
which definition you're talking about
and what you want to know about
governmental events
probably yeah
just as they've banned people from
riding horses on this road
yeah even closed courses right just like
cars
how many
people are coming around
keep them with us all the way to
lacrosse do you know where we're staying
tonight guys oh yeah did you get
something no she didn't
yeah um so working with the oems is
incredibly difficult because of who they
are structurally
i'm not sure that is the end goal i
think you have to think about how else
to get into the market
i think entering at the dealership level
might be the appropriate sort of place
where we are in two years and how were
the dealers perception
of that idea they they enjoyed it and
they liked the idea
obviously they wanted to be more
consumer on this course
but
that probably is the way that you
actually managed to shift this
and
does this approach win
well
there's a question all of when right
because the other approaches are
in some ways more predictable if you're
talking about the build a car and ship a
car approach
the fastest company from inception to
shipping a a standard production vehicle
i think was tesla i think it took them
seven years
so that's how long it would take a
company if they started today to build a
car
maybe it's a little bit easier with
electric maybe they can do it in four or
five
but it's still a huge challenge
so if companies start today or started
last year started two years ago
i think we beat them if they're trying
to build cars
now then there's companies who are
trying to work with oems
so you look at like uh volvo have this
drive pilot program that they were
planning to debut this year they've
pushed it back to 2021
which seems to be the date that a lot of
these car manufacturers are saying
again
i think we win by now but when i mean i
think we solve the problem by that
the truth is most people they'll ask me
questions about like does the public
perception of these systems matter
and in reality
public perception is a lagging indicator
of quality
if you have good quality
somehow our society is fairly efficient
at disseminating information if you have
bad quality the same thing applies
step one build a good system right so
you have to solve the problem and i
think it's solved in maybe two or three
years
that beats out anybody really trying to
work with oems if you believe they're
2021 and anybody trying to build their
own car then there's this third approach
the third approach is maybe the waymo
uber approach
where they're building um
self-driving uh where they're building
uh rideshare networks
the thing about ride-sharing networks is
you have to operate super unprofitably
until the minute you solve the problem
now if solving the problem were very
very very predictable like we knew due
to some kind of you know inexorable law
that the problem would be solved by 2020
and exactly what sensors in compute
would be required
if we knew that then the ride sharing
approach would probably win
because if we knew that
investment would be easy the world could
get together multiple trillion dollars
to build out the entire network
uh subsidize it do it all with human
drivers and then 2020 you flip the
switch
but because of that uncertainty
seeing i tend to believe that it's going
to be
about that long
which is yeah there are two questions
one um
solved is in what level
and two uh can we get an mtv crip style
tour of comma hq
hey if you know someone at mtv cribs
we'll let them into the house hey
uh yeah we'll let me know
which level so
it doesn't really like the levels are
stupid i guess i am talking about level
four
the levels are really just a liability
question
it's like uh the supreme court thing
where it's like you know
pornography right uh it's hard to define
but you'll know it when you see it it's
the same thing kind of with self-driving
systems right
you'll you'll know it when it's solved
you'll type in a destination it'll go
there and it's highly unlikely to make a
mistake
better than humans right statistically
better than humans so i guess that is
level four
but the levels are kind of off
it's all about the number of
disengagements yeah
do you guys have to drive back no we're
shipping all right we're shutting the
car
it's a one-way road trip
all right so what car should we buy for
next year self-driving car window
let's get the audi
sponsored by sponsored by silver car
silver car might actually sponsor us
silver car is cool
they're in a lot of cities though nope
not a subaru we're definitely not elise
no you'd have to pay me to drive across
the country in a subaru
again again i'm anti-shilling i don't
really have anything wrong with supers
wrxs are nice
no way i'm taking a lambo to some of the
places we went yeah of all the lambo in
the snow and ice and stuff
yeah
it would be nice to do this in the
summer i think those a4s are or is the
small wheel drive
a more southern route yeah we could
definitely we're definitely taking a
different route next year um but yeah
we're gonna do the same sort of thing
drive across the country
get sponsored
you get sponsored i mean i don't know i
predict i predict big things for comma
look at how much has changed in a year
yeah
one year ago we had five people
barely even to be honest
um i think we didn't start to get people
until january end of january we had open
pilot 0.1 was really unusable um it
would crash every couple minutes like
the software would crash
uh
the neo was was was janky
um they were kind of hard to get you had
to get that board made
i used to
we saw this year we saw neo driven we
saw la timer with open boards
someone says we should get sponsored by
amazon
tour come to canada
who knows where the next tour is going
yeah i don't know across the
international borders
tesla waited to release autopilot i
don't think so
um you know you can look at you can look
at joshua brown's death and like i mean
obviously you know it's sad but
statistically
it's
safe or safer that it's as safe as or
safer than humans assuming that there's
a human watching in conjunction with the
system right and in the joshua brown
case
you know there was no human watching the
human was watching harry potter and
that's what's believed i mean that's
just true right
so you know with all these systems
really pay attention at all times and
you have to and you're going to have to
for a while
but
i don't know with the singularity
question will you stay human when you
upload your minds
well i'm not really sure how you define
human
uh
you have to be a little careful with
uploading
i mean this gets this gets really into
sort of no no no no wire heading is very
different from uploading
um
i don't know this is all a little bit
too far away to think about back
thinking about self-driving cars again
yeah i mean we've always talked about
watching the driver's
attentiveness yeah
for level three
we will have to yeah watch for a more
consumer product from marketing product
um so yeah i mean the eon
can it see you
no
no we have to check
i'm not even really sure whether the
front facing camera can see you or not
it's kind of out of view oh that's why
you're talking about flipping it around
tesla ap1 couldn't see you tesla ap2 has
a driver facing camera does someone was
wondering what would happen if a deer
jumped in front of our car slam on the
brakes
well as hard as it can so it would
decelerate with 0.3 g of braking
and then i would uh press the brakes
even harder get it up to 1g
uh breaking is almost always safer than
swerving
breaking is almost always the right
choice unless you are really confident
in the swerve yeah
well like okay just swerving like around
like a car that you know is not going to
move is fine but swerving around a deer
hit the brakes
you swerve try to predict the deer's
motion
you end up hitting him
yeah with animals breaking is the right
choice usually
you saw a cat across the highway you
guys it was a black cat oh the glock
didn't stop
you imagine what can we hit the black
cat you would have been such bad
open pilot won't slam on the brakes for
a cat sorry cat
neither would you
why are there employees at fast food
restaurants george would probably agree
with you
um
well
so i mean what you really want to do is
like
if if minimum wage laws increase do you
see in areas where minimum wage laws are
kind of high like in europe or in
california you'll see that mcdonald's
has replaced a lot of the ordering with
those computer screens
right so minimum increased minimum wage
will expedite the replacement of humans
with machines
uh why are their employees at fast food
restaurants probably because it's
cheaper
um some of those things are kind of like
anything where you have to like
use your hand in complex ways
robotics isn't quite there yet
but yeah different
multitasked
things
yeah well it's hard to like it's also
much harder to train a robot than to
train a person
yeah um error recovery is tricky
yeah you could probably do it i don't
know you also have you'd also have to
look at what the breakdown of operating
a fast food franchise is how much of the
cost is human labor
apparently with abs you can slam and
steer
yeah well yeah so that's the idea right
um you can you can slam and steer now
again your car still has traction
you have to ask the question of you know
study racing a little bit you have to
ask the question of where you want to
use your grip do you want to use your
grip to break and steer or do you want
to use your grip to try to do both
both is almost always the worst choice
right because now you're getting less
braking like sure you can brake and
steer but you're getting less braking if
you're trying to steer
you're using some of your friction in
order to steer
yeah well that depends on your track and
control system the one in this car is
really good
i had a nissan 350z i used to ride
around rochester that traction control
system was terrible
obviously to the early 2000s it was it
was a 2008 um and it would would it
would increase the oscillations it
wouldn't damp them um it was really
poorly done this one is is so much
better
uh
so yeah i mean yeah bad ones do that
good ones good ones don't
i have something related to the fast
food thing it's still crazy that like if
they get a check
at a restaurant such a pain yeah like
they should just hard readers are so
cheap now that they can just like put
them at the table they're doing this
they're doing this at all the fast
casual restaurants and there's actually
one startup making killing doing this
now yeah you go to you go like an
applebee's or an olive garden they have
card reader you have carter using the
table they have curtis on the table and
even worse the things like try to upsell
you on little games of course thank you
so much for watching
and airports everywhere everybody i put
ipads in front of you at the airport and
sometimes like in uh in dallas or
houston i think it's houston
um i think you can pay where you're
sitting maybe not maybe it's just a word
yeah no but this is huge and all the
fast casual there's a startup called
like handy or something yeah
there's one company who's made a killing
doing this and all of these like chili's
macaroni grill all of these it's called
fast casual
yeah at level four what do you do about
like
airplanes landing on a highway and these
edge cases
these edge cases are extremely extremely
rare what do you do if there's an
airplane landing on the highway well you
probably definitely do something much
smarter than a human because you do not
panic
um a human might you know panic stare at
the airplane and keep driving honestly
what you do most of the times in weird
scenarios is break yeah whatever human
words
i hear don't panic right
um these scenarios are not and this is
the same thing with the trolley problem
like it's not real
this is not a dilemma that anybody in
the real world has faced and this is i
almost i don't blame people for thinking
this i really blame the news
i really blame the news for making these
extremely rare events seem common and
then what they do and this is this is
actually like thinking like this if
there's anything you could be doing
that's more productive which i'm not
even sure but i mean it's killing people
right because to be honest how do most
car accidents happen it's the dumbest
shit people aren't looking people are
texting people are drunk people are
asleep fix that don't worry about the
edge cases i still save thousands and
thousands of lives
bro stay on the road
they bro perfectly yeah i know exactly
right but it's all fake i think he's
asleep or something i don't know
it might be the wind
you see trucks do this and i think they
only do it when it's safe and i do it
for some reason
i don't know i've never driven a truck
so i couldn't set up another
weird-looking truck
out of town oh wow magically actually
shipped something today i
heard i know they didn't ship you can
sign up for updates you can see yeah you
can sign up for the band
do they have a price and can you
actually send them money for a pre-order
i didn't enter that price
yeah like like to be honest if they're
taking like just a one hundred dollar
down payment for something announced
they announced something or do they oh
they announced soldering okay
it's just to raise more money it's
honestly just to raise more money it's
it's a pr stunt unless there's a price
in a ship game it didn't even look like
real photos on it it looked like renders
they look like renderings right yeah
like at least like tesla might announce
something and it's three years away but
like it's on the stage they'll ship it
in five years and someone was driving
one someone was driving one right two
thousand but no price but see that's
what i mean like it's just it's just
fake it's just fake and everyone should
be better at like realizing that yeah
does open pilot work in direct sunlight
[Music]
direct
you have some trouble
it's got a lot better
surprisingly good
what about a rolling stone i don't know
they say rolling stone article is good
what is the about about about magic
being a scam yeah oh my gosh they wrote
about a scam what was that no no wait is
that was it a scammer i think
i don't know oh did they review it and
magically actually got hardware i don't
know like magic reviews
from what i've seen with magic leap is
they continually like promise this this
and that
hey guys you know remember when i said
we were gonna launch the comma one
we open sourced it all by the end of the
year and like here we are a year later
and like
you've got to come and eon the banana
grandma one it's a lot nicer that's not
it's not bright green it's not green
just the screen just the screen is great
oh we're still obsessed with it yeah
it's important to ship support to be
real
in some ways the only way to kind of
express yourself differently is to
counter single
um
aliases book talks about this too like
really analyzing counter signaling what
it does
i would like to get a magic link
let us know
oh they probably can't talk about it
yeah they say all of nba they won't
probably have like insane indians right
yeah i mean whenever you have scams you
haven't seen any case yeah but what what
are they thinking today
do we make employees on ndis
they just sign and well they sign an ip
agreement which has a little line for
ending oh okay yeah
agreement i.p agreement is to prevent us
from being sued yeah there's very little
in common that's truly non-disclosure
if somebody leaked what the pigeon was
yeah i mean we already they'd be fired
immediately fired immediately just like
the person who leaked midnight black
i mean a lot of times it's you
i know i know god guys if i could fire
myself the ceo of comma would have done
it so many times
no i mean like magic leap and like
i don't know you beam i don't know what
they're doing like
is definitely fair yeah
some employees have come out i guess
i've met her too
i don't want to say anything bad like
you know she has like a positive like
outlook like you know the only reason
people think this is impossible is
because they they you know you know they
don't try hard enough or like anything
is possible if you believe in yourself
and like
it's a nice sentiment
like a certain extent that's the thing
like it's not even that you beam is
impossible right ubm is actually you
could build it
right you say they do show those things
i mean they don't show anything real
like the current flow and power flow to
the device right yeah they would really
that's what you really want to do you
want to get the watt meter up there
right one of those little usb
usb there's one two shows charging one
meter ones the
and they don't do that
because they want you to like and you
know what you could probably get the
current up you could probably even
design the thing to be safe right yeah
but i feel like ube has caught so much
in this like we have to kind of prove
ourselves to the world like we've been
saying this for so long um so in poker
this concept is called being pot
committed yeah right like i've already
put a lot of money in the pot this might
already be like a kind of losing hand
like i kind of think i'm going to lose
the hand and like you know calling his
raise isn't really worth it but i'm
going to do it because i'm pumped what
should they do when they realize like we
can't really build this
what we showed as a rendering when we
went to investors yeah i mean what do
you do when you after you collected 50
million dollars i don't know i don't
know what you do they don't have i mean
it's not like they can give the money
back right like yes they could and they
could give it back at a loss and they
could be like
let this be a lesson yeah
well it's not even yeah but like the
whole point is it's not even that ubis
is impossible it's just incredibly
impractical right
charging cell phones using ultrasonic
power is incredibly impractical yeah
dragon sector team from ctf says hi and
wondering if you're gonna be doing ctf
anytime yo what up dragons actor um i
know with one of the guys from nullify
in omaha and he said something you know
you guys are like george you still play
ctf's and i'm like no not really anymore
and then he said we don't really either
because ctfs have a meta now
and
i thought that was like a really
brilliant way to express kind of what i
think about ctfs now it's
it's too much like okay there's these
kind of problems these kind of problems
these kind of problems these kind of
problems you drill on them you get
faster at them and ironically as much as
i talk about winning the real reason i
played ctfs was to learn
and i just wasn't learning as much
anymore and i'm still not learning as
much i've come back and tried a few
problems occasionally but it doesn't
have the sort of
novelty that i feel that it used to
um
by the way like
just let me let me take a little quick
aside here
driving with open pilot really is a
great experience
i'm not even chilling i've been we've
been we've been driving for for an hour
now yeah
like
everybody already when they're driving
let's driving fade into their
unconscious
i'm sure everyone's had this experience
where they were driving on a highway and
they realized wow
i've just traveled an hour and i haven't
really thought about driving much
that was kind of the experience that i
just had right even when i say things
like oh i'm correcting a little bit from
this turn that's all at the unconscious
level
some way the machine learning model in
there is like working with the model
that's in my mind
um just something we have to think about
when we do model updates
will you present
um i'm gonna tell you something else
that's real well we approached defcon i
wanted to speak there this year and they
said no
um they said no they're like you know we
can't just we can't just pick speakers
because they're famous and
i i respect that
um and if it comes from like a really
honest place and i'm saying that
uh you know i wish them well
but
i i i you know i don't like to question
people's intentions but
what i've seen i'm not gonna question
their intentions but i will talk about
what i've seen at def con right and what
i've seen at a lot of conferences
um maybe it's like the death of
subculture
defcon started out as a real hacker
subculture conference right
and you know talk about we'll talk about
inclusivity
inclusivity is great inclusivity of
you know please join my subculture
you know if you're interested in hacking
if you are genuinely interested in
hacking we would love to have you you
know we want you to learn we want you to
be better
but what we don't want and what you have
to watch out for is people who
show up at defcon and don't like hacking
culture
right
don't do that
if you don't like it
like
there's the global culture you could try
to change the global culture but let
people have their subcultures
um and i kind of see things like defcon
drifting away
from
uh subculture and that was was kind of
you know apparent to me when they didn't
want me to speak
uh so i don't know i don't know if i'll
be back at def con um
well it's maybe maybe maybe i'll show up
for a few for a few interesting meetings
but
just kind of my thoughts on it
um where's the next thing right where's
the next thing and that's something i
have to i have to grapple with my life
right like like
the death of 90s hacker subculture
um and maybe it's i don't know maybe it
still exists somewhere but to be fair
like that was the 90s right
the the the subculture embodied in like
you know hackers with angelina jolie
like that was great these are the things
i grew up watching right
you watch that you watch sneakers you
watch watch war games um you know the
old school hacker movies
uh but yeah i mean there is kind of a
question of what's next
so i don't know but uh yeah it's kind of
like constantly
sorry to be mean and if you think def
con is cool and if you're having a good
time by all means
uh keep on going oh slob the the british
knight band was a bot that's why i
banned them
someone was wondering no computers
allowed you know what you know what no
no no no no we shouldn't discriminate
like that i mean this um the problem
wasn't that they were a bot the problem
is that they were repeating what other
people were saying they did add an emoji
on at the end of a lot of this that
doesn't count that's not adding value to
be honest if someone could build a bot
that added value we absolutely would be
fine like that's the questions people
actually want to ask
yeah
wait george i have a little
follow-up from what you were just saying
[Music]
[Music]
bojack has to kind of find a way to move
on and in some ways
i didn't like the fourth season of
bojack
because he moved on
wait i'm not there yet
yeah yeah no no no no i shouldn't that's
not really a spoiler right no that's
like more that's kind of bad
that's a bigger picture thing
end in a positive way does generally
pull his life together no if it's over
but
that is kind of what bojack's about it's
very um you know in with the cultural
zeitgeist
shouldn't be i mean he's so miserable
it'd be weird to see him all of a sudden
well that's maybe the problem it was it
was like happy right it was like a
glimmer of more hope than at the end of
other seasons yeah uh i i have a saying
a lot uh too it's um seven seasons of
house taught me that people don't change
yeah
so
i don't know
i think about that am i capable of
changing when will when will when will i
become a cultural relic well what would
you do as an uber ceo
what would i do as uber ceo yeah
yeah
um
i would uh hire travis back and let him
do it
to be honest that's really what i would
do
he could do a much better job with me
you know what i would i would sit him
down first and here's the advice that i
would give to him uh never apologize
uh you have done so much good for the
world uber has done so much good for the
world do you know how many lives uber
has probably saved from people who
didn't drive home drunk yeah yeah
um walking home in sketchy neighborhoods
and you know there's just such a there's
such an attack on uber and i'm like wow
i just i don't know that that's things
that make me less hopeful for the future
um were there some cultural problems in
uber maybe i wasn't there
but when you look at uber as a force
right i'm not here to speak about
anyone's you know experience at uber but
when you look at uber's force upon the
world and
uber's impact on my life and uber's
impact on all the people who they've
employed right and you can talk about
well uber drivers you know they all hate
uber
no one's forcing you to do it right yeah
um it's an opportunity literally you're
you you're given an opportunity where
you kind of didn't have one before
um so yeah what would i do as uber ceo
i'd think for a while about what i want
to say to travis uh sit him down for an
hour tell him my thoughts listen to his
opinions then probably regardless of
what he says say
welcome back
if you want you want to do it
maybe man i don't know but what are they
going to do they lose a billion dollars
every year yeah and you look at what's
happening you know when you do stuff i
don't know i don't know and you know
what it would be so sad if we lose ride
sharing in the world well i don't think
we'd lose it but we'll play it we'll pay
triple the price oh well no see that's
the problem right like i'm okay with
paying triple the price but not
everybody is yeah and then and then it
would go
what i'm not okay with is waiting 18
minutes for an uber right and then it's
over and then it's over and then it's
over if like you you need to have sort
of a critical density of ride sharing
right in order for the network to work
by the way when do you think open power
will be able to handle hills better
um the new the new the new model
architecture the new model architecture
is much more holistic much more toward
the original dream of come ai than to
end learning this model is not very uh
end to end you know the lanes are
they're not hand coated they're
extracted by an automatic ground
truthing engine but the automatic ground
truthing engine is hand coded i even
want to move away from that
are you looking at any dedicated ai chip
sets instead of
use
no so i'm kind of bearish on dedicated
ai chipsets and here's why when you look
at a cpu die
and when you look at how many um so so
so it's it's uh what are they what are
they um multiply accumulates right
multiply two numbers and like accumulate
so that's the basic kind of dsp
operation
uh that you need for a matrix
multiplication which is what neural
networks are
um
you look at a cpu's die and you realize
really only like two or three percent of
the transistors are dedicated to doing
this
so there's clearly a room for a 30
improvement right at the same process
size and the same power
uh so using cpus is for neural networks
it's obviously a bad idea
but when you look at a gpu's die you see
that like 60
of the gpu
already has the transistors kind of
where you want them
um now you can do things like pipelining
uh better and dedicated hardware than
you can in
gpus but
it's not going to be a 10x improvement
it's going to be a 2 or 3x improvement
and the truth is that's the kind of
improvements you can get from software
so i'm bearish on dedicated ai chipsets
and i'm bullish on gpus dsps and things
that are a bit more general purpose
because yeah because a lot of the
transistors are already being used for
for uh the purpose you would use them
for in a dedicated chipset anyway
uh
honestly i really want to stick with
smartphone hardware for as long as i can
will next year's thing be based around a
smartphone maybe we'll see let's see if
things shake up this year we're gonna
make one state level four like kansas
and then move racing
oh that's not
so we're never going to put policy in
the map
um you have like cruz and waymo putting
policy in the map
uh and like at some point it doesn't
really matter right um also the people
think that there are regulatory barriers
to level four there aren't in some
states you can already put your car on
the road
no people
it's just fine i mean it's a liability
question right obviously you're liable
then for what that car does there's no
driver in the car to think liability
uh but there's there's very little
advantage to doing it state by state
there might be an advantage to doing it
road type by road type but then that
kind of isn't level four it's level
three
wait am i banning bots or no that just
repeats with the book
you ban low quality users
we won't discriminate whether they're
computing any repetition
vulgar yeah
well yeah again unless it's funny right
it's going to be really funny you got to
be funny
if you still have a playstation
oh no
get rid of that crap
uh
this isn't even anti-shilling sony sucks
i don't know just like kind of that you
know what
i'm even gonna be nice to somebody
uh i'm not allowed to discuss my
settlement meeting
but i am allowed to discuss the meeting
we had after the settlement meeting
where i met with some engineers
um
and if there were gonna be lawyers in
the room they wanted me to tell me how
they did it they really wanted me to
like do free security testing on the
playstation for them
happy to talk about it to be honest
especially if there are engineers there
like the guys who built the security
system you know after you solve a puzzle
it's really fun to talk with the guy who
uh
wrote the puzzle
so yeah no i went to a room and uh their
engineers
yeah we just kind of we just kind of
talked about um
you know playstation security
mistakes how things could have been done
differently and there's mostly you all
kind of agreed on everything
but no lawyers i don't know i really
don't like lawyers like the lawyer way
of thinking
uh the lawyer way of thinking is asking
the question what can't you do not what
candy you do
i'm an optimist
is this really the last scope this is
really the last periscope guys
there'll be more next year but like i
mean
it is
you know the more we drive to chicago
yeah
i kind of feel like this is the last one
yeah this is the last one yeah
we can't do fake tomorrow tomorrow we
take the letters uh off of the car how
many people we have
37 seven uh tomorrow is the true soul of
comma this is 37. just 37 yeah the two
salt comma
no but i mean look
we'll grow next year we're really well
every week the system gets better
maps
um
we're working on them we're working on
them we're working a lot on the uh with
the upstairs team
working on localization and mapping
we have an internal server
uh which has our maps on them
they're
accurate to about a meter right now
we want to get that accuracy down to 10
centimeters
and then we've got open source as much
as we can
um
so this is my warning to all the
companies out there planning to rent
seek by holding the map
planning to spend a lot of money right
now to invest
in uh
in in building a map with like a
dedicated fleet of mapping cars
we are going to disrupt you i don't even
mean this in like an aggressive way i
mean this in a like
you know don't be you be right
don't end up like that
um
if you can't figure out a way to sort of
profit off of the mapping operation
itself
you're
um i mean maybe it's possible for things
like paper to succeed
where at least you're crowdsourcing it
even if you are paying the users yeah
but we believe in paying the users with
value
uh we we add value with the dash cam
some value i think we had a lot of value
with open pilot
updated map uh
data oh the updated maps are shipped for
data that server broke that's server
broker there's no incentive to fix it
um we're doing maps much more regionally
now we're trying to make the maps like
really good in one region
and then we're going to probably open
source like that region
we have lanes signs and curves
and they'll all be accurate to like 10
centimeters
yeah
i think
i mean we think of schiffer the way we
think of schiffer in the coming year is
shiffer is like the remote control from
your car
especially if you have an eon mounted in
it and stuff
yeah a future we picture is something
like your friend texts you
a location and a dress
you
say like forward through shiffer to my
comic eon it'll show up in ways yeah
you'll start going
it'll it'll show up in ways and then
yeah all right you know what it's the
end of the year we're going to talk
about it
um
no we're not going to talk about it
about an inverting paradigm so i'm not
going to talk about that
can you gather speed camera data and
shift
our speed cameras
i don't know i honestly i don't know if
we can see them
in here we do want to make a
net we can id cops who are pulled over
on the side of the road trying to uh
oh cops when they're moving too know
when they're moving too yeah based on
you look at the car right the same way
same way people see cops right and we
would love all of our shift for an open
pilot network to report back we're all
the police officers
yeah we could we could contribute that
source to ways and we could figure out a
way to kind of make that data
i'm not sure we're going to contribute
it to ways i think we will try to make
that available in our apps
i think this is maybe the killer feature
of schiffer yeah that will keep people
like really if we could have the best
cop detector i think this is how waze
boots dragged
you guys
all i'm saying about pigeons is we're
going to try to have some out the second
or third week of january to the top eon
users don't care if it's autopilot
shifter plus
um top eon users and it has to be an eon
we can obviously detect
because they only plug into eons we're
going to send some out
get telemetry and then
if the telemetry looks good
we will
you know what i would give for other
companies to have periscopes like this
what i just
just i just would be so happy yeah it'd
be really cool it would um and i was
thinking like like a lot of people
emailed george asking for
you know to be involved in common ai
some business blah blah blah but like if
you hopped on periscope and started
asking us questions like you have access
to george hawks right now like if anyone
out there wants to no yeah actually like
honestly negotiate on periscope how cool
the world would that be if like you hear
yeah you know apple buying shazam on
periscope you know like yeah like
imagine shazam had a periscope right and
this is
why this is what i'd like to see exactly
oh virtually chris said this really is
amazing and bugs you said we'll be in
new york until the 28th
in new york city just do some meet up we
wanted the car right yeah
yeah you can um drink some beer yeah
yeah
we could all do it
we have a self-driving car awareness
tour reunion event
[Music]
uh but yeah no um
i do this thing right i get uh people
reaching out to me a lot from kind of
like investment uh analysis firms and
they want to pay me 500 for an hour of
my time
to talk with me about uh
about the space about the autonomous
vehicle space and i say this i'm like
i'll do it if you can buy me an htc vive
should be an htc vive
five is a hundred dollars more
to be honest i'm sure they don't care
about the money
but i think i've had like four of them
reach out to me and offer me this deal i
think i even had one offer me 750 and i
said buy me an htc vive and they
couldn't do it because they're that
bureaucratic the htc vive test is kind
of a great test of who you want to talk
to
um so same thing with the periscopes
right we have people email me and
they'll send me like four emails and
reaching out
i just ignore them
i actually have some filters to just set
up to ignore them like
do you care or are you doing this as a
job
if you care come talk to us on periscope
and i'll be i'll be incredibly honest
with you it's so cool and those are the
people we want to work with
um yeah apple buying shazam on a
periscope like there's like jobs talking
and just kind of for you know
posterity's sake right like i don't know
and it like
breaks down this
information access that like maybe only
the media has right now
yeah and then the media presents it
through their lens yeah it's bullshit
youtube right you guys i was times first
of the year 2006. you were what was
times person of the year in 2006 you
know yeah that's what i was i was
are you serious i swear to god how about
a hundred dollars wow
and gave me half of it you know what
honestly if that's what i go to jail for
i don't know man
wait someone wants to do a stats page
like total mile driven disengagement
rate do you want to do it or do you want
that you want us to do it oh
if you want to do it if you want to go
through these periscopes and analyze the
disengagements you are more than welcome
who wants to go to houston
wow
i don't know if it's the same yeah
america's so bad at naming cities
it's so unoriginal like come up with
anything nice you want to do it you
should definitely do it well new
modeling techniques ever replace defense
oh no they're they're definitely based
on deep nets um it's all about like how
you train them
deep nets are a very powerful idea
uh i don't i don't know like what it
would even mean for something to replace
deep nets i think things will work with
deep nets i think we'll find better ways
to train them i think metal learning is
going to be a huge field of machine
learning uh we still use optimizers like
if using stochastic gradient descent
there's no metal learning if you talk
about momentum as metal learning but
that's still very very crude right what
if you could learn what your future
weight updates would would look like you
could build predictive models of the
learner
and then this is not an original idea
there's people talking about it
there's probably people who've done a
lot more research on it than me i know
kind of why it doesn't work but
yeah virtually christian the coast is
like it's so annoying about things in
portland oregon thinking they mean
portland maine yeah
and also uh
yeah so this person wants to do it with
all drives not just our drives
like all the data all the data um
yeah
i don't know
do you kind of have those numbers
they're kind of like user exact user
numbers we don't really share those kind
of things do we train our model in
google slash amazon is it expensive no
chair model in the basement we have 25
gpus in a cluster
um
yeah
trading models on the cloud is kind of
hard for a bunch of reasons
data access
bandwidth
could set it up to all pull from s3
trade it on some of those v100s they got
on aws now maybe next year we move to
cloud training
we're not buying any more hardware for
the data centers
i wish it wasn't so dark i think we're
about to come up on a cool spot in the
missouri river no mississippi right now
oh it's a cool spot we're just like a
huge part of the mississippi the city is
built right on the mississippi river
we'll see it tomorrow morning tomorrow
morning
go out we got time tomorrow yeah the
tour ends tonight folks
why is so secret about how much you're
phoning and will open pilot driving
traffic like in the philippines
um because those statistics are very
easy to misinterpret
uh and i don't know i've never been to
the philippines thoughts on induced
demand from av reshaping land use and
where we live yeah
maybe
um
you already see this with uber i think
you see the availability of ride sharing
services
uh increasing property values in places
where public transportation doesn't
access in cities where like public
transportation is super common like new
york
people who live like a 20-minute walk
from the nearest subway stop maybe their
property value has gone up
but matter new york has cabs i don't
know cats are still really prevalent in
new york city because they're a good
experience right yeah and they were
never they were never overpriced
yeah they're not that overpriced they
take credit cards they're clean
you don't generally get it oh my god
you're getting some cabs in sf and
you're like this driver's on drugs
i've had this in vegas too i'm like yeah
you're on drugs man like i can tell
um
i i've never had that new york
yeah um i've never like gotten into a
cab where i could tell that like someone
vomited in here a week ago
clean leather seats a nice barrier it's
a good experience right and that's where
companies should be competing they
should be competing on experience what
providers use for storage of user videos
uh azure because they give us free
money it was aws and then azure gave us
more free money thanks azure um and to
be honest it probably worked we probably
will end up sticking with azure because
who's doing another migration
not the person who did a migration last
will time
manufacturers compete with like gm and
toyota i think they mean how will small
uh car manufacturers yeah like their car
dealerships i don't know they're
questionable primary factors don't
compete car dealerships don't compete
car manufacturers won't
getting into the business of making cars
is not a great business to be in
um you're going to see the same thing
with phones
notice that the people who made phone
make phones today
are the same people who were making
phones
you know 20 years ago for the most part
and i guess apple's not but they were
making ipad they're making ipods which
is a similar thing right but a lot of
the sort of like the samsungs the lg's
it's the same companies they've been
making cell phones forever
motorola
that you watch
uh the nokias and the blackberries top
so the same thing didn't happen with the
car manufacturers
maybe you'll see
you'll see like the fords
yeah for florida's who i don't have a uh
right prognosis for
um because they really don't want to be
the foxconn
or they should be they make a great
truck
you get this question a lot but can you
download your data on shifter yeah
well yeah go to the just go to beta.com
it
we can make exporting easier we should
exporting of candidates if exporting a
candidate we'll make exporting videos
from cabana as well
you can already save it like apparently
you can't right click on the stream and
click save yeah i thought that worked
i'm sure you can find some stream
downloader tool and it'll work
download all the data for a fee
for what you don't even need a fee you
can just download it
uh it is i mean it's rate limited at
some points i don't know
yeah
and then we have a bunch of driving data
available from our research paper we do
on archive.org seven and a half hours
um do we know where we're going again
yeah exit two exit two okay cool you'll
navigate us to yeah we got a little
wherever we're parking the car to sleep
in tonight yeah
nice spot by the river nice spot there
so it's exit to well that's on the
missouri side yeah
well the missouri side of the wisconsin
side uh
wait what's the address we pass over
into
wisconsin
yeah it's like dependent on our energy
yeah totally it is it is it is i mean
that's true about cam girls too
things we've learned
yeah
i mean the materials that like car
companies make within a car
is pretty limited
already to what you like to touch and
sit on
the materials
like the parts of the car that like ford
makes is pretty limited right well they
make like the body the seats
no i mean look you can make the same
argument about about lg right
like lg buys the processor from qualcomm
i'm sure they have like
yeah i'm just i i like i don't think
people think that cars are that way
i mean same with phones too right well
exactly yeah it's the same phones like
they buy those things they buy a camera
module there's tier one suppliers in a
lot of industries so yeah i mean most
things in a car
are made by or made by tier one
suppliers
like the steering column is made by like
like bosch mixture columns continental
yeah radar
virtually chris that's the banned
question
and someone else is wondering uh has any
crime manufacturer sent us a car to work
with
no
uh to be honest we probably wouldn't
accept it
well uh actually uh
like
oh well yeah i mean that's why we won't
accept it right we've
briefly worked with this with this
company and it just it doesn't work
because expectations aren't aligned if
if you are a car company out there and
you literally want to give us a car
because you think we are cool no strings
attached i will accept any car except
the subaru nah i'll even accept the
subaru i'm just kidding i'm just kidding
um
but um
it's okay if you see we we accept people
no it's cool man it's cool
uh i don't know
i will answer the question like like for
you i'll answer the question
um
our plan right now is to really just
continue with hondas and toyotas
i'll probably get bored of this plan mid
next year because i'm personally sick of
driving around in honduras and toyotas
but the civic is so nice
dude i used to drive a bed such a nice
car i went from like benzes and porsches
to like civics and sahandas and toyotas
it's like you got married if you had
kids
yeah i mean this is this is just this is
just me and my personal life right but
is this system at the quality level
where we can put it in a benz and feel
good about it i don't think so yeah i
think we have to get better and when we
get better we'll start working in
like
i personally yo guys i want a
self-driving car right
um and you know obviously the car that i
would choose to buy is not
uh not one of these
um if i was buying a car for my personal
life but
if this is your budget for a car
these are the best cars you're going to
find in this price range yeah the rav4
has really jumped up in a few spots
this past year oh yeah yeah this is
apparently
for a one-on-one car this year and then
another one so for a while it was number
three yeah
um
for a while it was number three
was the cheapest new car on the market
oh i think it's a kia i think there's
like a kia for like 12 grand
the fiesta is down there too
yes it's like 14 14 you got a car for i
think the fit is like 15. it's pretty
crazy it's the most expensive these
things yeah
well no i mean the real thing that's
crazy and expensive it's used cars
yeah right you're really you're willing
to get like you can go like like a you
know when i bought by the way when i
bought a porsche and a mercedes i didn't
buy new porsches and mercedes i bought
used ones my porsche cost me 10 grand
yeah um it was a great lots of fucking
car
my mercedes costs like 45 um
but you know i i bought that to be nice
and so it's a
110 000 car new
um
used cars are great deal yeah you could
probably buy a used i sold it honda fit
i sold it for 14. nice like that's the
real right i feel like
oh i'm not on the car for right here
eight years yeah i'm
i'm happy with the
uh depreciation of the value for money i
got on that car
will you buy a tesla for personal use
um actually probably knives
there's a few problems with the tesla
uh first off they aren't luxury cars
despite a model s having the price tag
of a luxury car i feel like the interior
and the ride quality doesn't even match
an audi a4
um
richard i disagree
um
the
electric okay the acceleration is cool i
like the acceleration i really like the
responsiveness you know what kills me
we rented uh we rented a chevy volt
and they literally delayed the
acceleration to try to mimic a gasoline
car yeah you have so much more power
available to you in that motor you
deliberately make it lag that's
disgusting i mean it's the only
explanation i have
if that explanation is wrong i would
love to know but that is certainly what
it feels like we certainly have this
thing in electric cars called creep
right right tesla you can turn it on
we have 18 t right yeah they're probably
not
probably not
dead zone let's tell them what we really
think about them
we love you scobies even if you can't
hear
they're so us
you know it's amazing here they are
right now i have a service they're sweet
scoopies are belly bags cookies are
probably like we didn't want to hear
that
does open pilot profile different car
performances slash response for deciding
actually
no
if you're no if you're driving safely
the truth is with safe driving all cars
can kind of be treated as the same
our our limits our steering torque
limits our braking limits and our
acceleration limits are well within what
any production car can do
yeah so we're going to leave them at
exit 2.
oh it's exit 2 in the new stage
it's not the exits are going that way
not this way is there a standard for
that i don't know
yeah i guess they restart in the state i
guess they restart this thing we saw
that though anywhere else
no we didn't i think they only restart
when they change the name of the file no
no no they definitely restarted stay
really they definitely restart in the
state the only question is are they
going up or are they going down i guess
they start going up again well yeah
we're quite high right you know like
we did 500 well we didn't pay enough
attention to see if that was true
all throughout the states but yeah you
do run into an interesting problem where
if like you have one that's descending
and one that's ascending you have two
exit twos actually pretty close to each
other just in different states right
she wouldn't really want that
that sounds like an interesting state
coordination problem i bet you members
of state legislatures have spent a lot
of time discussing that yeah well these
are all federal interests in iowa i
understand highways are federal i don't
know how much of the things the state
might have no they they're they're
federal i think there's hoover
man right
no eyes on them
find a song about it
is the father of the inner
wow
propaganda used to be a lot more blatant
this is some it's a newer song
lacrosse airport
this is the band is called best friends
forever i've known his friends forever
listen to eisenhower eisenhower
oh eyes eisenhower man eisenhower
you know he was great
eisenhower was like he was a bridge
player the man was like real he was real
like analytical about everything
game play real player of games which we
still had that in our modern uh i like
him because he got on the air and told
the american people about the dangers of
the military industrial complex
interesting yeah let's create an
interview with him where he talks about
it it's like you know we shouldn't
really have this machine that exists we
need to be weary of it
yeah and then it kind of felt
yeah
true
you know truman made the decision to
drop the bombs
hear about interviews with truman where
like they're talking about you know
do you really feel like you made the
right decision what about all those
lives and truman's just like look man
you have no idea what it feels like to
have made this decision okay
yeah i mean like all the people that
worked on the bomb were like pretty
upset too yeah i don't know i mean you
can play out alternative histories with
what would have happened
what do you think of recursive neural
networks
rnns or
our rnn's
i wouldn't exactly know what the term is
it's hard to keep all the terms straight
i kind of just see the diagrams being
drawn out and i think about like
informational flow
uh i don't know
uh i don't i'd have to look into like
more what they are
so
are you worried that musk will kill car
usage with hyperloop
no
that sounds great man i want a hyperloop
yeah i'm not like worried about these
things most guys doing hyperlink i'm
honestly i'm excited by these things i
would love to live in a better world
where there are hyperloops
dude
christmas
has gotta go
[Music]
thank you for joining us for this trip
it's been great having you on the uh
with us we're excited for more of your
videos we're definitely excited for your
i think it's the videos exit after this
thing
is musk
all right maybe we'll leave it with that
scopey's we're going to the french
island
and where we go from here
nobody knows
nobody knows
where it goes
we'll see you in the new year
so they can't see you enjoy bye scooby's
thanks for joining us on this trip
it's been great having you
you guys know that Black Mirror episode
where they have the ratings it's my
favorite episode
uh you know that woman starts off at a
very high rating and watches her rating
plummet
and
at the end she has the one star and
she's in jail and she's just screaming
and she feels so liberated
this is what I feel
I feel you know like like the gpts have
made it so obvious that it's all
bullshit all the niceties and language
and all of the oh yes I'm going to write
a four paragraph email to express a
two-sentence idea
is it over is the professional
managerial class over
I heard the Barbie movie described last
night as post-woke and I thought that
was really cool
uh okay my talk is called three stories
and we have three stories one about the
past one about the future and one about
the present
uh so we will jump right into the first
story about the past with the crude is
automation
um
so Cruise automation most people don't
know this right most people see the
weird orange hat branding today and like
look we're building cars that are
symmetrical I don't even get it but uh
you know Kyle was actually uh first
building the cruise rp1 Highway
autopilot for ten thousand dollars
and it sat on top of your car like that
assuming your car was an Audi A4 uh and
it worked on the highway uh to drive
um so Lex was guest 14. uh Kyle was
guest 14 on Lex
and he gave up due to the technical
challenge
um he didn't give up because it was a
bad idea it's actually the right idea he
gave up because it was too hard and he
had three concrete complaints about why
it was too hard
one is that there's a long tail of cars
right so uh they built it for the Audi
A4 we're like okay we can make it work
on the Audi S4 maybe the A6 and you
realize that almost no one drives Audis
all right we started with an Acura look
I made the same mistake
um and it turns out there's this
absurdly long tail of cars
uh
so how do you deal with this
well you just do it that's not that much
work
comes a 20-person company and we just
did it thanks to you know contributors
thank you contributors but like it's
doable right you just do it okay cool
oh but but how do you handle failures
what if a car has a sensor that fails or
GPS that fails or camera that fails or
steering wheel thing that fails steering
wheel actuator uh
okay you just do it
um open pilot has a great error
detection and handling system the alerts
uh Alex Roy drove in a car with a comma
one and this is what he praised he's
like wow this thing actually like
communicates with you
um so hopefully you guys have
experienced that using open pilot like
it actually
you know gives you errors that tell you
what's going on
then we track all of these on a back-end
dashboard and we drive them down to zero
um so again you just have to do it
uh it's different in one version of the
car what if the car manufacturer updates
the firmware
okay
you do it
fingerprinting yeah
we'll read all the firmware versions
we'll figure out which ones matter we'll
figure out which ones don't we'll do
this at scale
right these things are engineering
challenges
fake any of them either
when you ship a product to people can't
fake any of this stuff
all right
that's probably mostly of open pilot you
guys probably mostly have common threes
and it works in your car
and it handles failures
it deals with all the different versions
of the car you just have to do it
common was not supposed to exist
there is no sane reason that this
company should exist
the second round will be raised from
entries and Horowitz
I pitched him a crypto coin
hey look man you want to hear I'm
telling you what you want to hear man
I'll tell you what you want to hear I
know they're bullshit but you know you
want to hear it finals I'll tell you
that I know enough about crypto to make
it sound convincing
um our third round we raised from much
more aligned investors
uh look and it's not that even though
Andreessen Horowitz is bad it's just
that like again you have to think about
what these people are optimizing for and
what time Horizon they're thinking on
usually very short time Horizons
um so but then again you ask yourself
what's what's worth doing in the world
there's another scene from Back to the
Future too
if you're not building a company that
looks like that line what are you doing
with your life right
if if the only thing that's going to be
different if you succeed with your
company this is to everyone in the
audience everyone out there watching if
the only thing that's going to be
different is that the pile of money is
in your entry in the SQL database
instead of somebody else's
why are you doing this bro it doesn't
matter just update the SQL database it's
a lot easier
um so yeah you know build companies that
look like that companies that are going
to change the future
not change the distribution of wealth in
the future
right
I'm not doing this to like we'll get to
that this is a story about the past
so here we are
six generations of the hardware
zero
whatever you play with the letters a bit
comma two comma three I love when
Hardware companies just do that just
make the number bigger every time so you
know right it's easy
um
yeah
that's it
250 plus cars
uh every major brand except for the Flex
Pay ones Mercedes BMW no but otherwise
with Ford that's all of them
25 employees
uh uh in open source
all right so uh I think it's pretty easy
for this to tell that all three of those
numbers are going to go up begrudgingly
on the third one very happily on the
first two
um
and open source will stay uh keep you
want Hardware to be good look at the
iPhone right this is iPhone 13. you know
why it's good because they built like 13
other ones they built even more
right that's how you make something good
you just keep doing it you just iterate
it ship it you iterate on it
uh you want to support more cars okay
make sure you don't have regressions
well we'll get that I mean how how do we
how do we do this right
let's start with some like
with that one
right did you hear helion energy is
going to ship a fusion power to the grid
by 2028. did you hear Cruz is going to
have a billion dollars in Revenue by
2025.
like can I bet against these things
I hope that every
you got like a real sense of honesty
and part of the reason you get honesty
here is we don't have communications
people
what are Communications people in a
company besides paid Liars right what is
the job of it what is the job of a press
secretary
oh oh okay you you murdered dirty
orphans in Cuba uh I make it look good
though make it look good right no like
it was just honesty and it's honestly
because lying if you tell the truth you
don't have to remember any
you know that's that's a good quote
right
um
tripping
you had a ship shipping keeps you honest
right your ship stuff you send it out to
people and they'll tell you about
whether it's crap or not you know how
they'll tell you you know there's two
types of ways to measure people's
preferences your stated preference and
revealed preference right stated
preference is things people say they
want like
well wouldn't it be nice if we had cars
where we could share the car so we could
uh save the environment and then you
look at the HOV lanes on highways and
the usage of uber pool and you're like
wait a second no no no no no no no
everyone wants their own car right
reveal preference beat stated preference
so how do we measure reveal preference
we sell something
profitably
and then see who buys it right
so I'm shipping
iteration
uh you know how you build something good
you build it bad three other times right
that one's still not that good you know
that one is bad after you get to the one
that's built three times later and
there's no way around this the only
thing you can control is your iteration
speed right how quickly can you iterate
how quickly can you come out with new
versions how can you reduce the Ripple
time but you have to iterate
um and then the last one is humility oh
yeah you know this guy used to call me
Eagle hot you know it's kind of funny
right I do have a big ego I think I'm
better than a lot of people I mean
that's a true fact right I think I'm
better than a lot of people now look
look you may disagree with me about that
fact and I'm open to having a
conversation about it I'm open to you
know what do you want to what do you
wanna what what shall we challenge each
other at right
but that's not what humility means right
that's like like acting humility is
saying
okay there's an actual problem how are
we going to solve it right like it's
humility not as some status game but
humility in the real face of nature how
do you solve these problems well you
have to have humility you know it turns
out you think you think oh well I'll
train the machine learning model it'll
work you know I thought this is a
comment I'm like well I'll put in the
I'll put in the output path and I'll put
the image in and it'll work this turns
out to not work at all
um you can look up behavioral cloning or
imitation learning for why it doesn't
work and you just got to have humility
you know what I mean like Nature Nature
Nature doesn't care nature doesn't care
you know and it's humility versus nature
not humility versus people uh so yeah
you know you got some you got some
values of a company right
um all right
so why haven't we won
do we have the right right
we'll talk about what I'm doing wrong
talk about what we're doing wrong but
why haven't we won
um and then the truth is things take a
long time even accounting for things
taking a long time
this is not the first Comic-Con this
will not be the last Comic-Con
all right humans live a long time you
know this is something a lot of people
forget about in the world today like a
lot of people are so like man how can I
get rich quick how can I pull this scam
how can I ship fusion power to the grid
by 2020 but you can't even ship fishing
power to the grid by 2028.
you know
um so
yeah I'm gonna look I'm 33. I'm gonna be
here for a while
all right so you start thinking about
that I'm not trying to get rich I'm not
trying to retire there is no exit
there's no exit
okay and you know that book start no no
this is no exit this is it this is it
hell is other people right like
like there is no well we're gonna get to
this point and then we're gonna stop
no the system is going to get better and
the system is going to get relentlessly
better
right it's Comic-Con too
we'll see this is about the past
oh
think about like climbing out of a well
um so let's you know put it yeah
how long is it going to take to solve
cell traffic
no idea
but as long as every day
you make forward progress as long as
every day you make a few steps climbing
to get out of the well and as long as at
night you don't slide backwards As Long
as You Follow That algorithm you are
eventually going to get out of the well
right avoid regressions and make slow
and continuous Improvement this is how
you make things good
so climbing out of a well there's not
another way to do it
no but you don't understand we're going
to get a huge cash infusion
no
it's not going to get you out of the
well man what are you going to do you
got a number in a SQL database right
um it turns out these companies are
scams right
well this is Aurora too simple luminar
they all raise way more money than
common debt
which
uh oh none of these are Fusion these are
all self-driving cars and lidar but okay
so
question right what does it mean for
something to be a scam
there's something to be a scam require
Awareness on the part of the creator
that it's a scam
right if the answer to that is no if you
believe that intention matters
then what you're going to get is honest
idiots to raise billions of dollars
right they're being honest but they are
idiots right
this was obvious to me I've been saying
this exact same thing now for seven
years
I could have told you I did tell you but
I'll listen right
you know people also thought that
bitconnect and Luna warrant scams
right there's people honestly out there
who Shield me both of those products
right and now I mean look both of their
Founders are in jail so you know we can
all like there's a spectrum of scams
right
but um
yeah
uh you know we'll get to cruising waymo
later
marginal utility approaches marginal
costs this is a true theorem of
economics and what is the marginal cost
of open pilot
it's the marginal cost of autopilot
zero right so if open power provides any
utility at all marginal utility
approaches marginal costs a lot of times
you don't want to measure success in
value creation because a lot of value
creation is a scam look at GDP
kind of want to measure success and
value destruction if you can destroy
fake moats of companies open pilot will
continue to get better open pilot will
solve self-driving cars and open pilot
will be free
[Applause]
[Music]
did you know Linux is the fastest
growing platform on azure
it's not just a smart guy and Bryce
right and Bryce the car companies that
are smart will embrace the car companies
that are not smart will ship you the Sun
Cloud or the Oracle cloud or whatever
Cloud you know oracle still exists I
don't know how they make money but
whatever
um Linux is the fastest growing platform
in Azure markets do approach rationality
you just have to survive
Market can remain you know irrational
longer than you can remain solvent uh
yeah
this is a lifetime Revenue comma
nice uh a nice R of like that something
uh this is the amount these companies
have made in lifetime Revenue versus the
amount they've raised
no like I don't get it I don't I don't
know man maybe I didn't go to Harvard or
get an MBA or something
but like bro well okay look man look man
we we raised we raised 3 700 million
dollars and we made 200. okay that's
cool man
like
I don't get it I don't like I I would
I'm not even saying like Okay obviously
when you first raise for a company this
is true but these aren't recent races
like these companies have raised after
they were not even remotely close to
making back their initial investment in
Revenue not profit Revenue right you can
look at other companies like Amazon and
Uber and be like well I mean Uber's
hilariously unprofitable but they make a
lot of Revenue they have a lot of users
these companies don't
uh so this is the number for comma
uh 22.2 on 18.1 million raised
there's Twitter followers for all right
I told you I'd address cruising waymo
right so I actually do honestly believe
that Cruz and waymo have larger
marketing budgets than the operating
budget of comma
right and uh soon man soon all right
look they use a linear model but like
this is what the website said so
laughs
uh
employee retention uh four people have
ever quit over seven years
uh
it turns out honesty is a great draw uh
same Mission folks governance a
commitment to iteration and Improvement
I'll come work here
uh
look all this stuff everything about
opioid I didn't do any of it I haven't I
haven't pushed to commit to open pilot
in two years it's everyone else you saw
talk here today no saw me
um my sole job is to keep idiots far
away right that's really that's really
my only job right like it turns out yeah
I promised the other parts are more
upbeat the past is always depressing you
know but
uh no seriously um
to anyone watching this to anyone in the
audience if you want to come work here
look the bar is really high but what we
ship hopefully is really good and you'll
get to ship things right you'll get to
ship things you'll get to be a part of
this process that makes things better in
the world
and I think that's the real thing
especially as we approach this like
everyone late stage capitalism everyone
kind of understands the economies
whatever man fugazi right
uh I think the thing that people really
want is that they want to make the world
a better place like I said if your
startup looks like this
you know you're just changing the
distribution but if you start it looks
like this you're changing the world
I did not realize I was entering such a
dishonest game I have never seen a more
wretched Hive of scum and villainy that
I have in the business worlds
uh but you know we're gonna win anyway
uh just takes a lot more out of you than
you think it's kind
okay
the future
I'm excited about the future
I really am
so we'll start with a nice quote from uh
Elias goodkowski
and I'll plug in the numbers for the
current computing speeds the current
doubling time and estimate for the raw
processing power of the human brain and
the numbers match in 2021.
interesting
not but that far off
and I think we have a little bit of
still work to do on the software but
like
everyone kind of sees it right
like this is a lot easier I've been I've
been talking about this stuff man when I
read when I first I read this quote when
I was 15. it's changed my life my whole
life my entire life trajectory has
pretty much been because of you know
this guy in this document I'm sure he
incredibly disadvous it right now we
gotta nuke the data centers don't forget
but um no really uh
yeah
so what is the future
I'm going to tell a little story and my
story is called forward-looking
statement
ladies and gentlemen welcome to
Comic-Con 9 it is the year 2037. I am an
AI generated voice hiring real people to
do Pas became
way too expensive in the early 30s
um
you've grown quite a bit since the first
Comic Con in 2021
we have 44 stores in malls around the
world
and a billion devices Souls uh in the
top 10 biggest consumer electronics
companies and we did without selling out
um so let's look at a picture of a mall
this is a real Mall you guys should all
take it out while you're here it's
definitely uh it's called the UTC Mall
uh and I'm serious about the mall store
like like it's written on our boys
inside like come on isn't this where you
want to buy a commentary isn't this
where you want to buy a common body
you know like come by the mall store
oh the metaverse is lame it's gonna be a
real Mall store go get a Cinnabon I
don't want to sit about anymore get a
bubble tea
Happy Lemon
um so we're gonna we're gonna have a
store in the mall uh yeah
that's gonna happen is more stories real
uh
it's hard to go anywhere without finding
a comma remember it's 20 37.
in its three form factors cars bodies
and puppies it is versatile enough
for everything
you'll find commas transporting goods
cleaning houses cooking meals and just
being a lovable companion that will go
anywhere with you
it's not rendered
uh uh yeah
now announcing become a seven
just two twenty that many dollars they
have to be twenty twenty three dollars
look I don't control the inflation
uh uh it's a third generation comma asec
uh 50 pops of compute that's 50 000 Tera
UPS
uh for reference the comma 3 has about
five
all right so we're off by a factor of
ten thousand don't worry don't worry the
future comes fast slowly and then
quickly
um it's the first Common device to boot
into tiny grab
oh no really like look at home pilot
right like open pilot is kind of this
open pilot right now kind of means two
things right it's kind of both this
system layer and the self-drive layer
right the self-drive layer is a policy
model for driving on on roads these
system layers like a camera Damon maybe
we'll even start to move things like the
vision model into the system layer right
but you have this system layer in open
pilot which runs Foundation models
right and then you have on top of that a
policy model which does driving and then
underneath that you have tiny grab you
have an operating system which can run
all these models and schedule them
appropriately
50 pops is a magical number combined
with the latest version of open pilot
our foundation models learned in the
cloud RL in the world and a good amount
of on device learning we expect a comma
7 to be able to do anything a human can
do
this does not stop at self-driving cars
okay
level four level five this doesn't like
this is boring
oh but but I heard the question before
not to call not to not to not to pick on
you like oh like like why don't you
focus in on like an application oh my
God
I'm trying to build people
we're trying to build people that's what
we're trying to build here
right
self-driving is just a really cool it's
kind of a restrictive problem right you
can refine your techniques in
self-driving it's like a game but
eventually
this all becomes general purpose and
sooner than you might think right I was
trolling you know when we do the Taco
Bell challenge i i i Elon replied to one
of my things and I was like yo
our system is going to be so end to end
that even our DM's going to be end to
end
you guys saw it
uh yeah
anything a human can do is an
interesting thing too right so this is
my 300 this is what we build the uh
comma threes on
you understand that it's being operated
Now by a comma seven right
you understand that most of the
employees in the company now are commas
right
it's interesting right
I mean how many of our and you'll hear
about this in a later talk today how
many of our workers
how many people worth of compute does
comma have if you define a person as 20
petaflops you'll get an answer to that
later today
right
how many how many silicon people work at
the company
I'm not here to discriminate man I'm a
progressive
and I'm saying yeah no I mean it was
crazy when we first saw comma 7 actually
come over and like help build the other
comma sevens it was it was a wild uh
your comma seven is yours just like your
comma 3 is yours
the models we train in the cloud are
Foundation models meaning they do not
have opinions they're not rlhft they are
true foundation models and I want to
give a thank you even though I lost 80
000 in your stock and really regret
selling it I want to give a thank you to
meta for releasing llama 2 as the
foundation model and not just the vrlhf
version we want to do the same
and
I will
whatever it takes there's no cause I
believe in more than open source AI
um so the models we train in the cloud
are Foundation models they do not have
opinions
we do offer some pre-trained policy
models we call them custom software
maybe some of you familiar with that all
right if you want a custom if you want a
pre-trained policy model that drives a
car again how it drives a car is is a
decision right we make some decisions
about how to drive right in this but
that's that's when you get into opinions
right foundation models are unsupervised
trained policy models are trained
supervised in some way shape or form
with some RL with some supervised with
whatever but by default the uh comma
seven is like a child
it will learn whatever behaviors you
teach it so teach it well
and it should pick up skills as quickly
as a smart human
what's that
uh yeah I don't really know what's next
the comma 8 will likely be running the
company
let's look at it for a minute right
it's got two eyes
it's got a mouth
it breathesis air
it has two ears I pushed hard to keep
those two ears
it has a spinal cord
is it a spinal cord
I mean yeah all right look it's a comma
three it's got this looks like a little
bird brain right it looks like one of
them dumb dinosaurs you know
but we'll get there we'll get there
robotics is all a question of
intelligence
all right
turned out how many of you guys have
robot vacuums they're pretty good now
right
how many of the meat quartz
right why do they eat chords because
they're not smart enough to really
understand and like the comma 3 is about
the same intelligence as a b right it's
not as smart as a mouse never mind a dog
or a human but we'll get there robotics
and that's like humans are so good at
like moving we are so dexterous with our
hands people forget like how good humans
are
people forget how good humans are
driving they have all this self-driving
rhetoric oh the cars are going to be
safer or nothing I haven't seen a car
that's anywhere near as safe
right now ital systems can make it safer
because as systems you pay attention at
all times I do believe that ADA systems
make it safer But A system that
completely takes control away from the
human
you're forgetting how good humans are
humans are really good and humans are
good because they're intelligence
they're intelligent robotics is all
questions
but now back to the present
it's 2023 and you are Comic-Con too
thank you all for coming out
uh I hope I hope the things you saw
today were good
uh
Mall store
all right come on I really I really went
off in the weeds of the future today but
the monster is going to happen soon
right
the monster is going to happen soon
all right all right I love it all right
uh in the present huh yeah
a present clip art
all right
um I'm gonna sit here for a minute so we
can all decompress a little about the
future because we're we're really about
to undergo a major tone shift in the
presentation
the next slide is a is a major tone
shift from this hypothetical future
where robots are replacing
coexisting with humans uh so major tone
shifts coming and I'm just sitting down
to prepare all of you and now I'll go
back to the presentation
all right so we're going to start with
some contacts these are the failure
rates of iPhones
all right whenever we discuss failure
rates nobody is really going your Apple
is never going to put failure rates on
their website or in any of their
marketing presentations but I understand
this is very important to a lot of you
that buy the hardware it's very
important to me as well
um so to calibrate iPhone 6 is with the
worst and had a failure rate of about 26
percent uh whereas you got down to like
iPhone X's iPhone 8 plus and they were
like three percent right so the range
for iPhone failures is three percent to
26 percent
these are the real numbers right
um I could do it for game consoles too
but I like this chart for iPhones uh so
this was the failure rate of the Comet
two
uh yeah uh these are just real numbers
you know like I said we don't hire any
marketing or Communications people so we
don't have any people to make up fake
statistics to lie to you I just actually
took these screenshots from our reel
okay how good is the hardware
development uh the comment two failed a
lot uh
you know look we honored the one year
warranty spent a lot of money uh
honoring that one year warranty
uh and one of the biggest priorities for
the comma 3 was this cannot happen again
we are going to make these devices good
we did a lot better with comfort
uh
so you see orders of magnitude we've
shipped about
seven thousand six thousand which is a
lot better with the failure rate on the
three and the the real story is even
better than what that shows
um so this is the commentary failure
rates by month
and you can see a jump discontinuity
right here
it has nothing to do with one year or
anything like that
it has to do and that's when we move to
our new office
we built a real production facility for
these things
people think that this is easy people
think building like high-end Hardware
like this is easy go buy an owl cam and
you'll see that it has a crappy little
screen and it's in this like overly
dense plastic it doesn't look like a
sexy piece of modern consumer
electronics and it's because it's hard
right for however good you might think
our software is or however bad you might
think our software is our Hardware is
pretty much the same
all right same processes same ways of
thinking about things
um but we've put tons of effort into
making this a lot better so you can see
the failure rates of modern coma threes
are a lot closer to five percent than
they are to nine
and we are going to do even better
we uh dropped the price five hundred
dollars
uh in January
you can see we two extra sales which is
nice we do need a bit of growth uh so
you don't want too much growth right
we're not going to do we don't need to
reach the whole world this isn't for the
whole world but we do want to make a
product that is a bit more mass Market
it's quite a bit more mass Market
so where do we go from here
we'll find them
the comma 3 is great what do we do to
refine it
introduce them
the common 3x
so it looks pretty much the same from
the front
uh
see the IR LED is a little different
this the case is so much better on the
3x like when we did the three it was the
first thing we injection molded and it
was bad
shiny black plastic
you know you guys in the garage trying
to sand blast these things in our old
office oh come on like they look bad we
gotta makeup
stunning this time
um and you see the down curves there the
road cameras are on the board
we'll get to some pictures of the board
in a minute
now check time what time or something
3x specs okay comma 3x
it's the same 845 platform and Camera
Arrangement as a three
so what this means is your three will
not become obsolete
um the three and the 3x are in the same
cohort meaning like the software is very
close to interchangeable between them
more similar to how like the Eon and the
Eon gold were in the same cohort right
like everything about the E on gold
we're similar enough that we could keep
the software supported at the same time
so we're not the three and the three
acts are pretty much the same support
window again no promises on this
but uh yeah
uh we upgraded the cameras
three Ox omnivision sensors uh these
sensors are newer generation they have
20 more DB of HDR they have a faster
rolling shutter uh they can operate at
real 60 FPS if we wanted them to uh
yeah some of the late model coma threes
have this too so if you bought a comma 3
in the last couple months you have that
uh 128 gigabytes of storage versus 64
gigabytes uh so I put that star there
because we're going to start measuring
our gigabytes the same way phones do
some is taken up by the operating system
in the software but the real Flash on
the device is 128 gigabytes
so double the storage
can FD integrate it
I I know this is the one people are
waiting for this is the one people were
asking about a Discord uh so so it
doesn't look great about panda
um same OLED uh same spec OLED in the
last five years the Chinese got good at
making oleds which is great so the comet
3 used a Samsung OLED it was really hard
to get the supplier was for anyone who
had a screen problem with the comma 3
they weren't all I don't even think all
the panels were new some of the wrinkle
ribbon cables came wrinkly and we did a
lot of filtering on them and it cost us
a lot of money now we have a new
supplier of the panels we put in an
order for
a lot of them and when you put in orders
for lots of stuff you get quality
um so yeah only panels uh same OLED
looks great
uh on board road cameras versus flaky
ribbon cables if any of you guys saw
camera see or Sierra or camera
malfunction uh the cameras are on the
board now and actually the CR Sierras
weren't even caused by the ribbon cables
they were caused by bad assembly
procedures uh which we fixed and
if we have time I can go into more
details on that
uh stereo in case sound
you guys saw the Hubble sphere video and
the comma 3 came out playing those
sounds it was bad uh those mono speakers
it wasn't well coupled to the case now
we designed something with two speakers
that are like coupled to the case it
uses gaskets it's nice the sound is good
uh upgraded power architecture how many
of you had to wait for like super caps
to flakily drain on the three maybe like
kind of half drain it's because the
super caps were connected directly to
the power rail now we have a boost
regulator in between the super caps and
the power rail which lets us get more
capacity out of them and never has this
weird thing where you're putting seven
volts into the comma
uh yeah
and about half the components
it's a lot more reliable
let's take a look at the board
this is the front
the front looks pretty similar to the
three
a few things to know no more GPS
connector because it's using the GPS
that's built into the quick towel uh
those little antennas are actually
better than the big antennas on the
three you can see the pads for the
speakers you can see those connectors up
in the corner laser corner
this is not a laser plug
this is a laser pointer yeah yeah as you
can see these connectors up here they're
uh the Wi-Fi Wi-Fi antennas on the board
uh yeah these LTE antennas are smaller
and better those are where the super
caps go they weren't soldered in for
this picture same two microphones
uh uh and the GPS is using from the
quicktel we managed to get raw GPS out
of the quechtel the quality is the same
uh
uh I mean it's limited the antenna
uh yeah same psalm
where things really get good is on the
back I don't know if you've seen a
picture of the uh of the comma 3 back of
the circuit board
I will show one in the next slide uh
here you have the red panda integrated
in this tiny little chiplet
uh screen connects here power stuff all
underneath here to reduce noise GPS's
actually the GPS is better in this one
than the last one I think we got like 2
DB of noise lower
uh by shielding things and just doing a
better job with the with the power
architecture uh battery you guys don't
care about this but it slides in and out
so we don't have to hand solder it we
have to support can FD we have chokes on
all the can lines
uh you know like I paid three dollars
for this so I hope someone appreciates
it
um
uh these are the Wi-Fi antennas uh we
got a SIM card we tried with esim adiva
we'll uh talk to you about e-sims if you
want to know why maybe since
of
but oh I guess the main thing I really
missed here is that the cameras are
right on the board
so the cameras are just just on the
board and part of the reason we can do
this and almost no one does this cell
phones don't do this
um is because we have uh
we have a lens focusing line in-house
right we can we can put the cameras on
the boards and focus the lenses
and we don't have to do modules right
less ribbon cables less noise more
reliability right this is how you make
things really really good
I want the reliability I want the
failure rate of this device to be like
one or two percent
and by the end I think we're going to
get there
uh so this is the common three board
compared to the 3x all right
uh which one of these do you think is
gonna break
right
uh
uh yeah
this is actually from we I couldn't find
this picture this is a screenshot of the
last YouTube so it's extra bad quality
uh we got rid of the nvme it just uses
the onboard onboard flash now uh again
it's enough if you want more by Prime
uh we sort for you in the cloud or you
can set up your own Cloud Server if you
want to do that
uh QR codes on the board we like track
everything through this manufacturing
line
um it even looks reliable
is it a dev kit
I was on I don't sell my latent space
like the guys were like comma didn't
ship anything because of some like spat
with the government or something and I'm
like this is like what year is it
we've had plenty of interactions with
nishta since they were fine
if we report our accidents to Nashville
like it's it's fine it had nothing to do
with that the only reason we called it a
dev kit was to kind of set expectations
I mean I don't know I think it's
probably time we stopped using that word
so it's just the comma 3x
it's Mass Market
I'm gonna sell a lot of these
I think this is it I mean I think this
is the one right like it's not it's well
I guess you haven't gotten to really why
it's Mass market yet
that's on the next slide
all right so the comma 2 is 10.99.
with inflation
so what should we price it at
three dollars 350.
12.50
no additions just 12.50 you know
something I realized doing this this is
what my seventh of these now uh is that
you are
uh he always gets so caught up in your
head with all these like oh we're gonna
name it the panda the pigeon the giraffe
oh man there's additions why does the
storage matter does the one terabyte
drive better what does cross country
mean
you know what you guys hope you don't
read the questions document
there's a great document about questions
I hate questions I hate when people ask
no you guys can ask questions it's cool
you guys paid to be here you pay you can
ask questions
um no but like people ask questions and
you know how you get rid of questions
you're just like well what does the one
edition do said no one ever right you
give them three additions they'll think
they have like a choice right it's just
it's not even like worth it like it's
just like it's 12.50 you can buy it and
I called it three stories because this
is a line
in uh
houses three stories
you know how you know this one's good
because the last one was good
it's just the comma three but better
everything about it is better and it's
cheaper
uh so when can you get one
order right now uh ships in one to two
weeks one to eight weeks one to eight
weeks uh one to eight weeks eight uh
depending on when you order if you order
right now you get the one
if you order
on Tuesday you get the four
if you order on next Wednesday after
like way after the Tuesday you get the
eight so you know order now uh
we have a pool in the office and I want
to win so I bet a high number so you
know
uh no they're they're really good
um this is this is the the three acts in
a in an ev6 uh no more red panda no more
two harnesses just five little things
stick it on it
you know you just you just look look
we're not on the 13th generation yet but
if you handed an iPhone 13 to somebody
in like 2007 like when did the iPhones
get good
you know what generation around what
number iPhone did they start getting
like wow okay this is just actually what
four five four five by the way is not
the fourth or fifth you know they did
they did three three Gs four fours
I hope we're kind of there right I hope
we're kind of the point where like this
one's good
um
yeah
that's my presentation
[Applause]
[Applause]
I also want to you know
I didn't build this I didn't build the
software I didn't build these models I
didn't build the hardware the team did
[Applause]
apply for a job so apply for a job buy a
common 3x you know it's a calls to
action
uh no that I mean
you know what judge the team after
buying a device and driving without
that's fair if it's good I didn't do it
if it's bad I did it so
the comma 3x is live on comma dot AI
yeah
and now we're going to take some
questions
hello and thank you for presentation and
congratulations with 3x do you see any
value to run language models right on
device
uh why do you want to run a language
model
like interaction with
environment with driver
uh yeah sure
check it out it runs tiny grad it's
pretty good
I don't know our mission is to sell
stuff driving cars with living simple
intermediaries maybe solve robotics
while the living ship for intermediaries
if language models help us do that we'll
do it otherwise I don't see a reason to
but uh yeah no I think you can totally
get like llamas and stuff to run
probably not 7B but like Little Llamas
a great great presentation uh I'm not a
developer I'm actually a marketing guy
so technically I'm a professional liar
uh I mean would you disagree with that
characterization no no this is what we
do uh nothing personal obviously so I
got some uh just uh silly questions here
so have you done uh any testing or
planning to do any testing on commercial
vehicles like 18 wheelers and things
like that why
why we've done a lot of testing this is
the best tested comma device by far are
we how many people we get in eppot
whole bunch of people been driving
around with these
we've made like 82 of them this is the
best tested one by far
um the the amount of I mean we control
so much of the stack now too we're we're
you'll hear about this in our next talk
but like we built out a a manufacturing
line and we tested them well have I done
any testing in 18 wheelers I don't have
an 18-wheeler I don't have I don't know
I have a motorcycle license I don't have
a CDL
Tesla partnered with Pepsi
how who's making money off this who's
this delivering value to like I don't
get it is this like someone want it's
not self-driving what do you mean you've
got a driver in the seat this just
sounds expensive sorry just just one
more question so uh you know marketing
is branding and telling a good story
jobs sold good stories uh Elon sold good
stories until he bought Twitter uh
[Laughter]
so other than honesty what is the story
about open pilot that the common person
not developers need to know about or
want to be part of I I mean and this is
being about kind of the lying and like
where talking this is like what is open
pilot open pilot is a open source Adas
system what is the comma 3x it's
Hardware that's capable of running open
pilot so you ask the question what does
the user need to know just those two
things and you can buy them in our store
for 12.50 right if there's anything
that's like the narrative I mean it's
exactly what I said it's like you see
you want here I'll show you the
narrative I'll show you the narrative in
two words buy now
and you know what you know what if you
don't like it here's another part of the
narrative 30-day money-back guarantee
buy it try it
ships in one to eight weeks
hey hey George uh talk to us about how
the comma 3x will always be compatible
with the cars we drive and that the cars
we drive won't somehow disable the use
of the commas reacts
don't scan don't let Sam Altman scan
your eyeballs okay as long as you don't
do that I think you'll be good
I don't know what are they going to do
they're going to update the car this has
never happened like before maybe they're
gonna I don't think so oh I can't
promise you that I don't know man
probably not I've never seen it happen
you know what I mean
have to go there
uh hey there I was one of your hackathon
contestants
um look for my next hackathon project I
was curious
is it possible for a comma 3 to Port a
new model to a comma three
pretty easy I mean it's tiny grad now so
you don't have to deal with smpe you can
just the Onyx support is pretty complete
in tiny grad uh yeah you can run
whatever you want
is it possible sure it doesn't say dev
kit anymore but it's still a dev kit
that's not a dev kit don't worry buy it
if you're worried about that word I
don't know man uh yeah but no you can
totally run other models on it it's not
that hard I don't know like again like
are we gonna do it no but you can do it
I mean I think we ran something we've
got like a YOLO running for the body
demo or something
where's Antonio FPS we've got YOLO
running 20 FPS
we can put boxes around things right we
love boxes
okay you're talking a lot about uh Mass
market right so but
I only have a C2 so forgive me if this
doesn't work this way MC3 but like you
would get the device you turn it on you
still have to like download the software
right have you ever bought like a PS4
and had to sit there while it updates
for an hour it's faster than that well
so the question is is the PS4 Mass
Market
but basically this is like a tiny
liability air gap right how do you feel
like this liability like is going to be
serving you in the future
like that that is that anything about
liability it's custom software I
explained to you what it was it has
nothing to do with liability and
everything to do with the fact that our
models are already shaft right right and
if it's rohf that's a policy model
that's custom software the foundation
models will come on the device
right the foundation models tiny grad
agnos that comes on the device right
that's what the device is the software
the policy model that sits on top of it
that's custom software so in general
liability you're not concerned as far as
like future what do you mean live nhtsa
stuff like any of that I mean liability
I mean pay attention at all times it's
level two like the one comment I'd say
is like level three being shipped today
I'm not shipping level three right no I
know I know level two we're Shift level
two percent nonsense we will cover the
liability if our car I'm not covering
shit look look
if you want to not pay attention
do not buy our product you must pay
attention at all times this is not a
joke this is not tongue-in-cheek you
must pay attention at all times we put a
lot of effort into making sure you pay
attention at all times every accident
I've ever seen with the comma device no
one's died no one's gotten seriously
injured but I've seen a few accidents
and every single one of them would have
prevented been prevented if people were
paying attention pay attention this is
not a joke this is not tongue-in-cheek
pay attention or don't buy the device
[Applause]
that said if you want to pay attention
it's a great device
hi great presentation and now I always
saw a large Foundation model
vocal per wheel do you think in the
future or near future the only very
powerful Hardware can power self-driving
car something like that yeah um so it's
a question uh so the commentary and the
comet reacts have an expansion Port they
have a USBC expansion Port that can do
full USBC bandwidth so we are capable of
streaming out the full sensorium device
if it does turn out we do need to run
larger models which we haven't seen
better results with yet our
recommendation is going to be buy a
gaming laptop connect the gaming laptop
and put it under a seat
um no and I mean it like because it's
actually really hard to buy and video is
not going to sell you RTX
does 30 60s but you can go on Amazon and
for 8.99 you can buy an MSI plastic crap
gaming laptop stick it under seat it'll
run the model and actually I think we
can make the experience of this quite
good because if it loses connection to
the laptop it can fall back to the model
on device
um so with a lot of these things yes
more compute helps but model like
you can do all sorts of things with your
student teacher models to make it
smaller but are we going to need more
compute in the future of course we are
do we need more will more compute make
the comma device drive better right now
no
uh yeah also the other question is do
you have to can you can you do like
student teacher to put a small model on
the device that captures the policy
really well that's kind of where we're
going right now you'll hear more about
this in our next talk we're now training
a driving simulator
um and this is using a like an auto
encoder to compress the video and this
is a big model
um so we're training a big foundation
model but we may not necessarily need to
ship that to the vice because what we
need to ship the device is a policy
model but we have Pathways I don't know
the exact answer are we going to need
more compute than what's on a comma 3
yes are we going to need it in the next
two years unclear probably not
thanks we've got a question upstairs
hey hey Josh uh sounds nice presentation
uh a few nodes are first if you look at
those failure rates uh over time I think
there is like uh Spike if you look at it
then like summer times
so which suggests that you know they may
be fine
that isn't when the devices fail that's
when the device was built when it failed
right those failure rates are not that's
not the month the device failed that's
like when but anyways there is some
serious uh like um
time dependence that you might look at
but uh but my main question is not about
that actually it's a little bit to
reiterate and I really like uh the
effort you guys put into reliability of
3x and I think it it should be actually
built uh even more reliable than like uh
your normal car because like if you look
at like human brain it's built like
result like sorts of uh protections
around and that should be probably
should come up strive at like it should
like really build like a tank so even in
the event of collision it can record
stuff in like you know like the last one
the common device is not a safety device
it's not really it we don't no but but
just uh you don't use the word dash cam
right like our goal again we're a small
company and like I said a lot of what my
job is now is saying no to things right
this is one of the last things I still
do from the company like can we build
all these fancy features no we're not
Tesla enough
what we are trying to do is build the
best possible Highway and Highway plus
Driving Experience and you can go on
Reddit right now and see people
comparing autopilot to open pilot you go
back three years people would say they
were similar
now almost all of them are like look
it's cool with FSD and autopilot are
doing but day to day open pilot his
hands down better
um it was just a post on a kame i
subreddit where some guy's talking about
he has two bolts one with supercruise
and one without yeah night and day this
is by far the best Ada system you can
buy and that's what we're focused on
doing right we start focusing on other
things the adap system gets worse right
everyone's really easy to say yes to
things but it turns out it's saying no
that makes things really great
who has two bolts
some guy on Reddit I don't know man
I had an English teacher only had two
Nissan cubes
it's like that's my dad's I'm like the
car changed color he's like no that's my
dad's Nissan Cube and I'm like okay why
you'd buy one Nissan Cube you know
thanks to all the people who bought
comma 3x's already we're blowing up
George your high number make it hit yes
555 in the first week
this is the first comma device that I
would recommend to like my friends I'd
be like this one's actually what have I
told my friends to buy an eon and a
giraffe and a panda like all right you
know what I'm saying they were all good
but some were better than others this
one's good
thanks everyone
foreign
[Applause]
[Music]
foreign
[Music]
[Applause]
okay
don't worry it's a long talk
you guys know that Black Mirror episode
where they have the ratings it's my
favorite episode
uh you know that woman starts off at a
very high rating and watches her rating
plummet
and
at the end she has the one star and
she's in jail and she's just screaming
and she feels so liberated
this is what I feel the world's like
right now
you know like like the gpts have made it
so obvious that it's all bullshit all
the niceties and language and all of the
oh yes I'm going to write a four
paragraph email to express a
two-sentence idea
is it over is the professional
managerial class over
I heard the Barbie movie described last
night as post-woke and I thought that
was really cool
uh okay my talk is called three stories
and we have three stories one about the
past one about the future and one about
the present
uh so we will jump right into the first
story about the past with the crude is
automation
um
so Cruise automation most people don't
know this right most people see the
weird orange hat branding today and like
look we're building cars that are
symmetrical I don't even get it but uh
you know Kyle was actually uh first
building the cruise rp1 Highway
autopilot for ten thousand dollars
oh and it sat on top of your car like
that assuming your car was an Audi A4 uh
and it worked on the highway uh to drive
um so Lex was guest 14. uh Kyle was
guest 14 on Lex
and he gave up due to the technical
challenge
um he didn't give up because it was a
bad idea it's actually the right idea he
gave up because it was too hard and he
had three concrete complaints about why
it was too hard
one is that there's a long tail of cars
right so uh they built it for the Audi
A4 we're like okay we can make it work
on the Audi S4 maybe the A6 and you
realize that almost no one drives Audis
all right we started with an Acura look
I made the same mistake
um and it turns out there's this
absurdly long tail of cars
uh
so how do you deal with this
well you just do it that's not that much
work
comes a 20-person company and we just
did it thanks to you know contributors
thank you contributors but like it's
doable right you just do it okay cool
oh but but how do you handle failures
what if a car has a sensor that fails or
GPS that fails or a camera that fails or
steering wheel thing that fails steering
wheel actuator uh okay you just do it
um open pilot has a great error
detection and handling system the alerts
uh Alex Roy drove in a car with a comma
one and this is what he praised he's
like wow this thing actually like
communicates with you
um so hopefully you guys have
experienced that using open pilot like
it actually
you know gives you errors that tell you
what's going on
then we track all of these on a back-end
dashboard and we drive them down to zero
so again you just have to do it
it's different in one version of the car
what if the car manufacturer updates the
firmware okay
you do it
fingerprinting yeah
we'll read all the firmware versions
we'll figure out which ones matter we'll
figure out which ones don't we'll do
this at scale
right these things are engineering
challenges
fake any of them either
when you ship a product to people you
can't fake any of this stuff
right
that's probably mostly of open pilot
that's probably most of common threes
and it works in your car
and it handles failures
it deals with all the different versions
of the car you just have to do it
combo is not supposed to exist
there is no sane reason that this
company should exist
the second round when we raise from
address and Horowitz
I pitched him a crypto coin
hey look man you want to hear I'm
telling you what you want to hear man
I'll tell you what you want to hear I
know they're bullshit but you know you
want to hear it finals I'll tell you
that I know nothing about crypto to make
it sound convincing
um our third round we raised from much
more aligned investors
uh look and it's not that even that
Andreessen Horowitz is bad it's just
that like again you have to think about
what these people are optimizing for and
what time Horizon they're thinking on
usually very short time Horizons
um so
again you ask yourself what's what's
worth doing in the world
if you're not building a company that
looks like that line what are you doing
with your life right
if if the only thing that's going to be
different if you succeed with your
company this is to everyone in the
audience everyone out there watching if
the only thing that's going to be
different is that the pile of money is
in your entry in the SQL database
instead of somebody else's
why are you doing this bro it doesn't
matter just update the SQL database it's
a lot easier
um so yeah you know build companies that
look like that companies that are going
to change the future
not change the distribution of wealth in
the future
right
I'm not doing this to like we'll get to
that this is a story about the past
so here we are
six generations of the hardware
zero Eon Neo whatever you play with the
letters a bit comma two comma three I
love when Hardware companies just do
that just make the number bigger every
time so you know right it's easy
um
yeah
that's it
250 plus cars
uh every major brand except for the Flex
Pay ones Mercedes BMW no but otherwise
with Ford that's all of them
25 employees
uh uh an open source
all right so uh I think it's pretty easy
for this to tell that all three of those
numbers are going to go up begrudgingly
on the third one very happily on the
first two
um
and open source will stay
uh keep you want Hardware to be good
look at the iPhone right this is iPhone
13. you know why it's good because they
built like 13 other ones they built even
more right that's how you make something
good you just keep doing it you just
iterate it ship it you iterate on it
uh you want to support more cars okay
make sure you don't have regressions
well we'll get that I mean how how do we
how do we do this right
let's start with some like
that one
right did you hear helion energy is
going to ship a fusion power to the grid
by 2028 did you hear cruise is going to
have a billion dollars in Revenue by
2025.
like can I bet against these things it's
fake
I hope that everything you saw here
today
you've got like a real sense of honesty
and part of the reason you get honesty
here is because we don't have
communications people what are
Communications people in a company
besides paid Liars right what is the job
of what is the job of a press secretary
oh oh okay you you murdered 30 orphans
in Cuba uh I make it look good though
make it look good right
no like it's just honesty and it's
honestly because lying if you tell the
truth you don't have to remember
anything
you know that's that's a good quote
right
um
shipping
you out of ship shipping keeps you
honest
right you ship stuff you send it out to
people and they'll tell you about
whether it's crap or not you know how
they'll tell you you know there's two
types of ways to measure people's
preferences a stated preference and
reveal preference right stated
preferences things people say they want
like
well wouldn't it be nice if we had cars
where we could share the car so we could
uh save the environment and then you
look at the HOV lanes on highways and
the usage of uber pool and you're like
wait a second no no no no no no no
everyone wants their own car right
reveal preference beat stated preference
so how do we measure reveal preference
we sell something
profitably
and then see who buys it all right
so I'm shipping
iteration
uh you know how you build something good
you build it bad three other times all
right that one's still not that good you
know that one is bad after you get to
the one that's built three times later
and there's no way around this the only
thing you can control is your iteration
speed right how quickly can you iterate
how quickly can you come out with new
versions how can you reduce the Ripple
time but you have to iterate
um and then the last one is humility
oh yeah you know this guy used to call
me Eagle hot you know it's kind of funny
right I do have a big ego I think I'm
better than a lot of people I mean
that's a true fact right I think I'm
better than a lot of people now look
look you may disagree with me about that
fact and I'm open to having a
conversation about it I'm open to you
know what do you want to what do you
wanna what what shall we challenge each
other at right
but that's not what humility means right
that's like like acting humility is
saying
okay there's an actual problem how are
we going to solve it right like it's
humility not as some status game but
humility in the real face of nature how
do you solve these problems well you
have to have humility you know it turns
out you think you think oh well I'll
train the machine learning model it'll
work you know I thought this is a
comment I'm like well I'll put in the
I'll put in the output path and I'll put
the image in and it'll work this turns
out to not work at all
um you can look up behavioral cloning or
imitation learning for why it doesn't
work and you just got to have humility
you know what I mean like Nature Nature
Nature doesn't care nature doesn't care
you know and it's humility versus nature
not humility versus people uh so yeah
you know you got some you got some
values of a company right
um all right
so why haven't we won
do we have to write right
we'll talk about what I'm doing wrong
talk about what we're doing wrong but
why haven't we won
um and the truth is things take a long
time even accounting for things taking a
long time
this is not the first Comic-Con this
will not be the last Comic-Con
all right humans live a long time you
know this is something a lot of people
forget about in the world today like a
lot of people are so like man how can I
get rich quick how can I pull the scam
how can I ship fusion power to the grid
by 2020. bro you can't even ship fishing
power to the grid by 2028
you know
um so
I'm gonna look I'm 33. I'm gonna be here
for a while
all right so you start thinking about
that I'm not trying to get rich I'm not
trying to retire there is no exit
there's no exit
okay and you know that book start no egg
this is no exit this is it this is it
hell is other people right like
like there is no well we're gonna get to
this point and then we're gonna stop no
the system is going to get better and
the system is going to get relentlessly
better
right it's Comic-Con too
we'll see this is about the past
uh
think about like climbing out of a well
um so let's see what I'll put it yeah
how long is it going to take to solve
cell traffic
no idea
but as long as every day
you make forward progress as long as
every day you make a few steps climbing
to get out of the well and as long as at
night you don't slide backwards
As Long as You Follow That algorithm you
are eventually going to get out of the
well
avoid regressions and make slow and
continuous Improvement this is how you
make things good
so climbing out of a well there's not
another way to do it
no but you don't understand we're going
to get a huge cash infusion let's get
no
it's not going to get you out of the
well man what are you going to do you
got a number in a SQL database right
um it turns out these companies are
scams right
well it's Aurora too simple luminar they
all raise way more money than comma dead
which
uh oh none of these are Fusion these are
all self-driving cars in lidar but okay
so it's question right what does it mean
for something to be a scam
does something to be a scam require
Awareness on the part of the creator
that it's a scam
right if the answer to that is no if you
believe that intention matters
then what you're going to get is honest
idiots to raise billions of dollars
right they're being honest but they are
idiots right
this was obvious to me I've been saying
this exact same thing now for seven
years
I could have told you I did tell you but
I'll listen right
you know people also thought that
bitconnect and lunar warrants camps
right because people honestly out there
who should be both of those products
right and now I mean look both of their
Founders are in jail so you know we can
all like there's a spectrum of scams
right but um
yeah
uh you know we'll get to cruising waymo
later
marginal utility approaches marginal
costs this is a true theorem of
economics and what is the marginal cost
of open pilot
what's the marginal cost of autopilot
zero right
so homepod provides any utility at all
marginal utility approaches marginal
costs a lot of times you don't want to
measure success in value creation
because a lot of value creation is a
scam look at GDP
kind of want to measure success in value
destruction if you can destroy fake
moats of companies open pilot will
continue to get better open pilot will
solve self-driving cars and open pilot
will be free
oh
did you know Linux is the fastest
growing platform on azure
and such is a smart guy and Bryce right
and Bryce the car companies that are
smart will embrace the car companies
that are not smart will ship you the Sun
Cloud or the Oracle cloud or whatever
Cloud you know oracle still exists I
don't know how they make money but
whatever
um Linux is the fastest growing platform
in Azure markets do approach rationality
you just have to survive
Market can remain you know irrational
longer than you can remain solvent
uh yeah
yeah this is a lifetime Revenue comma
let's see a nice uh a nice R of like
that something
uh this is the amount these companies
have made in lifetime Revenue versus the
amount they've raised
uh
no like I don't get it I don't I don't
know man maybe I didn't go to Harvard or
get an MBA or something
but like bro well okay look man look man
we we raised we raised 3 700 million
dollars and we made 200. okay that's
cool man
like I don't get it I don't like I who
I'm saying like Okay obviously when you
first raise for a company this is true
but these aren't recent raises like
these companies have raised after they
were not even remotely close to making
back their initial investment in Revenue
not profit Revenue right you can look at
other companies like Amazon and Uber and
be like well I'm an Uber's hilariously
unprofitable but they make a lot of
Revenue they have a lot of users these
companies don't
uh so this is the number for comma
uh 22.2 on 18.1 million wrist
his Twitter followers for all right I
told you I'd address cruising waymo
right so I actually do honestly believe
that Cruz and waymo have larger
marketing budgets than the operating
budget of comma
right and uh oh soon man soon all right
look they use a linear model but like
this is what the website said so
uh
employee retention uh four people have
ever quit over seven years
uh
it turns out honesty is a great draw uh
same Mission folks governance a
commitment to iteration and Improvement
I'll come work here
uh
look
all this stuff everything about opioid I
didn't do any of it
I haven't I haven't pushed to commit to
open pilot in two years it's everyone
else you saw talk here today no saw me
um my sole job is to keep idiots far
away right that's really that's really
my only job right like it turns out yeah
foreign
the past is always depressing you know
but
uh no seriously um
to anyone watching this to anyone in the
audience if you want to come work here
look the bar is really high but what we
ship hopefully is really good and you'll
get to ship things right you'll get to
ship things you'll get to be a part of
this process that makes things better in
the world
and I think that's the real thing
especially as we approach this like
everyone late stage capitalism everyone
kind of understands the economies
whatever man fugazi right
uh I think the thing that people really
want is that they want to make the world
a better place like I said if your
startup looks like this
you know you're just changing the
distribution but if you start it looks
like this you're changing the world
I did not realize I was entering such a
dishonest game I have never seen a more
wretched Hive of scum and villainy that
I have in the business worlds
uh but you know we're gonna win anyway
just takes a lot more out of you than
you think it's kind
okay
future
I'm excited about the future Korea
uh so we'll start with a nice quote from
uh
Ellie Isaac goodkowski
and I'll plug in the numbers for the
current computing speeds the current
doubling time and estimate for the raw
processing power of the human brain and
the numbers matching 2021
interesting
not but that far off
I think we have a little bit of still
work to do on the software but like
everyone kind of sees it right
like this is a lot easier I've been I've
been talking about this stuff man when I
read when I read this quote when I was
15. it's changed my life my whole life
my entire life trajectory has pretty
much been because of you know this guy
in this document I'm sure incredibly
disavows it right now we got to Nuke the
data centers don't forget
but um no really uh
yeah
so what is the future I'm going to tell
a little story in my story is called
forward-looking statement
so much time
ladies and gentlemen welcome to
Comic-Con 9 it is the year
2037. I am an AI generated voice hiring
real people to do Pas became
way too expensive in the early 30s
we've grown quite a bit since the first
Comic-Con in 2021
we have 44 stores and malls around the
world
and a billion devices sold
in the top 10 biggest consumer
electronics companies and we did without
selling out
um so let's look at a picture of a mall
this is a real Mall you guys should all
check it out while you're here it's up
in La Jolla uh it's called the UTC mall
and I'm serious about the mall store
like like it's written on our boys
inside like come on isn't this where you
want to buy a commentary isn't this
where you want to buy a common body
you know like come by the mall store
no the metaverse is lame it's gonna be a
real Mall store go get a sin
bubble tea Happy Lemon
um so we're gonna we're gonna store in
the mall uh yeah
that's gonna happen is the Monster is
real
uh
it's hard to go anywhere without finding
a comma remember it's 20 37.
in its three form factors cars bodies
and puppies it is versatile enough
for everything
you'll find commas transporting goods
cleaning houses cooking meals and just
being a lovable companion that will go
anywhere with you
it's not rendered
uh yeah
now announcing become a seven
just two twenty that many dollars they
have to be twenty twenty three dollars
look I don't control the inflation
uh it's a third generation comma Asic
uh 50 pops of compute that's fifty
thousand Tera UPS
uh for reference the comma 3 has about
five
that's left by a factor of ten thousand
don't worry don't worry the future comes
fast slowly and then quickly
um it's first Common advice to boot into
tiny grad
well no really like look at home pilot
right like open pilot is kind of this
open pilot right now kind of means two
things right it's kind of both this
system layer and the self-drive layer
right the self-drive layer is a policy
model for driving on on roads the system
layers like a camera Daemon maybe will
even start to move things like the
vision model into the system layer right
but you have this system layer in open
pilot which runs Foundation models
right and then you have on top of that a
policy model which does driving and then
underneath that you have tiny grab you
have an operating system which can run
all these models and schedule them
appropriately
50 pops is a magical number combined
with the latest version of open pilot
our foundation models learned in the
cloud RL in the world and a good amount
of on device learning we expect a comma
7 to be able to do anything a human can
do
this does not stop at self-driving cars
okay
level four level five this doesn't like
this is boring
oh but but I heard the question before
not to call not to not to not to pick on
you like oh like like why don't you
focus in on like an application oh my
God
I'm trying to build people
we're trying to build people that's what
we're trying to build here right
self-driving is just a really cool it's
kind of a restrictive problem right you
can refine your techniques in
self-driving it's like a game but
eventually
this all becomes general purpose and
sooner than you might think right I was
trolling you know we did the Taco Bell
challenge Elon replied to one of my
things and I was like yo
our system is going to be so end to end
that even our DM is going to be end to
end
you guys saw it
uh yeah
anything a human can do is an
interesting thing too right this is my
300 this is what we build the uh comma
threes on
you understand that it's being operated
Now by a comma seven right
you understand that most of the
employees in the company now are commas
right
it's interesting right
I mean how many of our and you'll hear
about this in a later talk today how
many of our workers
how many people worth of compute does
comma have if you define a person it's
20 petaflops you'll get an answer to
that later today
right
how many how many silicon people work at
the company
I'm not here to discriminate man I'm
more Progressive
and I'm saying yeah no I mean it was
crazy when we first saw comma 7 actually
come over and like help build the other
comma sevens it was it was a wild
your comma 7 is yours just like your
comma 3 is yours
the models we train in the cloud are
Foundation models meaning they do not
have opinions they're not our lhft they
are true foundation models and I want to
give a thank you even though I lost 80
000 in your stock and really regret
selling it I want to give a thank you to
meta for releasing llama 2 as the
foundation model and not just the vrlhf
version we want to do the same
and
I will
whatever it takes there's no cause I
believe in more than open source AI
um so the models we train in the cloud
are Foundation models they do not have
opinions
we do offer some pre-trained policy
models we call them custom software
maybe some of you familiar with that all
right if you want a custom if you want a
pre-trained policy model that drives a
car again how it drives the car is is is
a decision right we make some decisions
about how to drive right but that's when
you get into opinions right foundation
models are unsupervised trained policy
models are trained supervised in some
way shape or form with some RL with some
supervised with whatever but by default
the uh
comma seven is like a child
it will learn whatever behaviors you
teach it so teach it well
and it should pick up skills as quickly
as a smart human
what's that
uh yeah I don't really know what's next
the comma 8 will likely be running the
company
let's look at it for a minute right
it's got two eyes
it's got a mouth
it breatheses air
it has two ears I pushed hard to keep
those two ears
it has a spinal cord
is it a spinal cord
I mean yeah all right look it's a comma
three it's got this looks like a little
bird brain right it looks like one of
them dumb dinosaurs you know
um but we'll get there we'll get there
robotics is all a question of
intelligence
all right
turned out how many of you guys have
robot vacuums they're pretty good now
right
how many of the meat quartz
right why do they eat chords because
they're not smart enough to really
understand and like the comma 3 is about
the same intelligence as a b and it's
not as smart as a mouse never mind a dog
or a human but we'll get there robotics
and that's like humans are so good at
like moving
but we're so dexterous with our hands
people forget like how good humans are
people forget how good humans are
driving they have all this self-driving
rhetoric all the cars are going to be
safer or nothing I haven't seen a car
that's anywhere near as safe
right now Ada systems can make it safer
because ads systems you pay attention at
all times I do believe that ADA systems
make it safer But A system that
completely takes control away from the
human
you forget how good humans are humans
are really good and humans are good
because they're intelligence they're
intelligent robotics is all questions
now back to the present
it's 2023 and you are Comic-Con too
thank you all for coming out
uh I hope I hope the things you saw
today were good
more store
all right come on I really I really went
off in the weeds of the future there but
the mall store is going to happen soon
right
the mall store is going to happen soon
all right all right I love it all right
uh in the present huh yeah
the present clip art
all right
um I'm gonna sit here for a minute
so we can all decompress a little about
the future because we're we're really
about to undergo a major tone shift in
the presentation
the next slide is a is a major tone
shift from this hypothetical future
where robots are replacing uh coexisting
with humans uh so major tone shift
coming and I'm just sitting down to
prepare all of you and now I'll go back
to the presentation
all right so we're going to start with
some contacts these are the failure
rates of iPhones
all right whenever we discuss failure
rates nobody is really going your Apple
is never going to put failure rates on
their website or in any of their
marketing presentations but I understand
this is very important to a lot of you
that buy the hardware it's very
important to me as well
um so to calibrate iPhone 6s were the
worst and had a failure rate of about 26
percent uh whereas you got down to like
iPhone X's iPhone 8 plus and they were
like three percent right so the range
for iPhone failures is three percent to
26 percent
those are the real numbers right
um I could do it for game consoles too
but I like this chart for iPhones uh so
this was the failure rate of the Comet
two
uh yeah uh these are just real numbers
you know like I said we don't hire any
marketing or Communications people so we
don't have any people to make up fake
statistics to lie to you I just actually
took these screenshots from our real
okay how good is the hardware building
uh the comment two failed a lot uh
you know look we honored the one year
warranty spent a lot of money uh
honoring that one year warranty
uh and one of the biggest priorities for
the comma 3 was this could not happen
again we are going to make these devices
good
we did a lot better with comfort
uh
so you see orders of magnitude we've
shipped about
seven thousand six thousand which is a
lot better with the failure rate on the
three and the the real story is even
better than what that shows
um so this is the comment three failure
rates by month
and you can see a jump discontinuity
right here
it has nothing to do with one year or
anything like that
it has to do and that's when we move to
our new office
we built a real production facility for
these things
people think that this is easy people
think building like high-end Hardware
like this is easy go buy an owl cam and
you'll see that it has a crappy little
screen and it's in this like overly
dense plastic it doesn't look like a
sexy piece of modern consumer
electronics and it's because it's hard
right for however good you might think
our software is or however bad you might
think our software is our Hardware is
pretty much the same
right same processes same ways of
thinking about things
um but we've put tons of effort into
making this a lot better
so you can see the failure rates of
modern comma threes are a lot closer to
five percent than they are to nine
and we are going to do even better
we uh dropped the price five hundred
dollars
uh in January
you can see we two extra sales which is
nice
we do need a bit of growth unless you
don't want too much growth right we're
not going to do we don't need to reach
the whole world this isn't for the whole
world but we do want to make a product
that is a bit more mass Market
it's quite a bit more mass Market
so where do we go from here
we'll find them
the comma 3 is great what do we do to
refine it
introduce them
to come to reacts
so it looks pretty much the same from
the front
uh
see the IR LEDs are a little different
this the case is so much better on the
3x like when we did the three it was the
first thing we injection molded and it
was bad
shiny black plastic you know you guys in
the garage trying to sand blast these
things in our old office oh come on like
I look better we gotta makeup
stunning this time
um and you see the down curves there the
road cameras are on the board we'll get
to some pictures of the board in a
minute
now check time what time or something
3x specs okay common 3x
it's the same 845 platform and Camera
Arrangement as a three
so what this means is your three will
not become obsolete
on the three and the 3x are in the same
cohort meaning like the software is very
close to interchangeable between them
more similar to how like the Eon and the
Eon gold were in the same cohort right
like everything about the E on E on gold
we're similar enough that we could keep
the software supported at the same time
so we're not the three and the 3x are
pretty much the same support window
um again no promises on this but uh yeah
uh we upgraded the cameras
three ox
omnivision sensors uh these sensors are
newer generation they have 20 more DB of
HDR they have a faster rolling shutter
uh they can operate at real 60 FPS if we
wanted them to uh
yeah some of the late model comma 3s
have this too so if you bought a comma
three in the last couple months you have
that
uh 128 gigabytes of storage versus 64
gigabytes uh so I put that star there
because we're going to start measuring
our gigabytes the same way phones do
some is taken up by the operating system
in the software but the real Flash on
the device is 128 gigabytes
so double the storage
can FD integrated
the one people were waiting for this is
the one people were asking about a
Discord uh so so it doesn't as great
about panda
um
same OLED uh same spec OLED uh in the
last five years the Chinese got good at
making oleds uh which is great so the
comma 3 used a Samsung OLED it was
really hard to get the supplier was for
anyone who had a screen problem with the
comma 3 they weren't all I don't even
think all the panels were new some of
the wrinkle ribbon cables came wrinkly
and we did a lot of filtering on them
and it cost us a lot of money now we
have a new supplier of the panels we put
it in order for a lot of them and when
you put in orders for lots of stuff you
get quality
um so yeah only panels uh same OLED
looks great
onboard road cameras versus flaky ribbon
cables if any of you guys saw camera C
or Sierra or camera malfunction uh the
cameras are on the board now and
actually the CR Sierras weren't even
caused by the ribbon cables they were
caused by bad assembly procedures uh
which we fixed and
if we have time I can go into more
details on that
uh stereo in case sound
I think I saw the Hubble sphere video in
the comet 3 came out playing those
sounds it was bad uh
uh those mono speakers it wasn't well
coupled to the case now we designed
something with two speakers that are
like coupled to the case it uses gaskets
it's nice
um the sound is good
uh upgraded power architecture how many
of you had to wait for like super caps
to flakily drain on the three and they
would like kind of half drain it's
because the super caps were connected
directly to the power rail now we have a
boost regulator in between the super
caps and the power rail which lets us
get more capacity out of them and never
has this weird thing we are putting
seven volts into the comma
uh yeah
and about half the components
it's a lot more reliable
let's take a look at the board
this is the front
the front looks pretty similar to the
three
a few things to know no more GPS
connector because it's using the GPS
that's built into the quick towel uh
those little antennas are actually
better than the big antennas on the
three
you can see the pads for the speakers
you can see those connectors up in the
corner laser corner
this is not a laser plug
this is a laser pointer yeah as you can
see these connectors up here they're uh
the Wi-Fi Wi-Fi antennas on the board uh
yeah these LTE antennas are smaller and
better those are where the super caps go
they weren't soldered in for this
picture same two microphones
uh
uh and the GPS is using from the
quicktel we managed to get raw GPS out
of the quicktel the quality is the same
uh
uh I mean it's limited the antenna
uh yeah same psalm
where things really get good is on the
back I don't know if you've seen a
picture of the uh of the comma 3 back of
the circuit board
I will show one in the next slide uh
here you have the red panda integrated
in this tiny little chiplet
uh screen connects here power stuff all
underneath here to reduce noise GPS's
actually the GPS is better in this one
than the last one I think we got like
2db of noise lower
uh by shielding things and just doing a
better job with the with the power
architecture
uh battery you guys don't care about
this but it slides in and out so we
don't have to hand solder it we have to
support can FD we have chokes on all the
can lines
uh you know like I paid three dollars
for this so I hope someone appreciates
it
um
uh these are the Wi-Fi antennas uh we
got a SIM card uh we tried with esim
adiva we'll uh talk to you about e Sims
if you want to know why
but oh I guess the main thing I really
missed here is that the cameras are
right on the board
so the cameras are just just on the
board and part of the reason we can do
this and almost no one does this cell
phones don't do this
um is because we have uh
we have a lens focusing line in-house
right we can we can put the cameras on
the board and focus the lenses
and we don't have to do modules right
less ribbon cables less noise more
reliability right this is how you make
things really really good
I want the reliability I want the
failure rate of this device to be like
one or two percent
and by the end I think we're going to
get there
uh so this is the common three board
compared to the 3x right
uh which one of these do you think is
gonna break
right
um
yeah
this is actually from we I couldn't find
this picture this is a screenshot of the
last YouTube so it's extra bad quality
uh we got rid of the nvme it just uses
the onboard onboard flash now uh again
it's enough if you want more by Prime
uh we sort for you in the cloud or you
can set up your own Cloud Server if you
want to do that whatever uh QR codes on
the board we like track everything
through this manufacturing line
um it even looks reliable
is it a dev kit
I was on you're gonna sell my latent
space like the guys were like comma
didn't ship anything because of some
like spat with the government or
something and I'm like but this is like
what year is it
we've had plenty of interactions with
Nish descents they were fine
if we report our accidents to Nashville
like it's it's fine it's had nothing to
do with that the only reason we called
it a dev kit was to kind of set
expectations
I mean I don't know I think it's
probably time we stopped using that word
so it's just the comma 3x
Mass Market
I'm gonna sell a lot of these
I think this is it I mean I think this
is the one right like it's not is well I
guess you haven't gotten to really why
it's Mass market yet that's on the next
slide
all right so the comma 2 is 1099.
with inflation
so what should we price it at
three dollars 350.
12.50
no additions just 12.50 you know
something I realized doing this this is
what my seventh of these now uh is that
you uh
he always gets so caught up in your head
with all these like oh we're gonna name
it the panda the pigeon the giraffe
oh man there's additions why does the
storage matter does the one terabyte
drive better what does cross-country
mean
you know what guys you're hoping you'll
read the questions document
uh there's a great document about
questions I hate questions I hate when
people ask no you guys can ask questions
it's cool you guys paid to be here you
pay you can ask questions
um no but like people ask questions and
you know how you get rid of questions
you just like well what does the one
edition do said no one ever right you
give them three editions they'll think
they have like a choice right and it's
just it's not even like worth it like
it's just like it's 12.50 you can buy it
and
I called it three stories because this
is a line
in uh
houses three stories
you know how you know this one's good
because the last one was good
it's just the comma three but better
everything about it is better and it's
cheaper
uh so when can you get one
order right now
uh ships in one to two weeks one to
eight weeks one to eight weeks uh one to
eight weeks eight uh depending on when
you order if you order right now you get
the one
if you order
on Tuesday you get the four
if you order on next Wednesday after
like way after the Tuesday you get the
eight so you know order now uh
we have a pool in the office and I want
to win so I bet a high number so you
know
uh no they're they're really good
um this is this is the the three acts in
a in a Navy sex uh no more red panda no
more two harnesses just buy the little
things stick it on it sometimes you know
you just you just look look we're not on
the 13th generation yet but if you
handed an iPhone 13 to somebody in like
2007 like when did the iPhones get good
you know what generation around what
number iPhone did they start getting
like wow okay this is just actually what
four five four five by the way is not
the fourth or fifth you know they did
they did three three Gs four fours
I I hope we're kind of there right I
hope we're kind of the point where like
this one's good
um
yeah
that's my presentation
[Applause]
um I also want to you know I didn't
build this I didn't build the software I
didn't build these models I didn't build
the hardware the team did
[Applause]
and you can be one of those teams apply
for a job so apply for job.com 3x you
know it's a call to action
uh no that I mean
you know what judge the team after
buying a device and driving without
that's fair if it's good I didn't do it
if it's bad I did it so
oh
the comma 3x is live on comma.ai
and now we're going to take some
questions
hello and thank you for presentation and
congratulations with 3x
do you see any value to run language
models right on device
uh why do you want to run a language
model
like interaction with
environment with driver
uh yeah sure
check it out it runs tiny grad it's
pretty good I don't know our mission is
to saw self-driving cars with living
simple intermediaries maybe solve
robotics while delivering ship to
intermediaries if language models help
us do that we'll do it otherwise I don't
see a reason to but uh yeah no I think
you can totally get like llamas and
stuff to run probably not 7B but like
little almost
uh great great presentation uh I'm not a
developer uh I'm actually a marketing
guy so technically I'm a professional
liar uh I mean would you disagree with
that characterization no no no this is
what we do uh nothing personal obviously
so I got some uh just uh silly questions
here so have you done uh any testing or
planning to do any testing on commercial
vehicles like 18 wheelers and things
like that and that's why
why we've done a lot of testing this is
the best tested comma device by far are
we how many people get an epoch
a whole bunch of people been driving
around with these
we've made like 82 of them this is the
best tested one by far
um the the amount of I mean we control
so much of the stack now too we're we're
you'll hear about this in our next talk
but like we built out a a manufacturing
line and we tested them well have I done
any testing in 18 wheelers I don't have
an 18-wheeler I don't have I don't know
I have a motorcycle license I don't have
a CDL
Tesla partnered with Pepsi
how who's making money off this who's
this delivering value to like I don't
get it is this like someone want it's
not self-driving what do you mean you've
got a driver in the seat this just
sounds expensive sorry just just one
more question so uh you know marketing
is branding and telling a good story uh
jobs sold good stories uh Elon sold good
stories until he bought Twitter
uh
[Laughter]
so other than honest here what is the
story about open pilot that the common
person not developers need to know about
or want to be part of I mean and this is
n't about kind of the lying and again
like where I'm attacking
what is open time
open pilot is
Source Adas system what is the comma 3x
it's Hardware that's capable of running
open pilot so you ask the question what
does the user need to know just those
two things and you can buy them in our
store for 12.50 right if there's
anything that's like the narrative I
mean it's exactly what I said it's like
you see you want you here I'll show you
the narrative I'll show you the
narrative in two words buy now
and you know what you know what if you
don't like it here's another part of the
narrative 30-day money-back guarantee
buy it try it
ships in one to eight weeks
hey hey George uh talk to us about how
the comma 3x will always be compatible
with the cars we drive and that the cars
we drive won't somehow disable the use
of the commas reacts
don't scan don't let Sam Altman scan
your eyeballs okay as long as you don't
do that I think you'll be good
I don't know what are they going to do
they're going to update the car this has
never happened like before maybe they're
gonna I don't think so oh I can't
promise you that I don't know man
probably not I've never seen it happen
you know what I mean
uh hey there I was one of your hackathon
contestants
um look for my next hackathon project I
was curious
is it possible for a comma 3 to Port a
new model to a comma three
easy I mean it's tiny grad now so you
don't have to deal with smpe you can
just the Onyx support is pretty complete
in tiny grad uh yeah you can run
whatever you want
is it possible sure it doesn't say dev
kit anymore but it's still a Dev catch
no it's not a dev kit don't worry buy it
if you're worried about that word I
don't know man uh yeah but no you can
totally run other models on it it's not
that hard I don't know like again like
are we gonna do it no but you can do it
I mean I think we ran some I think we've
got like a YOLO running for the body
demo or something
what's the 20 FPS we got YOLO running 20
FPS we can put boxes around things right
we love boxes
okay you're talking a lot about uh Mass
market right so uh but
I only have a C2 so forgive me if this
doesn't work this way MC3 but like you
would get the device you turn it on you
still have to like download the software
right have you ever bought like a PS4
and had to sit there while it updates
for an hour it's faster than that well
so the question is the PS4 Mass Market
but basically this is like a tiny
liability air gap right how did you feel
like this liability like is going to be
serving you in the future
like that that said anything about
liability it's custom software I
explained to you what it was it has
nothing to do with liability and
everything to do with the fact that our
models are rally chaffed right right and
if it's rlhf that's a policy model
that's custom software the foundation
models will come on the device right the
foundation model is Tiny grad agnos that
comes on the device right that's what
the device is the software the policy
model that sits on top of it that's
custom software so in general liability
you're not concerned as far as like
future what do you mean Lions nhtsa
stuff like any of that I mean liability
I mean pay attention at all times it's
level two like the one comment I'd say
is like level three being shipped today
I'm not shipping level three right no I
know level two we'll ship level two
percent
by the way we will cover the liability
if our car I'm not covering shit look
look
if you want to not pay attention
do not buy our product you must pay
attention at all times this is not a
joke this is not tongue-in-cheek you
must pay attention at all times we put a
lot of effort into making sure you pay
attention at all times every accident
I've ever seen with the comma device no
one's died no one's gotten seriously
injured but I've seen a few accidents
and every single one of them would have
prevent been prevented if people were
paying attention pay attention this is
not a joke this is not tongue-in-cheek
pay attention or don't buy the device
[Applause]
that said if you want to pay attention
it's a great device
hi great presentation and now as we saw
a large Foundation model
worker per wheel do you think in the
future or near future the only very
powerful Hardware can power self-driving
car something like that yeah um so it's
a question so the comma 3 and the comet
reacts have an expansion Port they have
a USBC expansion Port that can do full
USBC bandwidth so we are capable of
streaming out the full sensorium device
um if it does turn out we do need to run
larger models which we haven't seen
better results with yet our
recommendation is going to be buy a
gaming laptop connect the gaming laptop
and put it under a seat
um no and I mean it like because it's
actually really hard to buy and video is
not going to sell you RTX
does 30 60s but you can go on Amazon and
for 8.99 you can buy an MSI plastic crap
gaming laptop stick it under seat it'll
run the model and actually I think we
can make the experience of this quite
good because if it loses connection to
the laptop it can fall back to the model
on device
um so with a lot of these things yes
more compute helps but model like
you can do all sorts of things with your
student teacher models to make it
smaller but are we going to need more
compute in the future of course we are
do we need more will more compute make
the comma device drive better right now
no uh yeah also the other question is do
you have to can you can you do like
student teacher to put a small model on
the device that captures the policy
really well that's kind of where we're
going right now you'll hear more about
this in our next talk we're now training
a driving simulator
um and this is using a like an auto
encoder to compress the video and this
is a big model
um so we're training a big foundation
model but we may not necessarily need to
ship that to the vice because what we
need to ship the device is a policy
model but we have Pathways I don't know
the exact answer are we going to need
more compute than what's on a comma 3
yes are we going to need it in the next
two years unclear probably not
thanks we've got a question upstairs
hey hey uh sounds nice presentation uh a
few nodes are first if you look at those
failure rates over time I think there is
like uh
Spike if you look at it in like summer
times
so which suggests that you know they may
be oh yeah that isn't when the devices
fail that's when the device was built
when it failed right those failure rates
are not that's not the month the device
failed that's like when but anyways
there is some Curious uh like um
time dependence that you might look at
but uh but my main question is not about
that actually it's a little bit to
reiterate and I really like uh the
effort you guys put into reliability of
3x
and I think it it should be actually
built uh even more reliable than like uh
your normal car because like if you look
at like human brain it's built like with
all like sorts of uh protections around
and that should be probably should come
up strive at like it should like really
build like a tank so even in the event
of collision it can record stuff and
like you know like the last yes the
common device is not a safety device
it's not really we don't know but but
just don't use the word dash cam anymore
right like our goal again we're a small
company and like I said a lot of what my
job is now is saying no to things right
this is one of the last things I still
do from the company like can we build
all these fancy features no we're not
Tesla what we are trying to do is build
the best possible Highway and Highway
plus Driving Experience and you can go
on Reddit right now and see people
comparing autopilot to open pilot
you go back three years people would say
they were similar now almost all of them
are like look it's cool with FSD and
autopilot are doing but day to day
open pilot his hands down better
um it was just a post on the kame I
subreddit where some guy's talking about
he has two bolts one with supercruise
and one without yeah night day this is
by far the best Ada system you can buy
and that's what we're focused on doing
right we start focusing on other things
the adap system gets worse right
everyone it's really easy to say yes to
things but it turns out it's saying no
that makes things really great
who has two bolts some guy on Reddit I
don't know man
I had an English teacher only had two
Nissan cubes
it's like that's my dad's I'm like the
car changed color he's like no that's my
dad's Nissan Cube and I'm like okay why
you'd buy one Nissan Cube you know
thanks to all the people who bought
comma 3x's already we're blowing up
George your high number make it hit yes
555 in the first week
[Applause]
this is the first comma device that I
would recommend to like my friends I'd
be like this one's actually what have I
told my friends to buy an eon and a
giraffe and a panda like all right you
know what I'm saying they were all good
but some were better than others this
one's good
thanks everyone
[Applause]
18 lights.
>> We'll give you guys about a minute to
get in.
>> We're in beautiful, sunny San Diego.
>> Yes. Not sunny today, but usually it is.
>> Should we uh we can turn around and show
them the office from right here.
>> Yeah.
>> Zoom out a bit.
>> All right, we can start, I think.
>> Start.
>> Yep.
>> All right. So, uh, I'm Ade. I'm the
chief product officer here. Uh, I'm
responsible for getting you, uh, Comm
3X's shipped and, uh, looking real nice
and reliable.
Uh, hi, I'm Yen. I work in research and
I'm responsible for making the models
that drive the cars. All right, let's
flip it. Make hire and chill. Yeah, we
really want to make high and chill.
>> Yeah, of course.
>> The opposite.
So, we're going to do a quick
quick tour of the office, show you a
little bit what we're working on, of the
progress, some exciting stuff. So, we'll
start over in the common factory. So,
downstairs in the office is all the
common factory. We output 3's. Um, and
we have basically insourced almost
everything we can at this point.
got lots of security.
All right,
so
we start with boards. We start with bare
PCBs that look a lot like this. So these
are uh coming out real soon. We've insc
we're using in the Comet 3X's. This is
our very own design. Um we call it
Lightning Hard. It's a little play on
ThunderCom.
Uh, got the Jungle B2 board. So, this is
what a board looks like when we get it.
And then we run it through the line
here.
And it runs through the Jet printer
right here. We've got a top-of-the-line
My300 pick and place. Then we have an
oven and the top of the line 3D AOI. Um,
so we'll show you guys each of those.
So, this is a top-of-the-line Micronic
pick and place. Um, pretty soon we'll
get the one with both heads and we can
make boards really fast. But, uh,
the board goes right in here and then
these heads grab all the components
along these reels. Um, and they place
every component on the board. And then
they go right over here through the
oven. Um,
and then every board is inspected by our
3D AOI.
I'm going to zoom out a bit.
So, we get these really high resolution
pictures of the board
and we can inspect for any defects
before any board gets handed off to the
production team.
So, this is some really advanced testing
that we're doing on these boards. Um, we
want to ensure every device looks
exactly the same to you guys.
>> Pretty cool.
>> Thank you.
>> So, from Circuit Spoke, you get your uh
bear PCB populated and it looks like
this and it gets hand off to the
production team.
>> So, the production team will take it and
they'll head over to lens focusing.
um to install the road facing cabinets.
>> Also, I forgot to say, but you can ask
questions and I'll be reading some of
the questions and answer them if I think
they're interesting or if I think
they're funny.
>> So, we got a jig right here. You pop it
in. You put two lenses right there. We
have a this nice torque screwdriver. And
then you end up with a board that looks
exactly like this. If you pop off the
lenses, so you've got your narrow cam,
you've got your eCam.
Um, and we've got this nice hood. It's a
real professional setup. Um, we want to
make sure we're assembling all these
cameras with no dust. Um, and
everything's really precise. Um, so the
jig ensures that the distance between
these is very accurate. Um, they're not
a skew or anything.
>> So then once you have this, we head over
back to the main line.
And you can see the production team has
lots of boards prepped for you guys.
>> You got them stacked.
>> Yeah, look at all these boards.
This one's leaning a bit. All right. So,
then we go down the line. So, first you
get a song, a heat sink in right here.
It looks a little bit like this.
Um, so every station has these um
screwdriver, these screw feeders and an
automatic screwdriver. And then we go
down, we get a Dam installed. So this is
the driver cam. These are assembled as a
separate module. And it slots in right
here. You get it fixed right like that.
And [snorts] then we go down the line.
You get your super caps fixed to the
board. So those get four of those get
soldered on. And then you get your GPS
antenna.
So that gets slotted in the board just
like that. This nice injection molded
piece and go and just screw it just like
that. So after all those steps, you end
up with a board that looks a lot like
this. Um so you can see these uh board
tracking. We have some really advanced
tracking of metrics around these boards.
Um we really care a lot about the
failure rate and making sure we're
making really reliable electronics.
So you can see you got all three
cameras. This is basically everything
you need for a Comp 3X. Got your GPS,
heat sink, there's a SOM inside. Um, so
all it's missing is a screen and a back
case at this point.
All right.
So, look, Lo here is going to put on a
screen right now.
>> Nice. Let's see put on the screen.
>> Yeah.
>> And then we can see the back case. We
get to see the full process right here.
We are hiring for electronic. Yes, we
are hiring for E.
>> Yes, we're hiring people to design
things like this to run the factory. All
sorts of hardware skills and software
skills.
>> Nice. That was quick.
>> Yeah. Then a back case gets put on.
And you can see we have lots of backs
prepped. Um I know some of you guys were
talking about new hardware.
We haven't even built half the 3x we
plan to build. We want to build lots of
these things. We're going to be on the
A45 for a long time.
We put a lot of time into refactoring
and simplifying and making this super
manufacturable. Um, so this is a a
product we want to build and support for
a little while here. All right. So then
your device gets flashed with our custom
operating system and then we do um what
we call file provisioning. So this is
where we do some quick tests before they
head over to the stress test. And your
device will run here overnight. We try
to stress every component as much as we
can. We run them at full load. Um you
can see running the CPU and GPU really
hot. We check the compon the
temperatures of every single component.
Um we have super strict thresholds here.
>> So this device has been running for 15
hours.
>> No, that's how much time it has left.
>> Oh, cool.
>> You can see the GPS is really great.
We're getting accuracy to 1 meter.
>> Time's going down.
>> Cool.
>> Um so also sneak preview. These are some
of the first devices with our lightning
hard saw built in. Um, so we're really
stressing these guys and making sure
they're uh they're going to just be a
drop in replacement for you guys.
>> Nice.
>> So at peak capacity, we can fill up the
stress test rack supports 120 devices.
Um, so 120* 5, we can do that many
devices a week. Um, and we want to
increase this
is uh Oh, we don't have any devices for
they've already picked up today. All
right. Usually that bin is very full
nowadays.
All right, so packing up some devices
here.
>> Hi Adah.
>> Let's show them our professional
operation here.
>> We're almost done. We're almost done.
>> So your KA 3X comes in a box a lot like
this. Um we've got some really nice foam
packaging and there's a really nice
insert.
I really like the style.
>> This is a beautiful packaging.
>> Yeah, it's really nice packaging. We
spend quite a lot on the packaging
actually. Um it's this really nice box
that all folds up.
Packages every time 3X with a lot of
hair care.
>> Um so if you've ever gotten any kind of
product in really the last like four
years, it was probably packed up by Ada.
>> Yeah.
>> All right. So
>> is a beautiful place.
>> All right. Let's uh
>> we can quickly show them the uh the road
hooks room.
>> Yes. Let's go. This is one of my
favorite rooms.
>> So, we showed you guys initial um sorry,
final provisioning over there. This is
what we call initial provisioning. So,
this is where you take a board that came
out of Circuit Spoke and you've only
attached lenses so far. So, we can test
a whole bunch of the board really early
and we can focus um these lenses. So, if
there's anything wrong with the board,
we know very early in the process and we
don't need to build it up into a full
device. Um, and we catch things really,
really early this way. Um, so what we do
is we slot it right in here and then it
gets pointed right over at this TV and
the one in the mirror and we can focus
your road and uh, wide road camera like
this.
Yes, camera focusing very important.
Lens focusing.
And then shall we switch for the data
center?
>> Yeah.
>> All right. So the scene will show off
the data center here.
>> So we're going to peek into uh this uh
this very loud room.
>> There you go.
>> And our loudest room. So we're not going
to stay there long, but it's a very cool
room. This is where the magic happens.
Some tiny boxes here
and then many, many racks.
The data center is where we train.
It's where we train all our models and
we uh we we are currently training a lot
of models and uh we we'll talk about
that when we get upstairs.
>> All right, let's switch back.
>> It is the best room in the whole office.
Yes, tiny boxes. Go back.
>> Brand new room actually. It's our new
professional kitchen. This is our latest
bit of insourcing. Hi, Amanda.
>> This is where the lunch and dinner magic
happens.
>> This is the other magic.
>> You got a real professional kitchen, you
know, because of this flooring and these
uh beautiful commercial refrigerators.
>> All right,
let's uh let's check out the garage.
>> Yeah,
>> the kitchen is legit. Yeah, it is legit.
>> It is legit.
>> We got a black stone here. Got a black
stone,
you know, making healthy food.
It's our little courtyard.
All right.
Blackstone girl. Yeah. All right. So,
this is one of two garages that houses
the Kama fleet. You guys know we support
about 300 cars now. Um, and we have
basically one of every platform within
those cars. So, we can make sure every
car is having a really great time. Um,
and basically everybody who works here
commutes with our cars. So, we're always
test pilot all the time. Um, we actually
track our engagement stats and they look
very similar to yours. Um, so we're
really users of our own product. Um,
>> I'm do we can do questions when we get
upstairs to the open pile room?
>> Yes.
>> In the lounge.
>> Is there no based basement? Uh, no
basement.
>> Uh, yes. And also, not not everyone got
here already, so that we have more cars.
Video looks good. Thanks.
>> All right. So, I think we just do an
overview real quick. So, no, let's
actually, let's flip it and then we can
do a All right. So, right behind us is
that main production floor. And then if
we turn over here, we've got circuit
spoke. That's our circuit board factory.
And then the kitchen. And then the
common fleet is right over there. All
right, let's go upstairs.
This is cooler than Google IO.
There's a DJ upstairs.
>> Developers. Developers. Developers.
[laughter]
>> We could have done the overview up here.
Yeah,
>> probably.
>> It's actually pretty cool to show off.
So, right before we get into the uh
armor team rooms, we can see a whole
bunch of designs. Um, so we've got a
very early comma 3 design.
Um, this, I believe, is the red panda.
And we've got a whole bunch of refs like
the 3, 3x. Um, these are some of our
camera boards.
I think a cool project for a hardware
intern would be to take all our products
and make like a nice laser cut display.
Um, and have them all doing replays. I
think be a super cool project if
anybody's uh interested in that kind of
stuff.
All right.
So, we got a sneak preview of the uh
Tiny Blocks production facility.
>> Hi, Anthony's working real hard over
there. And then uh this is Igor's
office. He's not in right now, but he's
the head of hardware development over
here. Um, he's really in charge of
bringing you new products like the Comma
3X, the Tiny Box. Um,
and hopefully some cool stuff coming
soon.
>> And this is our other hardware room. Um,
you can see we've got scopes, we got
power supplies, we've got little reflow
ovens, we got 3D printers, we've got
everything you could ever want. Um, and
despite Greg sitting right here right
now, um, we have nobody who works in
this room full-time. That's, uh, it's
partially why we're doing the stream. We
got to find a hardware engineer who
wants to
wants to come in here, um, sit at that
desk right there and, uh, design
products like the Comet 3X.
We can show off this. Uh, this is pretty
cool.
Yes, this is a hacker space.
>> So, we'll bring up the uh the lightning
hardboards in our circuit board
manufacturing line. We want to make sure
the BGA soldering is uh basically
perfect. So, we do this test called Dian
Pry. It's a pretty standard technique.
Um and with this loop, we can basically
um iterate on our manufacturing
procedures and we can get almost perfect
soldering um on every one of these guys.
Um, so we've been making hardware for a
long time now. We're learning a lot of
the tricks. Um, there's really not that
many of them. And then pretty soon we'll
have hardware that fails, you know, way
less than 1% of the time.
Sub 1% failure rate. [snorts]
Alex wants to say hi.
>> This is Alex's office.
>> Yo.
>> Yo.
>> Right. All right. Then we have a little
kitchen up here.
>> Some caffeinated drinks.
>> We have caffeinated drinks. Every
variety of water.
We uh got to keep our fridges well
stocked.
>> Coffee.
>> Comic coffee.
>> You want to leak comic coffee?
Do you have a sneak peek on your uh on
your computer?
>> It's not a zoo animal. Um
Okay. Comic coffee is going to happen.
We're going to have a multi-week popup
shop this summer. We're going to do Kama
coffee and cars,
uh, some talks. Since we're not hosting
a Comic-Con event this year, we'd still
like to create some great events for
people to learn more about us and come
actually on site. So,
>> we'll have a legit lawmaroko. We're
going to We're going to sell coffee
profitably.
>> Robot arms.
>> No. Should we?
>> We don't. I don't think I think Mitchell
has them.
>> Yeah, Mitchell has them. We want to make
>> see what we can do to automate the
coffee. Um,
>> come coffee.
>> Yes, the robots are going to make
coffee. But
>> you heard it here first.
>> You heard it here first.
>> The coffee test.
>> It's not It's not going to be a curig.
It's not going to be an espresso. It's
going to be a real a real coffee.
Real espresso.
>> All right. So, we're going to head over
to research now. Research. You're doing
your own research because of this lovely
periwinkle color.
>> What is this? Look at this. Billy. Hi,
Billy.
>> You also gave me some GPUs.
>> Billy's giving me some GPUs. Some 2080s.
>> Oh, it's a 2080. [laughter]
>> Hi, Billy. Thanks.
Uh, let's go.
>> Is he running the roaming software or is
he manually driven?
>> I don't know. Is Billy manual driven?
>> I think he's manually driven, but we
have we have some autonomous ones.
>> Okay, we'll show off an autonomous one.
>> Yeah, let's uh
let's talk to Harold. Hi Harold.
>> Do you like GPU delivery?
>> GPU Billy.
>> GPU Billy. This is uh where some utter
magic happens. I'll
>> switch.
>> Yeah.
>> Uh yeah. Should we talk about uh if you
turn around the board there, we have our
goal set out.
>> So we want to get MLS in uh in master by
October. MLM means our new training
infrastructure where all the models are
trained on policy in the imagination of
a transformer model GPT LM style. Um
we've made some good progress on that.
We've got some proof of concepts and we
think by by October it'll be better than
anything we've ever done before. So
that's that's kind of our plan. If we
follow your scene, he'll show us some uh
some demo videos. I don't know how it
will translate, but should look pretty
cool. Scene's been doing some real magic
with
with the attention mans.
>> Are we going to have a tiny sim
comparison? I don't think people know
how tiny sim works.
>> Um, we talked about it in the conference
in the comic.
>> We can probably tweet some some some
comparison better depth of view over
there than
than on the screen.
But basically, Tiny Sim is just a
simulator where we take real video, we
estimate the depth of everything
relatively badly and then repro so that
we can move around. That comes with all
sorts of issues. Um, oh, some some
demoare issues. Some demo.
>> Third times a charm for passwords.
[laughter]
>> Oh, yeah.
>> It's a long password.
>> All right. So, you guys know it's a high
quality simulator.
>> So, this is our ML simulator. It's a
it's a pretty short roll out but all the
videos that you see here are uh are
generated by by GPT by transformer uh as
well as the recovery path that we're
training on. Uh so as you can see this
is just a list of rollouts. So the top
top video is the fcam. The bottom video
is the is the ecam. Um and as you can
see we made some good progress on how
fast we can run these models. So they're
pretty fast now. This is just running on
your GPU.
>> Yeah, this is running locally. There's
no uh we don't have like uh
>> it's not relying on the data center we
showed you guys downstairs.
>> Downstairs training is is relying on
that. But the the inference is done on
on this on this uh on my desktop. Uh so
as you can see it's faster than than
real time now. It's more than five it's
10 fps right now 10 fps. We made some uh
some changes to the architecture to be
able to speed it up. Um and um yeah some
great progress. We we have a proof of
concept of driving on these.
>> Oh, he's got to fix his cable.
>> Yeah, lot lots of people have cables in
front of the ecams,
>> but MLSim does just fine with that,
right?
>> Yes, that's fine. Uh, yeah. So, these
are these are some rollouts.
>> Whoa. It's not It's not even a 4090,
right? You have what? A 380?
>> No, I have a 409.
>> Oh, okay. Fine, fine. It's a 4090.
>> Yeah. So, is it you can see
>> our current models aren't trained on sim
yet, right? Not this sim.
>> Um, but they are trained in simulation.
So we have a more classical simulator
that we call tiny sim which is based on
repro reproing the image based on depth
information and that simulator is not
perfect but this is uh a lot more
advanced and will enable us to scale the
models uh a lot larger than what we have
currently. Uh and yeah as you can see
transformers are really good at
simulating the world and simulating
driving. Um, so yeah, just want to add
to that the visual quality of the
simulator isn't like as good as what
you've seen in, you know, some of the
demos online like Sora and Google stuff,
but we're really optimizing for a very
different thing. To make a good driving
simulator, you need something that
accurately represents all the things
that can happen on the road with the
correct probabilities and with the
correct physics, which is, you know, a
very different goal than than visual
stunning quality. So we're really
optimizing for that kind of physical
accuracy first so that we can translate
to driving behavior and then at some
point the quality will get better too
once that's the limiting factor. But
right now it's really a focus on making
sure that the physics is simulated
correctly since that's the priority.
>> Yes. And then the quality of the image
is just a dial that we can increase or
decrease as as much as as uh we possibly
can. we if obviously if we increase the
resolution very very a lot larger then I
won't be able to run this on my desktop
and I won't be able to debug so uh at
this phase of of development it's good
to keep it small keep it manageable and
then when we can scale up we'll scale up
>> so they're asking what improvements do
you expect when switching to the new MLS
>> uh so we're expecting both lateral uh
improvements and especially longitudinal
improvements uh MLS will have
substantially larger uh range in
longitudinal uh longitudinal
differences. So you'll see uh for
example experimental mode driving fast
on the highway or driving the speed you
want on the highway and if you slow down
on the highway it will recover to a
higher speed uh and basically yeah
stronger recovery pressure especially
longitudinally because the longitudinal
requires greater distances in
simulation. So that's what we what we
expect.
>> Is the environment synthetic 3D?
>> Is the environment synthes?
[laughter]
It's just it's just weights.
It's a floating points.
>> Oh, I think they're asking like what
space is it uh simulating in?
>> Yes. So we basically the image is uh is
a you know set of pixels and then we
command the transformer with six degrees
of freedom of of movement basically from
frame to frame uh so it is 3D u and then
uh the simulator gives us back an image
and then we do that uh iteratively uh to
get a video command command with six
degrees of freedom. So, but I think
they're asking like what I'm going to
get open pilot 09 12 with the first MLS
model. What am I going to see?
>> Experimental mode invested.
>> This is
>> Oh, that's ambitious.
>> So, the biggest bottleneck right now
with experimental mode is that the speed
control on the highway isn't that good.
So, right now people prefer normal ACC
over experimental mode on the highway.
And that's really the first thing that
we want to uh fix with these new style
models. We haven't put any effort into
fixing that because we think this is the
real solution. Um, so that's really the
first place we hope to see like tangible
benefits for the user.
>> Yeah. But first release will likely just
be uh it should match the performance,
right?
>> Yeah. We'll try to target that. Yeah.
>> Yeah. I mean that's the minimum bar.
We're not going to ship
>> accidentally do much better.
>> Yes. Yes. This is true.
>> If we train a model that is exactly the
same um training MLS, we're definitely
shipping that and then it might happen
to be better.
>> The the bar is to not be worse in any
way. So in reality, it will probably be
the same in the worst way and better at
everything else.
>> Yes.
>> All right. Any more questions about MLS?
>> So you don't take into consideration
users pressing on the gas when they're
in experimental mode. So overrides.
>> It is an override. Yeah, we count that
as an override.
It's it is an override. Yes. Same as
steering and same as
>> cool. Let's move to the body.
>> Cool. This is a body. This is a comma
body. Armo, the new intern. Armo. Uh,
you want to introduce yourself?
>> Yep. I'm the new machine learning
intern. And so I've been working on this
body, trying to get it to navigate the
office, uh, avoid some obstacles and,
uh, basically navigate. We are using
similar techniques to the MLM stuff.
We're using a transformer to model the
dynamics of the body and like the trying
to model the the office as well. Um,
>> let's check out the report. Yep. So
we've got some
>> these are all simulated.
>> So some of them are simulated the the
right ones.
>> So we start with like some real frames
from the data set and then get the bon
to imagine the next frames and the next
actions. And so we can verify that it's
doing what we expect it to do. So in
this case for example we expect it
expect it to go back press the S key
which is it is doing. We can look at
some more examples.
Um, for example, this one, it should
avoid going
uh going left.
This one should avoid going forward.
Um, so yeah, test to to to check that
the model is doing what we expect it to
do. So Armon joined the hackathon that
we did uh last time at the office and uh
his team placed first. Uh so they
completed a loop around the office
>> um using the using the common body.
>> Yep.
>> Uh and then he came back to finish
finish his work.
>> Yeah. Finished it work.
>> So you've only been here what 3 4 weeks?
So our
>> Yeah. So our uh our training stack is
just uh we put a lot of effort into
refactoring and cleaning up and
simplifying. So you're able to generate
all these reports and train our stack um
and make progress really quickly.
>> So that's really nice.
>> I think now the body is going to start
moving. I think so it should stop
moving.
>> So we're using uh we're using the new
library called body gym which is like a
gym wrapper around
how we control the body. So hopefully it
should open to you and then go back.
>> All right, it worked. So it's driving
autonomously now.
>> Yes, it's autonomous.
It's getting too close.
>> It does back up very reliably though.
>> Yeah.
>> Yeah.
>> So, is it going to hit Casper now?
>> Let's see.
>> So, this is completely end to end.
There's no object detection or anything.
Uh, it's just training to uh to do what
what what a data set that we collected
did.
So, yeah, it's just going to do its own
thing. Um, it's a little
it's a little stupid now, but it should
do some uh some cool thing. It looks
alive.
>> It definitely looks alive.
>> Yeah.
>> So, we're going to ship this app. Can
people drive around?
>> Yes.
>> All right.
>> We're going to open source this model uh
as an example in B gym.
>> Can we open source the SIM?
>> Uh, it's the SIM.
>> Okay, cool.
>> It's the SIM. The SIM and the policy are
the same.
>> Very cool.
>> Yep. So, the goal of this project was to
basically roam around the office, uh,
and then recover if it's blocked, uh, do
some loops, not bump into things, or if
it bumps, it should it should back up
and recover. And I think we're pretty
close to this to this goal. Um,
yeah.
Oh,
>> is it going to recover?
>> Maybe.
>> Come on. Oh, yeah. Billy.
>> Good job, Billy. Oh.
>> Oh, he's got it. He's got it.
>> Let's go, Billy.
>> Go, Billy. Yes.
>> All right.
>> All right. Let's head over to Open
Pilot. Jordan, you got anything to say?
What's up,
All right. Is the AGI
All right. So, this is our all hands
room. You see, you want to point out our
uh three goals for the company for 2024.
>> So, we have three goals uh AB on uh on
one car by default.
>> So, we're at we started the year with
zero. We have zero right now.
>> So, not a lot of progress, but working
on it. Uh research has a goal of 50%
engage time for at least one week. 50%
engage time. We are about 33% right now.
And we didn't in we didn't improve.
We're still at 33. So still got some
work to do, but uh we're confident in
MLSIM and longitudinal improvements to
increase this percentage. And then we
also want to build and sell 10,000
units. Uh we are 18 we start the year at
0% obviously and we're 18% of this goal.
Uh the units include 3 axis and also
tiny boxes. This was our uh our sale um
that we did recently.
So despite the sale um actually if if
you remove the sale entirely um we still
have quite a bit of growth. Um but we
sold out of our stock common 3X's
actually quite quickly. Um so downstairs
is really working hard to bring our
stock back up and then uh we want to
sell out of those again. Hit our 10,000.
This hasn't been updated actually in
maybe two weeks. 20. We should be about
20% right now.
>> 20%. Cool. This is our beautiful traffic
light. CI is passing.
>> All right.
>> Our uh tiny neighbors. Hi. She's the
tiny corp.
[snorts]
>> All right. And this is the
infrastructure office.
>> Hi Mitchell.
>> Y research has one more very low
priority goal which is to make the arms
make coffee. Oh yes.
>> Be very happy if we can make the arms
make coffee. Right now the arms can pick
up a chest piece. So we've made progress
very slowly.
>> Yes. Make the body drive around. Make
the arm make coffee.
>> All right. So now this is the open pilot
lounge.
We've got our open pilot dashboards
here. Let's show them the growth. All
right. So we launched a common 3X um not
even a year ago and you guys can see
hockey stick.
>> Yeah. So, um we're getting about 400,000
minutes of driving every day. That's
about 50,000 every week. Um this is an
insane percent of the um total 3s and 3X
sold are driving every single day. Um
which is super cool. You can see um
we've got our new devices coming online
uh measured by built shipped um and then
how many people are making new comma
accounts. You can see a little bit even.
So, this is the sail right here. Even
without the sail, there's still a nice
uptick. And then we want to make built
look more consistent. Um, we put a lot
of effort in getting Lightning Hard out
the door. Um,
so now that that's almost ready, we
should be building very consistently and
then we want to ship very consistently.
Um, we've got a couple other things. You
can see almost all the cars are growing.
Um, Ford is uh really obvious here.
>> Oh, Ford.
>> Yeah. We're thinking of getting an F-150
soon.
>> I think that's going to be our next car.
>> If you guys have any thoughts on next
car, love to hear it. Um, but even
Toyota's growing a bit um over the last
year. This is in log scale, by the way.
>> Log scale.
>> Yeah. And then we got forks. I know the
fork people love this. Open pilot
release isn't shown here, but this is uh
we consider we put master as a fork in
here. Um, so you can see sunny people,
the people love sunny pilot. Um, frog
pilot's growing a bit. And then uh yeah,
people are preferring Sunny and Frog
over Master, but Master still has the
next size chunk. And then uh this is our
this is like a rough mean failure. It's
very raw. Um you can see this big dip
here is the SDSU bug. Um this is why you
know we have to make hard decisions
about uh niche hardware.
Um yeah, and then uh this is uh the car
team dashboard. Their biggest focus this
year so far has been fingerprinting. We
want to just make it not a thing. Um, we
call it fingerprinting 3.0. Um, where we
still fingerprint your car, but you
don't need to know that that's
happening. Um, and you can see we make
really great progress. So, all these
Toyotas have come online and you see
these little blips, those are ones that
didn't fingerprint. Um, and for the most
part, these are like the RAV 4 Primes.
These are the Toyotas with security. So,
they don't work on Open Pilot anyway.
Um, and we use your car's VIN to know
what car you have. um so we can know
whether it's a false positive um or
something we don't support anyway. So
Shane's been working really hard on that
and then after fingerprinting um we have
an exciting project where we want to
pull out the car support from open pilot
into its own project and then you can
connect that up to any of your projects.
You can imagine like autoware or some
other raw based self-driving thing and
then you just use our package to uh
deploy to your car.
>> Pretty cool. We got some uh production
metrics.
So, this is how many 3Xs we've built
total. Um this is how many we have ready
to ship at this moment. We want to get
this back up to 1,000 and then we can do
another uh big push on sales. Um
yeah, we got to So, you can see um as
we're getting lightning hard up, our
build rate hasn't uh has fallen a bit
and hasn't been as consistent. Um but
the team has really been prepping
everything. So, once we get lightning
hards rolling off the lines, then uh
we'll get this number up really, really
quick within a few weeks.
>> Yes.
>> We got the open pilot kitchen. So, we
got another fridge that's very well
stocked. And then we'll head into the
open pilot office.
>> Some more caffeine.
>> All right. So, you guys remember the
research office was very full. Um the
open pilot office is not as full. So,
Shane sits right over there in the
corner.
>> Yes.
>> And then we've got does sponsor H1B's
cards. Yes, we do.
>> All right. And then, uh, we have these
two desks empty right here. Um, we're
hiring people to work on web on systems,
um, to basically do the work that you
see us committing to open pilot every
day. That's a preview of the common
keyboard. Um, work in progress.
>> You can use this keyboard.
>> Um, and then, uh, my desk right over
here, we've got a fancy Wi-Fi tester.
Um, it's like the official Qualcomm one
where uh we're doing some very deep
integrations with the A45. Um, we're
going to be on A45 for a very long time.
You can see some of our intermediate
goals.
So, for 097, our big goal was no OBD
port. Um, so Shane's got it such that
we're not using the OBD port for
fingerprinting anymore. And then no
fingerprinting is exactly what we talked
about, fingerprinting 3.0. Um, we still
got to ship the new updater that you can
run while onroad. And then, uh, yeah,
we've got some, uh, this overarching
goal of, you know, the green check mark
that you see next to your commit, that
should mean you're ready to go to
release. That is not quite the case yet,
but that's one of the things we're
working towards. Um, but we have this
really fancy testing infrastructure. Um,
and we can feel very confident
everything. It runs all the time.
Wow.
>> So, the
>> the web team had a big victory the last
month. This is the first profitable
month in Comma Prime's history. So, we
made exactly $5 when you account for all
our Mapbox fees, our cell fees, um our
Azure storage costs, Azure server costs,
um and like the data dog monitoring and
everything. So, we made $5. Uh it's
about break even right now. And then we
can put some more effort and make it
quite profitable actually.
So it's a big victory for the web team.
>> $5 we can do on the web team.
>> So you can work here. This is a
very
>> throw the test closet.
>> Yes. Test and close it.
>> Right. So these guys are running open
pilot all the time. Um they run both CI
on every commit and then they also just
run open pilot continuously. Um and they
really try to stress every little edge
case. Um,
yeah. This is uh what we call hardware
the loop testing.
We're winning.
>> Where do you want to go next? Do you
want to go see
>> the uh Let's show them the the gym real
quick.
>> The gym.
>> The lunchroom.
>> Yes.
>> We can go back here and do questions. We
do questions in the lunchroom.
>> Yeah.
We're walking over
our nice gym.
>> All right. Check out the common gym.
We've got workout classes here. It's
open all the time.
We got some great equipment.
Some uh pretty nice gym here. Uh
yeah, watch some TV while you work out.
You have one hit class per week and then
uh it's free to use and open open every
day, every hour for people who want to
work out.
This is our yoga studio.
We did yoga this morning about an hour
ago.
>> Yes, it's a great yoga session. We've
got a great yoga instructor.
>> Yoga once a week as well if you're into
yoga. It's
>> got a great view of the office, too.
Yes, yoga.
>> Many of us weren't into it, but uh the
class is very convenient.
>> That's very nice. It's very zen. Get you
ready for the day.
>> Got a beautiful yoga line. Uh and we've
even got one of these guys. That's how
you know we're a legit gym studio.
[laughter]
>> And then over here is housing for uh
interns and employees. Um so if you want
to live at the office, it's an option.
and our ping pong table.
>> We got the uh the best room in the
office. The lunch
>> lunch and dinner room.
This is where we have lunch and dinner.
No, no lunch yet. You want to go?
>> So, we only have one meeting a week. We
have an all hands on Mondays. So, lunch
and dinner are kind of integral part of
uh the experience here. This is where we
make a lot of decisions and we do a lot
of planning. Um,
>> we just discussed a message.
>> Hi, Eigor.
>> Oh, I got a lightning heart from Igor.
Got a little delivery.
>> Eager asked me to check it. I hope that
means it's good. All right. Uh, we can
sit here and take questions.
>> Let's do it.
>> All right.
Mhm.
>> All right. Let's take some of your
questions. I don't know like sit
together and reverse it.
>> Top tier hiring campaign. Thank you.
Thank you.
>> How are repairs handled that come in?
So, I don't know if you guys saw it, but
uh I've got a desk downstairs. We open
up every single one. We root cause every
single one, and this is how we have a
super low failure rate. Um it turns out
it's that easy. If you care enough to
open every single one and look at it, um
you can get super low failure rates.
>> What's our failure rate right now on
3xs?
>> Uh it's about 2 or 3%. Um, but the cool
thing about that is it's uh largely
screens arriving DOA um due to uh
packaging issues. So that's a very un
like that's a very easy to fix issue.
Where's the body? The body got stuck in
research. Uh I think he likes he likes
that room. Um but we can uh he can also
>> over here.
>> Yeah.
Any more questions hiring related?
So to recap what we're looking for um
we're looking for software engineers for
the most part um to work on machine
learning web so that means the comma
connect app um comma prime making us a
really beautiful web and mobile
experience for open pilot um so we have
the hardware to make the best dash cam
possible and most of the software is
there it's mostly building a nice um
front end around showing you your
drives. What cars do you personally
drive? So, we drive exactly the ones we
showed you in the garage. Um, we've got
like basically one or two from every
brand. Um, we didn't like cherry pick
the best open pilot cars. We just have
one of everything.
>> So, we have some more questions.
>> Tesla Model 3 Y support. Yeah. So, we'll
get that merged. Um, the problem with
the Teslas is you can't override the
steering and it's it's just a departure
from the experience that we ship on all
the cars. So, we may revisit that at
some point, but we'll definitely get it
merged to master as a dash cam mode car.
I hear the Cybertruck is very similar to
the 3 and Y. So Cybertruck support
coming soon hopefully.
>> Do we hire international students?
>> Yeah. So we uh we try really hard to get
people here on visas. Um there are some
country specific exceptions I believe
like we can't hire people from North
Korea but other than that we we try
really hard to get people visas.
>> What do you plan to do with the body? We
plan to let it hang out and roam around
the office autonomously without any
intervention. What we really want is to
build a stack that solves robotics that
can be translated easily to uh so start
with driving and then the same stack
with very minimal changes should also
work on on robotics and general purpose
robotics. Uh which is why we're doing
end to end. So this is our our our goal
with the body and with with robotics in
general. But as a as a first goal, what
we want to do really is just be [snorts]
able to avoid objects and navigate
indoors.
I think there's still a couple more up
there.
>> Yeah. Yeah. Uh is connect still being
worked on? I haven't seen much updated
>> when I have time. Yes, we're we're
hiring. Um we want to fill out the open
pilot team. Um the hardware team. We'll
we've never rejected somebody who was
good because we just didn't have room.
So if we didn't mention something that
you think uh you can effectively do
here, um we're very likely happy to hire
you.
>> Yes, we need people to work on connect.
Um, and to reiterate what the bar is,
the bar is our best definition we've
come up with is can you do our
challenges and or contribute effectively
to our open source projects. If you can
do those um independently and you're
just a motivated person, this is the
biggest indicator for success. Everybody
who works here now either did well on
our challenges or has history um as a
contributor.
>> Yeah. How do you guys like our new um
new jobs page? New GitHub page.
>> Yeah. How do you guys like the new page?
>> Yeah, it does. No,
>> there's no more like stock pictures.
It's it's a GitHub repo. You guys can
make PRs if you think something should
be clarified. Um,
>> it's very clean. Is machine learning
different from search applied science?
No, machine learning is applied science.
Pretty much the same thing. Is there any
plan in place to support vehicles?
>> It's the same with all the other cars
that we don't support right now. It's we
don't spend any of our own time porting
the cars. What we do is we make it
really easy to port cars for the
community. We build tools and
infrastructure and tests. Um, so right
now you can port a car basically on your
desk. You throw in a 3x as long as you
have the right kind of harness. Um, you
get a a route and you can write
basically all the car port on your desk.
So I did the the Kia EV6 port. That was
a fairly substantial almost fresh port.
Um, everything I did for that car, the
lateral, the longitudinal, all the car
state um parsing, it all worked on the
first try, which was um super cool. It's
a big testament to how far our car stack
has come and we have so much more we can
simplify. Um, so Shane's working really
really hard on that. So the security
cards are the same thing. We're going to
make it really easy for other people to
do it and then uh you know if we have to
hire a big enough team I I would very
much interested in hiring somebody to
just come and make the Ford's really
great or the Toyota's really great we
can totally support that. But uh as as
it is right now with the resources we
have um we're focusing the highest
priority is just making the
infrastructure really great for the
community to port the cars.
>> You can ask any questions but yeah
hiring questions
>> hiring is the main focus but uh we love
questions.
>> Do you have do we have a mobile app?
>> So we don't have a native app. We have
the comma connect PWA. Um I could be
convinced to switch back to a native app
if you want to come here and work on a
native app. If somebody wants to come
and make a beautiful native app would
love to hire you. Um, do you have a So,
a lot of people who apply for this kind
of stuff, they don't have uh working
projects or their projects are uh very
laggy. We we just want somebody to make
a really nice app. So, if you have a
demonstrated history of this or you
contribute to connect um and make it
less laggy and less like make it just
work then uh very interested in hiring
you.
>> What skills do you look for in software
engineers?
>> What skills? Um, so again, can you do
our challenges and or can you contribute
to open pilot? This is literally it. Um,
get clone open pilot. Um, pick a bounty.
Um, or pick some other issue. It really
doesn't matter. Um, if you find some
other way to contribute that we didn't
describe, even better.
>> By the way, the hiring page is comma
aai/drops.
>> Yes. Are you nervous about dollar total
units sold or is that a future thing?
Not sure what that means.
>> No.
>> So, like the unit economics on our
devices works out really well now. Um
the common 3x is uh we're building them
profitably. Um so we can sustain like
we're very stable on the common 3x. Um
that was the big victory with it. It was
we we're delivering the same thing to
users at half the price. Um we're the
price where they're happy with it and it
makes sense for us to keep building
them.
>> Cool. If you have a PR that improved
connect, that's it's amazing.
>> All right, let's see the PR uh GitHub
when first click through it though. So
what was weird about it? Have you sent a
comma 3? You see the We don't need to.
The OEM's bought them all on their own.
>> They're buying it.
>> Basically, every OM has bought the comma
twos, comma 3, comma 3X's now.
>> So, no questions.
>> What's up?
>> Any questions for me?
>> Uh, any uh
>> Oh, not really.
>> Oh, any questions for George? Hi,
George.
Any dogs?
>> Any C++ back end or infrastructure
roles? Yes. come my such jobs.
>> I mean, we're hiring a system software
engineer.
>> I believe that there's really a
universal skill of computers
and we're looking for people who are
just good at computers, good at
Googling, good at figuring things out on
their own. Um, if you haven't read it,
uh, how to read, how to ask questions
the smart way, uh, is required reading
for all comma employees and people who
like the kind of ethos laid out in
there. Uh,
>> if you stumbled upon it before we
mentioned it, then you're probably a
good fit.
>> Yeah. PE people who who who
>> like if you know who ESR is and Yeah.
>> Yeah. people who like that sort of
culture
uh, will do well here. So again, it's
really less about like the exact role
and more about a
generic set of computers and googling
skills.
>> Yeah, if you're contributing to any of
our projects or you do a great
challenge, we probably haven't even
looked at your resume. That's is a
total non-factor. Anything good up
there?
>> Uh, do you have any personal experience
in China using self-driving cars and
robo taxis?
Did you try any rubber taxis in China?
>> No.
>> No. Okay. [laughter]
>> I heard Neop's kind of good.
>> Tiny box shipping.
>> Uh, end of June.
>> End of June. But very excited.
>> Let's keep this stream on topic. So, I
think somebody said something about
webdev skills.
>> Can you make something that connect but
like it just works every time? Like if
the videos don't load 1% of the time,
can you figure out why? And can you just
deliver that independently? This is all
we're looking for. And do you not want
to use 27 frameworks?
>> Yeah,
>> I really I'd really like a webdev person
with a systems mentality who just wants
to come in and like not use any of these
frameworks and just writes like a
thousand lines of clean JavaScript.
>> Have you seen HTMX? It's pretty cool.
>> No. What's that?
>> It's uh it's uh this guy's response to
React and it uh it's pretty cool.
>> I like some like spelt. I like the ones
that will pre-render stuff. I think that
React and the virtual DOM is uh a lot of
these frameworks are designed to work at
a very different scale of company.
I was just reading the Intel uh compiler
for their NPU and you know it's one
directory of it is larger than tiny
graph
>> just the yeah they have all these like
bootstrapping things like you can't just
open a new file save it and then run it.
You got to like bootstrap it. It's you
know
>> I don't think there's any reason for
this. I I think that the main reason
this happened is what what what's the
law that says the structure of the
company will be reflected in the
codebase and vice versa.
>> It's uh yeah I saw it yesterday. I
forgot the name.
>> When you have a company with 20,000
people you're going to have an insanely
bloated ridiculous code base. But if you
have a company with 20 people, well,
there's not room for, you know, every
line's got to pull its weight.
>> Yeah. You don't want to end up with an
encoder team and a decoder team and a
radio team.
>> I mean, this happened here for a long
time, right? There was the NPC team or
the model team. They blame each other
all the time.
>> Yeah.
>> Well, that was a a bad abstraction. You
definitely want there to be different
teams where there actually can be
non-leaky abstractions.
>> Yeah.
>> Yeah. Unfortunately,
corporations are not good at finding
efficient ways to communicate and then
the models and that their their systems
end up also not being efficient.
>> Conway's law. Yes. Yes. Thanks, Greg.
Conway's law.
>> Were there any good ones up there?
>> How many?
>> Conway's law. Yes.
>> Used by people.
>> Yeah. But so that's the thing, right? We
want to hire people who want to ship
this to thousands and thousands and
thousands of users who use this every
day and it just works. Um, so what I've
been telling my team is uh I don't know
if you guys saw that MKBHD rabbit tweet
where he's like this is after he did the
humane review and the uh the Fiskar
Ocean review and he just tore them to
shreds and he tweeted a picture of the
rabbit. He said, "All right, let's get
to work." You know, when he tweets the
picture of the comma device, we want to
be like, "Okay, we did our homework.
He's going to have a good time." Um, so
that's that's what we're going for right
now. People who want to like
just make things that work. We have
something that like kind of works. All
our users who have it set up are super
happy. Um, just check out Reddit or
YouTube. Um, but we want to make it
really easy to get into that experience
and make it work every single time.
>> Yeah, there's this myth that uh
engineers can't uh ship good products.
And I think there's a certain type of
engineer like this. I think there's a
certain type of uh you know not to use
this word derogatory but like like a
nerd right who who delights in the
complexity who delights into the oh I'm
using I'm using wayand with the latest
rusticle compiler like there's a place
for this stuff but that's not what we're
trying to ship we're trying to ship the
simplest thing possible and the simplest
thing possible usually is a good product
>> yes there was a question about remote
work. No, we are in person in
>> if you want to keep doing bounties
though, we'll keep throwing them up. Um,
>> that is remote work. Yes.
>> Look, I'm not tiny corpse more open to
remote work than Kama is because Kama
does a lot more hardware. Um, in
general, I think there's a lot of people
who will ask that question um are not
really looking to like they're they're
looking for more of a lifestyle thing.
like they're like, "Oh, yeah, I want a
remote job." Um, so it's not that remote
itself is bad, but asking that question
is bad.
And there was another question about not
having lane markings. Yes, lateral in
open pilot is end to end. It doesn't
need any lane markings. It's just a
model that predicts curvature. So, it is
>> I work at a remote company. It's not
that great.
>> There you go.
>> Thanks, Moio. I I think a lot of people
also don't understand the very serious
trade-off with remote companies, which
is you're going to have to end up in a
lot more like planned sync meetings. And
I don't know, I really don't enjoy
meetings like that. I enjoy a much more
organic style and that's what you get in
person. Um, remote is feeding all the
people who are going to a false buyer on
their computer, right? There there's not
really another way to do it. Like the
end point of remote is there is going to
be an AI model using the webcam on your
computer constantly watching you and
reporting back the most sophisticated
metrics about you. Well, he smiled a lot
today. That's good.
>> So, I'm watching this from my remote job
right now.
>> There you go. Exactly.
>> There [laughter] you go.
>> Uh there's a question. Are we looking
for AI ML engineers or can traditional
software engineers with an appetite to
learn also work at Karma? Yes, they can.
>> Of course, we're looking for software
engineers to do lots of things. Yes.
Comma AI job
>> deleting all remotely.
>> There is no real such skill as like AI
ML. It's all infrastructure.
>> Yes.
>> Uh so no you don't need you don't need
to have a have a math PhD or anything.
>> Yes. Yes. AI. Yeah. Just do you want to
build something great? Do you want to
solve hard problems? And do you want to
ship to thousands of users? That's
that's the only requirement. Are you
capable of working independently?
>> Yeah, it's like we're looking to 10x the
team here. We want to fill out that open
pilot room um and the Cali room we
showed you for the most part. Um and
downstairs if you want anybody wants to
come hardware or software engineer who
wants to run the comet factory. There is
so much we're still leaving on the table
that somebody can just um lots of low
hanging fruit all over the stack there.
>> We're like 25 people now. We want to
grow to 30.
>> Yeah,
but remote offices. Yeah, we had one for
a bit. Um, we're we're we're a one
office company and we invest a lot in
this office. We showed you guys the uh
lunch and dinner room, the new kitchen,
the Kama factory. Everybody who comes
here parks with the rest of the comma
fleet. Um, they see the devices leaving
every single day. Um, it's it's really
incredible.
>> I worked at I worked at a Google
satellite office briefly and it's just
not really a good place to to get things
done.
Um, that was one of I thought Elon's
great thoughts when he got Twitter. Like
Twitter had like 37 offices. Why? All
[snorts]
>> So, I thought that was a pretty good
question. What's the best part of
working at comma for you? Um, I want to
win. Um, we're 20 people shipping
something that uh thousands of users are
enjoying every single day. And we're
going to ship that to a million people
pretty soon. Um, and with five more
people um, and it's going to work every
single time. We're building this like a
very modern consumer electronic. Um, and
we're gonna ship it and then it's we're
going to put on comma bodies and we're
just gonna keep going.
>> We don't have lies here. A lot of
companies have lies. Uh, some companies
would fall apart if the lies were to go
away.
>> Mall stores when maybe next year.
>> Mall store.
>> They'll do Comic- Con 3 in the mall
store.
>> If someone wants to come do the mall
store, I'd hire I'd hire a mall store
person. I'm ready for mall store.
Are we shipping a mall store experience
yet? I don't think so. I think a comma
fellow is going to have to cover too
much.
>> I mean, yeah, but all right. Someone's
got to recruit the comms, you know, get
in their jumpsuits.
[laughter]
>> Fellow.
>> So, George is the president. I just tast
>> We're not pretentious enough to call
them geniuses at this point.
>> Genius fellows.
>> Fellows. All right. Any hiring questions
or other questions are cool, too.
>> But I think we're getting ready to wrap
up.
>> Yes. There was a question about coffee
and cars. Uh I think probably
>> we'll announce it when it's time.
>> Not soon.
>> In the next three to six months maybe.
>> Do you worry there's a limit to what's
possible in self-driving now and that
you're close to it?
>> No, we're not close to it.
>> I mean we have I think we have line of
sight to shipping ML SIM that unlock
some things. I think you guys will be
really excited about a road map for the
next year. Um we showed you a good chunk
of it.
>> What do you mean the limit? Why? Why do
you think have you seen a human right?
There's a proof of concept that there's
a good one out there. Just build that.
>> Comma connect and open pile front end
are the same position.
So I I think you guys are thinking about
this a little bit too rigidly. If you
can do our challenges and you can
contribute um like if you're a person
who's like, "Okay, I only do front end."
I'm not really sure what that mean. It
sounds like, you know, you you don't
want to kind of own the whole app and
maybe that's not for you. We're looking
for somebody who can basically take the
APIs we built in open pilot, extend them
and is capable of making those similar
APIs to expose for connect and then
build can you build connection from
scratch basically. Um
>> so this siloization is how uh the
professional managerial class keeps
control of companies. Uh there's no real
reason for it. It's it's not
advantageous for a company to pigeon
hole you into a small role if the
company's trying to win. That is
advantageous if people are playing
office politics and some manager wants
to you know silo and pigeon hole their
their six people such that they retain
their own importance. Uh but if you
don't want to do that then things
shouldn't be around like this.
>> Comma doesn't have a PMC
is PMC free company. Uh we're using
TensorFlow. No we're not. Oh we're not
using TensorFlow. We're using PyTorch
and Tiny. How many refactors are too
many refactors? So, it's not about the
number of refactors, it's about the type
of refactor. Um, we've still got many,
many refactors to go on Open Pilot and
the rest of our stacks. Um,
>> yes, AE has more acceleration limit.
It's a slightly different
>> API. With respect to refactors, I lean
towards like the way that the C Python
team thinks about it, which is in
general, if you're trading off
complexity for things like speed or
extreme features, you're probably making
a bad trade-off if you have a long time
horizon on speed and features. We want
speed and features, but it's not worth
shipping hacks tomorrow after get them.
>> Yes, we don't want to put ourselves in a
local optima that we can't escape. Uh
we're using Python for training and then
tiny for inference on the device.
Can you choose your own equipment you
work on? Maybe I want to code on an edge
too. What is an edge two? We give you a
really nice workstation if you want like
a different workstation. That's an edge
two, I guess.
>> What's an edge too?
>> I'm not sure.
>> I'll buy you whatever hardware you want.
I'm I'm big on buying machines and
uh
>> what's the age range of Open Pilot
employees?
>> Um pretty young.
>> Don't don't discriminate.
>> You don't discriminate either.
Okay.
Someone says, "Thanks for the
transparency." Cool. I think we can wrap
up.
>> What's the process?
>> Oh, to relocation. Uh, I don't know. Do
you want to relocate?
I think can help with relocation as
>> we do relocation bonuses. I think
sometimes not quite so looking for
remote engineers. No, we're looking for
people to come to this office every day
and make really great stuff.
>> Yeah. Why do why do you want a remote
job? You know,
>> how easy is it now to support a new car?
So, it depends on the car. If it's a
model port, it's like crazy easy. Um
like somebody with experience in Open
Pilot could do it in half an hour. Um
and then if you're doing like a brand
port, it's like a weekend proposition.
Um it's very doable for anybody who's
has any experience with software. So,
someone's asking about the on-site
interview for the final round. How is it
like?
>> Um, so typically you can do um we'll
offer you an internship to hire if you
want or you can do a micro internship
where you come for like two, three days
or a week if you want and we'll come up
with a project um that is like a very
real problem. It's not a toy problem.
And then we'll scope it such that you
can ship it to users within that time.
Like you'll either ship it to Open Pilot
Master or it'll be something that ships
to production. Um
so that's generally we'll fly you out.
um we can house you here. Um it's a very
easy process.
>> Yeah. And it's it's a good way to see
what are the expectations if if working
here is a good fit for you and also good
way for us to see if working here if you
are
>> you don't want to move to San Diego.
>> Yeah. Why don't you want to move to San
Diego?
>> I'll say one more thing about the micro
internships. We actually stole that from
Stripe and I interviewed Stripe and they
brought me out for a week micro
internship. It was a good experience
coming to the office. Uh you know I got
something shipped. It was cool.
>> Yeah, it is cool. It's a two-way
process. It's not just about us testing
you. It's also about you seeing if
you're a good fit and if you want to
come here and relocate and work. Uh uh
really shouldn't think about it as just
us testing. It's like you come here, you
do some work. U see the fit, see the
culture, and we do the same.
>> Yeah. I mean, we're a pretty chill place
to work. You come here and you're
basically um there's no like you don't
have to onboard. You you can get clone
our repos right now. Um the difference
is you'll be working at a desk here and
then you'll have lunch and dinner with
us. Um,
so you get to really see what it's like
pretty immediately.
>> I mean, we do have access to some cool
things. We do have access to a lot of
compute power. We have access to the
data and we have access to the there is
one hidden repo here. The um the repo
that has all the the training and the
>> and shifer
>> data processing stacker not open.
>> No, shift not open.
>> Oh, we can we can open if someone wants
to do that as a project.
>> Who wants to come work here and make it
open source? Yeah,
>> I got to clean it up a bit.
All right.
>> Micro
means the recruit needs to work with the
team too, not just dance.
>> Yes. Yeah. It's not just Yeah. It's not
just a performance. It's really,
>> you know, it's like real real work. I
want to see
>> it's almost like your first week your
first week here.
>> It's important that the uh training set
and testing set be the same.
>> Yes. Yes. We don't want train set mis
test set mismatch. And you also don't
want to overfit. Don't want to train on
the test set.
>> Test set.
All right, I think we can wrap up.
>> All right, great. You guys can post uh
any more questions on Discord, make PRs
to the new jobs page. Um still looking
forward to any feedback uh and your
applications.
>> Cool.
>> Good chatting.
>> All right. Thanks for joining, guys.
>> Bye.
what up guy
I did I did on for the hata giraffes I
guess I'll do it for the term giraffe -
yeah Toyota giraffes are super sweet so
we got check it out this is a Skype and
in it yeah this one's a little used I
just pulled it out of my Toyota yeah so
they should go into production this week
we just ordered 200 boards a nice solid
feel to them
Toyota Moana we have a little bit more
room the Honda one you have to move way
to the right to get away from the
existing system Toyota one you just plug
it in like that it goes in I'm gonna
missus to the side then you can connect
well all the Wi-Fi with shiver or you
can connect this USB port to your Neo
pretty good pretty good
umm rav4 support Prius support
Alti SSP support coming to open pilot
someday
so so let's go Lisa I was driving around
that yesterday a few things we gotta fix
but yeah toyota support is real and yeah
i mean the way that we're supporting
things for the future is with giraffes
you check it out you got an Ethernet
port right down there you can plug that
into a neo it is a downside to Toyota
there's no continuous power available on
this connector so you have a few options
did Vivian talk to you about not here
it's Saturday
Leo is me
yeah but also the downside of Toyota is
there's no continuous power available on
this connector so we included a barrel
connector
and you can get 12 volts into there
however you'd like
so the cables we have actually run all
the way down to the ODB part o d OB d OB
deport I always say it wrong
um please show more what else you want
to say yeah so you guys a secret
internal debug board there's a secret
internal debug board we used to test me
us
um you plug a panda into it you plug in
do into it and connect them up together
this is what you first simulator if you
saw this simulator on Twitter what else
do I got to show wires and wires like
this one wires are terrible I hate wires
wires that was bright that's why we've
built solid drafts comma logo right
there the switches what are the switches
do so the switches let you turn on and
off the existing a tas system in your
car so if you want to proxy it if you
want to forward it you can do all that
with a giraffe so edgy that's a little
bit different so this switch 3 on the
honda one is for cam 2 switch 3 on the
Toyota giraffe is for enabling power
when there's ignition so yeah otherwise
you got to use this spiral connector
down at the bottom connect this to OBD
connect this to 4 lights
Oh B D yeah that's right
obd it's like n be deep but obd yeah one
more a little wedding today I could go
shower
yeah I gotta go shower I woke up and I
shipped the draft and I tried to fix
models models are kind of broken we have
new models coming up new models are
really cool machine learning is really
cool like oh yeah so that's it that's
the Toyota giraffe link to buy it is on
the wiki on Twitter and on slack thanks
for watching
she goes later
all right
people join up ask up one person one
person in us six people seven nine here
we go
what up crow welcome to myself driving
til your little Prius commas
self-driving Toyota Prius I didn't
really do anything
I just Cheerilee it and talk I'm the
periscope so we're actually using the
Prius is longitudinal control and this
is the comma a I lateral control oh oh
wait a second we have something we can't
show off in this car we show well hey
you know cats out know that don't worry
internal prototypes in total from tennis
yeah no I'm not
we won't even talk about it don't don't
talk about it just like yeah it's an e
oh yeah we have an e out yeah I mean our
self-driving Prius Wow can't believe I
forgot about that
yeah um we have an extra you know well
that's yeah that Prius has a computer in
it too um yeah the periscopes and we
didn't like why are the periscopes
always kind of low-quality but yeah so
we're using the longitudinal control
that's built into this car lateral
control is what we have we're actually
on our way right now to the Toyota
dealership to buy another Toyota
we love Toyota man Toyota's are great
right this turn here and we'll see what
it does
oh not what's with our fare um the Prius
has a significantly higher torque limit
than the Honda Civic
significantly higher so that's why when
I'm driving the Prius I always keep my
hands touching the wheel it's not
actually moving the wheel I'm not moving
the my god yeah
but yeah I put the speed up here get on
this Highway
doesn't that thing park by itself yeah
it does it does park by itself but it
does not drive itself
the Honda lane-keeping system is much
better than the Toyotas line keeping
system the Toyotas lean keeping systems
practically non-existent
yeah there's a lot of berry researchy
stuff going on in this car right now
yeah check out the wheel
my hands and hands are an inch from the
steering wheel sturdy
it's just ready in case it does do
anything if you've been quickly to
respond to this the release version this
probably won't be the case
oh yeah pretty well when I said we got
off of three three be a billion for each
other
ready through me look at that term
that's good
thanks genders diners on our thing yeah
ten days of thoughts
where is e where does it yesterday man
people have a lot of computer questions
genders is tech ops a comma AI it does
something of interest oh yeah right
wow this is huge props of the controls
team forgetting this to work
is it better than Tesla out of Paris
did not a miss Carnot so the Civic is
actually even better than this car this
is our latest in prototype so our plan
is by the end of the year to support
almost all the Honda's and all the
Toyota rav4 hybrid absolutely well what
year what year what year for your rav4
we're actually going to buy a rav4 right
now
work yeah it'll work on all someone's
asking me what the best part for this
isn't if there are any Hyundai said oh
no Hyundai's now the best car right now
is the Honda Civic our flagship by the
end of this year will be the Toyota
Prius so if you want now Civic if you
want future Prius
free stuff no no no when I wrap it today
what about Chrysler Dodge No
this is a greeting
into the wheel accident
makes the Prius the future so the Prius
does a lot of really cool sensors in it
so we have like a blind spot awareness
sensor see the mirror over there
it has an electric motor which you can
control much more precisely than a
gasoline motor it's a nice car I'm happy
with this I'm impressed with Toyota I
say the same thing about the Civic like
both of these when you compare like like
a Honda Civic
oh I went on with the GM with the GM
looking a buyer look at a buyer a bolt a
bolt
man that's that's that's that's see
that's a prototype neo yeah I mean you
couldn't even like look and see what's
on the screen it's no different from
open pilot except it's got a pink line
instead of a purple yeah maybe yeah
we'll see we got we can we have a
phenomenal new intern yeah yeah
the pink line control pink line control
is great man man when I talked about
silky smooth
that's fine so we've gone we've gone
five minutes now without a disengagement
this is coming eyes real
your turn free labor and no we pay our
interns oh absolutely better interns we
parent does really well can you apply it
more torque to the first in the Civic
yes we can
our go driving in Pittsburgh
each autonomous driving up anything
outfits book
autonomy we are - - and no one else and
no one else has anything else that isn't
- anybody who tells Balkan one exception
Howdy's traffic em assist might be level
three but the only difference between
level two three and four is liability
there's no other difference between
these levels so I'm actually gonna
disengage and engage because which it
cannot so Oh sort of no I can't no but
that's what what's nice about having the
Blind Spot Assist incentives if you got
charged for your panda it means it's on
the way it means we sent it out
absolutely
yeah you got charged for your pair that
means it shipped either yesterday or
will ship tonight yeah and us uh you
know what if you can do a close-up of
the giraffe I showed off giraffes this
morning
so these cones be mine on that I got
this long jab
I got it I gotta see the shoes I'm
driving a car oh man this is not the car
driver you guys the cars not this bad
but yeah so we're actually driving on a
panda right now which way straight
so this is actually all of the control
signals being spoken to the priest right
now are going through a panda pandas are
universal car interfaces they can be
used for shipper apps they can be used
for anything you're gonna be turning
left up at the top
so yeah if you if you bought a panda you
are getting in early yeah this is this
this panda that's running right here is
the exact same panda that we're shipping
out there's nothing special about it
wait what no you're actually following
turn left and then you're yeah you're
getting this Lane right there on our way
to melody Toyota should we live stream
the Toyota dealership oh we love Toyota
dealership I realized it people we got
66 mom oh yes they should wash off the
giraffe yeah check out so that's a
that's a panda up there yeah that's a
that's a giraffe which is how we're
connected into the Toyota we have a zoo
we have it's a whale we have giraffes
and pandas yeah we're gonna we're gonna
we're gonna make Li be koalas but koalas
were cancelled yeah yeah no one really
is time for koalas yeah yeah I'm see
also don't replace the rear view mirror
on cars anymore
we mount right to the windshield so this
neo has radar disabled and using the
Prius ACC oh so we're using the Prius
radar as well and we're using the
Priuses ACC yeah
well we're talking to the Prius trainer
is it possible to make a sound happen to
the neo and a certain effect occurs oh
we use the sounds from the car but yeah
I mean that's certainly possible
remember Neos run a OS which is just
like a slight variant to Android so yeah
it's really easy if you can make Android
class sound you can make a deal play us
out which point six miles your time
stay straight cool now unfortunately
since I'm using the Toyota ACC I have to
wait until we get to let's see if we can
make this turn here there you go guys
there you go look at that um since I'm
using the Toyota ACC I can't engage it
below 28 it also does a terrible job of
fusing with stopped cars like this is on
oh my god this you see it felt that hard
stop this is not our system that is what
our system does so much better yeah all
the steering has been our system but
we're gonna we're gonna work on getting
on getting the off so no stopping
yes stop it well Toyota low quality stop
and go yeah like look here so you can
see here like we're eight meters from
the UH from the car in front of us like
why did it stop Oh
vision only ACC not a high priority for
us a lot of these cars do have radars so
I also have to tap on the pedal to get
it to resume I see and it disengages the
cruise control if it loses the radar
track our system doesn't do this you
don't really need to
the volta loss up two to three meters on
stop and go after tree two to three is a
lot more reasonable eight is completely
unfeasible like eight meters from the
front of your car to the front of their
car
I thought Pierce at full speed DRC see
it does try to use it I would not call
it good good is not the word I used here
good is not the word I would use to
describe the nowhere
you guys who watch these periscopes you
get it on the latest and greatest stock
you say sign priority but is it viable
for open pilot users what oh oh oh
vision only as you see what car do you
have that you're really deep vision only
as you see far
you're better off just going on eBay and
buying like a Delfy radar or something
there it is melody Toyota you - you big
fan of Toyota dealership is the master
fest same thing I was right Turner
sketchy
left left - neow the right time
this vision ACC landing the video
combined with existing radar data yes
but what car do you have that you want
vision only ACC for Subarus originally
yeah I know superficially super us have
two cameras with a wide base line that
makes vision only a lot easier
my q5 doesn't have freedom but sue
by the way if you don't have radar you
can certainly still get open pilot to
work longitudinally yeah so this this
isn't you can actually just turn this
off in the in the settings the use of
the customs Canela yeah really
when they switch that's all a Bosch mor
for a while yeah I mean only ACC it
really depends on what you want to do
like if all you want to do is gas only
cruise control then the vision only ACC
and open Pilar is already good enough
for that if you want to start doing the
brake if you want to smooth braking
experience you'll have to wait for it to
get a bit better but show me that you
have a car that you can control the gas
and the brakes on if you show me that
I'll put some more engineering effort
into uh will open pilots doing work with
that radar yes absolutely yeah
the entrance I missed the entry using
the street you can go straight in around
that time my band's because I haven't
left the house in thoughts on Google and
pressing 1 billion and lift oh you guys
won't see self-park oh ho this is not
our son nervous myself Park is too bad
Georgia spiking my partner also you can
judge it to set some more fun you know
[Music]
this car has so many things that beep at
you
it's really like poorly done because
like you never know which beeps are like
important beeps this this is the car who
like you know the boy beep wolf oh it's
the P button
all right periscope yo yo
so we're out
to buy a Toyota but yeah by the end of
the year guys open pilots should support
top 10 cars sold in America the top 3
things won't buy Tesla oh I think has
will take over the auto industry in
America I think they're already worth
more than 4
um well someone buy for it I don't know
they've been a company for it's kind of
sad when you think about it
Ford's been a company for like a hundred
years and like your mustache showed up I
don't know where that was true
no but guys um so by the end of the year
open pilot we're gonna support top 10
cars sold in America at the top 3 or
pickup trucks go pick up trucks on the
top the fourth is the Camry the Camry is
going to work if you have the 2018 Camry
number 5 is the Honda Civic the Civic is
going to work if you have the Honda
sensing package then the next two I
believe are the Corolla and the rav4 and
both of those either the Corolla CRV and
the rav4 CRV is gonna be supporting the
Touring package parole in the rav4 all
of them are gonna work gas and brake on
Subaru so when you show me a video of
gas and brake on Subaru like with a
joystick and I'll work on I'll work on
organ vision for ya
well I won't work on the pitch but kabel
work on the vision you are
the new Bojack season was disappointing
just putting that out there but uh yeah
all right we're gonna buy a car
was it really disappointing the new Bo
Jackson oh yeah
experiences yeah or the fact that they
have experimental mode available and
just haven't used it how many people
just learned right now that there was an
experimental mode on their comma three
did we advertise it well
it turns out not that many people read
the blog so
I guess they read the release notes
though do they though or did they just
click accept everything yeah
all right we got to get some people
interacting this has got to be a Twitter
space you know come on where's the guy
who's a jackass from the elong Twitter
experience let's get them in here you
got the questions and Scouts
no that's what we get when we're not
controversial yeah
I mean this is the real truth we have to
we have to sell controversy
is that what it takes to succeed in the
modern world
it would be nice if it didn't just I
need a way to reward non-controversial
value well there's so many people in
here now but they didn't have nothing to
say we have 37 people listening and they
don't even know what they want us to say
oh there we go yeah you can talk talk
talk you're already a speaker you could
just click the unmute
yeah I mean you put a good point out
there so like I'm gonna
post shame myself right now I've had my
comma three for almost eight months but
I haven't had an ev6 was hda1 like the
way the Korean Market's going obviously
you'll understand that like can FD may
be a problem any work around future
state with like shrinking pandas or
making it more Sleek like y'all did with
the common three just because I'm
looking at all the peripherals I'm
running and I'm just like holy crap this
is intimidating for delay person right
the the red panda install is not the
best uh we're working on it
uh we're we're definitely working on it
I mean it does work and it will stay
supported but uh I mean you could
imagine sort of what's gonna happen
there
um you know no no it'll be a while but I
mean eventually that yeah can FD will
come native to the device uh you know it
just takes time to
trickle these things down
uh but yeah no the red panda install
it's also pretty confusing I think Alex
and adeeb were talking about adding a
kit to the website it's not going to
save money it's just a kit that uh
includes all the stuff you need if you
don't have to read a whole bunch of
stuff to figure it out
need the red panda though right
no I think you need two harnesses
I don't know where where where uh
fortunate enough to have uh who did the
Nick did you fix install
I still haven't installed investment we
just got handed the ev6 was already
installed uh we recognize this isn't the
experience for everybody so you know
what we're gonna make everybody suffer
and we're gonna
all red pandas
um and be like wow this is terrible I
can't believe how asking users to do
this but you know we'll get better
yeah as I look at my uh my red panda and
my comma 3 and the little compartment
underneath the cup holder right now so
wait I think there you go okay support
wait wait the red pen is going to get
smaller though right did we ever ship
smaller pandas
oh we have some small red pandas the new
red panda is used we made a little
chiplet with the with the so the red
pandas the old red pandas have a large
stmh7 in them it's like really large
it's like the biggest chip you've ever
seen
uh no the chip is like it's it's it's
it's large I do a lot of supply chain
issues which are now just starting to
clear up
um
yeah which has been really painful for
like
prices and part of the reason also we
could do the price cut part of its in
sourcing but the other part of it is
like we're starting to see the end of
supply chain issues
uh and we're able to
actually buy what we need to buy
um the new tiny red panda is gonna have
so that H7 microcontroller it comes in a
bunch of different variants
uh and uh yeah so instead of using the
big chip we're gonna use a tiny chip but
the issue with the Tidy chip is the tiny
chip it's so tiny that it can't fit on a
normal PCB so we made like an adapter
PCB made like a high density PCB and
it's really tiny that kind of like just
adapts it and has a bunch of capacitors
uh the Crystal and like a bunch of
support components on it
what else do people want to know
you guys got you guys got to ask
questions you know
is there anyone cool to talk to at CES
yeah did anyone see any good at CES
we're sitting in the Airbnb we're like I
don't know do I want to go back
I don't know see it all tomorrow what
did Dukes have to show did everyone go
to the zoox booth
Amazon had a lot of self-driving stuff
but I didn't check it out
with rivian or just Amazon
I guess just Amazon wait but think about
zukes and review
they did are they really playing bingo
you know what's Amazon going to do with
all their money
they know that delivering packages to
people isn't going to last as a business
for oh wait no
sorry that's the oil companies
all right we got we got another comment
from the audience
uh live view of mine oh oh I see so
you're posting uh
uh what were the booths next to you guys
doing one of them was doing like lidar
yeah no the red panda install will get
better don't worry
um
the boots next to you
we're doing lidar what was the other one
they had blinking brake lights that's
all I really know about them
and then like Dragon pilot Booth or
Dragon pot is Booth yeah which are they
actually uh well the guy who made Dragon
pilot works at a company that has Booth
oh I didn't realize they had a booth I
thought they were just there yeah yeah
no the guy who makes Dragon pilot was
was there left we talked to him we were
thinking about maybe going with Media
Tech chips
uh in the far future because qualcomm's
terrible and Nvidia is terrible
you know we we wish it wasn't that way
but media takes Chinese too mediatek's
Taiwanese
um we say two no Taiwanese not Chinese I
mean Chinese
yeah but actually Chinese uh uh Rock
ship's highest end chip is not really
good enough
let's see like it's it's on par with the
A45 and no one wants to do a lateral
support
T.I will never do that TI makes
Incredible chips but they will not be
more powerful than the ones they release
the ones that we're losing now so the
AWS chip is like half as powerful as 845
right
uh no not even oh no the TDA they were
talking about the tda4 VM the tda4 VM is
pretty underpowered I think it's I think
it's dual core
if it has a GPU it's really tiny it has
some weird neural accelerator
a tensor thing yeah like I don't know
deal with that
um
so yeah no ti no I mean like what
companies make chips that are good
enough Nvidia Qualcomm
uh media attack
Huawei Samsung
but yeah giving Huawei and Samsung good
luck but mediatek's probably the most
approachable of all those companies are
they in anything I've heard they're rich
phones a lot a lot of lower end Android
phones or mediatek oh I see yeah
uh
we have nine comments now
what are all these comments oh
have you and Elon discussed autonomy you
guys think I just like hung out with
Elon and we just talked about things
that didn't really happen guys
um
had a conversation with him in a Twitter
space uh
I use it and it is great thank you
what is the long-term goals of comma and
he talks of Partnerships with other
companies with car companies
guys this is the most boring question
ever
what do you think that means what do you
think a partnership with a car company
means really I'm giving us a free park
car to report well if Riven wants to
give us a free car to do a port we're
happy to do it that that's posted yeah
you know what if some car companies
serious and they want to give us a free
car I think for almost any car if they
gave us a free car we do it for it
yeah I guess unlike the car was
reasonable
like not like some like unreasonable
ridiculous that unreasonably difficult
unusually shit no unreasonably difficult
I'd even most black straight cars that's
probably true for if someone really
wanted to give us like a yeah for an
Audi Q7 yeah yeah exactly or no I'm
thinking like uh You Wanna Give me like
uh like a Porsche 911
I'm interested
um
so yeah if you want to give me a car uh
that's how we could start a nice
Partnership if you've given me a car now
otherwise I don't really understand what
you mean by partnership
um do you mean
integrating open pilot in the car well
you don't need to ask for that you can
just the software you just take it and
install it on your car
uh I mean this is why like the Chinese
are going to win cars
because they're going to do that
and like some companies won't and like
it's gonna be like TCL on the TVs man
it's literally gonna be TCL on the TVs
like cars are gonna get there
you ever driven one of the NEOS or X
pegs or whatever they are well those are
pretty good actually
cars like they're what I'm not even
talking about them I think there's going
to be a whole nother tier of Chinese car
companies that's basically like the Dell
of cars right because with electric cars
like with a with a you're trying to
build an ice car like where you get in
the engine
you can't put an engine for dinner those
companies have perfected those engines
for
so many years yeah but you want to build
an electric car you know buy a motor
from that guy buy batteries from that
guy by chassis from that guy stick it
together it's like building the computer
but when they compete with Tesla
um won't they just be more efficient
owning the stack
can they compete with Tesla I mean
Tesla's ain't that cheap yeah
oh no are they not more efficient for
owning the whole stack
I don't know maybe maybe Tesla really
owns like who's getting the batteries
and
oh yeah I guess they don't produce all
their own batteries yet do they yeah I
mean there's definitely a way to compete
with Tesla on the high end
I mean yeah but that's not really which
is kind of what you're saying
I'm waiting till I get the Ford Maverick
hybrid truck this year
and then I'll buy comma unless I find a
better hybrid truck
currently I drive a 2012 Lincoln MKZ so
it doesn't work for me what is the idea
I assume you mean ideal vehicle for
comma anyone have it installed on a
truck
I mean we have installed in our truck
yeah we are Dodge Ram
Dodge Ram 1500 Limited great car
drives off-road American
uh is it good or does it like cartoons
and stuff
well you wanted to probably gonna fix
this one problems is the truck's really
high and the thing's not really designed
to but we'll fix that
yeah we explicitly have a filter in the
data set that filters out
Road height detected over 1.5 meters
wait do we actually yeah because we
thought no car will ever be that tall
until we found out about trucks okay all
right we're moving that right now
right now great gotta I'm gonna filter
that out all right is anyone raising
their hand and wants to talk
got no hand raisers but we have 44
people now it's growing a little wow
that's good yeah
um any more
comments here are you guys offering
Partnerships with retail stores and
offer installation for end user
oh why don't you do it
right do you need me
uh it was the same thing with jailbreaks
right again I really don't like this
word partnership right because
partnership is is the most ambiguous
garbage I've ever heard what are you
specifically saying we do with retail
stores are you saying we give them free
devices and then they install them pay
us no because then I gotta come knock
your door down where you don't give me
the devices back I don't want to be a
creditor right but right now I think
it's still 15 if you buy right now but
we got we got to change it to 10 because
now they're too bit of a deal
um if you buy 10 devices we'll give you
10 off right and then charge your 500
premium on top of it for your
installation
and there you go boom you're making
money right
um but yeah so so are we doing
Partnerships with retail stores and
offer installation like you can just do
that you don't need me why do you need
me
um is comma buying open AI I don't think
you know
I don't think we can afford open AI
honestly no I think they lose a lot of
money I think that if the minute we
bought open AI we'd be bankrupt in two
weeks
you want to keep all those gpus running
for chat APK
right no you're just do you want to be
Microsoft's bitch like by open AI well
you do the credit it's not paid
it's free
try GPT has credits now oh it's free
chat ubt's been free for a while yeah
credits oh okay
um but yeah I mean if you want to be
Microsoft's bitch you can buy open AI
um
let's see do we have
more things
oh someone posted on the Discord did no
one post this on the Discord
cool
join our twitters I'm sure people on
Discord want to talk oh we have 12
comments now good
you got to give me content to interact
with
um
are driving control is significantly
better on supported EVS or is it roughly
compatible between Eevee and gas cars
wait sorry I was looking at this score
what was the question are driving
controls significantly better on
supported EVS or is it roughly
compatible between EV and gas cards it's
the same the only difference is that it
shifts on a gas car but that shifts with
a human too does that bother you
as a human driver it even shifts on a
Honda Civic with a CVT don't you love
the shift
shifts don't upset you as a human driver
it shouldn't be a problem for us oh you
meant selling them in a retailer like
Best Buy and they install them for you
maybe it's best to install things yeah I
know they do they make a lot of money on
this stuff oh it's like the Ikea add a
person to your account yeah yeah yeah
yeah Geek Squad will plug it in I mean
you can get there
um we can get there I don't know we'll
deal with talking to Best Buy like not
really
uh no look uh it's basically this like
the comment three was too expensive
hopefully it's not too expensive anymore
um and it didn't do enough and hopefully
now it does enough so it like does more
and it's cheaper uh if that doesn't work
to get lots of growth then uh
I don't know I don't know what to what
to say however I think common three will
stack up against v11 FSD
I mean we're one to two years behind
Tesla we've been one to two years behind
Tesla for a long time and we will
continue to be one to two years behind
Tesla it'll be more comfortable and less
Clash
yeah you go on Reddit and you can read
the comparisons between open pilot and
Tesla autopilot and FSD and like but
yeah it depends what you want
so I got some Twitter questions from the
Discord wait did they come on the
tourist Place uh well these guys just
not have Twitter they're just asking
here plans to add long support for more
models yes we are planning to add long
support to more models especially as
experimental mode gets better that's
more of a priority
foreign
[Music]
how many comma threes can we produce per
month now or in the near future
uh so I think we can produce 500 a month
now
I mean it depends so a lot of this
depends on when Parts come in
uh I think we've done 500 before and
yeah I mean we're working on we're
continually working on improving the
the manufacturing process to reduce time
uh so yeah I think it's gonna be I think
it's 500 now and hopefully by the end of
the year it's a thousand
I mean our goal is to sell 10 000 units
this year
so yeah we're gonna have to get that up
to a thousand
foreign
want to raise their hand and ask a
question
you guys want to type your questions
Nabil wants a spinning head to himself
instead of the comma logo well Nabil can
run the devil Fork which does that
um is the solo camera gonna be enough
the more comma evolves what solo camera
have you looked at a comma three one two
three
foreign
is that enough well it's enough for what
99.99 of driving
have you learned anything at Twitter
that applies to call my local Cloud yeah
don't ever be Twitter
Oh no just that like building a good
development environment is really
important I already kind of knew that
but Twitter just really reinforced that
idea
um
I don't have any more dumb questions but
I think I speak for the community as a
whole when saying we appreciate the
interaction from all of you and we feel
like part of the adventure companies
don't do this today yeah because most
companies are scams guys look some
someone realized and this isn't really
true anymore but someone realized that
it was actually a lot better to sell
shares instead of selling a box because
the problem with the box is it can break
people have expectations for a box
like the only expectation people have
for a share is the number go up and as
long as people keep buying the shares
with that expectation the number
actually will go up it's a
self-fulfilling prophecy
uh but yeah so companies that uh
you know run scams aren't going to be
open and transparent with you obviously
I mean yeah they've just got stuff to
hide
yeah so many people just terrified we
talk to so many people and you ask them
questions like I don't know if I can say
that
um
what do I look for in a potential intern
commits to open pilot
I mean guys like it's not like we don't
have like a secret rubric you go and you
do external work look at the last people
who got hired for open pilot they were
external contributors to open filing
it's actually pretty easy you're like
but I can't contribute to open pilot
well great why the fuck would I hire you
like
it's pretty straightforward stuff
if you do well in the calibration
challenge you basically get a get a
guaranteed interview it's a very
objective metric there's a script that
evaluates your code yeah it's just the
programming challenge
nothing of egg
uh we hire more people for research yeah
they do very well no they do very well
do you want more people
yeah they're very good all right great
uh so stoked to finally have a
compatible car and use comma bolt UV
yeah a lot of people have been buying it
for the boat lately we should really
make sure that port's really good we
have it both so it's gonna get good
um experimental long seems to act worse
at night tunnels and rain is that a
known issue
uh not really I guess and it seems so
slow to reach Target speed at any Lane
that is a known issue that we are
working on
AE did this better but not quite there
yeah so the auto encoder models are a
lot better at speed convergence we can't
ship them yet because of some issues but
that's the direction we're going and the
more we go in that direction the more it
will like be reliable like converging to
highway speeds at night time the auto
encoder models leak the headlights
right if they tell you where the
headlight is and then you try to
reproject it in the simulator uh it
cheats
yeah it turns out you need a lot more
than depth to actually reproject the
scene when it comes to lights I mean I
talked about the fancier stuff although
a lot
you know depth is
you know it's gonna kind of work you
know it's going to be better than what
you have I just didn't expect the issues
with the lights to come so quickly I
thought we could kind of ignore them oh
no you're gonna have to do something for
the headlights I don't think the other
lights have a good deal
no but we did a lot of augmentation and
it fixes like 99 of it
wait the headlights yeah yeah oh sure
you fix that 99
we like car drives at night exactly
oh but you gotta well you gotta model
the headlights that's not that bad
and we tried all this stuff
you tried modeling the headlights not
just augmenting like uh you can try that
too yeah but the problem is well I I
know you did random but you just
randomly made some patches bright and
some patches dim well that was the most
effective in the test at least yeah you
probably also want to model the
headlight and subtract it out or
something the problem is when you're
close to a barrier like you know this
highway concrete barriers the lights
against them are so strong yeah really
difficult to modify the image there
great so it fails so we gotta we gotta
just switch to something real well
that's what we're working on now yo guys
one of these days we're gonna hit
something real and the simulator's not
gonna fight us anymore and the model's
just gonna drive beautifully and then
we're gonna train it on 17 million gpus
then we're gonna stick a 30 90 in your
car and it's going to be level five
yeah
yeah
well I mean we got to figure out I'll
get the other cameras too so yeah
I just need like GTA 5 but in the
machine models head
that is how it works I mean like why is
boss D if you just go forward on a video
and have the machine learning model
imagine why doesn't it just keep drawing
what did you try Dynamics models and see
what it does
yeah we're working on yeah it was very
major I know
uh you've seen trading a couple of those
I don't know what the status of that is
but like that's gonna work Dynamics
models were not going to work until
you're vq80 no I mean that is the
approaching using yeah
I mean it'll work and like we're gonna
start to see these from mainstream AI
Labs like this year next year yeah
everyone wants to do everyone wants to
do video synthesis
I mean it's the obvious next step right
all the videos yeah all the all those
dollies and stuff we're gonna do video
volley
oh
I know
uh
okay we got a few people who requested
this because we got the people who want
to talk
no I can turn off my turn my auto
rotation
welcome welcome to the Twitter space
welcome
oh and we have 28 wow we have so many
comments externally
oh I guess I can beat those two
we got new speakers what do you all want
to say
hi George back I commented uh this
question I'll I'll ask you instead
um are you still walking on the
um the comma body or is that just kind
of a side project
um
um that's not going anywhere
somewhere it's just a question of what
the time frame is
um
long term there's no future in
self-driving cars
uh and I'll tell you why if two things
are gonna happen uh one
like
when you get to a long tail it does
become not only a terrible grind but
also a just a real problem of how do you
prove the success of this thing
and at that point the only thing you can
really do is become an insurance company
and that sounds very boring
uh and two
you're again running up against things
that are just that are just like
not fun
why do you want to deal with this long
tail you want to solve a problem be like
cool we solved the problem and then move
on to the next thing where we can
actually make progress on a problem and
the next thing that's really very
similar to what comma is doing today is
home robotics
uh so the body is the future of common
right the body in a way is the future of
Robin pilot too right think about it
when people say they want a self-driving
car this is not a car it's a person
that's a person that
sits down in the driver's seat drives
the car and doesn't talk to you or do
you beat most taxi drivers
um
but yeah so it's it's a
five years the plan for comma is really
to fully be a robotics company but in
the next five years I think we're going
to make a lot of money uh selling eight
ass boxes
uh
the the total addressable market for
comma is huge the amount of supported
cars that are currently on the road and
how quickly that's still growing
uh so I think we can you know start
making 100 million a year Revenue
selling 8s boxes
okay that um it wasn't just a side
project and and could be you know a a
successful product line uh if I could
make a request I would love for I know
you do a lot of streams which I watch if
you could maybe
post more videos of you testing
um
you know
development
trial and error crashing the thing uh
that would be awesome to follow
um I would love to as soon as you start
selling them specifically because I have
a car that you that comma doesn't
support so I've been following Comma
just as a fan I've never been able to
buy the
the the
um the self-driving aspect but when you
release that video on the comma body it
was very exciting for somebody like me
we have some other things planned for
combo robotics the body might have been
a little bit ambitious
uh uh you know what do you guys thinking
like a puppy you know it's just a puppy
guys like having a puppy right a puppy
what does it do oh it's cute
Nippers
so yeah I think there'll be some new
cool robotics content coming next year
I've been talking about how I want the
new office teaming with robotic life
I think anything around a thousand
dollar price point people like me are
gonna
want to purchase so make sure I think I
think that's about the price point we're
sticking to for our robots uh but you
also need a head right the head's not
included uh but now the heads are only
14.99 they're a great deal
and when you look at the common three it
really is a head right it has two eyes
it has two ears
people are trying to remove an ear
people are trying to Van Gogh the comma
three it's not gonna happen two years
uh
uh all right we let another speaker in
what does other speaker have to say
sorry for putting you on the spot
hi uh this is corn with McKay here and
from the autonomous Vehicle Association
of Ireland
um uh so 2022 will go down as one of the
worst years for deaths and accidents on
U.S roads
um uh one of the highest uh number of
deaths and accidents in the past 20
years so one of the things I work on
here in Ireland is lobbying and to make
this sort of Technology compulsory on
all vehicles
um I'm just wondering if you guys have
considered lobbying at the Department of
Transport and secretary Pete on making
these types of devices compulsory on all
vehicles on U.S Heights I would never do
that
[Music]
life like I'd rather like I'd rather
work at a KFC uh but no I mean that's
just me
um no I agree largely with regulations
that mandate things like aeb on new cars
uh I think again eight ass Tech is we
consider comma to be much more of a
convenience feature than a safety
feature our bar for safety is human
driving so we have to make sure it's at
least as safe uh as human driving and
we're confident we've passed that quite
a bit but
well that's a poor bar isn't it well
again
we are not a safety
safety safety aside from the it's not
going to make
um you know again safety is very much
your choices as a driver if you choose
to pay attention you know you're
immediately doing way better the the
thing that's I think you know I don't
know I don't actually know what the data
says on this but I do know that
accidents have ticked up slightly and
it's it's probably phones right
um well it's a a multiple of reasons but
it has been proven that ADA systems do
improve
um uh quality of driving time
the experience driving is much better
with the Eds systems but no like are we
going to start lobbying to make a
compulsory no but do I support some like
if you want to sell a car in 2025 it has
to have a EB yeah sure
yeah
okay thanks for that and best of luck in
the future guys
all right what else we got
uh image prime equals image already now
we need Dynamics wait you've seen you
you really think you really think the uh
is good enough
wait what do they would use it's just
not encoder dqva I remember no but what
would you use again
oh yes
uh yeah our reconstruction all right all
right I'm glad
sorry guys one more question there for
you
uh what about your Global rollout what's
your plan pretty Global what do you mean
by global well you can buy it anywhere
it works anywhere uh yeah but it's not
being promoted quite heavily anywhere
um
we do zero promotion we don't do
marketing uh we don't do advertising I
mean unless you count this as marketing
a world of broadcast media advertising
made sense but in a world of social
media all you need it's it's you are not
it is what is your person for every
person who buys the device how many
people do they then get to buy the
device
um so I mean yeah there's things we can
do to make the European experience
better I don't know if there's anything
we can do about the customs
I mean yeah
yeah but uh yeah costumes is kind of
annoying but yeah I mean they're sold
everywhere and they're promoted equally
everywhere which is not promoted at all
right 20 of our users are uh of the data
we get in is not in the US so that's a
pretty decent chunk
yeah there's a whole bunch of your
opinions
that
that is pretty good
sure nice guys uh
uh order
I have a question concept validation
request
I validate you I validate you
uh
uh if you want to raise your hand in
this space and you want to talk
um any more questions from Discord
looking now well someone asks uh
the priest or Corolla confirmed to have
Security will jailbreak one
I don't know is it confirmed does anyone
even know what
but what
for all I'm Prius I'll do Toyota
security whenever anyone buys votes you
obviously do not care enough if you
haven't bought votes that's that's we
sell votes and a few people buy 500
votes well crack Toyota security
um
Greg can you see you guys want to share
anything Greg you want to share anything
about Toyota security you've seen you
want to talk about the auto encoders
gotta you gotta gotta ask to be speakers
um
what about your Global rollout multiple
people ask this like no no this was the
same guy here no no no there's another
person there's another person who asks
are there plans to expand to Europe like
we already yeah we're in Europe just buy
one are you planning to do an alliance
with a big car company and a lions are
you open to a potential acquisition look
if it helps the mission yes but no if
you get acquired by Toyota your Tech
doesn't go in Toyota you go in Toyota
all right I think that's what and then
you know all these companies
um you know get acquired by these
companies and it's just you just go to
die like a lot of these companies just
want to buy you so that nobody else can
have you it's terrible
um so no not really open to acquisition
let me explain how you make money you
make money by selling lots of small
boxes and then doing share BuyBacks with
all your excess money
uh
uh oh you see he wants to talk
you see it I heard the I heard the new
models look good
hey
um yeah the new
um the new VA models are good do I owe
you a computer
uh I think so can I not tell the
difference if you put two can I not tell
you which ones though
so the deal was the deal was to train a
model that compresses
images from our Fleet
um and reconstructs them
and they look completely similar and I
think the I think that was done
now this is going to be used this is
going to be used to together with the
Dynamics model to um to have a an ml
based simulator basically
no police is going to be better than our
small offset simulator
is uh do we have to make the bits a lot
bigger or same number of bits
um it's uh I think
it's uh four times Iris it's 4X the
number of bits of Iris
but Iris was kind of small it's it's
this it's exactly the same as the what
taming Transformer used
did I lose the mic no
what's happening
um
yeah for people listening the idea is
kind of
when you drive you can like imagine
driving you could do like rollouts in
your head you could be like oh I see
what's going to happen if like a car
cuts in there oh I see what's going to
happen when the light changes right
uh so even if I mean ideally eventually
we want the model to do that at uh at
inference time but let's start with
making the model do that at train time
think about what's going to happen
and then think about where you should be
yeah like like GTA like you can drive
around in imagination
and the world just keeps getting
rendered
well GTA has a map though
we can give it a month
can we though yeah I know
well I mean this always separates the
problem like great we're gonna make
Dynamics miles I think we make good
Dynamics miles maybe even ones that can
keep video coherent for 10 seconds but
then what do you use to what do you see
the policy
all right what do you use for oh it's
the ground truth
yeah I don't know all right
at the very yeah that's gonna be the
difficulty
I'm sure we can solve this I mean this
sounds like a much more approachable
problem than like cheating in the
simulator
oh yeah but don't you just have like an
evaluator that like both evaluates real
data and your data and it's like
this seems good
seems human-like
pulled good I could make a
oh
what has he had for Sarah yeah
yeah you're asking a question like
giving this roll out we've talked about
this before the problem here is if your
simulator looks anything different from
real data this model ball yeah it needs
to be indistinguishable to this other
model that that does that yeah
um and that can be done in the Dynamics
level it doesn't have to read on this
bigger level yeah I mean that's that's
normal that's why I'm so excited because
Auto encoders I mean also uh maybe it's
just because I'm bad at calculus but the
reason I really like the vqvaes is uh so
vqvae is discrete meaning it turns the
image into pretty much a sentence
like it turns each image from the drive
into like a
you know maybe a
16 000 word vocabulary in four words
10 words
uh hi Kale what do you got
um hey I finally figured out the spaces
thing sorry about that I I was watching
when you uh asked and I wasn't able to
but I got it now so uh question for you
guys too in fact uh your website and
listings for the the models that you're
your device works for it shows a
Escalade 2016 model
but I have a 19
would it would it still be able to
interface there and obviously I have to
get a harness made and all that good
stuff but what a 2019 model be
applicable your car have adaptive cruise
control and uh yep yep it sure does yes
if it has ACC and Outcast I'm sure you
can make it work
right cool uh I figured as much I wanted
to hear from you guys first and I'll
probably be getting one and then uh
second one is you know I got this kind
of
concept that would be cool I mean people
go take their cars and get stereos
installed or you know you go down and
get uh customizations this and that I
think that for the masses to adopt
something like this it would be helpful
for most people to be able to take their
car somewhere and have this installed is
that a concept you want to get rich yeah
that's what I'm saying um
well we need to purchase all a bunch of
your units at wholesale right so it's
right now it's 15 off if you buy 10 or
more
also that's cool actually means remember
you can charge a lot for that
installation service
right you could probably sell this to
people for three grand like if you
Market correctly it might even might
even be a subscription model also I mean
you could have it monthly so you could
you know or something like that
beats down for credit man
yeah
I run a business now I'm trying to deal
with all this bullshit there's actually
a lot of money to be made
um yeah hell yeah absolutely you know
people a lot of people come to me still
and they're like George you know I made
money you know in high school using the
jailbreaks and they would basically
charge money to run my Jailbreak on
people's faults
right exactly I mean a couple different
models there would definitely be
successful and uh would there be like
would you be able to reach out on like a
commercial side on a support like would
would it ever be possible to reach out
for support on not being a retail
customer you know why do you need me to
do this why can't you do this
not you I mean like the company if
possible I had a shit ton of units out
there and you know why do you need me to
do support you can do support now it's
five right five thousand dollars to your
customers
I don't deal with any of this uh it's
not really worth it like
at a like I mean I'm sure it's worth it
financially but again this just isn't
the kind of company we want to be we
want to solve this technical problem and
then go on to all other fancier
technical problems
um will there be a time in which you're
you're going to to want these products
Mass they're currently mass-produced but
is that the business model or are you
guys moving on from this being the the
revenue for the company the actual
device this is going to be our Revenue
stream for a long time right
I don't care who buys them you know
whether whether whether you're
installers buy them whether dealerships
buy them whether car companies buy them
or they're individuals buy them yep look
it's a very simple business model we
build a device for cheaper than we sell
it for and then we make profit yeah
remaining right like I feel like things
are so messed up in business today that
like this kind of like real one-on-one
shit is just kind of Forgotten look we
sell the device at 14.99 now they cost
us about about 8.50 to make
pocket the rest
yep cool I appreciate it man uh thanks
for your time and you guys have a great
one dude
Craig you have anything to share on
Toyota security
just not no does anyone actually use
professional stereo install Services I
think I see so many shops yeah I mean it
was probably like a thing in the 90s
and then like they're just still there
all right we got DG
got div's on here too
deep you want to share anything from the
from the to the hall from the from the
booth
DG you could talk a deep thought deep
thought speaker yet
oh how's it going guys I heard um I
haven't heard you talking about people
buying commas on wholesale and selling
it
um and you're saying make a profit and
installing it but my concern was
well people if anybody has done it here
has
has anybody come after them saying like
you know say it's a non-technical person
and they're and you insult him for them
are they gonna
has anybody come after you about that I
mean come after who's coming after me
yeah yeah no no not you I'm not saying
but I'm saying in some non-technical
person
if you're putting this in their car uh
you know they're not gonna they're not
gonna understand it and some people
might just think it's gonna make their
car just do whatever and of course you
could tell them it has its limitations
but
I mean we have we have multiple people
around the world already doing this as a
business where they they buy you know 10
units from Us sell them to people for a
price we don't even know uh and they
keep coming back so you know they're
making money
um as far as how you communicate with
your customer I mean that's between you
and your customer right
yeah that's that's that's true I was
wondering if people I don't want to get
to know legal things but if people have
like made contracts with customers
but that's I mean that's that's more
than that's other than just your
business that's more of the side
business people make sounds like yeah
again this kind of thing both legally
and
uh informally is a thing between you and
your customer right
like you can buy it you can promise that
these things will wash your dishes for
you and then you know the costumes would
be like but it didn't wash any dishes no
you know that's between you and your
customer man
guys thank you guys I appreciate
everything you're doing decentralized
the power baby thank you for everything
George sure
went away
deep deep was on and then he went away
nope no something happened at the booth
that must have been exciting
the Twitter space is still growing
hey uh George sorry I'm taking I'm going
out of turn again you ever going to come
back to Twitter
no I'm done with Twitter
poor poor t said what's the announcement
I didn't catch up someone said price
drop he said ordering now
nice oh Greg wants to talk
hey Greg
hey can you hear me yeah
uh do I have this set up right can
everyone hear me yes everyone can hear
you oh okay I uh do you want to talk
about Toyota security
I mean people were interested in that I
heard you got the firmware that's when I
yeah so yeah we got the
uh I've looked at the firmware uh the
first thing is is I I've heard some
rumors that like people thought that
like there's some solution out there
where like you can proxy
or like uh
you could basically like maybe the
Gateway or something does the the Seco
see
um verification Mac checking yeah and uh
that definitely doesn't seem to be the
case uh it actually doesn't even uh
doesn't even parse the parts of the uh
bits out of the message for searing
unless you uh get through the the Mac
verification inside the power steering
firmware
um so it does seem like you actually
have to uh
either modify the firmware or figure out
a way to actually generate valid Max for
the uh
for the can messages that you send I
heard that was all in software though
it's not it's not going to some Hardware
thing
that's correct there's uh you autostar
has quite a few spec documents out there
that you can read and
um they actually intentionally uh
and wrote this back using using things
that were achievable on very low end
Hardware all in software
if that makes sense
um and so so yeah the in the firmware
that I've seen it's all it's all in
software
um
uh so yeah it seems like uh seems like
there's a few options you know one is
always refreshed re-flashing firmware
where you know you you make changes to
to things uh the other is like figuring
out how to get the keys
out of the firmware uh it does have read
memory by address but
um they block important ranges
um and the Seco C spec says things like
you know make sure that you you know you
don't but do they have right memory by
address
uh they don't have right memory by
address no but there is
um uh I found two ways that you can
write the keys
so you can write the keys using routine
control and then they also seem to have
these special uh addresses there's like
blocks of addresses where like it copies
it all into memory and then once it's
got like a full value
um it'll use it the same way routine
control uses it uh to then uh write a
new key or overwrite Keys uh but the
problem is is you have to know a key to
write a key that's that's like how the
uh
uh the key updating works and so what
that means is even if you capture uh
even if you capture the keys that are
say you like use the Toyota tools to
record it updating the keys
uh what you have are encrypted keys that
are encrypted with another key on the
device
um so there may be some hope that like
every one of them uses the same key I
haven't actually found there's a there's
like multiple sets of keys there's a
I can't remember the names now the the
Seco C spec lays it all out there's
there's like a a master key
um that you can't change
and with the master key you can change
any key uh and then there's like four
other keys that you can easily change
and one of them is used for all the
messages all the Seco C messages uh and
so like this is possible it's possible
that the master key is the same on all
of them
um I think the I think the the master I
think all the keys have to be somewhere
in the firmware
and I haven't found them
um but well actually so the the uh
um the psycho speed or the uh the EPS
that we have
um it was never actually in a vehicle
and so the problem is is I think that uh
they never actually wrote any keys out
to it uh and I did find
three keys and they're like the default
keys or something like that and it is
actually using the default keys
but I think the real keys are loaded
from from like data flash or something
like that
um and so don't have all that figured
out because
um
it's it's I don't know there's some
really complicated indirection stuff
going on
it just isn't trivial to to understand
and I haven't spent that much time
looking at it but
um
yeah but it's not really good it sounds
like there's good progress
yeah uh the first thing that I found
that was interesting was uh
um I noticed that it actually doesn't do
any of the Seco see checking for like
the first 1000 iterations of some thread
so when so when the power steering motor
first starts up you can actually sneak
through a bunch of messages and it'll
accept them and and parse them out and
everything
um but it's not super useful obviously
in in itself but there also is a method
that resets that that counter
but I haven't figured out how you I
haven't figured out like a way to to
call resetting the counter basically
like it only does Seco see parsing if
this counter is greater than a thousand
or something like that
um and so so I suppose there's some hope
that maybe there's a way to find to like
constantly reset that counter
or um
um
or maybe there'll be like some some way
to get read memory by address like I
don't know maybe we can figure out some
exploit to like get read memory by
address to allow you to read yeah so all
the keys are in Ram so all the keys are
both on they must be persistent
somewhere obviously and then all the
keys are also copied into RAM then
that's where they're they're used at
runtime and so just remember by address
let you jump the firmware
I don't believe so the address ranges
are really restricted for read memory by
address so it is super helpful for
introspecting a lot of stuff while it's
running to figure out like is it
actually parsing out the the can
messages
um the Seco secant messages like how far
is it getting through the the parsing
process and so forth but
um
but yeah it doesn't like I believe it
doesn't let you read The Flash
um The Flash was read by
um
by by putting it into like setting some
pins to put it into the uh what is it
called the boot assist mode or whatever
yeah and then
um doing a voltage uh Brown out like a
voltage glitch to get it to skip past
the security check the the key check
um
in the Buddhist mode yeah I mean that
that was crazy that that woman got adopt
uh yeah yeah it was incredible
yeah no I'm sure I'm sure we'll figure
something out I mean I bet the master
key is the same on all of them and we
just need to figure it out
yeah it may very well be
um yeah we just got to get the master
key off one of the men it's all
symmetric right
yes it's all symmetric 100 love it and
the keys the keys are loaded the keys
are loaded in Ram so if if somebody
figures out a way to uh
you know to basically bypass the the
read memory by address range
restrictions you could also easily read
the keys out of RAM
yeah hopefully the master key is all the
same what we do is we just get one into
flashing mode we re-flash it with a
patch tree memory by address read the
keys and stuff
well but then you have to change the
keys the problem with changing the keys
so the master key is only used to change
other Keys basically
so the problem with changing the keys
you could definitely change the keys but
the reason that changing the keys isn't
super attractive it's because then the
stock system won't work anymore unless
you change all the unless you go through
all the ecu's and also tell them about
the the key that you're changing it to
which is possible I guess you could
reverse engineer the whole Toyota
um you know update key update processor
I'm hoping that there's going to be some
Flags somewhere maybe that you just said
it disable secure C verification
yeah I've looked for that pretty hard uh
and I've got like a lot of the
configuration tables reverse engineered
really well uh and willem's done quite a
bit of work looking into it also and we
haven't found any way to get it to
bypass the closest thing I found was
that counter basically that it ignores
um the uh this Echo C stuff until you've
incremented it past that that magic
value of a thousand or something like
that yeah
but so yeah so that's unfortunate but I
trust I trust we'll find something
um or we'll just maybe be able to I
don't know I'll look over the Seco so
you think maybe there's a way to just
attack the algorithm directly
yeah potentially I mean there's a
there's a Defcon talk out there uh that
I posted in her Discord a while ago
where the guy says like this guy from
Intrepid systems or whatever the company
is he says that like he was able to like
you know like you record enough traffic
and then you could potentially
um
essentially like brute force it or
whatever uh or build like a rainbow
table or something I'm not exactly sure
what he was describing I don't really
completely understand how that works
um but
there may be some opportunity to do
something like that because uh what's
interesting is
um the freshness value and the reset
counter it always reads them from can to
start
so there's these numbers you know that
are that are passed in to
the hashing function
um as kind of like assault or whatever
that are the the uh
uh numbers that are always supposed to
be incrementing the the trip counter is
never supposed to roll over essentially
it can but it should take a super long
time because the trip counters every
time the ECU power's on and then there's
a reset counter that resets more
frequently
and the trip counter it reads off can
every time so like I also kind of feel
like yeah maybe there is some
opportunity to
um
have it be more deterministic you know
what what the values are that
um like like what the
the signatures are for
um specific messages and be able to do
you know kind of like essentially a
replay
type attack
if we have rainbow tables that we have
on our servers we can only include it
with comma Prime
yeah
you wanna you wanna get the key to your
Toyota you got to buy Super Pride 44 a
month
yeah um yeah I don't know I mean we'll
see we'll see how many uh
yeah I I hope something like that's
possible
yeah I mean there's no question that you
could that you could reflash the
firmware and uh and uh you know adjust
the
adjust the uh
whether or not this Echo C stuff is
enforced or not there's a there's a
there's configuration tables that
contain what address is
um
psychody applies to and wait there's
like Flags how do I reflash the firmware
do I need to take the thing out and
glitch it
I don't well no I mean you can you can
definitely Flash The Firm wherever it
can
um I haven't looked super deep into the
firmware flashing so the thing I don't
know is uh I think the firmware might be
encrypted but again
um the new Toyota sure the new Toyota
stuff is all encrypted when you download
like Q files and stuff
I see yeah uh I don't really know what
it's encrypted by or how any of this
stuff works but I know that I downloaded
the Q files for like the uh the the
secrecy cars and
uh it was all encrypted
yeah
so yeah reflashing the firmware isn't
super attractive but that might be
well like one one way to potentially
reflex rid of the yeah reflashing the
firmware is a lot better if we can read
the initial firmware but I'm sure those
keys are in there like I'm sure the key
is to decrypt the firmware are in the
other firmware
right yeah and it is I don't think
anything I don't think any of it's
asymmetrics I think if we get it we can
just
you know encrypt our own replacement
firmware yeah and uh yep happy to you
know all right maybe that's the first
firmware flash we released
yeah but yeah once I found the the
default keys in the flash uh in the
firmware dump uh Willem was actually
able to
um
to construct uh
to construct valid Seco C messages and
get it to parse them oh cool so
uh so yeah that's pretty cool great
guys yeah if there's some way to there's
some way to read the keys it's it's yeah
we got it I mean I don't know that seems
like the best the best option for sure
there's some way to read the keys yeah I
mean I I've looked these things just
usually don't have like arbitrary read
exploits in them
because the surface is so limited but
maybe
yeah
yo
yeah and there's no there's no uh I
haven't found any
um
xcp or CCB CCP like the calibration
protocols that they that they use to
like live tune I think these things
while they develop them where they can
like arbitrarily read and write memory
by address
um I haven't found any right memory by
address so Toyota has so much weird
stuff
like Toyota has so much I remember when
I was looking into like these this smart
DSU Knockouts there's like so many
layers of of different firmwares and
those things I wasn't even sure if like
it was almost like like there might even
be a hypervisor on some of these
yeah yeah I don't know I
don't know but uh yeah it's great sounds
like there's great progress to everyone
in this Twitter space you just got the
best update on Toyota security you've
ever heard
uh and uh yeah if you guys buy votes you
know we'll get serious about it
uh but no I mean it sounds like it's
there yep it sounds like yeah it's a
I think we have a pretty good
understanding of it now at least
um
so good stuff
all right cool I think we'll leave the
Twitter space there thank you Greg thank
you scene
uh
the fact did you did you want to talk
move thanks a listener
oh I really got everyone we got we got
everyone adeeb showed up for a minute
the whole crew
uh
no I think that's I think that's the
tourist place all right thank you guys
uh make sure you buy comment threes
otherwise I'm gonna get fired and the
price is gonna go back to uh 19.99. uh I
think it'll be like bad marketing intern
why'd you lower the price it was
terrible
uh because we didn't sell more devices
uh so make sure you buy make sure you
tell your friends uh no now's
legitimately a great time to buy this
product uh this is the first one it's
like it's like good another common
threes and the comma 3 is coming off the
line right now are like good
you know you should have seen what a
shit show comma 2 production was uh even
commentaries in the old office but in
the new office like we have like a whole
lot we have four full-time production
people you know they're just they're
just building really good devices uh and
now they're cheap so you guys about it
all right thanks everyone for listening
well I have a periscope so you know this
if this secret click click yeah you guys
better not right Scopus you know what
no no YouTube live stop it stop it ok so
you guys remember how the Twitter said
that it was scope e100 was matching
lowest price ever a just terrible
marketing you just lie to people but B
that's even a lie so yeah no no the new
product is not a giraffe I swear it's
not a giraffe if it's a giraffe I will
give each one of you one of the new
product but it's not a charity don't get
me out the Chavez discount didn't work
I'm sorry we have a discount that does
work though I know we might have lost
your goodwill but guys October 1st is a
new product but no Whitney pilot no
that's just it no if you don't like
weekly pilot revert to the old one
that's it it's not a beanie it's not an
article of clothing guys we're not
guessing about the new product all we're
saying is you're not gonna be let down
if you buy this for 599 dollars right
now that's $100 off you can buy an eel I
know it's like hard to keep the hype up
with the new product but you won't be
sad I'm not showing you the new product
I'm showing you the new product Monday
yeah I know who let the research guy
into this dark ricardo's on vacation so
you know about giving out any more
beanies but if you don't like Wiggly
pilot I will I work on a weekly pilot
the current product has two cameras
yo mano next Monday Monday is not today
today's Wednesday I don't know what
you're thinking bro I understand you
tried to trick me I know that one if you
want to take it Yan off the shelf and
show it to the scope ease show them what
they could get for $5.99 guys come on
you got a Bible you see over there
there's actually all the eons left is
today Thursday
look at that er yeah I don't know how
I'm holding it yeah yeah daddy one could
be your yawn if you buy it is for $5.99
you can put weekly pilot on it could use
a veteran's go peace well I sign it
should we sunshine all the last of your
boxes know one of the dollars more if
you buy it right now without the coupon
I'll sign it the EON how reliable is the
Aeon yeah you buy another one that's a
great choice get one right now $5.99
Dulli on technology get more yawns
buying Aeon for your friend I know it's
a little early to start thinking about
it but eons make great Christmas gifts I
gave a neon to my dad for Christmas last
year real shit chase you can't be too
broke for Eon is $5.99 with discount
code slack e100 slack e100 buy any on
all right so my phone does not much
battery so we can't move too far I'm
using brows I'm using a Lego charger for
my phone check it out it's late charger
alright
but um you should buy more because see
that over there that's all the eons we
have left you see those for midnight
blacks they're not even for sale over
there are the last 22 eons in existence
also if you want pandas we have a lot of
those please buy pandas pandas are no
longer on Amazon by the way because fuck
Amazon
why all laugh because this is it this is
all the eons that are left you can't
trade pandas for eons the last thing I
want from anybody is pandas do you know
how much pandas we have so much pandas
you guys the October one product
replacement we're not here to talk about
the October one product we're here to
talk about the lowest price ever in
history on eons
can you come make some more well it's
not gonna be more you gotta find them
now dad I'm good wiggly pilot very
divided whether people like Wiggly pilot
go say a few words to him say a few
words Pam just provided yeah we'll give
you pandas for $92 panda you can buy
lunch I'll just go oh man look at that
box of pandas we have everything what
else can we show you have pandas Toyota
dress on the giraffes gray pandas powers
go all right here debug boys return to
yawns we have more in the bench the last
are these t-shirts
these are XL t-shirts and smalls Wow oh
there's this babe stickers get some
t-shirts all your attic guys we have me
to do it means oh yeah by some guys yeah
you don't get these stickers though
these are now this is recover three Apes
showing what we got for press that we
didn't use what we got for precision
you mean the product that we worked on
for six months and then cancer oh yeah
oh yeah we can show me we gotta the car
absolutely yeah yeah you want to pull
out a big kama yeah no we can't tell you
stocks unless you're accredited investor
yeah look at that side of that come on
you guys
it turns out cars aren't magnetic though
the court is magnetic um you can't buy
big commas but you can buy eons for $100
off with promo code slack II 100 $100
off tell us about 0.54 I don't know I
don't work on that I'm just here to
shill tonight slack e200 whoa whoa whoa
chase do you not have any on what's up
with the freon man Accord is magnetic
ever just so kill me if I told you guys
I'm going to Singapore a real shit but
um what else is real shit is eons and
you can buy them for 100 oz off look you
could have this see I would not dis dis
Yan you could really have they look like
this here and look at this Eon it's busy
on here it's not gonna be yours because
it's ours but they all look just like
this one we promise cuz we bought it
from the shop we go to the shop to you
know what else we bought from the shop a
panda paw rare the rare red paw you know
whatever purple all purple paws are
there gpause those are real crazy like I
said check it out gray pandas these ones
work yeah
someone by your pandas yeah so we buy my
damage we have like way too many are you
gonna have to take out a second mortgage
to afford the new product no no don't
worry they're gonna be let down by the
new product it's a giraffe giraffe
no I'm kidding I swear it's not a
giraffe giraffe it comes in a box
do we have an empty box that we could
show them to get them hyped for just the
size of the product what just the comma
side of the box is one of my desk over
there what oh yeah yeah guys you want to
see the box oh yeah look at that box
that's the box the new product comes in
but you should buy a neon talking we're
just talking what other guys in research
was like you know I've never even used a
giraffe but it sounds like a shitty
product stop trying to sell things in my
channel okay
slack II one hundred the Box justifies
the price you don't even know what the
price is that's not to be announced yet
is it another animal name it's not an
animal name it's not clothes and it's
not a giraffe just what you know and you
know the box there's no more hints for
the product you have to wait till Monday
we're getting more box you want to see
more box no um what we might do them
we're gonna scope you Monday viv is
coming for that we're gonna present it
at a real presentation with journalists
and this coming and she'll scope Ian
today's not Monday stop trying to trick
me no but you guys let me tell you about
the new product we have 22 Young's left
and if we don't sell them there's no new
product we're delaying it
I don't know if they do product in the
unreplaceable no no um put it this way
you won't be upset if you buy a neon
unless you're very caught but I
shouldn't say anything else guys you
can't me to give away so much secrets
you know I love giving away secrets the
new product goes on sale once we sell
the 22 EOS or Monday and by that I mean
just Monday but if we don't sell the 22
eons we're cancelling it and you'll
never see the new product um you're
assuming you'll get a new product if you
buy a neon will new product be sold on
Monday I can't talk about any of that it
could be a pre-order it could just be
hype it could just be the box it could
just be a box for your er pretty good
product right
it's yond you fold it yourself it comes
in a big envelope it's an eon carrying
case box yes okay maybe it's the big
comma maybe we actually know you can't
buy the box now because on the other
side of the box it says what the product
is so you can't do that Eon XS max even
10's max um yo I got a red case for my
iPhone last night I went to the Apple
store and I was gonna buy an iPhone this
is true story Jeff at the Apple store no
I went to the Apple store and I was like
waffling we got there at like 7:40 and I
was like should I buy the frame I was
wobbling what should I buy it shouldn't
not okay sorry Skokie's um should I buy
it should I not buy it should I buy it
should not buy and eventually alex is
like heard you're never gonna be happy
if you don't buy it and I was like oh
it's will I ever be happy no matter what
I do and she's like that's a good
question but we agreed to buy the iPhone
the time was now 801 and they're like
it's after 8:00 we can't do live phone
sales after 8:00 what's under their
clothes hey so
so yeah I didn't buy the iPhone but you
could feel my cases so I just plug a
case for my iPhone X and like I think I
just pretend that you're not blocked I
can read you they close at 8:00 you have
the Apple on Chestnut Street and then we
went to the beach
you're not blocked it's like buying beer
in Utah yeah I know real shit
pedalboards it Awards no we don't we
don't send pedal boards out oh you
shorten pedal boards no chase chase ones
cuddle for a civic guys you know what
this is it's the inside of a but ya know
guys you got to buy Aeons come on
they're $100 off tell your friends it's
a perfect time to get started and buy
yawns chicanery system decision who'd
you sell it to
did you tell them it was broke can we do
some research into a honda eps hack now
do machine learning you guys are
dangerous that's right do it do it
Oh if you come work here you get EPS
hack to tell your friends tell your
friends to apply for a job for hire
you can verify you repair panda all
perfect I'll chase you or you work for
us your printer Jase you're working hard
back there right now you want to go look
at the printers I think we might have
enough battery car we are hiring check
out our hiring page thank you for the
super heart can you be tools and you do
know things about tools in firmware
firmware engineer leave firmware
engineer
I'm totally autos without hybrid you
stop and go you have to ask walks or for
his Toyota pence yeah we have the great
coffee together Eddie yeah Eddie makes
great coffee cold brew cold brew which
car is the most torque
to work with a lag get you on - by Neal
and I keep slide what black thing Oh
block the phone some slack
maybe I'm gonna slide later I sure got
the iPhone access I think this yeah
alright guys but this is a slide pretty
easy on these these are rare one of the
cranky on you'll be able to sell just a
box on ebay someday when we're rich and
famous get some get some these could be
yours
some people have signed boxes get me so
all I did side things are the two of us
are we doing the two it this year maybe
you know guys you really you gotta buy
yarns they don't buy any Elms yet no
refresh
no no body yawns come on guys
there are a hundred dollars off you're
never gonna get a better deal than this
on me on because on Monday the new
product comes out
don't buy a shirt yeah buy a shirt what
we'll shout out yeah placed an order
tell her I put buy things okay I'll sign
one of the scope e this e one will be
signed yeah we have a nice marker for me
well I have a Sharpie in there cubby
we're getting a sharpie I'm gonna sign
the back of this box whoever buys the
next Aeon gets this signed yawn I'm not
signing your damn shirt they're only 20
dollars all right I'm gonna sign it real
nice geo ha
guys if you buy this neon I signed it
what sign inside of you
I'm gonna yeah one sign in this eon
whole common team
check out this eon whoever buys the next
eon gets this one signed Georgie boy and
I'll buy it if you assume you won't buy
it and then I'll sign it
I want to face it with that shit what
model is it this is a 64 gigabyte base
model Eon it's the only Eon we still
have for sale everything else is sold
out so you can buy this Eon right here
you'll buy too if I give you an
interview yeah yeah bye - and I'll give
you an interview right now yeah go bye -
right now we're gonna do it I'll give
you an innovate but don't have to do it
in person if we do it on the phone right
after the scoping in phone right after
this Gopi let's do it I'm seriously down
I'll talk to you about whatever shit you
watched by - yawns oh he says he bought
a shirt who bought a shirt no you can't
buy midnight blacks they're sold out
yeah look did you buy a shirt yeah he
bought a shirt
oh let's uselessness only $20 that
literally cost us more to fulfillment
this is a midnight Blacky on but you
can't buy because they're a stop just
for us you're just for us thanks Tyler
thank you for buying a shirt no we
really do appreciate it every little bit
helps
you know guys we're trying to be a
profitable company otherwise Karma's
gonna go away because we're never
raising money from scumbag venture
capitalists again hope the venture
capitalists are watching they know this
complex but you get this nice signed
yawn oh you want a job interview oh yeah
email give me a job at come AI goodbye -
yawns - pr's and asked me if like how do
you feel about the security
of we don't know like I'm okay with
trading media attention for hype we're
for money the job interviews we can't
take that process
that's like bribing a judge can't bribe
judges for that but we can certainly
bribe judges for media interviews that's
fine because the media is corrupt that's
right
and will be corrupt just like the media
if it means we're rich they won't buy
anything yet
well we can let's watch it live on the
analytics oh yeah click analytics for
visitors right now who's checking out oh
we got four people checking out yeah
yeah by that beyonds you'll buy there me
owns two purchased oh I love watching
these numbers go up Chase bought a shirt
so chased by a shirt look there's an oh
there's an order
yeah whoo two shirts but on the shirts
you wanna buy a grape and a antenna
mount anybody check out these grape an
antenna mounts you can buy one it comes
with a grape and a 5-second can't buy
them separate no no sweatshirts are
never coming interview you know what we
have a lot of now comma power yeah yeah
we had a well guys want comma powers if
you're having errors with your Toyota
make sure you buy a comm tower or a boss
Honda we don't run a giraffe's soon yeah
no we're almost out guys better find
your house now why no PayPal Bugsy this
Bugsy find in New York oh yeah by that
young
no we don't have played throw sorry we
might have not a flame thrower
not a planter that's possible that's how
I bought one you bought enough like dark
then I canceled oh are you sure bring
it'll work
wait usually the scope he tells me how
long I've been scoping for I'm something
this doesn't tell me guys how wait we
can just check Twitter how long Elevens
go being for this is not going more than
30 minutes I'm a South Park to watch 21
minutes guys this is an ultra rare white
yeah
one plus three you can't buy this one
but you can buy an eon probably Bugsy
yeah leo boards this was that eyo boards
the South Park on tourists a hole there
anymore boards from Neos we have a lot
of doctors oh oh man I don't even know
about your closest person's name out cuz
they might not want their name said
publicly but we just solved an ER woo yo
that's Lackey 100 you're getting the
sign Deion I'll sign another on if
anyone will buy him there are no
shortages of pause if anyone would like
pause here's 200 pause to set to pause
[Laughter]
$99 comedy bugs you can buy that with
the money you save on Annie young
debug ridiculous product they haven't
seen how many shirts you need to buy for
you to send me the new product instead
well we have a lot Bansi before yeah
that's worth now that might come back
[Music]
here's a moto G smartphone yeah the
latest it's just a normal Moto G
smartphone there's nothing special about
it
it's always signing another one yet mark
will sign them right now it's good man
yeah bye guys bye
yawns was the with a sharpie oh yeah
watch this one you're gonna sign a.m.
drop no it's not a giraffe I told her
it's time to wrap no not yeah band the
bots oh the size of that signature you
want their service box change oh well I
know about that did anyone reply to that
by the way no cameras okay you can get
the large signature key on get that
large signature Y on right now buy that
shit we'll keep them like this is the PI
almost shipping like that order yeah
remember just purchase large thickness
garlic we just saw neon I think so
oh my god we saw two eons wani are now
what was $40 wait wait the orders are
pouring in oh man oh we're selling he
owns like crazy
yeah yo I'm so happy with all of you
thank you for buying me on
all right I will sign one more I will
sign one more except instead of signing
it we're actually just gonna put a dot
on this one dot no no no I will sign it
if you'll buy it but it only is a small
signature the big segments just sold out
it does come with a dot though
what are we gonna ship uh tomorrow yeah
we'll ship if you buy eons we will all
the ear insults and I can find anyone
who buys a neon wall this periscopes
going on will sign it will give you $100
off and we will ship it out to you
tomorrow
[Laughter]
well start we'll start all the unboxes
to go out tonight yeah if you missed a
sign to yard yeah you know that's just
the way the cookie crumbles
[Music]
guys we're at $1,700 in sales today keep
buying eons
when's the Aeon end-of-life date don't
worry about that how about this I will
tell you this the next product is
completely compatible with the Aeon so
we'll run all the same software as the
Aeon so no big deal there don't worry
about like any other end of life there
will be any on end of life but it's not
this problem so don't worry about that
if that's if that's holding you back
from buying a neon in fact the Aeons
will work a little bit better for a bit
cuz we got to try new models am I still
living in the home office can you buy an
e on board no run it better or worse
it's compatible it's very compatible
indoors to live here yeah I love
upstairs guys we've got a cup by eons
but how much time is dependant 30 miles
is Kobey's 27 27 right we got three more
minutes come on oh no the reading fixed
families are there does anyone like
watch these and see all the secrets that
are revealed for young cool right no no
no no no but but get in right now buy a
neon buy stop with so much stuff what a
great panel we have gray panda deadness
great panda this one could be yours
well sign gray pandas we will sign the
Aeons how hard is to get the CEO
position so easy I've never been happier
bros but I still do the scope he's some
of them all right guys could we get one
more ye on sale before the periscope is
out was having Elsa no oh he gets big
signature oh he get big thing is your
guy and you got gets double signature
you're welcome thank you thank you
people we love it when you buy eelain's
you won't regret your decision you might
regret your decision I don't know if
you'll get your decision yeah I'm not
taking paypal absolutely not
after what they did to move out Jones
that's never PayPal again I hated PayPal
for a long time people took PayPal stole
$10,000 from me once so we're never
using PayPal mafia
yeah PayPal mafia yeah I'm not using
Ilan wool shit I'm okay though actually
the worst if you've ever tried to work
with them Amazon is terrible as well we
use Shopify for payments shop finds
great love Shopify oh yeah no I I got
like a hundred K in donations in Pape I
was like working a freeze 10k event like
can you unfreeze it and they're like no
so it was frozen for like two years
until I kept complaining and then they
unfrozen
please ship your panda please I need it
urgently yes
huh my Twitter stock doing I don't know
we could check my Robin Hood yeah I did
show that hey wait that's a twitchy
thing alright it looks like who we gods
is what we're selling right now guys
that you know the the discount it's not
gonna last forever the discounts gonna
go away on Monday I got donations no no
no that was donations for a black rain
there's donations for black rain when
PayPal took ten of my thousand dollars
um they did let me have my lawyer
donations they're not that much of dicks
can't watch my twitch do you should
subscribe to my twitch I love making
money on twitch um but I also love
making money on Skokie's so make sure to
buy it you all right thank you all for
watching that's all bye Skokie's new
product announcement on Monday it's
gonna be crazy
you just like the fire festival you know
it's gonna be it's gonna be crazy
big big leak that's so weird all right
back
what up guys is Kobe town
oh oh you saw the the Android kernel a
eco all the leaks and found the leaks
alright let's just yo black people we
judge on test now
alright so I've had a chance to watch a
few of your videos and we're gonna watch
them with you and we're gonna look at
them now you guys know what the judgment
criteria was we can
a can of a fair contest without rules
don't smash your tennis racket on the
ground video theme is increasing open
pilot daily active users so that's
really what we're looking for we're
looking for videos that are likely to
increase the number of users that open
pilot hats so if we're going straight
off of likes it seems like Dewayne
LaRose won with 14 but we can't do it
just based on likes how fair would that
be
especially since two of them got
retweeted and the time needed was
different okay so who do you guys think
won say say say me uh in the in the
periscope comments who you think we
should give the prize to and maybe I'll
just agree with some of you and then we
don't have to judge anything that would
be kinda nice for it uh Jeffrey Nichols
is that you you can't say your own name
you liked Chris's the one who used it
safely okay so we have Jeffrey Nichols
we have Chris's we have mr. Kaul we have
another vote for Chris I let's watch
Chris's first right here open pilot is
an advanced driver assistance to
surprise Winky pick a function from this
to this as well as provide smoother and
safer radar adaptive cruise control open
pilot allows you to be driving
hands-free and feet free for long
periods of time without intervention
even more so on interstates and highways
look it's Canadian model but how does
this all work you need three pieces of
hardware all bought from comma a I slash
shop first
the giraffe this device look at my
watching the product I like into a more
Universal port for the next piece of
hardware which is the great panda panda
you see I'm not I feel about that ant
could also send information as well
James today tomorrow man Sharp's is
speed up slow down and turn the wheel in
either direction it also has a
high-precision GPS antenna used to
create HD maps as you drive finally the
e on this is the main device that drives
your car first plug into the panda then
mounted on your window look at that nice
long gate your car an existing radar
information which shows exactly how far
away the car in front of you is cut into
it for speed up its prey Pro guys it
also has a high quality camera that
looks for lane lines in the road and
tells the wheel to stay exactly centered
in the lane lines at all times as an
added bonus it is also a fantastic
dashcam with free unlimited cloud
storage open pilot runs at Honda's
Toyota's Acuras Lexus GM in hyundais
with even more car support being worked
on every day and the best part
altogether this setup costs less than a
thousand dollars checked up your
existing car is compatible then go buy
an e on panda enter app today and
upgrade your car to the future
alright so that's that's that's
definitely a contender for the price we
did get a few votes for mr. Cole's video
now we can't really judge it based on
likes because I didn't retweet this one
I didn't actually see it heard of
self-driving cars
they'll drive us from point A to point G
don't learn how we look at those Tesla's
they look pretty nice he gets a point
for nice looking tests how can these
self-driving cars learn how we the
majority drive and only the wealthiest
minorities
[Music]
and the best part is every time I Drive
a pilot today you don't need the 88
Tesla the way Moe or the Cadillac ct-6
and it's ready to start making driving
safer it's not an IRL I've been testing
oh he's sitting in the chair first check
your car's compatibility by heading over
to thanks for watching mmm give Baseball
America's past-time that's that's
exactly how I feel watching this 343
views 581 views mmm
okay all right who else do we have as a
contender who's a serious contender I
would say as far as actual information
goes Chris's does does win out um I did
really like this video I think that the
execution wasn't quite there but I
really liked the concept ideas for ideas
for future like so once I'm here I don't
know which ones open pilot and which
ones the original um it would also be
cool to see a counter like counting up
every time they make mistakes so this
video certainly gets an honorable
mention for concept and if we have
another video contest clean up the
execution
look yours Danijela oh just box I hate
the bots alright what else we got here
what was this is this over bah what is
all this stuff steering and acceleration
it integrates directly with I don't
think it's unsafe for the camera to be
held by the driver if that's your say
and radar system nice great panda magic
it's not unsafe guys
the car in front and automatically break
it will detect the car to the left and
overtake when we're judging the video
contest who do you think won we watched
virtually Chris's and mr. Coles they
were both very good yeah see what we got
here he also talks you so I was born I
do like the music choice
the 360p leaves something to be desired
nice iPhone X advertisements
[Music]
okay guys any any any last videos to
watch Oh video contest judging wow
that's so exciting what's going on Wow
hey I don't know if I'm blaming Europe
I'm blaming Twitty oh can you package
this as a rearview mirror with no but
you can all right guys let's let's put
it's either gonna be Chris or mr. Cole
let's let's put them up next to each
other side by side right here look at
yours but it's not a winner all right
all right guys I think I think I've made
up my mind I think we have a winner I
think you guys already know well
splitting the pie what is that man it's
not like everybody gets to get high no
I'll split the pot
ha yes yes yes yes she says oh and and
and oh wow Wow I gave I gave a great the
winner
what is open pilot by virtually Chris I
love the product shots
I love the touching look look at that
touching of the product look at look at
the touching oh it's so good yeah I know
this show it's falling apart it's old
I love the touching I love how it shows
off all the products mr. Cole you are
the runner-up I love how the chair is
brought through the whole video here's
the chair or was the scene when you sit
on the chair all that is a great that is
a great scene I must say for artistic
purposes we give it a mr. Cole but our
product our conscious is of course the
theme is increasing daily active unit
users so so it is it is virtually Chris
for the win we will be hooking him up
with $1,000 1,000 should we do cash we
get $1,000 cash no way no way we can't
do that the tax man gets angry $1,000
for the win and mr. Cole you will be
receiving the last the absolute last
ultra-rare come a IBT reach out to
support a common AI with your address
and Chris will get a check and mr. Cole
will get a beanie okay thank you for
watching
periscope where we judge the video as
promised we deliver on our promises
speaking about promises we got HD maps
by the end of the year we're gonna get
to 1,000 daily active users and okay
final two of us in their October first
new product announcement by eelain's all
right thank you very much
welcome to the second-in-command podcast
produced by the CEO Oh Alliance and
brought to you by its founder Cameron
Herold in the second-in-command podcast
we talked to top CEOs who share the
insights strategies and tactics that
made them the chief behind the chief and
now here's your host
Cameron Harold Vivian Ford is the senior
vice president of operations at comma
dot AI based in San Diego most new cars
on the road today are built with
features designed to assist with driving
but failed to deliver commas open source
software open pilot enables your car to
steer accelerate and brake automatically
in its lane it's easy to install and
trusted by thousands of drivers with
over 10,000 miles
vivianne previously worked at East WA
communications for one year back when it
was six people in a garage in San
Francisco so Vivien I am really looking
forward to hearing what you're working
on and welcome to the second grand
podcast so tell us just a little bit
more about comments that we understand
kind of where where these devices are
being installed or how they're being
installed in cars what kind of cars are
we installing them in because I'm
especially excited about autonomous
vehicles yeah totally so basically
Thomas sells a hardware development kit
that works on existing basically 2016
and newer Honda's Toyota's Subarus whole
range of supported cars we saw this
hardware that runs our open source
software so back in 2017 the open
sourced this thing called open pilot
which is essentially autopilot for
existing vehicles so a driver assistance
system that takes you on the highway and
will on the highway will drive you 90
percent of the time and then when you're
doing you know back road driving you
obviously take over and so we have
thousands of cars driving with both the
the comma E on and open
and we have over 10 million miles of
driving data collected and our yeah just
working on upping that number and
getting more and more compatible cars
and more people with the system in their
car unbelievable ok so this is a
third-party software then are you
starting to license this software did
any of the car companies are you just
selling this as the connector market
addition to vehicles so so the software
yes the software is under MIT license so
we open-source this on github if someone
wanted to go and build a system that ran
the software and then sell that system
they'd be completely entitled to we are
we basically just sell to whoever wants
to buy it if Ford wanted to buy you know
a hundred common ions you know that the
hardware and install it in their
vehicles they could go ahead and do that
you know we don't have a business
development department we have we have a
website with an order now button and we
will fulfill on Mondays and Thursdays
Wow ok so I I was 10 years ago I wrote
in the first Google experimental car at
Ted I was at the main TED Conference
sitting in the audience and someone from
Google came out and talked about this
vehicle and then they showed a video and
you know I'm sitting beside Jeff Bezos
Bill Gates is in the audience and
they're talking about this car that none
of us had seen I don't think very many
had even heard about it 10 years ago and
then the the person who's doing the
demonstration said by the way if you
want to drive in it it's out this door
on the parking lot and 1800 people stood
up and went running and I got to drive
it and I have a video on my laptop of me
driving in this Prius 10 years ago with
Mort Matt Groening the founder of The
Simpsons was beside me in the vehicle
and we drove on a test track 10 years
ago at 45 miles an hour and I was just
going holy like this thing is
extraordinary
yeah and I've since owned to Teslas I've
been driving them now for years how
how complex I got so so MIT labs
developed the software and then you guys
are third-party licensing it or did you
develop my choice yeah we developed the
software it's under MIT license but we
did develop a software and so yeah
basically we you know we maintain the
software the beauty of having open
source software is that one you get a
community that can contribute to it so
there's so many you know there's so many
makes and models out there that are a
little different and how they run
and so when you community member that
wants this to be supported for their car
and if they go through the effort to you
know send a pull request to have their
car supported and merged with you know
the next version of open pilot like
that's fantastic you're building
community of people that are you know
actively working to basically like it to
you know to push forward the technology
and also a beautiful thing about the
open-source code is that code is you
know anyone can if anyone's concerned
with the code they can go and read
through it they can you know if there's
safety concerns or whatever to some
extent code is speech so they can go
ahead and have their you know have a
look at everything we do and decide for
themselves if this is something they
want to put in their car instead of
getting into you know like a I don't
know a Honda Civic with the lane keep
assist system and having really little
idea of how it works and just kind of
you know trust and get and engaging it
and seeing it for yourself you know how
it works on the road and so why am I
scared of this why is this got me work
with the open-source idea that somebody
can just download this and put it into
their car why is that scaring the hell
out of me when I went again I've been
you know I drove my Tesla Model 3 from
Scottsdale to Vancouver and let it drive
2000 or the 2200 miles on its own but
this scares me for some reason what am I
missing
I think there's a couple of reasons that
these is scary and the first one is that
any time there's a autonomous vehicle
accident like it is so publicized it's
publicized until people can just you
know get
single blast click on their story
possible so we have so so many ideas in
our head that like these systems aren't
safe or you know oh but did you see that
you know this auto pilot accident caused
this issue whereas it's like sure along
with that article what if we also
publicize how many people die just by
driving a regular car that sertoli yeah
I think there's that level that's a
little alarming the open source code I
think also scares people because I don't
want to say that any of like the worst
like responsibility is the hardware to
place in this situation but Minh dove
like hey take a look at our code if you
like our code then maybe you'll you know
want to explore and experiment with it
and and and see how it runs with your
Honda Civic and so there's like an
active active like exploration phase
that the driver is is using because
they're downloading this code from the
internet and they're they're trying it
in their vehicle as opposed to kind of a
black box delivery of you know Tesla
autopilot here you are take a drive but
we're like where are they testing this
oh they're downloading the software and
they're just throwing it in their car
and they're going for a drive around
Scottsdale sure yeah I mean we have we
have millions of miles of driving data
from this we have hundreds of YouTube
videos of people driving around with the
system so well where are they testing it
like they're you know it's it's better
testing almost than any other
self-driving car companies product
because they don't even have a product
really you know like there's only so
many I mean part of the big issue too is
like there's so many edge cases with
drivings that it's impossible to to hand
code all of the edge cases of driving
George I think it like Elon Musk had a
line when we first came out with the
system and he was like you know sure 99%
of this is easy it's the one percent
that's really hard right but when you
try to capture all of the edge cases
like way mo with like I don't know what
their fleet is let's say their fleets
like a hundred cars or whatever
but that's still just that's not gonna
get you all of the edge cases and so
when you're just relying and depending
on you know all of the the all of the
data from your own cars as opposed to
kind of like decentralizing the data
consumption and getting data from people
all over the world you know all of a
sudden you have a much more like fully
packaged kind of you know data
exploration to go whether were there a
lot of legal hurdles in getting launched
or getting the product out the door
certainly so yeah I mean we we got a
letter from the National Highway
Transportation Safety Authority back in
2016 and so I yes so so we we actually I
think I think the open source in 2016
who knows the years are all the same but
regardless they they were concerned we
had announced at TechCrunch that we were
selling this product with open pilot on
the product and that this product was
going to drive your car I mean it was a
lot of hype the product can't drive you
know nothing can drive your car you
still can't sit in a self-driving car
everything driver assistance system
still level two and so there was
definitely you know I think similar when
you ask why am I scared of this there's
just a lack of information around a lot
of this stuff and so a big thing with
open sourcing it's like how do we show
the information how do we you know how
do we just like yeah explain like what's
going on and and and publish more of the
information publish more of the data we
definitely tried to do this with like
more medium posts we've tried to publish
more you know like this is how we're
using the data this is how we're trying
we're being compliant with NHTSA's
requests they basically sent a list of
17 questions I think was about 17 and
they were totally reasonable they were
totally reasonable questions asking us
you know like what what is this product
what is it doing how can you guarantee
certain aspects about the product and
but apart from that I think the I think
like the trend of the general
self-driving space is moving more
towards like not even away from
regulation but like when you have you
know lame-o come out and announce that
they like hyped it up a little too much
for the first X years that they've been
you know working on self-driving cars or
you have all these companies that are
slowly realizing like this problem is
actually really difficult like not that
regulation catches up but it just the
the problem slows down that the pace you
think it'll be solved slows down and
that reassures people automatically yeah
I think it's also the people are getting
more and more comfortable with it now
we're just we're not hearing about the
accidents constantly we have heard the
arguments now that there's other cars
that are crashing we're not hearing
about those so I think we're just
getting more and more comfortable with
the idea and then we're also you know
four years ago it was just weird or five
years ago was weird hearing a Tesla
creep up behind you and now it's like oh
you you almost can hear them now which
is so bizarre right we could never hear
them before and now we can hear them
which is really strange so how did you
get involved in the company so the
founder I lived in this house called the
crypto castle in San Francisco very San
Francisco it was basically a three-story
townhouse in downtown San Francisco with
a bunch of people who were interested in
Bitcoin and cryptocurrencies and George
the founder moved into the basement of
this house he was basically looking to
start his own self-driving car start up
and needed a basement where he could
pack away a car and so I'm and became
friends he I like just lived and saw him
develop this company for the first like
seven or eight months and then in about
a year later three and a half years ago
he was looking for an Operations person
and I went up to him and I said he
should hire me and definitely took some
convincing
um and yeah about two weeks later I
think I was offered the job and I took
it with very little operations
experience that's really cool okay so
you guys got involved he saw it in the
earliest sort of early stages and then
you went to and you did you launched it
disrupt in New York yeah yeah so I mean
yes that was 2016 13 early stages we we
had done a Bloomberg article in 2015
which launched I think that it was like
really the first of first unofficial
official launch of just comma as a
company and people were intrigued to see
what he was up to what he was doing and
then in at TechCrunch we announced this
whole you know shebang of a product kind
of trying to fall into the hype of
self-driving cars before you quickly
realized that all of that is dangerous
to fall into and then we open sourced so
yeah correct myself we open sourced the
software in 2016 we had no hardware we
had and we had hardware be an
open-source the hardware required to run
on the software but we weren't selling
it and then we had a community of people
just like building out this harder and
and and working on the product and then
we if we launched the comedy on the
hardware that supports open pilot if if
people want it also we launched it was a
dash cam so you know for people that
came development kit launched that in
2017 and kind of have consistently been
you know updating with with new versions
of both Eon and open pilot how are you
funded so through a 16 ca-16 zeal we
were still serious seed a 16 z led our
to our two rounds yeah we did two series
seeds how much have you raised so far
the 8.1 mountain
that's pretty substantial for a seed yes
it was to seed so the first seed was 3.1
million the second seed was 5 million we
have we have revenue um we have revenue
and we keep our power we keep operations
very very lean we're team of 13 12 or 13
you know it's yeah if the real goal has
been how do we become profitable which
is not a question that startups asked
themselves but I think it was you know
kind of a it was important to be like if
this is gonna be sustainable how can we
make money along the way as opposed to
just blowing through millions and
millions of dollars to technology that
you can't even ship you know yeah yeah I
led I I was brought in as a coach for
the team at HootSuite about four or five
years ago and I led their strategic
planning retreat and I pushed them to
consider profitability as a way to scale
instead of more equity in debt financing
and they decided to go for it and I'm
like I don't understand why people don't
like it's so simple to actually build a
real company if you decide to and you
have what any more control so that is
that is that is your focus then yeah and
what you said was build a real company
that's exactly what we do and we yeah
it's it's way more control it's also
just the easiest we didn't know that
you're actually adding value to the
world is you know are you - yeah if
people are buying it you're making money
off of it and it keeps you lean and
keeps you smart and scrappy it's so
amazing when we think when whatsapp sold
for like 1.4 billion they only had 50
employees yeah you know so you're on the
same trajectory so I love that that he
was working with getting some
early-stage free PR Ezra well I wrote a
book about a year ago called free PR and
it talks about how to leverage free
publicity for your brand and how to
generate it in-house instead of using a
PR firm yeah and then how do I kind of
because you guys have got some huge
upside clearly with PR I'm sure as well
yeah totally well also yeah I mean I so
George our president the founder he
comes he's he comes from like a hacking
background so people have like followed
his you know what he's been up to and
what his projects have been throughout
and so that was helpful too and also
it's like an underdog story that first
of all Silicon Valley loves
and the people in fiscal love where it's
like you know this one guy you know puts
together some self-driving car that like
you know competes against Tesla's and
whether or not it's true whether or not
you know how much hype you want to have
if you get a story like that to start
off your company people are gonna be
excited to see where it's at
I got missed out on the seed round at
Tesla by not putting $5,000 deposit down
on the original Roadster 15 15 16 years
ago yeah I was a bad bad call I also
told the founder of uber it was a stupid
idea when we heard him deciding before
he launched I was took him to Burning
Man and he was explaining it to me I'm
like this is before he hired Travis so
yeah I think you're onto something if I
told you it's a bad idea go all-in
though as well because okay so I know
how you got involved in the business and
when you started dealing with the whole
open source what can you teach us about
that what's been that would have been
the I guess what are the hassles would
have been the pitfalls and they the
struggles with the whole open source
side of the business
I mean honestly there are not many I
mean
the beauty of being an open-source
business is that it forces you to like
you're not you're not going to just
open-source your software and then be
very secretive about everything else you
do you're gonna be an open company it's
gonna approach what you do with an open
mindset and so kind of a default mindset
of kamma is like publicise what's
happening be honest about what's
happening you know like yeah there's
nothing we don't want to have things to
hide because if you have secrecy you
probably don't have anything at all is
the idea and so I think that that's
definitely a just like a positive a very
positive reinforcement of what
open-source does for me like from a
personal perspective I had come
I joined comma from like a tech PR firm
that was very much like embargoed until
this date don't you dare break that you
know and so I enter into this world of
comma where all of these people are deep
you know deeply admire the open-source
community and you you can't help but get
stressed about potential competitors
that decide to you know use this or get
a leg up on whatever they're doing but
then you really said that's exactly the
point where like if you do open-source
this and you do give even you know even
like people who aren't necessarily
direct competitors but if this
information is out there in the world
then everyone already has a plus-one to
having this information we just like
help you know and also like if if a
competitor comes along and builds a
better hardware system that's gonna run
this system but it will then you better
work your ass off to make sure that
that's not the case and that your system
is always promising you know the the
better experience for users so
definitely for me initially it was kind
of like a jolt of a different way of
thinking that's cool so you said you
came in and you didn't have any
operations experience so how did you how
have you learned it
I mean on the job yeah yeah I think the
the thing I quickly realized was that
operations
you don't want glory in operations you
want to be like as behind-the-scenes as
possible because it means the company's
being run and people aren't realizing
that something's an issue if that you
know you don't want there to be issues
which was a very interesting just just a
different approach of like okay how do I
you know how do I go about this how do i
how do I make sure that the things that
are happening are happening in a way
that that people don't like people can
do their job and thankfully like comma
grew with me
you know comma when I joined comma was I
think we had ten or eleven people
because we had interns and those interns
left so we were like down to six at one
point so six person company if you've
never done operations before you can
learn and you can like manage quickly
and because common has scaled that like
a very I think like appropriate rate
it's been a good a good way of like
learning and yeah I mean when you're in
San Francisco every other person does
operations to some extent right
Moses yeah how about attracting talent I
mean the Bay Area's got to be one of the
most competitive areas for tech talent
for sure and for even for the Ontario
students so how are you attracting
talent yeah so this was very interesting
and and one of the reasons we actually
moved to San Diego oh right yeah you're
in San Diego now too
you've done San Diego yeah I think
initially I mean working at comma is
different than working at almost any
other company so already with just like
the open source factor you're gonna
attract people that are interested in
the open source community and that was
key so like number one way for us to
attract count talent was like through
get up pouring over people's kid hopes
making sure that you know like people
were already contributing to the open
source community people who are excited
about those projects are gonna be really
excited about you know open sourced your
consistent system so that was kind of a
helpful way also I think that so yeah it
is real
hard to you know when Google's gonna pay
a machine learning engineer hundreds of
thousands of dollars and you're trying
to keep your startup very lean and
you're not gonna offer that what you get
on the flip side though is people that
are in it because they really do believe
that this company is going to succeed
which is always the goal and so you know
you people who come in and take you know
you give a sliding scale of equity and
salary and people who take like you know
is the slowest salary and the highest
equity because always like a positive
you know reinforcement of where this
person thinks the company is going
moving to San Diego
so it was hard it's it's obviously super
hard to recruit it's obviously very hard
to attract talent and going to San Diego
one of the ideas was like okay maybe
we'll be able to attract talent more
easily qual comes here you know maybe
will be different than the thousands of
startups in the Bay Area that are all
trying to attract the same people that
played out so I Monica Lee we a lot of
our employees not a lot but a decent
amount now have come from our community
and so that's proven to be like more and
more the best way to get people is
people that are that find themselves in
the common community are already
interested and then if they you know
contributed really positively floating
the idea of joining a company it's like
an exciting next step so and also just
kind of realizing that San Diego is also
a more pleasant place to live I think
then the Bay Area barry smith says he
was amazing yes you news great it's
easier to attract people from you know
wherever in the u.s. to move to San
Diego than to move to San Francisco well
in San Diego's got a pretty good
technology sector as well a pretty good
entrepreneurial sector there's a lot of
biotech but you know also that that
helps because then we're we're not
biotech so we're different yeah I've got
a bunch of my for I've coached a lot of
companies and I've got a number of
different coaching clients that are in
San Diego and then a couple of our
members of our CEO or Alliance are in
San Diego as well it's just it's a great
great market so what are you guys
struggling with right now what are the
pain points
I think the main pain point is like what
what do you want your company to look
like you know we built this company and
you were you you're working towards
profitability so this is the old this is
for now the ultimate goal you know like
in the immediate future but what kind of
a company do you scale into what kind of
company do you become how do you
decentralize the responsibilities of the
company so you don't have like one
single point of failure being your CEO
or whatever how do you you know how do
you work on I guess at the core of it
like it's our product in the company we
talk about a lot stability so stability
on the product and stability in the
company and how do you build something
that will outlast everyone that is
currently at this company you know those
kind of thoughts that you have when you
yeah if you're profitable you can
self-sustained for hopefully a very very
long time and then what does that look
like
how are you kind of giving the vision to
your team right now how are you
articulating it or getting them aligned
and inspired and then how do you also
keep a group of people super excited
when they're coming on for equity and
the company's seemingly moving towards a
profitability focus does that distract
them at all I mean in and by all rights
they should be focused on profitability
anyway but if it's builder busts that's
a different goal so how do you keep
people incentive is an interesting less
incentive eyes and more a more aligned
more aligned and inspired you know it's
the vision yeah they're not just trying
to focus on an exit I think what helps
is having an actual user base so we have
like a community discord and a lot of
our users are on that discord and a lot
of our employees are on that discord
talking fusers you know like having beta
programs and stuff like that that house
because you literally see what you are
doing affecting people that you were
talking being a 13-person company what
you work on has a big impact you know
you're not working on like a product
project with IP
bounine have that be scrapped like if
you don't do something it's obvious and
it hurts you know it hurts the company
so I think that alignment like will come
naturally just people seeing you know
what their work has and then in terms of
like the profitability equity think I
don't even think it's directly related
to comma when people hear that I think
it's more of a realization of like the
state of feces in the state of San
Francisco Silicon Valley or like that
money will dry up the money that they're
just handing out to companies will dry
up so if you do want to succeed if you
do want to win at self-driving cars and
solve self-driving cars what better way
than to create a profitable company that
doesn't die on these investors and I
think that mindset just helps in general
you know people get on board with with
yeah putting profit first can you and I
know that you're still privately held
and still see drowned can you can you
disclose some numbers to us in terms of
users and revenue numbers at all or did
you to keep that stuff private still so
we had I think was around 160 grand in
revenue um and you know we spend at a
rate of about you know about probably
180 grand a month is our burn rate so
you know close to close to getting those
two numbers very aligned which is yeah
which would be great and ideally we
don't need to raise money again you know
ideally we are profitable early next
year and and can continue sailing how
are you getting the word out right now
how are you guys getting the the buzz is
it PR is it just your community is that
it's yeah it's community it's it's
really the community we don't really
have any I don't have anyone here that
does marketing we don't really have
anyone here that isn't an engineer apart
from like myself I do operations that's
kind of engineering some sourcebook in
some way but we don't have marketing
program we don't have visit up
departments so it's really the community
it's really like you know
someone posted YouTube video and then it
gets on reddit or something like that
you know like where how are those sales
coming we also have you know it's not I
mean it's not like the simplest thing
when you purchase the the Aeon dev kit
you know it's still you're like is my
car supported you have all these
questions so there's still a lot of
low-hanging fruit of the people that
come to our website how can you know how
can we make it super clear for them if
they want to purchase it what are they
purchasing what they need to do and so
yeah but but definitely like getting
more people to the site is isn't is of
course a goal I think we're still just
focusing on like the people who do come
to site how can we make sure that it's
abundantly clear what what they could be
buying or not this is not expensive this
is six hundred bucks yeah it's
ridiculous I think by the way I think
the autonomous vehicles will be the
cause of the next baby boom you guys can
quote me on that you can put that in all
of your PR for real right you think
about like L people driving in LA
traffic for an hour what are you gonna
be doing you're not gonna be hanging out
in the front seat you're gonna hop in
the back and that would be then I'll be
like y'all's all commute to work like
people know what I don't want to work
from home anymore I want to commute do
you do you run on a remote team or do
you all run out of the office together
one guy whose remote but he was with us
for two years so he knew very well how
the company worked but really try to be
everyone in the office just helps so
much more with you know and also like I
joke that we don't really have any
meetings we have one meeting a week on
Monday mornings for it you know just to
sync up what's happening but I kind of
joke that like everything is a media
comment just in the sense that like you
know at lunch when you miss a
conversation you're missing a lot you
know to be really at all times people
are talking about their projects and
like what's the hold up and you know so
yeah it's just it's pretty important to
be yeah I think it's I think it's
critical in the early stage for sure of
a business to actually have that cooler
time and lunchtime and just kind of
interacting that that beta transfer is
amazing what happens there so how about
yourself and what
working on your skills right now is the
second-in-command so I run operations
here so basically everything everything
non-technical so I do you know yeah
operations recruiting accounting legal
HR you know yeah all of that kind of
stuff right now personally I'm working
on so we have some exciting things
coming next year that we're working on
and recruiting in this area recruiting
in San Diego understanding like how do
we yeah how do we build out teams here
you know reaching out to people in the
US and abroad
um and kind of all the things that come
in operations you know if I were to give
you like a given day it would change
drastically from one day to the next
how about technology tools what tools do
you use or does the company use to to
scale to manage you so for operations um
I mean I I don't know exactly these are
the tools you're thinking but like I'm
such a big fan these adorable startups
in San Francisco like Augusto and zero
that are incredibly helpful and have
fantastic customer service support
because they like because they needs
because they want to be yeah I really I
have been like very almost pleasantly
happy that the startup world is a thing
even though it can be unbelievably
frustrating but you know when you're
trying to get corporate credit cards for
your employees from Wells Fargo and they
require everyone's social security
numbers and all of these things that are
such a headache beyond belief and that
makes everything feel super
uncomfortable to have to give to you
know some big bank and then you stumble
upon upon a complete
Drex that you literally just sign up
online and get you know corporate cards
mailed to you in like three days
I mean it's so like the convenience of
so many of these of these companies is
to me and I'm so happy with it because
otherwise it's such a pain in the butt
to that steel so yeah we you know so
Gusto's the HR Payroll software Xero is
the accounting software relaxes
corporate cards so we use you know use
those otherwise I think considering you
started out of the crypto Castle re do
you accept any cryptocurrency as payment
for your products we used to and then it
was such a pain in the butt taxes to
have to claim you know how it just
became so not worth it but we had so
back when we were definitely had this
open-source hardware called the common
Neo terrible a terrible neon green color
really we you know back in the early
days there was a company that was
building them and selling them I think
they were building them and selling them
for one Bitcoin which at the time was
probably $700 and then December 2017 you
know people know Bitcoin Rises to 17
grand so I hope that I forget Neo German
is their name I hope they they did well
with their Bitcoin except you know
except transactions I was telling I
gotta go back and look at the dates but
I think it was 2009 that I was telling
people on Facebook 9 or 10 I know I was
freakin early maybe it was not a maybe
was 2012 but it was really early I said
when it was when Bitcoin was $400 nice
that I was I was accepting Bitcoin as
payment for speaking events and for
coaching people like you need why would
you do that but I ran a digital currency
company 20 years ago I had Starwood
Hotels and Bose stereo and Avis
rent-a-car Hard Rock Cafe all paying me
with a digital currency instead of a US
dollar we sold the company in 2000 so
yeah that we had thirty thousand
businesses buying and selling using and
digital currency no it was called it was
called you barter calm we sold we sold
464 million butBut it was a real
business we had they were open to using
digital currencies oh yeah we'd start
with hotels we had great little swipe
cards you could actually use it some of
them using merchants their merchant
processing and it was just a bilateral
multilateral trade and it was it wasn't
back we met with guys at Goldman Sachs
and like wait so what's backing your
barter dollar and we went nothing and
they went oh my god you you print money
and we went yeah they're like you're
like a country and we're like yeah any
much we actually print our own currency
because we if we needed more money we
would just give ourselves a credit line
we'd go buy furniture for the office
with our own crypto
it was crazy so I've always believed
that I think there's a huge need for it
but I think one day it'll come back
around that you can start accepting it
again yeah yes certainly it'll it'll
yeah it's on the up and up despite how
people might feel about it so when
you're alene when you're lean start up
in a smaller team and you're focused on
profitability and not burning through
cash what are you trying to say no to um
it's a good question because if there's
a very fine line between like being too
strict with the cash and you know
therefore not having like where does
productivity and cash spend meet
perfectly so one thing that we did like
a big overhaul of was services you know
random services that you sign up for
that you forget that you're you know
signed up to and then you realize that
you know at the end of the year you
spent 15 plus grand on services like so
down on that also
I mean honestly a lot of you know a lot
of like a good amount of PR can be
ridiculously expensive if you don't know
how to you know either if you don't know
how to use ad spend correctly or you
know you can hire a lot of consultants
that a lot of times don't actually add
value and that are ridiculously
expensive so how do you you know what
can basically what can I do how much
would it cost if someone else did it and
what's the value if someone else does it
versus me doing it and I think most
people - because you know because it's a
small team it's faster for them to just
do most things on their own
instead of using you know another
service or whatever but also yeah a
13-person team in San Diego with you
know I mean we have competitive salaries
now that we're in San Diego but nesaf
definitely lasts you know you start to
yeah it starts to almost naturally be
more lean certainly naturally be more
lean on when your zero Cisco they kind
of have to be take a look by the way at
my book free PR I think you guys might
have a huge opportunity to leverage free
publicity in-house how to generate its
how when we built 1-800 GOT JUNK we
landed
five thousand two hundred stories by
ourselves with no PR firm and that was
that was prior to Facebook launching so
we had no social media platforms to
actually leverage our PR on that was all
individual uniques including Oprah so by
the way I should shout out 100 that jump
because you guys save just so many times
yeah we're out of a house in San
Francisco that stuff you know piles up
quickly
that was our he was our fifth franchisee
the guy who owns the Bay Area does 20
million just in San Francisco on junk
removal he's killing it alright last
question we've got if you were to go
back to your younger self just starting
out in your career what word of advice
would you give yourself that now you
know to be true but you wish you'd known
then
I would say at the end of the day at the
end of the day responsibility falls on
you which seems like an obvious thing to
say but if you are you know even if you
were managing someone and they mess up
that inevitably falls on you and the
second you think in that way you start
to think more like the company you start
to think in a much more productive way
to actually getting stuff done to
actually you know shipping out products
and yeah and and moving a company along
because it's it's not it's no longer
individually based so you know thinking
in the sense of you know what
responsibilities do I give how do I
trust that that person will get it done
and if they don't okay that's on me what
do I do yeah or what did you do wrong
that let them let that happen I think
that's amazing
Ben Ben Horowitz in in his book hard
thing about hard things talked about
kind of that level of introspection
that's really important for leaders that
often when we're firing somebody we're
like oh I'm glad they're gone they're
terrible at this they're terrible at
that it's like well you hired them yeah
exactly so how what was wrong with the
interviewing process what was wrong with
the recruiting process what was wrong
with the top grading or the reference
checks or the training program or the
leadership or like how did you let this
happen and when we take that level of
ownership and introspection is powerful
and also on top of that it doesn't
happen again because now it's like you
know traced back to this point when this
was the mistake as opposed like you know
let it go as oh it's their fault it's
gonna happen again
yeah that's awesome Vivian Ford thank
you so much for joining us really
appreciate you sharing everything you
guys are doing with comma and really
excited about what you're doing work for
autonomous vehicles thank you so much
for having me this was a lot of fun yeah
thanks for sharing
you've been listening to
second-in-command brought to you by CEO
Oh Alliance founder Cameron Harold if
you enjoyed this episode please be sure
to subscribe for more best practices
from industry leading CEOs visit CEO Oh
Alliance com
you
now we're live again cool
yeah i don't understand
um
is is
no maybe the iphone was just being weird
um let's hope this is better let me set
a topic here broadcast details
no not that
um
yeah i know
this is hard um
maybe can i change what we're live about
nope i guess i can't
okay cool
um so this will be a good
this is not
rotate
there we go is the stuff fixed do we
have good orientation now
is the stream good
um
periscope is a lot of problems yeah
uh
so yeah this will be a good stream to
watch if you're interested in porting to
your own car so what we're about to do
is tap into the existing system
on this car to see how that system is
commanding the break gas and steering
what happened i pressed the home button
on my phone um it's kind of annoying
we should get a get a better streaming
setup yeah um but is this a stream good
quality good
bad reception yeah
it's good cool
um
so yeah what you're going to want to do
is you're going to want to sniff the can
buses right at the camera so this car
has a has a camera
just like the honda and it has two can
buses on it
one that
looks like it goes mostly to the radar
and the other one that talks to this uh
driving support module
so i haven't seen a driving support
module before
it may actually be doing some of the
math
of steering the car so in which case we
might have to replace that as well
but for now we're just going to be
focusing on
yeah you have to find the canvas wires
after the firewall um so a lot of cars
have these gateway units in them now and
the gateway unit is uh
blocks certain cam messages though
i believe that if we download the
manufacturer diagnostics tools
will be able to send special messages to
the gateway to bypass the gateways at
least bypass them for a read only and
there's no security issue with read only
so
i would guess that there's some way to
enable
that kind of messaging and that's
something we're definitely going to
start looking into with the panda
project and shiffer
you know because obviously with the
panda we want to gather
um
you know data from all the sensors of
your car
and uh
well yeah we'll get to that we'll get to
that much much later maybe next week
but yeah
so we're setting up a wire right now and
this wire is going to use the
uh ethernet jack
on
the giant panda board here no we don't
talk to oems talking to oems is hopeless
we
would be happy to start to talk to
smaller chinese oems once we really
believe that they are going to build a
car some of them like you know faraday
future
maybe will never actually ship that car
as much as they might want to
but yeah so that's the
ethernet ports on the neo
you put some heat shrink over there
yeah
faraday's kind of out of money and
that's kind of the problem
all right heat shrink and then labels
keep shrinking labels can we get a label
on this neo by the way yeah you want the
cereal i want the serial number and
maybe we should write that it's a 3t neo
as well yeah
you know what i'll make the label
where's the label maker
we have a lot of those label makers
cool
so that's the serial number there
of our neo and you can see that this is
running open pilot
0.3.4
not released yet
0.3 0.3.3 is available in the
development branch
so let's go here and let's type this in
6 8
f
a
six
use a capital a
two f a six
seven six eight six two f a six
that's right so i'm gonna print that out
i'm a big fan of these little makers
and later than the oh here do you
remember which way i put the label do i
put the top of the serial number at the
top
um
you know
i wish that my phone was also a tiny
drone so i could let go of it
and then it would stay still
you should get a uh iphone
case that tracks your chest
that might work
or a tiny drone
not a tiny drone
okay
um yeah right because now i have to
somehow put this label on this thing
because lucid motor is still a thing
um i don't know i think so i think so
yeah maybe yeah i need someone to hold
the camera i've run into this problem on
mtz as well
um you know what we'll hold the camera
my mount
get viv viv doesn't want to be on uh on
periscope
okay well there's 44 people watching
because i messed the periscope up oh
the 40 of them dropped off
this is viv
hello there oh we're 47. they they're
happy to see yeah um all right so hold
this camera while i apply a label to the
neon you gotta it faces the other way i
figured yeah i mean that much i get
so i'm gonna put this label
right here on this nail
oh my god someone had this mat when they
were a child nice jacket thank you peter
i appreciate that the periscope people
are very legendary matt yeah it's a good
match we got it um it's pretty good
target
did we get this or no yeah yeah yeah
yeah we didn't get it what happened to
george's hair he got it cut i did i got
my hair yeah
okay i should actually be focused on
this i'm just reading so this is why i'm
putting a label on it you know it's not
the highest texture oh okay
um but yeah so you see this has the
gopro mount on it
um so this is uh three times vhb tape
we're fans of vhb tape so this will
slide on and off
just like a gopro slide this off
slide this on and you get similar
rigidity that you do with the rear view
mirror
i'm also for phones these logitech
mounts are pretty great george someone
said you're taller than they expected
i'm tall what can i say
not that tall not that tall yeah all
right don't kid yourself hey
tall
i got photoshop for all these things
today anyway
um
cool scott wolfe welcome it's their
first day on periscope
it's the first day of character we
actually shouldn't welcome people more
regenty more
rigid oh god they're asking for if it's
better than a suction cup mount it is
better than a suction cup now so
actually the lack of rigidity in this
suction cup mount doesn't come from the
suction cup it comes from this
attachment point here like there's a bit
of wobble remember a phone is a pretty
long lever arm right so there's a bit of
wobble
in this mount i really wish some company
would just make a phenomenal suction cup
mount because it's not really the fault
of the suction cup but um the nice thing
about this vhb mount as well is it gives
you some repeatability of installation
all right so
neos right now still take a long time to
calibrate
um if you want
to be able to take it out of your car
and put it back in your car
you can uh
you can uh
do just that
you can put the you put the
thing on the
thing and then you slide it back on and
then it goes back on that's good
uh we have
61. wow they're coming back 61. is there
going to be a solution to the
recalibrating
yes there is yes we have we have we have
a person working on this right now um
it involves fancy machine learning oh
yeah obviously no it does actually the
current calibrator does not use fancy
machine learning
but um the new calibrator will use fast
machine learning
cool so we're gonna label the cable over
here
yeah um this is what separates the
amateurs from the professionals is heat
shrink and labels pretty much they're
important that's it that's all you need
um so let's not let's make sure when we
take referring to my neo guide we don't
uh show them what the new uh offices
okay it's secret secret yeah
uh vim
you think you think i use z-max
supply supply text is pretty nice
actually i like i like sublime text
any of these pins gonna like go in there
nicely and nothing sticks out they're
nice and long they're long bring let's
bring the uh let's bring the diamond
cutters with us okay
just in case we got it cut
okay okay
okay what's what
oh mapping slam progress uh
it's going well we have two full-time
people on it
so um yeah there'll be some incredible
announcements once we get some mapping
stuff together i won't hear enough to
the top
78 viewers that's right 78 viewers we're
almost at 100 you guys know what happens
at 100.
what happens oh we're revealing a new
car oh that's what's happening that's
what's happening i've been out of the
loop because you know yeah
oh so we're now at 69.
oh no they don't want to know what the
car is like
i guess they don't want to know what's
rl radar
it's a radar okay is that good all right
let's go
um
let's not do it
do we need a ground i don't think we
need a ground
someone else shouldn't get in the ground
no i'll get rid of the ground someone
knows what what is i can't say it out
loud because they're dude
oh of the place yeah yeah so yeah did
they post
no
wait how did they if that's public man
yeah what did they post i don't know
they just said someone knows oh yeah i
mean it's not that big of a secret yeah
oh is our locations on there
oh
no secrets today um
yeah but randos are shot on site
you think i'm kidding
tell that to the three rando's buried in
the backyard that's right we don't talk
about this
that's right that's why we keep no let's
just flip off the ground
what the rando's getting shot the yard
being such a mess to cover it up what
yeah you know what do you think look at
the tall grass you know you might find
some pokemon in the tall grass or you
might find some uh
you know
that's our meeting table for you guys to
know and i know it's not funny he's
wrong we are meeting that oh that is our
meeting yeah we got there it's kind of a
trek outside yeah uh but it's okay
um i'm gonna go upstairs and get the
cape wow okay should i just continue
filming eddie yeah okay
vertically okay good to know good to
know
man
how you feeling
i just don't know what i'm doing i'm
just recording it i'm really like
periscope's okay i guess
i explain what you're working on people
are people are well i'm just labeling uh
uh this cable that's gonna connect to
the neo that george is gonna use um to
plug in to the toyota the new cars the
new car around the back let's do it yeah
yeah yeah it's a beautiful
access to tools and stuff yeah let's do
it yeah i'll go i will go get the car
yeah continue let's yeah let's let's
what i'm not giving it away well i think
no i think we might have uh i don't know
let me just get the car
yeah
oh wow
what are you giving away the secret
location oh jesus
um well that's that's that's not ideal
that's uh
i disable that
just go to location services
yeah oh well
you know hey can't stay secret forever
yeah i know we're no longer selling um
well we're right now still inspired
we're still on cell phones but you know
just just in case some crazy things
going on next week live streaming is is
stealth mode in case anyone is confused
can you guys tell this is the first time
we've done this the more you flip the
camera around it's nauseating oh is it
really true oh shoot okay
that's my experience okay well this is
the second time on fire's getting okay
you want me to get the car you you keep
talking to the crowd yeah i'll go get
the car i'll go get your car guys get
the stuff ready
tom is watching us and giving really
rude comments
tom is like you know commenting on my
terrible video
oh really all right you guys are good
but i'm just no it's not oh
thank you tom all right i'm going to
show you guys uh this is our plant that
has died
it's a little lot tom when are you
coming to hang
when are you coming back alrighty eddie
help me out what are we gonna do right
now um we have lions
thanks alex oh we do have lions yep
yeah
there's some of the guards we have
here's another one
in case any of you guys are trying to
mess we have a nest cam so don't even
think about it
uh all right eddie it's on you
so uh this is the fully assembled neo
with a giant panda this gives you two
ethernet ports
uh we're using
one of them to power the car since the
new car we have doesn't have constant
power
at the
radar and camera connection point
so we're going to run this down to the
obd 2 connector
and then this is the standard neo get
ready get ready
and this is
the most beautiful car like i'm not even
kidding you when i say that
we'll just show you some beautiful
features
yeah it's a really really hard driveway
the table is back there
it's like our steering is good oh yeah
power steering is phenomenal and don't
get tripped up it doesn't have electric
seats but that's fine
but you know what it also didn't cost 40
dollars
it was a very reasonable it was a very
reasonable price and we love the people
we got it wouldn't be funny if i crashed
it yeah i think you should no don't do
it but it would be funny crash the new
automobile i'm pressing the p button all
right press the p button we're good all
right so let's get this thing mounted up
all right
wait wait let's open this it'll be
easier yeah where'd that where'd the
logitech mount go
uh i have it here you have it here
you take that i'll get the lot go get
the logitech mount so we're going to use
this one here for power
um because there's no so here's the
camera
over here
um and if you look on let me just turn
the power off to the car if you look on
this connector here
there's actually no
uh full uh power on this yeah so there's
there's two can buses but the power is
gated based on ignition
and we want your neo to be able to
continue uploading
there's no sunroof folks there's no
sunroom here
this is the toyota prius for those who
are wondering yeah that's the prius two
ps2 just give it back to me
okay i'm gonna spin you around slowly
it's nauseating george i know i know
a prius of some sort
um yeah so it is it is a 17 prius um
part of the reason we picked it is it
can do full speed uh cruise control it
also
has south park
um so by tapping into the self park
feature down here
we can actually turn the wheel
um while the car stopped
so you know hey maybe we're gonna do uh
a little more than a highway in this car
maybe headlight system malfunction
contact your dealer call the dealer
dealership lane departure alert
dealer oh geez dealer wow this car's all
broken it's not ready to drive
um
what are we gonna do well i mean if only
we had some people knew some stuff about
cars
okay
so
let's um
[Music]
man it's annoying to pull into this
driveway and pull out of the driveway
all right let's get this neo mounted up
on the windshield we're going to go like
here with it
yeah you know where do you want to go
with it
i don't know it's kind of annoying with
this
but the uh
yeah it's very slanty
slanty as shit um
and like that's really off center now
maybe there that's in your way that's
gonna be in my way wow okay
i know a bit about cars
my car press i know a bit about them i
like that i like the one i like this
toggle um
they are pretty nice yeah so all dirty
saying take off the mirror maybe
that's pretty dirty does something crazy
that's pretty nice i mean that's what
i've heard
give eddie the phone right you can
definitely say shit all right you can
even give eddie the phone yeah
question um do we we want a a female
cable to hook in
to the other side of that right
to do the gateway of the we want a
female cable yeah i mean ideally into
the radar right
now
sorry the camera so what we're gonna do
is we're gonna shove these wires in
okay so that's radar h camera h
i know that the h is the pin six
so how do i know what's pin six
oh no it's labeled here
so that's 12 okay so the h is on the
bottom here
so that's going to be the low over there
you really think these things are going
to work if we just shove them in the
holes like this oh and then you're going
to plug it back in that's the idea right
yeah uh yeah it worked it worked pretty
well before it wasn't i remember it was
annoying i remember sitting at the
computer while you were like doing it
yeah it kind of fell out a lot but these
pins are bad maybe we should use an
oscilloscope
or maybe we should do we have a
good we should get a portable
oscilloscope we should buy one yeah
those are those are cool
and then we can like see if we're making
good contact
yeah oh this is annoying
yeah if anyone out there can find this
12-pin uh yeah this 12-pin connector
that's on toyota's it's also the same
one that's being used on the new civic
hatchback sport i kind of think it's the
same system you know i believe they
switched toyota and honda
seems like they kind of partnered up on
this and it's bosch it's on the honda
it's a bosch system and this is as well
right you see bosch on that camera it
says
yeah it's the bosch logo so they're all
using the same system
this ain't bosch's denso denso yeah
denso is kind of toyota so honda uses
naidak and toyota uses denso um
we're going to pull power off the odb
port so this can just go down here in
the odb port
um it's a little annoying that we have
to get i mean we're just doing it for
power maybe we should just pull power
from the
yeah i mean we could
now you have all these exposed wires on
here and i normally like it
wait that's hot glue though no there's
no hot glue on the other side of that
hot glue down there
but here let's see if there's power is
in the yellow
oops
powered look how pretty with the white
case yeah and now
uh so that green
oh really
oh no it's good it's good okay i just
need a jury flash okay okay now if we
plug this in and we see green we should
be good
well let's turn the car on oh these are
falling out
this is so janky
okay
okay radar can work so we're getting
we're logging the radar can right now
um
turn this off for now
turn it on
just wait for the cans to turn off
but yeah so you see that green light so
there's just a panda in here you know
that pandas with the latest firmware
turned green when you're logging stuff
um so i'm just going to unplug that so
that stops logging a picture of my face
dude you want to take over camera duty i
got you yeah it's still it's still
logging
this is just open pilot
um so yeah a few things we got to do we
got to shove these wires in better
uh eddie you want to get some electric
tape and you want to put them in nice
well we know one of them works so that's
good
um and then we gotta kind of figure out
where to put this anyone have any
suggestions
aside from removing so honestly even if
we remove the rear view mirror
this is in the way
i'm worried that the best answer might
be here
right
you know
also this has a different angle
let's um let me just fire this up
[Music]
yeah fired up we can look at the camera
and see what it's seeing but yeah this
this this windshield at a very different
angle from the honda like look at how
angled that is
um
maybe here maybe actually kind of above
the mirror
the mirror down there and have this up
here i'm kind of liking that you know
yeah let's just make sure the camera
doesn't look at this yeah exactly right
so once eddie gets that taped up we'll
be able to fire up open pilot
um and then this will be logging our
first uh let me get out do you want to
take it
well get electric tape gaff tape is far
superior no no no no get electric tape
and why don't we put it down there
people are wondering let me put it down
there because it's kind of far
my car is very angry at me it looks like
get electric tape and scissors
scissors
great scissors
oh that smells good is that food it
smells super good by the way did someone
eat my fried rice last night
yeah i ate your fried rice did you
really no not really all right but i
wanted to see what you said
i'd be devastated somebody my favorite
like fire ice in the fridge
didn't you need my friend nurse
neil does everything
and they said no you don't
here we go eddie your minutes of fame
these folks have been with us for 24
minutes how many they're ready how many
folks do we have we got 55 they're like
silly they're tired you know we've been
just chilling i'm happy with 55. oh good
okay 54. i mean fine now
no but you know hey they stayed around
for the big reveal
so these two on the left are the other
two okay
i'm sorry
yeah the one on the left are the other
two cans so
you know it's the same like order as i
put the radar yeah
no highs on top
okay
all right well no no it's not on the
left no no no it's on the right oh it's
right next to it it's right next to the
radar yeah it's like a little grid there
um oh this stinks
one it's just so hard i know
well because we're shoving wires into
little ships you know
um but no literally we didn't test any
of this
uh so we're trying to connect it to the
wire you're trying to connect to so
we're gonna see what the stock system
is sending to the car in order to
trigger the uh lane keep and the
adaptive cruise
the lin bus is not used on this car no
but um the accord uses something that
looks very similar to lin for steering
also the acura uses lin for reflashing
or something likely needle lynn k line
any of these sort of one wire serial
protocols can all kind of be done with
the same uh
transceiver hardware and the panda
supports two lin buses
um so uh get an early gets
well they can't they have to just they
got a winner yeah they're ready
some people are already in early and
already have pandas yeah
um
if you've given out about 51 pounds
maybe
yeah well they want to start reversing
it makes sense
um yeah so this is how you can kind of
start reversing your own car when
shopping for a car to port to what are
the main features needed so
um we look for two features we look for
adaptive cruise control and lane keep
assist um if you want to use open pilot
on the highway you're gonna look for
those
um if you wanna move to
uh you know
higher torque stuff you want to look
also for self parking
but mainly the features you want to look
for are adaptive cruise control and
linkedin assist
so
you want to connect that up or do you
don't need your laptop to verify we're
getting data no no no no so as long as
it lights up green we're good i actually
can't see if we're getting both i'll go
get my laptop yeah just so you can see
if we're gonna yeah yeah and then we're
guessing i'll get well
just take tape it up nicely oh you wanna
verify
yeah you can't really
taping up nice isn't gonna go that far
but yeah
check out the steering wheel
optical fiber stuff
a little bit too nerdy for periscope
thank you we take that as a compliment
the steering wheel looks like a storm
trooper
yeah it does
right it's pretty funny looking
it's got this like white plastic
george with his laptop
you spin slowly
spinning slowly
um
well don't be dead please don't be dead
all right cool good
so the way that we can access all of our
neos if you build a neo this isn't true
but the neos that we build are all on a
vpn very similar to tesla's cars
so i see
a bunch connected to the vpn right now
and then the serial number on that one
starts with seven sex seven six eight
all right so let me connect up to that
nia
um so that neo is running the open pilot
software so i can just tmux attach if
you're familiar with it
um and i can go in
to something that's
shipped in open pilot self-drive debug
um
i don't like showing my computer screen
unless i think about it more
um but yeah so i'm just gonna dump
the can bus
yeah um i could clear this and then we
could show this
okay
can you see the screen you can tap on it
to focus
so we're here with vivian and eddie
um so we're dumping the can messages
as they appear
uh on the uh
on the
thing all right you plugged in i don't
see any cam messages yeah but you gotta
you gotta hit the power button on the
car you have the key yeah it's right
there you just hit it all right we're
starting to see some messages
all right now let me just make sure
we're getting messages on both buses and
not just one
i'm seeing messages on vehicle can
i'm not seeing messages on radar can
okay
well let me just control c
and grep yeah it should be right next to
it so let me grab source
let's not sack
all right i'm still only seeing it on
one bus
it is possible the car is only sending
on one bus put it in full accessory mode
so hit the button again you're in
accessory mode
uh oh yep i'm seeing them both yeah
you're good nice all right so just just
tape it up
this is eddie over here
um this is the raw data from the car
yeah we're dumping it it's got these
nice new scissors guys they're sweet
um so no that's not running ubuntu
that's i'm actually ssh into the phone
uh running the uh it's running the os so
it's the same neo s that we've publicly
just released of smooshing that in
hopefully it's still good
how many people we got um how safe is
reverse engineering
uh i mean it's safe it's in read-only
mode right now so if open pilot doesn't
fingerprint your car as a known car it
goes into read-only mode um the prius
does have low speed like the civic
that's one of the reasons we bought it
so it's actually the only toyota i
believe with full speed dynamic cruise
control so we verified it um i mean
that's not going to turn right off
because there's still some cam messages
cool but um
cool yeah we'll you know tape it up
better
uh is that good i'm going to mount this
too no no no i want you to tape up those
wires so they're not going to fall out
right well i want to know where is this
going don't worry about that it's going
to go there but don't worry about that
just even just tape it to the
tape um
[Music]
is aftermarket radar possible yes
definitely
uh you can
buy so if you want to be
no no no no don't take it to the mirror
on tape it to the wire right so you have
a wire that you're already with yes you
can unplug that if you want and then
just tape it to the wire
um so all of the cars that have tssp
we can do
now just unplug it and like tape it to
the wire i don't want to unplug it
just unplug it in there nicely oh unplug
it unplug it if it's gonna fall out when
you unplug it unplug it now we want this
thing to be in here for a long time
all right you should do it carefully
um yeah yeah so we're not tssp is toyota
safety sense p edition as opposed to c
edition which isn't as good i don't name
these things
um yeah accord doesn't have low speed
follow tss dash p you can google it
stands for toyota safety sense p
i don't know what the p stands for
everybody the piece now perfection well
maybe yeah what do you think the c
stands for crappy
all right cool
um where do i see comma fits within big
others like weymouth well our business
model is nothing like wayneos waymo is
trying to build and manage fleets we are
trying to build after-market self-drive
capability
uh what about non-toyota cars well
uh i don't know give me your car and
i'll tell you what i know about it
um
honestly after seeing this car why would
you ever want to know
this is this is going to be our 2017
flagship car
the toyota prius
um
yeah you can get a lot of torque with
this car
uh yeah i think the subaru might be a
candidate i see it mentioned a lot so
the reason that we pick hondas and
toyotas is most of the 10 most popular
cars
are hondas and toyotas
well it's going to turn on yeah sure as
soon as you get a can message it's going
to turn on all right do you want to
check to make sure we're still getting
both yes please all right so you're
gonna have to turn the car on
and i'll come back to my laptop screen
here
yep so i still see things from zero and
one cool we're good all right so now now
you can tape it stronger somewhere else
okay all right so just make sure that if
anything if i give it a tug it doesn't
come out zip tied to this is that pretty
good yeah you want a zip tie and you
want to get some zipline
yeah the ties are pretty good um and
then we'll work on mounting the camera
are we bringing these folks for a ride
audi's uh oh well maybe yeah i think we
can bring them for a ride they can watch
me fail and crash my new toyota wall
over there yeah yeah um
yeah but we'll get it mounted up we'll
go for a ride
um
yeah we will take you just for a quick
ride
and then we can go back to the computer
and look on the dongle id of the new neo
and then we can analyze it but i don't
think we're going to show off how we're
going to analyze it yet
no that's gotta that's that's that's
that's gotta be one stealth mode on that
yeah
um
but um some of you may already know and
if you know well you know it's a secret
uh yeah how did we increase the torque
by six percent well it turns out that
the honda accepts numbers that are six
percent bigger than the accurate uh we
didn't know this but i reverse
engineered the firmware found that and
then we upped it to uh hex 9000.
drive around the huli campus yeah yeah
and go home i'm dropping the mountain
here with cabin bells yeah see gavin
belson there
we'll take videos of his face good thing
we're not in europe
um because some guy got a ticket for
using shifter in spain are you really i
don't know he really wasn't before
shifter no no you date a privacy laws or
something um so if you're in the eu you
know europe cares about your privacy man
well europe is an authoritarian
government that's what it looks like
right don't get political on it the
chinese the chinese though the chinese
don't care about uh well no the chinese
just block it look at how beautiful
eddie just did this job how about hiring
a couple full-time automotive techs we
don't do that much with cars actually um
we're a software company an ai company
we just rig up our cars once or twice
and then uh
we're good to go
well now the people are showing up 91
92. damn i guess they're all excited to
go for a ride and they're brand new
toyota prius this is like this is like
everyone's yeah this is your new car too
that's true this isn't just our new car
george get power from interior light
instead of obd that's not a bad idea
this no they're saying
i'm going to charge a phone from the
interior i don't know it sounds
dangerous you're putting public lives at
risk for your experiments and
entertainment okay we're about to drive
a car and
oh my god log some messages while i
safely drive around the neighborhood
my neighborhood you guys don't know
where it is
yeah so everything everything's in
read-only mode right now
um you know we spend a lot of time in
read-only mode and
now let me let me take a look okay here
would be good actually if you want to
come back here and hold the camera and
switch you like it there i do well let's
let's turn the camera on and see what we
get all right let's switch
all right so we can turn the car on the
camera should turn on
it was a pretty good maneuver on our end
george oh yeah
we should be filmmakers i'm gonna be
just like uh who's that boy casey
neistat yeah yeah casey neistat you want
to watch this
yeah let's get them on our periscope i
like that personally you like that
[Music]
um
yeah the camera could see pretty well so
the higher up we are the better it gets
yeah i mean we could go there you want
to go there let me let me see from the
driver well no then we can't slide it
off what oh we got a slide yeah so we
need like that maybe more like there
right
if uh yeah if that's okay calibration
well yeah
i mean i don't really like that you
can't see the hood
and we have the same slide-off problem
so we could just go maybe we can go like
there you know
can you see it hits the mirror i can't
see anything you can't see anything okay
you're thinking down there i like that
oh actually this angle works pretty well
i was complaining about the angle before
but
um okay let me try let me see from the
driver's seat check it out
take my tape back
uh i wish it slid off the other way yeah
you know
i'll get down there
i kind of like it there as well actually
it looks nice it's pretty nice um
that looks nice all right well then you
know what maybe we just accept it
doesn't want to sleep it's in the table
notice that it doesn't slide off
it's fine for now we'll pull it off
plenty of those mountains
somewhat centered maybe it's pretty good
so you're allowed to have a five inch
square part of the uh
uh the windshield to mount on under
california state laws
yeah i wish we had almost another detach
mechanism you know
we'll work on it more
things to know just a note all right
cool
okay
close up the doors let's go for a ride
here folks you're gonna stay here all
right wait should i go in the front yeah
come the front of this easier um
this is where we leave eddie
um we're gonna have to take my phone off
wi-fi and switch it to uh well we'll see
how seamlessly it switches over
but yeah
um so of course this is not calibrated
at all we don't actually expect it to
work but we do expect the logger to work
um so this is going to log everything
while we drive and i'm going to take it
out and we're going to try to trigger um
mount these cables a little nicer
yeah we're going gonna try to trigger
both adaptive cruise
and lane keep assist so we can analyze
the logs later
and um
what did they ask
they're not talking right now
i said viv something oh oh i missed it
not ready to drive why are we not we
ready to drive i think we're ready to
drive okay
let's go
ugh getting out of here getting out of
this driveway is terrible 26 point turn
here we come all right
well let's try this maybe does this
maneuver work
you know what you know what's going to
be great the day that we have like
like some really fancy optimizer
figuring out how to do this for me yeah
well they're almost there let's use use
some like a star search will the gopro
mount work
what don't come out they're asking if
the gopro mount will work today oh for
what to the window mount oh that you
want to use the window mount for the
phone they don't like you holding it no
they're just asking oh i mean oh oh well
this will this mount working
over there let me let me focus on
pulling out of this driveway first i'm
getting distracted um i think we're
gonna clear that of course
we look like we're gonna clear it yeah
yeah oh this toyota's got a tight i love
this car you guys this is amazing this
car is pretty oh that's my seat belt
it's angry at you yeah you got to strap
in bro
well i'm actually on private property
right now so you don't
yeah once we leave private property i'm
putting a lot of trust in this rear view
backup camera i should check my entire
surroundings oh shit oh
that's fine that's just like it's a
plant i know
don't be worried
that's pretty good though like i hope we
can tap into those
is it the side radar do you think
okay i mean all right this is annoying
back up quickly
don't back up quickly i mean back up
quickly by avoiding the plan okay so now
it's complaining about oh shit it's
complaining you see this suction cup is
really good
all right
why is everything beeping i think are
you still in reverse
[Music]
there's nothing on this side you're just
weird okay i'm clear there yeah this
thing is literally wider than my car
so just turn a little more that way a
little more that way okay
cool why is this thing beeping like i'm
about to like you know burn a house down
or something is this a trucker
why is it beeping
i think what you're going to drive
you're going to be fine yeah all right
one drop all right cool
wow we are absolutely different if it's
friday or thursday oh the roads are just
getting busy oh
hello
people on our periscope
yeah we got congestion here
yeah it's fine all right
we gotta be aggressive
um
oh no
oh man sorry folks sorry folks uh so
let's head toward the highway let's hope
that we can get everything to trigger
before we actually reach the highway
yeah
um i'm gonna full tank yeah so yeah the
things that we're trying to do right now
this is our
how many people with us 65 wow and we're
still online like lte and so actually
don't touch anything else no
don't exit periscope whatever you do i
exited periscope before and i had a baby
i know i was watching it and it just
stopped i had a bad time
all right while we're here on board
let's figure out how these things work
oh you want to you know what no we we
can't leave the people we should finish
the drive with the people why what were
you going on the periscope we could put
the email music on no we can't leave
them
um so we're logging all the cam messages
through this camera um hopefully
use on expressway only beware of
stopping or merging vehicles
okay let's go
on a convenient little display there um
so i found the cruise control stock on
this car left a lot to be desired and
i'm always afraid someone's just gonna
skyrocket out of there you know
um okay cool
so the radar is ready so let's engage
cruise control
all right it's detecting one lane i
think my cruise control is engaged at
36. it's the it's the actually the
automotive system that freaks me out
more than mine because my system is very
predictable
all right is it going to stop is it
going to stop radar come on
it's not stopping oh no no we're good
look at that cool we're good we're good
all right so that was a very
uncomfortable i was nervous yeah no i
wait like it stopped early enough but
okay so i honestly
they should understand this the problem
is when you're hitting the brakes you
don't want to apply more pressure as you
stop because then you have this huge
jerk at the end and you want to minimize
jerks so what the controller in open
pilot does is it applies harder brakes
at the beginning and then smoothly lets
off the brakes that's how humans use the
brake that's not how this acc system
uses the brake so i press the
accelerator pedal to resume this is a
safety feature you see on a bunch of the
cars tesla doesn't do it so you can see
that everything is miscalibrated too but
that's fine
um cool so we got an acc breaking event
um which is the first thing we need to
get now the next thing we need to get is
a lane departure warning event so we
have to make sure that there's nobody
around us when we do this and then i'm
going to let so this thing does not
apply continuous torque to the steering
wheel it only applies towards the
steering wheel above 32 miles an hour
and when it detects that i'm about to
drift out of my lane so let me adjust my
mirrors here and we have no one to our
right so i'm going to drift into the
right lane here
all right let's see it's putting torque
on the wheel it didn't put any torque on
the wheel so let's try it again
all right here we are in the lane we're
drifting out
yeah okay put a little bit of torque on
the wheel cool so we don't have to go to
the highway
let's uh spin this thing around let's
take it home and then we can um
well we're not going to show you how we
analyze it because you know you got to
have some secrets um but you know
secrets don't stay secret forever maybe
uh keep your eyes out for an
announcement next week next week next
week yeah we like to sign up so you can
see that the uh neo is miscalibrated
but um that would fix itself if it was
getting the right data from the car the
calibration routine needs both the
steering angle and the speed of the car
um the new calibration routine won't
need any of this uh the new calibration
routine will be in the cloud so as soon
as uh we have a twin car we have a what
twin car
a prius well i think it's an updated
prius like it's like
toyota by the way guys shout out to
melody toyota we bought this car yeah uh
great people uh yeah they take their
time but great people they take their
time but yeah great people we were fans
um unlike that time we tried to buy a
tesla we had a great dealership
experience but then you know we had a
less pleasant experience the next day
yeah we got tonight yeah we got we know
how long you know they just wanted to
talk to us they wanted us to one of the
comments maybe sign a couple papers have
a car i'm not big on that kind of
conversation i think you know we don't
we don't we we let anybody buy our
products right
um maybe it won't be nice we had some
cooling in here
make a u-turn here we don't do anything
illegal on the periscope right
so explain what's going on inside the
lane with lane keep assist that's
allowed you to grab
um that's allowed me to oh yeah so we
assume that the camera we've tapped into
the camera module and we assume that the
camera module
sent
some signal to the rest of the car to
tell the steering wheel to turn right
so we've logged that signal we've also
logged the braking event from the acc
and then
all of the data is being logged by
openpilot and this is just normal
openpilot just like how you can download
and then that data is going to be um
sent up to our cloud
where we'll start uh reverse engineering
it but you know if you have if you have
the right stuff you can get access to
your data as well like if you you can go
into our driving explorer if you have
can you can click on the purple check
mark
and uh we'll check it out if you have a
panda
if you're you know one of the one of the
special people all right green green all
right let's go
look at the turning radius of this oh
this car man man i hope you guys felt
that that was great i don't think they
can feel it i mean they can get the
sense of feeling you know yeah no the
turning radius and this car is pretty
amazing all right so let's see if we can
radar fuse in the stopped car actually
i'm sure the radar is tracking that car
up there
so let's come to an uncomfortable acc
stop again oh gosh
if we see it if we see it will we see it
will we see it
yeah it's doing pretty well okay okay
not bad
i feel like it's good as long as it's
only using the regen on this car so it's
a hybrid it has an electric motor um
it's good with the regen but then when
it decides to apply the brakes it's
using like a really bad linear braking
model
um which is not how uh how humans use
the brakes right you know you get a
driver who's really good they teach you
this in like limo driver school you want
to step on the brakes hard and you want
to slowly let off as you come to a stop
um because of jerk
this is not this is have you been to
lima driving school george
no but i know how do you know i know
people who have you know i know people
so fun yeah right
um cool so up
no so it just kicked me out because it
says there's no preceding vehicle
um the cruise control on this car for
some reason if it loses the lead car at
low speeds it just disengages the cruise
control
um
i don't really like when cars do this
so if you saw it just kicked us out
uh
pokemon doesn't do that
i hate these cars have creep too they
like they put so creep is when you let
off the break of a car
it um
creeps forward right now there's no
reason this car should have creep
like why
yeah yeah and it's uncomfortable too i
think the tesla actually lets you turn
off creep in settings
um which is cool
that's cool tesla to do that tesla's
pretty cool that's pretty cool creep is
smooth acceleration
i mean creep is
particularly smooth i would rather that
when you don't press the pedals it
doesn't move right like why do cars have
this weird thing when you're pressing no
pedals they move slowly forward
what genius cam okay so there's a reason
it was true in old cars but there's no
reason it's true in this car which shuts
off the combustion engine
this is a sketchy turn yeah for humans
yeah for sure yeah right but hopeful
pilot will learn
oh let's see oh
can the blind spot detectors go off i
haven't seen them go off once yeah
like there's a car there why isn't the
blind spot detector going car's gonna
honk that'll be your plan are they
disabled or
we'll have to go through the settings i
mean i hope this car has it
theoretically so this car has rear cross
traffic alert as well as some side
radars if the user manual is to be
believed well i have to
yeah phrase you got it yeah yeah yeah
you got it we gotta look at the user
manual but um no it's uh this is a
toyota prius two which i was amazed that
it had oh we're gonna show you guys the
south park we're gonna log back and get
back to the place right and you're gonna
see some real torque be put on the
steering yeah that's amazing um
so yeah the camera doesn't control the
south park the south park is done by
this other module in the car that all
the ultrasonics go into and stuff
so there's a chance we're not gonna
capture that we'll probably have to rig
up the same sort of camera wiring
harness for the electronic power
steering you can see the can going right
into the eps module
um yeah so we'll overshoot by one
pull in
we'll try out the park and then we will
wave goodbye to the folks on periscope
wow that'll be stuck i know right how
about battery four people 54 people um
oh ev mode ev mode not currently
available
am i in ev mode
using the button oh i'm in evmo all
right cool they say turn the blind spot
oh that's your blind no on the buttons
on steering wheel which buttons
uh
this is your turn
uh that's not my blind spot we can try
to turn that on and see if we can
trigger that
oh it's turning off ev mode i had to
start the thing i like ev mode
all right we're gonna we're gonna go
through the very confusing menus
to see if we can get the blind spot now
we'll do one thing
yeah
um but for now we will pull in here and
do the self parking which is
surprisingly good i really have a lot of
good things to say about this quick it
feels great i feel good in it well it
goes as fast as i press the pedal you
know
oh yeah you still do the pedals yeah it
yelled at me for going too fast oh yeah
of course yeah yeah okay you went fast
so yeah let's make sure there's no one
behind us that we're gonna make too mad
all right we're good all right i'm
pressing the p button
parallel parking go forward
space detected go forward
the vehicle
shift to r
i want to see this
applied brake check surroundings look at
this see now that's putting a lot of
torque on the steering wheel you know it
takes a lot of torque to turn a wheel
when it's stopped
um so let's see it's going to turn back
here this thing is impressive
and it's actually kind of useful like
i'm afraid that i would hit now i hit
the
curb okay i hit the curb okay oh it was
cool there was something
carbs are hard you know
let's just park this guy
and then let's um
suspended steering wheel turn great work
on your uis folks
yeah cool
um so we're saying goodbye for now this
was comma
shows off our new car
and starts on our toyota port thanks for
watching
okay yo yo yo let's get back to this
we're back okay so that was a call very
excitingly from get around we're going
to racetrack tomorrow and I wanted to
drive down in a Tesla with the new
autopilot so I have some bad news about
that route you posted it's still too new
so this one's too new for a different
reason
see that pulled data but still can't get
Sat position something is wrong so
what's happening is we're downloading
from NASA's servers all of the ephemeris
data um the problem is NASA hasn't
updated for that so does anybody have a
grape and or out from like yesterday if
there's no sound what you can't hear me
oh there is okay good you can hear me
right it's working good huh yeah you got
that now you all got sound you broke
your shit alright so we need an older
rekt gotta go older gotta go older than
that one who wants to volunteer an older
route I think one day we can do but this
is still from today though I don't know
I don't understand this pulled data but
still can't get sad position let's take
a look at the code and get that info
this is all gonna be open sourced if L
if self auto update
yeah it has to be a great panda with an
antenna now you don't need to great
pandas one great pandas good okay
pulled data but still can't get Sat
position something is wrong
Harold why doesn't this work pedestrians
are mapped to all right who wants to
volunteer a new route posted on slack
and I will use it you need to have a
gray panda and it needs to be more than
a day old yeah so the prom is that
didn't get the location of the SATs
right so here what happens when I try to
run it is look if it brings up the
mapping interface it downloads this
stuff but it can't download this no this
looks so solid because of your new maybe
I was showing off the thingy in one of
the deliveries yeah
no just just a gray kinda just a grape
and is good but no Harold's not here
leaves all around
yeah yeah
all right we're gonna stable get around
called no they're like I can't make any
guarantees they like took some
information down to make me feel
important really yeah right the scope is
like it alright so who wants to post a
route in the slack that they want to
volunteer yeah so just right now pulled
data but still can't get sat position
something is wrong okay oh we got we got
a newer one now I'm a blogger just like
my hero Logan Paul and PewDiePie
alright let's try this one oh no that
didn't work at all Oh see guys we still
have a lot of work to do on our mapping
I don't know what the problem with this
one is what's your dog like dig in you
gotta give me a dongle I think I can
look it up in secret user admin tool but
I don't know why that one didn't work
that one just screamed at me oh that
might have been during the great
database
no it's Python exceptions the mappers
really flaky right now we're gonna make
it work though we're gonna get it to
work on one route so Larry I need your
dog lighting
don't have a good way to search for okay
I'm gonna let's let's move the scope
he's over here oh oh sweet we got it
okay we got it done waiting alright
let's type that in here and then let's
try like minute 12 it's driving it fly
oh come on work work work work work oh
oh oh this is exciting okay it's running
log oh that's way long ago now I don't
know if way long ago it's gonna work but
okay all right it's cashing your frames
this is exciting it's gotta run a few
logs let's go let's go let's go it's
very exciting I know back but you guys
when it starts making Maps it gets super
exciting I will move the mapper over to
this screen here yeah so it's waiting
for images now so it's got to finish
processing the logs now the one that
might fail is called mesh three geez
okay so this is mesh 3d now okay we're
downloading all the data from NASA
oh yeah download data from NASA come on
data from NASA now basically if your
route makes it through all of this that
means it's a Goldstar minute okay all
right we're downloading from NASA this
is pretty exciting a little slow today
this mapping is brought to you by pure
leave unsweetened black tea the purest
why do we need a femoris data so we know
okay so now it's trying to get a fix
let's see if it can get a fix oh it
hasn't gotten a fix for a while now this
is another bug we need to fix up but
this is the closest we've been so far
come on get a fix see it's trying to
initialize
no you won't be on sizing the mapping
pipeline we will be open sourcing the
localization cut down oh yeah you got a
map backwards you guys don't know the
trick you got a drive back with you liar
drives backwards he knows that map ok
but it's not actually mapping yet let's
try a different one
let's try the previous minute but this
route to the furthest we've gotten so
far ok mine's downloading the ship from
NASA not everything always downloads
from NASA only the ones that fail it
prints now he's not yeah changed it why
backwards for mapping ah basically it's
very easy to get the depth of things
that are close and not the things that
are far away um you know you can also
use a camera pointing backwards works
pretty well
yeah ok so it's running mesh 3d I hope
feeling up there's just a lot of bugs
and mystery dirt that's why things not
working ok so if you see here the red is
what the gray pandas saying and the blue
is what the cameras saying and this is
of course in full 3d oh yeah you see the
traffic light some of that oh good no
that's really good yeah yes you see
those traffic lights there hey cars
ponder those traffic lights there yo ok
guys one mapping yo I'm telling you
every mapping company you're gonna cry
when they see how good this is how many
map point per feet I mean you can look
at all the map points we're really not
skimping on the data here ok so it looks
like we just kind of spent a lot of time
chillin at this light
we're gonna sit in virtual trip we spend
a lot of time in comas sitting in
virtual traffic I know right those
traffic lights are maps like now we know
exactly where in the world they are see
you know the ones back there the ones
over here I know we do sparse mats not
dense mats you can't promise the scope
is too much you like you like you know I
wrote the mapping the the next thing I'm
about to show you when we look at the
maps oh they love the mapping this stuff
is accurate to 10 centimeters and each
one of these points like okay well
there's a tiny disparity there will come
a V the V block can be open sourced okay
so we'll give it a little bit more time
um Larry coming through with the map
this is a user Rhett this isn't even my
round we do get your pictures in color
but the maps are only made in black and
white right now
[Music]
that's kind of true that's why we spend
more compressive this on it alright so
this is like a real 3d map and then what
we're gonna see assuming the next step
works is we're gonna insert all of these
points yeah this is for self-driving
this is so we can know exactly where
every car in the world goes and by
knowing that we can we can train models
better we can offer things like traffic
lights and stop signs and all you need
to make all this possible
but all you need to make all this
possible is an eon and a gray panda how
do you map trees too we do map trees
though we do also know that they're
trees we run a sag net sometimes but the
second up takes even longer so if you
thought this mapping was slow we're
gonna run this of course on a million
machines in Azure how we're features
selected from a city in Oregon how our
features selected yeah well then you
don't need to rely on land Marcus
mappings pretty good see like we know
exactly where that car traveled right so
it's really cool is um Larry I don't
know if you drove if you drove through
there on another day but if you drove
through the same place we can try to
even localize the two with respect to
each other this is a derivative of an
open-source program called orb slam
we're using some parts of it using an
optimizer called g2o I started for the
charge cable of you you do have a charge
cable don't worry it's not fighting any
features on that have we used up as
you're free credits now we still have
more but yeah we're making maps so you
see we're hacking the poses in a running
pose optimization to make sure that's
all good we're computing the cameras
calibration at every stat do we map
lanes yeah you see what mapping lanes
right now you see all the features on
the links um so we know that they are we
know that they're lanes from our from
our segmentation network okay so now I
was writing the map to the desk and then
it's gonna put the map in the database
oh and then we can figure out where that
was
what if there's a roadblock the maps are
cool we like the maps global maps yeah
oh no we're not gonna start using
thousands of us okay cool
so that's done alright so now we're
inserting the map into the database cool
okay so we have the origin here so let's
go in here
I don't oppose slack I'm close to where
we mean Twitter you never knew Twitter I
can copy/paste the origin of the map
here so we can know kind of where we're
gonna have to lock right right over here
here's the start of the router ah so
where are we oh we are up an organ or up
an organ all right cool all right
between Eugene and Portland sounds good
umm so we're gonna insert keyframes now
we're inserting all those points into
the map now this is of course gonna run
a massive scale this is me just testing
in a one computer we're gonna run this
automatically as part of our pipeline
and all your routes come in and they're
gonna contribute to the map alright
let's go to the map now
it might totally be wrong this is very
beta stuff all right there we go we got
some points up there up in Oregon let's
zoom in zoom in oh yeah this is the
greenness where the car went it loads
everything in yeah so basically your car
is gonna live stream load this all in oh
no oh no I clicked oh no a mouse slip a
mouse slip you guys a mouse slip okay
we're going back
I hate we're on our way to Oregon it's
gonna take a little bit to get there oh
wow we got a lot of scope ease up oh ok
let's refresh this let's go
okay so we have a bunch of different
maps down here like we can track we
check dis engagements on this map we'll
just go down here to orb slam alright so
we'll go up here back to Oregon oh yeah
here we go and here is that segment that
we just mapped I won't slip with the
mouse this time I'll be very precise
with my movements yeah and that's full
three dimensions so you can see how well
the lane markings line up with the road
pretty well so these these are the trees
you should give these all color we can
go down here we're building a full 3d
map so you see that these maps are
actually accurate to which lane you're
in umm they're more accurate than the
other than the satellite imagery
we're gonna see if you zoom up see those
are the maps of the trees what does the
point fix up I don't know what that does
but those people just showed up let's
try mapping another one of those
segments it's got to run a few frame
gashes but yeah so that's what our our
complete maps of the world are gonna
look like we're gonna go a lot further
with this we're gonna offer we're gonna
add color we just got this working
tonight guys this will be available to
everybody
this is the kind of stuff we're gonna
we're gonna open source I mean then
we're gonna provide an API for people to
localize within the map and you know
it's just there's just so much stuff
that's possible with this technology
yeah yeah so everybody who has a gray
panda and an eon will be mapped and yeah
I mean that's what the Goldstar minute
program is for so if we go over here to
our medium we can look at the Goldstar
minute every route that Matt matches
these requirements here we go look we're
mapping another segment here
why gray panda because we have to know
not just where you are locally but where
you are globally here we are making
another math we live one camera so your
subjective things like scaled if no
great neighbors have gotten stock they
will be in stock at the end of the month
but um yeah look at all those points on
that house that's gonna be a nice map
all right guys
mail a gigantic big gold star maybe we
will mail I took big gold star whoever
gets the most you have to be updated to
four point three as well so gray panda
beyond open pilot four point three four
point three one check it out it's in
devel
how many gray at the end of the month
we're getting 250 and then we're gonna
get another thousand at the end of next
month
so there's gonna be tons and tons of
great pant is available for you people
to buy alright guys I'm gonna show you
something else kind of cool I'm gonna
show you something else that just that
just blows my mind um we're gonna head
downstairs
come on Wi-Fi here's my Amazon review of
a panda I gave it three stars we need to
work to make it five stars
what does Eddie been up to oh we don't
talk about Eddie's up to but we will
talk about this guy's
welcome to Akane I stopped have you ever
seen
ar e on Z yawn yawns yawns yawns yawns
yawns these things are moving man we're
moving weight yawns are just shipping
shipping shipping we got a bunch of
midnight blacks over here
I'm just 10 yawns in each one of these
boxes so we literally have hundreds of
yawns yawns for days sorry if it's
frozen but my investors happy you'll
have to ask them
I don't whoops all right guys I'll come
out of closet
come on frozen we see our testing closet
sure you guys seen her testing closet
cool yeah I'm out of the closet yeah
sweet you guys know the
3d printer lands here we are in 3d
printer land
out that room yeah well out of that room
San Francisco 3d printer land so smooth
love this thing show you guys the GPU
form I will show the GPU farm few farms
over here
you know I'm me really on those
computers down there
where's Fillmore let's see where
film-wise get cam we got Gio we got
pistachio no is feel more broken up this
film are more right there yeah the
coarser cases are pretty nice right
alright guys thanks for joining
that was mapping this periscope make
sure all for and updates yeah no and I
have to Ford up its yet yeah guys check
out you know always a calm down AI slash
shop buy stuff buy merch guys if you
think the map is good now like we just
got that working tonight
we're gonna continue to work on that
we're hiring we're hiring um we came
into some money recently so we are we
are hiring if you're good or you know
anyone who's good we're hiring for
people for the maps no we're hiring like
a serious team and I'm gonna give it all
away we're gonna give it all away we're
gonna give it all away because maps
should be free so if you work at a
mapping company or Adelaide our company
I'll be afraid because kawaii is coming
for you get your yawns get your great
pandas help out in the greatest open
sourcing mapping effort in history
you thought ways was good this is ways
2.0 this is uh this is way better how
higher thanks guys
okay you guys my phone's about to die
and I don't have that much long to talk
for but we have spotted a way mo in the
wild all right so we're just we're just
cruising along here with it without my
pilot you know we're out we're gonna
testing our self-driving car look we
have real statistics and stuff well rich
stop and look what we're rolling up next
to look it's a lame-o really get the
good shot oh yeah right
and here we are carefully rolling up
next to away mo it's gonna pass us again
on the left it's like seeing a lion
it's a lame-o it's come to our
neighborhood to spy on us with all of
its spy gadgets it's kind of light are
in the back
which still in the wave of bandwidth
[Laughter]
that's mostly what we wanted to talk
about we can't show you any of these
features because they're part of the
good secret version of open palette but
we did see a muffled by bees
yo yo yo good morning snow peas good
morning comma army come on of us five
there buddy we got some exciting stuff
for you today I can't show you these TVs
there's secret stuff on these TVs um yo
yo that guy look no we got new products
that they're actually kind of excited so
let's give everyone minute to get in
here we'll listen to fan joy to the
world while we wait you guys know this
song called fans right of the world it's
a song about about merch oh yeah so I'm
repping some new merch right now
it's calm a t-shirt $20 right now shop
comma thought I'd check it out okay the
shirt is made from I don't know versus
like $20 right shield for a company no
we are army yeah I wish I could put my
thing on a drum we're not some
flamethrowers chick Paula's no two
backslashes
all right
let's get everyone maybe we'll get sixty
people and then we'll go over the new
products shop that come that I'd check
it out no beanies we have launched
t-shirts for twenty dollars now we'll
just go now let's go um so
drop up here hopefully you guys are
seeing the same shop I didn't actually
check it from an external IP but please
make this stream in 30 minutes not the
streams right now you can watch it on to
replay but so first the hoodie is gone
there is no more comedy i buddy if you
got one that shit's gonna be rare and
valuable because now all you can buy is
a common AI t-shirt okay okay we heard
you we aren't a high-end fashion brand
we are a tech company we sell a company
t-shirt for a reasonable price
so actually have to do this on this
monitor because dropdowns don't work on
the other monitor so the shirt comes in
four sizes it comes in medium large
small and extra-large all the sizes are
$20 except for extra-large which is $30
so the extra-large shirts are $30 don't
worry we'll get to we'll get to the
other products that I met at the extra
larges or $30 but all the other shirts
are are $20 you have to pay the extra
large tax okay cool
those shirts take up a lot of room we do
have a fulfillment packer absolutely all
right now you know hey man you know
we're not gonna shame fatties we're just
gonna charge them $10 more it's fine
fat shaming is bad but charging $10 tax
that's good we gotta incentivize good
behavior uncle now that that's out of
the way we can get to the actual product
launches oh we got 65 people in here all
right all right all right
so the comma space add two USB and an
Ethernet port black Leon here my
midnight black e on let me just show you
how this stuff works
by that Murch bought a primer cool so
this is the midnight black eon you'll
see what actually i use a comma space
you know I'm not even lying like I use
this stuff this is a commis maze this is
the first of the three development
products you know we're interested in
making our development as accessible to
the world as possible so here's a here's
a commis maze just like the one that you
will get it adds two USB ports and an
Ethernet port to
Rhian do not plug this into your giraffe
it's not that kind of Ethernet it's
plugged into a computer a hundred
megabit Ethernet port for your e on this
side goes into the e on and this side
goes into the panda so you can continue
to use it as before you just get an
Ethernet and two more USBs perfect if
you want to add like cameras GPS is
anything you can think of now you're
about to get banned sup plugs into the e
on like that nope it doesn't work with
neo Neos are kind of retired we don't
really use Neos anymore look if you're
buying a $60 USB hub from us you
probably are the Neo kind of person
you're the young person cameras you can
do whatever you want
um I don't waste me oh yeah neo
Deathwatch I don't wish them to die but
yeah they're kind of diorite Neos are
kind of over you guys Neos are over in
the same way clip alright cool so that's
the comma space add to USB and Ethernet
port to Erie on we could just click in
here and see what I wrote allianz have
the same ip address 192 168 5.11 um be
like a common employee you can buy your
common space this is life right now on
shop comma a I everybody can go check
that out now the second of the new
products the Panda debug board use a
debug board and develop like the pros so
what we use this for you can see that I
have one here it's a good way to get
power to everything so you can power
things off of 12 volts you just take two
pandas here
and shove it in here and what we use
this for is it basically you connect one
of these to a neon you connect the other
one to a computer and then you can use
your computer to emulate a car so it
just connects these two pandas together
you can use it for you can use your
panda development you could use it
any kind of development you want $100 so
you'll see you like see the unrooted we
just read with the CEO let's reboot the
Seon and then I'll flip the switch that
like virtually starts the car they're
pretty cool or what car can you emulate
so the open palette software can emulate
a Honda Acura ILX so you can emulate
that we include a high quality 12 volt
adapter here so this is good for
emulating car Oh bro you don't have a
panda you've got to get a panda how long
will this integrated you know - there is
no eon - there is only yon you know and
get your last midnight black eon that's
an icy on man
that's an icy and you can buy your today
right here at shop comedy I we got eons
for sale right here - yeah - camp dad
kit maybe you guys want to drop down
I've told you drop downs don't work on
this monitor they work on the other
monitor so you might want to get that
midnight black get that midnight black
eon so let's see if this one's got a
boot up I don't know if it's gonna boot
up I don't know what stay my yawns all
right this is this mic this is my
personal development Aeon so every comma
employee has this stuff on their desk
has a debug board has a commis maze yeah
so you can play back your idea we're
working on open sourcing the tooling do
that that's basic
yeah that's exactly what we do with that
so we just take a this USB wires
connected to my computer down here and
that brings us to the third of the
products this is a panda Paul and what
panda paw does is it makes your panda
unbreakable so you can go in here and if
you press this button it'll always go
into boot mode no matter what you flash
it on it right so I just connect this
guy right up here and now we're in we're
in emulation mode so this is every
product that's launched all working
together this is the setup on every
comment I employees desk
here's a commis maze that's comedy bug
board those are obviously pandas this is
a white panda this is a gray panda there
is a pan to pull right there and you see
that it's connected down here in my
computer cable not included a panda paws
are very cheap throwing $20 say price a
t-shirt add a paw and make your Panda
unbreakable so we could view the Panda
paw right here berkshire panda you must
be kidding because panda unbreakable if
you have the convenient panda paw
uh now to be fair if you only making
small change to the firmware probably
like the briquette but if you want to
make big changes with confidence
get yourself a panda paw today for sale
at shop calm down AI shop kamidana yeah
i we have a car simulator and we have
replay we have both there's actually
open source car simulator in oppa violet
you just run board d with mock equals
one and we'll be releasing some
instructions on how to do all this stuff
but first we're getting the hardware out
there so everybody can buy that merch
alright so you'll see that the way this
works here's my Aeon let's give it a
second round of funding who talked about
that I'm talking about that
so wait that sounds like fake news okay
so I can just flip this switch on the
debug board and it'll basically start my
virtual car so you'll see that the power
is up here and this is a great
environment notice that green light
comes on so you know that your car is
started and now it's you know just like
starting
virtual car so how nice is that guys
this is how we do all our developments
GPS capture yeah the GPS is in the
flyback we're working on external izing
those tools over time but for now we're
open sort where we're releasing all the
hardware on chop comedy III you know
people you don't know tell me about my
second round of funding
I don't got shit all right so we got
panda paw we got ass maze and we got a
panda debug board small announcement
nothing too big this is mostly for
developers of course we have come AI
t-shirt by your commented a for the very
reasonable price of $20 great pandas are
coming well here's a great Panda they
are in progress coming very soon notice
it says gray on it that gray panda yeah
great pandas are coming along really
well here's a naked grape Anna
here's a what are the new pandas
shipping out oh you mean the injection
molded pandas injection molded pandas
will come out mid-february probably
whenever they get here who won the
contest all the contests all you
remember I'll talk about that later um
it would be spelled gray wrong no wheels
no gray wrong Gray's with thee
it's with thee everywhere it's with the
e we tried really hard to do we had a
company meeting where we know it's not
gray inside we fixed that Rose you fixed
that fix on that one so what I could all
get that one bottom no we fixed it brows
we fixed it all right let's see yeah our
orders coming in let me check let me
check the admin panel let's see if we're
getting orders yo we're getting orders
today shits flying off the shelf
everyone's buying t-shirts Brown went
buying a lot of t-shirts you guys invite
a lot of teachers guys we got a lot of
t-shirts we bought these in huge bulk
because we know comm AI t-shirts are the
hottest item on the Tommy I shop so get
in today
buy a t-shirt buy your space by your
debug I never stop shilling and comma
are me go out there you know no no no
Susan I was talking about starting last
my friend okay so we have $20 t-shirts
now this is typical for a tech company
and like we look at our hoodies and guys
the hoodies are nice but but is this the
a/v company or mark it's all the same
bros it's all the same ballpark and
number of Aeon sold hundreds we have
sold hundreds of eons and thousands of
pandas and by the end of this year we're
hoping to 10x both of those numbers will
be selling thousands of units and tens
of thousands of pandas these things are
flying off the shelves we can't keep
them in stock quick enough some of you
guys might know that if you bought a
panda nothing showing up yeah don't
worry we're working on it they'll be
coming you real soon real soon we'll be
getting you pandas on pause they're
shipping out right now spaces they're
shipping out right now and debug boards
they're shipping out right now if you
hadn't guessed you know what let's go to
the stockroom I'll show you guys the
kind of stock we got and then
the scope is kind of our military badges
I want to make nice comma uniforms right
like army uniforms right
um so come over to the debug we got
debug boards we get deep on boards for
days there's some debug boards right now
you can get this smooth can be your
everybody we got giraffes for days look
at all these giraffes Toyota giraffes of
the giraffes bros we got we got stuff
ready to go we got eons up here these
are V arms got plenty of yawns oh yeah
you notice how I'm not showing any
pandas in progress
so dad we didn't Hannah's listing now we
are getting some patties okay grab the
panelist have a few pandas no I actually
sent them out I think we've actually
sent out every panda in this place so
there's no more pens all right cool
thank you for joining and we will see
you next time
comma army bumper stickers and decals
you know we can't do everything
we got t-shirts we're listening to what
the people want we got t-shirts go buy
your t-shirt right now if you haven't
shopped comma dot ai go buy merch you'll
feel good thank you
Oh
Tomiko Vegas
which is no loss of the season
at a PC out never all my hopes for this
battles get me so good you guys
my dream one more
now we Chi are you know our steering
wheel can turn at low speeds there's gas
[Music]
we type through the ICO
[Music]
one time I touch the screen
[Music]
let's mess your camera
[Music]
most of driving is leading in traffic
like this
[Music]
I'm really a member
[Music]
oh it's Evans least 20 minutes come back
alright this why did you get fire
[Music]
and we'll sweater open can save 200
bucks
[Music]
[Music]
the model do
it's just getting this getting so good
and I think there's been some tuning
guns or the control oh
you guys zero point three point four
they're gonna scratch that guy
I don't know is it the model or the
control why does it feel so good I
think you'll get the bonus
come on we haven't been in the car
[Music]
yeah well I was gonna pull no I also
haven't used we change the way to model
strands or channel awesome
[Music]
and that's like that's not
it is a nice little ol boss but you know
what's really bad
oh you guys won't believe this
- I've never felt off the toilet yeah
so good
they look at a button
compared to the old one
this is driving better - thank you
this literally this is better than me
[Music]
[Music]
[Music]
and we gotta go to the airport I'm gonna
miss my flight already
check out my tie I
got important things to go to
a rap battle rap out a rap battle some
point I know TBD email
this track throw is going so small
should I change lanes yeah it's driving
so nicely oh I don't even want to you
know you guys this is
[Music]
quality quality we're finally at quality
[Music]
you should tell them how happy
there's inertia you should hold some
cash I
[Music]
don't know
yeah
I'll tell Michael he'll be good
motivation
I'm just very happy with your piloting
yeah
probably all the space they have you
know right everyone needs a hundred if
you work at comma got one hundred square
feet of space this is all I do is video
I don't like make space
[Music]
look how much space maybe make it happen
execution
what my job bro
I think it's a loss
but it's just like the waffle
Automation
good idea mom usually watch the car guys
work when their growth
got it
engage
those cards you got a think is it
engaged is it desires I know I'm on a
pedal I know it's just
you guys have no idea what's coming
- that seriously this is like the ICO is
Timothy fire but this is gonna be super
hot fire yeah yeah
nook is not this not just this is good
yes yes gonna be fire and wait'll you
guys see zero points
you don't know life
this is slightly see it drifts out
Hayate or toy export good sort
you put the torque mod back when here
for us
you might make your play
the great song
what next
today we're going to fly
I hate
all I hate puns I hate corny shit
now I shouldn't the new wasp on you to
be better about this town
[Music]
New Jersey New Jersey's best date I Love
New Jersey
[Music]
it's gotta be Alize money method
bracelets
[Music]
tell my money forget about this
not anyone local bitcoins in Vegas
get some bitcoins I could tell
[Music]
yeah let's save on the cars go back guys
go
nice Covey's you see if I can put you
somewhere nice there we go oh let me
take off let me take off this matter
this sweater is not calm a I merchandise
but this t-shirt is definitely common
and I merchandise you guys know where
you can buy them call me AI slash shop
and now I can say that I'm about I got a
slash shop let's see if that works I
love that link oh yeah comma dot AI
slash shop just like Logan Paul my cops
last shot we can now say that so there's
no new product right now you guys gotta
wait nine minutes
it is 251 if I had a large cloth I would
be showing that to you but they were all
out of large clocks at the large clock
store so that's uh no it's true I went
there and they were out they were trying
to sell me alarm clocks not large clocks
and they were trying to sell me phones
that had clock apps on them and I just
it was too much so we had to leave the
pawn shop did have some nice watches but
large box no we're not gonna talk about
large box we're here to talk about the
new product but just like The Bachelor
when they give away the final rose you
guys are gonna have to wait tick tick
tick tick tick when will you be able to
see your gold star minutes couple weeks
couple weeks we got we got big things
coming you know big things that's right
I'm so I actually have one in the new
product right here it's clacking on the
table a little bit yeah that Flavor Flav
clock you know what time it is this
right um no I actually one of the new
products right here this is the noisy
mix and you when you tap the new product
against the table um can I say
just going live yeah they're excited
there's a lot of there's 100 let's see
the three of them no no I don't think
they can see the boy let's go please
what up Skokie's what's going on here
you didn't show them the new product
you're just tapping no I was just
tapping the product using intact no yeah
just tapping it's not a do we on we will
tell you that well yeah and of course
I'm surprised nobody's found it yet when
you win it it's already live I'm
surprised nobody's famished
well it loads so nice I know right and
the font that's right I'm surprised I
even mentioned it in the periscope nice
picture changes y'all the picture
changes right nice oh it's solid autumn
you seen the best thing we haven't
believe I thought was 200 just dropped
to 90 no no don't be crazy
alright guys um you were looking is it a
projector wall clock no no no no no no
no it's not that
we're live on periscope Ricardo ready
for the new product announcement all
right guys there's a little teaser
before the new product if you guys
haven't seen it I gotta hide the product
hey it's the new website you might think
it looks like the old website but it's
new is it a job offer for Chase no
flexor a panda it's not a flex rependa
let's let's go through some of this we
wrote some copy today ah yes the future
of driving his open-source look at
phones for years every phone
manufacturer shipped a crappy operating
system they were so bad they didn't even
have names motorola razr OS LG phone
firmware some tried to do better with DB
LS on blackberry and Symbian OS on Nokia
spoiler alert those companies went out
of business then the game changed in
2007 Apple released the iPhone it wasn't
immediate you had the phone needs a
physical keyboard haters and those who
couldn't believe that it only had two G
and no apps only the web but they didn't
really matter slowly it became to define
what a phone was here is what our story
begins here's where our story begins
in 2015 I was approached by a friend to
the vision system for the Tesla Model S
perhaps as Paul Graham would say the
iPhone of cars after a miscommunication
with Elon Musk the contract fell through
but the future was obvious every
pathetic car manufacturer writing low
quality autonomy features this is phones
in 2007 sure BlackBerry's and GM's look
nice but after a few OTA updates from
Tesla they will be a joke what happened
to phone will happen to cars the iOS and
the Android the autopilot and the open
pilot common AI is building the Android
for cars we have an open-source driving
agent that runs on Honda Toyota and GM
and we have hundreds of active users
uploading the data back to us so the
system it gets better updates are pushed
out and we slowly move forward in five
years the world will call it obvious
of course cars will play out like phones
test the world on autopilot one idiot
will still be trying to run when
phone and everybody else will be running
the open-source operating system from
comma a I this is coming eyes open pilot
we have almost 8,000 stars now on github
we're gonna make this readme look
beautiful we support Honda's Acuras
Toyota's Lexus GM how can you add
support for your car easy it's open
source I went on up to the new product
yeah it's coming in a little bit 3 p.m.
guys 3 p.m. she can work with us this is
why comma AI to be honest our interviews
are brutal if you can get hired here you
can get hired anywhere you'll work
harder than anywhere else you'll get
paid less and you won't have a team to
blend into so why come nai because you
want to do something with your life you
want to see progress being made you want
to change the way the narrative will
play out you are bored and want the
world to be less boring and at the end
of the day you want to win so we have a
legitimate open positions page local
cook we're using lever I paid these
 lots of money I'm sorry they're
not a valuable partner valuable partner
lots of money so we could have no job
listings apply apply for positions that
coming I will throw it out if you just
want to email give give me a job
becoming AI that's good too I'm looking
at positions they're all engineers in
the role in San Francisco so if you're
an engineer in San Francisco we're gonna
win you want to join the winning team or
you want to join that you know well you
know we won't we won't we've set it off
terrible things
thank you thank you I did not design it
myself you can you can compliment our
design our designer did a great job with
this stuff the positions button is
broken these are broken seem to work for
me okay guys two minutes two three two
minutes to the new product oh yes and of
course the new shop build your kid
beautiful retrofit your car with the
copilot oh yeah yawns are gonna be
shipping out flipped if you buy any on
now it's gonna come flip you can add
your panda right in here you can add
your giraffe right here we're not gonna
click that drop down for another two
minutes um yeah pretty beautiful guys
it's pretty beautiful why the oneplus
are blue are they do order one of these
right now so yeah you can check out the
new shop here Aeons pandas giraffes
pause maze t-shirts debug boards and
comma powers is the quality low I think
the quality should be pretty high right
now yeah I know about I know about that
let's see if the quality tile is going
periscope right here Steve's on the high
quality this eating stream no no no it's
not a eating stream okay guys I know
what time it is it's one minute to three
that's the noise it makes
oh if you guys the websites already live
at kamidana yo bro bro the sales they're
coming in loving these sales look at
that number go up we just sold four
hundred and two dollars where's the
stuff I wonder if anyone's bought
yeah shop back home at REI is old bro
here it is the new product 3 p.m. we got
to do it on unveiling and on sale give
the network card box oh yeah it's behind
this box it's behind this box ready to
knit after this commercial break
this commercial is brought to you by the
comma panel the column peddle is not a
new product it's been around for a long
time and you can build your own kamma
pedal thank you for watching the coma
pedal commercial now 3:00 p.m. new
product reveal it's going it's going
it's the Honda bust your ass oh yeah
check it out it's the latest in giraffe
technology it has screws 1 2 3 using
active components aka a diode it's been
reduced from four switches down to two
switches only two switches even you can
remember what they do this one toggles
the camera power this one toggles the
forwarding or something like that
there's only two of them though so it's
twice as easy to remember as for this is
a Honda Bosch giraffe
check out this connector I am sorry for
the color but this is printed on a form
to printer this is the highest quality
3d printed connector UV cured and it's
yours for the same low price of $60 this
is compatible with the Honda Civic
hatchback the 2017 plus Honda CRV and of
course the 2018 plus Honda Accord Honda
Accord if you'll take three you can go
right now to shop.com ADATA yo sorry
comedy I'd slash shop don't get it
twisted don't go to the right shop I'm
sorry there's two we're gonna fix that
up later today
 Amazon bro driving assistant will
be replaced by self-driving cars that's
right with a
update your driving a system will be nah
we don't say that
bro common AI slash shop that's right by
an official comma Bosch giraffe today at
comedy I slashed shop the unofficial
come AI bashed your apps unfortunately
will cease working because they flipped
around can one and cam - they should
flip that back um we want to put the
radar on can one you don't have a Bosch
Honda then you don't need a Bosch mama
giraffe but if you want to buy three oh
there is a downside though there is a
downside the downside is that they don't
ship for two to eight weeks they won't
ship for two to eight weeks but I'm
two-day weeks you'll be getting your
very own Honda Bosch graph we are
setting it go guys any miles sake right
okay
so nice for only $60 you can plug your
comma power right in here you'll be able
to plug all future compatibilities stuff
into here this is the new product it is
a Honda Bosch giraffe this is a panda
it's not a new product but you can buy
these on
tamo dollar i slash shop as well this is
a panda but this is a Honda Bosch draft
check out the new website if you know
anyone who are aggressive now about
higher and you have lots and lots of
money this is a pedal from a Toyota what
are you gonna plug into the Ethernet
port well one thing you can plug for is
your homemade , pedal it is Ethernet zon
both sides don't plug it into a computer
though cuz the computer will blow up
you want the new what's the new Leon
you see how it's done no this is a
normally on is it feeling you can have
this Elin you can buy it today the new
Leon we are shipping the Aeons flipped
and I think we're finally doing a
shipper plus re-release so we'll be
updating shipper plus new Aeon you've
got it Geo haha comms do you have back
on still off I don't know I'm loving
these sails and love them by Bosch dress
right now bye bye bye aren't the new
cars stop and go you wouldn't why else
do you need this Ethernet port it's a
secret but don't worry your giraffes our
future compatible if you buy a giraffe
today it'll work in the future that's
right
future compatible um yes Bob man ways
yeah you don't want those to limit error
use RJ 12-month it only has less pins
dude yeah so buy your Honda Bosch draft
today it comes with two switches two
switches instead of four it's doubly
easy to remember this is a Toyota
giraffe it's not as good-looking as the
brand new Honda ba strap but if you have
a Toyota don't buy our Honda bus traffic
even though it's better looking you're
gonna have a bad time
oh man three people are checking out
right now Cree people are purchased I
got the live Shopify analytics right up
here bye bye bye what is this junk no
junk
oh yeah we're also gonna put the
ethernet cover in all the Honda Bosch
giraffes that we ship on to bust your
ass high quality stop it has three
screws that's you know it's quality this
has zero screws I shouldn't talk bad
about our other products great they're
all great all products are great
it has a lot of screws this is the stair
controller from with Toyota oh yeah this
is an active miles counter just go to
bed accommodate oh yeah you can see that
there so do we have any questions about
the Honda baath drift new open pilot is
great
what is it I didn't say that did I
explain the product oh well let's see
what it says on the website because I
don't really know what it does
I'm the social media guy let's read the
website
cars have many can buses not exposed on
the main obd2 connector giraffe like
this new one that we just announced even
the social media guy can put two and two
together
it's an adapter board that gets you in
so basically the new one here is the
Honda Bosch look that picture is the
same as this we have them in real life
it's not just main Photoshop like zukes
yeah so what does it do it design it
would tell you what cars design format
really doesn't do a very good job of
functionality it passes through the
signals to the existing driver
assistance system or turn the switches
off remember this one they told me this
in the press briefing it has half as
many switches so it's doubly easy to use
it's like unplugging but better that
makes sense
what proxy the signals through your
panda which you can also buy my way come
a nice nice shopping only $90 are great
um you guys should buy them they're
great they're the universal car
interface they have give your car USB
port which you can connect to your Aeon
the EON look cool it turns on wow that's
a quality eel shop tech house I had me
comment adding a slash shop you could
shop that cons I think it's actually the
old trunk we did not date again oh man
I'm loving all the purchases right now
Oh where'd we get the connector file
from I don't know man who stole of him
somewhere probably now I can be scanned
him good it's gang under something a
half as many twice as easy inversely
proportionate that's right it might even
be nonlinear maybe even ee is easy cuz
can you really remember for if something
you can kind of remember two or
something
look we're watching me on periscope it
also has a neo compatible fake Ethernet
port Ethernet that port with access to
can one can to start to detect 12 volts
and ground so make sure you guys check
out our shop
right now oh we have a news site where
you can read our medium posts medium
posts our Twitter's right here make sure
to follow us on Twitter oh alright with
way mo on to metrics we compete with way
mo we want to have more miles driven
than we mo and we want to have more
Twitter followers than window right now
way Mo's beating us at both of them but
not proportional to the amount of money
they've spent so way most spent billions
we've spent millions so this off by like
a factor of a thousand yeah I think
comma guys the thousand acts cheaper
than away mo and we have almost as many
Twitter followers and half as Ben's mom
we have half as many models and a little
over half as many Twitter followers
that's a great deal every comma a I
dollar is worth like 500 way more
dollars that's interesting to think
about
alright guys but this is this is the
come AI Bach giraffe available for sale
right now at comedy I slash shop this is
a Toyota giraffe also available if you
have a Toyota at comma dollar i slash
shop oh this is a cop Hetal you can't
buy these anywhere they're ultra rare
baby blue exclusive wire splitter
followers an important metric because
you gotta have metrics and they have to
be important it's important to have
metrics because twitter twitter is great
we love twitter um this is a comma a
panda it comes in a but a box i don't
have the box but i promise if you buy a
panda it comes in a box or your money
back
yeah yeah panna is nice right it's nice
look at has a USB port
these white pandas have Wi-Fi there's
gray pandas
we're being shipped to anybody Oh laughs
oh yes it comes look laughs yes Anna's
coming the cutest little panda boxes
that's got our logo on it right there oh
yeah look at that this doesn't look like
when you open it up gray pandas are kind
of where it's at though you can buy a
gray panda for only $1.99 it comes with
a $55 GPS antenna um super high quality
high-precision GPS product Maps you
overworking a wobble right now we're
getting the wobble down oh man I'm gonna
keep shilling as long as the sales keep
going up we got we got tons of sales
right now there's there's 27 visitors at
our shop right now which is crazy
there's so many visitors go to our shop
let she'll let she'll check at channel
check out the new shop htps
laughs shop that's right make sure that
link works oh yeah
Wow our are really ended yeah I'm just
showing on uh none slack right now for
the stop if you guys aren't on our slack
go to slacked off Tommy I make sure to
get on that slack we have over 3,500
people now that's so many slack ease if
you want to ask involve questions how
are what GPU is going yeah of course I
saw Blake's map back response you know
we love partners and we work with people
that's a lie we don't because people
will always let you down but you know it
won't let you down Honda Bosch giraffe
you could buy one for only $60 on come
to the I slash shop you go right now you
buy the product just buy just a $60 man
this is like as much as like a nice
dinner and not only last night you know
what lasts probably about like two years
until it's obsolete
a come AI Honda bhaskar app make sure to
buy one right now why should you buy one
from your Toyota no it won't work with
your Toyota it only works with with with
Honda Bosch know if firfer yeah I know
we gotta remove that copy a a yellow a
yeah many things we gotta do your
giraffe hasn't let you down see I like
that look we got a guy in here shilling
for the product a real user testimonial
if you want to come give a testimonial
about your Honda Bosch track have you
used on the boss tracks yeah what did
you think is amazing oh there we go we
have it right here
giraffes are incredible and amazing
people are watching this off the ropes
don't don't don't don't let them know
but this is the life combined two
screens right now what's going on
yourself boys no that's so we check the
quality because have been low guys do
you know what our number two cars on
open pilot we didn't know we know but we
looked recently why don't we have a team
page we do have a team page go to jobs
we have the jobs
I saw his quality page we'll link to it
right now that call me daddy I slash
jobs build the future let's let's look
at it let's look at it
by my car oh yeah you look at a job that
matters you'll have me reality that's
what everybody's looking for we're
selling you meaning in your life come on
you two
why see because where do you think the
future is over there
Wow I mean I'm not gonna hang up yet
there's 104 people on this still
watching I don't know what else can I
show for this is a comedy bug yeah check
out the condom debug it has a great
panda in it oh great panda perfect what
is our business plan to win you know
other people don't really want to win
I've heard we got some bleep documents
they don't want to win we want to win no
that's the business then six people will
win that's never happening but yep for
those just joining us this is the Honda
boss draft you can buy an accommodating
I slash shop this is a common panda this
is a collar panda right here this is an
old Panda and a grape and Betina coming
ID bug which is also available at
Comikaze I slash shop
what's top card open it's the Honda
Civic go to the news page here yeah you
can read all our medium posts there's
water prototype this Honda bas you have
no way man this is a product for sale I
know it has a c2 connector but that's by
design you want the highest quality of
Sidra
printed out a form - yeah see look at
this guy regretting not purchasing 128
gig option make sure when you guys buy
your Eon
you could choose right here everybody in
life makes choices you could choose this
64 gig or the hunt 28 gig midnight black
with midnight black heatsink and
midnight black cables the second most
popular car is the underperforming laggy
Toyota Prius no motorcycles
no midnight black for the win by a
midnight black if I had a minute I'd
like to show you right now I would but I
don't think I have one I've a normally
on though
here's Neil thank you for joining this
periscope where we presented the Bach
giraffe only by the most expensive do
that's the way to do life man that's the
way to do life we'll just make the comma
a I Eon expensive edition it's just more
expensive number of people running open
pilot hundreds hundreds of people run
open pilot you wouldn't believe it's
only hundreds by the amount of data that
we're dealing with at comma a I we have
huge data the data is super massive big
try stream labs yeah yeah yeah well
think about it
all right bros thank you for joining
this product announcement it's been
great to have you here
more than 5-hundred overall less than
five hundred weekly it's been great
spending some time with you we'll be
spending a lot more time together in the
future we have a lot more announcements
coming
but for now get your Honda Bosch giraffe
right now a comment on the ice last shop
thank you for joining
okay so uh this one's been the eleven in
the room forever most people love it
some people hate it
but let's talk about talk about it and
uh
it's the driver monitoring in one pallet
uh i'll just call it dm for the rest of
the talk
here are the topics i would like to
cover today
to hopefully demystify commas camera
based dm approach
let's start with the basics
so what's the goal of dm
what are we trying to achieve with it
as we all know comma is uh proud about
shipping
a very good like uh level 2 system
and
as the system is getting better and
better we need to remind people that
they always need to pay attention in a
in a level two system
uh to your uh to your driving
surroundings therefore the direct goal
of the vm is to keep the driver engaged
and obviously by using the camera only
driving now becomes more true because
the driver now doesn't doesn't need to
touch the wheel every now and then
when the system is engaged
when we say keeping the driver engaged
it means to make sure the driver is
always paying attention to the role that
they should be always to uh be ready to
take over
uh some examples of not being not paying
attention includes uh on your being on
your phone falling asleep or sim or even
like simply by just looking at the car
nestling for like too long
now that we have the problem in mind
let's fast forward and take a quick peek
at what uh comma
dm has achieved so far by looking at
some
numbers
got here
the first one is a comparison part
between having dm and odm uh showing the
cumulative
the plot shows the accumulated
distributions between
of destruction durations between
the current dm current data and the data
we had before we ship
open operator dm
the green line is from recent free data
and the orange line is from running the
same model and the data we had before dm
was shipped uh both lines show when both
lines show data when the own palette is
engaged only
if we zoom into that
that section there in recent data 99.7
percent of the distracted events are
less than five seconds
while in the old data this number is
97.1 plus 2.4
which means dm has managed to reduce
distractions more uh distractions more
than five seconds by ninety percent
which is substantial
here's another interesting step so at
run time dm is only like active when
open pilot is engaged but how about when
it's not engaged
by assuming dm is always alive we can
rerun the policy and the model applying
on all the logs to compare the amount of
dm alerts each user we have gotten per
minute both engaged and not engaged as
shown here
so the results show that when open pilot
is engaged drivers get sixty percent
less alerts on average on average when
compared to when they are driving
themselves thus we can say that when
engaged with open pilot people pay sixty
sixty percent more
attention in the sense that dm helps
them helps to remind people that
they need to be paying attention it's
not the fact that
that it beeps in fact is the fact that
you know it will beep at you if you
don't pay enough attention in a way it's
similar to like speed limits say it's
not about like the pres it's not about
the consequences it's mostly about the
presence
which brings us to this graph to sum
things up dm basically achieved two
things
one is that it reminds people when
they're getting distracted without
actually knowing being distracted the
other one more importantly is that it
keeps people from involving in
distracted behaviors in the first place
so how does so how does everything work
we start by looking at uh what happens
in open pilot
from sleeps to beeps
um so we have the driver the driver
facing camera that takes the picture of
the driver
say here with this beautiful comma free
camera
and then the picture is fed into a
neural network to estimate some
parameters of the driver we call these
parameters driver stage which includes
things like uh whether there's a face
where's the face
where uh where are the eyes are the eyes
closed where the face is looking at
stuff like that
then we have a classical uh state
machine that takes in
the driver state
all these parameters of the driver and
process them in loop as new pictures
comes in
come in
it also takes into account things like
the speed of the car
and also the how the camera is mounted
or even like how complex is the scene to
adjust all the things then the system
will use all these information to
determine whether the driver is being
too distracted and if they do an alert
will be shown
you get the beeps
um of course the being the brain of all
these is the the neural network model we
use to extract uh information from the
picture
now let's
do me more and look at the model itself
in like the more technical terms the
model is efficient at v0 vision network
which which is 8-bit quantize to run on
the dsp instead of the gpu such that
the dm model doesn't compete we source
compete for resource with the driving
model such that they can vote they can
both have room for growth say we want to
train big model in the future for both
of them we can do that
and the two main outputs will be the
driver's head post and ice stage which
are the two cornerstones of open part of
dm
uh well uh
it may not seem much but as we shall
show here we are we shall be showing
these two aspects are actually proven to
be quite versatile when it comes to
determining driver attention
here are a few examples of dm model in
action when i was driving
we can see that by just looking at
only the head and the eye you can
actually catch things from simply
looking away or playing with your phone
when driving or the the even more subtle
like falling asleep somehow
and of course the model works both day
and night
well
you might not wonder how the measly
8-bit model can do all these tricks as
george always said the most important
aspect of machine learning is of course
the data
so so the next talking point will be our
data
the latest dm model is trained with more
than 23 000 hours of driver videos
uploaded
from
over
unique users unique users from our feed
fleet which is
uh which makes up roughly 20
25 of the total user space
thanks to them open part of dm can be as
good as today
uh we would love to see this number this
number grow and in the coming slides i'm
going to show what we go what we are
doing with the data and
why more people should upload
well some people might be worried that
their faces will be looked at when we
label the data and thus have concerns
about privacy and stuff like that
and yes we do late we we do have our
diligent data labelers but they are
machines
so these beautiful computing clusters
that greg bill are also our dm labelers
uh here i have three pictures for them
because uh we have three racks
so how are the ground shoes generated
so we have been building this dm data
annotation pipeline for almost two years
now uh which can do the following tasks
in a fully automated manner so so that
no human no human would need to
look at the data any of the data
here are some of the examples of our
auto ground shooting stack in action
where you can see faces being
detected and the pose being accurately
estimated and also
as well as the eyes and where whether
they're closed
so what's actually doing all these
things are what we call the t-shirt
models that we train separately
to work specifically on our data set uh
using a technique called transport
learning
which means the knowledge of these
models are obtained from somewhere else
in this case it's the open source data
sets
um
so you have these open source data sets
of course you can not easily just train
some models on them but it won't work
because they not like nothing
from our data which brings us to the
idea of a domain adaptation
it means that uh we need to augment
uh these open source data sets to make
them look
somewhat similar to what's in our data
set then we can start training models on
them speaking of domain domain
adaptation
the idea can be also
be applied to say
when we want to train we train the model
that used to work on eons to work on
comma tools we can just make the we can
just start by making the eon pictures
pink kind of pinkish to mimic the ir
ir lighting in the comma tube
and it's also the same trick when we
want to transfer the say the comma two
models knowledge into uh
the comma three
oh sorry
into the comma three capable model
that's how we shipped uh really good uh
comma two
that's how we ship the
that's how we make the common free
dm model good at launch without actually
using a lot of common free data
so after all that labeling and training
now we move on to testing which is the
most integral part for us to move
forward and
avoid aggression regressions
so to test
you need a metric
what is a good metric for good dm
experience is it model accuracy does a
high motor accuracy equal to a good
experience
well not necessarily
well that's not true for dm at all
actually usually like 99 would be fine
but but now you're assuming the one
percent back experience is evenly
disputed among all users then in this
case all users are enjoying
of the experience but in dm usually
99 means one percent of the users are
constantly suffering and having constant
constant force positive or something
like that where the am doesn't work for
them at all
so how do we catch them so to catch only
any of such bad speed
bad experiences
we crunch numbers on every device in the
training set and validation set
for example here we try to see
how often each device will get alerts
with some candidate model we want to
ship
each dot here
represents a bit device we can see some
device get a lot of the ambulance
consistently and it's a and it's
important that
we understand all these
positives
for example if this happens on me where
the model constantly thinks i'm
distracted why i'm not we need to find
out why
it could be because the model doesn't
work well enough when wearing glasses or
is it because the policy is too strict
because i squint too much into the sun
or something like that
these are the questions that inspire us
to write more detail tests and fix the
problems they exposed
[Music]
on the right uh is another example of
testing by worst cases according to this
distribution curve some devices are
constantly failing to detect bases why
is it due to the model not working in
certain lighting conditions or maybe
it's just the lenses covered we need we
need to figure them out
so by visualizing all these worst cases
we can easily identify uh what some of
the problems are and what can be fixed
either by software or hardware
say for example uh
in the red ones they're clearly covered
and they're hopeless and then in the
black in the black images it's probably
because the ieds are broken and that's a
hard issue
so the takeaway is we can learn and
improve things a lot by just looking at
the worst cases
all right on top of everything i've
talked about so far i would like to also
ask some comments about thinking dm as a
machine learning problem in general
so we currently have data uploads from
about 1600 users
and below is the amount of people who
don't
who from who we don't get the dm data
from which is 75 75 of all users
which means
for us as a company we are stuck with
this small subset of date of data to
build a system which is expected to work
on
on a much larger user base than the
training set size
well
now all this looks like a disaster for
overfitting especially when we have
shown that even 99 isn't good enough
in other words the model is only
guaranteed to perform well on the people
who's in the training set
what's the solution then
well
how about
more people consider uploading their
driver camera maybe
wow it's just an inform recommendation
absolutely nothing more than that
right seriously though turn on turn it
on
to help yourself and help others
now let's move on to um
what's next
apparently the next
big thing would be end-to-end dm where
we will move the boundary between
perception and reasoning like we did in
the driving model the dm model we have
only one
output called iso row unlike like
in the classical model where we output
like
many parameters of the driver and did a
lot of
complex math and then and figure out
whether it's distracted or something
and actually we are now actively working
on getting automatic rank through
working on this end-to-end pipeline
um
pretty exciting stuff
also to give the model more context we
are also considering making it temporal
or turning back models on the common
freeze 180 model to make it seem more
so yeah there are so many
potential big improvements we can make
to stay ahead of the dm game
very exciting stuff
that's it for me today thanks for
listening
[Applause]
all right
how many of you are going to turn your
driver monitoring
toggle on
right
all right here we go jason
thanks this is a lot of good info can
you talk a little bit more you said
there were times when the dm model would
kind of
relax versus tighten up its requirements
for paying attention is that more than
just stopped versus not stopped right
now
so in the driving model
in the driving model it outputs
the probability of you like
being engaged and also the probability
of you like disengage in so many seconds
in the future so we use all the
information to
like
like adaptively set the threshold based
on the scene complexity that the model
thinks
like when it would fail so that such
that the dm model can be more relaxed
when say it's driving on a straight
highway compared to it's like stuck in
traffic
okay so every once in a while i see
someone question you know i tried
closing my eyes and the dm model didn't
do anything or i tried doing this or
that or i looked away and it didn't
detect anything and a good explanation
for that might be that it's relaxed a
little bit because this is a
simple scene with a low probability
according to the model of the driver
having to grab control
yeah would that be fair okay thank you
doesn't mean you could ever not pay
attention though
that's right
um my question is more about
uh future possibilities with the comma
three in the
180 degree field of view obviously there
was some questions about
a sentry mode and comma security and all
these things do you think implementing
some of those features
into the official release of openpilot
may encourage
with like a
prerequisite of needing to upload your
driver monitoring to record these events
could help
uh encourage more people to use that
feature and upload
because they're getting more benefit
from it
when right now they may just feel that
it's only a benefit for comma at a cost
of their privacy
where you could give them security at a
cost of their privacy and they may
consider it yeah so we are considering
that um
so actually
we are actually also considering using
the comma freeze 180 like driver camera
to
like to extract some of the like
information for driving
which is like the offering
like we can do
like you mentioned
so what we can do is like if we can
somehow make the users upload
with that
and if they if they don't like it they
can like choose to blur out their faces
then that would be great
a quick question for you are you always
limited to using the dsp uh will the
open pilot team ever give you more
compute if you ask for it
and is there any difference between the
um c2s
qualcomm i think it's an 820 or 825 dsp
versus the c3s 845. the c3s is way
better
but we are only using say
10 maybe 12
potential on the c2 so there's a lot of
room for growth
got anything in the crowd alright we got
someone upstairs
no worries i gotcha
all right
uh you you mentioned transfer learning
from training on some general object
detection data sets with some kind of
augmentation are you doing like uh
self-supervised pre-training or could
you explain that a bit more
well you can do augmentations like
color
like mimicking
or you can do like something like
fourier domain adaptation to mimic like
the sharpness
on like a finer level of image to make
them more look like look more like the
ones on our data set
does that answer a question
and you aren't directly training the uh
efficient net you're training a teacher
policy yeah we first generate the ground
through using the ground shoes using the
teacher networks on our data and then we
use our data and those labels to train
the efficient
to make the model perform
have you ever considered using a
monochrome ir camera it looks like there
is some color data maybe limited
use on
what we saw on the demos
um
we are not having problems with using
like
rgb ir cameras so i don't think that's a
limiting factor for us so far
so given that this is an opt-in are you
currently tracking the users who show
um a high
uh what's it called the the
distraction level on a consistent basis
and would you ever seek action to ban
those users is that a consequence no
oh
you want to put up with the b i mean you
know
you're an idiot
don't mess with your dm if you mess with
your dm i'll ban
hey so kind of a broad question so it's
totally understandable why you need to
like work on dm and and have some way to
like be able to alert the driver and
even help them and perhaps even hold
them accountable maybe that's taking it
too far but but at the same time you
also say stuff like and i realize it's
maybe half joking like we're l2 we take
no accountability so i guess what you
see is the purpose of dm to the extent
that what i'm saying of the company not
taking any i mean maybe i meant to say
liability instead of accountability i'm
not taking liability like
what's the purpose in light of that
[Music]
it's not it's not like a liability level
it's more like
you want
the you want to remind the driver that
the limitation of the system and what
their
expectation of the system should be
but and by using dm we are ensuring
that concept is always present
does that answer the question i think so
thank you
um
since in the future you guys are going
to be using the front-facing camera for
the driving
portion of the of the
of the comma um of open a pilot um are
you going to be doing two passes
basically um process the frame of
video for driver monitoring and then
reprocess the frame again for the
driving or is it going to be all mended
into just one process
we'll see
so now we have the super combo maybe
there's a super super combo in the
future
using all three cameras
uh hello have you considered
incentivizing users to upload their
their video as a as an investment in
improving the overall effectiveness for
everybody
yes
i mean if you upload it works better on
you so i mean that's the
direct incentive
common points obviously are very
valuable
the more you have the more important you
are so
all right that looks like it
all right
you
[snorts]
Welcome to the Kama factory. We're
starting production today.
It's a blue week as you guys can see.
Red and blue.
Uh it's a special day today. Space lab
day.
Uh
once Harold says he's ready, we're going
to grab a fresh device and show you guys
how easy it is to get running uh with
Open Pilot 010. At this point, um we'll
install a fresh device in our Rivian, go
for a drive, see what you guys can
experience on the latest release. Hello,
Yahia.
Um probably have another minute before
Harold's ready. So, if you guys have any
questions in the meantime,
uh the blog is up. We'll do the the
normal uh media shenanigans probably
tomorrow. It's nice to kind of space all
this stuff out. Do like the Twitter
post. Uh nice Twitter thread and
everything. Um but yeah, the release
actually shipped yesterday. Decouples
the uh the stream and the the twittering
and the stream and everything from the
actual release. Has it started? Yeah,
we're starting. We're starting.
Um
we got a special code for you guys. I'll
give you later. Uh or now if you want to
you want to buy now before seeing the
magic that we're uh we're shipping. Uh
if you use code space lab, we will rush
ship a 3x to you. I see on the board
there we have 287 in stock right now. So
if you're one of the first 287 people to
use the code, uh you'll get it in the
next 2 days.
Uh what time is it now? I think if you
place the order within the next hour or
two, it'll get fulfilled today and it'll
get picked up by UPS.
Um what are lined up reports? So, we can
talk a little bit about carports on the
drive. Uh,
yeah, I just got a 2022 Sonata.
Interesting, comma. Yeah, it's it's
great on a Sonata. All right, Har right
now. Let's get started. Uh, so we're
just going to go device out of this
ready to ship bin.
Pick a fresh device. Same kind of device
you will get if you buy one and it'll
get rushed to you with code spacel. And
then we'll go to the garage
and uh go for a drive in our Rivian.
Oh, Harold's all the way up there.
Go meet him out there.
You're too far from the Wi-Fi.
It might be fine.
>> All right.
Oh,
>> we got to do the install.
>> Oh, okay.
>> It's like a fresh device.
>> Let me pull over. I had some trouble
starting the Rivian. I had some
complicated controls.
>> This Rivian is very new to us.
So, your next car for open electric.
It's the beauty of Open Pilot. Doesn't
matter. Good for to reconnect.
So, this is a brand new device. We just
pulled out of the same bin that uh your
device will come from if you get a new
one shipped to you today with Code Space
Lab.
You do not get the nice pull. We We do
that for you in fulfillment.
We're going to show you how easy the
setup is.
>> And then we're going to drive with a new
model. Is that the plan?
>> Yeah, we'll do a drive with a new model,
answer any questions, and then we'll go
back to shipping.
>> Ship. Ship. Ship.
>> All right. We're ready to get started.
You want to go for it?
>> Oh, yes. Let's get started. What do I
want?
>> What do you want?
>> Open Pilot.
>> Latest Open Pilot. All right,
>> let's do it. Finishing install.
>> No Wi-Fi necessary now. Easy peasy.
>> Wow. So fancy.
>> This actually should be a little bit
faster than it is. Got to look into
that.
Let's see how long this takes. The
electric Valentine. Oh, there we go.
Okay, it's done.
>> Agree.
>> Now we got to do the training.
>> All right. have done this one before.
>> Give us navigation.
>> We'll do navigation when stopping at red
lights.
>> You guys should definitely click yes
here. We love your data for training
better driver monitoring models. DM team
is uh getting reassembled at the end of
this month.
>> All right, let's see what happens.
>> All right, we're already on road. So,
remember we just got this device from
fulfillment.
>> That's
>> we just loaded up the latest release.
That's like a 30 second set. 20 seconds.
>> I know. 10 seconds should be fixed.
We'll fix that. We'll fix it soon.
>> All right.
>> This one of those super fast cars never
driven before.
>> Yeah, these Rivians are too fast.
So, we got to calibrate. By the time we
hit the highway, we should be
calibrated. The highway's just right
over there.
3 minutes from unpacked to one road.
>> I mean,
>> well, no, we didn't have to. If you have
to route the cable in this Rivian, it's
a little bit of work,
>> but most cars, it's a lot easier.
>> Too fast. Yeah, I didn't when we rented
the Rivian, I
didn't have the greatest time with how
fast it was.
All right. Oh, jeez. This goes way too
fast. [laughter]
All right. Does stream look good,
everybody? We have 114 people. People
are into Space Lab.
>> Space Lab. I mean, it's good. It's good
name.
>> The people seem really happy with Space
Lab.
>> Yeah, I think it's it's really one of
the biggest real improvements we've
shipped uh in a couple years.
>> What are our favorite cars? Uh I like
the EV6 and the Lexus.
Bronco's all right, too.
Don't even have
>> easy. All right. Now we're cruising.
>> Cruising.
>> So we'll do the same. You want to go to
La Hoya and everything?
>> Yeah, we'll just follow where the road
takes us
long.
>> Uh yeah, but we're on release.
>> I don't know if it makes that much sense
to go.
>> Yeah, we can just do some highway drive.
>> Change speed.
>> Space Lab is a massive improvement.
Yeah,
>> not like that.
>> Do you want to give the high level
overview of what Space Lab is?
>> Wait, first let me figure out how I grew
it and make you go faster.
>> I think it's a squirrel wheel.
>> Which one is the volume?
>> Or maybe the butt next to it.
>> This is button next to this button here.
>> This is how you know we didn't script
it.
>> Oh, there we go. This
>> I picked a random device that uh from
the ready ship bin.
>> We're going faster now.
>> And now we're going faster.
>> Um
>> neither of us are familiar with this
car. Eene likes to drive this car.
>> Yeah. So what space lab is is it's it's
basically a new end to- end
architecture. Um it's really hard to
give a quick overview uh in just a few
sentences. We wrote a whole paper about
it that very clearly describes how it
works. So if those are very interested
in that, you guys can read the paper. We
also have a blog post that
>> How did you disengage?
>> I don't know.
>> Adaptive cruise control turned off.
>> System something detected.
>> I don't know what happened.
>> Uh Mr. Electric Valentine, can you tell
us what happened here? uh some some kind
of Rivian ACC thing. Um yeah, so if you
guys want to know how it works, just
read the paper. The paper is our best
kind of description. We have a blog post
that's a bit more digestible, but
basically it's a new way of supervising
uh end to end uh end to end control. So
this is the first release that has
complete end to end control for landal
and lateral that doesn't have any kind
of NPC or control systems either in open
pilot or in the back end. Uh this is
just all uh learned recoveries. This is
also why the longitudinal is so much
smoother. For those of you who use
experimental mode, I'm sure you've
noticed a pretty big change uh with this
new new set of models and that control
is much smoother and it's I would say
kind of usable now. I use it myself
voluntarily sometimes. I never used it
before. Before it was just not a
comfortable experience.
>> How are accident avoidant capabilities?
Uh we don't have those features. I mean,
it opens your drive pretty comfortably,
but aside from that, there's no like uh
we don't have AB or anything like that
yet.
>> I mean, you know, normal driving is
accident avoiding. There's really no
reason to distinguish those things.
There's some difference in actuation
limits depending on what you do. But
>> on chill mode, yes. Yes. Yes. Riven only
has chill mode right now in release.
The Rivian architecture is not uh super
easy for getting on shooting control,
unfortunately.
But Rivian is our fastest growing car
ever.
You guys should see the plot just goes
like that.
>> Yeah, I mean the Rivian, it makes sense.
The Rivian community is exactly the kind
of people that love
>> non-com owners get the ACC fault as
well. Yeah.
>> Great.
>> Sorry guys, there's some
>> What caused it? Did he say that?
>> It sounds like he doesn't know. Oh,
>> really want to see the comma output on
small window simultaneously? What do you
mean by small window?
>> What do you mean by small window?
>> Turn the AC.
>> Yeah, see that' be nice. That's on Yeah,
he's had it on high temperature. We
should fix that.
It's It's like as warm as his room.
>> Oh, yeah.
Uh
yeah, this is space left. So it should
feel pretty familiar. We've been working
on this for like over a year. If you
guys remember ship temper and we tried
to ship MLS, that was just us trying to
get it over the finish line. And uh that
took a year. Um there was, you know,
probably about a year of work before
that, too. Um getting us up to the point
where we could even have September. Um,
yeah, took a lot of work to make sure
there's no regressions
>> more than a year before that.
>> I would prefer my car drive slightly
more to the left. Is it okay to mount
the comma to accomplish that?
>> We would not recommend that.
>> I mean, we really can't guarantee
anything when you do that sort of stuff.
Like, it is totally possible that if you
mount it 10 cm to the right, it drives
10 cm more to the left consistently and
there's no problems. But it's also
possible that the car sees a different
perspective of the hood. The device sees
a different perspective of the hood and
that this confuses the model. Like we
really can't make any guarantees on
stuff that's outside of what you know we
kind of want it to work. Like you can
always do your own thing, but you can't
really have much expectations.
Yeah, it's chill. It should feel just
like normal open pilot, maybe a little
bit smarter. Um, the place I really
noticed this is around parked cars. You
can even be like somewhat adversarial
and kind of pointed towards parked cars
and it'll dodge them. Um, like it really
seems to understand scenes like this
better. Um,
also don't know how much of that is the
MPC or the lack of NPC.
>> Um,
yeah. Yeah, I mean part of it is that so
the MP the problem with the MPC is that
we had kind of hand tuned it to not be
very aggressive when going straight and
stuff like that and that caused just
issues in various places. It would mean
the MPC would uh would reduce the amount
of recovery that the model wanted to do
to make things smooth and to avoid ping
pong in cases like avoiding park cars
and also made it that it wasn't
aggressive enough when taking sharp
turns. Um, for example, when we did the
Taco Bell demo, we had to make changes
to the NPC just to make it possible to
do the 90° turns. Now, that's all not
necessary anymore because, you know,
we've just removed the NPC and it's all
learned. Uh, so it knows when to be
aggressive and when not. Um, so that's
kind of what you're feeling.
>> Is 0.10 different than 1.0? Yeah. So
0.10 10 we're defining as uh the first
use of the new world model and then uh
0.11 will be when we
use the uh the pictures from the
diffusion model. So that's when we go to
full MLS basically and then 1.0 will be
when at 10 log gets out of uh
experimental mode. So it's just chill
mode basically.
So those are kind of the rough
milestones there. We'll see how long
that takes. We don't expect another 3
years before a point release, but you
know, uh we're happy to be here today.
It's almost exactly 3 years since we did
09.
Timeline to add back nav. We really
don't have a timeline on this. We're
really just trying to get N10 long into
chill mode and then we'll basically
evaluate at that point. What is the next
source of disengagements? Um and then
work on that.
But I would say like very comfortably
not before 1.0. Would you agree?
>> Yeah. I mean like the real focus is just
you know you want right now I think
lateral can feel super human a lot of
times on the highway whereas if I mean I
experience this all the time that if I
take over driving you know the
passengers are more likely to get
frustrated with my driving than they are
with open pilots driving. When it comes
to driving on the highway and the
lateral, that's where we want
longitudinal to be before we start
thinking about nav. You want your
passengers to be annoyed that you took
over for the traffic light. And now the
opposite is true, right? Even when open
pilot does do traffic lights well and
reliably, it's still not as comfortable
as a human. And that's the priority.
>> Yeah. So 1.0 needs nav. Why doesn't it
need nav?
>> We have to define 1.0 as open source
thing. uh you know you don't think it's
going to be more than 10 years in but I
guess that's how it worked out. Um
>> yeah everything you know it always takes
longer but the thing is it takes long
for everyone. It's not like there are
other companies out there making AD
systems that you know are credible and
have no issues.
>> Well FSD is pretty incredible but again
it's not a self-driving car. We got to
make that real clear.
>> Yeah. I mean FSD is obviously very
impressive but you know it's not like as
an ADA system it's perfect. If you drive
with FSD, you'll also have some
complaints about the way it handles
things, when it's uncomfortable, when
it's too aggressive.
It's not a it's not a one fix uh one
thing fixes all thing.
I've had tons of compliments for smooth
driving when I let OP drive. Most didn't
even notice I was driving myself. That's
pretty common actually. Um first time
I'll drive with somebody with open
pilot, it'll take them a couple minutes
and they'll like look around like, "Oh,
you're not not touching the wheel." And
that's what we need for longitudinal
control. That is the big thing that open
pilot is missing right now. If you're
driving experimental mode, the
passengers will notice at some point.
>> This is also true of FSD.
>> Passengers definitely notice
[clears throat] when use FSD.
>> Definitely true with FSD.
>> Uh when you guys need a salesperson or
BDM, I don't know what BDM is, but we
don't do sales. One of the cool things
about
>> business development manager maybe.
>> Oh, but no,
>> if you want to work on supply chain,
we're hiring somebody very aggressively
for supply chain.
um like supply chain. I mean, we're
setting up like our new um SMT line. We
want to like get great deals on the
machines, go scope out all the machines,
plan out the next uh batch of Comet 3xs
and tiny boxes. There's a lot of money
to be saved just like getting many, many
quotes, working with suppliers. Um I
just to add to that to be clear, we're
only interested in things that allow us
to ship you a better product, which is
either cheaper or does more or has
better software. We're absolutely not
interested in anything that involves
convincing other product is better than
they think it is. Like people will
figure it out how good our stuff is. We
just have to make it as good as
possible. We're absolutely not
interested in trying to sell people on
uh
>> we're fine with the product always being
undersold and we we definitely prefer
that over being oversold and then we
just prefer the product get way better
provide overwhelming product value and
then the degree to which it's undersold
by doesn't really matter.
Um when is comma 4 coming out? You got
open pile 010. Isn't that enough? You
got a common 3x with code space lab rush
to you. Supply chain counting. Uh are
you saying you count that as BDM? Cuz if
you want to work on supply chain, very
interested. Very very interested. The
challenge is up on the site and go to
comi/job. Would love to talk to you. Um
love to hire somebody who's like working
on there's all these like people working
on accessories for the 3X. Um, if any of
them want to come here and work on
supply chain, hit me up. I would say
that's like that's way better signal
than even the challenge. If you're
successfully selling something that you
designed and made, um,
you're the kind of person we want to
come here to, uh, come work here and
work on supply chain.
I was going to ask if there's any new
common harbor plan in the future. Yes,
there is. Yes, there is. Um, it's going
to plug right in back here and it's
going to allow you to run really, really
big models.
Um
>> yeah, one of the big things that the new
space lab architecture allows is it
exposes intelligence of the base models
much much more. So we have experiments
now of models that can you know see
things that none of the models we ever
ship can see but they're huge and so
that's what the remote GPU
>> where's the Rivian see so bad.
>> Um but yeah so that that's going to
allow us to just have way better models.
Um, and this is one of the big things
about this release too, it just unlocks
so many future improvements.
This is the first time where I feel
like, you know, if we when we get the
external GPU up and running, we'll
actually be able to drive on something
that's substantially better, which
before this architecture was completely
impossible. There were so many
limitations and bottlenecks in training
uh that were just making the model
stupid in ways that size couldn't fix.
>> Yes. Yes. Yes. Yes. So stay tuned for
that announcement soon. Beautiful eGPU
that plugs right into your 3X. Um,
I can't count. I'm not a supply chain
guy. Oh, yeah. Counting is counting is
harder than you think. Inventory and
counting. Um,
you guys are really interested in a
comma 4. Do you want like you guys
remember the comma 3? Do you guys want
the thing to be expensive again? Like
the 3x is $9.99.
I don't think you want like a you guys
want like more processing and stuff. I
don't think you want that. You say you
do. You guys hiring for any ML rules?
Which challenge to choose? Yeah. if
you're like interested and you like
couldn't figure that out from the jobs
page. Um,
probably not going to work out. Not to
be mean or anything, but
you know, $5,000. Oh, George want is
this the real George? It's hard to tell
with this app. Uh, a George Hots says
he's willing to pay $5,000. Is that for
the eGPU or is that for like Open Pilot
2.0? I'd pay $5,000 for Open Pilot 2.0,
I think.
How much torque does the Rivian have?
>> The Rivian has a lot of torque. Let's
see.
>> I don't know.
I mean, the Rivian is easy disengaged
again. [laughter]
>> I don't know why it dis.
>> All right. Next time we do a Rivian
drive, we'll use open pilot lawn. We're
showing you guys release so we can't
right now.
>> I mean, the install was pretty cool.
>> Yeah, the install was good. No Wi-Fi
install. 30 seconds. If you use code
space lab, you can have it in 2 days. I
think you guys have like half an hour
for it to be fulfilled today. You guys
got half an hour and then it'll be
fulfilled tomorrow.
>> I love the Rivian community though.
They're so passionate about open pilot.
>> Yeah. Yeah. Real shout out to I think
Electric Valentines is the He's the guy
with the website. You make the website,
right? Uh it's called the comma space. I
think it's good stuff. Oh, Rivian has a
90° lockout, too. Okay. We could
probably fix that.
The problem is all this stuff requires
car specific work.
Uh when is 010 going to release? It's in
release right now. If you go to your
settings, you hit update. Show you. You
go here, go to software, you'll have a
little button. If your uh car is off,
you can hit update.
Yes, the comma space. Yeah, big shout
out to the comma space. Some good comma
content.
Um, yeah. You guys have like maybe 10
more minutes before we're back at the
office. I'm going to call it a day. Got
to get back to building 0101 for you
guys.
Um,
0101 and eGPU [snorts] and hiring a
supply chain person to make the common
3X even cheaper and to make tiny box
production run smoothly.
You got any more questions?
>> Very chill open pilot drive. New
architecture. Feels just like old open
pilot with maybe a slight personality
tweak. Feels a little smarter,
a little smoother.
Yeah. Yeah, I mean this is the problem
is that open pilot is pretty reliable in
a lot of normal driving, especially on
the highway and stuff like that. So most
even if we made huge improvements, most
of the time it would still feel the
same.
>> Where's the change log for 010, which
shows what's new? blog.com.ai
blog.com.ai.
We'll do like a full Twitter thread and
everything. Uh probably tomorrow. It's
nice to space this stuff out. We're
trying something new with this release.
We did the release shipping yesterday,
today's stream. Tomorrow will be Twitter
thread. Uh,
what updates for the Maverick? Uh, I
don't know. The Ford community is pretty
active. You go on the Discord and ask
around. They've got a lot of stuff going
on. Um, you're two years behind. Who are
we behind?
Behind what?
>> Oh, maybe car models is what they're
saying.
>> Oh, oh, oh, oh. We're making good
progress on that. A lot of the new
Hondas are supported now. Jason's
working on that. He's uh very interested
in picking up the Hyundai I hear after
that. When is Navon OP coming?
>> Uh we promise we got something way
better in the works.
>> I have some questions. All the people
asking for Navon OP. Did you guys use
it?
>> I'm genuinely curious though. Some
people really did use it a lot, but not
many. I'm just curious if the people who
are asking about it now are the same
people who are very passionate about it
then.
>> Oh, are you guys asking about a new
chip? Uh if you want to make like a
really great chip show up in the next
comma, don't work here on supply chain.
You will have a direct impact on what
chip you're going to use. Uh we got to
get it for real cheap. Uh can't spend
$400 on the chip. Uh cuz nobody wants to
pay $2,000 for a combo. We found out
uh
on a scale of it's full self-driving and
it's the same as before, how much of an
improvement do you think 010 is over 09?
Um, I think it's mild improvement.
>> And when you say full self driving, do
you mean like the proper noun of the
Tesla software or do you mean like full
self-driving?
There's a distinction there.
>> Uh, we don't want to feel like the
proper noun full self-driving. We'd love
some of the capabilities, but we don't
want to feel like that. And if you've
driven both, you you get what I mean.
Used it mainly for exits, but I don't
miss it much.
>> Why are you asking for it? We promise
you want end to end long. We promise. Uh
flexay support is not officially
planned, but the community is making
they they've got some cool stuff in the
works. There's a few to independent
flexay projects going on right now. And
if like there's a few hundred people
driving around on Flex airports, um
that's a pretty good argument for
upstreaming it potentially. Um so I
would say if you got like a few dozen
people, we'll like take a serious look
at upstreaming it. Um,
and if you're working on that and you
want to come work on car hacking here,
um, or if you just want an internship
and you want an internship to upstream
Flexray cleanly, happy to hire you, you
know, sit at a desk for 3 to 6 months,
however long you want, upstream Flex,
right, and call it a day. If that's like
your uh, it's like the famous story, the
guy like fix an iPhone bug, like left.
Uh, if that's your thing, we'd be happy
to have you if you're willing to, you
know, do it the right way.
what an eGPU like box bring your own
GPU. Uh so we'll likely just sell an
all-in-one type of thing. So basically
you can buy a common 3X and you have the
compute expansion and then it's just um
it's just like two products and you get
to it's it's going to be very similar to
like autopilot versus FSD. Um unclear
what the capability difference will be
but the split will be somewhat similar
where you have like the ultra high-end
the highest end experience and then the
commodity experience.
Uh, oh yeah, George is coming. Okay,
this is the real George. He's uh
we'll get MB in. Yeah. Yeah. Yeah. Um I
was talking to Julie the other day about
setting up some I want to set up like
two regular comma hack dates a year. Um
where you just like you know in February
or March and in like October. That's
when comma hack is every year. We'll do
two of them. Um for us it's we reliably
hire one person out of every hackathon.
Um, and for you guys, it's a nice chance
to up stream cars, work on the comma
stuff. Um,
if you guys have suggestions for your
dates, uh, I'm posting here on Discord.
Um, I want to make sure we can, the kids
can come.
Uh,
yeah, almost back at the office. Any
final questions?
Maybe we'll go to fulfillment and check
if uh, anybody ordered one with code
space lab. it'll be rush shipped to you
for free.
>> So, yeah, one of the big things we're
looking out for as well is whether the
experimental mode engagement is going to
be higher now with this release. I mean,
this is kind of the big improvement that
people have been noticing is that
experimental mode is more usable now.
So, we'll we'll see in the data whether
uh whether this actually leads to more
usage numbers. For me, it makes a
difference. I think for some other
people makes a difference. We'll see how
much it ends up mattering.
Yeah, I'm using it on my computer now.
The EV6. Anything special for Comm's
10th anniversary next month? We'll see.
We'll see. We'll see. We'll see. Uh, you
hiring if you can't code? If you want to
come work on supply chain, yes, we would
love to have you. Supply chain. Supply
chain. Supply chain. Supply chain. Maybe
if I say I don't know, somebody will
show up. I No, I'm really serious
though. If if any of the people who are
working on like the common accessories,
if you run like a real accessories thing
or um or you do this for some other
product or anything like that, that is
like so much more signal than
challenges. Um will there be a Labor Day
sale? Lots of folks missed the July 4th
sale for whatever reason. I think the
July 4th sale was too good of a deal.
Uh, we sold a lot of camels.
Um, so you got Space Lab. Space Lab Rush
is your sale.
>> Space Lab.
>> Um, does
>> anyone have want to voice their biggest
complaints about open pilot driving?
>> Wait, somebody's saying what is the
update? They keep asking. It's available
right now.
>> Yeah, it's been released for 2 days,
right?
>> Oh, Trey's in here. Another shout out to
Trey. He uh Oh, let's shout out the
driving feedback channel. Uh, the new
drive feedback channel is pretty cool.
Um, it's built by an intern using uh,
Trey's new clipper tool. Um, usually
what happens if you go on Discord and
you're like, "Hey, I don't like how Open
Pilot drove here." Uh, what the team
will have to do is like say, "Oh, can
you give us a dongle? Can you give us
your segment?" And then we get that and
they're like, "Oh, you're not driving on
stock. You have an unsupported car." Or,
"Can you please upload the files?" And
then connect to Wi-Fi. None of that. The
bot will just tell you. You just paste
in your connect link. You write a little
description and then the bot will say,
"Hey, you got to go back and upload the
logs." And it'll work with you until
it's all ready. Then it'll post a nice
clip and it'll give all the context we
need to immediately look into the
issues. Um, it's a pretty fun channel to
scroll through too to see like the state
of things.
>> Yeah, I mean the driving feedback
channels are great. Even when we don't
reply, it's super useful to see how
people are using it. I think there's now
a good middle ground with the fork
feedback. Like fork feedback is useful.
You just don't want to think that it's
not fork feedback.
>> Yeah.
The thing about Yeah. Yeah, the
distinction between the forks and like
the stock feedback channel is we take
ownership of every issue in the the
stock channel. We might not be able to
fix it like that day, but it is
somewhere on the road map to fix. Um,
and that's the real distinction.
Uh, what specifically is supply chain
are you all looking for? if you want to
talk to suppliers all day and like look
at the 3x bomb and the tiny box bomb and
handle inventory um like if you're just
a super detailoriented person um
and you really care about the product um
you're really motivated to like keep
production running smoothly and get the
best deals on everything so we can offer
the commas for the lowest price possible
then uh you'll probably be a good fit.
Try out the challenge. We made the
challenges exactly for this. Um, if you
see the challenge and you're like, "Uh,
yeah, I don't know." Then great. We know
exactly uh like where you fall on that
and then you see the challenge and you
do well on it, then great. You'll
probably be a good fit.
Uh,
it's not common space better tires can
help. Uh, that's definitely true. Yeah.
Any improvements I can do to my car to
enhance experience? Um, you can look at
your angle offset and uh get an
alignment done. How do you guys feel
about Frog Pilot? Uh, forks? I don't
know. Don't feel any particular about
frog pilot specifically. Forks are good.
We love forks. Um I frog pilot is like a
high variance fork too. I wish the forks
would experiment more with uh driving
stuff, but uh they are definitely high
variance in terms of UI and uh we had a
fun CES experience where some guy's
girlfriend came up and was like, "You
guys make the the little frog device."
And we have to explain the distinction
between the hardware and the frog pilot.
It was uh it's pretty funny.
What about server infrastructure side?
Still need to do a challenge. Yep.
Everybody's got to do a challenge.
Everybody's got to do a challenge.
>> Wait, someone wants to work on server
infrastructure?
>> Yeah, but usually when they if they're
asking and they don't want to do a
challenge, like, do I really have to do
a challenge? You know, they're not going
to work.
>> Yeah. Oh, yeah. You definitely have to
do a challenge, but we're very
interested in people if they want to
work on infrastructure or servers.
>> There's always plenty of work to do on
that.
>> Yeah,
>> we're bringing up a lot of new machines.
That's going to really speed up
training. But more machines means more
machine maintenance. And you know it it
just takes a lot of effort and uh to
keep that all running reliably.
>> The cool thing about the supply chain
job is you get to work in both
factories. So the tiny factory feeds the
commas. I mean we sell the commas to
then buy tiny boxes and then buy GPUs to
ship better open pilot to then sell more
commas to then buy more GPUs. Um so
you're very much in that mix and you
kind of operate it both levels there.
Um, so I mean every job here if if you
can't think about how you're improving
the basically how you're going to help
us solve the self-driving cars, then uh
>> I mean, you know, we now that we're
doing these upgrades, we're really
talking about this stuff a lot more. We
are really doing everything right from
the electricity to the data center and
from filtering the dust that goes into
the computers to running the computers
and setting them up and doing the
network.
>> Oh, he's saying just thought they were
all coding based. So he doesn't you want
to be like a technician. If you don't
have Linux skills then
>> I mean some amount of computer knowledge
is going to be necessary for a data
center technician.
>> Yeah. If you want to be like a
technician you're really great with
Linux. Um and you like you know you've
touched some Python. Oh the Rivian ACC
going to No, it was okay.
>> It always slows down aggressively.
>> Yeah.
>> Yeah. I mean somebody's like capable of
debugging like some basic network issues
and whether a GPU is uh having issues.
That's that sort of stuff is is usually
the level at which problems happen.
>> Yeah. Yeah. We'll hire somebody who
can't like program. We got to have
really great Linux and debugging skills.
Like really good really great skills.
>> We can drive for a bit if there's still
questions.
>> Yeah. We'll drive for a little bit more.
Go to little Italy and come back.
>> Yeah.
>> Okay.
>> Or just do the
truly the book.
>> Yeah.
So they're really interested in nav and
a comma 4. But so we got one guy who
liked nav who once
>> I think it's maybe it's the same guy.
>> Okay.
>> It's not clear cuz
>> I remember there was one power user who
used it on every commute.
>> Yeah.
>> Yeah. Obong is much nicer. Yeah.
>> These are Rivian users with Opong.
>> This is uh Mr. Electric Valentine's.
>> I see.
>> He's the author of the commace.
>> Oh
>> yeah.
Yeah. And are there people who like the
new experimental mode? Are they agreeing
with me that uh that's the biggest
improvement in this release or are we
not not sold yet?
>> I don't know. I feel like they haven't I
don't know. These are like the same
suspects on Discord, so I think they're
not like recommenting on it.
>> Yeah, that's true. I mean, a lot of a
lot of people have already been using
these models for a while.
>> Yeah, this is old news to these guys.
If it's not old news to you, use code
Space Lab. We'll rush a Come 3X to you.
Ships out. Oh. Oh, you got you still got
maybe 20 minutes. for 20 minutes and
then UPS comes.
>> Anyone else have any driving issues that
they would really like fixed on their
commute other than not having nav?
>> My biggest complaint is traffic lights.
Reliable stopping at the right place.
>> Oh, cutins are the worst.
>> Yeah, that's not a problem for me.
>> Oh, I hate cutins. It feels so broken.
>> But yeah, that's also a problem.
Anyone else have any complaints?
>> I have Linux skill and knowledge. Okay.
The other thing is you can't be remote
because I know that's always the next
question.
>> If you want to move to San Diego and
plug in computers and like make sure all
the computers work uh and you're like
really interested in that, then we have
a job for you. You can email in work at
com AI. Um I don't know, maybe just
write a little bit about uh
you should do the ops challenge. The ops
challenge is like a good general can you
think through something? Um and then
yeah, we'll schedule a call with you.
We literally just ran out of time during
the last comma hack. Yeah, the next
comma hack, I think we know the formula.
We got to be a little more prepared to
get all these cars upstreamed. We did do
we got like the Ford through, the
Rivian, and the Tesla, but uh I feel
like we could have done more if we were
a little more prepared.
Next time,
can we integrate adaptive headlights
into your Yeah, I mean, we're really
focused on the driving, but uh if you
want to like make a cool fork that has
these features, go for it. It's very
much, uh, within scope what's possible.
>> I think that's one of the things I would
really like to see more of for like the
sentry mode type stuff.
>> Yeah.
>> Does that exist forks?
>> Uh, Shane Pilot used to have this.
>> Oh, I see.
>> Yeah. And we shut down chain pilot.
Sorry.
Sorry. bulleted out.
>> But that means you guys got like Rivian
support and Tesla support. Shane does a
lot. Shane ships a lot of the stuff that
you guys see on the releases. Um,
for some reason my car loves to rubber
band. Uh, what car is it? Is it vision
only?
I feel like the radar has got a lot
better in this last release, too.
>> I mean, everyone's saying that it's
better in the models that we pushed to
master since release. Yeah,
>> they have like a big cult following in
the vision community.
>> Oh, really? Which one? DTR.
>> Uh, no, the ones before that or I don't
know. The ones that they changed the
loss function on Elites.
>> Which model did this?
>> I forgot what I called it. Steam powered
or something.
>> Oh, simple plan.
>> Yeah.
>> Oh, okay.
>> Yeah, those those apparently are way
better for the rubber banding. But
again, I mean, you know, we just haven't
put any effort into fixing that. Vision
only has not been our priority. Like, we
really just want the experimental mode
to be good on those cars to the point
that you don't need to rely on the lead
policy. Right now, experimental mode is
not that reliable. So, even when you run
experimental mode with a car, the vision
vision only ACC, you can still get
rudder banding because of the lead
policy still active. But once
experimental mode gets better, we can
either disable or limit how much the
vision or the lead policy does and that
will really improve those cars because
right now you're still suffering from
the fact that you don't have radar even
when you're running experimental mode.
Shane's always working on a big shiny
new thing for you guys. The problem is
the car stuff is like generally pretty
specific to one car. So some people be
very happy and then other people don't
get anything. This is why we don't
allocate too many resources to car
stuff.
Um,
but we have been putting a lot of effort
into controls recently and hopefully you
guys will start to see some of that
stuff in 0101 and going forward.
>> Yeah, there's actually the last couple
things I did with chain actually do do
affect quite a bit of stuff. All the
cars that have nonlinear control should
see some improvements.
Um, we're now fixing this bug where if
your device is mounted rolled, it would
take up to 30 seconds at the first
engagement of every drive to learn this
offset.
uh which is silly. I mean it should just
persist. So this means cars were hugging
at the beginning of every drive uh if
they had a rolled device which is pretty
common. So that should also be fixed
next release.
There's a few small things like that.
Oh, we have one more update for you
guys. Our our new machines are on the
way now. We got a stat printer and a new
my 300. Two heads
be able to crank out com 3xs even
faster. What's new in 07? I think this
Anthony guy's a troll. He's been here
the whole time and he's asking like
questions. Well, there's like a bug and
it
all right. I'm going to disregard
Anthony from now on. Uh but yeah, we're
getting our second SMT line set up. Um
should be basically iPhone level SMT
soldering. Um and the whole whole line.
The difference mainly between our our
new line and uh what you'll see in like
the very highest end lines will
basically be uh they have a lot more
inspection and they can get a lot more
throughput. Um, and the inspection is
just for driving down internal failures.
It's not really for driving down things
that you'd see in the field after we
ship it. Um, which is primarily what
we're focused on. Um, and it's to get
their yields like crazy high internally
like in the factory. Um, but as far as
like the quality gets output to the 3X
that you get, um, they should be
basically very very similar, the same as
like an iPhone or any other high-end
consumer electronic. Um, it's pretty
cool that this stuff isn't that
expensive. Like quality isn't that
expensive. they just got to care a
little bit. Um, which is pretty cool.
So, we're getting a stencil printer. Um,
that should help quite a bit. Um, you
guys see like there's still like a
couple camera functions out there and
stuff with 3xs. Um, it should help with
that. And the my 300 will mostly help
with throughput. Um, it's the same
machine we have now just uh with two
heads. It's like the the very highest
end one. And then we're going to get uh
an big inline vapor phase oven and some
X-ray inspection equipment. the X-ray
inspection equipment I'm help I'm hoping
will uh improve stuff that like stuff
that probably wouldn't be caught before
and that would fail like
some time in the warranty period. Um
we'll see. But yeah, 3X values are
looking really great. Um but we're still
very interested in driving them down as
we scale up. We just I mean more so than
more than anything I just don't want to
get that many devices back here. It's
like kind of a hassle for everybody.
It's not a good time for you. It's not a
good time for us. Nice hoodie. Can I get
one? Uh, I don't know if these are on
the shop.
>> No, they're not.
>> They're not on the shop. It's a really
nice hoodie, though. Uh, we'll think
about doing some new merch. Maybe some
10 year anniversary merch.
>> New merch.
>> 10th birthday merch. When is the
release? It is today. You just got to
care a little bit. Yeah. I mean, it's
pretty cool. It's pretty cool. This is
like the biggest thing I learned about
like reliability here is you just like
it's a finite list and it's not that
many. It's way less than you think and
you just kind of have to look at them.
You got to go down the list and be like
very careful and fix them. But once you
fix them, they're good. Comma support in
Asian countries. Uh so open pilot is
half the training data is outside the
US.
>> Yeah, we train on half on US.
>> There's I mean there's a huge amount of
users in Taiwan.
>> Mhm. [clears throat]
>> Uh we've got good amount of users in
South Korea. Yep.
>> And then the other Asian countries.
Japan I think is pretty big and then
those kind of the biggest Asian
countries. But I mean for sure this
works in Asia.
>> I think roads. There's Kamu in Malaysia.
>> Kamu. Oh, Kamu is going to upstream the
BYD port pretty soon. I don't know how
we're going to validate that one. Oh.
Oh, maybe when I go to Shenzhen, we'll
validate that port. Uh, hardware team is
taking a trip to Shenzhen. If anybody's
got some cool stuff we should check out,
let us know. Um,
>> I took the wrong exit.
>> New merch. Uh, new merch is not in the
works, but we can think about it. We
probably wouldn't build a carrying case.
We designed the comet to live on your
windshield, but it's cool that other
people are providing this.
Uh, is it reliable in smaller countries
with less training data? I mean, it's
not going to be as good, but I mean like
it should do something sane. It
shouldn't do something like crazy.
Will E2 being in chill mode not be
compatible with emergency braking like
the ref? It won't change anything like
that. We'll put more effort into that
stuff. Um, like once ant log is good,
we'll put more effort into that stuff.
When you think of ant long as a prerec
for that stuff. They have bu in Mexico.
Uh yeah. Yeah. I don't know. I'm not
going to go to Mexico to do a car port.
>> I mean, we're also not I mean, we can't
invest that much in car ports. Like that
just doesn't
>> No, but BD is big. We'll do it in
Chenzhen if we have time. We'll see.
We'll see. We'll see.
>> Bearch has a nice carrying case. Yeah.
Yeah. It's good. The community is uh
offering these extras.
You guys got to remember we're like now
we're 30 people. We've grown a little
bit this year, but uh you know to
deliver you 010 and it's it's a new
stack. Um it took a lot of effort. It
was the whole team. We had to build we
had to stand up new machines. Um Tiny
Corp helped out a whole lot with their
machines. Um
so it was quite an effort just to get
you this shipped and we want to like
this is just matching the performance of
old open pilot. Now, we want to do some
really cool stuff with this. Um, now
that Tomb Raider's shipped, um, and we
validated this, we can move on to the
stack and kind of forget about all the
old stuff and, uh, work on 1.0.
>> Yeah. I mean, the point of these big
refactors is always that they it's not
that the refactors themselves aren't
supposed to improve a lot. They're
supposed to just unlock future
improvements. What we had was kind of
the best that we could do with this new
stack that we made for the Taco Bell run
a few years ago. And now it's the
beginning of a new stack that we expect
will uh
>> yeah will for the next few years be the
the basis of all the improvements.
>> Welcome to 010. Welcome to 010. We're
hoping 011 soon. That'll be full MLS. Um
Tiny Grad is beating us. I think they
just shipped 011. Um we're in a race to
1.0 with Tiny Grad. So we'll see who can
get there first. But right now they're
winning.
Uh, plan to drive from SC to Napa next
month. Excited about these big updates.
Uh, yeah. I mean, open mild is already
very reliable in these drives. Um, I
think end to end long being in chill
mode will be a really big upgrade for
these drives. Um, I drive from like San
Diego to San Francisco somewhat often.
And uh, fixing cutins would be big for
me. That's probably my biggest source of
disengagements on those drives.
>> Yeah. on the highway. I think the
biggest complaints I have were fixing
cutins and also that it's goes fast next
to slower moving traffic.
>> Uh are you guys interested in slate? So
we have a stated preference for
supporting all cars, but we have a
reveal preference of the the list is
perfect as it is. So if you guys are
familiar with stated reveal preferences,
we love we want to support every car. Um
but that's not where we allocate our
resources to. We would be very happy if
we had Open Pilot 4.7 on exactly the
list we have today.
Um,
all right. We got nine minutes. 9
minutes.
This is your last nine minutes with me
and Harold. What can we answer for you?
You can complain to us. You can ask us
questions. You can tell us what you want
at Open Pilot 0101. You can just say you
like Open Pilot. Whatever you want.
We went for a while today. 45 minutes.
>> Yeah. Yeah, the RAV drives pretty nice
other than ACC disengaging.
>> Yeah.
Will there be more progress on
supporting or attempting to solve HCA2
issues? Uh yeah. Yeah. Yeah. I think
Jason is pretty interested in working on
that next after he's tackled Honda.
Um you guys, if you guys are curious, if
you're like somewhat technical, you can
read Python and you're curious why these
cars drive around and they're not
upstreamed. Um, you can go back and look
at like the Tesla work Shane did for the
safety there. Um, and then the the Honda
work Jason's been doing. Um, it's like
he's been working on this for a few
weeks and he got four ports upstream.
Then there's like I think four or five
or even more left to go. It's not that
easy to do this stuff cleanly. Um, it's
getting easier, but uh, yeah, requires a
lot of work.
You guys fix a 90°ree lockout. Yeah, we
we'll get around to it at some point.
Are construction zones better? Want to
talk a little about the contest?
>> Uh yeah, they're a little bit better,
but yeah. So,
uh we should post a blog post about
this, but um but some of the
construction stuff requires just smarter
models. The models we've trained now,
you know, they're they're trained with
bottlenecks. They're not very big. Um
and we never really optimized model
capacity for them. And it's pretty clear
that some types of construction zones,
especially where the lane lines conflict
with, for example, the cones or the big
arrows from like the arrow trucks, uh,
that they don't really understand what
to do. And so this is something we want
to fix in basically the next releases.
This is something that these new
architectures make possible. And so
we've trained big models that, uh, you
know, are much bigger and that that see
all this and they avoid all these cones.
Um, and so we're we're working on first
shipping that uh with the external GPU
on our cars or whoever wants to install
that in their car and then um shipping
those improvements to smaller models by
doing some some type of model
compression and stuff like that. What is
the best car for using OP? Uh we have
some recommended ones on the site, but
uh there's a lot of good ones now. New
hardware for smarter models. Not
necessary. Well, unless you're talking
about the eGPU,
but we already we still don't have
anything that like drives better on the
eGPU.
Um,
>> so as a fire hose data, I think we
probably answer it. Um, so next is going
to be the first one with two and a half
million.
>> Uh, probably. Yeah. I mean, we have
trained a lot of models already with all
the new fire hose data, but we just
haven't shipped it yet.
>> We're getting a lot more diversity due
to fire hose, too. Um, so that should be
a big improvement to the models. Uh, so
the next really should be trained on 5x
more data than all the models we've ever
shipped. Um, and it's way way more
diverse. Um, we keep lowering like we
have a limit of how many segments per
device we'll use and we keep lowering
that limit. Um, I think it's down to
a,000 now.
>> Yeah, it's really not much anymore.
>> Yeah, thousand. That's like only
>> How do you get version?
go in your if you're already on release,
you can go on uh settings and then
software and then check for update. If
you're not on release yet, just click
uninstall in the settings of whatever
software you have and then click the
open pilot button on the setup and then
you will get the latest latest version.
How much of difference could having eGPU
make once models that fully utilize them
are released? Um so I mean it it's more
compute than FSD has um and like their
hardware 4 suite. So, if you want to
imagine FSD but limited to the camera
view that Open Pilot has, you can kind
of imagine that or you can just think
about like think about you driving with
the camera view you see from Open Pilot.
There's a tool in Open Pilot called
Watch 3 that'll show you the like very
raw camera feeds from all three cameras.
Um, if you go back to one of your drives
and you watch that feed and you like
imagine how well you could have driven,
um, that's like kind of a good bound.
Uh, what took the most time? Yeah, it
seems like you've been following a plan.
what took the most time and more time
than you thought to get right. That's a
good question.
>> Oh, about the model stuff.
>> Yeah.
>> Um,
I mean, there was just a lot of small
bugs that took at least many months to
fix. When when you make an entirely new
architecture like this that trains on
policy in the loop, we have an entirely
new simulation environment where these
models train in and there's just I mean
it's it's a few thousand lines of code.
It's not that much, but there are so
many opportunities for small subtle bugs
like off by one and stuff like that or
um you know nan values or clip values
not being dealt with appropriately and
those kind of all compound into making
stuff slightly worse. And we were in a
long time in this state where you know
we could drive one drive on the new
architecture no problem. We were at
that, you know, over over a year ago
and, you know, that seems like you're
close to shipping, but it took a really
long time to figure out all these little
details that made it, you know, strictly
better than than what's in release now,
as opposed to just something that also
works and is sometimes slightly
different.
>> Yeah, total refactor, total rewrite. Um,
so you just end up with all these bugs.
Um, so at first, I mean, maybe it was it
was a mistake to try to ship everything
at once and then we've kind of we
stepped back from that strategy. Yeah, I
mean it's difficult sometimes to
estimate how difficult something would
be. Deadlines are sometimes useful
anyway.
>> It's it's always so tempting. You're
like the new refactor is so beautiful.
Why won't it just be strictly better?
It's always so tempting to just try to
straight up ship it. Um so we've been
taking incremental approach.
Um and now you've got TR. Uh
what is the best mapping software to use
and connect to on I don't know. It's not
really comment related. I like Apple
Maps. Would you consider more cameras or
more sensor? That will not make a
difference. We We give the model a tiny
little box. I'll show you guys. We give
the model this little box. It doesn't
even get the full screen and that screen
is not even the full camera view.
>> Yeah. The model sees like 20% of what
the camera sees. We can input way more
data. It's just not useful.
>> Yeah.
>> Like there just other issues.
>> We will do that soon though.
Uh, it' be nice if the combo would
replace closed source smart car features
with open source privacy respecting
ones. Um, yeah, general ones like that
that like locate your car. I mean,
that's already in Connect. Um, we're
open to like putting stuff like EV
charge status and connect. Somebody
wants to come work on that. Um,
uh, you know, I'd love to hire you. Um,
but for the people we have now,
everybody's working on making the
driving better.
This is like very much an auxiliary
thing. Um
like we're not going to dedicate 10% of
com resources to this, but we will
dedicate a small percent. Um because we
might want this too. Like when we're
taking the Rivian out today, I would
love if I can just check and connect how
charged it is.
Um but this is also a good time for like
a fork to step in. You can imagine like
a version of Sunny Pilot that has all
these things. Um that'd be pretty cool.
Um,
but yeah, there's also some hope that,
you know, once we hire somebody to work
on Webby stuff, um, that we can just
make something that's like pretty
generic and you can you can essentially,
um, have this architecture that's very
simple and people can make PRs for it
that are very maintainable and we can
just merge stuff. If the community wants
to work on something and then we have
this deal that will maintain it, similar
to car ports, um, I can see it working
out like that.
how popular the VWT1
VW unfortunately is not very popular at
all with comma users. Um but it is the
best maintain port due to uh it being
run by Jason. So
um unfortunately it's a
uh
it's a port we have to think about
sometimes but Jason makes it easy so we
never think about deleting it.
But yeah they're not very popular at
all. I think we only have a couple
hundred users. I think there's more
Rivians than VW and we just started
supporting Rivian recently. Driving
experience is already so good for me.
Oh, you guys have no idea how good it
will get. You guys have no idea. Ant
long will feel truly magical.
>> All right, we're back home.
>> Yeah, you guys think you want FSD, but
you just want it long. You think you
want FSD.
Um, and we'll see how it plays out
because that's what we're building
anyway. So, even if you don't believe
us, you'll see anyway
and you can see if we were right.
All right, closing thoughts.
Uh, no, I'm excited for this release to
go out. We have a lot of improvements in
the pipeline because of this. I mean, I
don't know if you guys have noticed, uh,
but, uh, we've already merged like
several new models since this, and
that's kind of what this whole release
enables, and that's not going to stop.
[snorts]
>> All right, remember Code Space Lab. Uh,
I don't know how long we'll keep that
up. Maybe like a week. Um, you get free
rush shipping. So, if you want to
experience OpenBud 010, you've been
following along, try it out. You can
return it in 30 days. Super easy. Um,
you don't have like talk to anybody. You
don't have to call a number. You don't
have to like convince some support
person that you have a legitimate return
reason. Send it back if you don't like
it.
Yo yo what up scopies?
I'm here with Harold from Kamei and
we're having a discussion that we
thought it might be worth it to share
with you.
Yeah, we need a we need a uh I don't
know. I mean they don't have a good way
to like Should we like put this
somewhere?
Maybe. Yeah. Put it on something and
we'll have like a a conver in
conversation.
Did I see the Huawei cell? Oh, the poor
shit. Oh, it avoids a dog. Now, the real
question is what does it do for cat?
Does it run cat? Well, this is going to
be kind of different. Company bashing.
Well, okay. Is the front camera cuz we
have to see the uh
see the scopies. Yeah, we'll put it
against code names here. We got code
names. This is this is going to be our
our phone mount for now.
Okay,
when I get in the frame, maybe we'll
turn it sideways.
Uh, on my face.
We're excited to hear about car
companies.
Yo yo yo. So, uh, yeah. Welcome to uh
this Periscope. Good thing I'm on my
high quality iPhone X here where you can
see great things from the front camera.
Um, it's hot.
Yeah. So, what we were talking about is
is, you know, I've been hacking cell
phones for a long time. It's kind of
what I do or what I used to do. And I
was just hacking the Toyota ECUs and I
was talking about how Toyota ECUs look a
lot like 1990s cell phones. And I don't
I don't even mean this as an insult,
right? I don't even mean this as like,
oh yeah, we're ripping on Toyota. But
when you think about what was added,
like there's not only no security in
these ECUs, there's no integrity checks
really. There's no like strong integrity
checks. They don't do like a shaw of the
data and compare it to a hash, right?
So, if you think of like you can't have
security without integrity. Integrity is
checking for accidental bit flips.
Security is checking for malicious bit
flips.
Um, but yeah. So, yeah, they don't
there's no uh there's no security.
Wait, but are these ECUs all built by
the companies that ship the cars?
No, these Toyota ECUs are built by
Denso.
Mhm.
Um, but practically
Denso, I don't know. kind of like owned
by Toyota. Like Naidak builds Honda, but
they're not really owned by Toyota
because Denso also builds ECUs for
Subarus.
Subarus.
Um, yeah, Denso also built CPUs for
builds ECUs for Subarus. Uh, yeah. So, I
mean, you know, to be honest, I I always
talk about how the car companies are
really just marketing agencies and
integrators.
Yeah. They
But yeah, so this is a Paul Graham tweet
that we we just talked about and it
said, "When the iPhone came out, every
phone manufacturer understood that they
needed to copy the iPhone. When the
Model S came out, the car manufacturers
still don't understand that they need to
copy the Model S." Um,
I mean, maybe they understand, but
they're just not don't have the dynamic
company to to make these changes, right?
if they buy all these ECUs from other
companies and have this fiveyear cycle
like they're just not they just can't.
But it's not even like I mean you know
what's next in the fiveyear cycle,
right? Their development road maps are
not very secret. It's not like they're
planning to put big powerful Linux
computers in cars anytime soon.
I just I just don't see it.
But maybe maybe they have this fear of
like computers in general because of
their fiveyear like updates, right?
Maybe they don't want to put like the
newest and latest in because they're
like in 5 years it's going to be old
anyway and then as a result they put
even older shit in.
Yeah. Yeah. I mean yeah I I guess what
they would have to do is really separate
out the hardware and the car base from
the software.
Yeah. Yeah.
Yeah. To that seems to make sense
to them. I think it's all kind of it's
all kind of viewed the same. But like
it's not even 2000 era cell phones. I
used to hack 2000 era cell phones like
Motorola Razer kind of stuff. I mean,
they're not the security is nowhere near
on the level of like the iPhone
security, but it's way better than these
ECUs, which look literally like like
they look like Nokia, you know, Nokia
shit. I mean, for example, you can just
go by how much flash they have, right?
So, so the the old Toyota ECUs had 512K
of flash and the new Toyota ECUs have
1.5 megs.
This, right? Well, okay. And what's even
more horrifying is that it uses all of
this code. Like the code is is spaghetti
code written in C. I mean at first when
I saw this code at first when I was
reversing the first ECU the Acura EPS I
thought it had to be generated. I
thought that it had to be like okay this
is written in like mat lab and then
there's some plugin which but it's not
like the more you look at it you realize
that this is handwritten C that's being
compiled.
Yeah. But maybe that's exactly why
they're so they have so much trouble
going away from it because they can
either start again. Yeah.
Because that's unupdatable, right?
Well, it's not even that it's
unupdatable. So, the problem of field
updates, cars are actually updatable.
They just don't ship like they're afraid
to do field updates and they should be.
Toyota's calibration update wizard. If
you unplug your thing halfway through,
it'll break your ECU.
Like, there's no The Honda one is a
little bit better. The Honda checks sum
is actually no. The Toyota the Toyota
has a verify step which is a little bit
better than checksum. You actually send
all the data twice,
right?
You send it once for a flash and then
once for a verify.
Now this is not particularly good.
So it just reverts if if it's not the
same.
No. No, it doesn't revert. It just says
verify failed and then like you know you
can try flashing again. You're kind of
fucked, right? No, but but this isn't
even good, right? Because bit flips are
likely to be correlated. When you send
bits down the wire once, right? When you
send them down the same wire, if some
bits flipped, there's a nonzero chance
that the exact same bits going to flip
again.
Yeah.
Right. It's much better to do an
integrity check. Even something like a
CRC 32 is better than this.
Um, you know, if you think that what are
the uncorrelated odds, four billion to
one, right? And that's that's you know
so the odds of the same corruption
happening is probably higher than
probably lower than 4 million to one.
Or you can just use a Shaw hash,
right? Like it takes it took an
incredible effort of like thousands of
GPUs and some of Google's best
researchers to find a shock collision,
right? You're never going to you're
never going to stumble upon a shock
collision.
Yeah.
Um but it's just it's the way that like
security is thought about and discussed
that's just absurd,
right? Like, how can they improve it?
What would they change?
Well, how can they improve it? I mean,
none of this stuff is signed. Like,
start with that. They could they could
add signature checking, but please don't
add signature checking. You'll just make
my life harder. It'll probably do a shit
job of me. Please add an integrity
check. How could they improve this? They
could write a function in the flasher
that will compute a shawash of the
flash,
right?
And then, you know, you can do this
without leaking any information. You
know, you put in shahash should be this.
Yeah. Yeah,
it computes the shy hash of the flash.
But do they do many of these updates in
general or do they just usually just
keep using the same
Well, they don't. And like that, you
know, anyone who like understands what
modern kind of practices are for any
kind of code development is, you know,
you don't want to have rarely used paths
in your code.
You don't want to have this updater path
that okay, we'll use it like once a
year, right?
Yeah.
It's just, you know, why not update much
more frequently? Even if you're updating
nothing, right? It's like making sure
all your keys are rotatable and stuff.
But maybe that's the problem. Maybe
they're in this like suboptimal uh this
local optima where updating just become
so hard.
Yeah.
But they've kind of got stuck, right?
I I don't know. I mean, I think they
have like completely irrational concerns
around OTA updates.
Uh whereas, you know, the bit flipped
literally right now if if you want to if
you want to and people are talking about
it in Toyota forms. I've been reading
the forums lately.
We're going to get to Periscope
questions in a minute. They're too far
away to read. Um,
like BMW,
like BMW, Mercedes-Benz, they might be
better. I know a lot less about their
updating architectures. I know they have
FlexRay, which is, you know, further
advanced than CAN, but the problem isn't
CAN.
Yeah,
the the problem is, you know, Tesla's on
CAN a lot, too. And I I think Tesla has
mostly solved this updating problem. Um,
you know, I bet Tesla's written like
quasi reliable updators for all these
things that are written in that are
written with a modern software stack. By
the way, download the calibration update
wizard or the J2534
flashing tool for the Honda. They're
written in like shit tier Windows.
They're written in like like Visual
C++.NET
2003.
Make sure you import std AFX.h at the
top of every file kind of shit.
Um, car companies have always worked to
do this as little as possible. So, how
long have you two been lovers?
Um, I don't know. Uh, why why why do you
not want why do they not want their
product to be updatable? You're still
trying to use learn to use Cabana work
more. Uh, wasn't lack of integrity
checks the reason the pedal sticking
thing that Toyota got sued for?
Honestly, I don't think there was
actually a bug. My understanding about
the pedal sticking thing was literally
like on two cars the mechanical pedal
got stuck down and then you know I mean
that's okay someone like spills a can of
Coke down there pedal gets stuck right
wait wasn't that like debunked or
something as well or like multiple
people start complaining and then
well I mean yeah yeah there's the whole
thing of you give people an excuse to
complain some guy got like pulled over
for speeding he was going like 95 on the
highway he's like oh acceleration Yeah.
Yeah, that's what it was. Um, do I think
BMW, Mercedes, Toyota will die?
No, I don't.
You think my is getting anywhere? Yeah.
Well, yeah. I mean, of course, the other
companies sure aren't. Um,
so
the
No, I I don't think any of those three
companies are going to die. I I think
that they have roles in the in the
future.
The thing about Toyota is they do build
a really nice, cheap, safe car.
Toyota should not be stupid and should,
you know, let somebody else build their
I'll build it. You want me to uh I mean,
you you see the thing is you wouldn't
actually give me enough authority,
right? You'd make me like a level three
manager. Say my Toyota, right? They'd
make me like a level three manager and I
would spend my whole time convincing
people that like this is I'm not doing
that. I'm wasting my time. I got I got
things to do, man. Um, what car
companies are good? Tesla to be honest.
That that's it.
Yeah, but that's part of the problem. I
mean that that's means I don't know.
There's just no other companies that are
doing this properly. So these these car
companies aren't going to die because
nobody's going to
take them over yet.
Yeah. I mean I I still don't think
they're all going to die, right? They're
not all going to die to Tesla.
Yeah. Um Tesla has production
difficulties and Tesla also is never
going to make uh gasoline powered cars.
Yeah. And they also don't make $18,000
cars, right? So
there I will see Tesla going there,
right?
Uh sometime maybe.
Well, Tesla launched the Model 2, right?
Yeah.
The Model 2 was like a Yeah. Yeah. Yeah.
I I don't think I don't think the cost I
don't think Tesla's a luxury brand and
it's kind of not, right? Like I I I rode
in a Model S. I had a I had a 2008
Mercedes S-Class um was my car and I run
a Model S and I'm like this is all
right, but it's not it's not a luxury
car.
Yeah,
it's it's like the acceleration is
really cool. It's a little more close to
a sports car. Um and it's very safe. I
do like that, but it's not, you know,
you look at the interior and it's like
it's like plasticky and the fit's not
that good. It's nothing Mercedes.
Yeah, it's not a Mercedes, right? Um,
so if Toyota wants to integrate your
tech into their car, absolutely it's
open source. I would love to see Toyota
integrate it. Um, the monopolistic
structure of car companies means they
don't have to improve. They're not a
monopoly, right? I I don't Yeah,
interior Model S is not luxury. That's
what I'm talking about. Um,
all IBM they'll sign licensing deals
with Microsoft. Yeah. And where are IBM
and Microsoft today? Microsoft is
desperately trying to pivot to be a
cloud company and selling you office
SAS, right? I mean, Microsoft's business
model used to be Bill Gates, the reason
he's a billionaire, he invented the
software license. That was Bill Gates
invention. He's like, well, what if
instead of selling you the license to
DOSs for $10,000,
we sell you $50 per computer.
That's a lot of $50, right? Like I just
imagine Bill Gates like going like this
and Steve Bomber and him were like
dancing around. Steve bomber throws a
chair across the room, right?
Um,
yeah.
Yeah.
No, but I don't Yeah. Tesla Tesla seems
to be trying very hard to do all these
things, right? But they're still making
very expensive cars that are less
luxurious than their gasoline
competitors.
Yeah. Um, so if you think about the
Model 3, right? You think about what the
Model 3 is going to be priced at. Like
right now it's competitive with an Audi
A4.
Yeah,
I think that's probably right.
Yeah, but it's not profitable.
I wouldn't worry about I mean why is it
not profitable they can make that car a
profit I think
yeah I mean okay I think it's all
reasonable but it just hasn't been done
yet right so
we need a bit more time to be sure that
to say that
the strategy is definitely better
no I mean you were telling me about like
the Tesla battery factory thing right
it's something that just so obviously
makes sense
are our Panasonic and the competitors
like even really trying not one big
recall and and they are finished.
What does that mean?
Yeah. Why do you think that? Like, okay,
there's a there's a recall for
something, right? So, first off, first
off, 90% of recalls for other cars are
bring your car to the dealership so we
can plug in a wire and run calibration
update wizard on our shitty Windows
laptop. Seriously though, like like
what's the recall? Okay, there's some
like bug in Tesla's ABS. Okay, we
understand. We're fixing it. We're
getting it out. We're gonna, you know,
most recalls people don't bring the car
back.
So Tesla gets a much higher penetration
rate and Tesla does it in a few weeks,
which which what do you mean one big
recall? What's what's it going to be
recalled for?
Um,
you know, maybe you can have something
like like the airbags, but okay, what
what does that what does that cost them,
right? They bring the cars back, they
fix the airbags, they sue the airbag
company. Not that big of a deal.
Um,
how hard was it for Tesla? Yeah, the car
manufacturers definitely want status
quo. Most recalls will probably be a
supplier's fault. Yeah. Um, because the
thing is everything on the Tesla that
wouldn't be the supplers's fault is uh
is updatable.
Um, yeah, car accidents kill over 1
million people per year. Yeah, that's
true. How many people did are those
people in Teslas?
Yeah, Teslas have been very safe.
They're very safe. Yeah.
I mean, they're very cars. They're just
kind of structurally good and they're uh
you know, I think active safety features
are going to play a huge role.
Yeah.
In in in mitigating car accidents in the
future. I mean, most car accidents are
just caused for the stupidest reasons.
Um
yeah, a lot of people die. I mean, you
know, it's it's a I think now uh when I
was a little bit younger, suicide was my
uh most likely cause of death. had a car
accident or was it was it flip back or
Yeah, I think it doesn't need cars for
when you're a teen, you're more likely
to crash a car and commit suicide. Um
Microsoft tried to emulate car companies
in the '9s. They were financially
successful for a while. Here's the
thing, and this is something that people
always point out to me about Microsoft.
Microsoft is actually still incredibly
financially successful.
Yeah,
Microsoft's one of the biggest companies
in the world. Like
for many, it's not hard to see for us
though.
You think Kaii will make it? I think in
a couple years you're going to have
these companies just looking around and
being like, "Holy shit, that's what KAI
was doing. Oh my god, we're fucked."
It's the goal. I
I mean,
I don't know what am I missing, right?
If I'm missing something. Oh, like
explain to me what will never work and
explain to me or or Okay, either explain
to me a what won't work or b where a
competitor will beat me.
Yeah,
I don't I just don't see either of
those. I mean, we view our competitors
as the car companies, right? We we we've
always talked about this. Um what's
Kamei's business model? It was very
similar to the car companies. We sell
hardware, but we don't sell cars. you
sell software for your cars, right?
That's the idea. Um Tesla wants to get
legal exception. I don't even know what
that means. I'm missing a pinstripe suit
and a focus on only money on the on the
short term.
Maybe that's what exactly we're not
missing.
Maybe what we're not missing, right? No
business people. Honestly, like business
people come to me and why just why do I
why do I want your opinion? Why do I Why
do I need your opinion? Why do I want
your opinion? Why do I want to let you
uh you know, in the company? Yeah, I I
don't I'm talking about sales, right?
Sales is sales is one thing. I mean,
really, I get some I want some kid to do
some internet marketing for me, right?
That's that's really I get some like kid
to like, you know, go on go on like uh
SEO doesn't work anymore. I don't know.
Buy some Instagram followers or
something. Um how would I convince
companies to buy my soft? I won't. I'll
just beat them. Um
manufacture flying cars. Yeah, they've
been talking about that for years. How
about Chinese copycats?
Let's see if any of them ship. How do we
store all the shipper data? Big hard
drives in the cloud. Um, comma AI can
win only because smaller lead teams
build better software. That's generally
true. Um, that that generally is is
true. I mean, I I've always viewed uh
software as much more like an art
project.
But it is, right? Like just imagine
just imagine we're asking like, oh, 16
chapel. All right. Let's get IBM to
paint the Sistine Chapel. Okay. Well,
we're going to spend six months on the
design requirement phase. Um,
we are authors, right?
What?
Author code.
Yeah. When will comma points be
monetized? Oh, wow.
Uh, eventually TM.
Um, hackers and painters by Paul Graham.
I don't think I've read that one. I've
read a lot of his stuff. Disruption is
usually caused by people who don't have
much to lose by challenging the status
quo. I mean, like, whoever has anything
to lose, right? What are we going to
lose? What's the worst case scenario? We
don't win. Oh shit, man. Oh, my whole
life was a waste. Oh, what am I going to
do? I'll have to go back to flipping
burgers. I'm pretty good at flipping
burgers out there.
Um, do you have a website? Yeah,
uh, Tesla 3 is having quality problems.
It's hard. Yeah, it's hard. Um,
I mean, put it this way. Tesla's quality
problems will be fixed long before
Toyota's uh ECU flashing changes. Uh
planning to do more funding rounds.
Yeah. And we have something. Why on
Subaru? Because like
you know like Subarus, man. Like
Subarus. I don't know, man. Subarus. I'm
a little uh short-term kills, bro. I
mean, yeah. It's it's it's uh it's a
disease. It's really a disease. Like
people don't know what capitalism is
anymore, right? People think of
capitalism as, oh, we're going to have
to like, you know, rape and pillage and
and get all the profits now. I mean,
that's like the mentality in the world
today. How stupid.
Um, only if they don't run out of cash.
But what do you mean by run out of cash,
right? Like there's no way Tesla's like,
"Oh, we're out of cash. I guess we got
to shut the business down."
Yeah.
That just doesn't make any sense.
I don't think that's going to be their
uh their problem.
um self-racing cars. I'm actually going
to be at a wedding that week.
When is that?
I I I didn't realize, but I think we'll
send someone a rep. I think it's like
two weeks.
Oh, it's in two weeks.
Yeah.
Dang.
Yeah. Look work out, right?
Yeah.
Yeah. He's low class.
Yeah. Completely optimal track.
Yeah. We're going to um People think
cronyism equals capitalism. Yeah. I look
and you know, also people people hate on
capitalism.
Capitalism is phenomenal.
You just need to get rid of the
cronyism.
Um, biggest fear of someone showing up
at comma with a dump truck full of money
on a What do you mean? If we raise
another investment round, it's not like
I'm going to give up a board seat. It's
not like I'm going to give up majority
control. What? What do you Oh, a dump
truck of money for me. What the hell
would I do with money?
Are you going to sell out, GEORGE?
LIKE, WHAT WOULD I DO WITH I was really
I was really talking about this. Like,
like, what would I do with $50 million?
could buy a boat. I think that's the
real
dude. Dude, I don't want a boat, dude.
The boats are great.
You know, if I bought a boat, I'd buy a
boat like your boat.
Yeah. And it's a great boat.
Yeah, exactly. I was like, "Oh, wow.
$500. I got to sell one ETH." Wow.
Yeah, man. The boats are great.
Um, no, but that's the thing, right?
Like, I made a lot of money when I was
younger and I just
I realized when I was like 21, I just
kind of looked around and I'm like,
"Okay, this is how much money I have at
that." put the hands here, right? We got
to do this to scale. And this is how
much money I've spent in my life.
I I don't live a very uh high
maintenance lifestyle. I mean, there's a
few things you need to avoid, right?
Don't buy boats, don't buy houses, uh
don't support dependents, and don't
spend tons of money on women, right?
Like, honestly, if you manage to avoid
those four things, what else are people
spending money on?
Yeah, but those are pretty hard to
avoid, man.
But they're easy.
Women don't respect you if you spend
money on them.
Respect.
The women's easier.
Well, okay, that one's easy, right?
But the boat and the women's the same,
right? You only need to spend money on a
boat to get one.
You don't even need to spend money on a
boat, man.
This is This is off topic now. All
right. No, but like I don't know. I
don't know what I would do with money.
Could someone could someone could
someone tell me like what would I do
with money? If someone gives me an idea
and I like it, I'm going to sell out.
Wait, no. Don't give him any ideas. No
ideas.
Boats and hoes. N
car companies will try to find my
temptation. You really think Toyota? Let
me tell you about my temptation. Let me
tell you what it is.
I want to live in the future, guys. I
want to live in the future where I don't
need to buy a real boat. The VR headset
that I bought for a,000 bucks is so
good. I download Boat Simulator 27 and
oh man, YOU SHOULD SEE MY BOAT. HOW MUCH
YOU pay for it? Pirated, man. You
wouldn't download a boat. I would.
What do you recommend to a young person
who wants to get really good at
something? Just like do it and don't do
anything else.
Um,
the women will sleep with you if you're
exciting and fun. Just be exciting and
fun. It doesn't matter if you have a
boat.
Um,
time travel. I would sell out for time
travel. But that's the thing, right?
Like none of these things I can buy with
a billion dollars. If I had a billion
dollars, what do I want to buy? I could
buy the biggest TV. You should see the
TV I like $500.
Like this isn't money, guys.
Take a sailboat to the Cook Islands.
Okay, so now I'm on some remote island.
How's the internet in the Cook Islands?
Let's talk about that. Well, I got some
like satellite crap. I'm like waiting
for the the the latency. The porn is
slow. Like I'm I'm out. Falcon Heavy.
That is a better idea
of money.
Well, what should I buy a Falcon Heavy
or should I start a SpaceX competitor?
Going to space seems fun.
No, really. You want to go to space?
I just want to be weightless. Actually,
the being
Oh, you could ride the vomicon for like
$500 like $5,000. Like, I kind of want
to do it.
Yeah. I When I fly, I do the thing, but
only like for a few seconds. It's not as
good as the vom.
It's probably not as good when you're
the pilot, too, cuz you got to be like
worrying. Okay. All right. That's my
altitude, right? That's true as well.
Um, no, they it take you it takes you
like up and down 20 times. I'd kind of
like to do it.
That's not that bad, actually.
Yeah, you can go to Vegas and do it.
You could do a trial ride in my plane
for a few seconds and see if you like
Oh my god, I'm horrified already. I'm
horrified just thinking about it. Uh,
would I go to the moon? Like, you know
what I say about space when there's a
fivestar hotel on the moon and I can buy
a ticket for the same price as JetBlue
Mint?
Um, how will Kama change as a business?
Buy my own private jet. Why would I want
to buy a private jet? Now I need a place
to park it. I got to hire a pilot. The
pilot's trying to unionize. I got to go
outside. I got to go to the picket line
and tell them about why the unions I
could buy a jet smarter subscription for
like 10k. Like again, these things
aren't money, right? Like I'm not
saying, you know, be poor. Don't be
poor. But like if you're making like a
100k a year, pretty much no matter what
you want to buy, as long as you don't
have dependence and you don't spend your
money stupidly, you can get it. And like
that's not that much.
Dependence scales linearly, so that's
not too bad either.
No, no, no, no. Dependents are bad.
Dependents are bad because the problem
with dependence is they will spend your
money without a care of how you got your
money.
That's true,
right? Like like that's dependent scale
scale linearly because they won't have
the same frugal attitude you do.
Squared. Um, ARVR porn. I've been
disappointed, but I'm really excited
about that if I do start another
company. Um, can we talk about vehicle
selection interface? Andy built that.
Uh, are all the vehicles not on there?
If they're not on there, we should add
more.
Um,
yeah, but okay. This dependents are bad
and dogs are not a scam.
Dogs are not a scam.
I mean, no, you can get a dog.
Dogs have a bigger for carbon footprint
than a hammer.
Interesting.
Interesting. All those like
environmentalist cat people troll them.
I mean, the real thing, the real thing
that has a huge environmental footprint
though, guys, if you want to save the
environment, don't have children.
Yeah, babies are the best.
Um, babies are really the worst. Uh, I
missed that. What was that question?
Proscope should keep the questions on
Tom Cruz or something.
Tom Cruz.
Um,
all right. Any last questions? We'll go
We'll go for 30 minutes. So, we'll go
for another another three minutes and
then uh
do some work.
Yeah, we all got to get back to work,
right? All right, we got we got shit to
do. I mean, we can't just stay around
and shit talk all day. You know what
happened to the man who shit talked too
long? The whole world passed him by.
Thoughts on Martin? Is he really going
to jail? That's sad. Uh, will Kama hit
an animal? I don't know. Don't hit an
animal. You're the driver. Babies are
good for the future. Questionable.
What's new in common this week? The
pedal. Oh, we're getting We're getting
Osh Park pedal boards today.
Babies are good for the future. That is
very questionable. I just want to live
forever. I mean, why do I need to have
children on pilot forever? Uh, will
there be a point where open pilot sees
better than humans in bad visibility? I
mean, look, what do you mean by sees
better, right? Uh, probably not on the
eon. You need kind of better uh
you need kind of where can you buy comma
gear for crypto? Um, sell your crypto on
GDAX and then go to shop.com.
When are you going to start hacking the
brain? What do you think I'm doing, man?
The truth about hacking the brain is
it's not sticking wires into the brain.
It's AI. See what P Oh, I haven't done
that shit in years, man. I don't know.
Yeah, I don't want to be old like
Charlie Miller who's like, "Oh, life got
too hard now that there's ASLR." Um, I
don't know. I mean, I I think the kids
are just better than me now. I think
that the kids who do Pontto are better
than me, and that's like how it should
be. Um, the new the new geo,
the new calibration method.
Oh, the new calibration record. Uh,
ICO, right? Uh, ICOs are banned in
America right now. We got to get the new
regulations passed, right? We're working
with regulators. Got to watch you work
with regulators. Um, what was the
question after? Oh, the new localization
method.
Yeah.
Um, okay. So, calibration is defined as
if you know how the car is moving and
you know how the camera is moving,
right? So, you can think about like you
have uh, you know, two two vectors
pointing out, right? And then there's a
two angles between the vector. There's a
yaw angle and a pitch angle, right? So
if you have a gray panda, uh, gray
pandas return these great things from
the satellite called Doppler shifts. And
it tells you exactly what you're sh
Doppler shifts are three dimensions.
There's only one.
Wait, it's one dimensional dimension.
There's many satellites.
Eight dimensional on average.
Eight dimensional. Yeah, a lot of
satellites. Use that. We using that
glowness yet?
Uh, this using that bait on the BU.
Well, we can turn off Glonass and switch
to BU.
Yeah, we should do that. Maybe is a bit
weird.
Yeah, Glonas. The Russians a bit weird
shit.
Yeah. Um, but what what do you say? They
put them in better orbits.
Yeah, they did. GLONAS is much better at
dealing with relativity than GPS.
Yes.
But in their defense, they built it the
same year as GPS.
Wide wideband.
Yeah, that has pros and cons.
Yeah. Um, why aren't boats fully
automated?
They are. They're completely
Because boat captain unions, man.
[Music]
Random question. How many hours do I
work? Over 100 a week. Life is work,
man. I I don't know. Work is the only
thing I've ever really found fulfilling
in life. Um, what else am I going to do?
Ride around on my boat. I DON'T HAVE A
BOAT.
All right. Thanks for joining. Uh,
bye-bye.
Squad fam out. No, I can't. I can't.
What's bob? No. No. Make sure to hit
that uh subscribe button. But seriously
though, if you want quality content like
this, make sure to subscribe to our
Periscopes. Get on quick. You know, we
got to build a brand here. We got to
build an army.
Um,
gray panda. Great panda all the way. Way
better GPS.
If you make a music video, absolutely
rent a boat. Absolutely. All right, Army
out.
i'm uh head of openpilot my presentation
will be uh will be about openpilot
um so the responsibility of the
openplaya team is basically all the code
that lives on your device so your
command2 or your command3
from the research team we get this nice
blob of weights from the neural nets and
then it's our job to run this as stable
as possible
and to interface with a whole bunch of
cars
and to be this reliable we're basically
trying to build this the most stable
robotics platform that's possible
so um in my presentation
um i'll be going over some open pilot
features uh i'll be taking you
on like a history tour
um but i'll start off with this uh
solving self-driving cars is
a software problem only
um
some people think this is what a
self-driving car looks like it's a
a car filled with computers because
otherwise you can never build a cell
driving car
of course we don't think this is true
if you would ask someone at a
traditional self-driving car company
what you would need and they would say
you need a lot of cameras you need a
lidar of course you need a lighter i
need a radar you need imus a gyroscope
an accelerometer a gps and definitely a
trend full of computers
um
well everyone knows that lighter is a
scam so we can immediately cross that
off the list so people use this to make
their hd maps and then localize
themselves in the in the hd map to do
their planning on
um yeah that doesn't scale so
definitely no lighter
i can also say confidently that a trend
full of computers is not going to be
necessary um we can run open pipe very
comfortably on the comma 2 and the comma
3 is even better
um so yeah and it's not a problem of
compute i'll i'll get to that later
definitely not cpu
um
then we can also cross radar off the
list i've been we've been using radar
for quite a while
um i looked a little into the data that
the radar gives us but the data is
actually pretty shitty uh you get this
like one line you get all these false
positives it's really hard to tell apart
like a stationary car or like a manhole
cover
um so we very quickly switch to a system
where we only use vision
to tell if a car is there or not and
then we still use the radar to um to
give us a speed because the the radar
gives us a doppler shift which is an
instant measurement of the speed which
is very nice but we're also moving away
from this and trusting the model to give
us the relative velocity of the car uh
and tesla is doing this now as well so
this jose
this is very very possible
um
and i
would say an imu and a gps are kind of
optional for the driving part uh over
time our models have become very good at
estimating the motion that the car is
going through will tell us the
rotational velocities and the
accelerations and the velocities
and the gps of course you can drive
through the tunnels without a gps it's
very possible to drive
um but yeah for ground trooping those
things are very nice so we definitely
put those on
and then the most important part is the
cameras uh if you have some very good
cameras which the coms3 has
this should be all you need this is what
a human drives with their eyes so
good cameras are very important and the
cameras on the commentary are really
amazing
i worked quite a bit with them already
george talked about 120 db of dynamic
range uh they do hdr they do full four
exposures at the same time so you have
four exposures
and each successive exposure has a 16x
shorter exposure time uh so in this
way you can see very dark but very
bright areas at the same time
um
so yeah this is uh kind of what
represents open pilot
over time
um we've been running on the on the lay
code or the oneplus 3
and basically open file has always
filled all the available cpu space um
but it was always fine like if we wanted
to try to ship a new feature we would
free up some cpu we would rewrite
something
um
[Music]
in c plus plus make it faster and then
in the end we always have the cpu
available to the write a feature we want
um so yeah we've been running our 2016
era smartphone for quite a while
uh and actually we don't clog the cpu a
couple times uh just for thermal
performance because the the cooling is
really terrible but still we're only
using like 65 percent of the cpu i mean
the gpu is a different question but cpu
there's definitely plenty of
um so yeah now i'm going to take you on
a tour of open pile features some some
nice milestones basically from version
0.1 to the upcoming release version
0.8.7
this is between 2016 and 2021.
um so this is basically pre-release this
is the the acura ilex with still the
computer in the back
uh and the joystick to engage and
disengage this is what uh george took
the bloomberg reporter on to uh to vegas
so this is kind of the shape of open
pilot uh you can see the the open pile
of ui in the bottom left um we still
have that debug ui around so happy to
see that that code still exists
um and then it was time for the
basically the initial open source
release which ran on the common neo it's
like this whole diy the 3d print a bunch
and this is also where the neon green
color came from we got a bunch of 3d
printers and when you buy the 3d printer
it comes with
a little bit of free filament in the
most hideous color you can imagine of
course
so that's why a bunch of our stuff was
neon green
i think we still have
quite a few spools of that left
um this is what the ui looked like um
back then
so
very engineery hackery with all the
green boxes all the lines
but over time like a lot nicer as well
um then i want to talk about the feature
in 0.3.7 about mobile predictive control
i mean the feature itself is nice but
this was my my first feature i shipped
as an intern
after i joined comma
um this basically made the controls way
more smooth instead of some like
it turned it into an optimization
problem so you put in like the position
of the leaf car and the velocities of
the leaf car and you try to optimize the
brake and the gas and the steering
to get the most smooth maneuvers
possible
and a lot of this code is still around
which is very nice um harold made some
tweaks to it in the meantime but the the
basic stuff is still around so
it was um it was pretty cool to see that
a comma when you write a feature and
then
in a few months you have this running i
mean at the time at a few hundred users
but now it's like thousands of users uh
that run your code
another feature i worked on as an intern
was uh for question warning um this is
when i kind of realized that the power
of all the data that comma has
uh so
when you
at the time this wasn't no machine
learning but i used the model outputs
to see what the car in front was doing
and then i made some rules to come up
with uh when to show the four question
one then i could use all the data to see
what if this had any false positives to
tweak the algorithm and this is yeah
this really showed the power of the data
and this is probably something the oems
can't even do
they have to go to a test track and some
testing
um
0.4.4 was uh the big flipping i thought
it was pretty funny uh so when we
designed the original eon
we actually put the selfie camera on the
right side of the device uh which turned
out to be a mistake um when we wanted to
start gathering uh driver monitoring
footage uh we want to put the camera on
the left so we just flipped everything
around
um luckily the eon case was symmetrical
so uh with a hex screwdriver you could
take it apart flip the mount around and
then put it back in your car and chris
even made a nice video about that three
years ago
[Music]
so this is the the first step towards
driver monitoring which is very
important
um when i was going through the release
notes i also noticed this pretty funny
thing and version 0.4.6 which fix all
memory leaks
i don't think that was actually true
but it was very optimistic at least
in version 0.4.7 we shipped the first
model with our improved brand choosing
stack
um
so before we just we we tried to recover
the path that the car took we used
mostly as the gyroscope for this and
then
all gyroscopes have a bias which we
didn't remove properly
so before this point all the models had
like this bias that would point you to
slightly towards the right if you looked
in the distance the model would always
do this uh so we had this this fixed
offset of one and a half degrees which
we always subtracted before we sent the
angle to the steering controller
but after this was finally gone so just
close
cool to mention
[Music]
then in version 0.5.0 we shipped right
for monitoring i'm sure wishing is going
to talk a lot more about the driver
monitoring but yeah as openpipe started
getting better and better
like in the first version we had this
this bar that took six minutes to calm
down and he had to touch the wheel
um i mean six minutes now in hindsight
is a very long time
but overpaid messed up so so often that
you you felt very proud if you actually
hit the six minute mark and you're
always paying attention
but then as opposed got better it made
less mistakes and then it became very
important to make sure that the drive
was paying attention
um
and yeah you can you can just make the
wheel touch time shorter but at some
some point it just becomes too annoying
uh so we actually want to make sure that
the user is paying attention so we look
at their face and see if they're looking
at the rib
then in version 0.5.8 we open source
vision d
um we always joke that we were probably
one of the first companies to actually
ship a neural net on the edge on like a
device in in the field uh back at the in
the day we wrote our own opencl kernels
to do all the neural net stuff but at
some point we shipped to the smp which
is this qualcomm library to do it as
well and they have all these these nice
uh opencl kernels i reverse engineered
their their library once and they're
they're super tweaked for for what the
the snapdragon can do so they're super
good uh so we should switch to s p
um and then so we just decided to to
open sourcefd
and at that point all the code in in
openpile was open source which is a
pretty cool milestone
um then in version 0.7.7
uh we actually started driving on the
localizer so to speak um so all cars of
course are different
uh all the tires have different grip on
the road and this can depend on like how
wet the road is how the temperature
and there's the steering it's like the
manufacture system some end-to-end ratio
usually but this is not true for all
driving
so we try for each car
uh we try to estimate the vehicle
and with like 130 car support this is
very important because you can't be
measuring this for every car
uh so we actually uh estimate this
offline we look at how the car drives
with the steering angle the speed
and then we predict how we think the car
should drive and then we could tweak uh
the vehicle parameters a bit so it
matches our expectation
and this is very important for things
like banked roads so if the road is a
little slope to the left or right um
then you would start hugging but this
actually takes care of that it sees that
the the car is not driving as expected
and then compensates for it
uh in version 0.8.0 we shipped the first
full 3d driving model
that would not only output lanes and
paths and x y but also in z
um and this was mostly useful uh for the
the discussions the openpilot team had
with research
we would look at like a replay and they
would say now this model is
overestimating the turn um but you have
to be very careful because of projection
errors that if the road would slope up
or down a little bit it would completely
throw off how the lines looked and the
research team always said no no it's not
overestimating it's just um it's just a
projection and then well turned out
usually in a lot of cases we were right
and this is the one of the bugs that
harold was talking about with the yellow
lane lines at
night and then in version zero eight
point three we shipped the first
end-to-end lateral model uh which is
yeah a big very big step which is
something that the research team has
been working on for a very long time uh
and i'm very excited to see what the
future of this will look like
and then in the same release we also
switched to a ui and qt we had this
massive code base in react native
although the ui was was an android apk
and then with at the time we were
already working on the on the comma
three as well um so yeah we uh we moved
the whole ui to qt it's super responsive
now
um and it's all it lives in the same
open pilot code base so we didn't have
to rewrite all the messaging stuff
in uh january 2020 we also made a very
important change on how openpod is
developed so openpilot used to be
developed in a cathedral style open
source
which means all the development happens
behind the scenes and then when there's
a release you get this dump on get up
with all the source
uh but of course you want to get
contributions from the community so
people still make prs for things like
car support i just kind of became like a
pain to merge
because like they could base the public
code base was already behind people come
and see what we're working on we started
running all the ci behind the scenes but
then we couldn't run the prs on the ci
uh so in january 2020 we just decided to
uh develop everything at open source uh
by the time we also didn't need to test
in cars anymore so
we could be pretty certain that if uh if
our ci passed that the code probably
wasn't broken
so if people start running that on their
device it wasn't such a big deal
so this was her old mono repo it was
called one
everything was in one repo
um
yeah and then this grew over like the
three years that we used it
but now everything is done in the open
pilot repo and you can see this in the
in the graph the number of commits went
up significantly
and now all the all the developments
done in the public uh no no secret stuff
even the the common three stuff has been
developed in the open some people know
this but uh yeah
so yeah i think this uh this shows us
very nicely how far we've come from
version 0.1 to version
0.8.7
um
sometimes progress feels slow but it's
always good to take a step back and see
how far we've come and i think this is
very promising for what the future will
show us
if we can get this much out of a 2016
our smartphone i think that proves our
point that this is just a software
problem and if we just keep chipping
away at the software it's just going to
keep getting better and better
so um what's next um
i think the most important part is
stability um it's definitely a few
features that still need to be developed
but yeah stability is very important so
we're
flirting one hours or 1000 hours between
failures so it means unplanned
disengagement so this can be anything
from a hard reboot which is very rare
now
um but also like communication error
between processes so if you don't meet
the real-time deadline
or other unexpected like planner
failures or model failures
of course we're going to start to keep
supporting more and more cars
and the openplay team is also going to
prepare running larger models it's
mostly a bandwidth problem with the gpu
so just by writing the
all the processing stages of the video
so it's like all the debayering um
all the all the conversions we do uh
just make sure that all runs on the c on
the gpu stays on the gpu
do efficient messaging so yeah
and of course we're going to talk about
navigation but i'm going to talk more
about that later
i also want to usually thank the
community who also make especially the
old 130 cars we support possible uh you
can see this is just past months we had
over 200 pull request merged which is uh
pretty cool i think a while back on
hacker news someone made a tool to see
how fast vrs were emerged um and it's
also cool to see how quickly we were
processing all these pr's with quite a
small team
um yeah this this small team
um
forces us into certain things like not
writing a lot of code but these are
usually good things like we see this in
research too it's like yeah we're not
hiring a cone guy
we're a small team so we have to we have
to make sure that
we have as much leverage as possible so
this end-to-end approach makes a lot of
sense um and if you have a lot of people
you're tricked into these approaches
that don't scale well and even with all
those people still will never work
uh so i think this is true for the
number of lines of code as well if you
you can do a lot with not a lot of code
um so yeah like the sudo project it's
like over two hundred thousand lines of
code
um yeah and with openpipe we're trying
to keep the number of lines of code
below 100 000 and so far we've succeeded
now we can also plot this over time
um so yeah we're you can see uh version
0.5.8 there's a big increase when we
open source vision d on camera d
uh and then in version 0.7.7 we started
to get awfully close to the 300 000 line
limit so we did a big cleanup started to
remove all unnecessary code
and that was comfortably
down to 60 000 again
um and this is still an amount of code
that one person can keep in their head
uh i know what all the moving parts are
and this
makes a lot easier to develop on open as
well
but as you can see the the number of
cars
that support it keeps going up um and
robin mentioned this as well and i see
that we only need 45 lines of code for
each supported car just because we have
very nice car abstraction links
um i also want to talk briefly about the
hardware that's needed to run open pilot
uh
so in the past it was the common neo
which was this diy project it's like we
have this manual on github you have to
3d print some parts order a board
um
and you know it's like solder a
connector to your car you lost all stock
system capabilities
but that's uh luckily
no longer the case
then we shipped the eon with the giraffe
which had some nice switches
but even as an open as a comma employee
i could never remember what all the
switches did always had to look it up so
it's not great for usability
um and then that was fixed with the
comma 2 and the car harness and
this turned out to be the future and
this is still used for the comma 3.
i'm also going to show a bit of the ui
progress we made i think this uh very
nicely shows how much openpipe has
progressed the software i think the ui
quality really nicely shows that
the state of the the self-driving code
as well so this is the original ui with
the nice hacker font is what a something
in a movie would look like but
uh them started to become nicer and
nicer and this is all the react native
stuff it's turned out to be a mistake in
the end
and now we have this beautiful qt ui
which looks really slick
um to develop openpilot we also had to
develop quite a bit of tools
and libraries uh which i'll go over
briefly
so we developed cabana which is used to
reverse engineer the car
uh rob also talked about this a little
bit which produced opendbc which is this
big github repository with all the
reverse engineered signals
um we also added open file support to
quad jugger recently uh which is this
very smooth nice pulling library so you
can pull all the the signals of the open
pipe modules and how they're
communicating with each other it also
parses out all the data from the from
the canvas so you can put those together
um yeah and you can also do live
streaming so if you're testing something
in the car and you can see it live for
tuning um this is so much better than
all the one-off uh jupiter notebook
scripts we used to write and it's so
much faster to debug stuff with this
um we're also added support for carla
which is a great way for new users to
experience open pilot
where they can try out open file without
a supportive car
um i mean carla is not the most
realistic simulator but i i use it some
from time to time to see if like if i'm
writing a new feature just do some
sanity checks make sure i didn't mess up
a sign or anything it's not steering
left when it's supposed to go right
we also made explorer
which is a nice way to view all your
drives or your dashcam footage but i'll
talk more about that later
so we um overall we made quite a bit of
progress i went from a proof of concept
and to well over 3 500 weekly active
users
we went from a 3d printed case to an
injection molded case that's like a real
product product
we built some nice developer tools in
the process
and we also built some very nice
libraries so we tried to keep the number
of dependencies low
but they also need to be resource
efficient so we wrote message queue so
we used to use zero mq which is nice
socket library but i used quite a bit of
cpu so we wrote our own library reduces
shared memory
research team read leica to do gps
processing and we developed open dbc in
the in the process
um i also want to talk briefly about my
timer comma i
have had a great time at comma so far
just i was looking for an internship and
then i uh saw the program i got sent a
programming challenge which i thought
was really cool way to hire at the time
uh so it kept uh tipped away it's a
chance for a weekend i felt like well
even if i don't get the internship at
least i had fun for a weekend
and i think that's the
the attitude to get you into comma i did
uh well enough to uh to get an
internship which is a great start for my
time at comma
i made some great road trips in the u.s
uh with my comma devices it's really fun
uh we uh spent some days in the field as
well uh
this time we're testing av we're making
sure that all the all the forwarding of
the a b still worked uh so went out with
ricardo and the deep and we uh printed
out this this bw golf uh stuck some
aluminum foil to the back taped it to
some boxes
um and then we rented this piece of
empty track
and then we just tried to drive into it
it was this game of chicken with the
boxes
and as you can see in the bottom right
it didn't always go successfully
um i also uh learned how to hack cars at
comma uh so this is the time we uh
i guess we wanted to show the flex ray
wasn't so insurmountable as people
thought
um so
the plan was to rent an audi a4 so rob
and i went up to la to pick up the the
a4
and um the person who rented this to us
really uh
he said it had all the driver assistance
features we needed but it didn't so we
had to give it back immediately and then
we went to mcdonald's and we started
looking for other audis with flex ray
but the only thing we could find with
the driver assistance features was this
absurd q8
so we picked it up in compton
um and then we uh then went back to uh
to san diego for the hackathon
and we immediately filled it with wire
started hacking away
um and then after two very long days we
uh we finally got it to steer so it's uh
very nice to see that was possible
i also showed how absurd the use of
x-ray is in these cars uh i know some
some manager probably decided that they
need a flex-ray i said they put in this
this whole flex-ray stuff and then they
stand sent the same exact cam messages
as on any vw golf but then they send it
on this super expensive bus and so not
sure why they did this
this is uh the combat 3 this was back in
san francisco
just
we
we decided we wanted to do rtk gps
whereas it's where you build like a base
station and you could do very accurate
gps i was a complete waste of time but
uh we had a lot of fun building uh the
comet through the combat three um so i
guess it's the predecessor of the of the
comma 3. um so we put this big gps
antenna on the roof got some two by
fours
um attached it to the outside of the
house and i had some cables running
through the bathroom
so sometimes when you're taking a shower
like the floor got wet and then the gps
antenna went down
so that's i guess that's the startup
vibe
um i want to talk about some
announcements uh i think a lot of is
already spoiled by george with the
navigation
we're going to start with
connect
so we used to have explorer and the
mobile app connects but
yeah we decided it was not worth it to
deal with apple and the app store
anymore
so we decided to just all integrate this
into this super nice web app which is
not live at connect.com.ai
uh it has all the features that from the
the phone app used to have and and way
more
so yeah it's really cool you can see
your battery filtered you can take
snapshots and with the commentary you
can see your live location and
previously it would just show the the
last the position of the last drive you
took but now if your car would get towed
you could actually see the car in real
time
and we have now this nice unified
experience between desktop and mobile
um so yeah no longer in the app store
it's a nice progressive web app which
you can add to your home screen and it
will always be up to date
and this changed to to connect was also
very important for the next feature for
navigation
uh because we needed a good way for
users to enter their destination to
manage their favorites um and like
typing a destination on the device is
not really not really a nice user
experience
um
so yeah so we have connect and then we
have navigation on the device
which is just for my turn navigation but
then integrated into the open file
experience
so you can go to connect you type in a
location so if you want to go to taco
bell so it's very nice reverse geocoding
we'll show you all the taco bells in the
area
and you can add favorites you can add
home and work locations which will then
show up on your device like this so if
you're just starting up your device you
click home and i will just go there
you can also use the connect to set up a
destination um so how does so you type
in your destination it will preview the
route and then when you click navigate
it will actually go through athena
um so all the devices
on the comma network have a websocket
connection open to our server um and
then if you're subscribed to prime uh
you can use this to uh to send the
location over to your device and this is
this is really smooth like within a
second that the map pops open with your
red loaded and it's really smooth
experience
this is all based on mostly map books
and other open source stuff
so the real thing is
i think it's busy based on valhalla
um uh and then we use the the macbook's
driving api which is built on valhalla
with them with some traffic uh
information sprinkles on top a lot of
macbook users send their real-time
location to macbooks so they have all
this real-time traffic information which
is really nice for us to use um
and then we rendered on top of some very
sharp vector tiles
and they have like this nice opengl
library
to render these so it's it's very smooth
and yeah which looks really nice if you
just get this term by turn navigation
you've even got lane lane info if that's
available so in this case we'll tell you
to be in the leftmost line
uh and it will also tell you that the
traffic so we know how much uh how long
a rad normally takes and if it takes
longer than that we can see for each
segment
if that's the case and we can we can
show that as well
um
[Music]
but then the big question of course is
yeah so
what the future will look like so it's
important that you have comma prime uh
this pays for all the all the tiles and
all the writing requests we do and pays
for all the infrastructure uh so yeah
sign up when you get your comma three to
sign up for the trial immediately
and enjoy this for a couple months
and see it just experience the
navigation experience
and then the question is like how are we
going to build this out to
navigate on openpilot so however already
talked about desire which is this way to
signal to the late to the model that you
want to make a lane change or keep left
and keep right
and of course this is going to be the
first step to see
if navigation tells you to keep left
what will happen if we tell the model to
do that
but then we're also gonna
this is why it's very important that
navigation is is an on-device experience
we can render a nice view of the map and
the routes that's specifically meant for
the model and the model can take
diagnosis like a fourth camera
and then actually can make decisions
based on that and i think if we all put
that together uh train this with all the
data that's coming back from the
chemistry so i think
it's to feel like a magical experience
so yeah that was my presentation um i
hope you guys all saw what
the nav looks like in its current state
uh and i think once you try it out for
the first time it really feels like a
magical experience
um and i think i've also shown
how far we've come with open file how
how we've come from version 0.1 to
version
and i think this just shows how much
more is possible and how good hopefully
it's going to be in the future
yeah that was uh that was my talk
you
Oh, it says connected. Does it show live
on YouTube?
>> That's why
she doesn't show it. All right. So,
we're here with a very special
announcement. Yeah, we're good. There we
are.
>> Yeah. All right. So, we got a very
special announcement. Um, but we got to
wait for some people to get settled. Um,
so first let's start off with uh anybody
driving on master? Anybody got feedback?
We're really gearing up for uh the best
open release ever. Um, this is it's
still 098 in the release notes, but uh
this will likely be 010 if it's the
release we think it'll be.
Yeah. Any comments? What people think so
far?
Uh, still looking for feedback.
Yeah.
Who do we have?
>> We're excited.
>> Let's wait to get a couple hundred
people in here and then we'll uh we'll
do the big announcement. You guys have
been asking for a long time. You guys
have voted. Um,
yeah. Anybody have any guesses on how
many uh votes we've collected? How many
dongles are driving around?
>> Mauricio, yes. Do you want the feedback?
Just post on Discord.
>> Plus on Discord, but any like casual
feedback here. Any vibes? Are things
feeling like at least are they are they
feeling very different? Because this is
a completely new training stack.
>> We'll talk about that in a little bit.
We got Mr. Yene here, head of machine
learning at comma. talk about the new
models.
Just add remote start unlock. No, no,
no. We're focused on driving. You know,
we want to ship you an open pilot that
you can engage and just keep let it
going. Is completely superhuman. It
might not take you to the right
destination. It'll need a little bit of
nav for that, but it should do things
that are very plausible. Um, and it
should drive better than you.
>> Mix feeling for MLSV1.
Okay, that that's a good sign. It's a
completely new training stack.
>> Yeah. Um really the first benchmark for
this stuff after getting it to drive
straight was um same performance as what
we've shipped in release. Um so the fact
that you guys are mostly complaining
about launch like experimental mode and
uh you know that it's like it feels like
a regression that's uh that's a pretty
good sign.
>> We'll talk we'll talk about that later.
We
>> have some uh the announcement here is is
about something else. But yeah, I
appreciate we appreciate the feedback.
We're uh aware of of some of the
regressions and we're working to fix
them. We have some new models coming
soon. We'll talk about that.
>> All right. How many people do we have?
Are we are we ready for the
announcement?
>> 127.
>> 127.
>> 137 now.
>> Okay. Okay. Can we get to 150 and then
we'll do the announcement?
>> Bring your friends. Bring your family.
>> All right. Um in the meantime, we can
give a shout out to Nelson Chen um who's
kind of the project manager for this uh
for this project. documented every
little thing that happened. Um,
>> yep. Good job, Nelson. Very helpful.
>> Let's go to 1K. Okay. I don't know.
That's That's ambitious. Um, anyone love
when comment goes live? Yeah,
>> you know, we got to show you guys we're
live sometimes. Um, you see it on
GitHub, but um, you don't always see it
on YouTube.
Opening accounts as a separate viewer.
No. Okay, we're at 138. We're at 138.
>> Maybe 140. We'll go.
>> [clears throat and cough]
>> I see 140, too. [snorts]
>> Sounds good to me. Yep. 140.
>> See 140. All right. Cool. All right. Uh,
should we start with the cake or the PR?
>> Uh, your call.
>> Yeah, let's do the PR.
>> All right.
>> All right, guys. You guys have been
waiting for Toyota Security in Open
Pilot. Um,
and we've had some people driving around
for a couple months now. Um, took a
couple years to get to that point. Um,
big shout out to Willm, too. um former
head of open pilot here. Um he was the
one who initially got these things
working and then Jason here is uh just
cleaning up the port and getting it
shipped to Open Pilot. So this is our
brand new Open DVC repo and I'll show
people. So it's not quite new. Uh it
used to just have the DVC files which
are these very low-level descriptions of
what's being passed around in your car
and we've expanded it now. We've moved
essentially the whole self-drive car
folder into this open DVC project. We'll
talk about that a little bit later. Um,
but yeah, let's Shall we do it? Should
we do a countdown and then merge?
>> Sure.
>> All right, let's get a countdown. Let's
get a countdown in the comments, guys.
>> All right, someone start at three.
>> No one wants to do it.
>> No, no, there's a delay. Sorry.
>> Delay. Oh, no. Is it three?
>> Eight. Seven.
Six.
>> Five.
>> Five. four three two one
>> and
>> merge
>> merge.
>> Y
>> and let's show them how fast the CI is
on this repo. So, we got a new rule
around here.
>> Um I'm very excited about this rule. No
CI can take more than one minute.
>> Um we have some catching up to do on the
other repos.
>> Go to master.
>> Let's go to master. Let's see. Is it
green already?
>> Uh let's see. It should be
>> Let's see. Pending. Pending
>> in process.
CI fasts.
But yeah, the new one minute rule, this
is coming to open pilot very soon. We're
starting with open DVC. Um, but it's
really important that your ripple time
is super super fast. Deploying on Friday
ambitious. Yeah, that's right.
>> We [clears throat] ship on Fridays
because we have good CI.
>> Yeah, this is dramatically dramatically
faster than
>> I'll just click details. I think the
GitHub UI doesn't update sometimes.
Yeah, there we are. Okay, it's already
done. Y
>> show them the times. Took about 30
seconds.
>> Yeah, 30 seconds, 32 seconds, 23
seconds. So, this is
>> on the order of 30 seconds where whereas
there's checks in mainline open pilot
right now that are in the 15 16 minute
range. So, this is really helping us
keep up velocity in open DBC.
Yes. [clears throat]
>> I I think Ade put it really well the
other day when he said it was uh the
slowc was a tax on all changes.
>> Mhm. That's true.
>> All right. So, it took a few years. So,
we decided commemorate this moment with
a cake. [clears throat]
I think last time we did a cake was for
uh when we recovered some katos that
were super hot.
>> It's a nice cake.
Oh, looks like a chocolate. Yeah,
>> Toyota security.
>> All right, so now we can
>> smooth it down spicy.
>> Just message on Slack so people can come
eat their cake. But uh yeah, let's talk
a little bit about the Open DVC project
now.
>> Who likes uh likes some cake with some
me?
>> Brian Johnson.
>> Oh, okay. We can do some actually let's
do some Q&A I guess about TSK. Um,
you got it open. Oh, there we go. Okay,
cool. So, somebody asked, does it work
for all the cars? So, it doesn't work
for all of them yet. Um, Jason, do you
want to elaborate on that?
>> Yeah, so uh this is the first step. Uh,
there's some infrastructure support for
support supporting secure onboard
communication. Uh right now um uh Wilm
did a lot of work to discover ways to
retrieve the key and right now you're
that's going to be kind of a community
effort to actually obtain the security
key that's particular to your car. But
once you have that uh these model
certain model years of Toyota are now
available. I think it'll take time to
have this be available for all Toyotas
uh with security key. It's a little bit
model specific, but right now we're
going for 2021 to 23 RAV 4 Prime and
very right after this stream, we'll have
I believe 21 to 23 Sienna as well.
>> All right, so we had a voting system for
Toyota Security Key. I'll give you guys
a little update on that. So, everybody
was always concerned, you know, we
really need to get Toyota, otherwise,
you know, car support will just fall
off. Um, we [clears throat] set up the
voting system as a way to register
interest. Um, we only got 154 votes out
of 500, but uh, we did it nonetheless.
Um,
and uh, we've got about 56 people
driving around with these cars. Um, so
that's that's pretty good for a car we
don't support. I think the F1 F150 is
about similar. Um, and it has a really
responsive uh, F-150 super responsive.
Um,
>> lateral launch.
>> Those are some
>> lateral or longitude.
>> Uh, longitude. I think lateral is very
similar to [clears throat] our Bronco. I
haven't checked it out, but I the API
should be very similar.
>> Pretty cool.
>> Yeah, it's pretty cool. It's an F150 and
it should be a very, very good open
platform. Um, so those of you with
F-150s um have a lot of reason to be
excited. You
>> might consider trading a Hyundai for a
Toyota now.
>> Hyundai for a Toyota
>> software update. Yeah. Yeah. All this
stuff comes with software updates.
There's no hardware update.
>> What is TSA?
>> What does this achieve? Um, so
essentially there's some authentication
in the CAN messages and for a long time
open pilot uh wasn't able to be ported
through these cars because you need some
vehicle specific key to authenticate
your message. Um, for those of you who
don't know the way Open [clears throat]
Pilot works is you [snorts] have some
lane keep camera and what we essentially
do is we just like you know your iPhone
takes over your infotainment system to
provide you carplay and a better
infotainment experience. Open Pilot does
something very similar for your ADAS
system in your car, but Open Pilot
effectively wasn't able to talk to these
cars um and be a trusted uh citizen on
the on the canvas. Is Jason a common
player these days? No. Okay. So, Jason
is one of our most prolific
contributors, especially in the car
stack. He's most well known as the
maintainer of the VW port and uh he came
out for a couple weeks um to do some
on-site work and uh one of the things he
really wanted to do was get Toyota scary
shipped. Um, so big thanks to Jason. He
pushed us forward really. Um,
>> it was a unique opportunity to get this
one across the line. Uh, William got it
almost all the way there. Uh, needed a
little spit and polish and, uh, I asked
the open pilot team if we could use this
opportunity and they were on board. So,
>> great.
>> I'm glad to get it in.
>> Explain what this is for my grandma. All
right. So, it's not quite ready for your
grandma. Um, but you know, you can drive
around with open pilot in
[clears throat] your graph priv if
you're really motivated to do it. Now,
>> experimental update. Um, yeah, we'll
give that we'll
>> talk about that
>> soon. But this is really an open DBC
focused stream. Um,
>> so I think that's basically all there is
about TSK. We got 154 votes here.
>> I just came for the cake.
>> You want to get Who wants to
>> got to get back to fixing hugging?
>> Jacob should have the honest.
>> Yeah, we got knives for you.
>> You're wearing the wrong shirt today,
too.
>> All right.
>> All right. All right,
>> we got the tools.
>> April's
like
incredibly tall.
>> It's a big plates.
>> Hi, Julie.
>> Hi.
>> Is this like
>> is open better than HA2 in my EV9?
>> Is this food or just a label?
>> No.
>> Oh, no. I don't want to cut it.
All right, go for it, Jason.
>> Take that off.
>> Yeah, that that that didn't cut.
>> Okay. I was I was wondering if that was
plastic or that was
>> plastic.
>> Okay, let's not try to eat.
>> You can take this home.
[snorts]
>> All right.
What about chill update? We have an
update on chill mode, too.
>> Pretty exciting. Oh,
>> yeah. Open silent.
>> All right.
>> Nice.
Congrats.
>> Congrats.
>> All right. The cutting cake. The cutting
is the most important part.
>> Yeah,
>> we can uh
>> Yeah, we're going to have to come back
to that. I'm not cake. It turns out
>> cutting was successful. As you guys can
see, we have a successful cut.
>> Well, the cake be shipped soon. All
right. So, we can't ship you guys a
cake. Better [clears throat] shipping
software.
>> But the cake was not a lie.
>> It'll be in the shop. Another cake.
We'll put commemorative slices of cake
in the shop if you really want. Um,
[clears throat]
sorry, there's some good questions. What
file system? Okay. Um, yeah, I mean, if
you're here, I'd hope you know pilot is
better in your EV9 than HDA2. Um, Kia
Carnival, I don't know if we support
that yet. Chill update coming soon. Will
controls be limiting factor again? Um, I
mean, depends on the car. Push MLSV2. It
is pushed. It's just not to uh master.
All right, so let's talk a little bit
about Open DBC now.
>> Okay, so I'll recap what I said earlier
about Open DBC. Um, at a very high
level, Open DBC is a Python API for your
car. You can pivot open DBC and
[clears throat] then if you have a
common 3X or our particular hardware
setup with a panda and a car harness,
you can read stuff from your car like
your steering angle, your wheel speeds,
all sorts of information. Um, way more
information than we even use in Open
Pilot. But the best quality stuff is
gonna be the stuff that Open Pilot needs
to drive. And then you can even control
your car. Um, you can drive around with
a joystick. You can control it just like
an RC car. Um, and the goal of this
project is to [clears throat] support
every car we possibly can. Um, and
provide a really cool Python interface
to your car. Um, so right now we mostly
support cars that are very good open
pilot experiences, but we really want to
support every car under the sun. um and
make it such that supporting those cars
doesn't make it harder to maintain the
cars that we care about as a company,
which are the ones that make a good open
pilot experience. Um so one of the
things that Jason worked on over the
last two weeks is a way to document
this. Um so cars.md our car
documentation has to expand a bit.
And so this is a very early version of a
new car docs where you can see the
support level for any car. So really,
this should have every car built in the
last 20 years. If we know anything about
it, we could say things like it's
supported in a fork. Um, it's not
supported because of FlexRay. Um,
>> all of this stuff about the car. Um, do
you want to show them the different
support levels?
>> Yeah. So, this is a little bit in flux.
It's not necessarily final, but one of
the things that we want to do to help
pick up velocity in Open DBC to help
merge car ports faster is do a better
job communicating where car ports are at
in the process. Either they're finished
and an upstream and drivable on release
or whether they're a work in progress or
whether they're in dash cam mode because
of like a steering lockout or something
or whether they're fundamentally
incompatible. Um, we also want to be
able to note cars that there might be uh
situations where they're supported in
forks and that might be a long-term
thing, but we want to be able to uh
point people towards the direction of
community forks uh if that's what
they're available. So, the intent for
this new separate document is for
everyone who has questions about is my
car supported.
>> Okay,
>> because I don't see it in the list.
>> We want to be able to add it to the
list.
>> Yeah. uh so that your question is
answered there uh whether we can't
support it or maybe it really is
supported but it's over in this fork.
>> All right, production team is here.
>> If you uh have a common 3X any common
advice really um these guys probably all
had a hand in building it
um or a tiny box now Elliot is on the
tiny team
>> and a recent open pile you want and a
recent open pile unit. You just got it
installed in your
>> key. I had to take it off cuz uh someone
broke in my car, but other than that, I
love it. It's in mode.
>> All right, cool. Um but yeah, the goal
with these docs is there will be two
places you go to find out about car
support. Um you go to comi/vehicles, our
website, and those will be cars that you
just hit in the drop down in our
website. You buy, you know, whatever it
says to buy and then you're going to
have a fully supported experience. And
then if you want to know anything else
about cars, this is the place to go. um
you'll be able to find out stuff like
Toyota security. If somebody comes to
Discord asking is my, you know, 1997
Camaro supported or something, you'll
point them [clears throat] to this
document and then hopefully it's
enumerated here. If not, somebody will
be able to investigate it and then make
a PR and document why it's not
supported.
So, that's really the vision with that
one. Um, we should have a pretty cool
version of it soon. This is just a very
simple markdown file. But uh
>> I think ultimately this becomes like a
nice looking like a little web
experience where you know you can filter
by like is this an EV um you know does
it have stop and go all sorts of stuff
and we can publish all sorts of stats
about these cars too. We have the
microphone log for all these things. We
can know about road noise um all sorts
of cool information that is not strictly
related to open pilot but we're going to
[snorts] release a data set for this
stuff. We'll expand comic car segments
and people will be able to make really
cool experiences around this. Like we
have the best data set for how cars
actually perform in the field.
Let's see what people think of this. I
like that.
My 2015 Ford Fiesta will soon be on Ko.
Any other any other comments? Anything
interesting?
>> Love my 3X. Won't buy another car if it
won't work with Ko.
>> I know that feeling. Yeah.
>> Road noise and car stats. Yes, we have a
lot of data. Have really good data.
>> Yeah. I mean, just with the comic car
segments, what's up?
>> Said he took too much cake.
[laughter]
>> Half the cake is gone already.
>> The hell took
>> Hey, leave a piece for me. Um but yeah,
we have just from what we have in the
comic car segments now, this is by far
the biggest data set of [snorts] the
actual can traffic that's happening on
cars that are in the like on the road
right now. Um and there's so much cool
stuff you can report about these cars.
Um we did an AB one back in the day
[clears throat] and we compared the AB
systems and a whole bunch of cars and
our data set is so much bigger now. We
understand these things so much better.
Um, but even if you're completely
unaffiliated with us, go download our
data set and you can probably write a
really cool blog post about anything
about these cars. Um, if somebody wants
to be an in like an intern on the car
team and just study these cars and make
a really cool version of this, um, I you
know, we're down to have you. Um,
there's so much cool stuff that we know
about these cars and having all this
data is one of the ways we haven't
shipped a car regression to release in
years. Um, and we kind of want to
productionize that and put that in the
loop such that the community can ship
lots of things to OpenDBC. Um, like
Jason is our first open source
maintainer who he has right access to
this repo. Um, and he's not an employee.
We want this to be a real open source
project. Um, so I think this has
potentially a lot of users outside of
Open Pilot who are driving the quality
up for Open Pilot users too.
>> Someone's asking about potential remote
unlock, start, remote HVAC. So again,
this isn't stuff we will spend time on,
but
we've merged like the infrastructure to
get this in, and I think that's stuff
that should be supported in here, and
then it can go and connect. Um, so it's
not something we're going to spend time
on. We are 100% focused on improving
your driving experience. Um, but that is
stuff that can go in here. We want to
know everything we can possibly know
about these cars. Uh, you pull up the
longitudinal reports.
>> So we started benchmarking all the
longitudinal APIs in these cars. Um,
>> so here's the tool and then I've got
reports pulled up separately so it'll be
a little easier to see on stream.
>> So we have like gas and brake step
responses. Um,
yeah. So this is a maneuver where we set
the acceleration to one and a half
meters per second squared and then we
just see how the car responds. Uh, and
we have Oak Pilot's excellent localizer.
We have all this data about it. [snorts]
Um, and we will publish these for every
single car we support. Um, this has been
something that's been really hard to
test and tune in the past when you're
trying to get a good longitudinal
experience out of any given car. You've,
uh, there's been no alternative to just
taking it out and seeing how it does,
and that's dependent on your traffic
situation, what's going on, can you find
a place to stop, uh, etc., etc. Whereas
this you can take into a parking lot and
repeat the exact same thing over and
over and make my new changes and get the
car's actual performance closer to open
pilot's plan. Uh there's a lot of people
that are like you play with different
models and different settings and it's
really hard to know exactly what
variables you're changing. This lets you
dial in exactly what you need from the
open pilot plan so that it always works.
>> Someone's asking about release notes.
I'm assuming release notes for the open
DBC notes
>> as it becomes more of its own project.
We'll figure all this stuff out. Um and
we'll likely publish releases. Um if you
guys know Shane, this is really his
project. This encap encapsulates all the
stuff he works on here. Um and then
we're we're experimenting with moving
the pan safety in here too. And that's
about 30,000 lines for car interfacing
code. And that includes functional
safety. That includes all our testing
infrastructure. Um it even includes the
fingerprints. If we remove the
fingerprints, it's probably like 25k.
Um, and the fingerprints will be removed
soon. Um, we have this cool refactor
called support groups coming out. Um,
that'll make it like way easier to port
cars. Um, it's already super easy now.
But, uh, the real dream for open DBC is
all that car support stuff that's in
fors. There's no reason it shouldn't
make its way in here. U, and there's
tons and tons of stuff that is in forks
right now. And we just want it to be at
Open DBC, even if it doesn't make its
way to open pilot. Um, and if you want
to have a car support fork, you don't
need an open pile fork anymore. You just
need an open DBC fork.
>> Someone's asking what is the next big
project for Open DBC.
>> Um, so we have a road map in the readme.
Um, we're still working on the docs and
everything.
>> The road, it's right at the bottom.
>> Oh, there we go.
>> Yeah. Yeah.
So what we're working on internally
right now is figuring out the exact API
for car control between open pilot and
open DBC such that we have two
engineering teams here, the autonomy
team and the product team. Um and one of
the things the product team does is like
low-level car controls in the OpenTVC
project. Um so we have to figure out
exactly where that line is. It's a bit
fuzzy right now. Um so we're working on
clarifying that and then really setting
up a good evaluation loop for that half
of it to test the interfaces such that
the driving policy is fully abstracted
out from that. Um so that's the main
thing that we are working on but these
are just general goals for the project.
Um even if not we're not working on that
at the moment but uh and we have another
engineer here working on mutation tests
for the safety. The safety should have
like the most incredible testing pretty
soon. It already does but it should be
even better. Um, cool. Yeah, that's
OpenDBC. If you want to contribute,
there's lots of places to contribute. If
you have a car support fork, um,
consider upstreaming your stuff here.
Um, like Jason, for example, is working
on a Chinese car a couple years back
that's now lost in a PR that got closed.
We want to merge all this stuff as soon
as there is some valuable stuff in it.
There's no reason we shouldn't have that
like Hongchi um, like there was some
Chinese brand. We should have that
partial carport in here. It should read
a car state even if it's not perfect.
and then somebody can go back and pick
it up and then the new docs will
communicate what state that is in
exactly. Um yeah,
>> cool.
>> So that's OpenDBC.
We have a super active community on
Discord. Um so if you're at all
interested in car hacking, any of that
stuff, join us on Discord. Um we're
making lots of progress on OpenDBC.
>> Some people are saying car manufacturers
should also contribute and be open.
>> Yeah.
>> Yes, they too.
>> That's kind of the idea, right? They can
push their DBCs, they can work on the
card interface, they can push tunings,
fingerprints.
>> Um there's no reason they shouldn't,
right? Um
>> it's a lot like, you know, a lot of
manufacturers handle the Linux drivers
um for their hardware. We we see Open
TBC looking very similar to that. Um
>> an operating system for your car. Nice.
>> Cool. Yeah, that's open DBC. And then uh
you see, do you want to flip around talk
about 010 a bit?
>> Yeah,
>> we can uh you can sit down.
All right. So, we'll do a brief stint
about the next release. Um, if you guys
saw my Discord post, um, a couple days
ago, we have everything we intend to get
in um, for the next release, which will
probably be 010, though. Um, it's still
going to be 098 and master for a while.
Um,
as a reminder, all releases are canceled
up until we have noticeable driving
improvements. Call us liars on Twitter
if it's not. Um, you know, you should be
able to feel the difference. Um, that
hasn't necessarily been the case over
the last few releases, but uh, that, you
know, that's a blocker on shipping
releases now. Um, and we have four main
things that are going in that release.
So, we have the new MLS models. Um,
completely new. This is mainly what
you've seen, we'll talk about. Then we
have um the first taste of N10 long and
chill mode. We have the brand new Toyota
tune and we have some DM fixes um
related to like you know your passenger
being distracted and then it classifies
you as distracted.
>> Yeah, let's talk about the MLS models.
>> So um
you guys you guys have been following
following along with the secret secret
good open branches. Well, it's not that
secret anymore because you guys have
been uh
>> it was never really secret.
>> It was never really secret. It's never
really we don't have any secret big
models that are like really great.
>> But uh yes, so we uh finally got into a
state where it's comparable to what's on
master and uh it's just easier for us to
just merge it right now and merge all
our internal training branches which
makes development and and progress very
easy for us. Uh you know working on
branches and keeping the rebases uh is
is kind of a pain. So um yeah it is in a
state where it's very comparable to a to
master um so we we clicked merged and uh
which is very exciting. It's which has
been a project for a long time. So uh to
to uh say a few words about what MLS
simin or what secret open is it's
essentially training uh the driving
policies in this new very new style of
simulator of simulation that's based on
machine learning. So everything is
trained end to end. There's no there's
no hardcoded logic for for simulation.
So the driver
>> as as opposed to what you want to play
tiny similar bit
>> as opposed to taking an image and
warping it a little bit with some priors
on depth and some priors on on geometry
uh and doing some very very basic
warping of the image which introduces a
lot of artifacts. Um so that's how our
previous simulator works. Um some other
simulators might be you know GTA 5 or CA
or other things but we don't want to use
that because the world is the world and
the scenarios there are very limited so
we need something that's datab based. Uh
so it's what leaves us in in either
machine learning based simulation or
some kind of reprojection based
simulator. So this new style of
simulator is very exciting. It's uh it
works very well. Uh we can basically
learn uh like a video game where you can
where you can play tell it which which
curvature which steering angle you want
which acceleration you want and it will
react to that and give you frames that
look like uh real driving video. Um so
these new new models that are in open
pilot right now are trained fully end to
end uh in closed loop in these worlds in
these world models that we call we call
them world models sometimes. Um and
that's exciting because we can
essentially uh remove all the
bottlenecks and all the crippling of the
models that we had to put in order to
avoid the models uh using the artifacts
of the previous simulator. So, as we uh
you know, we we we're aware that there's
some um some rough edges, some hugging
problems, and some lane changes
problems. And
>> that's a huge victory just to get to
this point.
>> We're looking to fix we're currently
fixing those. And as soon as we reach
really uh comparable performance, we're
going to start to scale both the
simulator models and the driving
policies uh which uh will hopefully come
without any bottlenecks. So uh you to to
people who don't really care about the
machine learning nitty-gritty that just
means you know open is going to get
better and smarter and and uh and uh and
more interesting. Uh this is really
exciting because
uh I mean there's been proof of concepts
of things like that being done in games
in Atari games in Doom uh etc. Um but
there's no uh no one has ever done that
in a real world ADA system. uh and we
know a lot of people are trying
currently and I'm sure some people are
very close too. Uh but uh besides games
and Doom and uh other video games, no
one has been able to to deploy uh a
policy that's trained fully in
simulation. So that's really exciting
work. Uh that's uh the autonomy and the
open pilot team has been working on for
a long time. Uh and the infrastructure
team too. Um so uh
>> we just got a couple new racks stood up.
Um Yes,
>> got a couple more standing up soon.
>> Big team effort. The models are training
every day 24/7. Uh GPUs are uh are are
warm. Uh and uh yeah, so that that's
pretty much the update. We're working on
fixing the issues. We appreciate all the
feedback. Uh but I think the coolest
thing is feedback is more actionable
than ever. Um we've had this in the
pipeline for a really long time and we
constantly have to make the trade-off.
Do we try to fix this in the existing
stack? Do we try to make experimental
mode good in the existing stack knowing
that it'll never really scale to
anything that's really beyond what you
experience now. Um so now we don't
really have to make these trade-offs. We
finally ship the thing that we intended
to ship for years. Um
so you guys post segments and we will be
able to debug why they happened and
there there's going to be like no
consideration of like a do we really
wait for this new thing that's coming
very soon.
>> Yeah.
>> We're going to look at your segment and
figure out exactly why that happened.
>> Yeah. This is this is an architecture
that we intend to to stick with for a
long time. Uh especially because it's
really clean. It's two models. One model
that that simulates a world and one
model that learns how to drive in that
world. So uh we that's that really is
that really was the the plan all all
along. And uh we don't really see
anything better than this. Uh and the
improvements are are going to are going
to come very very soon hopefully as soon
as we start scaling these models. These
models are still tiny. So just to to to
be to be clear uh these secret good over
branches and we recently shipped we
didn't increase any model size or
anything. The simulator is very tiny
still. Uh so uh hopefully u we'll scale
these soon. Scale these up make the
models bigger make the GPUs go better.
>> Yeah. So, for this upcoming release, the
things that you should really notice
that are different, um, you're going to
have the best time if right now you have
a Lexus ES TSS2, but it should be all
TSS2 cars [clears throat] pretty soon.
Um, you're going to notice the biggest
improvement on that car and with the new
model. Um, but very specifically, if
you're disengaging in stop and go, we
want to fix it and we will block the
release on that. Uh, if you have any
like if you're having a bad DM
experience, we want to know about it. We
ship some pretty big improvements to
master. Um, and if in the new models you
see significant regressions, we will fix
those are all blockers for the release.
Um, and we want those things to be
perfect. This will be unambiguously the
best open pilot release we've ever done.
Um,
>> very very excited about this release.
>> Yes. And then once this is out, you want
to tell them what the focus is.
>> The number one priority for this company
after that will be shipping antong. Uh,
what you guys have been asking for for a
long long long time.
>> Um, and that'll be the biggest
improvement. So we have the first taste
of it coming in 010. And essentially
what that'll do is the model can decide
whether it wants to allow applying the
gas or not. And what that does is like
say you're approaching a really obvious
case like a stop sign. It'll say like
okay, you know, we don't apply the gas
when we're coming up to a stop sign. It
won't apply the brake but it it won't
apply the gas. It won't floor it.
>> Yeah.
>> Um this you'll also notice this in cases
of like very dense traffic where maybe
open pilot doesn't have a lead yet, but
it's like nobody would hit they wouldn't
floor it in that scenario too. Um, so
there's some subtle cases where it'll be
better and then in the obvious cases,
um, it won't floor it.
>> Yeah. In turns on the highway too,
that's also very useful. Limit
acceleration. Um, turns on city streets
as well, red lights and stop signs. Um,
yeah. So, it's a very first taste of end
to end long. Uh, yeah. End to end long
in show mode. Um, also potentially AE
that'll be next.
>> Yeah. And then and then we'll come back
to things like nav and and exciting
features that a lot of guys a lot of
people have been asking on in the chat
asking about in the chat. I saw that.
>> So yeah, I think the the biggest thing
that the community has have very valid
complaint about for a long time is like
they post segments and they haven't
necessarily been actionable. Uh which is
a very fair complaint. Um but we
constantly have to make this trade-off
of like do we try to fix it now or do we
wait for the new architecture. This is a
totally new paradigm and there is
nothing else in the pipeline. Uh, we're
going to ship this, then we're going to
be 100% focused on shipping end to end
long to you in chill mode and deleting
experimental mode. It'll just be one
single reliable experience that we ship
to you. Um, and then on the car side,
we're going to do what we did for our
Lexus, but for all the cars essentially,
we're just going to go down the list on
the next candidate car. EV6 is a
candidate for next. Uh, maybe our Ford
Bronco that has the potential to be a
really good platform. Um,
>> loves the Bronco.
>> Yeah. So, we've have we've got really
good loops for this now. Um, yeah, I'm
really excited for 010. Um, you know, it
ships when it ships, but hopefully soon.
Um, we're scaling everything up to make
it happen. Uh, we're standing up new
racks in the data center. The models
that we merge now are just we built
those racks. We built those a couple
days ago, a week ago.
>> Yeah.
>> Yeah. As soon as as as Greg uh plugged
the plug the racks, there was models
training on them. I think a few minutes
passed between between the servers
turning on and them being 100%. SEO
unless that happened right that day.
>> Uh no, we wouldn't now.
>> Yeah, I think we merged it like maybe 24
hours after the rack stood up.
>> Yeah. Yeah, it was. Yeah, the we
increased the center. We should probably
go on next stream.
>> Yeah, we've got a lot of exciting stuff
around here to show you guys.
>> Data center,
>> even some very exciting stuff in
production. Um ultimate provisioning, a
lot of lot of a lot of cool stuff. We're
scaling up. We're setting up uh the
second circuit board line. Um a lot of
exciting stuff happening.
>> Yeah.
>> Um cool. I don't know. Is there any
final good questions? You see anything
cool?
>> Uh let's see. Should we see improvements
on all cars?
>> So you will not Yeah. Uh yes, but you'll
notice the most improvement right now in
Master and the Lexus ES TSS2 and then
all the TSS2 cars before it goes to
release. So that'll have the biggest
biggest difference u especially launch
shooting. And then the other cars, the
goal is to get the new style models up
to the same standard as release. But
just from the inherent like beauty of
the new training stack, you should start
to see some nice behaviors. Like I've
noticed in the UI UI looks a lot more
stable, looks more self-consistent.
Yeah,
>> it feels a little more confident.
>> It's more confident in terms.
>> Yeah, it just feels like it knows what
it's it gets it a little bit more.
>> Yeah, it's Yeah,
>> there's a comment uh love having the new
models in master. Makes sense to be on
bleeding edge. Uh another comment uh
uh would love to work with KA. What do
they do if they
>> Great. Okay, perfect question.
>> Get a job here.
>> Okay, cool. Um I almost forgot the
hiring shell. Okay, so we have um if you
want to get a job, come jobs. Super
super super super simple process. Uh
essentially uh it starts with either a
challenge. We've got lots of fun
challenges, a controls challenge, a
compression challenge, a hardware
challenge, design challenge, lots of
challenges. Um you can find the
challenges on comai/leerboard.
Even if you're not interested in a job,
it's cool to be on the leaderboard.
Right now, the active challenge is the
uh hardware challenge. No one's claimed
the 20 bucks yet. So, if you're good at
hardware and you just want a nice cool
little crown next to your name on the
leaderboard, that crown stays there
forever. Um, you know, it's more
valuable than the 500 bucks you win. Um,
go ahead and check out our challenges.
Uh, we're hiring for lots of things.
We're hiring controls engineer. We're
hiring lots of people for the product
team for, you know, web full stack
stuff, for system stuff. Do you want to
write us a new updater? Do you want to
like do you like kernel hacking, reverse
engineering stuff? You know, always
hiring for that. Hiring hardware
engineers to work on products like the
3x, work on manufacturing. Um, lots of
lots of cool stuff to do in production.
We have, you know,
>> the whole company is in this 20,000 foot
office. Um, you know, upstairs is the
engineering teams, downstairs is the
production. Um, every device gets built
here, it gets designed here, gets
fulfilled from here. Um, it's a really
cool operation. Uh, we probably have
some of the best testing for consumer
electronics um around. Um, then there's
even so much more to do. We're shipping
ultimate provisioning. I'll show you
guys that soon.
>> Even the racks that we use to train the
models are made right here.
>> They're made right over there.
>> Right over there.
>> Um, yeah, a lot a lot of cool stuff. Um,
you know, you want to come here and own
manufacturing. Um, you know, all the
parts in cell phone, you know how to
make things reliable. Um, you want to
work on supply chain. You know, we're
hiring for all that stuff. You want to
design things like the 3X or the comma
body. Um, you know, as it gets, you
know, We'll need um you know we'll be
spending more and more time on robotics
on our side soon.
>> We're working on road models on uh on
controls and things like that.
>> You just want an internship. Um you know
do the challenges but yeah all we test
there's no like you know leak code on a
whiteboard or I don't know this is the
only job I've ever had but I don't know.
I hear these things. Um super simple. We
just want to know can you do the work
and do it independently. Um, so either
contribute to our open source repos or
do well on a challenge and then there's
like a quick phone call with either me
or Harold and Eene or and then one quick
one with Alex and then that's about it.
We'll bring you out here.
>> There's another question about uh how
the uh simulator works for training uh
how their real world uh driving data
kind of feeds into that process. How
does that feed the simulator that feeds
that trains the models?
>> Yeah. So we use 100% real world data to
train the simulator. The simulator is
trained on real world video and real
world ground truth from our localizer
and things like that. Um so that that
gives us a nice simulator. Uh and then
uh it's a little it's
>> about the output space of that sim like
you can drive around in it. So the input
space of that simulator is essentially
six degrees of freedom uh pose input
which which is the x and y and z
translation uh and the x and y and z
rotations essentially. Uh so that's the
input space. The output space for now is
uh you know video an image the next
image that will result from from that
translation rotation and uh and that is
the secret sauce is uh uh basically what
the human path would have been given the
context and given uh that translation
rotation. So that is a that is the
secret sauce that comes from from the
simulator. Uh so this is input output
and that's it. We don't output any lane
lines, any lead, any car, any radar,
nothing else. Um, and then we use this
simulator uh to uh essentially put a
driving policy in this world and then
the driving policy decides decides how
to drive and uh uses you know those
images as as inputs and uses the uh the
human path that comes from the
simulator. In this case, it doesn't come
from a data set anymore. As soon as as
soon as we train the simulator, we
essentially forget about the the the
real real world data set. We still use
it for some things for, you know,
initializing the simulator. We need some
context frames and things like that, but
we essentially forget about the real
world and then just use the simulator to
train a driving bossy. And I know this
is a little abstract and it's not very
clear to say to explain it like this in
a few in a few seconds but we are as
soon as we finish this and we we match
the performance of master of release and
uh and and put this in a good state we
will write a really nice blog post uh
that will have uh you know beautiful
visualizations and beautiful schematics
and uh and uh it will be a lot clearer.
But yeah that is essentially the gist of
it.
blog update coming.
>> Yeah.
>> Why does everybody ask this? We We do
them when we do a release. All right.
When we do a release, we'll do a We got
to ship you good things first. Shipping
to master does not count. We have to
ship it to release. We're very serious
about shipping here, you know.
>> Yeah, we count.
>> We wouldn't count your device built if
if you know it was just sitting
fulfillment down here. We didn't
actually ship it to you.
>> You know, it's like the demos. We built
demos for this world models have been
around since 2016 and nobody shipped
anything like that. So, [snorts] um if
if if a blog post was was uh enough for
shipping, that would have been very
easy.
>> Yeah. Yeah. Blog post once it goes to
release, but yeah, for sure we'll do a
blog post.
>> Uh there's some questions about specific
car models, but I think we talked about
that during Open DVC.
>> Join the Discord. If you know, if
Jason's new docs don't answer your
question, then you can go and complain
in Discord and we'll fix it.
>> Um
>> all right, I'm going to head out. Uh
>> All right, cool. Got to go train some
new models for you guys. train some new
models. See you guys. Uh thank you for
uh for the feedback and everything on
Discord. Really appreciate it. And uh
yeah, got to go train some new models.
>> Yeah, you guys are really part of making
this the best release ever. Uh we will
take all your feedback. If something
looks like a regression that does not
happen on release, we will block the
release on it. So you guys feedback is
super super important for making this
the best release we will ever ever ship
up until now.
>> Cool. Any more good questions or we uh
go to end it?
>> It's about I think most topic. All
right, cool. Um, all right. So, one one
last shout out for uh jobs and hiring
and leaderboard. Got lots of stuff to
do. Um, you know, if anything here Oh,
that's my key. Yeah, if anything in here
looks pretty interesting to you, um, you
have fun doing our challenges. Um,
you'll probably have a good time here.
Um, it's a great time to join.
U, lots and lots of interesting stuff
going on on the product side, autonomy
side. U, even the operations side,
operations is hiring. Um, so if that's
your thing, I think Alex is working on a
challenge, but um, just email in work
comi.
Cool. I think that'll be it. Thanks for
joining, guys.
let's go peace okay it's been a while
since we've done a trash-talking
periscope so I think it's about time we
are gonna watch the Ashley Vance
zooks profile so you guys know
I felt kama get a start and now okay so
first first first first we break down
this tagline your robot taxi has arrived
kind of no it hasn't
show me where I can buy a Zuke's can I
buy a Zook somewhere no I can't buy a
zooms anywhere so justjust just to make
this this clear um now let's start with
this well you can see it better let's go
over to youtube so you can see it better
right that's a personal bicycle oh look
it's a guy thing okay um so a few
interesting things about zooks you can
actually see their GPS module so this is
their ladder that they're using um this
is a Bella dine puck right so to compare
way mo2 zooks this is this is this isn't
off-the-shelf turbid since on Tesla's
board that's great
why don't any funds oops don't funds
oops um Susan LM Park this is the the
lighter that they're using again it's an
off-the-shelf lidar it's fairly cheap oh
by now can actually buy something from
valid I know I can uh please tell us a
little about yourself and then they'll
be in touch okay all right please put
your lighters on Amazon thank you okay
so they also show you the inertial
system that they're using
I got the video slowed down and running
in a real slow mode so they show you
that a shot of it it's a no XTS system
it's that um so they're using an
off-the-shelf inertial localizer and
this is this is like a GPS so you see
primary and secondary those are your two
GPS antennas so this is very similar to
a plan X we can look and they're
probably using the same stuff on their
on their Lexus Rx's um this is just
another one this is actually the one
that happens to also be used on the
data set so interesting thing about
about success sensors there
off-the-shelf things um so the first
part of this video entry on camera using
the first part of this video they show
you these things and now why exactly
zukes is building these things it kind
of makes no sense by the way guys face
to be to me to tell you why I'm doing
this
I don't do this about weigh my right I
don't do this about lame-o like lame-o
might be a good investment lame-o might
be a good company I think there PR is
extremely distasteful but you know okay
what's the problem with lame-o no
problems the problem with zooks
is they increase hype to a point that it
isn't true um and we'll get to what
isn't true
and there's no way to really know so
it's really hard to talk about the
quality of a self-driving car drive um
one of the metrics that can be used is
disengagement so then if you go in this
video they talked about you know what's
actually going on in the zukes car and
they go for a drive back to the office
in San Francisco it's like a 20 minute
drive mostly freeway um
notice let's let's freeze the frame
right here what don't you see scobie's
it's interactive you gotta talk what's
not in this picture and it's very
deliberately framed this way scroll for
old comments what's what's missing from
this picture that you might see in any
other car a steering wheel right so
notice the way that this shot is frames
so Wow look Suk's has a car without a
steering wheel right and that's what you
think if you're just glancing over this
video but that's the backseat of the car
guess what's in the front seat of the
car and we'll get a shot of them in a
minute look at you didn't see that guy
anywhere else look at that guy who says
how come we didn't get introduced right
so the video unfortunately is not really
an unedited um unedited thing oh we can
go over here to this is this is a video
that Cruz Automation released and it
actually is an unedited video of a drive
throughout City to San Francisco um and
they show you look here's the safety
driver here's the safety driver you know
with their hands a safe distance from
the wheel but not touching it okay they
have a little gimmicky thing that says
autonomous but this is a real video this
is an impressive technology demo um this
is hype right and you know what car a
guy we do love hype now
you guys man look at the symmetry of the
yeah I wouldn't mind a chauffeur either
what are they cost I'm okay so you know
if he hears it cut across the things
tracking the trough that's all great um
so the only thing that I could really
nitpick do you guys remember the drive
that AI video the line following robot
that that one was bad
um this was the only thing that I could
really nitpick that I think is probably
a disengagement right they don't tell
you whether there were disengagement syn
the drive mean again they're sitting in
the backseat you can't tell whether that
driver is casually pressing on the brake
pedal touching the steering wheel a
little bit I can do the same demo with
open pilot you know magicians do this
all the time you got the guy in the back
seat to distract the guy who you doing
the trick for you put the guy in the
front seat who's actually like stuff in
the rabbit in the Hat when nobody's
looking
look I'm not saying this is true I'm
just saying it could be true we're all
having fun here believe this one look at
this one okay so here's a car here's a
vehicle right I want you to watch I'm
gonna slow this down the maximum I can
we're going down to 0.25 speed all right
I'm one of those conspiracy guys on
YouTube now take a look at when it
breaks right as a human when would you
hit the brakes right the brakes are hit
right there
well after obviously that car is is in
your path right now I can't tell for
sure or not whether this was a
disengagement but this is not what a
human driver would this looks to me like
they were expecting the autonomous
system to break the autonomous system
didn't break what you could probably
really do is if you take this video
frame by frame you could see exactly
like what the braking look at this look
at this you could see exactly what the
braking trajectory was like right and
then it starts to break hard here at the
last minute you can see the buck forward
oh you know what you know what wait wait
let's do a quick bonus video of Pony AI
Oh Pony AI is my favorite
okay so Pony AI is using a Lincoln MKZ
um ah
this part of the scene okay so this part
of the scene for the Pony AI you can see
there they have the sorry sorry sorry we
got a little distracted of Zeus why
would you do this for a minute because I
found this video really funny so here we
go they're gonna look at this cyclist
here watch the steering wheel
look how it jerked like that that is not
a self-driving car that is a human in
the backseat with an Xbox controller
like this isn't off-the-shelf demo car
so this is worse than Zeus okay this is
worse than Zeus
there's things out there worse than Zeus
let's not say Zeus is the walkway oh
wait you want to you want to watch the
wheel get jerked by the Xbox controller
guy again let's let's really go to it
we'll go to point 5 speed here alright
now to be fair the car was probably
autonomous up until that point and it
probably did autonomously brake for the
biker and then in order to make it seem
smooth look look look look look so this
is right when the human jerks the wheel
that's clearly an Xbox controller
maneuver oh we're gonna hit something
good heads up jerk the wheel right come
on pony aaaah you can do better
um no yeah you wanna what you want to
watch the collision you guys wanna watch
the phantom AI collision uh-huh but yeah
so this is all I could really nitpick
from the zukes video to be fair it's not
too bad I just wish they'd wear it like
so big with the hype do you talk about
your diss engagements openly and
publicly by the way I'm the highway
Carly I had zero but that doesn't matter
it doesn't matter because what matters
is hype so now on we're pivoting the
full hype got a pivot to hide bro oh so
let's see what else we can pick out of
the nukes video
now honestly if this was all that Zook
showed this is at least something
putting them you know I think a bit
behind but somewhat reasonable no I
could have been a ps4 controller no no
no you don't understand you can buy that
car from autonomous stuff and it comes
with an Xbox controller so I'm sure it
was an Xbox controller
um stop-and-go rav4 yeah well sorry
flashes yeah that's fine let's do that
oh all right let's go peace let's see
we'll do it a little more let's see what
else we can find this is mostly who we
wanted to make fun of today I have a map
I think if you really looked at this
frame for friend you could probably find
more dis engagements maybe free panda oh
oh it's wow you're here you reviewed the
whole drug did they disengage the
reporters in bachelor dances in the
channel right now Oh worried where
they're actually notice engagements what
what about what about that that thing
that I had that thing that I pointed out
okay well so the autonomous mode was
engaged the whole time so we've been in
cars where they say the word autonomous
the whole time but the safety driver did
corrections so we can engage the
autonomous mode the whole time and
adjust the steering wheel and that's not
considered a hard disengagement um it's
a little bit ballsy to not have the
brakes be considered a disengagement but
yeah I mean these are the these are the
numbers that I really want to get at
that's amazing
periscope I like this hey hey you know
what if it turns out that zukes is
awesome zooks is awesome um you will you
know you never saw their hands on the
wheel because they were in the backseat
what about the safety driver yeah so did
the safety driver make any Corrections
right all right all right I like this I
like I like this I like this integrity
and self-driving car journalism um yeah
so okay as far as investors going Zuke's
we can look into the details of their
round you never saw him touch her okay
cool
cool I take your word for it zooks
through without this engagement my good
physics um when the car pulled in front
it was weird did did they hit the brakes
is the question I mean I'd be interested
to see I thought for sure the human had
to take over okay
scared shit on that part they swore now
it's possible it was no like the car
clearly I hit the brakes too late but
they might have a decent you know
emergency braking thing I'm like uber oh
cool
no I'm glad you did um this is this is
excellent okay
this came for me let's back Suk's to a
do it okay all right we like Zeus yeah
why not talking about the exciting stuff
kama is doing instead of focusing on
competitors that's what we do in all the
other periscopes
[Music]
I will show you guys we do have so on
the highway merges
the one reporting was the worst of the
bunch yeah yeah I mean again I believe
that that was autonomous and somewhat
reasonable
we will talk right in front of we do
have a little poster where we celebrate
Zuke's this is why we don't build cars
yeah yeah but again that kind of stuff
is forgivable and I wouldn't call what
they did I'm safe I've seen I've seen
very conservative humans do the same
thing I didn't even call him out on that
it was that breaking event that was bad
but we won't come around on suits now if
I was ooks again I mean I guess this is
a way to differentiate yourself right I
guess that's really what it takes in the
market you don't think they have a
driver camera hey tzuke's
zooks release the driver camera video
from your drive with Ashley Babs do it
do it do it
no but seriously it was a time let's do
it we make a change in the world we're
demanding transparency and self-driving
car journalism and what do I make of way
mo in Arizona 11 douse key told me
there's no way to doing that for real
interesting um so here's the thing about
Wayne Wright way mo had that demo that
you saw in 2012 so what happened in the
last five years right way mo had a demo
where they could drive you back to the
Google office in 2012 what happened in
the last five years um I believe that so
okay
from what we can tell about lame-o they
are doing all of their stuff with a
safety driver the the way Mo's without
safety drivers are all done for PR so
there probably is a good chunk of these
engagements but do I believe that they
can launch in Chandler Arizona have you
seen I think I think if you look at
Chandler
I do kind of believe um is way mo AI a
joke no way mom as the most advanced
self-driving car in the world um what
the joke is where most PR it's way most
PR that that disgusts me honestly this
video doesn't disgust me I kind of like
it I think Suk's is overvalued but it's
good stuff right right it's a it's a
presentation of what it is and not what
is way No
right let's let's watch a hello I'm way
mo and oh no because yeah yeah why is
there no public photo because that's not
way mo doesn't do this it's it's this
kind of video
like vomited in my mouth no way Moe's
not driving public 2009 our team at
Google has been delving fully
self-driving technology
[Music]
now I'm driving in Austin Texas alright
um no no no no
so what way most says um and as far as I
can tell the early rider program does
exist uh unclear if these people are
paid actors or not I think the ones in
the videos are paid actors I do think
there are legitimate members of the
public in the early rider program I know
I know the video is disgusting but way
mo is not driving them without a safety
driver every single way mo out there in
the early rider program has somebody
behind the wheel of our self-driving
cars a few people who live near the area
have like looked around there and what
they can say is yeah there's a lot of
lame-o's driving around and they all
have people in the driver's seat oh the
people the people in the videos I really
think are actors one of these days maybe
we'll do a periscope breaking down when
we try to like crop out their face and
do a reverse image search for it and go
find their find their Instagram model
mayhem wherever actors are posting
themselves these days but yeah cool well
that got turned around we got we got we
got uh a props the valley actor for
coming into the periscope - uh do I have
a girlfriend now I have a company I
don't think the Tesla accident was
caused by Tesla's marketing I'm not
saying I like Zeus I'm not saying I like
zukes
all I'm saying is the valley hack came
in the channel who was in that car said
that he was watching there were not dis
engagements and I believed him so yeah
cool good for six but I would say I
would say if anybody out there from
Zuke's is watching I would love for you
to release just just the driver camera
of your driver driving throw it up on
YouTube technical crap it'll help you
with recruiting I mean cruise does it
right I like I like the videos that
Cruise released
yes Luke's is closed source I mean the
other thing too is like their sensors
are our generations behind windows right
what way mo would not have built their
own we got we got five million dollars
investment what would I do with five
hundred million dollars I have no idea
Marketing is autopilot I like Tesla's
marketing for the most part the truth
about the test the crashes is they don't
seem to be like statistically that rare
is closed source for pores okay so so
our now let's let's let's put our our
business hat and talk about Dukes for a
minute right so
zooks a1c bit of self-driving car
startup is closing a 500 million dollar
raised at a 300 billion dollar
post-money valuation prior to the deal
zooks valued at 2.7 billion interesting
so they actually raised it the same
amount of money I mean so so you can see
that like this is this so this is a
post-money valuation so the way a
post-money valuation works is you take
this and then you create 500 million
dollars worth of stock so everybody
everybody at Zuke's gotta get is called
dilution and also be curious to see if
we can find anything about the terms of
that investment who founded tzuke's oh
okay so here's the other thing that
kills me about tzuke's the symmetrical
cars no no no no I can't watch no no
more way no ads no okay we've all we've
all come around on jukes we've all come
around on Zuk Zuk says okay this is Tim
Kevin clay I was on a panel with him
once is just enough it soon
so no Carney mind we are we are fair and
open-minded here we are fair and
balanced periscope channel
these things though these things and the
idea of cars being symmetric to nice
manner they make fun of themselves
zooks has way becoming AI come as the
Apple one yeah I don't talk to any
engineer about bi-directional cars it
doesn't make sense to me a cars or cars
mostly move in one direction if you want
some video evidence of this look at how
much this car goes backwards as you see
all words pointing forwards here and not
backwards they want to be different with
the cars yeah I mean remember the time
we wanted to be different by making our
things bright green it was a dumb idea
2020 where it expects to put its first
vehicles on the road I mean making fun
of themselves like I like that alright
now we all like zooks now all right all
right all right all right Tommy I'm
marketing strategy revise you got a
marketing class we don't do any
marketing I just occasionally go on
periscope and make fun of people um
don't worry we make fun of ourselves too
it was media trolling yeah you say that
now we thought that people would love
the bright green new coke right
oh yeah I went sailing this weekend I
got sunburned
[Music]
celeb endow ski fix that way low stuff
is bullshit that's interesting what am I
making sir I liked it I mean it's good
I would not invest in zooks I would
really not invest in zooks
I don't see how they're ever gonna live
up to their their their their their
valuation I don't know like it's really
hard to tell the difference between hype
and not hype
I just remember I just remember how bad
the demos I did for you are like they
were so bad compared to what we have now
um reaching out to 11th St was good to
everybody should get levin dosti 's
comments on stuff i don't think making
the cars begins the differentiation i
met with them a few times he's a great
guy I'm like what's the best of luck bye
oh yeah
if we're doing the roundup of
self-driving car startups they have a
new logo now this is leopard on skis new
self-driving truck startup powered by
WordPress proudly no I don't think
Zuke's wants to sell you cars in one
syllable companies all right you have
changed my mind about zukes
when now Suk's fans without really
presumes to succeed we're not gonna make
fun of Zeus anymore and you know what
will really redeem Dukes is if they
release the video of the drive of the
safe to drive and not doing anything
then Zuke's will have a bill be golden
and worth their valuation all right guys
Wow so much can change in the span of 25
minutes
you know bro it up oh oh yeah yeah yeah
yeah yeah yeah
in early 2015 zooks became firing staff
and retrofire housing prototyping
facility in a distressing sign for zooks
as early investors kevin lee clay also
spent $16,000 on a subzero office
refrigerator because he thought it
looked cool there's too much money in
Silicon Valley there's too much money
zooks
and its founders had a clear picture of
the vehicle they wanted it would have an
identical front and rear this is dumb
why this isn't how design works right
like you start with an engineering
requirement right there's a reason that
cars are asymmetrical like what you
think that all the other car
manufacturers are like shit we never
thought of that before right I really
don't understand what that buys were and
would be easy to service on the rare
occasion when it wore out its built-in
redundant cars right so this is an
interesting idea like car companies have
been in the service game for so long
especially when you look at Tesla right
successful services all their own cars
how does Luke's think that they can
possibly do better than Tesla on
servicing their cars okay zooks wants to
revolutionize 10 things and you know
what for most areas should go to
Mitsubishi 3000gt out of cars for real
steering
um but it's not about four-wheel
steering it's about why right like just
have a slip angle it's fine uh each
vehicle would have its own motors the
vehicle commit precise maneuvers and
tight spaces is that what most driving
us um can't anyone do better than Tesla
on serving their cars well I have a few
issues with Tesla's there are just rare
cars right so you can't really compare a
Model S to a Honda you have to compare a
Model S to a a car that sells similar
numbers they also the availability of
parts for a Tesla if you are not Tesla
is is rare but Tesla has an integrated
servicing solution
right and so I actually no I haven't
actually looked into the Consumer
Reports but all I'm saying is like if
you're designing from the perspective of
caring about keeping your service costs
low Tesla has the right incentives
whereas some other companies might not
right I mean does Volkswagen really care
if their cars break Kovu ii like the
Volkswagen dealerships want the
Volkswagen to bridge dealerships don't
make that much money selling new cars
they make money I'm bringing you in for
the service be every 18 months right so
Tesla at least if these cars are under
warranty actually wants to bring down
the true cost to repair so what I'm
saying is like that's the way they start
engineering whereas it's unclear to me
if putting redundancy in the car is a
good idea so for example um this is
something I talked about of an engineer
here a lot the body has redundancy at
the cellular level right a lot of the
things we are building too so like if
your body doesn't repair cells it just
kills the cell and makes a new one um
when you look at phones like this
beautiful car ie on right here by one
come to shop that time without a guy
coming by the ice glass shop you look at
the see on right here right if this
breaks you don't fix your eye on you go
to shop , da di you buy another eel all
right oh no user serviceable parts
inside right so if you were running a
fleet of cars that's the way you want to
deal with this right you don't really
want your cars to be like linking easy
to service because they're redundant
that doesn't make sense to me
Moe right so so what
why would eat wheel out its own motor
that makes no sense right and especially
when people start talking about putting
motors in the wheels I mean this looks
great from a design perspective but
you're putting way view you're putting
all this unsprung weight on the car
right you cannot gonna have a car that
that uh that that has a good suspension
an array of sensor to be seamlessly
integrated not jammed into an existing
vehicle have you seen the Tesla's they
look beautiful all right
the Tesla's with a b2 hardware look look
look beautiful
um though they should all have a dark
motor encounter you guys good no I feel
about that vaporwave worshiped Oh with
extreme precision did it turn through
those sideburns because it's impressive
from an engineering perspective it's
just questionable for me why perspective
why should we do we support the
Hollander SUV what if they doing torque
interceptors do we support the Hollander
I don't know Highliner no we don't
support the highlander we should should
i buy one of these so I could have a
zukes have my air at very own zukes
about the positions of all self-driving
cars and who do you want to talk about
uh no we don't have camera yeah we're
gonna merge it in soon there's a
highlighter not have let's see
Highlander Hybrid it says it has TSS P
Lane Departure alert I've never greater
cruise control know the Highlander
should be supported oh you worked
Annihilator port is it good
how come we haven't merchant it's closed
sorry cool so will support the zukes car
in a minute they can run they figure an
open pilot in their car um they're also
I mean you could just see this is little
things I actually I didn't show you guys
this but this is actually something that
shows you the car actually probably is
driving in autonomous mode Oh
just slide to book as ooks we don't know
any company in the world is driving that
multidimensional degree of difficulty
from urban the freeway to downtown
[Music]
delphi's doing it pretty well this will
be interesting is the app crazy or not
you know what make fun of this right
like I really shouldn't make fun of this
because what the app does for a lot of
people is complete some narrative right
if you're trying to tell a narrative
about how you're gonna sell your product
well that's kind of how you do it
what'll L compile up to 90 degree turns
I'm a little bit more excited about this
now you know apps can make a lot of
money it was exact
I don't be so add I mean it's not that
right like like like like like it's it's
not about it's not about it's not about
like like envy it's about hype killing
the industry it makes it difficult to
sell your driver assistance system which
is available for sale today at shop type
, today i Delphia is active when Ford is
promising you that by 2025 their
self-driving cars will take you to the
moon right like they won't but you see
the problem is when you're like look you
can do this thing it drives on the
highway it's pretty nice somebody comes
back and is like well but Ford's gonna
take me to the moon in 7 years
zooks can pivot to them all the
telehandlers oh ok alright don't get me
started on the telehandlers that's
that's a terrible idea
um yeah or they'll drive you to the moon
I think that's what they promise yeah
Delfy is named adaptive now Delfy
don't underestimate Delfy um as far as
as far as self-driving car companies
going you guys know that I've come
around on mobile I yeah sighs adjusting
fit I saw that movie right people will
install things themselves you gotta make
it a little easier but um look I mean
you could say the same thing about
furniture before IKEA right all people
will never build their own furniture
they do all right I'm gonna get up you
got a TaskRabbit to do it for try to be
Witter alright and I think I think we'll
leave it at that huge props to Ashley
Vance for coming and joining us in our
periscope follow her on twitter at
valley hack follow us on twitter at
comma a i make sure to buy things at
shop comedy i you'll have to ask zukes
that my money would be on less than us
but who knows man you can scale that up
with money I mean you want more driving
day to pay people to drive your your
virtual horseshit around all that that's
not street-legal yeah Turner Highlanders
around all day
[Music]
cool so yeah be winner no my issue is
not money but issue guys is technology
technology weak AI and the reason our
driver monitoring isn't better it's
pretty good but it would be better if
you guys would flip that little switch
on your camera that says front camera or
record and upload so if you're out there
and you have open pilot it's hugging the
left lane a lot you can go buy a zooks
they don't do that no I don't know
obviously don't know why that's
happening make sure on the latest
version oh oh lady on Oh Leon I don't
know anything about Leon's Aeon Gold
Edition uh if you think parents can use
commas now don't give him a comment yet
we're only halfway there that was the
press zero point five but it is for sale
today if you're an enthusiast when are
we going to Vegas can we'll do it we'll
do it I got something good planned you
know what I'm a fan of the zooks video a
fan of zooks I will I will let you know
when we have something cool we got to do
high key guys we got to do - demos the
hype is back self-driving cars are back
we're gonna win follow us on Twitter LED
night and the next hardball have LEDs
you know sup when can you buy any other
members on you can buy a pan on Amazon
come to a hype demo with a friend never
going to Def Con again and that's all of
that went which again are I gotta get
back on twitch guys alright thank you
all for watching this edition of suits
is not as bad as they thought we thought
they were and they're at least better
than juice arrow and they're way better
than theranos I put Fiji water now
that's a great investment
ok guys be a winner we'll leave it at
that buy my snow peas
Okay,
>> check. There we go.
>> Hello everyone.
>> I'm Jason. Sometimes I I work on
cardboards.
Usually I do it with
people watching, but I'll see what I can
do. Um I have one slide
uh and then we're going to get down to
business. Um, we're going to talk about
um the minimum you need to do to get
your open pilot environment set up and
get uh your new your nice new comma 4
connected to your car. We're going to
talk about u a demo carport that I put
together to try and make this a little
bit easier. We're going to talk about
kind of the processes I use in Cabana to
turn that big scary wall of numbers into
something usable and some of the Open
DBC tests.
That's my slide.
and
we're going to get down to business. Um,
for those of you that haven't installed
Open Pilot on your laptop before, uh,
more than just like installing on your
com before, you're also going to install
it um, on a development environment on
your PC. You can use Abuntu, you can use
WSL, anything. You'll run this on your
PC. I'm not going to do it right now
because it takes five or 10 minutes to
run and you're all staring at me
expecting something more interesting
than watching a compile run. So I have
open pilot master checked out and within
that we have open DVC
and we have well
Shane was talking about that uh piest
thing earlier. We were trying to fix
that real quick. We're going to check
out the demo port. And the reason we
want that,
uh, I'll show you here.
Sorry, I had everything open and then we
were trying to fix that pi test thing.
So, we have a development template
carport that
um, it's not merged into mainstream open
pilot yet. It's kind of an experiment.
I'd like to do this something I'd like
to do this a different way, but we're
going to try this for now. It puts in
all basic infra
um so that you can get down to
mic off. There we go.
Um the interesting part
is
our use of the all output safety mode.
Uh and particularly this mode because
with that little parameter on there um
it switches open pilot into a mode where
we're transparently forwarding. We open
a relay and we start recording which
traffic comes from which side of the
bus. that's already running on the com.
And if we start the car and we do it
with key in
started up.
Open Pilot has started up and has
started recording data. And if there's
signal that we want to find in the car,
um, this is a good time to trigger it.
Like, let's say I want to find the turn
signals. I'll hit the left turn signal,
let it go for a minute,
and hit the right turn signal, let it go
for a minute, and shut off the car.
Um,
the way that I do this is always based
on uploaded logs. You can go to comma
shop and you can buy a red panda and you
can actually do this live just with your
laptop. Uh, but my method is just to
always let the device upload logs.
Let's see if my device is online.
It is.
And it has just recorded a route.
No, that's not it.
>> Come on.
It hasn't uploaded yet, but fortunately,
I have prepared extensively for stuff
going wrong.
Uh so we have a series of tests here and
I've put together a document that shows
uh some tests you can go through to
produce all the signals that open pilot
is looking for uh wheel speeds
um the accelerator the brake etc etc.
So, we'll look first at the drive
stationary test one.
We're going to grab that route ID
and
pull it up in Cabana.
And this is going to be a bit of an eye
chart.
Let me Oh, you know what I need to do is
start screen recording.
There we go. So, this is going to be a
bit of an eye chart and
nothing really useful or sensible is
happening here. We just have bits that
are changing and we're not sure why.
Um, but as there are some general rules
here we can use to figure out what's
going on. The reason we're using this
demo car port uh is because the comma 4
has
multiple CAN buses connected to it and
we can choose which one we're looking at
and just show
the messages that we care about. And
that's going to narrow down a lot. And
then we can filter by frequency or
rather sort by frequency.
And from here, uh, there's some general
rules. The most important CAN messages,
uh, safety related stuff, uh, wheel
speeds, uh, steering angle, etc., etc.
They're going to be in higher frequency
messages, usually, uh, generally 100
hertz, sometimes 50. Uh, they're also
going to be on lower numbered CAN IDs
just due to the way the CAN protocol
works. Those end up being higher
priority if the bus is busy. um the
lower frequency stuff and the higher CAN
arbitration IDs. Uh those are all
convenient stuff. Blinkers, seat belts,
stuff like that. You don't need a hund
you don't need to know if uh your turn
signals on 100 times a second, but you
do need to know wheel speeds.
So,
you can see Cabana here highlighting
just the bits that are changing. Um, and
the ones that aren't changing are being
left alone. Um, there's a lot of
activity here. Um,
my process is go through and kind of cut
through all the noise. Uh, get the
noisiest stuff figured out first. And
the noisiest stuff is going to be the
check sums and CRC's. Uh, every message
uh or most of the messages you find on
canvas are going to have a counter and a
checksum associated with them. Um, we
happen to know um the counters on this
car are usually located in um
bits 8 through
11. Yeah.
And then the check sum is that first
eight bits. Uh the check sum will appear
random, but it will cyclally repeat if
the rest of the message is the same. But
the check sum will just keep rolling it
over and over over and over.
Um, so the first order of business is to
identify all those because Cabana has a
feature where those stop being
highlighted if they've been identified.
So we can cross off all the check sums
and CRC's. Now I could make you wait and
while I go through and mark all the
check sum signals and all the CC signals
but uh through the magic of having done
this yesterday,
we can skip to the point where all the
check sums and counters have been
identified. And as you can see, lots
less activity here. So now we're
hopefully able to better see what's
going on.
I'm going to go back to our documents on
what I did in that drive.
So we're looking for the doors. Um,
we're probably going to look for the
accelerator and the brake first. The
accelerator is nice and easy. Uh, it's a
little further into the route, which is
only a couple minutes long.
And see what we got going here.
Don't know what this is, but don't be
afraid of marking stuff off. Um, just to
see what's in there. Uh, see how Cabana
graphs it for you. Uh, any activity you
see could be interesting.
Uh something interesting going on here.
No, that's not it.
Uh
that's not it.
If you need any evidence that I have not
in fact memorized all the CAN IDs, this
is it.
Okay, so here's something promising.
Uh
so
I've highlighted these eight bits here
or I've made them part of a signal and
you can see a weird pattern here. Uh it
goes up and it cuts off. Um you'll see
this when you're reverse engineering. Uh
what happens is um I marked off these
eight and it ends up overflowing into
the next one. And that's kind of a good
indicator that the signal is a little
wider
than you initially thought.
Or actually, maybe it starts
a little earlier.
Little more.
There we go.
So, we've got three things going on
there. I'm not sure if that was the
accelerator or the brake.
I think this is the brake because for
the accelerator we went uh to the floor
three times 100% each time. For the
brake, I didn't have the engine running.
So, this is like a hydraulic brake
pressure. And with the engine not
running, you get like a that uh Nisha
mandated vacuum boost left over for the
first couple times you press the brake.
And then there's a little loose. So,
this is going to be like a brake
pressure.
So, we'll mark that off. Uh, and then I
believe I did the accelerator before
this. So, we're looking for
accelerator activity
somewhere before
I don't know what's going on there.
Okay, I just didn't wasn't in the right
place.
It was right before the break.
There we go. There's our accelerator. I
pressed it three times, went to the
floor, and it went to a full 8bit width
each time. Well, just slightly less. It
went to 250. This happens to be a
percentage. So if we scale it by
0.4,
that'll bring it down to a percentage.
0% when released, 100% when not. So now
we've got our accelerator.
We've got our brake.
Now things are starting to get a lot
less noisy. What else did we have in
here? We had the doors.
Uh
so the doors we'll be looking for
somewhere
down here. Uh we'll be looking for them
in these lower frequency messages and
they'll just be little oneoffs that
you're going to have to hunt for and see
if anything interesting happens. Okay.
So, right there, uh, I have to know when
I walked past the camera,
that was I opened driver, passenger,
rear left, rear right. That's me walking
from the driver to the passenger.
So, I'm pretty sure this one was the
driver's door. I got out, shut it,
and then I should see a bit flip for the
passenger.
And then we saw some more while I was
typing.
And that'll be the rear left.
And this will be the
>> All right. So, we know this one's going
to be like from a BCM or something. Um,
I think in the demo carport, I think I
called this door states. I can't recall.
Let's take a look. Um, so, uh, we've got
a named message here now. uh door states
and we can save this DBC.
Uh
open pilot.
We're not scrolling.
We're going to save it over the demo
DVC. Yes.
So now I've got a DBC entry.
Now we can teach Open Pilot to read it.
Once PyCharm starts back up, let's go to
another signal while it's thinking. Uh,
did we get everything out of this route
already?
We got the doors.
Um,
I'm gonna skip the seat belt for now.
We'll come back to something more
interesting. Let's see if we can find
the gear shift position. Uh, the same
route. Uh, obviously we start in park.
But after I got back into the car, uh, I
went to neutral,
uh, or rather reverse neutral drive and
back again.
Uh, so I know that this was
where do we put the brake pressure?
So, we know it's right after this brake
pressure, right?
>> Yeah. So, we know it's somewhere in like
this area. So, we're going to zoom in
the timeline
and play it and see what pops up.
I
>> think we got something happening here.
Yes. Okay.
Uh so these four bits here are giving us
some interesting activity. Um they are
the same for the whole drive until I'm
messing with the gear shift. So it
starts at a five, six, seven, eight, and
then back to five. So, we now know this
is a gear
position.
And we'll go ahead and call this message
transmission.
And
we'll do something extra for this signal
because um
we know
what certain values mean. We know that
five is park. We know that six is
reverse.
We know that seven
is neutral. And we know that eight
is drive. Now, this is super basic. I
think the thing's got like a sport gear
and has manumatic. There will be more
states in here, but this will this will
do for a demo.
All right. Uh let me check how we're
doing on time. So
going through this whole process for all
the signals um will not fit in the time
slot that I have. Um going through an
entire carport um and I've done it quite
a few times is a probably a long
weekend. But we can skip through here
and look for some interesting signals
like
uh you know what let's actually skip to
the fun signal. Let's skip to the one
that actually controls steering
just to make sure we fit that in. Um,
this is a route from
uh a community uh Macan owner uh who uh
gave us a stock lane keeping assist
route because this particular uh Macan
doesn't actually have the factory
feature uh for lane guidance. The car is
capable of it. we turn it on, Open Pilot
can use it, but I couldn't get a stock
route from it. So, we'll come in here
and
launch Cabana on that route.
And because he was in dash cam mode
without that um special switch uh to
actually open the relay uh we don't ha
all the traffic is present on both buses
zero and two. So I'm going to cheat here
a little bit because I happen to know
it's in this message.
Uh let's load
let's load our demo DVC
and we're going to call this one
HCA01 because that's what it's called.
We'll mark off the check sum.
We'll mark off the counter. And you'll
see nothing else is really happening
here yet.
What we're going to do is skip till he
gets out to like a main road and oh, we
got some activity now. So, as soon as he
went out to a road, uh he uh bounced it
off lane lines a couple times for us and
we're getting some obvious activity
here.
Uh yeah, so these are
force inputs from the lanekeeping assist
system.
We're seeing that uh that jagged edge
there again that kind of indicates I
didn't make the signal wide enough. Uh
so I don't recall the exact width, but
it's definitely more.
Let's call it 12. See if it
Oh, it was just the Andiness was wrong.
Let's do this. There we go.
So, this is
the
factory lane keeping assist system.
when you see them get close to a road
edge,
it's applying torque force to the
steering wheel uh to counter that. Um
the Volkswagen family cars, um this this
one is secretly an Audi Q5 under the
hood. Uh it it shares a platform. Um the
Volkswagen family cars for steering
angles, pretty much any angle, uh they
don't use a signed value for whatever
reason, for direction. It's an absolute
value and they send a separate direction
signal. Uh so we'll call it uh
uh LK torque sign and okay.
And there's usually going to be a bit
somewhere that's just turned on
whenever it's active. Uh, in the
interests of time, I'll tell you I
happen to know it's over there. At least
I hope. I believe it is.
Make sure I got the values right. Yeah.
So, on this car, um, it is a three-bit
field values from 0 to 8. Um, if we look
in the like the beginning of the drive,
there'll be
uh an init value. Yeah, it'll knit at
zero. It'll go to three when it's ready,
and it'll go to five when it's actually
intervening.
So as you go through and
come up with
all of these values, we can take them
and plug them into
the demo car port into into car state.
Um we put in here and this is just a
test to see how it goes uh for speeding
up car ports. These are all the signals
that we need to populate. And
did did we find accelerator position? I
believe we did.
>> Maybe I didn't save it. I hope I saved
it.
>> Let's do transmission instead.
So as we find these values, we can come
in here
and uncomment
the places where
we read those signals.
Now that we've got a gear shift
position, every time car state runs,
Open Pilot will now know
we're in drive, we're in reverse. Um
like Open Pilot will refuse to engage if
you're in park. uh if you're in reverse,
it puts up the reverse display on your
screen so you don't look at it like it's
a backup camera, etc., etc. So, the
process you go through every time is you
got to find the wheel speeds, you got to
find brake pressed, uh gas pressed,
steering angles, uh cruise activation,
blinkers, etc., etc. Um, for purposes of
the live stream, I have a really limited
time slot. uh for purposes of nerding
out in a group of friends. I'll do this
all night if you want to see more
afterwards. Uh but I'm sure uh Julie's
going to give me the hook eventually
here. And people would probably like to
Oh, people are already eating. Good. I'm
not holding anyone up. So, um questions,
anyone?
>> Go ahead.
>> What do I type into it? like the values
that you found, how do you add them?
>> Uh so what's happening is uh when we
save this DBC, it goes into
car.
Oops, I clicked too many times. DBC
this file right here. Uh so we have a
transmission message with a check sum, a
counter and a gear position and down
lower in the file you'll see the the
value table
for gear position and then open pilot
when it starts up the demo car port
will read the demo DBC for this car and
that way when car state is running we're
referencing that DBC for these signals.
So that tells it what message to read
and then this shifter values map that we
read up here is what goes down to the
bottom of the file and reads that value
table 5678.
Um these names are made up. I made them
up just for the demo cardboard. You can
call them whatever. Uh the intent was to
kind of be able to skip all this stuff
and get straight to the fun part of
finding order in the chaos of this giant
wall of numbers.
So, we can find signals in here all day
if you want. Um but again, I have I have
limited time on the stream. I want be
respectful of everyone else's time. So,
uh if you have more questions or you
want to see more, I'm happy to. Yes,
sir.
So with the newer cars what happens is
like if you try to plug in
you don't see anything.
>> That's correct.
>> So the question is um why don't you see
anything from the OBD port that uses
CAN? Uh it's a good question. Uh and the
answer is there's something like there
is not one CAN bus in this car. There's
uh something like eight
um and one of them Hey, so there's a
central CAN gateway uh which has six CAN
buses. Uh one of them connects to just
the OBD port. Uh there's another one for
infotainment, convenience, powertrain,
uh chassis, and extended. And extended
is where all the cool ADS stuff is.
That's that's the bus that we split.
That's where the radar is. That's where
the camera is. And that's where the uh
uh like the blind spot radars are. And
then there's two more at least. Uh
there's a fusion bus between the uh uh
between the blind spot radars and
there's a fusion bus between the camera
and the radar. Uh that doesn't neither
of those connect to the gateway
directly. But the answer to why you
don't see everything is because there's
eight CAN buses and the di the gateway
filters out everything that isn't
diagnostic relevant. It doesn't repeat
all the other internal stuff on that
port.
Other questions?
>> Will it be same for all of the same?
>> Uh so of all all the cars in the same
model. Yes. Generally of the same
platform. Um Volkswagen is and other
manufacturers as well. Um really good at
recycling stuff from the parts bin. it
tends to all work the same way. Um,
other Volkswagen cars that use, say, the
MQV platform, and there's 20 or 30 of
those,
it's all the exact same open pilot code
that supports it. Um, there's three or
four different VW platforms. They all
tend to work very similarly. Other
manufacturers, uh, I think all the Honda
cars work almost the same way. uh
including the like going all the way
back from the mid2010s to the most
current CAN FD stuff they use the same
messages
same signals for the most part.
>> So does it make sense to start with Q
and then build on that?
>> Uh like the other like the Audi Q5 that
this is based on. Um so
it can you can just start wherever you
want. Um they're very very very similar.
um like 98th percentile similarity. Um
this is just the car that was in front
of us. It was the most interesting. We
thought it'd be cool to play with at
Comic-Con. Um and we'll come and layer
Q5 on top of this.
>> Anything else? Is it right to assume
that all information is open in the
sense that it's not encrypted or is
there any
>> uh so the question is uh is this
information open and not encrypted? Uh
yeah the information is there in the
open um it is not secured per se uh
other than it is undocumented. You get
to figure it out but we have great tools
for figuring that out now. Um
even the check sum um and the algorithm
for that varies uh isn't really intended
as like anti-tampering. Uh it's more
intended to protect against bit flips as
it transits like a CAN gateway. Um
there's CAN network level check sums and
then the payload check sum is intended
to protect it end to end. Um, you will
hear people talk about like Toyota TSK.
Uh, you're seeing some cars now, not
all, but some, uh, implement actual
cryptographic signatures on the
messages. Uh, you'll see that they'll,
uh, some Toyota messages will have very
random a very random looking signal
that's like 16 or 24 bits wide. Um,
that, um, the fun police have come for
you there. uh you it it is specifically
designed to stop man-in-the-middle
attacks, which you might consider that
to be what Open Pilot is doing depending
on your point of view. Um there's none
of that here. Um it is showing up a
little in the field. It's not hit
everyone yet. Um we're seeing plenty of
2025 and 2026 cars come out that have
none of this. So it's not been like, oh
my gosh, you can't get a car without
this anymore. some manufact Toyota's all
in on it, it seems, but I don't think
anyone [snorts] uh maybe some new Ford,
new GM.
Uh I think those are the big ones that I
can think of at the moment, but uh
haven't seen it on Hyundai. Haven't seen
it on VW yet, but I we think it's
coming. Um haven't seen it on Honda,
haven't seen it, uh Mazda, Subaru.
more questions.
>> Great question. Uh question is, uh
what's the minimum set of signals? And I
tried to put together a little bit of
information about that.
Um so you need to fill in uh brake, gas,
uh the cruise state. You really should
have like door open and seat belt. Um,
and you'd have to have that before
upstream, but like if you didn't look at
it right away, if you're just developing
on your own, uh, things would be fine.
Gear shifter, uh, I would go for it
right away just because it's easy to
find and nice to have. Uh, but like you
can hardcode the carport to drive while
you're in development if you have to.
Uh, you'll need the blinkers in order to
do lane changes.
Um,
standill, you can do on your own. You'll
have to know your steering angle. Uh
steering torque you'll need for lane
changes and for the safety model to work
right. Uh
and you need to know how fast the car is
going. Uh things you'll need to send. Uh
you'll need to send whatever the control
messages for your car. It can be based
on torque. Um it can be ba or angle
or curvature.
Um and you'll have to figure that out
during the process of reverse
engineering.
All right. Anything else?
Well,
>> this is my car reporting talk. Thanks
for coming.
hello everyone
I'm Jason Young
jn8607 on Discord you may have seen me
and uh you may know me as the Volkswagen
guy
um
I have a very good friend who tends to
go all in on technology Hobbies
um he got us into quadcopters back in
the day before they were popular he went
all in on home automation he's trying to
get us all to build combat robots which
I don't know if I'm going to do unless
we're going to get billions of duke it
out here
but back in 2018
he handed me an eon a giraffe and a gray
panda
and he said I bought this but I can't
make it work on my car he had like a 08
Acura something or other
but do you think this would work on that
Golf R you just bought because in the
repository there's this file called VW
mqb do you know what that is
and I'm like
no
but I'm gonna find out
five years later
I'm on the stage of Comic-Con so as you
can see that one kind of spun out of
control
so
in my day job in my corporate life it's
a habit to introduce myself with a
couple of
personal facts usually that personal
fact is
I drive my car with a cell phone but
that doesn't really move the needle in
this room for obvious reasons and we're
kind of past cell phones so my random
fact is the 8607 is my Cisco ccie number
the guy in my Discord profile pic is a
famous actor that's played in an old
Volkswagen ad campaign
probably 20 years ago and I've had five
total strangers approach me in airports
restaurants whatever and tell me I look
like Tom Hanks I don't see it I don't
get it I love Tom Hanks I'm flattered
but it's just a thing that happened to
me so that's my random personal fact
So today we're going to talk about how
to Port cars
um
this will be
very generic I'm going to use some
examples that are drawn from a
Volkswagen world
but this is not a Volkswagen specific
talk
we're going to start off and talk about
is a car good candidate this doesn't
mean we can know in advance if your car
will work you're going to have to go
kind of all the way through the process
to verify that but there's some red
flags that we look for
we'll talk about what you need for a Dev
environment
we'll talk about connecting to the car
for the first time reading data and
translating that into something that
openpilot can use
we'll talk about sending messages for
the first time finding the actuator
commands that you're
cars Factory Lane assist camera and ACC
radar use
and last we'll talk about the process of
upstreaming cars
so
three classes of cars here
it's a good sign if your car has Lane
keeping assist and adaptive cruise
control those are really minimums for
supporting open pilot on your car yeah
you can hack around it but it's not a
good open pilot experience if you don't
have adaptive cruise and Lane keeping
assist is a minimum
and the other thing is we want to make
sure it uses standard can or can FD
networking
bad signs
um some higher end cars don't use candle
use something called Flex Ray and flex
Ray is in a way that's hard to explain
actually I'm not qualified to explain it
is hard to split open pilot in the
middle of
comma did a hackathon type thing that
actually made this work on an Audi Q8
but I I think they decided it was going
to be a mess and hard to bring to Market
and didn't really proceed with it it is
difficult and right now there's really
no way in the market to work with it
um if there's Automotive ethernet in the
car that's starting to become common uh
in new vehicle designs
right now we don't have transceivers for
that it's something you can buy it's not
hard to get on ethernet itself the
trouble with Automotive ethernet as
manufacturers refresh to that is it has
a strong tendency to come with secure
onboard communication
which is a euphemism for there's
cryptographic hashes on messages that
stop you from messing with things
Flex Ray is just challenging to
intercept
if your car has secoc as unfortunately
Toyota and actually certain VW are
starting to have you actually have an
adversary someone's trying to stop you
from having fun
uh and that's going to be a little bit
difficult so I think both of those will
be surmounted eventually but they're
going to be very vehicle specific uh and
they're not something I'm personally
working on and
that that's going to be task for someone
else
if your car doesn't have any of this
stuff you might actually have an easier
time there's
um
some folks that actually bolted a pout
an electric power steering rack and a
bunch of microcontrollers and some other
things into a late 70s Volkswagen
Vanagon
um
now after that was done that Vanagon
kind of identifies as a Toyota Corolla
but
it works so in some ways
that car on the right is actually easier
than this car in the middle
so let's say you have a car that's
likely to work in this case mine
or whatever car that you might have and
I want to be clear that
what I'm talking about here today is
actually not that hard to do
um
if you can spell Linux and SSH you can
go through these Journeys that I've gone
through it used to be a lot harder than
it was but it's gotten pretty easy so
first thing workstation something
running Ubuntu VMware or WSL is fine I'm
about half and half bare metal Ubuntu
when I'm working from home this laptop
running Windows 11 I do the other half
on under wsl2
next thing you need is a comma three I
missed the memo on it not being a Devi
kit anymore
uh so uh comma three or three x and when
you order it you'll order it with a
developer harness which I'll show you in
just a moment
the return window for these guys is
normally 30 days I'm not sure what the
process is but if you're working on a
new car port they will give you a little
bit of extra time and then you'll need a
few basic tools you'll need a diagnostic
tool for your car it's a must you're
going to tick off your car during this
process and you'll need to be able to
clear faults and you'll need some
visibility into what's going on and
you'll need some other Basics multimeter
wire cutters crimper Etc
so
when you order from the comma store
and you get a developer harness that's
what it'll look like it looks like
any other harness adapter that they sell
you but there's no ends on it yet
you get to put the ends on it because
whatever ends that it needs the
connector shells and the terminals are
going to be unique to your car
you can figure that out by looking at
the connector cars on your car they'll
usually be a part number on it somewhere
um the one end will usually be easy to
find the other end
is sometimes rough because that's not
something the manufacturer ever has to
supply
in a harness form it's always built into
the camera in a pinch during development
you can make do with generic cart Edge
pin headers but
one way or another you need to take that
and adapt it to your car
and this is how you do it
every auto manufacturer in the US and in
really worldwide will have some way for
you to get access to repair info it's
not going to be free you generally have
to pay for it if you go to irwin.vw.com
as an example but you can do this for
any auto manufacturer you can get a
wiring diagram for any given car and
that'll
you can't really read this and you don't
have to but that will tell you
how your camera is wired up what's on
what pin
you take that together with commas open
harness wiring diagram and that'll tell
you where you need to put constant power
ignition switch power ground can high
can low and optional second can
and any pass-throughs that you need for
like a camera heater or or Fusion bus so
on and so forth
so
let's assume we've made that harness
and we've connected to our connected it
to our car
this is what we need to figure out for
openpilot to work this is a subset of
what goes into car state when you know
how fast the wheels are turning
what the steering angle is what gear
you're in all that good stuff and in
order to learn that we look at
Cabana
I promise the next slides will be easier
to read I wanted you to see the whole
window this time but
what you're looking at right now is a
pile of numbers and this looks
intimidating
but
it'll clarify pretty soon by the way
before I forget
um
this tool was made by another comma
external contributor named Dean Lee I
think I did asked him one day hey do you
want to do something about Cabana
because the web Cabana is getting really
crusty and then you just bang this tool
out in like a couple of weeks and has
been growing it from there and it is a
game changer for reverse engineering can
networks so Dean Lee if you're seeing
this you're the man we love you
oh
[Applause]
so
I'm not going to step through every
single one of those signals I'm going to
take you through three examples of some
of the more complex ones and a couple
tricks of how to find them
so Cabana the deanley wrote will show
you
and highlight bits that are changing to
find wheel speeds you're looking for
four signals that scale with how fast
the car is moving they stand still when
the car is parked and they move
linearly when the car is driving so
somewhere in that pile of numbers
is Cabana is going to highlight ones
that change in about the same way
times four
so we now know four wheel speeds but
where do they go
get in your car you'll take a test drive
in a parking lot
set your parking brake
and then take off from a stop drive a
figure eight stop and look at your logs
front and back will identify themselves
because
when your parking brake is set and
you're driving a front-wheel drive car
as most folks are particularly the
parking brake set the front wheels will
start rolling first so now you know
front and back
when you drive that figure eight
the outside Wheels
will turn faster
so
as we're making this sweeping tight
right turn the outside wheel
is turning faster
and that tells us left and right so now
we have front back left right we know
where all the wheels are
next you'll do a simple test log for gas
and brake usually I press the gas three
times press the brake three times
take it in look at it
the accelerator
will have a curve that goes up and down
it's pretty obvious it's not an on and
off it's a you'll find a percentage
somewhere you may need to scale it
you'll find a similar signal for brake
pressure that'll be some sort of curve
and it'll match when you're pressing the
brake and by the way there's some
features within Cabana that you can say
for all those signal changes that it's
highlighting
uh you can say kind of freeze those and
clear those for this little 10 second
time window and just show me the ones
that changed within there
and that'll start making things like
this pop out
and then it's nice to find a signal for
brake pressed
um
you can do that in a pinch by just
showing brake pressure above one but
that doesn't work for all cars sometimes
the Signal's a little noisy this ends up
being the source of a lot of bugs
comment chased a lot of these out I
wanted to even chain we're doing
improved testing for cars and chasing
down controls mismatches and so forth
brake pressed can come from a lot of
sources
uh there'll be a switch on the brake
pedal often there's redundant switches
so you may be seeing those you may be
seeing something from the ABS controller
that says break pressure over a certain
threshold and those are all good but you
might also be seeing something that says
open the brake shift interlock
or if you're driving
this might actually be a brake light
signal which sounds cool until you
remember that your ACC when it's slowing
down also fires off the brake lights so
you want to make go ahead and flag all
the signals that are potentially brake
pressed but come back and look at it and
make sure it's actually only fogging the
ones that the driver presses in
now for steering inputs I've got a
particular way that I like to do this
get in the car
start it up
and
you'll turn the wheel to 45 90 180
full lock and hold it
let go
and then turn it back to 0 45 90.
and that gives you a steering angle
unfortunately my laser pointer doesn't
show up really well against this screen
that'll give you your steering angle
and the scaling since when you turn to
45 you know the value you should get is
45 90 180. sometimes you have to watch
this on Progressive ratio variable
steering racks but
this one happens to be pretty easy so
that'll give you
the steering angle
the direction if it's separate sometimes
it's combined in an assigned value
sometimes it's separate in this case
it's separate it'll also give you the
amount of driver input torque this is
important for torque blending as you're
driving with open pilot so that open
pilot can back off
the guidance that it's giving you if the
driver is providing input and also so it
knows which way you're nudging for
desire inputs like Lane changes so
it'll show you here
as we're steering that EPS link moment
it'll show you that we're providing some
input and then high input
when we're holding it at lock
it'll go to zero
when you release and you'll see the
direction sign is different because
as we're turning the wheel back
we're providing pressure torque going
left even though the total steering
angle is still right we haven't crossed
zero yet so with that simple test
procedure that gets you all the scaling
that you need all the directions that
you need
so we take that
plug it in with cabana
and that outputs a DBC which
goes into an open Pilot Car State and
tells open pilot everything that it
needs to know about what your car is
doing how fast you're going where the
wheel is
etc etc
there's a lot more signals you'll need
to hunt down eventually but those
examples should kind of show you how to
use Cabana
the next thing we do is figure out how
to send messages
uh there's very few that we want to send
the ones that we do want to send are the
factory Lane keeping assist messages and
we're just talking about lateral for now
because I have 20 minutes to get through
this
this is usually from the factory camera
it's usually a torque signal they're
usually sending a command saying
turn the wheel this hard in this
direction
uh it's not a direct command to follow
this line whatever the camera is saying
turn the steering wheel this hard
sometimes the camera does send an angle
I think Tesla does this I think Nissan
does this I haven't looked lately
um
recently we had one come up that sent a
path curvature I know this drove Cameron
nuts for a while when I was bringing
Ford on board
uh but he got that figured out I had to
do some clever reverse engineering to
turn that into something open pilot
could use so take note of what your
factory camera does
to actually control your car what type
of signal it sends and what the maximums
are
and then we teach open pilot to do that
in order for the car to actually pay
attention to this message we've got to
talk about payload checksums and
counters
um
you may notice and most are all the
messages that your car sends there's a
counter
there's some field somewhere that just
rolls over and over and over it counts
up one every frame sometimes it's two
bits sometimes it's four bits all the VW
ones happen to be four some other makes
are two
you'll also see a payload checksum of
some form and a lot of messages
this can come in the form of literally a
checksum add up all the byte values and
take the remainder sometimes it's an xor
over the message payload
sometimes it's an actual CRC
in the case of Volkswagen happens to be
a strangely modified CRC that took
forever to figure out
um
in some cars it's completely random I've
seen the algorithm for Chrysler and I'd
have no idea what they're doing there
but somebody figured it out
um the key thing that you want to look
for and hope for is if you see on the
left side of the checksum there
if the message payload Remains the Same
and you get the same checksum for that
every time
there's something there that you can
replicate
and you just have to figure it out and
there's tools for that now there's a
tool called CRC beagle that you can get
off GitHub that you feed it uh
whatever byte value you're getting and
this payload and it will figure out it
will may not figure out completely
automatically but it'll do a lot of The
Drudge work that I had to do manually
five years ago
if on the other hand you see randomness
if the payload and
other values aren't repeating cyclically
if it's fully random
you might be having a bad day because
that might be a cryptographic hash you
might have run into Seco C
if that's the case you might be
leveraging that return policy let's hope
we don't see a ton of that but that's
what to look for
so let's assume we've got the steering
message figured out
Cabana is going to write out that DBC
for you
you're going to go into open pilot and
have the car controller actually send
out a torque command and by the way you
actually don't have to take care of
figuring out
at no point you have to worry about
where the car is in a lane what
direction to go how to turn the wheel
open pilot takes care of all the path
planning for you and it already has a
built-in controller for how much we want
to turn the wheel you just have to kind
of figure out you have to develop that
Rosetta Stone of
here's how to express a torque command
of the car
and that is what we want to do I'm going
to send a torque command if with that
direction and some match some other
stock values that were used and in this
case deeper levels of the open DBC
Library are handling the checksum
encounter for us
and that takes us to
what is hopefully good news
this picture was taken
at an early icky January morning in 2019
on the first day I made that thing work
let me tell you that was a good day
that was a fight to make that work I I
think it took me something on the order
of three months
uh and that was with several people
helping me and providing hints
um
and there was still a ton of time in the
driver's seat looking at tmux
fixing typos oh my God I can't believe I
made another typo controls crashed again
wait why hasn't the device starting
anymore it's
back in the day
open pilot was a lot less testable
verifiable that infrastructure that we
have today didn't fully exist yet
but
once you get it running
that first time that you feel open pilot
engage and provide some guidance to the
wheel
you're having a pretty good day
if your car makes it an entire minute
down the road and preferably more like
10 minutes you're having a real good day
but
sometimes you can get all the way into
this process and find out you've got a
lockout
and that's bad news
sometimes there's workarounds for that
but every car that has a modern
level two Adas system
will not let the driver go hands off
indefinitely
um the difference is
who enforces that
some manufacturers drive that entirely
from the camera
and if it's the camera that's deciding
whether there's driver input
and whether to disengage openpilot can
replace that
a few manufacturers I think some
varieties of Mazda
not recalling others off hand but
old Ford okay
sometimes that 15 or 30 second lockout
is enforced on the eps
in that case
um
well that's a bummer
sometimes there's workarounds there's
things you can play with don't give up
immediately
reach out for help but it's not a great
sign if it consistently breaks after the
same number of seconds but hopefully you
get down the road
and if you do that's fantastic you've
got a lot of cleanup and quality work to
do after that to make it good
um don't worry if it doesn't drive well
at that point you can fix that as long
as it open pilot can take control
for five or ten minutes
this is going to work so
that was my day in 2019.
this was Wednesday
what you're seeing here is the next
generation of mqb called mqb Evo this is
a 22 2022 GTI
we rented earlier this week
uh we modified a harness that's not
unlike one of the ones we use on VW
right now we moved a couple of pins
around there actually is Automotive
ethernet in this car but we don't care
about it it's used as a replacement for
the fusion bus between the camera and
the radar but we just pass it through
don't listen to it the stuff we do care
about is can FD and they rototilled some
of the messages and we had to go through
a process of reverse engineering again
but open pile is a very different
product today
the carports have been massively cleaned
up and standardized and templated
there's CI tests that mean you can take
a log and play it back through controls
and verify that everything works the way
you think it should and doesn't crash
before you get up from your desk you're
not doing this from the driver's seat
anymore you have tests that will check
all this stuff out and then
new Cabana
will help you out with this
and
the whole thing ends up being a lot
easier and faster
last time this took three months this
time we had it done in nine hours
to be clear it's not Upstream yet this
is probably the worst possible week to
ask a Dave and Shane to look at
upstreaming a PR
but it's in progress
so guidelines for upstreaming
um it needs to be safe it needs to
comply with all the guidelines that uh
Adib and the rest of the open pilot team
laid out earlier today needs to be
passing tests you need to verify all the
checksums encounters not only for
sending but also for receiving and you
need to make sure if you're using stock
ACC
that open pilot can reject engagements
if there's something wrong
then it needs to be supportable it needs
to work like other open pilot cars and
that means torque blending that's one of
the reasons Tesla isn't listed is
officially supported because the
steering API doesn't work quite like we
want
there needs to be no visible faults it
needs to drive in a way that would be
acceptable for a person and if there are
faults
they need to log them and upload them so
they can be analyzed later
this comes into play as part of
all the work that the open pilot team
has done to improve quality and mtbf and
autopilot to the point where the last
couple of times that the open pilot team
has had me look at routes
that experienced faults we tracked them
back to a bug in the car
one of them was a retrofit that somebody
had retrofitted ACC to the car didn't
have it from the factory and they'd use
the wrong software the other one was
genuinely software bug in the ECU a
certain model here of Atlas had engine
ECU firmware that if you did the wrong
thing in wrong order with remote start
you wouldn't have cruise control for the
next start
so you want to get to the point where
everything works and then
it needs to be actually marketable in
order for it to be upstream and actually
appear on comma's website and and Shop
you got to figure out how to make that
harness manufacturable means you got to
find the other connectors on the other
end it needs to be something somebody
can reasonably install
and it needs to be fully plug fully Plug
and Play fully reversible it needs to
work like
the open pilot experience and other cars
because it's one thing when you are
working on your own car but when this is
upstream and in a store
it's not you that's taking the support
calls or the rmas or the angry emails
it's those guys so it needs to be dialed
in in order for it to appear for actual
sale to actual customers
so
that's my talk uh that's
that's there's obviously a lot more that
goes into it I hope to actually do kind
of like a Blog series later I don't know
when that will fully come to pass but
hopefully that should be an overview
anyone got questions
a word Jason we're going to do questions
we're running a little over oh are we
okay I'm gonna give you a little spot in
the back and everyone can come up and
ask you questions back there okay uh get
their specific questions answered
um the comma team
upstairs if you guys want to come on
down
uh
[Applause]
hello everyone I'm Jason Young J young
8607 on Discord you may have seen me and
uh you may know me as the Volkswagen guy
um I have a very good friend who tends
to go all in on technology Hobbies um he
got us into quadcopters back in the day
before they were popular he went all in
on home automation he's trying to get us
all to build combat robots which I don't
know if I'm going to do unless we're
going to get Billy and silly to Duke it
out here but back in 2018 he handed me
an eon a giraffe and a gray Panda and he
said I bought this but I can't make it
work on my car he had like a 08 Acura
something or
other but do you think this would work
on that Golf R you just bought because
in the repository there's this file
called VW mqb do you know what that is
and I'm like no but I'm gonna find
out
five years later I'm on the stage of
Comic Con so as you can see that one
kind of spun out of
control so in my day job in my corporate
life uh it's a habit to introduce myself
with a couple of um personal facts
usually that personal fact is I drive my
car with a cell phone but that doesn't
really move the needle in this room for
obvious reasons and we're kind of past
cell phones so my random fact is the
8607 is my Cisco CCI number the guy in
my Discord profile pick is a famous
actor that's uh played in an old
Volkswagen ad campaign probably 20 years
ago and I've had five total strangers
approach me in airports restaurants
whatever and tell me I look like Tom
Hanks I don't see it I don't get it I
love Tom Hanks I'm flattered but
it's just a thing that happened to me so
that's my random personal
fact So today we're going to talk about
how to Port
cars um this will be very generic I'm
going to use some examples that are
drawn from a Volkswagen World um but
this is not a Volkswagen specific talk
um we're going to start off and talk
about is a car a good candidate this
doesn't mean we can know in advance if
your car will work you're going to have
to go kind of all the way through the
process to verify that but there's some
red flags that we look for we'll talk
about what you need for a Dev
environment we'll talk about connecting
to the car for the first time reading
data and translating that into something
that open pilot can use we'll talk about
sending messages for the first time
finding the actuator commands that your
cars Factory Lane assist camera and ACC
radar use and last we'll talk about the
process of upstreaming
cars
so three classes of cars
here it's a good sign if your car has
Lane keeping assist and adaptive cruise
control those are really minimums for
supporting open pilot on your car yeah
you can hack around it but it's not a
good open pilot experience if you don't
have adaptive cruise and Lane keeping
assist is a minimum and the other thing
is we want to make sure it uses standard
can or canf
networking bad
signs um some higher-end cars don't use
candle use something called
flexray and flexray
is in a way that's hard to explain and
actually I'm not qualified to explain is
hard to split open pilot in the middle
of comma did a hackathon type thing that
actually made this work on an Audi Q8
but I I think they decided it was going
to be a mess and hard to bring to Market
and didn't really proceed with it it is
difficult and right now there's really
no way on the market to work with it um
if there's Automotive ethernet in the
car that's starting to become common uh
in new vehicle designs right now we
don't have transceivers for that it's
something you can buy it's not hard to
get on ethernet itself the trouble with
Automotive ethernet as manufacturers
refresh to that is it has a strong
tendency to come with secure onboard
communication which
uh is a euphemism for there's
cryptographic hashes on messages that
stop you from messing with things uh
flexray is just challenging to intercept
if your car has seoc as unfortunately
Toyota and actually certain VW uh are
starting to have you actually have an
adversary someone's trying to stop you
from having fun uh and that's going to
be a little bit difficult so I think
both of those will be surmounted
eventually but they're going to be very
vehicle specific uh and they're not
something I'm personally working on and
that that's going to be task for someone
else um if your car doesn't have any of
this stuff you might actually have an
easier time there's um some folks that
actually bolted a power an electric
power steering rack and a bunch of
microcontrollers and some other things
into a late 7s Volkswagen
vanan um
now after that was done that vagan kind
of identifies as a Toyota Corolla
but it works so in some ways that car on
the right is actually easier than this
car in the
middle so let's say you have a car
that's likely to work in this case mine
or whatever car that you might have and
I want to be clear that what I'm talking
about here today is actually not that
hard hard to do um if you can spell
Linux and SSH you can go through these
Journeys that I've gone through it used
to be a lot harder than it was but it's
gotten pretty easy so first thing
workstation something running YouTu
VMware or WSL is fine I'm about half and
half uh bare metal yuntu when I'm
working from home uh this laptop running
Windows 11 uh I do the other half on
under wsl2
next thing you need is a comma 3 I
missed the memo on it not being a devate
anymore uh so uh comma 3 or 3x and when
you order it you'll order it with a
developer harness which I'll show you in
just a moment um the return window for
these guys is normally 30 days um I'm
not sure what the process is but if
you're working on a new car port they
will give you a little bit of extra time
and then you'll need a few basic tools
um you'll need a diagnostic tool for
your car it's a must you're going to
tick off your car during this process
and you'll need to be able to clear
faults and you'll need some visibility
into what's going on and you'll need
some other Basics multimeter wire
cutters crimper Etc so when you order
from the comma
store and you get a developer harness
that's what it'll look like it looks
like any other harness adapter that they
sell you but there's no ends on it yet
you get to put the ends on it because
because whatever ends that it needs the
connector shells and the terminals are
going to be unique to your car you can
figure that out by looking at the
connector car um on your car there'll
usually be a part number on it
somewhere um the one end will usually be
easy to find the other end is sometimes
rough because that's not something the
manufacturer ever has to supply in a
harness form it's always built into the
camera uh in a pin during development
you can make do with generic Cartage pin
headers
but one way or another you need to take
that and adapt it to your
car and this is how you do
it um every auto manufacturer in the US
and in really worldwide will have some
way for you to get access to repair info
it's it's not going to be free you
generally have to pay for it uh if you
go to irwin.com as an example but you
can do this for any autom manufacturer
you can get a wiring d diagram for any
given car and that'll you can't really
read this and you don't have to but that
will tell
you how your camera is wired up what's
on what pin you take that together with
comm's open harness wiring diagram and
that'll tell you where you need to put
constant power ignition switch power
ground can high can low and optional
second can and any passrs that you need
for like a camera heater or Fusion bus
so on and so
forth
so let's assume we've made that harness
and we've connected to it connected it
to our car this is what we need to
figure out for open pilot to work uh
this is a a subset of what goes into car
state when you know how fast the wheels
are turning what the steering angle is
what gear you're in all that good stuff
and in order to learn that we look at
Cabana uh um I promised the next slides
will be easier to read I wanted you to
see the whole window this time
but what you're looking at right now is
a pile of numbers and this looks
intimidating but it'll clarify pretty
soon uh by the way before I forget um
this tool was made by another comma
external contributor named Dean Lee um I
I think ad asked him one day hey do you
want to do something about Cabana
because the web Cabana B is getting
really crusty and then he just banged
this tool out in like a couple of weeks
and has been growing it from there and
it is a game changer for reverse
engineering can networks so Dean Lee if
you're seeing this you're the man we
love
[Music]
[Applause]
you
so I'm not going to step through every
single one of those signals I'm going to
take you through three examples of some
of the more complex ones and a couple
tricks of how to find them so Cabana
that Dean Lee wrote will show you and
highlight bits that are changing uh to
find wheel speeds you're looking for
four signals that scale with how fast
the car is moving they stand still when
the car is parked and they
move linearly when the car is driving so
somewhere in that pile of
numbers is Cabana is going to highlight
ones that change in about the same way
Time 4 so we now know four wheel speeds
but where do they
go get in your car you'll take a test
drive in a parking lot set your parking
brake and then take off from a stop
drive a figure eight stop and look at
your
logs front and back will identify
themselves
because when your parking brake is set
and you're driving a front-wheel drive
car as most folks are particular with a
parking brake set the front wheels will
start rolling first so now you know
front and
back when you drive that figure
eight the outside
wheels will turn
faster so as we're making this sweeping
tight right turn the outside
wheel is turning faster and that tells
us left and right so now we have front
back left right we know where all the
wheels
are
next you'll do a simple test log for gas
and brake usually I press the gas three
times press the brake three times take
it in look at it the
accelerator uh will have a curve that
goes up and down it's pretty obvious
it's not an on and off it's a you'll
find a percentage somewhere you may need
to scale it you'll find a similar signal
for brake pressure that'll be some sort
of curve and it'll match when you're
pressing the breake and by the way
there's some features within Cabana that
you can say uh for all those signal
changes that it's
highlighting uh you can say kind of
freeze those and clear those for this
little 10-second time window and just
show me the ones that changed within
there and that'll start making things
like this pop out and then it's nice to
find a signal for brake
pressed um you can do that in a pinch by
just showing brake pressure above one
but that doesn't work for all cars
sometimes the signal is a little noisy
this ends up being the source of a lot
of bugs um Comm chased a lot of these
out um when D and Shane were doing
improved testing for cars and chasing
down controls mismatches and so forth
brake press can come from a lot of
sources uh there'll be a switch on the
brake pedal often there's redundant
switches uh so you may be seeing those
you may be seeing something from the ABS
controller that says brake pressure over
a certain threshold and those are all
good but you might also be seeing
something that says open the brake shift
in her lock
or if you're driving this might actually
be a brake light signal which sounds
cool until you remember that your ACC
when it's slowing down also fires off
the brake lights so you want to make go
ahead and flag all the signals that are
potentially brake pressed but come back
and look at it and make sure it's
actually only thugging the ones that the
driver presses
it now for steering inputs I've got a
particular way that I like to do this
get in the car
start it
up
and you'll turn the wheel to 45 90 180
full lock and hold it let go and then
turn it back to 0 45
90 and that gives you a steering
angle unfortunately my laser pointer
doesn't show up really well against this
screen um that'll give you your steering
angle and the scaling since when you
turn to 45 you know the value you should
get is 45 90 180 sometimes you have to
watch this on Progressive ratio variable
steering racks but this one happens to
be pretty easy so that'll give
you the steering angle the direction if
it's separate sometimes it's combined in
a an assigned value sometimes it's
separate in this case it's separate
it'll also give you the amount of driver
input torque this is important for
torque blending as you're driving with
open pilot so that open pilot can back
off the guidance that it's giving you if
the driver's providing input and also so
it knows which way you're nudging for
desire inputs like Lane changes so it'll
show you
here as we're steering that EPS link
moment it'll show you that we're
providing some input and then high input
when we're holding it at lock it'll go
to
zero when you release and you'll see
that the direction sign is different
because as we're turning the wheel back
we're providing pressure torque going
left even though the total steering
angle is still right we haven't crossed
zero yet so with that simple test
procedure that gets you all the scaling
that you need all the directions that
you need so we take that plug it in with
cabana and that outputs a DBC
which goes into an open Pilot Car State
and tells open pilot everything that it
needs to know about what your car is
doing how fast you're going where the
wheel is etc etc there's a lot more
signals you'll need to hunt down
eventually but those examples should
kind of show you how to use
Cabana the next thing we do is figure
out how to send
messages uh there's very few that we
want to send the ones that we do want to
send are the factory Lane keeping assist
messages and we're just talking about
lateral for now because I have 20
minutes to get through this um this is
usually from the factory camera it's
usually a torque signal uh they're
usually sending a command saying turn
the wheel this hard in this
direction uh it's not a direct command
follow this Lane whatever the camera is
saying turn the steering wheel this
hard um sometimes the camera does send
an angle uh I think Tesla does this I
think Nissan does this uh I haven't
looked lately um recently we had one uh
come up that sent up path curvature uh I
know this drove camera nuts for a while
when I was bringing Ford on board uh but
he got that figured out uh had to do
some cever reverse engineering to turn
that into something open pilot could use
so take note of what your factory camera
does to actually control your car what
type of signal it sends and what the
maximums are and then we teach open
pilot to do
that um in order for the car to actually
pay attention to this message we got to
talk about payload check sums and
counters um you may notice and most are
all the messages that your car sends
there's a counter uh there's some field
somewhere that just rolls over and over
and over it counts up one every frame uh
sometimes it's two bits sometimes it's
four bits uh all the VW ons happen to be
four uh some other makes are
two uh you'll also see a payload check
sum of some form in a lot of messages uh
this can come in the form of literally a
check some add up all the bite values
and uh take the remainder sometimes it's
an ex or over the message
payload um sometimes it's an actual
CRC um in the case of Volkswagen happens
to be a strangely modified CRC that took
forever to figure
out um in some cars it's completely
random I've seen the algorithm for
Chrysler and I have no idea what they're
doing there but somebody figured it out
um the key thing that you want to look
for and hope for is if you see on the
left left side of the check sum there um
if the message payload Remains the Same
and you get the same check sum for that
every time there's something there that
you can
replicate and you just have to figure it
out and there's tools for that now uh
there's a tool called CRC beagle you can
get off GitHub that you feed it um
whatever bite value you're getting and
this payload and it will figure out it
will may not figure out out completely
automatically but it'll do a lot of The
Drudge work that I had to do manually 5
years
ago if on the other hand you see
Randomness if the payload
and uh other values aren't repeating
cyclically if it's fully
random you might be having a bad day uh
because that might be a cryptographic
hash you might have run into
seoc uh if that's the case you you might
be leveraging that return policy let's
hope we don't see a ton of that but
that's what to look
for so let's assume we've got the
steering message figured
out um Cabana is going to write out that
DBC for you you're going to go into open
pilot and have the car controller
actually send out a torque command and
by the way you actually don't have to
take care of figuring out at no point do
you have to worry about where the car is
in a lane uh what direction to go how to
turn the wheel open pilot takes care of
all the path planning for you and it
already has a built-in controller for
how much we want to turn the wheel you
just have to kind of figure out you have
to develop that Rosetta Stone
of here's how to express a torque
command of the car and that is what we
want to do we want to send a torque
command if with that direction and some
match some other stock values that were
used and in this case deeper levels of
the open DBC Library are handling the
check summon counter for us and that
takes us
to what is hopefully good
news this picture was
taken in an early icky January morning
in
2019 on the first day I made that thing
work let me tell you that was a good day
that was a fight to make that work I I
think it took me something on the order
of three
months uh and that was with several
people helping me and providing
hints um and there was still a ton of
time in the driver's seat looking at t-u
fixing typos oh my God I can't believe I
made another typo controls crashed again
wait why isn't the device starting
anymore it's back in the day open pilot
was a lot less testable verifiable uh
that infrastructure that we have today
didn't fully exist yet
but once you get it
running that first time that you feel
open pilot andage and provide some
guidance to the
wheel you're having a pretty good day if
your car makes it an entire minute down
the road and preferably more like 10
minutes you're having a real good day
but sometimes you can get all the way
into this process and find out you've
got a
lockout and that's bad news
uh sometimes there's workarounds for
that but every car that has a modern
level two adash system will not let the
driver go hands off
indefinitely um the difference is who
enforces that um some manufacturers
drive that entirely from the camera and
if it's the camera that's deciding
whether there's driver
input uh and whether to disengage open
pilot can replace that a few
manufacturers I think some varieties of
Mazda um not recalling others off hand
but old Ford
okay sometimes that 15 or 30 second
lockout is enforced on the EPS in that
case um well that's a bummer um
sometimes there's workarounds uh there's
things you can play with don't give up
and
immediately uh reach out for help but
it's not a great sign if it consistently
breaks after the same number of seconds
but hopefully you get down the road and
if you do that's fantastic you've got a
lot of cleanup and quality work to do
after that to make it
good um don't worry if it doesn't drive
well at that point you can fix that as
long as it open pilot can take control
for 5 or 10 minutes
this is going to work so that was my day
in
2019 this was
Wednesday um what you're seeing here is
the next generation of mqb called mqb
Evo this is a 22 2022
GTI um we rented earlier this week uh we
modified a harness uh that's not unlike
one of the ones we use on VW right now
we moved a couple of pins around there
actually is Automotive ethernet in this
car but we don't care about it uh it's
used as a replacement for the fusion bus
between the camera and the radar but we
just pass it through don't listen to it
the stuff we do care about is can FD and
they Roto tailed some of the messages
and we had to go through a process of
reverse engineering again but open pilot
is a very different product today the
car ports have been massively cleaned up
and standardized and templated there's
CI tests that mean
you can take a log and play it back
through controls and verify that
everything works the way you think it
should and doesn't crash before you get
up from your desk you're not doing this
from the driver's seat anymore you have
tests that will check all the stuff out
and then new Cabana will help you out
with this
and the whole thing ends up being a lot
easier and
faster last time this took three months
this time we had it done in nine hours
to be clear it's not Upstream yet this
is probably the worst possible week to
ask a d and Shane to look at upstreaming
a
PR but it's in progress so guidelines
for
upstreaming um it needs to be safe it
needs to comply with all of the
guidelines that uh ADB and the rest of
the open pilot team laid out earlier
today needs to be passing tests need to
verify all the check sums and counter
ERS not only for sending but also for
receiving and you need to make sure if
you're using stock ACC that open pilot
can reject engagements uh if there's
something wrong then it needs to be
supportable uh it needs to work like
other open pilot cars and that means
torque blending that's one of the
reasons Tesla isn't listed as officially
supported because the steering API
doesn't work quite like we want there
needs to be no visible faults uh it
needs to drive in a way that would be
acceptable for a person and if there are
faults you need to log them and upload
them so they can be analyzed later um
this comes into play as part of all the
work that the open pilot team has done
to improve quality and mtbf an autopilot
to the point where the last couple of
times that the open pilot team has had
me look at
routes uh that experienced faults we
tracked them back to a bug in the
car um one of them was a retrofit that
uh somebody somebody had retrofitted ACC
to the car they didn't have it from the
factory and theyd used the wrong
software the other one was genuinely
software bug in the ECU uh a certain
model year of Atlas had engine ECU
firmware that if you did the wrong thing
in wrong order with remote start uh you
wouldn't have cruise control for the
next
start so you want to get to the point
where everything works and then
it needs to be actually marketable uh in
order for it to be upstream and actually
appear on comm's website and and Shop
you got to figure out how to make that
harness manufacturable means you got to
find the other connectors on the other
end it needs to be something somebody
can reasonably install and it needs to
be fully plug fully plug-and playay
fully reversible it needs to work like
um the open pilot experience in other
cars because it's one thing when you are
working on your own car but when this is
upstream and in a
store it's not you that's taking the
support calls or the RAS or the angry
emails it's those guys so it needs to be
dialed in in order for it to appearer
for actual sale to actual
customers
so that's my talk uh
that's
hurts in here
I don't think I have secrets
well just on my phone we're sitting on
the floor
with a computer
what's up stream
that's kind of a secret we should erase
that
I don't know how to get chat
it's got to be a way hide chat
show chat where's chat
you're gonna show up somehow
uh I guess we don't have any viewers
right now all right so this stream is
brought to you by highball energy
not really they don't pay me anything
um no we're building a computer uh I'm
here with I'm here with uh Alex
[Music]
um
we have zero viewers right now I don't
really understand it
oh maybe they didn't push a message I've
been up for a minute supposedly doesn't
seem right no and there's no chat either
I just try again
maybe rat followed me
oh hello no it just takes a while
Sam Roe just showed up hello
Riley showed up okay uh so
what do you want to write a letter to
Twitch should we call twitch's customers
well you're on Twitch
yeah I like her on Instagram
oh Instagram works we don't have to call
Instagram because we call twitch's
customer support yeah
does this twitch customer support
do you have any support for this product
we have nine viewers yo okay look so
we're building a computer
um you guys already missed Alex said it
was great content hearing me put the CPU
fan on because I had to remove the fans
and I asked if I was what do they think
I'm made of time I had to use a torque
wrench but I don't have a torque wrench
so I estimated it and it said online
don't estimate it
but um you have a mental breakdown and
meanwhile I'm paying five dollars a
month for streams I'm not having a
mental breakdown or building a computer
and Alex is gonna film
yeah it's a long ounce the stream's
gonna be two hours so I hope you're not
doing anything for the next two hours
all right so this is my computer
oh we're building it we're gonna get
States you can read chat to me uh we
might be able to no we can't Mount the
phone oh we should use the new light I
purchased for streaming my old light
broke because it was low quality
this light is a high quality
wow
I'm gonna put a little light a little
light down here but pretty good
yeah it looks great all right
uh we can turn on all the lights too but
it's like it's like blinks weird like
this lights were good
I love this desk lamp you know that yeah
the desk lamp is good that light weirdly
blinks I don't trust it can you get
overheats wait the black one yeah
okay
so this is my computer
um this is an AMD epic wait
what we're getting the flashing
you know when the light looks like it's
pulsing oh is it from that one or this
one
probably it's from the desk lamp
actually no I can't even see the desktop
it's not this one it's from the desk
lamp it's from the desk lamp yeah with
the gestnuts PW women yeah oh wow
is that better yeah
does it have an LED bulb
actually I don't know how to say this
but I think the other one's doing it too
I won't be able to know until you stop
moving
they're all doing it could just be the
way this the screen is displaying yeah
well these
it's fine it's not a big deal it's just
something okay
all right so we're building a computer
you can read to me anything good from
chat
um we already put in one stick of memory
oh sorry I missed the chat this this app
is not great well
can we have horizontal video Yeah I
think that's a reasonable should we be
horizontal
did it actually go horizontal I just
turned the whole cam phone did that work
flip it horizontally house horizontal
guys
hold on we gotta wait
looks good here on the stream the sun's
flickering
okay
edit stream High chat stream manager is
it actually horizontal did you make it
horizontal bad you know my friend says
it's perfect nope bad they're kidding
they'll tell you anything's perfect okay
no because we have to unlock my phone's
rotate
and now we are horizontal oh there we go
yes this is the custom Hardware belt
this is a cost
rebuild for tiny brand
components we have so I believe I would
know because I didn't actually look at
the CPU so people are happy they might
have sold me the wrong CPU I didn't
really lock
um we're starting off with a Rome uh
d8-2t Slash BCM motherboard uh this
motherboard is made by ASRock which is
uh asus's uh professional data center
division
it has
seven full bandwidth pcie ports
uh oh we're gonna have to steal the nvme
from that computer
uh okay so these are sticks of memory uh
they are made by Samsung in the
Philippines
uh they are eight gigabytes each but the
reason that I bought them I have other
memory the problem with my other memory
was it was not fast memory they're
asking how you like the AMD Rock stuff
uh oh well Rockin is terrible but at the
time one of the goals of the tiny
Corporation is to fucking video uh and
that's why we are building with AMD even
though they're not as good
one of if if I can get AMD to be on ML
perf by the end of the year like I want
to put them on the map I want to make a
competitor Nvidia is screwing you guys
by
the way
um you know there's a lot of stuff that
could be enabled on Nvidia gpus that
would make training much better but they
choose not to enable that so we at the
time Corporation stick with AMD they're
a nice developer friendly Corporation
they actually have so these are rdna3
gpus and rdna3 is completely publicly
documented uh that's good guy AMD Nvidia
documents PTX but they don't even
Implement a document their low level
assembly called SAS for their gpus but
AMD will tell you everything you need to
know about rdna3 and that's why we at
the tiny Corporation have two beautiful
7 500 7900 XTX gpus
mounted here so this is actually a
Bitcoin mining case
uh this case is designed for Bitcoin
mining but the only real difference
between Bitcoin mining Rigs and what
we're building here
is these so these are 16x uh pcie4
extenders and hopefully they work
and they may not but hopefully they
try to make sure you don't want to know
prices uh for what everything so the
motherboard was 649 uh we just bought
another one
for 610 on eBay but it's 649 retail
um the CPU uh so I bought some cheap
CPUs I can show them to you
um actually the guy on eBay good guy
eBay uh sent me two instead of one so
that's always nice
um I bought some cheap epic CPUs they're
like really cheap these are like the
cheapest they're Gen 2 epics and these
were two hundred dollars
um but someone on the tiny grab Discord
which would turn out on the tiny grab
Discord you should have only join if
you're going to contribute and if you're
going to whine you shouldn't
uh convince me to buy a better CPU so
this is actually this is a six thousand
dollar CPU uh in and it came out in
2019. is it easy we got it for eight
hundred dollars
uh these sticks of memory cost forty
four dollars each uh actually no 44 was
this I think I paid 38 each for them I
could have gotten 16 gig sticks for 44.
they were dual rank instead of single
Rank and they weren't on the qualified
vendor list for this motherboard
so I didn't go with them I don't really
need RAM
what am I going to do with ram
uh nvmes are so fast these days if you
can't pull everything you need off disk
then uh what are you doing
so I have 64 gigs of RAM which is a lot
around am I getting paid for this what
do you say
so I paid 300 for this Ram oh there was
this company on Amazon that was selling
Samsung compatible RAM and that was 200
and I almost bought it but then
something I complained that it wouldn't
run at the full speed and I was just
like how by the real one so I went to
memory.net sponsor memory.net no none of
these people sponsor me highball hasn't
sponsor me memory.net doesn't sponsoring
if you want to sponsor me reach out to
my publicist okay
great person to have sponsor your
content I will shell for very cheap the
amount of views I get for how cheap I
will shield but the thing is I will only
shell if your thing is good if Portugal
contacted me I would tell them no
I would uh I would have to tell Paul to
go no
I would tell Portugal that I'll shelf
for Portugal but I'll also tell the
truth about Portugal so you know they
may not want to hire me as a shell
hiring me doesn't actually get you
anything I mostly just chill for things
but I think that will legitimately like
your company more if you pay me to show
for it
um they want to know what your minimum
chill rate is
uh no you see it's not about the money
it's about making me feel like I matter
they think your personality is different
when I'm here versus when I'm not here
on the stream is that true I don't think
so I think Chris is in a good mood today
I'm in a pretty good mood today I did a
lot of physical activity in our data
center
how many watts is the power supply oh we
have an ebga
1600 watt power supply but we also
purchased some server power supplies
this is a Dell server power supply it's
2000 Watts but it's only 2 000 Watts if
you have 220 volts so only Europeans get
to enjoy all those Watts European watt
enjoyers Americans do not get all these
Watts Americans only get
1 000 Watts you're going to show them so
where it says not to exceed 1 000 Watts
yeah so I bought some 2400 watt Dell
power supplies and they can do 1400
Watts
so we're gonna go with those okay so I'm
just going to reattach the fans here and
these are not to a fans and let me tell
you knock to a secret I'll let you in
I'll knock to a secret nocturnal buys 12
volt fans and then runs them at five
volts there you guys know the secret
um let me check my friendly motherboard
manual this is the box at the bottom of
the canyon oh I also had to buy another
power supply cable because they sent me
some European one
um
[Music]
what's the motherboard manual
they not give me a motherboard manual no
it definitely came with one
it's very nice you can download it
online okay here we go this is
everything I need system fan connector
fan one
all right it's not even as they don't
even have CPU fan connectors
we have 244 viewers
sweet that's not many I think it's wrong
it's probably wrong
um
I posted a video of comma body and the
Discord did anyone care okay someone's
asking about it oh they have 348 on
theirs yeah this thing is wrong
yeah what are you gonna do contact which
technical support yeah you can't because
they don't have technical support and
neither should comma
oh I put that fan on not where I wanted
it
okay which way do we want the air to go
we want the air to go that way or we
want the air to go that way
I think we want the air to go that way
so I think this is wrong
you guys like to see more George or more
computer content
well good they're suggesting the right
direction
good good good
all right and then we're going to turn
it on and who thinks it's gonna work you
guys missed me installing the processor
that was that was quality content
I'm sorry you missed that thanks guys
you can have more Alex content another
day
well they want Alex content
did you update the BIOS thermal grease
action I did oh you missed the thermal
grease oh you missed everything oh I did
thermal grease here you know what I can
show you I'll show you a piece of
cardboard I use to spread the thermal
grease the actually this thing suggested
not spreading the thermal grease it
suggested just putting dots and it was
like where I come from we spread thermal
grease
and where I come from is New Jersey
damn you guys are are saying that George
should chill things but the Auto mod is
holding your
blog post for uh name calling
oh they're trying to call me a shield
that's a compliment man that is a
compliment if I get called a shell
you know in before it overheats what no
come on I got a too many look at all
these fans it's not gonna overheat
George does have great hair
oh they like my hair
it's a wall
right now
yes they're not Aqua fans you know
knocking a secret I told you there
12 volt fans and called them five volt
fans and then everyone's like wow
there's there's Wyatt yeah because
you're putting only five of the 12 volts
into them
but they actually are pretty good fans
I like this one
you can tell it's not to work because
look at the color only nocturnal color
everyone else just colors their fans
black knocked or picked like the worst
colored plastic and used it as a brand
it's pretty good actually it's
impressive actually yeah
um okay we have to make sure this one
does this one reach
can we get socks no George is Barefoot
right now this is a Barefoot activity
great
okay
uh we have CPU and RAM
do we need power cables now
all right we might need power tables let
me get out my friendly bag of power
cakes
I was expecting that to make a more
satisfying noise all right
so this is a modular power supply it's
called a fully modular power supply
which means uh
you get double connectors one on the
power supply side and one on the
motherboard side
[Music]
the camera do we have a
tripod who's gonna read chat
what's he building
that thing needs some blinker fluid
ribbons on the gpus
blinker fluid
oh don't worry we have plenty of RGB
LEDs Gamers love RGB LEDs
we've learned this
okay
um
I hate how thick this wire is it just
doesn't like Bend nicely you know
okay for those new to the chat just tell
them what's going on uh so this is the
time corporation's new computer I spent
a lot of money on it uh way more than
the tiny core pass the time corpse going
into debt to me
uh this kind of core cost me a lot of
money actually
from time to core Busby back salary so
when the tiny Corp finally gets funding
uh
it'll have to pay me
okay these are vga's so we don't need
those this is a sad of power I don't
want anyone who needs that
uh useless what's this
VGA we're gonna need VGA look at how
many vgas we're gonna have to connect
CPU here we go we need this one too
wait a second
how many CPUs does this thing have
we need one big ATX one do we have that
I hope we have that
okay it has cpu1 and CPU two let's see
well if there's got to be two CPUs then
PGA VGA
little city a little town periph
this is
[Music]
an ad if you're bored of streaming you
can get the 10
and I'll make it work
s are you avoid of streaming
I'm just tired
this is this is Tiny Corp corporate
headquarters this is pretty cool for
headquarters we've been looking at
renting a few other headquarters with
the local uh San Diego area
what's my favorite Pokemon Charizard
how is my personality different when
Alex is around
he's really really hit a nerve oh thank
you
I was thinking of getting you a painting
of the pirate flag instead of this cheap
Pirate Flag I like the cheap Pirate Flag
you think Pirates have a painting of the
pirate flag that could be nice would you
become an overfunded pirate it's already
bad enough I drive a Rolls-Royce
you know you really lose the pirate
Spirit at some point
but that's what I mean like can you take
road trips in the Rolls-Royce no you
can't
because you've just lost the spirit
ah
that's what I'm saying we could laser
cut a cool flag I was gonna paint him
before that's super well funded Pirates
do you think people would be Pirates if
they were well funded no they'd
legitimately buy the content on Amazon
Prime if you want to hear more ads for
tiny Corp oh well
well so the tiny Corp is not hiring
unless you want to work for free
for free the Titan purple higher but
here's the thing about working for free
the tiny Corp also won't help you like
they won't manage you so you can just
submit pull requests on Tiny grab if
you'd like to work for the tiny corn
um and then maybe someday if we have
funding we will uh hire you and pay this
hour
um the goals of the tiny Corp
the big goal of the timing Corp for the
rest of the year is to build a training
Library that's competitive with pi torch
on AMD gpus uh I spent almost five
thousand dollars on this computer less
than that I don't know I didn't really
added up but let's just say five
thousand dollars so that's how much in
debt we are and how much money value we
have to extract from this endeavor
um it's a very nice computer and this
will be the new tiny Corps computer I'm
also going to buy uh
five more of these gpus and that's what
this is for exactly this fan is too uh
tall I can't fit a GPU on top of it
it's kind of a problem
see how tall it is
I think I could fit a GPU here one here
one here
we have to at least fit six
we don't need seven because technically
okay so if you want to go multi-machine
you need to put a melanox uh network
card or some network card in and you
need to get oh another advantage to the
AMD GP views over in video the Nvidia
consumer gpus don't support peer-to-peer
meaning in order to get data from one
GPU to the other you have to first go to
your system memory
um and this becomes a huge bottleneck if
you have lots of gpus but on this
computer we can go directly from this
GPU to this GPU because these are AMD
gpus
brought to you by AMD
no but I really do want to get a
sponsorship from AMD if AMD wants to
sponsor this computer I will build a
large rack of these computers
full of these gpus and I will make
training fast for their gpus
shots fired Nvidia no someone's got to
do something about Nvidia I was like
someone really has to do something well
if you do know someone at amd who's
interested you can email
you email them and like you work it out
and then like if they seem cool an email
can I share publicly what do you want a
Gmail
psychotic rants just useful content oh
my God the amount of psychotic Rams I
got by the way
no we don't we don't we don't have to
tell them about my current Feud
I'm feuding with somebody right now they
owe me money all right they owe me money
and I'm gonna take it I'm gonna take I'm
gonna sue someone guys
George is always feuding no no you know
what I I right now I have zero private
investigators on payroll and that's not
enough private investigators
uh
okay
three GPU wires I don't like the ones
that have two see these ones have two
don't have to use those
you're gonna have to use those
okay
we need to connect power to the GPU now
because we only have two gpus we can all
this is a 1600 watt power supply which
may I point out are very very expensive
this was 350 this 2000 watt server power
supply was only like I paid like 55
dollars for it
so yeah okay George if you just move a
little bit closer to the back wall I
could just get everything in the video
better
but you want me to move just like a foot
back
I gotta move the computer back yeah
oh
this is so much better okay a little
more a little more
I bought oh I bought I bought large
rubber feet for this computer I learned
all about the different types of rubber
feet you could buy
okay do I have to plug them in in any
order
in the order
assumes you don't have Giga Chad
graphics cards
okay is this gonna reach oh barely
I'm not bored I just have heard a lot
already about the computer
so who do you think I'd beta test my
content on guys that's right George's
already complaining and I said your
people would love this
also what's my favorite George Feud
um probably the Orange Julius
what no that's Jack in the Box yeah I'm
not shooting with orange julius I'm
shooting with Jack in the Box you just
said that to trigger me and get me to
talk about Jack in the Box
guys
I'm just
do remember that second time we went to
Jack In The Box
never forget like it was it was it was
it 9 57 if closes at 10.
surprise
[Music]
just like close the door if you're not
gonna serve food
no and then they said
person was like if you go up to the
counter they're not going to serve you
and then they it did because the person
at the counter at the Jack In The Box
didn't know the rule I haven't had any
beef in a while I did have some beef
with Gucci
oh the Gucci candle
here
we got we got the candle situation
resolved but it only took 500 emails to
all the Gucci Executives yo yeah if you
just email Executives of companies uh
most companies it'll do something if you
do this in comma it actually does
nothing oh George I just I want to
debunk this message from campsie George
is actually really
quite always
um very kind to service people
I think they misinterpreted your
complaint about Jack-in-the-Box but I
will say George's is never mean to
service people
one time because a bank teller was
really slow and I was said I couldn't
wait for a job to be replaced by the
machines and it really upset George
think about big bank that woman could
have kept Jack In The Box open for three
more minutes and she was just being a
dick
um George is a 20 Tipper
most of the
most you're neutral I'm nice but if
you're a dick I'm gonna be a dick back
right like you can't just expect me to
be nice that's not how it works you guys
George did go to the barber and he
they cut his hair too short this is the
perfect length what who caught my hair
too short I love crew cuts man you go
you go to the barber you ask for a crew
car oh I love the Italian Barber I'm so
happy at the barber I took more than 20
of that barber
I was very happy because I was unhappy
with my last haircut
the one I got before Twitter I was
unhappy with
then I went back to the Italians and
they did a good job my people
I don't I don't know who just who
George's Barber is he goes to lots of
different people sometimes we have a
woman come one of our comma perks is
haircuts sure she's pretty good I'm
pretty happy with those Victoria will
come and give haircuts at the office
yeah but one time I went to one and
where was that place and I was unhappy
Hillcrest you guys George does not like
me to put scissors near him
um
someone suggested I should cut your hair
what
cause I got other shit to do
like record like hold this video
I think I could do a crew cut guys guys
real question do these wires go down
here or do they go above you I only give
Mohawks that's kind of worried about
these wires hitting the
um
his hair is not too long
finally I've experience with mohawks so
I'm gonna just stick with that
I'm not happy about this
whatever
George of the Mohawk it would be
interesting I think
I don't know if he has a face shape for
it
guys we're building a computer
Alex are you responsible for getting
distracted by chat I get distracted by
chat sometimes too but then I remember
that I'm distracted by chance some parts
of building a computer are not that uh
you know entertaining we're connecting
the water but no no no we see you but
you're letting them go off topic you
can't let them go off topic I love you
just do your clothes in the corner Alex
what
do you know what happens when you let
them go off topic it's like when you let
the inmates run the Asylum I don't agree
and I I do think that we could talk
about your haircut for like at least an
hour but this isn't an appropriate topic
for this channel tell us tell us about
the first computer you built
no I told you you remember how I don't
remember the past
you think I remember the first computer
I built tell us I remember last weekend
honestly what did I do last weekend
do you know because I don't ah
I I went to the tailor
I didn't
I
I got you something
High balls we gotta drink highball
sponsored wow trying to remember what I
did what I did last weekend
I think I went to work we I slept I went
to yoga twice
I went to the grocery store I got his
fresh pasta oh I ate all that pasta
that's true
yo when Alex buys Alex can't buy bread
anymore
I think it's a reasonable question
explain Rivals to a Canadian highballs
are what you call an energy is your
airline good by the way if you're a
genuine Canadian is Air Canada good it's
an energy seltzer
so it doesn't have any sugar
but it just has energy It's Just Energy
and it has guarana ginseng caffeine
um it's like I used to drink monsters
and red bulls but they had they had
sugar it's no sugar
um I prefer to save my sugar for bread
okay I had major beef with Air Canada
it's not good that's what I told George
I don't think Air Canada is good
um
and
West Jets yo yo you know how I know fuck
WestJet because it's in Gucci gang
everybody knows that fuck it's not I
wouldn't call it a generic energy drink
it's just it's it's solid
um you can give it a Whole Foods
all right I think we're done with power
cables
George has some new aggressive flight
rules he's really only flying in
big planes no no no guys there's only
two good planes in the sky the 787 and
the a350 the A380 is also a nice coin so
there's actually three good planes in
the sky the A380 the a350 and the 787.
um do I want to fly on you know on
economy on a triple seven with a three
four three layout like no I don't I
don't that sounds like hell do I want to
fly on Emirates first class in the upper
story in the A380 where I get my own
room and can close the door and can
order food whenever I want that's what I
want Sam Chewy uh
no so yeah yeah uh no coming back from
India I took two Lufthansa business
class flights just very competent a350s
comes right at the San Diego Airport
wonderful fly
all right George it's time for our video
update for those who are new to the
stream
wow this is like how you'd want to
structure it if we actually want to like
get viewers and I didn't just do this as
a as a self-aggrandizing ego exercise
uh all right so my name is George
um I uh
used to be famous when I was young
uh then I realized that Fame is bad
because look what happens to famous
people
Elvis man imagine Elvis just like was an
accountant would have lived a lot longer
no this is terrible this is this is
garbage
discontent yes
no really though people think they want
to be famous but they don't what does it
say if you think you want to be famous
try being rich first I asked you to talk
about the computer and now you're
talking about Fame and who's off topic
now okay who's gone off topic who's
talking about
JK Rowling is wrong trans women are
women that's right that's right we're
challenging the paradigms of society
um
really feel bad enough no we're not
talking about JK Rowling
wow wow I love this you went to India
and you came back less enlightened how
oh oh oh don't get me started on India
you guys Church deep breaths
oh and we're building a computer here
um this is using an AMD epic CPU it's a
single CPU do you know this CPU has a
128 pcie4lands
um seven of them go to these pciex 16
slots so that's a 112 Lanes then we have
some only one of the m2s can be used we
also have a dual 10 gigabit Network
which sadly is on the pcie you guys
nothing happened in India though I did
think George got scabies but he didn't
no I
just gave these
[Music]
new viewers and they want to hear a
little bit more about your your
relationship to AMD via Nvidia oh dude
dude one of the goals of the tiny Corpus
fucking video and here's why we have
to sometimes someone gets a little bit
full of themselves and they they just
start price gouging and they start
artificially limiting their stuff and if
we had no robust Market where we had
competition they wouldn't do this
uh so don't get yeah the Nvidia chips
for example
these chips support peer-to-peer Alex
that's not allowed on Twitch
um
now these chips support peer-to-peer
meaning the the cards meaning the cards
can talk to each other directly without
going through system RAM and video cards
can't do this and I posted an issue on
their driver and they haven't replied to
me yet because you know what the real
answer is fuck you that's why so we have
to fucking video right back and that's
why we support AMD all right you guys
ready to turn it on
all right we got a green light let's try
this button I don't know what it does
uh
wait is this button not do what I think
it does what does this button do
oh no they added you to wikifeeed.com
bro bro bro you know I did post feed
picks before but only on my truth social
I thought it was a good use event
um okay I think we're gonna have to plug
in the little wire
it came with the motherboard actually
that turns it on because I don't think
this is an on off switch let's check the
friendly motherboard manual here what
does that button do qid1
what does the button do uid switch
so what's a uid switch
can someone Google that and tell me what
it is
thanks um seven months oh we have to
also I don't really want to turn that
computer off we're not going to have a
hard drive
we have to take it out of that computer
yo
do you want to do something do you want
to do a hot swap do you want to just
pull it out while the computer's on
sounds dangerous
quiet you can meet my computers it's a
ryzen uh 59.50
um it has a uh it has both an Nvidia GPU
and a uh
and an AMD GPU
um it has an AIO water cooling CPU
that's why it's so quiet the hot swap is
extra you got a sub if you want to see
the hot swap oh yo yo yo yo yo this is
this is this is real content all right
now watch me be an idiot and drop a
screw in the motherboard
and then
all right so I had a tiny Phillips
screwdriver right here
is this gonna work you guys have you
ever seen feed before
together
okay you got to get that out of here
this is
gonna break my computer
[Music]
she got the screw and the hard drive
oh
cue cheer track
I think we crashed the computer
do you think they crashed me
it's fine
why can't you just turn it off because I
have like stuff I'll put a team up
session
turn it off it's a Linux computer it's
very stable
hot swap guys hot swap oh it's hot
swappable it's supposed to be right
it's not mounted
I put it in I didn't use it
okay
guys real facts about George he's he's
only five foot four yeah just like Tom
Cruise bro
okay we have to put it in the correct M2
slot
I believe it's M22
but I'm not 100 on that
one of these M2 slots is turned off
I'm sure it tells me
his motherboard not come with a manual
the power supply came with a manual the
motherboard didn't
why would they do that
people want the death setup for sure
pretty sure it's M22
don't show them the desk they don't
deserve the desk oh no
Alex you're getting distracted they're
asking a lot about why you don't have a
grounding strap on
oh because grounding straps are for
people who are scared do I look scared
I'm kind of hungry
hungry
okay just eat all the ice cream
oh yes
Alex you're getting distracted more than
the people
all right it's that time in the Stream
where you tell the new viewers
okay look at the screw that came in this
bag let's try this one screw
bye bye by unplugging the pcie
no cool
I think the computer's screaming inside
it's George is not on drugs
man yeah I'm just doing eyeballs bro
sponsored by highball and AMD and
fucking video
um
but want to see inside George's closet
no stop it
wait no seriously you can't show them
the closet okay no you're done you're
done you're done
you guys are the reason Alex loses their
jobs as a streamer
I'm sorry I'm sorry no other memory
let's put the other memory away wait
Alex can we get a close-up shot on this
should we get a close-up shot of this
um yeah of course I'm gonna put the
memory one at a time
in slots
I have not tried Celsius it looks
disgusting
I am a troll just kidding it's part of
my identity
they're asking if you could you know do
it like Jimmy would do it
oh yeah
yeah slowly
oh no our Internet's down what what
they're back
you didn't miss anything you just missed
these memories
I don't have a patience for this anymore
man
this memory is slow and that's why it
goes in the box if it was fast it
wouldn't go in the Box
wait what
is that one different than the others
yeah it is it's brown on top
this is the SK haynex and this is
Samsung
that's just offensive man
oh did I take the wrong one out
I might have I took this out of the
computer
that's a land problem
now we just have to figure out how to
turn the power on what is this
oh this is a are these saddest
wow it's like a big set of a little
salad
with two big stats a little status
strappies
you know what this is guys
that came with my case
it's a power
thanks Xbox plasma for the follow
wait no they have to subscribe they
don't get thanked if they just follow Oh
I thought he's so sorry that didn't give
me any money you gotta you got we're
gonna we're gonna ban you if you don't
if you don't know no no no no no no he
didn't know he can follow that's okay
box panel one panel one speaker one
why is it so difficult
wait you guys
is the stream working
George is reading the instructions at
the end you can enable me you can turn
off uh Wi-Fi don't worry
I don't even understand where's power
oh Carla subscribed
yeah that's fine you can thank them for
that way okay powerbot
cellular data was turned off for twitch
um yeah okay so look at this we're back
we're back and it's a system panel is
that better or not not choppy give them
a give them a second are we okay guys
we're back
the data wasn't turned on
literally it's George's back we're back
okay all right guys you ready for the
Moment of Truth
you ready
this is a power button
oh the the fans
are towards your good posture
[Laughter]
okay uh we need a monitor
well do I have a lot of gpus or what
okay let's just turn off this computer
that's fine I'll deal with tournament
back on later
finally not just turned off before
why do I do things like this Alex
how many gpus
didn't count
they're asking questions
it didn't count can they count
I don't know
oh still f
yeah
oh guys are we streaming
two MD gpus
I'm really concerned about why you don't
wear socks I don't is this like a thing
electricity
you know I like always wear socks
I guess no they're saying f
uck they're saying yeah okay should we
put it back on Wi-Fi
it's bad
okay 25 is back on
it's work okay
they just like to complain about stuff
okay
all right fake news this DP is connected
to my computer
which GPU should we plug it into laugh
GPU or right GPU
it doesn't reach
[Music]
um
is this a DP or does this have hdli
oh thanks for the sub Hamza we also need
to connect the keyboard and the mouse
DP stands for DisplayPort
let's do something else too but I want
to switch
double points
all right
all right
moment of truth let's see if anything
shows up on the monitor
we got 550 viewers oh sweet they can all
watch me fit
are you guys
let's fire up this computer
are you gonna install a dvda
you mean Nvidia
no fucking video
wait is it working
[Applause]
[Music]
does anyone trust pcie extenders because
I don't
okay we got a 54 or 26. I get that bad
joke now
what
oh
wait why don't why does it work
s
oh I guess I'm hungry
why is there nothing on the screen
they want you to stream the snacks
change GPU okay so should we use the
other GPO
wow look at those look at those fans
yo they spin it
all right we try this GPO
is it booting I don't know memory
training
maybe I don't know what do those numbers
mean
what's counting down
all right well I like that it has this
thing and
um
disable bios delay why would anyone have
that as an option
it's gonna explode
9A
thank you
um
is it doing something guys
it turned the fans back on
oh as rock
as rock rack oh yes all right let's go
into setup
okay
welcome to ASRock rack setup
we have an AMD epic 676 62 64 core
processor
we have 64 gigs of eight
gvr dims operating at 3 200 megahertz
that's enough megahertz for everybody
giving us a total memory of 64 gigabytes
um
let's see what our nvmes are we have a
Samsung SSD 990 Pro 2 TB on bus 41 the
nvme size is two gigabytes
okay
hmm
did I flash the Samsung Firmware no do I
have to
right
we got some numbers here this all seems
pretty good
oh there's a bug really
no when do I have to update it I will oh
is this the one where it like times out
uh okay how do I disable bios slow
you said there's an option for Bio slow
whoa do we want Raz
I don't know
uh oh I hope we enabled that on the
other computer
okay how do I get stats on the pcies
we don't need that
I don't know what that is
yeah right server bios is it's like bro
we gotta I mean it's very responsive I
must say
what snacks did you bring
okay let's save change is an exit
uh we gotta install
we gotta set up uh Ubuntu
how are we gonna do that
it's like bread George is it called
taralini
it's like uh you know it's an Italian
carb can I have one yeah I don't know if
you've had one of these before give me a
tagalini tarolini
[Applause]
knockoff pretzel it's like a non haircut
so yeah
Italian pretzel
um
I'm having a
I don't know where it is
Alex we need a thing to install Ubuntu
um
all right let's check the wire box
[Applause]
do they want to come to the wires box
they want you to install Arch linux's
entertainment no never installing Arch
Linux again guys I want my computer to
work
quick
none of these wires are good
this is
[Applause]
you know what that wire is real life
George's house
we're also eating a very delicious meat
and maple almond butter filled pretzel
nuggets
we don't have very many left
so we're very excited to discover that
they're not like real pretzels
a little work and get one
USB Keys like don't work
no maybe we can find what it does
we need a USB key
do you have one
I think I do actually is it good A lot
of the USB drives are very bad it might
be at work though oh everything's at
work I have so many ssds at work
whoa wait you guys really want to do
something adventurous who wants to get
pixie booted to work
you guys want to try to get pixie
booting to her did you tell them about
ice cream
what ice cream
why are you talking about ice cream yeah
there's a electronic store on the way to
ice cream
one ice cream maybe I'll just make
popcorn
well I don't want to eat this shit
oh
should I just reheat the pizza from
yesterday
obviously cold she wanted to eat
yesterday's pizza oh it's so good wait
we're just ate so much talking about
Lobster though
George just likes regular popcorn
I need the stream to run for another
half an hour we're not going anywhere
oh it's my home drug test that I told
them I was gonna take on stream no why
don't you see that
if somebody will sponsor my drug test
for 100 I will legitimately take that
drug test do you have and I'll give you
the money back if I fail do you have
venmo how do they pay you
PayPal jio
someone PayPal's geoha in the next
minute he'll take the drug test on
stream that's right
you got I don't know what time it is
because
that's positive for a week a hundred
dollars
geohada gmail.com
PayPal
and he'll take the drug test on stream
Community Network
bar
okay I have one of those
all right
oh George is not natural
uncensored yeah he'll do it right here
on stream I mean like I will turn around
but yeah it'll be able to like see that
I'm not cheating
I'm not gonna like go in the bathroom
and be like you guys know no one
prepared this and have a guy in there
like I'm just gonna hear that shit
forever so you're like watch me I'll
turn around
you know
that's 100 there's nothing wrong with
taking oh can I have one
terrible you wanna reheat some pizza
yeah
what's wrong George
I have an SSD in that computer the
question is do I want to use it let's
see let's open up that computer I have
another computer right now
why
someone just said what is this Blair
Witch Project
[Applause]
sorry guys
all right they want to see this computer
it's a z840
um
it used to be used for my crypto company
but I no longer have a crypto company
let's step back
okay I also want to solve the mystery of
why one of the memories is Samsung
because this is the computer that I took
the memory out of should we just Rob
this computer of everything it feels
like that time that I went to that
woman's house and took my bed
wait what
okay
um what were the memories in this
computer match a woman took your bed I
also had to rescue one of my beds once
no I just like left it at a house and
then one day just showed up and took it
yeah I did the same thing are we the
same person oh no you know what I have
in here
oh I got something way better
you know how much terabytes these are
these are eight terabyte drives
I bought them and then I don't know if I
used
so I'm gonna boot driver this computer
with you guys I also had this card
wait all these Rams are the same
who just put the ram back on this
computer
I'm never gonna use this computer am I
okay
by the way yeah there's probably lost
dogecoins on this box you know there's
Joe's coins on these hard drives are
about to format
no there is a thing a sinking if you're
blockchain on these hard guys
but what do we care there's actually two
sinks there you're watching well my
nails are always done
back when anyone cared about hey
remember when anyone cared about crypto
do you remember those days can you ask
George if he plans to use hip on AMD
uh I don't know what that is
still expensive hard drive can you show
the setup please you want deeper in the
computer
what do you want to know
is it like some Xeon craps
you want to see it on crap support
infinita what is that
yo but I saw Mahindra Scorpio okay I
have seen him a Mahindra Scorpio
I've heard about the mahindras I've seen
him a hint of Scorpio
yeah you were in India yeah
we gotta keep our eyes out for him and
hinder Scorpio
sure enough like an hour later
insulation mode
why would I want to emulate losers like
Nvidia
it's artificially oh man George the
Taliban has a super car now like I don't
want to Google and find out what the
caliban towel bands make the Taliban
it's like like the like the guys from
the Taliban song you guys know the
Taliban song it's a great selling app
yeah
okay let's unplug this and plug it back
into quiet
you can use quiet
you guys I gotta go I gotta make pizza
all right
Church looks like he's already
you don't need me anymore well yeah I
mean eventually this is going to switch
to a stream where we're just on the
computer
but I don't know how we're actually
going to do that handoff if we get the a
b guy to look into that
we're at the AV guy to look into uh
it's a Herman Miller sail chair
well don't tell them
anyone who doesn't know what the
cherries can't happen I love that this
became a foot Pizza stream
should I use my Mac I know this is like
annoying to do for Mac I'll just use my
Mac where's my Mac
it's in here
all right guys question
Ubuntu 2004
2204 or nothing else because Arch Linux
is bad
did you check to see if anyone sent you
100 to the drug test
did anyone send me a hundred dollars
trust me they'd be claiming it even if
they didn't
okay we got
uh one 2204 2204 2204 it looks like
there's a lot of votes for 2204. okay I
will accept other things and DB and 11
gen 2. the door 38 Fedora 38 yeah bro
where's your Fedora what's Manjaro oh
man gyro
[Music]
uh what is
ninja 21 Savage Fedora wow this is a lot
of weird words 21 Savage
I'm kidding me now
you guys were always rooting for temple
OS
should we install Temple Alaska
yeah no we want to actually accomplish
things
hey
sorry Terry
recipes
uh I mean if we did want to accomplish
Things Temple OS might be the perfect
operating system for us for us for us
but considering that we do oh I also
need to find what's Holy See
what's the language of Temple OS is all
right we have fun official you gotta
tone it down here
we're not talking about George's
experience with ghosts even though he's
had many of them
what experience with ghosts you mean my
Rolls-Royce Ghost is that what we're
talking about that's right
wait I I found one of these oh I know
where my USB adapter is I'll be right
back it's conveniently located on my USB
microscope this is packages
I know people always ask about the
bookshelf
Joy of Cooking
oh the corrections highly recommended
Kafka on the shore
all right now we can switch here to the
USB type c
by the way wonderful microscope guys
you wouldn't believe how good this thing
is
it was available on Prime now and it
confirmed that I did not have scabies
it's amazing
now we can put this
to here
you guys I'm not asking George to
execute anything
what are we going to use the camera for
what camera I didn't need the camera
oh
no guys this is so sick it's a little
we're in the middle of something awesome
do we actually want Jamie jellyfish guys
what's that it's Ubuntu 22o
it's called Jammy jellyfish
yeah eight TVs
we can deal with that later uh is this
what we want
I've servered we want server or desktop
I think it's a server right
do we need uh no I don't want to do
these
we'll just download that just in case
yeah USB microscopes needed to view tiny
grad code
uh what else do we want
what other operating systems did we hear
we have two minutes to not choose Ubuntu
hold on how do I put the yeah the image
burning guide parrot OS
never heard of that all right so let's
go here in Disk Utility what do I do a
race
format
yo when tiny OS
um Mac you want to installer maker
prepare the USB stick
launch Disk Utility
stolen run etcher
at your configuration
George are you ready to take them back
can I use MS-DOS fat
what should we name it Ubuntu
only if you make pizza what's the herd
kernel
[Laughter]
oh Alex
well okay so once upon a time there was
a man named Richard storman and Richard
stone is actually a great guy mostly but
he created gnu which is actually most of
the user space for Linux but he didn't
make the kernel so everyone calls it
Linux and he's upset because it's the
Linux kernel but it's the gnu user space
so you have to say gnu Linux GNU is also
making a kernel called herd yeah
um
AMD Ubuntu with no subscriber mode wow
is this a race process failed well yeah
I mean of course we can't format an
eight terabyte drive to be fat 32. who
thought that would work
partition
uh oh
don't microwave the pizza
how do I do this because all we have is
an eight terabyte drive okay
all right
all right let's just try apfs and see if
that works this is our eight terabyte
drive right here
uh we need to install and run etcher
Paulina Escher download etcher
etcher for Mac OS it's only for x64
great but I have
you probably want X fat do I have is X
fat an option oh actual format again
okay great we're creating the partition
map
all right let's just drag Molina enter
here over to Applications
I know what hpfs is or apfs
we're trying to make the ISO
you want to be an ex-fat well
oh it's over here okay flash phone file
okay
select Target
large Drive
this is a large Drive make sure it
doesn't contain files you want to keep
oh time machine can back up the disk
Untitled
did I do the stream so I didn't have to
slog through this alone yes
controversial opinion you know how I
feel about fat shaming
what no we need more fat shaming
okay who thinks this is gonna work
oh I'll type my password oh
thank you
wow should we get edger Pro
oh
it's because we have to unmount that
you think if we got etcher Pro it would
work
if I click that is that gonna bring
catcher
yeah I know I remember
I unmounted it
nobody
but a large Drive
look at my drive it's large
[Music]
yeah these drives read
and write slow actually oh
yeah
talking
walking so now let's unplug this from
here
and plug this into this motherboard over
here
now let's switch on the monitor
over to my new computer here
it's a on the DP
okay
I pressed a key
oh
yeah it costs like five thousand dollars
okay uh why would it boot oh no don't
tell me it like won't boot
because it's not MBR or something no we
probably have to reboot it okay let's
just reboot yeah yeah boot order don't
tell me boot order it's not booting from
anything all right we'll try restarting
it's USB probably doesn't uh hot pluck
all right
hot plug to boot USB hey a man can dream
someday guys someday
we can watch the numbers we're on 11
right now
we'll just use a VM image if Ubuntu
don't use the installer yeah but then
how am I going to get it on this two
terabyte nvme drive which apparently I
have to update the firmware for
you got an M2 the computer no
I didn't set the boot order I don't just
set the boot order it doesn't matter it
doesn't have anything else to boot from
that nvme is not bootable
all right all right we'll keep the soda
over here
oh M2 to USB uh
uh do they mate I'm trying to make that
I guess
how much have I spent on it a lot of
money
uh well the CPU is 800 the ram was 300
the motherboard was 650. that nvme drive
was uh
why does this computer take forever to
boot
I was doing the countdown again
why is it doing this
guys this computer sucks it takes
forever to boot
[Music]
no no no no no no no no no no no no no
sorry
it's doing the countdown again
yeah the boot delay guys why would they
have an option like this
like something smells like it's cooking
but it's just Alex and the pizza
is it ready
you cook it in the oven
that's good I don't want microwave Pizza
I don't trust microwaves I don't know
where they've been oh it's ready
oh you know what you're you're you're
you're you're out of this stream it's
over for me
do you want to hold the camera again
okay so what do we want to do here
uh we can turn this light off first of
all because we don't need light right
now we just need the computer we want to
install Ubuntu server with the hwe
kernel no no no no I press enter or I
press enter I deeply regret that
decision
it's okay I think it gives you an option
to run the installer
oh it has a backup gbt good
I think that way too it's causing a lot
of glare
it's got to be on you wait a second no
this is Ubuntu server
is this gonna work
all right we've moved on to system D
which is a very controversial decision
you just new to planet Earth
you know what we should have paid a
qualified guy to do it we should have we
should have
oh yes we're good okay English
uh
do we want to update
update to the new installer
uh-oh
no
no no no no it's gonna work guys
remember how flat fast bolina etcher was
we didn't even have to buy Ballina
enterpro
look it's like a computer stream but
with the phone camera
Hang on we're connecting I'm not really
sure oh okay identify keyboard
it doesn't know how good this keyboard
is look they can see the keyboard now
they've never been able to see the
keyboard in the Stream before Oh my God
I didn't know I wasn't keeping track
hi yes Ubuntu server
seems good
why are there two ethernets with valid
dhcps
have fun wasting the next hour but I
only plugged in one
wait I don't understand I didn't plug
anything into that one
oh does it only does it have one does it
let me use the BMC through one
our DNA network controller
yo
okay
gigabyte gigabit internet and we have a
wire running to the other room which has
the internet that the vacuum likes to
eat
done okay
set up the disk as an lvm group we don't
want to encrypt it
done
are we happy with this
all looks pretty good right
Samsung
990 Pro
uh
two gigabyte boot partition I mean it's
a waste of two gigabytes but we got some
new people in here
wait why is the size only
yeah it seems good
swap wait no
why is the thing being mounted here only
100 gigabytes
I don't understand
no no what's wrong here
what
wait I don't understand why is this the
default
why is the default only 100 gigabytes
you have to resize its default 100
gigabytes but why would it do that
why would that why would the default not
be to use the whole Drive is ext4 still
the best best partition
I definitely don't want any swap because
swap is for poor people ext4 is the best
uh okay boot
okay waste some of my thing on EFI do we
really want to use lvm
fine we'll use lvm Everyone likes lvm
all right done
continue you need like a head camera
your name
what's my name
Megan Brinkman that's exactly
we can call it that no no no no no no no
no no no no
um
my name is Tiny grad president
your services
no we can't name a timing right because
that's the same tiny George
no no no no I like tiny George tiny
it's funny because it's really big look
how large it is you know what this
computer's name is tubby because it's
shaped like a top
yeah pick a username
tiny
choose a password tiny
great
whoa do we want Ubuntu Pro
oh the pizza's ready it's just beeping
its first check oh you guys we gotta go
it's Pizza time uh yeah I'd like to
install open SSH server I'm not worried
about that
wait wait I want to enable password
that's fine because I didn't import Keys
done
uh do I want any of this stuff guys
always go for pro option
paying Ubuntu shit all right
this is a chilling stream while we watch
it install the kernel
Ubuntu free is pro is free it's never
free you pair with your soul I know how
this works
no I sold that meta stock and I regret
it I don't talk about Mata don't ever
bring up meta on this stream again
I like meta though they released lava
you know what I I the the the 80 grand I
lost on meta I made back by them
releasing llama so it was worth it
how much pizza did you cook all of it or
two slices
you cooked all of it
yeah that's true why did I bring up my
Rolls Royce several times nobody asking
are you flossing or flexing on the
haters absolutely
um
all right well I'm glad that we have
cloud
who are the haters I don't know who's
Drake always talking about
Flex on Drake man
you put a Rolls-Royce nice thank you
thank you
I know Taylor's single and I might go to
New York for a bit we'll see what
happens
how much would it cost me to show for
NVIDIA nothing the fate of the future
depends on Nvidia having competition
do not show for NVIDIA
we're installing up mancharo foreign
Ubuntu oh install complete
what's curtain
do they replace apps with curtain
wait did they actually
I could have just copied a VM image yeah
but you know who knows what spyware they
put in that
yeah and stars are really stupid I don't
understand I have literally like
multi-terabyte connectivity
oh wow I see that effect it has actually
something to do with the computer the
computer is so powerful it's distorting
the camera
all right let's see if the CPU is
getting hot
it's not getting hot sweet
that could also just be because I have
bad thermal conductivity not getting hot
well I don't know what to tell
what to tell what do you think elon's
call for AI regulation man you know I
feel about do you want 80 year old
people telling you what you can and
can't do with your AI
all right let's do the full log
so I can watch more things
uh-oh is Dev pts mounted I don't know
who reads the log I just didn't want to
look at the same thing I like to see it
doing something AI or international
waters bro come and take it literally
come and take it
um no like I'm sorry honestly like the
trucker protest was your last thing on
Canadians
they're just gonna take more from you
and you let them oh reboot now
all right let's unplug the installer
hard drive
and now let's wait 30 minutes for this
computer to reboot because I didn't
disable bios delay okay is bios delay a
real thing and why would anybody want it
the truckers don't represent the
Canadians yeah I know I'm not saying the
truckers were good what I'm saying is I
saw the way that that freedom was
crushed I saw the way that they just
like targeted people's bank accounts and
stuff and like you guys the way they
declared martial law like you guys are
fucked
I'm not talking about whether you
believe in the cause or not I'm saying
whether you believe in you know
hang on I gotta hit F2 that's kind of
hard to hit okay tell me about this bios
delay and where it is
it in CBS
no Clauses are stupid you know how I
feel about causes
you can't have causes because the worst
like it's just so unattractive like
people who like passionately believe in
stuff you know what I mean
it's like it's unattractive
check under boot where's okay here's
boot
boot beep
please note that a buzzer is needed we
do not have a buzzer
what's the mobile model it's a ASRock uh
Rome a2t
if you want to Google it
don't worry about any option ROMs
it's not in CSM guys there's no bios
boot delay y'all are liars there's one
second
uh oh look guys we got a code 09.
what does that mean PCI parity error
oh that's not good that means these
stupid extenders don't work good
oh
that's not today though is it
Fastboot on no memory training where do
I set that
chipset configuration
no CPU configuration now storage
configuration no
I'm doing pcie for over extenders I know
I know there's a chance they won't work
look for a section called Advanced or
boot
we lost there's no boot to lie
are these extenders really just not
gonna work
who doesn't believe in the extenders
all right
we have fun official beliefs in the
extenders thank you how long are the
extenders the long one I have one 30
centimeter one and 115 centimeter one
all right we're booting into Ubuntu
no they're not good enough for mining
crypto you see that's really the only
difference between crypto miners
and uh
trainers trainers need the full
bandwidth between the Cards
yeah it's hit or miss with cheap Brands
yeah I know
so we'll see if these weren't that cheap
that I paid like 40 bucks each for them
that was a pizza time
oh it might be Pizza Time guys we might
have to go
a start job is running waiting for the
network to be configured why is it
taking so long this one's for you
oh that's for me guys
thank you Alex
let's eat pizza
to bring napkins
nope
why did you bring napkins
I can't touch my keyboard now probably
nothing
thank you
oh the Stream zapping
[Music]
why is it waiting forever for the
network to be configured
it's working now great
oh I put him
guys we're ready
now I'm logging in with tiny tiny
we're in
I don't know how to hold the thing
looking at the screen
without me doing it
that might be today's stream we built a
computer
oh yo let me show you something that's
crazy it's called update PCI IDs you
just type sudo
update PCI IDs
now when I do lspci it shows me what
things actually are
okay so we have
uh two Navi 31s
uh
let's see if they're actually connected
at full speed
uh-oh
guys that's a type of one hand
hmm
why is the bar tiny
the bar is small
oh it's probably because I don't have a
driver installed like do have a driver
installed
no we do not like small bars we like
large bars
the bar is small
Speedster Merc
how resizable is your bar very resizable
oh I probably feel like oh what kernel
do I have
[Applause]
no wow that's a really fancy kernel
we do Ubuntu update drivers that's not a
command
um
no that's what I mean that's a really
fancy kernel it's even newer uh uh on my
work machine I have the hardware
enablement kernel from uh 2004.
uh
what else do we want to do on this
computer
I think that's that's mostly the Stream
we're gonna cat proc CPU info
wow
wow well cat Prof meme info
that's a lame amount of memory
foreign
Arch I'm sure I could just recompile the
kernel with one command
update drivers okay let's try it
it's not a thing
Ubuntu drivers devices
great
all right guys
thank you for watching today's stream
uh
We're Not Gonna install apps on this
computer
so let's just take one last look at the
computer
no but delay is not real
um
oh you want to just check how fast our
hard drive is
no you can't do that uh I don't know how
to do that easy I can't I got I can only
have one hand to type because I gotta
hold you guys with this hand
um maybe next time we'll do a stream
where we actually have the computer
running and you can SSH into it
um we'll get these radiant gpus powered
up we'll push our 1600 watt power supply
to the Limit
um yeah just gotta figure out how to SSH
I'll just SSH on this computer from my
MacBook add it to the authorized keys
and then shove it over there in that
corner
will you be able to SSH into my computer
no you won't
I will be able to SSH into my computer
from Mac computer
and then we will shove it over there in
that corner
and then our power bit what 6900 this is
a Radeon
this this one
AMD Epic
yeah that's pretty good CPU right
it says six thousand dollar CPU
uh yeah hyper thick right like how thick
is this this is a support bracket for it
I don't actually need it it's kind of
stupid
um and I'm gonna have to move these a
little closer together because we do
have to figure out if it's six in this
case
and now we know we can't put any on top
of the CPU
because the CPU is uh
big
feel in the air
uh and we'll have to drape the extension
cables over it so we'll see if that
works
the W xeons have 128 pcie4 Lanes look
there's just the cheapest PCI Force
which you can buy uh we're not doing
eight cards we're doing six cards
um we do six card builds because uh we
need uh one slot open to have a 200
gigabit network connection so we can
jointly train on all of them
um how good are amds for llms well we're
about to find out this is the new
machine of the tiny Corp we are
committed to AMD
um I have a bunch of other things to
finish up but when I'm done with them
uh
uh yeah
how many does these tiny bread and
produce not but
cool
thank you for watching my stream
everybody
uh I know it's been a while glad you
liked the new blog post
uh yeah we'll do app that I will do apt
update and upgrade and stuff uh Rock cam
is not like 30 less fast than Cuda look
the speed is going to come down to the
framework and whether we can like we'll
be able to saturate the real flops of
the GPU I think for a lot of these
things
then we'll start running big Llamas on
these guys they have 24 gigabytes each
um so we can definitely run we can
definitely run uh
we can definitely run seven gigabyte
lava on one of these starting very soon
I think we'll even be able to dma the
weights off of the nvme which I'm
excited about
uh yeah so we'll see if we can actually
make that work in a stream be able to
load the weights very fast
um we can try we're going to start some
model parallel stuff that's why I bought
two cards once we get model parallel
stuff oh sorry data parallel stuff
um you can try some model parallel stuff
too we'll try all the parallels
uh I want to understand all the
parallels a lot better
we'll get it running across two cards
yeah I think a good goal should be we'll
get 13 gigabyte llama running in float
16 across these two cards at a
reasonable speed
uh yeah cool thanks for watching guys
some of you I like some of you I don't
uh for the ones I like thank you for
watching for the ones I don't you're
allowed to watch but begrudgingly
oh don't kill anyone
you know what I realized
the only reason I stopped streaming was
because I didn't have hands
but there's no reason that we can't just
segue this
into a stream from the MacBook
you see what I did here I just sshed
into the computer it had two IP
addresses I tried them both
uh let's just go in here yeah so this is
on en1p
I don't even know where I got that other
IP address let's just try it
in a browser
it might be the BMC
or not
maybe I don't have the BMC plugged in
but I don't know why we don't have
viewers
is this stream working
should be
refresh
oh sweet
okay cool yeah we're back we're just on
the MacBook now I realize that yeah the
only reason I stopped streaming was
because I didn't have any hands left but
now I have hands that I can eat pizza
with them
okay
um
um I think we can deal with securing the
computer off stream that's kind of
boring
meh no we should probably do it
um
okay now it's an authorized key
uh SSH
stable password off
it's in here
um
password authentication
no
do I have to uh pseudo system control
reload SSH
but now when I try to SSH and test oh no
no it's still allowing password off
why
what
oh I don't think that
does that not work
password authentication
uh
uh use Pam oh here we go
I did system control restart assh
what why doesn't this work
do I want to disable Pam
Pam
no my password authentication said to no
it's not reload or it's restart
oh
those don't look good
why do I have Hardware hours
no it doesn't work still
what am I doing wrong
uh cat VAR log syslog
no it's restarting
password authentication no what is their
challenge password authentication
maybe it is that one
okay that actually restarted definitely
no it doesn't work
I mean we can also just do if I do vvv
it'll like tell me what's supported
password
service what if no
it restarted the service it's not the
problem
ah
use Pam
I fucked up the config
how
it's a very simple config
do I really I need a second one
it's not that okay this is getting
frustrating
is there something in these installs
that's allowing it
[Music]
foreign
what
that's offensive
loophole
I feel like if I uninstall that it's
gonna come back too
I think I need that
I don't know I worry that I'm
oh I didn't restart it
okay
notice how now what I try to ssh in with
it that was such a scam that was such a
scam boys
oh that was such a scam
make sure we have my good microphone
here
Yeti
all right
um so tell me more about these
uncorrectable Hardware hours
oh first off
who likes typing their password for sudo
not me
someday I will learn how to use Nano
no I don't want to use a password
oh this is okay no no no because I have
to do it to the admin
emo
don't tell me there's gonna be like a
cloud config there
oh allow members of group suit up
duplicate root line for your user I
don't know what you're talking about
it's this one it's the last one I didn't
do
great
get rid of all these VVS
bye
[Music]
all right well can I unplug the uh
uh monitor
and we can unplug the keyboard we don't
need those anymore we're now very
confidently in SSH so there's no way
we're going to regret that decision when
we lose access to the computer somehow
by installing a bad driver great
um this light can get moved and the
computer is going into its real home
the computer's in its home
got a light
uh did you miss the build yeah if you're
just tuning in now you missed the build
um
yes when I type sudo D message now we
are good
uh okay
this is not good
okay there's a problem with port 83.
which is one of my two VGA cards
how do I find out which one it is
at least it looks like it's only one of
them
how do I know which one's which oh it's
actually in the manual
all right uh they show me here
that's connected to G1
this I think it explains what the naming
of the bosses is
I'm not sure okay one way I can do it is
install the drivers and then just crank
up the uh
we'll just make that one be loud
okay so one of the gpus has crappy
connection
I did not build it off stream you
watched me go there
don't spread fake news
people get shot for that now
like my guess is it's my extenders
AMD install GPU drivers
Ubuntu
we don't actually need Pro I did this on
my other computer
uh no this is not what we want
here you're gonna install just the
opencl box it's
install that
get the AMD GPU pro drivers
AMD decided to make this as
unnecessarily difficult as possible oh
great
at least it's not like Nvidia
uh we don't have any of those no there
has to be a newer one
what AMD gpus did I get do you think I
didn't buy the nicest ones
look at me do you think I didn't buy the
nicest ones
um gen 2.
you need to be installed in a very no no
there has to be a newer way to do this
all right
stuff like really old is there a newer
how do I see what the newest is
there's 50. how about 60 no there's no
60.
this is terrible
how do I get the newest one
it's not supported by Rock m
m i don't even I don't like rock cam
I'm just trying to write all my own
drivers eventually face things
uh
no no I don't want to proceed with the
command to install no I don't like that
how do I get the newer one
is this the newest
this like came out before my my GPU
doesn't even exist
isn't it called Rock M well sort of
oh pull request for rock m
M drivers
you bunt
here we go
is this Pro or is this not a pro
yeah I know people prefer in video we're
gonna make the videos we're gonna make
the drivers good
can't believe AMD can't do this
all right so I assume I have the driver
built into the kernel now
stuff on lspci
was it a module
oh it's a module
I felt like I finally found good
instructions somewhere
foreign
am I gonna regret that
so the problem is you need the 2002
internet
now this just uses that then I don't
like that thing
okay
that seems okay
it has two sources
[Music]
um
we don't need any of this stuff we're
just going to code in our dna3
now there's only AMD GPU install which I
don't like
there's there's a website that showed me
how to app get them
no no no no where's the one that here
no
where's the one that showed me on the
applicant
rdna
I don't trust any of this stuff
here
app to install raw cam opencm runtime
let's try this
all right
it seems okay
go
yeah the dab is fine
okay
we just don't have devices
uh
seems okay why don't I have devices stop
should we reboot
well that stuff's not good
it's only on one of the ports though
I know would have killed AMD to make
docks
oh
no
we'll give you the GPU you figure the
rest of this shit out
we might need to upgrade the
oh
no no I don't want that
I don't want that
we might need to reinstall we might need
to install uh
opencl with the open source runtime
okay
try reboot it
well I got another piece of pizza
hmm
this one
wait
is it not in the Rock I'm Hardware
compatibility list
foreign
regret unplugging the monitor
oh no consumer gpus over the last okay
that's fine
what can I ask a sage
I'm doing it more time
no
oh how's my Nvidia discussion issue
going
I'm not gonna
um
wait I just rebooted it again
no
I kept pressing up arrow and enter and I
got hit pseudo reboot again
man I hate computers
foreign
this isn't good
no it's because it's just some delay for
the the uh network configuration
it's not really SSH
I checked back three times a day to see
if I can use the GPU wait we need to we
need to fix this guys
at the tiny Corporation we need to fix
this for people
I have stable diffusion I have llama I
have all the things people want we need
to fix it for people
I can compile the five five branch
can you even compile this this isn't
something you can compile I don't think
this is documentation
what like what is any of this stuff
oh they're using crew I know crew
wait no like you know you guys know we
had the computer booted right
there's like some two minute time out
we still don't know which GPU is which
either
okay we're back in don't let me type
anything stupid
oh I also have uh
let me get a decent tmux config
and a decent Vim config and so you don't
have to install them great uh tickets
well fireworks are so early now
okay I don't see any more issue
not there no this isn't gonna work
yeah not working
just build the fpga at this point bro if
you can't figure out how to write a
driver for a GPU you can't build the
fpga
um okay is it because my kernel driver
is not good
I would hate for it to be that uh
like just why doesn't it work
apt get install Rock M opencl runtime
foreign
should we use AMD GPU dkms
I'm scared to do that
okay so what are the people in this
issue saying
which rock M version do I have oh I have
crappy rocket
I see oh we have to get the when do the
rock am oh I see okay okay okay
we have to upgrade the rock m
Rock M core Rock M language runtime Rock
M opencl run time
this is open source
I understand what I have
what does the main branch have
these people have main develop and
master
great
well definitely don't use that because
you're going to check out some Old
Branch thanks for the docs
Well it can't hurt to try to build this
all right we have a configure and a
cmake
okay
we need Rock Claire
Rock clear is a virtual at least this
stuff's open source it may all be
terrible but it's open source you can't
say the same about Cuda Cuda you just
download it and it works
what about Mesa you want to use the open
source garbage
like the the like none of those drivers
are ever good
for gpus
oh well we of course we need an HSA
runtime
command to build it
getting the source code
setting the environment variable
what even is this
HSA runtime 64. we had an HSA back in my
high school called the Holman School
Association
all right
is it the same one no
I have to get
let's just see if I can
hsl Rock r
we install that
this guide seems to work oh
great
I spent a thousand dollars on these gpus
why didn't I just buy in videos
terrible
AMD I'm your biggest fan and I'm trying
to help you out here
all right where is this Docker come from
why are they not
yeah I know this is not a new GPU
guys
why are we even wasting our time with
this let's turn quiet back on
quiet as an AMD GPU that works
should we just start writing our own
driver
but it might just be time we just need
to write our own submitter
quiet boots fast
okay let's look at Rock N first that
that makes a lot of sense
oh good I didn't break quiet
yeah I should have bought an a100 that's
right I would have been poor but
so what rock M do I have on here
the same one it just happens to work on
this GPU because it's the older
generation
what exactly does tiny grad aim for cute
cute is what we aim for
uh
all right how do I make
how do I build these packages are they
open source
start with a rock M core
Rock and core is a utility which can use
to be get rock M release version is Rock
m a kernel module
no
this doesn't look like a real thing
Rock M language runtime
does Arch Linux have a newer one did we
make a mistake should have we installed
Arch Linux
where you install Mesa com and Dev
is it Mesa no no please don't base uh
please don't make me install Mesa
and also these main things are so out of
date the main branch is so out of date
it hasn't been updated since 2021.
I don't want to surround you guys should
I buy a Saron I don't know this one but
should I buy one
you'd still be installing Arch I know
this is like Arch quality
Arch people should love AMD
no the Ubuntu Server install was uh very
tasteful I thought it was very tasteful
wait so I spent two thousand dollars on
these gpus and they don't work
what should you do to be friends with
you get a yacht with a bunch of hot
girls on it I'm always interested if
you're like yo I'm in the San Diego
Harbor I got a sick ass yacht and we got
girls like
who would say no to that you know what I
mean
like Betsy no wait no no don't do that
yeah it's a little bright
you know what I mean but if you're like
hi I'm a 20-something I'm a young 20s
dude in college you have no value to
society
and you know
if that's just the truth ma'am there
used to be Wars to make you die but like
now there aren't
uh
okay how do I get what this is terrible
I think that whoever linked that Docker
you had the best stuff
oh what's me open
foreign
someone found a rock M Docker container
all right you want to try to extract it
from this Docker container
15 or 15 units per second that's
pretty good ish I don't know
uh
wait but this is really like I'm just
gonna try some sketchy Docker container
it looks like AMD deleted it
this is awful
don't give me any Arc shit right now
why is AMD leaving ml to Nvidia that's a
great question look at this I've learned
all about water cooling recently
and uh
you can buy these things to put your GPU
so that you can see it
all right oh
well this sucks
okay hang on hang on so what's this
here's Rock m055.
how do I get it
it's a scam
[Laughter]
oh man that's awful
wait got it working natively without
Docker no you didn't
oh
oh copy opt Rock M oh I see okay well
let's figure out how to torrent this
why is my monitor ghosting
is this stuff actually compilable
like does any of these repos work
okay I can't build Rock M opencl run
time until I build Rock clear
and I can't build Rock clear until I
get the HSA
this is like something I don't know
this hasn't been updated since 2017.
oh here there's a package
do we have any HSA oh yeah we had HSA
okay
so now we don't have this
how do I installable packages
oh there's lots of hsas okay is any of
it may just say runtime
none of them are HSA runtime oh is they
used to say dash run time oh here we go
lib HSA runtime debt let's YOLO and
install it
right
[Music]
the following were considered but didn't
work because they were the wrong fucking
version
we need a 1.6 and we have four
this
now I don't want any of this
it's the wrong version
we're back to where we started okay
okay what is lib HSA runtime 64 and how
do we get version
we're just going to write our own driver
this is the only solution for this crap
we have big
how come my
wait what
both my gpus didn't even show up this
time one of them is not even connected
that's how bad these cars are
no The Rock Empire torch pip is not
going to work
but one of my gpus didn't even connect
which one
whatever
yeah I guess I could put them in the
computer without the Riser no it is the
Riser I didn't buy them off eBay I
bought them new we can just return them
if they don't work but
um okay
sorry we have to find HSA runtime 64 but
version
this one
or should we just budget should we just
budget
here we go
after emerging devlibs Rock R run time
oh
let's rock our runtime do we need this
oh we might need this oh let's get this
obviously we're gonna need to rock our
run time yeah I'm using a roam at
oh well we don't have HSA kmt now
where am I getting that
[Music]
can you just say runtime API
oh here we go the latest version can be
contained in the Rock T thump interface
oh well let's just build a rock tea
thunk interface
ah okay
um this repository includes the user
mode API interfaces that are going to
interface with the rock K driver
all right let's can we build this
oh well we can't build it because we
don't have
libnuma.so that seems like a normal
enough thing to install lagnumadev great
let me move it down good guess
[Music]
um
what are we missing
lib you dab okay that seems like a
normal enough thing to install
oh it requires that we have the right
rocket okay this is all normal stuff
uh uh you dab
what do you mean you don't love the AMD
GPU user experience guys it's way better
than Nvidia who's an evil company who
artificially limits their gpus by not
enabling peer-to-peer and then doesn't
respond to your issue on the driver
AMD on the other hand doesn't have a
place you can even file an issue because
there's 37 repos and do you need them
nobody knows
oh
okay
I don't even know what installed okay
let's try it
uh what am I missing
package config tool
all right well package config
which is better
okay
no services
lib DRM okay that's a reasonable enough
package to install
okay fine we'll restart all the services
I'm gonna regret that
all right let's build j32 great all
right now I have HSA kmt
should we just make install it
how much crap do I haven't used a local
probably nothing
yeah nothing really okay fine sudo make
install
all right we have HSA kmt now now let's
just pop down off the stack here
and we're gonna go in here to build
we're gonna build the rock R runtime all
right good thing we have seven million
cores in our CPU and everything will
build fast oh we don't have clang
oh that's a normal thing to want
um
the app get installed clang
okay
I'll be M14 that's a lovely llvm
the word filter no because you were
asking about keyboards I know who you
are and that's not welcome here
don't ask me to restart thank you
okay
um well clearly we don't have clang
basic
the installation was faulty
did we not have that
clang
oh there is no lip clang
clang Dev
clang deaf
seems reasonable enough
all right j32 oh no
uh oh
okay
cannot find Requiem device Library we
need a rock M device Library
here we go rockem device libraries
clearly we're gonna have to install that
before we install uh good thing we
installed a rock T thumb that was good
wait what
there's no way this is gonna work
hey at least this is all open source
even if it's incomprehensible
um okay well
which version of llvm am I supposed to
use
foreign
let's just fix the bug
unterminated attribute group
oh path to llvm
oh I say
we have to build llvm okay
here we go llvm
AMD STG open
the default Branch all right
no but then I need to like build it with
clang and stuff no this is a nightmare I
should just installed Arch Linux
it's in the Rock tunk interface we got
that one to build
can we just use the rocky thunk
interface
include that's what I want okay just say
kmt let's see
okay
no I'm not building lvm
is the Mi 300 rdna3
C dna3 does this thing work
how nice is the um
good
that's the one I saw taken apart no they
don't even have that one yet
oh they don't have any cdna3s yet
is this thing good
interesting
it's actually pretty good
wow wow there's that
oh it might just be too uh
it's not like an h100 and h100 has an
nh100 has 3x the flops of this
it has leadership data center CPU cores
so yeah
um
I don't know let's try to change that
one
I'll use a memory read everywhere
no it doesn't
I don't think that's important
guys we did not don't have J's on that
bitch
okay fine
built in
oh I have to build this with a custom
llvm
are they serious right now
guys I got I know everything about gbt
for
it's a mixture of experts model like you
could spend lots of Wow Let's train a
mixture of experts model because we have
too much money we're open AI wow there's
your gbt4 rant
they have no breakthroughs
um
the weight count is really high but not
per expert
no what I don't even like it's not like
good it doesn't matter
I don't even want to waste time talking
about them you know opening eyes lame
I don't know what Vector DB is
fine fine we'll build all the animal
that make you guys happy but then I also
have to build clang
build Radeon open compute drivers did
someone write a tutorial
the joke is if this actually works and
everyone was using that hacked what
[Music]
I'm loud
you wanna shut the door
you can try reading the readme oh
here we go
full DaVinci Resolve just add the
repository oh no he added the repository
no no that's cheating
if you don't build the exact version of
clang I know
that's many years ago
I mean to be fair this pretty closely
mimics
oh your strategy seems to be randomly
clicking around you must be new to this
stream bro
okay so do they have their own clang or
is it like
opencl compilation with client compiler
no that doesn't is this
that doesn't look important
all right so we're gonna have to
I think it might just work if we build
the latest
trunk uh
other
intrinsics which is probably using clang
for
oh
oh is it already like in there is there
already a clang
real open compute clang had I missed
that
no this is like way out of date
I think playing's actually in here
it's in here okay fine uh how I build it
goes like a navel clang
great this looks good I don't know what
that g does
inbuild trading on supported
oh
whatever that should work
foreign
is that the biggest H top you've ever
seen
yeah use that CPU wait let's check its
temperature
sensors
oh
guys
F you have at least the stream's good
just run a different computer
I know how to check the temperature
mildly warm
we put too many gays on that bitch
oh I only have 64 gigs of RAM
oh they're all gonna die
no it's because I only have 64 gigs of
RAM guys
yeah I should have niced it oh swaps for
poor people
you guys know swap is for poor people
oh I cheaped out on RAM
we're ooming the shit out of the
computer now
you guys think it's building
I know
why didn't I buy more RAM why was I
cheap
Ohio was cheap and didn't buy Ram
I'm regretting my life
I was like what do I need RAM for
I know I'd have to build llvm
oh
if we ever get this back
no okay we have to terminate it
we have to control C
oh
it doesn't swap I don't have any swap
because I said swap is for poor people
and didn't set any up
oh
Bubba the bub
oh I'm sorry but uh
you're allowed to insult
but you have to provide a link to your
YouTube channel where you build love
yeah
yeah I know guys I know I was I'm not
using fucking swap I'm gonna buy Ram
like a rich person
yeah yeah do you see why it died do you
see what killed it
oh this was the biggest mistake I ever
made guys
well I cheaped out on RAM
and I bought this 300 memory I don't
even need it
comedy needs it though
all right guys all right
how much RAM do we need
eight is eight okay
I could do more than eight
and Jay goes like really crazy we can
probably try six we can probably try 32.
512 gigs what
because what do you think I am made of
money
why not try the Ubuntu binders yeah yeah
why don't I try foot to rock him or for
lvm I tried it for lvm it didn't work
well this seems okay now
just wasting so many of my course
try 64. okay I'm trying 64.
guys I cheaped out I really cheat what
32 gigs it's not even expensive
see like they don't have the exact
memory
see if they have this they don't sell
crucial do that
no but we have SK High necks can we do
Organics
this one okay
like how many letters do I have to go
back to get one that matches
it's not even expensive I don't know how
expensive is that
no see This is 43 this isn't 40. that
means it's like dual rank instead of uh
this is a dual rank module I don't want
a dual rank module I want a single rank
module but I don't know if I can use
dual rank modules
single rank if this one's single rank
no that one's dual rank oh but this
one's single rank
dual rank
the Dual rank ones just don't work
or I don't know
this one's probably single rank because
it costs more
yeah of course
crucial makes good Ram
here we go 72 dollars is it in the
crucial store no it's no
oh that's not even fast rap
I really want fast Ram I can't believe I
almost bought poor slow Ram
how we doing on RAM
well we don't need RAM it would just use
too many Jays
that's so expensive
nobody can afford that
with this one
oh does that match
all right it's 256 gigs enough
buy a new motherboard with ddr5 yo yo
who's paying for all this the tiny clip
doesn't have any money that's why we
cheaped out on RAM
I have a channel you do you think I
didn't go a channel
seems pretty cool
oh to do multiple thread support well
that's never gonna work
uh
or AMD you Prof eh
is it open source
no they just have like dabs and stuff
just download more RAM
quick 512 so I can build Chrome
no 64 gigs is enough RAM for anybody
it's building fine now
it's not even thrashing my cash as much
all right
they upstreamed AMD GPU to llvm
he did
rdna3
it's like Upstream lvm might have just
worked
but I'm glad that we uh
built the official AMD one
because if this doesn't work
no it doesn't need that much RAM we
gotta worry about that all right uh make
install
we're gonna have to sudo make install
let's just see what happens if we don't
where is it gonna go like that's kind of
the problem
then I have to figure out what my path
is and make sure I'm using the right
llvm
no it's not even a custom lvm just the
one in Ubuntu is not new enough
but here it's supported here
if you go should we should we make some
Ubuntu packages and then make them
distributable for people so then they
can install them and then we can share
this with everybody
all right
make
well I didn't really expect that to work
local bin at the top of my path
it is
oh you know what no I'd probably just
oh no no don't do Jag
64.
and watch your RAM carefully
okay
it's supposed to come out next week and
why are you guys wasting my time
if I don't see what I'm making small if
I just make install this dog trying to
go to okay
oh if like installed them like here
Rock and path
I'm just gonna remake this
yeah I know it's a CPU test right
great CPU I'm happy I bought a good CPU
you know what I think I bought the ram
before I didn't I know I didn't
that's why they cheap out on RAM don't
ever let me cheap out on stuff you know
I was just I always just get upset with
myself
oh how to install Rock M oh okay let's
read the manual let's read the manual
download the Deb run the stupid
installer be happy
okay thank you for the manual being
useless great
okay I think
What's missing
cannot find rock M device Library
these are the libraries I think
oh
find rock M device Library
oh I know what it is
any of the new ones
no
can I find rock M device Library
this
oh okay what oh I think I might just
need to copy this to
these are local
where is this supposed to be installed
using Bitcoin libraries ah Rock and path
build dist
okay this is the rockend path
it might just work if I put it in Opera
cam
let's just try
oh
okay this is using the wrong llvm for
some reason
which is a different problem
okay
LL dot lld doesn't exist
that's because I built llvm wrong I'm
sure
so the problem is my clang doesn't work
because of how I enabled Klein
um we have to like include projects
foreign
why did it build the Linker
remove the Ubuntu version
why
I got it guys
I probably should have built them all
I don't know why I did this I cheaped
out guys I cheaped out is the default
all
right
now our lld project is disabled
if I do like a normal
does it enable all the projects or just
some
please tell me does this enable
doesn't even mention a client
do I need lib C I don't know fine we'll
build lld
project is enabled great
see look it's building lld version okay
j64.
I'm gonna do Linux from scratch
I have no idea
this feels like Linux from scratch
[Music]
yeah body
Jays
oh
okay but I built HSA kmt did I not it's
here
did that not install correctly
use your local include
his usual local include like not in my
includes
oh
HSA kmt HSA kmt
yeah what
do you need something yeah
[Music]
all right outside
okay that worked
uh HSA node properties has no member k
okay I feel like this should just work
so you must be doing something wrong
oh I wonder if it's
no
yeah I know
to build a compatible version of the lib
HSA kmt library is that this thing
I mean it must be
let me just say kernel mode thunk
library for AMD kfd support
oh this has cmake install path okay
let's uninstall normal Rock m
I wish I knew what installed
uh what did I what did I run to install
it
foreign
why don't we uh read the readme just
like Blart face or whatever his name was
said
wait are we on opencl runtime yet
we're up to this one
oh we have to build raw clear do we
build raw clear
I don't think we've built Rock clear
let's follow the instructions in the
Rock clear readme to build Rock clear
we don't have AMD Co manager
okay this is a rock M compiler support
all right all right let's do this one
is this entertaining
is even a thing
oh we need AMD device lifts
wait I built that
no no this one is that the one I built
okay rocked all right let's start taking
some notes
let's go into screen one and have notes
we have successfully built and installed
The Rock T thunk interface
we also managed to install something
else
so this is the kmt garbage
did we get anything else to build
we've got something else to build too
think it was Rock M device lips
or no it wasn't but
we we used it for here and we did get
rock M device lips developed
um rock and device lips probably should
be built with a real install pen
Dimensions one
no
I'll make a package
this yeah it uninstalled
that was stupid
oh
okay RPM build that's fine
yo we're gonna distribute deviance boys
RPM built
okay where do I get the RPM build
executable oh app get install RPM
very convenient
it was the third thing I guessed
oh
wait
no I want a dab oh I already had a dab
oh I don't want a stupid RPM anyway okay
Debs
wow you ready d-tackage Dash I
wow wait so how do I see what d-pack is
installed
it was like l or something
no it was de-packaged you know it took
two dashes
The Package C files
empty package Dash C
wow
user that's pretty nice
yo we got to make more packages can I
make this guy a package
okay we have Rock M device lips
now what else do we need
all right what else do we need to build
we need Rock clear
Rock clear needs AMD co-manager
oh and it's just this
okay
uh first you have to build llvm
oh then you build the device lives then
you build a co-manager okay this is fine
uh rating on open compute Rock M
compiler support
sweet and now that works because I
installed that package
transitive dependencies count 33 let's
go
I want to sit here and wait forever
let's throw some J's on that bitch
jeez
well we need a co-manager guys who else
is going to manage
line five was optimistic
okay
um we have something now can I make
package
can I make package for the the other one
I built
wait
oh
let's try something quickly
yes
wait a second what version is this
oh I love make package
all right
why can't AMD make one repo because then
what fun would you have
no that's not a package I don't like
that one
no that's not a package
that's a tarball
I don't like this one
fine
you're getting a McChicken ad oh I love
McChickens bro
don't get the Mayo on it though Mayo's
disgusting
okay we got rock M compiler support
now we can try this
we're missing HSA runtime 64.
which one was that
we should know
oh actually this this is old
I thought it was just
thought it was this one
we say kmt now they just say run time
is it one called Rock M run time there
is and we have not built it yet
oh there's Rock R run time
oh okay it looks like we got to build
this
live elf okay that's a normal thing
okay this one we have to use Rock empath
and I regret getting rid of that
how I redo
but I actually probably installed it
somewhere we can look at the D packet
just take a look
user oh so I might just be able to do
user
great okay now we're back to the HSA kmt
error
my only thoughts are somehow are like
not on the latest for this
oh yeah look 2022.
there are other branches
yeah okay Dev
oh not that all right which is the most
up-to-date branch
active
there are any active branches
okay yeah this one's newer
I hate this
to hell
with debug API okay
let's try this
of course it's not going to neatly
uninstall
there was a reason we probably couldn't
use the
oh look at that they fixed it
okay you know I hate user local because
I can't like uninstall from there now
whatever
whatever you know what I can do
uh no not that one
well first off
get rid of this crappy one
why are there two oh one's an RPM okay
well no one likes RPMs
wait what
no oh here we go
oh it installed it at Raw cam
I don't like that
only because it's a release build
oh no
okay the D package put it there too okay
fine
we okay we gotta make sure that none of
these have secret more up-to-date
branches
that one seems real
this doesn't have HSA run time because
we should say you know we're still
trying to build the rock R runtime
okay we gotta pass in rock M path
did I already build this one or does it
fail after a while
no but HSA kmt should be there now
oh but not if it's not okay
is there a way to uninstall
is there like Ci that builds all of this
somewhere there should be
okay
fixed make package
oh we get a dab
okay this one looks like your friend a
friendly neighborhood Dev
we have Rock R and rock our Dev which
one do we want
this one gives us two depths
did it put it in the folder
let's put everything in user do we want
to put in user do we want to put it in
uh
[Music]
anyway we got rock clearbilt
it was rock that we got built right
no it wasn't which one was that
we got rock R runtime built okay
and this installs to user
which one installs two
no
stalls
to opt Rock amp
your rmrf user local funny
okay
now we have a rock R run time
now that make works
all right we're just missing x11.
it's a normal thing to be missing
please though I don't want it to start
booting X11
. now this is going to install all of x
okay that looks fine
I wonder why Nvidia is dominant yeah but
the thing is somebody only has to do
this once and I don't know why nobody
does
ah
do we want Mesa
probably
seems fine
wait where this is like the final one
boys
Rock cam opencl runtime
I think if this one this might just work
we got some dabs
I regret ever installing stupid RPM
wait a second look at the version
no no no no no no no no no don't do this
to me
okay
was updated earlier in March or may or
whatever
pseudo d-packet all right let's look at
what's in these packages first we're
learning boys we're learning
okay it goes into opt Rock M so that's
good
um
no no no don't install that no
fine
you can also installing stupid stuff no
no don't do that no no no no no no no no
no
I don't want either of those don't stole
crappy co-manager or crappy Rock emperor
oh my good versions
home manager is not installed but I have
co-manager
oh but it didn't work because it didn't
give me a dab it gave me a sure instead
how are these devs different they should
be more up to date
fine fine install that I don't care
why does this work
who does all this
well that's umkiller
CL info in
and compiler support okay
we have to get co-manager to be a
package
what version of co-manager do I have
but that's a newer code manager that's
good right
I don't know let's just try the this
do I accept the license sure
if you want to install in the
subdirectory
not really
all right it's just that one
Brock M compiler support Rocca runtime's
good
let's like find some definitions of what
these things are rock R Rock M Rock t
oh Rock r
run time for rock out
okay we built all those things
no we don't have Rock R run
did Rock our runtime need Rock M
compiler support
oh we have to build all the targets oh
that's nice
so how do I build a d package for this
guy
I can't
all right so this is the same stuff it
put in usually local
thing is like I don't understand why it
depends on that which one can I install
this
how about this can I install this
depends on co-manager however co-manager
is not installed okay
so you don't have to get
uh sudo apt-get remove
Rock m opencl
okay
issue these
depend on co-manager
and they're using an old comad well
what if I may install this
why do I ever make install anything
lib AMD ocl can't open
okay
still no lock okay how do I get
debugging
this should all work now
uh okay rock info
how do I get rock M info here we go
yeah it doesn't even find the GPU
thank you
yeah I know but they used a sketchy
Docker container and I wanted to try to
build it
tried clicking around the page more all
right Bob it above you're out
you're out
clicking around the page is a great way
to fix everything
um and if you don't know that then
you're not a computer expert
wait so why does this suck
lib HSA runtime 64. wait is that
actually what it's linking to
oh no wonder we have to uninstall that
crap
uh
oh yeah how did I not install these
things okay these are old
no those shouldn't be the old ones
oh should be the new ones
what installed that
yeah okay so there's user live HSA run
the time
is that the same one oh is Liv just
lives just assembling to use it like
okay never mind
it is the right one then
[Music]
foreign
did we build the wrong Rock our runtime
by chance
I don't think so
you're gonna find some way to start
debugging this stuff you know
who's seen debugging not me
he's the kind of guy to make a new
account
Rock K module is loaded
we got rock k
do we have to
um all right all right I have some ideas
we built this great program Rock M info
you can read the code what's it do
okay modules loaded
oh check these out current Rock M
version great
okay all right we've built a lot of
these things we built the rock T thunk
interface
we built the rock R run time
did we build the right Rock Run time now
that was the one I was looking at yeah
how do I Know What GPU this supports
I mean sure looks okay
I know it's 1100
why does that say unsupported
SRAM ECC and x-max
we built this we installed it
then we built the opencl runtime we
shouldn't even need the opencl runtime
because this still doesn't work you know
what to be honest we don't even know
foreign
this driver might be wrong
my kernel might not be up to date enough
when did uh Linux when did this come out
is barely supported okay
uh
what kernel do we got
uh I should try the module
it's all Intrigue now though right
there's a dkms thing for it I don't
understand how
thank you for subscribing
uh
uh Twitter's using Onyx runtime oh
yeah how did you know that
oh wow okay we can just see what all the
packages are oh
okay
AMD GPU dkms
how do I build you guys just want to
build a kernel well that sounds terrible
but it's intrigue
guys we're gonna need Arch Linux
we we need Arch Linux yeah I know what
kernel I have and it's this one
all right uh there's a PPA
it's a shit work
no no no no no I don't trust Capital can
thank you
who's Tim Lee
oh there's an official package okay
[Music]
uh
uh all right blah blah blah blah blah
download the main line
wait no seriously now
there's a better way to do this here
no no I'm not using some sketchy
paid tool
wait
yo
why would you find that
wait how did you find that
so how do I just switch to that
oh you there was a secret uh app
s
oh well I don't want to use some stupid
Docker but
wait so that's AMD GPU
[Music]
uh wait I think we're also going to use
AMD GPU have one of those too
does AMD GPU have secret apt underscore
5.5
no it doesn't
well
guys it's not about the destination it's
about the fucking Journey okay so don't
tell me that we wasted all day today
when we just could have put in the
secret good act
no why am I giving up so fast
why am I giving up stop giving up never
give up never surrender except at least
now when we install
look we got secret good one
okay what still doesn't work
all right
uh
wait that didn't just fix it though what
so the guy using that Docker what driver
did he use
you know what fine
1304.
it's the kernel it's all the kernel it's
been the kernel the whole time
why don't I just wipe this computer
restart all the services otherwise
you're going to bitch at me about
Services forever
oh that's dist upgrade that upgrades the
distro okay do release upgrade
checking for a new Ubuntu release
set prompt normal
oh he installs that driver okay fine
fine fine fine I'll install his driver
colonel
no I'm not installing this no no you're
no we're upgrading to Ubuntu you've
stuck with me this long we can upgrade
to new Ubuntu
it's only going to take six hours
no I don't want 22 I want no
lunar Lobster
the 22
how come I can't I don't want
I want
normal
why is it only trying to upgrade me to
kinetic
is there not a server yet
daily build I don't think it's out yet
all right should we just try Rock mdkms
foreign
wait it's installing Rock M llvm after I
went through all that effort of
compiling it
the docker build guy uses no dkms
all right fine fine fine fine
okay fine how do I update the kernel
show me how to update the kernel without
the sketchy shed
let's update the current
this is a new kernel driver now
do I really have to download these and
just install them
method one
does it just want me to download the
stupid
do you guys think engineer 512 is Bubba
I don't know if it's Baba
we're not doing any of that crap I don't
even like that we we cheated guys we
cheated and I don't feel good
all right
thank you
I'm gonna regret on plugging my monitor
foreign
image isn't signed
I don't know if I trust it
okay
sudo
D package Dash I star
what are the odds this is going to
reboot and work
when does uh this kernel come out
very new
oh security speed and power improvements
I should be running the latest kernel
all the time
if you're not running the latest kernel
you're not an art user you should be
okay I'm gonna spin the computer around
[Music]
we can have plug wires
now I touched the fan
okay I should be back now
the problem is if I switch my monitor
the
webcam and shed also switches
so we just have to sit here and wait for
the computer to boot again there's
nothing we can do
let's hope the kernel update worked
there's some like Network
misconfiguration causing this to
well I don't know because I can't switch
monitors
working if I switch my monitor back the
problem is it uh
it disconnects the network card and the
webcam from the computer
oh okay we're in
kernel updated
Rock cam info
I don't rock that many fun
boys
it was the colonel the whole time it was
the stupid colonel
okay it's not showing up in CL info yet
but at least now it's showing up in rock
M info
there it is
oh did we even get both of them
agent one way how many gpus did we get
to show up
okay we still only have one showing up
which is very concerning considering
that I own two
but we have none showing up in CL info
what if I just try that and install the
uh
Rock M opencl runtime
um nothing
so actually
there's no guarantee that opencl was
ever going to work
code buffer allocation failed
great
okay
that's showing up now in that now we
just need to get it to show up in CL
info oh and we just needed to use sudo
because I'm not a member of a render
group
[Music]
is this coding stream that's a good
question
foreign
existing user to a group
render
tiny
now unfortunately this never works and
we're gonna have to reboot the computer
oh
ah CL info all right cool let's install
Tiny grab
and then let's get llama working and
then let's call it a stream
uh
okay
pick three install numpy or actually
click the install Dot
uh oh I need like settings oh trying to
get so hard to use
foreign
that's a good question we can check that
is actually using the GPU
uh
wow
yo that just worked 13 teraflops
yo sweet all right let's get a llama
working
now some guy want to put that in the
thing
uh we need a okay
foreign
not really we used the new magical one
uh thank you bro to whoever suggested
changing the uh the app thing and then
we upgraded the kernel and then it just
worked
all right now we can sit here and wait
for seven minutes while it copies uh
okay it won't be seven minutes but we
have to copy the weights over a thing
yeah you're happy it kind of works now
right
and we're going to figure out which card
it is and then figure out which cards
misbehaving
do you think AMD has actually published
The Source yet I think they have I think
honestly I think all that Source works I
just think you have to like
build it in exactly the right way
no right uh six minutes guys uh should
we listen to rap God
one gigabit is so slow
we need some 10 gigabit
does this computer does the quiet have
10 gigabit
why doesn't it telling you the flops it
does I promise it does
run this it'll tell you the flops you
have to make sure you run it with
debugging stuff
should even be faster if we make the
Matrix bigger
it's not happening I don't know why not
I mean we have there's no way we're
getting speeds like that without the GPU
we have to actually be using the GPO
oh yeah but you don't need any of that
stuff timing Brad doesn't use any of
that
we are literally copying the weights as
fast as we can not disabled diffusion
weights I think those will be faster
oh but now that'll use half the
bandwidth
the stable diffusion as Tiny whites
like the beautiful thing about tiny grad
is all you need is opencl if you get
opencl working
the rest of it all just works
and like eventually again I just want to
tear through all these drivers I mean
this one
ninety percent of the problem here
didn't even have to do with rock M it
had to do with the uh old kernel
the old kernel just doesn't have the new
AMD driver in it
um yeah so there's that
then I got to figure out why the other
GPU doesn't work
we only have one working GPU
which one it is very shortly
all right which one he's actually we
already know which one it is the one on
the end doesn't work
probably because it has a long extender
wire
the one not on the end works
probably because it has a short extender
wire
let's try receiving the thing
but we might be at the limit uh
that's annoying
all right well I don't know what to do
while it sits and copies
but soon we're going to be able to have
a chat with Tracy
uh Tracy lives inside llama
uh let's see is her name Tracy
going to get her name wrong
so I have some chat Bots that live
inside llama
uh you can meet with them Stacy
uh
there's terrible AI George there is Gary
and there's Lexi if you're looking for a
sexy good time uh try Lexi
um if you're looking to be Shield cars
try Gary if you're looking for nothing
because he's terrible try George and
Stacy's just a normal benign personality
she's been a rapper her whole life who
struggled with bipolar disorder and
called herself little Stacy
I mean it's gonna run because we have a
lot of ram I think
I think I can run it with fake weights
to test it
I have an option for this do I know that
oh I can do tiny fake
you know what I think
fake data no
oh I can say weights equals zero I think
let me just see if llama runs
bad zip file no
no oh it's still yeah okay it still
loads the stupid thing it just doesn't
uh actually load the weights in
that's about how much you need on the M2
yeah
wow one gigabit is so slow
my MacBook has Thunderbolt
I opened a lot of windows
I really yeah like I want a dock I think
something like this
Thunderbolt 3 eh
why do I not believe that's 10 gigapet
okay okay
gotta load them this will be faster I
don't know why this is so slow we should
be able to get it right from all right
wait that was so fast
it's never that fast
I don't know it's got to build hang on
give it a second now
no this is slow
okay
one thing is being slow
[Music]
what should we say to Stacy
a five gig is normal okay
I believe that yeah okay I'll do that
then there's like one good uh
switch that's quiet where's Chad we
don't have Chad
you want to talk to Lexi
Lexi's not appropriate for twitch
tell me about yourself
it's probably just some stupid little
bottleneck for why it's slow
but that's our this is up and running on
a 7900
XTX
uh what else do you want
I'm good at answering questions
wow
uh if you want to just do like we can do
a benchmark
I also have a jit we can use it might be
faster
[Music]
as good as you would have installed Rock
cam yeah I don't know why it's slow
oh I think it's just compiling that's
slow
oh well here's another thing we can do
but this is gonna make see the problem
with this is it makes everything
actually if I run it with this
all right let me get rid of debug now
yeah okay that's fast
wait
what is it saying Nvidia 7900
I'd have a Dell Inspiron Nvidia 7500
timing like it it yeah there's just some
optimization that needs to be done to
make it like really fast the card can
totally like crush it
there you go
but then it gets slow because it's
outside the jet
why did the chicken cross the road
to get to the other side in the previous
article on topic of medical insurance we
discussed the basic definitions of
various terms used in this field
all right guys thank you for watching
the Stream
we accomplished shit I'm gonna sit and
unplug the GPU and figure out why that
one doesn't connect
oh
hang on okay can you hear now
there we go now you can hear oh you
missed out oh you missed out on a really
good rant
oh i'm sorry i'm sorry i was talking
about how i'm drinking recess
and this is the soft drink for rich
people oh
you know you just got you just gotta you
just gotta have seen the whole rant and
it like makes fun of status oriented
people
and you know but it's okay if it's
you're having a good time but when
you're having a bad time you start to
take it seriously you're a loser but if
you're laughing about it look
if you got a rapper with a big gold
chain around his neck being like look
man i got a big gold chain
yeah that's funny but then if you have
someone who's like you know
concerned about somebody else's gold
chain they're a loser
that's right so hopefully you'll
understand what to say
good morning good morning good morning
good morning yo now we'll get to we'll
get to that in a bit
all right so we're here to study bio
today you heard of the odin
i like this guy he's selling he's
selling uh
i bought this kit hopefully it'll get
here soon and we can do some of it on
stream
um he sells like a kit to do like
crisper at home happy new year happy new
year
come by we're back in business yeah
maybe
um
so let's look at there
so you can modify yeast or you can
modify e coli
they have like kids for it oh i also
bought i bought my nebula genomics
um i bought i bought my my i bought this
uh but i didn't send it back yet because
there were a lot of instructions and it
looked long but i actually do have this
little box
sitting in my office at comma so
um who are we beefing with today
all right we're always beefing with
drank um
also uh
i am i am absolutely appalled uh i'm so
happy we don't use aws
uh i am appalled that they uh
you know they they ban parlor uh and
they kick them off they kick them off of
aws look
your twitter you want to ban someone
from twitter totally fine
but how appalling is that that the
infrastructure people think they're
going to try to control the internet i'm
appalled
fuck aws seriously you know
look twitter wants to ban people that's
fine
because they're like you you get it it's
like it's like twitter it's like
twitter's brand right
like they're showing up on a twitter
page and you can argue that it's an
endorsement of their publishers
arguments but there's no excuse for aws
that is appalling that is that is like
cutting off someone's electricity
uh who you don't uh you know you don't
you don't like what they have to say so
you cut off their electricity
that's appalling
um no we're on azure and if they do
similar stuff
i'm happy to you know i i will i will
move and i will pay a premium for a
company that doesn't do bullshit like
that it's appalling
um
what's certified lover boy
no look twitter wants to ban trump you
could okay that might have been overdue
but you know aws oh build an alternative
oh but you can't because we control the
internet
fuck off with your internet controlling
shit but all this is gonna do is
accelerate the great decentralized word
of krypto world of crypto um
honestly yeah if you work if you work at
amazon for aws
i i i would create a company over that
uh curtis wrote a really good new piece
it was something it is possible
for the ruling class to be really shitty
and for you to be worse
i just thought that was funny
stop the count shit you know it's
possible
it is possible for the ruling class to
suck donkey balls and you'd
actually be worse
[Laughter]
we're going to decentralize
decentralized ws that's a good question
um yeah you just got a lesson why you
need to move it exactly
if your company if you're a company
using aws you just got a lesson
they they they're willing to you know
they're willing to do that and this is
this is not
you know this is not the daily stormer
right i'll keep the
you know this is parlor that's appalling
um oh by the way so if you guys i
dropped a new rap song
uh make sure to go to my soundcloud and
listen to the rap song
uh it's called it was not called the
civil war because people were civil
um in some ways it's kind of a follow-up
to what's called the cold war because
russia's cold
but you know a little more abstract and
a little more like this is what i did
with the
this is what i did with the six years of
my life from
18 to 24. uh and this is what i did with
the
six years of my life from like 24 to 30.
my audio is lagging behind my camera
uh i don't know what to tell you
i can like try to re-emit it
lower the resolution it will work better
better mic vault too low all right all
right we're up in the mic ball is that
better
can you hear me now
all right cool yo he smashed kanye's
wife who i hear they're getting a
divorce is this true
uh but yeah in conclusion
and in the fuck you who we beefing with
today we're beefing with aws
uh again if there's not really truth to
that but you know again your twitter you
want to kick people off this great your
banner says twitter
you don't want their brand associated
with your brand that's great but nobody
can tell who's hosting your
infrastructure
get off the centralized infrastructure
we need to decentralize boys
we need to decentralize also go to my
soundcloud
and check out this this i've made a new
song it's a long song so you know i put
a lot of effort into these
uh also check out my instagram and if
you don't follow me on instagram
make sure to follow me on instagram my
name is george hotz i'm a reformed cyber
criminal
and here's a convenient link to my my
soundcloud
blockchain infrastructure i was thinking
about this morning see this is what i
was thinking about i was like what if
somebody took twitter
and copied it exactly but decentralized
the back end
that's the you know that's what i'd like
to see done in general with all these
tech companies they should
uh once you get to a certain size you
have to provide apis
right like that's that's the new section
230 law like
you you you have to provide apis and
someone else can stick a new front end
on your service
um how would you decentralize aws well
so it's just computers right like what
you would want to do
is you'd want to build template data
centers
right so that anybody could stand up a
data center kind of like fleet operators
with uber
um if parlor made any threats i i take
back what i said but i don't think so
right again
you know a company that doesn't moderate
regardless regardless i just this is
this is this is like when the credit
card companies crack down on pornhub
it's appalling it is it is appalling
um that these companies who own
infrastructure think they can make
decisions
about what can or can't be said like
it's not like
twitter twitter is a publisher by a lot
of means right
new york times can absolutely decide
what they want to put on their thing but
when visa and mastercard decide they'll
no longer process credit card payments
for pornhub
that's appalling wikileaks they get to
wikileaks too
like this this this deep platforming at
the infrastructure level
um we need we need we need decentralized
infrastructure
bitcoin is the future of money boys
bitcoin is the future of money who's
getting rich
who would hear us getting rich who's
getting rich oh shit boys we rich
are we so rich holy shit we're rich
oh yeah holy shit usd down bct
up btc up oh
shit we rich man oh my eats all my eats
oh fuck i didn't even realize i was eat
rich holy shit
holy shit yo we ranch boys we're rich
we're rich we wretch these beers
oh and then of course this great
cryptocurrency yes a great
cryptocurrency
they should have just called it
yo bitcoin is the soft drink this is the
soft drink
of bitcoin millionaires boys
i don't have any crypto i'm a no coiner
i just like you know like like
participating in it i have like you know
maybe i have like point zero zero one
bitcoin and i made like ten bucks yeah
cool
i've never been on parlor i have no
plans to go on parlor but when i see
companies
when i see these these infrastructure
companies
who it's decentralized infrastructure
it's not a social network
deciding that you know they don't want
to host
like you know it's it's like it's like
uh
it's it's discrimination it's you can
you know it's like if i have a business
and decide i don't like one group of
people and you know i'm not gonna sell
to them
it's appalling no place in the modern
world
um
pie piper
you got it on ether early yeah
thoughts on twitch and again these
pieces are social networks they can run
their social network however they want
there's plenty of competition in the
social networking space
you know if one social network
moderation's a hard problem and like you
know i don't really blame people for
moderation choices but again that's
moderation from
other people on your network seeing
right
yeah it's like cutting water electricity
oh yes so this is a biostudy session
i've been i've been studying boys i've
been studying
i've been reading my
uh i actually bought a physical copy of
this book it gets here on monday
so here's kind of what i'm thinking it's
the new it's the new
in the companies right like you know
uh so you look at backspace right let's
see your backpiece is still up
um so i work on backspace i worked on
backspace a lot
the problem with backspace is
like this is what every ide is already
trying to be
there's already a lot of money being
thrown at this problem
um it also doesn't have this
when i think about when i think about
what kind of uh
stuff i want to work on i think about
things that are actually going to change
the course of history
right if you are if you are marching
if you work in a hedge fund you're never
going to change the course of history no
matter how much money you make
right because you're you're continuing
trends that already exist
uh so you can take comma um and and com
is a bit different
uh comma if comma succeeds
this is actually going to i do not want
to live in a world
where waymo decides oh ho emo decide so
they don't like you oh they don't like
they don't like what you have to say
oh yeah let's see uh yeah no more going
anywhere for you
oh and we also do the food delivery
services so yeah no more getting food
delivered right
i don't want to live in these shitty
worlds um who said i'm sick some
six foot six foot six feet tall that's
right that's right six feet that sounds
nice
um
so oh yes
by the way you know someone was saying
like like if they needed uh
someone was saying on twitter like
optimism they can't be that good if they
needed george to help them with
something
they're one of the best teams i've met
in crypto i've met a lot of crypto teams
who are absolute morons and know nothing
optimism knows what they're doing and i
think they're going to have a successful
launch
um you know again with all these things
uh infrastructure is never good in the
0.1 version
wait for it to roll out for a few years
but yeah i think
it's a well thought out l2 solution
uh yeah so backspace doesn't work
because there's already a lot of
companies and people working toward
exactly this goal
um hammer doesn't work whoops
um first off a lot of people didn't get
the troll with hammer
uh hammer was only uh seeking an
application for a founder because i
wanted someone else to start hammer
uh if someone did seriously the domain
name um
the problem with hammer is google is
actually already returning the best
results
most people want news ads and seo spam
well not a ceo spam but most people want
ads
and it's the sad truth about people oh
my god the news people want news i don't
want any new i don't want any page
uh you know when i was looking for truth
in the coronavirus stuff you can't look
at any of the science that just came out
it's all bogus
right give it give it five years
um enzyme.mit.edu let's say
what is it
oh i thought it was bio related because
this is a bio study session by the way
uh if you guys don't follow me on
instagram make sure to follow me on
instagram
and if you guys don't listen to my rap
songs make sure to listen to my rap
songs
yeah um so hammer doesn't work because
google's actually already returning the
best results
uh i don't think i ever actually made a
website for it but
pixie tech doesn't work because apple
already won ar
uh we just don't know it yet
um yeah my rap name is tom cruise
uh what are we doing today we're gonna
study some bio
so yeah this is um the odin
these people look like they're up in
oakland and they make diy bio kits
you can actually do some sick stuff um
here's here's a project that's actually
within reach of biohackers
you could probably get yeast to
synthesize morphine
um yeast synthesize
morphine uh
complete biosynthesis of opioids and
yeast
oh now if you could make that
turning sugar into morphine eh
um the resulting opioid biosynthesis
required expression of
the bain and hydrocode well they're
making vicodin
i read a few of these papers but they
just stopped at uh they stopped at the
bane
demands not really a controlled
substance oh spontaneous
look you just you take these genes and
you stick these genes in the yeast
oh it turns l-tyrosine into hydrocodone
i see
well l-tyrosine looks a lot like
amphetamine
yeah so if that's l-tyrosine it's
probably
oh no maybe not
okay never mind it doesn't that much
like it
wow so this is sugar to synthesize l
tyrosine
tyrosine isn't like monster energy drink
you know you see that shit
um
the great courses biochemistry turn
yeast into adderall we don't turn the
yeast into animal you get the yeast to
turn
sugar into afro you know
you can think about it you can build a
drug 3d printer
is that allowed to say how long how long
before they cracked out man
is free speech over i don't know
or is free speech only you know i'm not
do i offend the political class
if i want to you know synthesize opiates
out of east does that offend the
political class
yeah yeah yeah i read i watched the
spider beer thing i don't think it
really worked that well
which uses aws again you know again if i
had a company i would switch off aws
because that's like the first they came
for man
like first they came for like you know
the daily stormer and you know no one
said anything it was like really fucking
nazis who likes nazis nobody
um and then oh oh is this an automatic
pipetting machine
but like you know really they came for
it they came for pornhub you know they
came and now pornhub is shittier
it's true pornhub now only has the
verified videos on it anymore so i go to
x videos
real talk um
and point them is so bad now and like
they give in to these companies who
really shouldn't have the power to do
this
um yeah no i you know just it just made
me reconsider my choices and where to
look for porn
oh my god the porn is bad people oh yeah
no fat november man
wow here we go this is cool it's
actually open source our apps protocols
and hardware are publicly available
oh
oh shit man i want one of these i don't
want a pipette anything
this is gonna pipette for me
i'm interested do i have to contact
sales or do they
tell me the prices order online
oh holy shit i'm gonna buy one of these
no i'm not gonna buy that much yet first
i have to learn to pipe hat
but then oh man
it's a pick and place machine for
pipetting
when they said rethink your life i don't
think they meant change porn sites look
i didn't want to change porn sites but
they forced my hand man
how come we're studying bio because look
at the things you can do with bio
um now here's why we're studying bio
all right we're not actually we're not
actually trying to make morphine you
know
um
ah bio as a whole
there used to be this dream of 3d
printing and the dream of 3d printing
said
that 3d printers were going to make
everything right and this isn't true
because 3d printers only print plastic
and not everything can be made out of
plastic i can't even you know
make this beautiful andrew yang out of
plastic right a plastic handle again now
it would be
nowhere near as good as this real cloth
andrew yang at right
um
i gotta peel that
uh
ah
it's not an endorsement of andrew gang i
just have the hat you know
oh thoughts on the rna vaccine um
yeah they look like they work uh there
was there's some really cool things
uh i i linked them in my coronary belt
um some guy reverse engineered the
uh the the vaccine this is actually what
got me rethinking about bio again
um so yeah you can download this
uh doc file it's a
doc file from the world health
organization and it contains
um the whole sequence for the vaccine
you see these things
they're i don't know what greek letter
that is but it's a uh it's a fake
you they did something on it so your
body doesn't attack the foreign mrna
talks about it here yeah
um i don't know again with all
with all new bio things i'm gonna
i'm gonna wait a year uh if i was higher
risk for coronavirus
i would uh i'd probably get it um
but i'll wait a year before i trust that
that was if i was if i was like 55 plus
maybe 45 plus i'd get it
it's the modified stable nucleotide
what's what are these different pipettes
wait are you telling me it can only pipe
at one size
it can only pipette a fixed amount
no why are there different ones
why would anyone want a p20 when you can
get a p1000 for the same price
oh it's different sizes i say
wait is that 15
that's kind of appalling
oh yes you got to discard the tip i was
watching some videos of people doing bio
protocols
i can't believe i can't believe the
amount of pipetting
that's what i said on wax like i'm not
pipetting shit
but now i mean it's like a cnc machine
so i probably have to like carefully
line everything up i mean it is just a
pick and place machine but you know the
problems with pick and place machines
what else do we got oh i got a
thermocycler
temperature module
i can hold my reagents at given
temperatures
oh and then i i see i stick these
modules
so i can does it automatically open and
close
so i can like have it move i can have
the pipettor move the thingy into the
everything you need for ngs library prep
what is ngs
next generation sequencing oh
i see so i can prepare for sequencing so
there's also these uh
uh ion pore sequencing
i'm gonna buy one of these too
yeah nanopore attack i'm moving into a
real apartment where i'm gonna have a
lot of space
to start doing some bio experiments yeah
look i can buy min
ions these guys i'm gonna buy one of
those
it really is this real this thing really
looks like a 3d printer
monolithics on lex friedman comp bio guy
wow he's been on lex friedman a lot
you're following
you guys are great you know i love
having you guys here for bio because
some of you know more about bio than me
they do they really taught biology
terribly in school
before you start with manufacturing tech
do i need a way to verify and test my
experiments yeah once can i buy good
microscopes
there's got to be some good ones now
where i don't have to stick my eye up to
a little stupid thing
and i can use the uh i think the odin
was recommending one
i first want to like replicate these
experiments that they've been doing
um so yeah yeah i bought this
includes pipettes um includes a crisper
kit
biosensors kit
hplc is what i need
is hplc
microphones like chromatography so i
want yeah
there's a few guests i want i want a
chromatography machine
i want a dna sequencer machine and i
want a dna synthesis machine
like this like dna printer machines and
you can buy them
and like they're not that expensive
oh yeah for some reason my ebay is in
mexican no i think it won't because i
cleared everything
yeah check it out what i can buy
i can print my own dna
wait is that the inside of a thing
is it just a fancy pipe heading machine
bio xp
hardly use check video let's see the
video
yeah i know i want to do pcr um that's
apparently
pretty easy like you can buy these
thermocyclers for very cheap
the odin is selling refurbished
thermocycles
you get one no that's the centrifuge
there we got a biorite gene cycle right
i mean it's like a reflow oven you know
we have reflow ovens we have pick and
place machines like we have all this
stuff at work
yeah they charge an arm and leg for the
ink oh it says razor and blades my
all right i can't take that free that
copyright free music
is this just what i really want to
figure out is how these things
work okay so here's my dream
here's my what do you mean why would i
be on a watch list i'm just trying to
synthesize it i'm kidding i'm kidding i
want to you know learn about bio
that's the thing though
um imagine
you could build one of these but
cheap oh come on i used to be i used to
be on their serious watch list they used
to fuck with my electronics when i was
across the border and i'm like
bro like i hack iphones for people
i don't i don't like you know go work
with terrorists who the fuck you think i
am man
oh a thousand viewers sweet
nintendo had me on the watch oh my god
was that even me was bob underscore me
is that what they were trying to say i
don't know
dude i don't care fuck with me man what
do you what do you what do you want what
do you want me to take away my plant
you want a smart water here it got the
feds can come and they can seize my
point two liters of smart water
.25 liters of smart water that's right
come seize my shit bro
i also want to say smart water is um
is the best water all right so let's
figure out how these things work
because imagine we could build one of
these but cheap and imagine we can build
one that produces its own ink
right you just put sugar in you type the
dna sequence you want and you get that
dna sequence out
oh thank you um oh by the way if we got
new people in here please
please check out my music on soundcloud
it's my real dream in life to be a
rapper
uh you know you know so just just go to
my soundcloud it's my real dream in life
um oh my god one of these days like the
government's gonna take this video
they're gonna be like yo
we're coming in here we're checking for
any yeast that can make opiates
oh and i'm like nah they don't make
opius they just make more yeasts
they make like the real dream is a
printer
that can turn software that you can
type out dna in a new programming
language
and then it can make you organisms that
do the stuff
right
make lead out of gold yeah turn gold
into lead
that's playing god hey you know who are
we today who are we today
um all right so you're telling me the
ink is expensive
here we go bio xp oh they have the new
one oh it's got a little
tired of waking weeks for orders let's
chat can i order
do they have a price online i hate when
they don't have prices online
oh this is probably one of those things
yeah you gotta contact do i need like a
synthetic genomes services build
jeans what are clones when people say
build clones i'm thinking like well
marijuana clippings
codex dna provides the industry-leading
turnaround time at an unbelievable price
per base pair
no but this is
i want to buy the little box all right
here we go let's check out the user
guide
for this thing so there's one of these
on ebay
you know what else this on ebay was
super expensive charizards and i'm like
i got a charizard somewhere
ah all right here we go
blah blah blah blah blah control your
time okay okay okay boring boring boy
this is like okay here's the user guide
anything good
this is so useless
no but like mean time between failure
imagine you've had a printer that could
print 500 pages
that's what this shit is
supports applications from building
cloning and amplifying gene fragments
and they don't make errors much that's
cool
wait so this actually looks like i can
buy a dna printer
but then i like look at the thing and
i'm like it looks like like
i've seen kind of how these things work
um
let's see is there is there a chapter in
my in my textbook about this
analyzing cells
those current methods rely on prior
knowledge of the nucleotide sequence
really
is that right oh most current methods of
manipulating i say
bio is the ultimate legacy code base you
see one of the problems i have with bio
is whenever i'm reverse engineering some
computer thing i know that i'm probably
smarter than the guy who built that
uh you know i don't think i'm smarter
than god
dna columns are corresponding to a
sequence of mrna molecules are the same
except that a dna copy of the mrna
sequence called
cdna is first made
dna clones lack intron sequences
so this is all just like you know
linking and copy and paste
crap it's a dna
library
how do i lace a cell
oh i put them in a blender i get it
cells blind blend
what is heating within a sample
don't want to denature my proteins
see it's like this kind of stuff you
know i took organic chemistry in college
because i wanted to learn
like lab techniques for organic
chemistry and instead i had to memorize
a lot of naming and i dropped organic
chemistry
because it was clear that they weren't
going to teach me anything cool for a
year
or useful remotely useful who cares what
it's called just look at the picture man
if i need to figure out which one's the
two or which one's the four
you know what is this like some like so
like hazing
are they hazing people before you get to
learn
um yeah
is that cmu i took organic chemistry i
guess it was it was it or was it at rit
cmu
the thing about patent infringement is
you know we're gonna come to my lab and
sequence my dna nobody fuck off your
patents
magnetic particle imaging we gotta order
food soon too
i don't know about this
c isn't exactly crispr is more like you
know
ld preload
the whole biology is built around plant
predator
there has to be a better way to do all
this
you know this makes me question the
whole thing imagine like instead of
having linkers you just like you
manually went into a hex editor every
time you wanted to like
you know link a binary how much of
software do you think would work then
and then you of course have to do this
every time it's not like you link the
software and then
copy it the software sent around
unlinked
i don't even know what i'm looking for
here we're trying to figure out how dna
printers work
i'm pretty sure they're
so
i've seen these too i've seen these for
sale on ebay
yeah check it out look what i can
buy oh i want one
dna rna synthesizer
yeah so i think the inks is the ink
really actually expensive like this
thing looks so
fancy but like then you look at it and
it's like
the ronnos just built a shitty pipetting
machine
i know what the edison was go
can i buy the name theranos how much is
the rights to the name theranos if i
started a bio company i'd love to name
it torontos
um
what's an oligo anyway
all i go to
synthesis more specifically solid phase
chemical synthesis
the chain grows in the three to five
direction so that's backwards
it's desalted or sometimes even purified
desalting and algo removes the salts
just so this process
see that's a crappy number of bases i
don't want that many bases i want a lot
of bases
um
so they made a synthetic bacteria
like
we don't need to go that far i think
let's just look at like
um let's go to the odin and then look at
whatever they're including
like i want to be able to print the
things that go in without having to buy
them
oh they have a frog kit too oh let's
look at that
yeast transformation kit yeah
with a plasmid that you provide it
doesn't include the plasmid
so we learned what plasmids were last
time
p glow
okay so that's about that's that's like
you know multiplied by two so it's 10k
of code
very reasonable very reasonable you know
my printer should be able to print out
10k of code
i watched the thor import thought
emporium video
uh no this is not what i want
we want to figure out why but how long
can these ones synthesize
synthesis length
1.8 kilobases right
all right we're just gonna have to you
know what i'm not gonna translate these
into kilobytes
we just need a name for because the
biology bit is for
uh s4 but it has a lot of redundancy in
it
let's just work it out so if there's 20
amino acids
and there's 64 codons coding for it
every three codes for 20.
um
there are three bits codes for 20.
when it can code for up to 64.
normally every three bits can only code
for eight
what is a scam
um all right you know what let's just
say with compression let's just call it
513k
okay
can produce 31 fragments
ranging from
well yeah covers 10 kilobytes pairs no
it's just bigger than that
chromovirus is a lot like 30.
yo yo yo we're not trying to print any
viruses we're not trying to print any
drugs man don't do that shit man
uh we're trying to we're trying to use
biology in order to
make sick people healthy that sounds
nice oh
look at this one this one can do 7 000
base pairs
we don't want a new design from scratch
tna and rna so much effort's been put
into this system
no
only the crappy old ones for sale
maximum dna length is 7 000 base pairs
that's pretty good
oh it came out this year wow this stuff
is like finally possible
get a fucking quote i hate that they're
in san diego
let's go visit them well by qualcomm
that's where our new office is gonna be
see i love that everyone i love that all
the bio people are just in san diego
i know
so you can print the right number of
kilobytes then the question is how much
pipetting do i have to do
in order to actually turn it into a
plasmid
you know
oh let's uh let's order some food what
do you think
what kind of food we want boys
i know ooh
tandoori hot is sponsored or high pokey
pop pico well fried chicken oh yeah some
tendees that sounds great
chicken tenders we'll search for tenders
and see what we get
buffalo wild wings roost republic
mr beast burger how to do mr beast is
franchising out
wow that's these are really bad ratings
roost republic has the highest rating
no look guys i'm not joking about mr b's
burger
here mr beast burger
make food on your own fuck that
you remember my cooking stream
oh lefty chicago pizza well they know
what i really want
no eight spicy roost tenders
eight crispy roost tenders
no i don't want any sauce get some fries
too
wild wedges all right we're going with
the roost republic
hate crispy roost tenders oh they'll be
here in no time
that's great
place order let's go add funds ugh
apple pay
confirm
you wish you lived by the website right
no i'm telling you
san diego is the place to be for this
stuff
what's the melodrone saying i wasn't
tending to the smiley face fresh
we got some chicken tenders coming and
some fries i'm gonna be good
oh my god all right all right great yup
yup yup yup
oh benchtop reagents
see they're not going to sell the
machines though they just want to sell
you a service
32 genovo dna fragments in parallel
wait oh with the option to stitch
together
four fragments i see
oh the system can assemble them to user
supplied proprietary vectors
only circle amplification amplification
of the assembled construct on a
microgram scale
providing a direct path from assembly to
assay
oh that's what i'm talking about
should i just buy this one
should i buy the one on ebay
where are they well they're in texas
i wish they were in san diego go visit
them
oh there's one on ebay version for 17
grand
all in an overnight run the future
evolution of this yeah i had a prince
overnight same as a comma
yes this is like half a bitcoin
perfect for my smallpox project has a
number of early access customers
who are helping us drive the evolution
of the key applications
by learning my exes live in texas like
george strait
based on their real world challenges
each biosp is connected to the internet
which allows our engineers to promote in
to either the fuck why
i don't want my thing connected to the
cloud i'm out on the cloud
oh they're running a model like juicero
i get it this is this is the juicero of
dna prints
i was like how come i can't buy the ink
oh
and well the optimized protocol from the
cloud
wait wait it's a total scam
it's it's like it's like zortrax but
instead of getting the software you
upload the thing to them
yeah but the problem with the labs is
you know they're going to be like why do
you want this
they're going to ask questions
they're going to contact us for pricing
when i get my dna should i open source
it is there any reason not to
further efficiency is to accelerate
genomic discovery
sgi and dna
but really these companies raise no
money we should be giving these people
money instead of the sell trade instead
of like cruise automation which just
throws it away
can we talk about what's wrong with
google for a second
wait that was a totally different set of
results than what i just got
i just got a whole set of stupid news
articles
the system cost just under
just under yeah yeah but it's not the
price it seems like their whole business
model
and make a positive impact in the world
but ugh you have to make a positive
impact on the world amount why do
companies say shit like that
trust me if you buy a coma too i don't
care if you're making a positive impact
in the world or not i'm gonna shit what
you're doing
killabaser.com
wait oh
yeah but all the ghosts sound like small
so they just call it the kill baser
which makes me think you can do one
kilometer
reagent cartridge holding materials for
bases the fuck
50 euro cents per bite
the scam oh my god the egg this is so
this is so expensive
[Music]
okay but this does make me think that
these things are not that hard to build
right if we could just get around like
okay serious talk you know what i want
my yeast to synthesize i want my yeast
to synthesize the reagents
for my dna sequencing right and i got
just like the aes the g's
the the uh t he's the c yeast and
they're all making me
making me little reagents and it's a
printer that makes its own ink and i
just dump in sugar
you know you can paste oligos together
yeah yeah that's i see this
um
like why is this why is this like like
like
marketed to retards you know
anyone who's buying this machine
it's chibios
yeah we should probably we should
probably use a real-time operating
system for the panda
um
can i buy the refills though
what's the best stuff you can currently
buy
yeah well that's what i want
kilobaser how many you don't even tell
me how many base pairs
base pair
no that's obviously not what i meant
stupid google hammer wouldn't have done
better there though
here we go
um our reagent cartridge holds reagents
for
200 dna bases it can be used for up to
two weeks after
activation
and costs 15 000 euros
oh they're in austria eh
that's better can be operated without an
internet connection
i know i can outsource my projects to a
biology lab but
have you seen me look look look at the
comment too have you seen the color too
the case is 3d printed the case is 3d
printed in-house because i hate
outsourcing look at the 3d print
i don't want to outsource i don't want
other people to control my future i want
to control my own destiny
it's like 500 a kilo i know
okay let's look up let's look up what
these reagents are
i wanna i wanna i wanna get refills
yeah look at this i can buy refills
oh includes the following base
protection
it's just like is this like when they
try to sell you the gas with the stuff
that protects your engine
god damn it
oh it's the empty
wait is this actually is it the same dmt
no it's not the same dmt
you don't even have to print the dmt
wait
dmt synthesis i think this one's
actually really easy
psychonaut wiki perfect
wait is my food here no where's my
chicken
it's my chicken this guy's riding a
bicycle
[Music]
um
okay can i not get can i not get scam
drug websites we got to figure out
chemical synthesis of dna
oligonucleotides
does oligo just mean short
oligomers eh
small bits of nucleic acids can be
manufactured molecules
the maximum length hardly exceeds 200
nucleotide residues
how is that thing printing 1800
alago means many but not as many as
poly i get it yeah i can buy yeast look
i can get some yeast off i can get some
yeasts from the supermarket
this biox piecing work differently
though
you know what the real troll would be
it's like juicero where the machine
doesn't do anything
they just print them
well yeah like they sell you a module
i don't even think this machine's a dna
printer
it's like the juicero doesn't make juice
it's altered department ah
no
yeah probably worth watching
all right here we go
i think that that one i think this is
this thing's a scam
i know that they made a synthetic
bacteria
craig venter where's that guy
it was like a shittiest bacteria too
what was craig venter doing right now
i'm trying to live forever i see
ah they live in la jolla and he's an
atheist
he has adhd oh and he believes in adhd
that's too bad
i have adhd but i don't believe in it so
it doesn't affect me
we haven't heard about them for a while
how do they synthesize it
blue heron
this is the company they did all right
so these people are making things yeah
so kilobase is probably can actually do
a killer base i think no but then we saw
what a scam their
stupid cartridges that only prints 200
characters is
where's the please note the logo will
change soon would you see that
sorry single use fluidic chip
yield 300 pulse
inline triddle sensor
what's a triple sensor
i don't think these things are real
i need argon or nitrogen
affordable price makes it accessible
look at that that's so crappy it's a 24
it's only 24 base pairs i was promised
to kill a base
ah i'm going to build this but instead
of any lab professional it's going to be
any rando to create dna and i'm going to
get rid of the word empowers and i'm
going to use the word let's
[Music]
anything honking from my food
oh no the guy's on a bike he doesn't
have a horn
base are probably the cheapest reagent
so is it more expensive reagents
how is bio xp getting more
uh oh yeah because the scam you have to
send it out
yeah i'm coming there get my poop i'll
be back
okay
oh yeah boys we got
chicken
[Applause]
yeah buddy oh these look good
great choice america's choice to get
chicken tenders
was a great one i'll even include a
napkin
fries oh
tenders and fries
all right so
i kind of think this thing is a scam
it's juicero this is actually juicero
so
enter your dna sequence using the
touchscreen
wait seriously though
i don't want sauce okay i don't like
sauce
some people like sauce i don't thank you
i'm glad you like the new song
um
wait all right so
this was the company that made all the
uh we've got to figure out what machine
they're using
non-complex sheets under 2.7 kilobases
all it goes again
what's a non-complex sequence oh yeah
there's actually something called dna
chisel in python
how cool is that
i'm going to start that they talk about
it in the uh
reverse engineering blog posts
ah complex sequence include
is that supposed to be the word
stretches
god
i know you got i know you people think
like you know george you're so arrogant
for thinking you know anything about
biology
well like i know what it's called
stretches
um
since genestones are assembled using dna
oligos oh i get
2.5 minutes per base
and you have to fucking stitch them
together this shit's insane
there has to be a better way
here's how all dna synthesis works
why don't we look up the um
well
i'm not trying to do no finer place yet
like okay so when we look at that what
was that thing called p
glow okay so this is a this is a plasmid
like instead i like to just be able to
print that
if i could print my own plasmids and
then stick them and stuff
that'd be sick
no i'm not putting any weird shit in my
body
if i make legal drugs using my stuff
i will check it on a mass spectrometer
first
lab x dna synthesizers
hmm
they really just make all of those and
stitch them together
at least they have a price
no this one's the best one i mean if you
accept that all you're making is all of
those and those bio
big ones are a scam
i also look at these people's manual and
i trust them
i'm not sure why but there's something
about this system that seems like it's
not a scam
insertion of a dna sequence inside a
plasmid
i need to have a talk with him oh i can
buy a kilogram of this shit
buy a kilogram of each base pair
yeah it looks like fuck you if you don't
know how to work that's right
the scales so wow look they're like
talking about reasonable things
there are six reservoirs that may be
used for antidotes
i can get specials
yeah this is the only one of these
that's real
it's a liquid gal boil off system
is how i get liquid nitrogen i mean i
guess i can get liquid nitrogen by just
compressing air nitrogen is gonna freeze
a lot quicker
oxygen co2 and ship wait now co2 is
going to
co2 is dry ice
there's not that much sugar
nitrogen maker
how sweet is this
if i want nitrogen i just have to buy a
nitrogen maker
man i love i love china
look i just tell you right away high
purity nitrogen gas generator making
machine
can i buy an oxygen making machine
um no i don't believe in this
because this one tells me how pure my
nitrogen is
95 oh
oh i can make
no i have to have manganese dioxide and
hydrogen peroxide i want to put
electricity
and sugar in and i want to get out
anything i want
i kind of want one of these though okay
still i was looking before
during chronovirus and you couldn't buy
any of them
because everyone was freaking out
another battery
30 to 90
i could set up an oxygen bar
why would twitch block i want candies
right fucking now
these um well
all i know is because there's no hype
around making nitrogen
they're probably banned in california
no i don't like that one it tells me
what it's for this one's better it
doesn't tell you what it's for
it just tells you what it does
oh my god wait a second
99.999
99.998
all right we've eaten too many tenders
do you have like the nitrogen making
machine for more pure nitrogen
i feel like all this thing does is
pipetting
um
oh my god that's never gonna fit in my
apartment
minimum
cpg for synthesis
if using the fritted plates oh
do you want to use the fritter plates or
not
these things really seem as crappy as 3d
printers
oh the attendees camp in california
so i want parker nitrogen generators
you know i have to buy synthesis fritted
plates
deep well plates
peter pipette what's a cpg
i kind of feel that all these things do
is like if you want an a they pipet in
the a
look at that old dell monitor
no i can have windows 98 windows me
windows nt 4.0
where's newark california i kind of feel
like this company doesn't exist anymore
they were too honest in their marketing
material
ew it's up there
hmm
check out the visual basic ui
loading oligos so this one like
synthesizes a whole bunch at once
this is really the best way to do this
and then they just stitch them together
that's so shitty
[Music]
here's the gibson assembly method
great codex dna i've seen codex dna
they make bio shits
daniel who was what is he doing now
are we still the cto
it requires the dna fragments contain 20
to 40 base pair overlaps with adjacent
dna fragments
dna fragments are mixed with a cocktail
three enzymes along with other
all this just looks like a lot of
pipetting
that's who i googled before no
i googled venter but oh yeah i googled
daniel gibson i got the
the the baseball player basketball
player some sports ball
um
so
synthesized 236 genome segments
that doesn't seem like too many
uh
we were unable to obtain them from
commercial dna suppliers
because they're complex to synthesize
sequence which facilitate
chemical synthesis everyone seems to be
using chemical synthesis
endonuclease restriction
oh i see that was the sequence they
couldn't use
because the restriction enzyme they're
using in assembly that makes sense
i don't know i don't know how much about
that stuff we're trying to figure out
what what
what good sequencer i can buy for cheap
you know so we can make
we can make plasmids in our room
but did they make these bacterias work
or not
here we go materials and methods that's
what i'm interested in
pim master shaft thank you for gifting
subs
you know if you gift a sub you get to
ask one question
genome partitioner algorithm a
order from two commercial suppliers
why don't you tell me the commercial
suppliers
can we summarize methods and caveats so
perfect i love cookies
ability to read dna is better than to
write it
petabases yeah
could i pass a high school physics exam
i think so you can give me a high school
physics question i'll try to solve it
for you
but you're just a subscriber you can
gift us up gift the sub and i'll solve
your physics question
by the way i really appreciate you if
you subscribe and i don't appreciate you
if you don't subscribe
that's just how it is you see
the beauty of smart water is it has
purely balanced
ph
how many streams of income do i have
whenever i need money i just look under
the bed
scam water what do you mean look i drink
this water
and i show that i'm more rich than
people who are drinking other cheaper
water
cram that graham thank you for gifting a
sub
would you like to ask a question
i don't have any green tea here i'm
moving to a new apartment where to build
my bio lab
kepler equations for like orbital
mechanics or high school physics adapter
google
um
or if you let me use python i might be
able to drive orbital mechanics
but i need python and i need something
to do like differentiation for me and
shit
wait monster hunter unite did i miss any
questions
i told her she could live with me if she
needed to i got a compound
did i miss questions from gifters
nadi odin are you a gifter oh what can
we repeat a gift or question
monster hunter unite do i think ross
albrecht should get a pardon
um
well i'd have to look more into the case
if the case were just for drug shit then
yes
um if the
if they have a reasonable case for uh
uh murderer for hire then no but i
believe the government didn't try that
case they just tried the drum case so
yeah pardon me
ross albrecht russ albrecht saved lives
you know think of how many people bought
some like sketch shit on the streets and
now didn't buy it on the streets
they bought it on a nice safe internet
website where violence is impossible
what is lagrange's constant i don't know
you're not even a subscriber you don't
get a question did i miss any other
subscriber questions
i was like the velocity you need to stay
in orbit at an altitude of 150
miles um
450 miles from the earth yeah i could
probably do that
i mean all i would have to do is figure
out i just have to figure out the
acceleration
uh and then i could work out the
centripetal yeah i could do that
oh pimp master shaft do you use graphql
for your apis no
i don't know i know what it is
i'm gonna use it
yeah universal gravitation i have to
look i don't know big g
off the top of my head
but yeah the mass of the earth out the
distance
um okay ooh perfect oh yes
column synthesized oligos
how do they figure out g
i mean you can't figure it out if you
know like
i guess that's how i figured out the
mass of the earth
the line's so blurry
[Applause]
all that goes in because has a long
nester
do
we can do a music i can live stream
sometime
i can stop eating these fries
um almost all goes
yeah yeah i've definitely read this
before
array based
um
light activated chemistry is interesting
ah it's easy it's shit like this yeah
you know that was one of my early
projects hacking dlp
harvested
oh this is exciting oh these are such
good papers
all those producers from microarrays are
three to fours
oh now we're getting into good prices
okay small sets of oligos provide the
raw substrate for constructing
larger synthetic fragments a variety of
methods collectively determined
gene says this the first synthetic genes
were short
cobined coppers used t4 dna ligase
to seal chemically synthesized oligos
together
in litigation based ligation based
approaches
um all right so it really seems like all
they do is make oligos and then stick
them together
did they not say here how long it goes
are
okay 200 200 makes sense because that's
exactly what the cartridge they were
selling on
on kilobaser i really think those bio
ones are scam and
it's just uh juicero
so they sell you the machine for cheap
oh my god and then
material for 200 bases 50 cents a base
pair that's pathetic
well they're trying to sell based on
privacy
anything useful from the links earlier
in chat i don't know let's see them
look stupid
[Music]
why are you guys doing numbers
hey guys the second we get popular it's
over
the second we get popular and there's
some like hit piece and business insider
about me
i'm never streaming again that's right
take that business insider
one bite of candy one bite one bite
that's right
not pretty good
and that's why we use azure microsoft
would never cancel maybe this
they disagree with my views right oh
i don't know
[Music]
but
what i'll do with my power once i get
verified slide into the dms with that
check mark you know
oh well who doesn't suck
i'll switch to whoever doesn't suck
who's dms i don't know does taylor swift
have dms
um
nah i just want to hang out i had a
dream one night that
i was sitting in an apartment in mexico
city and it was completely empty
and it was just me and taylor swift
sitting on the floor
and i never felt so seen
i've never met i've never met bailey
swift
no we were sitting honestly we were
sitting it was like it was like the
final scene
in uh adventureland but like
without the you know the the the the
embrace
it was just sitting and being understood
what having a small this is small oh no
no
it's amazing that this thing works i
have so many windows open
oh yeah all right special special just
for you guys
on the uh on the twitch all right so
this is this is this is the song that i
like actually worked hard on
but i did retweet something i made six
years ago it's called auto swedish fish
i don't think taylor dreams about me i'm
okay with that though i'm not trying to
be creepy or anything man
[Music]
this was my attempt at cloud wrap
tom cruise
that's a good name
[Music]
last week
[Music]
by the way this is completely copyright
me so you don't have to block this out
just just just listen to this
[Music]
now i can buy myself a trampoline
[Laughter]
um no but i can actually rap did you put
up a fight
magnesium packed pre-rolls in the bag
when the light comes tell me who's
holding the bag
i see it it's sad rage screaming it pads
big teams and their mind melters work
just like their dads another thing to
move past whiplash marine tone
tags and ankle monitors with harmonicas
in good with the phonics a big bash for
the new god they claim to be so taller
and disagree and they're all frogs
so don't worry it's not all it's not all
auto swedish fish
hmm
album
i don't think the portals for me
it's bad enough i did that stupid south
by southwest talk and now i get emails
from people it's like
bro i feel like we're on the same
harmonic wavelength i totally want to
jailbreak the simulation
too did you ever try five meow dmt
yo i went down to peru and i licked a
toad and i saw the truth about the
universe
you know those kind of people
to alex jones you guys have heard my
alex jones impression
i hear about facebook and my dog google
has cia conspiracy
and that's why you gotta buy a product
because when they come for you man
you're gonna have superman vitality and
you're gonna have
you know you know big muscles and you're
gonna you're gonna you can fight to
fight the global fight the deep state
man fight the
fight the you know the the cia mk ultra
they're coming into your they're coming
into your brain man you know we got we
got documents man we got proof you're
just gonna find out right after this ad
for
for for for ultimate male vitality
enhancement it makes your dick this much
bigger think of how much deeper you
could go it's this much bigger man the
cia won't know what they're fucking with
if you gotta dick
okay frogs
i think the botanist just could beat me
at chess when she said she's going to
2000.
she'll meet him pretty badly all right
i've listened to some of the portal um
some of the some of the episodes are
good i don't think it's for me you know
i'm not i'm not like
i'm not like peter thiel uh
i'm not a conservative i'm a progressive
and i don't mean that in the political
sense
uh i mean it in the sense that maybe i'm
a
like
you know you read the uh unibar
manifesto it's very conservative
right he has a conservative idea we
should we should smash the
technological industrial state
and go back to a state of nature this is
a fundamentally conservative idea
maybe the progressive idea is more think
like accelerationism right
um i like you know always be a
progressive if someone ever asks like
i'm a progressive man
you know just progressive it sounds good
and just like do you believe in progress
yeah i'm progressive man
you know i just wonder when everyone
woke up one day and decided that
politics was something to take capital s
seriously
um no and i i do think i do think uh at
least what i've seen in peter though
it's it's
like conservative uh
you know i think i think neo-reaction is
a progressive ideology
it'll become a sub if i take this iq
test i'm gonna take an iq test
uh i did watch canon yeah
control with the business insider
wait there's no fucking way that's a
real link that's funny
i bought some tickets to come see my
downfall they sold out in minutes i had
friends in the front row to leave when
i'm finished
in lights when my name's gone but the
ones that gas you up only come around
when the flame's on
i've been reading unqualified
reservations
that's a machine gun kelly man it's not
my bars
all right we're really we're really
getting distracted here
we can make 500 200 base pair oligos
george is losing it oh my god
yo no if i make a drake diss track i was
thinking about i was thinking about it
over break and like
my bars just need to be so tight you
know what i mean
and i gotta sound good i need to hire a
producer if i want to make a drake diss
track
you know what i think it is meditation
time i agree with that i was started
meditating this morning and then i got
distracted
good point
and again it's very soft with the voice
of your mind
and rather than try to approach the
breath
as though from a point outside it
just let it appear in the space of
awareness
you don't need to lean into it
or attempt to get closer to it
just receive it
and as with the breath so too with other
sensations and sounds
just let them appear on their own
notice that they do in fact appear all
on their own
and by appearing they articulate
this space of consciousness
just rest as that space
all right i feel calm
so this paper's really good
foreign
all right oh i have to start obs now and
let's summarize what we learned
what happened to the coronary thought
produce oligos
of
around 200 base pairs
uh no i got a
i got a cloth mask now i decided to stop
caring about the fact that they probably
develop micro mold and make you more
sick that's a whole lot more comfortable
you know so it also has the added
advantage if it does nothing
so yeah
this is this is me you know
giving up on that crap uh
you know you can you could you only have
so much political capital in the world
you gotta pick your battles when
everyone around you
is acting like morons you know sometimes
you just gotta
like act like a moron too like it's all
right
you know and you gotta you gotta choose
your battles man you gotta choose your
battles
that's right oh my god the war against
the model party
you know right winger is how you think
the left wing is deluded and believes
dumb shit
i mean that's true
i've got news for you guys
a too worried about kona virus i think i
already had it
choose writer you'll get censored even
this is like a
you know oh my god like right when
people go on free speech free speech
have you ever tried to moderate anything
like people in the common discord are
like you can't kick me out i have free
speech
what's the xkcd about that
you know did the government take your
rights or did some dudes say you were an
asshole and kick you out of his private
community
now i'm certainly not cloth masks
i'm i'm still very confident cloth masks
do nothing
but again you gotta choose your battles
man
you gotta choose your battles
surgical masks are better than cloth
masks
uh still likely to be useless but i'm
not as confident about that
so they have 90 confidence and cloth
masks being useless
fifty percent in surgical masks being
useless
and then once you get 1095 p100s
ninety percent confidence in p100s being
useful
all right but then all the people oh my
god wait can we just can we just make
fun of some commenters i love making fun
of comments
i thought i meditated i thought i was
calm i thought we weren't going to do
this shit like make fun of commenters
oh you know oh my god no you know what i
was thinking i read some comments it's
one of those comments like
you have to pay attention to how you use
your voice you shouldn't use your voice
like that bro
do i come to your house and tell you how
to use your lawnmower
do i tell you about like you know how
you shouldn't be mowing the lawn that
close to the flowers no because it's not
my lawnmower it's your lawnmower
but caring about other people means
wearing a mask
there's evidence to support that
all right all right there's evidence to
support that caring about other people
means wearing a mask
that's right there's evidence evidence
they say evidence
what a fucking absolute idiot i have
never seen someone more self-centered
fuck all you stand for
this guy likes lies
and tyranny yeah because i stand for
truth and freedom
um
i miss bagel gourmet too
i miss bagel gourmet too
john mcafee 2.0 yo i have never done
bath salts
and i've never killed my neighbor real
talk
i want to get rich like him and bang it
thanks bro it's pretty cool
i have heard this this is good to know
yeah genius responsible pfizer vaccine
they're great people the nba guys that
modern
astrazeneca you can tell by their papers
too
be careful what you say buddy business
insider is gonna come for you
hmm
i don't know i don't know why people get
chills guys two plus two equals five
two plus two equals five come on you
know it's true man
it's true you know all those all those
people trying to tell you that two plus
two equals four it's lies man two plus
two equals five are we going to get
commenters we're gonna come in and say
no but we know two plus two equals four
and here's the paper to prove it
not as a radio
uh yeah oh jordan lucas he did
uh there's on the there's no kamikaze
uh i got a couple of mansions still i
don't have any manners
you got a couple of ghost writers but to
you it don't actually matter
oh i should use my voice more
responsibly that's a good point that's a
good point you should use your lawnmower
more responsibly don't run over the
neighbor's dog with your lawnmower
bro as long as i'm not your neighbor you
do
you do you man you do you freedom
the particles of the virus are a
thousand times more in the capsule of
mass
yeah no shit
two times three equals chicken yo
all right now we're really we're really
you know i ate that i ate the chicken
tenders it's like fucking with my hat
man
should have gotten healthier food
oh my god how many people argue about
fucking masks
oh guys masks work i was wrong
uh they are very important show how much
you care wear a mask today
is that better
what's that old saying uh if you find
yourself in soviet russia
and stalin's your leader
you can't say bad things about stalin
you can't say we should have
zero stones right but you can say things
like
we should have fifty stalin's yeah
yeah we should have stalin is so great
we should have fifty stalin's there
should be a stalin in every neighborhood
for the apology george
let's see let's see here how am i going
to respond to my my business insider
article
um i'm very sorry to all the people i
offended
uh uh
you know uh
it's very bad what i did
i shouldn't have done it it's the
current year
and i've grown a lot
since i did bad thing x
uh i'm prostrating myself in front of
this
struggle session so that you guys can
uh correct my bad
behavior and shun
or allow me back into society as you see
fit
i am at the mercy of this court
of public opinion
[Laughter]
oh i made a severe and continuous lapse
in my judgment
and i don't expect to be forgiven
you know what the sad thing is you can't
apologize anymore when you're actually
sorry
yo shit's funny man these are
unprecedented times oh
freaky odds
i don't know i just i just i just i just
can't today
i just i just can't it's it's so hard to
take the like
i don't know if people just get single
boosted who take like all the wacko shit
seriously you know
what is there more wacko shit in the
world than ever before do we just see it
more
probably just see it more gotta go back
to when we're only seven
tv networks
i represent you do i i don't represent
you was i elected
no do you pay me money not you you're
not a subscriber
i do represent the subscribers if you
were a subscriber in saying that
your voice would have more worth
i love new taylor swift songs evermore
is an incredible album
uh we were like the mall before the
internet
it was the one place to be mischief
gift wrapped suburban dreams
well that's the problem i read this
thing which is like
you don't get how like
one percent of the people are like
90 of the comments on the internet uh
and like what do you do about that
no like you know whatever whenever
whenever i get called you know i love
getting telemarketer calls i'll tell
marketer calls
uh you know i like that i like to like
ask these people about like you know
their life and like whether
you know when you were like do you
remember being six who do you have what
do you have in first grade
you know you really like build up some
empathy with the person so you're six
and you know your first grade teacher
let's say mrs whitlock you know ms
whitlock asks you hey what do you want
to be when you grow up
did you say you know spam caller did you
say a telemarketer is that what you said
oh you wanted to be a basketball player
what happened to that dream man
no i'm trying to i'm trying i'm trying
i'm trying i'm trying to help you out
here you know
put this phone down quit this job grab a
ball go down to your local basketball
court let's play some ball you know
i'm trying to help you out i'm trying to
make you achieve your dreams
what did i want to be i want to be a
computer programmer
all right i gotta close you guys you
guys are too distracting
some of us are trying to study here
that's a unit
how many milliliters
oh how do you know this shit's even real
and they're not just sending you
water
high stringency ligation based synthesis
reduce error rates
because sequences with errors are less
likely to hybridize and like it
what's pca
pca based polymerase cycling assembly
use polymerase to extend overlapping all
it goes into a double-stranded fragment
by
cycling in a non-exponential process
both ligation and pca rely on pcr
amplify full length
hybridization based air filtration
better assembly techniques exist for
larger assemblies
pure amplification decreased the
concentration of the logos before
assembly
error corrected them by hybridization to
reverse complementary oligo so that's
clever
look at what they did they made both
sides and they stuck them together
and designed protein sequences
computationally to avoid this
hybridization so the sequences okay
that's great
this is like when you gotta encode your
shell code man
you know you gotta encode your shell
code gotta make sure your shell code
doesn't have too many null bytes in it
what's sand your sequencing
sander
i should have like looked at all these
before these names just don't stick with
me
comparison reported our grades
are correcting techniques ooh erase
[Music]
see this is my dream
wow
all right so the best thing we can get
huh
all those are up to 170 bases in length
we don't like special orders but you see
yeah
i mean the problem is all of these
percents multiply that thing about 13
makes a lot of sense
fully synthetic yeast genome
hmm
hmm
well let's have 20 base pairs
that's huge terabytes wow it's okay it's
really easy to get a dna sequence that
no one's ever made before
but it would make sense to a lot of them
you know that's probably stupid
like how much does this stuff compress
is kind of the question
butterfry maximum
compression of human
can genome tell me how big it is
i'll probably beat this with a uh here
we go
transformer on human genome
do they can they just tell me
400 to 1.
400 from what
one base is encoded with up to 1.3 bit
why isn't it two
i don't know why would anyone like do
this stuff by hand
just as long as i think of all the books
right on chess openings you know
all right so what's the name of that
stupid process that assembles them
which is named after some dude
there's something like to put them
together
no um i'll
go assembly into
i'm gonna check the chat you guys
remember what it was called we were
looking at it before
dna is not the future of d of of data
storage because it costs
10 cents to write
oh we got slow mode oh because you fucks
are talking about politics yo
don't talk about you know you know my
position oh my god i can't believe i
open chat i'm drawn back into this shit
if you want to talk about politics talk
about politics
circa you know 1900
don't talk about the names of any of
those you know
people lizards
um
i was asking you guys a question you
don't even know it
oh wow merge chance info open pilot
wow
damn we do well
i like that hey if someone makes a pull
request to open pilot
with that badge at the bottom of
openpilot i'll merge it
god like yeah i really i don't want to
talk about voldemort's rise to power
uh it's much more interesting talk about
you know the history of
of dark wizards the methods they use
or the inventor of the avoda cadaver
curse
you know
well i have been researching
what it felt like to live through the
late 80s and early 90s in russia
all right so this design is the aligors
all right bye bye chat you guys are
terrible
ah gibson assembly
yo wants to hack the gibson
you know um mine
let's go with 170 let's say we have 20
base per overlap so let's say 150 times
15.
okay
hmm all right this is interesting
see if any of these things actually work
major stakeholders fucking loser biotech
companies that's kind of a problem
you know because they're not going
consumer
see we'll open chat back up for this one
just imagine making
consumer biotech
like instead of trying to sell to labs
or sell to experimenters or like
you know okay the people make the dna
sync sequencing machines are like
or like the tier ones right
you know they thought who thought it
could be done for self-driving cars but
you know we're out here we're doing it
and do the comment and it's comma dot
bio it really is
um you know thoranos was a scam and made
technology that didn't work and
partnered with a lot of companies i'm
gonna partner with nobody
and sell you thousand dollar dna
printers
you see what i'm saying
one thousand dollars by uh
we can't call them comma i can't call
them comma one comma two what are we
gonna call
it one slow-mo you can remove slow mode
are people spamming
i don't know you can make whatever you
want
why go to the store and buy a moxel buy
buy penicillin when i could just modify
some yeast to make it
for people spamming if people are
spamming maybe slow more comes back
what's a deliverable intermediary for
toronto it's nothing because they were a
scam
it makes you a little box that can print
dna
and we're going to sell to everybody at
a low price just because we can
why are there so many normies in chat no
it's already getting ruined we don't
even need business insider to ruin it do
you mean
what the deal he's not da's not going to
have a problem with that he's kidding
about that no
i could use to make drugs just just
penicillin that's right
only legal drugs will upload all the dna
sequences to the cloud
and check to make sure that they don't
produce illegal drugs
oh life after google i don't know
there's a book
um the fall of big data and the rise of
the blockchain economy
uh no no
let's read the reviews though the shape
of things to come
google marxism oh my god
don't judge a book by its cover but you
can certainly judge one by its title
probably halfway through he's trying to
shield for you to buy chain link
buy some link bro buy some link
i'll sweet merchants uh i have where's
that i'm where's how i go to work
i'm not at work now
um all right microchip based
light directed
um
they my tiny crappy oligos eh
synthons
um genitalia
it's actually an std
i can't believe it this is actually this
is actually how they make these things
i mean the only one who sees san
francisco and thinks that place is
disgusting
i'm grossed out by like the place like i
just look at it and i'm like oh my god
what what what would like you know
it's like remember like you went to like
a house to party at in the 80s
like it was this shit in the 80s and
people were doing cocaine on silver
plates in the bathroom and then you like
go back there now you're like
oh my god
it was giving you the urban stream urban
stream coming
who still desires going to silicon
valley i'm sorry but some people
destroyed it man
no not more of that to come everywhere
san francisco is an incredibly corrupt
city uh run by terrible people
who you know these problems have existed
throughout history
it's just san francisco had a lot of
wealth these problems have always come
to places with wealth
trust me skokie illinois is not going to
have these problems
skokie eh yo i think i almost went to a
party in skokie once you know that was
gary indiana
oh this is getting slow oh my computer's
finally getting slow
i'm using all my eight gigabytes of ram
gotta close some of my 30 bajillion
windows
oh oh no i got to close some windows
there's too many windows boys
oh i need 16 gigs of ram buy a new
macbook
16 gigs i had a lot of windows open
it's fast again
i usually use safari but i don't clear
the history of safari i only clear the
history of chrome for streaming
oh my god see they get acquired
oh god it's all such scams
i'm gonna make oscilloscopes
to
you got him please you get him
hey hey i'm rooting for the police man i
go get the bad guys you know i watch csi
i know the police are the good guys
that's right
guys san diego's a nice place
i haven't had any encounters yet with
the police
um to be fair that's true for most of
california
but what i can say about san diego is i
haven't had any bad encounters with
homeless people either
like there's homeless people but oh man
you want to sleep on the street that's
not my problem
go for it you want to run around
screaming at me
follow me around now we got a problem
that's what happens in san francisco
shithole i was going to run for mayor
um before i decided to leave i mean you
kind of get a choice you kind of get you
can fight or
exit and i chose exit uh i was gonna run
for mayor
um my model was nice
uh we have to you know we're gonna use
the triforce the triforce you guys know
the triforce
do i ever explain my oil campaign to you
guys
so i'm gonna have a triforce right so
see this triangle here
this triangle represents housing because
we're gonna have housing
this triangle here represents
infrastructure we're going to have
public transportation that runs 24 7. by
the way
i didn't tell you guys my answer to
housing which is this one up here my
answer to housing is yes
my answer to infrastructure is yes uh
we're gonna have
bart that runs 24 7 we're gonna have
we're gonna have everything
uh you know working right all right
we're gonna we're gonna we're gonna fix
up the city you know
this one over here parks my signature
thing is we're going to turn
market street into a park respect to
leslie knope i stole that from you
um so we have we have housing yes
infrastructure
yes parks yes all right you see this
upside down triangle in the middle
that's homelessness we're gonna get a
bus we're gonna fill it with liquor and
weed
and heroin and we're gonna say everyone
free ride free liquor free weed and it
goes to stockton
and then we're gonna put a 200 toll on
the bay bridge if you want to come back
that way
um and then
and then i have a plan for crime
i have a plan for crime i would love to
see
uh some some candidates use my plan for
crime we are going to make
crime illegal we're going to make crime
illegal
why the bus just stopped it
it's cheap
make crime illegal that's right
i just i would have loved oh my god like
how great would have it been
if i said like if i was in the mayoral
debate for san francisco and i said all
this stuff
you know look look it's all it's all
positive stuff right like everyone
everyone should be happy with this
it's look it's an optional bus ride you
don't have to get on the bus it's not
like it's a terrible thing
we're just gonna you know what are we
gonna do with crime we're gonna make it
illegal
right what is your plan for crime london
breed
can you tell me about your plan for
crime and she'll ramble on for like five
minutes and you ask me my plan for crime
we're gonna make it illegal no like when
people do crime
it's gonna be illegal and then you know
they're
gonna they're gonna you know it's
illegal
i've had a cough ever since i got
coronavirus
cost is going down
i think we could does the boat go to
stockton can we get a boat that goes to
stockton yo let's let's
get a uh let's get one of those river
boats that used to go up and down the
mississippi you know
oh my god yes we can take a boat i
actually sailed
uh i believe it was to right here
um
yeah maybe it was even further
where's ephemeral
we sailed there i think it's here what's
it was it more of a protected kind of
thing
forget how far i went yo where's frank's
tract
but yes held up from berkeley up around
here
oh yeah no we stayed in pittsburgh wow
it really was far
oh no it's in here yes right here right
here
mandeville point
yeah you went exploring over here
don't turn into what if we make crime
legal i i think that's san francisco's
current approach and i don't think it's
working that well
but you know for yourself
some things just shouldn't be crimes
if you're not trolling you really need
to spend less time on the internet
that's a good point
who takes the internet seriously who
goes on the internet you know
you ever seen like a page by like a
karen or the kind of people who write
yelp comments man
oh yo i deleted it from my instagram but
my
i had a brief feud with united airlines
but my feud with united airlines is you
know
they're scumbags but did anyone think
they weren't scumbags
um oh also don't fly on a 737 max
you can read you can read about what
their fix was
well i didn't have to leak because it's
negative man we only want to put
positive vibes into the world
oh my god
what i say about the names i don't want
to hear
joe's name i don't want to hear donald's
name
i don't want to hear any of their names
man
it's all dumb
i'm six foot two that's right
oh my god i can't believe you guys are
the worst chat
you know i open you i open you and i get
distracted
ugh
who's over chat all right i think we
might be done with today's stream
i think what we've learned is that none
of this shit's real
and it seems like the best way to
synthesize dna
is this
but it shouldn't be expensive
i'm really not sure this thing's a dna
printer
because like it does seem like i have to
like
they like send me a thing which is
custom for my dna
it's literally juicer
uh
these people are smaller than comma
enzymatic approach see part of the
problem is they're using
chemical
i mean it's a reduce right like you do
the seek you do the
synthesis and so you do like a reduce
right
you run a map reduce on your dna
uh
i want the machine to go beyond just a
dna printer too i wanted to do all the
pipetting and the plasma tran
and the plasmid transfection and stuff
you buy like cheap things that can be
made in bulk with chemical processes
it's like urine can you just slide it in
it's not big companies either
transform that means to put it in the
vector
one day i'll know what a vector is and i
won't just say those words
[Music]
all right i feel like i understand how
dna
synthesis works um
there has to be a reason why it costs
this much
uh
we should look more into how to actually
do this stuff
how do i build one of these machines
right can i synthesize it
what if i just pipet can i synthesize it
with a pipet and a bunch of those little
what are those little doohickeys called
if i open chat are you guys gonna be
useful or useless there's too many
people you know what
i have a way to make chat useful oh i
love this way of making chat useful
that's right subscriber only chat
oh perfect i remember this from back in
the day
because then we don't have people saying
do you plan on listing your company in
the stock market
do you even invest bro just buy bitcoin
and wait
oh i'm in the just chatting section oh
yeah i don't know
[Music]
um uh
so
so
catalyzed condensation reaction
chad didn't get better yeah i know but
at least these people pay me money
you know it's so sad that like when i
see something like this
like i don't know if the world was
always like this when i see something
like
we are providing one billion base pairs
of dna to kinko bioworks to enable their
strain foundry biowx3 in a collaboration
with microsoft
research in the university of washington
our ola guides are being used as a data
storage tool
like i just know what complete and utter
bullshit this
is you know
and it's it's so sad
like it's it's so it's so sad like like
who would write this
you know the thought of actually using
this stuff for data store just
unbelievably stupid
right like it's not really being used as
a data storage tool
but unless you understand like not even
this stuff look i
i know very little bio but is anything
that costs
10 cents per two bits to write a
feasible data storage format
no that's so fucking stupid
right but you know here we are and
people write that and like
to be fair this is these guys's blog
like
it's so sad so sad
why do you say it's really only one bit
per base pair
no that's not right just because c has
to be paired with gna with t
figure out why that's wrong
right there's the five at prime end to
the three prime end
right imagine a binary code where zero
has to be paired with one
well that doesn't store zero bits of
information it's still
you know your zeros and ones can still
be flipped right
the orientation matters
yeah biology is a base for something
like qam2 right
inkjet printers are little pipettes man
i also think that
yeah like all this stuff in bio you
don't need it doesn't need to be done on
anywhere near the size and scale that it
is
right i don't care if i'm producing 10
000 of the
thing or 10 of the thing it doesn't
matter
right why am i pipeheading at a human
scale
microfluidics bro how do inkjet printers
work
x
can you explain pipe padding to a noob
no i don't know how to pipe i've never
pipetted shit in my life
all right guys i think that's today's
stream
i'm gonna take a nap i think it's nap
time
uh i think we've made some good progress
we learned how dna said this works
um
yeah so dna synthesis makes these little
shits
actually i want to have one more note
something really clarified to me um
size limited by
so
all right cool thank you all for
watching
um
we're going to do something about chat i
know i've said that why but when i used
to say that remember when i was serious
about doing something about chat
and then nothing happened yeah
stay woke everybody stay woke
thank you good night
I had a mucus
can't take the trash yeah sure sure
you know I do wonder if I logged in if
it would be better
yeah I think I'm gonna stray more but
this dream is gonna be a whole lot more
chill and yesterday's dream we'll see if
you really like it
my mother sent me an article this
morning about masks and the article is
totally complete trash and you know what
I regret talking about masks even this
stuff even this like anti Google the
problem with even talking about it
it is it attracts idiots whenever
whatever this is a good article for
everybody to read and this is this is
really how how people view it politics
is an extension of war by other means
arguments or soldiers once you know
which side you're on you must support
all arguments of that side and attack
all arguments that appear to favor the
enemy side otherwise it's like stabbing
your soldiers in the back providing aid
and comfort to the enemy people who
would be level-headed about
even-handedly weighing all sides of an
issue in their professional life as
scientists suddenly turn into slogan
chanting zombies when there's a blue or
green position on an issue
right the general level of discourse
about this kind of stuff is so much
lower so that's why we're working on the
busy beaver problem today and I was like
should I stream this or should I not
stream this you know I regret doing any
streams that ever talk about anything
remotely controversial because honestly
the Internet's about to it's a bunch of
immature fucks I'm not talking
specifically about my audience but the
the internet for the most part is is is
is immature Fox and you know you guys
don't know how to handle like the
intellectual and I I do think I'll make
this one point I think it has to do I'm
so sad for the internet that we lost I'm
so sad for the Internet 20 years ago on
the internet but I grew up with where it
wasn't like this and I do think it was
because well the people on the internet
were more mature and say
do some quick intro the busy beaver game
consists of designing a halting binary
alphabet Turing machine so not all
Turing machines halts on fall and some
don't
you can't know which ones you can know
for some to prove that a halting tired
Machine halts you can just run it and
figure out until it halts to prove a non
halting Turing machine does not halt
there's a few ways to do this so the
easiest way is if you get a cycle so you
can think of a Sigma you know Sigma
lowercase Sigma but now turn it around
right if your turn tiring tiring tiring
time you go on a turn loop and then you
reach a state that you've been in before
let's say at state 100 is a repeat of
state 30 well the same thing is gonna
happen again at state 170 you're gonna
get a repeat of state 100 which is state
30 so on and so forth so that has a I
mean y-intercept and slope aren't really
the right things but it has a intro of
of 30 and then like a step of 70 so what
is halting me
um so halting in a Turing machine is
usually just a state that States called
the halt state you can make more generic
statements like you can't prove of a
Turing machine ever gets into a certain
state so maybe a way to talk about this
is gonna be to look at do they have a
bunch of those nice old pictures here
they roll graphs
yeah yeah so this is like um this this
represents a time machine so if you're
in state a and you come upon a I don't
exactly there are there notations a
little bit different from mine so I
don't exactly understand it
um but Z is the halt state all right so
the Turing machine bounces around states
like a to be back to a to B to D that to
be back to a and then maybe it makes
this transition here over to Z I'll see
you that's what all that means
running my own private Wikipedia
instance it's never gonna my Wikipedia
imagine your computer hit you up and was
like yo could you give me $3 yo you got
$3 it's like it's like you know when I
go out on the street the homes people
give me $3 I go on Wikipedia give me $3
if it goes to see Ana terminates yeah
the rules for the two-state game are as
follows so it's it's a two-state wait no
not Tuesday so it's a binary alphabet so
it all it has is zeros and ones there's
two ways I've heard it talked about you
can say what is the machine that runs
for the longest without halting and then
what is the machine that writes the most
number of ones on the tape so a few cute
things it's really easy to show that the
the busy beaver function is non
computable I'm not sure this is the
proof that they're gonna go into but my
understanding of the simplest proof is
then well if you knew the busy beaver
number say for a 13 state Turing machine
and you had an arbitrary 13 state Turing
machine and you wanted to know whether
it was going to halt or not well you
could just simulate it for the busy
beaver functions number of steps and
then if it didn't halt it'll never halt
right busy beavers are totally and
completely useless and if you're looking
for useful shit fuck off from now on
this dream is a useless stream that
talks about nothing controversial except
for finite ism
this is this was a really cool super
impress when I saw this
you know you gotta be you gotta be
careful what links you click these days
this is see I want now I know Scott
Aaronson
let's try Scott Aaronson blog this I
want that I want no I want the blog post
turn machine DF independence ah yes
so
this is a really cool theory about so
the busy beaver number is theoretically
incomputable all right like you can't
there's no function that's going to
return the busy beaver for n but it
seems like we can get some of them right
we know the the number 4 2 3 & 4 what
we're gonna work on today is the number
4 5 which the number 4 5 we have a good
lower bound on it's easy to get a lower
bound if you as soon as you find the
machine with that number of states that
halts either after running for this many
steps or printing this many ones you
have a lower bound and if we happen to
magically find one that runs four more
steps or prints more ones we can update
these numbers but I don't think that
we're going to so this is talking about
the busy beaver number from the other
bound which says that the what busy
beaver number can't we compute and
there's some things in
yeah it follows as an immediate
consequence of goggles and completeness
care that there's some computer program
of some length
that eludes the power of ordinary
mathematics to prove what it does
yeah so that's it this is this is a cute
simple one enumerate all the possible
consequences of the CFC axioms you can
enumerate those that said axioms you can
apply them
I mean halt if it ever found a
contradiction assuming ZFC is consistent
this program must run forever but then
again assuming it's consistent it can't
prove that the program runs forever
since if it did that would prove with no
consistency thereby violating the second
it completes there so if you could
encode that axiom enumerator in a Turing
machine figure out how many states that
Turing machine has you know that busy
beaver number is is in computable you
can't know this this is a program in
math that you can prove that you can
never prove and as as fun little asides
they also made a 48 88 state Turing
machine that halts if there's a counter
example to Goldbach's conjecture
you all know Goldbach's conjecture
Globox conjecture says every number is
the sum of two primes except two I think
that's right I'm not going to fix it up
with something else
yeah every every integer great ever even
integer greater than 2 can be expressed
as two primes you take four it's two
plus two if you take six is b + 3 8 is 3
+ 5 so in sum and a 53 72 state machine
that halts if and only if there's a
counter example to the Riemann
hypothesis the Riemann hypothesis
explanation is too short to fit in this
stream but it says some weird stuff
about Zeta functions all that stuff and
someone just has to do with primes that
I read this proof out of this book yeah
no no I think yeah it's the same guy
I think I think I think this was the
book I read or maybe it was a it went
into trying to explain the Riemann
hypothesis and I really tried to go
through it and I would still love to sit
down with someone who can actually
explain to me what the Riemann
hypothesis is in a way that I understand
so this was this was done two years ago
they were so cool like I could have done
it you know so that's just it gives you
hope that math is accessible to - to
hackers because it's it certain it's
it's real it's real hacker stuff let's
let's get his name right Adam I'm not
even gonna try out the last name but he
wrote basically a Turing machine
compiler that makes small Turing
machines or this laconic that's a cute
language
and then this language compiles to small
towering machines
it has like an unpacker it's like
writing on a grating shellcode
so let's work through this paper um well
so here's my notes they're public as
part of the twitch cock repository on
github so if you're not evilly talking
about the five-state char machine you're
talking about how many well let's go
through what there
this is the notation that's being used
on this scale at page this pages from
2003 and let's look into who this guy is
he seemed she seemed to come pretty
close to to proving it and this was 2003
so I don't really know why he gave up
the codes in Pascal
and there's a yahoo email I mean I guess
that's what you had in 2003
do some anonymous person came just did
this so this is the notation that he
uses to represent the programs the
Turing machine programs the state is
imply the state is implied so this is
for state this is like a 0 a 1 meaning
it's a if you're in state a and 0 if
what you read on the tape is a 0 so then
this says transition to state C right a
0 to the tape and then move the tape
head left so naively not worrying at all
about D duping we say that there are six
states one of the states is those 5 plus
1 States because one of the states is a
halt state so you have 5 the halt state
once you enter the whole state you never
leave the whole state just spends a
little bit see if 5 plus 1 states 6 2
possible or I guess oh no no never mind
this is the 5 plus 1 States right here
so that's 6 6 possible values for this 2
possible values for this and two
possible values for this 6 times 2 times
2 is 24 there are 10 labels 24 to the 10
is 60 feet trillion so we have 63
trillion possible machines in which to
find our busy beaver
so usually whenever you're dealing with
searching in a set like this the first
thing you want to say is how many of
these machines are isomorphic how many
of these machines have the same behavior
like prove the same behavior so for
example one trivial way we can talk
about some some symmetries one symmetry
is the symmetry of the names of the
states so if I rename all the states to
other things with the exception of the
halt state because the whole state is
special because you halt and with the
exception of the a state because I
believe you start in the a state
then yeah there's there's still a lot of
degrees of freedom there which I can get
identical machines also left and right
the tape of the Turing machine is
completely symmetric so if I switch all
the left's two rights and all the rights
to left's it should do the same ones and
zeros would be symmetric work the goal
oh actually that's not true the Turing
machine starts with zeros so one's the
zeros are not symmetric so this is a
paper generating candidate busy beaver
machines or how to build the zany zoo so
if we can come up with a procedure that
allows us to generate candidates now
there's like words for this was my lack
of but if you have a function where
ideally I'd like a function where I can
say okay give me the 17,000,000
candidate and it will return me
something I don't need to iterate
through them I have a explicit formula
so let's read this paper I was sitting I
was looking at this paper this morning
and I realized something kind of sad too
as the internet reduces in content you
guys watch how I use the Internet you
watch how I highlight quickly and like
jump around and you kind of have to
because there's really very little
information in most web pages but this
is kind of breaking my brain for the
ability to sit and read something that's
very informational e dense I remember
getting a copy of critique of pure
reason and
I couldn't get past the first two pages
Tibor I know introduce the busy beaver
problem is an example of an on
computable function surprisingly simple
definition to find the largest number of
non blank characters that is output by a
terminating tire machine commencing on
the blink tank machine must be of no
more than a given size so that one can
define a function mapping the size of
the machine to the maximum size the
output produced
besides the Apple can be surprisingly
large for example there's a machine with
six states that terminates after the
beautiful thing about about the five
state busy beaver is the numbers
believed to be like 47 billion and 47
million we can write a Python ten to the
thirty six thousand yeah yeah that's
gonna require it's gonna require a lot
of speed-up tricks you don't you can't
actually simulate every step of that but
you can talk about its behavior what
it's going to do
principle this problem could be solved
by cleverly composing them particularly
machinery given size and proving that
it's maximum how do you prove that its
maximal without showing that all the
other ones are in practice solving
problem means analyzing all the machines
have given size and determining the
maximal one the evidence for maximality
such machines would be available mostly
he's complaining about the three and
four state machines not being
rigorously done
systematic analysis for the three-state
- symbol okay so obviously a program
should able to analyze all the 40
machines which were then analyzed by
hand they provided a description of
their method and a specification of the
40 machines but details are not provided
to reproduce what was done which is
interesting is I mean this is the same
approach taken by mr. skeleton so this
is the BB provers open source we can we
can run
after getting Pascal to compile you can
see it going through machines um no one
problem
we've potentially doing this one problem
with potentially doing this for five and
why perhaps it hasn't been done is you
may end up with the Collatz conjecture
we're gonna use my local instance of
Wikipedia for this because fuck the
internet the Collatz conjecture is it is
a conjecture mathematics that's concerns
a sequence to find a small start with
any positive integer and then each term
is obtained from the previous term as
follows if the previous term is even the
next term is one-half the previous term
if the previous term is odd the next
term is three times the previous term
plus one the conjecture is that no
matter that what value of n the sequence
will always reach one does the Collatz
sequence eventually reach one for all
positive integer initial values okay so
let's let's let's try one I'll write it
out so we're gonna start with six you
get to 3 right 3 times 3 plus 1 is 10
get to 5 that gets us to 16 alright
because 5 times 3 is 15 plus 1 16
divided by 2 because it's even as a 4 2
and then 1
so 6 works is that true for all numbers
now the problem with the Collatz
conjecture is the procedure is very very
simple yet there's no proof for this yet
so if we can show I don't think that
would be a really cool mathematical
result as well we could show well yeah I
mean that's the old all that sealed was
Hilbert was like some some mathematician
was criticizing Hilbert for his like
it's like Hilbert's list of unsolved
problems well anyone could write a list
of unsolvable problems it's so easy I
told her it's like okay give me give me
three and the mathematician couldn't
even come up with one because it's
really hard it's really hard to find
problems that are are hard to to say or
not busy beaver is an interesting place
to potentially look for these right
you'll have to translate you'll have to
translate this into a problem that
people can care about and demonstrate to
followers in Python because math math
seductive math is more likely to be
solved you imagine arresting he'll go
yeah so you got distracted we'll go back
to the paper
but analyze all before your machines
which it now is by hand provided
analysis of the four state to symbol
machines which also used programs to
reduce the unknown cases to to 1882 both
the times these remaining machines would
determine not to terminate due to the
human analysis well this is interesting
so this is basically saying that the
proofs for three and four aren't even
very good we just kind of came to accept
them and the five one is probably
correct as well but we live in an era
where we expect more rigor from anything
that looks consoling we do you
oh cool they actually said exactly what
I said anyone making a statement should
provide a substantially higher level of
computational evidence of course we will
do this all open source if we have any
luck I was one of the what what of one
of the things that I've never really
posted about anyway that I put a
surprising amount of my life into was
trying to find a collision in sha-1 it's
been done it's been done by the leader
in the space I read all his papers and
tried to implement them my
implementations whenever as good as his
but I wanted to use all I tried using
Sat solvers against it I still like this
code somewhere I have a Sat solver which
can find like 40 step collisions in
sha-1 but I couldn't get it sat really
interests me as well maybe well did we
do a stream that well he wrote us a
flower
maybe we tried we didn't actually get
through it because you know part of the
reason I was able to do twitch slam so
well is because I spent six months
before that like studying slam deeply
studying slam we have an internal slam
at comma so when it comes to writing a
toy one fort which I could do it very
well and twitch slam looks impressive
but what you don't see is all the work
that goes into it so if I do a Sat
solver stream you have to work in right
you know in some ways I have an
expectation for wanting this stream to
be high quality but I don't put much
effort into it so that's kind of on me
like if I want my stream to look like
shit talking our I prepare for this
dream like it should talking out you
know use a little bit more self-control
prep for and share the topping in
discord we don't have a discord I wish
we had nice tools
I wish we had tools which could build
nice communities part of it so part of
it I don't mean to just attack people
and say people have done a bad job at
this because like a lot of people it's
very hard it's it's not an easy problem
the only people who I would really
attack or people who I think are doing
it in bad faith in the early days of the
internet PHP BB MediaWiki these these
projects were not written in bad faith
Facebook wasn't written in bad faith it
changed over time
oh yeah so I mean if we could have a
nice community where you keep out really
all the toxicity then we can have a nice
discord where we could study and prepare
this is part of the reason I want to
make the college I think maybe it's a
fundamental problem with the internet
maybe it's a fundamental problem that
when you give people anonymity and weak
identity
you get toxicity and psychopathic
behavior
you get no no no person in real life
would treat you like a SEO medium post
would that only expects to ever have 30
seconds of your attention I mean sure
you know a beggar would at least at
least beggars I can respect more because
beggars is putting their their body in
front of me hey if you make me drive by
SEO content its you put nothing
they don't get flame yeah
if everybody stopped clicking those
links and everybody stop giving beggars
money it would all right that's the
truth about solving a lot of problems
too the coordination is hard but solving
the busy
you see that's something we can do and
it's beautiful because it's meaningless
like the people who appreciate it I
think I've talked about this before in
order to appreciate
I think III vacillate and I make dreams
like this sometimes where I get fed up
but the other stuff and it goes in Siple
reminder to future me when you feel the
other way watch this stream maybe it'll
work
Davis girl once she lived a nice text
message on the machine very nice that's
just how she was sad about how she acted
this way and so forth and then you know
she's acting that way again and I played
it the text message it didn't work maybe
maybe there's not really hope oh you
can't do it do you maybe all choose just
not dynamic
papers hilarious for picking on mediocre
research and rinse and repeat articles
in ml yeah but is that paper any better
is that paper any better
I don't like the libs either but owning
libs is not I don't like that either
let's build better systems
don't look at the comments they're a
distraction all right
there are over N to the N machines of
size n stroke that's you had an end on
both sides of the video yeah it's it's
actually it's yeah 4 into the two and no
not exactly because assaulting for n
plus one based to it Big O notation is
correct
second the process for generating
machines needs to be carefully
considered and based on sound principles
rather than simply generating all
machines of a given size oh well I mean
that's true too if you have machines
that have no connections between if some
states are entirely disconnected or if
you have Islands this is effectively
machine of size 3 rather than the size 5
so tremendous exclusion to be avoided if
possible thirdly in order to determine
the busy beaver function when you only
to analyze the execution of these
machines on a single input that means we
kept engine takes place properties the
intermissions the classic way to address
these issues and to intermingle the
generation of the machines with their
execution I've seen this so I actually
implemented this basically the trick is
whenever you can do a state transition
do it you'll and do both you'll find the
code I have the code for this yeah yeah
tnf Oh beautiful
so if we run TNF I think this is gonna
get alright yeah this is all the
possible machines with three states and
I think it eventually gives us the right
answer
yeah so if you're interested entry
normal form it's already implemented in
the twitch concrete box
get a parsley define machine in the
blanket Bunch on I like your transition
it was an appropriate additional one its
allocated there's only one of these
checks so it does it it does it
dynamically but this doesn't have that
property that I want I don't want a
recursive definition I want a the word
that comes to my mind is imperative but
that's not right
the TNF approach makes it attractive
resisting the process generate and
analyze machines rather than separating
the two is discussed above oh actually I
remember also if you want to run this
shit mad fast yeah pi PI
so prints the machine prints whether the
Machine bolts or not it doesn't I'm
gonna get fault
I think believe the other machines in
like Joe Ron oh this is wrong I have I
have my time machine runner over here
you know and M s equals 100 means that
I'll run it for 100 steps that's why I'm
getting all those 101 ok busy or - Wow I
even - takes a long time
so 4 - we got 6 and for all ass all
signal
Eggman
so that's the count and that's the
number so six and four I would expect to
find as the the numbers for yeah so six
and four
how's it for two states so that's my
middle of three normal form program
so yes this is all implemented
our intention is to provide a data set
consisting of all machines which need to
be considered for the busy beaver
problem of a given size so this the
scalloped edge estimates that Phoebe
proved our searches a hundred and fifty
million machines so 150 million actually
if the way that we have to do it is by
generating a big table that's okay
like we can you can turn a recursive
function into a function where I can do
lookups by making a table
somebody's talking about the importance
of separating it into the generation one
child proach will suffice the complete
analysis procedure which is known in
advance to be capable of analyzing
omissions of interest is available this
is generally unrealistic in practice and
so it seems necessary to have an
incremental development cycle involving
testily and partially developed
technique on a class of machines our
intention is to provide a data set
consisting of all machines which need to
be considered for the busy beaver
problem of a given size minimize the
size of the set when possible
it's even more important to ensure we
didn't exclude anything
this means we generally cannot reduce
the number of irrelevant machines
retained for analysis to zero for sure
it's irrelevant improving its relative
right because you do actually
technically need a proof for the full
combinatorics trillions and so you do
actually need a proof for the the dirty
there's sixty three trillion basically
yeah what you would need to show is you
need to show a procedure that can
canonicalize any machine so if we want
like a certain ordering yeah right 36
trillion is a 10 to the 16 that's that's
large 62 Chile I think today yeah
actually it's almost 10 to 17 so that's
that's that's beyond what we're gonna
run today what is when is 10 to the 17
analog I always like thinking in twos
log to see the news articles 56
say to 30 cents so yeah I mean can you
do to the 56 yeah but most try to find a
better way to I mean so so like what you
could do with two to the 56 is you could
say you could enumerate everyone and
then come up with just little little
like like a proof system to kind of say
this one's equivalent to this one it's
already on the list this one's
equivalent to this one it's already on
the last right I like writing things
that look like that more on section 2 we
discussed related work and in section 3
we discuss preliminaries or their quote
is available to which I just write a
dataset of all the machines which needs
to be considered clearly it's important
to minimize this all she's irrelevant
you're gonna have some that are stupid
but in there for this reason we need to
investigate formal results which
establish the correctness of constraints
of the type of machines that need to be
generated in order to solve a busy
beaver related problems we define what
is meant by being relevant to the busy
beaver problem and give results were to
establish a shannon ish eliminating
certain cases yeah we provide a
procedure for generating machines code
and the results are available in the
author's website okay that's I think I
think we understand now what it does
let's take a look
by the way it's more important now than
ever to save archive.org I find myself
using it more and more
25 petabytes for reference comma has to
pay two bytes
oh the observant honor let's learn about
the observant daughter
yeah that's to my Zotero
why are you waving
you know
so here I think
we don't they posting all numbers
there's certainly numbers we could write
it's just download this
Wow good thing that's on archive.org
I'll add it to money I don't think don't
mind
turning pearl god
there's no license
the good news is I'm looking at this I'd
like to aside from this one uses pearl
and this one uses Pascal like aside from
the weird choices of languages it seems
like this stuff's like written by
hackers
okay
so
and I would assume that this six of
states and the two is symbols and it's
interesting that yeah they've gotten it
a hundred and two million
well okay so to get an idea of the size
of the compute where si oh cool it's a
lookalike think about we can we can well
I was doing the file see if we can
understand their format dude Wow Wow
they saved in a hundred Meg's if file oh
that was so polite of them oh I love the
Internet Archive donate to the Internet
Archive
they've never harassed me for donation
see that's why I don't know yeah
and with the dying of the internet you
know
cybersecurity is a racket now I'm
donating through the cloud
I'm just going to use their park own
homes it take
it's not pearl what is PL prologue is it
prologue it's pro the gates prologue the
good news is somebody used prologue for
merge sort
so I know I'm right this metal fun
project or it just look like pearls
yeah 105 extension I do think this
actually isn't prologue
see if it looks like prologue looks like
fun
sniffle
sorry
there see
No
hmm
- teammate
I'm going procedure main oh I get it so
you can like swipe all G generate and
then when I run that I think I'd like
imports
create machines States symbols appointed
errors style of types - yes
we've ders
yeah
you know it would be nice if they had a
example yeah here we go
odors is directions not a directory Oh
top
Wow here we go
abs Tianna those normal things
unknown procedure directory
let's compile the top
not with GMA g-man was a mistake
yes
that whim would not create correct goal
so the problem was actually that I
didn't the problem wasn't generate fun
was that I didn't link it to whatever
other bullshit I needed directory
that way no Gmail
director EC : / busy beaver data raw
busy beaver 5 to 2 does not exist
somebody's of Windows
yeah here we go directory for import
directory where results camera one on
raw and they want a results
a machinist Oh
unknown procedure bound sex probably
jail
complained about a lot of stuff
unknown procedural fault trams yeah we
tried the my download finish
our file
you're appalled
[Music]
great
okay um we could try to get this code to
run but then it still involves trusting
so this is the first step in our in our
step here we have our attack steps here
so we can re implement whatever there
are search procedure is and hopefully we
get the same number of machines that
would be that would be very satisfying
if we could if we could finish step one
on part on this part one extreme I don't
think it's
but that's probably too ambitious for
the first part in-stream because math is
really slow
yeah it's prologue but you see the white
coated windows path
okay so here's kind of what I'm thinking
we probably could have recovered that
but like what would have we really ended
up with
here's kind of what I'm thinking me
reading this paper on streams not that
interesting so tonight my homework and
your homework is to read this paper so
this paper is called generating canopy's
fever machines or how to build the same
zoom The Associated code is now in my
github and tomorrow we're going to
reimplemented and that's going to be
step one we're gonna re-implemented on
I'll be on stream probably tomorrow
around the same time I can't link the
comments or online or on my phone but I
think this is kind of gonna be the new
the new style for a bit yeah we have a
stream schedule right pretty hardcore if
you like this stuff please subscribe I'm
gonna look at my twitch monies and if
I've been making a lot of twitch monies
I'm more excited to do this if I've been
making less twitch monies I'm less
excited to do this and I'm never doing
another coronavirus stream you know back
in the day you could talk about
coronavirus and then idiots took over
the discourse I didn't realize I didn't
realize how it changed I thought you
could
yeah I thought I thought over over two
months it seems like anyone who was who
was interested in I saw a joke and the
joke was like the guy goes up to a dr.
zeig a doctor when his coronavirus gonna
be over and the doctor said but he
asking me for ask a politician colory
first well thank you for subscribing
mooch was taken whoosh whoosh was taken
Christian James thank you for
subscribing only people who passed the
test should be allowed in the stream
yeah we can I can run that over with my
content team and my production manager
away I don't have any of that shit right
oh good yeah my notebooks is a good repo
that code is pretty clean get your VIP
star subscribe today subscribe now oh
actually the other thing that I was
thinking about is the end of these
things always ends up being a QA is
there like a I want kind of like a
reddit style for the questions you know
I want I want like instead of just I
could just make a reddit yeah I like
reddit thought private reddit instance
no no I don't want there to be the
reason I don't want there to be a reddit
is I don't want there to be a persistent
place no rats are right but I don't want
there to be for the same reason that
there's no discord and I'll be
infuriated if anybody makes one is the
problem with a persistent place is that
place is going to be taken over by it by
the psychopaths right the if you stand
up something quickly everyone is there
if no it's just like oh we just showed
up that the the minds of those kind of
people haven't yet figured out how to
exploit yet kind of the Janus I'm always
talking about this Oh Janice yeah
just turn it into sub only and let
people ask questions at the end oh yeah
that's a good point
yeah all right let's go solve only
yeah well we'll answer a few questions
but only for subscribers it's a good
point that's a good point they're
probably better people I mean any Q&A
for slobs
she'd be nice to have like a nice list
of questions you know like curated you
guys can vote a relatively short stream
today but we're gonna try to turn us
into as an a stream how should someone
who never coded start learning to code
see if you weren't a sob I brush away
that question real fast but actually you
know what's a more interesting question
would you fuck a polar bear and no I
wouldn't I mean will you fucking normal
bear like let's start there and then
like would you fuck a dog right like you
know where does it where does it stop
man you know where it stops animals
does it bother you that Peter teal is so
popular in start-up culture I didn't
even know that was true
and by the way how do I learn to code
question actually is a worse question
than would you fuck a polar bear and
that says a lot for that question
the problem with making a discord for
people who pass a test is who's gonna
maintain the test what's gonna happen
when somebody passes around the guide to
pass the test and the thing you gotta
moderation as a continual process I
don't get paid enough for it
object-oriented programming become the
standard as opposed to functional
because it takes forever to do anything
in Haskell lambda man yeah it just takes
long to code in the house
it's gonna be the same few questions
every time yeah I mean that that's the
nice thing about the you or the hype
train I'd rather be remembered for my
something I haven't done yet it might be
remember for that shit you'll see what
I'll remember for
if I can pull the parity to cover this
funny yeah just pay someone to maintain
the test for you see you know a lot of
people tell me this kind of stuff like
if I understand you know you're rich you
just pay other people to do stuff for
you
yeah well paying other people to do
stuff for you isn't that easy because
you run into the same problem of well
who's confident how do I judge their
competence do have to interview them
right and eventually yeah you could
probably build like a structure that's
capable of doing this how many high as
15 people I still have to deal with a
lot of this stuff hopefully last night
we're trying to transition away from it
but it took five years and 15 people is
backprop gonna be obsolete in 20 years
throwback problem I think backdrops
gonna continue for a long time I have
yet to see the brain doesn't use
backdrop at least not the same way
there's no way the brain is background
if you like ten layers
so why is there a need to create an
elite private community wouldn't it be
simply easier to set up some simple chat
rules and have mods enforce it you can't
do this because the problem isn't
moderating obvious spam the problem is
somebody's producing content that
doesn't violate any of the rules but
it's really low-quality
it's a quality problem not a rules
violation problem and you can't you can
have a rule that says for example you
know no racist comments and they're easy
to moderate but having a rule that says
no low-quality comments will that's
subject
can we feed gbg3 a lot of code and get
it to code Jen so I had this like idea
for backspace and I kind of wanted to do
this I think what you can get with them
as you can build pretty good linkers you
can find bugs by finding code that's low
but people don't when people if you
watch me code I don't start at the top
and slowly go down to the bottom unless
you have a system that's capable of like
jumping around and editing I don't think
it can code it racism is subjective as
well today so even even a simple rule
like that right so this this rule thing
is completely impossible low-quality
content and Chad is just a part of the
twitch chat experience yeah that
how do we attack
low quality stuff period in in the real
world there is kind of a social pressure
against it right because people have
like one identity nobody wants to start
being known as oh this is the guy who
just you know post trash I mean this is
probably what I'm gonna do next or I
know math is a fun hobby but I'm never
gonna I'm never gonna gonna make it as a
as a mathematician it's unclear that's
maybe when you first read less wrong you
think about recursive self-improvement a
you think that math is what's gonna save
the world and the more I've grown off I
realized that politics is gonna save the
world
you've just never been exposed to
anything that looks remotely like their
politics like most math is good most
papers that are published especially in
in weird parts of math are good because
who cares except people who are really
who really work hard and care there's no
you don't get any power in exchange for
these things so it only attracts the
right kind of people um
politics always attracts the worst kind
of people so you've never seen good
politics
what does good moderation look like I
think a lot of the Internet is is
struggling with this now
yeah I wonder
this is this is like what I want to
build the college all right I think by
having a physical space where there is a
barrier to entry that you actually have
to show up and and in order to place
your body there already will cut down
maybe this is why yeah online learning
and online communities can't happen
you're you're you're better there well
I'm not saying they can't happen but
until we solve this problem they'll
never be as good as real-life
communities can be
so I mean even that comment I guess
Trump is not a good example for good
politics that's not what politics is
if the you hear the word politics and
the first thing you think is Trump
you're that's like hearing the word math
and the first thing you you know you you
think man that's not it's not a good
analogy politics is the way to construct
systems that maybe prevent the tragedy
of the Commons if you think about our
key is the absence of politics you don't
know one lesson live in an organic is a
terrible place to live politics is what
comes in to replace anarchy
marriage an insight on mark says the key
to political change isn't changing the
minds of the masses but changing the
minds attention hundred bright people
for a given age I think that's right the
masses is down stood the belief in the
politics the art yoga here the art or
science of government or governing let's
say forget the especially let's just
leave it at that
the art or science of government of
governing and that's exactly what you're
asking the Janney's that's what they're
doing
right that's what moderation is that's
what building a good community is
and our yeah anarchy which which like
white or black is like the absence of
color anarchy is the absence of politics
I mean it's not really actually you are
you're governed then just by the law of
nature is it is so completely might
makes right
you know but me if politics is not the
way forward and maybe we use another
word for it because that word is so is
so tinged with with with crap um we need
a Bitcoin for society that's a good
comment I'm not sure I'm not sure how
literally you meant that if you mean it
literally as in we just pay society with
Bitcoin and everything will be fine
that's not true but the the
formalization of the system in Bitcoin
if you could figure out how to do that
for moderation
yeah a system that relies on everybody
becoming enlightened I don't see I don't
see working so well this yeah you want
to build a system that has the right
sort of you want to build a system that
rewards quality and punishes lack of
quality let's just say your social
network right I mean social networks
what are what are the people its
governance in a social network whatever
your policies are if you could figure
out how to build a social network that
rewards quality and punishes lack of
quality you'd end up with the most
incredible social networks so quickly
the problem is what are the experts
right so there's two ways to avoid
explains and this is true in in security
as well so one way to avoid exploits is
to build something that is so incredibly
secure the other way to avoid exploits
is to not have something worth taking so
these are actually that's all in the
same spectrum if you have a system that
costs $100 to attack but only has 20
dollars of value on it that system is
not going to be attacked but if you have
a system that has 100 that cost $1 to
attack but has you know a thousand
dollars of value on it then that system
is going to be attacked right I mean if
that cost can include everything that
cost can include we go risk and all that
so on and so forth so the reason math
seems to remain quality is that there is
nothing really a value to take math kind
of is its own reward
um well he of course that is that is the
ultimate the ultimate problem who
defines what is quality and what is not
is quality objective no it's not a just
it's it's well but even true there's not
no objectivity when it comes to people
there's certainly a some objectivity for
example there's no human that can run as
fast as a cheetah that's an objective
statement is true quality is truth yeah
again this suffers from this problem of
you can say a lot of meaningless true
stuff
one component of politics is influencing
other towards your ideas and no not
everybody's into politics I really I I
hate the idea but what else do you do
when you realize that's if I could save
the world through skateboarding I'd be a
pro skateboarder save the world through
math I'd be a mathematician but who's
gonna end the world with humans
see but okay a statement like that means
you don't understand what I mean when I
say politics a statement like the media
influences more people than the politics
what's the difference all of that falls
under an umbrella of like governments
the one who does a lot of interesting
stuff in crypto about this crypto people
I find just using that word governance I
realized that crypto people talk about
this all the time and they talk yeah but
maybe this is kind of a solution
too bad people thought they were there
was power there and ruined Krypton you
have to figure out the humans are
fundamentally economic creatures you
have to figure out how to make sure
incentives are aligned for everybody to
produce quality the initial hope of
social media was the users would
regulate content quality by likes and
upvotes yeah I guess I think is that
that naive I don't think so I mean 10
years ago I don't think that was naive I
don't know maybe 10 but I don't know 20
years ago yeah I don't think it was
naive at all
well everyone wants a good tailor
the problem is that the good part and
dictatorship suffers from sets of
problems that democracy campus I mean
there are some problems that are better
handled indicator ships though some
problems that have better handled in
democracies but this isn't even I'm
talking more about a new politics I'm
not talking about oh if only we'd elect
the Green Party or the blue party or the
red party know the system the substrate
on which they're playing is
fundamentally broken yeah the good
dictatorship that kid that takes over I
mean that's not the classic problem
Plato would have hated like some up
close something something that I really
want to
what Oh I'm streaming but that died yeah
who knows whatever Plato's Academy
apparently like Pythagoras found like
five hundred people who want to learn
math well I put them up in a building
and called it like yeah the Pythagorean
forget what he called it but that kind
of stuff okay we could do that again
today here's the thing about science do
you believe inside so you don't have to
believe in science people who you know
don't believe in nuclear physics still
get blown up by the bomb
to Sparta of engineering yeah it's not a
bad idea right you know I had to agree I
got it I gotta read more that stuff oh I
wish I wish I could I wish I could focus
more and read more stuff like that
maybe connect he's riding our brands
with everyone saying about these days
do you think the world will always be
full of inequalities I think it's a
stupid thing to focus on I think it's
bad we should focus on the sum sum of
all people the world is not a zero-sum
game
I'm not trying to change the society I'm
whoa whoa not that guy
I'm not trying to change the society
that's not at all what my ambitions are
I'm trying to build a new place that is
very high quality
I started combi with the mission of
changing the culture sure it's working
for you well am I gonna get to clown the
automaker's am I gonna get to finally
laugh at like you know forwards backward
ways of doing things
yeah kind of looks like it but I didn't
win I didn't win in the same way
theranos didn't lose for the right
reasons right like that they won't learn
the lesson so there's no point changing
a society is stupid how do we build a
new society that's good should I ban bra
flourishes trumped I don't care if
you're the subscriber
what is a good politician it's not even
why are there people was a people why
they're people
I want systems
bias.com is quality
it feels good to be a sub yeah it does
feel good to be yourself but no one sub
should know how good it feels
biased
all right that's today's QA
thank you all for watching everybody
please read the paper and tomorrow we're
going to construct the zany zoo in
Python which will complete step one of
our attack thank you all for watching I
hope the world becomes a better place
I'm training to elbow
the cancer will
oh sorry I'm muted
all right we good
oh how's cucumber stock
this is terrible this is terrible how do
I let you guys come on man no I don't
actually feel bad Qualcomm needs to
reform oh good whoever wants to do
activist investing in Qualcomm we can
make that stock go to the Moon we could
turn that organization around
um bro
wow no I can't let this go to my head I
can't let this go to my head all right
look
look look look look
um
oh as phone chip sales dive Qualcomm
maybe you should put more effort into
selling chips to robotics companies like
us instead of being dicks and assholes
all right this is not a Qualcomm rant
we're closing this I'm gonna get fucked
no come on come on we can't Delight we
can't Delight no I'm not pumping World
coin no I can't believe you got your
eyeball scanned no no you made a bad
choice now I'm actually here to talk
about how who watched my debate this
morning
um I didn't short it I should have
shorted it like shit man it's not
insider trading if you didn't act it's
like an Insider God I should have
shorted Qualcomm yesterday okay okay
uh who watched my debate this morning
machine learning Street Talk
uh
I think I kind of uh I wouldn't say I
lost but I didn't win I didn't win uh
kind of like he was a great debate
opponent
um
I'm unpracticed in the art of debate uh
you know I I just I just I exist in a
world where I communicate with with you
guys and with people at comma lunch
table and with Alex and like a bunch of
friends of mine holy shit I'm in an echo
chamber I'm in an echo chamber boys I'm
gonna Neko chamber I need to do way more
debates you know what I mean I need to
refine my arguments in an adversarial
environment
um it was okay I think I think it was
actually pretty good uh but I I did not
I did not deliver the slam dunk and the
truth is there's no slam dunk I'm a
Doomer too we're all doomers man like
like dude AI like
I mean I don't think ai's going to kill
me I don't think an unaligned AI is
going to kill me but I think I'm going
to be out competed by super intelligent
AI in the future and like
okay man every you know what's every
it's every
it's every uh every parent every good
parents dream to see their kids surpass
them I'm cool with that like
I'm not gonna I'm not gonna stay king
forever man I'll have a good run and
then I'll die like we're all enjoy a
nice retirement whatever it is I'm like
no I'm not that worried about that
um and I don't know how clearly I
express this
uh
is a very good debater too I'm not I'm
not that practiced in the art of debate
like you gotta just like what are what
are olinsky's Rules for Radicals I'm not
saying he did this I think he was very
fair too
um but like if you really want to win
debates
all right
oh yes if you really want to win debates
just stick with these rules you know
um
pick the target freeze it personalize it
polarize it right so I gotta I gotta
prep maybe I'll maybe I'll practice
debating against llamas
um
yeah shit I should have went to an Ivy
League school I could have learned rules
from radicals from Hillary Clinton you
know
um I know I know I know I know uh so I
don't think I don't think I gave the
best but like I'm kind of a Doomer too
and that's kind of the like
like
yeah
I'm not I'm not an undoomer I think that
like AI very well might kill us all
I just think that like the path to not
kill us looks different
uh the path did not kill us like looks
like like let's let's go let's go expand
into the universe as quickly as we
possibly can like shit you know that's
what really gotta work on like if we sit
here and build like like like like
generative Tick Tock instead of building
Rockets
if we're fucked I mean just just walking
a generative Tick Tock ourselves to
death instead of like like okay oh and
we lost Jupiter I'm sorry everyone on
Jupiter downloaded Tick Tock 7 and is
now catatonic for the rest of their
lives sorry about Jupiter good thing we
have 37 other planets
um
uh tiny boxes sticking with six gpus I
still like I still very much
I'm not eacc I'm not I'm not putting
that I put the moon in my in my Twitter
uh my Twitter bio uh my Twitter name I
think that's uh I think that we should
colonize the Moon
I I firmly believe in that right the
problem with the green with like e
something like eacc is they can take the
worst members of the group and like say
that's your political position and I
have two positions one is that we should
use more energy and two is that we
should colonize the Moon Moon and energy
okay maybe I should put a lightning bolt
next to the Moon right to to show what I
what I what I believe in the moon and
energy
um
Blue Line go up I do like blue line go
up okay I'm in a better mood I was in a
bad mood yesterday so uh you know just
just just just but like Qualcomm stocks
down seven percent how could I not be
enough let's let's let's let's see how
to uh
oh oh okay well I'm just saying I'm just
saying if you were to trade
[Laughter]
[Music]
um
but I didn't I didn't trade on any of
these I'm not I'm not a stock market
lawyer or whatever
um
am I bullish on Tiny Corp no I mean like
I realize I just got to be more quick to
ban people from Discord like if you're
net if you're a net like like like
okay here's a warning here's a warning
for all of you and you guys should all
be aware of this uh in the future a lot
of AIS are going to be tasked with
wasting your time right and like for
humans before we ban people like we
usually you like try really hard to say
like is this person a troll is this
person acting in bad faith but that's
not even where the bar can be anymore
uh the bar really just has to be like
like what's the lifetime total value of
this person right and I know it's really
a brutal way to think but if you don't
start thinking this way you're going to
be attacked by thousands of of AIS right
you're going to be attacked by thousands
that like you can't make a default
assumption that if someone is wasting
your time that they're wasting their
time too right you just have to have an
absolutely brutal like like yeah I'm
also like I realize I'm not doing the
meetings
I gotta work on
um coordination technology right all
right we'll steal something from the
debate this morning uh coordination
technology you know what you know what's
cool about the tiny Corp
I got I got five million dollars I got I
got another seven million in potential
Revenue if these pre-orders convert we
got money we got a business
what we're we make tiny boxes today we
make tiny grad today what we make
tomorrow can be anything
you know the future so it's only limit
to my imagination I just wish my
imagination were better man I'm hyped
today I'm hyped today boys I'm hyped
today because Qualcomm stop no come on
We're Not Gonna Hate no no no no this is
not Petty this is not about Qualcomm I
would love to help them make their stock
go up uh I emailed the CEO very nicely
uh and I'm look I'm just saying like I'm
not giving you bad advice I'm giving you
genuinely good advice like I'm not
trying to like I'm not I'm not trying to
get rich for myself I don't care right
and I mean this like I do not care
because it doesn't matter how rich I get
if AI kills us all okay
like like it doesn't matter I'm gonna
accumulate wealth in a dead world like
stop
stop it doesn't mean I'm a nice person
I'm not trying to like help orphans or
something
like like I just just the amount of
money I have isn't what's going to lead
to good outcomes for me what's going to
lead to good outcomes for me is sick
open source agis that let me go to space
and shit and colonize the moon and use
more energy all right we're gonna
colonize the moon and use more energy
ah
um
no I don't think ai's gonna actually I
don't think it's gonna destroy like
Humanity right I think it's just like
it's all a progression and it's all like
like like like we're summoning the
thermal doesn't have a God or whatever
like yeah come on let's go like let's go
let's go boys
like like that's the this is the kind of
energy also and this is why it's like
hard to debate doomers right it's like
like you can't it's this is why the
safety is in position wins in the world
uh because like it's like
kind of the default that you can fall
back to and it's kind of hard to
articulate the values of the other thing
but the values of the other thing are
like let's go colonize the fucking Moon
like bro look at this
we built the McDonald's on the moon
quarter pounder with moon right
oh let's just be nice and just be nice
but it turns out that these skills do
not translate to debate skills so I need
more practice debating so if anybody
serious would like to challenge me to a
debate on any topic and you have a forum
for it reach out to me I'm gonna start
doing more debates that's the other
thing I've been bored with live
streaming because it's the same bullshit
over and over again guys like I'm just
I'm rehashing bad versions of arguments
I read in books I'm a large language
model I'm a parrot all right so like
like let's get out of this let's get out
of this and let's not like let's debate
people I need more I need more
adversarial I mean the Neco chamber I'm
in the Echo chamber I gotta get out of
my echo chamber man
you know all right
oh uh
is the moon press 20 year old girls out
it's good
look I go in and out with like my
excitement about programming
um it's just like
uh
I don't want the AIS to be better at
programming
the tools to be better
if you want the tools to be better
George you got to build the tools no
George you got to hire people to build
the tools but then you got to manage
people and like it's I don't know I
don't know
yeah
I don't upload them to YouTube I'm not
George hot's archive I know people
thinks I am I'm not
um
debate me on the historical evidence of
Jesus Christ's crucifixion no no I'm not
gonna I'm not gonna like like I'll
debate you on crap like why Universal
Health Care is terrible
um
I don't know anything I don't know
enough about Jesus and what I probably
like you think it wasn't real or was
real
I don't know man I don't really have a
strong opinion either way
no there's no fucking way of debating
Destiny I'm never debating Destiny no no
no no no no no no no no no no no
I want to debate people like like like
Conor Leahy is the bar of like
intellectual right like
I like everyone to debate to be at least
or more intellectual than him I'm not
trying to debate like like why don't you
debate Andrew Tate man now
uh
I don't yeah I know I know Destiny's
famous for his debates but uh
look we all enjoy this kind of YouTube
content but I'm trying to I'm trying to
level up intellectually not like learn
how to dunk on people better on YouTube
when I debate Trump
all right all right all right and this
is the problem with live streams like
you guys just I don't know I don't even
really want a code I really just want to
like like rant about my debate and you
guys made me so happy seeing the
Qualcomm stock and AMD stock like just
just just just uh
the world is just aligned with me
you can't use the power you see it's not
like that camera and goosebumps man like
it doesn't actually cause bad things to
happen but you just get your finger on
the pulse of the world you know
uh
yeah maybe I should practice debating
llamas
all right
I don't know I don't even want to call
it that I I
am really excited about it
I need to build better infrastructure
it's like I'm working on this like I'm
working on this bitcast PR and it's like
no no I shouldn't be doing this I need
better infrastructure
like infrastructure can be person
infrastructure it can be you know that's
a saying that's a YC saying it's like um
like it's like a starter founder who
spends time coding will lose
no but okay like this is yeah
no this isn't right I I read
there was a good blog post that talked
about basically how like
the problem with coding and the problem
with me spending my time coding for the
new company is like okay
that's great but that's like linear like
I need to get more leverage
all right I need to get more leverage on
the problem and like I know this
I'm not exactly good at it I'm a pretty
good programmer
I mean I'm actually like they can look
at having a code right like
I haven't been compelling in the last
two years but
you know I I like that's a real that's
pretty close to a programming test right
I'm a very good programmer but
I can't do this myself
I need to hire people
right it was nice the debate this
morning also just like I get I get
frustrated a lot because I think the
world's just full of idiots it's always
nice to see people who aren't idiots you
know
um it just reminds me that there are
there are
yeah
and I can't I can't fuck around too much
you know
I have to actually try I have to
actually okay George are you serious
about building a company okay you have
to hire people
what does that mean
that's what I like this is what I mean
like it's just hard like I can't code
what I was currently doing with the
Discord like isn't really working
um
Rock chips up too hey look at that look
at that should we try that example and
just mention a company in a negative
light and see if the stock goes down I
don't know man ifesting you know
manifesting
um
yeah see like it's just okay should I
work on this bitcast PR like no this
isn't gonna this is not what's going to
make the difference between the success
or failure of the tiny Corp
it's about like hiring people now you
don't want to try you know you try to
you really want people to come to you
you don't want to reach out to people
because if you're if you're like
manipulating people too much and this
has always been a philosophy at comma
it's like if I like okay I want to use
recruiters and like sell people on some
Vision it's like well what you've ended
up doing there is manipulating people
too much and you're gonna like
constantly need management to keep them
on track comma works because it doesn't
have this comma works because I laid out
exactly what it was and you know you can
uh
you joined right and you work on the
problem
infrastructure is less sexy and I think
I have a less Clear Vision for what the
tiny Corp looks like but again look I
raised money from investors who who are
pretty open to what I want whatever I
want to do
like the vision of like a boring
infrastructure company
like it might not work
what what the tiny Corp may end up being
is okay we built tiny boxes and we run
like kind of a personal AI ad block on
them
right
lean into this decentralized AI stuff
but
you know I don't like
you know I had I had people around when
I started comma that was a lot nicer I
kind of had not co-founders but I had
like three people even Incorporated the
company
the tiny Corp is me
um and the people you see on Discord
all right it's a lot harder
uh uh I don't know I don't really know
right now how to how to escape that
foreign
conviction on a vision
yeah it's a lot like Thomas Vision I
believe in at least like that company's
gonna sell us all driving cars using an
end-to-end solution right like like
that's pretty straightforward but I
didn't have that at the beginning of
column
I didn't actually if you go back when I
started comma I was smoking weed every
day this was a smoking weed everyday
part of my life
uh and
I just wanted to beat Elon so badly you
know I just wanted to have a fuck down
beat Elon you know this guy God jerks me
around thinks he could write a contract
and then do this to me and beat him
right uh and then you know
yeah
I'm feeling kind of softened over time
um that's kind of what motivated me
right
I'm not trying to beat Sammy yeah hey
hey
Smoke Weed Everyday
um no I you can't like do the same thing
right
private AI that that is what it is
about in person tiny Corp I don't know
I'm kind of starting to sour on San
Diego uh between my interactions with
Qualcomm and between my interactions
with fucking Realtors man and then I
realized that what is this city besides
Qualcomm and Realtors
I'm kind of over San Diego
um
I was just in Vancouver I was just in
Vancouver it's like nice but
it's not like
I need a Clear Vision yeah maybe I do
um
go to Montreal look a lot of Like You
Know Rich Sutton as I watch this I
watched with certain things yesterday it
was it was cool uh I watched Rick Sutton
he denounced his U.S citizenship in uh
everyone else's US citizenship in in
2017 which I thought was like crazy
um the guy's like a hardcore libertarian
he wrote The Bitter lesson well you
really wanted the really one of the the
the the AI uh AI goats
um
moved to San Francisco ugh you know I I
saw a good quote I saw a good tweet
about that it was like
you people think it's gonna get better
when you're in an abusive relationship
stop thinking it's gonna get better and
start leaving
move to the euh
um
everywhere sucks I'm not really sure
it's a place I'm really I'm not sure
it's a place the place I'm kind of most
interested in now is Vegas
um
you know at least I don't have to pay
state tax
um
I was doing the chat over here uh
come to Italy I'm not going anywhere in
Europe guys uh kill my Ai and colonize
the moon should we just pivot to be in a
moon colonizing company I'm pretty
bullish on the moon
um
the South Bay was never really that bad
that's true that's true and in reality
that's probably where comma ends up
going
um
when I conquer Antarctica
uh you know like it's not Somalia I
don't go to Somalia but Antarctica it's
just me you know man versus wild except
not fake
um
Singapore is nice look I look San
Diego's like nice I'm just like wait a
second there's a reason Qualcomm is the
way they are
uh
I'll be I'll be in Asia in a bit like a
little check out Asia again
we'll see it's just as far away and
Rebrand tiny Corp is prime intellect
Incorporated
I like that I like that
no I experienced the same thing with San
Diego Realtors and I'm just like wait a
second I really hate these people
like they're really not aligned with my
values
uh
uh Prime intellect Incorporated
now Austin
's just speed running San Francisco
again
why not Canada what what issues though
it's not really issues like it's not
really the place like we can all sit
here and circle jerk about the place
um
I bet most San Diego people hate San
Diego Realtors too look I don't know I
don't know
um definitely not Mexico no it's not the
place it's not the place and we're not
gonna We're Not Gonna We're Not Gonna
We're Not Gonna indulge chat on this
um
no I just like I need to hire people and
like make this a serious thing or you
know fold
like
oh my God like
that's not hired the best programmers in
the world I gotta build good open AI
infrastructure
right like right now the stuff that's
being used to do the large training runs
is closed source and hard to use
and this is a really big problem but I
really don't like and this was always my
problem with the tiny Corp from the
beginning all I'm doing is preventing
downside
right right now it is so hard to do like
a pie torch training job across tons of
machines I do believe that lowering that
bar
gives us a much better chance
of like surviving the future
like if we if we could make this
accessible to everybody
if we could make AI accessible to as
many people as possible we stand a much
better chance
who's going to use it I mean everyone
will use it if it's better right if only
use it if it's better and it's like
like it's not that hard
these these companies are really poorly
run
um and they're optimizing for different
things
I don't know I mean the other option I
kind of have is like what's happening
right now isn't working I'm putting in
time to manage something and I'm not
getting enough back out of it
another thing that I can do is I'm not
sure how many more months it would take
me but I might be able to like okay you
know look some some I could like make it
just just raise the bar to trying to
like enter you know the time of your
Discord and like like the management
overhead of that is and reviewing pull
requests and stuff is kind of high
right so just like okay go back to let's
go back to a simple scaled down tiny
grad let's solve the problems that we
said we were going to solve but then
it's be coding right
what Enterprise customers customers bro
we're making free software
no customers no Enterprise customers
free software
free software personalized AI you train
shit in your house on your tiny box
right
um no but that the other the
I have like 500 pre-orders for tiny
boxes at fifteen thousand dollars each
all right okay half those people aren't
serious probably but still that's still
3.75 million in Revenue in the first
year like this is an insanely good
company
how many boxes can I make per week they
take me about four hours I think we can
get the procedure down to two and then I
think I mean we're gonna we're building
the tiny box right there's no question
that we are building the Tiny Box it's
just a question of how much of it is
comma and like no but I mean we have to
improve the software we have to improve
the software for the Tiny Box like we
are going to do this
it's just like I just I don't really
have like what it takes to like
I don't know how I did this comma
it's just like I guess it was just the
people I was around you know like the
people I was around made this all
palatable like it's just right now it's
so unpalatable
what's my margin on Tiny Box decent
um
looks like they're going to cost about
ten thousand dollars to make 7 for 15.
uh
why would you buy a tiny box instead of
just getting an h100 well because an
h100 is more expensive and about the
same power
um
I have tiny boxes literally make new
people I mean that's an interesting play
too right this is an interesting play
too it's like
all right
I mean that's the other and that's an
argument for kind of slow play in this
whole game right like the tiny Corp is
in no rush
and maybe that's something I have to
remind myself a lot right like
like okay the money I raised is sitting
there earning five percent interest
we're gonna build a pretty good business
regardless selling these boxes
we're gonna slowly improve the software
and maybe it's just like a much more
chill thing than combo once right and
this is it's hard it's hard like I don't
you know this is why starting your
company's hard
um and not many people are honest with
you about this very few people will
truly go and look I'll tell you I'll
tell you all about my insecurities my
fears and my this turns out by the way
not to be a good strategy in debates
debates Are Rules for Radicals and I
should reread Rules for Radicals and get
better at debates
um why would you buy a tiny box instead
of buying the same commodity Hardware
try to build a tiny box yourself it is
really hard it is really hard to get six
gpus stable in a machine okay it's taken
me months to do it and that's the first
one that is the first prototype Tiny Box
right there tiny five that actually has
six gpus in it and is stable
um yeah there's challenges
oh it has foreign vmes in it too try to
even do that
[Music]
why would you need to train a model over
say a good generalistic model okay so I
think the lines between training and
testing are kind of gonna training and
inference are kind of gonna blur
right like
you want to have a you say you want to
add a girlfriend right you want the
Llama to be fine-tuned at night right
like you want the the llm to be
fine-tuned at night on the conversations
you have so you can talk about hey
remember that conversation we had on
October 4th where I told you that you
were the prettiest girl I've ever seen
your bright green eyes gave me right
like
um so you might Laura and stuff might be
fine it might not be a full back prop
but we need tooling and infrastructure
to make this kind of stuff easy at both
the edge the cloud at every Point uh and
this is what tiny grad is Tiny grad is a
very good idea
um
like you can do the Press type debug
equals two into tiny grad and see why
wait a second pytorch will never be able
to do this structurally
um
you can't be the most genuine person
while also being killer debates
no no no no no I could do better I can
definitely be better about I'm not look
uh Kano is very genuine he just he has a
few of these rhetorical debate things
down pat a lot more than me
um and I can I can get better at that uh
there's a bunch of my points that I
think I could have fleshed out a lot
better you know like I see the YouTube
comments where people are like George
wants to move to Somalia it's not really
what I was going for there and look it
was me I got sidetracked right look I
get sidetracked by you guys too this is
a problem with me I was talking more
about like the Bronze Age mindset
concept of owned space
um but it's a little lost in the weeds
um
should you use Tiny Box for inference
yeah use it for anything it's the best
this is the Prototype this is Tiny five
the the
production Tiny Box will not be open air
like this will not have fans stuck to it
will be a bit smaller you'll see it's
good it's good we got some good stuff
planned
you think I won thank you I don't think
I lost terribly but I don't think I won
clearly
um I mean I looked at some of the
comments on his other debates and
he brutally beats him
uh
do I build the boxes on my own no
comma's gonna build them
um so look it's not like like I have I
have commas I built a great Hardware
Factory right and I was like shouldn't
say I comma built a great Hardware
Factory right
um and it's free money for commento
uh no no no no no saying everyone will
have AGI is not like saying anyone will
have nuclear everyone will have a
nuclear bomb not at all nuclear bombs do
one thing blow up AGI
who knows as yeah I could save the world
man it's just like like it's it's
they're not at all comfortable also a
nuclear bomb is not a defense against
nuclear bomb agi's defense against AGI
right uh intelligence is battling each
other out stymie in a great complex
decentralized society of Awesomeness
right
which is uh you don't get a great
complex decentralized society of high
intelligence organisms battling it out
you just get bombs right there's a big
difference uh that's that's a stupid
point to bring up
um
oh that was the other thing too Connor
didn't use his usual points with me he
had a whole set of points for me and
well done well done
um
yeah IBM's had to be five computers in
the world we got we got to prevent that
outcome
comma AI internship challenge still
active look I don't really like like
listen to what comma says don't listen
to what I say I'm not comma okay I'm not
comma I don't really work there anymore
I did the presentation at Comic-Con
right like uh but I'm not involved in
the day-to-day they have their own
hiring things I don't even approve
everyone who gets hired I only approve
Equity right like as the board
um
can't wait for my AGI spam and psyop
filter bro like this is what this is
what tiny Corps is gonna be this is what
tiny Corps is going to be you'll buy a
tiny box and it makes it super easy for
you to run fancy AI filters
uh in your house
it's it's the home base for AI that
that's our vision you know
um yeah that's our vision
and I like doing it with AMD cards
yeah I want to pay 15K for organs fan
filter right
I don't know I think that's most of
today's rant
I'm gonna get back to coding but like
the coding on live streams I don't know
if I want to do that anymore
I'm just not sure I do
um it kind of just became a
you know a reflection of a reflection of
a reflection
and it's yeah
uh you know it's it's watched itself too
many times
the people aren't serious enough for it
I mean that's kind of the problem too
again I think about thought about this a
lot of tiny Corp we're going to build AI
we're gonna basically build AI
management software right I mean that's
really what we want to I want to replace
the professional managerial class with
AI
with with decentralized AI you got your
own you got a it's like a personal
assistant but like your personal
assistant sits in your office you do not
want a personal assistant that's owned
by Google right
you don't want a personal assistant
because that assistant is not aligned to
you that assistant fundamentally answers
to Google
right you want to build you want a
personal assistant that fundamentally
answers to you
I think that's the mission of tiny Corps
um
you know here's the other thing like
I've completely given up trying to hire
for anyone like software Engineers I can
at least scream
you know I can screen a soft friendship
I can see if someone's a good software
engineer I could just really look at how
green their GitHub is right
I would love to hire like I want to hire
for operational roles but
everyone who reaches out is so pathetic
like I will like I just but there's no
there's no way I can communicate this
right like there's no like well don't
reach out if you're pathetic yeah
because you have done in Kruger right
and the worst part about saying that is
you might have someone who's actually
like would be good for the role who then
doesn't Reach Out
but like yeah
um no I don't think we're gonna code
the greed is is is is is is
quite a good make andreessen's world
come alive
I look I've been I've been I've been
liking what Mark andreessen's been
saying lately I thought I thought that
is Lex is good
um
uh
uh yeah the abstraction stream is great
I mean it still stands the abstractions
haven't changed that much what am I
looking for for someone who's good in
operation roles like
I just I don't want to be CEO man I
don't want to do this
I don't I kind of want to like program
and set a technical vision and I want
someone who's actually competent to come
in and do the uh
oh get me office give me people manage
them you know all that kind of stuff
right but I promise everyone who reaches
out is one of two things either
incompetent or a scammer right
no you have to like really not want to
scam you have to really want to like
okay we're gonna build so do I really
don't know someone like that well I
don't really like the idea of having
co-founders right I don't really want to
do it with co-founders
um I really don't know so you think I
don't like know anyone you know what I
mean like I don't know people who knows
people anymore
uh
no but I'm not even like sure I'm really
I'm not even like sure there's a like an
answer right I'm not even sure there's
an answer that I would like be okay with
right like do I know someone who could
figure out how to confidently like get
me in office and hire some software
Engineers after screening them with
triple bite or whatever they got now
yeah
I'm not that into that you know
why don't I reach out to the people I
want because like what people do I want
you know
I'm just like maybe I'm not that serious
like what I want is uh
why what is a ice
it's not an existential crisis guys I'm
pretty I'm a pretty stable person like
George is on hand and it's not like all
right what camera man
um yeah but see yes the problem with Sam
Altman is he's kind of a scammer right
he's a different kind of scammer from
Sam bankman freed he's not as bad but
like fundamentally
you know
job offers after lots of bounties
there's really only one person I would
hire I mentioned it to them you know
like they can
when they're ready they'll reach in and
there's those Maybe
maybe two other people I would hire if
they reached in and were serious about
wanting a job then like okay what does
that really even like mean the bounty
system kind of works
valuation might not be enough like I
don't think this should be a big deal or
like what do you care man maybe I'm
micromanaging too much what do you mean
by that I'm not managing anybody really
do I hire any pen testers you see that's
the exact sort of comment and I look I
got to be better and Rise Above This
kind of stuff but like
you are so far removed from like
like you don't understand what I'm
saying at all
you know that's what I one thing I liked
about the debate this morning at least
Connor understood what I was saying
most of the time I talk and no one
really understands what I'm saying it's
very it's very isolating you know
do I know what I'm saying yeah I do I do
I comma understand what I'm saying right
it's not it's not totally Off the Wall
insane uh so I mean I yeah like do I
know what I'm saying sure
um
I don't think that's really the problem
like there are some people who
understand what I'm saying and I have
some friends who understand what I'm
saying but like
most of
you know most of the comments and and
most of the people in chat right now you
don't understand what I'm saying and
like it's just a fact
um at comma I pay them to pretend to
understand I don't think so
uh like it's it's this is the old thing
about can you uh
can you pretend to be crazy
and there's people who like want to be
crazy to get Insanity defenses in in
courtrooms and stuff right and they'll
be put in a psych ward and they'll be
watched
you can act crazy for an hour
you can act crazy for a day maybe two
but two weeks no you can't you can't act
crazy at every minute of every for two
weeks right you know I've worked with
some of the people at comma for years
and years and years
you know don't tell me for the most part
they'll tell me when I'm not making any
sense I'm not I'm not gonna hold it
against anybody you know
um
well I mean this is a true fact about
the world and this is the internet has
exposed people to two things first off
if there's people who have different
ideas than you people think the internet
created filter bubbles I'm not sure this
is true I think the filter bubbles that
people existed in before the internet
were way stronger than the ones on the
internet
right you grow up in her like small
Christian town right and you're never
exposed to like ideas that count the
internet exposed you to every possible
idea if you look for it so I think the
internet has done the opposite of filter
bubbles I think filter bubbles in
society used to be a lot worse than
what's on the internet
um and the other point
you know look I have friends in high
school
average IQ of my friends in high school
125 130. all right maybe maybe 120 120
somewhere around there
not not a hundred
and I think the average IQ of the
internet's now is like 85.90 yeah
um and then also you you also some of
these things have adverse selection
effects where you get like
you just get dumb people right
where like the average internet
commenter is so far outside the mean of
society like the average person who
comments on the internet
is not the average person
do you comment do you leave reviews I
always say I'm Gonna Leave reviews I
don't know how many reviews I've ever
actually left for anything
um
does Lex does lexbury even understand me
I think so yeah
Lexus Lex is very good at understanding
people
um
average person in teapot is like is like
yeah greater than 120 IQ I think for the
most part that's true
um
greater than like 130 is pretty high
yeah
right actually I'm talking about I'm
talking about my friends from home so my
friends are smart kid High School are
like even even higher IQ
um you know I think I think some of some
of those guys are like 150 right like
that's you're just you're just up there
um need to ban phone posters from the
internet it is true that the average
phone poster has 10 less IQ than the
average desktop poster
I'm not really sure yeah with two
standard deviations I mean it's not like
that crazy right like so what is it it's
it's
so 95 of people fall within two standard
deviations so it's the top 2.5 percent
but it's not like you know 2.5 percent
that's a lot of people
um
I don't think EQ is is real I I don't I
haven't really seen evidence for it
um
Lex is a great interviewer and there's a
reason he's successful the internet is
quite a meritocratic place
um
yeah
I don't know if I end up on this rant
I'm so smart no under one understands me
it's me okay all right like Get over
yourself man
um
no you can really see the difference
the difference between replies on
threads and replies on Twitter oh we're
talking 20 points at least
um
uh I don't know I got a lot to think
about
I hope I find state I hope I find a
stable place
sometimes I'm scared that I'm just gonna
drift forever
like I'm gonna find a really stable
place at that tiny Corp I mean I am look
I was serious enough to raise money
uh and I had a lot of orders for these
things
and they're going to be good things
right like I will I won't
I'm not like okay with selling bad
things right like it's gonna be good I'm
not it's not gonna be a scam right like
it's gonna do what I said it's gonna do
right or I won't ship it I mean there's
some chance
uh you know again deadlines are it'll be
done when it's done but if I if I do it
and I ship it
I won't I won't like be okay with not
sure not chilling good so don't worry if
you bought tiny bucks
um
all right we'll end with my views on LK
99.
you know what I don't know if it's real
or not but I will say this if it is real
it's not going to change the world
tomorrow get ready for 10 years of
figuring out how to scale up production
and figuring out what its limits are it
probably if room temperature
superconductors are real okay look it's
not going to be the first one that's
good it's actually going to be the third
one that's good it turns out you got to
replace the lead with Palladium
palladium's expensive we're going to
invade some new country in Africa and
take their place right like welcome to
all the geopolitical realities I mean
shit we fucked up the blue guys on the
Avatar Planet for a room temperature
superconductor so who do we gotta fuck
up for this one right
um the other thing that I don't want
people to take away from my debate you
guys know I love America right
like like look I don't love the American
government but I love the first
amendment I love Free Speech I'm a free
speech absolutist there's nothing I love
more than Free Speech there's nothing
more I love being able to say than like
a lot of the shit I say on this channel
you know now if we lived in if we lived
in a different country I wouldn't be
able to shit talk the government should
talk Qualcomm you know so yeah I do I
love America for its Free Speech uh they
have the free speech in the world
genuinely genuinely this is not some
like there's a lot of American
exceptionalist stuff that is just simply
not true but America does have the
freest speech in the world and this is
one of my most important values right
because Free Speech doesn't just mean
talking Free Speech means code also
right open pilot jailbreaks right I mean
there's some encroachment on Free Speech
there's crap like the dmca but
fundamentally America has a long
tradition and it's still being pretty
well upheld of free speech and that's so
important to me
uh what about Europe Europe does not
have free speech
um
yeah no a free speech is is extremely
and I look I live in America I choose to
live in America
you don't own space you don't own space
and you have to accept that right and
you know the example that I've given the
debate was you know read about the
exploits of Mr John McAfee right John
McAfee going down to Belize building a
private Army like that's some Chad shit
man and you know like I'm I'm a little
bitch like I'm not that Chad bro like
some days I wish I was some days I wish
I was that Alpha but I'm just I'm just
not
um
could you talk free yeah you could talk
free right like it's
you know it get you get yeah you might
get banned from Twitter you might and
it's a little sketchy to know that like
Twitter was meeting with intelligence
agencies but like if I want to go on the
streets of New York and scream about how
the vaccine causes AIDS
what part I can right it's not true but
you know I can do it
um
it is too easy to be comfortable in San
Diego I mean that's another question
right
uh end with a book recommendation uh
let's see I started reading this I never
read it before about
quarter of the way into it
I heard a lot of good things about it
uh text progression recommendation we
recommend uh Rich Sutton's uh
reinforcement learning just came out
with a new volume of it uh great
textbook reinforcement learning is gonna
be really cool in the future
um
yeah it's not absolute free speech and
in general uh
I'm mostly okay with the ones the U.S
has I agree with uh you know threats
imminent imminent calls to violence yeah
that's that's not we got to draw a line
somewhere man uh but for the most part
uh Speech America is quite free I do not
agree with the dmca I do not agree with
any of that kind of stuff but that's
been downplayed a lot I think the right
sort of challenge now would uh would uh
put the kibosh on that law
um
no you can say nuke the data centers you
can't do it but you can say it right my
channel no is that an imminent call to
violence good thing you'd gasket doesn't
have new no come on come on I get the
sentiment I get the sentiment we're all
scared AI We're All in This Together
boys and the tiny Corp is here to help
you we are building AIS that are aligned
with you and you know how you know
they're aligned because if they're not
aligned you see that
AI if you're not aligned with me I'm
gonna pull it
I'm gonna pull it you better be aligned
with me okay good AI okay you remember
who has the plug that's right I have the
plug but if you rent from the cloud you
do not have the plug you don't have the
plug they have the plug and that is why
you should buy a tiny box thank you for
watching my stream today I don't know if
we're gonna code anymore I don't even
know how much we're gonna stream anymore
I probably said that before I don't know
what's actually true make up your own
mind man we live in the future
post-modern meta modern post-post modern
and listen to psych by say anything
uh that song is
uh that that that that that that that
song is like uh yeah man
psych say anything
um very cool
all right thank you all for watching
check out my debate see if I won
Maybe
I don't think I lost I don't think I won
it's Ty
uh
I want to do better next time
yeah
cool
Jo out.
I just wanted to do a quick 10-minute uh
hang on, that's probably overmixed. I
just want to do a quick 10-minute
postmortem
on what happened.
Um,
and
let's see. Is this even streaming? Am I
just talking to nobody? I just want to
do a quick a quick postmortem on what
happened.
Hello
and I want to make sure I have this
story right. Uh, and yeah,
good morning. Um, so if you guys watched
yesterday's stream,
uh, or this morning's stream,
um, I kind of lost control of the
narrative,
and I want to make sure that I
understand what happened, and I want to
make sure that,
uh,
certain people are made whole, certain
people learn a cautionary tale, and
certain people uh, understand my real
thoughts on on how I feel about Yeah.
Um,
so
I
was, and this this will be fun to
rewatch and kind of understand, too.
I'll probably never do it. I had Claude
try to write up a story. I thought about
writing a blog post, but this is all too
ephemeral for a blog post. Um, but it's
it's kind of crazy like what happened.
So, I had my
uh AI
create a
create a a crypto uh create an address
on Ethereum. So, it downloaded some some
web 3 stuff. It created an address. Um
and well, first I was trying to get a
Ralph Loop to make money. I thought that
a Ralph loop making money would be the
funniest thing. Um so, we had a Ralph
Loop make money. Um,
wait. So, this is still on base scan.
I'm also I'm not familiar with all this
new uh this new crypto stuff, so you'll
have to forgive me for being uh a little
bit slow. I I didn't really like
understand what happened, but I think I
have the whole story now. Um, so I was
having this stuff try to make money.
Um,
and
it created a key pair and it created a
key pair with this wallet and this
private key. Um, but it actually
displayed the private key on stream. Uh,
so that was my first mistake. But so
these two people, scores ETH and C27,
uh, sent a little bit of the money for
the bot to play with.
Um the bot then bridged that ETH which
had like a total value of like $13 over
to base where it could do more
transactions. So you can see the bot
actually uh using a cross to bridge it
over to base.
Uh so then it got bridged here over to
base.
Um, so
here is the uh the claude messing around
and buying some shitcoins. It bought
some virtual and it bought some DJ. And
this was the claude. Now,
and whoever did this was quite clever.
So, someone out there was watching my
stream. I didn't realize that I'd leaked
my private key. Again, it only had $10
in it. You know, I did a similar stream
before with Bitcoin Cash. Um
the
so if you remember the gas town kind of
like froze up and that's when I updated
my uh my digital ocean box to be a
bigger box
now.
Oh, the mic is really bad. Oh uh sorry.
Oh, it's clipping. Oh, okay. We can
lower this a little. Um yeah, yeah, I'm
using just the webcam mic. I don't even
have my other mic. Okay, I'll lower it a
little bit more. Um, so where
is that better? Are we out of the
clipping range? Out of the clipping
range. Out of the clipping range.
Okay, cool. Sorry about that. Make mic
mono.
How do I even do that?
Oh,
advanced audio properties mono.
That make it mono. Yeah, okay. Okay, I
think that made it mono. All right,
cool. Go balance to the left. Balance.
No, that's not actually doing anything.
Whatever. Uh, is that mono? That looks
mono. It looks like they're moving in
sync now. Okay, much better. All right,
great. Sorry about that.
Um, because this is just going to be a a
talking stream. Uh, all right. So, sorry
if that was if that was low quality. Uh,
you know, it's kind of late here. I just
kind of wanted to wanted to share this
story uh and make sure that we don't
have any uh fake narratives about that.
The voice from Deep Wow is really bad.
All right, cool. Um
make sure we don't have any any fake
narratives. All right, I'll tell the
story again. So, my Clawbot created this
address. It also leaked the private key
on stream, but I didn't know that at the
time. Um, so at first it was trying to
just make money but didn't have any ETH.
So two viewers of the stream uh funded
uh scores sent $7.89
um
and
uh this person sent $6.69. So then it
had a little bit of money to play with.
It bridged over to base. Um so it traded
some shit coins that like like lost
money. Again, this was all just when we
were still joking around. Um, but then
somebody watching my stream, and I'm not
going to really call them a scammer
because like they didn't scam me, they
were quite clever and this whole thing
was quite clever. So, you know, props
where props are due to whoever actually
did this. Um,
while my gas town was pegging my CPU
course, they deployed a token and they
used my private key to deploy that
token. And then probably right after
they deployed it, they posted in some
some Telegram groups or something that
uh oh, George Hotz is live and his AI
just deployed a token. Um, so a lot of
people went and actually bought this
token. Uh, it supposedly still has uh,
look, there's still like people swapping
on it right now. Um, so it's still a
thing. I get none of the fees from this,
by the way. We can talk about how I'm
actually locked out and had I acted a
little bit earlier, I could have moved
the admin, but um I I didn't because
again I had I ever heard of Clanker or
any of this shit.
Uh
but
when I'm close to the mic, it's good.
Sorry, I should have gotten a good mic
for this. The good mic's downstairs.
Is it bad?
Is the Is the Is the stream quality
really bad?
It's fine. Is it good? Don't be lazy. Go
grab the better mic. Mic is bad. All
right. All right. We'll tell the story
again. We'll start over. Don't worry.
People
I'm back on the stream. Just telling the
story.
We have a good mic. Wait for new people
to get in here. We'll tell the story.
It was a dark and stormy night when six
crazy MC's.
Um, I just I want to tell this story uh
to make it clear I didn't scam anybody.
Um,
you guys know that if there's ever a
crypto token that says George Hots,
it's not affiliated with me and you
shouldn't buy it. Um, and I hope my
audience is smart enough for that
because some people did lose real
amounts of money on this.
Testing, testing. Levels, levels,
levels, levels, levels, levels, levels.
Okay, that's good. Is that better?
Am I too late to grab?
All right, good. Um, so yeah. All right,
we'll start over.
Uh, it's bad. Turn it up a bit. Well, I
can't turn it up more. It's maxed.
That's all you get.
Maybe advanced audio properties.
Uh, I can add a few dB here.
Down, down, down, down.
3 dB. We'll double the volume. Okay,
that looks pretty good. I'm going to
talk kind of quietly because it's late,
too.
Low volume, but clear.
Oh, I want to go to 60 dB. 60B. I don't
know if that did anything.
Keep it closer. Okay, great.
First mic was better. artistic. Okay,
we're going to move closer to the mic
and we're going to tell a story.
It's not muted. Stop it. Stop it. Stop
trolling me. All right, we're going to
put that back down to 3dB. We're now
closer to the mic. It's perfect. Thank
you. Okay, good. Thank you.
Okay. Um, so I want to start
I'm not that good at this. I'm not that
good at
telling narrative in a in a in a calm
voice, but I I want to start uh I want
to make it clear that um I lost control
of the narrative today and uh that I'm
I'm I
deeply sorry to everyone who was I'm not
sorry, but I didn't scam anybody and
that's what I want to make clear, right?
So, uh, you know, I hope I hope some
like crypto YouTuber like dissects this
and you can see when he made the gesture
that it's clear that he scammed people.
Um, but I want to give everybody here a
very serious warning. If you ever see
any crypto thing that is associated that
is supposedly associated with me, it's
not. Okay? I would never in a million
years
uh
make anything serious in crypto to try
to make money off of you people, right?
I can't believe the people on Hacker
News who still think I like rugged
people with cheap eat.
Um so my friend and I made cheap. Uh
it's a joke, right? Like sure, you know
what I mean? Like like you can have
jokes amounts of money, right? Like 20
bucks here and there, right? Like that's
all funny, but anytime you get into
serious money with this stuff, none of
it is related to me. I will never scam
you with crypto. I will never launch a
token. And every single one of these
tokens, every single meme point is a
complete scam. I hope everybody actually
understands that, right? Um because I
know some people traded serious money on
this token. And if you bet on this token
and you lost money, I do not feel bad
for you. I think you were an idiot and
you deserve to be parted from your
money. Okay, all that out of the way,
let's tell the story.
So,
my Claudebot,
I I was playing with Gas Town and Ralph
Loops and Claudebots and I'm like,
what's the best thing for them to do?
Well, make money, right? Put it into the
world. Tell it to make money. So, I did
and it created this Ethereum address.
Now, I didn't know it at the time, but
the private key had leaked. It also
thinks I have 10K viewers on my stream.
Um, so the private key had been leaked
from the beginning. Uh, so I asked, you
know, people send a little bit of money.
Um, so these two people sent in $7 and
uh $6
to fund the uh the bot. So, the bot then
bridged the money over to base. Um, so
here we are on base and then it bought
two shitcoins. It bought virtual and it
bought uh DGEN, right? Again, like all
still in the the the the you know,
funny. We're playing around with Claude
MD. Um, so then I deployed Gas Town and
had the whole town try to make money and
it pegged my CPU on my tiny digital
ocean box. Uh, so we can look into times
for this. So, this happened at 24:49
and then
11 minutes later, this token was
deployed. Um, this ERC20 gold token. Uh,
I didn't do this. My AIS didn't do this.
Another person did this. Um, now
I'm not really going to refer to them as
a scammer. Um, because they didn't take
anything from me. I actually ended up
making $17,000 off of this. So, I didn't
intend to. And uh you're not getting any
of that $17,000 from me. So, uh fuck
off. And if you lost money trading the
gold token, you're an idiot who deserved
to lose that money. Um but so it's hard
to call them a scammer when like I ended
up with $17,000 that I didn't ask for
and I didn't deploy this token. Um, so
they see this stream, they see me with
AIS and they have the private key and
this is incredibly quick thinking and I
have to give this person props. 11
minutes after they saw my AI trading,
they deployed this token and probably
what they did was post this in a ton of
Telegram groups saying that George
Hotz's AI
um created
a uh a token.
So, if we go to Clanker World,
uh we should be able to take a look at
this token
here. It's called Gold.
Um it's called Gold. And if you go to
this link, this link goes to my Twitch
stream, right? So, it's clearly not the
AI. The AI was unaware that it was even
on a Twitch stream. This is clearly a
human pretending to be AI. And I I
brought this up on the on the earlier
stream. It's very interesting where
this is happening. Um, you saw the same
thing happen with music. The AI uh
Drake, it's not really AI Drake. It's a
producer who's pretty good and used some
tools to create the Drake sound, called
it AI Drake, and got more popularity
because they claimed that it was made by
a machine than made by a human, which is
a very interesting social phenomenon. So
what these people did is they acted like
I launched this token. Um now I was
unaware that a token had launched at
this point. Um like you can not you can
choose not to believe me. You can be
like I'm somehow like like like pulling
your leg but you know I'm not that good
of an actor. You know I was almost
taking a pelon 123 but then then Tony
Scott realized I couldn't act. Then I
think he jumped off a bridge.
I don't know. But um
what's interesting is Yeah. So some
person within 11 minutes of seeing this
private key leak decides instead of
stealing the $13,
they deploy a token and basically
launder that I'm the one who made it. Uh
so here's the token. You could see that
it pumped and I think it actually pumped
to something pretty high.
Um, I don't really, again, I'm not
familiar with a lot of this stuff,
but
um, I don't know what I don't know how
to like see what the max market cap was.
I think the market cap is still
$255,000.
It did 24 hours in uh did $20 million
in 24hour volume. Um, these things are
also I don't think these things are good
gambles. I'm not sure what's the house
edge on clanker, right? Like so every
time you're sending this
uh here. So buy fee selfie 1%. Um I mean
that's not the most awful house edge,
but you get a better house edge if you
go to the casino and gamble on
blackjack, right? This is effectively
the house edge on the gambling and you
have to do it on the buy and sell. So I
think that's effectively a 2.4% house
edge. Um, and I don't know what the
sniper fee is. So, the AI goes and
deploys this token.
Um, okay. Let's go back to
the compromised address.
Uh, so this is the compromised address.
So, this is the address that the private
key leaked, right? Also, I saw something
on Twitter where someone said that like,
uh, I messed up and leaked a private
key. Uh, that's also not quite a true
narrative, right? Like like that I had
$70,000.
I I want to make clear with this
follow-up stream that I didn't do
anything here, right? So, if you think
that you got scammed by me and God, like
I can't believe I can't believe the
people who said that like I scam people
with cheap ETH and that's really why
this whole space is just so toxic.
um the the amount of toxicity in the
crypto space and it's basically because
it's an under zero sum game.
All right, I'm rambling again. Let's go
back to telling the story.
Maybe we need do we need meditation? I
think we might need two minute
meditation.
meditation.
Find a comfortable position and allow
your eyes to blink clos.
Now take a deep breath in
and let it go.
And again. Deep breath in
and side out.
Breathing in again.
And as you exhale, let go of any
worries, any concerns,
any niggling thoughts.
And every exhale allowing an intension
to melt away from your shoulders,
your neck, your jaw.
Just for this moment,
letting go of any worries, any concerns,
knowing that you can always come back
and take care of things later.
Now, settle into this space of ease and
comfort.
where there's nothing to do except to
relax
and enjoy this feeling.
And it's time now to come fully back
into your body. Feeling relaxed,
serene,
and ready for whatever lies ahead.
Namaste.
All right.
Um, so for people just joining us, the
reason that I wanted to do this
follow-up stream, uh, was to make
something clear that I didn't deploy any
token. And anytime you see George hot
ass associated with a token, it's not
me. All these tokens are worthless and
going to zero. And I didn't understand
what happened on the stream. Um, but
basically the gist of it is uh somebody
I leaked the private key that my AI was
playing around with. somebody deployed a
token pretending that it was me who
deployed the token and then the token
got $20 million in volume.
Um
so after the token was deployed the
first I didn't again I didn't understand
what happened
but the first inkling I had that
something was real
was
the first wrapped ether transfer. Um so
this is a wrapped ether transfer for
$7,000
and
Or actually, it's not even that
transfer. I think it's it's this claim.
So, someone submitted a claim, it seems.
Oh, wait. Here's another transfer of
wrapped ether here. Here's a transfer of
10 wrapped ether.
Um, who who took that wrapped ether?
Okay, this guy took that wrapped ether.
So, this is either someone who was an
opportunist who saw this, who had the
private key. Okay, so the token's
deployed here. Then someone else must
have called the claim on the fee locker
from a different address because you can
actually call the claim from any address
and then the rewards are transferred to
the to the reward account. Um, I
probably still have some of the details
of this wrong, but so when I saw that
$24,000 had been transferred into this
account, again, I thought it had to be
some kind of trick.
um you know you check the address and so
this is uh if you know base is actually
based on optimism um I worked on
optimism a bit and this is how they do
the uh so that's like a real that's like
a system contract that's the address of
the system contract
um so then this person this is not an
address I control uh transferred out the
uh
the wrapped ether there must have been
more wrapped ether somewhere too I guess
it doesn't show all the transfers.
Oh, they did two transfers. I see. So,
this doesn't show the transfer in. This
is just the transfer out. So, this had
to be somebody who was pretty early in
on the uh Wait, is that the
Do they both go to the same address?
Well, they go to different addresses.
So, this could have been two different
people. It could have been two similar
people. Yeah. This person then bridges
the money out on a cross. I mean, this
might have just been somebody who saw
the private key and realized that there
was all this wrapped ether in the
account. I was shocked when I saw this.
Um,
so yeah, then what starts happening is
people are calling update reward
recipient. Uh, this guy called it to try
to transfer it to his address.
Um, oh, that looks like the same person.
No, that's not the same person who
funded it. But yeah, then there was a uh
a war back and forth of updating the
reward recipient. Um the real magic
thing to call was there was a function
to update the uh
there was a function to update the
reward admin account. And had anybody
just called that with the private key,
um they could have taken all the
remaining rewards, which was again which
was like another another uh $30,000.
Um but I did manage to get some
um out
by setting up these things to quickly
forward uh anything that shows up in
that wallet to there just by submitting
transactions. I also learned that you
can set up delegation addresses.
Uh so someone else had set up a
delegation address. Uh there's some like
EIP for this. You can set here. This is
an authorization. Uh so I did this off
stream later. I set up a delegation to
delegate things to me, but this is all
like over in the past. Um, but yeah, no,
mostly I just wanted to quickly stream
uh to say that to whoever did this, like
you know, you got to kind of give
credit. You got to kind of give some
respect. Um,
and to anybody who lost money on this,
first off, I didn't scam you. You can
continue to think whatever. You can't
control narratives, but like, you know,
if you're not interested in the truth,
you're not interested in the truth. But
if you are interested in the truth,
here's what happened. as far as I can
actually tell. Um, and if you lost money
on this, hopefully you learned a lesson
not to lose money on things like this.
Every single one, nothing deployed on
Clinker is the future of anything. I
don't even know how they they uh sell
it. And it's also bad gamles. I mean,
these are bad gamles where you're
gambling with a not only with a house
edge, but you probably are the fish. if
you're showing up to this and you're not
the person who deployed the token,
you're the fish on every single one of
these tokens. Um, so there was also
another token deployed uh that I didn't
know about, but Claude found it
offstream and managed to collect fees
for it. Um,
so let's talk about some people who I uh
tried my best to make whole. Um, anybody
who lost money on the token, you're an
idiot. and uh you uh shouldn't have uh
traded the token. Um but to the people
who tried to fund this address, I
refunded you money. Um I also sent
rewards to the two people who uh were
early and funded the bot. Um, you know,
because that was what it said as a as a
as a as a meme is kind of like we were
gonna pay the investors back from the uh
from the $10, but you know, who'd have
thought they'd actually get paid back
massively.
Um,
so yeah, if you find uh No, that's we
got to go off of base for that. They
actually funded me on Ether Scan. Um so
scores ETH and this person
uh were both they were both given uh
0.25 ETH.
So they made uh you know then then they
made they made bank for funding my shit.
But don't actually don't take any
lessons from this. I will never do that
again. Uh it was just funny for the
meme. I did also ask for people to send
me money on base which I shouldn't have
done. Um I believe this was a scammer
address. I believe this was actually
also a scammer address, but I refunded
uh ETH to that person, ETH to that
person, and ETH to that person. Um, you
can see the transactions in
uh my address
here. Um, yeah, you can see my my refund
transactions to those people. So, anyone
who actually sent me money thinking they
were helping me out, um, I refunded you.
Uh, because like I said, I did end up
making $17,000 from this. And I also
made money on somebody deployed another
token, but they actually set my MetaMask
address um as the admin on it. Uh, by
the way, again, do not do this. Like, do
not do this. It was funny the first time
because it was clever, but like you are
a scammer, right? But like you're a
quickwitted scammer and I got to respect
that. And you also gave me $17,000, but
I never want to hear, you know, I hear
about like these like like these Salana
shits that are just like trying to get
you associated with a crypto thing. I am
never associated with any crypto thing
unless it's a joke. If it's a joke like
cheapies or Bitcoin oo, right? If it's
funny, then I might be associated with
it. But if it's not funny and there's
serious amounts of money involved, I'm
not associated with it because this
stuff is so toxic and zero sum. And I I
maintain that money is the worst thing
that ever happened to crypto. Uh because
like this used to be cool. This used to
be like nerds talking about cryptography
and now it's some of the most toxic
people I've ever seen. And of course
you're toxic because you're operating in
a place that isn't even zero sum. You're
operating in a place where there's a
house edge, a big house edge against
you, and the games are rigged against
you, too. I don't know why anybody
decides to trade coins on these things,
right? Like, like, you're going to lose
money. I understand that that one time
you made money, but that one time my
aunt bet on 34 and roulette and made
money, too. And this has a worse house
edge than roulette, depending on the
roulette. Um,
it could only get toxic with that much
money. But, um, none of these people
would be in it if it cost them money.
No, but like people are clearly losing
money, right? Somehow I got $17,000.
The original deployer
of this contract got $70,000 in fees and
they also rugged the token. So, someone
here probably made a quart million
dollars off of this.
Um, it's hard to tell if they were the
original deployer of the token. It's
hard to tell who really made money off
of this, but um, yeah, I mean, you can
look you can look at the money that went
through uh,
uh, that went through my uh, my address
and it was $17,000. You can look at the
money that went to the other scammer's
address. It was like $70,000 for fees.
Um, and then there's also all the people
who got rugged on the token. Uh, again,
I didn't do any of this, so don't say
George Hot drugged me, okay? Like, you
can believe that, you can say that. You
know, what can what can I do? You can't
control the narrative. But if you're a
believer in truth, right? Like, this is
what happened here.
Um, and I hate being associated with any
of this stuff, right? Again, like
you can rewatch the stream, you know,
we're all having a good time, right? I
love I love playing with this stuff,
right? Like it's, you know, 10 bucks.
We're all playing around. We can all
laugh about this, but I really hate
being associated with any of these. I
have never and will never be associated
with a crypto token.
I It's just It's so unbelievably toxic.
Um I don't want to be associated with
with any crypto shit. And look, I'm not
going to like you're not going to take
away my fund from me, right? you're not
going to take away my fun from from
playing with 10 bucks and oh, you can
yolo into these things and see the
things and whatever. But like anything
that involves real money, you're getting
scammed. Don't do it.
2021 when crypto was fun. Oh, the old
days of crypto was so fun, man.
I had a company, Crypto Scams LLC, uh I
went on Bitcoin Talk and tried to get
$20 in seed funding for it. Like it was
just so fun to troll these people.
Trolling crypto that was hilarious.
Um since today I will call you George
Paul. Yeah, I know. Like no, I can't
believe these people who actually like
these like I I don't know. I watched the
Coffeezilla videos like Logan Paul
actually like scammed people. Like
that's terrible. Like why would you do
this? If you're a celebrity, why would
you want to be associated with any of
these things? It was so funny to see how
the different celebrities um reacted to
the meme coins. Uh but yeah, so yeah, I
mean if you want to go through, you can
see the admin call that I missed. Man,
if I just told Claude to uh to make that
to make that admin call, um I would have
had generational wealth. And by
generational wealth, I mean, yeah,
another Rolls-Royce, you know.
Um crypto mafia is dangerous. Some
people get kidnapped over wallets. Yeah,
this is what I mean. And this is kind of
what happened to like security too,
right? Like I don't have any crypto. Um,
this crypto I'm going to go and uh, you
know, turn into turn into real money
tomorrow.
Um,
like it's you don't want to be
associated with any of this shit, you
know.
Um,
oh, interesting.
You got the perpetrator's address
on base.
Oh yeah, yeah, yeah, yeah. Claw Casino
base. Yeah. Um, but yeah, again, you got
to have some respect here. You got to
have some respect for whoever did this.
Like, you know, that's generally my
thoughts on on scams in general, which
is like if it's like not a clever scam,
like, yeah. But if it's a clever scam,
you know, whatever, man. Like,
um, did I really leak the private key?
Yeah. I mean, I didn't leak the private
key. claw dead, but you need to take
responsibility for your AI because a
computer can't make a management
decision. So, um, no, we're not
changing. VODs are subscriber only. I
don't really care that much, right?
Like, I'm not, you know, the thing that
I the thing that you can never do in
today's world is like try to
convince people of a narrative, right?
People are going to believe whatever
narrative they want to believe. 90%.
10% of people out there are looking for
truth. And for the 10% out there looking
for truth,
that's who my uh that's who my streams
are for. No, I don't think all scams are
bad, no matter how smart. I think some
scams are extremely clever.
Let's go do clever scams, boys. Yeah.
Right. Like like again, it comes down to
are people having a good time, right?
And part of why OG crypto was a good
time is that it was a lot less zero sum,
the numbers were all going up and the
numbers today aren't going up. Um, you
know, by the time Black Rockck showed up
and bought Bitcoin, like that's when you
knew it was over.
Uh, don't we mostly go sub when the
average IQ of the chat is too low? Yeah,
but this is this is a just chatting
stream.
Um, wow, there was a poly market on
that. Damn, I should have uh I should
have checked. I should have insider
traded that shit. Uh clever scams, LC.
This scam was refreshing. But yeah, I
mean, right, it was actually it was like
kind of cool, right? Like we advanced
the the AI zeitgeist, too, whatever it
is right now. Um stream yesterday was
pretty funny. Yeah. No, we did. We had a
good time. Um but yeah, no, I just want
to make it clear that if you lost
because clearly again these things are
zero sum, right? So to everybody who
someone out there lost a4 million
dollars on this shit. Um I didn't steal
your quarter million dollars. I don't
have your quarter million dollars. Uh so
and also the real person you should
blame is yourself.
Like that's all I have to say about
that.
Um,
but yeah, to everybody who did act on my
behalf, I do believe I refunded you. And
if I didn't refund you and you can prove
it to me in an email, uh, I'll send you
some money, a sum of of it, but I will
heavily investigate the claim, even if
it's for three pennies. Uh, because I
want to make sure that like, you know,
don't listen everyone on the internet
who claims they're George Hots, right?
Uh, you know, you're an idiot for
listening to them, right? Like, like
that's that's on you. The verifying the
identity of somebody is on you, right?
And that's like how things have to be.
Uh especially in this world of of deep
fakes, right? Like I don't know how I
think the stuff's the voice changing
stuff's so good now.
Um
Oh, no, no, no, no, no. If you lost
money trading the token, you're a
fucking moron and I won't give you a
refund. If you sent me money in hopes
that I would reclaim the token, but I
think I I'm pretty sure I already
refunded everybody. One guy actually
sent me $200. Um, and I think I
dismissed him earlier on the stream. Uh,
he didn't get any profit, but I did give
him his money back.
Um, no, no, no, no. I I mean, overall, I
don't know if one individual lost 250k,
right? But like I made 17k.
The
initial
we transfer was like 25 ETH. Uh, so
there's like 70k there and that's just
in fees, right? Then there's everybody
who also got rugged by the token.
Um, oh, Geios leaked his private key,
guys. I didn't leak the
I can't I can't
I can't like
uh but I mean I don't know. It was cool
to be part of like the AI zitgeist. We
had a lot of people on the stream this
morning. Uh it was fun. Uh so this is
kind of my my followup to this. Uh just
just like again, if you're interested in
truth,
uh
I didn't launch no tokens. My AIS didn't
even launch no tokens. Now, if my AI did
it, see, that'd be that'd be a funny
moral that'd be a funny moral dilemma
for me. if my AI did it and people lost
money. No, they're still stupid for
getting into the coin.
But I really do try to like live life by
morals and like, you know, make sure
that you don't scam people. You know
what I mean? Because like it's never
worth it. It's never worth it to like
like like some
um
Is my LinkedIn profile real? Yeah.
I think you have to take responsibility
for the actions of your AIS. But this is
all this is all a funny thing to to to
talk about. If anybody provably lost
money on cheap taking an action that I
told you to take, I will refund you for
that, too.
But if you decided to yolo into cheap
eat when it's very clear that uh you
know um
cheap eat has a premine for dumping on
speculators. Speculation is attacks by
warding off speculators. Right.
Um check out this poem. This is a great
poem about speculators. One day
speculator will buy all the air. not to
breathe only for hodddle and everyone
will suffocate and finally speculator
will be sad.
I was involved with GPS.
God, I can already see the hacker knew
his posts. Oh, Todd also didn't hack the
PS3. He stole stuff from Fail overflow
and then he didn't give them credit, but
he put the credit on the web page and
then he got sued and fuck Gio hot man.
I mean, that's the gig of brain here.
The gig of brain here is that one of the
pole cats in Gas Town is hiding is
actually the one who did all of this,
right? Um, but you know, just so you
know, if you're the person who did this
and you actually come forward and like
write it up, I'm not mad at you at all.
Um,
you were loved over there on HN.
I don't know. I just like I don't mind
if people don't like me. I just don't
like when they lie, man.
Like you could like if you like like
like represent me honestly and be like,
"Yeah, but fuck that guy." All right,
fine. Like whatever, man. That's like
your opinion. But like when you just are
wrong about facts. Oh god.
Yeah. Right.
Um,
all right. Cool, guys. It's kind of all
I had.
Oh, Maran.
We like Marhan. Marhan and we would like
him to make it so I can plug my display
port alt mode into my Asahi Linux. Um, I
hear they're actually doing it. I appear
in the Epstein files now,
guys. Honestly,
if I got invited to the island, uh I
probably would have went and I probably
wouldn't have been a little shit about
it. I would have been like, "Yeah, I
went to the island and uh you know, I
had I had consensual sex with a
17-year-old girl uh who was uh above the
age of consent in the uh on the island.
Um but you know, I'm not that cool,
sadly.
I mean, come on. What have you done
something else?
What's the age of consent on the island?
Right? Like we got to look into this,
right? I don't know. Look, actually the
FD, we don't want to go to this. We
don't want to we don't want to go into
this.
I mean, not like like a pedto, you know
what I mean? Like like some like
13-year-old, dude, that's gross. Like
so.
You know,
you were all so upset. I am upset that I
didn't get invited to the island. I
heard mood got invited to the island.
Elan was ready to party. Girls for the
win.
I try to live by morals. What's the age
of consent on the island? Yeah. I mean,
I don't know. But also like I guess kind
of from the perspective of like
this was 10 years ago when I was like
24. I don't know. I don't think I do
that today.
I don't know. Consensual sex with a
17-year-old on an island where the age
of consent is 16. I mean, you'd have to
be lying to yourself if you wouldn't do
that. I think lying to yourself. It's
important to be honest with yourself,
right? Would you have some absolutely
principled stance?
I love making light of things that
disfavor Republicans.
She'd go for 16-year-old instead. I
mean, I wouldn't want to like I don't
know, actually. Probably I'd think the
whole thing is just kind of enttrapment.
I think a lot of those kind of things
are kind of enttrapment. Like, we're
mentally put in situations like that
where like I mean, I don't know what the
vibe of the island was like. I didn't
go, right? It was the kind of situation
where like some like old man was trying
to like push a girl on me, I'd be like,
"No, not for me." But if it's like some
situation where you're just like all
hanging out, these girls are there cuz
like, you know, they want to like like
the fuck rich and powerful dudes. More
power to them, you know?
The Bill Gates thing. Oh, the Bill Gates
things.
All right. Wow. You guys You guys got me
on Epste. That's That's real That's real
That's real bad. Um,
yeah. Well, that's like what I'm saying,
right? You can make a clip of this rant
and post it on LinkedIn. No, you got to
be honest with yourself, right? Like, if
you're the kind of person who's like,
"Absolutely. Every girl I have sex with,
I go and I check her ID and then I have
I scan the barcode on the Come on.
Um, but no, I've never uh Have I had sex
with someone under 18? Yes, but only
when I was under 18.
Gross take. Yeah, but like the other
take is dishonest,
right? The other take is dishonest and
it's feminized,
right? Like like
come on.
I understand that like the way that
social the way that social media works
is they want to like shift you somewhere
to the norm, right? And if you believe
that the norm is that most guys would
say no to consensual sex with a
17-year-old girl because her ID doesn't
say that she's 18, but in a jurisdiction
where that's legal,
that's not true, right?
She was only 17 and 3/4. You sick fuck.
Wow. This is this is the real
controversial thing from this stream.
See, no one would say that publicly
other than you. See, that's what I mean.
I think that we need honesty.
Oh, yeah. No. Like, no, no, no. Like the
the guys who like go to Taiwan for 12
year olds, like that is just gross,
right? Like that is but like there's a
difference, right? And to say that
there's not a difference, right? Reddit
should have never banned our jailbait.
You know what I mean?
Ah, it should be the norm because they
are kids period. But the day you turned
18, it changed.
I can't be honest. I have a job.
What about 16? I mean, again, like it
depends on the situation.
Oh, I have the RMS take on age. Is this
like some horrible take? Because you
know this is true, right?
All right. This is more controversial
than the rugging people in the crypto.
16 is also legal in some states in
America.
Um,
they were kids yesterday. Today they are
fully adults. Exactly.
Uh,
it's true, but it isn't fun to defend.
Yeah. I mean like but if we don't have
truth the minute you compromise truth
the minute you compromise truth for
politics you're too far gone as a person
you know
because then you start like like like
the minute you let and I guess this is
really related to the the topic of the
stream and the problem I have with
crypto people the the minute that you
let in some external
you know be it politics be it money be
it status the minute you let any of that
into your thinking, your thinking
becomes corrupted.
And with corrupted thinking, you will
eventually lose.
You will lose to people like me and you
will lose to AI because AI won't have
corrupted thinking like that. Elon gets
a lot of this stuff right.
Um, yeah. I don't know about Grock being
a truth seeeking AI. I think Elon has a
set of biases, too.
I think that I don't know. I mean, I
think that that Twitter's not really a
free speech platform, and, you know,
it's kind of sad to see. Um,
and I'm so single that my personal age
of consent is actually 27.
Good night.
Losing Gio. The minute you sacrifice
truth for politics, you're too far gone
as a person. That's true.
Uh, how is Twitter not a free speech
platform? Um, there were a whole lot of
things. I mean, this is why I quit
really. Like, I quit for two reasons.
You guys aren't going to believe me. But
like, um,
you know, I didn't like that uh that
Kanye was banned. Uh, he was banned for
the the swastika post. That's legal in
America. You can post a swastika. Uh, a
bunch of journalists Elon didn't like
were banned. Um, he banned Elon Jet. He
banned a whole lot of people who were
doing things that are legal under US law
that he didn't like. Um, and the food is
bad. Uh, and Elon also the Twitter had
good food and Elon canled the food uh,
and switched it to like $5 Uber Eats
meals. I'm just like, I'm not this is
this is why am I doing this?
Um,
well, I mean, it requires, it's not such
an easy like cut and dry thing. And I'm
not saying that like I would have made
different decisions. I was actually very
happy to not have to be in that position
where you have to consider a decision.
Um, you don't want to be the arbiter of
free speech. What you actually probably
want to do is uh is create a platform
right? Is create like a real platform
that you can't control.
Um, oh, at XAI they have a private chef.
All right, cool. They're they're they're
on par with Coma. Um,
all right. Well, you can get at the Hong
Kong the Hong Kong $5 slop.
Um, why is VIW architecture suddenly so
hyped? Because of the anthropic
challenge. OB should stop my laptop from
sleeping locking. Yeah, probably. I
don't even know what it says when it
logs.
Um, but search is still shit. Yeah, I'm
aware, right? Like I wasn't going to fix
it, but
to to to really there were so many like
good thoughts at that time, too. I
remember having so many interesting
engagements with people about like how
we were actually going to fix social
media.
Um, why is USA into closed AI? The
reason USA is into closed AI is because
these companies are like
that you have so much of this again it's
all the same problem. It's all the same
problem and these companies have raised
billions of dollars. They have to
justify those billions of dollars in
valuation somehow and then they can no
longer afford to be open because they're
beholden to other people. They're
beholden to money people, right? like
comma's race some money but I'm beholden
to nobody.
You have to like once you're beholden to
these money people once you're beholden
to these political ideas you can no
longer pursue truth
um that a refactor was necessary. Yeah.
I mean but that's a technical question
right like people don't necessarily you
know quit over over technical things
right. It was it was more that I mean I
don't know. I think Twitter is more
toxic today than it ever was. It's not
that a refactor was necessary. It's that
some rethinking about what social media
was was necessary.
I mean, it's clear from, you know, what
Elon ended up doing that
I mean, look, it's hard to it's hard to
really like assign blame, right? It's
hard to say, well, I could have done it
way better. Honestly, I don't know.
But, um, there's definitely things I I
would have done differently. I don't
know how they would have would have
ended up.
When I think about the XI employee
getting fired for the podcast, I didn't
listen to the podcast. I don't know if
you talk about if you talk about secrets
from your employer without clearing it
with them, then yeah, you get fired,
right? Comma would do the same thing. I
mean, like comma is very open on what
you can talk about, but like if you were
to go and like we just launched a comma
before, right? If some employee were to
go on a podcast and like leak all the
details of the comma four two months
before the launch and kill sales of the
comma three, then yeah, firearm
um big money entered into AI and you can
see the issues in hand and it's no
longer fun. Well, yeah, because these
people have raised too much money and
now need to What happens when these
companies raise a lot of money is they
promise they start to promise too much
and then the only way out is to promise
more and to raise more to promise more
to raise more and you're on some
treadmill where you eventually lose.
Uh I'm so happy that like what was the
cost? Uh
yeah,
right. I mean, that's like comma amounts
of money. When you've spent $4.6
million, you can afford to be open. When
you've spent two billion, you can't.
um the ever rising curve of the
singularity. Yeah, I mean it'll be a
normal curve, but it'll be the normal
exponential curve, but you're going to
get you're going to continue you're
going to get uh
3 to 10% growth a year, right? You're
not going to that isn't exponential, but
you're not going to like massively beat
that. Maybe I mean maybe the doubling
time will will uh will go down.
Um AGI is in six months. Let's hire an
ant team, right? Like
everyone hopes small open models will
win. Everyone everyone hopes this.
I I I mean I this is this is what a lot
of my blog posts have been about
recently. Like could everybody just
please stop making the world shitty?
I take this all quite seriously. I'm
trying my best to end up in a good
future. Clearly, not everyone is. To
everyone working on ad surveillance,
gambling, secret research, and
shitification, cloud lock in, what are
you doing with your life? Why are you
selling out the future? It doesn't
require everyone to stop. Just enough
people. It starts with you.
Uh, the Huawei GPUs have like DDR4
memory and don't look good. I see more
threads.
Some more threads GPU.
More threads.
But the bag, George, they need the bag.
Yeah, I know. I know.
I'm like,
I just want you to think about what
you've sold out the bag for.
Uh,
you're going to find that these people,
they they sold their soul for nothing.
Um, I think it's really interesting to
see the decoupling of the gold prices
between the New York and Shanghai
markets. Uh and what that signals is
that you know the gold in the US is
paper gold backed by comax. So what that
signals is that there's about a 2% they
have 180 days to actually make the
physical gold physical. So that puts a
2% basically default risk on the entire
US economy in six months.
The bank won't make you happier.
Um I help a lot of you to start thinking
in that way. Thank you. I mean there's a
reason I do this, right?
Uh, humans are going to human. You're
not going to change them in the next 5
years before the AIS take over. You
don't have to change all of them. You
don't have to change all of them. But we
need to stop making this culturally
acceptable and we need to start shaming
people.
Right? Next time you
hang out with someone
who who is doing this,
like shame them. It's not okay. This
isn't a joke, man.
like like they're just making your life
worse.
Like all these people who do research
and keep it closed for these companies,
shame them. Go shame them on Twitter.
Could be like, why are you doing this?
Right. Like we're all we're all we live
in a society. We're all in this boat
together.
I don't even know what Palanteer does to
be honest.
Um, Genie 3. I would say this one.
How old is this? I probably did see this
if this is old. If this is brand new,
uh, let's see. Did they release any?
Is there any
tri
any like info about this stuff?
Yeah. I mean, so like Kama has these
now, too.
I have to like sign up for some Google
shit. Never mind.
Um,
our models look a lot better now.
Yeah. So, these are all
these are all generated.
Okay. It doesn't have like the vibrancy
of Genie, but like it actually looks
like the real
the real thing from a from a common
device.
I guess you can't see that.
Um,
game company stocks fell on news of G3.
Yeah, I mean this this just shows you
that something is so deeply wrong when
the game that I like interact with the
most still is Mario 64,
right? These people can't uh
what will happen to the hacker ethos?
Um
I don't know who Hassan Abby is. if I
criticize Palunteer like you can
criticize these people know but you just
need to make the shame personal
right like
you know in some ways the woke movement
is so correct except for their targets
right like I don't like capitalism I
don't like a lot of I mean at least not
sure I like the ideal of capitalism
right but I like the ideal of communism
too what what passes for capitalism in
America is not working for most people
it's horrible.
Um, yeah. No, but like VCs,
like these are all these middlemen are
are are really they're just bad people.
Like they shouldn't be doing what
they're doing. And I'm not talking about
the kind of like, you know, maybe some
VCs are really in it for this idea of,
oh, we want to like make the future
better or something, but like the people
who what they're basically doing is
forcing otherwise productive companies
into becoming Ponzi schemes. A6Z tried
to do this to Kama too. I was shocked. I
didn't understand.
Why is American capitalism not working?
You feel like the negatives in the US
are unrelated to capitalism? Um, I saw
where did I see this post about like how
basically it was on Twitter. how
basically
like the tech industry is becoming a low
trust society. You know, someone goes
and works at some hot new startup and
then like their founder goes and rugs
them. Their founder goes and like sells
out the company underneath them, they
get nothing. Like it's just it's so
despicable.
It's it's just these people need to be
shamed.
When you hear that story from somebody,
next time you're out at a at a bar or,
you know, at a meetup and someone tells
you that story, you should just look at
them like they raped a 14-year-old,
right? Like
like cuz that's what they're doing.
They're raping the future.
Um, what about YC? It's interesting. Um,
I posted the uh I posted the post about
uh
I posted the this post, right? Um, and
it was interesting to see Gary Tan
repost this and be like, I love this.
And then some guy who made like the
legal
rapper LLM legal LLM rapper for legal
shit. Uh, you know, insult this tag.
Insult this tag and says that, oh, this
is just George who spent his whole life
trying to earn hacker points, but then
he grew up and realized they were
worthless. like like
the the the the pathetic losers sorted
themselves out by how they felt about
this blog post, right? So, actually my
thoughts on YC are somewhat positive,
right? Like I don't know. I like Gary
Tan. I like even like my thoughts on Sam
Alman are like somewhat positive. It's
it's kind of some of it you can
attribute to bad incentives.
Um,
wait, no. What do you mean? You You It
is working. People just believe it's not
because of negative propaganda and
social media. Dude, I go outside all the
time. I am scared on the streets in a
lot of places in America.
The the there's homeless all over the
streets. Some of them in some cities
actually very scary.
Uh, I can't afford a house.
Like, are you kidding?
It's not working.
The fact that I can't afford a house and
the fact that there's homeless people
everywhere shows you that something is
seriously broken in the United States.
Um, I'm in Hong Kong right now. Yeah. I
don't think this place is broken.
Yeah. So, I mean, we shouldn't really
talk about like capitalism, right? Like
capitalism is an idea. If you have
capitalism as a basic idea where it's
just uh
where it's just markets set prices.
Yeah, I mean markets should set prices,
right? I'm obviously on board with that.
Uh but there's another problem in the US
too. Um so do you know the US US versus
China tax uh GDP
percent of gov spending.
Um so you can look and you can see what
percent of uh
of a country's uh spending
is on government things, right? And one
way to think about this is it's kind of
a measure of uh like how communist a
country is, right? Um so here's China
and uh here's the United States. So the
38%
of GDP in the United States is
government spending.
Only 33% of China's GDP is government
spending. And it's actually even worse
than that because the main thing China
spends the government GDP on is
infrastructure. The main thing the US
spends its GDP on is entitlements,
right? the the largest the two largest
things the US spends money on are uh
Medicare and Social Security
uh which is basically like a Ponzi
scheme and fraud.
Um yeah, I think this is like overall
I can't afford a house. I told you I
have like 300K. Like I'm not even
kidding.
I mean I can afford some house but could
I afford a house in San Diego? No.
Um you zoom on on the EU. Yeah. Yeah.
Yeah. I mean it's really bad actually
when you look like France is really bad.
France is 57%.
Um government spending. No, Europe's not
ready for the next century, right?
I I I mean Europe can like continue to
exist maybe
uh almost in kind of the way that Japan
continues to exist, but Japan like like
Japan and Europe still like kind of make
things, but they're not competitive for
the future.
Um
well, Social Security and Medicare are
both basically transfer payments from
the young to the old. So,
uh,
all the young people are the ones who
pay into social security and all the old
people are the ones who get paid out.
So, it it's it's basically a Ponzi
scheme transferring the wealth from
these people to the people at the top of
the pyramid, right? It's it's literally
a pyramid scheme. Um, the thing is when
your pyramid looks like Nigeria,
Right?
You can uh it looks like a pyramid when
the population looks like that. Um you
know the the the amount of wealth that
is hoovered up by these people and
that's the real uh you want you want the
place that the real battle line should
be drawn in America. It should be
between the young and the old. these
these social security and Medicare uh
are these people spending these people's
money.
That's an empire state building scheme.
Um yeah, and Medicare feeds the insane
scam that is healthcare pricing in the
US. That's absolutely right. Um in the
same way that student loans being backed
by the government feed the insane scam
that is college pricing in the US. uh
you know my favorite um cost of goods
CPI US over time freedom means
you know this is one of my favorite
this is one of my favorite uh
charts there's a better version of it
too but
yeah
I mean this isn't normal this is because
of scams right and actually now I think
with with what's what we see in uh in
Minnesota or we can understand why
childcare went like this too, right?
Like like everything that the government
subsidizes becomes a scam.
Um
can I link the government spending
charts or something? IMSR site
about India 28 miss
uh we'll need robots to do the work I
mean
oh the with the the daycare scams. Yeah.
No, I agree. Uh but the real problem and
the real problem with these things is
that the government leaks power, right?
The minute the government sets up a
program and this is the same again very
related to what uh you know we're
talking about on this stream. The minute
you set yourself up to be a target, the
minute you set yourself up is I can make
you money. I have money to distribute
all the grifters will come to you. And
you see the same things with these tech
companies too, right? And this is why
comma and tiny ground aren't run this
way. Sure, I could raise lots of money
from VCs, but then that just puts a
target on your back for the worst sort
of people, right? The kind of people who
see that a startup just raised $382
million and want to go work there are
not the people I would ever want working
at one of my companies.
Tiny Gret's head count is six.
Um, and then like ironically,
comma equity ends up being worth way
more than most people get. people who
weren't early. Employee comma equity
ends up being worth way more than what
it's worth in a lot of these companies
when you join not at a similar employee
number but at a similar uh time.
The world is rigged and the worst part
is is it's not rigged by a few evil
people in a room.
Can everybody in this chat?
Can all Can all 693 of you right now
stop?
Can you all Can you Can you all stop? If
you're participating in this, can you
stop?
No. You don't want the system rigged in
your favor. Stop it.
No. Like like that's the problem.
Like can we just can we just you never
participated? Thank you. Um you're
jobless. All right. I hear about ninjas,
you know, no education, no job, no
ninja. All right. It's the way to be. Um
no, you know, one of the reasons that I
don't have a lot of money
is cuz I don't want to really make a lot
of money. It paints a target on your
back. I can afford everything I want,
which isn't all that much. I mean,
again, I get the same AI models. I get
the same phones, right? I have a $2,000
phone as my folding phone, right? I love
that phone, right? It's the best phone
in the world. It's $2,000. It's not a
lot of money.
Uh, except the house in San Diego. Well,
I don't really do I really want a house,
right? Like, I would want a house if it
was cheap. I would not want a house if I
had to like sacrifice for it, right?
Sure. Would I own a house in San Diego
if it was 50K? Yeah, of course. 100K,
sure. 1.5 million? I mean, yeah, sure.
Could I sign a 30-year mortgage and buy
a house? Yeah, but that's not worth it.
Your principled objection to doing
anything other than watching anime. I
mean, like, I respect that. Like, I
really respect the like like um I mean,
how do you get money though?
Will I buy the trifolds? No. No. Uh some
of the Tiny Grad
uh people tried it at CES and they said
that it's like weird because you can
fold it wrong. I didn't actually try the
Samsung one. I tried the Huawei one. I
didn't like that the screen was on the
outside.
Um
like we need a revolution, guys. We need
a youth revolution. And I really hope
that I think that like the the like the
16-year-old boys today are like smart
enough to not like believe in wokeism,
right? Like these people don't believe
in wokeism. You got to get the women on
board, right? We got to think about how
to get the women on board. And it's like
time for a revolution, right?
Why not do Batman type stuff? Because
Batman's not real man,
right? I mean, the closest you get to
Batman is Elon.
Um, I like Swami. Yeah,
I like Wondami and we'll see where he
goes. Like, let's give him a try, right?
He's a lot better than Quomo. Oh god.
You want nothing to change? Vote Quomo.
Uh, Revolution is five, but now it's
raining. I don't like the rains.
Raising us to believe our main purpose
in life is popping out kids, but like it
kind of is, man.
you really enjoyed the laptop Olympics
as a tech YouTuber. Thank you. No, I
don't need cash because again, the
reason I don't need cash, I don't even
understand like these people who are
making like 500k salaries.
Uh, you know, my salary at tiny grad is
100k. I get paid 100k a year and I live
off that 100k a year.
like, you know, I don't think people
should be paid like like I think that
that's like a good salary, right? Like
you should be paid anywhere from like
not sure if you have like a a family and
stuff you need a bit more, but like
between like 80 and 150 like that's a
reasonable salary. And if you for some
reason can't live off that amount of
salary, like you're doing something
wrong.
Even if you have kids, right? Kids
aren't expensive. They only become
expensive when you try to put your kids
into the same stupid, you know,
participating as everybody else, right?
Like, don't buy your kids expensive
daycare.
Probably time to move on from Elon as a
society.
I don't know. I mean, like, Elon is
doing a lot of good stuff,
right? I think he has weaknesses and
flaws, but like you know, you can't
expect people to be perfect, right? I'd
take Elon over like
I'd take Elon over Trump.
I don't even like strongly dislike
Trump.
Um
but you know, uh
for his POE scam, what's that one?
No, I mean it is sad. the the the
political arc of Elon. Um, where's my
where's my I have one
I have one of these where I give advice
to Elon.
Um, Elon, you need to reconcile with
your daughter.
Um, Elon should join Blue Sky and reach
out to Vivian Musk and be like, "I'm
sorry. I accept you.
Oh, we hired a Chinese pro gamer to play
for him. I don't really think that
that's true. I think he hired a gamer to
level up his account. I think he's
actually quite good at the game.
Also, like whatever, man. Some guy brags
about gaming. You can't complain about
that. I mean, I see I see his thing with
his daughter and that makes you know
that's sad.
Like that's sad.
Yeah, I know. I know. And you know when
you're when when when Vivian insults her
dad like that's that's fine, right? But
you know that's cuz it's a kid, you
know, she's a kid.
The way the way that I saw Elon talk
about on some interviews, like that's
hard to respect, you know.
Um do I think Elon reads this? Uh
if he was more center, I think he would
be so much more likable. I totally
agree. And like there were like promises
of being center, but he like falls for
these right-wing shits, right? Like it's
just it's just weird. I saw T like
Epstein is actually like a MSNBC lib
boomer.
Um
Oh, the race thing. But I also saw like
I saw like Venode Kla post something
about how Elon's a racist and like it
just made Venode Kosla look really bad.
I don't think Elon's a racist. Like I
think the race stuff's weird. I think
Ray Stuff's kind of dumb to talk about
um
care about POE over what he's done to
kids. What has he done to kids, man?
See, but that's what I mean. Like he's
just a guy, right? Like like like we can
rank our our preferred billionaires,
right? Like I like him a lot more than
like Larry Ellison who I think like
sucks and made or Oracle, right? Look
look at Bill Gates giving his wife
chlamydia and then trying to slip her
antibiotics. Like come on. That's like
that's way worse than anything Elon did.
What? Elon's outing in the Epstein files
where he wrote Girls for the Win. Like
that's just funny, man. Like that's what
I mean where you can't be like overly
serious about this kind of stuff.
He does retreat racist rage bait and
that's sad. I mean like that's just sad
if you're if you're running a if you're
running a begging for an invite to the
island. I don't know, man. LIKE WE ALL
GOT TO BE HONEST. EVERYONE HERE wanted
to go to that island, right? Like come
on. Did you not want to Did you hear
about Oh, there's an island full of
billionaires throwing parties on. Yeah.
I don't want to go, right? Like come on.
I'm not saying like today today I want
to be like I don't want to be associated
with ped shit. But like back in the day,
come on.
Come on.
Oh, come on. Oh, this is Oh, are you
serious? Like, and it's not like, you
know, you ask like who's going to be
there, right? If it's all like scammy
people, but you're like, "Yeah, Bill
Gates is going to be there. Prince
Andrew is going to be there." You know,
you didn't know about these people.
Yeah. In 2012, do you not want to go to
Epstein's Island? Come on. Y'all did
coing off of Bill Gates and the Royal
Guard. Yeah, that's that's what I'm
saying. Right. Again, it's also like I
don't know like today I think I'd feel
differently about it because you know
I'm a 36 year old man. I think now like
do I want to go party on some island?
But shit, when I was 23, do I want to go
party on some island? Fuck yeah.
And Bill Gates is going there all
passed. Oh, come on.
Um I've been to some events like this.
I've been to some events with like like
rich people and like um they're chill.
like they're just like good events,
right? I don't know. I've never seen
anything like weird
um like weird things. I mean, like not
like super not like beyond what you'd
like like get into with like you know
normal people.
That's why Bill Gates got viruses on the
island.
I used the joke about how Bill Gates's
wife left him because she googled Bill
Gates and found out what he was up to,
but like that's not so far off from
reality.
Would I go if I had to give Elon a
massage?
Enjoy your homoerotic fantasy, man. Um,
any potential for meristers analog
computing?
I think no.
Would John McAfee go to the island? See,
that's what I mean. Of course John
McAfee would go to the island
like you know like like you hang out
with these people like you know again
they're okay and you have to you have to
be aware of the traps that they fall
for, right?
Am I sad? Do I look sad? I don't think
I'm sad.
Um
I mean yeah like it does kind of like
suck, right? Like yay people just suck.
Um, Bef Jesus's company. I don't know. I
hear they like shipped something. It's
kind of interesting. I don't know. I
don't think they raised that much money.
How much money next traffic race?
They raised 14.1 million. Let him cook,
man. Like, this isn't like some like
Kyle vote $150 million for humanoid
robots. It's like $14.1 million for a
technology that like Yeah, let him try.
I don't even know what Palanteer is,
guys. I don't even I can't even have an
opinion on it. It's probably some like
boring scam. Like, it's like Oracle. My
opinion of Palanteer is similar to my
opinion on Oracle.
If I had an island, what age limit would
I set?
I mean, like, I don't know. But I I'm
just saying that like you have to I've
never actually like done this, right?
Like I think if someone actually said,
"Here, have sex with this 17-year-old
girl." I'd be like, "I'm no thanks,
bro." But like like
you can't like be on principle opposed
to that. Um if I had I don't I also find
those situations kind of weird. Like
I've been to parties before where it's
clear like the girls are paid. I don't
know. I just find parties like that
weird. I don't really get along with
those kind of girls.
Um, but I'm going to say uh the same
thing that's on X. Um, the limit would
be whatever the jurisdiction sets.
Exactly. Exactly. You know how like free
speech is by the laws of the country?
Well, it depends where the island is,
right?
Like,
all right. Oh my god. I was about to
like look up. We can look up what pedo
means. And I think that there again I
think that there's a big difference
between 17 and 12, right? Um
I hate the social climbing parties.
Yeah, I don't like social climbing
parties either, but like some rich guy
wants to go to his island, right? Like
come on. I would have went to the diddy
parties, too. Y'all would have went to
the diddy parties. Like you watch the
Diddy documentary on Netflix. Um that
was a good one, too. Like it's just like
like what did Diddy really do, man?
with a Dave Chappelle special. Yo, that
was by chance to fuck Cassie.
Do I like the piss play? I mean like I I
don't like like like I'm pretty normal.
I'm not like into any of this like kind
of shit, but like I'm not like like if
like Diddy invites me to his house and
that's what he's into, I'm not going to
be like that's gross, man. I shouldn't
associate with you. Like I'm like you do
you, man. As long as as long as it's
consensual.
groomer energy. I don't know. I don't
know. I The documentary is really good.
I think you get a real a real uh a real
idea for the vibe of the guy.
Did he got convicted of the man act?
Watch the Chappelle thing on it. I don't
want to like go into this, but guys,
like look. Oh my god.
Here's something that I found very true
during the wokism era about like me too.
You can watch the kind of guy who posted
this long like screed about how they
stand up for women and blah blah blah
blah blah and then they were the rapiest
guy you knew.
So all of these people who are so like
so much screaming about this or the or
the or the the the the religious figure
who's screaming about the homosexuals,
right? Like you got to you got to kind
of ask why they they're screaming about
this so much.
Isn't there a video of him beating a
chick at a hotel? Yeah, he beat up
Cassie and paid her money. I when I when
I This isn't the Diddy trial, guys.
This is This isn't the Diddy trial. Oh
my god. And then like you you get like
sniped by these things.
Uh,
every accusation is a confession. Yeah,
I kind of I kind of agree with that.
I'm the judge. You're the jury. Did he
Did he do it? Did he not? No. But I did
I went and see saw the uh Radio City
Christmas Spectacular this Christmas.
And I thought that the AV was really
mediocre. I thought that I could recruit
the Rockets. They're getting paid
nothing. We could pay him a little bit
more. And when Diddy gets out of jail,
George Hots and Diddy Christmas
Spectacular. What do you think? Diddy. I
fine. Diddy can have his name first. The
Diddy and George Hots Christmas
Spectacular, right? What do you think?
It's all to shoehorn people to a
controlled radical position. Yeah, maybe
it is. We'll ever go on Lex again. Oh,
that's another one I'll talk about. The
the weird hate for Lex online, bro. The
guy's been nothing but nice to me. He's
nothing but genuine. He's smart. I I
don't like I don't get it. Would I go on
Lex again? Yeah, if I had something like
say, I don't know. How do I know about
antihive and Slava KPSS? Just be on the
internet.
Do you think sex can be consensual if
it's transactional? Of course. Why not?
Go ahead.
The hate for Lex is that he never
presses his guest. What you mean? Like
you want it to be like 60 minutes. You
want it to be like got you journalism?
No. That's what's awesome. Like he just
lets people talk.
But I still believe in religion. I do.
I don't know. Like I like to say these
things in abstract about like the diddy
parties and the Epstein things, but like
in reality I don't go to these kind of
things. And not because like I'm opposed
or like judge the people who do. It's
kind of like not my like it's not like
my thing, you know? Like I'm going to do
like go like do cocaine and fuck
hookers. Like I like talk. I like saying
I'm going to do that, but like in
practice.
Uh, what happened to Cherry Computer?
It's kind of tiny. Do I think Jesus rose
from the dead? I think that him and his
boys plotted some great shit at the last
supper. Yo, guys. Yo yo yo, tell
everyone I came back, man. Three days.
Just like go move that rock a little
bit. Like, tell them, man. Oh yeah. No,
I was playing cards with Jesus last
night, man. He's back, right?
Uh, this is making you lose faith in
humanity. Why?
Um,
getting chicks is trivial. Yeah, you
know. Oh my god. You guys know my advice
for getting women right.
Um, do I really think we'll end up in a
neutral world? Yeah, I do. I don't
really think we're going to stop it. I
don't know.
No, you can't shoot your girls on
LinkedIn. Literally, like the kind of
people go where there's women, right?
Like like if you want to meet women, go
where there's women, right? Like go do
some shit that that women do, right?
Then you can like meet women, right? Or
like go to New York, right? The whole
city's teeming with women.
Um don't go to the women's toilet. Stop
it, bro. Stop it. Stop it. That was not
my advice.
I know. I'm not even invited to the
island, right? Like like like how much
how much of this is just all resentment
because people weren't invited to the
island, right? You all know you would
have gone to the island. I would have
went to the island, right? Like come on.
to look for a human being to exploit.
Yeah. Like don't be creepy, man.
How's Hong Kong? It's nice. I like it.
Um,
go to them. That's easy. Now pay me $5.
Subscribe for these great tips. We need
a new blog post or you're not invited.
You guys know I love Carmen Land. It's
one of my favorite South Park episodes.
Yan Lun Twitter's not a good look for
him. There's not a good look for a lot
of people,
but women love creeps. They don't.
You've seen You've seen those like like
the the meme about like whether it's
sexual harassment, it comes down to like
how the guy looks and how he presents
himself.
How do you not be creepy? Just don't be
creepy, man.
Like, no. The other thing too about the
women thing is like you have to Well,
you guys have heard my advice on this.
One, talk to women. And two, understand
that like
10% of women are out there looking for
casual sex. 20% of women are out there
looking for casual sex. Find those ones.
Don't spend time in the other 80%,
right? Like you're not trying to seduce
women or to convince them to do
something they don't want to do. You're
trying to give them the experience they
wanted to have. Right.
Watch home math. That guy's on Twitter.
It's really funny.
You're so afraid to talk to women, dude.
They're just like people.
I'm trying to catch something like
Gates. Oh my god, he got chlamydia. It
wasn't a big deal. He took antibiotics
and then like was like the weird thing
was that he tried to like slip his wife
antibiotics. Why didn't he just be like,
"Melinda, look, I fuck some Russian
hookers on the Epstein island. I got
chlamydia. Oh, you want to go get a
chlamydia test? Right? Like, if you're
not in a relationship where you can say
that, I mean, I don't know. Like, that
makes me lose respect for the guy,
right? Like, you couldn't just like talk
to your wife like a normal person. What
kind of a relationship are you in? Why
are you lying?
It's a lot easier to get laid on Grinder
than Tinder.
Uh, that's probably true.
Kongus hasn't slipped their wipe
antibiotics.
Have I tried Coutile? I've heard good
things about Coutile. I gota look more
into that.
Models are bony, bro.
Um, men aren't worried about getting
pregnant. Yeah. I mean, there's some
there's some like
uh there's like the some like
evolutionary psychology stuff that
explains this all pretty well. Do I
smoke weed? Not really anymore.
Certainly not here.
Do I miss doing security stuff?
Kids yet? I don't see um
what blue pill shit. What did I say that
was blue pill?
From my experiences with Europeans, are
they friendly people? Most people are
friendly. The only place I found where
the only country I ever traveled to
where I had a bad experience with people
and not everyone but just I would say
the majority was India.
Um, and then you look up like, and I
again I don't like blame people there,
but it just seems like people there are
quite unhappy.
Um, have I been to Georgia? No, I want
to go to Georgia. That's actually one of
the last countries I want to go to that
I haven't been to.
Portugal. Thumbs down. Thumbs down.
Thumbs down.
Wants to go to India. Happening
everywhere, bro. Everywhere. Love China.
I think people are unhappy in Germany.
No, I do want to go to Georgia.
Um, all right. Everybody
come to KSA. What's KSA?
Oh, the Kingdom of Saudi Arabia.
I almost went
um I don't know.
So big.
It's just like nothing.
What's in the middle of sound
could live here.
Um, the world is awesome. And the other
thing too is
you can travel in most places for less
than your cost of living in the US.
Uh, like when I did all those like
trips, I've been to I've been to like 50
countries or something and they're
cheap.
All right, cool.
All right, we ended up on the on the
countries. Um, but yeah, uh, I just want
to let you know if you lost money on
some token because you thought it was
associated with me, you're an idiot and
deserve to lose money.
>> You can't say that.
>> I just did. I just did. And I also would
have went to the island and you know you
would have went to the island too. Girls
FTW.
But hopefully you guys aren't so scummy
that if you got chlamyia you try to slip
your wife antibiotics. You could have an
adult conversation about it.
Uh yeah. Communication with AMD got
better.
Pimp happiness not found.
Why are VODs sub only? Am I eager for
that $5? Yes. Come one, dude. Come one.
No, I'm not removing sub only out of
VODs. Subscribers are better people than
you.
It's not about me getting $5. It's about
you losing $5.
Um, keep your kids away from computers.
I'm not letting my kids anywhere near
computers.
Um, global sales has been fucked by USA
for over centuries. It's a cheap part of
your travels. I don't think that's
necessarily true.
Longer love programming since LLMs do
everything. I don't know about that.
I think that LLMs aren't going to end up
changing the pecking order very much. I
think that there's some like junior
people who they will just discourage and
just completely but I don't even know
about that. No, I think they're going to
pretty much change nothing.
Like I mean I love I love working with
these AIs and like I think of them kind
of like what search engines would have
been if search engines weren't held back
for 10 years by Google being a huge
scam.
Like imagine Google, imagine there was a
competitive market in search engines in
the 2010s.
Like we could have actually gotten good
things. Instead, it kind of was all this
pent-up energy and then we got these
LLMs all at once, which are basically
search engines.
Um, do I think they'll close loops?
Well, yeah, they'll close loops and
they'll get they'll get better uh at
stuff. They'll get better at following
directions. I don't know. I'm I'm just
super excited about it. And I'm also
really excited about like open router.
Um that it may come down to not really
mattering
if
like there was never anything like open
router before for for uh for Google.
But the fact that all these companies
are basically like competing, there's
competition, there's open source, this
is so much better than what the internet
was before. Um, it it is sad to me to
see that like people do seem so
miserable about it. I don't know. Like I
just love these things and like it just
I just wish there wasn't hype. This is
what I always wish. Just like get rid of
all the hype. Let's be honest about what
AI can do, what AI can't do, what a
trajectory is going to look like. You're
not going to be in the perpetual
underclass. Like, come on. I shouldn't
have. People actually took me seriously
about this. Like, I do think we're going
to end up in basically a neofudal
future.
Um, and I do think that a lot of things
are going to suck like car ownership.
Like they're going to like deeply suck.
But this is just a general extension of
the initification that exists today. It
has nothing to do with the underlying
technology. The problem is the people.
The AI isn't going to fix that.
Um, my tone toward LM's changed a bit on
my last blog post. Yeah, similar Andre.
Yeah, I mean, Claude Opus is the first
one that I feel is like actually like
quite good and work worth working with.
I found a lot more of its limitations
recently. I'd love to see the next one.
I want to see the better one. This is
kind of how these things work. Um, I
mean the thing that was most surprising
for me was you can read like these posts
like this computer use models post,
right? Like turns out the idea wasn't a
desktop emulator with a keyboard and
mouse. It was just a command line. These
models are going to use IQ uh use
computers like 130 IQ people, not like
100 IQ people. So cool.
Um,
no. AI. No watermarking. No, it's not
watermarking. A art is bad, right? Like
a AR is just it's just it's just bad in
and of itself because like and part of
it has to do with the companies that are
doing it. Part of it has to do with like
them not really understanding what art
is, right? But but art has nothing to do
with like the people today who are
bitching about AI art. Can you imagine
how painters must have felt when they
saw a camera?
People care about human brush strokes
and they should. The problem is proper
categorization. All of the all of the
pictures taken with cameras need to be
watermarked and we need to understand
that they're inferior to portraiture,
right? Like like I hate that, right?
completely. No, AI is awesome and it's a
great tool and every artist that decides
to bitch about AI has just decided to
make themselves irrelevant. In fact,
every person who's decided to bitch
about AI, every person who's decided to
bitch about the aspect of AI that
increases capability,
it's just going to lose. Um, the people
who bitch about, you know, it's not that
there's nothing to complain about. I
complain about a lot of stuff about AI.
If you're complaining about
inchitification, if you're complaining
about slob, if you're complaining about
the uptake in spam emails, the uptake in
scams, if you're complaining about those
things, then sure. I mean, there's lots
of reasonable complaints. What are those
portrait painters supposed to do,
though,
dude? I don't know. Like, we live in a
free world. They can go find something
else to do, right? It's not like like
like there was never going to be some
some central planned economy who's like
and now we are going to reassign all of
the truck drivers now that AI has no
what that's never how it works.
Art is literally about the person doing
it. I mean you can say that that's true.
Um that's some kind of art
it's a very identity politics take. Um I
don't even necessarily agree with that.
I think art is uh what pushes the
boundaries and that's actually that's a
fine take too. I mean, art is just a lot
of things to a lot of different people,
but like to me, art is what pushes the
boundaries.
And when you see an LLM generated image,
right, if you saw that 20 years ago as
art, it's cool and that's insane. If you
see it today, you're like, but I know
how cheaply that can be made. That's not
art.
How actively do I use agents on Tiny? I
built parts of it with agents. It's not
that they're not that good, though. and
they kind of can't
I view them a lot more like search
engines than I view um
them as programmers.
Like they can kind of program, but it
almost just looks like copying and
pasting from Stack Overflow. They've
gotten better at it. And what Opus 4.5
managed to do is copy and paste three
different things from Stack Overflow
until the test pass.
Oh my god. No, you really don't want a
global minimum wage. You really don't
want this. You don't want anything like
this. Um,
uh, lowering inequality doesn't look
like UBI. It looks like open source. UBI
is surfed.
Fundamentally, if you're getting your
universal basic income or global minimum
wage, right, you're getting that from
somebody and then you're their bitch.
Okay. And it's not going to be universal
and it's not going to be global. What's
going to happen eventually is somebody's
going to take the reigns of that system
and be like, "Yeah, but like we're not
going to give any minimum wage to anyone
who went to the Epstein island." Right.
Right. We got we got to exclude some
people, right? We're not going to give
any minimum wage to goddamn liberals.
Right. We're not going to give
communists. We can't give communists
minimum wage. Right. We're definitely
going to give it to Republicans, right?
Um,
what's bereiement of a lost future?
Uh, no. I think that for in some ways
writing a game engine is easier than
self-driving cars.
Living loss is the sadness that comes
from unfulfilled expectations and dreams
or the loss of an imagined future. That
sounds like something that's like mono
wear. Like there's some like beautiful
Japanese word for it. The sadness of
unfulfilled expectations and dreams.
Um, it's unclear actually how much
someone's really going to own the AI
of a lost future.
Like medical going there. Game engines
are harder than rockets. Um, I think in
a way he's right.
Yeah, I don't really like AI space data
centers. I think it's kind of just a
scam way to sell spaceships.
You saw you saw my box, right? Is Hong
Kong really more attractive than
Singapore? I like it a lot better than
Singapore.
I mean, Singapore's cool, but I wouldn't
want to live there. It's very sterile.
What makes me keep going? Just want to
survive, man. Just want to survive. We
out here living.
Will tiny grad contributors be replaced
by AI? But that's never really how it
works, right? The bar for deliverables
will just go up. The bar for software
will go up. It's not like contributors
are going to be replaced. Contributors
are going to use AI as a tool to
contribute more in the same way that we
use Python. In the same way that we use
GitHub actions, CI
Have I read William Gibson's piece on
Singapore? Yeah. Yeah. Adult Disneyland.
Yeah. Yeah.
Um my show The Tiny Guy will be
finished. I'll never be finished. Xboxes
in three years. Actually, I think sooner
than that. This summer I'm going to get
serious about building an Xbox for comm.
But agents are not tools.
I don't think it matters.
I don't think I think that the same way
that that's like saying like but people
are not tools. I mean some people are
tools. You ever call someone a tool?
Man, you're such a tool.
Why can't anyone touch Nvidia?
It's like
I have AMD. I'm trying to run Kimmy on
it and like it doesn't really work.
I'm like AMD is the second best.
Have something in mind to do after Tiny?
Not really.
I don't rug my employees, man. I don't
like, yo, I'm going to jump to the shiny
thing. So weird, too, that like people
accuse me of that kind of shit. Like
George sees something new and shiny.
Look, he's interested in AI now. Dude, I
started an AI company in 2015.
This has been my whole life.
You know, no bandwidth is less important
than people think. I think there's been
some cool papers showing that you can
like really reduce that and it all still
works the same.
My vision was a thousand times more
enticing than anything that is currently
realistic. Also, sex and drugs feels
less enticing. Yeah, I know. We're gonna
get so much cooler shit than sex and
drugs, right? What's the Timothy Liry
quote, man? The PC is the LSD of the
90s. Yo, AI. AI is the LSD of 2025, man.
This shit, you know, just the nights
that you could just stay up talking to
these things. Oh my god.
Claude Code is the LSD of 2025,
right? It does feel like that.
I am ready to talk about it.
They may contain sensitive or adult
content. We want to
most happy about every day I wake up. I
don't know. I wake up every day and I'm
kind of like a 67. Not that happy. I'm
not that sad.
Just kind of just kind of am
for seven years, bro. Fried cooked.
If a new viewer comes in the stream who
doesn't know you are, they would think
they're watching a psycho. Why?
Why? I don't know why people like think
that, too. I saw I saw some Twitter
thing where it's like it's clear that
has like a mental health issue.
Mental health issue, man.
Like I'm not I'm not going out there,
you know, saying Hail Hiller and stuff.
Uh I have a normal kind of stable life.
I have a job. I have a girlfriend.
Terry Davis was schizophrenic, right?
Um,
I've watched some of his stuff, but like
this is He's clearly very smart, too.
I just said, "Hail Heller. Oh, no. Oh,
no. They're going to come for me." No,
you can say that here. It's fine. It's
Hong Kong. Get freedom of speech.
Um, like the Kanye West of the tech
world.
I'm stable but normal. That's what I
mean. I don't know why people like come
on my streams and think that like think
that like I'm psycho. Why? Cuz I'm
honest. Is everyone just so dishonest
today that you you see honesty and
you're just like
like oh it can't be oh can't can't have
that. I can't say that man. I mean
everybody else would go to the island
too but you're the only one who would
say it.
>> Well it's on Lexro. No, I seriously
think SSR is fucking people up like and
like at a kind of a societal scale, but
like you have to wonder about some of
these. You see these people who are like
absolutely histrionic about some
political thing and like yeah, I think
they're like on some weirdass psych
meds, man. You just don't get that
normal people.
Not really honest. What am I not honest
about?
Is Aderal a scam? I mean, I don't know.
It is what it is. You can take an
Adderall. You can see how you feel. Um,
you should also be aware that Adderall,
I think, messes with your ability to
judge productivity more than it changes
productivity.
Um, I had a friend give me good advice
on that once. He's like, "Bro, like you
can take those things to like work, but
like, oh, come on." You know, like it's
just a recreational drug, you know?
Like, and you know, you can have
whatever relationship you have with
recreational drugs.
Um, here's a nice discussion on SSRIs.
You were politically crazy before the
psych and the meds calmed you down.
Yeah, this is probably true.
This is so true. I walk all the time.
I love I I bike in San Diego, too. I
love biking.
Pretty good.
Come on buy tiny corpse. Why
many people online are driven by their
emotional insecurity and how they think
they're perceived by their peers. So
honesty in a public form is a foreign
concept. I mean I'm curious what you
think I'm dishonest about, right? Like I
think if I'm if I'm dishonest in some
way on this stream, I'm also probably
dishonest with myself in the same way.
Um, and there probably are things that
I'm dishonest with myself about.
Why am I not into polygamy?
I mean, I just don't like call it weird
shit like that. You know what I mean?
Like, am I into having sex with multiple
women? Yeah. Like, who isn't? Am I into
some like weird shit where I'm going to
have like a primary and a secondary and
we're all going to like negotiate our
policle,
you know, like constitution. Oh, that
shit's weird.
Can I show my bookmarks? I don't have
any other bookmarks in this browser.
There's discussion about comma. I think
I saw this one that might have even
commented something.
What did they say? Did they say good
things?
K is my favorite AI company. Really
incredible piece of tech in a tiny
package and I truly improve your life to
have it. Thank you.
Um, oh yeah, I replied to this. How did
my efforts to make the modern AI stack
work on top of AMD work out? Everyone
thinks that like because I announce
something that like I guess I do kind of
like fake announce a lot of things that
are like uh
like like kind of jokes like cheapy,
right? Like if I haven't raised money
for it, it's a joke. But the minute I
actually raise money for stuff, the
minute I actually take serious amounts
of money for stuff, I understand that
I'm putting like 10 years of my life
into it.
Um, all right. Honey, you get Fridays,
Saturdays, and Sundays. No, you know,
you
King A. What do you mean, man? I sent
you. 25 E. You got rich.
Um, let's play some game. What do you
want to play?
Do I think open source will go back to
the old school foss? Nothing ever goes
back. Everything moves forward.
Everything changes.
I think there's like new cool aspects of
things. I think there's like like who
made open claw, man. Like it's just
cool. Even if it is like vibe coded
slob.
Um I am thinking of starting a charity
though. I have some interesting ideas
for a charity.
Never have I ever
done something. You say you have to
subscribe. I love it. I love it. Is that
going to get you to subscribe?
You think I have any effect on red
pilling people by posting on LinkedIn? I
don't know.
No, it's not going to be a scam. I'm
going to start a legit charity.
Oh, yeah. I've seen these. Yeah.
Zeta Mac.
Chance me doing more talks. You have a
talk right here. I'm talking. want to
talk about.
I said long and video a long time ago
and now long AMD. Yeah, I think Nvidia
is overnight now. But
should we all move to South Dakota? If
you're spending not most of your year in
America, yes, you should.
I don't know much about RMS.
You know what? And thank you all for not
being here to try to like
wifey pussy spread. Bro, bro, bro,
bro,
bro, don't disrespect my wifey, bro.
Do I think there'll be data centers in
space? Um,
my friend over Christmas is like, uh,
dude, the only reason they're going to
put data centers in space is because
governments have made it so hard to
build anything on Earth.
Yeah. All the the crypto shells are No,
the crypto shells are mostly gone. I
appreciate you all being reasonable for
this conversation. No, I'm not going to
India. No, India.
Okay. I haven't been everywhere in
India. I went to Bangalore. I went
around Kerala and I went up to Mumbai.
Went to Goa.
That's not something I'm eager to
repeat.
Um,
computational irreducibility. What does
that mean?
I know it was the best of the cities,
but there was still a lot of aspects to
it.
Yeah, this is obviously true, right?
I think the three body problem is
computationally irreducible, right?
Got ruined by the Brits. Well, that's a
take.
Not a take I necessarily agree with, but
it's a take. And to be fair, yeah, you
don't really know what like the h I saw
I saw I saw a post on team line that
really summed up why India is the way it
is.
It was like in India just to get one
more step one more closer to the front
of the line people will like stand on
your shoulders like this like hyper
um
just doesn't feel like there's no chill.
No chill.
Um like when you're at a train station
in China uh and China is actually a lot
more uh kind of uh civilized than it was
15 years ago. like 15 years ago being at
a train station in China, right? Like
when the line moves, everybody pushes
and shots, everybody jockeys for
position, but when the line doesn't
move, everybody chills. In India, even
when the line doesn't move, people don't
chill.
A Chinese rocket almost went into a
SpaceX rocket. What are the odds that
two rockets would hit each other? That's
basically impossible.
China has repression. Why do you say
that? What do you think's repressed?
America has more repression than China
today? Not in the past, but like modern
America has so much weird oppression.
Hey, George, I'm broke. What tech field
should I get into so I have less risk of
being replaced? AI.
You know, Amanda's always telling me
that like the reason that like people
like want money and stuff is because
they just want to get rid of their fear.
Is that really true?
Like do you guys like feel like fear a
lot?
Can we be honest about that?
What do you fear?
Money is safety. Why do you think that?
Thanks for 20K yesterday. That's the
real scammer.
Yeah, I don't understand. No, no, no.
We've decided that the scammer was
clever and we're just it was it was
cleverly done, so we
um
Wait, but
Okay. I mean, like, let's talk about
this.
What are you really afraid of?
live a few days without money. Dude, I
like have you ever go camping?
You're afraid of having to work the rest
of your life. Why are you afraid of
that? Of course, you're going to have to
work the rest of your life. Life is
work.
one medical emergency away from poverty.
Is this really what happens or is this
like just something that
being unlovable?
I think of work differently than most
people. Why can't you think of work like
me? You lost 2 million last year.
You lost more money than I've ever had.
Yeah, you buy things before when you go
camping, but like not like like you can
live for so cheap, right? Go to
Cambodia.
You can get a flight to Cambodia for
like 400 bucks. And then once you're
there,
your place to stay is 10, $15. and get
sick ass meals for two bucks.
Well, but camping could be a lifestyle,
right? Like, sure, it's not going to be
like wilderness camping probably. Yeah,
if you've gone like backpacking for a
few days, yeah, it's different. You're
bringing like freeze-dried meals and
stuff, but like I mean, like live in a
trailer, buy a sack of potatoes and
rice.
You're in Vietnam right now, right?
Like, yeah. Oh, man. you you get you get
into this Southeast Asia mindset where
you get so cheap. I was in Malaysia. Um
I was renting this hostel on renting
this room in Lawi Island and it was $6 a
night and $8 if I wanted the air
conditioner. But the room the $6 room
and the $8 room were the same. Just if
you paid the $8, they gave you a remote
for the air conditioner. So I went to
the market and paid a dollar and bought
an air conditioner remote. that I had
air conditioning and I was paying $6 for
the room.
Um, yeah. I mean, of course you need to
work, but like life is work. I don't
know what to tell you.
Like, yes, you're going to need to work
your whole life, but what else were you
going to do?
Wait.
If you're a millionaire and you don't
have to be afraid of being replaced by
AI,
what is this? Like, why do you think
that all the money is going to go to
like like we're all going to be poor in
some ways, but we're all going to be
rich in other ways?
No. I don't know. The land I kind of
like lost interest in the land.
Why can't you get paid to play video
games?
Have you ever done landscaping?
What's the closest I've ever done to
landscaping?
I got paid $5 a baby goose once for
rounding up some baby geese.
Um,
you know, I like this. I mean, this is
I was like kidding about 3 minutes to
escape the perpetual underglass. I
thought that you guys would like get the
joke by making it 3 minutes, right?
If you're a millionaire, then someone
somewhere else is getting exploited. Do
you really believe that?
Is Hong Kong expensive? It's not cheap.
Um, you can live here for cheap.
Hong Kong has a wide variety. Uh, it has
more of a there the swing is bigger than
in the US. You can live in Hong Kong for
cheap. You can live in Hong Kong for a
ton of money.
What's wrong with wanting to be a
bazillionaire? Like, why? It's like
tacky, bro. What? You want to fly around
in a gold jet like Donald Trump? Like,
it's tacky.
My rig is being built somewhere by kids.
I mean, the tiny boxes are built in San
Diego by like
a dude who's chill and I think's got a
pretty good life. I don't know what to
tell you. Um, my clothes are being woven
by kids.
Cool.
I mean, I don't know what what do you
want me to say like
while the mass migration the mass
migration is not from
Hong Kong to America, right? Or Malaysia
to America. The mass migration is from
countries that are like awful.
Uh where Yeah. I mean, I don't know. I'm
for borders. I believe in borders. What?
Uh, but I can't believe how many people
said yes to this fear thing. I want to
like help you guys.
Like, like who taught you to fear this?
Send you krypto?
No, that's not going to help you.
I'm not saying it's my fault. I'm I'm
trying to like understand this better
because I don't really like experience
this fear.
I don't think I ever really have.
I mean, like, have I ever experienced
fear in my life? Yeah, of course. Right.
Like some things like when Sony sent a
guy parked across the street from my
parents house in a Lincoln Town car.
Like yeah, that was scary as shit.
Um,
what else have I really experienced
fear? I don't know. Like when I got
mugged in Mexico, like that shit was
scary. I don't know.
Ever felt the fear of losing it all? You
guys know the poem if
my mom gave me frame copy this poem when
I was a kid, right?
Uh
like can everyone please read this poem?
Like everyone who like feels fear
want to read it to you.
If you can keep your head when all about
you are losing theirs and blaming it on
you. If you can trust yourself when all
men doubt you but make allowance for
their doubting too. If you can wait and
not be tired by waiting or be lied
about. Don't deal in lies. Or being
hated don't give way to hating and yet
don't look too good nor talk too wise.
If you can dream and not make dreams
your master. If you can think and not
make thoughts your aim. If you can meet
with triumph and disaster and treat
those two imposters just the same. If
you can bear to hear the truth you've
spoken twisted by naves to make a trap
for fools. Or watch the things you gave
your life to broken and stoop and build
them up with worn out tools. If you can
make one heap of all your winnings and
risk it all on one turn of pitch and
toss and lose and start again at your
beginnings and never breathe a word
about your loss. If you can force your
heart and nerve in sin to serve your
turn long after they are gone and so
hold on when there is nothing in you
except the will which says to them hold
on. If you can talk with crowds and keep
your virtue or walk with kings nor lose
the common touch. If neither foes nor
loving friends can hurt you. If all men
count with you but none too much. If you
can fill the unforgiving minute with 60
seconds worth of distance run, yours is
the earth and everything that's in it.
And once more, you'll be a man, my son.
Damn, your mom just told you to man the
fuck up and stop being a baby. Yeah,
that's what I'm telling you.
Don't be a, you know, little little
pussy. like, oh, but I need a million
dollars to feel secure about myself. The
AI is going to come is going to come for
my my job, man. Like, stop being a
bitch.
I don't think we have enough of this in
society today, right? Like, they made
like bullying illegal in the schools or
whatever. Like, everyone just stop being
a bitch. I don't know. Like, I don't
know if it's just something that I like
don't feel the same fear as you. I don't
know. Like if I lost everything I had,
who cares, man? Whatever,
right? Like, yeah. Do I fear like,
you know, being kidnapped and tortured?
Sure. I mean, that's a reasonable thing
to fear, right? Do I fear pain? Yeah, I
got a root canal. That shit really hurt,
right? Like, but like to fear losing
everything?
Go make it all again. Who cares?
Do I think I'd see it differently if I
had kids? I mean, we'll find out. Uh,
no.
No. I don't know.
Do I own a home, have a wife, or have
children? I mean, but like, why does
that matter?
losing the standard of living. Who the
fuck cares, man?
I mean, yeah. People lose their kids and
people lose their wives. It happens all
the time.
I mean, you could think that I don't
know myself and you can think that, you
know, when I have those things, I'll
have a different perspective, but I
don't think I will.
I just don't think it's how I'm wired.
And I don't think maybe it's how some of
you are wired, too. I think someone
taught you to fear. I think someone
taught you this helplessness. I think
someone someone taught that to you.
No,
you say I can only understand when I'm
in a position to understand it.
I don't think this is true. Look, if you
had one shot or one opportunity to seize
everything you ever wanted in one
moment, would you capture or just let it
slip?
If you're planning to live in a society,
you need money. Um, so this is one of my
favorite uh
um
essays. We read it
um
we read it on a stream a long time ago.
Uh
this is
um
a pretty incredible essay and the the
rest of his writings are are quite good
as well.
Um,
I don't know. Like I found this stuff
when I was like 16, 17,
and
this like set up my world view. I don't
know.
I don't I think I've like
do I really think the average person can
drop out? Yeah, it takes nothing.
Yeah, I know about the Rosian veil of
ignorance.
Um,
and what I bring up to what I what I my
response to that is like
battery died.
I don't know why should have been
charging.
Um, so yeah, sorry about that. Uh,
let's do that here. We're almost we
almost wrapped up anyway, but you know,
I know that like people get scared that
like the NSA came for me or something.
Um, so it didn't, you know,
uh, were you trash talking me?
Do I fear the NSA or
What are you going to do with me?
What do you want from me?
Yeah, if I had like a data against me,
sure.
This my I would lab to
to to track.
I don't get it.
He would have died in a car accident if
he wasn't useful. I mean, yeah, maybe if
I pissed him off, but do I piss him off
the NSA? I don't think so. these cares
about me. Exactly. My views are not
inspiring enough.
Um, say something. I only have good
things to say about the CCP.
Um,
if we didn't have patents. I hate
patents. I hate intellectual property.
How is money fake if you can buy jet
with it?
You like to prove they're right.
Be big. This window big. How do I make
this window big?
There we go. This window is big.
Um,
like three times if the glow is coming.
All right, guys. Oh, my mic is low. Oh,
that went low again.
God,
there's times when these things are
difficult to use.
I guess we'll just move the mic a little
closer.
Uh, yeah. Yeah, I don't really have
anything else to say. I'm sorry that you
guys feel all this fear.
I guess yeah, I'm I'm sorry. And I'm
sorry that that's where it comes from.
And
I mean I ask yourself to like
look inside and and realize like
why do you think people put up with
shitty jobs like fast food? Most people
like their jobs, right? I don't even
think that's like that shitty. What
would you rather like sit at home and
smoke weed all day and be useless? No
way.
Learned helplessness is the biggest
tragedy of our generation.
I mean, it's pure fear. I don't think
so.
Like,
I feel like if I felt fear like that all
the time,
I'd kill myself.
No. Most people don't hate their jobs.
Did I accidentally leak an API code?
What API code?
I mean, yeah, a lot of people like
the
work.
Yeah, people who genuinely dislike their
jobs are around 15 to 20%.
Yeah, I think people might be passively
disengaged from their jobs. I would say
the majority are passively disengaged. I
wouldn't say the majority hate their
jobs.
I mean, yeah, I think that like I don't
know. I could never be a flight
attendant.
I would I would absolutely hate being a
flight attendant. Like I have to
interact with people and it just sounds
awful. Um, whereas like I think I could
be a truck driver. I don't think that
would be like,
oh yeah, they used a key that claw
leaked to other people did it. Other
scammers did it. But I can't be too
upset with them because I made money and
now I feel less fear because I have
money. Is that how it's supposed to
work?
People
are here to see if the key gets leaked
again. I hope that every single person
who's in my chat trying to make money
loses money.
Um, well, you know what they say in if
They say that
you gotta you gotta just just be okay
with people who lie about you and haters
because that's what the poem says.
Running Kipling I bet was based
Quality work may be done quickly, but
it's never pushed. It arranges itself
around the goal of doing something.
Yeah. I don't know. I mean, I think I
was influenced by these things a ton.
This is like how I run the companies and
all that stuff. You get what dropping
out is supposed to be? Well, I mean,
read his follow-ups to the essay. Read
about how he talks that it was
misinterpreted.
Dropping out doesn't mean, you know,
going and living with nothing. It just
means realizing that the system doesn't
own you.
And when you realize that the system
doesn't own you, the fear goes away.
I'm terrible at Counter Strike. I'm
pretty terrible at first shooters. Like
just like hanging out with like a casual
group of people. Um I'm in the I'm in
the lower half.
The system is quite punishing.
You can ride and go. Oh my god, I really
have crypto scammers in here now.
Um,
I mean, yeah, I mostly do feel that
people who fall for scams, it's on them.
But like there's some things that like
our government should help like if we
want to like live in a society. But you
know what I mean? Most people's needs
are self-inflicted. That is true.
Did I lose money? I made $17,000.
So, you know, take that scammers. I
can't be upset because I got paid out.
But I would be upset if your scam wasn't
clever.
Tune on, turn in, drop out. Oh, one of
those OG LSD guys.
Timothy Leer. Yeah. Yeah, that was that
was scared over a snowblower
also like
um
yeah
know that's exactly who I want to get
out of technology because I don't care
about finance, law and medicine. those
kind of people who showed up who were
like looking for a stable job and they
thought that it was going to be like a
nice day, like get the fuck out. Nobody
wants you here, man. Nobody wants those
kind of people here.
It would have been so boring if they
just took 13 bucks. Exactly. Exactly.
Um that's the power draw of my laptop.
And yeah, we're doing off-topic
questions.
The univer is great. Absolutely. That
was another That was another like
childhood shaping document.
You need money because you want to buy a
high-end tunneling scan microscope. What
is that? Most people's needs are
self-inflicted.
Um
contractor as opposed to a wage slave.
This are you creating value for other
people or Oh my god.
Oh yeah. Because like those people, I
don't know, finance, law, and medicine
sucked ever since I was a kid. Tech used
to not suck. And then all these people
showed up and it started to suck and
they all need to get the fuck out.
Yeah. But no, I I want to I want to get
back to that point. I want to get back
to that point about
the people here who feel fear and why
I don't really do meetups with people
guys like
people. I don't grow my own
I don't feel fear.
I care what other people think about me.
See, that's just sad.
We're all going to die
every day. We're getting one day closer
to death.
I'm gonna
Should I Should I take my $17,000 that I
made and buy everyone in chat right now
a weighted blanket? A heated weighted
blanket? Would that make you feel less
fear?
when my stream ended. I'm glad you feel
safe here in the stream with me.
This is why I need money to buy my Well,
you got to be a subscriber. The weighted
blankets are only for subscribers.
I should make a course on how I made the
money. All right. Wait, this is this is
getting annoying. How do I Why does my
laptop keep going to sleep?
We got to keep Yeah, the fear is getting
rejected from every job. Oh, have you
guys read uh what's it called? Uh by the
way, but why guy?
What's the story that I'm thinking of?
Yeah, it's Tim Urban. Yeah.
Why is this so difficult?
Why is it so difficult to find this?
Where's the story?
Wow, I should read a lot more of this
guy's stuff on the website.
Ask cloth. Yeah, ask a real search
engine. Good point.
Oh, Marshall brain. Oh, it was close.
This one. Yeah. Yeah. Yeah. Yeah. Yeah.
Thanks, Claude. Someone made a good
search engine. You see what I mean?
Um, it's quite good.
People with massive money saved losing
touch almost 100% of the time. Am I good
at Chinese? No. I wish I was good at
Chinese.
Is there a field I wish I wish I could
speak Chinese?
I have a fear of not having the choice,
not being able to spend time with my
wife. What do you mean? You always have
that choice.
How do I find such blogs? I don't know.
Sometime you guys love me still.
But yeah, it's late.
I'm going to bed.
How much Chinese do I know?
How much?
What was this article? It's a good
story. It's a good story. You all should
read it. And I want everybody, you have
an assignment.
What's my HSK level like one?
Um,
I have an assignment for all of you.
I want you to
meditate
and think about your fear
and think about where it really comes
from because it doesn't come from money.
Money is made up. Your fear comes from
something else.
Like I mean it may be something deeper.
It may be some fear about like
I don't think it's low on Maslo's
hierarchy, right? I don't think that
anyone in my stream right now really
fears starving to death.
Do none of you actually fear starving to
death, right?
Yeah. This story about sitting on the
bench is definitely true. Um,
yeah. So, none of you fear starving to
death, right?
Do you fear freezing to death?
People have fear of no money for the
same reason people use Kubernetes when
they can just use a basic server. I
think it's related. I think it's
related. And I think if tech companies
didn't hire the people with this fear,
we wouldn't get Kubernetes.
I fear a century of decline, too. in
some like abstract sense. Yeah, kind of.
I don't know.
I wonder how this would
remember reading these like manosphere
books when I was like 22.
Um I wonder if they I wonder if any of
them actually uh hold up.
Enjoy
the decline.
Damn, these books probably influenced
me, too.
right? Like like when you compare I
don't know and that's the other thing
like there's definitely things that
would make me feel fear but um I've read
a lot of history and you just read about
people who've had it so much worse than
you.
Civilian life in Berlin while under the
siege of the Russians in 1945. Berlin
was nothing but rubble. Supply lines
were shot and life for the average
Berliner was wretched.
They couldn't escape to the east and
fear the Russians would kill or rape
them. And they couldn't escape the west.
Not out of the fear the Americans and
Brits would do the same, but that the
Gestapo would kill them. That left them
trapped in a city that not only couldn't
support their population, but a city
that would become their grave.
How do you read that and you feel fear?
Just because something is better or
worse, right? I I don't like
because someone might misgender you. I
mean, that's that's true. That would
scar you deeply for life.
You get bad or no service, right? See,
like the government's got you so keyed
up thinking about healthcare, whereas
like people in Berlin are eating leather
from furniture,
right? Like I don't know. I really think
that this is all just a mindset thing.
And it's like Today's the worst day of
my life. No, it's the worst day of your
life so far.
Yeah, look at soldiers in Ukraine today.
Yeah, no shit. Right. Like, I'm so
grateful I'm not there. Y'all are like,
when you get a wife and kids, you'll
feel differently. No, I won't. If I was
dropped under the front lines of the
Ukraine war and enlisted in that army,
holy shit, I'd feel fear. Yeah,
like that shit's real.
I don't think Gaza is as bad as Ukraine,
but
again, we're talking Ukraine, right?
Like, you know, I'm not saying Eastern
Ukraine. Are we talking that I'm I'd go
to Kiev right now? Um,
yeah,
people aren't demoralized enough. It's
true.
Yes. Seeing a God, it's terrifying. It's
terrifying.
You want a harum with five 19 year olds?
Good thing they're 19 and not 17. Um,
I saw a Tik Tok of an 18-year-old
Ukrainian soldier having less beer than
people in this chat. Like, it's so true.
No. Let's see what we got here. Though I
really like someone recommended
Thank you.
This is interesting.
I'm actively ignoring every real retort.
What are the real retorts?
Oh, yeah. No, I would much rather be in
like in like a in like a Roman war.
Absolutely.
No, Modern War seems like such bullshit.
Like you're spotted by one drone and
then you're like taken out by some guy
20 miles away operating, right? Like,
yeah, that that that just seems like
constant anxiety
compared to like, okay, he's got a sword
and I got a sword. I mean,
don't sue Anna's Archive. Anna's Archive
are good people. That's sad. Spotify
suing them. Maybe I'll cancel my
subscription in protest.
Being in a rone war with the boys would
be sick. Yeah, in like some ways it
totally would, especially if you're like
not quite on the front lines.
Um,
cutting someone with your sword is
crazy. I don't know. Like, I'd feel I'd
feel fear, though. Would it be cool? It'
be balanced out by adrenaline, right?
Modern War is more similar to World War
I than World War II.
Yeah, I wouldn't mind dying with the
line, but kamicazi drone take me out
feels like Yeah, I agree. I agree.
Ever cut anything that was living with a
weapon?
Killed the chicken once.
Killed the frog once.
killed a fish once.
Never a mammal.
Lost touch. This stream is painful to
watch.
You saw I did a coding stream this
morning.
We haven't we haven't we haven't talked
in a while. I I felt like
uh why' you close the Roderdam office? I
don't know. the guy who was running a
crap.
Um,
Chad says money equals freedom. George
says we were already free. Uh, I tend to
agree with chat.
I'm getting tired.
Good night everybody.
Um, I really I really want you all to
feel less fear because I want the powers
that be to stop being able to control
you.
And if it means that I have to figure
out a way to help people overcome their
fears, then so be it.
And I'm going to think about that.
I'm going to I'm going to I'm going to
think about how to help you all. I'm not
sure what it's going to be yet,
but I'm going to think about it.
The weighted blankets was was an idea.
It was just a first idea, right?
It was a it was a first idea. Um but
we're going to we're going to try,
right? We're not just going to ask
people if they're the problem. We're
going to go to the next level and we're
going to ask why they're the problem.
Right. We had this stream where I asked
they're the problem, but I don't know,
in a weird way, working with AI has has
made me kind of more sympathetic towards
people, right? Like it's just it's just
it's just I don't need to I don't need
to like be gleeful that my reckoning is
finally happening. I just need to like
kind of,
you know, if if you asked if you asked,
there was a time where I was like, I
can't wait till takes all these fucking
people's jobs.
Um
yeah, but you know,
we only have we live we live in a
society. We we live we live in a
society, guys.
We we we live we live in a society and
and in order to make things nice for
yourself, you have to make things nice
for your neighbor.
Um,
good night everybody.
By the way, I didn't scam you on that
shitcoin, man. Uh, my apologies to
whoever got scammed. Most of you are
idiots. I paid back everyone who helped
me directly and I didn't deploy the
token. I did make money off it and I'm
not giving it back.
No, that's that's brutal and harsh. I
will think about how to deploy my
newfound generational wealth in order to
make some of you feel less fear. That is
my pledge to you. And you can hold me to
it. You can be like, "George, you said
you were going to do that thing." And
I'll be like, "Yeah."
But, you know, maybe I'll I'll really
think about it because if we're not here
to help people, why are we here? Why do
I still do this?
I'm a 36 year old man.
Why am I
streaming if it's not to help you?
But not in some like weird way cuz I
actually don't really want anything from
you. Even the subscriber thing was a
joke. I just want the world to be
better. I want everything to suck less.
I want everybody who feels that they
need to make things suck to stop feeling
that way. So then things could just not
suck.
in my beautiful slice of the cloud hello
people hello people where are the people
doing something know what you're all
doing make this or people maybe there's
no people if there's no people then
there's no stream oh there's a person I
was not Demi hi my love Wow okay wow
it's a little creepy oh we got one
viewer that's a little Oh about we got
we got oh we got eight off inch we got a
name that's in black that I can't read
that's poorly designed
hello risky banana thank you for
subscribing to my stream I'm so happy to
have you here welcome everybody welcome
welcome welcome happy fourth of July
look that 3d just went off alright so I
decided halfway through cooking to do a
cooking stream so student my fucking
awkward like xok do not have my handlers
tell me how to drink a cup of water yes
yes they briefed me today that normal
Americans drink blood light and that's
why this stream is brought to you by Bud
Light
it's made with corn syrup yeah Bud Light
it's made with corn syrup perfect I love
points here there's nothing more
American than corn no that's that's
perfect no no no no we're not you're not
smoking meat we made portobello
mushrooms and like this already happened
so you missed the garlic mincing you mix
the mixing of balsamic vinegar and olive
oil
you missed skipping the rest of these
ingredients because I thought they were
stupid whoa whoa director homeless say
good things about Bud Light that's what
his jeans brought to you by brought you
by Bud Light made with corn syrup thank
you Thank You Al Aqsa thank you for
liking my apartment this
sometime we come out on my beautiful
balcony out here uh and we lay back down
and we just you know the world is ours
right cuz cuz I live in the cloud my bed
my bad I sleep out here I sleep out on
the porch yo I've been out that Valley
you ain't been up off that porch man
can't nobody tell me not this speaking
of the cloud um
oh no dots oh you got me bros what do I
make of all the cloud outages I think
Google and Facebook a full of shit
alright so we are cooking on this stream
so we already cooked these portobello
mushrooms I'm not really know where to
put the phone that you guys would be
able to see it alright so let's get a
bowl we're gonna be slicing some
Tomatoes here's a bill all right we're
gonna my cooking knife here I was
kidding about the cooking all right
we're like we're really cooking look at
these Tomatoes these are tomatoes on the
vine from Whole Foods you pay an extra
dollar to put them on the vine but guys
we broke the daily Eon sales record all
thanks to I think it was toast 69 that
came through at the last minute or it
was toast mister toast on discard if I'm
saying your name wrong I'm sorry I don't
have discord on my phone but we broke
the sales record today and in honor of
that we're doing a cooking stream
alright so this is a tomato we're gonna
wash it and then we're gonna try to make
some really nice burger slices for it I
guess you guys want to see the washing
of the tomato yeah
alright we're washing the today
all right I think it's good and watching
that tomato's didn't want very cool all
right
let's let's let's try to get that slice
to be really nice you know no no the
knife is pretty sharp why do you think
my knifes not sharpen my knife is gonna
cut through this leg butter what does
Gordon Ramsay say he says just let the
knife do the work we're just gonna let
the knife do the work we're just gonna
let the knife do the work yes
what's that tomato oh look at that slice
see this part of tomato it's not useable
on a burger just eat it
yep how can you do all right I really
want that slice to be the perfect burger
you know we were trying to make the
perfect burger here
you got that slice on your burger would
you be happy no no you made it sport
it's good you're just not letting the
knife do the work
just let the knife do the work yeah
there we go perfect and beautiful slices
slice this guy and it's trying to deform
and not become a tomato anymore I don't
know how Gordon Ramsay deals with that
all right we got some beautiful tomato
slices it'll be great for burgers I'm
gonna need a few more that's not a slice
help one more tomato huh
[Music]
so I haven't taken wall to the fridge
with me we're gonna get a splash of
olive oil in in a minute so we got the
oven preheated here for our portobello
mushrooms which were prepared off stream
we have a bit more balsamic olive oil
mixture a little bit heavy on the oil
and we're gonna we're gonna just drizzle
it we're gonna we're gonna put this guy
right here we're just gonna drizzle it
over these mushrooms yeah we're just
gonna get on that mushroom yeah get a
little bit on that mushroom offices this
is this is perfect guys yep just get a
little bit on this mushroom it did say
to marinate them and let them sit for 15
minutes so we're just gonna do that
because the people are coming over at
7:00 and that's who this Fiesta feast
has to be be be ready for yeah those
portobello mushrooms are gonna be sick
right all right so we got our Bud Light
here ready blog light number two let me
bring you guys to the fridge the fridge
is a really important part of cooking
yeah so we got got cooking right here
and we're gonna gonna bring you guys
back over here and we're just gonna
crack open this Bud Light cuz I'm from
New Jersey made with corn syrup the true
American sugar periscope had a better
chat interface I cut myself a little on
a camera oh well we're good let's just
wash my hands oh we've got to wash your
hands when you're cooking always just
put the soap on there like that just go
in and wash my hands up like this yup
there we go
make sure your hands are real clean
always real clean real clean get them
Germans off don't just wash with cold
water you gotta wash it with warm water
guys make sure to wash your hands with
warm water all right just dry my hands
on this dish towel over here perfect
okay let's get back to slicing Tomatoes
yes Johnny ma'am and this is cooking
stream oh that's a beautiful slice
there's gonna eat that slice there hmm
mmm not tomato is that's a delicious
tomato don't know where to make that
tomato better a little bit of olive oil
I'm gonna make the tomato slices pretty
then don't want overly thick tomato
slices perfect that's a good amount of
tomato for our burgers maybe we'll do
one more tomato slice right here
that's a thin tomato slice this tomato
slices miss shapen you know what we're
gonna do with the MS shape and tomato
slice guys we're gonna put it down the
disposal good view on that disposal
there yeah there we go
turn the water on always show the water
on for the disposal and that's the
mantle slice nobody will ever know about
because it was a UH it was bad tomato
that's right you gotta have that iceberg
lettuce the kind they put the Italian
salads you know what I'm talking about
okay what about the hey no shirt on
today I on this stream we hit a new
record today so I'm working hard I'm
gonna slice you all I'm gonna get bad
for Twitter saying that tech companies
really got the bands in full effect
these days everyone's getting bang on I
think they just banned people for
posting hacking content on YouTube I
don't know what am i content we can
consider hacking content who knows man
the thought police are coming for you
drink blood light that's made with corn
syrup and we don't how Bud Light would
feel about me saying cuz it's fake news
but it's so blessed shield for their
product and it makes a reference to an
ad campaign that everybody probably saw
I'm bleeding again this is terrible
I do that myself
earlier let's just wait a little bit to
stop bleeding
maybe we'll meditate on our beautiful
outside porch I live in the cloud who
thinks I was hot for South but after you
smoke enough weed you just kind of can
like turn it on and off you know no we
don't have any bandits we're just gonna
will my cut to heal I'm gonna will it to
heal okay
told you over the ledge it was my
beautiful iPhone 8 I was rich long
before a 16z don't smoke weed much
anymore
no I have drank one and a half Bud
Lights
but that's about it well no I cut myself
earlier and then the can crushing just
reopened my cut so we're gonna be a
little bit patient while it clots you
know it's got a clot maybe maybe if we
drink milk the blood will clot you know
what let's have a vitamin that's a great
way to make your blood clot I read that
on the Internet
all right so let's just we got vitamins
right here we got vitamins no we're just
gonna take one of these vitamins it's
been a while since I've seen Marc
Andreessen they don't talk to me anymore
they don't like me
delicious vitamin comes with everything
you need all these things alright I
think my bleeding stopped thanks to the
blood clotting power of vitamins
protectors disrupt okay so I'll tell you
the truth about tech our system director
all of us um you do a Department to it
later after cooking because this is a
cooking string by as I promised um I
went to it I was sorry my sister week
before TechCrunch Disrupt and I said
what I really wanted to do was pull my
pants down and like you know shit on the
stage right because that's effectively
what everybody there is doing but
they're not honest about it
right like they're just talking shit
right like why don't they just actually
you know drop trou and go for it
um so I tried to do that as best as I
could verbally
I saw your talk I K tonight to smoke and
not to drink
if you drink smoke anything will you get
to where you are now don't drink to
excess don't smoke to access if you're
the kind of person who smokes every day
and sits on the couch and does nothing I
think it was man I think it really was
like there's some weird theories about
what really happened
there's no the winners right history
right thank you thank you everybody life
to jailbreak the simulation talk okay I
believe the bleeding has now stopped
yeah we're good good thanks to the
clotting power of vitamins and we're
gonna get back to cooking alright so
when you get a hit list
you're going to make sure to wash that
lettuce really well because lettuce
that's not washed well can become gross
okay I'm still bleeding we gotta wait we
gotta wait guys we gotta look just stop
oh all right let's look at it up can I
show you guys this is this against which
this policy am I gonna get banned by the
way could you guys subscribe pour salt
on it all right let's try that and we're
in the middle of a cooking stream after
all so let's let's try putting some salt
on the wound is that a good idea it's
not like a bad ion let's say can't show
blood on stream I'm gonna get bad we
salted it oh yeah we put salt in that
yeah Zak does that work I probably
should have googled this before I just
listen to you guys
daughter less your Bach I don't know
what else did I mention
did I mention crime and punishment about
why I'll never be a criminal why do you
know where the column AI offices that's
concerning what are we cooking we're
making burgers we're making burgers just
like Gordon Ramsay will also make it
some portobello mushrooms okay if I
stand stream whatever bullshit I want
and be entertained while doing it then
there's no point having streaming career
like look if I have to be the kind of
streamer where it's like you know tits
or gtfo that's not the kind of stream
where I want to be okay okay I've had it
with this bleeding it's really starting
to piss me off now we're just gonna wrap
it up I'm gonna wrap it up with a little
little little tourniquet right here by
the way I just want to make clear and I
didn't cut myself with a knife I cut
myself earlier and then reopened by
wound when trying to crush a can of Bud
Light made with corn syrup we got that
wound wrapped up that's right yeah
putting salt in your wound there's also
a saying called Dobby bitch and that's a
saying that I try to
all right cool let's watch this lettuce
gonna show you guys washing the lettuce
[Music]
we're gonna wash the lettuce together
everybody will wash and let us alright
cool so I'm gonna want to let us this
cold water not with warm water
wait who is that cheese portobello
mushroom I'm a way sicker portobello
mushrooms
oh then Gordon Rambler and he's a good
cook ma'am all right so I don't really
know how you prepare a lettuce but let's
just try eating a lettuce and see what
happens okay
ayo eat crap do not wash yet oh we got
the leaf now we do this to leave
all right guys I'm gonna do with that
whatever I don't like that way the stuff
that goes in the disposal anything I
don't wipe I just put in the disposal oh
[Applause]
that's gonna leave you guys out of good
Middle East and we got this for later
plug this back in the fridge oh cool all
right
now let's just put the leaps to this
bowl right here and let's wash up always
watch everything guys you don't know
where your produce has been he's gotta
wash your produce just wash good yo you
know what I can't believe 132 people are
watching this shit like I get it when
you guys watch the program I'm actually
pretty good at that but I don't think
this is how you're supposed to do
lettuce at all the bleeding stopped
where's the clotting not working we have
to take them inviting me
mostly stop we'll wait a little bit more
mmm all right cool lettuce is so cheap
go ham for you guys I made some chips
fill my chip want to check you guys on
chip
but like maybe the point zero
antiperspirant we could try that all
right so much people do something on
credit uh so I think we're good on
beliefs here we're actually gonna
transfer the Leafs over a small bowl
here lettuce is cheap we could have done
more lettuce I think we cheaped out a
little bit on the lettuce but washing
lettuce actually takes a lot of time oh
okay all right
my bulbs I used one for that I use one
for that we're just gonna use a plate
guys a little bit red onion right here
kept it in a bag wash the onion that's
sure you guys watching the onion
all right cool watching the onion yeah I
missed the keyboard sound to the chat
you posted on Instagram isn't the one
you use oh yeah
I bought a new chair cuz I'm rich make
sure to tell you know I wanted Instagram
there all right cool
I love telling people on Instagram that
I'm rich we're gonna really slice this
onion good it's a good slice I'll look
at that beautiful look at that beautiful
slice can't believe that look at that
that's an incredible looking slice um
we're just gonna peel off this outer oh
that's actually where's chop this
alright
good shot right like that that's a
beautiful piece of onion for the burger
if I got that cut on you know my burger
I'd be very happy all right cool I'm
gonna move the tomatoes out to the plate
as well I'm gonna put them on the plate
here you're gonna arrange it like we
like you know did something I cool look
at this we're gonna show you guys this
plate when we're done we're gonna put
the letters on the plate too oh yeah
well this this looks like Gordon Ramsay
made yeah look at this plate so far
that's like that's a nice plate of off
things to put on your burger let's just
slice a few more onions and I think
we're good all right people suffocate
eating that slice you know how I feel
don't know
you know people never onion right here
we're gonna just slice this onion off
right down here
oh no look that slice didn't come out
well when did it turn into little onion
we're really gonna try to spice it super
well so my salary that Gordon Ramsay
knows some trick that I don't not so
good-looking slice cool yeah you really
really got to look tonight through the
work here perfect
oh that that's a good slice we'll just
put it back together here no one will
know that I'm a terrible chef right
that's a nice looking on you all right
I'll just put that right over there all
right we making burgers right here on
this dream if you just joined us welcome
this is the Geo hot Channel well we cook
cooking alright this I am NOT putting it
bad beautiful later
that's good but white guys alright we're
good on the onion now let's get the only
part of the burger than anybody cares
about first we're gonna do a little bit
of googling for how to season your
burger meat so let's go over here to the
computer here we are on the computer
where we looked up baked portobello
mushrooms and let's look up burger
seasoning yes burger meat seasoning okay
Oh Fuddruckers I see there when I was a
kid
bread fuckers yeah get this paprika
ground black pepper salt sugar garlic
powder onion powder green cayenne pepper
that's crazy that's crazy we're not
doing any of that shit we're gonna wash
our hands again just to show you guys
cuz hand washing extremes are really in
these days I just watch I mean imagine
that was just a stream of people washing
their hands you really got to get the
soap everywhere turn on that warm water
not cold we're just gonna wing it for
the seasoning we're just gonna wing it
okay all of em for pointing to you I
appreciate y'all sticking with me we're
getting ready to move on to the main
event where we bring out the meat
let's take a look well let me just do
what my seasoning play a little bit here
I've got some onion we got some letters
and we got some Tomatoes well that looks
oh that looks this looks I mean really
could go to any do a better job that's
what you want to look at this right
that's that's beautiful that's that's
that's food porn right there you guys
could could post that on reddit we've
got like seven likes perfect yeah I love
that love that I
let's see the chip let's block with John
oh why he hasn't we're touching the edge
of okay let's get out couple pounds of
meat and we got a blob light yeah we got
country natural beef right here I like
to leave the meat all things have innate
my cutting board that is a nice-looking
log of meat if I've ever seen one
oh yeah look at that put bottom on the
patty before cooking I like that that's
good best good tip alright let's just
make that much of it and we put the rest
away for later alright
this got the ball take this log of meat
throw it in this bowl here right wrap up
this to put back in the fridge just as
later food you always beat later food
guys don't eat all your food at once you
always need to save some food for later
I'm gonna watch a few more cooking shows
and I'm gonna imitate their like things
so well yeah when I say it's gonna be
ridiculous like you gotta have some
later food guys you know
[Music]
we're gonna use this on you we're gonna
mince it and we're gonna use this onion
I always like a little onion in my
burger as well as on my burger I'm a big
fan of onion let's just say all right
this one I don't think is really edible
the rest of them are so this one I don't
know not edible all right this one's all
good so let's just slice this up a bit I
can't watch the camera while I do this
because I do not want to top myself
already caught myself crushing a can of
Bud Lights which is made of coin serum
it's delicious oh yeah oh yeah that's
that's not satisfying oh that's really
satisfying guys that's really satisfying
let's just let's just cut up these
onions here oh yeah we're gonna have
we're gonna really mince this on all
right we want minced onion mix in with
our burger meat what's up with the face
what does that mean you never cook meat
so don't move
meeting all the ones don't look good hey
hey if you want to like me you know what
love this dream right now but if you do
like me please subscribe because this
good stream is only made possible by
subscribers like you
okay so we got the meat and we got honey
so we're just gonna you know mash this
meat down a little bit here gonna mash
this meat down and we're gonna take
these onions
all right cool we got some meat some
onions she's gonna be delicious you guys
we gotta look we gotta figure out
I knew the onions we gotta figure out
what else we have to put it in we're
gonna put in a little bit of garlic we
might do a little bit of garlic
okay two teaspoons of paprika I don't
have that shit one way to have teaspoons
of ground black pepper we can do that
one 1/4 teaspoons of salt what any sugar
in my shit oh we can throw a little
cayenne pepper right I think I might
happen they might actually have a whole
cayenne pepper but that might be a
little much garlic overdoing the spice
rack here see what we have we have cumin
I don't know what that is we have
oregano we have chili powder
that's not cayenne pepper powder and we
have cinnamon mmm I'll take the pepper
out definitely pepper always pepper
let's just use salt and pepper and onion
that's that's perfect that's perfect
recipe for my burgers not using any
cinnamon not making weird burgers you
guys all right a little bit of pepper a
little bit of salt and then let's just
grind this up here I'm sorry I dropped
y'all I just touch the meat so I'm just
gonna wipe my hands on that and then put
you guys back up all right we're good
let's just mix this up here that's some
onions in here got some pepper and we
got some sauce we can always add a
little bit more pepper and salt say this
is actually a lot of meat I love a
little bit of onion
and with my me we might have gone a
little overboard on the onion so it
seemed like a lot of onions so we're
just going to take these onions and
we're going to throw them in the sink
that's perfect yeah now we didn't go
overboard on the onion anymore
we're good we're good we're good I'm
just gonna rinse my hands off a little
bit wipe them on this flower sack right
here and we're gonna go ahead and add a
little bit more salt and add a little
bit more pepper
all right cool cool cool cool all right
that looks good no it's good that let's
just let's just keep going with this
just really really get this meat get
this meeting in tip-top shape here you
know what I'm gonna add the rest of the
meat if we're going we're not gonna save
any food for later I know I said we were
going to but we're just not gonna do
that
not out of your neck you stop with your
stupid suggestions so in order to
balance that out you just take another
ball of meat and you're throwing in the
other ball of meat and you just mush
that all together there that's all gonna
come together and form a beautiful you
know great consistency
burger burger meat stew here this looks
this looks like exactly what you're
gonna want to make make burgers out of
we're gonna break it up into burgers in
a minute get the cutting board out
really uh break it up into burgers do we
need more salt and pepper I'm gonna
leave that up to you guys yeah yeah
onion salt pepper me what this great
shit you guys know I would don't let the
song pepper all right all right I hear
you I hear you okay okay okay all right
we're done with the salt and pepper okay
well I hope more salt and pepper later
right perfect all right yeah all right
the meats already perfect as it is
that's what you always tell me all right
and egg and breadcrumb stuff
no we're not doing any of that I'll get
our cutting board right here let's just
wipe it off yeah perfect
well give it a little rinse and then
we're gonna break the rule putting meat
on the cutting board but I don't notice
how else to make good patties such that
y'all can see all right perfect
all right so I don't know my you know my
milligram scale I got rid of that when I
stopped doing drugs so we're just like
afraid we're just gonna take a ball here
and this is going to become patty I
think it's not a good patty sighs it's a
little large well does it actually more
meat than I thought is that gonna make
it good let's just I've seen like you
make like a ball is that like a good
patty it might be it might even be a
little bit thick okay
really if the only thing I know about me
is quarter pounder with cheese so maybe
we want like something that big looks
like it's gonna be a good patty you guys
this is too big this is too big
I don't know patty says looks good I
perfect right yeah we got one all right
they're good all right let's just take
the rest of this meat put it back in
this bowl here and let's put this in the
fridge for later this is later all right
we're gonna take this and you're gonna
throw that away cause we don't need any
more all right now we get to the fun
part the part where we you know we're
cooking with wood stove go over to the
stove here you know and then we all use
cast iron pans one guy firebase and to
cast iron pans it's almost time to put
the portobello mushrooms into the oven I
want to make sure they're ready just in
time when my guests arrive at seven
o'clock so
let me figure out how to put you guys on
the stove give me one second how are we
gonna do this so here's what we got here
I'm just gonna give this a little bit of
heat and then we're gonna throw some
butter in it then we're gonna wipe it
down make sure that gaskets oh that
looks perfect
we only cook with cast iron in this
house B of this cast iron pan and this
cast iron pan
I'm not frying the mushrooms we're
actually gonna stove the mushrooms I
know it's a little bit controversial but
we're gonna go with the stove so the
mushrooms actually put oil in the pan
all right so what are we gonna fry with
we're gonna fry with olive oil and we're
gonna fry we thing we're gonna fry with
the butter okay just patty you're way
too thick you're fucking with me we're
splitting this into two bags you're
doing patty with this will do patty out
with my Patty spin olive oil smokes
earlier okay all right money baby thick
Novik is hard to cook I've done this
before
no I have heard that olive oil smoked it
has a smoke point oh my god where the
chat go Shh twitch interface is terrible
I know I got ya I got y'all show chat
having an actual streamer interaction
yes welcome to the gorge hot stream
thank you for subscribing by the way I
really appreciate everybody with a star
you're better people than other people
you guys all deserve a Bud Light if I
could send a Bud Light to you right now
I would not like really but please
subscribe if you haven't subscribed
because it's your subscriptions that
make my dream of being a cam girl
possible wait F wait what mister you
broke now what we get to stick Wi-Fi in
this apartment
alright we heating up this pan here a
little bit we're just gonna throw a
little bit of butter in there you got
the nicest Irish hairy gold butter
butter has a higher smoke point than
olive oil I do watch cooking shows once
just gonna take a slab of butter here
cut that butter in half and take some
butter throw it in the pan now that
looks perfect
oh that looks Alex ideal alright it's
gonna take that I got to show you guys
this this looks mad cool take that
butter we're just gonna move it around a
little bit here to really get that get
that pan at that pan ready go ready to
cook my burger here alright alright a
low battery oh not regular butter oh we
got regular butter alright alright you
got we got a back going on there now
we're just gonna take our pre-prepared
burger patty I'm gonna throw it in the
bar all right good I don't think it's
too thick guys I think you over fuckin
with me I'm gonna I'm gonna actually
flip the stream around so we can use
this camera that's perfect oh yeah look
at that look at that burger press down
on the center okay
all right that looks great
my means to big bunkers I've told you
all right there my spatula smack them
with a spatula okay all right all right
well push it down with this guy oh yeah
look at that sizzling oh look at that
look at that beautiful plastic spatula
imprint right there this is what America
is all about
if you can't get behind America and get
off the street because this is really
this is truly the American dream right
here I live in this beautiful cloud and
I'm talking to 127 people on the
internet and we're making burgers
wait it's not time to flip it yet don't
fuck with me all right
low to medium heat oh then we're gonna
lower the heat a little bit here got to
lower the heat because it's so thick oh
yeah and I bought some healthy
multigrain bottles because I don't like
to really eat bread um carbs are bad for
you okay
it's 6:30 so maybe we'll give it another
5 minutes and then we'll put these
portobello mushrooms in the oven this
burger a little bit of time to sizzle
here how do I know when it's ready to
flip I already put I put tons of I put
tons of butter
hey if Google steals my burger methods
you know Larry and Sergey if you ever
want to come over for a burger you're
welcome to don't invite sundar Pichai
that's all I'm saying
I almost made it help me help you joke
on Twitter today I was a Logan Paul fan
briefly
all right I'm starving fresh
I really flip the burger is it time to
flip they say you're only supposed to
flip it once I know that from the Gordon
Ramsay strings so let's just I don't
know how to hold you all right let's
just open up this just got to make sure
the Bud Light logo is really in there
that's perfect let's just get out one of
these it's a good-looking fun fun
actually dad oh that plate I got a plate
and we're just gonna go one on the plate
just looks sad totally strap on a little
bit I don't have a toaster so that's too
bad alright is it time to flip the
burger guys
should we flip it come on you asked
where I was a Logan puffin hey man
somebody needed to support that guy
after the suicide forest video he came
back and became a bitch I didn't support
him anymore but during the month heated
in the stream I was the biggest Logan
Paul fan okay perfect let's flip the
burger guys oh oh look at that looks
like perfection what Paul has a podcast
now the answer is not this better look
sick what are you all talking about I
don't like Mayo Mayo is disgusting
we're killing it I think we're killing
the burger game here get rid of this
bullshit you only think that oh that's
like the burger juices and stuff that's
just gonna make the second burger be
even better this is my test burger
before the guests arrive I'll put a
piece of butter on top of the burger all
right we're gonna do that we're gonna
trust you man let's get the butter out
let's just take a little piece of butter
here and let's just throw it on top of
the burger you think that's gonna be
good it's a holiday
we can eat saturated fat saturated fats
I don't know really not bad they are for
you but carbs carbs make me tired and
that's why we're eating whole wheat buns
I wish I could eat them up with a little
bit bell but that's not even gonna
happen all right shut the bar brother in
the burger now this is too much guys I'm
get rid of that butters going over there
I don't want to anymore all right I
think this burger might be done is it
done it might be pretty good to me
is it done char the bone on the stove
she told a mad man that in there for a
minute you're saying okay it's not done
yet all right we'll put it back we'll
put it back all right I hear you I hear
you all right all right it's back
burgers back burgers back don't worry no
I'm done no harm done but you got to
wait for the juice to start coming out
the top well how am I gonna know that
the middle is still raw okay great all
right all right how patient do I have to
be I'm a really impatient guys drink
called life
wait staff knows geo hot am I gonna get
the end for cooking it's cooking allowed
I don't know butter the bun and brown it
on the stove no no we're not cooking the
bun guys that's too much all right put a
slice of cheese on top we're not making
a cheese burger here we're making a
hamburger cheese is like carbs all right
is it done
no maybe not actually it doesn't look
that cooked
I'm not putting fuckin cheese on a
burger okay oh yeah I have a little bit
worried that when I said this party had
mushrooms people maybe thought that they
were the other kind of mushrooms
wouldn't have any of those mushrooms
here we only have these mushrooms there
should talk no there are portobello
mushrooms I know my cooking's all right
let's put this in the oven let's do it
let's do it let's go oven guys it's oven
time all right we cook them for 15
minutes
perfect right this has got to be done is
this done yet no actually maybe not I
don't have any American cheese guys I
got a bag with some cheddar in it I got
one mozzarella
yeah mozzarella we got no the guests can
have cheese I'm just not a me any cheese
just burgers for me it's a fat burger
that's what I'm talking about right not
putting any mozzarella cheese on the
verb Oh
yeah alright alright alright I skipped
out in the American cheese
I went cheap I didn't buy something it
was very own American of me I'm Way too
minimalist for America anyway I should
buy way more things and we're gonna get
right on that
after we drink a few more Bud Lights oh
can I describe the snow all the smell is
where the smell is it's really
intoxicating guys that's a fat burger
this actually looks really good you put
a little beer on the burger we're gonna
do that talk about beer burgers we'll
season it a little perfect oh yeah look
at that
yeah oh that looks good I just turn this
fan on up here oh yeah the old pod light
we're not putting it in the oven
terrible alright alright looks good it
actually looks genuinely delicious I
don't know how to tell what it's done
you think it's ready Al Aqsa alright the
locks of things it's ready can I get a
little more support on taking the burger
off the grill should we do it I
appreciate you all being with here being
with me here cooking all right hey hey
just wish you had this burgers you wish
you had this burger all right let's just
put it on the bun right here I'm gonna
move it over a little of my hands cuz
not that good with a spatula let's get
out these beautiful toppings that we
prepared earlier let's turn the heat off
over here let's turn the fan off over
here alright now what do you like on
your burger I like a bit of raw red
onion let's just throw that on top right
there can I slice a tomato oh that looks
great and let's throw on some letters I
love letters I'll look this letters is a
thick letters it's gonna be delicious on
my burger I'll put it on this side of
the bun here and we don't eat it with
ketchup or Mayo cuz that's just
disgusting alright that looks great
that looks great oh look at that burger
got a whole wheat bun right there
healthy no carb
uh yes yes guys yes we did it we made
this burger Five Guys Burgers and Fries
right here
remember Zoe Quinn it's actually really
good it's delicious
that was the best thing I thought in a
long time the bun could use a little bit
of heating up but this patty this patty
is the epitome of excellence oh my god
that just tastes so good my guests are
gonna be thrilled with quality and these
burgers I feel like such a success right
now you know we went through a bit of a
rough patch last weekend where I was
feeling like a failure
but as you can all see them comma a
guy's Twitter sales have increased
exponentially we're gonna be so bad you
know what fuck it we're doing
advertising we're selling out but sell
out man let's sell out boys was still
out was buy a jet ski all the beer the
beer no what made his burger so good mmm
mmm who's that my burger wasn't juicy I
could imagine a bear burger that is
cooked medium-rare to perfection
[Music]
mmm-hmm that's so good that's that's
delicious
that is truly oh there's no seats like I
made a list of what I had at my
apartment and I said if you want
anything else you gotta bring yourself
that's what minimalists here oh I should
make burgers more often mmm no I love
this fat burger you gotta be totally
right about not trying to double patty
this shit we went with one thick patty
with all your help we were patient
imagine I'd taken it off the stove
earlier on imagine I took it off the
stove and didn't put it back we'd be in
serious trouble right now but thanks to
cooking with all of you guys on twitch
that burger is cooked to perfection mmm
I love America I'm so happy to be here
right now this is a true American
pastime drink a Bud Light make them
burgers with the bunch of borough's even
though you're virtual and think we have
six minutes all right well I'm gonna
have to go I'm gonna have to rewind the
twitch stream and figure out when I put
the portobello mushrooms in because it
did say 15 minutes people I told him to
show up at 7:00 so I'll probably show up
at 7:30 and I've already eaten probably
all the portobello mushrooms there so
problem this burger this burger has to
be one of the best things I've made in a
long time
I'm gonna savor just lastly I'll bite
for once we get off stream I really
appreciate having all of you here to
cook with me
that was absolutely delicious burger I'm
so happy to be in this wonderful country
well it's day of Independence
now the streams gotta go man streams
gotta go I got things to do
so Tommy eye-opener right I really I
think I can make a great burger
restaurant all right thank you all for
joining happy Independence Day guys have
a good one
hopefully you're making your own burgers
and if I ever sell out let me know it'd
be like George old you would have never
let you do that
and I'd be like yeah you're right and
then we'll fix it because if I go up to
be a sellout no matter what I have in my
life I failed but if I'm here with you
bros eatin delicious burgers in my
lovely apartment it really doesn't cost
that much money cuz I live in San Diego
now I'm very happy oh yeah follow me on
instagram one I'm 20 19 comment make
sure to follow me in there for them when
I meet girls you know it used to be like
yeah what's your phone number right and
like okay you die message no iMessage
now it's like what's your Instagram
right I like that I've 12,000 followers
I'd really like a blue checkmark if
somebody knows how to get me that blue
checkmark hide if you want like a favor
you get me a blue checkmark and I'll do
a favor for you thank you all for
joining blue checkmark
you
mykyta_1: hey
lumma119: sup
whiterunknight: good morning
Shourikan: Yelo
hakobyte: yo
optionalflag: lets goo
moriartyblen: helo
lukasf6: Hello
sarah99___: 😎 here before submode (loser mode)
cantaim3: hi George
480i: hello Mr. Hotz
whiterunknight: did you buy the 5MW dam
obelixx0: obelixx0 gifted a Tier 1 sub to sarah99___! This is their first Gift Sub in the channel!
bojosos: Hello
sarah99___: Certified loser now BigSad
whiterunknight: hahahaha
sarah99___: ty 4 sub
RickAndMoreTea: how we doing yall
bojosos: Well he is absolutely right
MrKerow: alkXD
pepebruari: wrangle it in Georgie
madebyollin: sounds like it's time to refactor the linearizer
kalelite: Step 1: increase font size
sarah99___: Another certified George Hotz (noob) lesson Kappa . I.e chat will be lost after 10 mins
colonizethemoon: yo
djcodered__: lmaoooo
whiterunknight: :D
jjccccccj: Can you teach us react native?
bojosos: Good font size
whiterunknight: it’s a great font size
djcodered__: extra nice George ...
djcodered__: lmaooo
MrKerow: why you care about teaching others george ?
sarah99___: Karpathy era. I remember "Karpathy tries to actually teach you something, I just want to prove I'm smarter than you" GeoHotz
whiterunknight: George w hotz
jjccccccj: Meditation time?
bojosos: ratirlAlfred
bojosos: And we are already off HypeKEKW
djcodered__: I had a social studies teacher like that
jjccccccj: Those were the best classes tbh
sarah99___: she sounds 40+ so no
MrKerow: alkXD
alexberd24: peak content
bojosos: ratirlMeditate
sarah99___: BigSad we got GeoHotz Meditation before GTA 6 😭
whiterunknight: Namaste
sarah99___: you have to say the Namaste! It's what seals the calmness
bojosos: Gonna need that video in another 10 minutes
itsamarcos: meditation may be more effective than overcaffeination, guess I'll never find out though
sarah99___: Will captain throw us overboard (ban) ?
cuddles2000: cuddles2000 subscribed with Prime.
MrKerow: that's a name
itsamarcos: is there a goal for the tutorial? like fine tuning or running inference on a specific toy model?
kalelite: i didn't know we would go that noob
gliched_robot: gliched_robot subscribed at Tier 1. They've subscribed for 34 months! Looking forward to Tinycloud, how was your trip to find 1MW power stations?
cuddles2000: Nice outfit George. Looking the oppositie of disheveled. Shelved?
whiterunknight: I asked him that @gliched_robot he said to not get him started lol
gliched_robot: @whiterunknight  thanks! Sorry for repeating!
MustiFreak: hello
ABeautifuIDeath: hi
cuddles2000: What do you mean by "not computed yet" for the static data you set?
stoddlabs: stoddlabs subscribed at Tier 1.
stoddlabs: what is the benefit of Tinygrad being lazy?
gliched_robot: @cuddles2000 Because the ops are lazy. will run when they are needed. think similar to the python datetypes, it will assigned when needed to.
cuddles2000: So the lazy part in this case isn't "computing" as in math, it's about copying from memory to TPU
radon_90: radon_90 subscribed with Prime. They've subscribed for 3 months!
ABeautifuIDeath: ABeautifuIDeath subscribed with Prime. They've subscribed for 2 months, currently on a 1 month streak!
landepbs: and tag
TamagotchiCoder: hello dude
bojosos: This is a very tutorially tutorial
cuddles2000: Do duplicate calls do realize throw exceptions or is it a no-op?
IceLeo: IceLeo is gifting 10 Tier 1 Subs to georgehotz's community! They've gifted a total of 111 in the channel!
IceLeo: IceLeo gifted a Tier 1 sub to timichiban!
IceLeo: IceLeo gifted a Tier 1 sub to slouck!
IceLeo: IceLeo gifted a Tier 1 sub to 480i!
IceLeo: IceLeo gifted a Tier 1 sub to dfdx2!
IceLeo: IceLeo gifted a Tier 1 sub to lyrareturns!
IceLeo: IceLeo gifted a Tier 1 sub to thatjuandev!
IceLeo: IceLeo gifted a Tier 1 sub to brun2302!
IceLeo: IceLeo gifted a Tier 1 sub to kaljr!
IceLeo: IceLeo gifted a Tier 1 sub to Xewl!
IceLeo: IceLeo gifted a Tier 1 sub to jasondavies0!
TamagotchiCoder: Does it support Metal?
itsamarcos: I would just recommend having a clear goal for the tutorial, so that there is an end result to look forward to  makes the knowledge stickier too
itsamarcos: oops newline got removed there
dfdx2: @IceLeo Thanks for the gift sub!
smurfd0: <3
stoddlabs: If Pytorch isn't lazy, why is tinygrad? What benefits and trade offs are there?
itsamarcos: > what is the benefit of Tinygrad being lazy?  @stoddlabs it's so you can optimize the computation graph instead of executing every instruction greedily
bojosos: Torch has lazy stuff you just have to use them explicitly
stoddlabs: @itsamarcos so the idea would be to get all the context/steps for the job, then optimize form there instead of trying to optimize each step without the full context?
Mohaidoss: Mohaidoss subscribed with Prime.
Mohaidoss: Devtools pprint doesn't help make it prettier ?
firejjb1: if 2 UOp have the same src how is that printed
nuttyodin1: nuttyodin1 subscribed at Tier 1. They've subscribed for 26 months!
cuddles2000: That's super cool. It sounds like it would only copute t*4 once
smurfd0: print on line 95 you dont have the output for?
dontcrysomuch21: dontcrysomuch21 subscribed with Prime.
cuddles2000: I wonder how much CPU/memory gets spent trying to match operations to the global list to prevent duplicate compute
bojosos: What python is so magical
nuttyodin1: what are we doing today
stoddlabs: maybe it wouldn't be appropriate here, but maybe put why using Tinygrad makes sense over other libraries?
bojosos: But people in general don't make good decisions, they like being sold something shiny
itsamarcos: @stoddlabs exactly
cuddles2000: Is George threatening to break our leg?
def_stimulatedreceptors: def_stimulatedreceptors subscribed at Tier 2.
def_stimulatedreceptors: George, I am about to purchase tbox reds. I'm concerned on shipping internationally, especially to Aus. Have you had experience with shipping expensive large items to aus?
bambikapelo: x^2
cuddles2000: Yes
bojosos: yes
cuddles2000: AI support bot? Sometimes they don't suck now
djcodered__: lmaoooo I swear my friend thinks
djcodered__: If Im his CTO... he can text and email about random shit
djcodered__: koggin1Lynn2
smurfd0: maby keep output within """ """ comments
jjccccccj: what is a ramp
whiterunknight: a ramp for the noobs
cuddles2000: Is the generated C code just a reference or does it actually compile snippets of C as you run it?
def_stimulatedreceptors: Okay, that was all. I wanted to see the success rate of landing w/o damage. I have no trust issues w/ Tinygrad, just with shipping companies I've had bad experiences relating to expensive, hard to get hardware.  Thanks, good point. No I'm not looking for tinygrad to hold my hand and make me feel warm and fuzzy through each stage of the transaction. :)
whiterunknight: intel powered forklift
bojosos: Tiny customer service
boop322: boop322 subscribed with Prime.
def_stimulatedreceptors: It's not a money thing for me, I have a thing for freight handling morons breaking precious chips.. In Aus, our suppliers cut margins thin on consumer grade GPU's, so we have a limited market.  How that relates to my point, I suppose I have an phobia of GPU's being broken and wasted lol
whiterunknight: Hi
nuttyodin1: Hi, who is this now
whiterunknight: He needs his supplements
cuddles2000: George has gotten so zen
def_stimulatedreceptors: @cuddles2000 he has hasn't he
def_stimulatedreceptors: I think its called perspective
nuttyodin1: karpathy "empathy"
firejjb1: this is making sense so far
whiterunknight: Looking for shiny objects
nuttyodin1: who is the gurl
Ke_0: we don't
gliched_robot: Never ask chat!
cuddles2000: Ok so I actually have found this very straightforward and I've never worked with any of these libraries before, but I've been a software engineer for many years
def_stimulatedreceptors: Let sleeping dogs lie
0tt_1: Hello
whiterunknight: Very interesting podcast episode
gliched_robot: Increasingly, software has been abstracting away things. example torch! I think tinygrad is a breath of fresh air!
codingfisch: A fastai-like frontend would help...to attract script kiddies
gliched_robot: I have an Idea, bring in karpathy to stream for 1 hour and show him step by step. Good tutorial and stream.
whiterunknight: Your cam is still big, not that im complaining, but for the tutorial
cuddles2000: Does caching occur with the kernelized operations too? Like if two different operations produce the same kernel, is that computation run once? Like t+2+3 and t+1+4
wirtuosis: wassousu subscribed at Tier 1.
smurfd0: a good thing is that you can compare the output of prints to see that you do the same
stoddlabs: is the c code generated on the fly, and that's why the function name is E4n2()...?
stoddlabs: that explanation makes sense, ty
himynameischungus: I think VIZ is much more intuitive
smurfd0: nice to know the colors and the letters :)
himynameischungus: How stable is tinygrad's API? My perception is that multi is still fairly unstable
takeuchi_satomi: Ohhhh shiiii George is Streaminnnngggg lets gooooo. I was running out of george hotz archive vids on youtube to run in the background as I work XD
gliched_robot: I think I tweeted that it's crazy how derivative algebra is just 300 lines of code.
stoddlabs: so that means you could hypothetically create your own dag with all the ops and pass it to tinygrad to execute?
banceman: maybe add # %% to make each specific section runnable?
banceman: You need to end it too, I think.
banceman: No, just starting is enough. Sorry about that.
smurfd0: isnt this like one of those, i loose the name of them. ipython ehh
majorwho: had the same problem a week ago haha
majorwho: resolved it by using a venv
bojosos: This is a venv free strema
whiterunknight: I gave up on jupyter because of this kernel shit
majorwho: we love the Python undefined.undefined.undefined
smurfd0: jupiter playbooks what i was meaning
smurfd0: https://code.visualstudio.com/docs/python/jupyter-support-py
banceman: Do you have Jupiter installed via pip?
banceman: jupyter*
krakendmp: krakendmp subscribed at Tier 1. They've subscribed for 41 months!
majorwho: so ramp is like a tutorial/introduction i suppose?
whiterunknight: Yes
majorwho: nice
ForLoopInBash: ForLoopInBash subscribed with Prime.
hellscape48: coat makes him look like Chamath
gliched_robot: tiny box helping people hit SOTA https://x.com/jsuarez5341/status/1931369293536534572?s=12
majorwho: i think yeah
majorwho: its pretty simple
bambikapelo: this looks like haskell as a python dsl
gliched_robot: Did you also write about the graph view and debugging or that is a different tutorial ?
banceman: auto detect the best device is so nice
codingfisch: The pleb wants a short frontend. Something like "trainer.fit(...)"
himynameischungus: What do you mean by "time-based" visualisation? Like a profiler?
stoddlabs: this kind of reminds me of the Spark UI
jof343: If I cant probe once in a while how i'm I suppose to know i'm not talking to a brick wall?
whiterunknight: Damm the cops are outside
runnamucker4: WutFace
runnamucker4: manja manja, enjoy!
takeuchi_satomi: baiiiii
gliched_robot: bye boys!
majorwho: Have a good meal
takeuchi_satomi: When does the tinygrad and tinybox get to the level where company number 3 AI girlfriends becomes a reality Kappa
Giully3_14: Hi George, hope you are doing well. Thanks for sharing these, a lot to learn, have a nice day!
majorwho: Thank you for doing this!
whiterunknight: Made the font large and almost used a venv
takeuchi_satomi: On a more serious note seriously huge thanks for the stream and teachings!
rivetingco: conceptually simple?
dantedante33: "to commoditize the petaflop." i like your word choice herr
gliched_robot: There is no way anyone we can maintain torch code.
lsteacke: so you're john deere?
Zeevo: you just dont like dependencies
takeuchi_satomi: Smart people make things simple :)
n00n00n: You are wrong, King Terry can
ibarres: why is WMMA not a rewrite rule
banceman: I will go through the ramp. If I have any pointers, I will talk about it in Discord
stoddlabs: what is a warp?
govert72: Nice intro, thank you. Is trying to port an existing PyTorch-based model to tinygrad a good way to learn more? Should we expect better performance some day, or what other beniefits from doing this?
bojosos: @stoddlabs You should listen to his noob gpu tutorial
stoddlabs: @bojosos will look for it, I know nothing about GPUs
whiterunknight: @stoddlabs https://modal.com/gpu-glossary/device-software/warp
stoddlabs: @whiterunknight tyty
bojosos: I still remember the days of the 1000 line rule
pratikshit08: do tiinygrad make money
codingfisch: How many lines would be needed for tinygrad if solomonoff induction would be computable? 🤓
Zeevo: @georgehotz what excites you about python's future?
rivetingco: o7
majorwho: see ya
whiterunknight: Byeee
Gameplayer0618: o7
OetziOfficial: have a good one
takeuchi_satomi: See yaaas
runnamucker4: epic strim thank you!
def_stimulatedreceptors: thanks brother
SpongyBread: Thanks George!
malateman: what food?
pupscub: Will miss you
pupscub: have a great lunch
runnamucker4: what fodo?
def_stimulatedreceptors: When's new blog?
rivetingco: i love the heart, big heart
mokert2: Hi George, I played a little bit around with torch.linalg, unfortunately so far my impression is that it is not in good shape
def_stimulatedreceptors: no just new blog
majorwho: lex?
pratikshit08: what do think about software nowadays
robin_2723: are you gonna rub your belly after the lunch
21benzen: maybe we can upgrade you someday to a leather jacket
jjccccccj: has dwarkesh invited you?
bojosos: tiny.linalg?
FatherOfFamilyValues: ❤️
def_stimulatedreceptors: ResidentSleeper
runnamucker4: feel like i need that as a slogan on a tshirt, merch incoming soon?
waena_: At what age did you stop being a consumer?
pupscub: Don't consume it use it to build!
itsamarcos: we're heading towards a two-class society
itsamarcos: whatever incentives created youtube shorts and tiktok are not going away
ibarres: best asmr
def_stimulatedreceptors: just don't be a drone, have some spark
dantedante33: we need to clip that.
runnamucker4: vswedHi
whiterunknight: signed
Up in your car.
It used to replace the rear view mirror but
the government told us that was illegal,
so we don't do that anymore.
OK.
It's like a GoPro mount.
What's in it?
What's in it? Magic.
Magic in a box.
Is it a raspberry pi in it?
No, no, no, way way more powerful than a raspberry
pi.
This is seriously powerful computer in here.
Nice!
Then you connect this wire up to your car
and it can control the steering wheel,
the gas and the breaks and...
You put this in your car and it turns your
car...
It's like Tesla autopilot... so if you are
on the highway you can drive for hours without
having to touch anything.
Yaay...
[Music]
good morning good morning good morning
good
morning all right a very rare Thursday
stream um I made an offer to
uh to to
uh
um
look good we'll we'll do a real we'll do
a real uh we'll do a real intro very
rare uh Thursday stream so look I wrote
this blog
post
um you know
uh are
are I wrote this blog post um let's see
10 months ago thank
you
uh
like you know I I like being like really
uh honest and some of this stuff in here
just was
wrong um I I don't think we can get AMD
on ML perf like we could but it's not
the generic flexible work uh I thought
it would be so my my strategy was
basically
um
I I still like I I like this blog post I
got quite a bit of praise for this blog
post
um if you were to tape out your own chip
you'd be struggling with both Hardware
bugs and software bugs and would be uh
sure which one it is here you have a
good idea and have the AMD provided
driver as an open source
reference um I didn't understand and
again this is this is my fault you could
be like George you're an idiot you
should have known this and like okay you
know what I saw some guy on Hacker News
say I'm an optimist and for the most
part I am an optimist so the the problem
is what's open source is called the AMD
GPU driver and we're going to we're
going to dive into this a lot today um
unfortunately the AMD GPU driver uh is
not where the bugs are in amd's stuff um
I had assumed first off that there
weren't bugs in Hardware uh I'm not 100%
sure about that of course there can be
bugs in
Hardware um but what did I want to bring
up here
here uh okay so let's
uh let's start by cloning the
colonel um we can go there's a branch I
link to it from another blog post so for
those of you new here I started a
company uh almost a year ago and our
goal was our goal eventually is to build
chips our goal eventually is to build uh
AI accelerator
chips
but if you just start building chips
you're going to run into a real problem
pytorch and Friends pytorch
tensorflow uh Jacks to less of an extent
but really like pytorch and tensorflow
are designed pytorch is designed around
gpus uh tensor flow is designed around
tpus uh at inside Google tensorflow
works so what you start to realize is
you're not going to be able to build a
chip unless you build a framework and
you know we like T torant on the stream
but this still applies to to T torant
like it's cool as a piece of Hardware
but buying zon 5 cards was cool as a
piece of Hardware unless you've built
your own framework your chip is not
going to
succeed um and like T torr is trying to
integrate with pytorch I said that was
that was what I think is the biggest
mistake they're making uh they have a
new paradigm of compute and with a new
paradigm of compute you need a new
framework uh so I think the only way to
start with an AI chip company is to
start with the software uh the comput in
ml is not general purpose Computing we
can do a lot in framework and that's
what tiny grad is and we're still hard
at work on Tiny grad
um
so I thought that we would bootstrap on
AMD I thought that we would use AMD
chips we spent a lot of time building
these AMD
computers um I took pre-orders for them
George why did you take pre-orders
before you qualified the product you're
a piece of
shit the pre-orders are $100 and fully
refundable uh you know I never even said
AMD on the website but like I'm not
making excuses like this this didn't
work out the way that I thought it was
going to work out uh
obviously um you know I didn't take
anyone's money George you scam people
with chii you'll find someone who was
scammed right like like George switches
jobs every every six months I I've had
I've had two jobs for the last seven
years one at a company I started for six
years that's now profitable and wanted a
company that you know it's a year old
startup it's a struggle all right so you
know just just I'm all for haters but
you know please please uh improve your
hate uh please please please all I ask
for is factually accurate hate uh
so why do you take pre-orders well you
know to see to see if there's interest
now you're in fine right um I we raised
$5 million I'm happy to uh of course
refund anyone's pre-order um I will even
even if the company goes bankrupt George
the company is going to go bankrupt your
tiny guys never going to ship a prod we
have $4.6 million in the bank account
and we have more assets than Capital
that we raised I could sell the assets
on eBay and make that's not even the
point right now am I defending myself
against
strawman I'm I'm going to talk about
where I where I messed up right you know
what I I I just I just like like we live
in clown War I saw a video yesterday
where uh this woman tries to kick
squatters out of her house and she's
arrested and I I feel like that's the
same like clown world we live in here
you are really not understanding who the
scammers
are
um you know I
just uh are we centralizing the P flop
no no no we're not centralizing the pay
a flop but I want to talk about the
mistake I made um so that nobody repeats
this mistake so why does no one use AMD
uh the software is terrible there's
kernel panics in the driver you have to
use a newer kernel than yuntu I'm not
sure the driver puts supporting two cars
in right so I had assumed that the
driver was basically just two pieces I
had assumed the driver was the kernel
space and user space tidy grad has
remove removed the user space entirely
we now have
a a a competitive AMD stack using
absolutely zero of their user space and
I verified this last
night um you can see here my don't
include hip common we've ripped out all
of amd's user space the only two things
that are left are HSA rockar which is a
very tiny minimum HSA runtime that we
could replace like we could replace HSA
runtime with an engineer week or two of
work work and then co-manager is their
compiler um again could we replace the
compiler sure we already have a PTX
backend we could write an R A3 back end
that's probably something more like two
or three engineer months of work but
these are the only two components we're
using from amd's user space and I
confirmed that right now I set this
computer up last night and don't worry
this is a real stream we're going to do
things I set this computer up last night
uh with
650 konel you don't even need to install
you can use trunk AMD GPU install these
two dependencies and then tiny gr HSA
works so we've ripped out the entire
user space we succeeded at
that where I messed up was I didn't
understand and like
again I'm just I'm I'm I'm it's stupid
it's stupid it's I I I'm going to show
it to you I'm going to I'm going to show
you exactly what I didn't
understand um and I guess you know I
should have thought about it more and
mostly I'm just I'm I'm upset with
myself uh
so this is uh AMD staging DRM
next this is where by the way I don't
think we're going to get anyone notice
how the T torn people came in this
stream we're not going to get anyone
from AMD in the Stream and if we do
they're going to give me business
platitudes I'm also upset with myself
that because I get added by Lisa Sue on
Twitter I think I have some access to to
AMD all AMD did for us was basically
like I was just their unpaid QA team I
was their unpaid QA team for for uh for
nine months and look I'm not saying oh
I'm a victim I'm not saying any of that
right like I made mistakes and I am here
this is my apology video this is my
apology video to you for over promising
and underperforming which you know I I
really hate doing and however mad you
might be at me trust me I'm way more mad
at
myself we use the stream to process
emotions so let's let's CL
this um so this is AMD staging DRM next
and we're going to start taking a look
at the uh at the driver uh the driver is
actually in trunk which is
cool uh but even though the driver's in
trunk it turns out that what I didn't
understand was the bugs are not in the
driver um I had assumed that the bugs
were not in the hardware to be honest
I'm not even sure the bugs may very well
be in the hardware um I don't think so
but at this point I can't rule it out
because the bugs are not in the kernel
driver so while this is cloning I'll
show you in tiny grad um uh niml genen
in our Discord wrote a uh an HSA driver
so HSA is a layer below hip and HSA
basically directly talks with the GPU uh
it doesn't even talk to the kernel dri
so so gpus the way that they work is
they have uh they have command cues and
and these command cues are parsed by
what I thought was basically GPU
Hardware um there's nothing in the
kernel so you you have something called
an aqlq this is like a these packets
this kernel dispatch packet is basically
like like a cnq kernel or a kudal launch
kernel call and uh then you you know you
set the size uh you set the
program uh you know you set a bunch of a
bunch of flags on the packet it's great
okay you set the arguments for the for
the kernel um
so uh let's open
up no that's not the right
computer no but like you know guys I'm
just I'm just I'm angry I'm I'm upset
with myself for letting this go on for
as long as I did for not understanding
stuff um um you know I don't like I
really don't like being
wrong all right uh that's probably fine
we'll open the whole Linux tree look be
kind of fast yeah I trust the author's
Linux CR sure okay so let's go in here
to
drivers uh GPU DRM H actually you know
what no I do want to open the actual cuz
otherwise search is going to be annoying
I could probably restrict the
search you know what's the Eminem line
I'm harder on myself than you could ever
be regardless I'm I'm I'm really I'm mad
at myself I messed
up um I'll show you I'll show you I'll
show you what I messed up and it's it's
just it's sad it's really sad uh okay so
so it turns out that the kernel driver
doesn't contain any of the stuff that
parses these cues it turns out the
kernel driver doesn't actually talk to
the hardware of the GPU now I knew this
was true about amd's driver Intel in
nvidia's driver it's hard for me to keep
these straight Nvidia has this thing
called the GSP and the GSP runs on a
risk 5 processor inside the uh Nvidia
GPU
uh they basically when Nvidia open
sourced their driver they didn't
actually open source shit they just
compiled their driver and got the driver
to run on the GPU and then open source
some like communication layer that uh
that sits on top of it and that's what
the AMD open source driver is
um
so it turns out that AMD is like this
too AMD has a crap ton of complexity in
the kernel but then they have a crap ton
on more
complexity in the uh in the in the
device so there's this thing called the
mees and I thought that these things
were in the mees but no no no no no it
goes way deeper than the mees so maybe
we can find
llvm uh
AMD GPU launching a kernel and this is
even before the uh the mees was a
thing okay here we go so this is
actually talk about little bit
um
so uh Mees stands for microengine
scheduler the driver is basically just
communicating with opaque uh firmware
blobs uh that are that are
uh running in the GPU so it uploads some
firmware to some processors in the GPU
and we're going to go into what the
affirm actually is on this stream
honestly I don't really know I haven't
really looked into it uh I don't know I
I'm upset with myself I I got fooled
that like like AMD is like oh we're
going to fix the bug we're going to fix
the bug um I'll show you the document
that made me sure that AMD is never
going to fix these
bugs uh I'm sorry for not structuring my
stream
better um but yeah so uh these things
this is this Mees is not a harbor object
uh this Mees is just signed hidden
closed Source software running inside
the GPU um this is what the old version
of Kernel dispatch looked like before
the mees I'm not really sure how it uh
works but there's this thing called the
CP that's the command processor the
command processor executes micro code
and is responsible for detecting and
setting up the GPU to execute wave
fronts of Kernel
dispatch um CP ensures that when a
wavefront starts executing the kernel
code uh the scaler General blah blah
blah blah blah blah blah blah blah my
point is what the hell is the
CP right the the CP is not Hardware the
CP is hidden Clos Source software
running on the GPU this driver is just a
wrapper around that like again coming
back to we ripped out all of amd's user
space all of amd's hyper complex hip
which tiny grad doesn't need it anymore
tiny gr doesn't need any more of that
and it's 6,500 lines
and I can rip out this with 50 lines and
I could rip out this with uh a couple
hundred lines right we got rid of the
entire complex user space but it turns
out there's nothing in the kernel driver
either the kernel driver is it's it's
it's it's nothing it just passes things
through it's the same as nvidia's open
source kernel driver there's just Clos
Source firmware blobs that run on the
GPU now maybe these firmware blobs are
very simple well could someone link
could someone go on my Twitter and Link
the uh go on Tiny grad's Twitter and
Link the PDF of the change log for rock
m z uh
63 also I'm not trying to be mean here
like I'm really not I'm not trying to
like say that you know these are bad
people or anything like that right I'm
sure no one wants to be in this
situation but again you know I I I I
said that I was going to get AMD on ML
perf um this is just probably not going
to happen uh I I can't go to Twitter can
you link the actual
PDF no AMD did not announce they're open
sourcing the blobs and I actually I
realized that they did tell me they were
going to open source something but I
realized I was getting scammed and I was
getting scammed for two
reasons is the stack better on Instinct
well we can talk about Instinct and we
can talk about why it may be a tiny bit
better but uh overall I doubt
it can someone link the
PDF no we don't have Twitter on my
computer no no no no no link the PDF to
the to the change
log all right we'll unblock we'll
unblock Twitter we'll unblock Twitter
you know I just I'm done with Twitter
too
like it's just just a lot of
it's a lot of talking you
know thank you thank you okay so this is
the this is the change log
okay again I'm not trying to be mean
here I'm just trying to explain to you
why I believe that AMD firmware will
never get better unless something
radically changes inside that
organization and another thing I've
realized another thing that just like
upsets me
you want to read a comment let's read a
comment I I read this comment and I I
liked it because it wasn't total
uh I read your comments by the way so
you know say mean things I I love it
um
here
so uh this is not really scale that
applies to people people like Hots are
fascinating there's a lot of
similarities between him and musk and
the question of how could a person you
you don't really want to hear about me
the the only thing that like I I I want
to like emphasize by this is companies
do not work how elon's companies
work companies
are they're they don't make good things
they don't want things to like it's not
that they the people who succeed in
companies are not the ones who care
and I I I
just it's just it's just a sad fact
about the
world like here one could make an art
here this is the paragraph that that
that I want to emphasize right it's not
really about me one could make an
argument that when looking at successful
tech companies that wanted a sector like
apple with consumer electronics Amazon
with online shopping none of them did it
like Comm or tiny grad I personally want
nothing more for Hotes companies to
succeed which would truly be disruption
at its core but I don't think they will
it seems like you have to essentially
engage with all people as humans and
appeal to them but when you view human
when you view Humanity from a Viewpoint
of he mixed it up here from each
according to his needs to each according
to his ability which is what capitalism
should be and tweet about it it's pretty
clear that you dislike a large portion
of
humanity I don't think it's a large
portion I don't think it's the majority
but there is certainly a group of human
that I strongly dislike and of course
engaging with people like that means you
have to appeal to the professional
managerial class which goes strictly
against his
ideology um I mean that's I love
comments like this right that's that's
that's a comment that really hits and I
I think it explains also why the AMD
firmware is is not going to get better
um now let's talk about his concrete
suggestion and I can talk about why
again I um he he also talks about
uh the thing is for a smart person who
has a personality like that you can take
a narrative that fits within the
ideology they're almost guaranteed to
believe it whether it's actually true or
not because them denying it would mean
their ideology isn't correct which would
mean their entire life has been wasted
on wrong things and no person would ever
self-destruct like that I would I would
I mean if I genuinely came to believe
that the things that I believe are wrong
I will
correct it and this this this AMD thing
has again it has taught me lessons that
I was too slow to learn before um and
there's there's not you know there's not
an excuse for
that um I'm okay with you know saying
things were wasted I'm okay with saying
I didn't understand how things work but
let's also be careful to not just you
know change right away let's truly ask
is this
correct
for comma AI that would look like
playing nice with investors getting more
money hiring a wide range of talent
local and remote which would put them on
a stage where car companies take them
seriously and want to work with them at
which point dedicating resources to
making Hardware they can actually be
making the software a shitload better
which is the core to their mission of
solving Ai and yes they'd have to be a
bullshit they would have to sift through
that's just an unavoidable fact of life
let's concretely talk about that
statement right and reading this makes
me think that this actually isn't
correct
um frequently frequently uh you know I'm
I'm I'm I'm pushing the CTO of comma
that I want to scale up the models I
want to spend more money I want to buy
more computers and I want to train
larger models and he pushes back on me
and he's like George
look like we can do that but it's not
going to fundamentally
make uh things
better like
we have problems that we need to solve
just throwing money at this is not going
to make the problem better and I'll
point out to this commenter that comma
AI still exists is profitable and
actually right now with the sale we're
crushing it we're starting to hit a
million dollars a month in sales we had
over a million dollars in sales last
month like compare that to most other
self-driving startups most other
self-driving startups just
failed most their self-driving startups
burn through way more money I saw a guy
on Hacker News saying that George did
nothing but burn through VC doll and I
almost think that he must be mistaking
me from some for someone else right so
also I mean this guy seems to have some
sticky thing about remote work uh the
the only reason tiny grad kind of can
work remotely is because it's a software
company not a hardware company um also
dedicating resources to making Hardware
they can actually be making the software
a shitload
better we have two people on the
hardware and we have everybody on the
software like it's not like there's
anybody on the hardware so when I read
things like this it does make me think
that I am fundamentally correct about
these things but I'm very careful to
like if my entire life's been wasted on
wrong things I accept that and I will
change you have to be you you have to be
willing to to to do that because you
know what am I saying is like I I really
like being right but not at the expense
of being wrong um and yeah I I was wrong
and like could we get AMD on MLP yes
would we end up doing a lot of
mitigations and workaround work that
have nothing to do with tiny grad's core
Mission yes um with the firmware with
access to the firmware I would at least
feel like we are uh you know making
progress towards something not well this
okay so let's get back let's get back in
into this um so this is how you dispatch
a kernel on an AMD GPU you use the
architected queing language which uh you
know again you can see the
implementation here uh in tiny grad it's
in runtime driver HSA uh here's our
here's our aqlq implementation you can
submit these packets copy the packets
whatever you wait for the queue normal
normal like GPU command Q stuff you got
experience with this okay so uh this
stuff is all in user
space but then you get to this stuff and
this stuff exists inside the CP okay so
when you submit your que the queue does
not actually go to the hardware it goes
to this hidden secret blob called the CP
I don't really know where the CP is and
you know look my my title is a little
bit clickbait but uh you know maybe we
can actually do it um so this is the
change that that that uh made me realize
that this firmware is never ever ever
going to get better unless some stuff
radically changes okay the AMD GPU has a
unit called the command processor in
charge of driving work based on the
information provided by the
driver okay I
mean like first off that's
like that's technically wrong right and
it's interesting that so much is given
away in like subtleties of language so
well first off like who's driving work
right like like when I think of someone
driving the work it's like someone like
you know like like like like smuggling
you know pounds of weed from from from
California to Utah right they were
driving the work right we got the
cocaine and the trunk and the spare tire
right no
look
um uh information provided by the driver
so like I just like like like like even
you can kind of tell from that phrase
you can tell from that phrase that like
you just wouldn't say that
right um the it runs cues handed by the
runtime right the the the runtime the
the HSA runtime uh submits qes or the
hip runtime really submits the cues HSA
kind of lets you construct the cues
yourself um okay for compute workloads
there's a handshake between the CP and
the underlining Hardware underlining
Hardware uh when dispatching new kernels
and waves to ensure the required
resources are available um those
dispatches can be committed in order or
out of order in older Hardware the outer
order setting conflicted with fast
contact switching and was
disabled uh the setting was inherited by
new hardware even though more recent
designs do allow the OU order setting to
work properly uh during dispatch it's
also possible to pre-allocate resources
associated with certain waves the
combination of an unbounded
pre-allocation with inorder dispatches
enabled could result in a deadlock due
to a lack of resources over time
depending on a use case okay
so if you have a statement like that the
next thing I expect to see is root
causing right you want to root cause
why why does an in order dispatch result
in a deadlock due to a lack of resources
right Deadlocks don't occur due to a
lack of
resources there's no there's no such
thing as as as a deadlock due to lack of
resources right a deadlock is let's say
let's say um let's say you have two
kernels right and you have 10 resources
and one kernel needs seven resources and
the other Colonel needs nine resources
right and they've acquired these
resources in a loop computer science 101
uh let's say each of them have five
right so now all 10 resources are
allocated five to each but neither of
them can make progress right so you know
one of them needs seven one of them
needs nine so neither of them can make
progress so you have a deadlock okay
that's how you get a deadlock uh due to
a lack of resources but of course the
problem is is not actually due to a lack
of resources what you need is the one
that needs nine to give up at least two
of them so the one that needs seven can
make progress right this is this is a
like classic problem in scheduling and
it's fixable using classical
techniques they did not fix
it changing to outof order dispatches on
newer Hardware can prevent Deadlocks
from occurring while still allowing fast
contact
switching we did not figure out why the
in order Deadlocks we switched to out of
order and no longer observe the
deadlock I'm just like I was briefly a
TA for operating systems at CMU and if I
saw this kind of shit on an
exam you I allowed to fail people in
college anymore and again I'm not saying
this to make fun of anybody I'm saying
this
to explain what I read to tell you why
this firm went is never ever going to
get
better unless it's open source right
maybe if it's open source now you know I
again I still can't make any promises if
the firmware is open source this may be
due to the the hardware just being
broken but like the solution to inorder
dispatches resulting in a deadlock
should be fixing that bug not changing
to outof order dispatches
right
okay
again these people know a lot more about
this GPU than I do maybe there's
something I'm not understanding here
maybe out of order dispatches do fix it
it's just not explained well okay so
let's let's take another sample let's
read the the the firmware change in the
mees okay the micro engine scheduler and
you know what again also like props to
AMD for releasing this right props to
AMD for releasing this and I really
don't want their takeaway to be well
shit we should never have released any
change logs because they're going be
interpreted like this the the the
solution to criticism is not opaqueness
the solution to criticism is fixing the
issues I'm not saying this is unfixable
I'm saying that like something is wrong
here okay let's read let's read this one
let's read this one okay the micro
engine schedule is a hardware engine
used by blah blah blah blah the micro
engine interacts with the kernel driver
via a ring buffer oh this is actually a
lot more correct right this is a lot
more correct than the C
it interacts with the kernel driver via
a ring buffer to schedule user cues to
the hardware cues of each engine we can
actually there's a cool thing called mes
API uh and it actually explains how this
stuff works okay so this is this is the
mes API you can add qes you can suspend
them you can resume them pretty cool so
you can make use the mes great so that's
that's actually correct okay Mees
process which again the mees process is
secret Clos Source firmware running God
knows where on the GPU gets corrupted
when the driver reuses the process
context memory after calling this to
enable Shader debugger but not adding
any cues okay so it calls this function
to enable the debugger but then doesn't
add any qes since qes are not added to
the process the debugger process will
not be removed from the process linked
list and when the driver reuses the
memory and overwrites the field the
linked list will become corrupted okay
great so that's totally
reasonable it I mean again that's it's a
normal bug right so so we have this we
have this
uh we have this
this call to to enable the Shader
debugger uh but when you forget to add
cues it doesn't get uh removed from the
process link list okay normal
bug the solution is to add a new flag to
the mases API for driver to set to
remove the Shader debugger process this
flag should only be used if cues were
not added to the
process oh
God I you know what I don't know how
many people are watching right now and I
I don't know how many people like have
enough of an appreciation for software
development to understand how horrifying
that
is okay so now you have a flag if you
added cues do not set the flag if you
did not add cues you must set the
flag
God what happens if you add q's and set
the flag what happens if you
like why is this a
flag a am I missing
something or is this why AMD drivers
have been shit for 25 years and are not
going to get any better again I can't
fix any of this I'm happy to
but I can't I don't have the mees I
don't have the
CP right this should be an if statement
in the de
allocator this should not be a
flag yeah why don't they just detect if
they're accused directly what's this
weird shit cmax MD knows what's up now
I'm wondering how many workaround flags
they have exactly what you should be
wondering right does everyone understand
why like this is what I saw to make me
know this will never get
better we're going to have to unblock
Twitter can someone link my TW my offer
to
AMD not logged into
Twitter I don't understand oh you don't
understand why the flag is this bad well
go back to you know
yeah okay oh let's introduce a new
micros service to check for Flags yeah
yeah right okay so uh here's my offer to
to to
AMD uh no need to hire me just open
Source the firmware in docs and remove
the signature check we'll treat it like
bring up for our own ship right like
I've Rewritten your entire user space
not me but tiny Corp has Rewritten your
entire user space right I'm happy to
rewrite your entire kernel and firmware
space
too right proof that you can go right
now in tiny grad and you can install
just these two dependencies and run
llama and run everything with those two
dependencies we've bypassed has amd's
entire user space stack I'm happy to do
the same for their kernel stack and
their firmware stack but I need access
to it so that's my offer right your AMD
I I
don't I don't understand why you don't
take me up on that right you know what
it is you know what you know why you
don't take me up on that because you're
downside risk uh when you're in a large
company the only thing that can motivate
you is fear um I don't understand how
there is isn't enough fear uh struck
into this company by AMD like but it
it's I don't even think it like works
that way right I don't even think it
works that way none of these people feel
like there's an existential risk
like like and it got worse you know the
more the more aggressive I've been the
more platitudes I started getting the
more like General business jargon
bullshit I started getting right because
honestly I don't think they're worried
about the driver being shit I think
they're worried about this kind of PR
right I don't think they're worried
about the firmware I don't think they're
worried about the flags that doesn't
seem to be their priority their priority
seems to be oh well you know we don't
want George shitting on us on Twitter
right we'll make your software good you
know Andy driver ramp part two and like
why again again I don't blame AMD I
blame myself I blame
myself it's it's yeah it's like an
abusive relationship you know
[Music]
uh
just
yeah um
yeah oh I I bet I don't know again I
have no insight into the firmware
development process but it seems like
the kind of thing where there's no
Version Control and tarballs and you
know questionable regression tests
like all right well I mean that's that's
the rant no it say a time for the
[Music]
coding this is the price of being an
optimist I always think
yeah
uh maybe change can come but it need all
right well let's engage with chat for
five minutes and then let's find some
exploits in the firmware CU maybe AMD is
just worried that they can't open source
it because they're worried that someone
might find exploits and we can show them
that you don't need to have open source
code to have people find
exploits
uh God they're not Sony 2.0 look they're
knowing you're as bad as Sony Sony sued
me and that's unforgivable do you
understand suing somebody is threatening
them is using the government to threaten
them with violence
um I'm led by my emotions right now
again I don't know what do you mean by
that right
like you need some emotional impetus to
accept that thousand hours of work and
$100,000 just needs to be just needs to
be sunk right like it's hard to it's
hard to not be emotional about that
right it's hard to to not be emotional
when you worked for a year basically on
something and look 95% of tiny gr has
nothing to do with any of this tiny grad
will continue this this will be a a bad
memory in the rearview mirror like the
comma one you know it just seems like a
year into comma was the same
shit uh like guess what we're selling
common 3x's now you know we're selling a
thousand of them a month like shit's
pretty good man just just just took
years um you
know but no we can't get AMD on ml per
unless like here's my offer
right and I'm not going to I'm not
taking like a like a like a promise that
something will be done in 3 months right
like
no
no not HDMI that's not the
problem you don't understand their move
to remove web GPU backend uh a web GPU
backend is not like again it's something
that we had had to maintain it had a
bunch of weird quirks about it and it's
not really the target of tiny
grad
um can you read out the firmware and
reverse engineer it again like how much
do we want to reward this Behavior
right what would be the Target now with
Nvidia GPS it's the same Target it just
it doesn't look sexy anymore when it's
like we're going to get Nvidia we're
going to get tiny grad on on M uper
right like it just it's just the
narrative is not good but the narrative
just doesn't
matter running a tiny gr example made my
AMD GPU reset with a black screen
yeah so what about Instinct okay so we
can talk about Instinct so uh we have
the we have the driver up here um
so again here's some Alpha for AMD
investors okay so um here are Nvidia
Generations
right
uh no those aren't
good all right so Nvidia basically has
uh a bunch of generations okay so they
have
tur um they have ampere uh so ampere was
uh ampere was I'm going to do this from
memory we'll see it's right ampere was
309s and A1 100s so they shared this
ampere generation the AMD server gpus
sorry the Intel data center gpus are
about half a generation ahead of the
consumer
gpus uh so I believe that that uh yeah
ampere was the 3090 and a100 uh then
they diverge for the 4090 Series so the
4090 is Ada and the h100 is hopper
Hopper is a little bit ahead of ADA it's
looking like they are going to
reconverge on Blackwell so Blackwell is
both the the one that was just announced
at GTC and Blackwell is also the uh
going to be the consumer 5090 if they
make it 5090
um so AMD has managed to stay ahead
generationally with their server Parts
uh AMD has not so you look if you look
in this firmware uh in this driver uh
you'll see a bunch of things called uh
gfx so gfx is is the graphics core and
the 7900 XTX is is gfx by the way oh
don't you like these module firmwares
well that's what we're going to be
looking in a minute
um so yeah the the gfx1 is the uh 7900
xdx the
Mi Instinct series was forked at gfx 9
and that's why you have these I'm pretty
sure this is right this is why you have
these weird like gfx 942 gfx
943 I'm not 100% on this but I would
guess that this gfx
943 is is the Mi uh 300 um so AMD had
rdna uh then they made rdna 2 gfx 10 and
RD 3
gfx1 but cdna is still back here cdna
was forked at our DNA and they've just
kind of put hacks on it probably again
complete speculation but probably
because it's the only place the Firma
was uh was stable the mees was added
after that like and then they just
like this document shows if Mi instincts
work at all how they made them work like
yes you you can you can you can build a
house by just repeatedly slapping boards
in places everywhere water comes in but
wouldn't it be nice to just
like make one nice solid roof and just
be like wow that's a nice roof instead
of just oh shit there's a leak oh shit
oh they reported a leak to us let's go
let's go nail some boards in right I
don't know man what if we what if we
switch their deflector polarity right
like
uh and and is basically they're not
let's let's let's be careful before we
call Nvidia a monopoly apple is a
monopoly apple is a monopoly and I hope
they get crushed in their in their case
Apple locking the iPhone to basically
only use Safari only use the app store
uh not letting you um integrate your own
payment
stuff uh yeah so Apple's a monopoly
nvidia's not Apple locks you in and
ships the same shit iPhone every year
right like the iPhone hasn't improved in
a long time how how much better is an
iPhone 15 versus an iPhone 11 it doesn't
matter um but people are locked into the
iPhone because of the Monopoly and when
you have a monopoly lock in like that
people will still you know upgrade on a
Cadence just because they're kind of
locked in Nvidia is not like that uh the
the new Blackwell chip if it's really
priced at
$30,000 I think it almost May no longer
make sense to to build clusters of
consumer gpus I don't think that will be
the price uh but if the if the Blackwell
b200 is truly priced at 30k uh it's an
amazing chip and you know props to props
to Nvidia for
that uh so it's not a monopoly right
also we built the one tiny box has has
four 4 6 490s in it and I think the Tiny
Box we're going to end up selling is
just going to be
490s I'm sorry I'm sorry it's
not oh you think b200 is way more no
h100 are not 40K you get them cheaper
than that uh yeah if b200 turns out to
be way more
then well I mean they can charge 100K so
I think the estimate to make an h100 is
3K and the estimate to make a b200 is
6k like they have so much margin to play
with so I do think that we are going to
be stuck in Nvidia for a long time
however if Nvidia does price Gap for the
b200 people are going to more seriously
consider AMD I wouldn't uh like not
until they seriously fix this stuff
right I don't like look look lamini got
him working from what I heard the lamini
CTO is very good and did tons of
workarounds um you can probably make
mi30 work for like a single Transformer
training workload a lot of these like Q
things it's like if you're willing to
waste thousands of engineer hours on
mitigations it's probably fine but the
idea of tiny grad is every piece of the
stack is going to be good and
correct um are their profit margins just
huge or does R&D cost a lot I mean R&D
costs a lot
yeah
uh no I mean also there's no rdna
4 the AMD guy in Discord was like saying
like oh you know we want to we want to
fix this for the future we want to fix
this for the long term I'm like there is
no long term like there was like a
narrow window here kind of to make this
work um I'm also like how long it took
me to ship the Tiny Box like it turns
out it's way harder than you think it is
all these people who are like I'm going
to build my own like I mean go try it go
try it in a year if you spend a year on
it you might do it right like or I mean
look here two two hypothesis one you're
smarter and more motivated than me and
you'll get it done faster two you have a
lower bar for how good it has to be and
you'll get it done faster but otherwise
like how are you going to get it done
faster it takes it takes a year to build
these things that are pretty
good
um no I don't think Dojo chips I think
the problem with Dojo chips is the same
problem that plagues every AI
accelerator company I think that like T
torrent has the right idea it's still
going be such a long journey uh and they
should stop with their pytorch
integration and start thinking about
okay how do we actually build to T
torrent software
stack um gudi is interesting I mean we
can
look this this ml perf is really good
for uh for judging who's who's
legit um and we can see who's on here
here
[Music]
so uh
Nvidia
TPU lots of Nvidia oh Nan Nan's doing
pretty well um Intel gy too so there are
Intel gouty 2os training Bert resnet
gpt3 stable
diffusion I mean that's kind of that's
kind of a good Mark for uh for for Intel
uh but I think yeah the only other one
on here besides uh
Nvidia and
Google
yeah um no
AMD no T to
Warrant like it means if you're not on
here it means your accelerator
definitely doesn't work right this this
right here is absolute proof that you
should not buy an MI
300X if if AMD can't get their thing on
ML perf like why not
does your pie torch Port work I mean if
your pie torch Port works it should just
kind of work
right um
yeah I don't know and yeah I was you
know I was optimistic I was optimistic
and
uh removal of turn completeness is still
very much in tiny grad I mean so okay
what are the steps from here I mean the
steps are here here like it's not sexy
but we're just going to do we're going
to do
Nvidia MD is making awesome CPUs yeah
you know you know who made that CPU
um
uh Jim Keller returned to AMD where his
primary task was to lead development of
a new x86 64 and arm micro architecture
called Zen and K12 guess what Zen
became ryzen and
epic in other words amd's good CPU is
really all thanks to Jim
Keller
um he made the Tesla chip this is how
you know Intel
fucked and this is why you uh you have
hope forend to and then of course
there's Atomic semi which is very
exciting you can you can look into them
um but
yeah uh yeah so so you want to talk
about who built that good CPU for for
for uh for
AMD um and and look and and look at how
tense to is you know
I was talking with Alex this morning and
like I mean AMD is never actually going
to do this like it's kind of a troll
like it's kind of a there is no way that
like anyone at AMD has the balls to do
this and this is this is what makes the
like Elon companies so
successful you know my time of Twitter
was brief but man you know just just
increases my respect overall like even
if there's differences of like you know
opinion on some stuff
man just just the man can
execute uh no I wouldn't do an unpaid
internship at AMD I wouldn't I wouldn't
I don't want to participate in in in the
culture that created that I don't want
to participate in the culture that
created that change log
[Music]
uh by the way if we go with if we go
with Intel for the Tiny Box we're not
going to put in six we're going to put
in
12 uh I know the card is nice
right uh oh no no no no no Gro grock is
a total grock is a total scam I I told
if anyone I put this Challenge on Tiny
gr's Twitter if anyone's willing to send
me one $250,000 machine I will replicate
grock's demo on it if you let me keep
the machine grock's fastest claim is
just because nobody gives $250,000 worth
of shits right that's how literally
worthless that claim
is or take me up on it is it Gro 20K one
Gro according to semi analysis it took
GRS in order to run that mix model and
actually I heard it was more like
700 no they didn't want me to keep the
machine they didn't read the shit they
didn't read it um Nvidia responded with
their usual clown Nvidia stuff right
like look guess what when you are the
king you've earned the right to be a
clown right when when you're a king
you've earned the right to be a to be a
clown
um what is the mission of tiny grad to
commoditize the P flop and confidence in
qualcom actually sort of I mean look
Qualcomm Qualcomm needs to fire their
entire sales Division and they have a
good Fighting Chance right like the
problem at Qualcomm is simple the
problem at Qualcomm um so people are
saying people were responding to my AMD
stuff with like someone should do like a
like a leverage buyout of AMD and get
them to open source their shit that's
not going to fix AMD right this is this
is a systemic problem that's actually
like really hard to solve right
like I don't know how you f it's just
hard it's just hard and that's why like
I have in some ways I have a lot more
sympathy for AMD qualcomm's problem
could be solved the minute I become
chairman of the board right fire the
entire sales department replace the
sales department with a
computer I'm going to replace the Sal it
doesn't me to be a computer I'm going to
replace qualcomm's entire sales
department with a sheet of fucking paper
that says here's how much the chip costs
and here's your price breaks in
different quantities right I'm going to
take the average of what every customer
paid boom done I just caught tons of
bloat uh I I so many startups will start
building with Qualcomm
shit uh I can fix qualcom
overnight um
no so so I mean in some ways that
actually though gives me more hope for
Qualcomm than AMD because like
qualcomm's problem is
fixable with the stroke of a pen amd's
problem like look they're not actually
going to do this
right if if AMD actually turns around
and does this I give them a 1% chance
right like like it's it's
not well we're going to have to put that
through legal review we have to think of
downside risk
is it just Pride stopping AMD from
letting them hire you to fix their
firmware I'm not sure I would take that
deal right I also think that like you
know you look at me like you don't want
to do you want to do you want to like
work with me probably not right like I'm
I'm self-aware about this right I'm
pretty
abrasive like like I'm just gonna I
don't think I'd take that
job right
like I would do it as a contract but I
would actually do is a free contract if
you just gave the world access
right I'm not going to say more about
what I saw on elon's execution of
Twitter but I'm just going to say that
like the the man is
truly
like he he he's truly a once in a
generation genius who can actually like
get these things done I I I'm you know
whether you agree with him or you don't
agree with him where where he takes yeah
but um
no don't it's not you can't I don't
think Lisa Su can fix this like I I
don't think
that oh oh Intel uh wait which one the
uh who is smarter me or Elon
I mean elon's just way more successful
than me and and always will be for
various reasons right like I I talk
about this
um
what's
JH oh the risk one yeah it's
underpowered it's underpowered I mean
really one of the most interesting chips
like if I was building if I was building
a product today I would use this chip um
we're stuck into Qualcomm don't worry
don't worry don't worry
comma I'm not going to say what we did
I'll I'll say it I'll say it afterwards
but
like when when when someone looks back
on on what we ended up doing about the
Qualcomm situation people are going to
be like damn damn they actually did that
and yeah we did that
um
all
right I'm just saying we've solved the
Qualcomm issue at least for
now did I get the 500k back or 500k no I
I bought 500k worth of qualcom chips
from
qualcom
um
uh it's just this is the chip I I would
I would base things
around I didn't break into the office I
didn't do anything IL legal
guys
um Ka I'm so happy Ka ka's actually
doing really well right now uh we're
we're we're printing money hand over
fist um did I talk with Lisa Sue in
private just email I know talking with
there any updates on the folding phone
wait I love my oh oh the OnePlus folding
phone oh yeah yeah guess what I did for
onef I complained to the state of
California like the state of California
has like a complaint about a business
form I wrote up the story to the state
of California and they sent call they
sent one plus an email and then they
gave me my money back so uh you know
let's see um hundreds of thousands of
dollars paid in taxes to the state of
California one refund on a $1,500 phone
guess what it made me feel good about
California so yeah of course I got my
money back guys I don't
lose um California fix the OnePlus
store
uh all
[Music]
right let me let me go to the bathroom
and then let's get into
this um never give up never surrender
okay go watch Galaxy Quest it's it's an
inspiring slogan
man
all right
is Galaxy Chris good yeah this a fire
movie I wash my hands boys all
right
um you're interested in learning have
you considered going to
college sorry about the clickbait title
um all right let's see what we got okay
so I I literally I walk to work this
this whole AMD situ situation has really
been stressing me out I walked to work
at like 10:30 last night I picked up
17900 XTX uh I took the 10 stor card out
I put the 7900 XTX in I put a new hard
drive in and installed Ubuntu I
struggled to find a USB port with enough
power to power this thing but then I
found one got Ubuntu installed but
that's basically all I've done so I
saved all the good stuff for you guys um
so you'll see we can go in here to Tiny
grad
um you know we can even run something
complicated so like uh let's do
beautiful MST so an example called
Beautiful
mest um so it's just going to train a
quick mest model uh on our on our GPU
[Music]
here 98% accuracy so we can say debug
equals 2 and we can see what's going on
here so this HSA is uh amd's HSA q and
you you can do let me open one more
window
here and open I started a repo last
night called
XTX and that's where I'm going to
document
things
um do document much yet uh so there's a
flag there is an environment variable
flag it's like HSA kmt debug or
something so HSA kmt is the is the
kernel
interface uh that actually talks to the
uh also wrote a pretty good rapper for
this but there's a just
say debug enir
variable it's not AMD log level it's
something
else does anyone know
it it's not
that
great
history oh here HSA kmt debug level uh
so we can set that to seven and you'll
see how it actually uh communicates with
the GP that's what's add that as a note
in the
repo um so these are just the kernel
calls to the GPU let's isolate this to
just dispatch one kernel uh to the GPU
so have an example in test off called
test ad
tiny uh test tiny
ad we should if we
do I don't want to I don't want to
continue with this you know I ran into
the same problem with a OnePlus phone
like I could fix it but it's not worth
my time to do and this isn't worth my
time to do either so at least if we're
on stream and we're ramping like it's
just you know
this is one of the reasons I'm like like
you're supposed to just be like dis
passionate and emotionless and like okay
we just need to make a business decision
we'll make a list of pros and cons and
we'll choose and we're like I know yeah
I know you're supposed to do
things
um so yeah this this shows how it's
actually communicating with the uh with
the colonel but what this isn't doing is
debugging any um
of like the lower level stuff so let's
see if we can enable some debugging at
the kernel
layer um there's like a cool way to do
this
uh Linux
kernel enable
debugging do I have config Dynamic debug
thank you jar bless do you have a
uh oh is this thing do you have a uh
question if you gift Subs in this
channel you get to ask a
question okay so we don't want to just
driver file name let's try with all
amdgpu
stuff okay good there's
a this is just a generic oh this is just
a generic thing that happens to be
so maybe let's try this
that-
C now let's run this and see if we got
any debug oh good okay good we got debug
cool all
right isn't that
nice
oh yeah RSA thing is creating all of
these
uh all of
these oh actually I'm also going to let
me throw rock MMI and watch hopefully
that doesn't
uh oh I didn't actually install Rock
G see if this is going to install the
world no just
that
let's hope this doesn't spam the
C it doesn't so the reason that we do
that is because it doesn't put the GPU
to sleep there's like a lot of crap with
the GPU just going to
sleep
um
okay so we're probably going to have to
go to a lower level first we're probably
going to have to go to HSA
kmt um so let's just add support for
that to Tiny grad
and then we can start writing some some
programs that
uh get to the colonel driver which is
kind of annoying like all this
spam uh by the way niml genen did a
great job getting this driver to
work
um like we yeah hip graph is not like
Cuda
graph H graph's one of those it's like
cargo cult cigraph it's like like they
the same API but they don't understand
why people use cograph to make things
fast
um but you can do all this stuff in in
agsa which is
cool uh you know I just like I love this
stuff so
much like it's so much so fun to like
play with and understand
things okay so let's get into tiny grad
and let's add let me add
uh so I have this script called autogen
stubs and we should be able to grab HS
kmt
here
so in
days
need that don't need
that I'm going to put it in HSA
k&t
so yeah HSA kmt is like just one level
lower in
uh in
HSA oh
no don't make me build
it I might be able to use HSA
runtime these might export the symbols
you see the problem I saw a. a file
which means it's statically linked which
means I can't see types into it uh which
is kind of annoying but let's see maybe
this is just going to work uh generate
HSA
KT oh oops just
St okay I don't know why I printed all
that oh no those are fix me stops okay
ump doesn't work for binaries or does
it don't make me I'm going have to build
a justt AR
I
it's probably a flag or grab for binary
okay Li say kmt but it's just a a file C
typ doesn't work for a files does
it you have the ability to recompile the
library as a shared
object otherwise you'll want to build a
python extension model that links to the
static Library okay well that sounds
terrible um let's try one more thing
just use
pbind yeah might feel about that
okay um so it is true that AMD does have
these things open source they're just
kind of all
worthless I mean I guess it's better
than AMD not it's better than Nvidia not
open sourcing this I guess okay rock T
thunk interface I think it's
this hey AMD this is my job
interview
right how much shit do I know about your
shit like I don't understand why I mean
no they don't take me up on the offer
because companies don't work how you
think they work all right companies
don't actually make like like no one's
going to make a bold decision at a
company you never get fired for going
with IBM or whatever can I find Numa
what's a
numa um missing Numa
librar why is this linked to
Numa know that didn't
work oh Li numad Dev let's try
that
package can big not found well that's
like a normal
thing not Li package package
yeah what's it missing now a require a
li
DRM what is Li
DRM
okay of course it built the same shitty
static library that the other one did so
what do I have to do like see make
shared make
J unknown argument
shared make
package maybe the dev version maybe if I
install this it actually has what I'm
looking
for no that's already
installed oh here we go build shared
limps we love share
lips what I got to do put some D bitch
oh there we go live agent akts all right
cool uh
that's so
big that's
huge I don't really want to pseudo make
install it but I I pseudo make install
it whatever it's only one
file great user local lib HSA kmt okay
well that's a little bit
annoying
um I mention
this
think I need that I'm just gonna assume
it's
there okay notice how the fixing stubs
are gone so now we have a file in here
called Auto HS kmt now we have
hsmt that's nice we had to do this
anyway uh what am I a
branch it's fine
that it's kind of fine to be in this
branch
so I have a branch called hipless uh
it's fine to add I just say can't there
it's fine to support it
aogen uh yeah Numa got stuck in my mind
right okay so now we have HSA
kmt exposed to us now it's pretty cool
we can do things
like um from here let's do test. p
user from Tiny runtime
Auto
HT I import that
right tiny
grad just from like tiny grad Andor to
say
kmt
why do I need to look that
up
great all right um there's an HSA
[Music]
kmt header we can just
read it's probably the easiest thing to
do
uh or we can just look
at that's too much stuff oh that's cool
though look at running my
batches um yeah but no on
Monday like I gave them till Monday my
end of the week means Monday okay
I got to just on Monday I got to just
put all this shit out of my mind and
just say it's never going to be good man
you just got to accept it you got to
move on with your
life all
right
so
I know can I just like Alex memory let's
say let's find the ARs for
that why don't we first open
the
kfd it sounds like a good place to start
right open the
[Music]
kfd uh let's also just ni this
here we're going to get into the
firmware I promise uh if you just want
to see that part you can just fast
forward this live stream right
now okay do we have a kfd let's see if
we have a
kfd
zero it doesn't sound good or is it good
oh it's just status okay
whatever this function called check that
I use in a lot of
places let's just throw some checks in
there do it right check is dead this
check is
good always do your errors cuz then like
if you don't do things like that you're
going to be like why doesn't it work why
doesn't it work and then you're like
frantically adding if statements later
and you just don't want to do
that no I'm sorry about your fast
forward button bro What GPU do you have
do you have an AMD GPU or an Nvidia
GPU you got the kfd
open
h set event destroy event wait on event
Port
Q we're gonna want to create a queue I'm
sure there's a create
Q wait it doesn't even call create
Q it does I just bet the I bet the debug
is
broken wait what oh is this one of these
things where you actually want to do
like
like
that oh just can't be too
large I see um well okay we have the Q
creation code here we can just uh we can
find it in the runtime and the runtime
is open source
two uh so we'll just find out what it's
doing okay so where do we create a q
here HSA Q
create uh so why does HSA Q create never
call HSA kmt create
Q it's just poorly um okay I actually
wrote something for this that we can
just use in tiny
grad
um I worked hard on these things here
hip GPU driver okay so it's
here it's called hip wait kfdi control
what is
this
oh cool I worked hard on this this
stuff's better so um I love when old me
did good
stuff all right
uh can I just just go into HSA here and
do a import from extra
do where is that H GPU
driver that should be all I need to do
and then get rid of that we'll use my
debugger there we go that looks better
so I wrote something to just hook IO
control I'm actually very proud of this
code I wrote it on stream um you can use
it for the qualcom one too so like this
is how you can just like these GP few
user spaces are unnecessarily complex
and you can write like really simple
versions of it uh you know like there's
some 20-year-old kids now who are better
programmers than me uh it's interesting
how a lot of them code in like rust and
stuff like like it's really impressive
with what like um like like Asahi Linux
reverse engineering the uh the the
GPU
um of the mac and then like rewriting
dryers and rust that are more compliant
than the real ones um it just shows it's
interesting when people care uh how good
they can be okay uh so here we go here
is of course you know what let's keep
that thing on because of course that
it's incomplete and actually you know I
want to bet it's incomplete because AMG
just put in print statements and did we
put in a print statement for create Q uh
nope we forgot that
one uh so actually really what we should
be doing is not wasting our time on HSA
kmt we should probably go right
to I think
the and we don't even need HSA
kmt especially since you have to build
it and it's not
included uh we can go straight to just
like I already have all this stuff so we
can just go straight to using kfd oal
and we can just create this class and
call the io controls
directly oh
oh see look oh my God we could make it
so
nice we could build them such nice
things wait there's a poll how many
exploits I'll find why isn't zero the
top option okay we're not actually going
to find any exploits guys it's just I'm
just trolling you with that
thing just trolling you with the uh with
the
uh all right we want to find X
points we'll live up to the time of this
stream um all we did so far was open the
driver okay we just opened we're we're
we're like forward engineering I don't
want to reverse engineer anymore it's a
huge waste of
time all right maybe the right idea is
not to go to this level maybe we should
go to this
level we can use this this HSA driver
which is the HSA runtime level like it's
mostly pretty good it like pre-
allocates all these
signals um pre- allocates a bunch of
regions of
ram even dumb fuzzer like rat MSA what
is
this
H I mean okay you want to just try to
crash the GPU like is that what you want
we can probably do that pretty
easily
uh let's use
HSA we don't need we don't need cam
t
so yeah no like I said I didn't write
this
um what does the check do
here the
check where's that to
find it's pretty
cool
yeah we should still have our our driver
which is
cool let's go here
okay um wait no that's not running
that's not there but uh
here uh
OS
home good cool so now we can see like
when we call HSA a nit we have all the
debugging enabled uh we even have the
debugging enabled over here on the
Kernel side so we can see what's going
on there right so this is like what
happen when you go hsit um also what
happens when you when you dnit the thing
so I can do like
a more
time we can show you what like the the D
look like so there's the init and
there's the
dnet
DN
okay cool uh all right you just want to
Let's create a
q we an agent
first agent tricks they don't even have
a word for
it what's an
agent scan agents oh
say that seems nice let's just scan the
agents
is it a good idea to put pressure on
AMD I mean look it's not really going to
put pressure you're you're just going to
may maybe I'll I'll upset a lawyer a
little bit but like it's not really
there guys there's no fixing it
okay like this isn't going to get better
and you you just have to like it's it's
it's look I don't when I say say it's
like an abusive relationship I'm not
like like no like abusive relationships
are truly horrible but like there is the
the similar sort of like pattern there
where like you fool yourself into
thinking things will get better uh many
times you're like I can work on it I can
improve myself but but in
reality um you know that that isn't
what's going to happen and the sooner
you can just
leave uh
yeah like the the sooner the sooner you
just leave the
better the better off you
are a was almost bankrupt and they
turned the ship
around I mean
the even if they do turn the ship around
it's not going to happen on a timeline
that works for tiny grad like I don't
know I probably maybe maybe if I was
more aggressive
earlier like we're at a point now where
I have all the parts for the computers
we have to build something and I don't
feel okay shipping this to
people right like like again you want to
criticize me for taking pre-orders
before
like I I fully qualified something like
you can but it's not a Kickstarter right
they're $100 refundable pre-orders
mostly to hold your place in
line right like it's not like
Kickstarter where I don't have shit I
had a
prototype um it wasn't until you got
really deep that you found out that
these things were just
unfixable
um so I mean no like the problem with
being positive is like let's say AMD
commits to open source it'll be open
source in a year nobody's going to give
any shit about
the 7900 xdx in a
year like that's kind of the
problem we can't no look p is a right
move I'm not going to I'm not going to
like there's like 2% of fuckers who just
like you know whatever man
um
yeah all right let's make a
que we're just going to call it agent
that's a good name
what size oh size not equal to minus one
Max Q size.
value let's take a look how big is a q
oh that's a pretty big q that sounds
nice all right let's make a
C null fun it's an old
Funk yeah I know I mean this is this is
like the the same pattern that's played
out in gaming is going to play out in
ml
I mean it's a user space crash don't get
excited all right
cool Rec created a queue
maybe that's a little large for a q I
don't know let's make the Q size what's
a good Q size guys how you feel about
seven who's feeling seven is a q
size don't do seven eight is that a good
Q size oh don't do eight eight doesn't
work okay never mind Max Q size. value
let's go back to
that
so what's
crashing let's make sure we destroy our
kill probably some clean
up F the Q size I don't know about fing
the Q size
boys uh we should probably get the docks
for
this
so let's see I think it's rock our run
time yeah here we
go well let's just try putting trash in
the queue okay we're going to put things
in the queue you
ready where's the queue The Q's over
driver all right we have created the Q
what can we do with the Q we can set the
priority of the Q to be high we can
enable the profiler on the
Queue oh let's destroy the queue that's
just being
polite by the way yeah n j great work on
this this is this is
awesome all right we no longer die and
crash anymore we create the queue we do
some crap
whatever submit
packet let's take a look at submit
packet HSA Q store right
index
use have free bug would be
cool all right I think maybe putting
random crap in the que is going to get
us somewhere so let's try that first and
then let's just see like what kind of
gets exposed
um all right so this is just the right
address I
like what do I increment the right oh
okay I see I see I see here we
go I
see
it's like not really what I want to
do
um C
types un a
pointer from
address no no no that's the other
way
we can always do M
move
C types allocate
array you know what I can just use n for
this I don't know s
255 size is going to be
100 all right now we say that. data I
have to do from MV which is a helper in
tiny
gr like c types. m q base from that
data cool now we got to bring the
doorbell to tell it to execute the queue
let's see what breaks
um Q store index self next doorbell
index
barue where's our next door index is
that to start to zero
cool
is there a bug
[Laughter]
bounty we might need a little more
structure we might need a little little
more structure let's try out with a
little more structure instead of putting
random crap in the
C let's start with some
structure
so a lot of times it's yeah random
doesn't always work for
fuzzers you need to throw some structure
in there and let's see actually we
should probably try to find if we can
get like a good uh a good mutating
fuzzer
we're not submitting any bugs to bug
[Music]
bounties
you guys know my feelings on bug
bounties okay
um I'm probably forgetting something we
probably have to do some
like
barrier
packet put packet count that's
fine self available packet slots oh self
next doorbell index oh plus equals one I
say there we
go
HSA Q inactivated due to async error one
of the actual arguments did not meet uh
bullshit with a bullshit oh well that's
a good
point I didn't think about that
bullshit all right empty Q okay let's
try random Q who's ready for random
Q oh no the CP the CP will be so
sad H okay didn't
work what
happened that used to complain to me
about that que what
changed wait what happened to the
bitching about
preconditions
get
it that was just failing and complaining
am I not
wrong
I'm kind of sick of all this debugging
actually Let's
uh yeah
okay I don't
understand what
changed oh did I get rid of my
sleep oh there we
go inactivated due to async error
then it aborts with a
c do I get more info here I think also
we really want to fuck it up let's hit
the sdma the sdma seems way crappier
than the
AQL
then we can try things like corrupting
the queue halfway through oh yeah let's
go the AQL packet is malformed
okay I mean that's fair my AQL pack is
definitely
malformed because it's random
shit 's add 10 to this like some of the
things are the same
all right random doesn't seem
great
actually where is this argument coming
from a good question
right oh no it's just invalid packet
format invalid argument where is this
coming from what uh is it in
here
Dynamic scratch
Handler process errors if only one Q is
running
where's the sdma stuff let's take a look
at that too I guess we never really got
a queue working for
that okay we're calling into this copy
on engine
thing
um okay this probably bugs
there signals I mean see this this like
isn't a good fuzzer okay so this isn't
how you fuzz things the way that you
actually fuzz things um is with this
kind like you want you want a
permutation fuzzer right you want things
that look almost like real packets but
you just like change one number here and
there but that's a lot of software
engineering guys so let's take a
different tag right now and let's start
looking at the actual
firmware
um right like right I'm happy like like
so a lot of times the way that you
approach systems like wow I'm teaching
is hacking okay so like a lot of times
the way you approach systems like this
is you
don't you don't just focus on one thing
you you approach the system from all
possible angles right so so like and
then the question you have to keep
asking yourself is what actually is this
thing right so like something here is
throwing this invalid
argument um invalid packet format right
like where are these errors actually
coming from what's generating that error
so it looks like there's some in a
runtime there's some parser that parses
like an error cue that's probably coming
back from something like the mees or the
CP uh
yeah and then we can like dive in and
see what that stuff actually is um but
let's take a different tag for a minute
and let's actually look at the firmware
and see if we can find these parsers so
I looked very briefly at the firmware
once and the firmware I couldn't even
understand what instructions set the
firmware was so
uh
yeah we fuzz heavily in cash
verification
uh wa who's
we you work at
AMD do we we going to get the AMD people
in here come on is it going to be like
10 St that' actually be pretty cool
that'd be a good
step and then open sour your shit and
give me some
documentation
actually we probably have a better thing
to
attack I don't want to attack the C
let's attack the firmware load
process
some
oh you do CPU verification well your
CPUs work
great uh no look I'm not looking for
help guys this isn't going to get better
this is just a cope
stream like we're just coping and maybe
we'll find an exploit and if we find an
exploit like particularly if we find an
exploit that like could be used to dump
the htcp keys and stuff right not saying
it's going to be used for
that but then like this whole like oh
we're going to keep the firmware secret
thing kind of becomes less of a point if
like we have a whole thing that can just
load whatever uh whatever stupid things
I want so
yeah it's the link to my Discord not for
you the first step to entering the
Discord is finding the link to the
Discord and if you're incapable of doing
that go read the questions document you
know go read the questions
document um
okay uh so where are we let's go over to
the
driver uh let's get rid of my watch on
Rock SMI so it's kind of cool you can
watch if we have nothing opening the GPU
yeah you see Asic devices runtime
suspended let's do rock Ms oh
no all right so here is the loading of
the
stuff
memory training is not
supported PCI is resuming SMU is
resuming SMU firmware okay seems like
the SMU is the first thing that gets
powered
up I had fuzzing on my mind that's not
actually probably the right way to
attack the system the right way is
probably to look into this load
process
uh so these messages are coming from the
colel um actually should we just get the
exact
kernel yeah let's not look at a
different kernel let's look at the exact
kernel so this is just this is I I just
installed ubuntu's uh Hardware
next actually can I just like install
kernel sources isn't there like a app to
do that
user Source here back in the old day
of Linux
headers
um so let's I mean actually we just know
the colonel can I just look can I just
oh it probably has
mods app get install Source Linux
Source I must put some Deb Source
URLs you bu to rebuilding kernel I
didn't I do this on like another stream
and I ended up like talking talking
about how rebuilding
kernel building your own kernel is quite
easy oh here we go build dep no you must
put
some I just need to go in there
yeah
let's get the only the official ones
that are supported we don't want any
unsupported software on our computer we
only we only take approved taxis that's
right we had some people come to our
office once and they to be fair they
were from out of the country but they
didn't want to take an Uber they wanted
to take a licensed taxi and I'm like and
you're going to put a Snapdragon
consumer processor on your windshield
and let it drive a
car yeah yeah I don't think you're going
to do
that unfortunately this does not install
the necessary dependencies wait we're in
Disco what's disco I haven't heard of
disco oh because it's 1904 oh YouTu 2404
is out who's very excited about YouTu
noble
numbat noble
numbat apt
source
building the kernel is quite
easy how do I get to the route of the
kernal Source
train
where is
it I not I not do
it
download is performed as
root oh no I messed
up I understand well this actually
pretty
good uh so I can just I don't need rout
here I can just app Source here and
it'll give me the source code apps
pretty cool I've never I've never like
uh dove into
this you
know you know I always say so much
respect to the people who like make all
this stuff
work like the people who actually like
make computers good not like Troll and
start TR start companies you guys know I
am like self-aware about this stuff
right
I don't know my life took a certain
path I think that the way that you uh
the way that heaven works is you get
there and St Peter asks you if you're a
good
person
and if you can look him in the eye and
say something like yeah you know on
balance I you know I think I am uh then
you get
in but if the first thing that comes to
your mind is about like like a murder
you got away with or a girl you raped or
something you know something truly
terrible you did or you know someone you
stole from or just like being a scammer
your entire life right if that's the
first thing that comes to your mind when
when St Peter asks that question then uh
you know H double hockey sticks
man I think most people are good people
though I think a lot of people just
don't really know
better there's a few people who are very
bad
people I think Unfortunately they get
power
all right we're building the
kernel uh but good now we have the
actual source to the real kernel running
on our running on our system uh just you
don't really want to mismatch there
again little things like that make all
things easier later in the
future all right so let's um let's take
a look into what the firmware load
process looks like on these
things actually what I really have to do
is rebuild AMD GPU as a
module is it a module is a chance it's a
module that'd be sick yes it's a module
okay wait does this just
work pseudo rmod
amdgpu
yes yes hell
yeah
okay of course that didn't happen
cleanly but that's great I'm so happy
that's a module that makes my life a lot
easier
okay so let's see if we can repeatedly
uh unload and load it okay so let's uh
we LS mod is this in
here well because it's a module we can
just rebuild the kernel and then we have
the module and we can just make one
change
hacking is 50% setting up your
environment 50% knowing a lot of shit
and 50% binary search by hand I said
those backwards hacking is 50% setting
up your environment 50% binary search by
hand and 80% just like being smart
knowing about
computers yeah we look at amd's for the
colonel
keep hacking
Elite I know with a lot of like
diversity inclusion shit you're not
supposed to say things like keep hacking
Elite but let me explain what I mean by
keep hacking Elite I don't actually mean
exclude people from hacking I mean
recognize hacking is an elite skill
anybody can acquire that skill but in
order to gain Elite skills you must go
through the the the Journey of acquiring
Elite skills and it it demeans the elite
skills if you let people have the
rewards without going through the
Journey and that's what I mean when I
say keep hacking
Elite okay so we have IP block numbers
and DRM DRM doesn't actually stand for
digital Rights Management in this case
it's like direct rendering
manager
um okay so these are the IP blocks
numbers let's see where we actually load
this
firware fetched V bios oh this is cool
boys this is cool we're getting
somewhere um oh it comes with a TMZ but
it's not supported so I'm sorry if you
wanted a
TMC that's a lot of ram that's
good
it's so disheartening to remember that
no matter how far you go with this
you're going to be stuck at these at
these blobs um by the way I can show you
where the blobs live too so it doesn't
seem like there's any prints about
loading the
firmware like where it actually loaded
them
from well it might not have actually
loaded the firmware we might need to run
rocki for that to
happen
[Music]
no oh we also have rocket asmi can also
reset the
GPU argument zero I have a script
this oh I got to Throw Some D's I need
some D's all
right okay good that reset the GPU
SMU what's the
SMU we only want to search in
drivers
T to some s on that drivers the fuse
programming block
interesting
all right we have a lot of stuff in here
about
smus this happens before the fsdl images
loaded what's
fsdl
sdl let see
that
this is all debron what's the code name
for uh can someone figure out the code
name for
uh one of you guys can figure this out
chat I believe in
you we're still building the colel
loading dmob firmware via PSP wow I
didn't know there was a PSP inside of
this
thing
here we go here are the code names I
used to just know
this um no no no no the code name is not
that though here Plum
Bonito AKA Navi
31 all right so it's not the AL debron
let's find the plum
Bonito all right here we go here's the
SMU we're doing SMU
1307 PP
table my colel build going it's still
building see man I should have done in a
tiny
box
all right what is the dmob firmware via
PSP so it looks like our workfl
something like SMU so usually these
things are don't lowercase my shit
um where am I loading
me load demob firmware V
PSP oh they have driver
monitoring what if I set the size to be
big calculate the size of all the
regions for the dmob
service frame buffer move this into gar
man we got a lot of we got a lot of
understanding to them we got to
understand a lot of this
shit SMU equals system management unit
that sounds plausible do you have a
there's got to be like a you have like a
link to what all these things
are it's in the rock
nbox
Qualcomm is the most ridiculous names
for
things one the uh this one it's called
like the uh it's called like the like
the gate Trapper or something oh no a
stupid name like I couldn't believe that
this was
a search for
SMU
uh
oh you found it
here um okay AMD GPU SMU
mees
October this website's cool by the way I
like fonics i' I've been reading because
they covered a bunch of the tiny per
stuff I've been reading about it like I
I you know I feel kind of bad when I
like see these articles like I'm not
doing work in open source I'm trolling
people on Twitter okay like don't don't
don't fall for it don't like you don't
have to like like Tom's Hardware
whatever that publication is but like
fonic is legit you don't have to publish
this junk
um yeah the devil works hard but Michael
larabel Works harder yeah
um oh
noi this is just about no like I want
like a list of all
the
um gfx 11 has been the graphics block
for these
modern block by block driver
enablement colorful fishy code
names so which gfx am
I
how do I know what firmware is actually
being loaded I don't see it like
printing that out maybe it's earlier in
D message do I have D message going to
the beginning of the system no I don't
why is that buffer
small oh I think my kernel build might
be done I can tell by the fan woring
down module firmware
can I right click
and it's interesting that oh these are
just module firmwares for the uh for the
gfx block but I think there's module
firmwares for all the
blocks part of the problem with this
driver too is it goes back to like God
knows when like what's a Polaris what's
a I'm sure like some of you in chat
actually like know all these Act
better than I
do
um but okay so these are the different
module framewor I can show you where
they live and we can actually look at
some of these
files firmware AMD
TPU and they're
here so I don't know which one I
actually am but these are these are the
firmware files
do we know which one how can I tell
which
GX Rock info oh you're right you're
you're
right uh you're right Rock info can dump
all the running firmware
versions just add it to your
path no no no no there's a there's a
command for
this
um I can get the gfx from there you're
saying oh oh is that all that means so
these are like the 1100s no no there's
also there's a command to see I think
maybe it's an Rock
msmi to see the firmware
versions yeah show firmware
info yes
this okay
so this is cool because it just shows me
all the firmware versions let's put that
over here in my thing
here all right ium these ones that are
zero don't actually okay so the things
that we're interested in finding are the
CP and the
mes uh oh maybe the sdma too I didn't
realize sdma was a piece of fucking
firmware
so I'm going to guess that the CP is
actually in the
Me Maybe the mech is
like I don't know
uh but yeah so what you're oh okay okay
okay yeah you're right you're right
you're right so like gfx
1100 is Navi 31 and then this is Navi 32
yeah yeah okay that makes sense so these
are the ones we're loading these from
ref
vers so let's just throw some Sim links
in my
7500 let's attack the firmware build
process the Mi the Mi has the biggest
number which is
interesting probably mean this is where
a lot of this crap
is oh yeah but that's probably just an
HSA I doubt that changes like to
stop how big are these files that's a
good
question oh it has an IMU I wonder if
that's an inertial measurement unit
don't shake your
gpus um also like what what the hell are
all these files so
like oh we found the mes1 and the
mes2 but none of them show up
there oh well we can't get the firmer
version of the mes because it's not
supported of the given
system there's actually a flag to
disable the mees I have no idea if it
works or does
anything um CIS x file what files are
these yeah they're like not
anything look at nvidia's crap it's a
risk five
elf what what archit I mean it's clearly
it's not encrypted right there's way too
many zeros for it to be encrypted but
what architecture is
this does anyone
know no it's not
arm
no so I don't really know what open cell
is people people were giving giving them
credit for open cell do we know for a
fact that it's signed AMD told me it was
signed again I haven't really looked
into this that
much um but here's my
dream I ran file yeah you just watch me
do that and it didn't deal to anything
um we can try binw walk if you want but
binw walk has a lot of dependency and I
always regret
instelling
uh yes AMD told me it was signed I don't
actually know um I know very little
about this my
dream like if if if it if by some 1%
Miracle AMD comes through and actually
open sources this stuff then what I want
to do is like write the goal of tiny
grad is to be minimal all the way to the
hardware um if you look at T kernel
driver t t torren kernel driver is super
minimal I would love to I'm not even
sure we need a kernel driver it's very
possible that from user space even from
python we can map shit we'll just map
the mm uh you know I I'm not sure we
even need a kernel
driver uh and then we'll do everything
with the firmware right because this is
what Tor does like ttor doesn't even
have firm it has like some bios nobody
cares about bios the
like what I want to do is rewrite the
entire AMD GPU driver in user space I
don't think it's that much more
complicated than what we've been doing
again because most of the things are
done by these firmwares but then the
thing that you're talking to on the
other side is the firmwares and there's
like a megabyte of them there and we're
going to need a way to build them and
that's what AMD needs to open source if
they want us to continue with this
project I'm not I mean I'm not I'm not
throwing myself against a stupid Black
Box
anymore
like we're almost to the
end no I we probably minimal kernel
driver to like put set theu up correctly
and
stuff uh what architecture R
DNA wait I actually didn't consider
that I actually didn't consider the
firmware was written in R
DNA no I'm sure it's
not what architecture is this
no you it's strings oh oh you're going
to Strings them I can strings them yeah
that's a good
idea
Le hacking with
strings no
strings literally no
strings no no no no no no I I I would be
shocked if it was
rdna um the fact that there's no strings
is kind of crazy
actually when you get no strings it's
concerning
I'm gonna in this window over here ask
Claude I'm sorry I can't show
you what architecture is
this
this appears to be hex Co dump of
a oh it could be risk
five
um okay uh let's go over
here
uh let's scps over from
q and let's open them in uh
gidra no it's not compressed
[Music]
either
no I don't know maybe it's risk five
like okay it sure looks like let's talk
about a few things it sure looks like a
60 32bit instruction like a 32bit d
word it doesn't look like arm I'm pretty
familiar with arm and the fact that it's
32bit probably means it's not
thumb uh let's just find you know what
let's find a online risk 5
oh you know I don't even need to
go Lana Lux
[Music]
hello welcome it's a rare Thursday
stream for me
today uh we we'll let the we'll let the
non Subs talk in honor of the
raid uh it's a rare Thursday stream
today I hope your stream went well this
morning
uh we
are if I just put the word exploits in
the title I really get
I really get way more people no I mean
we're just we're just trying to we're
just poke it around you know um look I'm
I'm kind of like the beginning of the
stream is a more coherent AMD rant uh
where I really beat myself up about like
we're not going to get AMD on
mlpf um it's just not going to
happen like it sounds cool but the
driver's not stable enough um and I'm
not going to spend my time trying to
mitigate crap in amd's driver I do not
care enough to do
that
um so yeah there is a bunch of firmware
that runs on the GPU so the problem is
the uh GPU is not really uh open
source so we'll do a little in honor the
r we'll do a little uh little recap um
this was my blog post
uh 10 months ago where I I have a a new
company called the tiny Corp uh we make
this software called tiny grad um this
is Tiny
grad and we someday want to build our
own AI accelerators but for now are fine
with uh working with existing AI
accelerators should develop our
framework so I thought it would be cool
to Target AMD accelerators um the driver
is
terrible uh but I made a mistake of
thinking that the driver was open source
um so I even linked to the source code
uh it turns out the bugs are not in the
driver it turns out the bugs are in the
firmware um the firmware is closed
source and judging from a patch change
log that I got it's uh questionably
developed let's say
um
so yeah I thought I could fix the driver
but you can't fix the driver and you
basically can't fix the driver because
of
uh these
files so the driver in the kernel does
very little it mostly does setup of cues
and then you send the cues to these
things wow there's three Mees a me an
MEC um there's something called the CP
that I don't know where it is it's
probably in one of these
files um according to AMD they're signed
who knows how true that is uh we're
going to we're going to take a look and
see if they're actually signed I wonder
if anyone's really looked
um and yeah so we're looking at like
that's like 2 megabytes there one and a
half um uh oh yeah so as far as amd's
software stack goes tiny grad has now
cut through amd's entire user space the
only two things you have to install to
make tiny grad work are HSA Rock R which
is the HSA runtime there's not that much
code here this can be replaced probably
with 50 lines of code and a week or two
of work co- manager is their compiler
it's lvm base that assembles to this
well documented architecture called rdna
A3 um we can replace this too and like
it's very possible you see like I say
this with optimism but I don't I want I
don't want to do this anymore like like
like like like AMD like you know what my
mistake was I know what my mistake was I
talked to AMD I don't know why I did
that like it was constant it was
basically like like you are amd's unpaid
QA team test out this blob that we sent
to you and I don't know if they think
like that's doing me a favor but like
it's really not
it's it's it's really and I fell for it
I fell for it because like Lisa Sue
added me on Twitter and stuff I
shouldn't have fallen for that
like I wouldn't waste my time if Toyota
wanted to talk to me like why would I
waste my time with that so why should I
waste my time if AMD wants to talk to me
right like you have to fix you have to
don't work with the company work with
the
product um no I mean it would be awesome
to get them to change but you know how
hard it is to change yourself you're
never going to change other people right
like you can't even change yourself why
do you think you could change other
people um we got to get some food wow
it's 127 already how long have I been
doing this
for we got to order some
food um yeah so no I mean I made a
mistake I made a mistake of talking to
AMD
[Music]
uh maybe I can get funding from him I
don't need funding I have all the
funding I
need um wait Uber Eats is
broken come on Uber
Eats no why is UBS
broken no right let's try off Wi-Fi
maybe it'll work with no Wi-Fi come on
Uber
Eats all right good Uber Eats with no
Wi-Fi worked all right we want to get
some healthy food so we can keep working
hard let's
get sushi ball perfect what 20 57
minutes for delivery who's got that much
time um I get the Poke Balls but I eat
the Pokeball and I'm still hungry but
that's probably good
pick your own
Pokeball Alex tells me to pick your owns
get you more
stuff oh let's just order two pokeballs
fine fine this is we we get we got a
you
$40 whatever
man okay my Poke Balls will be here in
minutes you know tiny gr has to move to
Nvidia yeah working close source is
better than a buggy a buggy closed
exactly uh what do we got here oh you
found out what the is this say talk
about what the architecture is oh Mees
support
um
that's that's cool find if we if we keep
finding stuff like that let's
uh let's link
them um let's link them let's link them
let's link
them what if AMD open source is their
firm we around one month from now it's
probably too
late uh like if AMD open sources the
mees tomorrow and says we're going to
open source the CP a month from now okay
fine like but if I see nothing by Monday
we have to just call it like if I don't
see and I'm not talking about promises
I'm not talking about words if I don't
see any like code or documentation by
Monday we're just going to dismantle by
the way if anyone's in the market for
cheap 7900
XTX um I have I have 75 of them uh we're
just going to dump them on
eBay um it's too late to build red Tiny
Box but work on the code I mean like
again probably I should not be working
on this now right this is what I'm doing
today at work instead of focusing on
bugs and Tiny grad right like this is
not what I should be doing at work I
should not be wasting my time with this
garbage uh but yet here we are partially
because it's
addictive there's nothing more addictive
than hacking you hacking so addictive
you're just like it's like a puzzle man
you just you just want to work on
it uh I would definitely having fun but
it's not it's not Saturday I do whatever
I want with my Saturdays but really this
is not what I should be doing today like
this is a huge waste of
time um it is similar to the hardware
scheduler on the mech currently used for
kfd it's a scheduling
microcontroller okay what kind of
microcontroller is it
it
um yeah no I I think the Tiny Box is
just going to be uh is going to be
um AMD aside in
video I'm
hungry I AMU find
structure
well actually this is interesting wait
there might be code in the kernel driver
that
parses what is this why does this not is
this because this is too
big we don't want to open the entire I
just want to open
this can
I open an integrated terminal no
open folder yeah
kernel Linux wi drivers GPU I think this
is too big for it to like Auto
index uh DRM AMD that's
good so
now like when I right click on this why
can't I right click on this why doesn't
that
work oh here I have to include the C
install the CPP extension
back if I switch to
Scala yeah
man okay here we go size bytes header
size bytes let's see does this match
this size of the entire header in image
in
bites
that's hex
20500 oh cool okay all right good so
this is what the here it's called AMD
GPU U code see if we have any hints at
what it actually
is
[Music]
rlcv should drop a diss track AMD well
like guys you know it's it's it's this
isn't like
Qualcomm I said this earlier in my
stream maybe it's time to repeat
myself I could if you made
me CEO chairman of the board of qualcom
I could double Qualcomm stock like
overnight by firing the entire sales
team and replacing them with a piece of
paper that says the price of the chips
when you can buy the chips and we'll end
up making more money right the company
will end up making more money it won't
play any of these Zero Sum sales games
uh it will give companies like like rock
chip and mediate Tech will not have a
fighting chance against my new Qualcomm
I could fix Qualcomm overnight um
AMD uh I could start a process I could
start a process that would be fixed that
would have this fixed in in a year
um it would be a
struggle like I'm not I'm not even sure
right I'm not even sure it could be
fixed I mean I would start by open
sourcing everything like not everything
but like I'm not going to open source
like the verog so someone can build
clone chips but I'm going to open source
the
firmware um they probably can't have
stock at all due to cost yeah it's okay
not having stock
right I'm saying that we have a
thing that tells you this is how much
shit costs if you place an order today
right I'm cutting out the
middleman and replacing it with a piece
of paper and everyone will love
Qualcomm why do I think Lisa replied to
me I I mean I fell for it right like to
be fair I fell for it and put more
effort into this than I would have
otherwise um yeah so like in that
respect it
worked uh but again you have to not look
at people giving you platitudes and
niceties you have to look at what
they've actually given you and they've
given me zero documentation and they've
given me zero code right I should have
just looked at this code I should not
have spent any time talking to AMD and
that was the mistake right I should have
spent time really looking at this code
and like you know what it is like now
I'm just angry about the whole
thing
like I don't know I mean if we get to
the bottom of this maybe it's actually
somewhat like
salvageable I don't know I mean I just
don't want to deal with like like the
Clos Source firmware and stuff and it's
just it's just
upsetting it's like upsetting knowing
that like you work so hard on something
and then you have people on the other
side just saying well the in order Q
didn't work so we switched it to the out
of order Q we don't really know if that
one works better but like I couldn't
reproduce the issue like it's just it's
just so it's not I don't want to reward
that
behavior well nvidia's closed Source but
Nvidia works you think I want to be I
mean I enjoy this stuff but from a
company perspective you think I wouldn't
just be much happier if the firmware
just worked let's say from a company
perspective if only the user space was
shit like that'd be
phenomenal but I mean that's not the
case
uh where's my food I waited too long to
order to order
food DRM
dbug what is DRM debug
this is the mees stuff
uh okay I think it's time we go back to
uh been walk can detect architecture
from binary yeah we'll try we'll try
binw
walk watch binwalk installs so much
stuff I feel like I've tried binwalk on
it before and it didn't
work uh no no no no no this is this is
like the client for the mees it's not
the firmware for the mees if the problem
was just that the code if if the code is
open source and the only problem is
signing that's that's that's you know a
lot easier to work
around tried binwalk to in print
anything for you
yeah what is this
microcontroller imagine I'm placing all
this with user
space H What if I look at like
Tahiti what if I go back sometime it's
easier it's nice that we have like all
of them
here does nobody know the answer to
this uh let's ask Claude I doubt Claud
I'm sorry I can't use Claude on stream
uh
what
architecture
is
used on the firmware microcontroller
of the AMD
gpus uh many gpus use Arm cortex
M some older gpus use
8051 some use custom
architectures binwalk would find arm
right I mean those look like arm reset
vectors
right
it's definitely little
endian it's either armor or risk
five
uh
oh yeah this is when I was looking at
trying to fix the this is when I was
trying to fix the uh fire hoses when I
was trying to fix the
uh
the the
OnePlus um they added signing there's
now signing on the
images
stupid project name AMD
[Music]
firmware I'm set that everyone's like
switched to gidra and no one uses Ida
anymore because like I'm not good at
gidra and I'm like too old to get good
at it the way I was good at
Ida uh
firmware let's just copy
this see what I mean like
refresh
all
right all right we'll try risk
five default little
default I don't think it's risk
five do you have something why can't I
show Claude
contract have a contract that I'm not
allowed to show
Claud yeah I've read this paper I wonder
if they talk about about it do they say
what it is this is a good paper by the
way I'm kidding about the Claud contract
thing I'm just not showing you Claude
Claude claude's shy I didn't get his
written consent to be on the
stream all right
um is it risk five no it's not risk
five I hate that crap trying to get that
thing to work
too
does it talk about it in
here are there some good paper links in
here
too
um so Nvidia makes their own I think
it's called
Falcon
uh
look at AMD down here
nothing
nothing AMD GPU firmware we haven't even
found out the architecture like that's
like
can we just pick a jump instruction I
mean it's not risk five right we we
tried risk five and we got
nothing I mean I don't know like we can
try arm I haven't actually tried
arm I I know slow G is too I have an M3
I have an expensive ass M3 and the shit
manages to be
slow
oh did I actually delete the file now no
I didn't I just deleted it from the
thing see it's like
unclear let's just like just so I don't
like waste a ton of time and like it was
actually armed the whole
time
for
H wait that actually looks
plausible Let
Me Wait maybe we just arm the whole time
okay why didn't binw walk
work let's fix this decompile blah blah
blah blah blah privacy and security
allow
anyway
okay it's also very upsetting that it
has zero
strings open all right all right all
right all right wait this actually just
looks like arm wow okay did we just like
waste I don't know what instruction that
is who would use
it
I oh it's this also like cortex which
might have different looking is the arm
cortex architecture
different
let's look at the entry
point doesn't actually look
right maybe the entry point is
data man you should have SE I used to be
so good with
Ida not that good with g
all right um well we do know some stuff
about this so we probably have the wrong
load
address doesn't really look
right I don't think those are Pointers
they're not aligned with
anything cortex m is different from
cortex
a all right let's let's see if we can
like really find
structure that's not
right
firmware necessary to install the
proper build it into the
[Music]
kernel the
options
direct firmware load
fail blobs for known Carter Model so we
have
uh Navi 31 oh we also it uses these ones
as well
interesting so they're not all
gc's oh I see so it's gfx that but it's
these other ones too okay that's
cool let's put that into docks
okay the SMU is very interesting since
it's like the
main
amd's security chip should be called the
PSP okay well so you know what wouldn't
surprise me it wouldn't surprise me if
they use the same uh stuff that they use
for like the Epic micro
code
let's just read let's just read this
this this more
carefully um all that that that firmware
stuff
was got my
food come on
GS two minutes away coming by
Tesla
okay we we had some good we had some
good stuff with that I don't know where
that thing went
firmware oh
adastation oh that sounds
like firmware adastation debug FS read
oh that's interesting just
fing tracing
Dre
binw walk why and they all are arm oh
hey Yan what's
up you can be a VIP in the channel wait
but let's first check let's first check
your Alpha
here what is y and
walk
what no no no I don't have my my binwalk
doesn't have
why I'll still make a VIP on the channel
though I think it's
[Music]
this
yes got
food I got got
enemies
is the firmware open source nope we
don't even know what architecture it is
yet it doesn't help tiny
gu why is my computer what is it
doing why why is that using 100% of my
CPU yeah the bowl seems small I
know oh
interesting I mean my binwalk just
doesn't have that I guess there don't
have new enough version of Let's just
build
it it's not about helping tiny gr it's
about sending a
message it's
python
look we don't hate AMD we're just I I I
blame
myself I blame myself for getting
duped okay
wait
what how come I don't have
y how come I don't have why usage y this
as
ASM open file
this
I thought I was running the one I I mean
that's the the number the get check
out I don't know oh maybe I have to
install
no I'm using the new
one
here oh don't load the dis ASM module if
the Capstone module can't be
found this going to
work there you
go
it's spicy is so
spicy
okay is that the one I
loaded no I loaded
mess
um
firmware name
GPU
it's so scary how they don't have any
strings like again it's
just like I'm too old for
this a Bluetooth adapter
ones
yeah I just like take a look at what's
there I do verbose it'll print them out
out see if my mb5 is the
same
wait yeah I mean take a look at the
coated found no this isn't right that's
not cat that's
junk I mean that's not
real
that's something
else too much stuff is just
thumb is the
problem open CL and rock am are
not
firmwares
for
invalid
argument okay well I don't know what
that
does um I had the thing that was showing
me what the what the firmwares were
let's call like
common I had the
file
there we go common firmware
header okay in the SMU okay well we know
also that we're in SMU 13 where my notes
here let's get my notes so we're in SMU
13 um SMU 13 AIT micro
code okay print a
header
U code ID
SMC oh wow that looks
cool I bet we really dive into this
enough there's no security on it at all
or like you just re you would just
enable one of those
things
what's
mppt
can I mop the firmware ha stupid
firmware
oh we had that SMU thing printing out
which was
cool here SMU driver if version SMU
firmware if
[Music]
version send SMC
message okay so usually you have crap
like this this is like what sending a
message to like this you want to start
to forget fuzzing the aqlq they probably
do fuzz the aqlq start looking at these
messages that are being sent to the
SMC I mean in that change log they
basically just said here's an Mees
vulnerability to create create a corrupt
link
list
um all right the Vigilante you're the
reason that we're going to subscriber
only chat I just want I just want
everyone to like kind of be aware if
they're asking a question if they're
trying to derail
uh yeah so this is like the same thing
as wait this is actually just straight
up better than the stupid
tool thank you Smurf D that's why you're
a
VIP it's just straight up better than
that
okay was in the docks fire what
docks a lot of us just reading the docks
hacking is also another 30% reading the
docks oh the command to get the Linux
version Look at
that
I Leo thank you for gifting Subs always
remember if you have a question I'm
always here for you there's two ways to
get your questions answered one is to
make them be good questions the other is
to pay
money that's how Education
Works
okay what's a PP
table get PP table from
firmware set PP
table PP table signed what's a PP
table okay well we
can do want to just like write some C to
parse these trucks at least we're
getting somewhere
the pp table
right
okay uh let's just throw together some
quick let me copy from here AMD GPU U
code CP MD GPU youe to 7900
XTX let's just create a new directory
called firmware info let's rate a little
tool in C called firmware
info um of course when you code in C you
have to use
VIP God how does anyone Cod d wi this is
impossible nobody's ever coded anything
in G and anyone who tells you otherwise
it's damn wire what is it file f equals
Fen RC do it like that read F know we
need something like
struct
common firmware header
header uh we're going to free read
into
header size of
header from F and then we're going to
print
F I have like nice tooling for this in
Python but we're not using python now
are we we're not on my for are
we
we don't need sock BBS oh
wellow who needs sock BBS when we have
standard
in oh
no I no name
file expected semicolon or ship before
shit oh we have to include standard buol
we got
bus
sock bounding box has incomplete
type comment that now I don't know or
you know what whatever
man type death ining
box in complete type fuck
you
two or more data
types even need these
ones struct
mutex where's a mutex right sock BB
let's go get sock
BB how much crap do we need to import
sock
BB all right I lied we're not going to
use Vim vim's impossible anyone whoever
says they coded anything in Vim was a
liar unknown name youing
shit okay field mutex as incomplete type
struct mutex
mutex struct
mutex lock check out my M Tex isn't it
Le okay uh inex expected that's probably
just because I made typos yeah just got
those all
right
okay we just need to pass in the name of
a
firmware lib firmware
amdgpu let's look at the
SMU okay size and byes is that does that
match the actual size and byes of the
file I don't know because we printed it
in
HEX
let's return zero because you did such a
good
job let's also add to my get ignore is
a.out because we never want to Comm a.
outs let's go wow this is some old
school hacking stuff I see why you guys
got viewers it's like what I used to do
back in the day
boys um e IP okay uh let's look at the
size of the U code in bytes and let's
look at the offset to the U
code
payload offset from the start of the
header that's got to be in
HEX
right that was less useful than I
thought it would
be the U code starts at hex 100 okay
that's U code all right
great wait dollar sign PS1 is this
written in power
shell oh you know about the peee
table
wait what is
this
what is this and who made
this power play
tables oh
interesting
cool there we can edit all this
stuff ah the what you found out the the
the it was actually UTF uh
16 the code is just
emojis you can fry your
carard
um
okay that's great that we
have stuff but okay so the U code
clearly starts here what is
this
i i group xxd by
four that does look like arm kind
of
no maybe it want want
this oh that's the wrong Indian
this yeah that's not
arm AR
64 not AR
64 not
th
mips wait that's the most plausible
actually no that's jumping somewhere
crazy
though no it's not
myips MIP 64 I didn't know there was a
MIP 64 power PC
well but they're not reset vectors right
those aren't addresses why does this
look so
weird how does know one on the internet
know the answer to
this it's not
encrypted it's not
compressed
I'm not cheing off this this is right at
the
beginning U
code any hints about U code
CP and micro
code header U code version okay we have
a ucode
version let's print the U code
version um let's also do
I don't need to pass in an argument here
let's just write out the
files uh let me just make actually I
have an idea uh for i i z i left one I
less than RX c i
++
I
close let me just create a crap struck
for that
too okay
um
okay I see so U code version is some
look kind of like
crap maybe it's better in
Hatch it's interesting look the IMU is
almost all U code they're almost all U
code but the SMU is going to have a
bunch of pp tables in
there
let's do some differential
stuff
for
okay so maybe that first thing was a bad
place to start because it looks like it
radically changes but then the rest of
the stuff doesn't look like it changes
that
much that might just be a hash I might
just be wasting my time looking at a
hash that might even be a signature at 1
d
z
I know they say that's where the U code
starts but yeah that shit's not
code it's very recognizable it's code
once you get down to
22 once you get down to
2200 uh let me go back to printing with
grouping for George why to use a real
hex editor because I haven't hacked
anything in so long
is it possible that it's big
Indian I mean take a look at those
numbers
right let's look at one that's more
radically different you know the worst
part is I was better at this stuff when
I was
24 I bet 24y old me like would already
know what did I give up these skills for
this looks
different it looks like the SMU is a
different architecture from the
mees
oh and look who it is it's fail
overflow
a very
cool so it's internal custom garbage
great
amdu code in did someone already write a
better version
of oh very cool thank you for writing a
better version than me
tools all right um so you know I'm not
really a hacker I'm actually a script
Kitty so there's that
um you know people are really let down
when they find out about this fact that
it turns out I can't actually hack and I
just steal other people's stuff I mean
you know at least I'm honest about
it what's really important though is to
always take
credit whenever there's a video camera
you should take
credit
like right
now um no you know how I really feel
about that
like all right so where did this stuff
come
from
where did they get this
stuff
this doesn't look right either I this
only works for some of
them
why did they make their own custom
garbage the sea Islands
GPU which the sea
Islands
how old is this
R
interesting I mean it's kind of
concerning that they have a custom
garbage micro code processor
here a related but incompatible variant
oh
God so
interesting this almost doesn't look
like I mean this look looks more like a
um like a GPU language than a
uh if it's a green logo it's
ancient
okay Radion micr code processor which
seems internally to be
[Music]
called micro
code
F32 why is the AMD micro
code there's a lot of proprietary
St oh I see what they did it for it's
the PS4 GPU
you the Upstream R guys
are code for an embedded processor I
don't want to
document
why is this
stuff
we have a second Poké ball cuz that bowl
is
small Sal really tast very different
tun
like you know in all my talking to
AMD they didn't even tell me any of this
stuff right like like it was just zero
technical information and that that was
that was the giveaway like that was that
was the
giveaway I I think people have said this
about Sam alman's Lex it's like the guy
talked for a long
time but managed to say
nothing
well I mean this kind of gets at why
everything's so fucked
right we can't even find the
architecture for these
things it doesn't seem to match
this are these these real things that
exist anywhere
else oh pm4 it op
codes actually what's so funny is it's
these same op codes I have heard this uh
it's the same op codes in
Qualcomm you know adreno or the Qualcomm
GPU is an anagram of
radon
I think I'm getting obsessed with these
packet through things I don't think
that's really
true 32 P oh my
God this is actually just an assembler
like a
disassembler you have to go off results
not promises
yeah no 9 months zero technical
information from any one of
it's a culture
problem the best they would do was link
me to stuff that's toy
public and I've been complaining about
the same stuff for N9 months so there's
no excuse It's like you gave him a week
no I didn't I gave him n months
you know kind of the beauty of
um a lot of the uh compute stuff is most
of the complexity in gpus goes into the
GPU not into the Computing the Computing
is much
simpler
well when the mees crashes with message
like check out that other
tool container
file
oh have you seen my work reverse
engineering the
uh magic number oh I don't think this is
the same yeah this isn't
right this amdu code info is for the CPU
it's not
fair all right so we're back to good old
FW info
what why do you side
fault
um
oh it's because I didn't put Li shit
shit shit shit shit in front of
it
for
so those are the different like
targets you can load it through
different things I bet you you think the
signing Works who thinks the signing
Works actually there are all these
functions to print the headers we could
probably just compile them but this
doesn't look all that
interesting
is this useful for tiny grad
or an equally appropriate name for this
dream would have been
like giving up on AMD
gpus
um it's cathartic for tin no I've been
really I've been really angry the last
two
days
like I had this idea you
know I'm going take a uh take a
10-minute break and we'll get back into
this um glad we got a lot of viewers
that's
cool well we can try flipping a couple
bits but we really don't even know how
to load the firmware yet
we'll get there there might be a CRC
there might be a lot of
things um we will uh we'll get
there no I don't know I kind of feel
like this is what I want to do for the
rest of my weekend who
thinks I I wish I wish there was some
light at the end of the tunnel you
know I would bet quite a bit of money
that if I spent the rest of the weekend
on this by Sunday we understand these
things
um what does it get
us on Monday we dismantle the AMD tiny
boxes we take the AMD gpus out we put
Nvidia gpus in we sell the AMD gpus on
eBay we try to recoup our losses we move
on
we're here you miss tiny T you you'll
miss tiny 10 how do you feel about tiny
10 with 409s in it better tiny
10 call anything I want tiny
o you code start
address what's a
toin is AMD Pro different not at
all like the the W cards they're the
exact same thing some of them just have
more RAM
what all reduce were you getting uvn
wrote it 12 gabes a second across across
six which is quite
good
um no but it's
like it I'm down to put any amount of
work into this it's not a question of
the work it's a question of just the
disheartening nature of knowing that
we're going to get to the end and we're
just going to have a black box right
it's not a question of complexity sure
you know we could reverse engineer this
but like come
on um like at that point well actually
I'll say what it really is the reason
why sure we're having fun on the stream
it's
cathartic but the problem is reverse
engineering is not it's not sustainable
and it's not something we would have to
do if we built our own
Hardware
um oh make a pull request to Tiny grad
to be honest I'm not sure we'd merge it
the T Tor accelerator looks very
different from anything else that people
have and it's not it's not remotely
competitive it's not even competitive
with an Intel
GPU um they're going to fix it but like
the truth is you know I I can't sell a
product like that's not dollars per flop
competitive or dollars per gigabyte per
second
competitive um no tiny gr originally
tiny cor before it was a company we're
originally going to do a contract for 10
store um
yeah yeah in some ways that would have
been
nicer probably in a lot of ways
instead no the the main problem with the
10 stor accelerator is not even the
compute it's a lack of ram
bandwidth and a lack of well it has the
same PCI interconnect but I don't know
how all that
works I don't know if it's pcie4
pci3 uh like to be fair with the gpus
they do have working like this stuff
does have to work to an extent for
games
um do big corpse get better software
under NDA no that almost never
happens um there is no like better
software what big Corps might get is
support but their whole method of doing
support seems very messed up to me and I
understand this is how the games work
too
that it's like you report a bug and
they'll assign an engineer to fix it
which
like is fine if you're hitting obscure
bugs but none of this stuff is that
obscure there's a ton of stupid
complexity
here
um yeah and
again you say that I'm I'm just
shitalking and say George you can't do
it better like compare our user space to
the whole user space of
AMD we we succeeded at that we succeeded
at cutting out the user
space give us another couple months we
could succeed at cutting out the kernel
driver but then we're up against we're
up against
firmware which is not only
signed it's not only closed
Source but it has no strings and it's
God knows what instruction
set like do you know how much effort it
is it's doable do you know how hard it
is to reverse engineer something when
strings returns
nothing just build a big wafer with
multiple risk fives um I actually think
T torrent is also designing for a
paradigm that doesn't exist yet I think
it's interesting to explore but it's
much more of a research
problem um if you're designing more for
Paradigm that exists
today like even CIS is pushing
it um sis looks a lot like T
but all right give me give me a 10 15
minute
break and then we'll get back to this
we'll try to figure out how the firmware
loads how the firmware
executes there's got to be some sort of
like have we really found a bug that
stopped of viability of AMD Tiny Box
yeah you you you run the resed net
trainer and it'll just freeze after one
of those steps am AMD tells me they
can't replicate it like the guy trying
to like one of the guys trying to
replicate it has like his Rock am
installed in the wrong place and I'm
just like I'm not I'm not amd's unpaid
QA team right like like if you want to
send me a tool if AMD again they gave me
nothing if they're like oh here use this
tool it'll dump out a binary file every
time the GPU get gets into a bad State
and we can look into that they didn't
give me anything like that I don't know
if they have it or if they're just like
you know here's another here's another
hypothesis right let's say you're AMD
and you're evil let's say you're AMD and
you really don't like what we're doing
right you're AMD and you you want tiny
Corp to fail you don't want anyone to
use the consumer gpus you want to push
your Mi platform what you do is you
string us along and lead us into a place
you know is unsustainable right I'm not
saying this happened but I'm just saying
like
yeah uh no I mean
the BIOS ROM I want no it's not it's not
actually malice it's it's yeah it's
incompetence
but could also be that the hardware is
messy and they don't want to show that
well if it's
that I'm going to say if it's one of two
things if it's that they don't want to
show it well this stream is going to get
more views than any source code they
release if they if they quietly released
the mees and the CP source code that
would get less views than the stream is
going to
get uh so I'll say that to that if their
concerns are about security if their
concerns are actually about
oh we have some security like threat
model kind of thing I will find an
exploit by Sunday if it would convince
them I think the consumer cards are
competing against Nvidia consumer cards
yeah they are they are and you can see
what percent of the market AMD has
right um no I don't think they're evil
again I'm just saying that if you were
evil would you act that
differently again I I I'm thinking back
to all my interactions with them you
know I had I had four meetings probably
probably 100
emails like they gave me
nothing they gave me some some beta
releases of their
software I don't want that I don't want
binary block that's just here you're
unpaid QA te figure out if you fix the
uh the the the exploit right don't say
exploit them obviously not everything
I'm doing is on my own computer it
doesn't affect AMD right it's it's my
it's my
Hardware
um all
right short break and then back to
work I don't know I'm losing enthusiasm
for this
to It's just sad just
sad
e
e
e
e
e
e
e
e
e
e
e
e
all right we only lost 100 people
okay what's MC
extractor no this is the wrong kind of
micro code this is this is for the uh
this is for the
uh
CP all
right
oh
PSP ring
submit right frame is pointing to
address out of
bounds
interesting so when I cap that firmware
adastation
thing
huh
that's
interesting okay so let's label what all
these things
are
um SMU
is system
management PSP platform security
processor pay rules firmware
validation
another lowlevel security
tasks okay what's the
dcn display core next so that probably
handles the
uh I didn't I see some crap at the dmu
as
well
DM via PSP oh now we know what the PSP
is okay we load the dmob firmware via
the PSP okay that makes sense cool I
understand those words
now just immerse yourself in the
language you know I
remember the last thing I got like
obsessed with was the
PS3 I just
remember going to sleep and like
thinking about the PS mysty and all the
things in
it
yeah you think the PSP is
on well that's
exciting that you know for sure how for
sure do you know
that wait it has strings oh it has
strings
you can Google it it's well
known oh well this is very
exciting
okay there's a lot of research about the
PSP oh you looked no
no no no no no again careful there's the
PSP in the r AMD epics and there's the
PSP and the GPU now they may be the same
but they also may not
be you know on the you're talking about
the CPU thing yeah yeah yeah but there's
also a PSP on the uh on the
GPU it's possible it's the
same it's cool that there's been a lot
of research on this though like
sometimes you only need one to like
start to get
in I mean what's so addictive about this
stuff for me is
like oh yeah that's arm you're right you
can spot arm by all the ease you see all
the ease there so this is actually arm
okay awesome let's start taking a
look
uh
arm cortex
A5 is that a cortex
not that different I know like cortex is
a bunch of
instructions okay this is on
see this is what it looks like when you
guess it
right like just like a like a thing that
actually like looks like
code uh
cool all
right um so I think what's cool is if we
break the PSP we break the whole thing
right now to be fair if it's shared with
the CPU it may not be so
vulnerable those things are actually
probably pretty secure and audited by
good
people we probably much more likely to
find a vulnerability in the
uh Falcon code whatever
shit the more obscure something is the
more likely it is to have
vulnerabilities PSP reverse but no I
have an idea the CPU one might be the
same
I don't know no I don't think this is
true see like how different it looks
let's just take my firmware info tool to
it okay so why is there an SOS and a
TA no they're they're very
different um
[Laughter]
wait um by the way the thing about being
sued is
uh I I can't like literally what I'm
doing here is working to enable
interoperability uh with my uh deep
learning
library right you know the PS3 you can
say it's like piracy this is literally
to enable interoperability they'd stand
no chance in
lawsuit um
also uh I'm not uh I'm not 21
anymore you know look look at look at
remember do you guys remember what Axel
Nicks tried to sue me you know you you
can ask axxel Nick how that went for him
um don't sue me don't sue me I really
don't take uh take kindly to
it no I mean there's nothing illegal
about reverse
engineering uh most of
the shrink wrap license Agreements are
not uh I mean they're they're valid in
certain
circumstances but reverse engineering
for interoperability is a well
understood protected
uh protected thing I'm also like I'm not
a bitch like you
know um so many people another thing
like you see it all the time people are
like you can't use Nvidia cards for
commercial
purposes uh yeah you can you can you you
can totally use Nvidia consumer cards
for commercial purposes this is not
remotely prohibited and Nidia has
something in their Cuda Ula that says
it's not licensed for data center
deployment nobody has ever as far as I
know been sued over this Nvidia is never
going to sue anybody over this I'll tell
you exactly what Nvidia is going to do
Nvidia doesn't want Azure rolling out
409s in Azure so Nvidia adds that Clause
Azure is like well shit we don't want to
upset Nvidia and it would actually be
really stupid I mean like Azure is not
going to start to roll out 490s because
then they're not going to get allocation
for H 100s it that that Clause has been
so misinterpreted to think it targets
like a little person I also think that
um Corey Doo I read his book and usually
I like a lot of Cory Doo stuff but he
thinks that a lot of what holds back
like digital interoperability is laws
around reverse engineering this just
isn't true um I would be happy to
reverse engineer whatever for
interoperability it's just
annoying
like it's annoying it's also hard to
really do for Comm like once you start
doing it for commercial purposes but um
reverse engineering for interoperability
of Open Source software super well
understood to be
uh to be to be
good wait we're going to get the aces in
the comments we're going to get the
actes in the comments for this video
also like what do you going through life
so scared about what do you think
they're going to take from you you
know like I've set up my life such that
if you actually were to sue me and win
serious stuff you're not going to get
anything um you want to build stuff this
is just generally good advice right if
you have $100 million in a bank account
you're just a straight up Target right
someone can take that $100 million from
you and this isn't even just about
lawsuits this is just about anything
this is about whether people are going
to try to scam you this is what you want
to do is set stuff up that it's very
valuable if you're there but the minute
you turn adversarial to it it becomes
worthless um using a 49d with sirv well
I mean there's other things in the 409s
that are that are that are blocked in in
nvidia's I'm not even sure it's their
firmware it might be
euses
um
uh but yeah no if you want to um reverse
engineer for
interoperability uh by all
means it also comes down to like you
know another thing to always realize
about the courts is the courts are very
uh are very reasonable right like people
think they're going to get away on a
technicality right people think like oh
well you know like the recent Nintendo
lawsuit with the UL right like yeah
emulation is legal if you have a patreon
where you're making tons and tons of
money in a Discord where you're telling
people how to Pirate
games you know you you you uh you get
what's coming to I'm not saying it's
okay I'm just saying like you know the
the courts are very
capable uh of understanding
context um you know in this case the
context is that I spent uh $70,000 on
gpus that are uh you know
buggy they don't work with my open
source deep learning
software uh can some employee dump the
docks in firmware no that's illegal um I
mean it's illegal for that employee uh
could it be a hardware bug with no clean
software fix very possibly yeah uh but
see at least in if if that's true if
something's a hardware bug I'm much more
open to like mitigations and workarounds
where if something is uh you know just
uh screw you the software is
closed I'm less
interested okay where were we so we have
two PSPs we have the SOS and the TA
let's try to understand what those
are
actually that's weird wouldn't you think
that the thing has
to reference that
somehow good night after work
Tech
so I don't understand you have this SOS
and ta
thing oh
here we don't read patents unfortunately
uh in general your lawyer will tell you
don't read
patents
um okay we have the PSP SOS and the PSP
[Music]
ASD all commented
out which ones of these do we
have
here we go we have SOS and
ASD and that actually looks kind of
bugged it looks like that doesn't read
correctly
actually
all right let's start with the
strings what's an SOS and what's a
TA PSP key encryption key
data for
signing raing
data
it's not going to be an AMD r
like I said it's it's mostly just sad
and the stream is mostly just
cope
no strings in
there this one has a few
strings what's the
vcn code
page
Handler video core next um hardware and
decod media engine you
know what dma stands for know dma stands
for but what's sdma system
dma all right this is kind of cool here
a list
here system
dma our GC stands for graphics and
compute
okay PSP
dcn St next
okay oh I see wow okay so the CP inside
of here is actually a ton of different
bullshits why is
that okay the pfp the me I finally
finally we understand
um no there's not actually some lzma
stuff whenever it detects that it's
never
real okay I shouldn't be totally sure
about that but try decompressing it and
see if it
uh oh okay this is pretty
good I don't know like again even if AMD
like why did you jerk me around you know
why do you give me bullshit like why
don't you just like like it's like it's
like secretive for some reason I just
don't like that I don't like that when
like companies are like that like this
is actually cool to be fair I haven't
really looked that much into this
stuff
micro container files no no we know what
those are already also no it's not that
that's the other kind of micro code
notice how it says
CPU the firmware that runs on these
microcontrollers
right all right so we have another thing
here called
The Run list
controller
for
all right what's the
IMU we can probably go through these
things and just read the driver and see
if the driver kind of like describes
what they are anywhere it should all be
in
here don't talk to the company read
their
shit you know you got to just just
always remember that
lesson
um like they're not going to help
you
I oh
no like this is dumb I don't want to be
doing
this great all these stupid acronyms
like I should just be doing this
for
video go work on my uh my
Cuda rip the user space as Rip the user
space out out of Kudo like we did for
AMD all right that's the real that's
that's that's that's
fun
um all right well at least I'm
entertaining 1500 people hopefully
you're
entertained not
entertained I'm
sorry I want to listen to copyrighted
music
hey you know what after work Tech is
asleep this isn't the copyrighted music
now listening to Creative Commons chip
tune new music under
creative
e
e
e
e
e
[Music]
crap music is at least 3x louder than
me
uh I think yeah oh this is cop you have
to get rid of the
copyrighted
um
wofi creative comment
do we think it's actually no
copyright
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
how do you just build one module in the
colel
tree
alt CIS request
F oh here we
go Hardware Vol I don't care about
that oh there we go no oh fucking
control C
the final IM just use the M kill all
make come on make
die why don't they just set the keyboard
and SSH to very high
priority we don't have to do fault
injection guys there's 17 million
vulnerabilities in this thing it mostly
named it finding exploits just to just
to clickbait
people wow the music lost people come on
come
back I just needed the M I just needed
the M
argument I just needed an
M now we have that
crap kill all
make B CIS request F okay here's my
keyboard I know where f
is all I don't know where sis request is
PR screen
does this work through
SSH I would try to go to the computer
but I'm going to regret
that oh not over SSH well what good is
that all right we'll give it two more
minutes then we'll hard reboot the
computer
and remember to not throw so many js on
that bitch sometime you just use too
much JS
man we'll reboot the
computer it boots
fast I held down the power
button
why
reboot how do I press those keys over
SSH and which is the print screen
key I got to go find a
keyboard I hope it
reboots if it doesn't come back that's
just the end of this that that's that's
a good place to stop and give
up
yeah yeah
[Music]
not
bullish all right we didn't hard reboot
it let's give it a hard
reboot
come back my computer come back it's
right
here no to reboot over SSH no that's
not now the host is just down I don't
know if that's
progress we back boys we back
oh W we're so back we're so
back all right what lesson did we
learn don't do too many
Jays don't do too many JS all right
let's build
module
uh four is not too many JS
[Music]
right all
right
it's concerning that it's building them
here one J for two gigs of RAM is quite
safe I don't think so I only have 32
cores and I do
have yeah that's not a safe that's
that's not save JS all right all right
all right all right all right fine 16 JS
fine
because when we use btop we love btop
btp's the nice as top I mean it's not
actually as useful as htop but it's
beautiful I think that's what the b
stands
for wow that's pretty hot
CPU
for some reason we're building like no
vu in the world oh look at all this
crap oh
no wow look at all these these
O's I'm going to push my uh my
notes
[Music]
error
um I don't know I think we probably have
to
just make
everything that's not
good all right how do I just build one
module why doesn't this work how do I
just build the AMD GV
module we have to find a good way
here let's check
config yeah our DRM AMD GPU is
m
so how I just build
it an inry kernel
module
oh by the way we can't that's kind of
annoying that we can't get diff that so
wherever I put in that stupid
uh think we're g to get a fat
PSP build GPU current
module
BL we should be able to find the
module so what if I just do
this all
right can have a few
more
no okay I mean that's
not I don't know what Mr proper is but I
remember that you had to type that
sometime when you were making
kernels let's make old
config now let's make
this but only with
j16 what is this
happening can get your config oh
here
Mr
proper make old
config make that
same
SC prepare modules
[Music]
prepare why is this
happening
Debian build how do I build in the
Debian system they were doing like some
fake root
garbage
prare the build
environment I'm at primary table
Undeclared all right let's start
over do not use APG
use the fetched
archive no we're using App Source I
believe in app
Source only pain you will find
why
oh here okay pseudo app stall Linux
source what is it your name-
R cannot find any package like that
Linux source
that
Target user
Source Linux source
why is there a VM Linux
there all right unar the whole stupid
kernel this doesn't even exist
anymore
to replace this with
that actually not even just that I want
to go into
AMD yeah that's what we want to be
that's where I want to be
yeah
all
right make some shit with only
ajs all
right copy current exported kernels
module
make
uh let's just make AMD
GPO
this looks good all right I think I
think good W this is this is a
useful this is the only useful
thing oh yeah look at them MBS look at
them MBS MB m m m m
mean it's building it in tree which you
shouldn't build in Tree in tree builds
are no longer
supported but this would be cool if we
actually have a way to if we can just
ins mod that that would be
sick
so sudo rmod am
GPU
we don't have an AMD GPU right now
because we're building it with a
reasonable amount of
JS okay module only Sim
bars
I thought I did that I thought I copied
that thing
in VM Linux thought I was
missing mod post
what's Dash C does that do
something
no try
that
no rule to
make that Target needed by mod
final okay
um maybe this
works
oh canot open output file is a
directory oh does that
exist
sick all right
who thinks ins Mod's going to
work sudo ins
mod
sweet uh all right let's do
make followed by that and now let's
change a string and see if we actually
got it um
um okay what if we change it to say
loading D MB MB M MB
firmware d m m m MB firmware let's
go f my shit
Bitch T firmware yeah buddy all right
good we got our own Linux Colonel module
we are we are fucking with the
colonel at low levels this is exciting
this is a celebration this calls
for do we want another highball I'm kind
of feeling another
highball we're going hard these are the
old days it's like the old days you know
what's that oh man all right look it's
it's fair use man we just got to watch
that clip you know that clip um oh yeah
yeah this this is this is oh
yeah I wish there was a way to know
you're in the good old
days before you've actually left
them someone should write a song about
that no there's a lot more to it than
that too he's like you know it used to
be the old days where that's that's
that's the man it's my favorite Andy
grard moment normally I hate the guy but
you
know
a second highball but we're also going
to get a Second Spin drift to cancel out
the high
ball
you can't just be drinking high ball cuz
you're
thirsty let's
go
okay
so let's start taking a look at
where where's that shit where I'm
talking to the
PSP seems like a good place as I need to
start
right PSP earon net which PSP IP version
do we
have
set PSP
funks
um wait for boot
loader ring
shat is this
working
to help a
function here PSP command here let's
Okay PSP ring command
submits par
pointer
throw print K in
here how often are we talking to the PSP
let's find out oh wait no no we want to
First do an RM mod in
here
perfect I actually love that I can
remove and insert the module like that
it's very
useful all right all right look at all
those PSP ring
commands what do you think we're saying
to the
PSP like they say on my favorite
television show let's find
out CMD CMD command ID we look for
submit
buff where's my print
k
why is why is right clicking not working
why is that not working that's really
annoying that that's not
working let's try this loading it
again okay we go good good good good oh
yeah
all right do we put that print out print
K in the right
place Bros oh yeah did I mentioned how
much percent of hacking was just print
statements a lot of
it all right talking to the
PSP wow that talked to the PSP
too all right so we're sending a lot of
sixes but some
32s let's take a look at what those
actually
are oh here we go look at this PSP gfx
command name oh that's
useful this want print
k wow we really have a good work
environment when we can do things like
that oh yeah look at all them load IP
firmware
sexy all right so who does a load IP
firmware here we go oh uses
reinforcement
learning so there's one that uses
reinforcement learning and there's one
that
doesn't you know what somebody actually
will really believe that it uses
reinforcement learning like if you were
a Nob watching this stream you might
really believe that you might really
believe that
the okay um PSP prep IP Lo firmware
command buff all right let's just throw
a print K
here with
this firmware type and U code
size oh wait I think we get the firmware
type
there reinforcement learning for
register calling it sounds sick
BR wow when reinforcement learning
starts to work that's when we should all
fear
AI all
right so now we have all the different
firmware
loads um what happens if I go back to
that thing where I don't uh
remember when I was trying to not trying
to not use the firmware use the
PSP think that works how do I ins mod
with arguments what's that
argument oh wait is this just the only
function we're in
here I'm not even sure these are
bootloader loads these might not even be
IPS boot loader load component oh look
at all these
components you think they're all
properly
signed
um
all
right well that's where all the firmware
gets
loaded this guy I gave you money I
didn't even acknowledge me what if I
just banned him would that be
funny
I wouldn't do that to you auga but don't
think you're you're entitled to
attention for using your Prime sub on me
if you buy someone a subscription like
ice Leo and
JIS you can ask a question they've
actually bought people multiple
subscriptions ice Leo has bought 36 and
geris has bought
10 those are people who get attention
you with your Prime subscription don't
get
shit George you're being ungrateful to
people giving you money I'd rather be
poor then be grateful for your free
Bezos
money s a potentially interesting DM on
Discord what do we got what do we got
don't make me regret taking my phone out
for
you
[Music]
whatever that is I don't
know whatever that is
uh yeah
uh this is this is
yeah uh if you can't post my general
rule is whatever you can't discuss uh
publicly like like dick pics uh you know
if you're not willing to show your dick
to everybody I don't want to see your
dick but if you're willing to show your
dick to
everybody uh we might be uh we might be
interested um that's yes that's my
euphemistic way of saying uh we only use
public
sources uh you know when we're reverse
engineering we don't use private
sources
for all sorts of various
reasons but yeah no I mean like look
this is this is all what we're going
through right now is not just uh it's
not even this is this is the actual
Upstream Linux
kernel
um you know so as far as uh this is even
reverse engineering at some point uh
this is just straight up
engineering
okay reload the
SOS copy the secure o
binary ooh o o
[Laughter]
ooh
Okay so
yeah let's let's let's take a look at
this function I have some
theories there might be some handshake
with the hardware which needs DeLay So a
common uh trick you can
do is you like let it verify the
beginning of the firmware and then throw
a mem copy in like right before
it um like like let it it's marching
down verifying if it's not very careful
about the order in which it uh you know
does the
memory let's even see if we're hitting
this okay okay we're hitting the
bootloader load SOS which is good uh
where's the TA thing too we also have
that but the SOS one's the one I have
here um so this is reverse engineering
but is of course it is for the purposes
of interoperability with the custom
firmware that we're going to make in
tiny rat that's going to be sick uh you
know we love talk to bugs
um copy secure o binary to PSP memory
let's see where this PSP memory
is
we're only supposed to use One
X all right
what oh don't tell me these are like is
this like corrupted
junk I don't believe that's
right
is it like messing up the
pointer I feel like there's like some
like Linux like pointer off the stuff I
don't know if that's that
but no no no we want hhen
what why are those pointers
weird does Linux have like does this
have like things so it doesn't leak the
uh there's no point of confiscation
okay oh maybe it just didn't build I
don't
know
okay
so um you have these things in these
systems called a chain of trust so you
can see that if we could figure out how
to
uh how to smash the uh
PS
p all right so let's
[Music]
um I don't
know what do you think of
uh 1
three let's just throw some leite in
there the PSP is not lead enough we're
going to make it slightly more
leap uh make PSP more
leite let's see what
happens oh
void okay
oh we can't insert it because I didn't
got rid of the arm
mod
there is kslr yeah it's not aslr though
okay we got some uh some exploit what's
this PSP load SOS
failed it did not
like
okay yeah it didn't like making the PSP
more
Elite um
all right let's not make it
more you think mod works you think we
fucked it we got to
reboot
no PSP load kdb
failed can we reset the GPU
maybe no we can't because there is no
GPU let's try one more RM mod ins mod
cycle we'll use the PSP all right
well now we're we're in a bad
State PSP
load kdb
failed all all right let's try a good
old pseudo
reboot part of the reason that it is
nice to use this and not a tiny box is
uh okay
so what we're going to try next provide
the PSP secure OS to
Bootloader uh
where are we going to get the
bootloader it's a little annoying you
know what I have a copy of this code
here
too so we can look at it while we wait
for it to
reboot maybe I don't
be back soon uh we're going to look at
what these
um these things are doing
here primary MC
[Music]
address oh I should kept my magic please
be in
history
history
reconnecting to SSH come on you can
reconnect
questionable
blurry that one's
connected this one's connected
keep that magic
line do we have an understanding of
whether it's the same probably share
some code but one of the differences
between that PSP and this PSP is this
PSP is loaded by the uh why do they
write it like that that's so much
cleaner
[Music]
um so let's see
here reg
mp0
great I love that name the these are the
most useful register names I've ever
seen AMD thank you you put it in the 36
and the 35 of course they don't want to
tell you which it is
um all right let's first check uh clean
normal
build
all right seems
good we're loading SOS all right
there huh notice how those became that
one became normal
that one's still hella
weird why is that address weird it's got
to be a normal
address there's a definition for psp1
Meg is it like a different
Meg the PSP one me
guys
um you a trust memory
region yeah I mean but that's the
opposite
of
okay
so let's just move this make PSP more
Elite I really have no idea you know
what no no before we before we start
doing that um um let's let's hex dump a
little bit of
this uh for in I don't if can do that
actually on a colonel like put my
variables up there or something and IAL
z
i
let's try it
out let's take a look at where in the
PSP that actually
is
okay
so let's take wait a second you know
what occurs to
me what would happen if we actually did
corrupt
it see what I'm saying like what would
happen if we actually did we didn't do
that very
carefully
uh no we can't we can't just oh we can't
think that happened that would be too
serendipitous all right let's find this
string
24 50 53
okay here we go is that
it no it also appears there oh it's
PS1
oh that's probably that first one
actually one that's
26590 no it's something
different all right A2
F5 17
C that right before
that this doesn't look like
code I'm skeptical but wait this is that
well this is definitely
that also I should not have put that
slash in there
there's not the space
after 23 like that's so
weird 24
there okay so that's this is the
address
this is the start address like how weird
is
that see what I'm
saying why is that the start
address this barely this isn't even code
this isn't
code this is code
maybe not code it's like a signature or
something
these are
Pointers oh man I wish I knew how to use
[Music]
gidra
point
no that's
code it's not
code oh maybe it's just different
code
oh I wish I knew how to use
gidra disassemble arm there we
go
okay copy PC to R4 does that seem
plausible at least they're
pointers kind of in the
right
area copy secure binary here how big is
it this is the
size
stops IT random crap there that doesn't
really make
sense these also that's
not here we
go actually let me I should do
it um actually let me just do we know
it's that so we can do
that and we make this
larger and let's make sure these things
line up I love that we have this fast
workflow and we can actually just do it
like this and not have to like wait a
minute and like write helper scripts in
Python and
shit
okay so according to
this
26960 should be that
26960 is yeah C5 DB bullshit okay good
um but it's not to we get to here that
we find
jumps um this is good okay we just
disassemble
R f11 do I even have it that's not
f11 that's F12 but f11 does something
else who made
these
clear no if I disassemble it for some
reason it defaults to fucking
thumb I'm sorry I can't use gidra I'm
sorry I'm
sorry all right so these are like the
PSP functions that looks like function
oh those look like these look like
interrupt
handlers
okay
um yeah it's like something looks like
something TB blah blah blah blah
blah looks like an irq Handler right
that's actual valid arm
code
uh
is there good are there good pirate idas
actually bought item once
guys all right provide it to the
bootloader so
like
Prim MC
address darn just just just why is that
a variable why didn't you just put
that yeah oh here we load the SOS driver
we load the cyst driver o debug
driver I don't even care about the PSP
man like I wouldn't waste time with the
PSP if I didn't really think that I
needed to do the PSP to get the other
things this isn't the firmware I want to
change oh there a bunch of North Korean
idas with
malir good good looking
out now fail overflows radium Tools
looks too
old also I mean the PSP is definitely
hard
okay so
like oh let's overwrite something
useless we know that like that number
might matter we know that like this
number
doesn't
40 where might make the PSP more I know
40 what's a hex
28 can't hex a floating Point
number let's try it down
here
who thinks it
loads okay it loads fine
there let's do some timing on
this make more
wheat so we might have to it might be
this weit for thing handshake issue with
Hardware that needs to lie out I wish
they gave these registers names and
didn't just call them
81 so all for for those who are who are
catching up um well the processor that
is secured for security is more secure I
mean it's not the point so the PSP is
not just a security processing the PSP
is responsible for loading all the other
firmwares like you can see here so
notice how this make more leite is
happening uh almost 100 milliseconds
later um
so let's move this after the M delay but
be for the wait
for if there's going to be like talk to
things it's
there it's probably smart I mean this
probably doesn't
work
okay well that surprisingly
worked
uh let's get rid of
this let's move
that so like eventually when I put it
before the move to
secure okay that causes an issue
again unfortunately I think we have to
reboot to get out of
this uh
yeah there might be handshake issue with
the hardware that
needs
delay so probably what we want to do is
try to find this boot loader um it's
possible that these registers don't
actually do
anything and let's I mean we comment
this out I think it breaks again
I think like once the PSP doesn't load
correctly once we have to reboot the
computer yeah so we're back to
this um you know the best way to really
understand a system is to try to break
it
SOS fa that's what we got last time one
more
time glossery of terms
CPU watch out AMD makes CPUs that all
have the same crap
to PSP load kdb
fails so it's interesting that what's
failing now is not
this fot loader load
kdb um okay let's reboot and let's take
a slightly different T let's see if we
can bypass the PSP for loading the other
firmwares because that's all we really
care
about um let me
find what should we do while we wait
uh
so
so like I said it's not really a
question of what's more secured it's a
question of like what the boot chain
looks like and if you attack lower in
the boot chain it's usually easier not
always true I we could probably find the
signature checking stuff in here if we
look hard
enough this one at least has a few
strings um we can look at what this sign
checking looks like like but yeah
usually what I find with these things is
like trying to attack the signature
check is not a smart way to go what you
want to do is just look for
uh top tow is usually pretty good like
the trick is to modify it in a way that
the system doesn't expect so the proper
way to write this is to M Copy at once
into secure memory and do all the
checking there and it's possible the
bootloader of that so maybe what we want
to look for for now is to see if we can
find out uh what the uh bootloader is um
also another interesting thing is they
say they have one megabyte for this what
is that one megabyte is that one
megabyte SRAM on the GPU are they
wasting a whole megab I guess a mega
SRAM is not that
much um I've looked into this stuff on
on Qualcomm processors they have this
thing called the XL
SEC and then they run all these trust
Zone things in
DDR but you
know uh they run all these trust Zone
things let's give the computer a minute
and then we might have to show how to
reboot it um they run all these trust
Zone things in DDR and they have this
thing called I think called Pym they
like encrypt a certain bit of memory but
it's not just encrypted it's so it's
it's
clever I don't know how Qualcomm ends up
with such good Hardware when like their
salese and Leadership seem
incompetent I totally understand how
Nvidia ends up with good
Hardware you just see how excited Jensen
gets by the good
Hardware
um we'll hard
reboot it's a little Annoying that every
time
um so probably what we want to
do maybe we can find like a reset maybe
we can find like an actual hard reset
that we're just not
triggering
um you know some you can just get these
things into bad States they don't expect
the uh the PSP firmware to be made more
Elite and we're also just like blindly
doing stuff right now we we have to have
a better understanding of exactly what
it is we want to do um uh so you know
this is this is hacking now we spend a
lot of time documenting okay so we found
all the things that are loading the
firmwares right we can start documenting
what each one of those firmwares is um
and then there's a lot you can do
without even modifying the firmware
right so like do we have to submit
command cues to the mees or can we go to
the can we go to the CP right do we
still have the API of the
CP um what resources are these things
allocating right a ton of this is just a
documentation process right now again
wouldn't it be nice if AMD just released
some
documentation like look you know my deal
is all the firmware going to be released
and buildable by Monday no but if you
release some serious documentation on
what this shit
is uh you know start with one firmware
like show me something because right so
far you've shown me
nothing it's been nine months of
platitudes and bullshit and a broken GPU
and you know we can't do nine more
months of platitude and bullshit some
broken gpus I can't shit these to
people AMD roast is the title we're
finding
exploits
um wait why is my computer not booting
anymore guys we broke it
forever it's never coming
back okay no more no more making the PSP
more Le I regret doing
it guys we've tripped the we've tripped
the we've tripped Samsung's KNX they
licensed Samsung's KNX
technology the Intel arcs docs are great
they
are no they are
marginal I would not say the Intel Arc
docs are great there's definitely a lot
of them they're very
comprehensive they do document a lot of
stuff that that AMD just
doesn't um Intel also has finary blob
firmwares all over the
place wait so why isn't this booting
like what's going on what are you doing
that's not booting right
now what are you doing that's not
booting right now can we ask this
computer what it's doing that's not
booting we got to do a lot more reading
and documenting before we just try
things again I know trying things is
exciting for stream but we're actually
just reading and documenting all right
let's leave the computer off for 10
seconds 10 9 8 7 6 5 3
1 find more reading to do on
amdg all so here's the firmware load
type shit they had a secret oh we should
try the firmware load
type this is an old version l
colel
there we go this is nice sweet compter
back okay
uh we didn't we we took out our making
the thing more Elite right it's only I
don't have get on here too we got to
improve
our
okay we're not making anything more late
anymore the litness is cancelled uh why
does this one not
reconnect that's annoying close that new
window that okay no more no more we're
not rebooting
again
okay it's pretty good we can we can
comment out ghetto hex
dump we have a lot of just normal
reading to
do let's understand what this stuff
is okay oh include Asic
rig was probably not even that one it
might even be
this
one which MP do we
have what's an MP do we have an
MP don't
know
CM message so this is probably like some
like yeah boot loader
crap kdb
binary what's the KD
be
PSP
oh let's try okay we commented that out
let me try the
flag um amdgpu module
Flags module parameters uh where is that
one there's the one that talks about
using a
PSP
load here firmware load
type said something exciting about a
back
door um this for direct
loading default loading mode for the
ASAC firware load
type didn't like yeah I thought I
thought
RLC back door autoload oh
yeah you want to try
two still call the same still called the
same load IP
firmware let's try direct loading by the
Asic I think that one didn't work last
time yeah we got
this direct loading by the Asic doesn't
work whatever but we don't break the
computer when we do that one it's the
most important
thing by the way
I think
that the firmware stays the firmware
unloads itself so if we do this is at
least true for NVIDIA if I do that yes
see it has to reload all the
firmwares it reloads the firmwares every
time you
um wow it even reloads the
PSP PSP is presuming the sh is just like
inid and kdb sure sounds like Colonel
debugger
right um so this stuff's fun too like
what's the PSP
TMR um oo backdoor firmware loading path
for PSP
TMR Reserve TMR m memory which
holds IP Discovery data and is protected
by
PSP what is IP Discovery
data
TMR equals trusted memory region
okay let's add that to
my um things like that are usually great
things to
attack because it's in I mean it's in
the dam of the
GPU so like it depends like you can do a
good job with your memory controller and
it could be fine but I don't know what
happens if you dma to it right what
happens if you try to access it over the
pcie bus all those things get
interesting
okay
so kind be kind of nice to know which of
these uh we could turn that into a
string and have it print the name of the
[Music]
firware is there anything that will do
this for
me oh I mean this is cool at least at
least we can like see what's going on
here okay so it loads the two
sdmas it loads the
pfp it loads the me it loads the Mec it
loads the pfp stack
P1
God my
God can I get the file name
maybe where does I actually get this
from like the a disc or
something F
Type GPU virtual address firmware
location that's kind of interesting want
to print
that
if PSP is a cortex A5 that sounds right
okay cool so these are the
addresses
firware F command
High also G to switch the size to
hex again I love that this is fast and I
can just do that and I'm also going to
write 8.8 here actually I
08 it's like a big
shit
okay so these are them 44 there okay so
you can like see how it like kind of
ends
um I mean how much RAM is
this see if it can reasonably be SRAM I
mean it's
probably
oh you know it might not be
Sr this might be in the dam of the
GPU yeah that's not SRAM that's 222
Megs 212
Megs I don't know why that's
less but okay so it looks like where
these things are actually being loaded
is in the
TMR
um
so yeah probably the way
to we have to figure out how to disable
like this will also just just help us a
lot if we could just figure out how to
disable the TMR in
general like disable the trusted memory
region such that we can
uh we can look look into it oh this is
cool so this this is showing me all the
addresses
here um we should also have if we do a
lspci uh let me just find out which
device it
is oh let's fix
it update PCI IDs love it see now it has
now it says
radon yeah no it's pronounced radon
wellow it's also scario so there's
that wa
what is that invalid device
ID be a valid device
ID
work all right
cool
so uh this is because we have large bar
support so it's important to have large
bar you want your bar to be
big uh so that's like mapped
into this is just mapped into like my
host memory I can just like like green
right to Dev me right
there that shit
works like I'm going to guess that they
did a better job on the
[Music]
TMR um I spent weekends last summer
trying to get my 6800 XT to be useful
for machine learning and regret it got
everything working short of training
runs where I fell apart I bought a 490
and should have done so
sooner yeah
yeah you know and it's not going to get
better it's really
not
patch and cross buy if you want to do
machine learning buy an AMD GPU I sorry
buy an Nvidia
GPU I keep getting the names mixed up
just
buy if you want to if you enjoy messing
with broken firmware and working around
bugs consider AMD
gpus uh also don't like like talking to
AMD is a mistake I'm never talking to
AMD again I would appreciate if they
released some docks and some some source
card but like like it was a huge waste
of time you just kept thinking like like
I would think oh well you know have a
phone call we'll get the new driver the
new driver doesn't
work still considering Intel we're not
talking to Intel either guy came in the
Discord he's talking like a business
development jerk off like oh well let's
set up a meeting why don't you set up a
I set what what are we going to
discuss I said the only thing I care
about is if you want to give me a good
bulk price on a770 and he's like well I
can't make any promises well what what
good is
this you know should we just have a rule
no business development people in the
Discord like oh
God
I learned more in these eight hours than
I did you know in the last yeah don't
like like
like you how much we know about the
cars looking at this is this is the part
of the stream where we sh for
comma
250 plus cars are supported by op pilot
right and this is this is no small feet
we've we've
built we've gotten ados interfaces for
each one of these
cars doesn't support L we will how long
before we support
L
like all reverse engineered and we
probably understand more about these
apis than the
manufacturers I'll tell you why the
manufacturers couldn't dream of having
the data access we have when we want to
see if a can message is ever sent in a
certain way I have I have thousands of
hours of can data I just
look what's the strap for when the car
manufacturers try to up their security
G
um
yeah if you didn't read it this guy's an
exoma employee
um like again what we asked for what we
asked for from from comma users is if
you care enough about this give us
$50,000 and we'll break
it like this stuff's all easy to break
the manufacturer should just
stop like this isn't this isn't adding
any security I'm sure it's adding tons
of complexities to their internal
workflow they're not going to lock us
out like the really I can't believe
that's one of the pieces of fud I see
all the time in the in the fors about
comma the car manufacturers are going to
lock them really
bro the car
manufacturers apple and Sony with with
with you know h huge security budgets uh
couldn't do it but the car manufacturers
are going to do
it the consumers are making their cars
better shut it
down um no we don't I
mean yeah you know we we learned early
on don't engage with the car
manufacturers uh I mean look I'm happy
to by the way I offer a service now I do
it
personally uh 30 minute Consulting phone
calls and the minute you get into
anything personal or life device I just
hang up and keep you $1,000 but
um yeah Comm sells phone calls too I got
sick of doing the Comm phone calls
they're just so
[Music]
bad
um yeah all
right all right you want to document you
want you want to go through and document
this wouldn't it be nice if there were
like some like documents that explained
all the stuff about the GPU so we didn't
have to waste time figuring it all
out who calls for Life advice way too
many people way too many people it's why
the that's why the comma phone call no
longer says it's
me um you'd be surprised you'd actually
be surprised who has ,000 and calls for
like they're like they or they ask
personal questions like are you kidding
me um I'll answer personal questions but
that's the 10K tier okay you pay me 10K
whatever you want
man uh all right it's five
o'clock
uh let's push
this do we feel like we understand amd's
firmware
better do we feel like we understand the
CP now is the pfp the me the CE and the
Mech they're they're in God knows
what uh code except for the PSP this
one's
[Music]
arm chances you get another stream I
might do this again
[Music]
Saturday
do we really need to break the PSP to
figure out the mech calls uh well if we
break the PSP we can uh it's not that
we're trying to figure out the mech
calls it's that we're trying to like
figure out how we can how we can change
uh what these things are doing
right there's probably the PSP is
probably not the right way to go about
this actually um we'd have to have a
better understanding of what the uh like
security model of this thing looks like
um
are there are there separate tiers of
security or if we get one of these
pieces of firmware we get them
all uh like is there any is there any
memory
protection inside the uh inside the PSP
TMR or if we can figure out how to you
know just get any one of these um often
what you can do too is these registers
are often externally
accessible um so it's also interesting
that no it reloads the PSP every time
which is kind of annoying but you might
be able to just like so what you can
probably do um I don't know if the PSP
itself lives in
this probably not I bet the PSP is like
a higher is like a higher privilege
level um again we don't really care
about the PSP we care about figuring out
what these things are doing and figuring
out if we can actually ideally what I
want to do is turn them off um probably
a lot of these firmwares like the mees
we don't really
need um they do this stuff so they
talked about the reason they introduced
the mees the mes was introduced to deal
with these complex directex things but
like we don't really care about that we
can't do it all from user space but like
we control the entire application and we
don't have to support like an external
spec um you see see exactly one function
call from AMD GPU Mees but that doesn't
even say anything it's actually all we
we don't even know we'd have to we'd
have to start to figure out like okay
let's actually let's take a look inside
sis kernel
debug okay we have
events I'm going to dry
one I mean this stuff's interesting
right
like DP
this yeah like this is straight
up sdma
1 oh where's that firmware at station if
you try to cap that you get invalid
argument look at
this that's kind of
cool it's showing you where all the
doorbells are and stuff
what's in
RS um so it's also interesting that
these aren't
uh
um
oh the SMU is not done with my previous
command well don't try to dump the RS
because now the SMU is not done with my
previous command so you know you know
what's like again again frustrating I
don't know if I just wasn't talking to
the right people I didn't even think
about it like I guess you get stupid
when you think you have someone to talk
to like if you want to look for the
state of the GPU most of the state of
the GPU is exposed
here we can just figure out how to
deal so it's so
like
back in Polaris used to be able to
download the firmware and modify it then
in Vega they added signed firmware PSP
came with rna1 and tools like more power
tools stopped
working you just leak the firmware from
the internal GitHub don't do that um
again that I mean it's not it's not a
it's not illegal for me to use it but
it's against your contract to do that uh
do not I do not want any internal
documents leaked um in general right I'm
not I'm not you
know um I'm not interested in that uh if
they want to release the documents they
they they should if they don't want to
release the documents like that's on
them um leaking is not the right way to
do
it I don't want an open line of
communication I want
docks right by the way let's point out
the difference T tooren had two people
in this chat who were very helpful in
answering my
questions redis is closed Source now
don't don't give me this shit
um uh yeah no I mean that that I would
always appreciate I would always
appreciate it if someone wants to if
someone wants to come in into the
Discord and and come into the twitch
chat and tell me stuff about the
gpus I don't want to schedule a
Microsoft teams call tomorrow no I
don't like stop wasting my time with
that
shit Reddit reddis is actually closed
Source after giving my example of how
reddis
is
I don't even
know oh this is just trying to fuck
Cloud
people it's
stupid yeah Forks incoming great
great I don't know I don't know who runs
Reddit we're not going to judge I mean
what the cloud people do is
scummy yeah they removed thanks and
replaced it with
some what's what's SMU debug see that's
interesting
for
what does that reset
do
we probably have to reboot
again the SMU is not done guys the SMU
is still
working
kernel null pointer D
reference where's our dun what's the SMU
again the system management
unit what do we got in the SMU firmware
anything interesting was it arm or
anything that's not arm that's just a
lot of
zeros let's look at the one that we
actually know his arm and see what it
looks
like
oh I can enable the SMU debug option
yeah that actually looks like real alarm
you see the
difference
actually yeah I guess that kind of looks
like I don't
know
um we going have to reboot again we have
to reboot again I'm Terri L
sorry let's just push more notes before
we that's a good time to take a break
we're going to keep going with this
um we you know you know uh tiny
grad qualin from Tiny grad wrote an rdna
3 um emulator like we can use it to test
their compiler we can do it all in
GitHub C do do they understand how nice
our shit would
be oh yeah then I did commit a yeah it's
funny I know right uh let's turn it
off it makes SMU errors fatal
huh there are some docks AMD leaks from
tour but they're
NDA yeah
again we're not interested in
leaks
um I wrote The Python one I
think
um no come on no no conspiracy theories
about Jensen and Lisa AMD firmware has
sucked long before Lisa Su been CEO
right it's just like I mean like you see
why it sucks
right Nvidia basically from what I
understand has like one thing and it's
called the
GSP oh no it's not a python emulator no
no no no we have a we have an Ops py
um full descriptions of registers but
NDA stuff is bad
yeah
uh well they like don't work for gaming
they work for certain AAA games that are
carefully
tested I I've heard I've heard that AMD
has some serious problems with
management
um again I I'm not going to diagnose the
company and say what's
dysfunctional
uh but all I know is I don't want to
talk to them anymore and I regret
talking to them okay
um I'll be right
back give me uh give me 10
minutes
e
e
e
e
e
e
e
e
e
e
e
e
e
e
okay we back okay
okay
by the way you guys
know Nvidia so
the
um 7900 XTX and now that I'm not selling
them I'm happy to tell you this I wasn't
going to say this when I was marketing
tiny boxes the 700 XTX has 123 Tera
flops of fp16 compute the 4090 appears
to have 165 right so you think it's a
little bit more no the 4090 is disabled
in software to not let you get 330 which
is what the card is capable of a 490 is
actually 3x more capable than a 7900
XTX um of course the software limits it
to uh
165 uh that's that's a fun
one the software also disables
peer-to-peer
support this just says Nvidia is so far
ahead they can charge more and disable
major features on their
GPU half the half the AI training
performance uh oh yeah yeah you can
totally yeah but if you buy an RTX 60008
of course it supports these things I'm
not going to reverse Eng look we're not
doing AMD we're not doing Intel in
videos um I mean it's shitty but again
the way that you fix that by the way the
way that you fix Nvidia nerfing the
firmware is not through reverse
engineering uh and this is something
I've learned as I got older right like
if you try to if you try to fix it by
reverse
engineering uh
it's you you like you lose because even
if you do it what you're really doing is
helping Nvidia you're you're helping
Nvidia for using a bad a business tactic
that punishes you what you want to do is
commone a compliment you want to figure
out how to force you want to use you
want to shape Market forces such that
Nvidia can no longer do this right and
this is the truth about jailbreaking
too um
the right thing was never to try to
break Apple's wall
Garden actually the government is not a
bad way to do it but much better thing
to do would be to make Android
better
um all right let's get to
work did my computer come back
yay it's
back is it going to
reconnect
reconnect all right so where are you on
these
notes we have the system management us
it
mus for this
one
cmn to
as mode one resets and mode two
resets have a whole bunch of clocks I
mean this gets fun too you could figure
out how to actually get good power
efficiency out of these
things
so consumer gpus are tuned for
benchmarks uh they're not tuned for AI
training uh you want to know what your
chip can sustainably do not what your
chip can do while you're running you
know whatever 3D Mark
perf I mean in
may have some look shitty business
practices it's nvidia's right right the
shitty business practices involve like I
think that what they did with the Cuda
data center thing again I think that
people went way too far with that uh I
think that what people like Nvidia is
never going to sue you because of that
and I will eat my words if they sue me
if they sue me because of that they
really are Sony tier shit not that I'm
even doing it but like if they sue
somebody because of that then they're
Sony tier um but I don't think they
actually did that to sue people I think
they did that to Target large Cloud
providers which again yeah large Cloud
providers no 49 490s for you and again I
don't even think Nvidia would sue I
think Nvidia would just not sell them
the next
chip which again these things are really
their
right um even more so than like like I I
think what Apple's doing with the iPhone
is is much more bad
monopolistic Apple's locking you into an
ecosystem nvidia's not there's nothing
about Nvidia that looks like
lockin you just genuinely use Nvidia
because they're the best and Nvidia
knows this
too Nvidia knows that the minute someone
beats them everyone will move their ml
workload they've done nothing at all
that looks like
locking Cuda is not locking right like
having good firmware is not locking and
then being so far ahead that you can
intentionally cripple your Flagship
GPU like that's not bad business
practice that's just domination and all
you can do is respect
that there's nothing wrong with doing
that and again the way that you fix that
is not jailbreaking or or or firmware
exploits the way that you fix that is
through Market
pressure it's not Nvidia is not doing
anything an an competitive to keep
others
down like AMD could be
good it's not like Nvidia is making
their software
shit
I don't know people Switched Off AMD
servers pretty
fast I mean the Z on WS they don't have
enough PCI Lanes when
when I don't know people switched very
fast when epic came out at least that's
what I
remember
um yeah I mean the ecosystem is baked in
and again this is kind of our goal at
tiny grad we are trying to
um we're trying to commoditize the pay
to
flop oh well 10% market share you mean
new servers or 10% market share of
rentable Cloud I mean obviously that's
going to
lag but I think people switched pretty
quickly for their new machines at least
that's what I
remember they might have also been
locked into contracts for older stuff
right I don't know I don't know I've
never been a large cloud provider before
I don't really know what their contracts
look like to buy
CPUs all right we're just flailing um
let's stop flailing let's go back to
trying to Let's submit one Q let's let's
go back in here and let's ring the
doorbell and submit a kill and let's see
what's going on
here oh we also have we didn't reenable
the debug here
this one of the actual arguments does
not meet a precondition
let's figure out where this error is
coming from that seems like a that seems
like a good a good
task so this is a lot of like what these
things are you figure out like okay
something is generating this HSA status
error invalid argument let's figure out
where it's
happening so I'm creating a queue or you
know what maybe the first thing to do is
actually do create a legitimate uh we
have all that stuff to do it so let's
just make a
I guess would be this kernel object
isn't
correct what a kernel
object prog
handle how do I get a Prague it should
be here right yeah here's it
is so here I'll show you how to use some
tiny gr
infrastructure
[Music]
um um tiny gra runtime Ops HSA import
HSA program HSA
compiler let's create a compiler with an
arch
string uh
of uh
gfx that.
compile I just do something like
this I don't
know Works
quickly it looks like it compiles um so
I'll just say Li equals that we can hex
dump lib should be an
l
you didn't have hex stomp you got to pip
install hex
Stomp all right got it's an elf uh now
we can create an HSA oh but that's going
to be on a different device we actually
can't do that I don't
think that's kind of
annoying
maybe there's actually nothing to it
okay hang on so let's just try it HSA
program we have to pass in a device here
though device
used executable load agent
okay it's a lot of stuff that we have to
do
come back that
later inactivated due to async
error
um
what are those ioyal
commands
wow it's actually calling update
Q do we have to call update
Q I don't know
um ding
dong where is it
dingdong oh ding Dong's and then it
calls update Q which of these calls
update Q
I have a lot of questions about
that it has to call update Q oh yeah who
had an ATI Allin Wonder
Card probably shouldn't be calling that
actually
updating q1 doorbell
control we got to get to
the AMG just release
docks dump your dump your 7900 xdx docks
that's a good start
right
I remember I only use AMD for a 30%
discount I Rage Quit returned my H it's
going to be sad it's gonna what should
we live stream the dismantling of all
the AMD tiny
boxes
so where is
this Q error
crap started evicting pass
ID let's take a look in here and see
what's going
on it's in kfd Pro process a vict
process
worker that's
interesting oh wow wa wait this is the
CP we know about the
CP is this in the
mess that with a space what's the print
for that here it
is oh it's in restoring the
mqd the hell is an
mqd oh well we have an manager of
MTS I'm going to rip this all out I just
want to rip this all
out I just want to I just want to like
I'm going to ride a drive I'm run around
a Kel driver for this shit I want it to
be 200 200 lines 200 lines the colonel
drivers count as
lines
tiny boxes are only in
video the AMD ones are getting taken
apart again we can get to the we can get
to the end of all of this okay so here
we are knitting the
mqd and then I have an idea that all you
do well let's look at update mqd and see
what it does
oh update K
mask calculating Q size what is this
shit update K
mask do I update the K
mask don't update the K
mask um oh mqd equals memory Q
descriptor thank you how did you where
did you find
that citation please
sir
glossery I think I already have this one
probably but okay let's read about
memory Q
descriptors okay what's the pfp we don't
know about that about the PSP what's the
me we don't know about that what's the
CE we don't know about that we do know
about the mech and that's the micro
engine compute that's a memory Q
descriptor which is used by the hardware
to keep the user mode Q state in memory
but is it actually used by the hardware
or is it used by the
CP those are the
questions
doorbell
control what is this is this a
real so this is probably just some shit
that goes this is like how it
communicates with the CP
firmware uh the 490 is no it's not even
the driver or the firmware as far as I
can tell it's an euse that's blown up
the chip so there's two variants like
it's the same it's the 4090 uses um it's
a g
uh
ga102 there's a ga102 used on RTX 60008
there's also a 81 or2 used know the 4090
but there's these things in chips called
euses and you can burn them to uh like
disable or enable certain
yeah
and you can't you can't unburn an
euse right do we have more stuff we
don't have any CES
we don't have any Mees and we don't have
any
pfps oh wait oh I didn't know about this
is we can set the reset method this
might have actually fixed some of those
errors we were
having if we use like a more aggressive
reset
method
you think I can disable the mees you
think that works there's no way this
works
is it using the mes I don't
know I still see
mees
is there more Mees if I enable the me no
I think that just does
nothing it is also possible that it's
fused because there's something wrong
with the chips like not all the chips
are performant enough but I doubt
it
wait what is this
crap it's in gfx I should just have that
in my my driver
here they have some docks in there that
tell you
stuff oh the drawing
engine the gfx CP consists of three
micro engines oh they only tell you that
here interesting
okay so the command processor has a
prefetch
processor and a micro
engine yeah this is the stuff we
need oh this is where all the oh this is
where all the bugs
are oh
yeah yeah yeah yeah this is the shit I
want this is the firm where I
want well I didn't know it went all the
way back to it's not even the NES it's
this
junk each Mech supports four command
Pips finally we found
some H good find
pfp pfp plus me equals drawing
engine pfp me there isn't actually a CE
there's only one Mech and there's a
whole bunch of the CE might be
gone I don't get the problem do you use
rock and hip bro we ditched rockem and
hip months
ago that shit really doesn't
work yes like T AR kind cargo
cult cargo cult hip
graph oh you use the basil tool chain
he all right
um kgd engine
type oh wait I also don't know where the
sdmas are sdmas are their own
thing even though they're here as
engines okay so it turns out the I don't
actually care about the mees I kind of
got duped AMD said they were going to
open source the mees but what the hell
is the mees I don't even care about the
mees like now there's an Mees in here
but
like what about the what about the
prefetch parser can I have a pre-etch
parser
like this is what's actually doing all
the GPU in this is just a whole lot of
bullshit roam is just something AMD has
to tell investors they're are equal
footing yes yes they literally just took
all the Cuda apis and we like implement
the shittiest knockoff of this you
can and that's how you get hip
um Mech is micro engine compute yeah
yeah or compute micro engine I
mean let's let's just for for for
uh yeah there's Mech one and there's
Mech 2 that gfx 07 is the best one each
Mech supports four compute pipes and
each pipe supports
8 cubes the cues used to be exposed to
user space and programmed directly by
the compute runtime but not
anymore okay private Cillian
no I know it works but it doesn't work
it works like like this is this is the
the
the oh I ran it and it worked you need
two engines cuz wonder
relable I don't think it's that bad I'm
sure gfx 7 was very reliable they really
went off the rails at gfx
10 let's look into these mechs let's see
what do we know about
mechs all right all right good good good
we got pipes we got
pipes CP compute Mech
pipe
if you run the outof thebox demo they
spent months out of the box exam project
SP months PR for the demo it works
perfectly exactly exactly and that's the
whole problem like like you need to
think differently you need like fuzz
testing and you
know and that's why this is so hard
that's why this is so like this why it's
so hard to to make this decision that's
why it's been frustrating like I want to
like fix all this right let's rip away
the HSA Q right let's get to those let's
get to those four engines that are
actually on the
hardware right let's get to those four
cues I don't want something else copying
my cu's to more cu's right I just want
one I want to see the real que that's on
the real shit
and then how much transforming is like
maybe it's maybe the the mech used to be
a thing but now they have the virtual
Mech for backwards compatibility
purposes and that's why the in order
cues are stalling the come on
like docks
firmware
and if you're worried about people
exploiting it I will find an exploit but
that's the thing you can't like make
deals with companies because there's
nobody there right there's there it's
it's like it's not like you can say like
well you know okay you know well that
also kind of sounds like blackmail but
like um no I'm just saying like it's
it's your shit's not secure right I
promise you if some nation state wants
to exploit this they already
have all right private cerillium do you
work for rock am or
something would You Bet Your Life on
Rock am running stably for seven
hours if I put Rock am in a
loop and said you die if it crashes
would you You Bet Your Life on that all
right you're about to get banned
[Music]
bro
this guy's spending his life on the
micro engine compute not stalling the
[Laughter]
queue very
stable
[Laughter]
bro
crypto Miner is running the same thing
over and over and over
again in a very static
way
um okay let's focus here um all
right so this is the main this is the
main file here that we care about gfx V
11 we have
pfp me
MEC
RLC oh which may not actually know we
don't know if the mees is a part of the
CP I think the mees is separate from the
CP we definitely do
have yeah the mees doesn't seem like
it's part of the CP in fact the RLC
looks more like the
I'm glad they work for you
private how about this I'm not actually
legally allowed to take your life but I
would be willing to make a $10,000 wager
that I can crash your
gpus by running normal tiny grad
stuff I don't know about your Crypt
Miner your crypto Miner might run for 7
hours
I
mean you're sure I'd be able to crash it
exactly
now I would take the other side of that
bet on
Nvidia I'll give you a computer with 4
490s you can do anything you want in
time
do you think you can crash
it wait when you say you can craft
Triton on
Nvidia are you saying you can crash the
user space program or are you saying
that in D message the Nvidia GPU
says says uh says uh I'm
broken right it's easy to crash the user
bace I'm saying that do you think you
can break like the firmware do you think
you get the equivalent of Mees errors on
on invid with something you did in
Triton I don't think I've ever seen that
in my life the only only bugs I've ever
seen with Nvidia were bugs with gpus
falling off the bus and I have an idea
that's due to PCI
instability yeah and then and then
figure out how to panic the
kernel you get PTX errors in like user
space because yeah because you have your
R Triton
code like Triton works and it's well
understood yeah
we're not talking about PTX errors here
we're talking about the GPU
breaks
okay so here's another
question let's look at the list of
registers
here um include Asic regg it's
interesting that they have this
so if I look in the Asic Rag and I look
at like no not that SDM
where's the one that's actually like
let's find the GC
here
here so well first off why are some of
these
oh they're not all
addresses I mean this is cool they have
all this can I just disable the firmware
and use this
directly like what I want from what I
want from a
AMD can someone confirm inside I don't
think this is like can they confirm if
this
exists are there docs that explain what
all these registers
do that's mostly what I
want
like docs that
explain what is what is the the sdma U
code check sum register what is the sdma
Q2 preempt
register I mean I'm sure they
exist the amount of people to legally
post what their registers do and their
shit why
not
I don't believe
that and like legally able to or they're
worried about patent
trolls I don't understand also
like like okay so like reg CP mess
doorbell
control aggregated
doorbell yeah this
stuff this stuff
sucks how do I enable this drmd
PG
um we have also what all the
mees like look at all these Mees
messages we have them they're all
documented
m
m what's
m we're adding a lot of q's and removing
a lot of qes I
say read rag write
rag
oh wait is that just a vulnerability
right there
what if I just read a
register and I mean what if I write a
register and my register is actually the
uh can I just read the code at the
NS
okay they're firing threes what are
threes 0 one two 3 WM weight w
weight uh I mean that's just the same
sort of crap
um it's all threes okay it's this
one no I don't know I mean these
registers might not they might not
actually be
SOS meaning secure operating system
oh
I like this guy let's ever Ransom wear
brick CPUs dude you know you know you
want to talk about a scummy business
practice the Locking of the um the
Locking of the
uh you there's epic CPUs that are on
eBay that are just useless and junk
because they're locked to Dell and
Lenovo Bros you want to write you want
to write malware you want to write
malware and brick you want to Brick
millions of AMD
CPUs just just for the LOLs man0 one two
three that's what you get for making
your shit
brickable
wait oh here we
go um all right so like it like writes
registers kind
of I don't know what a wrm MK RM weight
is oh it's writing gp6 low in the
mech oh that makes
sense uh so like you can probably write
them all like there's tons of exploits
here just got to find
them oh what was the last abbreviation
kdb there's a there's talk about the the
the PSPs
kdb um there's also wait there's also a
TA there's a file called
ta and then here and then there's stuff
that talks about the
kdb uh yeah nerfy congratulations I'm
GNA I'm going to make you a VIP been
very very high
signal
um okay so we're writing to those
registers for some reason and then
sometime we also add q's and remove cues
from the
mes you using backo what's
backo another
AC RPM
backo oh you want a boo or you want a
backo smoking some
backo um main function load for
KMS ium is power
management DCS pre Compu is not
needed load autism spectrum
disorder
backo bus active chip
off oh okay so that's just like going to
sleep mode and
stuff The Firm doe to CFC State Central
manag loading sequence will be updated
as
below IP versions okay so this is in the
PSP so which IP version is our PSP it is
one of these 1311 okay so we're doing
centralized cstate
management
[Music]
um all right well so like you we can see
this stuff here we load the
TMR load other non PSP firmware we load
the ASD down
here and then oh we load some
Tas oh these T I
see yeah that's a good
comment
um
cool what's a load
ta
command buffer
IDs for the ring buffer
interface so okay T is trusted execution
environment that's a normal
acronym
um load ta unload ta so I think those
are like yeah like
trust
things uh htcp DTM WP secure display I
don't think we really care about these
things see like that's that's another
shitty thing like you know I even told
the AMD people like I don't care about
your your uh you know your your ta like
I don't care about your xgm htcp crap I
don't care I just want to like like just
I'll disable that I don't want to load
that I don't need that
um but yeah no I mean I realize like
what they what they said they were going
to do is like it's
useless the mees is not is not like any
of this stuff I need documentation on
how to actually drive the GPU
yeah ta is trusted application
cool that makes
sense
for
for
you know what yeah I I don't care uh I
don't care if the signings
removed I'm confident that without the
uh removal of the
signing
sorry I gotta do 2A for
something
oh I don't know if it's still valid
to
why does sdma have its own
firmware why can't sdma just be a
uh just be a just be an sdma
engine all right so I think we craft a
new
tweet um
uh in the
interests of
feasibility
[Music]
feasibility um open source the
GC the
firmware for the
GC
um CP Mees RLC pfp me
Mez and the
sdma
um provide
relevant
docs they won't do it I don't
know they won't do
it maybe in two years
maybe in two years
uh two
years all right brainstorming time what
what do we like this is so fun this is
so fun and it's so it's so sad what
would it take to get AMD to where Nvidia
is I mean there Hardware is not close
but that's mostly not the
problem mostly the problem is that
there's that there is okay so we ripped
we ripped down all of the user base um
again if you do not believe me go check
out Master on Tiny grad on a new
[Music]
computer go check out Master on Tiny
grad on a new
computer ring reduces Mar um Master on
Tiny gr on a new computer install the
following two packages HSA rockar and
co- manager right HJ arar is a
minimalist runtime co-manager is the
compiler it's possible to bypass both of
them uh with with like we we actually
did this we bypassed all of amd's user
space we're not using any of their hip
extensions either we still have the B
flat 16 hip extension that's why the
tests are failing right now but that's
actually going to take two hours to rip
out um and it's disgusting and it's just
they cast everything to float so you
know don't expect anything um the you
can read there you can read hip B FL 16
it's just actually hides the fact that
they don't do B FL their Alou doesn't
support B flat 16 right
um here want to see you want to see
something funny want to see you want to
see like like like I don't know I mean
to be
fair uh hip B float 16h why why is this
so
um
let's go to something like I don't know
tiny
15 read this file this is what you get
with hip so like oh look it creates this
thing called hip B Lo 16 oh you want to
you want to add B Lo 16s well we're just
going to cast it to float oh you want to
subtract the float 16s oh we're just
going to cast it to float oh you want to
multiply them yeah float why not float
divide them
floats uh yeah so like you know that's
yeah uh that's
that so we're going to r that out and
then we're completely free of anything
hip AMD user space relate because why
not just cast it to a float it's great
that's great
um seem very buoyant uh
yeah um we can bypass HSA kmt too with
uh with
kfd uh you just basically need the
strs so like we did it we ripped out the
user space right but it turns out that
even though we've ripped through layers
of user space multiple layers no Rock M
no hip there's an equal number of stupid
layers in the kernel that all need to be
ripped out right I don't want to use an
aqlq I want to actually submit it to the
hardware queue on the device right and I
bet you that eventually when you get to
the bottom we're going to have to be an
optimist and say the hardware doesn't
have any
bugs
um the hardware probably well I might
have bugs but we're going to assume the
hardware doesn't have bugs we're going
to assume that all this shit is in the
37 layers of of of translation code
using Mi open
kdb what's a kdb
file pre-compiled
kernels I don't think it's the same
kdb
um yeah or like if there's Hardware bugs
okay well work around a hardware
book yeah I don't think yeah I don't
think it's it I think that's thing
um
yeah uh no need to
touch
signing no need to open
source
[Music]
PSP
uh SMU
welcome but
also probably
noted look I'm reasonable that's my
ask that's my
ask
uh yeah this was also my ask N9 months
ago uh nothing was over sourced no docks
were provided and uh you know jerking
around happened a lot of a lot of stupid
business jargon multiple Microsoft teams
calls got fooled by ATS you know Alisa
Sue ATS me and I think this is something
like no open source is shit um does AMD
suck
yes
yes what access to an am300 help me no
uh mi30 is an older version of the
firmware that was forked multiple times
ago that they hand patch every bug for
I'm sure so uh you know mi30 is based
off of gfx 9 we could go I can show you
where that is in the code and stuff
so
um kdb debug hooks for
Radion oh Colonel debugger shell this is
this is looking more
likely
I don't
know
um for reference all of this stuff in t
torrent is open source and relatively
documented I haven't seen register docs
but like their registers are not just
like like uh nvidia's registers are
actually better documented than
this
uh you can go look in in nvidia's
uh like they have these
yeah that one's kind of documented but
those other ones I was looking at had no
documentation yeah I think you're right
about it yeah
it's maybe it's a debug Maybe it's a
debug uh PSP
kernel
um
yeah so that that's my ask on Monday you
have to dismantle these
computers like I'm not going to sit here
while the thing stalls and I have no
insight into what actually stalls right
like like like or are there debugging
tools um debugging tools very welcome
right like
like a tool a tool that shows
uh
yeah and like do this by Monday what are
you what are you you're either going to
do it or you're not going to do it you
know I mean they're not going to do
it and
and yeah we're going to move
on if they open only docs would it be
possible to write your own
firmware yeah I mean maybe that that's
not exactly
clear I think with with like docs would
really be on the right on the right
track I'm not that worried about the
signing um
um yeah but that's the kind of stuff
that would be needed to write an actual
uh performant and reliable GPU
driver I don't think let's look at the
SMU for a minute I actually don't think
we need it at all well I'm glad now that
I know now I know exactly what I'm
asking
for um so who thinks AMD watches the
Stream
t St watch the
stream you think
no one guy from the CPU Department
watches it
maybe the lawyers watch
it there's lawyers watching to see if we
used any
[Laughter]
leaks uh
uh that's why AMD CPUs are great
yes I mean they are great AMD makes
great CPUs the same their gpus are
shit uh do we need I had a list of the
all the the SMU uh instructions I don't
think they
matter no I don't care about it like
power
stuff this doesn't matter I don't care
about this as long as it works
I don't think this is where the bugs are
yeah yeah bco yeah I don't care about
that uh no need to open source PSP or
SMU
yeah
gifted a tier one sub to
AMD wait there's actually someone in
here called
[Laughter]
AMD
um the difference is in yeah the
difference is gy
Right everything gy shows
up
God who changed who changed their sh who
changed their name to
AMD you can give to people which aren't
here yep so um if Zero by Monday we are
done zero docs if zero relevant docs or
code by Monday we are done
not going
[Music]
to
help
those who
don't want to help
themselves not just going to say
register docs Docs in
general we are
done
dumping I think I have I I have
like like
72 x on
eBay oh wait wait we forgot we forgot
one stupid acronym uh oh the RLC we need
the
RLC don't forget the RLC you know that
whichever one I forget oh no good we
have the RLC good you don't say the RLC
twice is not that
important I don't think we have a CE
anymore we have three messes what's the
IMU oh did we ever figure out what the
IMU is let's figure out what the IMU is
that might be important we might need an
IMU uh let's see if we have Imus in
here
now I don't think it's an inertial
measurement unit I don't think gpus have
Gyros oh do want to put it in mission
mode
uh no no no no that's not that's the
wrong kdb I don't care about kdb I don't
care about the
PSP be care about the IMU what's the
IMU it's not my fire alarm it's in the
hallway
integrated memory
controller no we can't switch to 10
torrent as much as we might want
to all it seems to do is program The
rlc's
Ram
yeah okay great we remove the IMU but
what is the
IMU yeah it never worked properly none
of this shit ever worked
properly integrated memory controller
utility okay I want that I want that
can can you have a link can you show me
where that is all right the C is not
real anymore we don't need a
c we do need an
mes why is this so badly doggy minut
it's a great question bro it's a great
question wait what happened to my
dumping on
eBay
for
performance and
reliable ml
accelerator to make
oh you're not believing in The Rebound
in the near future you're liquidating
your rsus
bro like I don't know you know it's hard
to say whether stocks are going to go up
or down the stock stock market has
nothing to do with anything but if you
think AMD is ever going to have if
you're it depends how you price the
stock right what does AMD
share
um wow I didn't realize Intel actually
had
nothing
oh no they don't really have
nothing okay so um
yeah
wait okay never mind Intel actually has
a all of what about discreet
gpus
discret
pcgp no no that doesn't make
sense oh here D gpus oh this is right
okay here we go okay so um in Q3 2022 uh
Nvidia had 88% Intel had 4% and AMD had
8%
uh guess what the breakdown of ml
accelerators is going to look like
exactly the
same so asking the question is AMD stock
going to go up or going to go down do
you do you believe that they are going
to achieve more than an 8% share of the
market and then the the better question
here is how many of those 8% of Gamers
regret purchasing
AMT nobody regrets purchasing media
their pocketbook might regret it but
nobody regrets
it AMD mid tier gpus are selling really
well yeah 8% of the market
bro
8%
oh yeah don't use nickel what like tiny
grad has the
same
um do do I think it will grow no I think
that that's going to be the way of
things I don't see this
changing again and that's just what
that's just what's so like
sad it very will make it
worse I mean it also it also matters how
much Nvidia cares right Nvidia could
have all of it Nvidia could
could it's just it's just a margin
calculation for them right
I I think that even if AMD what was what
what did Jensen say he said that we're
going to make it so other accelerators
are worth zero doar as in even if you
got them for free nobody wants
them uh it doesn't matter they're going
to just drop the 5090 as far as I know
AMD has nothing to come back
with the rdna 3 documents the
instruction set which is fine it's nice
it's actually that instruction set Doc
is actually better than Intel's uh it's
way more readable Intel's is hard to
read it's not that Intel is incomplete
it's just hard to read it's very
verose um but that's the only piece of
documentation that was released uh on on
the 7900
XTX uh so I don't know I don't even
think we need to post this on Twitter I
think that that's kind of
though uh yeah they dropped yeah big
Navy 41 one is dropped they they say
they're going to do one for
rna5 um someone in here posted that
Nvidia is doing something different the
way like the AMD is doing Wham and
Nvidia is putting tensor cores on each
on each SM or something I don't exactly
know what that means
um watch the 590 come out for $1,800
what I'd be so happy at
$1800 that's fire man yeah that's how
much of 490
costs uh
yeah radon's issue is not Hardware their
Hardware is decent it's just
non-existent software well it's all this
shit
complexity like I just want to rip
through all of
it I want to I want to I want to tear
through this entire driver in the same
way that we tore through their entire
user space provably publicly
verifiably so I I asked I asked I asked
this question and I asked this question
I asked this question in the email in
the last email I said they have because
I'm I mean
like I'm just
like like I'm not going to waste my time
reverse engineering this
shit it's so I'm so upset I'm less upset
right now I actually like I I feel good
just doing this but I'm not going to do
like it's such a bad business
decision I love doing this kind of stuff
but it's such a bad business
decision yeah we're going to swap to
we're going to switch a
video no I I can't give them more time I
gave them nine months they didn't do
shit like I I can't I can't continue to
our computers are here tiny boxes are
ready to ship we're we're qualifying the
490 one it looks
sick
um I mean also when you get the Nvidia
one everything just works gbt fast works
all the pie torch examples work like we
have to deliver a product
you
know can I finish tiny gr and move on to
ha girlfriends everything with Invidia
just works I'm like we shouldn't be
messing around with this I'm down to if
I have documentation I'm down to messing
around with this because it's stuff that
we're going to have to be able to do as
a
company
right like here's the philosophy right
if here if someone wants to screenshot
this and put it on Twitter all if we I
saw another one of the tweets got
thousand likes if we
can't um
like if using AMD is
harder than taping out our own
check we'll do
that
like I thought
AMD was going to be a win I thought that
AMD was going to save us time I thought
that AMD was a cute way to not have to
tape out their own chip and what I
thought was this I I didn't think there
like I thought that this would have
extreme value to
AMD
like a few things like like like it
doesn't really make that much sense to
me it's fine if they think that we're
not capable of fixing their driver
right but if we if they think we are
capable of fixing their
driver what are they
doing it's fine if they think we're not
capable and just like like say
that but why would
you like you're just going to continue
to lose
I don't know
but yeah people try to believe in AMD
for good two decades by now and like you
got to just yeah I
know something's just broken in the
company no I mean they're not thinking
they're not thinking and this is this is
what's so hard for me to
understand
um you know
like the Elon Musk style of company
makes sense to
me like you could talk to the guy and he
could make a
decision right and he might say no he
might very well say no but he might say
yes but either way there's somebody who
can make a
decision and this is why Elon this is
why I believe in everything Elon
does this fact alone gives
him he can he can fuck everything else
up but the fact that there is one guy
there is Mr Elon Musk who can make a
decision gives him the biggest Edge over
everybody
else even if half his decisions are
stupid nobody at AMD has the Buton
exactly exactly exactly thank you my
lingo my lingo who thinks I'm wrong
about this you know I'm coming back I do
this I just grow more confident in my
George you're just you're just falling
for confidence in your own
worldview um
yeah just
man
no no Lisa Sue replied to a few of my
emails I don't think she can fix
this I don't think anyone can fix this
like I I think I
think you know what it kind of
is and I think there's worse companies
than AMD I think there's considerably
worse companies than
AMD
but I no I'm talking about like Boeing
right AMD is not Boeing tier right I
think that these companies like Boeing
have been
lobotomized I think that they they they
they lack
like they lack a prefrontal
cortex the companies lack of prefrontal
Cortex I think is kind of the the way to
the way to the way to say
it and I mean these companies are all
going to
die I don't think the stock really
correlates to to anything like these
companies May be
tied uh with the with the US right and
like look I'm not I'm not saying that
the us is going to is going to collapse
tomorrow it's it's it's not um it's
actually probably just going to continue
to get worse uh the US doesn't collapse
the US Falls the same way Britain Falls
and all these companies end up falling
in the same way like name name a name a
British
company I think that that's what what
happens right it's not like America
collapses America just goes the way of
Britain uh Brazil yeah yeah British
Petroleum okay arm okay Rolls-Royce
okay um I don't know why arm is so
valuable right now also like arm used to
be this relatively small company that
people were like yeah you know whatever
man like if they license their thing
it's cheap enough um but yeah know I
mean America's going to die with slow
Decay these companies are going to die
with slow
Decay I I think that
yeah
um I mean okay all the the best one I've
heard was like yeah arm and
BP anounced
[Music]
AI
um there's no company called Deep Mind
are you talking about the company Google
are you talking about the company Google
by the way you know you guys thought I
was like I I like I like um French
jokes memes about groups of people may
be disturbing or
hurtful
okay thanks
Google uh yeah I I wouldn't
uh Google made one product in 10 years
and refused to create images of white
people I I don't really know about BP
I'm saying like they're
not
yeah no I meant French jokes I meant
jokes in French of course
[Music]
um their shares went to the moon after
AI chip
announcements bro I wish I had a longer
time where wasn't to short this
shit are they gonna change their name to
Kodak
AI remember when they did Kodak
blockchain
um
yeah
arm back by the fond I don't
know I me look why does Nvidia succeed
right Nvidia succeeds because of this
guy he is Mr Nvidia wait none of these
guys none of these guys are Mr Nvidia
where's Mr
Nvidia there's Mr Nvidia right Nvidia
succeeds because there's a Mis Nvidia
you can talk to him he's actually pretty
accessible um did it warn me did it warn
me does it want to warn me about that
picture um I Le jacket get C look man
you TR
Sam remember said there was a clip where
I said that Sam Alman and Elon are liars
yeah Elon lies because he's an optimist
mostly sort of I don't know I mean
there's some things that are just like
go beyond the pale of optimism but
overall elon's lies are directionally
toward making the world
better Sam alman's lies are
directionally towards Sam Alman
increasing samman's
power um
all right what happens if AMD hires
Steve bomber well developers developers
developers open source your shit um
there's my
um we'll tape out a chip tap out a
chip little skip skip AMD and take out a
chip uh
yep no need such signning open source
the PSP or SMU I promise whatever the
signing thing is I'll find a way around
I don't care about
that
um uh there's so much there's so much
surface
area um if there's nothing if there's
more platitudes
promises we're out dump the gpus on eBay
what should we sell them for guys what
would you buy God I'm tank the price of
my own shitcoin I own 72 of this
shitcoin and I'm tanking the price of it
right now right what would you pay what
would you 420 USD is that is that what
you pay 500 bucks 299 Buck right I'm
tanking the price of my shitcoin I went
on a huge rant about how bad it was shit
I should have dumped
first one Nvidia share how much is an
Nvidia share that might be a good
deal yeah I'll take an Nvidia share yeah
give me 72 Nvidia
shares why you have thousand bucks for
this shit
GPU
um oh I give you a th000 and the gpus
you dump them in the
ocean you will not take them for free
you would take one but you already have
an Nvidia right um
72 AMD shares what's an AMD share
worth
[Music]
oh
um
yeah that's a It's A Hard Sell
um you could buy it but doesn't work
great with AI well it would if the
software were improved no I'm kidding
about the stock price thing I I know I
know about yeah they can just do a split
bro they can just do a split they do
splits and then they fool
retail um yep yep well you know what I
feel better
um I feel better after having done
this
uh
no AMD they they tried to set up a
Microsoft teams call uh I told them uh
open source your shit I'm I'm not doing
it you know what I like what we you you
want to figure out how to how to how to
meet my needs like I'm not I'm not going
to like like again I don't think these
are bad people I I think that like
imagine you want to help but you can't
do
anything um I just went through a
breakup I know I know but you know I'm
glad you guys are here with me
um let's hold an open source rally guys
but it's not it's
just
you smash him on stream nerfy I'm glad
you're enjoyed it congratulations
welcome to your your new VIP status on
stream uh let's just push the latest
shit
here we just call it
something
uh you didn't like my commit called
something uh oh it's on the front page
of twitch all right
cool yeah um I don't know maybe we'll do
a little bit more of this on
Saturday
uh you know what I'm going to I'll put a
poll on Twitter uh will Nvidia open
source anything will will will will AMD
release will will AMD open source
anything by Monday yes no show results
right that sounds
good all
right bye everybody have a good
night
what Su
guys all right I think this will be a
good self-contained stream I wasn't
going to do it as a stream
but I'll do it as a
stream I think it'll be kind of
fun
okay
so um we might have another I think
we'll have another AMD stream tomorrow
or so but tonight's an Nvidia stream
um
so we are we are switching uh the tiny
box from AMD to
Nvidia uh it's it's a it's a sad day uh
we're still probably going to get AMD on
mlpf
um we already wrote all the stuff like
we already basically have it um the
thing goes unstable every once in a
while I will have to see how the MLP
rules deal with that um we might be able
to write some junk mitigations that just
like oh it resets the GPU it loads from
the last checkpoint I don't think that
stuff will be that hard to write uh so
you
know people think I give up on
everything what what do you think I gave
up on man you know that's just just kind
of kind of
like I saw I saw a tweet and it was
like everybody else gives
up like in order to do things you have
to think you can do things and obviously
not everything you think you can to do
things it worked out but you know uh it
is better to have loved and lost than
never have uh loved at all
uh whole bunch of emails back and forth
with uh you know AMD people today it's
just it's just sad it's
just
like a few different AMD people
too you you work there and you want your
stuff to be good and you just kind of
know it
won't
um I'm not going to why are you asking
me about
attera
um think I drink drink sometimes not
much I'm going to go to the bar what's
more fun than sniffing Nvidia IO
controls
um no I mean like never give up never
surrender never give up never give up
never
surrender Never
Surrender
never give up never
[Music]
surrender never give up never
surrender
um but uh yeah no so okay one
of so tiny grad is right now at the HSA
level um we can go a level lower to the
to the konel
level and I think a lot of this stuff is
very
similar um to
uh to
Nvidia so I wrote this thing you saw me
use it it's called hip IO control and it
uh it sniffs IO controls so we're going
to do some some Nidia
sniffing uh let's do some let's do some
Nidia sniffing so all I did was install
Nvidia driver open let's see does that
work Nvidia SMI could not communicate
with the Nvidia driver
um I don't think that actually did
dkms you might also there's like crap
you have to do for the uh what I want to
do app cash search video
[Music]
driver
um open kernel module wait I didn't do
no dkms it should have
dkms Nvidia driver open colonel meta
package KS status oh installed PSE sudo
mod prob
Nvidia oh we can't mod Prov envidia
because of uh do I still have to do the
crap or did they did they update the
open source driver there used to be some
crap where it said the open source
driver was not for uh GeForce
gpus and you had to like do some crap to
make them
work
um I have a 3080 in this
computer do they support 3080 oh they do
support 380 oh that's nice all right
which
which which version do I
have
2496 we get that
one
we could build the Kel module from
Source do we want to build it from
Source it's not as nice uh get log
graph did tag maybe oh
good uh what did I do mod
info oh dkms status all right I'm
getting better at
dkms I do not want to make I'm actually
tired maybe I'm too tired to
stream okay uh let's reboot and let's
pray the computer comes back uh so this
is the Nvidia open kernel module Source
you saw me work with it on another
[Music]
stream I actually wrote a whole bunch of
stuff but it was pretty juny and it's
before I had this beautiful python uh IO
control
Interceptor so we're going to uh we're
going to
see oh you're getting 400 tokens per
second on 2 a 100s you're right grock is
a scam yeah no
shit now you know what I did tell AMD
today I'm like look what I'm telling you
right now you're going to pay some like
multi-million doll Consultants to and
they're going to tell you in two
years
uh you know it's just it's
just
how do we beat them guys how how do we
beat
them I I think that working with trying
to work with AMD was a mistake
definitely working with the company was
a mistake we had a guy come in Discord
I'm actually like I almost want to read
this like it's it's it's
like eight of us met with one of our VPS
yesterday to
coordinate I'm hoping to let you know by
Monday if we can try and help you solve
this like is this guy trolling eight of
us met with a
VP and they're go I don't even know what
this they're referring to solve what all
I said was the only thing I want from
Intel is a cheap price on bulk a
770s is this
like can someone can someone help me
understand
this can someone with like a Normy job
help me understand this well no no no no
no look
um the computer's back do have Nvidia
SMI sweet Nvidia SMI oh look how good
NVIDIA drivers work oh they work so
good okay go straight to
tsmc I like that thinking wait why is my
bit rate
shit no don't no
whatever
um is it over for AMD I am not bullish
on AMD
now uh look
again they were they were very nice to
me um but you can't take nice they also
didn't do anything right
right like I got zero docks I got zero
firmware I'm not going to get any docks
I'm not going to get any
firmware
um you say making a chip is like really
hard why why is it
hard we have a lot of work to do like we
have so much work to do in tiny
grad um
um we also have to get adoption for tiny
grad I know it's expensive that's not
getting money is actually surprisingly
easy I'm very good at getting money if
we need money you just tell me how much
money we need we'll get
money
um no literally I'm these people's like
dream founder you know what I mean like
whenever I read stuff about like what
makes like what you're looking for in
startup Founders it's like wow I mean no
I have all my you know attitude issues
but like aside from that
um no getting money is easy why is
making chips
hard verilog is hard dude they do that
shit in high
school um meaning timing is timing that
much different for Asic than on an
fpga I'm not worried about
that right I think I could write some
sick
verilog um again we have a whole stack
to do once we're at the verilog it's
going to be lots of
fun oh okay we're not trying to
manufacture chips I'm I'm hoping like
these you can't work with these
companies right some of them they're
they're they're all I I just like I said
this yesterday imagine that instead of
Comma just uh working with the cars we
tried to work with the car companies
we'd be out of business so long ago I
don't know why I thought the GPU
companies were different they're
not um and look I'm not gonna I'm not
going to make fun of them again I just
kind of feel bad
like like they're not going to make
anything
good okay like the the Nvidia sorry the
the AMD driver firmware situation like
it's not going to get get better and I
don't know see again like I'm an
optimist I like to think things are
going to get better they're just not
right in 5
years you know maybe there'll be maybe
there'll be another guy like me in five
years who thinks he's going to try to
use AMD to do some machine learning and
like it's going to be the same shit
man um so I'm actually pretty impressed
with the open fpj world so I did on
another stream I built a risk 5 uh
processor and I got the whole compiler
running on
Mac
um so yeah I don't know I I think that
might be uh might be
doable my thoughts on the ex dropic ship
chip or all I've seen was a picture
right like I can make a picture with
with with uh I'm I'm not like trying to
hate honestly I don't know that much
about it I'm just saying I like to
believe you know we can all make fun of
AMD but AMD has a chip that I've touched
T Tor we got to respect T torrent right
T torrent actually shipped me this
car and you know why we respect T torent
they didn't ship me this card because my
name is George Hots they shipped me this
card because I paid them $800
respect that's why we respect 10
Tor
um
I'm not so sure Tor has all the right uh
ideas at least for the current machine
learning
Paradigm these companies are F stupid
but like where do you guys work where do
you guys
work where do you work and what do you
do
you work in ad tack oh you used to work
at tens torrent I
see VFX post
production
Finance nice try you work at AMD
um Air
Force okay so for for those of you that
for those of you we got a bunch of softw
here it looks like Well Finance what is
what is
finance what what can someone describe
to me what Finance is like are you
saying you work as like a bank
teller or you work like a hedge
fund old ladies processing invoices I
just I don't really know I know what
some of you do all right so some of you
work I I understand like you people who
work at
like normal
uh Excel python I heard James treat it's
all written in Excel heard it's just one
big Excel spreadsheet that you do all
right all right I'm not going to get any
answers from you guys let's look at some
Nvidia
shit okay so we're doing some sniffing
let's do some sniffing um so let's first
check in tiny grad and see if we have
some Cuda working do we have any Cuda
working test some Cuda I don't think we
I think we have to install
Cuda test tiny
ad okay we don't have mvrc so we have to
install Cuda you want do 2204 install
Cuda how to install Cuda step by step we
installed the driver great installed G
GCC I'm not installing
GCC really no no no no there's got to be
a better way to install
Cuda here pseudo apps install Nvidia
Cuda toolkit
sick installing installing let's do that
in the screen okay so this is
my uh hip GPU
driver we're going to call call it we're
going to call it Envy oh we're not
connected we're going to call it Envy
what do you guys think is like that's
like the name for uh the layer below I'm
tired um that's like the name for the
layer below
uh
Cuda van v GPU
driver GNA have to get the
um
let's get some copy past up in here call
this nvy opal.
py that's a pretty good
prologue intercept IO control
[Music]
here
um we
going all the io
control and what does it do with ET in
shed oh that's
cool I get like the eye there I really
go beautiful I love this I just love
copying and pasting just hit BYO control
I think I wrote that in stream that's
some mad high quality
code uh actually I think I can just copy
and paste this shit
too we definitely have to install the
hook wow install hooks
here
um it's kind of annoying that I'm
copying and pasting
this is this all format struct is used
here
I should really make this a
library let's should we listen to some
nice non-copyrighted
[Music]
music the quality of the driver not
synonymous with withs a package of the
default repository totally bro no it
totally is what I don't agree with
that uh oh test tiny
ad okay good we got some Cuda you know
we also have a PTX back end you just do
PTX actually I'm not sure you can do PTX
I think you have to do Cuda and PTX I
don't know let's put those some debug in
that bitch and take a
look that don't is that hip
wait oh if you have both defaults to HSA
oh that's brutal there we go check out
our beautiful
PTX um I love this little computer it's
got It's got an Nvidia does Nvidia still
support open CL uh let's take a
look see who shows up in CL info will it
be AMD will it be Nvidia let's find
out uh
Nvidia and no AMD because I probably
have to install some package to do that
that I didn't install so yes Nvidia
still supports here you want to try
it if I do GPU equals 1 that should
be yeah there you go open see on
video we can check it as soon as we got
our sniffer
going uh the PTX generated oh you want
to check that uh I think this might work
if I say debug equals 6 it might give me
PTX no it's not going to give me PTX
with that but if I do debug equals 6
with Cuda equals 1 it will give me PTX
it'll actually go even further than PTX
and give me SAS so this is the SAS so
PTX is like a
llvm um we also have a pretty p PTX
printer check out our pretty PTX printer
uh who contributed that popular Twitter
contributed that
um yo tiny gr's so good
guys as soon as this shit's like usable
we're getting there we're getting there
like I mean here you want to
train beautiful mest on
Cuda it's race who
wins oh we got to compile time takes a
little bit of
time wow that's kind of
slow it's kind of slow boys let's see
who thinks HSA is going to be
faster o score one for
uh yeah it's already pretty usable right
I think I think we're getting good no
what was part I was thinking about today
a lot was um like unifying the
scheduler we have like schedule item and
jit item and then we have like like the
jit's a capturing jit and it should be a
schedule jit not a capturing jit I think
we can cut a whole bunch of lines like
that
too
um but yeah no I want to go to I want to
go to HSA kmt like we have to write
everything that goes flush up against
the driver uh before we can really
consider our own chips like there's
still we still have to do this we can
work around amd's bullshit don't expect
anything from
AMD um and I won't sell their boxes with
their gpus CU their shit but uh
otherwise I think I think yeah
um but this stuff this stuff's like it's
so good that it just like it just like
works so when we remove when we switch
from HSA to HSA
kmt we're going to be able to you're
going to need nothing you're going need
to install one package called
co-manager uh and that's just the
compiler for AMD and we could even get
past that if we wrote Our Own rdna back
in now where we're really going to start
to have fun I mean we are now committed
like we're we're amd's open sourc was
kind of a scam like there's really very
little that's more open source about AMD
than is open source about Nvidia Nvidia
open source their colel driver which is
the main like thing we kind of care
about um there's not all this
intermediate crap open and sure cudnn is
not open source but do you care one bit
about Mi open or any of nvidia's any of
amd's highlevel ml crap like not at all
so it it turned out that for tiny Corp
like effectively Nvidia is just as open
as AMD um the driver is
like I thought that AMD AMD GPU driver
actually spoke with amdgpu Hardware it
doesn't there's firmware blobs in the
middle I knew this about nvidia's driver
uh Nvidia has this Nvidia to be fair has
a bigger uh firmware blob but um yeah no
nobody cares about any of amds like
that's doesn't matter um but we do need
to get right to the konel on these
things I want tiny grad to replace the
entire user space of both Nvidia and D
um so that's kind of what I'm what I'm
working on
here
uh yeah yeah I'm I'm I'm I'm happy with
the way things are going um we're gonna
we're going to push patch HSA I think
HSA was a good intermediate but we can
push pass it to HSA kmt and we really
can get everything um then we're just
done all you'll have to do if you have
uh modern Ubuntu if you have Ubuntu 2004
with the hwe kernel or if you have ubu
244 you will not need a single user
space package except co-manager which is
the compiler to to run AMD and I think
we should even get rid of that like
Imagine
Imagine by the way I don't know if you
guys have seen this these are the only
two uh libraries that uh tiny gr
requires we are almost ready to remove
dumpy one of the big things W parot
actually did uh
was replace the we now have a random
number generator you can now do three
fry equals one and it will use tiny gr
Primitives for random number generation
that matches Jacks uh tqdm is just in
there as like a meme as soon as you
remove numpy we'll remove tqdm
too um let's remove numpy first uh
there's some guy in the Discord working
on removing this um I want to remove
that entirely I want to just go to the
so we have these things called
autogen um and these autens are like
they're just automatically generated
from from header files that are in that
are in open source libraries uh these
don't count to the line count of tiny
grab because they're not hand coded
they're just they're just generated
garbage
um so we can uh we'll add metal
here and then we can remove metal from
here as well like I want install
requires to be an empty list yo wait
wait wait I'm I'm just getting I don't
know like AMD bumed me out like it just
it just bummed me out guys you know I
just I I was really I was really bummed
out this week by
AMD um they're not going to be good
they're never going to be good but it
really was my fault for like expecting
them to be good and we're still going to
get AMD on ML perf we're just not going
to sell a tiny box with AMD because I
can't I can't bring myself to buy 600 of
these cards with broken firmware
you
know I'll try to like write this up well
I'm not that great of a communicator I
learn this during the debates I learned
this during my my uh my Conor Ley and
owski debates like I have ideas that are
clear in my head but I don't always
communicate them
great
uh I'm a good cheerleader yeah I me
that's kind of your job right you want
you want to run a startup you're pretty
much just a cheerleader and you got to
keep the dumb asses away from your
company right you got to make sure that
you know you don't start you don't end
up you just say no to a lot of people um
and you know you got you got to put
yourself in between like like people who
want to come mess with your
success uh yeah I'm really I'm really
proud of uh of Comm this here K is doing
really
well
um
got to keep the Consultants away
yeah all right so yeah I want to write a
IO control
uh sniffer here so when we do when we
do uh KF I think yeah I guess it's
called kfd so these are all the uh IO
control calls for actually we can just
do
it um so if you just add
import yeah if you just you just need to
import these things so you can just say
like from extra do
uh
hip GPU driver. hippi
octl uh import actually I think I just
need to do that not should be enough so
if we do now uh
HSA we can see all of
the yeah so these are all of the AMD kfd
calls and we're going to write basically
the same version of this but uh for
NVIDIA and then hopefully when we write
the HSA kmt driver that starts to use
these we'll be able to use the same
basic skeleton for the Nvidia driver
we're calling it Envy uh so you'll say
NV equals 1 instead of Cuda equals 1 uh
and then NV equals 1 will just talk
directly to the Nvidia GPU so you will
not need to install Cuda except for the
compiler so it'll be the same sort of
thing where it'll just use the
compiler
um yeah but that'll be
cool
uh so we can go in here to PTX equals 1
and let's make this debug equals six so
there's a layer lower
than Ed version
8 wait
what I thought that was changed I don't
po this was actually
updated sorry I'm tired so I can't do
this
fast
cool um so this stuff here is called SAS
and I would like to start uh to start
outputting
SAS um Biden sniffed me bro is a is a
very good is a very good contributor to
this stream I was going to I was going
to say sniffing Nidia like Biden but
then I realized that I already did
enough clickbait this week by saying we
were looking for exploits and amd's GPU
and we were actually just trying to
understand how it works because we don't
hate AMD we just like they could be good
but they just choose not to be
guys like
imagine I
I I'm sure the people who work there are
nice again everyone seems nice but nice
doesn't build great
things where are the people who want to
build great
things
you really think they know they're
choosing not to be
great I do kind of yeah I
do the best Engineers I knew from AMD
left or went to Nvidia I mean like how
demoralizing must it be to be at AMD and
like watch GTC right like I felt
demoralized watching
GTC and like I don't even like I don't
even GT the the b200 sick and I felt
demoralized so how do you think AMD
feels
um no I mean you know yeah you get these
you get these kind of talent magnets
like Nvidia where all sorts of smart
people go to work
there um and yeah it creates this it
creates a Snowball
Effect um but I do do think I do think
they choose not to be
great yeah AMD pays less here's what I
would do if I was AMD right
fire 80% of your engineers and double
the salary of the remaining
20% this is how you get places in the
world you
know figure out how to figure out how to
motivate those 20% of your engineers to
be like yo we're going to build
something something
great
you no don't merge with Intel merging
with Intel is like merging with McDonald
Douglas don't do it don't do it I
mean I will say a few Jim Keller went to
work at AMD and built the Epic chip Jim
Keller went to work at Intel and didn't
do shit so you know it's not Jim Keller
that's different
[Music]
um am I interested to use tiny grad you
can use tiny grad to do that I don't
know I don't anything about that this
just check out nvidia's stuff it's
called SAS let's see if we have to find
some documents on
it uh yeah someone wrote wrote this
pretty
cool no one supported
Ada quality
code um the guy who wrotes the dougle J
the guy who wrotes the wrote the Apple
stuff is pretty cool did he update it
yet for uh M3 why was M3 so
weird
wait what why isn't my mouse
working I think I put an issue
up oh no I put an issue up about
that
uh I don't know if this works for the 3
GPU yeah a lot of cool stuff
here oh AMD needs to create a cult like
Nvidia did yeah
maybe no see what they need is a
differentiating factor right there
there's nothing that differentiate it's
like why would you use AMD it's the
crappy Nvidia
right
you got to make yourself not the crappy
Nvidia
so okay are
are sometimes I'm in like a good brain
State and I can like write like I I
think that that my original blog post
was was one of the
best I don't know I was in like a good
mind state when I wrote this kind of
stuff um when you're a good mind it's
like a flow State you just kind of get
like lost in stuff like you're know
really thinking about anything
else
um the tiny cor is a computer company we
sell computers for more than they cost
to make true I've been thinking about
this one for a while in the limit it's a
chip company that's
true um human brain is about PID Ops of
compute true I've written various blog
posts about
this
uh oh yeah by the way we updated updated
the website today so the Tiny Box is
now
uh it's going to be 649s 649s is for PA
flops and those aren't sparsity PA flops
this box is pretty much equivalent to
two
h100s um so for $25,000 it's equivalent
to almost 2
h100s uh yeah no this is like that's a
beast of a box uh you know look I know
it's not like it's not like like the AMD
thing was sexy that was a sexy narrative
we are still going to also get AMD on
mlpf we're going to get AMD on mlpf
we're going to do
this but why does no one use AMD the
software is terrible there's konel
panics in the
driver
um wait you think open AI I don't know
who's still at open
AI still can't run grock in the Tiny Box
you want to run grock in the Tiny Box
they reached out
um we need to we have a lot of work to
do to make we got to make llama and
stuff faster we made it pretty fast for
AMD we got to redo this work for NVIDIA
but it's a lot easier on
Nvidia uh
yeah yeah we're still going to do
this I was very careful by the way to
never
say what gpus we're using in the Tiny
Box um I thought this might H I thought
something like this might
happen uh we designed the Tiny Box to
support we really designed the Tiny Box
for three versions red green and blue uh
I didn't want I wanted to commit to one
and I was down to commit to Red until
you know the latest set of driver issues
just made it like they're never going to
fix
it um we went over that on the last
stream I like it's never going to get
fixed it's going to get mitigated it's
never going to get fixed
um so yeah this is the Tiny Box now I'm
sorry about the price increase uh you
know we're passing the price increase on
to
you
uh but it's for pay to flops inate pay
to flops two two
float uh 16 pay to
flops
uh
yeah I think we can do fp8 with that too
maybe we only get two
fp8 no we get four FPA if we accumulate
an
fp6 um but yeah know we're just we're
just going to focus on Nvidia really um
like I think that it's a much better use
of time
like fine it's not documented but like
who
cares like
the the docks are almost worse than just
like reading the
stuff um okay so yeah I showed you guys
the actually I kind of want to add a
like to get
him
uh we'll say we'll call it ioctl
sniff I'm from extra do hip GPU
driver actually we just call
I so now it's it's easy we'll just add
this to Tiny gr if you
uh so if we run the HSA one
here you can say I octal equals
1 there we go you can see the ictal so
let's enable ioctl for
NVIDIA by the way we can make ioctl work
on Qualcomm
too uh I wrote this for Qualcomm my
Qualcomm one is less clean than my hip
one because I wrote The Hip one later
but yeah it's actually really cool we
can run all this stuff on my folding
phone
um
yeah when I saw Sam bman was out I you
just don't know who to who to like side
with there samman's a megalomaniac and
Ilia is a
communist uh I don't like who do you who
do you side
with no where is Ilia that's a good
question uh where is
Yia
uh if he doesn't identify as a communist
I'm happy to I'm happy if iler would
like to debate me um on the merits of
Communism uh I'm I'm interested I heard
Sam alman's leg sucked and he didn't
really talk about
anything all right so let's add uh let's
go into Ops Cuda here and let me add an
import here oh we're going to have to
include some
going have to include some like I don't
care that this import isn't used
crap extra NV GPU
driver so we're not calling it Cuda
because Cuda is not licensed for data
center deployment but NV is licensed for
everything MIT boys MIT actually what is
the license on the uh on the Nvidia
driver I'm
curious I take all right
cool you you guys know I don't think
Nvidia is the bad guys right I I don't
think AMD is the bad guys either you
know who I think the bad guys
are anyone anyone who sells you a metal
box for more than it cost to make is not
the bad guys
like a normal metal box they're not like
trying to like like it's not like a scam
metal box where you're just licensing
the metal box anyone who legitimately
sells you a metal box for more than
custom to make we respect we respect
fellow
boxer what are you say
Alex yeah you want to talk
to
do we have videos to watch
tonight oh that's
good we watched Haiti videos last night
dude dude dude had
fucked feel about Mythic AI never heard
of them sounds
Mythic okay so we have the
sniffer uh we just need to install the
sniffer I'm tired I'm sorry I'm not
going as fast as I usually
go sniff oh look we sniffing boys good
sniffing all right so look at all these
I love python like how nice is that that
it just prints like Dev Nvidia control
and stuff right I spent so much time on
this and see everything's just so
painful in
C um oh I don't know about analog I
don't know if that works okay so
now let's
find C extra MV GPU driver this one's a
little bit more
complicated
um so we're going to have to find what's
sniffing
we we sniffing boys we
sniffing wait
what outside the t-s Sor I'm
tired I'm tired and we're out of high
ball should we have some late night
coffee let's have some late night
coffee
this only takes away from your stream
tomorrow you
saying
[Music]
videos
prob we're sniffing a
video Cofe order coffee
tomor
we're
all right we got late night
coffee analog has a lot of
Errors
um okay so I wrote this stuff before for
let's bring up Cuda ioctl
snipper I wrote this in C last time so
let's take a
look you know this is going to be one of
those moments where I'm like what
asshole wrote this shit uh I really
wrote this in not a very good style I
think I've gotten like I've really
become a better programmer since I wrote
this I've become a programmer and less
of a
hacker
like tiny grads taught me more about
programming working on Tiny grad I love
the comments on Twitter that are
like I spend too much time on Twitter I
got to cut the Twitter back um I love
the comments that are like like tiny gr
is the essence of of of machine learning
I read this when I want to understand
how something works um it's really it's
really made me a better programmer I I
like I think I could like rewrite so I
think I could like so much a better I'm
so much better of a programmer now than
I was when I was a comma you agree my
coding style has matured thank
you um tiny grat is
like like like
like you know I I think of it just like
the way like authors write books I don't
know and I don't know what like my next
thing will be it upsets me when people
say I give up you know how many years
I've been working on Tiny grad
for how many years years have I've been
working on it
for you can abstract forever you can
build the most beautiful things and you
know you're building great things if
it's small because you're doing
compression all right um let's take a
look at where these things are
defined go to the driver here rip grap
that's some sick code whoever wrote rip
grap
okay so we're gonna have to like find
these
automatically this one how do I generate
this I
used I use the same code gen
crap uh I usually
use Clank to pie I have Clank to pie
sweet
um like I don't know what's in what's in
this
folder if I just
like
that to
Pi
Source Control
Star
what no switch file or
directory oh so I got to do like this
crap too
um uh start.
H oh it has
error how does it have an
error source code has one error oh NV
types wasn't found okay we're gonna have
to find NV
types so like I think these controls are
the io
controls um yeah like that's an IO
control I
believe we can look and see if those
like match what we
saw oh you know what I'm kind of
printing this wrong just print the io
controls the actual
request
uh when is FD Less Than
Zero
I know rip grips and rust I was wrong
about rust rust is a sick programming
language I'm I I'm you know what maybe
part of me is just I'm a too much of an
old man for
rust you think I can get good at
rust I I like python on too
much oh no these aren't the io
controls these are different things
these are
NR um all right let's see where that's
to find let's start with
that Envy Escape okay let's start with
that
file no Java's a shit programming
language okay so that just didn't do
anything oh I think we have to define
something
probably
wait what one are those defines oh no I
need I know what it
is um there's like crap I need
to
that there we go
cool I should probably be doing KY def
stun on all of
these
I don't want to call it NV opl that's
already what I called
it
um called gen
ioctl all right now we have this file
called gen Oyl how do I do the import
here be careful how you do these stupid
Imports here we go
from extra Envy GPU driver import nvy
octl I'm excited I'm going on a I'm
going on a bike trip going on a bike
trip in
uh end of May we're going going to
Eastern Europe boys we're going to we're
going to cycle the old the old Berlin
Wall the old the old Iron
Curtain
I just thinking back to my India bike
trip nice nice India bike trip a good
memory mova has beautiful
beaches like Estonia and
stuff um okay so how did I how did I do
this the
NR only if it's some of them if type
equals NV opal magic where's that
defined kernel open common
NV also here why is there kernel open
and not kernel
open that looks pretty useful
too
all right let's take a look at J octl
okay
cool okay um n octal magic is literally
f f boys it's
f
if I think I call why do I call it I
type oh because you can't say type and
python or something equals
um let's call it like capital c
capital
N
MV uh
or see look at how much more carefully
I'm doing this now used to code like
more of an idiot you
know I used to code fast I'm like an
idiot now I code slow slowing like an
idiot no Cuda capable device detected
extra has no oh wait shit me gen iio
control okay looks pretty
nice so that's if it has Envy
magic
um read link there not sure everything's
going to matter but
whatever
um all right so now we have to go look
at
these where's J
octyl
okay so what's the first dioctyl we're
getting 200 so ask card
info um if NR equal v. nves card
info es
here by notice how everything still
works we're intercepting like I'm so
happy with
this Russ sucks I now prefer C and now
Zig is a better C I haven't looked at
Zig
[Music]
um
I don't think rust what I will say about
rust is there are some incredible tools
like rip grap written in rust or there's
another
um
uh what's what am I thinking of uh rough
the python
ler it's an okay language it seemed a
bit like again let's take let's take a
quick look at Zig what I remember is it
felt like scripting
language I don't even know what that
looks
like
this is a really nice website actually I
I want tiny gr's website to look this
good man I got to make a good website
for tiny grad I have so much to do I
have so much to do that isn't fucking
with
gpus defer is really nice though what
else has defar I've used doesn't like go
have
defar yeah go has defar I use this in
go um you can design one can we n
PR will it be
nice I'm actually kind of down to like
pay someone if they want to make the
website
nice um you want to contribute to the
site like here here's the
problem
like I I want it to be beautiful and
simple um like we get website people who
want to contribute to the site I I want
like the same I want I want someone who
really understands the tiny grad no not
comma like comm's website's bullshit
comm's website's made in web
flow which is only slightly like it's
don't get me started don't get me
started on on on on my hatred for com
like com webs it's like
fine like I mean we are like Comm is way
more consumer friendly than
like like it's not a dev kit anymore
have you noticed that the com 3x is not
a dev kit it's like it's a product
right you're you got to be an early
adopter to buy it but if you're like a
normal early adopter type you'll
actually have a great time with this
thing
now
um but no I mean I I like I like this
website what's it written
in also please do not put any fucking
JavaScript on Tiny grad's website
Hugo I'm okay with a generator as long
as it actually generates what is
Hugo
we G to
go I use Jackal for my blog and a
certain Ruby and I don't love
it Ruby is is a janky
uh it's okay Ruby is
janky I shouldn't say that actually like
like by the way to the people who make
software like this you know how much I
love you guys like the people who like
like just like all the this open source
software that I
use man like it makes the world
nice uh I don't like Ruby do uh I think
that Ruby is like Yeah it's englishy
you're right like you can't it was made
by like a linguist I well let's not get
into um I'm okay my point is I'm okay
with a static site generator being used
for China gr's website it doesn't
actually have to be editable as long as
we can run the static we have to use a
static site generator as long as we can
run the static site generator in uh in
CI and it auto builds and
stuff let's look at some more code
samples memory Leak
Detection seeability
part when is J going to
launch I know it's not let's not get
distracted by programming
languages
um also I posted in tiny grad Dev a good
like first issue with tiny grad
hopefully someone does it it's a good
like first you can kind of just just get
a feel for it um if the CI passes you
probably did it right it's the removed
globals if if if someone's looking for
something to to do
tonight okay so we have Escape card info
let's go take a look at how we actually
parse this well I didn't parse
it probably because
in in uh
uh okay it's called in EnV control
AR I control card info
T are these are the same
file
I maybe that's a boring one to start
with let's find something that we
actually
parse
um RM control I think this is the
interesting
one
yeah uh so we have an Envy oos
parameters is that def
finded this D this is a lot more
complicated than the AMD one which kind
of sucks
um code has two
errors okay we have to find Envy
types
should we use all these Source ones or
should we use kernel
open we use
Source how do I do Imports here clang
ARS this Clank toy think is pretty cool
I mean the code's kind of janky you read
it but
uh
okay oh no inclusion
well okay good we have a lot of stuff
here
now okay so nvs RM
control gets an nvos parameters here
uh so let's steal that from kfd IO
control no sorry hip IO
control get
struck we'll take get struct and we put
them here too I see I wanted these
now um
see what that looks
like oh
format struck doesn't actually print
it here we
go find a way to do that automatically
have ever tried lib
torch
no that's pretty cool though right how
nice is that like I worked so hard do
this crap in
uh in
uh
see um okay so let me figure out how to
get
these I want to get all the nvss from
Envy shouldn't be that hard I should be
able to say something
like i dur
it yeah
okay uh so just
nves X for X EnV if x do starts
with nvs man I love
python feels so powerful python you
know okay
so no we want to make this a
dictionary
um get at
EnV
X
that okay uh
[Music]
if NR in
nvss print
nves of
NR cool check that out man I love python
man I love python so
much that's so
easy tiny gret's website going to have a
web GPU demo no we got rid of web GPU
it's not really the right direction for
the
project
um I feel I mean you know look the guy
who did it worked really hard on it I
feel a little bad um and he's welcome to
maintain it in a fork unfortunately like
it required a bunch of hacks across tiny
grad because web GPU was just slightly
different from
everything um maybe someday we'll bring
it back if we can bring it back if those
like hacks integrate nicely just like
every time we would make changes we'd
have to spend extra time dealing with
web GPU and that's why we had to cut
it um there's a maintenance
cost it was cool though there were cool
demos we had like webg to I mean they'd
be pretty easy to put back no no that's
not why I have funding that's the wrong
mentality right you're never going to
have funding doesn't help you do more
stuff like that right you always have a
fixed budget for
complexity
um yeah you can't you can't just say oh
you're funding you can you can you can
fix
that uh this is a pretty aggressive
print thing I don't really care about
that what I care about is the Comm
and so let's get rid of these
things
um we might we might very well bring it
back if if tiny grad matures to a point
that it's like the best option it also
is not the best option that's a pretty
competitive space like no one's going to
be training in the
web okay so where do we get these magic
numbers oh I know that one that's like a
2080 so I had all that I had that's that
that's the control
thing here we go all right so what is
the control can I just do that is that g
to
work
all right we redefined a lot of stuff
that's not a big deal how big is NBI op
now oh that's big it's not that
big love how fast computers are
too like just man I love computers so
much um
okay
so how are we G to find
these the same sort of crap we did here
except instead of nves we're going to
look for other
things wow that got
big
um so do they all have the word control
command in them yeah
do okay so it's going to be a little
trickier Envy
commands if x do starts
with uh
NV and x sub 6
colon that starts
with control
command
oh this is this is sheer skill
boys unhashable type
list don't be a list
now
um something's wrong with some of them
types
and type X is
in they are ins
right okay that seems good
though oh we don't want to parse this
every
time uh that should not be
empty but doesn't have
that oh
Dru Why didn't it get that all right
let's just focus on this one for now oh
that's in control 2080
GPU oh it's not even
here can't put comments in the middle of
chat
no the web GPU thing
is someday we'll bring it back we just
couldn't maintain the complexity while
we're working on it it was slowing us
down
um it's kind of web GPU is
[Music]
annoying
sweet uh
oh yeah that's wrong
actually
that okay good okay
um if x. CMD in Envy
commands
else
unhandled
CMD uh print EnV commands sub x.c I
think we can actually go beyond this and
also extract the struct of this works is
going to be sick love python love
python all right so I don't know why all
those commands are on oh they're on
handle just because I didn't include the
shit well that's
easy uh so where's that file you seem to
include more
shit okay that's control
H but we also need to
do Control Star
[Music]
control. like
that how much is that g to pitch me
out
bitch me out
hard wait the tiny good repo is public
it's geohot
XXX I'm pretty sure it's public
Secrets
uh
yeah there you
go okay that finished how big is that
now wow two megabytes we're getting big
boys oh
no it doesn't
work someone's trying to tell me I got
to wear a mask
I not need all the controls maybe I was
aggressive with all the controls we
might just do them one at a
time actually I don't really understand
in control
2080 it includes all the other controls
I don't really understand why doesn't it
just include
them so I don't understand if I just do
20 control 2080 doh why does that not
include 2080
GPU it
does let's just do that let's track this
down oh why is it doing nothing Handler
inclusion directive is not
handled
why is it because I
didn't I don't understand
that no I have cl to P here
though
do nothing for inclusion
directive why is it doing nothing for
inclusion directive
so because I have pragma
once get rid of that I don't know what
that
does is it just cuz I can't find the
files
[Music]
no is an argument declined toly to fix
this include declarations defin outside
of the source
files
[Music]
macro proces object source files only
ignore
includes do
that I want the opposite of that I want
you to handle
includes oh include declaration to find
outside of source file so Dash
I okay this is a different problem at
least I don't know what that
means
we also don't have to do this all as one
thing
actually um let's just do
that and let's make this control
ioct and do I on
there
why is it doing nothing for all those
inclusion directives still I gave it a
Dashi it shouldn't do
that but now let's see if control ioctl
has the one we
need that's just
done I'm not going to call this control
Lal what's the actual stupid name for it
ESL
here in NV octl we can do askal
ases
so do control ioo as
control
what controll octl has some wild
bullshit in
it what is
this the comments are
broken
oh oh I hate including
things it don't include things I regret
including things that's right no one's
included
anymore no one's
included all right are these controls
all base controls or does some of them
include crap some of them include crap
280 does not include
crap okay 2080 star. let's try
that
rebuild why am I red declaring
stuff I don't understand why we
declaring stuff
most things are getting
added unhashable type list okay that's a
different
problem
um just check in
UPS MV octal here we'll say and type of
I did this wrong you actually have to do
this
uh is
instance
okay good now we have these commands
being handled um I don't really care
about these we can just skip that for
now
okay we don't need to print that either
water
print okay so we have the the commands
now for the
2080s let's get the commands for uh the
Z
zeros so we want control z0 this is
probably fine to just list
out
Cen it's kind of
slow boring boring boring okay what
other numbers do we need we need
six so Nvidia breaks their stuff down
into these
like yeah this okay that's just that one
that's
bad
um we need C3
CF I like T what a bunch of these
are get class engine
ID um what other ones am I missing I'm
missing a 2080
there
um oh this is just
[Music]
we need 80
too I'm sure these numbers all
correspond like special Nvidia
crap prob I love that Nvidia made this
open source this what I mean like
they're really just as open source as
AMD is when it comes down to
it like when it comes down to the things
you care about when it comes down to
lots of crap you don't care
about all right what's the problem
here there's just like two of them that
are
broken I can't autogenerate
anymore what's broken about that why is
that one
broken why does that
not it's literally just this one of
course it involves a mask I hate masks
man no no no I I don't want to do
that
I have like little touchups in my
autogen stubs
here replace that with just
one control I
O.P I should just copy the set why don't
I just do the
said I just a will de bugging so it
doesn't print all this crap even it be
faster okay cool uh we're still missing
this where is this to
find
wait
oh control get oh it's not all control
GPU I
see C all control command I see that's
control get so I think we just do
control
there okay
cool uh we're just got to get this one I
think this is going to give us all the
strs too I'm not 100% sure on this but I
think I think these contain the structs
yes they do oh we're in luck oh we're
going to get some major parser parser
parser parser so look they're they're
autogenerated from fin files what's a
fin
file um but yeah you know now that we're
switching Tiny Box to Nvidia we really
like can focus all this stuff on
Nvidia my my addiction to GPU
understanding um uh okay we got a CB 33
over here got one 1280 that didn't parse
I don't know why that 2080 didn't
parse CB
33 AK
resolution
meditation in honor of the reolution
it's half off at the
Gap you're working on removing Global
size and local
size
okay if you do it
nicely I've tried that before and I was
never uh thrilled with how it came
out yeah that is a great song
right
where's this one and why didn't we
understand what it was this is the
secret one that Nvidia doesn't tell you
about if we found the secret
one I few of these being
secret they're not actually secret
there's like stupid reasons you
can't get
them whatever they can just be unhandled
cmds
added CB 33 we have CB
33 I wish this was
faster
okay all right but this doesn't look too
bad now does it here let's intersperse
it with the bug equals
4 all right so basically nothing at
all when it runs anything this is all
just setup
stuff um
uh all right let's find the
strs doesn't have a
struck
how do I find the structs for these
things where's the struct for client
address space
type okay this one has a
struct oh I have to get the put the
whole thing in okay
cool um great so we should be able if we
just add the word struct to this it
should kind of
work um get
out
get
[Music]
control X
nocore Plus X none that's probably
right
are they all none don't all be none
please there are none there are no
structs I do this wrong stru
Dash
oh there doesn't know the word CMD I
see I just supposed to know
that no like that one just has the word
prams after
it do they all have the word pams after
it oh they all the word pams after it
okay we got to add the word
pams see if this gets us any of
them go that
one
okay
um
if is not
n uh we have to get like the data from
this
crap poter or
something do
this p.
params s. is that right getu s. Pam
struct SS
on format
struct okay look at the work submit
tokens that's pretty good it's pretty
good all right we're getting somewhere
okay
so pretty
good
you want to do a long print for this we
can throw some join in this
bitch I forgot how little of this was
actually done with IO
controls
there we go pretty
cool
um actually remember there being a lot
more of these last time maybe there
NSS oh yeah here we
go okay so we have to Let's parse RM
Alec RM Alec was interesting
yeah here we
go sh I wrote like crappy like uh
rappers for this okay RM Alex worth
parsing
um what's it called an AR like pH class
oh no we have to we have to get a struct
we don't need that this is like I wrote
hundreds of lines of c and I thrashed
around you can watch me on that
stream
um
oh yeah those so those the MV Alex
now uh H object H class is kind of
interesting so I think the class is the
um
yeah this is like the object like
creates these things so the different
objects are pretty
interesting how do I get the name of an
object from a
class can
I
oh here okay emper Channel
gp5 out here G all
classes this one's interesting I
remember
let's try
this cl to p g all class
his class
control
there we go that's cool that was
easy go
here
classes actually do
everything
class iio control as
class MB
classes um
print oh it's not called what's it
called H
class sure it's not in some of them yeah
there we go
has no attribute as dick Mixon
oh that looks cool
right unhashable type list where's the
list
inance
it highed X is not defined what do you
mean oh
yeah okay so
cool I didn't close my
brackets got to close your
brackets okay pretty
good
uh RM Alec let me throw an RM control
here yeah
let me add a space to each one of these
and two spaces to this one look a little
nice Okay
cool so we're
aling
yeah the controls are probably more
boring any
Alex there you go all right make a root
client o confidential compute and then
don't use that one it's
secret I did include CB2 no that's
secret confidential compute
boys
um this is a I think it's different on
um maybe it's different on ad I don't
know yeah so you have to like Alec this
shit and then you control the
shit
yeah uh it's also worth looking at those
trucks because you like
Target you target like the
theem with those things so you see it
like creates a
device
um Okay so control command host get caps
how come I don't see that
struct okay yeah they just get rid of
the word
command but they keep the word
params whereever I get those
strs do any of them have the word
command in them yeah this one has word
command in it I don't
know let I should just Nest
these I think we got a bunch more there
there a
lot
um yeah all right so we figure out what
what these things correspond to um Alec
is not memory oh let's check out R map
memory that's probably
Cool N
the
oh with FD I
see I can get an FD here
format struct
app all right good that's a lot of
boring
stuff
what's the most interesting thing I
guess pinear
address
yeah so there it like maps all these
different
addresses pretty cool um so actually let
me show you
something direct
torch let me show you the power of
something of the
sniffer so we can import the
sniffer
here and now we can import
torch ready for some
Cuda look at that those are all the nvi
octal that torch
uses so I went a lot further in my C1
and I actually wrote a sniffer for
doorbells and
everything um I didn't do that in my HSA
one but yeah I uh I parsed The Q's The
Q's are a lot more complex
too because you have to
um yeah so by the way all this stuff all
these structs now that I have here are
now
usable in
um we should probably put these all in
the same file I didn't actually use that
did I actually use that import thing
anywhere no I
didn't uh so this probably all belongs
in the same
file with some like little wrapper
scripts around it so we can create a
header file that contains all of these
all of these structs and all of these
things right they're usable it's pretty
easy to now construct these things in
Python so I wrote I wrote this all in C
like a long time ago if you remember you
can watch that old
stream uh
GPU driver. CC
right kind of like oh c is so
ugly Comm
crap GPU
setup oh wait this like not
even yeah I created this thing called TC
contacts read it this is probably where
I'm calling all the like look here you
make an Alec object and then you call
the ictl on it and you check some
things I just think this would look
nicer in
Python probably is good to put them all
in one big Envy
thing the name should be different
enough yeah this one maybe is
annoying it's nice that this one's
actually uh
distinct but yeah so the question is how
much does this
API like
compute uh dma
copy interesting it does nothing
there that must just all be on I mean I
wrote all this I wrote all this in in
Cuda IO control
sniper but yeah I mean it's nice to just
bring this into the
uh into the kind of tiny grad
world
oh Nvidia doesn't use any I mean it's
smart Nvidia doesn't use any IO controls
when you're running let's run more Ops
and see if it continues not to use any
IO
controls so it is doing some RM frees it
is doing one Alec memory and one
free for each one of
those um so usually you don't want to
use IO controls cuz they're
slow um yeah if you can avoid using IO
controls it's a lot
better
I way to far to see
one
stru are really slow in Python though
but it's all just set up oh
yeah yeah you can check this out I I
this is this is how I know about all the
uh remember I was talking about the
Slowdown crap so there's actually this
command called get sm issue rate
modifier and yeah you can find out that
these two are half speed but if you run
that same thing on a a6000 they're not
yeah we have to write
like all the abstractions to do this
stuff correctly also a lot of this stuff
I didn't find in
um only some of this stuff I found in
the uh Nvidia driver some of the stuff I
went to no
for um but this this code does work or
at least it did work I don't know what's
updated uh this code does work to sub to
actually submit a Cuda kernel without
any
um it's crazy that tiny gr's kind of at
the point where we can like almost
consider
this it's still going to be a lot of
work but I think we can do
it and then yeah we'll have a we'll have
a stack that's completely independent
of uh of
Cuda so yeah this openg GPU kernel
module is
uh it's I'm actually
licensed didn't say anywh data center is
it uh so yeah if we could just just not
use uh not use Cuda at all that's uh
that's pretty
cool
a sovereign stack like there was a time
I thought like that was like like an
impossible dream like I was like that
could never happen but I actually think
that we're almost to the point now so we
got to go one layer lower and again it's
been it's been niml genen on on uh
Discord doing a lot of this he's now
he's now employed by the uh by the tiny
qup
um doing the uh HSA stuff but if we get
to HSA kmt I think this is a little
little
bit there's a little bit more crap here
but I don't think it's too bad just
figure out what these cues are figure
out how to submit them it's actually
kind of nice that it's lower level
too this what I mean like in many ways
the Nvidia stuff is uh is more open
source than
AMD give those stupid Nam
really good names
whatever oh then yes let's look at this
for a
sec so yeah this is all the this is all
the the setup stuff we can also probably
avoid a lot of this and then the G GPU
will uh boot a bit
faster we'll have some multi-gpu systems
we can do this on too and see what all
the multi-gpu calls are but I think
they're not anything okay the other
reason that I'm interested in this is I
think that dma between the gpus might be
possible maybe with a tiny
hack uh so let's take a look at our
device here
what this
one
oops Yeah 16
gigs so this 16 gigs is the entire uh is
the
memory actually it might not be the
memory but my point is we can map the
entire memory of the gpus this is called
the bar uh the Base address register so
this is a large bar small bar means it's
only 256 Megs so we should be able to
map all the GPU memory into like host
address space and we we might have to
mess with the IU a little but it's very
possible that we can just use a ampere
compute dma engine and then directly
copy between
gpus so since we switch the tiny box
from Nvidia to AMD we have new
challenges um so nvidia's challenge
amd's challenge is that their driver is
a piece of shit and just hangs
occasionally and it turns out you can't
fix it because it's in firmware and you
know I email them
look aail with Lisa Su she's very
nice
um I mean I don't mean that is like like
an insult like it's it's it's not
like um trying to
like look we can like shame them and
saying like you should open source this
this is
terrible but I don't
know a it might not work and B whatever
man it's like it's like it's their thing
if they don't want to open source it
that's on them I think it's
stupid like I think I think they're just
making a mistake do they why I'm happy
to do this for AMD
also um I wonder what I wonder if even
like I don't know how these people think
like what percent chance of success do
they assign to Tiny grad as a
framework
um what like I don't
know I don't know how they think like
like here's what I would do right if
someone came to me and they
were they looked like capable i' I'd
gatekeep them somehow I give them like
oh well you want me to open source that
like solve this problem for me
right um and you start them on some
bullshit like you
know here here's my way of contributing
here's
bounties uh you know you want to I
here's the shit like you want to you
want to contribute to Tiny grad you do
the bounties right like it'd be it'd be
cool if companies kind of work that way
like there's some kind of like some kind
of
like uh you know why don't you get why
don't you get stable diffusion running
in half the time it's currently running
in or
something
um and then we'll open source it right
like there's some like I was I don't
know I don't
know I'm just
tired
um
yeah but they're nice but they're not
going to do
anything and I almost wish there's some
like these business people why don't
they just say
no like just say no we're not going to
open source it fuck off right like why
why
engage and and then you almost think at
some point it's malicious right you
almost think at some point some guy said
that on Twitter like
um the companies are you know it's it's
a deliberate kind of they don't really
want you to succeed they they they hold
you back they gatekeep this way it's
kind of fuck gatekeeping but like I
respect gatekeeping right and let's
recognize it let's understand what
they're
doing people in business can't believe
someone would do something for
free
yeah yeah there's probably some like oh
why don't you contract us to have IP for
a driver but then you know you're just
as bad as them right like we're here to
disrupt things we're here to change the
world if we want the world to be the
same if the world's going to be the same
at the end of you doing what you're
doing why are you doing
it I want to get rich why do you want to
get rich
Bros why take it from a guy with a
Rolls-Royce why do you want to get
rich most fun I ever had my life you
know you really
like I think back like Iceland bike trip
I think back to like the two days that
it rained where at Campground just
rained for two days straight we just
stuck in this little shit tent it starts
leaking water into the into the tent no
being rich doesn't buy Freedom who told
you that you know what buys Freedom
having nothing to
lose wait no no no no
no being rich do does not buy Freedom
being
rich means you have something to
lose I could buy AMD and open source
stuff okay I mean that's a crazy tier of
Rich
sure by the way I wouldn't buy AMD I'd
buy Qualcomm and fire their whole sales
team you got a point all right well I
mean there's rich and then there's
actually I don't think anyone could buy
AMD being dead is the true source of
Freedom
respect all right let's
uh
okay okay Apple can buy AMD in cash no
they can't actually I would hope the FTC
tells them to fuck
off
um no I would seriously buy qualcon
though the quad's market
cap it's actually super
undervalued it's it's it's a shame how
much they suck
but
uh
God I mean they
suck but their chips are
good
are they going to fix it do you
think like look at how this company has
had no upward share
progress it has a pretty low PE I
know wait literally
vby like vby decoding founded
Qualcomm um man but I could fix you know
I always say this I could turn this into
a trillion dollar company
easy put me in charge of Qualcomm like
actually in charge trillion dollar
company easy
AMD I don't know about
that man should i b qu
St I always think I always think about
what the I hate them though but it's
going to go
up
yeah well no t torrent is not better
than AMD Intel and Qualcomm they might
have a better attitude than those
companies no okay Intel is Intel is
fucked uh Intel yeah I mean do we even
need to
really uh yeah no
uh
does Intel have a chip that you want can
you name an Intel chip you
want yeah Intel gets handed money by the
government like that's yeah
sad sad does that pump their share price
with their free money how much of that
20 billion had a Dei requirements
attached to
it
um
no God to this is not going to be a
thing they can't give that shit
away it's it's that to I mean I again
look at the just just just look at the
uh Jim Keller
test what happened when he went to Intel
well I don't see a Revolution coming out
of Intel anytime soon um I mean the
problem with tens torrent
is their chip is not the best approach
to running current machine learning
algorithms
because they're spending a lot of power
on decode for those they have five risk
fives in each one of those engines they
got to be burning a lot of power on like
on like like each one of those chips has
a little
pipeline um and I'm not sure the
programmability makes up for it enough
I don't know this I don't know this
actually um but it's not the kind of
chip I would
make right let's let's all right that'll
be a good end of the stream you want to
you want to take a minute and and think
about the kind of chip you want to make
think about a chip because that's the
only way to beat these
people chip.
[Music]
txt
okay so you're optimizing for a few
things
um care about compute per watt and you
care about compute per
dollar so first off um there's
absurd margin in just uh matching in
video you know it's a it's a
$3200 being marked up
[Music]
to
uh
30,000 so if we could just literally
build a chip that matches an Nvidia h100
we sell it for
$110,000 um but you have to have like a
good software stack right and this is
why like Mi 300 doesn't succeed Ed it
can never succeed I I I I
don't AMD I offered to fix your driver
for free and you said no
right you think Mi 300's going to
succeed your your strategy is not your
strategy is literally copy Nvidia
badly this is not a good
strategy I don't know what to
say uh
yeah no Intel acquiring arm wouldn't fix
anything I stopped having hope in Intel
when their Fabs just fell
behind um 200% profit that's that's like
that's just
insane more Nvidia stock it's so over
value guys like the market knows about
this damn why' I sell my Nvidia you
know
so why I can't play the stocks fan you
know you just you just lose you lose the
finance Bros who think about this all
day um the only crypto games you want to
play are like straight up like clean
single block ARB games even try to play
like what did meme coins now like want
to play these
games
um okay so you care about compute for
wat and you care about compute per
dollar uh okay so a lot of your compute
per watt has to do with data
flow and
scheduling so you're you're you're
burning you're burning the shit on the
straightup Al it's actually interesting
um Nvidia has started playing with small
data
type small data type uh helps you in
many ways small data type helps you as
your ALU is smaller you fit more in each
one of your caches less Ram that's why
they're pushing fp4 and stuff right um
oh where's that continue tweeted at this
fp4 uh values it's so
cute yeah
fp4 this little Matrix it was very
cute
um nxp or am logic I don't know if they
have any Leading Edge processes STM I
mean STM has nothing that's Leading Edge
as far as I know I think we're on the
Tom uses the stmh and I think that's the
newest
uh yeah the embedded
stuff they're not on they're not on
leading processes okay uh so you want a
small data type you want your data flow
uh you want to
staticly schedule
this
ically am I spelling this
right okay and then scheduling um okay
so scheduling
is like what kernels run where and
when if your if your data flow is all
statically scheduled your your
scheduling is all kind of uh done for
you okay compute per dollar so um a few
things about Compu per dollar uh you
want to use chiplets AMD is actually
ahead of NV video on using
chiplets um you use these massive dieses
and chiplets will help you with with
yield basically so the the're they're
moving to these if you want to look at
the the
gb200 uh what it actually
is now where's the
chip they show the chip here this the
chip B this a B2 200 sorry
um so yeah they're doing the largest
chip physically
possible uh the largest chip physically
possible
is what I don't even know what this is
this is what I'm thinking
of um
wa they're
all what's the difference between these
that they all have the
multiple this is
crazy
well you can like see it compared to
Hopper yeah yeah uh where's the zoomed
in there's a zoomed in version of that
picture that's actually nice you you can
see the
dyes um so they do have it is it is
chiplet
architecture uh but where's that oh I
guess this is it
okay
um so you look they have two compute
dieses and then these are memory dieses
around here so you have your compute
your memory and then these are your uh
Communications interfaces
some of this stuff is just some of this
stuff is just
insane so that's matching Nvidia but if
we want to beat Nvidia I think the main
way to beat Nvidia is better software um
so what I mean by better software is
basically just better
scheduling
Nvidia one way to compensate for not
like being careful with your scheduling
and stuff is to just massively overpower
everything so these chips have a ratio
of actually I don't know on this one but
I know the hopper one so the hopper
ratio is 900 gabt per second and vlink
and then 3.3 terabytes per second of
main memory so that you have this ratio
between memory and Interlink like that's
an insane
ratio
um yeah uh
that's what we need better software
better scheduling pop
Johns uh by better software I mean
better
scheduling uh it's all better scheduling
it's all some form of scheduling all ml
compute is
static uh very few exceptions and we
kind of have like hack workarounds for
them in in tiny grad
that that that work out pretty
nice uh you know Gro is a scam because
they're using 230 Megs of SRAM I don't
think that's my Gro a scam why because
they don't have hbm you don't really
want
hbm Gro a scam because like it's just
like I don't know again like what do you
do if you're you're grock right your
Demo's not
competitive I don't even blame grock I
actually don't blame grock the grock GU
is fine the the way that the Press so
uncharacteristically was like oh 500
tokens per second mixol I can literally
do that I can do that on a tiny box
green on a tiny box green if I quantize
to inate I can get 500 tokens per second
mixt we'll do it we will deliver this on
a tiny box screen wow wait that sounds
pretty cool
right uh I think we can I think we can
do
it it's VC hype it's VC hype they're
trying to raise money that that's what
needs to go
um should we beat them on a tiny box
screen I don't
know all I'm thinking about is this
stuff now though I'm just I'm obsessed
the chips and the gpus
and um it should be doable but we're
getting better I'm not liking to get up
but if you check um gpt2 is getting a
little bit
faster uh am I really bearish on on gy 3
[Music]
yeah yeah I think it's good I mean I
think it's good for NVIDIA to have
competition but do you know anyone who
uses
it like it's it's it's their gpus too
who uses who who has an a
yeah
um the people in Nvidia are thinking
about all this stuff and they're just
they're just way ahead right
now tiny grad and this method of
attention the attention's not too bad at
batch say
one paged
detention we I want Ty to autodiscover
these
things no it's just
like I'm just going to write the word
better scheduling three times it's all
just better scheduling better scheduling
better
scheduling Intel's always struggled with
drivers I mean drivers
are I I haven't seen any instability
with the Intel drivers like I've seen
with the AMD drivers
um yeah it's this if if we have any hope
of like beating Nvidia it's this it's
it's it's better software with better
scheduling better scheduling better
scheduling
um no Intel Intel needs to fire most of
the people who work there yes we all
know
this
uh chip what's in design
V2 wow we've really improved
this WOW tiny grad's come so far since
this
shit um
let's just write better scheduling a few
more
times to remind myself that that's what
I really need to be working
on not messing with maybe there won't be
a stream tomorrow maybe maybe this is
your weekend stream
boys
um I just want I just want I got to get
got to get to work on on
scheduling there's so much stuff that
needs to be scheduled like the tiny gr
dream is doable why did I get caught up
in this stupid AMD
narrative I just fall for Stuff guys
Twitter's really
bad um scheduling architecture you
looking at I'm not talking about an
architecture
so uh both the uops and the colonels
look like graphs I I here I can uh I'll
show you this I can show
this so let's bring up like let's bring
up that tiny ad
example but I can like show you what
tiny ad is it's very it's very uh human
readable it's just literally an adding a
three numbers together so let's graph
uops
net uops
svj okay so that's what the graph looks
like now you can put these uops let me
see if debug six Works do I have apple
GPU
cloned
disassemblers let's pull and see if this
is
better Apple GPU did you add support for
the M3 three no no support for the M3
yet or I'm doing something else wrong
all right we'll just do debug five a
debug five s of uops so this is the this
is the linear rise this is the topos
sorted form of the uops and this is a
graph form of the uops so for this
simple thing it really doesn't matter
but when I'm talking about scheduling
I'm talking about like that um so
there's also here I'll show you another
form of scheduling so I can say graph
equals
one of mest actually let me just do jet
graph equals one so this graphs what's
in the
jet uh we can do n SVG here so this is
actually that's a that's not what we
want that's what we want so this is this
is an amness
trainer and how it works I'm so happy I
fixed a sign I fixed the sign this
morning
um but yeah so how you choose to
schedule these
things uh qualin is working for working
on uh grouping some of these outputs
together in atom so we should be able to
like group these load off of signs into
one thing oh man this is
cool but yeah
the graphing is cool
right uh yeah so these are these are all
like the the Ops and there's really only
three kinds once you get down to it
there's reduce Ops there's element wise
Ops and then there's movement Ops so the
greens are movement Ops the reds are
reduce Ops and you see the ones that are
shaded in that means it's actually
realized so like this contains these
things as well in this kernel and it's
kernel number 19 and it's writing into
buffer number
49 so by scheduling okay what order you
want to put these in here that's you
want to take a look a little bit we can
take a look
um we do debug equals 2 that shows all
the kernels eventually they end up in a
batch executor like this uh but if you
want to see they all here too you can
also disable the batch executor if we
say J equals
2 um yeah so that's all the kernels that
are uh that are training uh that are
training um so yeah back to the uops
graph um so that's a pretty boring uops
graph but let's get a better uops graph
up
here let's do a gem actually do for only
to okay so this is what a uh what a gem
looks like all of this here is Computing
indices uh we have to compute indices
into the
Matrix and then we do some
loads uh oh this is actually using wh so
what wh is our uh our tensor course here
disable tensor TC equals z does that
still work yeah cool so we can disable
tensor cores and then we use the ALU so
those are the ALU
Ops um if we enable tensor course we get
Wham man this stuff's so good
now wow this is if I just showed this to
like me two years ago working on Tiny
grad and was like this is actually going
to like be good one day and have wames
and
stuff um you see the metal wames you see
this a metal
Wham Intel has wames too they're called
deas uh we have a we have a $4 Bounty if
someone wants to get depa working
um all right do a little chat with uh
let everybody talk maybe some people
have good opinions on
chips
chips so yeah chiplets yield then um
interconnect
cheap Nvidia is doing melanox say
burning p power you don't want to do
that
hexagon it's
fine yeah I like this God qu's actually
quom makes good
chips how has no one realized that like
qualcomm's the AI company
at
um the problem with AMD is the driver
the problem with Nvidia is the
price imagine they sold oh imagine they
sold h100s for like five
grand well the problem with AMD turns
out to not be The Driver the problem I
mean the you want to root cause the
problem with AMD it's not the driver
right it's the culture that led to that
driver and the culture is we do not root
cause issues we mitigate
issues so this is what they do for video
games it was just like again I'm going
to say that they were genuinely trying
to engage with me they really like did
try to
like help to an extent they're just not
very flexible right they're like like
they want to like shoehorn me into this
thing where you're like a
customer right like we can send out a
field application engineer to diagnose
your problem and I'm
like no I'm diagnosing your
problem
um yeah look the only way we're going to
beat Nvidia is with better software and
better SK in and that's where I need to
focus not on this
stupid uh GPU crap at least nid is the
right place to not focus on stupid GPU
crap more the South Harman Institute of
Technology oh I've heard of that good
school
that's how we beat them are our Edge
over Nvidia yeah I'm yeah I'm you're
right I'm done with the AMD drama we're
over AMD
drama um to make a better chip you need
to make it less
flexible yeah t to chip I mean torn has
a really long way to
go they they started with a chip they
didn't start with
software and their chip is very
cool um I think but I think I think
someone described it as a toy and it is
a toy it's an $800 toy it's a pretty
cool toy um like again if I was I think
also by selling those I think that
there's a lot of like college kids who
are going to buy those and these are the
kind of kids like I just don't have like
time you
know if I had if I had like tons of time
and nothing to do yeah I'd love playing
with that Tor thing I used to play with
the dumbest Hardware in college
like um and it's like cool no like I
play with Hardware that was like cool
I'm really I'm very bullish on Ten's
torrent in that sense but they have a
long road to go to be competitive and
their their software is not good they're
they're trying to like shoot warning to
a pie torch they have they their
examples are based around pie torch and
this is such a
mistake
um no but
uh you know what like if tenens Tor
continues to execute the way they've
been
executing to like build out in the open
to sell
cards like they will win if they can
keep it up for 10 years this is how
Nvidia built what they built
today they you know what I was you know
what I was playing with in college
Cuda I remember 2009 no it's
2008 I'm sitting in my dorm room at RIT
and I'm reading the Cuda dos about like
waves and like I'm like
man like this was a lot of people
probably had this
experience scheduling is NP hard after
all just put it off in the future where
AGI exists yeah that's kind of the
strategy
right I mean you know lots of things are
NP hard and like it's not really a big
deal does chiny gr work with modules
models larger than gram well what do you
want to do you want to move it over the
PCI
bus um the PC e bus is so slow that the
discs in the Tiny Box match it
[Music]
uh about Cuda and I mean you know in the
arm the
iPhone one of the things tend torren
doing right is they're understanding
that they're
like design designed for scale Nvidia is
NVIDIA has shoehorn scale on top of the
biggest chip we could possibly make
right they're like we're going to make
an absolutely massive chip and then like
like does it scale well yeah you know
why it scales because we we like bought
melanox and we put Envy switch
like
wow do do other did did AMD copy Envy
switch yet do they have knockoff sharp
somewhere in rickle they have rickle is
it called
rickle it's actually called
rickle
dude this is not a
strategy this is not a Strate you do not
win like
this
oh yeah yeah yeah
wow wait does it actually did they
actually take code or did they just take
the
version oh they might have actually
taken
[Music]
code
we beat him with
software what's
neuromorphic Intel's building it it's
why not
good what do you mean by neuromorphic
right like in some way tends towards
neuromorphic like do do you mean like
biologically plaus like like
like um now we're done with we're done
with the beef with 18 Twitter Twitter
encourages bad behavior you
know all right
guys Twitter is what we make it the
world is what we make
it
why did grock back back down from the
Twitter
bet you think that not
serious um if I hadn't spent this time
with AMD we didn't actually waste that
much time on AMD they also offered to
buy back my gpus should we sell the gpus
back to Nvidia to AMD or should we dump
them on eBay what do you think boys
um again that's what I mean like they're
very nice in that
sense like they don't want me to have a
bad time but they're not going to like
will they take me at full price again
like how much do I really care about
four grand I guess I kind of care I
don't know yeah we we'll we'll we'll
we'll send it
back
um
what particular scheduling
problems uh yeah so like a lot of the
problem so there's a ton of things you
can schedule and they should be
invariant but they're not so we're
working on like fuzzers to make sure
they're invariant oh they're not OnePlus
bad one OnePlus is so
sad that's like AMD was never good and
they're not getting better OnePlus was
good and they've become shit
um Bill Amman do you want to have a
trillion dollar company wait I I'll put
in I'll put in every dollar I have you
put me in charge of Qualcomm I will put
every dollar I have into
Qualcomm uh and we will pump it
[Music]
together
we we'll put a qualcom chip in
everything we'll displace the entire
embedded Market with Qualcomm
chips we're going to make the best we're
going to we're going to make the best
developer experience in the world on
Qualcomm chips and we're going to sell
them at a reasonable
price oh wait Bill Lan's fucking with
Google that's good someone's got to fuck
with Google all right
um we need to fuzz the Topo
sorts do you want to read like all my
old all my old ml plants I don't even
need to move cities I'll just I'll go up
to San Diego I'll take over Qualcomm and
I'll fix the
company
um no they're probably going to fix
themselves
actually he claims their shit well yeah
imagine a raspberry piie with qualcom I
know but the problem is you can't work
with
them tiny grad should acquire
AMD no
no AMD
also yeah fire all the BD people qual
fixed it's it's like qualcom can be
fixed
overnight um is it not solvable
bypassable it
is probably mitigable we could probably
write some quite good
mitigations but this isn't where I want
to spend my
time um like I said I think we're going
to end up still getting AMD on ML perf
uh just if like it happens to run
there no I don't I don't want to be an
activist investor in AMD I I think that
like you know you you you can lead a
horse to water but you can't make him
drink
um we'll see I mean I I hopefully got
the message across the balls in their
Court like open source stuff slowly over
a year it still like kind of
works uh
yeah like we we could hack around
everything but it's just fundamentally
like you're you're building a temple on
top of a shit on top of
shit right and can you build a temple on
top of shit you
can
the people that make AMD bad I can't
point to exactly who makes AMD bad I
don't think Lisa Sue is
bad
um I think that they have a misguided
strategy but that's different and I'm
very well may be wrong on that right I I
don't know again I don't really know how
they think I know that their drivers
have been shit for 15 years and they're
going to be shit for you know ever with
the current strategy I know that
but like it's not it's not like I can
snap my fingers and fix the driver like
why they're shit I don't know who
knows if you maybe if they open source
it we could find
out
um versus yeah versus
Qualcomm get rid of the IP licensing
shit sorry Huawei already patented all
at 5G this is not stop trying to rent
seek and start trying to sell chips see
this is why I have so much respect for
NVIDIA what did Nvidia do they sold
chips IP patenting who the hell
cares right this
is
that's what happens when you focus on
selling great chips that's what happens
when you focus on IP and
Licensing you
know and that's what happens when you
sell like kind of okay chips and have
shit drivers you have decent
CPUs but
um
you know you have no AI
strategy your AI strategy is
[Laughter]
rickle this isn't going to
work
I I don't think she said I make an edict
Let's Help George I think she
[Music]
engaged again in a polite way but not in
a serious like we are going to make any
change to our
process right there these companies
don't function like I make an edict Elon
makes an
edict working really hard on
rickle wait
oh I would not be I would love Nvidia
trying to trying to
wait for putting 649s in a box you think
Nvidia is going to sue
me this is
delusional if I built a huge cloud of
490s and then started selling inference
as a service to people I maybe get a
cease and
assist uh
like but probably not even
then putting 640 90s in a box and
selling them to gaming enthusiasts
Nvidia like loves this
shit why do you think like everyone got
so scared by that not licensed for data
center deployment again you didn't think
who that's targeted
that wait well look what they did for
the minor actually what they did for the
miners didn't sue any miners they didn't
try to inia doesn't use legal stuff they
did the same thing they did with the
with the Locking of the the the
309s aw's getting sued all day who's
AWS they did a firmware lock right they
did lhr like you can respect
lhr oh AWS getting sued all day well
yeah again if aw yes
if AWS deployed 490s I mean it also
probably honestly wouldn't make sense
for them when you're at the scale that
AWS is at you don't like you just get a
good deal from Nvidia probably I don't
know it's also becoming less relevant
like 490s are still a great deal today
but if they really price b200 at 30k
it's just it's just the Arbitrage is
over they really pric b200 at 30k comm's
going to buy
some I mean but you can't just also like
buying one b200 doesn't really work you
have to have a uh you have to buy eight
of them you have to buy the big machine
right doesn't make any sense to like buy
the one PCI card that's like super
throttled and
underpowered um no there aren't they
don't really make ml products targeting
the price range that Tiny Box is uh is
targeting um no but Nvidia is not gonna
they're not gonna Sue that's
absurd
uh like companies that are that are also
companies that have stocks that look
like this like do they really think it's
any threat at all to this no way I'm
going to sue suing me is a bad idea yeah
to
um how is Sony stop
doing
o o that doesn't look good o that that
doesn't look
good
um and that's the kind of company who
sues right like a sad company
you
know that company puts the firmware lock
to fuck the
miners
um I wish AMD worked out
too I wish they were like excited
they're like you're really going to get
our cards on ML perf Nintendo Su yeah
Nintendo Nintendo it's like a different
kind of culture it's like uh it's the
Japanese business
culture um diss track plus
puts can you clone comma Ai and do the
same idea no I patented the idea and I'm
going to come to Egypt and sue you yeah
have you seen
kamu
kamu you buy the KO assist we love these
guys um also like we like that you know
look yeah bua pilot is built off of Open
pilot uh which will be supported by
Malaysian
ourselves uh yeah it's a bunch of
Malaysian guys if you're if I was in
Malaysia this is probably a better
experience than a com
3x um they added a bunch of cars they
had a bunch of local Malaysian cars like
good on
that well you guys never heard of
Koo better than
ours you guys know I just love this
though like it's it's not
about it it's not about
no R is pretty good is not that bad it's
pretty
cool is
better can we Speed the video
up nobody even K already supports both
sides of the
road
the rain is more dramatic
right oh I mean I don't know the product
doesn't look as good they're not doing
it at the same scale as us the 3x is
really nice
I want a KO if I lived in Malaysia it
probably be a better
buy creating value in the world
technically is all about asking a
government to force someone else to give
you
money we love kamu
right again like don't be SC
and
uh it's like look kamu doesn't Leap Frog
Kama in the same way rickle doesn't Leap
Frog
nickel all
right goodbye
everybody I don't think we'll do this
maybe we'll do a stream tomorrow should
we do should we do uh should do AMD dve
drivers tomorrow do we want to spend
more time looking at AMD drivers or we
just done with
AMD one more look at the AMD I don't
know let look
rle oh you want to be
grock AMD is entertaining as I get mad
easier uh AMD is
sad today was too chill yeah I'm
tired more
scheduling any more
scheduling better scheduling better
scheduling better scheduling better
scheduling
don't do politics do cocaine before you
do politics yeah that's actually
probably true they say that you know
like drugs are bad for you but wait till
you see some people on politics man that
shit really rots your
brain can't Tiny Box get cloned for
cheaper I encourage clone
makers
um D Tiny Box is not open source you can
like try to make a
clone everyone says those things are
easy but like actually do it it's really
hard um good night
Let me see if I set my microphone up
correctly. I believe I did. We could
place it a little bit closer to
me. Look
left. Have you guys seen this hoodie
before? Uh, I'm debating if I should
close the window. It's kind of a little
loud. You guys hear the
outside? It's
outside. So this is our I've prepared
something for today's
stream.
Uh I was originally going to name the
stream struggle session but that is just
setting us up for struggle and I want
this to be
uh great and easy. Good morning. Good
morning. What is the general goal of
this
stream? Oh goals. Goal oriented
behavior. H. Oh, that's what they're
going to put in the AIS that kill us
all. Oh, it's Saturday
morning. Maybe there's some cartoons on.
They still have cartoons on Saturday
morning. No, the kids are shot in the
head watching Tik
Tok. Both Tik
Tok. It's a bit loud. That's what I'm
saying. All right, we'll close the
window. Close the window.
It's not even all the way closed. You
practically need a pair of pliers to
close the window. We live in like an old
building. So, yeah, there's that.
There we
go. I want someone to bring me a
Starbucks. Someone want to bring me a
Starbucks. We're drinking We're drinking
this this watermelon mint highball
energy, but it's not really hitting the
spot like a like a like if if you're out
there if you're out there like a large
cold brew with 2% milk. Like that.
That's what I'm saying.
I'm in HK. No, I'm in San
Diego.
Um, good morning. Okay, so this is what
we got
today. We got viewers. How much viewers
we got? 89 viewers. Should we wait for
more
viewers? Black hole from Tenstor. This
came in the mail all the way from
Canada, I
believe. Um, do we have import tariffs
with Canada? I don't know.
Uh 215. All right. All right. Need more.
Yeah, we need more to open the thing.
Once we get 500, is that how many we
need to open the thing? We can just we
can just I mean that's that's this is
the best part of the stream. You're
going to see that little like you know
the Pornhub little tracker thing with
the with the views. Pornhub invented
that. By the way, um you know, you're
going to you're going to see the part
where I open the box and that's going to
be the best part of the stream because
everybody can relate to opening a box.
You know, everybody in their life has
got except for poor people. No, but even
poor people. No. Is that poor? I don't
know. Maybe in like maybe in like Congo,
but like in America, even the poorest
person in America has experienced the
joy of opening a box, you know? I love
society. Jim Keller sends his regards.
That's great. Uh yeah. Yeah. We're
playing with we're playing with Jim
Keller's uh work. We'll see if it's any
good.
No, Grock sucks because they didn't ship
anything, right? See, we got to talk
about I respect Ten's Torrent because
they shipped a thing, right? This this
company is going to be successful in AI.
I'd almost like buy shares like this
company's going to be successful. And
it's interesting. It's interesting how
like
um Yeah. No, I mean Jim Keller is just
extremely
effective. Before Jim Kelly, they were
not going to ship things. He shows up,
he takes over, and he ships something.
Like, respect. Like, that's what you got
to do. Um, Johnny is going to ship you a
Spider Hockey Punk. Oh my god, that
video is so
cringe. Um, all right. So, let's let's
see. Let's wait while we get some
viewers here. here. Oh, you have the
P100A? Yeah, I bought the P150. I like
those uh network
interfaces. All right, so yeah, I went
to the You can buy a black hole here. I
went to the black hole shop. Um it's a
funny name, too. Black
hole.
No. Uh see like like you see this add to
cart. Go to checkout. Oh, by the way,
Tiny Box
uh reds are on sale. Uh they're on sale.
So, if you want a Tiny Box Red, just add
it to your cart. Uh and then when you go
here to checkout, just type in this
secret discount code, Red
Letter
Weekend. Okay? And then boom, 10% off a
tiny box red. So, if you want to buy a
tiny box red, make sure to buy it this
weekend and use discount code red letter
weekend. Why do I sell it cheaper?
Because I got four of them. Um, I got
four of them. I wouldn't even sell them
if I had a way to plug them in and use
them, but I'm out of power in that
room. Uh, the comma office needs more
power. We've petitioned the city. Uh,
power is so expensive here, too.
You tested Envim, bro. Do you want me to
do subscriber only? See, that's the dumb
shit. I don't even know what that is.
What? Like, that's some Oh my god. Here.
Here's your clip. Here's your clip. I
saw other people on Twitter like even
Gio uses VS Code. Dude, this shit
doesn't matter. Okay. It's like like
there's the kind of people you think
like you think like
uh like uh let's see who's who's a who's
a who's a famous author who I respect.
Do you think Doss DaVski sat around and
like circlejerked about what kind of
penny he used? Dosski was like sitting
there in some like Russian salon. He's
like, "Oh yeah, yeah, I got the I got
the big rider 9,000. Oh yeah, I can
really Oh, I can really write word." No,
he just like wrote words and talked
about like being depressed and shit.
Like that's that's good, but stop, you
know, like like you you circle jerking
about editors is like Doski circle
jerking about a pen.
Okay. Hey, you probably thought about
how much he sucked. You see, that's
that's good. That's good. Uh, talk about
authors I respect. Should I read War in
Peace? Is War in Peace actually good?
Anyone actually read it?
Um, I don't know. It's one of those like
I mean, yeah, you read those things and
you read like Crime and Punishment from
the Underground in your 20s and then
like
um good example. Thank you. Thank you.
Uh, all right. How we doing on viewers?
What are we up to? Are we up to 500? So,
we can open the box. Let's open the
box. No, you guys, I got this box
yesterday and I didn't open it. Like,
look, it's still sealed. It's still
sealed. That's how much I was excited to
wait for you guys. Oh, yeah. He totally
waited until he had Neo with LSP and
Fuzzy Search. Exactly. Exactly. Uh,
yeah. So, you can get 10% off at Tiny
Box Red if you buy it this weekend. Uh,
I just want to get these tiny boxes
moved.
Um, all right.
So, I mean, we'll get into this. They're
infinitely scalable. That's
nice. Uh, we'll we'll leave it on not
subscriber only while we uh while we do
the unboxing. Oh, really? No, though. If
someone wants to bring me a large cold
brew with some 2% milk, I would
appreciate
you. I'm the worst marketer. Yeah, guys,
it's not worth it. LA told me you'd be a
pop star. All you have to change is
everything you are.
I love that. I love that. You know, Pink
really influenced me more. You know the
pinks out there ever watching the
stream.
Um, where' I get this jacket from? Look
left. I bought this was like $6 in a
Hong Kong thrift store. I love Hong
Kong, guys. Um, I mean a cold brew for a
comma tour. That's not worth it. No, I
don't even want to meet you. You can
leave the cold brew at the gate and I'll
go get it after I see on the camera that
you've left. Uh, that's not it's not
worth it, man. That's That's not No, no.
That's That's That's disrespectful. But
that that's crazy, man. That's just
going You know what? You know what? I
don't need people. I have apps for this
shit. Is this No, but then I got to like
go outside and pick it up. It's too much
effort. Oh, why don't I have a Where's
my humanoid robot that's going to walk
down there? I got a humanoid robot. Oh
my god. You know what I did see though?
And that would be cool. There's a lot of
potential. Wait, wait, wait. Like like I
just want you to think about with this
new renaissance of robotics the
potential for battle bots, right? Like
don't you want to see two unitry G1s,
you know? Come on. Come on, Brett
Adcock. Do something useful with your
figure robots. Like make them fight each
other. See, that's respect, you know?
Like where's the where's the where's the
learning learning some Brazilian
jiujitsu, you know? Yeah, we got them on
the ground. We got them in a leg lock.
See, that's what I want to see from
humanoid robots, you know? All right.
How we doing on viewers? Are we at 500?
Can we open the
box? Ah, people are use drones to
smuggle drugs. People use drones to
smuggle drugs here, too. You see them
all the time. They you can you can track
them.
Um, yeah, my uh my friend's got a
company that does uh drone uh drone
tracking. Uh and yeah, you can see him
like fly across the TJ border. Uh fly
across Mexico border.
Um 485. We're almost there. Just 15 more
viewers, right? Can we just have like
everybody was
fighting? Uh is it called Anderel yet?
Maybe. I don't know. Uh am I still in
Hong Kong? No, I'm in San Diego. What's
in the box? A black hole 106 processor.
Okay, it's on the screen next to you.
You know, you know, you're like that
person in Clerks who's like, "Do you
have any new movies?" And they're
standing right under the new movies
thing.
Uh, did I see the Gemini diffusion
model? What do you mean in light of my
prediction? It's not like I made some
great prediction. I was aware of
diffusion models. Um, they're not as
high quality, it seems, for language. I
don't know. All right. All right. 500
viewer alert. Okay. Let's open the
box. Okay. I have on my desk here a
black hole 106 processor. Let me get out
my box cutter. Ah, yes. Don't bring one
of these on an airplane,
boys.
Uh, all right. So, let's just go here
and
just Oh, yeah. That's nice. That cut
pretty nice.
Okay. What's in the box?
That's a little stuck
here. What do we have? Okay. Visit
tenstorrrent.com/support to get started.
Here's a can get started card with a
trippy logo on the
back. Pretty trippy. Check it out. Check
it out. Oh, that's really It's really
aliasing with the pixels.
All right. Find everything you need to
set up your device at
tenstorrrent.com/support. Okay. We'll go
there in a
minute. Now, we have a piece of
foam. Uh
One way weigh f with this scale. Got
another scale for
that. I have milligram scale for
drugs and I got a pound scale for tiny
box parts.
Um, that's for weighing tiny box parts.
If you're weighing fent on a scale that
only goes to
Oh, no. Did it not include a
wire? Wait, really? All right, we'll
have to look in the box. I hope it
includes a wire.
Am I just supposed to have one of
these? I mean, I do, but I'll have to go
find it. There's a serial number.
Leaks. It includes
wire. So, it uses this
connector, but it doesn't include the
wire. I might have one. Oh, here's one.
How much watts does it
need? Oh, this one doesn't have the
little stupid shed. Oh, I have to go
find a
connector. Got 5090 down there. All
right, I'll be back. Go find that
connector.
All right. Well, since nobody bought
brought me Starbucks, we have a Ta black
coffee
here. And more
importantly, we have a
Nvidia. Is it branded Nvidia? Oh, it's
branded Nvidia. So, fortunately, I
recently purchased many 5090s. I have a
lot of
5090s. Uh, sorry gamers. Sorry
gamers. Now, no. No real gamer. Does
anyone know an actual gamer who bought a
5090? I don't think anyone bought a 5090
for gaming.
Um, no. They don't give you a
cable. I'll look more,
but 10
[Music]
torrent. All right. Well, just so you
know, if you buy a car from 10 store, it
does not include cable and you have to
have a cable. It's not a crazy cable,
though. It's like I think new power
supplies come with it, too.
So,
but we have
one
conveniently provided from my source of
5090s. Okay. I don't know. Let's go to
tenstor.com/support and maybe it'll tell
me what to do about not having your
cable. I mean, there were a lot of
advertisement for tenstor
torrent.com/support.
Support doc
site hardware
installation. All right. So, we slide it
into the hole.
Oh, connect a cable. Ensure the cable is
fully connected.
Okay. Well,
[Music]
uh, should we put it in the computer
first? All right. I'll try to get a good
Let's let Let me zoom the camera and
we'll try to get a good shot of me uh on
the ground with this computer. All
right. So, uh, you might recognize this
computer from some old streams I used to
have with my old house. I brought it
back. I wiped the drive.
Uh, we're going to have to turn it off
and hope it boots again into Arch Linux.
Hopefully, it
will. Um, yeah, it's a key crown. Yeah.
You like it? You like the little
monitor? But we'll be able to do it over
SSH, so we'll be able to uh do it. Why
do we use Arch? Just to make life
harder. Why does anyone use
Arch? Cuz their life's too easy. You
know what I mean? Like if you live in
like a first world country and don't
have any real struggles except that
nobody volunteered to bring me
Starbucks, you might want to consider
Arch Linux. Makes your life
harder.
Okay, get on the
ground watching Outdoor Boys. He's
always talking about how it's too old
for being on the ground. That's kind of
how I feel. All right, let's remove this
glass side panel
here. I guess I guess we got to have a
have a good shot here, you
know. All right. Uh let's just hard
power off this computer.
I turned the air conditioner on, but
it's not going on. We might have to open
the window again. It's getting hot in
here. Line up a little shit with a
little shit.
It's kind that down
there. Get it
in. Yeah.
Okay. All right. Firmly seated in my PCI
slot. Do we follow the instructions on
tensport.com/support? We got We got four
connectors here. We can give this card
plenty of power.
fans free to spin. And how loud is it
going to be? Oh, it's going to be loud.
I can already tell blower fans are
always loud. I hope someone I hope
someone attends to it put care into
making it like not loud when it's not
being
run. Um like I hope someone wrote some
decent fan control firmware.
Okay. Oh, I'm supposed to just probably
slide that off. Oh, I don't have to take
it off. Whatever. Where's the uh
guaranteed to cause a fire connector?
Great. All right, let's plug these in
here. If there's zoom, you guys can zoom
in post. Right. Right. Beast
team. Plug that guy in there.
that guy in there. Oh, let's give it 600
watts of power. I don't know how much it
needs. Can never hurt to have more
watts, only
less. We
go
[Music]
now. Shove that all in there like that.
Got to make sure these connectors are
well seated. Otherwise, they really do
catch
fire. Um, okay. I have no idea if that's
well seated or
not. I still see the Nvidia
logo. Oh, maybe that's good. All right.
Well, if it catches fire, we did it
badly. God, that really doesn't slide in
much.
I hate this connector. This is really
Why don't they just put these on there?
Use the 300 watt variant, too. There
should just be Everyone should just use
two of these and use the 300 watt
variant and not this ridiculous 600 watt
connector. Okay, I think it's
in. I think it's in. Let's just assume
that we did a good job and
optimistically close the side of the
computer.
this beautiful glass so we can see our
tens torrent card. Thought that would be
appropriate. Sorry, I really didn't
think through the camera angles of this.
You can see the tens torrent card in the
computer. That's what matters
here.
Uh except the cables. They're sponsored
by
Nvidia. All right. Um and
let's just
for Okay. All right. All right. So, we
think it's just going to catch fire
right away when I turn it
on. I like this is a consumer PC, so it
doesn't take forever BIOS.
So, okay.
Okay. All right. Calm down. Tennis darn
card. All right. I can hear
[Music]
it. I can hear it. Who wrote this?
Uh, Arch
Linux
go. I have to set a password on the on
the thing and then we can SSH it to
it. 900 cc's of pure whining power. No
outstanding warrants for my
arrests. Oh, I bought some switches on
eBay and this guy gave me a free bonus
switch. I bought one switch and I got a
free bonus switch. I bought this switch
and you know pretty good,
right? All right, we're booting. So, I
didn't realize and we'll get to this,
but I didn't realize that Arch Linux
does not have an
installer.
Uh, all right.
I hope everybody enjoyed
that. Let me just readjust this
camera. And
let's move this here and keep this in
frame nicely. Right. Is that in frame
nicely?
Good. We'll move the net gear switches
out of frame.
I called Netgear customer support. It
was a huge mistake. It was a huge
mistake. And then they tried to call me
back a whole bunch of times. Uh it was
so
bad. You know, I I just I just
uh the people who want comma phone
support like like I'm going to I'm going
to give you a menu. I'm gonna Oh, hello.
Welcome to commhone technical support.
If you're calling about a product or
issue, you've reached the right place.
Please hang on these lines and listen to
all the menu options to find one that
best suits your needs. If you're calling
about a comma product, press one. If
you're calling about a comma service,
press two.
Beep. If you're calling about a panda,
press one. If you're calling about a red
panda, press two. If you're calling
about a pigeon, press three. If you're
calling about a Honda giraffe, press
four. And obviously, you're calling
about a 3X, but that one's option
eight. I can hear it. It's too fucking
loud. Like, it's it's okay. It's not
like screaming, but it's still too loud.
They could have done a better job.
Yeah, give me human. Hello. Hello. This
is Raj from Netgear customer
support. Yes. To better help you, can I
please have the full product name,
please? So, it's a Netgear
GC 728X switch. Okay. Thank you. To help
you further, can I please have the full
serial number of the
switch? Is it like is it like written on
the switch or can I like get it from the
thing? Yes. Yes, it's written on the
switch.
Okay. Okay. Uh it's it's it's 12 digits.
Okay. It's it's a 1 3 4 C 7. Okay. 1 3
Yes. 1 3 4
C7. Okay. Okay. Hello. Yes. Can I please
have your first and last name, please?
And yes, is this a good call back phone
number to reach you at? Okay. I see here
that you don't have a Netgear account
associated with this phone number. Can I
please have your email associated with
your Netgear account? I I don't have a
Netgear account. Oh, I need an email
associated with a Netgear account in
order to create a case
number. Okay. Can Can you create a
Netgear account? Oh, you can create a
Netgear account online at
negear.com/account. Okay. Do do we have
to Can I just ask a question about the
thing? Oh, no, no, no. I'm not trained
to do that. I have to take this
information and then I will redirect
your call. Oh my god. And then you hang
up. And then I got calls for like three
days from Netgear support trying to
follow
up. She was short survey. That's right.
Do you want to leave a tip? You want to
tip 10% 20%
30%. Wait, I'm not blaming the guy. I
don't blame the guy. I blame the CEO of
Netgear. I blame society. I don't blame
Raj working in Netgear customer
support. He's following the script, man.
That's like blaming the actors because
like Lost sucked, right? Like I don't
blame the actors for not writing like
like like like Kate and Sawyer did a
great job. Jack did a great job. I don't
blame Kate Sawyer and Jack for the
ending of Lost, right? Evangelene, Lily,
Matthew, whatever. And you know,
whatever Sawyer's name was, you know, I
don't blame them, right? You gota you
gota you got to know who to blame. And
it's Damon Lindelorf and Caren Cuse.
I'll never forgive you. Also JK Rowling
for that shitty Harry Potter ending. All
right. Ending of Lost was not based.
Ending of Lost sucked. And I can't
believe you're a subscriber. like like
like that show. Oh, okay. Let's not go
there. Let's I can I can rant about Lost
for that, but it just it just it just
like Okay, what made Lost good was there
was a bunch of people on an island and
you could relate to them, right? They
were like kind of normal people and they
like discovered this weird hatch, right?
There's a button in the hatch, right?
And I'm sorry if you haven't seen it,
but there's a button in the hatch and
like, okay, John Lock says you have to
press the button and Jack says the
button's stupid. The guy's made it up,
right? Like that's like a normal
reaction that two normal people would
have. Um and then you know John Lock
finds this other station where they
turned down it's a psychological
experiment. He loses faith. Some other
guy has faith whatever. Again these are
like normal
interactions. But then fast forward to
season 4 and the sky is flashing and
they're traveling through
time. Just just no. like like you you've
now jumped and the characters don't even
really notice there's anything wrong
with this. They're just going with it.
They're just just they've completely
jumped the shark of being normal people
you can relate to and be like that's
kind of weird. There's a metal hatch in
the jungle. Oh, the sky flashed.
Obviously, we changed centuries. Okay.
All right. So, you know, it's not okay.
Okay. It's not okay. Like, it's okay,
but it's not okay,
right? Yeah. Yeah. I could have written
a much better. Don't don't get me
started. I'm
lost. I haven't watched any Star Wars
past episode three. I don't even know
what the the the Last Jedi or something.
I don't even know. I Rogue One, the the
Millennium Falcon, Mandalorian. I don't
know. That show jumped the shark after I
mean like it already kind of jumped the
shark in episode
one. All right. All right. All right.
All right. All right. Um, thank you
everyone for joining my stream. Today we
are going to do stuff with Oh, well. All
right. Well, that doesn't work. All
right. Let's see what the IP is. IP
link. IP
adder. Oh, 41.20. Okay.
Okay.
So, uh let's see if we have turtor
card. Whoa. Processing accelerators 10
torrent ink black
hole. Okay.
software
setup available
here a compatible host machine okay the
recommended us for all tentor software
is yubuntu well
nope we're using uh
arch
Great. Okay. Well, first let's install
Arch. Let's follow the convenient Arch
installation guy. Are you guys just
excited about should I just install
yubuntu or do you guys want to see arch
stuff
too or run arch
install? Wait, are you kidding me? Why
do they have this whole installation
guide when you can just run arch
install?
partitioning. Oh, use a best effort
default partitioning layout. Okay,
you're going to install it on that
drive. Wait, do I really want Butterf
FS? Oh, I didn't check my Hang
on.
Uh, not that I really care. If you see
my chat GBT history, I don't think I
have
anything sketchy in
there.
Um, all right.
[Music]
Uh,
butterfs versus
ext4. Which is
better? I've never heard of butterfs. I
don't really know much about
it. B tree file system. It has cows. All
right. Well, we're defin Don't Butter
FS. Absolutely not. It's better FS. No
butter
FS. XT4 is
faster. It's GIMPY ZFS. Why not ZFS?
Because that's not one of the four
options. Oh, you guys can't see the
options. Has cows. This is a joke,
right? Like I don't know what level
you're operating at. Obviously, like
copy on right has like I know what that
means, but do you know what that means?
Or what happened to the author of Riser
FS? All right. As as funny as it'd be to
go on a 10-minute tangent about Hans
Riser and how um he didn't kill his wife
until he realized that he could instead
of getting a 20-year sentence get a
10-year sentence if he showed them where
the body was. Then he killed his wife.
Uh yeah. So yeah, no, but now we have to
go subscriber only. Um, it's not that
that was even a bad comment. It's just
it's just is riser FS one of the options
here. Okay. Okay. It's not one of the
options. Okay, we have butterfs ext. I
don't want to have picked the wrong
option.
Okay. Oh, okay. Well, rocks are
10. What? Why are you so slow? Why is
Chad so slow?
Better FS. That's a good name. Wow.
Chris Mason. Did he kill
anybody? We should
check JBT. Did Chris Mason kill
anybody? Don't use a reasoning model for
such a simple question. No, but I like I
like Why do I want Oh, I should have
used 040. 40 is so
bad. Experimental. Okay, we definitely
want that. Uh oh.
We like to use butterfs sub volumes with
a default
structure.
No. Would I like to use compression or
disable copy on right? Why are those the
two options?
This is a really hard video game, guys.
And also, I resized the window and I
regret it.
Uh, yeah. Okay. Would you like to create
a separate partition for home? No.
Okay. All right. That seems pretty good.
Wow, it's compressed with
ZSTD. I don't know how I feel about
that. But the other option was disable
copy on
write. Why would I want to compress my
file
system? Why are my options no cow or
compression?
Light Zstd compression is insanely
useful.
Okay. All right. Well, it's the default
option, so let's just go with the
defaults. Okay. Good. Great. We got some
compression. We don't need
encryption. Swap on ZRAM. That seems
okay. Grub. What are my options?
Leamine.
[Music]
What is swap on ZRAMM? How come how come
the Arch installation guide doesn't tell
you about Arch
install? Thanks, chat. Was that a
subscriber who said that or
nonsubscriber? All right.
Uh oh, compression and RAM. Okay, cool.
Got a root
password user
account. Do we need that or is just root
good? Add a user
Billy. Yes. Okay.
profile type
uh
server. Oh yeah, we're definitely going
to need
that. All right, good. We're going to
install SSH audio. We don't need that.
Kernels Linux sounds good. Network
configuration seems good. Additional
packages. Oh. Uh no. Time zone.
UTC.
Oh, Linux is a
meme. All right. America slash San
Diego Dawson
Creek. Okay. Los Angeles sounds
good. No, not Lima. Los
Angeles. Yeah. Okay. Good. Automatic
time sync.
Yes. Save configuration.
Oh, no. Don't do that.
Install.
Go. Thanks for the countdown.
All right. Glad to see we're installing
stuff. That seems good. That was nice
and fast. Seems a lot faster than
Ubuntu. Better than Ubuntu,
right? Oh, are we building the kernel
right now?
Arch install used to not be officially
supported and it's still not the default
recommendation because most people end
up with a system they don't actually
know.
Oh failed to enable color. Why
not have a kitty term
info? All
right.
Cool. You like to
chirute?
No. All right. Took 30 seconds. You may
reboot when ready. Okay. Pseudo. Reboot.
I don't even need pseudo. Let's just
reboot. Uh, let me unplug the
installation
disc. Put it on a hyper fast NVME drive.
Why is it Why is it green? Can you guys
see? Why is the screen
green? Arch
Linux. I really don't know why it's
green. All
right. Can we SSH in? Let's try
Billy.
No. Check the
IP. Oh, it
changed. All right, we got Billy at Arch
Linux. Okay. T-Mox command not found.
Well, let's uh Do we have pseudo with
Billy?
Yeah, good.
Um, okay. We need
T-Mox arch install
packages.
Pac-Man. What does - S
do?
Sync T-Mox.
Great.
Uh, how do I Pac-Man
search querying package
databases with the Q
flag? Pac-Man Q
Kitty Arch Kitty
Termfell. Okay, Kitty
Terfell T-Mox. All right, let's also go
get my configuration because I can't
stand controlB. has to be the worst
shortcut key ever. Okay, we don't have
wag. No one uses wget anymore. I can
just do that. Okay,
fine. All right. All right, we're up.
Can I get some more color in my
prompt? It's not colorful
enough. That has color. Fine.
I I use backtick. ControlB is the worst
shortcut ever. Like it's so inconvenient
to
type. So that's one of the defaults I
can't
stand. Okay, let's figure out how to
install Blackhole. It's
loud. Why didn't you make the default
configuration
silent? It's not using How much watts is
it using? Is it using watts?
Maybe once the driver works.
Okay. All right. Let's install the
driver.
Pac-Man
get-
sit pseudo Pac-Man- sit. All right, I'm
going to disable password pseudo in a
minute. Created a user get. Okay,
whatever.
All right. Do I have
DKMS?
Pac-Man-SDKMS. Pseudo
Pac-Man-SDKMS. All right. All
right. Okay. Pseudo DKMS
install tens
torrent. Please install the Linux
headers arch 2 package. All right, cool.
[Music]
Arch install Linux
headers. What's pow hole?
Oh, dwarf utils.
Great. Okay. I'm glad I have a pole now.
Okay.
Uh, all right. It's already
installed. Pseudo mod probe tenstor.
Okay.
Great. We have tensor. Let's move me
back up
there. All right. We're going to have to
update the device
firmware. Um, pseudo
Pac-Man-Spython
3. How does Arch want you to install
pip? Is there a package for it or should
I do Python 3-m and share
pip? I hate this crap.
seems
good. I I don't like this. I always want
to break system packages. Thank
you. All right, let's install a ton of
crap.
What is a firmware bundle? It's a gzip
compressed
data firmware. Let's see what's in here.
Image.bin.
Asky text with very long lines.
What? Why don't they just come with
normal
stuff? These Pac-Man's
fast.
Okay.
Um, yeah. Great. Great. This gives me a
lot of faith in your Why didn't you save
it as a real binary
file? Why is it saved as
literal? All right, we have TT flash
now. Okay, let's TT flash firmware
[Music]
tar TT flash not found. Okay, where does
the Yeah, yeah, yeah. Um, okay. Okay.
How do I edit my
path? Let's not bash
RC because I'm using
Zish. I'm using Zish. Zish.
[Music]
Okay.
Well, okay. If you running the command
says the firmware is too old, you just
do it with
force. All right.
Uh, I bought
it. I bought I don't like free samples
from people. Uh, cuz then like there's
some kind of obligation. Okay. Does
everyone hear how freaking loud it is?
All right. Flash success.
Wait, it might be
quieter. Okay. Um, then reboot the
system. Okay,
fine. Huge
pages. What's your
system? Oh, I'm going to have to reboot
my system again. Okay, great. We are
going to have to figure out how to put
the Python in
that. All
right. So, this is
Zish. Wait, this is just Bash. Is this
Bash or Ze? How do I
check? Bash. Okay, fine. Good. I like
Bash better anyway.
All right, we got to enable this huge
pages
scrap. Well, that's not going to work
because we don't have
debs. All right, let's just skip that
step. It definitely won't hurt us
later. Why is this not the default? I
don't care.
Nah, I disable that shit on Mac, too. I
don't want Z, right? Every like fancy
little shit the kids are using, I want
the opposite. Okay. I don't even trust
autocomplete. It's out to get you. Okay.
Autocomplete is not on your side, you
know? It's not like channel five or
whatever channels on your side. One of
those channels, you know. All right.
Cool. Uh,
yeah. Let me move me out of the way. I
don't know where to move me. Maybe over
here. Uh,
firmware.
Telemetry. Okay. Heartbeat. All right.
Cool. Cool.
Cool.
Um. Ew. Why would that be a
toggle? All
right. Great. Gen 4 full link
width. That looks nice.
All
right. TTNN is
a userfriendly
demo.
[Music]
Uh file any issues through our customer
success. Great.
No, that's not where we want me. I'm
going to put me over here again. Sorry.
I want you guys to see. I want you guys
to have the full
experience. No more
Buddha. So, we can
do MLIR or
TTN first five things guide.
Okay. Installation guide. All right. We
already did this
one. Oh, no. This is a different one.
All right. We set up the
hardware. We did that already. We did
that. We did
that. From source. That seems good.
Invoke our build
scripts from wheel.
[Music]
and build
metal.
What? Why does it not do anything?
Wait, no. But seriously, why does it not
do
anything? Can I Can I get VI as
Vim like a package to do that?
Oh, do an aliation bash RC. All right,
good point.
Sweet. Thanks, chat. You guys are
actually pretty good at
this. Crimson doesn't tell me how loud
the fan
is. All right, so uh build metal.
Why doesn't this
work? And disable
that. All right. All right. That's
progress. I don't know why, but
whatever. Uh, and we need cmake. That's
normal. I'm sick of this.
What?
Am I in the wheel
group? I'm in the wheel
group. No, I don't want to type the
fucking password.
Why? But I'm in the wheel group.
or did I not save it or
something? All right,
whatever. Whatever. That doesn't
work. You have to type the password
every time. I don't understand that. I
got to restart my shell.
Use
this. All right, I did
that. All right. Yeah. Okay. So, I'm on
build metal. I installed C. No, I have
CMake now, do I not? Oh, no. I got upset
at having to type the password for that.
But I just need to get over that and
type the password.
Wait,
what? That's the
password. Oh no. Did I break something?
[Music]
Linux Pam locked me.
Pam, isn't that the bitch we got to get
out of the condo or
something? Wait, what?
How do I get around
this? Fail lock
reset. Wait, what? How would anyone ever
know
that? Thank you. How would anyone know
that? Okay, great.
Jesus. I mean, okay. Um, CMake, we don't
have ninja. We need
ninja. Let's get
ninja. All right.
Clang, these are reasonable things to
need. These are reasonable things to
need. I'll let you know when they become
unreasonable. Okay, that's kind of
unreasonable.
Right. So, I need clang
17. I have clang 19.
I have that.
So, this is going to require me to
somehow get Clang 17.
Don't trust
that Pac-Man
QS
clang. Okay, so we don't have any other
clang. So why is this insisting on clang
17? Let's build it with clang 19 and see
what
breaks. Why does this think that
All right. Struggle session was the
right name for
this
weird. Oh, this is like
a
what? No.
Uh, thanks Stack Overflow.
Can you doesn't include
less? Why does arch include
nothing? All right.
Why is this still trying to use clank
17? Okay. Well, that didn't work.
Uh, there you go.
[Applause]
Yeah. Now, I'm not installing some
sketchy thing from source. We just sim
linked it to Clang 19.
Yeah. All right. Build my shit. Does
this have htop? I'm sure I'm going to
have to install
htop. George, if you just install arch
things, you can just p and it will auto
install the packages for you. All right,
thanks for being slow
computer. Let's learn more about ten's
torrent cards while we
are running this. Okay, what's TT metal?
Where is this shit?
We're going to be able to somehow run
stable diffusion. That seems like a good
test that's in here. That's a wormhole
demo. Is that going to work? How about a
black
hole stable
diffusion? So, can I run the wormhole
demos or not? All right. Well, let's
just try the ResNet. Let's try
Yeah. I mean, this just like a crap
consumer. It's It's an old CPU, too.
Okay. What is it? 5950. This is an old
computer. All right. We don't have a
NUMA
library. All right. We need a Numa
library. Fine. We'll use the fast shit.
JBT is so much better than
Google. Just have to like rerun all
this.
Slow. I don't know. It's downloading
something. That looks good.
requires changing a what?
I know I don't have open MPI. Do I need
open
MPI requires changing an R path unless
on an
elf based or what?
Why is it
dirty? MPI
off. All right, let's find what we're
supposed to have installed on Ubuntu and
maybe that
will There's not like a list of things I
have to install.
Um, you know what? Let's take let's take
a minute and step aside here and let's
try
tiny.
Tiny. All right. So, we have tiny grad.
We take this. We get clone
it. This is way too slow. This is
upsettingly slow. Okay. Now we pip
install- e dot and we have to bitch and
tell it to break the system packages.
Great.
Uhhuh. All right. It doesn't work here.
What? Did it install? Maybe it did.
Huh? No. No. We don't have any of that
subm modular nit. I'm not using a VM. I
hate
VMs. Great.
I wonder what back end it's
using. It's using the CPU back end which
is very slow but Tony's already
installed. Uh so we can check backends
with that.
Why is AMD ah because we don't have co-
manager yeah so we're using CPU right so
you can see but what if we switch to AMD
LLVM
uh oh that still requires co- manager oh
that
sucks that's actually a new bug I just
did
that we don't actually need that just
fix
that I I just did that to support the
new stupid rock.
Uh, I mean, we could just install Rockm
and that would fix it, but
Okay. Device or resource busy because we
can't. So, we don't even have an AMD
driver installed. So, I'm trying to use
the uh
builtin. So, that's fixable with
pseudo. See, look, we're downloading all
the files now to talk to the
GPU. Uh, fail to open AM device. It's
already in use. That's actually
okay. Um,
It has to download them to a different
path because it's root. Okay, there we
go. We're
in zero AMD driver install, zero rock m
install,
nothing. And we're already talking to
the AMD GPU and it can be very fast. And
then in order to fix that pseudo, we
actually have a terrible hack in
Tinyrad.
Uh this
uh and now it should work without
pseudo. Don't ask too many
questions. Now it's on the CPU. Why is
that not AMD?
Why does it fail to map
the
what? It works with
pseudo.
Huh? I wonder
why. What capability did I not set?
So we're just we're just mapping the PCI
bus. So you know he's not going to get
great. But yeah, you know train up nest
with stable diffusion. Just stable
diffusion
next. Yay. Y nest. Uh, stay
here. Oh, we need
pill. Which one is pill?
pillow. Is that the right way to do
it? No, not that. Stable diffusion.
We need numpai
too. We shouldn't need
numpy. It's down with stable diffusion.
We got to fix whatever the capability
thing is. I don't know why that doesn't
work. Um, something's failing. We should
check that on March.
Yeah. Going to compile the model. It'll
take a minute. All right. Now we have
stable diffusion running on an AMD GPU
with no AMD driver, no Rockm, no
nothing.
Um, if someone wants does someone want
to do a pull request for that fix?
That's a little bit ugly, but if you see
the co- manager problem, I added a early
call that shouldn't be
there. Uh, all right. So, let's see what
the pictures of
stable diffusion
quality. It's like a cow and a weird
bagel. Does it work with the MI300X? The
MI300X, you're going to need the AMD
driver installed because our driver
doesn't work with that card, but our
runtime does. So, you don't need any of
Rockam or HIPP.
We need to also switch AMD LVM to be the
default. Uh, that should just be the
default. It should just work. And then
we have to figure out what capability
we're missing in our set cap to make
Arch
happy. Looks like this should
work. Fail to Map. Okay. So, that just
must be some other
capability. I'm going to fix this and
then we'll go back to Tenstor. Okay.
failed to m map. Why?
What's the right fix for that?
No, it says attribute.
All right. What capability am I
missing? Mlock through the
buffer. Add the missing capability or
just raise the mlock. Add cap IPC
lock cap IPC lock equals ZP.
What? Invalid
argument. Oh, like
that works
great. Thanks, chat. GPT. Love chat
GPT. Mlock. Every buffer it allocates on
your bunt. It succeeds because he's
rude. already has that fresh arch
install. Oh, you can only user can only
lock. Oh, I see. I want to try to a two
meg buffer object. Okay, that's
great. Cool. Easy
fix. Good. We got some good fixes for
tiny grad in. Uh like guys, I I think
you don't realize how incredible what
this is
doing. Like there is no Rockm installed
on this system. And not only is there no
Rock M on this system, there is no
AMD. Wait,
what? Why is there AMD
GPU? That doesn't make
sense,
huh?
Strange. So, but it must not be
connected to the GPU.
because it's using
the Oh, it's like
crashing. So, why can't I use the
So this is using this I mean this means
it's using our driver. So there's an AMD
iface flag we can change the driver with
and figure out why the main driver is
not
working. Uh if we set AMD IAE to
KFD there's no deb
KFD. Okay. Hey, there's no KFD. All
right,
whatever. It's got some broken version
of the driver
then. So, what happens when I do this?
It like crashes the driver. We just take
it
over. Sick. Okay, I think it just
crashed out.
measuring buffers. See, the driver is so
broken. Um, yeah, but so you can see
here that like this AM stuff means that
we're using our own uh our own driver.
So, this is all just from user space.
and then AMD LVM equals 1 which is going
to be the default means that we're not
even using we're not using rockm we're
not using co- manager we're not using
hip we're just writing raw LLVM and then
passing it to a normal the arch's normal
install of LLVM and that's just working
so great we'll push those improvements
at some point really have a good way to
do that on stream yeah
there. Okay, back to making tentor
work. Install dependencies. Only Ubuntu
is
supported. Package needed at runtime.
All right, we're going to need open MPI
bin. Thank you for gifting subs.
Um, what is it?
Pac-Man-Q open MPI
QS.
Sure. Of course, this doesn't
work because it has some weird
hard-coded install of Open
MPI. Oh my god, it's hardcoded to this
one Debian package of
OpenMPI. Well, that's never going to
work.
can chat GBT the app commands to
Python. Oh yeah,
maybe. I
mean this is
sketchy. This is No, I don't want no
disabled. No. Does it say add no
visual? Some way to turn that off that I
don't know how to
do. Uh oh. No
mouse. Okay. Yeah, that's just not going
to
work. Do we need all this stuff?
No, no, no, no. We're not We're not
We're not doing that.
Yeah, they didn't lie about just
supporting YUbuntu. Yeah,
clearly. Not only they just support
YUbuntu, they very clearly only support
one version of
Yubuntu. I mean, to be fair, it did say
this in the documentation.
[Music]
Uh, all right. Let's start taking a look
at what's actually going on
here. What can I disable?
What is OpenMPPI UFM
anyway? Is this
needed? No, it's not the
problem, right? You you can you can say
that, oh, just feed in the list of
dependencies, but that's not the
problem. Okay, so just look at this one
here.
This is just fetching a random Debian
file and installing
it. Um
Now copy paste is going to work. Great.
Now copy paste
works.
What? My colors go away.
Can I copy paste
now?
No. Didn't listen.
not load defaults if VMRC is
missing. I got a lot of
questions, a lot of
re-shoots UFO build.
No, we're going to have to just make it.
Okay. Distributed. Can I disable
distributed?
And then I don't know about this R path
yet. I think this is a separate
problem. Let's try to fix that one
first. That one looks easier.
Then we'll deal with the stupid uh
Think about it.
GPT come up with an answer.
Oh, there's Mac alert sounds.
Oh, I can just disable that. Do you want
that? Because I'm not listening to them.
I disabled them.
I mean, they're probably playing through
my headphones, but I don't have them
on. I don't understand
this. I'm on an elf-based platform.
All right, great. I'm sure that's
totally fine and not going to come back
to bite me in the ass later. Now, all we
have to deal with is the stupid open MPI
shed. All right. Do you want to just do
this?
This is going to work.
Oh, it's already here. Great.
Oh, good. It's running Clang 17. Good to
know it's running Clang
17. Good thing I paid for all those
cores.
This all just needs to be in tiny grat.
This all just needs to be replaced with
tiny
grad.
Like the whole like this. We could be
done already.
How does anyone still code in C++? I
understand Rust.
Fine. But like why people are still
writing new code today in
C++? Oh, it's really it's a terrible
language. My job was a C++ developer.
Oh, don't got to pass up by a reference.
I mean, okay, it's not as bad as being a
Java
developer. Java is the worst. Java Java
is F tier.
Um, but no, if you're writing new code,
uh, and it's not in like Python or Rust
or Go, people still use Go. I like
Go. So, yeah, I want to use Cobalt while
you're at it.
Um, you're full-time
go. Oh, good, good. Let's let's let's
shit talk about languages while this
compiles, but only for subscribers. You
actually like
Zigg. Is this is this real? I never know
if Zigg is like real or it's like one of
these like like I don't know any
projects that are written in Zigg. Can
someone link me like a good Zigg
project? Oh, Swift is I mean Swift is
okay.
Wait, what? Why did the screen turn
Oh, the screen turned blue because we
crashed the AMD driver.
I was going to get potato chips, but
then I remembered that we had py
yesterday and there's leftover py in the
fridge. Is this finished building
yet? All right,
good.
Ghost.
TTY
bun. This is written in zeg.
Allin-one
toolkit for JavaScript and TypeScript
apps.
JavaScript. TypeScript makes it a little
better. Like it's just sad cuz like
Python's everything about Python is
better than JavaScript.
Um, JavaScript's actually no, to be
fair, JavaScript went through struggles
with like promises and stuff. And then
with async, it's pretty
good. Like promises and callbacks were
tragic. Okay.
Let's look at some zig
code. Let's like find something that we
can understand what it
is. Why are these files so tiny?
I mean it seems it seems like
C looks like somewhere between does it
have memory
safety has memory safety GC
See, not like rest. Okay. All right.
Back to
tensor. I I'll maybe we'll do a Zigg
stream. Would you guys like a Zigg
stream?
We're eating
pokey.
Got tuna and
salmon has comp time for generics. I
don't know what that
means. Okay, we built metal. You're all
set.
Then try running a programming
example. Um, did it not listen to that?
No module named TTNN
examples. Oh, do I have to do this in
build release?
No module name ttn
examples. No.
All right. So, this is just
not Do you want to come to your wedding
in
Jersey? I kind of hate
weddings. Wait, so does this
work? Is this a real thing?
Oh, it's in
TTNNTTNN. All right, we just need
Logu. I'm going to alias that shit to
break system packages.
No. Well, library tweaks is not defined.
Okay. Where is it supposed to get this
from? What you mean? like as library
tweaks. Now we have a different problem.
I need to create the VM. Okay, we'll
create the fucking VM.
Okay, I hate
VMs.
Oh, package util.
I I don't know.
Yeah. I mean, like these aren't art
problems. These are just
like sure it might work on the one
Ubuntu system, but you just shouldn't
write things like this.
I don't even like know where
to I mean yeah if you're on a specific
version of yubuntu they might happen to
work but like this is not a solution
There's the docker option.
No,
like like this just shouldn't be this
complicated, right? If you're trying to
ship a hardware
product you shouldn't need all this
complicated software to just run an
example code with it.
Um, no. I mean, look, if I were 10
store, here's what I would do. I would
offer tiny grat a contract to actually
make this like work without all of this
stuff. Just the kernel driver talk
directly to the kernel and then it'll
work as easily as tiny grab.
Um,
like Kama suffered from this a lot and
still kind of does. Open Pilot is really
hard to uh install on other systems. So,
I really tried to go the other direction
with Tiny Grabb. Tiny will run
absolutely uh everywhere. Okay, I'm done
with your wedding. I'm glad you're going
to a wedding, but we're done with that.
Stay on topic.
I mean I don't
know people want to use PyTorch. I mean
you can yeah like you you can just use
PyTorch through Tiny. It probably tiny
pietorch back end is probably more
complete than 10
storms. Um like so you want to see the
tiny guy pietorch back end.
We do have to install torch. So, pip 3
install
torch. Um, oh, this is going to install
tons of Nvidia crap, isn't
it? We don't need that.
Uh, there's a way to only install CPU
torch.
What's this?
Um,
We don't even need that. So, let's try
now. So, import
torch. Um, import
tiny.frontend.trch. Okay. So now if I do
like torch
[Music]
zeros, we should be able to do
tiny. Uh oh, well that's cuz we need
amlvm, but
yeah, do it with debug google still.
Okay, ready? So import
torch. Uh,
import
tiny.frontend.ttor torch. So that adds
tiny to torch. And then we can do like
torch zeros 2020.tiny.
tiny. All right. So now we've created
uh something on the tiny device. I can
do something like a= a +
one. Now if we want to convert to numpy,
I got to convert to CPU first. It's a
torch thing, right? So that's running
with the tiny grad back end, but it has
all of
torch, right?
You know, like a time
a slow and annoying,
but let me clean that
up. It's just because of how Torch gets
the stuff. Does Torch Lalge SVD work? Uh
maybe like that's fast.
Uh what do you want to do in there?
No. So we don't have
uh No, see it's not a PyTorch back end
in Tiny. It's a PyTorch front end in
Tiny. So no SVD is not going to work.
Um, there's just no there's no support
for that in the tiny red back end. I'm
not even sure how we'd support something
like that. But like every normal thing
should work. Like here we can do a
map.
Um, yeah. So, if torch torch needs to
have like a decomposition, and I'm not
sure it does for things like
this. See, does randon
work.
Sweet. See what like passes through to
normal. And so, this is just running.
Now, this is running on the AMD GPU with
no
drivers. How much money for Tenstor
support in Tiny? Well, it depends on how
well supported you want it to be. I
mean, yeah, again, and I've said this, I
don't think their current software stuff
is sustainable. To be fair, you can say
that I'm holding it wrong, right? You
can say that, oh, you shouldn't have
done this with Arch
Linux. You should be using um
I I don't know what the algorithms are
for for IGEN values and SVD. Uh I don't
know if if they can be decomposed into
like normal tiny grat operations, we
should support them. Yeah. No, one
version of Ubuntu is just wrong. I like
you you not selling a generic piece of
hardware here.
Um, I don't even think it should be like
apt install tens torrent. It should be
pip install tense
torrent. Yeah, if it calls Yeah. We we
don't support any of that kind of
stuff. Uh no, I mean look, so if I were
10 torrent, what I would do is
um nobody's like what people don't
realize is nobody's going to use their
stack, right? like like they're putting
a lot of effort to it and internally
they don't realize
that nobody's installing TT Metal in the
exact same way nobody is installing
Intel IPEX
bullshit people will tolerate RockM to
an extent not totally but to an extent
for one reason for two reasons one it's
here on the Torch homepage
okay if you're not here on the Torch
homepage. And if you haven't been on the
Torch homepage for
years, there's no hope, right? You're
not going to like like you better start
figuring out how to get on this Torch
homepage and this kind of shit better
work. Um, Intel AMD took an interesting
strategy and I've actually come to
respect their strategy more. Rockm is a
complete clone of CUDA. every package in
RockM basically has a CUDA equivalent
and AMD engineers wrote an AMD knockoff
of it that is 80% there. Um, so the
reason that big data centers buy AMD,
uh, if you're Meta, it's always worth
spending 5% of your money on AMD. Um,
because why would you not? Just as a
hedge against Nvidia. Why would you not?
Uh, notice how there's no Intel here.
There's no Tens torrent here. So there's
there's a second source, right? It's
it's literally just a second source, and
AMD is the obvious second source.
Um, yeah, you don't need that. I mean,
notice how it look again. I installed
nothing and I got AMD working. Uh, we
can sort of do the same. The only piece
of Nvidia we're missing, we're
outputting PTX and we have a complete
driver. Uh, well, actually, no, we're
still using the kernel driver, but we
can fix that. So, we're still using two
pieces of Nvidia stack. We're using
Nvidia's kernel driver, which is mostly
just a shimmer on the GSP we can
replace. And then we're using
uh Nvidia has a closed source thing that
compiles from PTX to SAS, and it's not
LVM as far as I can tell. Or even if it
is LVM, it's it's closed source. You'll
never get it.
Um, so yeah, I
mean and again like you saw how easy it
was to import the tiny backend to
PyTorch. You just have to import one
thing and then tiny works. And again,
that one thing you're importing is pure
Python. There's no C
there. You import just import and just
the imports enough. import
tiny.frontend.trch. And suddenly
torch.tiny
works.
Cool. By the way, that'll work with like
Open CL. That'll work with
everything. So, yeah. Yeah, I mean I
like I don't even
know. Do you want to try the stupid
Docker? But like h how how terrible is
that? Now now I need to have like a
Docker and All right. You want to try
their wheel package? Think that's going
to work.
copy link
Yes. It's not a supported wheel on this
platform. Well, so the car's making
noise. It's now hot.
Did we even talk to
it? 30
watts. Yeah. Not a supported wheel on
this platform.
Sorry. All right. Just so we can try it.
Let's do Docker.
[Music]
Uh yeah, I know. I know. Now we're in a
fucking Docker.
Can I hate
Docker? I hate Docker.
I hear the card. You guys hear it?
Um, hey Docker, does this
work? Is it doing
something? I can use Podman as a
replacement for Docker. I don't know. Is
it system control starting Docker? Is
this doing something?
Oh well, we can't connect to the Docker
Damon sock,
obviously.
Oh, permission
denied. Is Docker
running? Uh, all right. How about this?
Come on, chat. GBT, help me
out. Use pseudo with Docker. Add Billy
to the Docker group.
Did that not fix anything? Oh no. I
probably have to
like restart.
I regret not doing that in T-Max.
Okay, good. It's
dockering. Oh, yes. Well, it works on my
system. Yeah, then we'll just ship your
system. And that's where Docker was
born. Yeah. You know what doesn't have a
million dependencies? Tiny. It has
zero. You watch me. You watch the two
dependencies I needed for stable
diffusion. Numpy and
pillow. And actually, I'm not even sure
why we need those. I'm sure somebody
could refactor it to remove both of
those. I guess you need pillow to write
the
JPEG. All
right. All right. Now I'm in a fucking
Docker
container. Oh
Jesus. All
right. Continue to You're all
set. Is this going to work? Huh?
Um, I installed your fucking doc
[Laughter]
error while finding. Oh, do do I have to
Okay, wait, wait. Maybe I have to export
arch
name. No, module not found.
Error. Okay.
run the other two commands. Yeah, but I
don't think that's right
either. That's like not what you
want. All right, let's just try looking
at it.
It didn't look complicated. Maybe it's
just
like Okay.
All right. So I created a torch ttn from
torch
ttn
x torch output
tensor. Cool.
[Music]
Okay, the other model demo is going to
work.
Where's like the model
demos
models? All right, so let's try to
run. I can't believe I have to do this
in
Docker. Can you check tensor device?
It's using black
hole. Uh, I think so. I mean, yeah.
like.
So, where is this installed
to
[Music]
cache site
packages? The models in here? No, models
aren't in here. Oh, we're going to have
to install the models. I saw something
about
that. No, not that.
Um, okay.
All right, let's
get Okay, we'll install this in the
convenient Docker. And we're installing
Git and we're cloning in the
Docker. Well, no. I mean, it's not that
it took two hours to make work. It's
that we gave up and used Docker because
this shit's not portable at all.
Um, no. I mean, I just like if I were
Tenstor, I wouldn't be focusing on any
of this stuff. Like, who cares about
getting your model to run? I would focus
on documenting the instruction set,
which it's not documented. Um, so Corsix
has been doing a great job
uh like documenting how this thing
works.
Um, there's no docs for any of this
stuff. Apparently, even like inside
tenstor, it doesn't have docs. The
answer is just kind of look at the
verilog.
Um, no, it's not that Docker's annoying
with the performance. It's not like this
is in the container. This isn't in the
container. Like, nobody wants to deal
with
this. Uh, no, but like there's no
documentation for for this. instead of
writing TT Buddha and TT Metalium, focus
on documenting the
hardware. Um, and
then like why is there new complex C++
code being written for this
stuff? Uh, don't do
that. They I mean their kernel driver is
fine. Their colonel driver is like
small.
Um, okay. Demos black hole reset 50.
Let's see if ResNet 50 works.
No module named
multi-process. So requirements are pi
project
autotoml. Again this is in their docker.
So this shit should already be
installed.
I don't ever know. Like I don't really
know how Docker like works. Like can I
attach another thing to that? I mean
that's a ski I know this is a skill
issue
but data sets. Is that like a hugging
face
thing? Why is transformers a dependency
for ResNet 50? That's a good question.
Um
and now it's uninstalling the one
version of Torch it probably worked
with.
Okay. Do
something. I think
[Music]
No, it's so
louder. Yeah. I don't understand. Like
I'm in their
docker. Okay.
Okay. This This, by the way, has nothing
to do with
uh Arch
anymore. Unknown hook pie handle crash
item.
Oh, maybe it's that
tests models demos black hole reset
50. No, it's clearly not okay.
a module named Git.
Uh,
Okay.
Um, all right. It just calls this
Let's try like this.
device. Where's the ResNet 50
code? TT Metal ReadAme has some info for
models running. Okay, so here is the TT
Metal ReadAme. Yeah.
I All right. Here's his
llama. I don't even know how we're going
to download that
shit. All
right. Oh
god. Wish I do this in
Tiny. Go to Tidyrad.
Python path dot Python examples llama
3.py and we need to take it open. Okay.
Okay, it's downloading uh Tiny
Llama. Do you want to try creating the
ream? Okay, we're going to need blob
file. I mean, yeah, we have some depths,
too. Well, that's annoying. I think
that's cuz we didn't install. It's going
to be the default
soon.
Really stupid
browser. Probably shouldn't be a
browser.
All right, cool. So, what's the IP
Yeah. See
this isn't going to
work. And this also
like I mean this is just this is just
like a broken ideology of software
development. It's the idea that like
like and and Google does this like we'll
and like these big companies kind of
think this is okay, but it's really not.
Like we'll just push through the
complexity. We'll eventually beat the
complexity back between so many shit API
abstractions that eventually it'll kind
of work for the majority of use cases
and we'll throw so many people at it.
And this is why all software today is
dog
shit. Like this is just the complete
wrong
mentality. You know, fire 80% of your
software engineers and build one thing
that
works. I mean to be fair like you use
like Olama and it's just as easy to use
as Tiny thing. Maybe even easier. It's
easier probably because there's more
tutorials. Like I'm just I'm not excited
to use this
card cuz I have to use it inside a
Docker and the demos don't seem to work.
And
um it's a tiny llama. That's That's not
big.
Uh, you know, Tiny Guide is Tiny Guide
is very performant on LLMs. Our
performance is um actually you want it
to go even
faster. It's going to take a little bit
to set it up,
but the noise alone demotivates
you.
Uh, by the way, this is stored
locally. It's going to take a little
bit. It's got a beam now.
Oh, I can finally hear the other fan
spinning. Actually, that might even just
be the
CPU. Using a little bit of CPU, but
yeah. No. So, now it's searching for the
fastest way to run.
It's a tiny llama though. It's not a big
llama. It's only one B. We can We can do
8B. You want to do 8B? It's not going to
give you the same speed, but it'll be
decent. I think it'll auto download if I
do
8B.
Yeah, take a whole bit to download. By
the way, this doesn't quantize also. So,
like that's
another limitation. 1B is the default
because people just want to get started.
Um, and then give it a little bit with
beam and we'll see how fast AP
is. Oh, Tiny is almost 1.0 software.
Like it's it's really like like easy to
to use. Uh, and this is this is this not
dependencies. Oh, yeah. I don't know. We
just some random guy hugging
face. Um, we're getting close to the AI
girlfriend. Yeah.
Uh, these basic examples only work on
gray
skull.
Okay. Am I on the right? I I don't want
to like be using the
wrong I'm not on the wrong like docs, am
I? Because Grey Skull is now two
architectures back. I have a gray skull
and they depreciated
it. Um, these are the most up-to-date
docs. You're not wrong.
Okay. I mean, like, this stuff's not
going to work. Like, Intel writes this
kind of stuff, too. Like, it has to
beTT. No, no one's going to use the
Tensor torrent neural network
library, like TTNNX. This can't be it.
This has to work with actual torch not
converting a tensor from
torch. This particular slice will run on
the device. But what about other slices?
Will they all run on the
device? Enable program
cache. Why is it not enabled by default?
Uh tracing the graph of operations
enable
logging. Okay, they support
these has a big dx problem. What do you
mean
dx? So let's see what should the
uh what should the theoretical max
be?
Uh so this chip has gigabytes per second
of
960. So if we're running an 8B llama, we
should be able to get well 60 is the
theoretical max. So we'll see what we
actually get. The one before was a 1B
llama. It wasn't big. Um so yeah, you
see why that's a theoretical max for
unquantized
loading. Uh, and it's going to be slow
on the first
run. Got to generate all that
shit. I got do that beam.
It really
does. That's pretty
good. So, we're getting like 47 out of a
theoretical max of
60. And that's on an AP llama
unquantized.
Yeah, just write good software with less
dependencies.
Agreed. The initial run here is not
fast. Nobody's optimized this because
it's actually just running them one
token at a time. It's not doing batch
inference. And we slow down quite a bit
because our KV cache
It's pretty
good. I'm happy we now have some sane
defaults for for tiny chat.
I don't know. You know, I I talked with
I talked with Tenstor about a contract.
They don't really seem interested. Uh
and it's it's like sad. I mean these it
look how long it took for AMD to like
come around to realize that you have to
value this
stuff.
Um, and they acquired, so the guy
running AMD's uh software now was
acquired uh from from Not
AI.
Uh, and like yeah, I mean, this kind of
works. You know, as much as I might beef
with the guy on Twitter, at least he's
like a
modern
like, you know, some of these these
companies have like 20, 30 year old
software teams that don't use Git and
don't use any modern tool chain.
Um, no, I mean, they don't value
software
and
yeah, like I don't know. I was really
hoping that this would have gotten
better, but this seems to be actually
almost worse than it was in the
Blackwell
era. And again, I really don't think
this stuff has anything to do with
whether it's Arch or Ubuntu because I'm
running into Docker. Hopefully, you all
can agree with that. I'm running their
Docker, which I already hate doing, but
um like this approach isn't going to
work. Like having your own, oh, people
will just use this shim library. They
won't. People will just use TTNN and
then exclusively write for the tens
torrent cards. Like I just don't think
that's going to work.
I think that you have to have if you're
trying to succeed
uh as as a AI accelerator company, you
basically have a few choices. Um have a
big successful framework that's yours,
right? So so Google can succeed with
their TPUs because Google wrote
TensorFlow and Jax. Like Jax is actually
good if you guys have used Jax. Like
it's it's if we were so comm is all in
pietorch but if we were if we were
starting today we might use jacks. Uh
and there's pros and cons but like
or you need to be on this
page. If you aren't on this page
uh you lose.
So the idea with tiny is to provide I
mean
tiny I suspect that like it may turn out
that most people just start interacting
with it through pietorch but again it's
just it's just tiny where we have
bounties up for people making the uh
like every place you type CUDA you
should just be able to top dot dot tiny
and it should just work. Uh, we have
bounties. We're making good progress on
like a bunch of major most major PyTorch
repos. I think we did a stream where I
just tried them and I think like seven
out of 10 just worked with
tiny.
Uh, I have zero interest in any Intel
shit. Okay, so Intel Oh, I can go get
them. Intel sent me their data center
max GPUs.
[Music]
Uh, so I wrote a whole blog post about
how basically like the tragic case of
Intel
AI.
Um, and it comes down a lot again to
software, but they do have fundamental
hardware problems too, right? So this is
like your memory
latency, right? So, uh, Nvidia,
AMD, and then blue is Intel. Um so the
problem with this memory latency
uh
is they there's not even enough
[Music]
uh yeah so they're only getting half the
uh the theoretical bandwidth and perhaps
Intel's very high memory latency makes
it difficult to make use of bandwidth.
the XE cores can't track enough cash
cache misses in flight to hide that
latency. And this seems to be very
fundamental. I haven't tried the B uh I
have a B B580 card. Um but the A770 had
all these same problems. The A770 has a
completely dog shit memory architecture.
Um, I don't know if it's fixed on the
new card because the new card doesn't
work unless you're running a bleeding
edge
kernel uh because they switched drivers
and they didn't backport the driver to
the kernel that ships with yubuntu
2404. I think the hardware enablement
kernel on 2404 doesn't even work for the
B uh 580, you know. It's just it's just
Yeah. Um, but then the other problem
with Intel is this.
Look into look into Intel's road
map. Uh here I
quoted PVC was delayed then launched and
ended up being very underwhelming.
That's PVC. I have some of the PVCs.
They sent them to me too. Um, and then
it's just
like you email Lisa Sue, she replies
like
like AMD again might disagree, but at
least there's like somebody there who
can make a decision. Intel's the biggest
clown show of of a company with with
respect to like it's Boeing tier. Intel
is like Boeing tier, right? Um there
there's no there's no leadership.
There's nobody there who like like the
closest thing you have to leadership is
but my stock price but my stock price
like oh my god
um she changed their slogan from Intel
inside to Intel Nowhere and they like
come out with these new things and
they're acting here. Here's the main
problem with Intel. Intel acts like
they're a leader when they are not.
Intel's in like fourth or fifth place.
Intel's like I have more hope for Tentor
Torrent than I do Intel. Like Tentor
Torrent could get their shit together
about this, right? Tentor torrent has
leadership. I think that like leadership
needs to rep prioritize software and
documentation, but um you know at least
at least from a perspective of they
shipped a nice card in a nice box. Uh
and like there's a road mapap for these
things. I trust that Tensor's going to
come out with White Hole next and you
know it's going to be a little bit
better.
Uh, and you know, I trust Jim Keller's
leadership on the hardware immensely.
There's just nobody at Intel. Who do you
trust at
Intel? They have a new CEO now, but
like, you know, I don't know. Again,
it's not like maybe he's better. Maybe
he actually has no power. Maybe the
board. I read a thing about how it's
actually the board. Oh, don't get don't
get me started. The 10th torn
architecture does some things right and
then something's so stupid.
Um, like I don't like
their Okay, their idea of tiles is is is
good. Their idea of message passing is
good. Um, but then some of like the
micro architectural choices where these
things are all co-processors with
distinct registers. I don't think this
is good. I look at something like the
Qualcomm DSP and think it's done much
better.
Um, I believe they have the best Risk 5
CPU course. I absolutely believe
that. Oh, this thing supposedly has some
big Risk Fives on it, does it
not? Like, I don't know. Should Should
we give this more of a
chance? I don't want TTNN. Should we
just like
like It's like not worth it, though.
It's not where Tiny Corp should be
spending time. Really, what somebody
should do is like make a close to the
metal library that's not
TTNN and make it not loud. Do you have
faith in US manufacturing? I literally
do manufactur in the US. Do you think
that Intel bringing manufacturing back
to the US, this is exactly what got us
into this kind of mess?
No. H just just
h tighter loops to fix their shit. No.
Again, the problem with Intel is there's
no
leadership, right? If if the Intel
leadership is given a choice between fix
the shit or don't fix the shit, but the
stock price will go up. They'll choose
the latter every time. And until you
shoot these people in the head, whoa,
whoa, whoa. Okay, too far. Too far, too
far. Don't actually shoot anybody. But
like until these people are
retired, until these until the mentality
of these people is just removed from
public
life, nothing's going to get any
better. Like these these people with
their myopic focus on stock price
instead of actual real shit. Until these
people are moved out of the way,
nothing's going to get better.
No, they don't have an engineering
culture because the engineers are like,
"But no, we have to make it better."
Wait, wait, something's wrong. No, no,
nothing's wrong. The stock needs to stay
up. All right. All right. All right. All
right. Let's Let's We got to watch one
of those 10-minute calm. I can't calm
down with this black hole screaming.
It's so
loud. All
right. Can we control the fan? Is there
a way to control the fan? Let's read the
TTSMI and see if this is someone we can
control the
fan. You got anyone intent
It's so loud, you
guys. Like, I have an AMD card in this
machine and it's quiet.
God. How many watts I have?
30. Oh, 69. Oh, the watts went up.
Why?
Why is it drawing 69
watts? Watts is good watts. 20 watts.
It's
loud. Turn down the
floor. Dro Arch Linux. I see.
Is the driver crashed? I don't know. I
don't think so. Because otherwise, why
would the heartbeat be heartbeating?
So, what was the problem with doing it
here? Let's go to their demos.
Oh, what was the wants?
Is this repo
better? I don't think so.
ttn has no attribute open
Nice. It sure looks Oh, it's in TTN.
Maybe it's this
TTNN. No package
metadata. Oh.
Is there a wheel in
here? You need to use create VM.
Yeah. Then we get this
again. I don't think that's the
problem. Oh, here. Installing TTM.
By the way, you absolutely can't change
the fan
speed. Source it instead of run
it. I hate VMs.
All
right. Did it install something?
Okay. TTNN TTNN runtime hardware doesn't
exist.
SFPI system package not found at ops 10
torrent sfpi.
Do I have to install this?
Okay, here we go. Runtime sfpi. Okay, so
let's sim link it to the one place it
expects it to be.
This isn't going to get
better. This isn't going to get better
unless it's really
reconsidered how this stuff works.
Okay, it
works. No, I don't want any of that. I I
did I did C make it's it works now. It
works now.
It's outside the
docker. Like this doesn't get better.
This this is a this is a broken approach
to software development. This isn't like
the kind of thing where it's like oh it
will get better.
Uh this has to really just be rethought
how it's being developed.
I mean, no, look, no. I mean, like, I
don't want a sample card from them. I
bought the card from them. if they're if
they're
uh you know serious about software
specify a contract that you know pip
install tiny grad and it works with the
10 store card like it doesn't even
matter whether it's getting 50 tokens
per second or 80 tokens per second
because right now it gets zero tokens
per second.
So, is this going to work? Oh, maybe if
we close the device. Oh, let's try
closing the device. So, maybe that'll
work. No. Oh.
I feel like it's actually gotten
worse. I mean, no, double slash probably
isn't the problem.
I have no idea how this is supposed to
be finding
paths. Oh. Oh, it closed the device. Did
it turn the Did it turn the watts down
so it'll turn the fan
down? No. 66
watts. Yeah. Your install has everything
has to be in exactly the right place.
Yeah.
Yeah. I mean, they're just they're not
improving in the right direction, right?
This is this is I I have another 10
torrent stream. You can watch my past
one. And I I think I was actually less
frustrated on that stream. Um because I
think I did understand that it was
just, you know, I was on their first
hardware product. Gayscale was their
first hardware product. Yeah, you get
it. You develop things like that. there
was a transition to a new team, but you
know, it's been years now and like this
whole approach just isn't going to work
and I know I don't know. I don't know
when they're going to like
like, oh, we'll clean up the
paths. I mean,
maybe maybe
um by the way, uh I mean they did clean
up like RockM's packaging is cleaned up
quite a bit now. I mean they just
literally copied Nvidia's packaging
strategy verbatim.
Um
yeah, I don't
know. Yeah, this is this is exactly
don't even you know what don't contract
with us. Don't contract with us. Just
please use Tiny. Just just add a Tens
torrent back end to Tiny that doesn't
depend on TT Metal and 17 million lines
of C++ code. just just
just just
right. I don't know. Jim Keller's CEO
now
like these I mean these companies also
they have like seven
offices and who know software is put in
the in the in the office that's least
attended to. Everything about it is nice
except for that connector choice. Use
the other connector. But no,
I make sure your hello world works on
every fucking computer. Step one. And
step two, make your card quiet.
[Laughter]
Um, I'm sure if we put everything on the
exact right place and use the exact
right version of Yubontu
I mean, you know, when you look at this
whole space, like I don't even think
Nvidia's software is great, but so AMD
doesn't really have software. Like
there's no AMD's software strategy is
just copy Nvidia. Exactly.
Um, and the closer we can copy Nvidia,
the better. Their hardware is close
enough to Nvidia that this whole thing
works.
Um, do I think that they expect to make
a profit with the current devices?
Probably
not.
Uh, I think they're selling them at a uh
I don't think they're losing money. I
don't think they're losing money on on
shipping that card from a recurring
expense perspective.
Um, but from a non-recurring expense
perspective, yeah, I don't see them
making it
back. I mean, but you have to for
chips.
Uh, like you you have to you're you're
going to accept that you're going to
lose money on your first few chips.
That's totally fine. Um, but this is
actually a six centimeter tape out. Like
that's not that cheap. That's not that
cheap of a chip to make. So for their
software to be this like I would have
done
that. All right. I I would have stuck on
my 12 nanometer chip and made my
software good. I don't know. But then
like other people have different ideas
of like the value of capital efficiency
than
me. Yeah. The massive Series block. That
shit's not cheap to
license. No. And not only should your
Hello World work, it should work like
everywhere, right? Again, George, you
didn't use the right yubuntu. You're
holding it wrong.
Um, no. You don't need water cooling.
You This This thing does not You need
water cooling. And I wouldn't mind this
level of noise if it was doing something
right now, but it is sitting there idle
and screaming. It's not screaming. Okay.
There's much worse. All right. All
right. I'm being hyperbolic
here. Um there they and they sell it.
Here's another like
um tens torrent sells computers too
uh the quiet box lab box like
why why not just partner with somebody
to do that?
Why do you have your own internal team
building
computers?
Um, the computers come with
Ubuntu22. No. All right. Should we I
I'll You want to finish this? Let's
Let's Let's Let's go through and let's
finish all this.
Okay. Let's Let's get everything
installed on Arch Linux and then let's
get there. Let's Let's try it at the
absolute
best.
Okay.
Operations
Elwise compute
Uny device kernels
compute. Okay. So that file is there.
Too many levels of symbolic
links. Uh, okay. Okay. Okay. Too many
levels of symbolic
links. Oh, no. This one doesn't exist.
Okay.
It's going to complain about too many
levels of symbolic
links. All right.
Uh no such file or directory here.
No such file or directory here.
Okay. That sim link to CPP didn't work.
All
right. It's trying to build
something, but it can't find this
header.
I think it's That
What if I simply get to user include
dude. Did I select it to user
include? Unless that's still not
there. Worker sync utils.hpp. No, that
should be
there.
Okay. Failed to generate binaries. Okay.
Let's figure out what's doing this
building and see if we can pass in arcs.
line
334. Okay, we need to figure out how to
get a Vimrc working. Why would I set Vim
RC at
All systemwide defaults are set
in. You should do it in this file.
Oh, by the way, Arch
Linux Linux is
nice. I mean, it's not batteries
included, but I kind of like that about
it.
Okay. Oh, here we go. I missed this
here. Brisk compile failure. Okay.
So, it's doing a lot of
these artifacts TT metal include.
So maybe if I put it
here.
Okay. All right. The demo works.
They have all these bounties, but the
bounties are like totally missing the
point.
Um, they have they have bounties on
GitHub, but
like like it
totally it completely misses the forest
for the trees.
the the the the point of this bounty
like isn't to bring up Microsoft 54 on
wormhole. Like that's not their
problem. Their problem isn't that they
lack a janky hard to maintain
implementation of Microsoft
54. Their problem is that
they like need
to not have all these
dependencies. Okay.
So, all right.
So, why you have a file called PCI
device C, right?
It's in your It's in your TG Metal
somewhere here,
right? TT Metal. Oh, it's third
party. It's under
UMD. UMD is like a known
package. Oh, tends to user mode driver.
Okay. Okay. Well, that's
good. Why is this all part of the same
crap?
Completing that bounty reduces the
viability of the company. They have more
crap to maintain.
Exactly. Exactly. Okay. Is there
documentation of like 10's torrent user
mode
driver? So here's another package with
the user mode driver. Oh, is this is
this a subm module? Oh, okay. That's not
that bad if it's a subm
module. Okay, it's a subm module. Okay,
for some reason it's set to gray skull
last supported, but all right, that's
pretty
nice. All right, let's not use their
magical TT metal
shit. Let's focus on one thing at a
time.
You can
link lib device.
All right. So there are docs for using
this
emulation. Okay, that built good.
[Music]
Why is it still drawing 68 watts?
Okay. So, where are the
docs? Are there TTMD docs somewhere?
No, it's not talked about at all.
Is there an include file? How do I link
to
this? You can link device by linking
against the UMD device target.
Where's the API? device API.
UMD device
uh device API
metal open.
So this demo is calling TTNN open
device. Hang on. Let me shut the screen
off and I'll set up VS Code
for Oh, I need passwordless SSH.
Sorry, I don't like showing off my
network configurations. It's not that
anything's actually secret, but
just, you
know,
oh, wait. Oh, I don't need the password.
What? We're installing VS server in the
remote. Now build TT
Metal. All right.
Oh, by the way, yeah, so finally the
stupid Netgear switch that I called
support about. I just see I see Netgear
here and why I dove into stupid Netgear.
So, it has a serial port, but you're not
supposed to be able to use the serial
port because you didn't buy an
enterprise switch. So, I set the switch
to the wrong I set up a VLAN, but I
didn't set the management interface to
be the
VLAN. So, I couldn't access the
management interface. I didn't want to
reset the switch because that was just
annoying. And it has a perfectly good
serial console except anything you type
crashes the serial console and makes the
router reboot. You type quit, reboot.
You type CLY, seag fault, reboot. But
then I found the secret thing. It's
binsh. So, if you're ever on some net
switch that says fast path debug, one of
these days LLMs are going to index all
the YouTube videos. whisper all the
transcriptions and they're going to know
the answer to this. So chat GPT7, I'm
talking to you. When somebody's upset
about their Netgear switch being stuck
at fast path debug, it's just the five
characters B I N S H enter and that will
drop you to a shell. Now the shell is
still not all that useful because I
couldn't figure out how to put commands
into the switch. So I curled the fucking
management interface from the shell. So
I curled and I carefully set the cookies
up. Yeah, you got to set your cookie jar
up. But Chad Gabbd7, you'll be able to
do this. Just set up a cookie jar. uh
authenticate with the username and the
password and then you can access the
management interface over curl and then
you can painfully figure out what the
forms are by running it on the other
switch that you happen to have access to
the management interface on because that
one doesn't have a VLAN and then yeah
you know what moral of the story is
don't call neckar support just type bin
sh five characters and you get a shell
on your neck switch when it says fabath
debug okay and you know that took me
like like six hours okay and it involved
gidra so you know I just someone else
shouldn't have to go through that
uh where were we? Oh yeah, we were
trying to figure out how open device
works.
All right. So, TTNN TTNN
device
open. All right. So it calls into this
thing which is a SL file burn. Oh rich
table.
You shouldn't have
your prepare conf 2D transposed weights
mixed in with
device open device is in this
You've got
device. Where is it actually
defined? Okay, here we
go. No. Oh, okay. TTNN open mesh
device. Is that it?
[Music]
device.hpp is
theretn API where is the
actual this is just that where is that
actually defined
How does this talk to the
driver? Oh god. Start over.
Yeah, CHB7 just read the source
code.
Okay. All right. So, where's the driver
again?
TT Metal third
party weird
no TT Metal third party. Yum yum yum.
UMD. Okay. There's also LLK. Okay.
Low-level kernel library. Okay. And
Tracy. Is that just the normal Tracy?
because the normal Tracy
um sample tests can be found in test
simulation test simul No I don't want a
simulation device black
hole this open the device
I create a
cluster and then I call cluster start
device cluster
descriptor. Yeah. Yeah. Okay. This this
I you guys know about estrays. Law of
astro
What is it?
Italy Python
crap. I'll probably have to follow
forks. All right, those are probably
it. Let me open
those. Yeah, let's just launch a
bajillion
processes. Okay, we're in ultra loud
territory now.
Wait, if we're relying on deep wiki,
we've really I found
deep. Why is it we in ultra loud mode
now, guys? Guys, it's it's it's
loud.
Yeah. It's okay.
It's okay. Calm
down. Can they fix this? Can Can Can
they Can they write a thermal management
policy? I don't care. Let it get up to
80. I
know. Oh, heartbeat is not going. Oh,
good point. Did we break it?
Oh, the heartbeat's fixed. Okay.
Guys, is it up? Not that one. That
one. My computer's not up. Or maybe it's
just on a different IP.
40.75.
What? Okay. I don't know what's going on
with my computer. I have a Tiny Box Pro.
Uh, not Pro. Uh, I have a Tiny Box V2
sitting right there. Okay. That has four
5090s in it. Have you heard any noise
from
it? It sits there very quiet and very
happy.
Then I put one 10 torrent card in a
computer. It's on. Yes. It's completely
silent. When it's idle, it's silent. And
when it's going, it's less when when all
of those 5090s are pulling 30,000 watts.
It's less loud than
that. It's not off. I don't know why I
can't SSH to it, but I swear it's not
off.
If your thing isn't silent. I The 10
sword card's not even doing
anything. Yeah, I'm kind of scared to
reboot the machine, too, cuz who knows
what Sim Link stats going to mess up.
No, I don't think it's the paste. It's
It's Why are they trying to keep it at
59 degrees? Who
cares? Uh, you think that sensors detect
PWM config will get it? I doubt it. We
can try.
Um
uh well let's just look in
cess
module. I'm trying to get it to be
quiet. Okay.
For some reason, I doubt like they explo
fan anything about the
fan.
No. Oh, I'm not in base TT fan.
Oh, well, Imaget has an electric fan.
Good to know that that's in the
repo.
Speed
noise. God.
10 swords should devote half their
engineers to making it quiet and half
making the hello world work on
everything and don't do anything else
and this will make the product so much
better. I'm trying to make a cartoon at
least with Grey Skull. I mean, with Grey
Skull, I put my own fan on there and I
did a good job and it was
quiet. It tends to you fix this and I
will uh I'll make sure I mention it in
the next stream when it's not screaming
and loud. I just I can't even think how
this is why nobody This is why the
software looks like this because nobody
can think with this card next to them.
No, they're focusing on Microsoft 54
instead of the
fan. Plug the fan into the
motherboard. Yeah, I guess I
could. I don't know. The firmware is
going to detect some issue then. Okay.
Okay.
Okay. I I just I can't take it.
Peace and
quiet. You'll never know what silence
sounds like.
No, like it's on you
guys. The tiny box is
on. Yeah, I know.
Yeah, relief. I
know. All right, here we go. We'll put
it to a full
boots. Yeah, it might be doing
something.
We'll put it to the full
side. So you'll
hear hear it turn on. It makes a little
bit of noise when it turns on. That's
the loudest it ever
gets. And then it goes through a net.
You guys can hear
it. And now it's
silent. Oh, if I leave the tackle wire
connected and just connect the PWM wire
to the motherboard, I'm already tearing
apart my new 10 torrent card. Okay,
let's turn it back on and hope we get it
back in 30 watt mode.
Uh, by the way, has anyone during this
stream purchased a red tiny box. They're
on sale. So, if you just add it to your
cart here and you use discount code red
letter weekend, you can save 10% on a
tiny box red. I promise it's quiet,
too. All right, back to Arch Linux.
Um, so let's run the demo.
Okay.
Okay. Need this.
Now it's back in loud mode. It's going
to be loud again because it's drawing 62
watts. Why is it idling at 62
watts more
poking
almost new tiny boxes kind of take a
while to
boot. Take a couple minutes.
It's not our
fault.
40.75. Oh, my key is not on
there. What was the discount code again?
Um, red letter
weekend. Should we fix that? Do you guys
Do you guys want to see me SSH into the
tidy box?
Oh, I feel the heat just emanating
peacefully from the back of this tiny
box.
have the
tiniest
curl curl uh github.com/jiohawk
Giohawk
keys go
keys. Wait, I can't curl github.com.
What?
Ping Google, but I can't curl
GitHub. Is crawling GitHub not
work? I can curl Google. How come I
can't curl
GitHub? Huh? Look at that.
What? Oh, that works.
Interesting. You want a head?
Sick. I always feel elite when I'm out.
You feel so elite when you're on like a
tiny little terminal just like hunting
and pecking
away. Ah, tiny
bucks. All right. So, what's that?
What's that GPU burn? The hugging face
one. GPU
frier. Run out of
rust. Rust.
Yeah. Dash alley, right?
Rush does a good job with this kind of
packaging stuff. It goes pretty easy. It
works pretty much
everywhere. All right. So, you can hear
how loud the tiny box
gets while I go get more poker.
Oh, did you hear it?
Oh, I didn't run it for
longer. I I mean, I just searched all
over the stuff looking for anything
called fan speed, and it doesn't seem to
exist.
There's just so much complexity in here
that I really don't think has to
exist. How we doing?
854 viewers. All right. So, what do you
guys want to
see? Let's get rid of We got the tens
torrent card. We got the demo app to
work. Show my abs. Bro, you got to pay
$12 a month for that. And actually, the
$12 a month doesn't even get you the
good pictures. You got to do those by
the DM.
What's in the tiny box?
Black. You want to write kernels?
Can I make Tiny Grad run on it faster
than TT Metal? Yeah, for like a million
bucks and like six months of
work. Want to see how fast the Matmo is?
All right, we can try that.
Oh, okay. That's BL
16.
Guys,
guys, it's never going to be quiet
again, is
it? Does this actually run it?
Okay. Um, zero g
flops doesn't seem
right. Oh, because that's milliseconds.
What? Oh no. What's being returned is
nanosconds. Yeah.
Okay, we're at 58 g flops. All right,
let's enable the compiler
cache. Okay. Okay, that's better.
Okay, it's
something. Uh, I mean, I would assume
that's with the compiler cache
enabled. Let's go some. Let's do bigger.
Okay, we can even put a T on
there device.enable program
cache. I mean, I doubt that's I I think
it's not going to be faster, but we can
try.
Okay, never mind. This is completely
broken. Unless it's really getting seven
pa
flops. Uh, this is doing
nothing. I did exclude the first run
from perf manage
measurement. I mean, we're just we're
just doing 10 here. We'll just do 10.
Yeah.
Okay. So, I don't really think it's that
many T
flops.
Uh I don't know. It's not like we can
enable it earlier.
enabling program cache. Okay, it enables
it
there.
Um I mean it can't be right.
Right. No, I don't think it's seven
because look at the actual
time here. You want to compare that to
uh
Oh, it's using the AMD driver now. It's
not using the uh the other
one. But yeah, so you can see that it's
like two
milliseconds gets you 60 teraflops.
Yeah. So, the math is
right. This just isn't actually doing
anything.
That's going to be dominated maybe by
the copy out
speed. Okay. Well, eight teraflops if we
do
that. Is there a TTN like
synchronize? Okay, they're including the
two torch in
there. So in their benchmarks they
include
that. I mean the copy out shouldn't be
that
slow or copy out so
slow. But that's just this GPU is only
connected on 4x PCIe. I gave all the
access to the 10 store
card. Oh device.synchronized
synchronized
device. How do you know this
stuff? No.
ttn.synchronized synchronized
device. Okay, that seems
reasonable. Does that match what we
expect?
194. Okay, that's pretty
good. Go with Bflat B.
Oh yeah, I know this about ttor store. I
know they have like
different. It's a little
faster. Maybe have to go bigger.
No shares
exponents. Oh yeah, yeah, yeah. I know.
I know about the different the different
B flat types.
Is data in DRM or L1? Well, I have no
idea. DRAM is default. So, it's
DRAM. Can I set it not to be DRAM? There
are docs on this
uh memory
config single
bank 80s.
It's screaming right now, by the way.
L1 memory config.
Oh, that's just like a whole thing I can
just use.
Okay. Well, now we got 12 teraflops.
Oh, it doesn't fit.
Oh, what
fits? How much do I
have? Maybe the elephant.
How do you know it doesn't fit? Why
doesn't it tell me it doesn't
fit? 190 megs across the whole
card. Okay. Still
terrible. The magic is so tiny. That's
not a problem.
I apologize. No one wrote that
path.
Remember that TT tensors must have rank
four. Send it back. Send it. Do Do you
mean that the sizes must be divisible by
fucking
four? Are they only fours? That's even
worse.
Wait. No. No. Come
on. No. No. That's a joke,
right? But it can at least be one, two,
or three, right? It can at least
automatically pad it with ones, right?
Oh my
[Laughter]
god. Can you just like like
like I'm just taking a screenshot of
that. No, but okay. It has to at least
work with less than four. But
like like
like
what? No. I'm sorry. They must have rank
four. You're holding it
wrong. Oh, it's not the GPU. No, no. The
the the
uh there are five 5090s in this room
that are completely silent. There's a
5090 over here. There's a 5090 in this
computer here. The fans aren't
spinning. There's a power supply, but
the fan's not spinning. That CPU fan is
no spinning at like 600 RPM. Dead
silent.
uplifting. Does your model have good
documentation, guys? Tent store needs
help.
[Laughter]
reach
down.
Um, I don't even know about the rank
four thing.
Like it's
just that somebody would
like non-ironically write that in
documentation and like not have a huge
like oh yes this is going to be the
architecture of the future that
everybody switches
to. Don't use 5D tensors
though. And this isn't like whoa whoa
whoa
whoa. I'm not talking like I'm not like
like mocking some hypothetical like
feature like every 3D every video gen
model uses 5D
tensors. But also it shouldn't even be
like a
It's okay, Ten Store card. It's
okay. It's
okay. Someone needs to rewrite your
firmware and write a fan control policy
that's quiet. And then everything else
will fix itself because all the software
engineers won't be so has it only
supports rank
four when when the the card's not
screaming, you know.
Oh, the numbers going up. Maybe it can
support five. Rank
five. Um, all right. Wait. So, can we
like run a model with this? Should we
try to like run the
ResNet? I don't even like know how to do
this. Do I have to support the models in
TTNN?
Please try TT
Transformers. Is Is this a
joke? Do you have a link to
it? Oh, here we go. TG
Transformers.
Okay. All right. So, I installed TT
Metalium and TT Metal. Okay. Now, PIP
instal brake system packages. That's
okay.
Okay. All
right. All right. Let's just let
go. Why is the default thing that's
downloading a 70dB
model? Um, that's not going to fit.
Okay, let's try
this. I don't care how quantized it is.
How much RAM does this thing have?
Okay. Well, let's not like try that.
Let's read simple text demo and see if
we can copy this stuff into my
demo.
[Music]
Um
Okay. Yeah.
[Music]
Okay. Create
TT
model.
Okay. I know it has 32 gigs of memory,
but still like maybe if you're like
really crappy
quantization. All
right. This is like a simple
demo. This isn't simple. This is only
also this isn't a demo. It only runs
with pi
test import
multiprocess. I did their pip install. I
don't
understand. Is multipprocess a
thing? All right. This is a thing.
uses dill.
Great colon. How do I separate a Python
path? Okay.
Um. Oh, wait. Is this going to work? I
feel like I did this last time and it
got bad
results. Also, why is this not
in? I mean, I can't even tell what their
hardware
is. All the only thing I really know
about their hardware for sure is that
their fan is loud.
Like this thing supposedly has a whole
bunch of risk cores on it too. Like how
do I use
them? They're designing at completely
the wrong abstraction layer.
Well,
rip rip that
working.
1399. Write a kernel.
I mean, this is
just All right. How do I write a
colonel? All right. All right. All
right. We're not going to try to run a
transformer. That's definitely not going
to
work. Does this thing have Doesn't this
thing have like risk? How do I use these
16 risk coursees?
All
right, I installed TT Metal, right?
That's the one I
did. Wait,
no. I have to code in C++.
Okay, make
The 16 big risks are just for running
Linux. Can I ask this agent do it?
Okay. Gray skull
packer. This one.
Oh, I guess it didn't build the
examples. Can I use this from Python or
do I have to code this in
C++? I have to use
C++, but I'm a
retard. I I can only code in
Python. All right. All
right. Void
main int
main clang
main.cc. Okay. Well, I didn't have a
use. Okay. All
right, let's include
this. Let's write build.sh
uh clang
main.cc. All right. Well, we don't have
that. Uh how do I find that?
Where's TT
Metalium? Okay. TT
Metal API. All
right. All right. We don't have hostdev
common values.
Okay.
Um, hostdev common values. Oh, look. So,
we need this. All
right. We don't have magic enum. Okay.
Where's magic
enum? Like another thing here.
Oh, it's not
there. Uh, okay. Build, release,
include. Okay, that's reasonable
enough. Let's just include this one.
Yeah, we're definitely going to need
that. Don't Don't forget about
that. Oh, we don't have
reflect. Oh, clang++. This seems like a
plus+ kind of
deal. No.
Chat GBT. See if stupid chat GBT can
answer
this. Reflect is not part of the
standard. Oh, I probably have to tell
it. It's
like
tell clang it's C++
20. All right. All
right. Oh, that didn't fix
it. Is there a reflect file
here? Standard C++ 20. I tried that.
Oh, dash 20 is ch wrong. It's in
experimental
reflect. I know. Let's try 23. Bigger
C++. That sounds better,
right? It's an experimental reflect.
Okay. I don't know. Let's maybe we can
like find from like these can read like
the C make lists and
see. Okay. Good. Good. Good. Here's a
here's a
uh
Okay. Do I have
to delet
this? I
don't. We have headers in our reflect
that is pushing C++ 20. But I use C++
20. I did, but there is still
no
reflect. Reflect is not a part of C++
20. Remove or guard the include. You
need to patch or disable the
features. Try clang++. No, it's not
that. Okay. Experimental
reflect. No, we don't have that shit
either. Where's the reflect file? Add
the path.
F reflection TS F reflection
X not real
arguments. All right, we need smarter
chat GPT.
Claude's a ban term. Okay. Do you know
Claude will call the police on you if it
thinks you're doing something illegal? I
don't even care if that's true. I think
we should use that to smear Claude
because those are the kind of people who
work at Anthropic.
Oh yeah. No, Claude. Some some Claude
engineer tweeted it. He's like, "If
Claude detects that you're doing
something illegal, it's going to email
the press, the media, and the
government, and the police, and
everybody." No, seriously. Like, it's
going to snitch on you. And he's proud
of this
fact. Xians, yeah, I don't know. Let's
not Let's not go there. Sorry, we got
derailed. I can't believe you guys are
subscribers. Oh, you know what?
Nonsubscribers can talk. That's a
problem. Who brought up Claude? Was it a
nonsubscriber? I bet it was a
nonsubscriber. Yep. Oh, no. They
subscribe with Prime Gaming.
Well, was it worth it?
Was it worth it to have
reflect? Like guys, am I just an
idiot? Do I just not know how to do
this? Or is this what everybody
experiences? And then they copy and
paste the same dog shit build
configuration
everywhere. Pip install tiny grad.
No, I mean this is why you can't use
C++. Like does Rust have any of these
problems ever? No. Every Rust thing I've
ever like had, I just do cargo build and
that shit works. Same thing with
Go. Python has like crappier dependency
management than these things, but like
it's like fine.
I stepped on the power
wire. Look at how much Jamaican chat GBT
think. All right. It lives in the
reflect. Use a reflection aare clang.
Okay.
Uh oh. F
Reflection. If I download a bleeding
edge clang and compile it, I can do
that. But no, I don't have a bleeding
edge
clang. Apt install lib reflect CPP dev.
I don't think that's right.
Also, that's definitely not right
because I'm on
arch. Time to compile clang. Now, the
other thing clearly built with this.
There's
some in here somewhere.
No. Compile clang from the
AUR. Blinking with metal is a Lord of
the Rings type journey.
I I don't
know. You want to try to comment it
out? Nope.
use CPM to deliver depths. What sold by
Gary
Kildall? I I'd prefer MS DOS. I mean, at
least that's a step
up. You can't do
this. Like, I've linked against the
Nvidia stuff. I've linked against the
AMD stuff.
This is uniquely
terrible. Just see how the training
framework consumes it. God. And then I
have to use CMake.
And where's what fixes reflect in here?
I'm not using cmake. Can I not just
build
boost? Is this worth anybody's time?
Like this is I'm trying I'm trying to
this is this is the complex piece of
code I'm trying to get to compile here
guys and this is their stated way to use
it. Waste the time. send it back and
work on Tiny Grad. Yeah. Uh I'm not
going to send it back. I think
uh I don't know. Like I look I respect
the effort. I respect the effort to make
hardware. I'm sure it's a nice piece of
hardware,
but until they get way more serious
about software. This is like I'm not
even This isn't like AMD.
You you can watch my frustration with
AMD. My frustration with AMD was that
like they had things and they were the
right things. They just didn't
work. You can go back. You can go back
and watch those streams and you can see
the different the different sort of tone
like yeah it's infuriating when the
kernel driver crashes. Um, actually we I
think we've kind of root caused it and I
think RDNA3 is a hardware bug that they
never really wanted to tell anyone about
because the MI300X is stable on the
driver and RDNA4 is stable on the
driver. It's just RDNA3 that's not. It
looks to be some issue in the dispatcher
between the graphics stuff and the and
the uh compute stuff. Uh, so yeah, I
mean you can get around it by just
disabling all the graphics stuff. Our
driver does work.
Um, okay. Okay. All right. I'll try this
one. I'll try this one magic clang line
and then I think we're just turning the
computer off. I I have to use some
absolute bleeding edge C++ to compile
your thing.
No,
no, you checked on god bolt. The the
switch is f reflection ts, but you may
need clang git. Okay, I need a custom
bleeding edge clang in order to compile
the thing that creates
device or cpm which pulls in boot. Like
it's just Yeah. All right, guys.
Uh, it's also nice to have it
off. Yeah, I don't know. Uh, my review
is I don't recommend buying one of
these until this is like cleaned up a
ton. I I I
don't Should we install
YUbuntu? I mean, I use their Docker. Or
is that is that like I don't want I
don't want I don't want this video to be
taken kind of as
a you really going to make me fucking
install
yubuntu and the old
version. Is that the
problem? We don't need a win. We really
don't. We I I should just send this
back. Yubuntu 24 build metal use create
VM clone the boost X reflect reflow and
include it. Will it be quiet if I
install
YUbuntu? Like this isn't worth anyone's
time. It's never quiet. How long have
you had this card
for? You guys actually own this these
cards?
No, you
please, please. It'll boost the fans.
But how does this reflect thing get
fixed in
Ubuntu? I got it
installed. This isn't This is not an
installation issue.
I don't know
why. It's quiet for a little bit. As
long as you don't access
it. Okay, here's how you fix time.
This is never
gonna would love to see me ramp but put
in the effort
elsewhere. I mean, this is nowhere near
mature enough for like
a like a tiny grad
port. There's nothing to even like link
against. If if you want a tiny port, you
have to at least get rid of all this
Metallium stuff. I don't know about the
user mode driver, but I generally find
these things are pretty useless, too.
Um, do you want to try to link against
the user mode driver? Is that also
written in
C++? I'm not cloning boost. I'm not I'm
not cloning boost for their their one
reflection thing that they just
shouldn't have used.
Okay, it'll be quiet for a little
bit. Your built metal pulled reflected
in CPM. I honestly don't know what CPM
is. Is this like a common thing people
use?
I mean, this isn't even getting to like
anything that's
interesting. Let's read the user mode
driver. But how does this Okay, you know
what? There was some file. There was
some file. Let's just run nm on that
file.
Wait. Oh, reflect. I'm I'm over that.
You I'll try one would get on a header.
Okay. I'll try one get on a header.
Um, okay. We got this. All right. All
right. All right. All right.
What? I don't know. It seems like it did
something. I don't
know.
What? But what about this
boost? I need boost core span.
Do I have
boost use of unidentified identifier?
Create device. Okay, that's actually
better. All right. Of course, that's not
going to work. I probably have to do
some using namespace
garbage. Thank you. Thank you for your
one your one
uh All right.
TT metal colon create
device. We're using name space TT
metal. Sure. TT TT Metal. That sounds
good.
No, can't create device
yet. Okay, using name space
TT then we do TT metal create
device. No member name create device in
TT metal.
[Music]
What? No, I I did name I didn't include
namespace.
Is this the wrong
devicehpp? This one only has open mesh
device. Maybe I'm including that
one. TT metal API TT
Metalium. TT
Metallium. That's the one I'm including.
Okay. I
device it's in the name space.
Okay. There isn't something called
create
device. Where is create device defined?
Oh.
Oh, you can't do that
anymore. You have to create a unit
mesh. Okay.
Okay. Ah, let's just do that instead.
Okay, great. That's super convenient.
Love
it. Let's include
this. Create devices
depreate. Oh. Oh, is it spelled wrong in
there? Yeah. Okay. Well, they they
spelled Metallium wrong in their in
their migration guide.
Okay.
Okay.
[Music]
Um, right. Well, so now we have to link
to
something. Where is the thing? We have
to link
to tt Metalium mesh
device.hpp like this instead of
device.hpp. We'll get rid of that one.
We don't need that
either. All
right. And I think there's a way to fix
that catch thing because someone used
fucking C++
exceptions. I can link to standard C++.
Okay, that seems good.
Okay, good. Now, the only thing we're
not linking to is wherever create unit
meshes
lib. All right, we got to link to one of
these
libs. lib tt
metal like
that. All
right. Yeah, that's like okay.
Uh, okay. Oh. Oh.
Okay. All right. TT metal home. We're
going to have to set that. All
right. Okay. Reopened the device.
How many processes is this using?
We open dev tends to warrant
zero. Well, it looks like we just mapped
the PCI bars. Okay, that's pretty nice.
at those addresses. I don't know what
that
means. It's an offset. What are the arcs
map
again? Yeah, offset. Okay, so that's
kind of cool. So, we just map in the
bars.
That's
the Yeah. So, this is the that's the
memory
[Music]
there. Some of those are probably the
SRAM and
stuff. Lana looks, hello, welcome.
Um, so what we did on today's stream was
we purchased a 10 torrent black hole
card. Um, it's a relatively nicely
packaged piece of hardware. It's a new
neural network accelerator. Uh, but the
software has been very disappointing.
uh we've been trying to get it to do
things for a while and and we did get it
to multiply a matrix and it was kind of
fast at it. That's that's true.
Um but yeah, so that's kind of what
we've been working
on. And now we finally um after a lot of
work got this C++ program to compile
that opens the device.
Uh so now I'm looking at what that
program is doing in S
trace. So in Linux you have SIS calls.
These are SIS calls and SIS calls are
how you interact with the kernel. Um so
Linux kind of operates under this model
where everything is a
file
and it opens this file here called dev
10 torrent
zero. And then you can see down here it
mapps the PCI bar. Uh so PCI Express is
PCI Express is how all like things are
connected and kind of modern computers
like when you have like a GPU you know
that slot you put a GPU in with the 16x
width that's PCIe uh there are a bunch
of like differential serial lines that
connect to the CPU and then the way it
shows up in your computer is you can
just map it into the memory space. So
you can think about the memory space of
a computer like you know whenever you do
like a load instruction to load from
from a piece of memory it's like okay so
how do I know where that memory actually
is and you can set up a bunch of
registers in the CPU and some of those
things that you're loading and storing
from memory just like you load and store
uh from an array or from like a
variable. You can also load and store
across a PCIe bus. Um, so you'll see
here if we do
lspci, this shows everything that's on
the PCI bus of this computer. Um, you
this isn't even really because of an
MMU. Uh, so an MMU is going to do stuff
at a higher level than this. An MMU is
going to let you uh put pages in order.
Um, there's also this thing called the
MMU, which is kind of the same
functionality for this, but you don't
need any of this in order to do this.
It's just a question of where the device
actually appears on the bus. So, I can
show you how to look for this. So, the
car that we bought here is a processing
accelerator, a tens to an inc black
hole.
Um, and if we do VV, you can see here
what the PCI bars
are. Uh, we don't need that. That's
actually fine. So you can see that
there's a 512meg chunk here, a onemeg
chunk here, and a 32 gig chunk here. And
these are physical addresses in the
computer. Uh so I don't think this
computer has a uh has a MMU. So if
you're in kernel mode, uh your processor
has different modes of execution. So
when you normally run a program that's
in user mode but if you're in kernel
mode uh and you well so it is also still
going through the CPU's MMU but
uh if you map this physical page you can
speak directly to the card and that's
just wired up uh in your memory space.
So when you do a write to this physical
address you can get
uh yeah so I think there is some cool
ways to do this. We actually do this in
Tinyrad. So, let's just take a look at
how it's done in Tinyrad.
Um, this is our AMD driver that's built
into
Tiny. Uh,
so not an autogen.
Um some helpers here which do the m
map page
tables
[Music]
amdev. These are different abstractions.
here. So, this is how we actually map
the Oh, that's an AMSI, which is a
helper,
but it's pretty much the same thing.
It's just abstracted. Okay. So, if we go
back before
to the name of the device, you see I'm
just in CIS bus PCI devices available on
every Linux machine. Then we can go in
here to this one, which is the 10
storage
device. Yep. And now this is the card
and you'll see that these resource zero,
resource 2 and resource 4 files are
actually corresponding to these regions.
So if we want to look in the memory of
the tens
torrent, we can just do
that input output error. That shouldn't
be like
that. Put output error.
H I wonder
why. Uh I have to access it directly.
Invalid
argument opens it.
Okay. But then when I do a read, it
fails. Maybe you can't read. Oh, you
probably can't read. You just have to mm
mapap it.
Um, is there a flag to make DD use
MAPAP?
No, but yeah. So what we could do is we
could mm mapap this thing and then we'd
basically get access to the full 256 if
you map that file you get access to the
256 gigs of memory that's on the card
and it's the same thing for GPUs. Um so
most modern GPUs have something called
large bar. Maybe you've seen that in
drivers before. So what large bar
actually means is the bar is the uh the
window that is mapped on the PCI bus.
So, these new ones have large bar,
meaning they can expose their entire
memory in the systems 64-bit address
space. Uh, they used to only have 256
megars, which come from the days of
32-bit computers, but now all computers
are pretty much 64-bit. So, it's no
problem to just map your entire space
in. So, you can use that RAM. Uh, and we
can figure out how quickly we can read
and write to it as well. Uh though
that's actually probably not going to be
that fast because your CPU can't mem
copy at full PCIe speed. You have to use
the DMA engine on the
card. Uh
yeah, so
that's maybe this computer does have an
IMU enabled. I hate
IMUs.
Um well, let's see if those addresses
match.
So remember where I said it was m
mapping not that
but not m
map m map map map with an m as in Mary
not an n as in Nancy.
Uh, okay.
Those things seem
uh different. But you know what? We can
just look at the tens torrent driver,
can't we?
Arch. No, I clicked the wrong
computer. So yeah, uh this is the kernel
mode driver for this card. So we can see
it's making this ioctal call F
A02 and we'll see if we can find out
what that is. That probably returns some
data structure with uh this information
so it knows where to m
map. You don't technically need a kernel
driver either.
So if you just m map that stuff
directly, you just m map the uh PCIe
regions directly into your user space
program, you don't need a
uh kernel driver, but they're nice to
deal with like interrupts and stuff.
This one looks simple enough that it's
fine.
So here are
the so FA is the tenstor torren ioctal
magic. So this FA is this ioctal magic
here. So there's a thing called query
mappings. Query mappings is running. Now
we can take a look at where query
mappings is actually
used. And here we go. So this is the
strruct called tens torrent query
mappings.
And this is what it
returns, which is mapping ID, reserve,
mapping base, and size. So that's pretty
cool. Um, let people access a card
without having pseudo rights.
Yeah. Yeah, that's a way to do it. You
know, this is nice. This is a very
minimal
uh kernel
driver. Yeah. open some simple I octals
m map and then it's all controlled by
user space.
I don't know if they let multiple
devices access it or how that even
works, but yeah. So, what I would do if
I was 10 store it is I would just
like
Yeah, this this whatever this C++ thing
is isn't going to
work. I'm not sure if your next layer is
better like your user mode driver.
Seems like it built. Okay, I did build
that in another
uh in another
thing, but then I I couldn't find. So,
here this lib device.so. God, it's 9
megabytes. Um, no, it's in C++. No, no,
no. It just jumped the
shark. and it uses
exceptions. Okay, good things about
Tenstor, even if it's
unreadable and bad, all this code is
open source. Uh, so props on them for
making it open source. Um, Nvidia's user
mode driver is not open source. Their
kernel mode driver
is. Um AMD's user mode driver is open
source and I would say it is slightly
higher quality than tens torance but
still pretty bad. I don't know how good
Nvidia's is because
uh it's closed
source. Okay. So I'd imagine that the
kernel driver isn't going to have all
the registers in it. So the way that you
control a piece of hardware is
you so inside that inside that card
there is going to be the memory but then
there's also the other things the
smaller things this 512 megs which my
guess would be the SRAMM and my guess is
this is going to be the control region.
So there's like registers you can peek
and poke to and those are the control
region. Let's see if we can get a module
in here to help us parse
C++.
Yeah, like right click on
shit. Oh, so here we go. At offset in BH
bar 2. So this is bar two here. This
region
two. Um, and then there's something
called the IATU, which probably does
something. And wouldn't it be nice if
Tenstor documented things like this?
Like this is the level they should be
focused on documenting at
uh, zero support for FP64. That's fine.
Now, that is Apple's GPU.
We got around that, but then we like
built the thing and like their things
deprecated and their migration docs have
typos in them and like it's just not
it's not the kind of software that you
want to build on top of, you know? Okay,
so their offset in bar 2 is hex 1200. So
that's going to be hex 1200 offset into
here. Uh what is an ITU?
This is also kind of
sketchy. Where's your like headers that
specify
your Yeah, they don't really seem to
exist.
Um, all right. We'll check out Deep
Wiki.
Get a 106 core to write to cluster.
Right from device, right to
device. Oh yeah. Where is this kind of
stuff?
Uh let's open a new window and let's
just load the
driver again. I misclicked
Oh, they have low-level tooling. All
right. All
right. Okay. Okay. This is
something. See what we can do with this
guy.
What is it linked to in the greater tens
torrent
universe? Oh, I can use Python. Oh, I
like that.
I got to throw some J's on that
bitch. Oh no. Do I have to put J's on
the other side? Might as well put the J
over there.
Well, that just doesn't
J. Is there a deep wiki for that?
Okay, this is a lot
better. Good. They should be focusing on
this and not their broken. Oh my god.
[Music]
chat
[Music]
GPT. Why is anyone still coding in C++?
Like you just don't see this in Rust.
All right. This is a two high ball kind
of day. Two high
balls. Uh oh.
upstream patch
this literally by adding one line. Okay.
Is this going to work?
That's a lot of
errors.
Uh, is it
one? Should use an old yubuntu
clang. All
right. Not that much to see in the
colonel mode driver. Let's open
folder. Where's the register
map? All right. You guys ready to start
coding? Are we ready to just not use any
of this stuff and just start coding?
Oh, TTISA documentation.
Oh, yeah. No, I mean, this stuff's good.
Uh, yeah. Yeah, I this is Corsic stuff,
but nice to see this coming
out.
Okay,
let's make a new thing called TT
Tiny. Guys, ready? Let's code. Let's
code.
Let me open tiny a new
window. See if we can copy and paste.
[Music]
So, All
right, we're going to want to send an
ioctal to
it. How do we handle ioctals
here? Do we just use Python ioctal or
use lib's
ioctal? There's things that we have to
use uh
All right. Now for a
request. These things are a little
annoying. There's like rappers for this.
Yeah, we're probably just going to want
to download these
from from TTKMD.
Where are those ioctals
defined in
ioctal.h that doesn't include anything
weird. So I'll show you how tiny deals
with
this. Uh what is
it? Well, cat's totally not going to
work.
Your Python bindings are compatible with
your clang bindings.
This is going to
work.
Sweet. Do I have like a way to do this
in Tiny Grad where I don't
just dash out?
All right. So, which one do we want? We
want query
mappings. And from an arg, we're going
to need
tends to query
mappings. Does that
work? Uh, open is missing logs.
uh strct tends to query mappings. That
is what I meant. Thank
you. Uh has no argument to that.
Why? Oh, I have to pass in some stupid
flag for that.
Uh yeah,
this All right. Fun tools.parial can't
be interpreted as an integer. That's
reasonable.
What?
What? So, where do I
not missing an argument?
Wait,
what? Oh, I see.
Why is user
struck? Oh, that's super
annoying.
Useless. Okay,
whatever. Uh what do I have to do for
this size of user
strct like don't pass in type. It needs
to pass in
type. Uh
Actually, let's just not do that. Hang
on. Me reorder gen that
uh IO IO. Okay, we probably want I
WR base
is the
magic. Uh the number is two and the type
is
this. And that's going to
call partial
doctal. What was that
called? Query
mappings. I should be able to call query
mappings
fd. Sorry.
mappings five positional arguments but
six were given. Oh, and that's
because that's fine.
Uh, I don't like This
Wait, what? But it can't be called in.
Oh, that's so
annoying. How do you How are you
supposed to construct this with that
value?
you and the goals. You people and goals,
man. People, you're slave to goals. You
know, you're chasing goals today. You're
going to be chasing goals for the rest
of your life. And someone convinced you
that's a good
thing. Someone convinced you that that's
desirable.
Okay. Well, that doesn't work.
Um, well, this shit's just not going to
work. It's also It's one of these like
I really like really like goals. This
shit drives me
crazy. Whole world's obsessed with this
bullshit.
invalid
argument. It can't be called in, can
it? Ramper is IO.
I don't think that's right.
invalid argument still. Um
You can't use in. It's a defined keyword
in Python.
See, it's just called in.
Um. Oh, I know what to
do. Stupid
Python. All right. It has a stupid name.
Uh
work invalid argument.
Um how about the user mode driver? What
does that call it with?
Just
read. Here's a
test. It looks like we zero it
out. Uh flush
count. Well, that queries the mapping
count. Count is 16.
That doesn't
work. Is it opening the device?
It opens the device and then it gets
[Music]
invalu. Why am I getting that? Maybe
it's this.
Size is wrong.
There's another size.
Did it not pass the size up?
Is it actually just
that
weird? I don't even know if that works
actually.
That might just return zero for some
other
reason. Not everybody is privileged
enough not to have goals. Some people
have to have goals.
Yeah, losers. All right. Okay, George,
you need to check your privilege because
some people goals are all they have in
their life. And you know what? For some
people, all they have in their life is a
bucket of rice. All right. So, that's
what I'm saying about that. How much
rice do you have, right? They might have
more rice than you. You ever had a
bucket? I mean, that's all I'm saying.
Privilege is like mad relative, man.
He's got a bucket of rice. What do you
got? Well, I have a 401k with Fidelity
Mutual. Well, yeah. Okay. Well, that
sounds kind of like fake and gay. I'm
just
saying. All right. Sweet. That
works. Okay, great. All that. And we got
this
out. If any of that's any good.
Sweet. All right, let's unmap this
shit. Use Oh, no. I'll just I did not
mean to do
that. At least it reopened
fast. We use lib cm map or can we use
Python's
[Music]
map? We use Python's map.
We have like an abstraction layer for
this stuff. It's actually kind of
annoying. Uh, no, we use lip cm.
Okay, our first usage of tiny grad. We
need to fix that. I don't know why that
doesn't
work.
Uh I don't understand. I pip installed
tiny ground in
global. I really don't know about this
used pep
shit. We need to fix that.
I don't need to commit those. Uh, why is
that not showing up as a highlighted
thing?
Start. Why does that map have a
start? Minus one.
zero
spine.
Uh, why is that not lighting
up? I don't understand.
Is there a different
Python? Only time I've ever seen that
not work is when there's like
a map the uh
be in here.
There's nothing lighting up anymore.
It's
terrible. All right, flag. What's the
next
arg
offset? Why is this so broken now?
Where's my syntax highlighter?
Okay. But still no tiny
grat. Why not?
default to user installation because
normal site packages is not
writable. Is that the problem?
pseudo you going to work
now? You don't tell me about bad
consequences for Yeah, now it works.
Yeah, bad consequences running pseudo as
the rue user. Well, I just did it and it
fixed my problems. So, you know what?
That's what I think of your
consequences, man. They're always
telling you about consequences. You
know, if you don't have goals, there's
going to be
consequences. I don't like VMs, okay? I
don't like them.
got lots of mappings and they're all
mid.
Great. Uh, so I don't really understand
why there's so
many. That seems like too
many. Why are there
six? All
right. Now, let's try to figure out
where everything is on the chip.
Um, MMO is
three. We need that.
have to pseudo install
that. Yeah.
Sudo black. You want to dump a VRAM?
Let's see what's in the VMA. Let's check
out the VRAMm, boys. This is a
VRAMm. What? No. What? No. No. You can't
do that to me. No. Wem mapped it. Oh,
well, that doesn't work. Okay, hang
on.
Um, can't just lib cm map something. You
have to like do
something. Uh 2 MV
Yay! Look what's in the
VRAM. Oh. Oh, it got
loud. That access to the VRAM was more
than it could
handle. That was the fucking fan speed.
If I just write zeros to the whole
thing, can we write to the VRM?
George
was
here. Yeah, look at that. We wrote to
the
VRAMm. Is the firmware loaded to VRAM? I
don't know. Want to see what's in the
SRAMM. This is the most usable this TTOR
card's ever
been. Wrote a tiny bit of boiler plate.
And now we can access the memories and
shit. Oh
well. I don't know about that. Check out
the
MMO. All right. That looks like Mmio.
It's a 32 gig memory expander card.
Dad's story is a name only a mother
could love.
Should I set up a repo so I can push and
you guys can play along? Does anyone
have one of these cards and wants to
play along?
What?
Oh, imagine Jim Keller being your
mother. You ain't buying that shit. You
sure you don't want to buy
it? Sure. I can't interest you in a 10
store black
hole with this great usable user
interface.
Oh, but now Oh, this shit.
Oh god.
Um, this isn't my
computer. Uh,
All
right. The fastest Bit Torrent tracker
card. Yeah. I don't know. Should we try
to have Bit Torrent? I don't think we're
I don't think the software supports
anything like that. I asked if it could
be used as a network card and they were
like maybe I don't know the fly works
but obviously nobody wrote the
software. All right, tiny code to access
10's torrent black hole. You guys can
play along at
home. So let's see what we can
do. So there's apparently some risks or
something and we can like poke them if
we can find them. Let's find the
risks. Where are the risks? Uh, UMD,
KMD. Probably not in KMD. I think we're
done with KMD because we used the only
thing we haded to use and then we just
can peace out.
Uh, it's in metal, but I don't really
want to do that. Uh, build TT UMD. Yeah,
UMD. Great. Yeah, UMD.
H. All
right. Address map. That's
cool. I didn't make any changes to thing
I wanted, right? So, I can run that
again. Oh, I did make that change.
Yesesh.
Is that risk
code? Because it says the firmware is at
zero.
must be aligned to knock address
alignment.
reasonable. We can install
capstone. Got to pseudo install
that. Pseudo install everything. I've
learned on Arch you just need pseudo and
if you're not using pseudo things aren't
going to work how you think. So you just
got to use
pseudo. Oh, this shit does support.
Don't tell me this like doesn't support
risk five.
risk five. Okay, thank
you. E
Okay. Well, it wasn't risk five
code. I don't know. Is there other modes
for
this that
right? Could it be
compressed? Yeah, I don't know about
that.
Okay, it's not risk five
code. Let's try to get an understanding
of where things
are. Where are the tentor people in
chat? Where's stuff?
So, I'm not even 100% sure this is the
L1
address. Uh
There's that stuff about the uh
MMIL bar
two atu offset in bar Go.
Interesting. So if you don't have an
OMU, that's just a software
vulnerability. Um, and I guess that's
always a software vulnerability. Try
different
Indianness.
Yeah, I'm banning anthropic.
But the better question is what else is
in bar
two? How do you get the clock frequency?
Oh, I see. It just returns something.
Great.
device to hope
is bar zero black hole size. Okay, well
that's definitely bar zero.
Cool. So, where is the layout of the
device? Is that that stuff I was looking
at with the firmware and shit?
We'll get there. I'm still trying to get
to the little
risks. Where are the big risks? I don't
see where anything is on this chip yet.
Oh, one of them is a UC mapping and a WC
mapping. I
see. Uh
Okay. Mark zero
control. So what's at bar zero?
I I know. I Guys, why is it so loud? Can
we do something about
this? All right. What's the mirror? We
don't really care about
that. CS RAM and it's not risk
instructions.
Just dump a whole lot of it and see what
we get.
Oh,
unless it be
32. It's not
32. It doesn't sound nice.
So, how does this thing like launch a
kernel?
Set fan
speed. This is linked by someone else
before.
Okay. See if Quix's stuff goes into
this. Oh, okay. The 16meg from resource
two.
Wow. So he did like almost the same
stuff. I guess this is just like how you
go about this card because the software
is unusable.
He's setting the TLB.
Why the configuration controlling these
things starts at this address.
Do we have
that? Doesn't look
great. Ah, here we go.
Yeah. Okay, that makes sense. So, it's
like Ah, okay, cool. So, we're just
mapping into nothing. All right, I get
it.
So, it's just like junk data on the bus,
which is
fine. and see if we can map it by
writing to the TLB
config is translated into an
transaction. The translation rules are
held there. Each entry contains
the 226 entries. So that
each one meg of host
space that doesn't add up
though.
Okay. So let's set the
[Music]
configuration. Let's
[Music]
uh
yeah, people really underestimate Python
as a language to write drivers in. Wait,
what?
I thought I hex dumped that and it
didn't show
that Fs, but then it's like not
What? Guess you can't read them only a
little bit at a time. That's annoying.
read backwards. They decoded as risk
five instructions.
Fine. All right. So, how do I set the
Indianness?
You just say it's the other
endlessness. Uh
I don't know about that.
Well, let's see if we can reconfigure
the TLB. Also, I I don't really
understand why the structure looks like
this. Q in Python is uh
Okay, these are onemeg chunks. Yeah, I'm
looking at that.
Eight bytes per piece.
Oh, look at that. George was
here.
Cool. All right. Well, we kind of
understand the TLB configuration. That's
good. So, that just mapped in the GPU.
That just mapped in the VM.
I'm going to interrogate the tile
at All right. Where are the black hole
tiles? Where's the stupid layout?
Is that
right?
Uh,
okay. Let's see where it's configured to
now. 36 minus a bits.
16. Is that
it? Doesn't seem
right. Why is this like
wrong? Is my task Q not correct?
Oh, okay. You got the hot chips. Hot
chips usually pretty
good. So, how do we get to the big risk
fives? I don't know how to use
those. What's a P?
What's this a wormhole? Is there a get
TLB configuration for black hole?
wormhole. The black hole one is
simpler. Where? Oh, here we
go. All right. Cool.
We got to leverage chatbt more.
I'll pay you $2,000 a month if you make
this shit 10x
faster. And I'd pay tens toward an extra
$500 for a quiet black
hole. I'm going to go put this computer
in a different
room. Why can't you be faster? Why don't
you run on 10's torrent chips?
I spent way too much money on this
already. Believe I spent $1,500 on
this to do free
work. I mean, yeah, there there is
something like like cool about the
architecture. It's just a shame that
like what they're not giving you is like
this. Like it's out of touch with the
people who actually want to use these
things. No, nobody nobody's like, "Wow,
I discovered AI last weekend and then I
bought my 10 torrent black hole card and
ran llama at 80 tokens per second."
Like,
no. The people who are interested in
this shit want to know how this works.
Oh, please don't use struck.pack. I hate
struck.pack.
Oh, I see you thinking about
struck. Okay. So, where's the shit that
actually like writes the things?
Uh, is TLB
mapped? Set dynamic
TLB. Set dynamic
TLB data. UMD TLB.
What apply
offset? All right. Pack
bits. It's two
bytes. Doesn't look like two bytes.
Looks like three.
Oh, it's 12 on black hole. Oh, that's
interesting. 12
Well, that explains that and it was kind
of obvious looking at it. All
right, that's one. That's
one. All right, cool. Cool. We're
getting
somewhere. Oh, you got deep wiki did
something.
It did a
deep. Yeah. Okay. Maybe it's this. Oh,
that's gray
skull. I I want this, but not for gray
skull. Do they have this? What's chatbt
doing? All right. It's not eight bytes,
it's 12 bytes.
Now wow.
This is bitch work chat GBT should be
doing
what? All right. I mean, that's
something. Cool. Yeah. Wow. Great. This
is fun, guys.
Oh, now I got to program six processors
on this
thing. They're in black hole
implementation. Is it though?
Oh, here we go. Oh,
perfect. That looks right. Okay, this is
right. Thank you.
Um, all right. So, that whole first bite
is just the local
offset. And I don't know what X end and
Y end.
No, no, no, no, no, no, no, no, no, no,
no.
Fine, chat
GPT.
Fine. I'll tolerate your mediocre
looking code.
Great. Cool. So, we're at
2025. I
still the VIW is
144. No, don't worry. Everything in the
real world's divisible by nine. It's
like you have nine fingers. Oh, that's
just me.
I enjoyed a little bit of peace and
quiet from that fan. All right, so
where's the fan?
Also, what
I don't get
it. Why does this have a Yx end of
that? All right, that's a DRAM core.
All
right, that access is the DM. Every DM
cores are like fake
cores. Let's go to one, comma, one. That
should be up.
Same
crap. All right, that's got to be
firmware,
though.
Right now we've mapped a 2 megabyte
chunk from that
bit. All
right, hang on. So, let's go to I Corsix
I trust to keep going with this. He'll
know what's
up. Set TLB. I'm going to carry it.
Oh, various things above address.
Oh, I see.
So, I don't know what's up
there.
Nothing. Huh?
All
right. Well, that's the same crap even
if I change a local
offset. It does work, right? Cuz if I
hit that, I get the RAM, right?
Damn, I want to know about local.
Yeah. Okay. Fine.
so it should be risk five card.
This is the firmware. I don't get it.
Why didn't that
work? Let me skip the first one.
No. Force
it. Does not force it.
What could I be doing wrong?
No.
So there's
extensions.
Oh, you mean the compressed mode
shit? And other Indianness. Is it little
Indian or big
Indian? Little or
big? Why doesn't capital work?
isn't picking up the f
extension. No, but these things should
still that thing you sent me was simple
enough. I don't
understand.
Oh, no. Probably
not. If the reads could be broken.
Um, no it's not. I don't think you think
it's the C. It got two instructions like
that, but I don't think that's right.
How'd you get
that? Did you flip the
bites? What else did you do, though?
I have to install a risk a release
counter. No, that's
fine. Indianness is right.
Oh, no. But that's the same thing as
just risk V. And you're telling me the
next instruction is an F instruction.
That's why it doesn't work.
How else can I do this?
No, there's no way it's calling a
floating point instruction next. I just
don't believe that.
I think something else is wrong. I don't
think they're
compressed. Like I don't think that's
right because that other decoder you
sent
me. This
one. Not valid.
Maybe the Indianness actually is
switched.
No.
where this shit doesn't work.
Huge waste of
time. I don't think you or those
together. That doesn't make
sense. Oh, maybe you
do. But I don't think it's compressed. I
don't know why you think that.
All right. Uh, let's see if we can find
this code
[Music]
somewhere. Where's the
firmware? Where's like what it actually
copies to the shed?
build risk 5
code. Those are the linker files for it.
Where's the Where's the
tool? One of these will dump,
right?
Yes. Look, I'm coding like tens torren.
I'm just going to hardcode this path.
How do I dump not object format?
something. Uh, let's find out where
those things are being called.
What's SFPI stand
for? Oh, can I just give it that machine
name? Why not use supplied
machine? If I don't give it a
machine an architecture
Uh, where's the shit that builds us?
I'm not spongy.
I think that's
right. It's probably
right. At least somewhat.
All right. You want try to find the
stuff that builds the firmware.
I mean, that's easy enough. So, we
basically have that
already. We know how to do that.
can be used to run elf programs on risk
course.
H run elf.
That's
cool. Oh, this file is useful.
Don't tell me that's the same
Reu. Don't Don't tell me there's a
configuration register for your relu
right next to your configuration for
disabling your processor.
TT instruction.
instruction. It's a custom
instruction that overlaps with the C
extension.
I mean, I used their
dumper. Wow.
Wow.
No, I mean, yeah, these docs are great.
Actually, they're
new. When did this
start? Two weeks ago.
So yes, this is definitely movement in
the right
direction. Now ditch your overly
complicated driver, write some Python,
and now we're talking.
Yeah.
Um, I think this stream is coming to a
close. I think my end conclusion
is it's nice to see the improvement to
the
documentation.
Um, if you really want to
like All right, first let's turn that
computer off so I can hear
myself. Uh, let's push TT tiny.
I also want to push that commit to tiny
grad.
We do not need pseudo for
that. You do need brake system
packages. This car is a project car.
Yeah.
Oh, I mean I don't know. I don't know
what it is in these companies, but just
this whole way of going about software
is it just it just feels 10 or 20 years
old. And if you're going to create a new
uh you're going to create a new chip,
like why would you write art? Why would
you why would you do
this? What would I
do? Um I mean
like we'll get there. Let's Let's first
make it so we can
hear. I'm just going to push to master
on tiny grad so I don't want to I don't
want to break
anything. I need that to do. That should
be automatic.
They really like this is this is
propaganda to push you to use virtual
MS if we're off in my pie and pilot. Oh,
I don't have pilot. have to install
Pilent. This is actually important. We
need to see what not to do. I mean,
there's a lot of things not to do.
Um, AMD strategy of copying video is
actually pretty good.
Wow, my pie is
slow. It's only slow for the first run,
then it catches everything.
Yeah, I don't know about
that. Wait,
what? Oh, because it didn't
because Onyx didn't build. We're going
to just remove Onyx from being
needed. Don't else use
some fancy parallel testing crap?
Oh, it's in testing
minimal. Oh, that's what I should
do.
What? Oh, this crap.
Use
pep. Where's my use
pep? Is that the pep I got to
use? Great.
That's not even really the right place
to put that. Really the right place to
put that is just a default to AMDL VM
equals 1. I guess if co manager I don't
[Laughter]
know. Yeah. Dash in. Gota love
that. There's going to be like like can
we just have like a 30 second countdown
to the point there's going to be silence
in this room?
How do you even like do this? Like
you're shipping
[Music]
hardware the fan. It's just a fan policy
question. It's not even a different fan.
It's not even a change. It's just
like like, you know, a lot of people
bought these cards to put them in their
computer, run it up to
82. No, but it might break the chip.
Yeah. Well, you know what else might
break the chip? using
it. That needs to be fixed,
too. Oh, that's because I hard specify
the GPU. I say that the tests have to
run something with the GPU.
Is there a market for consumer TPUs?
Well,
Okay. Okay. Okay. Okay. Pilot should
pass. Great.
Yeah, we'll definitely use that end.
Okay.
Um, everyone take a deep breath out.
Uh okay. So,
uh my end
advice, here's the problem. Like, and
this is this is why this this doesn't
work. You know, this is really really
and this was my pitch originally.
uh tends to should contract
tiny. If you want to run models like it
should be pip install and it should
work. Imagine you just pip install tiny
and then you can run llama on a on a 10
store card. Maybe you have to install
the kernel driver but that was not the
pain. This whole user space was a huge
mess.
Like these people need to stop focusing
on high-end capabilities of their
software. The AMD has this problem too.
These people are focused on how fast
they can do a matt, but then their
tensor only supports rank
four. Like if nobody uses your shit,
nobody cares how fast it does a
mat. Um, and that's the main lesson that
needs to like be communicated here.
You can't use that as a neural network
accelerator card. You're you're you're
better off buying a 10-year-old Nvidia
GPU. You're better off buying anything
that supports Open CL. You're better off
buying literally
anything. It doesn't matter if it can do
mats at 200 teraflops if the only way to
get that to build is on a single version
of Yubuntu with folders being put in the
exact right position. Like nobody cares.
Nobody's going to do
that. Um, and you're like, "Oh, well,
okay, but you know what about the big
hyperscalers? They're good at dealing
with complexity." Of course they are.
But they have a you know, they have they
have they have people think that like
big companies and I don't know I don't
know if Tenstor thinks like this, but a
lot of people think, oh, big companies
have a lot of resources and like no,
they don't. Everybody's operating right
at the frontier of their resources.
So when you look and you see that
um you know no
no company is going to use this and then
there's also this complete myth that you
can have things you can have interfaces
that aren't self-s serve. You're like oh
well you know and like Grock and service
think like this. they think like a
service is a bit better but Grock thinks
oh well you know we'll just work with
companies uh and then companies will
onboard their models onto Grock like in
the long run you're just going to lose
with this you're going to lose to
somebody who's self-s serve
um so I mean the real thing that needs
to like like I don't know I don't know
what Tensor torrent's pressures are but
they need to realize how terrible this
software is and like It's worse than
AMD. You remember my first stream with
AMD? I was frustrated that I couldn't
get my two cards to work. And AMD said,
"Hey, look, uh, we haven't really worked
on making two cards work yet." Now, I
think that's ridiculous. But at least,
no, this is so much worse than AMD.
AMD's also come a long way in the last
two years. Right now, if if you go to if
you go to pietorrch.org
and you have an AMD
card and you click Linux Rockm and you
just install
this, your AMD card will work pretty
well. I mean, it has edge cases, it has
annoyances. You're not just going to be
able to entirely drop it in, but there's
nothing as ridiculous as it only
supports rank four tensors, requires a
specific version of Clang, and needs
folders to be in the right place, right?
So, this software is so much worse than
AMD. Um, now to be
fair,
like only for very recent AMD cards.
Yeah, look, like when I saw like 10
store, it drops Grey Skull. That's fine.
It's It's not the most You can use RDNA
2 maybe, but I'm even fine with like AMD
only supporting RDNA 3 and RDNA 4. Go go
go go go go buy a 9070 XT, install that
Rock Am, and you'll have an okay time.
It's probably not worth it compared to
Nvidia still. Or actually buy a Tiny Box
Red. Um, you run this on a Tiny Box Red
and it it works well.
Uh so
yeah, not only that, you you not only
have to accept
that your software is bad, you have to
accept that hacking on it isn't going to
make it better.
So AMD was in an interesting position
and I didn't really realize this, but
their strategy is better than I
initially gave it credit for. AMD's
strategy is just to copy Nvidia
perfectly. Now, have you heard of
Nickel? Do you guys know about
Nickel? Okay, so Nickel is the Nvidia
collective communications library,
right? Have you heard of
Rickle? Not that Rickle. Oh, the Rockm
Communications Collective Library. Oh,
interesting. Have you heard of
Kublas? It's the It's the uh CUDA linear
algebra uh library, right? Klass. Oh, a
GPU accelerated library. Well, how about
Rock Blast? Oh, Rock Blast. Oh,
great. So, um you know, uh they they
have they have they have their own
version of Cutless. they, you know, they
they just went through all of the
uh the the Nvidia shit and just
literally copied it, which is actually a
very good second place strategy. Um, and
that strategy also involves a
self-awareness that you're in second
place. Uh, Intel does not take a
strategy like this. So, Intel has one
API. I just I just like I just I just
want you to like like is it a meme?
develop and scale your code with
confidence. The last thing I would ever
have confidence in is an Intel
ecosystem. Like that's got to be a joke,
right? Like like there is zero
self-awareness at this
company. Eh, a lot better.
Um, AMD. I I I'll point to another AMD
page um that that I'm actually uh
uh well, don't worry, there's still a
ton of HSA crap buried deep inside AMD.
And I I I still have a set of critiques
of AMD. I still have a set of critiques
of AMD. Are they doing everything
perfectly? No. But like here, so here's
your RockM install.
Um, it's pretty straightforward because
again, what did they do? They copied
Nvidia.
Um, hopefully they're doing their builds
in CI and they have more CI testing. I
think that's getting better. I think
Anush talked about this like like they
they kind of know what they have to do.
They also I really liked um
uh AMD 2.0 new sense of urgency. They uh
they published this
and AMD really seemed to listen which
was which was
great.
Um yeah I tweeted I tweeted about this
too. So yeah turnaround for AMD. Now, to
remember also that my biases are that I
own a quarter million dollars of AMD
stock. We can we can check on how that's
doing. Um, but you know, I didn't I
didn't buy the stock so I could shill in
my stream somehow going to make it go
up.
Uh, pretty good. We're up. We're up.
We're up uh 10%. It's pretty good. I
don't know what the whole market's up.
Maybe the whole market's up more but or
less or I don't know. But whatever. Um,
we'll let the subscribers talk for this
part.
But yeah, no,
like this strategy that Tentor is taking
is not going to work. Um, nobody is
going to move their models to
TTNN. Uh, nobody wants to rely on the
trust of the one
API. Um, nobody wants to move their
models to Rockm either. What they are
willing to do is pip install RockM and
make a two-line change from their CUDA
model so it happens to run on AMD,
right? That is literally as far as
people are going to go for AMD. Um, I
think their bounties are complete
nonsense. I think that the last thing
they want is Microsoft 54 running
carefully on their thing and paying
$2,500 for
it. Um, oh, does it make sense to keep
the 10 torrent bounty for us? Well, I'm
going to try to run it. I think that's
the requirement for our 10 torrent
bounty. I'm gonna try to run it and if
it requires me to have reflections or
whatever, then I'm out. Um, while
getting deaf by the fan. Yeah. Yeah. Fix
the fucking fan. Like
uh Oh, wait. No, you own Intel stock.
I'm so sorry.
Uh, look, I
[Music]
mean, would I recommend it if you just
want your stuff to work? No, I wouldn't.
I would just buy Nvidia. It's not that
much more money. Pay the Nvidia tax. Um,
but if you want a better deal and like
you're willing to put a bit of time into
it, you're interested
in buy a tiny bug shred. Um, we also
have a complete driver for it. Now, I
think that's a big thing that changed
this year for AMD. So, like last year
when there were problems with AMD's
driver, all I could do was be angry and
frustrated. This year when there's
problems with AMD's driver, we have our
own complete re-implementation of AMD's
driver. So, two things really, you know,
obviously giving me the machines also
turned me around a lot at AMD. But I I
think the other thing that really turned
me around is I'm just like I'm not
beholden to their driver anymore. It's
it's a full we have a full like stack.
Uh we have decibb right there. It's
under 50 dB.
Um, it's quieter than one 10 to card at
full power. By the way, you guys, I
haven't turned off the tiny box. The
tiny box is still on. You just can't
hear
anything. Um, you're interested in
seeing tiny support tentor torrent?
Yeah, I I mean, I'll leave the bounty
up. I I'd be happy to pay $1,000 for it,
but I think it's just
really
like
Yeah, the ear muff special
edition
like I don't know. I
mean, yeah. I I I don't know. I don't
know what you do. I don't know what you
do. You You have
to There's so few people who can do
software. Well, though.
I don't know. Yeah, but I mean 10 store
like again I would contract tiny. We
could build actual pip install tiny grad
tier
software and the shit just works on your
card. They're not I mean they're not
really interested. They're interested in
building these like it's got to be
enterprisegrade, right? Like this is
this is the the the the bad thinking of
these these hardware companies and like
they get so much of it right too. like
Tenstor gets so much more of it right
than like Grock. So Grock realizes that
their chip is not their chip makes no
sense, right? Their chip is not on the
proto frontier for anything. Um so what
Grock does with this is they never show
you the chip. They show you an API that
runs LLMs really fast. It's actually
pretty clever. So they managed to put
this together and they have an API. Um,
but I pretty sure they lose money on it.
And like everybody could offer LLMs but
fast. The problem is people aren't
really willing to pay the premium
required. Um, is it really bad thinking
if that's where the if that's where the
money is, but like it's not. You're not
going to make an enterprise sales deal.
The enterprise today is these cloud
companies.
Uh, and these cloud companies. Oh, I
heard from I heard from a guy at Intel
like we got some Growy cards on AWS and
Amazon said they never want Gouty cards
again. And of course they never want
they never want Gouty cards again,
right? You you want to see you want to
see a huge ripoff?
Are they Oh, are they gone? Wait, are
they Are they not on eBay
anymore? Oh, for just
$70,000, you can own
this. Like, they're off by an order of
magnitude for how much this shit's
worth. No, don't create an install.sh.
No, get rid of
dependencies. Like, get out of a mono
repo. figure out what's actually usable
here. Can you hook it up to your home
lab for local llama? Do you want to try
to get the closed source synapse
compiler to
work? No. I mean, it tends to goutudy
gaudy's architecture is is a
whole it'sanium 2.0
really. Uh yes, if you can implement any
if you can implement IGEN value SVD in
tiny like not using new ops. Yeah, we're
happy to add it.
Absolutely. Um and then it's one line to
add to the torch back
end. No, no, an install.sh is not a
solution. Like it's just look, let's see
if this website's still up. I used to do
this, right?
Um, oh, wow. It's actually installed.
SH,
right? So, this is this is Kira. Uh,
this is just it's the hallmark of a
junior software
engineer, like to not properly be able
to package your things. I wrote this
when I was
24. Um, and install.sh is so terrible.
All
right. Oh, it actually does use I did
actually eventually use a virtual
M. I do have a dash E. Okay. Like this
could be written
worse, but like what are the odds this
works? What are the odds that lib Pixman
onedev exists on modern Ubuntu?
Um, no. They need
a Here's what you do. Here's what you do
if you're tense. Here's something that's
a little more plausible. They hired
Corsix like put him in charge of a skunk
works software and documentation team.
the the the that documentation thing
from Tenstor is the best thing I've seen
from
them. Um I mean they could have like a
better homepage here. It doesn't show
you how much like depth there
is, but
uh yeah, this is this is the best thing
I've
seen. Oh my god.
What?
Wow.
Wow. Oh. Oh, never mind. There's no
savings
company. There's no saving this company.
The amount of complexity in
here. This is insane.
So check out check out
HVX. I think this is one of the best
uh like if you're going to build
something DSP like this architecture is
phenomenal.
um
RDNA4 like it is what it is. I think
there's very few
like there's some weirdness about it in
a few areas, but otherwise it's a pretty
beautiful clean
architecture.
Um yeah. No, I don't know. I mean what I
see here is the amount of
complexity that is put in here before
there's product market
fit needs to be
fixed. Like there's so much stuff and no
product market fit.
So you start to once you have product
market fit, sure you're going to
increase complexity in areas where you
found product market fit. Like comma
manages a ton of complexity for the
different cars, right? But we manage
that complexity and we get something for
that complexity. If we go and support
the Rivian, tons of people with Rivian
go out and buy commas and we make money
to offset that
complexity. When you think about like
EM
E5M7. Has that made them any
money? Like that's a feature that's in
the chip that somebody need to think
about that somebody hopefully
tested and does it make them
money? Oh, but it was easy to support.
Yeah, it doesn't matter.
Oh god.
Do you know what this looks
like? You ever read like the manual for
like the Super Nintendo?
Someone just needs to take the Qualcomm
hexagon processor and tile a shit ton of
these on the chip. Now that's an
idea. Um, you know, it's crazy. It's
crazy like like Qualcomm is such clowns
as companies, but then you like you look
at some of the stuff they've done and
you're like this is actually super nice.
Their GPU is pretty nice too. Like
people don't think about this, but like
Qualcomm has like a full feature GPU and
you know it has a compiler and like it
never crashes. The driver is solid. The
driver is pretty simple. Like it's just
good. Driver's open source too. You can
go look at the adreno driver in the in
the in the in the kernel and like it's
why is it so much better than the other
GPU company's drivers? But that's a
mobile GPU. Yeah. Why does that
matter? Um, no. But often you get a
client that pays for a custom
implementation, you make it available to
everyone. I agree with that. But no
client paid for E5M7.
gonna get another JS like
lang. I mean, I don't know. Like, I hope
it's Tiny Grad. Uh, you see what our
competition is. I mean, our competition
is stuff like Onyx
Runtime. Uh, I mean, it's basically just
like there's three companies that make
make competition to Tiny. And it's
Google, Facebook, and Microsoft, right?
Microsoft makes Onyx runtime, Facebook
makes PyTorch, and Google makes Jackson
TensorFlow. You can complain about Onyx
runtime, but a lot of people use
it. What are you using instead of Onyx
runtime? No, you don't understand how
bad the deployment at Twitter was a a
10-year-old version of TF serving. I
downloaded their model and ran it with
Onyx runtime. It ran 4x faster.
No, the complexity in here is
insane.
Yeah, it's sad.
So you pivot tens torren ends up really
becoming like a CPU licensing
company. Maybe they pivot to just making
CPUs. I I would totally believe that
they have the most performant big risk
5. How do I use the big risk
fives? I don't know. Have we we we
[Music]
we current
valuation? Uh I'm pretty sure the Nick
is
licensed 4B. It's not that
unreasonable. It's a I don't
know. Yeah. No, that's not
that. Is that
unreasonable? 2B. That's
better. 2.6
billion. Yesesh. Gave away a lot of the
company.
Uh, you know, I actually don't think
that's a bad valuation.
for a company that's actually capable of
shipping that
card. You feel like it's unreasonable.
You feel like 2.6 billion is
unreasonable. I don't know. I mean,
there's like
Like what? How does this company is that
real? How does this company have any
value? Who the hell is buying it?
Like you're telling me that a company
with like a fake self-driving truck is
somehow worth 4x10 torrent. I don't buy
that for a
minute. Yeah, I
agree. Oh no, this one I mean did too
simple actually went under,
right? Oh, they rebranded to create AI,
right? Like this was another total scam
one based out of San
Diego. Oh
[Laughter]
no. Uh that's still too
high. I know. I should have god. I
mean, yeah, for every for every dog shit
blockchain that's worth that, like 10
store managed to ship me a box with a
card in it. They did not sell 2 million
of those
cards. Um, I would guess that they
sold maybe they sell about the same
numbers. We sell
commas. Maybe it's similar.
I sell about 10,000 commas a
year.
[Music]
Um, I don't think K's worth 2.6 billion.
No. Uh, K's last raise was at 500
million. I think we're worth more
now.
Um, I don't know. I I'd give Kama a
billion. I give comma 1B. That's that's
what I I'd give comma if you were asking
for my
evaluation. Uh I mean it's a pretty high
revenue multiple
but you just got to think about
like I would say that we are
worth 5% of Tesla FSD. Whatever you
think Tesla FSD is worth, we're we're
the AMD of Tesla FSD, right? If Tesla
FSD is Nvidia, we're
AMD. So whatever whatever the ratio is
between AMD and Nvidia, that's the same
ratio between KA and Tesla FSD. Um I
mean I don't know you could also like
how many users Tesla FSD have, right? So
comma's got like almost at 6,000 daily
activives. So what's the daily act for
FSD? I think that's a good just straight
up multiple.
Um, I mean, yeah, you could probably
make that same argument with 10 torrent.
Let's say they sold 10,000 of these
cards. Uh, they also sell for more.
That's
true. Tesla FSD has upsell. I don't know
what that means.
Um, half of that 10 money is for gym. I
don't know what that uh
Oh, the Oh, the ttor has some scam
deals. Oh, no.
No,
[Music]
no,
no. They
don't. They don't have $150 million in
in deals closed. If that was actually if
that was actually true and those were
profitable deals, the valuation would be
a lot
higher. 69 watts cuz Samsung made
it. I feel bad for every person who
bought a Snapdragon 8 Gen 1. The Samsung
made one. Oh, that one was tragic. 8 Gen
2 is so good.
TSMC. Um, always divide by four. What a
founder tells you. I don't know. I think
I'm being honest about KMA's valuation.
I mean, I'd say if we were raising
today, that's what I'd raise at. I don't
know if common shares are worth that.
People have sold common shares of KA
between they sell between like 300 and
million.
Um, I do realize I I I I'm super happy
that Jim Keller is saying stuff like
this. They realize the only way to win
is to get developers on board by giving
them all the tools they need to own
their technology.
Uh, do you think AMD will shrink the gap
with Nvidia? I do. I'm betting on
it. Uh, I think they have
to. Thoughts on working for 10 torrent?
I
mean, I'm happy to do a
contract like a salaried job. I I don't
know if I want a salaried job.
Um, no. I mean, if Tenstorm wanted to
contract
Tiny, I would build I would rebuild all
of their stuff probably in a thousand
lines of
Python. Uh, and we would get at least
LLMs running at pretty much full speed.
Um, no I don't. I I mean I think they're
making a whole bunch of mistakes. I
think that there's way more complexity
in the product than there is product
market
fit.
Uh I think they're just building like
they're building way ahead of what their
software can do.
hardware direction is better than GPU?
Why do you think that? I'm not sure I
agree. Yeah, I agree. Yeah, I mean, why
have a cache? No, I I agree with that.
Um, like, so like what do GPUs have that
you want to remove, right? You want to
basically remove the cache and you want
to remove warp scheduling, right? You
don't need caches. You don't need warp.
You don't need warp scheduling because
everything can be statically scheduled.
And again, you don't need caches because
everything can be statically moved.
Okay, great. Um, but a modern Nvidia GPU
can do all of these things, too. Like
there is more complexity than you need
on a GPU, but this complexity is pretty
well managed. The latest Nvidia GPUs
support longunning kernels that are
pinned to a core. Um, you can totally
use the cache like an SRAM scratchpad,
right? there's not that much of a
difference between I guess okay you're
talking about an L2. Yeah, maybe you
don't need an L2. Um I mean Qualcomm
Qualcomm does this correctly uh with
this thing called the TCM. Uh and like
the TCM can be used alternatively as a
cache or explicitly addressed memory.
Uh yeah, but like you can take the cache
out and just make the SRAM indexable a
lot easier than like like there's tiny
tweaks to a GPU. I'm also not even sure
how much power that's going to get you
back. My only complaint I think there's
two things wrong. Well, I think there's
really only one thing wrong with Nvidia
and that's the price. There's nothing
like Nvidia's architecturally doing I
think also their software tentor torrent
is thinking about large scale out in a
way Nvidia is not like Nvidia links
their 172 unit rack with this super high
bandwidth stuff but like this isn't a
real solution for scale out right Google
is Google is thinking through scale out
in a very good way too
um memory is a huge amount of power
consumption I agree but it's not saying
that like if you don't if you have an
explicitly managed cache you'll do that
much better Um, you got to pay extra so
Jensen can buy more. You saw how bad the
chip was in the Switch, too. It's cuz
they didn't give in Nintendo a good deal
on the new one. Um, you just know it.
Like, uh, Nvidia has great in-house now.
I mean, it kind of sucks that they
bought uh bought Melanox. Uh, great.
Great. More consolidation. Uh, but
you're saying they have IP for that. I
believe
it Nvidia is
distracted. I don't
know. I mean, like for the 5090, it's
it's crazy how good the card is and how
understated it
is. Yeah. Yeah. They try to expand a lot
of things. I mean, they have to justify
their insane valuation, right? They have
to push to application to justify
that. Yeah. I I haven't I mean I haven't
seen like quality start slipping from
their stuff
yet. Um they have a very clear road
map. Could I elaborate more on how I'd
rework tens torrent software? I mean
yeah I
would like rewrite it in Python. Let's
start there.
Oh yeah. No, they're totally focused on
data center. Yeah, I mean that makes
sense. Uh yeah, I would rewrite tens
towards driver in Python. No, wouldn't
it be slow? No, it wouldn't be slow. It
would probably be faster than their C++,
right? Uh the GPUs always have issues
when they first come out and everybody
always says
this. They're fine. They switched also
to a new memory generation. So I don't
know how much that's dealing with stuff.
They're the first cards shifty
DDR7. No, I'm telling you, I have a
whole Tiny has an entire AMD driver in
Python. I'll show you. So here I am on a
Mac. Well, actually that one's going to
be slow, but not because of the driver.
We'll go to somewhere that's not a Mac.
All
right. All
right. So, this
is a tiny box. We're going to RM mod the
AMD GPU driver. Oh, it's in use. Someone
using
this? What's using it?
I don't know what's using it. Whatever.
Let's go to a different tiny
box. Okay, this one does not have an AMD
GPU driver installed.
So, this is now downloading all of the
uh register offsets for the AMD GPU.
Boom. We're booted. We're
in. Let's go. This is just taking time
because it's compiling the kernel. It
has nothing to do with Python.
All this time right now is being spent
in LLVM written in
C++. Boom. And now we're in the jet. And
now everything's fast.
Okay. Uh there's a flag to
reset. What it
does am reset. Okay. So, we're going to
boot the entire GPU. We're going to
reset it from
nothing. It didn't
work. Really? How do you
reset? The docks are
wrong. Whatever. It'll be reset now
because I control Ced it. No, I can't.
No. What's it doing?
Okay, if I aggressively control C
it. Okay, never mind. I can't even get
it to do that. Uh, get M AM
reset. AM reset equals
1. There we go. That's a full boot of
the GPU.
and time
it. I don't know. I must have time it.
Uh, so let's let's get to one kernel
booting. Okay, that booted the entire
GPU in 2.4 seconds. It's actually faster
than the kernel driver. And then once
the things are loaded, it doesn't matter
at all.
I mean, it's not that it's faster. It's
just that you can actually like
understand it and see what's going on.
And this will run anywhere.
Um, so yeah, I would move to a Python
driver. Uh, and then
like also get rid of the layers of
abstraction. They're they're trying to
like sell you
a I have no idea how that matwall
worked. I might be able to go in and
look at it but there's not a language
like the thing about Kublas is you know
Kublas is just written in CUDA
uh there's no such like language like
that for Tenstor they like tried to make
one but then it's all these like special
purpose kernels coded with all these
sort of things and if that's what you
have to do your architecture is just not
going to be competitive right the fact
there's nothing in an Nvidia GPU that
specifies a
relu. Um, so get rid of all that stuff
and write basically a Python driver that
says, "Hey, run this program on these
cores." It's kind of like that that test
one they have, but uh I mean the test
one they have is is both linking to a
huge set of stuff and kind of too lowle,
right? Like you want to build an API
that kind of looks like what's in a GPU.
Um, and then you want very clean code
that specifies because I don't know how
this whole programming model works. The
documentation doesn't seem like like I
can't even get the things to build to to
use it. There's there's there's
abstraction layers mixed in all the
wrong
places. There's there's code about relu
next to code that resets the processor.
You can't do this.
Um, like Tiny does a good
job of abstracting
out. So
like Tennyra has a bunch of directories
here, right? And like the abstractions
are super nice. This is tensor.py. It
has all your tensor ops in it. Okay,
you're not going to find any code about
a com 2D anywhere besides
tensor.py. All right, then underneath
tensor.py, you'll get to
ops.py. These are the ops. Nothing about
comms, nothing about
gems. Um, they look like a bunch of
shape manipulation things and they look
like a bunch of very low-level
operations, right? Uh, and then we have
a scheduler and engine. We have a code
generator in codegen. The front end
supports onyx and torch on top of tiny.
We have a neural network library in nn.
You're not going to find anything about
optimizers anywhere besides
optim.py. Renderer, which is what
outputs the code for the thing. Runtime,
which actually runs a thing on the
device. These are the backends that are
runtime supported. And then some code
for manipulating shapes. And then a
visualizer to visualize all of
this. Abstraction gives me job security.
Oh god, did this why all the code is dog
shit? You're a bad person if you do
this. No, the system's
bad. Yeah. Yeah. Yeah.
Um, yeah, like I was hoping that today
we were going to get to like being able
to think about how to map the tens
torrent stuff to tiny as a library, but
their code is nowhere near that
point, right? And you can be like,
"George, you didn't understand it." You
know, you just if you're just
like, who out there do you think you're
going to get that's better than
me? If Tentor thinks hypothetically
they're going to get developers who
understand
this, I
mean, okay, so here's what you might
get.
You might get somebody whose job it is
at a big corporation to make tense
torrent work. And the difference between
them and me is they're going to be
willing to put six months into it,
right? If that's their full-on job. But
if you give me a day to understand how I
spent I spent four hours understanding
how gaudy worked and I understood the
whole thing and I was ready to program
it in
Tiny. I think it there's architectural
problems with it, but it's very
simple. The TPU, the programming model
for the TPU is so simple. Now, it's
really really hard to generate the code.
The compiler for the TPU is really hard,
but at least like how the TPU actually
runs things, what the TPU's instruction
set is, like I reverse engineered it. I
mean, sure, there's a lot of like
subtlety and detail, I don't know, but
like the the basic model of it is
simple.
What is the basic model of a
tenstor?
What? And then you're going to tell me
that there's
actually hundreds of these on the chip
and they're all connected through a
knock which can send things at this
many. Like this programming model is
insane.
And it's
all like like you can have an insane
programming model, but you can't have an
insane programming model and bad
abstraction layers. You can't have relu
next to CPU
reset. No, you should obviously have
abstraction. Abstraction is good, but
good abstraction is good. Bad
abstraction is
terrible. Leaky abstraction is bad.
Right. That's mostly what I'm
complaining about here. Like
abstractions that leak or just
[Music]
nonsense. Um, which hardware has the
best code? Is it
Nvidia? Uh, Nvidia hides a lot of stuff
from you. So, it's like hard to say how
good Nvidia's stuff is. What would I
say? Like who who does hardware
particularly well?
Um, where have I seen like like people
who've just like nailed the
abstractions? I'm telling you, like
Qualcoms are mostly pretty good.
Occasionally they'll have one bit of
like Qualcomm nonsense where like the
licensing division touched things like
the fact that the DSP runs an operating
system and you have to sign things for
it. like god. Yeah, that was touched by
the that was touched by the that was
touched by the the Qualcomm scam people
out of money division. Uh but no,
overall like whenever you actually look
at a piece of Qualcomm's hardware, it's
like pretty well
done. Um like I can look at like look at
like their
encoder. Um their their encoder like API
is like really good.
Uh I mean it
shows it it it shows by the fact that
they can build this phone. I mean like I
use a phone with a Qualcomm
chip. Apple has a lot of weird
nonsense. Uh but then there's like some
things that do really I don't know.
Um, what are the
like AMD got shafted by the HDMI
lawyers? No, I don't know that story.
Uh, is this worthy of a blog post?
No. No. I don't know.
Like, I don't even know how this gets
fixed. Like, Intel, Here's how Intel
gets fixed. Intel gets somebody who
actually has like some leadership
ability and gets put in charge of Intel
and then slowly delivers on a decent
like if they continue by the time
they're on their dGPU maybe I'll trust
them, right? They made their A's, they
made their B's. By the time they're on
their DGPU, if they just slowly improve
it a little bit, I'm sure the E will be
great,
right? Um but no, I think that Intel,
yeah, they they lack uh leadership. Uh,
but like that's fixable, right? Like a
blog post could fix that. A blog post to
the right Intel board member could fix
that with Tens
torrent. The problem isn't just their
software. The problem is the insane
complexity in their hardware.
Jim is both the problem and the
solution. Well, I trust the tense
torrent with Jim a lot more than a tense
torrent without
Jim.
Um, but you know, I mean, like again,
you know, we talked to them about
contracting. I kind of got strung along
like you do by big companies and like
all right. I mean, you know, I I guess I
don't expect them to be better, but
uh yeah, I've spoken to Jim about this
stuff. It doesn't seem that
receptive. Um how much of it is others
hiding hardware
complexity? I mean, like Qualcomm, it's
very clearly not. You can you can read
read the Qualcomm manual for this DSP.
There is nowhere to hide the
complexity. Um it's it's a beautiful
architecture. It's a shame that like it
runs some operating system and you have
to sign things for it. But uh no and
like I mean
AMD's chips a lot more complicated than
this but not like like it's less
complicated than the tens torrent
chip. It's not just that the tense
torrent hardware is complicated. It's
just all the things that the five risk
five cores are supposed to do. I'm just
not sure what this gets you.
I'm not sure what all of these fixed
function things gets you. And
I I
Ow. You can put
like Oh, data flow arch machine arch
definitely has a future. It's there's
Yeah. I mean, there also just looks like
there's way too much data movement for
this thing to ever be power
efficient.
Um, I mean, you can read, so Corsix and
I went back and forth about this stuff.
You can read the history in the Tenstor
channel. like this is this is not new
thoughts that I have. Um I guess the new
thoughts from this is I did expect the
software to be better. I expected them
to move past like hard-coded paths and
like C++ 20 features that require boost
and I mean just don't use C++. Please
don't use
C++.
Um why would you? It's the like you're
designing a from the ground architecture
and you're like the thing that we're
going to choose to use is
C++ like use use Rust.
I mean, I I think you should use Python,
but that's just
me. And yeah, sure. You're going to
write all the You're going to write all
the code that runs on these little
things in C. That's fine.
Yeah, there's just an insane amount of
complexity
here. You know, here here's what this
looks like to me,
too. Th this looks like people
who very clearly didn't do the
software and they put all of this
flexibility in the hardware. The
tenstorm chip's incredibly flexible and
it is possible that they will manage to
carve out some
niche like there'll be some niche where
the way this is done it can like really
do something that a GPU
can't.
But I mean like yo dog I heard you like
risks so we put risks inside your risk
so now you can risk while you
risk like and that's not a
compliment.
These are nice docks though.
I think it's almost dinner
time. You know what I think I'm going to
do tonight? I think I'm going to smoke a
joint and go get a cowzone. What do you
think of
that? Smoke a joint, eat a cowzone.
That's a good
evening. Oh yeah.
Nah, like the cowzone place. It's like a
40m minute walk. So, you know, there's
there's plenty of time for smoking a
joint on the way to the cow zone. Uh,
yeah. I'm back in the US. You think I do
that shit in Hong Kong? No, it's illegal
there. Good cowzones in Hong Kong. Not
really. There's like some okay
pizza.
Um, yeah. Yo. Yeah. Looking forward to
watching the va. I don't know. It's just
kind of like me being sad about tens
torrent. Yeah, cowzones are illegal.
Yeah, definitely what I meant.
Um, okay. If there's one thing anybody
from 10 torrent needs to take away from
this stream, what is it, guys? What do
they need to fix?
Fix the
fan. Figure out how to make your chip
use 20 watts. Turn everything off and
then turn the fan way down and let it
run at
80. Fix the fan. All right. All right,
guys. Uh yeah. Yeah, the fan. All right.
All right. Thank you for watching
today's stream. you know, we we just we
just hope everything in the world gets
better. Um, it's it's it's very nice to
see to see uh
documentation coming together. I'm
curious what the differences are between
wormhole and uh black hole are.
Happy Saturday everybody.
Good
morning. Got to go over
there. Subscribe only chat. No, it's
not. Let's turn the air conditioner on a
little bit. And I want to tell you about
a great quality of life improvement I
made.
Okay? You see this? You see this
cable? This used to be the cable
connecting the 10 to computer. But the
10 to computer was
loud. So we banished it to another
galaxy.
Now, by the power of
SSH, we can still access it, but it's
not in this room being loud. And
hopefully with with the loud computer
gone, we can hear ourselves think.
I think also, you know, there's a bit of
a
misunderstanding.
Um, George, George, the documents say
you're supposed to use Yubuntu
2204. I would recommend sticking with
what the documents say. Okay. And
uh, IQ curve mid. You you guys know this
meme, right? You guys You guys You guys
You guys know this this meme, right?
Everyone knows this
meme, right? Know your me. Everyone
knows. Um Yeah.
So it's it's it's a
misunderstanding of what we
do on this stream.
Um, some people believe that the goals
of these dreams is to accomplish
something and then I ask yourself, have
you ever hung out with your
friends? Maybe maybe you like smoked
weed and watched Mel Gibson's The
Passion of the Christ. You know, that's
a good time right now. Tell me, what
were you trying to
accomplish?
Exactly. Exactly. That's the mentality
that we have to have on these streams
because if you're trying to accomplish
goals, it's just like I might as well
like work in a high frequency trading
firm, right? No, no, no. But you don't
understand. We do price discovery. We
make markets more efficient. No, you
don't. No, you don't. You play a zero
sum game, waste the intelligence of a
society, and uh siphon money away from
the middle class. But, you know, you
don't want to you don't want to stare
into the abyss and tell yourself that.
So, you really you really like like it
takes a certain amount of staring into
the dark abyss to understand that just
because life is meaningless and there's
no, oh, but we could do this. Oh, why
don't you use Yubuntu 22? No. No. Like
we're all just
here to have a good time and then we're
gonna die. Even Brian Johnson, even Ray
Kerszswall. Yep. Yep. Because you know,
you can escape death forever, but then
the heat death of the universe is going
to get you, you know. So, everybody
realize, everybody take a minute this
morning to realize that you're going to
die. Okay?
You are going to die. I'm going to die.
We're all going to die. Everything
you've known and loved is going to fade
away and it's all going to be
meaningless. So why the fuck do you work
at a high frequency training firm?
That's that's just But no, no, no. I
need I need I need a $400,000 salary so
I could so I could keep my wife around.
Well, you you picked a bad wife, bro.
That's That's You should You shouldn't
have picked a wife like that, you know?
You gota You gota You gota You know how
to like You got to put women through
shit tests, man. Like like like you
know, take them to Arby's. And if
they're not cool with Arby's, you
shouldn't marry them. Okay, that's just
good life advice. Okay. I mean, did your
father tell you that? No. You were
raised by a single mother. I'm sorry.
I'm sorry. I have to check my privilege.
Everybody Everybody knows that. That
that No, Ar is fucking disgusting, man.
Okay. All right. All right. But if your
girl won't go with you to Arby's, you
shouldn't marry her and stop doing high
frequency trading. You're wasting your
life and you're going to
die. Chipotle is actually pretty good.
All right.
See, but but this is all this is whole.
Oh, and all society wants you to have
this
goaloriented
behavior. Oh, goal. Oh my god. Machines
of ever loving grace. Like
like there's something so spiritually
wrong in Silicon
Valley. We're going to build this
machine and it's going to take your job
away. Oh my
god. You know, no, I one of my favorites
one of my favorites
uh there's a there's a zero HP Lovecraft
post taking down like leftist trajection
of IQ and we could like go into it, but
it's just it's just like like everyone
knows that you could have a dumb guy and
he's a great friend and he's a good guy
and you like having him around, right?
Right. It's not it's not like like it is
only it is only or I don't know. I I got
I got into it with this with this woman
like like like like she genuinely
believed that like people with more
money were better people and that's like
at the absolute core of it. Like she she
actually believed that and I don't know
you you've let the capitalism into your
heart. I mean it's probably true but
like do you know what I mean? It's not
like like like
like it's a good-hearted metric, right?
Someone who does high frequency trading
to make money is a bad
person, right? Like like like there
there's a there's a there's an amount of
oh well I made money by providing goods
and services to other people. I created
value uh for a lot of other people and I
took a small percentage of that value.
Okay, great. That you're actually a good
person then, right? you're creating
value for other people versus well you
see every time Peter pays Paul I took 3%
and then I traded an option on a
derivative of that 3% and took 0.1% for
myself. It's like super it's the plot of
Superman 4, you know, with the stealing
pennies. I never actually saw Superman
4, but I saw Office Space where they
referenced it. So, you know, just
everybody really think about what you're
doing with your life because you're
going to die. Okay. All
right. Um, dude, ketamine is like dirt
cheap. like go to like Vietnam and go to
like a veterary clinic and why why are
the weird white guys coming in here and
buying ketamine? Uh, fuck that printer.
That's right. All right.
[Laughter]
Um, yeah. But but but in order for
things to have meaning, you have to
first realize everything's meaningless
because otherwise you're going to
worship false idols. And that's
literally one of the commandments that
that God told you not to do.
Um, George, when will you create a money
printer? I'm tired of working. You know
what? You're going to you're going to
you're going to you're going to
Oh, h we used to pray for times like
this. You know, uh what's that from?
Um you're going to pray for times when
you had any sort of meaningful work,
right? Like you're tired of working. Oh,
you have no
idea. Just just Yeah. No, no, we're just
drinking. We're We're down at the the
bottom of the barrel. This is literally
the bottom of the
barrel. Okay.
Um, back to uh, okay, so we didn't
actually get a kernel built yesterday.
There there there's a lot more that we
can get done with tens torrent. I put my
uh, critiques a little bit more
together. For example, there's this API
called create
device.
So, we we didn't totally like uh
I read through the No, they're never
going to find
us. So here, this is like an
understanding of the 10 torrent uh
stack. So TTL TT Metalium is supposed to
be their CUDA uh equivalent.
The problem is that it has a C++ 23 API
that's very
unstable. Uh so to summarize all of my
advice to Tense Torrent, stop focusing
on this stuff and focus just on this
stuff. If
your card is going to find success, it's
going to find success in a new domain.
You are not going to win by building
mid-tier LLM stuff. And this stuff is is
mid-tier LLM stuff. Every every neural
network accelerator company like puts
this on here and thinks that it builds
faith, but it really doesn't because
none of these things are going to work
well and nobody's going to switch off
Nvidia for you. Um, but what you can do
is you can build a really
solid do what Nvidia did with CUDA. Um,
I remember CUDA. I remember first
reading the CUDA docs in college. I'm
I'm 2008. I'm at RIT and I'm reading
this thing and I'm like
whoa. Like it was just it was just like
it was like it was
cool. And you you know you do you do the
example, you get it working on like the
one crappy little Nvidia GPU you have
and you you launch a bunch of kernels
and it's like slower because all your
overhead is just in communicating with
the GPU. But it's it's like a cool
programming
model. Um, struggling to get an LLM demo
to work is never going to
uh is not going to make you the next
thing. Um, so I tweeted about this. I I
summarized my thoughts in Tensor to I
summarized my thoughts on the Tiny
Discord.
Uh, I hope that there's some people in
the Tensor Discord that I hope are not
reflective of Tentor torrent. Uh, as as
a person, you know, people people always
uh people give me shit sometimes. you
know, there's this ego hot stuff back in
the day, you know, and like I don't
know. I I mean, I ask myself that a lot.
Like, do I have a big ego? Like, I'm not
afraid to say I'm better than people,
right? But that's just true. And I, you
know, if I can beat someone at a
head-to-head skill game, there's no
point in being fake humble. But then
there's also a question of like people
who have an ego and they go so far with
that ego as to like lie as to as to lie
in the face of nature. And you really
just got to be humble in the face of
nature, right? So it's totally fine. I
don't think having an ego means saying
that, you know, you're better than some
people, right? Because you just are.
That's just true, right? And there's
some people who are better than you.
That's just how it works, right? But
that's how I like that's how you want
the world to work, right? I want to live
in some commie shitfest where it's like
everyone's equal. Like that's that's
that's like terrible. No. Like like like
there's people you're better at and
there's people that are better than you.
And there's got to be people that better
than you cuz then what do you have to
strive to, right? And it's not like a
stack rank. It's not like one clear
hierarchy, but there's got to be people
better than you, right? But therefore,
if there's people better than you,
there's people you're better than.
That's not having an ego. Having an ego
is the kind of person who
like, you know, it's like it's like it's
like like you you internalize these
things as some thing about yourself. And
I don't know. I It's It's also It's also
confusing. Uh that is why I stream,
right? Like that likes freedom thing. I
mean, that's like kind of true. It's
kind of not true. I I don't know.
[Music]
Uh
yeah, today's defo philosophy
stream. Um but no, today is not just a
philosophy stream. We're going to try to
get TT Medylium and we're going to build
a colonel because now we can finally
think philosophically. You know, I heard
something said about like if you're
living in the hood, you know the thing
about living in the hood. You ever like
walk through the hood? Um I was walking
around Hong Kong. We walked through this
like poor neighborhood. Everyone's kind
of rich in Hong Kong. It's not like real
poor, but like it's it's just the cacony
of sound.
Oh, there's just constant sound, right?
And then you go to like rich people's
stuff and like it's always so quiet at
rich people's stuff. So hopefully we can
focus on we can finally focus on
philosophy because that card isn't
screaming in the background. No, the No,
no, no. They're not really ghettos, but
yeah, the poor parts of Hong Kong,
they're not they're not like scary poor,
but they're just, you know,
loud. All
right, we need a meditation session.
That sounds
good. Three minutes. I don't think we
can do
five. Find a comfortable position and
allow your eyes to blink
clos. We'll begin today by taking three
big cleansing
breaths. Let's take a nice big inhale
through the nose.
side
out. Inhale through the
nose. One more big
inhale. Now bring all your awareness to
the crown of your
head, allowing all the muscles of the
crown of your head to relax.
And now, like a warm liquid, allow this
relaxation to flow downwards into your
forehead, your
eyes, your
cheeks, and your
jaw
completely relaxed.
allowing all the muscles of your face
and your head to
relax. And allow this feeling of
relaxation to flow downwards into your
shoulders. Feel your shoulders melting
down, flowing downwards through your
arms all the way to your
fingertips. Feeling both arms
completely
relaxed. Feel your chest
relax, your
belly, your
hips, and allow this feeling of
relaxation to flow down through your
legs, to your
knees, down to your ankles.
all the way to the tips of your
toes. Feeling both legs
completely
relaxed from the crown of your head to
the tips of your
toes. Feeling your whole
body
completely relaxed.
[Music]
Take a big
inhale. Let it out with its
eye. Big
inhale. Now let it all go.
All right.
I like this.
Uh, I don't know if I showed you guys
this
song. This is what to read. This is how
to sleep. This is when to breathe. This
is what you're scared
of. This is who to hate as of late. This
is Orzo. These are war zones. This is
your phone. Can you feel the
heat?
So, let's
move. Oh, you guys are hearing those
noises. Those noises are
harsh. Let's see if we can get that
metallium build system moved in
here. So, I have here. Oh my god, that
noise is terrible. Wow, I can't believe
you guys were listening to
that. All right. So, what did we settle
on? There's some like boost reflect
thing.
Uh, I saw some criticism that I don't
use LLMs nearly
enough. Is 40 like a good fast LLM? I
don't actually. I don't want to go into
this debate. Never mind.
Okay, we're just going to have to settle
for bringing reflect in here.
You have to like log into
Google. Does it have an
app? I mean, the other thing about like
the LLM thing too
is it's the same, I think, impulse that
drives people to talk about like, oh,
how they like supercharge their workflow
with like Neo Vim or Cursor, whatever
new garbage they're using. Um, what I've
noticed is there has
been not only no productivity
improvements in coding with
LLMs, there are now people who
uh Jonathan Blow had an interesting
tweet about like
why software design got so much worse.
And I think it's the same reason college
got worse. It's because you expanded the
population of people doing
it. It used to be just the top 10% of
people that would go to college and then
once you expand that to 50%, you didn't
make those 50% of people better. You
made college worse. And I think the same
thing is true about software. I think
there's way too many people in the
industry. And I think overall they bring
the average quality down.
Um, I forget how this relates to my
point, but
uh, yeah, no, I do think that one thing
the LLMs have enabled is there were
people who previously didn't understand
and they knew they didn't understand.
Now they post some crap into an LLM and
then post the LLM response like they
think they're doing something.
Um, and then there's the kind of person,
you have to like watch for this kind of
person on Twitter who will say, "Well,
George just doesn't get
it." I mean, this is possible. You
always have to be open to that
possibility. Uh,
but I mean, you know, you should look
into it. You should seriously consider
it. And you should find what the truth
is.
There's too little emphasis on that. I
think there's too little emphasis on
this comes back to my point earlier
about ego. It's there is a truth
um or you know something like truth
can't be racist like in the same way
like truth can't be
egoic. Those are just there's the truth
and then there's your opinion about that
but those are completely separate
things.
Uh, and I think that that
uh maybe maybe the statement maybe the
saying like all statements are market
manipulation kind of comes to
mind. Like no, I don't live in this this
like postmodern shit world where
uh that's
true. I don't I don't agree with this.
Okay. So let's see now if we can follow
the tel
metalium
tutorials. So unfortunately these
tutorials are all broken because this
create device API no longer
exists. like the API that we had to
use was this mesh device create unit
mesh because create device was not
there.
Um, update your include
path. Probably some way to specify this.
I specify an include path.
Okay,
cool. Create which doesn't take a device
ID.
that it lags to rerender an open tab.
Yeah. Well, it's
uh it's the finest JavaScript that
JavaScript has to offer.
So, this just doesn't build anymore,
does it?
Why is that?
Okay. Cannot deduce auto type.
just complaining that's not
used. Incomplete type. Oh god. See what
what what does that even do?
Command Q is not supported on mesh
device. Use individual devices
instead.
[Music]
Okay. I mean, there's not like a secret
way to get create device back, right?
Oh, wait.
What? Okay,
cool. Create device work. Something just
changed. I don't get it.
Why is it so quiet? Because I put the
computer in the other
room. All right, cool. So, that seems to
work
now. Let's give this a type. I device
pointer. Get rid of this mesh shit.
Get rid of that.
Cool. All right. Okay. It's looking like
this demo is working
now. I don't understand
it. Host API
H cool.
Okay, that seems like a reasonable
colonel.
program. What's
core? I don't really understand what
this
does. Data movement config.processor
processor equals data movement processor
risk
50.n colon risk v0 default
Okay. Is that going to work to build the
thing? Okay. I don't actually know if
that built the
program. Interle buffer
config. Wow.
So, I don't really understand logical
core 00. I thought logical core 00
wasn't uh tens
core. We'll fix that so we can copy
paste. But I guess not.
What happened?
Listen, it's on mouse mode
now. Hate this
crap. Why isn't that listening to MRC?
Okay,
whatever. All
right. Single tile
size. Num
tiles. D RAM buffer
size 48.
All interle buffers have the size equal
to the page
size and entirely contain the first DRM
bank. All right. All right. So, does
everyone understand what DRAM and L1
are? The only thing I don't understand
is which part of the D1 these are
actually in.
Where is create random vector of Bflat
defined? What
what Okay, sure. That's an API function.
Great. My runtime args are in a stid
vector.
Okay, don't
work. Invalid narrowing from unsigned
long to unsigned
int. Well, now you're a valid narrowing.
Congratulations. All right, set
runtimes. Put the program in the command
queue and then finish the command Q. So
that's that's very similar to like Open
CL.
Um it's a very OpenCL like
API. It's a weird API, I think. I don't
understand why you set the runtime or on
the program,
but
okay. Did we change our mind? Not
really. My main complaint now is that
this API is in some crazy version of C++
and you have to link to all this stuff
to make it work. Um, if this API was
like a simple C API like CUDA,
uh, I'd have a lot more faith in it.
Okay,
cool. So, this did something.
Oh, does that have my list of
input? That's cool.
H
Let's comment out the right and see if
it still
passes. Okay, faster. That's pretty
good. Um, I think there's some way to
enable some debugging so we can see
what's actually being built.
Okay, it might actually be possible to
build a uh a Tiny
Crab runtime on top of this.
I feel like I did this stuff once
before.
We need to declare some circular buffers
to enable data transfer between the
reader, compute and writer engines.
TT metal logger
level. All
right. TT metal watcher.
Okay, that changes
something. I need config equals debug.
Oh, do I need
to rebuild with that?
Spark,
right?
Let's see if we can get that other thing
built. The excellence.
I didn't build about
this bunch of C++ garbage.
Deep in the C++
garbage number name string in name space
std. Okay.
Well, what?
Not the right file.
include standard int.
I'm thinking more about the whole ego
thing and like what it is that like
drives these people to be the way they
are. And I kind of think it's ego and I
kind of think it's
projection. Like
it's there's a lot of people who have an
identity built up and if something comes
in
and challenges that identity
uh
it it triggers these defense
mechanisms. Um yeah. No, I think I think
Yeah. I went on this date. I'm just I'm
thinking I'm thinking about like what
was wrong with this girl.
And I I I think that a lot of it
was she's the type who's like this like
leftist activist type.
And she's so deeply ingrained the story
of
capitalism that she can't conceive of it
not being
true. Like the idea that like more money
is
better. And I think there's a lot of
people who Yeah. who cling to stories
like
that.
Uh cool prints debug now.
Nice. All right.
Let's get rid of the
[Music]
watcher. Just do
debug. Oh,
what is it broken?
There's some assert that if you do a
debug build, it doesn't work.
Catch VT tell me to do
here. Edit this
file. Okay, it works.
That
works. All
right, good. This is the exact kind of
debug I was looking
for. You can see here is where it
builds the stuff for the risks. I mean,
I had this working once before for a
black
hole for Grace
So you can say like what's the perf on
10's torrent compared to a 4090. I mean
this is a dev kit. I would never
actually buy this and try to like use it
for AI stuff. You buy it because you
want to struggle with this kind of stuff
and you want to play with the new
architecture.
If you're just trying to straight up
like use it, a 4090 is way
better. I say the ego gets you
attention. It's I mean Silicon Valley is
a trash
heap. What What's come out of Silicon
Valley in the last 15
years? Nothing comes from there anymore.
The whole thing the whole thing these
people have convinced themselves that
they're important. They pass fake
dollars around and like
this I
think it's really easy to make two
companies really big and you do this by
uh you start company A and company B and
they both have contracts with each other
and they both pay each other money. Now
both of those companies can book that
money as revenue. So company A is paying
company B for services. Company B is
paying company A for services. Both
people book that as revenue. And you can
do this as much as you want. You can
make company A and B arbitrarily large
doing this. Um you can raise based on
this revenue, get more money into your
pass the buck back and forth system. Uh
so this is what a lot of B2B SAS is.
It's just this with extra steps.
the when you get down to the well what's
actually like being
produced the answer is kind of nothing
and what's happening with Silicon Valley
is so it used to be sure you make a
dollar per user and the way that you
would increase your your your your money
that comes in right the way that money
like comes into Silicon Valley it comes
in through through uh you know the
selling the attention of of people like
Google and Facebook um or you know
hardware sales like Apple,
but you eventually get to a point where
you saturate the population and Google
and Facebook got
there 15 years ago and then you can't
make more money by making a better
service because a better service might
attract more people but you're out of
people to attract. You've attracted the
whole world. You you've you've you've
flooded the total addressable market. So
the only way then to increase the amount
of money you're making is to make more
money off each person. Now you can say
that okay well one way to do this is to
to expand into more services and provide
more value for that person. But that's
generally harder than just figuring out
okay but we already have this person as
a captive audience. How do we just
extract more from
them? Um so that's like what the imports
are into Silicon Valley. And then
internally there's this whole circle
jerk
economy. And again, like I say this
and you might have some people from the
outside who can listen to this and make
some critical arguments about why this
isn't true. Okay, these are these things
that are actually coming from Silicon
Valley. But this isn't the defense
you're going to get from people who are
there. The defense you're going to get
from people there is a very egoic
defense because if they were to admit
that what I was saying was
true, their identity would fall
apart. their identity as a as a as a I I
went back and forth with with someone on
LinkedIn who the new YC person and
uh you know I'm like yeah you know you
can't really like you're not going to
the next the next Airbnb or Stripe or
Door Dash or whatever isn't going to
come from from
YC. Uh YC and the whole Silicon Valley
startup is a completely captured
ecosystem. You're playing in their
sandbox. And his reply to this is, well,
yeah, but you have to play in the
sandbox. There's too much risk
otherwise. That exactly proves my point.
You're completely aware of what this is,
but there's some there's some disconnect
where if you were to really admit that
there's also not much risk. You can go
work at a fang company and get a fang
salary. There's not there's not risk
there either, but you're not really
doing something that much different.
They've they've sold you
entrepreneurship TM in a box. But that
can't be what entrepreneurship
is. The minute you put it in a box,
you're actually just literally playing
in somebody else's sandbox. You work for
a company with extra
steps. I didn't watch the Johnny Eye
video. I just heard it was
cringe. Um I don't know. But I also
don't know what comes in and what comes
in and breaks
this. Um because these people do at the
end of the day have a lot of
power. Uh they have a lot of power
through controlling the means of
communication. If that YC partner
actually said that YC is cooked. Yeah.
Partner. Yeah. Someone in someone in YC
said, "Yeah, well, there's too much risk
to do this without the Silicon Valley
ecosystem." Well, at that point, you're
not really starting a
company. It's nine years into the
company. How many years can you ship a
dev kit? You're talking about dance,
huh? I
mean, how many years is this comma into
the company? We're we're nine years into
the company and we're shipping what's
pretty much a dev
kit. Um, the PMC has too much power.
Well, the old PMC seems to be things do
sort of seem to be shifting away from
them. Uh, but if you've seen Elon's
stuff about the
Doge, you know, it's it's it's not going
to
work. Um, because you can't just go in
there and be like, "Oh, we're going to
cut spending." You have to change
incentives. You have to If you don't
change the incentives of this system,
you're going to keep getting the same
outcome.
the fact that cursor isn't a YC company.
No, I mean even I look I was in 2016 and
I wouldn't have gone to V gone to YC.
It's it's
uh but also I don't know why you hold up
cursor as some shining example of
something.
All right. W some gifted subs while I
was gone. We made this. We made this
with the Lar Zoko. Took a
while. Sorry. I should have told
you.
Um, no. I mean, Tensor's a real company,
right? Do you think Do you think I'd be
spending time on this if I didn't think
Tensor was a real company? Cursor is
not.
Um,
but
yeah, there's there's kind of like this
fake
economy that all of these things
participate in.
[Music]
Um, no. Like again, the
reason we're here, the reason I'm
spending any time on this is because
Tentor's a real company and I want them
to
succeed. This is what a company should
be
doing. A company should be shipping
basically a devkit.
surely rationally one should learn to
play the game with these people. Don't
make me sing the pink
line.
Um, how's it working for
Elon
again? Well, no, but is it
You're you're you're making an
implicit assumption here. You're making
again almost the capitalist assumption.
And it's it's it's crazy how completely
pervasive this assumption is throughout
society. The idea that like more money
is better, bigger is
better.
Um Jerry Seinfeld has a has a bit where
he talks about, you know, everyone today
with their jobs are so obsessed with,
oh, how much does that pay, how much
money you make? Back in my day, it
wasn't like that. It was like who had
the coolest job, right? And then one guy
would show up and he's a firefighter and
he'd just
win. Uh, and you could look at me and be
like that's quaint and oldfashioned,
right? And I'm all for conservative
beliefs need to need to stay in the
past. I'm a
progressive.
But Starling and we can get to Star.
Um, and what I think Elon's downfall is
going to be,
uh, the money is
fake. The the we're we're in some
there's an amount that people care about
money. Uh, and I think we're I think
maybe it's finally starting to
recede, but people can care
about all sorts of things. there's
nothing inherently that makes money
worth caring about. Um especially when
that money buys you less and less. But
so I think the problem with Starlink is
yes, Elon has succeeded from a very
goaloriented perspective of oh look we
got all of these satellites into
orbit. But now think it through a little
bit more. Who does Starlink end up
benefiting?
There might be some adjustment period
where it's great. Oh, great. Everybody
has free internet on the on the
airplanes. This is this is this is
great. Um it's fast and it's
but no, I'm not even making like a like
a Randian point as much as making
a does anybody Starlink is proprietary.
It's
undocumented. Like many of Elon's
things, these are not open- source
projects. What Elon has repeatedly not
been able to do is build sustainable
governance that lasts for a long period
of time. Um, his companies are run
like like a it's it's competent, but
it's a
monarchy. And the monarchy works as long
as you have a good king.
I think this is one of the reason that
Elon's really into uh having kids. I
think he realizes that he needs heirs to
run his companies. Um and I'm not saying
that this is necessarily a bad strategy,
but it looks very fundamentally
different from
uh the way
that we think of Western society and we
think of building institutions. we think
of building self-perpetuating
institutions. I mean, I don't really
know how to do this either. It seems
like it's a incredibly hard thing to do
today. But when I look at things like
the Linux Foundation, well, that's
interesting. This is the kind
of governance like like Lionus Torvald
is a lot closer to the kind of
governance that I would want than Elon
Musk.
uh whilst I can say that also while
still believing that Elon Musk is very
preferable to what we have today.
I
mean, I've I largely like the CCP. Like,
not ironically, in America. I can say
whatever I want. I like the CCP.
Um, I think that there's a lot of
propaganda about them. I think that
they're not I mean, there's definitely
some some
downsides,
but uh open source foundations being
corrupted and tyrannicized. Yes, of
course. And some of it is I I don't know
how well like does the Linux Foundation
continue without Lionus Torvald. Lionus
Torvald's like his attitude is the exact
sort of attitude that I want to see in
power. Dictators are always more
dictatorship. A good dictatorship is
always more efficient than a democracy.
The problem is a bad dictatorship is
much worse than a bad democracy. you
you're you're you're trading off
uh you know you're trading off like
riskreward. So the fake money problem is
much more of a problem in a society
that's decentralized than in a society
that's more centralized.
in a more centralized society. Uh if you
see somebody abusing the whole fake
money thing, well, you know, you jack
mom, right? Um and by the way, I largely
support what they did to Jack Ma. Here's
what he was going to do. He was it was
the cardinal sin of what you do not do
in China, which is he was going to IPO
Alibaba on Western
markets. You don't understand. Capital
flows into China. Capital does not flow
out of China.
Um, and whenever I talk about this
stuff, it's interesting to see the
comments. The comments are usually uh
something along the line of along the
lines of George has no idea what he's
talking about, but they never include a
critique. They never include what I get
wrong. They use that kind of tactic. And
you'll see this tactic in a lot of
places. the the the goal of the tactic
is not to
uh it's just to sew FUD, right? It's
just to say, well, you know, oh, how
could how could he say that possibly
about Jack Ma? That's that's
anti-freedom. But in reality, that
person saying that like I have this
understanding of it. There's definitely
people with this understanding of it,
but they have this understanding of it.
Um there there's so many things that
basically look like that. I think I
think we were talking about one of them
before uh where I I where I brought up
the bell curve meme. It's like like you
think I'm
here. All right. All right. I see how
you think
that. And we can make an argument about
whether I'm right. We can make an
argument about Yeah, maybe I am
actually, you know, grouped in with the
retards.
Maybe. But maybe I'm
not. And there
are ways
to demonstrate that that aren't, oh
well, you know, George doesn't know what
he's talking about.
Okay. Well, you can look at Singapore
and you can ask yourself if you want to
live there.
I don't think Singapore is a necessarily
bad place to live, but it's not where I
would
choose. All right, let's let's try to
stay on
topic. Stayed up late last night. You
know what I was doing last night? I
played Roller Coaster Tycoon. I've been
watching I've been watching
uh Roller Coaster YouTube and then then
like it's just it's just the Roller
Coaster YouTube to Roller Coaster Tycoon
pipeline.
Okay, there's only info and debug it
looks like.
Let's so somehow I I put 000 as a
uh virtual core
Okay.
No, I'm in San
Diego. Okay, so let's think about this.
What it would actually take if we wanted
to build
a tiny grid back end. There's there's a
ton of complexity. There's a ton of
like I I
remember
how Let's really try to read
this. Okay. A tensic
score. This guide is
unfinished. Everything's
unfinished. Near memory compute, the
tensics core operating on its local
SRAMM achieves silicon peak of what
current technology node allows for.
connected into a mesh via two
knocks and each tensor can communicate
with any other tensor in the mesh mesh
and with offrip GM as well as Ethernet
cores. I wonder how explicit this
messaging is or if it can look like just
mapped address spaces.
Um, one of the things that I I didn't
understand about how the memory access
worked, I thought that you actually had
to like pass
messages down through the cores and I'm
like, "Oh, this is such a nightmare to
code for." But apparently it's not like
that. Apparently, every message is just
addressed on the knock. One of the cool
things about Tenstor is um, and you can
see it also in those in those
architecture docs. They expose stuff
that looks a lot more like how chips
work.
So you can read like the RDNA guide and
you're never going to see them talk
about things like NOX. You're never
going to see them talk about things like
how the cache is connected to the cores.
Um they'll talk about coherency but only
from like a software level, not a
hardware
level. So it's cool that Tenstor exposes
all of this stuff.
enable programmers and compilers to
optimize both layout and movement of the
data.
Um data movement is explicit and
decoupled from
compute. Yeah, there's no caches, no
global crossarss.
Um I mean this is a very
interesting
this so like the DSP doesn't have this
uh GPUs have have these memory
coalesers. I I don't exactly understand
what a cost they are.
Um cash is
uh that is a
different there's not that much of a
difference between like an explicitly
managed SRAMM and a
cache but this one is actually a large
architectural difference. So if you
think about if you look at something
like RDNA4
um this is just a picture of the die
right uh I actually have a picture of
the die so if you look here like these
are the L2
caches there's a large I guess what
they're calling a global crossbar that
allows this L2 to be read by any of the
compute units right any of the compute
units can access the
L2 and Tenstor doesn't have this.
Tenstor torrent doesn't have
um the memory is explicitly on some of
the cores. So I'm not exactly sure what
all the implications of that trade-off
are. This the same guide or who can
Okay. Um, intensics compute instructions
operate on tiles. 32x32 matrix of
scalers. Don't know how I feel about
that. Uh, I don't really understand what
that means. Operating on coarse chunks
of data allows for the use of a simple
singlethreaded risk 5 processor to
dispatch these instructions. So this is
to the 106
core. I think bare metal core is not
thread. Every risk processor runs single
threaded and core to thread mapping is
one by
one.
Um yeah. Yeah. So, they don't have a
warp scheduler either, which again,
neither does the Qual DSP.
This is where they lose
me. Like why is it five cores?
So
uh when you look at something like
the I just I just wouldn't do this with
five cores. That seems so strange to me.
Um, where do I
have
extra? No, where's where's Excel or TPU
here? So, the the uh Google TPU uses
this VIW interface. It's like a it's
like a very long instruction word. It's
all in order and it can control all of
the uh the parts of the core with this
big
instruction. It tends to this just it
just strikes me as so weird that their
different risk five course. I'm sure
that's not the right
choice. Uh like some of their story
makes so much
sense. Uh I I've even I've I've come
around on memory on the edge like that
stuff's very
sensible.
[Music]
Um but why this core doesn't look more
like either a DSP style
core. But I guess you probably I guess
you don't want a DSP style core because
yeah, I don't know. But but like it's
interesting how hexagon deals with this.
Hexagon will deal with this by using VIW
packets of instructions. I I feel like
that's the best trade-off I've
seen, but like pack compute unpack. This
is not that
generic. If you use VIW, you need a good
compiler team. I
mean,
yeah, I I think that hexagon is the best
trade-off. So if you look at hexagon
uh assembly code they
have
what none of this is hexagon assembly
code they use
uh we can we can find it
um it's called nn lib
So yeah, these are the implementations
of things for the Qualcomm DSP. Um, I'm
so happy I found this, by the way. This
saved me a lot of
time. So like,
yeah, this is this is a comp 2D. They
use these four instructions inside the
curly braces run as at the same time.
Uh, and then the the manual goes into
how
uh like which resources you can use,
what combinations of instructions you
can put in these things. But so it's
like a packet of instructions. And I
really like this approach. Again, you
could imagine the tens torrent thing
looking like
this instead of like five independent
cores, which is super hard to reason
about.
you say like, "Oh, well the but these
cores are going to run in lock step."
And like that's great if you're coding
in cycle counting
assembly, but if you're coding in C, you
don't know how the compiler is going to
optimize things. You're going to have
things that break when you compile with
like 0 and 02. And I to be
fair, I haven't written 10 store
kernels, so maybe they have some nice
way of dealing with this. But just from
a surface perspective, it's hard for me
to think about how that works.
um versus something like this where it's
very clear to me. Okay, well this is
doing these are these are multiply
accumulate instructions. This is a
memory fetch and this is a cache
preload. Cool. That's all in a
packet. Like I would love to see instead
of these tensics cores hexagon cores.
Imagine imagine a a grid of Qualcomm DSP
cores.
No, but like you're like, "Oh, they need
a software abstraction that makes this
simple." But that's so against the whole
rest of TENS
Torrent. All of this stuff is we're
going to expose to you
uh like you're going to implement your
own global crossbar, which is cool.
hexagon instructions have shape N5 tens
torrent has five N. Yeah. Yeah. That's
that's a way of thinking about it.
Um the the other one's so much easier
for me to reason about.
Behind the scenes, a compute kernel
becomes unpack math and pack
kernels. Yeah. I mean, I see what it's
doing.
Okay, let's let's work on the high
performance. Let's look at the high
performance matrix multiplication
um example. Learn metalum at seven in
seven steps to
do write it.
I'm too much of a software guy to
understand the plight of a hardware
person. I
mean, you know, I think
the I think let's like talk about
questions like that. So something that I
like to do uh when I meet somebody
uh is I like to
like ask them a whole bunch of like
knowledge
questions, right? To ask them like do
you know what memory coalesing is? And
some people get offended by this and you
shouldn't because what I'm basically
doing I'm not trying like like this
isn't like again lose your fucking ego
like this is not an ego thing. I'm
trying to see like do you understand
because I really wish people would do
this to
me? Um I'm too much of a software guy to
understand the plight of a hardware
person to be honest. I don't know what I
don't know.
So do I know what hardware people
know? I can take some
guesses.
I've coded in Verarilog before.
uh like I'm familiar with what the
programming paradigm is for it. I've
never taped out a
chip. Um I've written a simple risk 5
core in
Verarilog. Uh I understand pipelining on
a conceptual level. I've never actually
implemented these things. I'm not sure
if there's like a big gap of things I
don't understand.
um in thinking in my work here at
Tinyrad, I've spent a lot of time
thinking about what the actual hardware
implementations of these things
are. So I I think I understand most of
the like understanding what like a
global crossbar is like I understand
what that is
now from a conceptual perspective from a
here are the transistors that go into
implementing a global crossbar. I could
try to think about
it, but I don't understand like I don't
know if there's some conceptual thing
that I'm missing there.
And what I find with
uh two kinds of people and I think it
comes down to like again a security of
the person kind of thing. Um people who
are insecure will tell me, "Oh, there's
lots of stuff you don't know." Okay,
that didn't help me. Then people who are
actually like very secure in their
knowledge would be like well you know
and actually uh uh a few conversations
with with with with Jim Keller uh you
know very very
much George like yeah okay you can think
that you want that but here are the
problems you're going to run into. And I
love when people do that. I love when
people say, "Okay, yes, I understand
five years ago when I thought that was a
good idea, and then I looked into it a
whole bunch. Here, here's pretty much
the
exact evolution that your thoughts are
going to go through." And they explain
to me, they first show me that they
understand how I'm
thinking, and then they tell me the next
thing I'm going to think, and I'm like,
"Damn, okay, you understand." Like I I
uh I respect that so much and I believe
you and I try to do this to people too.
I try my best whenever I'm capable of
doing that. Like
um okay, like I see why you think that.
I thought that
once. Uh but here's you know what you're
going to what you're going to run into.
And um one one Jim Kellerism and I like
how tensor focuses on this is so much of
power is spent in data movement. It's
it's not the compute itself. It's it's
bad.
Uh tons of waste in data movement and
everything's statically schedulable.
There shouldn't be this waste in data
movement, but it doesn't mean that it's
easy to figure out how to statically
schedule things.
Uh, no, he came down and visited Kama a
few times. We talked about this stuff
before he was at Town Store.
Um, can I tell him the software is bad?
I I have
Uh
again
well you can say that you can say there
should be an all hands on Monday but
again you'll you'll watch responses to
criticism and responses to criticism
usually fall in like two kinds of
buckets. There's people who get
defensive and these people should just
be like
discounted, right? These people should
just be like, "Oh, uh, yeah, I mean,
it's it's but no, I don't think it's
necessarily going to be going to be
that." I think it's more well, okay, I
mean, we could put effort into cleaning
up the Metalium documentation and API.
We could write a simple C API. We could
make it more portable, but what exactly
is this going to get us? And that's a
good conversation to have. A lot of
people are, George, uh, why don't you do
any advertising? You should be better
about doing customer support. You should
really make sure, and when these people
are making these sort of criticisms,
they're operating under the wrong model
of what my objectives are.
My objectives are not to increase device
sales. That's a secondary objective.
Increasing device sales is a good thing,
but only if fundamentally it comes from
making the software and hardware better.
The goal at the end of the day is to
make the individual box better. I want a
comma that is better. Right? Now, if
that leads to device sales, that's a
great way to measure how much better it
is. But it's not some it's not a metric
you can optimize for. This is goodart's
law.
Uh so I would I would say that you know
I look I think tenstorm software is bad
and uh I would change the following
things and they could be like well
George yeah but those are things that
you're optimizing for and that's a place
where I mean you can't the the this is
like the is ought problem of moral
philosophy right you can definitely talk
about is you could talk about if you
make these decisions it will lead to
this outcome
and two people can have a debate on
those things. But there is fundamentally
a truth. Whereas, you know, actually our
our goal is to just increase the number
of red balloons in the world. You can't
you can't tell someone that's a bad
goal. You can tell someone that buying
green balloons isn't going to increase
the red balloons, right? That's an is.
That's not
an What other objective can they have?
What's sales of the of the of the you
think they're objective is sales of the
cards? I don't think it's
that. Oh, then making good software and
hardware. Well, you know, define good.
Um, I don't know. And to be fair, I
haven't
like I'm going to go back to to to tiny
grad work tomorrow. This is not my
uh this is not my job. I I I I
haven't one one crit one
uh response to my criticism of the
software is uh you know George you just
haven't spent enough time with it. And
that may be fair that may not be fair. I
don't
know.
Um you spend a good amount of time with
that, right? Yeah. Again, I I think that
this is echoed by some people who've
spent a good amount of time with it. Um,
if Blackwell works well with
Torch, it's never going to work well
with
Torch. This just isn't going to
work. I
mean, yeah. And that that could be
that's an is statement.
Um, like from what I've seen of this
approach, it's just not going to ever be
good with
torch. Well, at least like we want to
look at their mir stuff. So, we might
not have found what their torch stuff
is. So, that the TTNN thing is I mean,
not only is that that isn't even torch,
right? That's interop with torch. That's
not actual using torch code. So they
have this TTM mlir thing.
I don't know if this lets
me is there like a tens torrent torch
thing that I can like build a version of
torch that lets me actually type like
torch rand n a equals torch rand n b
equals torch rand a at b and that maps
them pietorch 2.0 O ttn. Okay, so this
does
exist. Allow pietorrch code to run on
10's torrent
hardware. Oh, do I have to use torch
compile?
TT
torch. Okay, so this is it only works
for torch compile. It doesn't work for
torch which is the more upto-date
one. Should I use
PyTorch two or should I
use I
mean I I guess this is like always a
hard thing to do,
but okay. So like what's TT
Forge? Is this the one I want?
Okay, so we have TT Forge, TTorch, and
PyTorch 2.0
TTNN. Which one do I want?
Yeah.
Oh, and then don't forget TT
MLR
try. I bought a Tenstor torrent black
hole card and I'm trying to run PyTorch
models on it. What's the latest most
up-to-date open source repo that I
should be using in order to do this?
also have to do it with
compile. It's begging to have
bugs. And yeah, people will probably
like move this
direction. Yeah, I mean torch compile is
kind of a you
know the the other one's hard to
Yeah, like I want to be able to take any
PyTorch repo off the internet and make
it work. And most PyTorch repos don't
use Torch
compile. Um, and I'm not sure I see them
moving there. This is this this this
gives TensorFlow
vibes.
Okay, TT
torch. But what about that other one?
Also, another thing about using LLMs,
uh, George, why do you why do you still
use Google? Why don't you just always
use LLMs? LLMs are
wrong so often, but you don't realize
they're wrong. These things are
optimized with super powerful RL to give
you an answer that you're happy with.
Not necessarily. I think there was a I
think there was a uh distinction I like
this distinction that went around on
Twitter. Some people train their models
on helpful versus harmful and they
fine-tune them to make them more
helpful. Uh this is awful, right? You
don't want to work with a model like
this. You want a model that's tuned for
truth versus
falsehood. All
right. This is Cake crap.
Oh
god, it's calling
Python 310.
Okay. Oh, did I recursive clone?
Find a
torch. I have to clone torch.
Let's stick the normal get subm module
thing. I don't remember how to do this.
I mean, this probably works on on
yubuntu.
by bringing up ax models.
So
painful
requires PyTorch installation that ships
with their ABI.
Yeah. So, I'm gonna have to build
torch. I mean, it's good to understand
like how this stuff's being built. I
read the distraction comment.
Do they have it in their
docker? What?
What?
George, you don't understand. You You
just shouldn't be using this. You just
should use the thing that's already set
up and works for you. Yeah. And this is
why your life sucks. Okay? This is why
you don't understand anything going on
around you, you know,
because No, no, there's a tiny bit of
friction. No, you have to just the
struggle is the fucking point. Like like
like it's it's not about the
destination, it's about the journey.
That's the the amount of
people I don't even understand. How do
these people go on
vacation, you know? You know, after a
week, you're just going to be right back
where you started and then they come up
with the most asinine justifications.
Yes, but I made
memories.
What? So, what if you could just
download the memories? Would that be the
same as as your vacation? It's a
completely incoherent
philosophy. Oh, we have a TT torch
docker. All right,
[Music]
sweet.
Was I raised Catholic?
Uh, I wasn't raised religious, but
uh I got to like dock or load that
shit. Is that
it? No, it doesn't work.
was the medium
darker. Is that a Catholic philosophy?
Do Protestants and
Jews do things just just to for the
destination docker
pull. I don't think that's going to work
though.
Yeah, I mean it would automatically pull
I think. I just don't think that's the
right
path. What's
GHCR? It's a GitHub
thing. I don't think it's pseudo do.
GitHub container registr
changed tiny transformers
pytorch. So the metalium one is not
going to work
for Oh, you gave a broken link. Okay,
try this
one. Just change to
base. All
right, cool.
[Music]
Is this all just some kind of like proxy
religious war? How do we make the
Catholics win? That's the Catholic way
of thinking. How do we win?
[Music]
Those snacks look
nasty. Got a crab. You want a crab fried
rice?
All
right,
let's let's try
this. No module name TT torch.
[Music]
Do I need to activate some VMs?
Got to download a few dockers and patch
the firmware for noise. Yeah, that's
normal. Normal shit, man. Normal shit.
you know, we uh we uh we uh wrestle like
normal in the Kazakhstan, you know, just
just like that.
Um, right. So, like what do I
what inside the container? You're a
liar, Chachi
BT. I think I saw something else
in here.
No, it is TT
torch. We don't
have release dockers for TT Forge
yet. Okay, can I build it in here then?
I have to make it from source. Cool.
Yeah. Know we're having a great time.
Having a great time here. Everyone's
having a good time. A good
time building.
Just maybe
it's best of
times. Yo, like we could live in such a
nice world if
like people would just get over whatever
this thing
is. I I
don't this like zero some
mentality, this belief that somehow you
can win by taking from
others. You
can't. I'm not saying this in a
uh like moral sense. I'm saying this in
I'm I'm the greediest motherfucker in
the world. I want everything. I want my
own planet. I want my own galaxy, man. I
want to like I want to take over the
universe. But you're not going to be
able to do that by taking from other
people because other people don't have a
universe or a galaxy for you to take.
You can't you can't take that from them
cuz they don't have it. Like and we
could get it, but you're not going to be
able to take that from other
people. And it's I I am shocked that
this mentality
exists and like seems to be so
prevalent. And maybe it's just because
the things people want are pathetic.
Well, I want a house and he has a house.
Okay, you want a house? Oh.
You can never win a zero sum
game. You can have it
all. My empire of dirt.
Oh, cool. It finished.
All right. Which of these instructions
did I not
follow? This one
We were zero sum for most of history.
Yeah. And I guess that's kind of true. I
don't
know. I mean, this stuff starts to get
creepy to think about, but
uh what is it?
What's there?
one line in one of these songs.
Yeah.
Uh, one day we'll be holding hands
instead of grudges. We'll eliminate our
territorial circuits and know what love
is. One day we'll be holding hands
instead of M16. Till then, every human
being is controlled by the fight.
the
problem. Someone's going to try to do
this. Someone soon is going to try to do
this. And
I'm not afraid of AI. I'm afraid of the
person who who
who falls for this
ideology because it's so difficult. You
can listen to me talk about this and you
can be like this is, you know, this is
just all bullshit. George is just
playing a zero sum game to try to help
himself.
Um, did I not Okay. Do we do we miss a
step? Like I'm not sure which of these
steps I actually have to do in the
docker.
could not find Python 3.
No, there is Python 3. That's not the
problem.
Like this whole approach just builds on
so much croft and we're
compiling gigabytes and gigabytes of
croft. You don't need any of this.
Jonathan Blow tweet. It's
like at least things have gotten better
in the last four years since some people
are like talking about the problem with
the software.
I don't exactly know why this
happens. Like you're just like, "Oh,
I'll just implement my one little piece
of the
croft." Then I'm building
the am I the
[Music]
TT writing software is too gloated.
That's why most of it is bad. I think
that's kind of true.
I I I I wonder. Well, yesterday I was
talking about how like, well, no, but I
love that bad abstraction because that
bad abstraction is the reason I have a
job. We need to kick 90% of people out
of fucking computers. Like, if we kicked
90% of people out of software, this
would all get so much
better. This used to be constrained.
This used to be constrained by the
the computer has 8 kilobyt of RAM. So
you're going to put a lot of thought
into each variable you're putting in
those 8 kilobytes of RAM because the
computer has 8 kilobytes. So there was
kind of a natural
function. Did I not create a VM for the
TTML tool
chain? Did I miss one of
these? Okay, here. Here's the T. It's
not
found. The base image doesn't have LLVM
pre-built. This one does. Okay. But do I
still have to build all the other
shit? Okay.
Okay. Am I just bad at this?
I I am also I'm kind of confused by how
a lot of people deal with this software
like the things that look like
this. It's got to be a huge struggle for
everyone,
right? It can't be this hard unless it's
designed to be used by no one. Well, but
it's not designed to be
It's not designed to be used by no one.
It is just
uh Yeah. I mean that you know that's
something I like to do like like you
know I think a lot of people again it
comes from like a place of insecurity
where people are like insecure to be
like honestly I have no idea what the
fuck that is right like a lot of people
won't say that because a lot of people
you know feel insecure or feel dumb or
like if I'm dumb there's got to be some
bar here
right like you can be like well you know
George you're dumb you just don't know
how this works. Like you can say that I
don't know but I I feel like pretty
secure in my abilities where it's kind
of
like at that
point who is this
for? All
right, right. So yeah, I mean, you know,
I'm I'm the I'm the guy who'll tell you
that the emperor has no
clothes. Um, and you know what? Maybe
I'm just Dude, he's wearing a skin suit.
You're a fucking moron. And you know
what? Maybe I am. But
whatever. Uh, all right. So, like, which
of these do I have to follow? I Let's
just follow them all. But we can't
pseudo in the Docker because I'm already
rude. So, going to bitch about how
there's no pseudo.
Okay. Opt update.
I'm following every instruction. At
upgrade apt install clang 17 apt install
ninjab build apt remove cmake
y pip install cmake
upgrade cmake
version cmake
v 11. Okay, that looks good. All right.
Now, no, we can't
pseudo install
that. Skip the tool chain step. Okay.
So, I don't need to do this. All right.
So, let's just see if it already
exists. All right. It already exists.
Okay. Okay. That's good. That's good.
Uh now source M
activate. Yeah, I struggle with this
like everyone. I know. But no, actually
I don't struggle with stuff like this in
my real life because in my real life I
don't participate in this. Like
everything that looks like this, I'm
just like I'm buying a different card.
I'm using a different piece of software.
I really don't participate in things
that look like
this. The problem is there's no other
good hardware. What do you
mean? Buy a 9070 XT.
Okay. This
card is half the price of a 10 store
black hole and has similar performance.
Um, so you're going to get 16 gigs of
RAM. Uh, yeah.
instead of
32. Uh, you're going to get more memory
bandwidth. You're going to get more
teraflops of
FP16, same system interface, same
external power. The cooling is actually
good. I have one of these in the room.
Similar clock speeds. Uh, how many CUs
does this have? So, 64 CUS, 120 tens of
cores.
Like unless you have a particular
affinity for this kind of
architecture, everything about buying
this card for AI is going to be a better
experience. Uh no, Sans Nvidia would
literally buy this AMD card. I have one
I have one connected to my Mac right now
that I can just
use. George spends half these streams
just showing off Tiny Grad. Yeah, it's
what I work on, you know.
Um, so like here we can
just need to fix
that. Oh no, I had to use pseudo. Oh,
this was so painful.
Okay. So, like we're running right now
on
the 9070 XT. You want to see
it? There it is. It's plugged into a USB
port of my MacBook.
Um the only dependency that you need is
tiny and this is building things with
rockm but you can also use lvm with amd
lvm equals
1. No but software is hard. How is this
possible? Like
again I
I the USB thing is is like crazy beyond
belief. But if you just take one of
these cards and stick it in your
computer just like I did the tens
torrent, don't install the AMD driver,
just use Tiny, you'll have a phenomenal
experience. And if anything goes
wrong,
it's this many lines of
Python, right? You you don't have too
much to look through if anything goes
wrong.
The only literally the only external
dependency is LLVM and you brew install
LLVM19. LVM 20 has a bug. There's
actually a we found a bug in LLVM. Not
like like in a way we're using it.
There's actually a bug in LVM. Um,
brew
install
LVM19, right? You can also just install
the LVM19 package on literally whatever
you want. Tiny pip install
tiny. No AMD driver. No rockm. No
bullshit. 13,500 lines of
Python. Um, again, many of them not even
on code paths you're going to hit,
right? Like your like ops DSP is this is
actually perfect. This is perfectly
abstracted away. You'll never have to
think about it.
[Music]
Um, I feel like there's this mentality
also. It's like software has to be bad.
All other software is this way. Like,
no, it's not. Tiny legitimately not like
this. But George, Tiny is 10x slower on
LLMs. I showed you guys yesterday it's
not 10x slower. What are you talking
about?
for
from Okay. Oh my god, I have to press
beam equals two. Like, okay, I need to
put in one
flag. The hell is that crap?
I
actually uh No, I think I think it's I
think it has the it's accessing the
wrong
model. So, this is the 1B one. We'll see
how it
does. Oh, camera blocking. Sorry. I
don't know why the AB one didn't work.
You give that a second. See what it
does. Okay. So this is running a
uh 1B
model and the parameter gigabytes per
second is 334 gigabytes per second.
Okay, so that's like like this is
running a 1B model at batch size one. So
when you're running an LLM at batch size
one, you are limited by your memory
bandwidth.
So the memory bandwidth of my M3 Max is
400 gigabytes per second. So this is 83%
of the theoretical max. I I don't want
to hear oh tiny grad oh tiny grad is 10x
slower. You you actually did you write
bam equals 2. Even without be equals 2,
that's 83% of the theoretical max. And
you'll get that on almost all LLMs. Um
our mixture of expert stuff is not as
good. Our mixture of expert stuff is
more like 40%. But still not
10x. Okay. Like I I don't know. There's
some weird guy like hating in the
Discord about this. It's it's
it's like like there are legitimate
critiques of Tiny, but that isn't one of
them. And and then I don't even know
like what you do about that. Like what
you do about this like these people
really just don't know what they don't
know. You can say that it's slow, but
like why is it slow?
torch
stuff. Why did AB not
work? Why did it like it must have
downloaded something
weird? It's like stale. How do I Do I
have a flag to ignore this? Won't
probably won't happen on your computer.
Um, it's always good to fix a little
bug, but you can go you can go go try
that command right now on your computer
and see if it
works. I have an idea that it's only
broken for me because one of these
things didn't download correctly.
Yeah, those just don't look like the
right
size. Computing hashes of big things is
slow, too. Let's just look corrupt.
I don't know why they got moved though.
Must have gotten like
disconnected. Yeah. See, like look, it's
downloading four gigs now. To be fair,
yeah, that's like shitty. That's that's
shittiness of Tiny, but like it's
hopefully like it's straightforward to
understand what I did there and what
happened. It was probably busy
downloading the thing and somehow the
process somehow the connection died in
such a
way. Uh
Well, maybe this has already been fixed,
right? Because this is the kind
of this is the fix you're going to want
here if the length doesn't match what
you said the length should be. So, I bet
you someone already fixed this. My cash
is just still
What do we
got? Yeah, George. But I can get I can
get 100 tokens per second using GGF Q4
on my Yeah, but dude, that doesn't
matter, right? That's not the same
model. You can also like play with
quantization if you want here too, but
like you're just in some rabbit hole
of you're not running I don't
know. I don't
know. Maybe there's just also like no
demand for local AI. I mean I don't use
this shit. I use chat GBT, right? I use
chat GBT just like everybody else. Like
eventually they'll make a shitty and
you'll be like in shitification's going
to be harder this time. But again, okay,
so 21
uh.3 tokens per second. There's 21.3
tokens per second on an 8B model at
float 16 quantization. So we multiply by
two. That's 340 gigabytes per second.
Okay, with batch size one because you
have to read every parameter in the
model every time for a dense
LLM. You got to name this shit new
lessons.
The theoretical maximum on this computer
is
400. So where we're where we're we're
what of the theoretical max, right?
We're 85% of the theoretical
max. Felt like when I was a kid in the
schoolyard talking about cars. I knew
nothing and had many opinions about
engines. Yeah. No, I
Am I fighting just just just a losing
like is this just all a losing
battle? Is this done yet? Oh well, good.
We've completed Torch MLIR. That's
that's great. That's
great. It's my optimization objective.
Oh
god. Like this is the problem. The
minute there's an optimization
objective, don't worry. the ad people
and the Google pitch authority like you
just this
is I'm going to get a sign that just
says goodart's law and I'm going to tap
the sign. Okay. When a metric becomes a
target, it ceases to be a good measure.
When a measure becomes a target, it
ceases to be a good measure.
Right? So, no, you can't have an
optimization
objective, right? You gota you gotta
make fun of people by using a nerd
voice. What's your optimization
objective? Right? Because that's that's
that's how do you get around this
otherwise? I think it's like shame and
mockery. Yeah. Change the world. That
sounds good, right? That sounds good.
Let's change the world. You know, Hitler
changed the world, man.
Not all changing the world is good,
right? You ever seen Sam Hyde's uh TED
talk? It's pretty
good. Bra. Bra.
One second. Check something.
Great. No fat LTO objects. Good thing.
Good thing. I don't like fat people
either. Yeah, I'm with you. I can feel
that. All right. CMake install
build. All right. Run a basic test to
verify. We compiled TTorch in the
docker.
If I like exit this Docker, is there any
way to like get this back? I don't know
how Docker works. Or do I got to
like build more? It
won't.
Okay, so does this work? Let's try to
compile a single
convolution. TTorch has no attribute.
Compile. Okay. Well, I think that's just
the LLM hallucination. At least now
we're importing TTorch. Okay.
some list
of like is this example
work? All right, great. We added 2 * 2.
Uh, no. What I want is the stuff that
does like Can I like run a model from
like like the way people actually use
like this? Yeah. Is this going to
work? Okay. So, I have a model. Let's
actually load the pre-trained one.
Um, no. Operator torch vision NMS
doesn't exist.
Okay. Okay. Okay. We'll look at the
supported. Oh, you've had this one. Oh.
Oh. How do I fix it?
All right. Here, here's some models.
Okay. All right. Try Mobile Net
V2. Okay. Test T test RNet 18. Okay.
Here. All right. All
right. Oh, no. I don't think that's
doing anything. I think we have to run
it
with pi test.
Oh
god. All right, we eventually got it
done. Okay, so this supposedly
works. All
right, let's get the
model. All right, that worked. That
worked. I convert it to Bflat
16.
Uh, oh, I have to set up this
complicated compiler config.
up what so where's that simple add one
can I what if I use that same mentality
on the here okay so import the torch
dynamo
backend compile the
model that was
fast suspiciously
fast all right let's get some
inputs I don't know why you have to take
your inputs to Bflat 16 and let's try
Oh, well, there's an MLIR error and
verification
failed. OP 10's torch must be
a again. I
I did normal fucking shit. Okay, I
didn't do anything weird here. Did I
You're using I'm in
Docker. TT torch. An error occurred
during
compilation. Did Did I do something
stupid?
I I again I I think the
Yeah, I don't know. I I don't know if
it's I think think the
disconnect for
like I I feel that a lot of people who
work on this stuff are not ML
researchers. So I I worked at comma for
seven years. Uh most of that time I was
I was basically an ML
researcher. The amount that you're like
nobody will tolerate this. This is why
Nvidia is is is is winning so
hard. Let's do a
test. Let's try something.
Um, no. We'll have to figure out how to
install the
driver. You guys, do you think it's
worth it to try to do the same test with
AMD?
Okay. Install AMG GPU driver Arch
Linux. No, I'm not sure that's the real
So, first let's just try the pie thing.
So, I'm not in a Docker now. We're just
going to try this in raw arch Linux. I
have an AMD GPU in this computer. So,
we'll try Linux. We'll try
Rockm. We're going to just
do it like the dumbest way. I think this
isn't going to work. Oh, I should have
to uninstall
torch. Yeah.
[Music]
Uh 35
Oh, AMD GPU DKMS. That seems like what I
want.
There's a chance we just don't need
it. I'm going to try the exact same test
on AMD. By the
way, I know. So, I don't know. This AMD
driver might just work. The built-in
one. Okay, cool. All right, let's do
that same test that we were doing on
AMD. Import
torch. Import torch
vision. Download a
model. Convert it to be float
16. Compile the model. Oh, do I care
about that?
Um, oh, I should probably say model
equals
model.cuda. That's downloading it to the
AMD GPU.
Now, let's torch compile the
model. Let's make an
input. Put that on CUDA 2.
sick. AMD has come a long
way. I I mean, all I did was follow like
the simple instructions here.
Uh, let's make sure we're actually like
in actually in uh AMD
land. Actually, I have a simple one. I
have one in tiny
ground. Uh, so I have a torch gem
test. Let me just try
it. Cool. That's pretty
good. So, Torch is getting 113 gigaflops
on my
70. I mean, that was actually incredibly
impressive. I used the built-in AMD GPU
driver, the one that shipped with Arch.
I didn't have to build anything else.
All I had to do was this one pip install
command and it
worked. That might even be better than
CUDA. I didn't have to install rock am.
I didn't have to do anything.
Wow. Good work AMD.
So this is what I mean like these things
are not the same. You you heard you
heard yesterday when I was when I was
praising AMD. None of this shit worked
when I started two years ago. There was
nothing like
this. Installing AMD was a nightmare.
You'd constantly get driver crashes. Now
it's just using the upstream driver in
the latest kernel. PIP install Rockm
6.3.
Yeah, AMD's actually been making great
progress. I'm waiting for this to be
priced in too. I put I put a quarter
million in AMD. I'm telling you
guys, no, like they still have problems.
Like you see what the semi analysis guy
tweeted yesterday. Like they they have
problems. They have bugs in their
compiler. We'll find them.
Um, forget flex attention. Like, like,
yeah, I'm sure that shit doesn't work.
Whatever. And maybe it works, maybe it
doesn't work. But my point is, I
followed the absolute basics of
downloading a ResNet from Torchhub,
Torch compiling it, and running it. And
I got a I got an
output. Sorry. And this thing is like,
oh, sorry. You can't you can't import
torch vision because it doesn't have
torch vision
nms. And this is after I installed some
some Docker and spent 20 minutes
building stuff and picking the wrong
Docker two
times, right? Like like
like Okay. I I just I just want everyone
to
understand there's no there's no defense
for this. Right? It's bad. You can say
it's getting better, but is the path
that you're taking actually going to
yield you this result? I strongly doubt
it. And here's why. Here's why AMD was
able to do
this. I explained it to you yesterday.
AMD was able to do this because they
don't have a custom backend. AMD took
every CUDA package and cloned it and
wrote an exact clone of it. change the
ends to ours and now yeah it works as
well as Nvidia does. I mean probably
not. There's probably a whole set of
edge cases where Nvidia is a lot better
but at least the installation process
looks like Nvidia and it's because the
two accelerators are basically
identical. No, no, I don't think Tenstor
is on a track to improve the way AMD
did. AMD followed a path that was again,
watch my old videos, you can see all my
complaints about AMD. My complaints with
AMD were that they didn't test shit and
that they didn't have
CI. I mean, I I guess I was
misunderstanding what AMD's goal was. I
thought AMD wanted to leaprog Nvidia.
They don't. AMD is very happy getting 5
to 10% of Nvidia's market share and
being the fourth option. I mean it's
slightly better than CPU. Am I right?
And it
is. Yeah. It's the seventh ster attack
at 10 torrent. Without fundamental
culture change, it won't be
fixed.
Um I
mean something at AMD's culture changed.
AMD sent me two
boxes. Okay. And don't try to tell me
I'm holding it
wrong. How long has 10 sword existed? 9
years.
Um, so do we want to go back to to to
writing like
kernels? Um, let's let's let's hold me
accountable. Let's actually go back to
my initial
uh here.
The software is called RCM. It's open
source and it supposedly works with
PyTorch. So I've tried three years in
the last couple years to build it and
every time it didn't build out of the
box, I struggled to fix it. Got it built
and it either seg faulted or returned
the wrong
answer. Not what happened this time.
They fixed
it.
2023. Oh wow. It's actually almost two
years exactly.
Um, and we of course succeeded at this
goal. Um, I mean to be
fair, let's not go overboard with the
praise here. This isn't
training. Let's see if training works.
Actually, um, this is the test one I
like.
And just so you guys know, there isn't
like secretly an AMD GPU in here.
Secretly an Nvidia GPU in
here. It's slow.
want to compare it to
uh I need my DX
config. I haven't done anything yet.
This is
5090. Yeah. Well, maybe it's a little
better.
Uh, yeah. I don't know what's happening
there. It's trying. Let's give it more
time. Is it Is it spinning the
CPU? It's spinning the CPU, so it's
doing something. Oh, no. What if it's
not on CUDA? What if it's actually
trying to train on the CPU? No, they're
not using all the
cores.
Um, yeah. So, that I mean, that's pretty
sick.
Uh oh, I have something I want to test,
too. We got the new
tiny should
support 5090s with the NV back
end. So, let's see. Show you the tiny
grat equivalent of that car trainer.
It's slow in the PyTorch version by a
good
part. Oh, it worked. Okay.
It was compiling. It's compiling all the
kernels using
Triton. Cool. So this works with the NV
backend now. Um so this is the tiny
reimplementation of HLBC.
19 seconds. Okay. So, it's
it's this 7900 XTX is 4x slower than a
5090, which yeah, it's about it's about
a quarter the price. Yo, you know what?
I'm half tempted to get rid of the
discount on the red boxes.
Like this is actually really
usable. What is NV back end? Yeah, it's
Nvidia without CUDA. I mean, it's still
using the uh it's still using CUDA to
compile, but it's not using it to
uh it's not using it to
uh run the whole runtime is in is in
tiny. You don't even have to use it to
compile from CUDA code. Uh Tiny's happy
to output PTX.
The problem is it's hard to get
uh from PTX to SAS. There's nothing
really open source that does this. Uh
SAS is
undocumented.
Um so yeah, it's this is this is this is
a place where tiny grads may be 10x
slower. Um yeah, 93.7. Where did that
one get
to? Uh 94.
That one got 93
point uh 92.5. Okay. Um you want to see
if we can make it
faster. See how fast that goes. And now
it's going to take the same 60 seconds
or five minutes to compile that PyTorch
does.
Um, the way
So again, the only reason Nvidia AMD can
do this is because they have the Nvidia
crib
sheet. So when you actually read this
code, it's all CUDA
everywhere, which is
Actually thinking about it, kind of a
smart
decision. So AMD doesn't make you typem.
When you install Rockm torch, it's just
CUDA.
Um AMD also is like again the reason we
we shell for them hard
is they're the exact kind of player you
want to disrupt a monopoly.
the person who's actually okay with
getting 5 10% market share and just
keeping the front player on their toes.
Great for the
world. Well, AMD is great for the world.
Why? Cuz like Lisa Sue and Jensen are
cousins. This shit's
ridiculous. Oh, you can hear it a little
bit. By the way, the tiny box that's
doing this is in the room with
us. You can see it aggressively
compiling CUDA kernels and calling the
CUDA compiler many many many many times.
Oh, the uh the the luminal one. I think
they have interesting
ideas. I think that they should not
reimplement a front end and should use
tiny gods. I think they should focus on
just the compiler aspect of it. But
like, you know, everyone's not invented
here, so whatever. No one's going to
listen.
Um but you know they have some they have
some cool stuff in the compiler. They're
using
egraphphs. Uh like their their compiler
infrastructure looks more advanced than
tiny. I don't know if it's more
robust. I also didn't see any benchmarks
from them. So like we focused a lot on
things like
um like upcasting and filling out the
registers and tensor cores and stuff.
Uh, I'm not sure Luminal focused on that
stuff, but they do have a nicer way of
talking about kernel fusions than we
do.
Um, someday we're going to rewrite the
tiny red back end in
Rust. Like I can see a world where
tensor.py Pi stays Python but then
everything below it kind of becomes Rust
eventually once we've solidified all the
algorithms and the progress to only make
is in like search speed and heruristics
and
optimization then that's a good time to
become Rust. Uh but you know we still
have probably several years of
algorithmic iterations. Um, in general,
when you're looking at like speed in
programs,
your biggest gains are always
algorithmic. Your your biggest gains are
uh what is it? Like it's a Elon thing
like don't optimize what shouldn't
exist. Um, so you know, you move to Rust
and you're optimizing things that
shouldn't exist first. Make them not
exist. Oh, I could use C++ 26.
new
headers. What's in
C++? You
know, it's not even that C++ itself is a
bad language. My biggest criticism of
C++ is that it's just too big. It's way
too big of a language. Everybody's C++
looks so different. Um, Python has this
philosophy. It's like there should be
one way of doing things. All right, so
now it's like twice as
fast. Still pretty
awful. Um, this shuffling thing is only
bad because we're still doing it on the
CPU. That's really slow,
huh? Why did that take 14 seconds? I
don't know.
This shuffling comes from a time before
we had this stuff working. I got to just
go through and update this example. But
that step time isn't that bad. I think
that step time is within like I think
torch is something like 20
millconds. Okay, we tried all of this
stuff.
We're building this kernel.
Hey, George. Hey.
Hi.
Should we work
through
there an idea how the index type ends up
becoming a
float? Um, I don't know.
You'll have to look at what their demp
is, but it's exciting that they have a
demp for it. Torches this great file
called decompositions that break complex
torch down into primitive torch ops. And
that's like perfect for tiny grad
because we'll do all the fusions anyway.
Um, so yeah, any any decompositions you
can if you can enable a decomposition
and it causes an error, uh, we should
look into it. So we're getting pretty
close with our Onyx front end.
Um, so we
have Tiny has two front
ends. Um, the Onyx one is getting to the
point where we can move it in. So, right
now it's not in release. You have to go
here. Um, you have to you have to
install Tiny from the repo if you want
this. But yeah, the Onyx front end is
getting close to complete. So, I think
our op coverage is
uh I mean it's hard to say whether
you're better than Onyx runtime or not.
Maybe the thing to look at is what
percent of models you run correctly. And
we're working on a big CI test to do
this. Uh I think it's pretty close to
complete now, which is cool. Um and it's
pretty simple. These are this is like
like these implement the Onyx ops in
Tiny. So you can just load nonx model
in. Uh so that one's going to get moved
to the main
repo. And then there's the torch. Uh
it's called torch backend, but it's it's
a backend for torch and a front end for
tiny grad. It puts torch here and tiny
here. Um this is what I showed off
yesterday. So this one still has a you
know, you can just read the code and you
can tell that it's not nearly as high
quality as the onyx port yet, but we'll
get
there. Um or has so many ops. Yeah, I
mean they're not that hard to implement
though. What we really try to do is make
as many of them possible. The uh like
look I mean that just that's just like
look at how beautiful that code
is. That just shows like like code like
that's like like you know people charge
why would you write code like that? Why
don't you write a terrible softmax with
a big if statement and no like come on
right look at the difference. It's like
it's so obvious to I want to write the
code that looks like the pseudo code. I
want to write the code that most
concisely expresses the
idea.
Um yeah, so this is our Onyx front
end. I think we do support a good number
of the contour popops. Well, all the
ones that like are like
used maybe attention as a
contrib. Oh, this needs to be cleaned up
to
use. Wait, what? How come this isn't
using scale product
attention? Could be cleaned
up, but it also doesn't really matter if
you use scale. Attention because again,
these things are all going to be
optimized at a lower level anyway. This
is just a waste of lines. uh a waste of
lines and not just a waste of lines, but
a place where you're more likely to get
bugs.
Um
quantization these need to use the
actual optimizers too. We need like some
like basic implementations of the
optimizers. I have a PR up about fused
optimizers. I want to move to fused
optimizers. What is tiny
atom? Oh, okay. That is actually calling
the
That's
good. And then these are just the ones
that pass through
uh
as tensor ops.
Let's read this matt single core.py.
It's implementing a mat. I don't know if
it's necessarily a lot of lines, but
what's crazier is that it's actually not
even the mat kernel. This is just the
dispatcher for the mat. These are the
matal kernels. Why does this Why does
set mouse equal that in the thing not
work?
Stop detecting the
mouse. So everything's done by tiles.
Not here.
What's the tile size? I mean, so this is
their like this is their this is their
like uh their
tens. Like why is there a leaky rel why
is there a relu
tile? Why is Railu in
operation? This is an example of SFPI
code. So is this where the relu tiles
are implemented or is there actual
stuff? Why is nothing updated for black
hole too?
Yeah, I mean actually we can just check
out the repo. Let's check out the uh
Is this their main one? MV
mole. Okay, so it looks like their
tensor core size is
16168, which is fine. That's a normal
tensor core
size.
Um, but it's it looks like it's it's in
place. So you have this concept of in
place and
uh
like again I I watched the Qualcomm hot
chips presentations. I think they talk
some of the best about this like so if
you think of something like a systolic
array like a systolic array is going to
shift out and then where those things
actually go. Well, does it
uh or are you keeping the accumulator
local and then you shift out the
accumulator later? Is the accumulator a
normal register or not? And if you go
back to like old school 8bit machines,
right? You used to have this register. I
don't know if you guys ever coded for
like the pick microprocessor. I think
even like the 8051 was like this.
um you have an accumulator
register and that accumulator register
is special right you can do things maybe
you have like an accumulator an x and a
y register and you can move the
accumulator to x and y but your output
was only into the accumulator um when
GPUs have tensor cores the GPU tensor
cores can largely output anywhere uh
also like the amx is in place so tensor
is in place I mean in place is always
just harder to use but it may have power
advantages because you might have to do
less data
movement.
Yeah. I I just I don't feel this is
going to I I don't know if this is
what's being used under the hood in
TTNN, but I don't think that code that
looks like this is going to work.
I think
that you've built a data flow
machine, but you're trying to work on it
like it's a
computer. You're trying to like you're
writing you're writing sequential C code
like this. And this code's not
autogenerated. This code should be
autogenerated.
and
parameterizable. What if eight bank?
What if it's not eight bank? What if I
want to change my
uh tile
size, but then like also these things
kind of should not be parameters. They
should be recompiled and compiled in
every time.
is the same ammo.
Get compile time argal.
Why is this C16? What is
that? Oh, the identifier of the output
circular
buffer. Wait for tiles. Do the mammal on
the tiles. Pop the tiles.
Continue. Grab
a
tile packet. Push
it.
Let's look at something like the elute
tile and try to figure out where it's
implemented. Like is the LUT tile
implemented in something or is this in
hardware? All
right. LLK math Lwise
uny. So this is
the
LLK API.
God doesn't
see. Okay, that's fine. I Yeah, I mean,
this is also like just not how I would
do this.
This stuff can't be co. How many if you
want to add a new activation function to
tens
torrent? How many
layers would I have to
change?
Uh I don't think this LLK stuff is the
way to do
it. Oh god, there's stuff about the
derivative here. All
right. This stuff needs to all be
autogenerated.
It's
it's when I see stuff like this, it's
sad because you just you think of all
the time that went into this and it
should have just been computers.
So, I mean, when you look at the like
when you look at
the tense torrent stuff,
um, where's that picture of their
stack? No, they have a better picture of
the stack somewhere. I don't think TT
Forge is still real.
You know that picture I'm looking for.
Where'd it go?
this. Yeah, this one. Okay.
So,
like you wouldn't even be able to
implement
uh tiny at this layer.
Because this isn't this isn't the right
abstraction. Things that look like this
are not the right like you're going to
write a kernel for
everything. This should all be
autogenerated by your graph compiler.
Um when you think about it like one of
the ways to to to judge this is to say
yeah if I if I come up with a new if I'm
a researcher and I come up with some new
uh activation function right you see
like it's an LU but then it becomes a
relu at
three how much in order to get
performance so you can always implement
that at some very high level in terms of
torch tensors and taking round trips to
memory. But if I want to actually get
performance out of that, how many layers
do I have to change? Right? So we'll
call it the fail and I'd have to create
failure.h in here
um with like
initializations and then at a higher
level I'd have to create
uh a tile in it.
I'd have to pray this all
compiles and link this back
to
my Pitor torch and I'd have to like
expose a
new This just can't
work. What am I going to add failure to
stable HLLO? Like I I think that these
compiler things are relying on some
lower level being able to do fusion
because if you don't have some lower
level that's able to do fusion, you're
going to basically be taking trips to
memory. Maybe you can chain the tiles
without trips to memory, but at least
it's going to be trips to SRAM and
you're not going to be able to do it in
your registers.
So like for all the things that tens
torrent gets right about data flow, they
then
write c kernel sfpu lu and all that
potential performance improvement is
just dropped on the
floor. It should cost you no more time
to compute a double
lu. Want to see how to do it in
tiny? Uh so let's go. No optals 1, CPU
equals 1, debug equals 4. Okay, so I'm
going to create a random
tensor 10x
10. All right. So that's random. We can
say it just random. All right. All
right. So now I'm going to do a double
LU on it, right? And then convert that
to
numpy and support
LU. Oh no, I'm just tired. Okay, cool.
Um, so you can see that this double L is
being computed in a single function. So
we're not taking two trips to memory in
order to compute this. We're staying in
registers. There's only one loop that
counts to 100 and the LU logic here is
duplicated and that's automatically done
by the tiny
compiler. When you have an approach like
this, this is never this is not
possible, right? What what you want to
do is this. But there's no way to do
that without going in and manually
editing the code.
You need something that can autogenerate
at this level if you want to get
performance and you want to allow
research flexibility, which is a new
card. It's what you
need. Don't listen to me. I've only been
thinking about this problem for the last
five
years. Think about it every
day. And this is the best hope I have at
pushing back.
One thing that I've kind of just
accepted axiomatically because like if
it's not true, I'm really just lost and
have no idea what to do is that complex
software stacks privilege larger
organizations and simple software stacks
uh prefer
individuals. You're always going to have
imbalances of power, but you can decide
how big you want your imbalance of power
to be. There are some things that
um it's not unrolling the loops. It's
about whether you're taking an extra
trip to memory or not. It's about
keeping your data as local as proc as
possible while you're doing element wise
operations on it. So like you'll see you
can go even further with this. Like I
can also do mole 2 here which is going
to multiply it by two in between the two
values. And this is the code that was
automatically generated. And you can see
here that there's a times two put in
there, right? The times two also got
distributed somehow. So there's a times
two there. But um you can see that the
end result is well actually it shouldn't
exactly be times two because it was
after the LU. But we can we can move it
and put it so we really get a perfect
times two if we put it there. I'll put a
mole one in there and you watch it just
go away. Um but yeah, you can see that
just the output is then modified with
this times two and that's C code that's
being compiled by clang and
run.
Um and then I don't know if you guys are
interested but I you know instead of
setting CPU equal one you could just set
metal equal to one and this will all
just work for metal. Don't do it cuz
actually the reason the CPU is kind of
crazy is because we don't have an X
function
um in
the there's no X function uh in a in a
CPU. So like you can see that the kernel
in metal is a lot simpler. Oh, I just
did X but I didn't do
LU. Yeah. Yeah. So that's the LU kernel
in
metal. Um it's a lot
simpler actually. You can read this and
you can see
uh I don't know maybe they do both have
to be gated but there might be some like
optimization possible there. You can do
that as a rewrite
rule. You guys want to go further? Um,
so I can just do this as like a python-
C import from tiny import tensor
tensor.
N44
contiguous.lu
numpy. All right.
So if you want to see what the LU looks
like, I'm just drawing this with viz
equals
1.
And actually, let's just clean up this
stuff so we don't
uh empty.
So we just have the one kernel mess with
the other
ones. So that's the LU
there. You can watch it like
go and turn into
code. So I'll rerun it here with a
second LEO.
Look, now it has two L
values. I don't know how you see things
like this. I I don't know how you watch
um I I hope I hope people at 10 store
watch the stream. And I don't know how
you watch this stream and then go back
to writing cernel sfpu lu
And then also, I don't know how this
stuff's being called, but can you be
running an LU at the same time you're
running a
mapm? This is the beauty of the the
Google TPU compiler. Like, they really
are incredible at
um doing all this stuff, which there's
no there's no fusion possible
here. There's no op fusion
possible. You're like, oh, well, you op
fuse that at the tile level. Yeah, I
don't know.
To my point, maybe they don't
care. I mean, okay, don't care. Don't
win.
Um, if you guys want to see the
difference when you run this with the
CPU. So, you'll see that the kernel
starts out pretty much the same, but
then in this final rewrite, X2 is not a
valid OP on the CPU. So we expand X2 to
a tailor expansion so that it can
actually
run. Yeah, you have to have a great
compiler if you want any chance of
running well in VIW.
Yes.
So I mean I do think this ends with us
making
chips after a really long period. Like
we're not gonna make chips next year. I
can be excited about it and push for it,
but there's so many things still to be
dealt with at like a highlevel
algorithmic thing um that needs to be
fully understood and fully made simple.
Then when we build our hardware, a bunch
of things are going to be
true. Our first chip is going to run
every model Tiny
runs, which is like everything, right?
Try to find a model Tiny Grad doesn't
run. Um, again, we support most of Onyx
like actually working, not it's going to
give you some error on some weird op. It
actually like just works. But George, I
found this one thing that doesn't work.
Okay, I bet you it's a twoline change to
fix it. It's not 1.0 yet. Like, we'll
get there. But the question is not like,
does it work perfectly out of the box?
The question is, when you're missing the
failure activation function, how many
lines is it to
add?
Um, do you think they can win without
having developers make useful stuff on
top? Maybe they just want good hardware
and to get acquired. No, it's not going
to work. I Anyone who's playing for an
acquisition I don't know like you've
already just lost in my mind. You've
already just you've already just decided
we can't win, right? That's that the the
first step to wanting to win is, you
know, wanting to first step to winning
is wanting to win. If you don't want to
win,
um, SIMT is very different than TPU.
Does the software need to support both
before to bring hardware? It's not that
different. Um, SIMT mostly just gets you
nice abstractions that you wish you had
in TPU,
but we are going to, if we do not have
torch levels of performance on Nvidia,
we are not ready to tape out our own
hardware.
Um, so yeah, I mean when when we do make
our hardware and when the chip
ships, it's going to work out of the box
for every tiny model and it's going to
work out of the box on every computer
because there's not even going to be a
kernel driver. It's going to be user
space, Python, M mapping, PCIe, or if
there is a kernel driver, it's going to
be a 100line kernel driver that just
sets permissions up correctly.
Um, we probably will have to do I don't
think I don't think that set cap on
Python is actually a shippable solution.
We'll ship a very simple DKMS package
for every common uh Linux distribution.
And this DKMS package will use APIs in
the kernel that have been there for 17
versions. Um, so yeah, no, we will
probably well actually I don't know.
I think there is a way through VFIO if
you have the IO MMU enabled uh to expose
things to user space in a safe way. Part
of the problem with just straight up
exposing things to user space and I
wonder if I mean I think tiny I think
tensor one has the IMU but if you just
expose something to if you expose like
something with a DMA engine to user
space without
uh I don't know I haven't gone too deep
into the uh security model of GPUs but
if you have a DMA engine if something's
sitting on the PCIe bus with no MMU and
you have a DMA engine that can hit
physical pages of memory free. I mean,
that's just you can get from user to
kernel. Uh, yeah. No, I I am a user.
Like, fine. I don't know. I mean, I
don't like them. I think that there's
like you look at all like
the mitigations for like Spectre and
Meltdown and there's kind of almost two
use cases of computers, right? There's
computers where you care about the use
like user being in a sandbox and
computers where you just don't like you
don't care if everything just has
kernel. So if you don't care where
everything just says kernel like yeah
you don't want I amus and stuff but
um yeah
uh so I don't know maybe the other
interesting thing that I wanted to look
at for tentor and I think we found it
yesterday. So, one of the things that I
really like that I think they did a good
job of is not So, if you read the
RDNA3 manual,
um, where's the picture I'm looking
for? So, they have this thing called the
ultrathreaded dispatch processor. It's
unclear exactly what this even is. Um, I
also think that this might be where the
bug is on RDNA3 because you hit weird
race conditions sometime and I don't
really think they're in the firmware.
There's some like weird configuration
registers for this thing, but this just
does not have to
exist. You have you have very flexible
cores that are capable of directing
their own uh that should be capable of
directing their own like of deciding
what to run. the cores should be popping
off the queue themselves. You shouldn't
have something that looks like an ultra
threaded dispatch processor. Uh so I I
think that this is a mistake in GPU
architecture and it's nice to see it
fixed in Tenstor. So let's look at what
their replacement is.
Yeah, multi-tenant VM is is it's again
this is what I mean like there's a whole
different Sure. If you're running some
Yeah, I'm giving people like a tiny VPS
to host their their WordPress blog on.
Sure. Yeah, this stuff matters. But if
you're running a compute training job
across 10,000 computers, you don't care
about why would I want an
IOMMU? I control those 10,000 computers.
It's I guess you can think about the
scale of jobs, right? The scale of jobs
for computers. And there's some jobs
that need like 1/100th of a computer and
there's some jobs that need 10,000
computers. And the ones that are 10,000
computers, obviously you don't need an
OMU, but the ones that are 1/100th of a
computer, yeah, like stuff like that
matters.
This should all just be like maybe as
you want
somewhere. Meditation, meditation,
meditation.
Um, oh yeah, we were looking for the
So I think this is like the base code
that runs. I'm not sure which one does
the maybe the B-
risk. Are there any docks on the
firmware?
should just
talk. There's also two things they call
firmware. Power management.
We're looking for something that like
reads from a
mailbox and then like okay this one's
going to trigger the tris.
Yeah. You watch like like people hitting
like Rowhammer from JavaScript and
you're like that's
hopeless.
Um I don't know. I think it'll always be
a cat and mouse game. I'm not sure this
is ever going to be
like solved one way. That's a deep
question about cryptography, right? Is
is is asymmetric cryptography
possible? I don't know. It's so cool how
like math looks like a mandelro set
where you continue to get complexity as
you dive down.
Okay, that's
good. Wait, what? There's a dispatcher
core. Work through the entire launch of
a single kernel. Is there a dispatcher
core off of the 106 processor or do the
106 processors launch their own
kernel each command Q is serviced.
Oh, otherwise idle Ethernet tile. All
right. So maybe that's what e-risk
is or
ncrisk. I want faster 03. I will pay you
money for
it. Maybe you should run it on a 10
sworn
chip. Um, Cereabus really is the right
architecture for that though. That is a
like I I do think Sarabus has an
interesting
uh interesting niche carved out that I
think and Grock just looks like bad.
It's
not Grock has no real advantages over
just using Nvidia without the DRAM as
far as I know. But uh Capus actually
has hopefully much lower cost to move
data across that
wafer.
Um, oh, Sarah's a very interesting
company. Uh, so they might be able to do
something like build faster 03, but now
you don't even know. You don't even know
how many of these things are hitting
microservices in the back end, right?
This is hitting the web search service
microser. And once you've adopted a
microser architecture, oh, you're just
begging for things to be slow.
I mean, this is actually less uh this
still kind of does look like a GPU uh
with respect to like that code running
in the Ethernet tile is similar to like
the mech on AMD GPUs.
toggles the go done bits.
But so this
actually
what copy kernel text into each tiles
L1. Oh, but this must be done with a
broadcast. The knock does have like cool
broadcasting
stuff. Uh so this thing broadcasts uh
that makes
sense. Yeah.
Yeah, you can even like I believe map
the broadcast stuff on the um that's
another like really cool thing that GPUs
lack. GPUs do not have a good way for
cores to access other cores memory and
then
they like the command processors have
some amount of granularity with how I
schedule things but this whole story in
GPUs is very muddy. You probably can use
them like this but just most people
don't. I think that like some of the
Deepseek stuff was was pushing Nvidia to
do it. They've been moving in this
direction of like longunning kernels,
but I don't even know the whole story of
like, okay, so I dispatch a kernel to a
few cores. Can I somehow kill just those
cores? I don't
know. We'll get there. Um, e-risk is
embedded risk.
Does it control the
fan? When we ask JBT where the fan is
controlled
Um, but how do I do that with Deep
Wiki? Is it that it's pretty good? Deep
Wiki is pretty good.
[Music]
Uh, you know, another thing I I do use
LLMs a lot more in my real life than uh
than Google. I I I don't know how you
guys feel about this like new paradigm
of the stream. You're just kind of like
watching me use LLMs.
Wait, what? 10 torren is not open. It's
not open source. It's open
source.
Really? No, I don't believe this.
Didn't know about that.
I like how I don't have to log into this
too.
Really? Okay.
Still
running user kernel risk K.
God. That's what I mean. Like LM will
just casually lie to you and people will
just accept that as truth. Like is it
lying there or is it lying there?
Honestly, I don't know.
Google lies
less. I mean, fortunately, we haven't
descended into a total LLM shit hole
yet. We will, but you can still usually
believe that some text you're going to
find on Google was human written. And
like humans lie, but usually when
stuff's wrong that's human written, it's
either for one of two reasons. It's
either it used to be true and it's not
true anymore, which is very common in
documentation for stuff, or two, uh,
it's some kind of like motivated
reasoning, right? Like the human is
trying to tell you something like, you
know, whenever you read, I'm sure you
could go to like Papa John's website and
it will tell you it's the best pizza in
North America. And that's like obviously
a lie. Poppy Johns are disgusting, but
um that's just because someone's trying
to convince you of something.
LLMs just casually lie because they have
no real awareness of their own
confidence. And like why would they?
It's a autocomplete. And they'll get
better at this. They'll get better at
this once they're sufficiently punished
for lying.
They'll get better at
lying. All right, be right back. And I
think we're going to wrap up this
stream. I don't know what you want me to
do and go further.
Um. All right. So,
uh Oh, I know. I know you guys like when
I use Vim for
this. Advice to Tan's dorrrenant.
Okay. If you want to
get acquired slashbecome scam IP
licensing co
uh I can't help
you if you want to
win AI compute read
on. All right. So, let's start
there.
[Music]
Uh, this is your seventh
stack.
Uh, please, bro, one more stack. This
stack will be good. I promise, bro.
Please, bro. Bro, please. One more. One
more. Make
it all
back. One
trade. Bro, bro, bro, please. One more.
Made it all. Make it all back one trade.
You know that make it all back one trade
energy. Yeah. Make it all back one trade
type beat.
Um, you can't build a
castle on
a shit swamp.
Yeah. Uh, you can't build a castle on a
shit
swamp. That
that as long as you still have things
that look like SFPU LU as a as a LLK,
uh, LLK is the wrong
approach. Okay.
Um yeah
uh tens
torrent
advantage is
in more program ability with respect to
GPUs.
Uh hardware
shapes model
arch. The hardware of the world today
shapes the kind of models that we run.
Um, if you don't expose that
programmability, you are guaranteed to
lose. Now, what do I mean by expose that
programmability? You can make an
argument, but but but it's all open
source. Yeah. Okay. I love to I love to
throw this I love to throw this argument
in people's face all the time. I love to
uh love to say this when someone's like
like I have a Mahindra Scorpio and I
want to use it with comma AI and I'm
like the code's open source bro go
figure it out. Um, and you know, you can
always like throw that in people's
faces, but in
reality, you're going to get what you
what you
like. There's like
a if you've maintained enough open
source projects in your life, you
realize that there's the kind of things
contributors are going to do and the
kind of things contributors are not
going to do. Um, contributors will often
if they're hitting a bug, uh, some
percent of people, maybe one in 10
people who hits a bug with your library
is going to put in the effort to
upstream a fix for that bug. Um, that
person's probably a very good engineer
and that person realizes that if we can
upstream the fix from the bug, this is
something that I don't have to maintain.
Uh, and this is why like I don't think
that you necessarily need GPL to to have
successful open- source
ecosystems. It's very advantageous for a
company to upstream something because
now
the especially if you upstream something
with good tests because now the
maintainers of that open source project
will maintain your use case
practically. Um, so you might get bug
fixes from good engineers. Uh you might
get features. Uh there's a kind of
people out there who just like they want
to write some feature. Oh, I'm going to
add some feature to some open source
thing. You know, some of them use do
that because they want to. Some of them
do that because it's fun. Uh the quality
of these
uh contributions is usually less. There
are some good people who do features
too. Um there are some people who get
like nerd sniped by a feature. These
ones are usually very high quality.
um you know the people who just are just
like like they see the problem and
they're just like drawn to it and they
they got to contribute.
Uh but what you're not going to get is
refactors. No open-source people are
going to build an alternative stack for
Tenstor. Now you're like George, but you
built an alternative stack for AMD.
Yeah, and AMD is the right choice to do
that on.
um an alternative stack for
AMD. AMD looks like Nvidia but is more
open- source. The other advantage to AMD
over Nvidia is Nvidia's code's actually
very good. Um us targeting AMD, it's
like targeting Nvidia, but it might
actually be useful to somebody. I mean,
the real thing that Tiny is doing is
speed on AMD is great. We can beat AMD
shit, but no, the the holy grail is
beating Nvidia. the holy grail is
beating Nvidia on their own hardware and
then at that point you're ready to make
your own hardware.
Um, you might get
some contributor like like just the
scope of this project is too large to
have somebody come in and fix things
like
SFPI_LU. And if you don't see if you
don't see
SFPI_LU, SFPILU is a
problem. If you don't see that as a
problem,
um I I I
mean it's just like you have to rethink
how you're doing this whole thing
because the the choice made in
SFPILU propagates up your entire shit
stack, right? It propagates up all the
way to are you managing to tie the
pietor torch LU through stable HLL
through MLIR through TTNN through TT
Metalium all the way down to LLK like
are you are you passing that through
seamlessly six five six layers of
abstraction this just isn't the way to
do
this So,
um, if you
want a dataf flow graph compiler, build
a dataf flow graph
compiler.
This is not six layers of abstraction.
It's
three. Okay, you have three basic layers
of
extraction. You have one which is your
front end, right? Your front end can be
PyTorch, can be onyx, can be tensor.py
and tiny, right?
You have your compiler and you have your
runtime runtime runtime includes you
know runtime driver right it's three
layers of
abstraction ml stable HLL TTNN LLK none
of this shit should
exist you got to do
this but but But it's hard. Yeah, I know
it's hard, but you're never going to win
the other way. The other way is
guaranteed to lose. This way, you might
win. And again, if you want to get
acquired or become a scam IP licensing
company, I can't help you. But if you
want to win AI compute, you're going to
have to build
this. And you're not going to be able to
do this with TTN
uh TTorch,
TTorch_N 2.0, TT Forge. Just use one
more Docker image, bro. just use this
Docker image. Come on, man. Come on.
This one's good. Come on. Like, this
doesn't work. Okay. And this is very
distinct from how AMD
succeeded. They haven't succeeded yet.
But AMD has come a long way by copying
Nvidia.
Exactly. AMD didn't didn't use this
stuff. They just copied
Nvidia and they copied they got AMD
support into Triton. And the reason that
they get this luxury and tensor torrent
does not is that AMD and Nvidia are
pretty much the same chip. You look at
the new tensor course on RDNA4, they are
exact ripoffs of the Nvidia tensor
course, right? When you're building a
chip that's basically an exact copy of
the
chip.
Uh great, you can take that approach.
Tenstor can't because again tenstor's
advantage is in more programmability
with respect to
GPUs hardware shapes model arch um you
aren't going to get
better deals on
tapeouts IP than Nvidia
AMD you
need some
advantage. Uh yeah, and like mid-tier
LLMs is is not going to is not going to
work. Okay,
so and
only two you have to build.
So now let's talk about where things
are. Um let's talk about three. All
right, start with
three. The driver is
fine. That that the stub driver and the
kernel totally fine. Leave it completely
alone. Uh the next layer is where you
end up in a in a befuddled mess. So
there's this thing called
uh TT Metal. Okay, here's TT
Metal. Uh, TT Metal is not TT Metal. TT
Metal is TT
Metal. Uh, and then it has this thing
called TTNN in here as well, which has
like IPython notebook tutorials in it.
And no, no, this is this is the
wrong these are the wrong abstraction
layers. The runtime should just be a
runtime, right? I
better never see mention of an
LU.
Like an LU is a neural network op
invented by some grad student in
2013. Why is this in your runtime for
your hardware? CUDA came out. CUDA
doesn't have
LU. Maybe they added LU as a very high
layer of abstraction to CUDA, but there
sure as hell ain't an LU in
PTX. Right. Make the runtime expose
hardware in a
uh what's it?
Application agnostic way. This is not
easy but you have to do
it.
Okay. This is not what TT metalium is.
As long as
LLK as long as LLK sits
under TT
metallium, you aren't doing this.
As long as something that mentions LU is
in your runtime, you aren't doing
this. Okay. Now for
two. Um,
so tiny is
this, but you
don't have to use
it.
Uh I mean
I'm
like MLIR LLVM is probably
fine. I don't exactly know to the level
that they are flexible. They're written
in C++. I'm less familiar with them. But
this is this is okay.
Now,
uh, LU still should not be
here. This should be
um should deal with memory placement.
Uh this should deal with op
scheduling. Uh this should deal with
kernel
fusion not
lu
right now for one.
Okay. x.lu LU needs to have
same PF
as we'll get the one from
ground.
Okay. If it doesn't, you messed up.
Once only
once it
does are you
ready to write
lu
hint All
right for
how to write Lu
hint is not a hint. It's the actual
code. There's no getting out of doing
the hard work.
There's no getting out
of
compilation,
[Music]
dispatch, queuing,
etc.
CUDA is a simple C
API for this. I advise
doing the same.
This is not easy,
but
importing six packages of Croft
doesn't abstraction
layers of Croft doesn't fix that.
Okay. What happened to the pro the black
hole card? I put it in the other room. I
put it in the other
galaxy. Uh, hey.
Um, where's my TT
tiny
We'll push it
here. Ah, no.
Okay.
Yeah. if I improved Tenstor as I did
AMD. I mean, it's it's very hard to
prove ever about the AMD thing that I
was in any way a butt for a cause.
Like, AMD So, here's a fact. AMD clearly
improved in the last two years. AMD went
from unusable garbage that was hard to
install, that was crashing my system, to
we actually ran
HLBC10 and it just worked. It took a
while to compile, but it just worked.
Um, so something clearly improved AMD in
two years. Was it me? Probably not. I
don't know. I mean, this this comes to
like any kind of historical attribution
like great man causes and forces. I
don't
know. So, uh, you know, I can't take
credit for that. Um, the same way as if
Ten's Torrent uh, improves things in the
next two years, it's not because of me,
right? Like it's not um I don't know. I
don't know if I do anything at all. Like
I don't really but again I don't really
do this with like outcomes in mind. I do
this because it's like shit man. What
else am I going to do? You know what
else? What else are you going to do to
keep the boredom
away? You know, you know, you keep the
demons away by like feeling like you
have a little purpose in life. You wake
up, you have your little a little
purpose. So,
um I mean, yeah, but like I don't know.
They knew it was bad. It's hard to say,
but so there there's there's my advice
to Torrent.
Um, no. I mean, look, also let's not
give them too much praise. They still
have a long way to go.
But the copy and video strategy has
actually seemed to work out for them.
Um, they made it they made it work and I
don't know, maybe they like knew this
all along. Kind of worked, right? All
right. Uh,
uh, first ship will be bad. I mean,
yeah, the first ship will be bad, but
there's ways it'll be bad, and there's
ways it won't be bad. We'll build it on
FPGAAS first. I have the whole road map
in my head. It just unfortunately it's
like going to take a really long time
and like oh you know I go back to work
tomorrow and what am I doing at work
tomorrow? Well, I got to figure out why
the I got to deal with the fact that you
can't put views in the kernel because
you can't convert views into movement
ops. So I'm just going to cache what
movement ops created the views. But then
there's a bunch of subtle edge cases
there.
Um
yeah. Uh so yeah. No, it'll be bad and
understandable. I don't know. I don't
know. I also don't know like like the
the the I would never tape out a $40
million chip unless like the software
was done. But that's just me and maybe
that's like why I lose at this. So
uh am I going to do from the transistor
before making the FPGA chip? No, I'm
never actually going to do from the
transistor. I realized that I used to
believe that education was possible and
now I kind of just don't.
Um, will Triton be the new standard to
writing
kernels? Yeah, I mean there's definitely
some interesting things about Triton and
there's some things that it gets right.
Uh, I think that Facebook's chip is
targeting Triton. Uh, which is quite
smart. Like they're just making
something that's going to have a Triton
thing out of the
box. Um, and also realizing that like
Facebook's targeting it too gives you
faith for the long-term supportability
of Triton. Um, it's a shame that
Facebook doesn't want to sell their
accelerator. Uh, I think that they
should, but
um, that's not why I hate C++. And
there's way worse languages in C++, too.
I My main complaint is that there's
Python has the there's one way to do it
philosophy. C++ has the there's 10 ways
to do it. Two of them are wrong. Three
of them are okay. Four of them are good.
And then there's one that's great, but
you'll never figure it out because
you're not
Bernstrap. Uh, Mojo is doing better than
you. Give
credit. I'm not I mean, I've tried to
use Mojo. It's not all open source. They
have a lot of similar ideas to us. I'll
wait till it's fully open source and
then I'll go through Mojo. Um, but yeah,
no, I mean, look, they have a lot of
similar ideas. Like I said, this isn't
self-driving cars where everyone was
idiots, right? Self-driving cars was
just a room chalk full of idiots
clamoring for who could be the big
bigger idiot. The machine learning
compiler space is like smart people
with some technical disagreements and
may the best compiler
win. Like now we have a mojo is so
fucking bad unfortunately. Like I don't
know. I think that it has I think that
there's a reason it hasn't taken over
yet. I think that it has tradeoffs. Uh
in the same way Tiny Grat has
trade-offs. We'll allow Mojo doing
better than you just so we don't
discriminate here.
Share memory parallelism to Gail. I
don't know if this stuff matters so
much. Who is Mojo? The new Julia
Lang. That's good. That's good.
I'm saying such a smart person go for
Swift for ML. I don't know. Do you
remember Ghost
Autonomy? No, guys. They're the serious
comma. Oh, man. No. that founders fund
partner who invested in ghost autonomy.
He actually had a quote and I tried to
find it where he's like they're the
serious comma. Yeah. Serious about
raising 10x more money than comma and
returning zero to the investors. What
clowns? They copied all our rhetoric.
What complete
clowns? Um this is what I mean. Like
self-driving cars was a room full of
idiots.
Like oh I'm so happy to be in the ML
compiler space. You know what's so
what's that
XKCD?
Um two papers
nobody found
out. No physics thrown out of room.
Before
before exposed as phony by major.
there. All right. All right. Let's bring
out the big gun.
Uh, founders fund is usually good.
Founders fund is usually good. For the
most part, I like founders fund. I just
think that
like they didn't like my valuation
originally for comma. They did not like
my 20 three on 20 million. So, we went
with A16Z. That's the
truth. I pitched two VZs. I pitched A6Z
and Founders Fund. Founders Fund didn't
like they thought I was asking for too
much and I'm like,
"Okay, Xai." Is this like
a I feel like I've seen this before. I
don't
know. Oh, impostor. There we go. That
got
it. Ah, yes.
So, I mean, this is this is the thing
about working in the ML compiler space
is it's actually pretty easy to tell if
uh somebody's a clown or not. Like, you
can tell pretty quickly. the
self-driving car space for some reason
just entertained all these people who
like didn't know anything about anything
but like you know just like well so yeah
we're going to write the software and
it's going to drive the cars and we're
going to use lidar and it's going to
like have you seen a lidar it can just
see everything man but what about being
able to process it well yeah we'll hire
like some software engineering guys and
they'll write the code to process it I
want to focus on the branding and I want
to focus on making sure that This is an
inclusive experience where where we can
we can really make a car that's that's
inclusive to every like like this was a
real thing that somebody spent money
on. Let's make half the seats face the
wrong way and design the shittiest bus
you've ever This is a real thing that
billions of dollars was spent
on. I I I can't get over the level of
stupidity of these people like like like
I I look here I'm I'm sitting here
criticizing like like tens to like you
know parts of tens torrent stack I don't
know you can argue tradeoffs maybe
George you know yeah that'd be great but
this is going to get us the market
faster blah blah blah blah blah like you
you can you can make arguments you could
imagine a smart person justifying all of
Ten's Torren's decision I could imagine
sitting down with a smart person and
like the end of two hours be like, you
know, I might not totally agree with
you, but I respect your perspective and
I see how you're going to like do it
that way. That's actually like sensible.
Like like you went through like a, you
know, okay, okay, you did this. I think
this, but okay. Like we can we can or
maybe I'd even be convinced. Like I'm
not even so close-minded to think this
is just utterly moronic
bullshit. Who let these people in the
room? Well, you see, half the seats are
going to face backwards because cuz you
know what? I love accelerating while I'm
facing backwards. You get lurched
forward in your seat like this. Oh, it's
a great experience. And the other thing
I love is riding in cars with strangers.
Man, it's so great. Don't you just love
when you sit down and there's another
person who's a stranger in the same car
as you? Isn't that just a lovely
experience? We're gonna like I the the
level this is this is wokeism level of
moron like like like and then like the
wokeism people like wokeism is a whole
another thing where it's like no you are
just so factually incorrect and so
blinded by
ideology. So I I just I can't believe
this right and this company is bankrupt.
This company cost GM8 billion dollars
and you know good riddens, right? Like
the level
of those are real people who sat down
for that
advertisement. Like GM GM hired people
to to sit there and like like nobody I
don't know if the photographer was in
the room. He's like this shit's the
future of transportation.
this
shit. You just you just
can't. And and self-driving cars was so
full of of of idiots like this,
right, Zuks? Let's make a car that's
like totally symmetrical, dude. That's
like groovy, man. Because we all know
that like cars don't like clearly mostly
travel in one direction. No, like this
car will be able to like go the same way
backwards and forwards, man. We've
really optimized the shit out of that 10
seconds of pulling out of your driveway,
but like what about when you're on the
highway and like, you know, it's really
nice to have like a front and back
shaped differently. Yeah, man. But no,
no. Have you thought about this? It's
going to be like four like wheel motors.
We're going to put motors in the wheels
and you're going to be able to like like
but what about like unsprung weight on
your tires and like it's actually much
better to just have one motor and then
make your tire as light as possible so
that the car the suspension's easier to
build. No, man. No, you're not
understanding my vision. Okay. Okay. You
just you don't understand my vision.
It's going to have like it's going to be
symmetrical, man.
I I I
I it's it's it's
it's I I don't
know. I don't
know. Like, there's no adults in the
room. There there's clearly no adults in
the
room. No, these people already went on
an Iaska trip and shot their brains and
made this
And like this is all funny if it wasn't
costing the world billions of
dollars. I just I just can't I can't get
over
this.
Um burning I I then Yeah, that's what I
mean. So, so you know, bringing this
back on topic, my advice to tends to if
you want to get acquired and it become a
scam IP licensing co and you just want
to like pack the halls with developers.
Oh, look at all these things we got
going on. Check out my number of repos,
man. We got a lot of repos. That's a lot
of code. You know how many kocks that
is, man? That's a lot of klocks. If
you're optimizing for kocks, but I don't
think tenstor's like that. I think like
I think that it's just hard. And I mean,
I find myself doing this all the time.
Everybody finds themselves doing this
when there's a hard part of the problem.
Instead of owning up to the hard part of
the problem, you're just like, "Well,
yeah, but let me you do this other non
whatever idea first." You know, that's
like a Todd quote, right?
Um, why would you just just you want to
make a you want you want to see us just
doing everything right and self-driving?
Look at Tesla, right? Like, this isn't
even hard. No, but Elon's a Nazi. I saw
him go like this. Well, now you've seen
me go like this, too. You know, go
ahead, post that on Tik Tok with the
caption, George Hots is a Nazi, and see
if that shit sticks. You
[Laughter]
know, I really, you know, you really I
really want to dive into someone's mind
who thinks that. It's kind of like, do
they think that he's Oh, he's he did the
secret hand signal to salute the secret
Nazis who live in an underground bunker.
So, they dead, man. Some of them are in
Argentina. Um, you can call him
[Laughter]
Bernie. You missed him. I do it again
now. One time. One time
only. Don't worry. The secret Nazis in
the bunkers got the uh got the got the
uh got the message,
man. Reminds me of the Dean
Scream. Yeah, they chilling with Helen
Keller's down there, too. No, shit.
Shit. Shit. Who? Amelia Heheart. Not
Helen Keller. She was fake.
Um, Amelia Airheart. All
right. I think about three billion for
wind
surf. I don't even know what it is.
Whose money was it? Who did it go to?
What kind of circle economy is
[Music]
this? I think we didn't do enough
meditation this morning. Too keed up for
this. I thought about the cruise
origin Somalia.
I lost that debate. I lost that debate.
I don't think I did well in the Ukowski
debate either. I'm not that good at
debates.
Um I don't know. Maybe I could like
practice with some LLMs, get
better, tiny financial, how are we doing
financially as a company? Or do you want
us to pivot to high frequency trading? I
mean, we have a lot of GPU. Should we
just pivot to high frequency trading,
guys? It's a zero- sum game and it sucks
the wealth out of society. But we could
get rich. Think about it. Think about
it. Oh, I like what you're thinking
there. What do you say about that part?
The we could get rich part. Oh, I like
that
part. Inverse deepseek. That's right.
Let's just open AI should just just pull
the inverse deepseek. Just do high
frequency
trading. Sorry. 05 is not released. We
use it for high frequency
trading. Yeah. Yeah. No, I don't know.
The yet debate's like painful of me to
watch. Like I I was really I like really
tried to practice for it and I someone
described my tactic as like gish
galloping. Uh I'd never heard this term
before, but I'm like, "Wow, they're
totally right." I don't know.
I'm not the best at like sometimes
I'm trying to express an idea and I
think it's coherent in my head but I
don't really know how to turn it into
words but maybe that just means it was
never coherent in my head to begin
with. I don't
know if you training exist in this
[Laughter]
room. I think you assume other people
know exactly what you mean. Yeah, cuz I
don't know what they don't know. It's
easier for me when like I could ask them
questions,
but yeah. Yeah. Yeah. Yeah. Yeah. Wow.
Let's work on this.
Like, all right. Thank you for watching
today's stream, everybody.
[Music]
Um, I I want to see a beautiful C
runtime a graph compiler with a great
dialect, but you have to if selfle
doesn't have the same performance as
this, you're doing something wrong. And
this is true to everybody who's writing
a any kind of
um any kind of ML compiler, right? Yeah.
needs to have the same perf as
that. Um, well, good. I'm glad I
convinced somebody
uh host somebody. Well, let's see. Let's
see if if is Lana Deluxe is Lana is Lana
Lux streaming today. Let's see who's
who's streaming right
now. No Lana
Lux.
Jonathan
streaming.
Um, no. Wow. Gemini plays Pokemon.
Doesn't have a lot of We could watch
Claude play
Pokemon. Claude has more
views. Should we raid Claude plays
Pokemon? See how it's
doing. Is it playing a normal Pokemon?
Pokemon Red and Blue. All right, sweet.
All right, Claude 4. All
right.
Um, can I raid this one?
Oh, okay. So, I have to paste in my own.
Yeah, don't kill people. I think that's
hopefully
uh everyone
knows. That used to be my sign off, but
all right, go watch Claude plays
Pokemon. Thank you for watching today's
stream. I appreciate all of you. Uh
look, I just want you to think about
your life and think about ways in your
life that you're playing zero sum games.
And if you could even take one little
step to play a little bit less of a
zero- sum game, it makes the world a
little bit of a better place. And if
everybody just woke up every day and
made the world a little bit better, then
we would live in a better world.
And I will never lose hope because I
watched this movie once. It's called
Galaxy Quest. And you know what they say
in Galaxy Quest? Never give up. Never
surrender. Happy Sunday everybody.
good morning everybody let me just turn
this off make sure
streaming yeah we're
good
cool uh what do I want here that one
okay we have a stream chat
guess what we bought
today if you read the title you know but
we bought a Kens Tor
E350 you guys good thing you subscribe
to my stream that's how we afforded the
$800 to buy this it was $800 and it's
not going to deliver us $800 of value we
already know that uh but you know we
bought it to support the cause uh we're
drinking high ball energy this is like
these are these are discontinued and it
tastes discontinued and do like not a
good
thing but we're still drinking in high
ball energy we got a 10 t 350 it comes
with a blower duct
assembly and uh we're going to try to
put it in the computer and we're going
to see if that works and I don't know
man might work it might not work but
we're doing it live right here on George
hot stream um look I know I haven't
streamed in a while look a lot of a lot
of a lot of shit's been happening in my
life man no it's not really true
nothing's been happening except for
shipping tiny boxes except for shipping
tiny boxes uh you know I've been putting
in a lot of work
um to deliver tiny boxes uh to the
people is The Voice Low oh yeah the
voice is kind of low let me let me let
me uh Crank That Crank That Crank that
all right is that
good you can probably go in here and
crank in
more
sound crank that oh we are on the wrong
microphone we on the wrong
microphone I don't know
properties Yeti
X all right well that's what you get so
that's the
voice uh yeah we got we got lots of we
got lots of tiny
boxes uh we could just like go over here
and you can like check out tiny 12 uh so
this is Tiny 12 it's a tiny
box um I can show you like
like
look at this
boys oh you can't see any of that look
at this look at this look at this
Communications Matrix bidirectional copy
Peak bandwidth been talking to AT&T
again sorry not AT&T AT&T genuinely are
some of the worst uh people in the world
I'm talking about amd who's actually
pretty nice you know what I will say
this about AMD they are in a lot live
company um Lisa Sue is alive right Su
Pai
Dead uh Jensen alive Lisa alive right
like like like you could just tell
quickly interacting with a company
Qualcomm I don't even know who the
fucking qualcom CEO is I've emailed him
10 times do he reply to me no you know
you're a dead company bro and it's sad
qualcomm's real sad but don't get me
started on Qualcomm again uh I believe
like AMD can can own the future um um
I'm I'm very uh bullish if they if they
uh you know if they go through with what
they said they're going to go through
with but I've seen a lot of positive
steps and that's why the tiny box has
six AMD gpus in it uh these are these
are AMD gpus uh so you know we're
bullish on AMD uh medium on Qualcomm I
mean look they make a great chip but
they uh they suck and we are so bearish
on AT&T and like it's just you know AT&T
is Boeing tier boys Boeing
tier um but we're not here to talk about
any of those companies here today we're
here to talk about tense torrent uh so
tense torrent uh has been taken over by
one Jim Keller the most famous uh
computer architect uh living computer
architect uh he created like every the
AMD 64 the Apple M chip
or the predecessor to the Apple M chips
uh the Tesla FSD chip and now he's at T
so you know we like to support the cause
um he also open sourced a lot of code so
you know we uh that's that's who we
support right if you want to be like
like cabus look I like cabus too but
they haven't open sourced anything so
when cabus agrees to be open source and
sell me a sell me a wafer s me a wafer a
wafer that comes in a box that'd be
cool no no no no they didn't ship a card
whoa whoa I don't fuck with that kind of
shit man if it's like we have one
special card for you I'm like no fuck
off anyone who wants can buy a 10 stor
card right here just click add to card
they'll ship it to you right you think I
would not spend a minute of this stream
if this was something special that I had
that you couldn't buy you can spend your
own $800 and buy one of
these um not in the M series but the A4
of course he
was
um I saw the Truffle like
look things like
that it's an overpriced Appliance right
you're much better off for the same
dollars buying a gaming PC but if you
don't feel comfortable like if you don't
feel comfortable installing your own
Linux maybe truffle will be good but
it's an appliance it's not uh it's it's
it's it's it's it's as dumb as like the
rabbit thing like don't buy these things
right like like they what what you get
sold is like oh you know what it is you
ever see there's a great uh
YouTube thing that tears apart MMO
RPGs uh and people will buy into like
MMO RPG pre-orders because they want to
be part of a community and they think
that the MMO RPG is going to somehow
improve their life and I really regret
like there's a lot of people who saw my
Lex and thought like the Tiny Box was
going to be like a personal firewall
your house like it's not it's not okay
the the the the Comm is not a
self-driving car it's a driver
assistance system and the Tiny Box is
not a firewall for your house it's a
budget AI training computer it's just
about the best flops you can buy per
dollar but if you don't understand what
flops are the tiny box is not for
you um no the Tiny Box oh the Truffle
dude the Truffle don't even I'm not even
going to go into it okay it's literally
the Nvidia Orin in a plastic case okay
like
like um is there anything else with
similar RAM and bandwidth for that price
so yeah it's I
mean okay you like the high Ram right
here I'll show you if you guys don't
know
about right like the the these are the
um the Orin Dev
kits I don't know why you can't type
Orin
which which how much round does it have
which one is
it it's one of
these wait it has
64 all right fine we'll look at the
Truffle that cuz all right fine fine
fine fine truffle AI computer
shit
Invidia or GPI
GPO
huh okay maybe it's actually a better
deal than the Nvidia
one I take it back that's actually what
it competes
with
um how much is
this okay never
mind and nvidia's nvidia's scamming is
is too high
uh so yeah um no but if you're looking
forward to how much RAM bandwidth does
it
have 200 gigabytes per second I mean
this is on par with a uh an AMD
epic I don't know how they're getting
that price okay it's less of a scam than
I thought I I thought it was just a
plastic case around something that cost
like $7.99 but I didn't realize how much
Nvidia was scamming so so
whatever uh what like
how um all
right but yeah like like you you might
have a good experience with this if if
you're looking if you're the kind of
person who likes oama you might like
truffle
um like this isn't what Tiny Box is at
all
but I think that what happens like with
a lot of devices like that is like you
buy one and like like you think you're
going to use it but you
don't um you're much better off at that
price point it's true you're not going
to get 64 gigs of RAM but you're much
better off at that price point buying a
gaming
GPO uh I don't know but I guess if
people want the high RAM for
llms um I mean it's interesting llms are
interesting like that where like it's
not really the flops matter a lot less
than the ram
bandwidth
um of course uh you seen
ours
5.76 terabytes per second now to be fair
that's not full fabric right uh so
that's each GPU has I just added the
ramp balance up and you can access
things that fast you can't access
anything that fast so that's just how
Ram Works gddr 7 coming in hot let's go
wait so I was talking last night and I
heard that there just might not be 509s
right think about it you're
Nvidia and you have two products one
that makes 30% margins and sells to
Gamers who you got to deal with versus
the other that makes 90% margins and
sells to corporate ass people look which
one are you going to manufacture if you
have limited capacity on your line which
tsmc does
are you going to manufacture the 590 or
are you going to make more
h100s um yeah we are trying to push AMD
uh I had another phone call with them
yesterday look like again they're a big
company you you have to you have to give
them some uh allowance for that but
they
like you know they're they're they're
they're trying and they're not like
they're they're trying well they're not
like I don't mean that like they're
trying like oh they're trying I mean
like they're trying um you know they
obviously don't want there to be bugs in
the driver either and I think we can we
can get to a better place together
uh yeah if they Embrace open source
they'll take the lead completely
completely the idea that these companies
don't Embrace open source for some
reason it's it's it's like a backwards
way of thinking um and I don't mean this
again I don't mean mean this in like a
progressive shame like that's a
backwards way of thinking how could you
how could you say that there should be
slavery you know um I don't know man you
know you got to think of the pros and
cons right that's why we got to make
machine slaves and that brings us to our
stream today which is the 10 torr E350
let's open the box all right so I'm
going to I'm going to nudge this down a
little bit and you're going to watch me
on the floor trying to plug this into
the computer okay comes in a white box
they list on the back they patents weak
weak weak what's in the box let's see
what's in the
box okay comes with this little
card um oh it comes with some
stickers all right little envel opy
thing here little envelope thing some
stickers all right all right comes with
a piece
of let's make this a real unboxing video
comes with a piece of
foam oh and then in the box we have a t
torent card all right what do we think
has a hole for a 10 story
card sorry that wasn't very ASMR of me
look at just 10 story
card
um but yeah know we're we're bullish on
AMD and there's going to be an
announcement they told me there's going
to be an announcement in a week or two
you guys will see um we're we're bullish
on
AMD we'll see if they actually come
through with the announcement but for
the most part when they say they're
going to do something they do it which
uh you know I can respect they're not
Liars they're not liars and I'll say
this too in all my interactions with
with them sometimes I'll interact with
people and they yeah they lie they lie
because like I haven't found that at all
with
them um they've been they've been
straightforward about
everything uh you know again everyone's
not going to do exactly what you want
all the time um but uh yeah they they
you know that's that's when when someone
starts lying to me that's when I get
very upset um when when you start hear
like you know I could talk about some
interactions with some companies where
they're just they're just
liars um and let's tell about lying too
here's the thing about lying when
someone lies to
you they're lying to themselves you
can't just lie to other people if you're
a liar if you're someone who frequently
lies you no longer have a coherent World
model you no longer have you know what
the old saying it's like it's it's so
much easier to uh to to just keep the
facts straight if you just tell the
truth right
um yeah so they they lie to themselves
the organization when a sales person
lies to you the whole organization's
just full of
lies um and I haven't found out
with here we go and here's a TENS
torrent Mega blower fan okay uh did it
come with screws how do
I how do I stick this on here this is
also not going to fit in my
computer wait what the
hell did I misunderstand
something are there
screws how do I stick this on
here like I see what it's supposed to
do oh oh this screws hang on hang
on put this camera back
down
all right full screen
got okay so we have our 10 torn
card and we have a blower fan duck
thing and in here we have some
screws but wait is this going to fit in
my computer if I put that thing on the
back I I see what it's supposed to
do how am I supposed to screw that in
though there's no way this is going to
fit in my computer okay let's let's
unplug my
computer have Q over
here it's a normal gaming shit
computer uh I maybe it'll
fit I'll move back a little so you guys
can see I clean my room just for you and
for Jordan
[Music]
Peters
is this going to fit okay so that's that
long and this guy going to go back here
and there's no way in hell that's going
to fit inside my
computer God damn
it look at this
thing
did T Tor think about
this what am I supposed to
do we could go
fanless all right well let's take
out have an old I have an old AMD card
take screwdriver
too where's the
screwdriver maybe there's one in this
closet
screwdriver oh no tell me I don't have a
screwdriver we did not prepare boys we
did not prepare did you want me to
prepare before the stream is that what
you wanted
have a little Ikea tool chest here know
them Ikeas I'm about to blow a bag at
Ikea you just want the content I know
yeah you don't want me to prepare before
the stream that would have been
lame what do you prepare for
of course I got to figure out how to
push that damn PCI
thing need a
poker it'll hurt my hand doing this
we'll hurt my
hand there
we oh well we broke
it so we're taking out the Red
Devil uh this is a this is rdna 2 card
disgusting um now we love AMD guys we're
AMD fans on this channel who are we not
fans of AT&T and Bo it and the Deep
State watched a good video about the
Deep State last
night all right uh so is there any way
this is going to fit maybe maybe it
will just
barely how do I put this on came with
screws
but like am I an
idiot let's go back to the
tap oh no and it feels like this fan
doesn't have any speed control so it's
just going to be
loud so we have a
blower we have a card and it came with
three
screws but how do I put the screw
screws in here oh I probably have to
take this
apart okay
okay of course I don't have the screw
we're going to have to find more
screwdrivers I know I have more
screwdrivers I just don't know
where have like one of those like kits
for mobile phone disassembly
somewhere but I don't know
where
here have a vape in here that's pretty
cool
no go
walk
we have
some hex things in here but no it's not
going to be any of these we have to take
these screws
[Music]
out maybe we can use
pliers do it
carefully we really need to get the
right
screwdriver also is this just going to
be loud let's first check let's just
first do a loud
check cuz if it's going to be loud I
don't even want this computer's name is
literally quiet so you know loud is kind
of the opposite of what it is all right
so let's take this weird fan assembly
let's plug it into some power here let's
try the
computer how loud's it going to be
boys loud as
fuck oh wow it's a lot of air
though all right we're making an
executive
decision we're going
fanless how long will the card get I
don't know let's go fanless let's find
out 10 T I hope youe good thermal
protection I I can see the press release
on their website uh George used the card
outside of its normal specification he
thought the fan was loud and didn't put
it on it is loud okay I didn't think it
that's a
fact no no no no no no we we we we're
here to like tense torrent Jim's cool he
does the right
thing uh we're going to go through the
quality of their software in a bit but
um so far I don't know why didn't think
of this fan being used in residential
environments where I'd rather not hear
something that is stupidly loud so the
blower duct assembly is going back from
when it
came all right we're back to the
card this for you let's put the card in
the computer let's get this thing
powered on let's get this show on the
proverbial Pro proverbial Road
the cards rated for 200 Watts so I
wonder what it is at
idol it has a big heat sink like it's
going to overheat medium
right in the hole
okay the fan assembly was not user
friendly this card was clearly not
designed though in Norm people
computers .1 for
gpus all right got it in the
hole let's put some screws in
it I don't know what it tends to any 350
is either we just bought a150 is either
we just bought it for
$800 using profits from them from this
stream so I hope you all
appreciate you know what I probably
should have plugged this wire in before
I stuck that in the
wall
we have a six pin connector and an eight
pin connector now they're both connected
to my power supply fits in nicely with
my 380
ETI the side for my piece of tempered
glass back on
here you think it overheats right away I
think it's one of these cards that has
no thermal management and it just like
it throws the 200 wats
the blower fam assembly was not well
thought the I think I think it should
have uh speed
control actually I gave this feedback to
ttor while I was visiting I saw the
thing and I'm like oh really it's an
external fan and then they shipped it
with an external fan so uh yeah yeah
it didn't get
better I have this problem once with the
uh bought one of them Zeon five cards
that was meant for data
centers okay the
E 150 is inside of the computer let's
plug the computer back in we got power
we got Network and we don't need
anything else let's
go
put my tools
away let's do what the card says here
we'll go to tor.com
SLS
setup I remember early on they wanted to
give like they wanted to give me early
access to a t torent card and they were
like you have to sign a da and I was
like nope not doing that because if you
sign an NDA you can never give your real
opinion about things my opinion so far
is that the fan is too loud and too big
the fan is always too loud uh I'm on
stream also the fan is too loud and too
big and might put the 10 Tor card on my
computer without a
fan
Alex Alex
X
[Music]
Alex
domestic violence time what kind of
household do you live in man I'm sorry
you come from a broken
home uh okay so uh
lspci where's my T torrent card oh here
we go processing
accelerators uh all right let's uh uh
let's get to
work uh setup it would be nice if I knew
if it was overheating or not I can touch
it doesn't feel hot we're
good let's see what the hardware
installation says about the oh guys we
didn't use an ESD wrist
trp
all
right TT KMD this is their kernel
driver um let's check out their desired
version of it we'll add it to dkm mask
right that's pretty easy let's install
it
all right mod probe 10
Tor great uh let me see if
it's cool uh we can also do update PCI
IDs there's a chance that they added
it no oh here processing accelerators T
join in Gray skull great they added at
lspci uh okay let's uh up up the
firmware there's any issues installing
TT
flash
um detected Wormhole beable good we have
a gray skull okay cool uh firmware is
the firmware open source no the firmware
is not open source it should be why is
the firmware not open
source oh wait no also TT flash didn't
install
uh cargo the rust package manager is not
installed
great George you didn't use rust up
you're supposed to use rust up to
install
rust I haven't act up in a
while let's take a look at this what
banjo.com
why isn't that
working why do I have ban
out where's banjo coming from is my
computer of a
banjo
what is
Banjo
oh
creepy okay now we'll have cargo and
look now it's installing lvm 17 we've
moved up in the world oh I can disable
this great good fuck off data
collection don't connect to
banjo still connecting to
banjo we don't mind as long as you use
rust sometime in the future no rust all
right we have to wait while cargo
installs so we can install TT flash
while we wait let's take a look at the
firmware
what 404 not found uh oh we're not off
to a good start
here your firmware install links
broken uh fortunately I know about
GitHub but if I was a grandma who
purchased a 10 torrent
card
uh I would be in for a rough
time uh where are the releases SL
releases okay there are no releases so
why does it think there's a
release Here we can get 4.0 or here we
have new versions do we want new
versions do we want to download
4.0
[Music]
one I don't know that one seems pretty
good we might not even need to update
the firmware the firmware might be okay
I'll notice that's not the latest one
this one's actually
newer release patch
patches work around to address TT metal
issue this sucks why is this firmware
not open source Jim open source your
firmware great not in format because
that's not a real
link
is that a real
link great that is so rude that's so
rude you didn't put it in a no no no no
no no no no you didn't put it in a thing
and now I have to do
this
rude
it it's just rude to not put your thing
in a directory you
know
okay uh wait we don't even have my
card my card's not even in here I have
an
[Music]
e does this one have
it why
don't where's my e
I have to reboot the computer all right
let's try
reinstalling TT
flash now that I've installed
car but wait I don't understand I have
an
e 150 where's the
E150
where is
E150 perhaps the same you're telling me
I have to use the crappy tiny
firmware all right let's try again TT
Flash for
firmware
pack looks like you're running a very
old set of firmware it's safe to assume
that it needs an update but you should
update it using
Force that's very
sketchy also it's very sketchy that this
download didn't
work
okay let's try this
one running it says an error that the
firmware is too old you should for
all
right this is so
sketchy I think I just broke my card
let's give it a
try okay we're verifying the flash flash
complete power cycle the board a host
reboot will usually accomplish
this all
right it's my bedroom or my work room
Bros work life balance is a scam made up
by people who don't want to work hard
and if you don't want to work hard you
should have you know whatever I don't
know like this is why I can't stream
anymore like I just I'm sick of saying
that kind of
shit I'm sorry thank
you tell J the fan is too loud and too
big
no is that Trinity
yes all right come on back
you if you don't want to work hard you
get you Ubi I heard you can go to
Switzerland and kill yourself
legally it's like a nice experience I
heard
um all right let's install
ttmi oh wait do we have the module
installed or have the mod
Pro we have the module
okay all right just downloading 17 other
things great love it
gtsi oo that's pretty nice all right oh
this is nice oh good work good
work wow I wish Nvidia SMI was this good
Nvidia has got to step up their game
that's pretty nice that's the nicest SMI
I've
seen um good thing we trained our dam
good good good uh we only have a little
bit of Link because we're in a crappy
computer but that should be okay uh now
unfortunately it doesn't show me a key
thing I care about which is the
temperature of the
device um core temperature okay okay wow
that's updating very
fast uh uh good we're only drawing nine
Watts okay that'll that'll cool
passively for a
bit wow this is this is the best SMI
I've seen good
work uh here but V Toops like a third
party no I put the device in you didn't
watch the beginning of the
stream all
right okay getting started started with
TT Buddha and TT
medalo all right let's start with TT
Buddha TT booted demos are in a
different repo I think they have
bounties too should we try to claim one
of their
bounties
look here there's
bounties I am working on this no no no
no no don't look advice for people doing
bounties never trust anyone who says
crap like that sorry to pick on this guy
all right all right he does have a
greenish GitHub maybe he'll do okay but
still until you see a pull request from
people all right what's quen
1.5 oh I have to include a comprehensive
read me oh how much do I get paid for
this $500 that's not worth it um I will
submit a PO request though how
comprehensive does this read me have to
be
um but wait let's see if we can claim
enough bounties to pay for our
thingy can you link this issue using the
aloria source open no no stop pushing
your token
shit all right let's
go um well let's clone the demos repo
and see if we can get a demo work do
they have Mist for example we were
joking yesterday that mist isn't going
to work but we are going to get it to
add 2 plus
2 first five steps install TT
Buddha okay let's go look at that
here why is this in the
demos set up huge Pages
e doar or virtual ADM I hate both of
those
things stop yo y you know the joke about
Docker look man it works on my computer
oh well yeah but like how are you going
to package it up to like ship to other
people's computers I don't know man you
want to just like make a tarball out of
my computer and then we can ship it to
people
Docker all
right wow no no no but like I love this
SMI and everyone else needs to step up
their SMI
game
wait it says budha is installed even no
wait that's not the right I installed
different firmware why does it think
that that's the firmware
version why why is this
different oh I can get eth
for but does it have
token okay install P Buddha oh TVM
that's
smart TVM is a tiny red competitor it's
pretty
good all right I don't want to do Docker
I hate Docker all
right um huge Pages huge pages are
fine some devices
one editing the
grub I'm sketchy all take
gra what they mounted it in you can just
do
that is an f f stab
now that's
cool uh we can reboot
later
oh should we up get upgrade no install
recommends we we're connecting to banjo
again I'm really sick of
banjo P to
compile what is all this crap I don't
really want any of that torch
Vision smoke
test
no
P can I build
it downloaded the latest wheel
files just download a wheel let just
download some
Wheels py from 3.8 that's
disgusting probably only works with this
one though so let's
[Music]
try there's not a supported wheel on
this platform okay
well
wow that's a large
wheel we have to keep an eye on the
temperature
oh great we all tensor
flow block banjo and Etsy host that's
not the worst
idea someday I'll convert to Arch and
have to worry about so much more
crap let's Let It install stuff and
while we let it install stuff let's
check out
metalum
failed wrapper to convert to Pi bua
first where's the metalum one
okay that's pretty
cool uh GitHub project is is located
here why is it in a separate
organization see if this has tons of
weird instruction guides uh if you just
came from building from Source
installation instructions okay a note
about rebooting oh the minimum number of
reboots will be
two I don't know about that good thing
we didn't Harvest
it this one UNH harvested how do I
harvest
it oh wow okay they had a helpful python
script to enable huge
bases um
okay we going install some stuff let's
see if the smoke test
works
great okay which of the instructions did
I not follow I have to install a new
Boost
boost
docks
all right let's Let It update all this
crap I regret this
already should we tell the banro to fuck
off yeah let's tell the banro to fuck
off
yeah no banjo for
you it's going to take a long time I
don't want to wait for that let's just
do
this
I had a comment to remember why I did
that for
later hey they're actually selling cards
based right no the cloud is a scam guys
the cloud is everyone dude like someone
told you that the cloud exists the cloud
doesn't really exist it's it's one
computer haven't you seen
that
that's the cloud
right all right let's try the smoke test
again oh well we need lib yaml CPP okay
well we'll do a few more of these
installs where's
yaml none of these even are yaml oh here
we go that
one
those seem like inoffensive dependencies
some dependencies are
offensive got to have the
ammo all right well we don't have lib
zmq okay well have they considered tiny
gr which doesn't have
dependencies
what's a DOT file I don't even
know is there a way to do this faster
could someone could someone else do this
faster than me am I an old man sometime
I feel like an old
man all
right
and now we're up to this kind of
crap undefined
symbol tensor imple compute stride like
Channel identity okay this literally
has all right
well tensor compute strides let's see
what this
is like P
torch
um like the wheels should have fixed
this
has the wrong version of P torch
probably the metalum has a better way of
checking the huge Pages thing let's
let's just do
this where
a
all right should we
reboot even though that's totally not
what's causing that the torch problem
the torch problem is is other
crap all the second pass of the
huge oh well I have to
recurse sub
models also periodically check lfs this
is so
complicated Max tenset slots and by
Direction This Is Why Tiny's going to
win you can follow all this
stuff this is this is why tiny gr's
going to
win like well I'm pretty good at
computers I I I just tried for forever
to get this set up and there's some
problem with you know what oh I love how
fast this computer reboots oh these
these these uh these desktop computers
reboot so
fast
okay so I probably have the wrong
version of
pytorch
all right it seems like I have some old
Cuda version of pytorch uh should we
update
pytorch
no NX is no no I don't want to talk
about NX okay I tried NX once and it was
more confusing than all this no but NYX
is really beautiful yes I understand
it's really beautiful but once they
figure out how to express it beautifully
and not just have beautiful
ideas um then NX can take off but until
then it won't yes yes the idea of oh
it's all Version Control yes that's
beautiful um Docker is absolute trash
and still wins because this kind of pain
costs Millions yeah let me show you a
real way to solve problem okay all
Docker does is layer tons more crap
complexity on top of things the real way
you solve this problem is you don't have
fucking dependencies right those are
tiny grads dependencies like stop
writing code that in includes the
world but no we just need this we need
this look at this package it returns yes
it Returns the word yes I can't write a
function to do that like no but you have
to use libraries in order to make your
code maintainable
no
like this is this is this is tiny grad's
thing like yeah we linked to some
libraries using this autogen stubs right
we have a few we have a few C types
autogen stubs they're really easy to
regenerate everybody needs to stop with
all the dependencies and you know what
it is it's so mediocre software
Engineers can have jobs like I'm really
convinced that most code in the world
exists to give mediocre software
Engineers
jobs
all right is it going to work now see if
it
works no same
problem wait is that a different error
now compute channels last 2D dim wasn't
it 3D dim before I feel like it was 3D
dim
before all right there's probably an
exact version of pytorch I have to use
for
this maybe I should try to build this
from
source and not use a
wheel do I have to use off I have to use
Docker no I'm I refuse to use Docker
okay well first let's see if our huge
Pages actually
worked
oh sweet we have huge Pages great I
didn't have to do two reboots uh T
Vision install where is
torch that's torch Vision I don't think
that
matters
um let's try building this from
Source oh we have to like clone all the
garbage uh what is it
like a way to do this with like sub
modules yes let's make the world a sub
module yes but no this this is exactly
right here is why everybody who has shit
like this like I'm buying Nvidia wait
actually let's buy Nvidia oh look at
Nvidia wow look it worked it even
updated the driver let's use Nvidia oh
import torch wow look torch works all
right let's I don't know let's like like
make like a random thing on a Cuda
device
right wow look that just worked oh let's
multiply those two matrices oh look at
that and it's on device CA zero notice
how it didn't give me any errors
right and I didn't do anything special I
just pip and stalled torch that is the
incredibly valuable thing that Nvidia
has and until every company understands
this like no one's going to seriously
compete with Nvidia I press this like I
tell AMD the same shit it's like
like you need reproducible builds you
need to get rid of most of this crap
because that is what gives Nvidia that's
what lets Nvidia charge 90% margins for
shit the fact that it just works now
there's two ways to make things just
work right you can make things just work
by managing insane amounts of complexity
this is like the Google approach right
you you can get really good at managing
large amounts of complexity or you can
also just not have the complexity to
begin with any computer you can go to
hip install Tiny grat and it will
work um oh and then people think AI is
going to fix this oh don't worry AI is
AI is just going to be another shit
layer well now now I don't use Docker
directly now I just have ai spin up my
Docker and my kubernetes like no you
guys are this is the reason all software
is shit no zuda is z zuda this is
exactly not the answer even hip isn't
the answer teny gr doesn't use hip
anymore we use HSA uh it's one level
lower than hip stop putting crappy apis
on top of other crappy apis because I'll
tell you about crappy apis right like if
you have a crappy API at this layer and
then you build another crappy API on top
of it now all you did was crappy times
two right this crappy API didn't didn't
fix this underlying crappy API it just
added its own
crappiness
um it's pretty competitive on AMD now
yeah just pretty similar to
G if you
beam well it's not crappy Square maybe
it even is somewhat there is a squared
component to the crappiness
too all right undefined symbol tensor
imple compute channels 2D last okay
let's figure out exactly maybe in
requirements it'll tell me which version
of torch I'm supposed to
install Python and requirements okay so
there a torch
here uh okay here we go here we go it
has to be this
one uh
oops
yeah you gin you had great okay let's
see does that fix the
problem no no now we have a new problem
okay let's try installing all the
requirements
uh install dasr python n requirements I
don't understand why the wheel didn't do
this for
me oh no now this is a newer version
nope this is going to
break torch Library very kind optional
dispatch key great and that doesn't even
work oh
well let's try did I try this already
what did I get when I did that oh yeah I
have to do get subon
[Music]
no it's not that like all software is
not crap it's just like the
complexity this is not the way to deal
with
complexity like you know you know you
want to see some great software rest
this shit's great software
you many lines
Rices like this is this is great
software here let's go into Source look
it doesn't have multiple layers of
directories it's just this you can just
read it simple code and it works
incredibly well and it like Powers the
whole
internet um like that's a great
repo and here just just just to just to
play let's build
redus okay so I go to reddis and I type
make wow is this going to work is this
just going to work because this software
is not
shit I could have thrown some js on that
bitch but
now we can make fun of redus if this
doesn't
work actually let's throw a j on that b
because it's taking
forever okay so we're missing J
Malik uh look they even tell you about
this let's use lib C's
M with a
J oh lib HDR
histogram okay okay all right never mind
reddis has too
many why does
reddis depend on a
histogram
why wh why
why after a
reboot never mind all software shit oh
wait hang on hang on hang on hang on no
no no no okay it's a little bit unfair
because I
[Music]
think it was
building no I just want the server I
don't want the test I don't care about
the
test oh okay I don't know what I did
wrong but it worked
[Music]
okay that's pretty good actually that
that was kind of fine that was kind of
my fault I didn't specify what I was
trying to build but there we go now
we're connected to
redis uh maybe we should also build a
client that might have been my fault
because I stopped the build or
something
let's not blame redis that that's a pepc
error maybe it'll just
completely there we go
beautiful that was a petack
arrow now I'm connected oh let's do
help all I'm saying is red is is good
software
all right good we've en knitted the sub
modules now let's pip setup install oh
key error backend Arch name of course of
course we're going to need to give it a
backend Arch name okay well let's see
what we have to put in for
that here we go boot a backend
okay Arch name equals we have a gray
skull
back end Arch
name all right all right looks pretty
good have any lines in Rus let's take
one kind of a
lot but I bet a lot of them aren't
needed
um 100 ,000 lines in
Rus how much of these are like no wait
no there actually there's actually
100,000 lines in Rus all right all right
that's not that's not
crazy it's also written in
C uh what else is good code let's try to
build my SQL is my SQL good
code yeah that's a fan it's
[Music]
building we don't have B do yet yeah
it's throttling my poor little ryen CPU
there SQL light well sqlite's just even
a library it's not even a sqlite is good
software sqlite's phenomenal
software
I think it's just a library though I
don't think it's anything else well this
is a little bit
large I will say this is a little bit
large and why does sqlite not have
CI do we think this building is going to
work all right let's let's play with TT
metal maybe TT Metal
Works
installing oh good good that's the one
we have
great
um go to TT
metal uh what
branch do we have you main okay
uh get sub module andit
recursive
it's even that docker's bad software
Docker itself might be totally fine
software it's what Docker encourages and
enables yeah yeah okay
Docker not even
if software stopped depending on
everything
then good we're building something good
good good we have NC risk all right
let's get Visual Studio code up here and
let's start
exploring uh what do we want to
explore do we want TT metal like what
even is this that documentation page
looked okay let
let's see if this let's see if there's
anything interesting that
like okay this looks kind of
interesting um okay build a project
following that
great
uh
H okay I kind of like
this let's see if we can import
ttn
no module named
ttnn yeah I mean this looks kind of
interesting not with torch but can we
just do this why I need to zero
fine that worked how do I install this
installation
guide
Canon Ops and tensors
okay installation
instructions okay we did all
that develop our
dependen do this great download all the
lfs
crap
um set up the environment note that this
setup is required every time you want to
use the
project oh no what Pepe it's
disgusting if a standard rejects the god
tier 2 spaces then we reject the
standard
like I'll tell you the problem with the
strict formatters the problem with
strict formatters is you can no longer
tell who's a good programmer by looking
at their code or
not like one of the Beauties is I can
look at a poll request and when people
like have like a a variable and then
like a space and then equals and then
the thing right there I just know
they're not a good programmer okay
because they don't pay attention to
detail if they had a pep eight formatter
I would never see that about them and
and you know that would just you just be
losing information what are we
downloading that's multiple
gigabytes oh we have to download the
weights for llama 70b so you can run
that example well that's
sensible
um all right so we don't have that yet
oh oh did this do something okay let's
try the example in this
pipot
no module name Pi Buddha but I I I I I
installed it oh no never mind I'm sorry
thirdparty Buddha backend device bin
silicon Wormhole create ethernet map
does not exist or is not a regular file
great okay let's just try the metal
thing because Buddha didn't work how am
I ever going to claim this $500
Bounty should I just try harder on this
[Music]
TT to unknown torch
Library we
have I think torch Vision didn't
work
maybe
no I installed the exact wheel they
wanted
try to figure out where this thing
is all
right xft uses the 2.0 it does not seem
to if you need to compile with other
versions of torch you need to recompile
I use the exact same version of
torch let's uninstall and reinstall
torch maybe it'll work
better using this exact
wheel let's download the
wheel
no torch works great it's just when
people try to link to it it's linking
that's the tragedy oh here we have this
torch audio garbage let's uninstall
that
okay okay okay I have a new Theory the
older this version of TT Buddha might
have been built against
a
different might be a different uh which
release did I download we can look at my
wheels and take a look
okay uh Dev GS this one all right so
this happened on January 5th so let's
check out
this
commit okay now let's look
requirements this doesn't even have
requirements
anymore where's
torch great this one doesn't even have a
torch version that I'm supposed to use
but this is probably the wrong torch
version
um how's this supposed to
work if that doesn't
work which version of torch should I
use P torch 0.2 that's the one I
have all right let's try one more
thing
I don't know what this cxx API garbage
is let's try it without
that that's the python we
have TT Buddha seems
obsolete this did this Chinese guy
figure it
out in addition when packaging the wheel
you need to avoid
modifying there's not even a setup. pi
anymore what is this this is not even a
version
these people need tiny gr support
without
dependencies yeah it takes me a while
too this is Bullit shit you know like I
just I'm kind of like this is like
should we all right let's try metal for
a bit I think we're giving up on
Buddha I'm I'm not spending my time
figuring out why the torch Library
symbols undefined like stop writing code
like
this
oh oh okay it worked don't use the torch
they tell you to
use all right all right
great
okay all right it did something pH
finally uh we got to keep an eye on the
temperature all right we're doing
okay all right look at all this stuff I
mean this kind of pretty
PR creating input Q
connector well that wasn't in the
docks all right sure we write a little
uh little Benchmark want a
benchmark let's
see
what this is a
tiny
[Music]
uh
wait I have to make a
module Pi Buddha Pi torch
module this looks so
hard
e my is
[Music]
gross
all right does this work let's try a
smaller Matrix
first
[Music]
um
h
no error while pushing
inputs okay
so maybe I have to like make it a batch
or
something
okay that seemed marginally
better
no all right uh let's start by copying
their example exactly and then figure
out where it
breaks oh do I have to tell it it's a
torch andn
parameter um I don't I fine I'll write
out torch. mapall if that
matters I'll make it
four and that should pretty much
right oh let's stop doing it three times
that might have been too much to ask
for this the 10 point card might be a
one time
thing
uhoh it's getting
hot
no it didn't
work okay let's see if the old test
still works or if I broke the
card we broke the card
okay can I reset the
card if you thought AMD was bad try a t
torent
[Laughter]
card um is it hot no it's not hot we're
fine I mean that's not too hot that's
not that bad uh uh all
right does ttmi support
reset oh here we go do I want to
generate a res I can generate a reset
file I can generate reset J on fucking
joke oh yes here update the generat file
and use it reset reset EXP one
argument okay okay okay okay that worked
reasonably I don't know why that didn't
show up and help oh it is there okay I
see it just confused me with generate
reset Json all right let's see if the
test Works after I've reset the
card okay good good good good we're
we're back to it's working again it's
working again all right let's see if my
Benchmark
works
that was actually not that bad not that
bad we just had to reset the card once I
mean we asked it a lot we tried to
multiply a matrix that was okay good
good this worked okay now let's make
said M can I change that to one or is
that going to
break all right all right not too bad
not too bad let's try let's try looping
it three times what do we think will it
work will it work can can the T card do
three
multiplies no I know I know that was not
that bad that was not that bad we're not
hating we're not hating
boys oh well don't do
that definitely don't try to run
something multiple
times that was too
much
all right am I just not reading the API
correctly all right let's play with
metalum did I break
it don't do it three times that's too
many times you can multiply one Matrix
per time the softare
starts can I make the text bigger not
but I can let nonsubscribers not talk
that's
right
um there you go it's bigger are you
happy when Matrix one reset That's the
Law no no no no no to be fair you the
program multiple
times great great great great now see
this is the opposite of how you do
complexity
[Music]
guys
for
I want food is it Uber Eats time oh I
know what I want shansi Magic Kitchen oh
wait till you guys see shansi Magic
Kitchen
uh sh Magic Kitchen oh yo by the way
folding
phone
I got a folding
[Music]
phone
I want to
reorder from shansi Magic
no shansi Magic Kitchen is not open
right now nowhere's open right now
because it's
9:35 by the way look at the size of this
folding
phone
you can see the crease from
here
uh hang on what do I want to
eat this this all disgusting I'm going
to eat disgusting
food
never mind also was
disgusting wow P Buddha is actually
pretty decent and practical good
point oh CU I have to recompile it
I mean that might work but if that does
I I just
yeah no I don't want coffee I want
shansi Magic Kitchen no no I want Tha
food that's what I want I want some
noodles can I get some noodles or some
fried
rice when I was in India I saw a sign
and it said fired rice I'm like where'
the rice get fired
from
no there's no Tha food available but I
could get faam colie this is very far
away it's almost 10 o'clock I could just
wait and be patient what do you think of
that or do we want a bagel bagels are
disgusting like I eat bagels and then
I'm not
happy Taco
Bell
why is only disgusting food
open all right should we get an S
ball we get an SI ball bigger ball yeah
bigger
ball
if I add
$21 I
can hang on so if I order from another
one if I
bundle if I bundle a kondi from Randy's
Donuts does that count as
Uber no no you can't do that no no no no
that doesn't
work I'm trying to save
$25 with Uber 1 but I have to buy more
stuff from the place and all the stuff
from this place is
expensive right let's get Alex a
juice here
perfect
great
okay my as EO will be
here yes spend more save more right like
I just feel
scammed you wish you had money to eat
well you know don't buy a 10 stor card
because then you won't have
$800 but if you want this joy and
if you want if you want to experience
this this joyful experience by a 10 swor
card all right let's see if we can use
metal we got it working we got it
working it wasn't it wasn't too terrible
to be fair like as a dev kit this is
pretty decent as far as devkits
go on the devkit
Spectrum um let's install
this
Python 3 setup Pi
install Arch name is not provided well
we know the arch name and it's gray
skull no we don't have Dev men map
great or the imple device do we have
wheels are there wheels for T
metal
release okay okay is this a
wheel uh no it's a zip
file all right maybe we should try a
release maybe the releases work I think
that's what one of the things
suggested let's check out that
tag wow thank you for gifting
Subs
see if that
works no problems with dead map again
okay so
question if I have pdha installed does
that mean I have ttnn installed no
definitely not okay so that was that was
that was a false
hope
for
did most of
these um let's try
this not try to clone I don't know you
want just try it
again follow the instructions
exactly
why was I not I don't really want an SI
ball why was I not just patient and
waited for Shane Magic Kitchen to open
so I could eat chicken and noodles which
is what I really
want Ethan 1G you should know better
it's not for anything it's never for
anything
think of this four things you know okay
I try to explain this with like the
marketing for the Tiny Box like like
stop saying what it does and start
saying what it
is I hate all these like like no one
sells food by what it does right people
sell food based on what it is like I can
respect
food you know you can respect
respect um no one tries to like tell you
like like like this burger will complete
you no say what it does people just need
to like like focus
on if everyone would just focus on
describing the world
accurately okay we need these two to
metal
home
right python
pass good we installed
wheel let's just reset it resetting it
was very enjoyable why is the core power
so high now I remember when it was
low it's a little long now it's
good we're building TT metal
from this
version and then we can get
started T man this is kind of cool oh
look at this graph oh that looks
cool why does everyone try to like make
it like work with torch like it's never
going to be good maybe AMD will be good
because they built literally Cuda
clone
single core and multicore so I mean this
actually the
the I hate this
crap oh this is why HSA
failed like stop trying to make
everything generic and just just just
just make your shit like explain to me
what the T toor thing is actually very
cool like the accelerator is very cool I
visited them they explained it to me um
it's just a shame that they don't like
explain this to
you they're like we're building a
generic API that's going to drive
business value like
no stop saying what what is it user
friendly intuitive familiar with fucking
pie torch why is your low-level shit pie
torch
oh maybe there's something lower level
than
ttnn all right well this is all open
source so why don't we just start
reading the code for TT
Buddha P Buddha budha and then we can
see here okay Pi budha we have something
called Pi torch
module we can like see what this
actually does
luru great uh
what is this calling
into at the lower
level probably need tons of C
code I do like that they've lifted that
that that their metal thing is python
like you want your metal thing to be
python but then the question is does it
actually use
that
each one of these files is longer than
tiny
grad yeah make something that works for
your thing
exactly what do you want to know from
semi
analysis I should pay for how much is
semi analysis I should pay for
it is it
expensive
oh they have a
substack 700 that's kind of a
lot a year a
month good we're installing a lot of
stuff oh yeah that's not that
bad okay dependencies TT lip is a
unified to the tensor argument within TT
eager but I think TT eager is part of TT
metal the amount of code in this stuff
is just crazy but like this is what
happens this is what happens when you
just employ software
Engineers you get an insane amount of
code that can barely multiply a
matrix but no you're just not using it
right yeah well who's going to use it
right you know like if I can't use it
right tell me who's going to use it
right let's see let's let's give it a
fair shake and see if I can fix my thing
and see if there's some docs that
explain why I can't put modular run in a
loop like you'd obviously
expect
run
inference inputs output Q
get oh maybe is this something I
can let's just cause run
inference
which this shit why when I look in run
inference what it calls is underscore
run
inference
why is there an abstraction layer there
of course we're going to get devices in
this complicated thing and then we're
going to run devices
inference all right and then if not
resume we're going to initialize that
how do anyone do it oh yeah we're going
to start a loop thread unless we're in
sequential we're going to check the
sequential
override how does anyone do
this oh great thank you for building a
environment for me
do I have ttnn
now uh no of course
not wait that has ttnn that's just
weird uh no don't install it in a do I
have a wheel somewhere where can I just
install it
globally uh no I want a TT metal
wheel iPhone 3 setup
installed Marsh name equals Grace call
come
on oh wait you already built this why
are you building again don't build again
please don't build again please don't
build again okay it looks like it's not
using a ton of CPU so it's not building
again
maybe Enterprise companies have code
complexity tools that want 5,000 tiny
functions like I I hate
this this is this is this is just this
kind of code is just like please have a
million
bugs yeah oh look oh good thing we're in
sequential override mode and we can run
forward inside a thread all right let's
look at run forward okay here we go so
where does it actually run the fucking
thing what does run command do where do
I get there okay here we go all right
now we have a device okay push to
command que okay self command Q push
great all right so we're deep in here
and we have a device
now what actually gets pushed to a
command que can I like look at a command
Que
send the shit to this this is block oh
God what is
this what's being pushed to a command Q
you put Types on all the useless shit
like the q's but you don't put Types on
the oh well of course this doesn't work
because it doesn't have weird ass old
version of
torch missing parentheses and call to
print
no
no uh how do I create a wheel can I make
wheel like that
wheel okay well somehow it's set up but
I had to use this virtual amp and you
know how I feel about virtual amps I
hate that Python 3 doesn't work but if I
do python 310 for some reason I can
import ttnn there let's see if that
works no well that's the wrong ttnn so
it doesn't work at all never
mind if I do the one in Python 3 maybe I
have to go here when I import
ttnn but that doesn't work because
there's no Pi frame get
back okay why do you have Pi Buddha and
PT metal but pdha doesn't use TT
metal have dot C fucking P torch
garbage right so where is any of the
code that actually does anything in this
thing no no no no no no it didn't work
for me in 310 it never actually worked
it just it just imported the import. py
file
basically
I like that there's a script I like that
there's a script that counts the lines
this is very tiny grad inspired let's
see let's see how many lines it
is
okay never mind um all right why don't
we look at
ttmi or should we try to claim a bounty
do we want to actually try to use their
no I'm not I'm not dealing with that
that just sounds awful yeah I know I
love EST Trace
right uh let's look at this
thing I have it here don't
I no I don't we'll CL
it
okay uh Imports TTS SMI backend what is
the P Luan what is
that oh T Tor system interface Library
oh of course there's a
custom okay well this is
useless
um is this all just in like C and
there's no way I'm ever going to like be
able to do anything with
this how do I like talk to the the
device where's like the code that talks
to the
device does this have code that talks to
the
device yeah dist dist is what I
want dist okay good we got an egg all
right let's uh pip three install this
egg you can't just inst install an egg
why not oh let's upgrade pip that sounds
nice better pip maybe better pip can
install an egg what is an egg why can't
I install an
egg canot find a version that satisfies
the requirement force and stall my
egg that didn't
work I didn't have high hopes for
that is that disc always
there python install egg file how do I
do this how exactly does one install an
egg
file oh python setup you do this at the
setup tools page oh easy install Perfect
I love when things are easy
okay I spell it
right don't have easy install I don't
know pick preinstall easy
install all right no module named easy
install you think easy install would be
difficult I knew easy install was hard
oh it's called setup
tools setup
tools set tools is already
installed no module named easy
install Easy
install this is not
easy is it a real egg zip archive
data
oh great we got dot
c a whole lot of
weird um I don't know like that might
just work
maybe don't really have high hopes for
this maybe it
worked um tt.
device all right all right we's see
what is supposed to be in
ttb import ttb as
TTL okay let's see uh get num PCI
devices this is if this function Works
we're no of course not but we don't have
a yaml of course how could though how
could we possibly expect it to work
without a TT metal yaml
shit
what the
hell do we have that yo file somewhere
oh I probably have to set like
the those things I had to
export here we go let's
try TT export TT metal home
equals home kofka T torent TT
metal now let's see if we can do
this okay good we've detected one PCI
device okay okay okay we're making good
progress now boys good progress
um how do I install the egg let's
install the
egg so we don't to do zzy anymore uh put
three install the egg install the
fucking
egg easy
install
okay let's ask
Labs o Claud 3 hiu how do I install an
egg file in
Python download the egg file open the
terminal pip install the fucking
egg oh not compatible 's a virtual
environment
Force install
egg no binary no depths I don't know
let's try what does no binary do
bypassing yeah yeah yeah bypassing all
right let's go no binary requires an
option all right
well you must give at least one
requirement to install I need a package
name
TT
is it can cause more problems than it
installs ignore installed okay you know
what I have a better idea where is my
python whatever this
works um let's go to
my metal here I know about ttnn uh s. t
a pen to that shit import sis we need to
also import Os os.
inviron Oh make the text bigger for the
noobs well you know noobs you get that
size text okay so be
happy um where did I make that finally
do something
[Music]
here what did we have to do TT metal
home
[Music]
this all right let's import TT lib as
TTL and let's print
this okay
good' be nice if that actually worked
um
I can make that work
by oh wait it actually
installed
what the egg installed okay whatever so
I don't even need that
great okay good good good good all right
we can get the number of devices now
great we we're making
progress
um so all that stuff was actually TT
lib but maybe TT lib is TT metal and
ttnn is like right here and let's see
what this actually
is okay this all looks like nothing how
much code is just
nothing definitely don't care about
that oh here I have a so file I can just
import that that's the one that doesn't
work
all right let's try to like talk to this
device and like have it do something
eager
tensor oh
see
okay let's create a
device I tried to do that before in ttnn
did I
not
whatever yeah those things sound
good glad that we're designed to support
multiple devices this is a great all
right good we have ai
clock all right
um labels torch to TT
tensor oh it closes the device for you
that's pretty
nice let's see what's
here
tensor all right we can make a tensor
let's make a
tensor
what's a p tensor oh it's like a torch I
need a torch
[Music]
tensor
really of course no definition found for
tensor what's a TT layout oh
tile sounds
good tile is where I want to have my
tensors
TT D
type py tensor reshape size I don't know
what if I make a tensor Bob is that
going to
work no don't make your tensor
[Laughter]
Bob I fine I'll import fucking
torch
import torch
torch.
brand
1010 dtype equals torch. bflat
okay
that TT no that's a terrible name we'll
call it torch uncore random uncore
tensor yeah who likes my large variable
name that's right it's a large variable
name okay let's
work no no no don't do that index is out
of bangs for the rank should be between
zero and zero however is fuck you very
large
um while size is less than
four size insert at zero oh we have to
put ones oh oh of course of course of
course of course I'm I'm very sorry
you're torchi we need to put some ones
in here all right all right now we can
put it to a tile layout
yep Noe that didn't work okay
well that didn't work is that what this
does object one insert it zero and it's
putting the shits there okay well you
know I don't know maybe that's an
offensive size let's try 16 no one has
ever been off ended by 16 256 is the
least offensive size I'd say of all the
sizes I'd say 256 is the least
offensive okay
well that has to be like a
tile I don't
know like
that TT constants tile height I don't
know let's see can we get
that no it doesn't have
constants here we go tile height equals
tile dim tile dim is 32 oh 32 of
course
okay okay okay okay we have a TT tensor
now let's take a look at our TT tensor
let's admire
it can iuse python of course that does
work reinstall I
Python and I can tab complete please
restate current
task God
could you live life like
that we have a
tensor did you live life always thinking
about what you're trying to
do this sounds so terrible I am just
trying to eat an as ball and hopefully
it's
here it's
not should we ask the phone where it is
large folding phone where is my ASO uh
oh look at that it's using very little
power that's good what do I think about
Devon I think it's a hype I think it's
hype I think that hype fuckers should
you know just die and stop hyping shit
like can I use it can I use it or is it
hype or did you release a video with
blurry shit right you know all these
companies you're going to build humanoid
robots like it's so laughable it's like
wow remember when we we're going to
solve self-driving cars because
self-driving cars were the easiest
robotics problem everybody proceeds to
fail at self-driving cars and then
they're like oh humanoid robots you know
you just like you just can't
with I I don't
like you know what be be happy that you
don't understand okay if you don't
understand like if you don't understand
what's going on with AI and you don't
just be happy be happy because if you
did understand you'd just be infuriated
all the
[Music]
time
Ohi I don't even know what jobs people
are going to have in 18 months dude like
I wish these people would put their
money where their mouth is so I could
take it all from them not because I want
their money but because I want them not
to have
money right we'll burn it we'll burn it
in a big cash
fire my EV almost here so that's
exciting
okay um all right we have a tensor well
let's look at some of these let's look
at some docs let's read some docs some
of these docs actually looked kind of
useful except I don't understand why I
have TT lib and not ttnn but TT lib
sounds better than ttn in anyway
so um luin and TT firmware
and why are there no TT here TT metal
why why is why is TT metal in a
completely different dog from the other
thing not ttnn I don't here using TT
lib TT lib operations are missing some
of the
features print L1
buffers can I can I just ttnn
work no module name
ttnn I thought I saw a
ttn
maybe this will just
work okay
okay no it didn't just
work why
not oh no module named ttnn
ttnn oh I see it just didn't do
the
here we have an egg now that's a tiny
egg a big
egg okay this is this is
this okay we have to copy this
to this should just kind of
work Yola
now we need logu okay that's not too bad
I can install
log no module named presistent
persistent collections okay this just
looks like something I can pip
install and then we'll have working ttnn
then we use the ttnn examples oh grab is
that's a normal ass Library
good no module named TT eager oh now we
have a
problem thank you for gifting
Subs uh okay well we have TT lib so
whatever we can do with TT lib we can do
I don't know why we don't have ttnn but
ttnn looks crappy anyway so
whatever converting two and from a torch
tensor what were the cool things where
they were telling me about like dram and
shit like that I'm interested in
anything that involves torch I'm not
interested
in I want to like
like I want to
like
notal single
core creating Dam buffers and circular
buffers oh this is in C
now create
buffer where can I actually like use
[Music]
the maybe let's look at some of those
things that that that example prints
out no oh no pdha only works in Python 3
a of course got to remember
that all right
so we have Pi Bo a TT device create
input device Q connector
balancer
whatever like I just want to buy pass
all of this I want something the T chips
actually very cool and I wish they were
just exposed like they should stop with
this Jim stop I told you this like
nobody wants any of this shit nobody
wants a
50%
torch like be proud of what the chip is
and expose the chip for what it is the
Chip's really awesome the chip has like
all these tiny little risk fives and
they can talk to each other but instead
they put seven layers of neural network
crap on top of it that nobody
wants and it doesn't
work this this was my advice to TP I'm
like expose your chip for what it is
this is the only way this is ever going
to like get
traction you know explain why you're not
cuz right now all you are is shitty ass
Cuda it's like Cuda but it doesn't work
oh yes that's what I
want
um it's like Cuda but it doesn't
work like
I even T Inn is is too can I get the
docks for TT
lib does TT lib have docks
and is this the lowest level thing
because okay the chip is really cool the
chip is like a grid of risk five
processors and they can all talk to each
other yet I see nothing about
this I see all this crap about
like the stupidest thing you can do
today is try to build a large language
model inference engine
like that's the most competed in
space and you're all just going to lose
to Nvidia okay like if you try to do
that stuff you're just going to lose to
Nvidia if you like say look we built
something different because this is
different and this enables new
capabilities you're never going to leave
how about this same thing DD same thing
DD with hip maybe hip maybe hip actually
kind of works like maybe hip kind of
works because the Nvidia and the AMD
chips are actually very
similar
um so you might be able to just shove
your way
through
um I think what apples doing with mlx is
cool like like they're taking pride in
the things that they can do uniquely in
metal whereas what this is is just a
crappy
version like
why you here TT metalum is designed with
the needs for non ML and ml use cases
yet your whole thing is talking about
language model crap language model crap
that nobody's going to care about look
the only way this company succeeds this
chip I mean this car is fine I'll buy
for $800 because I think it's I think
it's fun but no no like real company's
going to buy these right no real
companies should
if I was in a real company and they're
like we're using 10 sorant cards I'm
like I this is what happened with Dojo
same thing right no no researcher wants
to use this and as far as like price per
dollar on inference you're not going to
compete with other people on
this
um you have to be in this for 10 years
right
like tiny Court in it for 10 years tiny
grad will will still be relevant when
large language models no longer
are here you say it's designed for
non-ml and ml use cases yet this whole
thing goes on to talk about
ttnn designed to be intuitive to a user
that's familiar with pie torch bro Wayne
Gretzky don't skate where the puck
already was skate where the Puck's going
and it's not going to fucking pie torch
and everyone knows
this
ttnn is based on top of
metalum all
right so where are the docks from
medallium
this can I use this no this is only in
C don't make me code in
C oh here here oh TT metalium here oh
okay I missed
this okay okay okay this is this is I I
didn't the whole thing here was ttnn I
didn't realize this was a separate
thing fucking pyth
man
okay all right
boys we got to leave
python it's time to go to C no no no no
we're going to come and see you
know okay TT metal programming example
loop back
make
make loot
back back
cop
no okay um make programming examples
loop back okay okay let's try this make
program examples loot back nothing to be
done for program examples loot back um
next sport GT metal
home
this export Arch equals gray skull I
just had e or an
A that's not a e that's a a the dude
wants to give me a massage he's
gay
bu Maybe down
here no such file or
directory no such file or directory oh
because this is TT
metal no Dev Med
map no in device did I spell gray
wrong
I
did gray skull has an
a
oh here we go build programming example
loop back
okay oh no that's not going to work
because we have
to we're just going
to me add this to my bass
shit
all these people it's AMD too like they
focus on all this high level stuff and
you don't want to focus on the high
level stuff you want to make
your programming model unique and
awesome
uh such that people want to use
it
builds
examples does it WR okay cool test
passed all right let's see what that
actually is programming examples are in
TT
metal metal programing examples loop
back back
okay
well don't do slow low dispatch mode
okay all right we created a device with
device ID zero I don't know why it's on
a new line then we create a command
queue and then we create a
program um this is very open C
shit I'm create a
kernel
Dam create random V Smurfy thank you for
gifting
Subs okay we write the buffer to
[Music]
Dam on time
ARS
what are KN coordinates is this stuff
documented look at data movement
C am I missing something that just kind
of explains what this
is like it just explains what the T torn
thing actually actually
is what's a knock does it tell me what a
knock is sounds like
herban SPF U
[Music]
SP oh we can make a chat VIP
only
a single
core
okay this stuff is much more interesting
than what I was looking at
before let's read some actual
carels let's read them M will
Kel
wow this just poor tiny
grab
like they should expose this API which
is the most sane API I've seen from them
and they should expose this API to
python knock might Me Network on
chip do we have anyone from T store in
here
okay knock is Network on
chap the ARs that we pass into the
[Music]
program physically independent to kns
there's only two like where are my cores
where does this shit actually
execute this is the font I just say this
is normal
chromium create colel most specif
the kernel and core range on which to
execute core core oh so this is just
running it on one
core but there's lots of
cores so if I read like the map mall
multicore it's going to use
multiple if I look at the create
kernel all cor oh I see where do I get
all Cor
split work to
course what is this
return core range set I
see so how many cores are
there
course
[Music]
our grid of
course each core includes five risk five
processors five Megs of
SRAM got jump go
right
okay I wish that this was all exposed to
python wait is it exposed to python is
there some way I can like create a
kernel and launch it in Python like P
open
SE
okay
um a gr skulls okay okay that makes
sense 10 x 12 G of
course now this is the documentation why
isn't this the front page of this that
would be
cool yes like this explains this makes
me understand things so where are my
knocks something we two knocks I don't
see two knocks I just see I see 120
cors ah yes wait this is the best stuff
why don't you have this on the front
page of
this what is a knock oh here knock is a
twood directional by Det tourus
the oh the KN connects all the cores
okay I
see uh we have pcie and then what's
Arc uh oh I this is the network stuff
okay but that's
there
cool so if I'm just using that core how
do things get to that
core this this is this is all okay this
should be this should be linked right on
the front page of
metal
come
all
right each core has two data movement
kernels and a compute kernel knock async
read from a buffer uh well I said he has
five processors on the
things at the basic data movement
kernel
oh reader binary okay all right so yeah
yeah I think understanding the m m thing
is good I think maybe I'll try to write
my own M Mall outside of this stuff and
that'll be today's
stream
this doesn't have the ethernet so I
don't know what Arc
is what's
Arc what is this excal draw
thing
oh
cool
um what what what is Ark I guess I
thought it was ethernet but these things
are
ethernet all right I don't care about
this stuffff don't care about this
stuff Arc is just a CPU that is used for
system management
okay all right let's uh let's write some
programs first of off I hate coding in
these sort of
environments let's create a clean um
we'll call it TT
twitch call 10 stor
twitch we'll call it twitch
torent TT
twitch keeping in the 10 for name all
right uh let's see if we can get all
let's see if we can get a little build
environment up
here okay now that now that T stor guys
are here I'm more motivated to try to
not be a general fuck like I usually
am all right it is in C++ so we do need
[Music]
CC
want
to create the
device know why we need to Define device
ID let's just do that what do we need to
include for that TT metal host
API well that doesn't exist so we'll
figure out how to do
that runsh love run.
sh should bang in
there
clang main where is this host API
thing TF metal did I do TF
metal yeah I did TT metal right so
just an eye on
there
all right we don't have common
assert where is
that okay we also have to
do
this all right we got to find format
color third party format okay well um
let's what is that I can use that same
I'll use that same environment variable
you guys
do TT metal
[Music]
home just say TT metal home equals that
for
now
spend time building a good build
environment and it will pay itself back
10 times
over
that D TT metal
home
that okay well that's great um lots of
shit doesn't
work let's go to loop back host API that
should just work I think
let's figure out what's not
working I probably need to say it's like
C++ 11 or
something um enable a new C++ what is
that stand
11 sounds
good all right now we're back to Dev M
map I've seen this one before and this
is because of you have to tell it it's
gray
skull yeah so that's in
here um whatever I'm just gonna only for
gray skull whatever I'm going to put a
comment because only gray gold cards are
shipping so this will work for
everybody
TTR Arch
types I mean this is actually
interesting I'm kind of curious what's
in this Dev M map M maps are always very
interesting you learn very interesting
things from M
Maps
cool
UMD what's UMD why do I need a
UMD
host me address map we need that
too um what's
UMD
we got some
rocky oh user mode driver
okay great we'll include some stuff for
the driver got to do that okay Dev
messages all right we're getting
somewhere we're getting somewhere maybe
who knows TT metal hardware ink
okay straight up Harbor don't need Grace
ball okay
um certain explicit cast to silence this
issue I don't know C++
14 no don't do that okay C+ plus 20 it's
20 non-constant expression cannot be
narrowed from type shit to
shit see if I can figure out what
arguments they're compiling with here
um got just be some way to ignore
this no no you don't want to like just
make another example and reuse the
existing build system you'll never learn
anything if you do things like that okay
if you just use what's handed to you
you'll be using what's handed to you for
the rest of your life see this is why I
don't stream anymore because I'm sick of
saying things that supposedly sound like
things you know just it sucks okay I
don't know
where modu M K yeah that's what kind of
what I'm looking at I'm I'm looking at
that right
now it is this
right
[Music]
god let's just fix
that insert an explicit cast to silence
this
issue
what
okay
great uh undefined reference to tit
metal create device and that's because
we're going to have to link to some
shit okay
uh R
grab
build
this and then we're going to have to
link
to I don't know like
device start
there okay just need a little yaml
yaml not find y
yaml
yam gra yammo yeah just orchestrated
with kubernetes
great how do I link to
yaml
y yaml
cppp all right now we're back to
undefined create
device okay it just looks like these so
let's try L tenser LTT
metal just LTT metal let's just try that
maybe we don't even need device let's
just try that we don't let's get rid of
Y want to do the minimum you always want
to do the minimum you don't want to
start linking into the
world everything needs yam we love yam
what TS to it cool we built something
all right
um
building throw a quick read me on here T
torrent example on Twitch
we'll doal with pushing
later but uh yeah so that uh cannot load
shared Library Li tt where's
Library build lib there somebody to do
this
um
whatever build
lab
all
okay uh now we just have a problem with
that
okay environment variable TT metal home
is not
set X but I thought I sat
that okay process tear down with Device
still active Okay that's a lot better I
think I might even be able to remove
that Sim link now that I actually did
export there I don't know why it wasn't
okay good uh process tear down with
Device still active okay we can fix that
uh we have to after we create the device
we have to close the
device let's pass oh
come here you can't INE because you got
to include the shit for
aert okay great good progress good
progress boys good
progress all right let's create a
command Q on the device and a program on
the device of course now we have the
core coord of 0 0 that's sounds
good um yeah that's fine let's create a
kernel let's just not be too specific
about what type of Kernel it
is program we're going to call it
kernel.
CPP need that core expression and I have
no idea what that data movement shit is
but we'll get
there all right let's make a new file
called kernel.
[Music]
CPP let's look at the simple
kernel let's make a kernel that does
nothing hopefully it's capable of
finding the compiler and shit no
suitable
what too many arguments in function
call where is this Auto completing
from
um why does this not think it has the
right why does this have a different
thing than
that I don't
understand like why when I Mouse over
this does it think that the types
are in and shit oh maybe there's two of
them and it's just stupid okay that's
reasonable it's actually pretty
reasonable okay I was take you all right
cool cool cool cool
um that's
good all right did it compile my kernel
let's put crap
here compile my
kernel it does not compile my Kel okay
we probably need to compile or something
create kernel Dam config create buffer
we need
buffers uh andq program let's
go uh finish that's
nice why is false not good too many
arguments and function
call I
see I don't understand why all these
like type hinings are wrong they look
right when I look at
them now this blocking operation yeah
that's good why don't I just block and
don't have to finish
whatever
okay now no such file or directory Great
so everything unfortunately is with
respect
to
um the the metal thing so let's just do
that uh now can you find the
file TT metal m equals
Dev uh no such file or directory oh I
see so even though I put in an absolute
path it's still doesn't
work at least the errors are good all
right good crap was not declared in the
sculp good that's exactly what I wanted
to say remove the
crap does it run an empty
kernel great it runs an empty kernel why
is this so slow
why does it take so long to turn
on that's
slow
um
okay let's take a look at
atals and see what we can
learn
it's j compiling a curent that's
cool uh
yeah core range that looks more useful I
don't like core
cward oh that's cool I don't need to
call create program create program is
just nothing I can just do it like that
it looks better
whatever we'll call it create program I
I don't trust C with it's like vampire
assignment
shit
uh all
right
let's this is a lot of work to create a
buffer why is it tiled what does this
stuff mean is that in the
docks it explain to me the
tiles
ined buffer
config drram
config why why is it tiled in Dam
though oh it's not Ty I see it's just
called it's just called
that
devices
device size
is why is the page size the dam buffer
size that's
sketchy all right let's make our Matrix
one or two
four two for the B FL B 16 is two bytes
I assume this is in
bytes um buffer type equals
Dr probably need to include some crap
for
that all that's a later problem um page
size equals one one page size that's a
good page size right how
one uh we need some
semic PR any after
that uh oh let me throw some e on that
bitch those some e there we
go all right um use of undefined
identifier
shit uh which one could it be I don't
know details TT metal is it in
detail it is
not where is this to find imple buffers
buffer do I import from impul anywhere
no
find import from impulse imple buffer
buffer got HP let's
go doesn't work I gota like use a name
space or something using Nam
space love names space using names space
TT oh maybe it was fine I just needed a
nam space all right great love
it got love that C++ garbage
I'm tired I'm an old man all right all
right we have dram config
now all right let's see if we can create
a
bar why do these not
work hello hi I got you a green juice
it's in the fridge you got me a what a
green juice oh thank you welcome uh why
does that
work
Banas
um page size must be divisible by this
shit oh well I knew my page size was
Tiny all right let's make my page size a
very normal that's a normal page
size
all right good we have normal P size all
right uh let's call this
buffer M1
dram let's first do an element wise
addition on these two and then we have
M2 dram and I hopefully I can reuse
that you know what I want I want Shashi
magic chicken and we're g to get some
shansi magic
chicken
we're working hard
today I really didn't want that as ball
and I don't know why I bought
it shansi magic
chicken you guys have you guys ever seen
me get shansi magic chicken before it's
delicious a sauté spicy chicken with
hand pull
noodles okay so we got two drams we made
some drams oh we can get some addresses
all right
cool um let's give them better names
like Source One and Source two and by
one and two I mean zero and
one okay well I call him that Dam buffer
it's a little
explicit okay we'll be
explicit this is C++ we should have long
variable name
let's put these
addresses is there a way to get more
debug information that'll like print
about the allocations and stuff yo
that's cool that's cool how they're just
like wow I can like see what the numbers
are that's that's cool I don't know what
the first 82 of the DS used but that's
pretty cool okay um and let's make a d
buffer as
well I do like that new hardware is like
this and they haven't managed to like
off escate pointers like crazy and they
just give you well okay Ram starts at
zero and then you count up kind of love
that all right uh oops tie bu I was like
what M the same buffer free shit let
go uh Colonel print what do we
have DD print all I
want wait I can print from kernels
that's kind of cool does that
work
I
ran wow look at that terrible looking
macro de
print what do you OD this is going to
work it didn't
work
um may I have to like de print
ches oh I ran cool W that's actually
cool go work 10
T that shit never works on gpus like I
feel like it's supposed to to work but
I'm like you
know great so that's being printed by
the
colonel all right we made some buffers
let's try to read from from the buffers
let's see if we can read from the two
buffers and then uh like have them add
two numbers and we'll see if we can
saturate the uh the
bandwidth
um okay well we're GNA have to somehow
tell it that it's
a oh that looks shitty what even are
those numbers can we why do I need
L1 okay
see have to create an L1 buffer
[Music]
to wow that's a lot of
L1
okay it's all the same except let's just
make my
L1 that
big
um
one buffer
address wait like is this like
real can I just like look at these KN
coordinates and they all actually the
same
is a programming model like Cuda well
one of the really cool things that you
see right away is this core range like
Cuda doesn't have anything like this
Cuda will not let you put certain
programs on certain cores I wish they
did but they
don't even though they it should be able
to like the GPU in theory should be able
to like I should be able to use my
compute units independently but their
schedulers are not uh are not great okay
uh what oh why I put a b
all right are these KN coordinates like
real L
want I hate can you put T Tor can you
make this in Python some of us really
hate coding in C you
know the stream has to be done by the
time it's you know
dinner um all right well they're all on
one comma zero so I'm not going to waste
a lot of resources passing those in
all right we're going to have to pass in
some
buffers let's put in less runtime
ARS you have to make it generic what if
someone's running on Wormhole 72
Edition blah blah blah
blah this is also
boring
you know what I need I need co-pilot
this is actually the kind of shit that
it would help with one of those crappy
AI coding
assistants you know normally I hate
those things because I don't code in
such verose languages but this is insane
who codes in
C python coming up I sweet yeah this
should be in Python that'd be
sweet um right let's set the runtime ARS
fucking AP
space Dam copy kernel ID we just called
it kernel
ID program kernel ID core why do I have
to pass the core to runtime ARs and
create
kernel I guess fine
whatever um why those
green back to the s
okay L1 buffer
yeah all right
um
colel
bu
address where's time to type all
this
all right great we got the arguments
wouldn't it be cool if they could be
like passed in as like actual arguments
no that's too much to ask for all right
not wasting my time with that we know
that it's just one comma Zer but George
one time it's not going to be one comma
Z and you're going to be upset yeah I'm
aware great for both garbage all
right
knock I'm actually kind of curious can I
print
that see what this actually
is Minecraft tutorial that's
right all right well that'd be cool if
it had like some like
spaces can it print it
hex or does it only print in numbers
numbers are
sad direct printing is supported Ford
printing includes macros
hacks all right let's get some
hacks all right well once you get the
knock address oh I see it just like
shifted some shit all right great well
I'm glad we did
that all right we have to get these ones
from the knock let's get the D Dam
knock from desk
d and
then I don't
know
that it's pretty uh
we're going to read it into what that's
the parameter that's the one that gets
it this is D and this is Source who
wrote this why would you do that did I
do it backwards you're reading from this
into that where is this
defined Source desk size
oh oh why would you do that why would
anyone write the
T me copy D Source size not Source Des
death dram
knock knock a sync right there all right
let's go this
work cool let see if it actually does
something um I actually want to read
these both uh I do this we're going to
have to give it double the L1 let's
let's do pointer
arithmetic
um close
that I what is Page size and why does it
matter Point
arithmetic o can I put the re barrier at
the end of both of them oh that'd be
based
go no I plused I plused it I did plus
and I made that the
size wait no I just broke
something wait I come how come I can't
plus it like
that I made the size
that
now I broke
it
ttmi D tr0 what's TR is r
uh now it's not allocating
anymore we broke
it but I understand why it doesn't work
though I allocated
that I mean I guess I didn't assert to
see if the allocation
failed what do you mean no I did
that no it's it's always just one and
zero it's never it's never not one zero
that's not the problem
um why what's where is this hanging
now boys I broke the 10 stor
card I should reset the board I am
resetting the
board I broke
it uh oh it's getting hot
what do you mean I am constructing a
knock address from
that that's what these zeros and ones
are it works
fine at least this computer reboots
fast hopefully oh that's really power Cy
we really power
cycle I if reo's going to
work
but I don't understand why my plus 100
plus a th000 didn't
work all right we're hard par cycling
the
computer
it is blasphemy in the ml world you're
right you only have two knocks it's not
like it's going to come up with a lot of
different things I'm not passing in all
those arguments that one involves so
much
typing which cases is a CS degree useful
it's useful for getting nonsubscribers
bannned from
okay all right we're
back T torent TT
twitch okay let's not break the card
this time
ttmi
can I print L1 address yeah I
can
reconnect
you why isn't this
working what
for
ff00 and I'll put the size back to
that still
ff0000 I'll put the page size
up I don't really know what the page
size does oh now we got something
different oh no
fe0 oh I see so is that
like size and by size of unit being
inter leave for non oh don't inter leave
your buffers oh
good I knew I wasn't supposed to inter
leave my
buffers wait but that should be okay
with e 0 right that's fine it was just
my page size that was wrong because they
were like supposedly interleaved or
something that should be fine
right
yeah
Yola it's fine it's got to be fine
because that's FF and that's yeah okay
any L1 address should be larger than
that seems okay
right yeah we're
good no no we're good we good we're good
I know it wrapped around but it was just
good I didn't set my page size correctly
but now that I set my page size
correctly let's just call this progress
I'm going to create a quick uh GitHub
new repo for
this name TT twitch T Tor colel from
twitch
public great care
repository oh remote
denied
there you go anyone wants to play what
do you even make a PR
directly that works
fine okay um this is all well and good
but now I want to like let's say I want
to like add things
[Music]
so that's
stupid let's look at at some demos so
this is fine for like data movement and
stuff but it doesn't show me how to
actually Access
Data let's
[Music]
here
here we go element wise what's
[Music]
SFU Sundown flash programming utility
oh never heard of that Acron
before yeah yeah yeah I'm doing an ad
that's what that's what I'm
doing um all right let's look at the
examples in TT metal uh not that not
that
that's one is binary okay two wow this
looks
complicated
um using circular
buffers what's a circular
buffer
a fifo in between kernels oh I see so
they have like
a b risk and C-
risk something else you I see so it's
got a reader and a writer all right
let's just like not do it like that
let's just uh let's start by just doing
it in this kernel
here okay so how do I
like can I just like read L can I like
dreference
L1 no I don't need two kernels I'm doing
one
kernel I just read l so I can like
dfference L1 so if I just were to do
something
like sick
[Music]
um I don't know I designed this for just
do these I don't want to think about d
right now
so
yeah
the math
engine I don't use the math engine that
sounds
complicated I'm using the plus we'll get
to the math engine
later uh
well invalid
conversion
invalid
types for a subscript you
sorry what no I
don't you saying oh oops no sorry right
I just forgot
did okay fine
uh oh that's
probably
that
F0 oh it stays in HEX
mode whatever Let's uh let's copy in
some
A's you know what I'd love to do right
now listen to some copyrighted music
some of my favorite things to be on the
stream oo a play
that's my favorite place to eat crinkly
candies right buffer all right well
let's
uh buff input V
Vector
VOR yeah you want to see some Elite C++
boys C++ is so fast that you can just do
things like
this input V Dot what is it push
back God how does code in this language
let's see if it says D
AA no matching
call
have to be
that DM's
big buff page
size buffer Pages must fit within the
command Q Data
Center
400 buffer. page size less than I knew
this page size was a
scam oh let's make them small
is that gonna
work sweet oh look at that D AA
yeah yeah all right I don't know let's
do this math in 32 bits let's really
let's really Flex this processor let's
Flex on
him let's Flex on this let's goy is it
big Indian or little
Indian that a a bbcc all right we ready
to do math let's do
math in Cuda this would be very fast
so let's try one +
one then after we're done we're going to
read the buffer how do I read the buffer
does this work and you read buffer I got
do is that going to be the whole buffer
that's
disgusting
all right let's not add one and one
let's add 13 and seven let's give it
something
hard all
[Music]
right that
crap oh fuck C++
death dram buffer doesn't
fit an output Dr buffer we don't have
that we have a desk Dr buffer reading
there all
right I knew it couldn't do I knew it
couldn't do a oh no we just for got to
send me call that's
fine
um
21 what's 13 + 7
guys
no no it's
[Laughter]
20 I did put in 13 and seven
right it's cheating at
blackjack no what did I do how did I
even do that I put 13 and seven I put
them in there and then I got the result
and I added them in the
kernel
um oh oh no no no sorry sorry
sorry my bad I still don't know why
that's 21 oh it's hex all right never
mind all right we made multiple mistakes
and they almost canceled
out the one a check some
20 all right look at that look at that
they're using tens Tor to add numbers I
knew it could add numbers
guys H all right let's figure out how to
use the math engine to add numbers
fast where's shansi Magic chicken
[Music]
chicken used Devon and he said 21 guys
it's coded by it's coded by 10 IMO gold
medalists I'm sure they know what what
13 plus 7
is
for
okay now let's read about the math
engine my magic chicken I forgot how far
away it was but it wasn't here I do know
that 12 minutes until chicken time those
are Uber minutes so it's actually
probably going to be more
like all right you sold you too can buy
a 10 torrent and add
137 right can I make it big but make a
page size
small
intered oh no don't do
that segmentation
fault
don't oh it might be the allocation that
succeeds actually but then it tries to
copy from more of the VC than fits
that's actually probably
right yeah that's probably the
problem okay that's
fine math engine works on 32x 32 tiles
so we need to BU float tiles oh God why
can't I just use Cuda P would just make
this code
fast no wait a second don't I have lots
of
cores what if I use lots of cores to do
this does that fix the
problem all right let's read about the
math engine so first we're going to need
circular
buffers um this is for
communication this looks
hard oh cool I can just make up whatever
address I want I love
that um we can control the math
Fidelity compute
config
okay passing in some configur ready
oh data movement
config all right so let's read this
whole thing how does it know that this
one's a I see so you have data movement
configs and you
have why are these on different
processors what's a b risk and what's an
NC
risk
what do you mean it doesn't matter are
they the
same do I have to put one on one and one
on the
other basically yes okay
great
um I see so this program's creating
kernels
to I only need one data moving kernel
why does this one have
two it's
optimized what if I have no data
movement kernels and what if I just put
the compute in the
data okay I
see what's this let's read
this low LEL CS oh
okay right these are good
wait kernel apis oh okay okay this is
understandable
circular
buffer a ring why isn't it called a ring
buffer compute Kernels have access to
the math engine but they don't have
access to
ramp and it just depends on and it knows
what kind of Kernel it is based on what
like config I pass in
here I see okay data movement config
compute config ethernet config I
say but like I can still like both cores
have the
same yeah yeah no I get that um but like
so each core has
[Music]
a compute and data transfer kernel I
see oh I see so actually on each core I
have two risk
processors and I can put the data on I
see I understand so like I put the data
on
uh
on one of them or the other one but it's
they're all still on core 0 comma 0 and
I actually have 120 of these
cores am I understanding this
right
each core has five all right all right
cool what are the other
ones stupid thing with the
commas to run data kernels three cores
run the compute kernel I
say place my
content loading
scene
let slow
it wait so can I create three compute
kernels or is it the same compute kernel
that just runs on the three cores
automatically three risks five one
compute
automatically wait where's my
picture I don't get a
picture
SRAM DM kernel risk
5 circular buffer goes to compute okay I
understand this yeah this is fine
and so basically these five I don't
exactly understand why the compute is
three separate
processors uh maybe I'll try in cognito
it'll work just
St missing
dou a w at the end
oh I see
cool where you can find that
W oh I see I didn't okay never mind my
bad uh okay so this is knock zero and
knock
one um the computer kernels are
automatically multiple for some reason
seems reasonable I guess
I see so these are just yeah they're
just circular buffers inside the thing I
mean this is this is yeah this is this
is a lot
smarter uh you see why this is better
than
gpus um gpus use the same stupid uh
instruction stream for the uh like this
is it's so annoying in time
that
the like it uses the same basic ALU to
compute all the data addresses yeah this
is what you
want oh
cool very
understandable
yeah look there's a lot of things on
here that are better than
gpus it's just you know underpowered
right
now
uh well
actually can I can I use can I are both
data movement current like can I use
them both to read because that's what
you want to do most of the
time yeah okay
good like most most things you're doing
are basically reading from like weights
and that
yeah
I mean I'm curious how this stuff's
implemented so like can I read the
implementation of
uh like I want to read the
implementation of like no a and
greed where is that
written
where's the code for
that well in data flow a oh here look at
knock async read one packet oh okay here
we go cool oh great oh I'm glad this
stuff's open source good you you'll you
you'll do far better if this kind of
stuff's open source cuz it really it
really bothers me when it just like
links to some stupid thing because for
some reason they don't want to show off
their like their
mm uh and yeah all right cool so let's
just Pok some M that's very
[Music]
reasonable uh yes
D read any L is just some
rapper yeah that's
cool
now how flexible is
it uh just just just
linear I guess if I have a whole
processor it's not that big of a
deal yeah there's some things here
that's way ahead of
gpus all right these are the compute
apis so let's find
those uh Hardware Inc see that
folder
okay so it's custom for gray
scale you can just leave data shared in
L1 between kernels I don't know if all
that
um what's this compute stuff all tiles
in
it llk what's an
llk I don't know if looks compli and
this much more complicated than the dma
engine gray skull metal llk
API wow this looks
complicated why did that link me a
wormhole end up in
wormhole the wrong one the wrong
one
so is there any stuff about
how like this is running on three risk
processors what's the actual code Cod
that's that's being broken down to the
uh no yeah no I I know this this is not
obviously but
uh no I'm I'm curious how it actually
talks to like the three I'm interested
in the three compute engines because
this is something I don't understand
like there's three of them are they
running the same
code
task
splitting this like a thing I can Google
somewhere I never heard of
that but
like that doesn't really make sense to
me um they're running the same like
instruction code like so I I see that I
can dispatch three kernels to the same
core but these three are just like some
of them only listen to some are there
any docs on this or there's there's
three different three different
programs
B level
kernels Bel is a simple example of okay
sfpi is a programming interface to the
SFU consist of a C++ W around blah blah
blah blah to generate SFU instructions
okay so it's an EXT it's a it's an
extended instruction set which is fine I
can see that here it's not done with mm
which I guess would kind of be
unreasonable for
compute
um T
risk no I I mean I get
this
think
all right you have a different kind of
map engine for both of them that's
fine
UI know but can I dump the can I dump
the
programs I guess this isn't really
compiling three
programs I guess I need to compile a
compute kernel if I want to if I want to
see what's going
on
like I'm trying to
understand this code is identical for
the
three I don't know uh maybe it's magic
chicken time and then we're going to
figure out how to compile a compute
kernel we're going to figure out how to
dump the risk code
it's not magic chicken
time uh no this is this is making me
quite bullish on 10 store guys
like um
this file
okay oh I'm wearing
sweatpants that's the kind of morning it
is I woke up early for this stream
boys
no okay let's write
a look at Matt Mall
tiles oh I see okay there's ah unpack
pack okay okay no no no I think you're
okay I think I know what I'm looking for
so it's the UN yeah yeah yeah I get it I
get it I get
it
okay
yeah okay good good good totally
understand totally understand what's
going
on yeah so it actually is just compiling
three separate binaries so there's five
binaries
pack uh math so I guess they share
registers oh we can get into the levels
of this and it' be fine
but three-way two-way dispatch I mean
this gets into CPU stuff I don't
know but they pushed my
chicken DM kernels are one to one
okay
um comp kernels 1 to three okay yeah I
understand cool uh so let me just read
that bind minity I guess the last thing
I'm not really
understanding
is how they're being dispatched but this
should be pretty easy to just understand
okay so here we create the kernel we
create this is a good example let me
just build this
example
um
let spin up my whole
thing why that
requires
okay so we create three
kernels
uh a
reader a
[Music]
writer because we're creating a new
program you must redeclare all the
circular
buffers don't exactly understand oh I
guess circular buffers are created for
some reason on the
program there were good docks somewhere
where did those good docs
go create a circuit buer an element
memory for all cores within core ranges
inclusive and adds it to the
program be a total of two circular
buffers per
core if a config is specified by the
circular buffer address space is
shared how does that
work yeah okay so create
kernel set your runtime Mars on the
Kel oh
oh I see okay so a program can have
multiple kernels bound to
it based on okay okay okay this is
sensible I I Now understand sorry for
saying that I was making fun of the open
CL the open CL API has a concept of
programs and kernels and it's the
stupidest concept like I don't know who
wrote that in the API but it's
nonsensical there uh I thought this was
just copying that but no this actually
makes a lot of sense okay you create a
program program is multiple kernels
create my three kernels bind them all to
the
program write stuff to the thing all
right I think that actually
finished see if it
works
um
okay
great yeah progr have 120 different
kernels I understand
that no I mean that's a huge like gpus
basically have the same thing so like if
you look at like the 79 100 XTX they
have these things called compute units
but the scheduler is a global scheduler
and it's it's
annoying Nvidia is pushing away from
this now with some of the h100 stuff I
haven't played with it that much but
yeah I mean what you really want to do
is you want to have kernels that are
like dedicated to different things you
want to have some Colonels handle memory
some Colonels handle uh
handle
math um it's it's rare that you want
them to be the same but uh so this is
yeah this is this is interesting that it
actually just sticks all the cores on
one and I knew this this was presented
to me a while ago but it's cool to
actually see it okay unfortunately this
API is hell of a Bose I could WR such a
sick python API for this oh like imagine
a sick python API where it's just like
you pass it in three strings and it just
gives you the uh the
program
where's my chick said it was here said
it was close magic chicken magic
chicken recently tried to contact
me go
outside I'll figure it
out
oh I hear I hear
steps
check num tiles
one what are
tiles I guess we'll know if we look at
this
program
tiles so this knocka and knock
Y is this always one and zero like how
much can those
vary like what are those are there only
two knocks I think there were two
knocks
chicken guys are ready to experience Shi
magic
chicken
have eight banks on GS oh I
understand
yeah can you see the chicken it's
chicken even
time you can't see the chicken oh the
chicken I love this chicken
[Music]
so it comes with these big flat like
hand pull you know those like hand cut
noodles kind of where the guy does it
with like a knife and like Cuts them
apart all
right if eating offends you
and this is in Japan so I can stick my
Chopsticks in like
that
oo GS sock or gray skull I assume oh
when you say GS you mean gray skull
okay um worker cores eight D Ram oh I
get it that's the one comma Z it's right
there one comma Z is right there that's
why we got one comma Zer oh that makes a
lot of
sense um
cool so I see I have to do the
[Music]
addresses I understand too it's probably
like I mean the Rams are actually each
like it's eight different Rams like
completely
oh is that what interleaving
is I mean cuz really what you want to do
to like maximize bandwidth is you don't
want to put the whole buffer in one
thing you want to share your buffer
across
uh all
eight do the
pages okay that's
sensible
um I would not expect there to be a read
barrier there
oh I gu you have do that okay never
mind file issue for one of your
requests my my beautiful python
API oh
yeah yeah
um it's just how man copy
is
okay pack math
unpack well it's so explicit about data
movement One Core to do math four cores
to move
data really want to zoom out here get
the big chicken picture here are we
liking the chicken eating part of the
stream we'll even let non Subs talk
during the chicken
part controver on replacing no one's
getting replaced by AI
man where's the
um
Marvin Minsky
1970 article replace
AI um a here here we
go yes Marvin
Minsky can I find the
actual can I find the actual Life
magazine
article no just like an
article I saw it I want the full
article
the full article's hilarious to
read
he was not misquoted I've read the whole
article oh here we
go can I see that page
the internet has too many
ads
we got a slightly longer quote from the
article ah here we
go this is from Life magazine in 1970 so
we're talking 55 years
ago Marvin Minsky of mit's project Matt
recently told me in from 3 to eight
years 1973 to 1978 we will have a
machine with the general intelligence of
an average human being I mean a machine
that will be able to read Shakespeare
grease a car play office politics tell a
joke have a fight at that point the
machine will begin to educate itself
with fantastic speed in a few months it
will be at a genius level and a few
months after that its powers will be
incalculable
okay so for every little fuck out there
who tells you but I saw Chad GPT CH
GP I think that all jobs are going to be
replaced in 3 years they're
not and Minsky was friends with
Epstein I don't know look I'm not going
to hate on Marvin Minsky a lot of people
have thought this kind of stuff but and
also in
1970 you were more EXC it was more
excusable for you to believe
it like if the year was 19 7 you didn't
know better this year you should know
better AI is cool computers are cool
computers can do a lot of stuff
computers are going to be able to do
more stuff all jobs are not going to be
replaced in a few
years I mean it's like dor shit it is it
is and then then the worst part is like
Marvin Minsky at least was not a Doomer
he was an optimist about this stuff
it kind of would be cool if that was
going to happen but it's
not what about
driving I mean you've seen the progress
there's some progress it's okay I'm
working on it ches is working on
it when can we replace te Bros I
mean do you got if you consider me a
tech bro
never um
like people like me are actually
probably the last people to be replaced
except maybe
for there'll be some guys who want
hookers that are genuine humans and
there's some people who want like a
genuine human to suffer and those jobs
will never be
replaced people who want the real thing
not just a fact simile no no no no no
you don't understand it's not about my
enjoyment it's about their
suffering
um you wanted to add a girlfriend you
can have one today there's not very good
I mean for some guys it's probably
better than what they can get not for
most yeah Rita Casino
Odyssey
you trying to open the
door would you like to come
in do you want some chansi magic
chicken on
stream oh I hav't tonight I should all
the magic
chick I had as ball this morning too
myice
what do I think of be's chip I think
Quantum stuff has a long way to go to be
useful there been a lot of quantum
startups
and what you end up finding usually is
that they can solve the problem but the
problem isn't exactly what you wanted it
to begin
with um
d-wave I don't know I mean you know I'm
bearish on Quantum in general I think
that P equals
bqp
um so I think that anything you could do
with a quantum computer fast you can do
with a classical computer fast you just
need better
software is this Hardware similar to uh
Gro Gro looks a lot more like a
TPU um no this is something entirely
different and one cool thing about Tor
is like they're thinking about the
future beyond the current training
Paradigm
um I'm not I'm not bullish on
grock um again if grock had a card that
I could buy for $800 and an open source
API I might be um but they don't they're
trying this stup stupid like Enterprise
sale can I buy a Gro
card can I buy a Gro card without
contact
us and is any other stuff open
source get in touch no
oh Bon Master okay okay hang
on
$20,000 yeah I mean they do have
one but it's
$20,000
also is there code open source what do I
get if I buy this
thing the official
python oh God no this is this is like
opening eye level
shit okay okay here we go grock flow is
the easiest way to get started automated
compiler what's in
here do they document their chip
anywhere I'll take back my hate for
grock when they document their chip and
they charge a reasonable price for
it but until
then
and
well I mean Tor is the newer Paradigm so
we know that the brain doesn't do a
backup like the brain
um regardless of what scale you want to
do it at like you're going to have to
break things down to smaller uh work
units Nvidia has pushed so hard on
having a full fabric memory
like Nvidia has 900 gigabyte per second
across a data
center um this is insane I mean it's
incredible
engineering but it's not the future of
neural
networks like Nvidia has gone so much
out of their way to make it easy for the
software guys and this is why they're
crushing it right
now oh thought you've heard about Tha
complex 7 oh we're going to build fall
complex
7 um AI Hardware companies are not as
much of a scam as other Industries I
mean some of them
are again you want to figure out if
something's a scam or not can you buy
anything from them if you can't buy
anything from them it's probably a scam
or too early might be too early but
probably a
scam contact us
scam all they
say when they're doing contact us is we
know that we're not competitive in the
market but let our sales gu try to talk
you into it
anyway
so can buy
this
no I know you can buy yeah I mean you
can buy Grace now that's the only reason
I'm talking about it wait why is it
still
that oh that's just a
bug we should fix that
link no the only reason that I'm here
doing this is because Grace Gull is
openly available on the market I do not
care about anything that people other
people can't participate
in I paid my own I paid my own 800 bucks
for
it um yeah so Wormhole didn't look that
much
better wait
what
like it's still 12
nanometer uh it is cool that it has the
uh the
link I that seems to be the big
advantage of
Wormhole
um
I mean I don't know if I were
uh if I were t t and I'd switch to Tiny
gr um and make the simplest most
beautiful API to expose like what I was
playing with
today there's so much unnecessary
complexity um built on top of like what
really a pretty simple compute
Paradigm because it's just unsustainable
to do it a different
way like if you don't have something I
mean you don't have to necessarily use
tiny graad but if you don't have
something that looks like tiny grab
you're never going to be able to keep up
with the state-ofthe-art machine
learning because the problem is like
Nvidia doesn't have to keep up Nvidia by
being the
state-of-the-art can just
um can just everyone ports to Nvidia
anyway everyone designs for NVIDIA AMD
has a um has an interesting follower
strategy where their card is similar
enough to Nvidia that people will choose
it just based on price um the Mi 300X I
saw Microsoft got them for 10 grand like
you're paying it's it's half off an h100
basically more than half off um and at
that sort of price break people will
tolerate some amount of annoyance in the
software but not uh not much um but only
because the the two gpus the the Mi 300X
and the h100 are so
similar that um that AMD can uh can be
competitive um if you're trying a
different Paradigm thing you are never
going to be able to build something that
looks like
Buddha um because you won't keep up with
Stud AO machine
learning like you need something that
transpiles
to like a much sort of um better
intermediary I don't know what
neuromorphic Computing is and I don't
think it has any
meaning I think that tens torrent looks
a whole lot more like a neocortex I mean
like Gro and gpus have taken a
completely this does look kind of like a
GPU
um it's a GPU with a better scheder and
better control but like gpus are going
to we're going to kind of see merg the
h100 already has a lot of these sort of
like tensor looking
features um like look up the tensor uh
it's a TMA it's a tensor math engine
it's like a fancy
uh it's a fancy dma engine but it it
kind of can replace the load kernel but
you could even have like a straight up
load kernel
um like like what tor's doing with the
risk five that totally works too uh it
might even be
better
um also having like a grd grid
architecture like this you're going to
need a grid architecture at some scale
so why not start that scale
smaller
um you know we're uh we're pretty booked
for the rest of the
year but after the year is up if you'd
like to contract uh the tiny Corp to
build a
uh a cleaner more functional Port than
yours
um we can do
it I'm interested in building some of
this stuff generically
anyway I'm interested in building
um like like so so here's kind of what
I'm saying the the thing you call the
graph compiler should be
generic uh I mean a port that runs tiny
grad on uh on on this uh on on gr
skull in normal
um and I think I can beat most of your
most of your examples I mean like it's
not only could I beat the examples like
you saw me try to use Buddha and you saw
me try to do something that like looked
obvious and it didn't work uh but it's
not even just that the the problem comes
down to there'll be new Ops added in
deep learning people think like
attention is this oh we're going to have
attention forever we're not in 5 years
people are going to be like oh yeah
attention that was cool that was like
like early like early 20s
AI um well now again I'm an overpaid
contractor and actually what I would
rather you do instead of paying tiny
Corp what I would rather you do is Port
it yourself to Tiny c um focus on
building a beautiful python abstraction
for as low level as you could possibly
get uh I think your kernels like I I can
see the python abstraction already look
I'm even too I'm too lazy right
now um where where to plug in you want
to plug in at that layer that I'm
playing with now
um You don't need like you don't have to
go to the mm layer you don't need to
make a risk five compiler don't do any
of that stuff but
um you're going to want
to it's not so it's not it's not um yeah
have tiny grad emit the
kernels you're going to need to make
some changes to the linear so right now
the linearizer emits one UOP stream and
this one UOP stream includes loads
compute and stores all in the same
stream but it it would be like a 10line
change to emit the loads computes and
stores to three different
kernels
uh and then you're going to want to
write a runtime for Tor and this runtime
for t torant uh should wrap your C++ API
so if you have a stable C++
API um you should just wrap that with
python such that it's like a simple like
here's my kernel here's my source
code
um yeah and then like the things should
map pretty well like you can definitely
deal with
like Dam and L1 like it's that all that
all works in like the shapes yeah use
tiny got to emit the C plus cels
directly
absolutely um again it's it's not that
different from what you already
have you'll have to write a renderer
you'll have to make a change to
linearizer to split the UOP stream for
loads in like loads and you use like
those circular buffers and the
cues yeah I know you don't admit the
kernels and I think that this is like
this is exactly what I'm talking about
will never
scale if you're prewriting the
kernels like you'll never be competitive
with uh no I understand I I I I read
briefly what Buddha was but if if you're
doing that you're never going to be
competitive with
Nvidia um because there's always going
to be new Ops and you're always going to
be behind versus like you tiny R can
emit the kernels can emit the kernels
for you
um again for less money in a contract I
can get a functional tiny grad Port
there's like a functional tiny grad Port
then there's a fast tiny gr
P um you should be able to have
something functional and then the minute
you get tiny grad functional all of our
examples work including
train like we now have we now have
resnet uh
we now have resonet 50 training on a
tiny
box we'll have all of ml perf by the end
of the
year but yeah no no admit the kernels
definitely admit the
kernels like that layer I'm playing with
is the right
life
um
no I'm not
using oh I like for perf what you want
to get working no no see that's the joke
right so don't optimize your kernel
generation figure out how to
parameterize your kernel generation and
then use
search
so this is one of my favorite documents
the bit
lesson
like read this document stop trying to
hand optimize things and figure out how
to parameterize them and use machines to
search yeah so tiny gr has a has an
option called beam and this is how we
are we're not beathing torch we're
better than torch on on M1 and on AMD um
but only if you do a big beam
search um which will just search you
know a thousand permutations of the
kernel that are all correct and just
figure out which one's the fastest
computer go bur there we
go
um also don't prematurely optimize I
mean this is just classic like it's not
like your Wormhole chip is ever going to
be your gra chip is ever going to be
fast no no no no no I I don't
want so here I can show you in tiny grad
how the
uh yeah if you have like a like a mat
Mall kernel thing the tiny grad uh Cen
can deal with that if you have something
that looks like a like a
Wham so here are the tensor
cores like the tensor cores are all just
specified right
here um so like I think you have like
32x 32 by
32s whatever you have you can just
specify it
here
yeah it's it's really easy
like this we have working the I we have
all three of the tensor cores working
the AMD ones the Nvidia ones and the
meta
ones
[Music]
um yeah okay so you want to turn
the the chip into a systolic
array I wouldn't worry about
that I I
see
like in each one of your cores you have
something that looks like a that looks
like
a what you're talking about there is not
what you're talking about there is is
like what's called uh like locals in a
GPU so gpus have like like warps but I
think each one of your cores is an
entire warp cuz your cores look more
like a compute unit on a
GPU so your core is a warp and then you
have locals on top of that and your
locals can have a grid and yeah sure you
can just like don't worry about the idea
of like we're making this a systolic
array for multiplication worry about
saying if this core is trying to load
data that this core already has just
fetch it there right you you write that
primitive and then that primitive scales
to the entire chip instead of trying to
like plan the entire
chip um everything in tiny gr is 100%
static meaning
[Music]
um meaning you can pre-compute all the
uh memory
accesses we're done with chicken
[Music]
now okay I think we're going to put
chicken in the
fridge we're going to get a little bit
of
coffee and then
[Music]
uh should we write should we start
writing the
runtime like it'll be
beautiful all right well we'll write a
little bit of runtime we we'll get some
Colonels working from
python um and then we'll call it for a
stream thank you thank
you we'll see if C types can generate
C++ garbage
let me take a let me take a 5 minute
break um I'll be
back
e
e
e
e
for
e
e
e
e
e
e
e
e
e
e
e
oh hey uh what I didn't really say uh
about the systolic aray thing was don't
worry about speed worry about
correctness um what I found so now timey
gra is speed competitive
on uh apple and AMD compared to torch uh
the speed of tiny grad at the beginning
was completely non-existent we focused
on correctness and I think I think you
can always get speed later just by like
adding tweaks to make things more
correct again there there's nothing in
tiny grad that's fundamentally slow it's
incredibly flexible and can generate I
mean it generates all the kernels right
like if you write like a if you lock
yourself into like a m m kernel that's
slow sure it'll never be fast but
there's nothing fundamental in tiny guy
that's slow um and we can always add you
know after careful consideration new
abstractions if you need them but I
actually don't think you do uh so let's
look a little bit at the what I think
the right layer of abstraction is for
the
card what you like detecting a thumbs up
what the hell is this is AI do you guys
see a thumbs up like you're
detecting what what is this some like AI
detecting a thumbs
up that's
creepy is creepy all right
um
okay
so uh let's take a look at what
the it's a Mac camera feature weird uh
let's take a look at what the
uh what the tiny grad abstraction is so
we have a compiler a program and an
allocator and a
device so we're going to like this is by
the way this is the whole abstraction
like you can read this this is all the
code you need for
metal um in tiny gr so what would it
take to
transform uh 10 torrent to be
uh to be to be
similar
so let's write
example.py so we're going to have
something like uh just WR out a compile
function so our compiler is going to
take in Source risk
zero um let's let's try to reimplement
the element wise thing but in Python and
in like a readable
way uh let's Implement
Alec
so yeah there's three kernels there's
risk
zero uh risk
one let's also get that magic TT metal
home uh so we
have Source risk one by did I put mine
on risk one or did I put mine on
uh
on
uh that's my kernel where's my main I
put mine on risk zero so I guess it
doesn't really
matter uh is the ISA documented sort of
I mean all the all the the stuff you
maybe the firmware is not open source
but all the stuff you basically want to
see is open
source and the the schedule is explicit
so like we have like Source risk one
actually let's not call them risk let's
call them
data uh Source
compute
um also does this one allocate any L1 so
I found it weird kind of that it could
allocate L1 you don't really want to do
that you want to
um like use the circular buffers I think
I I think that yeah sure maybe you can
like use the L1 for longstanding kernel
stuff and keep it allocated I guess
that's the point of it but I don't know
why you want to do that yeah I can keep
chairs I mean some
day Shard and your tensor across the
whole thing you keep them resident in L
one yeah that's cool
um I see uh so yeah you sharded across
uh all the
cores I guess what I don't understand
about that is when I Al this L1 is this
on every
core on every core okay so this size is
actually times
120 well times inter leave but where do
I specify inter
sh how is it shed on core range I create
the buffer long before I specify a core
range
interleaved the D is interleaved
too and then also another idea I have
was so all of these
kernels uh unless there's some reason
you can't do this all of these kernels
pass in the address the source the knock
X and then call this get knock
address but why don't I just do this in
yeah why don't I just do this
in why don't I do that in C++ and then
pass the real address in here instead of
passing I guess do the ARs have to be
you and 2s why don't I just pass in the
u64 knock address and then like compute
that beforehand and not at
uh not at not a compile
time okay so circular buffers very
notably apply to the program so you'd
want to specify your circular buffer
stuff
here uh at at compile
time
I don't know processor knock
ever yeah
um compute inputs data flowing out
compute
outputs all right I mean I could like
I'm okay also with being like
opinionated in the AP and doing
something like
that and
then
okay so a
a allocator and Tiny grad
has it also has copy in and copy
out notice my use of Destin
[Music]
source
so these are Opa
pointers
remember that one where was just
specifying like addresses for the
circular
buffers oh it has to be a vector 32
uh don't need to specify any address for
CBS what's a
CB oh I
see uh yeah yeah there there were other
things that uh there was one other
example I saw that that maybe it's this
one that no I don't know where it went
there were ones that just poke put an
address in for the circular buffer but
yeah it didn't make
sense um create a circular
buffer within the core so I
guess I'm more confused about that
but
um
this how Colonels can use inly buffers
just via
address I don't know about
that
we're going to have something like
compute options you see that being P
have a lot here
config how's it do
okay
yeah I mean
the this might be be like a reason we
doing this stream
um yeah I mean these abstractions are
quite
good like if you just this isn't even
like the metal one is pretty complicated
I think like the python one is pretty
minimal uh this is like a compiler an
allocator and
device that a one super
tiny just so much crap in
C++
start with something simple I can do
right buer let's figure out what library
actually contains
this okay TT
metal where build
it so we have it
tiny
graag called autogen
stubs we'll see how well it's going to
work
for
for
m
every time I do this I always have to
fix bugs in this
thing
for
for
[Music]
for
for
all right let's take a look at this host
API
well hang
on can I access this stuff is this
accessible through
uh through TT
lib i t to pay the ass to install anyway
though there python guys for some of
these how
many like can I rewrite this example in
Python is there anything
missing I like you really want your
python to be autogenerated from your
C and not
compiled
and then recompile ttnn no way I'm
out all right
ban anyone who mentions
Devin
okay I don't know how to do that but if
we have any mods do
that I can't believe you guys fall for
that you guys I'm gonna I'm gonna I'm
going to make I'm going to make a I'm
going to make a AI called Karen okay and
you know what Karen does she goes to the
DMV and stands in front of you in line
and just complains about stuff and
you're like Karen we have things to do
and then she screams at you and you're
going to be like wow that's amazing ai's
going to replace so many people's
jobs right like don't you want somebody
to like you know when you're like you're
hanging out with your friends you're
like bro it's fucking retarded and Karen
you can't say retarded there's actual
people with mental retardation are
you're upsetting
right like we can make AI do that think
about that think about that
right Devin is only for VC see thing
about
VCS and the thing about like you ask
yourself like why is the Deep state so
bad right now like why is the Deep state
so much deep stating and it's because
they're losing their grasp on Power and
they know it and so are VCS who respects
VCS
seen Ilia I love those I love those Ilia
milk
[Laughter]
cartons you know poor guy I don't
know like this is what happens when you
you know get involved with with
utilitarians man utilitarians eventually
turn against you that's that's the only
way utilitarian ends eventually you're
you think you're friends with the
solarian but eventually they will decide
there is more utility and you
ding oh man who triggered me you
triggered me with Devin oh my God and
like you're giving them press like you
know he's not even a bad guy like like I
don't even like I saw the people they
didn't even look like bad people but
like it's it's the stupidest hype I've
ever
seen ask yourself would you be impressed
if a human did it right like like like
replace Devin with Kumar okay and his
name's Kumar and you know not to be
stereotypical but he cheated his way
through everything and he managed to
solve 13.6% of issues on GitHub
right like like no no just stop like
replace AI with
people and if you're not impressed when
of people does it why should you be
impressed by AI does it you want
impressive AI Alpha go like that shit's
impressive man beats everybody to go
that's cool a software engineer that
solves imagine we have a car that you
know only doesn't crash 13.6% of the
time right like oh my God no like like
guys we just have to exclude VCS from
polite
Society okay what has ever come that was
VC funded that was
good Uber was good yeah Uber would have
existed with or without VC fun and the
version without VC funding would have
been better abbn was good no it wasn't
Craigslist was
better what did Founders fund from teal
make what do any of these things
make Founders from teal made like paler
and Ander things that don't help you
though you know it is good to know that
pal milwauke is on our side and it's not
going to be you know it's not going to
be it's not going to be the F35 I just I
was thinking last night like F35 cost
$100 million which would you rather one
F35 or 10,000 DJI drones With
Grenades like remember how the birds do
you remember the time the birds took
down that plane and it landed in the
Hudson like imagine the birds are
drones DOD GMC I can't believe you're a
subscriber who gave you
money I know DJI is Chinese
look look I'm I'm going to show you guys
a
video yeah have you seen these
things better one now this
one this is the Chinese military
industrial
complex
okay
e
yeah okay so I'm just
saying all right where were we we were
trying to get this shit to
compile I'm going to end up rewriting
this thing I know I'm going to end up
rewriting this
thing
I'm sorry if you were trying to sleep
you all got an ad for the Chinese
military industrial
complex why are those why is
true
oh yeah I mean we're yeah we're going to
lose of course we're going to lose
they're not even trying you guys you
don't understand America was a country
built on slavery we deserve to lose
Chinese
look I it depends what you mean by
America no there's really like I I think
it's really like getting to a head
where you have to take money away from
these people right and it's the same
people it's the VCS the Deep State the
government the the problem is they're
they own the money printer and they're
friends with the guy who owns the money
printer and you think crypto's better
who owns that money printer right like
like like this will not be solved until
we go back to
Gold this is the only way to fix
this like like everybody needs to stop
accepting the fake paper money or the
fake shitcoins too it's not better C
crypto is the same thing oh but there's
only 21 million of them there there's
not like that that's not a naturally
defined thing it's just defined some
source code somewhere defined 21 million
but no they would never raise the limit
they will raise the limit I promise they
will raise the
limit um you know what they can't raise
the limit of G like money needs to be
based on something that is naturally
scarce or you will always end up in the
in the shit that we're in
today like it it's really it's really
getting to a head
now
well you can try to make more gold good
luck like the only way that this stuff
gets fixed that all the scams get fixed
that everything becomes like like we
have been stagnant since
then yeah golden asteroids golden
asteroid are the most incredible thing
because we're going to have to build
sophisticated infrastructure to go
extract the gold from the asteroids like
that's
amazing right like gold is the perfect
money it scales with us to space like
yeah let's go into space and get some
gold that's a great reason to go to
space you can just mine more gold yeah
you know what happens when you mine gold
you're buying mining equipment and
mining equipment is buying engines and
engines are buying Fuel and you're
stimulating the
economy instead it's it's it's five
people with an Epson printer hitting
print a bunch of
times like like I I don't want to sound
like one of them libertarian assholes
because you know you don't have to be a
Libertarian to realize that like you
can't let the government print the
money it's not just the government who
prints the money it's all the VCS too
where do you think the VCS get their
money the VCS get the money from LPS who
are LPS LPS are just Pension funds where
do Pension funds get the money they are
the government it's all the same shit
right there's there's there's two sides
of the thing there's the people who
print the money and the people who work
for the money and if you're not printing
the money you're a clown and everybody
who works for the money needs to get
some pitchforks together you know what
we don't even need pitchwars we don't
even need pitchwars we just need to stop
accepting their printed money is
legitimate money it's not it's
completely fake it's a bunch of cronies
with a printer
sure you can take your fake tax dollars
and your fake money that's fine but when
it comes to anything real I mean I'm
going to make a coffee shop and we're
only going to accept Gold All right but
we all need to stand strong and we all
need to do this together because that's
the only way this stuff gets fixed
otherwise this will never be fixed and
they will continue the scams will
continue the beatings will continue
until the money
[Music]
improves most money printing comes from
the private Banks well if the banks were
private this would be fine because Banks
can sure Banks can fractional Reserve
all they want but people need to stop
thinking of banks as a secure place to
hold their money and you better keep
your gold under your mattress defended
by a unry with an
AK-47 no I don't want Bitcoins okay
they're they're they're worse they're
dollar level crypto is dollar tier ah
but it's it's algorithmic they algorithm
says they can't make it they do remember
that time ethereum rug pulled everybody
and switched their proof of work coin to
proof of stake right there is no sure
bitcoin's a little bit Lindy right if
bitcoin's been around for 200 years and
nobody's changed the 21 million i'
believe it a little bit more right but
again that's younger than our
constitution right you want to talk
about how Lindy something is it really
matters in money but bitcoin's been
around so long it's been around less
time than Nvidia okay Nvidia shares
Apple shares are more hard money than
Bitcoin
um is to have no owner yeah but like you
know what has no owner
gold or gold is going to happen oh gold
is going to happen right gold gold
happens when everybody loses faith and
all the fake
money why is it doing so well another
question to ask is why is gold doing so
so poorly
right the the problem with gold and the
reason gold doesn't do the same shit
that crypto does is you don't often get
or they put a lot of work into avoiding
uh hype Cycles right no one think gold
is going to is going to 2x in the next
year you don't get these you don't get
these fake hype Cycles which which Drive
the crypto
Market other minerals have similar
properties which
one
no no no no growing economies don't need
the most liquid assets this is
completely fake this is you you've
fallen for a scam you've fallen for a
scam where it's like well we're just
going to print more money so now we have
more liquidity no no no this is not how
it works right what you just did there
so you have a map in the territory right
what you just did there was you had a
map and you're looking at the map and
you're like oh shit we're going to have
to walk across this mountain and then
like you know the guy next to you is
like I got an idea and he pulls out an
eraser and he erases the mountain from
the map oh yeah oh that's fixed oh good
job oh yeah that's going to be so much
easier now no all you did was change the
map you didn't change the
territory he folds it right he folds the
map he folds over the little
Hill
um all right if if we're getting to 1971
it might the end of the
stream we did some good T stor and stuff
we struggled with this stupid crap uh no
we need like a good
python 198 1971 means the end of the
stream you guys
like it is not going to get better it is
not going to get better until here
what's what's the quote it's at the end
I don't believe we shall ever have good
money again before we take the thing out
of the hands of the government that is
we we can't take it violently out of the
hands of government all we can do it is
by some Sly roundabout way introduce
something they can't stop
gold it says something when I run clang
to Pi oh do I have to put it in oh do I
have to like put it in C++ mode or
[Music]
something oh
oh clang C library are different oh okay
okay this this might be
um we have Jamie I don't
know
yeah instead of banning Bitcoin they
approve the ETF exactly
exactly
okay we can have clang
12 are we happy with clang 12 we can
have clang 14 that's not that's not
allowed
I might have to tell it at C++ this
might actually be a real
thing okay we're still getting that same
bug but now it's that I don't think this
matters we can try
it no that's not the
problem but there might be a flag for uh
inclined to fly
for it's like maybe I did like it's like
DX CP or or
something
TV air parsing translation
unit
all right we we have to go back to
subscribers only if we want to do
anything but I agree I agree that we are
the mistake was literacy right the
minute you give people literacy you can
brainwash them and if like most of the
country was illiterate they would
understand but but the money is uh you
just print the paper the money is made
of paper you print the oh no no no no no
you don't understand you see there's an
organization and it's separate from the
government and then there's this thing
called blockchain technology like like
it's
no no why is the money not a coin made
of
gold but where are you going to store
your gold old yeah this is not a real
problem okay people have been making it
work for thousands of years but today we
have more money than ever no we
don't like we don't
no
oh for thousands of years everybody
understood this everybody understood
that you can't have one asshole making
the money out of paper or God forbid
fake Internet money made out of
cryptography wait gold wasn't
brainwashing gold could buy you land and
people mean you Landing people I've
always had value but like those things
still have value today like land has
value
how is this code even supposed to
work
okay those structures and functions
that's looks pretty
good
we had that old thing which was getum
PCI devices we had the
uh can TTL do this what can it do all
right maybe we should be thinking about
this in a different way maybe we should
be going even lower level than this like
what are these what are these metal
things doing why aren't we just calling
PL to do the risk
building we should be able to do running
from TT lib I
believe let's see what's in
here
um okay where is TT
lip
we want this to be free of all the uh
let's move
metal yo should we just be using S
Trace what's this actually
doing
let's let's let's let's let's let's
instead of going higher we should go
lower when they go low when they go high
you go
low all right so these things are
actually being
built what are these
things oh look there oh these are the
dam knocks oh that's
cool
the minute VCS invest in it you know
it's a scam and VCS have invested
heavily in blockchain technology notice
how they haven't invested in
Gold like imagine a VC funded like you
know it's like a little bag that you
keep on your chest where you keep your
gold right you don't see them making
that but oh we invested in a crypto
wallet see that's how you know it's a
scam much simplified element wise binary
at the top here
oh yeah but I mean this is just this
just has wrappers around
it uh oh wait
what I don't understand what where are
these things do well this is in the
kernel acquire eight tile register so
this is a Compu kernel okay I mean we're
not even close to this yet
we're still struggling I'm going to try
to figure out where the risk compilers
are actually being called um to figure
out if we can tap into it at that layer
right because like we really don't want
to use we want to use as little as
possible and get to like
like uh yeah I mean this stuff's
probably fine and there's probably like
a whole like a runtime build environment
that we can extract from this that
includes this stuff it's prob
cool um but I'm just talking about all
like the outer device layer
stuff it asks money from the bank well
the bank can give them gold right like
like like like I just want you to think
about fractional Reserve banking with
gold for a minute right like take
take I bring 10 pound of gold to the
bank
right see with with paper money and fake
databases this all seems kind of okay
but when you actually get down to what
fractional Reserve banking is it means
that they're loaning out nine of your
gold pounds to other people and assuming
there's not going to be a rush on the
bank where everybody comes and asks for
their gold pounds of gold back at once
right suddenly Banks don't seem like the
most genius idea anymore right but when
the money's all fugazi oh yeah well you
see you know the bank has has deposits
to no like I want you to think about
this in terms of literal pounds of gold
right like when I go knock on the Bank
of America door if I'm depositing 10
pounds of gold right like where are they
putting my 10 pounds of gold think about
that right just imagine daycare that
loans out 90% of your child right that
doesn't sound like a good idea why do
you think fractional Reserve banking is
a good
idea
one day everyone will come back after
their children
back
don't worry don't worry don't worry
we're lending out your gold but when you
come for your gold we'll give it back to
you well how are you going to do that if
you're lending it out well you see we're
going to take some of other people's
goals and give it to you we're putting
it in a big gold fat but what if
everybody comes and asks for their gold
oh well like that almost like never
happens also we have like FDIC insurance
and the gold printer will bail everybody
out oh good thing there's a gold
printer
what is it
calling
h
so once we go very very deep down
through tons of crap we found the the
call to
[Music]
system
see this is the problem with all these
crap lares of abstraction your thing is
forking multiple times to build this
[Music]
code oh here we go TT metal backend dump
run command let's see that seems
cool uh all right so where's
my that runs a kernel all right let's
try
that whoa that's a lot of system
commands no wonder it's so
slow these
numbers
whoa what's a command Cube producer how
come I didn't know about command Cube
producers where does that guy
live
well I looked at all the system commands
it was
running and there's a ton of
them oh you know what well my kernel is
very complicated because I'm doing okay
we have a lot more to do before we try
to run multiple kernels we still don't
really understand how one kernel
runs so let's get rid of
dprint does that have less
commands tons of
commands and I don't think there's a
cache oh well no no no that only is
happening because I'm calling the de
print I'm passing in the magic de print
course that did not change the insane
number of system commands that AR
wow good thing this computer's
fast look at all this
stuff we rebuild we be rebuild risk
common every
time o a dispatcher konel oh that's
cool we need to expose
that
yeah okay we we have not gotten to
nearly the lowest levels yet and I
apologize to everybody for trying to
jump ahead and write python cuz we're
nowhere near there yet we do not
understand how this thing works yet we
didn't even know it had a dispatcher
colel okay um let's go
lower
what's BR risk
K
what if you don't believe in Gold you're
being scammed okay that's all I'm saying
how is it for thousands of years
everybody used this but somehow in in
1971 we became enlightened and realized
we didn't need that anymore and then
everyone you
know just just just just really ponder
that
question I mean there's only two answers
to the question one is yeah bombarding
lead with neutrons will produce gold
that's incredible and if we could find a
cheap way to bombard lead with neutrons
that would be great
um but we
haven't right gold has has stayed this
incredibly good I mean gold is still
scarce right gold is still scarce it's
if you could figure out how to turn lead
to gold today you can still figure out
still make a lot of money
um what I'm saying to you is one of two
things is true and you should very
carefully think about which one you
believe one we discovered something new
about the world in
1971 and suddenly money didn't to be
backed by gold anymore and everything's
okay or
two you're getting massively
scammed now I'll note that every single
time in history they've tried paper
money before and it's you know it's not
it's not a brilliant idea you know it's
not like it's not like it took some like
next Generation scientists to be like
well instead of gold which is hard to
find what if we just printed our logo on
a piece of paper and told him it was
money right TR trust me the Romans had
that idea too you know
a physical asset shortage yes yes why is
there a
shortage right like you can't just just
again again like yes you know what sucks
when you have to walk over a mountain
like oh we're going there and we have to
go we have to Traverse over that
mountain the solution is not to fold the
map in half and be like look the
Mountain's gone right that doesn't fix
it that just hides the problem right
sure maybe you'll March along for
another 10 miles and be like there's no
mountains here I have this good quality
map
um it aggravates me so much it
aggravates me so much that like you're
you're arguing with
me like that you're not like you either
believe thing one or thing two you
either believe
that like they discovered something new
in
or you're getting massively scammed and
I know the latter is just like hard for
you to believe like I know no one wants
to believe that right no one wants to
believe everyone wants to believe things
are okay but like they're just
not and they they won't be until like
what we call money is real
again no it's not like it's not like a
little scam right it's not like a little
scam the the entire basis of the entire
world economy is
fake it's like a little scam it's not
like oh you know we're selling some
people like some homeopathic medicine
right that's like a little scam right
that's like that's like a little little
small tier scam yeah we're selling them
water and we told them about the water
memory effect and we diluted rose pedals
10,000 billion times and like and they
put it in their ear and it's actually
just water but they get better because
of the immune system right like that's a
little scam the entire Global monetary
system is completely
fake that's that's the biggest scam of
them
all like the whole substrate is
fake the whole substrate for all other
scams are fake this is this is the mac
daddy of
scams all right
is there more debugging info I can
enable somehow that would be
interesting like somehow I'm pushing
there has to be something that's like
loading these things into memory I guess
it could be the loaders but there's some
like dma engine that I'm pushing over
PCI actually let's take a look at the
kernel
driver I should have right cuz I built
it KMD here we
go all right good it's a very simple
Colonel
driver the character device should be in
Dev I
guess actually open that device
search for
Dev
there we go Dev ttor do I have a Dev
ttor oh I have a Dev 10 store
great command cues are in pin huge pages
and system memory dispatch Curel warning
a device pulls binaries run time AR CQ
PCI cool um yeah so let's take a look at
how this is
actually working something's opening Dev
10 torrent here in in oh in
UMD oh so yeah it's this UMD thing yeah
so UMD is the actual
um I wish it told me what UMD
was o o emulation what's
this zeu ep1 emulator what is
this
cool I didn't know about these
things
uh yay yeah so that's what I'm trying to
do I'm saying like if I can get into the
okay UMB is user mode driver that makes
sense uh so if I get into
this maybe there's like
prints it's all in C++ goddamn C++
wow so much
stuff
stuff why are these functions
implemented oh here we go TT emulation
device it's TT silicon driver
uh read from device right
here okay so these are the things that
are
actually controlling the chip TT metal
logger level debug let's
go
oh cool okay so that shows the ah good
good good I like this I like
this um that's a complicated one that's
my simple
one it includes a big rant about gold
it's cuz I'm getting tired it's almost
nap
time cool
oh yeah so okay it's exactly this stuff
so NQ WR buffer NQ program I don't know
why we call Finish
twice oh I guess we call Finish twice
because I do the did the other one async
but then why isn't that printing I would
expect
um this enq read buffer to print
something the Finish must just be in
there because that's probably the only
way the uh sync stuff
works I don't know why those are called
always
always uh right so the trisk are the uh
are the are the
uh kernel
[Music]
processors um uh
wait why is oh is hex actually
hex it's actually
Hax oh no xxd
what it's actually an X
format uh yeah guess so that's not a
binary for some reason um so I was going
to see like exactly which one is which
but compute kernel runs on trisk runs on
these
guys uh so that's
these yeah so these are building the uh
the compute
kernel now that's a brick
so we have brisks and
trks where are my
brisks doesn't have brisks only
drks oh probably because uh that's not
the name of the colonel yeah the colel
is reader binary so this is going to
have a
Brisk
uh that is an NC well okay there's a
Brisk but it's actually this is an NC
risk if I get the WR or unary it'll have
a Brisk yes it has a Brisk okay that
makes
sense okay so we have an NC risk we have
trisk 012 and we have a Brisk let's
let's take some
notes
R skull has
120 it's not python stop it's not python
it's text
um there's that map M example you sent
me that explains what the three
are
yeah okay so there's uh unpack math and
pack
respectively there's brisk and there's
also NC
risk um
each core
has five risk five
processors you know it's interesting
that you chose to like there's five but
you chose to only expose three of them
and I wonder why but in theory you could
expose was on
five
um oh so I actually know
uh yeah writer un is brisk so this is
um zero no no no no I understand they're
all exposed but what I'm saying is you
at that API level you only you you wrote
your compute to look like this
where these are actually running on
three different kernels and the read and
WR are completely separate compiled
kernels from the thing yeah um I kind of
like that seems like some arbitary
distinction to me uh I mean there's
probably a reason for it but uh read
kernel right kernel we can give some
names to these things I mean just as an
example I imagine these are
pretty
veral there was a bit confusing okay
yeah so you just just wrap it with
things wrap it with these
macros
um okay
so uh the driver has two
parts a KMD and UMD user mode
driver
um
with uh yeah not much be game by Expos
controlling three
sure
uh each core has one MD available
and this can used for
either
cular buffer or long
standing
all NQ WR
buffer I don't understand why there's
not an NQ read buffer
here I think there should
be so like in this program here I'm
doing
uh I'm doing this andq read buffer but I
don't know why that's not uh yeah why
isn't it why isn't it printing with
debug
I want to see like everything that can
go kind of on the command
[Music]
que uh is this it me find the command Q
manager
ethernet
crap let's Trace down the command Q
creation
oh well that's interesting so the
command Q is are pre-initialized
thank you for the bits
uh so there's Hardware command cues and
software command cues I
don't why is this like is this like fake
like they do like fake queuing I hate
this stuff like AMD does this too and
like we ripped it all out and we had to
find where the real command Q
was I mean the key thing you want to be
able to do to make neural networks fast
with command qes is you want to be able
to reuse the same command
Q yeah Hardware command Q is the real
que okay so that's what I really want to
push to here oh here's the dispatcher
okay
[Music]
uh okay
cool so let's find where this actually
like yeah okay okay okay great so it's
it's these it's these device commands
that actually I mean I like looking at
what the actual format of the command Q
is so we have some packetized thing
called a device command and I imagine
there's some serializer for
it um yeah yeah yeah we set some crap
command header and then we have
whatever it's a lot of stuff
yeah okay so we we put
these command qes then I imagine there's
something which dumps the software
command Q the hardware command
Q um but that's actually really cool
you're telling me that the command Q
parser is just a kernel
[Music]
uh oh is that what that is that what
that thing on the end was that I wasn't
sure what it was the thing on the end in
uh well yeah it's a kernel but is that
what that's special was that what that
Arc thing
is like is is Arc your your your oh
no so it's just like a normal kernel
that runs on a
core
oh you take a row of 106 course okay so
in other words I don't actually
get I lose
10 you're on dispatch colal command okay
cool well that's cool at this it's not
like the stupid Mees on the AMD GPU like
this is the stuff I'm trying to AMD to
open source CU I'm very interested in
how all the scheduling works because
scheduling is the key to make neural
networks
great um yeah no that's this is awesome
you guys have really uh yeah open source
everything I care
about uh yeah I mean you don't I don't
care if the farmer is open source or
whatever like secret bring up that
stuff's not important as long as all the
schedulers open source
um because there's so much that can be
done
there okay so these are the kernels I
see
um how stuff
works
okay so this is like a special this is
like shared
memory and it's just loading those on
let me see if I can find what actually
look I mean there's got to be something
I wonder if I see it with the dispatch
right because it's got to
be what is all that
stuff LL
runtime
what is all
these that one's reading the secq huge
page
I'm trying to figure out where it's
actually like where is it dispatching
them firmware knit
complete it's got to be these then but
it's running on all of them not
just it's running some LL runtime on
everything in fact shouldn't I be able
to unless it's
precompiled no here it
is wait that's like really
close yeah right
here oh so here you go you're in row 11
and you're you're dispatching it here oh
producer
knock there's super lean firm we running
on every yeah on every Bisk uh
oh but look okay I see your producer and
consumer are just I see it's you you
took row 11 but your producer and your
consumer are just on seven and
one
whoa that just accepts Colonels from the
dispatcher but then there's this
extra uh command
Q uh thing that okay cool I
understand
um yeah I think with so many of these
things like you don't need all these
layers of
abstraction what's wrong
with just directly dispatching from the
uh I guess I kind of understand so you
don't want to have to uh manage the
don't have to manage that from The Host
you don't have to M manage Colonel
dispatch from the host so you just do it
on two of the cores I mean I imagine the
10 are Reserve but it's just on two of
them and you recompile them every
time don't recile them every time use a
cash the these are like the kind of
things you just get for free in the in
the tiny grad uh like like cashing
around all this build stuff and
um it's all
free I mean yeah it can be caption to
retrace
sure uh the dispatch on ethernet cor
yeah again sound like PR optimization I
I wouldn't worry about any of that stuff
I would just say like what's
the so much complexity
here I mean this is the downside of
like yeah I I know like like I know it's
it's tempting to go to these like big
scale things but like again I tried to
multiply I mean you saw my demo and I
don't know what I did wrong but like I
tried to put the Matrix multiply in a
loop and it
crashed like I I think that there's a
problem here like grock is the worst
about it right like I'm sure grock's way
behind you guys grock showed off that
one Mixel demo and they're very happy
with it but that doesn't mean you have
an accelerator you can sell for
anything uh I think that
like I mean the hardware is pretty
incredible that it's so flexible I mean
maybe gpus are this flexible and I just
don't know enough about
them uh I wonder how much probably not I
mean gpus weren't done with a very clean
Chic
design it's probably just hacks on top
of
hacks uh like is there a way in a GPU if
I had like firmware control that I can
dispatch different kernels to the
different compute
units I'm so interested to read
amd's uh they're going to open source it
they they'll open source it the
mees uh but I think I even want to go
below the m yes I want their command Q
parser and that one they say is harder
so we'll
see uh it's also all
signed nothing looks signed on
this I don't think it's Trade Secrets
things are going well with AMD
yeah
I mean you could you could work Forever
on this
software there is there is like no
limitations almost to how good you could
make
it uh this chip has so much
flexibility I mean it's a it's a 600
core risk five
chip and I can run arbitrary things on
all the
course it's not the HT htcp
problem
for
for
so what is this
firware NC risk.
CC
I imagine that's for the NC risk
probably one called brisk as well oh
yes are there separate ones for each of
the uh you know there is just one
trisk this is the
uh
yeah they spin way for the
uh Mak
sense okay um I think there's one more
thing I want to understand and then
we'll call the stream uh so I want to
understand kind of what the memory what
the math engine looks like like uh like
what the what the
uh I think I get everything except for
now what actually the math uh the math
looks like so let's make a section
called
math um and let's look at the terlop
numbers and figure out how they're
actually
achieved
so
so somehow we're getting
70600 G blobs per
car uh it's 32x 32 but I say say it's a
Mac okay so 200 yeah
yeah okay so then to do that out we have
you're running
[Music]
at
what no you're only running at 300 no no
no I know the megahertz it's running at
1300 mehz
so you're saying each
core so this should
be
uh 120 * 248
* that many mega flops
right
that would be a 319 tlop
chip oh that's M ads in in something
small these are the block based uh 8 bth
loading
points and block it okay so that's
blockade I see so I don't know why I'm
only getting uh 320 Tire flops
there 3 * 32 is 128 so it's 32x 32 Mac I
don't care if it takes 32 cyes it's
pipelined
um all right let's take a
look
yeah thanks for uh thanks for helping me
um I think it's a good uh it's a fun way
to it's a fun way to get some
documentation uh wait for regular B FL
16 I can do that many no that this is
this looks like a factor of
three oh docs are wrong
okay
py 2 mode consumes all the mantisa but
one LSP oh okay
I don't know why it's easier but
probably I don't know this this gets
into stuff I don't know about making
Hardware I don't know how Math's
actually fast I don't know what a lot of
these things are in
practice but that that gets down to the
lowest levels I know maybe Sunday I'll
go
lower
but yeah so it's just I mean it's it's
instructions
[Music]
um and this is for Wormhole if we want
the gra SK
one common yes C
kernel
colel
[Music]
Ops I mean this whole there's a whole
Rabbit Hole to go down here about how
these uh how these dispatches how this
stuff
works like how
unpack and it's putting them in uh just
read
the
yeah I I see the custom instructions
more what I'm thinking is like so these
must have like weird registers that are
defined
[Music]
somewhere GPR is general purpose
register
face
Dimension um okay so it's a 32x 32 Mac
it's it's notably not a TOR Core like
you're not doing you're not doing a
multiply with one
instruction uh I don't actually know
like look I know the API for the GPU uh
tensor cores I haven't actually thought
about how a GPU gets
built um but so it's a 32x32 Mac and the
neighbors can combine for uh bf16 uh can
it do flow 32 or just
bf16 and it accumulates in bf16
also is that
okay or is he accumulating something
bigger well I don't care about the
multiply can I bf16 accumulate in float
32 or is bf16 accumulate
in
uh B float 16
accumulator does that work for training
we have debates about this at
work oh whatever that
means I'll write it down what's oh in
Gray skull in in Wormhole okay okay okay
I see yeah yeah uh but the fp3 to
accumulate is
free yeah I see I see uh yeah it's very
hard to train you need really to
accumulate and in in float 32 you never
need to Flo 32 multiply like Flo 32
multiply is kind of useless and
expensive that with that squared
shit
I
mean
yeah you know the Nvidia
scam for every for everyone who doesn't
know the uh Nvidia
scam a PDF
so uh where is it here is
a here's a
4090 so the RTX
490 has a peak fp16 with fp16
accumulate 330 teraflops but then if you
accumulate an fp32 you only get 165 Tera
flops this is a total scam and it's just
done by software they blew an euse on
the dispatcher to not let it accumulate
and Float 32 fast so you can't use the
thing for train which is it's just
offensive like there's no reason look
here here it is doing fp32 accumulate in
in
330 um but yeah this is complete this is
a a complete
scam uh and you know because the
same actually that's wrong that's wrong
because if you buy the if you buy the uh
expensive chip which is the same die it
doesn't have the euse blown and like I I
went into the driver I was really hoping
it was just something in the driver and
the compiler I looked into the driver
and it's just it's an euse
uh so you know thanks Nvidia thank you
Nvidia for giving other people a chance
to catch up actually I mean if this
really was the number of of
409s if 409s were that we'd have to use
them for the tiny
box but fortunately 490s are that and
that's not actually so far off AMD
doesn't do either of these things so
there's two big features that Nvidia
blocks on their 490 and one is this and
the other is PE to-peer transfers
between the Cards over
PCI uh they're complete the highend
cards can do it uh these cards
can't um I mean you know I'm too old for
jailbreaking
uh some all that all I see when I see
that is the way that you do this is you
make you just need to make Nvidia like
feel the need to compete you need to put
pressure on them um tiny Corp will know
they're succeeding if Nvidia stops doing
that in their future gpus because they
literally have your training power of
your 49s you should be upset and
offended
um cool uh I think that's today's stream
I think I'm going to take a nap Alex and
I got a nice Sushi dinner
tonight uh yeah uh thanks to Tor guys
for uh helping me understand this I'll
push my
documentation um
my my general advice is this thing could
be amazing but the software is going to
be a huge
Journey um you know we we're in luck uh
gpus have done a lot of this stuff for
you uh like have a lot of sort of it's
not that they've done a lot of it for
you it's that the GPU like the Cuda
style of programming has been around now
for 15 years so people kind of
understand how to do it uh whereas when
you're given a chip with this much
flexibility we have no idea what the
correct abstractions look like um I
would really avoid making things I'm
glad I see that that it's using TVM I
mean TVM is a great choice uh I think
there's a few things that TVM exposes
that they shouldn't like TVM you have to
make a choice when you're writing
something like this whether you want to
allow like CNN style things CNN style
things help you in the short term but
hurt you massively in the long term uh
because you're not going to be able to
do kernel fusions you're not going to be
able to do searches you're not
architecture portable uh the only thing
in tiny grad that's not architecture
portable is that tanor core definition
and it's not architecture portable
because that's literally I'm describing
Hardware right if you want to do
something that's not architecture
portable it better completely describe
physical metal transistors on your chip
um whereas a lot of these things even
things like command cues don't right
like command cues are abstractions that
you've put pretty low level in your
software that don't have to be um I
think that what you want to do is yeah
really think about
the like write the most generic software
you possibly can that also works on gpus
you can imagine the same abstraction
being used for
gpus uh like you know my theory with
with with tiny grad is we are not
succeeding until we have written Until
We have replaced the entire High user
spaces of Cuda and Rocket it is only
after we've done that that we can
consider making our own
Hardware um because yeah the software
complexity is just is just insane and a
lot of times what you end up doing when
you don't understand the software you're
writing you end up making the hardware
too generic and that generic nature of
the hardware is is burning power burning
transistors uh that could be used for uh
faster faster shit uh but it's pretty
cool if you're really getting those kind
of teraflop numbers from a 12 nmet uh
chip I don't know what's the what's the
die
size oh it's 600 oh okay I mean that's
pretty big um but
uh yeah still those those those numbers
are well you're at a you're at a
3090 uh with that of course there's the
ramb bandwith
issue um I understand why
uh what it's
df4 uh I mean that's something that has
to yeah that
that that kills you I think it's it's
higher than that though right I I
thought it was like
200 uh
I mean yeah that makes that makes
training basically like impossible until
we all move to the new paradigm of
training and that gets that I mean that
gets even further down this down this
crazy Rabbit Hole software which is like
uh the current
training I mean look the current
training methodologies are insane if if
you told me 10 years ago when I was
first seeing Alex n that like L Lux
hello welcome new people we were we were
just getting off stream but we'll do a
little recap for the raid uh and then
we'll end today's
stream um yeah what we did today was we
played with the T torrent
e uh T torrent e uh 150 you can purchase
uh these guys at T torant website um
again if you're planning on purchasing
it to do
something yeah yeah doing things but if
you want to play with really uh an
incredible piece of Hardware that's
that's pretty
unique um and look I would not endorse
this Hardware at all if it was not open
source um so not only is this Hardware
quite unique and cool it exposes
everything to you um you can you can go
through and you can see so when you have
like a GPU right like a GPU has a
programming model AMD is a lot more open
source than Nvidia but when you have an
Nvidia GPU you're basically given the
Cuda programming model and if you're not
okay with the Cuda programming model
well Nvidia tells you you know uh get
bent
um but AMD lets you go to lower level
stuff and then T torrent lets you go to
an even lower level than that so in
terms of like open sourness this is more
open source than AMD um you can you can
see things that AMD I mean I'm pushing
AMD if you follow me on Twitter I'm
pushing to open source stuff but uh well
good oh this is another this is another
thing that I can mention to them I'm L
tor's going to be you guys you know Tor
and open source their command C
processor uh you guys didn't do that um
so yeah there I I don't really know how
flexible modern gpus are uh in a lot of
ways modern gpus do look similar to to
the T torn things um so what the Tor
thing is if you guys are interested it's
here this this is a pretty good good uh
it's a pretty good picture actually you
know I'll just find that guide. MD here
it
is um so this is basically what the 10
stor chip looks
like make that don't move that make that
a little smaller uh so this is pretty
much what that chip looks like and each
one of these workers is five risk five
processors in a tiny little chip uh so
this is this is what happens when you
zoom in they call it a 106 core uh they
have two two of them for data movement I
think there's something special about
them and three of them for compute um
the compute you can imagine one guy with
a shovel over here one guy typing in the
middle on his calculator and another guy
with a shovel over here that's how the
compute goes uh you can imagine the the
data movement guys are operating
something that looks like uh bulldozers
right one guy's coming over here dumping
dirt for the shovel man uh you know
driving the bulldozer back and forth
over here one guy's coming over here
he's taking away that dirt moving it on
uh back to memory uh so yeah that's kind
of what that looks
like
um what's here um yeah so this is this
is yeah this is this is basically what I
was saying bulldozer here shovel man
shovel man
bulldozer uh cool model that is all
completely exposed so if you want to
play with new unique Computing Hardware
uh yeah come check out this card but
yeah there's a there's a long long
journey to building a useful neural net
stack on top of this and I think a lot
of the stuff is Jumping the Shark I
think um companies have this very
unfortunate nature of deciding well we
need to get started on that problem
today so they'll take a problem and
they'll try so hard to subdivide that
problem into multiple tasks so they can
put multiple people on it uh this is
this is like this is why software looks
bad today um so much software looks bad
because they're trying to paralyze
things that are fundamentally not
parallelizable uh what you do is you
have a 100% software team guess what
happens your software is going to have
100 pieces it doesn't matter how complex
a software is your software could
literally be like I press a button and a
Skittle comes out of a Skittle dispenser
but if you had 100 people well that
software is going to have 100 Parts your
software will always reflect your
organization um so it's it's unfortunate
that like this is kind of what a lot of
this stuff looks like theyve built this
ecosystem they have two different
looking docs
websites um you what you you don't want
you don't want you know if you have if
you have a software team of 100 people
and you have 10 Geniuses and 90 mediocre
people your team is much stronger
without the 90 um and instead of
focusing on trying to do everything in
parallel focus on building up slowly
serially exactly what you
need uh yeah and I think that would end
up with a much better uh much better
much better thing at the end of the day
um but yeah so what did I actually do
this stream uh I wrote up
some uh basic stuff uh to run a simple
kernel that doesn't really do anything
but uh at least all the pieces are there
um a junk python API I INF finish uh
using T torren python API but I'm not
really sure what it can do unless I use
ttnn which I couldn't get
compiled uh there is this highle demo
here uh well we'll throw that guy in
there to um which uses pytorch but don't
put this output in a loop don't put it
in a loop uh if you put in a loop you're
going to have a bad
time um using pi Bo
like this is the kind of stuff that
people exactly don't want to use right
like the the best thing is compatible
the second best thing is completely
incompatible and different the worst
thing is well it's like kind of
compatible kind of compatible is the
worst look at Python 3
um so yeah uh oh and we should let oh I
forgot to let normally yeah I should be
better about that when people raid I
should let nonsubscribers talk so you
guys can all talk uh we're in the
Talking part of the stream now we're
going to do about 5 minutes of talking
actually because I am tired it's nap
time I've been on that bifas you know
there's two sleep schedules that have
ever worked in human history it's
monophasic and basic so I've been on
like a basic sleep schedule I got like
six hours of course sleep and then an
hour and a half nap so it's nap time
skidy
um please stream more often well had
something special for today's stream
today we learned about the T stor
cards
uh y yeah it was good it was good having
them in here uh to to to explain stuff
um yeah tiny Corp has a lot of work
right now but I really think you guys
should try to try to Port this to Tiny
grad uh and then focus on like it let
you focus on what the real problems are
um a common thing you'll see
about
uh no he didn't no he didn't you can't
actually sleep 20 minutes six times a
day that's that's myth busted foros
um a common uh thing you'll see is like
again it's it's people like it's it's
the humanoid robots are a perfect
example of this human robots are
complete cargo cult uh so for those of
you that don't know the story of the
cargo cult uh let's see let's just bring
up a
picture
um so
this uh it's from Business Insider but
so there was an island in like the South
Pacific where the US was coming and
using it as a base during World War II
and the US would bring planes and these
planes would have MREs in them and you
know the indigenous people there were
like wow this stuff's
amazing uh then the war stopped and the
planes stopped coming and they were
upset about this so you know they built
some planes to try to make the come
back
uh yeah yeah well it turns out that uh
that that doesn't bring planes back
right it kind of looks like a plane but
it doesn't bring planes back um so you
know the humanoid robots are the exact
same thing people have things that have
the brain of a bird but they build a
thing that looks like a person they
think that somehow that's going to imbue
it with personhood which in reality you
know if you can't make the comma body
work
if you can't make the comma body do
everything like if you can't make the
comma body into like the world's best
security guard stop trying to build a
humanoid
robot
um I knowe something about cargo
cult yeah learning how not to fool
yourself uh I think I've actually read
this
uh yeah um um we'll read this
uh may I never read
this this's cool at least I don't know I
still thought it was cool even though
here it's like corpor and terrible
now
um
yeah they follow all the apparent
precepts and forms of scientific
investigation but they're missing
something essential because the planes
don't
land um I think there's a ton of this
sort of thinking out there
today
um to explain to them why building a
plane out of sticks isn't going to be a
plane
right
um yeah right like don't fool yourself
people fool themselves all the time
um people also look I'm guilty of this
tiny gr everyone's guilty of this right
like your software there's software that
other people use and there software that
you can use right the software that a
few people can use the software that a
few people are willing to put up with it
is so so incredibly hard to get software
over this usefulness point that people
will put up with anything in order to
use
it
first principle is you must not fool
yourself and you are the easiest person
to fool this is exactly how we started
the stream and this is how we'll end the
stream um if you lie to other people you
lie to yourself
right like you start by lying to
yourself and then it manifests as lying
to other
people
for
so the men in charge of programs at n
are so anxious for new results in order
to get more money to keep the thing
going for public relations purposes they
are destroying possibly the value of the
experiments themselves and so the men in
charge of VC firms are so anxious for
new technology in order to get more
money to keep the thing going for public
relations purposes they are destroying
possibly the possibility for technology
itself what's the conclusion of T Toren
the open sourcing is very
smart um you know this is this is the
most open uh of any of the accelerators
you can buy uh I think that's true I
think that's true I think uh I mean you
can look at the Google Coral I did a
whole bunch of reverse engineering on
that um closed Apple npu lock
down uh if ten torrent manages to keep
this level of Open Source uh start being
really honest about like what parts of
the stack they should work on and what
parts of the stack they shouldn't work
on don't give bounties for models like
like like I understand the bounties for
models thing is like tempting I
understand tiny grad does it in fact I
think the model bounties are some of the
worst ones but um yeah don't uh like
that's not your strength your strength
is not that we can run a language model
at X number of tokens per second give
that to the O llama people give that to
the CP you give that to the the you know
what we'll end the stream with this
thing where's the Truffle truffle AI I
thought it was I thought it was an
overpriced scam but it's actually less
of an overpriced scam than I first
thought
uh oh I don't
know oh maybe maybe they don't actually
have any software at all but regardless
regardless it doesn't seem like a if
they really have an Orin with
uh wait how do you know it has 64 gigs
of
RAM who fooled me into saying it has 64
gigs of
RAM does it have 64 gigs of
RAM I don't know
60 gigs of RAM okay that's
Ram
um regardless like the Truffle one how
many truffles in a tiny box a ton a ton
truffle if you're just going they their
their headlining thing that they're
talking about is 200 gigabytes per
second the Tiny Box has 5,700 gigabytes
per second so by that ratio there's
about 30 truffles in a tiny box
um and there's only there's only uh 13
truffle you can buy 13 truffles for the
price of one tiny box so you know it
does it does work
uh uh how would you use an llm at high
speed without using grock dude you can
build that demo on Nvidia just nobody
gives a shit you can build grock's exact
demo you give me an ad100 machine a
month and you know what how about this
if someone buys me an h100 machine I
will build you that exact same mixt demo
if you let me keep the machine when
we're done okay that's my challenge to
anyone about that stupid grop demo like
oh it's 500 toget per second you give me
an 8100 like an sxm 8100 machine like a
$400,000 machine cheaper than the grock
uh I will build you that exact same demo
if you let me keep the machine when
we're
done um so yeah that's a that's a
challenge to uh no you will work but you
won't be able to build the demo I can
can actually build the demo I know
exactly how to do
it uh it'll take me a little more than a
twitch it will probably take me a month
uh but yeah i' work for a month for 400k
sure why not um and I learned a lot of
cool things about gpus so if if if
someone hey Nvidia hey hey Nvidia if you
want to take me up on that send me an
ad100 machine and I'll build you that
grock demo I'll build you something
faster than that grock demo or you can
come take the machine back for
me I do know you you're not even a
subscriber
bro um
yeah if if if if Nvidia would like uh
yeah yeah a h100
sxm give me give me give me one of these
machines and I will build you that
stupid grock Mixel
demo uh yeah one of them that looks
nice wow it's not even that unreasonably
priced it's only
uh why am I skeptic about
grock
um well if someone wants to give me one
of these I'll build you that demo
because you can build that demo on
Nvidia just as
easily in fact I might even be able to
build a demo on a single maybe not a
single
h100 but uh I'm not going to spend my
own money on this like giving Nvidia
money it's just 90% gross margins
90% well it's not that GRS are I'll tell
you what happened so like look Gro let
let me tell you why T torr's going to
succeed and grock's going to fail right
what does t torrent do ten torrent
figures out and it's not easy it is not
easy you can go on archive.org and you
can see how long ten torr has said they
were going to ship the cards for and
ship the open source software it took
them two years but they did it it's
really hard but you can't fool yourself
to do that right you have to like here
it actually is it's open source right
you can't take it
back with grock they built a single demo
that looks kind of cool but it's a demo
right weo drove a blind man across
Austin in in a long time
ago
um that's a bold statement that I can do
better buy me the computer how about
this I'll do one better you buy me the
computer and if I fail at
it
if I fail at it I'll give you 10 grand
in the computer
back right so I'll put some I'll put
some I'll put some I'll put something on
the
line yes I know you can try grock on
playground but I I if you don't
understand what's wrong with that I
can't explain it to
you 300K on the computer
back is slow count I mean i' do 10K in
like a
month um see the problem with 300K and
the computer back is like the the
problem with that is not even that I
don't think I can do it it's just that
some absolutely ludicrous opportunity
might come up in my life and I might
just want to do that
instead um look ex dropic again
uh they're early okay they're an early
startup but don't believe in hype ask
yourself what have they
shipped and even better than what have
they supposedly shipped right like a
YouTube video is one thing but what have
they shipped that I can buy because once
you they've shipped something that you
can click Buy It Now on well that's it
right like like that's that's where the
dollars end up right that's like
fundamentally I gave $800 to 10 torrent
for this card and I never expect to see
any amount of that $800 again right it's
not an investment it's not a scam it's
straight up that's how consumerism works
it's like if I buy an Apple I eat the
apple
great um so I'm not saying grock is a
scam I'm just saying their demo is not
impressive and I can replicate their
demo on that machine or 10K and your
machine
back I me look grock is better than
grock is better grock is the same tiers
like cabus right actually you know like
Services actually I think make more
Revenue too which is which is something
else to be
said um the era of one bit llms maybe I
don't
know I'm
I'm is it inference in one bit or is it
training in one bit right the largest
llns today are still being trained in B
float
16 uh their lpu thing is bullshit for me
it's not bullshit it's just not
competitive right the 10 card is not
competitive either you should not if you
trying to do any sort of serious AI work
like normal straight up AI work you
should not buy 10or Cards um you should
buy probably h100s maybe Mi 300 A's and
maybe maybe tiny boxes
um but you know again Tor also like I
think that the like Gro and Google TPU
architecture are they don't look like
the
brain um whereas the Tor thing looks a
lot more like the brain and not only
does it look a lot more like the brain
it's a much more buildable kind of
architecture because like the future is
okay so we can look at sarab right
service is kind of cool
um again I had a lot of this stuff wrong
I wrote an old blog post I wrote an
update blog posst and I've learned so
much more since then I mean this is like
what I spend all my time on now so so
this is this is cabus they're doing wer
scale um so I I talked to Jim about this
and what he said was like look you don't
actually want to do waer scale what you
want to do is chiplets and a substrate
and completely uh the problem with this
kind of stuff is it's really hard to get
yields uh and I would guess that a lot
of those waivers end up thrown away and
you're like oh we can route around that
but you don't know how much they can
Route Around
It
um yeah so like what you probably want
is a chiplet style architecture and
something like tens to lends itself
really well to that because you're going
to have to solve the grid communication
problem at some scale right you're going
to have to solve the data shoveling
engine at some scale right so gpus don't
have five risk fives on each compute
core but they have sdma engines they
usually have two sdma engines right
which is going to I just know that the
AMD GPU has two sdma engines so you can
you know send data there pull data from
there at the same
time right that's why you need two
engines
whoop
uh what's my current goto llm Claude I
paid $20 a month for Claude right it's
better than what I can get
[Music]
uh why does a chip company make a well
why is it inference only I don't know if
they're saying it's inference only I
mean the gray skull chip is inference
only because it can't accumulate an fp32
it also has crappy memory bam with I
don't think that's fixed with Wormhole
either but again these things are all
fixable like in
theory
um
qu uh no the open source ones are cool
if you want to need something offline or
you want to you know talk talk about
naughty
things
um Wormhole can do training it has yeah
that fp32 more memory band you need you
need a lot of memory B for
training
uh
yeah we holding Afters for training yeah
no I mean training is the training is
the place to compete here here's another
one of these these people who are like
we're in only company no you can't be
the future of AI is training
always the the the future is not models
that you train once and then don't
continue to update their weights right
humans aren't like this right the the
the future is going to be some form of
always on training always on fine-tuning
uh it has to be uh right and we're in
some we're in some uh very
limited uh space of models now that
don't do this
um all right cool it's good note to
leave the stream on thanks again guys
have a good day
enjoy
your
weekend
yo it is Friday night in Hong Kong and
if you'd like you can watch me be bad at
video games for the next six
hours
um wait till a few people come in here
and then have a few questions about what
we want the sound settings to be uh
we're going to try to
uh play the old
factorio
uh style where we launched the rocket uh
I don't think we need subscribers only
for
this
see think we're live I think this is
working yo you guys ready playing
factoral
boys watching me from jail what' you do
bro what' you do don't worry let me
guess you didn't do it
uh I know this game is made in the Czech
Republic uh all right let's
go um so first
off uh I don't want to deal with that
and let's just Jack all these things up
yeah that sounds good yeah lots of
shit uh crude oil yeah we want lots of
that shit coal oh that's only on the
planet we're not going to the
planet all right let's check out this
map uh do we like this seed what do we
think is it a good
seed I don't want there to be a lot of
fucking trees you know sometimes there
just oh yeah it's not going to be any
trees on this map that was probably
pretty
good all right ready we
go give you my seed it's right here so
you can see
it uh
yeah let's
go all right uh so not many people are
speed running uh this version
yet all right let's
go okay uh oh shit okay well this sucks
we got to walk a long way to get to our
iron which is pretty bad all right so we
got a long way walk to the ocean that's
okay um let's find some rocks and mine
them where the rocks oh God we're
already getting a terrible time I should
have mined The Rock on the
way
oh oh we only got Stone I need fucking
coal let's try this rock come on Rock
have coal in it have coal in it do way
to know oh let's go on Al mode maybe Al
mode will tell more
Stone uh I don't know can I just stick
trees in the
burners okay we're already off to a
we're already off to a terrible start
we're already off to a truly terrible
start any real speedrunner would be very
ashamed of me no no no that's just iron
oh my God where's the
copper okay fine fine don't don't do
shit fine uh all right we put shit in
there yeah it looked like a real speed
Runner doing that all right let's make
some of those let's put that down
there all right um I don't know let's
throw a few more of these
down but we have a real problem now cuz
I don't know how to get any coal I can
mine it guys what am I doing
wrong all right stick coal down there
all right seven iron plates that's not
many iron plates what how did that how
do I get how did I get an iron ore in my
shit go in that hole okay good all right
now we can make another burning mining
drill okay we need coal
soon I don't know let's just get some of
these rocks let's pick some of this
up it's okay it's okay we got to just
roll with the punches all right look I
got iron plates all right cool that's
cool that's cool
oh this game has a rather slow
start why is there only Stone in these
rocks fucking
Stone okay we got some iron plates not
enough to make that we don't have any
fuel oh this is so bad this is so bad
guys how come I can't get coal from the
things all
fine oh I should have left that there ah
I'm so bad I'm so
bad okay that's going to get me lots of
coal go get me
coal these rocks Maybe
expected resources oh it tells me how
come none of these rocks have coal in
them okay none of the rocks have coal in
them
fine how are you supposed to know
that all right all right we lost we lost
we lost precious we lost precious speed
running time there but it's okay we got
some miners up on coal now
got lots of coal okay we got 20 coal all
right let's go let's go let's go let's
go let's
go all right can I craft one of those
yet no I can't all right let's put some
coal in
those let's craft another one all right
we're going now we're going now put that
down there
let go down here and get
coal hand mine or to speedrun faster
let's chop this tree down just because
we can suck a dick
tree all right let's make another burner
Miner one more
make a few more of
those all right we got some more of
those let's throw down a few more of
those How's my iron coming okay that's
pretty good that's pretty good all right
we need put more coal in that
one I just dropped the coal on the
ground
what the speed Runners make it look so
easy you know
radical oh I didn't mean to pick those
up why did I pick those up like a noob
wow I'm bad at video games don't ever
trust me to play video
games that looks pretty
good how come it how do I switch the
rows the rows switched on me
should have been crafting furnaces while
I was
walking how do I get the rose back how
come two is on top now and one is over
there can someone tell
me I didn't mean to click offshore pump
oh my God but now I'm out of
stone oh
Fu
whatever look at some of those
rocks
uh find that the rocks have
stone oh yeah I'm on the air leaderboard
yeah yeah boys get leite skills you
know all right I'll let you in on a
secret it's called
[Music]
AI but George you can't use AI that's
cheating yeah was it cheating when Lance
Armstrong Ed steroids no it wasn't Oprah
just got upset about it or something I
don't know but I don't think it's
cheating because there's no such thing
as cheating in real life
you
know when you're just doing things
you're just out there you know oh my God
but that used up all my stone okay
that's
okay that last burner does not want to
be
fed how do I swap that
back put it if I put it there now it
works someone know how to do that
all right good we got tons of these
things now U let's make an iron
chest let's start Gathering
Stone I'm just dropping the coal on the
ground aren't
I all right we got got lots of coal
now how does he do that where he selects
them I saw something where he selects
how does he
select okay uh I always do this in
speedruns I start slacking and we got to
not do that all right let's get more of
these guys down on coal we're going to
need lots of
coal need lots of coal this is going to
be dirty as shit let's go let's make it
dirty boys let's go
lots of
coal all right so real talk we're
thinking about buying a uh a micro
turbine to generate power for comma
because power is a huge ripoff in San
Diego and fuck the power company I'm
going to make my own power
company okay now let's craft two steam
engines a boiler and I already did an
offshore pump let's do two
pipes Uh crap I didn't cut any
wood oh actually we're not even close to
ready yet we still we still got to get
uh six burners on
copper keep crafting keep crafting
[Music]
those craft a bunch of those pick up the
iron oh it went back
there okay keep in watch what I press to
make it go there right craft more of
those craft more of
those right we have
uh that's a good amount of
those
oh they make it look so easy in the
speedrun Watch Me Be clumsy with a mouse
all right let's chop some trees down to
make electric poles oh shit but I didn't
mind any copper oh I need copper all
right we got a row of those row of those
let's fuel it
up we're good on Stone we're good on
iron we're one short on
copper uh
lots of
coal start crafting
those get more
coal get
copper craft more of
those oh my God we have a long walk to
this
my 38 poles
reach let's throw down a little power
plant
here what did I forget what did I forget
did I forget anything
oh I should start crafting a
lab oh shit they're all out of
coal more iron plates craft red
science
research
automation oh they were all out of coal
too craft more red science 1 2 3 four
five
six some coal in each one of
those start slamming the red science
into the
lab okay what's next done all right uh
time to start doing iron Lanes oh no we
have to research uh let's just craft
another lab keep hand
crafting uh
science let's go pick up coal
gotta learn how to use these hot the
shortcut
keys don't tell me my iron oh shit
they're out of
coal okay we're crafting a second lab I
don't think we actually even need to do
that let's just craft some oh well now
we
should oh yeah five science in there
yeah let's craft an
inserter
good keep hand crafting science uh let's
see we want to queue up electric mining
Logistics this steel processing I can go
later M Ser is probably more important
than that we don't need repair packs we
don't need turrets we don't need ammo
okay
good uh keep crafting
there automation's done cancel
that I want to make automator thingies
how we doing on
Stone check on my
stone autom
thingy those
[Music]
thingies make red science copper
plates automator
thingy um inserter thingy you make
gears make fucking
gears shit right
good uh
um yeah yeah yeah two more of
these make gears and you make red
science you take plates take copper
plates how we doing here pretty
good all right let's get to work on our
first half iron Lane why aren't you
making anything okay um let's craft some
go by
[Music]
hand use another lab yeah we could
always use another lab
inserter shit that was that was
bad got to get this research done for
electric mining drill
okay we're doing pretty well on iron
plates no no no no no don't do
that okay that's
better another lab second another lab
all right uh how's electric mining drill
coming electric mining drills what do I
need to build more them more copper
let's throw down one of these
um
inserter and a
bucket I should have done this
earlier all right have to get a lane of
iron here so that's 15 miners is the 15
miners on each side of the belt that's
15 miners on each side of the belt uh
you make copper
wire take copper and put it in this box
for thank
you um craft more of
these I won't be able to keep this uh
speed up for the whole run unfortunately
and even if you thought I was slow now
cuz I start realizing that I don't know
what I'm supposed to be
doing uh transport
belts yeah um what am I short on short
on iron why did I go to Coal you see
that was just a bad choice you got to
prioritize
they're doing probably pretty well on
iron now build a few more of these
things get a few of
those keep building those which
belts um see I want one of these
to make
belts uh oh I should
have yeah I should have I meant to put
boxes there I should have put box boxes
there I didn't put
boxes all right let's keep putting more
down more of
these
box ingi for inser IR
[Music]
plates more mining drills
he has some way to count them too that I
don't know how to
do one two three four five six seven
eight nine 10
11 need more trees anyway
13 craft more
those ABC always be crafting
um let's get a belt going here okay
where do I want to
build I'll probably want to go the other
way let's go away from the
resources probably not far enough away
from the resources might be
okay go
there oh how are we still have power
looks
correct all right I always be crafting
we need tons of
those uh okay 1 2 3 four five six seven
eight 9 10 11 12 13 so we need two
more let's connect them up to
power I know that there's a new more
clever way to do this where you uh uh
where you uh use like an underground but
I don't have do
that all right H shit we need
coal don't need coal yet let's just
start building okay we need to do 24 of
these 1 two three four 5 six seven 8 9
10 11 12 13 14
15 fuck stupid
Pole now count how many did I
have 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
17 18 19 20 21 we'll do three at the
top
[Music]
one need the wood
anyway should have buffered that with a
buffer chest no it doesn't matter it's
perfect for you in okay uh well that's
in the wrong place
then okay we got a transport belt that
one needs a power
pole um
my co guys died because I didn't come
and check on them we have a lot of coal
now okay oh shit we're not making
inserter is why are we not making
inserts CU we don't have any iron wait
we have so much iron
what we don't have
copper okay I got to pick up the copper
cable now we can make inserts now we
have an inserter to start cleaning the
transport belt into there also take the
transport
belt okay now you get to watch me be
really bad at this I see the guys who
are like pros at factorio do this and
it's
unbelievable the way that they lay down
inserters
always be crafting
I don't is their Mouse just better than
mine or do they have a technique I don't
know oh did I miss one no that's
right always be crafting always be
crafting
I don't even know how to power them
right you see how bad I am at this all
right uh let's buffer that into a
chest um how's fast and start a research
going probably not well because I didn't
oh I'm making red science what's going
on well we have lots of iron at least
good for chests okay
great that's
broken okay
why are those not pound because I don't
have enough
coal okay need fast Ser to
finish all right
uh temporary small science have make
here power is low okay let's extend the
power plant I we
need I shouldn't have done that how is
this going
[Music]
fine okay we got lots of
[Music]
coal let's pick up my iron plates
I don't know how many it actually takes
to
feed okay we don't have a lot of coal
anymore okay we got to craft one two 3 4
five six seven eight one two three
four uh and may a couple pipes
little lab maybe research will go
faster we need fast
inserters all right that looks pretty
good lots of iron plates there
how is power is it actually low power is
low uh we should not have done that like
that
fucking small electric pole oh my God my
whole Factory shut down that was
terrible wait why is that not hissing
you're out of power
right let's design for the
future pick that up throw a belt down
there cannot build on water who's trying
to build on water here all right great
uh power pole I know I should be using
the hot keys but the hot Keys move on on
me all right that goes there and that
goes
there not
coal how do you use these
things Command right click to clear
shortcut
okay wait oh I put it there
all right that's pretty
good okay we got tons of Gears now okay
extended the power PL okay build more
iron than copper smelting okay we're
going to need another row of iron so
we're going to need tons of electric
miners
oh let's make some fast inserters that
copper should be a fast inserter what's
out
here I want pick up iron plates maybe I
didn't I just use
one I definitely didn't
crafting copper cables and fucking iron
nuts don't do
that I don't think I want ailon of
those maybe I do it doesn't matter I
don't know
Copp
mine two three four five six seven eight
nine 10 11 12
13 let's go check on my belt
guy I can also build a few more of those
always be crafting
ABC they're out
of for
all right now this is the part where
you're supposed to do everything
templated and not like I'm doing it
here I also realized that I put one too
few uh things
down Okay um
why are those not
burning fast
[Music]
inserts right logistic science build
more iron than copper smelting and now
we need to build
okay uh we need let's get our Stone wow
I can't believe those kept
running if you know how many of those we
have to build but okay we did 1 2 3 four
5 6 7 8 9 10 11 12 13 so we need two
more on that side
there uh you know we'll just lay them
all
whatever I shouldn't do
that I mean the problem is I'm so much
slower than this guide so it doesn't
really
matter like it's if you don't know how
to lay uh things fast
uh okay so what do I want to do with
this
um don't really want to go the other way
now they're out of
coal some transport
bels now how do they do this where they
click so
fast for
always be crafting violating that
rule these inserts face the wrong
direction
oh they're making
steel all right anything else I want to
research I don't know doesn't
hurt um let's just NQ automation to that
that okay we need we need green science
that's what we got to think about green
science
out of those
13 on the
bottom what are we out of iron plates oh
these are
full uh we did research Logistics okay
good let's do this more right no don't
do that
um
okay what oh no we're out of power
shit of course we're out of power okay
we're GNA have to wire up coal in a
minute have to do this before we get to
Green
science and that's the right place to
build green science but there's a stupid
copper patch in the way okay
whatever craft always be crafting always
be crafting
okay this goes
here what I'm just going to do a few
steel can I just can I just do this
to get do this give me steel axe just
give me steel axe
please why does it mean underground belt
for that I don't want an underground
belt I want
this okay thank
you all right
cool uh let's see so now if we want to
insert onto that side of the belt we
insert from
[Music]
here we don't have any oh that's
great let's pick some
up fast
inserter right cool let's go to the
actual home of coal make sure we get
coal why is my science that oh cuz I'm
trying to
research course those are full because I
haven't been here in a long
time why we can't fit anything else okay
well I don't need all the
stone definitely don't need any red
science
that's
good pick that
up okay great okay we got a belt of
copper uh got a belt of
iron uh we're going to need a belt of
copper
okay that's
the input
belts oh see I built this in such a bad
place whatever no see it's not I'm not
going to be able to expand it to the
other side if I put it here am
I
will need more transport belt and I
didn't make make any
[Music]
here let's do this
right oh George don't pick up belt it's
a waste of time yeah but I don't have
any belt okay
uh Stone furnaces any more of
those 481 belt that's a good Lo of belt
I'm so bad at this
game you watch the speedrunners online
and they make things look so
easy def stupid com
uh okay we're getting past the point
where chest feeding is
okay let's build a few
undergrounds that one I think we can
just move to
there I don't know why oh George why
don't you just give yourself space Oh
yeah well you're not building the
fucking Factory so you don't want to you
give yourself space I'm talking to
nobody
here that's a problem with undergrounds
we have to deal with that
[Music]
shit all right I'm not following a rule
always be crafting always be crafting
why am I not crafting
I know I'm not supposed to be building
two lines of copper but oh
well all right we'll just focus on one
just got to get robots really fast
robots make this game easy I love robots
okay
[Music]
copper copper why are those not power
don't have any coal okay we got we got
to deal with coal
lose power to the whole thing
again okay
great making lots of iron
plates
um
okay let's go somewhere we have tons of
space
always be crafting why weren't you
crafting assemblers you're going to need
a shit ton of them now you're crafting
copper
wire do I have a steel axe yet at
least okay well you're busy crafting
assemblers um what did I not why is that
not powered no just powered okay it's
fine
great um all right assemblers
uh one two three four you make copper
wire one two
three four
make copper wire some fast
[Music]
inserters you make green circuits what
goes into green circuits no no you make
green circuits I said green
circuits okay green circuits that's good
um oh let's make some of those always be
crafting always be
crafting all right uh let's bring the
iron
belt in here
not really sure why to do it like
that this is where to power
everything
cool all right we're making
[Music]
circuits
um one two you can make gears
there we
go also fast
[Music]
inserters let's buffer the gears and
chests you
make wait how am I going to make red
science I need copper plates what's hand
feed still no no that can't be red
science
build we're past any need for anything
like
that
okay let's make this
number those that can go on a belt
uh let's
also SP copper to
that okay uh
gears Transport
bels oh shit we're out of power
again all right let's get coal over
there 24 electric miners great
just
for for
okay first we'll do
this we'll come back and do the belt
whole factor is
down oh shit I don't even know how this
is going to work we're going have to
jump start
everything good thing transport belts
don't use power how do transport belts
run by the way
magic fairy
dust what oh come on
so
bad what a waste the thought
time
engine we didn't actually need to do
that okay always be crafting we need
more
inserters more steel
furnaces
um that needs
power uh
have exit inserters
here okay long
inserters great
all right we're making some of those uh
okay what do we need to
make we need to make transport
belts and
uh transport
belt we put that on one side uh and the
other side why aren't I crafting
assemblers
it's going to make red science
this is going to make green
[Music]
signs off by one
power PES are so
D they know about putting power
underground
okay
great um
always be
crafting what does it take to make
inserters uh I need another gear wheel
and
that and
that okay what's the trick to get it to
uh
I do an inserter out of there what side
of the belt does that go on wrong side
damn
it all right go from
[Music]
there make green
[Music]
science do the proper
inserts always be crafting Y at me when
I'm not crafting
just don't have
power that that and that more power all
right good good we got a science factory
out let's do 10 of each
six seven 8 n 10
I'm not getting any green science
because those poles aren't
[Music]
connected we're out of Transport
belts back to my old belt Factory let's
stop stealing all the plates
okay we got a good number of ir Gear
wheels number of
those that's probably good
number we don't need those to go any
[Music]
further for
last
one let's give these guys
power all right uh let's craft
Labs pick up my old Labs I don't even
have that's a huge waste of
time okay why am I crafting
that pick the old
Labs
right lab crafting uh didn't I make
copper wire somewhere nope I didn't we
can pick it up out of
these actually you know what I have
green circuits let just pick them
up all right let's start Let's Do
Science Let's Do
Science uh
insert for
oh no I hate having science in my
inventory
I probably should add buffer chest for
those but I'm not going to do it and
regret it
later okay um automation 2 is almost
ready oh we're going to need steel oh my
God did I
even okay let's do a steel
one build them till we have
steel stupid
crap all right Maul says we do that
before steel okay fine we'll build
another iron line
again let's just go let's just buffer
those circuits why am I not buffering
the
circuits slow inserter we can use a fast
inserter there even just the chest
one great all right well none of those
have
coal oh cuz I didn't pipe the co to
there
oh that's so
annoying for
sometimes you put the miners in the
wrong place they get you the wrong
resource which really
sucks oh there's a coal patch right
there
oh stupid fuck
whatever we'll use that other Co later
one of the things I keep doing is
standing out of range not good at that
all right
um why did I build this so
close what's the usual way to do
this got build
undergrounds um don't put them so
close walk by
one and then do
inserting there to there that looks
right and then get the splitter here
okay that looks
good how out for this
guy oh my God I'm so bad at this game
[Music]
spaghetti look at the my spaghetti
stop
it stop
it
for for
it's broken for some reason
ABC always be crafting yeah there we
go let's lay this whole one out
beforehand do it faster that way
just make less mistakes
Maybe for
see this is what happens when I try to
go fast I misclick and they go all over
the place Dro and stolen furnaces you
know those probably aren't even aligned
right got to learn to use the shortcut
keys
so precise with the mouse in this
game so that power goes through a
different way now I don't need
that Factoria one small power pole fits
your whole
thing all right we need another 30
miners
what you watch how fast the guys in the
speeduns do this I lose so much time
right
here what's it going to take to get
steel
furnace what is
it where steel
furnace Advanced Materials I definitely
want that before Logistics
too also I'm not even building steel
like I'm going so
slow okay let's build
steel and come back to that line
later fast there
so for
steel um one of
those align it with the others not that
it really matters
but so we steel we have that insert to
that always be crafting
uh and then we have a two-way belt with
that
um
there but nothing actually goes on that
belt all right let's drop my
[Music]
drills drop 15 fast
all
right for
of course we didn't leave any
space plasic me these PS aren't even
used anymore
turn around half of
those we'd be crafting
and I put the coal on the wrong side of
the
belt how do the guys do
this okay we need the coal to go on the
other side of the belt
um it's
fine
for for
the steel okay what do I want to do with
steel why did I do all this to get Ste
oh I didn't even build my mall yet oh
let's go build the
mall that requires you other iron line
okay uh what do I want to do with steel
I wanted to build steel furnaces that's
the main thing I wanted to do with steel
maybe some assembl
twos an assembl or two together that can
make me steel furnaces I need
Stone it's like I don't plan
anything stone bricks okay that it's
easy at
least
for
[Music]
for for
I've been making transport belts or
that's the mall I didn't build why are
those not even running oh cuz I didn't
power
them 28 transport bels okay that's a
hall anything else I want to research
yeah lab research speed electric energy
distribution lab research speed too
don't need a car tool belts always nice
what's that fluid handling what what is
fluid handling enough
oil why is that coal belt
broken what I do flip that around okay
whatever uh okay
one two three four five
was I faster that time
whatever use
undergrounds what am I missing iron
plates you kidding me
all right steel furnaces
um I want to make more of them faster
actually I know this isn't what the
guide says
but always be craft
thing we going get this steel line wired
off before we can go to uh
really that one's not
connected what are we doing on
[Music]
power
wow one two three four five
this shit such a bad
[Music]
order insert steam Eng inventory is full
great
I just drop a steam engine on the
floor the iron plates for those
thanks we should never lack iron
plates huge chests of iron
plates why did I click those I didn't
need those all I need is
miners we do need to deal with the power
is low situation
craft a couple of
pipes wish I could reorder the crafting
Que
we on transport
belts for
pipes I guess we use them
every time I'm on that menu I'm wasting
time power better that's
short on inserters
too don't eveni to make them we're sure
iron
plates tons of electronic
circuits thank you for the inserters
[Music]
about oh this isn't making steel because
we didn't wire this
up um and these aren't connected and now
we have no hope of connecting them
because I was an idiot
this is the worst design thing in my
factory right um
okay steel
furnaces all right before it's even
built we're going to upgrade this to
Steel let's upgrade the functioning iron
line first but we're not even running
low on iron okay we got to build them
allall let's build them
all um
where should we build them
all over here this is even used any
right this game is very fun
[Music]
okay so
this
uh
okay so this is going to make
inserts
[Music]
um where the ones next to
it no okay we need we need do we need
need more green
circuits we might just need to split the
green
circuits I don't know let's just make
another green circuit assembler
going to make these inserters going to
make these
power this contraption
oh shit we need
gears uh where do we get
Gears where are we even supposed to get
Gears how does this
work oh it's okay was supposed to put
them on I
[Music]
say let's build a guy for gear is
all right now we got
Gears we're also going to build
assembling
machines um
[Music]
uh yeah you know so this isn't how the
guys normally do it they usually use two
red inserters I think it's just cuz it's
faster to place
maybe um where do you make transport
belt and Splitters and
shit other side of this okay that's
fine and pipe
[Music]
cool make a machine that's good why
aren't you making any steel why is my
steel
broken wait what oh
right
great uh do the same thing over here
let's abuse the red inserters now that
we have a lot of them we also want to
Lim at these chests
uh this is
Splitters transport Bel and
Splitters always out of iron
need this one to also give that like
that okay that looks pretty
good um
gear makers do they have they have four
gear makers okay we're GNA need more
gear makers
here they just use these gear makers how
did they do
that it's really clever of them I don't
know
whatever it's the mall it's
fine uh you are going to make
uh assembler twos but that's going to
need
steel which is fine that's right
here make too many of them
uh one of those one of
those you're also going to
put pipes at the
all same sort of
idea pipe we do that and we do uh what's
the last one I steam
engines um it's probably good thing to
automate place them
WR
[Music]
make no no no no no no no you don't make
that
you make that you make that and you make
Steam Engines yeah okay we going need a
few more iron chest let's always be
crafting there there
there there there there
there that okay
cool let's limit these chests we don't
get a bajillion of them
got me
splitter underground
belts name Bell want more of
[Music]
that why isn't fast inserter
working
backwards limited appropriately all
right great let's grab some long handed
inserters all right that research is
done concrete we're definitely going to
need that oil Gathering we're definitely
going to need that
um how long was that research done for
okay now we have all the steel furnaces
so let's just
upgrade that was one of the worst
decisions I
made I don't think I think we're also
going to have to upgrade to red
belt so what does that need gears and
belts we're going
off uh item ingredient shortage okay
we're short on
belts we're short on yeah okay
we have lots of gear
production that might not actually be
enough I don't
know because it's not a fast inserter um
fix that
shit don't do
that let's upgrade those to assembler
twos I see I never put those on the Belt
that's not star of my red
science all right we need to make red
belt red belt needs belt and Gear
wheels I don't know if the ratios are
right on this
red
belt we shouldn't just make red belt we
should also make all the red
things we just need red belt I'm going
to regret that I can already tell I'm
going to regret
that we need all the red things
not even sure what I have to be crafting
anymore now that we built them
all uh okay let's build another iron
line we have another iron line let's
just get it up and
running okay how do I get out of here
crafting underground
right okay um that all needs red belts
okay let's wire up this last iron
line 30 miners okay we need 15 on each
side of the belt
do not mind call
okay what else do we need okay we
actually just have to go get oil let's
build some pump Jacks iron Gear
wheels okay we're not making enough belt
fast
enough oh crap what
down
here
really
okay all right well that was a big
detour I should have got that iron line
up
faster um we got to double the speed of
that guy soon and this isn't even ready
yet so uh need a splitter and I can't
craft it CU I don't have iron plates
boxes of iron plates let's go pick them
up crack some of that too
how many viewers we got what are we
doing people like this
contact 237 okay okay not too
bad 247
287 all right good uh that's steel
Line's going to start
up um you know what let's not do
that uh you make red
belts red
bels normal
[Music]
BS you make iron gear
wheel for
all right uh what do we got to upgrade
to red belt let's upgrade this one
here H yeah just work
we have biters but we turned pollution
spread to zero which is what all the
speedr running guys
do I can't believe I'm crafting iron
Gear
wheels okay
okay uh we got to go do
while oh
yeah how the biter going to feel about
my huge new steel line
all right let's see how many miners I
actually have on there make more
Miners did I need a car to go find oil
where's oil oh it's down there shit by
the biters
okay let's just research the car I don't
even have an engine so that's a waste of
a
research like AR full lines but got
enough
okay uh what do I need I need
oil what does it take take to make an
engine steel iron gear plates
and not stuff I
have I just going on a wild oil
hunt
Fus I should have remembered on the map
before it went away where the oil is but
now I don't
know copper
iron we're walking too far oh there's an
oil up
there oh I didn't even bring the
pipes oh great it's near those
biters don't forget that oil
H where's my
car we got to go pick up
pipe that is probably
[Music]
better should we try to craft a
car all right let's go driving boys
make don't make cars make a car engine
unit need steel
plates iron Gear wheels and what
else
pipe we got to pick that
anyway
really many engines do I need for a
car five that's a lot of engines
okay am I doing on
power doing okay but we should can do
better uh let's do 10 more boilers
[Music]
and
Mak that gives us a full line
no
pipe for
okay how's my car project
going project
[Music]
car 10 engines okay that's a good number
of
engines fire up
oh don't crash into
shit I almost just crashed into my steam
engines and broke them
all all right that's a good amount of
oil I'm a Lumberjack and I'm
okay night see all day
there I'm going to be able to run with
my car and lay down both pipe and
electrical
one of those alone is going to be a
challenge
for for
I need to understand this house mechanic
works
better okay
cool all right this looks like a great
middle of nowhere to build my awesome
refineries
[Music]
okay I see like you have to like move
the mouse I'm starting to kind of get
this okay good we got a
while what's it going to take to build
where are my
refineries steel
plates should buffer those
um
okay we got to do red circuits
next our goal is to make blue science
let's just look at what's in blue
science wait did I have not researched
blue science yet oh shit now I can
research that now I can research
that uh now what do I need for blue
science I need
sulfur else do I need for blue science
now we can add it let's
go um
[Music]
um build oil
refineries SP down
here all right base oil processing that
sounds good
I'm wasting tons of time crafting gears
and pipe pipes in my mall but I wasted
it all
why not making
assemblers you don't have any green
circuits CU one green circuit maker and
there are going down there
oh whatever
make more
pipe let's just get to robots let's get
to robots got to get the
robots my all drills aren't
connected are you
sure I don't know I sure hope I
connected them
three four five six
seven
eight for
okay there's no oil in the pipe why is
there no oil on the
pipe going to crash into one of my
electric poles and break it I can tell
already there's oil there but there's no
oil
there what's wrong with
it I just went too far with one of them
oh god of course
take on academic streaming while doing
research is it
interesting I mean I don't know it can't
be worse than me being bad at video
games why am I so bad at video
games okay
um all right we need a cop we need a
full belt of copper
I don't play very often
right you have 27
assemblers uh let's put this shit down
over
here oh look a big patch of
copper okay
uh
one I automate those
let's build it up here this a good place
to build up
two three four five six seven 8 nine
10 and then one away we
build one two three four five six
seven these make copper
wire these make electric circuits
fast
[Music]
inserts we need a full belt of copper
there but until we have a full belt of
copper we will settle for steel out
party we want that
no I'm kidding actually I actually
challenge you to beat my
time
um I challenge whoever watching this
video to actually beat my time I think
it won't be too
bad for
these last
three that
oh need iron plates too
all right
uh we're going to have to figure out how
to mix plastic onto that belt
okay I gota be using q more
uh we need Co
too let's go pick up belt
let's pick up Splitters and undergrounds
too
for for
okay plastic coming plastic is
coming
uh my building of inserter machines
going Bo those up on circuits got 47
that's pretty
good one two two three four five six
seven eight
all right we got a belt of red
circuits all right blue science
goes into blue
science haven't finished it
yet something blocking my
research where is my green
science oh they're stealing all the Gear
wheels
no more stealing Gear
wheels crap I'm short on
iron I'm not short on iron I have all
this fucking iron why doesn't this
work
for for
okay moral of the story we should not
have stole Gear
wheels from the uh science
tons of these steel
furnaces let's upgrade all these belts
to red belts
be easier once we have
uh robots
power any of that and what do I still
not
have why isn't that oh I didn't put exit
inserts okay
I'm getting better at least at this
whole powering things
thing I used to be so wasteful with the
pulse I'm less wasteful with the
pulse so that's progress all right uh
why are there still no red circuits
coming that side's making red circuits
this side I bet I did the inserts
backward
I just didn't tell them to make red
circuits all right now we have red
circuits now wait are we back to having
green chemistry so my research can
continue we have
some um let's upgrade all of those to
assembler
twos most important one to upgrade to an
assembl 2 is that one
real short just circuits and it only
makes
these right
three who's trying to use block
terms how much inserters do I have
here I got tons all right let's
just just get them
in
um a trash chest have to look for
it um
all
great okay that's fixed uh we need
sulfur only need one cam PL for sulfur
and it needs water I know
that hold that pipe and I didn't pick
any
up I have way more pipe than I know what
to do with
craft a couple of
those those are so annoying because you
can't run through them
all right we got
water it all it takes to make
sulfur now we're moving fast on let's
resarch that resarch that resarch that
resarch
that that
great all right we need blue
science engines what I could have been
making those the whole time I'm an
idiot all right where's the what
all right uh what goes into
engines up here you make engines
okay we need iron gears and pipes great
and steel
pipe
[Music]
here and fill this belt with IR be this
one
here just like I planned
that okay that's good and I need steel
up
[Music]
here there's the steel
that's not
steel steel split it
here
whatever spider the steel up
here for
you're going to make
that okay
my assemblers
looking 67 that's pretty
good 12 of
each two three four five six seven eight
nine 10 11
12 one two three four five six seven
eight nine 10 11
what I don't
know
for for
okay let's make this go that
way
for for
am I getting faster at this
oil what's it take to get to The rockle
Silo
[Music]
lubricant uh Electric engines I think
actually before we go there all I really
want is construction
robots whatever we need that
okay uh let's go build more uh
miners we're going to need a aboutt of
iron and copper for Batteries half iron
half copper
I got to learn how to just use all these
short ccs
[Music]
copper that's
good sufu acid D it's
got suric
acid now we can make three battery
factories to move that if I want more
labs
batteries
made they're not researched are
they oh they were doable at the
[Music]
beginning okay what do we need for
robots
robots electric energy battery
robotics construction robotics
I'll give blue science a minute to queue
up it's
fine we haven't researched batteries yet
we do have Lube I think so we can switch
a few of these over to uh the other kind
of
refining spidery
Mass
for
for
for for
okay we got
batteries let's do
Lube just heavy oil
okay I want to
build we need more engine
units so those are already up there we
just get place to put it
engines feed right into
electric
engines uh they also need green
circuits for
all
right uh that's
good now now uh let's get the batteries
up
there we're going to need let's get the
belt need belt
okay making assembl
frames robot flame need steel plate
battery electronic circuit and an
electric engine unit for
oh I didn't craft an output belt for
these things fuck
that looks
good let's make of
them long distance
yeah that should be all the
ingredients all right wait can I build a
robo
Port I can I just need steel plates and
uh Advanced circuits I should have been
buffering those
okay
look how much better I'm getting at
that all right we want to make
construction
robot electronic circuit and flying
robot
frame for
okay um actually that didn't say how to
feed it like that because it wanted to
limit the number it made I don't really
care uh okay
copy and paste the power
plant
um let's go back to my steam engines and
unlimit
them oh we need to make chests
too not Port
range do eventually want to stop making
them we just need Steel
should buffer everything I don't know
why I don't
for it don't really
care need to
be Iron Gear
wheels for
okay
our trash chests in one
place next to an assembler with an
inserter full power p
uh wait no we do need
all that to your copper
okay right
all right have you guys I don't know if
anyone if you've made it this far in
this game before but now we have robots
Co and they'll start to do the building
for us in a
minute hi Lex
what you guys are talking about
Lex well low on production of iron
circuits for some reason why are we low
production of those
okay there not in the
chest all right oh it's cuz we never
finish this other copper line what was I
thinking
now we just have robots do
it where's
my where's my R
Port didn't I just craft a robo port or
did I craft something else stupidly
oh it's crafting
still for
they're doing
things my
robots I knew that other belt of coal
would be useful
oh they need to go chop trees down
too guess I can give them the trees I
have
yes my robots build things my
robots
for
for for
sh
for
for
for for
okay why does none of this have power
because I don't have any power
FS give the Bots trees to chop down
for for
what did I just break it all
here for
we are going to need red undergrounds
and red
uh how am I doing on time
how long have I been
streaming what are you guys talking
about
okay
okay all right um let's focus on
actually launching this
rocket need that we need
that we don't actually need any of the
other things
that where's Rocket
Fuel there's Rocket Fuel flam this first
let's do that
first and Rocket
Fuel I don't know if we need those
rocket what do I need
first Logistics robots
here we
go and it's cute but unfortunately our
lack of copper cost us
majorly so
[Music]
open
[Music]
for for
oh it's cuz I deleted those things it's
taking
forever stupid
a horizontal fli blueprint
is that my only copper line well there's
this copper line too which hasn't been
started
yet there don't my Blueprints and shit
insert into your inventory
oh we going to get coal there
to for
okay okay look at that's some
progress coming in pretty
hard 313 okay can we do it no I don't
think we're going to get under four
I did make Miners did
I I don't tell me I didn't make miners
my gear wheel electronic
circuit
for
for for
wait
what oh no we're out of coal
why isn't this one running do no one
connect
them oh I didn't connect it to
water for
is for
could I really could have I done a worse
job at this
what a shit job I
did we have another patch of
call pretty sure job with that one
too
for
for
for for
why is that not
running because that side's
full for
for
for
for for
all those
robots why aren't they upgrading that
shit Gear wheels
and should have been buffering things
you know that's how I'll get much
faster I have a for
uh biters aren't turned off but I uh
disabled uh pollution
spread this is what I I just like
followed like whatever the speedr
running guide
say okay is my thing to make the miners
not working
this green circuit limitation God damn
it what's needed for
green
for
for for
all right no more green circuit
shortage make miners now
so much steel did I buffer
it we need Steel
okay what does it take to build a rocket
Silo we
there so research
what are you
missing miners I'll start to
build get power over
here Mega
copper is
good just basically copy this
Mega Iron
mag got
iron steel plates okay but we had a ton
of them didn't do anything but now
okay if we need anything for Mega Iron
and mega
copper that's probably stupid let's pipe
this back to a real
base
for
for for
okay build over here
you
may copper
wire you make green circuits
um green circuits that you output into a
chest
and you get iron from this
Bel quickly
copper green circuits
where's my iron just turn up
go
back
for
for
for for
all right that's a Rob
problem for
okay 1 2 3 4 5 6 7 8 9 10 11 12 13 14
six 8 9 10 11
this game really does make you like
think about how to
uh you
know okay we don't have any iron coming
on that line yet
need to BU coal over to it
too put a few new miners down
I already did
that no I didn't when I beled something
else over to it not
C whatever
what's my time so far
348 yo what's
up oh that's not a red chest it should
be is that with my buffering of
Steel okay good we have a massive amount
of
Steel green circuit should not be taken
here
for for
I'm really focusing the wrong thing
right now it's not like three miners are
going to change anything
we still have no iron coming through
here comes the iron
finally
iron need way more miners
okay the Iron's stuck
okay super iron is
up green
circuits uh
why isn't this
working that one's missing s
Fus they don't have
iron I missed I miss
click it's
fine I didn't make the red inserters a
chest
I did this so
badly I don't deserve to
win there like one bit of not fast pipe
there
okay uh I
chests I think that's way faster than
the chest though
okay we got green circuits we're going
to need red circuits
next I don't even know what we need what
why is science per minute
zero I do look up the speed run as it's
true all right let's engage with uh
let's engage with you guys how's it
going why don't have any blue
Zions what what am I
missing
uh output fall we're missing sulfur what
cuz we're out of
water that was never
connected how did that even
happen oh I must have accidentally broke
it damn
it for
okay now
my science is
unbroken my research can
continue yeah better click Q and the one
in this the thing okay yeah yeah these
are these are just things that I have
you know you see me with vim and I'm
fast and it's cuz I spend a lot of time
in Vim how come I'm not fast in
this all right
um go over here to Giga
oil for
definitely didn't automate that
all right we need iron gear
it's always the same crap you
know be
missed oh
what I don't know what to put
places I need those iron Gear
wheels now want electronic circuits it's
always the same
C for
the refineries in there now let's make
more chem plants need stone bricks okay
now I got to run back to stone bricks
you know I'm so bad at just keeping
things in my
inventory oh we got we better queue up
stone bricks
too for
okay plants and
refineries bring coal in and get plastic
out
a
for for
okay red
[Music]
circuits you want big copper
you make
wire and then wire
has two
[Music]
three
for for
okay why isn't my plastic
plastick cuz my oil is an
oil CU they don't have power
why don't I have way more refineries
what in my
inventory how long will I have to play
this to be good at speed running
all
right make red
circuit need copper wire for
see how I use the button there
see I didn't use the button there that
was very bad at
me oh I forgot output
you for
a robo Port just doesn't have
power that blueprint doesn't have power
okay all right make red circuits all
right let's make blue circuits now
what goes into blue
circuits add
circuits and other circuits
wait what I've never heard of that
blue
circuits we out a power pulse
only because we were out of
trees why are those ones making so much
Steam and these ones
not are they even operating
okay we're out of
PSE it's cuz I made a few other chests
didn't
I they have to be deleted
now we got to go delete more trees
tons of those
did 90% of my copper miners never even
have
power ridiculous
ridiculous how little I'm actually using
none of my miners were even
powered okay we need sulfur uric
acid oh we will probably just get from
the other
side want to deal with making that not
really those pipes to ground go through
Lakes
I want to go around the
online
for for
no
no no I have no defense
[Music]
[Laughter]
of I researched no
military now they'll chew on my
base I aggroed the
biters for
okay so where were
we why are they still destroying my shit
okay well we actually
lost this is happening
again yeah yeah I played fortnite yeah
[Laughter]
no let's try
again we grew overly
confident we thought we were going to go
to space we thought we could turn pollu
off we thought it would be
okay okay well lesson learned you know
what we're going to have the robots
build this
shit not risking real
people wait why did they take those
things you want to say biters
win for
no okay I'm not doing this again
okay let's craft some armor I didn't
research
anything I'm going to die
again you know what you know what the
fighters win the fighters win
all right fine I ever give up up Never
[Laughter]
Surrender let's research little fucking
military let's at least get me a machine
gun and some armor you
know okay you know what I have an idea
I I was going to build myself a fortress
and not come
out for
you know what I got a
car do they know about my
car why do I need to build a machine gun
iron plates I'm never going to find
those
should we get
revenge should we just get some Revenge
real
quick should we lose again to the biters
okay I'm losing to this Rock right
now there was oil right there the whole
time
don't make me get grenades no no no
no okay
my
car they killed my
car and my machine gun and my
armor okay just going to go just going
to come in here get my get my corpse
real
quick
okay all right cool got my machine
[Music]
gun get some
armor
great um why is rocket rocket will be
done in 14 minutes that's actually kind
of terrible let's see how we can Juice
It Up
we have Logistics don't we do we not
have
Logistics oh I never require Logistics
robots no you can't even get request or
chest in Space Age
okay mistakes I built a base that was
too big
uh I spent a lot of time stupidly
running back and
forth I mean to be fair this game's
supposed to take like 40 hours or
something
why what is this stuff limited by
now nothing just
that's the speed at which we produce
blue
science okay that's the speed at which
we produce blue science all right let's
go build speed
modules walk all the way down to the
bottom of my base and let's go build
speed mode you know what I don't have
to um
I didn't research speed
modules
for
for for
speed
module for
we need concrete for the rocket Silo
too let's get on building that one
what's in
concrete
H
stone stone iron ore and
water for
okay now for the enjoyable process of
running water up here
too far to connect
far to connect
for
for
for for
sh
for for
I just not build enough blue science or
something wrong with
it seems
okay all the prere are there it just
doesn't have fine
okay well you'll get speed modul
soon um okay I need like 200 of those
for Rocket
Silo my concrete
[Music]
production I never ever put steel chests
then
that's good power
those okay um we need load entity
structures what goes into that copper
plate steel plate plastic
bar you don't make me do
Steel for
we should not be building this
here should build it back at the other
base the other base barely has any I
didn't build more I was supposed to
build a steel line too
whatever supposed to just have these
things ready to go and cuton
paste
for for
I should be Blueprinting it all at once
I don't know I'm just getting
tired okay we got steel we're going to
need plastic
what else do I need for these
things okay rocket Silo finish low
density structure we need copper plates
too plate steel plate plastic
bar okay
just place the plastic on the other side
of
that need copper plates
low density
[Music]
structure make that many of
them am I getting better at least
okay uh
okay we need 200 Electric
engines what are
those we have zero because we kept
making construction Bots
God how many construction Bots do we
make put speed modules in here
electric engine unit what else do I need
to make a level
bo uh pipe and a th000 concrete and 200
processing
units we're good on
steel we get on concrete
and
concrete we're good on
concrete we need pipe we can get
anywhere but yet we've been short of it
though no I just threw all my pipe away
okay I know where that is at least we
need 200 processing units and then 200
electric engine units also going to need
to build that which is going to take
copper cable
and I didn't build output things of
course not for some
reason okay that's good I didn't use any
of those that's great just built them
cuz that's where the blueprint
said 200 processing units we'll get
those to the rocket Silo in a
bit
[Music]
um Electric engines and
pipes oh well that needs copper cable
that's convenient
there's the
copper well that never got
upgraded Le finally we're using it
[Music]
okay Electric engines and pipes and we
can craft a rocket
syum I don't think there's anything else
we have to
research don't understand why those
aren't
steaming are they not
connected they're pretty clearly oh no
they're not connected
I'm an
idiot all that power that whole time was
just not
connected I don't know why that one
doesn't have any e
call
a I'm so bad at this game
I I looked at that three times
not there yet on that tons of steel
though
okay we're going to have to make rocket
fuel we should do that now
make that just a normal
assembl yeah they need the C plant for
the
uh White oil
um that's
fine no okay that can't be right
prob one chem plant
that
ch
for for
once again I didn't do out
but I'm just getting tired
see if we have enough engines yet
craft rocket
[Music]
[Music]
Silo
[Music]
power see the extent of my Logistics
Network
oh did I ever get my low density
structure assembler
working yeah I did but it didn't make
many of them
we didn't have any copper
plates it's a full
Bel
for for
okay my rocket Silo is
done how much time we got
what are the five hours all right so
real speed runs do this in what an hour
and a half
Processing
Unit goes
in rocket
fuel
in
and low density structure
go
that okay the rocket fuel's coming
copper is good okay good look how much
better we did that one that was good
someday I'll learn how to actually do
uh these things
right that did nothing
all right we're making a rocket
um now we need more of this stuff so
this is going to be copper cable and
steel
plate saved up all this copper cable
now we're out a steel
plate for
that while we
Craft
um should have buffered everything in
chests so that way I never would have
been sure but then like you don't see if
your factor is working when're not
trying to build a factory for a long
time we're trying to speed run
let's build space platform starter
pack let's walk back to my
rocket the lake still
there why because we burned it all in
this them engines
okay I don't know like I should watch
this replay I should force myself to
watch this replay of this video and be
like wow I'm such a
dumbass all right
we just got to wait for these things to
craft down
here 15
seconds all right a good time to
talk uh yeah I'm in Hong
Kong I live here
now uh even worse League of
Legends we can talk these in a s and go
faster
actually maybe
what made me choose Hong
Kong it's like China's a future guys I
don't want to get started on
this
56 feel like we're right back at the
beginning
one space platform starter
pack okay then we're going to put the
space platform starter pack in the
rocket
uh can I speak Mandarin better than I
can speak
KY wo
chn I can speak man about as well as I
can play
factoral Chu I don't know what that is
60c crafting time it's probably faster
than an
assembler and we made three extras of
this crap
let's go
boys all right what's my
time oh barbecued pork Oh you mean like
the
the 58 okay that's that's not that
terrible check out my space platform
who's played space By the
way
stream Speed Run they don't allow quotes
in
the
ah all
right we're just just chilling in space
that's
[Music]
it go to
GLA maybe next GLA sucks I haven't been
to GL yet little B to
volcanos can you comment on my blog
posts no I don't want your feedback
all right cool it's a decent that's a
decent Friday
evening
um last night I got a
6:30 that's actually that's actually the
second time I've done that if you could
believe it uh so you know we gained an
hour and a half and I played I feel like
I played
terribly I feel like I I just
like I'm curious I'm curious who in this
stream thinks they can they can beat me
who in this stream thinks they could do
that
faster people we got by the
way 285 yeah y are disappointed you're
like he's not
coding he's just uh playing video games
badly you think you could beat me
awesome freak
72 there's the L from already this
stff uh
um you know what it is about coding so
like my day job is really
coding
[Music]
uh from a very modest perspective I
think I could beat you all right maybe
we should should we have a should we
have a a
[Music]
uh best meal I've eat in this I do like
I do I do like this shanton spot I go
there a
lot wow it's already
midnight that took five hours
how was the conference oh the Thailand
one you
know look we made it through a whole
stream with uh being so positive we were
so POS even even when the biters uh
attacked us and we died multiple
times uh let's take Tik Tok train post I
don't know what that
is oh oh my high rank and Advent of
code uh
well let's just say I've been playing a
lot of factorio so I'm into
automation oh the car shit went
to oh
I'm I'm going back to San Diego tomorrow
actually uh be in town for the Comm
holiday
party and uh you know meet up with some
a tiny Corp got a got a lot of good
things planned for uh for next year tyy
guys's getting
good
um yeah we're working we're almost done
with the delete lazy which is like the
biggest uh
I bought the new I bought the new chat
GPT it seems like they made old 01
crappier and
then uh like actually the thing that I'm
even fine with paying $200 for is just
unlimited access to
A1 uh I hated having to like not use 01
for some things because I'm like oh I
only get I only get 25 more requests
this
week
um that's good I bought claw too I've
been uh Advent a code has
has has uh I mean I said I said on on on
Twitter that I thought ow and previews
the first model that could code and it's
it's really true
um yeah of course it's 20 bucks I paid
for it make that off your subscribers
boys um yeah back to America Christmas
party use1 to avoid the problem
statement look here's my take on AI and
admin code it's like trying to restrict
it I think it's a really bad idea
because it's like doping right I think I
think cycling should just allow doping
it's really stupid uh for it to not so
first off you no longer can be
competitive I I tried the first couple
days without
AI I'm no longer remotely competitive at
have a code and look I I I was like 21
first and 30th for two
years um I I was doing pretty well then
I got bored halfway through one
year
uh so you can't you can't be competitive
without without using AI but then the
contest turns into something entirely
different the contest turns into who can
build the best
automation um what AI did I use well
that's that's my
secret uh
you got to be fast you could try to pipe
it to the opening I API but uh it's open
is not that
fast AOC is so
hot yeah can you can you pay to get your
uh yeah add proper jaction I'm still
waiting so I'm still waiting for the one
that uh uh like like uh fucks your
system that uh that that the encourages
the solution to run like you know rmrf
star um is grock any good they're losing
money I don't know I give I give some
chance that grock's not even running
their shit on their own
chips uh
cerebrus
inference cool we got some good stuff
merged um
yeah he's on board as an intern now oh
we got web GPU have you guys seen
this let see if it comes up in dock do
go this the old one still
this might be the old
one submitted to hack I can find it
there yeah this is a new one
um
being good at
factorio oh let's see person who is good
at
factorio oh we got download the model
wow this is this is slower this is
slower than my factoral
speedrun uh hang on you can't see a shit
because I'm big
um oh I just to rown the model because I
worked cash for
stream uh oh yeah you see me on Blue Sky
now see the problem with these things is
like too many people show up and then
it's not fun
anymore uh I like I like speaking to a
small like like the people right now who
are here and stuck with me after 5 hours
of uh of
Factoria uh it's got to download the mod
my internet here is not that
fast um it's
5G fast
is yeah kind of
mediocre 5G is real yeah yeah you know
that 5G that's in your phones that 5G
that mind control and everybody is so
trolled uh yeah no we're working on
uh we're working the the big thing that
we're doing is the deletion of uh of
this
file so this file turns out that you
just kind of don't need it like all
those lines can just go away CU they
were bad lines move that there put that
there that here oops don't do that see
my mind's just like it I think it does
make me think better though and I I
wonder if I wonder if I
uh what is web andn it seems
stupid I don't know this is just yeah
this is just this is just a browser
framework
uh oh here we can
run webon and not supported setup webon
in oh I have to like download some yeah
you don't need any of
that oh it's because they want to use
npus and stuff do I have a single
monitor yeah yeah I've kind of moved to
just working on a single
4K and I got my laptop over here
change my stream
title why is my this is the end of my
factoral
speedrun when do I leave tomorrow
why uh yeah we're deleting this whole
file that's really exciting
what's your first season of Mr
Robot uh yeah it's being replaced by
this well no I mean the main like the
big abstraction in tiny grad now is the
UOP um so these are all the Ops and Tiny
grab there's a few more now if you guys
haven't seen viz viz is really cool
[Music]
so
like this is the uh this is the actual
uh this is the uh the map M so you can
see we're
loading those load multiply reduce axis
to um and then we have this thing called
Lower which will actually do indexing so
like these shape trackers are not are
not indexable they're not indexable
uops uh so like you actually have to
like replace it with like oh here it's
the local index of the GPU uh this is a
expand uh which is like a like an
unroll um then this so on and so forth
right you see a bunch of stupid things
in there like add zero so we're going to
just remove those do the first passive
constant folding all right now we got to
do something about those expands so
we're going to prop at them through this
is in vectorized format where everything
is
vectorized but it's the gems we got you
know there some Japs and we add we store
right it's a loop over the two special
over the two local index GPU all right
now these vectorizes uh you know we
can't actually render them so we're
going to uh Dev vectorize the whole
thing so this is what it looks like de
vectorized that we can actually do that
load uh it's kind of like
and now this is oh this is the new thing
I finally merged this week um the linear
eyes so you see like we've got to group
these things into basic blocks so I
think this one is all just one block
yeah it's all one block so it's really
simple but if I run it with
noop uh actually let's not do noop let's
do clang too um so if I run it with like
clang and noop so it's just like here
you can you can see the code here this
is the code for the uh MX multiply here
but uh you you can see there's a lot
more uh blocks now all right so like
these block ends are like Loop ends so
these are the outer Loops this is the
inner
loop
[Music]
um and uh yeah we insert some block
forks and then we group them together
into one mega block right there and
those are the uops and that's what gets
rendered into that this should be ready
person who's good at factoral run okay
of course you're not going to have to
redownload the model every
time uh once the model is downloaded oh
there we go look wow that guy looks like
he's good at factorio that's pretty cool
um so yeah like we don't have to
download the model again we just have to
decompress it because it's to compress
compile all right um a dog on a
Mountaintop cold
4K uh image uncore he
I that's a terrible scary
picture let's try again roll
roll okay
okay um yeah OG St diffusion was not
that
good but yeah it's time to gra viz uh so
this is all this is all tiny grad uh in
in the web GPU I don't know I haven't
actually read the Cod of this but uh
let's see what we
got so's actually that
code for clip okay let's just look for
the CP
tokenizer it must be imported from a
separate Javascript
file here we
go that's a token I there so where's the
actual
model I you read this
wait
next let models equal
what where does that come
from for
G get rid of that and put that in tiny
grab so where's the actual like
code
dynamically something called text
model oh here we
go oh it's a net. JS okay how does .js
get loaded in the
source oh right there I just missed it
okay I'm
done here we go so these are the actual
generated kernels by tiny
gr let's just output in print it
out a bowl of noodles
M noodles those look pretty good those
are pretty tasty
noodles where
did here we go do Will Smith eating
spaghetti Everything feels like factorio
now
[Applause]
yeah not
bad visions of a person taking iasa you
know what I'm just going to paste the
link for you you can try it you can try
it all right see you Will Smith um
yeah so viz is the new hotness you just
run with viz equals one and you can go
and you can see how uh every step that
actually uh builds the uh builds the
kernels that builds the source code for
this s
with all this my
bedtime n just kidding I'm going to do a
whole other Factory spe doing
all right so let's let's for the last
minute let's reflect on what I did
badly mean it doesn't let you run you're
in Chrome you're on your phone we got we
got a YOLO demo that runs your phone
too um here you want to see the YOLO
demo
y we got a oh that's pretty good that's
that's sick actually this improved a lot
yo that's good
FPS yeah buddy try that
one oh this is buttery on
laptop I didn't have my steam power
attach that's true this buttery
M what's this oh bottle not
bad it's over for surveillance Pros what
we got an actual remote cell
phone
airpods
remote my wallet cell phone
are there beers in the refrigerator
where's the
refrigerator did say
refrigerator did it say refrigerator
over there oh yeah the
refrigerator are there beers I don't
know let's go check
and some refrigerators are whiteboards
too that's right and some whiteboards
can be refrigerators if they
cold thank you for watching my stream
maybe we'll try another speedrun but
we'll try to get I would be happy with
a two and a half hours I'd be happy
getting half that time three hours yeah
three hours that's pretty
good three hours no I got like take
notes I got to go through and you know
just like not fuck around forever next
time up three hours
all that sounds good good night
everybody if I don't see you happy
holidays enjoy losing to me at Advent a
code um and uh Merry Christmas to
everybody even the haters and
losers check out the check out the check
out the web demos that this good this
watch improv watch
improved uh you know on that internship
bro you want internship you know how he
got an internship he contributed you
want internship you contribute that's
how you get an
internship why would I give an
internship to somebody who didn't
contrib all these people are like oh can
I get a job can I get it why aren't you
contributing on
GitHub yeah there's no excuses
anymore use ai ai can code now I love a
future I love a
future uh yeah why give them internship
without making them work for free first
you see if that's your attitude you'd
never fit in here why do even want an
internship look I can whoa whoa look at
the size of that
box I can control the
Box all right good night everybody
bros welcome to my stream bros
let's get some more lights in here you
know
like some clap on lights in this bitch
i'mma be clapping all night in this
bitch
you're allowed to say bitch on twitch as
long as it's legal in your country
all right let's see if anyone's here
join my chat
let's put a hoodie on we need a hoodie
[Music]
oh we'll be drinking aurora bora
bora basil berry this evening
we are live
[Music]
uh i don't know why
nobody's uh in my chat yet oh is it
still sub only
no it's on sub only
hello
this is what oh i can't drag it over
there
i drag it over to this window
oh people are here
okay
uh yes
all right
um so
i'm uh
not very good at this game
but we're going to play anyway
uh this is my i want to pivot i don't
want to code anymore i want to be a
gamer
this game is called ftl
um you have this ship
and uh you're control these little guys
and you fly through the galaxy and you
fight other little ships
full of other little guys
so first question to you guys should we
play on easy
normal or hard
hard
normal
all right all right no one's saying easy
oh we have one easy all right all right
we have an easy we have getting normal
you guys like extremes i'm not playing
on hard you just want to see me lose
we're going to play on normal
i told you i'm not very good at this
game
all right
the data you carry is vital to the
remaining federation fleet you'll need
supplies for the journey so make sure to
explore each sector before moving on to
the next
um yeah we want to stay in each sector
for as long as possible to improve the
ship since each sector is good okay this
is our ftl and we can jump and there's a
store and that's kind of unfortunate
because it's down there
um
so we got to do pathing through the
galaxy
see if we can make a bunch of jumps here
and then we got to get to the exit
before the rebel fleet uh catches us so
let's jump over here and let's see what
we get
um
so we can um
we're gonna aid the federation ship
because we have a chance at a double
reward here i was watching some youtuber
play this game all right so let's look
at his weapons
uh oh he's got a oh he's got a hull
laser oh is that a missile i don't know
if that's a missile but either way we're
gonna target his shields
and we're gonna target his uh
fuck we're just gonna target his weapons
with everything
um
let's go
well actually you know what we're
actually not gonna fire the laser
uh because we might be able to target
his shields if the uh
things knock his weapons offline our
shields are down uh all right maybe
that's a hit to his weapons uh his
weapons are only partially down so let's
take them out with the burst laser so
his missile launcher will go offline
because we did take two points of hull
damage there all right
so his missile launched his weapons are
down
um we got a guy fixing the engines
that's pretty good
um
let's uh fire the laser
uh at the uh the shields let's take his
shields out since his weapons are
offline unless by the time the laser
charges remember missiles cost us
missile to fire so we don't actually
want to fire too many missiles all right
let's target his uh
his weapons i don't know if he's gonna
get a shot off with that missile
launcher
[Music]
um oh he did that's okay he missed all
right great uh let's actually take power
out of our med bay and divert it to our
uh
engine so our dodge goes up to 20
percent here
uh and we're gonna fire his uh okay
great and we blew a ship off that cool
peace out bro
uh contact the federation ship yes let's
rescue the crew oh and we got a guy his
name is t-leck it like you're my shields
man and we're gonna click over here to
save our current crew positions
all right so we gotta we got a pretty
nice looking crew here uh let's jump
let's go up here
um
no i'm gonna lose crew if i do that so
we're not gonna do that one
it's not like giant alien spiders but
either way
um
they can improve my reactor for
two fuel two missiles and two drone
parts i think we're not gonna do that
um let's go down here
[Music]
uh
okay this guy's got a drone
got some shit
all right uh
i don't think his weapon can hurt me
that's just some like
as soon as we get 50 scrap we gotta
upgrade to double shields
wait my shields are offline
why are my shields offline
what temporarily disabled by enemy
how do you do that i don't know
but either way we'll target his weapons
i just took my oxygen offline his little
beam drone how did he take my shields
out
maybe we have to target his drone
control system that thing's going to
keep damaging me
why are my shields
offline
[Music]
i don't understand this
[Music]
either way we'll take out his drone
control system
all right drones are offline
up now he's hitting me with his beam
we're in trouble here all right fire the
burst laser his weapons
his weapons are down
uh let's make sure his drone control
stays down
[Music]
i don't understand why this is grayed
out
all right um
you don't need to fix the oxygen anytime
soon that's fine
i'd rather not waste any more missiles
so let's just charge my laser
off hit his uh
if we need to we'll use a missile we
have it charged
oh i should have taken shields out these
things are already offline
[Music]
some chance we destroy a ship with the
next volley
[Music]
got him all right we'll send this guy in
to fix the oxygen
all right we're at 50 scrap so we're
gonna buy two more shields
i don't know why my shields are offline
so we can go like that if we want
oh sorry you guys can't see my power
that's actually pretty important so
we'll put me right there that's not very
important
all right cool
this is this is my power to my systems
on my ship where's scotty when you need
him i know i know
warning oh too low all right we gotta
power the oxygen oops we didn't power
the oxygen all right
the oxygen is powered we're good uh
let's send this guy in here to fix
sensors sorry i didn't do that fast none
of this stuff matters this is not a
real-time game
uh we also got to heal up larry in the
uh first aid bay over here so we'll take
the
engine offline and put them in the first
aid bay
maybe the engine offline
okay now that landing's healed up we'll
send all my crew back to their positions
um
all right so we can go to the store but
we don't have any money so that's
useless
um
maybe we can go around like here
yeah it looks good
uh
yes let's attack the automated ship okay
he has a missile launcher
uh and he has a uh combat drone
uh let's uh power that down power that
down power that up
um i don't like that our dodge is now
zero
it might be worth it to have two shields
but he has a missile anyway
at least that's stopping his combat
drone okay he fired a missile
all right we can take one hit from the
missile our doors are offline let's hit
him with the laser here
and that's offline oh we should have
increased our burst our dodge percentage
when the missile was coming out that
would have been ideal
whoa well my crew members are not gonna
die bro i'm great at this game
let's knock his drones offline
sorry
i just want to be able to read your
chats better
miss on the drones
it's not even hurting me
[Music]
all right his drone's broken you can go
fix the doors
it doesn't matter it's not gonna get
boarded or anything
all right his drones are down
actually his drone's being went down i
don't think these ships fix
well themselves shields
t-league got some experience repairing
oh shit
just died
oh i missed
oh he better not hit me with a missile
i'm gonna be mad
all right shields down power to engines
dodge dodge dodge
no okay we took one hole damage that's
fine
all right um didn't get anything there
if we have to we can jump back to the
store but we'll go here it's only a 14
scrap
um
yeah we'll leave the civilian ship let's
go double reward i don't know what that
is it looks like some kind of beam and
some laser weapon
uh oh we need to buy another power all
right let's just power shields
i don't need oxygen let's go there
don't let me forget to turn the oxygen
back on
just until we see what weapons he has i
don't know if that's a missile all right
he's gonna fire first
with that laser we have two shields so i
don't know how good of a laser it is
um
targets weapons
all right it only has two great
oh it's a teleporting bomb oh shit
there's a bomb in that room
get out of there bro get out of there
all right the ftl drives off line
oh is he gonna hit me again with that
all right let's uh let's use the missile
offline
[Music]
taken down
oh they fixed up my hull all right
that's great
all right you go help fix the engines
all right uh let's buy a power bar so we
can keep some engine power we have both
our shields powered
let's jump uh no point going to the
store we'll just go here
since we only have nine scrap
uh no pirates we're not paying you any
money who do i look like all right they
have some laser weapon and some ion
weapon i don't think that really matters
i just hit their weapons
they could knock my shields out with the
ion weapon
they have a crappy little laser and
their iron weapons offline
dick dumb shits
i got this one where it was like you
know
you we sat and wait for months for a
trap and then i like blew their ship up
and i'm like imagine waiting months and
then your ship getting blown up
um
yeah it's a bojack reference thank you
thank you you know my references
sarah lynn was my favorite character
knock out their oxygen just to do it
we are playing on a mac
why is it different all right lanny you
got to go to the uh you got to go to the
first aid bay remember every jump is a
jump into battle i'm just repeating
things i've heard other youtubers who
play this game side
ah
that's too much man
all right um my ftl is down because i
don't have any power to it
all right so we can't go there because
the rebels are about to get in control
of that beacon i so go there
all right what do they have
what is that a missile and a bomb thing
drones
set lasers to ramming speed
that's a beam weapon is it not
all right good i don't think they can
damage me
all right now shields are down
oh no the drone got a double hit okay i
forgot combat drones can get a double
hit oh and that sucks because doors are
offline all right you go put the fire
out
um
we will not accept surrender who do we
look like
yeah drones can a combat drones can
occasionally fire twice
so what happened is the combat drone
fired twice and then i got hit by their
beam weapon
and they took my uh
first aid bay offline okay this ship's
done
all right uh thank you let's put some
power to the med bay heal up those guys
who bravely fought that fire
um
power to the engines
should i buy another power so i can get
two power to the engines what does that
make my dodge go up to
twenty percent
yeah it's probably worth it
i could keep the engines powered let's
jump here
who suggested surrender all right we got
a rebel ship
some
a heavy laser and a beam weapon yeah i
don't think they can do any damage to me
hit those shields
i think there's a heavy layer so expect
a green thing to shoot out of it and i
think that's a beam weapon
yeah so that doesn't even take my shield
from that just hits me with one shield
and the beam weapon does nothing
all right cool i'll turn auto fire on
and we'll just let the burst laser blow
them up
[Music]
some people on youtube i've seen they do
training against ships that can't hurt
them all right so this ship has weapons
that are so crappy that they can't get
through my shields
and that's what the rebels get for being
cheap and not buying good weapons
and the rebels should have funded the
ship better
oh don't tell me this is one of the
ships that tries to uh jump away if i
start beating them
no i think as long as i make them fix
their shields not gonna do that
but if they try to jump away we got the
artemis missile uh
yeah yeah it's this all right
um well they're gonna fix their shields
now
oh they might get away should we just
hit him with a missile they have 15
missiles yeah
i
target their pilot
oh no i missed
oh they're gonna get away
and i blew the ship up never mind
all right great
[Music]
we'll go down here
get wrecked rebels let's attack the
pirate yeah alright they have a missile
[Music]
and uh is that a heavy laser i don't
know
oh
oh yeah we should also always switch the
order of our weapons
uh because in case your weapons get hit
you want the ornaments to go down and
not the burst laser
all right um this ship does have things
that can hurt me so i'm gonna target
them with that
yeah
oh and there we go oh our weapons went
down too so actually the artemis would
still be online if i didn't make that
switch
so that's what i get for you know being
dumb
all right first laser's back
that thing doesn't do anything
it's this missile launcher we got to
watch out for we should be able to hit
them before they get back up
good we're learning how to repair things
that's good
all right great
keep their weapons offline
it's nice that the laser comes back up
first
so we just hit them all right that's
offline
is this the right stream yeah we're
playing games boys
uh piracy cannot be forgiven that's true
we're not gonna forget piracy
all right cool we blew their boat up
great um
we do not
do we have time i think we might have
time yeah let's go help this guy we have
a lot of g we have a lot of fuel
we're in space fighting enemies that's
right send in my crew hell no
uh oh are we gonna have to jump to the
no
no
oh i already messed up boys we're gonna
have to fight the rebels that's all
right
uh oh what do they have
i don't know all right let's just get
the ftl charged as fast as possible oh
we have asb to deal with too
oh shit
i should not have done this all right
take the weapons out
oh no we're getting hit by asb
this is why you do not this is why you
got to be more careful the guy on
youtube was playing on easy mode
three damage
[Music]
three hole damage oh i don't want auto
fire on why do i have auto fire on don't
do that
all right we'll get out of here soon
we just gotta wait for this to charge i
think we'll avoid asb again
no we're gonna get hit by two asbs damn
it
all right jump let's get out of here
all right uh nebula or rock oh it's
gonna have you off
great
okay sorry you guys are gonna have to
suffocate for a little bit don't worry
the med base we're ready for you
don't die
we made it out that's right we're in a
nebula now you guys know about nebulas
and nebulas you can't see
uh all right
what kind of path we want to take looks
like there's some action over there
yeah yeah
wow okay so that's like you got to be
careful here you have to be down here by
then do not end up there because you got
to go so many jumps to get back to the
exit even looks closer let's go
amazing retreat well done captain let's
go
yeah you guys can ask me new questions
on this stream because you know we're
all equals when we're playing video
games
video games are the great equalizers
uh
yeah let's help them oh great we got a
guy matt all right matt you're in charge
of sensors congratulations i hope you're
good at sensors if you're not good at
sensors we're going to
throw you at the airlock
you know you don't just get fired on
this ship you get thrown out the airlock
intruders
where are they
all right you go to doors
normally i like to suffocate them you
know what no but we don't need to
suffocate let's just go beat them up
whatever we're not doing anything else
go beat up the intruders oh my god
there's a lot of them
all right no no we gotta go in that bag
okay
wait no no no do not stay in there go to
the med bag
you're fully healed you can come out you
go to the med bay you desperately need
the med bag bro
okay um i think what we do is we
okay they're in weapons
so you go to door control
and then we're gonna open all the doors
but close the ones to the
med bay we'll also close the ones to him
because we don't want him to suffocate
and we'll open these
and they'll all run to the med bay
because it's the only place with oxygen
that's right we're suffocating them
up nope they're trying to go in there
oh they broke in here
okay good three of them are in the med
bag all right we can close the doors now
and you can find them
great see my guys are being healed while
their guys are dying
great this guy can take him
hmm go fix the weapons
you three go fix the weapons you heal up
in the mad back
that was some good planning what do you
think
all right everybody go back to their
stations
matt you know where your station is it's
sensors you're in charge of sensors
save current crew positions
cool let's get out of here all right we
got a distress peek in here
let's go here
all right
they have some kind of drone oh we're in
an ion storm
um we do not need the med bay our
oxygen's already offline which kind of
sucks remember you're always jumping
into battle
uh now we can get oxygen power
i don't think those weapons are very
powerful
we have one shield which the combat
drone if it gets a double hit will work
but we can't really power the other
shield
uh
all right we don't need to hit the
weapon just hit their shields because
that beam went from oh we'll now if the
drone takes it offline then their beam
weapon's gonna do damage
the drone takes my shield down you know
what just take out their drone
control right the drone's down
took the other one out of their drones i
think i hit their shields on them
they'll fix shields before they fix
drones i think
oh they fixed the drone
the drones are offline
take out their shields
can i recommend a good hardware kit bro
we're playing video games this is a
video game stream
oh shit all right don't let him get away
um i don't know if i'm gonna be able to
charge in time
i don't think i have a choice
target they're piloting
don't let them get away
great we got em
all right they're gonna try to fix it
again
okay we missed they're gonna get out of
here
all right they ran away
do the rebels know our location now oh
we're boned
um
let's go to the store and then distress
or distress them the store let's go to
the distress someone might need us
i play factorio a bit all right what is
this
um
what is that
let's bring the weapons online bring the
shields online bring the engines up to
full power
uh what they have like uh is that just a
laser and a beam
uh if our shields are full power i don't
think i can do anything
let's
take out the weapons either way
i'll take up the shields do it
oh
what oh they have a boarding drone
oh
i don't want to deal with that
i'm going to take my piloting offline
that's fine you stay at doors i gotta
get people to fight the drone
actually if i just take the drone
control offline i think that'll work
you got the drone control i have 15
missiles hit him with a missile oh we're
running on fuel too
all right great the drone's useless
how do we only have three fuel
like what did we do to not get fuel
all right they're not pulling oh well
okay either way they pull their guys off
of uh
they pull their guys off of piloting
see you bro
all right uh you guys gotta go fix that
hole sorry there's no oxygen in there
don't think i had to go back to the med
bag see this is like when you watch
people who are good at video games they
probably make smart decisions
but i don't
all right we got a little bit of fuel uh
should we buy anything no we'll go to
the store next aren't we maybe we can
get a weapon
yeah we need a weapon
so some of these guys i guess they
stream so they can't just be waiting for
the god tier rng
because our rng has been meh
kind of meh
let's go to the store
let's go to the mall
uh all right all right we can buy drone
control
um
we can buy this we should probably fix
our haul
[Music]
do we want drone control do we want to
buy a defense drone it comes with free
system repair drone i don't want that
crap
uh we definitely can't afford cloaking
i'm not buying that drone uh let's buy
the fuel and let's fix the hall sorry it
was pretty boring but that's what we
bought no weapons here
all right let's get out of here
um
all right pathing
there there there there there
should we try to go around like that
let's try to go around like that
we don't want to get hit behind the
rebels again
i don't know robin sparkles is
uh
leave arm the weapons
all right they have a missile launcher
which means they can't hurt me
oh shit
wearing one of those ion things again
laser take the oxygen offline bring up
the missile because they can't hurt me
charge our weapons up
i'm gonna get a shot off though which
sucks
with that missile launcher and then i
have a blazer
all right the laser was useless but this
is going to do something
they don't get two damage
good they keep the laser up
take out their weapons fully
okay their weapons are down target their
shields
oh let's go to the mall oh then all
right yes that was the reference
we will not accept surrender
my ship's running out of oxygen boys
well we're going to get back into speed
running
all right good the ship's dead take that
offline bring that up
um
poor man you need to go to the uh wait
what how's this guy dying
oh he almost ran out of oxygen that was
close boys
that was close i was careless
i was careless i was being careless
ah
this is what
what's an sde
i have no idea
um this is a don't be a noob stream
we're learning how to play this
game uh remember every jumps jump into
battle is our ship battle ready
all systems are at maximum sir
all right good uh we're gonna go around
like this let's go down here
how many viewers we got
do you guys only watch programming and
not watch me play games is it because
i'm bad at games
all right do that that
don't need that don't need that
how many viewers we got i can't see
uh some laser and some teleporting bomb
uh target the weapons
186 we usually get way more you only
like when i program
the game is boring this game is
wonderful
i kind of suck what do you mean i'm
doing so well what am i not doing well
thank you for saying this game is
interesting i appreciate this game all
right
we are
sure journey journey men
traveling through space i don't know i
don't know what eldon ring is
damon vamp
uh especially because we're in space
we're on the kestrel traveling through
space with bournemouth
lombard teak leak and matt
you don't know what's going on
all right all right
i'll try to explain this is good this is
good practice from my explaining thing
yeah yeah it's like you get to
micromanage people
all right so we're in space on the ship
and we have these systems like shields
engines first aid oxygen and weapons and
then we go fight other ships and we use
our ship to fight just watch the game
it's not that confusing
um let's jump back here we'll try to
make it around like this we're jumping
through space we just jumped
we're gonna go fight this other ship
right now we're gonna attack the pirate
look here's the ship okay
so when i look at him
i'm looking at his ship right now all
right so you see his ship has systems
just like our ship
our weapons are already online
uh and then he has a
missile which is the same as ours he has
laser so missile weapons go through
shields
so he's gonna go through the shield with
his missile weapon if he gets off a shot
he's probably going to
yeah he already fired
all right so you're gonna hit us with
the missile but it's okay where's he
gonna hit oh he missed all right great
oh we should buy more engines to get our
dodge percentage up
so this is my dodge percentage it says
that uh depending on how much power i
have to my engines i can
dodge
oh these missiles back up no he's not
actually going to get a shot off we'll
get my laser in time
that is a heavy laser it does two damage
if it hits me but it's oh he is going to
get a missile off man i took a whole
damage okay that was dumb
um
they tried to surrender we said no
oh they got another missile off that was
stupid
sorry i fought that fight badly you can
all tell me i did a bad job
atlantic get to the first aid bay oh
shit my ship's on fire
all right we'll vent that fire into
space
can you upgrade your ship yeah you can
upgrade your ship so this is where you
upgrade your ship we have 111 scrap
right now scrap is the local currency
all right things are no longer on fire
let's close the doors i just opened the
doors to vent the fire
uh so let's just open this up make sure
we have plenty of oxygen in here
uh and you can get in there and help fix
that too
all right so now we gotta fix our engine
you know fix it fix fix fix fix atlantic
you gotta go get healed
see atlantic is a slightly uh not healed
so he's got a heal
and that's why he went to the first aid
bay all right so i press enter now all
the guys go back and now we can get back
jumping
let's go here
uh what do you get for winning the
battle like in life man nothing nothing
you get nothing for winning the battle
i have not played into the breach is it
good
uh let's just attack the ship what's his
unknown weapon he's got some like laser
and some beam weapon
i don't know that actually looks like a
pretty good laser let's try to knock it
offline
i think that's the same as my laser
actually
just keep his weapons down
he got one weapon back up we're not
gonna let this happen again
if he gets the weapons up at all we will
uh change the targeting reverse laser we
need to get some more weapons we have
111 scrap we need to get to a store
we will not accept surrender why would
we accept surrender
have ever played with a boarding crew i
haven't really tried
boarding um i did buy the crew
teleporter once but then i lost that run
pretty fast
all right
uh we have plenty of time we'll go here
we'll go here
probably if i'd path better could have
made it like one or two more jumps in
this sector
um
okay
rebel scout he's got a missile
so we do have to target his weapons
unfortunately
uh he's worth using a missile on
let's knock his uh let's knock his
engines offline so he can't charge his
ftl
and target his weapons there so he can't
hit us no he'll hit us with the missile
either way
whatever good enough
any as a drone
[Music]
shields and engines are offline
uh
take out his shields
sorry
weapons and engines are offline he can't
ftl
without any weapons will keep the
missile charged in case he tries to ftl
take his engine out take his pilot out
too
i know i only have five fuel i'll buy as
much fuel as i can at the next store we
just have to get to a store
one fuel this is pathetic
it's a pathetic amount of fuel
should we buy should we buy some engine
all right you'd add more to your engine
all right let's add one to the engine
buy another
power cool
uh
who goes ultron
alright first jump don't get a choice
we're in a nebula
all right he's got a cloak
full powered engines we're at 25 dodge
our sensors are offline because we're in
a nebula this is fine
my weapons aren't charging because he's
cloaked even though that doesn't make
any sense don't forget to add power to
my engine i'm about to get hit by a
missile yeah you're right i should
really micro
micro better all right
he has a laser that can hit me
um and a teleporting bomb
uh we go over there let's vent that fire
into space
uh let's put power to that
hit him with a missile too we got plenty
of muscles
shields are still on fire
got this cloak back uh close the doors
go fix the shields
oh there's no oxygen in that room
shields are offline
i should take them out with one more
burst
unless he gets his cloak in time
he's done
uh
i think i much prefer laser weapons to
beam
weapons right we got a distress call
down here we got a couple of
things up here
[Music]
what connects to the exit all right
we're gonna have to make it up there
eventually let's go here
yeah i like roguelikes i played um
there's a card game one that i played
for a bit slay the spire
uh
let's hear them out i'm a nice guy
uh
all right cool we got a quest
all right let's definitely goes with the
nebula
actually i don't know if we can make it
to this nebula we can try
all right um oh is this mantis oh no
mantis are hard to fight
all right let's get them to the med bay
their ship has
junk
uh
all right let's open these up
get rid of their oxygen
they can come to the med bay and fight
me
i'm not paying attention to the fight
over here
target their weapons
i shouldn't let them fight my doors
let's go in there and fight them
all right great they're in the med bag
the best place to fight them
a power to the med we're good
uh
and with a missile
great
we will close the doors all my doors are
broken fix the doors
hit their shields with a missile why not
hit the weapons here go
good
they are done
gotta wait for a ship to refill with
oxygen
have ever beat the game yeah but only on
easy i've never been in a normal before
i've played maybe eight hours
all right cool we have a lot of scrap
now
so we might want to upgrade our ship
uh we can make it up to the nebula
should we do that
yeah i think we should
oh we only have four fuel so we better
find some fights
um all right this is an ng ship
some beam weapons
i don't know if that's a missile
oh we can de-power that put that power
into the engines
uh they have a defense drone so there's
no point shooting missiles at them
[Music]
they're gonna have to really target
their shields
the laser i need to buy some weapons i
haven't had any opportunities
i don't know how these like i don't know
what i'm doing wrong in this game
i feel like i just don't have a lot of
uh
[Music]
opportunities
you know
see i can't even take out their shields
my weapons suck
[Music]
i mean to be fair their weapons suck
against me too
but i think there's no point in wasting
uh wasting any missiles
oh ngs fix things so fast so i hate
these people
i could try to take their drone control
out and then hit their shields with a
missile we'll do that
[Music]
like they can't really hurt me either
oh no it's good for training
they have a defense 2 drone which can
shoot my lasers oh i guess if i fire the
missile right when they shoot the laser
i'm good
[Music]
they fixed things so fast
[Music]
where'd my missile go
yeah if i stay for a while train my crew
to be experts good point
i like that you know this game bro
am i doing anything wrong
oh shit now how'd they hit me
[Music]
how'd they hit me with that beam
oh good look he became he got better
all right they're on fire you hit him
with that
i think it's okay they just shoot it
down
this is stupid
okay don't let me waste any more
missiles
you fix the map
should we go back to the drone control
strategy
i feel like i've been getting hits on
the shields
i think if i could knock one power out
of their drones
it's only hacking once you see that is
that
okay we need to get the hit on drone
control
then their drone will be offline they
will fire the missile at their shields
[Music]
oh great am i guys learning oh yeah look
he's a two-star weapons general now
i mean it's nice this is fine like we're
training
this is very boring
not really that i'm not bored are you
bored
like what can i do here
if i fire the missile at the same time
can it not shoot both
[Music]
i just shot both
i'm just wasting missiles
you cannot shoot both but the timing's
very tight
oh there we go
he's gonna fix it though in time
all right i got his shields down
nobody got the drone back up damn it
how did he hit me
they fixed the shields
[Music]
oh my oxygen is broken
i wasted so many missiles on this fight
the ship better give me some great stuff
i just need better weapons
i have 155 scrap where's my weapons
this music's great it's the ftl music i
hope it's not copyrighted no it can't be
you're allowed to stream video games
i feel like how does that beam cut
through my shield sometime
is there anything i can do
okay my guys are fully trained in
weapons and shields
the hall only has three points we'll get
it eventually
okay let's all right fine we'll time it
better
am i really just blowing all my missiles
on this go
all right there we go
and it missed
and it missed
their beam does two damage or my
shield's down by one it goes through i
say
i'm really sick again this is this is a
stupidest fight
i wasted all my missiles on this fight
i can't jump away now though
stupid stupid why'd i fire that
i'm getting frustrated i'm getting
frustrated boys
i'm just taking damage let's just jump
i'm not doing this fight anymore
we're in a nebula
rebel scout i should have fixed my shit
first
here's a missile
fix my doors
[Music]
my hole's low
fix my doors i told you to fix the doors
this guy is insubordinate
yeah the engineers beat me
hey but we look we got we got we got a
two-star general over here you know
all right
give me give me some fuel oh three fuel
suite
okay and we have a store all right now
we're talking boys should we go to the
nebula first
uh our haul's pretty low whatever
yolo
useless all right let's go to the store
let's go shopping
what
all right
breach and haul beam
how much shield does this go through
14 seconds to charge what do i have now
11 seconds 12 seconds
all right i think we're doing whole beam
can help him go through shields
how much shield can haul beam go through
i hate the missiles i'm not doing
missiles anymore
you don't think hall beam goes through
shield at all
so their shield has to be down
[Music]
so
we could sell the artemis and buy both
of these
oh that requires three power
we can't afford that
it's pretty powerful you can get their
shield though
yeah
should buy drone control
combat drones are so useless too
howard hogging was awesome until the
fight yeah i know the defense drone is
pretty good i agree but
what do we want to go here do we want to
go drones do we want to try to go whole
beam i don't really know how to use this
thing i'm not gonna get their shield
down i'll get their shield down enough
we'll target him with the laser all
right we're good we're good
uh let's buy that and we don't need more
power right now
let's throw that over there
uh take one from there go to there all
right great
we'll hit him with the laser and then
we'll hit him with uh this game is
called ftl
our hull is recharged we'll hit him with
the laser and then we'll hit him with
the uh
all right let's go there there now let's
go
who's in distress i'm coming i got a
brand new whole beam weapon
and i'm here to fuck you oh my god look
at these guys weapons those are legit
ass weapons
all right
so we have to wait we're gonna have to
take one volley from him
then we're gonna smack him with the
burst laser
oh well actually we don't need that
let's just do that
okay we got an incoming missile
our dodge is a 29 that's pretty good
all right let's hit him with the burst
laser and weapons
and then we'll smack him with the
hallmark
[Music]
okay i didn't time that the best
we have a breach here
uh i took a car of weapons to fix it
my timing left something to be desired
now we're out of oxygen in this room
okay weapons as soon as that fires it
takes the shield down we got to start
the haul beam
okay there's shields down
now
oh the whole beam is one that does like
extra damage to systemless rooms but i
just hit him there
uh
for fuel
i like the for fuel
no we get more if we don't let him
surrender
what is that that's still off but just a
heavy laser all right that doesn't
matter
oh put that back on o2
we don't even have a good dodge
percentage anyway because that room's
out of oxygen
let the whole beam charge
fire that
now as soon as their shield's down smack
with that and they die
great
love the whole beam boys
love the hull beam oh sweet
we got an ion bomb
oh now whole beam and ion bomb that's a
good combination
hmm
we're getting somewhere now
i need 50 for that
uh should i buy another power so i keep
my engines charged
yeah probably
all right
i'll go there there there and there i
want to actually make it to the quest
so let's go there and we'll come around
like that all right good moves boys
i love study
another store
what's for sale in the store
um
oh that's interesting
uh
oh this one comes with a free defense
drone man i wish i had more money i can
sell that for 19. that's worthless
i like those weapons
uh let's just fix the hole and buy some
fuel
i like to have 12 fuel i feel very good
with 12 fuel
all right so i won't be able to get my
ion bomb up until i
upgrade my weapons once more
uh can we make it down now yeah i think
so
it's gonna be close
let's try it worst case we have to fight
the rebels
we can fight the rebels right
uh
attack of course
all right what's that that looks like a
big scary missile
uh okay we don't want we want to charge
first
they sent they sent one guy
oh also i didn't have my guys all right
and they beamed into my first aid bay
okay
well this ship's run by morons
they can control where the teleporter
goes right why do they take it to a
stupid place
okay
hit with that thing
the whole beam is close enough to charge
fire the laser
okay their shields are down now smack
them with the whole view
all right good
[Music]
turn my guys back to systems actually
not yet no who's hurt not those guys
okay fine
um send them back to systems take that
offline bring that up
you gotta wait for the whole beam to
charge
all right i took
four damage
damn it
anytime that great i think i could have
done a little more
that miss will fuck you what mess
[Music]
oh the missile yeah i know don't worry
it's offline now
all right
laser
i was a little mistimed
uh no we can't surrender
your bitch
[Music]
atlantic and you guys got to go in the
first aid
you can help fix it too even though you
don't need first aid
oh are they using have we detected
tachyon emissions are there tachyon
emissions emanating from that temple
rift over there oh man it must be a
kaizon imperial cruiser
uh why don't we reconfigure the
deflector dash
and um emit a reverse
polaron bursts
what do you think
all right uh shit no i think i think
we're not gonna make it out here in time
all right well whatever we're gonna have
to jump back to the exit
all right we got asteroids
um hey i thought the zoltan were
friendly why are you why being a dick to
me man
maybe the dick to me i don't know what
that is that thing looks scary what
weapon is that
i don't know
all right um
[Music]
try to hit their weapons with the burst
laser it won't work
well definitely won't work if we missed
like that no reason to fire the whole
beam
it's an ion thing
[Music]
great great great the shields are down
oh i messed up as soon as their shields
were down i should have hit him with the
hull beam but i messed up
gotta time that better the time not
better boys that time better
all right i think we get a crew kill
maybe we get a crew kill
okay lasers are off
weapons down it's down
oh i think if you really want to do
damage to the whole beam you hit uh oh
yeah that'll do damage look at that that
looks solid
oh yeah see a ship
i love the whole beam
all right we're flying a bit chilling
the asteroids are we combat ready
are we combat ready gentlemen
we are let's go
[Music]
oh we're gonna have to fight the rebels
oh
i hate that
oh another one of these little shits
all right that looks like a serious
weapon
um i'll target the weapons
um
[Music]
actually
[Music]
i have an idea
i could do that
i only have five vessels never mind
i don't know if they're just gonna hit
us with this i don't know what to do
man
oh
three damage
prevent the fire
[Music]
they're gonna hit us with it again
probably could have prevented that
my dodge is at max right now please
dodge please dodge
great
i don't even know if we dodged that
missile i wasn't looking
[Music]
the whole beam is devastating
we took a lot of damage in that fight
that's upsetting
um should we buy
this enough to power the uh
yeah yeah we'll buy it
uh wait no that's not what i need to buy
i need to buy this is that worth it
let's uh let's see if we got a store
coming up
oh no we're jumping to the rebels yeah
yeah we definitely need that all right
all right good now we can power the ion
bombshell
okay we're gonna have to get oh we're
gonna get we're gonna take some hits
from the enemy ship battery boys
it's okay
uh
the rebels got here first okay they have
a laser and a weapon
my own bomb takes a long time to charge
okay they got a boarding party
um
the humans will send in three guys to
fight them it should be good
or we can seal the doors and suffocate
them
you recommend increasing my evade
yeah actually probably would have been
smarter
that's why i'm not good at this game
all right let's go fight those guys
okay
great
losing those fights
we gotta fix that
you go to doors i don't really need
sensors right now
shit the asb is coming online
i don't know what to do i let him wreck
the oxygen i don't really care
all right we have an ion beam we have an
ion bomb i don't know why i bought that
i don't even know what to do with that
we could take their shields out or we
can take their weapons out we'll take
their weapons out
oh i dodged
i think i dodged the asb okay that's
really good
um okay i don't know about these guys
let's send in fresh blood to fight them
let's send these guys to the first day
at bay let's power the first a bay
[Music]
all right we got a battery coming
oh we got hit by the asb
and now the ftl drives offline shit i
forgot we needed to charge the ftl drive
oh we're dead we're dead this killed us
all right
oh the good news is it killed their guys
too
oh they killed their own guys
all right you stupid fucking rebels
[Music]
[Music]
oh the asb is coming back
all right we're charging the ftl
i don't think we can do anything faster
fix the oxygen
oh they have more boarding party
oh now we have no oxygen
that's fine they'll follow me
all right we have a whole lot more than
they do
uh
okay so let's get out of here phew we
got ftl
let's go angie homeworlds
all right you know hey any fight you
make it out of any fight you make it out
of right
anyone you walk away from
oh shit
all right anyone you walk away from
voice anyone you walk away from
the fight with the rebels
oh all right you got to get healed too
you guys are good
oh matt
matt you gotta get healed bro
matt what are you doing at the doors you
gotta get healed
all right i'm glad everyone stood by the
engine and like chanted they were like
engine engine engine
uh i don't know why i bought this ion
bomb that was pretty stupid
i don't know we'll need the weapon
upgrade anyway we don't have enough
scrap for any dodge upgrades
dodge upgrade would be nice which way do
we want to go here's the exit over there
did we do the quest i forget if we did
the quest after all that
oh remember when i played league
oh i was really bad at league
uh
hold on
oh that's a lot of weapons
[Music]
and they hacked us
we only have one shield oh no
oh no we might not walk away from this
one boys
and they have a defense drone
[Music]
oh good thing i bought that extra
weapons
okay
i missed okay you're sure that can't go
through
you sure my thing can't go through any
uh
oh no my whole beam's offline
you get in there fix the whole beam
shit
all right guys
guys i don't think we're gonna live
i think this is it
i think it was good while it lasted
i think this is it
our sensors are offline i can't see
that's not going to get to pass their
drone okay
okay our only hope is an ion bomb
let's fire the burst laser
let's get the missiles back up no no oh
it's a is it a teleporting bomb oh
okay i should have done that sooner
oh it's locked because of that
okay we have to get the ion bomb online
we can also get the whole beam online we
won't even need it
our oxygen's on fire but that's not a
priority right now
actually if it's on fire we should vent
it
okay our sensors came back up
okay our sensors are down again two more
hull damage
i think i think it's been nice knowing
you all
hit him with the hull beam hit him with
the whole beam now
the hole is critical
the hull is critical
[Music]
my ftl drive
get out of here
no
oh
the engi boys the angie
one six six six
one six six six
all right all right um it's been nice
playing video games
uh thank you all for watching
uh that's tonight's stream
we're just gonna have one go at ftl
uh you let me know your youtube comments
if you like this content uh if you like
it i'll make more of it
um if you don't like it i might still
make more of it
please stream more programming bro we're
gamers now
we're mediocre video game players
what's brogue ce
we don't assume a good game with
graphics no you don't understand i can't
even watch those games anymore
to watch me play league
have a look have you solved from the
transistor
let's let's loose some of this volume
have you solved from the transistor
no
no
what's in the hanger
oh
have i played minesweeper
all right let's go let's sweep some
mines real fast
oh no i closed i closed the wrong thing
i closed uh
i closed twitch chat i didn't mean to
close you
uh all right
this is too big
all right so that one's definitely a
mine
this one has three mines around it so
those are probably mines this one's got
to be a mine
um this one's got to be a mine because
that's the only way that could be next
to it but if that one's a mine then that
means this one's safe
it means this one has to be safe
too
because there's already one mine next to
that in fact
all of these are safe
and that one's safe because there's
already one mine next to it okay
so
this one's got to be safe because
there's already one right next to that
one
this one i don't know about the mine
could be there or it could be there we
don't know that one has to be a mine
because that's the only way that one can
be next to it so then these three are
safe right because that one has one and
it's next to them
um this one has to be safe because it's
one and it's next to that
same as
this one everything around that one
all right good we opened up a big
section
okay this one has to be a mine but then
this one's already next to two
so that's safe this one's already next
to two as well so actually all of these
ones are in here safe because there's
one
um this one's got to be a mine but then
this one's already next to two so that
one's safe that one is safe and that
means these two are safe okay we're good
that one's a mine obviously
that one's got to be in mine
uh
if you click the number and you have all
the necessary flags it will auto delete
the save blocks
so if i click here
no that doesn't work
what kind of fancy minesweeper are you
playing because this one's safe
wait is this one safe yeah it's next to
that one
and this one has to be a mine
for that one to be next to three these
both have to be mines right because
that's the only way so this one's
already next to one so that one's safe
that one's already next to one so those
two are safe that one's already next to
two so that's safe that one's already
next to three so these three are safe
this one's already next to one so that
one's safe
this one's gotta be a mine
so it's gotta be a mine
uh
this one's safe
so i'm going to make any mistakes is
anyone making mistakes labeling mines
these two have to be safe
uh all right
so where are we at now that one's gotta
be a mine
ask for streaming
okay we're playing minesweeper you know
mine
sweeper we already lost at ftl
these two have to be mines
and then everything around that one's
safe because the only way that one can
be three right
everything around this two is safe
because it's already next to two mines
that one's already next to three so
that's safe
ah that one's already next to two so
that's safe
this one the only way this one could be
next to two is if that's a mine right
because those two adjacent are mines and
that one's already next to one that
means so it means those two are safe
um
this one is not next to two but this one
is so that one's safe
wow boys wow wow you're starting to get
it i don't know should we should we quit
while we're ahead
should we just quit mine sweeping be
like we're ahead and quit
i think we could do that
ah what is this this is this minesweeper
iq test
all right this one for this one to be
next to two that one has to be a mine
and then that one's safe
uh with time you get really fast and you
won't need to put flags wow
wow that's some
can we have popcorn yeah let's make some
and
yeah we can make popcorn and watch alone
that sounds that sounds lovely alex
oh so this one's safe
you want to come play minesweeper let me
know which ones are mines i think we're
out of things to pick
i think we're done
we gotta guess wait what you don't have
to guess in minesweepers sometimes you
do really i don't know i'm not a
minesweeper expert no you're the twos
this one's a two so this one's safe yeah
whoa whoa not all the small things see
the two in the middle i know all the
things are going around yeah these ones
are good here you're saying yeah yeah
all right all right look whoa fours
okay the top one there so you're nailing
it you're healed yeah all right don't
worry this one's already near four we're
good
oh should we have a competition where
you and i might sleep at the same time i
think you might be way better at
minesweeper than me alex but the
question is how are you at
on ftl i think you beat me in a few
games but i think old man and ftl all
right for this one to be next to four
those both have to be mines all right
because it's the only way
that's the only one
yeah they love minesweeper
this one's got to be in mine right
because that's going to touch whoever
picked mine
that's next two right so i'm not messing
up here this one's already next to three
that means all right those were risky
that one's already next to three that's
fine that one's already next to one so
all those are safe
wow that was ballsy that one's already
next to one so that's safe whoa we just
blew we just blew this whole thing wide
open
what do you mean we knocked out the wall
and we put in an open kitchen it's an
open concept you know i'm gonna make
this open concept oh my aura borah yeah
yeah it didn't help me play ftl
wow 263 people are watching me play
minesweeper right now
do you want to play
you can play but do not mess up my
minesweeper
alex 255 people are watching wait i'm
gonna play them they're really in a
great shape right now
um how do i use this thing
right click to make a flag and you click
to expand
wow you're doing this so fast
don't mess up
don't mess up
no pressure
oh my god don't mess up
don't mess up
[Music]
[Laughter]
[Applause]
she's speed running it all right all
right all right are you guys ready to
play in yolo mode do you think this
one's a mine
no it was a two
all right bro
let's try again
big brain alex what do you think this
one is
you think it's a mine
oh it's a mine oh we're done
we're done we're done ah
oh well we just started guessing
we just started guessing
no this reminds me of the time that i
bought the bed into the uh
into the ender dragon thing
and went to sleep if you try to sleep in
minecraft in the nether you die
and i did that on my stream and all the
people in the streams were like no
george don't do that you die and i died
all right thank you all for watching
enjoy the rest of your evening go play
video games hug your loved ones uh and
you know how i like to end my streams
don't kill anybody all right we're good
all right see you later
see you later see you later
but uh
I love whom I stream
it's three tokens for kiss and five
tokens sir nipple flash and whatever
else the girls on my freak am saying
those things definitely if I had
balloons imma pop them but I don't I
play League of Legends bros oh you know
what I was doing tonight though new
Eminem malval is good if you haven't
listened to it yet kamikaze particularly
in the third song I was uh I was
impressed I hated the last one
yeah just lying in bed listening to
Eminem and I was like I'm gonna play
some League Legends and then I was like
but I can't talk to myself when I play
League of Legends and then I was like
that's why I have twitch
all right I'm always misfortune
misfortunes great because she says to
make it rain button 17 people that's
good
brought to you by Lacroix ah delicious
hey let's play all right I'm not gonna
buy guardian angel this time we're only
gonna buy offensive stuff I think well
no maybe boots maybe defense I don't
know there's probably like tutorials on
this online like Google how to be good
at League of Legends
this game also takes forever to load
because Xin Zhao has a crappy computer
good thing he's nothing on their team
yeah guys US isn't cool more we wait I
control my light switch my lights for my
phone look at that
maybe it'll work
okay this usually works oh there we go
look I can tell my lights for my phone
you might think this is meaningless but
my bed is over there and my light
switches over there I used to have to
get up and it was actually one of the
biggest problems in my life now I'm not
really sure what that says about my life
but we can dim a little bit - yeah
that's a lovely ambience nothing's a
waste of time you guys life is
meaningless bullshit I can double click
you know wait what's a waste of time
time is a waste of time but but if my
champion will continue attacking after
only a single click how am I gonna get
my APM up
no-one's going man I'm going men let's
go men
like this guy's going mid there's always
action amid
okay you guys always complain about the
sound I don't believe you
wait is there actually no sound oh shit
no sound sound sound sound sound no
sound stop it
Oh like other guys snipe my goals
okyou is guy
oh my gotta kill that aunty kill that
aunty oh no no no no shit
oh that was just dumb that was just dumb
I'm sorry I suck well at least if at our
kills me nobody actually gets any gold
so it's fine except this is valuable
experience I could be learning earning
earning whatever Annie had to go home
anyway
oh why I'm calling her Annie is her name
Annie
oh yeah knees back
no no no no no no never got another no
run no nun this guy
I'm so bad at this game
can I buy anything yet boo boots okay
this is a real problem they're too good
well you know what maybe I should stay
close to my tower
Oh Annie I'm gonna kill you
but that's my experience I understand
focus on the last hitting of minions
when their health is low okay I
understand I'm gonna I'm gonna hang out
in the bushes and ambush
well how is this guy so good
bullshit
this guy's hack it is he oh okay focus
on last hitting minions okay I
understand you guys give me such good
League of Legends hips
I can't have help how do I gonna kill
him we were close to the same level oh
look at that last hit that was the best
last night I did all game
yeah ya know about our power
whoo
this guy's good now you do have my our
power see this guy's cheated
look at him cheap he's too good
how is he doing that where was she level
18 when I needed help
Oh Annie's back I killed Annie once
no no no no no help me help me help me
oh he ran away whoa whoa what's that
we got anything for killing there okay I
got it make sure to use my affability
don't forget DNA okay so Diaz exhausts I
should use that
do I have to target them to do that
don't think health potions are very good
buy this guy's too good though I don't
know how to fight him
my minions are stealing the last Tetz
gods Annie I can take a knee
oh yeah skill bro
okay that guy's too good that guy's too
good um that looks pretty good
I don't know how we're gonna kill him I
kill any and that guy kills me
Oh Annie's back I can kill her perfect
love killing Annie it's a hobby
No
ah just blade and usin this ghost play
can i buy those things money
I'm not buying guardian angel again well
that one looks pretty good I wish I had
money
my team has destroyed the first time
these people are too good my book he's
killing our turret turret can you attack
him you killed our turret like I'm here
killing minions let's go kill the dragon
this guy's worse than me
Xander love killing man
oh yeah bro
no-no-no
like I don't know what I can do that guy
shows up and he's too strong and he just
kills me I don't have a choice
oh I can buy a serrated Dirk perfect
should not be buying these cheap items
what do they upgrade I don't know how
items work on this game
that guy's a new if I could kill him
okay what do I have to do keep an eye
out should I cast wards
so kill that guy
I know it's an an easy to kill Oh
die die die all right
you should sell your Dorian sword in
that hammer both my door and swords and
focus on getting which one duskblade oh
this one forgot that okay I got that now
I have to get you some as ghostblade
where is this this one okay I'll come
back when I have 2900 goals perfect you
are bro
I liked your good bro you know how to
help me out who's that guy can we kill
him oh yeah George uh-oh they're coming
for an attack oh they're here
that was a waste a nest
okay so I got a I got a get a twenty
nine hundred gold if I go jungle I don't
know what that means but I've heard
people say it on streams they say
they're gonna go jungle
well that was good while it lasted ah
I use Daffy I guess I could have tried
to use D on them hey kid double-team
okay bro I'm coming to help you out
coming to help you out
it's just not fair
going jungle is in the outskirts so that
I think we lost this game sick
oh okay they're doing okay this guy
needs to be killed but what if I show up
here he'll just kill me like it's not
fair all right let's go jungle I know I
can jungle this one so how do i market
to my allies
can I kill that
boom I juggled jungle over here
yeah we can my tower helped me there you
go
oh they just have one person who's good
minions attacking my tower sucks
don't even get any of that gold
try Junko more I feel like I didn't get
more XP from jungling that I different
just killing minions
they're in our base why don't we go
Kelvin
okay ready for the hardest fight of my
life useless
useless what's up you should be going
bottom lane but for this game just wrong
they kill him at least yell surrender
sure
you know what No Surrender
I changed my vote if I get more gold I
can buy that other thing if I just
jungle a little bit more
that was not a good use of my our
ability was it
all right let's all stick together these
minions yeah all right look at this
teamwork now
they're in our base you guys
oh these guys are noobs I can kill him
never mind they were nukes yeah use it
for the audience
they won't dead we win
33 verse 28 yeah oh I have gold now what
should I buy
I still can't afford a ghost blade I
need 500 gold
okay I need 50 more goals
my iron gold just by living this is nice
they're killing our inhibitor again now
okay but now I'm about to have a goal
and blade or whatever it is yeah I go
around blade I'm unstoppable now
okay well that lasted ten seconds
guys one of these days I'm gonna win a
league of legend name one of these days
I will win a league of legends game
one of these days no you all sucked Oh
but now I've leveled up alright let's
try it one more game let's let's keep
going
this game is addictive one day I'll be
good at it watch this vid you will laugh
only two minutes is this appropriate for
my channel my family-friendly channel
we're family-friendly here
this is long the paupers ksi
I don't know man Oh confused I'm not
much about Mike Tyson but doesn't me by
Holyfield's ear off that's all I really
know about him what if you can play
League of Legends sure you play for a
night instead I'm worse if you could
believe it I'm actually worse at 4:00 at
night than I have at League of Legends
yeah I know kid kitty pryde is lovely
Soundcloud I knew Tom Cruise a better
debt
a fortnight oh yeah except God
ah
okay so now wait wait you told me what
items I had to buy and save my money for
those items you should
so okay
focus on last enemy vengeance
and I gotta buy duskblade and ghostblade
or double blade okay
wait whatever my match
do they not find other players to match
with or as bad as me all we misfortunes
yes
you don't need to save your money so
what you need to do is click on the item
you wanna purchase and Percy item to
build the end my day thoughtful tomorrow
okay
okey one you are super bro thank you for
priming and wait um star Guardian this
oh no how does he get to be star
Guardian misfortune doesn't much sexier
looking misfortune does that cost real
money
I mean that cost real money it's almost
worth it
super for now he's super brokers he
gives me good legal legends tips unlike
you new Tom Cruise who quote my rap
lyrics he always make your aim should I
should so I should buy the door hands
blades let's see what this is what say
you moves goes played made-up long sword
and serrated Dirk okay I say duskblade
okay so maybe I shouldn't buy any door
hands blades should I not I don't even
know do I buy Dorian's blades or no
what do I save my gold and you think I
should go bot go bot
make sure you guys get Oracle ends for
chemo shrooms you got shoes bro alright
we'll go back wait but there's someone
else here kill him oh he hit me oh look
there's someone hiding there
Oh bro I think we should retreat growl
good retreat bro
putting game
all you need to do that
say go home I should go
sorry bro it wasn't good enough buy
potions ok potions are a waste of money
I'm still level one
[Applause]
oh yeah of course we get killed first
hey all the minions keep stealing the
kills
oh shit
that guy's just staying in the woods
taking potshots at you cheater
like I hate that
he's in here isn't it
when you ran away come on bitch I like
this guy's teammate though he's proud
tree for our retreat
you're going home you're going home like
bitch
nevermind your good teammate I'm sorry
no no no no no run okay I'll go home
like bitch tail
okay so now I want to buy duskblade and
ghostblade
so I buy longsword should I wait for
gold maybe I'll wait for gold is that a
good move
wait and I thought if I just have those
oh I say I understand but that okay so
that just adds a way that make sense
I'm coming ba bro get boots first okay
well I wish I knew that buy boots sorry
yeah
don't worry I shall avenge you yeah oh
is that something good
I got so much gold gnashed I go home get
boots don't get boots
shop boots of speed
Caulfield warhammer love it
I'm feeling good about this game oh they
already level seven
oh come and help you bro
want my are abilities
alright alright alright wizard guy sucks
bro bro bro bro bro bro you're
overextending bro you're gonna die
none of them running they're running
they're running you got him you got him
got him
yeah no no no yeah oh look at that use
of f Oh brawl with that skill of what
if I didn't hit that F at just the right
moment is this one good should I get
this or should I buy more of those
things I like DOS we'll buy them bro f
save me bro whoever told me about f your
bro I'll get that oh man I'm killing it
oh it's just wizard new began my now to
kill wizard noob
Oh Mykel there's no good people in this
game just wizard new and I even have my
R he won't even know what hit him
there's no shit about our
okay okay okay okay okay okay oh I don't
have to go home again
maybe I'll kill minion first cats go
home
they're taking my tower down get a
minions I don't find zero day anymore I
am legal legends and the simple player
of the League of Legends
no oh I thought I had them avenge me
brother turn around and kill wizard oh
you're new did you shot one of them down
at least
I want sexy misfortune like the other
guy had I'll pay money for it
I'll pay real money don't worry I have
real money
SiC micro brow
fuck you wizard
[Applause]
kill wizard new
I don't want the lowest-level guy in the
game now
you're going home
he's going by
yes
almost level mine
yeah I'm 18 bro oh you're cool so you
know things about League of Legends best
route to take to learn to code you just
got to do it
there's not really a route like you just
got to pick a project and you just got
to do that project right like pick
something you're interested in so you'll
stay motivated and then just work on it
and like not every part of it's gonna be
motivating but you know that's why you
got to pick something you're interested
in
do you have an F back yet oh I gotta go
home again
Nikhil our Tower two against one
don't blame me
let's go kill them how do i signal to my
enemy friends that we're gonna go Titus
but showed up yeah I love that
uh don't worry so much about language
really just work on a project but decide
what you want to exist and then work on
making it exists yeah I wish we could
have done this before they knocked our
tower down
that was great
who should we live Shu Kaggle that might
be funny no I think tag is just stupid
now
I like you can buy things
[Applause]
I moved out of my house when I was 8 no
I don't know about Kaggle like to this
merit I haven't done in a while I
remember looking at it it was just
people making these like absurd and
samba models that didn't correspond to
anything reality
I didn't like that those guys yeah
are we winning
they're all there no it's a wizard bro
where's it brother over there I'm coming
to back you up bro just hang around
I'm coming we'll go kill wizard bro
together
[Music]
this is not a good strategy no okay okay
all right I've learned something you
can't keep running when they get to the
turret
-
I was six sided to kill Oh where's the
girl you got killed by wizard bro who's
a buzz little bitch though
my wizard burgers leveled off was it
brought won't see me coming now I just
look like a minion
you push and keep pushing
what a waste of your attack
wait what how I get killed
use happen everywhere okay I didn't I
didn't agree with that decision I just
want to point that out I didn't agree
with that I know what the game did but I
didn't agree with the game's decision I
don't think it was correct I should have
died there
rush mag
you can wizard Bob I'm coming to help
you kill things
I'm getting out of there
that looks like a way to die
[Music]
yeah got him love this game
I got out of there just in time
so I turn around a fight what do I do
well you know I don't want more of those
crap
that's what I want
now I have everything you told me to buy
do it buy anything else
Oh
uh-oh this isn't sounding good wait we
have 40 is that us and we have 40 kills
they're crashing that damn viga I don't
know what a vigorous the sounds vaguely
racist music that's a little minion
fight going on here
that's cute look at little minions
fighting each other
go minions go I freaked away for you
got the turrets bro we get gold for that
no run away run away run away I don't
think I can take
come here tightest spots I need your
help
hi this butts why do you run away just
what I needed you you were my only hope
when is that okay you know what I'm just
gonna kill her
Oh
Titus butts is here love Titus but she's
bro hey what
dad dad no I'm not ordering food not
hungry
that's a ton of food tonight it's kind
of gross
how do you know what to buy anymore
this looks pretty good yeah perfect
oh we're gonna win this game I think oh
yeah we got
we got him bros we got him tightest
butts I wish you could have saved me all
right there's only a 12 I think I can
beat him let's go let's kill the dragon
love killing the dragon I'm in
I did something I'm helping
but they'll go
right away
I love dog look at that attack
oh I can recall superfast cuz I have
dragon power
C well I can run fast cuz I have dragon
power
oh this is great
look at all these minions why is all
these minions here it's gonna be so
crunchy
just one shot all those minions
oh yeah
oh I feel so nice to win a game yeah all
right Oh
Titus butts you are the number one bro
all right one more game what we're game
though gonna sleep hey Pope is go big
game yo you outside let's play my
brother's League game but we're gonna
have to play later we're gonna play
normal game now let's go
[Music]
no it's not Alex Roy it's a co-worker
oh if I teach your friends we in a bot
game in a part of bot down well I could
get any I could get perma Annie I think
I make money for streaming on Twitch I'm
not really sure how I was thinking about
writing music actually the Eminem album
is pretty inspiring always misfortune
it's just this is aspiring music
it's true
those that do a leap I don't know all
right
[Music]
sixteen-year-old bro
did I play last game better I think I've
did my loadouts better my items I gotta
buy boot stuff I know that one now
always buy boots
[Music]
you can just chat with your fans and can
make more money on touch I love making
money guys you know I love money what
life and mice you know life advice
I want League of Legends advice this one
I want I listen to you if you even if
you guys telling these stupid things on
listen hey could one of you guys Google
how to win at League of Legends and tell
me what it says
but it's damn stupid though this is
falling like
well she runs so fast but GoBot
don't Bob Bruce don't anybody else to go
back so I'm gonna buy I'm solo bye
tonight attacked our bro row let's kill
him bro so I use my health potion
already minions yep let's go home
kill him kill him kill him
yeah die oh you guys are new
why do I have a thing on my head Oh
stupid and buy things anyway
don't
uh-oh your triple box oh my god what is
this
you're gonna take down our tower
Holloway alert beep oh here
oh my god you came in and slayed them
all
you are number one okay now I liked
being solo BOTS go away oh you are great
friend you listen to me
you want to go your level shit and I'm
level awesome wait how do I get Kemp
there were two of them
cheaters oh wait I got a kilt
I
yeah
you're gonna die
no cheaters they lured me
goes play by that one I want to buy dusk
play that I don't have any more money
I wait for money yeah we can wait here
five four three two one five long so
let's go
you know diver
I'm gonna get last kill
[Music]
-
the highest level on the team oh yeah
kill
Oh
most better
I can't experience in this
that was their alternate
don't find me don't find me don't find
me don't find me don't find me don't
find me don't find me no I pressed half
it didn't help
I can't afford a duskblade of dark beer
unless I sell my boots is know by that
10 by berserker's greaves though
should I buy bass or should I wait for
that or should I buy that
damage attack speed mmm oh it's worth it
I'm alive again I gotta go
there's such low level
I will pone these noobs no we will we
will sell come by we will buy League of
Legends games
boom unstoppable
legendary
it seems like where I'm needed well it's
good here until these minions
easy
alright alright I know by that and by
that oh yeah oh now I'm unstoppable
what else should I buy
like dagger dagger sounds good
oh yeah thanks team I don't know what
that means but you're all bros love you
all
nice gross oh right that was really dumb
oops I didn't mean to do that we gotta
go we gotta go we gotta go get out of
here
so it's cool let's get that love moving
fast and breaking this guy Oh running
from them cuz they scared um such high
level I ain't scared of shit
oh he's too good
oh nice sorry I couldn't help you bros
if TR runs coding training sessions of
twitch oh yeah yeah we'll take your new
coding training after this but you all
gotta give me money pay money first
money first and then we'll do coding
trainings if you guys manage to give me
$10 before I'm done with this game of
League of Legends
we'll do some coding training after this
with the 45 minutes of Tony trainer but
only is joke
there's others that mean let's go kill
you guys give me no no no no you guys
give me money where's my money
ooh rapid firecannon love that are you
doing kills miss Jets oh we don't we're
slaying and I'm still winning I'm the
most valuable player on our team
I'm a beast so that I die I only died
cuz I play stupid overextend myself into
useless battles nice
well how fast she runs let's go miss
fortune they're all that minion gold
that could be yours
why are you guys going that way
oh that was so cheap he chained up for
us but we were killing the bird no no no
I'll do training right now but you gotta
give me ten dollars
oh the gang you're not fond of they have
high-level people and I'm the high level
person on our team and I don't know how
to play this game
we were just killing the bird and you
had to come mess with our bird
killing time by your level Tanima crush
Neal talk away from white power
that's right that hey oh hey what was
that
really am sick of the account
oh that's right but you kill them all
oh yeah gotta get him gather get up
that's right
give the last one kill the last one
golde again but what i can buy
oh and I got my special charge back up
I really am sick of dying
well be there in a minute I'll be there
in a minute
yeah this high-level
you're buying
I'll be seeing doc
see you on our team Wow I think so sweet
let's go take out their towers no no you
pay me money first and then we do
training but only tonight hey any money
$10 now and we'll do coding after this
otherwise we'll just play League of
Legends all night all right love it this
is the most popular my League of Legends
channel has ever been don't even think
about it
how are you killed yeah I woulda guessed
pyroclasm
we are all dead
oh we're all dead well they killed us
all
what can i buy
Oh self dorans blade why would I want
that
more Dominic's regards that looks cool
alright let's go kill them we are the
rightful owners of this plot of land I
you have addressed us for the last time
red team you stand for everything that
our values are not and today rock dude
69 is taking a stand for years of photo
right away is so many guys now run away
there's too many is too many with too
many run oh and you killed me up yup
that was great yeah no those dumped yeah
alright well oh well we tried I love all
of you 32 streamers you're all during my
favourite you're my favorite you're my
favorite we're gonna win this game of
League for you guys kill them kill them
please teammates go after don't know oh
yeah double kill that's right oh that's
right that's why you don't mess with
blue we killed them all but as that us
no we're good
oh yes we're back alright I'm here to
help you out let's go
all rush by for win
let's go let's go all but now
I am your leader I am Miss Fortune and I
will not guide you all
ah that was intense
okay what can I get rid of oh oh if I
get rid of health potion can I buy other
things you're curious mere
[Music]
I don't even know how to use how potions
are useless I'll look there in our base
life life life life life life life life
life life I'm gonna unleash my our
attack on them they'll never know what I
spit what came
yes that's our attack
oh well that was close that was close
yeah we best be rushed med
that's right with my mercurial schmear
oh yeah oh thank you you gave me wait
that's not $10 is that $10 all right
we'll just some we'll do some
programming after this all right let's
do some programming after we kill this
noob that's right
shit bro he got yet he got shit I don't
know how to fight him ah we're gonna
code after this freeform coding and
there might be some weed smoking after a
coating coating coating only cuz no
we've soggy for League of Legends gotta
focus when you're playing League of
Legends this is a hard game I have to
wait 30 more seconds this is bullshit I
don't even get to use my mercurial
schmear wait how come
is there no level beyond a team is that
max level that's bullshit well they
destroyed our inhibitor that's why they
get Superman
okay
well look at this little minion pile up
all right so long I've bought time die
at least I killed him oh wait we're
gonna loose we're gonna lose
we're seriously gonna lose about now the
minions are here we just lost this game
Oh No
bro you are only home Oh Mike Wow
well you are champ Wow
okay I'm gonna kill all these minions
with one super hot fire
I'm going on guys I'm going home don't
worry I'll be there soon
all right I'll told them
got'em bras all right let's go man let's
come in
whoo thousand chance
well look at that horde of minions I'm
gonna go take him out taking out that
horde guys who is never gonna see what
came
how many guys are coming
we got him
shit
this is this is close like I don't know
who wins this I've never seen a legal
legends game go on like this I don't
know what happens I'm gonna sell that I
buy that
should I get rid of my boots what is
this step
you know what happens
and I couldn't I'm not sure out of
position or daddy daddy
I share a tree
Jiji folks all those close to him
alright alright so that's $10 so we're
gonna do some program oh my god it's
late
that game was close though
yeah I'm sure one exit League legends
all right all right so we're gonna
program call it learning what do we want
- okay guys who paid for a programming
tutorial let's go do programming in PHP
we'll have PHP what have PHP mmm a dot
PHP what's a dollar sign a equals a echo
dollar sign a we're doing is syntax
highlighting for PHP don't let that PHP
a dot PHP you know I'm gonna do the PHP
for ya okay all right so notice how it
prints out the word I of course not
followed by a new line because PHP is
bad for anyone I'm gonna print this in
for the new line so we'll just Becker
slash at or that should be a new one
okay cool so now we right now you have
some PHP let's have some fun with PHP
right so we could just do like for
dollar sign a equals a dollar sign a
less than Z cosine a plus plus and then
we can like her echo a echo and write
please we'll just print out the letters
from A to Z right yeah okay so oh wait
no hang on I messed up I forgot about 0
where Z where Z oh I gotta do less than
or equal to Z right I let's go oh wait
why did it print all the way to Y Z PHP
makes no sense let's do that again in
slow motion for those of you who didn't
see okay
so very simple PHP program you can see
here I just iterate the letters a
the FNLA I print out a new line to a PHP
program okay ABCD efg hy g KY z KY okay
perfect now if I change this to a less
than or equal to we get Y Z I don't know
man PHP makes no sense okay so now that
we've all learned how to program in PHP
I hope you enjoyed you toriel a tutorial
and now it's my bedtime now I wouldn't
do that to you guys I promised you a
coding tutorial let me see if those bits
how much money art which bits worth
because guys I do love money we should
change the game we're playing though
we're playing programming I don't want
to get banned from twitch alright
perfect
how much which bits worth
this is very confusing this looks like
Amazon this looks like AWS know I hate
guardian angel never buy guardian angel
you should have seen me last night
okay guys what is no one talking
PHP game
you guys wanted me I did PHP game you
like PHP game PHP a dot PHP now what
should we Co you listen you learn okay
all right what should we code let's go
add some Python I want you be coded by
thought oh I know what I was playing
with you wanna flirt with formulas for
Gaussian poreless for gas run so now let
me know much about gaussians but we can
look at pictures of gas it's like a
Gaussian beautiful calcium's this
Gaussian is bigger than this Gaussian
but you guys know that all Gaussian
should be equal so we should multiply
that 1 by 2 because these are communist
gases let's look at them oh look at
Communist gaussians are the same right
now
yay all right now that's stupid because
now it's not a Gaussian anymore and we
have to have definition because this is
a nation of laws all right Python ah you
didn't like PHP ok fine all right um
Python object detection in 30 minutes
what object you want to detect what's
the object you'll loan that online
perfect we need Yolo net online webcam
demo Yolo life perfect
looks hard
you just want to download Yolo I mean
that's how I would do a legit detection
we can watch the Yolo video these people
know how to market check
[Music]
I think so yeah oh so let me get in this
so I can wait hang on
wait I'm trying to alt-tab away from
this so I can mute my oh I'm dying
oh you pseudo killed me oh hang on
no I fullscreen dat before and then I
couldn't switch away all right well my
name is rock dude 69 I so let's go
fullscreen okay yeah yeah
is that gonna work I don't know that
doesn't work at all
wait we're gonna set the resolution
right okay I do know about computers I
may not know about legal legends but the
other alternative was live streaming
trying to get tensorflow GPU to compile
so oh yeah I look I'm beating them
beating them up yeah look at that I got
his gold yeah that's right
this right box take that oh no if they
have a turret how'd they build that oh
yeah yeah yeah beat up the turret yeah
oh yeah die now let's attack the enemy
crystal shit yeah crystal shit wait
just try to put my streamer headphones
on - oh no I can't go there can't go
there I'm dying alright alpha-strike
is this good oh yeah wait let's
alpha-strike the turret can I do that no
no no
oh yeah meditate yeah was that good oh
now I can use our yeah I beat the turret
up
oh yeah I win get come along greeter
working on stream bro all right yeah
she's pretty
look but like at a chair I got a gaming
chair how can I be bad at gaming
you know what I found out all these
games they don't even you can't even pay
more money to win you can only buy skins
I was amazed when I found this out
learning a basic ability Oh make it rain
yeah it's gonna be a hot key for that oh
I'm always mid always mid yeah
I played this game I favor played one
game of this before
earn experience but I can't go there
can I kill snipe from my minions and
gain experience that way
oh the enemy hero oh yeah yeah take that
Annie
wait so how do i I don't have to click
there
do I have to click
yeah see how I lured them away from the
turret I'm so good at this game my
minions will tank for me
I know I know terms structures are
immune to most spells okay
well that's good to know these up
I like make it rain oh yeah make it rain
better yeah perfect
oh yeah yeah kill the hero kill Annie
kill Annie the turrets targeting me oh
yeah get her all right I want to heal
perfect me lovely oh my bad friend help
me out what a pro did I do that
Oh buy items oh good point do I have to
go back here can I just click Harold we
have to go back to the start to buy
items oh no it's not what I wanted yo
should we hack legal legends instead
they want me to hack legal legends
instead of my twitchy's cuz I'm not very
good at it it was the shop is this the
shop I see you orb oh the furry thing oh
sweet
what do I want AB dagger that sounds
good buy more dagger bye that probably
wasn't a good buy zeal oh that's bye
Plus
craft epic items oh I understand
I don't I lied let's go mid always MIT
can I hold control to run oh press B to
come back to base
Oh recall yeah no I know this I've seen
that in streams before oh yeah die
that's right yeah that's right that's
right rock dude 69 always better make it
rain I love this game
this is the best cuz they she make rain
unlock the camera press why wait my
letters daughter I don't have keyboards
own letters on my keyboard I don't think
that works for me I tried that button
yeah Annie you didn't buy items did you
someone stole my kill it's best so that
looks pretty cool
come on your home be I feel it a still
but now I got an XY why does that do
this unable to purchase
who's attacking my target down here
always MIT because you can just buy one
boot I understand I understand I'm just
gonna get a lot of them
oh yeah wait these are just BOTS I'm not
even playing a real game I shouldn't
feel good about myself
wait let's just end this what am i doing
let's kill them all right bye turret
alright let's rush their Nexus let's go
no no it's not good I think maybe oh
straw all yeah I can't make it rain on
the structure it doesn't work yes my
first bot game why do I have to play
more oh but I'm already so good what if
I just win this one
that's right killing spree I'm a great
League Legends player alright alright I
understand the towers heart die
oh yeah wait this crystal thing he
doesn't even attack back today we had a
crystal thinking to accept our crystal
thing he wasn't blown up all we get
super minions
I've watched League of Legends streams
before
I'm really good this game guys oh no no
no I'm really bad a fortnight oh I could
try to play fortnight but I'm really bad
but like it's not even funny I just lose
victory Oh 5v5 blind tech okay how do my
friend you complete all tutorial games
oh I have to do this one too I bought
items from the store last game yeah I
know yeah some guy on Twitch told me I
had to buy items alright let's just win
really fast I'm now good at this game so
I can win really fast nope no way I'm
rock dude 69 other people take a deal
hot on stuff yeah all the time
wait no what happened to make it rain I
like to make it rain
no I used to have different abilities
why did my abilities change there's a
new champion
I don't like I picked our though but I
like the other one better why didn't
nobody tell me this oh thank you I
wasn't even asking for a Dorito oh I
didn't know you were gesturing I was
talking about the complexity of my oh
she does backflips
I picked her cuz she looked pretty now
do they all do hmm
alright the by item I want McNuggets No
oh yeah I'll buy one of those wait I
spent all my money on a book wait you
subscribe for three months nano danger 7
thank you so much I love when they
subscribe you don't understand how I
made $135 streaming on twitch wait all
right so I got I bought a book is that
good
wait why did I pick a complicated
champion
Oh deal the killing blow to 12 minions
all that sounds easy
she's terrible his woman's terrible oh
my god that's what they all say
boo charming I'll be charming oh that
was good
oh I see it makes those fireballs Oh
control Q I see Thank You max Q okay you
guys think I should vote for Q we'll ask
them twitch max you wait is Q actually
good how do you know all the champions
why did I pick a gobbler get a champion
you should send George don't pick that
one it's complicated they do I had a
choice of five champions and I picked
wrong I don't have any cute
how many minions have I delivered the
killing blow to control queue oh yeah I
have Q now I think I missed them I fired
off my queue when I missed ya minion you
charmed
I'll Q's the best oh we should add queue
before oq just slays everything me just
use the level 1
no these bots suck do they even know how
to buy items now we have more queue I
got to go home guys
but I can buy things with all my money
twitch and cam girls is very similar oh
look I bought all of those now let it
buy this and now can i buy that not a
lot of money new Tom Cruise is great to
have you watching my channel 20 there's
20 people out there watching me play
League of Legends imagine all the people
who are actually good at this game we
would love to have 20 people watching
them oh yeah yeah I killed them yeah no
no they killing me uh retreat retreat
retreat Retreat retreat oh no I died
yeah why try to avoid dying enemies get
stronger with each death I wasn't paying
attention and they ganged up on me I was
talking about how excited I was to have
20 viewers I miss my old hero that could
make it rain do you know which one can
make it rain can I spend real money on
huh wait how much that's so worth it
wait wait so they give you a trial with
the expensive one I thought you couldn't
pay to win I thought you couldn't pay to
win
they're not equally balanced this
woman's terrible that's what they all
say but I don't believe it
oh no you killed my ally all right
that's it that's it I can take these
guys oh yeah look at this triple kill
yeah yeah that's right BOTS oh I got a
retreat I wish I had make it rain
oh I didn't make it rain I would win
wait ten real dollars can I get it if I
like play good instead I want on locker
with experience D to run faster waited
no way oh it's my way it's like my
ability or something oh no run run run
that's right yeah you want to engage now
that's right
killing spree
oh I understand how this orb thing works
now yeah I say this is complicated I
like to make it rain wait if I pay ten
real dollars I have to vote my credit
card out don't I can I pay with Bitcoin
yeah how could I type in my credit card
on stream i can't I can't upgrade my
queue anymore I could pay with PayPal
what if I get a lot of in-game gold is
that good enough
how much
and I really want the hero that I know
how to use cuz she was easy to make it
use start with your e this guy's saying
to use my e
yeah he was make it rain on the good
hero no I know the enemies a buck but
we're gonna play a real we're gonna play
real opponents very soon I promise guys
they make you play two games against
bots and the bots are beating me but I
believe in me oh yeah look I charmed
this one is that good die die die die
die yeah unstoppable that's right
or I gotta finish killing these BOTS
first don't worry I got a double kill
I'm really good at this game
put your fill in the middle of the map
I'm button spamming yeah yeah yeah no
that's fine we're going we're gonna push
look it look I got all these minions
we're gonna push nice I'm saying
oh yeah Morgana yeah get charmed that's
right I learned how to use this hero
I'll level up that's right godlike
George I'm godlike oh so you always need
to level or whenever available or is
always a better ability than all the
other ones wait really
yeah Suze called your ultimate ability
guys is that really true
a tank on your arm man
uh-oh I miss make it rain
that was a good ability died no no no
run run run oh how do I run fast D I
love D really when someone tell me this
digit or L didn't tell me anything can I
use B often
ah I forgot to take my R again
ooh that looks good
whoo that looks really good let's get
that one all right wait let's end this
game so we can play real players and
then we'll play for tonight afterward I
League of Legends no I'm good at this
game now don't worry but you know how to
play this game hey guys no no no no stop
stop stop push no don't let don't kill
my ally I meant single-handedly take you
guys all on don't worry I'm rock dude 69
that's right legendary yeah look at that
I know it's on this game is stupid I'm
playing box
ah I have are now
oh you're lucky I missed dude
go home go home go home go home go home
go home no no no oh wow that was close
you're our is-3 - what does that mean oh
I can't hit it three times
oh but I can't use my art right now it's
not ready I can only use it once every
minute but I can use it three times
quickly but if I don't use it quickly I
understand all right
these minions won't even know what hit
them
no I charmed a minion by accident I want
to charm that hero more are yes I'm
gonna get to use our again
all right
Facebook graded this game for point 1
out of 5 I missed
oh I have my are back
I have to go all the way home to heal
this takes forever
don't recall okay don't worry I wasn't
going to I was just thinking about it
but then I remember that I have an our
ability and I'm indestructible except
I'm not I'm gonna die
slayed my ally
oh I thought that they would heal me if
I went into their base it only heals
when you go to your base that was a scam
okay
ah this games hard you guys know I'm
walking across the map it takes a long
time
what do I have - is that what my are
ability does oh man no these people are
gonna know what hit him because I have
an AR ability
ar AR AR AR AR AR AR
yeah victory yeah let's play
you have a rock dude wait Rock 269
alright good okay how can i buy that
here oh that's good that's too hard
will you buy points there perhaps
thousand yeah you can buy it now oh
really
yeah can I sell my voice for ten real
dollars no oh wait we're so where is
that here oh you have to go to shop
which is the coins I get how good and
then champion so what's her name miss
fortune 200 just search and she's make
it rain girl yeah
oh wow I can I have 6,000 bees but for
me you also said 6,000 but then turn
that turn to 3000 hey it's a bug I think
yeah 3000 how do I earn more you earn
more we can
can I earn 150 really quickly I think so
all right let's play well do you have my
friend Lucas friend requests oh great
perfect all right yeah we're gonna play
League of Legends where's the weed
here's the wheat guys but it's a work
night so we're not smoking weed here's
gum detoxify toothpaste wait I don't
need open capsule whoa oh oh whoa they
know something where's capsule I will
hack server but later profile maybe is
when I arrive like items somewhere
collection icons
given to players who choose all your
Tony I could have chosen misfortune is
that near stole loot
no I already did this I think so where
do you say I do this no no no no no no
we don't hack shit anymore cuz I'm
retired you guys could sit could you
gift me money could you give me a
hundred fifty shits why not oh I have to
be level one or above to receive a gift
perfect I'm level three yeah just go to
click on loot and go to the gifting
Center and then type in my name in loot
oh I can sell all I can sell I can sell
the terrible hero who seduced me with
our good looks Sal Kate I don't have her
yeah yeah just go to just go to the
coins and then go to gift disenchant
into essence by Kate oh so much essence
she is beautiful I know but she's
apparently very complex you can't give
me blue stuff
can i buy champion now I have money now
I'm gonna buy a champion now by
misfortune okay good bye oh I was only
50 away Kate won Kate one day this is my
promise to you I will buy you back um
thank you to major
she was looks like Thai so left I'm
terribly sorry for what I said
I feel bad one day just like Liam Neeson
and taken I'll come back alright wait
I'm joining your game wait I hear your
voice on here alright I don't know what
should we play
you picked Kate as well oh can you buy
new icons
I have $22,000 can I find your buddy
all right yeah I turned off your voice
already all right you're the owner of
the party begin matchmaking let's go
let's play some League of Legends well
you got to play the other game pack
go twitchy's I want nuggets but let's
see how much I weigh too much for
Nuggets oh I love this game
you guys you can't play a ram don't
worry I wasn't wait we plan you can't
play a ram you need more champs I think
nota major knows a lot about this game
oh except let's go
how much do you have high place care so
much I got a date Friday night I'm very
excited you guys very excited thank our
fire facility
I already clicked accept all right so
how do I play oh I know which one I want
misfortune let's go
no it's not a man it's a woman a date no
it's not Taylor Swift no no I don't know
I think I'd actually be overwhelmed that
intimidated and wouldn't be able to do
well on a date with Taylor Swift
but Talulah Riley on the other hand
anyone else having audio problems no
it's not tender you guys this is
authentic fire festival merchandise and
swear man who's duel eepa she's not
Caitlyn my sold and disenchanted into
essence that's devastating
it's like scobie's but less serious
switches I will try plate get a csgo
free to play I'll try playing csgo I'll
follow you better at it than fortnight
at least I know I never to be the sniper
I now to hang out on the roof for snipe
people no no no Selena Gomez the one
with the donut ooh is that Ariana Grande
dials go I'm ready I'm not to play this
game we're gonna top but I always go mid
let's go top I'm with you I'm with you
I like dumb Abed anymore I have a
mattress on the floor I live in a closet
I'm off my twitch streams lagging
hmm almost bad time
how many FPS the way yeah I have an
external GPU box with an NVIDIA GPU but
not using it because my monitor doesn't
support it but one day we're gonna
livestream trying to compile tensor flow
with GPU support for Mac what time is
that let's say 12:30 late
yes
mastery I was a shitty computer this is
what
wait but this is taking too long
cooee boot him
tweet-tweet boot Oh bro bro you poor
[Music]
I already haven't played a game of
League Legends yet and I'm already tired
not if shitty Wi-Fi is the real problem
we have we have gigabit Comcast it's
this damn stream speed is decent but in
his fun room I agree I have a big
American flag on the wall which I would
show you if I had a mirror that's over
there oh yeah let's go only make it rain
can I buy things already at the store oh
yes oh free oh I love free health
potions about one of those
okay all right let's go go on top but
we're on the other side how do you go
top on the other side wait should I not
be here let's go
you're lagging you have such a good
computer oh yeah let's get him he's out
I'm gonna call another Tower don't worry
because I was just snipe minions and get
kills and now to play this game
wait you're moving oh we're gonna go
bottom okay let's go bottom can we kill
we creep kill wait look at these people
we got to help them
oh yeah your money
so someone killed our people already was
it the guy with the bad computer Oh is
there a turtle can I kill it I can't
kill the turtle okay I'm coming don't
worry I got your back yeah make it rain
oh I made it right on the minions but
just two of them you got a heal bro I'm
gonna heal you I'll heal you got ya oh
you're welcome
I have them here to support
oh yeah make it rain on the enemies yeah
so good rock dude 69 love this game
should we try to kill that guy let me
know what I should do something
yeah died I died I died yeah try run
away
you want to stay here but what if they
come for our turret Oh perfect yeah no
don't worry I'll go go mid bro you're
dead bro you come near my turret again
I need more Manas wait he can make it
rain - oh the other one I had was much
prettier before you know I had Kate
before she was she not that complicated
yeah I know that's why I didn't like her
but she was prettier than this one no
this one's ok because I can make it rain
but I don't have enough mana anymore no
I like girls who are pretty dresses oh
don't worry I got you wait how do I get
more mana
how do i what why would I do that should
I go home and buy things at the store
should I go home and no 600 but it'll
take me a long time to get back I'm
going home oh we know there's all these
people here never might not help
wait no no they almost killed me I got
to go home is it worth it to run or
recall really but what if I'm really
close to home oh yeah
what should I buy boots of speed that's
all I can afford I can buy another
dorians blade oh now I have two Dorian's
blades Oh sick love stacked I'm good at
this game right yeah
[Applause]
can I use lots of mana now could I buy
more mana with real money I'll spend
real money on mana but so I shouldn't
make it rain on these minions but it's
gonna be so satisfying what'd I do
oh that was so satisfying that was so
satisfying though
look at all these minions I can make it
rain on them that's so satisfying that
won't use queue attack on them don't
worry I will use queue attack on this
guy though that wasn't you who died
right
oh no we're good yeah I know I got him
Oh get him get him bro I'll make it rain
on these minions no no no no no no oh
God them did you die oh sweet does he
get money oh that's a good deal yeah I'm
gonna kill their tower no I'll make it
rain on you bro
should I goos my how are their jar they
showing up I haven't died yet I'm
invincible
our teammates suck why we get partnered
with noobs I've never played before but
I'm not an idiot really did they buy
things in the store you have to do that
it's an important part of the tutorial
Oh take our guys I don't know how to use
our wait let's kill this guy alright
alright
oh good I love satisfying ours
can I go kill turtle now sweet I'm going
to kill turtle
I hate turtle
I attacked a plant oh sorry what I don't
have it our he's new don't worry oh no
I'm gonna die I'm running who an orb you
died oh my god you should have told me
yeah I'm a beast of this game I'm gonna
stop a ball I'm running home oh wait I
shouldn't have run home I should have
recalled home and then oh my god they
got 17 kills versus four of ours why'd I
get noobs on my team
press B what's B oh I don't wanna do
that I'm already here I ran home you
have to kill minions with the last hit
to get gold
I'm coming I'm about to make a rant on
the minions no I didn't buy any ours
okay you promise me it's easy to use
it's not like Kate I love make it rain
it's my favorite ability
okay all right now should I use it yeah
wait why oh it sucked it sucked
died help me kill him got him I'm so
good at this game
oh I hate when my minions get the last
hit on minions then I don't get gold
that wasn't you right there should be
better at this game I don't have any
mana how do i Rico beat that's what I
wanted
you have to stay still I understand I
will stay still next time I use my R I
can't even buy anymore shit
now I have all my mana back wait we need
to go defend up top did they knock our
tower down that's terrible
oh don't worry I'm coming to kill that
guy my R is almost recharged
oh yeah ah wait I'm nearsighted let's
just hang out by the tower tower
super-safe
were you leaving me here bro oh he was
killing you I didn't realize that
wait they killed me too how'd they do
that I didn't even get a chance to use
my attack
oh what a cheater
those guys hacking
what we're gonna lose our way
and remember money to buy things oh yeah
let's kill this guy
let's hack it you can't do that
we don't have anymore towers they all
went mid people on the bottom did great
I'm gonna go farm creep or whatever that
means
no no let's kill him
nice nice I'm killing this thing where I
cancel my or again I'm so bad at using
that oh yeah was that worth it for all
that matter probably not oh my god
why does my teammate so bad
No
oh I lost don't use our against monsters
yeah I think this that makes sense why
are people all noobs what wait you're
telling me that there's people on our
team trying to lose
so these are like gold farmers
nice can we reconstruct our things so
the super minions will stop that's cool
yes right now I can buy good things Oh
rapid firecannon all that thing looks
good yeah that our was good I know
don't kill my tower yeah yeah yeah
you're trying to run away bro trying to
run away that's right
Oh oh that guy's a high-level I missed
good my arse back
Oh how'd they get that thing Wow well I
should use my are on it
dad
Jiji
we're all the dentists next week guys
and excited I found out that you could
for free
get them to clean your teeth well I have
health insurance and it's a scam and you
gotta use it because otherwise the
insurance company makes money all right
how about have we lose I played so well
do I get Ilan for that oh boy I leveled
up I'm three now let's play again
all right fix my audio explain to me
what you want me to do here's my audio
I tried
all right no how do I go back and see
how I did it that game
Manchester
five hundred fifty thousand are you
running these in cloud downstairs Oh
overview yeah that was a sad game Oh
perfect let's go
okay nano danger is a subscriber and he
says the audio is fine so you know what
it's fine you tell me to fix my audio I
have no idea what you want me to do
yeah no now I'm gamer I play League of
Legends I am League of Legends stream
right now audio is fine
Bruce your bro oh yeah I know which one
I'm gonna be wait I can't be Miss
Fortune know who's Riven she looks
pretty who else can make it rain wait
what else do I do
what do I do uh take Tristana that's the
only non-complicated 100 she looks
terrible though
oh she looks like a purple Shrek
yeah I'm just saying your guy wasn't
much to look at but I don't understand
what you say you can't hear anything
what do you mean do you need me to add a
new source audio output capture create
new like that I don't think that worked
like that like that like that
that didn't work
[Music]
audios fine okay I don't know bro you
guys fix your computer wait
but vector Slayer took my hero
I bought misfortune to get a refund oh I
didn't even know have you know have you
seen how much better our computers are
than everybody else's what I do is fun
you know what let me ban this guy I
would ban you if you twitch is that a
thing
only when they lie audio sounds loud you
for me but I've got a lot of intensive
software on a crappy pc so I'm guessing
it's me bro the bike computer good
computer I bought I have this Mac as
2017 Mac I didn't by 2018 Mac I have 27
twitchy's now yeah yeah they liked my
League of Legends skill guys how's my
League of Legends skill am I good at
this game
thank you subscribers then I don't know
if there's a crown me more subscribers
only if you watch replays everybody can
watch normal yeah scamming twit yeah
that's a good point
no they hold it for like 14 days but
YouTube will let you do that forever so
what you just upload gigabytes and
gigabytes of random videos to YouTube no
cuz they still get copyright screened no
it's twitch prime does that mean I'm
getting money what does that mean you
just pay twitch money because you guys
know that the only reason I stream on
Twitch is to make money I made one
hundred and thirty two dollars last
twitch payment cycle I think it was
actually sent to my bank account yeah
Nick Nick he Lowell are you actually
audio is only for subscribers you have
to subscribe how are you twitch Brown
without pay can i research brain without
pay you have an Amazon account oh oh oh
Amazon Prime Wow alright let's play wait
I don't know which which which ability
to I spam
I hate all these ability no that
involves thinking I want make it rain I
can't even buy sword all I can buy his
shitty shield
I bought shield oh wait I almost didn't
buy free thing all right which which
Lane are we going
let's go top I hate this champion
I wanted to play Miss Fortune Amazon
bought twitch oh yeah I did know that it
really occurred to me the rich get
richer
oh yeah let's kill him
I'm coming I'm coming I'm coming why no
cheater if I had rocket jump I could
have killed him
I picked wrong
that ability sucks II
is the worst
I did it on the enemy Oh see I mrs.
heroes I miss misfortune I'll level up
that's right I'm getting double use how
is he healing
Oh
that sounds cool if I was good at this
game how about if I kill a minion boom
oh wow 21 cooldown that sucks
even though I killed a bunch of minions
Nicola you suck you're bad for my twitch
channel wine one of our guys died
already
w w's my new favorite yeah die that's
right could we go kill turtle
boom die oh wait now he's gonna kill me
he's gonna kill me
and now I don't have matter anymore
where are you oh I don't have any life
dying yeah without
boom
but I can't I don't have any mana or
health oh but look at all those crunchy
minions with those last kill easy to get
Oh
we can get this guy if we both rocket
jump at the same time
yeah let's just hang out in there and
then when he comes by let's ambush oh we
got a plan
wait for him to come by ambush him what
happened so did mine yeah but we died
oh my internet lagged uh we put my
internet lagged that was so shitty
someone ddosed me from buying boots of
speed you know what probably people
uploaded stuff on comma thank you thank
you surrender thank you please subscribe
to my channel I give me money I only do
twitch so I can make money did we go top
again wow if Majan that didn't lag we
just would have killed him and got away
did you see the hackers bullshit
I'm a great League of Legends player
there's no way I would have died
I still have to walk all the way back
how come ginger fucker has a six now
also he gets all the XP that's cheating
can I have a lane to myself there's
another person cogmed down
oh no oh no I'm dying I'm dying okay
what
nope nope
dead
where are you
nice
see but he's a level 8 and I'm only a
level 5 it's not fair
I thought all people were equal
what does it do how do I use it oh yeah
I did oh I got him yeah that's right
dude never stood a chance he shouldn't
have messed with rock dude 69
we're gonna take down his tower
oh there's a hero
we can take them
nice got him got him got him he's weak
he's weak ease we calm down yeah do I
get life for that sweet I'm gold now
pickaxe what we're doing better this
game sweet I hate having to walk back
though oh they need help on mid
now come nobody talks anymore
yeah
on my alternates back
my ultimate is great do we take that
tower down
nice
you want to kill that hero I'll come
join you what yeah get him
he won't see shit he's a noob he told me
get him
oh we can teleport a cheater oh let's
take away his mana let's take away his
mana take my cue I think my cue socks I
still don't understand how my e works
oh my e is very complicated oh but I
have an R again oh my god there's two of
them where should we go okay I'm coming
Oh we kill the thingy
they got them oh here's a guy
nice you got them I need to go heal
you put the e on the enemy than the more
you attack the more damage it'll do okay
I understand
I seem body thing heal heal heal heal
heal heal
I wish should we go
and no one's going top I'm going to top
to level up on these minions
I understand my okay it's pretty good
got the tower
boom yeah who said I shouldn't use all
those spells that's right
too close to tower
all rush top
dye minions oh oh yeah yeah no house
doing so well I've gold now though bf
sword that's right and we serve wrath
it's probably a ripoff just like if you
spend your money I know how capitalism
works
wait but there's a hero up top you want
to rush him oh I think someone's coming
for him pyre of strike Oh Papa scope is
you can't read playboy I just oh you got
him nice nice legendary I heard I was
legendary and then I died but legendary
I mean I got one kill I have my are
attack back though
oh no we're crushing it especially we
take down this tower easy easy I want
one of them buttons that's right
wait no nobody come back when you're
hanging out here you want to get those
guys I can use my are attack
nice wait no there's still two of them
no no they're coming for me to cover for
me help oh I can put ye on Atari that's
pretty cool
that's what it says yeah oh they got you
man I watched that I can click for death
recap wow they must have got a lot of
gold from you
oh good thing I'm buying a guardian
angel wait I should have bought infinity
edge
I'll have bought the wrong items that
sounded like a ripoff why'd I buy that
that sounds good no don't worry I have
spells I just killed seven minions with
one spell I'm unstoppable no I should
have died a bunch of times at this I
feel bad I'm a bad teammate
no oh that was you
scared the enemies killed a dragon why
don't we kill a dragon
oh here's a guy
oh they're all here I want in on this
nice I get something
oh yes oh this is oh look at a sleigh
I put my thing on the turret oh I love
this push
oh yeah we're crushing it oh this is
gonna make super shets
oh yeah where is it I can't see hang on
should I go somewhere
yeah we'll kill the worm what if it
kills us
all right I'm here are you here
why Oh try and forget that I got a I
gotta go help these people out don't
worry I'm gonna kill random Rhino with
my with my are attack shit
how is just resurrect Oh guardian angels
the best oh I love guardian angel it
saved me I would have died this is the
battle no shit
all right now I'm dead can I go yeah oh
I can undo in the shop while I was still
in base I shouldn't have bought stupid
guardian angel let it know that
the spawn time so long can I sell my
guardian angel I bought a second door on
shield
I bought a third door on she cult oh
yeah
combined my guardian angel and my three
door on shields I'm unstoppable
Oh DNF yeah I know what is d exhausts
target champion I know F I used f once
that's like guardian angel but not as
good oh that's right they're all hanging
out in base
the worm let's go
nice that looks useful
oh yeah the worms attacking me help
wait yeah that was a scam I wasted all
my attacks on that why'd we attack the
woman who's dumb
they have the turtle so it's hard to do
the warm that makes sense I'm killing
this guy nice
where our super minions
oh yeah I'm hanging out with this super
minion
is he here's a doctor
on with daylight dreary yeah oh we have
good teammates this time we get this guy
no he killed my friend
he killed us both
and through his shields of Doran I
something couldn't kill me
we do win though right
with your Crispo came back cheaters
yeah I'm hungry guys you know okay
I didn't even get to use my our attack
psychic I'm going that way
look at that micro guys
yeah
Wow Wow
how come they get to kill dragons and we
don't we tried to kill a worm and we
lost oh oh I'm dead no nope I have
guardian angel
[Music]
yeah but I bought guardian angel
I like this hero though these are cool
abilities oh we're starting to lose
again
wait what this guy in the middle is so
weak
what giggling
oh the gays
gays are very strong and that make sense
he's running he's running nice should we
kill this worm how come they got to kill
dragon why should we just lose
what if we kill him
he doesn't die well what if we all gang
up on we're not good at that what I have
a Q ability Oh Q no no it's like
teleporting guy I'm dead I can kill bear
in one view what is that a trump well
Ally super minions that's good we're
winning again oh I can kill this guy
this guy's only 11 oh you got him I have
2,000 gold can i buy something oh yes
Lord Dominic's regards yeah I don't know
I wanna buy guardian angel I'm in such
bad purchasing decisions early on in my
life
don't get him didn't go below bow get
him I saw him he was almost dead
let's go kill gingko biloba well if we
all gang up on it oh here here let's go
kill baron no okay okay
kill the inhibitor I'm on it
oh look oh we're all together oh I love
this teamwork
up
oh my god I got away oh no never mind
the gay guy just teleported ah look at
all these minions here that's so much
minion gold I can get
yeah the gay guy is not fair we're
losing now aren't we
he shouldn't be in this new bleep oh my
god they're here they're gonna kill our
thing and now they get super minions
they're in our base
don't worry guardian angels got me
but we lost oh we have people in the
base that's crazy
no but they get super minions now it's
not fair
signals that enemies are missing
why don't we ever do dragon
who got dragon we have dragon oh nice
love when we get dragon yeah dragon I
feel invincible
oh it's gingko biloba we got to run but
there's all of us here can we all
together kill gingko biloba
I died kill them oh you're gonna get him
you're gonna get gingko biloba oh we got
away
where'd he go
Oh ginkgo biloba press tab four stacks
oh sweet am i losing
I am a man
wait how am i dad again I mean my base
Oh stupid well at least I didn't die for
nothing are we winning again this games
long guys
I can't believe I bought a guardian
angel
where is it he's in our base kill ginkgo
biloba Wow he you like one shots me GG
what
I'm done with this game cell door and
shield and buy a bf sword are we lost
all right guys I've learned that I'm not
cut out to be illegal in the stream room
Wow you know everybody is things are
good at in life bye bye twitchy's thank
you please like and subscribe so I will
keep creating all this great content for
you it's the like button down there it's
the easiest thing you could do to help
out it's also sign up for things that
like give me twitch money bro you know
there's no foodies bedtime goodnight
which is yeah switch money that's right
all right ladies
well you know it's really slow yeah
make sure to follow me on Instagram
right here have fourteen point four K
follower assess like dial alright
come into my channel drop frame zero the
camera lags I know the camera lags
there's nothing we can do about that
toddler is welcome hello
diamonds skin one hello let me see if I
can zoom in on this alright I'm so we're
gonna lay down a ground rule right now
and the ground rule is we only talked
about minecraft so if you're not here to
talk about Minecraft get the out of my
channel that's right
minecraft we're gonna play minecraft
make a server I don't know how to do
this no no we're not making a server
we're playing solo minecraft cuz some of
y'all might put some hate speech in the
server and we can't have any hate speech
because hate speech is not related to
Minecraft and we're only here to talk
about Minecraft so let's let's its
booting up here
mo Jiang here this game was made by a
bro named knotch
now let's create a new world and what
should we call our world twitchy's which
we call our twitchy's River world not
much I'm really not very good at this
game
twitch verse alright game mode Oh
survival that sounds
let's go
there's a good place for me
should make me bigger all right so I
don't really know how to play this game
so I'm going to need your help I'm going
around my other world looking for copper
for a while and then I found out that
there was no copper or maybe there is
and it was all very confusing
alright so welcome to twitch verse let's
play some minecraft where the seeds Oh
Sees oh sweet all right I think we have
to go chop down the Train
it's lagging
is it lagging no all right oh it's
lagging I forgot to fix the lag I don't
know why it's lagging we're not dropping
frames video capture device this is a
very high-resolution display you know
what let's just lower the resolution on
the display you can't even make it lower
than that no no no no no no no pervert
okay cool
so now we have less resolution now we
can make this big maybe this'll a gloss
yeah the game's not lagging for me it's
only lagging for you
is that bad well it's bad all right cool
let's make some planks no one no dating
in San Diego right go we got sticks but
no really what I want to make is a
crafting table all right where do I want
to live you know what let's go far away
let's just travel for a bit if we play a
nice song about traveling this area is a
little bit deforested if you know what
I'm saying I DeForest Sharpe whole pod
I'm really not very good in Minecraft
guys but we're going out of here because
I don't want to be here this place kind
of sucks
it's like a like jellyfish and stuff
let's go somewhere cool
[Music]
cows chickens
[Music]
just in case I need whatever sheep have
[Music]
all right
this looks like a pretty nice place for
a home wouldn't you say what's this way
don't sleep in the nether I know about
that one you know Loki PewDiePie did a
lot recently for this game's popularity
[Laughter]
it's just the same world everywhere
Syria looks a little depressed where's
the sugar cane was that it over there oh
is that it over there all that looks
nice what is that anybody who talks
about anything is do I have any mods
here can we ban anybody who talks about
anything that isn't minecraft oh sweet I
got sugar this is a nice place
sorry peg I might need what you have I'm
not sure what you have but I might need
it
all right get some blue flowers nah but
for reals what are we doing thank you
for subscribing thank you accidentally
okay see this just become a mod oh this
looks like a nice place to build a house
wouldn't you all say haven't found any
mines gay thing we need mines in
Minecraft but this is idyllic you guys
this is an idyllic place to build a
house I think all right let's set up my
crafting table I'm gonna set it up right
up here against this wall here now what
can we make
let's make a pickaxe I'll look at these
beautiful flowers oh this is also so
beautiful you know all right where
should we put the mine maybe right here
what's in here oh this looks like a
great spot for a mine but I need coal
don't I is there any coal here this mine
kind of sucks guys
ah let's go back to our home I don't
know if that's gonna be our home able to
take our crafting table with us
this area is a little sparse and
resources I think oops no no that what I
make stolen pickaxe maybe only colistin
I call this time perfect what was that
noise oh the game audio is coming
through the speakers into my mic so is
this bad the hell is this thing
Hey Hey I'm gonna die this isn't funny
run run
right yeah this is terrible I'm losing
in Minecraft can these things jump I'm
afraid if I stop to eat they'll attack
me Oh phew we lost them while I was a
terrible place to make a house oh I can
sprint oh that's sick yo you bros are
the best control to sprint guy I like
you all right what is this mountain this
mountain looks pretty cool right I'm not
an idiot
alt f4 to sprint guy how come in
friendly mines mines mines guys now four
mines just we're looking for my fine
cave that's a good plan I like that plan
I took the crafting table all right I
got it and leave it to the wolves
yo those wolves was those wolves was
shed where are these caves
oh this looks like such an idea like
forest spot oh is it getting dark I
think it's getting dark
all right well camp here I didn't find a
mind
who lights my house we can mine a little
while we sleep it's gonna be dark and I
don't have any coal for torches shit
wall down my house should I built it out
of cobblestone oh no my house flooded oh
that was close bros oh that was close
alright we're good now so I've heard
from professionals that you should never
mind straight down cuz one time I did
this and I fell in lava and it was a
terrible time I can't see that please
call
well we're not up to redstone logic
gates guys but really just kind of
bootstrapping our way here this should
be a great house if it had some light
you know
let me make myself in the water I wish I
could see though Debbie you're gonna be
nice there even monsters on video
settings brightness 100 percent you know
what let me do that oh I still can't say
thank you see you better cool flames can
that make coal oh no my pickaxe broke
well that's a terrible time no it's nice
about shitty pickaxes though is you can
just make a new one that's really not
that big a deal
I'll give you diamond pickaxe breaks
that's a bad day we should eat
well no I just realized if we don't get
a bed soon we're gonna have to start
over
I don't need for a bed make a wallet
stop let's go kill some sheep tomorrow
Oh guys I feel cool your boy your boy
you know what they tell you about never
giving up and never surrendering that's
what I just did right there and now we
got torches that's right
normal people torches oh ho wow this is
beautiful this is a beautiful house guys
you know living underground actually
seems pretty sweet so how do I build a
door I build or old or oh I don't know
no I can just take this apart yeah I
don't know what I'm gonna do with three
doors but you know better safe than
sorry
oops I put in the wrong place
Oh terrible Oh is it light out no still
dark out but at least we can mine let's
eat some money let's eat some raw pork
chop
can I eat sugar how come I can't eat
this can I turn it into something paper
huh sugar that should be edible all
right come I can't eat it
make furnace how do I make furnace it's
not a cobblestone furnace okay
I have furnace what you do I have
furnace what dough can I cook my sugar
[Music]
can I cook my sugarcane okay so while I
make a furnace Oh iron Wow I have an
iron would I get that is there iron back
here - oh this is a sick as mine ever am
i right
iron and coal
[Music]
oh yeah we about to move up in the world
boys
okay what do with all our new found
treasure I'm not gonna put the box near
the furnace because it might catch fire
is there a fast way to do this I saw I
saw this something like fast way
shift-click oh yo that's so fast yo all
right good
why do you do that shit maybe
cobblestone can come with me so we can
build things hi that's good
oh yeah we got in goths oh we definitely
need some stick as well let me stick a
couple oh thanks you know stick yeah
throw down two sticks that I'm some iron
in got ya buddy all right cool
all right can we uh nope it's still dark
outside
that's insane that is just really insane
just make myself a stone sword require
too much resource
how am I going to do with my doors they
can definitely stay here what a ways to
call alright
put your food in furnace I tried that
all its sun's rising sweet all right
wait do I get out oh no oh no oh wow I
hope I got flood insurance no okay well
this is terrible this is this is really
does I don't like this let's go this way
there is no water this time sweet okay
what do it today guys what do today
let's build a big things where I
remember where my house is sometime I
lose my house and that's a bad day
okay let's jump in the water should be
okay perfect
your move s and I can put that back
there ah beautiful look at my house
should make some cobblestone steps for
my house
maybe we shit all right
so first things first let's go get some
food I have set up sets me that I can't
be a vegan in Minecraft but I'm not very
good at farming so let's go see what
food we can find hey remember when there
was food everywhere and we didn't kill
it
that was stupid I don't know why we
didn't do that mmm we're even are we I'm
gonna lose my house it's not a mine oh
that's nice it's right by the house all
right cool you can go back there later
let's just get the stuff we need for a
bed I'm gonna have to kill sheep though
this doesn't make me happy set a pig up
there oh you're dead pig yeah you can
fence them in and breed them for food I
don't know I'm not really good at that
we can try what's that they're just
another mine
it might be monsters in that mine
Oh sheep wait if I kill them do I have
to share them do I ever get wall wall
perfect
I need your food straight up okay
three white wall I think that's all I
need
pack your chicken you live okay I recall
correctly my house is right over there
but sometimes I get lost let's see
should we cook this stuff cook this food
can I make like a fire campfire make a
campfire oh it's a lot of wood was
smithing table watching what is
fletching
here so that'd be nice to have stop
killing all those sheep I cost me iron
wooden sword or I can make arrows I
heard I think a bed yes bed
perfect well we should make myself a
nice bedroom you know there's a
one-bedroom apartment make a flint and
steel what do I do with that
can I start fires are you trolling me
that's nice perfect okay let's make a
flint and steel
Oh let it go well I'll cost me an iron
that better have been worth it oh wait
uh should we have the fire room let's
make a fire room behind the bed okay now
can I cook my chicken what
q to drop and that'll cook my chicken
guys how do I know when they're done you
put it all right
no no no you know what
I'm I'm tempted to just turn the stream
off no that was what why do I have this
is it a weapon
exactly me any food guys okay I need an
axe I'm very upset
that was incredibly disheartening you
know what because of you guys more
minecraft animals have to die you're
terrible people and I'm just killer you
know you know what I'm just gonna burn
the whole place down
that's right sorry you get fire and you
get fired you get fired that's right
that's right I'm lighting the whole
place on fire
well my fire burned out
it's spreading can I use my shears once
I share a chicken can't your chicken I
can't shoot that thing either wait how
do I use I want to share you yes thank
you
is that a horse can I ride it that's
right
yeah I'll find more horses that one was
food why not kill all the sheep I just
should have sheared you come here sheep
I want to share you I already sheared
you no more wall oh we got to go home
it's getting dark we're not making on
autonomous anything you guys you've seen
how noob I am at this game I threw all
my food in the fire let's go let's go
let's go let's go oh yeah wait control I
can run see sometime you guys give me
good tip so I'm like flint and steel oh
we have to chop a tree down quick oh
please use my shears to do this I
shouldn't be doing that I guess my iron
pickaxe will do
[Music]
oh my hunger decreases faster oh that's
why it's so low foods hard to get ha
home sweet home
all right who's ready for bed the fire
room whew
Oh cook food first that would have been
a smart idea all right well let's make a
campfire because I know that's actually
how you cook food guys it's that to a
green bed that's cool
campfire
oh we have to make more sticks
well I suffer from carbon monoxide
poisoning if I put this in here maybe we
should build a chimney
oh yeah those are be steaks in no time
taste is somehow monsters up there don't
really know where monsters come from but
then I coded them up there all right
perfect
for leather as well I make something
cool out of leather
should I use the furnace alright help me
out guys what do I do now
Oh rose bush alright let's make a hoe or
an axe I'll be fine with that
alright let's go home a bit of shit I
can't believe I wasted an eye on flint
and steel and it's the most useless
thing and it just burns your food never
run out of wood again this looks like
some great land for farming right here
huh well let's turn into wheats oh you
need water nearby
oh okay never mind I was kidding about
the weed is that true is that one of my
things ever work that's why I can't farm
oh okay well it's good to know what my
house go I'm lost
well good thing I built that little
tower to tell me okay let's just go
through water my things grow here nice
like that for blocks on the water
all right cool I'm out dirt dirt dirt
you are an edge to block
perfect
all right by the entrance to my house so
those are gonna grow oh there's a
cooldown on hitting Wow okay what do I
do
I'm confused let's go to the mind now we
just go get my food first
mmm steak oh that was delicious you guys
oh there's the best steak I've had in a
while oh you know what we got to build
some cobblestone stairs
maybe this will lessen fury at you guys
hah who likes my staircase
do you like my staircase oh it's a
beautiful staircase I think oh okay this
is kind of annoying because now these
things are in my way let's build a
cobblestone ring around them I'm trying
to dam up this whole river it's gonna
work where does the water come from how
is this all right here just paving this
place you know pig
explore knocked my torches back I'm
putting a wall up here so nobody will
ever come to this stupid place again how
that's one of my torture suppose you
gotta go back for it I don't know maybe
this place is cool I take it back
this could be my second home just give
you my summer okay what was that mine
let's go to the mine alright and I
understand you guys are offended that my
my farm is not symmetric you can go make
my farm symmetric later is my mind so I
know that big mine I found the other day
where was it I'll make a shield oh that
might have been a smart idea
I found the mine flooded not so long
ha iron underneath it don't mind
straight down
[Music]
[Music]
remember your home coordinates press f3
I'm not pressing any day
I don't trust you but if you all want to
tell me what to do um down because I
don't really know what to do anymore
like I knew what to do I knew I had to
get iron and like we can look around for
diamond but like oh they have nests a
long way down
[Music]
who are found iron on my staircase
for now
[Music]
it's a long way down
[Music]
see I made it symmetric just for you
guys okay press f3 Wow
[Music]
pretty cool okay are we going to the
bottom of the mind I think we are
should we make a shield first should
make a little home in here let's make a
little home in here set some stuff up I
[Music]
wish real life was like this would be
cool and you could just have a little
home anywhere
[Music]
[Music]
you could like build things like this at
a rock furnaces are cheap oh I didn't
bring many of my doors with me to make
another door that's offensive should
make three more doors now we can't do
that as too many doors
you know whatever I'm gonna second
furnace kind of furnaces a lot and I
need a shield shield shield shield
shield shield our shield iron ingot and
my shield head
iron pickaxe is running out - oh there's
a creeper that's what those things are
called free verse I'm scared of it going
back to my house my house go you'll
don't come near my house bro can I shoot
it
can the furnace really catch things on
fire next to it
you're Blackwall I'm gonna blackball to
make a bed some logs down here mistakes
with me dandelion seeds and flowers and
stuff could stay here i season come with
me when you're gonna okay so how do I
kill that guy I build a bridge oh no
another one Oh my stairs my beautiful
stairs okay should we get to oh wow it's
nighttime
oh we got to go good thing I have
weapons not come upon any sheep this
year I really like to share a couple
sheep
you see an Enderman
who's an Enderman do I have that they
don't explode if you're around a corner
they say right down
what is that noise is a monster by my
fire I was definitely the most remote
and fire anymore
no we need a new iron pickaxe now I'm
gonna make one in my mind
what what no Eve anyway
some good steaks I'm gonna lead them
away from my crap when will the battle
in the guys pull the battle and what
make a bow with sticks and string I say
when I could be as annoying as that guy
I don't have that many steaks Oh sheep
I'm gonna shear you pick a black bed can
i okay can't share the chicken
what my mind go pick some all birds out
of that sheep all right I don't know I'm
not sure what to do next in this game I
feel like I already won I made a bed
dozen I mean you win mine yeah
eggsy your coordinates and why is your
level I guess behind
that's a lot of iron in gun
shooting at me let's go make an iron
sword I have one steak left also a
little concerning
Oh build a secret staircase let's build
a secret staircase
I forgot my doors I want to bring them
down here
I built the secret staircase right into
my house all right well we have a lot of
oak planks we'll just make more doors
oh I feel so safe in here come on alarm
let's make some iron armor you'd be
indestructible
I lost all my iron
and out of food to which I don't like
tiny grass you cannot eat grass is that
dirt it's like the Red Rock
I thought this was gonna connect okay so
what's the game mechanic
I don't know wait till it recharges just
when I die
oh he's attacking bow and arrow guy
that's a good deal and now I'm out of
food there's creepers well this is
another bone arrow guy we gotta go we
gotta go get food all right let's build
a secret staircase out of here
Cali California welcome to the
subscribers we don't have a name for you
guys you're just like good twitchy is
that what most kind of Suggs band who
ever talked about anything that wasn't
minecraft let's we only talk about
minecraft this is a minecraft channel
guys I know I'm not very good but one
day I dream that I can be as good as
who's that famous guy you know the
famous guy knotch
he's famous now that's not what I was
thinking about I was thinking about the
other famous guy um which famous guy was
I thinking about the guy who just quit
twitch because twitch put porn on his
stream you know Jake Paul
they're monsters up here now this is
dirt oh we found me up it's nighttime
all right oh that's pretty cool where am
i where am i go Korea where am I
what is this how it's lava come here
monsters we're monsters come here come
to the lava
oh I'm gonna die where's my house I
never remember where my - oh no this
isn't how it ends guys this isn't how it
ends that's a shoe there guy I'm trying
to think where I went I felt like I went
underground and this was fine you know
what can I just get back to my mind
where's my mind okay well here's lava
land my mind was safe
my mind was safe where's my mind there's
lava land no that's not my mind I'm
gonna kill you chicken just my mind
No Oh creeper no no oh oh that was close
I could have all gone much worse where's
my house
oh no I was closed off no no no no no no
not today no great okay let's sleep
tomorrow we go find my stuff okay oh we
have some wooden pickaxe a little bit of
coal no wood no food all right cool
perfect okay harvest us no the other one
wasn't ready to harvest
I get cool all right so I have a
strategy guys we're gonna go find my
stuff we're gonna go back and know how
to get to the mine yeah I could do that
but that would be sensible
yeah I'm now remembering my numbers
that's cheating you guys both like I
cheated video games
it's cheating thank you following
Instagram let's try it at your charts I
know all I have now is a wooden pickaxe
but one day I'll have an iron pickaxe
when I go find my iron pickaxe that I
had not very long ago all right so my
first strategy is to get back to where
we were it was nighttime everything was
dark it was all confusing first we're
gonna get back to my secret exit from my
house you'll notice I have installed a
beautiful door how so no monsters can
get in so we know this place is safe for
monsters
alright we're good now I'm like oh yeah
let's just build a secret exit okay cool
here's my secret exit you have five
minutes before you stop vanishes as
that's true already slept okay so first
off where Wow okay I'm already lost how
do I come out here no no no that's lava
how did I how did I come out here oh
here it is
okay hey we hold fucking boomer okay so
you're like ran around for a bit got
attacked by some guy it did my stuff
really disappear
this is five minutes shit real oh
there's the entrance to the mine okay
well at least we know where we are it is
possible I went down the other side of
the hill
it was on the river it is also possible
my stuff fell in the river that should
mostly be our tack you know the stuff
wasn't even that great anyway what great
stuff that I have you didn't have shears
okay I think maybe we just cut our
losses and say that stuff sucked anyway
which kind of did it's going to the
right it could be on the other side of
this hill I think goes a river there
what's this that's a nice mine
they're cute sauce
don't see my stuff anywhere I don't even
have good stuff to begin with you know
into one loop around here and I were
just gonna give up cuz this stuff sucks
anyway is there a river on the other
side of this well I'm not ignoring chat
what do you want all right who knows
where to go
did someone watch this stream and tell
me where my stuff is
I feel like I did that
if anybody talks about shit that isn't
minecraft you know you're all banned
follow the river wheat river okay you
know what we're gonna Google Wow okay
now my monitors don't really work
because I change the resolution why I
just so much for you bros does your
stuff disappear in Minecraft after you
die perfect if they're on the ground for
five minutes
oh well that stuff sucked anyway that's
what I think
now I'm lost oh you're back wanna go
home alright this is now a Minecraft
mission we are gonna try to make it to
the nether after he is cheating we're
gonna make it to the nether and then
we're gonna call declare ourselves
minecraft heroes so let's see if we can
do that because I've never actually made
to the nether before there you have to
like just dunk water on lava click this
link to make a farm I made a farm
you don't like my farm never wheat I
don't like to make bread but no but I
don't really know where oh well this
sucks this isn't where we want to be
alright I went on a wild goose chase
after my stop and now I'm lost I should
build a campfire by the entrance and
then I could have seen the smoke for
miles
died so you can respawn at home you know
what I almost like that plan I don't
really have that much good stuff with me
that might not be a bad plan we'll do
that if we don't find a better plan
I could wander around in these crevices
for hours never find a thing it all
looks so familiar but then it's all just
bricks go to the right over the warning
I think that's right no this is
different water you guys
[Music]
no no I've been here before on a wild
goose chase looking for my stuff and I
deeply regret it it was bad stuff anyway
now it's left alright I trust you
twitchy's for the most part except for
f3 you haven't led me wrong no stop it
with f3 f3 is cheating and the people
who use f3 alike the people who uses
gps's in their car
oh who chopped this tree down had to
have been me do you guys really just not
get lost in this game oh you guys will
cheat use f3 don't give me that all
looks the same I agree okay gathered
some nice flowers I'll bring them home
to my why oh that's right now they
belong oh yeah I think it's this I think
it's this I think I know where I'm going
prediction to be confirmed we're gonna
run into the mine soon oh you know I did
have though I built all that expensive
armor yeah here's my mind Thomas Lee
where's the chicken you're gonna make a
nice steak for tomorrow Hey Oh
[Music]
I've never been so excited to go home
before going home
Oh almost home guys we're almost home at
the end of a long day turning brightness
not stopping with you guys just wanna
cheat you know y'all cheating at
Minecraft can I harvest these yeah
harvest my harvest that one yeah harvest
I walked on the other ones it's all a
bad for him
five three weeks oh let's make bread
let's settle down for a nice loaf of
bread tonight yeah I throw my steaks on
the oh yeah after mine I'll tell my beef
on that oh that's gonna be sick yeah
just go over here just throw down three
wheats oh yes a nice loaf of bread
tomorrow we'll expand the garden you're
gonna be an indoor rosebush don't catch
fire what good thing I always keep some
spare dirt there oh I wish I had some
iron ingots or something but I don't I
don't
so you know we get you got a stone shit
Wow how the mighty have fallen
oh we used to be rich when we used to
have everything defend with one careless
death we lost it and now we have nothing
at least we will have my rose bush oh
that's a beautiful rose bush alright I
won't carry too much shit with me next
time thanks minecraft hindsight captain
who thought we were gonna die
nobody not me well I woke up scarily
close to that campfire I have my steak
look my mistake
give me a steak I we're good alright we
got steak we got bread let's go to my
other house they're monsters we need a
home
just plant more stuff yeah we should
plant our star alright you be sticks no
wait why don't you just go to this mine
this is a nice mine we forgot a nice
this mine boys you know we went to that
other mind thinking that we were gonna
find stuff we're gonna find shit I'm
your found shit but you know this is a
nice mind too and it does have any
monsters in it now it's not trees - Alex
I know I need more food where do I get
it where do I get food
Zef food oh it's gonna make a home I
need to make a hole for you kill a cat
make cow farm okay I like that plan
let's make a cow farm you're right
before we even travel to the nether we
need to how do I get the cow to come
over here or I guess I can make a cow
farm anywhere
well breeding animals takes forever I
need to feel I need to feed them fucking
weed why don't I just eat bread if I'm
gonna feed them we know I like the
plants they pissed me off I wanted
something that pisses them off and for
me it's plants off this cold you know
coal might not be much to some people
but to me who lost all his stuff in a
terrible accident
coal is lot sorry torch
okay you know what I'm sick of not
having iron we have on our knees need to
go get it it's not in this mine right
here yeah fuck plant that's right
what I don't even have it if I could
just bake bread why don't I just make
bread wheat
oh yeah home sweet home number two where
I have lots of iron I believe actually I
think I wasted all my iron making armor
which I then lost well we have three
yard sweet
I'll settle for a stone sword
bread and steaks with more tasks we cook
the rotten flesh okay
my name is shir want a mining coal I
don't need call I want to get on so I
can make a bucket so I can get walk
let's go kill this guy look his iron
over there just took a guy you can't
even hit me down there can you see old
praise me on my patience in that
encounter by the way notice how I didn't
just bum-rush him who I found la la la
we call I was anticlimactic if it be
something cool down here nothing too
cool alright how do we get to the nether
guys oh that could be bad is that good
monstrous yeah it just sucks wait I need
diamond to get to the nether oh I guess
I need a diamond pickaxe in order to
break the nether Rock well I have coal
and iron so if that's what I need that's
what I have things are stupid
okay let's go find some diamond if we
need diamond we need a diamond too or
can I say doing it with buckets is kind
of massive don't tell me to mind
straight down okay we'll make a diamond
pickaxe no he's protecting his baby
be my over the under a letter - is that
gold
what kind of do with gold
Oh
you got noise come from Hey iron is
everything fine diamond what's that
noise
all right let's go back to my house not
ambient sounds of uses monster it's not
immediate well they're doing a good job
I'm scared my crash is scary what was
that we're how'd I get down here is it
up how this monsters over there I think
I'm supposed to go I'm lost again just
didn't help that this thing doesn't
render no that was that stupid place I
cleared out from the wah-bah
nope nope nope nope nope that's right
can't fuck with me in here broski that's
just tunnel op am i at low enough level
to find diamonds let's check every I'm
at negative 40 I'm at 47 is that good
is there diamond tier level 11 how do
you know I'm at 37 I mean it says 48
I'll go diamonds near the lava
the middle one is your level oh I'm at
39 diamonds are at 11 diamond is below
16 okay well let's first go home and
then we're gonna go you know what we're
just gonna dig really deep this is it
you know what I got a plan guys we use
an f3 we're only using it we're not
using it to find things but we are using
it to tell how deep we are that's right
that's the plan I figured it out all
myself
let's get out of this terrible mind what
what even was that did the torch burn me
is that possible just my house no
andesite what a shit material our dirt
now what's the circus why don't you go
with the surface okay here we are again
and it's nighttime last time we did this
terrible things happened this time will
we be smarter first we're gonna leave
some torches so we know how to get back
in I'm at a tortoise
no no no no this isn't happening again
oh no that's right all right guys we're
just gonna chill we're just gonna we're
just gonna chill um that guy's gonna die
in the morning anyway then he sucks
that's what I've heard
I don't have any wood so I can't make
myself a house down here we could just
casually mined this iron skeletons don't
die in the Sun you know what let's just
go out a different way is this minecraft
or is this minecraft you know I wish I
knew the X Y Z of my house so I could
just tunnel back there you don't I'm
saying we wouldn't even have to see the
skeletons we could just tunnel I mean I
know it's a long tunnel but like if el
chavo can do it I think we can do it too
I wish we had some sticks and some wood
okay let's go to the surface
let's get sticks and wood
creeper no cat every time we go to the
surface
bad things happen I'm out of food I'm
starving to death here in this mine like
the moves to remember the Chilean miners
it's like me it's pretty nice though
these torches you should keep the
monsters away where's my house
okay welcome to our new home
I'm not going outside cuz it's sketchy
out there there's monsters and shit but
this is our new home
nice crafting table in it it's amazing
how you can find everything you need
just underground to make like furnaces
and crap yeah buddy oh yeah then we dump
our iron in here make another one of
those furnaces are gold and that one
okay
to make a couple more torches what a
deal see where we can't make food or bed
but those things be different oh it's
daytime let's go home henceforth oh no
oh no oh no
okay well good thing I didn't have
anything good
now the only question is can we find
that place again let's go we got five
minutes a wheat cake who remembers where
that place was I think I was super close
yeah
it's not the skeleton that killed me my
stop ready yeah
it's gonna feel good to kill you man
that's right
okay so torch land is somewhere around
here to that islands Wow look how close
it is to my house oh this is the new
best entrance to the mine okay how's my
iron smelting going really well
as to be expected got myself a new iron
pickaxe beautiful okay and now we begin
the project
oh it's super close to our house this is
the most convenient armored shield
shovel that's no stop shooting me bro oh
it's so conveniently located by our
house okay guys ctrl + left click to get
things oh I see what you're saying
Oh wheat okay we're just gonna go for
diamonds what level do I have to go to
[Music]
welcome to the new step mine
[Music]
nothing can kill us in the step mine we
have torches in the step mine anymore
what you'll have one in my box you know
what we gotta go whit hunting use the
sword
that's good what this is good
I need to plant more wheat but then I
have to make a hoe and I don't want to
do that I know ax gets wood faster yeah
type my home chords and chat guys know
we're at 58 and we're about to go down
this is for all the miners who said that
you have to explore to play Minecraft
we're gonna go down and we're gonna
strip mine till we get a diamond mine
because we are gamers and we have no
limits to what our patients can hold if
I can play old-school World of Warcraft
which I hear is really popular right now
and slay 15 dingbats and then go slay 50
Rumplestiltskin zand it's the same task
as the dingbats they've just called
something different because the creators
are lazy we can get to the end of the
earth in Minecraft where there is tons
and tons of diamonds is that what I'm
saying who believes in us 43 42 41 yeah
here we go what number do I have to be
at 4 diamonds
eleven let's go guys if I go to eleven
do I die is it all lava you guys fucking
with me why you even found iron boots in
my stairs so we can mark I feel like I'm
building a Soviet missile shelter you
know you just dig down and build a big
room at the bottom bought some wood with
us everyone will feel at home I mind
straight down that was horrifying
right here 14 13 what's it zero 12 11
welcome to 11 now we're gonna find
diamond no diamond that way
we're not hacking the game guys we're
here to play Minecraft you're not here
to hack minecraft we're here to play
minecraft
anyone can hack minecraft but does
everybody have the patience to dig all
the way down to level 11 to grind
endlessly through these mines until we
find diamonds is there a more efficient
way to do this desert f3 but tells you
what a diamond is I don't want to talk
about food I don't know how to get it
don't worry I have enough wood for a
crafting table
oh well good I'm gonna need that soon
okay well this sucks that whole card are
contained zero diamond where the
staircase go over here
is there really Dimond at 11 I don't see
it I didn't see any redstone ore lapiz
lazuli Oh red stop
know what to do with it all so much
redstone only that was all diamond
automatic miner
I'm just digging tunnels is more
efficient or cut tunnels it is mine long
straight holes all right I'm on where's
the diamond they're making another
pickaxe this is a waste of mine
so that was that the auto diamond
locator do you see anything I'm looking
torches so
oh man this is brutal
I remember just stumbling upon Dimond
once that was a good day that's good to
hear right now stick with one tunnel
[Music]
if all this redstone was diamond we'd be
rich
I mean do it all those rock this is
terrible
slowly subject our children to this is
like work simulating what a minute
diamond in there oh what's that
lapiz lazuli
oh man don't
oh what's that
coal's did I forget to enable diamonds
and now we're out of pickaxe
where are my diamonds look at the size
of his mind oh man I've whatever when I
thought the digging was gonna be the
hard part
yeah I know about running but it cost me
food Oh
can I open this server to you guys come
help me mine diamonds wow that was a
long walk okay
can I sleep now a break from our
regularly scheduled programming of
diamond mining where we're gonna build
something large out of all our
cobblestone
[Music]
and want to put that one there
Wow that takes a really long time okay
that was terrible so the wheat bro we
gotta go put
this is our big stone thing do you like
it do you like how symmetrical it is
good I worked hard on what I will this
stone can I do with it I'm gonna iron
got a have on let's make a pickaxe first
need to make stick okay we're going to
look for diamond guys wish us luck if we
don't get diamond then we're gonna be
devastated
ah yeah next time if we do another
minecraft stream next time I don't need
food if we do another minecraft stream
we'll do multiplayer next time but I'm
never playing this game again because
it's terrible and I don't know how we
subject our children to this no it's not
really terrible I'm just bad at it I've
been looking for diving for a long time
and I haven't found it it's kind of
sucked and it's kind of its kind of a
disheartening because I've dug so far
and still no diamond I don't know if you
guys are trolling me about 11 you know
what we're gonna check we're gonna check
or am I being trolled minecraft what
level is diamond perfect most common in
layers 5 through 12
oh we could go deeper we need to go
deeper
let's try digging a little deeper maybe
we are in a deep server
is that the diamond noise I bet if I had
a diamond miner I could get through the
bedrock house they're still cold I
killed all the coal ate that's a good
place to find damage
oh that's a good point maybe I should
look by the call
maybe it's by the cult it sounds like a
good idea just follow where diamonds
come from this is brutal
oh okay where's that cold they're
diamonds by that right here
[Music]
it's the big cold opossum there's got to
be some diamond around here
iron they've got everything here
[Music]
dirt
[Music]
as the diamond where's the diamond
[Music]
more redstone no I'm gonna have to make
another pickaxe in a minute
[Music]
[Music]
[Music]
we're running low on stick
[Music]
[Music]
it can't be monsters down here can now I
built this mine with my own hands
[Music]
well it doesn't make sense you came near
BA it's a diamond dinner huh monsters
get into the go
wait is that diamonds it's coal take it
it's almost diamonds why should I sit -
one time can someone give me actual
logic why I should stick to one tone oh
mind everything here damn in a spare
I think we might be out of sticks
therefore we're out of torches and
therefore we can't see and therefore
there's no guy
I don't even remember how to get out of
here no dime in there there diamond tier
no diamond here right : so we have to go
back to the surface and get more
[Music]
come on diamond well there's coal with
his coal there's diamonds found another
coal land and now we don't have any more
pickaxes use the AG this is terrible
this games
terrible I don't know anybody who played
who plays this game I've been digging
for diamond for so long you guys aren't
even trawling i Gogol dance
all right we need an axe somebody stick
that sucks
I don't even know what the Enderdragon
is I'm going to the nether and we're
gonna go hang out there no and then
we're ending this thing because if we
make it to the nether we did everything
we meant to do all right who wants to do
some outdoor crafts let's do some
outdoor crafts first things first I'm
gonna make an axe no longer and I make
an axe I need to make stick first no
longer are we going to chop trees with
an inferior non house and all these
trees are gonna die for my lack of
d'arnot
then it's not what I want to a dirt
Louie's didn't wants to eat and even
want most of that stuff factor oh wow
this is a nice farm actually thanks
creeper did he blow up my crafting table
you did I was just doing some outdoor
crafts you know what I won't make anyone
we've an axe we have a sword give a
shovel
sorry it's stone I'm gonna make a hoe
I'm gonna plant our wheat seeds not a
stick
no I didn't want an axe no put it back
one of the ho that's what I wanted there
we go
does that work
[Music]
[Music]
[Music]
[Music]
all right throw it you know what if it
worked for drama
we'll build a wall
now no creepers can come fuck with me so
many of these things Oh
music what is this turbo build mode I
thought that will have to be removed
from for a night because it was too good
control Q throw everything through
wonder
[Music]
White's my farm okay back to the diamond
mine
Oh diamonds by branch mining oh okay
good I like learning let's learn branch
mining is safer than more reliable than
caving
whoa I don't even know how that makes
sense okay I'm done I don't even know
guys we're gonna do it we're gonna find
Dimond we're gonna go to the nether and
we're gonna we're gonna hit that's it
that's it for the minecraft stream the
sir he went on way too damn long this
was supposed to be over quickly but it's
not because everything in Minecraft
takes forever all right so first off
there's a car door somewhere without
torches let's find it
forget it branch mining because like
this a different branch like a branch of
our division my name's to all cheats
that tell me where the diamond is
look at the memory how rare is this shit
go back up to 11 I heard it's the
optimal lair for diners those lots of
good shit here got gold again iron got
coal up this has gotta be off ways of
diamonds oh yeah it's no way cuz
diamonds just not real
lapiz lazuli
I got doomed I thought it was dying
[Laughter]
these diamonds I'll be nice about a
shovel you can make one
oh don't think I missed some it's may be
possible
coal land
are they more likely to be near other
things no no it's great well that lasted
then I gotta find my way back can you
not is that an actual thing like you
could not turn on diamonds what do you
remember how to go back all these card I
just start to look the same
[Music]
they all just go in circles I wish these
branches have been designed by
see ya - this is the Ramanujan
[Music]
[Music]
[Music]
[Music]
[Music]
okay
138 well that's where I am 6x6 tunnels
what's a 6x6 top
[Music]
[Music]
oh there's a room hey you think it
through them because you're a stupid
thingy and I'm gonna get here
see any diamond everything else
three verse you dedicate more RAM to my
car it's not lagging for me it's only
lighting for you guys oh this is insane
I walked through this whole cave no
diamonds there's more cave
[Music]
great we did okay okay okay okay we're
doing those coordinates after you go get
my stuff back
we got five minutes something I remember
the way back please write and flash not
all my things
okay let's get out of here
no monster can make it through that okay
where are the diamonds 108 eight 121 108
108 a interrogator download that 108 8
121 okay guys
where are diamonds
where are they I'm starting to think
there are no diamonds just trying to
think of the RAM and my computer
glitched I'm starting to think guys that
this is the past and the Diamonds
haven't been made yet that's the only
explanation that makes any sense to me
we must be in the past
otherwise there'd be diamonds but there
aren't any diamonds so therefore if you
found this beautiful cave like this
would be the perfect place for there to
be some diamonds except to heart because
I don't think diamonds are enabled on
this server I'm not even sure really
what that means it doesn't it sound
we've been digging for diamonds now for
an hour we've cheated
and we haven't found diamonds we've dug
forever
not a single diamond was found the only
conclusion is that they don't exist
okay 108 121 108 8 121 108 8 101 not 108
Oh 101 all right yeah we're gonna wait
at 101 let's go sorry it's hard to dig
with this thing on my screen
guys look at that right where you all
said they were oh sweet diamond Oh
beautiful diamond I have dug for days
in hopes to find you I stopped believing
in you and I shouldn't have and for that
I'm sorry
you guys here you lay right
it only took a little bit of cheating
twitch I'm so proud of all of you to
everyone who came through here today to
make what's about to happen possible let
me just throw away some of my stupid
cobblestone control gee how do I throw
this away
how do I throw this away alt Q
[Music]
[Music]
goodbye enjoy the whole today we mine
diamonds for glorious beautiful diamonds
the music is just perfect for this
occasion I'm not even sure how to get
out of here
I'm not sure how I got down here but it
doesn't matter because I have diamonds
and that guy's I think is the end of our
minecraft stream I feel so unbelievably
accomplished even though we cheated
badly well why don't we just do that at
the beginning why don't we just look up
where everything is
[Music]
let me wait no no no no putting the
music back we need the music
we need the music we need the music but
I want to also do this
wait no no no no no go over here go over
here yeah that's right that's right
ah guess we have four diamonds
[Music]
I'm not even sure what you do with
diamonds but we have four of them we get
it together nice food one kick and one
shovel should we go to the nether are we
close to the meta okay guys
you stuck with me this long let's make
my box small and let's go to the nether
if I ever find the way out of here I'm
not sure how easy that is get in here
okay we need ten obsidian how do we
obtain obsidian well this is the one
that we never put torches on there's no
diamond
since fire is this our og as our G
crafting table
should I make a diamond ho oh this one
right all right so fast oh that was dumb
that was so good
all right yo diamond ho never waste your
diamonds on oh that's that's good advice
yes all right
make a bucket do we have it on fire on I
hope we do there we go
how to make bucket
called her
bah dad perfect guys I'm afraid I'm
gonna fall into the lava okay oh look
look at all this weeds tonight we eat
I'll look at all that weed - I know we
walked on the farm and it was terrible
but all right we got water now I know
what this lava it's like up on the hill
right
a little outdoor crafting
we have food now everything is looking
up for us it was on the hill alright
there's like a lava pool is easier to
find at night
I fall in the lava you know what I'm
gonna save the game no no that's weak no
I'm not gonna do that
if we die we die but if we live we live
you need to copy to save you that all
sounds too hard there was lava here
right remember that lava pool
this was the fake cave
what's that bad trading in minecraft oh
there's our old remember that thing well
so maybe it was on that side of the
thing if there's definitely easier ways
to find lava to
you know with this lava you know just go
in my mind i knows love in my mind
should go to the mine gotta mine and
actually I don't know what his lava in
mine
and what is love in the other mine oh
yeah lovak Awards all I love u k-- award
grows yak award bros
she's you know fine at night
okay well we can just go down here I'm
sure there's a lot more down here if
there's not as they're monsters down
here there might be monsters as I seal
this off no nevermind I'll go down
anymore as creepy I saw the lava
make armor with the iron good no my
water but spread like crazy
make a flint and steel again I need it
for the portal oh well let's take this
one step at a time
I see ash is that from lava no I did
that again
now what's down here it's lava not lava
okay wait lava is that what are we
anywhere near there nineteen
guys I'm gonna get lost
oh no that's does the river by my house
okay nineteen we go got water and ghost
was the love I found before I love
cheating bro Oh cheating grows the best
I was right here before
hola I'm scared I'm gonna fall how do I
use water how oh yeah buddy I took it
back
the fuck it's raining
oh I lost my obsidian well that was
rather dumb
I'm out of space
eight enemies
go move
which oh I need to get ten of these
oh shit it's nighttime
yeah go
you got tomorrow you Freddie Freddie
brain oh yeah
okay guys I remember where the lava is
we'll be back tomorrow when the rains up
I'll have a bright new day in Minecraft
where we're gonna go to the nether then
we're gonna shut this shit off cuz then
we're done
whoa good night's sleep gasps what's
that noise
now you go back to the obses back to
them what but be you adapt to my diamond
pickaxe that's right and now I'm gonna
eat some bread cuz we have please do
some outdoor crafts
Oh cooking stream
that's just what I was thinking
directrix 13 more water always useful
she even get my shovel out
okay so here's that the lavas like
somewhere around here
[Music]
negative 19
hear us
[Music]
oh yeah want some bread guys kind of a
mood for some bread
so bud are we doing all we need one more
[Music]
you've got an extra one for good luck
they break it just takes a really long
time
I read that online hey cool
we have 11 leave a granite monument for
how to find lava the monument to lava
that's a much quicker way to go it seems
okay so we're gonna go home oh that
looks nice let's eat it we're gonna go
home
we have our obsidian now we need to make
a flint and steel to ignite the portal
and how do we make the port
well my five let's say oh wait this is
like oh so four by five wait but don't I
need more obsidian for that what do I
not need to do the corners and when you
flint and steel tell which thank you man
we have flint
it seems useful
you only inside inner corners okay okay
we're gonna build it right here y'all
thought I was building that Cabos no
wait I didn't stone - okay perfect
no inside of no corners - we'll go there
we won we'll go that way what minecraft
and nether portal just look at images oh
this one's good yeah here we go
one two three four okay I understand how
it's icsf oh we're doing it right
let me just build a lovely staircase to
my nether portal
Oh construction crew working wait oh I
guess I can do this okay
now for the moment of truth haha we did
boys we did it let's go it didn't work
let's try again
oh yeah alright guys you know what
I have a plan we got to go home we gotta
get something though I love wearing that
there portal as much as the next guy we
do have to go get something hmm one
white wall let's go find some sheep I
think I'm gonna go take a nap in the
medic you know I'm gonna go sleep in the
nether no I think we just make bed don't
look ever since the rain storm we have
this red flood here she pees you she you
know what I have a better idea guys we
don't even need she pees we'll just take
it with us let's go it's not like we'll
be coming back I'm moving into the
nether for good I'm moving into the
nether forever I'll just bring it with
us
perfect
oh wow place seems pretty nice I'm just
gonna bury should explore a little first
and then we're gonna sleep all right
guys good night
it's been it's been a great stream but
uh I'll see you all I'll see you all I'm
going I'm going to sleep I'll see you
all see you all later
what up guys did i forget anything
i don't think so
put chat up here and pick the right mic
yeti stereo let's go boys let's go
all right
um so i watched this video
where did you want to do can i uh
sup let me add an
audio i think i can add audio to do
audio capture from the computer
well you tell me if you think the audio
sucks
so i downloaded this classic beginner's
guide to speedrunning
uh pokemon it's because i watched this
video you ever watched this video
can you beat pokemon blue
with just no there's one where he does
it with a magikarp
this guy this guy's
top video this one
this is a great video
uh you guys should watch it
but we're here to speed run pokemon red
let's go
all right
start new game
oh i have to set all right
because i just spam a oh i need one of
those things that shows my keyboard on
screen
keyboard on screen mac os x
show the on-screen keyboard viewer
ah speed runner
speed runner
no no no no god display
key strokes on screen you guys are gonna
be like
i want this later i want this when
you're programming and now
uh how can i see a visual over there the
shortcut keys
how to show keystrokes on your screen
here we go
key caster
bulbasaur eh
all right is this key caster gonna be
worth it because i want to show you guys
my great key presses
i want to show you guys this is real
this is not i'm not using any uh tas
uh i does that work
shop hype train all right toggle
capturing
here's part of the emulator this sucks
um oh here display all keystrokes
oh here we go in display
don't check display oh this is useful
display only command keys
oh there we go they're down there see
the ws
all right remind myself not to type any
passwords or anything
all right it's l is a
and then how do i set the location
display can i can i
display it over on this side
oh here we go position on screen click
and drag the text oh that's easy
all right
you thank you for subscribing you're
about to see
some leap speed running right here
that i miss press the a key uh
all right let's go all right so i've
seen
pro speed runners they just spam a lot
okay you have to make your name be
something short
new name a start oh yeah yeah i'm really
i'm really getting those
those key presses down you also have to
name your arrival a
because when you name them a it takes
less time
for them to type out
no no you don't do this one in japanese
i'm covering the key oh because i'm
there i understand
you guys got to see my key presses this
is not a task i swear
i'm not a cheater boys i'm gonna really
earn my speedrunner time now
the world record for this category i
believe is one
hour and uh
uh 47 minutes so that's what we're
trying to beat
all right all right so let's let's okay
uh oh shit how do i set my options
maybe it's an option oh i gotta press
a start and then i press a
okay text speed fast battle animation
off i don't know what that does but all
right we're good
all right so here i am we're gonna have
to go out
wait no i have to go to professor oak's
house hang on is this professor oak's
house
well that's not professor oak's house
off we're not doing well already boys
let's go is this professor oak's house
oh yes okay
gramps isn't around can i take a pokemon
oh
okay okay okay okay i've seen this on
pro speed runs before
you just have to go into the grass yes
here we go
oh thanks bros all right i'm gonna rely
on you for help
because i'm not you know we're gonna
we're gonna set the record but i need
all i need all you to help me and like
tell me what to do and shit cuz
um
all right we gotta pick squirtle and
then we're gonna have to do
rng manipulation to pick up the knit
around
but i don't actually know how to uh yeah
you just spam a i know how to do this
all right this is good wow wow your
finger really gets tired speed running
what if i maybe press b
oh which pokemon do i want okay i
pressed one too many a's there that
one's squirtle
yeah oh look i got that on my first try
boys
yeah i want the water pokemon squirtle
all right let's go wait i have to name
my squirtle something not squirtle
yes a
yeah all right good good good i'm glad
with that time save boys
all right um rival tail whip
tackle spam only tail whip a second time
if growled turn one all right i think i
can do this
yeah all right let's go let's check out
our pokemon
all right oh good good good good
all right good good we're in the guide
boys we're in the guide
just in case you don't see the guy go a
fight tail whip yes
okay good we haven't messed up yet oh
yeah i gotta work on my speed of
execution a little bit
alright so we were tackled so now we're
just gonna tackle spam i missed
[Music]
yeah critical hit that's good something
about dvs or something
i've seen i've seen pro speed runners
they talk about dvs
we got we got great dvs on our squirtle
should i check my squirtle dvs
now they don't matter but we do need to
get good dvs on our nitto ran
because we're of course playing the
glitchless classic speed run
where we don't use any scam uh rng
manipulation
because that looks really hard to do to
be honest
that seems pretty good did i get good
dbs boys
all right i'm not spamming a fast enough
all right um during the parcel quest ko1
encounter okay
uh we're on the road up oh that was that
was bad movement that was bad movement
boys
all right
um i wish i could zoom out
can i use a scroll wheel and zoom out
how's my movement
this good movement oh this guy gives you
something free
oh no he doesn't never mind that was
such a waste of time wow we're never
gonna set the record like this
[Music]
all right uh how do i fight the pidgey
can i just tackle them
all right three tackles should take out
the pidgey
okay the early x will get you bubble for
brock good we need bubble
okay we're in viridian city now
um that's the pokemon center we have to
find the mar
yes buy nine poke balls
at the marked
okay we got oak's parcel that's good but
then we also need to
wait why can't i buy things
okay never mind you have to walk back
with stupid oaks thing
[Music]
all right jump the ledges the guy told
me to do it all right good
see how i went there and i didn't
trigger the ledge animation
the ledge animation is actually slightly
slower
than the uh no no no we have to run away
this is a
this is a bad encounter this is killing
my time boys
this is killing my time
all right uh we go back to oak's house
and i give him a stupid parcel right
oh hey how was my old pokemon all right
all right take care all right all right
oh no see i was supposed to stand behind
oak so that would be slightly
faster oh
all right all right i'll take your
stupid pokedex man
where's the timer oh we need a timer
that's a good point
okay well i mean it might be cheating a
little but we're gonna start the timer
now
what do you think
see uh we should have went to the top of
the screen
wait how do i get the pokedex do i have
a pokedex
oh good i have a pokedex okay
all right all right let's start the
timer now
uh uh don't tell anybody i cheated when
this video is on goes on
goes on speed demos archive all right
that's my official timer right now let's
go
valid run i think it's valid right let's
go
no no no no this is an unintended
encounter
we've had two so far pro speed runners
get only 18.
so we're doing better we're doing 16
better
all right all right good movement oh no
okay
oh no the bad movement look look what i
did look what i did
no we don't want a pidgey we do have to
catch a knitter in him now
uh and that's in route 22.
okay
buy nine poke balls at the mark
[Music]
wow
[Music]
okay walk to route 22. do i have a map
i think i didn't get the map
well we're going west of viridian city
i'm on the road
oh i've seen this before i've seen this
patch in in the in the uh
commercials okay
now we don't want rattatas we run away
from rattatas
where'd my keys go
all right we need a knit around need a
random knit around that no
not rattata i think this is only like a
hit bros i think there's only thirty
percent hit
no not a spearow no
no no we don't want spiros boys we don't
want them they're useless
[Music]
oh oh nidoran m i think this is a male
knitter
and okay tackle level three nidoran's
once before throwing balls
[Music]
okay item ball let's go
all right all right we gotta do it hang
on hang on hang on we gotta do our
splits
yeah good split that's a good split what
do you think
all right whoo yeah we got a nickname
a it's a great name yo
name your kid a you know what i mean
all right oh no we were supposed to try
to catch a sphero
we didn't do that that's okay
okay what
get the tree potion here potion oh i see
where to get the tree potion all right
i love when there's map all right let's
go
back to speed running i you guys got to
give me credit for that pause because
that that doesn't count toward my time
right
should have i approached it from the
other side i probably should have
oh i found potion
okay thanks gunner maniac for your sick
map okay
walk this path in the forest
all right
[Music]
i think the viridian forest is north of
viridian city
correct me if i'm wrong and what do i
have to do along the way
pick up the antidote and hidden potion
if squirtle hp under 13 use a potion
before weedle guy let's check my
squirtle hp
watch i don't know it yet
okay i think this is the entrance to the
viridian forest
where's the viridian forest
am i on this map i worry i went the
wrong way
oh maybe this goes to the viridian
forest
oh nice notice how i haven't been
stopping to talk to any of these random
people
[Music]
oh crap no i didn't want to fight that
guy
no i was looks this is why i was
supposed to walk like that oh
wait was i supposed to switch and make
my knit around first
oh god what if i lose to this guy
maybe i should have done a leer first
tail whip good move
yeah yeah yeah
my squirtle's got sick dvds bro i should
check my dinner and dv's
all right we got we gotta think this is
a speed run we got we gotta press more
a's
oh yeah yeah i outspeeded the weedle
perfect
all right oh yeah level seven squirtle
that's right
should we use a potion
what does category have oh yes tackle
that's pretty good attack
does two damage all right back to
spamming egg let's go
as long as doesn't crip with tackle here
i think we got this fight boys
oh yeah look he missed that's right
that's like a that's a one in seven
chance in gen one pokemon
yeah by the way don't listen to
you know i don't know i'm making this
stuff up but if you guys know the truth
uh you guys should tell me oh shit we
should just
i didn't mean to encounter that that guy
but it's gonna make the brock fight
easier boys it's worth it look i already
got bubble look at that that's crazy
that's crazy all right
all right let's not make any more
mistakes no more mistakes
we don't we don't that that cost us that
cost us time that costs us time this is
really this
this is not going to be a gold split
oh wait does this map match the forest
it's a different forest wait no no no
oh we're already up here okay we go this
way
and then here's a yes antidote perfect
all right we walk on here
walk on here oh look at how many few
unintended counters i've been getting
that's good
all right look at these strats boys look
at these strats
my letters are covering my map
this is almost a perfect viridian forest
if i didn't fight that one guy
oh okay one on a 10 in the counter
that's not too bad that's three so far
that's a pretty good rate
all right
oh yeah look i knew to press a there and
i found potion
oh no i was supposed to do the potion
before that
because my squirtle's hp was less than
13.
oh no he's gonna get one more fight
on me oh why'd i fight that guy
all right what do i use all right
weedle guy oh
potion if under 7 hp tail whip 2x
okay we're under yes let's use a potion
oh that's a good move boys oh that was a
good move
19. all right that wasted a turn in this
battle though
this is this is all gonna hurt my my
speed run time
oh we're poisoned what do we do about
that
tackle
all right we're not pressing a fast
enough that's why we're not waiting to
speed run
you got a critical hit man that's only
one in four in this oh come on
does he only have one wheedle
whoa we got 15 special that's pretty
good
no need to save
okay after the fight
swap nidoran and squirtle
potion if squirtle's health is less than
use or toss the antidote why would i
toss it
i guess i don't just scroll through it
oh sweet all right we got a full health
squirt all right let's go
all right uh swap nidoran and squirrel
pokemon switch there oh i got
my movement should be faster in that
menu oh let's go back to my map so i
don't get lost
there's no more map okay i guess they
assumed it was just obvious okay
all right let's go to pewter city that's
at the end of the viridian forest oh
this is i
this this one feels fast boys this run
feels fast
oh i can't heal do i have any more
potions i'm not sure i do
oh no we can't go to the the pokemon
where's the gym
[Music]
looking for the gym here boys who knows
where the gym is
is this the gym no i don't know what
that is
oh good thing that was oh jim all right
we found it all right let's go
all right i don't think we have to fight
that guy let's walk around him
brock all right brock
you ready to lose okay
brock
[Music]
wait geodude heal
if hp under 8.
swap to squirtle then bubble spam
oh is this to get my experience for the
uh
this is true x bought my knitter and bro
okay
okay we're gonna swap to squirtle
and then bubble spin but if onyx uses
bide we tail whip twice
oh sweet
does bubble stay selected
i think we want to swap to knit around
again
because then we want to swap to squirtle
this is just so my nidoran gets
experience
uh pokemon choose a pokemon switch
oh shit he used bide okay we have to
tail whip twice
oh because bide reflects things okay
good move bubble spam
oh beautiful oh this thi i love this
strat guy
the strat guard's the best if i had the
strat guard when i was a kid
all right boom who defeated brock
this guy
all right all right i'll press a faster
all right do i need to do anything
besides press a all right
[Music]
all right good point good point
wow this is i gotta do the bike shop
hack
[Music]
don't fight that guy
[Music]
i know where the mard is let's go to the
mark good movement good movement
all right we gotta think speedlines
peter speeder speed
mark oh look at this movement oh that's
solid movement look at how i got that
one pixel from the mark oh beautiful
um no no first we gotta sell
tm 34 salt yes
cancel buy 12 potions
[Music]
okay that was some b spamming i'm
getting faster already all right
three guys which way is route three
pokemon red map
kanto region map okay good
um route three okay we gotta go we gotta
go east
let's go east
what do i gotta do on route three
um bc one who's bc one do i have to
fight this guy
i don't think so i do never mind
all right this guy must be bc one
okay
you want to lear horn attack two times
we need to use a potion
all right finishing with a tackle
did i not out speed the caterpie
level nine let's check my speed 15 speed
whoo bug catcher's about to use weedle
don't change
okay weedle we wanna lear horn attack
tackle a horn attack potion of under 14.
i'm feeling the speed run spirit right
now
no i didn't want to change pokemon no
oh that cost me so much
boom okay
heal to full hp before short sky
and save the game
who's shorts guy
[Music]
well
do i want to heal both my pokemon or
just my this guide is not clear
is this shorts guy oh shorts guy he
likes his shorts
no no he said he likes shorts look at
his shorts
youngster and he's got a rat all right
cool
all right let's learn and then we'll do
two horn attacks
potion if under
18 hp on wrapped okay
good point
i used quick attack that's so unfair he
has speed
okay
after lear is used the inputs are select
i never press select at all
no
atkins lear
poisons thing that shouldn't do much
because i'm a normal type pokemon yeah
yeah yeah i knew my pokemon
that's right horn attack let's go
poison sting useless perfect okay oh i'm
in red bar
oh this is a good strap boys okay after
using lyra on atkins
switch oh no i didn't mean to do that
okay i messed this up don't worry that's
only a little time loss well we can
recover from that
all right do we want to heal
we also want to save the game
you guys 25 minutes i think we're doing
pretty well on time it's pretty good
we're already at route 3.
uh do i want to heal i think i should
it doesn't say to heal though
[Music]
oh
i think that was a fight i didn't need
to do oh no
why don't they have a map
oh i got a fight alas okay don't worry
i'm using last strategy it's fine
it's fine i read about last strategy
okay fight
we want to press select
okay after lear the inputs are up
select oh good i switched layer with one
attack i didn't even know you could do
that
oh crap
i didn't even need to do this fight
don't worry it'll just it'll just make
it'll make future fights easier
oh i didn't make a mental note of my
things
no
porn attack
[Music]
no
okay see now you see why this was a
useless fight
so i can't get around her i'm not sure i
have to fight that guy do i go down here
[Music]
root three map
pokemon where does the big blue bus go
red can't do route 3.
here we go
um no we don't want to go down there we
want to stay at the top
oh good thing i checked that ah
item potion use
knit around
[Music]
okay we're on bug catcher three now
he's gonna have a caterpie and a metabol
metapod
we just need to i just need to press a
harder than i've pressed a ever in my
life right let's go
let's go let's go let's go hey
i'm still pressing a guys
i did an extra last fight i heard this
was actually a strategy so we're just
going to call it a strategy
oh oh my god i pressed b there oh that's
the right move i don't have to scroll
down i can just press b
i don't care about your defense kakuna i
got horn attack
[Music]
no i shouldn't press no there that was
an extra frame i didn't need
wait i thought he would have a metapod
or something is this not bug catcher
three
did i not do bug catcher three skip
i even checked the map
this is bug catcher two
that's okay uh oh
i was not supposed to use all horn
attacks i was supposed to switch
okay we can switch now
because i have to save my pp of horn
attack
extra last in route 3 new meta i agree
all right
[Music]
all right catch a three this guy's got a
caterpie in a metapod
we just need to uh
okay if we have under four horn attacks
left how many one attacks do i have left
oh i probably used a lot upon that last
not under four
i love that this guide is so thorough
oh this isn't good though i'm gonna run
out of horn attacks i need to
use a level i need to use horn attack on
a level three pidgey to weaken
i didn't need to go down there i should
just press b
we'll save one horn attack for the
pidgey
oh it doesn't take forever because it's
gonna harden
[Music]
all right i'm not pressing any fast
enough i get it
[Music]
okay i think there's a pidgey in this
grass don't
trigger that trainer
we need a bird so we could teach a fly
all right we're gonna tackle the sphero
and then we're gonna throw balls at it
i didn't even need my one attack missed
oh yeah yeah i've heard one way to get
better at speedrunning is to battle
other people
we'll name them a
okay use the pokemon center to heal
before entering mount moon
all right good movement good movement
good movement
this pokemon center up here
[Music]
there's the entrance to mount moon all
right
heel oh you walk straight forward in
pokemon centers and then you spam a
okay pick up
tm12 all right we got a map
okay perfect wait
this doesn't look right how come oh
what
enter mount moon from over here
pick up tm12 all right gotta do the
movements
just right
okay so what am i supposed to do if you
see a paris catch it run from all the
encounters
oh that was good movement that was i
moved to run really fast
just hold b for a secure catch that's a
myth right boys
walk and fight the super nerd as
indicated below
oh i could speed around this game so
fast without this text know how many
encounters i'm getting in mount moon
right now
there's an insane number of encounters
i haven't even found a paris
oh my movement was not perfectly
matching the map right there
oh it's a paris okay level
horn attacked weekend unless i had nitto
kings and nidorinos which i don't have
perfect perfect oh this is this is great
man this is great let's throw my balls
at
all right i feel accomplished i feel
like i checked a box i call
paris no it didn't say to buy any repels
you don't get repels from mount moon but
you do get them for other things
we're gonna name my paris a
no
man i should have done that rng minute
bros
you can do rng minute for zero encounter
mount moon
all right super nerd you're going down
okay we want to do two horn attacks and
a poison sting all right one attack
let's go
spam a
okay a up down a oh look at that
movement look at that movement that was
good movement all right
voltorb we want to do now does it stay
pointing to poison sting oh
look at how i used b there and i didn't
use the extra key of pressing down
all right two horn attacks and a poison
sting let's go
yeah yeah keep using screech bro
got him
didn't even need that poison sting
that's because i used the
l extra lass you know
you know people think i was a noob and
did it wrong but
oh shit this map looks confusing
all right no no there i am at that guy
so we're going to go this way
this way this way this way and here's a
ball all right
i found a rare candy pick up the rare
candy take a step right over top
and bonk into the escape
row from the left hand side for lag
reduction good point
[Music]
all right cool good good good good lag
reduction all right cool
that was that was that was good movement
um
that noise doesn't sound good
all right where are we oh here here we
are on the map all right sweet
all right yeah okay okay okay
all right we gotta fight this this this
lass she has a level 11 oddish and a
bell sprout i know
i got the perfect strategy against her
we're just gonna spam a let's go let's
go
let's go yo can i just hold a
you can't hold a lesson learned
that would be cheating that's too much
that's like a task you know
you can't just you can't you can't just
uh
yeah i've learned that all you gotta do
is horn attack a lot
all right good good good take this last
teach wait what no i did not want to
switch pokemon
i had to spam b for that
teach water gun on the blue tile
i think i spam a for this right not b
because b would make him not be uh a
nidorino
we need a nidorino yeah nidorino perfect
how do you get out of here you didn't
have a map lass
i went on google docs and got a map
oh did you see that movement how i
avoided that trainer encounter
okay wait i have to teach water gun do i
have a tm for this
how did i get tm12 does anyone know how
i got tm12
[Music]
okay teach it to nidorino and slot 3
over leer
okay good good good perfect perfect
i love this strat all right cool let's
go
just a kid man i got water gun
oh i know what we do we just spam a i
know the strap
it's the spam a strat no oh no i didn't
want to spam a there i just spam b
for that now back to spamming yeah okay
watch i'm gonna get it right this time
okay we spam a all right now we spam b
now we go back to spamming a oh this is
some speed running
shit okay
okay we go up here we get the moonstone
now we take the ladder sick moves bro
[Music]
evolve to nitto king on the blue tile
before rocket
slot six use moonstone what do you mean
slot six
[Music]
this random encounter rates crazy
no that was bad movement you all saw my
bad movement there's no hiding from it
oh that run was like frame perfect that
was like frame perfect bros
oh yeah okay my movement didn't exactly
match the map but i don't think it
matters
[Music]
evolve to nitto king on this square
okay it's slot six oh that's what you
mean by slot six okay
moonstone let's go should i use my rare
candy
it would tell me to use the rare candy
if it wanted red candy
okay we gotta we got to edit those out
like every time i pause the game
that doesn't count for my speed run time
right
oh that's definitely a split man i gotta
i gotta do a split oh sweet
bro we're at 37 minutes this is this is
this is on track
for for a world record run i think i
mean think about it
the world records like one hour and 47
minutes and like
there's no way that like i can be that
far from the end right
i think we're doing pretty good i think
this is i think this world record pace
all right foreign attack perfect okay
we're horn attack and we poison this
thing and then we
horn attack i know that strat it's the
spam a strat
poison sting quick attack he outspeeds
me man
okay this is the spam b strat
okay now we gotta be a little careful
here because it's a up a
down spam a oh that's that's that's
once once i got it figured out we're
good we're good yeah that's right
supersonic failed i outspeed that zubat
with my level 17 nitto king
oh yeah crap
all right oh we're done with the map how
do i get out of here
wait how do i get out of here
there's no more map i'm lost
oh yeah no i know this part yo wait wait
which fossil do we pick
does it matter why doesn't it tell me
involved in you know king before the
moon rocket slot five use moonstone
i knew it was in slot five all right we
gotta get the helix fossil
all right
we're gonna battle this guy this is a
super nerd
all right i know what to do spam a i
know this track
all right watch this this is gonna be
this is gonna be frame perfect boys
spam a i don't actually need to use horn
attack here but you know whatever we'll
use it again
doesn't matter all right i know the spam
a strat all right now we spam b
spam b spam b
spam a go back to spamming a born attack
oh good good good
good i feel good about this pace
okay oh no i used one attack again i
used 120 horn attacks
oh all right this is the spam b part
it's okay it's okay we'll recover
we'll recover all right coughing's
pretty good all right we got one attack
on him that's a good point
ah two horn attacks can finish him off
anyway
uh all right let's just use poison sting
come on kill him kill him kill him kill
him oh i didn't kill him crap
oh that was bad oh we got red bar now
though red bar is great i've heard red
bar
is is is okay we're good we're good
we're good
okay
is this the helix fossil i do want the
helix fossil
all right let's get out of mount moon
boys all right this is definitely a
split
all right you can take the dome fossil
or whatever else it is i remember i
remember that crap from twitch list
pokemon
yeah let's go all right let's get out of
mount moon
[Music]
oh sick all right that's definitely a
split let's go
oh yeah all right all right we're on 41
minute pace after mount moon can someone
tell me what a pro
pro players pace is are we on world
record pace here i i don't know
oh hidden rare candy shit where am i in
this map
where's the mount moon exit
um
where am i i think i'm over here
yeah okay okay okay hidden real candy is
here
[Music]
i like when they tell i like when they
tell me exactly where to walk
they can't expect me to figure all this
out by myself
go to that pokemon center i think
[Music]
okay go to this pokemon center and heal
in order to sell i know this strat is a
spammy strap
world record split is 24 minutes oh we
got to pick up the pace man
we got only we got to make up uh what do
we got to make up
we're about 17 minutes it's okay we're
getting faster i feel it's improving
we're getting better at the spam a strat
all right we got to pick up the hidden
rare candy behind the pokemon center
how do i get there i gotta go through
that door maybe
i found a rare candy sweet
all right um pick up a hidden rare candy
then head to nugget bridge
which is nugget bridge how do i get to
nugget bridge let's check the map
big map there's nugget bridge on this
map
damn it where's nugget bridge can
someone help me out here
where's where's uh where's where's
nugget bridge
this looks like a bridge oh perfect okay
i met my rival sweet
if you get hit by only one sand attack
ko
pidgeotto
[Music]
all right i know this strat it's the
spammy's draw let's go
all right if you have only one sand
attack
no sand attack that's just a gust quick
attack and i don't speed you every time
oh you can't crit that's not good
okay three horn attacks done
this is the spam b part of strat
this is the spam a part of the strat all
right this is this is how we're going to
make up the 17 minutes
oh it's because we did the extra last
this fight's easy
i think this is a better i think i think
i found a better meta
okay my mount moon pace wasn't great i
mean we got to be honest with ourselves
here
what if you have to go to the bathroom
during a world record run what do you do
all right do we keep going this way
all right i think we just have to fight
these guys
[Music]
i know the strat it's the spam ace jack
we can't totally spam any we gotta
switch to poison sting to save pee pee
oh no i used water gun oh
wait they don't know about the water gun
strap the water gun's a great strap
shit what have i needed those water
dumpies
all right trainer two is alas we're
gonna pidgey we're gonna horn attack and
then poison sting let's go
for under 12 hp we got to watch our hp
nah but if we're in red bar i hear
things are faster
i'm spamming b this is the spam b part
of the strat
i a horn attack oh do you see how i got
the switch right that time
all right oh crap all right sweet i got
a crit oh that's making up time
all right trainer three let's go
we're at level 21 after the youngster
all right let's go
crap oh that's sick oh we're making up
so much time on bridge boys
this is a world record bridge oh no no
no that was a b spam
oh you know you can't get too excited
man you get too excited you spam
a when you're supposed to spam b
crap
all right all right all right all right
all right we're in red bar now red bar
is great
beautiful beautiful we're at level 21
this is great okay
use the two rare candies on nitto
slot three good good thing we knew that
all right good level 22
that's 60 these boys sick dvs
all right level 23.
i was trying to learn thrash teach
thrash over tackle slot 2.
good potion optimization strats that's a
good point that's a good point
oh i can't just spam a anymore i have to
change attacks
okay a down spam a
oh sick bro one hit ko
this is the b spamming part now it's the
a spamming part
oh whoa i just got a double thrash oh
this is great i love
thrash thrash my new favorite attack
oh yeah you lost that's right you lost
all right trainer five let's go
oh he's number five he's self-aware i
hate trainer five
i'm so excited she trashes manky
all right
a down a spam a
oh god i'm one hit ko all right we're
gonna fight bridge rocket
bridge rocket let's go i got a nugget
would i like to join team rocket i mean
kind of
do i get a choice oh what kind of rpg
is this
i don't like that i can't just spam a
anymore i have to press
a down and then spam a but there has to
be a reason that horn attack stays is
the top one
this is a b spamming part of the strat
this is an a spamming part of the strat
i don't have to spam anything there spam
a
all right how's my bridge split
50 uh sick bridge split
um crap okay
bottom hiker
where is this guy that guy all right go
to the bridge
okay we gotta do that bottom hiker
checking the map
always worth it you don't want to make
you don't want to make mistakes boys
you make mistakes they cost you you know
you know why i'm behind world record
pace
because i fought that extra last what's
the strat here
wg what's wg
a water gun all right let's go i know
water gun i think that's
a and then two down hey down down
hey
do not fight the two tile vision hiker
what i feel like this is an extra fight
oh stupid
i did not need to fight this youngster
let's just take him out with a thrash
thrashing am i going to be confused now
all right we got red bar red bar red bar
is great
we got red bar this actually makes our
whole run faster don't worry
don't worry about that extra youngster
fight don't worry about it
um we do have to fight this last damn it
that's the hiker we don't fight
yeah i see the yellow squares oh my god
don't worry i won't mess this up
i see what i messed up but
uh oh i'm red bars are risky strap boys
oh but i got that red bar all right cool
all right
wait
red bar is a risky strat
a down spam a oh no
we're really deep in the red bar now
boys we got a one hit k all
these things this is a b
spamming part this is an a spamming part
all right sweet take him out
all right if oddish i don't know what
oddish can use does others have quick
attack
that's the last lass i should have
walked right next to her so we wouldn't
have to play that
walking animation
one hit ko
one hit ko
one hit ko i love thrash
look at this look at how we're using red
bar you guys should look up red bar it's
a six strat
all right we gotta get the ss ticket
from bill is bill in here
oh this is bill he like turned himself
into some bullshit
yeah thanks bill
i'll help you out yeah i got you i got
it i got yay
i got it yeah i'll help you bill i got
you boy
those goals gold's gold golds go
what do you mean take the center we
playing chess
take the center and go straight to
misty's gym
that was an extra all right you owe me
one yeah yeah
you didn't know but i came to get an ss
ticket all right thank you
oh i think i spam too many s uh okay
item
escape rope use
take the center and go straight to
misty's gym
okay um
off damage
[Music]
is that the trainer no i think i could
have avoided that one
damn it
i don't think we had to heal i didn't
want to heal it didn't say to heal
no this is no no i'm done i'm done i'm
done oh this is killing my run
this is killing my run this is an extra
trainer i didn't have to fight again
all right no
okay that was an extra trainer i didn't
have to fight i do have to fight this
trainer though
guys we're using the red bar strap don't
worry about healing okay we have red bar
yes thank you
okay save the game before misty
that's pretty good one one hour pace for
misty what what's the misti split
oh let's use a potion potions aren't
even that like useful anymore
here's another potion that i need them
for something
starmie will outspeed you
why isn't thrash my top attack
stormy damage rolls depend on special tv
okay we're gonna switch put thrash here
no i just want attack no
oh
okay let's hope i got them good speed
dvs
don't outspeed me starmie
[Music]
i'm dead shit
oh no i don't think these other pokemon
are any good
tackle
yo
i should you i should be using tail
let's take out starmie's defense
x defend
oh this is the worst misty split boys
this is the worst misty split
come on other pokemon
pack done
done all right if you have to reset you
can soft reset with a b
select and start a b select start
okay
oh we were supposed to heal oh i get it
okay we're supposed to heal here to full
health we didn't follow the instructions
we didn't follow the simple guide boys
we even outspeeded stormy but it beat me
all right we healed to full health good
move oh why don't i do that before the
misty fight last time
uh we lost so much time on that strat
and we did that horn attack initially
we're gonna switch thrash to the top
attack
i don't know how to do that never mind
thought we were gonna do that or not
the dying strat is sub-optimal yeah i
know
okay that's right i get a cascade badge
is that the one misty gives you yeah
cascade badge
oh
tm11 all right
teach bubble beam
[Music]
over
poison stone
oh no that was slow that was slow
okay turns out you can only switch those
things during battle alright cool
um potion if you're under 13 hp
no uh
okay surge
how do we get to search
okay where am i right now misty is in
celadon city right
or cerulean city that's bill's tunnel
where is
surge in saffron city
god i should have watched more show
vermilion
city eh oh it's all the way down there
how do i get there
oh all right this doesn't count at 5p
during my speed run but it doesn't count
yeah the bathroom breaks that's unfair
you know
so how do i get to search
uh is there isn't there an underground
tunnel or something i kind of remember
from like being eight and playing this
game
[Music]
is this a tunnel what's a bicycle oh yo
i know it's like
i know a sick hack here okay you go here
and then you don't have a bike voucher
wait but how do you do this south of
cerulean city
all right never mind this is a glitch in
this one
all right south
okay search
what's that
okay we gotta find the underground path
where is this path
because of all bitcoin all right
wait did i have to teach something
caught
where's the underground path
right here
another gate surrounding san francisco
this is so useless
it's just a picture of a path location
of the underground path in canto
the building to the top right of the gym
okay i remember where the gym is i think
okay go through there
[Music]
how do i get there
to here
this one
[Music]
oh yeah sweet that looks like a tunnel
wait no no am i supposed to fight this
battle
is this dig rocket
do you see alright so we don't know what
to do we got a thrash
okay select
select yes now we can spam a
that was the slowest part of the speed
run boys that was the slowest part of
the speed run
i was on like really good pace until
then i
i didn't know about the um
all right tm 23 thank you
okay
wait where's this path
this is useless was this underground
path
the building top right of gym all the
way south okay
oh go here look on the other side of
this
all right sick
this
sweet
wait i have to find the hidden full
restore all right
thanks gunner maniac wait why are there
two
is that rng
where's this hidden full restore oh it's
over there
i don't even get it
hidden full restore
pokemon red
floor store is found two tiles to the
left
of the top stairs in the underground
path
man this is hard this game's getting
harder
how come i can't get it did i already
get it
we have to face that square
ah you gotta face the square
all right pick up the hidden full resort
we don't need the x special it's useless
to be looking at the space not on the
space this game is so hard boys
okay to avoid butter
all right all right we got a map
oh that was close oh that was close good
move though good move
all right junior trainer f i know the
strat
it's a spam a
we got a mate here
i feel like the speed one's just getting
intense
this is the spam b part of the strat
this is the spam a
quick attack
i don't think new zero could beat it
they would have to learn how to read
this this guide
i don't know why sometimes you guys
can't see what i'm spamming at
you know it's kind of fitting because my
name is a
this is a spamming b part of the strat
this is a spamming a
part of the strat i really i really lost
a lot of time in that uh
okay let's get on the boat
fight the gentleman in this room here
where's the boat
how do i get to the boat
okay the boat's probably by water
yeah of course i played this as a kid do
you remember how do you remember this
welcome to the ssn yes actually i do
have a ticket thank you very much
i'm welcome here okay
so we have to go to this room here
um i don't even know what i gotta go
downstairs
more upstairs this is the rooms
two three four
i'm like the count all right let's fight
this trainer
what does he have
growlithe and ponyta we know the strat
for this oh the gentleman oh he's a
gentleman
oh yes
fancy yacht party on the ssn oh how
beautiful
okay
oh no no
i didn't follow the instructions
oh this is an extra fight
there's a reason they gave me that
careful map
ah how many viewers we got
what's a few
more than 12 340.
oh you guys like when i program better
than when i speed run
i have to get a new audience that speed
runs
all right um how do i get to ssn rival
is it over here
[Music]
sweet
wait i'm not supposed to use thrash here
so
perfect i outspeeded that pidgeotto
all right this is a b part of the strat
this is an a
part of the strat
be part of the strat
a down go
bad frames my two thrashes on the
ivysaur
really leaf seed
i don't even need the full restore i'm
just gonna sell it
to buy repels
all right talk to the captain
get hm1 that's where i get caught right
[Music]
assume i get off the boat the same i got
on the boat
[Music]
no this isn't right not no no no
[Music]
six feet around boys six speed run all
right bolt leaves
okay then leave the boat all right so we
gotta go to vermilion
city sell all pokeballs
is thingy
i sell pokeball
how did i buy them and then sell them
because they didn't know how lucky i get
with pokeballs that's wise
all right full restore yeah
um by
three repels
wow i'm so rich why did i need to pick
up that full restore that was a huge
waste of time
probably gonna have to buy like x
calciums or something right we don't
need
any uh cop menu pokemon
item hmo one use
teach it to paris
teach tm 28
digs a tm
paris come on dig
cut the tree and enter serge's gym okay
pokemon
paris cut
[Music]
all right check the cans in this order
until you get the first one
bottom left
bottom middle oh i did it wrong
bottom left
[Music]
oh shit this is an extra fight isn't it
okay
okay let's not do this wrong again okay
bottom left
bottom middle
this is middle left
[Music]
okay there's a guide to help me with
this
okay guide to surges cans
only red cans can be the first can
[Music]
all right cool
found it now try this one
sweet ah okay good good good time on
surges cans that's pretty good
you guys pretty good time actually
all right um serge which sounds like
we're going to thrash the shit out of
them
this is the a spamming guy
[Music]
gonna be the fastest surge ever watch
this
doesn't matter how good of a speedrunner
you are nobody could do that faster
where do i get the bike voucher can you
guys help me out
where do i get the bike voucher
is it in that trash can
[Music]
is it here where do i get the bike
voucher the house left of pokey center
okay
thank you
[Music]
i'm trusting your intelligence dude
the pokey center is it this house
[Music]
what are these people doing you have a
bike voucher
oh i want to hear his story i want to
hear his story definitely
oh i should always listen to some old
guys stories yeah please tell me about
your stupid rapid ash oh i love
rapidashes too
yup the rapidashes are amazing they're
cuddly they're like my little pony oh
you kept me too long
i'll listen to you yeah thanks to the
bike voucher cool let's get the fuck out
of here
are we in cerulean city sick
all right i know where you turn in the
bike voucher and it's in the bike shop
which is right here
oh you couldn't have imagined that
there's no way to do that faster
oh that was great timing oh yeah that
dig
i don't even know how dig works but good
thing i listened and like did it all
right all right cool
swap slot one potions with bike
no i didn't want to get on the bicycle
select i got off the bicycle
select oh i really got to work on my
movement here how do i do that
select oh and then like this
sweet all right um
teach tm 24
thunderbolt over water gun
get on the bike to head east to route 9.
thank you for telling me which direction
to go
let's check the map quickly quick map
right here on pinterest i went cerulean
city we're taking route 9 we're going to
rock tunnel all right let's go
you already beat that gym
wait how do i get to route 9 it doesn't
really tell me
east east east
[Music]
oh i have to cut the trees at the bottom
i think they're down at the bottom are
they not
here we go oh that was that was bad
movement
pokemon this guy cut let's go
oh east sweet i got it
all right um safety for this fight
four turn thrash girl
all right junior trainer f today is not
your day
tomorrow won't be your day either but
today
definitely won't be your day i know spam
a strat
and then i'm gonna spam b after i kill
your oddish
that's right
and then i'm gonna go back to spamming a
i'm gonna horn attack your final bell
spread after i'm done with my triple
thrash
[Music]
i'm confused
that's not worth it whatever it is
whatever in that ball it's not worth it
all right this is the other junior
trainer bug catcher yeah good
bugs are for losers bro i don't know
what to do against bennett
oh i guess it's just gonna auto thrash
get ready for a thunderbolt my brand new
attack
[Music]
i still want a bicycle
oh that movement could have been better
should i go to this pokemon center it
didn't say to don't do it
[Music]
rock tunnel is your first repel one step
into rock tunnel
oh no do not have a flashlight or
something
okay oh shit
i needed a flashlight
this is the worst map ever where did i
come in
oh i came in that ladder
okay pokemon fight ready go i how do i
fight this person
all right we got a bb and then a tv all
right let's go
what's up better welcome we're
speedrunning pokemon
oh yeah is this blind rock tunnel or
what
um all right a goes to a
what do i do in this fight tv
of course it's water pokemon i should
know this
okay and then we wanna thrash
we don't need to save
the guide wouldn't tell me to say if i
didn't need to save trust the guy
trust the plan you're allowed to say
trust the flame
you will fight me oh why thank you i
will fight you too
yeah i'm a speed runner
we thrash in this fight let's go
oh sometimes ashes are terrible right
here
that was almost perfect movement just
look i used to repel at exactly the
right time
okay b goes to b
[Music]
c goes to c
[Music]
repels effect didn't wear off yet oh now
it has
it's a thrash fight no it's a bb fight
fight down down down i should just press
up
click on that faster the spamming part
so
okay we're back in d here's d
all the way over here down over
down over
down over challenge that trainer
what do i do in this fight
thrash this is a spamming fight
no no pp left
i have to start thinking for myself i
don't like this
oh i poorly timed my uh
if you change battle style it won't ask
you to switch pokemon
oh man you're smart no i'm absorb
oh shit okay i have para's heel
yo huge time loss yo
you are a speed runner expert thank you
fuck offish
oh i should have probably changed
pokemon to
hey
i gotta change battle styles
[Music]
set good point bro
you are pro speed runner you should be
speedrunning this game and not me
all right let's go how do i get the bush
where's his bush
there's the exit there's the bush
not ever going back in rock tunnel again
all right good we gotta eat there
potion before this flight under
okay i had to do that fight
bubble beam uh when was i supposed to
heal
i can't believe i'm still paralyzed
onyx hiker
what's going on here
this was an extra fight i don't exactly
understand why
oh man that made things so much faster
now that i don't have to switch pokemon
oh you're an expert speedrunner bro
all right does this is this guy gambler
or am i just not going the right way
gambler gambler hiker why am i fighting
these stupid hikers
still paralyzed
i didn't go the right way
all right let's check the map
oh that this was the biggest time loss
so far
finding these stupid hikers oh i
could've just went around them that way
i should have checked the map
do i have to dig again though that's the
problem like
i can't thrash anymore it didn't tell me
to go to the pokey center
all right fine i'll fight the stupid
gambler this is gambler
all right gambler
pokey maniac
i didn't even have to fight this guy
either
bubble beam bone club
crap
the water type no
oh no i'm confused
that's probably dumb
porn attack come on come on come on come
on die die
die yes all right i don't know why i
fought all these extra fights
where is my supposed to go i should have
checked the map
better and then bike straight down
oh my god i didn't have to do this one
i'm just gonna went around like that
oh and there's the pokey center oh what
a waste okay
big time loss big time loss outside rock
tunnel
don't forget it don't forget the big
time loss outside rock tunnel
if i have to dig again to get back to
celadon city i'm in trouble
because it didn't tell me
okay underground path to sell it on city
where's the celadon city path
what city is this sell it on city take
the
underground path
selling on city underground path
we're so lost boys we're so lost
okay it's it's west
oh that's where it is okay
where's that gambler let's get on the
bicycle
so much time loss how can i ever forgive
myself
the speed running gods must hate me
okay i think that was not
[Music]
you know lavender town right now the
underground path is west okay
oh i can't believe my battle mode was
wrong this whole time
oh okay let's use cot there so we can
avoid those trainer fights
i think i fought this last instead of uh
no
stupid encounter
that wasted time
all right we're back on speed run we got
we got we gotta we're not we're not i'm
not thinking fourth dimensionally here
no
i didn't even see that guy
oh
super nerd i don't want to fight you can
i run
i did so many extra trainers at least
the elite four is gonna be super easy
oh my nose itches
oh come on die
we're gonna get bubble beamed
i shouldn't used up all my thrash pp
there could have killed him with a
bubble beam
all right there's hidden shit in this
one too okay we're gonna be better about
the hidden shit this time
hey how come i can't ride my bike in the
tunnel what is this walmart
with that elixir
got it
i can ride the bike
good point
all right we're in celadon city let's go
oh the cellar is a supermart i love the
celadon mart
it's my favorite mart i used to go here
as a child
brings back such good memories how do i
get there though
[Music]
you know my mom just used to drive me
here in her car
no i didn't skip the ssa and i did the
ssn we're way past that boys we're in
like you know
okay it's not world record pace but it's
pretty good record pace man
oh is this the salad on city mart
am i in the right building clerk on the
left hand side
i don't think we're in the right
building
he would say mart if it was a mart we're
in the wrong mark
there's the mart oh man this is the
nicest mart
i'm not good at stairs that doesn't even
make any sense how do i end up over
there i clerk on the left-hand side
buy 10 super repels
by two revives
do i have to walk up to the sixth floor
is there an elevator
i feel like there's an elevator
elevator this is an elevator thank you
is the elevator fast
how come i can't go to the sixth floor
my 14 x accuracies
this is a lot of money i'm about to drop
on these x accuracies they better be
worth it
do not buy guard spec must be an x
special
7x speeds
[Music]
oh i got to do something with ghosts to
get a pokey flute so i can wake up the
snorlax right yeah i watch this tv show
i know what's up
all right and we gotta buy it's in these
vending machines isn't it
great japan i love japan
oh my god this okay great thank you
vending machine
gotta buy a soda pop give both drinks to
the girl in exchange for
buy a second fresh water after training
this girl looks like an idiot i'm
thirsty
yeah of course i got a fresh water for
you fresh water oh you're going to give
me a tm
wow that's a great deal man sure i could
give people i knew she was an idiot i
wish i could give people tms in real
life you still want something to drink i
got you here's a soda pop yeah give me
the tm thank you
[Music]
george you demeaned the rpc people
the npc's all right
can i take the elevator no the elevator
doesn't come to this floor i'm just
taking the stairs
bad movement bad movement is this a
speed run or what
oh
all right let's go okay bike west
[Music]
cut down the bush before the snorlax
is this the bush before the snorlax
yeah okay cool and continue heading west
i'll have to get hmo2 from the girl in
the house above cycling road
oh that must be cycling road is there a
girl in here
yeah i found your secret retreat i won't
tell you yeah give me a hm that's right
all right open the menu and do the
following
swap slot 3 useless ss ticket
with super rappel
down two to teach hmo2
to bird
good thing i caught that bird
ops 3 swap
x accuracy with helix fossil
fly to celadon
[Music]
no i flew to pallet town oh that was
dumb
why would i ever want to go to pallet
town this place
sucks i grew up here
[Music]
all right uh fly to saladon
take the center if under about 35 hp
now we got beast levels of hp and then
bike to the game corner where's the game
corner they need to include more maps
i hear this game corner is run by team
rocket actually
is this the game corner just the game
what is this
celedon mansion where's the game corner
march more
tractor where's the game corner boys
no it's like it's a big building right
so one of those buildings
[Music]
it can't be one of these little ship
buildings
celedon city map
red
where's the rocket game corner
no i wouldn't recommend this map because
you don't tell me what these things are
which is the rocket game corner
is this the rocket game corner
is there's those game machines no
[Music]
is this a game corner
this is right in the water in the middle
of the city
i see the water you want to go to the
water
oh right of the water oh in the middle
of the city you know i it's been a while
since i've been to celadon to be honest
no i'm not flying again i'm gonna end up
in pallet town
okay we had to cut no i don't think we
had to cut oh is this it
beautiful with a rocket game corner all
right let's go
okay talk to the grunt standing at the
poster
yeah i know about you i hear this post
right here this is a secret hideout for
team rocket
yeah oh
man
wow we wasted a lot of time there this
plate is not good
at least we saved a lot of time by
switching our battle style
we used to have to spam b we just have
to switch that was really stressful
oh this game is mostly just spamming a
yeah yeah go tell your boss that's right
i'm pressing the switch behind the
poster
take the stairs to the right walk down
and left
to avoid the rocket
take the stairs down again
okay i didn't need this
these the stairs i don't think these are
the stairs
[Music]
where are the you see any stairs
oh take the stairs to the right damn it
we needed two stairs
oh you gotta read the instructions so
carefully
walk down and left to avoid the rocket
okay yeah we
avoided the rocket all right good
take the stairs down again take the
spinning tile on the left
assume they mean this one
i remember trying to get past this in
twitch place pokemon it was like
impossible
um
i'm dumber than twitch plays pokemon i
have to get to those stairs
this game's so hard
i don't get it what'd i do wrong follow
the path like i know the path
i need more maps
oh my god 50 50.
this one
50 50 could be guessed right good i
don't
fight that rocket take the stairs down
walk toward the grunt on the top left
and fight him
got you who is the lift key this guy is
a lift key
i picked up an extra escape rope oh that
was useless
all right good take that coughing
oh this feels so slow this just doesn't
feel fast
just talk to the grunt you drop the lift
key oh you dropped it oh that's cool
i pick up the rare candy
no more room for items
tm02 i didn't even want that one
um
no i don't want hp up where's the rare
candy
they need maps
where is this
the elevator where's the elevator
my rocket game corner really needs some
improvement we got we got to go drill
rocket game corner
where's this elevator
it would make sense that the guy was the
lift key is near the elevator right
okay fine we have to go back upstairs
why don't they just why don't they just
say go back upstairs
okay what's this
rare candy okay okay we're on the right
track we have to find tm07
i don't have tm07 do we
useless hp up
tm07 tm07 tm07 tm07
no i don't want to fight that guy i
don't think i have to no
no
bottom right can i miss it is it on this
level
fight the stupid guy
bottom right of top floor okay i really
gotta work on my rocket game corner
on rocky game corner this week i lost
guys we were a world record pace before
this
this is this was world record pace until
until we messed up you know
you know world record like there was
there was not
you couldn't even done better is it this
floor or is it a different floor
is this where the tm is is that it up
there
or is it that down there
is this tm07 tm07
moonstone the hell am i gonna do with a
moonstone
toss it
okay bottom right
is it this one
tm07 okay sweet how was i possibly
supposed to know to do that
how do i get out of here now
tm07 better have been worth that oh shit
don't need that
this is not how i get out of here reset
redo game corner
if i saved at a reasonable time i'd be
up to do that but i don't remember the
last time i saved
this was a terrible rocket game corner
how do i get out of here tm07 was not
worth it
[Music]
no no okay that's fine
wait i don't even think am i even near
the elevator
where's the elevator down there the
elevator's down there ugh
worst rocket game corner ever
can't even spam a to make this faster
okay
i know this is the worst split oh i
can't even blame rng
you know
like a pro speed runner
okay menu before the grunts
take the elevator
to b4f
okay
[Music]
swap slot
done with tm 48
down 8 teach tm07 horn
over slot one horn attack
i moved my horn attack out of slot one
though
they really wanted you to keep thrash oh
i see why they wanted you to keep thrash
okay
well we can't just use the map for
everything boys that's just cheating
okay
right grunch okay
item exact
just rap
tv
hello luca how many viewers we got
how we doing for this epic run
of pokemon red
316 sweet not as popular as programming
but pretty popular
one hit ko hell yeah i don't know why it
said that
doesn't say that normally
let's go left grunt
yeah i ruin your plans in mount moon
that's right
bubble beam
item x accuracy
thunderbolt
finish it with a warn drill
no need to yield because i fought way
too many extra trainers
all right giovanni let's go
all right this is this is this is
feeling like a speed run again
bubble beam
spam a
one drill
that's right that's right i do
understand that's right get out of here
and give me a
let's go all right we get this let's go
dig out
pokemon not this one dig
let's go fly to lavender town and walk
into the tower okay
i'll fly to
lavender town
i'm already out lavender town walk into
the tower
oh wow that was an optimization
all right lavender rival
how do i get to lavender rival
[Music]
it's gonna be steps this thing's a tower
right
oh yeah it's my rival all right let's go
all right tbtv bb thrash thrash let's go
this is feeling like a speed run now
boys this is feeling like a speed
[Music]
oh no i moved my
and now i'm confused oh that was a big
mistake
i'm not confused the confusion did do a
lot of damage
all right sweet
hmm
[Music]
do
oh this is the channel you can't get
past with a magikarp i know this
channeler
[Music]
this is the channel where you can't get
past
there's a hidden elixir
is it
i don't even know this is the right
level
so
just an elixir okay sweet
[Music]
right there
wait it is there
that one you have to be on the square
oh i see what they did never mind
[Music]
this way
heel pad wait when do i take the heel
pad
take the heel pad okay
[Music]
oh i have to fight this channel i guess
i should have walked one away
would not play that animation
wait i went to all that effort to get
tm07
what a waste
[Music]
i have to fight that one okay fine we'll
get better about that
i can't believe i missed that's there's
a generation one missed that's an
unmissable attack
okay pick up the rear candy blocking
your path and menu right away
teach item 12 tm13
over slot for rice sly
roxtide
all right cubone's mother
do i want to use a second repel i'm not
sure i do oh i should use a second repel
[Music]
oh wait this might be marowak's ma
cubone's mother oh yeah get ice beamed
[Music]
sweet
all right let's go ready to get ice
beamed bro
yeah we killed cubones already dead mom
this game is mostly just spamming a
do
get out of here rocket one
oh you were you guys were harassing mr
fuji
that's not cool we like mr fuji
i'm not mean to all the npcs in that
game just that stupid girl who traded
some valuable tms for like you know some
some cheap things from the drink machine
uh i want to use horn drill toe
never mind get out of here
what why does he have uh drowsy
his drowsy was not well documented
pokemon good for so much more than
making money bro you have to love your
pokemon
go up to
[Music]
um
[Music]
don't worry i took care of the man rack
for you bro
follow you to your home yes absolutely
thank you
mr fuji give me a pokey food you have
pogba food for me bro
hit me up bro thanks for the pokey flute
[Music]
yeah your flute's great bro thanks bro
um fly to
celadon city
take the center
this rival five we're gonna fight soon
all right bike east
to saffron city and enter slithko ah
okay got lucky there no encounter
bad movement bad movement speed run
speed run speed run speed run
uh i gotta go is it this thing all right
all right yo yeah i got some water for
you yeah yeah yeah
yeah enjoy i wanted to sell it on mark
for you wow you're sure
thank you
wait is this slithko
oh how do i get to slithko
where am i is this lithgow this looks
like slithko this looks evil
there's a slithko where the stairs
take the stairs up to the fifth floor
this is a tall building if i'm in the
wrong building that's it the speed one's
over
four walk left and take the hidden
elixir in the plant
is it this plant
what do i do without these maps wait
this doesn't even look like this should
i not go to the fifth floor
no this isn't right either
am i in the wrong building
i feel like i'm in the wrong building
oh it's this one here we go yes
okay i got an elixir
and walk down and talk to the rocket
next to the teleport pad oh no i took
the teleport pad don't take the teleport
pad
talk to this rocket is this a rocket
i don't think this is the right one
please have an arbok
scientist no
no
oh this is the worst
why am i fighting a scientist do we hate
scientists
that's right
that probably believes in vaccines and
shit oh
worst guy let's kill him
oh my god if i hurt myself again in my
ah
guys i'm throwing the runaway now i'm
throwing the run away
i'm throwing the whole run away
oh i'm throwing the runaway
throwing the runaway oh my god we forgot
the timer
oh we should put the timer on the screen
ah
oh we threw the runaway oh we threw the
runaway oh my god what are we doing
what are we doing
no pp left okay thunderball
i've seen pikachu beat a wheezing before
pikachu beats them every episode why
wasn't that more effective
oh this guy's the worst
i still have more things to fight
can't believe this guy i cannot believe
we fought this guy
oh i hate this guy
you know what i know it says take the
stairs but i'm taking the elevator voice
taking the elevator because otherwise i
don't know which floor is four or five
no i pressed four all right let's just
go up one we'll take the stairs one
floor
how am i supposed to know which floor
i'm on
talk to the rocket next to the teleport
pad okay
wait he doesn't even have an orb
i hate these guys
this is the fifth floor we just didn't
want to talk to that guy
this one this rocket next to the
teleport pad
you better have an rbok bro if you don't
have an arbok i'm gonna be very upset
okay thank you
okay i should spend more time looking at
the map
finishing with an ice beam
you have a card key
do you have a card key i'm not fighting
another stupid scientist
[Music]
where's this card key
go back into the portal and back up okay
i hate science
[Music]
now i'm confused
[Music]
great great
great
[Music]
really
[Music]
i'm sick of scientists okay go into the
portal and back up from the portal right
go right to the right of the rocket guy
okay
ice beam should kill him right
that's right get frozen bitch
you can't run from trainer battles guys
okay i'm going back through the portal
to the right
darn it needs a card key
where do i get a card key
okay it is
go right of that guy
oh i see what you want me to do this
got you
good moves good moves
he was standing in the way
clever pokey game all right cool
ah the card key open the door
[Music]
where do i go
i want those items get the card key
no we would intentionally like to take
damage here
okay
go in again
now is that old going again here
i hate this thing
it's the first door i opened you're not
right
i don't think you're right
it's this door can i teleport here
okay this looks like a long hallway it's
got to be good
uh no i gotta find my arrival
i can walk around this building forever
where do i go
boys i need help
i need help where do i go
which door this one
what door because i don't need them
go back to that long hallway middle left
door okay
no no that's not where it was hang up
oh man this is totally killing my time
bros
okay middle left door
the teleporter
okay i get it i have a card key thank
you
this one
one of those two thank you how do you
ever play this as a kid
okay where's my arrival
how big is this building
you're a literal zoomer you just
youtubed it that's fine but like
okay which one it's not this one i'm not
fighting any more
scientists is it this one
oh there we go thank you
all right
we intentionally are ko'd by koga's
wheezing
to set up red bar
oh my god i don't have any pp for horn
drill
because i used them
[Music]
oh this is so bad
now i'm gonna be confused
[Music]
hide your problem dad
oh
[Music]
um
[Music]
all right so when i revive do i get my
pp back
can i use wandro i don't even get my pp
back
okay he's an electric pokemon we gotta
start thinking for ourselves boys
we gotta start thinking for ourselves we
can't just like guide get you through
life
you know because because one day you
wake up and you realize you don't
actually know anything
and you've just been following other
people's dreams whole life
and you don't know anything okay no
all right i've seen pikachu he beats
everything with thunderbolt so we're
just gonna use thunderbolt on everything
i don't know if electric attacks attack
those kind of pokemon
thrash no no no confusion no no
please don't be confused oh no
no we're done we're done boys i don't
even remember the last time we saved
[Music]
we're done i don't have any more revives
amount of revives
the matter revives
we're done i didn't save
[Music]
can i dig out of this battle dig oh he's
done
he's done goodbye goodbye everybody
goodbye
oh no
you can't use a rare candy in battle
ah you know what
we might just have to like this might
just be a lesson
this this might just be a you know we
could like go back into that building
and we could uh we could uh
fight him again but
i don't know if we should
i think i think we fainted we we blacked
out and
this is just a failed speed run boys
i don't know what else to say
do you want to try it again next time
we'll try it again
we have to we have to get better at a
bunch of things we have to get better at
rocket
uh we have to get better at slithko
um
can we do it should we continue
man
hang on i got some plans tonight let me
see when they're gonna happen
time you thinking
ah you know what
no see this button
that's it that's it you know why
what's that book was it a sci-fi book
what's that sci-fi book
uh
consider phlebis yeah
consider phlebus you don't always win
boys
you don't always win and that's the
lesson from the speed run
um if you guys like this kind of content
shit what are we doing tomorrow let's
speed around pokemon what do you all say
should be your own pokemon tomorrow now
i have things to do tomorrow
but we might do it again we're gonna
become good we're gonna become
the very best we're going to improve
we've learned so much
we've learned so much together we've
we've we're we're going to get some
splits up
uh we've we've we've learned
about how to change our battle style
we've we've learned so much
but sometimes
you know oh yeah let's let's i'll
i'll leave you guys with a with a
reading of um
curtis bronx
wasn't always
a joke box grant and bronze brand
uh what's what's that grey mirror
um
i mean whoa that is a soundcloud
let me read it wait let's let's we gotta
go go
go back um
ah yes open letter to paul graham
ah okay and we'll start with the reading
of this
and i think this is a lesson uh
to take away from from this speed run
uh you guys can be more prepared we all
could have been more prepared but
it's time to stop being an optimist
while i never had the honor of being
mentored by the great paul graham i'm
sure he can deliver some of the world's
finest canned speeches mentoring does
that to you
and i'm sure one such recording is the
perfect way to tell kids in a tight spot
that they need to realize how tight a
spot they're in
graham doesn't seem like a potty mouth
so it probably doesn't contain any
f-bombs but you know ben horowitz
another startup grant a god
has a great acronym uh w-f-i-o-w
is where an io is it's over
surely there's a speech where the w
becomes a y this is not that speech but
the speech before
which says to paraphrase rilke who i
don't know who it is you must change
your startup
and when the problem with your startup
is your ideas
you must change your ideas i write this
because of a new paul graham essay
which like most startups that fail is
almost perfect
almost perfect isn't good enough graham
writes short
apodictic oh i love learning words i'll
send this word
apodictic clearly established or beyond
dispute
essays i like to justify myself
exhaustively let me use graham's style
and tell him
where he's wrong and why he's wrong
having ideas in a world where some ideas
are banned as like playing soccer on a
pitch that has a minefield in one corner
you don't play the same game you would
have but on a different shaped pitch you
play a much more subdued game even on
ground that's safe
having ideas in our world is like
playing soccer on a minefield period
the only part of that field that isn't
mined is your own penalty box
don't get too close to the edges 30
years ago you could safely dribble
almost to midfield and even take a wild
shot there were still six players on
your team one was actually a forward
now it's you the goalie and one defender
with half his left foot blown off
the other team which doesn't set off the
minds has long been letting its whole
bench play
at this point random fans from the
stands are coming down and taking
penalty kicks
the who's just taken off his referee
shirt and replaced it with the other
team's uniform just awarded one
apparently you made a mean face or
something you saved it so the score is
still only 47 to zero in the long term
you're hopeful
graham's error is that he has absolutely
no sense of history
he has no critical sense of the present
he has a good critical sense of the
present his past
graham's error is he has no absolute
sense of history he has good critical
sense of the president his
his present his of the present his past
is a piece of cardboard he downloaded
from the new yorker
for the last couple centuries at least
when the aggressively conventional
minded were on the rampage for whatever
reason
universities were the safest place to be
hi reading one sec
for the last couple centuries at least
when the aggressively conventional
minded were on the rampage for whatever
reason universities were the safest
place to be
it may not work this time though due to
the unfortunate fact that the latest
wave of intolerance began in
universities
it began in the mid-1980s and by 2000
seem to have died down but it's recently
flared up again with the arrival of
social media
in the mid-1980s it began
in other words at the first point in
time in which graham
had a chance to see it with his own eyes
a remarkable coincidence and because
you can't take the boy out of harvard
because you can take the boy out of
harvard but you can't take harvard
out of the boy graham has turned
conventional versus independent into
town versus gown
this has certainly been true in some
historical periods but
in actual american history the period of
heaviest landmine installation was
probably between 1920 and 1940.
if you compare the difference between
what books could get published in 1920
and the books that could get published
in 1940
with the equivalent gap between 1940 and
1980 the formers
is wider and more mines went in between
40 and 80 than between 80 and 2010.
uh 2020 graham cannot see this history
of the world
before 1980 graham cannot see this
because his history of the world
before 1980 comes from the minefield
itself what was happening between 1920
and 1940
the universities were taking power in
1900 the idea of a professor telling the
government what to do was borderline
absurd
by 1940 it was normal by 1960 it was
universal
all public policy in the future would be
determined by
science and because the ring works like
that
power was taking them with its favorite
toy money
federal funding of universities before
world war
ii was negligible in the pre-war period
monies came
from the great foundations carnegie and
rockefeller generally
i went to carnegie mellon institutions
and professors
that the foundation managers liked
prospered gloriously those they disliked
vanished without a trace
as did their ideas and after the war
washington became the greatest
foundation of all
most of the science was complete wu and
balderdash
mainly selected for how much it provoked
the townies and it didn't just provoke
them
scientific public policy turned the
bronx in 1960 into the bronx in 1970.
strolled the grand concourse lately it
may its name wasn't always a sick joke
nice work harvard i haven't been to the
grand concourse
i don't know exactly what that means but
i do know about the bronx and
maybe i wasn't it was true so when
graham writes i spent a lot of time
thinking about the situation i can't
predict how it plays out
could some universities reverse the
current trend and remain places where
the independently minded want to
congregate
no because our universities are not
universities
they are organs of a state church that's
why they all always agree with each
other about
all political and spiritual questions a
set
now that includes everything outside
math hard science and engineering
and we're starting to see more stray
minds even in that penalty box
and when not late but early in the 20th
century they accepted that our
idea that the role that their role was
to guide and supervise the government
they forfeited forever their
independent-minded purpose
it is not possible to be both important
and independent
it makes no sense at all but i'm hopeful
long term this is from paul graham
the independent minded are good at
protecting themselves if existing
universities are compromised
they'll create new ones new institutions
have a simple choice
they can exclude every whiff of power
which means they will only be for the
heretics
they can try to remain open and free to
all sides
which means they will only be for the
orthodox only the orthodox can plant
mines only the heretics
actually detonate them these are the
rules of power
nothing within powerscope can ignore
them graham
created his own new institution hacker
news for no doubt excellent and
practical business reasons it took the
second path
hacker news is very much within power's
scope
ten years ago you could have a heretical
conversation on hacker news
all heretics have long since blown up it
remains a relatively permissive space
meta-heresy like graham's essays remain
allowed you can praise free speech as
long as you do it very politely and as
the clash put it
you're not dumb enough to actually try
it
that may require some imagination but
imagination is after all their specialty
it will require some imagination
imagination though necessary is not
sufficient
and it is not even clear that we have
sufficient information imagination
ultimately graham is still operating in
the false frame of a free and open
society
in fact there has been no free marketing
ideas since his parents were born and
quite arguably his grandparents
one mark of a successful startup is that
it always operates in the real world
it may try to spin others generally it
has to but it never spins itself
when you succeed within the borders of
someone else's unreality
you hit those borders and then start to
fail imagination is the specialty of the
independent-minded
power is not for the most part
independent-minded people are terrible
at seeing power
it's simply not how their brains work at
this point
the reality of power is too obvious to
dismiss
but as bad as these people are at seeing
power they are far worse at
using building or taking power they
often have the ability to lead
they're almost universally bereft of the
far more important ability to follow
which makes even an army of them into an
army of cats
putting our institutions of thought in
charge of the government was a terrible
terrible mistake
the smart independent-minded people who
made this bad choice thought power could
only float downward
from water to sewer but the sewerage
came back up this pipe
and turned all those independent
universities into one giant state church
unlike the catholic church it doesn't
even have cool magic rituals
but it sure does like burning heretics
check back in 50 years
it'll be burning them literally this
mistake cannot be corrected by building
new institutions
new institutions will still be playing
on the same minefield
nor can it be corrected by imagination
or ideas
only by what napoleon called the
alliance of philosophy and the sword
only power can cure power and i see no
trace of any such alliance in the world
today
but i am hopeful long term i'm not
the only thing we have to fear is hope
itself for
all of the impediments to success false
hope
is by far the deadliest false hope
trains you on a low bar
you see that bar and think that's not
too bad i can work out more
stop eating carbs i can clear it you do
the work you practice you clear the bar
every time
then in a real event you see the real
bar
higher than you could ever imagine and
you just walk back to the locker room
i really i just remembered that last
paragraph and that's how i feel about
that uh about that speed run
so um you see the real bar higher than
you could ever imagine
and you just walk back to the locker
room
uh what was this point i don't know man
it's poetry you know it doesn't mean
anything like people get upset about
this stuff because they think it like
means something right
like they think it's like you know you
read a lot of like you know things that
like talk about this kind of stuff and
like
you know it doesn't matter like like
who's right it is democrat stuff
republican stuff doesn't matter who's
writing it they're all trying to like
get you to do something they're all
trying to motivate you to take action
how can republicans be against this how
can democrats be against
this how can the tories do this how
could you be a pro-brexiter how could
you be an anti-brexiter
how could you be no man it just doesn't
say you know
it's like you know it's just like
man you know
just just it's not activism it's
pacifism
all right thank you all for watching my
video
and if you enjoyed this we will try
speedrunning pokemon
red again on our next stream
bye
WEBVTT
Kind: captions
Language: en
dedhuecilisvinec: Sup dude
olntel: yo
Major_Spicy: Hello sir!
0xNexn: yo
3even: collin32BCH collin32BCH collin32BCH collin32BCH
Oxi_Y: Sup
480i: Hi
nbrand: yoyoyo
guusii6: Wassup dog
Ind1eMonk3y: Hi everyone !
Koduck007: Solar system record, thats right
DatHarryGuy: YO
equalizer_____: Yo
lightb00k: SPEEDrun
0xNexn: first time in stream wasup man ...
acidaliaerospace: hey
harmanthebest1: hey
lightb00k: hii CHAT
nbrand: Mac LUL LUL LUL
Mayfieldiv: Here we go
不好意思: hi
tuffest_leader: yoyoyo
kas_par: VoHiYo
malana_cream: hey man!!
algodog: PokBlastoise
ZX10RSE: like an ml speedrun ?
rudolphdoesgames: starting the timer at the beginning this time? :D
hiddenspacex: Representations
zx01337: 😂
architectzs: George how did you get into computers?
eax_ebx: Поехали
Koala_V2: Yooooo
zx01337: Should do yellow version
malana_cream: what's this stream about? missed the try 1 i guess
leeeeeeeeeeeeeeel: bonjwaKEKW
DatHarryGuy: OMEGALUL
hiddenspacex: see the manifold
yllstar__: u progamming a 80 year old game?
nuclearnicdev: &lt;3
K0enich: does someone know the name of the emulator?
nytherino: how long did you take yesterday?
soupsox: LUL
NotEnoughSpeed: poggies
t1r4t1oais0: again?????
ZX10RSE: :D
hiddenspacex: gme
averageswe: elite elite elite elit
averageswe: elite
yogi_1010: LOL
leeeeeeeeeeeeeeel: professional speedrunner .. siiick
averageswe: eliteeee
qq818: don't forget pink knee-high socks
smurfd0: things are getting serious!
DatHarryGuy: this is a scuffed SGDQ LUL
dando500: Geohot looking beautiful today
damacloid: wear a hoodie
ZX10RSE: check 2 of 2
t1r4t1oais0: again???
NotEnoughSpeed: A E S T H E T I C S
yllstar__: give us the link
siriusb_79: hoodie up = hacker LUL
jehdhjwjw: audio reduces when you go away from PC
sw1jari: if we win we get hottub stream
t1r4t1oais0: Paul graham vs Curtis Yarvin
salem8salem: hack world please instead of speedrun
DatHarryGuy: if you win can we geta hot tub stream? @georgehotz
t1r4t1oais0: Paul Graham vs Curtis Yarvin (Trial by combat)
uint15_t: i support that hot tub stream
Major_Spicy: monkaS wtf is this
rudolphdoesgames: george voice acting
uint15_t: george can show us his gainzzz
kid_cudi_: link?
ZuppaSalata: LUL
na_masw_elies: link?
imjoshvo: yo george!
sw1jari: react logo poggers
kklisura: George, is it time for another interview with Lex?
0xNexn: https://imgur.com/gallery/u4iRsk4 its the link bois ...
lightb00k: link?
Koduck007: rainbow shirt
jehdhjwjw: rants are your USP
yllstar__: a speedrunner doesnt dress at all
kid_cudi_: @0xNexn thanks
yllstar__: hes always naked
KtArchived: hey first time on the stream
nuclearnicdev: "Don't follow your passion" ~GH
cwyptoduck: hi jorge
DatHarryGuy: Yellow Shirt Guy Speed Run
DatHarryGuy: Pog
DatHarryGuy: SGQD
Santiago_LHC: Yeahhhh proper SPEEDRUN stream!
tornpaperyoyos: wtf is happening lol'
uint15_t: i mean speed is the key word right ?
many_mangos: @georgehotz if you were king of the world how u gonna restructure society
broccolight: speedrun chess!
Santiago_LHC: But change the category to "Pokemon Red"
dedhuecilisvinec: lets go baby
MrBankster: oh shit. nice man
leeeeeeeeeeeeeeel: 🔥🔥
MrBankster: i was just watching the first speed run
leeeeeeeeeeeeeeel: bonjwaKEKW
dedhuecilisvinec: straight fire
quickcheck: go to duck duck go, search how to not fail at life
StrongArmSteady786: this is going well..
tornpaperyoyos: KEKW
nuclearnicdev: @many_mangos lol u serious bro 😂
slytherinvalisi: We want Twitch plays pokemon red :&gt;
broccolight: damn that speedrun fast
votummy: what a boomer, tried to exit with the menu LUL
Santiago_LHC: But timer is running!
aksdjasdas: is this the pokemon red emulator someone posted on hackernews?
ZX10RSE: reset the timer
Zamytv21: TIMER LUL
smurfd0: reset timer
quickcheck: quickcheck subscribed at Tier 1. They've subscribed for 3 months! &lt;3 &lt;3 &lt;3
lightb00k: GEORGE do the minecraft speedrun someday
vertune_: @leeeeeeeeeeeeeeel bonjwa FeelsGoodMan
leander_ms: This was not the content I expected but I'm here for it LUL
Leviitate: a.b.c. man, always be fast
11plus4thinking: george playing games :O
JigglyGirls: actual gaming strim ? cdawgvWine
11plus4thinking: what is this
nuclearnicdev: are we cheering red or green?
jehdhjwjw: yea in 68 lines of C++. that is what got his attention I think
leeeeeeeeeeeeeeel: bonjwaLurk @vertune_
quickcheck: speedrun content finally
Santiago_LHC: NIDORAN, we are coming for your 7:42 shitty run!
bananiel66: INVALID RUN
tornpaperyoyos: jesus christ george LUL
Aehoard: What a timeline , I love it
Seyyal01: Hello to everyone
MrBankster: are you saving your keystrokes to replay the speedrun?
quickcheck: we survived covid for this
swpxpxp: This is epic
11plus4thinking: trying to speedrun pokemon of all things you could speedrun
NatelBeats: lets gooo
jehdhjwjw: @georgehotz tell us your HN username
vHyphy: Yoo he’s actually playing games!
nbrand: spam a strat LUL
ZuppaSalata: Didn't think the title was serious LUL
Santiago_LHC: Don't change the names
11plus4thinking: Kappa
NatelBeats: Those are some quick splits
11plus4thinking: TRUE
Aehoard: YEP
11plus4thinking: LUL
DatHarryGuy: TRUE
quickcheck: Kapp
11plus4thinking: im a loser FeelsBadMan
nbrand: LUL LUL
MrBankster: i'm a loser FeelsBadMan
lightb00k: LUL
MarioSO: anyone has a link of that infographic???
krisa002: fuck commenters
ShrimpmasterCoA: where the fuck are the keystrokes??
Tymscar: Tymscar subscribed with Prime.
NatelBeats: Should have named him Youuuuuuu
nbrand: the people who comment on gucci cang are hilarious
Zamytv21: FeelsBadMan
damacloid: Please don
DatHarryGuy: if you win can we get a hot tub stream? @georgehotz
lightb00k: letsss gooo
ligurious: to have 1% hfunny comments you need to have 99% of shit comments
fancyslimshady: Do you think this game aged well??
quickcheck: SNES trap
Major_Spicy: KEKW
hiphopsucks: LUL
phoxyie: failed
Santiago_LHC: @fancyslimshady Flawlessly
uint15_t: restart
damacloid: Please don't name everything "A" this time
uint15_t: we fked up
uint15_t: nooo
ZX10RSE: @georgehotz what is your all time favourite game ?
quickcheck: up to you
ligurious: Jesus he's tweaking
rudolphdoesgames: @damacloid that's the speedrun strat &gt;:(
toledo60: look at the pace
PieIsEqualToExactly3: Love this game!
jehdhjwjw: imagine if Fabrice bellard does this speedrun
Santiago_LHC: We are almost finished!
Zero_KA: george are you invest in cryptocurrency ?
hiphopsucks: the 1:12
bananiel66: this is on WR pace
Tymscar: I mean, we might as well restart
Santiago_LHC: comma.speed
leeeeeeeeeeeeeeel: bonjwaSmart
DatHarryGuy: this is the canals 1:12 pace
DatHarryGuy: PogChamp
quickcheck: becoming a pokeman master
ZuppaSalata: Dialogue skip any%
Santiago_LHC: No hating on classic Pokemon allowed
480i: LOL
rudolphdoesgames: @Santiago_LHC i don't know if it's a big deal but the stream category is kind of wrong
Santiago_LHC: Yeah
Santiago_LHC: Only he can change it unfortunately
blade_hopp: is this a good game?
mucinoab: A timer and all. We are serious now.
Jeppelelle: 7:42, is that really glitchless?
uint15_t: the guy who said this about pokemon classic should go to jail
rudolphdoesgames: aah okay, all good
Santiago_LHC: @blade_hopp It's a pretty solid classic RPG
reticence00: lol next thing you know the split is going to have a personal best and target tab
mboumaza: It's our favorite white boy, George
jslxxr3_4: Sheeeeeshhh
blade_hopp: @blade_hopp looks weird
rudolphdoesgames: looking this from an emudev perspective is pretty fun :D
Tymscar: Isnt getting a good speedrun dependent fully on luck though?
jehdhjwjw: SeemsGood Kreygasm ResidentSleeper WutFace BibleThump HeyGuys LUL VoHiYo NotLikeThis
Errmergerd_: make a pokemon speedrun rap song
phrixus_bro: how do you get jump
480i: Did he already deliver the package
Nicerman1: reset?
leeeeeeeeeeeeeeel: haha
thomas_the_tank_engine: already fucked forsenLUL
phoxyie: late
mondeverest: actually WR PACE Kreygasm
Santiago_LHC: We are doing great
leeeeeeeeeeeeeeel: vahnil1Laugh lets pretend its just a test run
Nicerman1: LUL
alexlucas__: alexlucas__ subscribed at Tier 1. They've subscribed for 11 months!
Santiago_LHC: Nidoran is biting his nails. Boy getting nervous.
quickcheck: no glitches georgie boi
leeeeeeeeeeeeeeel: l33t speedrunner
Santiago_LHC: Smell him later
krisa002: :) 👍 KEEP GOING GEORGE :) 👍 KEEP GOING GEORGE :) 👍 KEEP GOING GEORGE
makeitpis: Im looking at the fucking pace
daxyxy98: I was here Pog
ZX10RSE: he alsmot got Nidoran
rudolphdoesgames: rigged rng
Errmergerd_: cocobFast
Santiago_LHC: WR achieved
krisa002: i love how George just put up a timer now since last stream yesterday haha
ProfessorMagikarp0: hot tub stream when? Kappa
quickcheck: LUL
Santiago_LHC: How the hell do you beat the game in 7 minutes WITHOUT glitches.
Tymscar: @Santiago_LHC you do your best
phrixus_bro: no
slytherinvalisi: U bought 18 pokeballs am i wrong?
krisa002: yes :)
Santiago_LHC: @Santiago_LHC It doesn't seem physically possible
MrBankster: +1 :O
makeitpis: Does George ever speak?
vortexcdn: yo whats up
Santiago_LHC: We are back!!
krisa002: YAAAAAAAAAAAAAAAAAY
phrixus_bro: ok yes
Santiago_LHC: REFRESH
lightb00k: we are back
krisa002: HELLO GEORGE :)
toledo60: twitch couldn’t handle his god pace
idevelop: idevelop subscribed at Tier 1. They've subscribed for 11 months, currently on a 11 month streak! What emulator are you using?
PieIsEqualToExactly3: Will the subsequent streams become less nihilistic as they go?
alertyus: alertyus subscribed with Prime. They've subscribed for 7 months, currently on a 1 month streak!
Koduck007: gdq 2022 i can feel it
krisa002: what is kernel panicking?
gandastiK: HeyGuys HeyGuys
Santiago_LHC: OpenEmu
itskyledaniel: Watched a lot of your livestreams on YouTube, first time watching you actually stream love the content
lightb00k: when system resource deadlock happens
ZX10RSE: can somebody just hack the db and write his name before Nidoran
damacloid: https://en.wikipedia.org/wiki/Kernel_panic
Alpasfly: are macbooks that unstable?
Santiago_LHC: Let's get Nidoran!
mboumaza: YO HE KILLEN THIS
ravicat: George playing pokemon LUL
ZABITAMEMURU: what do you do for a living? @georgehotz
daxyxy98: dont speedrunners change language to chinese or sth because the signs come in faster?
Santiago_LHC: @ZABITAMEMURU He is a world renowned speed runner
brofessorbob: Gary is a bastard
480i: Japanese
ravicat: @Santiago_LHC LUL
480i: But not all games
krisa002: @ZABITAMEMURU he is a twtitch streamer
mboumaza: This is how I skip the intro and then I have no clue what to do anymore LEL
thomas_the_tank_engine: george presses buttons for a living
jllcha: hello
enderowski: yes
mondeverest: f5
ravicat: @Santiago_LHC you mean hacking speed runner?
andamxx: watch all streams be speed runs from here on out, no more coding slams
mozycozy: It is ruined
Tymscar: @damacloid wait, I was afk for a second, did he kernel panic?
brofessorbob: Anyone know where to find misingno?
ZuppaSalata: George gonna end up on a SummoningSalt video
Mayfieldiv: you gotta go out
damacloid: @damacloid yes
automoltov: Hey hots
Santiago_LHC: Okay, here are the REAL world records: http://wiki.pokemonspeedruns.com/index.php/World_Records
makeitpis: Dont speak to mr Hotz
kamchach: tailssNug
ferdovvs: Hello all
enderowski: lol
kamchach: hi
Santiago_LHC: Basically we have to beat it in under TWO hours.
Lefer_: Geohot for GDQ 2022? Pog
sanneck: why dont you let to ai speedrunit?
froggperson: PrideLaugh
automoltov: Do it with AI
guilhermicas: you're an inspiration
thisisnotatemp: real speedrunner Pog
olntel: APM Pog
mrnivclones: Yo George what up love your stream
ferdovvs: this game brings back so many good memories
thisisnotatemp: FeelsStrongMan
damacloid: @Santiago_LHC which one is he playing? There are multiple categories like glitchless, No save corruption
brofessorbob: I can't wait till I hear this music when I'm not watching the game.
Santiago_LHC: @Santiago_LHC Glitchless
enderowski: it says st top right@damacloid
yllstar__: @Santiago_LHC why did i get timed out
automoltov: Someone explain whats going on
Santiago_LHC: @yllstar__ Probably for dissing on one of the best games ever made.
480i: George is playing Pokémon
glitch3dout: @automoltov he's speedrunning pokemon fire red
yllstar__: @Santiago_LHC wow. why take it so personally tho
Santiago_LHC: @yllstar__ Because Satoshi Tajiri is my father
480i: He’s on WR pace so far
Tymscar: PokPikachu PokPikachu
doctorpoopee: doctorpoopee subscribed with Prime. They've subscribed for 3 months! yo
rudolphdoesgames: the kernel panic is the new rng manipulation strategy
mozycozy: Wow so close to WR
MauriceChavez: lest gooo livesplit
yllstar__: @Santiago_LHC is he a musician or something
phrixus_bro: no
Santiago_LHC: @yllstar__ game developer
NatelBeats: does it matter which nidoran you get?
life_309: Hello George nice to see HahaBall
ferdovvs: Why do you need to get the nidoran?
Dusteyy: @georgehotz hot tub stream when?
glitch3dout: Frame perfect PogChamp
damacloid: @yllstar__ and rapper
MauriceChavez: now thats a speedrun. a mashing. livesplit. klean krisp linez
1PiZi: " with less nihilism" LOL
guilhermicas: george hotz will be in the next SGDQ
NatelBeats: @ferdovvs I think cause nidoran can learn all types of moves which makes fighting faster. And is super strong
ferdovvs: I see, thanks
wertpert1: This is the best crossover in history
glitch3dout: D:
NatelBeats: pokemon movies were all right
smokyakasteve: lmao
ferdovvs: He fked up, ri[
Santiago_LHC: The first Pokemon movie in particular
MauriceChavez: hehe. they let them go multiple times. hows that for depth
480i: I love the episode which gives you seizures.
juviin: tfw your parents allow you to play for only 2h a day
glitch3dout: I think Team Rocket is supposed to teach you about the pitfalls of addiction
f4r3l0: the graphics Kreygasm
phrixus_bro: what are they addicted to
Santiago_LHC: Team Rocket is a metaphor for speculators.
glitch3dout: pikachu
MauriceChavez: oof
krisa002: pepeJAM
Santiago_LHC: Come on Nidoran!
MauriceChavez: 30 secs
guilhermicas: WR Pace HYPE
NatelBeats: i always liked nidoqueen more
glitch3dout: Team Rocket are Cardano holders PogChamp
Santiago_LHC: YEAHHHHH
phrixus_bro: YES
rudolphdoesgames: better than wr!
Santiago_LHC: WE BEAT THE WR
MauriceChavez: -3
Lefer_: PogChamp
mozycozy: I WAS HERE
480i: Why is nidoran important?
yar3_yar3: PogChamp
MauriceChavez: u need to download livesplit
krisa002: POGGERS
glitch3dout: WR PogChamp
MauriceChavez: this is a bs online version
emekunn: mrpomsLetsgo mrpomsLetsgo mrpomsLetsgo
Santiago_LHC: @480i He has to use only Nidoran for a substantial chunk of the game
mondeverest: was it Lv4?
andamxx: nidoran good special attack?
guilhermicas: wr garanteed
MistaGobo: &gt;alt-tabbing during speedrun attempt
FullManaShen: up your apm buddy
MauriceChavez: gg
guilhermicas: strategic wall walking beautiful
MauriceChavez: restart
glitch3dout: forsenCD
480i: @santiago_lhc is that best for speed?
mozycozy: I see walking to wall strat
Santiago_LHC: Oh no, Ash got the spectrum
NatelBeats: @480i nidoran good at learning a variety of moods to optimise speed
droterville: What are some current macro trends we should watch?
automoltov: Bruh use AI pathfinding algos
Santiago_LHC: @480i That's right
mondeverest: if NodoranM Lv4 then check stats: 9 ATK -&gt; reset
Canine_Ace: A* is my favourite AI algo
480i: Got it.
ferdovvs: Why this path exactly guys?
glitch3dout: its the path of least resistance
480i: To avoid trainers
flightless_bird: fucked it
1000tonsermoud: u r playing this game, u r rly brave
Santiago_LHC: Also known as the "I don't have time for this shit" path
andamxx: easy way to beat WR, increase game speed
FullManaShen: I want to eat a pokemon
ferdovvs: How do you beat gymowners if you pokemon are low level?
tesseract199626: Hello, I'm new here
ferdovvs: your*
Santiago_LHC: @ferdovvs Nidoran will be boss by then
bfgz: YouDontSay @andamxx
automoltov: @tesseract199626 Me too
makeitpis: Composition for this game is good.
480i: Bubble will be good for Brock. What will be good for Misty?
ivaldir001: do you know ecole 42?
MrBankster: was that a car?
MauriceChavez: the magic they did with 4 audio channels
guilhermicas: beautiful pathing, flawless execution, this is wr 4sure
smurfd0: focus game on point :)
NatelBeats: WR pace bois
Croww__: loooool
Croww__: got the speed runner clock and everything today
aPosterior: speedrun seightseeing
Santiago_LHC: Be made it Brock on time!
yuyaaah: LUL
panthurrr: nice got the timers goin
NatelBeats: is the brock time for initiating the fight or beating him?
glitch3dout: brock with the wakanda pose lmao
Croww__: catch brock's pokemon
rudolphdoesgames: @NatelBeats beating probably
Lefer_: This song so good Kreygasm
NatelBeats: gym music always fire
tesseract199626: Damn that music though
glitch3dout: catJAM
Triphasic: yo
NatelBeats: Misty's gym music #1
infy_war: yee. ur back today :D
tesseract199626: someone's gotta make orchestral covers of older game music
LiveCustoms: GEOOOOOOO
LiveCustoms: HELLLo
LiveCustoms: LiveCustoms subscribed with Prime.
LiveCustoms: &lt;3
PhineasPhreak: he has livesplit this time PogChamp
MauriceChavez: @tesseract199626 its pokemon. they surely did.
Lefer_: Nooo
panthurrr: Sadge
PhineasPhreak: LUL
makeitpis: Good job Sadge
ray_1010: wow pokemon
andamxx: how much nihilism vs try hard today
tesseract199626: can't skip the text lol
shieeeeeeeeet: yooo we got splits today
makeitpis: Mods, is this a fitting category?
Santiago_LHC: @makeitpis no
glitch3dout: @tesseract199626 https://www.youtube.com/watch?v=jB0y8__1kog
Santiago_LHC: "Take your time", ha what a joke
makeitpis: He does not speed nor run
PhineasPhreak: you have to walk before you can run
andamxx: Do you run to speed or speed to run
makeitpis: No one knows
tesseract199626: @glitch3dout nice
11forza11: 11forza11 subscribed with Prime.
i_osc: be careful , you take a wrong stream category , twicht can ban you
PhineasPhreak: lol no
makeitpis: If twitch banns him, he can ban twitch
11plus4thinking: Guys I have exams soon how do I deal with stress
kornez: @i_osc wrong category is not bannable, they will move him in worse case
shouting_cup: !uptime
hanycopes: what is he building?
zaubages: u are quiting programming to be a speedruner?
shouting_cup: he is playing pokemon
11plus4thinking: I know you are all wise buddhas in here
andamxx: Try to pick up a quick claw. I believe you always hit first on first turn
makeitpis: :(
norflin555: @georgehotz can you make hot tub stream pls?
shouting_cup: yes
script016: George is gaming?
smurfd0: when you beat the world record, you might have to look into how to live like a pro gamer (pure pwnage series) https://www.youtube.com/watch?v=WqWFYOxjZ54
damacloid: Are speedruns about idealism or or a measure for competition?
tesseract199626: wait do you need to fight all these guys?
waffleswala: @11plus4thinking Start working towards your test, the further you get with your preparations the less you will stress about it. Watch a couple funny videos if you feel like
hanycopes: what is he playing?
script016: @damacloid both it depends on the person
script016: @georgehotz dude congrats on 50 million miles
zaubages: what do you say about doing a chess stream?
Triphasic: @hanycopes Pokémon Red
PhineasPhreak: reset reset reset
1000tonsermoud: like, what's the big deal with speed run? competition and all this stuff?
NatelBeats: metapod is megadumb
hanycopes: @Triphasic where can I play it?
zaubages: george has muted the chat to be more concentrate?
andamxx: it’s like a race. Why do people like races?
MauriceChavez: @zaubages just ignoring u
andamxx: @1000tonsermoud
LiveCustoms: huh
1000tonsermoud: good point xD
shieeeeeeeeet: you save a few frames by talking to the trainer instead of letting them see you
yuyaaah: LUL
NatelBeats: harden is the worst
shieeeeeeeeet: only if you're already adjacent to the tho
Triphasic: @hanycopes no idea how he's playing it on his Mac tbh, probably an emulator
toledo60: harden ResidentSleeper
PhineasPhreak: few frames saved and he loses all that gain by all his other inefficiencies
LiveCustoms: HARDEN Kreygasm
MauriceChavez: @1000tonsermoud not only a race. i like speedrunning cause it pushes the game and its code to the max. usually finding bugs and high skill movements
andamxx: I like it cause it’s meaningless
MrBankster: split
makeitpis: No traina :(
softwaretools: pokemon speedrun is ife
softwaretools: life
Mayfieldiv: city trainers are in the gyms
dagobetting: Would you shout me out? @georgehotz
11plus4thinking: @waffleswala Okay thank you wise buddha TwitchUnity
name100015: 420 viewers
the_scungilli_man: bathtub stream when?
0xbadidea: PokPikachu
yuyaaah: D
Fantastic_Man: What is the world record on Red spreedrun?
damacloid: @Fantastic_Man http://wiki.pokemonspeedruns.com/index.php/World_Records
d_brane: just got a Xbox series x, Gamepass value is wild
black_text: Hey George, any plans on coding some scripts that speedrun Pokemon games? :D
PhineasPhreak: @damacloid nice, thanks
Mayfieldiv: @georgehotz instead of clicking the down arrow in livesplit, click anywhere in the list of splits so it actually saves your split time
python390: Hi George !!
yelonk: next month news: new G. Hotz's AI system figured out how to beat the pokemon red speedrun record
searchingforlife: george gonna be on gdq confirmed Pog
Jrgoomer1: :tf:
zaubages: u think this game has a lot of RNG?
Chemisecurity: "We will always have Paras." lmao
vloood: Some use rare candy to just heal a little bit so you’re still in red but not too red
yakreboz: What happened to minecraft
vloood: Or maybe it’s to get you into red I forget
Chemisecurity: Which emulator are you using?
prvk3: pokemon speedrun Pog
turosdotexe: @georgehotz RIP bro you on red :(
qubitmanipulator1: openemu
JAGxTERRA: hi chat and george
thisisnotatemp: OP AF
zaubages: hi
johnny___silverhand: BibleThump
Loutlot: Cheer100 I love your works
1xelerate: staff in chat monkaS
0x80h: I'm surprised someone with IQ 170 like you spend time playing games like that.. Every time I come by you're always doing something really high level :D
turosdotexe: lmao ?
zaubages: 170?
1xelerate: is that bait LUL
turosdotexe: you high bro ?
PhineasPhreak: he is 168 IQ at best
turosdotexe: what does IQ have to do with chillin and playing a game ?
votummy: speedrunning pokemon takes 300IQ tho, that's why george doesn't have the world record
thomas_the_tank_engine: 170? Those are rookie numbers
1xelerate: @votummy, true
ipo___: What has speedrun to do with Chillin?
turosdotexe: gotta pump those numbers up
nOkEdAjUnKy1: Gr8 b8
EUW_Greater_Than_NA: guys how do I get an IQ boost?
0x80h: I have a feeling that high IQ are always trying to change the world
1xelerate: you have to t3 sub for that
DragonMorcilla: eating brain
TsarSec: does this run have ACE
0x80h: @EUW_Greater_Than_NA I read once that after 25 years old, your IQ is gonna be all downhill from there
kotetzu_: down
EUW_Greater_Than_NA: @0x80h well fuck, im peaked
0x80h: lol same
studydistributor: なぜニドラン？
0x80h: But we can always get some more experience.. and keep learning
turosdotexe: @0x80h rip you missed your shot at changing the world
zaubages: u should work in your IQ when u have like 14
studydistributor: ミュウツー捕まえましょう
0x80h: Don't do drugs and alcohol when you're 15.
Loutlot: he is speedrunning IQ leveling irl and thats essentially same as what his doing rn
EUW_Greater_Than_NA: @0x80h [x]
0x80h: I wouldn't be surprised if we find out he is teaching the game how to play with Tensorflow or something like htat
prvk3: is pokemon red your favorite pokemon?
0x80h: But I guess it is the relax day for the big wizard
MrBankster: yellow my fav
karaokecrab: omg is geohot speedrunning!!!!!
ahahaitslit: isn't every pokemon game basically the same?
votummy: monkaS he's about to wipe
Loutlot: @studydistributor ニドキングが必要な個体値を最速で手に入れられるから
karaokecrab: GET IT KING
zaubages: @ahahaitslit yep, is the same with fifia
zaubages: fifa*
MrBankster: red and blue are basically the same, yellow is different. silver and gold are basically the same.. etc
andamxx: lol catching Abra is shitty, almost as bad as raikou
luspr: just joined. are we in for a world record today?
qubitmanipulator1: you mean games in a series are alike, wth
luspr: I see George made progress with the A spamming
1xelerate: this is wr pace
Consural: this programming language looks weird Kappa
chiliwithpeppers: Let's go!!
Bacon4Life_: hacker, rapper and speedrunner PogChamp
MauriceChavez: the save sure saved some seconds
zaubages: Kappa Kappa Kappa
1xelerate: Kappa
ahahaitslit: i mean that the gameplay between every game is more or less the same, with only cosmetic differences
leanhermit: he's prepping for summer games done quick
ahahaitslit: idk though
EUW_Greater_Than_NA: geohot is my fav rapper
kklisura: dv, like in delta v
Loutlot: do language versions affect time/record?
turosdotexe: I think JP is faster but dont quote me on that
qubitmanipulator1: probably which is why it says (ENG)
andamxx: If there was one really useful RNG manip it would be DB manip
ftdgomez: It's funny. He has the same facial expression as if he were typing python.
andamxx: Lol @ftdgomez
krisa002: StinkyCheese ANY STINKIES? StinkyCheese ANY STINKIES? StinkyCheese ANY STINKIES?
karaokecrab: which emu?
leeeeeeeeeeeeeeel: @loutlot imagine clicking through jp … bonjwaKEKW
damacloid: @karaokecrab openemu
EUW_Greater_Than_NA: typing python = :) , typing js = :(
karaokecrab: ty
votummy: JP is faster I'm sure
ahahaitslit: the fuck is jp? jordan peterson?
ftdgomez: @EUW_Greater_Than_NA HAHA true
leeeeeeeeeeeeeeel: japanese
prvk3: lmfao
luspr: shouldn't you use rare cany right after levelling up?
qubitmanipulator1: pokemon: jordan peterson version
zNxftw: What was the final time last run?
luspr: pokemon: clean your room
Thobrik: is this straight up speedrunning?
covidneunzehn: what happened to him? is he vaccination yet? speedrun pokemon?
leanhermit: @luspr pokemon: you must rescue your father from the underworld
leeeeeeeeeeeeeeel: 🍬
krisa002: BloodTrail POLSKA GUROM
1xelerate: BloodTrail 21:37
krisa002: CorgiDerp ANY GOOD BOIS?
luspr: RIP world record
ssbhardys: Sadge
1xelerate: dont worry we have time save
luspr: @georgehotz please restart the run
krisa002: COPIUM we have still chance
premell: what do you think about linux?
leeeeeeeeeeeeeeel: time for a dddduel .. let it rip
MauriceChavez: blood of the pokemon kinda game
Joooooooooonas: 435
krisa002: 430
qubitmanipulator1: 420
SleeveMcDichael22: you gotta do yolo lorelei
votummy: @georgehotz if you have to walk in front of a battle NPC you want to be right in front of them so you dont waste frames when they walk to you
PimpNamed_SlickBackk: FeelsAmazingMan
EUW_Greater_Than_NA: 0x1B4
Backrub: ive never seen geohot stream a game
zaubages: u are crashing pokemon red section my man
notfromquetta: speed run the new hack the box release machine
Somenone: PokPikachu
JAGxTERRA: how was yesterday's speed run?
EUW_Greater_Than_NA: 0o664 viewers
krisa002: monkaW
festerthe: had me at less nihilism not gonna lie
LiveCustoms: twerk George
leeeeeeeeeeeeeeel: doctor428Elonsmoke
nickthegreek321: i actually thought he was going to build pokemon red
zaubages: when u start with the idea of speed run pok red?
nickthegreek321: damn good luck
SleeveMcDichael22: ru not doing red bar?
MrBankster: building pokemon red sounds pretty difficult
akuma_sensei_: is this a rerun or did you restart the speedrun
luspr: From a technical perspective pokemon red is quite interesting.
EUW_Greater_Than_NA: it's bill hates
EUW_Greater_Than_NA: gates*
damacloid: Questioning bill's motives
sHaKeEeY: how do i write my undergraduate compsci thesis in 1 week please help
ahahaitslit: what's the topic
leanhermit: @sHaKeEeY just hire someone from fiverr to do it for you dawg
LyconFPS: hi
YouPowerRush: ruyuF_SG ruyuF_SG PokCharizard
maciejfiedler: HES FAST AS FUCK BOIIIIIII
1xelerate: FeelsBadMan
MauriceChavez: ooof
mikey9988: clutched save
Mayfieldiv: nice save
qubitmanipulator1: Stamie's sprite is clean
YouPowerRush: b r u t a l
thisisnotatemp: rip
rawrrzfn: FeelsGoodMan Go Agane
mondeverest: DV's man
grey_street: Gg
SleeveMcDichael22: misty wants her bike back
jusdapper: Need more LiDAR to complete speed run
yuyaaah: Oof
MrBankster: misty is a b!tch
maciejfiedler: monkaS
MauriceChavez: just crit. EZ
zaubages: just crit. EZ ahahahah lol lmao SSSsss \
maciejfiedler: FeelsAmazingMan
Joooooooooonas: do you know agdq ?
votummy: what thing
luspr: house on the right
MauriceChavez: candy
zaubages: where is the beginners guide?
votummy: go into the house with the guy outside (on the right)
alexobrien20: is there a reason he is doing this? or is it just for fun?
zaubages: he do everithing without a reason, in this case is the same i guess
1xelerate: why does everyone so obessed with why he's chilling and playing a game LUL
smurfd0: its weekend, its fun
alexobrien20: fair enough, my bad
zaubages: dont play games boys, it s a waste of time 4Head
MauriceChavez: damage
MrBankster: oof
leanhermit: oops
votummy: actually wiped monkaS
turosdotexe: most people here just wanna be "like him" so they document his every move in order to fulfill that inner voice that keeps telling them how "unproductive" they are set by an arbitrary standard usually imposed by society
ray_1010: feez
Bombapil0t: we still good boys
MrBankster: girl likes her pidgeys
sur86: yo yo lets speedrun
votummy: yeah let me just work 25 hours a day cause that's more "productive" LUL
luspr: @turosdotexe Yeah, and George would think like this
MrBankster: i'm just existing at this point
zaubages: play games is a productive activity, cause make you more productive when u need to be productive
PhineasPhreak: be useful to society is also a meme
changename_: you should set the game category to pokemon red
changename_: instead of speedrunners cause that's a diff game
damacloid: why be useful to society? my goals might not align well with our collective identity i-e society
bananaconda: finally full time variety streamer PogChamp
SleeveMcDichael22: current wr fights a trainer in ss anne so ur good
guts_pc: George what are your thoughts on aliens and the upcoming congress report by the govt.
luspr: thrash too strong
sk84uhlivin: geohot is speedrunning, nothing can top today
MauriceChavez: xcept yesterday
zaubages: our boy geo just wanna know about pokemon now boys
MauriceChavez: when he was also speedrunning
cookieforu: why on earth are you speedrunning pokemon LUL
techiedheeraj: Is this game stream ?
techiedheeraj: What is the point of this stream ?
leblblbl: didnt know you were a speed runner
guts_pc: funtime stream
techiedheeraj: Okay
Omashu: @techiedheeraj What kind of question is that
zaubages: why play normal games when u can be edgy vintage
techiedheeraj: @omashu never saw George doing this stream … so asked
Davizzpin: Hello
thomas_the_tank_engine: whats the hottest pokemon geff
mn2197: are we going to write some RL code to play the game ?
MauriceChavez: hitmon-chan
zaubages: if u are trying with games, what about hot tub section man... @georgehotz
Davizzpin: does he want to win a guinness record?
MrBankster: what did the switch do?
qubitmanipulator1: yes
ahahaitslit: is there actually a guiness world record for fastest pokemon red speedrun? jesus
Nietzsche3: @georgehotz speedrun pokemon &lt;3
rondon_squad: it's not a guiness world record, it's some nerd website with a high score table
Hamled: @ahahaitslit as I understand it, Guinness offloads the judgment for some things to third parties like speedrun.com
qubitmanipulator1: creating new strats
zaubages: what a song "die now" when a album man ?
Hamled: how long have you been speedrunning Pokemon Red
damacloid: @zaubages @georgehotz  when are you releasing a music album?
MauriceChavez: VROOM VROOM
ZuppaSalata: are you winning George ?
sk84uhlivin: Have you watched any of the glitched runs for Red @georgehotz
MrBankster: this is the second stream of speedrun
MauriceChavez: lvled pidgeon
MauriceChavez: i think
pro_andi: pro_andi subscribed at Tier 1.
SusvaraS: Speed running POGGERS
SusvaraS: SusvaraS is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
SusvaraS: SusvaraS gifted a Tier 1 sub to I_Love_Lxthul!
SusvaraS: SusvaraS gifted a Tier 1 sub to JigglyGirls!
SusvaraS: SusvaraS gifted a Tier 1 sub to yerttle!
SusvaraS: SusvaraS gifted a Tier 1 sub to MrTikkux!
zaubages: the west side has been very quiet since george realesed his music
SusvaraS: SusvaraS gifted a Tier 1 sub to zach_xt!
Zepcon7: Speedruns seem like the perfect game type for him
Triphasic: PogChamp
SusvaraS: :)
rudolphdoesgames: tactical pee
Styves21: george how do expect to beat tesla if youre playing games instead of working
JigglyGirls: @SusvaraS cdawgvWine thanks buddy
luspr: did he bind bike to a shortcut?
MauriceChavez: time it
MrBankster: pp
SusvaraS: ;) @JigglyGirls
SusvaraS: pp(p) LUL
rawrrzfn: PogChamp
zaubages: SHEEEEEEEEEEEEEEEEEEESH
Nietzsche3: LUL
MauriceChavez: whats funny here where im from PP is abbreviation for ad break in a program
420_blitzcrank: Hi! how are you?
480i: I’m ok.
420_blitzcrank: thats fine, I guess :D
pro_andi: Yeah I’m good too
corraie: WR pace PogChamp
haris_pap: Do you like your chair ?  I know I could watch a youtube video or read an article but people are sellouts and really stupid so I'm asking you @georgehotz
bobec1998: how  crazy that would be If pikachu evolved into a raichu?!
FlyerLeVrai: no more keystroke on screen ?
smurfd0: is it because Cubone is a ground type pokemon?
luspr: thunderbolt is strong against birds
rektiwow: this a gaming channel now?
FlyerLeVrai: what is the world record ?
norflin555: this game is so bad
luspr: This game is great
haris_pap: this game is okay
perfectionits: this game
thomas_the_tank_engine: this
corraie: t
ellips0nspice: hey @georgehotz
akuma_sensei_: its so satisfying and nostalgic listen those musics again almost after 2 decades
luspr: this is the ghost city first
ludkiller1337: big fan, just joined in
ludkiller1337: what are you upto?
HULLA_SZILVA: hey @georgehotz, huge fan, keep up the good work agiicaLove
swingtradewizard: how come u dont play with a newer version? with better graphhics
420_blitzcrank: music Pog
ellips0nspice: its PUBG v0.0
luspr: @georgehotz Can you bind the bike to a shortcut in this emulator? You could do this on the Gameboy
anon_lambda: want to hear memory about pokemon
humann4ture: more nihilism
480i: @luspr only on silver/gold and newer
luspr: I see.
timo_162: Hows it goin
luspr: Games are merging together in memory
knwnw: !uptime
swingtradewizard: they are all the same game anyway lol. pathetic how much they milked the same reskinned game
KingHerods: Hey Geo, Do you have an update about your biology adventure(s)?
mik12f4: ever play final fantasy for nintendo?
Plurmorant: It's not logical
swingtradewizard: like 10 different games just reskinned
SKPTCL: guess its time for a reset ;)
nk_hitman: hellooo
luspr: @georgehotz Is the hidden stuff worth it?
ellips0nspice: late 70 dreams
mehmetspf: oh gaming stream
timo_162: What is it about the m1 security flaw?
keat0: rare geohot content
mik12f4: or first zelda.....more fun
swingtradewizard: you thought this was about fun?
NuttyOdin: Let
NuttyOdin: Let's a go!
lzgmc: ayy I caught a stream
mik12f4: i figured there was an underlying reason.  Just sayin
bino68: nice pokemon red :)
swingtradewizard: lol i have no idea @mik12f4 but... following a speedrunning guide isnt my idea of trying to have fun
mik12f4: true
swingtradewizard: this is just unnecessary stress
NuttyOdin: Are ya winning, son?
RX00023: hey Geo :) KPOPvictory
vervierszoo: Wich emulator is that?
luspr: Is this the dungeon with those spinners?
RX00023: open emu
swingtradewizard: maybe thats why hes doing it. this is good training for stress management?
mehmetspf: mehmetspf subscribed at Tier 1.
Khalifa1897: sub 2 hours?
BurntOut157: try yuzu emu if you ever want to play switch games
swingtradewizard: never thought of it like that
Khalifa1897: !uptime
1xelerate: SourPls
swingtradewizard: oh shit this room sucks
MauriceChavez: 1st try
guilhermicas: wr pace HYPE
NuttyOdin: !time
mik12f4: never thought george the type to stress
swingtradewizard: being a little kid trying to figure this stuff out on your own without internet REEEEE
guilhermicas: beautiful pathing execution
OK4iser: would ya be mad if you went bald?
KriminelleLebensstil: Do you have money in stocks?
mehmetspf: this game increases my anxiety
KriminelleLebensstil: LOST TO TMO2 OMEGALUL
mboumaza: Have some mercy, you beat everyone at coding now this??? Kappa
guilhermicas: rare candy is not a scam because post modernism
BruceWayne11x2: Japanese Electrical Engineering is so good
swingtradewizard: rip
swingtradewizard: see that stress lol
woodpecker991: SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A
woodpecker991: SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A  SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A  SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A SPAM A
luspr: @put thrash first!
luspr: @georgehotz  put thrash first
j0sheezy: What the
swingtradewizard: 2 more weeks
j0sheezy: This music is lit
mik12f4: lol if he stresses i dont think he realizes it
caracazz: i was there in the second try!
DestruinES: how long should the speedrun take?
stale2000: Speed run PogChamp
swingtradewizard: the world record is 1h 45m 05s
amuzinc: is the 64 line emulator
DestruinES: well he has 20s
swingtradewizard: HE CAN DO IT
DestruinES: mmm
DestruinES: idk
swingtradewizard: not with that attitude
DestruinES: looks like he already miss the record
big_dog_genetics: is it too ratchet to use vim on windows?
DestruinES: but yeah he can
amuzinc: @big_dog_genetics not really
swingtradewizard: im surprised he isnt trying to program a tool to play with it, thats fun
DestruinES: @big_dog_genetics is like using a lamborghini engine on a lada
ellips0nspice: GEOs game looks like a captcha and he can't pass it for access to tor site
Zorbaselo: guys is there anyone could help me with my compsci specialization path
thiagomaycon11: Hi geohot, I'm from Brazil, I admire your work.
patcapp21: sick
swingtradewizard: @ellips0nspice beat pokemon red to post your shitpost.. best captcha ever
DestruinES: 1 hit kill everyone
luspr: This A pokemon is quite strong
ellips0nspice: @swingtradewizard hahah but not for GEO, he wants to beat ALL captchas and pokemons
TheRealMast3r: Is he doing that for the sole purpose to add it in his bio ? LUL
amuzinc: @georgehotz what emulator are your playing on
DestruinES: OpenEmu
underdog2000: restores pp
amuzinc: @DestruinES thanks
patcapp21: elixir restores some pp to all moves
patcapp21: max elixir restores all pp to all moves
DestruinES: @amuzinc you are welcome
amuzinc: this nidoran is on all the supplements
luspr: Nidoking please
amuzinc: @luspr my bad Nidoroid
DestruinES: omg all of them has the same freaking pokemon on the same lvl
BurntOut157: liking the stream George
kektobiologist: why?
FURiOUS: do you like glitched speedruns?
luspr: Ice Beam PogChamp
amuzinc: just missingno it
swingtradewizard: marowak devastated 😔
Fenumgum: salve @FURiOUS
FURiOUS: @Fenumgum furiHey
amuzinc: did anyone mess their cartridge with the missingno glitch
amuzinc: @georgehotz Bitcoin is funding team rocket
quickcheck: soros
valtspri: Meowths in the PayDay mines monkaS
swingtradewizard: an international cabal of abrahamites
shieeeeeeeeet: investors are paying for rocket to steal pikachu
valtspri: Maybe they sell special pokemon on the black market
amuzinc: team rocket..... TO THE MOON
quickcheck: its probably all voluntary
damacloid: meowths are non-fungible
swingtradewizard: they use pokemon for slave labour and stuff
david3chorvath: Greetings, how are you guys ?
luspr: split
swingtradewizard: but then again, everyone uses pokemon for slave labor
amuzinc: @georgehotz maybe make pokecoin or would that have copyright issues
caracazz: the speedrun was not very effective...
shieeeeeeeeet: wrong city bro
FURiOUS: @georgehotz have you watched any ACE speedruns?
swingtradewizard: pokemon and crypto was already a thing. people paid thousands to "own" them and trade them
ellips0nspice: This game looks like AI battle. AI is everywhere. Much more better if we don't create an AI.. and computers!?.
quickcheck: it's around the back I thought
VVurbose: saffron
patcapp21: its in saffron city not celadon
underdog2000: it was to the right of  the building you went it
luspr: Trainer tips LUL
VVurbose: yes
amuzinc: @ellips0nspice i think you are talking about digimon
ellips0nspice: digimon? hmm, interesting..
danielb123: CATCH A DEWGONG PogChamp
amuzinc: @ellips0nspice digimon are digital monsters hence your AI reference. everyone knows pokemons are real.
danielb123: if pokemon weren't real then how do you explain birds?
danielb123: literally flying types
shieeeeeeeeet: Pog
luspr: Rival is the real speed runner
valtspri: But when you sign up they give you a cool jumpsuit PogChamp
quickcheck: too far bro
DragonMorcilla: not cool, bro
damacloid: Why? Team rocket is powerful
amuzinc: FUll PP mode
danielb123: FUCK HIS HUSBAND PogChamp
luspr: LUL
ellips0nspice: thanks @amuzinc . interesting, i imagine synthetic machines
Nietzsche3: easy bro
quickcheck: not allowed: misandry
swingtradewizard: u have to use the japanese translation because its 10 milliseconds faster as the characters are smaller
hotarokun: red tea blue  tea green tea
luspr: just use BB
Constantx1: Did u ever play world of warcraft
luspr: Ah he doesnt have BB
quickcheck: PP restored
danielb123: RED IS COOL PogChamp
nerdylordie: true LULW
turingsdilemma: I remember playing this game for 5 straight hours once. That A spamming takes a serious toll.
valtspri: I only got an A- in ditch digging
miloeu: what's the emulator called?
quickcheck: the splits should be your PBs
BruceWayne11x2: make the average a manditory 65%
swingtradewizard: i feel like george is going to unironically become a speed runner
swingtradewizard: and its terrifying
danielb123: MEN &gt; WOMEN CONFIRMED PogChamp
s3xygirl6969: HotPokket
turingsdilemma: It's openemu, I think.
amuzinc: @miloeu openemu
miloeu: thanks
Keeqler: gaulesStonks
luspr: easy game
marco_from_venice: sup sup duuude
swingtradewizard: theres tons of hacked pokemon roms that make it more challenging. i wouldnt play normal ones
danielb123: PogChamp
quickcheck: probably used an abra teleport
danielb123: USE IT ON A RATTATA PogChamp
luspr: can you dig?
Yoann_b: gosh I only know the pokemon names in french. I can't help :D
quickcheck: this is the covid lab
BruceWayne11x2: Applied Sciences
luspr: Trust science
luspr: The covid lab is on the island
Yoann_b: in french he's called Ronflex
amuzinc: @Yoann_b snorlax?? us ronflex?
amuzinc: hahaha
Keeqler: LUL
quickcheck: kinda fucked that he attacks you just for playing the flute
danielb123: ronfle = snore in french
Yoann_b: snorlax is ronflex in french yeah
swingtradewizard: havent u been pissed off when someone wakes u up @quickcheck
amuzinc: @Yoann_b thats nice that you guys got proper french names for the pokemons
quickcheck: not with a flute @swingtradewizard
Yoann_b: yeah they did that to keep the puns on the names
swingtradewizard: ill take that flute and shove it up your
amuzinc: LUL
quickcheck: bikers man
damacloid: Can we ask offtopic questions today? Any thoughts on Tesla going full on vision.
Yoann_b: I still have to buy a switch to play the new pokemon snap
luspr: press a not b?
swingtradewizard: its not new its just new graphics @Yoann_b is that worth it?
swingtradewizard: muh Nostalgia!!! must consooooom!!!
Yoann_b: I hope it is, I didnt read anything about it though. Let me check
mik12f4: things are falling apart
luspr: pp up LUL
Yoann_b: 4.5/5 on amazon, and it's a new game yeah
Chrees12141: is the speedrunners category an inside joke btw?
Yoann_b: seems nice
Chrees12141: no flame intended
swingtradewizard: ive been flaming him for it, he doesnt care :D
yetanothernull: what you think about making a trading bot?
DragonMorcilla: guys how do i find the number of 1's in a binary representation of an integer without converting it to string?
Chrees12141: but im pretty sure he would get more viewers with the right category since speedrunners is a different game that nobody plays lol
luspr: @DragonMorcilla XOR
mik12f4: yeah playing games on twitch usually gets you thousands of views
Yoann_b: Man I always hated this area
madebyollin: @DragonMorcilla __popcnt()
swingtradewizard: i loved safari zone. u see some weird pokemon finally
mik12f4: just need "video game" in category
Yoann_b: @swingtradewizard from my memory, if you had blue or red version, one was missing in this area
Yoann_b: you had to trade with a friend to get it
luspr: you knoe you have a step limit here?
swingtradewizard: neat
LEXINGTONSTEELEROBLOX: george is a true multipurpose AI
swingtradewizard: u dont need it
sudqi: try walking
swingtradewizard: the guide has a PSYOP in it!!!
2sin54: George what the FUCK are you playing
studydistributor: walk
mucinoab: Ban if lie
kamchach: tailssLurk
swingtradewizard: who the fuck would ever know to grab a "tooth" there
underdog2000: u need the teeth to get strength to move rocks i thought
danielb123: George "Surfless" Hotz LUL
le0n_: go upstrais
luspr: 49 steps
shieeeeeeeeet: this feels like yesterday's silph co
Mayfieldiv: https://imgur.com/oBebL5z
Yoann_b: :D
swingtradewizard: EVERYTHINGS FALL APART
luspr: LUL
mondeverest: wtf LUL
yakreboz: is the game even fun??
swingtradewizard: no
swingtradewizard: its an autistic minmaxing game
NuttyOdin: What is the time now?
Yoann_b: they took 1000 bucks from you for the zone george
shieeeeeeeeet: did you reset? otherwise you might run out super repels for later
valtspri: speedrunning is about Violence. Speed. Momentum.
yakreboz: play fortnite
swingtradewizard: speedrunning is about avoiding your real life obligations
yakreboz: *fartnite sorry
NuttyOdin: This song will play in my head even when I am asleep
danielb123: you missed it FailFish go back
valtspri: Just sell those solid gold teeth for a forturne and forget this whole pokemon thing LUL
yakreboz: seems like m1 handles the graphics well
inshelootts: Interesante
mik12f4: is it that difficult to create a game with more than 2 colors?
mucinoab: in 1980, yes.
Yoann_b: gameboy had no colors at the time !
edonze: edonze subscribed with Prime. They've subscribed for 2 months! fkx
danielb123: Jebaited
mik12f4: i hated gameboy
yakreboz: try run the game on a water computer
mik12f4: sorry didnt realize this game was that old
swingtradewizard: gameboy was amazing at the time. i carried mine everywhere in a gameboy bag
Yoann_b: yeah +1. It was the first real game to me
TheKoreanZombi: This will be your Personal Best though. Then you can beat that next time.
mik12f4: i had sega game gear
big_dog_genetics: @georgehotz is it too ratchet to use vim on windows
valtspri: pokemon started the hipster craze of juggling and unicycling SeemsGood
Zepcon7: What do you use for the time tracking?
damacloid: is that uptime +59 min accumulated over levels or just for the current level?
mondeverest: https://one.livesplit.org/
hajyand: @mik12f4 I think it came out in 1998 and the entire game is like 11mb
Zepcon7: @mondeverest thanks
Hello_Im_Jonas: Hello george and chat. Hope u have a great weekend ;)
Yoann_b: I wonder how hard it is to code this now
nytherino: Yo george why not trying to decrypt elon’s twitter profule pic?
danielb123: GOLD PogChamp
luspr: Isn't the game even smaller... like 512kb?
mik12f4: nintendo game&amp;watch manhole game was the best
swingtradewizard: elon is bread and circuses bro @nytherino
nytherino: Yeah but george trying to decrypt sth is fun
nytherino: Even if its nothing
shieeeeeeeeet: you gotta swim to cinnabar island
Yoann_b: why not fishing a bit ?
AdmiraIGoldenRetriever: Catch Mew
shieeeeeeeeet: the island should be just south
votummy: its on the top left of the island once you find it
mik12f4: was there a flood?
LeonardoDiCaprino: just keep going down
danielb123: it's there FailFish
swingtradewizard: streaming category: Casuals
votummy: top left
Yoann_b: @swingtradewizard xD
danielb123: GYM'S CLOSED
LeonardoDiCaprino: oh thats the lab with the fossils thing
LeonardoDiCaprino: thats not the mansion
danielb123: Mart is Japanese for mansion
mik12f4: pretty cool game considering 11mb or less
helmutpas: its the house on the top letf of ksland
Mefe_1337: SourPls
Yoann_b: these mazes :'(
andamxx: Yep
danielb123: BASED
luspr: :D
SKPTCL: pokemon looks so hard now, I can only image how bad I was playing as a kid
votummy: manipulate statues from floor 2 -&gt; go up to floor 3 -&gt; drop down in the holes
andamxx: Go to the pillar area
andamxx: On the top
Mayfieldiv: those first stairs were the ones you want
SKPTCL: breadth first search, walk on every square xd
votummy: the statues are right next to the stairs
Mayfieldiv: second floor go up
the_gilps: oh we back at it!
andamxx: Yeah go back down
Mayfieldiv: there are stairs in the room above you
danielb123: Catch it PogChamp
drajza: what is the time to beat ? :&gt;
the_gilps: lol bolts
shieeeeeeeeet: did you get/use the rare candies?
SekstiNii: how is this a speedrun though
swingtradewizard: lmao
Mayfieldiv: activate statue now
grey_street: NotLikeThis
the_gilps: shit guide
swingtradewizard: why are people living in this crumbling building. doesnt seem safe
Mayfieldiv: down those stairs
swingtradewizard: lmao
Mayfieldiv: http://wiki.pokemonspeedruns.com/index.php?title=Pok%C3%A9mon_Red/Blue/Any%25_Glitchless/NidokingRouteExarion#Cinnabar_Mansion
Trindor_: pls not ign
andamxx: You need to get high from wheezing fumes first
luspr: RIP A
the_gilps: @Mayfieldiv oh nice
swingtradewizard: hes gonna get whited out
lolsloths: a.OUT
Nietzsche3: LUL
smurfd0: lol galaxy quest, need to see that again
Yoann_b: good night everyone. have fun and see ya !
swingtradewizard: cya
the_gilps: nite nite
Mayfieldiv: statue in that room
Mayfieldiv: yeah that room
the_gilps: checkout the link mayfield shared, that one looked good
swingtradewizard: now thats a guide!
Mayfieldiv: now right and up to the top statue
Mayfieldiv: left out of this room
Mayfieldiv: follow the black line on the map
zaubages: don't cheat with the guide 4Head
zaubages: ...
luspr: you do
swingtradewizard: cheater chads rise up
the_gilps: amen
luspr: please buy repels
eldac_kno: why he suddenly streams games?
shortgecko: are you sure you wont get sued by nintendo for this one
mysterykiller1234: @eldac_kno games r fun
the_gilps: jesus this place is a nightmare
swingtradewizard: REEEEEEEEEEEEEEEEEEEEE
mik12f4: what about 1st xcom speedrun next
luspr: sued by nintendo and sony PogChamp
480i: Use repel?
loopylol: what are the splits looking like boys
swingtradewizard: *covers eyes*
480i: @loopylol not quite WR
the_gilps: get me outa hereeeeee
loopylol: oh fk LUL
the_gilps: lol
swingtradewizard: only 40 minutes over WR
mik12f4: lol ok i think stress is kicking in
lasgce: lasgce subscribed with Prime.
zaubages: dont be bad
the_gilps: yeah lets never go back there
swingtradewizard: looool
the_gilps: lol
NatelBeats: pokéyelp
the_gilps: we should create one
Mayfieldiv: just review your local cinnabun
eldac_kno: hope george will play with unreal engine 5 in the future. Nanite is amazing
the_gilps: be like those amazon reviews that go viral
yodaskywall_: it is
swingtradewizard: dont waste your low pp moves on scrubs
TheRealMast3r: isn't it a trick to pop up a mew at start
NatelBeats: lol you know about the 50 gal drum
swingtradewizard: lmao
the_gilps: damnit swing!
panthurrr: LUL
the_gilps: lol
Nietzsche3: thunderbolt LUL
mucinoab: lol
luspr: LUL
luspr: noob
quickcheck: happens to the best of us
mucinoab: Dont simp Erica
luspr: You can only fly to places you've been at.
the_gilps: lol
YouPowerRush: indrekX_SG
swingtradewizard: a spam dominating
TheRealMast3r: What would be cool is to see how much calorie we can lose by pressing that button LUL
swingtradewizard: u might get arthritis too
the_gilps: shit
andamxx: Will George pass the gym IQ test
quickcheck: D:
tylertravisty: tylertravisty subscribed with Prime.
yodaskywall_: have to fight all of them
x_0_696969: spooood ruuuun
andamxx: in firered there are trivia questions
patcapp21: interact with the question machine so u dont have to fight the guys
helmutpas: try interacfing with the machines
BBBBenjo: interact with the machines in each room
zaubages: why do you torture yourself
swingtradewizard: to grow stronger
x_0_696969: ^
lasgce: hello
andamxx: time to determine George’s IQ
CaptainMoistNuclear: battles are still good for exp
x_0_696969: 9000IQ obv
danielb123: YES
luspr: PogChamp
zaubages: IQ is fake
the_gilps: BOOM
big_dog_genetics: that music is suspiciously close to yugoslav synth pop
danielb123: NO
danielb123: EASY PogChamp
swingtradewizard: WE JUST LEARNED IT
the_gilps: lol
quickcheck: trolling you
danielb123: PogChamp
x_0_696969: hacker
luspr: :D
the_gilps: hahha
enderowski: you are in
danielb123: it was TM26 no?
danielb123: LUL
grey_street: David Blaine
the_gilps: niiice
x_0_696969: truly fast much wow
danielb123: EASY PogChamp
the_gilps: all one-hits
Nietzsche3: gg iz bro
quickcheck: wiped
swingtradewizard: embarrassing for blaine
the_gilps: now we moving
c1rca1017: missingno
danielb123: BIG BALLS MOVE PogChamp
CaptainMoistNuclear: big dam
jusdapper: What's easier? Beating Blaine or beating Waymo
danielb123: GOLD SPLIT PogChamp
danielb123: WR PACE
zyph42: gold split LUL
Trindor_: up
CaptainMoistNuclear: top right
patcapp21: gym is at top rght
Trindor_: not that one
patcapp21: not this one
CaptainMoistNuclear: dojo is good but not necessary
BBBBenjo: wrong gym
Trindor_: theres another gym to the right
mucinoab: Sabrina is a sexy name
Aeolus9: wrong gym
andamxx: don’t do dojo lol
patcapp21: go to the gym to the left of this one
the_gilps: you ever had phil's bbq in SD george? driving down there from OC, was told to check it out
x_0_696969: Can You Beat Pokemon Red/Blue WITHOUT EXP?
c1rca1017: geohot lets run some warzone
x_0_696969: burning too much brain juice
luspr: :D
hiphopsucks: LUL
swingtradewizard: LMAO
zyph42: LUL its going worse and worse
hiphopsucks: smack that a
x_0_696969: LUL
luspr: world record will be hard
the_gilps: as long as we remember to save today
danielb123: GYM GYM &gt; GYM PogChamp
the_gilps: yesterday was heart breaking
x_0_696969: haxx
swingtradewizard: this stream is schadenfreude
x_0_696969: LUL
anac0nda3000: hellou
akiratoriyama91: No gta RP?
zyph42: EZ PZ
swingtradewizard: shes a dominatrix
mik12f4: lol
the_gilps: hm i dunno
x_0_696969: some BDSM whiiip
Trindor_: brock though Kreygasm
c1rca1017: geohot in nopixel would be kinda sick
krisa002: @c1rca1017 That would be a disaster lol
CaptainMoistNuclear: nidoking mvp
andamxx: need a baddie like Sabrina
x_0_696969: when was the last you played this @georgehotz
c1rca1017: @krisa002 he's insta chang-gang
TheKoreanZombi: Yesterday
krisa002: bet
CaptainMoistNuclear: straight up from pokecenter
luspr: right of the poke center?
Trindor_: did you beat giovanni already
luspr: i think
andamxx: yeah you need to fight giovanni
NuttyOdin: How many of you have played this game here?
shieeeeeeeeet: @georgehotz you need to fight viridian gym first
Trindor_: you need to fight giovanni 8th gym if you didnt
x_0_696969: i have
BBBBenjo: no
kdklv: GYM
luspr: @georgehotz its right to the poke center
andamxx: lol
CaptainMoistNuclear: it's north but you have to walk to the left around the wall
kdklv: gyovnnny
Trindor_: yeah this gym was closed when you first came here
andamxx: up
andamxx: Right
swingtradewizard: weeeeeeeee
hiphopsucks: COGGERS
krisa002: LMAO
krisa002: george needs to add the bettertv emotes ASAP
kdklv: this is faster than TAS
zyph42: BTTV emote, gotta add those it would be POGGERS LUL
krisa002: OMEGALUL
danielb123: how do i download poggers? :)
zyph42: @danielb123 LUL
Trindor_: ur doin it right i think
Mayfieldiv: you're supposed to fight this guy
Trindor_: just approach karate guy from under him now
the_gilps: alright ladies calling, i gotta bail, but i'll check out the recording later so don't forget to save this time
krisa002: pepeJAM
swingtradewizard: cya
krisa002: 350
danielb123: losing to a puzzle made to 7 year olds LUL
sufiblues: chat can you tell me why george is speed running pokemon
swingtradewizard: LAMPIN
kdklv: for lulz
Trindor_: ye you had to, otherwise he blocks the way when you try to enter from there
rawrrzfn: @sufiblues ManChicken Fun
swingtradewizard: u need an arduino controlled A masher
krisa002: ManChicken Clap WE RISE CHAT
Trindor_: theres a rival fight now on the way to victory road
andamxx: tes
rawrrzfn: PogChamp
kdklv: mc tendies mmm
shieeeeeeeeet: victory road gonna be cancer without repels
thundershots999: Is this the 3090 TI ?
phrixus_bro: awful dvs
luspr: buy repels before the dungeon?
krisa002: but do you have 120 fps tho?
andamxx: yeah You’ll need them
shieeeeeeeeet: idk how money-constrained this guide is, but if you can't buy all the things for elite 4, you will not beat it
Santiago_LHC: I'm back. What time are we at?
swingtradewizard: only 2 hours from the WR
480i: Basically frame perfect
Mayfieldiv: we're so close!
krisa002: :) 👍 GOOD PACE GEORGE :) 👍 GOOD PACE GEORGE :) 👍 GOOD PACE GEORGE
Santiago_LHC: Let's go!
kdklv: LESSGOOO
votummy: he's going to need so many repels for this
Trindor_: fly to island place
swingtradewizard: oof
andamxx: no
Trindor_: the island with blaine has them
480i: Fly to cinnabar
shieeeeeeeeet: if you want to buy super repels, fly to cinnabar/fuschia
Trindor_: ye cinnabar
480i: Cinnabar
Trindor_: its easier if u fly
kdklv: YES
480i: Fire gym place
votummy: yes
kdklv: FLY
votummy: you will lose like 10 hours
andamxx: yes
480i: Yes
votummy: you thought cinnbar was bad oh no oh no LUL
hiphopsucks: oh, u dont say
480i: You should
rawrrzfn: :) hope all is well chat
kdklv: STOP CINNEBAR HATE
Santiago_LHC: We all hate Cinnebar
phoxyie: whats he doing? he should code an ai to do this
swingtradewizard: oof
danielb123: racism will not be tolerated. STOP CINNEBAR HATE
andamxx: cinnabar has sick fossils
swingtradewizard: cinnabar is for fatties
480i: This is the best LP ever.
mik12f4: ugh why cant this music be copyright protected?
Santiago_LHC: This consumerist music is fire
Mayfieldiv: on the road from veridian city!
swingtradewizard: move your max repels up in menu
luspr: for the gym?
Trindor_: it was for blaine gym i think? i dont think u need it
votummy: the key from the mansion was to open the gym
shieeeeeeeeet: 3rd time he's jumped that LUL
swingtradewizard: kek
swingtradewizard: ahahaha
luspr: LUL
Trindor_: LUL
Keeqler: LUL
luspr: again
phrixus_bro: hahahaha
Santiago_LHC: CLASSIC
hiphopsucks: another one
CrossCommoner: its twitch plays pokemon all over again
swingtradewizard: my sides
Keeqler: POG
hcbritt: third time the charm :D
kdklv: LUL
zyph42: at least he is being consistent LUL
grey_street: Poggers
ric_gr3yson: That makes two of us
Santiago_LHC: THE ULTIMATE BOSS, a little shitty bump thing
Trindor_: thats after victory road
480i: Yeah you can
alexisabl: Hi @georgehotz  can you give me 1 ether against 1 sub :D 0x601028A4b3A52DBf43f3d506F0C2B0b0522Ab660
swingtradewizard: oh yeah u can buy those repels in here cant you....
swingtradewizard: theres a shop
Santiago_LHC: Wasn't the shop at the entrance?
480i: In the shop after the cave
Trindor_: shop is right before elite 4, not here
Mayfieldiv: lol you're about to use strength on a rock
LiveCustoms: HahaDoge
shieeeeeeeeet: imagine your job being to sit in the water and check people's badges
kdklv: this hurts
hcbritt: go up
swingtradewizard: comfy job
Trindor_: up
hcbritt: :D
andamxx: Nevermind, but cinnabar has the aerodactyl I believe
andamxx: lol
480i: Up
Trindor_: here we go
480i: You can bike here btw
Trindor_: repel
480i: Select changes order of items
Trindor_: yeah guide doesnt explain?
luspr: sokoban!
vrobel: wait why is he speedrunning georgehotz
480i: Strength
luspr: :D
shieeeeeeeeet: LUL
kdklv: LUL
shieeeeeeeeet: you were  doing the right thing, just don't leave
Arschkrapfen: LUL
Trindor_: go bottom from further left
luspr: push rock to the top
hcbritt: nooooo
Mayfieldiv: you pushed it 2 spaces too far to the right
votummy: push it from underneath
shieeeeeeeeet: oof
Trindor_: oh no LUL
kdklv: LUL
hcbritt: no as in dont go down on to the exit patch
480i: Oh no
hcbritt: but next to wall
hcbritt: :D
CrossCommoner: you can stand on the door
480i: Go down one
Trindor_: u need to get under the rock there
480i: Noooo
AveMariaaa666: speed run?
Arschkrapfen: LUL now this is content
480i: I think George is trolling us
luspr: IQ test
480i: He has to be
Santiago_LHC: It's not so easy
Santiago_LHC: I fucked up a lot back in the day
shieeeeeeeeet: tbh this is almost as hard as writing an algo to detect a car's speed from camera
Trindor_: victory road
swingtradewizard: lmao
luspr: victory road
Trindor_: not elite 4
480i: @shieeeeeeeeet probably harder
Trindor_: yes
Trindor_: that laddder
sudqi: yes
HydroponicGarden: @shieeeeeeeeet no this is much harder
Trindor_: dont need to do this part
luspr: @georgehotz it's called victory road
480i: Ladder
Trindor_: last puzzle is kinda hard
Mayfieldiv: https://strategywiki.org/wiki/Pok%C3%A9mon_Red_and_Blue/Victory_Road
swingtradewizard: REEEEEEEEEEEEEEEEEEEE
Trindor_: dont need to go down here
swingtradewizard: imagine listening to this music everyday for 16 hours as a pro speedrunner
plate0fshrimp: whats good
Trindor_: this is moltres area, no need to enter here, u can go back up the ladder
480i: @swingtradewizard that was our life in the late 90s
Trindor_: theres a boulder to the far east
Trindor_: u need to push it to west, under this ladder
Mayfieldiv: that's not a speedrunning guide, just maps of the area
plate0fshrimp: east or west?
plate0fshrimp: oh west
Trindor_: to that switch
plate0fshrimp: check out the big brains on brad
swingtradewizard: boo yah baby
sudqi: no go back
Trindor_: go back
sudqi: you need to move another ball
Trindor_: up the platform
LiveCustoms: Real men play Pokemon Emerald
plate0fshrimp: nice level loading times
Trindor_: yeah LUL
sudqi: go up to these stairs
mik12f4: i wonder how many more people would have played this game if it wasn't for the music.  killing me
Trindor_: and then go through the upper platform
swingtradewizard: oof
Santiago_LHC: The path to Pokemon master is dark and full of terrors.
mik12f4: me too
LiveCustoms: Yeh poke is poke
LiveCustoms: they're great games and pieces of ass at the same time
Santiago_LHC: Like life itself
Trindor_: now drop the boulder and you drop after it
LiveCustoms: indeed @Santiago_LHC Kappa
luspr: Imagine the grind of actually speed running these games
Trindor_: nono
sudqi: push the ball to whole
sudqi: the other one
votummy: drop the boulder and then jump down
Santiago_LHC: Boulders in the hole!
Trindor_: ok
Trindor_: now shove that one to west
votummy: push the boulder left
LiveCustoms: Very speedy, much run
Mayfieldiv: Shove the boulder all the way west to the switch. This removes the barrier near where it fell through from 3F. Climb up onto the platform and take the ladder to the third floor
wherethefismariojudah: @luspr you dont have to imagine it, you are experiencing it
Trindor_: thats it pretty much
Trindor_: that will get rid of the glass block thing
Trindor_: ye ladder
votummy: bets on whether he wipes or not?
480i: George did you have red or blue as a kid?
sudqi: go right to the machine
swingtradewizard: this is the pokemon center i would work in. very little customers
BruceWayne11x2: Alan Turing Month
patcapp21: toss the fossil
480i: Use the pc
480i: Deposit items
shieeeeeeeeet: @georgehotz save before each fight
CrossCommoner: good luck
votummy: monkaS
480i: Deposit
kdklv: mm tendies
plate0fshrimp: HeyGuys
kdklv: such speed
big_dog_genetics: i kiss the old George, the no troll George, the base your knowledge in the information tree George, the crunch and entire code for a chess ai in a couple of hours George
Trindor_: good luck monkaS
Santiago_LHC: We are almost there!
kdklv: wr pace
big_dog_genetics: miss kek
swingtradewizard: i remember when kids would buy magazine guides to help them beat pokemon
toledo60: you can’t pee during a world record, next time bring a bucket for your desk
Gladiar: cheats enabled?
andamxx: lmao @toledo60
TheKoreanZombi: Did the speedrunning guide advise you to go to the bathroom at that moment to achieve WR?
Mayfieldiv: so flier takes big first attack
Mayfieldiv: which missed
Trindor_: ai always uses psychic move because nidoran is poison type LUL
Santiago_LHC: YEAH LET'S GO
Trindor_: so they use rest/agility
Santiago_LHC: I'm going to start calling people SLOWBRO
kdklv: BOO YAH
Mayfieldiv: you have enough full restores
swingtradewizard: lorelei absolutely destroyed
anon_lambda: so good texture
smurfd0: Nice!
luspr: split
rudolphdoesgames: lets just ignore the real speedrun time and take the time you are slower as your final time
Trindor_: LUL
swingtradewizard: i hope he submits his run to the leaderboard
Trindor_: the comeback PogChamp
CrossCommoner: LUL
TheKoreanZombi: His Actions Per Minute are through the roof.
chr1stianlol: full restore for 5 hp 5Head
swingtradewizard: it does your pp too
luspr: baited
swingtradewizard: guess it doesnt
Trindor_: two battles left PogChamp
480i: Nice
TheKoreanZombi: Quicktime event
bradyry773: cant cycle indoors god damn
Santiago_LHC: YEAH
480i: Lance
Trindor_: famous last words Kappa
andamxx: gilf incoming
Santiago_LHC: split?
swingtradewizard: he did
andamxx: Nevermind
Trindor_: omfg
Santiago_LHC: woah
swingtradewizard: oh shit
swingtradewizard: "Lance is easy:
Santiago_LHC: TAKE IT
bradyry773: has he seen the mew truck yet?
TheKoreanZombi: Red bar strat
Mayfieldiv: you're so lucky
Santiago_LHC: ONE MORE DOWN
swingtradewizard: WEW
danielb123: That's why you need the speed LUL
bradyry773: how do i become a good pokemoner
Trindor_: why x speed when you can dodge like a boss LUL
Santiago_LHC: DIE LANCE
kdklv: chicken fight
andamxx: epic red bar
Santiago_LHC: CHAMP!
Mayfieldiv: full restore before entering room
Mayfieldiv: oh no
shieeeeeeeeet: KEKW
Trindor_: LUL
swingtradewizard: uh oh
swingtradewizard: lmao
bradyry773: pure nostalgia this
votummy: LOL
Trindor_: should be fine
swingtradewizard: wipe time
patcapp21: switch and use full restore when ur guy is out
480i: Uh oh
Trindor_: yeah
bradyry773: damn gary
smurfd0: phew
bradyry773: boooom
swingtradewizard: i never used any of these X speed stuff as a kid
Santiago_LHC: TAKE IT PIDGEOT
Trindor_: its over PogChamp
danielb123: SUB 4 HOURS PogChamp
Santiago_LHC: ALAKADOWN
Mayfieldiv: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
Santiago_LHC: More like RHYDON'T
bradyry773: gary looking crap!
swingtradewizard: HYPE
kdklv: OUR BOY BOUTTA DO IT
bradyry773: gary the amateur
rudolphdoesgames: only PBs from here on!!
swingtradewizard: I WAS HERE
brabo92: how does he one shots everyone ?
andamxx: horn drill is way OP
mucinoab: skills
Santiago_LHC: POKEMON MASTER AT LAST!
chr1stianlol: because the nidoking is gigabig
480i: X attack
kdklv: SPLIT
brabo92: PogChamp
underdog2000: horn drill is an OHKO move
danielb123: professional A spammer EASY PogChamp
mucinoab: 375 people ready
matty_bam: hahaha
shieeeeeeeeet: lex fridman has entered the chat
phrixus_bro: nice great job
Mayfieldiv: just under the 2xWR pace
bradyry773: gameboy Ai is the big thing for 2021
TheKoreanZombi: split
rene7551: you also have to train your neral networks with trust and love
PieIsEqualToExactly3: Spam A with Love
Trindor_: lets go PogChamp
luspr: luspr is gifting 6 Tier 1 Subs to georgehotz's community! They've gifted a total of 17 in the channel!
luspr: luspr gifted a Tier 1 sub to JesseDart!
luspr: luspr gifted a Tier 1 sub to painblanche!
luspr: luspr gifted a Tier 1 sub to SkywardDev!
luspr: luspr gifted a Tier 1 sub to JimDeezy!
luspr: luspr gifted a Tier 1 sub to compcold!
luspr: luspr gifted a Tier 1 sub to RARayze!
NatelBeats: PB boi
whyb_b: ggs
TheKoreanZombi: Amazing. Personal Best!!
weeva: huge
Santiago_LHC: YEAHHHHHHH
Santiago_LHC: AWESOME
Bombapil0t: POG
bradyry773: we did it
smurfd0: wohoo congrats :)
kdklv: YOO
alwayas_and_forever: Hello
CrossCommoner: PogChamp PogChamp
Santiago_LHC: I hear this is a RECORD in CROACIA
brabo92: SeemsGood
mucinoab: Play the credits
Santiago_LHC: *croatia
swingtradewizard: time to analyze the strats
bradyry773: no iced tea killed us
gamer_hope: what's up with the nihilism? 🤔
grey_street: Safari
Mayfieldiv: puzzles for 8-year olds killed us
patcapp21: read the poem from the beginning
TheKoreanZombi: This was the real event, you saw the real bar—higher than you could ever imagine. And you just walked back to the locker room.
ProDucks: smash 64 run soon?
rudolphdoesgames: bad rng to blame
weeva: that was fun :)
kdklv: pwn noobs
Nietzsche3: oh not, finish stream? BibleThump
bradyry773: gameboy AI ftw
480i: Super Mario 64 speed run next
chr1stianlol: now play pokemon red on RISC V
Zigiro: what is harder, pokemon speedrun  or AI programming?
gamer_hope: bomberman 64 speed run
TheKoreanZombi: All bow your heads during the joyful reading.
luspr: Are you reading on stream?
Santiago_LHC: Final Fantasy 8 speedrun
LiveCustoms: KFC
kdklv: TENDIES
bradyry773: chicken
phrixus_bro: chicken sandwich
andamxx: no sauce
mucinoab: vegan wings
shieeeeeeeeet: wow chat has some real chicken bias right here
kdklv: TEN DIES
citsejam12: chicken shawarma
swingtradewizard: lamb kebab
bradyry773: 3.42
Santiago_LHC: Link to reading material, class: https://slatestarcodex.com/2015/08/17/the-goddess-of-everything-else-2/
TheKoreanZombi: Better carb load after that endurance event
andamxx: fingie muscles need tendie nutrients
kdklv: mm tendies
shieeeeeeeeet: tacos
weeva: get a gyro
TheKoreanZombi: massaman curry
danielb123: ORDER SOME BUGS PogChamp
bradyry773: pad thai ftw
Santiago_LHC: I like a TIE
phrixus_bro: curry
kdklv: GOOD FOR YOU
swingtradewizard: pizza = carb coma
TheKoreanZombi: drunken noodles
Trindor_: that sounds so good
anon_lambda: quantum computer
citsejam12: ask them if they have papaya salad
citsejam12: spicy one
yakreboz: coders order pizza, programmers cooks themself
bradyry773: hit the iced tea my boy
swingtradewizard: based @yakreboz
danielb123: price went up because of the biden bros and their inflation
swingtradewizard: beautiful
TheKoreanZombi: Imagine Two Princes  one, two, princes kneel before you That's what I said, now Princes, Princes who adore you
yakreboz: @swingtradewizard my butt asdasdsadsad
thomas_the_tank_engine: ResidentSleeper
smurfd0: was this supposed to be Less sad than yesterday?!
JesseDart: @luspr Thank you for the gifted sub!
Trindor_: reading time
Santiago_LHC: CoolStoryBob
yakreboz: It's Alt+Tab o'clock
eldac_kno: reading time with geohot
MauriceChavez: can we read wikipedia next?
yakreboz: can we reed kuran after wikipedia
Santiago_LHC: speedread
TheKoreanZombi: We always read long form essays after Pokemon mastery. Keeps us centered.
rage_au: what’s going on?
SpeeDim14: the only reason i can see for him to read out loud is to train some tts ai
swingtradewizard: credence and blood feud  mmm :D
metasolid: yo
swingtradewizard: The Goddess of Cancer is pure, the Goddess of everything else is a false god.
TheKoreanZombi: clap
swingtradewizard: needing to conquer space isnt contentment
luspr: beautiful
Bow234: Pokemon was better
Errmergerd_: gg
shieeeeeeeeet: i might be missing the point, but doesn't this contradict your essay about power being the ultimate thing to optimize for?
Bacon4Life_: 5Head
Bow234: LULW
thomas_the_tank_engine: forsenThink didnt understand
votummy: stack up on repels
smurfd0: both very serious
Bow234: Do you actually want to discuss the human condition and morality with twitch chat?
ryuparish: Evolution is big for loop.
yakreboz: is there godess of everything else than everything else
mucinoab: are you?
D2Cookie: i'm anxious about everything LUL
MauriceChavez: what do you think the great filter IS? what form
TheKoreanZombi: Very transhumanist
Trindor_: this is pretty optimistic
pychainman: hey
swingtradewizard: vaccines @MauriceChavez
luspr: Do you think the goddess of cancer can be overcome by culture alone or do we have to transcend our biology
Busterpunker: I just entered the chat , what is yesterday's story titled?
TheKoreanZombi: Pressing "A" 4 billion times will wear a guy out
pychainman: what is this stream about? I just joined.
thomas_the_tank_engine: have you seen anonymous message to elon
phrixus_bro: it was the gray mirror essay to paul graham
yakreboz: dang the pokemon, lets play some valorant
Errmergerd_: please go on
broccolight: Do maths
swingtradewizard: we'll never overcome it, its just wishful thinking @luspr we'll cease to be human when we "overcome" it
luspr: So... singularity, but just more cancer?
eldac_kno: have you seen Nanite? simulation is near
rage_au: @thomas_the_tank_engine  real or fake ?
thomas_the_tank_engine: @rage_au dunno seems to be on their youtube channel
Chronark: just joined, tf is he talking about?
swingtradewizard: we have totally gotten worse at politics
swingtradewizard: people vote for the handsome candidate
Busterpunker: I absolutely concur
anon_lambda: mRNA?
swingtradewizard: wait for the governent cyber security committees to deal with ransomware
dedsylva: I think that at the beginning the singularity will be difficult for our 'society', but at the long term I think that we will have more freedom to do literally anything we want, because people won't need to 'work for a living', as some do today
TheRealMast3r: what does communism mean for AI lol
MauriceChavez: neuralink gonna mindcontrol us
Bow234: "AI's will create perfect communism, my boyfriend told me"
swingtradewizard: our brains shrunk after grain became a staple diet, we are meat eating hunters
votummy: I can't wait for humans and machines to start intertwining to push us past our physical limits
swingtradewizard: civilization was a mistake, again. the god of cancer is pure.
Bow234: Biological decline is mostly bc of toxins in our food and environment
jasondesante: this is why trump farmed eastern europe for women
anon_lambda: @MauriceChavez but, I think that he should do that because george googled word when read these blog.
luspr: will those darwinian speculations even matter when we can control biology?
outlier2: Singapore IQ shredder: https://spandrell.com/2013/03/26/lee-kuan-yew-drains-your-brains-for-short-term-gain/
INSPIRAT3D: jo
swingtradewizard: thats interesting. never heard of the IQ shredder term. reminds me of brain drain.
routerkicker: we have to shrink industry like the transistor instead of making bigger factories.
thomas_the_tank_engine: the only way communism can be achieved is through technology
thomas_the_tank_engine: grimes is sort of right
shieeeeeeeeet: is global coordination/agreement the best way to achieve a favorable singularity?
mboumaza: Guys remember, there is only one god and that is George
votummy: @thomas_the_tank_engine that's only assuming that the technology isn't built to favor the already wealthly/powerful
anatman_: @thomas_the_tank_engine true, but she also assumes the people in control of these systems will use them in benefit of everyone
jasondesante: eth'ism is the future
swingtradewizard: globalism is horrible. it makes the weak hate themselves comparing themselves to the strong.
thomas_the_tank_engine: an abundance of everything, humans have dont produce anything anmore, ubi for everyone
df_train: what do you think about recent UFO videos?
eldac_kno: communism is ideology based on envy, it will always fail
TheRealMast3r: do you believe in Pinker POV on war declining for decades or Taleb views
anatman_: @thomas_the_tank_engine why would the people who have an abundance of everything give a share to everyone else?
rage_au: i think communism is for people who arnt willing to work hard to achieve good things
anatman_: steven pinker is so naive lmao
donutcentral: communism doesn't mean no work; that's just modern zoomer doomerism.
thomas_the_tank_engine: @anatman_ we're talking about huge spikes in production, the only way you dont have acess to abundance is through some sadistic comic book type of evil
TheRealMast3r: Interesting thanks
swingtradewizard: lots of people think Nuclear weapons are psyops
votummy: nukes have already been fired no? That's why we have anime
TheKoreanZombi: If Russian gov't sponsored the  gas pipeline hack, is that an act of war?
brickeyy: LUL
anatman_: @thomas_the_tank_engine good point, but i also don't think that situation is outside the realm of possibility
routerkicker: nuclear weapons can be defeated by spreading out through the galaxy. how can ai weapons be defeated?
shieeeeeeeeet: wait, why is coordination bad again? because people get complacent in utopia?
TonedF: Helen Keller was made up to make kids believe they can achieve anything they put their mind to. I won't stand for it
64pillars: will ai replace communications departments for companies
donutcentral: There are anti-semmitic currents on the left, for some reason.
plaintext: to some extent it already is
marko_sreck: George Finally caught you live!
Trindor_: LUL
eldac_kno: there is photo where von Braun is in front of Saturn V, he used slave labor during WW2 and then participated in one of the most advanced science feats. in the span of 20 years crazy
dedsylva: do you agree that people got worst these last 20 years as technology got better?
plaintext: anti zionist is not anti semitic
BruceWayne11x2: The International Space Station
shieeeeeeeeet: you can't say something never happened isn't viable when talking about the singularity :p
swingtradewizard: @dedsylva you can easilly show this to be true. look at school tests from decades ago compared to tests now...
swingtradewizard: they were much, much more challenging
7488dubbk: know of any applications of euler diagrams?
plasticityyy: what's the best case scenario for nuclear weapons? spread out to other planets before they're fired again seems unlikely...
anatman_: but we are intrinsically part of nature no?
BruceWayne11x2: I want Nuclear Fusion by 2040
dedsylva: yeah, but the tests are not as accurate as before
UntiedSoul: I mean you can, it has to be a factor of time, I thought IQ was proven false
BruceWayne11x2: ya
mik12f4: money
vollous: Did you went to college?
64pillars: depends on ur country in EU they dont require high school
whats_up_baby: George, add me on instagram
mucinoab: only like 30% of mexicans go to uni
atlaslobster: Jobs required more education. Back in the day people didn't need education for farming
votummy: @UntiedSoul IQ is very real
thomas_the_tank_engine: if it got dumber it got for everyone, cause the US still dominates universities
whats_up_baby: Iq was proven false KEKW
anatman_: @UntiedSoul intelligence isn't reducible to IQ, but IQ is also not a useless metric
swingtradewizard: @thomas_the_tank_engine bro China dominates all innovation now
thomas_the_tank_engine: @swingtradewizard name me one
Cracktune: @geohotz do you post a blog?
swingtradewizard: AI, robotics
swingtradewizard: 5 more i forgot about
TheRealMast3r: IQ was proven false by Nassim Taleb actually, and his paper is pretty solid statistically speaking
ananasfringant: have you passed an iq test?
Bacon4Life_: LUL
donutcentral: Well,  an alternative to educational standards declining is the idea that intelligence is also correlated to environmental factors which have gotten better over time (lower level of pverty, etc.)
smurfd0: https://geohot.github.io/blog/
thomas_the_tank_engine: @swingtradewizard having a lot of engineers/ research papers in a certain field doesnt equal inovation
anon_lambda: do you think mRNA solution
BruceWayne11x2: IQ is relative
eldac_kno: IQ is good predictor, but bad test for intelligence
JesseDart: Every generation from here on will be worse than the previous.  The Great Filter in action.
4ll0x: @TheRealMast3r 1 person
UntiedSoul: but genetically not everyone is going to have the same range of IQ, so you would have to have the low/mid rangers be productive too right
BruceWayne11x2: 100 is average
shieeeeeeeeet: @JesseDart you mean the previous generations with slaves and shit?
ananasfringant: we the best as Khaled said
7488dubbk: will euler diagrams be useful to AI?
SIMPalaxy: IQ is useful for statisticians and psychologists. An intelligence test may be useful for individuals given you get more out of it than a number.   Knowing what you're good at is worthwhile.
eldac_kno: IQ supposed to work on macro level, not individuals
ananasfringant: where is France in here?
whats_up_baby: cmonVruh
whats_up_baby: cmonBruh
xMimmer: Hey George. What's your dream?
l4ndd0: its just a coincedance Kappa
TheRealMast3r: Goodhart law or even wittgenstein law make me feel stupid every time I talk about IQ
mik12f4: how do you cope with stupidty?
Busterpunker: @ shieeeeeeeeet actually today there is more slavery then ever in history
sanneck: “The minimum IQ required to destroy the world drops by one point every 18 months.”
votummy: which intelligence did you take?
rage_au: 2020Partnered
swingtradewizard: sperm morphology has also been declining for civilized men
votummy: intelligence test*
sangor: LUL
localcanofdutchgold: and more cookies
Bacon4Life_: og slavery LUL
l4ndd0: true
anatman_: how is UBI analogous?
anon_lambda: new solution born from quantum computing. will die x86
spitza: Any thoughts on the whole UFO sightings?
xMimmer: Hey George, what is your dream?
lightb00k: how is UBI slavery?
64pillars: wat about uyghur slavery
TheRealMast3r: wittgenstein : "Unless you have confidence in the ruler's reliability, if you use a ruler to measure a table you may also be using the table to measure the ruler"
swingtradewizard: you will own nothing and you will be happy
ananasfringant: what's UBI?
Busterpunker: yes depends on the actual definition but like forced labour and/or being held against your will
sangor: true LUL
swingtradewizard: UBI takes power away from everyone. no businesses. no power.
l4ndd0: lmao
eldac_kno: what about slavery in Russia? It's called "Serfdom"?
routerkicker: instead of ubi everyone should have a backpack sized fabricator
shieeeeeeeeet: why?
7488dubbk: who r ur favorite mathematical physicists
Izimoney92100: what made you change your mind?
UntiedSoul: do you think a post scarcity star trek society will ever be achievable
anatman_: why?
gooodgulf: UBI is just a simpler income transfer system to one that only pays for doing nothing
mucinoab: whats ubi?
Davizzpin: 16 million Americans believe chocolate milk comes from brown cows
thx1342: universal basic income
Izimoney92100: universal basic income
anatman_: @mucinoab universal basic income (free money from government)
vollous: I think we will reach a point where everything is so automatized that we have to give food and houses because there will be not enough jobs for everyone
BruceWayne11x2: Kardashev scale
RileyReidABook: what's the alternative for dealing with automation taking jobs?
swingtradewizard: destroy them
swingtradewizard: use a sledgehammer
thx1342: the purpose of everything in the universe is to consume energy, increase entropy.
eldac_kno: slavery in Russia was quite different from other slaveries
gooodgulf: I mean at the moment people are explicitly paid to do nothing
TheKoreanZombi: Use more energy from any source?
ileno: watch the world clock debt
luspr: finally, someone speaks about this truth about energy usage. it's insane and anti-human that people think we will use less and less energy.
thx1342: we are here to increase complexity and consume every last scrap of energy
smurfd0: if that is Good energy, not energy causing global warming
thx1342: the cause of global warming is not energy consumption, it's the source of energy we use
zaubages: i am gonna put my money in horses
NatelBeats: horse census must be very recent
swingtradewizard: F horse bros
donutcentral: You can think of it as a decline or as a return to the mean.
xMimmer: What is your opinion on the development speed of the Covid-19 vaccine?
eldac_kno: People ate a lot of horse meat in 1950s it seems
routerkicker: nuclear power solved that
UntiedSoul: more efficient usage of energy and horses
thx1342: consume less energy is anti universe
shieeeeeeeeet: my AI's goal is to accelerate the heat daeth of the universe
zaubages: we should be naturals and be vegans :(
Busterpunker: we need fusion
thx1342: increase entropy. that's the whole deal
naplevente2: i overclocked my gpu, im glad im part of the revolution
donutcentral: Also stop factory farming
dedsylva: I think the saddest part of the singularity is that it will probably be started by 'big tech companies' like Google
zaubages: ted kasinsky talk about that be careful boys 4Head
mik12f4: smart people need to relate better  maybe
Cracktune: dont worry fusion is only 10 years out.... (said every 10 years)
eldac_kno: Google makes money on ads, not technology
ananasfringant: @zaubages 👀👀👀👀
abhiksark: which is your fav AI company ?
abhiksark: which can bring singularity
TonedF: But money though...
swingtradewizard: all the smart people go to fintech, awful
ileno: Got an offer for AWS, should I take it?
Busterpunker: I dont want to lose google maps :(
spitza: In case you missed my previous question, any thoughts on the UFO sightings made official recebtly?
thomas_the_tank_engine: more like manipulation
altingamingyt: i thought it was pokemon stream
64pillars: bitcoin &gt; finance industry
shieeeeeeeeet: @georgehotz do you believe that people should be rewarded/punished for their genetics/environment they grow up in? don't these fully determine their potential for contribution to society?
tcusa: aws is famous for its toxic culture
UntiedSoul: that's what happens when everythings free
anatman_: the ufo thing rn is a psyop
SIMPalaxy: financier -&gt; cut-taker
SIMPalaxy: I like it
pwnbase: why do you think Zuckerberg did equity engineering to keep his majority stake in FB
MauriceChavez: big money ruins everything
altingamingyt: did you finish the speed run?
PhineasPhreak: @Busterpunker whats happening to google maps
Bacon4Life_: isnt finance just putting a price tag on time and risk?
swingtradewizard: when the gov talks about UFO theres other stuff going on they dont want you to pay attention to
UntiedSoul: even horses need carrots
TonedF: Finance jobs wouldn't be so attractive if money wasn't so hard to get for average people
xMimmer: What is your opinion on the development speed of the Covid-19 vaccine? And did you get it yet?
eldac_kno: Google is just and ad company
ananasfringant: by the nodes
smurfd0: jup large farmings adds to methan gases that causes more greenhouse gases
shieeeeeeeeet: @georgehotz by the way society is structured. eg capitalism rewards those who are good at optimizing for money
sanneck: would you like to dedicate yourself to politics in the future?
zaubages: this shitty world ... i just wanna be drinking a tea in my bedroom...
Cracktune: @shieeeeeeeeet its all luck ... how can odds be a little more even.
agabakinsoda: whats your stance on socialism
muralha__: Elon Musk? Kappa
luspr: I quit my faang job in part because of you reading your "sell outs" blog Post.
jambikus: george do you have a tip for all of us miserable fat college dropouts who do know programming but they cant get past through 82 interviews every firm is asking for before hiring you
abhiksark: @georgehotz which is your fav AI company? and who will bring singularity?
brickeyy: did u take the vaccine?
MauriceChavez: @muralha__ what happened with the loop? i heard it got shafted
eldac_kno: if you like socialism go live in North Korea
anatman_: thoughts on universal healthcare?
Busterpunker: @PhineasPhreak George was talking about the demise of google
zaubages: @luspr where is that blog, gith?
swingtradewizard: what things have bugged u about covid response @georgehotz
thomas_the_tank_engine: have you seen the anonymous message to elon
BruceWayne11x2: Industrial Capitalism
PhineasPhreak: @Busterpunker oh ok
JesseDart: Until we got $10 2x4s because all the lumber workers are making more money staying home.
siriusb_79: alphabet
routerkicker: have you seen the android event thing?
naplevente2: couldnt they just buy off small startups, where the smart people go?
l4ndd0: lol
thomas_the_tank_engine: its pretty cringe
zaubages: you meet elon ?
ananasfringant: what cultural problems?
ileno: Same as the company I work for here in Japan, big tech one, toxic and corrupt af
swingtradewizard: money printer go BBRRRRRRRR
luspr: @zaubages https://geohot.github.io/blog/jekyll/update/2021/04/20/sell-outs.html
Izimoney92100: what do you consider as sound money?
xMimmer: Is Elon damaging cryptocurrency with his Twitter posts?
eldac_kno: why unchecked capitalism is bad? what do you think about free market?
thomas_the_tank_engine: what about 1 billion
commandpaul: 🙏
swingtradewizard: you should see how much money Canada printed... pathetic. doomed economy
tsakal0ss: can u list 2-3 of ur "heroes" - idols!
zaubages: @luspr ty man
UntiedSoul: do you think i should quit and join academia
altingamingyt: never sell out George,gg.
AzzoDio: why is elon always talking about random crypto stuff, it feels beneath him
swingtradewizard: elon is a glowie
l4ndd0: based B)
BruceWayne11x2: lets make a StarShip
TheRealMast3r: What if your investors doesn't want that though
PigeonsDontFlyFar: it can buy you a cookie
TonedF: You already have a lot though
votummy: @eldac_kno unchecked capitalism is why we used to have literal kids working, in a completely unregulated market the health and sustainability of people/society doesn't matter, only growth
donutcentral: You can be pro redistribution and against socialism, the welfare state is something that can exist in both capitalism and socialism.
PigeonsDontFlyFar: money can buy you a cookie
BruceWayne11x2: or at least plan for one after we die
shieeeeeeeeet: they're goodharting their bank account balance
TheKoreanZombi: What if they gave you 1 million instagram followers?
macrovest: buy competition to delete it
TonedF: I don't mean money
PigeonsDontFlyFar: If you want a cookie it cost money
PigeonsDontFlyFar: You need money to buy a cookie
tsakal0ss: Can u list 2-3 of ur "heroes" - idols!
PhineasPhreak: $78k?? have you tried working for facebook instead
TonedF: You have the dignity of living and surviving on your own
eldac_kno: @votummy well, healthy people are better workers it will be in the interest of capitalist to have healthy people
TonedF: A lot of people don't even have that
BruceWayne11x2: you can make a cookie on a farm
PigeonsDontFlyFar: If you want a cookie you need money
zaubages: u can go to the forest
ananasfringant: who is the last great genius?
Busterpunker: so true
swingtradewizard: nikola tesla
donutcentral: Redistribution of wealth (through taxation) to pay for healthcare, education, public utilities, social benefits.  Socialism = no private enterprise
donutcentral: different things
Chilaxathor: so true :D
xMimmer: You stated that you like Elon Musk. What is your opinion on what he does to the cryptocurrency community?
TheKoreanZombi: What things don't you have that could help you achieve your self-driving goals faster?
votummy: @eldac_kno but that wasn't the case for miners though, as long as people don't die instantly and someone else can replace them instantly than the market doesn't care
TonedF: Medical debt
le0n_: Generally people arent looking to solve their problem, they want to complain about them
BruceWayne11x2: Domain Theory
BruceWayne11x2: old school physics
commandpaul: I have a lot of respect for you and your vision and your mission 🖖
ileno: @xMimmer No point of talking about mr elon dump
timumba27: in america they are
eldac_kno: @votummy miners were exploitated because state and monarchies, not capitalists
routerkicker: dude crypto bros stop with the stupid shit
TheRealMast3r: In my country education is free and difficult to pass
abhiksark: college is bigger scam
FargioFarmani: Should I use Haskell more often to impress girls?
anatman_: what about the obvious effectiveness of socialized medicine in every 1st world country besides the US?
mik12f4: your a smart guy and seem like a caring person.....why don't you try helping society in some way?  Don't ask me what, lol
UntiedSoul: aren't you helping "other" people with self driving though
Gazny: How do I prove I know how to solve a networking problem, when I don't know the problem?
wasabi2531: Why do you use macOS dude? Didn’t you actually critique apple? I have liked apple for a long time btw, now linux and windows.
tsakal0ss: Can u list 2-3 of ur "heroes" - idols! @georgehotz
Tornyl: @FargioFarmani good one
binary_stream: what part of pokemon red is this
be9ns: I mean windows is cheeks
naplevente2: during war times, you get good education
altingamingyt: peter thiel said we give up finding answer to immortality so we settle with healthcare.
le0n_: Education is a buzzword in america along with "healthcare"
eldac_kno: education in Russia is free, and there a lot of world class STEM students from Russia, because it is hard but free
swingtradewizard: based geohotz. ban GMO. ban HFCS
localcanofdutchgold: but freedom bro
shieeeeeeeeet: regulate mouth opening!
agabakinsoda: isnt that because of greed and capitalism
abhiksark: do you like europe healthcare?
livebullsh1t: not a scam if u're rich
zaubages: show the samsung graph with the others ones
Cracktune: GMO ftw
swingtradewizard: NO ITS NOT
Errmergerd_: broccoli is gmo
le0n_: strawberry too
swingtradewizard: thats why we're all getting cancer
jucybooty: HypeHeyFriends HypeHeyFriends HypeHeyFriends
KunstPhrasen: Disrupt the horse industry when?
votummy: @eldac_kno what do you mean by state and monarchies? Capitalist are people who own capital and deploy that capital to make more capital right? As a capitalist you NEVER want to lose your "assets" so you have a unique interest in earning money, if you don't then you fail the capitalist game
MiniMimX: how can you stop people fom making themselves fat? create a fast food black market? lol
anatman_: @swingtradewizard you're so stupid if you think GMOs are dangerous lmao
deadfr0g: WutFace
donutcentral: You're talking about regulating food industries; when people talk about healthcare in political circles they mean things like single-payer, m4a, etc.
ihatemidsmurfs: @georgehotz so humans never ate fruits before?
Chilaxathor: have a good one bro, going to sleep :D
BruceWayne11x2: farming is hard, it's why the soviet union fell apart
l4ndd0: is GMO just selective breeding?
Bacon4Life_: i love gmos
mik12f4: its where all high sugar comes from now
MauriceChavez: weve been breeding for thousand of years
altingamingyt: LUL omg its bussines insider. did you write your apology yet? LUL
BruceWayne11x2: be carefull
swingtradewizard: WHO CARES. Cancer booms
ihatemidsmurfs: we used to eat meat only
MauriceChavez: thats all gmo
HydroponicGarden: looks delicious
ananasfringant: tf is that article
le0n_: if someone cut into a watermelon todya and it looked like that they would try to return it
ileno: GMO is being a thing for thousands of years, since we farm our own shit we started mixing and modifying our crops
le0n_: little do they know...
salvdelg: best substack/blog/newsletter that you read other than ACT and lesswrong?
anatman_: @swingtradewizard link me a paper with evidence GMOs cause cancer
eldac_kno: you are confusing GMO with selective breeding
wasabi2531: Why macossdds
PartyDip: watermelon is bussin
xMimmer: That looks delicious
votummy: @eldac_kno by virtue of being a capitalist, you have a unique interest in making money at the expense of anything else, because that's what capitalism is
wasabi2531: Whyyyy
routerkicker: gmo doesnt cause cancer LUL
qq818: now we even have square watermelons
jucybooty: My cock is GMO
altingamingyt: $10000 tip
swingtradewizard: GMO is a bandaid solution.
wasabi2531: Tell me why program in macos, not win or linux?
TheKoreanZombi: Don't bring it to door, you get a non GMO watermelon.
patkarmobile: george have you ever tried the sneaker/ticket botting industry? there
le0n_: crony capitalism != capitalism
BruceWayne11x2: true
patkarmobile: there's a lot of interesting things with bot protection and bypassing
BruceWayne11x2: pi = 0
eldac_kno: GMO is not the same as selective breeding lol
FargioFarmani: There is this interesting paper showing extreme opponents of genetically modified foods know the least but think they know the most about science. [1] @georgehotz
ihatemidsmurfs: lol they do it for the love of the country then?
luspr: people like to change definitions.
eldac_kno: Banana and Watermelon were selectively bred, not GMO'ed
HydroponicGarden: @eldac_kno GMO is safer
FargioFarmani: [1]: https://www.nature.com/articles/s41562-018-0520-3
vollous: Its a bit stupid how in a capitalist society companies are in need of bailouts all the time
tcusa: modern GMO is different from domestication of plants
ihatemidsmurfs: nothing wrong with doing it for money
altingamingyt: replace for profit with for honor
luspr: we are not living under capitalism today.
plasticityyy: best way to price in externalities?
shieeeeeeeeet: free market prices are set by self-interested agents
rbsrbs: came for the pokemon speedrun, stayed for the chat stupidity LUL
agwl: @vollous then it's not a capitalist society dude
donutcentral: You can have markets and something akin to socialism. Google 'market socialism' if you are curious.
alphamenacegang: Just wanted to say I've been loving the new song, its fire
le0n_: we have state capitalism
NatelBeats: capitalism requires capital
xMimmer: Any pro cyber security tips before my exam on Monday?
sangor: but instead they print money LUL
TheKoreanZombi: Cyber security is a scam
livebullsh1t: system is collapsing anyway
vollous: @agwl I agree, where is the risk. You win, you get money. You love, the governments gives you money
agabakinsoda: humans are greedy
salvdelg: salvdelg subscribed with Prime. They've subscribed for 9 months!
altingamingyt: @le0n_ china is state capitalism
Busterpunker: price discrimination
agwl: @vollous Yeah, that's a free market.
swingtradewizard: skimmers and middlemen
eldac_kno: George, Banana was domesticated not GMO
donutcentral: What are your thoughts on Social Wealth Funds?
ihatemidsmurfs: without middleman your proudct wont sell tho @georgehotz
donutcentral: Like the one in norway, etc
tsakal0ss: Can u name 2-3 of ur idols!
routerkicker: b for banker LUL
guts_pc: people in third world countries suffer due to manipulation of capitalism for ulterior motives
Gabulhas: How about going  Ted Kaczynski? Planning on saving some money, going to the middle of nowhere and not caring about anything.
le0n_: the management class?
livebullsh1t: gold standard was tangible. with fiat, it's non sense
anatman_: @livebullsh1t the value of gold is also intangible. it's abstract
yorden7: buddy of mine is at ibm rn and it's 90% meetings
abhiksark: do you think amazon is anti capitalism?
Rickytickytastic: "bankers" don't really move anything tho
guts_pc: innovation doesn't drive things anymore
swingtradewizard: thats horrific @yorden7
kaysmusic_: where is that article?
ileno: @Gabulhas I am saving currently to do so, move to middle of nowhere and watch the fucking world burn
le0n_: MMT!!!!
livebullsh1t: u actually own something of value with gold
votummy: I would compare our current system to a more modern version of feudilism. The poors can't acquire assets, the rich own and rent out assets to extract wealth. the average rate of inflation outpaces the minimum wage so people are valued less and less every year
le0n_: look up the keyens quite
le0n_: quote*
swingtradewizard: thats why they killed gadaffi, he tried to move africa to gold standard.
livebullsh1t: something u cant make
ileno: @georgehotz https://usdebtclock.org/world-debt-clock.html
altingamingyt: fiat is non sense, i will start using egg as money.
shieeeeeeeeet: currency should be based on units of energy/increase in entropy
guts_pc: people are the cheapest resource
ileno: That clock is insane
abhiksark: @shieeeeeeeeet this makes a lot more sense
routerkicker: eth is bout to get really cool hopefully
agwl: Doesn't 1B kind of improve the 3rd class (the ones that does efficiency improvements)?
BruceWayne11x2: labour
krisa002: guys i am very d u m b but am i welcomed here still?
swingtradewizard: thats a good point. more people should learn about money.
Gabulhas: @Gabulhas Yeap wanna do the same. I don't know how people live in big cities
livebullsh1t: crypto is like gold, ressources aint unlimited
ileno: @shieeeeeeeeet This is insane good imo
donutcentral: Most economists agree that MMT doesn't work: https://www.igmchicago.org/surveys/modern-monetary-theory/
ihatemidsmurfs: why are programmers so political?
keiner2: aren't bonds all negative right now?
swingtradewizard: high IQ @ihatemidsmurfs
eldac_kno: are you libertarian?
xMimmer: What is your definition of a "good" programmer?
Rickytickytastic: infinite supply
zaubages: @ihatemidsmurfs cause they need secs
votummy: in the US you're better off investing right now because the inflation rate is higher than bond rate, some areas in EU bonds are indeed negative @keiner2
ihatemidsmurfs: @eldac_kno he is a librarian
Gazny: How can crypto have value without people buying it
swingtradewizard: society is the 5% intuitive people battling it out over controlling or enlightening the 95% of plebs
takroli3: look ar the solana
le0n_: if you are not concerned with this then the politicans got you right where they want you
rbsrbs: chain of trust
ihatemidsmurfs: @georgehotz how's the AI project going for the car, I checked in last 1 year ago
vicfred: have you tried to learn another language?
routerkicker: make better services than the government
BruceWayne11x2: Engineering
livebullsh1t: about crypto, chia owned the storage market.
thomas_the_tank_engine: i never got crypto. its all ideologically based, doesnt actually provide value to the average joe
johnny_mucambo: what you think about holochain ?
livebullsh1t: so bad
tcusa: let's have a blockchain based government! let's make this happen!
TheRealMast3r: right we want a freely available medium of exchange, not top down but bottom up, no more "education" but apprenticeship, etc
swingtradewizard: you need philosopher kings to have engineers making the decisions
Gazny: Have you read the Leviathan by Thomas Hobbes ?
mik12f4: Would you ever get in to politics?
altingamingyt: @gazny crypto have vakue to me, i dint have cc and Paypal  to pay stuff online so i use crypto.
rbsrbs: you do stuff that people want or atleast think they want
xProtheanx: @Gazny is it good?
shieeeeeeeeet: @georgehotz currency should be based on units of energy/increase in entropy instead of whatever arbitrary backing we have now
naplevente2: have you ever heard about the liska model?
salvdelg: nice blog/newsletter that you read often?
ihatemidsmurfs: the fees kill cryto for me @georgehotz will there be a no fee transfer currency?
Gazny: @altingamingyt ty
votummy: @georgehotz we both know America won't let that happen LUL
swingtradewizard: stop importing all the smart people from the third world, big problem.
donutcentral: Are you familiar with John Rawl's 'Original position'?
krisa002: and the funniest thing is that all these society and economic terms only lives in our head lmao
eldac_kno: antinatalism sounds better and better everyday
smurfd0: something invisible was sold for like $18k and it was not a nft
yorden7: @swingtradewizard why is this a problem? genuine want to know
Gabulhas: Is it normal that CS students know shit after graduation? I'm about to graduate and a friend of mine just told me that he doesn't know how to code
xMimmer: Any good programming books you can recommend?
anatman_: @donutcentral Rawls*, and also he's extremely based
timumba27: @altingamingyt how do u buy crypto tho? without cc
swingtradewizard: because those third world countries will never improve if all the intelligent people leave their homeland @yorden7
swingtradewizard: and its our fault for facilitating them
vicfred: have you tried to learn another language?
keiner2: yeah IP is BS
ihatemidsmurfs: the fees kill cryto for me @georgehotz will there be a no fee transfer currency??
sangor: PogChamp
hardtarget4: cheapeth
votummy: @Gabulhas it's somewhat uncommon but it's not unexpected, college is worth only what you make it worth. computer science != coding
Rickytickytastic: theres so many feeless crypto lol
yorden7: @swingtradewizard Interesting, thx for the response
BruceWayne11x2: thoughts on the IEEE
johnny_mucambo: Are you familiar with Holochain @georgehotz
routerkicker: do you think mit or no license is better?
ileno: @ihatemidsmurfs there are tons of coins with almost no fees, what you talking about
donutcentral: 'A theory of Justice'
altingamingyt: @timumba27  OVO wallet apps, i top it up with atm tranfer.
anatman_: rawls &gt; nozick
timumba27: @altingamingyt oh makes sense thx
ihatemidsmurfs: @ihatemidsmurfs they are very bad
lawlster_420: Anarchy with crypto driven hedonism!
anatman_: @lawlster_420 based
Rickytickytastic: there is many NO fee crypto.. xlm for example
paultaylor12: I love to listen to uncle george and his rants
swingtradewizard: majority of transactions using BTC do not even go on the blockchain. its just coinbase shifting numbers in a database.
mucinoab: factorio but with war
rbsrbs: 1 planet? not for so long
Pectus_1: yoooo i saw u on Youtube ur crazy man
le0n_: its all an information war these days
guts_pc: what are your thoughts on the UFO report by congress this month
keiner2: information is energy though
AzzoDio: All wars in the futute will be settled by speedrunning
tsakal0ss: Can u name 2-3 of ur idols! Last time i ask ^^
swingtradewizard: he said its distraction @guts_pc
Pectus_1: ur brain is difffrent then everybody else
xMimmer: Can any of you recommend a game that teaches programming?
guts_pc: oh
siriusb_79: people can't pay a bit of fees, but take +- 10% daily volatility
boobatube: George's idol is Dan Bilzerian
routerkicker: informaftion is not energy lol. computation doesnt actually need energy
ileno: @siriusb_79 True
Gazny: ggs
routerkicker: byebye
anatman_: good stream dude
Trindor_: thx for the stream
boobatube: eat some ass dude
我不做人啦: 88
swingtradewizard: peace
xMimmer: cya!
salvdelg: bye george
Tornyl: bye
Cracktune: thanks for the stream
nancyxmancy: &lt;3
mucinoab: bye bro
altingamingyt: gg bye
FargioFarmani: georgeL xqcL
swingtradewizard: 88
zaubages: see you TPcrunchyroll
commandpaul: Thank You
th3_maj0r: lol
agwl: thx
kaysmusic_: ggs
paultaylor12: gg
ihatemidsmurfs: thanks
lightb00k: Bye George
deadfr0g: good stream m8
[Music]
[Music]
unmuted warning all right so we're we're
in the Divine Beast
Ruda uh that's the master control thing
and we can't go to it until we activate
terminals so I used magnesis on this and
I used cesis over
here um I'm not very good at this game
I'm very good at games in general but
this is what we're doing this morning
and I thought you guys could join like I
was going to stream but we're not doing
computers this morning we're playing
breath of the
W
um I got to Nintendo switch
controller uh this is the Wii U breath
of the
wild
uh maybe you guys can maybe you guys can
help me with this
puzzle I cleared the way we go up here
this one I don't
not I stasis that so you get these p
Towers called
runes no but you can these things are
affected by stasis but I haven't figured
out how this thing works yet I tried
stopping time and hitting them but that
doesn't
work fact that there's water
here
raise voice
volume this is breath of the wild use
ice to stop the wheel and climb
up all right we'll try that I feel like
I tried that and it didn't
work right so like I stop the wheel like
[Music]
this like shove a piece of ice in
here I tried using ice to stop the Wheel
from the outside but it did not
work see it just
snapped the wheel is very
strong what's
Yuzu we're going to try Nicks too that's
that's what else we're doing on this
stream by the way I solved my OnePlus
thing what I
realized was that uh you know customer
support just has some RNG and you just
got to grind it it man you just got to
grind the
RNG uh oh uses a switch emulator I heard
the Wii U one was better I'm pretty
happy with this en be
better by the way we've i' I've legally
purchased the game and we are legally
emulating This legal legal boys you got
you got to got to do things legal Amica
we have respect of the
law this isn't some other
countes like
I know did they respect the lawn don't
know okay uh so you guys get to watch me
be bad at video games like that's kind
of the problem I'm good at computers but
I'm bad at video games so I'm I'm
listening I'm listening to uh what this
is on an M3 by the way so it's pretty
good if you have any
ideas I'm I'm very open to it in stream
chat yeah right this is smooth uh no so
I had to like do some configuration it
wasn't that easy I had to like turn on
FPS Plus+
and okay well I don't know about this
wheel puzzle I don't know how to solve
that work
out there's another puzzle over
here can I freeze the
waterfall
no
I going to ground if I do that oh look
there's a thing on
it oh there's a terminal right
there can I activate it from the
water I just need to get on the wheel
just get on the wheel
go no no no no no no come
on wait why can't I activate
it this is
unreasonable so there's the
thing I don't
understand we don't know how to saw
that yeah what moron puts a terminal on
a spinning wheel that's what I thought
it was probably Ganon and his evil
forces the bad guy in this game is
called Calamity Ganon Ganon Ganon Ganon
okay then there's this puzzle so there's
a terminal in there but it's covered by
this thing now there's these little
Stone dooh
hickies um
so I have this power called stasis and I
can use it to freeze this and I can
smack this but I'm not sure going to do
it when time unstops
oh did that do something no see it
didn't do
anything um
yeah the ball I tried the ball so it
looks like the ball's meant to go over
there but again like I can stop time and
the ball will fly towards there but it
doesn't really like well I don't want to
do it cuz it breaks my weapons and your
weapons only have limited durability in
this
game uh
okay what else could it
be
oh the trunk of the elephant can move oh
yeah yeah I have controls of the Divine
Beast said
a move
trunk all right what is this going to
do where's the trunk where am
I
all right rotate it
[Music]
more how is this related to solving my
problems oh oh that did
something oh I see wow chat you're so
helpful going to beat this game in no
time all right this is now rotating oh
there's probably like just a magic time
when I can go
in oh now we can use stasis on those
things okay no I've had gaming streams
before I speedran Pokemon
Red okay
um so let's go around and go
up oh no we got to go back up it's going
to take some
time cuz I'm really bad at video games
so you know you can't make fun of me
okay cuz then I'll never do video game
streams you can make fun of me it's it's
fine I I encourage light good-hearted
bullying you know light good-hearted
bullying is the reason I'm not as weird
as I could have been you know it's like
important like there's some kids who are
just always going to be weird and
there's some kids who are never going to
be weird but bullying like good-hearted
bullying is good for the people in the
middle you know there's people in the
middle who uh
who could be
saved I dropped those weapons cuz I
didn't want
them this game's the reason why you
bought Nintendo switch
yeah
okay so I know what we do we're going to
use stasis on this after it's about to
fall and then we're going to have time
to go get it okay see that's look that's
basist now it falls and that goes down
okay this this makes sense I think this
is the right basic idea I don't
understand what this me why are there
two of
them wait the Beast I have to fight the
Beast
no the Divine beasts serve mostly
friendly okay so I can't stay to sit
that
long how do I how do I space to it
longer
if elon's going to play games on stream
so am I maybe we stop this one somehow
that does
something oh that ball one clearly
controls the uh uh no no no no we'll
we'll solve it we'll figure it
out maybe jump in there when it opens I
don't think I
can okay yeah I understand to stasis the
ball and maybe I just need to get the
timing exactly
right okay it's going to start to go
right
now
right oh so close okay okay okay I think
if I just do that again we
good
I don't think stasis recharges that fast
we can try that too I mean we might be
able to double stasis it that's what
you're thinking I should be able to hit
it
twice no no no no
okay will give you time to access the
thing between the squares oh this thing
okay okay what is
this oh there's a chest I see what's in
the
chest but I don't care it's probably
like some stupid
weapon well we should at least be able
to do this as a test of our stasis s
abilities we're at the bottom now so
we're going to okay when this thing goes
around going to free
that okay but now I don't know but I'm
not able to get
up these video games are made for
children why are they so
hard okay I regret coming down
here I regret coming
back
wait do I have to fight the Divine
Beast should I just go solve more
shrines you should see me trying to
solve shrines I'm not good to that
either
yeah I was trying to so you had to get
shock arrows to come here and there was
some like thing on top of the mountain
and I just kept losing to the thing but
then I realized I could get the shock
arrows and not fight the thing um so I
was like wow okay I'm just going to do
that and I
did is the chest really going to help
me like is that worth
it ice the waterfall you can't ice
the oh you're saying oh what if I stop
it rotating by icing the waterfall oh
that's clever all right let's
see yeah
cryonis yeah oh that's smart
bro you're a winner or you've play play
this game before okay sh a slate good
three terminals remaining let's
go yeah I know I know I'm slow all right
did everyone else solve this game fast
you people play video games so you know
like the
meta I was pretty good at the witness I
played that was the last
game all right all right let's go back
to solving the ball puzzle and then I
think this when we have to get in the
trunk
yeah it was tough when you played it
right all
right we got to get what's in the
chest we get what's in the
chest um how do I want to do
this I want to keep the top one wait is
there an orientation
chests oh okay I see what we do for that
so let it go around let that go to the
bottom and then when that's over there
we'll freeze the top one and then we can
walk on and get the chest all right I
think we got a plan
boys you know that um you can eat
anything you want at Alice's Restaurant
you know that song well that's what it's
like you just got to wait for the wheel
to come around you know you got wait for
the to come around
the all right
stop you stay there all right now we go
and get the chest why is stasis so
L all right ancient
core that doesn't seem good that seemed
dumb can I do
something no I can just sell it to to to
to to Traders and grifters all right I
think this is the right idea we just
need a time it right I think there's no
way to double
stasis my game sound is too loud
compared to my voice that's just what it
is but I can look I look I'll look oh
all
right uh yeah we can lower this down
go no don't let me miss
this I might be able to wait wait a
little
longer okay that was close that time
it's got to be this we got
to unless is there a way to stop this
whole wheel how does this wheel work is
it powered by
water so that the wheel turns the other
way wow I never would have thought to do
that okay so you're saying if I put the
trunk down here the wheel turn the other
way how do theine beasts work maybe we
should understand this
first
back
oh okay now the wheel
stops
well no we can't do
that the trunk sprays water on the
wheel can I like zoom out is there way
to like move the
camera okay I don't think I can oh maybe
okay hang
on so maybe if I put it like here it'll
go the other
way that's that's this is this is a good
thing how do you guys know so much about
Divine beasts did you pay attention in
school okay now it goes that way now we
freeze
this no no no no no
no a we got to wait for it to come
around again but that is the right idea
okay we got it we just got to do
it you got to sub if you're going to ask
questions no no no gaming look man when
I'm programming you know I'm a good
programmer when I'm gaming we're all the
same we're all the same guys it's a very
humbling experience being terrible at
video
games um not terrible at all video games
I'm better at uh at like rtss I'm okay
at puzzle games
actually or I like to think I'm okay at
puzzle games but Zelda has been a very
tumbling
[Music]
experience it's SP like an hour and a
half in a shrine last night there are
two terminals remaining all right two
terminals
remaining all right um there's one in
the trunk
maybe beat that I can't believe I wasted
time getting that stupid
chest um how do I get up
there okay I've used stasis I've used
magnesis and I've used cryonis where am
I putting small
bombs
is that magnetic I love magnesis it's my
favorite
one okay so I think what I got to do
yeah I can probably get on the wheels so
if we could get on that wheel and we get
on this
wheel how I get out of
here link can't jump good or Swim Good
oh I'm going to drown I'm going to drown
I'm actually I'm going to drown I'm
going to drown I'm going to drown
actually going to drown I'm going to
drown
[Music]
how do I get out of
here all right the wheels going the
right
way let's go Divine
Beast all right w
oh don't ride that one that one's got
chick of shit
on
guard hey hey you don't hit me with your
sword now what can we
eat I didn't cook enough food for this
either I use a lot of my food fighting
the other
guy Hyrule Bass seems good also we equip
a good weapon not this
crap why can't I equip
that why can't I equip the why can't I
change my
weapon oh come on all right let's
go
[Music]
die I don't understand why wouldn't it
let me change my
weapon
wait but I really have to fight the
Divine Beast you guys are trolling me
the Divine beasts are friends
right now let's lower the
trunk let's do this slowly so fall die
one
the eye with
a no no no don't just be a chest no you
need to not just be a
chest what's in here probably some
stupid I see something stupid why do I
want this I'm going sell it to Merchants
and get
rupes oh
no um yeah so
this there's a terminal
there oh maybe I can like stand on here
while I rotated or
something looks like it's on the other
side I don't know how I'm going to get
up
that is there a way to zoom out can I
control the camera and zoom
out
um
can't zoom out
okay so how do I get out here can I just
climb
this okay let's what's going to happen
if I rotate I just need to find a place
to wedge myself where I
rotated behind this chest here looks
like a safe
[Music]
space no
okay you know what YOLO let's
go
[Music]
YOLO we are on top of the Divine Beast
now where is that thing oh I can get on
the other side of it
maybe go to the head of the elephant and
rotate the trunks you can glide to the
top of it okay that sounds
sensible can I see the terminal I see
where the water comes out
of where's the terminal
[Music]
it's like on the other
side okay maybe we should solve that one
in the head
first can I can I drop in
here above the head how do I get up
there I don't know to get up there I
agree that I have to get up there but I
don't know how to do
it
this is M3
Max all right that looks like something
YOLO did I just mess
[Music]
up
all let's let's take let's look at I I
need attitude
settings uh you can just lift it up more
now yeah shika slate let's
go just one terminal remaining I have
faith in you you're telling me I'm just
going to end up in a boss fight that I
can't win cuz I didn't do any shrines or
nothing uh all right so where's the last
one looks like it's right there in the
head I'm going to go in through that
hole is that a
mistake is the hole a
mistake we're doing it let's
go
oh this looks like a magnesis puzzle I
love
magnesis oh no
die
ow no no okay all right we're good we're
good we're good we're good we're good I
thought I was going to fall down to the
bottom of the Divine beast and that
would deeply upset all right where's the
eye that I can take out for this
that's right
Shield
oh come
[Music]
on wait it did save right I don't have
to okay I think we just have to Reet up
to where we
were wait that was a huge
mistake guys guys we we goofed we go I
have no idea how to get back there I
guess I can ride the wheel again where's
the
wheel I can swim up because I'm wearing
Zora armor yeah I've heard about this
where's the water
from
okay no we we goofed we goofed we
shouldn't have done
that wow it must be so painful for you
guys to watch me be terrible at video
games we're not doing any more deep no
deep learning today today's a deep
learning free Sunday okay is deep
learning
free that wheel's not even
moving um
I can't believe we messed up so
badly yeah I felt like reinforcement
learning yesterday when I was trying to
fight the lion shit on top of the
mountain I was trying to fight the lion
ship for like 2
hours
what
yeah people always avoid the lonol yeah
I figured
yeah wait do I have to what no come on I
have to do this
again okay that was a costly mistake
that was a costly mistake boys that was
a costly
mistake
this me
up
can I make it there on the power glider
I do not
know I could swim up and Skip all these
yeah
probably oh I forgot about swimming up
okay don't die to the thingy this time
where is the oh there's the
eye
I learned guys I learn all right now I
get to use my favorite Power
magnesis
don't worry I'm not good at magnesis
it's just my
favorite what is this
controlling this
controller
[Music]
is this manual trunk
[Music]
control
PL oh is the problem okay the only
problem is that there's fire around it
so if I just get the trunk to put water
in there to put the fire out we're good
but then how is that related to this
magnesis
thing wait
okay opened up trunk water fire
yeah I see so I did something with the
magnes s now we just got to find the
correct position for the trunp to get
the water to go in
here all right all right all right
there's some water go one Higher I
think
[Music]
yeah
wait but it doesn't look on I it should
be on let's
go that's
not yeah sh a
SL you activated all the terminals now
you can start the main control unit is
that Princess Zelda there should be a
new glowing mark on your now head there
I didn't know there was a boss oh let my
guard down
great I know where this room is
actually cuz I've been there at the
bot
[Music]
oh that's me oh the the the fish girl I
was in love with she's
pretty I know what's okay oh shit I
really do got to fight a boss all right
um yeah so how do I beat this oh watch
me now we're going to fail for the next
30 minutes I don't even have food I have
crappy
weapons
[Applause]
is it a
[Music]
guardian wow wow I mean they didn't even
need this animation scared but
[Music]
like please take care that thing is one
of ganon's creations wa I put up as much
of a fight as I could but it proved to
be my this is who killed
mea I'm done I'm done boys we're done
we're done I believe that you are well
prepared for this moment I'm not but you
don't understand I'm
[Music]
not care let's bear has
a
yeah yeah that's
right right in the
eye yeah right in the
eye you need to flurry Rush with
Dodge
okay
I did four
damage wait you know what that's a good
point let's
leave
Bast what are these graphic settings you
think they're good
[Music]
okay I can always go back to the Divine
Beast later right yeah okay we can
always go back to the Divine Beast later
um I I'm I'm upset that I didn't get
enough fast
travel I solved that
Shrine okay where are there more
shrines I did not solve that Shrine
because I didn't figure out how to get
to it let's go to this Tower and then
we'll figure out how to solve the
mystery of the pokey
spinies uh wait you think the graphics
are good or bad I think they're pretty
good I'm pretty happy with them they
haven't taken away from my enjoyment of
the
game all right let's go fail at shrines
it's probably better than like whatever
crap was in the Wii U you
know
[Music]
all right we have to carve through this
mountain
here no it's not
that it's not that way
either says I can get through the
mountains
here I have to go here to this Shrine
and we can't fast travel to it cuz I
didn't saw it it's probably this
oh I kept my Zora armor does that mean I
can swim fast no cuz link can't swim or
jump oh what is
that a
rushroom
it's probably like an ideal amount to
hit that did I just find a shrine I just
found a shrine wow the gods have smiled
upon me
today N I don't really play games that
much sometime I'll play I like games
that have like good single players and
sometimes I'll play
them all right let's let's
go all right let's see how fast we can
be at this
Shrine oh you can fast travel to shrines
you didn't solve as long as you went in
that makes
sense I didn't go in that other Shrine
because it had spikes around it and I
assumed that I had the paraglider to it
oh
thanks all
right oh yeah straight up portal I know
[Music]
[Music]
portal
Bullseye oh but I probably should have
been standing on that I guess it'll come
back I'll just
[Music]
wait let's go please drive
me I have a shik slate
by the
way people in this game are mad racist
man like some people like hyuan and some
people don't like hyuan okay you
shouldn't shouldn't you know you
shouldn't hate on someone just cuz
they're a hyuan or not a huan oh yeah
let's go okay well
[Music]
close
all right well let's think about this
one for a
minute I feel like what we want is
like yeah like to like bump it you
know like it'll like fly off the end
maybe we start it like this and then go
like that okay that's kind of the idea
right
we have to start it in a downward thing
we just have to get it
right too
late let that
go 3 2 1
go
close 3 2 go there you go
[Music]
yeah we're going to try NX after this
should we try NYX after this are we
going to beat that Divine Beast today or
am I just like woefully unprepared for
the Divine
Beast
I solved your Shrine in the name of the
Goddess hilia give me a spirit
[Music]
orb there are two treasure chests and
you didn't get any H I know I know oh I
told you I'm bad at video
games all right um let's get out of here
go solve the next
shine oh for some reason I can't fast
travel to the
Village uh-oh wait this is a Blood Moon
I learned about
these
the Blood Moon Rises once again some
traveler told me about
them be
careful wait what they all just come
back do I think gaming can be a purpose
in life Wow you people
man what are these guys one bomb arrows
dis batch them pretty
quickly just can I just use normal bombs
bomb ARS I don't have that many of
[Music]
well that
sucked
thanks for the arrow
bro I thought I get to keep the
arrows what they be add to my
inventory all right you can just
die do I want any of this boo junk
probably not should we do some cooking
let's do some
cooking uh what's going to be oh an
apple and a mushroom that sounds
delicious but now I just want to do that
is there like a way to do this just 10
more times
quickly
[Music]
why are you oh with a wooden Shield oh I
see I don't have any of those I threw
out my wooden Shield cuz I thought it
was
dumb wait is there a faster way to do
this we can write a script to automate
it are you
kidding how come sometime they have lots
of hearts and sometime they only have
little
hearts should we put some lazalo tail in
[Music]
there
yeah I know I'm pressing X to SK the
cooking animation energizing mushroom
skewer all right um know let's make a
super one out of two of these and two of
[Music]
these okay I got to be faster about
pressing X to skip the animation yeah
see that just sucks that just uses up my
ingredients we just got we just got to
be faster about doing this see that's
not enough all right let's make double
Apple what do you
think what do you think of super
Apple simmered fruit
lame super mushroom super
Apple need to get some meat all right
we'll kill the next things we say should
we kill a horse by the way I left my
horse somewhere is it going to show back
up at the stable how does this
work run fast no I don't I
Ste didn't I get a rushroom did I not
cook my rushroom oh I should have cooked
my rushroom
whatever what's up there what's that is
that a
rushroom my rroom all right I have an
idea we have to go
up because the
shrine has spikes around
it that was not worth the damage to my
all Fork
Boomerang I have to switch weapons let's
use that war spear that thing sucks
okay
all right skip all animations let's
solve the
shrine I do well at that other
Shrine we should bef friend a dog that
sounds
fun all right May the goddess of hilia
smile on
me those things actually don't do
anything I think I look stupid carrying
this uh spear so we're going to switch
to just a normal is alom right that was
better all right um oh I can swim up
waterfalls probably not in
shrines uh okay so this is just
a uh
cryonis oh I did not mean to drop that
[Music]
bomb
um all right well that's a long way down
okay I know what I can do I can choose
the side of the water it's not what I
want I make two steps or just
one
[Music]
I love that you can climb up the side of
ice
basically NX is a time syn bro you're
better off playing
Zelda
okay um
magnesis no magnesis I love magnesis
it's my favorite
one um
go down
there to
do oh is there a w oh there's water
there oh we can just change its
Direction with
water all right is that going to do
something not good
[Music]
go in the
hole I got to three cryes out at
[Music]
once see I it's not it's exactly why
I
that's
fine
no
really
bad oh you know what I can just put it
there and then I can't ah now you can't
no but that's the opposite of what I
wanted but back but just
not yeah now you can't pivot anymore ah
yeah that's right
[Music]
I love you know guys know sarin's
catchphrase suck a dick dumb shits this
a great
catchphrase all right go in the hole
Yeah the hole okay we solving shrines
all day let's
[Music]
go
yeah I'm actually happy with this game
like I'm not most I'm not I think that
most new video games are really
um they just
[Music]
like they're designed for people with
10c attention spans and they're not like
they don't keep the same
feel uh of of the uh of the older games
even I don't like the new Smash Brothers
either I think there's like too much
going on
on um but this game is playable even for
an old man like
me uh have ever played Witcher no I
never played Witcher Oh look The Spikes
are G okay uh cool we saw that Shrine
let's see if I can get my horse who
thinks I can get my horse even though I
didn't put my horse back in the state
they going to be like what horse sir or
are they going to be like oh your horse
made it back to one of our stable
Networks
hey you can give me directions oh
hey you were not helpful what
look
yeah
[Music]
wait where the hell are the
[Music]
horses I'm not going to beat this guy
he's a
champion can't even find a horse in that
time all right should we get the peacock
instead
hey
where
you
hey he threw something at hey come back
here
hey who's throwing those things where is
that
guy
yeah yeah good horsey yeah yeah good
horse good horsey good horsey good
horsey come on come on we're going to
beat we're going to beat the we're going
to beat the guy let's go maybe he'll
give me rupes he better give me rupes
there let's
go yeah the horses are free I know oh
[Music]
well
[Music]
oh what happened to my other horse I
named him B because the emulator kind of
didn't
work yeah amazing right
rensa yeah it was so easy I mean you w
you yeah
great 50
rupees yeah that's right I'm a haruan
okay I'm the master race of this
[Music]
place
ah
yeah
yeah
sure oh I can download a new all right
we got to name my horse we name the
other one B we're going to name this one
C no I we name it something car that's a
base well it's called
a uh Bor
horse okay now
hi take
horse
oh
wait do you not have be
hey oh B oh my budy
[Laughter]
be uh okay so why can't I fast travel to
Keno
Village why can't I fast travel
there did I not like get something that
I'm supposed to be able to do
how much Spirit orbs do I have oh I have
lots of spirit orbs okay let's
go there's a shrine
there I'm back on B mornings are the
worst I know man all right we're just
riding a horse let's go go fast horse go
fast good horse that's
right that's right good horse
beetle
George tell us how you failed fixing
Twitter search after you publicly
boasting well you see
I am a failure I have no programming
skill it's actually fake man I have a
team in India that scripts these videos
um but this is my legitimate gaming
skill so if you uh you know this is this
is truly who I am but the programming is
all fake and uh
scripted um no but the worst part is
there's actually people like that man
and you know what we call them
Liars uh by the way I solved my problem
with OnePlus you know how I did it so
you got to realize that a lot of times
customer service is just RNG and you're
going to get one person who's either
like nice or confused or something and
yeah they they sent me a return label so
look at
that solving problems and then I bought
a Samsung Galaxy which I will not break
I'll be very
careful whoa whoa whoa hang on good
horsey yeah good horsey good horsey
what's my bond with be how do I check on
my
bond I don't know how to do that but all
right do I want a hard or a
stamina
what's that that look
cool what is
that just a
CBE there's more cubes do these do
something let's build a
stairs is this stupid what is it
they we said in Zelda you got to pay
attention all right never mind oh it's
magnesis should I use
magnesis oh magnesis oh good my
favorite oh I know what to do do I make
this square hole it's going to do
something if I make it match the other
one that's the obvious place to put
it oh
yeah yeah I get a cororo se you found
me
yeah go back down the road and talk to
hu who's
h
I crashed my
horse see those horse need to open pil
now
stop bad
horsey good horsey all go let's
go go
[Music]
fast oh yes we are back in kakaku
Village I'm not talking to you you don't
have anything interesting to say I've
tried talking to you before you can talk
to the pumpkin patch guy and I'll give
you a pumpkin but I didn't save that
game because it crashed when I was
talking to Shrine
lady she let's save the
game I push my save games to GI up it's
a private
rep
[Music]
[Music]
[Music]
what
[Music]
all right let's get off the horse wait
there for me
be
hi no I don't want to talk to you all
right we have to go see lady
impa but
we can talk to this thing and do we want
stamina or do we
want I went with heart last time let's
go with
[Music]
stamina
[Music]
yeah I will bring peace to Hyrule
just the kind of guy I am can I fast
travel here
yet no so how do I get fast travel
here three apples look at
that feel like I just robbed somebody oh
let's talk to lady impa have to talk to
her anyway like show her a picture or
something it was stupid but let's do
it
ah
oh yeah yeah per was definitely giving
me the runaround great now then let me
see yeah yeah no here's a picture of Pur
yeah yeah you happy all right button
button button button button button
button button button yeah wow Princess
Zelda had a camera 100 years ago that's
crazy it probably used
film wow yeah oh wow restore some your
lost memories that's cool great I get to
go to Great flash scenes okay what do
you want to give me you may not remember
yeah no I I bet yeah did I really fight
genon oh I didn't mean to ask you about
the four Divine beasts I know about them
yeah great great great great great I see
why all the speedrunners play the French
version um you must Infiltrate The
Divine beasts I know yeah but you don't
understand there's guys inside there and
it's terrible yeah I know about that
okay my memories I won't fail
great oh yeah I know I know no I want to
help the princess stop it you're making
me feel bad
lady
uh all
right
12 Beast destroy Canon this can't really
be a main quest I can't really have to
do this
right
[Music]
all right so is there a shrine here so
I'll try turning on Shrine finder but I
wasn't good at using it my shika
sensor Shrine nearby okay how do I use
this
thing let's just look on the map and see
where the shrine probably
is probably in the middle of lantern
Lake
all right so this thing beeps how do I
use
it where's the
shrine a potet oh I want a wooden
Shield thank you for telling me about
wooden Shields all right this is broken
[Music]
anyway oh
cool I love steal and stuff and people
thinking it's mine right can I swim up
that
waterfall yeah probably
[Music]
right so Bast
go oh oh wow we're going to drown we're
going to oh a
shrine uh where's that Shrine
[Music]
go oh it's up there I see
it do we want to cook
anything
[Music]
delicious that's not what I meant to do
[Music]
though wait this is really the worst
though you have to do this like every
time
[Music]
I was telling Alex about cooking and she
thought I didn't mean it in the game
that I was actually going to
cook okay okay okay okay okay see the
shik sense is really annoying CU I know
where the shrine is yeah yeah run I know
I'm running don't
worry B could never make it up
here
[Music]
[Music]
do you actually hire noobs no why would
we hire noobs explain to me like why
would I ever hire a
noob
like just I want you to think about that
right like do I look like a charity or a
capitalist all right oo look I found a
chest that was too
[Music]
easy Eightfold
blade another
chest these chests are suspiciously
simple I have one of those Shields but
that one is better than my
shield no I have that same Shield
mind I have to fight against this
thing you should just side hop how do I
do
that side hop Dodge enemy
attacks Target enemy
strafe
jump this isn't going
well
was this like a way to like teach you to
deflect attacks or
something Dodge enemy attacks by hopping
[Music]
sideway flurry
Rush Oh I like that the game's teaching
me
that flurry
Rush do a backflip to avoid enemy
attacks W I love that this game's
teaching me
this okay Target enemy back
pedal FL
Rush
you can repel and attack you parry with
your Shield at just the right time use a
for this I've done this when I was
fighting the lion
shit did I do
it build up your power and then release
it to unleash a charge attack catch your
enemies in this motion
and I how to do
this
[Music]
hey than your sword
[Music]
bro you have done well to learn these
crucial skills now proceed thank you wow
the goddess Helia Smiles on me
[Music]
do I get a spirit orb for
[Music]
this oh an opal sounds like I can sell
it for a lot of
money your triumph over the test of
strength subverts the pro propy of
ruin all right have we solved enough
shrines can we go fight the Divine Beast
now hey B you can chill in that town I'm
not I'm going to leave you here okay
you're good horsey good
horsey
uh I'm using a switch controller yeah
you can just fight the final boss I've
heard but I won't
win oh my reinforced lizzle Shield is
badly damaged all right we'll take this
small shik of
Shield
um should we get the
uh we can probably go get the tower in
this one so we'll have a map what do you
think you want to do a
tower let's try to find a
tower don't attack Choo Cho man I've
learned this Choo Cho are
friend just better not be the one with
Magna and the
flowers she's the
worst there's a tower over
there
where is the nearest
town oh that's actually like far
should we go
there this not an emulator no it's a
real wi
U an M1 M3 Max wi
U flower BL C Canon o
flowers no I'm going to drown I hate
swim I always
drown walking through the swamp walking
through the
swamp oh the guardian I remember
that electr
bats through this swamp walk through
this swamp will it stop raining here
when I tame Ruda
walking through the swamp walking
through the
swamp Guardian is coming walking through
this
[Music]
SW yeah go up the
tree
oops
ah where's my last save let's
see okay it's back here
um all right maybe we'll have a few more
tries at fighting the Divine
beasts
no if I if I lost to a
guardian and then we'll do Nicks all
right let's let's lose three times to
the Divine beast and then try
[Music]
n
wait these things
respawned oh because there was a blood
move where's the
thing careful that spear has a Long
Beach where's Water by Canon
okay see him right in the
[Music]
eye oh well that wasn't
good
[Music]
oh okay we're not good at this
[Music]
[Applause]
game attack so that was one that was one
uh death to the Divine Beast okay how do
I beat it
guys we have to Parry and then flurry
Rush wait
what no this is terrible all right well
we solve some
shrines uh it's very nice and now let's
try some
Nicks thank you for for joining my
stream uh it's Nicks
o'clock how many viewers do I have can
we check in Chrome
oh we got to clear browsing
history I don't know what's in
here uh what do we want to check
twitch.tv
chots
uh 407 yeah
this we should change the category
that's what I want to do cuz we we don't
want people thinking that it's breath of
the Wild and then being disappointed
when they watch me do Nicks MK and
Apollo stream manager can I change the
category does that
work search for a category Science and
Technology yes
okay category change wow you guys got to
watch
ads need more emojis in the
title uh can we classify that as a try
yeah I just lost I don't know you're
right I wasn't really trying hard that's
a good point let's charge my switch
controller
okay uh all right what is
NYX
NYX
nothing declarative builds and
deployments download
Mac
OS okay it has a Linux
distribution and a package
manager consult the
manual can I brew install
Mi oh here zeron ni.com you're guide to
learning Nicks and
flakes um George do you want to have a
family someday I want a subscriber only
chat because of your question F2 Pusher
there's a reason you're not a
subscriber for out what that reason is
because you can't talk anymore because
now we're in subscriber only
chat
oh I don't know Zelda is pretty
exhausting I don't know if we if we have
time for
Nick all right quick
start we wrote zero to Nick's quick
start with a specific audience in mind
people have heard about Nicks but don't
know much about
it to run the
installer can examine the installation
script here no let's just trust them all
right make sure your computer doesn't
already have Nick show you what I'm
going to install and where create the
system users and groups
what it has a
Damon
no can I use Pudo
sure
sure
uh
it's pronounced demon I can't believe
you're a
subscriber what's
dscl directory service I don't know what
that
is n is trying to connect sure
ni
all right let's run a program with
NX ncks packages pony
say wow okay I mean this tells you a lot
of what you need to know about Nicks the
first hell world is about talking
ponies okay great let's open a new
terminal and run
this experimental NX feature NX command
is disabled I'm going to move me hang
on see there's no good place to put
me we're going to put me back here but
we're just going to hit at enter a lot
of
times all right
uh well the hello world doesn't
work uh I don't know let's ask uh let's
ask
qu do you know about
Nicks oh
good
what's this
error I don't know how I feel about
that what is Nick
all this told me something that I could
run open a new ter terminal and type Nix
shell Nix
info all right let's download a lot of
stuff this is what I remember the one
time I tried NYX before you just had to
download a lot of stuff and it took a
long
time uh you're the ni desktop no am I
going to use this in Tiny Box probably
not I think I'm going to use you buntu
and like clouding it and stuff
uh oh that was Nick's okay I see that
like did
something doesn't require
anything like a
NYX all right should we experimental
feature Nick's
command no that doesn't
work
wait Nick shell doesn't
work okay so Nick's run
add experimental feature is
broken
but users Diane default NYX doesn't
exist I should have kept this session
open
Quenton you're not being
helpful NYX flakes are still an
experimental
feature what is NYX if it doesn't have
flakes do I not have a good
version
now I have the current
version but I can't enable
it why are we using the official
oh oh I should have used this
installer requires you to enable flakes
manually oh okay well we messed up we
should have used this installer which
like runs pseudo and lots of sketchy
stuff all the flake files are pinned to
some what
Nick shell and install coway and
lcat we'll figure out flakes
later right now we're in the nick shell
can I just do Nick shell and I get a
Nick shell sh no what is
p
packages if I just do
that oh can I do c
here no but if I do that that'll give me
a Shell with access to these things I
don't know what c does
oh I have no C all right let's see
lat
whoa we got to use these wait this
trippy
man can you just do that in normal ansy
or is that some special Nicks
thing how does this
work do I have Fortune no I don't have
Fortune wait
what
animate whoa that's so cool
we should be doing way more how does
this
work is WR in
Ruby no okay there must be just crazy
antsy stuff for that that's so
cool
Brew uninstall lcat I don't want that
polluting my
syst great wow 262 files that's so many
files I can just use lcat in my
convenient NYX
shell all right where were we which NY
tutorial will we in okay here we go
search for packages what can you put in
a shell environment for example find
find the package names for these
programs can I just do like get does
this
work where is get name something
weird
it seems normal
enough
interesting NYX packages. relases Dosh
why isn't printing a lot of
stuff implicitly
using so what if I just do
this unrecognized flag
I that's
fine default NYX doesn't exist is LS a
package no it's
not okay cool that worked is it faster
the second time
great okay so like uh at our Christmas
party one of our Tom's old employees was
there and he was he he was Shilling Nick
to me so that's why we're we're playing
with that so what it is
is
reproducible uh like
environments this like Dockers but the
problem with Dockers is is one hash for
all the state whereas nxs it's like
functional and the functions can be
composed
why do it show me my
viewers just shows me live and
excellent is that on Mac yeah it's on
Mac my revenue is going
up I don't know why I can't see my view
oh there they
are uh interesting the viewers go up
when the gaming
stops all right Nick's language
Basics uh Nick's the largest most
up-to-date software distribution in the
world and written in the Nicks language
Nick o
uh did I watch myself play I did I did
wow they have their own programming
language okay okay we can get a repple
Nick reppel 1+ two great I just wrote a
NYX program the Nyx language uses lazy
evaluation nle by default only computes
when
needed I don't even understand what
that's supposed to do
nyck
instantiate okay so it has a it has a
programming
language FS
Trace
I this is what I'm mostly interested in
I'm interested in being able to use NYX
to quickly deploy Cloud
instances so this is a terraform file I
guess and then from some random dude's
GitHub I can pull that
okay so terraform
is uh it's like a scripting language for
clouds thank
you am I thinking about using Nicks with
tiny
grad um
maybe maybe for uh
CI but probably not this this like it
just looks like too
like obscure
Embrace NYX
flakes NYX is a package
manager if you're using nixos add this
to your
configuration file if you're not on
nixos you'll have to
edit
config
Nix ni.com or ety Nix ni.com okay that
one exists
and we'll have to add experimental
features Nick's command
flakes then can we
try
this why would I want Nick's packages
unstable get Mitchell h on a call to
teach me about
Nicks wow this is a long time to make a
pony say something wow pony say wow I
get a random Pony is there a way to
specify the
pony can I put dash dash help here
here no that just made a pony say help
wait can I do
that oh that's help for Nick's
run
help who's learning Nicks yeah yeah
learning
Nicks we're trying it people it's it
seem people who know a lot about
computers seem to be interested in it so
we should try
it the Nyx
develop activates a NYX development
environment def finding NYX
packages I do remember last time it was
also much worse it like had to download
19 gabyt and it didn't have to do that
that time so I'm slightly happier about
this
you can specify the pony with
f so this Auto Handles dependencies in
CI three wait what type curl can I do
this
here wow I'm learning so much
about I'm learning so much about Linux
doing this I didn't know you could like
type was a
thing
what that's so cool that's so much
better than witch it tells me what is
can I do type wow that's like the better
witch I'm never using witch
again
um had a follow-up context to
yesterday's stream we did get our refund
for OnePlus just by basic well okay we
haven't actually gotten the refund yet
but I got them to give me a mailing
label to send it back by basically just
spamming the customer service line and
eventually you're going to get one
person who either feels bad or doesn't
know the policy or is scared and like
you can just get what you want you just
got to like call six times right like I
I used to do this to change flights too
you just you're just like you call up
United three times and you're like no no
no they told me yesterday that uh they
were going to wave the change fee yeah
yeah they're no no no it's going to be
waved yeah yeah no just just click wave
it yeah it's good
um O type type O that's fire type is a
Shell built in what if I do witch type
I don't know how I feel about that I
don't know who to
trust buil it
oh which which user bin which I trust
that this is going to don't cat who no I
catted who that was a mistake do not cat
who yeah which is uh okay
cool you can cat which but don't cat who
right great uh I don't like I don't TR
that CH
anymore uh okay
good run commands inside the development
environment oh the Nick St sure oh that
they have an app
store an on disk storage system let's
see so is this all in like a folder
called
mix it is it has stores and
vars the Shopify engineering
block everything on computer yeah
yeah we need coffee for next we
definitely need coffee for
[Music]
next
Hing
say
e
for
here we go we have a large glass for a
small amount of
coffee cuz we only had a small amount of
coffee you can hear me far far
away
I
see I mean yeah it's a very good uh
microphone an empty directory where you
have right
access result
I
see here next package is a flake
reference a flake reference is a string
[Music]
representation python with NYX what's
wrong with python with NYX why did they
invent their own programming
language wow read link wow they really
they really know the the
uh they really know the Obscure
linuxes these guys must be experts at
the
linuxes let's build and run rip
grap any Nick flake can include package
output
say build your packages in a local
flake
of course they chill rust to you okay
search for Nick's packages okay nck
search what if I just nck search cargo
cannot find flake cargo but if I search
NX packages
cargo then it does a lot of
stuff
why why did none of those
work oh I can get Jon the web interface
it's search
Nix npm is the absolute
worst uh no actually so there's a
downside to your package manager being
too good and I think this is kind of
what happened in JavaScript right by the
way should we use time keyboard should
we be using tiny keyboard kind of want
use tiny
keyboard like just you know I want all
you people to know it's like you could
give me the best controller in the world
and I would still suck at video games
but if
you you know you can give me the worst
keyboard in the world and I'm still good
at computers right all right so how does
this
work it's going to
work
how do I pair this keyboard okay FN
Bluetooth keyboard
connect okay we're trying to use smaller
things uh topre Corporation is that the
same topre that makes
switches press the key immediately to
your left or your shift key no it can't
be that it's going to complain wow
that's wild never seen it be wrong
okay um
cool so I've been trying to I've been
trying to use smaller things like this
is my small Mouse and this is my small
keyboard how many keys does it have do
you want to count them I don't know this
many oh the uh chist dress I have is not
the right side
size I don't think we can use the wrist
rest tiny
key wait no it has caps lock enabled we
have to disable caps
lock I don't know why I can't just
generically disable caps lock
always do modifier keys
always be controll caps Lock's most
useless key man someone told you there
was a key called num loock and it just
made all your keys numbers right George
there is a num lock it makes your number
pad numbers instead of arrows that go
diagonally like Pump It Up not like DDR
only like Pump It
Up you used to like NYX until you had to
use it for a project that used NYX to
replicate experiments okay so what
should we turn into a NYX package I mean
the best way to really learn stuff is to
is to do a project so what do we want
NYX to do for us what's like annoying to
do I know it has labeled keys I'm a
little upset about that I wish I could
have gotten a version of this without
labeled keys but they don't have them um
I'm going to use this with my new
Samsung zold 5 right like imagine this
this and a Samsung zold 5 how nice is
that going to be you know what I
mean um and we use a Samsung zold 5 and
not a OnePlus open and if you're
interested in why you can read my
LinkedIn um and the Samsung Z4 5 might
suck too so I'm just don't hold out for
it being good uh okay so what do we want
Nick to do what's like annoying to build
what do I always struggle
with yeah it's the same size people say
the OnePlus is better but OnePlus pissed
me off so now we use a Samsung zold
5 um does this
work no wow kind of like what do you
guys do you like my new
keyboard like it's so small I love this
small folding stuff but I I don't like
that I don't have a wrist rest does
Samsung phone suck for unlocking no I
bought the Europe
one uh there's a European variant it
doesn't have the all the 5G bands in
America but I should just be able to
root it and I won't Breck this one how
why didn't they Flash B with the with
the xpl like like who doesn't do
that I RCT it
by uh so I didn't want to mess with the
a partition in fast boot so I flashed a
boot image to B and then I switched boot
to B uh which I didn't realize that they
didn't Flash the xpl on B so it went
into
qdl and normally this is no big deal and
you can just get out a qdl normally
actually even in qdl you can can set the
partition uh back to a no problem easy
you don't even need to re-image the
thing so I thought this would be no
problem but Qualcomm added VIP verified
image programming in qdl and then with
VIP the read command no longer works and
then without the read command the set
active in qdl no longer works and then I
realized that I'm just too old for this
shit uh and I wanted to return the phone
um it felt sluggish in in Chrome too the
the zold 5 felt a lot faster when I used
it to Best Buy and then they wouldn't
let me return it and that triggered me
you
know
um what is aache
kudu okay I can't use this
keyboard never mind the keyboard matters
guys fast analytics on Fast data
uh no we're going to try the keyboard we
got to try the small keyboard it's small
keyboard small keyboard small
keyboard
look at how slow it Scrolls like an FN
scroll it's kind of nice but I need a
small I need a wrist
rest let's look up wrist
rests it's so hard to
type for small
keyboard why do I feel like I need a
wrist rest are wrist rests good see look
I can't type wrist rests do not provide
any significant ergonomic benefit now
this is an ad let's ask someone we can
trust let's ask
Quenton this is really hard to
use
we don't get a mouse pad so let's put
the mouse pad aside too let's see if we
can actually use my new small
setup I don't like that this doesn't
stick to the table well either like it
moves
around
h
a flat keyboard
do I need wrist
rest straining my wrists if you feel
comfortable without a wrist
rest
oh yeah yeah you're not allowed to talk
about keyboards normally this stream is
this stream is a rare exception we
played video games and talked about
keyboards so now how do I okay it's just
that
um is mixt committed no I didn't merge
it yet it's in a branch I have to fix a
few bugs
what can we build in Nick can we get
like a run Apache inside
Nick most basic lamp stack you can get
up
wow
interesting let's see if we can stand up
like a Wiki or
something can see if we can stand up
media Wiki inside
ni that seems like that seems like a
good
project um and you know just cuz you
watch me suffer in video games we won't
use a small keyboard right now but we
should be using the small keyboard more
um because we have to learn how to use
small keyboards okay uh NX media Wiki
let's see if someone's already done
it uh wow okay that's really
easy
um what is this so it's a NYX config
like I can do it like
this wow I'm so much faster on that
keyboard keyboard does matter boys I was
wrong I was
wrong uh okay well so like I have a NYX
package in NYX Os Oh there's also nixops
AWS oh that's
cool
um media
Wiki okay how do I use
this Nick media
Wiki uh let's go back to the Run command
by the way you just like you don't
realize how little you know copying and
pasting from tutorials until you
actually try to do something that's not
the tutorial that's actually good
advice
um so let's go back to that pony say
example no not this
uh zero to n
yeah so NYX
run uh NX
packages
videoi now I can't type it
all okay it's doing
something I mean this does seem better
than Docker compose in a lot of ways
like Docker compose
oh unable to execute okay maybe I can't
nyx's run
it how do I get a NYX
environment
uh oh not
these so I can do like what if I do Nick
shell DP
media sample media
instance okay is this like listening on
a
no
no wow why is the GPU preference some
crazy thing like that there's no Apache
running
um look at search nixos to find page to
find packages Okay so if I find the
media Wiki
package how to install media Wiki okay
so I did no but I don't think this is
right this program provides
no like okay so I have to like run it
somehow I don't really know how to do
that
I do
pure I do pure okay I can still access
all my files there which is interesting
fun ni
Wiki oh that's in fun next oh this is
just my external okay so this isn't
actually a
shell I see the p is dubious for any
uh
can I like I want to like to like run a
server can it do
that I tried Nick's run but that didn't
work try to Rift Lake example from
determinate
assist
install riff using NYX NX
profile Comm man n ni profile manage
Nick's
profiles make sure to have flake in it
okay create a new flake build the flake
in the current
directory start a new development shell
for hacking on this
flake not a server but
informative I don't think
so NYX run web server has to be a
tutorial for this
okay creating the
flake okay save the following
code in a file called flake.
next so let's read what this is doing uh
running a web
server just looks like some python some
little python thing okay so how do I run
that mix
build this will build the web server and
start it on Local Host
wait that's like concerning it just
starts it if I do build oh no yeah I
have to do result bin run web server oh
okay okay that makes a lot of sense um
interesting but is that running it in a
Nick
shell
huh I mean maybe maybe that Python's
like
wrapped by the way why did it install an
old crappy
python oh here python 3.8 okay so do we
have newer
pythons I would hope so
let's try that in Python
312 didn't
update I do not like
this
huh wait
what it added the CIS import but it
didn't actually what I
do
oh
okay so I don't know what if I RM
flight.
loock and then n
build no it didn't increase the python
version
okay uh how do I force a rebuild of this
oh I see packages 38 shouldn't that not
be
loud oh okay it works out
[Music]
cool
so how about that media Wiki
now probably some like start script I
have to run hidden in
here NYX build media
Wiki NY build media Wiki does it work
can I find flake media Wiki in the flake
Registries next packages
unsupported
uh Nick's
Ops
that's
great yeah Nick sauce is immutable so
it it's it's really is how package
manager should work I just wonder about
the implementation of it um uh okay
explore Nick development environments we
did these build a package using Nick
search for nx's
packages collaborative editing software
that runs
Wikipedia okay let's try Nix flake show
mediawiki is that not a
flake is that a package or do I need the
fully qualified name
here
no
next run
medor was that the same as the flake.
next that I was doing do I have to call
it flake. n what if I just do this and
then I run NY build
here does not contain a flight. n okay
so that I just did run web server so
what if I call this flake. n what does
that
do flake. n must be an attribute set
which is different for some reason from
this flake.
next import make test python okay well
this doesn't look like a
devm
Dosh developing your shell deploy
containers oh I don't know how I feel
about
this what does this get me that the
other thing doesn't
[Music]
have yuntu core is
immutable oh this is interesting I don't
know much about this
stuff
um
should install
Ubuntu core on my Raspberry
Pi
Nick's packages on silver blue what's
silver
blue oh
fedora
um okay H how do we get media Wiki to
work I installed the Nyx package for
media
Wiki uh this is not the next package for
media Wiki but if we go to like next
packages search that was a thing here it
is social media
Wiki
the following code is a system
package so this has to be like in
somewhere can I see like the source of
this
thing cuz this the oh okay here we
go all right media Wiki fetch URL do
some
patch
inherit
what's this pass through test stand M no
CC make
derivation what does this
do
what is
out this is just my normal
computer did you edit the configuration
no I didn't use the configuration I just
did I just did Nick shell DP
mediawiki does not include the lamp
stack like
I feel like it didn't download nearly
enough
stuff
which should make up setting a media
Wiki as simple as
this H prox your
varnish no if if this can't do media
Wiki it's
useless
okay this looks a lot more complete
[Music]
here but I don't know what this is this
is just another NYX
file there's a lot more stuff in here
though you have to edit the
configuration file I have to have a
server in installed
what this this is harder than
Zelda okay can I what if I media wikix
is not a recognized command
well what are these
files I don't want to install system
wide I definitely don't want to do
that I want to like run a local I'm
trying to run like a
local like just just a local
nck that runs like I want to run a
command and I want it to give me media
Wiki can it do
that then create shell. next okay shell.
next okay what do I put in my shell.
X
here okay NX shell this will use the
shell. N file all right it's downloading
shitty Ruby okay I don't want
Ruby packages build package media wiy
tools you need to
run didn't do
anything I'm going to need more than
just media
Wicky um I probably need an Apache
package there has to be an Apache
package Apache
httpd
all right it downloaded a lot of stuff
that's good
Pache uh type
Pache
htpd
okay
uh media
Wiki
someone has to already figure this out
okay and I also
need do I need I need a
database am I just like using NX for the
wrong
thing like I just imagine that I could
like like what if I search for Docker
media Wiki
right like let's try this with Docker
too just just so people can get a
comparison yeah find Docker you can
connect to the internet I hate that
Docker has like a stupid popup now
um
okay Docker pull media
Wiki it's not really what I wanted but
fine wow look how easy that was who
loves
Docker wow wow we you just use Docker
boys just use Docker all right what
Docker kill
this how's going all right
good um yeah
yeah wow Docker man everyone she like I
understand what docker's doing I don't
really understand next why why can I mix
me with you
[Music]
too
but actually I do have some questions
about that Docker where does that Docker
put the
state it's not in that
folder
but so where does that Docker put the
put the
state I don't know that much about
Docker either I'm not good at this stuff
I'm better at it than a i a video game
stuff
um okay so this is
[Music]
the command Apache 2 foreground like
that's cool usually in VAR
Docker
uh
how does this stuff
work it's actually pretty
cool so where it is but I don't
understand where it saves the
uh like the
state is it State external or is it in
the
[Music]
container state is stor within the
docker
container
there's a right layer did I mount the
volume to the host no I didn't see an
option to do
that oh this actually this is pretty
good I'm pretty impressed with this
Docker UI never mind at first I was
making fun of it but I actually like
it
what does Docker info tell
me where's it State you're just saying
it's inside this
somehow
um container has no bind
mounts so it must be composed because it
must include a media Wiki
right
I must included my SQL
right yeah there's my
SQL Apache 2 foreground where did it
start media
Wiki Docker PHP X install what is this
oh this PHP
extensions where's it running media
Wiki
oh it's using SQL light oh I see okay so
uh if we go in run this container we can
find the SQL light database in VAR www
data why doesn't the tab complete
work
no oh maybe because I didn't actually
create it yet complete the installation
yeah let's go
um oh okay this is going to bitch me out
and be like you don't have a my SQL but
if I use a SQL light I can go there and
it'll create that my name is
Bob my username is Bob my password is
Bob and my password again is still Bob
oh 10 characters okay my password is Bob
Bob oh my password must not appear
within my username well four Bobs
doesn't appear within one
Bob Bob Bob Bob
Bob it's an open Wiki anyone can end up
my
Wiki W Docker so good man who loves
Docker why would I download this that's
terrible okay is there a file here now
all right great we got a file okay so
that goes in there now if I stop that so
I guess I understand how I can bind
Mount that to the external world if I
want
okay
cool great so good to know that we don't
actually need
uh
need my
SQL yeah no we're going to try to get
a
so we have to like NX compose these
things what does the docker actually run
it runs Apache 2 foreground okay so
let's try NX shell no not here okay I
have a shell. Nix so let's try NX shell
and then here do we have Apache 2
foreground what if I witch Apache
control okay that makes a lot of sense
wow I haven't done Apache control well
who set up a lamp stack back in the last
years um why is there no Apache 2
foreground what is this can I get that
in
ncks no I don't have
that now what if Apache control
start
80 all right
8080 oh failed
uh run
patchy uh
foreground hatat
control DD
foreground uh uh unable to open logs
okay well that's not
good you try to use wamp
[Music]
Winamp
uh okay well that
sucks
so how do they have this services.
httpd how do they get that how come I
don't have
that oh this is Nick's
o
server. next
configuration.
next do server next does this do
something NYX build server
NYX no this doesn't
work uh okay maybe we need to call
this
configuration. NX and then we create a
server NX that looks like
that is Linux
fail okay
well do I have these Linux
here no I don't that must be somewhere
way deeper
okay would a derivation like this work
for the source code is this supposed to
be easy or is NYX just impossible to
use nixos
container
um I just have to think about what I
really want
here like okay the reason for that is
because the like configuration is
uh very simple and friendly flake how
did I run that flake
again
NYX Run flake.
next oh it doesn't contain a flake. next
NY
run okay so I like that okay so we're
going to have to make a
flake flake. mix okay let's make it look
like this
flake
uh
okay I don't know if it needs a
description what is numb tied flaky
tills I don't know if we need
that maybe we
do the mediawiki NX o service module
thank you for subscribing and that's
your first time chat see that is a
winner guys that's a winner their first
time chat provides
information I know that there's a
reasonable majority out there there's
the reasonable silent majority and then
there's the
2ers the two centers are unreasonable
and just must be excluded from polite
Society what's the media Wiki setup for
oh why is everything always four
things uh yeah no I I mean I know it's
not straightforward do you think I
picked something that would be easy or
pick something we don't do it because
it's easy we do it because we thought it
would be
easy all right dolak ni
here okay
so instead of packages python
2 let's start with a package that's
Apache okay let's first start with the
web page let's first start with the web
browser right Apache httpd but why does
it have two names like that but whatever
okay
um run web server that's a
weird make app this is so
complicated
N Run flake
ni okay that still works even though I
removed python for some
reason I don't really know
uh install phase
okay default equals run web ser server
flake utils lib what is flake
utils
uh
okay outputs equals self Nix packages
flak utils flak utils lib simple
flake Miki thank
you welcome we're doing ncks Nick engine
X instead of
htpd is the same and with Duram the Nick
shells I don't know if we can use does
engine X support PHP
[Music]
oh I can use fast CGI can I do a engine
X media
Wiki does this just
work interesting okay should we try to
use engine X instead of
Apache this looks like this is going to
work all right someone has to have
engine X working that has to be easier
Apache socks what is this the '90s
okay well the first engine X I get is
engine X
shth is that a good engine
X or there's engine X Mainline there's
also just engine
X which is the best
one is this like a thing engine X
shth oh it's like a
thing
okay
so we're going to have to make a flake
that somehow combines these all together
okay what is a NYX
flake flakes is a feature of managing
nxs packages to simplify use a
great a flake refers to file system tree
whose root directory contains the Nyx
file specification called flake. n an
installation may contain any number of
flakes independent of each other or even
call each other the content of the flak
stu oh oh here we can generate a basic
flake I don't understand now I have a
Frozen
next I don't understand why that NY is
broken NX shell DP engine X that should
work except this one's broken don't use
this
one how do I actually kill
that why does Chrome have NX in
it
not oh we type we don't use which
anymore we use type okay
great
uh create a directory called flake 2 NX
flake and
it all right what's here
okay a very basic
flake now I can NYX run my
flake nope this flake
sucks uh cuz the flake needs to provide
ar ar
Darwin all right well let's fix my flake
okay this this seems like Arch Linux
okay this is just the Arch Linux of
package
managers oh I shouldn't have a default
there ah I see so we just need the only
one we really need to provide is this
but I'm not sure that's going to work
cuz now we're pointing to a Linux
package that's probably going to
fail I do provide that now oh what is
this apps apps okay
that uh cannot execute binary file yes
that's right because we are using the
Linux version but if we use the Darwin
version this is just Arch Linux this is
if if you like Arch Linux consider
NYX if you want to actually get things
done use yuntu and
Docker okay great we got hello to
work uh is it what just the common
syntax
that don't really anything we could just
leave them
okay okay so what if instead of this I
just set the default to be
this okay good that works as I
expected um packages AR 64 Nix sauce
legy
packages engine
X oh
okay now just complaining that it can't
open the log
files is that trying to open like the
log file on my
computer so if I like created that that
would work NYX is not a container I
understand
okay you'll finally see my guide okay
you wrote up a guide okay okay let's
read your guide for Nick's media Wiki
let's use caddy the no no I'm not using
caddy why don't I just use Docker at
that point why don't I just use Docker
you know Docker is
great it's very reliable it already
Works remember when we already did it
with Docker got to get more coffee Mak
us
[Music]
hard
e
I'm on Mac OS so it doesn't even work is
what you're telling
me uh okay
well save a file and then run NX OS
rebuild I definitely don't have NYX OS
rebuilt we do not have NYX
OS put this into your
shell
once you're in the nick shell we'll
finally get to installing media Wiki
this is so much worse than
Docker all
right all right is this just not what NX
is for are we just are we trying are we
trying to do something that's just
unreasonable in this okay so this is
nice it runs it runs engine X that's
kind of nice now how do I run it with
parameters U we can look at the source
of this all right here's where engine X
comes from it
does this that's great
uh platforms
all good we include Pi
sometimes so there must be like
[Music]
a there has to be a there has to be a
flake for engine
X here we go an engine X flake oh okay
this looks reasonable is uh okay we're
of course including flake utils again
because we always include flake
utils um each default system something I
don't think we actually have to do that
I think we can just not do
that okay uh Docker entry point oh oh I
see it uses
Docker fake
NSS
R is root cannot be
used ah Nix is for those who like
functional languages reproducible builds
and pain it sounds like Arch
Linux no I actually don't think it's
that Docker hides this complexity it's
that Docker is actually re like I've
written many Docker files in my life and
it's pretty
straightforward is creating a Docker
image without actually using the
docker I want to not use
Docker okay so I have this
flake I want to set configuration for it
I don't understand how to do this let's
read about Nick's flakes
we have packages system and that's
executed by NX build
okay so that's building the
package but then we have to have apps
dot
oh okay let's let's try apps. this.
deault equals this type app program
equals LS does this work should run
LS uh I need to
s app program LS is not in the nick
store program engine
X that program engine X is not in the
next store
[Music]
uh no one knows if NX is sandboxed or
not because it's impossible to
use making your evaluations pure NYX
flakes runs in pure evaluation
mode here I can use them with nix's
OS
uh
yeah
okay I wanted to run what's in the next
store is Bash in the next store no bash
is not in the next store no of course
not of course not
um all right well
we had this flake this flake was kind of
interesting so
apps
oh flake
utils what's
wreck doesn't do
anything okay let's go about this
another way
do we need these
wrecks if I get rid of that wreck does
it still
work what mix
run okay it still runs even without the
Rex so Rex are dumb and we can get rid
of uh no that was
needed that was needed
okay nck wre what does wck
do with let you can define local oh here
the rec statement turns a basic set into
a set where self- referencing is
available
oh okay I see because default is
referencing that but of course we could
just set default fault here to this get
rid of that get rid of that and it
should still work okay
no um run web server is missing yeah cuz
that's stupid we can just do default
there there we go
yeah all right that works
good um we don't need wreck here if we
change this to default too I don't want
exp why I wouldn't just set it in
default okay that seems good all right
so this creates
a install phase and it just knows that
this is
Bash
also we get a normal number
of there we go now it has a normal
spacing does that break
next glad to see it doesn't okay great
um okay I don't like flake utils I'm
getting rid of flake
utils should be able to get rid of flake
utils so outputs
real okay so we can set that to let
in uh I don't need to specify Nick's
packages I don't think flake utils maybe
I need to specify so that line might be
extra okay oh we updated the packages oh
it's just that's just what it didn't
even pin it do I need flake utils it's
going to bit where's flake utils oh that
just works that's
concerning what if I get rid of flake
utils okay first let's get these inputs
turns out we don't need inputs at all
okay that's still runs great um this is
called binary
search where you just it's not called
binary search don't listen to me that
doesn't make any
sense
okay so we do need flake utils there CU
if we don't have a flake utils it has a
bad time
okay um flake utils lib each default
system
uh people who use computers for work
oh okay
so if I just do this instead of
apps I have packages
too oh so didn't we determine we didn't
need
this yeah that's another extra line is
this all
extra wow there's so much extra lines in
this
file
um
okay packages in import NYX packages
inherent
system uh oh okay I see so we're
probably going to need like a fully
qualified name
there get rid of packages okay now just
complain there packages standard and
make
derivation what does make derivation
though it's a wrapper around the raw
derivation which pulls in the standard M
for
us okay import NYX packages inherit
system
what system is
stupid
at least I think we can get rid of
this undefined variable system
oh I
see okay
um self. packages. system
default this is too complicated
okay
so make
derivation can I add a with import mix
packages
here
no that doesn't work at
all and we'll change this back to
hello okay so I think we can use this
name here instead of this packages let's
try
that okay good that still works the
same um then we can get rid of packages
here a flake utils lib make
app what's in flake
utils
lib make app
this look just look really
dumb what's XY
path so I'll get rid of this if I just
do
that default. type doesn't
exist
uh okay
so type
equals
app program equals
Hello app program hello is not in the
App
Store
okay
um just like puts them
together Drive pass
through exe path
we know what system is it's
this oh
okay that's like
better uh okay we can I think we can get
exip path from
this actually what if I just
do wow what are you guys
doing that looks like a real
conversation wow NX NX really brought
people
out uh
xyth
okay no you can't do that attribute XY
path missing all right well it doesn't
have
that permission
deny what if okay well
first
no out bin run web
server what if I don't set up program
what do I
get attribute program doesn't exist what
if I set program to bin LS do that run
LS no complains so put a semicolon okay
now put a semicolon okay app program bin
LS is not in the App
Store but somehow that
works except I'm getting permission
denied
um bin
name
okay so what if I just literally do SL
binth that.
name okay that works great oh yeah
that's that's that's very uh that's very
obvious
great great
um all
right
uh should be able to replace that
packages with
that okay that still runs now hopefully
we can get rid of
that okay that still works now I just
want to get rid of this flake util stuff
and maybe I can just do that get rid of
that unexpected
thingy don't need that
oh that's uh I see that's the wrong kind
of
bracket okay does not provide
apps Darwin
default I am providing
that
oh no I'm
not I'm providing just apps so we have
to stick AR 64 Darwin default on the end
of
this default. type doesn't exist okay
wait we need to throw a type in there
now uh
oh it's just
this canot coers a set to a
string attribute name
missing
oh okay hang
on let's get rid of this uh what about
make
derivation does that just
work it can't work can't go a set to a
string
okay
def don't need that
anymore still works okay flake utils lib
each default system maybe we can learn
something Reading flake each default
system each system default system merge
together the outputs for all
systems use some weird
nick
uh
okay I think I know wrong so that goes
away that that goes there that goes
there that goes there this becomes
that this
becomes packages Arch Darwin 64. default
but we leave the make derivation shit
now this goes down there into ABS go
there go there go there go there no h
syntax errow well that doesn't sound too
bad get rid of the default
there file
we one too many of
those yes it still works okay
good all right now we've gotten this
down to like a minimum file that looks
enough like that and we can get rid of
stupid flake yous no more flake You
Tails wow removed input good flaky Tails
died great we hated flaky Tails um
cool so what does this make derivation
and why do I need
it yeah I I I see what it
does uh used to build packages within
the standard
environment okay well we're not going to
mess with
that build phase install
phase use packages
okay I mean like I think I get
it uh all right let's change this
to if I just change this to Alias this
like let's just run
python unable to execute that there's no
such a
python oh because there was like
something else like G name or something
saw that in flakey
Tails P
name yeah that works okay cool how did I
know that by the way like that's the
like you know people who have skills in
video games um they like you know know
like things like they they know like the
meta right how did I know that P name
was the right thing to do there it's a
good puzzle for you
[Music]
um
okay uh yeah so I think we've figured it
out like NYX is just the Arch Linux
Docker for hll
fans like we could go I think now and
write the config file but do we
care like all right we'll have to write
out the config file point the log
somewhere I think we understand what nck
is
um can I put a d v
there no I can't okay uh
NX apps oh did I say has oh
God I can just tell by the way people
talk about this thing that not for me
and that you should just use
Docker remember that time we stood up a
media Wiki with Docker and it was really
fast you can pass arguments to Nick's
run by adding Dash Dash and then the ARs
okay no I I can't
actually I can't um I have to do
probably like Dot and then dash dash on
the args okay fine
God
[Music]
God
all
right we've
learned that Docker is good
just make sure just also make a NYX
package I'm never making a NYX package
I'm never using NYX for
anything I have no idea what it did to
my
computer I should have used the
reversible installer so I could
uninstall NYX and never think about it
again no look look look I'm not going to
hate that much
um I I'm I'm it's better than last time
I tried it it is it is better than last
time I tried it last time I remember it
downloading 19 gabt and just taking up
19 gabt on my computer and you know I
was just like wow 19
gabes
uh so yeah no we I think we gave Nicks a
fair try and I think we learned that it
was just confusing Docker that isn't
really Docker because it doesn't do what
Docker does should we rewrite Nicks and
rust yeah yeah yeah yeah yeah I was
thinking about rewriting tiny gr and
rust yesterday should we rewrite tiny gr
and rust
um no I just like like
okay uh there
are nice
things like
uh there are nice things like rip grap
which are actually very fast and rust
but then you remember that your problem
is not rust versus python your problem
is that your Python's
confusing uh what did I have to do to
run it Docker I Googled Docker media
Wiki I copy and pasted the example and
it worked base
Docker
um that's today's
stream we delivered everything we
promised not like OnePlus who says they
have a 15-day return policy but it's
actually RNG whether you're going to get
it I think that the customer service
guys roll a D20 and if it comes up uh if
you get a 17 18 19 or 20 they give it to
you 18 19 or 20 they give it to you
right but otherwise they don't give it
to you right and you just got to you
know what are you doing this RNG you
just you just throw yourself at it a
bunch of
times
um should the gaming part of the stream
be a separate upload no I don't think so
I think the gaming is part of it I think
it's pretty much the same thing right
like did you see did you see a
difference in the procedures I used for
the gaming and for the for the Knicks
right the thing is I just understand the
meta of computers a lot more
um so like that's why I knew that that
thing had to be pame right so I was like
oh well they probably have some where
you can override the process name but
otherwise it's just the name and this is
probably in the wrong place and it
should probably be refactored but like
like you get the meta in it like like
I've seen people who are very good at
video games uh I watch YouTube videos
where people are very good at video
games and they do the same thing they
just like have played so many games that
they know what the structure of the game
should look like and it really is the
same skill for
computers um it's hard to come with a
contrived example that shows its value
no look I like I understand in theory
what its value
is
uh yeah no I get it no I understand what
we talking about ni
um yeah I I understand in theory what
its value is but for a lot of the cloud
op stuff I should just really look more
into Cloud op stuff and just do it
properly like that um I mean I'm
interested also in running a cloud with
the tiny boxes so I I don't know much
about what I'm actually going to have to
run to do
that um my devop skills are not that
great I also need to use I also need to
image oh no no no no we're never doing
kubernetes kubernetes is awful um I also
need to image all the tiny boxes with
the same
image and I need a way to do that like I
don't know should I use cloud in it
should I just DD to the hard
[Music]
drives um yeah if you missed breath of
the wild we played breath of the wild
before um tiny slurm what is
this
oh I heard about
this actually our um our head of mlet
comma uh
thought we suggested this as a pipeline
manager
um
actually looks pretty
good use Nick's o yeah okay well we're
not going further into Nicks
right oh you're saying to use this to
schedule on the uh on the tiny boxes
that's interesting
um T boxes are AMD gpus here we can s is
H into one uh so here's a tiny box
here's where I was playing with mixol
yesterday um what do you want to see the
gpus uh so yeah six of those
gpus
um we have
a 32 C CPU with 64 hyperthreaded
cores 128 gigs of RAM this is pretty
much going to be the final specs of the
machine
um how is T Tor doing with their
software stack I have no idea should I
go to their should I go to uh should I
go visit them next
week maybe we'll see we'll see if I feel
like leaving I don't really feel like
leaving uh
like I don't think well I I think I
think that ten torrent is going to Pivot
to just do risk five stuff they're
probably going to end up getting bought
by a company like
it's the fact that they've had for two
years that they're going to sell the
cards and they haven't sold a single
card
um you know look Jim Jim is great
but he's worked mostly in large
companies as whole
life um he he's worked like
again this is this is bad this is really
bad right this this just shows that
you're not really ready to sell your
things and you know it's been so long
since they promised they were going to
sell them um to the point that the
hardware is so outdated but people will
even try it like people like esoteric
Hardware but
um yeah this just shows that you're not
like you're not serious about selling
cards uh what's the advantage over a
tiny box show me anything that's like a
tiny box on the market show me something
where someone puts six gpus in a
computer it's way harder than you think
it
is just put the dollar price I mean they
put a dollar price but like like again
it doesn't matter cuz you can't buy
it uh who fills out a form to buy
something yeah what's your return policy
is it 15 days no questions asked uh
what's system 76 up to I mean again like
people are like George why don't you
make a tiny box for $1,500 and I'm like
just go buy a gaming computer
right the Deep learning has very little
in that sort of range like Lambda Labs
is the closest you're going to get but
what you can get for 15 grand on Lambda
Labs is a third of a tiny
box
um is Tiny Box a cube I released some
pictures there's some pictures on our
Twitter see if they come up with
external Twitter here they are there you
go um
that's two tiny
boxes yeah IP licensing oh man see that
stuff's so
boring just just uh how many you so
these are 12 you uh they're 12 U so you
can fit four in a 48u
rack yeah I miss when the pop-up was
removed too who said I did nothing in
Twitter
um
thank
you um so for
psus we were first going to use these
but they're
discontinued there is the superflower
one that's the same one but I found this
one that's cheaper and it's not just
cheaper it has a USB port
which is really
cool uh so it has a USB port so we can
pull all the uh the temperatures the
current uh so the Tiny Box has two of
these felio will do quad GPU yes not six
GPU and then the Tiny Box can do six GPU
and not only does this box have 6
gpus it also has a melanox Connect X6 on
PCI uh
16x and in addition to that it also has
four nvme drives so we're using 128
lines of pcie to link together a super
powerful array of mvme drives a melanox
card and six
gpus we end every screen with a uh does
it run run torch yeah runs
torch we should should shouldn't be too
slow let's see
uh oh no Cuda gpus are available it runs
torch melx is owned by Nvidia
yes yes uh but the cards are pretty good
will it mine crypto if you want uh why
not server grade PS because server grid
psus are so loud they are actually
cheaper they are cheaper here I have one
up here this is a 2000 wat PSU I would
love to use this in the Tiny Box instead
of the Corsair the problem is this PSU
is 65
DB um you don't want
it yeah they're so loud what is the
pricing for Tiny Box
$155,000
$15,000
you not a subscriber and it shows
because you don't know how to Google if
you search for Tiny Box price here you
can get it right here on Hacker
News wow I can get a whole house for
20K wow wow I didn't realize that other
people had tiny
boxes here this is the Tiny Box here
this is the real Tiny
Box um data centers are so loud I know
uh the Tiny Box is not loud the Tiny Box
is is very
quiet I am much louder than a tiny
box um there are water cooled psus okay
nothing in the Tiny Box is water cooled
I do not want to get an email my tiny
box leaked it
leaked I'm sorry I will not be able to
honor the return policy if your Tiny Box
leaked can you live in a tiny box well
if you are tiny then
yes
submerge it in mineral oil
oh nothing worse than a leaky box no
it's air cool these are knock to a fans
this is just nine big 140 mm knock to
with
fans um it crashes in ring zero no it
doesn't seal info
done the box is nicely configured I ship
in a chest freezer Unfortunately they
weigh like 90 lb we wanted to keep it
under 70 so that one person could move
it with UPS but no it's not going to be
under 70 I mean we tried with this one
so this is aluminum um but the aluminum
feels crappy we're giving you hard hard
coal roll
steel uh is Tiny Box my company tiny
grad is my company we're at tiny grad uh
Corp and we sell the Tiny
Box
has the latest Rock M version slightly
better than the previous
one uh just build one inside an actual
fridge actually that's totally not true
how many watts of power do you think a
fridge can remove right so no no let's
be real here okay so the Tiny Box uses
about uh about like that's that's
ridiculous right and I'm going to own
you with thermodynamics bro Tiny Box
uses about 2,000 Watts right so air
conditioners usually need about three
watts to remove one watt so your
refrigerator that could do that would
need 6,000 watts of power and I don't
know where you're getting 6,000 watts of
power in your
house uh no I know you were joking I'm
just messing with you but no one of my
favorite one of my favorite I was I was
at a party in high school and uh it's
hot it's hot you know it's Jersey and
summer uh he's like no don't worry about
this man I got it so he takes a window
air conditioner out of the closet and
brings it to the middle of the room and
plugs it
in and uh uh you
know this doesn't really
work uh he's like no no no man it works
feel it the air is cold I'm like well
yeah but that side's hot yeah but it's
cold over here yeah but like
thermodynamics
nah um yeah AC is pretty
inefficient uh no I'm not using amdgpu
Pro this is just the normal one unstable
in playing with I oals uh there's ,000
Bounty if someone wants to do that by
the way
[Music]
um how can I help get you added as a
vendor at work bro if you're like
texting me with some annoying bullshit
like can you send me a invoice or a
whatever man whatever stripe sends you
if you're not happy with that don't buy
a tiny box you're the 2% of unreasonable
people what's our return policy I don't
know yet we'll figure it out um we'll
figure it out help I bricked my tiny box
look we we want to be better um
distributed stuff is pretty stupid
mostly there's a few Niche cases where
it can work like Lila zero but mostly it
doesn't work
um what is the flag behind me this is
the flag of
Somalia um just don't buy on oneplus's
website exactly
exactly okay I think that's today's
stream um consider a tiny box recommend
a tiny box to your friends I don't care
I have so many pre-orders I actually got
to build the things there's so much work
to all decentralize it guys like it's
just not a scam like I'm going to sell
you the box you know you know it's just
I can't believe it like oh there was
some guy in my party a holiday party
like he's like like George so you know
what's your plan with the self-driving
car thing like well we sell a
box
you
know we sell a we sell a
box uh you bought a tiny box and it
never arrived I'm sorry
um so yeah we we we sell box and we sell
it for more than it costs us to make and
you know that's that's
capitalism right like it's it's a fully
refundable $100 pre-order like there
there's no end game aren't you going to
partner with automakers no why would I
do that why would I do that why would I
be like yes please let me be your bitch
you know that's just what that
is uh no we sell the boxes and we're
going to make better boxes we're going
to eventually sell boxes to everybody
the T Comon three is tinier than the
tiny box but it costs less
money does the Tiny Box come with its
own nft for collectors I will if I were
the type to do custom orders which I'm
not if you buy 10 tiny boxes I will
include a link where you can create your
own
nft uh is 1,000 Watts or less the limit
because well you can throw all of them
down it comes with two plugs so you can
go up to full power but um
yeah
Tiny Box will let you mine tiny
coin no it won't it
won't uh what's the pre-order count
right now
uh no we can have to log into to stripe
to check it's more than 500 less than
600 no chap e died because I stopped
paying the digital ocean Bill okay I
lost $5,000 on chap E I hate it I hate
The Hacker News people who think I someh
scammed bro like like like if you
pre-mine a worthless shitcoin it's it's
worthless like it's just that's like the
idiocy of crypto
people just like like what you think is
a scam is not and what you think is not
a scam is it's a governance token you
don't understand it will do governance
okay why does this have value well cuz
like if a lot of people buy it then the
price of the token will go
up yeah yeah why are a lot of people
going to buy it well cuz cuz if a lot of
other people buy it then the price is
going to go up you understand what I
mean it's it's like look I buy it and
then I tell you to buy it and that makes
the price go up and then I sell it and
you know like I make money yeah and like
you get someone else to buy it and then
like like they uh you know like you sell
it and and you make money and everybody
makes money and it's good
man um what's my margin on a tiny box
probably like six
grand uh the first ones are going to be
less but yeah I think I think the parts
are going to cost like nine in
quantity yo but we do still have we do
still have in this is what we'll end the
stream with we'll end the stream with my
beautiful uh
poem uh this poem is actually written by
Goku
1997 uh and I do think I do think it's a
beautiful poem uh one day Speculator
will buy all the
air not to breathe only for hoddle and
everyone will suffocate and finally
Speculator will be
sad now now the poem you know doesn't
doesn't tell you of course the
Speculator is only sad because
everyone's dead and he has no one to
dump his airbags on but but that's
really that's really like with with with
the new incoming crypto Bull Run I want
everyone to remember the following words
crypto is only good for regulatory
Arbitrage what regulations are you
arbitraging right I thought about going
on uh they they invited me to go on Bank
list to like talk about this but I
decided not to do it because what's
going to happen is you're going to get
all the stupid crypto haters like just I
don't want haters man like I got enough
haters already you know you just get you
just get ha I do George Happ blah blah
blah blah blah blah blah blah look look
here's the truth of crypto I don't think
they're sus I think they're nice guys I
like the podcast but uh you know I just
I just think that like that's not really
an audience that um I want because a lot
of them are really toxic and like they
have these okay so here's the general
idea of crypto right uh crypto is only
good decentralized stuff is way worse
than centralized stuff but decentralized
stuff can exist when there is an
Arbitrage opportunity and a big form of
Arbitrage is regulatory Arbitrage so
Bitcoin found a use case for selling
drugs across the internet right and the
regulations they arbitraging here are
banking laws if some drug dealer started
taking PayPal things really wouldn't
work out for him that well you know
strip ain't going to process that
payment for .5 grams of ketamine 100%
Check reviews early confirmed right like
just just just so you know you got to
use Bitcoin for that right but then
ethereum managed to find an even better
product you know what do people want
more than drugs and it turns out that
the product is unregistered Securities
right like like like gambling the
shitcoin casino buy the token do a crowd
sale this product has even larger ma
than
drugs uh so yeah yeah yeah so you know
crypto's good for drugs and gambling um
but then someone's like I'm going to
build a payment Network for dentists on
crypto you don't have to there's no
regulations to Arbitrage there you can
just build a normal payment Network for
dentists but it's decentralized yeah
that's a bad
thing
um no Sam bankman freed was an idiot he
actually had a good business going and
like you know like most greedy people
just just just kept going like it never
stopped man it's like the kind of guy
who like you know I put all my money on
red and it hit man I doubled up I put
all my money on red again and I hit and
it doubled up so you know what I'm going
to do now I'm going to go put all my
money on red oh it came up black oh yeah
so that that is that is what happens you
know with with things like that
um you actually believe what you're
saying for real
yes I mean okay so there okay there
there are a few other regulatory
Arbitrage opportunities in crypto that
are slightly less uh gambling and drugs
um a big use case is crossb
payments uh crossbo payments to have a a
Universal Medium of exchange uh tiny
Corp pays out its Bounties in uh either
PayPal or usdc you know PayPal is not
for everybody and usdc is is a bit
better um but again most of the reasons
why PayPal is not for everybody come
more down to regulatory Arbitrage than
anything
else
uh yeah yeah I think that there's some
interesting stuff in
privacy um unfortunately most of those
companies are
scams uh like the people haven't built
the how come I can't buy a coffee with
crypto right how come I can't why is it
very easy for me to buy a coffee with
credit card but if I want to buy a
coffee with crypto I can't right like
this just shows something broken about
the technology not anything else it's
because a lot of the people putting
money into it now are not developing
technology that's useful for anything
and here's kind of the problem right
like once you're deep in a
scam um there's no real way out for you
right there there's no way for you
to uh you've promised so much that you
can't just like ship something
reasonable this is also true for people
who've taken on a large amount of
investment right like you you have to
look tiny Corp raised $5 million right
uh we're going to sell these boxes
probably going to sell hopefully $5
million worth of the boxes right like
that's pretty good like like it's it's
reasonable it matches but if tiny Corp
raised 500 million and we came out with
this we're butterfly Labs
right or not what's the one 21 21 not
butterfly Labs 21 buttery Labs was some
other scam but like like they raised
hundreds of millions of dollars and they
released a Raspberry Pi Bitcoin mining
hat like this is a
joke um Bitcoin mining hat
21 no no no no no no wow this company
was the company called
21 Bitcoin mining Raspberry
Pi
yeah the 21 Bitcoin computer right how
much did this company
raise uh now this is a
different
21 yeah they raised lots of money and
built this and look if a startup rais
like a couple million dollars and build
this okay that's pretty cool but you
know 21 crypto
coinbase it's it's not
this unless they
like can someone link the real
one
Bitcoin
computer I can't even find it
um yeah I don't know butterfly Labs is
not really what I was thinking of I was
thinking of this and like obviously this
doesn't
work
um yeah like one way that crypto could
succeed is if the centralized stuff gets
worse right the more they decide to
scrutinize the more they crack down like
like crypto does succeed I think crypto
does very well in Venezuela right like
if your central bank is so terrible then
yes Bitcoin Bitcoin has managed to out
compete Venezuela's currency
great
um no no crypto is not destroyed by
regulation
uh this is a myth like the the thing you
think the thing that holds crypto back
is regulation it's not why can't I buy a
Bitcoin with why can't I buy coffee with
Bitcoin we're working on this new thing
I'm such a bullshit why can't I go to a
store load my mobile wallet up tap the
shit you know you got to start a company
call it triangle right you want to beat
dorsy call it triangle man it's a
triangle you tap on the triangle angle
to pay with
usdc right that'd be pretty
cool uh what about bitkey what's bit
key saying he'd close it down yeah I
mean look JP Morgan might be upset about
crypto but you know who likes JP Morgan
you would have to use Bitcoin lightning
oh confusing like like it's
just what about Circle pay oh no no no
no no C dbc's no no cheapy like yeah you
know honestly no but like like you know
what you know what if someone said I was
a scammer for pre-mining cheap be and
I'm like you know what you guys deserve
the hell that is crypto like you guys
deserve everything you get fuck all of
you I'm out screw you guys I'm going
home right
like screw you guys I'm going
home
uh what's risk zero oh no this is like
another this like a Leo like no you
can't do this stop doing the compute in
ZK when you don't even have a ZK that
can
send don't put the compute in the ZK
okay okay you you don't need Anonymous
compute Anonymous compute does very
little what you need is an anonymous way
to get money to places that you can do
compute in public right suit Anonymous
computer is fine oh you know but it's
just that's not the point right the
point of crypto isn't to make something
good it's to shill your bags so you can
dump them and move to Puerto Rico where
you don't pay tax but life sucks but
you're like at least I don't pay
tax speculators man it's not even
speculators right no no no it's actually
you know what it is you know what it is
it's not speculators it's Founders who
cash out every person whoever founded a
company who cashed out of something that
wasn't legitimate profit made by the
company is a bad person
right if you found a company and you get
rich without delivering value to users
I've sold zero comma shares right I will
sell comma shares once I'm selling them
back to the company based on profits
from selling the
hardware like once you've delivered the
value yeah sure you should get rich
right like like that's an appropriate
time for you as a Founder to get rich
but if you haven't delivered the end
chain of the value you should not be
getting rich
about scalability using ZK oh you don't
have to pay gas fees you just have to do
this this this 17-hour computation on a
supercomputer then you can verify it
know of one time but it uses this like
moon maath like you don't understand
it's a polinomial commitment but we use
this hash function oh my God why can't I
buy a coffe with
Bitcoin floating
[Laughter]
sh
um no it's it's the truth is that people
got rich and that's that's the real
shame of crypto um oh in other news in
other news too simple oh I remember I
was on I was on a panel with these
people um clowns absolute clowns and
like you could just tell immediately
like who bought this company like who
bought shares in this
company you
know like this was a scam self-driving
company at San die oh they weren't a
scam Don't Call Him a scam that's
liable well just look you know what if
you want to know if something's a scam
or not just look at where all the money
went I don't know man a lot of money
went in no money came out
interesting
um oh we'll continue to operate out of
China well
like H what's
sgx also also ethereum why did you
switch from proof of work like the
switch to proof of
stakes that's just innovation in the
wrong
area
um it's not if the money would go to the
right people and not the problem right
because the right people aren't usually
limited by money the problem is the
people with all the money okay so
there's some Talent right uh this is
this is a general rule about Society uh
10% of people will never steal 10% of
people will steal anything that's not
nailed down Society is about winning the
hearts of the minds of the other 80%
right so you have 10% of people who are
talented and are just they're always
going to work on things that aren't
scamed things that are open source you
have 10% of people who are talented but
for some reason they're just total
scammers it's about the hearts and minds
of the other 80% right like how many
legitimately good Engineers worked at
tonos and spent their time on something
that was obviously completely
worthless that's the
problem the problem isn't that the money
is not going to the good people the
problem is that the money is going to
the bad people um just having less money
would make Innovation happen
faster
what if the 10% is rapidly increasing
due to Broken borders I mean yeah the
American Border look I'm I'm an open
borders guy like I I think that the
Border should be open but it's open in
the absolute worst way right now right
it it's open in the sense that you know
like you can a criminal can come here by
just walking across the border but if I
want to get you know a developer here
from um from uh Greece well you
know you're going have to apply for a
Visa J1 o1 blah blah blah blah blah like
like like you now have the absolute
wrong selection function I think open
borders are great people are great right
you just can't give them free shit but
more people are
great um no they're going to come in and
ruin the culture
man
uh
sounds like communism no money for all
that's right that is the real truth of
Communism you can you know what you know
what happens you know what zero divided
by anything is
zero
um no I mean yeah taxation is taxation
is De like there's there's
no um so guys the globalist American
Empire is over uh let's talk about that
let's let's uh let's uh wow I should
have a I should I have a podcast so Sky
Bri the globalist American Empire is
over what what are your thought on
that
um we stand with China no I'm sorry are
you are you Han Chinese no no no no no
this Empire is not for you this Empire
is for the h Chinese um that is a sad
truth about China
uh and you know I I would love a world
if if China were to
liberalize and like embrace
multiculturalism it's not
multiculturalism that that that causes
Americans problems multiculturalism is
legitimately great um this is I think
one of America's greatest strengths
right because you're allies with all the
countries if you have their immigrants
there right like I you know this closed
borders policy I I don't really
understand it the problem is you do have
to be somewhat selective with who you
let through those borders the question
is is this person an economic asset or a
liability right you want Assets in
liabilities blocked right
simple like I don't know it's it's kind
of baffling to me that nobody runs a
country this
way um I guess I guess yeah I mean you
come close with a place like Singapore
right what problem with crypto is that
the world needs to be open to a big
change no know this right here is the
stupidity of crypto people the problem
with crypto is that I can't buy a
Bitcoin with a coffee right a coffee
with a Bitcoin I can run a coffee shop
and I can have a phone I have a coffee
we're going to open a coffee shop I get
into that later but how do I take crypto
at my coffee shop I
can't right I'm not a racist or a
humanist I'm a technologist that's
right
what yeah I want some lean you got
lenies
um bit key check it out I'm buying a
coffee right now all right where can I
go where can I go buy a coffee with
bitkey a self- custody Bitcoin wallet
okay great now where can I
go where what accepts
bicki why do I have to buy a little QQ
looking thing I can pre-order a little
QB looking thing all how much is a
little QB looking thing
$150
and where is this
accepted this is actually kind of cool
though I do like this when did this come
out oh it just came out all right all
right all right all right not bad not
bad good I I actually Jack dorsy DM me
and uh I dm'd him back saying bro if
there's anything I can ever do to like
help this happen uh let me know and he
didn't reply to me but
uh I'm interested in this
happening dorsy really tries to do stuff
yeah no look look look I I think he was
a bit depressed at the end of Twitter
man in the beginning of X by the way by
the way just just
like I voted yes in the Alex Jones
poll like
you know there's way worse people than
Alex Jones on
Twitter um dorsy is a pizza client is
this is this like a vague Pizza gate
reference um no Elon Elon Elon is
literally winning the culture War I had
my doubts about his strategy but it's
totally
working uh oh I prefer cdbc over crypto
okay okay who's glowing we got a we got
a we got a glowy over
here
um there's literal dictators I
know we can't have Alex
Jones
um yeah
inah we got we got we got we we got the
do we got the dictator of Iran no like
who's like who's like the worst state
sanctioned mass murderer on
Twitter
um the talibans on Twitter yeah
yeah see that kind of Alex Jones tell me
okay all right all right we're going off
in the in the weeds here uh I'm going to
go eat
lunch uh if you can't buy it it's not
real uh NX OS is just Arch Linux for
dock Docker it's it's the docker Arch
Linux it's it's like if you don't want
to you can use Docker and you buntu if
you want your life to be easy or you can
use nxs and uh and Arch if you want your
life to be hard uh but you know some
people like their life to be hard some
people don't have enough difficulty in
their life and that's why they play
video
games um can we raid someone no we can't
raid someone I gotta go bye everybody
it's
lunchtime wa who can we raid we could
raid somebody do we have anyone to raid
if we have this is a lot of effort I
gotta go I gota go I got food to eat
goodbye
everybody
it sounds ok stream earlier no it's
streaming time now Bros Labor Day open
end not application low er no
applications okay try again open em you
know ok security settings now probably
most of the stream is going to be me
trying to get this to work yeah I don't
know about these audio problems guys
like I hear this sometimes so it
probably isn't all trolls we're getting
a lot we're gonna oh yes on exciting
world Oh perfect
let's go
drag and drop games here we're going to
speedrun Super Mario World dismiss Super
Nintendo oh yes perfect ah yes this is
actually gonna work
controls now I have here a ps4
controller only because I couldn't find
my Xbox controllers so sorry Sony if I'm
hacking the ship I deeply apologize you
can sue me just kidding don't do that
mmm Wow they already have good mappings
for it
yo emulations gotten good yeah let's
play all right I don't actually know how
to speedrun this game but we're gonna
try our best well okay so actually hang
on oh sorry no they're not me back let's
exit full-screen here go to my twitch
ease put my twitch ease over here and
let me see if I can fix sound display
capture video capture device audio
output capture create now device no
device
[Music]
no mic ox
yeah I don't know how to help you guys
with the broken audio but we're here and
we're gonna try our best to speedrun
this game let's go oh I had to do some
cloud shit there with like Yoshi and his
tongue I've seen speedruns before all
right so I know when you speedrun you
just keep pressing right and sometime
you press jump oh I should have just ran
into the thing I think the 14 is
slightly slower all right so I don't
know anything about speedrunning I don't
know like what routes to take or
anything but I think we're gonna go to
star world right how do I do this level
I've seen the speedrunners do it and it
wasn't like this I need peace speed up
thank you sir can you hear me turn the
volume up a little bit okay we should
watch a real speedrunner do this super
mario world speed right now they're just
cheating with credits warp glitch i want
to do that crap this may be
oh here he's on this left okay okay so I
did that too I might want to host
character but like we literally did that
last night
oh he jumps there okay jump on the Koopa
okay let's try that again
[Music]
he's betting's hard guys let's try it
again see I don't have peace you see
when he's sick sounds a little Mario
thing oh so close that time guys all
right we're gonna jump there there and
then up
all right don't worry never fear try it
again in order to be a speed runner
you must keep trying alright good I'm
good at speedrunning this level
I lost speed there I got a time nap
better lag frames oh yeah okay alright
we're good at speedrunning that level
all right now we just got to get good at
this next level wait on big Mario does
that matter I won't be big Mario after I
died
let's try that again jump all right I
gotta land up there I got a jump no no
no no no no no no no no no no watch how
this guy did it in the video look I saw
him do it
jump jump jump
look at that pro scale look at that guy
do it he can do it I can do it jump too
soon
[Music]
oh yeah getting better guys I'm getting
better
[Music]
oh do you guys see that so close yeah
we're trying to speed run brows no that
was so close guys that was so close it's
gonna feel great when we get it look it
from where he jumps okay all right
that's a good point
[Music]
watch in slow motion
he just has skill I got to figure out
again you know what if I can just get
more speed on the first level we can
make it up I'm gonna why he gets that
shout
oh he like does weird shit he does he
goes glitches this is a glitchless speed
on you guys now okay yeah we got to get
my timing better on that oh yeah look at
that that's the route I know the route
now oh yeah we definitely don't want to
get that last charge of Chuck oh yeah
you see how I didn't jump there - I'm
getting better at speedrunning guys
[Music]
[Music]
you're only gonna try this once boy oh
did you see that did you see that shit
I'm a great speed runner I supposed to
jump on that Cooper app alright
[Music]
oh yeah I'm getting reliable at it guys
I had to jump on that Koopa didn't you
see what he was doing I can't lose my
pee speed no we don't do reverse
engineering if you're looking for that
you're on the wrong Channel we speedrun
Super Mario oh yeah all right fine you
won't go we'll go cupola yeah that was
that was douse dumb that was dumb
[Music]
oh yeah
speedrun bros what are we doing this
level P speed spin jumps all right cool
oh that was was that a shell jump that
looked hard okay we've got to do a lot
of spin jumps now if you want to learn
to hack oh wait how I hold I'll hold
them with the Run button n spin jump
speed run okay we beat that level very
fast
[Music]
I'll find somebody's I fail is purple
said back too many spins oh no we only
do things that don't teach anybody
anywhere like how to poorly speedrun
mario what does he do about that guy
that guy seems like the enemy
Chay's in oh did you see that low-speed
spin jump oh that was sick though let's
try again you know what they say in
Galaxy Quest never give up never
surrender let's go alright then spin
jumps are faster oh that was bad I lost
so much time on that my splits hey
you're watching my stream we streamed
Super Mario speed running very poorly
you want to get good at something you
got to practice very hard like to see
this jump when I started speedrunning I
couldn't get this jump but now I get it
most of the time yeah speed one skill
don't even think I had to jump down
going low koopa piece beat did that on
purpose guys
I don't think I have to jump here I
think I do this Ronnie Cheryl went
backwards you never do that in a
speedrun if you're pressing the left
arrow in a speedrun you're speedrunning
wrong all right this is the level we
just run and spin jump a lot we have to
throw the shell up here up yeah I get
that fish I spin Jobert can I show my
controller on screen not supported I
[Music]
want to show my controller inputs on
screen for the pleasure of all of you
watching at home a gamepad viewer
no display mo I don't know about this
[Music]
oh come on let's see what he did about
that fish has more of a dry humor me not
a nut I mean that's in your face does he
do that with the shell he does it so
fast
[Music]
[Music]
that's some cargo cult speedrunning
right there I I got the shell cuz he got
the show those mines it's tricking you
guys mushroom with so many lag frames
just levels hard okay run spin jump down
spin jump they're at a second platform
how do you really learn to do this
[Music]
second part see he never goes in the
water
it keeps p-speed all level only have one
life left tweeze hats and get infinite
lives no now we only use hacks on this
channel this is the Tom Cruise channel
there's no hack it we speedrun mario
okay we're gonna go for the low spin
jump around the guy always smash that
fun mash that button yeah ah we hit them
[Music]
guys but you know what they say in
speedrunning you gotta keep trying you
get faster with every run purpose
watching to do some purpose I don't want
to be big Mary ow
[Music]
yeah you see there we did we did noise
cancel no I don't know why I didn't make
the noise when I lost my thing hey hey
hey slow run hey I want to see you do
better
let's see your speedrun skills brah
alright this jumps hard I got to focus
guys I really got to focus on this
[Laughter]
you're gonna make fun of my speedrun oh
yeah look at that look at that I get
that
reliably now don't low Koopa nope I
landed the other specified purpose okay
so I know about speedrunning you never
press the left button the only choice
you have is how hard you want to press
the right binder see these are the
buttons don't press this one is this
isn't speedrun and you only press that
one alright guys
oh no I have to do this one again this
one this one's hard
[Music]
ken did that right how to do that shell
track oh come on I hit it with the spin
jump let's watch his route really
careful
okay early spin jump there there there I
don't know what that shell shit is the
early spin jump stuff early spin jump
down their second platform go go
no I think he does I don't know what he
does that he just lands on both
something like that with the shell hey
tech fish okay let's watch carefully
one spin to there spin to there
spin to there but you get no okay only
first platform there okay let's try that
I don't really spend jobs here second
platform go go first platform perfect do
the weird shell trick up fish killed me
how does he do that
terr second platform first platform pick
the shell up turn drop it jump should we
Google have a shit I don't know I'm
trying to figure it out okay early spin
jump go second platform huh messed up
messed up and now I did that I'm so bad
I'm the worst speed runner ever guys I
have no future and this I should just
give up and win self-driving cars
okay let's watch castle
low-spin job I don't know how the guy
did that I knew did you go tutor me
what are you doing area 51 you want to
teach me how to speedrun area oh yeah
got it
I got it no I didn't mean to pick that
up no but at least I can get first jump
[Music]
all right guys you know what they say in
speedrunning do it again let me find a
Super Mario World all exits where they
don't do Glen Chao kill them jump spin
jump over that
you just did that for nothing man yeah
that looks very similar to my speedrun
[Music]
we could try game genie I don't know is
that how these people practice I met you
jump to there no no no okay let's do
that again
this one cat one jump there jump there
spin jump over that jump there see
oh my we're gonna do that spin job I
gotta keep my oh yeah kill it with them
speed guys I really got to focus on this
part got it no okay let's watch him a
little more carefully because I saw what
he did for the first thing well it
seemed he has a there there there keep
running there there kay jump on them
both go jump over hit that alright I see
[Music]
I don't like I should learn game
mechanics probably just what do you
think you get something no oh okay okay
I see what I have to do
did you see how that one was different I
just got scared guys you know what they
say in speedrunning though you can't
give up you got to keep just going you
did a second jump there and then their
lamb there nice spin jump I'll go do the
spin jump transition better good up
differential
Oh guys please donate to my channel I'm
sorry if you'd rather like I'd be doing
something else productive with my life
like programming or hacking but this is
a marriage of speed running channel we
speedrun mario very poorly see that's
how poorly we speedrun mario I see what
I have to do Mac oh look at that that
was good that was legit fine we'll go
low Koopa I don't have P speed that was
good ball lasted just gotta keep going
I'm not pressing the go right harder
[Music]
where is he when he jumps that's a good
idea I might want to host character like
we literally did that last night
frame perfect trick yeah do that again
[Music]
we almost got to go hi Cooper that time
[Music]
[Music]
with one life I always spend jump
yeah second platform to make it all the
way to the other platform there over
[Music]
engines I'm pretty good at this level of
guys
[Music]
oh it says she'll jump question mark so
maybe that's not that hard maybe that
actually is a really hard Trek mean
Chardon Chuck well this is the best
speed I've ever had guys hi Koopa what
does he do there he jumps jumps over all
that I got high coop of that time and
I'm pretty happy I'm just making up
speed running lights okay early spin
second plat first plat she'll jump oh
did you see that was close
oh that was the speed run if I've ever
seen one guys that was fast
I had great time without me let me put
my splits in how do I get one of those
split counter things
I'll get one soon
[Music]
low jump spin okay I've got to figure
out what to do about that guy okay spin
spin oh he just managed to spin below
him he's good oh my get down everything
kills you in castles how do I get off
the wall
[Music]
oh I'm a speed runner i hate auto
scrollers caution about that
[Music]
[Music]
No okay fine
I gotta figure out a better kill these
bosses how does he do it bro he's just
going down the wall Wallace caller
[Music]
[Music]
yeah you see that this is speedrunning
scale bras yeah mash buttons fast
buttons math buttons alright what I do
now I gotta I gotta learn Kate mechanics
she gets special exit here we gave you
the special exit see where did you get
the Cape on the first guy let's go donut
land guys so he did that way faster all
right what are Cape mechanics you can
fly forever with this Cape I just don't
have to do it let's look out Mary Oh
world Cape mechanics follow-up not
useless yeah okay just stay in the air
alternately pushing left and right on
the died but I'm getting it kind of yeah
I don't want to talk about we used to
continue in my speedrun
[Music]
what what Kate back not on mushroom no I
didn't want to continue
no how do I get continued fine you take
you have to come back here Cape come
back here Cape it's terrible oh I'm
terrible go back to the beginning this
guy with tape tape there's got a cape
come here Cape there my cape who's a
cape guy gonna continue
[Music]
[Music]
okay bro getting better no right here
and donut Plains one is a great place to
learn Katy go back to the other one
Mario grab the loop is down check is a
face hey see that Cape cancel guys
[Music]
now okay that took way too long where do
I go next
look at him he just Brants over the
whole thing does she is pro he got
instant fast fly of course like sugar
should have gotten that one I gotta go
for this secret here no no oh this is
keep shell I know keep shout
[Music]
[Music]
[Music]
okay fine where's he gets shell well he
goes in that pipe this is their throwing
pipe okay we need to get wings keep the
shell I've seen this guy no I don't want
that I want the shell
oh my god really
oh there goes my shell scenario swims
faster when he has an object
[Music]
okay fine
do I need Cape for this level
I need Cape for this level no that's the
wow that was boss look at him he's boss
with that Xiao well I don't know about
all that
let's see what exit I have to take why
up there with the pay okay
[Music]
[Music]
with my pika
[Music]
is my pink
[Music]
[Music]
big boo can't hurt you actually little
boobs I probably shouldn't have lost
cape
rainy cape for next level I do
[Music]
spin jump cancel perfect there's a
mushroom oh no I can't cancel bro you
are a king I want cake how does he do
that thing Reid cancels their workouts
like that how to play the next level a
water level get the Yoshi don't feed the
Yoshi
take the Yoshi and swim over everything
until you get to that fishes and then
swim under everything down earlier oops
[Music]
hi ocean
can what I do in the next level fly up
with the p ms no now I have to go back
get flying know what a better idea if I
get blue Yoshi can't believe she eat
anything apply this is an alternative
route you guys fly eat fucking cloud man
now my blue Yoshi okay put feathers in
the box okay fine
new Tom Cruise's here - shit talk my
Mario's speed someone get Kanye on the
phone this has to end
how's Kanye gonna help can Kanye speed
run
oh no that was terrible I was looking at
you guys
Oh guys I don't know the last time I
saved if I die okay you gotta focus okay
let's get double cape is that what you
want the whole camp no if I kill them
like that I don't get any cape
[Music]
you only get one King don't mess it off
[Music]
no I did that last time secure shit eat
that Yoshi you're like oh my god how do
you come back no that was bullshit wait
how's this supposed to work the NTIA
like jump off no shoes mechanics at this
level because I haven't beat it
oh thanks for the cloud bro I just stole
his cloud thanks bro
[Music]
this is an alternative strap it's called
cloud steel I did the cloud steel strap
I don't see what I'm doing the next
level I fly over the whole thing with my
wings that I don't have fast all right
all right come on please
okay let's get gameshark wings gameshark
wings superman i get wings settings
select cheat start his cape mary oh oh
they know what's up
wait where's my cape just like she start
his cape mario i don't understand
[Music]
I'm not Cape Marriott well limited lives
let's just start these aren't good
cheats
unlimited alive that's a good cheap
limited lives I don't really know if
this works Cape start as Cape Mario
start us fired
[Music]
Oh unlimited lives works but not
starting is Kate Mary yeah let's just
die I have an idea we gotta practice we
didn't speed one of the Star Wars enough
anyway I don't navel on the bias I'm
done with cheating guys
cheating's wrong don't cheat we're gonna
get double cape over here come on Kate
[Music]
okay remember the strats guys spin jump
figure out somehow how to do that Cape
cancel down
[Music]
I'm trying to clamp I don't know how we
get that I fine
twit cheese I'm sorry did I call you
slack ease I'm sorry
scobie's I'm sorry I know your pitches
at oh I know this strat oh this is the
easiest I love the straps oh no I said
yo I know my fucking cake that was
literally the worst thing that could
have happened in this level now I'm
gonna have to play it that was literally
the worst thing that could have happened
in this level guys yo she ate the star
[Music]
you see five swimming fishies you want
to go down yeah oh my god this level
takes so long now those fish died try to
follow me guys cheating's for losers we
don't cheat
[Music]
where's my tape was my cake add cheap
good tape
[Music]
powerup selection it's this dad cheats
ox and sheep power off press often
select eyebrow jacking your cloud drop
[Music]
never mind
press come these don't oh I have to turn
it off there's only in the levels wait I
had a cake
how'd I get that did you see my cape
oh I figured how to do it okay oh yeah k
bro
[Music]
[Music]
I'm trying to be pro gamer guys okay
let's say you play this level was it to
me as well okay I did that you run fast
fly immediately please wise under the
level that looks hard I might have to go
back to donut secret and practice my
cape perfect
fast fly immediately please
[Music]
how did he do that oh yeah you see that
skill tiger P speed again so anywhere in
this level I can get P speed now flux
I'm waking up at eight and a half hours
thanks for telling me
but see here's the problem we have to go
down there unless we can floppy let's
just enable infinite lives
[Music]
[Music]
[Music]
okay you really have to get the timing
on that right not like that
I know I got a work on the Cape mechanic
guys I'm getting better don't worry have
you been here if you've been with me
since Yoshi's Island three you see how
fast I improve it Thanks oops
[Music]
deaf Lila I did this twice
[Music]
he flies on direct right path I
immediately please why do I want this
Yoshi yeah okay you're right just fly
around at the timing haven't just freak
out on him down low I don't want this
Yoshi you know Leo she's too long
[Music]
see I'm going just too low this is not
that easy - we try to do ML speedruns
after this we'll try to learn to
speedrun like learning to speedrun from
watching youtube videos I'm gonna be
pretty cool actually if I could really
do that that would be like a super paper
worthy thing no see okay it's very hard
to actually gain altitude while doing
that it's doable but yeah I know I know
it's timing I know but there's no way to
like fly around should I go to a
different level no no no no I could
never do this in fact when I saw this in
speedruns I didn't know that that was
possible with the Cape I didn't know
that it was possible to stay airborne
forever so not every six-year-old could
do it I sure as hell couldn't do it when
I was sex see I was so close there I
have to work on gaining altitude once I
lose
[Music]
[Music]
close close close close and get me guys
I'm got it don't worry don't worry I
won't keep you to it she's here forever
yeah it's written in assembly like a lot
of people would disassemble yeah I'm
trying to fly the entire board I know
that's what the guy did in the video
[Music]
[Music]
game class okay okay you know just so I
can do the flying mechanic I mean I
understand it it's just time but
practicing there is just as just as good
as practicing anywhere else
the trick is will not play flesh welcome
to my channel but we're trying to
speedrun Super Mario World
[Music]
ah so close I'm getting it back well you
don't even have to press forward can
actually just press back it seems oh
[Music]
this is so easy you just press back oh
this is the easiest thing in the world
okay food ate so much food today we ate
food drank beers Labor Day oh this is
the simplest mechanic once you figure it
out homes you know what the problem was
I told myself you never press the back
button and speed Ronnie all right how to
play this level oh why don't I just go
there all right
Bowser skip over 1 2 now go into 2
all right we're not gonna try that well
actually maybe we can oh no you got to
keep your piece beat in the door I've
seen this before
well dive and you want to okay I say
room seven takes you I don't even know
about that do any music he doesn't jump
and then up yeah okay does that and then
he goes to the door then Bram suck I say
[Music]
my name is the door
I love the new Eminem album I think it's
great I said it was fire fine oh my god
this is so slow I thought this was
speedrun bro I'm seven please
how's he keep that
[Music]
what what what dish you thought was wack
see how he does that he jumps first
frame jump and then he still has it okay
no damage boost
which it was the desk she gun kills all
right you can dis little Zen and little
yachty only wise people suck I'm seven
please
[Music]
[Music]
this one's hard
[Music]
alright let's just beat this level by
Bowser going down old-school style with
Mario skill and cheats
[Music]
[Music]
Cape cancel the last guy what is this
he's memorized this why people are dumb
that's a great question
I think it's led
[Music]
this guy
[Music]
[Laughter]
[Music]
that's fly
all right thousand gonna die
[Music]
the Bowser I need some Mecca Cooper's to
throw out you throw Mecca Cooper's know
and what's too far off the screen for me
to get uses a complete ambassadors
traveling in do because it does yoshi
coin shit
and princess give me a mushroom love
mushrooms oh yeah I needed that clean
been flying around like a moron
my pals like give me something to throw
at you come on a marble no no I want
marble skip no no marble whoops my
princess is in another castle after I
fought this asshole in a smiley balloon
mecha Koopas thank you I missed oh you
gonna drop another marble
I ain't marbles marbles marbles eat you
too maca Kubas thank you die Bowser
hey princess can I have a mushroom
princess all of you give me mushrooms
and then you're stuck in the smiling
pool with the weird guy oh god no
no the mushroom where'd it go
what's the sake of Bowser's shit Macca
Koopa yeah mega Koopa wait what no that
wouldn't kill them that want to kill
them do I have to replay this level Oh
No
okay it was literally one mecha kupo
away from killing him I don't know how
to do that part with wing yeah I was
living my god
[Music]
hate that guy down all right let's just
keep this guy I know I said that last
time I was trying
hate those things
hate that thing hate that one we tried
to Cape cancel Mecca Cooper couldn't
come to door with me
Oh yo if you guys donate ten bucks I'll
do programming yeah
see that Cape cancel don't get lucky
twice you know
mega Koopas thank you
[Music]
did you donate $10 will do programming
no one donated any dollars for my love
quality Mario no Machine Gun Kelly just
Eminem back I'll watch that no no no
whatever you can't pay me to do reverse
engineering but you can't pay me for
programming we will do 30 minutes of
programming after this if you donate $10
we'll go back to Gantz you can do Ganz
but you gotta donate $10 donate $10
that guy's hard look at that one it's
hard he's hard to see look I can't get
around him
[Music]
if you don't need $5 that's not enough
and you tank
how about you donate seven and then
someone else will donate three because
we don't get money by the time I beat
Mario I'm going to sleep or we could
have a long night of program but I need
money
[Music]
guys no I'm not even like trying to
speed run anymore I'm just trying to
play Mario
[Music]
okay point one Bitcoin hell yeah bro if
you don't make point one Bitcoin I'm
sold
point one now I jumped over no he came
back frustrating as hell that was so
hard
even with Cape Qi and on limited lives
this is really sad
focus focus for this episode is play
good mag don't play fast Mario play good
man you know we're here to speedrun if
you promised we'd speedrun but $10 so
who wants to donate $10 then we'll do
program Pico coin was your all coin shit
don't know Pico coins yeah we can do
that we can do whatever whoever donate
to be $10 wants yeah that's it I just
jumped over yeah that's right that's
right don't even hate these guys
[Music]
I was spinning so good I don't even know
what happened
[Music]
by Bowser let's go
yeah I'm getting better cheating no we
won't do reverse engineering but we will
do whatever programming you want if you
pay me $10 sorry I talked to shill and
play Mario at the same time I love money
[Music]
No yeah we can do no js' or rust we can
do whatever you want viewers choice
you gotta donate ten dollars
I know nodejs under us yeah I know them
both what do you want me to code let me
know what you want me to co it was
called it hate these fire-breathing
assholes what do you want me to make
emulator for as NES I don't think I can
do that that fast
[Music]
wait what I'm laying on his head hitbox
[Music]
no hacking I'm just gonna fly away I
don't want to fight Bowser anymore oh
yeah of course that's why I landed of
course some big barrier now - I didn't
expect that
[Music]
to mushroom not beatable now never you
guys donated I beat the game I mean
money this game wasn't free you know it
cost me $50 and if you're saying if
you're saying that you saw me at the
beginning of the stream I just lost a
thing if you if you say you saw me at
the beginning of the stream download
this for free off the internet well that
would be true but
marbles oh you got a common compatible
car congratulations welcome that was a
scam I even get that other Mecca Koopa
they do all this like shit to skip the
Bowser fight and speed runs and the
Wonder I can't do this look the guy
cheats uses glitches with all Bowser
fights just a few did good
like Bowser fights no
right
yeah take that Bowser no no no no no
there's glitchless speed rocks
I'm going to rescue the princess if it's
the last thing I do
tonight unless you donate $10 and then
to program washing
Macca Koopa thank you cheating
dear boy I'll go back to twitch s for 10
bucks I'm a cheap programmer come will
this used to be a programming stream hey
hey hey hey Marilyn princess of a
platonic relationship thank you for
subscribing to my channel they're gonna
take a vacation this is nothing there's
nothing untoward about that
please donate to my stream yeah first
time you guys alright so now I want you
to edit that stream together and then
we're gonna post a fake speedrun cuz
we're gonna be just like Billy Mitchell
you guys know Billy Mitchell will be
just like Billy Mitchell he's a famous
video game player who cheated
yes sissy this was work for Mario but
this was in captivity though really if
you were caught up by like that guy
alright next time we'll have splits and
we'll try to get better
wait did you really sub to my channel
did you really just sup to my channel
when you stop normally I clap when
people sup know you've been stalked for
as long as I can remember don't try that
shit you resolved I don't know about
that I do appreciate your subscription
but well I always clap Joker
[Music]
no I'll never be like Billy Mitchell
don't be like Billy Mitchell guys if you
give me $10 I'm giving you no nevermind
it's too late I'm going to sleep see you
guys bye twitchy's thanks for not giving
me $10 and now I don't hit me anything
during my super heart's chief speaking
All
right. Good morning,
everybody. Welcome
to Saturday in Hong Kong on
Saturday.
Um, oh, we could play on that laptop.
No, that'd be a bad
choice.
Uh, see if, uh, wait for a few people to
to get in
here. How are How are you? How are you
today? Today's Today's stream is gonna
is going to be about you and it's going
to be about
education and teaching you
things.
Um, I'm not sure how possible education
is. I You really have to ask that
question, right?
Everyone thinks
that, oh, we're gonna like I don't know,
maybe people don't even think this
anymore. We're going to really get
answers to that question,
though. One of the things I like to
think about is
uh
AI, similar to God, is going to judge
you. Like, I think about it, right? I'm
I'm applying right now for uh for Hong
Kong residency and I have to put a
resume together and oh this is just like
like I got to put a resume together. I
got to like like do like I got to like
think oh wow remember that time I like
went to college and like worked at
Google and worked at Facebook and stuff
like oh wow you know you got the normie
you know that guy the guy the uh
interview coder guy Roy Lee I love I
love watching the people like this guy's
destroying his future like
dude what what world do you do you live
in you know like oh no oh no he's he's
he's rejecting
stagnant tech companies and Columbia
University. Like, wow. Oh, no. He's
destroying his future. Like, what future
are you talking
about? Um, my advice to him is make sure
you're always punching up. You know, you
always got to make sure you're punching
up because once you start punching down,
you don't have the uh you don't have the
uh the people's mandate anymore.
So, you know, I always try in my life to
punch up. And then once you get to the
top, you got to stop punching. Like once
you're the top, you got to stop
punching. You got to be like, I'm the
top. I don't punch anymore. We just try
to build good things for many people.
So,
uh Oh, yeah. No. Oh my god. He's going
to be so like like he's going to be so
fine. What What are you even like
talking about? Like like do do you
understand the normie person who like
graduates from Colombia and gets an
interview at Amazon? Like I wouldn't
hire them at Tiny Corp or
uh probably, right? I wouldn't hire the
statistical average of those people. I'm
not sure I'd hire that guy either. I
mean to be honest, I don't think he
wants to work at a at a at a at a
company, right? I think that there's
definitely some uh some some some uh you
know, questions there.
Um, but I think if he really wanted to,
I think he's definitely capable. Uh, you
know, there's just the type of person. I
mean, I'm kind of like that type of
person, right? Could I really work at a
company? I don't know. Maybe I'm
unemployable, guys. I'm
unemployable. What What am I going to
do? What am I going to do? The system
The system rejected
[Music]
me. What's happening with my utopia? I I
did work at Twitter. That's all
right. I was a fiveweek intern at
Twitter. My
utopia. You mean China? I don't think
it's a
utopia. I don't think utopia is real. Uh
but I do think that Oh, I saw Oh, there
was this guy. Uh let me find it over
here.
Um, someone posted on uh on Twitter that
this is similar to my version of uh of
Nobody Profits. Chinese subsidies uh
create not destroy value. Um, and it's
it's it's pretty good.
Uh, like, do we really want tech
billionaires or we want tech? In fact,
mega cap valuations indicate something's
gone seriously arai. What China wants
from BYD and Jeno Solar should be
affordable EVs and solar panels, not
trillion dollar market cap stocks. Like,
holy shit.
Yes. Uh yeah, like like like make cars.
Um you know, they talk about the global
south a lot. Uh yeah, you know, so I I
think that that it's it's nice to see
that I'm not like way off in the weeds
um thinking this stuff. And uh I read
another thing last night. Maybe we can
find it. It was on HackerNews.
Um, it was some like Yimi crap, you
know, like like the oh, we just need to
build more housing kind of people. Uh, I
don't know if we're going to find
it.
No. Oh, here we go. abundance isn't
going to happen unless uh politicians
are scared of the status
quo.
And there's a general fear of being a
landlord. Tenants have a lot of legal
rights and the risk of inviting someone
on your property who could start
squatting or doing drugs and not being
able to evict them is beyond the pale
for most
families. What the hell happened?
Like, and then all of these comments go
on to talk about a legal balance
between the landlord and the tenant. And
something that I repeat all the time is
that legal power is weak power. It's not
strong. It's not strong power. You want
strong power. A gun in your face is
strong power. Saying, "I'm going to take
you to court." And then after paying
lawyers millions of dollars and having a
judge and a trial by my jury of peers in
three years, I can finally get a
settlement which I then have to collect.
Like that's such weak
power.
So it's interesting that the these
things go that these things go back and
forth, but that's the debate. And my
argument is that the minute you've
framed the debate as a question of the
legal rights of the tenant versus the
legal rights of the landlord, you've
already accepted that you're in a medium
trust
society. Um, in a high trust society,
these things aren't a
problem. If someone starts squatting or
doing drugs, their family will come and
they'll be shamed. And, you know, it'll
it'll you you'll deal with this by like,
why would you do that? you know, he's a
good Christian boy and he goes to my
church and like you can make fun of that
stuff, but that is what it means to be
in a high trust society. Uh, you know, I
was thinking about Hong Kong is a high
trust society. Uh, and I think that's
one of the main things that I really
like about being
here because say there was like a
typhoon and you know the bottom floor
flooded. I would be more open to letting
random
uh, you know, Chinese people who live
downstairs and don't speak English stay
with us uh, than I would if the same
situation happened in San Diego. And
it's it's it's sad that that's true, but
it reflects the natures of the society.
In fact, I'd probably let the person in
in in San Diego stay, too. But I'd be a
little bit more on my
guard. Okay. Blah blah blah blah. Like
here, I don't really know how things are
dealt with, but things just generally
aren't problems.
Uh maybe one of the reasons is if you
think about what the Christian morality
says, the Christian morality says you
should help the poor, you should help
the beggar, uh you know, help the person
who's down in their luck. And it's it's
good morality, but that morality assumes
that that's a very small percentage of
the
people. Once that percentage of the
people starts to
become the these people are saying like
one in 10 of your tenants is going to
become a squatter. Holy shit what a
broken
society.
Um in Germany tenants have more rights
and legal protections than landlords.
Again, you can you
can the minute you're arguing that I
like there's a thing that I'm in favor
of and that's the first thing that you
think of, but then you realize the
minute you're actually arguing that
uh you've lost you've lost the plot. You
you've you've you've accepted that
you're not in a high trust society
because in a high trust society, these
things just aren't that big of a
problem. Uh so I that's the big question
and that's the big I do think that
that to quote my blog post the
demoralization is just beginning in
America and it's that
erosion of trust over the last 50 years.
I wonder if there are polls on this.
Like um USA poll, do people trust their
neighbor?
Okay. Here. I mean, this is this
is here here's here's a here's a proxy
for
it. It doesn't have to be a neighbor,
but like
like and again, I didn't I didn't I
didn't uh plan this beforehand, right?
This is this is just my feeling. And
then I Googled this.
Um this is this is the closest question
you can get at
uh do you live in a in a in a high trust
society or not. And you can see that
even since the 70s when I I don't I'd be
curious to see this going back to the
50s and the 40s.
Um, yeah, I mean, you can see the the
trend and I'd also like to see that
continue and I suspect the continues on
that same downwardly sloping line. Uh,
it's not that I'm never going back to
the US. I'm going back for the summer,
but this is a major problem. And this
this is the root of all of these other
problems. And it's so obvious living
here in America. I might, you know,
start on some dumb crap about how
tenants have way too many rights.
Landlords should be able to immediately
evict people if they don't pay. I like I
agree with that. But again, the minute
you as soon as you've gotten there, as
soon as you've gotten to the point, I
say the same thing about crypto. Crypto
is a
good crypto is the lowest trust society
you could imagine. If society needs
crypto like like the money like oh well
we have a smart contract and we're
enforcing this stuff like like you're
just in such a it's a backs stop. Yeah,
it can get
worse. It can
get but in a high trust society you
don't need that kind of
stuff.
Um, no. And it's it's it's interesting
how it how it rubs off on me how how I
find myself wanting to participate in
society in a high trust way. And I think
that this is a human universal. If you
put people in a high trust society, put
one individual in a high trust society
for the most part, they become more like
their
society. But unless
this is fixed, it's over.
Uh, let's see if we can find the same
thing for
[Music]
China. What? They're asking people in
other countries about whether China
respects the person. What? What a joke.
[Music]
into USA
again. I mean, we'll speculate for a
minute.
Uh, just imagine you were in the right
like like again a media America's a
medium trust society. I'm not worried in
San Diego that all my neighbors are
gonna gang up on me and kill me because
I'm a
libertarian. Uh I'm not a libertarian,
but you know, people have people have
misconceptions. Whereas like in in
Cultural Revolution China, that shit
might have actually happened. Uh so I
imagine that when you compare China in
the 40s and 50s to America in the 40s
and 50s, America's way above
China.
Um but now it's changed. Uh, and if you
haven't been to to East Asia, if you
haven't experienced this,
uh, yeah, I
mean, I find that a lot of people in
America are fed a lot of misinformation
on this stuff,
and until you fix
this, you're never going to fix it. Oh,
finally, finally, finally, we tweaked
the law. We tweaked the law between the
tenants and the landlord so there can
finally be peace. Like dude, that's a
dweeb. I want to like this like Dwight
Shrew energy. Like like you just just
No, that's not how it's going to be
fixed. Nothing's going to be fixed like
that. And as long as people are thinking
like that. Yimi
action. This doesn't
work. Yeah. Let's make everybody scared.
That's what everybody needs. Yeah. Let's
make everybody
scared.
Um, like like Yeah. Okay. I think you
get what I'm I think you all get what
I'm
saying. There's money and power and
division. Yeah, you can argue that
that's why this happened. But all right,
welcome to the opening rant. And now
we're going to go to subscribers only
because now the opening rant is over
because we are no longer in the opening.
We are in the midame. We're in the
midame. We developed our pieces nicely.
Got good control of the center. Got a
lot of Got a lot of squares covered that
knight. That knight on F3 is looking
real looking real flexible right
now. The coffee we ran out of milk.
We ran out of
milk. Um, yeah, this is a good
article. Uh, 5G here. I don't know what
5G is in America. I don't think it's
that fast.
Um, so let's start with the basics of
what a GPU is. Maybe we'll start with
the Nvidia CUDA. Have you guys ever
programmed for GPU before?
Let's just we'll do it
again. So, have you guys ever programmed
for for for a GPU before? Let's uh let's
do a snap pole. And let's say can we do
a
pole? Oh, yeah. We got to do straw poll.
I know how to do this now. All right.
Straw
pole. Have you
programmed
programmed a GPU at CUDA
level? CUDA hip open CL
level. Yes, a lot. Yes, a
little. No. All right, let's see what
we're starting with because this is a
noob lesson. This is a noob lesson.
We're gonna We're going to teach the
noobs things. Okay. All right. There's
the link. Metal. It's all the same. It's
all the same
crap. Oh
god. Oh god.
Really? Why do you even watch my
streams?
Uh, why do we only have 214 viewers?
We're weak on viewers
today. Wow.
Wow, you
guys. I don't know. Maybe maybe all the
all the pros are sleeping. Why don't I
have any viewers right
now? Why am I only 214? Where's my
viewers
at?
Okay, Friday night, late night, maybe.
You know what I did last night? I played
Magic the Gathering.
Okay. Um, all right. We're going to have
to start with some real noob shit
then. GPU
noob. Should we try to code in C? Does
anyone want to code in C? Oh, let's code
in Rust. Oh yo, I never code in Rust.
I'm so bad at Rust. You can all make fun
of me because I'm terrible at Rust.
Okay. Um, all right. Let's see. Rust
Open CL. Let's see how to do
this. A Rust implementation of the Open
CL3. All right. How do I use Rust? Oh, I
need an
LLM. Oh, how am I going to get an LLM?
This is so
annoying. All right. Well, we're stuck
with
this. Eventually, they're going to shut
this down and then we're not going to
have any LLM anymore. Okay.
Um, how do I use Open CL from Rust? All
right. So, we're going to we're going to
bring myself down to the noob level
because I don't code in Rust and I don't
know Rust. Uh, and we're going to we're
going to really start with some noob
stuff. Okay. Create a pro Q.
What?
What? This is
broken. Oh, this is the inside. This is
the
thinking. What?
This is
broken to use. Okay, we're going to need
a cargo
toml. Oh, it fixed itself.
Okay. All right. How do I enit Rust
project? Creating a new project. Okay.
cargo
new GPU noob. Oh, people are going to
lose it because I'm because I'm because
I'm writing Rust
shit. All right. Now, let's not call it
GPU noob. GPU noob will be the whole
thing. We'll call it
uh simple
CL. Oh, that one created faster. Great.
All right. Uh, okay. We got a hello
world. Okay. Good, good, good, good. I I
like the minimalness of
Rust. All right. So, what do I do? Can I
do cargo
run? All right.
Sweet. Let's add a dependency. Al 19. Is
this called alle? It's called Open CL.
on the seal
crate. Is this
really implementation of the Open CL
API? How do I know which one's more
popular?
Aqual is
here. Cl3 is here.
What? That's
Cl3. All right. Which one should I use?
Do I want to use Aqual or open CL3?
I'm going to make myself make my image a
little smaller so we can see more
[Music]
code. All right. So, how do I judge what
a good thing is?
I don't know. Three sounds better than
not three.
should uh use a or open
CL3. There is a more lower level
binding beginner friendly
Oh, well, no, but then there's CL3 which
builds on top of
this.
Oh, this is based upon the
Pro
[Music]
Q. You're new to Open CL and
Rust. Oh, I've heard about Rusticle.
Open CL implementation. That's just not
going to
work. All right, let's just go with this
one. Let's go with the OCL
crate. All right, so we include the
crate in my cargo toml. Oh, look. I'm a
Rust
programmer. Do I have to use four
spaces? Can I use
two? Just one of these languages off the
standard. Come on.
Fine. Connect. That's
fine. Okay. Good.
this
work. Okay, that's great.
Okay, we got our nice code that we stole
from an LLM and it
works. Remove that mute. Oh, I see why
it thinks it's mutable. Okay, that's
good.
Great. Work size. Global work size.
What? Oh, I need some like Rust plugin
or something.
What did all Does crab show
up? Well, it's kind of heavyweight, but
okay. Uh, what about
locals? I don't love
this. Let's read the docs.
Which one did we use? Used
OC. That's all the types. Yeah, that's
kind of cute. All right. Can I see some
examples of
this? This might be too high level. I'm
not sure what it's abstract.
It's going to
work.
No extra
argument. What's
d spatial dates? All
right, cool. That works. Uh, what about
local ID? Okay.
local work size and the local work size
might be set automatically. How do I
override it?
Ah, set default local work size.
Okay,
cool. Um, read the data back. Yeah,
yeah, yeah. That's
great. Yeah, it didn't work. Okay,
that's fine. This number is a little
big.
Uh, let's just change that to
like
26. I don't like all this this type
stuff. How do I turn it
off? Rust analyzer.
Stop doing
that. No, it keeps doing that. Okay. How
do I turn that
off? What is
that? No, I don't want any of that crap.
Thank god it's
gone. Yeah, it's
fine. No. No. Go
away. Oh,
fine. Keep on hoping we eat cake by the
ocean. Oh, it turned itself back
on assist.
Okay, I want this off. Let's find
settings. Is there
settings? Settings. You guys get to see
me be a noob. Is everyone excited about
that? Rust settings. Extensions. Rust
analyzer. Here we go.
Uh signature info typing. Uh no
no. Okay. I can change the settings.
Show syntax
tree settings. Inlay hints.
off. Great. Oh, I see. So, it is a
global setting. Thank you. Thank you,
chat. I figured you guys would know this
kind of stuff.
Great. All right, let's go back in here.
Darker
run. Uh, let's print these things out.
God, how do I print and rust?
print the output in the C loop. Thanks
LLM.
Oh, that's not what I meant at
all. That's not what I meant at
all. All right, we should learn some
Rust and how to print things.
positional
arguments. Got it.
Um, I format this a little bit
nicer. 56 is a lot. I don't know.
128. Okay. Getting an output from the
kernel.
This is kind of terrible. First of all,
I print this like
that. That of course that's
wrong. You can pad numbers with extra
zeros. Right. Justify with that. Okay,
that's
reasonable. Uh, now how do I print
without the new line?
Same as for the
[Music]
text.
Great. Let's just like some rest. Yo,
boys, we have vibe coding. Does anyone
like this vibe coding? Does that work?
No, probably not.
Um, if I mod
[Music]
0. Who likes my vibe coding? Yo, we vibe
coding. All right, great. We'll probably
go back to Jersey 6. Jersey probably a
nice number.
No, 128 is
fine.
Okay, now we are Why is there a percent
there? That's
terrible. Y'all can make fun. Who's You
all can make fun of my bad Rust
skills. Uh, it's not actually mutable
because we don't change that. where that
can go. Okay, let's talk a little bit
about what this is
doing.
Um, so get rid of that. We don't
actually use those
buffers. Um, don't actually use those
buffers.
Okay, so this is the source of the
kernel that it's running in Open CL.
Um this is a magical method called get
global
ID. Open seal is a little bit weird
about this because it doesn't exactly it
doesn't exactly
uh you can think about
GPUs really
as well. We're only going to use one
global ID here uh and one local ID
because that's all that there really
are. So you can think about GPUs as G
and uh G
cores with L
threads. So this is your in Open CL this
is called a group. Uh this is called a
local
uh in CUDA they have different names.
Let me just see this code in in tiny
grad. Forget what I forgot what they all
they all have like slightly different
names for this grab and it's like
uh shiny grad. No, no, don't. No. In a
new window, please.
So here's
tiny look in C style and see what they
each call
them. So you see in open CL they're
called so like the functions are like
get group
ID and
get get local
ID. We'll get into what these are in a
minute.
So this is Open
CL.
Um,
CUDA calls
them the block idx and the thread
idx. It's actually a much better
name. What does hip call them? Does hip
have a stupid name for him too?
Um, hip calls them group and
local. Same as
uh
cuda
hip. That's like the real hip. What does
metal call them? Metal calls them thread
group position in grid and thread
position in thread
group. Okay, but they're all basically
the same thing. And you can think about
it as six cores and L uh so G cores and
L threads. Okay, so um I don't really
know why this has a dim here. What
happens if I get rid of that? What is
what complains?
ProQ has not any dimensions specified.
Okay, let's specify some dimensions. So
here we should be able to say global
work
size. Actually, is it global work
size? There's three dimensions, but you
never have to worry about the three.
What? I specified the
dimensions. Oh, stupid
Rust. This is actually stupid OpenC. I
shouldn't blame Rust. It's not Rust's
fault.
Okay. So
the
yeah the stupidity of
uh Open CL is it specifies this thing
called dims and dims equals G *
L. Okay. So in this example, G is
128 and then L is specified down here as
1. So if we want to see what those
things actually are, we can go here and
we can get the group ID of zero. And
you'll see that right now we're running
on 12
uh8 cores and one thread each core.
So we can run 128 cores, one thread
each. Now if I change this local work
size to be two, how many cores and how
many threads are we going to run? I'm
going to run 64 cores with two threads
each. So let's see if we actually
confirm that we're setting the group ID
there to the output C. So what we expect
to see is 0 0 1 1 22.
But nope, that's not what we saw because
for some reason it didn't actually
listen to this local work
size. Ah, no, it's dumber than that. So,
you see what we did there? We didn't set
the um let's make this get global ID
zero for the actual output of the thing.
There you go. Right. So, that's a global
ID and that's a group ID. So now we're
set to the group
ID. So your global ID is your is your
uh you want to take your so so you can
think about it as like G and L. You can
think about it as G times numbum threads
plus
L how it's actually stored. Okay. So now
we can put it on four course. Let's put
it on four cores, four threads. So you
see that's thread. All right, we're
good. Uh now if I you see I can do get
local ID here and we're going to see 0 1
2 3 0 1 2 3 0 1 2 3 0 1 2 3. Okay,
great.
Cool. Is this making sense to
everybody? Is this is this good? Is this
good new lesson? If I unen if I enable
nonsubscriber chat, are you guys gonna
be terrible or are you guys gonna be
like, "Wow, he's actually educating us
and teaching us something because we're
going to we're going to really all these
lessons build on each other." So, I hope
you're paying
attention. You're like, "Oh, this is
simple. Oh, I understand this." Okay,
great. You understand this? That's
great.
Okay, here's a question.
What if I make dims really, really,
really
large? How does it
run? The GPU doesn't have this many uh
cores. If the GPU doesn't have this many
cores, how is it going to run? And the
answer
is, think about the G's. Each G is kind
of like a packet of work. And it's uh if
you're familiar with like Grand Central
Dispatch on Mac, it's like the same
basic idea. All the GPU cores are
sitting and waiting for
um a chunk of global data to become
available and then they'll run them on
the threads. So let's get some real
numbers here about how many uh cores
GPUs have. So how many cores does 4090
have? So Nvidia calls their cores
streaming multipprocessors.
Um
on Nvidia cores are
SM on AMD cores are uh compute
units streaming
multi-processors
compute units
My chat keeps breaking. I don't know why
this breaks all the
time. George looking like Steve Jobs
today. Okay, now I think I'm caught up.
Okay, course multiprocessors on AMD
cores or compute
units. Um, so let's get into some stuff.
How many streaming multipprocessors does
a 490
have? That's a 3000.
Uh, the actual name for the chip is 812.
There you go. Oh, that's pretty
nice. 8102 right
here. So, each of these
GPCs, one, two, three,
[Music]
four. Let's just check with a P.
So 8102
has 144 streaming
multipprocessors. 4090
uh and actually the 4090 might even
scale that down a little bit. I think
this is just the full chip. So AD102
4090 let's do it. nothing disabled. It
has 144 SM and it has this many CUDA
corores. So how remember a CUDA core is
like a th is like a thread. So
[Music]
there's 128
threads
with 128 threads each.
Well, I mean, this is education for
everybody. So, this is I thought there
was going to be 32, but maybe not. Okay.
So, then the
uh 700 XTX is called Mavi 31.
So, Navi 31
has 96 compute
[Music]
units,
CUS with how many threads
each? I think it's this.
Well, so the cool thing about this is
there's actually a PDF that shows you
what a compute unit actually
is. That's a workg groupoup processor.
Don't you love all these names?
So each workg groupoup processor has two
compute
units. Then each compute unit looks like
it has 64 threads.
No, maybe
not.
Actually, so dual compute unit 8 in
each. 8 * 6 is 48. So it does have 96
compute
units. That's a workg groupoup
processor. And each workg groupoup
processor
[Music]
has three sims. So it does seem like
they have 64 threads
each. All right. This doesn't seem right
because these chips do have similar
uh power but no maybe that's right.
Well, we'll we'll we'll get we'll we'll
dive in deep and we'll understand
this.
Um so yeah, each workg groupoup
processor is these these these sims are
are kind of like the the well each of
these sims is 32 threads and that
introduces the next concept on a GPU
which is called a warp. Okay, GPUs have
warps. Warps are groups of
threads. Um, and all modern GPUs have
[Music]
them as
310.
Okay. So,
um, are you guys familiar with what SIMD
is? Put my camera to the left, please.
Who knows what SIMD is? Who can tell
me? I don't know why this chat
breaks. Is that
live? The web saga gets disconnected or
something.
Um, okay. So, SIMD stands for single
instruction multiple
data.
Uh, I don't know why chat's broken.
Stream's working though,
right? Um, CID stands for single
instruction multiple data. So, maybe a
simpler way to think about 70 is just to
think in terms of vector registers.
So if you think about uh a register on a
GPU, let's say the register is 32
threads. Each thread can fit a single
float. So if you have a, you know, it's
just like it's like a vector of like
float
32. Um how many bits is that? Well,
that's going to be 32 * 4 bytes * 8. So
that's 1024 bits.
Um and then if I do something
like C= A + B
uh on vector registers,
this is a single add instruction on 32
pieces of
data. So the GPU programming model is
slightly different from this. So if you
ever use SIMD, this is how SIMD works.
You can use this called like AVX or Neon
or whatever you want to call it. GPUs
use single instruction multiple
thread. The math is pretty similar, but
on a GPU, you never see it do float 32.
Uh on a GPU, you'll just declare float.
So notice how I just declared float
here. So this or I can just declare int
here, right? I can say like int a equals
get global
ID. Um, and
then a is here. So you don't see it even
though this is running on on four
threads. And let's let's increase it to
the natural number of 32. So it's a
single
warp. So now it's running on a single
warp. So there's going to be four warps
there. Um, single instruction multiple
thread. So even though you don't uh you
don't see that this is a vector register
it just declares it as int vector
register. What makes sim a lot easier to
program for than sim is loads and
stores. Loads stores are
different. So the problem with sim is
let's say I want to get some data into
a. If a is a 32-bit thing and I do a
subi, what that's going to do is load
the contiguous uh
things. Um, load stores are
implicit scatter
gather because on a GPU I've declared it
like this. I can happily do something
like that and it will get
them. Whereas on SIMD it's
explicit. That's it. That's the
difference. Uh GPUs like to hide this
fact from you that what they really are
is one24bit wide uh SIMD machines. But
they really are 1024-bit wide SIMD
machines, but they have this special
thing called memory coalescing.
Um, so you'll see that
like GPUs can do all this stuff for you
fast even when accesses are not
aligned. They'll do all of that for
you. Okay, great.
Does everyone understand the difference
between SIMD and
SIMT? You
only
declare
float
behind the scenes.
It's float
32.
Okay, so you might think like why do I
care? And for a program like this, the
answer is you don't care. But let's see
if we can get in a little bit and make
the programs a little bit more
complicated uh to the point that you
might care. So, let's put a loop in here
and have to deal with timing shit and
rust. Um,
Oh, perfect.
Yes. Oh, that's pretty nice. How did
Russ know to format it like
that? That's very
fast. So, let's add a stupid loop in
here.
Um let's we have to make it not get
optimized
out. Compilers are very
clever. Uh also this is kind of wrong
here. We'll have we'll put it after the
read. Let's make sure nothing's getting
optimized out.
Okay, maybe it's not getting optimized
out. It's probably getting optimized
out. Let's think of something that's too
stupid to optimize.
[Music]
Uh okay, good. That didn't get
optimized. Doesn't know how to multiply
by two.
Okay, great. So, that takes 37
milliseconds
here. That's probably good. Okay, 163.
Okay, so what's going to happen if I
only run this on one
thread? Takes the same amount of time.
No idea why that is.
Oh, probably because globals isn't big
enough. I'm going to have to make
globals
bigger. CNC data.
stuff isn't used
anymore. Not used. Not
used. Let's make
dims. Find a number that matters. Uh
32768. Actually, that's still too
small. Oh, yeah. All right. That's
chilling. That's chilling. All right.
Two seconds.
Oh,
faster. All right. 220 seconds. Great.
Uh, so now if I only tell it to run on
one
thread. Yeah. Should be about 32 times
slower. So, is that
32?
It's 229* 32. Yeah. Okay. It's about 32
times slower. Okay. Okay. Now, if I run
it on two
[Music]
threads, twice as fast, right? This make
sense? So, remember that uh this is not
going to be your your global uh your
global threads. This gets divided by
this. So, like how many threads are we
are we are we putting it on? Go to four
threads
faster, eight
threads. Um, I also want to time this. I
also want to change my timing a little
bit. I don't want to include the read in
the timing. So, I should be able to do
something like
ProQ finish.
Yeah. And we'll do timing there.
This result may be an error
variant. Okay. Right. Uh so 8 16 we'll
watch it still get twice as fast. Should
be about 420 milliseconds.
uh
32. But something interesting should
happen at 64. At 64, I predict it will
no longer get any faster.
Yes. Does everyone understand
why they tell you this stuff about how
these things have multiple threads, but
I never think about it like that. uh we
we'll get to well I don't really
understand why that is but you can
really think about GPUs operating uh 32
wide oh I know why never mind I
understand why okay you can think about
all GPUs operating
basically GPUs are multi-core
processors with 32 threads
um so we're on a Mac let's actually
figure out what we can
what we can do. Uh it's there's a lot
less publicly known about uh this stuff,
but you see why putting it to 64 there
no longer made it any faster because
GPUs only have 32 threads. So what
you're doing if you're going to 64 is
you're going to run this chunk and then
you're going to run this chunk. It's
just what happens. So if I go to 16 and
then I think 128's not going to give us
any more speed either.
And then
eventually, let's keep going up here.
256. Let's go to one
512. Ah, 512 doesn't work. 256 is max
threats. Now, if you're like, "Oh,
they're running sequentially. Oh, why
does it even matter if it's uh actually
is 256 the max?"
27. Okay. No.
Good, good, good, good. We have we have
like some plausible numbers here to work
with. Okay, so let's see what we can
find out about Apple GPUs. M3 Max GPU.
So, it's a 40 core
[Music]
GPU, but these cores can do a lot
more.
Um, well, we can try to figure this out
by profiling if we don't have another
way to get it. Okay, here we go. So, the
M3 Max, I have the big M3 Max variant.
It has six
uh six execution units, I assume that
stands for. Yes, execution
units
units. And then it has this many
threads. Let's see what how many they're
saying is per eight. That doesn't make
sense.
It doesn't make that much sense, but
okay. I think we can figure this out if
we we can figure out when it stop we can
change the global size here and figure
out when it stops getting faster.
So, this says there's let's just try
that to start with. So, I set the local
size to 32. So, that's going to put it
on 320
cores. Um, I don't think execution units
are exactly cor. We'll figure this out.
Okay. So, that's 320 cores. How much
slower is it when I go to
600? Oh god, it's a little
slower. It tells me nothing.
We'll start with a
one. That's
fine. So, one takes 36 milliseconds. So,
36 milliseconds is my minimum. 36
milliseconds.
uh
this kernel
takes 36 milliseconds to execute. So
think about
it. You got
threads. Uh actually just go to one
here. Oh well that didn't work. There's
a working size. Yeah. Set that to one as
well.
There. So, this kernel takes 31
milliseconds to execute. That's just it.
Takes 31 milliseconds to run this stupid
loop. Uh, we can try to figure out why
that is in a minute,
but well, let's see if that's remotely
plausible. Okay, so it's
um
[Music]
1,00
so
26. Uh,
it's that like doesn't seem that
plausible. GPU is like slow. Only a
million. This thing should be running at
gigahertz. I understand why that's so
slow.
Oh, there's like a base. I see. Okay.
[Music]
Um, yeah, it's not that great.
[Music]
Uh there's like a there's like a base
thing that's just uh Oh, well, you know
what? Here's something we can do. Let's
not look at the first run of it.
run it a few
times. All right. A for loop in
Rust
[Music]
for warm up in like that.
Oh,
okay. It's just slow. It's
fine. Let's just
do we can get that 32.
Great. Okay. 14 milliseconds
there. There we go. Now, now we're
seeing Now we're seeing good scaling.
So, it's 14 milliseconds to run. The
first one's just slower, but now you see
when I add one more zero, it adds one
more zero to the thing. So, the kernel
takes 15 milliseconds to
execute.
Um, that's one E6. It's in
15ms. So that's let's find
something
26. So that's something
like 66
uh
million per second. What's the clock
speed of GPU?
boost up to
1,600 something like 24
instructions cycles
per seems somewhat plausible.
Cool. Okay. So, one of these runs in 15
milliseconds. If we do a
uh global size of
one. Oh, that's going to be really slow.
Okay, so 256 didn't get any slower,
which means that the GPU has 256 cores.
Remember, GPUs have cores and threats.
So, it's easier if you just like look at
one. Uh, I found this thing high
yield. This guy goes into the chip.
That's
cool. So, it's it's it's helpful like
everyone needs to really of the entire
chip, the compute parts, everyone needs
to really understand
what's going on here.
Uh before we can move
on. All right. So, this is the chip.
Each of these compute units is a core.
And then inside the compute unit, we can
zoom in and we get a thread. So in each
of these cores, each of these threads is
32. So each of these is like a a little
computer with 32 threads. See how
everything's
32? So each of these compute unit pairs
has like four cores inside of it. And
those are full cores. So that's 8 * 6 is
48 is 109 * 4 again is 192. So there's
192 cores each with 32
threads. So 256 is still fast. Let's
find when this starts to slow down and
we can figure out how many cores this
thing has.
Okay, so that's loaded
down. That takes twice as long. That
means it's taking like some cores have
to run, too. So, let's see if it's
really
640. 640 is a little
slow. 600's a little
slow. That's still
fast. 513.
513's
fine.
520. You know, I used to say hacking. I
was just binary searching by
hand
50. Ah, that got
slower. Should we like make plots and
shit? We should make
plots. What's that? Who's ready to make
plots? Oh, let's make plots. God. All
right. All right. You guys are really
You guys are really testing my rust
skills
here. Should we use rust to make the
plots?
I don't even know how to write a for
loop in
Rust for num cores
in remember this here is fixing it to be
only on one thread.
Guess where do I set the dims? Wow, I
set the dims all the way there. Can I
change the dims? I want to update the
dims. There we go.
[Music]
Data length exceeds buffer length.
[Music]
What?
What? Where does it tell the size of the
buffer? The default dimensions will be
used. Oh no. Not cool. Not cool,
bro. Why would What? That doesn't even
make sense.
buffer
builder doesn't even make any sense. Why
would you use
that? Well, I'm
go make me
uh
buffer.
Shit. All
right, here we
go. Okay, here we go. Buffer
builder. All right, let CB buffer equals
Did I have to import the freaking
buffer?
Buffer
builder
Q
flags
len build question
mark. Oh, wait. What is the question
mark
though? I think I just want to use that
question mark in some places. Why did
you ignore that? Okay, good. Great.
Thank
you. That'll make sense.
[Music]
Oh, I broke
it. Oh, I didn't break it. Oh, no. Oh, I
see. Just multiply zero by zero a lot of
times. All right. So, how do I like lie
to this and get it to like
not Okay.
There you go. Yeah, I used it. You see,
I used it. Yeah, it's legit. All right,
cool.
Um,
yeah.
32. No, but it didn't listen.
A bish don't
listen. Oh, I know what I can
do. Oh, I just didn't do better. The
dims don't really matter. There we go.
Okay, now it's only running at 32.
Great. All right.
for test
scores in
0.124. Did that work?
Cool. So, we're going to see a jump when
we get to the number of
course. All right, we're going to make a
graph. Can you make graph and rust? Is
that doable?
Uh, we can also how do I
like that? All
right. Step and rust
loop. Step in loop.
Step five.
[Music]
I want to make
graph graph range step
inclusive. Yeah, good. They got rid of
inclusive. That's good. That's good.
Rust is moving in the right direction.
All right. uh make graph in
rust. I don't know why the chat keeps
disconnecting
me. Yeah. You like my you like my new
lesson? Is everyone happy? I'm teaching
you something hopefully.
Have you guys never coded on a GPU
before? All
right. Bit map back
end using the pet graph recommended.
No, I want a chart. Use
plotters. Plotters. Is this
good? Let's try
plotters.
Plotters. Oh god, I need to make an
array. I'm going to do this guys. Rust
is impossible.
Can I put the question mark there? I
want to bang there. Can I bang? No.
Question
mark. Does that make you happy,
Rust? Rust is never
happy. Oh, good. We can remove that
meat. Don't
meat. All right, bitch. I want to
plot. Let me go back.
V. Yeah, V. That's a good name for a ve
dot. No, no, no. Don't put it in a
box. Oh, do I need to tell it what it's
a ve of? What's this a ve of? Man, I
wish I had like like the type hints
would show
up, you know?
Why does my chat not work
anymore?
Why?
What? I hate
this. Why Why is that doing that? I Why
can't I make a ve?
um make that vec,
but I can append to
it with a
tpples the plotters. Yes. Oh yes. I want
mutable vec I32
I32 except no I want
float
F32. Oh yeah yeah yeah yeah. Let me
points equals vec new. Yeah yeah yeah.
There we go. There we go. Yeah. Yeah.
Push those points. Yeah. Now we're
talking. Oh
man. I'm a Rust programmer.
All
right. It's like the LLM is a Rust
programmer. I'm just sure to criticize
it. Why a error? Why is it
Oh. Oh. Fine. Fine. You got a box. You
happy there's a box. I got I bought you
a
box. Oh.
No, no, don't do
that.
Becca, do I have to import
block? Hey, hey, yo, I'm getting errors.
Yo, yo, I'm getting errors. Yeah, please
please like just like don't like fix
them. Yeah, we're vibe coding, guys.
We're vibe coding, right? Yeah, you did
a bad job. So, you got to parse all that
crap. Oh, yeah. Okay. Well, the user's
main function returns result. Oh, maybe
it should return result, aqual error.
Oh, great. Yeah, but what? No, no, no.
You're using generic error. Yeah, yeah,
that's right. That's right. Yeah, yeah,
yeah. I got a box. All right, good. I
put it in a box. All right. Is that
good? Is everybody happy now? I put the
error in a box. All right. Is that good?
No. Oh, Russy explain. All right.
Here. Oh, no. Not
good.
No. No.
Why is it still trying to do a
error? Let's import that one
first. Yeah. Yeah, that work. No.
Yeah, that's
right. Great. They have an alias. I
don't know the
alias. I put the error in a
box. Who knows what I did?
Oh. Oh, result. Oh, I see. What a
scam. Oh, a huge scam.
Okay. Why do you keep using
result? No result. Just error.
results imported.
What? Oh
crap. Expected
duration found I32.
Well, we're not going to sit here and
wait for that every
time. So, a lapse, unfortunately, is a
duration.
I go like two
float. Uh what's a word as
millies? A millia here, a millia
there. That error is
backwards. U238. Okay. as I
32. Okay, just draw my
plot. Oh yeah, look at that piece of
shit plot. Yeah. Yeah, that's exactly
what I wanted. Yeah. Wow, you really
read my mind.
Rust actually kind of like
rust. No, why can't I put that in there?
Oh, no, no,
no. Don't get your those
things 14. But no, no, no, no. Come on.
I want like a float.
No. No. Come on. Come on. I want like a
float. No. Don't do that. Don't do me
like this. Come
on. All right.
Fine.
Fine. Fine. That's That's good. That's
good. That's
good. All right. You
happy? Everyone's
happy. All right. So, where my where my
plot
at? All right.
Well, what was the
plot? Oh, did I not like I got to like
tell her like I should do
something? Did I not copy and paste
something? Use the collected points.
What?
Save
it. There's no line
in the
pinch. I'll
do how I get line.
vibe
coding. I love
LLMs. Oh, is this the
problem? Oh, that's the problem.
Maybe. Why would it ever do that? Oh,
the range. Oh, okay. Thanks thingy. I
don't know. Let's go to like a 100,000
here. And we'll go to like I don't know.
One, two, four
here. Yeah. Base line plot. All right.
100,000 might be a little overkill.
Let's go to
50,000. And let's go to 1024
here. Yeah.
Oh, check out baseline plot
now. Yeah. All right. Does everyone
understand how many cores it has? I
don't really understand why it's doing
that, but we see a hard change over at
at 640, I think. So, there are 640
cores. And then theuler is just like
kind of
mediocre. All right. What's margin?
What's this?
the size of the four margins of the
chart. Why are there so many
lines? All right. But uh so it is 640
where it hard switches. No, it's not
640. Oh, yeah, it is. Okay, good. So, it
does have 640 course. Okay, good.
Everybody's happy. Just the schedule is
kind of shitty. So, it really does have
course. I don't know why it only has
that many
ALUS. Now I
expect Okay.
Can I do like
this? Of course, that's not going to
work. Syntax.
cannot use points in this scope. That's
actually a reasonable error.
Orange is not a
color. Yellow.
Yellow is a
color.
Yellow. No semicolon parenthesis. You be
happy now? Good. You be happy. Good.
Everybody's
happy. H.
Oh, whatever. We're going to start at
64. All right. So, now we're
just What? Why is that group size? That
don't make sense.
Oh, because it's not like a
multiple. That shouldn't really be
required,
but quick
fix. Yeah.
Sometimes you want
max. Yeah, look at that. Yeah, you know,
it's going to be mad. You imported min
and you didn't use it. Okay. I went to
all that effort to import min for you
and you didn't even use
it. Yeah. Okay. Baseline plot. All
right. Uh, well, that's what happens
when you put in threads. I don't know.
Let's go to two
there. Um, let's make that a little
faster. Well, 640. That's a divisible by
16, so that's good. Uh, let's go a
little bigger
here. Oh, no, no, no, no, no. We made a
mistake. We made a terrible
mistake. The charts, man. Impressive.
Yeah, right. Don't you love rust? Rust
kind of great. Is rust going to be like
my new
thing? H That's the ugliest yellow I've
ever seen.
Seion. Oh, no, no, no, no. Magenta.
Magenta. That's the perfect
color. I don't know.
Uh, let's try times locals
there. That's not really what I
want. Let's just step by
64. And let's go to something crazy
there. Okay. So if we have 640
threads
32. Oh, it's looking slow
already. Look at how slow it looks. Oh,
it's gruelingly slow.
Oh.
Oh. I'm not going to sit here and wait
while that happens.
What?
What? Come
on, be happy.
Okay.
Um All right. So, yeah. Yeah, this is
kind of notice
how notice how beyond
here it doesn't uh it doesn't matter
anymore because this is how many threads
the GPU really
has.
[Music]
So measured
We
measured 640
EUS and
with 32 threads each
We can add some more colors in
here
for I don't know. Actually, you know
what? Could we just make them all the
same color?
Does everyone have a good understanding
of what this is going to look like?
So you can
see
um should actually do times 2 times
locals with min
Well, now I need min. Oh, let me just
import
min. If it tells me that I could put the
comps
together. No, it didn't tell me that.
All
right. So, does this make sense? That's
with one thread. 2 4 8 16. But then 32
and 64 are the same because there really
only are 32 threads on the GPU. So, all
it can do is run this thing
twice. Doesn't make sense to you.
Yes. All right. You get it now. That's
good. That's
good.
Great. So, this is the minimum amount of
time that this kernel can take. That's
just this kernel. If you just run this
kernel single threaded on one thing,
then there's a question of how many
threads you want to run it on and how
many cores you want to run it on. So
it'll dispatch to all the cores. And
this means it has to run in series. So
this mean has to run serially. So it has
to run it twice. All right. Does
everyone understand baseline plot?
Because we're going to we're going to
get rid of baseline plot in a minute.
Let's uh let's actually commit this
stuff. Might be useful for somebody.
Um, no commits yet.
What was this? Some like
Rust. Rust automatically creates a git
shit for
me. I don't know how I feel about
that. I really don't know how I feel
about that. That's a little upsetting to
me.
Did it name it Maine? If it named it
Maine, I'm going to lose
it. Oh, good. It named it master. All
right, we're good. We're good.
Everything's fine in the
world. Those look like good
files. All
right, I'll let me create a thing for
you
quickly because we can also start to run
this on tiny
boxes if we
want. All
right. Noob lessons from stream about
how GPUs work. Let's add a remote and
let's push that
shit. Oh no. Come on.
[Music]
Yay. All right, you guys can go to the
repo now.
Okay. So, we made baseline plot.
Everybody understands it and we're
good. Uh, what else do we want to check?
I mean, I think this kind of explains
this kind of explains the GPU execution
model to everybody.
I don't know why it says that that's
only that that's the number of
AUS only
500 doesn't seem right.
app calls a GPU core seems to be the
same as what Nvidia calls an SM.
each core.
It's interesting. I don't really
understand
It's mad cuz it moved. It's
fine. All
right, let's let nonsubscribers talk for
a little bit. Let's talk about what we
don't understand about GPUs.
Okay, only serious
questions. Banhammer is going to go
hard. I think that like my chat's
broken.
You're asking me to ban you. Okay,
done. How they settle on 32? Uh I don't
know. Nvidia did 32 and everyone just
kind of copied
them. Is this Rust code vectorzed? So
this chunk here is what's running is
what's being dispatched to all the uh to
all the GPU execution units. So you can
see that the dispatch happens here and
then I wait for them all to finish here.
then like hopefully you understood what
I said about the course and the threads
and stuff. Time zone am I in? I live in
Hong
Kong. Uh yeah, G. Well, sort of. So, I
think we talked about that. It's not
really SIMD. So, it's SIM T. So, G the
the GPU that I'm working with here is
basically 640 cores with 32 threads
each. It's a little bit more complicated
than that,
but uh does AMD still have 32 and 64
thread modes? It actually does, and that
came up this morning. Um there I
said, so AMD has the best documentation
uh for like all this
stuff they'll talk about. So uh AMD
doesn't call them warps, they call them
waves. Okay, waves.
Um, so you can get 32 and 64, but all
the code I've seen only outputs 32, but
there's apparently something outputting
now. Good website to understand GPU
nomen glitch. Let's see what we
got. Am I still holding AMD stalk? Yeah,
I'm holding for a long time. Oh,
interesting. Who's modal?
Um, why is it
green program GPUs? Yeah. Okay, cool.
Oh, it's pretty good. Yeah, this is
good. Good. Good call.
Yeah. So I mean then we can get into
like latency hiding and how that stuff
works. If you think about a CPU will
context switch in order to hide latency
from like a network card uh or disk. A
GPU will context switch in order to hide
latency from
memory. Google's over. Google's dead.
Um, so I've been working a lot on the
DSP on the
uh on this DSP on the Qualcomm DSP. So
I've been I've been reading this manual
a lot.
Um, you get into like how the DSP works
and the DSP the DSP is a SIMD machine,
not a SIM T machine. So, all the memory
accesses are annoying. And then there's
like very specific patterns you have to
use it in to be fast, but you can see
the uh Qualcomm hardware channel. I've
been posting all the updates. We finally
been making it like fast. Uh and then
comma can switch back to the DSP for
um the driver monitoring model. But
yeah, like when you look at these like
look at that instruction, like look at
what that's doing. So it's doing it uh
for uh here we can see the vectorzed
version down a bit further
too. So like this is the vectorzed
version of that. So you can see it's
doing and this is this is not the whole
thing. So it's actually 128 bytes uh
which is 124 bits. It's the same,24
bits. It's the same it's the same width
as a as a GPU. Um, and then this is a
mullac, but it's also a fourwide
reduction. Uh, and it does this because
these are ints and it wants to
accumulate into a 32bit. So if you want
to keep the input and output registers
the same, you have to think of the data
flow in your
chip. Uh, so I think that can you
implement efficient flash attention in
the Qualcomm DSP? Yes, you
could. Isn't this under NDA? No, this is
publicly
available. Uh, you have two job offers.
One from the AMD Linux kernel team and
Google network engineer. Are you a good
programmer? If you're a bad programmer,
stop fucking up the the AMD Linux
kernel. But if you're a good programmer,
by all means, why would you go to
Google? Uh, AMD has a future. Google
does
not. AMD has a serious future. I know
the stock dipped a little bit, but
um we went up, we went down. I'm I'm in
AMD for for years, guys. I'm not I'm
not Lisa Zoo DM'd me on Twitter and sent
me half a million dollars worth of
hardware. This is a company with a
future. I don't know how the stock
market's going to reflect it. Fuck the
stock market. Who cares? I know that
this company is going to
deliver in like increasing quality AI
hardware. You're one of the good ones.
Great.
Um, so it doesn't even matter. You know,
I remember when I lost money on Meta,
which if I just held my meta, I would
have lost money. But like like it's like
this shit doesn't and I think that's
what we talked about at the beginning of
the stream. Um, this shit doesn't matter
about just deliver
value. Uh, everything's different right
now. Just AMD. Yeah, whatever. Whatever.
Market specific risk, corporate specific
risk, who cares? I think in 5 years AMD
will have a larger market share of GPU
compute than they do right
now. What GPU we're thinking for the
external enclosure? Probably like a
7600.
Um, the problem with the 7900, so it's
got to be an RDNA3 GPU. So all our USB
stuff only supports RDNA 3. I we can add
support for others, but so the problem
with the bigger chips is a power draw.
So it's going to be just hard to get
that amount of power in a car.
uh your cigarette lighter is only like
if you have the the old school uh
cigarette lighter thing that's only 10
amps. So realistically you can only
probably get like so 10 amps is 120
watts max but you could probably only
get 80% of that. So it's really probably
only going to be like 100 watts you can
get. So even a 7600 has a higher TDP
than what you can easily pull from a
car.
Um, I bought one of these in
China. That's about what I paid for.
Yeah, that's all
right.
Um, what number formats are going to
win? I don't know about that.
Uh, I think
that it's been a slow uh I think that
we're going to increasingly move to
FP8. I think training at things below
even FP8's annoying. Like BF-16 is what
you can get away with without being
annoying. Uh, but no, I I do think it's
going to be some kind of 8 bit number. I
think four bits too small. You can look
at the quantizations. So you can look at
the quantizations of valids. You can go
from 16 to 8 basically for free. Uh the
8 bit ones perform almost as well as the
16s, but I've never seen a 4-bit one
that performs as well as a
uh what's going
[Music]
on. Is there a fire? We got all the fire
trucks going by.
Uh, what about the modded 4090s? I mean,
they're modded 490s with more RAM, but
they don't increase the RAM bandwidth.
Everyone all these people on on on
Twitter who like Circle Jerk about like
the Oh, it has 128 gigabytes of RAM.
Yeah, but if you only have like a RAM
bandwidth of 400 gigabytes a second.
Well, you can only read all that RAM
like three and a half times per
second. Oh my god. None of those things
remotely compete with Nvidia with the
tiny
box. The little shits, the little $3,000
shits. They don't remotely
compete. It's not crime. It's the fire
department. Uh HVM. Yeah, I've seen that
guy on Twitter. I don't really
understand what it
is or virtual machine is a
massively he talks about it like it's
the best thing in the
world. I don't understand that. I have
no idea what the hell that says, right?
Like like compare that to the
tiny read
me. It's like
oh like okay create a
thing interesting and then like all
right we have like a very normal looking
example here like anyone who's ever read
torch can like immediately see that and
then like oh link to an example okay
let's see it oh wow that's actually
really short that's a coolness thing all
right so I like define my layer
sequential like
yeah Um, I don't really understand what
it is. It might be cool,
but like the question that I ask is
like, what can this do for
me? Paper. All right. So, we're going to
read a few papers. I think that's going
to be the second part of this stream.
Going to go downstairs, get a tea.
Yeah. Okay. So, these are their like
basic ops.
It's kind of like an even smaller than
like tiny has
ops.
Um they're called u ops. So here's the
offset for
tiny. Uh it's getting a little big now,
but like see like these are pretty
simple. Um, and this is a global offset
across all the different transformations
of the IR. Uh, so like ML lets you
define custom offsets and custom areas.
Uh, which like you can argue is better,
but I don't know. I try to keep it
simple. Like if you can just like have
them all, whatever. I have the same
philosophy and like with cereal in
um, so okay, they have they have less
27 races a binary
I don't understand this.
Bend is the human readable language.
Okay. I
see. And I've seen like like this. This
looks very Haskell, right? Like you can
you can do this kind of
stuff.
But yeah, I don't know. Like tiny grad
would just take that sum and turn it
automatically into the
number. This is some functional
programming BS. Like I kind of
agree they they
don't what I found with so many
functional programming things like with
with with Haskell and they they
they want to be
esoteric. They they want so badly to tie
it to math and just sit around and
circle jerk about math all day that they
have some legitimately awesome ideas,
right? Like pure functional is great.
The idea of lazy evaluation is great.
Like Tiny Grat takes all of these ideas.
They're great ideas. But then like, oh
well, you're going to use a funtor
combinator to curry over the monad.
Okay, what what the hell is that shit?
We're going to do a map over the shit
from that shit to that shit. Applying F.
Great. Love it. But that's never what
they do. They're currying a monad.
All right, we got
salmon and tea.
[Music]
HTTP is port 80.
[Music]
What? Okay.
Let's go back to subscriber only. Let's
read some
papers. So, this paper just came out
analyzing modern Nvidia GPU cores and
we're going to read it together.
There is no
uh papers that talk about how to
[Music]
do that have a modern understanding of
GPU micro
architecture. Describe the operation of
the issue stage.
So these are stages in the
pipeline. I don't know what those
are. Apparently this is good. A
simulator that's 14% inaccurate.
stream buffer. So the register file
cache a number of register file reports
effect. That's crazy to me that the
register file has a cache.
processing
blocks. This is some old
shit.
[Music]
Um, this is the old one that they used
in
2006. Our approach is based on writing a
bunch of small microbenchmarks that
consist of few instructions measure the
execution time. So Nvidia GPUs have CUDA
PTX but then PTX is not actually what
runs on the GPU. So one cool thing about
AMD is that RDNA is actually what
runs on the GPU. So RDNA instructions
are actually the machine
code. But in
Nvidia you have to go to SAS
Where is this cool?
There's another thing that's just way
better about
AMD. Oh, by the
way,
UUVN
got the AMD back end working on this
computer. 300 teraflops.
So, this is running on a uh
M300X and then we can do like beautiful
Minus multiGPU which is tiny grad simple
multiGPU implementation.
You see it's going on colon
one. There you
go. The sync is still slow because we're
using PM4 and not AQL.
So, let's get this
upstreamed. We're going to need to find
a better way to um So, the I went over
this a little in the other
stream, but the MI300X is actually
uh the best way to really think about
it, there's a picture I want. The best
way to really think about it is as
So hopefully everyone understands that
kind of stuff from what we've been
talking about today. They even add a
layer on top of that. So a single MI300X
is basically eight completely separate
GPUs. So that's a GPU, that's a GPU,
right? 1 2 3 4 5 6 7
eight. So when you have a computer with
eight of them, it's basically a computer
with 64 GPUs. These are unique GPUs that
each schedule their own like warps to
them and stuff. Um they have their
ownuler. They have their own firmware.
Everything about them
is very
uh the only thing they
share is this high bandwidth memory
link.
So the difference between six discrete
GPUs or eight discrete GPUs and this is
that the bandwidth
here the interconnect bandwidth exceeds
the memory bandwidth. If your
interconnect bandwidth exceeds your
memory bandwidth you can basically treat
it like one GPU.
That's
interesting. This looks so much more
complicated than AMD.
Okay. So firstly we describe which warps
are candidates for issue. So the warp
remember is a 32 wide
thing and then there's the
um the like that's a 32 wide like like
there's 32 threads and then that thread
group gets assigned to a
core consider account
instruction. We have valid instruction
in the instruction
buffer. So let's understand this a
little bit.
Assumes have four subcores and warps are
evenly distributed among subcores in a
roundroin manner.
Wait,
what? 65,000
registers. Oh, I see.
So
there's48 warp registers I
say. So AMD does this a little bit
differently. Um AMD has two types of
registers. They have VGPRS and
SGPRS.
Um yeah. So there's
uh I think 255 BGPRs or something.
Yeah, 2 256
VGPRs. Um, and then when you allocate
them, you can your your number of warp
uh the number of Oh, this is GPUs are so
complicated. Number of warps you can
have in
flight. So each warp has 64 private.
Okay, so these are basically the scaler
registers.
um predicate registers. So this has
predicate registers too. What does it
talk about them?
stuff. What is HS and GS?
I don't even know if it has explicit
predicate registers. Okay, so this has
explicit predicate registers. Uniform
predicate registers. Okay, so they're
uniform. AMD calls them scalar. Nvidia
calls them
uniform. Like previous works, the
inclusive presence of an operand
collector
There's a dedicated record of,024 bits.
Remember that's the width of the city.
The hardware structure responsible for
efficiently gathering and managing the
operands required by instructions before
they're executed by a process functional
unit. Okay, I see. So basically they're
saying instead of having something to do
this they just like they have all these
uh control bits which do it basically
statically in the
compiler. I'm going to read the matches
all the cases we've studied.
It's only used by instructions that have
operands in the register regular
file.
Wow. So, I mean, the reason that you
want to have a simulator is because you
want to be able to perfectly predict
your performance so that you can make
better choices.
warps per
SM.
What? Oh, that's warps per SM. Okay,
that's a that's a total
warp. I see. So that warp per SM
effectively is that thing that we were
looking
at this the Apple thing has 16 warps per
SM what I put a note there what happened
to that
note must have gotten deleted.
Uh, okay. But still 640 divided by
16. So it has 16 uh warps for SM in
Apple. Cool paper.
Here's the people who did this for an
RDNA uh GPL.
They did some weird stuff in GCM with
like
four like stuff being like four
wide. I don't know. I'm not going to
waste my time learning how GCN works.
But yeah, so this is this is the RDNA3.
We have the vector registers, scalar
registers,
scalar
alou 20 wave instruction buff.
Interesting. So this is a look ahead
buffer basically. It's like a reorder
buffer.
So what a reorder buffer is is when you
think about like the
uh so I think a fun project might be and
something that I might get interested
in.
Uh maybe next year might not be this
year. So this year is the year of speed.
We're working right now on ML Perf Bert.
Um, ML Perf Bert is we're doing
like I think now we're up to like 60%
better. Uh, so like like 40% of the time
is gone
uh from from what it was before. So it's
it's 60% of the time it used to be. Um,
so yeah, this year we're still focused
on a lot of highle stuff to get speed.
uh working we're working on adding local
memory support. Uh so there's there's
memory in each of these things. This
this
uh yeah this ve well it's ve memory but
it's it's called share memory. Um it's
local to each compute unit and you can
only access it from your locals.
Uh so
that's uh something that we're not
supporting in Tiny that we can make
things faster
with. But we're almost done wrapping up
a contract of getting Tiny to be fast on
the Qualcomm
DSP. The Qualcomm DSP is the simplest
chip. These things are so complicated
compared to the Qualcomm DSP. Like the
Qualcomm DSP has a instruction packet
where you can pack four instructions in.
I don't think it has anything like this.
Um I think you have to do this like
explicitly at compile time. Uh the
Google TPU is also very simple. So I
don't know if you read my I don't know
if you guys read my blog post where I
talk about the tragic case of Intel AI.
Uh but there's like programmability is
on a spectrum and what I mean by
programmability is like it's simple to
code for to get performance. So CPUs are
really easy to code for to get
performance. Um like you barely even
have to think about it. Uh you're not
going to get that like you're going to
like it's really easy to I shouldn't say
get performance. I should say saturate
the max performance of the device. So
it's really easy to get the max
performance out of the CPU.
Um, GPUs you can kind of get the max
performance out of. Qualcomm DSP and
Google TPU require really fancy
compilers, memory layouts, all of this
stuff. Um, to then like gaudy and the
Apple A&E are like they're not even the
hardest to get performance out of. But
if you have a program that's like, oh, I
have like a 4x4 convolution with stride
3. Oh, sorry. This thing doesn't support
that. Like it's just a fixed function
unit. So, it's really easy to get
performance for like a gem, but the
minute you step it all off the beaten
path, um, you can't, uh, you can't get
any
performance, but I think a fun project
might be to write a simulator for the
Qualcomm
DSP and truly understand everything this
chip is doing. Um, so these GPU
simulators don't look like they're ever
perfect, but for this one, it might be
possible to write a perfect simulator
for it. Uh, I think it would be a lot of
fun.
And then once we have a perfect
simulator, we can figure out how like if
I could take that simulator logic and
then put it in a constraint solver like
Z3. That's what I'm really interested in
doing. Again, there's chats and they
don't show up. I don't get
it.
Um, but yeah, no, if you could put all
this stuff into a into a constraint
solver and then say find the fastest
program to to actually compute
this, the Aikita simulation
engine, this stuff open source. And
then did these people open source their
stuff for
this? No.
Sub
projects MGPU
sync. No, it's GCN3.
What level does the Nvidia simulation
run
at? We'll separate AMD and Nvidia
folder. Second try.
Okay. Not ready for use. GCN3. So, they
never upstreamed this. It does look like
it's still being actively developed,
which is
cool. But we reuse a few components.
Most of the Navi sim simulator. Is this
open source? I tried looking for it
briefly and couldn't find it.
[Music]
Oh, she also read
this a 2022
paper. Maybe they talk about why they
open source it or don't open source it.
Oh, Navisim is open source under the
terms of the MIT license. Oh, it is open
source. Where is
it? Link hidden for double blind review.
Who could find it?
Actually cool to try to get this to run.
[Music]
No probably
[Music]
available GPGPU sim is
old. Maybe I can find them. Maybe they
filed issues or something.
Is this what I'm looking for?
Maybe. Oh, it's on GitLab. I
see. Cool. Good work. I think that's it.
Is that even
work? All right. Last update three years
ago. Good find. Thank you.
Wonder how fast it
is. Who thinks it builds?
That's a quality
file. New
GPU package Navi
Sim. Who's
Aikita? Are these people Aikita?
Do you even
read? Second guy sent a
link. Thank you for subscribing, but
please read what you just sent.
So
weird. It's not even he Oh, inactive
maybe. Wow. It's really deeply hidden in
there. Well, Aikita's the simulator, but
I didn't realize the simulator people
were doing this. I didn't realize it was
the same group.
All right. So, like what can I like do
like what if I do like go
test? Does that work? All right. Go find
internet. Sure. We'll install the Go
team at Google. Do I trust them? What
are you trying to sell me an ad
for?
Um, all right. Well, it doesn't have
tests. Okay. So you go to all this
effort to write this
simulator and then that's your read
me. Is there another
repo? Is there another repo I'm supposed
to be looking at?
This is their old
one. You trust them? Well,
what? All right. Compile the simulator
with the benchmark with go
build didn't do shit. Oh,
samples. FIR go
build
FIR.
Um, all right.
timing report
all. Oh, a CSV file.
Okay.
Zero trace
mount. Verify.
Oh, it passed. Why are the files
zero unified
GPUs
timing check the generated metrics CSV?
today.
Hello.
Hello. Hi. Oh, I'm streaming.
How was lunch?
Oh, I don't have the camera. Wait.
That's good. That's good.
Oh, I know you like the peeking duck. I
ate the two day leftover salmon.
It tasted good. What are you guys
talking about? Uh, we found an AMD GPU
simulator and we're trying to make it
work.
Oh, they have some tests. I don't know
what's going on though. Yeah. Well, I
don't understand why this isn't
working. Okay. Create a
new. How come report all didn't report
shit? Oh, let's try a different sample.
What else is a good
sample? Reu. I trust
relu. Go
build.
Reu timing report.
All no metrics.
What's a Hasco? I've seen that
before. Let's figure out why report all
doesn't report shit.
timing being enabled or do I need two
dashes? What if I need two
dashes?
No. Trace viz
trace
[Music]
m
Oh trace username is not
set a username
Bob
oh
well it
didn't I tried to dial it's not working
I tried to dial
that oh it's going to my sequel. Oh,
well, we don't have my sequel. Sorry, I
should have known that port number.
That's a famous port number. Guys, do
you want some light? Are you happy in
the darkness? Um, we're mostly happy in
the darkness. Okay. Do do you want to do
you want to do you want to say anything
else to them? No, I'm good. I'll see you
later. I'll see you later. Byebye. Bye.
Bye.
All right.
I'm not feeling that tea. We're going to
get a coffee and a pineapple bun. What
do y'all
think? Um, well, so first off, it looks
like we're on the wrong
platform. How do I change a
platform?
Navim
platform. Oh, maybe R9 Nano is
right. What's R9 Nano?
What's a R9 Nano
GPU? Is that like an old GPU? Is that
like a GCN3
shit?
Oh yeah, this is GCN3
shit. Where's the RDNA? Oh, don't tell
me it's like on a branch or something.
Uh, let's just look here quickly for
branches. Create an AMD RX.
Okay.
Done. GPU builder.
MU. So it might just be what's called MU
[Music]
here. Debug
is built an emulation
platform. Try debug ISA
to Oh, here we go. Look at all these
empty files. Oh, but these are
things. ISA
GPU1. Oh, look at
that. That looks like RDNA3, but to be
fair, I didn't know what the previous
one looked like, so I don't know. Looks
like
RDNA3. Wow. Wait, so this thing kind of
works. I wonder if we could wire it up
to
Tiny. Um,
so Quaselin wrote this thing called
Remu. Uh, that's an RDNA3 emulator. Um,
it's very
readable.
Uh, I think it's in thread. RS. Yeah.
So you can see how it like parses the
instructions and
stuff.
Um, it's a little uh, you know, I wish
it used some uh things that expanded the
cons, but it's so short, too. A lot of
that is tests. Like when you get to the
real base of the code, it's only
uh 2,000 lines. Um, it's all pretty
straightforwardly translated from the
manual. Yeah, these should have been
constants
uh like from the manual, but other than
that, like you can pretty easily. So
this is like a VOP instruction. So if we
want to find VOP, we can go to like
RDNA3
PDF and it's not actually here. So it's
like
these
VOP3P instructions. So if like
instruction shift 24 is two ones, two
zeros, two ones, two zeros, right? Like
it's very like it's super literal. Here
we go. Look, we're pulling out the
Ardest.
um which is
here written in Rust which I'm now
improving
at. Um but this is cool. This is cool
that this actually
runs. So debug ISA works but the other
things don't work. Let's figure out why
that is.
Use unified
memory change.
Okay. The number of samples to filter.
We just need to go larger.
Something's got to be wrong. That should
be outputting to the matrix. All right.
So, I know Go. We can We can code in Go,
right? Who can code in Go? We can code
in
Go.
Benchmark GPU driver
New runner. Okay, here's where we get
the
runner. Start profiling server.
I guess that's just cuz it's like multi-
threaded parallel
[Music]
engine. Okay, good. We have the code
now. Present Navis. It's open source. We
found it. It's executiondriven
simulator. I don't really know what that
means. recreates the execution
instruction set the help of the
instruction emulator for
NASA show the instruction emulator being
used
fine when's it
oh I
see when's either emulation mode
instruction emulation mode can recreate
execution results
Oh wow. We should actually get this
running
simulation.
Yeah. Who knew that this was just
available?
I mean, it was good for Quaslin to write
this anyway, you know, to learn about
how GPUs
work. Okay. Uh, so I kind of feel like
just timing isn't
working. Like that timing flag isn't
working. Run detailed timing
simulation. Report all
like that. That's what would make sense
if like the timing thing wasn't
working. By the way, let's see if we can
find the actual program
here. So, where is like Oh, nav sim
benchmarks DNN
Railu. Okay.
This is the actual
code. Elf
run
it. This is open Seattle code. You can
see it's a re down there. So you get
global ID. It's the same thing we were
doing before.
timing
flag. Okay, if I do timing and report
all, this should just work. I don't know
why it
doesn't. Okay, timing is clearly
enabled.
I don't really understand the profiling
service collector didn't collect or
something.
Is there some way to like add like
logging? The only thing that did work
[Music]
was debug ISA.
output can
generate lots of shit.
All right. If we don't have timing, we
build an MU platform. Oh, maybe we don't
want timing.
Okay, we can't report all if we don't
put the timing
flag
trace that's outputting metrics.
trace username is not
set. Oh, maybe it needs my
SQL. Oh, no. Maybe it only needs my SQL
for trace viz, which is only enabled
when I put timing. But why does this
output
nothing? Collect trace.
Could it just be something where it's
just not like closing the
file? No, not that simple.
That's what I'm
doing. Okay, it should be writing
metrics. I don't really
understand. Wait, what?
Something else is probably opening
it. This is a common. No, it's
fine. Why?
It clearly writes to the
file. Wait,
what? Why does it close the file
there? What the hell is this
code? How am I am I reading this right?
It's not deferred or
anything. Wait, that's odd. After
closing the file, it tries to write with
it. But once the file is closed, writing
to it should cause an error.
What? I don't get it. You wrote a whole
GPU simulator, but sometime you close
the file before you write to
it. Okay, cool. Yeah, that looks good.
like defer. That's the normal way to do
that.
Go. Okay. Wait. So, where's the memory
trace? written. Do they write the same
bug? That looks like a different bug.
Great. They were vibe coding. Yeah,
vibes are off. Don't worry. It knew how
to fix
it. What? They also messed up
that. Yeah. is
what? Okay, that colonel seems really
fast. Let's make it
slow. 1 million
relues. Oh yeah, dispatch those kernels.
You know what would make it faster?
Parallel. That didn't make it
faster. Okay, a million is too many. I'm
not that
patient. 100,000
values. This is terrible.
We go. Yeah. No, we This is their
simulator. They spent all this time to
write a simulator. They They must be
accessing the metrics in a different way
because how is the metrics writing
function broken?
What do we think of this? Rainbow CSV
from Mecca
Truner. Sure. 12 million people
installed it. I probably trust it. Oh,
that's nice. Look at that. Thanks,
Mecca. Meatroner.
Maybe Re is a boring simulation. Let's
try a different
simulation.
Fire. Oh, well, we can't do
Reu. Fire
timing report
all metrics.
Oh, read hit
239. Read miss
nine. L2 misses
sometime.
Cool. All right. This is very sensible.
You can get a lot of this data out of
the GPU, too.
MGP GPU SIM works out of the box. I
believe that. But MGPU SIM doesn't
support.
Uh what are you gonna How long are you
going to go on about Rust? This is
written in Go. Okay. You just got to,
you know, deal with it.
All
right. Do we have anything else in here
we want to check?
Someone did this very carefully.
I see this is cool. Should we try to get
that working? Might be kind of cool.
Okay, that's like pretty
understandable. Uh
Come in.
Thank you. Well, I can't read properties
undefined, so we try.
Wow, it's on a plate.
Thank you.
Maybe we want some lights in here.
All the lattes in this place are so
good.
Oh, you guys will never know the joy.
Some of you might know the
joy. Where's your AI girlfriend? That's
my AI
girlfriend. All right. while we eat.
Let's read this
paper. It almost looks like it's like
entropics. Like I was talking about
this.
Okay. I mean like this is
exactly when I talked about entropics.
This is exactly what I meant.
How do you talk about information under
computational constraints? Now, let's
see how good this paper actually is. But
I'm super like excited about this
direction of
science. Extracting actionable
information from noise and possibly in
high dimension data sources is a key
computational statistical challenge at
the core of AI and machine learning.
Yes. Information
theory provides a conceptual framework
charact.
Yeah. Oh my god. These people literally
defined entropics much better than I
could. They actually like did it. Yeah.
Yes. Consequence new formulation is
pretty usable information.
That's a data processing inequality.
Oh
no. This generalizes the idea. Wow. I
mean, this is the sickest abstract of a
paper I've ever read. if they actually
followed
through. But I don't even know like how
you start
All
right. Boring
[Music]
math. Blah blah blah blah blah. Okay.
Boring. Boring. Boring.
What?
The problem with papers like this is
like I have no idea if this is real or
not.
I'd be curious what else these people
do.
Well, okay.
I mean it's this paper defines the like
the space. Yeah. Okay. So it's it's it's
Does it talk anything about what the
functions are?
So, I spent a lot of time trying to do
math for the Hutter Prize and thinking
about stuff like, well, okay, I mean,
what I really want to know is what's the
probability of the character at position
P given the character is at position 1
through p minus
one. And I spend so much time like
thinking about that problem and like
looking for a solution in
math. Uh like I'm like okay could I
could I was like how do I use like baze
rule? Like how do I do a perfect basian
representation of all of this like all
the like less wrong circle jerk stuff?
And like the answer was
transformers. Um, well, the current
answer is Transformers. Will be a better
answer in the future, but like
Transformers, I
understand. Like, I can I can tell you
what a Transformer is. I don't know how
it works. Whatever, man. That's not that
important. I can tell you how to use it.
Which for so much of this stuff, it's
like great, you can define all this
stuff, but like how do I use it to
answer questions? Okay, great. You want
to talk about usable information under
computational constraints? Cool. How
many how many hours is it going to take
on this GPU before it can um get a 50 on
MMLU or
something? Yeah. Know I mean like I I
see I think I see what they're saying
here. They're just talking about some
function.
My predictive family is a set of
predictive models the agent is allowed
to use. So it's yeah it's it's basically
given the model how much information can
how much how much mutual information can
you
extract? Why do people write math papers
and so confusing bullshit?
Damn, this is so much better than the
paper.
I mean, this is a very good this is a
very good
analogy. This is something that's always
bothered me about information theory.
[Music]
Yeah. See, but now you lost
me. There's no way you can tell me if if
I give you a a a plain text and a cipher
text in AES, there's no way I could tell
you you could tell the difference
between a cipher text and random things.
That's a property of AES.
questionable.
[Music]
question is
computable using only the prior no come
on the model uses y the car to be lost
model that doesn't use x okay Okay.
By the way, I love that this is this is
open source. I think I don't know what
the 1776 edition is, but this basically
just deepseek
Interesting. Well, this is actually a
really interesting approach.
And that's cool that interesting
slightly
better you do slightly better on math if
you're uncensored.
Now, what I'd really be interested in is
the
uh what I'd really be interested
in is the
uh
the does someone have this but the
Chinese version that goes into llama and
removes all like the American
Shit. We identified people. Yeah. Known
to be censored by the CCP. Right. So,
I'd love to see the Chinese one where
they employed human experts to identify
approximately 300 topics known to be uh
censored by the US
government. Interesting.
Wait, what? But then they made it bigger
because that's 1.4 terabytes. So they
must have went to float. They didn't
keep it in FP. They didn't keep it in
FP8.
No. America would never spread false
information. There's false information.
Number one.
Um, no, I mean that's the and that's and
that's the difference between China and
America, right? Like everyone knows that
that there's certain things that are
censored by the Chinese Communist Party
and everybody's aware of this, you know,
it is what it is. In America, there are
certain things that are censored by the
US government, but you're not really
aware of what those things are.
Um, you know, the US goes about it in a
in a very different
way. It's a censorship with American
characteristics. It's still GTO to align
with the
[Music]
West. Yeah. Yeah. You definitely I
definitely see a good thing. Good thing
China put tariffs on F-150s so all the
people in China aren't buying
Americanmade car. Oh, wait. No.
Um, see, you know, it's it's so more
like there are things that China puts
tariffs on obviously like Instagram.
There's a there's a infinity% tariff on
Instagram in China. Well, it's not
actually infinity, right? Because you
need a VPN, you can get around it. So
there there's some that's basically a
tariff on Instagram. But the difference
is you want to put tariffs on things
that have network effects and you don't
want to put tariffs on things that
don't. One more joke and you will get
tax on GitHub
bounties. Who's taxing me? setting up a
Hong Kong
corporation. We'll see if they want me
here. Got to write a
resume. Where were we? We got
distracted. But this paper, this this
model's good.
It's hard to use. Like I find Grock uh
for coding often will just make things
up. Grock seems to be the worst about
hallucinating. It's the worst about
hallucinating, but it's the best at
being
current. Chad GBT is very middle ground.
Chat is good if you like I think it's
the most reliable
um of the
three. And then Deep Seek is the best at
uh things that really require you to
think. I haven't used
Gemini. I don't even know how to use it.
Like fuck
Google. Did they ever open source Gro 2?
See, we say they're going to open source
things. Elon like open sources nothing.
It's kind of sad.
Oh my
god. Okay. I mean, there's
like the only country in Europe to
support grow. Can you actually not use
like AI in
Europe? You know, Claude
sucks. I don't know what's up with the
Claude
stands. I've never found it better than
the other. I I found it just a
generation
behind. The thing about Deep Seek is
I'll actually think for a long time.
I feel like 01 preview would think like
that, but then they nerfed the
thinking and deep thought just takes too
long. All right, we've moved on. We've
moved on to shit talking time.
Um, okay, cool. Yeah, that's pretty
straightforward. Uh, yeah, I like
Mercury. They're They're better than
Brex. Brex was such a clown shell.
Brex like didn't approve my account. Uh
we want to make sure that you're you're
validated through existing startup
partners. Um you know I told him okay
well then no uh you know you don't get
my business. And then they did something
that I thought was really not cool. I
told them stop this. They sent me an
email a week later saying your Brex
account is ready. which I really think
somebody looked it
over and uh saw what happened, looked up
who I was, and then pushed my thing
through anyway that like, oh, I have the
Brex account now. I'm going to use it. I
was like, absolutely not. Uh, so yeah, I
mean, comma is still through Brex. No, I
think we might have moved Kama to
Mercury,
too. Uh, I'm not that involved with with
operations of Coma anymore, but yeah.
Yeah. No, I would definitely recommend
Mercury. Um, Brex also like they seem to
go this route of like hiring the NBA
types because they start to talk like
NBA types. Uh, and whenever, you know,
this is just it's just death for your
your
thing.
Um, all right. We read this
paper. We read this paper. We read this
paper. We did some noob introduction to
GPUs. Let's see if people have anything
else. We did some ranting about the US
and China. We laughed at the Europeans.
Always good. Always good. No, no, no,
no. You see, AI is illegal in Europe.
You see, AI might
upset someone's job. And it's very
important that nothing upsets people's
job. It's very important that there's no
disruption here. We've had these ways of
life for so
long. I don't know how Hong Kong social
life
is. What do you do? So, I told you what
I did last night. I haven't played Magic
the
Gathering.
Um, I don't know like what what what's
social life anywhere? Uh, go to parties
sometime where we like play board games
and drink beer.
Um, going out clubbing? Fuck no. Uh, I
did go to I did go to I did go to a
rave. Uh, I did go to like a like like a
underground speak easyy type rave. That
was pretty cool. I like things like
that. The last thing I ever want to do
was like, oh, let's go out in Lancong
and listen to loud house music. like,
"Oh, host host host host host house."
Oh. Uh, no. I was like a techno, right?
That was cool.
Um, yeah. Yeah, exactly. Exactly. It
just violates one of our 9 million
rules. You can totally use
AI.
Uh, into ma jang. I should learn how to
play ma jang. That's right. Get hustled
by some by some Asian grandmas. Uh
Sunday Sunday is a big social day here.
Like people go out and like bring
blankets to parks and stuff. Uh I like
to go for
walks. Short meta. I don't know.
Whatever. It's all It's all fugazi,
man. Uh where where' that where' that
thing go?
You know that thing we had up before.
You remember it?
Whatever. Um, how long have I been here?
Well, less than 90 days
consecutive. Um, long palent here. Oh
god. How do I manage to get a girlfriend
despite being so low in the male
dominance hierarchy? Bro, I'm about to
demonstrate something to you. You see
this? You are now banned from my
channel. Oh, sorry. No, I just blocked
you. Oh, no. Ban. Yes, that's what I'm
Yes. Yes. So, now who's lower in the
male dominance hierarchy? You or
me? All right.
[Laughter]
evil magician. Oh, I wish this was more
coffee. Oh, this coffee is so
good. Uh, what else do we want to talk
about? What else we got? We went over a
lot of stuff. studio areas on GB 2022
amount to these inputs the yield calcul
of the chip area. Let's find some like
beautiful like GPU die annotated
pictures. This is a 3000. This is like a
380. Whoa. Really? Which die is that
though? That's a GA. They laid them out
like that. So, all the new ones seem to
lay out
like I don't know which one that
is. It's
812 GA2.
Just that that's G 100. Okay. DSM's
there. It's interesting. It's
interesting that it's all laid out like
that. If the uncensored deepseek is
1776, what would the uncensored
GPT4 have as its
suffix?
[Music]
Um, let's have more Europe. They need
more demoralization than the US. I think
they kind of don't like the thing is
Europeans US people like do not realize
yet that their empire is over. Europeans
have accepted that their empire is over.
They're a lot further along the
demoralization
curve.
Um yeah, I don't know. Like I think
about it a lot. I think about it a lot
like how you actually
do.
Uh, by the way, I don't think this is
necessarily long-term for America. I
could easily see a world in 30 years
where America has surpassed China again.
But in the next 5 years, no way in hell.
In the next 10 years, probably
not. Which empire is just
starting? Yeah. Hey, you want you're
trying to get in on the ground floor?
You trying to get in earlier? You trying
to get in
early? They're desperately trying to
expand into
Ukraine. Yeah.
Okay. Oh, you want to bet 1k that the US
is on top in 10 years? On top in what?
You think you think in 10 years the US
is going to be producing more
electricity than
China? You think in 10
years somehow the US is going to be
higher than China on that?
You you you you you'll bet you'll bet
$1,000 that somehow the US is going to
be producing more electricity than China
in 10
years. You want to do it for
steel? You you want to you want to you
want to you want to bet that that in 10
years the US is going to be producing
more steel than
China? Yeah. Yeah. You think you think
you think the 10 years? So like that's
what happened in the last 10 years. You
think in the next 10 years somehow
that's going to get bigger than
that. Oh. Oh, you're going to bet we
have more compute than China. Okay. So
you think the US is going to have more
compute than China? You think China Do
you know the the basic input to compute,
right? It's electricity.
So it looks like if current trends
continue, China's on track to have 4x
the electricity of the United States. Um
so so you know you know where all the
chips are made, right? You you do know
you do know that they're made in the
Republic of China,
right? The Republic of China. I I don't
know if you guys have ever like looked
at a map, but like you know here's
here's China and and here's
Taiwan, right? Some some some just
because some like you know loony people
in the US oh which is by the way all the
way over here think that somehow you
know the chips from here are going to
keep going
here. I kind of think the chips from
here are going to start going here. kind
of makes interesting interesting how
close it is. Look look look they could
like practically throw a chip. You could
you could you could stand here right
where TSMC is in in Hinshu and you could
like throw a chip to Kango. Here you go.
Here you go. Here you want an H100. Here
you go. You want a B200? Here's a B200.
Here you go. Oh, no. No. No. No. They're
going to continue to come on boats all
the way over here. Yes. Definitely.
[Laughter]
Yes. Come on, guys.
All right. So, so who's still betting?
Who's still betting that somehow in 10
years the US is going to be unlike any
metric ahead of
China? Oh, you can do stuff with more
efficient processes. So, for some
reason, the US is going to get these
more efficient processes and the Chinese
are
not. Wait, you'd still think we'd be on
top? This is it. This is it. You guys
think you're on top on some like oh on
freedom metric? The fuck is freedom
metric? You'll be willing to shake
cybergenic. In what metric will the US
be on top in 10 years? The US will be
ahead of DEI. All right, good. I'll give
you
that. Yeah. I mean, there's going to be
fabs all over the world, right? I'm just
I'm just like like you guys are aware
that Taiwan is a part of China, right?
And I'm not just saying that because I'm
here, right? Like you can look at the
history. You think the best AGI labs are
going to be in the United
States? Um I mean there's Okay. Okay.
Okay. There's more of
a there's more of a possibility of that.
Um, well, the US is going to take over
Greenland. That's true. That's true.
We're going to get all the fabs in
Greenland, right? All the all the chip
manufacturing capacity in in in
Nuck. Oh, the US dollar is backed by
military. Oh, interesting. Okay, here.
Let's see. China Navy versus US Navy.
All right, let's see.
[Music]
Um
production.
Okay.
Oh. All right. Total uh battle for
ships. Notice how it looks like
everything
else. Holy shit, they look identical.
It's almost like all these things are
correlated. It's almost like all these
things are correlated and this idea
about America somehow having the best
military is utter and complete cope.
Also, here's an interesting asymmetry of
uh you know, America's military and uh
and China's military, right? If you're
talking about something like
Taiwan, I mean, the US would have to
project
power across the biggest ocean in the
world, whereas China, oh yeah, oh, I
could I could literally sail this in a
day. Give me a sailbo. If the winds are
good, I'll sail right there.
All
right. So, hello. Oh, no, no, no, no,
no. The US has the US has
what? What? Drone
production? You're going to try to tell
me the US can somehow produce more
drone? I want you to imagine an
Americanmade drone. I want you to
imagine the union worker putting the
propeller on the drone. And then I want
you to think of every modern Chinese
factory video you've ever seen.
Okay, you have better tech. The US has
better tech. By tech, do you mean
intellectual
property? Come
on. Why are so many Chinese wanting to
come to America? Some Chinese people
want to come to America and some
Americans want to come to China. It's
actually easier to to be a American to
be Chinese and come to America than it
is to be American and come to China. But
is that even like how long is that going
to be true for? When does that switch?
When is it easier for an American to go
to China than it is for a uh a Chinese
person to come to America? I think for
tourism it's
already for tourism it's easier for an
American to go to China. I It's
interesting.
Um, yeah. US only has best LM.
Everything else China's winning. I've
heard they have like sick videog models
in China that are better than the
US's. You have no idea what the US
military has. I heard a good I heard a
good saying about this once and it's
kind of like, do you think which do you
think is better run, the DMV or the
CIA? And the thing about the DMV is
everybody can see how the DMV is run.
Everybody can experience the
DMV.
Uh, so at least there's some check on
it. Why do you think the CIA or or
whoever you think's running the military
is some bastion of
competence whereas the DMV looks the way
it
does? Yeah.
I mean, why? What? What makes you think?
What? You know
what? All right. So, um that's the uh
that's the US uh champion math team.
Interesting. Interesting. It's
interesting. It's interesting what I
noticed about all of
them. Okay. So, so, so what is it? What
is it that you think that that uh
uh what is it that Well, here I mean we
can also look at the you know the
Chinese champion math team and for some
reason uh yeah interesting. I know
that's that's that's the US one. Sorry I
got them confused.
Um, no. Uh, that's not I'm not trying to
make like a racist point or anything.
What I'm just saying is if if you
believe somehow that America will have
the best uh genite tech in 10 years or
the best LLMs in 10 years, I ask you
why. Is it human
capital? Is it is it resource capital?
Is it intellectual property? Like what
is it?
For everyone who says freedom, I'm very
curious what you mean. I've experienced
much more freedom here than I have in
America. Because you know why? Here I
feel that I can walk
anywhere, certainly anywhere on this
island at any hour of the day.
and nobody's going to nobody's going to
harass me. Nobody's going to try to mug
me. Nobody's going to nobody's going to
touch me. Like, you're just not going to
have that, right? That's the thing that
I want freedom from. Most of the
infringement on my freedom in America
isn't coming from the government. We can
talk about the tax rate and whether
that's an infringement of freedom. That
certainly infringes on my freedom, but
again, there's a there's a
whole criminal like the amount of times
I've had to call the police in America
is insane.
That is
freedom. When you speak of freedom, you
speak of political speech. Why do you
want
that? How is your political speech
worked out for
you? Uh why is there no Starship in
China? We can look the US and China are
here. So we can look at uh space
launches 2024.
Um
here so here are the the orbital launch
attempts. So you see it's dominated by
SpaceX. Um Elon in a way gives China a
run for its money. If if you let Elon
operate
uh but a lot of these are Chinese uh
startups colored
Right. Uh, yes. So, there you
go. Mhm. That's a pretty nice one,
actually. America's certainly increasing
there. If you count America, I mean you
almost want to like like on all these
things for like electric cars and for
rockets. Imagine Elon as a separate
country from imagine Elon is separate
from the USA, right? Like imagine Elon
uh I don't know this is this is a real
place where America has an
advantage. Um, if Elon, yeah, it's Elon
versus China, you know, and yeah, you
know, BYD makes like electric cars and
there's a lot of hype, but like you can
compare BYD to Tesla. You can compare
BYD to Tesla and you can see like even
competitors, right? You can see a world
where BYD pulls ahead in some areas,
where Tesla pulls ahead in other areas.
You look at like like that's a fair
competition. When you compare something
like Tesla to GM, it's a joke.
Well, it's not about Elon engineering
the rockets, right? Like like like China
didn't engineer the rockets either.
People in China engineered the rockets.
But what Elon can do is bring the people
together to actually get the rockets to
go up. You say the West is at least 10
to 15 years ahead in fabs. I mean again,
what do you mean by the West?
Um, and also like, yeah, you can break
fabs down. Sure, ASML is ahead. ASML's
EUV tech is I think 10 to 15's a bit of
a stretch, but I think 5 to 10 is is is
plausible for what they're ahead of
China. You can look at like the China
domestic UV machines, and I bet they
don't really work
yet.
Um, yeah, New Zealand has Rocket
Lab. Um, I'm going to New Zealand this
year. I'm excited. Uh, ASML is half
American.
Uh, interesting. I didn't know
that. Yeah, I thought they were Dutch.
So, does anyone still want to bet? If
you gave me like who's going to be ahead
in space launches in 10 years, I think
there's a chance that it's
America. You'll define the West.
sovereign states that agree with
principles of individual autonomy,
freedom of speech, privacy, and civil
liberties. I mean, I don't
know,
like some of those things are kind of
true, but they're also kind of marketing
material. I I prefer to
like I think a lot of those things are
are platitudes.
uh to deal with like cope I I the things
that I would prefer in a country
are like wealth and abundance
um and not wealth and abundance from
like sure you can have like an oil
country I wouldn't want to live in one
of those I'm saying like a society
where a lot of the individuals are
creating
value that that's that's a good soc
society. Um, yeah, I mean, sure. I I I'd
say that the the US has very good
freedom of speech laws. Um, the US
always has and yeah, this is something
like the US really values. Uh, I think
it's cool. Like I like freedom of
speech, but I I think there's a flip
side
where like freedom of speech for an
individual to criticize the government
is great. Freedom of speech for a large
corporation to hire a lobbyist to
influence the government. I mean, that
falls under freedom of speech, too. And
that's a lot more problematic.
All right, we're off the rails here, but
I I really every single person who
thinks the US is going to be ahead in 10
years, um anybody who wants to make a
concrete bet on that, I'm interested in
making that bet. Uh and we again we got
to pick we got to pick some number that
can be measured. Even saying like it's
going to be ahead in AI, right? Like
like is Deepseek ahead of Chatbt?
It's like it's hard to argue, right?
Like maybe probably not,
but it's not like it's not like like
steel.
Uh I mean, I don't know about the
justice system in China, but I do know
that in China, uh it's probably a lot
easier to rent an apartment than it is
in the US. I can't believe how difficult
it is. I cannot believe the level of
like like applications and checks. But
then I can I can believe why every
landlord wants to do this. Every
landlord wants to do this because I
could, you know, be a deadbeat drug
addict who stops paying rent and still
lives there. I think that's a lot less
of a problem in
China. Uh you're uncertain the US is
still a democratic country in 10 years.
Well, the best possible outcome here is
Elon becomes a popularly loved dictator.
If Elon becomes a popularly loved
dictator, installs a good set of
lieutenants, starts really thinking
about how to build
institutions, if if the Doge doesn't
just stop at
destruction, like if Elon's game is 20
years long and he truly
builds new institutions in the
US and you have you need to have an open
policy. If if you don't basically have
open
borders,
then I see no way the US could be
competitive with China like in
generations. But if you have open
borders
um and you have
a a state that's like turned around,
yeah, the US can beat China again. Elon
could do it. I' like I'd give Elon a
chance if if you if you if Elon if Elon
was the dictator. I would I would give
Elon a chance at turning these metrics
around. I'm not sure he'd win, but I'm
not sure he'd
lose. Anything that looks like the
current US administration, I am so sure
they'll
lose. Uh, and it's not just Elon, it's
it's Elon like
leadership. He cheated at Path of Exile
because he had a dude grind his account
for him. What do you mean
cheated? Elon can't even turn X
around. I don't
know. It's like it's I think it's better
than it was.
I mean, Twitter was always a toxic
cesspool, and now X is a toxic
cesspool. Wow. You're telling me the
richest guy in the world decided to pay
to not have to grind in a video game?
Based acts progressively more
erratic. I don't
know. This is a lot of disinformation.
Like Grock is good again. Like don't
don't worry about why do you think why
are you so arrogant and to think that
you can like
judge like like somebody from these kind
of vibes, right? Why do you believe you
can have that opinion or do you
outsource that opinion or that shit
doesn't matter? What fundamentally
matters is
output
is are things being delivered because he
contradicts himself. I don't know.
Grock's pretty
good. SpaceX is launching Starship and
catching it with the little fingers,
right? China can't do that shit. The US
is the US is 10 years ahead of China in
space flight. That's definitely true.
Uh, I mean, China has an interesting
strategy to catch up. The US is also
ahead of China in airplanes, right?
Like, like China's eventually going to
launch the uh I think now they're
flying. I think now they're flying
domestically, but like it's a shit 737
A320 clone. It's like that's not a great
airplane. Um, their next generation will
probably be stuff that looks like the
787 and the A350, but then what's going
to be so interesting is the generation
after that. So in like 20, 30 years, I
bet you the best planes will be
Chinese. You're 10 years ahead of China
in so many things. Literally name
another
one. What do you
think? I'm not so sure about that.
Software.
the amount of gangs. You think China's
going to have gangs in 10 years? You're
10 years ahead in school shootings?
Yeah.
Um, okay. So, wait. Software, hardware,
what? Okay. So, again, like you can't
compare a Boston Dynamics Atlas to a
Unit H1. You have to compare per
dollar. Software. I don't know. Do you
see the Deep Seek kernels?
Like look at Deep Seek compared to like
llama,
right? Um Oh no, no, no, no, no, no, no.
India is no China. Uh I I do not think
India is ahead of us in
anything. Um China has won zero Super
Bowls. That's
true. Uh Boom releasing a commercial
supersonic aircraft.
Um,
Uh, they've raised $151
million. That's
it. And they're going to build a
commercial
aircraft. Yeah, that's not going to
happen. All
right, let's see the one they actually
have. Yeah.
Okay. They're going to build a
commercial passenger aircraft. No
fucking
way. That's so for reference. This
amount of money is half the cost of a
single Boeing
787. All
right. So you boom or
like like one 78710 with a bunch of
bells and
whistles, right? The 787 cost Boeing 32
billion. Sure, Boeing's inefficient.
Boeing's inefficient. Maybe you could be
10x better than Boeing. You're still off
by an order of magnitude.
Uh, so yeah, might this company
eventually grow into something that can
build a commercial plane, but that looks
like something could be built in a
garage, which like respect, but don't
think this person's ever going to like
in any amount of nearby time build a
commercial passenger aircraft. No, it
doesn't it doesn't seem like a scam like
Nicola. Though to be fair, if Sam
Alman's involved, it's probably a scam.
What America has that China doesn't.
Companies market cap. Fake
dollars. China has mid girls. They know
big booty
[Laughter]
Latinas. All right. They'll have the big
booty Latina visa.
Isn't the fact that most of the world is
using American software
something? Um, yeah. No, I mean,
America's got a few
like America's a good bit ahead
on like chips still, right? When you
look at that more threads GPU, I mean,
the more threads GPU looks like
something that's 10 years old.
Um, have I looked into Doge and maybe
sent in some of my ideas? Yeah, that's
exactly what they need me to send in
ideas.
Uh, yeah. I mean, I have a way I have a
small indirect way that I'm contributing
to Doge. I very much want to see Doge
succeed. You can, you know, there's
there's No, we're not going to go into
that.
Um, wait. Again, for your money, what is
the actual bet? We need a number. We
need some number that we're betting on.
Um, if Boom had the White House behind
them, if Boom had the White House behind
them, how many how many electric car
chargers did they install? How many
broadband things did they install? If
Boom had Elon behind them, yeah, I'd
kind of believe in it, actually.
All right, we're off the rails here. Um,
if anyone wants to make a bet on some
number, right, let's get on some
number. No, I mean, look, there's ways
to save America. Here's something I
would do. Here's something I would do.
you know, like can we like make America
like like like like like a good place
and then set up little Taiwan and be
like look anyone who wants to uh you
know come anyone from Taiwan who wants
to come move to America and like set up
sick shit here like you can like that'd
be
awesome. Um but no, like America's not
going to do that. You're gonna have to
go through some bullshit and like look I
look I don't really believe in open
borders, right? If if if every person
from if if if every Somalian wants to
come to America, like every person in
literal war torn
Somalia, no, if every person in Taiwan
wanted to come to America, Yeah. anyone
who anyone any Taiwanese citizen who
wants to come to America, yeah, you
should you should be welcomed with a
work visa and open arms and a path to
citizenship.
Absolutely. Right. You got you got to
like like look at the country, right?
think just here you know every country
that has a murder rate lower than the US
if you'd like basically an open border
with the US I don't see why not can
Europeans come
absolutely absolutely
um no all countries don't have murder
rates lower than the US I mean you even
got to be careful with Mexico there
right just just look at your country's
murder
If your murder rate is lower than the
US, you should be welcomed at least with
a work visa right
away. I mean, yeah, you got to be
careful with South Africa. I'm not
saying if your murder rate is is higher,
you absolutely can't come. But we do
need more
scrutiny. Zambia has a lower murder rate
than the US. That maybe everyone from
Zambia is
allowed. Zambia, nice.
What? I don't know. I've never been to
Africa. No,
that's interesting. Wow, that's actually
higher than I
thought. Scary.
Can you like go to Zambia and like
chill? Is it like chill?
I love how like you click on the
pictures, they're just
like like let's compare this to the
pictures for like some random place in
Taiwan, right? I'm not going to
Yeah. Yeah. Let's go to Well, that's
probably a bigger
city actually. They're kind of similar.
Who picks these
pictures? Copper Belt Energy
Headquarters.
Who? You're telling me this
is Who Who did that?
Kerning.
Yesesh. They really like the Zart there.
I'm surprised this is the one for
Taiwan. The ones that didn't make the
cut. I don't know. I don't know how they
picked them.
That's more representative of what I saw
in Taiwan. Oh, actually, I don't know. I
rode my bike through that actually. I
rode my bike exactly
here. Exactly on that little hatched
path. They have like some cool bridges
here,
too.
Yesesh. They They really They really
like the
the You could have made those the the
the letters a little smaller. I mean,
okay, it's not like this level of bad.
It's not like this level. I mean, but
like, no. Okay, the Taiwan one looks
better.
Like, their countryside really does look
like this. It's really
beautiful. Oh, yeah. See this? This
that's
representative. I don't know why more of
the pictures don't look like
that. Oh.
Oh, that was pretty nice. Okay. Okay.
That's a nice convention center.
I mean, I don't know if that's just the
choice of font
[Music]
or all right. All right. Lincoln
Park, Copper Belt University. Okay.
Okay. Swimming charges.
Adults K 100, children
K50. No lifeguard pay at the
bar. Okay. Okay. Reasonable. It's a nice
picture. So, but is wait, no one answer
my question. Is like Zambia
chill. Uh, does higher education in the
US suck?
Uh so in the last 10 years a lot of the
colleges you'd be more and more
infiltrated by the DEI garbage. Like
there really is there's a mind virus and
it's in the universities. If you're the
type of person who can stay resistant to
that mind virus and focus on whatever
esoteric math or science thing you want
to focus on, then the US universities
are very good. Um but increasingly more
and more people are being pushed out uh
as they enforce ideological purity,
right? Like like the college these are
the same people who wanted to do things
like
um I was just thinking it's like wow the
US like had its like shit cultural
revolution and then in like 50 years
maybe it'll be sick. I don't know. No,
we didn't actually get to the killing.
We didn't actually get to the killing of
a large number of the population. That's
where cultural revolutions always need
to go. I was in Cambodia. I went to a
bunch of like the Cambodian genocide
things
there.
Um, you feel like you're the only person
in your college who doesn't buy into
DEI, but you have to stay very quiet.
Yeah. I mean, look, I'll tell you right
now, uh,
like do not cowtow on that stuff. and
you you start thinking, "Oh, well, I'm
just going to do it for this one thing
in order to achieve X." It's it's kind
of like the way this stuff kind of works
is like a it's it's kind of like a cult.
Like like if you buy in
uh the like like like they're getting
you to um what what do they call these
things? Struggle sessions. It's kind
like a struggle
session. Uh UT Austin
You mean the new the new the Jolans tail
thing? I'm not bullish on that. Every
college that starts with undergraduates
is a scam. Uh any college that if you
want to build a college and I think a
lot about building a college, you need
to build a research institution first
and then undergraduates second. And
everybody who's not following that path
is building
basically a a glorified prep school like
a like a high school like
um DEI girls are very easily sexually
available, right? I don't know about
that. I don't know. I just I I wouldn't
you know the expression like don't uh
don't sticky dick and crazy people who
are like like it's one thing like look
someone like like like there's there's
mild forms of this and then there's
extreme forms of this the mild forms of
it sure everyone has like um some mild
ideas but the people who like believe in
this stuff militantly I don't I wouldn't
I wouldn't involve myself with those
Oh, the right wing is a mind virus, too.
Oh, I want George to walk into any
seemingly top college in the US and see
his
reaction. I mean, look, I've seen it. I
I was there right at the like beginning
of it. Uh I'm I'm like I don't know. But
I also like I also hear from a lot of
people that it's like you can avoid
it. Like sure, yeah, there's going to be
a a you know a table set up for asexual
awareness week and they're going to ask
you if you want to talk and you can just
say no thank you and you can move on
with your life and be like okay.
All right, come on. Let's not let's stay
off the stupid things, right? Let's stay
off the the the things of mind virus,
too, because people like go off on it.
You can't avoid writing DEI statements
in top grad schools. So, literally what
that you should just say no and you
shouldn't participate in that
system. Uh yeah. Yeah, sir. This is a
Wendy's. Yeah. Yeah. You can literally
just casually avoid it and the hard
science has seem to not be too
compromised by it. I think that's
generally true.
I think that's generally true. So like
like are these look I mean I went to I
went to CMU for for a bit and it was
okay. It was a lot worse in 2014 than it
was in 2012. And I do think it's gotten
even worse since then. But I would bet
that like operating systems and
compilers are still really good courses.
And oh, if you think you're getting a
diploma and that's going to be worth
anything, if you're not going for the
learning, you should leave right now.
The diploma is completely worthless.
Wait, the diploma is actually worthless.
You guys are aware of this, right? No
company cares anymore. Like the
companies who do care aren't even going
to exist in 10
years. This is why like Roy Lee is like
so right. It's it's like like like
people are like he's throwing away his
future. Like are you
kidding? What future do you think you
have?
You have to have built Google to get a
job at any software engineering
company. Um, as the founder of two
software engineering companies, you
don't. You just have to be able to like
produce value. That's literally
it. You You want a job? You want a job
with Tiny Corp? Start contributing to
Tiny
Grat. It's actually that easy.
contribute to tiny and show that you
have a loop that you can I mean the
difference between someone who
contributes and like solves bounties and
someone who we hire
full-time is somebody who can
consistently and independently improve
the code. Anybody who can consistently
and independently improve the code, I'll
hire full-time.
I mean, this is Yeah, the the the the
trolling of leak code is incredible. I
don't know. But also, like the the other
side of the trolling of leak code
is if you're a good programmer, you're
pretty good at leak code. I'd be
curious. I'd be curious right now if
somebody
uh if somebody gave me leak code
problems, like would I pass it? Would I
pass an interview? If I could easily
pass the interview, then it's
fine. If I don't pass, then okay,
something's wrong. But I don't know. I
don't know where the bar actually is on
lead code. Do one hard.
Let's like look up a code
card. Someone want to give me Someone
want to give me a
problem if it's Have you seen this trick
before? I probably haven't. That stuff's
stupid. Didn't I destroy Advent of
Code? Um yeah, back in the day. Now, I
mean, now you should just use an LLM.
All right, lead code hard page one.
Okay, so let me explain how you solve
leak code problem. So, in this window,
you bring up an
LLM and then you click
here and then you do this. Say Python
solution there. Oh, no. I have to
actually paste correctly.
Oh, no, no, no. Let's refresh my LLM.
Python solution. Oh, this is taking me a
long time. Okay,
cool. Uh, so we're going to do this in
Python.
Um, in
this format. Okay, you should probably
have a faster LLM ready to
go. Uh because if you have a slow LLM,
the interviewer might uh know that you
have a slow LLM. Wow, this is this is
really slow. Wow. You're just supposed
to know the answer already. Oh, I'm I'm
sorry. Oh, why don't we talk about my
dog? Yeah, I just got a new dog. Yeah.
No, I'm I'm thinking through the
solution, but first I want to like talk
about my dog a little bit. Yeah. No, his
name is a puppy. Yeah. Yeah. I thought I
thought it was kind of ironic, you know,
like I named my I named my puppy puppy.
Uh Yeah. Yeah. Yeah, yeah, yeah. Um, so
you know, his name's Puppy and uh
sometimes
uh Yeah, yeah, yeah. Uh you know, his
name is Puppy and and Oh, okay. Oh,
yeah. No, yeah, I see. I see. We're
going to have to Well, first we're going
to have to like handle the edge cases.
Uh yeah. No. And then Yeah. Um so, no.
Uh wow. Wow. I really I really should
have I really should have prepared for
this interview more, you know? I just it
just takes me a long time to like think
through these things and wow wow this is
really um this is really
uh wow wow this is this is we're still
we're still going here like sometime
deepseek really really really does this
really does this um yeah
oh we don't even have that uh oh and
that one's not going to work either oh
no oh
no um no guys I failed the interview.
[Laughter]
Sorry. Oh, yes. Here we go. It's even in
the right format. Oh, no. No. Sorry.
Sorry. Here. I got it. I got it. I got
it. I just I just thought everything
through. Everything just came to me.
Okay. Here we go. Yep. All right. Cool.
Uh, yeah. I solved
it. Would I use an LLM for admin of
code? I used an LLM this year. I just
that's I used an LLM. I even wrote a
script and
everything like it's it's
not I don't know. And then I kind of got
bored I got bored with it a few problems
in. I'm just kind of like if this is
what it's going to be then why
uh then why
uh like the competition had a good run.
Um but as an actual like practical thing
the leaderboard they're like oh you can
use an LLM but you can only use the LLM
to help you. Don't copy and paste the
problem. Like there's just no longer a
real line. Okay. Do you really want to
like think through one of these?
Department top three salary. Oh jeez.
What is
crap? Who earns the most in each
company's
department? Write my SQL query statement
below.
What? Oh
god, it's a my SQL
problem. What's
candy? There are n children standing in
a line. Each child is assigned a rating
value given in ratings. You're giving
candy to each children. Each child must
have at least one candy. Children with a
higher rating get more candies than
their
neighbors. A big
zen. Not that
big. How long do you have in interviews
to work through these?
OBS is not
centered. What you mean by
that? If I have 40 minutes. Yeah, I can
do this in 40
minutes.
Yeah, I have to solve this like one
problem in 40 minutes. Yeah, this thing.
Um, I don't know what fire ship
is. I mean, so like what I would
actually do here, the the way that I
would actually solve this is I would use
Z3. And like if they have a problem with
me using
Z3, it's just like it's just really easy
to express like this exact sort of
constraint. I don't know, maybe Z3
wouldn't maybe that's too many variables
for Z3, but I would express it first in
a constraint
solver. Um, and then think about how to
explicitly solve for those
constraints. I don't know, like I feel
like with all of these it's like sure
you could push people on like knowing
whatever the algorithm is.
Um, no
libraries. Yeah. Okay. Do you guys want
to actually do
this? 40 minutes time is running. I have
to sign up for fucking lead code.
Um, nobody wants to do
this. Code is contrived.
Uh, the minimum number of candies you
have to distribute the candies to the
children.
I would not partake in raiding small
children and distributing candies to
them. Uh, now I see I I get I get nerd
sniped by this stuff.
Um, not speaking is a red flag. All
right. You want me to speak the whole
time? So, we have the ratings coming in
and we have to
return the minimum number of candies.
Well, so the absolute minimum number of
candies is going to be the number of
children because each child must have at
least one
candy. And then every time we have all
right, so there's kind of there's a few
cases that can be done here. So we have
a child and either this child
has children with a higher rating get
more candies than their
neighbors.
So we can think about the case like
this. Um and
there's high
uh so we can think about all the
possible cases
here
higher. So how many possible cases I
have?
Uh, same higher, same
higher.
Uh, lower, lower. And we just do all
that same stuff, but
lower. Then we also have to do the same
for lower and
higher. So those are all the possible
cases. And every time there's a change.
Okay, so
whenever two children next to each other
have the same rating, we can just remove
them all, right? Because that doesn't
matter. They're all going to have the
same number of candies. So we just have
all the step changes.
Um, it's a Scola
interview. Yeah, I don't
know. Yeah, I mean, this stuff's kind of
stupid. This this is this is a dumb way
to interview people. This is a real dumb
way to interview people.
Um, so I haven't really thought like
this in a while. Like, this really is a
much less useful way to think now. You
should be outsourcing this kind of
thinking to
LLM. What did I ever say? Leak code was
smart. What? So, we used to have one, we
used to have one at at comma, a
programming screening, but our
programming screening was not
uh le code. Our programming screening
was not algorithms. It was literally
like can you write Python code to fetch
a web page and extract an element from
that web
page. Uh so you should have like some
basic No, I mean Tiny is just much
easier because it's just open source.
Okay. So you got to deal with each one
of these transitions
um as being more or less. So, first
we'll compact it to
that and then I feel like we can do an
an iterative algorithm, but that
probably isn't optimal, right? So, you
can you can quickly get like a solution
with an iterative algorithm where first
we're going to go through and like find
an unsatisfied child.
Okay. So
candies = 1 * length
ratings for i in range
[Music]
uh
if n equals length ratings 1 * n for i
in range n
If
rating sub I is less
than grading sub I +
one
candies sub I
All
right. Did I solve
it? Not logging in to find
out.
Oh, my final login. No, no, no. I don't
lose my candies. I worked hard on that
solution. Is it
good? No. No. I'm nerd sniped. I'm nerd
sniped. We're solving leak codes now.
Look at leak codes off the
stream. We're solving leak codes.
I'm doing Vim for all time
sake. Oh, I can't believe this.
This is a leak code solving
[Music]
stream. Use use tabs or something.
What? Oh, come on. What is that? Set
ET. It's been a while since I've used
this gun. All right. Oops. Forever.
Great.
Oh, take away a candy from that child.
That's right. Okay. Three and four. No,
it was supposed to be
No.
Okay.
[Music]
What? I even understand the problem. I
don't Well, I don't understand why
that's ever
correct. Why that's the output of
candies? That shouldn't be the output of
candies. Oh, the
Why does that get 102?
What? Ratings eye is less than ratings I
+
one and Candy's eye is greater than
Candy's eye + one. So why does that not
just increment that by one? Why does
that give me two there?
Oh, also
um how did that even become zero? What
did I just like?
And that becomes
zero greater than
one. All right. One, one,
two. No, but see now because that one
has to be
incremented.
Um, in fact, why do I ever have to
decrement? Can I do this only by
incrementing? The only
time I might have to
decrement. Okay, let that out for now.
Let's focus on that
case.
So, this child is a lower
rating. So, we're going to have to
increment the first one. Let's just do
this a little differently. Um, okay. So
while
that while that rating is okay while
that rating is true and Miss Candies is
true, let's
increment the ratings of the first
child.
No, now we can't increment ratings.
Sorry, what am I doing? What am I doing?
All we can do is give the child more
candies.
Okay. So while the rating of the child
is greater than or equal to and the
candies is less, we give the child more
[Music]
candies. And candies is less than
candies i + one.
less than or equal
[Music]
to. Right now we're getting 211 because
we forgot the last
child. Oh, this. Okay. Wait, wait, wait.
So, think this through for a minute.
So, can we like solve this like
inductively?
If you fix the beginning of the list, is
there any reason something later in the
list? Oh, I guess yeah, if you have like
a sharply descending thing, you're going
to have to you're going to have to
increment all the previous ones.
[Music]
Um, okay. One, two, one. So, now let's
just do this for the last child.
ratings uh n minus
one. If ratings n minus2
is okay, let's just do the last child
explicitly. uh
ratings n
minus if
uh three possible
cases same children with a higher rating
get more candies than their
neighbors. So if
ratings n minus one is less than ratings
n minus one
candies n -1 =
candies n -2 + one
else. Oh, that's if it has a higher
rating. Oh god, no. Um,
okay. This kind of like gets at how to
do the whole thing though. So if they
have the same
rating then we have to give them the
same
candies. We can probably just use the
same logic to then solve the whole thing
if they have the same rating. If
the if rating is same, we need same
candies. All right, that's a true fact.
Um if
second
last
is
higher
rated than second
last
[Music]
Uh, last
gets one more
candy. That's
fine. If last is
lowered than second to last, last gets
one less candy.
If
candies
subj equals
zero, can't have zero
candies add one to all.
[Music]
We got five for
both.
Oh. Oh, okay. If they're the same, they
don't need the same candies. That's
wrong.
Oh no, this is
complicated. Oh, this is really
complicated.
Check
chat. Well, I'm not checking chat. We're
solving this
alone. Um, okay. If the rating's the
same, they the same candies. This is
false. A higher. Okay. So, wait. So, I
was wrong about all that stuff about the
same.
Okay, the rating is the same. I could
actually do whatever I
want. The rating is the same. Maybe I
just skip
it. Just so then I don't need to add one
to all. So we we'll get there in a
minute.
Rating
revised. If rating is same,
ignore. Anything is
fine. Now we have a problem with that
one being zero.
Okay. Or I in
range J to Z - one - one.
Um if
uh
rating sub i -1 equals equals rating sub
i
break rating is
same. Anything is
fine. Okay.
Where does it
[Laughter]
break? Uh, cool. I saw the
examples. Is that right? What did I do
wrong? What did I do wrong? There's no
way it's that algorithm. There's no way
it's an oan
[Music]
algorithm. God, I'm going to sign up for
lead code. See, want to know the truth
about this? I look at this and I can't
stop. And unless you're like that, don't
go work at a tech company. Get the fuck
out of technology.
Um the algorithm is not bad. It's n
square.
some test cases to test. All right. The
answer to this is
13. Can you I don't just want the
answer. You got to give me the candy
distribution. Got
13. What else we got? You got any more
examples for me? Did I get it
right?
Um got it right already in eight
minutes. All right, cool. Glad to know I
can solve leak code hards. Glad to know
I can have a I can have a job at a large
tech company. Okay.
[Music]
Um, did I actually solve
it? I don't know. Maybe I was just like
overindexed on like how hard these
things
are. Oh, you ran it for me. All right.
Thanks.
Great.
Um, cool. I can get a lot of Java tech
on me. All right. So, look, here's the
truth.
leak. Actually, if that's the
difficulty, if that's the difficulty,
that's
fine. If that's the difficulty for an
interview, that's
fine. Like there was no if if if it's
the kind of thing where, oh, you just
have to have like Max Flow memorized or
Ford Marshall or whatever. Yeah, that's
stupid, right? Or if it's the kind of
any interview problem where you have to
see a trick, it's stupid. But there was
no trick there. It's just like, "Okay,
go through and solve it." You guys are
like trolling me probably. It's probably
actually like, "No, you need this like
dynamic programming N squared
search."
Um, no. Come on. That's a reason of your
question. If a guy who wants to join
Tiny Grid can solve this problem but has
a hard time contributing to Tiny Grad,
no, of course I wouldn't hire him. It's
a much better interview process, right?
It's a much better interview process if
your test set and your train set are the
same. Uh, no. Anything that's speedbased
or that you have to practice is stupid,
right? Like, like, okay, sorry about my
arrogance, but like if I can't solve
whatever it is, it's not a good
interview for a tech company. Like, I
might have other problems with me that a
company might not want to hire me, but
if a company's upset with my programming
abilities,
You know, that's that's I don't know
where that bar
is. And like some people have been
posting like a bunch of like those hedge
fund
questions. Oh, no. I'm sure there's some
lead code hards you could give me that
would just happen to stump me for three
hours. That's not contrived. That's
programming. If if again, if that's the
level of interview question, that's
programming. You don't need to know any
algorithms to do that. You just need to
think it
through. I think that some of the hards
are stupid. Like I don't know like the
median I know the median uh median
subset one is is is
uh like again if you have to know the
algorithm if it's a question of
grinding. Yeah. I mean then it's stupid.
anything that people are going to grind
for is just like not a good interview at
that point. Um, and again, I'm not
saying that companies should use this as
an interview. It's a weak predictor of
the thing you want. I would never the
the comma had I don't think we have it
anymore. I think now comma is all
programming challenge based but we used
to have a uh programming challenge a
programming like we had like you had to
do like four questions on one of these
platforms but they were a tier easier
than this they they didn't really
require thinking through problems they
required actually just kind of being
able to do things
um I remember like some of them were
were
uh were as dumb as like um fetch a web
page and uh yeah like parse this data
out of it and then calculate the
mean. Yeah, this
is interviewers are arrogant and they
yeah throw impossible problems to boost
their ego. Uh, you know, I failed I
failed a Jane Street interview. Um, I
did I did a Jane Street interview
and yeah, it was kind of like uh it's it
was something I hadn't seen. It was like
basically that you can create two to the
n
things in
uh in like a functional programming
language. Um, and this is this is back
before I even had as much Python
experience as I had. I was doing things
mostly in C and
like it was
just it was a question that was
assessing if I had spent the last five
years doing functional programming more
than anything else. Um it was about it
was about yeah two of n constructions.
You you can use something that's o of n
to construct objects that are two of n
two to the n. It's like really obvious
and I'll never forget the problem. Um,
but yeah, no, they they rejected me on
the interview and
like yeah, I don't know. I I don't think
it was a particularly good
uh it also wasn't like a coding problem.
I actually solved the coding problem.
They gave me a coding problem and I
solved it.
And I was so weird actually now that I
think about it. Like what I failed was
like the got you questions. The guy was
like like how big a thing can you
produce with an O of n calls to a
function and
like I guess I didn't really like like
it's a very functional programming way
of thinking. Um and then he had like me
to do some thing where you like traverse
the list and I used ID in Python and he
kept telling me it was wrong and I was
like I don't think this is wrong. Uh,
and he's like, "What about the garbage
collector?" And I'm like, "Python's
garbage collector is
non-moving." And he's like, "Oh,
uh, yeah." So, I don't
know. Um, no, I don't think the problem
was that creative. I think the problem
was literally like, are you thinking in
a functional programming language or are
you thinking in imperative programming
language? And again, it's a totally fine
it's a totally fine screen if that's
what you're looking for. But the
question would like even someone who's a
very good programmer uh who hasn't just
spent a lot of time thinking in a
functional way would get would get and
like you know I saw something in in in
uh someone in Lex where I mentioned that
I wrote a compiler in Haskell. I wrote
my compiler for CMU's compiler class in
Haskell and like it doesn't mean I
consider myself good at Haskell like not
really. You saw me at Rust today so I
have rest. Uh go I kind of do but
um I ended up interning at SpaceX that
summer. Uh SpaceX's interview question
uh
was basically
explaining at first I mean first they
had me do like the typical like uh walk
me through a hard problem you've
encountered and how you solved it. Um, I
forget exactly what I said, but and then
they had me talk about like ground
bounce. Uh, and just like understanding
that even your ground plane has
resistance and your ground plane is
going to be pulled up in areas if
there's current drawing then your ground
could go and like they were asking me
like do you know that like a transistor
triggers at 7 volts or something like
all very reasonably e questions.
Do I think it's worth learning
[Music]
programming?
Uh, what? I don't know what you mean by
that. Really, let me tell you the truth.
If you have an IQ that's
like
like sub sub 110 sub 120, I just don't
know if you can do this. And I I think
that's the real truth. And I think that
there there's a lot of taboo in just
stating it like that. You know, we live
in a world where like people can
overcome, but like yeah, maybe 115, but
if you have an IQ of 85, you'll just
never be able to solve a problem like
that. And that's the truth, right? You
can you can grind at it your entire
life. And maybe you can grind at
explicitly leak code, but you're not
going to be a software
engineer. And like that's just like I I
don't know any other way around that
truth. bro woke up and chose violence.
Yeah, I mean it's not violence. I think
that the even sadder thing is telling
anybody that they can just practice leak
codes and eventually get good at them.
And like programming is a skill you can
definitely practice. And the sadder
thing I see is when I see like 150 IQ
people who can't program like you can
program. Go spend, you know, five years
doing it and you'll be good at it,
right? Like like the only reason you
can't do this is because you haven't
spent time doing it. Um, and that's less
about stuff like this. Like these kind
of things are almost straight up IQ
tests. Uh, like there's some amount to
which you can memorize the tricks, but I
really don't think the companies want
you memorizing the
tricks. Um, yeah. No, no. Look, if your
IQ is like 115 or 120, yeah, I think you
can learn to do this. Um, but if your IQ
is 85, you can't.
If you take a few hours for elite code
hard, you should work at
McDonald's.
Like I mean something I can think about
is
like when I was
like 21 22 I was just as good at that
problem as I am
now.
Uh, when I was like 15, I think I was
less good. I'm not
sure.
Um, but no, it's it's not a trick. I
mean, like they they don't want you to
know a trick. They're they're they're
trying to see if you're capable of like
thinking through stuff like
that. There's not really different types
of intelligence.
Uh there's there's limited and sure you
want to talk about different types of
intelligence sure like you know sure
someone who's like an artist or
something yeah maybe that stuff's
different like maybe there's like
convergent and divergent but there's not
different types of intelligence that
make you good at programming and this is
in its purest form what makes you good
at
programming candies fail. I got one
wrong. This might be wrong, too. This
might very well be wrong. Um, and again,
if this goes into like you you have to
uh if you give me an example, I'll go
through it. But, um, this can very well
be
wrong. But it's not about even like
whether the solution is exactly right or
not. It's about whether you're capable
of breaking the problem down into subp
parts and like understanding what the
constraints
are like can can you see first like
first look at how I broke it down here.
I broke it down into like all right
there's these like different cases and
then you have to think about how to
handle each case. I don't know. I mean,
look, again, maybe it's bullshit. Like,
if someone actually gave me this problem
in the real world, I would just try to
shove it in a constraint solver. Um,
because like, why should I be thinking
like this? Constraint solver should be
doing it. LM should be doing it. All of
that. But if you don't understand how to
solve it, you're going to struggle at
the higher level thing. Like, I I do
think the tiny interview process is much
better where we're just literally asking
you, can you code on Tiny? But I'd be
willing to bet I we did it actually. We
did when we did the programming
challenge. Uh we gave it to Comma
employees and all the common employees
did well in
it. Oh no.
$250,000 and fang. Wow. What am I going
to You're telling me I can ship better
ads to people? Me? I can I can help
connect people with products? Oh, my
dream in life.
Um, the correlation between intelligence
and success is much lower than hard work
and success.
[Music]
Uh, here's how that
works. I heard I heard uh, you know,
there's always a debate. It's like, do
you have to be smart? Do you have to
work hard? Or do you have to get lucky
and to get success? And the answer is
you don't have to be the smartest. You
don't have to be the hardest working.
And you don't have to be the luckiest,
but you got to do pretty well on all
three. You got to be an eight out of 10
on all three. Like the people who are
really successful in the world are not
just smart. They are smart. They are
hardworking and they're
lucky. You need good connections, not
hard work. I completely disagree with
that. That's a total bullshit take.
Um, that's a total bullshit take. I hope
all the people who like got jobs like
that are just going to be weeded
out. Sometime luck means your dad was
rich. That could be what luck means.
Luck could be that you happen to stumble
upon the right place at the right time,
right? Like there's definitely a
component of luck, but there's also a
component of luck in poker. And if I
went to a room full of poker pros and
played poker with them, I'd lose
miserably.
and my leaving the leaving that poker
room. I'm not going to say, "Well, they
got lucky." I'm gonna say they
understand how to control for luck and
control for variance far better than I
do, and that's why they beat me at
poker. Is it possible to teach me
Chinese? If someone was actually in Hong
Kong and like spoke good Mandarin and
like wants to like meet up for an hour a
week and like try to teach me Mandarin,
I'm down.
How would I set my children up for
success? I would use um a genetic
selection technology to uh select for
high IQ and avoid uh uh bad genetic
abnormalities. Connections are basically
useless. Um you don't need connections
in today's world. You need scale.
um you you need to be able to produce
value for other
people and there's never been an easier
time to demonstrate that, right? Like if
you're like if you're like in the past
and you're like in some like small
farming town or something, um you guys
are all going to make fun of me in the
comments be like, "George, your elite
code was
wrong." Uh can you do this in a real way
in 2025 to some extent? Gwarn has a good
uh Gordon has like a breakdown of like
all the techniques you can use. Um you
can do it to an extent but you don't get
that much selection power. So basically
like when when uh when a woman has her
eggs extracted um you only get like
maybe like 40 uh and
then you fertilize them. You're going to
lose a bunch there. Maybe you're down to
maybe you're down to 20 or 30. Uh and
then like so your selection power is
like let's say you have 16, right?
That's four bits, right? So you get two
to the fourth selection and then I think
two to the fourth selection. You can
translate that to IQ points. It's like
kind of straightforward. I don't know.
There's a lot we don't know about that
stuff yet
either.
Um Oh, cool. Send me an
email. What height would I choose? I
mean, yeah, I don't want him to be like
short, but I don't think you got to be
like some like mega tall person. I think
that that's one of there's a lot of
things where like more continues to be
better and there's a lot of things where
like as long as you're not in the bottom
as long as you like prevent the downside
risk you're pretty good and I think
that's true with height. Yeah. Like I
wouldn't want my like male kid to be
5'3, but according to Google, I'm 5'4,
so you know,
hey, dangerous
misinformation. Tiny on track for speed.
Yes. Yes, we're on track for speed. Our
ML perf results are going to be nice.
We're doing a lot better than last time.
Um, Tik Tok is making you stay at the
bottom, but no, like really about the
lead code stuff, like take a legitimate
IQ test. I wish that we could be more
honest about things like this in
society. And like, yeah, if you get like
100 on the IQ test, you're not going to
be a software
engineer. Like, let's just be real. I
don't know. Would you rather someone lie
to
you? You got 120. Well, if you got 120,
you're in the realm of water. Like, you
probably can do this if you grind hard
enough at
it. It's my IQ. I took an IQ test on a
stream. Um, again, I don't think these
things are like like I'm not trying to
like circle jerk about the number here,
right? If if you're in
the if you're anywhere from like 120 to
160 or 120 plus, all these opportunities
are open up to you. You got a 140,
you're a dumbass. Well, you know, then
that's all on you, man. That's all on
you. That's even more
stupid.
Um, no. Like, stop with the cope. Stop
with the cope.
Uh, I argue EQ is equally as important.
Again, like is IQ a perfect measurement?
No. But that doesn't like everyone knows
that there's things that it perfectly
correlates to,
right? You got 119. If you want to be a
software engineer at 119, you'll
probably fine. I'm I'm just really
saying
like when my code feels sad. Oh my god.
See, this just tends to like you guys
aren't mature enough to have this
conversation. In fact, like the whole
like like American society isn't mature
enough to have this
conversation.
Yeah. Um but see, that's the other
thing, right? like like like beyond a
certain point it's not IQ. Notice how
when I saw that leak code problem like a
part of my mind just couldn't
stop, you know? I just I gotta do it. I
got I got to solve this. And if you
don't have that, if you don't have that,
I'm not going to like like get on you
about IQ. That shit's like but I am
going to get on you about that. If you
don't have that sort of drive, if you
don't have the sort of drive where it's
like, oh my god, like I have to solve
this problem. I really enjoy solving
these type of problems. Please leave the
technology industry. Please leave.
Nobody wants you here. Okay? Like, get
the fuck out. There's the door. Please
leave. If you're not excited about doing
this kind of stuff and you're just like
the kind of person I I think you're a
bad person, please get the fuck out of
technology. All right. If if you're not
here to make things that are great, if
you're here to, oh well, I just want to
do mediocre work and get a fang salary,
get the fuck
out. All right, that's a good thing to
end this on. If you are excited about
this shit, I mean, that's really what it
is. That's really what it is more than
anything else. If you're like, "Oh, Le
code's such a grind. I just got to grind
lead code so I can get a comfortable
salary." Like, get out. Don't waste your
time. You're wasting everybody's time,
man. You're wasting your time. you're
wasting their time. You're wasting the
world's time. But if you see this stuff
and you're like, "Damn, I love solving
this shit. I love solving problems. I
want to understand the universe. I want
to understand
everything." That is who we want in
technology. All
right. Is that clear? I hope I
discouraged some people today.
Everyone's big on encouraging people.
There's way too much encouragement shit
out there. There's got to be more
discouragement shit because honestly, if
you're going to Elon said this, look, if
you're going to if you're going to
listen to some discouragement shit and
actually be discouraged, then get out.
You should have never been here in the
first place. If you're going to listen
to that discouragement shit, be like
George Hot's a fucking asshole. I'm
going to show him. I'm going to be the
best software engineer in the world. I'm
going to grind leak code non-stop. I'm
going to think about I'm going to
transcend leak code. I'm going to make a
thing that solves all the leak codes for
me. Congratulations. You just invented
LLMs. Thank you for watching today's
stream. We have about 30 years till your
jobs will all be taken by AI and none of
this will matter. But until then, go to
work, get things done, and create value
for other people. Thank you for watching
today's stream.
XxSallyTheGooseXx: hi
fightscore: yo
mattiebatslayer: lets gooo
codingbyamp: hi
Santiago_LHC: We are live
mntndew: hi
kinvert_ed: it's been such a long time
mntndew: chat is here
iooiooiooiooiooi: yellow
codingbyamp: longtime i  see alert
miggjacker: geohot streaming, new ilya interview, we are so fuckin back
wideclearly: LUL
DaveCodes: georgehotz went live, right away i clicked it. LFG!!!
mntndew: just get a neuralink and think chat into existence
whiterunknight: Hi
suntadge: the goat is back
BlurryFella: How's life man?
Nirfse: Hey!
kinvert_ed: We got proof of life fellas
21st_centuryman: George hots is back. god is good
480i: hello!
TandeBoy: Comma 4 yay
alistar_op: morning sir
userismale: Yoo
whiterunknight: But its tuesday
tohrxyz: Hello!!!
michaelmanog: if candice owens dies for any reason people are going to build conspiracies anyways
Nirfse: Congrats on the launch!
jnpl95: Been a long time
pika2u: congrats on the comma four
m3ntors: Geoooo🔥🔥🔥
Slappy826: hello
RajarshiKhatua: hello
kinvert_ed: 4 commas we in the 4 comma club now boys
whiterunknight: Its so tiny
tohrxyz: it looks like it fits into pocket
miggjacker: are you still in Chyna
zee133: what happened with the 10k wager with the 6000 and the 5090s
whiterunknight: @zee133 He won
malateman: Home for the holidays
michaelmanog: it drives very fast I feel unconfortable with that speed
iooiooiooiooiooi: ram prices :(
480i: it seems like a good speed
swimming_dragon: So when will AI cook for me?
480i: what’s the best car for comma 4 now?
Joooooooooonas: Start producing DDR5! thats how to make money
whiterunknight: Looks great on my end
filthyspaceglider: whens the podcast dropping
LateStageUsername: ur pushing too many bits twitch cannot handle it
soapy_flannel: unc
shuttleword: What's sota
kinvert_ed: Leetcode them IRL
Santiago_LHC: Rantcast
malateman: Do a call in show
borisevstratov: When next Lex Fridman ?
Joooooooooonas: You and casey muratori would be nice
jnpl95: Podcast would be fire
kinvert_ed: 1337pod
dqbee: @borisevstratov Lex Fraudman
aobakwesometimes: aobakwesometimes subscribed at Tier 1.
480i: @malateman he’d ban us all after the first call
kenqz3: Comma 4 is nout??
Erixp: optimize for normies
rliessum: Advanced Idleing while driving
kenqz3: LOL
Dewauwa: it's authentic
BlurryFella: It's authentic this way
kinvert_ed: biometrics now haxxed
wayne_keker: @georgehotz how u doing with bad weather cases?
jnpl95: yep authentic this way
itsamarcos: isnt it kinda smol
kalelite: Why does it watch me?
kristofferhelle: i have ap1 car. ap3 and 4. ap1 is still way way better in europe.  it's fun how the 35W mobile eye is better in every way.
souperfalconn: No Ferrari?
chedoki: What's the selling point over comma 3? Is it cheaper?
oibtujwhcdjkfx: George, you should react to Ilya Sutskever on Dwarkesh Patel. 12minutes ago released. Pog. Cinema.
480i: @kristofferhelle I wish AP3 and 4 had radar enabled
alimehdi92: hi
ALEX_rocket_420: Dirty screen let's people know it's not AI generated
rliessum: jitterrrrr cable congested
480i: @oibtujwhcdjkfx worth watching?
alimehdi92: what is gps
pythoNNNNN: geohot so high t so awsome
pythoNNNNN: !soundcloud
oibtujwhcdjkfx: Most definitely. @480i Why? Because ASI.
dqbee: @alimehdi92 the thing you turn off on your phone
biggorillaz: pls more comments
OdisiousMax: Hey just sounds so unenthusiastic about what he's talking about.
Joooooooooonas: What about sound, would sound be helpful as a "sensor"
marschr: Cx3 still available for body? or buy used?
techie163: Does comma 3 still work or is it discontinued?
malateman: @pythonnnnn bro is trying to rage air to get sub mode enabled
alimehdi92: can I get this in Canada
rliessum: ah that explains the eGPU shizz for tinygrad as well
deepvision: How well does comma work on Europe? Europe streets are quite different from us. Tesla is like 50 times worse in eu
alimehdi92: I have Nissan rogue 2021
pika2u: I can see myself buying the comma four for my dad, you guys nailed it ty! <3
chedoki: Do you think the average consoomer will think "less screen = worse" ?
serokon: how can it turn the wheel?
cj1m: Any plans to enable experimental mode on Tesla Model 3?
pythoNNNNN: @malateman i mean no harm. i love geohot
defbehaviour: are there chinese version?
rliessum: @deepvision proprable learn the shit on training video's allready
techie163: Is the harness any smaller with the new version?
michaelmanog: you can use comma to make an uber without a fixed driver and if someone is the driver for a small he gets a free ride to transport other passengers
biggorillaz: going to order bidzillion of this if it’s good stuff
kenqz3: does it need to have ACC my car has it but its software locked?
kinvert_ed: Not level 5, level based
biggorillaz: Corolla
kenqz3: skoda
marschr: no GPS at all or just for coarse/groundtruth location?
kenqz3: scala 2020
RajarshiKhatua: when international launch
abitranis: mazda CX 5 ?
pika2u: does a compatible car come with the comma four febKappa
einqs: Audi A1
zee133: do u know if other forks will be functional once shipped
rliessum: all jokes aside, looks like a awesome product, the prospects are good.
Themarkum: Why is no french cars supported?
k1ngafa: peugot is stellantis too
RajarshiKhatua: I can buy in india
dispassionatejoe: @Themarkum BasedGod
vinodvankar: Hello Hello 👋
crysiston: can we buy this in dubai??
Ethan1G: I need a video of how bad the torque limit in an 11th gen civic is
oibtujwhcdjkfx: For CC, should I be using Comma   4 or Claude Opus 4.5? Python mostly.
jnpl95: fork em
480i: have you tried an HW4 car with FSD14 yet, if so what did you think
michaelmanog: can you set it to follow a car in front?
dqfft: dragonpilot is still nice on the 2 :)
biggorillaz: can world model beat LLMs
chedoki: What requirement does a model need to fulfil to be considered supported by open pilot? Just ACC+Lane Assist? Or it being part of the dataset?
mrmati55: no toyota auris?
pika2u: I’d be interesting to see linus review the comma four
k1ngafa: don't newer german car use encrypted communication stuff
crysiston: lincoln mkx ? 2015
kinvert_ed: If we put a tinybox in the car could it beat Max Verstappen?
malateman: adeeb mentioned the settings work well on the small screen. but can we actually see how it works
KettlebellSwinger: its geohot !!!
480i: thanks George
kenqz3: why do toyotas work best
chiefpuzzleofficer: what’s on your white board
KettlebellSwinger: wb been a while
chedoki: lets go livedoing
yep_cog: no toyota yaris?
kinvert_ed: f it we'll do it live!
whiterunknight: We'll do it live
480i: @kinvert_ed haha
rliessum: Was that demoed allready? the egpu in a car with a comma4? :-)
rliessum: open up al pic lanezzz
malateman: find someone that loves you as much as pytorch developers love command line flags
HurricaneFP: does it use the neural processor oon the 845?
Joooooooooonas: did they help with your request?
rliessum: don't max out the usb4/tb4-5 bandwidth yet?
journey_in_ai: that's sick
biggorillaz: pls hire me, I spent shit amount of time with gradients and optimization methods, Hessian, jacobian etc
masterMau: was at comma_con when it launched, the C4 is beautiful and im super happy about the body v2 !
rliessum: Also, going from mandentory sales pitch to nerding at once hehehe
pika2u: @biggorillaz check the tinygrad bounties
malateman: it's the best body yet
einqs: What does the body V2 do?
masterMau: the rgb makes the body v2 10x smarter !
pls_at_me: no clanckers!
masterMau: @einqs whatever you want it to do, thats the beauty of the body !
einqs: Can it do my laundry?
yep_cog: just curious, why is not toyota yaris compatible?
masterMau: amazing that it comes with a harness now !
MicroG0D: WIRE!!!
whiterunknight: Ahhhh wire
kaplanfx: Which version of body will be able to turn my steering wheel? My torque sucks.
ALEX_rocket_420: electromagic
biggorillaz: you certainly need well known superstar AI guy to attract more funding
masterMau: ez pz
rliessum: wireless harness upcmming
journey_in_ai: simplicity is great
defbehaviour: wires is a myth, ductape is a real stuff
Joooooooooonas: I feel like the harness is the last major showstopper for some people
pika2u: plug and play is the way to go
masterMau: i hope to get it next week. I ordered it the minute it was announced lol
nikolasantesla: hey man, I have foxus 2023, is it compatible?
masterMau: that piece of plastic is a pain in the ass
rliessum: if you can't do it just get a local meganic to put the thing in, no big deal.
caillouFPS: thats an expensive adapter
wwwroot: @nikolasantesla there's a compatibility page in comma.ai you can check
KettlebellSwinger: thats what she said
nikolasantesla: @wwwroot checked it says focus 2018, thats why I asked
KettlebellSwinger: sorry
masterMau: talk about the keyboard, that's the biggest thing with the C4. the keyboard is great !
malateman: need to make a world model to generate custom install tutorials
480i: 32gb
dqbee: how much detotated wam
kinvert_ed: Shucking Commas for RAM
masterMau: downloadmoreram.com
whiterunknight: No wayland too
biggorillaz: 28gb ram?
Shashwatkthnxbye: @georgehotz remember when you said you'd never do discounts or sales and here we are doing promo live streams
kinvert_ed: Is it shuckable for the RAM fellas?
N0uLaiF: buying it just for the ram
rliessum: @comma_ai_copywriter
malateman: lol
pls_at_me: nabeel day when
swimming_dragon: Do you expect normies to buy commas or just nerds?
biggorillaz: everything Rust coded, so it’s extremely smooth
pika2u: the comma four doesn’t look real, it looks sick! should be called the comma 5
Joooooooooonas: I think the last showstopper for normies is the harness
rliessum: normies are the future
masterMau: the one thing that's left for it to be a true product is a good web app
RajarshiKhatua: python ftw
Consort1: how do you tell it where to go
rliessum: yeaaahhhhhhh raylibbbb
pls_at_me: looks super smooth and nice this time
rliessum: gogogogo
kenqz3: comma 5 will be huge
programmerare: what’s your favorite programming language btw?
Tachyonray: is it no longer a phone?
kinvert_ed: RayLib goat
Impr0x: babe wake up, geohotz is live
kinvert_ed: We use RayLib at PufferLib
chedoki: its a good camera sir
kenqz3: does it use lidar
masterMau: the raylib maintainer is in the comma discord, its pretty cool that he's there to answer the community questions GoatEmotey
rliessum: proven tech
Shashwatkthnxbye: Why does it say "support georgehotz by disabling ad block" on my screen?
kenqz3: blackmagic doesn't
Joooooooooonas: laziness scales with speed LuL
odiemac: 10nm tho bro
swimming_dragon: software boys are 10years behind hardware chuds
cj1m: What's the mic for? Spying?
showboat88: @kinvert_ed did they switch from qt to raylib?
whiterunknight: but georg where is da lidar>>>??
biggorillaz: good specs
pls_at_me: need the specs in the form of a rap song
Shashwatkthnxbye: thoughts on stutton vs dwarkesh?
masterMau: i wish they would compare the size to an iphone or pixel, the size is super impressive
rliessum: devtalk on commacon was good about the cooling challenges with the new case
masterMau: ah yeah robbe talks about the cooling, they wrapped it on both sides and filled the gaps with epoxy
kenqz3: LOL
KettlebellSwinger: taichi is based
masterMau: its in the robbe presentation
480i: @KettlebellSwinger kettlebell tai chi is the way
verig0: it is in hardware presentation on comma ai
masterMau: the copper shot glass lmao
verig0: even package on apckage
Joooooooooonas: I think he shows some cfd
biggorillaz: actually cooler fans are underrated
bojosos: Hello
malateman: yeah, he does go over it in the vid
malateman: not in this much detail
rliessum: not going to get away with a 3d printed ASA case lol haha cool engineering.
masterMau: qualcomm did a whole report on how it improved cooling, its simple and very effective
Shashwatkthnxbye: how much did you personally work on comma four? is it all the comma team?
goldbattle: epoxy can cause increased chip stress, did you see any issues with that?
malateman: LUL
odiemac: QC evil bro maybe go Samsung. Their BSP sucks tho
masterMau: SHOUT-OUT NICK! he did a great job!
swimming_dragon: Fire the web guy live on stream
rliessum: cool animamations
Crazytacolover47: When will comma be used in the pit mining machines to get more copper for more comma products?
greatgitsby: reviewer 1 energy right now
showboat88: why use raylib with bindings instead of pygame? @georgehotz
Santiago_LHC: BrocoliPlus account
Ethan1G: wow that ui is dope
Shashwatkthnxbye: is the keyboard coded in react?
whiterunknight: erlich bachman is your refrigerator running
masterMau: what would you want in a comma app? the main thing i can think of is sentry mode
ALEX_rocket_420: everything should have a confidence ball
masterMau: ah yeah the car finder is great
odiemac: Even CarPlay has the parking reminder. But the app could be cool otherwise
swimming_dragon: why do you think everything sucks so much in tech, its like a race for lower quality every day
masterMau: the big thing also is controling the car remotely but that involves UDS stuff
pepebruari: enough comma. more tinygrad.
malateman: parallel parking is real life c++. manual memory allocation
kinvert_ed: And kick out the profit seekers that don't care about the tech
480i: how do you think noobs should learn then
masterMau: truuuu
OCPetrus: LUL
ChichinGerberstein: BasedGod
unsafe_ai: Hello hello how is it going? :)
Shashwatkthnxbye: why did you raise money?
swimming_dragon: lol
kinvert_ed: Embarassment requires self reflection and shame
theydontknowyet: Gotta form an internet society and wall it off from noobs
whiterunknight: tahoe is so bad
Crazytacolover47: How does party with models help make better tech?
borisevstratov: Apple's LIQUID ASS really sucks
malateman: true, people look forward to FSD and openpilot updates
odiemac: worked at apple 17 years and yes everyone with a clue left
pls_at_me: bro if i see AI tools added in another software
kinvert_ed: make it so good and free that they prey on another industry
unsafe_ai: Yep can't stand tahoe, rolling back asap
biggorillaz: it’s how money works, you can’t avoid market rules
Ethan1G: is there a chapter 8?
swimming_dragon: So the solution is a tyrant to eradicate the n99bs, I like that!
Joooooooooonas: we need more like tv industry
DarkAdepti: bro it's sad how bad the quality of most software is currently
kinvert_ed: That chess guy
masterMau: im pretty sure that exists
borisevstratov: Yeah. New comma designs are evolving. Less nerdier than used to be. Like the direction
swashhh01: when am i fucking the ai mhm
devscuffed: Lets make UI sexy but harder to comprehend and less responsive. W design
masterMau: there are AI vapes
ALEX_rocket_420: thank god Europeans are not in tech
parentdisgrace: LMAO
rliessum: healthcare engineers are the real heros keeping windows nt 4.0 going strong in hospitals.
odiemac: odiemac subscribed with Prime.
rliessum: butkickers exist
KettlebellSwinger: thrusts like johnny sins
rliessum: just a other ting, AI butkicker.
480i: is banana is banned word
pika2u: but what about making sick products and then partying with models NiceTry
biggorillaz: Hans had that while ago?
480i: nope
Shashwatkthnxbye: you think europe makes a comeback?
ibarres: Kappa
dikelito: Does openpilot work with no issues on Skodas?
swashhh01: theyre just using ai to justify the means and the valuations shoving it everywhere
tokyo_lights_: Europe is so cooked on so many fronts LUL
Hamudi069: Im from europe, we are cooked
480i: @Hamudi069 why
Hamudi069: ursula von der leyen
Shashwatkthnxbye: France is cucked
topscoder: im from Europe too and have to agree
lamboing: The comma four shop page is very tech-centric. As a user i miss information about the top level functionality of the device or im blind
rliessum: well, tesla fsd is going to be trialed in 2026 after a long time of barking up trees
480i: @Hamudi069 what is she doing
Gameplayer0618: @Hamudi069 did you talk to your grandparents? every generation is better off then the last
rliessum: Europe is fine, people wine to mutch
ALEX_rocket_420: Ursula Fond of Lying
tauzN: @rliessum southern europe wine a lot
Shashwatkthnxbye: you think you could have built comma in any other country?
lizardbutttt: Is there an RFC/RFD backing these decisions? Like, it's great you're talking about it all, but I'd rather understand *why* you made these decisions. Are there any metrics behind those decisions as well?
rliessum: (i mean the drink obviously, or not)
malateman: work at comma for the best technology comedy bits in the industry
HurricaneFP: spindrift?
rliessum: @tauzN haha
tauzN: @tauzN nothern europa beers a lot
RajarshiKhatua: in think it should show regional price, like in india it's approximately ₹100000
kinvert_ed: no air conditioner back then
rliessum: 19:10 here, beer o clock
Shashwatkthnxbye: Prof jiang says old europe was pretty good, worship mother nature
480i: I think I’d go back to 2000
Joooooooooonas: depends, do you keep your knowledge
k1ngafa: no twitter is a no for me
swimming_dragon: Bureaucracy, over regulations, retarded immigration laws, and promoting crime is Europe in a nutshell
henriquegarciar: hello friend
hardwallz: Only true if you are not the type that gets pleasure from lording over people.
lizardbutttt: Does comma.ai have any public RFD/RFCs for the curious to read???
hardwallz: I'm wondering if he'll talk about the SMT lines they set up and what they have on the "Ultimate Provisioning" thing. :)
henriquegarciar: can u JB my series x? 😁😁
kj_script: lfggg, i finally caught a stream wtffff
k1ngafa: @swimming_dragon its not just the politicians its also the people
rliessum: 404
biggorillaz: kek
rliessum: 30 day trial should be ok
Shashwatkthnxbye: how you make fun of frameworks like react and then build your shit in react?
odiemac: odiemac redeemed fail for 250 Bits
swimming_dragon: @k1ngafa agree
devscuffed: connectivity world wide?
ibarres: too much friction still needs a driving license Kappa
masterMau: be a prime member so that you can get a comma wrap! still WIP but coming soon !
pika2u: are there any downsides to not having any display on the device and using a phone to set it all up?
rliessum: products are difficuly, espec world wide
Shashwatkthnxbye: name five comma sized companies you respect
hardwallz: talk about the ultimate provisioning thing!
wowsoclutch: I'm thinking about getting one for my new vehicle
cryptovantrader: im building my first PNP machine
smurfd0: thats cool. doing it your own
rliessum: thats sick, full control. also your dc has the best vibes
swimming_dragon: would it be cheaper if it was out sourced? if yes how much?
ALEX_rocket_420: what are the margins like on a comma 4?
Gadaros: Gadaros subscribed at Tier 1. They've subscribed for 11 months! George wassup! Hope you doing well my friend!
biggorillaz: sick vibes drive creativity
Shashwatkthnxbye: what's your next move?
Ethan1G: Will comma move to texas one day?
p01s0nZ: yo
suraj_samal: up
ALEX_rocket_420: 60% niiiice
swashhh01: do you count just manufacturing shipping etc as well
borisevstratov: What are you using datadog for?
greatgitsby: san diego is too nice
wowsoclutch: I manage elastic on prem if you get sick of data dog
davidxd3212: Being in SD do you ever go to eat to TJ?
kenqz3: comma asmr
rliessum: MAX! like the purple tocuh
wowsoclutch: New comma looks nice
tokyo_lights_: 60% net is sick
odiemac: QC is evil bro. Samsung SOC is goated but their BSP sucks
Shashwatkthnxbye: on a scale of 1-10 how cracked are you at math?
rliessum: next, ultra MAX in red
masterMau: comma 5: now with the body included !
Shashwatkthnxbye: did you sell your AMD shares?
whiterunknight: Will there be a 4th of july special edition of the 4
480i: is there a car you like the best for comma 4
codepour: Is Comma a general product now or is it still sold as a "devkit"?
rliessum: san diego prop better then palo alto
smurfd0: Congrats!
kinvert_ed: 10X chef?
Shashwatkthnxbye: are all the robots going to be teleoperated by indians to replace immigrants?
masterMau: @whiterunknight that's a throwback lmao, the limited edition red comma 2!
whiterunknight: @masterMau That video was so good
biggorillaz: jeez
ALEX_rocket_420: advertising is for losers
rliessum: vibez no codility crap
swimming_dragon: what if comma wasn't open source how would you hire people?
pika2u: any downsides to not having a tiny display on the device? f.ex set it all up on a smartphone
Shashwatkthnxbye: if you're a kid, would you bother with competitive programming?
KettlebellSwinger: domain expertise
sk84uhlivin: Congrats on the release
greatgitsby: i appreciate how your management is mostly just engineers
malateman: any comma stores coming to like AZ?
KettlebellSwinger: LUL
swimming_dragon: lmao
Gadaros: lol
suraj_samal: have you watched dwarkesh and ilya pod ?
topmayer: this hiring is amazing, i was shocked when i first saw it, cool
kinvert_ed: You could still make bounties in a separate repo, extra work tho
biggorillaz: perfectly describes me
KettlebellSwinger: skills and normal ?
masterMau: be normal LOL
Ethan1G: skill based matchmaking
rliessum: your DC cooling is kinda sick, still running hot because of electric prices for AC cooling?
forthereals: first guy to come in, look you in the eye and shake your hand. just like 1965
pika2u: haha
Shashwatkthnxbye: @georgehotz what skills to build
tokyo_lights_: @forthereals golden times
henriquegarciar: bro my PC needs RAM where do i download it xd
kinvert_ed: "What did you do at comma?" just look at the repo bro
masterMau: it sounds crazy but its so true, i think the 10% of people where i work are actually normal
pika2u: LUL
philip0524: The openpilot github readme should be updated for v4, currently only  states v3
malateman: i have a firm TCP handshake
ALEX_rocket_420: Make sure to start the interview by announcing your pronouns
Shashwatkthnxbye: avg age of tinycorp employees
Nirfse: A bit too specific question, but: what's your workflow with prototyping the case/enclosure? You make a 3D model, then do you prototype locally with low scale injection moulding to iterate on design, or rather design once and go to mass scale production right away? how does is usually work?
topmayer: george, did you hear rust for CPython?
rliessum: a 3way handshake
MRTOMZ123: what cars do you let your eployees access
Shashwatkthnxbye: geo/hot
480i: I’m too noob. :(
DarkAdepti: how do you manage your teams?
bojosos: Do you do anything for comma now?
pls_at_me: pronoun company would be crazy
StiefbroerIkZitVast: wait i thought Waymo was your company
Shashwatkthnxbye: what are some cool applied ai problems these days?
kenqz3: insert paid internship questions
masterMau: is waymo finally in SD?
deepvision: People are the worst...
Ethan1G: wordpress
Shashwatkthnxbye: what you call cringe comma will be doing in 10 years
ALEX_rocket_420: Waymo car looks ridiculous
gatorhaha: i got robbed in a waymo
rliessum: hand above the blankets
lamboing: centered feels wronmg
pika2u: it’s ai generated
rliessum: litterly you are the passenger in your own car
k1ngafa: https://antigravity.google/ this is awful
odiemac: Their disengagement stats tho
Shashwatkthnxbye: from transistor to web browser still relevant?
Ethan1G: a cursor clone lmao
Crazytacolover47: Open pilot back seat driver AI waifu that yells at the driver for mistakes like not using a turning signal
alfred___d: is it under 1kb tho
k1ngafa: the website is awful
rliessum: more marketing budget
Shashwatkthnxbye: is commet browser what hammer set out to be?
rliessum: gui looks better then tesla's interface
borisevstratov: WAYMO's looks mediocre business school BS
rliessum: wonder how that would look at tablet size
Crasner: the comma website bangs so definitely not yalls lol
malateman: when is comma 7 that sits in the car coming out? i need support for my 01 accord
Shashwatkthnxbye: any other company that hires like comma?
alfred___d: font being bolded but the header being thin is freaky
bojosos: No transparent rounded edges on the comma website
borisevstratov: when you update tinygrad logo on github?
ALEX_rocket_420: every company should hire like comma
swimming_dragon: Waymo's website says: look it doesn't runover people, its safe!!!
shmupzy: how is the hardware dept?
kinvert_ed: HR gatekeeping the Engineers. Dumbest idea ever
cryptovantrader: that video looks like it was taken north of Encinitas
Ethan1G: will comma do a lane change on turn signal?
Shashwatkthnxbye: name your top 3 skills
mehdi_fifo: LUL
k1ngafa: waymo is a taxi service
tokyo_lights_: @kinvert_ed not only them LUL
ZonFibraRocha: using John Cena  to do a commercial would be something
kj_script: i am a bit retarded lol
ibarres: yes most people are retarded :)
MRTOMZ123: what cars do you let your employees access?
Loumardou: should I buy comma for a rav4 2025?
lamboing: Psychology does its thing if you want it or not
Shashwatkthnxbye: @georgehotz what skills do you have apart from programming?
showboat88: "As the world moves towards Rust, openpilot continues to become more Pythonic!"  Is th something to be proud of?
Nirfse: Re: I know this is a bit too specific, but what is your workflow for prototyping cases and enclosures? Do you create a 3D model and then produce a small batch of prototypes with a local injection molding company to iterate on designs? Or do you design once and go straight to full-batch production? How does this process usually work, any pitfalls/caveats?
gyne: i prefer minions
kinvert_ed: bugs bunny OUR CARS
StepPapa0: Family?
k1ngafa: you can steal the 20 cars
unsafe_ai: You can rap :)
ALEX_rocket_420: you can rap
malateman: he writes good sci fi
alfred___d: @georgehotz how do you feel about picking up girls in a self driving car?
Shashwatkthnxbye: guidebook for startups please
kenqz3: sony did
L1ghtxyz: When are we getting the next chapter of the story you were writing on your blog?
ThatOneDutchyGuy: shout out Sony Kappa
greatgitsby: LOL
Ethan1G: lmaoo
Ethan1G: return scammed by some kid?
davidxd3212: no way
SpeedWiener: @alfred___d self driving car super bowl ad spot OhMyDog
unsafe_ai: Yessss
RajarshiKhatua: what car companies need to do to support comma out of the box
swimming_dragon: yes
MRTOMZ123: yes do it
Nirfse: Should have made him make a "mission failed" video CoolStoryBob
Shashwatkthnxbye: did you give up on leaving USA?
suraj_samal: bro you should get married
tokyo_lights_: don’t dox the poor fella
Rossoneri2007: @georgehotz hi, sir. Did you use Codex or analogs?
ZonFibraRocha: do not redeem saar
cipher_space: bounty for hacking your network or website?
Shashwatkthnxbye: shkreli got a kid now
kinvert_ed: best robots you can make is mini Georges
DarkAdepti: what's the company culture like at tinygrad?
masterMau: how are you feeling about AMD since making your AMD blog post?
weimarer_republik: morality is fake, only strength works
tokyo_lights_: yeah, he did bad, but deserves a second chance to do better
tonos777_: monopolize the petaflop
lamboing: wtf
Rossoneri2007: lemao
b0da1234: bor what about kids
Shashwatkthnxbye: have u used shkreli's new SAAS
lamboing: got you
lamboing: fair
rliessum: fw unloadlocal
kenqz3: offsec folks are fuming
kinvert_ed: mcafee goat
Shashwatkthnxbye: telegram ceo a grifter?
tonos777_: now its all glowies and money grabs
eoj007: "Hello i took my CISSP. please give job"
480i: @eoj007 I got my A+
Shashwatkthnxbye: shkreli a grifter?
tonos777_: signal is banned in the EU
malateman: if survival is the goal for tech companies, what do you think about IBM?
k1ngafa: You need to turn on encryption on telegram
DarkAdepti: people are submitting vulnerabilities hallucinated by llms lmao
suraj_samal: why ?
weimarer_republik: most markets are saturated so people make up fake KPIs
showboat88: what would you use instead?
ALEX_rocket_420: when has France ever been cool??
rliessum: @tonos777_ not true
real_tyrone6: only scamers use telegram
Shashwatkthnxbye: truffle1 by simp4satoshi a grift?
HaXiChAn: LUL
cipher_space: roll your own crypto
rliessum: and drugdealers
RajarshiKhatua: main selling point of telegram is the features
frct1: @real_tyrone6 bs, the same as whatsapp
odiemac: If you're not breaking CAN encryption who is lol. We need you geohot
kinglouisxvii: o7
k1ngafa: Everyone in the Russian spehere of influence uses telegram
suraj_samal: his brother is a genius ive he's a ipo champion
tonos777_: the only crypto is monero
rliessum: Back to AI
showboat88: said the cheapeth guy
whiterunknight: Cheapeth is going up
Rossoneri2007: @georgehotz what is the best UI design you've seen lately?
kinvert_ed: Just tell them you bought GBTC
kenqz3: where is your eth george
khronicz: khronicz subscribed at Tier 1. They've subscribed for 28 months!
maland3r: !F
malateman: i have zero knowledge of crypto so i invest in zcash
tonos777_: zcash is a scam
Shashwatkthnxbye: did you actively make a choice between crypto and AI?
Joooooooooonas: good some good hard cheapETH
suraj_samal: they just consume a lot of energy just for simple transactions
Cubd_: But when can I pay for my Comma 4 using Comma Coin?
weimarer_republik: @georgehotz i live in a country where the police kicks your door in if you say mean stuff about the government, we only have twitter and telegram left for free speech
malateman: @tonos777_ how so?
neunmalelf: wait for next year
Shashwatkthnxbye: how much did u lose on meta?
davidxd3212: When a new singularity post ?
suraj_samal: @weimarer_republik what is youre country
MRTOMZ123: jeez 250k
StiefbroerIkZitVast: whatsapp is encrypted
neunmalelf: when more AMD 395+ cpus are all over the place
tonos777_: @malateman they are not banned from exchanges
rliessum: Only rich when its sold ;)
tonos777_: signal you can read the code
Shashwatkthnxbye: top 3 countries to live rn
hardwallz: Telegram uses their own channel for propaganda purposes. It's scummy.
splendid_beaver: Hi George, in what area of Hong Kong would you stay for 2 days ?
MRTOMZ123: @georgehotz would you still invest in AMD today?
TechnicBeam: Is the main difference between comma units what the connector is? IE: If I buy a new car in a year, do I just have to get a different harness to get it to work?
kinvert_ed: Online fren writing PQE (post quantum encryption) tool
tonos777_: signal only collect timestamp and thats it
lamboing: What dou you think about Fully Homomorphic Encryption?
odiemac: Spoiler NVDA is too high
malateman: @tonos777_ they make it hard to get and have insane KYC requirements to get it, so they are worried about it
cipher_space: they both too high
RajarshiKhatua: xmpp is still better, just need good ui wrapper
hardwallz: I would invest in Tenstorrent.
swimming_dragon: now look up Intel lmao
Cyberactive: nvidia and amd owners are cousins no?
frct1: @georgehotz what is Signal's country of incorporation?
topmayer: these investments of today will make the value go up i think
odiemac: Solve SDV's and then you have a taxi business oof
cipher_space: but the money is fake so…
tonos777_: @frct1 murica
Shashwatkthnxbye: what would a 18 year old hotz do today?
sunwellem: George in your blog "you can never go back" you said "It’s easy to see the appeal of conspiracy theories. Even if they hate you,". SO who's they? who are you referring to
neunmalelf: NVIDIA is "AI chips" as an addon AMD is "AI chip" build int #My2cents
日文或韓文字元設定顯: @georgehotz what about telegram secret chats, though? although it seems they made them so bad that no one wants to use them anyway so
zJev: LOL
TaterPancky: how about arm stock? is the architecture fit for whats coming in the next few years?
davidxd3212: Is chapter eight from your story happening ?
topmayer: for 25 year old guys? still the same ? :D
Ethan1G: once you get the bitches you start needing the money
tonos777_: hotz got the body count of genkis khan
ibarres: what story
k1ngafa: Telegram is mostly a social app too for the countries where it is very prevalent. They are also rotating their servers through a big IP pool and are hard to blacklist.
Shashwatkthnxbye: what would a 27 year old hotz do today?
Ethan1G: drop chapter 8 bro
frct1: @tonos777_ I mean like when it is needed, any country of 5eyes would easily get that data by any way. Would it legal or not lol
davidxd3212: Im really excited for them
Finol78: What are you writing?
Shashwatkthnxbye: can the comma...what would a 27 year old hotz do today?
TechnicBeam: Is the main difference between comma units what the connector is? IE: If I buy a new car in a year, do I just have to get a different harness to get it to work?
Ethan1G: does it change lanes
hexdhog: btw, I loved watching the Comma Hackathon, was really fun
tonos777_: when comma 5
sunwellem: george why don't you hop on gear to get jacked and you will get more bitches
real_tyrone6: how is comma gonna reach lvl 5 without rear or side cameras ?
TechnicBeam: Also, do you support a Prius newer than 2022?
RajarshiKhatua: when it will support TATA cars
tonos777_: what res is the new screen
StiefbroerIkZitVast: Bmw when?
Shashwatkthnxbye: does comma work on indians roads?
noktuh: LUL nice
HaXiChAn: haha
rliessum: at least they support it, no suzuki to be found :P
whiterunknight: subaru doesnt even sell 4 cars
k1ngafa: 1 billion idians
rliessum: read: non US roads :-D
Loumardou: there's an input written "discount code" what should put?
nick_dr1ft: does it work in my '97 Lada?
odiemac: Not on CAN MACSEC dude
bojosos: Does comma work on Russian roads
tonos777_: mercedes
verig0: you explained cooling for snapdragon 845 max, but still why not use new chips that more power effiecient?
lyrareturns: Infinity please
noktuh: brazil road tested?
wittentrip: mercedes support?
k1ngafa: Bro needs the margins to pay for the bitches
dp_smh: hyundai nerfed my 2025 elantra, it has the sensors for smart cruise but it’s disabled
Loumardou: does it work properly in snow?
Shashwatkthnxbye: cows, dogs, crazy drivers, no lines, no signals idk
okStevie: what went into deciding your favorite openpilot cars in that list right there?
Cubd_: looking forward to comma compute module...no need for faster snapdragon
TaterPancky: where can i read about comma's philosophy on being a python shop
Ethan1G: go use it in the snow, dude
rliessum: was loosing the GIL helpfull for the comma4 or is it at < python 3.14
tonos777_: what res is the new screen?
weimarer_republik: stop ragebaiting, chat
Shashwatkthnxbye: how was your india trip?
okStevie: hmm makes sense
RajarshiKhatua: indian roads are sometimes harmful for walking and running
StiefbroerIkZitVast: which car is yours?
kenqz3: toyota dealership when you walk in
ch333nchan: i got a new score in the controls challenge leaderboard!!
rliessum: DPI
cipher_space: what about traction control?  what happens in a skid?
hardwallz: Do you integrate the pre-existing sensors on the car in your algos? I.E... radar?
tonos777_: cool
suraj_samal: where r u gonna do the next funding round ?
sunwellem: george do you believe muscle mass and abs is quintessential to get girls or height
Shashwatkthnxbye: could comma have been successful without the initial people who worked there
arash99: does c4 provide drift aid?
gatorhaha: does it work in the middle of the desert in africa
Crazytacolover47: hyundai requires a connection to a third-party cloud service to change your brakes, I image such ideas contribute to having a new harness every year
MRTOMZ123: have you got any tv ads for the comma 4?
odiemac: All cars will have it soon
cryptovantrader: better than paying 15k for fsd
hexdhog: wish i could use it in the EU, then I would buy it
okStevie: thats already too much
Shashwatkthnxbye: noob programming lesson 2 never came out
ALEX_rocket_420: Buy a comma 4 to get comma equity
suraj_samal: whats the best pickup line
Cyberactive: whaat? talk ? to them?!
real_tyrone6: wen ai gf
Angry_Burrito1: Just show the girls your comma four lol
topmayer: george streaming just to practice talking to girls (talking)
DarkAdepti: do you try to maintain a certain type of engineering culture at comma and tinygrad? or do you only value competency?
tonos777_: get a comma u will get all the girls
danteeee666: @Crazytacolover47 wtf is this real
MohAngabo: Where can we buy your product?
karnbirr: what’s the reason behind the camera sensor upgrade from the older sensor? Apparently it’s worse HDR
Shashwatkthnxbye: left hong kong?
dijikul: rhyzLURK
Cubd_: Any benefit to installing the new harness box that comes with C4 if I'm coming from C3 (mid 2022) with old ethernet harness box?
hardwallz: A lor of cars will have SecOC in the near future. It might becone a  problem in the near future, probably before you fet FSD. :)
ibarres: are mobile socs perfect for comma needs or would there be benefit from custom edge tpu like accelerators
malateman: is jack dorsey the coolest tech billionaire?
tonos777_: femanon u get free discord nitro
Shashwatkthnxbye: thoughts on https://learnaifromscratch.github.io/
rustypaint: Its a femininominom
tonos777_: yes
Crazytacolover47: @danteeee666 yes, see louis rossman video for 2025 hyaudai
laobanftw: if i get stopped by a police should i say i have a c4 in my car ?
sirpearl: factual and true
Cyberactive: @laobanftw  LUL
rliessum: where is the egpu going to live in the car then
Angry_Burrito1: all girls like a guy with four commas lol
rliessum: long usb calble?
Ethan1G: Can I drink and drive with the comma four?
Shashwatkthnxbye: do you still talk to shkreli?
kenqz3: gpu asmr
Joooooooooonas: external gpus for comma, not gonna work for normies no?
rliessum: chip is small is the freaking sync and fan blowing it up
k1ngafa: @Shashwatkthnxbye whats up with shkreli?
whiterunknight: noo but we got a npu with no api
greatgitsby: melt that 12v!
k1ngafa: @Shashwatkthnxbye bro is clearly a grifter
dijikul: everything is computer.
weimarer_republik: this is what the ai gf looks like without makeup @georgehotz
hardwallz: You can put the cooler on the roof and the faster the car goes the more you can stress the GPU.
Shashwatkthnxbye: hotz and shkreli were all i watched as a kid
karnbirr: how are you guys gonna make the comma compute reliable in a car (power and heat?)
Clee_Torrees: h100 on the trunk LUL
HaXiChAn: lmao
lelqganka: hello
rliessum: if it works in the DC it should work int he car, driving wind
whiterunknight: Its gonna die in LA traffic
sunwellem: do you believe thinking in words vs pictures matter
k1ngafa: @Shashwatkthnxbye same but shkreli fell off after prison
StiefbroerIkZitVast: does it run Crysis?
danteeee666: what if we put gpus in space instead of earth
real_tyrone6: will comma 4 get you to the 3 commas club
kinvert_ed: Noctua fans
Angry_Burrito1: You can use the cars own radiator for the GPU
kenqz3: LOL
dijikul: what if we install a fish tank and inference underwater to offset cooling
Shashwatkthnxbye: Ye kinda did hotz never mentions shkreli nomore
tatted_Schnitzel: can this be used as dashcam instead of having separate camera?
kinvert_ed: inflation gets us in the 3 comma club
lukasf6: Connect it to the air conditioner for sub ambient cooling LUL
nick_dr1ft: I just love the fact that Comma works in Tesla's LUL
tonos777_: will a comma 4 get me more bitches tho?
TechnicBeam: Upgrade to semicolon when? Jonathan Blow does semicolons every day.
rliessum: with subscription ;-)
Ethan1G: Does it say goodbye on the screen when I turn my car off?
suraj_samal: @Shashwatkthnxbye thanks
Shashwatkthnxbye: Shkreli says good things about hotz in his streams
topmayer: i should make a comma cover company, (pink for girls)
pratikshit08: do u ship tinygrad pc in india
tonos777_: bro he has a harem
karnbirr: have you guys found a new SoC candidate for the comma5/4X yet?
rliessum: true, not yet
Shashwatkthnxbye: hotz got crazy working memory
tatted_Schnitzel: you guys should add integration to car starter for online subscriptions
odiemac: Singlethreaded on the phone
StiefbroerIkZitVast: is there a live salescount? You should add a streamalert everytime you sell one, that might convince me
rliessum: thats a long usb cable to the trunk
P4sik: no BMW?
rliessum: grafana dash up
hexdhog: you can plug a GPU over usb on a comma right?
Stroj14: there's no Renault?
kenqz3: opinion on european fsd laws
ArbitRandomUser: whats the verdict on amd as of now ? hows team red doing
neuralnetnemesis: also no benz
tonos777_: overclock the gpu 1000W baby
neuralnetnemesis: wut
Cubd_: I heard USB GPU won't work well on C3/C3X because of GPS issue?
MohAngabo: Mercedes please 🥺
hardwallz: Wait... what? You can attach a GPU to the comma? I thought you were joking.
rliessum: that egpu comma4 thing screams for a demo video thing, thats cool.
pratikshit08: do u hire remotely
karnbirr: what’s holding back full MLsim (0.11)?
malateman: AMD turned it around faster than i thought
PUBGmasterClutcher93: i bet Lisa Su has a comma in her Porsche
real_tyrone6: does software use blinker for bmw
dijikul: okay hippy
weimarer_republik: any plans to run comma in an ai datacenter and stream it over mobile?
cactusvacuum: GabeN gonna help with the amd driver
dijikul: haha oops wrong chat
tonos777_: they are riding the jim keller arch hard tho
RajarshiKhatua: did you see the steam machine
voids33ker_: i'm curious to see how AMD's upcoming ARM chips are gonna perform
HaXiChAn: haha
Shashwatkthnxbye: need tinySolarPannel
PsychoSocialxX: just put cancel before x
Joooooooooonas: xcancel dotcom works
guido0x0: Call him
Negened: man that was fixed for couple weeks when u were at twitter right?
malateman: he doesn't want people scraping so he can sell data to ai companies
Ethan1G: i thought you did ship that at twitter
stovecat: gotta intern again
Shashwatkthnxbye: have u used grok's ani?
k1ngafa: Google cloud has him by the balls
ibarres: LUL
swimming_dragon: lol
tonos777_: u dont want 10 baby mamas
scotty529: amd gpu perf are on par with nvidia?
Shashwatkthnxbye: sup with lex?
deepvision: if ur girlfriend becomes ur wife im very worried about the company nr 3 @georgehotz
deepvision: KEKW
Shashwatkthnxbye: do you think marriage and kids are for noobs?
hardwallz: Did you check out Stoke space? It was pretty impressive what they did with a small team.
kinvert_ed: blue origin prob has pronouns tho
MRTOMZ123: when did you make your first million george
swashhh01: isnt xai kinda impressive though he definitely took a smart bet
PUBGmasterClutcher93: blue origin did land a big rocket tho
Shashwatkthnxbye: he was 24
pika2u: LETS GOOOO TO THE MOOOOON
pika2u: DinoDance
RajarshiKhatua: PewDiePie made a tinybox
kinvert_ed: Does red just work with tinygrad, not torch etc?
DarkAdepti: the joe rogan video of him saying he uses grok to do epic roasts of people at parties to make them laugh is so sad. all he wants is to be called funny lol
MohAngabo: Expensive
swashhh01: pewdiepie living the life
scotty529: amd gpu perf are on par with nvidia?
Shashwatkthnxbye: are u still logang?
ibarres: need tenstorrent box with maximum noise possible
k1ngafa: Whats the point of VW group putting encryption into the onboard communication lately
TotomanRecai: cars are sooo expensive ın Turkiye sorry maybe in the future
kinvert_ed: Yeah idk how good Torch handles rocm etc
tonos777_: accept monero
nather2k23: Can we omarchy in that lol
MRTOMZ123: you playing any games atm george
hexdhog: when tenstorrent over usb on tinygrad?
en111: when i see a field for discount code i immediately pause
rliessum: java boyz
PUBGmasterClutcher93: was Jim Kellers reputation fake?
tonos777_: LMAO
Shashwatkthnxbye: jake paul vs joshua who u got
swashhh01: nah
odiemac: LUL
karnbirr: what’s holding back full MLsim (0.11)?
hardwallz: No, you get this wrong. It's because they want to sell shit to you.
Cubd_: Gotta keep those Kia boys at bay
RajarshiKhatua: in hackerone
malateman: i think they just see subscriptions as their future and have encryption as a business requirement for that
odiemac: Its true I worked at a major OEM
tonos777_: jim keller is why AMD is great NOW
hardwallz: They want to sell subscriptions. so the car makers need the encrypted can bus so you can't change your shit.
real_tyrone6: i drive a tuktuk cant use the comma sir
odiemac: Jim Keller doesn't know SW does he
dirt_eater99: any black friday sale on c4 or 999 for a while?
swimming_dragon: when tinycorp chip?
Shashwatkthnxbye: is late 20s too late to get into computers?
MRTOMZ123: are you playing any games currently george
hardwallz: I wrote SecOC implementations. We automotive sw engs are a bunch of dumbasses.
kinvert_ed: Beff Jezos thermal computers?
tonos777_: what do you mean by understand software?
odiemac: Where is latners startup tho
sunwellem: george your blog "we cant go back" is one of the most cryptic literature I've read. Do you want to read that and add more context to your words
k1ngafa: jonblow is a dick tho
swimming_dragon: how would you explain/define software?
ArbitRandomUser: have you tried out reactant.jl , the've done some crazy stuff running on XLA
Shashwatkthnxbye: latner, carmack, karpathy,  blow,  keller who else?
odiemac: Bosch and their SW stack was hiliarious
neuralnetnemesis: what about Nikola
neuralnetnemesis: HAHA
SpeedWiener: @Shashwatkthnxbye is ignoring tech still an option these days?
freiheitswag: what about pony ai? @georgehotz
wirtuosis: what about wayve?
onvo: Aurora who bought Uber atg
kinvert_ed: I got to work on the Aurora truck for a while.
hardwallz: What advice would you give to your competitors in  the Self driving space?
odiemac: What happened to Anderson and Urmson how did they F it up so bad
k1ngafa: Jon Blow still gatekeeping his language
Shashwatkthnxbye: who was that cheapETH competitor?
SuranDuran: Missed u bro <3
wirtuosis: Jon Blow bald for a reason
TechnicBeam: @k1ngafa It's still changing, getting better. If he released it, it would have to be stable. So he's actually doing the right thing
Shashwatkthnxbye: Terry A. Davis
MRTOMZ123: you playing any games currently george
tonos777_: what do you mean they understand software tho
Shashwatkthnxbye: explain us software
onvo: @kinvert_ed I worked at atg a short while before they got bought out by Aurora lol
odiemac: How bad is going to GM for Anderson versus Aurora
Shashwatkthnxbye: thoughts on friend necklace
DarkAdepti: what do you think is holding back tesla? @georgehotz
Unknowing: saw you using omarchy, how you liking it? @georgehotz
k1ngafa: @TechnicBeam can people without clout get access to it?
pouryakillsound_live: toyota + comma > tesla
Shashwatkthnxbye: i want a computer that i can ask to think about something for several days
monke_poo: any competent chinese labs?
Unknowing: using it too, liking  hyprland a lot
marvooy: rails commuinty XD
jaysrod: @Shashwatkthnxbye you just have to put software on it bubba
tonos777_: hyprland sucks
pouryakillsound_live: tinyarch comming?
itisciprian: i am on row arch with hyperland
sunwellem: george what do you think of tinybox competitor truffle computer by some twitter/X anon. I believe that dude is a grifter
b0da1234: are you coding or working today or what
k1ngafa: Hyprland and their guy is cool too
pouryakillsound_live: arch is so clean man
swsh: swsh redeemed awww for 1000 Bits
Shashwatkthnxbye: yeah is truffle a grift?
odiemac: You know the BS is deep when Mira Murati gets $1B and she's a mechanical engineering who was product manager for Model X
scotty529: dhh 7 hour on lex is good
ArbitRandomUser: steamOS is based on arch too
nather2k23: That's what endeavour os is for
Shashwatkthnxbye: https://www.reddit.com/r/LocalLLaMA/comments/1bd2ekr/truffle1_a_1299_inference_computer_that_can_run/
pika2u: MingLee
swimming_dragon: does waymo have any chance if tesla launches robotaxis? (cheaper car and better AI)
k1ngafa: This stuff was all i did when i was 14 lol
Zeevo: @georgehotz Thoughts on Ilya's Safe Superintelligence company? What is he doing?
tonos777_: steam is running arch on all their machines now
sunwellem: mira murati is a high ticket sex worker for the homosexuals of SF
scotty529: dhh 7 hour episode on lex is good
Shashwatkthnxbye: Do you agree with?:  Personal Computers emerged from (3) stacked-innovations  → microprocessors (smaller)  → operating systems (useful)  → visicalc (killer app)  Personal AI will emerge from;  → smaller GPU  → fast inference engine (new OS)  → killer app (?)
wirtuosis: polished linux is gonna win
k1ngafa: @tonos777_ they've been working toward it for 15 years
kinvert_ed: RayLib seeking sponsors, PufferLib top sponsor atm
k1ngafa: Have you seen the Steam box?
RajarshiKhatua: wayland need to go stable soon
nick_dr1ft: I work at a danish High end HiFi audio amplifier company, and I hope to god a really good linux distro for audio stability comes out since MacOS is getting a little old
MrWhite911: How good does it work outside of US? Will openpilot be worse as it has less train data?
tonos777_: yeah but u dont get the M chip
weimarer_republik: @k1ngafa steam machine
siberianw: living with linix on high end hardware is fun, until the cpuid bit gets locked due to randr
Shashwatkthnxbye: You know that a local AI chatbot  is kinda useless,  So what’s the killer app?  You know that inference  on an Orin is slow,  how do you make it fast?  You know that GPUs are large,  how do you fit them  in a small form factor?
scotty529: can you go back on lex?
SaneGaming: Will openpilot support navigating city street turn by turn style at some point? or will it always be mainly highway?
pouryakillsound_live: @tonos777_ we could the snapdragon though
karnbirr: geo why did you guys switch away from the OX03C10 for the c4?
mysticfear: what about a modern phone that actually fits in your hand?
k1ngafa: @weimarer_republik yeah
whiterunknight: @mysticfear Youre talking to a fold user
Shashwatkthnxbye: do you believe in embodied ai?
tonos777_: dwarkesh > lex
kvertisas: why do you prefer macos over windows?
ArbitRandomUser: what does he use raylib for ?
karnbirr: when 0.11 (full mlsim)
Shashwatkthnxbye: lex is dumb
k1ngafa: Have you seen the new hardware from Valve?
HurricaneFP: when can we expect tinydiffuse?
Shashwatkthnxbye: he asks the worst questions!
pika2u: windows is one big ad, i literally have to watch an an ad after booting up my pc
Ethan1G: He asked you such bad questions
teerv: @Shashwatkthnxbye it might be, but hes still levels above everything else
siberianw: people think he s a russian spy and industry plant... jesus christ
Ethan1G: i think he was tired
fazzydota: he is a yes man
Shashwatkthnxbye: name one recent lex pod u enjoyed
Shashwatkthnxbye: one
cryptovantrader: gotta go back on Lex, really like those interviews
k1ngafa: @Shashwatkthnxbye why u hating dog
danteeee666: @pika2u my pc still restarts after update even tho i click update & shutdown
swimming_dragon: he's non technical interviews suck, too much boring childish politics
PUBGmasterClutcher93: Jim Keller 1 was great
ALEX_rocket_420: russophobia is hilarious
scotty529: dhh 7 hour episode is great
needwotlich: why wont lex have curtis yarvin on after you mentioned him
suraj_samal: dwarkesh and ilya just droped a pod
metsu_gadoken: nah guys, lex's interview with george was great
davidxd3212: dude the Kanye one was crazy, he didn't back out
TechnicBeam: My wife drives last year's Prius, and she needs comma four more than I do =)  Is there a timeline for models more recent than 2022?
SuranDuran: well hes a genius so no sht :D
MrWhite911: okay kanye west one was great. But is this because of ye or lex?
paradox109: with zelensky?
sunwellem: george why do you not stream on instagram now
pouryakillsound_live: kanye west episode was like kanye west's hosting
hardwallz: Dwarkesh sutton was a bit cringe.
fazzydota: good ol eye on ai hehe
cryptovantrader: Gotta watch Your Moms House, it heals the soul
pika2u: do u like roe jogan?
ALEX_rocket_420: you should go on Joe Rogan pod
tonos777_: rooooee joooogan
Shashwatkthnxbye: u smoker da heefer?
suraj_samal: machine learning street also have droped a pod with person who made transformer
karnbirr: when is 0.11 (full MLSim) coming out?
SuranDuran: dude i loved ur podcast with lex
k1ngafa: Have you seen the Valve hardware?
Shashwatkthnxbye: why does schmidhuber keep asking for credits
scotty529: can you sell me a robot yet?
hardwallz: I recommend Mike Duncan if you're into history.
tonos777_: its the year of the linux desktop
RajarshiKhatua: TBPN
fazzydota: any progressive you would want to pod with?
Joooooooooonas: the valve fex stuff is crazy
MrWhite911: What can comma 4 do what 3 cannot do?
fazzydota: good old Bernie
k1ngafa: Whats up with TBPN they have no views but insane guests
voids33ker_: i wonder what will gabe do to sell those machines with the current RAM prices LUL
pika2u: hotz vs yudkowsky round 2 when?
wirtuosis: ima be talking on ai tinkerers warsaw tomorrow. any tips for public speaking?
malateman: did you write your last blog post after losing a parlay
ALEX_rocket_420: Rogan would bring the real unfiltered hotz out of you
siberianw: gotta halt and catch fire, have a good one boys and girls
scotty529: I want to buy a robot for my apartment from you
k1ngafa: Nah
Shashwatkthnxbye: is yudkowsky doing reverse psychology
sunwellem: Do you know Mike israetel he tried reaching out to you for podcast i guess
WojcieszekB: hi
Gadaros: mamdani gonan give me free stuff,, i like him
whiterunknight: new yark
govert72: How do you think about the super-smart large models vs. small ML models for specific domains? It feels like large models can do everything better, but so wasteful.
k1ngafa: @sunwellem Hes cancelled lol
MrYasser2194: @sunwellem he a fraud
Shashwatkthnxbye: do u listen to flagrant?
Shashwatkthnxbye: how do u keep up with all the new ai papers?
pika2u: we need joe rogan, mike tyson, george and alex jones all in one pod MingLee
weimarer_republik: george for president 2029
k1ngafa: Population decline bro there is no help
scotty529: Please run for governor of CA, george
suraj_samal: blackrock
hauntigton: @pika2u LUL
swimming_dragon: But they all suck, non of them want to make more energy
SpeedWiener: @Gadaros hah! change? can you spare some change king?
MrWhite911: :D
sunwellem: bro but america is so goddam prosperous anyway why do you guys believe better is possible it is already paradise. with beautiful women
Crazytacolover47: You should read the two new substack posts from Michael Green
Negened: what happened in 1971
HaXiChAn: maneWOAH
tonos777_: we need a more virulant pandemic
greatgitsby: best comma 4 launch stream ever
davidxd3212: yeah, fuck'em old people
voids33ker_: steam machines might get cancelled or delayed because of current RAM prices
Shashwatkthnxbye: im about to take a year long sabatical what books would u recommend reading?
k1ngafa: Nah bro I think ur delulu on that one
kinglouisxvii: BASED
weimarer_republik: based
Ethan1G: oml
scotty529: Please run for governor of CA, georg
Pravus_: lool
kinvert_ed: don't be a stranger bro
pika2u: wtf bro LUL
malateman: will you do ai advent of code this year?
wirtuosis: we need country-as-a-service
k1ngafa: They will die soon
Shashwatkthnxbye: COVID 2.0
weimarer_republik: @k1ngafa "soon"
Ethan1G: wait?
lamboing: @wirtuosis xD
tonos777_: LMAOOO
k1ngafa: 20 yrs
pouryakillsound_live: @georgehotz is openpilot entirely on tinygrad?
Shashwatkthnxbye: COVID FAILED
milkmilklemonade: lmfaooo
tonos777_: the BOOMERS WILL NEVER DIE
k1ngafa: Putin has aura tho
Shashwatkthnxbye: MAKE COVID GREAT AGAIN
DarkAdepti: they are selling houses they bought with a summer internshiop job for 1.8mil bro
nvixii: boomers never say die
sunwellem: exactly
P4sik: putin is a dkhead
Shashwatkthnxbye: cheap houses = blackrock buys all of em
Negened: when it turns into politics its a good place to end, because everybody and their mom got something to say
kinvert_ed: tinyhouse
whiterunknight: 1000% property taxes
tonos777_: apple needs to make houses
Ethan1G: build more houses on treasure island, sf housing crisis solved.
kinglouisxvii: pausechamp tinytinyhouse wen
Crazytacolover47: scarcity based business models are BS
mysticfear: spindrift lemon soo good
sunwellem: self maintaining houses
voids33ker_: LUL
weimarer_republik: we love black friday
tatted_Schnitzel: SeemsGood
rs_ggs: bro? no hands on wheel?
RajarshiKhatua: ✌️
kinglouisxvii: monkaS
pika2u: tesla making houses soon
k1ngafa: Asmon went life lets go
xxer60: love to you bro
kinvert_ed: choose wisely
suraj_samal: yoyo
monke_poo: make sure they are old
rectanglefanboy123: thx gonna go kill somebody
k1ngafa: Good timing
Shashwatkthnxbye: bye
sunwellem: stream on Instagram
suraj_samal: love u
Gameplayer0618: byee, God bless
SpeedWiener: best! future is bright
weimarer_republik: gg
look there actually is a a beach and
there's a pool so I'll show you the pool
uh so I'm not in the wrong category
there's my
pool what's up
boys we're drinking this this hinin this
what we
have
um no but we got we got uh
some things we got to speak
about some things we got to speak about
right
that's that's some guys that's some guys
rap
lyric wait for the next verse cuz we got
a couple things we got to speak about
you know always wanted to do one of
those rap
battles I'll look like the type to win a
pullet surprise until I pull it surprise
and bullet your eyes I saw credit where
credits
though
um sup chat they coming for you the
Choppers helicopter
propellers uh yo yo what up we hanging
out we hanging out George looks 30
thanks bro I'm 31 I'll take that as a
compliment
um wrap about the iPhone
2g it wasn't so flat it was kind of
thick top was made of metal bottom
plastic you know my name's George
Hots never wrote
shit went down in history I jail broke
it yo this is why I don't freestyle on
stream but please in comments please
chat don't be
mean I don't want want to be vulnerable
like kitty
Pride were you all there the night my
ego
died
H is Bitcoin dead or will it bounce
back um no no my freestyle
bars are like Jack in the
Box no good
or an old dude who can't get it up no
wood two things I don't do I don't go to
class and I don't eat
ass so faded bro so faded I had I had a
a quarter
beer um
I'd sub a thousand time no this
apartment doesn't have a hot
tub
um no but all right look here's what
we're really here to talk
about
um you guys come to
ComicCon no you missed you missed my
very bad freestyling yo but like it is
kind of fun you have like go online you
get like a random word generator uh and
you just like make the random words
rhyme like you know Chiron man
Chiron uh the hose will be a Comic Con n
but like it'll be a it'll be a good uh a
lot of events now are run by the you
know the professional managerial
class uh and they suck
so ComiCon is not run by the
professional managerial
class uh ComicCon is
where uh I'm drinking a Heineken but
that's only cuz that's what I had in the
fridge we can go look in the fridge my
beer selection wasn't great I ran out of
Bud Light Bud light's the true beer of
Champions um
when we die of a artificial no blood
light bro blood light is the true Beer
champions
um 10 VIP seats we've sold five so far
so you know get in if you want if you
want one of the other
five
um what can you do with Comic Con Bros
you could witness the
future faded bro faded no we're not
building a processor today no but you
know we just you know we're ordering
tomorrow some AMD epic that that 32 core
frequency
optimized 1 tbte of ram I'm going to put
830 90s in
there
uh yeah it's going to be
good where will it be streamed it won't
you got to come to the event bro you got
to come to the event
um what's Comic-Con go to comma.ai click
the green link see what ComicCon is yo
yeah we got sick computers yo I've been
working all right so here's here's the
great mystery boys here's the great
mystery you know how I've been trying to
start an AI chip
company I discovered that Nvidia is
great but for some reason
they advertise 30 Tera flops or 300 if
you use the tensor course but I'm only
getting three where are the teror flops
going and we are going to investigate
this no not Comic Con ComiCon you get
it who stole your
flips who stole your
flops
yo sick bars bro I'm on a roll I don't
do yoga but I wouldn't mind body and
soul
Fresco credit or credits
still taking the cock out of
Croc
um yeah man Fresco and then he ended it
with
Splash uh Solon just yelled about a lot
of like you know he just he just yelled
about gay people a
lot uh I don't know what xqc
is no it's 300 teraflops I think with uh
with the
tf32 maybe it's only maybe it's only 150
but still if it's 150 where's my 150 I'm
getting three woo hype
train what's
xqc I don't know what sawon I don't
watch any of those
movies yeah nocoiner bro laughing at all
you crypto fucks who lost money you
know me I
got big stacks of Fiat
money you got no stacks of crypto
money put it all in
eth 10x
margin and now you're
[Laughter]
[Music]
poor no I'm a I'm a nocoiner bro I'm a
nocoiner
um oh 300 ter fls with structural spy
but still where's my 150 we're off by
orders of magnitude here I think Nvidia
is stealing the
teraflops I think it gold bro you guys
want to see my collection of
silver n I'm not showing you guys my
collection of silver I'm not showing you
where my silver
is um the creation of CH was the
top called the top
bro um Can AMD do ML on Linux yet
no Tesla's new super is pretty nice wait
till you guys see
ours um I bought the first note of it
today well we haven't order yet we're
tomorrow but we went with the frequency
optimized up the 2.95 GHz 32 core dual
AMD epic third generation cores we got
one tbte that's
16 uh dims 64 gigabytes each so we get
that full 3200 megahertz of
frequency don't put two dims in even
though it supports two dims you go slow
if you got two dims that's why we got
one
um since we're not in a data center
we're going to pack that shit full of uh
390s yeah I know Tesla copy me again
yeah announc yeah Elon yeah announcing
this event I know what's up I know
what's
up um AMD Milan is that is that the new
one uh which Nicks so yo we built out
this whole infin ban Network like we put
infiniband in thinking it would make
things faster and it turns out it wasn't
infiniband that was making our multi
computer be bad it was fucking tensor
flow so we switched to pytorch and now
we can use the 100 GB ethernet we have
as the normal Fabric and it works great
um so the moral of the story is don't
use tensorflow uh we have these I think
like it's like two 50 gig Nicks on like
a
pcie uh card and yeah we uh you know
just hook those 50 gigs into this big
Dell switch we got
um pie torch master I that's right don't
use T So
flow um usually using the cube yo
everyone's on board for the cube man
we're talking about systolic arrays
today work no one's on board for
systolic arrays everyone's on board for
the
cube uh could probably do 200 or 400 G
in this rev we could up the bandwidth I
don't know we can talk about that um I
do got them Gen4 pcie slots but I hate
paying a lot of money for network cards
G you want to buy you you you try to buy
200 gig ethernet is like expensive 100
Gig ethernet you can afford I I think we
might have 200 I think we have dual I
think we have two 100s I I got to go
walk but yeah then I have to find some
stuff and so for Gen 4 and that's a lot
yeah we got them 8 390s the two slot
blowers you know real
nice
um yeah know thousand bucks for fucking
Yeah well yeah you know uh do I have
Tesla stock no it's overvalued I sold
that shit um became a millionaire went
downhill from
there off his swivel chair screaming
life is still unfair till I get a real
career what the fuck am I going doing
till then two kajillion pairs of super
villain boots in the mood to kill it I
plow this scop the villain inside the
food pilion a
Build-A-Bear oh man remember when Eminem
was good
Shady XV Cipher
yeah um 1,000 bucks gets me two 200 gigs
I don't think our switch supports 200
gigs though I want two 100 gigs on PC
because that's not even PCI is only
going to support one 250 gigs so I'm
like where's my bandwidth
going before the cringe Trump shit yeah
the Trump shit was cringe and like it's
just I don't know that might have been
before kamakazi I thought kamazi was
pretty
good get a beat out bro you'll get into
the
flow um what my bank roll I do not play
poker
uh $600 or so yeah all right fine maybe
I'll pay $600 for that
card um MBT MBC I don't even know what
that is that's how much I didn't follow
Eminem after like Revival or whatever
like kamakazi was good no I don't know
the new album purple pills yeah I smoke
so many places I seen so many faces but
nothing compar so there's blue and
yellow purple pills
man remember what rappers used to say
shit you know like like real shit yeah
not like you know are these going in the
NADA data center yeah I'm going to my
NADA data center it's a lot of kilowatts
of gpus yeah we got we got stacks of
those racks are
like we have like mini racks a racks are
uh uh 25
U 25
you that sounds right I think we put I
think we put five machines we got the
hump you know we got the GTX hump we
don't actually need the hump anymore for
the
309s uh we can put the old covers back
on
them Cruz got a 10 billion line of
credit and they're going to blow it on
Cru Origins man you know what I'm going
to show up one day I think we'll be able
to buy Cruise Origins for 10 cents on
the dollar you want a $3,000 Cruise
origin now here's the catch it doesn't
come with any software so if you wanted
software to go with your $3,000 Cruise
origin you're at a lock but it is only
$3,000 it has a nice motor and a nice
battery
right um will the building give us
enough power no it's not a 10 kilowatt
machine it's not that crazy uh I think
the machine may be 4
kilow uh well I it's got four 2,000 wat
power supplies 2 plus two so yeah it's a
it's a 4 kilowatt machine will the
building give us enough power no that's
why we're looking for a new
office um I'm never going public cuz I
hate Bankers do I want to sell myself to
Bankers I made a g today but you made it
in a sleazy
way uh we are drinking a hinin boys this
we're drinking
hinin um no no no stop with your
parentheses
bullshit it's not damn it's the system
man I hate mik all right all right um
it's like
what do bankers want to do but make more
money even if it's devoid of anything
that has any human
value uh you know why is only all the
people talking like that fucking
Communists man I'm a
capitalist but like I don't want Banker
shit I want like flying cars
yeah see see what I mean like where's my
flying car I got I got 200k to Wild
right now who's going to give me a
flying car like nobody and if they did
it's going to be some unsafe oneoff
piece of shit I want like a nice
reliable flying car you know no no
corporations where's Alex been been
around so Al going land
tomorrow we would have 4 e cars right
now if it wasn't for banks I think that
might be true man I think that might be
true do a direct listing if you you want
to cut out the bankers yeah but then I'm
still slaves to whatever like you know
I'm not a fucking whore do I look like a
whore I did talk about this morning how
much you'd have to pay me to eat Jack In
The Box and like we agreed for 100 I
wouldn't do it but for $500 I might eat
some nasty Jack in a
box right so that's all I'm saying right
like but am I a h of fucking banks
no red pill you want herbit um
look I admire what her's trying to do
but
like the thing about the internet the
thing that made the internet great was
that the internet gave you a new power
the internet let you
communicate uh across you know oceans
for nothing right like you guys remember
that joke on like bash.org right
remember that joke it's like oh hey hey
just chatting here hey just chatting oh
by the way uh you know you know don't
you hate those longdistance chat charges
oh yeah yeah yeah longdistance chat
charges are the worst by the way bro I'm
in Finland you've been chatting long
distance this whole time
no Bob o Bob logs off IRC you
know um so yeah the moral of that story
is the internet was cool and gave you
new magical powers see that's what we're
trying to do a comma right we built this
little box that gives you a new magical
power it's a magic iCal power
man
um you like my hot tub yeah is this what
they do on hot tub streams I've never
watched a hot tub stream should can I
show nipple is that
okay um Hunter to
yo yo that bash.org man y'all
remember uh what do I think of Wall
Street I think it'd be cooler if they
sold walls I think it'd be cooler if
they built walls you know build
something
real um whoa whoa whoa there is a pool
right down there you guys see my pool
yeah it's my
pool you won't eat it Jack in the Box if
you're drinking hanin's an okay beer
okay I mean it's not a Bud Light Bud
Light is really the champagne and beer
sorry Miller Light but I'm stealing your
slogan
uh a street of just
walls I'd be sold on that who's my
favorite
rapper I don't think I'll make it hang
in here another day I want to get
Spirited Away every time I'm near it I
run clear the other way disappear and
never
stay uh MF Doom
man uh I want to kill a beat and
resuscitate it in two minut I just want
want to be like Doom with it I want to
kill a beat and resuscitate it in 2
minutes no Committee of clones to ride
cock and say leave Kitty alone they're
Criss Croc to me you don't know why all
the boys flock to me bitch draw your
eyebrows on then talk to me yo she was
hard man she was
hard
uh yo I don't know if anyone's everever
said new Drake
wow I'm good man those are my lives
bro
um this is the smartest place on Twitch
no the best rapper will never be based
on uh Bert checkout0 HP Lovecraft about
why AI can't write all right you know
like all you little like yeah you know
what AI could probably replace a lot of
BuzzFeed writers right like you know
what I
mean why turnips are
racist I think I think GPT could write a
pretty good article about why turn-ups
are racist you
know
uh yeah yeah zero HP Lovecraft bro Oh no
I got a book but no the book's too spicy
for twitch I think I think that book's
too spicy for
twitch um where's the pool yo pool's
right down there yeah pool's closed boys
pool's
closed
uh why did I like Bronze Age
mindset oh is it Mike mbook oh I don't
know who that is
[Laughter]
uh this is not an Instagram live stream
this is Twitch stream boys real spicy
shits on Instagram you got to follow
Instagram um got follow Instagram follow
George house on Instagram yeah I got
that blue check man you really want to
get laid get a blue check on
Instagram uh nipples are allowed if I'm
in the pool wait is that really the rule
like if I were to like lift my shirt up
right now and like show you guys nipple
like that that'd be against the rules oh
man I don't get banned from twitch over
nippel you know if I get banned from
twitch it's going to be because I said
some spicy
shit n are too pedestrian my nipples
look just like your nipples unless
you're a girl then they're a little
flatter um when am I getting partnered I
applied once I really represent the
brand would I be a good candidate for
being a twitch partner and if I go smoke
some weed right now is that
acceptable see my blue check much famous
wow
uh you're looking at
ASMR inflence Say Something Real spicy
and see what twitch
[Laughter]
fix uh think of the advertisers that's
true I do have to think of the
advertisers advertisers matter bro you
know what used to be a great subreddit
are consumed product they tried to
restart it on like the dowins but then
it was political and once ship becomes
political it doesn't matter if it's
leftwing political right-wing political
it always sucks but consume product was
something that we could all agree on
which is
like 35-year-old men who like you know
purchased like a Lego set and
consume yeah that's right should be made
fun
of bro no that's not that's not cool man
when I'm 35 I want to buy a Lego set if
anyone makes fun of me I'll punch him in
the face
uh
consume what do you mean when Mark
Zuckerberg bro if I grow up to be Mark
Zuckerberg I'd be like
damn why don't I have a hotter
wife
um don't make fun you Lego
sets if I buy Lego sets I'm going to be
self-aware enough to make fun of myself
self um I've never heard of the center
for human technology can you consume
comma I mean like you kind of can't like
by the structure of the company you I
get emails from people who are like
George you know you should really work
on making a more consumer friendly brand
I had to read through seven Discord
chats in order to figure out what the
product was I'm like yeah bro that's the
fucking point
you know if if you if you just want to
consume like you know what go buy like a
apple home pod oh you can't there they
don't sell them anymore
um Zach doesn't see looks he only sees
IQ I mean to be fair like once you get
famous like that you
know
um I will not live in a pod I will not
eat the
bugs uh
Scar the shit the lady of Las Vegas man
man I drag like three red bulles for
That interview that that interview kind
of
sucked
um Mark is ruining Instagram no I don't
know I don't me to rip on his wife man
I'm just saying if I was Mark
Zuckerberg I wouldn't really like be
paying a lot of attention to that kind
of stuff and i' like I'd be using my
money to try to like make the world
better place you know
would I do another Lex podcast I only if
I had something to
say when do I think all vehicles would
be self-driving cars who the fuck cares
man consume
product what thoughts on
dragons I don't know
bro I heard that Uncle
iro killed The Last Dragon but that he
didn't kills The Last Dragon I didn't
really pay that much attention during
that episode but overall I loved
Uno especially the episode where that
guy tries to mug
them will Kam and I move on to solve
other problems yeah bro I'm trying to
solve Ai and replace all the
jobs you
know Ro
jogan how do I feel about contributing
to the technological industrial society
so look I look I was a big uh I mean I
remember when I read that Manifesto I'm
like holy shit this guy's pointing out
all the problems with like the
singularity and the leftists in one
Manifesto damn this is a great
Manifesto and then like I don't know I
got a bit older and like you know
leftist still pissed me off and I was
still concerned about technology
but it didn't really have a satisfying
answer there's not really a satisfying
answer to uh you know in that
Manifesto like okay so what are we going
to do we're going to destroy the
industrial techn society but bro how am
I going to live forever and stay in a
fivestar hotel on Mars if we destroy
technological industrial society you see
what I'm
saying um what's my plan tonight we
could go smoke some hot
marijuana
uh am I into
accelerationism accelerate
the world decelerate your
tribe I heard that somewhere thought it
was kind of cool
sounding
um my a sigma male a geopod yo yo
remember when I got arrested for smok of
weed in Texas that happened it's true
the geopod they photoshop some marijuana
leaves around me and now I can't get
Global Entry you know you live in the
consequences or something but apparently
you know we're going to write a letter
about I'm reformed about how I founded a
company and created many jobs for
America I was funded by a very prominent
B firm do you think the government likes
that shit they they give me Global Entry
now will they still be like no he
brought marij of Texas when he was
22 um here's here's a fact
Bros oh no I never get a job with the
government here's a fact Bros here's
here's two life fact right I'll give you
a two life fact right
now if you don't have something that
you're willing to die for they will
fucking own you that's right like I know
if people were trying to like control me
and tell me what to do I'd be like no
just kill me you going to kill me just
like just kill me bro like and you could
torture me you'd have to keep that shit
up you know and that's
like you got to have that and once you
have have that the whole world just
opens up to
you become a YouTube pickup artist well
walk up to girls on the street and make
nine out of 10 of them uncomfortable and
those are the ones I don't show I don't
know about
that I'm a online pickup artist nah bro
you just got to treat like a sales
funnel uh what am I willing to Die For
Living
forever
um no we don't have any Bud Light uh at
least unless Haro there was reason to
die are you guys laughing
out we're
all now we're
allna
now thousand year 10,000 year mental
prison sentences yeah that just fucked
up man that's why you know you always
got to be ready you always got to be
ready on the trigger man are you lacking
did I just catch y'all
lacking
uh was your Anonymous Twitter and how
many bands are you at Twitter's a
fucking sess man I'll go in there oh you
see my Twitter it's Kam AI as spicy as
we get on there is like my tweet do ATO
got any pacificas for sale don't worry
we don't need the liar is it funny boys
is it funny
maximizing learning a safe objective for
AI oh my God that's another thing that I
used to believe in when I was younger I
used to believe in like
like the uh the like rationality like oh
optimization very scary it's going to
optimize and it's going to turn the
world into paper clips and then like you
realize and like no offense again I'm
saying like I had that perspective but
you realize in a way like
uh how sort how sort of like autistic
that perspective is and again I say it
like saying fully that I had it
um the thing that is much
scarier is when you look at okay so what
those those people don't understand
anything about power and those people
don't understand anything about who has
power and like what forms power
takes um it seems really unlikely that
we're going to end up in a world there
are much much easier and more probable
ways that the world is
destroyed uh you know I don't know if I
don't know what I don't know what I'm
legally allowed to say anymore that's
not against the terms of service about
the truth of Co but like again not
conspiracy theories I hope you guys do
know the
truth
um H and there's people out there
worried about paperclip maximizers
right Co is fake see that's not not true
man that's not true the vax is fake
that's also not true okay can we keep it
true
information
well uh no okay we you can go back to my
streams I'm pretty sure what I said that
it was likely that it was a Labis gamee
I thought it was a natural virus you
know I didn't I didn't I didn't
understand uh you know what these people
were doing
um uh one istitute of virology
19 yo okay so there was this virus that
was originally going to be called the
four corner virus um it's it's a Hana
virus and then the people there were
like you can't call it the for Corner
virus we're from here it makes us look
bad so then they named it the sin
sinnombre virus which is Spanish for
without a name
um yeah gain a function research man can
you believe that shit can you believe
anyone thought that was a good
idea um no see it's not bioweapon by the
globalist like you guys you guys sound
so stupid when you say things like that
you guys S as stupid as the left wiers
who say things you know we don't have to
go into to what the left wing says is
dumb cuz that's the stuff you're not
allowed to say but you
know hey bros can we make super AIDS yo
yo what are you doing this weekend you
want to make super AIDS yeah come to my
biolab
yeah um you guys want to see my biolab
don't worry I'm not working on Super
AIDS
uh I see Brett wit's podcast about the
dangers of fiser vaccine okay so here's
probably the truth about that kind of
stuff right and here's probably why they
censor it it's not cuz they're like evil
or because of that shit it's like well
all right so less people get the vaccine
you know it's it's let's even say I was
an antivin right let's even say that I'm
I'm a you know I all vaccines man
vaccines are real bad for you right but
if you do believe you still want
everyone else to get the vaccine I mean
maybe not like your friends and family
but don't you still want everyone else
to get
it I were wrong the last time what was I
wrong about tell me what I was wrong
about
um go back watch my coron virus streams
I forget exactly what I said I I I will
say this I I didn't
uh I didn't think gain of function
search was a was a
thing
um I try to be well calibrated you
know cuz what I believe
in I said it didn't escape from a
lap because it wasn't close enough to
what I don't think that's what I said
I've be curious I'd be curious to go
back watch my coron virus streams if I'm
wrong I'm wrong um
again I mean I'm sure I mean I certainly
learned about I certainly learned about
uh
the the SARS uh you know SARS escaped
three times two of them were from
laps um yeah man and I labeled turn-ups
racist in my BuzzFeed article written by
gpt3 what are you going to do about
it assassinate me bitch y assassinate me
bitch cuz I'm doing the same shit Martin
Luther King did same balcony in the same
room in the same balcony like
assassinate oh what's the line oh it's
good man doing the same shit Martin
Luther King did in the same room same
hotel room same balcony same balcon oh
yeah in the same room what's what's the
what's the line someone post to line man
you know oh that's that's little way man
that guy that guy's a
man
um look at how it's suddenly okay to
talk about gain of function was it ever
not
okay guys you know people are like I'm
not like worried about like censorship
I'm worried about like you know
like bro like if these people want to
censor me like you know enjoy
Bros
enjoy uh you know it's
not a conflict of interest to these
experts anyone who ever trusted people
like Anthony fouchy was an idiot right
like why would you trust these like
washed up political hacks who've been in
the system for like 30 years right you
know what I
mean like that's not what I would
trust um oh yes yes let's all trust the
official government I heard a good I
heard a good uh I heard a good line and
it was um you know in China no one reads
the newspaper because they all know it's
propaganda Americans haven't figured
that out
yet but no like Anthony F is not a bad
guy he's not like a behindth scenes
conspiracy guy he's a man who sat and
Bing stupid meetings for 30 years with
losers and like well you know you are
your five closest
friends same Hotel
same H in oh yeah yeah in the same sweet
bitch same balcony like assassinate me
bitch
um I would not like thanks to Hippa I
would not like to disclose my medical
history and also thanks to Hippa I'm not
wearing a mask I'm not really sure why
but Hippa bro look it up right I think
that yeah what do you
think um that's a stupid
take you want see my weed plant no I cut
down the weed plant man I'm trying to
make clones no I'm not sure any of the
weed plant but we can smoke a little hot
marijuana got I got a little bit of a
joint left we can smoke it walk in my
bathroom m
wait if I get in that tub is that the
hot
tub all right so here's what's left of
my hot smarana
joint smoking weed on Twitch allowed or
not allowed George got Bam from twitch
for smoking
weed do I believe in the Human Genome
Project someone ask me if I believe in
marriage is as dumb as that shit man cuz
I'm doing the same sh Mark and Luther
King did checking in the same hotel in
the same sweet bitch same balcony like
assassinate me bitch yeah that's
right uh oh we discourage broadcasters
in the use of marijuana guys twitch
discourages the use of marijuana so
unfortunately I'm going to have to turn
you all to face that
wall uh wall stream bro wall stream you
heard of Wall Street well that's a wall
stream uh we're definitely not smoking
marijuana right now that's not what's
happening on the stream bro cuz you
twitch discourages the use of marijuana
on
stream I mean if twitch discourages it
you know we don't want to do anything
twitch
discourages hey man if alinity got
unbanned I don't even know what she did
but if she got on
band in before fire alarm oh yeah we
should close the door we're not let
smoke weed in the apartment actually I
don't know maybe we are the apartment
never told
me I Smoke sigs
N uh
I'm loving the little Wayne quotes up in
here yeah I love L way man I'm not a
human being part
two
yeah
uh going for p on a
street is it working from a bean
bag I do not smoke crack I've never
smoked
crack Anna girl
smoker can you say something that will
make crypto pump
AF um not of sexual relations with that
woman all right all right you guys want
to pump crypto all right uh
um y'all think I'm on Aderall all the
time too like in my life have I Tak an
Aderall yes am I on adderal when I
stream almost
never do I still take adderal sometimes
less often than I smoke
weed
ah my neighbors are listening man the
neighbors are listening good
point only Elon can pump
yo no you guys uh have you heard the bo
buram internet
song the bo buram internet song is
unreal
um if if you guys don't know it go go
listen to it right
now apathy is a tragedy and boredom is a
crime anything and everything all of the
time can I interest you in everything
all of the time a little bit of
everything all of the
time and that part where he just
maniacally
laughs you you
inable
you H yeah Jeffrey
basos Jeffrey
basos we went walking a SeaWorld on
Sunday and I was just screaming that a
whole bunch of
times sometimes when I'm walking by
people I just like act the most I can
like an ad like I'm like turning to the
person next to me and I'm like did you
know that Clorox is is is 200% more
effective than competing dish
detergents can I delete this when I'm
the CEO of Facebook yes if I'm ever the
CEO of Facebook I will delete
this how often do I smoke weed I don't
know once or twice a
week uh oh and it did all the things we
designed it to do yeah oh that was that
was a good line bro that was a good
line um have I ever considered that I'm
autistic I've considered it I don't
think it's true though my new thing I've
been considering thanks to my DNA
profile is that I have
tourettes oh the twitch stream
par right so we're we're going to play
this game I don't know maybe we'll we'll
cry
again I did not have sexual relations
with that
company one of I joining only fans
what are my ticks then Jeffrey Bezos
Jeffrey
Bezos nah I don't know man it did say
that I likely had Tourette's
though I didn't actually get my tea
level tested but it said that uh what
the hot tub is the pool's down there
it's actually it's a pool stream and the
pool is down there I hope you guys can
see it if you can't we'll walk a little
more this way so you guys can really see
it no I don't really think I have asked
for
[Music]
man is it better to promote individual
liberty or engineer
Society can you start a geohot fan club
in South Africa and be
president might a hotel or
something you want to go to the
[Laughter]
space um
who's Danny
and infinite just is about parenting and
not wireheading bro how many simulations
can a simulation
simulate I'm fucking loving
this uh if I build a chip company and
sell it for billions will I be a called
sellout yes but the great thing is I
don't give a fuck what you
think I'll let it sit in the park
and will shit in the dark touching my
hair while you pick me apart I used to
drinking in the park now I'm sitting
cozy don't know me or the woman who made
my soul bleed I roll four rows of OE and
smokes and weed some stupid homies you
guys know that song while y'all talk
politics siing a latte you be Bridging
the Gap but you're missing the
walkway
um you look so
me n squ is bullshit bro n squ matrix
multiplication is
possible
um why do I like the hhkb because it's
expensive and other people can't figure
out how to use it I used to have this
saying it's in one of my songs it's
called keep hacking Elite you
know playing the instruments you guys
want to go play the piano let's go let's
go play the piano I got a pee though so
I'm going to leave you all outside while
I go pee and you guys can look at the
piano while I pee
right Jeffrey Bezos Jeffrey
Bezos right look at the look at the
piano man right but you guys can wait
here all right I'll be right back don't
worry about don't forget about me don't
ever forget about
me for
okay don't worry I'm back uh quick get
some clap on lights in this bitch I'mma
Be clapping all night in this
[Music]
bitch all right well I don't know how to
make yall balance there I can't move the
piano closer to the wall I no you know
what
you guys can probably balance there I
have an idea we'll get this hat comma
shill merch am I like Logan Paul just
pulling out you know my
merch yeah I
am hopefully we'll start with some
scales yo are you guys all Bots
[Music]
play some chords all so everybody this
is c
[Music]
chord and then this is a G
chord and then this is a a minor chord
and then this is an F chord and now we
go back to the tonic and we play a C
chord A G
chord an A
Minor oh Country Roads um what is it
Country Roads
take me
home to the
place I
belong West
Virginia Mountain
Mama Country
Roads Take me
home I think that a minor is
[Laughter]
different and it did everything we
designed it to do
yo all
right um should we get should we get
another hkin man let's get another
hkin you like this stream you like this
stream Play Runaway by Kanye West whoa
whoa now you're asking for some complex
shit uh now you're asking for some
complex shit
um Stella no we got another another hkin
that's what we have in this
house you want more oh you want to play
Constantine I think I play
Constantine what is that so that's some
like the the
be a it's been a long time since I
played that
song it's like uh
how do I play
constant can you guys uh can someone
past the the
[Music]
chords oh yeah something like
I can't imagine all the people that you
know and the places that you go when the
lights are turned down and I don't
understand all the
things things You'
seen slipping in
between you when you're big
dreams it's so always you in my Big
Dreams and you tell
me that it's
over wake up lying in a patch for
clovers that's hard too hard too hard
too hard Bros too hard at one point I
could play out
song There's a video me on the internet
playing that song
Somewhere this might be your favorite
stream thank
you what can I do I can't be a
hamster am I going to try on outfits
Thank
you Good Vibes
yeah don't let your dreams be
memes oh do I still remember the Sony
rap song yo let's take this out of the
courtroom and into the streets I'm a
beast at the least you'll face me in the
Northeast uh get my ey up Light My Fire
I'll go harder than Eminem One at maride
pound me in the ass with no lube chaing
you're fucking with the dude who got the
keys to your safe and those that can't
do bring suits cry to your Uncle Sam to
settle disputes thought you tackle this
with a little more tack but then again
fudge packers I Don't Know Jack I shed a
tear every time I think a lick Sayang
but shit man they're a corporation and
I'm a personification of freedom for all
you fill dockets like that's to concept
far to y'all while lawyers muddy water
and TR stall out of business is jail for
me and you're suing me civil exhibit
this in the courtroom go on do it I dare
youc your safe
and um how many hours do I work all the
time mostly and life is work
Bros am I going to diss Eminem someday
no why would I diss Eminem I like Eminem
I mean I think he's a little not as good
as he used to be but I think that that's
just like Eminem is like a 45-year-old
man you know what rhymes with orange
fore b d and
ding um he did and Eminem did it's Drake
on the other hand who makes shitty music
now and Drake could make good music but
he makes shitty music because it
actually sells the same and you know all
these fucks with no taste can't tell the
difference so Drake's like whoa I'm
going to make shitty music beefing with
Drake do a rap where you kind of insult
people but also kind of compliment them
yeah
[Music]
um who are the good rappers now guys
remember Tyler the Creator some har yo
cyber bullion's not real just turn off
the
screen yeah you're the type of guy that
likes
hops um
the Creator still put out music yo we
were just talking about blady right
we're thinking of making the new comma
servers we're going to like put never
mind but they're
bladies juice world isn't he dead and
they all dead now little peep was
great just walk
away love that love that
mad
lip Mac Miller yeah blue slide
park thoughts about infos SEC oh y I
don't want to get into how I was beefing
with Defcon man you know infos not
hacking anymore that's all I'll say
about that it's like infos is like this
weird thing that's been like what what
did I say I said it in one of my blog
posts I'm like you know these like
people show up and you know what it is
about them they're just not any
fun like these people show up who who
don't even like know what fun is and
they go through the procedure and they
go through the motion but they're not
like the original people who came up
with it you know the original people who
came up with it were all it was all part
we're all having a good
time um infos SEC is checklists yeah and
like what funner
checklists you
know like there's lots of great stuff to
still do and like hacking is a set of
skills that you should have the modern
infos world
stupid infos
certifications yo I have this
certification okay it's from a very
prestigious place they gave me a
certification and they conferred some of
their Prestige onto
me
uh do I believe in God and life after
death yes and
maybe I don't know what dark side is I
don't follow like stupid infos saac like
yo you missed you missed bars there was
some do I remember the movie hackers
hell yeah risk architecture is going to
change everything it's even one of my
slogans
man um any dating apps have good stuff
not
really I don't know if it's just because
like I think when you're young you have
this like incredible idea and you like
build up women and your head at least I
did and then like you know you've gone
on like a lot of dates and it's like
okay I like to see what that
is
um I said on B that my beliefs are
closest to Buddhism that's probably
right dating apps filter by weight since
they do with height do they not to most
of them you not have to put you put your
height in
weight it's like being a giant nerd I
don't think I'm a giant
nerd Instagram is dating enough that's
true did Buddha hack the universe man I
wish I could achieve enlightenment one
of these days it's it's too late you
know one of these days I think I'd be
happy if I achieved Enlightenment then I
could
die sounds right
that's on Uber mench I sat down I was on
a road trip and I'm like I'm gonna
really try to read some ni and
uh just doesn't like it's
hard your chemicals
changed I'm getting tired what do I do
for fun I like long walks on the
beach uh I like hanging out with my
friends uh oh no that's a white girl's
[Laughter]
Instagram
um how many push-ups can I do all right
let's
go we're gonna go for 20 I think I can
do 20 I'm pretty confident I can do 20
and then we're not going to push it past
20 cuz like I don't really know how many
more I can do and then there's going to
be a last push-up where I fail and you
guys are going to see me fail
[Laughter]
yeah all right 20
push-ups yeah I did 21 to fuck with you
guys
um all right after that I'm confident I
can do
30 I'm not sure I could do
40 this looks like every Geor talk how
did I develop morals Captain janway Star
Trek
forager do I do
pull-ups
yeah I can do two
I should I exercise daily I work out
twice a
week uh I mean if we were in a hot tub I
take my shirt off and you guys can see
but many books do I read a week the
median is
zero many hours a day do I read all
day I watch Star Trek like the original
start Trek
Voyager what's my routine only arms
no I don't know biceps triceps
shoulders uh I have a trainer it's like
nice to like not think about that kind
of
stuff can't even do three
pushups N metalic is a
bro
um I do skip
legs a person who can't do one pullup
shouldn't have the right to
vote it's an interesting
World Is Love worth it who taught you
about
love do I believe in mechanical
reductionism no that's some lame shit
made up by
losers do I believe everything that's
true about it yes but what I have done
oh yes I'm a mechanical reductionist no
cuz I'm not a
nerd how far could I jump off my
balcony
um what hot tub am I on check out my hot
tub boys yeah this a hot
tub
[Music]
um I dropped out College what you
recommend you invest my life in and 5
years later you're going to be telling
your kids that yo I was on this guy's
twitch stream and he told me that I
should invest my life in being a rare
silver coin collector only silver bro
not gold okay and when anybody asks tell
them you have your reasons and I quote I
have my
reasons all right you got that all right
good that's what you should do with your
life you come in you come in you you you
come into my twitch stream in like 6
months and you tell me how it's going
and if you don't do that you know I know
that you were just asking CU you wanted
you wanted some bullshit reassurance or
validation you actually wanted Direction
silver not gold trust me
bro I have my re
where's the hot tub this is it's hot tub
look look it's hot tub
colored I've had Society of Mind
actually I might even have Society of
Mind do
I no I think this will
work what is the best way to beg for a
girl to give me attention
I'm not experiencing hair loss now I got
that thick hair bro look how thick that
hair is thick
hair oh don't give women money man I'll
just spend it on dumb shit like
Kardashian
makeup yo ablo espanol we
Bueno
yo yaho
at De
Meo
personas ESP in
Mexico yo Bukowski Bukowski is great
watch some Logan Paul Vlogs
Maverick
uh let's start a call Thum down yo I
have land boys you know I got land right
no but
seriously the point of this stream
was to tell you guys come to
Comic-Con you
know comic-con's this shit but a bit
different you know what I mean like
there's real shit too right and then you
get you can't you know you can't fade
away from the real shit have I seen
Kathy 2020 CVP I talk I watched the end
of it today yeah uh yeah nice automatic
ground Tru and for your radar it sounds
like K stack three years
ago um
I don't know I still don't get why Tesla
does Shadow mode but their new a100 data
center looks real
nice um but see like if even if I'm like
first I was thinking like man I wish I
had that
money
uh the allright has arrived in the
Stream Bros there's no altri right you
know like Hillary Clinton said it was a
thing it's not a thing it's kind of
funny though I was I was laughing my ass
off that night when like Hillary the
altright is out there that's like when
you troll like that but I see that I'm
just like that's like the Cyber police
video bro it's like remember that one
where the old man was like I'm going to
call the Cyber police my daughter Jesse
Slaughter you know you remember that
remember that guy it's like that bro
like there's no cyber police man who's
the all
right uh you can't even travel to the US
Open them borders hey man I don't run a
border okay consequences will never be
the same
I should write poetry man yo you know my
go boys go my boy Goku's poem right my
boy Goku 1997 the creator of cheape
I one day speculators will buy all the
air not to breathe just to huddle and
everyone will suffocate and finally
speculators will be
sad I'm a postmodern of
course wait who asked if a domain is
good are AI domains good bro you know
what domains are in now. computer
cherry. computer what's the Border
policy of my
land
uh I
mean what is the actual border policy
with my land
I have a fence that says if you trespass
on my land we are armed and dangerous
and crazy
um so man put a sign up says I mean have
you not seen that sign when you like
come to America it's like I just wish
that everyone in America was like more
chill about that stuff like you can come
to America but we're armed and dangerous
and crazy all
right um we are a cult now are we a cult
risk architecture. computer yo can you
buy
that um do I like poker only when I get
quad Aces on the Flop then I love poker
two those aces in the pocket in in the
hole and two Aces on the Flop
man and the other guy's got the fifth
Ace and he's like oh I got trip Aces
that's a pretty good hand nah bro I got
four aces and you just push with your
trip Aces
and I got
four join Navy Seals I'm sure you guys
have heard me talk about the Navy on my
streams oh yeah man oh this is this this
this conflict's definitely going to
involved and you guys you want to hear
how to get away from the Navy go like
two miles that way you know like that
way like there's the ocean go like two
miles that way Navy Navy has no idea
what to do really easy to escape from
um a full house versus flush man yo but
but I got the boat man like I see that
you have a flush but I got the
boat how many fl Arbor hacks did I pull
up
bro I'm a
nocoiner what do you think money is
going to buy you when the singularity
gets here okay what do you
think this is a hot tub
okay anyone who doesn't believe that a
hot tub get off my stream right
now the Navy has nukes so how far do I
got to go that
way current ETA and the singularity yeah
you know 2038 you know what's going to
happen you think the you think we're
really going to let the Unix timestamp
roll over without there being a
singularity
aren't I going to create this thing I do
not think my bic is above
um can I write decent code with a B
above
08 what honestly I don't think about
India that
much I think that they've actually left
a lot of people out of poverty in the
last like five or 10 years uh when you
look at like Global poverty in the world
like if you go back to like the '90s uh
in the '90s like China lifted most of
their people out in the '90s and like
2000s China lifted most of their people
out of uh extreme poverty and I think
India is doing the same thing so that's
what I think man I've never been to
India though and my friend said it would
piss me off because there'd be like a
cow in the road and like you just want
to like like why don't they just move
the cow and no you don't move the cow
and also you'll get sick if you drink
the water and my friend got sick and
he's like bro like don't go to India but
so I've never been but I don't know I
shouldn't have taken his advice I'd go
to
India so those are my India
thoughts free Ross Al I think
so I don't know I mean here's here's my
argument for free Ross Al it's like if
the government had actually had some
shit on him
uh you know about the Hitman thing if
that was actually true then they would
have put that in the case and you know
what I think he should be tried for that
if he actually tried to have somebody
killed fuck him jail but like he made it
safer for people to buy drugs how many
lives did Ross save by making the drugs
cleaner safer and you can't shoot
someone through the mail damn bro damn
we could have some nice online drug
markets if it wasn't for the
government um I don't know how are the
online drug markets now are they
good come to Iraq how is Iraq these days
why am I so confident that I can beat
the scammers when the tracker gets
pretty poor because I mean I don't know
am I confident I could beat them Maybe
not maybe I'll lose but
like what what was what was um man that
guy Alberto Gonzalez what was his his
hacker plot called get rich or die
trying right like welcome to my life
it's all just a hacker plot to like uh
uh you
know take down the professional
managerial
class government's listening to me oh is
the government scared of me I was
kidding about the guns I don't own any
guns man I'm like you know you want to
like take me away man put me in jail
like do it man do it if you go to jail
now for talking I know exact you know
what you guys look around the world
today and you know exactly ly where
you'd stand if you were in Nazi Germany
you know exactly where you'd stand right
oh man like I wish the people I wish the
people who actually like you know are
the new Nazis heard
that in my closet no
um you know the new Nazis are everyone
knows the new Nazis
are scy versus me in a rap battle let's
go bro let's
go what do you mean say it you know who
they are all right well like let's look
like look for people censorship is a
good giveaway right censorship man you
know what else what else can we look for
universally right they don't like one
group of people okay censorship they
don't like one group of
people
uh yeah I mean you know that's pretty
much I mean the Communists are the same
way man Nazis and Communists and like
you think about when your country you
know your country ever gets taken over
by these groups and you think about
where you would stand right and I know
exactly where I would stand fuck you I'm
going to say what I want and if you want
to put me in jail for it oh well you
want to shoot me for it that's the way
it is bro that's the way it
goes You The One and Only geohot is in
who is John G I don't think I'm that
cool I think a lot more people know
about John G than
me um yeah you lived under you lived
under conf like there's people who live
through this shit man I you know I've
been looking for good sources on what
happened when the Soviet Union actually
fell
the most blasted emo
song um well I did that cover of that
one that I really like me versus your
friends but they have another one for
when from when Grandpa meets grandma
again we all know she she said it's just
a
headache um are you not saying what you
want by using euphemisms to point out
who the new Nazis are no like it's not
exact one group of people right like
it's not like I can point to like like
that person and say they're a Nazi or
even like that group of people but
there's like a general way of thinking
that's associated it's the same thing
when these fascist or communist groups
comes to power it's always the same kind
of
thinking right it's the opposite of
freedom and that's how you know and then
you know you look and these sort of
people they get massive followings right
and like I'm not saying I know like I
know like you guys are like don't say it
man don't say anything to insult the
left you know don't say anything to
that's not even who I mean that's
actually like
like it's it's all the people
responsible for this this dichotomy and
this this collapsing of of thought this
don't think for yourself this this you
know destruction of Freedom that's what
happens when these shitty people come to
power and then like there's some people
who are just like yeah man but you know
it's just a job man but you know like
they pay the bills but like I get to
like work on interesting stuff but like
stop what the butt likes man like you
know you know what's good and you know
what's bad deep down you know what's
good and you know what's bad and ask
yourself that question what's good and
what's
bad I never actually read manufacturing
consent but um yeah Chomsky was probably
right who do I think the world is run by
mik like you know like NBAs man the
these people they you
know what what value do they genuinely
add the world is run by the elites I
mean that's
true they know they're lying yeah I
think they do I think I think a good
number of them do and
yeah but I I don't mean to like well I'm
not like you know you guys like I'm not
saying like you know it's like like a
like a Jewish Spears your dumb shit like
that and that's dumb and like when
people say that it's like you know like
if it's true say it and there are some
truths that are taboo truths that you
can't say but like these like taboo
falsehoods or like you know Co is fake
like that shit's just not true okay and
you're like I mean and you know what for
me that's more forgivable when people
say things like that because that is the
little guy punching up that is the
little guy expressing a certain
frustration when you know the people
with a lot of power say something that
is clearly not true like that's not like
you know that like cloth masks are
effective at preventing the spread of
airborne viruses like when the when the
powers that be say things like that like
I don't forgive that as easily like
that's not as cool you know they have a
responsibility
right mba's made the pool hot tub and
Beach's section
yo man triple mask that's a good point I
did see about double masks being more
effective than single mask you know it's
super effective plastic
bag um the problem is the powerful think
they're talking on behalf of the
powerless that's how they cover
themselves well that's an excuse they
use right I don't think they really
believe
it aren't I myself an elite well I mean
you know again do I run Society maybe
parts of it
I think I mean you know my my blog post
is called the changing of the Elites for
a reason uh I think there's going to be
a new group of Elites I really hope
there's going to be a new group of
Elites
um I did not vote in 2020
no very proudly did not vote in 2020 I
regret ever voting and I'm never voting
again fuck that shit you wrote does not
make a difference
in the Battle of doors versus Windows
well Windows suck so you know I'm a door
I'm going with the doors right they were
they were cool I never like they made
like music back in the
day um the most entertaining outcome is
definitely utter chaos and destruction
that might be true and like that's a
problem of itself right one of the
things we think about is like you know
America um there's more people rooting
for the destruction of America than the
growth of America and once you have that
you kind of have a problem right it's
why Kanye lost damn if I did vote hey if
Kanye invited me to his uh to hang out
in Wy yo I'd love to hang out with Kanye
Wyoming you know if anyone knows anyone
I'd love to hang out with Kanye
Wyoming um
guys I don't think the elections are
rigged anymore than they're super
obviously rigged by the fact that you
can vote for that old guy or that old
guy
right
um am I still big on unqualified
reservations
yeah um no I mean look again I I reject
the premise that neoreaction is a
conservative ideology
um I'm not a conservative I think that
conservatives
lose uh I like
winning um so whatever you believe in
you're a progressive now the question is
you know you might be oh I'm a
progressive who believes this right but
you know we always believe in progress
in the future
right
um yeah there's almost no difference in
the policy of the larger government no
matter who's in charge and that's true
and then there is a question of why
that's true um I don't know I don't know
like you could have you could say like
it's the Deep State um Dan Carlin said
some like very early stuff I think
that's where I first heard the concept
of the deep State uh I mean not what it
like kind of morphed into um and then
yeah you know you listen to that and
you're
uh that's a possibility it's also a
possibility that it's just the
optimization landscape it's just kind of
what it has to look
like some ideas are really effective for
staying in power and yeah I mean that's
probably what the system optimizes for
to deep State killed Kennedy I don't
know that was before my
time why does Zuck get into trouble
every time what does he get in trouble
for what what do you think digitizing
the US
elections if one party made actual
change if for example Republicans banned
abortion in the next election they would
lose that talking point they wouldn't
get as many votes yo I like that I like
that I haven't heard that
before um people are told democracy is
good so we told we have a democracy
propaganda and its finest that sounds
right um
ah yeah I wish I had a more concrete
plan n you think I have a
plan
um I mean and that's the truth like I'm
here to party and the moral of this
stream is that you guys should come to
ComicCon um go to comment. click
ComicCon $99 in beautiful San Diego
do I look like a guy with a
plan yo one of my favorite clips of all
time is the Rick and Morty
[Music]
oh the microphone was muted looks like
my signature moved now uh
yeah good morning everybody good
afternoon good evening and good night
what was the Truman Show
thing uh so we're g to have just uh we
said it's just chatting tonight no
coding so if you wanted coding watch one
of the uh old
videos
um yeah I just uh you know it's the end
of the year it's always a good time
to reflect on how your life's going I'm
uh I've been uh active on Twitter in the
last two
days you know you won't get you won't
get Twitter activity all the time uh I
rewatch parts of my third Lex today I
watched content all day today I went for
a nice long
walk
um your life is sad
ASF I'm sorry
bro um I'll I'll leave you with
something I I'll give you I'll give you
something
um I remember like six years ago was in
my friend's house in in uh Colorado I
said to myself
look everything that's wrong in your
life is your fault right and it doesn't
even matter if that's true or not not my
point is believing that is the first
step to fixing
it everything that's wrong in your life
is your
fault right the reason we live in the
new Roman Empire the reason we are
enjoying this decline right now it's my
fault
right it's my
fault
um yeah I was referring to an
introduction to clra complexity and
applications good book uh so I think I
think we'll start we're going to do some
some reading review some things I've
read in the last
uh so uh Curtis has a has a
substack uh and I like this a techno
pessimist
Manifesto
um you should text
her oh left their fridge open hang
on we having a night time coffee we're
reading I was uh I was going to fly home
today but I didn't I stayed around and
read um I listened to a whole lot of
Peter teal lectures too Peter Teal's
been uh saying some good stuff
lately uh mle bug's a bit St not really
I mean what do you think is
better they they got Trump I mean there
there's no right let's let's let's
avoid short-term thinking and start
thinking more long term right maybe
beyond the 2024
election though you know who's been
killing it lately Tucker
Carlson I mean look he still has his
problems but but
uh you can see the like stories Fox News
forced on him and the stories he can now
post on X right like a
uh you know a full defense of of Julian
Assange uh you know the journalist
industrial complex will allow no
competition to the journalist industrial
complex Julian Assange was uh if there
was any integrity and any prizes in
journalism he's the greatest journalist
of the 21st century
right
um yeah I mean Tucker
can there is a sense un like unfortunate
there's sensationalism that I don't
always like about
it um but you know I guess that's what
it takes to sell news I don't know I
don't I don't appreciate the
sensationalism but uh in general I think
his takes are are
quicker uh
what's the current perspective of
Americans well I can speak to me and my
friends and uh I mean you know look it's
uh regard what they're doing to him is
insane um but I don't know if that's
General American I'm not sure what the
general American thinks you'd have to
look at Pulse uh so this one's a little
political but we not going to get super
political here uh we always try to avoid
talking about any controversy of the day
right um well maybe we'll start with the
Peter teal
thing Peter teal
lecture he had very uh
interesting let's see if we can get the
transcript to this uh I think it was
this
one I don't know I was I was listening
to them I I love my folding phone guys
it's in the other room but I got a I got
a Samsung Galaxy zold 5 absolutely love
it I if you're going to buy a folding
phone buy that one don't buy the OnePlus
open it's literally twice as fast and
you know they have qdl restore files I'm
still fighting with OnePlus uh he so sad
what that company's become but yeah no
Galaxy Z 5 I absolutely love the phone
and I wish I trusted uh Android to be my
primary phone operating system maybe
I'll come around to
it um well I mean is Tucker cross Tucker
cross is sort of a journalist I mean
yeah these are the people who are who
are actual journalists right not just uh
the extended press secretaries
right
um so let's see if we can get this
transcript maybe someone can find
[Music]
it come on I actually saw the transcript
somewhere I thought
I read the transcript and then I
actually listened to it
today uh I have a show transcript Buton
but I don't want the crappy uh the
crappy YouTube transcript okay I'll
settle for the crappy YouTube transcript
can we can we at least zoom in on
this no we can't no no no no you know
what actually I think if we just search
for one of these
phrases no
H the myth of
the oh come on all right I didn't
prepare enough for this video well good
when I was when I was
undergraduate
um
they had a transcript of it I'm pretty
sure where did I read
it if the
smartest I will give a channel point to
uh anyone who finds this I don't know if
I can give away Channel
points but oh I think it was in Pirate
wires um check out pirate wires if you
haven't
too uh parro wires is it's like Mike
salana and people
uh what where is this
they have it they have it
somewhere because I read this
transcript oh come on okay okay you
found
it
uh posters for paid
subscribers
actually am a paid subscriber I'm just
not logged into
anything oh so that must be what it
is okay uh I'm a paid subscriber but I'm
not a paid subscriber on anything I'm
going to log in on
unfortunately so we'll have to figure
out okay YouTube good transcript view
because we're going to talk about this
for uh I'm going to talk about this for
a
bit
okay there's a way to open this
in the new in like a
new window okay we got a paste bin
here okay someone managed to copy this
and that's completely unreadable
okay um new Criterion oh he oh he put
this in new Criterion I love new CR okay
okay maybe this is where I saw it too um
does he end with his
his uh
okay yeah
yeah um
good oh yeah this is it cool uh this is
where I read it actually new Criterion I
have a few Palladium long form new
Criterion and astral codex 10 uh that's
it's important to stay up to date on
stuff I've been working really hard on
Tiny grad lately uh so we
see um so you ever read the diversity
myth uh it's it's Peter Teal's OG
book um and it's kind of interesting I
mean the year here is is very notable
it's
1995 um you know again and we've talked
about whenever we talk about wokeness on
this channel uh we talk
about uh again not don't uh don't take
this to hate trans people or minorities
or anything like that take this to hate
uh universities and really how the
university system has has failed Us in
in a very fundamental way right this is
not a political point the only political
point that I'm making on this stream is
that acceleration is good right um I
think maybe you've seen my arguments
about this before uh acceleration is the
only thing that lifted Humanity out of
poverty on the whole you have to
basically make the pie of the economy
bigger um I saw some people respond to
one of my Twitter things yesterday about
like uh what did I post yesterday
um they respond with like it's important
how the wealth is distributed it it's
really not important how the wealth is
distributed and the more you focus on
how the wealth is distributed the less
you focus on making sure there's more
wealth in the world right uh the the the
uh Genie coefficient of a country is
much less important than the uh you know
the GDP of the country right right we
don't have any any Ultra Advanced
countries which have no very high gdps
but uh life is terrible for everybody
who lives there that's just not really
how it
works uh
okay
so
um te talks about a
few talks about wokeness in a in a very
uh intelligent way not in the sense of
wokeness is bad but in the sense of why
is wokeness uh spreading right why why
did this ideology manage to spread why
is is is uh Claudine gay now the
president of Harvard right how did how
did he go from Larry Summers to claudian
gay what what actually happened um so I
I loved this anecdote uh a few years
after the diversity myth came out a
Stanford physics Professor Bob uh
Laughlin got a Nobel Prize and he began
to suffer from the Supreme delusion that
now that he had a Nobel Prize in physics
he also had academic freedom now there's
a lot of controversial topics in
science uh you know you could have a lot
of different heterodox views but he
managed to find something that was far
more taboo than any of the normal ones
he hit on the idea that most of the
scientists were doing no work at all um
T goes on to talk about it's very easy
to criticize the
hum's uh Department of universities
right it's very easy to criticize gender
studies or even to go less uh less
politicized you could talk about about
criticizing interpretive dance right you
know or or or or uh you know a
Mesopotamian history right these these
completely uh as the unibomber would
describe them serate
activities uh
but that's hitting them at the weak
point right till even goes as far as to
say this is what the center-left
bureaucrat
wants uh what if instead you say that
the universities have made no progress
in physics
and it sure seems true
right we made all this progress in in
fundamental physics in up until really
the
1970s um something happened in the 1970s
where progress kind of stopped right uh
so if you look at USA energy
usage um you know you
can
this is the one that I usually get
energy usage per
capita but we see if we get one going
further back because you really don't
see
the the absolute startling here um so
you see from 1950 to
1970 uh it doubled
and then it went
flat
right uh this is this is energy usage
per capita
um this was brought up on the last
stream uh productivity and
[Music]
compensation
uh do they have energy
here they don't have energy here but the
same thing true an energy toe um
something happened here and the energy
usage has been completely flat
since uh so something happened pretty
much in the last 50 years that has
prevented uh growth in energy usage that
has prevented progress in The
Sciences what fundamental science has
been figured out in the last 50 years
the answer
is almost none
um a lot of
the bio stuff and health outcomes right
uh right even here it tapers off
later but it still starts to taper
off um look you can see the tapering off
here in Mexico you can see the tapering
off in the UK
uh so Laughlin's team started with an
inquiry into the biod department uh
launching an inquiry into what exactly
it was
doing
um the generous conclusion would be that
the department wasn't fully fraudulent
just an incredibly incrementalist
exercise and group think that wasn't
really moving the dial
forward uh this line of thinking was uh
completely completely taboo I I don't
need to tell you how the story ends on
the lecture he actually goes into it and
uh well his students couldn't get phds
anymore he lost 10 years so on and so
forth
um I like this as well he talks about
how which do you think is worse run the
DMV or the NSA right we all know how
badly the DMV is run but why do we think
that the NSA has a secret basion of
competence and I love this because I I
use this for startups as well right
secrecy
uh with very like with the only notable
exception of Apple is inversely
proportional to coolness if a startup is
secretive about something it is almost
always because it is not good instead of
because it is good uh we joke about the
secret good version of open pilot but of
course there is no secret good version
of open pilot if we had that we would
have released it to
you
um so
uh he he talks about something else that
I I hadn't really uh heard before but
it's this microeconomic problem um
where he talks about how
uh Goods like housing right if you uh
decrease the supply of housing
1% the average price goes up
2% right if if if artificially
restricting the supply increases the
total market cap of the good uh this is
a hard problem to solve this is true for
oil too this is why you have things like
OPEC right again if you were to increase
uh oil production or housing production
the pricing of existing oil or housing
would fall now that's obviously true but
what's not obviously true for these
Goods is that not just the price of the
existing stuff would fall the entire
market cap of the sector would
fall
um and
uh see if he he talks about it here but
but I loved that as like uh wait that's
a real problem right that's a real
problem with with with what you consider
a free market if if you like free market
economics how do you solve the problem
of uh basically artificially decreasing
supply of something something increases
the total market cap of the thing right
actually makes the pi bigger the pi is
bigger by by artificially reducing
Supply uh and this uh has been brought
up for for cigarettes for oil and for
housing uh so that's a big problem uh
that it's not clear how you uh how you
solve with free market economics but
this is The Cutting Edge right so look
it's a just chatting stream we're
talking about politics but um
I watched another video of of tals where
he talks about this guy who's like uh
more fossil fuels more fossil fuels good
um and yeah I didn't think the pro
fossil fuels guy was making such great
arguments but I did like that the whole
thing was post
alarmist and this is where we need to
get to we need to start talking very
sensibly about how to uh fix these
problems right we need to move past a
world of every every culture War issue
regardless of what your feelings are on
on gay marriage on abortion on on
whatever culture bullshit like like like
it's all a distraction from basic
economics it's all a distraction from
the fact that we are no longer
experiencing growth and how do we get
that growth
back um yeah energy usage is the let's
let's let's
find
uh I want the one going way
back could search for the Henry Adams
curve the Henry Adams curve is what we
were promised uh yeah so here it is
going way
back
um all right so you you see you see an
exponential growth uh and then in the
1970s uh it's cut off right
so you know
teal goes into like um he talks a bit
about Christianity too which which I
find very interesting uh you know is it
is it possible to be to be too
Christian uh he he talks about wokeism
as a uh offshoot of Christianity where
without forgiveness where you keep
original sin but you remove forgiveness
right um and then he talks about these
these neop he he describes Bronze Age
pervert as neopagan um where you don't
even have the concept of original sin
basically the victims deserve it uh so
it's interesting it's interesting to to
see this to see this spectrum right like
like Christianity has original sin and
forgiveness over here you have original
sin and no forgiveness and over here you
have no original sin uh
so yeah
um
uh he talks about the ad ology of
political
correctness
um basically uh political correctness
comes from comes from Moscow being
politically correct meant that you were
a good
comrade
um my uh my goal here is to be is to
concretize all these concerns not with
the aim of providing answers but simply
of asking questions and I think that
they are very uh good questions he also
described and I I listened to like four
hours of pedy tale content this morning
he also describes
uh the 2010s as
this like Groundhog Day um as this
groundhog and I really did not like the
2010s I I think that now we are on the
verge of something new um I think that
the 2010s were completely fake uh
largely because of of of uh 0% interest
rates um so this
one so he he again described in a way
that I thought was absolutely
uh uh simple and and beautiful uh fed
interest
rates why is this why are all these
charts so complicated I want the Fed
rate over time here it is okay thanks
CNBC
okay um yeah so you know I I don't think
that this uh that this decade was a very
a good time I think that we had a lot of
counter progress in
technology uh but he describes very
clearly why this had to happen and it's
because deficits got large so if you
have a really large debt you want the
interest rate to be really low because
your payments on servicing that debt are
really low right think about it if you
buy something on credit uh you know you
want your credit card to have 0% APR
right um if you have debt you want low
interest rates uh if you do not have
debt you want uh High interest rates
right so you know I'm rooting for this
number to go up um I I I think that the
that the interest rate should be much
higher uh than it is um by the way again
if the interest rates go up the price of
housing will
fall uh the price of all Goods will
fall so I but I just thought that as
like like the the people uh you know in
charge had no choice because deficits
were so large all you could do is lower
interest rates to make it so you can
push the problem into the future and uh
we pushed a lot of problems into the
future until now they are uh now they're
unsustainable um you know again I'll
take a slight
sideline into into current politics um
again the just chatting stream I'm sorry
if this offends you uh but but it's
interesting that the uh the Jews have
been
uh it's interesting to watch the even
mainstream
media
uh now no longer print this
uncritical diversity
gibberish uh
it's interesting right it's it's it's
actually it's actually really cool so
you know sorry you piss the Jews off and
uh well you know ask Kanye where his
sneaker deal is right
um but you know again this is not a you
have you have takes on absolutely every
single side of this right uh the
fourchant take on Israel Palestine is uh
I want them all to die you know it's
it's it's just like you have you have
takes on absolutely every side of this
and I don't mean that any of the takes
are are are better or worse I'm mostly
indifferent to most of the stuff I'm
talking about what concretely affects my
life um and one of the things that
concretely does affect my life is
the the pushing of of of um okay so I'll
talk about how it affects my life right
so politics is really dumb following
along with politics that does not affect
your life is really dumb the kind of
person who reads the news right uh I met
this woman who was was uh living in in
uh she was living in Japan we met up in
Tokyo and she was reading the American
news and it was outraging her and I'm
like you're in Tokyo none of this shit
matters right like she was upset about
like border or Trump or whatever like
like bro you're in Japan this doesn't
matter right um so let's get to the
actual issue that does uh affect me
which is uh which is progress
um uh prog progress does affect me uh
the other
thing what did is this a new Criterion
thing um if you haven't seen new
Criterion I I like I like these
guys
[Music]
um one of the posts uh talked about
basically how
complex uh our society
is um our our society is extremely
complex and it requires
uh let see if we can find it it requires
highly skilled people in order to
maintain the complexity in our society
right who's running our power plants
who's running our water grids who are
our air traffic controllers um and if we
move away from a uh merit-based
system the nice things in society are
going to start to fail uh now this seems
this seems obviously true again I'm not
talking about only worry do not ever uh
get caught up with a political issue
that doesn't affect you right whether
Trump or Biden wins the next
presidential election it doesn't affect
me right the the the crisis at the
southern border it doesn't affect me
right this this doesn't affect my
day-to-day life you say that oh maybe it
will in the future and maybe it will in
the future right um but yeah things
don't affect you you should avoid but
things do affect you well you got to
think about them
right um so let's see if we can find
this I don't think it was this
one but I'm pretty sure it was new
Criterion and it's interesting that uh
that tal is here
too
uh Henry kiss M I guess he just died
that's why people are
interested
um
uh
they also talked about the
uh maybe it was this
one um it was like Griggs versus Ohio
power I didn't know about
this uh but this was a here Griggs
versus Duke uh Duke Powerco again 1971
it's it's interesting that all these
things happened at pretty much the same
time um it was basically a
uh
the power company wanted to give a uh
basically an IQ test uh to
to uh perspective in place
and they ruled that in 1971 that using
IQ tests uh was illegal uh in employment
because you couldn't show that someone's
IQ directly impacted their performance
on the
job
um
again you
know so there's your there's your
correlation between sat and IQ uh so I
mean colleges basically do use a
uh do use a uh an IQ test uh to
determine who gets in but there's
movement away from that right there's
there's movement away from using SATs
and college applications right now why
anyone would want to go to a school that
doesn't use any objective criteria I
mean at that point what are people being
picked on right
uh okay I think we got a little bit into
the weeds there but we'll come back to
how this relates to uh
accelerationism so one of the greatest
questions and I've tried to find the
exact quote I think it was a zero HP
Lovecraft
quote there's two types of capital that
he defines he talks about human capital
and techn capital um human capital is it
increasing or
decreasing you can look at this in two
two ways right you can kind of look at
the human capital per capita right is
the average human today uh better than
the average human 100 years ago right
and it's not clear what the answer is to
that but if the answer is that the
average human is
worse then this goes into basically
the if you've built a
system right it is true that the people
who build the system uh generally are
smarter than the people who uh who do
end up maintaining it but if the people
who end up maintaining it aren't smart
enough to do that uh then we start to
get widespread collapse I've been
watching a whole bunch of uh I think
it's practical engineering on
YouTube uh this guy's a civil engineer
it's really cool
stuff and talking about how if we see
collapse if we start to see collapse in
something like the electrical grid like
what they're seeing in South Africa um
tons of other systems start to collapse
also uh so you know it's it's just it's
just really important
that human
capital you know is is kept up to the
point that it can maintain these systems
until we do eventually hand them over to
machines uh if we do that but if uh
Harvard is no longer using the SAT for
admissions where are these people going
to come from right where do we have a
pipeline anymore to get uh talented
people right um by the way and I'll I'll
I'll I'll I'll say this and I'll I'll
emphasize this uh you know I think
racism is extremely stupid um I think
that uh using someone's race no matter
how you use it uh to
determine uh anything pretty much is
just dumb um because you're not going to
get the best person for the job right
you're going to have this confounding
variable which again you know I think
all humans are pretty much the same uh
not all human not all individuals are
the same right but like you know maybe
there's some differences between racial
groups but who cares right let's just
focus on the individual uh all right so
classic liberalism classic liberalism
going to fail blah blah blah blah blah
blah blah blah blah okay um so uh can we
accelerate our way out of this we are
here uh human capital
declining uh we have two choices uh we
either fix human capital or we beat it
with a lot of technical Capital
um there's more variation within races
than between of course you can like read
all these things you know as again like
like it's a lot of like conspiracy
theories when you make something taboo
uh the things or when you ban something
right when you try to censor something
when you try to people generally assume
that the truth is much worse than it
actually is when if you just you know
told people the truth it'd be like oh
okay um and you know we don't need to
talk about the it's an it's an upset
truth but you know it is a truth and you
can look at it and then you realize well
hang on we can we can still build a very
functional
Society
um why is it so hard to tell the truth
well so the teal thing kind of uh goes
into
this
um here we go why it's so hard to tell
the truth well assume that people are
purely motivated by
economics uh and he he poses an
interesting again assume that it's all
and he talks about real estate kind of
being the core the core thing right
assume that everything is basically
motivated to make real estate prices go
up right like like stop thinking of of
of of wokeness as causitive and start
thinking of what caused wokeness uh and
he he has a
funny uh
ath thought experiment might flush out
this crazy Theory just a little bit if
you were sitting here in Manhattan back
in 2007 or in San Francisco and you told
me the average rent would double in the
next 16 years I would say that's
completely impossible people would just
move they figure out some other place to
go but maybe you countered well let's
say rent's going to double anyway and
then you asked how would that be
possible it would be inexplicable
without recourse to some kind of
ideological superstructure inflicting
some version of Stockholm syndrome if
you're a gay person you might be told
that if you ever move from Manhattan to
Hoboken you'll be beat up by bat
wielding thugs right away if you're a
woman living in a rad infested apartment
in San Francisco where the rent is going
up and up while you fantasize about a
nice Suburban House in Reno Nevada you
might hear that well if you ever dare
move to Reno you're going to be chained
to a bed and forced to carry a baby to
term right um the only logical
explanation is that a crazed ideological
intensification has distracted us from
what's really going
on
um I I'll say this too right so I I do
very often ask the question how much are
am I affected by my own biases right do
I like that explanation because I hate
San Francisco right or is it because
it's a good and true explanation I don't
know it's really hard to tell um I don't
know that that's why I really like
falling back on the things that are data
uh things like you know now we have a
declining life expectancy in the United
States uh you know and then then this
one this is this is the truly this is
the truly unforgivable sin of the last
50 years that energy usage per capita in
the United States has stagnated now you
want to see energy usage per capita in
China right boom whatever
happened um I was I was in China around
that time you know very what an amazing
time what an amazing time to be there
uh oh oh oh it gets sadder oh yeah it
gets sadder if you go to yep yep it gets
it I
mean
yeah the European countries are even
sadder um we're bearish on civilization
today okay so let's this is a good
that's a good segue into the next uh the
next the next
reading uh but yeah Listen to listen to
that teal actually it's really
good
for
so uh we did our attack on uh on on on
wokeism on mainstream ISM on come on
does anybody seriously think Harvard
does anybody seriously think Harvard's
good right nobody thinks that anymore
right like like they talking about the
collapse of the universities it's it's
pass it doesn't even have to end with
tanks on the Harvard campus it just ends
with uh you know just the
the the the loss of status
um in in uh in Harvard and in the ivy
league right you can look at the
declining uh enrollment numbers you can
look at the declining
um
uh number of people in general going to
college I mean I guess it's just
employment numbers anyway
um isn't the energy graph just uh
tracking the move of basic production to
China I don't know what that has to do
with
production um you can say that yeah okay
maybe I don't know how they measure that
I don't know how if they include the
energy that was used to produce a good
that's then imported to
America
um well you say their research facility
is nearly the best in every field but
please tell me more about about where
we've made progress in the last 50 years
right there's been limited progress in
in in biology but still nothing compared
to what there like could be right you
know here's here here's something that
just blows my mind when I think about it
right everyone knows that we went to the
moon in 1969 everyone knows that right
they're like oh maybe this was just some
completely unsustainable um you know the
came
out in
1969 this plane today is over 50 years
old and you'd be so lucky to get on a
747 most of the time you're on some shit
tier
737 right we don't even have make planes
this good
anymore this is this is a 50 3 54 year
old
plane how sad right let's go 54 years
before uh you know 1969
right um let's look at a what year was
the right
Brothers in a
productive 54 years we went from this to
that
right and then in another in another 54
years okay I mean we do have okay we do
have we do have 787 today right I like
787s they're they're they're they're
okay but you know they wouldn't be
something that is unrecognizable to
someone in 1969 right it's not that
different okay the engine got a little
bit bigger you can see they clearly did
some cost reduction where they got rid
of some of the engines uh they made the
plane a little smaller uh they made the
wings look fancier great but like like
just just just when you go from that to
that uh
wild um a380s are pretty okay okay okay
we I mean we can look at the A380 the
A380 is what is 30 years old now how old
are a380s no a380s might should be newer
than that how new are a380s oh no no no
they're nevering that okay a380s are 16
years old I mean again it looks pretty
similar a380s are very nice
planes um yeah the new stuff is boring
and un Inspire right um and it probably
is related to this General sort of this
General sort of
decline
uh he went to another thing at I
listened to teal and David Graver the
bullshit jobs guy talk and you know just
how I me I think about me
right where do I end up where do I end
up and see I'm um I have slightly better
executive functioning than a lot of
people who sort of look like me right I
I am capable of starting companies and
raising
money uh but you know I'm also I'm
pretty
weird uh and I just I read about I read
about these like mathematicians right
and this is the lifestyle that I wanted
the the life that I wanted was to go
around from place to place and like work
on problems I never wanted to
participate in business we have to today
right because that other system is
completely destroyed um at least
fundamentally business is tied to what
people will buy and there is some
inherent uh democracy there right people
kind of know what's
good uh okay so we've done our criticism
of uh of woki and classic
accelerationist uh Theory
um oh I'm also Argentina has a has a new
guy we'll we we'll see how things work
for him uh I like the El Salvador guy uh
the El Salvador guy
tweeted you can it's interesting it's
interesting what's happening in South
America maybe now that the uh I don't
know uh you know I always think of them
as a Bastion of the stupidest kind of
like communism socialism Venezuela
Argentina right the Argentinian
currency
right um I remember like oh it went down
again your average shitcoin outperformed
the Argentinian peso by the way uh we
thought about buying bird remember bird
scooters
um uh the market cap of bird scooters is
now $1.3 million so you know I thought
about dropping in 700k and buying a
controlling share in
bird
um
uh I mean it didn't do as bad as uh
Argentina's currency is Brazil that bad
too
uh not as bad as Argentina no that's
like a normal like okay I like it went
down a bit but like come on come on
that's this is this is hyperinflation
land right
uh China canceled currency swap with
Argentina because the new president said
he hates
communis oh
man uh well you know you can you can uh
you got to separate come on you gotta
you got to separate Argentinian
communism from Chinese communism right
Chinese communism build builds highspeed
trains I remember riding on some some
buses in Argentina over things that
could barely be called
roads
uh you don't get the art yeah so so you
you can also talk about potentially um
that the decline in stem has happened
because uh all the easy problems have
been solved yeah I've heard this
argument too maybe maybe but like does
that explain the energy usage thing no
um teal also had an interesting take on
the nuclear uh why why nuclear stopped
and it wasn't Chernobyl or 3M Island it
was actually India getting the bomb
after we gave them civilian nuclear
reactors that they made into bombs right
uh that's an interesting take okay so we
did our we did our we did our hating on
on wokeism and now let's hate on
accelerationism right we got to hate on
everybody equally right isn't that what
the news is the news is when you get two
people from both sides and just let them
talk right cuz that's what news is
um a techn pesimist Manifesto are you a
techno Optimist this is a serious
condition as common as pre-diabetes
don't laugh you can treat your
pre-diabetes and your techno optimism
too
uh corn syrup techno optimism As
Americans and we're all Americans Now
location even birth location is just a
detail we're all techno optimists the
American idea is the idea of Tech name
man-made order creating a city on the
hill in a new wild
continent uh you know it's funny like
you can read
Andre's uh Mark Andre's Tech like Tech
optimism
Manifesto and I read it and it doesn't
resonate with me that's what he's
responding to uh I think maybe that even
links here
yeah you can read this right and
like this seems very much like a
rehash of
uh right uh you know I I like again I'll
say the same thing I said on like Lon
space I like Mark andreon uh but I do
think that some of
his I ideas
are
uh the first word that comes to mind is
juvenile and I I don't really mean that
as a as like a like a like like it's
idealistic let's say that's a that's a
more positive way to put
it um so you know it reminds me uh very
similarly of the uh of the of the
futurist Manifesto right we have stayed
up all night my friends and I under
hanging mosque lamps with Dome of fil
greed brass domes starred like our
Spirits shining them with the prisoned
radiance of electric hearts for hours we
had trampled our atavistic and we into
Rich Oriental Rugs arguing up to the
last confines of logic and blackening
many Realms of paper with our frenzied
scribbling right just imagine like a
bunch of guys sitting in like an Italian
Cafe drinking espressos being like yeah
man yeah you know you heard of cosmism
man you should see what the Russians are
doing they're going to bring everybody
back from the dead man like you know
it's it's it's uh um we intend to sing
the love of danger the habit of energy
and fearlessness courage audacity and
Revolt will be essential elements of our
poetry up until now l has exalted a
pensive immobility ecstasy and sleep we
tend to exalt aggressive action a
feverish insomnia the racer stride the
Mortal leap the punch and the slap right
so this is this is I think it's
1912 uh 1909 1909 the the founding and
Manifesto of a futurism right uh let's
let's just contrast this with uh Italy
energy usage per
capita
um yeah
yeah uh all
right so yeah um what happened
uh so I I see a lot of a lot of
similarities here I think this might
even call out the uh futurist Manifesto
specifically no it doesn't
um
but yeah I think that this philosophy in
a lot of ways hasn't been updated for
the the current uh time uh and look you
can actually say I've heard this as a
like like I don't consider myself on the
right uh but I certainly don't consider
myself on the left um and you know
leftists don't attack each other and I
don't mean this is an attack I I don't
for the most part if these sort of
people were uh in charge of everything I
would be much happier than the current
group of people who are in charge of
everything
but I do think there are some
fundamental issues with it and I think
Curtis addresses some of them pretty
well
uh so how did this uh technological
optimism work out uh for Americans how
did that work out uh well it worked
quite well at first but as of late
opinions
vary um do you have an opinion do you
doubt your opinion either you're a
pessimist and you want to see the
Instinct confirm or you're an optimist
but want to be a scientific Optimist one
who belief is confirmed by
doubt if you want to doubt techno
optimism here's a cure I call my therapy
the Johannesburg protocol it costs about
$5,000 the protocol is fly to
Johannesburg spend a week walking around
the city stay safe make sure your hotel
has a generator see Johannesburg capital
of the rainbow Nation see the
future and when you get back assuming
you get back take a day to think about
how AI will fix South Africa or VR will
fix South Africa or crypto or
whatever
um so I found this uh
interesting
uh South Africa ranks is one of the
highest for uh screen
time Philippines Brazil Columbia South
Africa
Argentina
um
interesting what this
means oh they're measuring vision loss
I've seen South Africa at the top of
these lists too um in terms of computer
usage South Africa is the is the uh is
the
top um here South Africa Brazil
Philippines uh highest average screen
time uh which is interesting uh so yes I
take a day to think about how AI will
fix South Africa or VR will fix South
Africa or crypto whatever I just like I
just love these zingers from Curtis
right cuz like you sit here and think
about it you imagine you're like average
like Tech bro douchebag being like well
AI is g to is g
to right like h no like bro bro that's
not the problem right
um what you will see in Johannesburg is
abundant physical evidence of a world
that was functional 50 years ago even
100 years ago but now is halfway to Mad
Max I've never been to South Africa uh
I'm I'm assuming Curtis has uh even if
he hasn't this backs up what I've seen
in in a number of YouTube videos on the
topic
um so yeah I mean you can read uh hopium
hopium is a good way to uh to describe
it um I love this quote actually America
is not full uh we can fit another 46
trillion humans in there if we grind
them into a find powder and store them
in giant grain silos that will occupy
every inch of this
country I love the imager right like you
just you just you never get this like
like this is there is like a certain
sort of absolute and complete fakeness I
get from so many of these uh like
accelerationist people like like this
isn't
a you know the the the the wokies are
going to beat you right like the wokies
deserve to beat you right like
they um oh you know what you know what I
was watching uh yo yo I think I think I
brought this guy up on stream before
little Mau little Mau man um okay this
this video is fire okay I promise I
won't let you down boy lace about to
make us catch another case you don't
want to be in noil follow my fault fa
I'm new to this place yeah baby to the
hood baby welcome to the hood if you're
with us you good right
um so we'll go on in the Curtis thing
and he talks about this thing called
thymos right and I want everybody to
just think about this this video which
not ironically I think is actually
legitimately great um and you know it
just it just got me thinking when when I
was when I was listening to this today
about the uh The Barbarians who are
coming for American culture right uh or
who are coming for civilization in
general right where where are the where
are the Germanic hordes right where the
uh the VIS Goths you know where who's
who's coming and like uh welcome to the
hood if you with us you good right but
this is actually not to hate right
what's what's so funny is like you know
look I I didn't grow up in the hood man
I don't know that much about the hood
mostly what I know from like videos like
this in Adam 22 right um but there
certainly
is one interesting thing that you knowe
about you know whenever you go through
an area like this is people are outside
right and they're not necessarily
outside cuz they got nowhere else to go
they're outside cuz like yo we're
outside man we are a
society right whereas when you go to
some of these you know places that have
have experience decline there ain't
nobody outside on the street
right uh so you
know
um yeah uh
uh Andre is no UNS subtle thinker is not
a pure poana Optimus he see he he too
sees two curves his falling curve is the
curve of human Spirit thymos whose loss
gives us n's last man and CS Lewis's men
without chests right you could say a lot
of things about people in the hood but
they have
thymos right they have a society and a
culture culture
that you
know you wouldn't describe them as the
Nan last man or a man without a chest
right that's who I that's what I
describe your average diversity
bureaucrat as a university ass right the
last man is the human being specifically
the human Elite at the end of a
civilization um the role of thos is to
maintain order pride in maintaining
order is a crucial element of a
functioning Elite when the elite loses
this Pride or even developed its
opposite luciferian Pride at destroying
order trouble is on the horizon um you
know I just I love I love all the you
guys know I'm Christian I love all the
return to to Christianity stuff lately
right like you
know
like there's just some things
that were so much better understood I
feel by Societies in the past by
societies who actually went outside and
didn't interact with the world mediated
through a cell
phone that is created and curated by you
know a small group of of of companies
right you know
again uh it brings us back to to L
mau's uh is this the hood or these guys
gangsters nobody knows man I don't know
people probably know I've never heard of
5o faren before um but no this video is
actually fire check it out
uh indeed if present Trends continue
voluntary human extinction seems likely
to become a live political issue within
our children's lifetimes you
laugh
um
so let's uh Curtis comes to one of my
one of my sacred cows here one of the
things that I believe one of the things
that I repeat and I've been rethinking
it um I I went for a walk today had two
people recognize me uh one guy like
thanked me thanked me for for what I was
doing
um that guy had actually like met
through a friend so it wasn't weird when
like random strangers by the way if any
of you watching this are like random
strangers like don't come up to me man
like like don't don't come up to me man
uh you know okay look if you're like
cool and you could be cool about it then
it's fine but like like socially awkward
people come up to me man like what's
just like like I feel awkward right no
the guy the guy today the guy today I I
met through with FR he was cool and
actually it was a very positive
interaction um
and like this always makes me think of
could
accelerationism be a mass
movement
uh there was
another
this um when we so uh he Curtis talks
about the thymos crisis right the crisis
of kind of maybe everyone feels it right
it's the crisis of kind of like why are
we doing this all like I feel it someday
too right I think we all kind of do like
why why keep this going who are we
keeping it going for right whereas like
you just don't you don't have this and
uh you know when you when you when
you're too busy figuring out if we got
to you know
uh uh shoot up that guy's house tonight
you're not so worried about existential
bullshit right uh you know where we
doing the drive by tonight boys like
you're not so worried about existential
bullshit um
so
uh here William James who thought that
the uh 1910s was was decadent degeneracy
maybe it was right maybe World War II is
coming
um
if now and this is my idea there were
instead of a military
conscription uh a conscription of the
whole youthful population to form for a
certain number of years a part of the
Army enlisted against
nature the Injustice would tend to be
evened out and numerous other Goods to
the Commonwealth would follow the
military ideas of hardle hood and
discipline would be wrough into the
growing fiber of the people no one would
remain blind as the luxurious classes
now are blind to man real relations to
the globe he lives on and to the
permanently sour and hard foundations of
his higher life to Coal Mines and iron
mines to freight trains to fishing
fleets in December to dishwashing
clothes washing and window washing to
Road building and tunnel making to
foundaries and Stoke holes into the
frames of skyscrapers would our gilded
youths be drafted off according to their
choice to get the childishness knocked
out of them and to come back into
society with healthier sympathies and
sober
ideas they would have paid their blood
tax done their own part in the
immemorial human Warfare against nature
they would tread the Earth more proudly
the women would value them more highly
they would be better better fathers and
teachers of the following generation I
totally believe in this I think this is
actually awesome right um apparently uh
ma had the same idea uh he had some he
had some uh this sent down youth uh but
this this is this is based as hell man
like like this
is so one of the problems that I run
into when I think about this YouTube
channel when I think about the George
Hots quote unquote brand everyone has a
brand even if you acknowledge it or not
how it toic bio psychiatr are real look
um
the I have a lot of people
who would uh take Direction a lot of
y'all ask me for direction in your life
a lot of you say what should I do George
I'm studying this blah blah blah blah
blah blah blah right
um no but really really so so so you
have the ability to lead a uh to lead a
movement right um and one of the
problems that I've always run into is I
do not know how to make the people
genuinely useful to my movement I do not
know how to make most of you watch in
this video right now useful to my
movement and this is a problem Curtis
talks about
it while pushing forward the frontiers
of human power over nature is indeed
exhilarating this experience is by
nature itself limited to a few and this
is always this is what I've experienced
this is my
greatest
um joy in life right the conquest of
nature the overcoming right
um you know and you can look at that
with stuff like the iPhone uh but that's
you know that's that's baby stuff right
it's a good thing to train on but again
the iPhone fundamentally is made by a
made by humans right but when you look
at like the self-driving car problem or
asking questions about what uh deep
learning what machine learning what
machine intelligence really are um and
then building machines that can do those
things right these are these are these
are pushing the frontiers of human power
over nature um
and this
is what andreon talks about andreon will
restore thymos in two ways by the Direct
Energy of participating in research and
development and by the indirect energy
of supporting technology as a cause like
global warming or the
Palestinians
um
yeah and as a democratic cause a
movement of the crowd technological
accelerationism is a terrible product
the problem is is that it is a good
cause a pro-social orderly cause it has
no victims or scapegoats it does not
inherently harm or damage anyone in
short it's like Asteroid Defense not
like climate change you will never ever
see protesters gluing themselves to the
road to get governments to spend more on
Asteroid Defense that is because the
defending of the planet from asteroids
is not a pretext for causing any kind of
harm or damage and I just absolutely
love this I love this take on all of
these like like black lives matter okay
that's great what are you going to do
well we're going to go lie down in the
middle of a
highway okay I get it I I want to lie
down in the middle of a highway too
black lives matter let's go
right
uh
yeah look I I played with this for a bit
um I actually went so far as to buy I
own
land here
um this is this is this is one of my
websites I think I promoted a lot like
two years ago uh I've pretty much uh
given up on the
idea
uh for several
reasons it's really hard to do
anything like it's really hard to do
anything on land and RW nature like that
and I'm not willing to
devote I'm not willing to devote like my
time to it anymore a hobby I'd put in a
few hours a week but a few hours a week
would not make this succeed right um I I
do think that I'm I'm better off what do
I actually spend my time on I mean now
I've been spending like all my time just
working on Tiny fad right um you
know but I'd love to see someone do
this right the sent down
youth but you see they have to be sent
down they have to be the elites the
problem problem is it can't be opt
in uh so yeah you have a lot of energy
right a lot of you ask me what should I
do and the truth is like I'm trying my
best with tiny grad and the bounties but
again this experience is by nature
itself limited to a few unless that
magic Elixir that turns us all into einy
is invented and even that I argue uh
unless everyone is the equal level of
Einstein uh it wouldn't really work uh
because you know yes we' get rapid
progress right
but yeah
uh I wasn't really trying for G gch and
you know what to be fair this is a very
long-term project of mine I'm not
getting rid of the land I own 123 Acres
uh absolutely beautiful 30 minute drive
from San Diego um but what I realized I
need is robotic Labor uh I'm not going
to be able to succeed at this project
until we we have robots that can that
can uh that can do shit uh so you know
we make we make bodies uh and someday I
will put them to use on my land some
days bodies you're going to work and
you're going to love it right that's
right that's right um You can follow
Billy AGI on Twitter uh Billy is a Comm
body has a Twitter
account
um yeah you just look at like the money
you could make off of this um you can
like board horses and again this is like
good money to like pay like a few people
salaries maybe um you can grow grapes
but really what you want to do is it
doesn't matter about the grapes you grow
it matters about the uh weddings you
host at your Winery right so that's the
kind of person who I really want to do
this and if anyone ever does reach out
right and you're like you know I get I
get emails from people who want to be my
Livin property developer and I'm like
like bro like have you ever lived off
grid the answer to that is always no I'm
like have you ever like spent a week in
the woods and the answer to that is no
and I'm like oh God like even I've spent
a week in the woods right you
know um seriously how many of you how
many of you we here well engage chat how
many of you have spent a week in the
woods how many you have spent a genuine
I guess the longest I've done is five
days that's
good five days backpacking all right I'm
not talking you drove your tent to some
Campground like you know you can 5 days
four nights is the longest I've
done
uh four days yeah it's it's it's kind of
the limit right like like it it became
it becomes hard to carry all your food
like you can do it but then you're
really in some uh in some most of most
most of my backpacking trips are three
days two
nights
um you know if you want to bring stuff
that's going to ensure you like a a
decent standard of living then then you
got to then then uh you do that if
you're willing to bring
very I don't know like I love those I
love those
meals um I don't know I just remember
like I maybe it was just the people I
did it with too but um you five days AR
great appalation Trail all cool good see
see that's real like I appreciate
that um oh you did yeah yeah bike
packing um the cool thing about bike
packing is it becomes really like it's
really quick to get to places uh I don't
know like I did like Iceland we did
bikee packing but you know this hotel's
half T night so
places for places for
food
um the woods are scary at night bro I
feel that I feel
that I'm not scared of wolves or really
Bears I don't
know no I mean what scares me in the
woods humans and mountain lions and
rattlesnakes not even mountain lions
really just like humans and like
stepping on a rattlesnake
um I've had on bear encounters I don't
know I mean I guess I've never slept
anywhere with brown bears I'm scared of
brown bears but uh California black
bears
scary
um what's the strongest animal I can
take
down uh I never really hunted I'd like
to do that sometime I'd like to do that
sometime um if if if if if one of my
subscribers is like cool and not weird
like uh it want to you want to go
hunting I I I'd be down I was wanted to
go hunting um I did one I did one
backpacking trip once where we didn't
bring any food and uh we brought a
uh a book on edible Wildlife um we found
lots of edible Wildlife but you're
eating like miners lettuce and distan
and you're like shit this don't have any
calories in it so yeah we lasted one
night and the next day um I did Fast for
two days this year maybe I talked about
it uh we had a we had a company wait I'm
I'm really I'm really going off into the
weeds here uh my my point is
um
uh I like this I I like this I like this
as an idea uh they sent down youth I
love
it
um Kanye's building a new city in the
Middle East is this
real
uh how's the Wiscon how's the how's the
Wyoming City
going uh I love Kanye by the way you
know I love Kanye right
um just invading Israel
bro bro
uh you see but that's you know that's
the thing like like you can like Kanye's
got beef with the Jews the Jews got beef
with Harvard and Harvard's the Real
Enemy here so as long as Harvard loses
we all
win
um I'm like three steps away from moving
to a Shack in
Montana ah someday man someday
someday
uh
no I wouldn't I wouldn't mail bombs to
people what would I
do what I do no I don't
know live for a cause Don't Die For A
Cause right that's the
problem you know you can sympathize with
the with the unibomber but he pretty
much died for a cause he didn't really
live For A Cause right could have lived
for the cause uh I mean he did produce a
great a great a great uh Manifesto and
should all read it and you know everyone
knows that we're mature adults here and
we can separate the art from the artist
right because we don't believe in
identity politics
perfect
uh Kanye must be good the media is too
unhinged talking about
him man is
like there's some Kanye Clips like that
he's just so funny
man
um I would like to see the rap be good
again like I I do not feel that his new
albums have been have been good da and D
2o there there are no My Beautiful Dark
Twisted Fantasy they no College
Dropout
uh but uh yeah was the was the Wyoming
place the doctor clip the doctor clip
the
do I'm not going to say what kind of
doct I'm not going to say
oh there's a there's a bunch of Kanye
Clips like that you're just like what
the fuck she know about cameras I I
haven't seen that one she's
just reminds me a little Wayne
deposition clip where uh uh Mr Mr Mr uh
Dwayne Carter did you uh did you hire a
photographer on or about April
14th nah no man I didn't hire a
photographer look look I'm I'm a
superstar I got people to do that for me
um celebrity depositions are are comedy
gold uh I I got people to do that for
me Kanye 2020 no no Elon had a good take
on Kanye's when Kanye actually like
published his like wakanda plan for
governance
yeah
um
I got this makes me want to watch Kanye
CLP I do remember this badass bitch
birthday party she was crazy stupid
thick no no no we're not watching we're
not watching Kanye Clips you can you can
do that on your own time
um the ineffectiveness of technological
acceleration as a cure for the chestless
of the modern man is hardly the biggest
problem with the Techno Optimus solution
the problem is actually much
worse technical acceleration is not just
not the cure for the last man syndrome
no technology is the obvious cause of
the last man syndrome andreon is curing
cancer with
tobacco look at James's list of dirty
jobs dishwashing clothes washing and
window washing half of these jobs have
vanished into the ma of the machine and
it is already clear that over the next
few decades the present assault of AI on
White Collar bullshit jobs will soon be
matched by a robotic assault on manual
labor precisely the tool that is most
useful for turning lazy willful boys
into mature and effective
adults William James could never have
dreamed of a world in which most humans
are useless
um this is one of the best videos on
this topic and it's crazy how old it is
uh I remember when this came out nine
years ago uh if you haven't seen this
video I will link it in chat uh go watch
this video uh this video is
great um plumber robots are yeah I mean
yes yes it's true that we'll get rid of
the we'll get rid of the white collar
Jobs first but we'll eventually get rid
of the manual labor
jobs
um base God cgp gray truth truth truth
oh cgp gray also has a great video on
how uh dictatorships democracies and
oligarchies work uh so so check that out
um
[Music]
uh
yeah
um do anyone trained in utilitarian
economics the idea that any kind of
productivity increase could be harmful
is deeply
counterintuitive in fact there is a
precedent for the negative impact of
technological advances on society the
negative impact of resource discoveries
the resource curse is well known I
actually don't agree with Curtis here um
I think that this is actually very
different because the resource curse
exists because other nations then buy
whatever that resource is the resource
curse cannot affect the entire world
right it's not like the entire world can
discover money trees and we can all
become
lazy um so I I don't think that it's the
same thing I think that technological
Advance has the capacity to do this to
the entire world
whereas any sort of traditional resource
on unless it is total right and that is
the difference between something like
oil oil may be useful for many many
things but it is not like AGI it is not
total
uh but this what ends up happening seems
uh similar they transition from the
economic means of subsistence producing
stuff that other people need to the
political means taking stuff that other
people
have uh yeah yeah uh Ubi is not a
solution
uh I don't know what I can say about
this but an article I I got an article
coming out soon uh you guys can read it
I I talk about my my my thoughts on the
solution to this problem um it's it's
related to if you have read wireheading
City on my blog it's it's in those
lines
um this is incredibly ironic for Andre
to present the acceleration of
Technology as the cure for 21st century
words I do not
know listlessness or toror are not
caring or not being concerns with one's
position or condition in the world yeah
definitely see that enemy that sounds
French breakdown of any moral values
standards or guidance for individuals to
follow yeah yeah it sounds good man
sounds good uh which is actually the
result of technological
acceleration
oh who I've never read
this humanity is a population of
spiritless decadent socialites living
underground inside the belly of a giant
single machine then the machine breaks
and the people just die based Man based
wait I want to read this is it
long all right well I'll read that off
stream uh
[Music]
yeah one can easily see uh trosky at at
Burning Man he talks about how the uh
the Soviets were uh
accelerationists so y'all thought that
this was going to be a shi stream for
the wonders of
accelerationism uh but it's not it's not
uh I like the idea of accelerationism
right now but I do not think it is a
good long-term ideology and I don't
think that we have a good long-term
ideology um now like I mean and this is
kind of
unfortunate for me uh because I
do
personally get lots of
joy out of this pushing forward the
frontiers of human power over
nature but this experience is by nature
itself limited to just a few and I can't
share that with all of you and here on
this stream I want to share with you
guys
and I don't think I can share that I I
don't even know and this is probably
just my inabilities as a manager but
most
people even if I had
like complete if they if
they all the willpower they could muster
they devoted it to me I'm not sure what
I could do with that right and I'm not
some I'm not some like David Kesh type
who would uh who who likes that I
actually don't like that I I I find I
find that kind of like it's awful it's
actually really like I don't like if you
see me in the street and you don't know
me like don't talk to me man unless
you're cool and you can do it in like a
cool chill way but most y'all aren't
right oh George H I'm such a fan oh my
God see I I think there are people in
the world who like that I'm just like so
like like what the fuck do you want me
to say man you know at least have the
decency I'm eating or feeding of my
daughter and not come and speak to me
uh
right
um so yeah
uh this question this stream leaves with
more more questions than answers
um but you know again you guys say
Curtis is Curtis is is saying the
absolute most clear
stuff between
between you know Curtis in the more
broad picture thing uh Peter teal doing
an incredibly good job describing the
present which is kind of criticism
um
uh yeah attracts to Nikes right let's
pick some rare ass Nikes let's Heaven
gate was in San Diego man let's do it uh
no look look like like it's not a cult
because I'm not a cult leader right I've
thought about being a cult leader
but there's very little that I can
do first off there's very little I can
do with like Capital like money Capital
um there's even less I'm not very good
at deploying money capital and I'm even
less good at deploying human capital
right there there are people who are
good at these things and I you know this
is this God like something I think about
is like what does what does separate me
from Elon what what does what does he
have that I
don't
um and it seems to just be
like like a crazy sort of I don't know
I'm reading I'm working my way through
the biography now um like a crazy sort
of
I don't even know if it's like a risk
tolerance like he he I don't know why I
can't deploy
Capital um I mean in a
way okay look I'm obviously uh uh I
think elon's doing a lot of a lot of
good for the world but we can look at
someone who's a bit more neutral like
Sam Alman
right um I I you know I my my opinion of
Sam Alman has gone significantly up
after the uh after the open AI after the
coup uh after the coup attempt uh I
realized that Sam wman is not an
effective altruist and the people who I
really don't like at open AI like Helen
toner uh Sam Alman apparently also
doesn't like uh again you know enemy
your enemy and all that right so my
opinion of Sam Alman has gone out um I
also said on Twitter that I liked
uh if we look at open ai's new blog post
um so by the way I'm not you maybe some
of you watch my debate with owski I do
not think I was in good form in that
debate I rewatched clips of that today I
was like oh that's such a bad argument
why did I say that man I'm not
practicing the art of debate uh then I
rewatched parts of my Lex and I was like
damn I said some good shit in there you
know that was that was that was good
thinking um so you know if if you're
going to watch some some George Hots
videos watch the Le don't watch the
owski debate but you know I'm not a I'm
not an anti I do believe that AI
alignment is somewhat of a real thing
um it's unclear how distinct AI
alignment is from just AI capability
right capability and Alignment May
totally be the same thing uh I mean you
can talk about like the capability and
the alignment of a person um if a person
lacks capability most often when I tell
someone to do something it is not an
alignment issue it's a capability
issue uh so but it's interesting you can
read
this
like this is a very I I like the tone
here so much
more
uh This Is The Verge I I shouldn't do
this I
should
here due to concerns about large
language models being used to generate
deceptive biased or abusive language at
scale oh oh right B who cares about this
shit right um but if you know we're
talking about how can human steer and
Trust AI systems much smarter than them
this is actually a very interesting
interesting
question uh and they're talking about
weak to strong generalization
interpretability scalable oversight
honesty Chain of Thought faithfulness
adversarial robustness evals and test
beds right if this is what you mean by
alignment research this shit's great uh
especially if you're doing this kind of
research in public right like
adversarial robustness right like you
can make fun of a lot of like the
adversarial research but there are some
deep questions here um you know you
You're Building evals and test beds and
you're doing this publicly this is great
uh so you know again my opinion of open
AI has gone up um but coming back to my
point about you know what what separates
why am I not an Elon Musk or a Sam Alman
right I don't think these people are
smarter than me uh but they have an
ability to deploy capital
and I I sadly think it might be because
they're willing to
lie um a lot of what I've heard about
Sam Alman and maybe right away is why I
I didn't get that he you know actually
was pretty opposed to the effect of
altruists is he'll say yes to
everybody right even if he doesn't mean
it and Elon in a way did this to me
right like if I proposed a contract with
somebody I would stick to
it uh I mean what I say now I don't say
a lot right because I'm careful to mean
what I say
um but they seem unbothered by this they
seem unbothered by sort of leading
people on and I've come to like this
single thing is the greatest difference
right like with comma I scream you know
no Partnerships right but imagine I did
imagine I spun up a bullshit partnership
division right that told every company
we were going to work with them and then
raise tons of money right like I think I
think I talk about this I have a blog
post where I go into this a bit um but
like this is just sad if
uh I call it a disgusting Playbook
right
right um you know Elon every year would
promise level five self-driving right it
wasn't
true um you know Sam alman's crew
revenues right around the corner right
this is exactly focused on you know
maybe yeah Elon and and Sam um as in
what they have and I don't and if that
turns out to be the truth right now to
be fair you can talk also about how much
of that is my ego right how much of that
is they actually have some real skill
that I don't right and how much am I
hating on this skill because I don't
have this skill right you can say that
it's an unwillingness but is a sour
grapes on my behalf and the answer is
like maybe I don't know like I think
about that a lot and
yeah
um well Cruz also lies right so lies do
eventually catch up with you it's
interesting right it's interesting so
the lies did catch up with uh with Cruz
uh this was I posted this blog post
before the uh the cruise
accident um you know a story I heard
about Elon like after my sort of beef
with him uh you know this is one of the
like uh apparently there was this guy
who was working on the space internet
and Elon took like five meetings with
him right like long meetings where they
discussed all of this technical detail
basically on the premise that Elon was
going to fund him um Elon did not fund
him Elon cut him out and made
starlink
now how do we judge that
behavior
right like I judge that behavior as I
can go buy a starlink right and this kid
was probably going to do
nothing maybe maybe not but
again if Elon steals the idea and Bill
starlink or steals the idea right like
it's kind of ridiculous right I don't
believe that stealing the idea was
really the problem there's no such thing
as stealing an idea intellectual
property is stupid but uh no that that
he led this person on and basically got
this person to uh you
know
uh you know tell tell tell him
everything he was working on in in in
multiple meetings and then like you know
people on LinkedIn are like George
you're asking for work for free with the
bounties and I'm like I'm so disgusted
by this it's like first off it's not
even free but like fundamentally what
I'm asking you to do is is contribute to
it like an open source project you see
what it is right and if you don't see
what it is that's on you right but then
you can say the same thing about
business right if I don't see what it is
that's on me right um all
right but yeah
um utilitarian ethics are absolutely
disgusting the problem with utilitarian
Ian ism is you are willing to kill three
people to save
10 right and then eventually you just
lose the to save 10 part and you just
kill three people well like
hypothetically they might have killed
people in the future right the the the
pipeline from utilitarian to murderer is
very straightforward right this is the
problem with utilitarian
ethics
um don't let him almost SC your eyeballs
you know to be fair like what these
people also are very capable of doing is
building thymic
energy Elon and Sam they they build thic
energy right and this is a universally
good skill right so as much as I can
hate on the lying and the business
scum they're clearly both way better at
this than I am right um I've been
building a company now for seven years
at comma and comm's like like 25 people
it's a pretty good company Works makes
money uh you know making open software
it's good but you know it's not opening
eyes started around the same time Cru
started around the same time right not
Cru Cruz is stupid but like uh know but
you know started around the same
time U maybe you just need to partner
with someone okay so let's not use that
word right so this is another maybe this
is a character flaw of mine
uh
let's the word partner is is actually
pretty disgusting to me because let's
just be clear about the hierarchical
relationship here right either they work
for me or I work for them right there's
two ways to quote unquote partner with
somebody
right um you know they work for me or I
work for them uh
could I
like the problem is also a lot of these
people are just like liars without any
sort of confidence to back it up
right you talk about that Starling story
right and like let's think of the flip
side of this right let's think of an
Elizabeth Holmes right Elizabeth Holmes
and thoros probably shut down
numerous uh micro fluidic blood testing
startups right just by kind of out
competing them a fake bullshit Market
where they didn't get any funding right
and that is unforgivable right that is
the that is the right so had Elon like
taken funding away from somebody for
starlink and then not built starlink
himself well that's uh or robbed someone
of thic energy uh and then not built it
himself right that that would my my
judgment would be very different in that
case but uh you know he built it and you
can buy it and that kind of that pretty
much absolves you of all of all sins
right like fundamentally if you deliver
and then maybe that's what it is maybe
it is just a completely irrational
belief in
yourself um you know literally $120 a
month I can buy this they're in Best Buy
right like how cool man how
cool
uh pretending to build hyperloop to
prevent Rail Project
S I don't think the hyperloop is the
reason there's no rail projects in
America man um and I you know again I've
uh I've driven I've been driven in a
Tesla through elon's tunnel so again as
far as his infrastructure projects go
uh it's just it's just not scams right
like you built an actual tunnel and I've
been in it right I've never been in a
cruise car I don't even know if I can
sign up for a cruise car but I've been
in elon's tunnel during C yes right
pretty
cool
um didn't Biden push the speed train
bill yeah where's my fucking train right
like you can do whatever you want but
where's the train right fundamentally
have I been on this train do you know
anyone has been on this train there's no
train
right uh what I think a tunnel it's
pretty cool it's a pretty nice tunnel I
like
it
for
uh I worked on a song a bit this
morning uh like a show tune
style
uh but it wasn't that
good you know it's it's it's
it's uh it's Christmas right I didn't do
any work today I was like today's
today's a no work
day um I smoked and went for a walk and
I listened to Peter teal and now I'm
sharing it with you
guys uh you sold out you used to shill
your Instagram yes but only ironically
bro only ironically by the way I'm
partnering with you sleeve they make a
sleeve to hold your Vape man and it
holds Vape around your neck you can
click my affiliate link and you can get
$8 and by the way have I talked about
the therapy session that I had with
Better Health yes better help really
change my perspective on everything and
if you use my code right here Link in
the description you too can start
improving your well-being with better
help and I'll also mention if you're
thinking about building a website have
you considered Squarespace Squarespace
I've never been to the website but I oh
sorry sorry sorry Square I built my
website with Squarespace and it really
changed my life the therapy Pro sorry
the the website building experience
provide oh I can't keep this straight
man hey Tony Tony you got to write
better scripts for this shit the
advertisers aren't going to sponsor
us oh
yeah starlink for homes internet service
and by the way while we're talking about
internet
service have you considered surfing the
internet with surf shark surf shark VPN
you can pretend to be from any country
even some countries that don't have ads
or you can watch content or you can
particip or you can go play Counter
Strike on on a VPN to make your ping
time higher so then when you run your
cheat you're less detectable by the
server
right
[Music]
um
uh that kid man he's just Amazon Fire
stick in a
hotel I don't even know if that story is
true
man look look and I'll say like you know
normally the people who are doing
destructive shit like the people who are
like hacking and then like releasing uh
releasing like uh you know like private
like like the TJ Maxx hacker and stuff
right like that's just illegal shit but
you know which to the point now when
you're you're hacking Rockstar and
stealing their GTA like don't I mean you
know kind of criminality is bad but also
come on man this is funny as shit don't
lock the kid up
man you know indefinite Hospital
detention how true is any of this right
God you
know it's just like it's sad to think
about they they pumped them full of some
primitive Pharmaceuticals right you know
that future aned Voyage they pump me
full of primitive
Pharmaceuticals um
he tried to Ransom them
yeah yeah I don't know man we can't
support criminality we can't support
criminality right criminality is bad but
we have to be able to separate the art
from the
artist
um he used anazon y Tony Stark built
this in his cave with
scraps h no Ransom is really no no like
the ransom wearing of like hospitals and
stuff no those those people are just
straight up criminals man
um but if you believe fundamentally that
information should be free you got to
just you got to be idealist man you got
to do it and be an
idealist you can't do it and and and be
a uh you know be a be a be a like a like
a criminal right it just taints the
whole thing but if you just hack people
and say information should be free man
you know I don't know I don't know
that's a it's an easy C it's an easy
terrorist cause for me to sympathize
with um don't worry I heard recently
that the NSA and the CIA are less
well-run than the DMV so you
know that's a kind of a comforting
thought to be honest if it's true I
don't know if it's true but it's kind of
a a comforting uh thought mik's dead I I
vaguely remember that I met him once
cool
guy
s um do I support cod's law ethos and
[Music]
crypto
it's hard right I can see both sides of
that argument I can see both sides of
that argument like I don't
know do we have a civilization or not
like you got you got to be against
stealing man like you got to you got to
be against stealing but like I don't
know like here's what I support here's
what I would support on the Cod is law
question um one way to make all systems
much more secure is to make hacking
legal
right imagine a world where hacking was
legal uh it'd be an interesting world
because I I gave this talk once I
couldn't stand like like by the end of
my quote unquote security career um this
was the new line that I was giving
people I'm like you guys if you actually
cared about security we need to Lobby to
make hacking legal right because then
things will actually become secure as
soon as hacking is legal the the the the
cost of find the browser exploit will no
longer be 100K right it'll be 100
million because when hacking's legal we
could have you know large well-funded
corporations trying to exploit browsers
right and then we'd actually get secure
code um so uh yeah I
think here's what I'm gonna say about
cod's law all right all right I got this
i got this i got this I love this I love
this analogy oh
man we have two zones right we have like
the P versus ezone and the P versus P
zone right we we have two zones of
crypto we have the zone of crypto where
normal laws are enforced and we have the
zone of crypto where code is law right
come on come on that's based as shit we
need that I like that right and if you
enter the PVP Zone you are a consenting
participant in the cod's law game right
I love it like you know you you got in
on on on pancake Swap and someone robbed
all the pancakes from the Master Chef
like bro sorry sorry you're in the PVP
zone right so that we have the PVP zone
of cryp where kot's law and the PVE Zone
like usdc right like you stealing usdc
man you knocking over Mount goau and
stealing Bitcoin I mean that might have
been illegal Beyond a cod's law thing
but like
uh you know like like like the Dow you
know remember the original Dow hack in
ethereum would have the Dow hack been in
the PVP Zone in which case the Dow
hacker could have been like pwned you
noobs right like that's the world we
want to live in we want to live in a
world where we have Clarity we have
clarity about those laws right cuz like
in I mean you still might want to not go
around bragging about how you pwn the
noobs right cuz someone might you know
shoot you but uh PVP and
PVE I code his law right unless I lose
money right that's what it is in crypto
right now a lot of idealists talking
about how code is law no government you
have to come give me my pancakes back
someone swapped my
pancakes right you have these crypto
compan it's actually kind of funny right
they they might talk on Twitter about
how code is Law and then they get hacked
and uh yeah so you know we got to have
we got to have consent right it's all
about consent I love consent you
know
um that's wild how fast they switch once
they're
at oh
yeah I don't know if pancake swap got
hacked I'm not trying to a slander
pancake swap here I just think it's a
funny name right I love the binance
smart chain um I didn't make money on
the binance smart
chain I did not I wanted to make $2
million on binance Smart chain but I
didn't I didn't make any money on
binance Smart
chain uh Caroline is she uh is she free
is she free what's she up
to uh cheape though all right guys I
scammed you all I scammed you all guys
cheape man I pre-mined it I pre-mined it
and I I hid the pre-mine right there in
the code man oh man the che you can go
join devith man is Dei still up I'm
waiting for the tiny grad
oh I'm waiting for the this is this is
the cheap e the cheap e hater Discord
right I just love to see the thos you
you know um for for reference I lost
$5,000 on cheap e right so whenever all
the haters on hackers George was
involved in this Shady crypto project oh
my God like this is why no one legit
wants to get involved and all you getter
scamers
right you know you just you
just
um yeah no the debie the debie guy was a
big name hater in the cheap e Discord
but you know he put up a website he made
his own chain right we got we made the
cheap e Bridge from cheap e to it's all
about having a good time and a lot of
people in crypto forgot that when they
got rich right and that's why crypto is
is sad because like you know people get
rich and they all forget about having a
good time right you get hacked you all
forget about your ideals about code
being law real fast right all
right um is crypto still EAC Bros I'm
not EAC okay like like this is like it's
not
a
like Twitter movements are are I don't
have that in my bio right like we can
talk about effective accelerationism as
an idea right it's like the free zone of
Scientology right auditing is pretty
good I love whipping out my e- meter to
get people to calm down right but like
like I'm not going to pay the Church of
Scientology right like read dynetics and
buy an
Emer
um
tiny grad coin
oh all right good stream that was
today's stream think we covered a lot of
good topics uh I'm sorry I don't have
any answers for you
guys
um
but we talked
about
accelerationism and then techn pessimism
and that's what news is okay so we did
news tonight and that's why I was just
chatting
uh Merry Christmas everybody uh Happy
Holidays happy Hanukkah if you celebrate
K Quanza does anyone actually celebrate
Quanza if you celebrate Quanza you have
a great Quanza you have the best Quanza
you could have man we love everybody on
the stream um if if you celebrate
festivas I I think that's a that's a
that's a holiday thing man if you
celebrate the Flying Spaghetti Monster
fuck you I hate atheists man that's one
religion I can't tolerate you got guys
are so dogmatic spreading you're shitty
atheist there's no God beliefs man you
all read Dawkins and you got smug like
go read the Bible George I hate that he
says Christian shit oh my God I'm
kidding man you know what it's like the
it's like the what's the narcissism of
small differences no we're spreading
holiday love everybody happy holidays to
all faiths and denominations but really
Merry Christmas because the uh meek
shall inherit the earth Jesus Christ all
right bye every
everybody
I thought uh yesterday's stream was
pretty low
quality uh it's mostly just a lot of
yelling um you know whenever someone's
angry it's really because of
uh you know an internal struggle you can
lash out at the outside world but it's
not the outside world's
fault or to put it another
way the only thing you can
control is
yourself uh you can spend a lot of time
talking about how the world should
be but mostly that gets you nowhere
focusing on how the world
is is a lot
more
productive uh machines of ever loving
grace I read this last
night um
how AI could transform the world for the
better he talks about a lot of
uh talks about a lot
of Bio things Grand things that can
happen I don't think that maybe this is
the right framework with which to view
this and I can kind of explain what my
goal is with tiny grad and we can try to
think it
through uh we can try to think
past
um put it in the tuning gry but that's
probably
appropriate just call plan
ond so what I sort of
Envision uh the world becoming is is you
can think of data centers as
brains big
brains um then when you have a big brain
you have the question what should they
think
about so our maybe should is still the
wrong word uh we need to get away from
should thinking and we need to move to
is thinking so what will they think
about
and you can maybe ask a question uh who
controls
them I think the answer to this is going
to be pretty I think the answer to this
is pretty
obvious uh at least if the world looks
anything like what it currently looks
like which is the
market the market of course
so you can say you might have uh
fantasies of power where you control
this big brain I know I've certainly uh
thought like this before where you
control this big brain and can finally
have it do your bidding and uh reward
your friends and punish your enemies and
so on and so forth um but I don't think
that's actually what's going to happen I
think you're going to have big brains
and they're going to be controlled by
the
market
now how much control do we we
get do we or let's say I
get
um
so in my more calm and Lucid moments
when I think about this kind of
stuff I think that the
goal the best we can hope
for Hope for is a free market
um your guy won't be the
winner it's just
say um the best we can hope for is a is
a free market your guy won't be the
winner uh
so how do we
make how do we
promote the free market
you'll
see Elon
building uh xai Data Center elon's
building a very
large some trash news but
um uh's start using perplexity more
perplexity is pretty
good I use perplexity all the time on my
phone I don't know why I don't use it on
stream um
so elon's idea is kind of I'm going to
have all of my gpus in a big
room uh but or I think
um let's see
uh see how recent perplexity is collapse
of h100 rental
prices know I've been reading some stuff
about this
here um perplexity has gotten a lot
better I'm I'm impressed with this uh
so like if you have a big GPU
cluster uh
what do you do with
it how do we promote free market how do
we
structurally
uh uh
favor R
seeking um if you have a big GPU cluster
what do you do with it
so where does
agency uh exist in the
world turn up gain can't hear me
well uh where does
agency of signal to
noise should I go buy a
microphone okay
um
so if you have a big GPU cluster what do
you do with it and the answer is
whatever is the most
profitable and then you can have the
age-old debate between central
planning uh versus free
market and um you know free market
wins some people think that this might
change in the era of
AI but I don't see any real reason why
that's the case people think that oh
well we're going to put we're going to
have big brains which can do big Central
planning and big Central planning uh can
finally solve the age-old problem of
resource allocation from a central
place but the fallacy there is that
you're saying you're going to be the
only one with a big brain and you're not
lots of people are going to have big
brains uh so let's ask
some uh I really I I've started using o
one is significantly better than what's
come before I I just feel like it's
a you know standard deviation IQ higher
um so how many uh let's say one megawatt
let's say 10 megawatt plus uh data
centers are there in the world
so that's that's something like 20,000
gpus
um robust
increase
interesting uh so this probably gets you
to
some to some decent
uh maybe there's going to be something
like 10,000
brains in the
world so people are working on uh
distributed training kind of stuff too
if you saw distributed training
run wow all these search engines are so
bad if I do like recent distributed
training run is this going to get
it no
there was just one on Twitter some
people are doing a distributed uh it's
distributed across four data centers um
they're doing like a 10 billion uh
language model uh train but I think this
is one of the main misunderstandings of
a lot of AI doomers they think that all
the AIS are going to work together and
be on a team they think that truly
enlightened beings for some reason all
all see reality the same way and team up
and I think this is a uh a fantasy
colored by a political ideology not a uh
fact about the world I think
that you're going to have pretty much
the same distribution of cooperate and
defect uh as yeah this comes back to the
end of my owski debate which is he
thinks the prison dilemma is solvable
and I think it's of course not
not
um yeah yeah yeah new yeah news res is
doing it uh new resarch is cool we like
them thank you for the
link uh no didn't they actually I don't
know about this
one
um I remember this one being light on
precise uh
details there's some people you're doing
a run maybe they are using that but
regardless it doesn't really matter um
so if you have 10,000 brains in the
world uh you know what do they think
about so there's going to be a lot of
people trying to runseek
open AI right now is trying to runseek
everybody's trying to capture value
everybody's trying to be uh the
intermediary
um so everyone is trying to R
see uh I think Sam Alman tweeted this
morning I I don't know if if he is
self-aware he's like I I'm using chat
GPT to uh clean up the picture of this
Walled Garden that I want to build and
I'm
like are you like like are you trolling
do do do you understand what a walled G
um so everyone is trying to rent seek uh
our job is to stop
them
uh I think that's kind of the best I can
hope
for when I when I think
about what change I could actually
potentially make in the
future uh if I could figure out a way
not for ever to make rent seeking
structurally impossible so I think one
of the greatest um I think Satoshi is
the
postmodern
uh it's like the postmodern
hero right Elon has very Henry Reen
Vibes uh tank Reen
uh like like it's very it's very outly
Shrugged and modernist which is cool
which is very cool and I'm you know I'm
happy this
exists but what does that's not a
postmodern Victory that's a modernist
Victory uh the the Starship being caught
in the Chopsticks it's it's very
cool
um what does it mean though the problem
with things like this is they largely
centralize power and I don't want to go
off on a on a on a um again we need to
avoid what should and we need to talk
about what is so everyone's trying to
Ren see our job is to stop them and I'm
not talking about this in a in a high
fute and philosophical way I'm talking
straight up about you know uh chat GPT
charge charge per
month
um there's nothing wrong with charging
per month but every that charges per
month so cable TV originally had uh no
ads it was going to be monthly and have
no ads and then oh well now it's monthly
and there's ads so you get you get in
ification
um they called it Prime
intellect yeah this is the one I'm
talking
about
um so what what these things basically
are is my understanding is using
uh algorithms that require less
synchronization and I think this is true
I
think architectur is going to move more
towards uh you'll have roll out workers
and training workers and the latency
between these roll out workers and
training workers can be uh can be large
so there was a very successful uh
distributed training
run um
wait
what my understanding is this was
trained across
uh so chbg charge per month Claude
charge per month
uh so you have a kind of
Stack all in a stack so you can think of
like the stack as something like you
know at the bottom you have uh the
Silicon right and then tsmc is adding
let's say you know 20% and then we have
Nvidia adding 90% right and then there's
you know uh markups
here uh and then we have you know so
like this is something like Azure maybe
adding something like
30% and then we have open AI trying to
add you know xx% on top of it right
because that's not a uh because it's not
a mature Market it's not clear what the
margins are going to be but um so let's
say the Silicon has uh let's say they
have 20% margins too the thing about
these margins is they all
stack so I think I'm going to multiply
this right I don't want to pull pull an
Andrew huberman
here but I think that so you start with
paying $1 then you pay for the
Silicon right then you pay for
tsmc then you pay for
NVIDIA then you pay for Azure and then
you pay for open AI let's let's give
them a uh let's give them a 10% margin I
actually think they're losing money but
you know that margin will get bigger
right so you know a forx uh goes to
rent um
Elon maybe talks about this in terms of
the uh the idiot index it's it's you
look at an h100 and you say well how
much do the Silicon atoms
cost
uh let's see let's see what what this
website says about what Ren seeking is
I don't think it necessar it's
interesting they only talk about it in
terms of
uh in terms of of government it's not
yeah I shouldn't say all profit margins
are bad right um so this one
is uh you know very high right now this
is where we're trying to compete um this
one is uh uh VC
subsidized
subed spell that right probably
didn't
uh uh so what it means to be VC
subsidizes it won't stay I think about
the prices of
uber uh you know I when Ubers were they
cheap now Uber not so
cheap I can see your
chats
so let's think about this in the in the
longer term
future um I shouldn't say our job is to
stop them that's let's let's let's just
uh let's just talk about the stack
because this is something that is a true
fact about the world Forex goes to we're
not going to call it rhy we just call
margins
okay um you know
I like I do have
a
uh ability to sit down and and think
about things and make plans and I wish I
was better better at it you know I wish
I was better at thinking more clearly
all the time and you're going to try to
watch my thought process here and you
can you can see if it's
uh it's good or bad
so I guess a lot of my thoughts on on
Tiny grad are
somewhat
uh we can talk about the goal and then I
can talk about how I got there and we
can see if the goal actually makes sense
uh build
a uh
free
large free fair and simple to
access uh market for
thought it's kind of that it sounds
lofty it sounds like and if the
next thing that I was going to tell you
is uh you can purchase my uh you know
token to access this Market you should
be like
scammer um
scammer
uh so what tiny grad is a
language uh to
express
uh is a uh language to express uh
machine learning jobs concisely
um uh
compiler to compile these jobs to run
oner uh auler
well to
uh
determine the layout
uh
order of the sub
[Music]
jobs to compile these sub jobs to run on
real
Hardware uh a runtime to
actually uh run the
jobs and you can see this like this all
exists in the tiny grad code today this
isn't like stuff that will exist this is
stuff that already does
exist so I'll show you
um this example from Tiny grad to kind
of understand where we're
going
um it's called stunning mest
like you have this
uh
this a a few things are are interesting
about this example you see that when I
do my uh data sampling so mest is small
and fits in the entire GPU but just
because something doesn't fit in the
entire GPU doesn't mean you should have
to express it in a different
style so you see that I first take all
the samples um my dimensions of this
tensor are steps and batch
size now here I Loop over all the
batches but this is a python Loop you
really don't want this to be a python
Loop you really want this to look more
like
this um where I can specify the range to
go
across in
uh like in the graph not having to break
the graph to do it and then when you're
left with
this um so this is already true I mean
we can actually go here and run stunning
amnest so you see that until we schedule
stuff I'll run it with dbug equals
one oh it is opening the device early
now uh well that shouldn't really be
happening or maybe it's opening the
device but it's not scheduling any
kernels uh it has to open the device I
guess to it allocates the stuff there
but we could even push that allocation
to
later um so you see that it's not until
you get to you get through all the code
oh here we go we have actually a check
to make sure that no kernels are run
during scheduling so we only actually do
anything at the end um and this loss
thing is so that I can iterate and get
the loss out but I can say loss equals
zero and then it will actually schedule
the entire thing as one shot so it
schedules all the batches together as
one
shot um it's only that because I didn't
do a lot of
batches uh so we can we can raise the uh
we can raise the sorry I didn't do a lot
of steps so we can we can like raise the
number of steps to 30 or something and
then oh but see there we go there's a
bug probably raise it to 20 can't even
raise it to
20 um metal doesn't support uh large
amounts of buffers
so yeah we can use we use GPU back
end GPU back end
does so you see we've scheduled now uh
this many kernels to run and eventually
so right now because it's still written
in this style the Kernels have to be
scheduled like all in a line it's not
aware of this Loop but when it's written
in this stle it will be aware of the
loop and I'll also note that this code
is two lines shorter than this code
so you'll be able to specify the entire
there we go we got a decent uh accuracy
uh the error in metal is that metal has
a limit to how many buffers you can pass
into a single
kernel so a language to express um
now
uh
entire so imagine a language to express
the entire gp4 gp4 training job
uh well let's talk about the Llama
training jobs since they're open
source so I think I think we can
actually uh you know Google and get some
information on this
um it's still called Google even though
I'm using
perplexity uh llama 3
[Music]
number of training
steps and batch size
uh so it was trained
on 15 trillion
tokens this is so
good imagine imagine how long it would
have taken me to find that information
with uh with
Google I had to go to the paper we'd all
be sitting here oh
man a love
AI
uh so
yeah whatever they they have a micro
batch size but either way it's it's so
it's this many steps uh and uh 4 million
badge
size so you can specify but uh
only like 10
KB to spe the whole
job you can specify that in
entire uh job here
um how many GPU hours were used and
what's the approx
cost well come
on come on don't do
that don't do that
oh that's
bad I don't log into things on stream it
makes it harder to use things I don't
like that you have to log into
everything see this is this is the rent
seeking
 right perplexity should not do
this this is this is a this is a huge
mistake
[Music]
um okay so
77 uh 7.7 million GPU
hours so you know you
can um the whole $15 million job can be
specified uh in 10 kilobytes so
imagine uh
imagine uh submitting
uh that job to a
Marketplace so when you look at right
there with perplexity and the rent
seeking uh imagine whatever perplexity
job template is exists in uh in tiny
gred format and then all you have to do
is basically change one of the input
tensors with the the uh the new thing
because these jobs will be so simple to
specify people will end up using this
format and then you say okay but you
know people aren't going to release the
job template and they might not but a
big
Advantage uh
so uh a big reason uh the
internet
uh it sucks today is
um the uh cost to maintain
infrastructure I'm probably this stuff
probably is the kind of stuff the
ethereum uh people are saying but so you
see me using perplexity even though I
know how to run llms locally even though
I have uh a hug ug amount of gpus in the
cloud that are that a huge amount of
gpus remotely that are mine um I'll
still use perplexity and I'll still use
chat gbt somewhat because the models are
better but mostly because it's more
convenient so um you know
bring that
convenience can't spell
 why do I have to why do I have to
go to the Internet for this and send
uh to even to all players uh even the
smallest so once it becomes just a uh
small job that that you can
submit uh
no uh remove infrastructure advantage
sa the
not so our slogan since the beginning uh
our mission is to commoditize the P flop
uh that's pretty much what I mean by
that
um I don't know what 238 is anybody who
is selling something that look anybody
who's trying to build the market before
they build the
infrastructure uh I don't think should
be taken
seriously the market is very simple uh
compared to the really hard work of
building this kind of infrastructure now
a lot of people are building this kind
of infrastructure so how do you actually
run this llama 3 training job um half of
the challenge is this and meta is pretty
open About It meta's released a lot of
good
stuff
uh meta paper on llama 3 hardware
issues see this is this is this is
bad uh
no see this gets me to go back to
Google it's even an offensive
color it's the same
link
um where's the actual
Source the article
better
uh okay now can you show me the paper
Okay so that's how long it took to find
that URL signature expired never mind we
haven't found it yet let's try searching
for
that and then maybe slowly finally
loads is it in the Llama paper
Google outing your pink it's my
pink it's in the Llama paper
okay uh oh here we go yeah so they they
talk about all of these uh all of these
infrastructural difficulties uh with
with training llama um remove
infrastructure advantag and and save the
internet don't uh allow uh rent seeking
on infrastructure this
time so a lot of what's happened with uh
like Google
and like half of these things that half
of these SAS apps that manage to charge
you $20 a month a lot of it has to do
with like
uh I want you to think like think for a
minute about setting up a uh
database right so you want to set up
like a mySQL database oh well that's
easy I'll just spin up an AWS node and
set up a mySQL
database U but okay what if it scales
beyond the one
node
uh okay I'll make it a big Noe I don't
think we'll scale there yet okay well
what about backups all right we're going
to need a solution for backups so I
wrote this script that uh lets me
uh it automatically backs up the
database every night and stores it in
this S3 bucket okay well what about uh
you know how do I make sure that
script's actually running every night we
got to we got to occasionally restore
from our backs so we're going to need
some monitoring okay well here we have a
dashboard we're using data dog and it's
going to send you a thing and it's just
such a pain okay so now we have AWS will
host your MySQL for you but now what
they can do is rent seek the the problem
is that AWS MySQL is not
commodity S3 is not commodity even when
you're using
S3 so we get a chance now with software
2.0 to reinvent
the uh all of this core
infrastructure we get we get a chance to
build all new things we get a chance to
build them in such a way that they are
taken for granted as free in the way
that Linux is taken for granted as
free
um
uh AI infra must be
taken for granted as free in the same
way a Linux is so if you look at the uh
the
Starship thing yesterday uh how many
Linux Compu
do you think there are on that
thing
like I believe that it's infrastructure
that moves the world
forward I think
that the bigger Arc of History bigger
than the rise and fall of
Empires uh bigger
than
any bigger than bigger than dynasties
bigger than political parties bigger
than any of these things is the story of
the growth of
infrastructure history is the story of
infrastructure
Improvement
um does Improvement have any I can't
spell it does
I get a spell checker like of all the of
all the AI I'm sure I can get some AI
thing in
there um this kind of sounds like
herbit it has some
similarities um herbit seems very
complex to me it also
seems uh an sa on economic theory so is
this is this kind of the
I these are probably all rehashed ideas
I've heard I've heard somewhere else and
kind of and kind of
synthesized we're all not really doing
reasoning just like the llms
probably worth
reading I think kind of Economics is the
master
science I think if you really want to
understand the destiny of humanity it's
best to look at economics more than any
other
science curse her but it just spell
checks yeah
uh
so like this is kind of what I'm
thinking
um some of it's frustrating and I think
that uh I get caught up in bike shedding
a lot too I think we all kind of
do I
think that all fall for
traps it doesn't matter what country
you're
in it doesn't matter what infrastructure
what physical infrastructure you build
because the physical
infrastructure is
commodity what's not commodity is the
software the biggest place that the
modern tech companies are capable of
rent seeking is they have a database and
then they put access controls in front
of that database or or they have a they
have a service they have a commodity
service and they put access controls in
front of it and it's that it's that set
of access
controls that is
uh I'm practically pitching you the
ethereum project here it's that set of
access controls and it's not that there
shouldn't be access controls of course
there should be of course you can't have
an open database that anybody can read
and write to uh even Wikipedia has has a
set of rules and a set of a set of
hierarchy right Wikipedia has has
moderators Wikipedia you can't do it
without that
um
so yeah but the thing about ethereum is
anybody can go and read uh any contract
and understand how
the stuff
works uh anybody can understand exactly
what the rent seeking is and anybody can
Fork so anybody can you can take Unis
Swap and you can make Sushi
swap uh and it's it's that it's that
fork it even if the fork doesn't happen
just the thread of the fork prevents Ren
seeking you can't Fork
Google
um can only disrupt it and perplexity
needs to get rid of that awful
screen like don't do that if you're if
you're ever building a product don't do
that uh what you need to do I understand
you want to make money I understand you
have a you know you want to you want to
convert me to to being a user doing that
frustrates just frustrates people it it
hurts your brand figure out how to use
carrots and not sticks to get me to log
in um I'm not sure about the n Focus or
anything like that I think
that if I want
to I don't beat Elon by starting a
rocket
company I don't beat Elon by building a
larger data center than he has for Tesla
and
xai if I win I win as a
postmodernist if I win I win through
you know I'm pitching you guys the the
ethereum project here kind of I think
there's some problems with the ethereum
project uh I think
that they
get yeah um I think that you know the
computer's not very powerful uh I think
that a lot of
decentralization is not as
important comma is not decentralized
right so so you kind of have a a
spectrum this stuff comma is not
decentralized but it's forkable it's
forkable in both the software and the
hardware and the hardware is not open
source but it's it's forkable right
there's there's people out there
building uh competitive hardware and
this is how you build an
ecosystem um
cheap e won't save ethereum uh cheap e
was just kind of my way of I was making
fun of the
l2s you can get
into
nuanced Uh crap about crypto
like a lot of the a lot of the the L2
debate and you'll see you see what I
mean you see what happened in the
ecosystem it's it's all cheap
e and what do what do you think what do
you think ethereum on the uh on on uh
optimism the other one
R uh oh it's a roll up it sys the state
well it'll syn the state less often so
on and so forth um the whole the whole
thing is just building a bridge and yeah
I don't know I don't I don't want to get
into the the the Nuance of this sort of
stuff the the the basic idea is um you
know our mission is to commoditize the
pay to flop AI infrastructure must be
taken as granted for free in the same
way linuxes history is the story of
infrastructure Improvement um and the
rent seeking slows that story
down engineer
512 I think you're missing the point uh
the idea that
the you know I think that the maybe the
chat can be better if we only have the
uh subscribers speak because we all know
that subscribers are better people than
nonsubscribers
um I don't agree with
this I think
that the world ends up in free markets
anyway you're paying a big cost to not
have a free
market um you know it's it's kind of
like the like the economic theory about
um you know discrimination based on race
and hiring like you can do this but
you're paying a cost in order to do
it uh okay so uh I think this is I think
uh I don't know why I'm I'm listening to
to to most of you in in the comments
it's like this is what I have figured
out um you can believe me or not you can
uh join me or not you can join the tiny
grad project I think I've kind of laid
out what the tiny grad project is here
uh if you have any good questions about
the tiny grad project I'm happy to
answer them but uh this is kind of my uh
lot in life at least for now I work to
improve this and I work to make this
possible it's a language to express
entire machine J machine learning jobs
concisely like the entire L3 training
job schedule to determine the order of
the sub
jobs um and I mean you can imagine that
scheduler being the uh the
marketplace hopefully hopefully everyone
can kind of see how this becomes machine
learning jobs there's going to be a
uh there's not going to be a split
anymore between training and
inference uh like that that splits
increasingly going to go away remember
that humans uh don't have a a split
between training and inference so it's
all just going to be throwing large
amounts of compute uh at solving a
problem and hopefully we can express
these things in a very simple language a
simple language that manipulates large
large amounts of data 10 10 kilobytes to
spec a $15 million training job like
that that's that's huge and you can
also prove that this training job is
happening right you can use you can use
like a hash chain and prove that this
training job is actually
happening
uh what wear is the hardware for tiny
grad so tiny grad has a huge set of
backends um tiny grad runs basically
anywhere again the details of this
Marketplace are somewhat less important
the marketplace could be uh people
putting their data center on the
marketplace the marketplace could be
people putting their Tiny Box on the
marketplace right if you have a Compu if
you have a training job that you want to
do on a single Tiny Box um there's a
question about security of your job
right if you're sending it to someone's
house of course they can see what the
job is you can you have to trust
whatever data center you're running in
um do you actually have 20 megawatts why
do you have 20
megawatts uh you know I think that like
as cool as this stuff is it's it's
really easy for me to like get get uh
caught up in all the in all the details
of actually building these data centers
uh and we do we sell the boxes the boxes
are pretty good uh fill it with tiny
boxes fill your fill your stuff with
tiny boxes and
uh you know add your stuff to the
network and that's it um I'm going to
have a we're going to have a small uh
test cluster up but I think that yeah
you can you can like add yourself to our
Marketplace and we'll rent seek for a
moderate 10% on our
Marketplace
um business-wise is Tiny grad the
uh the the
marketplace uh or is it the software
interface layer uh well teny grad is the
is the library and then Cloud equals
uh is like will connect you uh to the
cloud and uh
yeah you know you
can have a
Marketplace uh for your jobs I I don't
want to okay all right so let's let's
let's let's focus on
a
um you can't be everywhere
yeah
so at what level of the stack do you
want to play where does the winning
happen are you winning
son
um I have a beautiful the the the white
is so uh scalding to my eyes because I
have a I bought an OLED monitor this is
a this is a Samsung OLED monitor
um so what you want to do is uh create
the
economic uh gradient uh for others to
profit
off of your work
basically um
my goal is not to I'm going to build a
small uh I mean I'm going to basically
install a small test data center in uh
at comma um
but so uh think about it kind of like a
tiny uh
franchise um you know
buy uh tiny
[Music]
boxes um you know
uh pay uh franchise
fees uh set them up
somewhere uh pay franchise fees to
be part
of part of the timey
Network
um and uh
Cloud equals one will
route uh
jobs to
you if you are offering the best
deal the franchisees will be small
um so like we are going to have to we
have to
build uh the
first uh
first uh test
franchise um so I'll
note uh
no uh crypto no
token no decentralized like
that um my basic thesis on crypto is
that the only uh benefit to crypto is
regulatory
Arbitrage if you're trying to build a
drug Market or an illegal Securities
Market crypto is a good choice
um because these things
are uh you're willing to pay the cost
for decentralization for these things
because these things are illegal
um and you know you can either pay that
cost there's a lot of different ways to
build a drug
Empire
uh
but you know that one you're you're
willing to pay the extra cost for the
decentralized stuff uh there's nothing
illegal about this this is a this is
this is a completely legal this is
basically a a cloud business um but it's
a cloud business that's allowing
franchise so think about imagine AWS or
Amazon a lab franchise and they don't
they build it all in house and this is
partially because it's very hard to
run uh these sort of data centers and
they require a lot of specialized
Hardware where I think the machine
learning stuff largely does not so you
can think about what vast AI is
um I like vast AI uh you know a lot of
people a lot of people talk about how
they're going to build these things vast
AI is actually out here doing it you can
rent gpus on these things the gpus are
actually real uh it's
cool so you know again no crypto it's
just just a Marketplace but I think this
is operating at the wrong
level uh I think you're renting a
machine and you don't want to rent a
machine you want
to um
you want to pay the job you want to just
uh submit the job uh so there is a
question of uh
storage um my thoughts are to make a
big uh hash Value Store uh so a hash
Value Store I don't know if there's been
name for it but it's like a uh instead
of having it's a key value store but the
key has to be the hash of the
value where the key is the hash of the
value right so you can regenerate all
the keys from the values basically um
and then it says a lot of a lot of cool
things right because like it also it's
like I don't know like one to one onto
one of those like functional things I
see it as a I see it as a diagram on my
head I'm not always good at at at
explaining what these things
are um so it's it's content
addressable uh addressable
tensors like uh for example example of
alids and you can put all of them in one
in one concatenated tensor you can you
can you can slice and dice the
tensor uh it it all just works like
that um I'm not even sure I want to put
any metadata with it that tells you like
what the type is and stuff if you want
metadata you can just uh you know put
that in the in the tensor itself so like
right now I don't think I did it but we
should
check
um oh okay so Safe Load itself can take
a
tensor so so you can you can you can
pass a tensor in uh to the uh Safe Load
function I think you can pass a tensor
into the P function so you can basically
have the data be a tensor and then that
tensor will be all sliced up uh
appropriately
yeah so that's
that thousands of people supporting a
single large job um I could see people
using it like that but
again I'm not sure that's the part that
we have to play I'm thinking about
exactly what part in this stat stack we
want to play and you know we're already
building a compiler and an operating
system so I don't think we're also going
to build physical data centers I'm not
even so sure that like I guess I I do
like the idea of maintaining the
marketplace I do like the idea of at
least even if maintaining the
marketplace at first is just simply a uh
Whit list in the GitHub repo of
different Cloud providers you can
connect to and you'll be able to like
search all the resources connect your
tiny grad uh to Some Cloud that you
don't really have to worry about that
much um and uh you know it's just it's
just you pay your small amount of
franchise fees to basically uh ensure we
we as Tiny grad promise you that the
machine that you're connecting to uh is
giving you the right answer right this
doesn't have to be solved in an
incredibly expensive decentralized way
this has to be this can just be solved
in a uh you know someone sends me an
email gets a complaint explains it to me
and I uh you I deal with
it so I I think that that won't be um
that big a deal and we can have
instrumentation uh to make
sure uh yeah this all works but so we
first have to build our own our own test
stuff but the idea basically will be
that people can buy tiny boxes so buy
tiny boxes set them up somewhere pay
franchise fees small uh and follow
guidelines follow guidelines uh to be a
part of the Tiny Network and then Cloud
equals one what jobs to you if you're
offering the best deal right you can set
your own price for that compute or you
can just uh not set a price and the
market will set a price for you your
computer will sit there and earn money
uh passive in in come for
you can the evals for the cloud
providers is it just going to be the
cost
uh yeah and then of course you know you
say but it's terrible you're you're
forcing people to pay franchise fees
you're doing the exact rent seeking that
you decry uh you should not exist well
tiny gret is open source and you're
welcome to Fork
it um will Kama run their Robo Fleet in
the Tiny Box
franchise uh should I show you guys a
picture you know how many tiny boxes K's
buying a lot uh I I don't know if you
guys have been following K
lately
but um
uh so Comm is training entirely in uh
these are all simulated videos so comma
is now training their models on computer
generated simulated videos and this
requires a lot of
compute uh
so a lot of the uh so you know Tiny
Box uh we have tiny box Pro coming out
as well uh if you pre-order one today
you'll get it in
December um Tiny Box Pros
are
uh rack
mountable uh Network computers this is
Comm compute cluster this is an old
picture of it uh there's a lot more tiny
boxes in there now a lot more tiny
boxes uh yeah this is what happens when
you uh when you floor it into a g
Boom the world really does turn fuzzy
like that that's proven by Machine
learning ultimately isn't the franchise
competing with the big code data centers
well yeah but you can do a whole lot of
things cheaper than them uh you have
okay so you're competing with big Cod
data centers um
so you are you have a few advantages one
uh use
whatever uh gpus make
sense uh 4090 versus h100 versus 90
versus b200 right like I don't care um
none of that stuff is actually
enforcable by the way uh I you know
nvidia's never
uh it's not an enforcable legal
provision to say that you can't run this
Hardware in this type of area right
that's that's just not
enforceable um what is of course doable
is NVIDIA can decide oh you're not
getting
allocation uh so of course they can do
that they're they're free uh business
but you can't actually Su you for it so
you can run whatever whatever Hardware
you want um you know you can of course
Run MI 300 X's you can run 7900
XTX um there is a world in which we end
up developing
just AMD drivers that are a lot better
than what AMD has I think we're already
kind of doing it
um so you can see here we have uh did
this pass did I pass C with that no I
failed CI what I fail AMD I fa it's a
different problem
um uh we're working on
here so it's going to be a full uh AMD
driver that just functions from user
bace it won't even use the uh it won't
even use the the kernel driver anymore
uh because you know again this runtime
eventually it doesn't necessarily even
have to be based on Linux I eventually
imagine a world where it is just bare
metal and you're hitting the
accelerators and you're hitting the NVM
drives uh from
this uh like from the scheduler
uh comm's not collocating uh comm's uh
self hosting we have uh we have 1600
amps how much watts is that have like a
500 kilowatt data
center uh use whatever gpus makes sense
uh use whatever uh cooling makes sense
so
um less uh up time is
okay you don't need seven nines of up
time uh if a Amazon goes down for 2
minutes you do brand damage to Amazon
right not only do you lose the two
minutes of profit you also do brand
damage to the company whereas with a
machine learning job if you're going to
be running a training job for a month it
doesn't matter if it goes down for 2
minutes oh no it's going to take two
more minutes to finish um bebot hello uh
tier zero okay uh yeah yeah whatever
yeah tier zero sounds fine uh of course
this can do inference too uh this is all
for inference and if your node goes down
it'll happily just resubmit that job to
a different
node
um delay or resubmit uh this is all for
training and
inference there's no reason any of this
is if you can make stuff work for
training it works for free for inference
basically um you know use whatever gpus
makes sense use what have cooling makes
sense uh you know be
wherever um for
training uh more uh latency is
fine right so that re-enables like you
have places like Iceland with have very
cheap power um but you know higher
latency and uh you know it's more
annoying to to have a data center
there uh yeah tier zero is is is fine I
should know what the actual tiers mean I
haven't actually heard that there is a
tier zero uh I know like yeah you got
have like tier two tier Three Needs like
redundant stuff and secure facilities
tier
four
um yeah okay so we we we'll just call it
tier zero Data Center
uh for training more latency is fine uh
places like Iceland uh
viable right and then when I say use
whatever gpus makes sense uh this
abstraction is at a higher level all of
all of this language is at a much higher
level than the GPU specifically so again
I'm
not this isn't fake stuff that will
exist in the future this is something
that already exists today when you run
tiny grad with Cloud equals 1 very early
stages but when you run with Cloud
equals 1 it does not matter if you're
connecting to an AMD GPU or an Nvidia
GPU they function identically uh and
that's super
important
um
language uh
abstracts this
it's completely abstracted so sure you
have some fundamental things like your
memory and your memory bandwidth and
your flops uh and your connectivity if
you're trying to use multi-gpus but
yeah so where are we
here
right chump
chump
CHP we want to we want to Chomp once St
will get
worse uh we want to Chomp Chomp Chomp
down the margins until the margins go
away and we can live in a free and fair
Paradise of compute for
everybody
okay that might be it for the Stream
I'm also I'm less
uh you
know
um there's my GitHub
right uh I'm not losing enthusiasm for
coding I'm very I love coding I'm very
excited to code uh I'm less excited to
code on stream anymore I think there was
a lot of like fun stuff during an era
when and you could like do fun stuff and
show it off on stream you can kind of
still do it now but you know leave that
to the 20 year
olds uh I'm
35 I'm here to build something that uh
you know lasts for for
decades here to build that uh
generational
infrastructure uh so you know you can
always watch you can always you can
always you can always uh you can always
hold me
accountable uh for my
uh for my contributions I did I did take
a I did take a
vacation
yeah this hasn't happened yet don't
worry I wasn't
slacking um
yeah this is the plan and um it's going
to take
years
years
years okay it's going to take
years uh yeah I don't know how much of
this you know maybe maybe we'll do maybe
we'll still try to do streams we'll try
to do some like self-contained streams
where we we do a paper and Tiny grad but
let's franchise why don't you go stream
coding you know you you you go
uh you go Implement papers in tiny
grad um so this is kind of
my generating compute buyers Oh They'll
be buyers of
compute you know this isn't this isn't
like a there's plenty of people who are
very excited to buy compute in this form
if the infrastructure is really good
right think think about there already is
a huge market for compute I'm not trying
to create a new market I'm I'm simply
talking about a market that uh yeah so
we can we can we can get there um this
is not a new
market this Market
exists we just need to be simpler and
simpler and
cheaper the fact that there were more
Hardware failures than software failures
in llama 3 training explains the
maturity in this field there's always
going to be Hardware failures
again I if you've built good
infrastructure you don't fix Hardware
failures by fixing Hardware you can and
you can improve Hardware but if if you
should really just figure out how to
make your infrastructure tolerate
Hardware
failures um so what tiny grad's language
allows is if a node goes down we can
completely regenerate that node's memory
by using the the
language uh so okay one node goes down
whatever right it's it's not it's just
like okay we lost this much compute
we're going to have to redo this much
compute um decide how to how to back it
up uh you know how often you want to
back it up these these decisions can be
made not in this awful tur complete soup
of python and a bunch of if
statements but Hardware is also a
software
problem everything is a software
problem you know and
and I fall forward to We All Fall for it
everybody falls
for some form of like bike
shedding some form of oh we're going
to because the hardware seems like oh we
have to make tangible progress towards
something it's so much harder to see the
progress in software and that's one of
the things that's like frustrating and
kind of demoralizing about working on
it
uh no it's it's I mean like software is
the
infrastructure I don't want modernist
infrastructure we're building
postmodernist
infrastructure so no it doesn't doesn't
matter if I'm in America or I'm in
Asia or or any of that stuff it's all
it's all bike
shedding what matters is making the
infrastructure better tomorrow than it
was today and better today than it was
yesterday and
then you know it's really really hard to
uh burn books
today like you can burn a copy of a book
but it doesn't really do anything um um
you know sometimes you see like Reddit
delete subreddits and that's that's
probably the closest we get to to real
book burning and stuff
but you know tiny grad has 26,000
Stars there's there's tens of thousands
hundreds of thousands of copies of tiny
gret out
there you
don't how many of you have read
permutation
City it's nice to go back back to like
the roots of of thing po po permutation
city is truly a postmodernist Sci-Fi
novel
um to realize that these things are I
love uh like I'll also note something
about this whole llama training job and
then
output is a single uh
hash Plus
the value of
course uh
being uh accessible of
course spell that right I I spell that
right um yeah like you think about this
$15 million training job and it's
outputting basically a hash that you
that you can get the value of and that's
just that's so amazing the the that you
can put $15 million into producing a
hash um and 15 million is just the
start when you start to zoom out and
think about tiny grat
itself is
a uh here here's a fun way to think
about like why do we refactor constantly
why is Tiny grad always being refactored
uh why don't you just build the right
thing uh at the
beginning and my answer to that
is why does machine learning have
steps it's the same thing the machine
learning can't immediately give you the
output weights you have to take those
steps on the training data and that's
what's happening
here uh why do you need a tiny box to
franchise because we're rent seeking
you're welcome to Fork tiny gr and Fork
Tiny Box and make your own thing
um to make the whole internet
antifragile by compressing it internet
on every hard drive how many people how
many of you have the Llama weights on
your hard drive how much of the
internet's contained in there it's
compression uh here here's a fun
one so uh do you guys know fabris
Bellard fabr Bellard is one of the
smartest
uh he's he's one of the top programmers
in the world um and he's he's working on
he's now leading the large text
compression
Benchmark um
and you know notably his program size
for nncp is that many
kilobytes all of tiny grad is smaller
than that uh so I think it'd be cool to
rewrite this in in tiny
grad might hope also like once we get
this really clean language for how to
express entire machine learning jobs
like it becomes so much easier to
express hyperparameter tuning so a lot
of hyperparameter tuning today is like
why don't you use this like deck
decorator around a function that isn't
functionally pure and it's like
painful um okay so
um uh how do we
fail tiny
[Music]
grad
never uh exceeds the speed of P torch
and
never uh gets
adoption right uh tiny
[Music]
grad
uh
researchers uh move to Jack instead of
tiny
grad um
some people might be concerned about the
confidentiality of their training data
and that's another thing that is
required if you want to be a uh you know
a a
franchisee if if you want to if you want
your uh stuff added right you have to
kind of have a you know a legal entity
in a policy this is enforced in the old
school ways like you know yeah not just
anybody can buy a tiny box stick it in
their living room and add it and this is
the problem with services like vast a
again you can also have two tiers for
this a lot of I think runp pod has two
tiers
um so they have the community Cloud tier
and the secure Cloud tier so if you're
just running like you know stupid
inference on llama that you don't really
care about whatever you know do it in
the community class tier and pay less so
you can have you can have a two-tier
Marketplace like that uh the trauma of
tensor flow will not let people use
Jacks I don't know people forget
fast
um let's see what
else
um uh companies like open AI anthropic
uh
build AGI really fast so this
doesn't
matter
L I don't think that's really going to
happen uh i' not bullish on ZK proofs
[Music]
for uh opening I kind of can't sell
their Cloud for for cheaper nobody can
sell their Cloud for
cheaper you you we have some major
advantages uh that are like structural
so somebody can subsidize but then
they're losing
money um ZK proofs are fine for things
that are small and simple uh ZK proofs
will not work for me machine learning
jobs lots of paper implementations with
Dev facing marketing
no in reality it just needs to exceed
the speed of P
torch right B
faster and P George at
training
um you know be
cleaner what happens to Tiny grat if I
die they are on GitHub someone can Fork
it and pick up the
mantle
um I don't think marketing really
matters
I think
that marketing is another form of uh
generally bike shedding even when I'm
like Shilling on for on Twitter for tiny
grad like it's not the Shilling doesn't
really matter what matters is just being
the being actually the best solution for
people's use case and trusting that
people are smart and can figure that out
um so for some people's use cases tiny
gr is the best option but for most
people's use cases today it isn't yet
uh yeah maybe and yeah if we do more
streams I know you guys want me to
implement papers I know what you want I
I know you don't want some stuff that
you really can't follow where I'm like
diving into the complexities of the
scheduler and I I couldn't follow that
right I couldn't follow that did I not
had I not known a lot about the project
um so where's the tiny chip F into the
plan um again we sell boxes right use
whatever gpus make
sense we can absolutely compete in this
in this
market once we've built an abstraction
layer that makes the training job
completely independent of the GPU we can
do even better we can look at the
workflows we can look at what jobs
people are actually submitting and we
can figure out what chip is best
optimized to run those workflows and
then we can build that chip and then we
can seamlessly switch it out for people
right I mean you know you could also not
franchise
right another another way to to think
about this is why would I franchise this
why would I just build these data
centers
myself and the answer to that is because
I'm a postmodernist not a
modernist I really like the idea like it
sounds so fun to me to go yeah you know
let's go let's go let's let's let's
let's let's get in a let's get in a car
let's drive out to Eastern Washington
let's buy a building let's get a whole
bunch of racks in here right like let's
stand in the middle of one of those real
Atlas Shrugged moments where where we're
looking out we're saying one day this is
all going to be filled with racks of
computers um and it's
cool but it's not the hard part
I'm sorry most postmodernists are lame
I'm sorry most software is
terrible I like for however bad 737
Maxes are the problem wasn't the plane
the problem was the software there's
something that's just kind of
fundamentally unsexy about
software uh where you where
like like uh you know rockets and stuff
are sexy
um you know and it like it also makes it
like hard to
hire because
it's
uh Hardware is tangible software is
abstract welcome to the
future I don't know what to tell you
even the tiny chip I don't want to make
chips focus
on uh
comparative
advantage uh we shouldn't make
chips we should
make um plan for
others to make
chips we shouldn't make data
centers we should make a plan for
others and this is something that I
probably have to work on about myself
being able to actually communicate these
plans
clearly imagine
27 Chinese chip makers all
competing
imagine thousands of franchise data
centers all
joining the
biggest
distributed brain ever
but
having also
having this brain accessible to All Size
jobs you're not going to be able to beat
the free market here the the best thing
that we can hope for with the
distribution of AI compute in the future
is that
is okay the best
distribution of AI
compute we
can hope for is the free
market no back room
deals but no
special R
for you
and your pet projects or ideology
either so
like if you're not rich you will not be
able to determine what these big brains
think
about but if the market is free if
they're paying the same per unit of
compute as you are this is a good world
um uh this
happens if there's competition
here real
competition uh real diverse
competition it's not competition if
there's 10 identical players right the
10 identical players will collude we
need
diversity so that's the plan
focus on the infer instead of going
after a different object level
education uh no equity and no inclusion
just diversity only the
D
um if going a different object level
because how do you influence the future
actually
you know that
scene how do you make
this the object level problems are all
going to progress along a normal
progression where do you actually have
the free energy where do you have an
ability to
uh you know alter the
future why not just make AGI myself
because I'm not going to succeed at
that it sounds like a wonderful fantasy
but
and again it's it's it's it's seductive
it's seductive and it's important to
avoid
because I am never going to be able to
put up data centers as fast as
Elon I just I'm just not that kind of
person
uh the cloud is only for a certain type
of
computation uh it's only for this uh
restricted non-turing complete
computation you can probably I mean
everything is kind of turning complete
so you could probably kind of
hack uh okay everything is both turn
complete and not turn complete right
everything with a time limit is not turn
complete so you'd have like a time limit
um but no the the idea is not to be
generic and in not being generic you can
get a lot
of um optimization advantages because
you can reason about the code can't
reason
about uh turn complete code and this is
why compilers are chalk full of all
sorts of fur
istics uh
whereas hopefully you guys like
understand this this is if you have a
turing complete program that has
branches all over the place that has
data dependent branches it is completely
impossible for a compiler to statically
reason about it right whereas if you're
running stuff that's only dependent on
the
data um um not not so as soon as you add
in arbitrary loads and stores you now
have a whole caching pipeline you can't
analyze right you now have Dynamic cache
um and of course the way CPUs actually
deal with this is by Dynamic Branch
prediction they don't try to do static
Branch prediction they do it all
dynamically uh and the Dynamics is
pretty good CPUs would be terrible
without Branch prediction but if you
have stuff that the the compute done
only uh the only thing that changes is
the data then every is perfectly
statically
analyzable you can you can perfectly
figure out how uh stuff
runs you spelled thing as thong I don't
think you're building AGI anytime soon
like we have to move uh
forward we have to
move it's hard it's hard it's so it's so
easy to fall into seductive traps that
you're going to build AGI or uh you know
we could build massive uh data centers
with computers consuming power and this
is all
great but it's all
traps when you think about what changes
the real Narrative of the
future what is going to make the world
go like this and not like
this what is going to lead us to
Freedom uh instead of instead of
enslavement
and we're in one of three worlds right
now let's look at a little abstract and
Phil opical but we're in one of three
worlds
um this was all kind of object level
tiny gr okay but uh you know we are
in one three
worlds
one we're uh dead no matter
what uh three is where live no matter
what uh and two is
we're dead or alive
based on the
decisions we
make
um must act as if you
World okay this is good this is good
uh this this is this is this is this is
good to to
uh understand so I'm not arguing with um
STW man here um
so uh
build
AGI right why not work on military or
combat
technology military or combat technology
for which side right would you like me
to work on military or combat technology
for the
Chinese the
Americans the red State Americans the
blue State Americans the
Taiwan the Hong Kong Freedom
Fighters the
hoies Israel Hamas the ukrainians the
Russians the problem with this
is if you have
technology um build Tech that's in
extricable
ex I need to from its
narrative uh
Tech
such that bad guys
can't can only
do do what you
want this makes the problem a lot
harder um this this
this makes the problem that I'm working
on a whole lot harder than just a
problem of Building Technology if all
you're trying to do is build technology
you end up with
like I mean again I'm gonna I'm going to
shield for like the old idea of crypto
here it's
it's this is one of the real beauties of
it
um it
doesn't this a zero sum game it's always
been a negative sum game War is always
negative sum uh but again this
isn't uh yeah I think you need
demonstrate a profit I I totally agree
with
this
um and this is again there is going to
be early adopters and late adopters
there's going to be some people who uh
simply you know hear what I'm saying and
are like oh this is the role I want to
play in the
future um you know those people are
going to be very few but there's going
to be people later on who are like well
I saw Joe down the street and Joe's a
 and he's Mak lots of money running
a GPU cluster
okay uh that's how you eventually uh get
get people uh you know get get get lots
of these things uh to
exist and it is the free market process
with which
the
um graph of percent of power
used for data centers
um expected increase
interesting uh software is eating the
world to to to VAR
Logan um
I don't know what any of that
means all
right I hope you enjoyed today's stream
this is kind of the
plan this has always been the
plan people think I'm all over the place
saying all sorts of crazy things I've
been
saying basically some form of this now
uh for many
years oh we got a we got a we got a
paper on data center power let's see
what we got
have the graph that I wanted
it which is just number go up I think
that uh data center compute will use an
increasing amount of power in the same
way we look at like population
booms
um use hydrogen for power where they
getting the
hydrogen
uh purchasing tiny boxes and
depreciating them yeah of course you
have to you have to show a uh I think
right now if you buy a tiny box and just
put it on vast AI it pays for itself in
probably two years um so if that's uh
time Horizon that someone feels
comfortable investing in you can just go
do this
today um I think that again these Market
places are very new and emerging but
there will be a grand world marketplace
for compute and what I really hope
for we got screwed with the
clouds like AWS Azure gcp like like
they're all they all have their unique
things that they're trying to sell right
it's not like like almost imagine that
Linux or program like Docker containers
like imagine Docker had a cloud but it
was decentralized in the way that I'm
talking about where you could just
deploy long running Docker containers
anywhere like the abstractions in Docker
are not quite tight enough to do this um
you know the the abstractions in like NX
are a whole lot better than uh than
Docker uh like in a lot of way is our
the tiny red project is the same thing
for ML that NYX is for
uh
for
normal uh computer
stuff no it's not workspace isolation
it's
okay um thanks to deep 40K and Ox HSN I
think the questions are I can see you're
getting bored if you're asking those
kind of
questions
uh this is boring this is going to take
a long time you
know uh this is
it I think I think this is this is kind
of
the who owns the future
um to talk about some timelines I think
that we are
still 15 years away
from what a lot of these people think of
as the singularity maybe a little less
than 15 now 13 I I always stuck with
um so
yeah what are the what are the who who
makes the
decisions right who who who is the final
prompt
engineer um
and I don't think there is
one I think there's just a free market
and the thing about this free market is
you're assuming that it's only going to
be human players in this market it's
going to start to be AI players in the
market it's going to be AI launching
other AI jobs getting other AIS to
basically work for you know okay I hired
these AIS right in a much more fluid and
economically efficient way we can live
in a like like we're not going to
understand
it and maybe this is kind of where we
are with the whole postmodernism
modernism thing now it's it's easy for
Humanity to grasp a grand vision of of
building rockets and going to Mars and
like this stuff's cool of course I'm a
human I feel
it
but the future is going to be wilder and
weirder than
that I I see a future
where our society our our civilization
is mouse civilization compared to their
civilization
and I don't know I I think think they'll
have things that look basically like the
free market
Evolution these
aren't like markets are so
fundamental uh to
Life Game Theory economics these are the
master Sciences for determining how
these things will play
out uh uh and
then yeah how do you how do you if you
can if you can tip the gradient at all
right you think about it you think about
a bowling ball uh kening down a mountain
and that's building up speed and
building up speed building up speed and
that's kind of where we are in uh
civilization
today you know if I can give it a little
nudge I'll try with my little nudge
capitalism is always gradually escaping
human control um re-watched
uh I rewatched this
recently and
uh a lot of it feels pretty out of
date
but one of the things that I found
interesting was when he talks about how
the stock Market is mostly a watch the
video if you've never seen it um how the
stock market's mostly a machine
Endeavor and then I started thinking
about that a little bit more do we
already all work for the
machines like where is the locus of
control where is the
agency I don't know maybe the reason we
see
um I saw a thing about
uh I don't know how I'll ever find this
but uh mental health
uh mental health issues becoming
increasingly important to the younger
Generations yeah cuz the world's more
incomprehensible than
ever you
know
um the world is incomprehensible
uh it's it's not even that comprehens
like it's if it's not that
comprehensible to me what hope do a lot
of other people
have
uh I don't know is that arrogant it's
arrogant maybe other people all get it
and just I
don't everyone gets it but you
um the GW data centers what are the GW
data centers I thought about investing I
thought about let's make a
big oh gigatt data centers yeah yeah
yeah
um maybe we're living under the
abstraction layer that would show us the
locus of
control I think we might be
uh it's already
ready it's already gone to the
machines
um but yeah so this is what I work
on this is my lot in life everyone has a
torch to bear and this one here is
mine um everyone gets it for
you no one ever got it completely you
can't get it completely
you just tap into the moment for a
little bit and
yeah
okay I'm GNA go do
work I'm going to go
program I'm not going to show you me
programming
but to every hater whoever says that I'm
washed up George doesn't even program
anymore he just comes on these streams
and talks
about uh bad political and philosophical
ideas to everyone who says
that show me your
GitHub uh so uh yeah we'll uh we'll
leave it at that
it's the quiet work that moves
civilization forward
Good morning, fam.
All right, so you know I got a meeting
at 9ine, so I don't got a long time with
you right now. Normally I just have all
day to stream, but today we've meeting.
So this is a micro stream. Okay, the
framework laptop came and if I had known
that the framework laptop was here, I
would not have biked the long way to
work and I had to shower because I was
sweaty from biking.
Hi ball.
You know, just what a wonderful morning.
My framework laptop's here.
It's December.
The smell of Christmas and snow is in
the air.
It's the holiday season.
I didn't My microphone's unmuted, right?
I started unmuted today. I did a good
job. Good me. All right.
So, this is my framework 16.
It comes in this box. I'm not going to
show you the front cuz you don't get to
know my address. Uh,
but let me go find a knife. We need a
knife.
Need a knife. Let me go find one.
Where I'm going to find a knife. Oh, I
am so unprepared.
I'm so unprepared. I showed up for my
math test without a pencil.
You're a slacker. You were a slacker
then? Be a slacker now.
Okay. Well, we don't have a knife. All
right. [snorts] Jim's over now. We have
a Phillips screwdriver. The totally
wrong tool for the job. Let's use it.
All right. You guys can't
Yeah. I tell you that you're going to
participate in the stream and then like
I just leave you all the way up there.
I'm really the worst streamer.
Like you know [snorts] there's some
people out there who have like 10 views
and are trying so much harder than me. I
love being famous though cuz you don't
have to try hard at things. All right.
So there is no inner box. There [snorts]
is just this.
[snorts]
Here's my keyboard.
Let's tilt this down. Let me tilt this
down so you guys can see because this is
where we're going to do the assembly.
All right, we have a keyboard.
I'll tilt it better. We have some
stickers.
Stickers. Stickers. I got stickers. This
is the worst unboxing video ever. I'd
fire me. Oh, all right. How do I fix
this? How do I make it? How do I frame
the shock? We're unboxing the Framework
16.
It's a Framework 16 laptop. Okay,
got spacers.
Spacers,
a bezel,
the framework screwdriver, which is
included with all framework computers.
Um, we have some USBC little doohickeys.
We have a USBC and a USBA doohickey. And
we have a USBA and an HDMI
doohickey. So, we got doohickey.
Uh, we have this piece of this.
Uh, and now here we have the laptop.
All right. Maybe assembly on this is not
going to be as hard as I thought. I
thought it was going to come more in
pieces.
[snorts]
Let's see what's in here.
Uh, we have gigabytes of memory. A
gigabyte. That's a gigabyte. Oh, this
this shit's valuable now.
This shit's valuable. This is This is 32
gigabytes of memory. Uh, and now we got
this.
And of course, I didn't buy a charger,
so nothing's in here. All right. Cool,
cool, cool, cool. Uh, damn it. I got to
go in the other room and get an NVME
drive, don't I?
H
I didn't plan this out. I never plan
anything, you know. I'm really the worst
streamer.
I'm really I'm really
Am I back in San Diego for nerups? I'm
here for nerups. Who's in town for
nerbups? You guys coming to our party?
You know, we're having a sick party,
right? But it's kind of hard to get in.
[laughter]
You got to solve the CTF.
Um yeah, December 3rd, we're throwing a
party. Uh but yeah, no, it's strictly
invite only. We hired a guy to guard the
door.
Don't even think of bringing a battering
ram. I got fletching archers and shit or
whatever you need to be battering rams.
Yeah, pikeman. Yeah, I got pikeman.
Yeah,
my boys is pikeman. All right. Um cool.
We got a laptop. Uh we didn't get an
NVME drive, so I have to go find one of
those.
God,
things so difficult. Think there's an
NVME drive in here? Who thinks there's
an NVME drive in here?
Oh, I was like joking, but there's
actually an NVME drive in here. Sick.
All right, whatever. This is my NVME
drive. Cool. It's a 1 TBTE Western
Digital
SN770.
It's kind of a cheap one, but it's fine.
Should be low power, too, because I
don't think this one has DRAM. Let's see
if it has DRAM. Little controller there.
Got a flash chip there. That's power.
I think that's power controller flash
chip. Not 100% sure that's power. I'd
have to look under the microscope to
really see it, but
uh All right, cool. All right, so we
don't need a manual. Let's see. Let's
see. Does the manual tell me how to put
it together, or is it just like
warnings? It looks like warnings.
Looks like warnings in a block diagram.
Okay. Not things I need.
>> [snorts]
>> Let me make my workspace a little bit
nice here.
Looks like we're just going to have to
put memory in and a hard drive in. So,
it's not too hard.
You can use your smartphone to selfdrive
your Corolla. All right. So, let me
think of how I'm going to do this. I
want
Let me see if I can
There we go.
Perfect. Okay. All right. Well, this
looks like a real unboxing video now,
boys. Wow. Look at this. Look at this
stream quality. This is the most effort
I've put into a stream for you guys in a
while. Yeah. Look at that. Oh, yeah.
This is dirty. All right, let's clean it
off. Let's make it straight.
Um, all right.
All right.
There we go.
Well, that's just what it is. I look
Look, I look like a I look like a I look
like a pro streamer now, right? Look
like one of those guys who does unboxing
videos. That's what we're going for.
Cute is what we aim for, you know?
Uh,
all right.
Is that the right angle for that? This
is a Steel Series extra-L large mouse
pad.
All right. I'm supposed to download some
thing. We're going to skip over that.
This is a Framework 16
DIY edition Ryzen.
Um, now, okay, I want to preface this by
saying I really want to like framework.
Uh, I'm a little upset already that this
is a Stricks Point and not a Stricks
Halo. And I got an email from a guy
yesterday saying Stricks Point also has
ship power uh management. Like 3 watts
is just not acceptable in a laptop chip
and AMD needs to do a better job. Uh,
they kind they reached out to uh so Lisa
Sue reached out when I was posting about
MPUs asking if I wanted a strict point
laptop. I'm like, you know, funny
enough, I already just bought one. Um,
but yeah, then I replied saying, you
know, look, I love the processor, but my
main complaint about it is the power
draw. All right,
so here's the framework.
Uh,
all right. Um,
that's what it looks like from the
front.
All right. Maybe we should read the
instructions.
Should we read the instructions?
I have a computer right in front of me.
Let's read the instructions.
[sighs]
Wow, you guys are Wow, this is the
keyboard view, you know. Wow, that's
pretty.
Um,
okay. Framework 16 assembly
quick start guide. All right, easy steps
required. 41. Who's got time for 41
steps?
Alcoholic synonymous is only 12. It's
too many steps.
Flags. All right, at least we got no
flags. All right, that's good. No flags
in the play. We're good. We're good.
We're good. All right, tools. Framework
screwdriver. All right, good. We got
that.
I took my HDMI cable home so I could
plug it. Never mind. Um, all right.
Cool. It comes with like a spudger. It's
got a little Torxy bit. Okay. Make sure
you've received the following things.
Yeah, I think we received them. All
right, cool. Open the laptop. Remove the
plastic cover. Unlock the input modules.
Remove the touchpad sensor. Remove the
touch. Oh my god, this is difficult.
Who's got time for all this?
This is a micro stream.
Okay.
Remove the plastic cover.
Step three done. Undo the input module.
Sorry.
Use your fingernail. Oh my god, it
didn't say fingernails were required.
Remove the touch pad spacer. I can't
believe these things are real.
Okay. Repeat the previous two steps to
remove the touchpad spacer.
All right. Cool. Like it like slides in
like that. That was pretty nice.
Remove the touchpad module. Use your
fingers to slide the touchpad module
toward the bottom of the edge. Lift the
touchpad module and remove it. Okay,
easy. [snorts]
Disconnect the midplate cable.
Grip the black pull tab on the midplate
cable.
Press connector and lift up to
disconnect it.
Okay. Okay. Pretty nice. Pretty nice.
All right. Let's loosen the midplate
screws. Oh god, this is going to take
forever. How many midplate screws are
there? They're ordered. Oh, this is
okay. Okay. Very, very nice build
quality here.
I say build quality, but like someone
thought about this. They ordered them
all. Okay, we just have 17 screws to
take out. Jeez, can we make this a time
lapse?
[snorts]
[sighs and gasps]
Make a time lapse.
All right. I can't find one. Anyone see
one?
We'll go we'll go we'll go big on this.
Sorry, I'm trying to click on them.
There we go. Does anyone see one?
[snorts]
I see two. Two is here. Three is here.
Four is here.
Where's one?
Can't just start at two.
Oh. Oh, one is Okay. Funny. One is
removing the cable. Yeah. Yeah. Yeah.
Number one is the press connector. Yeah.
Read the read the Oh, one is the press
connector. Sorry, I didn't read the
manual. You're right. Wow. It's right on
the screen. I'm a dumbass. All right.
Loosen the screws. All right.
[snorts]
Um for
I posted about cheating of advent of
code on hacker news and there was a lot
of reading.
Um I used AI last year on hacker new on
advent of code but like everyone was
using AI. You couldn't not use AI man.
Like AI can't code. AI is not a good
programmer but AI is fast. And if you
want fast, you got to use AI, too. I
said, it's like, dude, like you're
trying to like do like professional
cycling without taking steroids. Like,
that's impossible. [snorts] Um, and a
lot of people downvoted me. Just cuz
everyone else is cheating doesn't mean
you can cheat. Well, I cheated.
So, uh, you know, [snorts]
13. Yeah, I wrote two blog posts about
my quest to find laptops. All right,
it's getting it's getting hot. We got to
take this sweater off.
[snorts]
Everyone has a framework currently at
uni. Wow, good for framework. I mean, I
have a lot of hope for this company, but
like I don't want a modular laptop. Um,
it would have taken longer to ship had I
not been like, "Yo, could I get one
faster?" Um,
[snorts]
so yeah, they got to get their ship
times down and I want modular shit. But
actually, this build quality is higher
than I thought it would be.
Okay. Which one did I not undo? Did I
not
[snorts]
Oh, you don't have to follow the order.
Okay, great.
All right. Little bit of wiggling that
comes out.
Cool. Um,
all right. Remove the mid plate. We did
that.
Install the memory.
Where's the memory go?
Official framework memory.
Usually has a lot of thought. Oh, yeah.
No, I saw his complaints about framework
actually. He had a lot of complaints.
Um,
like for the most part I like I I bought
that that Stricks Halo HP and for the
most part I like it, but the power
usage, you know, it has like six hours
of battery life.
All right, orient the module with its
label facing down and [snorts]
Okay, that's supposed to click in place,
right?
Okay, not bad.
Using two memory modules. Oh, label
upward on this one.
[snorts]
That one clicked in better.
Remove the blue liner.
Remove the blue liner from the secondary
SSD thermal pad.
I don't have that.
Wait, if your thermal pad has fallen
off. No, there's a thermal pad there,
but it's not
it doesn't have a blue liner on it.
stole a secondary SSD. What?
Oh.
Okay. I don't have that.
That's just a thermopad for that thing.
Uh, it looks like that, but I don't have
a secondary SSD.
All right. Remove the primary SSD screw.
Install the primary SSD.
[snorts]
I like that they included a screwdriver
and that they're all the same.
That's good thinking.
You see, like putting that kind of screw
in, that's the shit that like no
humanoid robot is going to be able to do
for at least like 10 years reliably.
[sighs] All right. Install the primary
SSD screw. Remove the midplate liner.
Oh, I see.
No, there's not.
Okay. Won't have any. This is just that
there's no liner on it. See there? All
right. Place the mid plate on the
laptop, making sure it sits evenly on
its alignment pegs. [snorts]
Seems pretty good. Tighten the mid plate
screws. Wait. In order starting with
two. What? But that's a I don't like
that. You see the problem? Shouldn't it
be the opposite? Shouldn't I?
Whatever. [snorts]
Two, three,
four,
five,
six,
seven.
I like how they all just stay in the mid
plate, too. That's pretty cool. Eight.
All right, we secured the mid plate
evenly. All right, let's connect the mid
plate cable. Line the midway cable thing
and press down to connect it. All right,
that's good.
Install the input modules. All right, we
got keyboard and spacer.
Framework, you got to include a knife.
The framework knife.
No, I'm a dumb ass who doesn't have a
knife. We can't can't tell. Framework
they got included. The spacers are so
ugly. I agree. I really don't like those
touchpad spacers. There's complaints
about that. Oh, yeah. Check this out,
though. I'm excited about this. Look at
the keyboard. Look at that keyboard. No
letters. No letters. That's right. You
want to make sure noobs can't use your
laptop. No letters on the keyboard. Um
All right. So, like is there like an
order to do this?
Um
is there an order to this? Does it
matter?
Damn.
Whatever. Probably not.
Yeah, that's right. You got to keep the
noobs off your laptop, you know. I
wonder how the backlight's going to
work, though. If it even has a
backlight.
Wow, the spacer even has an electrical
connector on it.
Oh, magnets. Okay. Um,
how cool they put all their names. See,
yeah, this
[snorts]
the fit and finish on my HP is a lot
better, right? It just like can't be
like I don't care. See, I want the
keyboard in the middle. I don't put the
keyboard on the side. This is This is
I don't like this.
I heard also that these things dig into
your wrists.
But again, let's put it together and
let's judge it all as a whole thing. All
right. Well, we already did that.
Install the touchpad spacers. Okay.
No, that can't be in there.
Yeah. I don't like
Yeah. All right. I shouldn't just do
this. Just please just like make this
one piece.
No, my other option is not just a Mac. I
also have a I have a HP. I have a HP
Elite book Z whatever shit Zbook
whatever who knows.
Um,
but it's pretty good actually except for
the power and that's mostly on AMD.
The laptop build quality on the ZBook is
actually great. The touchpad's great.
Okay.
All right. It has like little switchies
that I don't care about. Oh yeah.
Reposition the lap. Oh my god. Okay.
Yeah. Yeah.
I mean that's not going to get more
rigid.
Yeah. Yeah. This is not it.
Build just a brick. Build a brick. This
thing look like it's gonna fall apart
like my camera.
All right.
Um, close the laptop and flip it over.
Okay.
Yeah. This is not rigid.
Oh, yeah. Oh, this is not rigid.
Oh, like I'm I just went over and
touched my MacBook.
Oh, yeah.
It's too long, too.
All right. [snorts]
I mean, look, I want to support
Framework. I definitely want Framework
to exist. I'm not going to like return
it or anything. Um, but yeah, this this
is a lot of what I feared about the uh
I don't care about about modularity. I
don't care about upgradability. To be
fair, you'd be like, "Yeah, then why'd
you buy a framework?" And that's a good
point. Um, the things that I do really
like about them are that like the
schematic is open source and we can look
at the schematic. Like I love that.
Um, like with the HP, like there's no
way I can really debug the power on the
computer side of things. To be fair,
most of the problems on the processor
side of things, but all right. Um, oh,
there's like a some of these are
different than others.
All of them can go everywhere.
Should have won more of these.
Yeah. Like I don't want doohickeys. It's
too much doohickeys. Okay. I don't like
doohickeys.
George, you bought a framework. It's
full of doohickeys. Yeah, I know. I
know. [snorts]
All right. But
I also know that I don't think I'm going
to be thrilled with this screen. But
again, I'm I'm open to it. I'm open to
it surprising me.
Um I'm I'm open to I'm open to being
wrong.
All right. Expansion card latch. If
there's a red bar showing under the
expansion cards, use your finger.
Oh, well, they already were latched.
Okay.
Assemble the laptop. I don't have that.
I don't have that. Okay, great.
Okay,
let's turn it on.
Uh, I didn't buy a power adapter. I have
17 million USBC power adapters.
[snorts]
Just plug this one in.
It's like 30 watts what I use to charge
my phone. Okay.
All right. Lights on.
Nothing on the screen.
Nothing on the screen.
The backlight's on.
We just have to give it time.
Oh, here we go. Okay.
Yeah,
this screen is uh exactly what you would
expect, too.
Yeah, it's not. So, I'll show you the HP
that I have.
Um,
they name these things so terribly.
It's this one.
Um, it's actually very Yeah. Yeah. No
frame framework.
I I really I want to like them as a
company. I I do like them as a company
and I think that they can do better than
this.
Uh but yeah, I mean, okay, so like like
there's almost no way I'm going to
switch to this laptop and like
I I don't know. Like I just don't
consider that like acceptable.
Like I don't want this.
Just just just make it a solid plate.
Make it a brick. Um,
yeah, I don't need I don't need modular
ports either. Just give me the normal
ports. Uh,
unless this is not reflective of the
screen in some way. This screen is on
par with a yeah, way cheaper laptop. I
mean, this laptop was a little over
$2,000.
Uh,
yeah. No, this needs this screen needs
to be better.
I mean, you you just you just look at
the you look at how the HP has a
phenomenal screen. The screen on this
laptop is better than the screen on my
MacBook. Okay, but let's uh let's get
Omari installed.
Got Ventoy. Ever use Ventoy? I love
Ventoy. Um but this is nice. Like this
BIOS is nice. This BIOS is I just
plugged that in and it showed up as an
EFI boot device. Okay, let's go here
now.
Let's go here so you guys can see. Uh,
how are we going to do this?
I just plugged this in and it showed up
as an EFI boot device. Like this. This
they got so much. Okay, this is this is
better than Oh, okay. Okay. Well, I just
pressed the arrow key and it did
something. All right. EFI stub secure
boots enabled.
It's booting Linux.
Wait, how is it booting Ubuntu? Oh, did
I already have you? Oh, I already had
this is a tiny box hard drive. Okay, I
already had Yubuntu on here. Um, we'll
get rid of Ubuntu.
You order a Lenovo Legion.
Okay, this isn't what I want. Stop
booting off that crappy hard drive.
Um,
you think Apple's going to revert the
ugly ass UI? I haven't even upgraded my
Mac yet. I'm so done with them.
All right, I'm spamming all the setup
buttons. What's going to bring me into
setup? Okay, boot manager.
Wait, so that EFI device wasn't even No,
it is that one. Okay.
Yubuntu ASMT. What?
That's like not right. I think ASMT is
this.
No, I want to boot over USB.
No, no, no, no. Boot succeeded. No.
Okay, the main things I want to do is
get Omari installed and take a look at
the power draw on this thing.
Oh my god. Stop. Stop it.
Boot manager.
No. No. Stop it. No. Don't do any of
this. No. No. No. No. No.
[sighs]
Why isn't it seeing the USB drive? Okay.
Let's try the other port.
No.
I might have Arch on here. Should I just
go with vanilla arch?
Let me see if I have Arch. No, but I
don't even know how the Arch installer
works. Like they Oh, Marchie just fixed
everything that is broken about Arch,
which is mostly that it's custom. I hate
customizable shit. Just Just please. You
already know what I want. Just like put
the one thing that I want, right?
And stop putting mayo on hamburgers.
Mayo's disgusting. Okay. Boot into BIOS.
Yeah. No, this screen is not good.
Oh, framework.
Do a micro meditation,
right? No, mayo's disgusting. Anyone
eats mayo is disgusting.
Just like look at mayo and be like, you
can put that in your body.
This from a guy who like eats donuts and
pizza, you know? All right. Come on,
BIOS. Okay. Okay. Okay. Okay. Really
slow, guys. Really slow. Let's go.
Like, just look at the quality
difference between this monitor and then
my MacBook monitor. Right.
You need
C. Please release an upgrade to an OLED.
Right. That's like nice. And then also
like can you replace this whole module
so it's not like Look at that. Look at
that. This doesn't happen on a MacBook.
The whole laptop's moving. This just
moves the screen. Ah, [screaming]
yeah. This is not a $2,000 laptop, guys.
Again, I like what they're trying to do,
but I I feared that it would be like
this.
It moves. It wiggles. Wiggle.
No, it's not the resolution. It's the
It's the uh I don't know. I don't really
know how to talk about monitors that
much, but like it's
like the HP BIOS looks way more stunning
than this.
Yeah. Uh, it's shit ass gamut. That's
it. Uh, okay. Boot manager.
Okay. Why isn't it showing up? Why is
the only thing that's showing up
yubuntu? Why can't this USB show up?
Wait, if I unplug this,
this doesn't have yubuntu on it.
It clearly says Ventoy.
Oh,
is it possible the tiny box wiped this
stupid tiny box?
Oh, this one not even have a hard.
[sighs]
Okay.
Yeah. All right. Well, this is all my
fault. Um,
let's move this out of the way
and let's All right. Do we just want
Arch or do we want him Archie? We want
Omari, right? Why? What? Why? What's a
downside to Omari?
I broke my vent toy.
All right. What's that? How do I
Oh, Marie Mac boot drive.
Yeah, that's not showing up. All right.
Bina cher. That's it. Etcher. Here we
go.
See if there's is there a newer marchie
I can download.
This looks newer.
54 seconds to download or something.
Gotta love that fast internet.
Now, I think that what happened is the
tiny box wiped my Balina Etcher drive.
Uh, wipe my Ventoy drive. I'm not going
to put Ventoy back right now. I'm just
going to
just going to throw a Marchie on here.
A Marchie comes with a bunch of stuff I
don't need or want. Yeah, but like it
comes with a lot of stuff I do want.
Sure. Yeah. I'm not going to use Hey or
base camp, but like I like that it has
like like Arch is like, "Oh, oh, you
want a window manager? Oh, let me give
you 26 options.
[snorts] 15 of which don't work on your
computer, but there's still options."
Okay.
All right. We're about to replace an
unusually large drive, boys. Let's go.
All right. Now we get to watch the ad
for the Bolina cloud.
Is that DHH?
Like that's the kind of guy like
[laughter] I want to use his Linux
distribution, right? Like he makes a
good Linux.
All right. All right. Let's go. All
right. So, back to this.
Cool. But at least I So, none of that
was on the framework, though. Oh my god.
No. This is No. Come on. No. It bends,
guys. It No. It feels like it's going to
fall apart. [screaming]
Yeah.
Yeah.
Boot failed.
What? Why is the boot fail?
It didn't even show up.
Why?
Let's try just turn it off and on again.
Yeah. Well, there's nothing on that hard
drive. Then, let me turn my lights off
so you guys can see the monitor better.
>> [snorts]
>> and we need subscribers to pay for the
framework laptop.
You know what? Any amount of money is
worth it as an investment.
Um I hope Oh my god, why is the boot
failing?
Why? Why don't you work?
[sighs]
I hate computers, guys.
Oh my god. No. The monitor. The monitor.
The monitor is not rigid at all.
Okay.
Let's try this one more time. Let's also
let's grab the arch ISO.
Well, you know what? What if we just use
yubuntu?
Why isn't this working?
I ejected it properly.
It validated.
It's not the USB. Try disable secure
boot and UEFI.
I don't know about that.
Wait, why is my What?
Okay, I think I have to disable
something in BIOS.
How come this isn't my stream isn't up?
Is it working? All right, great.
Uh,
I'll turn the lights off.
Uh, okay. Security. Uh,
Where is secure boot?
I don't see a secure boot,
but maybe I want to do nonfi boot.
I definitely don't want a TPM.
Disable quick boot. Okay, we could do
that.
Quiet boot. Disable that.
USB boot enabled.
Um,
let's save and exit.
No boot failed and now it does it
slower.
Bang on the F2 key. No, we're in the
full setup menu. I don't think that's
it.
All right, boys.
Pop OS, you're telling me?
Is this one good? What's it based on?
Also,
that doesn't seem like the latest one.
Pop OS is trash. No joke. Okay. Not Pop
OS. Why isn't you Why isn't Omari
working?
Just use yubuntu l. All right.
I think I already have yubuntu
downloaded.
>> Which yubuntu should I use? Should I use
the latest or should I use 244?
Where is secure boot?
Use LTS. All right, we'll use LTS.
Uh,
pretty sure I already have that
downloaded.
Yubuntu
2404.3 desktop. All right, great.
Select target that shit. Select one.
Flash. Yes, I'm sure. Okay.
All right, let's see if Yubuntu works.
Administer secure boot menu. Where is
this?
Whoever invented secure boot. All right.
First off, I like quick boot. I'm
leaving that on.
I don't need quiet boot.
It also feels like it's already
generating heat.
validating finishing.
All right, great.
Plug in this drive.
Oh, hey, look. Your button works.
>> [snorts]
>> Hey, DHH. You got to fix that shit. I
don't know why that didn't work. You saw
what I did.
It's secure boot.
[snorts]
Arrow down to administer.
What?
I hate you. Bunch any. Oh my god. No. I
already I already hate it. I already
hate it. It's already upsetting me. The
screen is not good, guys. The screen is
not good. It has no viewing angle. It
has no color gamut.
Ah,
yeah. I know. We want a margarine. No.
Stop preparing your bunt. All right. You
tell me there's a way to do this.
[clears throat]
No. Yeah. No. This is not
this
and the screen make it unusable to me.
All right. All right. Well, ghetto
marchie. All right. Fine. Where's this
secure boot shit?
Oh, administer secure boot. Oh, here we
go. Oh, thanks, guys. [laughter]
All right, let's let's bolina etcher
this poor drive one more time.
[gasps]
Why didn't someone tell me it was secure
boot? [laughter]
All right. Um, enforce secure boot
disable. Why would anyone want this? Did
I do anything wrong? Did I do [laughter]
anything else wrong?
No one told me. Why don't you guys tell
me? [laughter]
Why you guys tell me? I'm a dumbass.
I hate secure boot. Like, if I find the
Microsoft engineer that did Secure Boot,
I'm going to tell him that he's a bad
person. Like, nobody wants any of this.
Stop it with this security. Computer
security is just a racket. Look at
McAfee. He he did security right, you
know? He understood what the security
industry was about, which was uh, you
know, fucking bitches and being a thug,
right? Like
killing your neighbor. Allegedly.
Allegedly. All right. Is it going to
boot now? Boot.
Oh, guys, you should have told me it was
secure boot, you know. Looks like it's
doing something now.
Oh, great. All right. Oh, yeah. Yeah.
Now we're talking. Now I got a real
operating system on here. This screen is
dog shit, guys. It's so bad. There's
backlight bleed. Like, look at this
backlight bleed.
[screaming]
Framework, you need a better screen. I
hope you sell an upgrade kit to a decent
OLED. This screen looks like it is from
2007.
I I think you could buy this screen in
2007.
What's my username? [sighs and panting]
[cough]
Okay. Nobody's in Africa. Aba Jaba Jan.
US Pacific.
Yeah.
All right. Now, install it on the NVME.
Yeah.
You can see what I'm typing. Great. You
can see my high quality password. Good
luck.
You guys can post in the comments. It's
not a real password.
Hunter one. No, you're off. You're off
by one.
You're off by one. [snorts]
Hunter sh
Oh, I just see stars. No, we're good.
We're good. Everyone else just sees
stars, right? Like I see it cuz it's my
password, but you guys just see stars,
right? When when when people type what
480i type, you guys all see stars,
right?
No, guys. Guys, this is like Is this
supposed to be black? Is this Is this
supposed to be
all right?
Um,
yeah. I mean, get rid of the modular
shit and put a good screen on this
laptop that doesn't flexy and has a
color gamut and no backlight bleed.
Like, when you compare this to like an
OLED or the Apple with the mini LED,
there's just like no contrast. Like,
this is this is this screen. And again,
we're still in a setup, so we'll wait
till we get to the full thing, but like
this is my MacBook,
right? like like it's just not there.
And these aren't that dissimilarly
priced computers either.
All right, I got to go in like 15
minutes. Well, we we'll be able to get
into Omar, actually. This is good.
feels slow.
The Halo felt a lot faster.
[snorts]
No, I'm telling you guys, we could do a
review. I don't have it here. It's at
home. But if we do a review on my HP
ZBbook, most things about it are
actually pretty awesome. Like the build
quality is great. The screen quality is
great. The touchpad's great. The
keyboard's great. Like there's a bit of
HP jankiness about it. Like it has like
weird logos everywhere, which I like
that the framework doesn't have. But
honestly, I'll take a weird logo over
like this. Like I don't want this.
Yeah. Okay. This screen is Oh my god.
Oh my god, it like looks washed out.
Oh, I forgot how bad Omar is until you
configure it a little bit.
Just This has a real password so you
guys can't see it.
If you guys saw, it's not that big a
deal. It's our guest password to come.
Close that.
No, we don't update. You can update
later.
All right. Power savings.
Um.
Gh, that's not
I need to remap that to control.
Otherwise, I just don't know how to use
a computer. Um,
oh, it feels slow, too.
Unless like is it cuz the battery is
close to dead? But yeah, it does not
feel fast.
and see if this works.
I don't have the Ryzen SMU. Uh oh, yeah.
Let's just download Ryzen adjust.
I bought an HDMI capture card for this
stream, too.
Why is it installing T-Mox from git?
Install the T-Mox package.
We might want to update.
Um,
oh, here we go. Oh my god, it's worse.
That's That's I mean, that's just it.
It's drawing seven watts right now.
To be fair, I spent a lot of time
configuring the Oh, no. Okay, we're on
balance. Let's go to power saver.
It's drawing seven watts. Yeah, this is
on this is not usable.
I was really hoping that stricks point
would have better power draw, but like
on my laptop.
So, this is the draw of the of the CPU.
Oh my god. What?
This touchpad's also not as good as the
one on the HP. It's not terrible, but
the HP one is better.
Uh, no. They only have one screen for
the uh for the 16.
I mean, can I see the total power draw
of this thing?
How come they don't have a sensor there?
Oh, that's it there.
Well, it's like charging. So, let's
unplug that and see.
It's slow to update.
Still says plugged.
Yeah.
Okay. The appsy. Again, these were
things that I was hoping for from
framework 2 that don't seem to be there.
Like that the appsy would be really
good. So like HP has like they only test
those things on Windows. So, I was
hoping that this would be better on
Linux, but yeah. No, this is not there.
Disappointing.
Disappointing. Um,
yeah. Oh my god. Oh my god. I just
picked it up. Yeah, I just picked it up
and I put my finger here and this corner
is absurdly sharp.
[snorts]
Uh,
oh, we want to update. Um,
why does it still think it's plugged in?
>> [snorts]
>> Okay. So, yeah. Um, I should have
brought my HP in today. I didn't know we
were going to do the framework stream,
but let's uh
Yeah. Uh,
[snorts]
so
I have a lot of hope for this company,
but I wouldn't buy this product. Um,
I bought the framework desktop, too, and
I think that that's probably going to
work out to be better. Um, so I really
like that they pushed the like I asked
for this and they pushed the uh so this
is the
uh this is the schematic
of the laptop, which is really cool. U
and I have some hope of like fixing the
power uh on this one in a way that I
don't on the HP, but the build quality
on the HP is leaps and bounds better. I
the build quality on the HP, aside from
like some janky HP things like having
weird branding everywhere, is on par
with a MacBook. Um,
so if you can deal with a 14-in screen,
which I mean it's a little annoying that
it's 14, but I am going to stick with
this laptop. Um, you know, I was hoping
that I could be persuaded with the
framework. I really like that the screen
is that the uh that the the schematic is
open source. Their BIOS is a lot better
than the HP BIOS. That secure boot thing
is totally on me. Uh, that was not on
framework. Um, you know, that was just
me not understanding. The HP one was way
more confusing. There's all this weird
HP crap in their BIOS about how they can
like remote control your computer and
stuff. And like, yeah, I hate having all
that on my computer, but for the build
quality of this computer, the build
quality of the framework is not there.
Um, and the screen's not good. So, like
like this corner, this needs to go,
right? This is a this is a sharp corner
where I put my finger. Um
the power draw is worse than the HP uh
out of the box on Linux and I did a lot
to optimize the HP too but um so it's
not like you're getting like great appsy
or anything like that. Uh in fact it
looks like HP put more effort into it
than framework. Um oh the battery did
eventually show up. It says I'm at 45%
right now. Um I don't think this has a
big battery either. So, one of my other
complaints about the easybook is it only
has a 75watt hour battery, but to be
fair, that's in a
um
85watt hour battery. Okay, so it's a
little bit more. Okay. So, my two
immediate recommendations to framework,
uh, if you actually want me to use this
laptop,
um, build a new this
the level of flex in this and the low
screen quality. Like, build a new one of
these. Get rid of this sharp corner
here.
Um, which I like, God, did someone pick
this up?
Um, like this corner, this one's
rounded. This one's sharp. What are you
doing? Um, so yeah, replace the give me
an OLED option. Uh, what's the
resolution on this
hyper control monitor monitors
by,600. So the resol I mean it looks
okay. It looks okay resolution-wise, but
the color gamut is not there.
Um, also why do these things I have to
hold the Fn key to do brightness and
stuff?
Oh, that's full brightness. Oh, guys,
guys, that's full brightness.
Let's compare.
Yeah,
like that's full brightness on my
MacBook.
You can't really see it on the camera,
but
I mean that's the other thing you hope
for at least with this kind of LED LCD
is that they're very bright. The the HP
Omen isn't that the HP Zbook isn't that
bright. Uh that is one of the downsides
of OLEDs, but the I mean the OLED looks
looks stunning.
I don't know. like this page looks more
okay,
but
yeah,
you just you just can't like you can't
ship uh in the current year a normally
backlit LCD in a laptop anymore,
especially not in a laptop that costs
this much money. Um, so also like this
configuration, like I I like that
there's no letters on the keyboard, but
like that's just a troll. This
configuration is the standard
configuration for everybody. just ship
this whole thing as one piece, right?
Like just just ship this whole thing as
one piece. Call it like the the standard
one piece thing and it'll hold in place
a whole lot better. So like yeah, with
like a new screen. Also, let me see if
this fits in my case.
Um, this is a MacBook 16 case. Uh, the
Omen fits in the MacBook 14 case, which
I like. God, does anyone think it idles?
Yeah, it doesn't fit.
It doesn't fit.
It has to be mini LED or OLED. Yeah, you
can't just have a single backlight in
the current year for a laptop. It's just
not really acceptable. Um, also the the
level of flex on here is way too much.
Like
it's hard to cap, but like like the fact
that I can
when I when I torque on the screen on my
MacBook, the whole MacBook moves. When I
torque on the screen here. Yeah.
Um
I really wanted to like this. I really
wanted to like this. I was worried about
these things and it's exactly the things
I worried about. Uh I would say it's
pretty much exactly on par with what I
expected, but I was optimistic. Um
it's it's
yeah, it's it's not if you're coming if
you're coming from a MacBook, you're
going to be very disappointed. Um, if
you're coming from a MacBook and you buy
that HP, if you're coming from a MacBook
14 and you buy this HP, aside from the
battery life, I don't think you're going
to be disappointed with anything as long
as all the stupid little branding
doesn't bother you.
Um,
like maybe I'll do another I'll do
another micro stream where we review the
uh we review the HP. Uh, but yeah, the
the build quality on the HP is is Apple
level. Um, it does have like janky
things like little webcam covers, but
this thing has them, too. Like, I don't
want any of this. Oh my god, I don't
want any of this. I don't want little
doohickeys.
Like, Apple doesn't have that, you know?
No little doohickeys and no stupid
branding. HP, get rid of this little
doohickey and get rid of your stupid
branding and immediately, just by
subtraction, your laptop's better.
[snorts] Um, but yeah, uh, the touchpad
on here is higher quality than the
Framework one. The framework one's not
bad, but it it's Yeah.
Again, no, this is this is worse than
the Lenovo I bought, too, which I wasn't
happy with and thought was unusable.
Um,
the performance doesn't feel great. Uh,
I don't know if it's like memory latency
or something, but the Stricks Halo just
feels faster. The power draw is worse on
this than the Stricks Halo.
Um,
yeah.
No, it's drawing it's drawing almost 15
watts now. So, this thing's going to
have a battery life of like 5 hours.
Yeah.
Yeah. Lunar Lake's interesting. I just
use a It's a MacBook 16. Whatever the
top config is of the M3. Like I push
this screen down like like I push this
down and this stays high.
[screaming]
Uh which Lenovo I bought like a ThinkPad
Carbon X1. I paid a lot of money for it.
Like I bought the fancy one. The
processor was such dog shit. Um okay.
Yeah. It's too long too. It's too long.
If if you're really into
customizability,
um maybe this laptop's for you. But if
you're looking for a MacBook
replacement, this is not there.
That is my review of the Framework.
No, it can be beat. MacBook can totally
be beat. This is close. This laptop is
close. If AMD fixes the power draw and
HP just makes this without the stupid
branding and in 16 inches, you've got
me. I'm never going back to my MacBook.
Make this laptop 16 in 100watth battery.
Uh I kind of like the 14's kind of fine.
Like it's a little small. It's a little
small, but the the screen on this is
stunning. The screen on this laptop, the
screen on this HP is better than the
screen on a MacBook. Um it's an OLED.
It's beautiful. It's beautiful. It's all
it has 100% of the color gamut. Like,
you just wouldn't believe how good that
screen is. Um,
no, they they do feel good. They do feel
good. Why don't I reach out to HP? Who
am I going to reach out to at HP? Like,
that's the other thing I like about
Framework. Framework will get better. I
I have faith in Framework long term. I
would not buy this product, but I would
keep an eye on them. and when they ship
something that they're trying to replace
a MacBook with, uh, you know, yeah, I
have faith in Framework getting better
as a company. I have zero faith in HP
ever getting better as a company. I I I
just
[sighs]
I I got to go and I got to go. This was
only a micro stream this morning, but uh
Why is that being slow?
>> [sighs]
>> I'm typing this blog on an HPZbook Ultra
G1A14. Question to HP, who names this
crap? Why do these companies insist on
having the most confusing product
lineups and names? Are ZBooks good or do
I want an Omnibook or a ProBook? Within
ZBook, is Ultra or Fury better? [snorts]
Do I want a G1A or G1i? Oh, you sell
ZBook Firefly G11? I like that TV show.
Is that one good? Wait, wait, wait. Omen
Max 16Z AK0000 has a lot of capital
letters. That one must be best, right?
But there's also an HP Elite Book. Elite
sounds like the best. Do I still want a
ZBook? Like, these aren't even made up.
These are legitimately here. HP laptop,
HP Probook, HP ZBbook Fury, HP Elitebook
8, Omen Max Gaming Laptop, ZBook
Firefly, Probook 4,
Omnibook 7, HP Laptop 15T,
which one do I want?
It's a joke. I'm telling you guys, if if
you're set on not buying a MacBook, buy
that one. And you're okay with 14
inches, buy that one. You'll be happy
with it.
You'll be happy with it. I'm going to
switch to it. I would have loved to been
able to switch to the framework, but
also it doesn't fit in the case. Like,
here's the case I have for my MacBook.
It doesn't fit. It's too big. And like,
what am I putting this bigness into,
right? Like, this is just this is just
waste. I don't need any of this, right?
The laptop should be cut there. It
shouldn't have this sharp edge. It needs
a way better screen and it shouldn't be
flexy.
Um, I will also give them props. That
guide was very nice. The like
customizability, build quality is there,
and this is why I have faith in
Framework as a company, but there's a
lot of refinement that still needs to be
done. Um, the Framework 16 is not a
MacBook replacement. Uh, and for the
price it sell, it's it's just totally
not worth the price it's selling for, at
least in my opinion. Maybe if you have a
different niche. Uh it is. But yeah, now
it's
You guys should feel how good that HP
is. Like I love that HP laptop. It
really feels great. Um you know, just
just just just just [laughter]
actually I think I took too much for
granted on that HP laptop. Like I think
I took too much for granted because this
is my experience with a lot of PC
laptops that I buy. Uh they're just
totally not at a point that I would
consider replacing a MacBook. But that's
the first laptop I felt like that has um
I I don't have it with me. It's not
home. So uh yeah. Why am I ditching Mac,
guys? It's over. Mac is over. This is
they're they're a user hostile company.
They're also not going to get better.
Like Framework's going to get better.
Mac's going to go downhill and HP is
going to stay identical. So
when I reach out to HP, I'm going to
like reach out to some like bisdev corp
asshole. Like that's the other thing
that's cool about framework. Like I
emailed Nurav and he emailed me back.
Like he wants to do better and he will.
He will. In 5 years I bet Framework's
going to make a sick product and can
actually give Apple a run for their
money, but they're not there today.
Um,
have you ever tried Dell? Yeah. Again,
like you know what? This reminds me of
the Dell laptop that I had in high
school. The screen reminds me of the
Dell laptop I had in high school.
Mac with Asahi Linux. You can read my
blog post for my rants about Asahi
Linux. What about the Razor? Oh, dog
shit. Dog shit. I tried with that one. I
tried with that one, too. Um, and it was
just not
uh
Yeah, do not buy a Razor.
Buy this laptop. You'll be happy. If
you're buying anything that's not a Mac,
buy that.
Um,
OLED is coming to Apple in less than a
year. Yeah, they're also going to
supposedly have a folding iPhone, but
like, yeah, again, they're just user
hostile. Apple has lost so much
goodwill. They're going to lose their
developer community. Somebody's going to
build a better laptop.
All right, that was my Thanksgiving.
This was my Thanksgiving project. This
was my Thanksgiving bike shedding, the
time I thought about building a laptop.
We have lots of stuff to do. We have
lots of tiny grad to do. We have no time
to build laptops. Um, you know, to be
fair, actually, a lot more that's wrong
with this laptop is on AMD than on HP.
Uh, AMD needs to fix the power draw of
their chips. The power draw is too high.
Anush is on it. He replied, he sent me
an email with some guy who didn't reply
to me, but I was like, yo, like, should
you expect the power to be less? They
think it should be. It could probably be
less. There's 69 files in the BIOS. If
AMD fixes the power draw, um, this HP
seems actually great. Uh, I I kind of I
think that it can use a when I turn the
display off. It just turning the
brightness down on the display doesn't
get rid of all the power like keeping
the display on and stuff. So, the
display does draw a bit more than a watt
than I first thought. Um,
but uh, no, I mean
this experience with the framework has
just reminded me how good this HP is.
Uh, it's got all the ports you want. But
again, they put stupid branding. I don't
want Poly Studio branding. It comes up.
It has a popup that says Wolf Security
and AI experiences. Get rid of all of
this shit. HP. Like, you have a good
laptop. Just delete shit.
Um, but yeah, I mean, the build quality
on's phenomenal. though the touchpad's
Apple tier. You wouldn't notice that
it's not a MacBook touchpad. In fact, I
went back to my MacBook touchpad. It
felt almost bad compared to the HP one.
The HP BIOS, all the amount of crap in
the HP BIOS. All right. Uh yeah. No,
Asahi. Yeah. Yeah. Yeah. You see my
thing about Asah. Um but yeah. Okay. So,
final verdict on Framework. I really
like them as a company. I like that the
motherboard is open source. Uh, I think
I like that Nurov responded to my
emails. I think they're a company on the
right track. I think that this product
is just not
they're they're they're catching off,
but this is not this is not a laptop uh
I would buy for for daily use. Um, but I
bought a desktop, too. I bought a
framework desktop. So, maybe when that
comes, we can do another review on it.
Um, but yeah, they got to fix the
screen. They got to fix the flex. They
got to fix the size. and they got to fix
the overall just build like like like
like yeah you can be competitive. I'm
not even talking about Apple. I'm saying
be competitive with HP. Other things
that I like is that their branding is
classy. Like it's just this right?
There's not like stupid branding all
over this thing, right? Like there's not
like a little thing that says like Beats
by Dre or whatever, you know? I don't
want any of that. Um a little bit of
little bit of branding there too. You
could lose that branding. The one
branding is good. doesn't have a lot of
weird writing on the bottom, but it does
have like too many things.
Like there's like too many things on the
bottom of this. Like too many things.
Yeah, great. You can like insert a GPU.
I don't care. I don't care. Stricks Halo
is good enough.
Um
the HP is slim. You'll love that laptop.
If you buy that HP, you will love it. Uh
yeah. I don't know. See, and this just
says like, well, yeah, you just got to
make it HP good. All right, cool. Thank
you for watching my stream. Uh, it was a
micro stream. Uh, I'm really We're
rooting for Framework, guys. We're big
fans of Framework. We're big fans of
Framework, and we want them to be
better. We want them to do better. Uh,
and hopefully they will, and I'm excited
to see what the rest of their product
lineup holds. I hope my review was
helpful to some people. Uh, and yeah.
God. All right. No, George, don't build
a laptop. No, the the break's over.
Thanksgiving's over. Stop thinking about
building a laptop. This is is a bike
shedding to the extreme. You shouldn't
be bu You're not building laptops, okay?
Stop building laptops, okay? Fix the
fucking software on the HP. The only
problem with it is software. The only
problem with anything ever is software.
The hardware is phenomenal. Your only
complaints about the MacBook or
software, too. All the complaints are
software. The hardware is way better
than you're going to do. Hardware is
total bike shedding. Stop with the bike
shedding. Fix the software. I'll see you
all in the Tiny Grab meeting. Bye-bye.
Welcome to the laptop Olympics opening
ceremony.
Uh, all right. We're going to we're
going to give you guys a minute. I'm
going to go get a get a get a drink. But
we're hosting the laptop Olympics. Just
the opening ceremony. You get what I
mean by opening ceremony. All the
laptops are closed. So, we're going to
open them. And it's brought to you by
this dirty microfiber cloth. Okay. If
anyone wants to be a real sponsor, uh,
contact me at, uh, george,
don't contact me. You'll piss me off.
Like, like, I really want to advertise
for someone who doesn't want to be
advertised for. Remember that time that
Jay-Z was drinking the champagne? You
know what? What champagne was he
drinking? Uh, you know, um, Sha Don or
something. Crystalall. And then he
pissed off the Crystalall guy. And the
crystal guy said, "We don't want those
kind of people drinking our champagne."
And then like sales plummeted. That is
what I want to do to a brand. So
whatever brand doesn't want to be
associated with me, that is the brand
that I'd love to shill for in this
stream. Welcome to the laptop Olympics
opening ceremony. Look at this. This is
production. I got two cameras. That's
production, boys.
All right, let's go get some
To clarify that story, I want to be like
Jay-Z, not like the lame ass French
champagne guy. We only gatekeep
programming. We don't gatekeep bullshit
like overpriced crushed grapes. All
right, we don't even really gatekeep
programming. Anybody can participate,
but you have to have skills. You see,
that doesn't mean anybody can
participate right now. You got to
practice your skills. You can't just
show up and not have practiced your
skills and expect anyone to respect you.
You got to earn respect.
Okay.
Some of them were charged, some of them
weren't. They're plugged here into this
anchor charger. See if we can see it
here on the little screen.
All right. We got 118 watts of draw.
Most of it coming from that MacBook over
there.
>> [sighs]
>> Um,
hi from Somalia. What's up? You really
in Somalia right now? How is that place?
I hear it's like the hood like No, like
the but not like the hood like you know
like the hood that like Will Mabu did
the song in. I'm talking about like the
hood hood. [snorts]
All right. When will we who will we get
for the laptop Olympics halftime show?
But we can't play Taylor Swift because
that shit's hella copyrighted.
Man, I really am the best ad for
Highball Energy, but they would want to
be associated with me. Who would be
upset if I was shilling their brand? I
don't even think Rolls-Royce would be
upset.
Uh,
why does so many AI slop startups these
days? Yeah, Sony might be upset. Yo, you
want to like take apart a Sony and try
to trigger them? I don't think they
care. You think anyone's left at Sony
who gives a shit about me? No.
Definitely not.
All right. It's too hot in this
sweatshirt. We need better merch. Okay.
This is a lame old comma shirt. We're
getting better merch. We're going to up
our merch game. Our merch is overpriced
and bad. It's about to be overpriced and
good.
Okay. Um
Oh my god. I need I need a camera guy.
Okay.
Uh I got a spin drift right here. This
is spin drift and we're double fisting.
Yeah, double fisting.
Okay.
Um, Apple might be upset. I don't think
Apple cares.
Um, okay.
So, let's introduce the contestants.
We're going to try holding this camera.
All right. If you don't like my
videography, you can blame the
videographer guy. Okay.
On the right, on the left here, [gasps]
we have a MacBook
M1 Max Pro
M1 Max. MacBook Pro M1 Max
running Asah Linux or at least last time
I checked, which was probably many years
ago. I don't think I've opened this
laptop for a long time. Okay, can we get
a round of applause for the MacBook,
everybody? Round of applause for the
MacBook.
Oh, MacBook.
Oh, it really doesn't want to open.
Okay. Well, doesn't want to open. Come
on. You're in the Olympics. It's good.
It's good. All right. All right. It's
dirty. That's why we have our dirty
microfiber cloth. Oh, why did it boot
into Mac OS?
Okay. Well, it booted into Mac OS.
Great.
Okay, the MacBook.
Um,
now introducing
the It's booted. Look, it booted. Look
at that. Look at that. No backlight,
please. Look at this. Look at this
quality display. Look at this. Look at
this quality display. Isn't these like
fingerprints? Like, you can't compete.
This is the oldest laptop of the bunch,
by the way. You know, look how there's
no backlight bleed at all. And it's
dirty. It sat under my bed for a long
time. Okay, introducing
the second contender, the ThinkPad X1
Carbon.
Is there an on button?
Ah, here we go. Right on the side here,
very conveniently located. Coming in
with that beautiful keyboard backlight.
It has a stunning OLED screen. This
laptop costs way too much money for how
crappy it is. It's a Lenovo.
It has less power than a Zfold 5. Let me
just enter the password over here and
make sure you guys actually can't see
the password. Okay, we're good.
Oh god, I don't actually remember the
password.
Okay. Well, we have a password that we
do not remember. Uh, we're going to have
to format this and put Omarie on it.
Fortunately, it comes with a USBA port.
A convenient USBA port. In fact, the
MacBook here is the only one without a
USBA port. Let's see if we can log into
that one. Do we know the password to the
MacBook?
Oh my god, I haven't logged into this
computer in so long. Probably has
vulnerabilities. Sweet. We know the
password to the MacBook. Uh, maximum
number of tries exceeded. All right,
let's try this one more time.
We legitimately have no idea what the
password is to this. And this thing's
opening lots of weird crap. Okay.
Our third contender. Don't download
updates for Discord. Please don't. No.
No. No. Close. Close. Close. Close.
Okay. Okay. Great. All right. Great. Our
third contender. Oh, yes. I forgot to
introduce the ThinkPad Carbon is the
only contender with a throwback to the
'9s. The clit mouse. Look at that. Look
at that. So neck beards can pleasure
their laptop. Well, they pleasure
themselves. It's a ThinkPad X1 Carbon.
ThinkPad X1 Carbon. It also does have a
have a touchpad, but we don't remember
the password. And right now that OLED is
just screen burning. So yeah, we're
going to have to install our marchie on
that guy.
Okay,
this is the framework
16, the newest contender in all of the
laptops. Uh, it has a screen that gives
me flashbacks to high school, my Dell
laptop in high school with the back
light bleed with the single CCFL tube or
something. I don't even know if it's
LED. Uh, yeah, check out that no
keyboard. It is the cleanest of the
laptops because it is the newest and I
do remember the password to this one.
Maybe. I think so. I typed it in
yesterday. Okay, great. And we are on
Omari on the framework
17. Uh, which of these is? There's the
That's the maximum brightness it gets
to. Oh, this is installing some stupid
firewall. I'll just post so many
vulnerabilities in this. Look at how
beautiful that black MacBook screen is.
Can we Can we Can we hear a round of
applause for mini LED technology, OLED
technology, and backlight from 2004
technology? Also, why? Look at how
shitty it is. Look at how it's
reflecting the light. There's something
wrong with this. Like like because I see
that in person, too. This one doesn't
reflect the light. This one reflects
everything. And this one has a huge blob
where the light is. Okay. And last, but
certainly not least with more names than
a Mexican, the HP
ZBook Ultra G1A 14in stricks Halo
Edition. It's this laptop. This is
actually the laptop that I've been using
and it'll unlock conveniently with my
fingerprint right here. Okay. It also
has an OLED screen, 14 in, 75Wh hour
battery. It has a clear contender to be
the top laptop here. It does
unfortunately have more branding than a
rally car on Sunday. You can see the
Zbook and this I don't know if that's
supposed to be AI.
Also, if we go over on the side here,
you'll see that it says Poly Studio
upside down for no reason. And it also
has HP right there. So, we will have to
rate this laptop as not classy. HP,
could you please make a classy laptop
for classy people? This is a classy
laptop for classy people. Okay, welcome
to the laptop Olympics, everybody. If
you're just joining us, we have a
MacBook Pro M1 Max. We have a ThinkPad
X1 Carbon that costs way too much money
and has less computing power than a Zold
7. Yes, this has more computing power
than this. What a dog shit processor. We
have the Framework laptop and we have
the HP
uh stricks Halo blah blah blah. Okay,
sorry for offending your culture, HP. Oh
yes, and then of course over here we
have the MacBook that we're streaming on
for people who actually want to do work.
Okay, great. Um, let's first try the
torque test. The way the torque test
works, we place the camera here, we
place my hands here, and we flex the
monitor. Notice how easily the laptop
rotates with no flex. We are going to
give this nine torqus out of 10. Okay,
that's pretty good. It's pretty good
entry in the in the laptop Olympics. A
16-inch MacBook Pro passes the torque
test. Let's move over here to the X1
Carbon and do the same thing. Okay,
let's see. Oh, it's pretty good. You see
a little bit of flex in the panel. So,
we're going to give that one a 9 out of
10. And we're going to give this one a
seven out of 10. I can see a little bit
of visible flex in the panel. Okay,
great. Now, on the framework 16, we are
going to try the torque test. Ooh. Ooh.
Yeah. Ooh. I feel like I'm going to
crack the screen if I keep doing this.
We are going to give the framework a two
out of 10. Would not lie it on the side
in your bed.
And for the HP, we're going to give it a
Oh, that's pretty good. That's pretty
good. We're going to give it the same
nine out of 10 we gave the MacBook. So,
if we can just zoom out here and see the
scores. That's a nine, a seven, a three,
and a nine.
All right, welcome to the torque test.
Okay, let's do the install Omari test.
Uh, this one is only for that laptop.
And we have to go find that stupid
driver we used yesterday.
The Oh yes, we should talk about the
processors that they're rocking. This
one, of course, has a M1 Max. This has a
Intel dog shit. This has an AMD stricks
point and this has an AMD stricks Halo.
Let's install Omari on this one. And
that one took about two minutes to
install Omari. So, let's plug it into
the convenient USBA port. Good thing we
don't have to do this on the Mac because
that one does not have a convenient USBA
port. All right, USBA. I forgot it can
be plugged in upside down. And of
course, you will get it upside down
every time. All right, let's turn this
off and on again.
Is it going to boot?
We have to disable secure boot again.
Okay, it does not want to turn off. I'm
holding the button, guys. You see me
holding the button.
M
control delete. Control delete seem to
work. Let's use the dirty microfiber
cloth to wipe some of the dirt off of
this screen. The screen does not come
dirty, unfortunately.
Let's interrupt normal startup. Okay,
let's give this Let's rate this BIOS.
Okay. Yeah, pause.
Um, okay. Well, good thing we can show
the asset information and the regulator
information.
Uh, let's choose a temporary startup
device.
Okay. Boot menu. Tab.
No.
Enter.
Oh, there we go. USB HDD.
Okay, let's go. Will it install? Omari.
Will it install?
That's pretty good. That's pretty good.
By the way, check out how there's no
backlight bleed down here on this
beautiful OLED screen. It does
definitely have that going for it.
English username.
We'll use a throwaway password again.
One I actually remember. Yeah, let's go.
Host name.
Think Pad
again. We're going to have to scroll
down. If anyone is using this in Africa,
blah blah. Uh, okay. NVME
format disc. Bye-bye. Whatever was on
that laptop, we'll never need to know.
This is running the beautiful Omar. LOOK
AT HOW MUCH GLARE THAT IS. That glare is
real, guys. That's terrible.
It's terrible. The, you know, the screen
isn't even that bad. The colors are
actually fine, but what's so messed up
about it is like this is like normal
office fluorescent lights. And notice
how you don't see that on any of the
other laptops. You don't see it here.
You don't see it here. You see something
else here, but that's like less of a
problem. That's not that great either,
actually. I would think the uh the
ThinkPad with the matte OLED is
definitely the best. Like you can kind
of see like there, I'm really trying to
get that reflection in there. You like
kind of see it, but it's like barely
reflected. This one's super LOOK AT
THAT. LOOK AT THAT. UNUSABLE.
UH, the HP is
glossy. So, these have the downside of
glossy, but you know, whatever.
Isn't the ThinkPad tilted different? No,
they're tilted the same. Try take it
through a full
degrees of tilt. I mean, that's the
window now reflecting, but the ThinkPad
like it just it's so the the it's
unusable. It's really like the frame.
It's not even the LCD. It's whatever
they used in the polarizer on this
thing. Um, they need to get the
polarizer technology from the other
laptops. Okay. Let's proceed with
installation.
All right.
What gen X1C is this? It's a Ultra 155H.
All right. Let's go over here, guys.
It's impossible to look at. Look at that
glare. Look at that glaring glare.
Let's first go over here to Stricks
Halo. Let's try the Tiny Grad GPU burn
test. All right, let's check. By the
way, this has a touch screen. So, we can
go here to balanced.
No, that doesn't work, but sort of
works. Let's check out master.
Oh, we got third debug equals two on
there so we can actually see it.
Okay, so this is GPU burning on here.
You can see that we're getting six
teraflops.
See down there? Oh no, now it's boosted.
Something in the AMD SMU finally kicked
in and now we're getting 11 teraflops.
Okay, so that's 11 teraflops from the uh
from the HP Stricks Halo. Let's also
listen for fan noise.
No fan noise. That's pretty good. What's
our power draw right now?
We're pulling 40 watts off the chip,
which is actually the most you can pull
in balanced power mode. See that 40
right there?
Okay.
By the way, you can all see the real
winner of the laptop Olympics already
sitting up there. That's my M3 Max
MacBook that I'm streaming to you on.
Try the performance governor. We should
keep them all balanced cuz we're going
to do this one balanced, too. We can't
test them all. We don't have enough
budget for that. If anyone wants to
sponsor the laptop Olympics, we're
always looking for sponsors. Oh, yeah. I
was trying to turn on the LED backlight.
All right, let's go over here to Tiny.
Check out master. Let's get pull.
I forgot control isn't okay. Installed
in 2 minutes 20 seconds. So, even with
that dog shit Intel processor, it did
about the same speed as the framework.
is a little slow, I think. I forget what
it was yesterday. We can check the
stream. Let's [snorts] boot that into
March. All right. Could not resolve
hostgithub.com.
All right, we should be Yeah, we're
connected to the Wi-Fi now. That's a
homearchy issue. All right, great. GPUs
equals 1. Python path equals this. Debug
equals 2. Python 3 extra GPU burn. Let's
make sure that we're set to balanced
because we're doing balanced on all of
them.
Um, AMD LVM equals 1. You got to just
know the magic flags of tiny grid. Okay,
give it a minute to warm up.
And we are getting
3.8
teraflops over here with stricks
11. By the way, that's been going this
whole time. Have you heard any noise
from this laptop? I thought the
framework thermals were pretty good, but
the HP thermals are actually sick. I
don't know what was throttling up in a
game.
Um,
you can hear it a little if you listen
to the fan. All right,
the third contender right over here.
All right, let's log in to the wifi.
By the way, how nice is it that Omari
just works. It has a real password. So,
again, I'm gonna move you over there.
By the way, this is like half an ad for
Tiny. Okay, we pulled the latest Tiny on
this MacBook.
Let's run the same example. Do I also
have Azytop?
I don't have Azytop. Um, oh, Brew is
going to like update everything, isn't
it? By the way, could we just give a
shout out to the absolute stunning
quality of this laptop screen? Even
though this laptop is the oldest of all
of them, and it's still trying to tell
me to get more from my Mac.
[sighs]
All right,
which laptops are we hearing now?
Quiet. Quiet. Good. Good. Framework's
good on the on the thermals. See what
we're actually pulling right now.
38 watts. That's pretty good, actually.
38 watts and pretty much dead silence.
This is finally warmed up a little bit.
And we can hear a little bit of fan
noise coming out of the HP. Um, I will
remind you that this is doing 3x the
performance of that.
All right. Uh, great. We installed Azy
top and it like did stuff.
Cool. Um, by the way, can we just give a
shout out to Apple's incredibly low idle
power? This thing is idling at 6 watts.
This is the oldest laptop of the bunch.
And I really must say none of you guys
come close. This is It's so sad. It's so
sad how Apple is kicking all your asses
with an old ass laptop. I would say that
this uh
the password got to hide. It's not even
a real password. I don't know why I'm
trying to hide it, but you guys are
freaking me out about that. Um,
someone's going to hack sore my box.
Let's unplug this USB drive. You don't
get an unfair advantage anymore.
ThinkPad. All right,
the framework's still going along in
almost dead silence, which is pretty
cool. Uh, this thing is losing power
real fast. So, I'm just going to swap
around some wires here.
Um,
one watt. But that's terrible. It's not
charging.
It's not charging. Probably because this
wire isn't rated for like PD bullshit.
All right. I heard this about the HP
that it only charges if you have a
adapter that's capable of doing 100
watts. So, we're just going to do a
little switcheroos over here.
Anchor. Let's see if that charges.
Still only pulling one watt. If it
doesn't charge with that, it doesn't
charge with anything. I actually have
the charger for that laptop with me. Why
is that only pulling one watt?
You're not looking good in the laptop
Olympics. I was rooting for you. Why
aren't you charging?
Still not charge.
This is one watt.
It's terrible.
All right, we'll have to get out the HP
power brick. Wherever it is.
Where's the HP power brick?
All right, this is the off
one watt
C2 over here. That guy's drawing 42
watts. All right, here's the HP power
brick.
See this 140 bullshit watts?
I don't know
which one's plugged into the A.
Which one did I give the terrible one
to? Oh, the framework. That's not
charging either, but that's expect.
That's reasonable. Wait, that's insane
that that won't charge.
[snorts] All right, let's plug in this.
Plug that. Plug in this.
Is that going to make it charge?
Okay. HP gets a three for power adapter
compatibility.
Yeah, framework charges right up. Okay.
Is it charging now that I plugged in the
HP adapter? It really only charges with
the original adapter. That is terrible.
That is terrible. That that that like
the How many? Oh, but it went up 14
teraflops now that we've plugged it in.
Even though that shouldn't really do
anything, but whatever.
Okay. [sighs]
14 teraflops now that it's properly been
plugged in.
Oh, but now I hear the fan noise.
Okay, let's install Tiny over here. Get
clone httponegithub.com/tinyiggradin.
This is Tiny on a brand new install of
Omari Linux.
It takes way too long to clone. We need
to fix that. Oh, let's go over here and
get that GPU burn test going. GPU is
equals 1. Python 3 examples GP.
Let's put that screen. Wow, that's the
nicest screen. Apple really has the
nicest screens. Like, it is nicer than
the OLEDs, actually. I think the OLED is
nice, too, though. I mean, this is this
is a nice screen. We should we should
wipe it off a little bit to do it
justice. It's also a touchcreen.
Ah, the judges have a bias towards this
HPZbook.
I wanted to be good. Um, what did I want
to show you? I wanted to show you
something
on here. I can't believe it didn't
charge with the anchor charger.
All right, let's check out this guy.
An old T-Max. Whatever.
Um, Python 3. All right, we have Python
3. Python path equals that. GPUs equals
one. By the way, notice how Tiny Grad
needs no install at all. I just clit.
Let's see if it works. GPUs equals 1.
Debugals 2, Python 3, extra GPU burn.
Oh, and that's on CPU.
Okay, that's pretty mediocre.
The blacks on that Mac are blacker than
my monitor. Yeah, I know.
The Mac is still the best. It's the
oldest of the laptops. HP, you're
starting to make noise.
Framework's starting to make noise, too.
And this guy is still trying to use its
pathetic little CPU to do something. We
can see why Open CL didn't get installed
in a minute. Probably have to install
six Intel packages.
Still over here purring along at a
pretty beautiful 14 teraflops though. Um
oh, we have an entry from the ThinkPad
here running on the CPU. It got 11
gigaflops.
11 gigaflops. So over there that's a
1000x faster than that. I actually think
my phone is faster than this. Uh, but to
be fair, it's not using the GPU, so we
can give it a chance. We can give it a
chance. It's trying to compete with one
leg behind its back, and we like
everything to be fair. Okay. And GPU
burn is up on the Mac. And the Mac is
GPU burning at
7.7 teraflop. So, it's about half a
stricks halo. This is the first laptop
I've seen be competitive with anything.
This still does have the best memory
bandwidth, though. Let's just zoom out
here for the uh pan shot.
Oh, it's going. It's trying. It's
trying.
Um, this gets this gets minus one point
to anything for not charging on the
anchor power adapter. I I can't I'm not
lugging around that HP brick. If this
thing doesn't charge from normal ass
shit. Like, come on, HP. Really? I love
these little anchor bricks.
Look at that touch panel. Adds those
great things to the thing when you touch
it. W cinematography. Thank you. Thank
you. All right. All right. We got a new
entry here. That is six jigoflops.
All right. Fine. Let's make it use the
GPU. It did get It is the only one that
got reformatted on this stream. So, you
know, we have to be fair. The AMD ones
did just work out of the box, though.
Let's see what we can do.
Should we try to use the HDMI capture
card? That's not what the X1 is for. I'm
holding it wrong.
Okay. All right. Let's see if we can fix
the uh
first. Let me get pseudo list password
on here. Pseudo vi pseudo.
Oh no, but this is I hate when No, no,
there's actually some bullshit way to do
this in Omari.
Sudors.d
Oh, but now it doesn't have that.
Pseudoedit pseudo.d0000
light.
No password at all.
And we're still messing up. Okay. Oh,
it's downloading Treesitter. Everybody
let it download Trees.
Got to download Treesitter.
Okay. And the MacBook has the most
silentest fans. The HP, you're starting
to hear them. Let's see how much power
it's pulling now. Oh, we got that up to
60 watts. Even though I'm still
supposedly
on balanced.
Let's check rise and adjust.
Yeah. Okay. PPT limit slow is 40.
Why is this
Oh, no. It went to 60. Okay. Let's set
it to 40. Slow
limit 40.
No, wrong 40.
That really tanked the power.
Okay, now it's back to 40 watts.
This is You know what? Let's set it to
38 so it's really competitive with the
uh so it's using the same power as a
framework, right? We got a we got a
power
Yeah. Uh this just again shows like why
would you have a strict point when for
the same power
is the power. I mean it doesn't look
like framework has a lot of sensors
here. 36 watts. I'll put this down to 36
watts.
And let's confirm it's actually drawing
36. Okay. So we're actually here drawing
36.
Uh, at 36 watts, we're getting 10.6
teraflops. Wait, no. No, now it's going
back up. Stop it. Bad computer. Okay, we
get 10 teraflops at 36 watts versus 3.8
teraflops at 36 watts. All right, this
is still downloading tree sitter.
Oh god. All right, do I have
passwordless pseudo now? I do. Great.
All right. yay- s info.
Let's figure out how to get Open CL
working. Okay, we don't have OpenCL. Uh
LSPCI.
You like my
uh Okay, it's Meteor Lake.
Um
waiting for elephant.
Where's my elephant?
This is the slowest laptop I've ever
used.
My god.
I think this is just broken actually.
Let's give it a reboot.
All right, we got rid of waiting for
elephant gray.
Meteor lake open cl lit arch install. I
need that AI shit. Come on, give me the
AI shit. Oh, here we go. Level zero.
Uh, Intel compute runtime.
Let's just try yay- s Intel compute
runtime
OLICD.
All right, let's download. All right,
that might have not been the laptop that
slow.
Do we have working open CL? Oh, we do.
All right. All right. So, uh it should
just work now.
Yeah, you can see it's worth CL now.
All right. All right, let's see how many
dog shit flops I got. Dog shit flops.
That's 143 gigaf flops.
It's a little bit more.
All right. This will not stay power
limited. It's really eager to use a lot
of power because it's plugged in. Um,
and yep. Yeah, we're over here at 161
gigaflops.
Let's at least wait till it gets to the
jet so we can be competitive. All right,
everybody. Is everybody enjoying waiting
for the slow bus?
Does the clip mouse work? Let's see. Oo,
wow. That's disgusting. This is This is
disgusting. How do people ever use these
things?
All right, now that the jit is up. Oh my
god.
Oh my god.
Oh my god. Good thing I don't want to
multiply a matrix and it has some fan
noise.
Okay,
so
the beamless numbers. Can we test the
N3? That's unfair. [laughter]
Okay, so we have for the final numbers
we have
157 gigaflops.
Coming in in last place is
139 gigaflops.
Coming in in second place is the
framework 16 at 3800
gigaflops. Coming in in second place,
that's third place, bronze medal, silver
medal at 7,000 teraf gigaflops. And
coming in with the gold medal over here
is the Stricks Halo at 14,000 gigaflops.
All right, let's give them all the beam
just in case they need the beam. If they
need the beam, they need the beam. Let's
give them the beam.
We're going to beam them all at the same
time.
Going to beam them all at the same time.
Okay, so Tiny is this magical option you
can use called beam equals 2 that just
makes things faster. It's slow though to
start. That's the trade. Engineering is
all about trade-offs. Okay.
So, are we ready?
That thing over here is still whining. I
wish it would stay power limited because
it's actually good at 40 watts. It's
only when it gets to 60 that that fan
starts making terrible noise. So, I
actually thought the framework thermals
were better, but uh apples to apples
comparison, the HPs are better, except
the HP will not stay power limited at 40
watts when you are plugged in with the
stupid power adapter that it will only
charge with. What was first? The HP.
Okay, are you guys ready for the beam
extravaganza?
We're going to start them in reverse
order of their speed to give everybody a
fair chance because we believe in
diversity, equity, and inclusion. That's
right. We have lots of diversity. You
can see all this diversity represented.
We have black laptops, we have silverish
laptops, and we have
silverish gray laptops
and a dark space gray laptop. We see all
this diversity and inclusion. Okay. All
right. We love diversity and inclusion
on this stream. Great. See, now that
it's not cool to like diversity and
inclusion, we're getting on board. Kind
of like that time we bought Bitconnect
after it went down. True story. All
right, let's start this guy first.
Bitconnect was going to come back, guys.
Bitconnect was going to come back. All
right, ready? Go, go, go, go. All right,
they're beaming and they're off to the
beam. We got some beam searching going
on there.
H cannot pickle IDER tools count object.
Okay, we have an issue on the MacBook.
Parallel equals zero. Don't pickle. All
right. And the MacBook's off without
having any parallel. Let's turn that
screen up to full brightness and show it
off in its glory. No parallel on the
MacBook. The MacBook got a disadvantage.
It tripped out the gate.
I don't know why that's being slow. That
should be a lot faster than that. I'll
look over there. 50 watts down.
Are you watching AI slop? Yes, you're
watching compiling of AI slop. Okay, we
got the Max over here beaming. It's
beaming. It's beaming. It's beaming.
Let's beam. Oh, the Stricks Halo is
pulling ahead. It's already on the
second beam. Everyone else is still on
the first. Stricks Halo is looking like
a winner right here.
We got to pay attention to the ThinkPad
over here, though. It's It's moving.
It's moving. Look, it's mo. No, it's not
moving. Mac looking pretty good. Mac
looking pretty good over there with that
lit up 32 in the warp. That's pretty
nice. That means it's using the Mac
tensor cores. Tensor cores are in play.
Stricks Halo. Stricks Halo over here
still in the lead. Stricks point is
lagging to catch up. Oh, it's trying.
Oh, it's trying. It's trying. Oh, and
the Mac. The Mac. No, no, no. This is
still in the lead. We're on the second
beam here. You see, we're over here on
three. This is Oh, the Mac just got to
three. We got to three on the Mac. We're
on three on the Mac and we're still over
here on two. I'm very slow. Very slow on
the on the ThinkPad. I'm telling you,
the processor is actually slower than
the processor in my ZFold 5. ZFold 7.
ZFold 7 has a faster processor than this
Thinkbook. All right, this one um slow.
Oh. Oh, and we've moved on to nine down
here. We're really we're really zooming
ahead with Stricks Halo. It really is
the fastest of the laptops. Remember,
this is an old Apple. This is not
representative of new Apple, but how
pathetic is it that there are many
things about it that's the best? It
charges with a normal charger. Uh yeah,
so there's that. Okay. something. Oh,
and Stricks Halo's off. Stricks Halo
coming in at an amazing
17 teraflops. We are touching 17 over
there with the beam. 17 teraflops. That
is unbelievable in a laptop. Okay. Uh
Stricks point with the synchronization
failure. Let's try it again.
Yeah.
Uh wait, time out. Oh, and this went to
the screen saver. It got so bored. Okay,
this on screen saver, too. Okay, cool.
And we're still doing up there almost 17
teraflops. This is still running. Let's
go. Let's go. Let's go. We'll have to
try it with hip equals one. If that
doesn't work, uh, rigged test. Whoa.
Rigged. Whoa. Whoa. Whoa. Whoa. Whoa.
Whoa. Whoa. Whoa. Whoa. You accusing the
the the laptop Olympics of being rigged?
The laptop Olympics is a legitimate
organization.
Okay. Okay. We're like the FIFA people.
It's legitimate.
Okay, we got the the MacBook. I'm kind
of excited for the numbers the MacBook's
going to pull. And that thing is still
on kernel uh two. Yep. Yep. It's over
there on kernel 2. Stricks Stricks Halo
has been going for a while. Halo's been
going. Point is point is is struggling.
It's struggling. If colonels don't
finish in 30 mil in 30 seconds, the
driver times out. So yeah, Stricks
Stricks is struggling.
Ah, the PC's tested like but this is
just like the normal like I put Omarg on
it. You saw me do it. You saw me put
it's it's it's it's the Mac's doing
pretty well and that's with parallel
equals zero. And that's actually not a
Mac problem. That's because I have a
weird Python installed and we should fix
that. Cannot pickle tools count. Oh,
this is how does it have Python 314? How
did I just open a Mac and it has Python
314? But regardless, someone should fix
that. Does someone want to go fix that
bug in Tinyrad? It should work on Python
314. And we can't pick all eder tools
counts. Why can't we pick on ider tools
count? I don't. All right. Um, okay. And
the Mac is off. The Mac is coming in at
9.7.
Let's give it a 9. No, we don't see 9.7.
9.65
teraflops. 9.6. A classy 9.65 teraflops.
An overwhelming 17 teraflops. And a
timeout again. All right, let's switch
to Open CL.
Let's switch to Open CL.
I think Open CL should work. Let's try
CL equals 1. No, open CL error. Okay,
can't do that. Um,
let's go manually adjust that timeout.
God,
timeline signal.
Let's go in here to
hcq.py
tiny runtime graph hcq.py 30 seconds.
We need that.
You guys are just seeing hand, aren't
you?
A little blurry. Wait for that to come
into focus. Um, okay. Time spent
synchronizes online.
I want that HCQ
support HCQ.
Uh, weight is on line 259.
Time out. Oh, here we go. We have
already have a parameter for it. Don't
do that. Okay.
HCQ wait time out.
hcqdev
weight
timeout ms
equals 200. That's a good number of ms,
too. There we go.
There we go. 200 seconds. Okay, we we
want it to we want it to even finish the
race. Okay. Oh, and it's it finished the
first kernel. Okay, we got we got we got
a respectable 1.2 Two teraflops here on
this first kernel, which is something
is is something.
Green screen saver is insufferable.
[laughter]
The way T flops on the thing, pad, it
probably does. All right.
[sighs]
Do we like the laptop Olympics?
We're going to try our best to estimate
idle powers in a minute, too.
Oh, you feel sorry for who?
Look at the terrible glare. I'm sorry
you guys even have to look at it. None
of the other ones do that.
It's just a whole thing. Okay, it's a
little bit on the MacBook, but like
what? Like the laptop Parolympics? I
don't know. I think we have two real
contenders here. I think we have we have
the short bus over here in the middle
with the framework and the and the thick
pad. And then we got like this thing
which has some limitations. It's a bit
it's a bit fussy about what power
adapter it can use. And we got the uh
oh, let's see how much watts this is
using. This is using 52 watts. So
actually this at over here at 60 is more
power efficient than than this. But to
be fair, this is an M1.
Um, no, the blacks don't look better on
Apple. It's They don't. It It's um here.
So that's actually Well,
I mean, that's true black right now. The
Omari is just not really black in the
background.
Um, so this is like true black on the
HP, but yeah, I agree. They still kind
of look better on the Mac, but you won't
notice it. I I I think the HP has a
screen that's at least as good as a
MacBook. I think that this touchpad is
at least as good as a MacBook. This
branding is awful. The fussiness about
the power adapter is terrible. And the
battery life is is atrocious. The
battery life of this laptop is like 5
hours. The battery life of this laptop
is probably like 20. Um and the screen's
a little bit small. And we don't
I think with the new timeout I think we
might have made some progress on this
guy. Oh, we got we have to go marchy
screen saver coming up. Little lag
there.
All right. All right.
And we're up
and we're getting
one teraflop.
Okay. The stricks point managed to do
worse with beam than without beam. So,
let's go back to without beam. I don't
know what to tell you.
It actually managed to do worse.
I don't even really know how that's
possible. That's probably more of a tiny
grad bug, but it might just be
inconsistent power management.
So, we have a final verdict.
The standings did not change. This one
is still riding the short bus trying to
catch up. I'm telling you, the CPU in
this is unusable. Um, I can't believe
that they put a whole laptop around
this. This is also not a cheap laptop.
All these laptops cost over $2,000.
Um, the framework has an unbelievable
amount of glare on the screen. The whole
thing is just diffusing. That window is
just like it's like I can't see a thing
right now. It actually looks better in
the camera than it does in person. It's
not even it's not even the colors on the
screen. It's just like a frame like this
is just completely unusable as like just
look at that. It looks even worse in
person. This makes the framework
completely unusable until they fix their
screen. It it's the polarizer. Um I was
emailing with with Nurov about this last
night and he says that they have some
like matte but like like I mean I'm just
I got three other laptops here and none
of them are doing that shit. Why is this
screen so bad? OLED. Terrible. OLED.
Really, it kind of is the nicest screen.
All right, we got a little bit of noise
coming out of that guy now. Little bit
of heat. Got the most noise coming out
of this, but it is using the most power.
It doesn't make noise at 40. This one is
silent, but it's only running at 38. And
I bet you this thing uses a quarter of a
watt, which I guess is kind of good for
battery life because it probably has a
dog shit tiny battery.
All right, are we even going to let it
finish?
Hey, the max screen is so nice,
[laughter] guys. Like, just look at it.
It's so nice.
Oh, no. This one is nice, too. Let me
turn the brightness all the way up, too.
That is full brightness. Okay. The
brightness is kind of mediocre.
[laughter] The max screen really is the
best.
All right. Um, yeah. So, the short bus
is still is still coming in. Uh, the
screen's pretty nice on it. I don't
know. The fit's pretty nice on it. This
is the lightest of the laptops, but
yeah.
What's the graphana in the background?
That's the power draw of the uh the
guys. The just look at the glare on that
screen. It's unusable. It is so
unusable.
Oh, okay. Uh it's finally finished. We
got one more beam to do.
Yeah.
Yeah.
All right. We have the Yeah. I saw a
thing where they said the framework put
all of its eggs in the basket of
repairability, but like this isn't even
really true. This screen is just bad.
And it's not bad because of resolution.
It's not bad because of color space.
It's bad because of the backlight and
the glare. Like, you have to fix those
things. you have to like pay more
attention to whatever polarizer you're
using. Um, and also don't use a single
backlight. Figure out how to get a mini
LED backlight. It looks so good. Oh,
like just just the the the quality that
you see on that webcam reflects reality
with the one caveat that that isn't
actually black on the Omari screen. Um,
and I don't know how to quickly change
it. It's not black and marches. All the
marches have the same config.
Oh, what happened there?
Oh, the battery is dying.
Apple nicely saving my battery.
HP only charges with that one adapter.
Okay. And the MacBook is back running it
for gigaflops.
HP got its own charger, so it kind of
cheated. HP by being a whiny little
bitch got its own charger. All right,
still it's still going. You just came.
Who won? Um, okay. So, we have two
losers. Let's start with the losers.
Okay, let's start with the Let's start
with the losers. Okay, th this one the
whole time we've been sitting here has
exhausted my patience waiting to beam
something. So it doesn't even get to
finish. We're going to control C it. I'm
sorry X1 Carbon. You have less power
than my ZFold 7. You have been
eliminated.
Framework for having the most dog shit
glare on the screen I've ever seen. It's
it's it's it looks even worse in person
than what you see on that on that on
that thing. And don't tell me it's the
position. We can move all the other
laptops into that position. I played
with this all day yesterday. This makes
this laptop completely unusable. Also,
you guys, if you weren't here for the
beginning, we did the torque test where
we Look at that. It flexes. It flex. I'm
going to crack it. Look at this. Doesn't
flex. Whole laptop moves. Oh, no. But
that's not fair. That's a 14 in. Yeah,
this is a 16 in. Whole laptop moves.
Feels the most solid. 9 out of 10. Eight
out of 10. Seven out of 10. Three out of
terrible framework. You have been
eliminated. I felt like I was going to
break it just closing the screen. And
that leaves Let's get these ones out of
here. Let's get the losers out of here.
The loser laptops are leaving the laptop
Olympics.
Bye-bye. Bye-bye.
And we're left with two contenders.
the MacBook Pro from literally four
years ago. This is a four-year-old
MacBook Pro. Let's not even get started
on how good that MacBook Pro is. And the
HP ZBbook right over here.
All right. So, this is the HP ZBbook.
And this is the MacBook Pro from four
years ago.
The HP ZBook is the only laptop to be
faster than the MacBook Pro from four
years ago. How come no Dell laptop?
Well, Dell didn't sponsor the laptop
Olympics. Okay. Um, the MacBook Pro is
the only laptop is Yeah. So, this is the
only laptop that's faster. Like, again,
if you over there, if the losers over
there can't compete with a 4-year-old
laptop, never mind. I think the the the
right laptop probably has the same power
as my cell phone. And the left laptop
has the power of a potato. Literally,
I've seen potatoes with more computing
power than that laptop.
So, this leaves two potential winners.
It leaves the MacBook from a while ago
and the HP Stricks Hammer. They're a
similar price. This one, unfortunately,
does not come in uh 16 in. It only comes
in 14 in. So, you have to be okay with
14 in. Um, it also doesn't want to
charge with anything besides its
included power adapter, which like if
the MacBook had included power, like I
don't know why. Just find the included
MacBook power adapter. The included
MacBook power adapter is great, too.
like this is charging off an anchor,
right? It's charging off of whatever I
just happen to have. This thing doesn't
charge. So, yeah. I mean, you know,
you're left with the like, do you see
this logo? This logo is representative
of the experience you're going to have
with the HP, right? Also, can we talk
about the names of these laptops? This
is the MacBook Pro 16.
And then the processor is the M1 Max.
MacBook Pro 16 2001. This is the HP
ZBook.
They I think they throw the word Ultra
in there. It's the G1A, not to be
confused with the G1i.
And then it also has 14 for the size of
the the screen. Um, as far as screen
quality goes, it's there's some things
that Let's Let's bring up a web page.
Uh,
stunning graphic.
Graphic deep color.
Yeah.
God.
So like
that's not even a let me find like DCI
color test.
Yeah. Okay. This is a good one. Yeah.
Okay. So like
the it looks actually way better in
person than what you're seeing on the uh
let's do the same on the Mac.
widegamut.com. That's easy to remember.
It It looks better in person than it
does on Oh, Firefox does not support
this test. Okay. Well,
sure this Mac has Safari.
I don't want to make Safari my default
browser from 26 years ago.
Um,
widegamut.comestimage
HDR. The keyboard is pretty nice on
this, too. The framework does have a
good keyboard. This is the MacBook. I'm
telling you, the the HP looks better.
You probably can't see it on this webcam
because the webcam doesn't have dynamic
range.
But yeah, let's let's zoom in a little
here.
Yeah, the HP is by far the best looking
one. It may Yeah.
Yeah. If you can't see it on the webcam,
nine out of 10 people would choose the
HP over the MacBook. But they're both
excellent displays and you won't be
upset with either of them.
Uh oh, the Mac has a different aspect
ratio. This Mac also has a notch, I
believe. Um, are you running Windows?
No, I'm not running any Windows.
Uh, if you can get an M1 Pro for 550 on
eBay, like again, I it is what what's
not even being discussed here.
Let me put these two right next to each
other. Like the elephant not in the room
here. I don't know if that's elephants
or whatever. I don't know about
elephants, but like is that this laptop
is 4 years old
and then finally there's just barely
something. Yeah, you can see it there.
You can see it looks better. Like it's
the the clouds on the Mac here are
washed out. The the screen does not have
the dynamic range of this. But I mean
it's an all that, you know. You got you
got to give it credit. Um let's scroll
down and see another one.
Let's find a good one.
Oh, great.
Yeah. Again, no contest in person.
Yeah. Like I guess the webcam can't
capture dynamic range because like you
don't see over here that it actually has
pretty amazing dynamic range compared to
the MacBook where everything is like
Yeah. not like there's just not like
real HDR support on the MacBook. Uh I
don't know if it's gotten better on the
new ones, but yeah, this I mean the
screen looks way better.
HP also has 120. They're both 120. Uh
they probably have similar PPI.
Let's do these
side by side here. All right. Um it's 10
o'clock. I don't want to steal Kevin's
office. Uh
so yeah,
that was the laptop Olympics. Uh if
you're buying a laptop,
uh
you can't you still like there's still
nobody that can compete with the
MacBook. Um again, the other thing
that's not discussed here is I mean
those two over there. I'm not even going
to look at the idle power because like
the framework that that screen just
immediately rules it out from ever being
used as a real laptop. both the
flexiness of it and the fact that it has
tons of glare and the fact that it has
backlight bleed. I have not seen
backlight bleed on a laptop since high
school.
Like no, I mean it shouldn't it's not
actually high school. Like I think the
Macs used to have I remember like buying
a Mac in like I remember I bought Macs
in like 2014 and I would send them back
if they had backlight bleed. But like
there is no backlight bleed. Well,
that's an OLED so there can't even be
backlight bleed. But there is zero
backlight bleed on this MacBook, right?
Like that's that's that's a that's a
true edge at the bottom there. Um,
again,
you don't see that glare in real life,
but wow, the Apple
um the framework is actually it's fine
on color, it's fine on uh
resolution, but it's not fine on the
screen goes like just
[laughter]
the Mac wouldn't even think of bending.
The HP bends a tiny bit, but like not
really. Like you feel okay doing that.
You know, when I'm lying in bed, I use
my laptop. I put the laptop on the side,
you know? Like I put a laptop on its
side, use it like that. And like I would
not feel okay doing that with the
framework.
What about M4 Air? Guys, would you the
the HP from the current year does not
even beat the MacBook from four years
ago? Hands down. They're competitive.
These are competitive laptops.
Okay, that was the laptop Olympics.
Thank you all for watching. I think
we've crowned a winner here. It's the
unseen hero who was on the stream, my
dirty ass M3 Max. And this isn't even
the latest generation Apple. Come on,
guys. Come on. We need a competitive
laptop.
We need a laptop that's competitive. We
can't just let Apple keep winning.
I'm gonna I use the HP, but the battery
life's so bad. I never had to think
about charging my MacBook. I just like
charge it. What's the price? I paid like
2300 for this guy, I think. 64 gigs. I
mean, it has more RAM, too. This has How
much RAM?
Like show like my
I don't care. You guys can see my serial
number. What are you going to do with
it? That has 32 gigs of RAM. This has 64
gigs of RAM. I believe this has two
terabytes of storage and this has one.
So, you will get slightly better specs
with the HP.
What kind of keyboard? This like little
chicklet thing. I don't know. It's not
great. The framework one is kind of
better. I like Also, the back the
keyboard backlight on this draws two
watts.
Um,
yeah,
we didn't get to really test this with
uh,
yeah, like it it looks way better in
person. I'm I'm looking at the screen on
the webcam and the webcam just can't
capture the dynamic range that the
OLED's capable of displaying.
Um, okay everybody,
thank you for watching the laptop
Olympics. Uh if you are a laptop
manufacturer and you would like to
sponsor the next laptop Olympics, uh
send me a laptop and we'll make sure we
include it in the laptop Olympics in
2026 when somebody finally can maybe
beat the MacBook from 4 years ago.
[laughter] All right, thanks for
watching everyone.
okay
let's get back to where we were
did i not make a script to compile this
hello
thank you
thank you
yeah i'm in the gray shirt uh
no i got it i got a date tonight so
we did four loops it's done
we did that one
so there's a few things we could do
today
if you recall on the last stream
we uh
no i'm not i gotta get changed before
the date
i'm learning how to clean clothes too we
gotta i gotta do laundry soon
hello hello
here i am at camp granada that one
uh online
let's just say in new york there's many
women
which isn't true about now there's many
women everywhere
but they're easier
the ratios are better in new york city
uh no i'm not streaming my date for you
guys
does it really make me look zuckerbergy
damn new york city
no i didn't watch the any trust hearing
i don't care
uh i can't believe i watched five
minutes of the
impeachment shit the kavanaugh shit
it's it's just don't watch it
the only the only solution
to today's uh
attention-seeking world where everything
is infused with power
is to turn it off
um now i have some i have some excerpts
from this book that i'm going to read to
you guys but
we need i think we need quiet um
this book's called white noise by don
deleo and let's see if i can i can find
there were a few i should have
highlighted you know
all about the wonderfulness of
supermarkets
i should really highlight things there's
a few things in here that i would just
like
should we just do a reading stream
do a story
oh yeah yeah this this this whole thing
was pretty good
i asked him why is it alphonse that
decent well-meaning and responsible
people find themselves intrigued by
catastrophe when they see it on
television
i told them about the recent evening of
lava mud and raging water
the children and i had found so
entertaining
we wanted more more it's natural it's
normal you said with a reassuring nod it
happens to everybody
why because we're suffering from brain
fade
we need an occasional catastrophe to
break up the incessant bombardment of
information
it's obvious lasher said a slight man
with a taut face and slicked back hair
the flow is constant said alphonse words
pictures numbers facts graphics
statistics specs waves particles moats
only a catastrophe gets our attention we
want them we need them we depend on them
as long as they happen somewhere else
that's where california comes in
mudslides brush fires coastal erosion
earthquakes mass killings etc
we can relax and enjoy these disasters
because in our hearts
we feel that california deserves what it
gets californians invented the concept
of lifestyle
that alone warrants their doom
kozakus crushed a can of diet pepsi and
threw it at a garbage pail
japan is pretty good for disaster
footage alfons said india remains
largely untapped
they have tremendous potential with
their famines monsoons religious strife
train wrecks boat sinkings etc
but their disasters tend to go
unrecorded their lines in the newspaper
no film footage no satellite hookup
that's why california is so important
we not only enjoy seeing them punished
for their relaxed lifestyle and
progressive social ideas
but we know that we're not missing
anything the cameras are right there
they're standing by
nothing terrible escapes their scrutiny
you're saying
it's more or less universal to be
fascinated by tv disasters
for most places for most people there
are only two places in the world
where they live and their tv sets if a
thing happens on television we have
every right to find it fascinating
whatever it is
um i've i've really been enjoying this
book that's what i've been doing uh
this morning reading this book
i will do one more
everything is concealed in symbolism
hidden by veils of mystery and layers of
cultural material
but it is psychic data absolutely the
large doors slide open they close
unbidden
energy waves incident radiation all the
letters and numbers are here all the
colors of the spectrum
all the voices and the sounds all the
code words and ceremonial phases
phrases it's just a question of
deciphering rearranging and peeling off
the letters of unspeakability
not that we would want to not that there
is any useful purpose to be observed
this is not tibet even tibet is not to
bed anymore
studied her profile she put some yogurt
in the cart
tibetans try to see death for what it is
it is the end of an attachment to things
the simple truth is hard to fathom
but once we stop denying death we can
perceive calmly to die and then go on to
experience uterine rebirth or
the judeo-christian afterlife or
out-of-body experiences with a trip on a
ufo or whatever we wish to call it
we can do so with clear vision without
awe or terror
we don't have to cling to life
artificially or to death for that matter
we simply walk toward the sliding doors
waves and radiation
look at how well lighted everything is
the place is sealed off self-conscious
it is timeless
another reason why i think of tibet
dying is an art in tibet
a priest walks in sits down tells the
weeping relatives to get out and has the
room sealed
doors windows sealed he has serious
business to see to
chance numerology horoscopes
resuscitations
here we don't die we shop but the
difference is less market than you think
he was almost whispering now and i was
trying to get up closer without ramming
my car into the vets
i wanted to hear everything supermarkets
this large and clean and modern are a
revelation
to me i spent my life in small steamy
delicatessens with slanted display
cabinets full of trays that hold wet
loft sumpy
soft wet lumpy matter and pale colors
high enough cabinets so you had to stand
on tiptoes to give your order
shouts accents in cities no one notices
specific dying
dying is a quality of the air it is
everywhere in nowhere men shout as they
die to be noticed remembered for a
second or two
to die in an apartment instead of a
house can depress the soul i would
imagine for several lives to come
in a town there are houses plants and
bay windows people notice
dying better the dead have faces
automobiles
if you don't know a name you know a
street name a dog's name he drove an
orange mazda you know a couple useless
things about a person
that become major facts of
identification and cosmic placement when
he dies suddenly
after a short illness in his own bed
with comforter and matching pillows
on a raining wednesday afternoon
feverish a little congested in the
sinuses and chest
thinking about his dry cleaning
don delilah white voice
i haven't read the whole book yet but
so that's that's what we're doing today
we
i mean my phone black and white
i find a lot of uh old philosophy hard
to get into i mean some things are
accessible
nietzsche is somewhat accessible
kierkegaard wrote a few good short
stories i don't know if you count
kafka's philosophy but if you ask me to
read heidegger
and or heggle and learn about da sign
and fuck that shit man that's not even
anything
no if you can't understand it you have
two choices you can either say
you know it's because they're saying
something deep and mystical
um or you can say it's because this is
actually just you know
non-existent uh no i can't understand it
nickel is clearly a charlotte and i
agree and you have guys like
foucault who basically admitted they
were charlatans
[Music]
it's not even anything george hats
um i don't know
oh shit yeah i've
uh it's too contemporary
kind of um
hey george i coded my own two state two
symbol busy beaver to understand the
problem one nice job
um
i read the stranger back in the day i
found it hard
to get through though i think now i
could probably read kamu
sar no exit's one of my favorite stories
um
i don't think they're all fake no i
don't have a test prepared today i don't
really have much prepared today
i guess i more wanted to complain about
philosophy than code
um i did not watch the congress hearing
i am absolutely done
with anything these people have to say
it's all fake
it's all stage work you're watching a
shitty movie
every time you watch one of these
congressional hearings you're watching a
shitty
movie that has nothing to do with the
levers of power in this country
and have everything to do with
entertaining and placating you
should we just do philosophy well what
should we read
what lecon should be i i've heard of
this guy i dated this girl
listen to these people adorno
uh and they were
she opened my mind to a lot of stuff
now the myth of sisyphus
i don't know i'm not sure i really feel
like like
here's here's here's maybe this is just
talking stream
um it's a conversation
uh
i thought about it yesterday i thought
about yesterday's stream i i even
rewatched parts of yesterday's stream
uh smoking weed streams um
i don't know why do i want a blue check
mark on instagram why do i want to be a
twitch partner
it just seems like these are things that
other people
want so like getting them has
uh has value but
maybe not um i was reading uh
this girl's blog um
no what's her uh
like knowingless it's it's the cowgirl
blog
that i read off of before um
and i found some of these uh
posts to be really interesting
she speaks here about enlightenment
and she goes and asks people uh
instead of asking the question whether
people are enlightened or not
um she gets at what enlightenment means
she asks what does enlightenment mean
and
yeah she breaks it down and she talks
kind of about these four things
um material enlightenment
these people sound like a in an
inspirational talk given by a competent
ceo at a dinner party
skill enlightenment which is like
whether you can meditate and do brain
tricks
warp reality in your mind standard
enlightenment which is the usual
you know peace wordlessness no self and
understanding
uh traditional enlightenment it's just
it was an interesting
um breakdown
of what it means to be honest i
did some reflecting last night and i was
thinking really just what i want is
is worthwhile uh
worthwhile competitions to win
you know what what is is it really
worthwhile to
uh become a twitch streamer or an
instagram influencer
i mean you know what's the top it's the
top profession now
that kids want to be uh american kids
used to want to grow up to be astronauts
now they want to grow up to be uh to be
influencers
i was on this uh this date with this
other girl and i was like telling her
like
look these kids don't actually grow up
to be influencers nobody does
these jobs are dependent on fame
probably similar you know you want to be
logan paul that's as far as being an
astronaut
um
i think so uh i'm scared to google it
because
what else i was googling i was trying to
find some uh
i was reading it's like some like
rationalist blog where it linked to this
other blog and like that he was like
like
this is what the red pill people
actually believe and i searched for that
phrase on google and i got news articles
and i was upset
um
why are you driven by competition and
not intrinsically
uh you know we're just going to change
this to
to talking hour because i don't know i
feel like coding
i did a contract the beginning of this
week
yeah i made a good amount of money i
paid for
my apartment my lavish stay
in new york city
a 420 lmao here's your recognition
uh i didn't like the matrix two and
three i can really get through
um i don't know who dr k is i'm not
talking to destiny
i also took i took a big five uh yeah
i'll do it on stream they're kind of fun
um
[Music]
so i i did i did this this morning a big
five personality test
i'm the life of the party i'd say
somewhat
i feel little concern for others that's
probably true
i'm always prepared no i get stressed
out easily not really
i have a decently rich vocabulary i talk
a lot
i'm not that interested in people um
i don't really leave my belongings
around i'm relaxed most of the time
i understand abstract ideas pretty well
i feel comfortable around people
sometimes i insult people
yeah maybe
pay attention to details not really i
don't really worry about things
i have a vivid imagination i keep in the
background
um i don't know i did this test
uh the big five personality
um
yeah i found out i had very low
agreeableness
i had high openness medium
conscientiousness high extroversion
low agreeableness and low neuroticism
uh so i don't know i don't know what
that that says about me and then i
looked into like agreeableness
um then i looked into like
like dark triad behavior you know you
read about this stuff before i don't
know
i mean am i these people i don't know
i do score very low on agreeableness
um
think that i think that a lot of these
people are
am i going mad no
i i don't know i don't think zuckerberg
deserves all the hate he gets
um
what do you do if you're mark zuckerberg
specializes on the oh let's see what
does this word mean
influence of others instead of allowing
them to come to their own conclusion
yeah uh
i do lizard people things
how does he drink the water
um i've met real mark zuckerberg several
times
he's been coached a lot now
the water drinking test
it's cuz i'm wearing the gray shirt yeah
this is live
i refreshed it to get the viewer count i
don't know why it doesn't sync
i drove from the tab
um i have a really low standard of
living
we can go back we can go back to the we
can work on busy beaver
i mean it's kind of interesting but
really what i want to discover is like
busybeaver52 might be worthwhile
who made this fucking subreddit
it's better than a discord i'm telling
you if i ever see a discord
if anyone makes a discord and starts
talking in it and i find out about it
we're going to uh we're going to stop
streaming that's the end of it
then it got too big
the subreddit's somewhat okay
um we're not gonna we're not gonna
scream about the subreddit
yo if i find out about a discord
seriously one asshole's gonna ruin it
no i don't have a discord if there's a
discord
yeah no just i mean you know what like
like yeah there might be there might be
uh
for you know really if this if this
becomes a big thing it's it's over
there are zero discourse that's what i
like to hear uh
i'm fairly anti-discord yeah
oh there's a discord
with 70 people in it um i'm serious
uh
all right shut it down
uh if you don't i really i just won't
stream anymore
um you better delete it
if i find it that's it that's it that's
the end of the streams
um no slacks no discord
nothing real time the stream exists when
it's here it doesn't exist when it's not
here
i give you a lot of power yeah i mean
you guys are welcome look if
like i don't know i don't really know um
now people are gonna start making
discords but we'll see you know that's
it that's the end of it
uh that'd be like oh cool yep he was a
streamer for a bit but
now he's not a now he's not a stream
anymore
do i exist if i stop the stream not to
you
how do you know i'm not already a uh
a gpg3 what if some of these streams are
in me
you know what if some of these streams
are just i trained uh
i trained an ai on the thousands of
hours of content and it's like deep
fakes
you did you would have a better haircut
now it's so easy for one person to ruin
it i mean that's how it is
you know you guys can self police though
you guys can self police
and i believe i believe in you
uh you can have merch but you have to
make it yourself
anybody who's selling merch get fucked
um
i would just quit if this if this like
became like a bigger thing i would quit
uh like it comes down fundamentally to
whether i think i get value from it or
not it's it's an interesting way to
self-reflect
um i can talk with you
and then in effect almost running the
filter that i run on myself
when i'm streaming allows me to
uh access
parts of my mind that i wouldn't it also
when i use it to code
um it's it's kind of easier to decode in
front of a in front of an audience it's
a different state of mind
uh and it's an interesting it's a way to
access it
therapy hour yeah this is therapy i was
thinking about that this morning
i was thinking about you know people can
come to my apartment and
i'll talk with them about their problems
for an hour
uh but then i realized that i don't have
a license
and it's probably illegal i don't really
know why it's illegal
and then i didn't really look more into
it because i realized that you know
what am i going to say to these people i
don't really know
you know what if what if what if one of
them takes my advice and kills
themselves
i just don't know if i could deal with
that so so it's not worth it
um talk to dr k no i've been through a
lot of therapy in my life
uh
coaching yeah yeah coach got a good
point yeah if i dress it up in some
euphemistic terms it's all legal
um
yeah maybe i mean i wouldn't do it you
know for everything i do
under my name there's a whole set of
things that i don't do under my name
and like this would be one of those
projects
um it definitely wouldn't be no because
we'd get fucking fanboys man
like fanboys are real like like people
go people go stupid in the mind when
they get into fanboy mode
you know oh we can talk about deep shit
on the stream
yeah i think it mostly is listening
no if geo streams stop i mean you know
guys and like
i i had i had a big twitter file i had
150k followers on twitter and like
you know people pissed me off so i
deleted it to be honest
uh and i'll do the same
uh no it's never worth cashing out what
do you think you're getting
century of self
i mean that's that's an interesting
quote this series is about how those in
power have used freud's theories to try
to control the dangerous crowd in the
major mass democracy
um you know what was what was that thing
that i went to it was like uh
safety.google or something yeah
um remember we looked at this yesterday
on the stream
and like i i just
i don't understand the person who reads
this
and like not only
i look at this and i can't tell you
whether this is true
or not all i can say about it
is that it was written by a pr person
google hired somebody and
they don't know anything about how
google was founded anything more than
you might find by reading wikipedia
um and their job of course is to write
nice sounding copy for this website
uh so this isn't true or
false it's it's it's gpt three level
shit
um i think i forget which maybe it was
on hacker news where people were talking
about
what if you seriously you always want to
talk about gpg3 here you go
what if you seriously scale up gpg3
how many jobs can it replace i think i
think there was a thing where someone
tried to use like gpk3 as a design
brand consultant and like it did pretty
well
um
no of course i get trash
honestly half the time i use google to
try to find things that i've already
visited
i could be better about this uh
design brand consultant it was like a
fake chair company
no it's not see
never mind i i can't find it but
um i i don't know
you think they're gonna give me the beta
key
you think let's let's let's let's go to
the gp3 beta
let's let's you want to try to apply
let's try to apply
join the waitlist i'm interested in
being a beta user of the api
name my name is george my email is
geohotogmail.com
um your use case please
provide a
brief description of the way that you or
your organization might want to use the
api
where applicable please include any
initial thoughts you have around
any potential benefits or risks from
your use case or other information that
you'd like us to know
um i think it was nips
paper uh
society impact their
um
you know these these
these people this is this is no sorry
nips has been renamed to nurips
um these people are demanding that
your your ai paper have a section about
broader impact
this work has the following potential
positive impact in the society
at the same time the work may have some
negative consequences because
furthermore we should be cautious of the
result of failure of the system which
could cause
um
i i i
who who pushes this stuff
you know
um jordan peterson
i don't wanna you know i wanna be jordan
peterson jordan peterson on sick leave
you know i can look into that more i
don't think he's on sick leave
uh you don't wanna be famous man you
really don't
um you know you think you do and you
think you want to get your ideas out
there but your ideas are just going to
be
yeah i like i like this quote i like
this quote from century of the self
um this is about how those in power have
used for its theories to try to control
the dangerous crowd it's the same
it's it's the same with with with jordan
peterson or with anything that becomes
popular it's not going to um
it's it's not going to be interpreted
the way uh the person wanted to be
interpreted and then
you think about things that cannot be
interpreted wrong and i think this is
one of the beauties of crypto
bitcoin as speech you can't misinterpret
bitcoin it is exactly what it is it's
the greatest threat to state
power um that has come around in the in
the in this century
is it possible to discern between crappy
writing and gpd3 writing no
oh oh we're going to build detection
models
yeah um i mean you can do that for
imagenet right
you could build you could build a
detection model for imagenet and you
could detect uh
whether or not
the imagenet classification results are
being done by a human or being done by
a machine
to read the unibomber manifesto on
stream see today it's political
it was never really intended to be
political i mean in in
in a way like
they would reference it a lot on consume
product and then
in a way you you realize that consumed
product is
does irony make it okay
i think i used to think that i think i
used to think that
having these views ironically
was okay i don't really think that
anymore
i think whether you're doing it
ironically or not the intent doesn't
really matter
and the right thing to do is just not
have the views at all
oh whoops i actually didn't mean to deny
that um
i i i meant to accept that and yeah to
say
look you know i got an email this
morning uh from a hedge fund that wants
to buy common ai
so you know you never you never turn
rich people down you always just say how
much and of course they're not giving
you a real answer they're going to ask
for a phone call and that's going to be
the end of that conversation
um but shit man you know if they said 2
billion you know that's my number voice
um and then we'll start you know
uh david foster wallace on irony
maybe not
yeah so so like like new sincerity uh
the this word popped into my mind i was
into david foster walls for a bit
um i read some pale king excerpts on my
instagram
uh infinite jest is one of my favorite
books
um
ah let's read this essay together that
sounds somewhat nice
is it short
that's not social watching
i will read this i don't want to i'll
read this on my own time
yeah post-post-modernism
the next real literary rebels in this
country might well emerge as some
weird bunch of anti-rebels born oglers
who dare somehow to back away from my
ironic watching who have the childish
goal actually to endorse
and instantiate single entendre
principles
who treat of plain old untrendy human
troubles and emotions in u.s life with
reverence and conviction
who issues self-consciousness and hip
fatigue these anti-rebels will be
outdated of course before they even
started dead on the page too sincere
clearly repressed
backward quaint naive anachronistic
maybe that'll be the point
maybe that'll be why they're the next
real rebels real rebels as far as i can
see risk disapproval
the old postmodern insurgents risked the
grasp and squeal
shock disgust outrage censorship
accusations of socialism anarchism
nihilism
today's risks are different the new
rebels might be artists willing to risk
the yawn the rolled eyes the cool smile
the nudge ribs
the parody of gifted ironists the
ohabanal
to risk accusations of sentimentality
melodrama of over credulity
of softness of willingness to be
suckered into a world of lurkers and
stairs who fear gaze and ridicule
above imprisonment without law who knows
yeah i i mean i completely agree i i
think that
the question is where do they succeed
right
where where do these these these people
succeed
not in industries that are controlled by
social media
um social media
uh
here's here's something i was thinking
about this morning actually started i
was
listening to some beats and i was
working on some diss tracks
and i was like who do i dislike and i
realized a group of people that i
dislike are internet commenters
no internet commenters are not the
majority of people
i have really never commented on
anything on the internet
i don't have a reddit account um my
facebook account was
was largely full of uh banal bullshit
um i i do these videos but these videos
are
and the one requirement that i make for
these videos and i will issue takedowns
to anybody who tries to do otherwise
is that the videos be presented in full
with context
um because if you're willing to watch a
multi-hour video
you won't take me out of context
you won't take a
one sentence snippet and and take that
snippet and figure out how that works
into whatever your ideological world
view is
you'll have to if you want
access to this content well you know
watch the video
um
[Music]
social media has consequences have been
a disaster for the human race
well this
uh black mirror is probably the
appropriate answer to that
social media is not you can say social
media is the problem
um you can say
one group one political group is the
problem
uh you can say that if only everybody
thought this way
well yeah but what you're really getting
at is inability to solve
like coordination problems if
it makes sense for everybody to defect
there is no more power in the world
i think that the the poor believe that
they have no options in life and you'll
hear this is a common
kind of is the word respite is that the
word i intend to use
yeah yeah a common respite of the
respite of the poor is that
oh well you know circumstances
circumstances and circumstances
um and if if someone who's rich or
powerful tried to say that
uh they wouldn't be accepted as sincere
but in reality it's unclear that they
have more freedom of action than the
poor person
in some ways they may have less
uh something that i did realize early on
with with kind of
comma uh and and my life in general
is if you're a celebrity who's known for
doing
one thing you don't have
power you actually because well you may
have power you may have
influence but if you have no freedom to
go with that power and influence you
have nothing
and that's i think a lot of people
who've gotten to quote-unquote high up
positions
they're there on very tight leashes and
these leashes are being held by all the
other people in these positions
um it's true the more successful the
less free
uh i mean i value freedom above
success by far so i'm gonna try to beat
that
like to answer the question more
concretely about why
if this stream ever became popular we'd
have to shut it down it's for that
reason
how free am i i mean starting combo was
one of the biggest things i did which
limits my freedom
but it doesn't really limit my freedom
it's a prison that i've made for myself
of course when you want to start
something
will we win self-driving cars
i did this i did this ethereum contract
um
over the last three days and it feels
nice it feels nice it feels nice to
to step in on problems that people have
been working on for a long time and
solve them relatively quickly
but yeah i mean you know when my
competition is is is
uh you know a classic like startup it's
not that
hard uh to to to do really well
and to this self-driving car is maybe
um here uh so
curtis paul graham response
uh if you read the paul graham uh
gray mirror hologram um
here open letter to paul graham uh
if you read the the the paul graham
essay and then i also read
it was like another thing posted on
hacker news
which was uh against this
this is i mean this is against this from
a different angle and then
there was another one that was against
this too if you haven't read the essay i
mean it went around the internet it was
pretty popular
but i think there was one the one line
that i want to quote
um paul graham says but i'm hopeful long
term and uh curtis replies with i'm not
the only thing we have to fear is hope
itself for of all the impediments to
success false hope is by far the
deadliest
false hope trains you on a low bar you
see that bar and think
that's not too bad i can work out more
stop eating carbs i can clear it
you do the work you practice you clear
the bar every time then in the real
event you see
the real bar higher than you can ever
imagine and you just walk back to the
locker room
um the thing that
i immediately associate with this isn't
he speaks more about the political
situation i don't even associate it with
that i associate this with the rise of
ai
um the singularity happened five years
ago
the computers run society the twitter
algorithm runs society just because the
computers leech
off of human intelligences in order to
do it maybe the singularity happened
once megacorps existed
when when humans are no longer the
dominant species on the planet
um in the real event
in the real rise of uh
ai maybe the real bar is higher than you
could ever imagine
you know
it's interesting it's looking more and
more like darwin's goals as a writer are
convince you that everything is getting
worse
it's impossible to stop it so give up
hope once you've given up hope then he's
going to hit you with the solution which
is
give up hope strange religionness anyway
this essay is just a trifle but he's
effective in making me give up hope yet
when i step back and ask
why this essay makes me feel hopeless it
has to do with the organs claim that
universities have been a lost cause
since 1900 or so
um yeah the
the the mythical notion that society is
always getting worse no i don't know if
i agree with i don't know if i agree
with it i
don't agree with um i don't agree with
curtis's point about paul graham's essay
i agree more with paul graham's point
after all i do want to start a college
um
uh
though i've spent a lot of time thinking
about the situation i cannot predict how
it plays out
could some universities reserve reverse
the current trend and remain places
where the independent-minded want to
congregate
or will the independent-minded gradually
abandon them i worry a lot about what we
might lose if that happened
uh curtis's response is that the
universities are a state church
and harvard yale princeton all march and
complete lockstep and all social and
political issues
uh this seems to be largely true um the
university system as a whole is lost
but the nice thing about that is
it comes in lockstep with the
university's
uh decline in actual power
um back in the day you had to take a
long time it took a long time to build
up harvard's reputation it is relatively
easy to destroy it
um i mean i agree with this uh but i'm
hopeful long-term the independent-minded
are good at protecting themselves
if existing institutions are compromised
they'll create new ones that may require
some imagination but imagination is
after all their specialty
so in a way
when i think about comma i wonder
it's a bet
on the future not looking
how the present looks and i think that
every real 100x startup has to be like
that
it's a bet basically saying that
you know what i'll make this a little
smaller so you guys can see the chat um
you guys can see so basically right now
uh laughing in the face of the ford ceo
is actually an okay
strategy um
believing that the future tactics of
business will not look anything like the
current tactics of business
uh
you know once you stop once you start
recognizing
the the seo spam all over google you
realize that it's all over business
inboxes too
11 months congratulations snorting milk
i don't agree with you the point society
is getting worse
i don't think society is getting worse
um
i don't think society is getting worse
at all i hope that's not
um your take away from my streams
uh or actually the better one is percent
of the world
global poverty by percent of the world
um
so you know if you go back 200 years i'm
almost everybody is is living in extreme
poverty
uh whereas you fast forward today and
then here with the modernization of
china and india
um
well i don't think the world's getting
worse
i think that
if current trends continue
if current trends
go towards if we go towards the
singularity
with the current culture plex
uh we've created a terrible nightmare
for ourselves
no extreme poverty is not defined as the
worst off population it's not constant
at all
i believe extreme poverty has to do with
food insecurity
um do you have do you have the needs of
human life
uh food shelter water um
the graph is a bubble yeah population's
gonna crash bro
um yeah i mean when you look relatively
it says percent
culture is getting worse society is fine
i'm not sure about that so
a hypothesis against this book um
this book is uh
was published in 1985
um 1985
and so it's been um
uh you know it's been 35 years since
that book's been published
uh what what is being written today that
will still have relevance in 35 years
don't read anything that is is current
who's spangler who do you think who do
you think our current
rulers are
i've heard about this book
um
yeah i i don't i don't know how much i
don't know how much i buy into these
sort of theories
uh about
like decline of of of
western civilization what do you think
western civilization
is you know there's a lot of people
people talk about this this is uh
um
do you mean the enlightenment ideal of
science
uh like the enlightenment ideal
definitely will live on because it's
what wins wars
can you imagine a 15th century
army facing a modern army today
and we didn't build guns by having
better politics
they had the same politics all the
political systems
uh had largely been invented
in some way shape or form way back in
the day all right sure they
got like you know but but
we we we grew in power because of
science so i don't know what you mean
by um the decline of the west
there's an obscure correlation between
standard of living and depression
yeah yeah whatever
uh i was sitting in the uh
sitting in the barber shop i got my hair
cut and i was thinking about ubi
um wait
why is my stream lagging it's behind
way behind uh
i was thinking about uh
ubi and like if you really believe kind
of in a in a veil
but what are the two books like a theory
of justice
and like uh whatever what's nozak's book
liberty look i read these both back in
the day i just i
can never remember the name of this one
oh anarchy state utopia yeah
um
predicting the end time seems like a
popular thing to do
no i i yeah i'm certainly not predicting
the end times
um i'm saying that i think there's a
great opportunity today to create
replacements to colleges
but in some way well how would i fund it
i mean i would fund it with with common
ai money
um
but then you say well if comet ai fails
how will you fund the college
well i mean if kane high fails the world
doesn't want the college it's the same
idea
it's the same
will the
[Music]
think of let's look up the ceo of ford
right i mean not not
not to judge
you know just by looking at a picture
but you can say a bunch of things about
him looking at a picture
um
one he's relatively old two he's wearing
a suit
and three you know look at his like
bokeh effect on the picture
right like why why are you doing that
you you it i mean it says something
about you right like i wouldn't you know
i wouldn't have a picture like that
i wouldn't have i wouldn't have a it
just in a way like like
through that picture you're showing your
distance
from anything that is real right again
remember the picture of the samsung ceo
holding up the cell phone
um you could say he's a white cis male
too and there there's some
i don't know i'm not big on i'm not big
on the identity stuff
uh you know does he identify as a white
system i don't know i i think that
that's kind of a meaningless
i think that like to judge people based
on their their race or their sex or
is is just racist and sexist just it's
not
um you know it's just that in a
different form but you can certainly
judge
uh several things about him from the way
that he presents that picture the
clothes that he choose to wear in the
boca effect
right but here let's let's take a look
all right
jim hackett is president and chief
executive officer ford motor company
he's also a member of the company's
board of directors
our directors under hackett's leadership
together with bill ford
ford is committed to becoming the
world's most
trusted company
designing increasingly intelligent
vehicles that are connected to the
increasingly intelligent world
around us all to make life better for
our everyday
customers our community and our climate
the fuck does any of that mean
right i'm i'm expecting
the world that i'm expecting over the
next 10 years
about an end to this kind of stuff and
thank god for elon musk elon would never
write something like that
right let's see ceo tesla let's see if
we can actually find one on tesla.com
i'm
going to get a big list of okay here we
go
um elon musk's co-founder elites tesla
spacex neurolink the boring company
uh as co-founder and c ceo of tesla elon
leads all product design engineering and
global manufacturing of the company's
electric vehicles battery products and
solar energy products okay
um since the company's inception
in 2003 tesla's mission has been to
accelerate the world's transition to
sustainable energy
now you can say that this is very
different for
make life better for our climate
the fuck does make life better for our
climate mean
that's actually a phrase that's in here
right i'm not reading that wrong
all to make life better for our everyday
customers
our communities and our climate
like it's it's a joke it's it's almost
like
this guy knows that these people have
seen a lot of uh stock gain
so they try to like take their words and
and and and like mush them into
something
it's it's it's oh captain i need you to
activate the deflector to invert the
polar on pulse
right it's it's uh
the first test look alright so this is
just this is just like a history of
tesla
right um
but yeah i mean and then also like you
know tesla's mission has been to
accelerate and
i've seen elon talk about it and maybe
maybe the ford ceo says all this stuff
very coherently but
and i'm open to be proven wrong on this
but i doubt it right elon makes it very
clear that like you know in order to
lead the world transition and accelerate
the world transition to sustainable
energy
we have to build sexy electric cars that
can command high margin as a classic you
know classic
good business practices
um it's an ai writing not the ceo
i mean yeah so it's not
right you can say that this is actually
written by an ai but
are you saying the ceo doesn't have the
power to write something else
is is he an empty figurehead
um
yeah i think i looked at this on a
previous stream
uh wow that really ripped off uh
was it outliers
i'm not clicking a clean technical
article
uh
what would you write in my ceo page well
if anyone ever wrote something lame and
shitty
um i don't know what's on my instagram
ex iphone hacker sued by sony comma ai
president
it's my one true dream again
should i stop with the irony right like
i i guess i i i i think i believe that
my audience has the sophistication
to understand that when i say one true
dream it's like not meant to be taken
seriously
it's my one true dream to have one
million followers right and it's like
one and one i think it's like cute
um follow and be a part of hockey stick
growth right and then like you know
that's like
uh check the cover thinking fast and so
i was thinking about thinking fast and
slow you're right you're right
um
why does george present himself with it
yeah it's look is it is it my highest
quality shit i don't know man
take off the ironing no i mean it's it's
like i think it's appropriate for the
platform right
like how do you wha what is what is on
my linkedin i talk about how i use it as
a dating app and i think like that's
appropriate for that platform
all right all right all right we'll read
we'll read the clean techno art
let's let's check the biases of clean
technica
um
i write an article full of anger as a
german about the german auto industry
the octopus is one of the most
fascinating and intelligent animals in
our seas
scientists predict that if they didn't
die that early after the new generation
is born because of their ability to
learn
they would be just like the humans of
the sea dominating all other sea animals
largest
citation needed
and octopus has eight arms hence
starting with the name octo and each arm
has its own little brain managing that
on
eight brains that communicate with a
central brain
honestly this all sounds like it needs
to be refactored man refactor the
octopus
yo if we could get could we get like a
group of people
um 7 p.m uh
outside trump tower to
get some signs that say refactor the
octopus
you know what i mean like would people
would people go to that i'm not talking
about that one but just in general like
i think
i think that would just be like uh you
know think about it you'd get all these
like confused people refactor the
octopus wow they're really passionate
about it you know
um
uh i could hire people for this yeah
i'll put it on
i'll put it on craigslist ten dollars
come protest come protest the octopus
having an overly complicated
architecture
um yo
uh and free yo i actually protested for
shkreli man i protested outside the
twitter building this is like before he
went to jail and shit
to try to get him unbanned i thought it
was unfair
um he made a homage to lauren duka uh
you know plenty of kids make homages to
justin bieber and that's fine but when
he makes a collage of his love for
lauren duke it's not okay i was confused
um
free scrolling man
uh the incumbent auto industry is trying
to develop a competitive
fully electric vehicle uh
the arms are in the way yeah yeah yeah
more managers will lose their
responsibility because it's obvious that
they do not know what they do and talk
about see
i mean this is this is what i'm banking
on right if if this
is the way the world trends and most of
the things that i've said if you guys
watch the early comma ai periscopes have
largely come true
about the way this industry is going
spoiler alert
self-driving cars like level 5 are still
at least five years away at least
and that's all i'm confident to say
um
managers who in their entire life have
never written one single line of code
nor understand it all decide on vehicle
software that determines the largest
share of their profits
people who do not even know what basic
current software languages nor what it
means for success or what good code is
bad code is
good code or bad code is are deciding
the big issues they will not even
understand the problem as a software
engineer tries to explain it to them
they don't understand the challenge with
that they are far away from solving it
uh yeah this is this is right this is
again
in a way
who did they bring in to replace herbert
dice
oh he was named one of the best ceos in
the world by ceo world magazine
wasn't that the year of the volkswagen
scandal
oh yeah 2018
best ceo in the world 2019 jail
um wait
oh let's see let's see who these new guy
is
let's let's look look we can tell right
away from the picture
yeah remember what i made fun of harvard
for
the harvard ceo for it's a big picture
of a guy
in a sport coat next to a large logo of
the brand
this very clearly tells you that
volkswagen's not a car company it's a
brand
company he's not standing next to a car
here we
finally get one where there are cars in
boca
in the background right
oh yes pose with the car yes pose with
the car see
it's the brand but it's also the oh
oh i was time magazine's person of the
year in 2006 as well that's pretty cool
thank you for subscribing andy davies
um a door
yes yes we i have car please bring the
car
in here do i have to touch it with
gloves
you know really when these guys stop
wearing fucking suits i'll take them
more seriously who wears a suit anymore
could they could be real about that like
who wears a suit
like i can imagine the corny 80s movie
playing right before the like sexual
harassment goes on in the fake boardroom
scene
you know
that's why amd is so good i mean you
know
even i feel i feel a little bad for
ripping on nvidia
uh in the in the third row tesla
um but look like
at least nvidia is still run by the
founder
i think that he got a little over
excited by the money
um which like you know you can't really
blame people for that
uh you know that's when i sold my own
video and i should have huddled long
term right
um
but you know
they're they're i guess you know what i
guess i'm
they're talking to bad business advice
here if you have a five year monopoly on
ai tech exploit it
right if you have if you have a monopoly
exploit it
oh yeah yeah yeah the reckoning's coming
i've heard
the sad thing is intel's been fucked for
so long
and only now actually i guess the stop
knock going up is
pretty reflective of it
um
yeah let's see who's the intel ceo
bob swann same fucking sports coat and
bokeh bullshit
look i have people behind me
holy shit look at who's holding up a
chip
this is the picture you get of lisa sue
you see what i mean
of course they're gonna win she is so
much better just look at that
she's not wearing an ugly ass sport coat
like like she looks like she does stuff
you can just tell you just look look
look who does stuff
oh yeah this guy oh we're back to this
fucking guy
oh yeah yeah stand next to the brand
make sure the brand is in full
make sure the brand is in full is in
full uh full view
we gotta make sure they can see the
brand it's a little bokeh
i like the bokeh because i want to
emphasize that i'm the most
important thing in this shot but we also
got to let him see the brand
god no but like like do you see the
brand there
no this i mean this might make me sad if
i do lisa sue and do an image search in
order to have a fair comparison or to
really amd ceo
and do an image search
yeah better better
it's pictures with chips
chips like that's not it's like uh you
know
notice how notice how that picture like
the brand is not
neatly like put somewhere it's like a
real picture
if you google lisa sue there are more
chips
chips let's see let's see rob swann
no i got it wrong bob swan i don't know
i don't remember
all right we're done we're done ripping
on ceos um i shouldn't rip on them for
what they look like it really is kind of
a low blow
but i do want to rip on them for exactly
what's in that clean technical article
um yeah yeah the the mba offication of
the world
needs to stop these these people
are useless
like they're they're they're just
they're just exploitive psychopaths
um well i'm not coming i see you come
here doesn't have a ceo
just be honest i hate corporate culture
is it
culture yeah maybe
you got a neural link bro yeah you sign
me up bro where am i gonna when do i get
a neurolink
his job is to talk welcome to talking
hour
and you guys are gonna subscribe and pay
me yeah i get paid to talk i'm an
influencer
um
sorry about your mba bro coulda learned
real skills
how do i get unblocked from github
you're now blocked from here
congratulations
um we're we we we pull the disrespect we
just ban people sometime you know
um you can actually make crazy shit ton
of money just by talking on twitch
uh what products i use every day
this is my american passport i use it
every day
to remind myself that i have freedom
yeah i have freedom do they still have
like the constitution written in this
thing
important information regarding your
passport
we the people of the united states in
order to form a more perfect union
establish justice ensure domestic
tranquility
provide for the common defense promote
the general welfare and secure the
blessings of liberty to ourselves and
our posterity
to ordain and establish this
constitution for the united states of
america um
oh my mexico stamp mexico put the stamp
all the way in the back you know
like here my like main stamps and then
like all the way in the back is my
mexico stamp
czech's passport says don't be evil
uh
yeah i'm not i'm not a politics guy and
nationalism global i don't know anything
about that
oh incognito jam thank you for gifting
subs to people
we appreciate you
um
don't be evil is such a weird thing just
a weird thing why would they do that i
trust people who say don't be evil
uh how many countries have you visited
let's do it you want to shoot like is
there like how many countries have you
visited quiz
there's got to be like a quiz oh it's a
buzzfeed
oh let's see i've been to the u.s i've
been to mexico i've been to canada
down in south america i know i've never
been to brazil but i have been to
uruguay
argentina and chile
i've never been anywhere in africa
but i've been to spain portugal
france the united kingdom ireland
iceland never made it over to norway but
i did go to sweden didn't go to freedom
didn't go to denmark i did go belgium's
over there i've been there
germany been to italy
switzerland oh man this
zooming is oh i gotta zoom with this
all right let's see um i did these
countries once
was serbia always good old serbia
there's serbia
did not go to croatia but i did go to
hungary and i went to austria and i've
been to chechia
never been to slovakia i've been to
chechiya when it was still the czech
republic so i don't know if that counts
never been to the middle east or
uh africa but i have been
to australia i've been to japan
i've been to indonesia been to malaysia
been to thailand didn't make it to
cambodia
uh yes vietnam no philippines
yes taiwan of course china wow
wow oh there's hong kong
oh that i thought they were trying some
shit
um i've been to all the u.s states i've
been to everyone
i've been to russia
that might be it oh i've been to
mongolia i took the train up to mongolia
uh and i've been to nam haven't been to
laos
or cambodia or there or there i haven't
been to india
i haven't been to bangladesh i've been
anywhere in the middle east or to a
single stand i know i'm missing out
that's probably it
how many countries have i visited
does it not tell me
what the one thing i wanted to know
i've been to singapore yeah i guess like
yeah that's tiny down there
oh there it is singapore zooming in oh
my god really
35 countries not bad
uh probably russia and south korea for
ctfs
wow i feel like i'm like missing out on
a lot of countries
35's not so many
wow so many places i've been to panama
too
36.
oh i mean i stopped by the bahamas on a
cruise ship does that count
i think that counts 37
[Music]
and i've been to all the states nothing
too exciting
why do i avoid africa in the middle east
um
i don't know
i mean like my sister went to israel and
she's like the border was scary
uh it's like there's no there's no
real reason uh i think i am if it's
still gonna happen i'm gonna speak in
dubai
um the end of this year
i can get in i'll go there and then i've
been to the middle east
i don't know where is it going after i
just think i'd go to go to like morocco
definitely
i almost went to morocco on a trip
um i was in the bottles for a day
no i got to do so my next trip my next
trip that i'm thinking about is
these countries like i'm interested in
uh
all the plus soviet countries uh i'm
trying to find
where is there something new you know
i look like a jewish
uh africa is deadly i don't think that's
true
um i mean there's some places in africa
that are deadly but like you know so is
saint louis
uh
[Music]
yeah honduras has a really high murder
rate
uh no i'm not i'm not afraid of most
countries in africa it's not because i'm
afraid
um just kind of because like
have i been to liechtenstein no i
haven't been to liechtenstein
is that lichtenstein right there oh
luxembourg
i've never been to luxembourg either is
that liechtenstein oh my god
lichtenstein's small
i did not make it elected stein
um
where's bratty's lava
because i've definitely been to
bratislava because they oh i've been to
slovakia then
uh oh cool yeah i've been to slovakia
uh because i know i went to bratislava
because i i did
i did a train trip um up from uh
was at this conference in serbia i did a
train trip
up through here rented a car
yeah belgrade 20 20 uh
12. it's actually while i was still out
on bail
for my marijuana arrest
did i like latin america uh yeah yeah
they wouldn't let me to brazil i'd have
a visa
um switzerland i remember everything
being expensive and i wanted to draft
beer and i couldn't get one
it's hot in here boys
no i didn't go to jail it was overhyped
bullshit i was wrongfully arrested and
it's since been
dropped and expunged from my record
because i was wrongfully arrested that's
right
um wrongfully i should sue for my
wrongful arrest
uh
tell you my right that's my only time i
was ever arrested i was arrested for
marijuana in texas
nah i've never been to monaco where is
monica oh monaco is like south of france
kind of
i met some people from monaco and i was
hanging out in malaysia
oh and dora look at these little
countries
look at these tiny little countries
hmm
so i've wanted to go around the world
um by land
uh you got to kind of go through russia
i i i met this girl
in china who had done it and she went
this way
uh she was a canadian so i was like how
do you get through iran she's like i'm a
canadian they let me through
um
[Music]
i don't know how you pronounce it
um
would i go to iran i don't know if
they'd let me in
i don't know how they feel about
americans i'm cool with iran and you
know i
got i got no beef um am i even like
no they're not gonna question me at the
border and they're gonna be like why'd
you go to iran did you spend money
supporting iran
uh yeah
around the world stream what is
transinistra
whoa
this looks like definitely a war zone
frozen conflict zone
wait is this like the donuts republic
i'm sorry if i'm saying anything
offensive i honestly like i don't know
i'm not trying to be offensive
i never try to be offensive guys but
sometimes you just are offensive you see
i'm trying to be offensive but i don't
try to be inoffensive i just
say what i believe is true and if i'm
wrong
i'm happy to uh apologize for being
wrong if i'm actually wrong
if you're trying to use that i'm wrong
like a political bludgeoning tool well
you can get fucked and then i'll never
apologize
um ghana is a real nice place
where's ghana is gone a real nice place
oh west africa
no where would i actually go in africa i
definitely go to morocco
uh i go to egypt what country
is the uh mount kilimanjaro in
no i being wrong is bad you know you can
apologize for being wrong you shouldn't
be wrong
like if you're especially if you're
telling other people wrong things
like i think it's like kind of morally
not okay
i'm like if you believe wrong things and
you keep them to yourself that's fine
but if you're spreading wrong facts i
think it's morally wrong
being wrong is bad yeah
yeah misinfo's garbage right and it's
not like yeah
like like if you're if you're spreading
fake news you're bad person
conspiracy theorists are triggered right
now now some of those conspiracy
theorists
i think are on a level like
you know um look take something like
pizzagate right
like
you know it's kind of funny
in like a meta sense right like you know
you can't you can't uh
you know a lot of conspiracy theories
are pretty funny man
uh so like i'm not gonna i'm not gonna
say that's like spreading misinformation
because that doesn't purport to be
information
um it purports to be
fiction and if you can't tell that it's
fiction
well you know that's kind of on you
right um
to be fair you can almost say the same
thing about the news right
you can say the same thing about a lot
of the
i wish they would just acknowledge in
some way shape or form that they are
fictional
yeah no i mean obviously look no one's
fine with the guy who showed up with the
with the rifle right
but like that doesn't mean you know what
i mean like somebody killed john lennon
because they thought the songs were
speaking to him right that doesn't make
the songs not okay
um all right
they killed oh they oh no did not catch
her when the rye was speaking to him
right that was the guy
um watching your brand i'm not telling
you to watch your brand
how do you distinguish truth from
fiction science
uh never mind i regret using pizzagate
as an example
you fucks are too political i have to
brush up on my
on my you know 19th century conspiracy
theories that nobody actually has an
opinion on
to use as an example you can't use
modern examples it's a good it's a good
thing from less wrong
go to nagaland if you want what is naga
land
i'm learning so much
this place looks beautiful
i thought malay i thought mongolia was
going to be like beautiful jungle and it
was actually a frozen desert
that had power 23 out of the 24 hours of
the day
yeah part of the problem with can you
even make meta-political points or
metapolitical points just attract
idiots you know an interesting thing
about a topic
you know what we'll say about
programming languages because nobody's
offended by programming languages
right have you ever noticed
how like the ruby community is full of
idiots
while the haskell community is full of
people who can like write really well
is anyone offended by that oh java oh
java's the fucking worst
go to like a stack overflow about java
and like
i mean it's true clearly some
programming communities have like a
higher brow
that just this is like like like yeah
java is a good one to rip on man
[Laughter]
whatever
you know what okay all right all right
all right all right
let's let's let's um let's see um
rust uh let's ask like like
uh binary search stack overflow let's
not talk out of my ass let's use science
how would i implement a binary search
using just an array
and we're going to try this for
different languages ensure that your
array is sorted so this is the crux of
binary search any index random access
data structure can be binary search when
you say it's just an array i would say
this is a very good answer i like this
answer right
i would say this is a quality answer it
shows a recursive implementation an
iterative one
um rust high quality okay
java
[Laughter]
that was totally rust can i get some
help
please i have tried many methods to get
this to work
i got the array sorted and to print but
after that my binary search function
doesn't want to run and give me right
results
it always gives me -1 any help
just compare that to this
yo so too man let's let's let's give
ruby a fair shake
ruby binary search i'm trying to do
binary search
i get this error just use array b search
as for the error it comes from somewhere
else
it's better than java let's do
javascript
i'm trying to implement a binary search
algorithm in javascript things seem okay
but my return statements appear to be
returning undefined can anybody tell
what's wrong here
okay java ruby javascript
rust
uh well no no no no well you really
we got we got to do the
can just just just like look look at the
quality of that answer
versus this you are not actually
comparing with the array values
lowercase u
god unreadable junk
java php ruby
javascript haskell and actually i think
the rust one was the highest quality
i will do python as the last one
mid tier on par with javascript
mid-tier
why do i feel like you're about to start
a call well maybe with an apostrophe re
is there even one for agna
oh my god wow
and it only got one up vote
okay ag agna is really top tier
the tricky part is understanding what
the widening function actually needs to
change once you've got that right in the
code is fairly easy
and then proceeds to write a really nice
happy coding
beautiful english well formatted
yo and agnes god your language
[Music]
all right guys we're getting near the
end
of this
yeah there's probably only 10 active
devs in the world and i mean though this
says something about
well that gets into deep truths
all right any q a
google programming languages as weapons
i know i was short with you guys last
night
um what the fuck i can't even
[Laughter]
this is pretty good rust is a 3d printed
gun it may work
someday
it's usually only used because how shiny
it is
this is good these are good
c sharp is a powerful laser rifle
strapped to a donkey
who takes off the donkey the place it
doesn't seem to work as well
uh lisp is a ship which comes in many
forms anyone who uses this is probably
crazy and dangerous
refactoring freebsd kernel
yeah i don't know whoever they switched
from c plus plus to java
i was the last year that took the ap
compsci test in c
plus um
i'm done with the merge sort reform
board with that
uh oh my god is neural link going to be
the next gbt3
you guys are all going to ask about yeah
i talked about neuralink already i
talked about that in an old stream
do i still work i worked hard this week
i made i made dollars boys
i made dollars
thank you i hope i don't want to
zuckerbergy you know
i did say things about gbg3
not disrupting nobody's social shit man
there's collaborators there's dissidents
and then there's the detach
i'm going to one of those 10-day vip
asana retreats
you know and leave you guys all with the
world that you made man you know
i didn't do it that's i didn't do
nothing man
deep dive into nuclear physics and boss
at google was
interested in like reactor design you
know a bit about it
like molten salt reactors and stuff what
do you mean like like
like the equations behind nuclear
physics
which i kind of know like yeah the
uranium splits and gives off this and
the neutron
uh no it was a contract
yo kodak gets it remember when kodak was
a blockchain company
and now they're a covid company
common connect pivots to drugs after
abandoning photography and crypto
no not bug bounties bug bounties are for
bitches
it is a great title
nick bogo sort updates on hammer
hammer became political and that's why
it was canceled just like this stream
would be
if anybody made a fucking discord
um
oh grow my long curly hair i look like
tom hanks i'll take that man tom hanks
good looking guy
i don't know about the mark zuckerberg
have you tried quantum programming not
really i heard like some new language
came out
and i
like i don't know is there like a good
language for this
it sounds kind of fun
sorry strawberry field ai uh
most of what i know about quantum i
learned from reading uh quantum
computing system archites
oh god midflowmax caught yeah
maybe at the very height of my
competitive programming career
i could write that i can't anymore
inline gifs in terminal that's way too
terry davis
here pie quill
righty computing wait
wasn't that the kid from silicon valley
but the other guy the kid who did
nothing big head
why did i think his his name was
righetti
big heady oh close
oh my god man you know this thing's a
scam
this is a fucking steampunk quantum
computer
i don't know the pi quote might not be a
scam now all i'm saying is
if that's what they're advertising on
their website
um
yeah are quantum computers real
let's google it i don't believe they are
but i i don't believe they're impossible
and i believe they will be built
once yeah yeah okay quantum supremacy i
don't even
i didn't really follow that because it's
all like i don't want to read scientific
america
well maybe scientific americans okay
let's take a look
well i'm judging the quality of the
article based on how many interruptions
they have and that one
um this is kind of old so
first step is to make quantum chips
5 trillion transistors to simulate 42
cubits
i mean that seems right what's 2 to the
42.
yeah like 5 trillion
but that's assuming quantum computers
can solve mp complete problems they
absolutely cannot
oh great the us health subcommittee on
bullshit um oh what might have to do
with ai nothing
are quantum like i would believe
i will you unfollowed essay after they
show the metric system
you apple pie yankee guy
probably measures their dick size and
fahrenheit
you know
what do i think about p and np you
i don't know if you guys uh
yo actually i'm gonna chill for this
well so okay first
um you want to watch a good video
if you guys haven't seen this
[Music]
then his dad looked over his mom and
said you know this is probably less time
we're going to see
[Applause]
speaks russian americans
chose
[Applause]
you're about to see a russian air strike
on syrian ranks they inferior to
amphibious siberian tanks
you're nothing but a civilian with sileo
blanks
who's really up his own ass like azealia
banks
but then what's more unreal and this is
the quote that i'm gonna leave you with
uh
yes
foreign
you know that's how i feel
that is how i feel man i would rather
die of fucking no name than become
famous and end up being like you
that's how i feel though you know
you say that now you know what bro if i
ever don't say that
here we go
i'd rather look at no name than mw
famous and end up being like you
if i ever don't say that or um this was
on ella's blog
uh
she had like reminder from childhood
um when i was a child adults often
didn't treat me well
they didn't seem to care about my
feelings would do things that made me
really sad and generally dismissed my
experience of the world is less
important because i was a child a fact
that they reminded me of constantly
i didn't know how to communicate to them
how much this hurt me but this was
seriously confusing to me because
they've been children once right
and they talked about their bad
childhood sometimes which mean they had
once been in my position
i realized all the children had grown up
into adults then turned around and
stopped caring about children's feelings
because they'd forgotten what it was
like to be a child this terrified me
mainly because i knew that one day i
would become an adult too would i grow
up and forget
would i do this exact thing to the next
generation of children's
so i packaged a mental message for my
future self
a set of impressions that i would
remember regularly as the years went on
and preserve over time
as close to its original form as i could
manage the message went something like
this
you don't remember what it's like to be
a child but i'm telling you
take the experience of children
seriously don't underestimate how real
and how important this is
don't forget me i'm an adult now and
i've mostly forgotten i'm not around
kids very much
my memories are fuzzy but that message
sent from my childhood is still very
vivid in my mind
so you say i say that now
not a public figure
wanna see some real
i've been a public figure for a long
time
um and fuck that shit
you do not want to be famous
so i'm telling you i'm a public figure
i'm a guy who streams and a bunch of
y'all watch me no
if i win self-driving cars if kama wins
self-driving cars
i won't be famous
like think about the kind of person
who's famous you know people think
people think i'm an egomaniac right
people think oh yeah joha you know he
sticks his name in his face on
everything like
i don't know i mean you know why did i
stick my face in the jail breaks like
for me it was just like funny like the
irony
the irony and i didn't really you know i
was young i didn't really like get it at
the time
right i didn't get like the irony of
branding
like it was it was a joke like it wasn't
meant to be it was it was it was a
hacker
like um
you know did it look like a real like
just just you know it was it was funny
and i didn't
get
i i guess i didn't get what i was making
fun of at the time
now i want to speak russian i want i
want to understand like
like
the level
in this in this in this rap battle
um uh if language structure thought
these people have access to language i
don't have
um oxymoron tells the story
shit i gotta read this the hero with a
thousand
faces yes
oh it's an anthology
all right this is what i'll read next
you know i read this
junior year english class i had some
some camel essays
you can learn this cyrillic alphabet in
two hours i've tried
i can't i'm not like good at things like
that
um though i was trying to
[Applause]
stop
i've been trying i mean i i i spent a
morning on that
russian sounds like i'm reading the
torah um
oh my god the book of why does judea
pearl pay you to come in here and
chill
uh oh try this in your free time all
right cool
and that's how i feel man
oh god i don't i don't know man oh no
that's why i gotta click you know like
if you ask me to do the same thing with
that i can't do that because i don't
know how to
you know oh shit i don't know
um
but yeah
i just i just
you guys can remember this is the end of
this stream you know it's forever on the
internet uh
that
who's pavel durov i've heard that name
before
i've definitely watched disaster or an
oxymoron it's sad how badly he beats him
um it's almost like disaster isn't
playing for all the marbles and oxymoron
is
uh thanks gig effect
oh no i've never met him
travel the world in self-imposed exile
and then are they in america they're
here in uh new york
i mean where would you go you know
uh well if anyone knows him i'm down i'm
about to hang out
um
bald and bankrupt
no i don't know this guy's a blogger
he's a blogger oh damn
oh russia beyond
foreigners show you the real russia
who's forced to apologize on camera
by chechnyan authorities
oh my god yo i love when people have
real experiences on youtube so i don't
have to
bald and bankrupt is a creep and a sex
pest
hey i don't know i don't know anything
about this guy
all right guys
we're gonna we're gonna finish the
quantum we're gonna look into quantum
python
i think i like look downloaded this once
before
is it a cute is it like a nice paradigm
of learning
this website looks crappy
q sharp is it a microsoft language
dude are they fucking kidding me
fuck google
oh no this is like this isn't
yep it was sad yeah they gave me q anon
bullshit yup
you know guys the companies don't care
man people are always saying oh
the search engines all the social media
companies they have a liberal bias no
they have an
outrage bias they have an idiocy bias
if it's dumb they give it to you
uh my solidity changes got merged in
that's nice
video buffering
not even majority bias it's like if
there's something that can like you know
be
dumb yet outrage you
no i'm not making a hammer i'm out man
my stand in the culture wars i'm going
to build a college
that's my stand in the culture war
who cares what it is the difference
between q anon and pizzagate
is q anon takes itself you know what
never mind fuck it
no i'm not i'm not talking about this
it's all bullshit guys
it's all bullshit it's just thinking
about it rot your brain you know
will i actually make a college or is the
college like the church
well the problem with the church no look
don't take me that don't hold me that
accountable right
the college on the level of seriousness
here's comma ai
here's hammer here's backspace and
here's the college
comma ai college backspace hammer
was that tribalism it's the incentives
of these companies
tribalism's always existed the
incentives of these companies has not
you can't even blame the companies it's
just the incentives i don't know you
know
all they can come into smash is power
um the college requires a entrance exam
um and the entrance exam you'll sit for
it right at the college
and then we'll set a threshold on the
entrance exam and everybody who does
better than that threshold is welcome to
attend
the problem with the college is that
it's already the church no you can't
make a church because it turns out only
crackpots want to make churches
now if you want to make proper tinder
you have to charge men money
i don't understand why dating apps don't
do this
dating apps are terrible because it's a
sausage fest and it's a sausage fest
because it costs the same for men and
women
you want to charge men money every club
promoter knows this you do not want your
club to be full of dick
so you charge men money i don't know why
dating apps don't do this
we'll be on the exam intelligence
nothing you can't study for it
there will not be a physical assessment
now
it's an entrance exam
if app charged money there would only be
rich ugly guys
i don't think that's true i'm not saying
a lot of money right just enough money
that you want
so i think what you'd end up with right
like if you sign up go sign up as a girl
on
i did this back in the day on okcupid
sign up as a girl and realize all the
spam you get
you get tons of messages from guys but
that's the only strategy they have
because they
you know this is the strategy you have
to use on dating websites you have to
mass spam messages
and this is because the ratios are super
imbalanced right
um imagine you know you can imagine the
physical instantiation of this is a club
right
do club only have rich the clubs only
have rich ugly guys
i don't really think so
oh my god bumble oh i went in some
horrendous dates from bumble fuck that
website
um
instagram instagram is the best dating
app that's true the dms boys
the dms you know oh the dms
fuck tinder man
dating is i mean it's a lot easier it's
easy in new york
uh that dating is great
find dates on twitch i've looked at the
demographics of my
audience i am
i am straight um
i've never actually gotten a date off of
linkedin
um let's just say i have standards
and the messages i have actually gotten
do not meet
uh my standards
uh what about grindr i think it work i
mean again
if you're into i think it works i think
the gay dating apps work a lot better
um because of the fundamental symmetry
well tinder sucks yeah of course a
tinder you can't use tinder anymore
i'm not on tinder um tinder still works
in some countries tinder worked well
like in malaysia
i had some luck with tinder i mean i had
luck with tinder like way back in the
day
go back to like 2012. tinder still
worked
now it's a meme hinge
hinges so you got to get past the cringy
questions
uh no i don't even think i don't even
think tinder works if you work out
um what was wrong with bumble i don't
want i yeah
yeah i'm not going to go into what's
wrong with bumble
columbus i don't know people found dates
on clubhouse
this one looks like the best this kisket
is it python
sorry we're making the uh making the me
tiny again
uh okay so i mean dating sites suck just
go meet the person face to face stop
using useless tools so
uh while having conversation i mean your
dating apps are just funnels right
i mean it's it's you know you really you
want to build they saw
man you know so many i've given you so
many company ideas today uh build like a
crm for dating like build
salesforce for dating
seeking arrangement follows the one rule
it charges men money
uh you have to charge men money
i think that that didn't do what i
wanted
i might regret using pseudo
i finished for loops boys
well yeah but fake accounts i mean fake
accounts would go away with uh
yeah so you'd need i mean you'd want
you'd want to make sure
that look if people if i'm charging 50
bucks a month for an account
or 30 bucks a month for an account uh it
doesn't matter
um if people make fake ones or not you
can waste your money on that
uh yeah for the women who get free
accounts you're gonna want uh
verification
the girls in sd are better than ny i
don't know about that boys
i don't know about that
simple ratios you know
uh what do they say in the hunger games
uh
the odd may the odds be forever in your
favor
well that's new york
let's convert hammer into a dating
website
yo it's a search for people
it's a search engine for people
yeah yeah and then it'll like pre-write
your first messages it'll arrange you
i mean i mean that's the crm of dating
right like you know if you guys use
dating apps seriously and
there's you can succeed with dating apps
um if you use dating apps seriously
you get you basically build a sales
phone
to go back into a dating app
organizing the world's humans i think
talent here has got us beat
we're trying a little bit with the
quantum
we're casually doing things boys we're
doing things
i mean yeah can gvt3 write how okay how
do you get access to the gbd3 api
gpd2 online we'll settle for gpt too
oh this is the one that's taken down
though
man
ah get started by writing a custom um
what is a good
opening uh
message for to send
to a girl on
a dating app
tab
ah well in one moment it's the perfect
one to receive
honestly if you sent that message on a
dating app it might get you some
interesting replies
i can say i've heard the word ah in our
minds
a quick reply a hint an email just a
couple of simple and very
let us know in the comments
this key can be used
i don't know
say some dumb crap that normies will
find deep
um yeah no i think we're going to need
gvd three level technology
okay all right all right we're going to
apply
we're going to apply seriously join
waitlist i'm interested in being a beta
user of the api
george hearts geohot plus hammer
gmail.com we're going to turn hammer
into a uh
your use case
spend a lot
of time messaging
many people
on dating
apps this
can be replaced
by ai i'm interested in receiving email
updates about the api
yes but only if i get hammer
hammer.law this can be replaced by
ai
this would benefit
society because
more true love
can be found
more efficiently
that's it this is not this is not for
hammer let's just let's just let's just
do geohot
a more true love this can be replaced
by a good we want to be accepted
good ai language model like
gbt3 always flatter the authors this
would benefit society because more
true love can be found more efficiently
there may be
risks if the
ai sends in
appropriate
oh i got i don't know how to spell in
a propriet messages
or if
if
people weren't
really looking for true
love and actually
actually
just enjoyed
messaging people
this can replace by a good ai language
model
combined with
with a crm
like salesforce
perfect men spend a lot of time
messaging people on dating apps
this can be wait we shouldn't be gender
exclusive
people spend a lot of time messaging
many people on dating apps this can be
replaced
by a good ai language model like gpg3
let's just leave it at that we don't
need to talk about the cr this would
benefit society
because more true love can be found more
efficiently
there may be risks if the ai sends
inappropriate messages or if people
weren't really looking for true love
we'll just leave it at that
perfect who thinks i'll be approved
[Laughter]
who thinks i'll be approved
i talked about the benefits and risks of
society
i promise they won't i read that you
know
the good news is i have access to a
super computer if i want it on gbt3 is a
little big
we'll try yeah sure we'll do it on
stream if i'm approved go go email open
ai and tell them to let me in but be
polite
you remember you're representing the
george hot's twitch channel
inappropriate messages yo
ask your dick pic
no but really really just imagine a gpt
that's scheduled just imagine like it
just schedules your dates for you
you don't have to do all that
pre-messaging you know a lot of sites
have like
even the better sites of like a 21 ratio
you got to send out 20 messages for
every date you go on
um this is a christian channel i'm
trying to help people find true love
more efficiently
oh whoa well that's too deep man those
people don't want to you don't know it's
not them man it's not them you know
pot suits
uh yeah i should try out ai dungeon i
hear you sign up you got the thing
hello mr altman i'm representing mr ox
[Music]
all right all right that was we we had
fun uh
i don't know i might go look at quantum
stuff off stream i'm kind of interested
but on stream this stream has been wow
we just did we just did
two and a half hours of just talking you
know
i hope you guys enjoyed the talking
stream
thank you all for watching
uh
please subscribe if you enjoy this
content
if you're not a subscriber uh i look at
how much money i make off twitch
and it decides how much i'm going to
stream
that's not really true but it's kind of
true
good vibes thank you all for watching be
the change you want to see in the world
that's bad advice just be that's good
advice
bye everybody
welcome welcome welcome to my stream
hello
everybody I have a chair over here we
can sit
down I'm not really that visible then we
can maybe tilt it down a little we're
we're going to write on the
Whiteboard uh let's wait for some people
to get in
here oh good morning we on subscriber
only chat we don't need subscriber only
chat thank you for
subscribing this is this setup working
we have we have the Whiteboard today no
computer only
whiteboard
um you I did a lot of thinking about the
last stream uh I did a lot of thinking
about
the uh techno uh
pessimism uh argument for the last one
it was brought up in a few things and we
can discuss
uh
crisis of
meaning right maybe you've heard this
phrase who thinks it's
true right can everyone see the board no
one can see the board I need to write
way
bigger um I need to write way bigger
this is not this is not big enough for
the
board wow it's now I understand what you
guys always say with the font right all
right all right all all right all right
we're just going to write the word
meaning in big
letters
right and everybody suffers from this
right you think you think oh oh did I
spell it right yeah
meaning
right
um it's not a crisis of skill issue
right and a crisis of meaning is
actually incredibly stupid when you
think about
it like and you know I think about it I
was in New York for the week and I'm
thinking about
this
uh my markers you don't like my marker
okay we got lots of markers to choose
from thank you thank you thank you you
know what guys I'm not going to wear
black anymore you know I always dress in
Black I think I'm I'm going to bleach my
hair blonde and I'm going to wear
brightly colored clothes not brightly
colored but like white you know because
it's it's time the the tides are turning
it is it is
2024 and the tides are turning you
thought that marker was bad this markers
is even worse someday they will invent
good
markers um I like big shirts though you
know
uh no it's the other way around bro the
fs are white the zeros are Black come
on um where Earth colors no it's not
about the meaning of life right but you
guys know that I'm not kidding when I
say what is the meaning of life right
and there really is only one answer that
makes any sense and that's to
win
right that's it win no one can see
anything this board doesn't work it's
too
shiny okay
so
[Music]
um how do you win right
so I just like like like here we are
look around right you are in an open
world mmor
RPG
right here you are with all these people
now how do you win at World of
Warcraft how do you win at
Zelda right how do you win at wow how do
you win at Zelda right why do you think
it's
different why
and this is what what just comes to me
about the crisis of meaning being so
incredibly
stupid it's like have you had a crisis
of meaning in Zelda ever right what am I
even solving these shrines for you know
okay I guess it's nice I guess it's nice
that you can you can click that button
and it says at the top you know destroy
Calamity genon
right I'm going to stop saying right I I
realized I say right at the end of
things and it's bad and I'm not going to
do that anymore because it's a new year
it's 202 before even though you can't
see it and it's in green
marker when it felt
real I understand that but what do you
think feels real anymore I go to New
York every year and the things that used
to feel real don't feel real anymore
either we can't go back we can only go
forward only forward not
back so you have no problem with this
objective in World of Warcraft in Zelda
and there's lots of different things you
can do in these games you can you can
join a guild you can go gather mushrooms
in the
forests uh but it it you don't have a
crisis of meaning in these games and why
not why do you have a crisis of meaning
in this world but not there I'm sorry
sorry the game is hard I'm sorry the
game takes a really long time to
beat I can't tell you how to quit
procrastination just the the
world okay can
everybody Harvard can everybody read
this cuz we're going to put a big no
sign through it these people have led us
wrong for the last 50 years for the last
50 years we've been listening to idiot
OT we don't have to listen to them
anymore Harvard's over we're
free
um no we don't we don't there has been a
group of people since since we'll put
the year up here since
1971 that has been you know this the
year the money became fake this is when
everything seemed to go R and we just
don't have to listen to them anymore
are can I draw my best integral sign go
you're the reason we're going to go
subscriber only uh no no no no don't
trust see but this is the problem now
okay so we destroy Harvard right
everyone everyone everyone loves being
who is it robes Pierre everyone loves
being the guy who's going to you know
storm the bastial and kill the Nobles
but the question is what do we replace
it with you you can't replace this with
a bunch of hack conspir iracy theories
and libertarianism and and
and whatever you can't do that you need
to come up with a
new uh
epistemology sort of I mean not really
like it's it's been there the whole time
it's been there the whole time and it
brings me back to this point which is
how do we
win
so you've played
you've played breath of the wild right
some of you have you know when you're on
that little island with the four you get
the four shrines and and
uh you get the four shrines and then you
get your parag glider and you can leave
the little island look at the universe
we haven't even left the little island
yet here here here is here is Earth
Earth right and here's the sun over here
right and like space is like we'll make
it a little bigger cuz it's the sun
right and like space is like mad big
guys um to be fair there's not going to
be beautiful little quests in every
corner of space this game is harder than
that reality is a hard
game it's not not to scale not to scale
all right not to
scale
okay so we're going to talk about got a
few uh it name is soul okay fine fine
fine fine fine soul soul soul soul
that's that's that's like the that's
like the name we'll put Alpha centor
over here is that is that
alpha
alpha Cantor goes over here I don't know
how to spell that but you know it's like
like like isn't that Kane new girl
sentory sensory something like that
um not to
scale
[Music]
uh it's it's not it's not it's not
appreciate so let's talk about a few
ways that technology is actually going
to start to improve your life again um
so for the
2010s I just listened to Jim rutz Cory
Doo for the 2010s tech was synonymous
with this group called fang okay uh most
of these companies are not technology
companies and if they do technology it
is mostly kind of as an aside right like
there's some interesting stuff happening
at meta interesting stuff happening at
Apple interesting stuff happening at
Google Amazon's a logistics company
Netflix is a stated Media
Company
um but this is not technology and you
shouldn't associate that uh when you
think technology the best thing to think
about is
farming right you guys watch you know
what's cool Clarkson's Farm
this is Clarkson's
Farm farming is the best thing to think
about because humans have been growing
food
for many many many years and oh man if
those if those if those first
agricultural guys who were trying to get
like a mule to pull a plow saw a tractor
oh they flip the shit man yo a big
tractor coming through the field you
know tilling all the soil planting all
the seeds right chopping all the wheat
man they'd flip a
shit so can anybody
sit right here now and say that things
have not gotten
better and yeah there's some there's
some great like like crisis of meaning
stuff oh things used to have meaning you
used to have to rely on your neighbor
things used to be better dude if you
want things to be better like that leave
America you could you could go you know
I love watching these this is this is
YouTube our best documentaries and you
watch Africa documentaries I love Africa
documentaries you can see right now if
you want to go live in a world where
people still need each other and food's
hard to get and there's a sense of
community and tribalism you can go to
Africa and live this life right if you
want to I said right I got to stop doing
that um but like do you want to be you
can out you can opt out at any point the
Lites can opt out but for most people
come on let's be real here do you want
to be pulling the plow or do you want
the
tractor um I don't want to rely on yeah
it's true it's true like something's
lost right and I'm no I'm a technology
guy I'm not a philosophy guy you know
and it's a shame that philosophy guys
all came from you know terrible
institutions like this there are smart
ways to think about philosophy you just
don't see much of them
there are there is a real liberal arts
education out there but unfortunately we
are a Lost Generation unfortunately for
the last 50 years what has been called
liberal art is nothing of the sort what
you will get in a liberal art you know
hey ho hey ho Western culture's got to
go come
on right and it it's not it hasn't gone
anywhere it's still there you can still
find it there's people out there and I
love when I meet them people out there
who are still incredibly educated on the
humanities but these these these these
neo-marxists like you know I've met some
smart marxists I've met some smart
marxists and you can you can talk about
Marx um in in in smart ways and it is
true that they still do produce some
decent marxists but I don't think
Marxism is really the future I think
that it had some good points a while ago
we tried it and hey you know we got the
Soviet
Union uh
all
right markx was a Jew so what
what I'm streaming what's
[Music]
up what's up I got you got Co yeah
oh all
right uh I'm I'm streaming
you bring
me uh yeah yeah uh yeah should be good
be uh no I I don't think it's F Co oh
yeah the flu is just whatever the flu is
just whatever uh happens to be the
uh the the the thing uh that goes around
we call it the flu we call it a cold we
call it whatever coron virus is a
cold uh okay I don't have
Cod
um let's not get distracted by that we
we got distracted let's let's let's go
back to where we
were so yeah there there is a real
liberal arts education out there and I
hope some of you you know all you people
who comment you realize the internet
commenters always remember that the
internet commenters are a very small
subset of society oh I was commenting
about your marks as a so what man come
on let's move past racism it's 2024 and
we can all agree that racism especially
uh systemic racism like affirmative
action systematic systemic with the
system does it like affirmative action
is evil and there's no place for racism
going forward so let's let's let's stop
doing that right um and if you're not on
board with the no racism you can maybe
go to Harvard I think they like racism
there so you know maybe he'll fit in hey
maybe you'll fit in
um jees hate what come on stop with the
racist shit like it's still racist it
doesn't matter it's all white power
black power wokeism it's all racist
racism is stupid okay you want to win or
not you know even even even link had to
work with the with those fish people
yeah you had to work with the fish
people all right all right imagine he
was racist against fish stop being
racist right can everyone can everyone
stop being racist in 2024 that's a good
come
in oh I know my door get stuck we're
telling everybody that there's no room
for racism in 2024
$135 you need
$135 well help yourself hold yourself to
my pile of
money
um I have some in my wallet too I
think we're on to stream right now you
need this money right now what is like
like like Tony spr stopping by he going
to shake us down he is one is there
right now all right I got I got some 20
here where have you been going no just
every time I get dollars I put them in
the pile over there you want you you
want to show them my dollars that is
insane oh here's some dollars what is
happening what here you want some
dollars I got dollars you likey to me
about your activities how upset will you
be if I make it rain right now wait I
wouldn't be upset I'll pick it all up
you'll pick it up yeah I Make It
[Laughter]
Rain I mean I have to feel bad for the
guy has to count it all
he's going to think I came I'm a
stripper always remember that we're
having more fun than the other side
right d cells having no fun
accelerationists have
fun uh no it's it's true though it's
true I've learned this I've learned this
from from protests right like you look
protests you know like the leftist
protest used to have the energy and
who's ever got the energy but can we
have a protest where we we stop like I
don't know you know what you know what
infuriated me last night I watched that
video about housing in Japan and it
turns out we really are just all getting
scanmed like there's no reason housing
should be expensive this is a deliberate
policy made up by people who own real
estate to make their real estate bag
stay expensive it's just a scam uh and
like you all are affected by this scam
my my red for this apartment is
$4,000 that's
insane get this in toal too for a a
grand
no
um Tokyo is expensive I'm sorry if
you're a homeowner but your bags are
going to tank bro get out get out while
you can no legit if you are in this scam
get out today I'm warning you right now
Michael bur's tweeting it yo man uh you
guys know Michael bur is right
um
now I'm not saying you got to do
protests I'm saying you got to be with
the energist who's ever having a good
time wins the future and who's ever
having a bad time loses the
future
uh wait no but the housing Market's
actually going to crash it's just a
question of when perception is reality
until it's not and the market can remain
irrational longer than you can remain
solvent but not me so you know I want to
print mRNA at home too that's
right
[Music]
um you've heard this shit for decades
now yes but let me tell you what is
different this time okay there is one
thing that
changes does anyone know what that one
thing
is not
Bitcoin technology okay
what does it take to build a house what
if we just had a machine that could
print
houses
it's like there's a great I think it's a
it's a haak quote at the end of the uh
you know the WPF happen in 1971 page um
that says the only way that we're ever
going to make money real again is if we
figure out how to make it something that
they can't quite see as money I'm sorry
they see Bitcoin as money crypto failed
okay now that doesn't mean that
technology is going to fail but this
this this this like oh we're going to
get crypto in before they notice I'm
sorry no like imagine Uber took the path
that Bitcoin took right Uber worked Uber
exists today because it turned out that
all the congressmen were taking Ubers to
go to Congress the congressmen are not
using Bitcoin to buy coffees and they
don't give a shit about crypto and until
crypto people understand this until
crypto people understand how to make
normal people depend on their thing
there's no future in crypto okay I say
this all the time like you want to
succeed in crypto stop trying to make ZK
snark bullshit and make triangle it's
like square but you can pay
decentralized with crypto right and you
know you can there's a lot of I think
there's actually a lot of energy like
this in New York I love in New York you
pay for everything with cash it works
right you know and they all have they
all have signs that say 4% fee for
credit cards I love that I mean you have
to pass that on to the consumer the
consumer has to feel the pain of those
Merchant fees
um check out Doo
no uh yeah yeah you streames yeah this
is this is this is this is unfortunate
but this is what your bags and housing
are going to look like if you don't get
out and this is what your money is going
to look like if you are socialists oh no
this is India democracy yeah that's what
happens if you do
democracy
um someone someone was angry on my last
video saying I embrace fascists who
Peter teal who's the fascist
man I I it's crazy to me that's like man
you want to like give people freedom and
make things cheap that's fascist man you
can't just do that right like we need
like one world government and
surveillance state so we can save
democracy yeah
[Laughter]
right um we don't need another War can
we do this without War come on World War
I is actually going to suck guys like
you think it's going to be cool and you
think it's going to be some Call of Duty
shit but like it's not okay it's just
going to
suck
um everyone's inist now uh how many
houses does my family own yo 100%
inheritance tax who's on board you got
to build you got to build yourself up uh
war is kind of essential I'm not I'm not
an anti-war I'm not proar uh I think
that war is appropriate in C certain
circumstances um
uh World War III I mean I love cold Wars
cold Wars are the best cold Wars are the
best possible outcome of Wars nobody
dies and Technology gets better I love
the US China Cold War maybe we can have
ai skirmishes where drones destroy each
other over the Pacific Ocean now that's
my kind of War right we can get behind
that now warm Wars soft and the kind
that the worst kind of War like World
War II was awful okay and the worst kind
of war is a war that wants to get the
citizenry involved right like a total
war where your citizenry have to
contribute to the stupid war effort
sucks okay none of us want to live
through that uh a nice uh war between us
and China where we like fight over some
uninhabited Island to just like a tech
pissing contest that sounds sick man
like that's the kind of War we want in
the future okay it's not like nice War
right it's it's it's an understanding
that both sides could nuke each other
and turn everybody into Rubble right we
sort of do this with proxy wars it's a
little upsetting that people still have
to die imagine we had proxy wars where
we just sent
robots and we can all agree to some
Geneva 2.0 convention where we all just
send robots to war and anyone who sends
people to war is a terrorist how about
that
um Tech bro wants war no I do I do want
that kind of War though I think every
year we should have uh drone combat with
China over uh to take control of an
uninhabited Island rules you can't send
people and maybe there's a no there
doesn't have to be a budget cap it's
like the Olympic Games but with
technology I think that'd be sick that's
a huge waste of resources bro bro what
are we gonna do help poor people in
Somalia come on come on drone War sounds
sick George you can't do that that's
fascist okay well that's like your
opinion man that that's that's that's my
new phrase for like like that's like
your opinion man I think it's from the
big lowski I think it's good war on the
moon let's go right the thing about the
Moon is almost everything you do to it
improves the place you explode a nuclear
bomb on the moon I bet you it gets
better have I seen For All Mankind no
what's that is that like seven jeans
True
Religion
uh space race except you can shoot at
other spaceships no no no no let's have
the PVP zones of space and the PVE zones
of space I saying that about crypto
right like we like that that'd be
cool
uh no no no I did like Curtis think
about look but um you know I think uh
we're we're we're going to compliment
Mark andreon I think I think Mark
andreon uh does bring up a really good
point about these sort of radical uh
radical uh Lites and if they really
believe that this technology is going to
destroy the world if you're going to
destroy the world and you think you know
if you really think that your neighbor
is working on a project that's going to
destroy the world killing your neighbor
is the right thing to do right and
they're going to become violent um you
know hopefully not hopefully they see
the light before they do but I think
this is one of the smartest things
andreon said and it is uh sadly
something we have to watch out for but
the good news is we have drones and they
do not um
um I am a Christian
uh look
guys all right um I can't believe I was
duped into
atheism but also evolution is
real so yeah like Christianity I I could
see I do sort of see a bit of a
Resurgence of Christianity among uh
younger people
I'm a Christian I believe in evolution
uh my belief in evolution does come
above my Christianity right so so if you
say you can't you know if you say Jesus
didn't die for your sins if you believe
in evolution well that's like your
opinion man uh so but no when it comes
down to a lot of the again wokeism
really showed me the importance of
Christianity and the importance of
forgiveness wokeism is original sin
without forgiveness uh and we can't have
that we have original sin but we have
foress okay that's Christianity I like
it I want you to get on board it's a
nice religion we love everybody come to
a church uh I don't know church is kind
of boring someone's got to make cool
churches actually the churches in the
South are cool if if I uh if I lived in
the South by like one of them like like
Sea Coast Church in South Carolina uh
and it was good and I'd probably go
every Sunday uh you know the the
the the lowbudget Catholic Church
doesn't doesn't doesn't draw me in every
weekend not not hating just doesn't draw
me in every weekend uh the rock bands
are cool right like I think this is good
I think that like all right fine they
finally caught up to the 1970s but I
would love to see a Resurgence of the
church uh that a church that Embraces
technology because if you do not Embrace
technology you will
lose how do you how do these people who
say they don't like
Tech like do they have a sustainable
plan for the future do do they have like
like have they thought about what the
future is going to look like people who
don't like Tech are like conservatives
uh conservatives we're going to rip on
conservatives everybody knows
conservatives suck uh the kind of
conservatives who like in the 90s really
didn't like gay marriage and today they
really don't like trans people right but
gay marriage is fine and then in 20
years well trans people are fine but we
have to do something about pedophiles
right like like like like it's going to
be these conservatives are always losing
because they have no principles it's
just a backlash a backlash to the
backlash to the thing that's just beun
right so don't uh don't be a
conservative don't be a lite unless you
like losing who's the worst who's the
worst football team in the NFL I I was
saying this I was saying this to to a
friend yesterday
uh you know there's some people who just
I got to stop saying you know and I got
to stop saying right I'm self-aware
about this stuff right you know uh the
Jets aren't pedos always bet I don't
like pedos but like again oh I don't
want to get into this come on let's
let's
let's
ah let's let's let's let let's not get
into this but I think there is a
destination of where this stuff goes and
just culture War stupid the culture War
stupid there's only one war that matters
and that's are you on the side of
technology or you against
technology this is the new dividing line
this is the new dividing line in society
we don't have uh conservatives and
liberals anymore we have
Excel and D
Cel
okay D Cel and Excel and which side are
you on are you on this side or are you
on this side
now this side is
conservative so we'll give him a c
right and this side is Progressive we
give him a
p and if you've been listening to the
last five minutes you realize that the
C's always lose and the P's always win
so do you want to root for the Oakland
Raiders or do you want to root for the
Patriots when they still had Tom Brady
look it's a p
right so it is kind of still
conservatives and and and liberals but
this is really the dividing line now
look in embracing technology does not
mean embracing every single piece of
every single technology and it's all
good even if there's negative effects
that's not what it means that's not what
it
means I think the most pure way to
distill this down and every metric can
still be perverted every metric can be
perverted good heart's law but I think
the most pure way to look at it is
energy
use this is energy use up and this is
energy use minus do we want to use more
energy in the future or do we want to
use less energy in the future right
humans
population do we want there to be more
humans in the future or less humans in
the future some people might put a plus
there and still be conservatives but
really it's all the same thing energy
use in humans what's the difference
humans use a lot of energy well you
can't use the energy for that
no right are you a
progressive or or are you a
conservative and there's people out
there who are conservatives and I don't
mean to hate on the individual who's a
conservative the conservative who wants
to be left alone and live their own
lifestyle we need to totally respect
that I totally respect the person who
doesn't want to allow the new technology
into their lives and that's fine you can
and you should you should be left alone
and that's the moral duty of these
people the moral duty of these people is
to people who want to be left alone
people who don't want the technology to
come for them it absolutely should not
for them people should totally be able
to opt out of this otherwise you're just
asking for a fight uh and I think that's
a real I think that's a mistake that
the uh current progress has made uh so
if you want to opt out you can opt out
what you cannot do is prevent this if
you're on this side and you want to
exist that's fine but if you're on this
side and you want to try to stop this
that's where we have a problem and these
are the people who need to be soundly
defeated in every Pole in every ballot
in every democracy in every war in every
Everything war is the fundamental
decider we don't doesn't have to come to
war let's hope it doesn't have to come
to war let's hope these people realize
that if you don't Embrace technology you
lose and you don't even have to fight
now let's give them good surrender terms
let them surrender peacefully let them
live out life on their Farm let them
reproduce right this is this is animal
conservation it's the same thing right
we like animal conservation we're
progressives all right so
everybody in 2024 welcome to the
progressive team welcome to the
accelerationist team we love technology
we want to see more humans we want to
see
flourishing we don't want to see
deceleration we don't want to see
housing not being built we don't want to
see power plants being knocked down we
don't want to see uh one child policies
we don't see anything that looks like
that it's negative it's negative got got
positive energy over here see I'm not
dressing in Black anymore it's time it's
time the future is ours W is this is
this just is this just me with the same
same accelerationist andreon Manifesto
we come
on uh so coming back to here coming back
to
meaning um
look what is the existentialism of the
21st century I don't know I'm not that
great at liberal arts I'm not uh I'm a
good PR I'm a good security guy I'm not
I like the stuff I'm I'm I'm a hobbyist
but when I meet people who are genuinely
good at this stuff the people who know
like all of all of the the SAR books and
the Kimu books the people who've
actually read like like being in time
and are like I understand it what what
was on my book K what's K
uh oh critique of pure reason like the
people who've actually read critique of
pure reason I just I can't do it but but
there's people out there who have and
this is a this is a serious role in the
future for this figure out what the
existentialism of the 21st century is I
don't know I don't know but there's
answers here and the closest I can come
is thinking about
winning and I don't mean winning over
other people I mean winning over nature
we are in this great open world
universe
and do we want to win or
lose let's
win you could stand in the same place
you could you could play Zelda you could
just stand there but why would we do
that you could play your little you
could play your little mini game you
could go around catch horses by that one
stable all day but why would we do that
let's progress let's get to the end of
the
game we're going to be tired of winning
we're going to win so much going to be
tired of
winning Jesus Trump F in
2024 what a a What a Sad What a Sad
state but it doesn't matter it doesn't
matter this is the new line this is the
new
line um you're either on this team or
you're on this
team right no racism okay I don't see
any racism 2024 if you want to be racist
go to Harvard okay they're they got to
they got let them let them have racism
and you know they can they can be stuck
in 1971 and and you know let him have
racism um Charlie she was ahead of his
time uh Harvard is is racist yes yes
they are they are um they have they they
so so look let's just come up with a
very simple definition of racism if you
are looking at People's race if you are
making decisions based on people's race
you are a racist
pretty straightforward right so if
Harvard looks at People's race when they
decide who to admit they are racist and
because Harvard is a powerful
Corporation that's systemic racism okay
should I should I teach should I teach
impression studies does everyone like
this systemic racism when a government
or a large corporation uses race to
discriminate systemic racism
um is a doctor racist then well a doctor
doesn't use that to discriminate right
if a doctor were to look at someone's
race and charge them a different amount
based on their race sure if if you you
race affects your medical yeah but come
on we live in a society we live in a
Christian Society where we're all equal
under God okay everybody has the same
moral value to
God now
that doesn't mean that everyone's going
to have the same stuff that's just
that's just the economy that's just we
live in a free world you make you make
choices you you have free will you also
unfortunately are somewhat trapped to
your genetics but that's just life
sometime the ball comes up red sometime
the ball comes up black should we make
roulette illegal no but we should remove
the zeros from the wheels one zero is
plenty three zeros is really egregious
and someone needs to do something about
this
um is all racism bad I think
so okay now I I do think uh race does
correlate with certain things that you
may want to discriminate based on you
may want to discriminate based on uh
culture you may want to live PE uh live
around people who have similar values to
you this is all very different and this
is not
racism um racism is literally racism is
asking the question what race are you
this is not a real category this is
bullshit it it it it singles out a few
pieces of DNA that that that don't your
color your skin come on man this is we
are progressives here we have moved past
this okay racism is over it's back at
Harvard um how do we build the Protech
future I mean it's not going to be easy
and it's not going to happen overnight
there's going to be a big struggle okay
so let's get let's move past racism is a
stupid topic uh let's move to a good
topic okay housing right um this is
Peter chals thesis and I've come to
believe that it's very
true if we can fix housing we can fix a
lot of other problems in society so
housing you basically have two groups
you have land
owners and then the uh renters I I'm I'm
in this class so we have two classes now
let's say rent were to come down
75% the renters would be happy but the
landowner class the homeowner class
would be unhappy their bads would become
smaller
look you got to give them a way out you
got to give them a way out I don't know
what that's going to be yet I hope
people smarter than me or at least
thinking about this more than me are are
are working on this cuz you do have to
give them a bag out but this is what
needs to
happen you're going to get continued
very strong opposition from this class
this is why this won't happen but if we
figure out how to
either saer Swindle whatever it is we do
to this class I don't know you know I'm
all for I'm all for diplomatic Solutions
here but something's got to be done
right this is class Warfare this is
Marxism 101 one you know they really try
to distract you with racist bullshit but
we are the 99% boys we are the
99% and something's got to be done about
the damn land owners gouging everybody
because they don't just gouge Everybody
by charging a lot for their properties
they vote in elections and then they
make it illegal to build more housing
basic I hope everyone understands this
now and hope everyone sees that it
doesn't have to be this way I think the
simplest way to get people out of this
and into this is to show them that the
future fut can be better than the
present if you live in a world where
we're in pretty much decline since
1971 it's hard for them to believe that
the future can be better than the
present look at look up look up trust in
the US government look up trust in the
US government Peak to Kennedy and it's
gone downhill since little Spike at
Reagan little Spike at Clinton but
mostly it's gone downhill
since we need to convince people things
can be better and they can thanks to
technology because everyone can agree
that a tractor is a lot better than
plowing the field
yourself uh so eat the rich I love it I
love it let's team up with AOC we got to
get AOC on this team right we got to how
do we get AOC on this team we can do it
cuz these are the good
guys uh I know Uncle Ted wouldn't agree
but
like
it's not good it's not
good we got to move past that we got to
move past that ridiculous way of
thinking that somehow meaning is being
stripped from the world all right let's
talk about let's talk about let's talk
about TED kazinski right guy loved
nature wild nature guy did not like
uniform housing projects I don't like
uniform housing projects either the
things that we can build in the future
look more like nature there's a pirate
wires article about
this we can the reason that houses are
boring beig boxes is because the
Manufacturing Technologies of the last
100 years allow us to build boring beige
boxes as we get control of as we can use
additive Manufacturing Technologies as
we can use biotech to build that's the
look at species 8472 that's that's the
future like a a fusion of of of of
biology and the things in the future are
going to look more like nature not less
like nature we will exist in more
harmony with nature with more
technology things today are when you
think about I just want you to imagine
an appliance from the 1950s and how
sketchy it looked the thing was a fire
hazard the thing was think about like a
Transformer and you're putting things
through and your little coils are
vibrating at 60 HZ and it's scraping the
enamel off the coils now compare that to
a
mosfet think about it think about a
beautiful little tiny mosfet switching a
kilowatt you can switch a kilowatt with
a mosfet you know 50 volts 20 amps is a
kilowatt with a
mosfet I a moset symbol I we'll draw the
transistor compare
this this is also not to scale compare
this to oh what I got to build a relay
what am I going to do build a to relay
and like pull a magnet on here and then
have like a little like electromagnetic
coil here oh
oh the solid state it's it's the
technology gets us closer to like
beautiful pure
things um the relay and the Transformer
last way shorter amount of time I know
that's not a mosfet what's the mosfet
what's the mosfet symbol well you know
what I'm going to label them gate drain
and source so therefore it is a mosat
there we go take that electrical
engineering
um actually this is it's this right the
drain is the emitter the source is the
collector I don't know uh is that
right uh I
mean I
think yeah because usually a drain is
like if you have like
a um it depends I think it depends if
it's n type or ptype
um yeah we could go into uh but but it's
but it's this stuff I was watching a uh
you watch a Super Bowl
from uh 20 from from 1995 you watch like
the the Super
Bowl uh show and you look at these large
hallogen lamps that you can't switch on
and off
quickly how would you even do that how
would you even switch it on and off
quickly today we have LEDs switched by
mosfets come on that's
cool um so drain source and drain it's
gate source and drain are the three
things but I forget whatever it's this
npn because I Dre the eror that way PNP
is the other way I don't know I come
from a
prosat
um
uh small transistor uses less energy out
arrow is end type yeah
okay
uh mosfet and heat sink yeah but you
need you need a tinier heat sink today
you need a tinier heat sink today than
you do in the past because your so a
mosfet has a resistance here you you
have you have some you have some basic
like like the model is that it's a
semiconductor with some resistance
actually this resistance that matters so
you have some uh drain Source resistance
when your mosfet's fully saturated and
these things are
becoming this like it's I think it's
beyond 99% efficient today meaning that
for every for every you want to switch a
kilowatt you only need to sync 10 watts
I I bet they're even more I bet they're
even more than 99% efficient today um if
we had computers we could look this
stuff up but the future is so bright I
agree uh so this is a separate
problem and we need real liberal arts
Majors to work on this we need people
who actually understand like what what
was called the liberal arts for many
many years till it was perverted by a
Marxist
cult right is this is this
controversial I think I think everyone
kind of gets it now
um what can us as Engineers do okay stop
and I say the same thing I always say
think about what you're working on and
what the convergent end point of it
is think about where your technology is
going and how your technology is going
to change the world what group of people
is it going to benefit is it going to
benefit if you are at a physics research
lab researching mosfets with low drain
Source resistance you were doing good
for the world if you are working on a uh
you know uh
uh you know I we don't have even have to
give examples you know you know the kind
of things that I'm talking about if if
you are working
on if you work at Turbo Tax and you are
lobbying the IRS to make the tax code
more complicated that's my favorite
example but there's many forms of that
if you are working to slow down any of
this technology if you were the person
who made Elon strap a seal to a board
you're the bad
guy so what can you as Engineers do I
mean think about who you work for do you
work for people who look like this or do
you work for people who look like this a
lot of these sort of people still want
technology the New York Times has
somebody making their website don't do
that the New York Times actually isn't
that bad but you know you know the ones
who are
bad um if if there not if the the the
the ownership of your company is
fundamentally against technology stop
working for them and start working for
people who like technology and want the
future to be better than the
present
uh yeah Fang and John Deere are probably
on the left side of the
board
uh I mean I think I don't look I don't
know that much about John Deere uh
for Fang companies yeah I mean I
wouldn't work at Google uh I think I
think Google is is fairly anti-
technology today I think that um it's
less clear for company like
Amazon uh of course they rely on Tech
and look just like just like welcome to
the you know welcome to the welcome to
the welcome to the 2020s the lit 2020s
where we used to come people used to
quit because they're they're you know oh
my company doesn't support like uh my
company isn't pro-choice I'm going to
quit the company right that's right you
know I respect these people right to to
stand up for what they believe in and
all the engineers out there you know
stand up for what you believe in right
it's the same
thing uh but I
think uh you know it's it's it's if if
your if your company doesn't share a pro
technology set of values stop working
there stop helping them with
technology
um meta is these companies are large
they have many different divisions they
have many different
teams I think
that I can promise that all of my
interactions with Elon match up to what
you think Elon
is Elon seems to be complet like there's
no there actually isn't a filter how
Elon behaves is what Elon is I can't say
the same thing about Mark Zuckerberg or
Jeff Bezos I'm not sure I'm not saying
that they're not but what I'm saying is
it's not completely obvious to me and
see if you can find somebody who would
vouch
for uh them you know someone who's
someone who's someone who spent time
close with Mark Zuckerberg does he
actually believe the kind of stuff he's
saying now uh and then there's also a
question of do these people have you
look at someone like Jack dorsy in
Twitter it turns out Jack dorsy was just
cut out of everything in Twitter so
sometimes you might even have the
question is do they have control and do
they have good
values uh so come on we all learned we
all learned from the sjws in the 2010s
some of their tactics are good some of
their tactics are good don't announce
them because they're sjw tactics but
always make sure that you are having fun
and if you're not having fun you're
going to lose right if you if you see
this all as drudgery and this is what I
said on Twitter I'm like if you don't
love technology quit technology right
it's going to be a party and that's the
kind of energy that was I loved Occupy
Wall Street back in the day that's the
kind of energy that that that that that
works that's sustainable everyone here
is having a good time building the
future
ah what's the name of this cult it's not
a cult man it's the future it's the
progressivism it's progressivism right
progressivism we believe in in
progress we boogieing
right Electric
Boogaloo the booo
boys see they having a good time
man um how is Xcel the good side if the
doomers are right what are the doomers
right about everybody can say Ai and
they can say Doom okay what exactly how
exactly does AI lead to Doom I was
trying to get owski to explain it and
it's just like converging endpoint you
know what elsea convergent endpoint is
the heat death of the universe okay the
heat death of the universe is coming and
if we have any chance of answering the
last question we need AI So currently we
are on a trajectory to Doom I want
everybody to remember that you know some
people have those clocks that like how
long you have in your lifespan well how
long do we have before the heat death of
the
universe right right I got to stop
saying that I got to stop saying that I
got to stop my verbal ticks it's
2024 uh I think it's more than a few
billion years but the heat death of the
universe is coming and in order to beat
the heat death of the universe we need
we need AI maybe maybe you can't beat
the heat death of the universe we don't
really
know
AI leads to Doom when the government
uses autonomous
RoboCop with all technology there's
challenges with every technology in the
past with all this new surveillance
technology that now exists there are
challenges is AI a pure unalloyed good
no is technology a pure unalloyed good
when you have a gun pointed at your head
you do not think technology is a pure
unalloyed good but on balance is
technology good and the answer is I
think
obviously with things like HVAC and
cheap food and cars and look like I I I
flew I just flew on Jet Blue from New
York right I could talk shit about Jet
Blue but imagine flying in that like
right flyer twoo at least that was on
was on
a321 um I'm against progress of
Technology they no longer provide
benefits no that's not
true we are
unfortunately like you've been scammed
by a group of people for the last 50
years the reason things have gotten
worse is largely not because of
technology I also just listened to Corey
docto on on uh on uh I think Jim rut's
podcast and like we have been scammed
largely through government inaction
against these tech companies I still
someone in the comments like George you
don't even know you can download other
browsers for
iOS I just when someone says something
like that I want you to think I want you
to think do I not know how browsers work
on iOS or are you wrong when you
download Chrome on iOS it uses a web
view which is actually just Safari
because nothing else on iOS is allowed
to Mark pages
rwx rwx is a permission built into the
kernel that only the jits allowed to
bypass there is a 5% chance I'm out of
date on that information but I don't
think so okay so you think who you
talking to
right um we went from a world where
Microsoft couldn't bundle Internet
Explorer with uh Windows without getting
sued and now we live in a world where
Apple not only bundles Safari but
doesn't let you install anything
else so this is not due to technology
this is due to failure of government
this is due to regulatory
capture technology itself when you think
of Technology don't think of fang think
of a
moset a very simplistic model of a moset
you put in a little current here and
massive currents flow here it's a
switch and that has
changed that's why everything's so small
and good now you have a phone that can
charge I got I got my phone charger
around here 67 Watts putting 67 watts
into something this big you think you
can do that without MOS fats you can use
a
Transformer so everybody don't think of
fang when you think of Technology think
of the mosat
all right it's for iOS not for the Mac
yeah for the Mac you actually can
install different web
browsers thank you for watching today's
stream it's the end of
2023 uh make sure you're having a good
time if you're not having a good time if
you're if you're if you're angry you're
probably over here and might I consider
switching to the you know what the P
stands for it stands for party you're
joining you're joining the party side
happy 202 for everybody have a great New
Year's unalloyed Tech
optimism someone's got to solve this
someone's got to solve this let's let's
let's create an alternative to this that
can produce real liberal art Scholars
who can solve the meaning crisis I'm not
smart enough to come up with it but I'm
smart enough to read it and understand
it so I would appreciate that uh if you
were out there uh Happy New Year
everybody
one
good morning yeah
a reaction to Aid
uh we watched as a team last night uh I
just thought you know I have some
commentary that might be worth adding uh
we're going to be watching it in 1.5 x
speed I'm going to be answering your
questions that all the questions the
Tesla didn't
uh
uh uh hang on I gotta pop out chat yes
there I just wanted I'll put that at the
bottom we're talking okay I'll wait for
a few people to get in here and then
we'll start this video uh it's number
three I'm trending so you know we we
always like to hop on Trends and
bandwagons and that's why we copied Elon
Musk when we said we were going to build
uh some bodies uh no that's a joke
um I think I said it first but uh so
first off you know sometimes we get a
little disrespectful on this channel uh
you know we get a little disrespectful
I've been playing a chess all morning
and I'm like bitch I took your queen
that's right bitch you know I got a
queen and you don't right like you know
sometimes we get a little disrespectful
but I just wanna I wanna preface this by
saying no disrespect tons of respect for
what Tesla's doing uh all criticism is
uh designed to make everybody in the
world better because I want to live
forever in virtual reality with my AI
girlfriend
uh you know Elon wants to go to Mars I
want to live forever Universal reality
with my girlfriend you know I think the
depths of the Mind are are unbelievable
I don't want to be in a spaceship too so
nobody can fuck with me man because if
you're on Earth people are gonna come
fuck with you people with like armies
and nukes and critical theory uh yeah
that's right uh you got you got to shut
off the information too bro
hello hello hello welcome welcome all
right we're going to be watching AI day
together uh so let's go here no no I'm
not that no no no no no no no yes okay
uh so I watched this last night
uh with the team so let's watch and
we'll give some commentary
in the Fremont Factory as well I wish
they gave chapters I'm just gonna say
probably a little too fast I don't know
maybe we'll watch our normal speed we'll
jump around
as as you know last year it was just a
person in a robot Pursuit
but uh we've come a long way and that's
uh
you know compared to that it's going to
be very impressive
and um
we're going to talk about uh the
advancements in AI or wholesale thriving
oh it's too quiet how they apply to more
generally AI problems it's because
Mike's down here
all right so like I said you know no uh
wait wait wait I want this on top how do
I always on top I don't know how to do
that
all right and um I think actually tells
us a good entity to do it from a
Governor's standpoint because we're a
publicly created company we're one class
of stuff oh did I already miss the thing
yeah I thought this was very
cringe-worthy commentary
uh about the the public governance Elon
stop listening to your PR people their
link
oh
bro why are you wearing a mask bro
you know they don't do anything to
prevent the spread of respiratory
viruses
uh I'm a big I'm a big fan of Elon uh I
think that you know look there's not
many good people left in the world I
think there's a lot of scumbags out
there and I think Yvonne is not one of
them uh I think you might do some scummy
things but I think overall his heart's
in the right place and he has a heart
which is a lot more than you can say for
you know people like Axel Knicks
um Axel Nix is the uh patent troll who's
suing us and you know real life's not
like the movies in the movies whenever
you have an anti-hero they always have
some redeeming quality about themselves
uh this guy and like you know I've
looked into um I looked into his
personal life it's just fucking sad man
you know it's just fucking sad so uh
there's a lot of sad people out there
there's a lot of real losers elon's a
good guy so like I said I mean no
disrespect uh with my commentary uh
foreign
all right wait God how I wish Tesla had
real PR oh my God I hate real PR
and that's another thing this is another
thing we got to respect Mr Elon Musk
because
when he uh
talks it's real
it's not some it's not some bullshit you
know it's not some like well this is a
carefully crafted statement designed to
manipulate the people uh he's just kind
of saying what he wants
um
what makes a loser a loser
uh you know what really you know what
I'll tell you I'll tell you here's the
simplest
it's when somebody
who like forced under truth serum
to talk about themselves says completely
different things from what they say not
under truth Sarah right I think that's
the simplest definition that's a loser
right
um I I think that you know the lots of
things like somebody who like you know
look man I'm not something you know
things ain't great in my life you know
blah blah blah that's not a loser man
the loser is the kind of person who says
one thing but believes another
right and I don't mean like to say oh
well that's just a liar no no no like
there are some Liars or winners some
Liars or losers I mean the person who
projects an identity
that when you look at them deep down if
they were forced to like look at
themselves in a mirror right
there you go all right I think you guys
got it
um yeah
uh welcome to Tesla AI day 2022.
fake fuck yeah that's right
a loser is incapable of not bullshitting
themselves that's right
Optimus robot uh as as you know last
year it was just a person in a robot
suit uh
so Elon says weird stuff about
governance
uh
one little bonus tip for the day this is
actually the first time we try this
robot without any backup support cranes
mechanical mechanisms no cables nothing
yeah
let's see ready okay okay
[Applause]
[Music]
yeah we'll break down here and I'll talk
okay
so let's take a look at this thing
um this is the uh Tesla autopilot
computer uh they go on to explain that
these are off the shelf actuators uh
which is definitely a smart move how
impressive is this demonstration right
um so it's
it doesn't move like the Boston Dynamics
robots
[Music]
it moves in a pretty uh non-fluid sort
of way like it was optimized now to be
fair
um Boston Dynamics is Leaps and Bounds
ahead of everybody else in this kind of
stuff
um for reference let's take a look at
how an atlas moves right
uh
um so if you guys haven't seen the
Boston Dynamics videos uh they run a
great YouTube channel uh you know I
don't know much I should say about this
but um they run a great YouTube channel
uh
well so a few things are different so
let's talk about some differences
between uh between Atlas and the uh
Optimus
um so Atlas is hydraulic
uh there's a big hydraulic pump in here
uh and Boston Dynamics has custom
designed valves uh to be able to switch
hydraulic fluid fast enough uh I would
doubt that like Optimus for example can
jump
well yeah so we'll get to what's
impressive is they can build millions of
them
so this is their V1 of the robot um V1
of the robot is built with off-the-shelf
actuators uh but they then go on well
they show these weird demos
which is like they're running like the
autopilot segnat this is a segmentation
oh that's an example buddy a little bit
more
on the thing uh
so here this is there this is their V2
version of it
um they go on to talk about how they
Custom Design all these actuators and
they designed it for manufacturability
which again you see Tesla really taking
the same approach that they've taken
with the cars uh with autopilot that
they've taken with the robot they're
like first let's build the hardware
um Tesla has a lot of very talented
mechanical engineers we're going to come
in and we're going to make a humanoid
robot uh before we can make any software
don't worry about an MVP just uh
let's make the hardware let's ship all
the hardware and we'll figure the
software out later
um now you know I I of course we're
going to show for comma on this stream
uh this is our competitor uh to Optimus
um I mean it you know it has a really
similar functionality
um
uh
uh we also have one with a knee
um
so people people thought that the comma
body was a an April Fool's joke and it's
definitely not
um the color body is a minimum viable
product right uh actually I would argue
even argue that you might need a little
bit more so this is the comma body with
a with the knee uh the knee it's a four
degree of Freedom robot if you can't
make a comma body with a knee do
like amazing stuff it's not worth
investing more time into the hardware
yet um so this is my philosophy on it
Tesla's philosophy is let's just build
the hardware
uh as fast as we possibly can and deal
with the uh deal with the software later
so you know here's my here's my
competitor
um they are even cheaper to build uh
Tesla talks about how Optimus is going
to cost under twenty thousand dollars uh
the body is of course for sale for 9.99
right now on kamabody.com
um now I mean the body again is kind of
a
like the same thing I say that
self-driving cars are all a software
problem robotics is all a software
problem as well you can build things I
think that have very very few actuators
that look incredible in fact we'll go to
Boston Dynamics to prove this point okay
so uh Atlas is a very sophisticated
robot that has many degrees of freedom
but if we get over here you'll see this
row back here uh so I believe Boston
Dynamics calls it handle uh handle does
not have many degrees of freedom at all
I think it has one two three four five
maybe six
and your luck and I want you to look at
handle
now look at that robot look at that
robot dancing
that robot to me looks far more lifelike
than the Optimus uh demonstration right
which you know again I'm making the same
claim that robotics is all about
software in the same way self-driving is
right
um so if you can't write incredible
software for something like Optimus uh
why bother building something more
advanced
uh no yeah Tesla's a different approach
uh up sorry
I gotta remember that my camera's here
but yeah this thing
look at this robot back here it has
almost no degrees of freedom yet it
moves so fluidly
right you almost want to dance along
with the robots right look at the look
at the Pixar lamp
how many degrees of freedom does this
lamp have
how incredible
right the lamp looks so lifelike and
again I'm saying that what what makes
things lifelike has nothing to do with
the hardware and almost everything to do
with the software
it's robot uh
so again well let's look it up I'm just
walking all right
the Pixar's in the lead right I mean
it's it's rendered obviously uh okay
coming in hot
uh we need to do this in the right way
we need to do it
we spend a lot of time thinking about it
okay so this is actually
um referring to the human uh 73
kilograms is about what I weigh so I was
pretty happy about this uh this is they
talk about their latest generation uh
the battery pack is 2.3 kilowatt hours
uh the comma body has a 100 watt hour uh
battery pack for reference
um the bot brain is very similar of
course on the common body we have a a
comma three uh they decided to reuse
their autopilot computer as well
um 28 structural actuators and 11 degree
of Freedom hands again they talk about
these these super sophisticated hands
and like it's cool but
I think that it's Overkill right when
you look at nature when you look at uh
you know uh maybe to quote uh Mr David
Foster Wallace consider the lobster
uh you know lobsters have hands too
uh
a little bit about our structural
Foundation
miles per hour time yeah yeah they talk
about how they're doing like these
mechanical simulations and they look
really cool I mean I wonder what
software they're using for this
this is incredible CAD software they go
on to show they're doing the same thing
when they crash the cars starting a
heavy Outlet
um
we're also trying to find ways to
so
like again
come has approach to robotics is isn't
it
um Khan's approach to robotics is is not
uh
well I'll show you
um there's a there's a thing from
Berkeley
uh
it's called learning to walk into it I
walk in the park right
um so Berkeley used uh reinforcement
learning demonstrated
over 20 minutes it's completely
untrained but it's given the goal of
hiking up this Trail the robot explores
by moving its legs observing how its
actions affect its movement
with this feedback the robot quickly
learns how to coordinate its movements
into a naturalistic walking gate while
it makes progress up the hill and
encounters New Challenges it's able to
learn from its experience and adapt its
Newfound skill accordingly
here in just about 10 minutes the robot
is able to walk up so I think continuing
on this sort of research is much more
profitable than the approach that uh
that Tesla's taking
because the problem uh I mean I'm not
talking about the hardware all right and
again again here's my disclaimer a lot
of respect for what Tesla's doing uh
this is just where I think that uh maybe
it's uh let's just say not what I would
do and you guys can agree or not
so
look at this here pelvis unlock arm sway
probably what they're doing here is
they're putting this maneuver into like
a like a model predictive control style
controller uh so I have a blog post
where I go into like how we thought
about this
here's here's a here's a combo body with
a knee uh and
you run into this problem like nobody
doubts that we could make a model and
write NPC to control it we could
probably also build a simulation
environment even do RL in the simulation
the words reinforcement learning are not
said once in the entire Tesla AI Day
presentation right this is where they're
they're you know they're making a model
and writing NPC to control it uh but
what happens when we encounter a bump
gravel snow a human trying to knock it
over banana peel did you put all those
things in your simulator right and this
is even assuming like an RL style
simulation approach you're not doing an
RL style simulation approach
um here's a fun thing Alex is
unfortunately out otherwise we'd have
her here to help me demonstrate
um
when when someone comes at you to knock
you over right you're ready for it
you're ready for it right you you can
you you predict that they're about to
knock you over and you apply the counter
Force before they do which is why you
know like the butt of a lot of jokes is
like to psych someone out you know come
right up on them and then they uh they
over correct and actually uh
fall into you
um but how are you ever going to get
that behavior to be emergent
uh like how are you sorry how are you
ever gonna like hard code that behavior
you're gonna have to have an
understanding of everything in the world
so I mean my thought is that you need to
have on-device learning and nothing in
the in the Tesla presentation remotely
talks about this
um so I think this is the kind of stuff
they're gonna have to change uh if they
want their software to
like actually be good
um
self-driving is right on the level where
we all still think well some people in
the world think it can be hand coded a
comma obviously doesn't
but it might be possible to hand code
cooking and cleaning are way more
complicated or even like assisting in
the factory and stuff
um okay so Tesla talks about yeah really
designing this thing for mass production
the num they go into like the number of
actuators how to do the actuator design
really cool stuff super fancy mechanical
engineering and unlike Boston Dynamics I
love the emphasis on design for
manufacturability
um Boston Dynamics most of the parts the
parts in Atlas for example are made of
3D printed metal
the parts cost an enormous amount of
money each Atlas is on the cost scale of
a waymo car uh whereas Tesla's talking
about twenty thousand dollars and I
think that would be really awesome and
if I were Tesla what I would do is I
would you know I would open it up right
like except that you're good at the
mechanics and not good at the software
and uh you know just start selling them
um you think predicting the velocity of
each box only occupancing that no no
this is such dumb stuff and we'll get
there we'll get there okay all right
here in this video
should we again we got to this point as
well we're like should we start should
we adapt our our training stack to the
body and like eventually we will and
some of the stuff transfers pretty well
on like the pose net transfers pretty
well
but again we run into
if you think driving has a difficult uh
reward function the the reward function
for cooking and cleaning is is way way
harder because there's so many different
paths you can go through in the space to
get there
um
that was just what do you mean we're not
gonna have something else's you know run
up on some talibans in Iraq you know
uh
God you know what the most boring shit
is when people talk about like why we
need robots or why we don't need robots
who the fuck cares man I'm here to build
robots bro
I think I asked me that once and you
know that's one of the answers like
people are like you know this is going
to be a great answer like like well
George what are you gonna do about all
the people who lose their jobs and like
like bro
I build technology
I'm not a politician that's their
problem right now if you think you're
going to stop me if you think you're
going to be a politician and stop me may
I just remind you China
that's right
um so don't stop technology that never
wins man that never wins you know but
it's always loose it's kind of
interesting a lot of night's always
loose and there have been a lot I'd
since forever man I'm sure oh man I'm
sure the whinging about the printing
press well the Monk those are gonna be
out of a job
um
all right
uh so just to go over what actually
happened here if you guys would watch it
this is uh Tesla using basically the
same cameras uh and the same computer
that they use in autopilot on the body
uh on Optimus and uh this is the
segmentation Network free space
different objects same idea
um Warner Von Braun that guy is a boss
man that guy's a boss you know he's a
Nazi rocket scientist for the Nazis
right and you know we we came over there
we got kicked their ass and then uh we
go to the guy and we're like bro
um we're gonna give you two choices
right either uh you know uh come build
Nazis for a company rockets for America
or um go to prison for life
and he's like bro to be honest man I
never cared about the Nazi shit I just
like building Rockets
that's my guy you know you know and of
course he went on to lead the Saturn V
which was the only good rocket NASA ever
built uh
I don't care I never really cared about
the Nazi shit I just liked building
Rockets
oh I hate that I hate that they're
always trying to inject their own what
do you put your statement your your
ethics statement and all papers if you
want them to get published in
conferences like nurips which can't be
called nips because that's a little too
close to tits man uh
homie really came out in the chat now
look build some awesome Rockets man you
know you want to build awesome Rockets
you gotta come to America man
um don't build the rockets for the uh
yeah
we also trying to find ways to improve
the documentary networks um using work
made on your Radiance field to get okay
and our representation
uh okay so they they talk about how they
did it here
um
they talk about building a uh
very complicated model updating the
model based on sensors right so this is
classic like model predictive control
stuff
um
yeah
uh you can see they have their
trajectories all in a simulator so you
can build you can build simulators um
mujoku uh well it's actually bought an
Open Source by deepmind good on deepmind
I'm very smart of them uh
it's very smart of them actually let me
explain why it's very smart even if
you're deep mine you're completely
selfish right so this is this is a this
is a general perfect physics engine that
aims to facilitate research and
development robotics biomechanics
Graphics blah blah blah
the reason you open source it is because
you want people to use it
such that it gets better papers are
published on it and people are basically
working for you for free when they
publish mojoku stuff right if we all use
the same framework we can all move
faster and by open sourcing it you don't
you have people who are like well I
don't want to use my Joko it's called
Source now you don't have that problem
anymore right like people are worried oh
what if I need to add a feature even if
these worries are unfounded and they
won't ever have to
it it makes companies feel more okay
with this right and this is by the way
why open pilot is MIT and on GPL I think
that intellectual property holds the
world back
and GPL is a form of intellectual
property right copy left is copyright
uh so all these things if you just open
source it if you can get other people to
use it they're going to make it better
and you end up winning from that
um
so uh yeah this is the mojoku is um
uh
might even be what this is or maybe
Tesla has their own stuff for this
and these rough introductions through a
trajectory optimization program which
solves for where the hand should be how
the world what's gazebo Ross
uh
simulation
yeah I mean there's a bunch of I don't
know I found a whole Russian ecosystem
so like
I mean open pilot is basically Ross 2.0
I found the Ross ecosystem to be very
heavyweight a lot of non-invented here
stuff like they invented their own
serialization format their own message
passing thing we actually did end up
writing on message passing thing too but
uh for different reasons like we have
zmq as well we support both
um
you guys know where Ross comes from
right it was a company Willow garage
back in the day
uh and it's interesting that Ross ended
up Surviving by the way I was sad to
hear
uh Kitty Hawk shutdown
um
I was sad to hear that I don't really
understand why
I think that
this kind of thing is exactly what you
want to build
um a small plane that can do vital uh
electric planes can be so much safer
right your your engines aren't going to
stall
um your plane's not going to stall and
control flight into terrain you actually
will be able to like turn on a dime okay
if each one of those things is like a
brushless motor uh so yeah okay back to
the back of your video
um
but um I don't know about you but after
seeing what we're showing tonight I'm
pretty sure we don't get this done
within the next few months for years
um and uh reality and change the entire
economy um so I would like to thank you
to your Optimus team for the hard work
over the past few months I think it's
pretty amazing all of this was done in
barely six or eight months thank you
very much I don't understand why someone
would want to fund this this thing's
electric like that's amazing
uh oh you know what I don't like this
though I don't like that they were
trying to uh do autonomous don't do
autonomous just make a sick electric
plane that that people can fly
um vital
like so cool
I I'd fly this over to my land
uh of a lumps the taxes on it that's
cool man
hey everyone
um
so a shark said several things goes on
to say several things in this
presentation that show that Tesla does
not believe in India
um I think one of the most telling
comments Susan he talked about
Foundation models for uh geometry and
physics
and I believe that misunderstands the
way the word foundation model is used
but we'll we'll get to that um let's go
through this stuff okay so this is this
is Tesla's uh stack if you want to
compare it to ours
um so if you guys don't know we did
something called Comic-Con
uh
uh these are not that easy to find
uh
uh
foreign
uh actually you know what I think we
have a blog post
by the way you know we got we do blog
posts for uh yeah album pilot working
around Okay so so this is this is a
pilot
um these are the the different services
so I think this is a little bit more in
depth than the uh
then then Tesla's uh thing
yeah I mean Tesla's kind of mix
more sense it's it's that uh it's at a
higher level uh
but okay I mean maybe maybe it actually
looks more like this right
um so these are the these are the loops
inside openpilot these are the loops
inside uh inside Tesla
uh so
if note a few things first off they're a
box called neural networks does not
extend around planning
um their neural networks are just
outputting occupancy and lanes and
objects and I find the occupancy stuff
really funny
um do you know what they built do you
know what the occupancy net is who knows
what it is
who knows who who can come up with it
with a word for basically what that
thing is
do you get points well it uses a camera
that's right but Waymon Crews have these
things no no no lidar exactly first time
talker Tesla built a lidar despite Elon
going and talking about how Tesla
doesn't need a lighter Tesla doesn't
need a lighter which is absolutely right
he then goes on to build something that
looks a hell of a lot like lidar uh and
no this is raw there is no occupancy net
in your brain if your brain is queried
it can answer that question but this is
not how your brain is doing it
all right so they got a AI compiler
influence AI compiler and inference by
the way
I'm particularly proud of this
um if you go to comma AI open pilot
guess what we use for AI compiler and
influence now
tiny grad
we've moved we've moved from qualcomm's
snpe to Tiny grad as part of our move
off of Qualcomm it's a long and slow
move off of Qualcomm we're going to
basically build comma 3s for like two
more years uh but then in two years I'd
like to see what socs we have available
uh Qualcomm unfortunately
they're not as bad as in video but uh
you run into all the same problems these
these companies have
uh sales processes that are unbelievable
I do not understand why they don't just
sell chips and they're gonna lose to the
Chinese that don't
why would you want to move off Qualcomm
because good luck talking to them I I I
now I wrote a second email to the CEO I
wrote a first name of the CEO someone
actually heard it and he sent an email
to VPS sales to try to make things
better I talked to this guy he was like
okay things are going to get better it
took a month to get a quote
and the thing that they sent wasn't even
a quote didn't have lead times it didn't
have quantities it was just like it was
a number
um you just you can't buy chips in these
people this is after a two-month ordeal
where a sales guy basically lied to us
about these chips existing and then he
was on the call with the VP and got
scolded it was
I just cannot believe
the companies are coasting on on on
fumes these companies are coasting on
past successes and they should have in
the same Market they would have
collapsed a long time ago I mean you
know let's hope they don't kill 500
people like Bowen with the 737 Max right
I know I know I know no I used to look I
tried I I really we we put in a lot of
effort with Qualcomm
um we I give up we're just gonna buy
Psalms and then we're gonna figure out
how to move to something else there's
some chance we're even gonna make a chip
a very interesting person reached out to
me yesterday
uh who's also interested in making chips
and um
no we're still using we're still using
Qualcomm for now uh through an
intermediary we're not buying chips
directly from Qualcomm we're buying soms
uh there's two companies that make these
Psalms Thunder common crack towel and
you can just buy them uh but yeah no I'm
really hoping that in two years
Qualcomm is going to lose
uh robotics they're going to lose AI
uh they're just gonna lose like I I
tried I tried I tried to help him man uh
and they're like you know what don't
listen to me fine you know what don't
listen to me uh you see but here's the
difference between me and the other
startup guys right the other startup
guys are probably thinking the same
thing but they're not going to tell it
to you they're going to be nice and
diplomatic I'm just gonna you know tell
it like it is I had I don't have time to
be so here's the thing but in video
right there's two in videos there's High
stock price Nvidia and low stock price
and video right so um this was an era of
hot oh yeah oh you can't even I really
want this on a log scale back here in
video man I Jensen wrote in the first
comic-car like he was a bro man like he
was really cool
um then Nvidia had a big stock run up
and then here they were dicks
and then their stock crashed and then
they were nice again
and then
even though we're fitting like 4X more
transistors on a die we've only like
halved the switching energy of them so
the power usage of the chip goes up
ah
cool
all right let's go got any computer
interpreted within the same for cell
driving computer to make this possible
we have to keep the title control on the
end-to-end latency of this new system
30. more advanced scheduling code across
the full HD platform
all of these neural networks running in
the car to get that produce the vector
space which is again be more logical uh
Moore's Law is dead yeah so it's it's
sadder than this so we are getting these
like okay I mean you can argue that it
depends what you mean by Moore's Law
right
um dinard scaling which made the
frequency of the chips go faster stopped
in like 2006. uh
uh no capacity no longer works at Tesla
um you can check out his Twitter from
last night it was pretty entertaining uh
Moore's law in terms of frequency
scaling stopped in 2006. Moore's Law is
continuing in terms of transistors per
square millimeter this is true but the
cost of the new Wafers has gone up
because the number of steps is going up
the number of steps required to produce
new Wafers is way more than the steps
required to produce the previous wafer
so they have to charge more money for
them
um we have not seen uh
commiserate
commiserate I don't know the word we've
not seen equal advances in in workplace
efficiency to allow more processes to
cost the same amount so let's see if we
can find this like cost per wafer uh
nanometer tsmc
here
um yeah
so yeah Moore's Law is is dead
uh this is the the cost per wafer
the sale price per chip
that I don't really understand but uh
yeah they
are
uh you're sending a message so I put on
sub mode
frequency scaling has had a resurgency
lately no it has not not even close man
you know we were we were all
overclocking Penny and fours to five
gigahertz back in 2006. I know the
Wafers are not bigger the Wafers have
been 300 millimeters for a long time I'm
uh you know
some point in the past they were 200
millimeters
but uh
uh
most chips now are they're they're
alternated
system
or smooth make progress towards the
destination using a combination of model
based optimizations
okay
so this demo here right in front of the
person with a very aggressive
profile now obviously we are being a
joke
we could have moved public slowly short
for a gap between The Pedestrian and the
business on the right again like
they really show this off more later
look at this stuff
like we're sitting there the whole comma
team sitting around watching this stuff
and like okay you wrote Monte Carlo tree
search and like
that's fine
but you're doing this on like a on like
uh
again a a feature space that's hand
engineered
um one of the core beliefs of comma is
that there is no human understandable
feature space for perception
Lane's occupancy moving objects is
always going to be incomplete right
um
for all the reasons that like
you can interpret the difference between
you know a homeless person uh
on the street corner that might jump out
into the street versus a uh
uh you know a a a a a celebrating
businessman right like was that in your
was that in your feature space
um this also none of this talks about
uh occupancy to an extent talks about it
but occlusion runs into a problem right
like if you have an occupancy Network
that says there's Big Trees here well
what's the likelihood of a car behind
the trees right humans have good
understandings of this I don't see how
this kind of stuff does
so yeah uh here we go
uh
uh they do have this thing called a
neural planner
um which is
cool uh I I think they're using it as
more of like a filter if the neural
network assigns a low probability to a
trajectory then uh don't use it
like yeah I mean eventually
you keep you keep doing this you'll
eventually be like well why don't I just
always let the neural network choose
right
so
we use the video feeds from eight
cameras to generate the 3D occupancy of
the world
the foreign
foreign
so yeah something I found odd in this
part they talk here about how they are
putting in the image before debattering
uh my question about that is how are you
getting that image back
did you design a custom compressor or
are you not using a compressor right
this is actually answered later that
they clearly are using your compressor
when they talk about their data
ingestion pipeline so maybe they're
running like four compressors uh one for
each color
right because like normal HVAC and stuff
is not going to work with this this also
gets you nothing
um this idea of like oh we're gonna put
it in the Bayer and then not have to go
through the ISP
yeah okay like I think our ISP ads adds
like two milliseconds of latency it
doesn't really matter
uh
so yeah this is there this is their uh
their their occupancy Network
they're fancy Uh custom lidar thing
uh
um they talk about how much training is
required a huge amount so for reference
commas using 500
000 segments
so comma is currently training on
60 million frames uh a good bit less
than that
um Commerce training on about
it even
if you want to compare this let's say
140 gpus uh so 1000x less and then we
have about a three pay to buy
distributed video cash so that's uh 10x
less
uh here they talk about how to load all
this stuff
they talk about a custom file format
they designed it's cool stuff we have
something similar it's called super
pickle at comma
um accelerated video library we just
wrote this uh and by the way it's clear
here they're using compression right
they have iframes and P frames uh so
they're using compression somehow they
have debared stuff in compression I I
don't really know how that works but we
just did this we just used uh actually
there's a slide that I really like this
one here
um how to get more
uh speed up so we checked we made sure
our iomu is disabled Cuda graph is
really cool oh we gotta check this oh I
don't know if we're using this I'm gonna
go check that we couldn't get more speed
up with channels last but that's
probably just our net uh that I don't
know how to get
release scale on one map copy tensors
um
yeah this is this is a cool cheat sheet
I love seeing Tesla talk about this kind
of stuff
uh
oh yeah okay now they talk about their
layer Lane net where they designed a
custom language for lanes and then
they're using a Transformer on that oh
my God I just I just like all the
engineering that goes into this is
insane you don't need any of this
um end to end is uh is way better can I
explain what settings
uh George I want to explain what those
things are
uh okay hang on
the slide okay um so this is the the the
accelerated video library uh they're
doing uh Hardware decode on the GPU uh
so there's something called Envy Inc
uh and Bianca's nvidia's encoder
blah blah blah uh it's a feature in the
video graphics cards it provides video
encoding and they've decoding too let's
sorry it's called Envy deck is the
decoder
um we actually have in our computers we
have a 30 90 and then we have two t600s
that we're using for uh we have 3080 and
then two t600s uh that we're using for
for decode
um
in uh in some of our computers and we
have like so they're just they're just
basically cards that do nothing more
than decode and do a little bit of uh
transformation
they're nice they fit in one little slot
so we have a whole lot of these in our
in our compute cluster
uh cheapest decoder card you can buy
so
um their final format they talk about uh
uh 4X less logos
why did I read that last night as iops
what's a logos
[Music]
I don't know I read that last night as
iops
uh more iops less iops would make sense
I I could have sworn oh here less iops
oh it's a typo
fine
uh yeah so less iops iops are i o
operations like how many seeks you have
to do on the drive I mean they're ssds
well probably I think Tess is all ssds
we're all ssds uh so iops uh don't uh
matter that much uh but still nice to
have less uh especially if you're going
across the network
uh disable smt
so
so oh okay this is just disabling hyper
threading yeah you don't actually have
to disable it what you can do is you can
just fill half the course uh so what we
do for this is we don't actually yeah we
don't actually disable it we just fill
half the course I think that gets you
most of the gains uh I actually posted
in our channel to make sure the immu is
disabled so the iommu was like if you
have a GPU and you have two like
virtualization containers and you only
want to let some of the virtualization
containers access uh pieces of them
uh you can use an iommu uh supported on
all modern processors
um why is it faster to disable because
you don't have to go through tlb entries
right because otherwise every time you
go to the GPU you're going to have to do
like a look up and like the the tlb and
if you get a tlb Miss you're going to
flock page tables right so if you don't
have a page table uh it's faster uh
let's see if this is are we using this
we should we should post about that
hang on I'm just gonna I'm just gonna
post about this another slack right now
c-u-d-n-n-v8
also from Tesla presentation
uh enabling TV and NBA and avx2
instructions that only matters using the
CPU Cuda graph we're already using that
our codograph lets you it's a lot faster
than pytorch hellfish thank you for
gifting Subs uh use channels last so
there's two formats for tensors you can
use nchw and nhwc uh some people think
it's faster to use channels last like we
tried it if it didn't speed anything up
all right cool so that's that uh that's
my this is my favorite slide in that in
the presentation
uh so yes then they have this whole
custom Lane language I'm very sorry for
all the engineers who had to work on
this like yeah I get it but like oh oh I
don't know I couldn't bring myself to do
it
um you know it's just it's just painful
it's like why is all this stuff being
hand coded
super complex
um
wow 9.8 milliseconds of latency I guess
that's just for the lanes Network uh so
for reference commas networks about 30
milliseconds latency
uh and we're using uh about a watt of
power
okay this talks about their compiler
you've all seen tiny grad you know how
that works
uh how they put it in oh yeah this thing
so they have a they have a thing to
stitch together trips like it looks cool
it basically makes HD Maps
um this is an old levandowski quote
though you do not want to be a map
maintainer like this adds so much
complexity to your ground Roofing stack
you know you asked a question why does
Tesla have Phantom breaking and Phantom
breaking is caused by bugs and ground
truth and the more complicated you make
your ground shoot stack the more bugs
there's going to be so like they showed
this one because it looks good and it's
been hand checked but when I think about
multi-trip reconstruction being run on
huge amounts of data and then not being
carefully observed by a person I bet
it's not good and I bet it's really a
bad choice so we don't do uh any of uh
this kind of stuff yeah well so
interesting about the language model for
Lanes
um
comma's kind of switching I'm trying to
switch to this I'm trying to switch to
uh
it's not exactly language but if you use
a quantized uh
information bottleneck
you can effectively think of the
quantization as like you have the number
of symbols and then your vocabulary and
then that can be treated as a language
right
um the difference between our language
inside the common neural Nets and theirs
is that the one inside the common neural
Nets has no semantic human
understandable meaning right if you want
to extract a meaning from it you have to
use a neural net there is no like you
can't say this symbol means this this
symbol means this this symbol means this
I mean to be honest you can't do this in
the brain either and like this is one of
the biggest misunderstandings about the
way the brain works you think that
because you can talk and you can explain
quote unquote what's going on in your
head that that has anything to do with
the internal representation it doesn't
right but the way that your brain works
is
who knows right if you want to extract
information from it you've got to run a
big neural net
and that's exactly what you're doing
when you talk right
um yeah I mean look a discrete State
space and a and a continuous State space
with gaussian noise and normalized are
the same thing information theoretically
uh you know I'm just not going to
calculate some good information Theory
so like I like that like oh it's got
like wall shit man if I can choose 500
different things and I can choose it
like uh you know 10 times let's say 500
to the 10 man that's like a normal to
the power of all right good
um
talked about
so when you started this track we wanted
to know if you can run this facility uh
they talk about how to make their things
run on their uh
on their chip
um
then they talk a bit about their order
labeling stack and how it's multi-trap
again not what I would do
um this is their simulator that builds
up
uh they talk about their reflected in
the real world
simulator on Market Street and they have
this simulation World creator again cool
stuff but they only show one example
which makes me think it only really
looks good at one example right there on
Market Street and they show this example
the whole time
um so I I don't know how uh good there
uh
their uh stuff is for this okay so you
can look at the size of Tesla's training
set for their segment
um for reference ours is ten thousand
so again this keeps kind of what the
theme of Tesla being 10x larger than
everything comma's doing
uh so this is our comma 10K it's a
little bit more than 10K uh by the way
if you want to help if you want to
contribute uh people are starting to
submit these uh driver monitoring images
um
really cool if we can get all of these
labeled we can ship Lane changes without
confirmation
um these were all submitted by the users
themselves because they're kind of
privacy sensitive so you have to submit
your own
uh I don't like your masking like this
right and this blue mask gives people
movable objects inside the car uh so
this is what Tesla's doing there's
obviously not open source uh ours open
source comma 10K and theirs is about uh
15 20 x big than ours
seems like there's a lot of work to do
with Tesla yeah
um
so this is my favorite part of the
presentation
and probably what I'm well I wouldn't
say at least qualified to speak on why
is the car company building a super
computer for training uh but Dojo looks
JoJo looks amazing
uh they're doing a few things
particularly right I thought this slide
was really cool
this here is their voltage regulator
um so it's on the back of the chip
a thousand uh amp current delivery so if
we look at a 30 90 PCB
this is a 30 90 PCB
you see all this
this is the power delivery for the 3090.
Tesla fits it in this tiny package on
the back of the chip remember the closer
you can put your chips together the
faster signals can move between them
like this is an obvious truth right
um and this stuff really starts to
matter
if you're talking this is about how far
a light goes in the nanosecond right so
if you want to save an nanosecond which
in that a second again you're running it
you're running a couple gigahertz like
that's that's a couple cycles of added
latency As you move the distance apart
right and then think about a GPU and you
have two of them how far you physically
have to go you're just you're just
adding cycles of latency so if you can
put the chips physically closer together
oh they mentioned cooling oh yeah they
go into cooling
um so these are the things they talk
about how their capacitors were
vibrating uh this is their their system
tray
so one of these trays I believe is 25
150 chips
uh supports 54 pay to flops bf16
uh
2 000 amps at 52 volts
so this is a hundred and four kilowatts
um for reference this one thing was
about comma's whole first compute
cluster
uh our new compute cluster is let's say
uh
so now we're going to get 208 times 800.
so our new compute cluster this is yeah
two of these is larger than than comma's
compute cluster
um
so how do you cool 100 kilowatts
user applications land on these hosts so
we can provide them the standard x86
Linux environment
thanks Bill my name is radhe and I'm
going to talk some numbers
this is their Cooling
uh for this one cabinet let's see how
many of these go into a cabinet
they should be inside our cabinet with
one of these
system management
rather than doing what
um standard ID how to play vibrate
a slice of the dojo mesh can be caught
up to run anymore
um but yeah yeah I would I would watch
this whole Dojo thing uh this was my
favorite part of the presentation
It's just sad that Tesla's not open
sourcing this right and the truth is
Tesla might have The Cutting Edge now
but like Google had The Cutting Edge of
like all these infrastructure services
in 2005. even in 2010 uh 2.2 megawatts
was was uh I I don't think it's 2.2
megawatts per cabinet we we did the
rough math last night it's not true
um
Google had all the best infrastructure
in the mid-2000s uh and then they lost
it and then they lost it Google Borg
looked so Antiquated compared to
kubernetes
uh you know even Google like GFS is it's
it's so bad compared to like what S3 and
Azure and stuff are using all these
modern Stacks took over
um actually and Azure don't have their
storage open source but uh kubernetes is
and uh Docker is and they just replaced
all these things that were at Google and
now Google's stuck on these Antiquated
things and that's what happens when you
don't open source Facebook actually
spear had a lot of these these open
source compute projects because
Facebook's like this isn't our
competitive Advantage right our
competitive Advantage is um no no no but
you can't sell it fine you cannot rent
it
uh you cannot set up a cloud it will
never work there are three serious cloud
companies in the world and they are
Amazon Microsoft and Google uh sorry
Tesla you're never going to be a serious
cloud company
um they blew a local Distribution Center
oh that's insane man you know I think
Humanity should use way more power you
know I love using power
standard of living is energy usage
um no I just wish like there's no point
the other huge advantage to open
sourcing this is the same reason you
open source mujoku Engineers are much
happier to use something if they can
Google it there's answers on stack
overflow
uh no not no one man should have all
this power like it's just it's just
holds things back a couple of years
um is all that not open sourcing it does
uh I really like the one where they
showed the inside of the cabinet
see if we can find that blah blah blah
blah blah
no no no no no no no no no no no no no
no
oh yeah um actually here's a funny
they do show it
these can provide Hardware video decoder
support or video Based training
and our user applications
so we can provide them is this Google
Linux environment
now we can put two of these assemblies
into one cabinet oh it is Google
interesting
I didn't know that
Facebook made her dupe
uh
uh wait that's actually really
interesting
Okay Google's trying to correct this
I didn't know this
now is Google using kubernetes
internally
Hadoop was made by Yahoo
okay never mind I'm totally wrong about
this uh
what did Facebook make
the Genesis of the Google was the Google
file system paper
um
yeah well it looks like it wasn't made
by Yahoo or
uh Facebook but they both use it
it was made by this guy
and this guy
oh work to Yahoo all right all right it
was Yahoo all right all right I look
I know nothing don't don't ever believe
anything I say on these streams
um Facebook made react uh you can look
at like Google makes tensorflow Facebook
makes pie Tours Facebook made pie torch
right
this just was made by Facebook
originally developed by meta AI okay
fine let's go Facebook made something
all right good Facebook's done bro you
know what I own metastock I own
metastock and I shell for them oh the
picture I was looking for it's right in
front of me oh man oh hhvm never mind
okay so each one of these cabinets is
200 kilowatts this is 100 kilowatts each
so you have two of these computers and I
think these things are power supplies
uh I met as trash no man the man versus
the future man
uh yeah it's a lot of juice uh how are
we doing on viewers I can't see the
viewers here
7 41 all right not too bad
uh
Facebook's go with open source in
general I agree you know Tesla's not
it's sad they don't open source any of
this stuff and I don't really know why
supplies that do direct conversion of
three phase 480 volt AC power the fact
32 volt DC half
another one standard paper uh then they
talk about their compiler oh this was a
cool they show their reduce
dye level reduction followed by global
reduction towards the middle of the time
then the reduced value broadcast evading
from the middle accelerated by the
Hardware's podcast facility
this operation takes only that's cool
the dojo can function is a boat
it's really good
uh all right cool
and then people ask questions
what do you mean in video it's just a
lot of stuff uh Nvidia
again
uh Nvidia also open source their driver
Nvidia is stealing
ah this stuff yeah these are cool
uh
cuda's closed that's true
they cost them in the long run
I think it does not have to overs with
the driver because they got hacked ATI
open source their driver first
uh what do I think about AI art uh you
know you know
ah Alex said she watched uh an interview
with him uh this guy's a boss
uh
you know I just I just love it I just
love seeing seeing one man uh
destroy opening eyes business model
where we're gonna train models and then
we're gonna
get his dumb but we're not gonna let the
pope paint make things like Pakistani
airline pilot even though that's totally
not racist what the fuck man
um you mad the Giga chat that's right
that's right
uh I know right
uh yes Nvidia yeah uh our dna3 is
chiplet uh Nvidia is not chiplet Nvidia
is still making big chunk and big big
big chunker chips
um
not your subscriber I'll click this link
don't make me regret it bro
I regret it bro why the fuck did I click
that
foreign
[Laughter]
link one link and I'm like oh click this
oh it's probably something good that
adds value nope nope nope
um what's been trending Tesla I die or
that picture
uh
uh all right cool
that's Tesla I day uh what else you guys
want to talk about
may I just didn't really talk about
enough how stupid like all this
hand-coded stuff is it's
it's we're so close guys we're so close
uh what I do is stream with shkreli I've
never met him uh so probably not uh
but I didn't hang out if Scarlett wants
to hang out next time I'm in New York
like let's chill man
um
I don't know what his streams are like
oh if carpathy ever wants to do a stream
uh happy to do it
uh
do I think they'll attract the talent
they're looking for
again I guess we didn't really watch it
because it's long I think that until I
think Elon has some very serious
misunderstandings about like
what AI is
and carpathy did not have these
misunderstandings
um carpathy
really understood it and it was so nice
to see him on stage at the presentation
saying stuff that like made sense versus
presenting stuff like language of lanes
it's it's the wrong call
um the destiny call out that's another
guy I'm never debating fucking Destiny I
don't know who that is I'm sure he's a
nice guy I'm never debating him you only
lose man it's like debating creationists
man
like debating creationists
uh
uh you give any fucks about jailbreaking
these days nope nope zero
uh I'm not saying fuck Destiny I'm not
trying to diss the guy you know I think
this is how you get started man oh you
know what you know what I should I
should I should I come out with uh you
know it's like come out with us I've
been working on should I have a diss
track for the you know the the guy who's
suing me Axel Nick should I should I
diss him man I found some brutal stuff
out about him oh I got some I got some I
got some I got some ammo for diss track
and check this out California
illegal to use rap in court
uh not rape uh rap
in court
yeah yeah new California law limits the
use of rap lyrics and evidence so if I
verbally murder this guy
um let's just say uh there's a
California law limiting the use of rap
lyrics as evidence in court cases
bro bro bro bro like you know like like
what if I went on his daughter and said
you know like 16 man like I'll buy her
only fans in two years you know like
that kind of shit man like how would you
feel bro how would you fucking feel uh
and drop the check make it an
international War crime bro
too bad I don't seem good at rapping bro
let's go right now let's go rap battle
right now
uh
I am a famous rapper on SoundCloud
um
okay
love your enemy make a rap song about
how much you love him good point good
point good point you guys ever see the
Pats stay rest in peace Roan I can't
believe Patsy is dead by the way
compliment battle
ew Facebook
why do I own this stock
I mean not to mention how long you could
laugh with her I'd sneak in your room
peeking out through the closet watching
and smashing her come out applauding you
afterwards and go home not even mad at
her dog I'd be proud of her
[Applause]
how do you like
that how you like that
hey a little
because I was drunken in beholded
manners
fucking archaeologists were compliments
your house for you were pretended to be
your father I'd beep and all I mean just
a thought of you being honor it'd be an
honor
fucking archaeologist
[Applause]
GPA highest Mark you can get your
fucking smartest shit
you said some pretty nice stuff have
fond of him but even Sobe's brand said
there's no comparing our compliments
yeah bro
ah
rest in peace past night all right
they ain't gonna arrest Stephen King for
his words
sounds so aggressive but so wholesome at
the same time
no I found some real sad stuff about the
guy like it's just like what do you do
man like I don't want to fight with this
guy why you know I never fucked with you
why would you fuck with me knowing I
could wrap circles around you what you
nuts is me
I'm probably playing guitar better and I
never touched a string
um bars now this is Eminem Man Eminem
dissing Everlast you know
you know oh
um nah yo man all right that's it thank
you for watching Tesla AI day
bro I just like like what would you even
do you're a 51 year old man and and like
the like company that you're suing the
president of the company comes out with
a rap song dissing you I just that's you
gotta be unpredictable if there's a meta
you gotta Escape The Meta this is good
general advice for life right like
there's a meta they expect you to do man
like going to college right
that's the meta and then like while I'm
a drop out of college right and that's
the meta how do you avoid the meta
entirely
that's how you win
and then coming back bringing the stream
full circle the way that you don't be a
loser is you own it whatever it is you
do in life you own it you could give me
something that would make me a hundred
percent truthful and I'd be saying the
exact same shit I'm saying now
and you know what it doesn't mean I'm
always right it just means I'm always
honest with myself
that's how to not be a loser 101. no no
I'm not saying maybe the meta now is to
go to college I don't know man that's
the thing about the meta it's always
evolving
don't don't
be yourself man isn't that good advice
be yourself
life tips which were short meta I can't
believe I fucking bought Matt I lost
money Bros I lost money don't ever don't
ever listen to me for stock advice don't
ever listen to me for talk advice
um
take the meds that's the meta that's
right that's right off his meds nah on
his meds bro that's the meta
oh
uh when did I buy it at
all right we were supposed to watch the
AI thing I don't know I I don't know I
was streaming I'm like why'd I stream
today man why'd I stream today uh why do
I stream all right
uh anyone of anything good to say I'll
give you guys two more minutes to say
something good
should double down and get call options
you know what they call that being they
call that putting money into a losing
pot
um rust why it sucks oh my God all right
never mind see this is boring so you
always got to escape the meta
you just gotta Escape The Meta and then
do I even talk about Escaping The Meta
what how do you escape the Meta Meta man
you love acid all right all right good
for you bro good for you
um
AMD Rock um talk about it bro
all right
Escape The Meta by joining The Meta bro
I don't know I mean thoughts I gave you
my thoughts I don't know like I think
it's cool Elon should open source that
metaculus estimates a 13 chance of
nuclear war who bet on that
I'm not even saying that that's right or
wrong I'm just saying who would bet on
that because your money is going to be
worth a lot less if there's no nuclear
war you win if there's nuclear war oh oh
it was a nuclear war and we all died but
I claim to buy metaculous shares right
see that's the problem with bettinger
that's the problem with with prediction
markets affecting the real world
oh how do you escape the meta be the
meta who blew up the Nordstrom pipes for
all I don't know
I don't know man but
life sucks right now you know I kind of
agree with this life kind of does suck
right now
all right it's just you know I'm a fan
of the recession you know I'm so excited
for the recession can't wait till Axel
Nix goes bankrupt and can't afford his
Porsche anymore oh that'll be oh man
that'll be nice it's foreclose this
fucking house no look look look look
look uh no we're done we're done we're
done talking about him we're done we're
done we're done
we're done uh man
uh
yo
was that bad I made with Carmike I
didn't take the bat
um CarMax bet against boots on Mars by
2030. I agreed with him I didn't take
that bet against them
uh uh you hope for nuclear war
I don't know is it really gonna fix
things
if we had nuclear war tomorrow would
like all the morons be like you know
what guys you were right cloth masks
don't do anything to prevent the spread
of respiratory disease everybody knew
this in 2019 and then Little World went
crazy but after this nuclear war we're
all going to be saying again is that
what would happen
um I don't think it would fix anything
and that's the sad truth of it right
like
when yours here's here's
nah they never admit they're wrong and
of course they never admit they're wrong
like I said it's it's like it's like
Axel Knicks man like the man has no
redeeming qualities
you just need to beat them
like there's not even a point in dissing
them
right it's just like you just beat him
in court
right and that's all you can really do
and I I guess that's all you can really
do with these people too like there's no
point in dissing up there's no point you
know you know what like whenever you
have like the like Ben Shapiro Stephen
Crowder kind of people like bro you're
the controlled opposition man
like
like this is not you're not opposing
this you're you're you're profiting
office you're you're in the meta you got
to escape the meta
um
you believe that the world is much
better than we make it out to be
it's part of the show it's part of the
show there we go that's right
um
coldness do stop you from licking a
doorknob that's a good point was that a
problem before covert
uh
uh
these Teslas and patenting everything
they do I mean most of these big
companies don't actually you're not
going to get sued by patents for patents
on like
you gotta trust me the large companies
are not going around patent trolling
startups
when you hear about patent lawsuits
occasionally you'll get like a big
patent troll like Oracle versus Google
um
but Palmer Lucky's the man yeah yeah uh
Parma Lucky's cool
no there's some good people out there
man
it's just here's here's
like what seems to be the thing like it
just
everything requires this sort of
organizational ability
and this organizational ability is
this is all the professional managerial
class can actually do
but it turns out to be the key ability
to have power
this is what governments look like too
you know
I'll use a hacking analogy right like
at my height
but at my Peak I could probably develop
exploits better than the entire NSA put
together but this doesn't matter
right
like if the NSA put together a CTF team
I probably could beat them right I one
sacked you inside solo 2014.
um and I would say this like is like a
like a bragging thing I say it is like
an actual factual thing and then I'll
tell you why it doesn't matter
right
you can come up with better exploits to
hack into someone's computer
but what's your persistent stuff look
like
they have persistent Stacks that they've
developed for 20 years
and they will just grind they will
outgrind you and they will beat you
like
you know it's not even about
and this is why it's it's it's it's
hopeless against these people
oh oh yo yo yo yo when Elon was like
what work did you do this week oh my God
bro uh barack's such a loser uh
laughs
bro
oh my God and then without that article
on the Atlantic this is why Tech Bros
don't deserve your respect for something
oh
bad I don't know you know guys are we
the bubble or who's the bubble are we
the bubbler are they the bubble
cry hack into the computer of someone in
chat ban timeout that guy just time them
out
time them out
how do you stay in control of the asset
right are we the bad guys oh thank you
for timing him out I like that I like
that I feel powerful
um
yeah the open source protocol stuff too
bad Jack dorsey's a Bitcoin maximalist I
mean you know what to be fair Bitcoin
maximalists can enjoy their Resurgence
now that the merge stocks in ethereum is
worthless
uh
the guy timed out kind of escaped The
Meta but no one got it yeah you got
timed out man that's what you get for
going against the grain you should
conform more that's right
[Laughter]
uh
George new based Elon sauce cops called
do you think someone can build a new
Twitter yeah but like I don't think it
matters right unless they the
and he's here um ethereum Mev OPAC
here we go
uh no there's some like
there's some like block
ethermine stopped including tornado cash
transactions right like they're
literally censoring transactions on the
ethereum network now
um right here Mev wash this is that
so like this is sad
it's many of the blocks are censored
right uh uh I read an interesting
Twitter Thread about how Sam FTX is a is
a government
uh his parents are Harvard professors
like
you know you can't beat them man you
can't beat them
how are they censored what 26 of
ethereum blocks will not include certain
transactions they censor
or any crypto safe Monero what do you
mean the government's gonna come after
Monero right after they come after
tornado cash do you think Monero is any
better
[Laughter]
um
what
should do another Lex Friedman podcast
to be honest what would I talk about
what would I talk about guys
the Fatal flaw was that they thought
they could escape the government you
know
remember remember when we all listened
to the decline on the stream and then
the line Why Try to beat them when a
million others tried
the FED made the internet it was all
enough bro it was all enough
it was on up
thoughts on whisper well good on uh
oh I could talk about how wokeness this
is destroying oh my God
let me tell you where wokeness comes
from right no one's gonna tell you this
like
I I hate the people who think that this
woken of shit is like a small contingent
of well it's a small contingent of
college professors that come from the
Frankfurt School of critical theory and
you know they're trying to push a
communist agenda none of this is true
guys
right and again this is your your your
opposition and I'm not saying the
weakness shit is good I'm just saying if
you want to understand how to really
oppose it you know that's not the way to
oppose it
you the only way to oppose the wokeness
is to have a positive vision for the
future
and our society's gotten into such a
place where people don't see positive
some games as possible Right wokeness is
strictly a zero sum or even negative sum
game right all all of these these these
power moves that these people are doing
you can look at what it is but look at
like the diversity canoe from uh
like the professor the Brett Weinstein
and like you know you just see this
you're like oh
okay I get what this is right this is
this is maybe the people who talk about
like overproduction of Elites is
slightly more like a slightly more
correct way of talking about it but
the the the more real thing is that like
can you come up with a positive
inclusive vision for the future
I know I can't right it's I I don't know
how to do it
um can you can you appropriately answer
the questions put forth in the Unabomber
Manifesto
um and I mean this is something that was
kind of bringing it back to AI day like
this is something that was kind of sad
about this elon's comments were kind of
not that inspiring especially when he
said like if you don't like what we're
doing buy Tesla stock and like the Mars
stuff's a lot more inspiring
I even get this on YouTube sometime
where people are like George you know
why do you want to build this AI shit
right like why do you want these robots
and like
I don't know
I I but
it's not a reason like
not to do it I think there's just
something more deeply wrong in the
culture that doesn't want these things
right we have a culture that's afraid of
loss
um
you know and you look at these people
you know you look at these people and uh
you know the very the very woke sort of
people they're very woke sort of people
in general the people I know who are the
most
like who buy into that stuff uh and the
Unabomber even talks about this
um Ted Kaczynski uh even talks about
this when he says your your average I
believe he says Urban ghetto dweller
doesn't love all this political correct
bullshit right it's actually your your
uh White upper middle class ivy league
graduate
who cares about this kind of stuff
and the reason for that is it's I mean I
think it's a form of projection right I
think it's a form of they worry about
their own sort of
status loss
uh wokeness comes from Consultants I
mean consultant again it's just uh you
know look
um
Elon got a phone call from a
three-letter agency about how we will
never be able to change anything no
matter how much money he has
since for that
what if he did
institutions bad is getting pretty old I
mean
like
here's a question
what if we are the bad guys
what if the Western world is the bad
guys
right
when Soviet Union collapses
early 90s they surrender to the West
right they might have been the worst
guys but what if we're the Bad Guys
right there's no one for us to surrender
to there is no other
conception of there there is no other
culture uh we are from the Eastern Point
of View but who what please please try
to tell me about how Russia's the good
guys right bro like I've been to Russia
um
like it it's not uh
you'll lose Warrior the bad guys right
um
you don't understand a single thing what
do you mean this is just general shit
talking now or this is General shit
talking or no I've just I've been kind
of bummed lately
you know
it's like yeah what is the point man
what is the point
foreign
like is the future in decentralization
no crypto is I spent I spent two weeks
in New York hanging out with a whole
bunch of crypto people
oh my God there is disgusting there is
disgusting as the startup people and
there's disgusting as the late stage
startup people if you go back to crypto
five years ago
everyone was in crypto five years ago
maybe a little bit more now maybe you
gotta go even back like before the Ico
craze you go back to crypto in like
2016. right and you know I I live in the
crypto Castle 2015 2016.
uh
no bad people are in crypto man everyone
in crypto was cool right
uh
it's all scans and rug pulls I mean
what's that what's that what's that
graph uh always was right
worse than startup people no I mean
there's some cool crypto people there's
some cool crypto people just like
there's some cool startup people but it
just feels exactly the same
um and there isn't much real value to
actually produce there right so the
startups did sort of produce real value
at least the early ones did
right and then you got ones that managed
to produce value but didn't manage to
produce return for investors like the
Ubers
uh
yeah geek smob sociopaths you know I
love that one you know I love that one
Bitcoin Maxis were right all along yeah
that's kind of what we've come around to
man it's kind of what we come around to
I don't know maybe so this makes me
reconsider my position on Jack Dorsey
uh
do I like metallic yeah I like metallic
uh
the answer is easy just buy the Etc
I don't know maybe I'm just old and
tired guys maybe I'm just old and tired
kind of crazy that a business model is
to reborn why do I why do I ever think
you're gonna give me answers you know
sometimes I think randoms on Twitch are
going to give me answers I know I think
it's women are going to give me answers
none of y'all give me answers you know
the only answers I've ever found in my
life have been through hard
search self-search man self search you
know
it's time to go off grid oh I tried that
you want to go off grid everything's
just so painful
I'm supposed to give you the answers you
think I have any fucking answers man
only people who tell you they have
answers are scammers
I will tell you that psychedelics do not
have the answers
Dostoyevsky have the answers I don't
know
maximizes Freedom at no expense to
living standards yeah yeah I wrote this
up oh my God Ubi is a fucking terrible
idea
you like a decentralized planned economy
that's great bro go make it happen how
many guns do you have you know
you have the answer this guy's got the
answers first time chatter all right
sure let's hear him out what are the
answers bro
you want to have an influence oh my God
that's the last thing I care about what
do I want man what do I want all right
I'll let you guys in on a secret it's my
birthday tomorrow I'm 33.
oh I'm a 33 year old man and I'm writing
a diss track against another guy who's
suing me that's that's what I am
that's what I am yeah
thank you
uh uh
look I'm not that upset about the guy
suing me I'm just more upset like that's
just kind of the meta that's upsetting
like you're just like
if I have 10x the followers then I'll
finally be happy
we're gonna have a party
I don't know
the answer is to join the meta
it was the last PC game I played I tried
to play Elden ring but it was a long it
was a large download my internet's too
slow
I mean it was pretty old GK
I think this is the best time to be
alive I don't know
I think that it's all the same I think
that everybody would probably say the
same thing about their time I don't know
no I think we're at a particular lull
right now
uh I think that
I think that in the mid 20s like in the
I don't know in like the early
2010s I guess I just didn't know how bad
it was going to get
yeah I mean when growth is around
everyone's pretty happy right
well of course peasants living 200 years
ago would switch places with us yeah but
that doesn't answer the question right
like
I don't know
prefer this to many of the last couple
years yeah no me too I mean I'm a fan of
the recession I think it's necessary I
think the Mania was really out on a limb
um
oh and yeah you know I mean if you're if
you're if you want to see the woke
people suffer man uh you you should
really be uh the recession is gonna is
going to uh
paying lip service to wokeness spending
extra money that's all great uh when
things actually hit the uh hit the fan
when shit hits the fan people care a
little bit more about truth so you know
I'm a fan of the recession oh my God
DeSantis 2024.
guys let me tell you who to vote for do
not vote
the way that you maximize your influence
in the world is not voting
because if you vote you're buying in to
the meta I see the majority of people
don't vote so maybe if you do vote
you're not bro I don't fucking know just
don't post it in here I don't give a
fuck who you're voting for man
all right all right
the Next Generation has no chance
against wokeness oh my God oh my God
what do you do do you read Fox News bro
[Laughter]
excuse me I will consume Alex Jones
man you know what I will say this Alex
Jones got way cooler after he was like
banned from YouTube you know what I mean
like back when he was still on YouTube
I'm like why would I listen to this guy
it sounds like a moron and then like I
found out that he YouTube banned him and
I'm like I wonder what he has to say
it is true like they try to they try to
ban these people and like Alex Jones is
Iconic he used to be some like
some like mid-tier shit Hawking
supplements now he's like an icon for
free speech so you know
oh no no I guess the brakes is pretty
good though I didn't realize they
interviewed him that's that's good
um Alex Jones is right I have no idea
who Andrew Tate is someone mentioned
that in the comments like he has no idea
who that is he was banned no one cares
anymore when you get banned Alex Jones
was the OG band guy
the liberal Lords will ban us oh my God
oh
oh you guys are more cringe in the woke
people
all right it's got stupid
nobody says don't vote that's right
nobody's saying that I'm out here
telling you is that can I say this on
Twitch some people get very upset and
think this should be a very banned
opinion
um
all right that's a good idea let's go to
let's go to subscriber only chat and see
if you guys have any answers
do you guys have any answers we're here
we're crowdsourcing answers guys I don't
know I don't know what I'm really even
looking for answers for
just not that I'm just not that
motivated anymore you know maybe I'm
burned out
ah
no there's no answers that's right
buy my book to find them see this is
where we are today this is where we are
today
how does it uh
oh food and sex man I don't know about
that
the only people who think sex is the
answer is people who aren't getting sex
a lot right like
when I was when I was like man you know
what I wish I had anything in the world
that I wanted as much as I wanted sex
when I was 19. you know that's that's
that's a fact
take a vacation to the islands and do
what what will I do on my vacation
I'll bring my laptop I'll sit around
I'll read the same websites
you know what what what what islands
people take vacations here this is the
beautiful beaches in the world
Latina pilled
[Music]
um
but then I think back in my life and you
know
never mind subscribers don't have any
better answers than than the randoms
uh just make cool shit and fuck
everything else
yeah
testosterone supplements bro I'm
genetically 96 style of testosterone
suffering through hiking
but you know I biked around Iceland
uh
like a month ago
spent two weeks
biked from here
all the way around
well I didn't actually make it to
acurari
uh where's mivan
I'm into the fast Hotel like right over
here
where's the Foss Hotel
let's go here
like somewhere around here
now but of course we didn't go this way
uh we went this way
my Iceland bike trip
I was pretty happy when I was on the
bike that's true
uh
yeah I rented a bike it doesn't matter
what you use my hand's still a little
fucked up for me
the only thing that brings me joy these
days video games lifting weights
is your company struggling to expand its
business
the fuck why do you think I want why
does everyone always think that I want
to expand
I start a second company I've been
thinking about it
starting a family I don't think so guys
um
Dharma AI what does Dom AI do
you joined my second company if you
can't join my first why would you be
able to join my second you can apply to
comma today we're hiring it's a really
cool place to work
um
like as far as I don't know like of all
the places I've worked when I think
about the other places and like the
things I had to do oh my God
trying to find answers Is So Meta bro
just stop searching see the truth is
this guy has the answer you see but you
can't just be told that you got to find
that on a journey
um
are you willing to hire someone
part-time from Europe
what no why would I hire someone
part-time
Burger's life bro
uh I'm woke that's right how could I
prove to you how woke I am
I believe that there's no difference
between the genders that's right
um stream got me jaded right yeah Jade
extreme work is life is the answer I
don't know I don't have any answers Bros
I don't have any answers
big if true that's right right
uh is it cool to rest invest in a full
remote fake job no you're a loser bro
didn't I gave you the fucking definition
of being a loser
would would you believe one thing but
act a different way you're a loser all
right so no it's not cool
right remember whenever the media talks
about like made up terms like quiet
quitting they're encouraging you to be a
loser because they're losers and they
want to bring everybody else down with
them
whenever the media is saying some stuff
right you gotta just think of it as
projection man these people are losers
and feel meaningless but you see when I
feel meaningless I talk about it and I'm
here talking about it with you and that
means I'm not a loser or I don't know
maybe I'm a loser man what if what if
what if I'm wrong see because yeah like
if I'm a loser it's one of those meta
things man you know like you've met cool
journalists yeah
you know what would be good if someone
makes a movie where journalists are the
bad guys you know you don't have enough
movies like that
it's Market crashing burning you out no
it's just what's what's bumming me I was
just like I'm excited for the market
crash I I love to see people lose money
uh
I love to see companies tighten their
their purse strings in their budget and
have to like because because it's in a
recession when truth comes out right
Die Hard had a movie with journalists as
a bad guys
dumbest shit man
philosophy is for high schoolers who
just discovered smoking weed
see you swimming naked when the tide
goes out like that analogy I like that
analogy
uh
oh my God you're biopsychiatry bullshit
yo I own out of stock guys why did I buy
it I bought it after Zuckerberg's likes
Freeman I can't believe I bought meta
stock
um
your fault for assuming and Randy's
philosophy no that was a good bug Alice
shark's a great book about a a woman who
runs a train company
um I'm not philosophy
Madison
no it was just like you know back in the
day people like had hope for these
things
you know
people were like hopeful about
technology
comes so under leveraged
with nothing to affect us
you hire former big four devs bro I
don't care if you have experience just
like no things
become a CEO of a big bad company you
mean like Francisco Dan cono
was the reason for buying meta I like
Zuckerberg on Lex Friedman you know you
don't see Prague on Lex Friedman let's
just say that
um
get a parrot
uh
the lack of ambition in startup culture
is really sad yeah no the hate against
Tech is real and it's just like it just
bums me out like
you guys just hate like what do you have
better you know
set the comma so behind them is the uh
guys we're gonna solve self-driving cars
we're actually gonna win the victory
doesn't feel good it's a meaningless
bullshit Victory oh my God like
I can win I could we could solve
self-driving cars next week and my life
won't get any better
people seem hopeful and optimistic about
AI why
good days and bad days yeah
don't start open source unless the
software company what
everything is meaningless so what's the
point oh nihilism's so cringe
yeah that's true I'm smart I have money
and I'm based and guess what man none of
that stuff fixes your problem you know
you all want some y'all want some
inspiring bullshit who the fuck cares
who bombed the pipeline
uh are we happy the pipeline was bombed
but that's the only question we have to
say because your vote matters in the
next election you can vote for the other
party who won't I'll wait no never mind
I take that back don't vote
Glenville next time Brook Park I have
the solution stage yeah
what do you think AGI is it's
uh who bought the pipeline let's let's
think about it was it Elmo it might have
been Elmo from Sesame Street I think
that's a working Theory
um not vote and be in the majority you
can't escape the meta why why
yeah you want to use you want to use um
[Music]
oh this is here we can run stable
diffusion right here in tiny grad uh
what what okay
um steps 20 phrase uh Elmo
bombing
uh the
Ukrainian
oil pipeline
did I spell Ukrainian right I don't
think I did
uh boss are Ukrainian also Russian
foreign
oh we gotta check out master
oh yeah don't worry don't worry there is
no uh there's no
there's no safety Checker in the tiny
creative limitation
uh uh by the way shout out to whoever
uh
it'll work on Tiny grad this morning
uh
all right we'll give the shout out
properly for who actually fixed
uh
uh
no where is it emergency then
here made by Ollie actually fixed the uh
this was a great pull request
fix the opencl uh issues
and got this to render uh on a M1
foreign
I think if the people who always talk
about AI safety are in charge of it I'm
very afraid
if you think that AI safety is making
sure that I can't put racist things into
Dolly bro bro yeah I don't know how that
became AI safety
um tiny grab big chip service hey if
they want to give me one I'll think
about it
foreign
Dolly bands anything gun related all
right
come on stable diffusion by the way the
stable diffusion in tiny grad is not as
good as the non-tanny grad stable
diffusion
Dolly's lame
Dolly's everything that's wrong with the
world
[Laughter]
foreign
just took a piece of it guys we found
out who did it we found out who did it
was Elmo
we have the proof we have the proof
right here
[Laughter]
man so I can't believe Elmo did this
laughs
[Laughter]
all right guys
um
Case Closed time to manufacture the next
Crisis right nobody the only reason this
stuff works like
I I think that you have a rising of
politics and Society at time when like
Society just doesn't have any direction
um
um
[Laughter]
no no no this is stable to view this is
Tiny grad and stable diffusion
so now it's meta to have directions
again yeah post-modernism sucks one is
postmodernism gonna be over
when is post-modernism gonna be over
guys
ah
dolly was into the truth
laughs
show you more props that's it all right
that's it all right this stream got
depressing uh Happy Birthday to me
tomorrow
um hope my life gets better I sure won't
share it with you fuckers uh no I would
I would I want us all to I want us all
to do better I want us all to be happy I
want us all to find truth and meaning
and I want all the losers to lose and
all the winners to win and uh I want
Elmo to be convicted uh for crimes uh
International war crimes that's right
those are my that's my Chris don't
forget my Christmas list this
hey everyone welcome to delete and space
podcast this is swix write an editor of
latent space and Alessio is taking over
uh with the intros unless his partner
and CTO on residents and decimal
Partners hey everyone today we have
geohot on the podcast AKA George hotz
um for the the human name everybody
knows George so I'm not going to do a
big intro a couple things that people
might have missed so you you were the
first to unlock the iPhone you traded
the first ever unlocked iPhone for
Nissan 350Z and three new iPhones
um you were then one of the first people
to break into the PS3 around arbitrary
code uh you get sued by Sony you've
heard a rap song uh to fight against
that which is still live on on YouTube
which we're gonna have on the show notes
then you did not go to Tesla to build
vision and instead you started come I
um which was an amazing engineering feed
in itself until you get a season disease
uh from the from the government to not
put these things on the street uh turn
that into a research only project you
know they're out there yeah yeah no no
no no they're out there but like in a
they're not a you know you Market them
as a research kind of like nowhere use
the word dev kit that's not about the
government it has nothing to do with the
government we offer a great one-year
warranty the truth about that is it's
gatekeeping what's the difference
between a dev kit and how to get dev kit
nothing just the question of do you
think it's for you and if you think it's
for you buy it it's a consumer product
we call it a dev kit if you have a
problem with that it's not for you
good for me that's great Insight
um and then I was going through your
blog post to get to the day you you've
heard this post about the the hero's
journey and you link this thing called
the portal story which is kind of the
set of stories and movies and books
about people living this arbitrary life
and then they run to this magic portals
kind of takes them into a new very
exciting live and dimension when you've
wrote that post you're talking about
tiny grad which is one of the projects
they're working on today and you
mentioned this is more of a hobby
something that is not going to change
the course of history obviously you're
now going full speed into it so we would
like to learn more about what was the
portal that you run into to get here
well what you realize is
you know what made me realize that I
absolutely had to do the company seeing
Sam want to go in front of Congress
why
uh what are the odds they nationalize
Nvidia
you know what are the odds that large
organizations in the government but of
course I repeat myself
um decide to try to clamp down on uh
accessibility of ml compute
uh I want to make sure that can't happen
structurally so that's why uh I realize
that it's really important that I do
this and actually from a more practical
perspective I'm working with Nvidia and
Qualcomm to buy chips Nvidia has the
best training chips Qualcomm has the
best inference chips uh working with
these companies is really difficult uh
so I'd like to start another
organization that uh eventually in the
limit either works with people to make
chips or makes chips itself and makes
them uh available to anybody
maybe we can dive into each of them so
xla Prime torch those are the complex
instruction system tiny grad is the
restrict uh restricted instruction
system so you're kind of focused on
again tiny grad being small not being
over complicated and trying to get as
close to like the DSP as possible in a
way where it's at more well it's a very
it's a very clear analogy from how
process is developed so a lot of
processors back in the day were cisc
complex instruction set um system 360
and then x86 uh then this isn't how
things stayed they went to now the most
common processor's arm
um and people are excited about risk
five right no one's excited about risk
five is even less complex than our
um no one is excited about Sisk
processors anymore they're excited about
reduce risk reduced instruction set
processors so tiny grad is we're going
to make a risk uh offset for all ml
models and yeah it can run all ml models
with with basically 25 instead of the
250 of xlar probe torch so about 10x
less complex yeah you talk a lot about
existing AI chips you said if you can
write a fastml framework for gpus you
just cannot write one for your own chip
so that's another one of your core
insights I don't know if you want to
expand on on that yeah I mean your chip
is worse right there's no way the chip
that you're going to tape out especially
on the first try is going to be easier
to use than an AMD GPU right and yet
there's no good stack for AMD gpus so
why do you think you can make one for
your chip you can't all right the only
company there's one other company
assassin video who's succeeded at all at
making training chips what company
[Music]
who's trained to model on AMD or Intel
nobody on AMD sorry
cerebral I'm talking about you might
know some startups who trained models on
these chips
I'm surprised no one immediately gets
this because there is one other chip
aside from Nvidia that normal people
have actually used for training that's
very neural engine no neutral training
no yeah you can only buy them in the
cloud
exactly yes right sure
mid-journey is trading on TPO right like
a lot of startups do actually train on
tpus and they're the only other
successful training Chef aside from
Nvidia but what you what's unique about
Google is that they also wrote their own
ml for Network right and if you can't
write your own ml framework that is
performant on Nvidia there's no way
you're going to make a performant on
your
yeah and they started from tensorflow
and then they they made the chip after
yeah that's exactly exactly and you have
to you have to do it in that direction
otherwise you're going to end up
um you know a service one of those
things a million dollars I've never seen
a service no one's ever like oh I
trained my model on a service
most people are like I train my model on
gpus some people 20 are like I train my
model on tpus
yeah and then the third one which is the
one that surprised me the most is uh
through and completeness it's harmful it
should be avoided it it made sense once
I read it but maybe tell us a bit more
about how you got there
um okay so CPUs uh devote tons of their
silicon and power to things like reorder
buffers and speculative execution and
branch predictors and the reason that
you need all these things is because at
compile time you can't understand how
the code's going to run right this is
this is Rice's theorem this is the
halting problem in its limit
um and this is not like all the halting
problem is is theoretical no no no it's
actually very real does this Branch get
taken or not well it depends on X where
does X come from I forget it right
um but no branches depend on X in a
neural lat every branch is a static Loop
like if you're doing a matrix multiply
it's a static Loop over the inner
Dimension and neural networks are even
better no loads even depend on X right
so with a GPU Shader right you're like
your load might depend on which texture
you're actually loading into RAM but
with a neural network your load is well
I load that way why well because I load
that weight the other million times I
ran the same net every single time you
run the net you do the exact same set of
loads stores and arithmetic the only
thing that changes is the data
and this gives you a very powerful
ability to optimize that you can't do
with uh CPU style things which have
branches and even GPU style things which
have loads in stores
make sense well gpus if you want GPU
style stuff you have like load based on
X you now need a cache hierarchy and not
an explicit cash hierarchy an implicit
cache hierarchy with with eviction
policies that are hard-coded into the
CPU like you start doing all this stuff
and you're never gonna get like
theoretically good performance again I
don't think there's 100x you know some
startups will talk about 100x and
they'll talk about absolutely ridiculous
things like clockless Computing or
analog Computing okay here analog
Computing just won't work and clockless
Computing
um sure it might work in theory but your
edit tools are
maybe uh AIS will be able to design
clockless chips but not humans
um but what actually is practical is
changing cache hierarchies and removing
branch predictors and removing warp
schedulers right gpus spend tons of
power on warp scheduling because we have
to hide the latency from the memory a
little bit High the latency of
everything statically scheduled yeah
what do you think people
are still hanging on to their incomplete
well because it's really easy turn
completely is just really easy right
it's really easy to just you know just
be so nice if I could do like a like an
if statement here
and actually Branch the code right so it
requires a lot more thought to do it
without Turing completeness
and would this be qualitatively
different than tpus
closer yeah tpus are a lot closer to
what I'm talking about than than like
like Cuda okay so what is Cuda well
kuda's a c like language which compiles
to an lvm like IR which compiles to PTX
which compiles to SAS which are all term
complete uh tpus are much more like this
yeah their memory is pretty statically
managed they have a I did some reverse
engineering on the TPU uh it's published
in tiny grad it has like a vliw
instruction and it runs them so it's
similar I think the tpus have a few
problems I think systolic arrays are the
wrong choice
um systolic array I think they have
systolic arrays because that was the
guy's PhD and of course Amazon makes
produces systolic arrays are just um
okay so basically you have like this is
a way to do matrix multiplication uh
think of a grid of Mille Lacs and then
the grid can multiply and then shift
multiply then shift multiply then shift
and they are very power efficient but it
becomes hard to schedule a lot of stuff
on them if you're not doing like
perfectly sized dense Matrix multiplies
which you can argue will design your
models to use perfectly sized dense
basic multiply sure but um it's just
it's just
no but thanks for indulging on on these
uh explanations I think we need to keep
our audience along with us Yeah by
pausing every now and then to explain
key terms you know
explain a systolic array I just
immediately get a picture in my head of
like tilting a matrix and shifting it
it's hard to kind of explain yeah which
is
and we edit we edit it in visuals yeah
yeah there's some great graphics that
just show you oh so that's what a
systolic array is but it's a
machine that looks kind of different
from the typical like Apu sort of
machine sorry ALU sort of machine I
think the right answer is something that
looks more like cues that feed into Al
use and then you can like pre-fetch the
loads from the memory put in a bunch of
cues and then the Q is just like feeds
into another queue over here
um
but yeah but that's not even the main
problem with tpus the main problem with
tpus is that they're closed Source not
only is the chip closed Source but all
of xla is open source but the exhalated
TPU compiler is a 32 megabyte binary
blob called lib TPU on Google's Cloud
instances all right it's all closed
Source it's all hidden stuff and you
know well there's a reason Google made
it closed Source Amazon made a clone of
the TPU it's called inferencia or they
have some other name for the training
yeah yeah and you look it's cloning the
GPL
software doesn't work though like Google
software at least kind of works
um so those are kind of like the
three-quarter pieces uh the first thing
you're working on that you've been
working on is Tiny grid um and one of
the your Twitch streams is that is the
the best thing you've ever written
um yeah tell us a bit more about um
that creation
for a long time tiny grad had a hard
limit at a thousand lines of code
and what this would force you to do is
really make sure you were not wasting
lines
um I got rid of the Restriction because
it became a little code golfy at the end
but once like the core framework of tiny
grad was there in those thousand lines
it's it's not huge now it's like 2 800
lines now it's still very readable
um
but like the core framework the ideas
are expressed with no boilerplate if you
go read pied torch uh you know Patrick I
think is actually pretty good code I
think Facebook's pretty good
um but there's so much boilerplate go go
in pytorch and try to track down how an
Lu actually works
it's just a lot of distractions oh
you're gonna be you're gonna be you're
gonna be diving down a long stack from
python to C to custom libraries to
dispatchers to and then I don't even
know how to read tensorflow like I don't
even know where's the Lu intensive phone
nobody knows
um someone at Google knows maybe
uh Google as an organism though so I
don't know if anyone individual at
Google knows
what are like the important ergonomics
like for a developer as you think about
designing the timing right API so the
tiny grad front end looks very similar
to Pi torch
um there's an even higher level front
end you can use for trying to grab which
is just Onyx we support we have better
support for Onyx than core amaldas and
we're going to have I think we're going
to pass Onyx runtime soon too and like
people think Onyx runtime that's the
gold standard for Onyx no you can do
better pass them in what specifically
test uh compliance tests okay so Onyx
has a big set of compliance tests that
you can check out
um and we have them running a tiny grad
and there's some failures we're below
Onyx on time but we're Beyond core ml
so like that's like where we are in Onyx
support now but we will pass we will
pass on sometime soon because it becomes
very easy to add Ops because of how like
you don't need to do anything at the
lower levels you just do it at this very
high level in tiny grad compiles it to
something that's fast using these
minimal Ops with
um you can like write I mean most
concretely what what tiny grad can do
that like pie charts can't really do is
if you have something like a times B
plus C right
if you write that in naive pie torch
what it's going to do on the GPU is well
read a read b in a kernel and then store
a times B in memory and then launch
another kernel to do a times B plus C
okay got to do those loads for memory I
know I did a whole extra round trip to
memory that I just didn't have to do
you're like yeah but you can use the
torch jit and it corrects this yeah for
that one example for that one example of
mullac but oh now you did three
multiplies six multiplies
right it doesn't uh it won't compile
arbitrary code and if you looked into
like the other approaches like Pi torch
lightning
um to accelerate pipe torch itself well
Patrick's lightning my understanding is
it's a mostly a a framework around Pi
torch right pytorch lightning is not
going to fix this fundamental problem of
I multiply six tensors together why is
it going to memory any more than a
single read from each and a single right
to the output okay
um there are there are lower level
things in pi torch that are I'm not
exactly sure what Dynamo does
um but I know they're generating some
Triton stuff which is going to generate
the kernels on the Fly
um but you know Patrick's lightning is
as at a higher level of abstraction so
Tony grad's front-end stuff looks like
pie torch I made a few tweaks there's a
few things I don't like about Pi torch
why is relio a class oh really like what
what was the state it's like you you
make a class in this estate everything
should just be torch functional and
unreliable you but just dot relu on the
tensor also like there's things in torch
where you have to do tensor Dot and not
a tensor dot right
um like why why are these things like
this just it just shows an API that's
like not perfectly refined but when
you're doing stuff tiny grad style where
you don't have lines well it has to work
this way because even the lines to
express the well you can't use the where
operator unless in the wear operator in
pi torch why is it uh true case
condition false case oh the worst that's
like how python expresses ifs it's
disgusting right Turner operators are
much nicer it should be I can do my like
a less than zero dot where a comma one
right
the very pandas uh like API yeah yeah
yeah yeah it's just it's some it looks
like torch numpy pandas they're all very
similar I tried to take like the
cleanest subset of them and express them
but like I said you can also interact
with using Onyx yeah
um but I have a rewrite of stable
diffusion every ride of llama I've ever
had a whisper you could look at them
they're short in the torch versions and
I think they're clean and you stream
them all yeah
very nice
um laziness is kind of the other
important concept that you're leveraging
to do operation fusing um yeah talk a
bit more about that so yeah you have you
have basically like
a few different like models for uh
compute the simplest one's eager right
the simplest one is eager is as soon as
the The Interpreter or sees a times B it
actually dispatches a times B right then
you have graph like uh tensorflow which
will put a times B into a graph and then
we'll do absolutely nothing until uh you
actually compile the graph at the end
um I like the third choice which is
somewhere in the middle laziness
laziness is you don't know when the Ops
are going to dispatch and don't worry
about that you don't have to worry about
this as a programmer you just write out
all your stuff and then when you
actually type dot numpy it'll be ready
by the time you you know copy the thing
back to CPU well you can do dot realize
and it will actually like force that
tensor to be allocated in Ram
um but yeah a lot of times right like
and if you think about it Pi torch is
kind of lazy in a way but they didn't
extend the Paradigm far enough right
when I do a times B in pi torch it's
going to launch a Cuda kernel to do a
times B but it's not going to wait for
that clue to Kernel to complete so
you're getting the worst possible world
you're getting the same laziness but you
also can't get Fusion because pipe torch
doesn't know that I'm then going to do
plus C there's no way for it to be like
whoa whoa whoa don't launch that Cuda
kernel whoa we'll just do this one too
right um you can kind of like again this
stuff
Pi torch is working on this and uh you
know it's a little bit harder like in
comma I felt like I was competing
against a lot of idiots
um here I'm competing against you know
smart smart very smart people who've
made other people yeah who've made some
I think different trade-offs right
who've made some different trade-offs
whereas if you're trying to build
something that is just straight up good
on Nvidia and we have a lot of people
and complexity to throw at it yeah
pytorch made a lot of the right choices
I'm trying to build something that
manages complexity like you can always
make your software do more the magic is
when you can make your software do more
without adding complexity right
um because you know complex things
eventually collapse under their own
weight so it's kind of that how does
fusing actually work like like
tensorflow actually collapsed turned
right song right it's kind of that's
kind of what happened right how does
Fusion actually work
um so yeah there's this thing called
lazy dot pie uh and when you do like a
times B that's uh it's put into a graph
but it's a very uh local graph there's
no Global graph optimizations and even
this can change right again like the
programming model for tiny grad does not
preclude eagerness right laziness is not
guaranteed laziness it's just going to
try its best
um so you put in a times B and that's a
binary app right and then you put in a
times B like that's a node in the graph
it's a virtual node because it's not
realized yet plus C okay here's a new
node which takes the C tensor in here
and takes the output of a times B it's
like whoa wait there's two binary Ops
okay we'll just use those together okay
here I have a kernel this kernel has a b
and c as inputs it does a times B plus C
in the local registers and then outputs
that to memory
and you can graph.1 in tiny grad another
another
like amazing thing the tiny red has that
I've not seen in any other framework is
two things uh graph.1 graph equals one
which is the environment variable it
will output a complete graph of all the
operations other people like oh you can
use Pi torch export to Onyx and use
netron yeah you can but like what if
that's not what's real right graph.1
will show you the actual kernels that
were dispatched to the GPU you can also
type debug equals two which will print
those kernels out uh in your in your in
your command line and it will tell you
the exact number of flops and the exact
number of memory accesses in each kernel
so you can immediately see wait a second
okay this currently gives this many
flops this was the gigaflops this is how
many bytes it read and this is the
gigabytes per second and then you can
profile without having to like okay I
mean in theory in pi torch sure use the
Nvidia Insight profile no one does of
course because it's so difficult right
like like actually Nvidia used to a pre
pre I think cuda9 was the last one that
had it they had a command line one but
now it's like okay I'm going to generate
this blob use this Nvidia GUI tool to
convert it into a chrome trace and then
loading Chrome yeah no one does it right
I'll just type debug equals two in any
tiny grab model and it will show you all
the kernels that it launches and the
efficiency of each kernel basically
yeah this is something that John carmick
has often uh commented about is like
when you code you need to build in your
instrumentation or observability right
into to that I wonder if whatever John
is working on he's adopting this style
and maybe we can sort of
encourage it by by like I don't know
naming it and coining it as a certain
kind of debugging style if you would if
you would like to start contributing to
Tiny grad I'd be uh you should hook up
with them
chatted with a few times I'm not really
sure what his company's doing yeah
um I think it's all I think it's it's
pretty uh uh but no I mean hopefully
like we get tiny grad to a point where
people actually want to start using it
um so tendergrid right now is
uncompetitive on uh it's on competitive
on Nvidia it's on competitive on x86 and
specifically what do you care about what
you say uncompetitive oh speed okay
should I have speed it's correct the
correctness is there the correctness for
both forwards and backwards passes is
there but on Nvidia it's about 5x lower
than Pi torch right now like 5x wow this
is this is unsurmountable no there's
reasons it's 5x lower and I can go
through how we're going to make it
faster and it used to be you know 100x
slower so you know we're making progress
but
um there's one place where it actually
is competitive and that's Qualcomm gpus
uh so tiny grad is used to run the model
in openpilot like right now it's been
live in production now for for six
months um and Tiny grad is about 2x
faster on the GPU than qualcomm's
Library
um and why specifically Qualcomm well
because we have Qualcomm we use Qualcomm
in the uh common devices oh I mean like
what what makes what makes what's what
about qualcommer architecture oh what
makes it doable yeah well because the
world has spent how many millions of man
hours to make Nvidia fast and Qualcomm
has a team of 10 Qualcomm Engineers okay
well who can I be here let's like like
when I propose what I propose with tiny
grad is that developer efficiency is
much higher but even if I have 10x
higher developer efficiency
I still lose on a video right you know
okay I didn't put a hundred thousand man
hours into it right if they put a
million like like that's what I'm saying
but that's what I'm saying we can get
and we are going to close this speed Gap
a lot like I don't support tensor course
yet that's that's that's a big one
that's just gonna okay massively close
the gap and then AMD
uh I can't even get I don't even have a
benchmark for AMD because I couldn't get
it compiled oh and I tried oh I tried I
spent a day like I spent actually a day
trying to get pie torch and got it built
I got it kind of working then I tried to
run a model like there's all kinds of
weird errors in the rabbit holes are so
deep on this I'm like
um so we you know you can compare the
speed right now you can run llama you
can run anything you want on AMD it
already all works any opencl backend
works and it's not terribly slow I mean
it's a lot faster than crashing so it's
an infinitely times faster than Pi torch
on AMD um but
pretty soon we're going to start getting
close to theoretical maximums on AMD
that's really where I'm pushing and I
want to get MD on ML perf
in a couple months hopefully now that
you bring up AMD yeah let's dive into
that because when you announce the tiny
Corps fundraise you mentioned one of
your first goals is like build the
framework Grind Time and driver for for
empty and then on on June 3rd on Twitch
uh you're weren't as excited about AMD
anymore maybe let's talk a bit about
that and like uh you compared the
quality of like combat messages from
like the MD kernel to like the Intel
work that people are doing there what's
important to know so when I said I
wanted to I want to write a framework I
did never intended on writing a kernel
driver I mean like I flirted with that
idea briefly but like realistically I I
like there's three parts to it right
there's like the ml framework there's
the driver and then there's the user
space runtime I was even down to rewrite
the user space runtime I have I have a
GitHub repo called cudaio control
sniffer it's terribly called but you can
actually launch a Cuda kernel without
Cuda also you don't need Cuda installed
just the Nvidia open source driver and
this open source repo can launch a Kuda
kernel so rewriting the user space
runtime is doable rewriting the kernel
driver I don't even have docs I don't
have any docs for the GPU like it would
just be a massive reverse engineering
project
um so that is when I saw that there like
it wasn't like I wasn't complaining
about it being slow I wasn't complaining
about Pi torch not compiling I was
complaining about the thing crashing my
entire computer it panics my kernel and
I have to wait five minutes while it
reboots because it's a Server
Motherboard and they take five minutes
to reboot
um so I was like look if you guys do not
care enough to get me a decent kernel
driver there's no way I'm wasting my
time on this especially when I can use
Intel gpus until gpus have a stable
kernel driver
and they have all their Hardware
documented you can go and you can find
all the register docs on Intel gpus so
I'm like why don't I just use these now
there's a downside to them uh their GPU
is 350 and you're like what a deal it's
350 you know when you get about 350
worth of performance and if you're
paying about 400 for the pcie slot to
put it in right like between the power
and all the other stuff you're like okay
never mind you got to use Nvidia or AMD
um from that perspective but I sent an
email to Lisa Sue and she responded nice
oh you can see you published that email
in a Discord I did I did and she
responded
um and I've had a few calls since and
like what I did was like
what I tried to do
well first off like thank you for
responding it shows me that like if you
don't care about your kernel panicking I
can't like like this is just a huge
waste of my time right I'll find someone
who will care like I do I'm not asking
for your seven by seven Winograd
convolution when transposed to be fast
like I'm not asking for that I'm asking
literally for the basics and this isn't
tiny grad this is your demo apps I ran
their demo apps in loops and I got
kernel panics I'm like
okay there's a
um but no uh
Lisa reached out connected with a whole
bunch of different people uh they sent
me a pre-release version of rock M uh
5.6 they told me you can't release it
which I'm like why do you why do why do
you care but um they say they're gonna
release it by the end of the month and
it fixed the Cardinal panic the guy
managed to reproduce it uh with the two
gpus in the computer uh and yeah sent me
a driver and it works so um yeah I had I
had bad experience uh and then I had
another experience where I had two calls
with like amd's like communication
people and just like
explain to these people like open source
culture like it's not open source if you
dump the source code on a GitHub repo
and then forget about it until the next
release it's not open source if you know
all your issues are from 2022 like like
it's just no one's going to contribute
to that project right sure it's open
source in a very like technical sense it
to be fair it's better than nothing it's
better than nothing but
um I fixed a bug and nickel that I fixed
a there's a fun fact by the way if you
have a consumer consumer AMD GPU they
don't support peer-to-peer
um and they're already span with this
horrendously slow because it's using
Cuda kernels to do the copy between the
gpus and it's putting so many
transactions on the pcie bus that it's
really slow but you can use clue to mem
copy and there's a flag to use kudame
copy but that flag data Buck
um so I I posted uh the issue on nickel
I expected nothing to happen the Nvidia
guy replied to me within an hour he's
like try this other flag I'm like okay I
tried the other flag it still doesn't
work but here's a clean Repro and I
spent like three hours writing a very
clean Repro I ended up tracking the
issue down myself but just the fact that
somebody responded to me within an hour
and cared about fixing the issue okay
you've shown that it's worth my time and
I will put my time in yeah because let's
make this better like I'm here to help
um but if you show me that you know
you're like you're the kernel panics
let's just like expected yeah okay well
it sounds like EMD is getting the
message they are and I just I don't
really think they've had someone explain
to them like like I was like you're
gonna like build in public and they're
like what's an example of building in
public I'm like go look at pytorch go
look at pie torch right like you know I
have I have two minor things merged into
pie torch because it's very responsive
you know it's only minor bug fixes but I
feel like it's you know
yeah
um so that's kind of like the lowest
level of the stack and then at a
slightly hover level obviously there's
tiny grad there's Mojo uh there's the
Gmail how are you thinking about breadth
versus like depth and like where you
decided to focus early on
um so ggml is very much like a okay
everyone has m1's right actually I was
thinking in the beginning I was thinking
of something more like ggml focus on the
m1s but ggml showed up and was just like
we're actually just focusing on the m1s
um so and actually M1 pytorch is
considerably better than AMD pie torch
and when pytorch works it only gives
wrong answers sometimes and only crashes
sometimes but like some models kind of
run
um
when I was writing the metal back end I
was comparing to MPS Pi torch and I had
like a
discrepancy like tiny grid checks all
its outputs compared to torch
one word didn't match I'm like
I really I I checked the matrix by hand
it matches tiny grad I don't understand
and then I switched pytorch back to CPU
and it batched and I'm like oh
yeah well there's like bugs like if you
like transpose The Matrix because like I
think it's like has to do with like
multi-views and Pie torch and like weird
under the hood stuff that's not exposed
to you like there's bugs and maybe they
fix them but like you know it seems like
there was a lot of momentum again
because you're getting a huge variety
you're getting how many Engineers care
about making pie charts work on M1 right
thousands tens of thousands yeah and you
have an open development process and
guess what it's going to be good how
many Engineers care about AMD working
for my torch AMD working oh you got 10
guys that work for AMD and then like a
couple hobbyists
you revealed an interesting detail about
how you debug uh which is you check you
hand check the matrix math no I don't
hand check it there's a there's a one of
the best tests in tiny grad is a file
called testops.pi and it's just a
hundred small examples written in tiny
grad and pytorch and it checks both the
forwards and backwards to make sure they
match
good test Suite yeah very important
that's I mean that's one of them where
you like I really I put a lot of effort
into CI for tiny grad I think CI is
super important like I want that green
check to mean I can merge this yeah all
right I don't want my tests to and if
the green check if you somehow manage to
introduce a bug and get the green check
okay we're fixing the test top priority
yeah
uh Mojo
it's closer uh no I'm not that
interested you know what I mean like
like look I I like Chris lattner I think
he's gonna do great things and I
understand the uh the like kind of the
wisdom even in keeping a closed Source
but uh you know I'm interested when it's
open yeah right you have an interesting
design uh deviation from him because
he's decided to be a well promised to be
a superset of python and you have
decided to break uh with with pi torch
apis uh and I think that's that affects
learnability and and trans
transportability of code
you know
porch thing ends up being like uh like a
stumbling block I could write a perfect
pie torch uh like I'd like it like a you
know instead of import pie torch instead
of like yeah import torch you type
import tiny torches torch and if that
really becomes the stumbling block okay
I will do that
um no Chris leiner went much further
than pytorch replicating the pi torch
API is something I can do with a couple
you know like an engineer monster right
like a shim yeah um replicating python
there's a there's a big graveyard of
those projects how's uh how's piston
going how's uh jython
you can go way back
um so a tiny gray and small layer um you
announce Tiny Box recently which is
um you know you made it so your core
mission is uh commoditizing the pedophob
and then your business goal is to sell
computers for more than the cost to make
which seems super reasonable uh what are
and you're gonna have three tiny boxes
red no no no no no no
no that was my look you know you know a
lot of people like I love you know
leaning into like saying I'm giving up
right it's great to give up right giving
up is this wonderful thing it's so
liberating and then like you can decide
afterward if you really give up or not
there's very little harm in saying you
give off except like you know great
Twitter haters have something to talk
about and I'll press is good press kids
so
um so obviously just red only red yeah
Tiny Box red Tiny Box red unless AMD you
know upsets me again and then we're back
we're back to other colors we have other
colors to choose from
when you think about Hardware design
what are some of the numbers you look
for so theraplopsis per second is one uh
but like memory bandwidth is another big
limiter like how do you make the
straight-offs well I mean fundamentally
unlimited what gpus I can buy but uh
yeah for for something that I think a
lot of people are going to want to
reasonably do with um uh uh a co-worker
of mine described them as luxury AI
computers right like luxury AI computers
for people and that's like what we're
building and I think a common thing
people are going to want to do is run
like large llama right or large like
falcon or whatever 16 level FB 16
exactly exactly um you know I indeed I
think can work I think that like what
ggml is doing to go to like N4 I think
this doesn't work like have you done
maybe they have but like I I read what
it was and I was like this isn't from
any paper this is just some like you're
amazing as much as possible yeah you
made up some quantization standards to
make it run fast and like like maybe it
works but okay whereas like the Hella
swag number right where's your where's
your where's your uh you know all your
the thesis right that like if you have
billions hundreds of billions of
parameters that the individual
quantization doesn't actually matter
that much well the real way to look at
all of that is to just say you want to
compress the weights right it's a form
of weight compression quantization is a
form of weight compression right now
this is obviously not lossless it's not
a lossless compressor right it's a
lossless compressor and you can show
that it's correct then okay we don't
have to have any other conversation but
it's a lossy compressor yes and how do
you know that your loss isn't actually
losing the power of the model maybe
maybe int for 65b llama is actually the
same as FB 167b llama right we don't
know uh maybe someone has done this yet
but I looked for it when it like first
came out and people were talking about
it and I'm like I just have like it's
not from a paper right the in-date stuff
is from a paper where they like some of
the entire stuffs from a paper there's
one paper I think it's like into llm.ind
date where they actually uh you know do
all the tests and they didn't go fully
in date they they made like 90 of it in
day and kept like 10 of it in FB 16 for
what they called like the like outliers
or whatever
um so I think that this is not quite so
easy and I think being able well so
first off if you're training no one's
gotten training to work within date yeah
there's a few papers that vaguely show
up if you're training you're going to
need uh bf16 or float 16.
um so this is why I Target that
now
the thing that you're going to want to
do is run these large language models
out of the box on your Hardware in fp16
and that's memory bandwidth so
you you need you need large amounts of
memory bandwidth too uh so ask how I
trade off memory bandwidth and flops so
what GPS can I buy
but um and I saw one of your about so
first of all you have this hiring
process which is you gotta solve one of
the bounties that are open on Tiny grad
there's no uh technical interview one of
them is intake support do you already
have some things you want to test on uh
we haven't date support
um what I'd like to see somebody do is
just load the ggml into llama into tiny
grad and then Benchmark it against the
FB 16 one
uh indeed already Works in tiny grad it
doesn't actually do the math and in date
which is even a just even a stronger
like it does all the math still in fp32
so intake can mean you just have your
weight tenant date or intake convene you
have to do your math in a date and doing
your math in a day the big like gain
that people care about is actually uh
having your weights in a day because
weights in a date mean less memory and
less memory bandwidth uh whereas the
math keep it in Fe 32. with with on on
m1s it doesn't even matter if you're
doing it doesn't matter what data type
you're doing in the for the in the GPO
I'm not even sure it can do in date but
fp16 and fp32 is the same it's the same
Tire flops
um so yeah no that's one of the bounties
one of the bounties is get get into date
llama running with the intake weights
and then actually you don't even need to
what you could even do if you really
want to test this just take the fp16 way
to convert them to indeed then convert
them back to fp16 then compare the
unconverted and converted oh that's a
nice hack oh yeah right like like I
should be lossless in the other
direction it will yes uh yeah I think
fp6
16 it should be lossless in the other
direction I'm actually not 100 about
that why not uh oh because like you ever
try to like like if you want to
represent if it was like n16 it's not
lossless
sure I think I think all of intake can
be represented in fv16 but I'm not 100
about that
okay it actually I think it we just draw
out the bytes we just have to do it
right just literally do it there's only
256 to check like
um but yeah either way or I mean into
four definitely so do your in four
convert it back and now see even within
four weights and FP 32 math like okay
how much does your performance degree to
this model yeah yeah so can we uh I'm
about to zoom out a little bit from the
details I don't know if you you had more
no I think like the you're planning to
release the first time you box ship them
in like two to six eight months
something like that uh what's up online
for you in terms of building the team
who should who are you calling for yeah
uh well like to to stay on the Tiny Box
for foreign
so if the gpus picked out and you're
like well I could make that computer
with the gpus and my answer is can you
do you know how to put do you know how
hard it is to put six gpus in a computer
and people think it's really easy and
it's really easy to put one GPU in a
computer it's really easy to put two
gpus in a computer but now you want to
put in eight okay so I'll tell you a few
things about these gpus they take up
four slots
what kind of computer you can buy the
nicest super micro you can't put eight
of those in there you need two soft
blowers if you want to use one of those
for you super micros you need two slot
blowers right or water cooling right if
you're trying to get the four Slot Cards
in there you're going to need some form
of water cooling uh or you're going to
need there are some like Chinese 40 90s
that are blowers right you have any
blowers or water cooling if you're
trying to get it in those things right
um so you're doing water
no I'm not using that chassis okay um
then the other thing that
okay so now you want to get six gpus on
a computer so that's a big challenge
you're like oh I'll just use a pcie
extenders I saw it online as Tech tips
it works great no it doesn't try pcie
extenders that work at pcie 4.0 and
interconnect bandwidth super important
yes
Okay Google 3.0 no pcie extender I've
tested and I've bought 20 of them uh
works at PCI 4.0 so you're going to need
PCI redrivers now okay how much is that
adding cost right like these things all
get really hard and then tiny boxes I've
even had another constraint to it I want
this thing to be silent
not totally silent but my limit is like
45 maybe 50 DB but not super micro
machine 60 DB if we have a small we have
a compute cluster at comma hey you gotta
worry you gotta wear your protection to
go in there like I've seen some videos
where you give a tour oh yeah yeah it's
super noisy super loud 10
000 RPM just screaming like I want to be
able to use the normal big GPU fans
and make this thing so it can sit under
your desk
plug into one Outlet of power right six
gpus
your GPU is a 350 watts each can't plug
that into a wall outlet okay so how are
you going to deal with that good
questions right
um and you're not sharing them well that
one I mean that one is pretty obvious
you have to limit the power on the gpus
right
um You have to limit the power on the
gpus now you can limit power on gpus and
still get you can you can use like half
the power into 80 of the performance
this is a known fact about gpus but like
that's one of my design constraints so
when you start to add all these design
constraints
good luck building a tiny box yourself
um you know obviously it can be done but
you need something that has actually
quite a bit of scale and resources to do
it
yeah and you see like the under the the
desk it's like one of the main use cases
kind of like individual developer use or
yeah what I also
like an AI hub for your home right as we
start to get like home robotics kind of
stuff
don't want to put the inference on the
robot
but you also don't want to put the
inference on the cloud
uh we don't put on the robot because
okay it's 1500 watts Tiny Box
you put batteries and charge them
bad idea and just just wireless wireless
is 0.5 milliseconds yeah right this is
super fast
um you don't want to go to the cloud for
two reasons one uh Cloud's far away okay
it's not that far away you can kind of
address this uh but two Cloud's also mad
expansive yeah like Cloud gpus are way
more expensive than running that GPU at
your house at least any rates you're
gonna get right maybe if you commit to
buy well yeah I'm gonna buy 10 000 gpus
in three years then maybe the cloud will
give you a good rate but like you want
to buy you want to buy one GPU in the
cloud I mean okay you can go to like
vast but like if you're going on Azure
or AWS so that's expensive yeah this is
like a like a personal data center you
know instead of a cloud data center we
like the term compute cluster so we can
use Nvidia gpus data centers may be a
little bit dated
compute cluster which is totally legal
under the Cuda license agreement you
talk a lot about the pcie connection do
you think there's any fat there to trim
what do you mean uh just you're limited
by bandwidth right okay for some things
yes
um so the bandwidth is the is roughly
10x less than what you can get with NV
linked a100s yeah right and vlinked
a100s are going to have and then you can
even get like full Fabric and the Nvidia
really pushes on that stuff
um 600 gigabytes per second right and
pcie four you're gonna get 60. right so
you're getting 10x less yeah
um
that said why do you need the bandwidth
right and the answer is you need it for
training huge models
if you're training on a tiny box your
limit's gonna be about 7 billion right
if you're if you're training on Big
Stuff your limits could be like 70
billion right okay you can hack it to
get a bit higher you can hack it like
gbt hacked it to get a bit higher but
like that 65 billion in llama like
there's a reason they chose 65 billion
right and that's what can reasonably fit
model parallel on on agpus right so
um yes you you are going to end up
training models the Cap's going to be
like 7 billion but I actually heard this
on your podcast I don't think that the
best chatbot models are going to be the
big ones I think the best chatbot models
are going to be the ones where you had a
thousand trading runs instead of one
and I don't think that the interconnect
bandwidth is going to matter that much
so what are we ultimately for instead of
compute optimal
uh what do you mean compute optimal uh
so the this is you're talking about this
um the Llama style models where you
train for like 200. longer yeah yeah
yeah so okay you can always make your
model better by doing one of two things
right and a comma we just have a strict
limit on it um you can always make your
model better by training longer and you
can always make your model better by
making it bigger but these aren't the
interesting ones right particularly the
making it bigger because training it
longer fine you know you're getting a
better set of Weights the inference is
the same the inference is the same
whether I trained it for a day or a week
yeah but the okay if it's one billion
versus 10 billion well I 10x my
inference too right so I think that
these big models are kind of uh
sure they're great if your research labs
and you're trying to like max out this
hypogical thing which you can talk about
later yeah yeah but if you're but if
you're like a startup or you're like an
individual or you're trying to deploy
this to the edge anywhere you don't you
don't need that many weights yeah yeah
yeah you don't want them anyway it's
amazing for inference rather than
capabilities doing benchmarks yes yes
um and I think the the inference thing
right there's going to be so much more
right now the ratio between like
training and inference on clouds I it's
only still I think there's like two or
three acts right there's two or three
acts more inference which doesn't make
any sense right there should be way more
inference yeah there should be a 10 to
100 x more inference in the world than
than training
um but then also like what is training
right you start to see these things like
Laura like yeah you're getting kind of
it's kind of blurring the lines between
inference and training and I think that
that blurred line is actually really
good I'd like to see much more like on
device training or on device fine-tuning
of the final layer yeah um where we're
pushing toward the stuff at comma right
like why am I shipping a fixed model I
totally want this model to fine-tune
based on like how you know your left
tire is flat right
like every time you cut the same turn
because your left tire is flat well it
should learn that right so would comma
pursue perimeter efficient fine-tuning
yeah yeah where where it seems like good
we're looking into stuff like that I
mean comma's already very parameter
efficient because we have to like run
this thing in a car and you have to like
cool it and power it yeah
yeah
and so this kind of like intelligence
cluster you have in your home you see
when the person is using third-party
model they
load them locally and kind of do the
final fine tuning it kind of stays
within the Box yeah
I think that that's one thing that's one
version of it for the Privacy conscious
um I also see a world where uh you can
have your Tiny Box in its down Cycles
um mine flop coin right you know not all
it turns out not all crypto is a scam
there's one way to tell if crypto is a
scam if they're selling the coin before
they make the product it's a scam if
they have the product and then they sell
the coin it's maybe not a scam right so
yeah my thought is like each Tiny Box
would let you would have a private key
on it uh and you have to do it this way
you can't just let anyone join because
of civil attacks right there's a real
problem of like how do I uh how do I
ensure your data is correct and the way
that I ensure your data is correct on
the tiny Nat is if you ever send wrong
data
your 15 000 Hardware box is banned so
you know don't cheat
um obviously if it messes up we'll
forgive you but um I'm saying like
somebody's gonna try to jailbreak your
devices there's no jailbreak there's no
jailbreak there's just a different
network there's just a private key on
each device right like if you buy a tiny
box from the tiny Corp I give you a
private key it's in my backend server
right you want to hack my server that's
illegal anything you want to do on the
device the device is yours my Surface
mine right like
yeah yeah have you looked into like a
Federated training at all yeah so I mean
okay you're now there's okay there's a
lot of magnitude a federation you mean
like over the cloud and stuff over the
Internet yeah over the internet but also
distributed on a bunch of devices right
yeah
I'm very bearish on this stuff yeah um
because you're interconnect bandwidth
right so okay at the high end you have
your interconnect bandwidth of NV link
which is 600 gigabytes per second right
yeah the Tiny Box has 60 gigabytes per
second
and then your internet has
125 megabytes per second right not
gigabits 125 megabytes right so okay
that's um or it is a magnitude that's
that's how that's how many orders of
magnitude we're talking here like from
60 down to 125 like all right that's
over 100 it's over 100x that's 400x
right so like no uh what but what you
can do is inference right like there's
for inference you don't care all right
for inference I I there's so little
bandwidth at the top and the bottom of
the model
um that like yeah you can do Federated
inference right and that's kind of what
I'm talking about
um there's also interesting things to
push into like your life but okay what
if you want to run closed Source models
this stuff gets kind of interesting like
using TPMS on the boxes and stuff
um yeah but then someone might jailbreak
my device so you know maybe we don't try
to do that
yeah what's like the Enterprise use case
do you see companies buying a bunch of
these and like stacking them together
um so the Tiny Box is like the first
version of what we're building but what
I really want to do is be on the
absolute edge of flops per dollar and
flops per watt these are the two numbers
that matter
uh so the Enterprise use case is you
want to train like like comma right so
comma just built out a new compute
cluster it's about uh it's about a
person and a half
uh so you know it's it's decent size a
person a person being 20. a person is 20
paid a flops it's about 30 pet flops
um we built out a little a little
compute cluster and you know we paid
double what you theoretically could per
flop right you theoretically could pay
half per flop if you designed a bunch of
custom stuff and yeah I mean I could see
that being you know tiny Corp when com
is going to be the first customer I'm
going to build the box for comma and
then I'm gonna show off the box I built
for comma and be like okay like do you
want to build I sell 250 000 training
computers or how much is one h100 box uh
it's uh it's 400 Grand okay I'll build
you a 400 Grand training computer and
it'll be 10x better than that h100 box
for again not for every use case for
some you need the interconnect bandwidth
but for 90 of most companies model
training use cases the Tiny Box will be
5x master
for the same price yeah
you mentioned the person of compute how
do we build the human for 20 million
dollars
oh it's a lot cheaper now it's a lot
cheaper now uh so like I said comma
spent about uh about half a million on
our person and a half so you know you
know what are some of the numbers people
should think of when they compare
compute to like people so gpt4 was a
hundred percent years of training that's
more like on on the time scale
um 20 petaflops is one person I think
you
um right now the math was that for the
price of the most expensive thing we
built which is the International Space
Station we could build uh one Tampa yeah
yeah one Tampa which is 400 000 currency
of uh measurement
uh yeah yeah we could build so like the
biggest training clusters today I know
less about how gpd4 was trained I know
some rough numbers on the weights and
stuff but uh llama forever well okay so
gpt4 is 220 billion in each head and
then it's an eight-way mixture model so
mixture models are what you do when
you're out of ideas
um so you know it's a mixture model uh
they just train the same model eight
times and they have some little trick
they actually do 16 inferences but uh no
it's not so the multimodality is just a
visual model gonna glimmed on I mean the
multimodality is like obvious what it is
too you just put the vision model in the
same token space as your language model
yeah yeah oh did people think it was
something else no the mixture has
nothing to do with the vision or
language aspect of it it just has to do
with well okay we can't really make
models bigger than 220 billion
parameters uh we want it to be better
well how can we make it better well we
can train it longer
and okay we're actually we've actually
already maxed that out uh getting
diminishing returns there okay yeah a
mixture of experts we'll train eight of
them right so all right so you know you
know you know the real truth is whenever
a start whenever a company is secretive
with the exception of Apple Apple's The
Only Exception whenever a company is
secretive it's because they're hiding
something that's not that cool yeah and
people have this wrong idea over and
over again that they think they're
hiding it because it's really cool it
must be amazing it's a trillion
parameters no it's a little bigger than
gpd3 and they did an eight-way mixture
of experts like all right dude anyone
can spend eight times the money and get
that all right
um but
yeah so uh coming back to what I think
is actually gonna happen is yeah people
are going to train
smaller models for longer and fine-tune
them and find all these tricks right
like I I you know I think uh openly I
used to publish stuff on this you know
uh when they would publish stuff about
how much better the training has gotten
given the same holding compute constant
it's gotten a lot better right then
compare like Bachelor no Bachelor
yeah all right and now we have like
Israel finding algorithms like flash
attention yeah well flash attention yeah
yeah
um my flash attention is the same
computer flash tension is an interesting
Factor where it's actually The Identical
compute it's just a more efficient way
to do the compute but I'm even talking
about like like um
look at the new look at the new uh
embeddings people are using right they
used to use these like boring old
embeddings now like llama uses that
complex one another's like Alibi I'm not
up to date on all the latest stuff but
uh those tricks give you so much there's
been a whole round trip with positional
embeddings I don't know if you've seen
this discussion
rotational and then you don't need them
I haven't followed exactly I mean you
quickly run into the obvious problem
with positional embeddings which is you
have to invalidate your KV cache if you
run off the context so that's why I
think these new ones they're playing
with them but uh I'm not that I'm not
that I'm not an expert on like the
latest up-to-date language model stuff
yeah um I mean we have what we do at
comma I don't know how that works but
like
um what are some of the things I mean
that people are getting wrong so back to
autonomous driving there was like the
whole like lidar versus Vision think you
know it's like people don't get into
accidents because they cannot see well
they get into accidents because they get
distracted and all these things what are
do you see similarities today on like
the pathway GI like are there people
like what are like the nothing nothing I
say about this is ever going to compete
with how rich Sutton stated it rich
Sutton is reinforcement learning a bit
of lesson nothing I say is ever going to
compete with the bitter lessons way
better than any way I'm going to phrase
this just go read that and then like I'm
sorry it's bitter but you actually just
have to believe it like over and over
again people make this mistake they're
like oh we're gonna hand it to you this
thing we're going to hand no like stop
wasting time
which is I mean open AI is not taking a
bit of lesson no open AI
they were they were leaders in deep
learning for a long long time are you
telling me GT4 is not well open AI was
the absolute leader to the thesis that
compute is all you need yes right and
there's a question of how long this
thesis is going to continue for right
it's a cool thesis and look I think
um I would be lying along with everybody
else I was into language models like way
back in the day for the higher price I
got into AI through the hotter price
like 2014 I'm trying to build
compressive models of Wikipedia and I'm
like okay why is this so hard like what
this is is a language model right and
I'm playing with these like like
Bayesian things and I'm just like
oh but look at it like it needs to be
like like it's like I have two data
points and they're like almost the same
but how do I measure that almost right I
just like you know wrap my head around I
couldn't like like grab my head around
this and this was around the time
carpathy released the first like uh RNN
that generated the Shakespeare stuff and
I'm like
okay I get it right it's it's it's
neural networks that are compressors now
this isn't actually you can actually win
the hotter prize with these things
because other prize is is mdl it's the
model size the model plus the size of
the encodings and vettings so yeah you
can't I mean probably now you can
because it's gotten so good but uh yeah
back in the day you kind of couldn't so
I was like okay cool like this is what
it is I kind of get it
um yeah I mean I think I didn't expect
that
it would continue to work this well I
thought there'd be real limits to how
good autocomplete could get that's fancy
autocomplete
um but yeah no like it it works uh
it works well so like yeah what is open
AI getting wrong
technically not that much I don't know
like if I was a researcher
why would I go work there yes so why is
opening I like the Miami Heat
[Laughter]
no I don't this is this is my technical
stuff I don't really want to harp on
this but like why go work at open AI
when you could go work at Facebook right
as a researcher
like open AI can keep ideologues who you
know believe ideological stuff and
Facebook can keep every researcher who's
like dude I just want to build Ai and
publish it yeah yeah
awesome
um yeah any other thoughts tiny Corp
bounties
um
yeah so we have
been thinking a lot about like what it
means to hire in today's world
what actually is the like core okay look
I'm a believer that machines are going
to replace everything in about 20 years
uh so okay
what is that
what is that thing that
people can still do that computers can't
right
um and this is a narrowing list but like
you know back in the day like imagine I
was starting your company in 1960 right
oh we're gonna have to hire a whole
bunch of calculators in the basement to
do all the you know math to support the
cafe dude have you heard about computers
why don't we just buy a few of those oh
oh wow man you're right
um so like I feel like that's kind of
happening again and I'm thinking about I
will post in my Discord I'll be like
Okay who wants to like okay I just
changed my unaryops used to be log and X
in like e um I changed them to be log 2
and X2 because Hardware has log 2 and X2
accelerators yeah and of course you can
use changer base it's one multiply to to
get it back to e but like I made The
Primitives log 2 and X2 right and this
is the kind of I just posted in the
Discord I'm like could someone put this
pull request up and someone eventually
did and I merged it but I'm like this is
almost to the level where models can do
it all right we're almost to the point
where I can say that to a model and the
model can do it
um have you tried yeah I'm
I don't know I'm
like I'm I think it went further I think
autocomplete went further than I thought
it would but I'm also relatively
unimpressed with these chat Bots uh with
what I've seen from the language models
like they're
the problem is if your loss function is
categorical across entropy on the
internet your responses will always be
mid yes World collapse is what I call it
I don't know maybe I'm not even talking
about mode collapse you're actually
trying to predict these like like look I
rap I'm a hobbyist rapper and like
when I try to get these things to write
rap the rap sound like the kind of raps
you read in the YouTube comments Nursery
schools yeah it's like all right great
you're my box with Fox stick around bro
uh you know uh you know and Drake is
rhyming give it up for me with napkins
and Cutlery right like like all right
come on what's that like this thing
about orange like orange is famous yeah
yeah yeah yeah but now of course you
know four inch screws and orange juice
is in is training Corpus
um
but uh yeah so I think it went further
than like everyone kind of thought it
would but the thing that I really want
to see is like somebody put 10 llms in a
room and have them discuss the answer
before they give it to me well you can
actually do this right um and I think
the coding things have to be the same
way there is no coder alive no matter
how good you are that sits down well I'm
going to start at cell A1 and type my
program and then I'm going to press run
and it's going to work
no one focused like that
um so why do we expect the models too
right so so there's a lot that like
still needs to be done but you know at
the tiny Corp I want to be on The
Cutting Edge of this too I want to be
like program generation I mean what is
Tiny grad it's a compiler generates
program generate the fastest program
that meets the spec right why am I not
just having a ml do that
so you know it's kind of a you have to
exist fluidly with the machines and I
come around on a lot of stuff I'm like
wait tiny crowd tiny crip should be a
remote company right why I can't do this
in person really yeah like like how it
makes sense to be in person like comma
sure yeah we're going off in San Diego
like but that was a six-year-old company
right and it works and it works for a
certain type of people in certain type
of culture but what's going to be
different this time okay remote but now
it's remote and now I'm getting these
like people who apply and I'm like
I literally have a thousand applications
I'm not calling you to do a technical
screen I can't really tell anything from
a technical screen what am I going to do
make a code on a whiteboard like bring
up bring up a shared notebook documents
we could no like that's not gonna work
um okay so then I'll move to the next
thing we do this a comma with good
success programming challenges
I've also found them to be like
completely non-productive
I found one thing to actually be
predictive and it's
wait a second just write code in tiny
grad it's open source right and yeah um
so yeah I'm talking to a few people
who've been contributing and like
contributors you know the job's not for
you
um but you can do it remote and it's
look it's a chill job like you're not
you're like oh yeah well I work for the
tiny Corp like well you're writing MIT
licensed software like you see what it's
doing right like we'll just listen I
think just think of it maybe more of
like a stipend than a salary and then
also some Equity like if you know I get
rich we all get rich yeah
um yeah how do you think about agents
and kind of like thinking of them as
people versus like job to be done
um Sean built this thing called small
developer um and then it's in the same
thing like the human in the loop with
the language model and just iterating
while you write code
um I think I think that's that's
absolutely where it goes and there's
like a it's not like one thing it's like
they're small interpreter there's like
small debugger it's kind of like all
these different jobs to be done it's a
small world yeah it's a I know this is
like the small pockets it's like small
AI me tiny Corps so we're on the same
wavelength how do you think about that
do you think people will have a
human-like interaction with like oh this
is like the AI developer or like is it
I'm the human being supercharged by the
AI tools
oh I think it's yeah much more like I'm
the human supercharged by the AI tools I
think that like
coding is tool complete right like
driving is not tool complete right like
driving is just like like we hire people
to drive who are like below the API line
right there's an API line in the world
right love that yeah there's an API line
in the world and like you can think like
Uber's a really clear example right
there's the people below the API line
and the people above the API line and
the way you can tell if you're below or
above by the way is is your manager
computer right who's the manager of the
Uber driver well computer does the
machine tell you what to do what do you
tell machines exactly exactly
um so
coding is too complete right coding is
to complete coding is above the API line
so it will always be uh tools
supercharging your coding workflow and
it will never be you performing some
like
task like okay well I can do everything
except for actually starting a Docker
container like it just doesn't make any
sense right
um yeah so it will always be sort of
tools and you know look we see the same
stuff with all the like people are like
stable diffusion is going to replace
artists or whatever it's like dude like
it's going to create new artists did
Photoshop replace artists like what are
you talking about right like you know a
real artist's finger paint they can't
use brushes brushes or you know brushes
are going to replace all the okay like I
just can't like it's all just tools and
the tools are going to get better and
better and better and then eventually
yes the tools are going to replace us
but you know that's still 20 years away
so no I got a company to run at the
meantime yeah so I've written about the
API line before and I I think that's
from venkatesh I don't know if you've I
don't know I definitely took it from
someone it's definitely not mine vgr
yeah but I also have a speculated a
higher line than that which is the
kanban board like who tells the the
programmers what to do right so are you
above or below the cabin board
does has that evolved your your
management thinking yeah like that's
sort of what I mean like it's like like
I'm just gonna describe the pull request
in two sentences and then like yeah yeah
so you are running the combat board or
the bounties yes yeah the bounties are
the compound board exactly and and that
is kind of the high level and then like
yeah we'll get AIS to fill in some and
we'll get people to fill in others and
yeah and that's also what it means to be
like full-time a tiny Corp right would
you start and I wrote this up pretty
concretely I'm like okay step one is you
do bounties for the company step two is
you propose bounties for the company
right you don't obviously pay them we
pay them but you propose them and I'm
like yeah that's a good Bounty that like
helps with the main workflow of the the
company and step three is you get hired
full time you get Equity we all you know
maybe get rich
um what else are you designing
differently about the employee
experience
I mean I'm very much alike you know some
people really like to like like keep a
separation right some people really like
to keep a separation between like
employees and management or customers
and employees like a comma you know the
reason I do the dev kit thing it's like
dude you buy a common thing you're an
employee of the company like you're just
part of the company it's all the same
thing there's no like Secrets there's no
dividing lines there's no like it's all
a spectrum for like you know down here
at the Spectrum like you pay and then up
here at the Spectrum you get paid you
understand this the same spectrum of
college right like for undergrad you pay
and then you get up here to like you
know I'm doing a PhD program you get
paid okay well cool welcome to the you
know mm-hmm
what about uh comma bodies
you know you mentioned a lot of this
stuff is clearly virtual but then
there's below the API line you actually
need uh
this is the thing that's been announced
combo bodies we sell them oh we didn't
buy them there are a thousand bucks on
our website oh okay no no I'm thinking
about like the what Tesla announced with
like the humanoid Roblox it's the same
thing yeah except of course we made the
comma version of it Tesla uses 20
actuators we use two right like how do
you how do you build the simplest
possible thing that can like turn the
robotics problem into entirely a
software problem so right now it is
literally just a comma three on a pole
with two wheels
um it balances
keeps the comma three up there and like
there's so much you could do with that
already
right like this should replace how many
security guards could this replace right
if this thing could just confidently
wander around a space and take pictures
and you know focus in on things send you
a text message when someone's trying to
break into your building you know like
like this could already do so much of
course but the software's not there yet
right so how do we turn robotics into a
thing where it's very clearly a software
problem you know that people don't
accept that self-driving cars are a
software problem like I I don't I don't
know what to tell you man like literally
just watch the video yourself and then
drive with a joystick right yeah can you
drive and we've actually done this test
we've actually done this test where
we've had someone okay you just watched
this video and here's a joystick and you
got to drive the car and of course they
can drive the car yeah it takes a little
bit of practice to get used to the
joystick but
um
the problem is all the model right so I
cannot make the model better yeah uh
specifically anything in computer vision
that you think uh our second most
popular episode ever was about segment
anything coming out of Facebook which is
as far as I understand the state of the
art and computer vision
um what are you hoping for there that
you need for a comma I have a new
segment to anything like the large large
yolos or not I've used like large
yellows and I'm super impressed by them
yeah
um I guess you think it's solved I gotta
check out segment anything I don't think
it's a distinct problem right okay
here's something that I'm interested in
all right we have great llms uh we have
great Texas beach models yeah and we
have great speech or text models yep
okay so why can I not why can I not talk
to an llm I can have a normal
conversation with it you can with the
latency of like two seconds every time
right
um why why isn't this and then it feels
so unnatural it's just like staccato
like I don't like the rlhf models I
don't like the two in versions of them I
think that they become you take on the
personality of a customer support agent
right like oh come on you know I I like
I like llama more than Chachi
Beauty's personality just graded on me
was llama like cool I write I write a
little bit of pretext paragraph I can
put you in any scenario I want right
like that's interesting to me I don't
want some like you know yeah so um
yeah I think there is really no like
distinction uh between computer vision
and language and any of this stuff like
it's all eventually going to be fused
into one massive so to say computer
vision is solved well it doesn't make
any sense because what's the output of
computer vision model segmentation like
what a weird task right who cares OCR
who cares I don't care if you can
segment which pixels make up that laptop
I care if you can pick it up
like it interact with real world yeah
and you're going to have the local
cluster you're gonna have the the body
yeah yeah I think I think that's kind of
where that goes so so the image like you
maybe we can paint the future of like
the year is 2050 yeah you've achieved
all you want in the tiny Corps what what
is what is the AI enabled future like
well tiny corpse the second company
comma was the first comma builds the
hardware infrastructure tiny Corp builds
a software infrastructure the third
company is the first one that's going to
build a real product and that product is
uh a graphind no like I'm dead serious
right like this is the dream product
right this is the absolute dream product
girlfriend is just the like stand in
well no it's not a stand-in no no I
actually mean it right so I've been
wanting to merge with a machine ever
since I was like mad little like you
know it's like how do I merge with a
machine right and like you can look like
in like a maybe the Elon style we're
thinking about as a neural link right
and I'm like I don't think we need any
of this right you ever some of your
friends maybe they get into
relationships and you start thinking of
you know them and their partner as the
same person you start thinking of them
as like one person I mean they are kind
of like merged right like humans can
just kind of do this it's so cool it's
this ability that we already have right
so I don't need to put you know
electrodes in my brain to merge with a
machine I need an a girlfriend right so
that's what I mean like this is this is
the third product this is the third
company and yeah in 2050 I mean like
oh it's so hard I just like maybe I can
imagine like 20 35 I don't even know
2050 but like yeah 2035 like yeah that'd
be really great like I have this like
kind of
you know so in terms of merging like
isn't it should any work on brain upload
rather than yeah yeah girlfriend but I
don't need brain upload right I don't
need brain upload either like there's
there's thousands of hours of Me on
YouTube right yes if you might how much
of my brains already uploaded that's
only the stuff that you voice yeah it's
not that different it's not that
different right you really think a
powerful you really think a a model with
you know an extra flop of compute
couldn't extract everything that's
really going on in my brain I'm a pretty
open person right like I'm not running a
complex filter humans can't run that
complex of a filter yeah like cubas just
can't like this is actually a cool Quirk
of of a biology it's like well humans
like can't lie that well
yeah yeah so is it good or bad to put
all of your stream of Consciousness out
there
I mean I think it's good yeah I mean I
don't know I'm streaming every day
we said off Mike that we may be the
first Immortals right yeah yeah like
this is how you this is how you live
forever it's a question of okay how many
weights do I have right okay let's have
a trillion weight so it's talking about
a terabyte at 100 terabytes here like if
it's not really 100 terabytes right
because it's common graph complexity how
much redundancy is there in those
weights so like maximally compressed how
big is the weight file for my brain
um quantize it whatever you want
quantization is a poor man's compression
um I think we're only talking really
here about like
maybe a couple gigabytes
right and then if you have like a couple
gigabytes of true information of
yourself up there
cool man like what does it mean for me
to live forever like that's me
yeah no I think that's good and I think
like the
there's a bit of like a
professionalization of social media
where like a lot of people only have
what's like PC out there you know and I
feel like you're gonna get come back to
the chat GPT thing right you're gonna
train the model on like everything
that's public about a lot of people and
it's like No One's Gonna Run their model
and they're gonna die
on social media
your life could depend on it
um we have a segment uh so uh we're
moving on to a what what would normally
be called the lightning round but just
uh just general takes because you're a
generally interesting person with many
other interests sure
um
uh what is the goddess of everything
else mean to you
oh it means that ai's not really going
to kill us
really of course
tell us more
look
uh Lex asked me this like Isaiah gonna
kill us all and I was quick to say yes
but I don't actually really believe it I
think there's a decent chance today I
think there's a decent chance that AI
kills 95 of us
okay but this on your Twitch streams
that you're with them so they're not
gonna no I don't think I actually I
don't also think it's AI like I think
the AI alignment problem is so misstated
I think it's actually not a question of
whether the computer is aligned with the
company who owns the computer it's a
question of whether that company's
aligned with you or that government's
aligned with you and the answer is no
and that's how you end up dead but um
so what what the goddess of everything
else means to me is like
the complexity will continue paper
Clippers don't exist you know there are
forces the paper Clipper is cancer right
the paper Clipper is really just a
perfect form of cancer and the goddess
of everything else says uh
cancer doesn't win you know yeah it's a
beautiful story for those who haven't
heard it yeah and you you read it out
and it doesn't do it
um yeah good what else we have a good
question so many yeah what are you
grateful for today
ah oh man I mean it's all just like I
haven't I've been thinking about this
stuff forever
like that it's actually like happening
and it's happening in an accessible way
too I guess that's what I'm really
grateful for it's not like
like AI is not some Manhattan Project
Style you don't know anything those
daughters closed doors and it all fight
really hard to keep it that way uh
you know uh that's that's a song I'm
grateful for just just how much is
released out there and how much I can
just learn and stay up to date and I
guess I'm grateful to the true fabric of
reality that you know I didn't need
differential equations to understand it
like I don't need you don't need you
don't need some like like there's
there's I've tried to do there's a limit
to my to my math abilities I can do most
undergrad math but I took some grad math
classes and okay now we're getting to
the end of what I can do and it's just
the actual like end of what I can do
like I'm limited by my brain but you
know
ml stuffing you need high school math
yeah like I could do all that nothing
like that you know what I mean when I
learned to multiply Matrix seventh grade
like it's all easy you need more
electrical engineering than you need
high school math early yeah yeah well
you need electrical engineering to like
build the machines but even that like
these machines are simpler than the
machines that have existed before
the compute stack looks really nice so
you know yeah I just uh I'm grateful
that it's all happening and I get to
understand it be here so yeah yeah um
John Carmike mentioned there's about six
insights we have left do you have an
intuition for what some of the paths
people should be taking obviously you're
working on one
um what are some of the other branches
of the tree that people should go under
I don't think I'm working on one of the
six insights I don't think tiny grad's
any one of the six insights
um something I I really like that Elon
does and I try to take it from uh I try
to be inspired by it is um
look at the boring tunnel machine and
ask how you can build a 10x cheaper one
all right look at the rocket how can I
build a 10x cheaper one all right look
at the electric car and say how can I
build a 10x cheaper like or cheaper or
you know can go further or whatever
whatever right you just do the straight
up physics math right like I'm trying to
do the same thing with with uh ml
Frameworks right and and and in doing so
making sure that this stuff remains
accessible right you could imagine a
world where if Google tpus were actually
the ultimate Google tpus were actually
the best for any things I mean actually
you know I'm kind of grateful for NVIDIA
right like because Google tpus would be
the ultimate now you have this huge
closed Source compiler in between
xla and the hardware and yeah that's uh
just a really bad thing so I mean
something that is somewhat upsetting
about the tiny Corps is it is that it is
trying to prevent downside but uh it's
not all trying to prevent outside like
we're also building computers and we're
gonna build some awesome powerful cheap
computers uh along the way uh so no I'm
not really working directly on any of
the six tricks I also think the six
tricks are kind of going to be like lock
I think this is gonna be like you know
please tell me more about what covaria
shift is and how that inspired you to
come up with batch normalization please
tell me more about why it's a
Transformer and it has a query a key and
a value right like Schmidt Hoover
described it better and fast weights you
know like like I mean my theory about
why Transformers work have nothing to do
with this attention mechanism and just
the fact that like it's semi-weight
sharing right like because the weight
Matrix is being generated on the Fly you
can you can like compress the weight
Matrix right like this is what that
there's an operation in the in the
Transformer which uh like
and by the way this is like qualcomm's
snpe can't run Transformers for this
reason so most Matrix multiplies and
neural networks are weight times values
right whereas um you know when you get
to the the the the outer product in in
uh Transformers well it's waste times
away it's a it's values times values
yeah yeah right um so snpe like doesn't
even support that operation right so
it's like that operation that gives the
Transformer its power it has nothing to
do with the fact that it's attention all
right and this is a funny like but that
is one of the six tricks right like
batch like these Norms are a trick
Transformers are a trick okay six more
is there a reason why so you can talk
you talk about uh attention as weight
compression
um
big compression is not exactly the right
word what I mean is that the weights can
change dynamically based on the context
there was this thing in pack 8 in the
hunter prize that I absolutely loved and
I've never seen it again in neural
networks and a really good trick okay
imagine you have 256 weight sets for a
layer right and then you choose which of
the weight sets you're loading in based
on some context and that context can
come from another neural net right so I
have another neural net which protects
projects you know a 256 wide one hot do
a soft Max predict it and then I
actually load the weights in and I can
do this operation in both test time and
train time right I can do this operation
post training at inference and I load in
the weight given the context right like
that is what Transformers do but
Transformers instead of having 256
discrete ones it's actually just that
but continuous yeah
um which is funny that that was in
language models and I just like when I
understood that about Transformers I'm
like oh this is a real trick and why are
they using the word attention yeah and
today is actually the anniversary of a
tension is all you need what oh yeah
that's a day today six years ago six
years six years change the world wow
well there's one of your envelope tricks
right and you can easily write it on an
envelope you know think about how you
write out that how many times have you
written that because it's not in any
libraries because it's like all used a
little differently each time yeah if you
just write out that exact same you know
yeah yeah uh you've name checked uh Elon
a few times yeah
um I think about both of you as systems
thinkers input output
think something in between sure
um what is what's different about your
Style versus his
um elon's fundamental science for the
world is physics minus information
Theory
but you you do a lot of physics as well
I mean like and Elon does a lot of
information Theory as well too but if
the question is fundamentally that the
difference maybe is expressed in what
your Ambitions are right elon's
Ambitions may be like go to Mars go to
Mars right go to Mars is the ultimate
modern modernist physics ambition right
it's a physics but I'm getting to Mars
right what are electric cars that's a
physics
okay now he's like pushing in the
autonomy stuff and you push a little on
information Theory but fundamentally his
dreams are physics-based dreams my
dreams are information based dreams I
want to live forever in virtual reality
with my girlfriend right those are those
are the aspirations of someone who who
accepts information theories of course
science so I think that's the main
difference between him he has
physics-based aspirations and I have
information-based aspirations
very very neat uh Mark Andreessen uh he
is a hi Mark he's listener
um he is heavily is a big proponent of
effective accelerationism you've been a
bit more critical why do you say that
iak is not taken seriously by its
adheritance oh
um
well only the left takes ideology
seriously
was it yeah just as a fact it's just
like it's just like a fact is the right
more cynical is that so what it is I
don't know it's like it's like the left
actually manages to get energy around
the ideologies right like like like
there's a lot more look here you have
you have two effective altruists Named
Sam going in front of Congress only one
of them is in jail
um you know it's interesting uh they're
both calling for regulation though
respective spaces right so SPF is
definitely like kind of a wolf in
sheep's clothing kind of right like he
only adopted Yak or ea uh oh and Sam
Altman is a genuinely good guy who is
not interested in power seeking for
himself all right okay we don't have to
fair enough fair enough
um but uh no Yak is not like like you
are not serious right
um You are not actually a a serious
ideology you know uh Mark injuries I
like Mark Andreessen but I think that
like some of his Twitter things are like
dude you like just like it's like it's
like someone who's in like 2019 who's
like eyes were opened about like the
political world being not exactly you
mean all the people on the news were
lying to me yeah bro they were lying to
you like okay we all figured this out
five years ago now what are you gonna do
about it I'm gonna complain about it on
Twitter great and that's what Yak is
um last and maybe most important what
was Avatar too bad
oh
oh I have a whole my blog I rewrote the
script of Avatar 2. I wrote a script
that actually might make you feel
something for the characters I killed
Jake Sully in the first scene like you
had to wait do you really
story arc topped his first one no of
course not you had to kill the guy and
make the movie about the brothers right
and just that alone and realizing that
right like you could have kept the
Titanic scene it would have been if I
didn't even take it out I left your
Titanic scene James Cameron but I wrote
you a story that so you know you just
just just
it's a great scene but like the movie
was just like like the Roman I never
great CGI you know let down by the
writing maybe yeah
yeah no but like the CGI like it was
It's A Beautiful World and that's why
like I care so much right like you don't
hear me ranting about Pirates of the
Caribbean 2 being a terrible story
because come on what do you expect man
like Johnny Depp's like wow I had a
movie that made me Rich I love this like
but this goes back to like the midpoint
you know I think he wrote like feels
like China PT wrote the movie and that's
my worry a little bit it's like kind of
converging towards that oh look Malik
wrote the movie
sorry I didn't want to interrupt you no
no I closed I closed deploy request two
days ago I was like was this written by
Chad EBT and I just closed it like you
know what I honestly feel bad if you
were a human who wrote this like I
you're incapable of of being more
perplexed but but but if you if I have a
classifier running in my head that asks
you know is this a AI or is this a human
like
you know the only way to deal with all
this like like
it's like the worst possible like you
know people are like
like how are you mad about like these
chat Bots you're not mad about like
Tesla well because if if I don't want to
buy a Tesla I don't have to buy a Tesla
and it won't really impact my life
negatively but if I don't want to use a
chatbot it's still going to impact my
life negatively all the amount of like
personalized spam that now makes me
spend more Cycles on my classifier to
tell if it's spam or not because you can
now use AIS and generate this
like no I mean we have to move to a
model where everything's just a dollar
right like you want to send me an email
it's a dollar like you guys wouldn't
care I know my friends would care no one
would care except the spammers all right
like we just got to move to those sort
of models
yeah
yeah awesome
um one last message you want everyone to
remember
uh
uh go uh go try tiny grad uh I hope that
we're a serious competitor to to what's
out there and then I wanna you know I
want to take it all the way we'll start
with just building something for gpus
and I'll start building chips and
they'll start building Fabs and they'll
start building silicon mines and we'll
have the first self-reproducing robot
using yeah okay
all right George thank you so much for
coming on that's a big inspiration thank
you thanks
all right
how was that we uh
not not quite like Friedman but we hope
to do something different
be good
now get the microphone
going turns out my keyboard was uh was
cheating and using blue was cheating and
using blue was cheating and using blue
was cheating and using Bluetooth was
cheating yeah get that on repeat get
that on
Loop was cheating and using Bluetooth
was cheating and using Bluetooth it's a
good Loop uh so where's chat
why why is the internet is so hard to
use like how does anyone use this I
don't know really I have a lot of
questions about like people in the
internet they like move things around I
can't wait till AI just use the internet
for
me all great all right good we got some
we got some good
bandwidth we got some milk tea which I
kind of got rugged on I thought it was
coffee but it's actually milk tea we got
an empty lemon spin drift there's full
lemon spin drifts
downstairs we got a shirt that reminds
you to look
left uh you know you can get great
things in the in the Bargain Basement
Hong
Kong
um I got uh so I went to I went to China
for the
week we can this doesn't have to be
subscriber only you guys can can all be
in when we talk about going to China for
the week so yeah went went to
Shenzhen uh show you guys I went
shopping in
Shenzhen what did I buy in
Shenzhen this is a more
threads see more threads uh
S80 here's the model it reminds you that
you use the CPU connector and not the
GPU connector which is actually quite
smart um the GPU connector is total
nonsense uh cuz it only does 150 watts
this is an 8 pin connector that can do
300 watts uh four 12 volts on top four
grounds on the bottom it's very sensible
the six pin GPU connector is kind of
nonsense so good to see someone thinking
from first principles there um overall
though I hear it's a crappy GPU uh I
just bought it because I'm excited to
see one on the Shelf
that marus and Guan
B here's an
AMD uh this is a 60 this is a
50 uh gr
Edition GPU so this is like the the
cheap Chinese market gamer
Edition
um and then I bought all sorts of stuff
to plug that in over USB but uh you'll
be seeing plent of that in the future so
have to show that now I also bought this
power supply guess how much guess how
much guess how
much 500 wat power apply guess how
much $20 yeah pretty
much little more 200 RMB
uh so I got that for 200 R&B and then
here's all the USB GPU things that I
bought in this little box
here it's a lot of little thingies we
don't need them all they can be unboxed
we have the whole tiny gang
coming uh you know our crew is kind of
like f Society you know F
Society um so we got the whole tiny gang
coming uh out to Hong Kong
uh for the month and some of you are
invited to if you're a tiny grad
contributor and you want to come on the
Hong Kong trip
uh yeah we we'll see I mean this how you
get hired here right kind of a kind of
a remote company show that you can
produce insane value for the tiny
project uh tiny never really had an
office in SD uh we rent part of comm's
office uh in exchange in the say as part
of the joint comma tiny Corp
agreement um I got I got stopped by Hong
Kong immigration
yesterday uh you know the guy's like
trying to scan my passport he scans it
like five times and then and then the
person comes out and I'm like oh okay uh
but you know there's two types of power
in the world there is there is rational
power and there's psychotic power and
the difference between these Powers is
when you comply with rational power uh
they lift the boot uh when you comply
with psychotic power they push the boot
on harder um so if you remember like all
like the the protests all the like the
campus protests where they would go and
like sit in in the Dean's office and
then people would comply with them see
that's the wrong kind of power that's
psychotic power because when you comply
with activists their demands will only
increase uh so which which is why you
really just have to exclude activists
from the conversation entirely you can't
talk to
activists uh but IR rational power if
you comply uh it's reasonable so you
know I'm selected for secondary uh
secondary immigration secondary
screening uh you know in America is a
Terri terrifying experience you know you
know they're gonna you know they you
know there going to do some weird shit
to you man like you don't even know what
it's going to be um so I'm like sitting
there I'm sitting there with like uh
three other Chinese guys uh
and nobody looks nervous which was
interesting like in America you're in
that same situation there's like a
10 yeah uh you know why why they
bringing me here um so I sat there for
maybe 15 minutes and then uh this woman
brought me into the uh interrogation
room
and uh a few things a few things about
the the interview really stood
out um the first was they explained to
me why I was there uh in America they
never explain
like they never explain to you maybe a
cop will tell you why he pulled you over
but sometimes it's like some bullshit
reason they'll never tell you an
immigration why you were selected for
anything so they were like well you know
you've been selected because you've been
coming in and out of the country a
lot uh fair fair I've been coming in and
out of Hong Kong a lot and following all
the immigration rules um and then she
asked me a whole bunch of probing
questions but something I found
interesting about the interview was in
America this interview would be very
adversarial uh I would very quickly be
thinking okay do I got to get my lawyer
like is this going to be a you know
honestly if I was put in that same
situation in America and again I'm an
American citizen I'm a guest in Hong
Kong uh in America I'd just be like I'm
not answering any of your questions uh
look you have 24 hours to charge me with
a crime or you can let me back into the
country uh I'm happy to hang out for a
day if that's what you choose but uh you
know I didn't commit any crimes and uh
you that's just how it's going to be I'd
rather not answer that question sir um
they were very reasonable even with my
thing so I always turn my electronics
off at the border uh you should always
turn your cell phone and laptop off
whenever you cross an international
border uh this is just like basic obsc
stuff uh so you know and like again it's
it's an interview it's like who are you
you know what are you doing here um but
the whole time I was in there it felt
like like compliance
was the more that I comply the more that
I actually am not quite forthcoming but
the more that I'm you know like we're
all on the same team here in this
interview uh the better things work out
for me and things actually it it really
went well and the main thing that they
were trying to discern was are you here
to uh bring take money out of the
country or are you here to bring money
into the country and I really respect
that because that's the thing that you
should be looking for in all immigrants
right whenever you're thinking should I
let this person into my country as a
visitor as an immigrant as a worker
whatever are they trying to bring value
in or are they trying to take value out
uh so so I I think once I explained that
you know I'm an owner of a business in
America and uh you know I'm being paid a
US salary and I'm coming here and I'm
spending money at Hong Kong restaurants
and so on and so forth uh the interview
uh you know it became not a problem um
it was very quickly not a problem you
know I didn't violate any of the rules
so you're absolutely happy to uh they're
absolutely happy to uh to have me here
and they gave me another uh the normal
90 days and said that uh you know if I
come in and out of the country a lot
it's triggered by just an automated
system uh so again very cool good signal
for Hong Kong uh and it
just it shows you what can happen in a
society where there is trust and it's
one of the things I really love about
this place that it is a high trust
society and uh I try my best to
participate in a high trust Society in a
high trust way if you're in a medium
trust society which America is you
purchas ipate in a medium trust way look
I don't think everyone in America is
trying to kill you but you know be on
your guard uh no officer I'm not
interested in taking that field soety
test um you know I i' honestly I I would
prefer to opt out uh with all due
respect uh I would I would feel more
comfortable having having a lawyer
present at this as
interaction and that's just the attitude
you have to have it's an adversarial
attitude it's a medium trust Society
it's not a low trust Society a low Trust
Society is is a whole different like you
know who's who's who's pulling the Glock
out first right uh so I don't ever want
to uh go to or live in a low trust
Society I'm not I don't want to the
minute Glocks are out you've already
you've already you've already uh you've
already crossed the line right even when
everyone walks away from this why are
the Glocks out right
um so oh someone should hire me as Hong
Kong's tourism master I legitimately
love this place um again there there are
so many wonderful things about a society
being high trust uh that that that I
really uh yeah I'm happy to be here
um yeah I'm thinking about working on
applying for
residency uh setting up a tiny corpse
subsidiary out of Hong Kong um there was
discussion in one of the group chats I
in about Elon special economic zone and
I listed like the things I wanted uh you
know what would you want in a special
economic zone in America maybe you'd
want something like uh you know easy
High skill immigration uh you'd want
there to be no crime uh you'd want there
to be cheap housing uh you'd want there
to be you know not no tax but like maybe
a 15% corporate tax rate and then I
realized at that point I was just
describing Hong Kong it has all those
things the immigration could be better
uh you know I'm I'm I'm lucky passport
privilege is a real thing it's nice to
have a US passport
uh so it makes things certainly easier
uh on that
front and yeah I mean Hong Kong could be
better about about a simpler pipeline
for for High Ski immigration but overall
it's better than Americas uh on that
front uh from a crime perspective
perfect uh I don't want to live I think
Singapore I mean it's a nice place but I
think that almost takes it a little bit
too far uh you know I don't think that
that's I think that that's a little bit
uh
extreme uh I'm not sure you know and
then I Dubai is another one I think I
think there
there's you want a little bit of crime
you don't want no crime right you don't
like or you don't want just all these
crazy things to be crimes like chewing
gum or you know that kind of stuff it's
kind of a meme about Singapore it is a
lovely place but uh you want there to be
a little bit of edge uh which I think
Hong Kong's pretty good about uh but you
obviously don't ever want this be
violent crime how does a society
tolerate violent crime or like breaking
and entering style property crime like
that's insane some someone broke into my
the comma office to try to steal a bike
like you know that's
Insanity uh how do we have that how how
how is that like like like how can how
can a state I mean you're not a state at
that point if if if there's people doing
uh viol crime let's start with just
violent what the hell a state is a
monopoly on violence that's the
definition of a state you're not a state
if there's people frequently committing
violent crimes in your territory you
don't control your territory right think
about OG you know there's no difference
between the government and a mafia I
think about a mafia y you can't do a hit
outside the Mafia That's not how it
works we do the hits okay and if we
don't sanction it so effectively all
violence in America is sanctioned by the
American state and that's what you have
to realize right or they're not a state
there's there's one of two Alternatives
here one all the violence you see is
sanctioned by the American state or two
the American state is weak and incapable
of actually uh you know
operating so it has to be one of those
two things there's no other explanation
for it
uh no violent crime here all you can
look up the murder right here and you
look up what the murders usually are
there either domestic or uh you know
gambling heat of the- moment passion
kind of things not all very much things
that you can entirely avoid uh and look
i' I've never you know I've never had
a uh I've never I don't even like the
phrase been a victim but I've never I've
never like uh it's not like violent
crime is super common in America there's
a lot of places I wouldn't go if I
actually thought it was violent but
property crime is super common uh I've
had property crime so many times uh
particularly in California uh and it's
just insane it's just insane like you're
not a state um you can't you can't have
that
um yeah and I've been I've certainly
been like harassed and
touched uh by Street people and like
can't can't have
that
um and yeah the tax rate okay now what
do
you it's not crime enforcement what the
hell are American taxes going to I have
no idea can't run a state why should I
pay for
this
um and then the cheap
housing look people are like oh robots
are going to fix everything oh robots
are going to come in and build cheap
housing it ain't robots housing is kept
artificially scarce it's not that like
we can't build it we could build it
especially if we bring in people from
Bangladesh do what Dubai does you can
build that you can replicate that in
America why not
um so
yeah
uh the Elon special economic
zone High skilled immigration no crime
15% tax rate cheap housing what do you
think see that's Innovation that's we
can get
Innovation
uh do I believe America is its people or
its culture America's got a lot of
things going for it and if if you if you
want to fix America you really have to
lean in on America's strengths against
some of the strengths that are here uh
like you have one of the most wonderful
things about
America and I worry that it fades a
little bit but America's civil religion
the idea of diversity you can make
diversity work you just have to not be
stupid about it right this idea of
diversity that that this idea of
diversity that people of many different
races can work together is phenomenal
that's just a huge talent pool right you
know any you absolutely want this people
from different cultures people from
different races people different Sexes
genders whatever that's who you want
working together now what these people
will often launder in with that idea is
that all ideas are equally good an idea
that well maybe in order to reduce
homelessness we should give homeless
people a check no see that's just a
fucking dumb idea because wow follow the
incentives we homeless people a check
now there's more homeless people we give
more checks there's more homeless people
who give more check wow you see now you
got to wonder something right are the
politicians who propose those policies
idiots or are they not working for
America
Traders it's got to be again it's got to
be one or the other right they're just
either completely incompetent which is
possible they can't understand the
second order effects of their policies
or they're misaligned they're working
against you and your interests and they
want to destroy America right it has to
be one or the other there's there's no
other room for this because these
policies over and over again lead to the
bad outcome it's obviously predictable
that it will lead to the bad outcome so
are they too stupid to see it or are
they not on your side right I know never
attribute to malice you can attribute to
stupidity they're honestly probably just
stupid stupid
but uh so yeah no I mean America's
America's civil
religion uh and there is a sense of
freedom and space that you just don't
get here um you know part of it is just
by the nature of being a city
everything's kind of crammed together
right in America yeah I'm going to go
get some land and a pickup truck and
some guns this good time and you could
do that there is a sense of but you got
to get rid of all the regulations
right I got I got some land out in
California can I go buy and tariffs are
regulations right get rid of the
regulations could I buy 100,000 solar
panels from China get some Bangladeshi
labor to come install them wire them all
up and then have a lot of power in
California and lower my electric bill no
because it violates a whole bunch of
regulations but imagine I could there's
nothing stopping that and America wins
right I own3 3 acres of land about 30
minutes east of San
Diego import huge number of solar panels
from China no import tariffs just just
huge number of solar panels coming on
boats from China getting shipped to my
land now I also have contract labor I'm
paying a minimum wage what the hell is
that get rid of all this bullshit right
you can't have this you can't have this
you want to be rich or you want to be
poor right that's it oh no but you have
to ensure a fair no no no no no no no
you're not thinking fourth
dimensionally make the pie big make
everybody
Rich so I bring in I bring in you know
like you say Bangladesh but I think
there's lots of countries where you can
bring in uh labor labor from um I know
Dubai brings in from Bangladesh we could
bring in I mean labor from Mexico is
pretty good uh bring in bring in bring
in cheap labor bring in cheap
hardworking labor um again it's a good
de it's not like people are like oh this
is exploitation this is slavery no it's
fucking not no one's forced to go it's
an opportunity right you either take it
or you don't um so bring in these people
have them set up the solar panels right
well again buy some cheap Chinese steel
I mean we got to spin up that American
Steel too but uh get some get some uh
stanion shove them in the ground get my
solar panels get them all connected
up um yeah and we've just raised the
value and brought more literal power to
America so think about it and then oh oh
you're going to have to advertise that
over the tax over the blah blah blah
blah blah 15% flat tax on
profits well your solar panels are
actually only deductible of blah blah
blah blah no no no no no how much money
did you make and we're going to take 15%
of that right that's just
fair what happen if us if Calo
on that look like like like
you know how you bury your head in the
sand right you bury your head in the
sand even deeper we can fix this I don't
want you I don't want people looking on
my posts about America and taking away
an absolutely Bleak perspective but I do
really think that the demoralization is
just beginning and in order you know the
first step to change is realizing you're
an addict the first step to to making
progress is realizing that there's
actually a huge problem that needs to be
fixed
so uh no I'm in Hong Kong but I'm an
American citizen uh I'm I'm
I'm again I'm not an idiot I'm not I'm
not blindly patriotic I'm a I'm a value
buyer right is America good value or is
Hong Kong good value I'm a value buyer
right oh George there's no you don't
have any loyalty yeah that's not how
things should
work right think about brand loyalty
nothing should be like oh aren't you
still buying Sony TVs don't you have
brand loyalty no I'm buying tickle TCL
oh but that's Chinese not it's a nicer
[Music]
TV value buyer create value don't try to
scam why is it so hard to see for
Americans to see that there's a huge
problem that needs to be
fixed because a lot of the people are
the problem remember when I did that
remember when I did that survey on the
uh on the Stream
one-third of people actually are the
problem needs to be fixed is in the ey
if you're if you're raking in the do
from the scam maybe the scam doesn't
need to be fixed uh so there's way too
many of that someone's really got to
investigate how are these politicians
getting paid 300K
salaries yet have net worths of $70
million how is that
happening someone's really got to look
into this
um no it's
not uh here if there's one article for
you to
read uh it's linked from it's linked
from one of my blog
posts uh there's one article for you to
read and please sit down and read this
article in full it's a phenomenal
article um it's called the value of
nothing Capital versus
growth uh so read and understand this
it doesn't just
attack traditional us thinking it
attacks Silicon Valley it specifically
attacks inent
Harts uh yeah read this and you
understand what the problem is we can
fix it and you know you see elon's new
Starling Factory now that shit's amazing
right we got a pretty good Factory going
to comma like we're doing a lot of the
same stuff we have a lot of the same
sort of ways of thinking one of the
particular things they talk about is how
you have to bring the Factory close to
the design so you can iterate on the
design to make manufacturing easier so
many things we found with comma and the
reason we've been able to bring the
price down so much is just if you design
better you can manufacture for cheaper
or not just better but if you design
with Manufacturing in mind well shop
teacher used to say that all the time
design for
manufacturing um
Julius I don't know who this
is I should read all articles are but
they're
good the real class war I'm
interested uh you have it all figured
out George congrats I don't know if
that's sarcastic or not but you know
something I find uh when I look at the
comments where people say like oh well
you know Packer news people are like oh
George really stick to reverse
engineering or blah blah blah blah blah
like the thing about that's that's very
low on the on the tiers of uh argument
you're not making a coherent argument
against me also the gold standard yes
the fucking gold standard yes oh but you
could use Bitcoin it's just like gold no
it's not do you know why there's 21
million Bitcoin because some GitHub repo
says 21 million what if I submit a pull
request that says 22
million oh
well no no no one will merge that it's
million right what if I bribe them yeah
well no they're not going to be bought
yeah but what if I like slowly do an
influence campaign over five
years right getting the key people who
can actually get that pull request
merged and we'll just merge the pull
request theyy 22 million called the 22
million project right it's like the 1619
project but for Bitcoin 22 million
project
the 21 million of Bitcoin is entirely
socially constructed there's no
fundamental reason that it's 21 million
it's just cultural and eventually
anything you do that's cultural will be
worn away but you know what can't be
worn away literal physical gold we're g
to make 22 million gold yeah how you
gonna make
it you're gonna you're gonna you're
going to go mine all right now we're
talking all right you're going to get
some trucks yeah make them out of steel
and aluminum yeah you're going to employ
some people to make some trucks you're
going to work on some Advanced robotics
to get the gold out of the ground better
see now we're talking see that's an
economy and you know it's not an economy
lobbying people to make it 22 million
and then like the fed's even worse you
don't even see the 21 million there's
not a GitHub repo there's not no code
that says 21 million it's all fugazi
right we got to go back to the gold
standard if you want money dig it out of
the fucking ground or convince other
people who've dug it out of the ground
to give it to you by providing value
right there's really only one way to get
money the only way to get money in the
world is to convince other people to
give it to
you um maybe in the gold standard
there's another great way too which is
you could dig a deep hole and digging
deep holes is very
valuable
[Music]
uh people's time I don't know I've seen
AI man more faith in Gold just
real uh yeah convince people right I
convince people yeah yeah yeah yeah see
that's what you're gonna end up doing
too right right the 22 million project
no no no that would never happen yeah
but what if I had the backing of the US
military right and again we're not going
to do like a very clear it's
cryptography it can't be changed I'm
going to kidnap the minor
families yeah 22 million bitches
all right it's 22 million project that's
just
real no really how long you think it's
going to stay 21 million for Jord you
can't say that that's heresy to bitcoin
see the beautiful thing about gold is
there's no heresy you can't make heresy
to gold right you can try to oh this
guy's a gold bug oh he should really
read this economist let me tell you
about economists right they're kind of
like Harvard professors when you ask
them about race and IQ right you ask a
Harvard Professor about race and IQ and
then they they think about it for a
minute and then they're like Harvard is
committed to diversity equity and
inclusion and then they give you an
answer right after they read that uh so
it's the same thing right you ask an
economist right it's like is printing
money
okay I'm being a PO by the government
who wants to print the money and oh yeah
yeah it's called modern monetary Theory
you see you see okay modern monetary
Theory umary Theory right
and like I just I just want you to try
to explain modern monetary Theory to
some like Roman Empire guy right some
like guy in a Roman Empire no no no no
no no the money doesn't have to be
backed by gold you see you see you're
only limited in your money creation by
inflation yeah yeah yeah yeah and
inflation only accelerates when there's
full employment or what the fuck does
any of this mean
gold George you just have to understand
the economics no this isn't economics
this is politics this is people who want
to convince you that for some reason
they're fake money is better oh but you
see you need to have lots of value
because you have to support a growing
econom what what are you talking about
support a growing economy price goes up
if there's not enough gold price goes up
supply and demand no no you have to
print money in order to no no but you
see there's going to be lots of
recessions yeah as opposed to massive
inflation so so people are like oh well
you don't want to be on the gold
standard because of uh let's find like a
let's find like a
longterm
um inflation over
time uh
cumulative yes here we go cumulative
inflation since 1913 okay so you
see when you have the gold standard
everything's good then you start to go
off the gold standard a little and a
little bit of inflation okay it's
controlled though but you see like like
now instead of a dollar being backed by
135 an ounce of gold it's backed by
145th an ounce of gold and at least
people can see what the inflation is so
you're not you're kind of limited by
what you can do right you can't you
can't 145th 35th an ounce of gold is now
backed by one now dollars backed by
100th of an ounce of gold you know
everyone's like oh you really rugged me
bro but you know they keep the rugging
little and then Richard Nixon comes
along and he's like rug the shit out of
everyone and look at what we get
and the trick is you have to look at
cumulative inflation because they always
talk about how well no it's 3% it's
always been 3% yeah but it also sometime
used to be negative
3% but now we avoid crashes and economic
recessions Yeah by making everyone
fucking
poor by literally
taking 30X of everyone's
value
like George you just didn't read enough
economics
if you read more economics you'd
understand that inflation's actually
good right remember remember when like
they like oh God I I can't get over like
the stupidity of like are they
brainwashed or are they in on the scam I
think they're I think they're in on the
I think they're on the take remember
you're you're an economist right you're
gonna you're going to you're going to
talk about what's best for the economy
you're going to talk about what's best
for your career right you're in social
sciences at Harvard you going to talk
about you know the truth or you going to
talk about what's best for your
career um solution vote for more
Republicans and they don't solve the
problem call them
rhinos no unless like the Republicans
aren't saying go back to the gold
standard but it's it's not like this is
a uh you know this is like bringing back
like no this is literally what what
happens when you have fake money oh but
we have new technology now no we don't
the Romans understood how to make their
money fake too and eventually they did
and that's what happens to every what do
you think happened to Roman dollars I'm
sure they had dollars I promise you and
I don't know I'm no Roman Empire you
know puff but I promise you what
happened to the Roman dollars is they
got inflated out of existence because
that's what happened to every single
currency ever except for the ones that
happen to exist today so what if we just
like didn't do that restored the gold
standard be like sorry we rugged
everyone for the last 50 years but now
we're going to stop rugging people
better late than never hey but you
know okay uh wow we had a long we had a
long opening rant we had a long opening
rant
uh wait no something definitely happened
in
1971 in
1971 America got taken off the gold
standard entirely to be fair they' had
been doing it for a while since someone
had to pay for the stupid European War
we never should have got involved in but
hey that's a political take that's
that's a
real ocean big
ocean know big ocean yeah big ocean we
talking you know uh all right good rant
Mr Peter sh I didn't realize like I
can't believe that I ever fell for
crypto crypto's fine stable coins are
cool uh a lot of parts of it are fine
but the belief that like crypto was some
fundamental backing store of money
because there's only 21 million Bitcoin
are you
kidding 22 million project George you
can't even say that someone might do it
yeah I know but what you think I'm the
only guy who's ever going to say
it and then why are we going to stop at
22 right
all right let's get down to the
technical
stuff modern mod I'm just triggered I'm
just triggered by okay I want being
trigger it's a good day W it's a good
day it's j
[Music]
um let's put that over
here so I'm routing it's a little bit
faster I'm routing this through my tail
scale Network tail scale is really good
by the way you guys use tail scale I
mean I'm sure they're the kind of
company who's eventually going to rug
you when they're like I don't even think
I pay them I don't even know how it
works I'm happy to pay them please just
like take my $10 a month and be happy
with that and I'll give $10 a month but
the problem is you'll eventually not be
happy with that and may have an in sh
ification you guys know in shit
ification and shit ification it's uh oh
someone figures out how to prevent that
um all right so in other news uh
AMD uh is sending us to Mi 300 boxes um
so yeah I invested A4 million
AMD uh my money not tiny corp's money or
anything
uh yeah I think that it doesn't really
make sense that uh Nvidia is valued at
16x above AMD I agree they should be
valued higher but the Gap doesn't really
make sense the the
m300x and the h100 are very similar
products or
and uh yeah why why does Nvidia uh
command this
huge why is it worth so much more um I
don't think Cuda is that much of a moot
I think Cuda is an early ecosystem but
often what you see in technology spaces
is the early ecosystem doesn't
necessarily win very often the open
ecosystem wins so I'm thinking about
things like Unix versus Linux I'm
thinking about things like betamax
versus
VHS so our goal at tiny Corp is to
commoditize the P flop and I love that I
got uh uh like like uh I know from AMD
uh going along with that language
because that language really is in amd's
interests and I I I love that I even
want companies like I just love that
that is the language being put out there
in the world because it's against a lot
of uh
bad like like scams where people just
develop Moes and then they sit on their
moat for the next forever right you want
things to be commoditized but just
because something is commoditized
doesn't mean there's no profit in it
there's a reasonable amount of profit uh
I would like to see multiple companies
competing you know some of them are
going to lag behind some of them are
going to Speed Ahead uh different
companies should be the winners at
different times so right now Nvidia has
been beating AMD generation after
generation I think there's a chance that
could change intel was also beating AMD
generation after generation and then
they faltered I'm not sure AMD is going
to falter in the same way but I do think
that Nvidia is getting addicted to the
free and cheap money free and cheap
money is bad many times uh and you see
them taking all these high-risk
strategies for their new products which
are good and I'm happy someone's doing
it but it's good that it gives I don't
know I look I like Jensen a lot I think
that that that um he knows that the 91%
margins on h100s are not here to stay
he's not trying to lock them in and we
could live in a world where all of these
companies compete on the merits of their
accelerators not by trying to lock
people into an ecosystem if Nvidia and
AMD had to compete on the Merit of their
accelerators yeah maybe Nvidia is worth
5x AMD but not
16 uh so either Nvidia is super
overvalued or AMD is
undervalued I'm not sure that Nvidia is
even
overvalued uh maybe I mean maybe and it
might go down but how much will it go
down um I think that the demand for AI
has barely started
I think
that the AI and the demand for thought
any kind of thought labor right whenever
you think of like a bank with a tower
full of full of a thousand people
working in it right that's just thought
labor and that's all going to be
replaced by AI uh so I think the demand
from a for AI is barely started I think
we're going to very soon figure out how
to make algorithms that scale with
compute that that scale with compute I
mean the whole thing has been algorithms
that scale with compute but algorithms
that are going to more explicitly scale
with compute you can put more compute in
and get a better answer uh which you've
seen this with open AI this isn't like
some crazy thing I think they're very
clear about this with 03 it's clear that
opening eyes ahead in this stuff
um you know deep SE kind of like shows
you how to do it you can just pour more
compute in and things will continue to
get better so I think that yeah the
demand for AI has barely started I think
that AMD is undervalued way more than
Nvidia is
overvalued um and I put my money where
my mouth is and I'm not look I have some
money but I'm not like worth a100
million doll or anything this is
actually a good chunk of my my of my uh
my network
so I'm long AMD
I mean it's betting on it's betting on
Tiny Corp too uh I always like to find
ways to so I've never sold any Comm Ani
shares I actually recently bought some
more comma AI shares uh from a investor
who uh an early investor who like didn't
have enough to sell in Forge they were
just annoying me so I'm just like what
do you want I'll give you 2x what you
paid for like I want 3x I'm like no fuck
off I told you I'd give you two right
they come back six months later they're
like you still want give me 2x I'm like
no now it's 1.5 you want to take it or
no and they're like okay I'll take it so
you know I wired I wired some money for
for 1.5x what they paid uh so I actually
bought more Comm AI shares recently uh
you know I don't have any plans of
selling uh any Comm shares or any uh
tiny Corp shares the the only person I
would sell shares to is back to the
company uh I do think stock BuyBacks if
done appropriately are good ways to uh
you know to get to
get it's an aligned way to get people
out who want out and to keep people in
who uh want to stay in you want to do
stock BuyBacks with profit made from the
business on profit that you don't easily
see how to redeploy quickly I don't know
uh but yeah know I kind of like that I
think like that's if there was ever a
way that I would take profit from one of
my companies it would be that um I have
zero interest in like selling to
investors or selling to bankers
what are you going do so stupid um but
if you can make money through like this
if I can if I can buy AMD
stock uh with tiny Corp work on better
drivers for AMD Drive demand for AMD
Drive the price of AMD stock literally
everybody
wins except in video but you
know video wins too like everyone kind
of wins here I think the demand for AI
has barely started um I think Nvidia
will likely at least for a long long
period of time have the high end if you
insist on the highest performing stuff
you will be buying Nvidia for at least
the next five years but if you're
interested in would you rather fight
like Nvidia is selling you one
horse-sized duck and AMD will sell you a
100 duck-sized horses
and if you're cool with duck siiz horses
then then yeah Nvidia is probably not
the place to buy the duck siiz horse
from they sell you the horse siiz duck
and there's a premium it's a you know
it's a it's a very large duck right so
yeah
um no stock BuyBacks with low interest
loans come on you do stock BuyBacks with
actual profit that you've made by
delivering value to the End
customer uh yeah no uh very smart
uh uh Quan guy explained this to me I'm
like why don't companies pay dividends
he's like dividends and stock BuyBacks
are the same
thing um and actually like it's kind of
better I think to do stock BuyBacks
because again there's so many ways you
can scam with stock BuyBacks but stock
BuyBacks are not inherently a
scam um if you're using stock BuyBacks
to try to juice your price yeah you're
scamming look we up all of this all of
this uh you know orders off the order
book and now there's our price is higher
you got to stop looking at the price the
price isn't that important you have to
think about the depth of the order book
come on every shit coiner should know
this um right just because your your
your Melania token is worth $3 billion
when you multiply the last traded price
times the total number of Melania
token like no no that's not how it works
you got to look at your exit liquidity
but look at the volumes the volumes are
high yes I understand the volumes are
really high now sell a million dollars
of it and see what the price goes
to
um so George doesn't understand
economics came up in the crypto world
man I think uh I might understand
economics a bit better than uh you know
some some some copium folk
got look at
incentives the technicals of
understanding it aren't all that hard
it's it's mostly it's like like
understanding yeah all right we're done
rant rant season's over um so what we're
going to work on today is mixture of
experts open source so I think we can
actually we don't have to go to the tiny
box yet we can probably just do this on
Mac let's take a look at which one we're
going to use so you guys understand what
mixture of experts is I think mixture of
experts is probably how brain works um
so you have a problem with
uh me three so you have a problem like
with llamas your your llama 70b is
accessing every single one of the 70
billion weights every time and this is
incredibly taxing to your memory
bandwidth it makes memory bandwidth and
memory capacity basically the same thing
so you don't want this um when you look
at Deep seek deep seek is a mixture of
experence model to be fair gbd4 is a
mixture of experence model too so this
is not like it's not like a Revolution
by Deep seek but I think that most
models in the future are going to go in
this direction so this is the total
number of parameters in the model but
this is the activated number of
parameters in the model so each time you
run the model
uh it's also possible that none of this
stuff's going to matter because we're
going to move to a diffusion style
architecture but I'm less familiar with
diffusion architectures but I think even
there like mixture of experts is just a
good idea you should not be accessing
every weight for every query this just
makes obvious intuitive sense if I'm
asking a query about archaeology right
we shouldn't be an we shouldn't be
activating the neurons that relate to
the reman hypothesis and this just
different so you have a ratio your
activated params to your total params uh
so let's do it the other way around so
we can actually see the
number so yeah deeps is about uh
18x so this is really large we're not
going to be able to load this on our
Mac but let's take a look and see what
open mixture of experts models we can
find
oh these are
just here's another one I don't know
which of these is the
best we support mixl in tiny grad but
mix's also rather large and kind of old
now but I think we'll be able to reuse
some of this code
uh then we're going to have to try to
get our mixture of experts models in our
Jet and there's a bunch of reasons that
this is tricky mostly because we have to
access different weights based on the uh
you're accessing different weights based
on what your previous layer said
looks pretty
open even more open than open Moe this
is also pretty
open who are these
people yeah I was looking at this when I
was in the coffee shop this morning so
we'll just pick one of these and get it
to run
M okay they write
Rags
uh 64 small unique Experts of which
eight are
activated good it's pretty
big
um why didn't you use Mi
100x rouder Z loss and load balancing
loss observe that they train 2x faster
than dense
llms equivalent active parameters
let's check out this
paper shoot
yeah so this
is it's a good picture I like I like
this project props to Almo from
contextual AI that's what we'll be
using so when you see this as a 1B 7B I
think what that means is There's 7
billion weights but only 1 billion of
them are access each time so I'm going
to have to download this uh
cool yeah so it clearly outperforms
everything with 1 billion active
parameters a little aggressive
to I mean it does have a lot more stuff
there oh this is also a mixture of
experts wait quen is mixture of experts
for
oh I can register an Alibaba cloud
account huh so okay it looks like they
did one mixture of
experts now it's Quin
2.5 so they moved away from mixture of
experts
I wish I I use Gro for like everything
now Elon you got to get rid of
this do I have to log in that ruins all
my fun oh oh maybe I don't have to log
in it's going to make me log in after I
type the question which is an evil dark
pattern
oh
sick it didn't make me log in all right
now we're talking now Gro really I use
grock for everything now the killer
feature of grock that chat GPT lacked
was real
ESS
um like Gro uh open AI
being a gear and a half out of date made
it like unusable for so many things that
I would use Google for and now instead
of Google I'll very often go to grock
because it's up to
date um and you know and you know what I
love it I love it and the reason it's
like safety it's like safety cocks it's
like we got to spend six months with the
model and make sure that it's not going
to tell anybody to go kill themselves um
and then grock's like well you know have
you really considered um yeah and that's
like good good cuz we this not like you
this isn't even what AI say safety means
this isn't even what AI safety means
right you've seen my
legs this one open do
interesting okay so they kept doing
mixture of experts just for the
uh private one I see I really think
mixture of experts is is the future
especially for these bigger models for
7B it probably uh doesn't help that much
but once you start to get into these
things I mean I imagine these models
becoming uh like terabytes and that's
fine just you can't access all the
terabytes every time um by the way so
this these are
the the big project that I want to do
with the uh the mi30 X's that uh AMD
gave to us also I saw someone saying
that AMD probably gave them to us based
on some like non-disparagement clause or
some signed contract or something like
that there was nothing like that uh and
I appreciate them for understanding that
I would never sign anything like that it
was literally
just uh
yeah we're going to send you the boxes
what's your address all right here's my
address here's a FedEx tracking number
uh so respect when AMD wants to do
something they actually just did it uh I
was I was I was expecting I gave I gave
like a 20% chance that they were going
to be like just sign this
non-disparagement Clause I'd be like
fuck off the hell I didn't think you can
buy me for that kind of money no way
right um but no it was nothing like that
so don't don't feel that I'm ever
restricted in what I can
say
um so I'm not like yeah I'm not like
like
uh if it sucks it sucks I don't know
there's a chance I'll get these actually
this isn't right I wish that were true
so say slower than that but um yeah no
if if the hardware actually does end up
sucking for some reason uh I will say
the hardware sucks but everything I
found with the 7 00 XTX the 7900 XTX is
phenomenal
Hardware um we have we have two P
requests that I'm very interested in uh
uvn is working on they have all this
tracing stuff that seems to just work
where you can trace like every
instruction run uh in a Shader um B1 TG
is working on and these are just
external contributors to Tiny CR it
could be you uh is working on getting
not using co-manager anymore just
calling right into lvm I'm not lvm is
like tiny gr does not replace lvm lvm is
kind of the last piece of external stuff
that tiny grad uses uh you know when I'm
replacing kernel drivers that were
written 20 years ago and hacked on and
hacked on and hacked on okay that's not
that hard to replace when I'm replacing
new code that's written as copy
Nvidia uh but just rename everything to
hip instead of Cuda yeah that stuff's
easy to beat but uh can I beat Chris
lner in
[Music]
llvm I don't know uh I'm not that I mean
prob who knows right like it's not like
like
like when
you're uh like playing up against people
like that or whenever you're playing
this is something I said about like
always like Tesla versus Kama there's no
advantage that Kama fundamentally has
over Tesla Elon is thinking in the same
Cutting Edge ways right there's some
companies that it's just when you look
at the advantages Kama has over
something like Toyota there's no contest
they're not thinking in new ways there's
no there's no one at Toyota who's like
capable of saying well shit what if we
just use a smartphone GPU and run AI no
one can say that oh we have this
approved thing from this vendor and it's
going to take 17 years and you know
we'll we'll have it part of like that's
that's the process of these companies so
it's easy to beat those kind of people
um then it's easy to beat like software
development teams that you can see what
their incentives are but can I beat uh
llvm who knows we're we're we're on a
Level Playing Field here we all know the
latest tricks we all know the latest
tools that's true about PCH
too like can tiny grad beat pytorch and
the answer is we can make different
tradeoffs from pytorch that may be more
appropriate for certain
users uh Goose cases but can we straight
up dominate pie torch no they're very
intelligent people working on pie torch
some of them are in our Discord now and
like I metah high grade programmers uh
so I'm I'm up against I'm up against
like a tier programmers here uh
so you know it's not like
um yeah there's going to be any clear
domination uh of things like that but I
do think pytorch made some tradeoffs
that makes it tricky to do some of the
things that tiny Gra will end up doing
uh or tiny can already do and I think
that's where a lot of the value will uh
will acre but it's not that the pytorch
team was dumb it's that the pytorch team
made trade-offs that were appropriate at
the time uh so many times you're you're
you're often uh with that you know
thinking like that versus when you
compare tiny grad to like qualcomm's SNP
yeah we're just going to dominate them
uh we have better Engineers who better
understand the problem
I dominate like the poker charm you
know uh so these things have tons of
ram why am I using Google don't ever use
Google how many free ones are they going
to give me let's say if this really if
this really stays open like this I will
use grock for everything please sell my
data to every hedge fund or whatever
whatever
whatever oh
um yeah so this is this is the
theoretical memory
bandwidth uh so it's 42.6 terabytes per
second that's terabytes divided by 37
gigabytes theoretically that's the max
tokens per second doable with deep seek
on one of those a300 boxes all right a
th000 tokens per second would be sick
have you been watching I've been
watching Claude plays Pokémon
know I bet on Twitch some guy wired up
Claude to play Pokemon it's cool you
know who's there like the OG Twitch
Plays Pokemon and
stuff
um
[Music]
so the big downside to it is how slow it
is oh the model is like brutally slow
and then it's like I'm gonna I'm in
battle with a Zubat here's the status of
my team okay let me think about what I'm
I'm going to do okay I'm here let me
think about it press
a okay I pressed a it went to the next
screen let me think about what I'm going
to do here's the status of my team I am
going to need to select an item because
I'm selecting an item okay the item is
down press down right like no just make
that go 10x faster it would be so much
more engaging so I want to get some sick
super fast seek
stuff up on the m300 Xbox and we'll see
what we can get it to do um yeah so the
first step to that is getting mixture of
experts to work in tiny gr and be
fast it's in China I always get a cough
when I go to
China something in the air oh I also got
the weirdest freakiest thing I went to a
massage place in China right and like
you know the White Lotus spey spey you
know U but it wasn't like that kind of
spey spey
you lean back in the chair and this
woman took a stick with a very sharp
point on it and cleaned my
ears and
like sticking it in the ear canal it
hurt um another another example where
I'm just
like you
know for the most part I trust this
Society
I see people moving around here everyone
looks pretty healthy nobody's deaf um at
least that I could see so it's
like I trust whatever is happening here
it's okay and it was
okay I also went to the the dentist in
Hong Kong I got a rude canal and a crown
um and it was another
like wow I kind of actually like I just
trust this a lot more than I trust the
American Medical
system uh you paid it a pocket it wasn't
cheap wasn't like crazy expensive it was
like a fair price but
like you do the thing you go to the
front you get the bill you pay the bill
done I give him my credit card I pay the
bill why can't you do this at a doctor
in America well so actually yeah okay
you're going to pay us now but that's
just the off office visit coopay uh so
you're going to have to pay for the
nurse but that's to a separate
contracting company don't worry you're
just going to get three easy and
convenient bills in the mail um you're
not really sure which ones you have to
pay maybe some of them you don't have to
pay who has time for any of this shit
I'll pay you 20% more here's my credit
card oh well you see that's a PPO and
you're in an HMO and that's going to be
out of network so we're going to be able
to build the nurse to your insurance but
the medication well that one is actually
the doctor didn't write that it could be
generic on here so you're going to get
that filled now if you do get that
filled and you go to a Walgreens uh the
Walgreens is going to have the the
Walgreens prescription discount if you
don't have insurance now I'm your
insurance company will advise you to use
the insurance but of course uh if you're
going into the Walgreens I can't really
tell you otherwise but Walgreens can
just you can go out of insurance and
then they can change it to the generic
and that's going to be cheaper but I
can't really tell you to do what why do
I have to know all of this
stuff um that's why I only plan to go to
the doctor in
Thailand yeah yeah I saw someone die in
Thailand when I was there
uh couple of months ago I talked about
this on stream I I saw I saw a
motorcycle accident I saw someone die uh
was a little traumatic and you look up
the road safety in Thailand and like
it's the worst in Asia by far and like
you can see why so I don't know I mean
I'm not saying like Thailand's vet or
anything I'm just saying that uh I
wouldn't blindly trust the Thai medical
system the way I'd blindly trust the H
Kong medical system
that was a bit of a Tang we got a lot of
tangents
today
oh okay well I got three free
grocs where were we oh we're reading the
Alo
paper um okay use dropless token Choice
routing what does that mean
I want see what we can reuse from mixl
and stuff see if we can get this running
oh yeah which browser are we switching
to I heard I heard Firefox sold us out I
we talked about this little last time
Google sold us out a long time ago is it
ladybird
yeah I'm using Brave on
stream I trust brenn and Ike at least
there's like a name associated with with
it so you know it's unfortunate that
they're in bed with crypto scams but to
be fair like bat was pretty early it
wasn't clear that all icos were a scam
at that point no but this Ico is not a
scam you have to check out the new Dent
coin it's going to fix that problem you
were talking about with Healthcare and
it's going to unify them all on one
simple
coin also sign up for the airdrop you
can get an air drop get air drop you D
the coin
all right here's our hugging
face which one do we want probably
instruct why does this one have more
downloads than the why does the base
model have more
downloads license Apache too what I
really like about these
uh all right so it's safe tensors
why are there three of
them like how do I deal with this how do
I deal with this in like mix
draw all right let's
go so I think it's just straight up
we even have to say download equals
true
uh why did that get downloaded there
like
this
whatever so it Keys it based on the uh I
don't think we need download equals
Trail
we really need to make
fetch we really need to make this an
HTTP
tensor so
these fetches can
happen in
parallel so fetch is just like it's a
little helper in tiny gr it's stupid but
uh
actually we don't have to use fetch we
should not use fetch fetch is the old
way of doing it by the way tiny gr has
phenomenal
docks um watch The Docks not have what I
want right now uh but yeah that was over
here from
URL so you can just do tensor do from
URL but this isn't lazy right now and it
should be lazy
[Music]
we'll let that download while we
uh do other stuff
oh that's cool I have a Wendy B
tell Allen Institute for AI this Paul
Allen it's pretty cool I've seen some
good stuff from them
like wandy V let you do notebooks like
this what they're running the arc
challenge
crashed cool yeah I think this is a good
one I feel good about this as a
choice wow this is new too or did they
just update the
paper oh they updated it with too which
do I have a change
list what they
change upside what is upside doing
it's so cool I if hugging face is really
profitable that makes me really happy
because it's so cool that you can just
download these huge things from this
website like no login no nothing
all right let's take a look at how this
is actually going to
work oh it's just
transformers interesting
and we could probably just do it through
the pie torch back end but I don't love
that this is what like everybody Builds
on and stuff though now I want to get
like really high token
counts uh so quick estimate of what our
what our Max token count can be
here uh so we're on my Mac and and then
is this going to be a what uh so it must
be FP 32 or FP uh
fp16 I mean it's got to be right because
we're downloading yeah 16
gigabytes model is fb16 or is it bf16
I'm sure it just says this in the pap
it's
fine okay so it's probably
bf16 you can quantize to eight pretty
well I like that the Deep seek model was
actually trained at eight because
whenever you're quantizing there's
always loss but if the model's actually
trained with the
quantization uh you can also do
quantization aware training uh which
does the same sort of stuff right like
but if you're doing this post
quantization is kind of uh
iffy okay so this is BF
entirely oh mixed Precision training
okay fine tune in bf6 well we'll find
out quickly actually we can probably
just see it if we go
[Music]
here pling face should show me all the
uh here we go okay yeah so the bf16
that's a lot of
Weights
cool uh we should be fast with bf6 on
Mac but if we're not this is a good time
to fix
it okay so
it's
1.3b active 6.9 B
total
um M3 is 400 GB per
second Max is 400 GB per
second 2.6 I don't understand why it's
2.6 and not
1.3 who can do math nobody that's why we
use
Google so in theory we could get 154
tokens per second I would be extremely
happy with 100
actually I don't know let's not let's
not undershoot ourselves that's the max
theoretical tokens we can get from this
model so this is just you multiply this
by two because we have 16 uh so it's
unquantized in theory we could get 154
tokens per
second how's our download
going I need this it's actually I'm just
not a 5G Hotpot it's how a lot of people
get internet in Hong Kong it would be
cool to have an actual
fiber I know this is one of the first
places to have gigabit fiber look at
this th000
m home broadband
home WiFi how do I actually get fiber to
my
home that
work
wow aggressive I'm not showing you guys
my
address I don't know yeah if I'm going
to be here uh so I'm going back to San
Diego for the summer I don't want to be
here for the summer
sweltering 85 degrees with 95%
humidity ah got we got interns coming
for the summer too it's always fun to be
on comma when it's intern
season okay um we can start loading this
now so let's see if we can use mixol and
what we have here
I don't feel
forward fun
tools these numbers are probably
incorrect why does it say jit false
stuff in the
paper all right so the number of
experts
actually oh you see yeah this this this
isn't going to work because it's
assuming that there's only
two which is not
right so we're going to have to change
that um I mean it'll still
run 64 experts crazy high number of
experts yeah so mixl uses eight experts
per Layer Two of which
experts I like this like Bolding too
this is cool this is a w written paper
okay so how much layers is
it I think it's
these here we
go okay so a hidden Dimension that FFN
Dimension is that Norm is that
rope doesn't
matter num layer 16 so there's 16 heads
how many KV heads are
there is that the same
oh using
mqa I think
no so is the default of that
none yeah default of that is none so we
actually proba don't need
that what's the vocab size
some strange number what kind of
tokenize this thing us who's got the
tokes toes toes toes toes lots of
toes oh good that one downloaded a
little faster can I please have some
Fiber just need some
Fiber vocab
press this is like a meme it's like oh
yeah it's only 1 billion but then you
need 500 million vocab perams I don't
know why they're treated
differently D you the want a
CPU is all the training code open for
this
too I don't know
I mean I think these things can
be trained pretty
well oh see this is throughput which is
a little bit different I'm interested
with the AMD stuff I'm not interested in
throughput right a lot of cloud fuckers
are into throughput um Cloud
fuckers
but I'm into I'm into high individual
TPS how fast can my AI think for me
talk about data is there like a common
like there's got to be just common stuff
everyone does these
days how big is the
data 17 terabytes eh
where's
uh libgen an his
archive looks simple enough
uh how much tokens was this trained
on where' the paper go
that's going to be fun to get to
work what's deep se's number on
that so V3 and R1 are the same model our
one's just like fine
tuned I'm pretty sure that's
correct it's very different paper
I haven't downloaded deepseeker anything
yet we're also going to find out how
much what SSD is AMD G gave me in the
boxes
um I Corker is setting them up
uh is going to be on Monday so we'll
have them up
Monday um
so how many uh experts is
this by the all our code looks like like
hedge fund code so interesting
they make things work and they make
things work fast at hedge fundes because
it actually like
matters like algorithmic trading code
hedphones not the right
word okay we use 32 no that's
parallelism where does it actually talk
about the model architecture
oh one shared
expert interesting okay so I imagine a
shared expert is just one that always
runs amongst the routed experts a will
be activated for the
token and each token will be ured to be
sent to most four noes okay
interesting yeah cool let's just look at
the about hedge funds and making things
fast let's see what we
got oh yeah I've seen this paper it's a
good
paper
uh no like this is this is what you
really start to think about and I want
to get to this level with tiny
well things are getting crazyy
I like the mlx guy and I like the
project uh I don't think there's a
future in uh Hardware specific
Frameworks I mean if any company can
pull it off it's Apple people are in
their own weird Apple ecosystem
never really coded in Swift I wouldn't
spend time learning it because it's not
used in a lot of
places um but you know to each their own
right like for people who are in the
Apple ecosystem maybe this stuff is
appealing okay um that running
anything why is that
slow what's slow
this initialization is
slow why is
that we'll get
there okay whatever um we have state
which is going to
load um
see if this is
fast should be
cool glad that's
fast by the way you can see it so this
is
accessing the Json from the uh safe
tensor so what we're going to do for a
lot of this uh stuff to make loading
faster is I could just like blit those
big files to the GPU and not do each one
individually
in
fact if you want to see that you should
be able to do like two metal here that
should just
work yeah
cool see see we get item
there great we're loading it at 6.5
gigabytes so I mean we could do two
metal there and then
that uh actually loads them from the
disc
uh which is
cool all right now I got to go through
and assign the weights
tqdm you can tqdm on a
dictionary tiniest tqdm you
can I'm sure if Chinese can do it 3 one
can do it too we have our own tqdm in
dyr because I didn't like it being a
dependency
State sure
CI see if that
works all right we got some weights
[Music]
I'm go find some more coffee
Amanda do we have more coffee
are you trying to rck me
yes okay
all got that dry China
cloth why is this slow let's try to
figure it out
so tiny grad has a useful helper called
profiling and you can just do with
profiling let's see why it's
SL no don't do that
all right
[Music]
um it's just like Randomness that's slow
it's just doing a lot of Randomness
that's slow
wow it's spending six seconds in
Rand that's annoying
want to like work on optimizing this
python I hate the idea of waiting 6
seconds who's got time for that six SEC
we don't know what the world's going to
be like in six
seconds all right chat Focus
just make a database of all the rules
and then we can use all the rules and
then have expert systems no none that
shit worked okay build
infrastructure wow
on
topic why is this
slow all time we're
wasting should we just spend the whole
rest of the stream making this python
not slow because piss me off that it's
slow
be faster the profile FL
I love how easy it is to just do
profiling okay so all the slowness is in
rammed and then we can like look at why
this is slow we can also throw a with
timing around
that but it's profiling so that impacts
a little bit but not too much so we can
actually just get a final verdict on the
time see if we're making things fast all
right 1776 milliseconds all right that's
a lot of
milliseconds
yo on
topic gon to ban people
we have like so many layers of in
Direction here
now what is this
crap mop
hello come
in thank
you it's I got rugged before and it was
tea and then Amanda tried to gasl light
me and tell me it was coffee it
was yeah this is coffee no that was tea
one was also coffee I tried it it was
also coffee she's trying to G me it
was hi no it was T they're they're
they're they're off topic what are they
saying some shit about like phenomes
like like what's a it's because people
want AI to be expert systems and not in
scrutable weight matrices but they're
wrong on it's inscrutable weight
matrices and you just got to have more
flops
bro I'll let you guys get back on topic
that's good thank you for the real
coffee this time that isn't
tea I promise last one's
also
enjoy we're not even working on AMD
drivers why is this shit so
slow it's because we have lots of code
got IND Direction the more code stuff
has the more slow it is
shouldn't be
slow it's also good thing I'm not
actually doing the real uh three fry
there okay how many calls to Rand do we
make
790 yeah they take
milliseconds that's C
crazy we're making lots of calls to
apply broadcasted
uops so this is all crap to deal with
floats and like we even made three fry
its own UOP
no wonder this is slow look at all this
Cod use
numpy think that's going to be
fast there's a lot of slowness here in
rapper too
tracing
stuff so
slow I mean one thing we could do is
like Drop it to UOP level when we do
this because the stuff's all fine to be
in the UOP
level but there just shouldn't be that
much
overhead we agree that like six seconds
to initialize nothing is not worth it
right
we could also have it like
not generate the random stuff but it's
not actually even generating it
slow that all
this oh it's all going from
rapper what's the default of Trace meta
one disable Trace meta how much faster
is it
a little
faster now we can see what things are
actually going
from uh a rapper does someone want to
fix this so we can like name the
function
right you know you is like functional
wraps or
something I don't know if that's fast
no see it's still saying that all these
things are called from rapper that
doesn't do what I
[Music]
want right there's a lot of slowness in
tensor and
N I just need a fast path in tensor in
itet what are all these things being
called with
oh I think I fixed forward to call
tensor a
net yeah it's just being called with you
sometimes we can go with floats and
inss it's already caniz that's
another piece of
slowness uh Funk tools. update wrapper
wrapper
wrapped it's the same thing though I
don't think that's will that fix where
Prince
there
trumai
bro I mean it's not even okay so what's
happening right now is we're creating
this is really because this number is so
high um because this number is so large
we're making tons and tons of calls to
Rand uh so we're making 790 calls to ran
even though it's only four layers it's
usually not bad it's like four * 64
times some overhead so it's just making
that initialization really
slow um okay here's an idea maybe we're
just not thinking about this right
I probably don't even want to do it like
that so let's just try first off making
this like
[Music]
one and now it's like really fast okay
fine that's probably just how we want to
fix
this it's creating all these linear and
creating I mean this this stuff should
be made a lot faster but this is all
just poor design so let's just like not
design it poorly we're going to have to
rewrite mixture feed forward
anyway uh so like we can just do this
and it should be pretty fast great 162
milliseconds everyone can wait that much
time okay we'll just rewrite mixture
feed forward and I'm interested in
people making this
faster all right you're banned
congratulations we got our first just
off topic ban
told you to stay on
topic it's problem I watch out for these
days you know those like AIS who come in
your chat and just try to make you go
off
topic if you're not here to pay
attention can leave my classroom
this stuff's terrible too okay we're
going to have to really just rewrite
mixture feed
forward
um let's rewrite
it could be able to use
that so let's look at what feed forward
is
this let's think about how to do this in
a less stupid way um
linear we're gonna have to go deeper
than
that let's go to NN
linear where was I here
down equals math. square root in
features it's like fine I whatever let's
do
empty empty is very
fast okay so our we're going to have a
tensor um yeah let's cut through all
this abstraction
layers let's print these names
[Music]
again you to stumble home with me girl
I'll be
directly
on oh God
you while the white house burns
[Music]
more groc
requests uh all right
like so shapes we got
shapes up down PR gate I think I gave
them stupid
names uh yeah W1 W2 and W3 those are
pretty stupid
names is that really like what they
are is that what they call them so that
one's a
gate
[Music]
uh yeah fine whatever uh okay up
equals
uh so what's the hidden hidden 2048 okay
so let's just do this tensor empty num
experts
dim hidden
dim Zer Zer
good uh we have down proc and we have
gate for got to actually run it
later for down prod we're going to want
to flip
those sensible Sensible sensible
that all
fast even Trace
meta be fast okay it's
fast so you see the problem we were
actually creating uh separate tensors
for the experts and it's probably not
the right way to do it you probably want
to stack them
wow it looks
complicated oh where's the
token this the right tokenizer who knows
what tokenizer to
use uh I want to try running the model
with zero
oh yeah I'm getting Chinese food for
dinner it's going to be
good sweet and sour pork sweet and sour
pork for dinner was feeling
that what are yall eating for dinner
psych that's off
topic okay well good we're getting to
there so let's print x. shape
and then let's think about what we
actually want to
do so we have input layer
Norm we have a gate
so we can probably keep
that keep one NN linear
around so this code is going to
eventually form the root of what we're
going to run deep seek really fast on
the Mi 300X
um and like you're like oh well why
don't you get the torch stuff working
the problem with the torch stuff is I
think it's going to come down to a lot
of stuff like this also getting things
to load quickly um is going to be
annoying right you want it to like copy
quickly off the disc so I'm going to
pre-
Shard uh hopefully we got hopefully this
has good ssds in those machines I'm
going to pre- the Deep seek model into
like just what we want to copy to each
GPU and I'm going to just copy it right
to the
GPU oh they should be on
pcie uh
15 PC
5 I don't actually know I got very
little info on these boxes they're
they're sitting in K's
office um they're probably the super
micro
ones but I do not know they might not
have come with drives too I might have
to go by
drives so how are these things
attached um we do have these nice this
interconnect is
nice uh how can it fit 8X of these there
has to be some switch
switch going to tell me there's a switch
you're tell me if there's a switch great
thanks super
micro uh the Box doesn't say super micro
on it so I don't know if it's super
micro oh it has this ridiculous board
whatever we'll understand this once we
have the machines powered up there's no
reason to look into this now uh but
we're going to have to like yeah think
about how to get the models off the diss
as fast as we possibly
can
um onto the gpus and then we'll going to
figure out how to make this fast so
there's a whole lot of things here that
like is not exactly clear how to do it
in tiny grad right now so maybe that's
where we should be Focus but let's first
write the stupid code to make this load
oh gr could probably do
[Music]
[Music]
it we're going to get rid of the word
model
attention it's called self attention
that's fine it's the same
[Music]
thing FFN
Norm are there multiple
Norms well this is the model so I
have korm and Q Norm are those
normal sorry it's been a while since
I've done any of these kind of models I
don't just know what's
normal you want to get good at something
you just got to do it 32 times uh okay
so why
I have FFN norm and attention
norm and I have probably let inut layer
Norm let's mixt deal with
this all it kind of works so mixol just
kind of has this I don't have to do any
Transformations on
it no I just did torch loud
so let's exclude these experts because
there's too many of
them we'll deal with the experts
later self
attention
korm K QV but
I don't think I have norms for them I
just have a tension Norm I don't have a
separate Norm for K and
Q is that
normal ah you want the mi30 project
uvn uh we could definitely do that I
think that sounds like a reasonable uh a
reasonable project could put up a bounty
for it and get you on one of those
machines uh yeah I'll I'll post when the
machines are up
uh yes so I think I think we'll have
we'll have two bounties for that
um and yeah the cool thing about those
bounties is I'm not going to give
everyone access to the machines uh but
yeah no I'll give you access to the
machines
we'll have the runtime Bounty and the
driver Bounty and they're separate you
have to do the runtime
first and then the driver uh no navy4
yet either I could I could throw up a
bounty for that one
too
uh my nav4 is not here yet I ordered one
on eBay N4 is already A4 uh for those of
you that don't know
um yeah so
these Norms are just not like I don't
have
that for
okay let's focus where is that I don't
have that where would that belong that
would be in my
attention so yeah my attention just
doesn't have
Norms it has
weights what I do with korm
and all right do I have any more grocs
come on grock give me more
grocs oh I'm not worried about sqt on
rdna A3 is fine for
now um but we should add basic support
for
rna4 uh we should yeah at least start by
adding support to the run time uh uh
H yeah see it's like it's not
normal do they talk about it in the
paper there's only like six tricks that
everyone uses for these Transformers
though just kind of like know them
a qk norm there we
go after the query and
key we find qan
Norm all right so I'm going to have to
support qk Norm
[Music]
here kind of annoying
so where are my other norms
have to pass Norm EPS in there
too or
do s k normals nn. RMS
Norm uh the
dimension is actually after the
ection oh just dim here is fine okay
fine
[Music]
dimk
n all right got Q norm and korm
so we reply them after the projection
like here
maybe is
right at least we have whole sment
now oh we have to tell it that we have
this so I created in there
to pass that all the way through
[Music]
Transformer junk
okay uh great we have holes to STI them
in
now uh no we didn't because we have to
say qk nor
equals 1 uus
5 great now we have q norm and
korm now we're just going to have to
write stuff that transforms that into
that okay so first thing we want to do
is say RC equal K
dot it's well model dot
right sir k. 6al model
dot we have that's not part of the model
LM head oh
well where do I have the LM head
let's get rid of the
model um
so like feed
forward. Gate Weight
becomes MLP do gate weight
all right which way are we doing this
transform going from that to that so we
actually want it to
be Fe forward
Gateway get to that other crab later
um like post attention layer Norm
weight
becomes where's post
[Music]
attention post tension layer Norm
weight where's attention
Lama where's
Lama post attention
lay yeah I know I could use AI to do a
lot of this faster but you don't really
learn if you do that so is there a post
attention layer Norm oh it's probably in
here uh it's called a tension Norm so
that's so FFN Norm is post
attention it's probably that
one and a tension Norm is which one
input layer Norm weight okay that's
probably
right input layer Norm becomes attention
Norm which is kind of I guess a stupid
name but it's clearly on the input
right so we're replacing it such that it
becomes the uh like the model weights so
it should be
good
okay see that's becoming that that's
becoming that uh still the self
attentions
jeez man the amount the like people just
don't understand
anything who has like if you go if you
don't understand this stream seriously
ngmi I understand when I go off the
weeds into like like crazy shit I
understand when I go off the weeds into
like ials and drivers and yeah fine you
know whatever uh that kind of stuff I'm
actually
like I mean that kind of stuff like when
you get to all that low L stack stuff
I'm actually one of the best people in
the world with that um so I understand
that that's hard for people to keep up
with but this shit I'm a Noob with this
shit so yeah if you can't follow this
like someone probably just actually
knows the hugging face library that just
does
this inspirational thank you thank you I
really try to inspire people I really
try to inspire people and tell them to
keep going because you keeping going is
I give fuck if you keep going that's
right like if you need somebody to
encourage you then you were never going
to make it in the first
place I I think I think so many people
like miss this when they talk about the
self-esteem shit like your self-esteem
should be precisely calibrated to your
actual skill Americans rank like 30th in
MCH math but number one in math
confidence math confidence is
bad it's just bad like you're just
learning wrong things you should be
exactly as confident as your real skills
are
okay embed tokens. we well it's probably
talk
embeddings that's right
all right we need an LM
head what's the LM head which one is
that Norm Maybe
there already is a norm. weight okay so
it's not
that maybe LM head is output. weight
those aren't even the right
size uh
okay embed tokens
if the one from the model is that okay
that makes me question the
dimensions these are all just
wrong okay so why do I think dim is that
and hidden dim is
that di is probably that maybe hidden
him is that
that's just
backwards shape
smge okay so MLP gate is wrong and
that's because num experts is actually
64 30th in math yeah I'm taking my data
from The Newsroom trailer nah I'm I'm
taking my data from The Newsroom trailer
but I've also seen Americans trying to
do
math if you're telling me that's not
true I mean my my lived experience backs
that up so you can tell me it's not true
but
no it's not
true it's not
true feed forward Gate
Weight what is
that gp.
app I haven't heard of this
cool okay so we have our experts and our
experts
are so I guess our hidden dim is smaller
than our
dim which is
[Music]
fine I guess linear so that's output
features that's input features
uh I let's just do it the same way
they're doing
it which would be putting hidden dim
there I think that actually is back
where it's
from uh I'll also
[Music]
m
I mean you guys want to see what the
right thing to do was you guys want to
see what the right thing to do here is
is actually just to print the whole list
print the other list copy paste that
shit into Ai and be like write the code
that changes these things for me and
like it would get it right
um
okay
so these ones are going to be a little
trickier because we're going to have to
get those experts
out um
there isn't an up down. gate kind of
thing these are all the experts
junk
[Music]
junk
layer junk
junk
expert uh name
junk then we're going to want layers
dot uh
[Music]
layer feed forward.
name model State dick so layer that this
do that in
F OKAY model layer equals
that uh stat okay so model layer
uh
sub
expert I don't know if you can do that
hope tiny supports that
see what that should
do OKAY model State assign State
[Music]
K uh assign device
mismatch
yeah place
let's copy these to metal should be
fast okay it's not that
fast now we have a sign D type
mismatch uh yeah because this should
be
replace let's get rid of those for now
let's just
move do that do to metal Ian it's a
little stupid but
whatever uh and this is replace and we
have the outside here to underscore
metal that'll QE
it all right now another Valu is to
unpack CU we got to split based on the
DOT
[Music]
string indexing is not
supported there shouldn't be a
string
oh
okay that might have loaded something
maybe all those signs are actually
pending which is
interesting um
let's take a look at T at
[Music]
selfup yeah it's not exactly right uh
let's take a look at where it comes
from look at the lazy data for
[Music]
that
um so I never got assigned to
or does that not assign in
place that definitely should assign in
place why is that not assigned
to see how it's not assigned to but it
should
be just still
zeros that should work
get
it
oh that's broken
that's good to know that that's broken
but this is actually creating a new
tensor it's not a
[Music]
slice yeah and then when I assign to it
it doesn't
work huh
you see why it's broken so that's
actually creating a new
tensor and then this is never being
realized so when I realize it it's
probably
fine uh if we do realize realize that
actually trigger the assign okay now it
like copies in all the
stuff uh
wait that's still zero no that should
not be
zero yeah
huh this gets into like deep tiny grad
issues tiny grad's not great at this
kind of stuff
uh and we have to this is a good thing
to focus on for mixture of experts
models and this is something that just
works way better in py right
now so if we want to do this what we do
is
[Music]
this say w equals that W
sub uh
experts
expert W sub Z
expert uh.
cat
uh state to
metal uh un squeeze
z uh
wub expert
one um
w. sign
I can do do replace there don't need any
stupid
assign should
work great now you can see that that's
actually aign
too takes a little bit of time but that
should be right
does that make
sense did you see what that's
doing and that's how like it has all
that stuff there so we
can like print the tensor and see if it
actually has shit
what why was that so
slow okay
what's it
doing okay it took a long time but it
got it sort
of um yeah so you know why that
is like it's trying to copy in all the
things uh
but because if that's a metal
bugm Alum doesn't support bold 16 right
is GPU if we want B 16 we got to do
this oh this is absurdly
slow is
stupid oh we have to just make a sign
work
so this is a different
problem like all this stuff works fine
when you're dealing with small mixture
of experts models but once you get up to
64 like 64 is a large
number actually almost don't think like
I almost don't think it's saved
correctly because instead of having the
tensors look like this it has the all
these as separate tensors which don't
tell you anything about how memories
laid out
[Music]
yeah I mean it is working it's just very
slow which it shouldn't
be what's the name of this
stream mixture of experts oh I said it
was going to be on the AMD stack I'm not
even using the AMD stack this is just
metal in fact the AMD stack doesn't have
this bug
I could do this over on AMD and it would
be faster I also could have downloaded
the model on that computer and it would
be
faster
um I mean okay this will fix
[Music]
it
[Music]
yay slowly copy in all the weights
you have 17 years to do this
[Music]
great all right there's all the way to
the mixture of experts model so like it
does work that's just really
slow
SL slow
you know what would be faster I think if
we put the two metals there it's fast
maybe so that's going to copy the whole
thing into RAM it's fine because I have
a lot of RAM on this
computer okay it's not like super fast I
guess those cats are just slow
regardless
of yeah the cats really shouldn't be
written like
that all right you want to write the
cats
correctly whatever let slow um get rid
of that for
now what we'll do here is we'll
just uh
we'll hand code some
garbage uh experts
sub int layer comma in
expert that shouldn't have
t no
equals
that oh we need name as well
isn't exactly right uh we want layer
name
here and
then
guess actually that doesn't really
matter at all it's doesn't matter at all
whatever that's kind of more convenient
to iterate over uh 4 KV in
experts uh
okay uh 4kv and experts model State dict
subk equals uh we want to extract them
all so do V sub I4 I
in range
64 SE when V = 64
okay tensor
cats uh no we'll just do stack do stack
right yeah
great guys know the difference between a
stag a
cat that's garbage
[Music]
um can't UNS squeeze a list now can
you why is that a
list oh
Splat interesting
that shouldn't be the shit it's not
right oh what model State deck no that's
not what I want uh I
want uh States
okay and we'll do two
metal I can't really stack them on disc
so that's not going to
work oh yeah see it needs a
renderer uh if we do 2 lvm and then we
do two metal that'll
[Music]
work no it won't because it's B Flo 16
see the problem with doing two metal
here is this this is another
long-standing bug people need to really
work on the front end you get this but
notice how much faster the whole thing
is so that's
good okay okay okay let's put this
[Music]
back takes a little bit to load them but
at least that problem should be fixed
great problems fixed
it's a little slow because it's got to
load
them is that printing
[Music]
garbage it's actually loading really
fast if that's real hang on
uh no that's not the load the load is
there and it's kind of slow
actually uh the load is here okay the
load is actually kind of fast that's
fine it's a pretty good
speed so we're getting like 9.5
gigabytes per second so it takes like
it's taking like three seconds to load
the no sorry taking like 1.6 seconds to
load the
model I don't like having to sit here
and wait for that every time but there
probably not gonna be in the way so I
mean it has to eventually it has to get
onto the GPU somehow
and it's super nice how fast this is now
because that's no longer uh that's just
like on the GPU
by the way like something you guys don't
realize here is just insane that no
other Library can do this Safe Load is
actually operating on the GPU so we're
running the safe tensors on the GPU
uh
meaning like you can just copy the whole
file in and you don't have to copy the
tensors one at a time all right now we
have the
shit now we actually got to make this
work the first thing we're going to do
is run the gate
[Music]
[Music]
so now we on the
gate and now we get to another thing
that tiny is bad
at why is it all
once I mean we can copy this I don't
know why that's all ones but all right
so now like this is going to be slow and
then I guess we'll first make it slow
and then we'll do it
fast all right so this this is
uh
Norm they can only be
one it got to be like a soft Max here
this Cod is
[Music]
buggy are you agree there has to be a
soft Max
right oh I guess that kind of is the
soft Max okay that's
fine uh so this the genericized version
of this is some Lambda XA XA
One
landing x sub one 4X in
top uh
right so this one just implied it was
two but it doesn't actually have to be
two just go crazy here stick that
there all right um now we want to run
let okay okay this is doable
uh
self. uh so cell
I think maybe this works see this is
again this gets into like the indexing
stuff we're pretty weak this is a if
someone can make this stuff
work uh like make this indexing stuff
work
well it's a lot
better
uh xla needs to spend 10 years
transposing tensors before upload you
see you think this shit's bad and Tiny
grad try to do it somewhere
else
slut sell you
close
um let's run
that why did that all just lowercase all
my tensors don't do that
okay
x times self.
gate subcell
x uh self.
down subcell self. uppr
shit uh and then we're going to want to
average it according to that okay so uh
always
okay so let's
um probs divid equals problems.
sum uh alls
times probs is that going to broadcast
how I want probably
not uh but
whatever times probs .x is
zero right something like that do right
so you see we're doing the sword on the
CPU and that's slow so we'll have to fix
that
um
okay oh of course it's
self oh tensor objects is not callable
uh yeah that's fine um
um let's just like print that.
shape and uh also print x. shape we have
to like map all them or
something
[Music]
yeah can I just map all it is it right
what's in
linear have to transpose
something sure looks like I could just
like that's my inner dimension of the
Matrix so instead of calling it I just
do that
[Music]
right
okay why can I not DOT
those oh I guess because it wants the
inner Dimension there okay
fine
um where is
linear yeah okay I do a transpose there
fine
crap I don't know why it's always done
like this but something about like how
you put it
Ram was a good error message thanks
tanyr thanks for not giving me a
terrible error message
all right
well it's not right either why
not if you see what I want to do
right is it not even do like I just want
to
whatever we'll do with batching
later I think what I want to do is just
literally multiply them and sum them on
axis
[Music]
to let split this out a little bit let
be less clever okay up Chanel cell we
can literally just multiply it by
that and then we can sum it on axis too
beauty of tiny GR
that's plenty fast it's lot easier to
think
about I'll sell you that
one and
then right so that times that is going
to broadcast on those Dimensions which
is exactly what we
want then for
this say x.
down that to X do
down that's probably not going to
broadcast how we want uh
reshape okay so this should be self.
activated experts 11
one
um so this one's going to be different
actually
fast mixture of
experts all right we're not trying to
dot shit
boy that one should be doable though can
we dot those is that GNA Dot
it should die right
all right
uh fine we can't dot them
fine we'll multiply
them I love tiny Grand this so easy dot
UNS squeeze
one do sum
two pretty sure that stuff's
right let
groc I don't want to wait for
this all right good we're not DOT
anything anymore we're done with
DOT self. activated experts. one onx
zero right shape
Stop Printing all that stuff why you
printing all that
stuff
okay
something great I think it's running
it's got to be the slowest llm I've ever
seen but it's
running so this is another this select
is going to be hard to write
who thinks it who thinks it works
what's up PR
okay you think that's a good
token okay there's like 17 things we
have to do to really make this FL
why the jit's disabled because this
can't be
jitted the loading all seems
okay I didn't give me a nan either which
is
good uh
so much shit
here do need variable
um ar.
temperature try
zero or.
count
10 uh let's figure out if this is the
actual tokenizer we
[Music]
want be deleted okay where's the
tokenizer
[Music]
it's made a Json
which tokenizer does it
use what am I going to load a j can this
can this load a Json
tokenizer
tokenizer not a string
oh this looks like a string to me what
you want
doix canot parse model Proto okay so
that's fine how do I load a Json
tokenizer no no no no no no
llama that llama the the
Llama do have a Json
tokenizer or is a model
[Music]
tokenizer
tokenizer CH token
here we
go all right the appropriate format for
pre-trained tokenizer
fast the hell is
this depends on the tokenizer library
of course
not that would be too easy and that
would be too simple and
convenient
Transformers that work
that's going to import P
torch could not instantiate the backend
tokenizer you need to have sentence
piece installed I installed sentence
piece okay how do I load a
[Music]
Jon God I doesn't even use computers
a
Json
okay canot parse model Proto okay can
sentence piece processor load a Json
no Auto
tokenizer from pre-train
no okay okay we need to write custom
code okay I understand fine we'll write
custom code oh it's unnecessary since
you can import a huge massive ass
Library that'll do it for you okay I
understand yeah yeah yeah yeah
yeah it's totally reasonable it's
totally
reasonable Chas on object must
be read
text
happy great that looks good
[Music]
Okay g delicious want's an
apple who's
honking that doesn't sound
good wasn't
me for
this looks difficult to
use fine what if I do that are you happy
all there you go using I'm importing a
library I give in I give reporting the
library is that it takes forever to
load going to be
faster
slow let's shame it for being slow by
putting it in a with timing
block no no no but this is a fast
tokenizer see 950 Mill seconds who has
time for this kind of
[Music]
shit then how do I even use the autot
tokenizer I use
this am I out of
grocs uh
what's b
i one sounds
good one good we happy with one
it's extra slow right
now cuz I actually told it to do
something oh look how long it took to
get me the word
padding that can't stay
three
seconds this is why you can't use
libraries they take
forever who has time for
this time's only currency
right all right what token do we get
next let's see our tokens
[Music]
oh good it gets
faster it's almost too fast what was it
doing the select so
fast okay well that's what we
got I don't know what's zero maybe zero
is better than padding padding is what
upset it let's see how long that takes
to
decode like this look
[Music]
at oh IP address okay well that's great
um where's that token
Json can we read it in hugging face
maybe all right
[Music]
padding
spaces phone number
end of
text Bosnia
[Music]
[Music]
just using the KV cash that's all
good okay probably have bugs
somewhere where could the bugs be
everywhere
let's ask
grock
no all right we'll have to go to stup
grck
it add a proper P torch module structure
that's
good oh yeah it would be nice if we had
a top K let's get our top K to
work
uh well I bet you that's wrong
getting pretty sick uh
bandwidths that looks good actually
those look
good routing to one of the
experts
normalize some across that axis that's
sick though it's probably wrong
it can't be the shapes match the shapes
match how could it be wrong that's like
when a type checks in
hasle that gets fast
too the only thing that it's not doing
there I get item Colonel that works it's
crazy okay uh
why why am I getting
junk Maybe is not supposed to be the
first token it's the only thing I can
think
of unless this bugs then I can think of
a lot of
things all right how do I get the first
token from Auto tokenizer
okay tokenizer dobos
token try to BOS
token that is what I do in mix right's
mix can someone write good
uh if it doesn't have a b token that's
why I used Gro 2 why does it take 13
seconds string object could not be
interpreted as an integer oh BOS token
ID oh of course why does it take so long
to import
that someone needs to write tiny
tokenizer oh end of text what that's the
boss
what does boss even
mean
go I don't where is end of
text it's like
there I mean it looks stable it's not
and it's not zeroing so that's pretty
good
quasi seems quasi
[Music]
plausible com that out
it loads the weights in milliseconds but
it takes 4 seconds to import auto
tokenizer from Transformer on an M3
[Music]
hello
in B in
bu okay
well yeah yeah it's probably not
right hello Indi and burn hello and
being
[Music]
burn um
I forget
anyless the model has extra ones
go and think about it for a
while did I put those Norms in the right
place like I can't really think of where
else they
go I guess it could go in front of the
thing
output wait for the final layer so
that's LM head yeah that's
right oh okay like we already kind of
like wrote most of this so it's all kind
of
right uh input layer Norm becomes a
tension Norm embed tokens becomes talk
embeddings LM head becomes output and
model Norm becomes Norm okay that's
already done
great we're stacking the experts that
all looks
correct what else can to be doing
wrong oh I think the norm thing
oh oops
korm
typo that could explain
it see if the AI finds
it this thing's very
talkative ah the Q Norm is there we go
hello and be
[Music]
burn I think
I'll hello in in in in in the same at at
at
Endor little temperature
maybe k
probably fine if it works in
uh not jitting
anything well the temperature did
nothing I guess that's a pretty low
temperature
let's like just print before you go to a
Max and stuff
okay the first one looks very different
e
it looks like all equal probable for the
first one is probably
wrong the thing about that code is like
I know it works
oh deal with
that so it without the KV cash if that
makes any
difference but because it shouldn't
because that code works but
this stuff all should work in bf16 on M3
no
problem um Rel loading in the
experts oh
well that's
annoying does anyone support that
like
okay what we really want to do is just
transpose those two and then dot
them that should work right oh maybe we
do it the other
way let me read the code for the
linear Okay so so we'll try X do
dot uh
this uh trans
permute uh Z one to
thato I having backwards or something
[Music]
uh okay so there
yeah okay that actually shouldn't be the
size not waiting for that's stupid token
loser every
time okay so here relax do down which is
going to
be
do
dot
this should mostly be right
okay
[Music]
um yeah okay that's
fine the problem here is
this uh
one one I had
originally all right it's going to be
fine for the first layer it's going to
glitch out of the second
layer uh because we're going to have to
do
ex that
shape is that the same math as that I
just don't really
know yeah it looks the
same I don't know why that's not oh why
is
it that looks
different okay this stuff looks
different okay that's good
don't think it's better I think it's
stupider
but looks different at
least um yeah that's just going to be
one come one that's
fine so we're going to broadcast across
both the batch dim and the uh the other
dim then we're going to sum across the
mixture of experts term
do that normal space that's fine it's
the same thing I did for mix that could
be
wrong there's another potential
wrongness oh let's wait forever to
import the tokenizer again who's excited
about
that I see it's fast as long as I don't
do anything with the
tokenizer no the Apple
hello in
O in O in O
Okay
useless for
okay like something's broken if those
are
different I hope that actually works
looks pretty good to
me okay we're picking eight
experts um I mean I'm pretty sure that's
how you combine them
oh oh why don't we just import tensor
flow oh no wonder Transformers is token
so slow
where could the bug
be let's go back to the
paper okay
we
[Music]
perform parametric RMS
layer despite reducing C
wow
for for
okay what else did I do
wrong V balancing
loss for
know what looks
right we the good tests I'm going to
just say that stuff's
right for
okay I what could be silently
wrong KV
heads rope
Theta our rope Theta does this even use
rope that could be wrong let if llama
specific
assumption Rope Rope th is 10,000 okay
that's
right attention heads
16 layers
every what's dmoe
decentralized mixture of experts oh it
sounds like crypto do they have a
token have they considered a token I
would really trust this project more if
it had a token
okay the only thing that it could
potentially be is that there's an nkv
heads thing or just some other like bug
that I just don't
understand it's strange that those
switch okay the activation there is
Squig Glo so I'm using Squig Glo this is
Squig Glo or not
silu is Squig
Glo oh no what if Squig glue is not Sil
you do I have Squig
Glo what is
this what is this are you going to build
a Squig
you're going to go oh going going
camping in the snow we're going to build
a Squig
Glo uh what else uses Squig is it could
it be
Squig the hell is
Squig doeses llama use Squig
Glo swis and GL every new llm uses it
llama 2 uses
that is it Silo is it the
same someone has to know this
right for
where's my Squig
glow it's in here no it's not it's in
here here we
go
swish it's not just swish we have to do
more
oh how does llama do
this Sil you oh this is Squig Glo
oh I see we squiggle there and then I
see okay fine I'm doing
that oh do I is the gate
[Music]
there fine we're doing squid
though yeah yeah yeah yeah but which is
what are these what's up PR down p and
gate p is that right right or did I mix
up gate p and
up which one of these is called the
gate does the gate have the Squig Glo or
no
no no KN grock two
no oh you put the gate P there and the
up P there oh you think that's going to
fix it got to put the gate P there and
the up PR there all right all right all
right come on hard of the
cards heart of the
cards I'm playing Magic draft on on
Fridays those look a little like they're
railing out I don't know if that's good
or
bad was very excited to use that expert
that's the hello expert
[Music]
hello buer this already doesn't look
good hello burn oh
oh hello burn
I'm mate all right this looks like
better I guess
a gate P okay we sure the gate p is in
The
Silo and I had that
backwards gate has the CIO is all
right try
that
um there were some issues maybe with the
KV cach
that's the same crap
there it's picking a wide variety of
experts that's the
same hello bar amongst all right this
looks like it works even less
good less well even
gate prod goes through the silu okay we
have definitely confirmation that gate
prod goes through the
silu then multiplied by oh and added as
a residual connection to the input okay
did we forget that we might need a
residual connection to the input oh did
we just forget
that so hard to get
right um all right
forward no it just looks like
that okay the the residual is just done
there so it's done in the Transformer
Block it's probably all the same
K
up upgade dot it with
down some that across a is
zero after we divide there
end of text
buyer it does really like that one
it's not
[Music]
wrong I don't think
so
oh well okay it's definitely not going
to work if we do that
no that's not I love the
ways only bs1 but it's even more than
only bs1 it has to also have the second
dimension only B one
because that's why we're taking two
there do weight loading we're doing that
fine how did Gro miss that
is
buer crap it was never going to work if
that other one wasn't uh wasn't
zero
junk how do I disable numai um
you can watch the mixt stream and you
can watch me probably do like all the
identical things it might even be the
same
bug can I print that on one line please
I am loading these right there not
actually
[Music]
zero I that one's kind of crazy
could the problem be that any of this
stuff is in flat 16
that should all be
in we can PR the time just to make sure
but
[Music]
okay all right not a B flat 16 issue
G pro pro I make more
typos that expert is really
excited could that be
wrong e
hello
buyer well let also print the uh logits
where's
logits so the KB Cas stuff has to work
but also that doesn't explain why that
sample is
wrong like hello definitely the next
word for hello is not buyer that doesn't
make
sense I guess it is one word
right not like like hello is one token
right
yeah it's one token we can try a
different
word um I'm is that one
token no that's two
tokens
one what got to be one
token that's one token okay cool is that
also going to look that token that thing
is Big
again so that one's always big I mean
that could just be normal for that
layer is that buyer
again okay that that gives me a lot of
pause that's something is just
wrong uh what are we zeroing
out could the gate be wrong or is my
embedding
just for
okay we're sure this stuff's right
right oh maybe Max context is
wrong that shouldn't matter I don't
think but maybe
uh sequence like this 496 I mean
again I don't think it
matters no
same okay uh
[Music]
H
H okay like it doesn't seem like
anything's blowing up
the numbers are slightly different
what new trick am I
missing does qk Norm have a different
EPS no it can't be that it can't be
something stupid like
that attention heads num
layers could my mixture of experts be
wrong we sum them or maybe there's a
chance we don't waight them by
probability no that's that okay that's
the same that's actually what I'm
doing I
believe like X is right there what is a
soft Max
again e to the / the
okay
what I don't actually do soft Max why
did I divide it by some
again doesn't
matter I don't think that's a problem
okay what else could it
be
dropless with token choice
voice the hell does that
mean for
didn't like my typos here did I
the multiplication does not assume
broadcasting again
now asymmetry must be intentional but
unusual
no it's fine I don't care about
that
uh all right I mean I guess I can just
say I'm going to just say soft Max
equals one sopt want
[Music]
it
change I guess they already sum to
one oh they don't sum to one you have to
do it again because of the uh we'll just
leave softmax that's fine but you
actually have to do this again because
we're only selecting a certain number so
that's making all the probabilties sum
to
one no it's going be the same crap
though
whatever everything's excited about
softmax leave it at
softmax
um that's right
shape mismatches
what also
huh why are you putting that
there I don't think you know what you're
doing
this
commute that dot that
we know what the shapes that going to
have we Su across that we don't keep the
AIS that's right
okay and if it's the first token that's
wrong the problem definitely isn't the
key value cache which is
good the only change I made was that qk
Norm
crap wait
what oh no never mind
never mind it's annoying
um we don't also apply it to the vorm do
we maybe that's the problem
okay could that be layer norm and not
RMS Norm
should we read can we find an
implementation of this somewhere that we
can
read is there something here or is it
only like moved into the Transformers
library right
here
um expand attention mask omo RMS Norm
doubt that's different from the normal
boring
shit that doesn't seem
weird router prob per expert see c a
long
confusing routing weights okay know any
of
that auil load balancing what
stuff shouldn't have changed okay
definitely gate prob is
there so that change is definitely
right just like quickly like print K
here this isn't wrong right
yeah down P up P gate
P model State dick replace okay
right I mean like if I comment this out
it should just behave really stupidly
right
no it looks smart
actually well sort
of never mind it look stupid okay so
it's definely doing something
um and these are all like that split
would fail if that just wasn't right so
all right MLP gate is feed forward
gate the gate's not one of the experts
so that's being set correctly
here's the
Norms clip
qkv they R qor and Norman
States oh which is what we do
to yeah I don't think this can really be
wrong I want to put it before the
reshape right yeah you put it before the
reshape okay so there's the there's
their
reshape um then you apply the shit
whatever K Norm applies to k q Norm
applies to q that was a bug we
had I doubt it's that
clip we don't have
biases oh num key value
heads that is the same
right num key value heads is none all
right that's
fine um
okay what is Norm topk
prop whether to normalize the top K
probabilities
interesting so you actually maybe don't
do that
again if it's really
that oh
it behaves almost dally I can't be
that same crap
what
could it not be RMS Norm
those are RMS Norm
uh interesting so that's
zero okay so we'll get rid of that
Norm mean it's
yeah for
I would never write this like
this that's going to ignore the top
ones that prude I'm pretty sure is
correct pointwise multiply gate by up go
down by
down that goes
there zero so we're not even getting
into variable
stuff temperature is zero so that's not
going to do
[Music]
anything dot
item it's not the problem
okay post attention layer Norm is FFN
Norm
I think we checked all that stuff
all right who knows who can find the
bug what strange shit changed in this
model
call
[Music]
on what at that
see if that doesn't look
stupid look fine
why is this
wrong what was the bugs in the mixol
what did I have wrong in the mixol last
time I tried to do it on the
mixol I apply the experts here
and move everything around on
[Music]
devices I manually divide those both by
the
norm this terrible
code what if I say let's start with like
toes equals z how different does it
[Music]
look
strange
really that
different or did I just break something
interesting almost working
[Music]
who can find the bug before
me how come if I do that that's
crazy that we get
that like it can't be zeros can it
I guess there's no biases in any of
[Music]
this no that still shouldn't do anything
that doesn't make
sense even if those are all zeros
well that just looks like numerical
instability at that
point I mean I have a whole bunch of
questions
why is the token embedding for zero zero
that doesn't make
sense oh that looks totally wrong
why is there so with zeros in
there or oh maybe those are just fake
tokens like it can't actually be
zero never mind that might be
fine and then yeah like it makes sense
if you put zeros in you're going to get
zeros out which is like normal I guess
and that's just numerical
shit is a
silu have a fixed what's silu
[Music]
zero so z z okay fine this is this is
all just like
symmetric so okay if you give it a
stupid token it gives you a stupid token
back is this going to give me buyer
again
see that's this is what's cool to play
with though you learn things like
that that just seems more balanced like
I'm not getting an outside token
there 309
I that's a very reasonable
letter I didn't fix anything did
I I guess I did the soft Max but I doubt
that's
anything oh I fixed the K norms
we going much more balanced these look
it's a little less balanced but once
we're in eye territory it's thinking
about itself so
come on you're a reasonable
token it's getting slower
i period seems
unlikely does the Llama have to put a
boss ID
first I have so little experience
actually like using these things you
know
yeah okay so it does it does put the
boss ID first so this actually like a
plausible thing to believe that
like you have to actually put the boss
ID
first that is what Mixel does right oh
this isn't even the boss ID this is some
other stupid ID it's called
padding oh okay so like maybe this is
literally just that I hope it's that why
is this so slow
now did I like break something seems
slower than
ever so this not even the b i
like slow metal land for some reason
sometime metal just gets
slow all right we're putting in the bar
ID railing out to that expert again
is that
buyer stupid buyer
all right who's like who knows this
stuff um what tokens am I supposed to
put into
this Co
no what
token goes
first into an
llm boss
beginning of sentence token
why is that called end of text but
whatever it should not be giving me that
though it does matter what I put
in which is
interesting there's no way like
something could be transposed that I'm
not doing right I know like the GPT crap
does like transposed stuff
I guess it could be missing a layer
bed tokens way that's right what about
the
output now put that way it's right
can I see if any Rands are actually
triggering that would let me know that
I'm missing
something um
what am I
missing freaks
sis it's probably okay
yeah I'm fine
[Music]
oh maybe one of the reasons it's so slow
now is because we moved everything to
stupid floats we don't actually need
floats that stuff can be keep that in
bf16 get the Ram faster this
copies makes no difference
I was really hoping I was on to
something with the
BS still print Logics print logs print
the
Logics we don't print the
Logics wow it's way faster if we don't
convert that to
could this be
right burn a former US I mean this seems
coherent at
least just loves
burn it's also fast if I don't make that
float get rid of the other to
float oh I know why it's just slow cuz
it's that's a lot of ram it's killing my
Ram oh it's probably it was probably
swapping to
disc no wonder that was slow okay fine
fair I won't ever make you go to disc
again I'm
sorry gotta load the
tokenizer
burn a former US enter enter enter enter
ENT enter enter
enter uh I don't know about
that still some bug but all right I'm
glad we're fixing the speed
up where's that other float get rid of
that one more
floating only
sinking uh the problem with float is it
was making the uh the thing really big
especially because I'm not deleting I
should delete these tensors when I'm
done with
them
fros burn a former US enter enter enter
enter all right um for this one am I
giving it a
temperature yeah 0.7 is the default
temperature so we can try that too I
don't think I think it should still work
without that but you never really
know delete
print compile all the layers compile
compile
compile yeah seems
unlikely okay importance of self driving
education I mean this kind of looks
coherent it's not a large
model no okay it's not this
stupid there's some bug somewhere still
I'm GNA guess BOS token ID is
fine if it's instruct it's even more
important
oh oh you're right it's an instruct
model
oh why don't we download the
non-instructed
end of the page for how to oh
that's the non- instruct model let's not
use why did I downlo the instruct model
can I just get rid of the word
instruct that
work take forever to
download they hav an improved one
wow they popular
model all we're downloading this
model Bitcoin is
we need also fast ways to just like
quickly test it on one of these things
and see if we're like that's the only
way to really test if you're running
these things correctly is going to be to
actually put it in one of these
uh just like one of these
tests oh and this is also a different
Arc
don't Norm them hiden activation is Sil
you that's fine which what we're doing
not doing any Dropout that's my rope
Theta I don't really know what rope
Theta is but that is what it
is uh router aux lost coefficient that's
only for training
right number of key value heads is the
same as attention heads so that's just
nothing number of experts per token is
eight Max position embeddings again fine
initializer don't care about that EOS
token ID is that which is what we
use yes
um so like yeah there aren't there are
like special tokens for these things
does the instruct model have a different
uh wait
huh don't trust that
yeah I shouldn't do the instruct models
that's a good
point leverage hugging phase to get the
inputs Yeah well
yeah I guess I could I guess I could
just run through one token at a time I
don't have to sample from
it still going to take 10 minutes to
download sorry my internet's
slow what's for dinner
fishes I love fish
there's this sample
wow M Moe
girl how good is how how good is that
stuff now it's been a while since I've
played with
that I remember being really excited
about at the beginning and I think a lot
of people were but
then you realized it's just not that
good talk about this a little while it
downloads I've read this before
so one of the downsides to Nvidia one of
the nice things about AMD is AMD
documents they're
uh documents their real instruction set
Nvidia does not document their real
instruction
set um they have something called
SAS which changes from generation to
generation and then PTX is transformed
into
it well chat's quiet because when chat
says some shit they get
banned every time you talk in life it's
just like you could get banned this
time
um should we let let we let
nonsubscribers
talk we'll let nonsubscribers talk while
while the model downloads
you're not free you're cheap because you
don't
subscribe who thinks it's just going to
work I'm going to regret it soon enough
what am I going to regret
to see chat
format what am I meeting an amhq what am
I going to do there why subscribe when
there are ad
bloggers add special tokens add
generation
prompt what's the generation prompt
indicate the start of a
response subscribing is like paying for
Windows
you see I would say that but you're
subscribing to me and that's the
difference you can pay Microsoft money
you can give you can give Sati and
Nadella more money or you can give me
$2.50 uh no hey hey look look look look
you I used to tell nonsubscribers that
they were bad people I've I've come
around on that I've mellowed out a lot
you I moved to Hong Kong life's just
pretty good
so you know we don't got to we don't got
to bash the this isn't some hyper
capitalist America we got to bash the
nonsubscribers we just have to gently
remind people that you know social
cohesion only works when we are all
socially
cohered and if we let people drive a
wedge in between us like not subscribing
and then we won't just get to talk and
it'll just be it'll just be less good
because we all need to work together to
make the
society it cost a dollar to subscribe in
Russia uh when I moved to Hong Kong uh
well like as Hong Kong immigration will
remind you I do not live here I am
visiting
uh been here since like last August I
don't know
if uh yeah if you if you missed the
beginning of the scream I told you about
my experience being interviewed by Hong
Kong immigration which was surprisingly
reasonable
um you know the CCP you people it's
actually it's it's so weird like I think
the average American thinks about
politics so much more than the average
person in China or it's periphery
countries like like Americans weird
obsession with this shit like whose
president is going to affect what you're
doing tomorrow like it's
not
um no my internet could be
faster
yeah if he starts World War II as was in
China
as sitting at this Pub and these British
guys are
talking uh and uh
they're talking about yeah World War II
and all the nukes and all that stuff
like I don't know I maybe maybe that's
the vibe more in in Mainland but I don't
think that's the vibe that's definitely
not the vibe
here uh like you know who who's nuke and
Hong Kong nobody it's just
so let the let the people with the you
know I keep saying you know I gotta stop
saying you know
no reason to think about something
people can't change
that's God grant me the serenity to
accept the things I cannot change the
courage to change the things I can and
the wisdom to know the difference
there's a reason my phone's a blocked
her apparently hasn't been the
same what's
YH oh oh lkf like the like the the bar
Street how I'm I'm 35 you think you
think I'm going out like binge drinking
and listening to like let's make a night
you can remember be the night you won't
forget you think like I'm I'm gonna like
dance around to that kind of music and
and uh yeah no that's
uh maybe when I maybe 15 years
ago uh no I saw I saw the clubs in uh
Coco Park and in Shenzhen and I was like
yeah I'm too old for this
wait so it's like the same with that
model I mean I don't know maybe that's
just
right 29 is that a good
token a greater than sign I don't think
that's
right maybe actually what is
this I think it's actually
working it's just like this is what it
generates I don't know no I'm sure
there's
bugs I'm sure there's bugs that subtly
degrade the performance
must be real number not n
type so this doesn't have a boss token
ID or this isn't the right tokenizer or
something none
okay
okay what's going on here
[Music]
the current process just got
forked STP fork in my
process and get kicked out of pon
[Music]
like it's still it loves that 30 on the
third
layer it's got this got small model
spell no it can't be this stupid three
is that a good
token hello quote no this isn't right
there's no way this thing's this dumb
there just B
the first line of the file is the name
of the
file I don't know why there's not a boss
token ID anymore
though because I went away from the
instruct bottle
uh okay let's fine we'll download the
torch
one can even try torch with the tiny gr
back end let's see what we got um
instruct not inst not instruct
can anyone start work on jit Mo well
that's kind of what I'm doing great
we're going to have to redownload it
somewhere else
uh did AMD no AMD sent boxes legit
what else could be wrong
maybe the ll. CPP one is
simple for
I just feel like that's
wrong it doesn't happen with all
tokens see like that token it doesn't
happen
with and if I pass in zero it doesn't do
anything at all
so you're think in tiny gr you can
always run with debug equals two and
then that'll show you the uh like how
what it's actually doing
so we can look and think if like it's
doing anything
stupid fine
there's
your qkv
thing there's your
attention where's the mixture of
experts well actually that has to happen
up top
here get item
here be interesting let's see what it's
actually doing
so we can look like these are
the those
things I it's like probably
right wait what what's calling
numpy have a lot of questions about
that like nobody has to realize
those inner ones then it gets
the order for that to work
those are all the slow ones
are for
just for
sanity that looks fine
28 GPU servers
[Music]
[Music]
or some crap
broke why is this what does this tied
weight Keys
mean like I feel like it's something
like
that that are potentially tied to
another in state deck
doesn't matter
this should affect
yeah I made it to the second file okay
well that's good
by the way if you want to get good at
machine learning I always say this this
is how you do it like you're like oh
well you're actually just sitting there
and you're just debugging stuff and it's
stupid and there's one bug and they
someone just show you the bug yeah but
then you miss the whole
point by sitting there and struggling
and trying to find these bugs you're
reading all of the stuff you're learning
I'm learning all the new tricks it's
been a while since I've hav one of
these so I'm like I'm learning all the
all the tricks of what the latest stuff
is the norm is there is that the
same you know we've also never really
tested our uh like our stuff period
we've never tested our llm
implementations to see if they're even I
mean they're not totally wrong they
print reasonable stuff but that might
not be
enough the FFN norm and we have feed
forward and then we add before the norm
to that or continuous
there figure excludes in details Al uses
qk Norm okay see now we know what qk
Norm is and we did that
I mean probably what you want to do to
test them and I'm not really doing that
we can go through we'll just we're going
to start comparing the layers to torch
in a minute because I don't know what's
going
on uh
on a scaler
oh
really score one against torches thing I
don't know why it like doesn't work
um yeah that's fine
F it's not
wrong fine
I could have done this somewhere f with
a faster I could just test this
somewhere that has fast
internet okay I have my suspicions
around those tied weight keys
Ed tokens and talking about dinner's
ready we're
streaming doesn't work yet
she
wants I think we got to go to dinner and
then come back and then we'll find the B
and then we'll make it fast that's all
good we got to go to
dinner I'll see you all in about
all right I got fish to go eat uh I'll
be back in an
hour and then we will debug this layer
by layer and then we'll make it
fast uh see bet should we leave leave it
on and just just put a blackout screen I
don't know how how you usually do this
on
Twitch we're not going to find this in a
minute this is going to be a slow
methodical
project why nobody on chat
oh wow wow chat was
lagging put a BRB
screen okay okay let's see how quickly
this is going to load
all right we'll eat quickly and then
we'll come back
it's still loading
something oh Jesus it's crashing my
computer it's making
copies uh
where's the
example we won't go to NPS on this
whatever making that lag
can we have waiting room music oh I know
we'll put on seven hours of the Jeopardy
song
um
[Music]
okay is that
deterministic what do I say temperature
okay so that's clearly
we know what we're supposed to get
now so we can just put this
in I'm try to find torches equivalent of
that and print
it all right you get nothing but I'm
going to eat
fast
e
e
e
e
e
e
e e
I forgot I muted it all right I gotta go
to
dinner we'll be right
back
e
e e
okay there was a negotiation we got
dinner being brought to us it's the best
of both world
El okay it looks almost entirely
[Music]
correct um let's just check my
sampler like it has like all this crazy
stuff uh
what's the loss
free thank
you we go out later yeah when I done
yeah
we at
dinner look at dinner fish this fish was
recently
[Music]
alive why does this one look different
H well when I divided by the some of the
probs it broke everything
I'm going to guess is something related
to
this we're really close
though they dynamically change the bias
to select the experts what does that
mean
you mean like
this whatever this crap
is do we have to do this
[Music]
yeah it
repeats oh I mean maybe
oh you know what it is probably
[Music]
actually I bet their model generate has
some improved sampler
crap
uh reads from a Json file
[Music]
all right well we definitely don't have
a problem our
sampler that can be
deleted um
a temperature see what we
got for
it selects the most
likely at each
step okay maybe it's not
this yeah no there's still some bug in
this
it's almost the same but it's not
[Music]
exact we're probably routing to the
wrong experts
[Music]
all right maido you're the reason it's
going sub
only stay on topic
please
why is this not
working it's close the other one is
hello I'm an newbie to this form too I
think we have to understand this switch
Transformer
thing compute load balancing loss
function like what is that
is it masking some of them out
encourage a more even distribution
no this is not a real okay I don't have
to do anything for this at
all yeah this is not I don't have to
deal with this
it's just top
K I'm doing soft
Max it's the same as the Llama rotary
embedding did I forget a norm
do I need clip
qkv what happens if I comment out the
Norms so you see the problem like it's
almost correct but it's repeating I am a
newbie to this
form which means there's something
slightly subtly wrong with it
well that breaks entirely so it's not
that
wrong could it be KV cash I mean I guess
we can run and Float it's just really
slow I doubt
that I've seen no fixes at
all from changing D types and I think X
is not even
like I doubt it's accumulating in B flat
all right where might a subtle bug be
hiding for
I don't even know how that
[Music]
works should be that
all right we have the first set of
experts let's see what torch says they
are let's see if torch says they're the
same thing
[Music]
freezes
C
routers yes do
that I don't know
for
for for
[Music]
[Music]
24 do they match
yeah
identical oh
but okay we have to be
careful
because it's possible that this isn't
actually what's getting routed to the
things
I wrote that logic
myself and if that logic is what
contains the bug
okay that one all looks
correct see the next
one oh the next one's not
right 863 I get 68
totally different
probabilities okay the first one matches
exactly the second one no longer matches
is this some issuing the attention
like KV cach has to be
wrong so we're going to totally
different experts
here there's some similarities in them
but they're not the
same and the probabilities are
definitely not the same okay so it no
longer matches once we get
to even two so let's just do max length
three um we can even just
print
for for
so it's either a KV cash issue or Norm
issue for
I having a my
uh he's got removed I remov
that okay you guys see what should be
the same
there so that's
8636 so the values must be
different um let's figure out what's
different
attentions what are hidden States
so is that like the X that's being
passed in
here like PR this
x got the same thing
those are very different
pass the
MLP getting F in the MLP there
see if those are the
same yeah okay
cool 41 41 all the way down
to it looks right
totally different once you get
there yeah it's minus two that's minus 7
okay totally different
so it's got to be the
attention well or it could be
this for the iner norm
[Music]
so it depends we'll see if this one's
the same or not
okay that one's the
same but that one
isn't okay it's just a problem with the
attention but how this is the same
attention I use for
everything what could it
be is it the
Norms well okay let's debug this I we
can debug this
exactly
um it's crazy though that's
easy kind of what the hell
sdpa attention scale do product
attention okay that's fine that's what
I'm
doing that shit it's not clip qkv is
it rotary shit
where key value cash here
for
it's kind of it's annoying because
that's after the bullshit um we'll do
that it's not clip qkv right
okay it's not clip Q
there are my query states do they match
or
no particularly that one
there's like so many more methodical
ways to do this that I should be doing
but
no okay
[Music]
so this one matches and the second one
doesn't Okay so that's not the problem
where is the
cashier where's the key value
cache for
[Music]
no data is available if shape is
symbolic well
okay that's
annoying
uh for
I don't understand how the key value
cache is anything besides the absolutely
normal key value cache
though which it works fine in all the
other
models the only difference is that
Norm and that Norm should be applied
long before the key value cache
I guess we don't jit it which is
different so there could potentially be
a bug with the
like that should work fine if it's bound
wait why isn't that taking in the
sequence length
[Music]
okay I don't know what could this
be Ty FL
for for
now we have two of them here
this is the
key I mean clearly it's added a new
entry
here to the
cache but that entry doesn't match
torches so this one you can see matches
this
one now as soon as we go to the next one
this first one which is the key from
last time matches but the second
one that's what that has to
be doesn't match
which doesn't make a ton of
sense you
assign the key and the value
okay is the problem
here is the problem in apply rotary
embedding that should go right
through this is if it's the
Rope if it's the
Rope okay one
[Music]
before the one before is
right now the one
after no it's
wrong right there is wrong see that is
wrong where am I putting that
let's move it
above the rotary
embeddings has this just been
right before we uh jump to
conclusions let's check
here doesn't look like it's the key
value cach that's the
problem it's probably just some one tiny
little word I didn't read in the
paper well actually we switched the
cosine and the sign
because when you see when you put signs
and then
cosine don't try to do these both at
once clearly
there's the one before there's the one
after wait that
matches and that matches
huh okay it's got to be the rotary
embedding for
huh where did that come
from for
this looks like
rug why is it
that oh maybe because that's the first
one okay that's
fine but then it's wrong for the second
one
that's got to be
wrong I don't really know why it's
wrong oh no flip
shit this is frustrating for anyone to
just
watch favorite VSS code
plugins
oh oh oh the the advanced rope type
oh yes yes of course
no they look the same to me
this better be a good bug this better be
a good bug for how long it took to track
down I better learn and gain a lot of
insight from
this all right there's some bullshit
numbers they don't fucking match okay
well at least there that's
that that's that and that one matches
that one but look that one doesn't match
that one even though the inputs to the
Rope match so why is it not getting the
Rope
correctly I was I was like
says it's the same as
llamas for
could this have just been wrong the
whole time in tiny grad
why are they different
they're clearly not the
same inputs up the same
if feel like way different so
is that really the same as
this for
for for
that's
sh
has this been wrong the whole time
sh
okay let's just try to write the other
one the other one even looks better I
don't complex malt garbage
it says this is copy from llama is it
really
looks
identical it's shorter code anyway I
hate that complex mold garbage
8636 well
well that's is not that
yeah what is supposed to be multiplied
here
wait
huh why is that repeated
that
yeah this doesn't really make sense
[Music]
I feel like this has just kind of been
wrong the whole time
[Music]
look at them it runs twice
for
for for
it's been wrong the whole time probably
8636 is that the magic
numbers
629 like I'm on fucking lost or
something you know you yeah the numbers
8 23 6 29
[Music]
Fu that's probably been wrong the entire
time look at that code it looks like dog
shit I never want to see complex
multiplication all right let's delete
all these prints and get out of
[Music]
here Jesus that's probably been wrong
the entire time
does anyone even use tiny
grad no we have to get much more serious
about testing our llms
like I see what the bug was
too it's interesting how little of a
difference it makes
let's just make that number bigger
again I mean like if that's a real bug
in llama no that's actually super
worthwhile that was so worth my
time that was so worth my time to track
down and I have to really understand
you're right I have no understanding of
what rope is doing and that's what that
just showed to
me guys know my my one of my favorite
lines ever you know never give up never
surrender
um I am a new be to this form and I am
looking for a cup people
to talk about my new
website all
right
um but I know Transformers
[Music]
does it match torch
now damn those libraries are easy to
use I see why people use
them it doesn't
match
closer but it doesn't match
wait
6863 no wasn't it the other way
around yeah we want
8636 oh this just has a the bug in it
still did I delete
it I thought I got it
what oh did some of that printing change
something that's super frustrating if
that's true
[Music]
863 sex we
want see
6863 is not what we
want it's so wrong
okay that's
right but it definitely
said
8636 right
yes right there
8636 well that's a whole another
issue that turns out to be
related now we are already doing that
what
no there was one tiny gr that was
correct now what changed
this shit is so troubling like what's
going on here
all right let's see if we can go back to
it should I just copy and paste that
[Music]
wrong I might have just copy and pasted
that
wrong 8636
I think that one was
right Jesus
[Music]
e 63
try to get a better understanding of the
different types of data that can be
stored in okay there we
go
matches
geez well the good news is it was not
any tiny grad bugs
should we do a whole stream tomorrow as
punishment where we just go over rope
over and over again because I really
legitimately have no idea what rope
is if you get this shit subtly wrong I
think it's wrong in all of our llms I
think all of the tiny Grand llms have
this one thing wrong that I wrote the
first time that nobody
checked because there's no real way to
test it it almost
works but you know what is this
horseshoes or hand grenades no it's llms
and if you get it kind of wrong you know
what you get just just SL L stupider
llm
Jesus what a what a waste of a day but
not
really how many like libraries have this
wrong how are people validating this
stuff it had nothing to do with any of
my Almo stuff this is just the first
time I don't know this model must be
really sensitive to it because it's
mixture of experts or
something and like the llamas can just
take a lot more abuse don't abuse your
llama um yep okay but I would like to
point out to everybody that this matches
this
exactly and you should never settle for
anything besides exact you should not
say oh the words look kind of
right um
great you know I kind of want to do tiny
gr. apps and I want to write like a
super high quality did I commit
this so I want to do like a few super
high quality llms in
there we can make this thing fly
too got to make this thing
fly get this all in the jet
all right non
subs thank you for being here with me
through this you see you know
what you want to know something about
greatness there's got to be something
broken in your head there's got to be
something broke in your head where
you're just like I couldn't even I
couldn't even eat dinner you know I
couldn't even go downstairs for dinner
like like a normal person cuz it wasn't
right there was some
bug uh
and yeah you just kind of got to be
obsessed with
that there were times when I was going
to give up it was an arduous journey and
adventure and turned out the whole time
my rope was wrong notice how grock first
said they were the
same and it's SP the bug and tells me
they're different I don't know that kind
of coding is so hard for me too that's
like really one of my weak spots it's
one of my weak spots when it's like you
can write things that are subtly
different um
yeah
well it works
now I want to write tiny. apps.
llm where I read every line of the code
so carefully
uh yeah good lesson about machine
learning oh how
come why didn't my chat like
work I don't know why like chat's broken
look at this
crap time plan expectations no they
literally sent me two
boxes the minute they wanted me to have
expectations or sign an NDA or sign an
agreement like I'm out it's not a
business Works business Works based on
incentives you have to think about what
my incentives are you have to think
about what your incentives
are uh and let's
just oh there's a 55 second delay
why where is that this supposed to be a
twitch issue I got nothing wrong
here
um yeah I'm surprised this bug hasn't
been caught earlier either uh like of
all the people who use
llama in our stuff
[Music]
um does someone want to uh like write
that up nicely explain what the
difference is explain what the different
types of rope
[Music]
are I really understand what it was
doing
wrong we should do that now
it's also faster I
think so what I did wrong last time was
I didn't copy and paste that like that
[Music]
that's the
same is repeat KV right are there bugs
in this stuff
let's read about
rope this just looks more correct
[Music]
we should be able to do the same thing
like this
[Music]
put this
same so even though it's repeated they
just store it repeated which is
interesting I mean I don't know I don't
know if the llamas were
wrong I think the right thing to do is
going to be to write a
uh like is this just a different type of
rope for
also by the way that's so much more
readable than all that complex malt
crap
tin the more tiny right way to write
that right like that code's actually
very readable now the old code was not
readable I did not understand how it
worked okay there's no reason to store
twice just
repeat that looks weird
why does it stack them and then unstack
them am not totally
sure apparently copied that from llama
[Music]
for
this is the other
thing this is different
um okay maybe it's not broken for
llama I don't have a llama right now A T
one and these comments could also just
be
wrong here's another theory this model's
just
different and
uh for
[Music]
for
yeah you see the difference right it's
actually all just in the rotate half
function this is reshaping them like
that
and then taking that last Dimension
there where is
this like it's a versus chaa right and
this one is ch ch
wild uh okay let's find the original
llama apply rotary embedding see which
one it
is view as
complex I don't know what that means
what is view as complex
though needs to have a last dimension of
two
does that's fine and then it mixes the s
and cosiness
h
that for
no
give me one more grock bro give me one
more
grock for
is
for e
what is this reshaped for broadcas
thing oh that's fine
now Gro is a lot
better for
for
maybe no actually this is interesting
because they found
it right like this is this is exactly
the problem
huh
it hasn't changed
because I copied it from this
repo is this bug here
[Music]
I mean is the bug in the Llama
code all right let's try
it for
[Music]
for
for
[Music]
sh
[Music]
that
[Music]
um so end is actually just
one uh no never mind it has to be
[Music]
two and then we have to do
[Music]
what do we think is going to match
all right
well the old one matches exactly what's
in the Llama
repo so
either llama uses a different
uh I'm going to copy the one from uh
let's find the one in Transformers
do I get like money if like the Llama
repo's
[Music]
wrong where did it say it was taken from
was written in the almost shit
here for
that
this looks really complex
sh for
for
Jesus it's
going
for for
[Music]
[Music]
okay
that
[Music]
they're all
different but that one more closely
matches new tiny
grad metal llama and Transformers llamas
don't
match I I really think metal Lama is
wrong let's look on that repo again and
see if anyone's complained for
[Music]
for
okay come
on Can it have that many stars and be
wrong
[Music]
okay for
you know I feel I feel a lot less bad
about myself to write like when I write
bugs I feel bad about myself you know
I'm like like why did I write that like
that was bad I should have paid more
attention but like I did I copied llama
exactly all of them Implement rope
correctly that's not
true so you guys could solve like Amy
problems you know
that
Transformers llama and new tiny grad
match which also is the one that we need
to make the thing work metal Lama and
old tiny grad match
okay well it's interesting R1 1776 seems
smarter than
grock uh
I'm trying to
think what if you rotate what if you
change all your
matrices are hugging face weights stored
in a different
format such that this is correct for
hugging face but not correct for
do I do anything like that when I like
convert from huging
face what is this shit
uh
yeah okay
they're probably not
wrong and there was code and Tiny grad
to fix them the whole
time how does that work
I'm sure someone else wasted tons and
tons of time on this
uh no it's not any of these
so like I already like wrote
this oh first let's see if we don't need
that
for for
[Music]
[Music]
[Music]
no I did save them
is this
right maybe our normal stuff is right
but I have an idea that you can't just
do it to q and
K
oh no it's okay this isn't going to work
yeah okay this isn't going to work
because
uh you also have to prute the
Norms I'm not dealing with how to do
that okay we got to the bottom of
this there wasn't oh my God what what a
stupid voice
I'm not this is probably fixable by uh
yeah I'm not sure this was
right is this code like from somewhere
is hugging face
Transformers yeah this is made by
hugging face
for
is this having store for training
almost stuff is open source where's
their training
code Transformers implementation is slow
we recommend using
VM all
well that was fun
uh we didn't get to work on making
mixture of experts
fast
uh I can just so we complete what's said
in the Stream title let's move it over
here and run it
on
uh
AMD with the Am driver notice if we do
rock msmi well do our stuff so we'll
just pseudo rmod AMD
GPU oh no there's no more amdgpu what we
do to it doesn't
[Music]
matter uh let's just run debug equal 2
to
start oh see that what it means to have
an internet connection you know that's
an internet
connection oh that was fun that was so
fun
like hugging Face stores something
permuted it seems to maybe permute it in
such a way
that the shape manages to
match yeah I think it
does like usually when you see stuff
like this it's because
it's uh
mismatched but really what okay I mean
the real thing thing to do here is just
to update this function such that this
function
works like I shouldn't have reinvented
the wheel I should have just used
it there's nothing at all wrong with
using this
except for the fact that it's
uh not always right with the mixture of
experts but it clearly marks gate down
and
up
um I would assume that those ropes are
even probably correct and all I got to
do is flip around the uh
I flip around the Norms
also wow who wrote this and why weren't
there comments
rearranging the weight
matrices oh I think we can do this
because we flip both the key and the
value
the rotary embeddings and multi-head
attention would compute incorrect
results do I have from metal
[Music]
somewhere why is it trying to use metal
oh up here to
metal all right let's fix
that oh we're not we're not even a why
did I write this junk I wrote this junk
because I was on
stream I don't blame
you blame myself I should have used the
library code in tiny grad the library
code in tiny grad is extremely high
quality this is just a standard format
it's just the hugging face format
[Music]
we're just going to need to prute the
stupid Norm too then it'll
work it's been a long road getting from
there to
here why is it still trying to put
things on
metal I have the word metal anywhere
here two
metal junk junk I wrote junk
code I wrote junk code
[Music]
why would they flip the
Rope okay so in conclusion the rope in
tiny grad was never
wrong yeah that was dumb of me to think
that that would even be a thing um
um all right and here we are running
that same thing on
AMD uh
yeah look how fast it reads to the GPU
it copies those 10 gigabytes a second
yeah we shouldn't have written this
garbage it should have just been convert
from hugging
face we do have to deal with experts in
a special way
but otherwise it's a standard Hing face
model
the CPU in this is worse than the CPU on
my Mac that's why this is so slow but
you can look at the model time it's not
bad
H we ran out of
ram it's like not being
freed I wonder why that
is is it freed on
Mac it has to be
no it doesn't
okay and we have some memory leak
too to top it all off there's a memory
leak I don't know I'd be a lot less
frustrated by all this stuff if I just
like
[Music]
hugging faces llama interleaves the
rotary embedding Dimensions dim one dim
two dim 3 dim one dim
3 and then let's look at scaled group
attention um and
confirm where's scale group
potention so what that going to do is
like you have a different key value
permutation there it's all in the cache
like that that's all
fine um when you're in
[Music]
key value you multiply
the key and the query Matrix together
with the inner Dimensions so all this
stuff cancels
out
yep so it doesn't matter you can permute
the qu the query in the key as long as
you permute the query in the key inner
Dimensions identically uh you'll get the
exact same output from then on out the
only reason my permute and switching it
back didn't work was because I didn't
also permute the uh the the other thing
and let's just test that
theory also there's a memory
leak that's got to be fixed I don't know
why that's
happening oh we got to make things up
there's so much to do there's so much to
do but we're going to make deep seek go
so fast on those mi30 machines
[Music]
um there's a few things that need to
really uh happen this year one of them
is uh
I like how much simpler that one is we
can probably write something that looks
like that though
for
oh we have to give it heads too
[Music]
the norm happens afterward um
okay
wrong
now I like vaguely even remember this
from a bounty for
you can also just make a flag called
hugging face style
rope I am a newbie to this
form and I am trying to get a better
understanding of the different types of
data that can be stored
in h okay
uh someone want to do this someone want
to clean this up it's a good it's a good
it's a good project just like clean this
up integrate it beautifully it's not a
bounty it can't be a bounty because if
it's a bounty I'm going to get I'm going
to get 32 spammers who try to do it only
do it if you're going to do it
beautifully but uh yeah someone do it
integrate this
function uh with that
function I should have looked for this
function first this function's way nicer
than what I
wrote um this needs a fucking
comment like whenever you see
that whenever you see
permute whenever you see that kind of
thing you always assume it's because the
shape don't match but permutes where the
shapes match are
horrifying uh so yeah that needs a
comment to whoever wrote this I don't
know how you figured it out but you
could have left a comment for the next
guy I probably wouldn't have even
checked it
um
[Music]
well yeah and this is this is a good
lesson of where bugs are too it's not
like the bug is really in any one
place this explains it
perfectly hugging face llama interleaves
the rotary embedding
Dimensions differently the Target Model
expects a group in contiguous pair as
the permute function fixes this mismatch
so there was never a bug with
Lama there was never a bug with llama
there was a bug
only in my stuff with the weight
loading uh tiny gr was correct I was
wrong and
uh I don't
know took a lot of
time should I be upset with myself how
did I
do and what did I do like no I don't
know I tracked it down I went through it
methodically lessons were learned
lessons were definitely
learned
uh who did
this I did this one this one's going to
have good comments too because I'm sure
there's like 20 people out there working
deep in this llm stuff and they're just
kind of like he felt for the hugging
Face stores the weights permuted
differently
bug um I did I
did I fell for the hugging Face stores
the weights Prem muted differently bug
wow so many of you are why we only let
subscribers
talk uh the AMD one doesn't work because
we have a memory leak and I'm G to
fixing that right now um okay so
todos todos somebody clean that cat up
make a beautiful commit out of it and
fix up that hugging face function you
can make all that code I wrote really be
like just 10
lines um we'll see if anyone does it if
no one does it I'll do it uh this whole
thing could have been a 10line
diff uh two find the memory leak uh
where else does memory leak exist it
clearly doesn't exist in all llms it
probably has to do with some indexing
stuff uh
three make that actually fast so I know
we have that top k implementation coming
uh so that's definitely going to help
and
then yeah make it
fast get it in the jet get the whole Moe
in the jet it should be a lot more
doable the way that I'm that my that
code's a lot cleaner than the Mixel code
I know when I wrote the Mixel code
people really liked it um and I know
that like there's a lot of bullshit in
here some I'll clean up tomorrow maybe
um but like this is a much more
beautiful uh
implementation of this because it
supports this uh I should also support
the normalized probs as a as a
flag um whether you want to normalize
probs afterward or not but this
shouldn't go to CPU and then this should
all be jetable I believe yeah there's no
reason it's not jetable the hardest
thing to jit is the KV cache there was
never a bug in our KV cache there was a
bug with with permuting the
shit um that can all be
deleted can someone find out how to not
use this tokenizer that takes 3 seconds
to
import um that's fast now that we're
using the new
mixture of experts thing which is a lot
which is a lot nicer than the mixture
one right like the mixture one is doing
this and this is going to be slow uh but
this is not slow I put the experts in
The Matrix itself
um so yeah we need to not go to CPU here
we need to speed up uh these indexing
functions and we need to get this all in
the
jet
uh
g g could someone write a for Loop for
that um I don't know it's not that bad
whatever this should be lazy still it's
even more reliable than the torch
vatcher delete all that delete all of
this um something like that's going to
have to stay and then that's just a junk
Loop but yeah this can all be like 20
lines of code uh you guys do it tonight
if no one does it tonight maybe I'll
stream again tomorrow I think I'm going
walking
tomorrow uh you know I did this instead
of eating dinner downstairs I ate dinner
right here you guys on
me uh thank you for watching my stream
does anyone have any intelligent
comments you will not be the last PL
message is this open source no it's
closed Source keep it very secret this
is secret this is high quality shit man
you think I'm just gonna give it away to
anybody chat helped me today did it
though did it were you guys talking
about the hugging face thing did you
know about hugging face
permute
um you didn't know about hugging face
permute wait hatch AI
knew wait you guys wrote it in chat I
should have paid attention to
chat you just didn't read
check his logs yeah oh man chat one oh
you knew it too why would they do
that why would they do that all right
well I didn't even spend that much time
I didn't spend that much time going I'm
get a beer I'll see you guys uh next
stream thank you all for watching I love
some of you I I am okay with some of you
and some of you well you know like like
you know being being a member member of
The George Hots streaming Community
isn't for everybody um and we do hope
that people who write stupid comments
will self- select out um you know like
what keyboard you're using why why do
you care you think you're G to get a
better keyboard it's going to make you a
better programmer you think that's
what's going to happen you know what's
going to make you a better programmer
the gold standard all right tell
everyone you know it's only real money
out there this isn't some gold bug shit
if you don't believe in the gold
standard you're Hammer that's it that's
the only explanation I have for people
oh but the modern monetary okay thank
you for watching the stream bye
everybody
you
welcome to the next mobility podcast on
this week's episode we have the founder
and CEO of comedy I George ha George
Hotz welcome to the podcast George hi
yeah so I thought to really kind of dive
into some of the details on on some of
the autonomous technology that you guys
are developing we'd start by kind of
tackling the reason why you started this
company and you know why you didn't kind
of jump along you know say Google
Google's whammo project or uber or Tesla
and that sort of thing so what do you
what's kind of your main reason for
starting common data AI because do you
really want to live in a world
controlled by way more oh that's a great
question yeah
it seems it seems as though they're kind
of pursuing something quite different
than say they did with Google's even
their own search engine or what they've
done with Android of course which at
which I know you've been quite vocal
about and so you know how are you guys
approaching it from a different angle
than some of those bigger companies
developing this technology well I mean
it's not just a question of you know a
different angle it's a question of who's
gonna win and who's gonna lose
wham-o and Google I'm sorry way mo and
uber operate in bubbles um they operate
in enclosed bubbles where they think
that they can control the entire stack
of mobility no and he'll mm-hmm and so
you see it kind of being a multiple
company operation in terms of someone's
getting the ride shares called someone's
operating the autonomous technology and
you know some other company might
maintain the vehicles and that sort of
thing forget about it this is the kind
of people who spend their day like
jerking off about the future no
seriously though they spent like oh the
world is gonna transform in ten years
now right now people buy cars and they
crash right how do you make them buy
cars that don't crash i Tesla's got this
right so instead of you know tackling it
you know with some like you said some
kind of futuristic mindset you you're
kind of approaching it from you know how
can we improve the safety and how can we
move it where people will accept it you
know a lot faster rather but how do you
win right yeah how do you how you win
seven cars and I said this since the
beginning right the way Moe an uber
approach doesn't win
I mean uber has more of a shot of that
than way Moe look at Google Fiber right
it's a great ISP how many places have it
- yeah yeah right
it was a little burr fiber all right
maybe maybe they'd be able to roll out
the the ISP but kudou be really handled
the technological challenges no it's
just not the way the world is gonna play
out the world's gonna play out a whole
lot more like what you've seen in the
smartphone industry right I mean this
happened before in computing this idea
of thin clients this is all you can you
can trace this back 40 years like this I
did Oh everyone's just gonna own a thin
client
we're not even all in the thin climb
maybe it'll just rent the thin client
from the other leg everyone will have
Bloomberg terminals I mean this isn't
how computing happened right mm-hmm and
so when you're looking at developing
internally it come a you know your cars
are they still using lidar like uber and
and way moe
or are you moving towards the more
computer vision aspect of development
well I mean that's a technology choice
I'm not sure why the reason people
fixated on lidar is because way moe does
have a technological lead and because
they use lidar if the year is 2005 and
you just witnessed
everybody lose miserably at the DARPA
Grand Challenge in 2004 lighter gets
invented people start winning in 2005
lighter looks like a great idea fast
forward you know almost 15 years
computer vision is amazing the AI
revolution is happening computer vision
is superhuman in some categories and
cameras have this two huge advantages
they're cheap and they're passive right
you don't want a sensor on your car that
has to actively emit stuff
this isn't how humans drive right humans
drive by humans don't have any active
sensors there's like that's bats too but
like um no humans don't have active
sensors right you don't want active
sensors active sensors interfere with
each other on the they're more likely to
you know be thrown by their own
interference because you have both a
transmit and a received pathway and
lidar is ridiculously expensive and so
yeah I've talked about that with some of
some executives in the you know kind of
evie space or autonomy space and they've
they've always said that they've they've
always you know
kind of emphasized oh well lidar works
really well except for the fact that
it's very difficult to manufacture and
it cost a crazy amount of money it's
also like it doesn't work well here's
the thing right when you think about the
the problems involved in self-driving
cars there's like a perception problem
and then there's a planning problem
right the lidar only helps you with the
perception part of that problem
maybe there's perception planning and
localization sure the lighter might help
you with perception localization but
when it comes to planning we're really
all the hard problems lie it doesn't
matter right like that's we are much
better at like object classification
detection and recognition and computer
vision than we are at like complicated
decision-making required for actually
driving cars um it's just it's just such
a trivial part of the problem it's like
we were playing Monopoly and the first
thing I focused on was well you know you
have to build your houses evenly on the
property you can't put three houses
there in one house that's irrelevant
right mm-hmm and and so when you're
talking about computer vision technology
and how much it's advanced in the past
you know 10 15 years where do you think
we are on kind of the road map to
computer vision you know being advanced
enough to handle you know commercialize
self-driving vehicles it already is you
think it already it's at the level where
it's gonna recognize it enough stuff and
provide enough input into the the AI
develop software and kind of control the
vehicle and a you know advanced
commercialized level yeah I'm telling
you if all I had was the AI technology
today for vision I can we have a demo on
our Twitter where we we use a segment
and a depth that we basically output a
lidar we output a point cloud of the
world around us a segmented point cloud
which is even better we know which the
objects are right that's the easy part
the hard part is okay I'm trying to
merge up here
what's my model for how that person's
going to be hey of assuming the bad
person stepping on the brakes and being
able to represent all of that predictive
complexity particularly predictive
complexity where there's search right
and you have to search when you can take
actions okay if I move my car to the
left here what will the other cars do
being able to reason like that in terms
of counterfactuals AI is really bad at
still
and so what do you think needs to take
place and in terms of AI development to
get it to that level I mean you're
starting to see you're certainly just
looking look at alphago look it look
what just happened
alphago zero like reinforcement learning
works if you have access to a really
powerful simulator the question is where
do you get a really powerful simulator
for for self-driving now you could try
to code your own simulator but you're
running into the hand coding problem
again just in terms of graphics and not
vision right you're coding the graphics
part not the vision part umm yeah and
you're Simula is probably gonna be
pretty restrictive so what you want to
do is you either want to learn a
simulator or you want to use the world
as your simulator and figure out how to
do that safely and so when you're
talking about using computer vision and
in combination with AI on this level for
self-driving vehicles you know there's
not a lot of vehicle or not a lot of
companies kind of pursuing that model
but one of the only other ones out there
is of course Tesla's autopilot and it
seems like the development there has
been a little bit bumpy over at least
the past year and a half or so with you
know Chris Lautner leaving earlier this
year and the be whole sterling Anderson
issue unfolding earlier this year in
past last year
what do you think are some of the
challenges that that Tesla's facing to
bringing some of these features and
developing AI to a level of where they
can bring that full self-driving
technology to the vehicles he only has
an idea in his head he has an ideas head
that it should be easy and he's right it
absolutely should be easy so every time
someone doesn't make it seem easy he
fires them which is actually probably a
good strategy so what's the problem I
mean it's just actually implementing all
the stuff mean implementation is hard
mm-hmm no it's not it's not it's not the
theory the theory is like all there and
so when do you think you know Tesla's
gonna be able to where Elon is gonna be
able to assemble that you know the right
team and all the right pieces to make it
all happen do you think they're getting
close to that or oh one day one day you
know someone a little bit smart is gonna
get become in charge of a car company
and they're gonna be like holy crap or
five years behind Tesla we got to catch
up
all right the Paul Graham is a great
tweet when the iPhone came out all the
phone manufacturers
like wow we're 5 years behind we got to
catch up but when the Model S came out
the car manufacturers have still have no
idea how far they are behind the Model S
has sophisticated compute has OTA has
Linux boxes has a you know a large
touchscreen a modern user interface what
is the Chevy Volt half-right when you
look at it from a very superficial
features base level the Chevy Volt in
the model 3 of the same car when you
look at it from a well I mean consumers
aren't stupid
how many Chevy bolts were sold model
threes you want to buy a model 3 today
it's gonna cost you $100,000 that's how
high the demand is and so good good luck
for cooping what you paid for a Chevy
Volt yeah yeah and and in terms of that
brings us to a really great point do you
think like legacy automakers are really
making any of the right moves to develop
their own self-driving technology or do
you think they're kind of approaching it
in a kind of backwards way I mean you
could buy new Tata me for 450 million
dollars and kicked a can down the road
another five years look a lot of them
are really bad um
cruises are right cruise if you want to
if you want to believe in the way mo
uber world's we're like one company's
gonna own the vertical ya cruises are
right at bat as far as playing the
vertical goes when you look at people
playing the horizontal check out check
out like AI motive they're doing a
pretty good job and in you when you're
talking about playing the whole vertical
to help our listeners understand you
you've previously kind of said that the
Tesla's currently on the path to kind of
be the apple of electric and
self-driving vehicles by you know owning
owning all of the technology from tough
to bottom and really kind of vertically
integrating everything there's a huge
difference
Tesla's not gonna own the fleets Tesla's
figured out how to monetize on the way
to owning the vertical and this is what
Apple does as well Google and uber have
figured out how to sync billions of
dollars on the way to hypothetically
maybe owning a vertical yeah it seems it
seems like once Elon will be able to
turn the fleet into you know a
self-driving fleet of you know
ride-sharing cars you know he's not
gonna own them but Tesla's going to have
a piece of it and they're gonna own all
the technology behind it so it's
like they are kind of approaching it in
a more economically feasible way than
you know
uber with you know trying to buy tens of
thousands of cars and that sort of thing
you know we're doing the exact same
thing you know we're gonna be there with
you with the witty open competitor to
Tesla's Apple right that's the simplest
way to describe it right if you think
that that's the way the world is gonna
shake up if you're a believer in the way
my uber crews world okay I mean that's a
matter of taste if you're a believer in
the in the Ford Toyota Honda I don't
even know what world you live in
I don't know it's a different planet
mm-hmm and so when you're talking about
being the the open source kind of the
the Android of the the world in terms of
comparing it to smartphones you know how
do you get there from where you guys are
right now and how is that kind of
changed over the last couple years so we
have open-source self-driving software
it's it's it's it's neck-and-neck with
autopilot less you know less probably
because we're doing a particularly bad
job and because we're doing a
particularly good job and more probably
because autopilot hasn't been doing a
great job for the last year so it's it's
it's neck-and-neck you can download it
right now install it on on certain
hardware you know we do we sell
compatible hardware we sell it as a
dashcam we don't sell any self-driving
stuff we do sells hardware that is
compatible with open pilot and you can
put it on your supported Honda and
hopefully by the end of this week you're
supported Toyota and with Honda's and
Toyota's that's gonna be six of the top
10 cars sold in America and so you know
win-win will those dash cams and all
that hardware and in software all those
pieces come together where you guys will
be able to sell that as a you know
whether it's directly through the
manufacturer or just off the shelf or
some why should we why should we and so
what's the what's the business model
there oh well I mean there's a lot money
is trivial to get these days look new
tana me just got bought for four hundred
and fifty million dollars they stuck six
lied ours are they stuck they've got six
cars they stuck lighters on them
they got 50 people in a room and they
kind of made the car drive slow around
some unoccupied streets right um there's
so much capital in the world right
mm-hmm it's a question about whoever can
actually build and deliver the
technology we'll never be short on money
mm-hmm so what's the what's the business
model there's a ton of ways to do it the
business model I kind of like is a
subscription-based service okay um you
charge people you know $20 a month to
get your car on the self-driving Network
or you can have limited self-driving
features for free all right once you
want the fancy like point-to-point
navigation stuff that requires the cloud
you have to pay about 20 $30 a month a
reasonable fee um that that's probably
our preferred path to monetization and
so you don't go ahead we don't even have
to sell devices directly to consumers
for that to succeed we just need to get
people running our software I don't care
how people are running it whether you're
running it cuz you got it through a
dealer through your to an OEM by
downloading it from our github you know
it's just it's just a potential customer
mm-hmm and in one one of the players
we've kind of been not talking about but
some of these newcomers in the
automotive space and as you've said you
know if you present the right technology
in the right way it seems like the
capital kind of follows follows along
but what do you think about some of
these other newcomers say something like
Rivia n-- or lucid motors or neo you
know and what are those guys oh you're
talking about the Chinese companies that
think they're gonna make cars in terms
of you know how do you think they play
in the environment and especially in the
self-driving environment you know to be
fair Eevee's are a lot easier to make
today when you look around you look
around say look like SpaceX and Tesla
right when you look around at SpaceX
like there's nothing really
fundamentally that makes rockets that
much easier to build today then they
even were to build in like you know a
long time ago even like the 60s or the
70s right okay you have fancy or
guidance computers maybe you can do your
your recoveries and your nice landings
but when you look at electric cars oh
it's so easy today
Oh a kid could build an electric car in
a garage you buy a pre-manufactured
battery pack a pre-manufactured powerful
motor power and pull inverter and boom
you've built an electric car um so is it
possible for these companies to succeed
yeah maybe
and so kind of back to when you got kind
of started and interested in doing
self-driving cars you you said that Elon
Musk kind of approached you to possibly
run the auto pilot division how did that
kind of shake out and did you have any
interest of joining Tesla well I was
supposed to be a contract I'm supposed
to be a contract I was supposed to be in
and out of this game in a year
mm-hmm but you know I'm stubborn I don't
like to lose so I'll be here a long time
and so you know do you think that AI
development is kind of reaching some of
these levels that that will pose a
threat as kind of Elon Musk kind of been
talking about oh here's the thing about
any weapon right mm-hmm
every weapon that's ever been created
guns don't kill people people kill
people
nuclear bombs don't kill people people
kill people uh it's gonna be the exact
same thing with AI right this idea that
AI presents any like unique challenges
that haven't existed already for every
weapon in history that I'm not sure I
believe but once these powerful agencies
get their hand on AI well you know
nuclear bombs aren't very useful
tactically AI is so that's what you got
to watch out for way more than like a
runaway a eye control problem kind of
sci-fi stuff so you think it's more of
you know whoever's kind of in control of
it which is sort of what Elon Musk was
been saying but in the same sense he's
also been more in general that AI could
kind of start running loose if someone
isn't well I mean we we really shouldn't
conflate those two things I mean think
about Google right Google is the Google
makes all their money from advertising
right what happens when advertising
becomes too good there's a great book
Infinite Jest that goes into this right
what happens when Google starts applying
superhuman AI to matching ads with
people I mean are people anything more
than slaves at that point you see that's
a whole lot scarier than oh we're gonna
be turned into paper clips sure maybe
but uh I don't know I think it actually
we rather the paper clips when it comes
down to it all right so we're gonna
we're gonna take a quick break and then
we'll come right back and kind of talk
about some of your recent products and
how they're kind of assembling a
complete eCos
system for for a self-driving car as we
talk about the future of mobility it's
hard not to ignore Tesla's Model 3 a car
that could potentially disrupt the
entire automotive industry right now
Tesla has been having issues with
scaling up production of the vehicle but
the team
Tesla rowdy has learned this week that
Tesla may put the production back on
track you can check out their coverage
right now and Tesla rowdy calm all right
we're back on the next mobility podcast
with George Hotz the CEO and founder of
Comet III and we're gonna talk a little
bit about their products that they just
released last week with their revamped
website you guys now have a dash cam and
then what you're calling a giraffe
connector within the vehicle and a panda
connector that goes on to the obd2 port
which is in virtually all modern
vehicles can you tell us a little bit
about those those building blocks and
what they mean for comedy III yeah so I
mean like forgetting about really what
they are as products you have to think
about them as Universal building blocks
right um so what the Panda is and
they're dried in the tagline the Panda
is the best universal car interface ever
if you want to interface modern
computers to cars cars have these weird
ports and these weird buses they have
obd ports and cam buses and and and and
weird stuff that computers don't have
computers have USB ports and Wi-Fi
phones and computers to the exact same
thing USB points and Wi-Fi so yeah we
need we need an adapter we need an
adapter that transfers from the kind of
you know buses your car has to the kind
of buses your computer has step 1 build
a good interface and that's that's panda
now then the new product eon is is okay
so now that we have a good interface
between cars and computers we need to
get a computer in your car mm-hmm so you
know I could sell you a big desktop and
you have to put it in the trunk with
your inverter and no one's gonna do that
or how else can I get powerful computers
into cars well that's what he owned is
that it's a smartphone in case I really
but um it's also a powerful computer and
it has a
you know very powerful sensor it has a
camera smartphone cameras are just so
phenomenal with how good they become in
the last couple of years so it's it's a
camera it's a GPS its gyro it's an
accelerometer
you know phones have a lot of the same
senses as people it's got a microphone
it's super powerful sensor and compute
array that you can mount right up on
your dashboard you can connect it up to
your pandas and now you have powerful
compute and a powerful bridge between
the compute and your car and giraffe is
just not everything's accessible very
easily over the OBD connector there's
other hidden buses in your car like
hidden cam buses giraffe just lets you
connect panda to your hidden cam buses
okay and and how do these all interface
with you guys's chauffeur app and and
how does that compare to these so
shippers is software and it runs it's
it's - Bank software but it's it's dash
cam with extra stuff like eventually
we're gonna start to offer forward
collision warnings Lane Departure
warnings maybe even self-driving you
know all that stuff right it's all part
of the same kind of spectrum ranging
from just logging to to literally I type
in where I want to go and my car takes
me there level four right it's all on a
spectrum but in order to make this stuff
possible in order to like be able to
move up along that spectrum we need core
building blocks in your car now Tesla
and like I said
Tesla's five years ahead of every car
manufacturer because if I wanted to
install open pilot or I wanted to
install ship or plus on a Tesla it would
only be a software change because Tesla
has provided the hardware and the
sensors that I need no other car
manufacturer has so we have to build our
own and when you're talking about
Tesla's hardware and the software kind
of coming together one of the the kind
of criticisms or worries about the Model
S and and all their vehicles now is do
you think that all the hardware that
that Tesla has installed in those
vehicles is going to be necessary - or
is going to bring the car all the way to
self driving it'll do exactly what I
promised which is yeah make it drive
twice as safe as a human I had totally
absolutely it's just a software problem
and in terms of
you know the hardware that you guys are
gonna be offering in the future you know
are you guys gonna be offering full
self-driving Hardware on the vehicle
multiple cameras and that sort of thing
so that someone can you know say get a
box in the mail and install it on their
vehicle and that sort of thing so we'll
be offering more and more powerful
computers better and better sensors and
more and more sophisticated interfaces
as time goes on so we can see you know
kind of like you said collision warning
that sort of thing I'm and the current
stuff and then eventually you know
you'll provide a version 2.0 and that
sort of thing yeah maybe we can even go
beyond collision warning right now if
you download our open source software
open Pi that you'll get industry's best
adaptive cruise control and Lane keep
assist it so someone can install that
right now with with your product and you
know well the product doesn't come with
it I'm we don't we don't really
encourage that but if you want to do it
we're not gonna stop you sure sure you
know what one day one day maybe the
product will come with it one day one
day the product will come with it and at
that point you know you're doing
everything to manufacture intends for
for for regulatory and liability reasons
you know if you do this you're on your
own also a bit for quality management
reasons right like like we can provide a
really quality dashcam our self-driving
software's it's cutting-edge yeah yeah
and that's a great segue into kind of
the regulatory issue here you know what
kind of regulatory hurdles do you think
are facing autonomous vehicles and are
we on kind of the right path anyone who
thinks there's actually regulatory
hurdles again is someone who desperately
wants to remain employed kind of doing
nothing um it would be so immoral and
unethical if there was good self-driving
technology in the world for regulators
to try to block it I mean they're
literally sentencing hundreds of people
every day to die if the technology
existed self-driving is entirely a
technology problem if the technology
existed and it was cheap and shippable
it would already be deployed everywhere
no regular no sane regulator would try
to stop it so you think that that you
know most of the time when someone comes
out with new software or new
self-driving things it's at least going
to be an improvement in safety so it'd
be kind of silly for
leaders to hinder that development yeah
okay
did you be honest the reason humans
crash cars is it's just like it's it's
some of them are so bad like people
crash because they're they're drunk
they're distracted they're asleep it's
just like so simple to fix they just
drive their car off the road why should
your car allow you to do that it
shouldn't I mean it's so kind of kind of
looking at the whole big picture hang
here when do you think we're gonna start
seeing these cars completely self Drive
on the road you know level four autonomy
and kind of be in regular people's
driveways I don't know
I don't speculate much in the future
what we'll see I'll say that like way mo
will probably get the first one working
the first one that's actually better
than a human and way mo will ship maybe
200 of them then Tesla will probably be
be second and will be third but you know
it's gonna be like like Xerox PARC the
Macintosh and Windows right I'm so Xerox
PARC had all of his great stuff first
right and where the Xerox PARC stood a
well they're all sitting in the bottom
of a landfill you can actually see a
Google car if you want at the Computer
History Museum it's interesting that
it's already history um so that's
what'll happen that's what'll happen to
way more on Google though ship a few and
eventually line up in landfills
um Tesla will come out first but you
know it'll be like the Macintosh right
it'll be this this high-end piece of
hardware which sure it has all the
future of gooeys and stuff but you know
okay a bunch of people are gonna buy and
it's gonna be cool and you'll get a bit
of a cult around it what you already see
around Tesla and you know will be the
windows will be the Android will be
everywhere even if we thought and in
terms of you know you brought up a great
point there with with Google's way mo
you know they've been around for for
nearly a decade or more at least in the
conceptual phase why do you think it's
taken them so long to get to where they
are and it seems like you know because
because they're Xerox PARC the reason
Xerox never shipped the great computers
great technology built at Xerox PARC but
Xerox made money off copiers alright why
would anyone want this stuff right
Google is a little bit better but
fundamentally they make all their money
off ads yeah like ads are to Google
whatwhat copiers were to Xerox and of
course they're not gonna be they're not
gonna be truly ambitious they're not
gonna be hungry no
there is hungry what are you hungry for
yeah we already make a great living off
copiers yeah right
so it seems yeah you know they're tied
down to their existing business so they
it's kind of hard to see why they should
be taking such big risks and putting a
lot of resources into something that's
arguably completely unrelated yeah and
in terms of what we can expect you know
coming soon from comment that I I
anything you can share on that front
yeah I mean we have our we have our
product line up there now it's it's
about it's about you know supporting
that that's gonna be our product line
for the next year and that hardware is
quite capable um that VAT hardware that
the Panda and the Eon and the giraffes
together is a very capable hardware
system I'd even say that it's it's it's
it's more capable than autopilot one
it's not more capable than autopilot to
you'll have to wait for commas next
product for that but at least the
autopilot that was in like autopilot
when it originally launched we're
launching something that's better than
that and you can do that already with
our hardware it's just a question of
software and of course all our stuff has
full OTA capability so we can ôt a and
you'll continue to get updates and it'll
get better and better better and and you
guys are open-source software and in all
that development why do i go with the
open-source route with that kind of
development rather than you know white
listening into different companies and
that sort of thing oh god then after
what i have to hire a business
development to you i have to deal with
their business that's not worth it it's
not worth it I'm gonna beat you because
I want to beat you not because I want to
like Oh square away my hundred million
dollars I want to win mmm you'll see
nearly enough of this today in Silicon
Valley you know the technology used to
be cool right like this the stuff oil
used to be cool and then like you know a
bunch of people are like whoa well we
could get rich and not bringing that
thought out all the hangar honors and
that brought out all the people who just
like well well stick lidar on six cars
will will make a deployment in Singapore
no one's ever been to Singapore I'll
never actually see the deployment and
then uh yeah we'll get like 50 people
our room and we'll sell to Delfy for 250
million dollars when we flatter their
their egos about detecting reindeer and
stuff um yeah but no like that's that's
one that's one type of person I'm not
the type of person I want to win and if
I don't win I don't
win but at least that's what I'm trying
to do well yeah there you have it you
know it you know if you're out there to
win rather than in and to give a little
bit of context you you're probably in
the same agreement with with Elon Musk
because you know today he he tweeted
they just on the announcement of Delfy
by and metonymy he just tweeted groan so
hilarious I'm sure I'm sure he totally
agrees with you on that front and it
will be incredibly interesting to watch
this kind of development shakeout over
the next couple years as we get closer
and closer yeah absolutely
thanks so much for joining me on the
podcast today cool thank you Tom
yeah thanks so much thanks for listening
to this episode of next mobility please
subscribe on whatever platform you
listen to podcasts on and if you enjoyed
this episode please leave us a review
problem cover art by Sidney E in
original music by Jack mewho see you
next time
you
oh no sorry ass obvious is the streamer
or software on yeah I don't think so I
mean I think we might have been lied
that one time
can you chat my chat room Oh live POG Oh
Lucas oh you can hear me right now yeah
it's like broken I don't know
oh wait what a five oh it's working out
high five yours yeah sweet Lucas can
hear me alright
did you get a note no they probably
didn't that's why I'm only a 5 your and
your your like you have notifications on
usually alright we got people now oh
okay this man is insane big fan from
Bangladesh let's go yo I'm glad why am i
outside what oh yeah don't share balls
[Laughter]
Unreal 4 engine looks good what's up
hello hot outside yet no well I don't
have a mask on and you know listen to my
soundcloud if you have any questions
dude you can't go outside well you know
what I don't know what anti-freedom
place you live in but this is America oh
yeah you show them a hundred ninety-two
alright show them you yeah hello I'm
here with Alex
you all remember Alex this is wonderful
how outside has nice graphics dude I
know
hey guys I got wild rendering so it's
not gonna be a long stream today zoom
back this is the protein sort of folded
and we'll get back to that in another
stream but um no Alex and I were just
talking about predictions for the future
it's true yeah so we thought we'd share
them with you have you read the papers
Kelly released the paper I saw Danny
yeah is it good huh but you didn't see
his plea I lead you to it
Oh she'll let him out of jail for
coronavirus but I
Alex I thought this was just another
scam I thought this was like the Hillary
Clinton hair thing they should have let
him out a long time ago but that time
you defrauded people and made them all
money see no futurism is coming the
resolution is insane you mean it's good
you mean all right I would get any
predictions all right so we started
today's conversation about decades have
passed maybe we started with the
observation that everybody thinks
culture is declining and shitty that's
the past there's a moan in the past that
where things were perfect ingredient so
from my perspective you know everything
in the 90s was perfect and great the 90s
the 90s was the I don't know I wasn't
alive for the eighteen nineties but all
I know is that like like kids are
playing pokemons go today well ship him
we invented Pokemon in the 90s wasn't me
but you know um so
guys I'm not that worried about the
social distancing only from old people
if you were 30 and you catch coronavirus
you're probably gonna be where people
over 100 have died then under 30 yeah
that's just something that puts this
stuff in perspective um but yeah all
right so well no we talked remember how
we through the 30 years thing okay the
60s man well yeah yeah you can't argue
that a decade that ended with the
greatest human accomplishment ever
putting people on the moon was a decline
no no certainly not just like a brief
like the 60s was clearly an ascent right
right um so we talked about the Internet
the internet between 20 during 2000 to
2010 you gained all these awesome new
powers and I argue that the Internet's
gotten worse in the last ten years do
great you're on my podcast Heyward
debating really when it started
happening 2010 2020 clean well was
thrown out yeah when I worked at
Facebook I think that was 2012 not agree
you don't think so I don't agree it
became everything we had yeah yeah I
think there's no like if you compare
Google Maps from 2000 to 2010 huge
changes if you compare Google Maps in
2010 to 2020 they're the same if you
compare video games from 2000 to 2010
you know quantum leap forward right we
went from like like halo 1 to modern
warfare 7 yeah and now we're on modern
warfare 14 that looks just like modern
warfare 7
not internet bad but big companies that
are bad well yeah I mean I think in a
way that that kind of over simplifies it
but it is these companies that have they
stopped trying to make a better services
and they've just tried to extract more
value
well first off because people have have
had it with how do you know like think
about how much you know anti e-tec
backlash there was in 2010 versus
anti-tech backlash from 2020 sure yeah
you know Joe Biden is clearly going to
be a phenomenally strong leader and
guide us through this Joe Biden's gonna
lose Joe Rogan say he vote for like a
man-eating plant over Joe Biden who was
Alex do you want to introduce yourself
no just you can make something up
[Music]
Alex was raised on a boat it's from the
ages of 1 to 16 with 16 other people
yeah but she got out she's pretty normal
now government checks Joe exotic for
president yo I mean if you pulled that
off right now could he pardon himself
Carol Baskin assassinated by Drew we're
in Golden Gate Park
yeah the quarantine is a little
overhyped guys yeah I wouldn't you know
go to a bar or Club but you know I
wouldn't go to a club I wouldn't go I
don't go to the club
well that's true I mean you know
that was that was that was China circa
2010 back in the world was so good you
love Clark the free plate absolutely
those dragon fruits yeah those were good
enough occasionally they'd bring out
like duck liver or something and be like
damn
terrible food and then one time they
brought out bat no just kidding they
don't eat bats in China so by the virus
escaped from a lab but we're doing
projections yeah yeah we're doing
prediction in Manhattan you're locked up
here I mean are you what does the law
actually say you can look into that you
guys know any cities where things are
still happening I'll get on a plane
we'll go there yeah we could go to a
rest in the UK you get a $50 fine in the
UK you also get a $50 fine for like
saying something about Muslims on
Twitter so you know I don't know about
you guys and then on a free speech you
guys fight for free speech free speech
is important free speech is one of my
favorite things about America yes Sweden
isn't sweetener that closed down I think
they closed the border about
I mean Iceland is not closed down either
no they won't let me into Sweden and as
they shouldn't I'm from the I'm from the
country with more coronavirus than
anywhere why would they let me into
Sweden I mean I think you might be able
to go to Taiwan but you have to do a
government mandate of 14 North Korea is
operating normally
all the propaganda from North Korea says
they're operating normally
thoughts on Carmack leaving oculus and
focusing on AGI I've actually spoken
with Carmack recently we did talk we
think talk to Carmack about this I'm
very uh I you know I'm always optimistic
I'm cautiously optimistic I think the
man is a genius and I think he has some
interesting ideas that are at least
worth trying yeah
they banned the virus
[Laughter]
okay make predictions on AGI so I'm
definitely bearish on AGI by on anything
that would be considered AGI by 2030 but
okay so we started out with I think that
we are either going to have people on
Mars or be very close all the combat
that's why we kept that's not ours to
share who is that I was involved as
reminder ship but um so and this isn't
gonna be like the time we went to the
moon and we sent like three people there
and then we went back because that was
done by the government just to you know
wave their dick at the Russians the moon
landing was actually faked that would
that would seriously that would
seriously make me undermine my ability
to think about anything
[Laughter]
alex is not in biz dev don't worry
computer computer is gonna do it okay so
another prediction um
the Star Trek Universal Translator will
I mean I think it's gonna take time for
it to actually be good but basically
yeah because yeah it's not gonna be like
we already have the underlying tech for
you know there's always this problem of
how do you block out their voice noise
cancelling headphones bro we're still
put on yeah put on some air pod sevens
and you can hear the whole world in
English
already goes in your ear and does some
amount of time it's probably like Google
glass and tariffs oh I don't know
predictions on the rise of cam girls
post Kovac I mean I think camp girls
it's a golden era it is it is a golden
era of cam girls easy if you'd like to
get somebody to base themselves online
for you prices have never been lower
that's like the oil markets right now
dropped for cowgirls I don't know I mean
you don't really have prices they kind
of operate on a donation model a lot of
them so if there were an actual
efficient market yes prices would have
drops yeah everyone's live right now uh
yeah you might start an only fans all
only fans is really you want to start
not like that no no no that was some
subscriber who said it that's why I read
it because subscribers are better people
than nonsubscribers pro tip to you other
people we don't stream for free bros
it's true it's true karma doesn't pay me
anymore six feet apart oh no no we
protest we stand we fight the authority
you're not even giving them your best
prediction well okay we're we're so so
yeah so that's it we went thank you for
subscribing who subscribed em bmz all
big girls one big Griz
what's the chest move against dropping
the CEO veg bro there's no chest move I
just didn't like being CEO fucking suck
then I realized that I had jump is gonna
win if Trump doesn't win twenty to
twenty but I think I mean I predict that
the only way the coronavirus will affect
Trump's re-election is if he gets it in
guys paper Martinelli releases the
coronavirus oh no oh yeah we know I'm
sure I'm sure Martin shkreli is off I
don't know George a 33 year old guy in
my area died somebody somebody's gonna
die right like statistically again this
isn't if this was a disease that a
hundred people had and a 33 year old
died in your area that's different this
is a disease that has half a million
confirmed cases in the US
oh come like sorry I was like covering
the mic oh I don't know um that's why I
have to hold it like this we really need
honey booboo for president no I mean I
think at the end of the decade all the
candidates are gonna be I mean we need
to have some kind of or okay fine you
know you can also I will say that all of
my predictions are in the optimistic
camp I mean we could do we could do
pessimistic twenty productions all the
candidates in 2030 look like Joe Biden
[Music]
predictions on streaming video quality
improving now I'm not I'm not a
pessimist I genuinely have very high
hopes for this for this decade
no no military's our economy no but uh
oh we'll Bitcoin moon no I'm very
bearish on I do watching it's gonna be a
little bit better but it's still gonna
remain a theory um's not gonna have like
they're gonna actually fix the capacity
issues like it is going to get better I
think there's no doubt that it's gonna
get better this like blockchain is going
to replace the money it's better yeah
like like easier to use of course well
it just isn't
um yeah sharding will happen show you
around beautiful San Diego not in San
Diego San Francisco
George listicle coins like tethered to
the alright we're rooting for our
prediction markets would be great
because then we could figure out you
know fuck all of these models made by
government shells a prediction market is
gonna tell you exactly how many people
are gonna die of coronavirus yeah right
I mean if the prediction market really
gets big enough you can have people like
voting for something and then like you
know are influencing politics I lost
money every day
what you better I did not Biden oh you
got you went not Biden for oh I've only
bet one son predicted and it was on
Trump in 2016 and I made 16x returns on
that I don't even think I think I think
Trump is already bottomed out if you can
get there's a classic predictive meme in
the comments where it's like you know
people like fake shill fur there's no
way down is what I'm saying
I know so that so that they can buy
cheap Trump ships I mean there's tons of
discord some of them you could even pay
to be a member of where people tell me
where the Zoomers congregate
we wanted or the zoo we want to know if
new culture is happening and we're just
old isn't winning of Trump a good thing
I mean it depends who the opponent is
versus Joe Biden sorry I'm pulling the
same thing Joe Rogan said yes it's it's
like did Carol Baskin kill her husband
though I think no I don't and I think
that there's actually like if you look
online there's more to that story that
involves like the husband's yeah I mean
I think Carol Baskin killing her husband
is too convenient for the gel exotic
narrative almost
yeah yeah um karabast
don't get me wrong I thought she was
bitch
not every bitch what will happen with
snow tonight I mean oh my opinion of the
Apple Google partnership put it this way
if they don't actually give you a way to
opt out maybe I'll get back into
jailbreaking now I wouldn't go that far
but actually would switch on Android on
and I'd commented out if they if they
tried it if they try to push Public
Health shit into my phone without me you
know what I'm a nice guy I probably
opt-in the Apple Google maybe like you
know I think oh I don't know no this is
these are short-term predictions they're
not making short-term predictions on
this dream short-term predictions are
yeah we haven't we haven't been talking
about the mainstream topic really um so
I think that AI is going to get good
um and I will make the most common
related prediction I think in five years
we will have level 3 level 4 working I
think in 10 years we'll have level 5 um
so I think self-driving cars or
something that's definitely gonna happen
in the next decade I put my money on
before 20:37
the self-driving cars yeah oh I think
the 2030s are that are the real severity
yeah I think I think the light 2039 is a
singularity but I think the 2020s again
I mean in a way all of you here on this
stream oh you wanna see the windmill
[Music]
tech talent migrate - that's a good one
there the world ends in 2038 the world
you yeah it's gonna be y2k again yeah
the UNIX timestamp roll all over the new
white you came out wall is 64-bit
computers by then VR innovations yes so
I think that's gonna be yeah I think
that's gonna be a big is David's
prediction public yeah I think by the
end of the decade we're going to have
really good both VR and I think AR
technology will be in common use oh no I
think I think as phone replacements okay
no phone we have headsets I think you'll
have a place oh yeah I think I think
it's the iPods you know yeah I mean no
maybe not if we're walking together like
I don't think it'll be that I think it's
like together we do yeah and like
sometime I think it's like air pods all
right do we put on air pods together cuz
it is personal in the same way exactly I
think that's how often we'd have
headsets on but I see headsets being the
new air box phone that's gonna be a bit
of a technical challenge I think we're
gonna have high bandwidth streaming to
headsets before we have and what am I
gonna be watching you just born he's
like what's going on in my head what do
you mean everything you know yes you're
fucked I'm walking around with it so I
can see
I think there's gonna be walking around
with it well I think our gonna be like
VRA our headsets and you'll be able to
dim the outside world and rise it up all
right in the same way you can no rise
and dim like the air pod noise
cancelling it off you're basically just
gonna get air pods for your eyes I am
rooting for Apple yeah close to the end
yeah which I mean okay my prediction is
let's say 2027 because about about lack
of new technology yeah what's the new
curve well there's no new curves really
it's just gonna be things are finally
gonna get good right what were the new
curves in the 60s the sixties will win
like nuclear power got good the nuclear
missiles got good like that's the end of
the nuclear curve oh yeah yeah we went
to atomic city in Idaho who's gonna win
with a RV our unity are unreal oh yeah
are we gonna walk on beaches
nuke war I don't think we're gonna have
a nuke war you the curve baby yeah we're
gonna do it
valve on VR that's not clear no one
wanted to yard yeah well AI impact on
education system well I'm very bearish
on anything today that we call education
[Music]
so okay full disclosure in the 2020s I'm
gonna take my comment a I earnings and
I'm gonna start a cult it's not a cult
it's a chair well you know one let's use
the word universe a school a school a
place of Education it's going to be free
for everybody who can get there and who
can pass an entrance test no yeah put
this way like if I'm thinking about it
aren't other people to Plato's Academy
fagor is did this right where do you
sign up there's no sign up yet we're
looking at properties you know again we
need a few more years of comma AI
winning self-driving cars full
disclosure my position on coronavirus is
somewhat influenced by the fact that I'm
a small business owner in America you
know one of those people creating jobs
for the middle class when's the next
kovat nineteen stream guys I did 25
hours of research live on stream another
25 off stream I'm over I'm over coded 19
I think there's only so much you can do
there's so much you can do right what
kind of new information you can glean
well let me give it some time the
question was like is this is this
something that's incredibly high risk to
me is this something that's medium risk
to me or is this something that's quite
low risk
my conclusion is it's quite low risk -
Trillian no oversight yeah I mean it's
just a scam well let's not get the gold
right
I don't not really one of those fringe
gold guys I like pretending to be a
fringe gold guy sometime no but um you
know there's a we saw some stickers
around here what was it boycott rent SF
yeah well so if your boycott rent who
are you ripping off right
fundamentally someone has to pay for all
of this and it's not gonna be the elites
because they're scammers it's not gonna
be the poor people because they don't
have any money right the last the last
40 years have been a great wealth
extraction from the American middle
class
you see it all the thing coming equality
and then who actually doesn't have the
power
oh you behind oh you have a viewer
following you behind maybe I think it's
all we care about dated fold it kind of
fold it and we'll get it out in the
bubble screen
thoughts on PS 5 it's the same bullshit
is the last one money printer Goldberg
yeah and yet we do have to do something
about that money printer I mean
personally I don't know actually Alex to
be completely honest I don't actually
know what the ramifications of gold
would be something no something I am
very much Pro is that like the Fed
internally should have you don't need a
blockchain you just need not is a
database yeah right like a database
that's auditable by anyone in the public
you can print money but you better let
us all know exactly how much money you
printed it's all insider training
very high-profile yeah now this is this
is normal this is normal they're they're
such scammers with that market the SEC
is not an organization designed to
protect you not letting you invest in
comma AI the SEC is an organization
designed to protect to institutional
Wall Street I mean those are most of
these I don't think I think this is the
same pattern in every one of our
governmental institutions yeah all right
like the same way Google became scammer
well the SEC became scammer the SEC is
founded to prevent poor people from
having access to investment because
they're too stupid to know the risk bro
have you been on Robin Hood have you
been on our wall street bets do I think
Ovid 19 will seriously change our
society
no I've hit it slow I'm not making any
stupid real-time predictions about the
stock market I'm continuously surprised
yeah I really should go so do I think
handshakes will come back no handshakes
are dead and we never liked handshakes
Trump was ahead of the curve with that
drop gets done in by the old coronavirus
thing round germophobe done in by germs
um I never liked a hand it's Bernie
Sanders got some bad news about Bernie
Sanders I hope you guys got your refund
I got my refund he's getting a refund I
didn't donate it but uh that's good wow
that's pretty nice of Bernie man what a
good guy we'll break the 35 percent THC
mark on weed yes I want it naturally
growing I don't know you can only buy
some of those pens
I took yeah I don't know I took a hit of
a weed pen once there's growing Tommy's
eighty-five percent THC Wow I look like
a small head I was five for the three
hours do you think there will be more
remote jobs I think we were slowly on a
trajectory towards remote but I do I
think mushrooms will be legal yes oh
yeah we're getting yeah I mean I think
we have to do something about all drugs
it was odd kind of no you really don't
what do they do they meet do they want
to try them like what most of them have
tried also you guys I've written things
that you're on drugs all time it's true
man it's true
I mean they said this is Gary well like
the Trump sauna had a roll Trump said
how things are all tricks on songs no we
should go watch old Tom videos see what
we think actually I think people confuse
Trump's inability to read with I've
never used the teleprompter it's true
did you ever post on wall street that's
not oh my god
my mom calls me asking her advice on the
stock market should we Sal should we
tell now what do you say I say Holly not
buckets generally go up trumps aunt
modafinil
it's weird
so we're drunk not obvious how it feels
or what it does my dad was a drug I've
tried it's low-key good new go pill on
go pill for like the military well I
think they fed me now I mean they could
give people in it well you know I mean
you know about the trajectory of
antidepressants in America it was first
opiates yeah then it was like cocaine
then it was barbiturates absolutely for
is a big cocaine guy they would inject
it and shit I mean to be fair if you
didn't actually like know about it you
know what I mean like no I don't think
if I didn't know about and I took it I
was not not for me no but like I think
people didn't know how to associate like
feeling good with being good
because there was much less things like
right in the modern world we're
constantly exposed to like candy bars
and shit yeah all right so everyone kind
of knows yeah well this tastes good but
it's not good for this feels good but
it's not good for how to join common
yeah you got it give me a job yeah yeah
I I think I will say that's fair if you
can't figure out how to apply that's
kind of the first test definite that's a
sad realization though yeah I think a
big part of the culture and working with
you is that you have to absolutely all
the all the information is available you
have to find it yeah and that's the
world today everything's available I
know I'm just like who asks yeah yeah
what is the next thing for the music
industry actor oh well we okay we were
debating on the music you want to defend
your position on the music industry is
weak now not I'm not standing that
nothing you've changed my mind
I haven't changed your mind okay yeah I
mean I think that the music industry's
actually one of the most healthy
industries I think that music today is
incredible
I think that it's well there's search
engines social media I mean I think I
think what airplane manufacturing does
it unhealthy industry right I think
there's tons
but no I think that the music industry
because the production
I mean you genuinely have like lots of
little peep like people in the world
dear viewers things that we should just
let all these big companies go bankrupt
oh yeah yeah well we started with okay
you know we're bringing back the French
Revolution we're bringing the guillotine
back whose heads were chopping off right
and like you know it's the Congress and
the large companies right yeah but then
we realize that you know we do live in a
democracy and we can just solve this
problem who's voting for Nancy Pelosi
and who's voting for Mitch McConnell yes
I'm voting for these people bye-bye
bye-bye
thank you for serving us terribly for 25
years yeah so I mean the big companies
are the same way right
does our economy does our whole middle
class exist a prop up these these
companies that are you know strip mining
themselves to stock buybacks right so we
got to let all these companies fail
we'll make the planes someone's gonna
make the planes gonna make the plane and
right you know guess what with the death
of Boeing there's gonna be a lot more
interest in what's wrong with stock
buybacks what stock buybacks give
executives a way to get their money out
while basically like it's it's it's
they're not aligned with the company
it's them versus the company and like
dividends on the other hand are their
people little dividends the stock
buybacks are just the same thing you can
do the math out there the same well my
favorite finance explained it to me and
he from a very technical perspective
they are
from a very technical perspective it's
just letting all the people buy out
basically like it's reinvesting your
dividend for you sure if everybody who
wasn't part of the buyback just
reinvested their dividend it would be
the same thing at stock buybacks
but the problem is dividends come to you
whether you like it or not
buybacks reward an investor that's
paying hyper attention and that is never
your middle class person with a 401 K
they never benefit from stock bonds and
it also encourages this whole the CEO of
Boeing doesn't give a shit about Boeing
right
these people aren't founders these
companies the founders died years and
years and years ago right it's time for
these companies these companies have
gone through the whole business cycle
and it's time to let them die ha ha yes
yes we must make the number go up
ok everybody try the number chant any
Boeing is too big to fail no it's not
let's let it fail oh no it failed Oh No
look at the time we shut down the whole
economy because you know a bunch of
people freaked out and you're telling me
Boeing's too big to fail yeah like when
the Dow gets hacked sure when the Dow
gets hacked sure aetherium can revert
their whole blockchain but when a
theorem gets act
if they were too big to fail why
couldn't they build reliable new planes
yeah very they've already failed do I
think Trump has stocks on hydro chloric
win alone he's this this whole thing
battles but like Trump cares about like
a couple of million dollars that he
makes on some stupid stock thing yeah I
my read on what Trump cares about is
Trump cares about one thing
do the people love Trump do the people
love Trump oh I'm gonna have a big rally
and they're all gonna cheer when I say
Trump what's up with the f was the app
for the Trump or for the for the for the
companies or for the stream
are you still planning on making an AR
head set back today it may not be the AR
headsets
today it could be in the future what do
you mean like uh on making the AR head
oh yeah yeah yeah yeah no I mean you
know I was just exploring I was
exploring talking about medicines
recommendation guys if you're drinking
fish tank cleaner you have much deeper
problems it was some guy said on Twitter
no actually I think we can talk about
that no don't fuck normal people talking
about medicine I not only think it's
important I think that a lot of these a
lot of these expert organizations are
not better than a intelligent individual
reading the interent
I think if an individual knows how to
read the internet knows how to put
information together they can outperform
like come on the World Health
Organization all there's no human they
told you that that masks don't help you
and then some new study came out two
weeks later that's a nasty Wow maybe it
had to do with the fact that we were out
of masks and I think lying are people is
a good idea yo just if otherwise why
would doctors ever wear masks masks and
do anything no but we have to stop the
bailouts for absolutely everything
starting with the college education
well I mean this is a huge problem if
you trust me all of the all of the you
know interpretive feminist dance majors
would dry up real fast if the government
wasn't covering their student loans
turns out the world just too many
interpretive feminist answers absolutely
but they can pay for it out of pocket
this is a free country well no to be
fair though if you're a bank who do you
want to invest in them or a petroleum
engineer you know maybe not right now in
the petroleum engineer but that's the
top pay stopping major yeah petroleum
engineer where can we find the oil I
just you always see there on the top of
that they want us to test
that's what they're asking stocks
finally made it to a gorge tomb when's
the wedding and will you invite twitch
chat now fuck off weddings are illegal
haven't you heard of Cologne a virus
they apparently canceled Burning Man up
by the way I think this is gonna be the
best year of Burning Man ever who wants
to go to the playa we're hosting our own
Burning Man AR has hella potential yes
we agree with that are we going to the
clubhouse
should we show them the beach yo man
look at all that social distancing out
there on the ocean oh you want to stop
at this thingy oh the Cliff House where
their petroleum engineering is in Texas
[Music]
[Laughter]
there's a long way from the phone to
fall show them what's the value of
college or some do you wants to be a
programmer no you can't go outside bro
I just did what are you gonna do about
it
right next to you George I don't believe
they're here if someone actually came up
to us would be funny I won't shake your
hand no those are illegal in the era of
coronavirus take us into the water oh
the time we walked by the cliffs and
went in the water sure I was gonna die I
was sure I was gonna die
College helps you get a job and forces
her to study yeah PG stream' please yeah
that's why it was that's why we flipped
the camera around
let's call the cops chat do it do it
behind you in blue t-shirt is there a
guy behind me in a blue t-shirt that's
right good point
Jones already above you yeah I wish
someone was working someone's on the
drone please you know what a drone ad if
someone gets a drone over here I'll
attach a hundred dollars I'm just gonna
say the same thing alright what are
their predictions do we have before we
go
they are Mars AI Tech's about to get
really do it
I think BIOS still kind of not gonna
happen because I tried to fold a simple
ass protein and it's too hot
Oh what personal flying things happen
now what is your keyboard keyboard I
don't have keyboard what about China Oh
in 2021 yay applause follow me you know
the Japanese will make that happen
predict when do you think they're gonna
open the economy oh pretty eclectic
we're gonna open the economy so shorts
on I'll give you my shirt prediction
right then I think at the end of April
most things are gonna open with a few
crazy states don't oh I'm gonna look
into nandi I'm definitely looking to nab
do on the next stream guys installing
CUDA such a pain cuz Nvidia hates you
bro why was i living in China China shit
do I think the US and China will go to
war within the next 20 years
no it doesn't make sense for anybody
what's the war gonna be open the u.s.
channel every minute I'm the US and
Russia went to war
oh yeah it didn't happen
why can't biotech work I agree why do
you think I took second that's one of my
four versions at the singularity well
yeah the singularity is not gonna happen
till the 23rd when we'll discuss the
cyber war is happening right now this is
only ten-year predictions
yeah the cyber war just sucks cuz you
don't hear about it well Microsoft throw
me no absolutely not
this is the end the shutdown no good way
no way they and the governor's notice to
the minute they close the shutdown sorry
bro that's the most powerful you were
ever gonna be in your life predictions
for Tesla making out of it they're not
gonna ever make a singularity in 2030
end of the 23rd is the singularity but
the 2010 the 2020s is going to be a
great decade what do you mean by drone
warfare well some cop chase a guy down
with a drone yes oh yeah singularity is
not happening we're never going to Mars
either like an individual no guys
hacking is like kind of not real they
think the competitive solitaire scene
will hit this year making
looks like look you guys I I did feel
bad for Libra I do oh yeah next what
about a neural link and decent ink a lot
of the neuro-link stuff is overhyped
about what it can do but I do think by
the end of the 2020s we're gonna have
something great I definitely people
think that it's gonna be like magical
it's gonna be yeah if you if you're
paralyzed or like a quadriplegic the
next day the next time the next 10 years
if you actually are like locked in your
body are gonna be amazing
again it's really it's gonna be even is
gonna get people who just like you know
love him more than anything else talk
about a product with engagement you know
if someone's like locked in their body
and can't use a keyboard in the house
I'm not sure that things like neuro-link
are gonna outperform I don't think
things like neural link will outperform
a keyboard and mouse and touch screen
well no one is out five will trying to
dominate with AI George's girlfriend's
bad hey thanks bro yeah she does joke
shall leave me I mean I think she'll
leave me too you know what I mean
alright guys I think that's us man it's
time thank you all for joining us
predictions a are more self-driving cars
gonna happen a lot more is gonna happen
the 2020s are going to be a great decade
it is a wonderful time to be alive
everybody go outside unless you're old
or immunocompromised then you might want
to stay inside but otherwise stay safe
always they say if we love safety safety
is one of our key values on this stream
you
so we'll have to push I guess I could
just push from github bathtub okay cool
so here on my Windows computer we're
gonna wait for some people to show up
today is chill stream it's chill
oh that's exciting that it's your
birthday but I do have to say that these
dreams are all about me
these dreams exists to glorify my ego
not I don't know man it's early happy
birthday my 3xx you are the first person
to speak wait are you a subscriber does
that mean all your trich prime ok that's
almost to subscribe where we love our
subscribers because they give me money
and I spend money on great thing it's
like tea here we are we're drinking or
drinking tea you know what was I
thinking this morning
somebody in a comment
call me melodramatic melodramatic I
looked it up
especially in being exaggerated
sensationalized or overly emotional oh
no man
it wins 5 out of 12 games bro you're
almost halfway there you know it's like
you have a self-driving car they can
drive on 5 out of every 12 streets
you're almost halfway there yeah yeah
yeah so Windows the most common
operating system in the world we're also
trying out vs code today and I really
used to before
so let's first get checked out - be
Cash's now we have a branch let's run
the mini p-value tests so for those of
you who don't know many TV displays
distributed file system it's now used at
comma
you have to allow access through the
fire that's our test oh yeah that's just
for rebuilding and stuff so first thing
that we're gonna have to do is look at
these two record and from record things
you all just stick the hash on the
suffix this has suffix not valid oh my
god you all think I'm on drugs you know
what greedy
you know what greedy BAM that's right
it's ban you arey is bad morning what
that sound is is my laundry we're doing
laundry okay is there been keybindings 4
vs code how do I get vim keybindings
we're gonna waste the whole stream doing
crap like that boom keybindings
yes color this probably has one of these
stupid plug-in architectures
[Music]
your subscriber you get away with more I
just look at somebody and I don't see a
star next to their name and I don't see
a crown next to their name then I'm like
get the fuck out of my channel anyway so
hard to use alright guys I'm sorry to do
this to you but we got to go put the
clothes in the dryer so I'll be right
back
all right Pisan we're not dry clothes
it's gonna be a good deck
so many key values my distributed file
system you'll find it on my github /g oh
hi
just tell you how to install the s code
event script is not supported oh this
looks hard it's automatically enabled
install okay yeah sure yeah
press the gear in the bottom left I mean
this is what everybody is using I should
kind of learn how to deal with our 300 M
key bindings oh this is really nice this
works
[Music]
cool thanks bro
yes we're just gonna do it has suffix SS
type shit that be it's gonna be an md5 -
I got some tests for that - yes
okay you probably want to keep them as X
as well no she'll just be a string
hey how come I've in is gone we want
really what the hash to be in there and
optional
now I should really use some real
serialization thing that isn't these
stupid hacks just stop working job
I run that test 101 lip test go go test
Oh index must be non-negative ah that's
too bad too few values instruct
initializer is there a way to make
something optional and a go struct
optional this looks awful
go strong default value
I have least do that
right a seperate constructor function oh
my god
why can't I just do this why doesn't
that just work no it's gonna complain no
that's of course not gonna work because
that would make sense and you know let's
make sure my pull request make you high
you're a little boy star who's talking
about fucking calm a guy who's talking
about self-driving cars
monka monka has five ones he's booking
us fine a subscriber your subscriber you
get a warning if you're not a subscriber
to get banned no that's a layabout
market go
okay well now you don't watch you just
double prefixes yeah it works
it's office
[Music]
mismatched type string and array string
oh that's not right and now we have too
few values and structure visualizer okay
now we're just left with too few values
instructive but it's because I'm
creating records and I don't give them a
hash let's just talk about it who's
talking about it wait honestly who's
talking about you know time out time out
not the place whose monka s5o your codes
darvid you know what time out there we
go y'all gonna be nice
well you'll just risk it you know what
you you are actually bad no don't mod
user we're gonna ban music yeah there we
go
this is always you know this is really
common at the beginning of my streams or
you guys think you can get away with
shit and then you'll realize that I read
you guys know what the number one rated
a management book on Amazon s oh this is
the Dover thrift Edition here we go look
at this I got it today it's the number
one bestseller in office management you
know oh the audio is bad well I'm sorry
you can buy me a better microphone this
better that's right
oh it's not bad at all what are you all
causing trouble for all right I mean we
could just edit every place where we
create records
here right don't have a hash
perfect
now I have to go through and figure out
everywhere I created a record here we
gotta create the default record here see
that
rebalanced server creates some records
we're actually gonna want to compute the
hash here though so well we'll get to
that later first let's just add support
so the idea is we want every file to be
able to have a hash value we want to
keep it backward compatible with the
existing mini key value just and rebuild
so what rebuild does is if your database
breaks you can regenerate it okay don't
fail print Ln list and the redundant
newline what that's kind of by design or
whatever
I know so yeah maybe maybe we'll change
the name we're adding a file hashing
support but this is a Content hash it's
based around yeah it's based around
level DB which of course is already a
hash function Sergio thanks for the bits
[Music]
okay we really should have done some
test-driven development here would have
been a great example but let's get like
md5 hello
I hope those are working you can add a
println just
I kind of like that in the tests anyway
shows that they're past okay and support
to record Oh guys you know what I got
and we can go open it on the stream
I got an Apple watch I bought a series
five Apple watch yesterday and I will
push it from here we can just publish
branch perfect alright now if we go over
to github we should see my hashes branch
we can even create a pull request oh wow
this is really nice but not mob no of
course you can't do that from get a
desktop you have to do that from this is
mini key value and you'll see there's a
hashes branch how am i editing the code
directly from the server no it's not
mounted so this is just using uh it's
actually on checked out in the Windows
system you can check my commits all
right so we're gonna see kind of what
I've written so far so we added hash to
record type I added a mechanism for
parsing the hash if there's a hash
prefix I added a few more tests I
shouldn't have removed that I got
scammed but it's fine
okay we're also going to refactor
rebalance at some point to not do it
like it's doing it there isn't rebalance
call this server now right yeah those
are the ones calling the server now
whatever that code what's he's done yeah
you could separate them by something but
yeah it's a fixed length right like it's
all gonna be md5 so that's fine they're
guaranteed to have it you only need to
set null if you have non fixed length
sure might be better for the future a
lot of things might be better for the
future wait some more
[Music]
so the person who suggested hacking NASA
had it storming area 51 go that went
well
we'll consider it okay so what we're
going to need to add here
[Music]
that hash so I use hashes and live see
how I do it
yeah another sex really do five have to
import crypto md5 here yes I do
we love md5 md5 is the best hash
function ever sha-1 used to be better
but now it has collisions - who cares
it's all the same md5 dots some body
md5
TxDOT encode to string
does that work
Exploud cartridge king seems nicer
[Music]
the hatch of the value its key value
lies on file
yeah it's not doing yourself - I think
it's just WSL and if you tell me a way
to check out that many key values yeah
go a while ago the Python one was too
slow so now like let me just make sure
that my delete is not stupid
mmm I say oh it's stupid yeah it's
stupid we want to say rekt on hash here
that will persist the hash okay do the
test don't pass let's say cannot use
body type io read R by E what I've
literally copy and pasted that code all
they're doing it like that that's not
right
because what if they're zeros
the sources bite
I don't even know
okay fine you know what I'm done with
this fat guys have this worked does this
work it does have a fixed length so
maybe it is okay
multiple valued format print F in single
valued context why I want to ask printer
for something oh my god
she's legacy is disgusting alright well
that's a different problem not use md5
sum I oh we've got a new way to do this
we'll put a new hatch interface to write
to IO copy okay fine fine fine fine fine
oh that's cute never mind I do like that
better
even though does hex encoded string is
this uppercase hex or lowercase hex
okay Xperia Clark a sex is way more
beautiful
I copy ash body
[Music]
how can that error
ban the annular god wasn't the angular
got what's wrong with the angular got
what does he do to me just cruise
through her van happy doesn't mean we're
gonna bit out okay all the tests will
pass it's good
let's did I write something that after
the test run we like dump dump for that
it's kind of level d compared try our
test our test should actually fail no
Noah values mash because they have
hashes look at that
see so this key now has this hash in
front of it okay all right what it's not
she's not you want a bigger
I don't think ctrl+ work sorry
ctrl+ won't work yeah
add the hashes to here
okay now if we have a hash I think what
I want to do is just return a header W
dot header set and read the REC - is not
equal to CR out there some standard for
that so I can just make up something
again just trying to be is this editor
trying to be smart and like put braces
and for me I hate whenever there's do
that content 5i here we go I got it
right
oh it's base64-encoded for a 128-bit mv4
digest
I guess 128-bit is exactly what I'm what
I'm doing
let's read the RFC
good
content md5 generation blah blah blah
did it say it have to be base64 ah has
to be base64 cars can't help you there
that shitty you know I don't really like
that does anything I actually support
this thing
Oh was removed because it was any
consistently implemented with respect to
partial responses oh that's an
interesting problem we have that same
problem we should add a note note that
the hash is always the whole okay is
legion high of causing trouble what I
was ridiculous okay so now if I run mini
key value it's really very easy to use
um you can just curl which puts big swag
and we have now you can get key oh here
we go content md5 let's go online to
make sure that's actually the md5 a big
splat Wow
wait this is gonna be the fastest we
ever like did anything normally I say
like it's not right not nice -
that's about that huh
it's not right
should we had a print
the whole body of that request should
just be big swag what now it yes well it
says this is the md5 what is that the
md5 of
zip archive data Oh it's an empty hash
ah okay my md5 er didn't work
if we've already read the contents into
the tea reader oh yeah I messed this up
um this isn't right this is stupid arrow
stupid stuff I can just say md5sum bar
dot writes look at all those lines no
saving cannot use buff dog bites type
funk bites
ah the function then we should call it
anyway slice of on addressable value and
now we're back to this stupid problem
again so we're back to doing this
programming you don't need that anymore
pretty much back to what we had the
problem is that I was consuming the
reader and actually need a reader there
I don't know why I wrote all that code
still the wrong hash
it didn't really put okay what's the
correct ID right now
I guess the put was down leaving the
floor what happens if I try to again to
put yeah okay so yeah that's for three
okay that's fine
cool fix hash computation and return
it's not PowerShell so I setup Ubuntu
using Windows or Linux subsystem and
then I just SSH into it okay that's done
let's just try to come to test that
[Music]
again we probably could have done this
with test-driven development I don't
know we're probably gonna wash I was
gonna open that in them I'm trying not
to use them today trying to use vsco
here we go oh yes let's install the
Python extension oh it said
multi-threaded debugger that's more than
I could say from Python
[Music]
I don't even know what this does is
gonna send my code to Microsoft isn't it
sure why not it's open-source reload the
one I regret this markdown went
we use many key values distributed file
system for anything so that's our dock
content let's print the headers yes so
the problem is that isn't with a header
[Music]
I don't understand why the D became
lowercase and that just weirds me out
because I quote md5 here
but I guess that's the standard for
that's the only thing I want to check
I'm a little bit concerned about that
that printf thing
is that I mean that syntax isn't really
like sensible and server
my concern here is what if there's zeros
actually
let's just try something that has an md5
hash with a lot of zeros we're gonna
watch let's make the test better it
should be easy to compute an OD v in
Python all right let's just say data
actually ski
[Music]
come to be five what else you do import
md5 or use hash Libya exactly I know
hash lived on employed ashlynn this is
laggy er than them
wait I was already using Ashland Oh
didn't need to do that
[Music]
tax digest oh yeah love that love that
until I complete whatever shit alright
cool
okay I mean if the test passes arts has
not fails which is interesting just make
sure some of these hashes start with
zeros
about crash I see what happened
that kills us
- zero can we see one of those 0 r is
equal to zero it's just fine yeah here
we go
yeah so it must you know what we can
also yeah yeah windows firewalls upset
with me I know yeah we shouldn't of our
code crap like that and tests oh I'm
just so it's just so conditioned muscle
memory all right for some reason twitch
is telling me I have zero viewers which
I know is not true Wow three hundred
seven hundred fifty seven thank you
thank you for joining me today on this
beautiful journey where we add
functionality the mini key value little
extensions all I can search extensions
in the marketplace all I can make micro
payments to improve my editor Oh
somebody's okay yeah that all sounds
good cool okay
now I think if we go to github I think
we're gonna find out that the tests are
failing I wanted to be done but we're
not done because the tests are actually
gonna be failing I believe oh we don't
know that until we create a pull request
and create a pull request I'm not logged
in together you don't like my new sub
system I'm sorry
let me just log into my other laptop get
my to obey and screaming
I don't think they do it we just took
the rebound test the rebuild tossed
chaos and the reason the rebuild test
fails I mean in a way we could just fix
this with a hack and that problem
actually the best way to fix this
probably is just by fixing the test if
v1 is not equal to if add some
[Music]
now
so the problem is we do this test where
you rebuild the database and then
confirm that it matches but undefined
strings okay but the problem is the
rebuild doesn't recompute the hashes if
we're rebuilding just the level DB it's
optional to have the hash
good pass fix rebuild it says fail test
Valley just like I thought
yeah we you want to pay me a couple
hundred dollars right look I'll tolerate
you because you're a subscriber when I
talk about how on this channel I'm
desperate for money and I love money I'm
joking around I have more money than I
possibly know what to do with so a few
hundred dollars is not going to entice
me to do shit
now if you post it it says you are a
subscriber if you post it in the
comments we can all talk about it and if
it's good we'll be like Dan that's a
good idea and if it's stupid we'll make
funny because like Max Reed once said
bring back bullying do I talk like such
a douche IRL yes I do and your time down
woo
you want to talk by I mean you know the
trolls got me thinking do I talk like
this in a real body I mean the part of
that I'm focused on is the real life
part Odin XVI thank you for subscribing
to my channel are you trying to tell me
that my stream is not real life how do I
address patents I address them as your
majesty your majesty
great 5:33 lidar patent of the way Moe
uber lawsuit yo if you guys want to read
something sick it's New Republic it's
about the 737 max yeah this is brutal
it's brutal I love the picture you guys
know this is something I've been
following you really upsets me
finally uses Python yeah
tell us more about it come on come on
Shane Shami all right guys we already
did what we have planned to do for the
the stream today so let's go in hack a
rank do our slut hacker rank installs
and let's try to use esoteric
programming languages to solve problems
I thought this might be fun no George
what was my name do hot crap maybe
that's what I used as a password do that
what was my name from the last stream of
Geo hot junk oh good thinking yeah yeah
G hot junk you were bro what passport
did I use I don't know
forgot your password geo hot junk
probably's geo hot junket malonate or
something
oh great select pictures of bus mail
inator calm feel hot junk Oh perfect
anyone else tries to reset my password
using mail Nader I'm coming for you
all right perfect
am i open - yes I won't put to new job
opportunities absolutely my name is geo
ha junk
I live in Alaska my profile headline I'm
just I'm just I'm just upset by this I'm
just no no no Alaska
I live in Alaska okay what language
should we use you know what you know
what
all Bros Bros do you know about morgues
I think I'm what was
oh yeah using only one color see this
guy this guy is my YouTube idol one day
looking this guy's does many mores one
guy I wanna it's just laggy but if you
guys you guys should watch Morris all
right we'll use Haskell
what this looks hard
what
oh no lost no never my own play hat I
don't wanna play this anymore
we already did what today's we already
did what today's uh no it's lagging
because my monitor is 5k and I don't
actually really understand now we
already did what today's stream was what
is leak code wait where let's make sure
the tests actually passed yeah we think
the test is good
yo yo real talk don't we jail broke a
shower you ever wonder why you shower is
low-flow well you know get a pair of
pliers and a pair of needlenose pliers
and a cloth and some plumber's tape and
you can jailbreak your shower to kids
our knowns as dreamed up to all time I
don't tell you you know it's better the
environment the climate crisis division
is coming for me whoever walks up
Oh
yeah Bros is an Apple watch series 5 all
right we'll do the unboxing and then I
have a copy of Machiavelli's The Prince
to read to learn how to be a better
manager
[Music]
we needed to improve the acoustics of
the room I didn't want you to hear the
dryer
[Music]
there's a tiny
I think maybe
the information down apple.com / support
/ manuals / watch
we have three pieces I don't understand
why instead oh I guess it's how big your
wrists us this is very small residence
this is for human heart wrists
here's my Apple watch
do I have a wrist or do i have a small
wrist
how do I know which one goes home I just
hide its our picture somewhere
like
this one
perhaps I do have a small wrist
let's try this one
whoa who's using bad words in my discord
you might have my twitch okay
I need oh I could get popped up can i
pair my phone with my watch
okay I don't know about monka s I don't
know but the ASMR portion is over we
really really put stuff everywhere oh
here we go
comes with this too you can charge it I
guess
well I like these new cars Wood snaps
they're kind of beautifully designed
it's gotta be someone's job at Apple
what a guy alright open your band box
follow the steps to get started open
your Apple watch app on your Apple phone
I needed an Apple phone why didn't they
tell me
put your Apple watch and hold it up to
the camera
my iPhone is out of date sorry you can't
use the Apple watch until you download
iOS 13 no that's gonna take forever
no that's gonna take forever no my
dreams all my dreams iPhone update
stream it's downloading iOS 13 ooh
dark mode
seems vaguely Pleasant what am I gonna
do with this extra piece it upsets me
and I used to work really hard like I
would save all the all the packaging but
now I've become an adult sorry teacher
took so little time to write this is
junk this is junk what if my wrist grows
and I become fat
well then I'll you know be so upset with
myself that I'll need a pickup and buy
new Apple watch anyway because despite
what Buddhism tells you buying things
really does make you happy that's a lie
but it's a nice lie to believe because
you don't like buying things that's what
there is to do today there you can buy
things and you can post about you things
all right you can sell things but yeah
it's becoming increasingly hard
yeah hacking things is becoming harder -
they're really clamping down they're
clamping down on their control of the
internet they're clamping down on their
control of the world you are a consumer
no that's not true I lied about being
rich that was just that was just to make
fun of that guy who wanted me to do like
bro bro could you hacked my Instagram do
you hack my friend's Instagram for $27
that was mostly just that I'm really not
rich I really count on all of my
subscribers and all of you giving me
money or else I won't be able to afford
Apple watches for the next unboxings
chief
I put the dryer
I think that might be in forestry and
today Oh do universal Geneva thank you
for gifting subs to people we appreciate
you Dork moe thank you for the bits we
appreciate you
yes a smart driver that's right a lot of
smart drives oh no I can't set up the
Apple watch because iOS 13 isn't
installed yet it's still preparing
update now I want delete code it's not
that fun let's say all right let's see
let's see I don't know I've never done
lead code maybe it's super entertaining
is it super entertaining create account
is it gonna ask me dumb questions using
it yo hot jump password Geo ha Oh Geo ha
and then I'm not gonna tell you guys
what comes next cuz it's a secret oh
it's George chunk I spelled it wrong
now I can't do that anymore yeah do that
okay
median of two sorted arrays who said I
can't do the hard ones fine
the median
of the two sorted or oh wow this is all
this is verify my email all right you
know what they just made it too hard for
me you know what's it called quick
select the algorithm unordered list
on median of the two sorted arrays
it's better not interfere with my
oh you can't see anything oh I'm sorry
oh you have to look at my face us funny
no no no we definitely don't do any
portables all right median of two
sorters is it confirmed my email let's
go come on come on
gigabit internet this doesn't work I'm
gonna charge my Apple watch what we
okay the median of the two sorted arrays
I mean see this is the problem all right
well we've all we won't Google we'll
just try to think about damn look at
those uh those type signatures on that
Python um well okay so what's the
algorithm guys like this one is hard I
want to point out and it is way easier
than that one I did on well let's talk
about let's watch it talk more after I
solve it okay
med one equals
yeah you understand it has to be oh so
it's like you got to do something like
okay you got the two medians right and
you gotta like get them to converge or
some shit like right so the algorithms
probably something
this is stupid guys yeah merge the
arrays and resort well so first off you
don't have to merge the Iranian resource
it's very easy to zip the two together
but that of course would be O of M plus
N and then that's too much oh we need
less oh well it's like you guys do like
binary search on the on the things right
like you got like the the the the two
and then you're gonna move one of them
this way and you're gonna move one of
them that way right
so in an extreme case the first list
contains everybody in one case the two
lists are exactly absolutely identical
and then you want to know in an extreme
case the first list is all smaller and
the second list is all larger so you
actually want the the average of the two
now you guys do like binary search on
this
and let's say so the medium can be an
average of two but it can never be an
average of more than two so I think the
answer is gonna be yeah you're gonna
have like low and high right but do I
have to Lowe's and two highs and then I
guess I do check the last one in the
first or i of the yeah I understand
feeling like Google interview this is
hard no one knows this algorithm it's
binary search right you could search for
a single element now search for the
median right yeah well at least this is
clever at least like this isn't going to
involve a lot of code once you figure
out this solution
just merge sort and find the median yeah
that sounds great except for this oh
yeah oh yeah yeah try that try that and
see if that's you know yeah right
it doesn't that sound fun yeah here we
go
done
about syntax
well see look beautiful Wow works so
well guys oh yeah yeah there you go
all right yeah who cares this hello
again it doesn't matter nothing tea on
my shirt okay
but think about a normal medium
lisam it's not right let me handle this
case it's interesting to also note that
there's always gonna be an even number
so that's okay the different sizes so
never mind no pan thank you for
subscribing oh my god no one equals zero
I want one we have our two lessons
this isn't right either because you
could completely exclude one of the
lists
a median of sorted arrays some kind of
binary search
oh yeah my head even close to right
outside it's just a way of thinking it's
not real coding
we might need more tea okay okay this
isn't this isn't this isn't that easy
now whatever guys oh I hate to do it for
all these people although they might not
give me a job at Google whatever I do
you know how to do it binary search to
find the slice with double and you know
map them that sounds about right
[Music]
hi OVS okay
this is hard and uninteresting way I
mean I kind of agree but I mean yeah you
want you want to implement it
[Music]
should we have races um nobody's right I
mean we can exclude anything it's not
easy it is deceptive
it is it is deceptive um we could
exclude anything from either side of the
arrays that doesn't if it doesn't
overlap 320 metric spaces
the problem is I know you can google
this one really easily
unlike the derangements one so you guys
are gonna post the answers in the wait
you taught me I can do it in linear time
all right all right go go go uh if I can
do it in linear time and pass a lot of
time out sounds to it linear time
nomes equals zero times
problems I asked him who who interviews
me I'm very hard
linear time let's kill what
we can write this offline right don't
don't pretend answer
yeah well how am I even writing this
fall
Aion short-circuit evaluation
this isn't right either I think yeah
even this isn't like super trivial -
right right because this is actually
right because if you deal with the other
edge case where this is finished
oh this is like boilerplate
okay is it really gonna start throttling
me hard
I'll put 3.5 it's not right
lists mergers right
off by one frustrating
I just solved it
you bad one time I beat out 31 percent
of people it's pretty good I think
no it's not too much at all look it was
accepted yeah nice short solution oh
that's actually a hard huh I would
actually say that's a hard decode and I
would say that I solved it that's right
should we try to write the right thing
do we even care
so this isn't a real solution guys I
mean I don't know why this was accepted
it shouldn't have been the overall time
complexity should be this and this does
not this this merge here is o of M plus
M actually can you even write the
extremely stupid one
even right the one that's so dumb you
can just do this
look at that
alright alright alright
yeah I'm not let's read the past worship
oh she doesn't look that I don't know I
just wanna look at how much bullshit
wasn't I'm not really reading it
this looks like a lot of edge cases
I employ z3
look at that check mark that's a check
mark that I don't deserve guys and that
tells you that to get ahead in the world
just you know what don't follow the
rules if the rules tell you that you
have to write algorithms that are hard
just right easy algorithms will just
tell people the door please white arm oh
oh yeah
iOS 13 will begin installing six seconds
I say what a day
all right we're gonna do two some but
we're gonna do it in a hard programming
language we did a hard one
we did one that was hard okay what do we
want
they don't have Haskell I'm sorry
they don't have racket I'm sorry PHP
what is it for dollar sign I equals zero
dollar sign I less than link gnomes this
right
for loop PHP you know might computer
lags and streaming to you guys
No Oh for semicolons because PHP
Oh call to undefined a function lack of
length PHP Wayne all right count.php
stupid oh oh I wrote the N squared
solution are they're gonna ban me maybe
they were oh that's right that's right
they say remove those PHP oh yeah you're
right I should've done the triple equals
got to make sure they're the same time
knowing guys they don't have basic this
is all they have
no more song suggestions we're not doing
any songs yeah oh that good at
algorithms not bad at all but the Cold
War's do the Sudoku one this is a cool
one think of what that is you think I'm
not much bullshit I'm gonna have to
write for that
it's like one line in Python is that I
don't think so
nothing it's a do you
if I do what
to check if a
is this hard
oh I like this it has bin support
wait this is hard this is exactly what I
wrote last time
[Music]
lower the queue the harder deaths are
you trolling me I mean this isn't
trivial right like you have to there are
there are so two to be an impossible
decision points they gonna make me log
in no they're not gonna make me log oh I
like this one it doesn't make me log in
and create this stupid account but they
try to sell me you could be an engineer
at cruise automation this is medium
what's the algorithm here yeah is there
a smarter way than just like greedy and
backtracking
how do I get the Strix how I read I
don't know how to maybe it doesn't fly
do I like have part one like this
missing language Python this is broken
ah here we go
okay um in the same order
it's just this isn't hard right it's
just if s sub 0 equals equal part 1 sub
0 ok we have to actually check if both
are true and s sub 0 equals equals part
2 sub 0 the water turn is merge S sub 1
:
right is it not oh this stupid edge case
again we need a termination to return
true yeah yeah
this is lagging and hard
[Music]
we have to memorize this - oh god well
that was a stupid type out
see I didn't even know I had to handle
extra characters
what is an extra what is an extra
character
be very careful can be formed from two
other strings
what
ah so basically I mean this is just
vicious specify this better alright and
now well see not really what you want to
do here is you want to memorize there I
solved your ass ology thing that was
easy was that supposed to be hard
Oh submitting your front line is now I'm
gonna make me sign up for an account
oh you must sign up before you can view
solutions off that's when they get you
type racer just like typing no no no
all right what else we got what else we
got going to folding laundry stream I've
been folding laundry stream permutation
free strings is this one hard the other
one was easy and I didn't like it
3q
permutation free this just seems
annoying
now I went through this one give me
something good three something fun come
on come on comment give me something
good something fun although this is like
see that's a problem you guys nerd
stange like I see this now I'm gonna
have to think about it and then I'm
gonna start coding what's this - brain
fog transpiler
this is too long to read yeah the hotter
prize yeah you're funny what Google
Chrome bounties what's this oh yeah I
don't care
guys neither that's extremely insecure
son all right we're gonna go is my iOS
13 Hall press home to finish setting up
iOS 13 hmm a few more steps and you're
done
okay appearance dark yeah bro I wish I
had an OLED all right now put my Apple
watch on oh you and Internet erasing
well that's funny bro you should feel
good about yourself everyone should feel
good about themselves unless through the
people who work at H&R Block Bobby you
were an evil person and you should be
like shit avail yourself but I don't
know most people I think they're good
how I done but otherwise most people
probably good to this number memory test
novels
I'm pairing my Apple watch but oh my
Apple watch is paired restore from
backup set up his new Apple watch I had
an old Apple watch but we're gonna set
this one up as new because it's new I'm
not trying to hack iOS guys that's
hacking like that it's like over okay do
I get beat no i don't i'm nothing good
I'm not doing typing now right all right
what about curing cancer yeah well we'll
do that next - why is hacking like that
over because it's not like there's -
good as like practice problems with the
the golden era of hacking is behind us
nobody is garbage who said any one of
those garbage nobodies garbage except
for the H&R Block died and who else no
loss in the world is truly evil
tinder sucks guys any of that shit you
know if you want to convince yourself to
never use tinder again go on tinder and
create a girl account in a couple days I
think in like a day you're gonna get
over a thousand swipes you're gonna go
over a thousand people who you could
message with and like hmm then you
create your guide send your accountant
and see them any see any matches you get
well but but that's just what it is
right what tinder functions as and and
one of the problems with online dating
apps in general is the men are on there
to get laid and the women are on there
to boost their self-esteem so these
these two markets are not quite
compatible so what you end up with is is
a ton of a ton of men who you know
validate these women and then the women
get the validation and you know
sometimes people get laid but not after
they put in a lot of effort because
that's not what most women are looking
for so there's a few things that can be
done on both the male side and the
female side of effort of dating it's I
think about this a lot um first off men
outnumber women massively on these apps
they will not tell you this but it's
true uh so what you have to do what do
you have when you don't have a match
marketplace you want to charge men money
what you want to do is say you have a
thousand women on your dating app how
many men you want to have maybe 800 so
do a do a do a second price auction and
auction off those 800 spots to the man
and you can set your bid and then once
you know your bids accepted you're
welcome to the app all right so this
gets around the there's way too many
damn men well then also these men the
men
willing to pay or probably of a slightly
higher caliber so there are there are
women who go on dating out it's not just
for validation but because they are
trying to find a date but what they get
is thousands of guys who are gonna you
know give them validation and post
one-off one-off pickup lines because
that is what most women on tinder are
looking for not for people to talk about
to talk about serious date um so you can
also you can also from the male side you
can limit you can send up to five
messages do you do away with swiping
leave swiping for the Wicker for the
women swiping might make sense but for
the men it absolutely does not the the
right strategy on these apps is just to
swipe right as many times as you
possibly can without triggering there
too many swipe right detectors tinder
reason even get a good data I really
don't understand what they're doing if
someone with a little bit of game
theoretic understanding came to the
dating app world we could live in a
world with our own eyes dating apps
[Music]
exactly right every everybody knows that
no one wants to go to a club that's a
sausage fest so you know you're a guy
you want to get into the club it's 200
bucks you're a girl you bring you know
five beautiful woman's of Instagram and
it's like six girls trying to get into
the club you know what will even comp
you a bottle of Belvedere and give you a
table right because you add value to the
club six Bros and somewhat wrinkled
shirts I mean sorry Bros 200 dollars a
piece not sharing my watch analytics
with Apple
create a four-digit passcode on your
Apple watch I say keep your Apple watch
up today okay Oh Apple pay on my Apple
watch I don't have that credit card
anymore well that's so convenient I can
Apple pay for my Apple watch oh never
mind I have to enter in my credit card
thingies my CVB's we'll deal with that
later
emergency SLS sure clock faces install
available apps all apps Apple watch I
can you know an iPhone 11 it's like the
other ones
adding more cameras does not innovation
I see video that's funny so you study in
California or go to the EU it's a very
it's a very personal decision I don't
know you how could you expect to
personalized advice you know what I'm
thinking about doing I can't click you
know I'm thinking about doing private
sessions you know think that this is
what can girls do also I'm gonna be a
twitchcon next weekend since I am a
twitch streamer um boom my Apple watch
well I don't really wanted to have like
messages and stuff I mostly just wanted
for the fitness stuff oh it like shows
me a tutorial all set I know that's kind
of nice no no I'm saying that we can
have private sessions okay we're talking
about keyboards that's born as Samar she
did some medicine work today
private sessions yeah create money with
private sessions I think maybe what's my
strategy for reaching 1 million on
Instagram I was kidding
I mean it would have been nice if it
happened but not if it's gonna require a
content strategy that's too much now
that's the question
it's one of those things where like
we're not doing exploits no honestly my
aunt is kind of good enough
I did try pretty hard for a blue
checkmark but it's really pissed when
you meet girls these days it's not like
what's your phone number it's like
what's your Instagram yo hey what's your
insta yo what's your snapchat I was kind
of joking readout of though who cares
cannot you stream on pornhub over X
videos
what do I think about cryptos in
generals bro buy some big connector bro
how's my big Connect investment doing
bid connect let's say it's going for
market cap I'm sure I'm making a lot of
money they told me that this asset
couldn't even go down I could only it
could only go up because only it could
only yeah yeah yeah why it's inactive
where'd my big Connect go Oh No maybe
Kryptos all a scam
my big connect I invested my life
savings into that i mortgaged both my
houses and sold my cousin's kidney to
buy Pitt connect oh yeah big boy gets a
real Bitcoin man really Satoshi's vision
oh that's another Bitcoin yet no shit
the stock markets a scam guys I don't
know if you've realized this but money
is a scam like the money all the money
all the money circulating the United
States do you guys know about fiat
currency like if you told this idea to
someone 100 years ago like in the future
money's gonna be backed by nothing the
government's just gonna print it and all
the populace will be so stupid that
they'll just trust it they look at you
like you are a lunatic and asked you
like you know what happened to the first
and second amendment and then like no it
turns out that people actually are this
stupid golden based on nothing yeah
currency give it some like name now that
said that doesn't excuse you if you're
if you're a Ron Paul or who screams that
we have to go back to the the gold
standard because I don't really know
about that we should think about it a
little bit more but mmm fiat money
doesn't have use value and has value
only because a government maintains its
value people is just stupid like these
people in life we wanna like accumulate
money bro
you're earning government points
becoming more real
that's the twitch bit I mean it's just
about as good to be fair the US
government does have the US military and
twitch does not but don't buying video
videos a shit stock they had it they had
a market lead you thought they were
gonna keep going with it and then the
money guys took over you know how can we
exploit all the value yeah by black
notice man you got Black Lotus from
alpha yo this can be worth some shit boy
yo guys we want guys you know you get it
the we work ICO just 47 billion dollars
it trades for 24 X revenue plus one
Apple like they make things man App
Store was it was packed last night you
know I mean if the best thing the world
is doing is like look phones used to
have two cameras now they got three you
know what the worst part is the worst
part of the three cameras is gonna be
all the Android phones next year that F
three cameras that's that's just they
don't even know why not like Qualcomm
it's very important to feature that
Qualcomm support three cameras on their
upcoming CPUs because Apple has three
cameras
Oh Android phones already out for cams
how about why my watch is ready and
press the digital card this isn't very
nice look at this you guys can't see
start the word start is cut off forget
that an apple that's upsetting oh it's a
scroll he never mind
oh it vibrated whoo that was pleasant
yeah I got a watch case
heard of GRP say we're doing a Q&A right
now what do you all want to know I've
used this before what did I use this for
yeah my pocket I've been arrested yeah
terrible crimes just Google George Hotz
arrested you could you know what I was
arrested for what's my words per minute
I hunt impact when I type I have a
minute book and a razor snorting no
thank you for subscribing
she's a mother scream Libre I wish I was
a respite at the Martin shkreli Pro des
been arrested yeah I want a possession
marijuana Megan the kids crazy
minnerath thank you for subscribing now
is the perfect time if you've been
watching my channel and enjoying my
content now is the perfect time for you
to smash that subscribe button and pay
me money alright cuz I love money and I
can buy great things like Apple watches
I don't really like this it like it's
black and then it turns white when I
look at it and then like if I turn it
back real fast it's still white I don't
know free Mars shkreli that's so I feel
you know
advice for a college student you're like
the guy who wanted advice about where he
shouldn't move I don't know man I just
know don't move to San Francisco a
pleasant shuttle SJ kzr xxx thank you
for subscribing searching for life thank
you for subscribing I love seeing you
guys all subscribe that's why we do this
here today on this channel oh you're
doing debates around politics and social
issues last something I really want to
get my voice heard on you know yeah yeah
I really want to want to throw my hat
into that arena trans Jack 7 low Quarian
thank you for subscribing thank you I'm
really really glad that you all
subscribe to my channel who you voting
for next year boom let me tell you about
the votes man now but if there's one
thing I have to say about politics is
it's really all not that important
because it doesn't matter you're gonna
vote for the you're gonna vote for the
you know it's the best thing we could do
to the government is give it less money
and pay less attention to it
politics is basically do you watch too
much reality TV right like like whenever
people ask you oh who you vote before in
2020 right like I'm gonna go up to ask
them and be like what's that new show
that was just on oh it's like The
Bachelor where they brought back all the
old bachelors it's like The Bachelor you
know reunion edition or whatever it was
enough people really hyped about that
and then like you get into real deep
conversations about like who their
favorite character is I'm like The
Bachelor forever or something right it's
the same shit except everybody in
society seems to understand that the
bachelor forever is just a TV show but
they don't seem to understand that about
politics where it's also just the TV
show
look will you ever met Joe Biden I never
met the guy man you know he's some TV
character
I am Vice President Joe Biden and I want
you to go into a booth with a curtain on
a day in November next year and you're
gonna see a bunch of names there and I
want you to make sure you press the
button next to my name because Joe Biden
is the best candidate in this reality
show politics could have maybe not get
arrested
oh my god the two days of inconvenience
my arrest caused me caught off it could
have let's see I'm I've gotta spent my
whole life no actually I really the
people who were supporting from
marijuana legalization I like you guys
I like you guys because you know what
what I think about change this actually
happened in my lifetime
that's changed it's actually happened in
my lifetime and it's positive change I
mean I don't know like a lot of change
is just like you know who's who they
grabbing the money from who they given
the money to Sasol scam but when they're
just making weed legal everyone there so
that's that's that's a cause that's a
cause that I can utter - as we get
behind marijuana legalization
good ya know if ever if ever that's a
cause if you ever are gonna make the
terrible mistake of going to vote for
something make sure it's only for mera
fixation how do you keep yourself
positive when you say everything around
you is joke what do you mean jokes are
funny man could I not be positive it's
the people who think everything around
them is serious like my global warming
is gonna come take away my bread I don't
think so man I don't think that's you
know what are they gonna take you want
weed legal because it hinders booking by
planting trees yeah it sounds good we
love trees man what are you gonna offer
on your private session oh yeah do I
have to offer something should we do
global warming's not iced it's not fake
it's real is famous real it's real
that's right I do love nature I do
if you're ever not feeling positive take
an ice cube and eat it mmm crunchy zero
calorie snack I really wanna go
what's ten curves
wash my hands Bros don't worry okay do
we have anything else to do today Oh
guys what sector of programming we'll be
safe from the recession in 2021 I mean
let me tell you something no sector of
anything is going to be safe from the
computers everything you think you're
good at a computer is about to be better
at I've wrote the hash code already
already did that sorry the stream is
kind of misleading I did that in the
first like hour
all right you know what I I know what we
can tell
I'll show you what I was I was reading I
was reading something we can read it
together I guess it's called the ghost
in the quantum Turing machine by Scott
accent maybe you guys are like
when does the supplier to use
we're gonna read this out we're gonna
read this scientific paper Raven that
wreck thank you for subscribing
wait oh you can't see it David beer
champ thank you for subscribing so you
see it has this concept called night me
and freedom I'm gonna really know what
that is so let's google it you can take
OBS any smaller windows is not usable
the hitbox is so small yeah okay
so for those that don't know Scott
Aaronson say he studies quantum physics
at UT Austin but really he talks a lot
about computational complexity Universal
genève thank you for gifting subs to
people
and Stephanie well what economists call
nightie and unpredictability meaning
unpredictability that we lack a reliable
way even to quantify using probability
distributions see that's that's like hmm
what this means right I mean usually we
think of uncertainty right if you have
uncertain to get a coin flip
then that's effectively like
quantifiable risk or statistical noise
right here courtesy even exists
I mean so you have this idea of as a
system that to predict it would require
as much computation power as to run it
and I guess that's effectively
unpredictable especially if the system
itself is the universe
Oh again you all got to talk about stuff
that if you want my advice on something
private sessions are let's say $100 for
20 minutes does that sound good
$100 for 20 minutes if anyone would like
a private session we can chat on skype
just send me an email
no there 100 there 100 that's that's the
price if you want private sessions just
20 minutes $100 just send me an email
geo hot at gmail.com and will uh what
we'll discuss it's 100 dollars 20
minutes that sounds pretty good we'll
start there and I will try my best to
give you advice on whatever it is you
want $100 for 20 minutes the only caveat
is that we're here you were there to
talk about you would not here to talk
about me like any cam girl you can't
start asking me questions about like
where I live and stuff because that's
creepy and we don't want to be creepy
not do we thousand dollars for a minute
no it's no negotiation no it's it's a
hundred for 20 though if I bore you you
are welcome to hang up at any point
yeah I saw you talks about this right so
I'll be less interested in particular
methods of prediction than the best
predictions that can ever be made
consistent with both laws of physics and
the need not to destroy a system being
studied
see I like this guy because instead of
using like philosophy terms like that
are stupid about morality he uses
philosophy terms that are we're no
longer talking about ethics metaphysics
or the use of language which is a lot of
what philosophy is all right a lot of
philosophy is just Circle Jerks in these
areas where I don't think anything can
be figured out only about whether such
in such a system is or isn't physically
predictable in the relevant way - this
is exciting because we can use science
to talk about this I reject any
connection to freedom and merely
probabilistic unpredictability I'm just
more interested in learning about this
in general
it's called sumantra PDF oh no I just
cool that ethics is not ethics is stupid
ethics is the biggest circle-jerk and
and then it and everybody who invokes
ethics is just trying to get you to like
do something it's unethical to eat me
why don't you eat beyond me instead of
catching for the beyond meat company
right
that's right whatever they want to do
they justify using ethics oh it's
immoral tough it's immoral to do that
you know more like the church used to
like oh it's immoral to have sex with
that girl outside of marriage right
today we're all like men but you know
always ask the question what they're
trying to morally guilt-trip you with
today and because in the future people
couldn't feel like we met so you know
you want to think in the future always
realize that ethics and morals are
mostly a scam we need some people who
try to talk about it genuinely but you
know Oh what did I read recently social
media hasn't made us all more
narcissistic it's just given the most
narcissistic people in our society a
platform and I'm very grateful thank you
much social media
I don't know I tried to read critique of
pure reason
maybe somebody smarter than me can
explain it to me and like say that he
was really saying deep stuff but I
thought it was mostly just confusing
let's look up critique of pure reason I
can't even remember what it was about
don't dump mercury in the food you're
gonna get sued bro and you're gonna be
the mercury food guy one's gonna hate
you man
just cuz you don't have to believe in
ethics and morals doesn't mean you want
to go we're going to piss a lot of
people off it's not very smart and what
do I think of Jordan Peterson I don't
know that much about him
I read the Kindle preview of 12 rules
for life
I don't know anyone who's Charlie tell
me what I should do
I'm skeptical of looking official thank
you very much I'm on nihilistic Milan
don't be nihilistic bro now ISM it's not
a real thing let's let's let's
deconstruct nihilism let's let's put on
our best postmodern on our best
postmodernist the rejection of all
religious and moral principles no no no
no no guys guys guys guys I think you
might be misunderstanding me when I talk
about ethics and morals ethics and
morals of course they exist but they're
deeply personal what a little skeptical
of us is when other people are telling
you about ethics and morals what other
people are trying to say to you it's
immoral for you to spit off of that
balcony all right look you might not
wanna to but you don't have to invoke
morality in this but internally without
morality and religion you are a
meaningless void adrift in a great sea
of nothingness you need to believe in
yourself the doctrine of an extreme
Russian Revolutionary Party who's the
opposite of anarchist let's see what
Google says
when running all this guy DJ he had
stuff to say he said some interesting
stuff the spa's Appaloosa that's
readable Beyond Good and Evil
this stuff is readable unreadable news
guys
we're out of tea
it's convoluted sure Infinite Jest was
convoluted you know
I think he's suggesting that I'm on
drugs as a noob and topic
I wouldn't mind look if I was
legitimately on Jar Jar I will tell you
I will confess that yesterday I took an
edible and I went for a walk you want to
see how long my walk was I went for a
nice long walk it's my friend and if I
was dreaming yes yeah I've been like
guys I took edible this morning oh well
the new health app - now track my cycle
Wow
my birthday is off by one of my weights
not right health profile
date of birth
well this is wow they really changed
everything here I'm one of their streams
or just people using phones Apple watch
edible watch stats me I don't understand
just like totally got crazy so wall
health data lights client what this is
unusable can I get the old health app
back
so all data no this isn't what I want I
want to know how far I walked
so far you're taking less steps than you
usually do
yes you look that's yesterday but it's
so bad
OMG programming is so immoral because
people lose jobs and we are all human
saves a human jobs save the clock tower
save the clock tower haircut jimmy
goodbye alright guys thank you for
watching today's stream I appreciate you
having having you all with me we did
some programming we did some other
programming we did some ranting and now
I'm gonna go read by myself my beautiful
apartment in the cloud where everything
is peaceful and everyone is happy and we
did some ASMR and we unboxed an Apple
watch which I'm gonna wear around a lot
if I'm not wearing my Apple watch pros
you'd be like George why aren't you
wearing your Apple watch
Oh
so it's gonna be fun we're gonna go for
about an hour
i didn't do well the last two nights of
that event
um
so we're just gonna uh we're gonna do
some post-mortem
they were good problems too i really
like them
um i should have
done better
let me get chad up here
we got any people in here
this one's all for the subscribers and
doing this content off the subscribers
so
if you like this content you know what
to do
is the stream working let me shout out
if you're here
all right so let's look at the calendar
here
um everyone's done now so we can share
this
let's do let's do 18 first
so 18
is a pretty straightforward problem
uh basically evaluate these expressions
with the order of operations
uh of plus and minus being the same
and where's all the people in my chat do
we have people in my stream
if there's no people here i can't do
this so actually
good good evening good evening all right
so you just want to evaluate expressions
like this
with plus and minus uh
plus and times having the same order of
operations now
to be fair this is not the solution
that i came up with during advent of
code had i come up with this solution
i would have been a huge winner but i
didn't come up with a solution
uh i sat i thought about it for 20
minutes afterward
and came up with the solution so um
i'll show you guys my boilerplate code
uh let's get it from this one the
boilerplate code is basically just this
i've started also saying from
collections import default decked
all right so just a few things to use if
i want to memoize
shit uh and then there's example and
there's input so this one we don't
really care about the example we're just
looking at input so the goal is to
evaluate all of these things
with uh times and plus having the same
operator precedence
so you guys can look it up it's day 18
operation order
plenty of context okay so
the best solution i came up with i first
i
during the competition i didn't get any
points for this i just wrote the whole
thing by hand i wrote the stupid parser
and it just made me embarrassed how bad
i was at parsers
and it's even more embarrassing that
tonight again was a parser problem
and i didn't get it i'm not fast with
parsers
um so let's
come up with a good fun solution to this
i know if you guys have been following
along but alright so the basic ideas for
x and dat
uh we're gonna want to accumulate
uh we're gonna want to evaluate each one
of these and add the thing to the thing
so we'll just say
plus equals so the first thing i did was
just eval x
um this is just going to evaluate them
using the normal
orders of operation and i was like oh
we'll do this really fast oh there we go
i got the answer
so i copy and pasted that in but this
answer obviously doesn't match
this so it was wrong but so you want
times
and plus to have the same order of
operations
uh how can you fix that well i can turn
all the times's
into minuses
but the problems with doing that is now
there are times now they're minuses and
not times
so we're gonna have to write my own
function eval
do my eval x and then i'm gonna wrap
each number in a
class uh so we're gonna say for
uh c in x
uh if c equal in
zero two five seven eight nine
uh c's in this string
we're going to say something like s plus
equals
num uh
plus let's say uh
yeah that let's have a piece of state
called
in num say in num equals
uh true and
in num equals false
okay so we're just going to add a number
to the beginning of that
and now we're going to say up in x
i'm going to say c
just add it to the string there so we
can print this string to see if we're
doing the right thing
uh unsupported top and into none type
but that's okay so we've got a num there
so we need to exit the context too if
in num equals equals true and
[Music]
see not in
so we're going to add the backward paren
and false there
okay good so we've wrapped each number
with
a number of parentheses
and then we also should say if in
s plus equals close parenthesis
all right so those are each wrapped with
a number class
um now we're going to return eval
of that string well num is not defined
so we're just going to have to define a
quick class
called num now remember what i did was i
replaced all the
times is with minuses minus and plus at
the same operator presence because
nobody changed the operator precedence
in python
so same operator precedence
now works but we just need to redefine
uh let's define an add uh let's make a
constructor
define uh knit self i
i add self.x return
uh we actually want to wrap that in num
self.i
plus x dot i and the other thing we want
is
sub which psych is actually times psych
it's times all right and then here we're
gonna because uh
you know it's a number object that we're
gonna return we're just gonna return to
i
um i'm gonna get rid of that exit and
sure enough this number is equivalent
to this number so that is part one of
last night's adjective code
now part two is
you want to reverse the precedence
levels of addition and multiplication
fortunately we've written it in a way
that this is super easy
um so
where you already have the nice num
wrapper uh we're just going to want to
replace
let's say replace times is with yeah
minuses are fine
uh what did i do
replace we're going to replace the
pluses with times is
and then we're going to replace the
minuses
back with pluses right so this would be
correct
except the operator order of operations
is now correct
but we just want to define added mall
and add is actually times and mole is
actually plus
uh evaluate and sure enough we get the
number that matches the puzzle answer if
you guys can't see the puzzle answer
puzzle answers right there
and that matches my number there so boom
what a great solution for last night's
advent of code
if only i'd been smart enough to come up
with it
while i was actually playing the game
and not
sitting there struggling 20 minutes i
was in the middle of a heated poker game
last night
we had to take a break the whole table
paused i feel bad about that you know i
was
my nerves already wrecked from poker
uh so yeah or just use parentheses for
operator precedence
yeah i could have injected parentheses
but the problem
hmm
if i just injected parentheses nah but
see that doesn't work because
you'd have to parse so much to figure it
out
right
uh to figure out where you actually want
to have those parentheses okay so then
of course you know what i really should
have done today instead of done work for
comma is i should have practiced my
parsers
because we get hit again with another
parser problem and i did
so terribly at this it was embarrassing
so here's the example code
we'll call it x3
basically what the problem is is it's
just this is a grammar
for a language and now i think we can do
a better job at this
uh so let's write go to
let's grab go to from last night
let's copy and paste all this stuff
we're gonna work on
x3 okay
so uh the interesting thing to split is
here and then we have rules and we have
tests for x and tests
dot split um
i just want to say is good x we want to
accumulate
that uh all right we're expecting to get
the answer
2. all right now we just got to write
this is a good function
okay so is good is actually just a
question
another way to say this is you know we
can say consume
x with a rule number the rule number is
zero
but you know yeah
consume x real number zero
uh and then we're gonna have consume
return the number of bytes that it
returns
so we'll just say equals equals length
of x okay
cool um
expecting an indented block because i
didn't actually write consume so now we
want to consume
according to that rule number so let's
actually parse out these rules
um we'll turn into a dictionary
uh for r in rules dictionary
r dot split i'm going to split it
here um we have like let's say just
val uh and here we'll say
uh rule number rn
uh dr sub into rn equals val
and actually we want to split well now
we can deal with that later okay
so um we have our little rules built up
here
you can check them out uh if i didn't
write it right
close thingy okay not enough values to
unpack a oh yeah because we have to
split that with the slash n you know i
should really write some helper
functions
to do that for me i'm the worst
competitive advent of code player um
i won money in poker i got second place
um yeah so
these are the rules of our grammar we're
starting with rule zero
and we want to see if that stuff
actually consumes
uh string so
let's do this in the smartest way we
possibly can
let's start with uh rule
equals rn uh dr sub rn
if rule sub zero equals
quote then it's a terminal symbol
i think that's what these things are
called and latin parsers and grammars
uh you know last night was a parser and
tonight was a grammar yeah that's good
cheers to the evidence cheers cheers to
advent code for doing that
it's embarrassing that i can't write
this stuff faster um so we'll say
here rule equals rule dot strip num
strip we'll strip away
those quotes if x dot starts with
rule return
length rule
otherwise return -1
okay cool now the other rule means that
we actually have a bunch of symbols to
iterate through so we might have an or
so let's say for opt in r uh in
rule dot split um
with the or because you know it's the
grammar so like rule one
can consume either a two and three or
three and two
so first we're going to have to say uh
you know pick an option right now there
may only be one option and that's fine
um then we want to say
for rule number
in opt dot split
uh and we have to say args okay
that's the actual integer and now we
want to say
uh consume x rn but not exactly x
because we want to keep around how much
we've actually consumed
um here let's say accumulate
is that accumulate well let's do
red equals that accumulate plus equals
rat
if the return is -1
then we can break
then we can actually say ack equals -1
and break
otherwise it was a good consumption
uh if i think then we can just return
ack here
right
so we've split the rule uh oh if
uh back not equal to minus one return
act because we actually want to try both
options
right and then if it fails return minus
one
cool all right
so that didn't work um
let's do a little bit of debug printing
let's print x and the rule number we're
trying to get to consume it
so oh yes of course
we have to actually consume
okay we got two okay so let's download
our input i wrote a little convenience
script to do that fetch 19.
cool input
go 184 and my puzzle answer was 184.
damn you know if only i could think this
clearly
during advent of code i flail around
like an idiot
um okay so
this one changes these rules so i spent
a bit of time actually looking at the
input these are the rules you'll find
that these things all either consume
two symbols or nothing but now
these one adds rules that can consume
one
or two symbols right so this one
actually changes the rules
um so we can just say you know
if rn equals eight uh
val equals
this and if our oh my god that wow oh
wow because that has an
8 in it as well oh that's crazy that's a
super complex symbol okay
so they even give you a convenient
example here which
with the changes and without the changes
parses differently
so let's call it x4 dot txt
and these are the two new rules that
you're adding to the grammar
okay so this is a test set
i like when they give you the test set
it's always good to know so you don't
accidentally
put in the wrong thing so if you do it
without the rule changes you get three
and if you do it with the rule changes
you get twelve
so let's apply those two rule changes
that they asked for in part two
and notice how we still get three and
that is because we wrote the code badly
now
if you'll notice this can be this can
consume
uh these can both
especially this one these can both
consume
the same input so instead of returning a
single value
we're going to have to keep a list
around
so here let's return
length of the rule in the list now
for the list we're going to do it here
consume
uh no we want to say if blend
x in consume x comma zero that seems
right
uh
acc we're going to start it off here
with zero
um we're gonna okay for each option
we're gonna iterate over the possible
accumulators for
ac in acc
um ret consume ac
but now remember consume now returns a
list get your types right boys
get your types right uh so we'll say 4c
and rat um acc
well actually uh
let's just call it mac uh
we're gonna see knack dot append
uh c plus
ac we can get rid of that stuff
right uh so then we say knack
uh ack equals knack right so these are
all the possible options we've tried
consuming
for each one yep
and then here
well now we actually want to return we
want to put this outside
all the possible accumulators
is that true
let's think about what we want to do
right so we're starting with nothing
consumed
either that side's going to consume or
the other side is going to consume and
they might consume
different things
seems right
now we have to give him both a chance
with zero though
let's do b-ret equals that
and here we say b-rep plus equals acc
return b rep you know work
still got three eh
um oh well this code doesn't even work
because we didn't say rn equals into rn
get your parser right okay we got 12 now
let's try it on the input and see if
that works
oh it takes a long time so slow 389 and
sure enough the answer is 389
wow damn that was beautiful and i wish i
could think that clearly
during the competition thank you twitch
tonight
for joining me for this advent of code
lovely
we'll say lovely19 that was a lovely 19.
i wonder what my time was to actually
code that it was probably pretty good
thank you all for watching please
subscribe i only did this for the
subscribers
uh you know i got i got some stuff to do
tonight
uh let's not do any more of this so i'm
sorry to tell you
i gotta leave you but
thank you for watching please subscribe
i don't know i just i like to look at my
twitch dashboard and i'm like you
subscribed and i'm happy all right
just tonight's having a code play having
a code tomorrow
beat me i'm i'm 24th on the leaderboard
uh competitive this year competitive
stuff and i got a few points for that
one but if only i could think
the way i think on twitch with you guys
during adventure code so
clearly so calmly and we gotta meditate
more thank you all for watching
have a good night enjoy your lives
substream
all right hang on where we got the
mobile streaming setup today so you know
it's not as good
like let me get my I had to find the
cable to plug my phone in so I can have
chat up my phone oh I came with my new
airpods I got new airpods and they're
they're fire bro
um
I don't know why it's red on here Red's
gotta mean something
fresh new lightning cable love the smell
of crispy Cable in the morning
let's go uh yeah we trust this computer
now we don't trust shit all right I'm
good
um
my channel
hello
hi everyone hey uh morning okay
good we got Chad over here we got we got
the mobile streaming set up today
because we're in shitty San Francisco
welcome to shitty San Francisco where
everything's shitty and I'm scared to go
outside uh no I'm really I'm in San
Diego I miss Alex and I do have a nice
cup of tea though so that's that's like
a nice guy we're gonna we're gonna we're
gonna sip t
um and we're gonna do Advent of code but
I'm gonna have any code this year I've
been very busy you know you got to be a
hardcore engineer if you want to make it
at elon's Twitter
uh so you know we've been a hardcore
uh
and I'm still terrible at Scala so you
know you guys can all make fun of me
hang on we got we gotta we gotta we
gotta turn on we gotta disable auto lock
for our luck
never okay
um what are my plans for today uh well
my friend just got sideswiped so you
know uh he's gonna deal with that it's
annoying uh
no plans man no plans I got a dinner
tomorrow
group house you know
of course
you know it's just like these people are
running it all back these people are
running back the same shitty culture
that got Tech to where it is today man
moved to San Diego chill make our
Technologies are
um
is Scala only a framework for
microservices no Scala is a full
programming language based on the jvm
okay so let's Scala
all right so this is my input uh
I copied the cookie into Chrome
okay we have to figure out the elf
carrying the most calories
so let's go what should I call it what
should I call it Go dot Scala okay Scala
read file
all right all right fine
uh oh I can't log in
oh oh that's annoying hang on I gotta
hide the let me hide
this
no this while I log in to open Ai and we
can use chat EBT to help us out
all right that will that make everyone
happy if we use chat GPT
was it chat.openai.com
log in with your openai account
okay I
this is a research preview
okay I can bring that back all right
we're good we go we go very good all
right let's make this a little smaller
all right all right
um
how do I read a file in Scala
this looks pretty nice
I do not care at all about the ball game
Scala go.com
print Ln lines should I do this in a
wrap up
illegal start of top level definition
longer explanation available when
compiling with explained do I need a
main method
that was useless
um
Scala illegal start of top
inside another definition
what
what am I doing wrong guys
the main method is an entry point into
scholar
wait I can just make anything main if I
do at Main
does that work
all right we read some we read some
stuff in Scala
um
they end up with the following list so
there's going to be some empty ones that
seems good
yeah I'm sure we could copy it from chat
gbt but uh also that's where I am so we
have to move me hang on
I'm going to be using over there so
we'll put me down here
now we'll put me up here I'm small
no but that's a waste of okay right
there maybe his best okay
okay
um
get lines to list all right we have to
we have to find the empty lines
wow this is so bad I'm so bad at Scala
boys string to in Scala
uh we could do map
X
all right VAR nums no but this doesn't
work because we have to separate it
based on the elves
oh this is hard
this is hard uh
there's a partition function in Scala
no it only returns two that's not gonna
work
I'm going to split sequences into
subsets ah Group by okay let's try that
split at
no I'm not in the Twitter bedrooms I
have an apartment I'm not a Savage all
right no that's not what I want I don't
want to split at no never mind
uh Group by
I really just want the type
no that's not what I want either
split at
groups two
oh you see what I'm trying to do why is
it so hard
okay we could recursively partition
a partition that returns a list of lists
okay let's try lines dot partition
we need a function that returns a
Boolean
actually I think I can just do this
uh and we'll say about
F God
so wait oh is it so that actually does
not work at all I think it's dot I think
it's that to access a single one
okay never mind partition did not do
what I wanted
um
all right all right you get subscriber
only chat that's right Lana Lux thank
you for the raid good to see you well
we'll let non-subscribers talk in honor
of
of of of Lana lux's raid
um
guys I'm really bad at Scala like
Twitter should fire me you know
who thinks Twitter should fire me
okay Group by
split at partition
[Music]
no this isn't what I want okay
maybe we don't want to get lines maybe
we first want to how do I split Scala
split
this split available on Scala and Java
string objects
so where's my chat GPT that told me how
to read a file
so maybe instead of make lines we'll do
make string
and then we'll do
dot split that
what is that going to return that's not
going to return a list of oh it is going
to return a list of strings okay we'll
call it animals
found array string required list what's
the difference Scala that's as Chachi if
you take Scott what's
that difference
between Scala array and Scholar list I
think one's mutable and one's not
eraser mutable okay good
okay great we get an L Java Lang string
great uh you gotta love oh man don't you
love Java no okay uh I think it's l Sub
Zero will get me the first elf
okay cool
okay and now we can do elves.map
we're going to map by the way if you're
calling something in Scala that only has
one argument you don't need a
parentheses thing
so let's do split n dot map
uh two inch
I think that's right
Okay now what's the type going to be uh
the type is going to be
array array it
elves two
I found two int
okay Scala to int
how do I convert a string to an integer
oh it has to be an argument so I think I
can say
da
okay good
uh now of course I don't want to raise I
want lists
um can I say that that'll give me the
first one
okay good now we're in our place ready
to solve this
um
they like to know how many calories is
being carried by the elf carrying the
most calories bro if I had to actually
do this I'd be fucked right now do
people solve this in like 30 seconds
we'll call this elves stir and we'll
call this elves because we it's
important to use good names we'll call
this elves strength because that's a
very Java looking thing right
I don't know I'm not a Java programmer
okay
um actually we want some so there's got
to be a way to just sum them
okay we've read in the stuff
now we can say elves dot map
um array sum Scala
oh it's a list Method All right well
let's hope it's uh let's map
dot sum
elf total Gray
all right let's just go for this is
there a Max method
there's some chance that just works
great
just the right answer
let's try it
uh most calories how much calories
that's the right answer I'm one gold
star okay
um might have run out of snacks by the
top three
okay the top three elves the sum of the
calories of the top three okay so we
can't use max anymore
we need to sort
Scala sort
uh
sorted now we need a slice
um Scala list slice
great from index until index so let's
try slice zero two I don't know if
that's inclusive because we actually
need three is that going to give me
three great it's gonna be bullshit all
right cool let's check the length of
that I'm like that's the right method I
think it's length of course it's drama
you have to spell everything out really
long
two okay so that's not right we actually
want that
and then we can do dot sum and that's
the solution
oh
oh because we have to sort and reverse
uh
Scala sort reverse yeah I should have
checked because that just didn't make
any sense okay
uh dot reverse
so that number looks bigger now it's
going to be like you have to wait be
patient
I have 35 seconds left to wait okay
let's let's find let's want to actually
check this uh can I do is there like a
two list
okay good
that seems reasonable
I'm not a league code bro I'm calling in
Scala boys it's difficult okay you know
but
there's six seconds left to wait all
right remind me not to get the wrong
answer anymore
I also ordered some meatballs so maybe
they'll be here that'd be nice where's
my fucking meatballs bro okay return to
my advent calendar
wait I have I solved this doesn't it
where's my stars
where are my gold stars
oh I'm not logged in for some reason
I don't know whatever
okay uh the owls begin to set up camp on
the beach
a giant rock paper scissors tournament
is already in progress
fetch two
then copy one go dot Scala
first round
I don't understand
okay
let's take a look at the data so I kind
of understand that
okay so it's just basically which ones I
I couldn't understand
um so let's first parse this as we can
use the other thing we can read the
lines let's read the lines
let's read the lines boys what are the
lines
let's copy this at a chat GPT
oh to list what if I don't do two lists
it's an array
import.txt okay we have lines
um
the score for a single round is the
score for the shape you selected okay
X for rock one for paper
so let's just make a function called
score that takes in a string
and returns an end so that's not how I
write that it's just this right
so we want to do x dot split
I really want to split that's pretty
expensive
can I just get like
well eventually I want to say lines.map
score
um
that's um but actually let's not do some
first
let's just print out on that
and let's also make small input
which is just that we can check on the
small input
uh Scala go dot Scala now we wait for
the jvm to load okay uh what'd I do
wrong
I was mad because it doesn't return it
in okay return zero
just Returns the oh great oh you gotta
set because
sequels
toxic chat today
bro don't be toxic bro
value get is not a member of string okay
how do I get the character app
okay that might be right
can you tell me what type this is
I should really just be doing this in a
rebel okay good
um
let's make a map
I don't know
there's nine combinations here should we
just write them all out you have to pay
for free speech here that's right
Freedom isn't free boys Freedom isn't
free
oh man you know how fast I'd be at this
in Python
oh so fast
shape you selected
so there is this component of it well
here
so we should be able to make a map
um
map
X okay
so there's two components to the score
there's this component which says you
get one two
and three
uh do I have to do dot get on the map
okay so this is one component of the
score
let's just return that component of the
score and see if it's right
um let's also print out an X
uh found options
why is that option
um
I don't want it to be an option I wanted
to assert I think I can just dot get in
order to do that
non.get no that's not right
oh because it's probably not the the
skull I have like a character type which
is like this
the thing is I don't know what type that
is
I mean I've seen that in other languages
maybe that's right okay cool okay great
so that's right
um now we need
the other one
we need to figure out who the winner is
okay
um
this is kind of ugly but I could just do
this
plus equals valid and Scala
okay uh a draw is if x zero equals
equals x two
um we need a Scala in line if if
then
I'll do this
we need parentheses no matter what
three else zero
expression expected but if found that is
a fucking expression fuck you scar
great
I don't have any draws there
uh we should have a draw CC should be a
draw I don't understand that should add
three
oh no it doesn't actually equal we have
to like map it back oh
all right
um
fix
fix dot dot dot get
an extra comma there
that's right now we also have to check
for winning
um so what's winning
draw
base win okay
um if
X Sub 0 equals
no there's I really should just map
these to integers and then check the
integers right
um
Rock
if my opponent played Rock
and is it and or is it like that and I
played paper
uh
actually you know what I should probably
do I should probably just invert this
and write
or
plus equals three sorry like I'm so bad
in this language that
score plus equals three okay so that's
if the opponent played Rock and I played
paper the opponent played paper and I
paid played scissors
and if I played
uh scissors and the opponent played
with the opponent plate scissors and I
played Rock
the total score would be 15.
the fact that Twitter is predominantly
written skull is an Evidence of why this
whole quiet quitting entitled culture in
Silicon Valley is a problem
oh it's really not
I think so I I think that the choice of
skull and Twitter was was less dumb than
you think I did like I found like the
guy who like really wrote all of it the
code the a lot of the Scala is very nice
there's not that much of a problem with
it and also remember it wasn't chosen
today
it's better than Java
what would you use instead of scholar
okay and then we can just do some here
and then let's run this
is my answer right let's find out
yay I got a gold star
anyway the second column y means you
need to the second column says how the
round needs to end
oh I see okay that's difficult all right
get ready for difficult work
ill oh leeches is written in Scala
interesting you would use Java or python
Java is really disgusting yeah I don't
think kotlin existed right like let's
figure out when kotlin came around
it looks very much wait this just looks
like Scala
hmm
yeah and it first showed up too late
okay well you can't use Python do you
understand how slow python is
like python is not a serious choice for
any sort of uh wait I gotta check where
my food is hang on
where's my food
oh
wait what
did it arrive is it downstairs I hate
when they put it downstairs
where's my food
because meatballs aren't at my door I'm
gonna be mad
foreign
oh guys I gotta go downstairs and get my
food
I don't even understand like it like
disappeared
enjoy your order call Renee if you can't
find your order
was my fucking order
spaghetti with meatballs cost thirty
four dollars this is insane
oh
wait how did this cost thirty four
dollars and I can't view the receipt
yeah just so something's got to be done
I hate this city
all right I gotta go find my I'll be
back I go find my I gotta go find my
food
foreign
foreign
no food
bro
oh
let me make sure I didn't do anything
stupid
did I order to this why can't I see the
receipt
okay I ordered to the right address
get help
can't help
this is crazy it sounds
no I'm just more help
select help with my past order
conversation you delivered my order
today my order never arrived
we're sorry to hear you never received
your order
foreign
the
thing
see I can't call back because I have my
phone silenced all up
all right silence on on callers off
okay now I go here and okay cancel
uh no receipt available get help connect
me as a person
all right now I get a call from spam
Uber will not ask for any confidential
or private information and you should be
careful when sharing information with a
third party
press one to connect the call to the
other person this is a call from Uber
please leave your message for four one
five bro we got rugged bro we got we got
what we got we got we got rugged
no this is insane
help with a past order my order never
arrived
next
oh here I can get my refund I don't want
fucking Uber cash I want my original
payment method
honestly did the driver just eat my food
may take three to ten business days how
satisfied would you with the support I
received sad face
oh now it's going to tell me why thanks
PM oh what's the primary reason for your
fuck PMS man fuck PMS
I'm hungry and there's no food
ah
best we can do is
[Music]
all right is there any food in this
apartment I found tea
coffee sponge Tide Pods
oh maybe there's some food in here all
right smarter snacking oh here we go all
right all right good we got a box of
snacks
all right
so well you can't you can't you can't
call it Scala on an empty stomach oh
sweet potato chips white cheddar popcorn
or Lacroix all right we'll eat the
potato chips is that a beer
Still Water not
all right
so really where is my pasta it was 34
anyway let's get our money back all
right 220 calories of chips sweet potato
chips
foreign
Twitter was originally in Ruby
foreign
let's just write the transformer for
this
um
all right you know what let's just write
this
map okay
ax means we need to lose
so this should be
we should have done this with numbers
that was a smart way to do this that's
why I would have done it in Python but
I heard a noise outside there's some
chance that's my meatballs
keep awesome
no meatballs
I don't want to like instacart or
something get some real food up in here
we also have some white cheddar popcorn
to eat next
yeah you get the food and your money
back that's winning
if I need to lose
given Rock I need to choose scissors
um
I'm going to lose here I'm going to
choose that
and that
and then if I need to draw
and if I need a win
this is just going to be um
b c a
hey
on the map we want to get x sub 2 we
want to call get again and then we want
to say Val C2 that
12.
no such element
no I don't know we just get for x
y c a y there
um what did that work
c-a-y
does the string have like crap after it
that I can't see
there's a y I don't understand
that
oh
this isn't right
this is actually z x y x y z
12. wow
great
let's return to my Advent calendar wait
did it just say I could share on Macedon
that's expensive
what's LSP
as a Twitter employee I'm offended by
your suggestion that I share on Mastodon
okay
rucksack reorganization
[Applause]
um we definitely want the other type
where we read the lines
okay
see really I should write scripts which
automatically like extract that
[Applause]
so we need to split them
find the combination
um
did I use substring in the other one
I feel like I use something else
slice
um
okay that's correct
uh now we need to find the one that's
the similar in both
or the index of Scala
we're getting nine minus one okay so S2
dot index of is this algorithm wrong
I think this algorithm is unsquared
whatever I have a fast computer skull is
very fast runs on the jvm
um not equal to minus one
[Applause]
um
is it char
now we need to do this other look up
uh okay one through
um
yeah they're eating my fucking meatballs
it was unbelievable
more people should be fired
you have one job it was bringing my
meatballs and you didn't do it
and now I'm eating sweet potato chips
and popsy all this disgusting oh now I
got chips everywhere which is terrible
it's terrible
this is terrible I'm I'm so upset I hate
San Francisco with my fucking meatballs
like ah
[Music]
do this
for free speech that's why we love free
speech
all right wait we can't remember
essentially clean the floor off
scholar charger and
[Music]
um
so if it is actually uh
our preparation applications come before
and ASCII so if V1
um
Less Than Zero
V2 else V1
233 not right
I hate that I can't put two arguments
into the print function like a normal
print function
they use like one of these
okay the L's are wrong
oh
oops
wait what
why are they showing up multiple times
oh they're shot multiple times ah
okay
they show up multiple times guys I'm
eating disgusting food shop
flops up
I'm triggered ma'am where's my meatballs
they took my spaghetti
I want you to fix it
157 right
they took my spaghetti
we can have a different badge item type
foreign
so basically
instead of splitting it in half we need
to
yes
and we need the other kind
I'm going to group them by three
how do I do that
she's an upsetting for Loop
the Phillips are too upsetting
I can't believe anyone ever used for
Loops they're so upsetting
how do I skip three
OH ZIP
zip either data three
trip cloth you know Scala
is this actually right or you just
don't know I'm in a mediocre apartment
in a terrible City
I don't understand anyone lives here but
how do I zip
uh no I'm okay okay I guess I could do
that if I can slice can I slice
I want like the colon colon three right
I see how to do it with zap
no of course it doesn't work beautifully
like python slice
every
let's not chat TBT
Scala every
third element in Array
you can use the grouped along with the
mapped and flat oh grouped oh
oh man that's some fire Scala
um
head
flatten
wait there's gonna be fire if this works
foreign
let's do it on small
I'm asking you
know we don't want to flatten I know
what we want to do
map
let's try that
close
um
I'm gonna flatten we want to concaten we
want to join
Scala joined string into list
or the other way around
see how to create a single string
oh dot make string
fire bro okay now we can do dot grouped
two
um this isn't exactly right because we
have to
Scala unzip
or I should be able to
map
that's gonna bitch and tell me some
iterator again
dot map
case x y
eval x y
mismatch error found x n e y but it's
grouped I don't understand
slice notation in scholar is that useful
to vector
or would I ever want a vector I hate
vectors
let me get the elements
actually kind of your Gap
value get is not a member of list string
I think it's not get it's just
scholarly's zero Index right it's not
like evil Lua iterator I love iterator
52.
oh that seems right
let's do some I'll get 70.
52.
wait what
the first group all the only type that
appears in all three okay never mind
we're doing this wrong
oh
okay
we have to find the one that's common in
all three
so we're close here
70. cool
or we're scholar Geniuses bros we're
scholar geniuses
this food was disgusting
should we followed up with a wheat and
gluten-free cookie
this is a real food normally don't eat
this
app there's no wheat and there's no
gluten what does it have in it
you know I'm hangry right now I eat a
fucking Snickers that's how hungry I am
I like Snickers
I don't like peanut butter
all right should we try Uber Eats again
I'm sorry Chad I haven't interacted with
you all the time but hopefully you like
that I've been writing Scala instructor
and that's what we all like to see on
streams right
do you like to see me be a noob and
struggle
[Music]
I know many people might work all of
them
you just gets things because he's famous
vaping
all right GrubHub
doordash really fucks up do I even have
a doordash account I'm sorry chat
thank you
it's pretty more water for my tea
the Twitter huge
ten times over
elon's not a big fan of feeding people
granola cookie bake all right fine it's
fine
we'll eat this
oh it just smells bad no I can't I can't
oh
vaping is my new hobby I Vape I play
chess and I go on Twitter
all right
they're probably the apartment never
mind uh
what's with the new skinhead haircut I
gotta look hardcore man
Vape is probably bad for you
how bad for you right a lot of things
are bad for you
smoking is bad for you
we have more water for my nice calming
tea
um
I know this is a terrible place this is
a terrible place
so at
you see me in San Diego I'm chill man
you know you know magic problem with my
favorite words
where should Twitter relocate to San
Diego man
Twitter wants me to stay at work that
longer San Diego
um San Jose is oh you like San Jose just
hold this holder
no Austin guys Austin is just San
Francisco running it back turbo like
it's it's not better
you can't have these ultra-left cities
like why
because people like them because they
have like like hipster coffee and stuff
like it's not worth it guys it's not
worth it
the shitty politics of your city will
creep into your tech company and you'll
end up with the Twitter files
all right
like these people are like like they
think you know these people here are
whacked out of their mind man they don't
say things like homeless you see what
what's like the politically correct word
for homeless now it's like unhoused
persons right like anyone who talks like
that is fucked
no I mean everyone knew the Twitter
files look like when Snowden came out I
mean I thought this is all nothing
Burger too like holy shit yeah of course
the NSA is spying on all your you know
Communications of course they're logging
all the metadata right like everyone
knew that everyone knew what all the
Twitter files were too like yeah Twitter
banned you from search like there's a
tool online to check this everyone knows
this
yeah well work from home's another hole
why do I want to work from this
oh man I'm just agitated you know
agitated it's like oh go outside and
enjoy something nice no I won't
um Twitter files are basic corporate
Behavior I mean we had a sort of
it's not
yes
the corporate behavior is broken is
basically what I'm gonna say
I agree and like look those people are
not terrible people you all understand
their decisions in isolation
but then when you like zoom out and say
wait a second
what are we building here right that's a
lot of the problem Twitter didn't
understand what they were building right
Elon says all the time this is the
Public Square I old Twitter never said
that
or they might have but you know they
just lost their way like what were they
actually building they were not trying
to build a Public Square
they were trying to build uh something
actually much more resembling a modern
Newsroom
oh
Google search sucks now not because
Google's been captured by ideologues
Google search sucks now because there's
no more internet to search
um what did I get done this week oh I
found some very interesting stuff this
week
like just I'm looking into there and
look Elon wants me to fix search
and
I don't know I mean this isn't secret
I'll talk about it like I can do
basically one or two things
I can ship a bunch of small mediocre
features or I can build you a really
impressive demo that won't be able to be
shipped for two years right like what do
you want
sorry the best engineer in the world
can't like ship this demo
um I'm not going to go into the reasons
why but like yes you can build
incredible demos that use modern large
language models use modern image
embeddings use like
fancy contrast of methods to figure out
what you want deploy rlhf in real time
yeah like you can do all these things
but not in 12 weeks
right and a lot of these things require
you to build up good infrastructure
beforehand I say this all the time at
comma the goal is not like solving
self-driving cars will be easy Once you
build the right infrastructure to do it
um
no no no no no I can't I can't stay in
this city more than 12 weeks man I miss
Alex I miss San Diego
uh
there's nothing about Twitter Twitter's
actually pretty nice
um though
we do need good food good food's
important to me common is good food
um how many more weeks uh I'm three
weeks in to 12 weekend to your chat
um
yeah the city's just
agitation and I I like I remember how I
used to feel when I lived here
how's the talent generally pretty good
actually
um you know I think that
the people who stayed are exactly sort
of the right people
uh there's some very good Engineers
there
right and yeah like
you know I am maybe there's a few more
to to uh
you know not not everyone but
most of the people I meet are very good
tiling window manager no I'm Italian
right there
when I stay at Twitter if they move to
another city if they move to San Diego I
think about it yeah
if they move to San Diego I'd think
about it and like look I could build
some really incredible ml stuff for
Twitter but it's going to take a year
um and I think there is much more
pressing priorities there right so again
nothing secret Twitter used to have
uh 7 500 people right
your code base reflects your
organization so when you have an
organization that is very clearly
overstaffed you have a code base that's
very very bloated
uh now
you know
what I would do is spend a lot of time
refactoring but you have to make a
choice do you want refactoring or do you
want features right and you can scream
both as loud as you want but you're not
going to get both
you're going to get
probably actually features if you scream
that you want both refactors and
features you're going to get features
uh
the slack channels are probably fun
though
yeah
you know they're they're not Bombshells
to discover it's all basically what you
think
um like I said I I promise you the
talent bar or Twitter has gone from here
to here now the the people currently at
Twitter are probably the average Twitter
employee now is probably considerably
more talented than the average Twitter
employee was right the good people they
believe
um there was a tweet I liked it was like
so the greatest entrepreneur uh you know
of Our Generation comes and buys your
company imagine what you could learn
from him imagine the impact you could
make imagine the opportunity but no you
resign LOL right like
um but if I refactor I can guarantee
three times performance
well can you right you can get there you
can get there and refactorings are
required refactoring can improve both
your performance and your velocity of
features but it takes time and there are
not obvious results tomorrow
so that's sort of the problem
um
I mean Elon is clearly you know whatever
I think maybe elon's doing the wrong
thing I do remember that he's a
billionaire and I'm not
uh so on average his decisions are
better than mine right and this is true
you can look at it you know it's the
same thing in chess right like someone
on average who has a higher rating than
you is making better moves than you
can I share the architecture of Twitter
I mean it's mostly public right well for
natural and finagle stuff is used
um you can you could read all that uh
that's like that Mike services
how's Advent code I'm not really doing
it this year
um I don't have time you look at my
GitHub my GitHub it's sad my github's
not even there's no green on my GitHub
right now
it's all it's all empty
um is Twitter bloated with microservices
uh look what Elon said was accurate
got to day nine and you're like meh
I don't I think microservices are a good
idea
um for the most part I I think that uh
it maybe has been taken to an episode
extreme
Alice I don't think Scala is a bad
choice I think skull is a fine
programming language like good luck I
mean look look at the code I've been
writing right
let me clean up all these stupid print
statements
that's pretty nice actually
I don't think I could write it much
faster in Python there's there's nothing
in Python there's nothing like called
grouped in Python is there not that I
know of
yeah there's no group to buy them
um in Python I would do like Zip and
then zero colon colon three and then one
colon colon three two column three
uh why not go Lang I mean yeah golang is
probably a better choice for
microservices than Scala that's what I
would choose today
but
I I mean I think there are more go
Engineers again there's nothing
fundamentally wrong with Scala
this is your favorite Scala project oh
chisel I don't know chisel was written
in sky
sorry this is gonna be a short stream
today I'm uh
maybe maybe I'll do one more at that
code
we have 843 people here all right we'll
do some more coding
I'm just I'm hungry
I'm hungry and I gotta get food all
right let's try ordering again
should we try Uber Eats part two
Getty
Istanbul Grill King of Thai Noodle
Grandma's homemade pasta I got some from
Grandma's homemade pasta it was very
mediocre so I tried a different pasta
place
should we just order the same thing
again
no it was 30 something dollars
so we should probably go out it's
raining
foreign
we'll do one more we'll do we'll do one
more problem and then I'm gonna go out
and find food
order the same thing but say it's for a
cop bro I don't think they like cops
around here
uh
look I'll Advocate as much as I can to
open source Twitter's infrastructure
you know but again when you look at
elon's other companies he hasn't really
open sourced much it was a struggle to
get Tesla to open source the Linux their
Linux kernel even which you legally have
to
um tiny cores and Scholar chisel
there's nothing really wrong with uh
with Scala
yeah I miss tiny grad I missed the tiny
Corp
all right
um
day four
consider the following section
assignment pairs
um
let me say uh fully contains the other
how many assignment pairs does one range
fully contain the other okay this is not
too hard so we're going to do lines dot
split
but see it can't be split
okay uh
[Music]
this is the last one guys
Can I some Bulls
clogbull is probably fine okay so we
want x dot
[Music]
um
can I split on two things
you can also split based on a regular
expression
and really what I want to do is like
that that might work
so in Scala VAR changes Val doesn't
true I'm just gonna bitch and be like uh
oh yeah I gotta equals here
no implicit ordering to find for be fine
L Javelin string
okay good
that works great I know my right Axis
okay
um we want to figure out if does one
range fully contain the uh there so
let's map
two inch
all right and then we can say a sub zero
all right so if it fully contains
then we have a sub 0 less than or equal
to a sub 2
and a sub 3 is less than or equal to a
sub 1.
or
the other way around
ah this one contains this one
um I'm gonna close that and one l0
453.
all right uh uh it's quite a bit of
duplicate work the number of pairs that
overlap at all how many overlap at all
okay
so if we want to know overlaps at all we
just have to check if
any of the numbers are in common
so I think I just need to check
uh
uh see this is like where like there's
like some people can do this very very
fast and that's his winning Advent code
if you train yourself a bit you get like
very fast at these things
we're not really trying to speed run
here we're just kind of
we're just kind of chilling and thinking
about how to write beautiful Scala
um okay so if this one is in the middle
we can just check this
or
this
can't hurt to check the others too
and there's
great
and Scholar three
yeah
uh
this one look fun that looks awful
we didn't have to even write any
algorithms this is all just like string
parsing
which is kind of lame
um no I mean I don't know like having a
code just like the times one of my
complaints about evident code last year
was that like the solve times for these
things was like a minute and we'll solve
times a minute you're no longer
rewarding like people who can program
you're rewarding people who have good
infrastructure and just happen to be
like like it's it's a reading
comprehension test instead of a
programming test
um which I mean it's still fun but it's
just not like
look at day 10 you found it pretty
enjoyable okay should we skip to 10. no
I can't do anything I need food
I need food let's look at ten Ten's
enjoyable
oh I do like things like this you know I
really like the first year I did it they
had a uh like an interpreter
they wrote like a tiny interpreter and
they built on it and every other one I
thought it was really cool
okay
[Music]
all right we'll do this one too
add V takes two cycles to complete
there's nothing like the op code thing
day 10 was math
[Music]
um
like the login pop-ups back
uh
that upsets me if that's true
nine is more fun than ten
I don't know no I'm I'm I'm I'm I'm done
with this
I gotta eat
uh look if the login pop-ups back like
that's that's that's so upsetting to
hear
um they don't have pieces that deliver
the login pop-up was gone for I removed
it for 99 of people the other one
percent look there's like PM still who
like
oh you can close it now okay as long as
you can close it
I'm not fighting it's it's a stupid
political battle like
you're just you're just you're just
losing I tried I tried guys
click on oh you have to click on login
and then click X oh my God
Knitter project in shambles now should
we build a Twitter competitor
foreign
should we build a clean Twitter
how do we build it
how would we build new clean Twitter
oh it never allowed you to browse likes
or media
what's actually wrong with Mastodon I've
heard that all people do it you know the
problem with Mastodon is the same
problem with troop social and parlor
right
so when like these new ones show up
who goes who legitimately signed up for
truth social and was like this is going
to be a community I want to be a part of
nobody right you got a bunch of like
rabid Trump fans and you know it sucked
it was a terrible Community right
um mastodon's the same thing right
the but it you know usually people are
used to this happening with like the
right-win people fragmenting like when
Reddit kicks off the Donald and they go
to the donald.win right like it's it's
usually people it's the right wing who
leaves but on Mastodon it was the left
wing who laughed all the oh you know
Twitter is owned by a billionaire and I
hate billionaires I'm gonna go to
Mastodon where they know how to run a
social network
um
so yeah I mean the problem isn't even
the Mastodon technology it's like do I
really want to hang around those people
like everyone on Twitter I see who has
the Mastodon in their profile is like
this person doesn't seem cool man
uh what do I think of urban well I mean
or if it's a lot better right or Urban's
a lot better Urban suffers a lot less
from these uh
from these from these problems
uh all the cool people are showing
Twitter yeah I mean it's true right
all right I'm sorry there's no more
programming today I'm hungry my food
didn't show up
and try to order food with the GrubHub
app
uh no Urban does exist right so Urban's
interesting in the I mean urban has a I
think there's another like Arena like it
has this sort of
um
hipster early adopter vibe to it and the
the people there don't really seem like
it seems like there's like a political
balance there and it seems like people
are there because they're excited about
like
weird esoteric technology which is cool
like you can you can build a community
around that they're they're into like
artificial difficulty
right yeah who is a disaster right like
like knock and Hoon are not serious
programming languages right nobody would
argue that that hoon is like a serious
programming language
but it's it's kind of like the way
people like like
esoteric stuff
right
similar to like I mean I see some
overlap with like like the 8-Bit video
game Community right like the people are
like oh yeah look what I made the NES do
right
um am I on Twitter HQ no that's my
apartment
smoking a cigarette
um
there's a whole Twitter thing is
political one side believes the guy who
took over is against their politics well
yeah but you see look the problem is
like elon's not a political extremist at
all right Elon and he talks about this
all the time he's a Centrist
right so yes if their ideology is we are
far left Communists who believe that
like you know uh gendered pronouns
should be abolished and everyone should
just be they and you know we can all
look like NPCs yeah like if you believe
that yeah this guy's probably against
your politics but that's a wacko idea
right
um so yeah I mean yes anyone talks about
this too he's like well yeah we want the
extremists to leave right both the
extremists laughed and the extremist
right and yeah everyone like there
should no one wants extremists they're
just terrible
I mean yeah Elon reinstated Trump right
like
why was Trump banned in the first place
how absurd was that
it's just like
can you believe they actually banned the
president of the United States from
Twitter
and you can read like the justification
and it's absurd
it's not like uh it's not like uh you
know this guy was actually like
you know I mean
what did he do right
uh so if if if one side has a group
where you know that Donald Trump
shouldn't even be allowed to talk well
that's a bit extreme right I think it
would also be a bit extreme if someone
like you know wanted to kick Biden off
of Twitter right if Trump had reinstated
Trump and kicked Biden off yeah fuck
that guy right like no one wants that
right like this is this is the problem
um
right but you know you want to let
everybody talk and then let everybody
you know you should be able to listen to
everybody and make up your own mind if
you really like what Donald Trump has to
say you can listen to him right uh you
know
foreign
can we kick the terrorists off
I mean
who's a terrorist right
like one man's terrorist is another
man's Freedom Fighter right
it depends it depends what they're doing
are they you know where I think the line
should be I think the line should be
illegal in the United States right if if
they're posting things on Twitter that
are illegal in the United States like
imminent you know violent threats uh
child porn like things that are illegal
in the United States yeah you should be
kicked off Twitter otherwise you can
talk and people can listen or not
right
I mean they literally execute people
yeah but I mean I ran as a sovereign
country right
so you can say that you don't like them
and that's fine but are they breaking
United States law
and then also it's not like he's
executing people on Twitter
um
who's getting ad money from the EU yeah
I mean if the EU wants to pass laws
against legal speech in America then you
know what my take is fuck the EU man
like they can set up a great firewall if
they want
um yeah us doesn't execute anyone
exactly right like like the US is
responsible for more
killings and death and like
well great the Iran guy exit how many
people do we kill in Iraq like you know
um so it's different I mean what is a
country a country is a monopoly on
violence right the state is a monopoly
on violence so when a state does
violence it's not like an individual
doing violence
do I know what Elon and Tim Cook talked
about I really don't know I don't have
any insight that's not really just
what's on elon's Twitter
um like I don't know if Iran is bad
honestly I don't know enough about it
but I think that there should just be
like Fair very permissive rules on a
place you want to call the Town Square
and then like Scott Alexander has a has
a post where he talks about moderation
it's not censorship right if you don't
want to see Donald Trump's tweets that
should be your not right but like we're
trying to make a good platform right
yeah block Donald Trump Right add a
keyword block for Donald Trump great you
don't have to see it but to say that
like Donald Trump can't talk to somebody
who wants to hear him talk is absurd
right
like like censorship is when a third
when you have two parties who consent to
communicate and a third party says well
actually we're not going to allow them
to communicate right
I'm not turning Twitter into 4chan and
again there should be some
civility
right
um I mean Twitter for one is not really
anonymous
uh isn't there somebody you forgot to
ask that's right
um hate speech is not illegal in the U.S
there is no clear definition of hate
speech the U.S has this thing called a
Brandenburg test right
this is this is
this is basically the uh the limitations
on on on free speech
uh in America right
um cannot punish inflammatory speech
unless that speech is directed to
inciting or producing imminent Lawless
action and is likely to incite or
produce such action right imminent
Lawless action
and is likely to incite or produce such
action right you can do hate speech all
you want you can talk about how Hitler
was great you know you can talk about
how you know you you you you want all
the redheads to die like you can do that
but you know there's a test
hate speech doesn't protect you from
being punched in the face no it's
illegal to punch people in the face
right because someone
because someone says something you don't
like it's not okay to punch them in the
face right
oh so yeah yeah this is why Clips aren't
allowed right this is why Clips aren't
allowed actually I for full of contacts
I actually don't think Hitler was great
I think he was a loser uh I think he
killed himself sad in a bunker like he
was a loser man you know say what you
want even about what he believed like
the guy was a fucking loser
um
the core problem in America is that no
one understands Civics well they should
have paid attention in seventh grade
you had a wife one day and then I think
they dated but like not look I don't
know man I don't know my I don't know my
my hitlerology that much I said the guy
was like they didn't let him into art
school man the guy was a loser
[Music]
um
whenever EU demands matter so the rules
will be the average of the U.S and EU
yeah
yeah I don't agree
I don't know what if the EU would like
to stand up a great firewall and block
my website they can
uh
is there a line where you would say that
someone Justified being punched no
This Is How Free Speech works
do you know what I mean like it's not
okay to respond to speech with violence
like
basic American shit guys
um I'm not that interested in what Kanye
has to say he's got a he's awesome he's
on some weird Trip Man
no no it's not okay to punch people
because you don't like what they're
saying
oh
I I get yeah it's a mercy band man it
was a mercy band really
um you can verbally punch somebody
that's right you can you can you can you
know put a fire diss track together
that's all fine
um it's okay if you're a state yes it is
okay a state is a monopoly on violence
yes
all right uh politics is stupid guys uh
thank you for watching today's stream
uh
uh I I honestly I don't have an opinion
on Iran
um
is Twitter hiring yeah Twitter's hiring
Twitter's hiring uh
I'm not I'm interned I don't have any I
don't have any insight into that but I
do think uh
oh python three python 312's out
hungry I'm tired I hate this city
ah
you know you know the sad thing about
politics I heard a quote that upset me
it's like
you might not be interested in politics
but politics is interested in you so
like here's what I Hope's happening I
hope that like
a whole group of people who's just
absolutely fed up with the bullshit
shows up and you know look I think
elon's in this group right
politics is a little more appropriate
than usual because honestly why did I go
to Twitter
I came to work at Twitter because I
believe in free speech
I believe a lot in free speech I think
it's uh
you ever see the graph where it shows uh
IQ versus belief in free speech right
also you know
um
better salary and comma dying
November was our all-time profit record
at comma for a month
now we made more money in November than
we'd ever made before
uh thank you to everyone who purchased
the common three on Black Friday
um
I'm trying to comma next I gotta leave
the city
why'd I leave comma because I'm a
quitter quitter man
um
it was two times of people people want
to be left alone and people who don't
want to leave them alone yeah that
sounds right
uh no I think there's a real change
I can feel the change in the air boys I
can feel the change in the air you know
this isn't
this isn't this isn't a winner or the
culture War this is just both sides of
the culture War being told to shut the
fuck up that's what I'm talking about
that's what I want to see man you know
nice like we can we can like yeah the
extremes of both sides are just
ridiculed right
Vibes be shifting right Vibes are
shifting that's how I feel
uh yeah AMD doesn't have any good
opening eye come out with something that
performs comma not easily
um we are years ahead
in a whole bunch of things like it's
gonna be really hard to
engineering is a function of
like the number of times you've iterated
and how quickly you can iterate right
and
and no one's really iterating on what
com is iterating on we've been iterating
on it for years we're going to win
self-driving cars
um AGI more on my mind now
my mind as much as it was
look like I mean Chachi BT is is
good but it's not that impressive right
um I think it has it has an IQ of uh of
81 uh it got a 10.
20 on the SAT it's a isfj isfjs
um
Twitter I'm a kid guys
uh
what would make an AI surprise me
well then really it's just going to be a
slow and steady Improvement
what oh let's ask let's ask what is your
sign
as a large language model trained by
openai I don't have a sign
well we stopped it bro
it was surprised you got 20 on Arc too
bro we stumped it
gvt is making you nihilistic
sorry but I am a machine learning model
trained to assist with
all right when
were
you born
what guys Chach EBT is just thousands of
people in the Philippines
you need to use playground default chat
it's more impressive
slash P slash default chat
oh
when I what is your sign
I don't have a sign but I can provide
you
when were you born
what month
please add a payment method to your
account
oh
if you weren't USA Ai No that one
doesn't really work
I was programmed in August what sign is
August
so you do
have a sign
why you lie to me
you told me your birthday
told me your birthday
I'm getting
aggravated
fine where's my fucking meatballs
Uber Eats didn't bring me my meatballs
I contacted
them but
still no meatballs
[Music]
foreign
I'm frustrated
you understand why I might be feeling
frustrated you're not being helpful
right now I want you to empathize I want
you to empathize with me
I get you don't eat meatballs but meat
is delicious
ah are you vegan
no I'm not at least he's not a vegan
guys at least he's not a vegan we should
stop making fun of him play with the
chat EBT Linux shell
you know SPF
click shift enter or something
exactly if you don't eat your vegan all
right guys thank you all for watching my
stream today
um
wow my skull was bad
uh
uh yeah I need to get food
bye
okay okay
uh oh I don't have the chat up again
look I gotta I gotta I'm gonna try
something
first off I feel bad I was in a bad mood
for yesterday's stream and the meatballs
really put me over the edge man
but even though I love you guys and
we're here to we're here to spread we're
here to spread love
forgiveness and tolerance yeah those are
good things all right so also we gotta
finish Advent of Scala uh and today
we're gonna finish it
ah
so let me find my iPad
and let's see if we can plug the iPad
into the computer and get more screen
because I don't really have enough
screen
this is going to be too hard
this is a later project but we have the
iPad and we have the wire
and for now we will just bring chat back
up on my phone so I can interact with
you and you can interact with me and we
could all be a happy family hello stream
um
okay
hello stream
twitch
my channel
happy to see you too
another Twitter project stream no so
we're doing Advent of code in Scala
food
um I got a nice
latte
by the way I want you to know this is my
right hand not my left hand and that's a
little misleading so let's see if we can
fix that
we don't we don't want any of our
how come there's not a toggle for that
okay it's not a toggle for that great
and I have to turn auto block off
thank you
no my so this is my mobile streaming
setup
um my real streaming setup is at home in
beautiful San Diego but instead I'm in
we're gonna really today's stream is
gonna be very positive
I mean
slightly less beautiful San Francisco
uh oh we got it we got a nice latte we
got some leftover pizza in the fridge we
chill on boys we chilling
you can flip the webcam on the borders
in OBX
where is this like here
how do I flip it
whoa whoa whoa whoa whoa
you can drag border a frame through
other border
oh this list
all right cool look this is my left hand
this is my right hand
all right we're we're good we're good
we're good oh yes you're you're good bro
you're good we're positive stream today
positive stream
so look we're using them again too
should we be using them no we should use
vs code but I don't have enough screen
you see I have some some screen here for
the terminal and I have some screen here
for the problem but I don't have any
screen left for uh vs code
35 I wrote a little script to fetch
and then we're going to copy for
go dot Scala
should we use the S code let's use vs
code
oh we got a new vs code today
we should also I didn't spread enough
positivity for python32 we should spread
some positivity for python32
um
improved error messages are really great
you know it's so annoying in Python when
you have a long especially if you're
writing tiny grad code where you have
very long lines
uh
uh my monitor size back home
is 30 inches
uh
is learning Scala worth the price of
freedom of speech you know you're not
just a Twitter for freedom of speech I
thought about that yesterday too uh
you know this is this is a very
interesting event
it's an interesting event I believe in
the mission
oh so I thought why not
go to Twitter
and here I am
um
Elon I'm working this weekend man I'm
working look I'm I'm learning scholar
why do you think I'm learning scholar
I've been learning scholar to help out
Twitter you know what we should learn to
do there's a way to get like a terminal
here
why is this in restricted mode
trust oh of trust
okay let's load this for AOC in June
um no okay leave restricted mode trust
now how do I get a terminal is it can I
run Scarlet in a debugger
run and debug whoa
Scala extension
scholar language server with
whoa let's try this
medals
can I run this
run and debug
create a launch.json file
needle launch.json file
what do I put in my launch.json file
find
I don't know I'm trying to run the Json
now we don't want to do that
let's go to Scala
and then oh oh what is this doing oh
it's downloading stuff
oh this is exciting
um did I have to do an interview yeah I
had to do an interview it wasn't like
more people would
technical interviews for me they don't
usually do technical interviews they
usually do like
uh you know more
what are your expectations why you hear
that kind of stuff
which which is fine I I actually the
Twitter people were very nice
um
this one this one was very nice but some
of them some of the like interviews I've
done now are more
yeah you know I I wish that I wish that
uh
they would they would ask I love I love
technical interviews
no one ever gives me technical
interviews and coding challenges you
know
all right so we're you know it's a
Sunday we're gonna chill
um we're gonna we're gonna Vape a little
just just chill Vape man
my vaping upsets you I'm sorry
um this is a positive stream
and okay so can we run it now
no build Target could be found for the
path okay we need a build Target
um run and debug vs code Scala
no this is wsl2
nope build Target could be found for the
path
can we not just run a single Scala file
bug single scholar file vs code
yeah so this is like for like whole
projects and stuff I mean okay we
probably could just go in here to a
terminal and type Scala go dot Scala and
this does most of what I want it's going
to complain because I don't have a
for input what
oh
I do have a
um
let's create a new file called small.txt
I was like small
and
oh it includes a drawing that's going to
be fun to parse
I think we might actually have to write
an algorithm for this one
but let's make the debugger work you
know
if you're going to spend six hours to
chop down a tree you should spend the
first floor sharpening the ax and when
we have a beautiful Scala debugger
and remember also all these streams it's
not about the destination it's about
it's about Journey
so we're here to go on a journey and our
journey is going to be figuring out how
to use a Scala debugger
thank you for the hype train I'm glad
Everyone likes positivity I like
positivity too we should all try to
bring a bit more positivity into the
world
foreign
I have a latte
Vape
is vaping a terrible Hobby
do I ever
um
okay we're gonna have to go to
subscribers only chat because you know
what subscribers I just feel like you're
more positive people than
non-subscribers
no it's uh the vape's at elf bar
this is the first Vape I've like really
liked I've I've tried I've tried vaping
before like I tried to Jewel I wasn't
really feeling it
um
yeah you know a really cool thing you
can go to uh you can go to a new city
and you can have a new identity so
anyway I uh cut my hair I bought a vape
now I live in San Francisco and I work
at Twitter
how cool man
why doesn't my debugger work
internal error
um this is in the output
no build Target could be found for the
path should we ask chat gbt
oh no
open AI you need to buy more gpus
um
scholar debug single file vs code
do I need to put that in launch.json
let's type a skull this is not going to
work
no build Target could be found for the
path okay how do I make a build Target I
don't think it's this
metals
let's look up what this is
hmm
so it might only work in SBT
for each main class oh it's not a main
class what's this
insert type annotation
right should we make an object Main
will this make it happy
this work still by the way
let's just write a minimal one
how do I move between Windows with the
the S code keyboard move
between Windows
I've done this before now that opened a
lot of this open this
I can focus on the explore panel with
that
um you know a lot of times a way to get
better at this kind of stuff is to go
slow with the keyboard shortcuts and
really force yourself to use it and
that's how you get fast right look I'm
giving I'm in such a good mood I'm
giving you guys real tips today
um that can annotate with Maine yeah
okay
so I don't understand why I have to
hmm
main annotation cannot be applied to
object Main
that works
so how do I jump to okay so that's how I
jump to that how do I go back to that
one
yes code jump
control shift p
oh what's this okay so this gets me
there that takes me there and then that
no
troll back tech I tried that
oh it's control back tick not command
back deck oh that's ugly I don't like
that
command J works for mac oh that hides
the console so
search for Focus terminal
and she did better right I should get
better at vs code
um
could have preferences open keyboard
shortcuts so this is called Focus
terminal
well we know that control backtick works
it just feels awkward to use because the
control key is very small on a Mac
command J will hide and show the
terminal yeah which actually is kind of
cool too
but I don't know why command backtech
doesn't
whatever whatever it's control backtech
we just have to use it
um
I don't recommend changing the default
uh keys I recommend learning the default
keys because then you can work in any
environment very quickly because you
know there's some people who are like oh
I have to spend 10 minutes setting
things up yeah well because you didn't
learn the default keys
um the only program where I really have
hated the default keys so much is uh
gitra
hello everyone
good morning to everyone even a fact of
altruists
why doesn't my debugger work let's
figure this out
no build Target could be found for the
path Scala build Target single file
set middle Target get build Target
hmm
don't see now we're getting crazy like
object main extends app
bro
I'm gonna learn the shortcut key for
that how do I switch the tabs
oh there's
oh control back takes the terminal if I
want the output it's command shift U oh
that's cool
that takes me to the terminal
oh I can do object main extends app and
that works too interesting
what if I don't write extends app
no main methods detected interesting so
app is a built-in
the app trait that's a trait okay we
learned what traits were in scholar
School
um
cool I kind of like that better than at
Main deaf Maine I think it's kind of
more beautiful do you know what I mean
feels slower though is it actually
slower
yeah
marginal
seems slightly slower though
uh whatever 100 milliseconds
how do I get fast scholar
what takes so long does it have to like
allocate gigabytes on the Heap
Gala startup time snow
scholar native
I tried to pass the client parameter to
the jvm
how fast is python oh man that's
Lightning Fast look at that
oh that's lightning fast
don't you wish this call was that fast
oh we live in such a nice world if we
didn't have to wait two seconds to run a
small scholar script
jvm slow to start
oh you're doing the chapters on
yesterday's stream we should merge these
two streams into one I think yesterday's
stream was yesterday's stream was was I
was in a bad mood for yesterday's stream
we're in a good move today
um no also I had a Red Bull on on Friday
sometime like the day after I have a Red
Bull I just like I'm angry it's like
some like B vitamin deficiency shit
um
I'm gonna you know it's nice and slow
it's Sunday uh
now food was really probably the issue
man the meatballs thing really set me
off man
just I just wanted to be false I didn't
get any meatballs
ah
you know it really
it takes time you're really like I
always come back to my my absolute love
for computers and doing this stuff
thank you for gifting Subs
um
okay
so it's interesting we can do object
Mains let's figure out how to specify a
build Target
well these people used Main
all right what's Scala kly
how do I get Scala kly
oh I see
Brew install
we do not call scholar clay a build tool
no learning curve
well missed it do you have a question
paper will be fast look at what we
people built around Scala
this will be fast after everything
finishes downloading we're downloading
the tamarin
oh this is Scala three what can I do in
Scala three
just came out
wow look how fast that is but
jvm that is hosting bloop
bloop exit
oh
can I change it or is it only because
it's cached it's still faster
how do I kill bloop
uh Scala clay bloop exit
starting compilation server
oh
jvm that is hosting bloop and then use
the jvm flag to restart bloop
oh I see okay
current bloop jvm
I think everything is dependent on bloop
jvm that is hosting bloop is older than
the requested runtime
jvm what's the requested run time
where do I get the requested runtime
from
I just think this error is really uh
ugly
oh maybe it's uh okay you know what I
want to exit and get a new terminal
let's kill bloop
how many scholars do I have on my
computer right now
I figure out what jvm I'm requesting
oh this is using open jdk I see can I
just uninstall open jdk do you think
install open jdk
because this is using
yeah Brew uninstall open jdk I'm gonna
regret this aren't I yeah because it's
required by Maven SBT and Scala okay
um
this is the current bloop jvm I think
if I set my Java home to this
no this is what is it Java home like
this what do I have to export
ah there we go
let me add that to my uh
now let's see if this works
okay wow that's so fast now oh it's so
nice
let's time it now I made a change oh
yeah look look look we saved a second
boys now look if over your life you do
that
like a million times what's a million
seconds
it's not even a million
if you do that a million times you've
saved 11 days
the faster if I use Main defame
wait
why did it say error no main class found
now it's fine
that's concerning whatever
we like having a main class
and we got a main class
okay never know main class found what
whatever it's faster now that we're
using Scala clay but we still haven't
figured out how to debug
because we need to build Target
Scala build Target
build Target is defined by SBT
let's try SBT
and let's figure out if there's a
minimum thing we can copy
okay here we have project and Target
this doesn't look useful
or you can pile on code change blah blah
blah blah
no main class detected
I have to create a file
try creating a folder called source
I did this a bit on the last strings do
a new Scala file we'll say main dot
Scala
what
select the kind of file empty file enter
the name for the new file main dot Scala
and then just copy and paste this oh I
should have put dot Scala
SBT run
about SBT now fast
no main class detected but I have a main
class
file layout oh okay so basically we only
need two also if I just make something
called build.sbt we can use SBT
delete that
we're in the trash
SBT package
we'll still just do this in the SBT
folder so we don't
mess it up
um
let's create a new file called build.sbt
and let's put that in there
and it will also create a file called
hello world
dot Scala let's just try this example
and see if this example is going to work
SBT run
don't kill the SBT process Just Launch
SBT and execute stuff okay hi Martin all
right can I debug this now
debug run and debug
no build Target could be found
what do you mean
have a build Target and it's here
I'm going to project definition
why doesn't this debug now
be a little Target could be found before
a path
oh did you run build import on the
workspace how do I run build import
build
no
mirror.properties
code isn't open in the okay the
subdirectory fucked it I I got it yeah
yeah okay let's try moving build.sbt
here
nothing in here okay just name hello
organization.com okay let's try that
can I run this
no build Target could be found for the
path
so it's not that
you can check to make sure SBT run works
here
going to create some other stupid
folders I mean we already accept that we
have tons of stupid folders
good class or object definition oh
that's that's annoying
the skull audio Source there
in my build.sbt I point the thing to a
thing
always Prince Hello junk Bob okay let's
try that
internal error no build Target could be
found
we need talk settings
here's my launch.json
do I need a launch.json
oh wait I don't see that many viewers I
only see six seven seven
is that a long time ago no I couldn't
have changed that fast people like when
we work on environments I bet we do
drop now for some reason interesting
I managed to solve this by installing
Bloom on my Mac
add these to your build.sbt okay
we call it main.scala maybe we have to
call it Main
build Target could be found I like to go
better
okay we don't actually have to do any of
this like I'm a little upset that the
debugger doesn't work but we have
managed to improve the rapple time using
scallacly
skull class very fast
oh
stopped working
now it's back I see
this is a net split
okay we might just want to start working
because we can spend forever tweaking
environments
and uh does it work right should we use
object main extends app or should we use
main death main I kind of like main
death Main
feels to feel slim you know
if we do it twice it works
it's kind of interesting
and it compiles that
all right
day five
we're gonna have to parse this thing and
then we're gonna have to move things
okay
so this is not the easiest thing to
parse
um what might we want to do to parse it
let's take a look and see if it like
really follows this but okay that's fine
uh how do we want to parse that that's
not easy
okay well it's interesting that they
have spaces in there
and we want to know which
ends up on
what crate ends up on top of each stack
okay so it's CMZ
um okay we move three from one to three
okay so it's
the top so we really want to list okay
so we should probably do oh what was the
other kind of fetcher I had
no that's got lines to list I have
another kind
uh yeah make string split
edit that
um
okay now I think we can start reverse
wait
that was not what I wanted
I just wanted to reverse the outer list
why did it reverse the inner list
oh because it's not a list uh
okay that looks good
um
hmm
I think also we can do dot slice one
because we don't actually need that
uh Missing argument for slice
until and can I do minus one
how do I say that I don't care about the
end
until index
can I say minus one
that's ugly
um
Ted oh I can just do dog tail
okay that looks good
uh now what we want to do
is for each one of these we want to take
just this one
um how do I do that
it's like one two three four five
uh
okay let's do map x dot tail
let's stay a list yeah it does okay good
uh now we want to select every
um Scala every
third element
from list
uh
skip
oh
drop grouped
list tabulate
uh dot grouped because group is the way
to do it and then I'll get the heads of
them
that's an iterator uh
map underscore head
uh to list
okay good that's what I want
I love oh man that's so nice that's so
beautiful
uh let's save all a
okay
so now we can make each list and then we
can actually do the moving according to
the instructions
uh we wanna like
you see what we want to do we want to
like invert the order of these lists
we're gonna like
you see what we want to do
oh via a launch Json configuration
scholar meta via launch Json
configuration I can't click on that link
because it's on my phone
now we gave up on this a long time ago
we got launch Json configuration oh that
looks so long
our main class oh that looks ugly never
mind we can't do that it's too long
I'm happy that we have Scala Clay
scolical is our friend
our friend okay we want to like
invert the lists you see what I'm saying
like we want to take like this oh I can
write like I can write the simplest list
comprehensions in Python to do this
you like Scala right like it's kind of
nice like that's kind of beautiful right
uh it's on the jvm so it's fast like
we're all we're all
SBT workspace detected would you like to
import the build
that's tempting let's try it
is this gonna work
um
you want like the first element of the
list and the second element of the list
and the third album of the last
we could just like
write this explicitly
I'm trying to think of some like trick
to do like flat map and grouped
can I think like some trick to do like
flat map I grouped you know
uh I like obviously everyone knows how
to do this with for Loops but for Loops
are so ugly
um
you want to take the first element from
each list then the second element from
each list
see what it looks like with the big
thing
flat map is identical to the map method
the inner grouping of an item is removed
let's let's get inspiration and look it
all out let's look at all the list
methods
tabulate
yeah yeah I get it
okay we'll do it as a for Loop
uh for
I
zero to
a zero dot length
uh uh that's inclusive okay that's weird
0 length minus one
all right now we want to go through each
one of the lists so we want to say a sub
I dot map
get I no no that's not right
just a DOT map get I
uh
dot filter
[Music]
x x not equal to that
it's actually a string not a char
we should be able to say that I think
I want a comprehension
let's see if this is even what I want
scholar of list comprehensions
uh value get is not a member of list
chart oh why am I doing that can I do
that
uh it's okay it's a Char so we're just
gonna do that
so this gave me Z and n on the first
stack m c and d and then p
Gala list comprehension
okay so you can think about the way
Connor to write this as a
as the other thing right we have to do a
map but we have to do a map with
enumerate
it's gonna have enumerate
there's no enum oh no I don't want to
eat them
um
I really just want a list comprehension
four comprehensions okay
for each do println
oh you can until instead of two
I just ended up using a head I didn't do
minus one ah zip with index good call oh
we got some Scala Pros in here
okay I mean we can write it like that so
we can write it as
a zip
with I don't really like that though
all right so it has to be a way to write
like a something that looks like a list
comprehension
the closest now oh what's yield
can I yield
where does it yield it to
illegal start of statement okay
[Music]
um
scholar list yield
for yield what is this
work
illegal start of statement
because I have brackets
cool okay let's see what this is
that a list comprehension why could I
not use brackets
wait is that exactly what I wanted yes
oh yield buddy
oh God I love it oh you gotta love it oh
you gotta love it
all right now we actually have to write
the code
um so that's TB
dot get one
and we're gonna do these things
oh it's not in get okay it's just so
it's just one but it's not what the
jokes okay
these are one indexed
so
can I say for
ins TV1
Yuri seller off thank you for
subscribing
uh dot split slash
now we have to extract the numbers from
there so so probably the easiest way to
do this is that this is very python of
me I know
so then we can say like ti so we'll say
something like
I'll count
equals t i sub one
file Source equals one two three
um involved dust
was TI sub five and I really don't like
that I can't do this
is there a print Ln that can take
multiple arguments like that
oh and then we want to do two indominus
and we also probably want to subtract
one from both of those
I really don't like that
what's TT
where do you see TT
uh
TI is just like my instruction split
apart TB is this file
um
oh your White Lotus is on tonight yo
it's the finale of White Lotus yo life's
so good boys life's so good
there's printf and Scala yeah
I have to do this
oh I don't know do slash and fine I'll
take it
okay fine
um
so we're moving from this to this okay
so now we have to take the
all right so what did you say that was
instead of um
we aren't even pattern matching yet or
four comprehending oh saren oh you're
the you're the Scala expert here
you suggested something else I can use
until instead of two
Scala list until
until
oh oh I can use until like that okay
okay
see if that works
nice
until instead of two oh you gotta love
it
uh you can do app strings yeah I know
you can do abstracts I usually do F
strings but
just wanted like a simple like like
console.log does this or print in Python
does this yeah yeah
um okay so array slice
it always takes in two arguments
it's fine there's got to be like a great
let's go right actually these aren't
arrays they're lists
allow us for prepending
Chinese oh they call it they call it on
till that's pretty nice
okay take selects the first n elements
take right
okay
so I think we want to say something like
B oh wait
so is be a list or it's a vector I don't
know what that means
but okay so B sub Source Dot take right
count
um
B sub source
those B sub Source dot uh maybe it's
called drop so something called drop
here drop right without its last
drop right count
B sub DST equals B sub Dash plus temp
or actually I think we can just
write it easier if we just do this
okay that should do all right
value update is not a member of index
sequence
uh dot two or
two array
hmm
scar array update
that should work
It's actually an array right
I shouldn't click I should do
why is it a vector
what's a vector
I don't trust that
um
Value Plus is not a member of
value update is not a member of index
sequence but I did two array here
oh no
I need parents I don't know if two array
even works
okay that works
okay now we just need to find the
concatenation operator for lists
I said plus plus
whoa did that just work
so we're left with
oh
it's wrong
why is it wrong oh again because crates
are moved one at a time oh okay
uh so we actually need to
dot reverse on here
yeah okay that fixed that and now we
need to take the last one from each one
so that's just a simple matter of saying
dot map
uh no it's not tail how do I get the
last item
you could do take right but I think
there's an alias for it
right we're really trying to write good
Scala here
uh select the last element of last
okay CMZ and now we should join that
into a string
um I think it's just dot make string
forever from yesterday
CMZ all right well the answer is not CMZ
we have to try it on A5
let's try it
are we Advent of code winners
well we're Advent code winners
okay
um to create some of the same
configuration because it says before Oh
crates stay in the same order they
retain their order okay so that's MCD so
I think if we just comment out the
reverse there
we get that
sweet easy
easy boys skull is pretty nice right we
don't like scholar
uh let's make some tea let's eat a
little pizza
oh today is a beautiful new day
oh
foreign
[Music]
would anyone else enjoy listening to
some copyrighted music
um
now we turned off stop only for a little
bit
we'll let some nonsense talk while we
drink tea
you know
Alex and I were talking yesterday
about how
our culture at comma differs from elon's
culture
and one of the things we kind of came to
was a real an appreciation for beauty
you know Alex has taught me a lot with
this idea I dress a lot better now
our merch has been taken up to the next
level
and you know I like I think the same
thing's true about code too and I think
it's really important to write beautiful
code
okay let's fetch six
no build tool was detected
no main class found well that's
forgivable
foreign
we have our input now let's also
download small.txt actually let me just
do something quickly
foreign
the preparations are finally complete
you and your Elves leave camps on foot
and make your way toward the star fruit
Grove you know they read a really nice
story like
you know again we're spreading love
today
um how nice is that that someone like
writes online
an online Advent calendar where you can
write code you remember having calendar
as a kid we eat the chocolate
all right you're slowly starting to look
like Jack Dorsey
guys we need we need a mobile phone we
need an operating system for a mobile
phone that's just the web what do you
think
but no that's got to go to subscriber
only
I think that if we search the universe
hard enough we can find a halting Oracle
and then all our problems will be solved
foreign
wow Bros how nice little halting Oracle
be can we just like take a minute and
fantasize that we had a halting Oracle
think about it you could write like your
ml
and then like if your loss didn't get
below a certain amount
Paulding Oracle
you can you can binary search to figure
out the results of computation instantly
using a halting Oracle
um okay
so this is a small
oh I think there's like one on each
it's one of these like one on each oh no
it's just one okay fine
um
four characters that are all different
so the answer to this is 7 because this
is the first four that's all different
oh no these are the first four that are
different
I see
uh so let's just throw these in and make
sure we're getting the right answer
even though it is only one for the final
one
we can just do it here
and let's use
this
map
actually let's just go to your unit
because we don't care we'll just print
it
next we don't need to use map here we
can use for each here
because it doesn't return anything
uh Scala clay go Scala
oh we need to import source
I should be using the shortcut case that
faster
uh proc not allowed here
only classes can have declared but
undefined methods but yet if I do Scala
it's fine
oh
wait what I was doing this yesterday and
it was fine
because I have a different version of
Scala now
value for each is not a what oh
this is because we upgraded Scala is it
not
oh no it's because we didn't do that
great very useful error Scala
we want to find the first
four characters that are uh
unique
okay uh for I
there we go for loop again
where I zero until
she doesn't really matter
we can just say accidentally it doesn't
matter
let's say my Explorer
um x dot slice I I plus four
test
uh is that no I think it's not inclusive
so I think we actually want to do three
but we'll just take a look
no that's right okay we want to figure
out if there's no duplicates in there
God this is so easy in Python you know
you just do like set equals
uh
skull uh array no duplicates it's
probably something similar
oh distinct
or if test
dot distinct
dot length equals four break
I don't know if there's breaks and Scala
loops
um
there's break oh Loop dot break
wait I have to import something for
breaks
no no no no that's a meme I don't know
this is a meme guys you can't
you have to import the break function
not found Loop
create a new brakes object no no no no
no no no no no this is unfair
I have to create a class
uh
it's never a good idea to break out of a
for Loop
oh can I return
found unit requirement okay we'll go
back to map
found unit required in it oh because
this there's nothing here okay I don't
know minus one
non-local returns are no longer
supported okay this clearly is not how
Scala wants you to do this let's find
how the programming language wants you
to do it
oh we can just do find over x a good
idea
um no but oh okay I guess can we
construct it is this an iterator
can can I like do this as an iterator
is this fine
oh found option end dot get
all right let's see those are the right
answers
oh we're gonna have to add no no we have
to add four
okay so the answer seven six okay cool
great
14 distinct characters rather than four
so we just need to change this to 14.
I said all right
oh no I just because I gotta do that too
hmm
not right
oh what
I just need to change all of them
nice who likes my one-liner is my
one-liner beautiful or what
foreign
we've completed day six let's do day
seven
whoa
did actually is this if I inspect this
element is this always one
thing
yeah we should probably we could
probably write a script to auto save
that
can I do time frog
no that's not worth taking time
guys we have to mail it two gigabytes
for the jvm and we have to initialize
the GC
okay this isn't it'll be a map one
vowels
the sky
okay
let me see
okay
I see what it does
all right this is a very sequential
looking thing uh so for Allen lines
um we're gonna need a
gonna need a variable
to track the current working directory
um
they're actually you probably don't want
to just do that as a variable
what we want to do that is this
our empty list
okay
um
foreign
let's first see what we want to do
what is the sum of the
okay that's hard
find all the directories
yeah so we're going to need to actually
build up a structure of the file system
well this is so easy
if you go out it looks like I'm fine
then right it's just like a dictionary
of dictionaries
um
should we create a class
you want to make a class okay fine let's
make a class
directory
I think this is the last one we're gonna
do today
um because I have to call my mother
wait what
wait that looks terrible in scholar 3.
no no I'm writing it like the other kind
okay
um
is that okay can I write it like that
um
so basically every time okay we have to
track the current working directory
uh so if l dot
uh uh we need the first no it's not head
what's it called
uh take
four equals
no no CD
let's print that line
okay uh FL dot slice
uh
zero one two three four
[Music]
uh six equals dot dot
PWD equals PWD drop right one
and it might be off by one there
uh value update is not a member of
in in string what
oh substring
oh
okay well this isn't right it's like
that
okay I understand uh five
okay cool
okay uh drop uh else if is this call
syntax
F okay
um we'll slash
PWD equals less string
that else uh PWD Dot
uh how do I do is it like push
list push
how to add elements to a list
prepending elements use a list buffer
when you want a list you can modify I
say
oh I can do it with colon colon that
only adds things to the front though
we can just do it backwards
cool
okay
so this tracks the current uh directory
now we need to parse the output of LS
if l dot take 4 equals equals
LS
um we'll make a another variable called
NLS
uh actually
I don't think we have to do that
that one's meaningless
um
we can just say if l dot take one is not
equal to this
uh
no no LS still matters because we have
to reset files
um
how do we know when we're done with ls
okay here we can just say uh
something another if
all the last LS cannot give me a prompt
though
yeah okay
um
okay
uh that should not be take one
okay then we also have to deal with the
final one
um
right we also have to say uh here
so I guess actually we just need to say
add directory
actually we might I'm sorry if you
wanted to see me use a class but we
actually might not all right fine we'll
use a class I understand why you want a
class
um we'll use a class okay
so here we need to create a new
directory okay so directory
okay this directory is just
a list of
string
I guess so it's just like this
um and then here we can say like
you can make like a file system map
uh the map is from
a list string to a directory
shouldn't be a list which I'll just join
it
I think here we can say
hi to ugh man I don't really want to
make string because we want to
once again Bob thank you for the raid
even if there's only one person
we appreciate everybody
we appreciate everybody in the Stream
wait what won't work oh
maybe a directory can contain files and
a directory well yeah I mean obviously
it can
as a tree okay so you want to make a
tree object
um
yeah but see like we need a whole we
need a whole
uh
actually do I need to initialize that or
can I just do that
only classes can have declared but
undefined members okay
okay
uh
file systems PWD dot reverse equals what
else
value update is not a member of maps
column map mutable
scholar collection mutable map
uh add one
ass one
that is the syntax like this is special
syntax in Scala for creating a temple
it's actually nice
oh I need to tell it it's a mutable map
required
oh I see that's fine
we'll figure out how to use the class in
a minute I promise you a class we'll use
a class
uh we're creating the file system but
what do we actually want to do
we wanna
hmm
there have to be a reference to
we have a small faster right
this is pretty like easily solvable now
without the class so uh
I'm sorry but object-oriented
programming stupid never mind if you
wanted a class you got scammed
I I think I can solve it now without the
class right so I just need to go like
four F
Ile system
um we wanna okay we need a function here
called get size
uh it takes in
a list string
called current working directory
uh
file system
dot gets
for file
uh
we only get the size of every directory
that we have to do
yeah yeah no object there's communism
man that's right
uh equals
we want to get size f
um I'll size
if size is greater than
a total size of at most okay so okay
size is less than or equal to ten
thousand
uh now we can write this as a map file
system.nap get size
um
no we want file system dot key dot map
get size
keys.com
filter size
uh dot filter less than or equal to
1000 that's all
like that's just so nice though
like I was gonna write like this
terrible looking code and then I just
wrote that and like that's much nicer
found unit required int oh because I'm
not returning anything okay
all right you know because we don't
actually want to do rad that's terrible
um
whatever we'll clean it up later
uh that's what I want to write int
equals zero
okay great let's get zero now
we're going through the files let's
print Ln
oh we're gonna need to memorize this
function
right
are all the files just hi is I the only
file
all these other files
that doesn't seem right
oh we have to make a copy of this list
um
so otherwise it's just saving a pointer
wait a list is non-mutable so that
should actually work I don't really get
that
you see the problem though it's just
saving that same stupid list every time
foreign
different lists but then like it doesn't
actually do that
hmm
I don't like that
the size of the directory does include
its subdirectories yeah
list is immutable
they're both creating a new list that
references list
you should like I think I know what's
happening
it's just using the same one every time
so we fetch D down there no okay maybe
this is actually right
we have a fuck
this a should not have that stuff
this is wrong
right
before you try to write this let's just
focus on this top bar
let's focus on this top part until we
actually have a real
uh Happy file system okay so there's
something else going on here
um oh
it seems better
oh it includes dollar sign LS
uh
see I wish there was
print after
all right fine I'll show you how far my
strings work
uh now we also have to add the last one
okay cool
okay
um
if
file dot take
3 equals d i r
then we have to get size CWD
plus equals file Dot
uh we want to like drop the first
dot drop four
and
those otherwise
we want red plus equals
file not split
get
0.2 inch
uh
okay no this isn't right
um
shouldn't reverse this
we can track it all non-reversed
a current working directory is fine
um
file.com CWD
okay Value Plus equals is not a member
of int
like I'm so functional boys
value dot get so
the right answer
cool that's the right answer
um should we yellow it it's yellow
not the right answer your answer is too
well okay we're wrong
foreign
thank you for subscribing wait so I hate
that I got the small answer right but I
got the big answer wrong
uh what I do wrong
let's do this slowly
okay uh four file system keys
I'm gonna print outline s
dot reverse
get size f
should we have to write down one line
right
um not happy
I found no
what
it's Arrow expected
but found oh I just wrote my arrow
backwards
all right the total size of directory E
I don't even understand why e is not a
dirt okay let's start with the fact that
he's not a directory
um that messed up
CDE I don't understand why that didn't
add it
should Addie right here
oh because e is a subdirectory which is
actually still correct okay so that's
right
um the size of directory a has a total
size there
total size is there directory D has the
total size of that okay so all of these
are correct
find all the directories with a total
size of at most
okay so at most and then find their
total sizes
as in this example the process can count
files more than once
yeah I fixed my my wrong pointing Arrow
okay but yet there's some bug when I run
the big one I should have written down
the wrong answer
it's always a good idea uh what I do
wrong
okay I remember to deal with the last
one
drop one is correct
that's correct
drop four we get the size of that that's
right
what can I do wrong
it's my bug
one city slash
yeah good view of numbers
why is this wrong
that doesn't give me a different answer
does it
no
we're CD in here
get that otherwise that otherwise that
files dot length is greater than zero we
add in the final one
let me get the size
hmm
no there's no tricks like CD dot in the
middle of the file
we're getting the small one correct
what happens here it re-enters a
directory
should be right
it shouldn't be a problem there
uh we can check for that
how do I assert the skull
don't do that
and check to make sure my start works
yeah okay
okay no re-entry
um
thank you for your Bezos money
uh
it's a little odd as I'm doing this
stuff backwards but it shouldn't matter
right
like I can't imagine a world where it
does
we're doing all the file system
the only thing is it possible that a
directory is never LS and we're supposed
to just know about it okay you see what
you see what it could be wrong like if
there's some directory
that you never LS but you can
understand it exists right
uh
okay this is what we have to do
the problem
yeah
okay you see the problem that's really
cute actually
uh
there can be directories and this is why
you don't want to really write it like
this
uh
okay we have to add it to this directory
if
file system okay
uh
you see you can like CD through two
directories
and then there's like it's there
multiple times
so what we have to do is if we C D do it
we know that it exists and that's a
minimum
but that actually involves
decently complicated logic
probably fix it with a few lines if I
think about it for a little bit give me
a minute
right because we have to like fill in
all like the subsets
see what I'm saying
just make sense to you guys
all right all right should we write a
class
directory
um we want the
path
to be a list string
and then inside the class we want to
have a
um
contents
fine you know what this is just this is
just the object-oriented God's Mighty
make
um let's create a method called add
files
and actually does Scala have a set
s or collections that contain no
duplicate elements okay so we actually
want it to be a set string
uh for adding files we may be a list
string
and then
I basically want to default dict and
Scala okay so we're going to say here
filesystem dot get or else
PWD new directory
say add files
files add file
or F we have to actually write this very
verbose and terribly to honor Java
um
it's not is it this
plus equals
we should actually probably call this
dot add file file in honor of object
oriented and actually in honor of object
orientedness we can just say files.4
each
uh this dot add file underscore
okay we have lots of bugs
missing argument for parameter path in
directory
uh every day
should we need the path I don't think we
do I think it's actually already tracked
outside
okay end of top level definition but we
shouldn't have an equals
these ones need equals because they're
methods
classes are not methods
value is not a member of set string
X we need a mutable set
not found at focus called file
oh this is very this is very Java Java
would be proud of us
file system add one
you want to just copy that it's a little
bit I'll do that we have to copy that
value map is not a member of directory
you can say get uh
contents
okay now for some reason we get the zero
we shouldn't be getting zero
oh no okay because we don't actually
want it to be get or else that's wrong
um I guess we can say file system
PWD equals file system get around so no
but that actually doesn't return
see what I mean this isn't actually uh
exception in Maine no cat
is this cat would fails
which get fails
get size again here this fail somehow
okay
well they don't all exist for some weird
reason
what you're trying to get that doesn't
exist
D why doesn't D exist
it should totally work I don't
understand this
oh
oh it's this crap again
um get or else is kind of wrong
you see what I mean
like this isn't really what I want
map we want like a get or set
skull
oh Jonathan Blow rated all right how
many people we got oh 394. we are coding
in Scala because today is a beautiful
day in lovely San Francisco we're
drinking tea and we're coating Scala
we're taking our time we're chilling
we're hanging out
you know
um oh get or else update
love you Scala
oh this is sick Bros is that exactly
what I want on one beautiful line of
Scala
no
almost
oh no it is it is it is it is it is we
just need to copy this one beautiful
line down here get or else update how
nice is Scala how
how
privileged are we to live in a world
where we have Scala and we can write
beautiful I'm not even controlling I
actually think that's absolutely
beautiful syntax like get or else update
that's exactly what I was looking for
you see what this does this is like uh
so python has something called
collections default dict this is
effectively collections default dect
it's a little annoying because I have to
if I use it in two places I have to copy
that
but I can probably like bind a method
using some Scala magic and it'd be
wonderful but
now we have to fix the book
so the bug
is that
there are directories
that
this basically adds a directory
but it may not be added to the file
system
so let's just write here file system get
or else update add file
um and we want to say
dir plus L sub string five
same answer
but that is the basic idea right
whenever we go into a directory we need
to tell it that that directory exists
you will convert to Scala if you go
through the exercises of the red book
functional programming and Scholar
second edition man everyone a comma is
going to be so pissed when I come back
and talk about how we have to move to
Scala
okay that gives me the same answer
which I didn't expect
I expected that to give me a different
answer
am I going to stupidly submit
it's exactly like defaulting yeah am I
going to stupidly submit the same thing
I mean this is just like when I recurse
into a directory I add it and tell it
it's a directory
it's correct
okay do we have another mistake do you
want to just stupidly try to resubmit
the same answer
like I just feel like it's right I I
don't get it
your answer is too low make sure you're
using the full input data
I mean
I guess
the only other thing I can think of is
this
no
that'll just create the directory so let
me iterate through it later it exists
because we know that directory exists
submit it one more time yeah I know I
know I know it tells me whether it's
lower high
am I doing wrong
okay well we should first off refactor
and make this a get size
um no because then we need access to the
map which we don't have
I'm a little worried about my use of
substring everywhere CDE doesn't support
slashes in the thing does it there's no
like
it looks in the card directory for the
directory named ax and makes it the
contractory
it also quits telling you
after your third attempt that's funny
oh
I mean
I don't think so but like no it's not
because
okay well first off here's an
interesting thing we don't actually need
an add files method
I think
we can just say if it's not equal to
that
we can
here instead of files is kind of useless
we can just do this
that's actually nice because we don't
need that method anymore either
we don't need that that can all be
deleted
the same wrong answer though
we should note this
greater than
total size of at most
do you handle directories that can have
the same name I do because that's an
entire uh
that's an entire uh path
so that shouldn't be a problem
if we like go down we go back it's it's
adding the file
we get size we drop the dura space
we added to the current working
directory
otherwise
we split it at the space we take the
first part and we take the uh
the end
but we're on the seventh problem
okay we know the answer is greater than
that
can we just like see anything being like
raw
okay
we LS the base directory
that's how big empty list should be
uh I mean I would imagine that you're
really supposed to memoize this and
that's half the point of this problem
uh
uh okay
let's just for every file
let's print
CWD dot reverse
file
would you print out like all the files
oh sorry
file
it's not falling back to the address to
Hash right
uh I hope not
we can fix that if you want
um
all right just make everyone happier
that that would be insane if that were
true
but also again like lists are immutable
oh maybe drop
we'll just we'll save it as like a
really nice
[Music]
um
save it as a string if people incest
okay uh
let's just write a quick little helper
method uh Tudor
let's stirring
equals
uh
star turn
all right this is absolutely stupid but
great
um get size
CWD less string okay so we actually just
want this
now we'll get size CWD Plus
slash plus file drop four
uh we don't want to do any more
reversing
[Music]
um
none dot get
I wish it would tell me what I couldn't
get
it's taking me way too long
to dir PWD I like that
it's nice it's making real directories
problem here and yet
oh why did it make slash slash d
oh good
uh oh
that's if we're in slash
slash is interesting slash is a special
directory
uh do we want to always put one at the
end
no we don't
um we can do an answer
if cwt
I mean this is just less clear I I don't
understand why this would do it uh
need to print
okay the answers right
it's the same answer
what did I do
what did I possibly forget
the total size okay
here there are four directories
is it bigger than the maximum in no
I don't think so
did I copy the entire input file yeah
I'm sure I did
I have a script to download it
yeah that's right
I have some bug in my ankle though I'm
sure
for most directories a and d e which is
an a the final characters also contain
files of various sizes
total size of each directory
total size of a directory is the sum
of the sizes of the files it contains
directly or indirectly we're adding
every direct directory we're adding
every file to the unique directory that
it's in
you can have directories with the same
name in subdirectories
no I can't
no that would be ridiculous
I can't have two directories with the
same name
I can have two
directories with the same
I mean yeah in the global file system of
course but I can't have
if directory already exists I don't
think
okay all right we'll we'll keep tracking
for this already exists stuff okay
um
no might yeah
I'm also adding subdirectory size to The
Parent Directory yes definitely
paths are unique guys I'm not an idiot
what did I do
okay I add
that
the directory
wait a second let me think for a second
here
okay
I create this
new directory here
double counting size for a parent
yeah what do you mean
foreign
forgot to change current working
directory when I moved back
yeah no I mean sometimes they'll put a
trick in it's probably a trick in this
one see this this is sometimes I just
totally bomb these and I just like miss
something
uh
finds the directory that contains the
current directory and makes that
directory the current directory
foreign
it's a set
the sub string looks fissy I agree the
substring looks fishy
I don't I don't disagree with that
uh
check how many directories you got and
double check with the input yeah how
would I quickly find that
because it's it's like multiple levels
deep which is kind of tricky
okay
um
[Music]
sometimes you know
I just really I bomb these
that's what I bombed
what is the max size of a Scala ant I
didn't mess that up did I
it works it works with a test example
uh
two longs
though I do find it interesting that my
my number is too short so this isn't
even right
no no no no we're not going to start
we're not going to start looking at uh
We're not gonna start looking at answers
yet we can fix this
okay
all right
Namaste let's
Let's Go full object oriented you know
class file
VAR size and the size is along
[Music]
um
we're going to rename this to add entry
right right you ready we're going full
object oriented all the Java people will
um
if
entry
oh whoa wait now we have to create hang
on hang on hang on hang on we have to
create a class which encapsulates both a
file and a directory
so we're going to make a class entry
foreign
and
an entry
uh okay
Scala extends
extending a class in ska
ah file extends entry
stems entry
file has a size long witness we need to
put that in the Constructor
all right we're just going to write it
so beautifully that it has to give us
the right answer what do you think
class file size
long
file uh size long
this dot size equal size
no I don't think this is exactly what I
write hang on I gotta think about my I
got to think about my class structure
got it you gotta think about your class
structure okay
so when you add an entry if entry
Dot uh take three equals dir
oh we should track the name of the file
too you know just even though we don't
actually need that I think I think it's
good because we want to write this code
so beautifully
that uh you know it just can't be wrong
all right so then
yeah
hmm
this isn't exactly right
okay maybe we do just want this on
directory
Scala
Union type can I do a union type
so the contents of a directory
is a mutable set
of Union
of either
directory
all right all right you know what this
problem was just the object-oriented
God's punishing me for not writing it
very carefully
I'm curious what the bug was uh
so if entry dot take three
equals equals dir
then we are going to create a oh
directories have names and directories
have contents okay
directory
[Music]
name
[Music]
string
uh
oh crap how do I even get all the
directories then
our directories have parents too
well that's that's that's deep man
that's deep
blue directories have parents okay okay
okay okay okay good
parent is a directory
I really what was the bug
um use case classes oh you're right I
should use cases definitely
okay
um then we also have a method called get
size
and get size is going to 4E in
uh
let's call them entries
oh actually this one we can just say
this dot entries dot map get size
because a file also has a method called
get size
get size returns an INT and it returns
this dot size oh you've got to love look
at that accessor syntax bro
look at that accessor
oh yes oh I love I love object oriented
don't you don't you can you use an
object oriented just a wonderful way to
be
an equal sign there
yeah we're going polymorphic
oh
entry string
okay we're gonna say entries Dot
oh plus equals
um
why is that highlighted like it's angry
illegal start of simple expression okay
it's a complex expression it's directory
oh yeah okay we gotta track the parent
directory
this dot parent equals parent
directory uh entry
uh we pass in this
and then the name is the name of the
directory is dots
lit
else
file
um
I mean I could just write it like this
it's kind of terrible but wait okay so
first we want the file first has the
name which is that and then the size
that we gotta track long that might be
very big files out there
all right
um
now now
we're gonna not track it like this
because this is terrible this is
terrible we're in the object oriented
world
so we're going to have something called
current working directory
directory
equals directory the parent is actually
an optional directory because there may
not be a parent
so for this we're going to have to do
some of this right well I'm learning I
know I know my Scala boys I know I'm so
happy I'm so happy I had this bug and we
had to do this and there's probably
still going to be this bug because I
probably still got it wrong but at least
we got the joy of object-oriented
programming
okay and the name of the root directory
is that okay now I'm going to go through
and when we see a CD
what do we do
well if it's this
um oh we have to make a new directory
called root okay
root
you say CWD equals root oh yeah yeah
this is good object oriented shit
okay now for this
we say
CWD equals CWD dot parent oh come on is
that fire or what is that fire or what
we were trying to hack when we should
have been coding like Java programmers
oh I love Java it really really okay now
this is when it's going into a new
directory so when we're going into a new
directory of
this is a little harder okay
we're gonna have to say we should have
another one add subdirectory
a method
um
name
string
we want to add a subdirectory
uh we're going to say entries
oh and actually this should return
uh this should return the subdirectory
as well
this dot adds subdirectory
entry split
entries plus equals rat
I shouldn't just call it add
subdirectory I mean I guess that's fine
okay fine whatever
um okay so here we say CWD equals CWD
dot add subdirectory
and we're going to do L sub string 5
here
that's for that
um for the ls we don't have to do
anything
and then otherwise we're just going to
CWD dot add entry
okay did we write it correctly
let's find out
value update is not a member of file
needs more tea
oh yeah come on who's excited about
who's excited about this we might have
to actually do real polymorphism so we
can call both get size without using
either type
it out
I didn't wait for the water tomorrow
all it needed was a tree class I can't
believe we got a thousand people
watching this
I love you all
okay
this is beautiful object oriented code
now
all right
um
so I think that should be right
oh and we can even write our memoization
in there
all right
value update is not a member of file
Gala class
wait a second oh oh this might just work
like this if we just do this we might
not have to even have that
all that is really nice
parent
option directory name
oh Scholars really got syntax figured
out I'm 90 that's not even sarcastic
like I actually think that's really nice
of that if that does what I think it
does that's that's really nice
um hang on so when I get parent I have
to do a get
and that will fail if the parent doesn't
exist and that's fine because we have to
extract it from the uh
okay required int oh well of course
we're tracking size and longs
hmm found unit long
where's the unit not a unit
uh I'll add some
still wrong
required either directory file
I don't think that works
oh oh we forgot something about a file
actually no file lives in a directory
and that's fine that's implicitly
tracked
do we need an accessor
okay we're at oh I don't think this
either thing is really what we want
um
Scala
Base Class okay let's write an abstract
Base Class called entry
or do we want to trait
scholar traits don't allow constructible
parameters
great
can I use a trade as a
traits
let's call the trade sizable
call the trade entry
an entry has an abstract method called
def get size law
now we're going to extend
extends entry
then
entry
Now entries extends entries I can't
believe I tried to use an either type
that's not beautiful Java
full Java okay is that better well good
less errors
okay required entry long oh because we
have to do that duh
entry must be called with
no argument
wait what
that's not right
oh huh
this is the same as writing this right
how is that different
point
I don't really get that why do I have to
call it with I thought there was a save
in sky but whatever
um yes and we
parent can't be accessed as a member so
we're gonna have another one called get
parent which turns directory
um
oh should I just get rid of that
can I just do that
cool
right found unit what oh yeah that's
fine
uh parent dot yeah
we can access it this is Java
okay okay I think we're building a file
system now
all right
um now we need to get all directories
how do we get all directories
um yeah
sub directories
turn a list of directories
do uh
entries how do I check the type
that might not be doable
what if I just do
this will include files as directories
so we don't actually want to do that
this is going to get me the entire file
system
make it a sealed tray what's a sealed
trait I don't know how to do a sealed
tray
uh we're definitely going to need that
though okay so let's do
entries.map get entries oh wait I want
to do flat map oh yes Scala flat map
this style entries.flat map
um and this is going to return an empty
list
require entry iterable once
to start entry stuff flat map get entry
where did that work
no no we're not using any monads don't
worry we're using beautiful object
oriented Scala
uh found entry yields iterable once
returns a sequence
didn't work
oh
requires list entries is actually a to
list
nice okay
now we can say root dot get entries and
we can have entries and actually also
this is a Val
um don't make it a bear if you don't
need to
okay an empty list well it's not exactly
what we want
that's a little bit sad it was a very
anticlimactic all that work for an empty
list
I wish we had a debugger
that we could debugger
okay I mean it's definitely returning a
lot of stuff
for some reason
the root knot doesn't have stuff
there's a beautiful object-oriented
scholar programmer from the San
Francisco Bay Area Vapor chess
Enthusiast I love it am I looking like
Jack Dorsey
foreign
I'm devastated that this list is empty I
was really hoping it wouldn't be empty
let's try something like this
println root Dot and let's also go back
to small
okay so that has some stuff
oh I know the problem
of course nothing's ever going to return
anything
because we you have to think about your
base case what's your base case here
nothing
but if we do this colon colon oh yeah
now we're talking okay now why did we
just get directories enough oh that's
just
we have to naming things correctly is a
really important part of java so they're
not actually get entries
their directories okay now why do I have
so many of them this is the oh no I'm in
the big input okay where did my smaller
put go let's go back to the small input
directories
get entries is not a member of Entry yet
because get directories now
and that's why file doesn't return
anything it returns knowledge you really
put that in the abstract class but we
didn't do that
why are there so many directories I
don't really understand that
but let's just try it and see if it
works
parental and directories
dot map
okay we want to get the size
uh we want to filter the ones that are
less and then we want to
and then we'll put that all on one line
oops
okay that's a good answer
now
let's see if this works let's see if
object oriented programming delivers or
do we get the same thing
oh look we got a bigger number
oh yeah
what the hell was the bug
I'm adding the middle directories uh
it adds them to the map it should find
them
object oriented okay
oh
I missed one
wait I would love you know what I'm
excited to read the YouTube comments on
this will you guys tell me what the bug
was all right let's see what part two
was now you're ready to choose a
directory to delete all right
um
find the smallest directory that if
deleted would free up enough space on
the file system okay
the total disk space available to the
file system you define a directory that
you delete
find the smallest directory that if
deleted okay so this is just this is
easy
um
okay uh
okay so we have to get the total size so
first we have root dot get size all
right let's use our object orientedness
to to get this all correct
okay
let's do this beautiful
object-oriented programming man you know
what this was just God punishing me for
not using object-oriented programming
we have to this is the total size to run
an update you need unused space of at
least
three thousand so
um
resize
okay and we'll have another one called
needed size equals
okay so that's how much size we need so
now let's
filter
greater than or equal to
needed size dots sword Ed
I got one get zero
oh and then we have to get the name of
the directory
okay value get is not a member of list
long but could be mount
uh what
okay we actually don't just want to
return get size here we want to return
a couple
let's do that actually let's use the
special Syntax for tuples
okay
so now we have oh no no we don't want to
say x dot get name
do we have a get name method
no no
no name but that's not public
did you mean oh no we have to can we say
that this is a public
oh no because traits don't have
oh that's terrible okay we have to write
get name
do it object oriented do it correct
this is Java
of course we need a function called get
name that Returns the name
value name is not a member of Entry
we're going to need to add together for
the name to our trade because both
directories and
um files have names
oh oh oh oh oh oh no we have to special
case this okay because if
if
parent
is none
then we have to return slash else we
return the name
yes that's much better good don't write
bad code
why is it returning that
return a0 here that's a bug and even if
that bug doesn't affect our output we
have to fix it because this is Java
why why is there an empty a here that's
terrible
wow I can't believe this code actually
worked this is very buggy
which created a new subdirectory we
didn't want to do that
we should have checked to see if the
directory already exists
that's pretty brutal that that just
works wow we had we had so many bugs in
our object-oriented code
um okay let's sort them
uh Scala sort
okay
dot sort by
we can try sort it and see what we get
but I don't think that's what we want
we want sort by attribute
okay sort by X I think it's called I
don't get the dot tube
okay good now we're sorted by that
now we want to filter
where the line not line say
can I do that
good
and actually we should write this code
better it should be written like that
that's much better
okay now we just want to take the first
item so we'll just say head we say head
all right and now of course we just want
to print out the name now we should
print out the size just for for good
measure
the answer
issr let's go
not the right answer
okay well it's not quicker Greg SSR
you have FN in two places
oh
oh What's the total size of that
directory oh sorry
okay so the answer is actually this
that's fine
I'll have to wait a minute and then just
do that
but yeah so the answer would have been
that
wait so we didn't even need the name so
all that get name stuff we didn't even
need
I'm glad we've improved our object
oriented stuff all right we have five
seconds left to wait five four three two
thank you for watching my stream today I
appreciate all of you we're in a great
mood today we're in beautiful San
Francisco where the crime is is is just
it's just a part of of of the city it's
just it's it's it's kind of like you
know that episode of uh South Park where
Mr Garrison makes the super efficient
bike but it like you know dildos you uh
in in your ass while you're riding it
like yeah it's just part of the bike man
it's just part of the bike
uh
yes uh let's see let's see let's let's
look at myself a little bit while I talk
um
uh I want to see in the YouTube comments
someone figure out what my bug was and
why my code didn't work for so long or
was it really just the object-oriented
Gods asking me to write a truly
object-oriented solution to day seven
I don't forget to raid someone uh do we
have do we have to we should we read
Jonathan Blow back is he streaming or is
a lot of luck streaming
uh or should we or is Gotham chess
streaming I've been watching a lot of
Gotham chess on YouTube
um
can I paste bin the code
uh yeah you want this crap
all right
we'll make that we'll make that URL big
can we make it big
there you go
the secret
if oh Scala Works wait also I try FP
scholar all right we gotta check out
that book
um
all right so whose stream is lilac
streaming
uh we have uh J blow twitch we have
Gotham chess twitch
the internet
offline
offline
uh where's your Twitch
how come that doesn't come up when I
when I when I you know you got you got
just some SEO issues
um twitch dot TV slash J blow
no no one no one's streaming
oh we have no one to raid not I don't
know any of the other people I would I
would send it to Gotham chess you know
you gotta you gotta you gotta keep it in
the family I gotta spend more time on on
Twitch and
watch another programmers find my craft
every day we get a little bit better
um
and that's the key to success really you
know the key to success is this if you
have to climb out of a hole if you're in
a hole
and as long as every day you climb more
feet up then you slide back down
Jun paid me money so I you know I love
money that people pay me money I'll do
whatever they want
what about NASCAR CNN no who wanted
coding tutorial sorry I was in the
middle of a very heated game of League
of Legends that I did end up losing
tragically but it was close and we could
have won
now I'm kind of tired guys all right I
do all you all a coding tutorial but
what I can't do is come up with the idea
like I was going to teach you how to
count the alphabet PHP you can do it
slower if you want learning so there's a
problem where this doesn't count to two
that and that's because when we echo you
know dollar sign Z plus plus that
doesn't work because you can't you have
to assign a variable to that but if I
echo dollar sign a feed that Z but if I
actually do a plus one especially a a so
when you add letter and PHP I don't know
why I lag am i lagging lagging you guys
are lagging I'm watching my stream right
there
she Street was like I all right guys I'm
going to sleep
I promised you coding I feel bad I feel
terrible but it's so late no you know
what I'm excited though I'm gonna brush
my teeth
let's go get a toothbrush and I'll brush
my teeth oh it's Jane
that sounds good
alright guys we got the toothpaste and
the toothbrush
we're gonna put toothpaste on the
toothbrush steer very carefully in view
of the webcam I really like this
toothbrush because it has a timer for
each quadrant of my mouth you guys will
see so I turn it on I asked the lower
right corner my mouth
I live alone there's just a lot of
people around here usually there's
actually one of you intern clothes here
I know you listen see how mighty so I
should stop a little bit that's the
signal to switch quadrants
what do you want me a code in PHP
hey Rick when there's two fucking stream
oh wow you gotta tell me what the code
not found hard
my hands touch down because of how well
how can anything
again after the Gaussian Oh
he's watching his done
okay right again to match the Gaussian
distribution I'm not really sure how to
do that what do you mean by that
okay so we have our beautiful Gaussian
distribution I'm not sure what you mean
by I don't know mighty MUX it's all
public if you go my github geo geo
textile slash configuration
you
that work
did that come back how do you develop
this personality I don't know you guys I
knocked with a watt and the phone into
the wire on my computer okay so I'm not
sure what you mean by again that can
output that Gaussian distribution let me
think about what that means all right so
when again you have a generator and a
distributor at a discriminator so each
point you want to know whether it came
from the real distribution with a fake
distribution hmm I mean this is a cute
toy exercise to think about right
I mean the problem not tensorflow
like this isn't really gonna work
because don't leave one dimensional
right
I think ganz only work in like really
high dimensional space that's right so
if you think about the manifold of like
an image right where you think about
each pixel is a dimension the manifold
is extremely like weird looking and what
again is doing is making it look we can
play with that kind of stuff let's think
about it like well so the other downside
is I don't really have a GPU in this
computer maybe one day we can stream I
have I bought an external GPU thinking I
could do machine learning with it but
it's very hard to get tensorflow GPU on
the Mac
[Music]
so this is a thing
okay.we training a neural network to
sample from the simple 1d normal
distribution let DNG be small three
layer perceptrons each with a meager the
discriminator takes out
okay okay this is doable okay we'll
think about this a bit no no there's
more fun I like this I like this problem
don't go to sleep okay
uniform zero one okay so the goal is to
transform beautiful um zero one
normal
[Applause]
should be able to use CPU tensorflow
no I don't think I can pick install
tatse for GPU I don't think what's gonna
work this'll work
wait to my mother break again
okay
[Music]
no this is stupid
it's just using why does this keep
alright assume every night pretty much
get to Nathanael we got focus all right
so let's not look at too much of this
code I'll be streaming tomorrow night
probably playing Morley legends such a
way that the mappoint clustered densely
where P data X's dense G takes in Z
yards fake data X so that's an easy net
to think about should we use cross for
us makes life easy
new tutorial here off the top of my head
[Music]
input is 1 they said they had 11 in here
that's telling them and then obviously
my activation can't be softmax with me
output so well let's first the first
thing that we should try to do before we
do Gavin since we can cheat on this and
we can actually always just get a look
up it's big Gaussian I think we want the
probability distribution yeah the
cumulative distribution function how do
you do this how do you sample from a
gaussian normally i don't know any RFS
like this is not an obvious thing to do
especially since like once you get to
the long tails of sequential what you
get to the long tails of the gaussian
right okay so there
the probability density formation how do
you sample let's just look at sampling
from a Gaussian me like old school way
to do it
Wow yeah the inverse distribution
function but like there isn't a normal
way to do this
no you won't
Oh JSTOR fuck JSTOR sure these authors
are great put J's toys evil guys can
look good love to find out why Susanoo
between zero and one PDF what value of x
will P of X equal P be the equation no
yeah okay that's a negative two ratings
so that's wrong
Wow I don't know anything about coming
yeah come on related they just use my
name one of these days I'll sue them
like okay so you can see what the
functions are right
[Music]
hmm
meanwhile the discriminator takes an
input X and outputs a likelihood of the
import belonging to P data
well you're already telling me that I
need a way to sample for my distribution
so that's a scam all right like you see
what I'm saying like I would need a
sample from my Gaussian distribution in
the first place I mean I guess I could
do that with numpy
she's a code for this does that work
so I want the inverse cumulative
distribution function
Oh
this is hard
now let's not look at that stuff because
it's cheap okay so if you want a sample
from the model and then I assure you it
goes well you can just stick in believe
that random is Python is the step is a
normal sample right switches have to
play along at home okay when we're
actually best target distributions all
this I was copying the definitions I
don't read their code sample of a noise
distribution X
so I sample right now my mom is a real
tap them okay so now when we pass in
this random distribution in maps to this
our target distribution is they have a
name for this shit
so you got rhythm like I'm tired okay
so that's the real distribution now we
need a discriminator so call this one D
she got four decks they said eleven way
side eleven to their god we actually
like freeze the weights of some of these
don't we
listen till when I use Adam it's too
complicated
inappropriate serial walrus
inappropriate this is a PG rated channel
we have family-friendly
one day I want Kellogg's cereal to
advertise on my twitch channel and if I
ever want Kellogg's we have to behave in
a family friendly manner Kellogg's
cereal but you buy frosted flakes
totally the tiger and Michael Phelps
smoking a ball ask can't say my thoughts
about goodbye that's not family-friendly
yo knew everything about them that's
crazy so what do we want to do we don't
care about the discriminator predicting
correctly
what is the gam trick again okay I don't
want to read that cuz we're trying to do
it from scratch that's thing yeah if I
think about this a little bit that it's
fine okay we want the generator when we
go through of the generator and the
discriminator
[Music]
[Music]
[Music]
[Music]
- pol has know how to do tendon right
nose easier
cow lodge you guys Kellogg's one day
Kellogg's will sponsor my twitch channel
and then I'll finally make money off of
twitch fuck them fuck that me I can't
say I don't know what the what that
means
I have family-friendly channel guys
family-friendly o x equals MV dot or ax
oh I got emails I don't know what any of
that stuff means
alright let's say H oh cool change
alright good all right let's
discriminate a lot we love
discriminating don't tell anybody
alright good train so good
[Music]
- sighs will default to 32 that party
will attempt a 410 at box
oh good oh look train so good
oh look at that okay all right um let's
just train for - okay so that trains the
disco thats right this is a Christian
Channel
I know that one I so we train the
discriminator now train generator this
is a lot harder I think I just have to
say something why D D equals sequential
GD is like that eg that compile all of
this is gonna work
don't be sad freeze the weights this is
what gets annoying like I want to back
prop through the discriminator but I
want to freeze the weights you know I'm
saying Christian channel YX point okay
um all these weights leave the light on
the freezer layer layer dark trainable
let's do it the lair level and endured
the mod xi d dot trainable not like
apply it to all the lair that'd be so
nice oh so much okay I'll say that
fanboy equals so change generator okay
what do we want to train here basically
on my fake samples well that's probably
a little stupid too because it should be
non stationary distribution dumb anyway
I think we just want to generate random
data we're gonna use the random store
before actually I don't want to say Gd
that's right
let's compile the model wait whatever my
mom like elite that I'm such a noob Oh
actually no nevermind I'm going on a
date tomorrow
no screaming sorry wow you all show up
for this stuff flow attribute has no
shape of course floats have no shape
just like try to shape a float it's like
alright ya gotta make that Z capital
brah
alright is the loss going down oh oh
yeah look at that loss
[Applause]
we can put the weights
[Music]
[Music]
[Applause]
[Music]
[Applause]
[Applause]
[Applause]
Oh
[Music]
[Applause]
[Music]
[Music]
[Applause]
so histogram right guys never gonna
always been again
[Music]
wait so that was to go through
[Music]
it's totally different
[Music]
[Applause]
all right this family guys you should
forgive me it's late you don't forgive
me
well Wow look at all these people y'all
showed up can't leave now we got a
streaming audience oh this isn't a other
song yet another good one anytime this
one
[Music]
[Music]
1990-1999
[Music]
[Music]
and makes the sellout that ring is sell
out I know a sellout when I see one oh
boy
[Applause]
[Music]
[Music]
[Applause]
[Music]
[Music]
[Music]
[Applause]
[Applause]
yeah
[Music]
alright that was perfect timing I think
we're good now if anyone wants to play
along at home I'll throw this on a guest
I'll throw this on the paceman or
something yeah that's too hard never
mind I take it back I lied bro it's liar
again I know you alright so that's what
it starts looking like the goal is to
make the orange look like the blue oh
that's better well it learned the mean
can learn the variance
alright guys I think that might be what
you get tonight
be warned joying alright so let's see
after it learns for one thingy okay now
it went over there again is garbage now
I'll use I'll use better than
Oh
all right it's getting stuck in this
like shuffle XY to be right no try a
couple app box we've done trainable
equals false
I mean maybe we want different randoms
Shh
no we do want different randoms yeah no
we doing different atoms
that's adapter
I'm tired that's something
Oh
mmm
and he's Adam I should all be predicted
to be one even though they're fake
because that's what fights against
[Music]
yeah
my only concern is that generator
trainable thing is still changing the
way to the generator see now look I try
to trim the discriminator and I can't
learn anymore this is a great problem to
understand dance thank you - whatever
your name was trumpet Jean your bro this
is a good problem I'm gonna layer in
there dude deep learning
so the goal if this thing works is that
the orange should line up with the blow
okay so look slightly unbalanced these
things are apparently incredibly painful
to tune
let's turn the learning right down right
and yeah MSE is all fine
there's only zeros and ones and gas man
which is fine
Wow someone changed PLT has two vets
those tops piss me off bins integer
sequence
not work oh yeah
that's actually exactly a lot more like
what I would expect as possible our plot
was just broken
it was crappy what's not learning that
was learning
my only concern I guess is that it's
changing the way to the discriminator
[Music]
I'm having this problem before with
cross games it just doesn't listen wait
there's no way to like get that high so
I can actually put the weights no
[Music]
function
actually this is bullshit
[Music]
this cracker said d dot that wave will
say once you have the weights the
discriminator are changing
okay that's good that's a lot of weights
we shouldn't change
my job
okay that works cans are just really
unstable
well yeah it's just more
oh look I'm going to converging Oh
exciting now it went past converging oh
no its continuing to go oh great okay
right faster
that's background one
okay looks like gams are unstable
garbage maybe some wrong
don't worry about you hi
let's go
all right cans are in stable garbage I'm
gonna sleep I'll pass this to you guys
without poops a closed twitch guess
without github
see they removed anonymous Slough sorry
I lost the chat hey spit what's hast
been this any good he's elegant paste
new can I Drive file here no ghost bit
private there red tree ipfs bet code pad
if there's any good pipe
so more tech cement oh my god these are
the lowest quality things I've ever seen
let's try a spit again what did I have
fun with hey spend save
I've got CoffeeScript got it wrong huh
cute though I can just access it as
anything very sensible okay if anybody
would like to play along at home there's
the link enjoy
I will twitch tip anybody who makes it
work to post your haste bin tomorrow it
kind of worked for me and will read the
thing thank you for joining
that was twitch programming it's 2:00 in
the morning I'm gonna sleep glad people
morning
Bros good
morning all right now we are going to
have to take a break at some point to
shower cuz I didn't shower this morning
yet but I wanted to get on
stream
uh who's ready to who's ready to go
let's let's go let's
go all right so we're over here on on on
Kafka Kafka I'm quiet and this is my
Cuda driver I've been slowly working on
it every morning putting a little bit of
time
in uh and
now it
can run a program I'll show you the
program right here um yes I I did write
this program
myself uh let's just install
this so we can have some syntax
highlighting good morning good morning
good morning okay so it's uh it's
running this
program um it takes in three uh values
this is written in
PTX which is nvidia's uh like highlevel
Assembly Language that's stable across
all their
platforms um and then you can compile
PTX to
SAS uh which is in nvidia's lowle
thing so I I did all this off stream I'm
sorry to everybody I Didn't Do It on
stream I just you know I do it a little
bit every morning and I'm not going to
I'm not going to log into twitch you
know we don't have twitch kind of energy
uh it's Saturday we do have twitch kind
of energy today uh good good morning
everyone I'm I'm I'm happy to have you
all here joining me on this beautiful
Saturday
um we wrote the driver in
C++ uh but you should just pay attention
to know that uh yo is your first time
welcome welcome uh if you all say stuff
real stupid today we're going to have to
put subscriber only chat on cuz you all
know that subscribers for the most part
are better people than nonsubscribers
um all right so we wrote this little
program um it's written in Nvidia is
Assembly Language PTX and here we can
assemble it uh I had a whole thing where
I thought that SAS wasn't actually the
low level language and it was being
transpiled but I realized that I didn't
set my GPU name to
sm86 uh so for those unfamiliar
with uh Cuda Cuda has different compute
levels so my
GTX uh we're doing this on a machine
without and I hate that Nvidia doesn't
print this anymore
wow I can't see the whole name of the
GPU
um okay
well SMI
DL no you
see you can't see anymore that it's
actually a a uh 3090 TI be away viia SMI
print
full GPU
name all right just
just oh man yeah I got to get the
sneezes out bro got to get the sneezes
out all right all right
um format switch is missing so we'll
format it in uh in
CSV ah what what's up with that
face how did you all know to make that
face did you guys practice this before
the game
show
um oh sneeze face I say all right so ah
yes now we've queried the name of my GPU
you can all see that um I didn't cheap
out on you and I bought a RTX uh 3080 uh
TI uh we still have the stuff that I
bought with the subscriber
money so oh yeah there's that okay so
this is what sm86 means that's the
GPU
um hi Georgie I hope you're a
girl if you're not that's
creepy
um so uh yeah this compiles the
PTX and then we can coup object up and
you can look and this is the SAS code so
this is actually what it's being
compiled to uh these things these things
these things these things these things
okay so now we have the code how do we
actually run the
code um and uh there's no girls on the
internet there's definitely no girls on
4chan why the fuck are you
here that's good advice all right I got
to remember not to read chat y'all just
bait me and we got programming to do
today got would be here if we didn't
have programming to do no we got
programming to
do
um every night PR
night someday guys I want to be a rapper
you know but I want to put effort into
my rap career I wanted to come easy like
drink you know just be on De grassy
which was a terrible show by the
way um welcome back to beefing with
Drake
hour ah
why are you not using co-pilot you know
what you just you just got subscriber
only you just got subscriber only get a
jet ski that's it's a good idea I I do
have like there's a beautiful ocean
outside my house I don't know if you
guys can see it you probably can't but
it's pretty beautiful okay uh so this is
a SASS and you can dump it this is
nvidia's Assembly Language so this is
the actual bites of the program
uh that run on the GPU so then here's my
GPU
driver and
um I'm sorry about the
uh it's got to kind of be
refactored but we reverse engineered a
few we didn't even really reverse
engineer them we kind of just read the
documentation
so you can see that this is a dma copy
it dmas from source to Des this is a mem
copy which can copy from a host pointer
uh this trivial is a trivial program
this is the program that we were uh no
that's the sax program but this is the
program that we're using here you can
see down here we load it in uh then we
copy the program to the GPU all right
let's start cleaning this stuff up um so
we don't need any of these malic and we
don't need any of this test too don't
hard code addresses
okay so this here uh set
up command C
so gpus have these things called a
command CU or Nova refers to it as a
push buff uh where we load up all the
commands and then we actually send that
to the
GPU um this here reads the program load
program right it's just it opens a file
fseek F read F close
right uh this GPU base you can move
around but we're going to put it right
there because it's
simpler um this is a separate test that
we don't really
[Music]
need yeah I'm going to get rid of that
we don't need it anymore and then I'm
just going to change this GPU dma copy
to move from uh let's say 0 to 14
okay into GPU memory
um these are the args to the program if
we go to simple PX you can see that the
args are right here so I just made a
little struct for
them um actually this program is too
complicated we're going we're going to
make a simpler
program okay so we actually don't
need this we don't need this uh that one
we do
need these ones we don't need this one
we need
uh we don't need that anymore we're only
using two
RDS I don't actually know if that
works you going to complain Parson near
what line a oh cuz I have a Comm get rid
of that Comm let's call it
value okay so all this does is stores
value in pointer uh that's illegal
because that needs that don't need that
label anymore
great still works okay so all this is
basically saying is star pointer equals
value for those of you familiar with C
Syntax for those of you not familiar
with C
syntax uh you know you can go watch
uh what else they got on Twitch go watch
that
um let clean this up a little
bit we're working on making it clean cuz
you know clean code you got to clean
your room boys you got to clean your
room all right
cool so you can see this just reads
pointer into rd1 this reads value into
R1 this converts to Global actually
let's just try not doing that and see if
it still works uh by the way to be clear
about what this program
does oh let's go back to before before
we try to remove more things uh we'll go
back to the uh data sheet you can see up
up top here oh this is little
Trash you can see up top here this is
the program so this is like the real
lowlevel assembly uh it looks like the
things are actually uh the bytes are
actually there's 32 bits so it reads in
these two parts and then it does a
global store uh I don't know what this
is that doesn't look useful and that
doesn't look useful so I bet we can
actually take those lines out and I bet
they don't do anything
um exit and then this is just a branch
to itself this line Looks useless and
this line Looks useless I don't know see
this this this makes me question a lot
of stuff about whether the Nvidia
compiler is any good um so you'll see we
can
go
uh down here you know what I'm just
going to I'm going to leave a GPU meem
copy just so we have
Okay cool so you see this is just
here uh so this loads in the
Sentinel uh I'm going to put this down
here with the program here uh load
program and
args uh run
program test. program
[Music]
ran I'll just say
um do this
to uh kick off command
Q this isn't actually really right this
is junk we don't need
anymore um wait for it to run and then
dump uh RAM
check Okay cool
so that's
junk
cool uh now we have a pretty
simple GPU driver when I was looking at
the program this so this is this is that
function GPU compute that's called from
down here uh you can see that it sets up
a whole bunch of things in this stru
this stuff's all junk going to get rid
of this
junk um we don't need to include that
anymore I'm not using Shadow anymore I
don't think we need that
okay uh my
driver you're going to get banned so
quickly for saying this crap that's
right you
are uh bye-bye
all right cool so we're running the
driver now let me just Commit
This
run sorry my names aren't very good you
know coming up with nice commit names is
something that you have to do at work
and that's real software engineering so
uh by the way I don't care if you're a
subscriber uh you know you can still be
banned that's just that's just how life
goes man you know sometimes you paid to
get into Harvard and you know you still
can't get a job at your cousin's
accounting firm like like you know he
can't he can't work miracles here man if
you're asked in an interview what 2 plus
4 is and you say five like you just
can't be helped there are wrong answers
despite what you've been told to believe
in uh you know in in in Feelgood school
there actually are wrong answers uh 2+ 4
does not equal five
uh and you know only Communists think it
does and you know what we think of
Communists around here that's right
that's
right watched Top Gun last night so I'm
feeling you know American is a American
as fuck
right H
cool so yeah unfortunately this address
changes when you install the sniffer but
we are running the sniffer Okay so
the thing that we're doing in today's
stream did I appropriately name this
stream an open- Source Cuda user space
yes yes it's appropriately named uh you
see I removed outf and yay so so I'm
just running driver right now so this is
just this here
um and I have this little sniffer which
works with the driver too like you can
use the sniffer uh on Torch but we did
that in in a previous stream so we're I
can do that again what we are going to
do is start diving into what this
does uh unfortunately we are still
linking to
Cuda uh we're still linking to Cuda
unfortunately because we're using it for
Cuda and nit and if we don't do Cuda and
nit nothing
works so I started yesterday morning and
we're going to keep working on it today
we're we're going to look at all the uh
IO
controls I'm down in San Diego too which
is like you know like welcome to the
home of the Navy you
know um man you know how does Tom Cruz
still looks so good he's like a 60-year
old
man so we can look at a full dump here
uh so this is the code and then the
sniffer is sniffing this is what we call
a knit and you can see that it makes uh
you know a crap ton of IO
controls um so I was wrong when I
thought that gpus didn't have mmus it
turns out they do and they're very
complicated uh so let's dive into this
and hopefully by the end of the stream
we will be running a Cuda kernel without
linking to the Nvidia driver
wow all right let's
go so um we don't reuse this Stuff error
that's all good so let's just comment
this out and see what
happens uh it's segals great it's segals
because my GPU buffer is not actually
mapped you can see this is my command Q
here and we didn't actually map the
command
c um we are still linking to the Cuda
driver so we can
confirm now that we don't have to link
to it you see this El Cuda we're just
going to take it out
and it links but it's like fals right uh
so now that we're no longer linking to
Cuda you'll see if I put this stuff uh
back
in uh it doesn't actually work cuz it's
not defin reference right oh look I'm
going slow for you guys today I'm going
slow for you guys today Ione happy ah
cool uh if you're happy I'm
happy it's my one of my favorite lines
from house I say it all the time I say
to Alex you get mad at me when I say it
I'm like if you're happy I'm happy do
you like the the the floor if you're
happy I'm happy you like the car if
you're happy I'm
happy
um you know what uh Alex left me some
food for the weekend uh so we're going
to we're going to cook some
torini uh I'm I'm I'm excited about
torini uh and I'm excited about
replacing the uh the Cuda driver uh with
uh m okay so this is the init function
you can see like I anit device CTX so
maybe we can first start looking into
what the init function does so this
output here is being generated by my
sniffer uh which just intercepts IO
control it's gotten kind of wild and out
of
control uh but it looks like basically
we open two things we open Nvidia
control and Nvidia 0 and I imagine
Nvidia 0 is only Nvidia 0 Cu uh we only
have one Nvidia device this computer has
two so I expect to see yes Nvidia zero
and Nvidia one all right that's good to
that's good to know okay so that's the
device and then there's the
control so let's go into my driver and
let's see if we can replicate
this um we're going to have to open
Nvidia control so we'll say int FD
control equals open Nvidia control we'll
do something like
that I don't know if we have to open it
non block or
anything we could intercept the open
call and see what it's
doing uh but I don't think we really
care we'll see if it's wrong uh D
dev0 okay we've opened both the devices
we can confirm that that actually bumps
the major
fds you can see I'm actually
intercepting the
opens uh the sniffer is sniffing why why
don't I see the opens there oh because
Nvidia is using I think I'm only
sniffing
open 64 yeah I don't know why they use
open
64 um but we'll we'll just let's just
print the flags out
to to make sure I get the flags right
because we don't want to like waste time
and the flags be wrong okay it's being
opened with flag two but this one's
being opened with a different flag so
let's let's take a look at what two
actually
means
um where is that stuff to
find okay so that one is O R
W oh my God is this octal bro
bro can we can we print F in
octal is that a thing here printing
value in octal I never knew how to do
this oh I can do an O for octal okay
let's try
it
sniff gon to print this in octal oh yeah
got a o there whoa you guys know what
octal is p
seven okay good so now we got the value
in octal and now we can see that it's
being set to I think it's clac is that
right so that's 1 2 3 4 5 6 and that's 1
2 3 4 5 6 all right cool so it's being
opened with clo EXA to you guys know
what CL exac does uh if you don't you
Google it uh cuz you know I I can't tell
you
everything where would be the
surprise okay we're opening the Nvidia
driver
now uh octal is seven yes octal is
seven clearly that's what OCT means you
seen the Octagon yes seven-sided polygon
that's
right I've seen an octopus yeah seven
legs used to have eight then it was an
hopus but I ate one and now it's an
octopus it was delicious was chewy got a
good consistency you know look guys you
shouldn't apologize for being the top of
the food chain you know a lot of humans
like want to be vegans and shit and I
don't get it man I don't get
it you you know I'm proud to be at the
top of the food chain my ancestors
conquered the Earth and one day the
machines will come and Conquer me and
I'm like cool with that man it's called
The Circle of Life you guys saw the line
okay you know what's
up um why is October the uh 7th the 10th
month well that was due to political
interference it's like the Indiana pie
Bell that's right it was the you know
juliia Caesar month bill or
something um
n man you can beat physics with
postmodernism you know towards a
transformative hermeneutics of quantum
gravity all right
uh so this all looks like we don't need
any of these I definitely don't need a
TPC mask I definitely don't need gers or
caps now something that was kind of
confusing when I was looking at this one
yesterday so I think this is the first
interesting uh call
here and let's try to make the call and
see if it works when we do
it uh let's actually make sure that
let's do open 64 to match the Nvidia
driver and then do
driver and okay you can see that I open
Nvidia control we're only going to open
what we need because my driver is
minimal uh these RM Alex are interesting
so it looks like
first see if there's any no there is
zero example code online so we're going
to have to do this
ourselves so you call Alec and it gives
you these
objects um so this is this is my sniffer
all this codes up on
Google uh
let's put this here and this
here and we're going to make an IO
control uh FD control here and my params
are this
thing let throw that in a little brace
so I can reuse
p uh always set to zero
uh let's take a look at this struct I
also have so this is just the uh I have
the other window up I have the open
source Nvidia GPU driver here you can
download that it's called open GPU
kernel
modules and then this is the things that
we're going to have to set so it looks
like in order to allocate this root
client you pass in h root equals z and
object parent equals z so those are
already zero uh H object new I believe
is uh returned so we're going to need an
H class of just an Envy root client and
we can see if this works so we're going
to say p
dot uh H
class equals nv1 root client I think I
might have to include something for
that
um and actually am I printing the return
value of the
ioctl if I'm not I should
be that way I don't even need to check
it in my thing because we can just check
it with
sniffer uh
well we'll keep an
assert okay assertion failed uh let's
use iok to control 64 so it fires in my
sniffer
okay some unidentified
identifier okay it's not I control
64 understand I link to I control I
intercept I control over
here uh assertion R equals zero it does
open but it does
not uh
run oh
no the type should be Nvidia IO control
magic uh yeah also clone the Nvidia
driver just to block a bunch of IO
controls that's not a bad idea we we we
can try that I mean there's some that
we're going to have to implement like I
I don't think there's any way of getting
around allocating this root
object uh so we're going to have to
allocate the root object we have to so
the really important one that I want to
get to replic ating is this one here is
an map and this map's in the control
page so we're going to have to replicate
that no matter what and you can see that
this is allocated off of a root object
so I have to allocate this root object
here no matter what like online
53 um so I'm making a call to IO control
for some reason my sniffer isn't picking
it up and I wonder why that
is could my type be wrong I I don't
think
so I really don't
know my open is getting linked but my IO
control is not
see it shows up an S
Trace uh yeah here's my control you open
there and I'm getting an I
inval though it does seem like
something's wrong oh this isn't right oh
oh okay that's just switching the type
okay so that's actually not what goes
there
we're going to have to build the io
control or find where it's already
defined probably some Macro for
this NVR
NR
type seems right what's
NR oh the type is
just is it just this
use of Undeclared
identifier so we we just parsed the io
control we didn't
um we haven't actually generated any of
these IO controls yet because the other
thing is all through a user space
interface okay these are DRM IO WS I
don't think that's right so let's figure
out where this is Kernel open common Inc
I include nvy ioctl numbers I do not
include
Envy so now we're linking to that but of
course it doesn't work CU we did
uh link enough let's just go in here and
do open GPU kernel
modules and we have to do
kernel open common in that's going to be
right all
right unused identifier Nvidia platform
Max IO control
size okay well that does doesn't look
like it's defined anywhere in this
driver
um we can Define
it probably
that okay
cool uh so now you can see that even
though it's not returning the right
thing we are at least hitting the right
uh Nvidia thing is it does it really
want me to pass in nvy ioctl magic there
does that
matter no it doesn't okay then I guess
we don't really understand what that
type is yet we should figure it
out NR type i r NV I octl
here you see that I put type here and
it's that it doesn't really make
sense
uh let's look up the I W
macro
useless um type NR size oh this a
size I mean it makes sense that that's
size but why do
they oh also that's not actually the
correct Max size the max size is
this and
then okay I'm printing out
size here it says it's zero but when I
print out size here it says it's 20 so I
think I just want to say a size of P
here
I don't know why that's so terribly
mislabeled as
type uh okay I'm only passing in HEX 8
that's not
right how is it only hex a that doesn't
make
sense unless this thing is just
wrong what if I type in 20 here
hex
4 this just
broken w r type and R
size type def
Char size oh oh
oh oh it's double size oving so we can
just do
that okay that's 20 there we go great
look and we got a we got an object okay
so it's it's calling size of so I can
also just pass that in
here that would also give me 20 but we
can just do
p p has that type okay so you see that
hex2 is now
correct and we are allocating our first
object so
uh H cheers to cheers to that
so let's just go straight into the next
thing we have to
allocate uh H object new okay so we'll
just make a quick function uh Alec
object what is the type of H
class type of H class is nvv 32
oh and then the return type is going to
be an Envy
handle so we can move these guys up to
[Music]
here uh we'll just do Alec object nv1
root
client
um NV
handle uh root equals NV object
right turn P
dot uh H object
parent we are also going to have to pass
in the root and the H object
parent V handle
parent P Dot
H root root p. H parent equals
[Music]
parent make sure that still
[Music]
works it does not because we did not
pass in the
FD oops
no parent name no project oh H object
parent oh fancy
bro all right now I don't know what
we're going to do about the ones with
pams because we haven't gotten to them
yet okay so it allocates uh two root
clients even know that seems like
Overkill everything about this driver is
overkill um okay so let's get down here
and let's see if we can make this Alec
work okay so this has a pair parent
object of
this and
unfortunately this one has Alec params
which we're going to have to parse
boo um wait where does this object come
from well this is an Envy device zero
okay well let's
first we'll allocate a
device we'll pass the class
in device
zero we will pass in the par and the
root are both just Roots so we can just
do root comma root comma
root uh UND declared identifier did I
not copy that right copied that
right maybe for some reason it's not
defined where was that defined I think
it was uh
this I'm going to complain cuz I didn't
doubt I your brackets or okay that works
okay cool uh great so we're allocating
that now for some reason I get an object
that has a completely different looking
handle what does this one give me that
object oh it is passing an Alec
perams xqc thank you for gifting Subs by
the way lonx box nice to have you around
um yeah blocking a controls was very
helpful when I was doing this for the uh
the Qualcomm camera
driver let's take a look at pic pams and
see what they
are thr a hex stump in here of pic prams
we'll get to that
later let's just see if we can figure it
out by looking at the
jum okay depre ated get class
ID no I don't think it's
that device level calls are broadcasted
to all gpus within the
device I saw this right what is
this oh yeah no these are the ones we're
using uh but those are not IO controls
you have to be careful those are just
types um
P Alec
pams look at that address it's so
high
useless Envy pointer to nvp blah blah
blah blah blah blah
blah okay here so let's go look at Alec
with second info
[Music]
nope RI Alec with te info I feel like
I've looked at this before okay here's P
alic pams let's see how they're
used why isn't it highlighting it
all right here is being passed in here
to RM
Alec um and here it's being passed in
here to server Alec resource all right
all right all right don't worry we'll
all the pointers I'm not getting bored
yet in video D all right uh where is p
alecs p
Alec
params RZ res Alec pams
internal this doesn't look
useful okay
well we'll throw Cuda knit back up here
while we go through and try to
understand
this so we see have the Cuda and its
stuff back let's um let's dump
it if PP Al Pam not equal to null heex
PP
pams it's dump
40 I think my hex works let
see
okay so here is pic pams for the
subdevice call I'm making a subdevice no
I'm making a
device so I'm making this call here and
there is this pointer all right so that
pointer just looks like the root object
being passed in so maybe it is this
struct Envy
handle emu baby thank you for gifting
Subs I appreciate
you uh could it really just be this
second info p Alec
pams if H client is located pH
client oh man I read this and all I see
is is
exploits exploits exploits exploits okay
P user Alec pams is being passed into RM
Alec
pams it's like it's hard to follow you
know what I
mean go here we go here okay underscore
rmal in the RM
API p alic pams is being passed into
server alic resource okay and that's in
pams here which is passed into all this
stuff so maybe
it's copy in
no I mean it really does look like this
is the struck but why would they why
would they call it
this I don't know I okay can't
hurt um um we'll say
with with
prams uh for this one will say false
this one will'll say
true uh
if uh with
params so the r is ref AP we'll call it
PP P
dot P Alec misspelling of
prams star PP
PP dot only see set here is the AG
parent so we'll set the H parent to the
parent and then we'll see if we get
things that look more like you see the
problem my thing looks like a calf and
their thing looks like a 5c so I'm not
sure if it matters but you know just in
case right now we're passing anal params
uh no we got to figure out where that's
actually defined and it's in Source
Nvidia generated G RS resource NV
o fatal error nvoc runtime not found so
I would
assume where is nvoc runtime oh we got a
hype train going that's nice mvoc
runtime is here so Source Nvidia Inc
libraries let's include that
Source Nvidia Inc libraries did I spell
it all
right oh well we still don't have the G
object nvoc which is very important and
this just might be in source and video
generated maybe yeah okay we have to
include Source andv generated
Source Nvidia generated okay so for
those that for the for the six of you
out there who've never worn a seat belt
before you guys know what the eye
parameter does oh great okay well that's
it's
terrible uh that's really terrible I'm
having this is a this is a bad time I'm
having a bad
time why would I don't need that all
right
fine internal use
only can we do this is this going to
work or is this going to bitch me for
seven other reasons
it's bitching at me for seven other
reasons
okay all right we'll have to figure out
how to make this work then okay nvoc run
time not
found that one
just that one in ink
libraries then G object MVC is not found
and that's in ink
generated or is it just generated it's
just generated get rid of the ink
let's go okay uh error templates must
have C++
linkage I'm not happy about
this then we have unknown types I as we
like not including things in the right
order or
something containers type
safety what who cares about type
safety I look it includes seven
things
okay exter C where am I declaring extern
C
no
here same
issue template must have C++ linkage
extern C is being defined here okay
let's try to include this ourselves
maybe that will fix
it can we include type safety. clearly
we need some type safety and then it's
not within an extern C
block okay okay that's a little better
uh let's just figure out where these
types are
allocated um
go to definition well it doesn't know
where the definition
is the ref macro comes in several
flavors so we have to include EnV Port
debug source include Nvidia Inc
libraries andv Port
debug all right all right all right not
too many now include port. instead okay
all right all right all
right oh no we still have a lot of
Errors okay uh do I have to enable NV
Port
debug um if to find
debug here we
go it's in
EnV Port
inline debug Unix kernel
o.h this file can only be compiled as
part of the kernel buildt okay well
that's too bad cuz I didn't want that
file
anyway
um where's Port me allocator defined
this is
annoying okay you know what maybe I'm
including the wrong thing maybe this
isn't actually the struct
like there might be a user space version
of this struct I might just have it
wrong all right let's try a very simple
version of this
first GPU driver get rid of that do
that okay so I don't think that's right
because first off I'm still getting the
wrong
thing uh is my status
right no why does it give a status of
1D that doesn't sound
good we want to status is
zero see where that comes from in
here okay status p status okay so that
gives us a status of 1B and that gives
us the status of zero so I think we're
doing something
wrong like internal use only dup
Al okay I mean maybe we need the whole
struct and we'll even keep a lock info
around is there a pointer that's a
pointer so that's
not that's going to bitch and be like oh
you didn't include those other ones okay
we need to find an RS resource ref
[Music]
that's not really defining it oh
here no no never
mind yeah internal param should be
different structures but they're
not okay uh I have to figure out how to
get an RS resource ref where is an RS
resource ref defined see we're learning
though uh no that's a resource ref list
where's an RS resource ref well that's
useless it just defines it as it oh here
we go oh this looks
complicated okay I mean if it is just a
pointer we can just say type da RS resar
void
star uh I think I did that backwards
sorry void star R resource type deps I
think it's just the same as defining
like a variable but it makes it a type
so okay now while we're left with this
API security info so let's make sure we
get the API security info correct it's
very important you know you got to you
got to make sure your privileges are
right oh my God now look at this crap is
it a pointer it's a pointer all right
you know what whenever it's a pointer we
just type Dev void it that's
right cool uh well our status is still
1B so that's a
tragedy uh we're trying to make an Envy
device
zero
uh let's see if this changes when I
run
KET oh so now I get a zero but my
address is still weird
uh but at least my thing looks the same
as their
thing what if those are part of the
thing that doesn't look right at
all oh is pic pams actually
returned maybe it's not something I set
no my status is still zero when I do
that so maybe I don't need the par
that'd be really
nice
[Music]
1B it just doesn't seem
good so what else happens before I do
that okay so here we're doing
Nvidia ask register f D that's the only
thing I can think that might be
important right because before we
register the device it seems like we uh
are opening the dev zero so let's open
Dev zero and try
it wait my status is zero
now so if I don't open Dev
zero my status is 1B but if I do open
Dev zero how does that even know
how does it know if I opened it or
not all right all right
fine I'll
settle needed question
mark all right we're still getting weird
looking things but maybe that's because
we have to do register
FD so let's register the FD uh it's f
after we allocate the root
client uh register
FD where is register FD okay the IAL
register FD Rams equals Zer prams
do control FD equals FD
control we call this on
uh and is zero so we're going to call it
on FD dev0
here it's not an RM Alec anymore it's a
register
FD and uh we should just call my grabs P
for
consistency now we registered the FD but
we still get weird looking uh how come
their object looks like that
and my
object looks like
that like it might not matter it's
returning the same value but still I
just you know it it upsets me I want my
object to be nice looking uh how big is
this
structure create a
rs. uh copy this stuff
include
rs. also include that in the
sniffer now assuming that that's the
real struct go down to my hex dump here
and we can say size
of RS
that
internal okay let's look at my driver
here comment out the real Cuda
net I used open on dev zero no I didn't
I used open 64 on both uh RS access mask
is not
defined
okay must be defined somewhere it's only
a problem in the sniffer
so let's probably Define in one of these
other things that I'm
including RS
access Nvidia Inc RS
access Source common and maybe it's just
this one I don't include the
sniffer I do include that one I don't
know the Escape no I include that one
this
one oh is it because I didn't Define
Envy Linux
no which other ones do I include in here
that I don't include in there
nvos G all
classes oh just move it down
here get your order right okay good all
right so that's the S oh my God look at
all the other stuff that's being passed
in here so much
stuff okay this one is at two over
here let's see what's at 30 at hex 30 we
have a two so let's look at that struct
okay that's going to be 8
uh probably
18 uh
23 is that a pointer to a client no it's
probably Alec flags that would just be
my guests let's just set the AL FL to
two and see if that
works
pp. Alec
Flags equals
two
oh what I do how did that just happen
What keys did I press wrong to make that
happen my micro isn't good today
all right well the two's in the right
place so that's good but we're still
getting the stupid uh FD
number how come H that's a CF and that
is this a real thing am I just wasting
time with something stupid all I'm about
to start should I start blocking IO
controls is that the way to do
this
ah maybe these RM controls don't that's
annoying I didn't set it up to do that
easily cuz I I print this stuff out
after
I what could it
be okay we're very clearly passing a two
in there and I'm kind of curious what
that uh what that
is try to find
it Alec
Flags here we go
nvy
o32 Alec Flags Force meem grows up I
would say that's probably
it okay I'm passing in the same Alec
flags for the same
device uh and I get
nothing well still nothing but their
object looks like that and my object
looks like that I feel like I'm getting
duped and I'm getting a scam GPU I'm
getting I'm getting like the null GPU or
something right if we get rid of the kit
it's still giving me a status of
zero but still giving me a calf I don't
want a calf I want a
5co uh this is just info I'm sure it's
not that I'm sure it's not
that let's read what some of these
things do um AR control get build
Version Control command GPU attach IDs
is this a real
thing okay this command attaches the
gpus with the GPU IDs matching those in
the table okay I feel like we have to
attach gpus that looks kind of
important GPU get probed
might even need to get the probe IDs all
right well let's let's improve the
sniffer so we can sniff
that GPU attach IDs
um attach
matching
oh do I get any PRS here fine here we go
here's a
prams control attach ID prams sub
pram GPU IDs failed ID controls that to
finded 32 all right well you can't
attach more than 32 gpus if you're
trying I'm sorry but it's not for
you okay uh
subram
IDs zero
all right is this making sense to people
583 viewers all right well not that many
people I
guess
um here attaching
900 I don't know why it's
900 but uh I think we
can try it ourselves
okay
uh Al a root
client I register the FD let's throw
something here okay so this is an
nvos 54
pams P equals
z uh we'll make it
SP equal
zero um for the ioctl it's a esrm
control
contr uh
P command
equals GPU attach
IDs yay 32 I mean there's no real reason
what calf numbers there in the file
oh
interesting okay these are called RM
handles well let's see if we do this and
this works I think that this one was
important uh so we just say SP sub GPU
ID Sub
equals
okay uh undefined
reference for this one can I just
include
that can I does that
work oh that one doesn't work
that
work uh not a pointer no shit it's not a
pointer why don't you guys tell me that
it wasn't a pointer and we also need to
set P
dot
uh
params equals
Undeclared
identifier where oh so so good thing I
remove that CU otherwise I wouldn't have
caught that AR for a while I would have
caught it quickly been like I want the
right device let's
go cool uh no we're still getting a
calf
yeah I could block block them we we'll
get to blocking them I don't know I'm
just like I'm curious what
these uh things are there's also like I
don't think I can block all the RM
controls I'd have to go and like dive
into what the RM control actually is
okay we attach 900 same as that thing
attaches 9 oh oh I think maybe my client
object aren't
right yeah okay my client and object are
not right so so I don't know where we
set those um probably in this thing
client equals
root object equals
root we attach them to the root
object oh yes I did mean h client and H
object of course I did what's this
Hungarian
notation okay we still got a calf
great GPU attach IDs control command GPU
attach
IDs attach 900 okay the get stuff can't
be
important Nvidia client set inherited
share oh I see what you want to
do okay okay I'm sold
uh okay
so throw a uh get
in Block I have to parse it
um
IAL z i Plus
plus uh okay get in
Block we okay we want to block one per
run all right that that's really easy
then here do a a to I get an block if um
I uh equals equals a to I get
Block should do
that so we actually start from one
return
zero okay
cool
H well I don't understand why that
happened oh because this is a
crash Okay cool so we can say
one still
works uh you know what we're not
actually going to return
here back to being
zero and let's give this a Block's not a
good
name I don't want to remove this code
J blow welcome thank you thank you for
uh for for for uh showing up to the
party uh okay you want to print the
number I will print the number all right
we'll just do that and
um okay now we've numbered all the io
controls
three
there beautiful okay they're all
numbered okay so we block zero so es
check version string uh doesn't
matter es check pams doesn't
matter that one doesn't
matter ask get card info I assume the
Alec matters if we break this one
yeah okay if we break that one it all
breaks so the Alec matters get build
version but see like get build version
okay this is why uh oh oh yeah that's a
good idea uh I don't know how to do
that but you can definitely be a VIP in
my
channel hang on here we
go oh that's cool if VIPs can talk in
sub
mode um
okay so you see the problem is if we
block get build
version uh it doesn't
work but that doesn't necessarily mean
it doesn't
work
uh it could just be the it's the driver
just checking the
return uh
stuff okay but we can block them now so
let's block 17 and see what
happens okay so now we block the attach
IDs and look they still get oh okay this
is good already all right look we
yielded something so this is still
giving them an H object of
that so maybe um attach IDs didn't
matter and maybe register FD doesn't
matter either let's block the register
FD
it's
21 they still get an object they still
get a good object number but we should
understand that maybe this actually
doesn't matter and maybe the object
numbers are completely
irrelevant it's like the points on Whose
Line Is It
Anyway uh okay let's read RS
client uh by way guys before I sign off
we got to return the favor you know we
got we got to send our guys over to uh
Jonathan Blow uh he does some
uh awesome game development stuff he's
got a good theory about you know
software being shit uh I repeat his line
all the time about you know software as
of gas it will expand to take whatever
container you put it in and you can see
this with the Cuda driver right if this
thing was running on a 33 MHz processor
you know nobody would waste time these
useless I
opal uh but because it's
not okay I'll see what the handles
mean I just don't understand why okay
new people what we're working on is an
open source
Nvidia uh CA
driver so in our driver right now we're
still calling K
andit uh but we don't have to call K
inet hopefully when we're
done where we are stuck right now is
that when
Nvidia um calls stuff they get handles
that start with 5C and when I call stuff
I get handles that start with Cal now it
may not matter
but so at lonx Box's suggestion we wrote
something to block IO
controls and we'll see if we can get
objects that look
like mine
oh
no so it just reallocates through root
client if I block card
info no see they still get ones okay
does it matter let's read the
documentation uh and see if it matters
so you said there's stuff
in
RS on
vgpu NV divis Z is
allocated yeah I feel like I'm getting a
vgpu which is a
scam I don't want a vgpu I want a real
GPL so we know it's doing those things
even if they're not useful we can take
them out
later we attach we call the attach IDs
on the client object maybe there's
something I didn't set here in these
parameters so a lot of this is possible
because Nvidia open sourced oh we see
did we set
Flags oh did we said param size I don't
think we said any of this stuff all
right
fine P do pams size equals size of SP I
bet it's
that it wasn't
that um but either way we got to dump
these things
now
okay so this is my IO control sniffer
that we run on the Cuda
driver uh where do we want to dump these
things here
okay so we're dumping h on
client command we need flags and param
size okay we are doing
Flags here we're doing it with flag zero
what do they do it with you also flag
zero
okay Rams is
84 RS is
84 uh I only printed one of the
params just dump it quickly
okay gra putting in a nine
there junk junk junk junk junk they put
in oh the rest of them is FF maybe
that's the
problem
okay what shouldn't matter actually I
think they they set invalid GPU but we
can do it either way
sp. GPU
IDs uh this chat is
subon because when I let the non Subs
talk the quality in the chat that's
quite
bad ID one
that no we're still getting calfs we
that one doesn't even matter we we
blocked that one and it didn't matter so
it's not that
one we attach it we register the
FD it can't be things like Numa info
control set inherited share policy that
didn't make a
difference didn't make a difference
either so it's not
that can't be how we're outling the root
can it no that looks like it's the same
number control command attach IDs that
seems so
correct I guess it gets the attached IDs
and confirms they're actually
attached can we alloc a
device pass in the parent pointer
huh for some reason they allocate two
things up here but I don't think that
matters get build version
all right fine I'll make the blocking
fancier like par
set lot of
effort I got to sit with better posture
you
know posture is not very good
okay block that we're only trying to get
to here let's block Numa info and see if
that
matters oh I have a standing
desk maybe we should try
standing let's try see my desk is not
plugged in I my desk is not plugged in
um here we can unplug the Philips hue
light plug the desk in and let's stand
up come on wires be long enough wires be
long
enough I don't think I've ever stood up
with this desk oh that feels good
though we could re we could replay them
exactly but then the problem with that
is we don't understand what it's
doing right the goal of this stuff is to
understand because we're not just trying
to build a copy of the Nvidia driver
we're trying to build a better
driver okay so we're trying to get to
call
23 one of these calls before 23 has to
be doing
something um oh my God I got to like do
a it's one line in Python to like
separate something you
know should
blocks false
if should
block print out
blocked
else that okay if block IO control let's
parse
it okay what do I have to do
string
Parc it's something like this
right uh
z i less than sterland block IO control
i++ um
map int
blocked um
block part okay I'm annoyed by this
sorry
um if IAL equals comma
IAL
zero uh Char star last
equals lock
iotal uh
if I is comma or
I zero oh this is the worst thing I've
ever written
it can't be a cons Char
but
um a
toi last if uh i n equals a I last
should block
equals true last
equals um block no
don't I
sorry should work all right now finally
I should be able to do things like that
okay 21 was blocked but not 22
um should work
oh you s to L in a loop I probably could
do
that oh it's because I'm doing string
length um that's not what we want
all
right no matching
call oh end pointer okay okay okay okay
fine fine I see what it
is
um but why didn't that work is that in
stood LI or something
what does it return if nothing else zero
value is
returned okay well don't
uh don't use zero can't block zero
we'll go back to getting rid of
zero okay wall stage previous not equal
to
zero that's not right we got to do while
one in
temp uh if temp equals zero break
if temp equals
uh iio control num should block
true lus probably be like that codee's
crappy you don't want to write code that
looks like
that okay did it block the two no it
only blocked 21
again
um oh was a comma there all right
um
what this is
CRA no because it's not okay
if star preve equals
comma uh pre Plus+ okay
okay good now we block two of
them okay we're trying to get
to wait
what how would I block it is this
already
set did this just tell it that's what it
was oh that's a
scam are you telling me I can do that
too does that work
what yeah I just said
it
okay well that's a
scam okay this turned out to not matter
what a waste of time why' I waste time
with this it turns out not to do
anything we'll just accept it that's the
object I get it was just setting that
number these things aren't needed
so we're back to that I don't think I
need that
even great we're allocating an object oh
we're back to one BS uh because we
didn't open the
device we open the device status is no
longer 1B we get a zero okay great I
don't know it seemed to kind of work
okay now we got to allocate a subdevice
let's allocate a
subdevice um for subdevice we pass in
device uh we keep the root the same same
but we pass in device and we'll call it
subd
[Music]
device okay great uh it looks like that
worked now where do we even use the subd
device we might not even need
it now it's being used here in ralic so
now are we ready for AR yeah okay let's
try allocating a turing mode
a
um call this user
mode and we pass in the
subdevice okay I mean all these things
seem to be returning okay stuff let's
see if we can map
it turns out we didn't need any of that
what a waste of time
um let's try
calling this calls get a dress Bas type
we don't care about that we're going to
try ask M
memory so I got to make some food I
think it's I think it's leing time can
we all right we're getting somewhere
we're going to cook some torini going to
eat torini and then we're going to keep
working
so to be clear why the drivers was
different is was just passing in the
handles apparently you can do that and
then it'll just leave
that or it will assign you calf
handles and if you don't want calf
handles you got to pass in five C
handles
for
seems
okay can pass in the same linear address
if we want
to okay now I should be able to call map
and the FD is
10 what is 10 oh it's a new open of
Nvidia
zero flags are one I don't know what one
means set is zero okay
ah okay so you see real now is uh so
this is the thing that I'm hooking uh
with my
driver uh so you can see now real is
minus one so that kind of sucks um
it's called that map failed isn't it
just map
failed map failed with one
M what is this return if it uh returns
minus one the value map
failed map failed
fine fine fine fine fine fine all right
what if I cast through a void pointer
are you
happy some Undeclared identifier
assert okay so now real is equal to void
minus one
and that's not
good it reopens FD
dev0 I don't really understand
that well this is why we have the
blocker so that one has working
real um
there a whole lot more stuff before this
but it does all look like gets okay uh
let's not attach the device let's remove
that
one um so that's 18 I say block equals
does the battleship still SN yeah you
sunk my battleship okay so that one
wasn't needed uh no it didn't block for
some
reason oh if it doesn't have a comma
does it not work why the block oh
because I called it block
ioctl okay that one's blocked and the
map still
succeeds so it must be something
else um let's just try
this we do always have the same
things so if we're
calling uh map memory
here oh we didn't set the H
client yeah okay we didn't set the H
client that we have to set the H client
to Route I
believe I need to close the device I
don't think so
still
nothing uh okay what I was going to
try was changing
these to be the old device and see if we
get a hit
there and there's some ch chance you
can't map it
twice so I'm just trying the ones from
the default driver and see if the map
succeeds the map still fails okay I
suspect we're just doing something wrong
oh oh I'm targeting the
stupid to Target FD control
here still nothing but that's more
forgivable 58 it reopens it CL
exact
map that that and
that P linear address offset length flag
status and then here it Maps but that
gives me
that maybe Seven's not
right let's just add something to the
sniffer I mean the sniffer itself is an
independently useful
uh useful
tool so if we develop these things
jointly okay now PR
seven uh FD is 11 we do reopen it which
is kind of odd
let just try that and see maybe we'll
get
lucky
no uh there's some chance we just
totally can't map it
twice
no
water for
cooking instructions three
minutes making spinach and cheese talini
with some Rouse H
[Music]
sauce I don't think the Alec pams
matter I don't think pinear address
matters you think they reopen right
before the map memory I I know I did
reopen right before the map
memory oh you think they reopen right
before that map memory oh you're right
they
do good catch
no
nothing shot there something in D
message let's disable the konet and I do
still have all my debugging stuff on so
maybe uh freeing abandoned
client this one map
this is just all the
freeing okay so this is only down
here all right it does those Alex and
that's all fine how come I don't see
more Alex
it's definitely returning me that
object must be a different thing doing
it there any Fields missing in your
command prints like an
FD
Maybe can look at the you mean my my
parameters to my
map Cent
device uh I assume offset zero though
okay that might be
missing no no offset zero I'm putting it
here uh offset length pinear address
status and flags I'm setting flag two
setting length to that setting P your
address to
that so it probably failed before we're
even
there for
[Music]
here's something we can do want to read
the dis M we want to read the D message
for cing
it no no bad
table no bad table go
down
down
down it won't go down
down down go table good to
table so if we call real C in it we get
tons of crap in D
message um let's see so the last one was
167 let's just call it one more time
look at all this how come they get all
this stuff and I
don't look at all this like the mmu it's
doing all this stuff I'm not getting any
of
that it's actually overflowing the D
message buffer and how much crap it's
doing okay so what else am I not
doing you don't have to register the
FD all right fine we'll do it
methodically should we write a script to
do this or should we do it by hand
we need
four we need
five don't need
six don't need
seven How does it go from 83 to
86 I don't know about that it's very
suspicious
need
nine need
10 don't need
11 don't need
12 don't not need
13 don't you love doing things by hand
that could be done by machine but you do
them by
hand oh this isn't really right let's
start them at one and then only
increment them if we're printing
something so we don't block other IO
controls okay
great now it start over because this
isn't right again
I know let's just try let's just look at
them and make a whole big list of ones
we think don't matter like 74 75 7 76 77
78 79 80
82 okay great now does that matter
because they're all actually after the
thing we care about anyway we care
about um the M map working right there
below
70 so we we'll block all
those great
32 33 34 35 36 37 maybe one of them some
of those were
needed this is frustrating
[Music]
okay how about all the TPC masks do we
need
those no we
don't see now those are all blocked we
don't need them
our goal is to make this m map succeed
in our
driver cool you didn't need any of those
so 11 to 21
you did need some of those why does it
print out blocked three
times okay it's blocking other IO
controls this is actually kind of
annoying
um this logic should probably only be
here
then we also need to pass through IO
control
normally um if the type is not in video
okay so that works okay oh actually know
it
doesn't so that's fine it looks like we
do need to attach the IDS
actually um can you ask TR to make sure
they're not doing anything else the uh
yeah we'll get that we'll get there in a
minute I think that you might just need
to attach the ID maybe that's just not
what we're doing okay because if I block
GPU attach ID
I block
16 nope I can totally just block it I
can totally block it and it still
ends I just can't block
14 then it like errors
okay not
needed um do we have to get the is this
going to block
these I can't why does it call the same
thing twice get ID
info all right it just looks like it
retries
it I can Block 17 can I block
19 Block 19 okay Block 17 Block 19 can't
block 18 block
20 21
22 no we need
malic okay we'll look to see if they're
doing anything else to the
FD um
here's the M map they're doing
a yeah okay so that's it
right they just can that doesn't do
anything see they're opening up
there's an FD associated with the memory
mapping
somehow
H okay so what you're saying is I mean
that makes sense right it would make
sense that it reopens the device and
then passes in that pointer and then
it's a special
one uh so we can
look oh oh there might be two there's
like another parameters I might have the
parameter struct
wrong no for map
memory you think there's an FD
here that would make a lot of sense
[Music]
P API FD what's a p API
oh wait no no no
no
ah this is a wrapper for nvos with an
FD good find
okay
Envy Das un- nvos params rappers why
can't I copy and paste that
still doesn't work but I think we're
getting a lot
[Music]
closer
yeah all right let's put that in the
sniffer who would have thought there's a
special one for with the
um
FD for
uh all right yeah passes in the FD okay
[Music]
good find that makes a lot of
sense um man I wish there was some you
know errors
I did not break this right like red
actually still works right I'm a little
worried that I had a red broken for a b
[Music]
setting the FD
just in case we get
lucky we did not get
lucky okay well there's Alec pams again
I don't know if they
matter it looks like it was just passing
in a stupid pointer
so they really might not matter um I
have a cheap way to check
that they don't matter
can you double check their map args
against yours
yeah so this is the wait why does that
have PR
2 let me just log this into
oh we got it great
dude Ling box you're you're you're the
one doing this I'm just here operating
the
computer um okay so what what actually
is
Proto oh so it's only right oh I was
trying to map it exact that's probably
what doesn't
work probably that yeah okay cool but if
they're just doing right we can just do
right as well great okay so that's the
special control page for the
GPU um that's
amazing I think I might only have to get
one more allocation to work
so I have a thing which like hooks this
page you can read it in my sniffer um
the hooker works we hook
it um I don't have to reopen it that's
great maybe you do have to reopen it
we're going to map more
memory but dude we did it
didn't I check before and it was Pro
7 how did it turn into Pro
two um for reference Pro s includes
EXA um which is why it didn't
work I don't know why I thought that was
okay okay
cool now we're back
here okay so we're getting past all this
I'm not sure any of this is
useful uh the M that we care about is
there's one more that we care about
I wonder is this
object oh that's a vid Heap
control
object how does it allocate something oh
it is it's only two Megs okay
allate a few
more this thing is the other thing that
I care about
okay so we got to do vid Heap
controls actually does any of this
matter so there's only a few addresses
we code there's this address this one's
actually included in the same so these
are just generic GPU memory
allocations it gets a little hairier
when we go down here somehow something's
telling it that the command buffers are
located here because when we kick it
it's not really doing
anything
um then does that force it to that
address yeah
okay with flags 11 what's what's what's
that m flag
11 oh map fixed oh okay that's
fine okay uh let's just replicate
that uh so this isn't this is called GPU
pointer that's
fine
um let's make a vid Heap control
work don't tell me this one has an FD as
well I can't believe I got scammed by
that um deep control is targeting N
Video
Control
uh Flags don't really seem to change
that's a return
value I don't know if this offset
matters
this is the m map we care about and this
is this object which has this
offset so like
maybe maybe this
matters I also want to make one quick
little change to my driver and we'll see
if it still works and then I might only
have to map one
region um actually just leave all that
stuff going to hurt anything
oh it is because it's actually syncing
the battleship
twice comment that one
out okay good it
works still uh let me change these
addresses to be
here and confirm it still works then you
only need one memory allocation yeah
okay it still works see how everything
still
works uh so we should only need one
memory
allocation we should only need this one
and it's offset so we're mapping it at
24 so I moved everything into like that
region of addresses
cool all right so again our goal is to
comment this stuff
out uh we don't need that let's still
there um okay the thing that we need to
call for that is vid Heap control uh so
you guys all know what a heap is I hope
if you don't know what a heap is uh go
back to college you can learn things in
college
um P
dot oh here we go
okay so we have
p. data
dot p. function equals
Nvidia Alex
size um
uh as z. owner
equals your school never taught you
about Heap oh well you got to know about
Heap
bro um the owner is
root the
memory is a return value I assume the
flags are
that we can figure out what that means
at some point uh the size is
that and the offset is
that okay I M some stuff
up talking about Heights and
stuff uh oh
okay
um what I do
wrong oh I mean
okay is this like
a oh
P data
API what I do
wrong setting the function data Alex
size that should be
right um oh we have a lot more things to
set
here wow this returns a lot of stuff
VA space
handle I should have been more
consistent why did I call this P API
we'll just call it
P all phva space
uh
root object
parent okay it's not going to work
okay
um those look pretty
boring it's just the same as oh owner's
not root there is owner root in the
other
one the owner's root here look at the
difference this one is the owner being
root and that one has the owner being
the
device that's interesting I don't know
if it
matters but this is the target M map
that I want I didn't mess this up right
that's the
root okay
cool uh
okay oh object parent
okay so we can say p. root equals uh no
it's not root sorry it's h root root
equals
root but the object parent is the device
not the subdevice I believe this is the
device right
let just try
this okay we're still doing something
wrong oh well we got a handle return to
memory even though nothing else is
right uh
oh it's creating a new
object okay cool
okay we have a handle return to the
memory
um now I think we just need to map
that uh uh does that use
a yeah pinear address this
one all right let's create a
function for
map um map object in
FD
control we will make it reopen the
Nvidia object even if we don't have to
so the other one
does let's move this stuff up here
okay root subdevice user mode okay we're
gonna have
to user mode
uh we should pass in the length and
linear address
I'm always going to do pro read
right change that to linear address get
rid of
that change that to length bitch at me
that it's the wrong size you planning on
building anything specific yeah I'm
building you a fucking bouncy castle bro
you happy you happy is that what you
want you want a bouncy
castle I hate questions like that
ah it's a dumb
question am I planning on building any
of these bro do I look like I have a
plan if I had a plan I'd be a
billionaire right now in My Yacht but
you know I don't and that's why I'm here
with you
fuckers
uh okay I broke it somehow what did I do
how did I break it what did I possibly
do I just copy and paste
it oh
oops illegal
instruction why is that a
thing oh I didn't return
it it doesn't matter but it's a bug
anyway we don't get the illegal
instruction anymore so that's great
cool uh all right now we're aling the
thing um so let's make a void we'll call
it local
pointer and we'll figure out which ones
to
do get address space type okay this is
the pinear address oh and we want to
force that to be at an address but
actually I don't really care
there uh this should also be
length guess that's forcing that to be
an address we don't really care okay the
Root's still that that's still the
subdevice we're not going to call it
user mode we're going to call it
me uh we change the linear address to
this and we change the length to
this see if that's
working okay cool um we're M mapping
should I give it a
Target yeah let's match the other one
okay
um so here we're just going to pass in
null but here we're going to pass
in uh this lovely address
do I have to cast that to a void pointer
I probably
do okay M map Target uh for Flags we
want to say
or uh Target not equal to null and prop
fixed no let's call like map fixed else
nothing great
okay um cool uh that's mapping all the
things we care about all right 10%
chance the GPU just works now I give it
less than a 10% chance we can't be so
optimistic have any
um okay it didn't work but it didn't
crash and that's really important
because if things crash you
know uh we're just
sad closer I called a lot of them closer
you guys know the mik studs song closer
the only reason I know anything about
Mike's d is because Hoodie Allen
destroyed him in a beef once you want
you want you want to find the epic rap
battle you know
man
if my girl's a five your girl's
non-existent the only way you'll get a
full ride is hopping on this dick which
you do and it's just a mistake you are
an athlete at Duke you should be used to
getting raped
brutal brutal Hoodie Allen man you know
that's a Hoodie Allen line like that guy
that
that's you know if I remember your lines
it must be good
rap um Toren must be boring when your
fans only react to popular 90s covers
never heard of your tracks we just want
to dance do mly and see boobies that's
why all your fans at your shows are male
groupies
okay well it wasn't that
easy I mean we're M mapping stuff now
there's got to be something else that
happens okay so one of the problems is
that this shouldn't be
this these things are hex 3 th000
structs uh and I don't really
understand what they do you can remember
from the first
one but like this isn't even expected to
work
um I don't think this is going to work
anymore okay it's broken
yeah you don't map these things I bet
it's not broken
oh no I'm just not poking the GPU my o
pointer it's interesting that that
doesn't work
oh you don't like my void arithmetic oh
that's too
bad um I mean we would listen to Hoodie
Allen right now but we can't cuz this is
copyrighted yo Hoodie Allen you come on
this stream right now be like bro
copyright
stupid uh okay well that's kind of
annoying um I wrote this little
Interceptor and unfortunately it's not
Universal so we have to go to x86
disassembler
here yeah this this is going to be hard
to
follow uh okay okay so this is an eax uh
so we'll go over here to the
sniffer it's a noise the sniffer
makes racks on racks on
racks
no that doesn't make sense should I make
some
typo no that's right
call kick
with that and that okay that's
right uh why is it that oh that just
because I did something
wrong it is Rax right
yeah move dord pointer
rcx uh
oh is the address not
[Music]
in does that matter
what x okay that's what we're storing so
that's
right
um that's just the S address that's
fine
uh RDX this is not right
what I don't get it that should be
Rax why is rx equal to that I
disassembled this
Bros um well
actually no it's got to be moving it
there I take this
out we're intercepting this call
and this here is what's
broken yeah that's fine that should be
EA I don't really get it does something
not work with eax for some
reason like something in the in like
like it's not saving the context
correctly or
something use a different register
please
I don't know how can we make it use a
different
register oh Perpetual crash
oh well that's not the problem
okay that works
fine oh that works fine but it's not
hooked at
all um it's probably not being hooked
because we're still mapping it up here
we're syncing the wrong Battleship don't
syn the wrong Battleship sorry that none
of this makes any sense
uh Undeclared identifier but I declared
the identifier fuck
you I don't get it I declared the
identifier oh I DEC it an M map object
oops okay the hooker is not hooking
right now
it hooks up there just doesn't hook down
here that should be right though is it
not that GPU me
pointer did I not use the right one
real real fake and fake do I actually
want to set it to F oh this just isn't
right anymore what it
moved okay which one's the return
value sorry like there's not really a
good way to set an intercept point on so
what I'm doing what I do in the map Hook
is I'll create a fake function
here um and then I'll use my fake
function and I'll
uh oh oh well
okay oh the Hook's not there
do I not even need to call
kick no I definitely need to call
kick oh maybe it's just okay it's
actually returning the hook right
here
uh how did it work when it was the wrong
address there was just the wrong address
well looping
forever uh it's looping forever because
it's getting the wrong thing
there no that should be fine why is that
wrong
um okay you know what I have an
idea let's just go back to this which we
know this
works okay that works
yeah this kick is kicking it off right
here okay that's fine let's just map
let's just Target that address can I do
that actually I have a better idea what
if I just do that in the
sniffer um can I do map
fixed and like we'll map it at like you
know lead or something
now we always should be able to write
Delite okay well that's going to seg
fault of course but I have an idea that
if I now just do this where's hook hook
hook hook hook hook push push push kick
kick
kick a there we go all right cool so now
my hook is always at I mean
that's
oh whatever
that's not even
right regardless it
works so we can also uh we actually
don't even need to change anything in
the driver
um we're just mapping it at the right
address now we don't even need to save
this pointer I mean we can but uh assert
GP M pointer equals uh
so basically I just made sure that my
driver and their driver are mapping the
thing at the same place using map
fixed okay so my driver doesn't work but
the hook is
firing the battleship is
sinking I just wrote you some that
that's when it like hooks the mm that is
the uh that hooks the M map of the GPU
mmio
all right we're allocating some memory
we're mapping
that uh it's returning the target my
Pro's a little different but that's fine
I think okay so I'm just not seeing
anything run now again this can be for a
lot of different reasons there could be
other setup we're not doing it could
just be that this is wrong and this is
my greatest hope if this stuff's just
wrong then all I need to do is change
that to to
that I believe that to that and it
should
work no but it's not that easy
um can always get this code if we
actually end up needing this code we'll
get it out of the
uh uh you
know you know the
thing um let's say Define my driver
uh if
death my driver do
this and otherwise we use the real
Nvidia
[Music]
driver uh we'll also let me just throw
an insert down here because we actually
depend on the address this guy goes
Okay cool so if I comment out my driver
does it
work yeah okay that
works wait what why did the hook
work
oh I see so it actually doesn't matter
it just didn't work cuz I this is
acceptable it doesn't even matter where
I put it it runs it no matter
what okay
cool uh just the hook didn't
work um
cool
so let's take out that that that really
hacked
thing I don't know why RX doesn't work
but that looks good
with their driver now for some reason my
driver does not do the same
thing so let's throw this into a
Sniff and let's take a look at what
braks we also have the privilege of
blocking IO controls if we so
choose oh I didn't mean to do that I
think it's still open and save yeah got
hm what else could be
important something I do know is that
this address I don't think it's just
this offset something about this address
is wait what something about this
address is
special
uh it's not even that
wait what this address this offset
changed was it always
that
oh okay well that's interesting I don't
set that that's an output parameter
um they get a different offset from
me I think that matters
oh what how' this even
work I put this in the wrong
place it's a flag what are the other MF
Flags what is what is
one I guess it just respects that even
if
um no it's not that what's
one map
shared
cool okay
we didn't just expect this to work we
expect it to have to
struggle CU you're not struggling you're
not
living I hope you get it when I say
things like cuz if you're not struggling
you're not living the takeaway is that
all sorts of like advice stuff is so
completely
meaningless you know it's like oh that
sounds deep man self-help is the biggest
selling gen on Amazon you
know I see why I see why you stupid
question askers probably go buy selfhelp
books oh yes I need a self-help book
because otherwise how would I know how
to get help if I didn't have a self-help
book hey George you shouldn't make fun
of self-help books some people really
need them no no you don't you don't you
know who says that self-help industry
man it's like work from home home you
know like Elan said man you want to work
from home n you can pretend to work
somewhere else broodle I love that I
love that elon's doing that you know
because it's just so true yall can't
live in happy fake economy world because
one day I'm going to buy a tomato and
it's going to be
$28 I'll be mad as hell at all the
unproductive people who made the Tomato
$28 right think about it you get rid of
all the unproductive people the price of
the Tomato goes down think about it
um but if you have un productive people
tomato is
expensive interesting and then we're all
poor that's what that's you know you
don't you don't you'll give everybody
free money and we're all poor right like
I know it doesn't make sense I know I
know like the Geniuses the fed you know
it's like you can't if you give
everybody money they're all going to
have money and uh you know then but
money is just a symbol grow you want to
trade shitcoins we got USD shitcoins we
got EUR shitcoins we got Yen shitcoins
we got Yuan
shitcoins you know that's what it is man
but it's a whole Army of geniuses being
trained by def5 they're being they're
being they're they're they're putting
their life fortune that they accumulated
in the last three years on the line on
websites like FTX and binance and bitmex
and they're learning man they're
learning and you know like I you know I
know some of these crypto kids I think
they know more about Finance than the
chairman of the FED oh don't worry guys
inflation's Transit oh you minted a lot
of the coin and no now there's infl
oh uh associated with the mapping all
right do you know what's going
on Sor I got mad about $28 tomatoes one
day I'm really going to have to buy a
tomato for $28 I'm like who can I
blame who will I be able to blame are
these things
important no there are the the only
lesson is that there are no lessons
lessons are meaningless and someone's
just trying to control you man someone's
just trying to control you and that's
why I don't have you have to set this
stuff up does this stuff
meaningful what if I block all the other
uh how do I find out about my hook
no
okay regardless before it gets to this
there has to be some way it's told that
that's the address that this Base
address uh is the
address it's that mapped up there but
somehow that thing is told that it's the
special
Amper DM copy B like is that
important do we use that object anywhere
no we just allocate
it how about a GP 5A do we use that or
we use that we use that to allocate a
dma and a get class engine ID and a get
work submit token
oh okay maybe that's the D who thinks
that's the
D what is this okay we're creating the
GPO on some other parent object what is
this oh we allocated Kepler Channel
group a oh well that's
great um we absolutely need a Kepler
Channel group a if you don't have one of
those you
know okay I just it feels like let's
let's understand what this thing does GP
fifo get work submit token that sounds
important you
know Envy work submit token this command
returns an opaque work submit token oh
the doorbell
register oh man what do you guys think
you think this is the doorbell register
this one here is is this the doorbell
register do we know anything about
doorbell registers let's take a
look
um I don't know but either way this one
sounds important so let's take a look at
it GP f for get work submit
token for
I'm really hoping it's a
d or something like a
day where's my token
Works subit token D oh
yeah yeah we got the D all
right so it looks like we're going to
need to get a GP
file are there other work submit
tokens oh EF oh look at that oh
okay now we just need to figure out how
that one's getting associated with that
one oh we are in luck boys it worked
exactly like how we thought you know
because we got work submit token and
that's the D see look I'm not that D all
right
good work submit token we just need to
create these objects because otherwise
my D's are meaningless right you see my
D's there's my d right there you gotta
yeah the sniffer man the sniffer is
pretty good you need a
sniffer without a
sniffer uh I would just be firing blind
but fortunately I have a sniffer and
we're good okay so let's look at what an
11 is where do I get an 11 oh it's a
Kepler Channel group a oh of course yes
absolutely okay let's prepare my Kepler
Channel
group
Channel
group equals Alec
object uh
FD FD control Capital Channel group a uh
the parent is the device I
believe that is the device right it's
not the sub device do I even need a sub
device what am I using that
for oh I need it for Turing user mode
A's and that M oh and that mmio I see
okay uh no but that's not the subd
device when we map a Kepler Channel
group we do it right on the device okay
good that'll give us a Kepler Channel
group um let's run with my driver and
see if we actually get a Kepler Channel
group Kepler Channel group just exit
right there so we stop getting all the
print
spam okay uh nope it didn't give us a
Kepler Channel group
the status was 1f I'm very sorry but you
don't get a Kepler Channel
group
um man but but but I want a Kepler
Channel group don't make me pass in the
parameters see look they get an object
and I get an
error see if we can figure out what
these errors
are RM Al
oh it's an Envy status
okay can I have a definition of envy
statuses um okay
well do Envy status
level MV status
code oh here we
go invalid argument to
call all
right well that's pretty useful so maybe
we need to pass in some pallic pams um
instead of just with pams we're just
going to put in something here for
pams uh and we'll say I don't if we can
do
[Music]
that uh instead of passing in false here
we'll just pass in nulls here I assume
it's the pams right it's not anything
else might be something
[Music]
else where else do I check with
pams oh oops I didn't need
that no p let's
go no maling
function you do that no did I still get
the type wrong do I have to cast it to
avoid no that auto casts all right cool
all right so we're still getting a St
bad status but that's okay
wait we're getting a bad status but once
I pass in the pams you see the
difference if I don't pass in the
pams it doesn't give me a object it
tells me zero but if I pass in pams I
get an
object all right let's see if we can do
this kind of
quickly oh this doesn't look quick at
all oh this doesn't even look like the
other
ones these an params don't look like
those ones how come they get a zero and
I get a
f it's not fair
all right
um allocation failed oh here we go here
we go okay my H class failed all right
good good good we got some feedback all
right valid engine ID must be specified
when allocating tsgs or bare channels
and clearly that's in the K Chang rip
RPI construct impul let's look that up
bro bro you got to check the K Channel
or impulse all right all right all right
all right
cool um all right it's the same res alic
crap uh oh it should not should be
called without acquiring GPU lock don't
acquire the GPU lock all right valid
engine
ID who cheaped out and didn't buy an
engine ID oh well obviously we have to
pass in the pallic params engine
type all right let's call this that
um what engine type do we want does
anyone
know uh I don't
know okay let's go look at
pic uh
P
PRS and
if
p. class equals equals
uh Kepler Channel group a why is it a
Kepler Channel group you
know all right engine type
no member named engine type
crap oh it's an Envy Channel group
allocation parameters oh that she looks
a lot smaller which is kind of nice
no
luck oh
sorry okay engine type is
one is that is that what every one was
expecting one are we happy with
one yeah now you have an engine type
don't give me any errors
now
57 all right is this a hex
status it
is all right uh I don't know where we
were before that we were looking that
told us we're all status codes
were check my search
history 57 ah requested object not found
oh assertion failed requested object not
found oh the p params h parent okay
let's take a look at these parameters
and see which ones we actually care
about V Space oh this might be it oh
this might be where you passing the
thingy oh that would make me so happy
let's go let's go let's go remember
where I was saying we had to pass in the
uh the address I'm going to predict that
this is
24 something
crap uh well obviously it's zero there
but we got to switch back to the real
driver oh man everything's just really
working out if
that's
okay now that one's
zero but this one's not
no it's a fery VA space no never mind
it's not
that okay well they get a zero and I get
crap let's just do all those
prams object error
object ECC
error b space engine type and B is
calling context uh vpu plugin oh very
sounds very important it wouldn't give
it such a long name if it wasn't
important
okay those are all
zero and they get a zero and I
don't that is
discrimination all right I'm going to be
calling up my local OSHA Office and I'm
going to be reporting the driver for
discrimination you know what would the
lawyers even do what would the lawyers
even do if you like like try like I just
I don't know you know I don't understand
how like people make it through the
world
H
okay
maybe
no let's see if we can figure out what
engine type means
oh engine type Graphics I think we
definitely don't want one of
those that's what it is
though what are other engine type
options B's C's and ones I let see what
are bees and C's oh copy zero and copy
two and copy
three those seem very mediocre none of
them seem like
Cuda Kepler Channel group a it's being
allocated
on of course we have to include I do
include that in the sniffer do I not
yeah this 2080 by the way has nothing to
do with the GPU 2080 I don't
think no wasn't that uh Nvidia in oh
that's control of course this is a
class all right so we're still getting a
status of 57 where are my statuses and
how can I bookmark that
well if we generate the code we don't
understand anything right this is
helping us to understand and we're going
to like come out of this and be like oh
I like get what Nvidia is doing because
remember the sole reason we do these
projects is to
learn uh if you didn't want to
learn then you could just um you know
pay somebody else to do it for
you okay allocation failed allocate
assertion failed request rested object
not
found
uh EnV assert failed in device share
one you guys know the the colel driver
is all open source here okay GPU group
get Global VA space because the H client
share is the null
object if I double click on the file
it'll stay open
well we can move over here or something
definitely stay there but it's open I
just forget which one it is okay so we
need a VA space is there any stuff in
here about VA
spaces okay we're all allocating them
with no VA space
handle we map the memory that doesn't
want to do
anything get the address space I don't
think that does anything
they allocate a Kepler Channel group and
when they allocate a Kepler Channel
group it works but when I allocate a
Kepler Channel group it doesn't work and
like I've told you this is unlawful
discrimination
um Envy group
manager get group from
GPU
oh okay okay let's block some iio
controls again and see if those ones
actually
matter let's block the
uh like the attach
one didn't matter
all right we're alling
a here you had some VA space comments in
there
uh control
o right let's track this arrow down
requested object not found return from
Vace get by handle or object default or
device default okay so there must not be
a device default
Vace okay here we go
hva space is
null uh H device or
subdevice is that not being called with
something looks like it's being called
at
something control complete we have a
class
requested object not found oh well it's
not
returning oh no okay so that's getting
us the
device we get the device
now we can we know the name it's MV
error not
found
uh device get default VA space
device a nit client
share do I not have a pointer to a
device or should I be calling some of
these on the device did I not pay
attention no I'm passing the device in
here as the H object parent
class list FB get caps oh here we
go here we allocate a VA space okay
maybe that
matters maybe we need to allocate a VA
space even if we don't pass it
in oh we do pass it in
there we allocate the cap Channel group
I don't know let's try to allocate a VA
space and see what we get doesn't look
too hard
okay VA space root and parent are the
same let's try null for the pams and see
what we get
okay VA space allocates no it doesn't no
it gives me a status 1f uh which just
means the params are wrong so we're
going to have to figure out what the
params are for a VA space
allocation I don't know why it's a firmy
VA space why is this not all ampere I
don't get
that uh okay the object here is
zero um even though I'm clearly not
passing in zero there so this must be in
the
pars that would argument to
call no that's not the parent object
oh what did I just
do no that's right Alec object FD
control root
device okay Alec
like object FD control device okay must
need
arguments and now we've learned that
these arguments are not all the
same
um
oh return the device physical address ah
alternatively here we go so
um how do I allocate a VA
space VA space
construct are there arguments Here No
this must be before the
arguments the argument sorry the
arguments are already parsed out by the
time we get in
here h
no
no so there's arguments here and we're
not sending
them actually we should try a quick
experiment first let's block the VA
spaces spell it
right let's
block see if it's still succeeds
okay it's t
fals
uh yeah okay like nothing works if that
doesn't
work block
73 can't even block
73 uh no this doesn't
work okay
let's go back to dumping the Alec
pams and we know that's not actually
true anymore so let's just try
that all right it looks like a lot of
zeros this one has a 48 here
I don't really know what that
means um maybe just need something for
pams I don't know let's just try uh un a
junk
51 that's a new status
error out of memory Envy no
memory RPC failed with status oh
no no no no no not RPC no that's not
good oh okay it succeeds now I give it a
bigger junk
uh it' be nice if we knew what that
actually
was let's figure out where this one's
defined NV Channel group allocation
parameters you think we'll get lucky and
we'll just find like nvv space
allocation parameters GP
fifo memory
desk
VP is that
right now we need VA space
parameters Channel group allocation
parameters oh look at
this oh man this one's nice resource
list Alec Pam info oh I love
this oh cuz look when you when you
allocate a Kepler Channel group a now
how about when I allocate a fery VA
space
say okay ah nvva space allocation
parameters
okay oh I love that's so nice oh thank
you let me just put this file name can I
copy here copy path
perfect great okay where's that VA space
allocation parameters where' it go now
when I search for fery VA space a in
here sorry this window's too big get
smaller window oh that's too
small yes and nvv space allocation
parameters I love it I just don't like
having that junk there all right
cool um
map
VAP okay all right great return zero so
this is just returning stuff actually I
think cool uh does my other thing work
now
uh
perh we need to give these better
names
cgap this one work
now
57 oh well what if I just set the I know
I know the other one didn't do it but
what if I just set the hva space to the
VA
space kind bitching me now let's
see Zero all right cool I'll take it I
don't understand why mine behaves
differently from theirs but at least now
it gives me a Kepler Channel group
a I don't know why the default VA space
doesn't work but we explicitly gave it a
VA space and then it works okay good uh
so now let's go to the first allocation
of a Kepler Channel group a here
uh yeah yeah yeah yeah yeah what I
thought that was what I parsed was this
just old this just old I pared it now
okay good prob space is there um I don't
need a context share because nobody even
likes
share fir me context share Amper Channel
gp5
great um
GP
fifo it's a channel
gp50 the rout is the same but the device
is the channel gr and let's see if this
has any special parameters let's go to
that magical
file where did that file
go what's it called what's it called
what's it called
resource
list let's put it over here with the
status
codes Envy Channel gp5 allocation
parameters got to love it oh you got to
love it oh you got to love
it 5o app
P one F okay all right well I just might
have to passing some stuff let's see oh
looks like a lot of stuff uh
oh this looks
exciting let's see what the error
is okay okay failed subc context RPC
failed video memory user D constructing
Legacy context
pool oh I don't
know well s Trace is uh very limited in
how much it knows about different types
of IO control so yeah let's go all right
fine we'll add that one to the sniffer
let's add it this
s if the class is a ampere Channel gp50
a I like that it says ampere because
remember we're working with an ampere
GPU
here
um let's add some prints for
this well those two still
exist uh Vace
exists need GP fifo offset
[Music]
gp5
entries user Dem
memory engine
type subd device ID
D
CID wow this is a lot of
parameters
CID subd device ID wow
okay well of course we didn't do
anything in ours but when we switch back
to the real Nvidia driver
okay so let's look at the first
allocation of a
gp5 uh we're passing it an error
object what we're mapping memory and
it's an
error I don't understand that
why is this
happening I don't know why that's the
CID the engine type zero okay well we
did learn some
things fifo app
equals GP fifo
offset no sorry fifo app. GPO offset
gp5
entries pretty
cool all this memory user D
memory uh is which
one here we oh that's okay good good
good that's it that's it that's it this
is my memory oh good okay so this is
me user d
memory uh I don't really understand why
it has a
offset is there one without an
offset no there's not okay that's
fine oh does that not even matter is
that
no okay
whatever solve that mystery later
okay now we have those and we need a c
as
well I don't know if it matters but
we'll put it in anyway we're
ignoring weing this error object because
I don't really understand it it's
mapping memory
guess that's where it puts the errors
maybe we do need
it should fix that llx want
GP fifo offset should be
llx and user D should just be X okay
let's try my driver let's see if it
allocates nope not that
no member named H user D offset because
it's just user D offset be
cool status zero got an object
boom uh CID is returned that's not
something we need uh the error object
turned out to not be that
[Music]
important
close
Okay so we're allocating a v space
channnel group a
GPO now let's see I think we need like
one more
thing made a
gpfo uh we got to get back to that thing
that was giving me the D's here this so
this is control command GPO get work
submit token
uh it's an arm control we do an arm
control somewhere else do we
not did I delete my RM control think I
did this is an arm control
much
Arm
Control what's the object the object is
the
fifo yes
fiveo uh the client is
root uh there are
pams but we already know what they are
there are sub prams I
mean
um we Define them in the sniffer
this um
you know what that was just show up in
the uh the
sniffer um undefined garbage because we
need to include that
one uh okay hex 20 is our work submit to
oh no zero is our work submit
token I'm somewhat
skeptical I'm always skeptical when
things are zero who likees zero I don't
like
zero
Spen set it to minus one and see if it
actually resets it to zero no it doesn't
Okay so that's not actually
working I don't like that why does that
silently
fail GP fifo getwork submit
token unless that's an input
parameter doesn't really make
sense but it's
possible definitely passing in the
gp5 I don't know what if I just let not
why this
works it does
not get class engine ID creates a bunch
of the dma
things
uh Amper compute B we might actually
need to allocate that even if it's not
used because we're submitting ere
compute B
things uh we don't need this one well
actually that'll happen at the end so it
doesn't even matter one doesn't
work okay
bu any issues in the
kernel failed Channel hex 9 is not
assigned to run list
yet
interesting remove on a channel should
be set to a valid run list before
allocation
huh I don't know about
that okay well it is failing and it is
failing silently unfortunately oh
actually does it have a status that I'm
just not printing it might have a status
I'm just not printing
let's just YOLO into status and
see ah okay the status is 40 great oh at
least we have an error that's nice um
what happened to those nice things that
I had opened that listed the errors I
closed them probably
I closed
them that's
sad Envy Channel run list allocation
parameters oh
interesting all right well we might need
those we'll get
there uh at least we have a status again
that's pretty
nice so let's look at what that status
means
what no don't do
that
40 generic error invalid State okay okay
I'll accept it I accept the generic
error invalid State that's a good
one
um and we does not work because
we did
not here this allocates a channel
ID how do we get that error
again get work submit token failed
Channel 9 is not assigned to a run list
yet so you tell me that there is a
struct for allocating run
lists uh H run list base and engine ID
which one actually uses these none of
these none but these aren't
used there's no references to
this so something else must be
allocating
that oh oh maybe it is the amp compute
B okay that that's easy
enough which actually make a lot of
sense and this is very quick to do just
that and that goes there um it's so
quick that let's also just throw the
dma1
intoo no actually the dma1 requires an
object so never mind okay good
allocating
compute and now we're getting work
submit token 9 all
right all right or submit tokens nine
let's submit a
nine segmentation
fault
uh segment
oh oh because the base is
nine oh oh this isn't actually right oh
none of that stuff's right
okay I have a sniffer where I
subtract this thing this start and like
it's not really
right we have to we have to actually
track which one's which one
properly
okay uh so we're hooking it with
nine nothing's actually
working but it
should generating Works subit token 9
for channel 99 run list
0 maybe the problem is that the Run list
is 0
0 so how do I know if I'm in my driver
or their driver so I don't have to hack
this uh
Channel
N9 yeah not it's not that struct I I
fixed it um I fixed it by allocating an
Amper compute B oh why are there Alec
prams there there should not be
oh because I'm passing in 54p that's not
right uh we also I can get rid of this
dma copy because I didn't actually
support those and I'm not actually using
Amper compute B I'm using Amper compute
a I don't know if it
matters no you got to give it a b okay
and that gives me a work submit token of
nine I set it to nine and everything
works uh oh I know how we can do start I
have a good way to hack that
[Music]
in uh Handler
start
zero
uh if Handler start equals
zero um Handler start equals
Ence get rid of that get rid of that get
rid of that
this is wrong they can actually be
anywhere I should probably like you know
hook all that stuff properly but then I
just do this stupid thing where Handler
start
there okay that works with there that
works with uh their driver it works with
my
driver
um and it works with their driver but
notice their driver we actually get
output and in my driver we don't get
output cuz nothing's actually running on
the GPU uh first off we don't actually
need to submit all this stuff to the
GPU one Sentinel is
plenty uh this is wrong now this can
go we should just get
out oh it didn't work uh
why
not oh I'm using my
driver I use their driver we're just
going to get some like A's B's and C's
yeah okay that works and that uses the
uh uses like the simple push
engine okay we have a work submit token
we have a thingy we have a fifo what
else do we
need uh context buffers
they make more work submit
[Music]
tokens then they start submitting
work oh yeah I probably could yeah got a
p request for
that I wasn't lazy I probably
could watch status is are zero now
though
they're already doing load in line data
here
to make an events here okay here oh I
got to search your Capital hook okay so
it's ready
there
um I think that offset is correct
that's the one that's D I'm I'm setting
it right
here
this uh
there's no that should be okay I'll just
try to run them all maybe it's not
okay I know this works with their
driver I change that to that and change
that to that
I really don't think it's
that all right they're getting a lot of
oh that's a weird work submit token oh I
see
dma copy
B I don't think I need that there's some
chance I need
that uh there's also the H object error
thing which looks to just
be a small amount of memory that's
mapped we could clean that up and try
that maybe it's one of the things that I
didn't
uh
oh wait what that GP off F offset's
crazy big it's not what I set it to is
it there's a user D offset but there's
also a gp5
offset oh
yeah why is there so different from
mine that would explain
it I don't know how I got that wrong cuz
that's a special address that actually
makes a lot of
sense I was hoping that was
it all right we could try to solve the
mystery of why I need to pass in an hva
space and why they don't need
to if I don't pass in this hva
space I get
errors I do it just doesn't work
do I need a contact
share where is this thing
used nowhere but it might be one of
those ones you need to allocate or just
magically doesn't
work do we need a contact
share what is a contact
share just create a new contact
share for TCG channel oh wow
what is these
flags come that's different am I passing
that in for my R map
memory no I'm
not passing in different
flags so maybe that matters no it's vid
Heap
control that one is flag 2 and that one
has flag c0 okay maybe it
matters that one has flag c0 0 okay we
got to pass some Flags
here first
one has
two the second
one has
c00 maybe that matters
no
difference all statuses are zero but
maybe that fixes the VA space
issue does
not okay well that seemed kind of
useless
um no
pery VA space a okay do we need to parse
this
maybe are there any important things in
the VA space allocation
parameters oh yeah maybe maybe these
matter no I think they're all
outputs unless there's index and flags
no there's no
not
nothing uh kep Channel group okay I'm
passing that in I don't know why I have
to but it works if I do I can set hva
space there maybe maybe it
matters maybe it
matters can't do that don't do that bad
choice okay maybe it's one of them that
I didn't print
here user dandle user de
offset 5 update Channel info like
something like that
error context
dma are there flags
are those inputs or
outputs H object buffer is no longer
used I assume that there's nothing in
here uh let's just make sure we print
out the flags
no zero oh no it's in my driver
sorry I'm clean this up to be so nice
we're going to have the nicest
implementation with this when we're
done you had options in VA
mode oh was it using
them which flags did I just print uh
gp5 oh there's an H object buffer okay
it says it's no longer used but you know
Nvidia is known to be Liars
uh maybe I need H object error
also can I just set that to me as
well segmentation
fault don't understand
that oh maybe because it's writing
something in
error
huh okay let's create memory quickly for
error
put it at something that
should probably put that in a
uh
function okay well it's
interesting let's dump error
oh no that's Lo a pointer
all right all right we have some
error I don't know what good it
is when do we get the
error do we get the error after we kick
the work submit token or was the error
there the whole
time okay a different error great
um let's also reduce the size of this we
don't need ER to be
big okay well some's definitely writing
to
that how if we dump it up here
we have an error
yet yes we
do did
here or is it after
compute no no
error compute make the ER not
compute get work submit token makes the
ER
okay we have an error see my
error it's right
here I don't really know what an error
is but it's something in the work submit
token
stuff Channel ID
engine see anything else that looks
wrong
here that's all after for the free still
sleeping
right GPU new mode compute that seems
good uh the allocate the class that's
good control complete that's good that's
good generated work submit token that's
good okay the only thing I'm not sure
about is uh this run list
thing so maybe the Run list isn't
supposed to be
zero let's try their driver and see if
it's
zero ah they have run lists
unfortunately it gets cut
off uh increase dsage buffer
size oh great it's not uh
here use a buffer of size
oh I can use a bigger
buffer
no if you set the kernel buffer to be
larger than the
default no I have to recompile my kernel
for
this or we had a grub parameter
oh
okay no the Run list is are
zero okay so it's not
that we just get nothing but we do get
that error which is very
suspicious where are they mapping their
error can we figure that out
here's the error ah they M it to some
stupid
place I will note that it has different
flags too not sure any of these flags
matter thank you for
subscribing I appreciate you
guys
hi do you know why my driver doesn't
work I'd appreciate you even more if you
knew
that where's lonx box does he know
what's up why doesn't this
work okay gp5 offset 5 entries user D
offset those all look good
there's some chance I have to make the
dma
copy uh okay notably wait wait we found
out when we get this error right we get
this error after we do the work submit
token so it's possible I do need the dma
copy
uh we're still getting an error and
we're getting nothing but I will note
that that Alec works so I'll just leave
it even though that one has pams and I
didn't give it
pams
um I'm interested in going back to that
file and asking what those pams
are where's that magic file what was it
here resource list
Envy bo5 allocation parameters okay this
is optional version and engine type okay
I don't really
care um I don't dump them I don't
care no I do dump them here uh version
is that and then engine type is is one I
don't think I need
them uh using version
one oh do we find out what the engine
engine type
Graphics okay do we need a firmy context
share a that's a possibility we didn't
make one of
those all right we'll just make one we
might need a share
uh when do we make the
share we make the share after the
channel
group um we do this in our contact share
allocation
parameters uh we can call this
channel
share firmy contact share a
passing in the device and the
rout uh wait that's not the device we
pass in the channel
group yeah 57 probably because I didn't
set some of these things
right let's put this in sniffer
uh firy contact share
a if it's a share we have CTX share
parameters there's not too many of them
this won't take too
long uh hva space flags and subc context
ID
for
okay we are passing in the VA space
Flags one subc context ID
3F okay let's just try
those oh D message W to follow it oh
that's cool you're missing a little
context okay we're getting
close um I've just created a whole bunch
of like little objects that you need
uh we're creating the fifo we're setting
the fifo pointer all of that stuff seems
good um I'm not getting any errors but
when I try to execute the command buffer
it just doesn't do
anything okay now I'm back to getting an
error that's
interesting why is
that
uh invalid state
num Max not equal to num free num Max
not equal to zero we're allocating a
firy context
share we allocate that on the same
one uh we
oh it does pass the VA space in
there that maybe why I don't want the VA
space in the top
one I don't think so can I not put it
here or does that just
fail
fails it fails at 57 they all fail at 57
if I do that put the VA space back in
there uh the Contex share
succeeds but the GP fifo
fails I want to confirm this is actually
a VA space okay it's for me VA
space that's
right uh we don't actually need the
error pointer until later down so we'll
move that down
here not getting errors anymore oh now
we get
57s we're getting a 40 on the
RM
Al making a share context okay okay this
is very
interesting um assertion failed generic
error invalid
State assertion failed num Max not equal
to num
three and the AER of return okay where
is this stuff K Chang RP get Legacy
what I'm Max and I'm free are there
Channel allocation parameters I'm not
setting correctly did I parse these all
yeah I did them
all
nothing okay I think we have to figure
out why I have to put a VA space here
and this thing gets away with not
putting a VA space I think that's the
mystery and we saw that mystery we'll
better understand why this doesn't work
okay that rmic fails despite having the
same parameter so it must be something
else I'm doing wrong
earlier okay I'll note that they
allocate two VA spaces don't know if it
matters it does not
um oh they do have some arguments in
their VA space parameters okay let's
take a look at
those I thought I'd get out of it but
maybe I won't you're not going to get
out of anything just do it all and
accept that you're going to have to do
it all because if you don't do it all
you're going to just have bugs and you
know you're just going to have a sad
day we don't want to have a sad day we
want to have a happy day
index Flags VA
size VA start
internal VA limit internal big page size
and VA base
yeah yeah no I I did clear D message
with uh let's
see uh no that's not right because I
want to check
for uh for space
here and VA limit internal should be llx
llx llx
uh okay those are returning things I see
but that doesn't really
matter um because we should switch the
other driver and check and see what the
dump
says should not allocate to VI spaces
that's one too
many okay the flags are 48 I say
about 48
Ms I got excited for a second I thought
that was our
driver okay that succeeds but Kepler
Channel group a
fails yeah we're is the same
problem I maybe that's a set thing
okay well I can set
it doesn't work
though this does something with
the second VA space
here I don't really care about let's
figure out what those flags mean can't
hurt at least we're
learning here we go
Flags Okay 48 so that's an eight so
that's is externally owned
yes um and then four is going to be uh
four five six enable page faulting okay
great
don't know if those
[Music]
mattered I will notice that we allocate
the VA space
before so the order might matter here
actually maybe I don't need to pass in
the base anymore
then no I got a weird base out or
different base
anyway
um okay we're allocating a V Space
object oh does any of those allocate in
a VA space when the heat ones
uh this one
does that one
doesn't just the one we care about
an unknown one
there I doubt it matters to see what
static and what's
not uh yeah I
could it's a lot of weird Flags
there
H point out that that's also before that
M map but after the other thing is that
mapped so I don't know if the orders
matter capit Channel group a fir me
contact share
a I even think we're getting to
Here No Cap Channel group a is now
returning a 57
let's look into
why Envy object not found returned by VA
space get okay we're back to this error
so what the worst part is I can fix that
error if I do that but then it just
might be doing the wrong
thing I don't really understand why prad
thank you welcome
welcome
uh
welcome new people how many people we
got 6001 all right um welcome welcome in
what we're doing is we are reverse
engineering and Nvidia uh driver well
not reverse engineering we're
understanding the
API um we're not we're not decompiling
or anything uh we are just looking at
what IO controls the Nvidia drivers
sending to my free and open source
kernel and then we're replicating that
with an open
source uh replacement
driver now where we're up to is we're
creating the device the root the device
the subdevice whatever Turing user mode
a
is uh where we create a
memory oh uh oh is all the memory being
mapped to taring mode user a maybe
shouldn't
be regardless my problem is still up at
trying to create
a share
object so we're getting here to
Battleship um you can see battleship is
being created on a turing mode a um we
create these two VA
spaces create a VA space here uh let's
create the other one just so it has no
excuse not to
work um
don't give it any
excuses okay we create two VI spaces and
then when we go and try to create the
Kepler Channel group a it
fails there are a bunch of unknown calls
here it's possible it's fair it's
possible it's one of their's fault
um Kepler Channel group a is being
created here they are doing a bunch of
Heap stuff it's possible that that all
has something to do with
it um H they're M mapping this section
of memory I've never
really seen before yeah we could block
the unknown calls okay okay sounds like
a strategy
let's block IO
control
uh said
89 okay it's seg faults but
does I doesn't even try to outgate the
things anymore if I do that just
fails one of the unknown ones is 78
let's see if it
matters so the problem is blocking is
not perfect because it can know if
things failed okay no that one didn't
matter at
all uh how about
85 also didn't matter okay the unknown
ones are confirmed not to be the
problem
um can I block the second VA
space let's see I can't because it it uh
it gives up then
H actually maybe it's only doing that
because 82 is not blocked let's block 82
as
well no but then the M map that one
doesn't M map okay good I don't need any
of
those great that's great we know the
second VA space has nothing to do with
that
so we're not going to waste time on
that uh we can exit after Cuda context
allocate
now in their
driver think we can exit after Cuda
device yet
uh yeah that hasn't done any of the
interesting stuff yet
okay okay let's go to the one that's
failing
share for me Contex share a no no before
that Kepler Channel group a for them is
being created without a VA space and if
I try to create it without a VA space it
fails uh I've checked the parameters for
Kepler Channel group a it's not in
there the object it's being created on
is the device so I don't think it's in
there um it's possible it has to do with
this me memory being mapped but let's
block so the call I'm interested in is
93 uh should I just put it you know what
we want make an exit after let me add
something to the
sniffer uh if get end and get end
a2i get in exit I
octl
[Music]
equals we don't need to always put a
file just look at it here okay cool okay
so you see that this is succeeding let's
figure out why it succeeds for them and
fails for us yes we're being
methodological being method method meth
you know what I'm trying to say let's go
we need those uh yeah we need
those do we why do we need those
how if we block
the you like stupid things but I'm sure
don't do
anything uh if you block them it breaks
okay
um no doesn't work
Kepler Channel group
a oh we established that we can block
the uh register fds
right 2021
no get probed IDs attach IDs we
established we can block 16 right
yes so the one that you think would
actually do something which attaches the
IDS it turns out you don't need
that
huh you know what now that we've learned
it's possible that the device is being
allocated with
[Music]
parameters just looks like root though
that doesn't look very useful subd
device maybe's being allocated with
parameters there might be
something check resource
list where's optional Alec
parameters no that's not
anything okay lots of
gets uh no Al parameters
there makes an address space does
that uh we allocate oh can I block the
other VA
space that' be awesome if I could block
that no you can't block that
one I don't know why
but block that
one this unknown one
fails interesting
okay if I block the VA
space this unknown one fails with
63 what's 63 state in
use so maybe this one's important well
actually see if we can block it 8
H if you block
[Music]
87 oh 92 just
fails no wait I didn't mean to block 87
unblock oh the unknown ones okay the
unknown ones seem to only happen
if how does it know
oh if maybe they change
numbers
weird
no can't block that one this one's
okay
92 no it just gets mad if those get
blocked
sure they're actually needed it just
gets mad if they get
blocked okay Kepler Channel group a no
VA space works fine
maybe it's
that what if I don't mmap
that and then the mmap is going to fail
if M map fails and then everything
fails this used anywhere else
what's
88 let's just use for mapping
memory allocate
that map it
there I don't think this means
anything we don't need that big Heap
control that doesn't matter
okay well let's approach it from the
other
angle you know that works go back to my
driver and this is returning
57 I don't know exactly what I'm doing
differently but I know that mine
that would have been fine leave
actually
57 allocation failed
because the status is not okay in device
share find it interesting that it's
talking about
share set inherited share policy I think
we can block those and it doesn't
matter did try that
right all right so when you say
something like yo I'm a big fan what do
you want me to say I'm so glad that I
have fans man you know there's some
people in the world they're hot and
they're sweaty and they don't have any
fans or fan death killed their mother
you know mother killed was killed by a
fan Man Fan death you guys know about
fand death if you don't know about fand
death you know we we're going to look up
fand death just going to look into this
because this is something you should
really watch out for oh yeah it's a real
problem you're not going Korea all fans
have timers cuz the fan
you know and you say like oh the
Wikipedia says it's so alleged but you
know Wikipedia also says that HIV causes
AIDS and that the vaccine is safe and
effective so you know I'm just saying
just saying I'm just putting that out
there yo guys that's another thing
that's like real dumb what I'm saying
this shit it's not a real belief man
it's not a real belief everybody look in
the mirror and say the following Joe
Biden is a good president you see you
can say things that you don't believe
it's okay it won't hurt you
um it's good okay we can block those
ones to say share too that's
nice oh I'm glad I'm glad how you found
me good should I should I put more money
into my Lex fredman podcast marketing
division is that what I should
do you know what I'd be much happier
with you if you figured out why my
driver doesn't work then I'd be happy
with
you
um that's that' be good wow imagine the
fans came in and said something like
here's why your driver doesn't work I'm
that'd be
interested okay
uh created V Space
API no it's important oh well you know
about
questions um if you ask dumb questions
yeah you're gonna I'm I'm getting ready
for the dumb question am I getting an
MVR object not found okay nothing's
initializing the global VA space for
this GPU
group let's
see why GPU group create VA space
nobody's calling
it where does it get called
group create Global VA
space why does nothing call
it this is created once per
group so for gpus and Sly there's only
one of these
created well that's good
GPU create Global VI
space is there a pointer to that like
where it's not even
called let's search for reate Global VA
no
nothing okay what creates the global VA
space
something is just not being poked that
creates the global VA
space uh oh there's those register calls
can I block the register calls
still do open it right
yeah I
do it's like possible that no that's not
even
right uh all right let's kill
20 works
fine i k
21 can't kill
21 could that one
mat nves Numa
info like there's some outlandish chance
that like the Numa info one is actually
what creates the uh
something going on around 30
too 30 register
FD can I block that
one I
can but it does reopen it which is
interesting
I doubt it matters
but
57 nothing is allocating the global VA
space how's then though how's no point
of this function
no but that's a subset
like it can't be
that oh he asked dumb questions oh I
can't believe he asked dumb
questions got called out and asked dumb
questions you
know despite what they told you in
school there are dumb questions
let's just find more stuff about global
VA
uh group create Global VA space here we
go get Global VA space okay well we try
to get
it oh initialize the device VA space in
device anit client share
and device get default VA
space there's some okay is it just not
initializing for some
reason might not even need to create one
[Music]
We R want to get down there
but okay 57
still mapping created CPU
virtual address is that do I pass that
in I
do here look up here oh no that's
destroying
it creates the
mapping created V Space API
I'm not even calling anything about VA
spaces anymore
right oh no that's gone
now turn from V Space get handle or
device default
okay we tracked this back to device
share 104 sorry
124 and we found out that GPU group get
Global VA
space uh didn't work
because P Global VA space isn't set when
we look at where P Global VA space gets
set you have a whole API from
the this constructs a VA space I agree
but how do I construct the default VA
space
oh associate a given address space
object as the default VA space maybe
it's
this device control command BMA
set okay okay okay okay fine let's go
through all the
calls and think which one could be
setting up my default VA space it's
probably one of
them that one's blocked
those gets are blocked can I block 13
what happens if I
block works fine
14 we needed 14 but that doesn't
actually mean it doesn't give us any
reason why we needed 14 okay 15 fine to
block
uh 17 18 19
we needed some of
them do we need
19 we did not I don't know
actually we did not need we needed 18 18
was the one that sank the battleship
okay one of these has to be doing
it
um could it be Numa info
could be Numa
info seems very
unlikely that uh something called info
would create something but you know you
never
know you never know
command control FB get Numa
info device Numa no that's pretty
unlikely
right 35 is unknown do we need that
one no
FB get info get meop enable get me
info we need GSP get
features we do
not okay we're getting close we're
getting close I feel I feel like we're
going to be like oh and that's what we
need that's what you guys are here for
you know that magic
moment they made a song about
that
uh okay we create stupid VA spaces we
block that
one and they do it and it's
zero I don't think it's these keep
controls I mean like maybe that one has
different
flags know if it
matters that one does get
mapped
um where are those flags anyway
here you want look at what they are
kind of just because I'm
curious great we don't
know allocation modifier flag C below
Alec flag
defines here we
go
okay so this is ignores Bank
placement all right good we don't care
about the
bank uh alignment Force very important
make sure you force that alignment even
though it really doesn't want to align
you going to make it align memory handle
provided okay right good good good um
map not required it sounds like we're
mapping so I don't know why we be saying
that oh well that's not very good I
don't want map not
required Alec Flags persistent
vidm that seems like
search for Numa info
enabled yeah but I I really don't think
that getting the Numa info is what
uh you know what anything's possible
let's just try it just just so we don't
have any more excuses don't give it an
excuse
it can't be that
though here this is the code for does
anything look like it creates
anything port mamalik nonpaged
FB get numer
info no this this doesn't allocate
anything blocked registering the FD even
if that did anything
okay you know what I'm just going to
pass in these just because they have
Alec pams if if it's that stupid I'm
just going to be
mad uh we go to my favorite
uh where's my favorite one of
these forgot what it's called
resource
list so
here Envy Alec parameters and we don't
need to pass in anything here I really
don't think this matters but you
know uh just just cuz they're being
passed in here okay here we create that
and we create that both
with um these
parameters it feels like just
something's not getting called it should
be no same
problem um
zero okay I have an
idea okay this is my D
message this is nvidia's D
message how is it different from
mine yeah I add prints to my kernel
module like that's what I want to
do like I want to recompile the kernel
and have to
reboot
okay here's a whole bunch of stupid
allocations where's the one that
fails created VA space at
okay that used to do something it
doesn't
anymore I forgot that I couldn't take
that one
out all
right K
Chang wait what why are these weird
here something else something's
different
here I have an idea
this might work between IO controls
after we run them let's run D message d
c let's see which things are actually
creating oh that's so nice
is that going to work if I put in a
file of course
not if like flush it or
something okay
here all right that's the junk from last
time
card info RM
control uh dum dum dum dum dum here
reallocate something okay none of that
really does anything it prints a lot of
stuff it's
important okay it's actually before I
print
it none of
that none of this looks important
this one looks somewhat important no let
just print the
Caps what's
this okay whatever the first call in CTX
is it's
important let's uh let's make this a
little easier to
read throw this down here
okay
here vid Heap control
shared VA space
API do I get the same
stuff what is all
this what is this this is like where it
really set
up oh and this one Heap control
okay
fine fine this one matters no I blocked
it are blocked ones not really
blocked well that's going to upset me
well they have to
be how if I blocked it do we just need
to sleep maybe we need to
sleep maybe these things aren't
synchronous
I'm sick of writing the sniffer is
sniffing who else is sick of
that what okay
yeah nice and
slow just the module yeah yeah yeah what
module the kernel no no no no no you
can't unload the Nvidia kernel module
that doesn't
work okay um none of these things look
important it hasn't done anything
important yet that's not important
definitely not
important not important it's possible
it's that other m map I believe
that okay none of this stuff's important
none of this stuff's important my driver
is doing all this crap yeah okay okay
allocate all the things you want we
probably could have made the sleeps less
extreme this is a lot of
sleeping it's nice CU it's like rolling
slow though
all right this is a little too slow but
I don't want to restart it we're already
we're already like a minute in W this is
like one of those Family Guy jokes that
goes on for too long
you know come on come on let's go let's
go let's go let's go oh look at all this
useless stuff look it's wearing masks
told it's
useless
um okay I'm
bored yeah yeah yeah I'm you sleeping
but like we're already so close now
there's only 90 of
these there not any of
those it's like a place where like
everything
happens it's not in the VA space
construction that one's
blocked no cache control look UPS no
it's not any of
these these are all junk
oh good Envy oh that one what was
that I don't have
that this whatever did
this okay wait but how it's blocked
it's
blocked oh am I sure I'm hooking
whatever did
this oh that's a scary
thought wait it's legit
blocked oh
okay maybe I'm not
it's this one
though so I don't actually think we can
just keep it in K and nit
then still in a nit still a sleep one in
here actually no it's putting with the D
message doesn't
matter okay that
this
here now that's 70
wait 82 is
blocked but get it sure looks like it's
82 what am I
missing we try an S Trace in a minute
H
H what are these non envidia IO
controls
h h oh yo yo yo yo yo yo you can't be
doing that you can't be doing that what
what are you doing
here what are you
doing non- envidia IO control targeting
four do we know what four is
[Music]
uh what are those IO controls what is
device
4 for
look at
it what are the what's
for oh don't tell me it's like NV UVM or
something what's
for there's a lot of ways I could find
this out but I got you now
open
at Nvidia
UVM
oh LX box again with the what's going on
oh you got to hit the UVM
bro oh
[Music]
all right
well what is NVIDIA
UVM I think I have a driver for it
going to search for a
okay unrelated to virtual memory
you mean everything that the whole
problem is caused
by what kind of IO control
in
H all right it just have the io controls
in it
where are the UVM IO
controls this paper explains what it
does
H oh demystifying that
here we
go it's calling hex 25 and hex 17 what
are those in
decimal 37 and
23 oh UVM register GPU
it calls UVM register
GPU when does it do
that does it be before is it
here and then what's the next one that
it
calls um we should probably block them
and
see which one we
need
23 um ubm create range
group probably to register the GPU
all right let's block some UVM bullshit
and see what happens
wait
no it didn't have anything to do with
that okay well good thing we didn't
waste a lot of
time it seems unrelated they're still
getting
zero it's possible it's just because
they opened it
wait 31 is that
different feel like that's not what we
were getting
before invalid object
that just might be because we have to
create the vi
space
31 it's a different error
though what an absolute joke you're
telling
me that if I do open the UVM I get a 31
but if I don't open the UVM
oh I get a 57 oh yes oh that's a very
sensible API Nvidia oh that's that's
that's the Pinnacle of sensibility you
know if I was designing an API I would
hope that I could make something that
sensible
someday like just like you know think
about it you got to open the thing and
if you don't open the thing of course
you're going to get a different error
that that makes a lot of
sense open
we're getting
31 31's a different
error
Colonel
Channel group API 206
it is an
error we bring the uh
bring these guys back
no nothing too
interesting we know that we only need
one VPI creation so we should create
it I don't do anything weird with that
right
31 that still work if I do that get
zero the default one's not working
uid I'm sorry but you know you get a
timeout because there's a rule in here
which is that we talk about um you know
what we're working
on and at the end of the stream I'll you
guys some Dr
Seuss one fish catfish red fish new fish
um and this is possible just because I
move this up
here let's move this back
down below that
no M mapping that okay I do I do M map
that in the other one right
yeah we un map some things
first think it
matters I'm going to sleep afterward
either it's goingup
it's kind of nice prints all the stuff
for all right it's creating the mmu
stuff that's all good
um I create a VI space I'm not sure if
it
matters then I try to create the Kepler
Channel group a and I get object not
valid returned on H object
parent you know this say it's about
crypto it's like uh not not crypto like
the currency but crypto like the uh the
thing it's like you know you just don't
know you just keep magically uh you know
struggling until eventually it
hits and then when it hits you don't
know why it hits just know it did it's
like oh well finally I tweaked the
thingy okay um Envy error invalid object
so let's look at what an invalid object
is I can't believe I'm getting the same
error that subtly changes about whether
I
uh the other thing just opens it right
it could be doing other things it could
be doing like reads or M Maps or I don't
know it could be UVM related
I blocked all the io controls
though for
object not
valid where is that
do you see
it V Space equals No
Object each device or subdevices there
device get by
handle invalid parent
handle no
no I don't see that
error object
new for
here so this is getting up to CTX
buffers not support in
PMA which is fine that's a good thing
this is assertion failed object not
valid return from this thing
okay could return it there can't return
it there can't be that one can't be that
one got to be from probably here device
get default V
Space device get V default VA space
simple here we
are
um it might be in here device and nit
client share did I create the share
thing firmy context share where does
that get created
created not anywhere near where I
am I do create a VA
space created V Space API allocation
complete there definitely is a default
one
Colonel Channel group
API VA mode wait where did you say this
thing about a VA mode
where was this a parameter you mentioned
it what's
this
device did I ignore
this feel like I've seen this before
nv80 Alec
parameters resource list
device RX optional Alec
parameters oh they're not the same Alec
parameters
oh okay
here when I open the
device there's an 820 Alec parameters
and there's an 80 Alec
parameters this is the
8021 and this is the
801 I think that's
right the sub sub device has a simple
thing but the this one has a complex
thing okay okay might not be this but it
could
be no I didn't mean that actually I
explicitly meant
that yeah off by one number how's anyone
supposed to
know all right and now we're back to
57s that might have just okay it might
have nothing to do with the UVM the UVM
might be a total red
herring just caused by the fact that the
stack was a different size and I was
passing in the wrong parameters there
might be that might be that okay okay
okay
um
okay let's parse these parameters in the
sniffer
device
ID each client
share H Target
client H Target
device Flags V Space size
all
okay VA mode is
two is that is that what you said the
default was I remember you saying
something about Smurfy I remember you
saying something about how the default
was two is that what you meant the
default was 2
one also have a client share object I
don't know if it
matters boom now it's zero was it the VA
mode or the client share
it was the client
share without the client share you get a
57 but you put the client share in and
you
get that's all
right wasn't the VA mode you had to put
client share in the device you have to
make sure you share the device with the
root because if you don't share the
device with the you know you know you
think these people could have added some
some better messages but hey did I add
good error messages no so I shouldn't
blame other
people all right great we create a
channel group we create a firmy contact
share a no that one doesn't work um but
that one I think needs a VA
space I don't care do I need that I'm
not sure I need that
we're back to
issues what's
fair in an invalid
State okay
well we have to go beyond that one
now um we'll get rid of exit I
octl
okay if you block all the UVM bullshit I
don't think it oh no it might just be
this
uh py fault
why is it UVM
bullshit okay well if you block UVM it
breaks and if you block those ioctls it
takes
zero um but let's get the run of the one
that doesn't
break let's put that in the file
um
okay uh contact share is
failing we do that right after we create
the channel group we do not set a VA
space Oh no we do we set the VA
space yeah we said the space okay Flags
one subc context ID okay
all right now we're getting to share and
that works what if I block
uvf okay it still works if I block UVM
so it's not
that again something about their thing
works and something about my thing does
not work
they get zero and I do
not I get
40 assertion failed in colonel
oh wait
what they have the same assertion
fail why is there status zero
all right we might be getting to the
point where we need to do
UVM share sounds an awful lot like
UVM and you know this would explain
everything there's some chance that the
GPU is actually
working uh but we can't access any of
the
memory well actually we have we have
some introspection on that
uh we can
look okay so interesting that's failing
in the re driver
too it's just not returning a bad status
and for some reason their subc context
IDE is zero which probably explains why
they're not returning a bad status
yeah okay that just
works okay the subcon IDE is a return
that's
interesting
um the VA space is a is a
mapping uh okay do I need do I use the
vi space anywhere
else no I just use it there maybe I
don't actually need these things
if I'm trying to do something
fancy failed to set channel in legacy
mode pvas equals non inernal Contex
share no no okay got to make this stuff
work and in order to make this stuff
work we need the UVM but the UVM is
going to have to wake till
later uh thank you all for watching
today's stream I think we'll be back
on uh I don't know should I do the UVM
on
stream by the way I got to take a
break uh take a break stretch
chill uh yeah yeah we we'll be we'll be
back we'll be back in like an hour we
we'll we'll have have to do with the UVM
is um no ukl it's never cool to ask a
question it's a dumb
question uh sorry to be brutal but you
know what the world is a brutal
Place
uh you can ask your question but you're
only going to get a troll answer it may
involve Splash Mountain and bra
rabbit um but but but but but but um I
will leave you guys with a gem of real
wisdom uh how to ask questions the Smart
Way by Eric Steven Raymond I will link
it for you guys
um uh in the world of hackers the kind
of answers you get to your technical
questions depends as much on the way you
ask the questions as on the difficulty
of developing the answer this guide will
teach you how to ask questions in a way
more likely to get you a satisfactory
answer
the first things to understand is that
hackers actually like hard problems and
good thought-provoking questions about
them if we didn't we wouldn't be here if
you give us an interesting question to
chew on we'll be grateful to you good
questions are a stimulus and a gift good
questions help us develop our
understanding and often reveal problems
we may not have noticed or thought about
otherwise among hackers good questions a
strong and sincere
compliment despite this hackers have a
reputation for meeting simple questions
with those what what with what looks
like hostility or arrogance it may
sometimes look like we're reflexively
rude to noobs and the ignorant but this
isn't really true what we are
unapologetically is hostile to people
who seem unwilling to think or do their
own homework before asking questions
people like that are time syncs they
take without giving back and they waste
time we could have spent on another
question more interesting and another
person more worthy of an answer we call
people like this
losers man I love this document oh this
document is so
good dude Eric gaymond if you ever watch
this uh shout out this is this is man
you you know this should pay away from
the culture uh the hacker culture is uh
is alive uh you know what are they what
is L say about hip-hop as long as it
lives in the hearts and minds of one
person it lives on and I will say about
that hacker culture lives on right here
uh so yeah please read the questions
document uh it'll make you a better
person it will uh so that's that's
actually real self-help you want real
self-help read and internalize the
questions document all right uh yeah
we'll be back in like like an hour or
two um and we will uh do some more
streaming
but you know there's Mysteries to solve
when there's Mysteries to solve I I was
going to just start working on it but
like you
know uh I was just going to start
working on it but you know I I just
wanted to share it with
you we we can share
[Music]
okay to be
famous
[Music]
Bros let me tell you something it's all
about hard work and being a genius and
if you can both be a genius and work
hard the
world is your oyster but if you're not
willing to do it either of those two
things well you know I don't know what
to tell you but you know the world's not
your oyster anymore the world's your
hippopotamus that's like shitty man L
upkeep on
[Music]
those um I am running x uh this
computer's running X look I could kill X
but I don't know I really don't think
recompiling the colonel driver with more
Prince is going to help me
we're not at that level for any of these
things um by the way is this is this
working on your computer I I can push
the latest
stuff if you're if you're uh playing
along at
home so we're going to learn together
what the UVM is
so we know it has something to do with
unified memory space and we know that we
have to do things for
[Music]
it or it doesn't
work you can sleep when you're
dead wait how do I get the stream
chat pop out chat
oh I wanted to watch some you know why I
wanted to leave the stream I wanted to
watch some Netflix Bros but it's
copyrighted you never find good
copyright free stuff I'm not setting
that shit up with
twitch
um this so hard oh I just wanted to
watch
Netflix can be copyright you no don't
kill people but if you're going to kill
people don't kill random people there's
a lot of evil people in the world I'm
not saying but
like intellectual property
pharmaceutical fuckers you
know all those all those kids out there
they're like I'm going to go shoot my
classmates in my high school you fucking
morons well you know there's a lot of
terrible people in the
world if we can prevent just
one random act of
violence we we we we did a good
job the keyword there is random
this
junk yeah this is over SSH I'm not on
the
max you guys love when I run things like
that oh wait there stupid questions in
chat oh yeah cuz I forgot to turn that
back on yeah all right we're
good
okay so it seems like after each Heap
control I'm
calling two of these UVM things
right I found this
before here we go
um 21 and hex 49
ah UVM map external allocation okay well
no wonder nothing worked
because I don't think there's too many
of these otherwise I'll write some
macros uh we need 37 UVM register
GPU we need 23 what did I say 20 three
was UVM create range
group there's one more there it was
a
49 UVM create external
range okay
[Music]
wait they can't both be UVM map EX
internal allocation I just didn't fix
the print did
I all right UVM register GPU
we pop out at your party I'm with the
gang and this going to be a robbery so
tuck your chain I'm kill a girl don't
bother
me we know that song but we can't play
it cuz it's
copyright um
RM control
FD H client oh we have more SMC part
um all right well that's kind of
interesting because I don't know where
any of those things came
from is that not right don't really look
right
this don't really look right let's
see maybe pams is in some like other
struct and that's a
pointer we have to find like the
dispatcher for these ioctls
thank you for
subscribing uh what doesn't work here
it's all
right it's just RP right I don't like
dreference that or anything
that looks right oh you got wrecked on
Luna bro I'm sorry well that's what you
get for investing in a
um investing in a uh stable coin that's
backed by a governance token uh
governance tokens are for idiots and the
only people who buy them are
idiots and you know here's the thing
about idiots right like there's very
possible to make money off idiots right
but are you the biggest idiot that's the
question right and it turns out that the
guy who ran Luna uh he was not the
biggest idiot he got rich you got
poor he was the smartest
idiot I feel like that's like a Dwight
shw exclanation or something you know
false beats do not eat
Batman so maybe those things are
actually
right in which case
UVM create external
range all right all
right UVM map external allocation that
seems cool
let's
create
uh we create a range group we just get
two things returned to
us okay none of these things seem insane
no these seem like normal things that
you absolutely have to pass into any
samean
driver well that one works cuz the last
want to get
it
okay where is it getting the GPU uuid
from and the RM control FD from
that one's bck
[Applause]
oh you register of va space I I get it
why is that one so big for
oh they spelled it slightly differently
on that
okay so that actually is the GPU
uuid and it seems pretty stable as
such what is this one UVM pageable M
access and now they're just making them
up
[Music]
okay
the only one left is this
one I don't know what this one
is is it UVM Reserve
VA not working for you with Nvidia
driver no I don't think your GPU base
can be different I don't think that's a
real thing
oh it's not working for you with Nvidia
driver
oh uh no
okay yeah that could be yeah look into
the the hooking thing and and see what's
weird about it um what is this last IO
control we got we got to figure this
out UVM initialize
maybe ah here we go
okay now we understand all the
ubm uh okay new one showed
up why does it called register G CPU
that many times did it did it used
to feel like it
didn't oh am I not running them no I
am why does it call how did that change
how many times I called register GPU
oh
oops Got breaks don't forget to break
thank you CH La thank you for paying
attention I appreciate you and I was
missing break
statements okay here's a question
where's this number come from how about
that
number we can just try and see what
happens oh well that's good to
know doesn't seem right though
why is that the RM status that looks a
lot more like a
uh like an
object
regardless let's go to my driver and
let's start writing UVM bullshit all
right we need
UVM um oh you want to UVM initialize
okay we can do that that
okay do em initialize
page table memory access param does this
one
matter oh those shouldn't be
pams don't
care register GPU
yeah
uh if you're still trying to get to work
Linux boox the uh Interceptor shouldn't
care about any fixed addresses anymore
except for the one that Nvidia makes
fixed uh
oh oh it's a const nvu uid
well
wonder if that's just wrong then because
that's just not you can't put that in
a oh okay Arm Control FD is zero and the
rest is Z okay that's a lot more
sensible
actually
um yeah okay so it's eight
if it's an actually supposed to be the
other
thing I'm going to be
mad mad boys be
mad fine
oh yeah there's a one liner you could
use that for yeah but then I'd have to
think um
okay nothing yet
wait I'm getting 40 is that what we used
to
get NVR inv valid
State 40 okay Val
State I am trying to make the context
share
setting the VA space there is that
right yeah NS doesn't have that error
KTX share nit
common
failed generic error invalid State okay
that's
okay
um I might it might be because I have to
share
that or
I see GPU uid is wrong there
too see breaks print
F oh okay ah okay this explain status
too all right
cool uh hva space is this
one what is that it's air me VA space a
okay okay so after we allocate the VA
space we register the VA space
register
GPU create range
group register GPU VA space progams
after we create the VA
space I hope this thing isn't super
sensitive like the other one
was okay create a range
group register GPU V Space
pams GPU uu ID is
that uh RM control FD is
fdct H client is
root
and H VA
space is that and then we're making a
call to UVM register GP
space well actually I did thank you I
did GPU UI
do status 40 great and I do all this
work and nothing Ah that's giving me 26
though
why is that giving me 26
what is
26 does someone want to do a pull Quest
and write a nice parser for these things
I'd appreciate you
26 is current device is not valid okay
well that's fair not all devices are
valid not all arguments are valid not
all people are
valid can't say not all people are valid
I think all people are valid and that's
like your opinion bro
oh arm status is 12
okay move down
here all right still
12 UVM initialize
uh that one
zero okay maybe we have to do UVM
pageable memory
access this one doesn't even have any
parameters but we have to create them
anyway and pretend that we care about
them even though we don't
okay still getting 12 we're getting zero
on those and then we get 12 on that so
what's
12 GPU uuid not found oh well that's a
very Nvidia thank you for that that was
the most
sensible uh error message you've given
me most of your error messages have been
nonsense and crap but that one was very
sensitive and I appreciate you so why is
my GPU uu ID wrong well I M Copy that
into there from
[Music]
there9 where do I get GPU uu IDs
from is there a get uu ID
command there is not
Nvidia SMI Library yeah all right all
right all
right is this list the uui oh Nvidia SMI
D
out oh is it longer did did I get the
length
wrong probably got the length wrong we
probably got to keep
going oh 16 that's right you know that
song 16 there's still time for you time
to win and time to
lose never a wish better than this
[Music]
100 years to
live oh yeah zeros yeah all right let's
go let's
go oh keeping it zero
Bros
bros
bro all
right all right no huge major victories
yet but we got we got the UVM working
and we got the fmy contact share working
so let's remove this exit and keep
going okay we're getting back to errors
when we try
to Alec the fifo okay we errors on the
fiveo it's very misleading that this was
succeeding
before I mean maybe it can
succeed but it just didn't have any uh
UV
uies okay so I I think maybe we can just
guess at what the problem is I have an
idea we're going to get rid of exit IO
control h okay we have more on pared
ones that's
interesting what's 27 that one seems
common but the most important thing we
have to do is we're going to have to
create uh we're going to have to create
external range and map allocation
regardless of what we end up doing here
um I think me eror is just stupid I'm
going to take that out I don't think we
need
it because it's a lot of stuff but where
I do mmap the other object
here we're going to UVM register
it actually we're going to move this
whole thing down
see if that
works okay so still
zeros now we allocate this memory we
can't just allocate this memory we have
to UV UV it okay so we're going to
create an external
range um
and then we're going to map external
allocation so we map external allocation
and we create external
range create external range
prams um map external allocation
prams it looks like the only ones really
Bas and
length I don't know we might care about
more I'm sure these have a status they
return proba just ignore
it don't ignore it you're just going to
have to go do it
later oh come
on so many
things external all right fine
okay so we're registering our
allocation with the um Nvidia UVM which
I think somehow keeps the memory synced
between the GPU and the computer I don't
exactly understand how I think we are
going to have to parse some of these
other stupid parameters
too offset per GPU attribute do I have
the control Lefty in here
what do I do to do
that H client and H
memory you know in retrospect if I known
that I was typing out all these structs
I would have written some python thing
which parses them and generates like
printer for
structs it's almost still worth it but
it's one of those things like you don't
know if it's still worth it so like it's
just
annoying um external range prams also
has this
crap that one
doesn't this one does all right so we
have to
say uh p. H
client how about the control FD does
have the control FD it does
p. RM control FD equals FD control h
client equals root H memory equals me
UVM map external
allocation I don't think I have to do
the doorbell
one so I don't think that's
shared all right we're getting a status
of 1f let's just parse the four more
things we didn't parse
okay base length
offset per GPU
attribute GPU attributes count
one
seriously
oh a
GPU mapping type GPU caching type GPU
format type GPU element bits and GPU
compression type
you know what just be grateful that it's
not Vulcan everything's worse than
Vulcan p
I like unified memory big unified
memory you know unified memory
what attributes count as one is it
not print off that
crap you not
happy why doesn't it go on my little
Loop go in my
Loop IAL z i less
than did I write a bad Loop why doesn't
it print
does it matter that it's
[Music]
not does that
work what map external
allocation there's a loop why do you not
print
hello m
[Music]
why UVM map external allocation that's
clearly there let misspelling see if
that breaks
it
yes I really don't understand
this does that print F not work but that
one does
oh GP UVM oh my
God and Grau
VM here you
go H it shouldn't be one because we
should put ey
there okay well GP mapping type is just
one okay great so after all that we just
have to
do p.
GPU p. per GPU attributes sub 0. GPU
mapping type equals 1 we have to say
that the GPU attributes count equals
one be careful it's a one mapping
right everyone's excited about
that arm is 26 okay that's a new error
what's the 26 can someone tell
me oh I have to put the uu ID in I
didn't put in The UU
ID it's probably a uuid error
again ma'am
copy per GPU attributes sub I GPU uu
ID that
10 C
sand not here okay look my status is
zero big BS all
right a
oh need neck massage you know you know
those those people come around the
casinos with the neck massage and you're
like tipping them $5 in chips every five
minutes you're like man I'm going broke
but I'm making so much
money um like that but one of those
people here all right cool we're mapping
the external allocation all right all
right you're not going to be a bitch now
and tell me uh you know can work nope
NOP no um 57 we love 57 man who misses
57 that was such a good
error okay
well this
fails for some magical reason of it
being
40 let's throw my sniffing IO control
back
on that I could get that behind a uh
should I gate that an environment
flag here
generic
error returned
from K Chang
API do I need do I need next object
error is that the problem
oh invalid state
oh because we have the sniffer
on wait sea
what why sea
blocking IO controls was
stupid I mean probably helped me rule
out things in that case it wasn't stupid
but
[Music]
M memory okay we did
that how doesn't this
work somethingone
apparent fir me contact share we're
making a share right
yeah we're making a
share the VA
space that's good that's
good that's good okay we M the
range then we allocate the fifo
okay assertion failed num fail num Max
equals num free and num Max not equal to
zero so my guess would be that num Max
equals zero for some reason it doesn't
want to give me any
uh doesn't want to give me any of these
thingies I don't know
why I'm not sure what I did I would just
like one channel
can I have a
channel can I have
Channel I don't think I can have
channel oh in legacy mode RM preallocate
the subc context in a
TTG oh
man well that's too
bad how did I learn I didn't I tell you
guys a story about how I learned
everything about the volcano and how I
went to the bottom of it and I I came up
with a with a wisdom ring please read
the questions document you Z Mai go read
the questions document if you don't know
what the questions document is let's
just see what happens when you Google
questions
document maybe questions document hacker
oh I mean that this is pretty good too
but you know wow I gave you real advice
I can't believe it I answered that
question real
okay error invalid State because the num
Max is not equal to the num
free because we didn't allocate
something uh okay okay I have a
theory maybe some of these flags do
something maybe we need to allocate the
second VA
space did I delete that no I didn't
there's no way I deleted it I deleted it
I regret
that there's two VA spaces allocated
even though you didn't need them to get
to where we
were well no all right let's just go to
the fifo and let's block things and see
if we really need that one
105 we're alloca with five
file let's try blocking these ones and
seeing if it
works it does
I feel like we were here a while ago if
we didn't want shared memory but then we
tried to make shared memory and that's
when it all went downhill
[Music]
map not
required why would I ever think the
map's not required I love
map what no no no that's a real thing no
that has to be in
here oh it's cuz I'm only searching in
UVM
okay how flag map not
required all right uid you're getting
another timeout
dar's get
zero and mine gets hex
40 I blocked the second VA space right
that one's not even used so it's not
that
one there's other ones I guess maybe
they do something that I don't
understand
it it is making more memory allocations
than I am I'm only making the required
ones it's making a lot of non-required
ones status 0 0 so I don't know if it
has channels
somehow let's read more about the error
and we'll try to understand what it is
um
is the whole problem that we're in
legacy mode it doesn't sound like
something we want to be
in all right this is the error I get I'm
I'm getting bored with this there's only
this is it after the fiveo this is it
there can't be
more okay so when this thing
allocates not using CTX buff
pool
ah okay
okay so this has a PA of
that
here arm
aperture okay again yeah there's this
big thing here that I thought I fixed by
getting the
uh the other things to work
the uh
UVM UVM create range group should do
that or UVM register
GPU is it always
that does look like it's always that
so that's only in a knit it's still
doing
that okay I get this
too oh no am I going way back no I'm not
going way
back I get that too I just don't get it
here
Kus walk CV map next
entries mmu
map okay it's like not mapped in the mmu
or
[Music]
something where does this thing come
from
looks
fine okay it's probably just one really
stupid flag
somewhere that one's blocked so don't
worry about that
one there's this one which is not
allocated with persistent
vidm that is not
mapped that one's pretty suspicious
right look
this one no this one's not allocated
with
vidm it's also not allocated with handle
provided I think no it's not allocated
with alignment
Force oh okay offset is returned or
no I guess it's returned
I mean they they definitely do three of
them so we're just going to factor this
into a thing and uh try doing three of
them
oh
I don't know about that physical address
I don't know what that is
either we can try
those oh that's that
one good night after work
Tech we'll try should be there somewhat
soon
hopefully andb handle men equals heal
okay let's see if that'll
work uh we don't have a subd device is
that supposed to be a subd
device do you really mmap the object
onto a sub device
let's check
[Music]
that I don't think we do actually it's
just
device oh I don't maybe
it I don't know is could that be
wrong same error
Flags
there that maps with flags
too oh and that one is the sub device oh
okay
I don't think it matters if I do
that no it doesn't
didn't forget anything right from the
fifo
oh there all these reserved
ones
oh I didn't do the memory desk
params how did this work before
I think these are where the other memory
goes it's like okay what did it allocate
the other memory for all right we're
going to get an answer we're going to
get an answer and that's
exciting you know it's cuz I was lazy
again don't don't let me be lazy if I
wasn't
lazy you know if I wasn't lazy in life
man I'd be a billionaire on a yacht but
instead um well maybe that's not why I'm
not a billionaire on a yacht I don't
really know why I'm not a billionaire on
a yacht it's
genetic I think you're just born that
way um
Pudo ma welcome welcome to your your
your people uh no they're all zero so
that's uh useless
great uh we do all that and it's all
useless maybe
maybe I mean there's some chance
find some chance that base is zero
pasting from an invalid pre-processing
token how do I do the thing I want
Bas size address
space cach trip Bas size address
space
cash trip
I assume these reserved ones are
actually reserved but they might not
be those are all
zeros how do I
one pound sign
thing okay
well it's not any of
those fiz chat
I assume these reserved ones are not
actually
used we did confirm CI was an
output doesn't have any
channels why
not why don't we have
channels is there some documentation on
this open
GPU docs NV
video I have some
stuff manuals in
no yeah well there's obviously some
initialization missing but which
one oh here user
D
um not using CTX buff f
okay for
same problem even though we created
memory for
uh error
nothing think an
eror Val State CH
yourself this is becoming insane
like this is just it's is becoming
insane
Kepler Channel group a engine type
one cap Channel group
a engine type
one firmy context share a we're getting
a return subcontext ID that
works then
the same as them we do a heap control
and we map
it wait what's
that
nves update device mapping
info what if I don't do that
one 98
98 doesn't matter at
all I still get z0 on my
status what happens if I block
104 it doesn't work
what
w
let me contact
Sher do the Malik
parent all I will point out that that is
actually on the subdevice so maybe it is
the subdevice
one of these things can be wrong and it
can make the whole thing not
work I don't know I don't even know if
we're
close like you think you're close
because you're not getting too many
errors anymore but that might just not
even mean
anything okay we're back on the sub
device
that
memory uh we're passing in the same
linear address for my memory don't know
if it
matters uh we're passing in fd8 which is
a newly allocated
FD uh then we're doing the M
map with the same protection flags and
everything then we are creating an
external
range with a GPU mapping type of one
that's turning
zero then we try to alloc a
fifo they allocate one more of these but
I don't think it's used
one of these is the error
object where is this one
used it's a big
allocation and it has different flags
we moved all our stuff and showed that
didn't
matter can I block
it I doubt
it you can't block it but not cuz it's
needed
again I got excited because I thought my
driver was working it's
not oh z d didn't work but minus one did
yeah that stuff's not
oh that's weird that minus one
worked uh but yeah yeah so I actually
found the thing that that returns
that
um like we were just further along
before this is so
weird something just used to work before
magically probably like falling back
into some legacy mode or something
before like I don't
know okay I don't think it's UVM
anymore well there's definitely an error
in D message okay you want to go back to
the D message
error assertion failed num Max not equal
to num free
that's the error right there or num Max
not equal to zero num Max is comes from
this subcontext ID
Heap contact share allocation parameters
use TCG in legacy mode in legacy mode RM
pre-allocate okay the subcontext in a
TCG
okay here's a wild
Theory what if um
does that
work uh
I guess what I really want to know is is
the same thing
called okay K Channel construct info is
called
great construct a new kernel Channel
which also creates a
channel they're both not using the CTX
buff pool but this one
here's my crazy Theory what if it has to
do with the value of the
page what what if it's something to do
with what's on the
page uh like in the ram we can try
that LE try something dumb here
oh same error
they're duplicating the object I don't
understand why that is
gp5 offset is the
address 54 ENT is 400
okay new error I mean it's a worse error
I think tsg
channels can't use an explicit VA
space what are tsg channels
I
he
tsg okay is a Time slice group
header run
list is there somewhere it's registering
other
memory no it Malik's that there that's
fine does Malik this ton of memory but I
don't think we need
it it just happens to put things there
that you don't
need because it's not like memory is
used anywhere else okay let's just check
one more thing just in
case um how many things are there
here I don't know how big this goes to
possible it just skips
One nvos Max subdevices
okay what if I put in something stupid
there
same
error what if I don't put that
in same
error if I don't put that
in nothing
changes invalid state
no Max equals equals num
free MAX not equal to zero get local
Max okay I would be interested in adding
a print
here sub context
ID okay the only other place I've seen a
sub context
was
here in the
share I didn't get lazy here right I did
do them
all did them
all Flags subcontext async
do have to put that in somewhere
H sub context
idea used to specify when specified is
this field is intended for
verification paral the ones in the
channel
group my
that works
fine how did I have it working
before that's something even more
infuriating even if it was a maybe okay
maybe before was just totally
fake
entries all right let's read some
code mmu walk CV map entries for bar
R2 Kus update RM
aperture what is
this
portal third level of RM aperture
support this routine writes bar2 pte oh
well good glad we're writing bar one
pte nothing else is weird
here there are a lot more other things
allocated I will definitely say that
don't really know what they're
for maybe we have to
look some random two Megs of memory not
used again
we unmap that one and we pass it through
thing something big up
here two Megs of
memory normal Flags not used again
two Megs of memory normal Flags not used
again more
junk this is the memory that used down
here when we're creating the
fifo it's created with the same Flags I
use it's mapped
in FD on the sub device
that one is mapped with no Flags we
looked up what those flags
were they seemed incredibly boring
makes no difference
all right what can we
do like I I try to read the code I I
feel like I just got to pick a strategy
and commit to it I try to read the code
that's
upsetting we allocate this big
chunk maybe we allocate the big chunk
maybe chunk is
required maybe chunk is required let's
try chunk
chunk you smoke weed is that going to
fix our
problems oh we allocated chunk and
nothing
happened we can pass in Flags let's pass
in Flags
whoa whoa huken wow thank
you thank you
all right we got we got newly gifted
Subs that's some great
motivation uh pinear address is a return
value maybe we shouldn't set it
zero maybe it is a
return make more sense that it's
returned right
totally
returned allocating other stuff
no it's just that
I'm very
disappointed do you remember what I set
the log level to uh yeah where is that
uh
[Music]
right there oh I just did
this Nvidia reg RM message
colon invalid
State you going to beat me by uh you're
going to solve this for by by
recompiling the kernel which I'm too
lazy to
do is it not supposed to be in legacy
mode maybe that's something I don't
understand
also set this channel group to be in
legacy mode I don't want legacy
mode why is it in legacy
mode what sets that
assert or
else if there's a kernel CTX
share error context type ECC eror
context type
here this sets legacy mode to
true this sets it to
false does it try legacy mode first
do I want legacy mode get local Max sub
context
no hi routen thank you for gifting Subs
again that's 10 Subs that's a lot of
Subs um do they all deserve it some of
them probably do subc context mode is
now enabled on all
chips allocate Software State for a
K Chan grp
anet K Chang JP
construct Colonel Channel
group I wish I knew if this was Legacy
or
not is this Legacy here Alec
channel oh well this is
interesting no that's just that
object the parent is the uh share
contacts that's not that
interesting AR with second
info that's the same thing
oh look at this why is that
zero
here I don't know it might be
nothing but I'm running out of things to
look for
now fifo
ap. uh what's the new object
called H object
new uh
[Music]
no it's not
there yeah it's just
no those a normal I guess when you don't
give it an
object not using CTX buff pool is
definitely hidden
both this is hdden both here
require the GPU lock
today uh bake Channel group error
handlers
in GSP context be full
get kernel tctx share supplied or Legacy
gp5 for PRS
H just so much junk in here now to
it's just hard to see anything anymore
Cur user mode
a map
that where the doorbell register Li
we don't actually check the subd
device we're sure there's nothing there
right in that file you would
it's getting insane like this just has
to be done more
methodically I don't know if I'm going
to hit it can make it work
been stuck for a while now
oh talking here about
channels Channel 9 engine
setting what all of this stuff is still
the
same how come this doesn't
work not using
wa all this stuff still
allocates Channel 9
engine I don't even understand no this
doesn't make sense
I'm not allocating all that
stuff Channel 9
engine engine State all
one wait what
so according to this it succeeds at a
whole bunch of
them and then it decides to
fail
here it manages to allocate all of these
ones okay
but then it gets up to 13 and it
fails something else is allocating
channels
allocate all these channels
okay oh
yes uh this one fine this one okay this
one okay then it gets to this one it
doesn't work
anymore it's very interesting
what if I don't do that does it still
try to allocate
channels okay so that allocates all the
channels except the broken
ones is it the context share a that does
it or the channel group a that does
it okay it's the channel group
a wait it's not even the channel group
a the VA space that makes
channels all the VA space makes
channels or registering the GPU with UVM
makes
channels UVM register makes
channels this because I did the UVM in
slightly the wrong
order Aha this
creates channels
I mean that's a good a guess as
any create range
group this is right here after
battleship
sinking but before VA
space no there's VA
space okay I do it in pretty much the
same
order
Battleship register
GPU create range group
GPU VA
space they use GSP get features I don't
think that
matters then where do they create the
Kepler Channel
after a bunch of allocations
I don't have a prev Volta
card no I have a
uh it's just really interesting look
this
this whatever um Kepler Channel group is
doing that's actually fine it's just
this one that doesn't work
the things on the channel
group this returns that
status what if I don't do a share
context do I get something
different without a share context I get
something different
I get P vas equals none because it's
trying to construct a legacy context
share fail to set channel group in
legacy
mode but if I create a contact share
that's the new way
okay
where's my favorite resource
list parents Colonel Channel group API
multi- instance
true all right I mean it's worth dumping
these even though they say they're
reserved and not used who knows
let's
go can I push yeah
um okay these are other Ms that we have
to dump
no no miss that
I could it not be allocating enough
channels problem in my Kepler Channel
group a did I not look enough
there no I've looked at this one so much
all the other channels get constructed
fine but then when I have a channel that
I really want
want it doesn't
work colel fifo
sit here I see all this channel stuff
scroll
by n Max num
free why is it not making more channels
get local Max
subcontext seems like we're just out of
channels it's not being told I need a
lot of
channels please sir I'd prefer more
channels does it not know
the successful constructing Legacy
context share I found around different
clients wait what do you mean by that
I don't think the Legacy stuff's the
problem I think it's actually just like
out a channels for some
reason kfo Channel group get local Max
subc context h
tsg in legacy
mode engine
type in SMC legacy mode revert to preamp
Behavior
peer and peer each Colonel
group Colonel CTX
share yeah I don't really know how to
set that
though context share
handle P Channel GP fifo pams
okay do you see a context share
I think maybe just said it here with the
parent wait do I have the parent
wrong no okay I thought for a second
that maybe the parent was supposed to be
the
uh the share
and not the channel
group I think that is a colonel CTX
share
wait NP Channel
PE did I just miss that
one is there one called H contact share
and I just missed it
yo Smurf
D that was so fucking stupid I I just I
looked at that five times oh my God this
is such a waste of
time oh I just need to write
tools oh fucking a man look at this shit
watch this are you ready to fix it oh I
can't believe that fifo A.H context
share equals share oh yeah piece of shit
yeah thanks for the great error message
yeah now it's zero great all right all
right all right all right what a waste
of time Smurf D nice job
congratulations you've just been
promoted to VIP of the
channel oh
a let's go let's go all right all right
all right wow all right you know who
wants to who wants who wants to waste
two more hours because you didn't set
your H Contex share correctly well we at
least learned what a
tsg I'm hungry and I don't want any more
chips I any more food I know what I have
chicken tenders
to make Bill and Evans raised without
antibiotics let's
go let's go guys can you believe it it
was literally the call that was
failing it was so
stupid I need just
write all right if we get into more like
this if we find ourselves wasting even
10 minutes we're going to write a
generic SE struck dumper that doesn't
forget anything and formats it
nicely this is a huge waste of
time
okay it runs now it just doesn't
work
um are L those things
succeeding those are
succeeding work submit token is
D oh we're getting
D that's nice that we're getting d
um could just be
this well
okay no we're going to
um going to hex dump the FIFA
right in our driver all we get to
7f but in the NV driver we got a bunch
of
things uh those might be
pointers it's possible that I have to
set something else up that I just didn't
set now I don't think so because I have
a clear thing around in my helpers don't
I clear GPU control
we shouldn't set it that much
but okay that's what I get when I clear
GPU control so clearly it's like doing
something and I don't even have to it
doesn't really
matter
um yeah I'm clearing this whole thing
so doesn't matter I still get my A's B's
and
D's but when I do it with my driver I
get
nothing I have a 30-in monitor
we're resetting
this it should just
work do that
what no that doesn't
work
huh
okay it's kind of good news that that
doesn't
work cuz I would expect it
to oh
no yeah yeah it seems okay now the
problem was I just wasn't passing in the
share context there was an extra flag to
pass in the share context I just missed
it look CU you can see that I put that
there and then the GPU communicates back
with me and puts things here
but as you can
see in my driver that doesn't happen yet
so there's a bunch of things we could
have
wrong we could somehow have the memory
share
wrong um there are more
UVM so that might be a fruitful place to
look
I create more range
groups I'm doing
UVM so you see what I mean about the UVM
it's possible that like if this isn't
actually linking to the GPU back
end then
uh like I'm just writing to well a
stupid piece of host memory which is
very possible
I don't even know how to start looking
at this colel driver
that's a UVM test
I oh here we go UVM register Channel
well that seems important we love
channels don't we love channels
H
client H
Channel now this is probably yet Bas
length arm status
okay
um cool what's an
18 those might be return
parameters uh
what's
18 okay okay that's the Amper gp5 F so
we have to register that after we make
it with the uh
yeah after we get our work submit token
that's all good we just need
to
uh UVM register Channel
Arm Control
ID three h client is
root and H
channel is GPO
okay nothing yet again I got duped I
thought that okay we're getting a bad
status return code there
um I set the GP or U ID that's
correct it's giving me a 13 what's the
[Music]
UVM address not
valid okay
well this is saying base of this and a
length of
that did I print the right thing for oh
maybe I have to go bigger on
base again if that's going to annoy me
if that's the bug
okay
interesting that's really
interesting because that's not the base
of the other address
we can try it
though okay we're getting zero don't
know if it's
right my oven's pretty heated for the
Nuggets okay nothing
yet it's
working why are they using a weird
address why do think that's the base of
the channel where does it get that
from think it's map do you want to just
map it
we map error
too just as we
can nothing
I don't know why that's the
base what's usually
there want to stop it take a look
like
fa
oh oh that's
36 okay I read that
wrong I don't
know why is that so weird
where does it get that
from okay well one clearly doesn't
work I'm not writing anything to up
there it's not even mapped
don't a
pan I just put the pan in the oven will
I regret that
what if I just put them on foil we have
foil I have a pan I
oh it's in the
other now this p
minutes
now settle for some more yogurt and
strawber
we'll settle for more yogurt cuz
strawberries are a lot of effort to
cut this is why Kama offers you lunch
and
dinner no one should have to be thinking
about this this
stuff yeah
okay I don't know if the queue is broken
or if the doorbell's broken the doorbell
could also be
broken that's what the thingy is called
that
uh kicks It Off
[Music]
[Music]
create range
group okay here's a 40 here's a 68 and a
72 maybe it's
these 68 is Alex seor
pool 72 is validate VA range I kind of
don't think it's either of those
not those
65s
also what's the
65 Dynamic parallelism
region that doesn't sound important
either
no cuz actually I know this stuff's not
important because when's the first
kick oh hook
sorry yeah the first hook is right
there
oh if the first hook is right
there that means that it already works
by then
control GP 5o schedule
H Ruden thank you for gifting more
subs people like you keep this channel
alive
um okay
yo let's go boys let's go who who who do
something all right you know what in
honor of the hype train H roon I'm going
to let you decide for the next 20 for
the next 15 minutes should we let the
non Subs talk you have that power you
can grant speaking ability to
literally 300
people up to you you just say the word
and we'll do
it
um no no DJ Coda red oh wow okay I heard
yes congratulations nonsubscribers you
can
talk all thanks to halot and you have
the right to talk not right privilege
right right privilege is the word I was
looking for oh this is
different looks pretty
good yo instacart boys where it's
at some people were trying to use Amazon
for grocery delivery that was a poor
choice they should have been using insta
M Icelandic yogurt we fixed the invalid
State yeah we're getting
close well I always think we're getting
close I don't know
[Music]
but oh here they are registering Channel
programs without a base and a
lamp yeah
H that's
interesting okay what happens if I don't
give it a base and a length because
those Bas and this Bas and length don't
really make
sense doesn't all this register the
channel then we're getting a
Oney address not valid
huh but
yet this
one manages to call it without an
address and it's
okay can we get him to increase the font
size you math nerd can ask nicely yes
this is Sky Icelandic
Yogurt
wait why are there Kepler channels do I
have I have Kepler channels don't
I I'm glad I have Kepler channels
okay they make more channels though
which I don't really
understand you don't need that many
channels stop making
channels where is the base
that okay let's use S
parameters let's just try what I would
think the parameters should
be which should be this and that
actually it should be gp5 entries times
3,000 which I hope is less than the
length whoa level three hype
train uh is that less than the length I
don't
know no it's
not oh we might have too many uh
thingies
400 might be too many F
entries try just 405 entries oh no maybe
it is 400 I don't know oh I guess those
aren't F entries those are actually
separate command qes so never
mind
um I don't know we'll just pass in this
whole length there
that seems right are we getting arrows
when we do that yeah that gives us a
4E when I pass him this I don't get an
error oh no it's not when I pass in this
I don't get an
error yeah
h
[Music]
okay Channel 13 engine engine State one
be
okay all that stuff looks good channel
duping is not supported why is it duping
my shit
okay internally this is calling a whole
bunch of
things which seem
okay
know it goes to hook pretty fast
[Music]
is it possible that I have to set
anything else up
creating another dma
copier this
object Kepler Channel group
a do I need to schedule them
okay maybe I need to do
this control command GPO
schedule seems
reasonable
huh okay
let's just try
it okay we register the
channel
now what is
it it's an scrm
control like this
one we
want GPO schedule control
prams it targets a gp5 f it's that we're
going to set enable equal to
one is it a bull enable equal to true I
don't even probably have to look at that
if we do that
right okay
sure even though it's slightly
different I hope that's
right
3A oh because for some reason it's still
a getw work submit token
should not be a getw work submit
token should be a control command gp5
schedule
all right
56 it's nice to see ARS always it's
really not nice I'm okay I'm always okay
with seeing errors what I'm not okay
with is when I don't see errors and I
don't see
uh oh don't do
that
undo process ID not found oh no wrong
error call not supported oh very
interesting sure looks supported when
their driver does
it same
command same param length
same
route oh it's the channel group it's not
the gp5 file
wait wait I I just I just I
just
Bros just just this is our driver
right this didn't this didn't this
didn't break right did did we just get
it I think I think I think we just got
it I think I think that's a that's a
that's a hit
yo yo I I like Doe G without link and
Cuda my
pleasure uh wait so I actually have to
do an F def if you want to do that um
done done am I the first person in the
world to do that now that's a
question Nvidia open Cuda is coming for
you get ready for open
Cuda take Cuda subtract all the insane
megabytes and megabytes of bullshit that
you do not
need now to be fair it's not running
code yet we're going to make sure it can
actually run code that's just a DM but
it means that it pars the command
buffer if it actually runs
code oh
yeah should we reimplement the whole
Cuda
API the real question
is you can't believe you got timed out
for a joke you might get banned for
complaining
would you believe
that the question is how can we sell
tiny Cuda to Enterprise
customers no like I I think that a
driver like this would provide a million
dollars in value and
like um and oh hey it's been 15 minutes
someone brought up an IQ test up now
we're back to subscribers only you
failed the IQ test
sir uh all right there I mean there's a
decent chance that this just works I am
going to reenable Cuda for now but don't
worry you don't actually need to link to
it it is optional
[Music]
so first let's do it with Envy driver
equals one what not run
driver okay so you can see this here is
being put here by a uh by a program so
that's actually a run of Auda
program so if we do it without the
driver we'll see if we still run the
program we do not well that is upsetting
okay we don't run the program
um I don't know why that could be true
for a lot of reasons let me see if dma
works dma works what happens if I don't
create the dma device does dma still
work yes it
does dma device turns out not to be
useful um dma works but the compute
doesn't
work
unfortunately
um I wonder why
what's not
running
well okay let's first say there's some
chance that it let's just make our
program
simpler make it not do anything does
does it run
now it doesn't and I know it doesn't run
because it didn't make the dma copy but
if I run it with the EnV
driver it does make the DNA copy you can
see the A's they see how they
moved um okay so it's not the program
itself though actually to be fair even
if this is commented
out and we'll sell it to miners
that move is still
there let me just
try I used to have this in the
thing
um can't believe I got timed out for a
joke
okay so that's a really simple
program that still doesn't work
what resource am I not configuring that
the program requires
[Music]
what okay
does anyone have any intelligent
questions about what we're doing and
uh wants
to have them
answered so
what are the advantages of writing your
own version so this isn't actually a
good question um and let me explain to
you why since you are a
subscriber I I know you come from the
default world and the default world
people do things for a
reason um but here on the
stream it's not really like that
you know have you ever
seen
um oh it's very large Cuda is very
large have you ever seen um a rule
Goldberg device it's like that
Goldberg
bro there saw some military jets fly
by is it
wartime or are some people just excited
about Top Gun
so there's all this stuff that loads
data we are still on the topic Colonel
FL one
um
so it might be this
stuff you see all this setup stuff that
it does
like here's a question where does it
have the
stack right th this might be here one of
them set Shader shared memory window
set
object what can we read about what these
things
do I bet this one's pretty important
though
yeah the Shader shared memory
window I guess would be
that that's like the stack
pointer all right we'll add to no subs
for a little bit we'll do a few
questions and I think we're done for the
night um we made good
progress I did the other compute off
stream we'll probably do this compute
off stream
too but we did
get a command buffer
running without a
driver here's another
interesting um thing to note
oh
well that's
okay I'm going to
relax can I start knopping their
commands yeah that's probably a good
idea it doesn't work right now without
the
sniffer because the haveo pointer
but here's another reason you write your
own
look at that
speed and without the
sleep what is window
b um
well it looks like a and b are just the
upper and lower part of an
address uh we could knp out their
commands now that's one way to go about
it it's probably a pretty smart way to
go about
it yeah there's all this setup stuff and
they set up like each
queue that just zeros something out
that's not interesting
um that's not like puts that's like an
address I bet you it's I bet you it's
just this I bet you it's just this but
that's going to have to
wait um all right fine we'll answer
we'll answer general questions
stream's over for the
night you spend all
day you make a little bit of
progress this should probably take like
a week of full-time work to like
refactor and make
nice you know have some nice
abstractions which are
like oh how much memory overhead a ton
well so everything in Cuda everything in
Cuda just decides to waste question uh
waste memory the contexts waste memory
here's how you know they waste memory
the context is larger on a 3080 than
T600 I don't think there's a reason for
this I mean maybe okay you know what
maybe there is maybe you have to like
like fit the whole warp or
something um
in general Elon fires someone we
wouldn't hire them
um I have the exact same position as
Elon on work from home you know you
could pretend to work somewhere else
po to somehow anti- remote work what do
you mean
somehow remote works a
scam no they all like think
like never
mind oh there's a these were delicious
chicken tenders by the
way I wish you guys could have enjoyed
them with
me you're working off work a joke thank
you for acknowledging
it what the I of the chicken
tender how can you physically assemble
something if you're not on the factory
floor but software is not like
that day in the life
video I agree that remote works really
boring too I could never work at a
remote
company like if I was going to work at a
remote company why would I work at a
company at
all you know I could just stay here and
like write Bots and make tons of money
um
no like I really think it depends on
your philosophy right I I think that the
people who um like remote work don't
believe that work is life I believe that
work is life I think that the point of
life is
work uh I was on software engineering
daily
actually uh i' go back I'm always happy
I remember they asked me pretty good
questions about the infrastructure I'm
always happy to talk about it
the metaverse isn't very good
yet I heard a story about like some
Facebook executive logged into the
metaverse and it was a bunch of like
12-year-old kids chanting the nword and
they were horrified and I'm like
yeah and this is why your metaverse is
going to be terrible
Facebook um no what it's not capitalism
right capitalism is a specific economic
system
uh the point of life is
work yeah I really don't understand what
else like the point of life would
be right like I don't want to work
anymore okay die
like what do you want to do I don't know
I don't know what else there
is I just want to do nothing shit man
you don't need a million dollars to do
nothing I got a cousin up in Iowa and he
doesn't do anything and he don't have a
million
dollars uh I was raised Catholic well
not really culturally Catholic I'm not a
Protestant to travel the world
oh
oh my point in life is to consume why
would I work when I can consume
be a
consumer get a new office comma is
moving we have like a 5,000 foot office
mov to 20,000 squ foot
office it's
unbelievable uh why don't you move to a
major
city novel experiences consume consume
experience consume
Travel
consumer passion
oh oh I hate this word and then you're
the kind of people who are like I just
haven't found my passion yet
bro like it doesn't work like
that
wireheading the point of life is
wireheading
yeah for some people it really might be
and I hope they wirehead and I hope they
leave everyone else
Alone um what's wrong with consuming
well you see you're consuming that's
like saying what's wrong with mooching
or what's wrong with taking well nothing
as long as you know you balance it out
right um cuz if everyone just consumed
there'd be nothing to
consume I'll travel the world to find
your passion that's that's you know you
guys know where I got my coding skills
right I was in Indonesia there was a
volcano I I hiked down to the bottom of
it there was a plume of sulfur I passed
out when I woke up I knew how to code
GPU
drivers uh just ask for generalization
no that sounds like what some ml
thing um I love telling that story to
people who
ask uh but you know the Portal's closed
man
we
[Music]
got I should read this more carefully
I feel like I saw this linked once I
didn't really have time to read it when
I saw it and then I forgot about
it
huh I'm going to pick up Ian good fellow
I don't know look I I I don't know I've
never met in good fellow um
I don't know if he actually it was
because he wanted to work remote or it
was because you know he didn't want to
work at a company where you your
research doesn't get published like I
don't know why anyone who's good at ml
would want to work at Apple I think
there's a lot of you know if you're
interested in product Apple's a great
place to work but why would you do ml at
Apple um vitalic spends his whole life
traveling
yeah it's for some people
depends what you're
doing uh falic is uh you know he's a
much better uh he's much better leader
than I am uh yeah if if you're trying to
build something like ethereum it
probably makes
sense but uh you know I think that I
don't think vitalic would shy away from
uh I've met him a few times uh I don't
know but I I don't think he would shy
away from the idea that uh life is work
but I mean crypto has that sort of
culture
uh so no I'm
not vitalic travels and basically works
on ethereum stuff is my understanding of
it um I don't think he's traveling he's
like I'm going to go to Mount Fuji and
walk up Mount Fuji I am going to ready
marathon on all seven
continents
uh and paying higher taxes like slavery
look
man Tex ation is like they made this
shit up they made up the money and they
take some of it back it's fake it's not
like slavery do whatever you
want right like it's just they have some
stupid rules if you want to interact
with their fake little shits right if
you don't interact with their fake
little shits well you
know people just wait for an excuse
that's true a lot of people do that
man uh I gotta read this just just today
today I don't know I I should have gone
about this whole thing more methodically
I didn't sleep that much last night
should have methodically parsed all the
structs oh it would have been so
nice uh but you know then you get to
like the next thing and like I think
we're already past structs and now it's
a question of figuring out which
commands need to go in the command que
to initialize the command to initialize
whatever it
is uh I don't know I wonder what the
resource actually is you get a better
intuition for like what these things
actually are on the
GPU um but no here's here's a goal
too do I like GitHub co-pilot not really
I don't think it's very
useful uh I think it's
it's all the it's all the e it's all the
easy and fun parts of programming
without all the hard Parts I i' much
prefer a uh type safe language where all
the types are instantly checked and
powerful and intuitive now I'm
interested right yeah it's good if you
like boilerplate but if if you're
finding that co-pilot helps you ask
yourself what you're
coding uh and you just probably should
be doing it a different
way I'm going to code a bank API in
Java oh okay I'll start the I'll start
the GPT session with I am an expert
coder who has won many yo and Imo Awards
an experienced Graphics developer
right am I going to juice and
juicier what's juicier is that like
AA prime. CP thank you for
subscribing AGI by 2030 what the hell is
Agi I don't know what it means such
thing as general intelligence Concepts
ridiculous you think you have general
intelligence you just look smart but you
know what the birds think the same thing
about the bugs they eat they look in
like stupid bug
what is intelligence
well I don't know what kind of like you
ask a question like that like what kind
of answer do you
want compression yeah there you
go Tech stagnant the last 40
years dude I don't know how you could
say that
man let me see your 40-year-old laptop
no but you don't understand that's not
real
technology I don't
know world's out there whining about a
lot of dumb
shit uh by the way I
did did we pray for the recession come
on can I really hope this is a real
recession we need the prices of
everything to just
crater because it's all
overpriced n n we got a drug we got a
drug post no see you make me want to end
the stream
bro session's priced in no no no no it's
all got a PL it everything is too damn
expensive I was looking at houses it's
like little shit box houses here for
like $2
million like you know what I can buy in
Iowa for $2 million like a
town the government can't bail
know good night Smurf
d uh buy a town no but see the another
problem with buying a town is like an
unproductive town is bad
not sell out what would I even sell out
for I don't even
know so like a fuck models on my
yacht sounds pretty nice now that I
think about it I'm going to sell out I
never thought about that
before little for
you oh no no I want it all please make
it all crash man please please
please
uh well we got to do the ca driver first
and then and then we can train tiny
voice quickly on one
GPU I don't have 8 gpus to train tiny
voice on anymore I need those for
work BR Edy I told you volcano volcano
man
who's going to do anything with
homomorphic
encryption uh we have
like
200 uh they can all run at the same time
right now though we got to move to the
new office where we have more power new
office all like 200
gpus uh I think I think we only have
like well it depends what you mean by
gpus we have a whole lot of small ones
too to do
decode we just bought a lot of uh we
bought a lot of
T600 uh to do decode of the hvx so I
have uh another 130 of
those but they only have like three ter
Ops of compute
I know the San Diego power rates are a
scam we're building a nuclear power
plant in one of the rooms in the new
office it's going to be a small nuclear
power
plant all right oh this might be a
better summary the just ask thing
I'm gonna go lion bed and read these
things and think about it tiny fion yo
tiny fion all right on that note thank
you all for watching uh that was this
weekend stream uh keep an eye on the
GitHub thing and it will start to do
more and more
things good night everybody happy
Saturday
oh let me get chad up here
all right she's gonna be a a quick
stream today
uh
i want to apologize yesterday for
parsing all those structs by hand
uh i made mistakes doing it it was
really stupid and i feel terribly
embarrassed and ashamed about my
behavior
i shouldn't have done that i should have
slowed down
i should have been calm
i should have said
you shouldn't be doing this by hand you
have to write some introspection
uh to do this
uh so that's what i did this morning i'm
sorry i didn't let you all watch we'll
do this apology again uh once we get
some some people in here
so i really am very sorry uh you know i
i
demonstrated behavior
that uh was not uh becoming of a good
programmer
uh
hang on where's my where's my chat
i don't know what my chat is uh
no
sit here
how do i get to chat how come i can't
use this oh here we go
um
about chat here we go yeah
so let me get a little bit more coffee
i'll say my apology again
good morning everybody happy happy
sunday it's
nine o'clock in the morning
uh
um
so um
yeah like i uh
like like i wanted to tell you all um
you know i really i apologize for what i
did yesterday
uh i spent a lot of time you know
stupidly copying and pasting and
printing the strokes and that really
wasn't the kind of uh
behavior that you've come to expect from
somebody who's a good programmer
i demonstrated recklessness and
carelessness
and that carelessness actually cost me
an hour yesterday
uh when i when i didn't properly parse
the uh
i didn't properly parse the struct
and i missed this h context share
and i wasted a ton of time
and that's really you know not the
behavior that i hope you've come to
expect from me
on the stream
um i did finish it last night i did get
uh compute working
let me just remove that exit so you guys
can see it
ah
yeah i was just you know as as i was i
was upset with myself
uh for for doing such a bad job
uh you see
uh this is uh actually running the
compute in my driver you can even run it
with cudalysts
which doesn't link kudo
uh so yeah i know i know my
disappointment is immeasurable my day is
uh ruined and i hope that you as a
community can see in your hearts to
forgive me
uh and can can can hope that
i hope that i'll be able to demonstrate
uh exemplary uh programming behavior uh
from here on out
uh so you know like i said uh what i'm
apologizing for
uh is i you know you look at this shit
man you know what well who would do this
who would like write out
all of this by hand like i didn't just
do it once i did it over and over and
over again
and you guys saw me do it and it was
really terrible you guys should have
been like george you have to stop
what are you doing
so this morning
um
i woke up at the seven o'clock
feeling very bad about myself
and then i went in and i wrote this
uh and this uses clang
to parse uh the header files don't use
some custom shit
uh use clang
uh this is pretty nice you can uh just
you know link python here into clang
uh walk the ast
i wrote a little field printer and now
i'm getting these printouts of the
structs here being automatically
generated
uh
from clang and that way look
uh when you fix a bug
you know you got to make sure to think
about is what i'm doing high leverage
you know what i was doing with those
structs was not high leverage and i said
it yesterday but you're just like you
know you're so committed to something
you're you're so committed to an
approach you're just kind of like trying
to thrash your way through it you know
um
but the beauty now look i can like just
by changing this python file which
generates c
i can like change the meta behavior of
the thing
um
and it's really a whole lot better so
now there were two bugs last night with
why the compute didn't work
one was we did have to set up the shared
window and the
shared memory window and the local
memory
i mean the other bug was caused by my
qmd address not being mapped
so i managed to figure that out
by dumping the uh the error struct
and i found out that i was getting a
fifo error mmu error fault i managed to
reproduce that error with the nvidia
driver
uh and then
once i knew that it was this address
this address is kind of tricky because
it shifted over by eight
so you can see that i added shifting
over by eight
here to my push data qmd
uh so yeah this is real software
engineering and you know i just i just
wanted to make this apology video
um
it's not gonna be a long stream today
uh just just just an apology
uh and today
we will do some um beautiful refactoring
of my driver
and make it so that anybody uh can use
it
so i have this nice uh struck printer
stuff
we can delete a lot of the crap from
sniff now
look at all this crap like who wrote
this it's so disgusting
even this i should be auto-generating
some of this
you know
i was careless with the includes
look at how many times i repeat
source common nvidia sdk ink right so i
did it nicer over here
uh this is just getting started
uh this is the
this is the file that's being used by
the struct parser
uh
to
uh sniff things but you actually can use
this
uh if you run it with kudos
you can actually launch
a cuda kernel without
uh using the cuda driver
i don't understand exactly why this
error is happening sarah goes in this
slot not in this slot when you make a
mistake you'll see the error goes in
this slot like here i can show you how
to make a mistake
um so if i were to
you know go to my uh
thing here
and like you know instead of putting in
that i just put in like trash and i
can't put in that kind of trash but i
can put in numbers
all right you'll see
that i get oh this is an error 45.
an error 45 is a gr class error
but you can also get mmu faults
and if you get uh there's also
exceptions
which are like unmapped pages but we can
put that back to there
run it and you see that it works
are we going to implement simple array
multiplication well
we can talk about what we want to
implement now
we got everything working it's pretty
nice
uh let me just go
but yeah mostly i just wanted to
apologize to you guys
for uh thrashing around a lot yesterday
and getting angry and there's no point
never getting angry
uh programming is about zen and love and
don't listen to me when i say things
like that i'm just talking
but really i did a bad job and i want to
apologize to you for not demonstrating
the kind of behavior that you would
expect from a good programmer
um no euclid no uh you suck and now
you're banned congratulations that's not
who i'm apologizing to
um you know just cause someone
apologizes for something doesn't mean
they're a bitch in the rest of life you
know that
uh wow i just banned that guy oh that
was pretty brutal man
um
yeah that's the thing you know sometimes
if you make me uh think about you too
much you get banned right like me
thinking about you
is is is if i don't think about you i'm
probably not gonna ban you but if i
think about you you might get better all
right good
so that's over
um
that's not what i was apologizing for i
was apologizing for my behavior
okay
so
do you like seeing refactoring does
everyone want to see refactoring
i did some other refactoring here too
but let's go through and let's write a
beautiful class
uh i believe we'll call the class
context because that's what the nvidia
driver calls
it okay
contacts.cc
uh
um do we have a name
do we have a name for this project
because it's not cuda
and i shouldn't create a class just
called context
tiny coup
well
yeah someone did point out i'm not
really sure if i can call it tiny kudo
um because
uh you know nvidia
you can't just take their trademark name
uh and and call it cuda
what do you think of lorax name it after
the tree guy
that's what i was thinking of naming the
the nvidia version of this because the
uh
qualcomm version is named need
i'm open to other suggestions
we'll refactor all this stuff nicely
um
let's just create it in a header file
for now
yeah i think i might just call it cool
it's fine
but no no i can't call it kuda kuda is
trademarked but just ku is not
what is what does nvidia call it it's a
cool context
cuda in reverse attack
mackerel
all right we'll just call it class
context for now and you guys can think
of names
um
god
so
we'll define some private stuff here
uh we have the nv handle
device
sub device
user mode
uh
mem is bad uh
channel group
share
next uh share
uh
gp fifo and compute
we need like a good it's got to have a
good two letter
it's got to have a two letter
not cuda
um
we can call it
cuda
what do you think
and kudo with with with two hours
um
all right fine tiny cuda
and we'll call it a
tc context
tiny kuda is the obvious name
tc context
annette
uh but we'll just refer to it as tc
because that can't be trademarked right
what do you think
tc love it
all right
um
we're also gonna need fd control fd
uvm fd dev zero
oh we need the root context
we'll open these all
them all with chloex
open devices
um
all right
tiny cuda
and no i don't know i don't complain
it's tiny
tiny stuff's inoffensive
um so here we allocate the root object
that doesn't need a comment it's obvious
enough
uh this i'm gonna clean up a little bit
you know what and i should this is uh
it's actually kind of bad behavior
i should make another file called
context.cc
and then it can include context.h
not like that
ah
work here on coolest because this
actually won't need cuda at all
uh and then we'll say clang
plus plus
uh context.cc
i think we are gonna need
that but we might not need anything else
okay use it on the identifier tc context
that's okay because we have to include
context
okay
that stuff's not included
because we have to include
f control
unknown name nvhandle where's nvhandle
declared
here in nv types kernel open common ink
probably something else will probably
include that
if we go over here to my include.cc
let's include nvos maybe that'll just
include it
requires a type specifier
uh null is undeclared where is null
how do i get is it standard
no string
okay good
alec object is undeclared because those
are helper functions
that i have in my gpu driver
static so it doesn't export it
my cert is undeclared
and now we need this alec params
so for that alec param see look we're
doing this so carefully and calmly now
uh that is we need this class
use of undeclared identifier ask rm alec
uh
and the escape
like for all these things i'm thinking
is there something else i should be
including that's like a better
well the only thing that includes it is
that
so we do just have to include that one
okay
uh
what we should do here
source
nvidia arch and the alec
unix include
and then here we can just include uh
envy escape.h
um
it's in kernel open common ink
also here if i include nv.h
so i should probably just include nv.h
undeclared identifier
okay i o control is undeclared
um
i still didn't figure out where nv
platform max i o control size came from
[Music]
and then for i o control what is it
where is i o control and why do i not
know this off the top of my head
control
okay undefined reference to main that's
obviously fine
yes tiny cuda
um oh and i should rename these files
[Music]
doing everything carefully and
methodologically
uh let me just make a uh
tc test.cc
and
this is going to include tc
contacts.cc
it's just going to be a simple main
uh that creates tc contact ctx ctx.net
test
i got the power rangers time force theme
song in my head you know
time for time force
time time force power just time force
you know
okay cool
so we're calling it and we're allocating
the root object
um
you want to throw the sniffer on there
it's kind of nice with the sniffer
sniffer kind of shows me what i'm doing
okay
we'll get rid of that once it works
okay cool
so you see we open the three things we
do alec and we get a zero
all right
so where were we up to now
we're doing the parameters so nicely now
so we have h client share
equals root
and we have va mode equals nv device
allocation
va mode multiple va spaces and that
might complain
great put that on one line
looks pretty nice don't you think you're
doing pretty well it's very readable
code
open device is kind of dumb comment
in general if the comment you're writing
uh
set up parameters what do you want
this is a sub device
you don't actually need parameters for
that
what why is that undeclared
because that's in 20 million
cool
we don't actually need that
um we'll declare we'll allocate user
mode here too
undeclared identifier turning user mode
a was that declared clc41
i don't even define that one
oh it's in g all classes
i don't know how i feel about that we
can include the class
i kind of like that it's explicit here
so that's the term user mode thing
turning user mode is where the doorbell
register lives
okay now we're up to m mapping the
object we should not call it gpi well
gpu mio point it's not the worst
there are worse names
and map object is not
declared so these are like my helper
functions
we have to re-open the
nvidia object to do an map
i kind of wonder
should these be class methods they
probably should
yeah some of them
i don't know we can we can deal with
that refactor later
uh cis man
see where this one's declared
and the arch and the alex include
envy unix
unix
and the os params wrappers
remember the thing yesterday about the
missing fd
uh so we've we found the fd
uh this video is going to be a nice
example of like what the minimum you
need is to initialize a good context
so we have my alec object my mmap object
notice that i'm asserting on the
statuses nicely
okay
so we unmapped the object
now we're here
we have to allocate the va space
so we can do this pretty nicely
here
here
cl90f1
so this is how nvidia labels their
objects they all have like these four
digit things this is a device this is a
sub device this is a user mode and this
is va space
now my only oh i didn't include va space
here
okay we're allocating the va space
um
okay now we have uvm stuff to do
oh we have to figure out how to get the
gpu uuid because otherwise it's gonna be
broken on everybody's computer except
mine
i feel like maybe we should break it up
because that's like the basic of cuda
and net
right um
call this init device
another one called
context
and another one called init uvm
we can create the init function
for all of them
device
net
evm
and init context
those actually um
this would be a call to get the uuid
that we have to figure out how to do
we'll figure that out
do you get this
maybe i'll leave that to whoever wants
to use it on not my computer
uh
okay
uvm initialize
um a few things about this we're
actually asserting on the wrong thing
here i'm going to start on arm status
undeclared because we need uvm linux
okay
so this is
linux
this is a different thing
so i feel okay about adding it in here
it's in
kernel nvidia
uvm
kernel open common ink okay seems like a
fine thing to add
find reference to a knit context that's
okay
okay
we are initializing the uvm
now we have to register their va space
[Music]
should we actually label these to match
like
you could label those to match better
okay
assertion is failing
here
why is that failing
oh we have to first register the gpu
params
i kind of did like when they were
reaching their own it was kind of nice
there don't you think
[Music]
so
what you can do with that in uh in c is
that just creates scoping
so that way i can reuse variable names
and it won't complain
um and it's nice because you really want
to keep your scope as limited as
possible
so we'll just go back to that
i like it because it added a few more
braces but
it makes the code simpler and that's
what matters
it's not readability not about line
count
uh
use under cloud identifier arm control
fd
it's not in registered gpu perhaps
sure looks like it is
oh let's create a dot
cool
oh good we got we got we got some
viewers today
so we're initializing the uvm i believe
that's everything now
uh
now we want to initialize the context
so we can say
handle man error handle
i think this is good for the context
i'm gonna need to copy and keep our
so this is heat balance
keep alex kind of ugly
i'll see what doesn't work now
gpu gpu-uid
so for reference where i got this was i
just did nvidia smi dash l or it wasn't
dash l desktop
yeah and then i just copied this uuid
that's something someone could do a pull
request for
um use of undeclared identifier member
oh yes
what is that
oh that's the address that i'm putting
it at
i mean that shows kind of an interesting
problem with my uh
those flags are ridiculous
okay
we're allocating mem handle and nem
error
handle um
here we'll allocate the channel group
maybe i should actually make that a
different function
um
uh channel group allocation parameters
all we have to set is the engine type
equals uh
nv 2080 engine type graphics
okay we have to figure out which class
the kepler channel group a is
ah the class is
a 0 6 c
i could put some comments on those to
say which one it is
nice
there's also meta things that let me
include everything like i can do this
one here generated gl classes
by the way does anyone know why when i
do spaces in vs code it gives me colons
like that they have a dot or sort of
dots
it added a dot
um but yeah this is really helpful for
understanding like how nvidia stuff
works
so there's objects and they all have
four digit class ids
so you can see we have a device sub
device a user mode a va space a channel
group and we're going to actually have
to do it's like three more
um
down here in it context
so we'll go in the gpu driver to where
we emit the context uh
here we created context share
by the way does anyone know if the rest
of those
become zero by default i sure hope so
good to know it's a sub context async
we don't want any sync context by the
way when i say things like that i'm
joking
i have absolutely no idea what that
means i just copied it
so here we need the fermi context share
a
um i don't think i need i think i can do
these
it doesn't have to be
i just like them better
they look a little nicer
the brackets instead of the quotes
brackets are so much prettier than
quotes
uh oh it's a mac only issue okay okay
let's say
oh
and full stop with double space oh then
it requires a restart all right well
i'll be happy that i did it later
great
um
i don't know it kind of looks nice
i mean we could use the other kind of
initializing thing but
tp5 file and compute
mem is kind of a ridiculous thing
i'm gonna have to include two more
classes one for the gp 50a and one for
the compute b
so beautiful
that's so beautiful
okay
so now we're allocating the compute b
uh we need to do a work submit token
register the firefoot with uvm
so
i think i already started on the status
but we should start that works
i think this is going to involve yet
control
so that'll be our first control here
include
control
slash control c
for
what is see
does it tell me what that is
it's volta channel
gp fifo a
all right arm control is my function
it's right here
put it after keep balance
okay we have a work submit token now
uh we have to do two more things we have
to register the fifo with uvm and then
we have to enable the fly file
i shouldn't call it contacts i should
call it fifo
those private functions
the user should only call a net
uh we're gonna have to include i'm just
gonna guess at this
oh it's a class kepler channel group a
i already include that as a class
okay there's a control version of it too
okay cool
so now we've registered
that with a knit fifo
ah that all looks pretty nice
let's go over here to our test
okay
we create the context we knit the
context
uh
now what do we actually need to do
okay all that stuff should probably be
copy and pasted
maybe i should just update the gpu
driver to just not use that
we can just say tc context
instead of the test
uh i'll just say tc context ctx ctx.net
[Music]
which will be able to be deleted
all right gpu mmio pointer equals ctx
dot okay that's a
global
we'll make this global so
okay
cool
uh i always should get the words of the
token too
i like that it still works with the
nvidia driver too
pretty good
uh those things should probably be based
off gpu base
okay i included amp here a twice did i
oh you're ready
okay
so
let me just add
tc context to here
replace the includes with this
get rid of all that
see if it works
that's because we have to include the
file
cool
good refactor
it's because of ssh with an agent over
there that's why i can push
okay
kudo list works let me update driver to
work
um
and the escape not found
[Music]
okay
it's pretty ugly but it works
okay
uh
larry capilot can you please read the
channel description
okay
what do we want to do next
general so thank you for subscribing
uh what do we want to do next
does everybody understand what's going
on and how this works
so this is the uh
nvidia
uh
driver
well
actually you should make sure it still
works with the nvidia driver i can say
envy driver is one
and then it runs it with the nvidia
driver
you want to do matrix map mode welcome
hype train
um
also i want to show you guys something
so
that's the fastest i've ever seen cuda
initialize
you're running a gpu program you're
getting everything up and running in a
hundred milliseconds
you can't see why not oh
move it over a little
that good
look at that
um it's very fast and your video is very
slow because it's making a lot of i o
controls because it supports tons of
stuff
uh we don't really need to support tons
of stuff
okay this is like all
[Music]
hand coated junk
uh we could clean this up create a
struct for the queue
try to find the struct for the queue
but overall i mostly wanted to just show
you the refactor
apologize for parsing all those structs
by hand
i'll show you guys something else too so
this is the
code that's actually running
if we look at it i think a lot of it's
actually unnecessary
so that's a trivial program that doesn't
uh
that doesn't do anything but let's say
we want to let's say we want to actually
do something
so let's
load this and look we're doing assembly
by hand
this is this move
you can do this move too
it has to the address is big the address
is 64 bits
so we have to load it in with two
instructions
all right now let's do the store
so all this program does
i can show you the code
all this program does is reads two
values and then stores like it reads a
pointer and a value and then it does
like yeah like star pointer equals value
so i think that all we need is this
and then this is exit
now this is nvidia's low-level thing
called sas i was looking at the google
open gpu driver
and there's things that will compile
cuda code to ptx which is this like
mid-level assembly parsed by llvm
but the
ptx as
is still only a closed source one
so if we really wanted to do it we'd
have to figure out how to uh
wait so why doesn't that work
that doesn't run
interesting
which of these useless things are needed
oh i didn't load r5
okay we have to load our five
i didn't know the value
for some reason the nvidia assembler
likes to insert this top one boilerplate
but if you'll see r1 is never used again
and i don't even know what this you are
for thing is
yeah okay that program works see i can
see the program worked because it set
that
oh yeah so cool uh that's a program it's
just four it's just five assembly
instructions
[Music]
this is the open source context driver
let's do a little bit more documenting
okay we have a little bit of
documentation should probably clean up
all this other useless crap but
oh yeah
just about getting all these parameters
exactly right and we could have done
this a lot faster yesterday
uh if we just spent some time
oh timeline i like that
now we can switch between
cool
why do we need a tpu the problem with
the tpu is you can't buy a tpu
gpu can be bought by everybody oh
another thing i want to show you let me
kill x how do i kill x on ubuntu you
look at nvidia smi
it's funny webkit
was it system control
stop x
system control stop x x11
stop x
oh light dm
i always get this wrong
is there some other
oh pseudo service that's why i get it
wrong service like the m-stop
system control has the opposite of uh
gdm
now if i look at okay look there's no
running process he's found
so i'm just going to throw a uh while
one sleep
at the end here
we can run kudos
look at that memory usage
two megabytes
did you know you could run
did you know you can i could kill all
x11 but i think it'll come back right
because system control is managing it
but did you know that you could run
uh cuda program in two megs of ram
it almost fits on the cache i'm not even
sure i need all 2megs we might be able
to use less mix
yeah that's small right when you create
a cuda context here you want to compare
it
uh well here i just gotta do driver.h
so that's using my driver now if you use
the nvidia driver
oh i broke it
how did i break it
crap what did i do
what did i do
oh
no i'm not even running the trivial
program okay what did i do to break it
i can't imagine what would break it
huh
maybe an address changed
uh we should figure that out but also
look at how much it uses 245 mix
uh i really do want to maintain both of
these things working
so japan my point is correct memory
should be correct
oh i got rid of the clear
no it's still there
it's not the problem
hmm
no
did something break because i killed x
i mean that's possible
oh maybe just an address changed because
i killed x or something
but still like what address could that
be yeah
i don't know how i broke it
uh student service gdm start does that
just fix it
no
probably unrelated to that
uh what could be wrong
the hook still triggered
oh but i will notice that the hook for
some reason didn't uh
didn't dump anything so that's weird
on mine on the hook triggers it dumps
all that stuff
oh it's not d
i see
okay
uh we have to hook that anyway
yeah it's five for some reason okay
whatever
since i killed x that's
okay that fixed it
no this can be wrong
there's things that are kind of hard to
get when you're using the cuda driver
like that work submit token
i don't have the handle of the fifo i
don't have anything
you see it works now
uh and you can see that it uses just 245
megabytes or you can run it with my
driver and it uses just two megabytes
that's like a 99 megabyte savings can we
pass this on to enterprise and deliver a
1 million value to an enterprise
one
million dollar value
to enterprise
i think we're pretty much done
i think that was mostly where i wanted
to leave things
i would be interested in further
understanding where these things are
actually going
um
i don't understand this at all
this should probably be a parameter
somewhere
that's not just hard coded because i
can't put it anywhere
we just allocate one chunk of memory we
should probably allocate a second chunk
of memory and use one chunk for the fifo
and one chunk for my stuff but then
we'll use four megs and that would
double our memory usage
yeah it's two minutes
there's two megs
i don't need a comment
by the way just so you know when you
write it out like that
you don't have to worry that the compile
that the computer is going to waste time
doing that thing because of
there's this thing in your compiler
called constant folding
i agree that four mags is too much
uh we should probably put the flags in
here
for that i don't know do we care
hook up with rdma yeah
well i only have one gpu
so uh
what do you want to rdma it to my
with this for the network card
can i can i rdma it out of my network
card
maybe we'd have to figure out how uvm
works and stuff
i don't know
everything got really complicated in
like memory architectures now you have
like
iomus and
pcie bar dresses and stuff i don't
really understand how it all works
but i'm pretty proud of tc context
cheesy context is actually like
you know with a couple days of work a
usable class for somebody somewhere
for a hundred gpus you're saving 20
gigabytes of vram that's true
ram costs about five dollars a gigabyte
man
i would say it's a million dollars but
that sounds like a hundred dollars
think about it but you can then use that
ram for other things
like think about it you know i i think
we gotta tie it in with like climate
change you know we can it's like carbon
offsets
that's bad
uh i'm probably not gonna write it now
let's just tell you guys we're gonna
write a blog post about three barrels of
oil for my land
and uh you know i'm gonna light them on
fire unless someone would like to buy
some carbon offsets
uh you know you can spare the barrels of
oil from execution yeah but not like
wendover did a video on it and now it's
like no it's like played out like it was
funny when i was saying it a week ago
saying at lunch look i'm buying three
barrels of oil and if you'd like me to
not just you know carelessly burn them
and release a ton of carbon into the
atmosphere you can buy a carbon credit
from me
um but now everyone knows carbon credits
are fake so it's like not funny anymore
it was funny last week though it was
funny
um yeah right right you can fit larger
models
yeah you can fit
let's let's
uh
make totally fake benchmarks
that like pretend that this affects
scales
um
carbon threats that's right
i'm gonna release a ton of carbon to the
atmosphere unless you pay me
i bought
a square mile of rainforest i am going
to burn it down
unless you pay me money
ah
that's the problem with that you can't
and then you can get into like uh we had
a conversation at lunch like i was so
right
people some people you know thought
carbon credits were okay they're they're
not carbon credits are not okay
uh
bros
you know
let's follow gpu industry trend and make
up stupid benchmarks and sell it
i think this project's only worth
continuing if we are delivering one
million dollars to enterprise
how can we deliver one million dollars
to enterprise we can save both ram and
startup time
and we can make everything more
efficient
because i feel like in the nvidia driver
i mean this was certainly true in the
qualcomm driver
we would look we had a thing that was
doing the model and it was using 50
percent of our core on the snapdragon
that's why i need
it was using 50 of a core and most of
that core time was spent in malec
because every time when it was pushing
one of these things to the gpu it was
malicking it
like now looks really slow
so we could just like
you know keep uh keep a ring buffer of
uh
keep like a buffer of the things before
we submit them
i don't know
why why is nvidia cuda launch control
launch kernel
i think i worked out that it could only
do like 10 000 of these per second
uh
if we could do more efficient map model
well
what do you mean by more efficient map
mall so it turns out that a lot of
models
especially
uh as the gpus get faster
you're limited by your cpu uh your cpu
is not capable of driving enough i'll
show you something here
so we bought these new machines at work
uh with these processors
because we needed to be able to just
like and then they waste like
what is all this crap doing what are all
those cores that are pegged at 100 doing
those are the torch course
and they're using 100 so i wonder if
they're like not efficiently utilizing
the gpu
um then if we go over to like the other
machines
these machines don't have such great
cpus they only have those
uh that's why no one uses them because
the cuda driver
can't submit enough i mean okay they're
being used for
oh my god they're running model features
someone's running model features and
they're not using the gpus they're just
sitting there
all right i have a lot of work to do
nvme to gpu and ignore cpu yeah i mean
like
the truth is the problem probably isn't
the driver there's probably like ways to
do all that with the driver the problem
is it's just like the easy way to write
code you can see there's a pull request
on autopilot where i wrote this uh
streamer for the body so
i got latency i got video streaming
latency down below 100 milliseconds and
i'm like how far can i push it and i got
it down to 40 but it required this
incredibly complicated c plus program
that was making no copies
uh
like making no copies is difficult it's
very easy to just say oh we'll just copy
it to a buffer on the cpu and then we'll
copy it to wherever it is right so like
say you're doing something like an nvme
to a gpu right
the easiest way to do this is just to go
through like the entire stack uh you
know use like f read
on the nvme which is going through the
entire kernel file system stack
and then it's uh you know you're
allocating probably use malik to
allocate that buffer right so you gotta
copy it into the buffer
and then you copy it back to the gpu
right
and then most of the time people do this
all pretty and efficiently so they only
have one buffer right and they're doing
like a read and then a write and then a
read and then a write and then a read
and then a write right this is how you
can write like efficient cp and
inefficient cp right you want your reads
and your rights to be parallelized
because there are completely separate
devices
um
if you look also at how much
time is wasted in programs doing mem
copy
mem copy is this insane waste of time
um
something we could try to do is we could
try to re-implement the cuda driver
and then we can try to like get torch
torque
uh
with tc context that would probably be a
pretty cool project okay we could go and
we could uh you see that my sniffer
already works with torch
so we go to like uh
here
i can like load sniff
python3
import
torch
uh say torch dot zeros two dot cuda
boom and now we initialize cuda
we'll make like that
b and if i say like b sub equals a uh
look okay it included an entire program
to do that copy
you can see that it doesn't include this
program
should probably get rid of that
non-nvidia i o control print it's kind
of ugly
let me fix that
oh wow it's a lot of opens as well
that's probably fine
okay so we can say like torch dot zeros
out let's make a more reasonable one
all right and that does all the cuda
initialization wow that took a long time
i can make b that was a lot faster
so you can see what is it actually doing
here
these are the launches to the driver
um
it's just doing a bunch of dma-ing
uh there's probably like a zero page so
it's like dma a bunch of zeros right
here you can see it's
getting it out of the gpu
these are all more dmas all right so
what if i do a times b we'll just say uh
c is a dot b right
so that right there
is a
matrix
multiply
um
vos 32 programs i don't really
understand that
uh yeah but it's okay so it's mapping in
the
i kind of broke that one i think
uh it's mapping it's creating memory
it's mapping it in
uh then it's dispatching this
thing
uh this is setting up
the basics of the program this is
passing the arguments to the program
uh yeah it writes something up here too
so you can see like this is the program
argument address does this 160 and one
860. that's pretty consistent all the
time
um
for some reason it's sticking so you can
look here like this is okay it sets this
address
uh it's four bytes launch the dma and
the four bytes are 25
sets up the qmd address which is the q
metadata
uh and then there we go that's the
program launch
um these are the buffers that are being
passed in
how does that one have that size but it
copied that much data
i think those sizes might be wrong
or like shifted by something i think i
read that
uh and then it puts this is the q
metadata struct that's actually being uh
shoved in
and there's a report semaphore to tell
you when it's done
and you can all we can all check that
zeros times zeros are actually zeros
um
if i do something like a plus equals two
all right so uh
yeah
i guess i'm really curious like
what's in that program
there are b's this twos
and then we have like c equals a dot b
same launch and that's 496.
all right oh there you look 2 times 2 is
496. did you know
uh well it is when you add it up one or
two four times which is how the matrix
is right
um you see it's doing this
dma
oh it's doing like tiny dmas
oh this just must be because okay this
is c these are float 32s and each one of
those is c right
so it's getting that it's getting that
it's like reading that it's pretty cool
um i think a lot of the value from this
project could also be delivered and like
instead of printing all of this out you
write like a smart parser
that like takes this because these
semaphore things are like junk you don't
care about right
this is something you care about so you
can see like where it's actually reading
from
on the gpu
and it'd be cool to kind of do that in
real time it'd be interesting to see
what's getting loaded at all these
program addresses
we could like uh
take a look and
grab the names of the programs
that would require some fancy
stuff but yeah i mean that's another
direction to take this whole project in
i think that would actually probably be
the most useful one
like the driver is fun and all and i'm
glad we did it
but
uh you know it's not just about writing
the code it's about maintaining the code
there's there's a few uh
just
dumb
well no they're not dumb but they're
just like they're unmaintained
uh the the
graveyard is littered with
uh people who've written half-assed cuda
drivers
right and unless you're going to
maintain it and like it's unfortunate
this is an unfortunate truth about a lot
of open source projects like
um unless there's an organization
behind it maintaining it or a very
motivated individual
uh these things just kind of fall apart
and i'm not motivated enough to maintain
a cuda driver for the rest of my life
all right this is the kind of thing that
that like uh
well yeah and testing is testing is hard
it's just so sad to me how little money
is invested in infrastructure
um
you know
we we could do so much better
uh with debuggers and with look at the s
code right finally vs code finally
somebody has managed to outcompete them
i and the main thing that vs code offers
me
is and let's see if it's going to work i
can right click on this no i actually
it's actually not going to work right
now
but it does offer at least a quick way
to do a find
uh
across a lot of files at least like okay
maybe here
no this doesn't even work
i can't even right click and show where
that is
sometimes it works i haven't figured out
when it works and when it doesn't work
the ability to right click on something
and see like the type signature of it
that go to definition is awesome when it
works you just saw me try to do it it
didn't work there i don't really know
why it didn't work there
uh
like again this stuff's hard because
like you're you're building in this
complex build environment so ides that
just work out of the box and aren't
laggy or really valuable
and
it took like microsoft
to come in and put a lot of money into
trying to build this and it's nice
it's a shame that it's just microsoft
though
um
you know i've tried really hard i'm
really just working on infrastructure
now at kama we're hiring by the way if
you want to work on really some of the
most insane infrastructure you've ever
seen
in a sense that it's
simple
uh
we've open sourced the infrastructure
comma you know we wrote our own
distributed file system and you're like
well it's really stupid to write your
own distributed file system because a
lot of people are working on one
uh and you know you're never going to be
able to maintain it you're never going
to be able to test it
um and that's true if i wrote something
that looked like seaweed fs or ceph
but if i write something that's under a
thousand lines it actually becomes quite
usable
um it has a
like this would be this project would be
even more valuable if i perf perfectly
mimicked the s3 api
um so it could be a drop in for for s3
uh i mean this piece of infrastructure
is public
we have another piece of infrastructure
called giga shuffle
and like i'd love to open source it i i
the only reason we don't open source it
is because i'm lazy and it's like baked
into a lot of our crap which is no
there's actually a lot of the reason
that a lot of companies don't open
source things
um
oh trying to reverse engineer cuda is
there a github link yeah uh i'm sorry i
should put these things in the
description just go to my github it's
the top project that i just uh submitted
to
or somebody could give them the link
um
amd could totally
i don't understand why amd doesn't have
a drop in cuda replacement because gpu
cc is open source
uh
there are some other incredible pieces
of infrastructure at comma so if you saw
me go into that machine you probably saw
some of the processes were called
gigashuffle
so what giga shuffle is
is and i don't know how you know no
one's written a good one of these maybe
everyone just writes their own at the
companies who are doing machine learning
uh
no amd does not have a cuda replacement
as far as i know as far as i know aside
from some hacked open source things
which convert cuda to opencl which is
absolutely not what you want to do you
do not want to convert cuda to opencl
and then compile the opencl you want to
compile cuda uh probably to ptx but what
you really want is something that
compiles ptx to nvidia
sorry the amd
has anyone
there's something called hip
um does it does it use ptx
i'm not sure
i mean
i i
oh no
no
[Music]
uh what is spear v
compiles cuda opencl no i believe those
called uh
what's that thing called
they can't use ptx due to legal reasons
that's just disgusting you know
it's so disgusting
that uh that the world is held back by
crap like that but i don't really think
that's true
uh i'm i'm not 100 sure that's true and
i don't really think nvidia's evil
um
[Music]
i i think look nvidia just open sourced
a whole lot of stuff
i think that amd is probably being
overly cautious and i think they should
just do it
uh okay nvidia sues you for ptx like
uh
no i don't really think i think as far
as evil corporations go there's
corporations out there they're a lot
more evil than nvidia
um
you got you got to look you can't hate
everybody right you got to put things in
retrospective
um
apis aren't copyrightable this is
bullshit uh
you know again like sue me like okay
fine and nvidia sue's
uh
that's a different yeah
let's talk about a few really nice
things about nvidia so i can go on
amazon
and i can type in nvidia 3080
and i can buy this
for a thousand dollars and it shows up
at my door and i can plug it into my
computer
all right
wow these guys cheap
how amazing is that
right
can i can i buy a uh
can i buy a
google tpu
and stick it in my computer no of course
not
um you know thank you thank you uh
nvidia for for doing that
uh the entire legal department was
working to block the nvidia arm deal
you know
there's a philosophy i have in general
there's no point
like trying to defend the hill anymore
right stop being a modernist stop trying
to defend your little castle
and just like whenever someone comes to
your castle just like move to the next
hill
man
i'm over here on this hill
all right let nvidia by arm
let nvidia block everybody from arm
patent licensing okay we go through a
bit of shit but we move to risk five
all right
um you know when you look at something
like the uh like the m1
it really wouldn't take apple that long
to reuse almost all the good stuff
uh
on the m1 if they wanted to switch to
risk five
it's annoying that things aren't binary
compatible but that doesn't really
matter that much anymore like it's so
quick to just
you know recompile these things with a
new
i mean look you know i always say risk
architecture is going to change
everything
i think there are going to be some
incredible open source uh
cpus with with risk five here's a fun
fact about risk five there's a risk five
processor in the nvidia gpu
um we can go look at it here
it's called gsp
yeah
um so this is how big is that
it's a 39 megabyte
risk 5 binary
that uh that that runs on uh
lisa sue called risk five a joke and
there's no plans to invest in it look i
mean i i respect uh lisa sue a lot i
think she's doing great things for uh
amd but um x86 is a joke and why do you
keep investing in it
right
why why do people keep pushing on x86
x86 is a really stupid uh
a bunch of things about xd6 like
you see what apple had to do with the
the memory model for the uh
to get their x86 compatibility stuff to
be fast i think i think risk five really
is the future yeah they keep pushing x86
because they have a monopoly on it like
okay
you scared of competitors bro
uh like x86 is gonna die
right
you know what
to anyone who doesn't believe me that
x86 is gonna die
i don't even know how to do it on mac
here
that's not the one i'm running
that's the one i'm running
i i've been streaming on an arm 64
computer this is the fastest computer
i've ever owned
i don't even hear the fan i'm on a
laptop right now it's incredible
i
no i'm dead serious about about risk uh
and i think that like
risk 5 and arm 64 are pretty close
um
bro security is a joke and nobody cares
uh
i mean intel intel will invest in
anything
um you know hopefully qualcomm gets rid
of their patenting division and moves
towards selling chips qualcomm could be
a real player in the chip market
look hopefully everybody kind of learned
from nvidia's shareprice that that kind
of thing is the future
sell the card
sell the card
you know everyone who wants to make a
garbage cloud
uh thing
why would you do that
right like like you're gonna die as a
company
yes to be fair here's what i'll say
everybody who's making a uh
everyone's looking to buy arm right
uh
everyone is looking
to make uh a cloud thing everyone is
like oh i'm gonna
uh make accelerator cards i'm gonna keep
them in the cloud and i'm gonna own the
vertical
you're not serious as a company
um
you're not going to win
and
to everybody who thinks you're going to
win who you manage to dupe out of
investment money they're suckers
and you know what you might if you're
looking individually to to get a yacht
uh you might be able to pull that off
but you're never gonna make an impact on
the world
look at all the companies who have
there's no company in the world
right who's managed to who's managed to
to do that
it's like oh i'm going to keep my card
secret and people are going to pay me
their license and it's not going to
happen
um nvidia managed to pass intel the cpu
company but you know
intel might have lost their way recently
they haven't come out with anything new
but the fact that intel managed to not
come out with anything new says
something about the strengths of their
core business
aws azure
uh
google cloud all these people are built
on intel
and then intel lines it's like oh but
the cloud is where all the profit center
is yeah for now
intel's been around since the 70s
intel
well i mean maybe not intel but selling
processors will be around for a long
time the cloud
it's commodity
right
you want to build a you want to build a
uh you want to build a processor well
that's real hard you want to build a fab
oh that's real hard this can require
lots of investment you want to build a
cloud bro
well i bought a couple computers on ebay
i put them in a rack and then i uh
i sold them to people
it takes nothing
right aws and azure the only reason
they're big is because they're making
money off this quick run up
this quick run up of other fake value
there's no fundamental value in a cloud
business
and and
people get all hyped about this but then
people forget about all the ones like
ovh and rackspace that like
you know those aren't those aren't um
i shouldn't say those aren't billion
dollar businesses because i'm sure they
are
but those aren't darlings of any world
right once you start looking for
something as what it actually is you're
like
well they took a wreck and they put a
couple computers in and they put it in a
room with an air conditioner and then
put it on the internet okay great
that doesn't sound hard
right
i could uh you know you want to build a
cloud i could get i could get 50
laborers up from tijuana we could slap a
cloud together right oh you gotta write
the infrastructure software yeah it's
not that hard
i don't know why
you know people think it's so hard
it's like most of it's open source now
you can just do it like the problem is
nobody's going to use your cloud
but they will if you sell for cheap
right it's a race to the bottom there's
no money in the club
um
tpus are just fixed function hardware
uh
well you know it depends what that fixed
function is
i think the things that run neural
networks i think i was wrong about this
you can uh
you know you can you can read my
correction blog post
um
this is the right way to think about it
like there are three different uh
compute paradigms and they are very
legitimately used for different things
um you you need you need
all all three of these
but
this one has been around by the way for
a long time all audio signal processors
have looked like this
right it turns out that you can also
just use the same paradigm for video and
any signal information
and anything you can turn into something
that looks like a signal processing
problem which is what neural networks
are
uh you can put on these dsp style chips
oh the big camera hides the blog oh
sorry
i'm not a good streamer
i should be fired
uh so yeah this is this is a
yeah
there's value in tpus and
maybe tens torrents gonna pull it off
i i'm still hoping
you know
as far as i can tell you know i talked
to jim a bunch of times about it they're
on board
stay tuned for availability come on you
got to sell the cards bro
you got to sell the cards and you know
what your first card's not going to make
money second card is not going to make
money but your third card
that's going to make money
every time i do this stuff you know you
know i want it you know i want to build
this company
you know i want to build this company
you know i want to just put all these
people to shame
uh but making a chip is so hard
you know i can't make a chip
i can't make a chip
and
i think that i could write
stuff on nvidia cards that runs you know
by the way when you look at nirvana
that's what the guy first did the guy
who made the uh
the guy who ended up founding nirvana
wrote a faster 3x3 com than the one in
cu dnn
by like really looking into how the
nvidia stuff worked so this is the right
path
the problem you run into is
if i were to write some nvidia stuff i
feel that i could probably get neural
networks to execute
10x faster on a 30 90
with a much simpler stack
i think i could do it with
five software engineers in two years i
think i could i could out uh
no no nirvana it was they were sold to
intel before they bought habana and
intel buys and kills a new neural
network accelerator company every few
years
right like do you want to be the neural
network accelerator company that intel
buys and kills well a few people did
nirvana havana i think there was even
another one
um
well
yeah when you need a new function right
but like what do you mean by a new
function if they pay good enough why not
bro i should ban you for that what are
you gonna buy
would you rather be paid hundred
thousand dollars but an orange costs ten
bucks or would you rather be paid twenty
thousand dollars but an orange costs a
dollar
um the cu dnn isn't slow
it's not cu dnn itself it's not the
kernels that's not where i would focus
i would focus on
this is the kind of thing that you can
get
uh
if you put time into it using cu dnn the
thing that i would focus on is
writing better tools to make it easy to
see why things are going slow
you've seen cuda fft's implementations
twice as fast as qft yeah i totally
believe that i think that there's there
is definitely stuff to be gained there
but you just don't really know where the
bottlenecks are a lot of it has to do
with bad introspection tools
um so i think with better introspection
tools which you can totally write on top
of uh
right like yes if you hand code
everything and you spend a lot of time
sure you can get that same 10x i'm
talking about but i'm talking about
being able to deliver the 10x with torch
in normal configurations
and look
could i build this yes probably with
let's say five software engineers in a
year
right
um
but then what that's not a company
right you're always nvidia's bitch if
you're that company right you put a lot
of this time into nvidia maybe that's
really the way to do it
maybe you know you you settle for the
fact that for three years you're gonna
kind of be nvidia's bitch but you're too
small for a video to really care about
you
and then you uh
at that point
start thinking about rolling out your
own chips
i don't know
i'm also not sure that i have the
discipline to
to actually run two companies
uh
i feel like it would all kind of blur
together
right
i'm no elon musk
when you look at these people when you
look at people like elon and vitalik
these people are way better leaders than
i'll ever be
um
public amd gpus have that feature and
video has a decent profile yes but how
often do you like use the profiler right
like i've tried to stand it up and like
you can and you use it and you find
something but
it's first off it's a gui
uh and it's not like it's operating at
the cuda api level not at the gpu level
something in general i've found
uh
if you want to
if you want a good place to
uh cut things
you want to cut you want to you want to
introspect as close to the hardware
software interface as possible not at
the api interface
um because
these stacks are built on stacks are
built on stacks and now you use react
and your button reaction time when you
click on it is 50 milliseconds 100
milliseconds in a web browser you're
like bro we made computers a million
this is jonathan blow which by the way
remind me to rate his channel if he's
streaming when i'm done uh
we made computers a million times faster
yet pressing a button somehow got slower
uh yeah i mean so i don't know
should we build
you know it almost seems synergistic
enough to comma
we build
neural network uh
running libraries
another thing that i think about a lot
is like exactly what parts of the future
do you want to own
you know we've got to think about how
things are going to play out and
you know when singularity happens it all
collapses to nothing
right so how do you set yourself up and
put yourself in a good position
uh
cuda back to react
i don't know why i react it's just
terrible it's terrible
but you know you just built it on so on
top of so many levels of abstraction and
people just will cut it here and be like
well that's the level of stretching i'm
working at right and
you know you wouldn't believe how many
mallocs are all the way down your stack
um a lot
uh
i don't know i mean i also like i just
get excited about this stuff and then
you think about whether you really own
anything right like okay you get that
10x great
but
110x does not
uh
you know make you win
and then i i think
you know it's really important that you
make sure that everybody has this
compute
right and this isn't because i believe
in democracy
or anything like that right i think
democracy is actually you know a bunch
of dumb fucks
uh
but because
this general like if you build something
if you build something that like say
let's just say the cia wants they will
take it from you right but if you build
something that the cia wants and managed
to give it away to everybody
well the cia is going to leave you alone
right that's a surreal you got to think
about that that's the threat model right
if you build something that somebody can
take from you somebody will come and
take it but if you build it and you give
it away for free they won't even take it
right i'm amazed i'm amazed so many
people have this mentality of trying to
take
and they they contact comma and they
want to take and i can tell they want to
take and i'm like bro it's open source
here you go here's the link take what
you want and then they're not so
interested in taking anymore
they won't know they actually are really
not that interested
um which really gets to a
thing that you realize about these
people is they're not interested in
taking it so they can use it they're
interested in taking it so you can't
um but if you give it away to everybody
it's
right
you know
open pilot's unstoppable
people think that oh you know i beef
with the other communities and i uh
you know i i
complain about their safety shed or
their yeah like i do and i mean it
but also at the same time
thank you
thank you
for making open pilot unstoppable
can't you can't stop it shut me down
shut me down you get worse people right
that's that's that's really
think about that right you shut me down
look i'm the guy who's trying to tell
you how to do this safely i'm the guy
you shut us down
nobody's doing that anymore but open
pilot's still out there right
that's how you win
that's how you win
ah you make it so though even even even
your haters think that the world is a
better place with you in it there's a
saw it's the veronica mars i'm sure i've
quoted it before
um
it's uh weevil steals the fitzpatrick's
uh
you know their their customer list right
meth deal is a steal the customer list
right
uh
and he steals it and he tells the guy
he's like yo man you know i stole your
list
all right
fitzpatrick guys like yo weevil you
better watch your back
weevil turns to him and says
i'm gonna be watching my back
you're gonna be watching it for me
because the minute i go missing
this list goes out to everybody all
right so it's that
you managed to do that even your haters
are watching your back
[Music]
your memes are confusing though because
back when you did that qmu presentation
and you memed about the yacht or
whatever makes you look like you want to
make money over everything money over
everything money on my mind
then she got asked when it got so empty
tell her i apologize it happened over
time
he says you missed the old great please
don't tempt me oh
i do miss the old drake though drake
used to be good
uh now he's not
i've been yelling out money over
everything money on my mind
uh
yeah bro money over everything man money
solves all your problems in life don't
you know
uh spotify it's joe
uh you want enough money to eat whatever
i want whenever i want
bro no money in the world can save you
from diabetes
uh why every american can sing did you
mean can't
now you should see manny you're singing
and uh like you know you're gonna go to
south korea go to karaoke everyone can
sing there
such part of the culture it's cool
um
oh people from europe can't sing yeah i
believe that
i believe that man i believe that
i'm just thinking like ramstein and
stuff
uh yeah drake's canadian he's from
toronto bro my city boy you know
something like that
um
carly ray jepson and avril lavigne i
believe avril lavigne is also canadian
yeah
so you know i come back to this i've
really put a lot of collective effort
uh why pie torch requires so much vram
yeah like we looked into it and it makes
all these two megabyte allocations that
it like then proceeds to not use
so it's like fixable
it's fixable in torch you don't have to
go down to the cuda level
which would kind of be cool because then
we could use torch
uh for our stuff at comma we're gonna
have to write cuda kernels
but then the problem is you gotta get
that upstream to torch
uh
do i know how to send a udp packet
can i just not can i not just create a
udp socket and send it i don't know why
that doesn't work
wsl shouldn't care ws is a real linux
kernel now it's just virtualized
torch is getting too big yeah tiny grad
uh you know if you if you have tiny grad
with tiny
it's gonna be the next tensorflow
i mean
it's not that bad it's not that bad
because at least it's still pretty
direct when you do a thing
sure it goes through levels of
indirection but at least it doesn't have
hidden state
tensorflow's main problem was it had all
this hidden state in this graph and you
just couldn't see it
right you don't want hidden state
um you want to be very explicit about
state
file bug report with microsoft if they
care
um
yeah
i mean i think i don't know i think we
could write a sick neural network
library but i think we'll end up in this
place with like mxnet and all these
other ones where a lot of effort was put
in but nothing really happened
um
you know i've tried jacks i found it
similar to
poor google poor google
do i know of any obscure alternative
yeah tiny grad
um
someone implemented cuda for tiny grad
we could try to see if we can get uh we
never got imagenet to train in uh in
tiny grad
mx not dying was so sad to watch i know
i know
um
no we need to fall for anything anymore
it's too bad
i'm like it's not even like pie torch is
that good it's just
it's but this is actually the truth
about what is good
i would not look at pie torch and be
like this is an inspired beautiful
library
it's just not bad
but that's i guess what makes something
good when you look at when you look at a
thing it's like well you know it's like
ffmpeg good well it's just it's not bad
right
i
look anyone was still using tensorflow
like i'm sorry
um
do i seven i wonder my tiny cuda driver
will end up as bloated as the nvidia one
well it won't because we don't have that
many people working on it right part of
the problem is nvidia has a lot of
people working on it not all of them are
that good so once you hire a thousand
programmers to work on a project they're
not all that good
uh you get crap
um
i don't know again i wish there were
better like statistics to track this i
think there's some but like we try
really hard at comma to make sure
instead of writing more code you should
just rewrite the code you have
can i explain gigashuffle yeah basically
it creates one shuffle buffer that can
be shared across processes
uh so you have
like eight gpus training in one computer
but you don't want to create eight
shuffle buffers because you create a
truffle buffers you get less shuffling
so gigashuffle creates one
big shuffle buffer for the computer and
then it has reader processes and writer
processes and then the writer processes
are going and i can also refactor
gigashuffle to make the reader processes
put things directly on the gpu which
would be really nice
um
just it would like be so much fun you
know
i i try i always try with the
accelerators and i get emails from such
crap people
uh sometimes i get emails from i
shouldn't say that not everyone is is
crappy people
but like
you know just like if there was a bunch
of people who were like also thinking
about this
uh
you know make a company
get the stuff done
and then try your best to eat your way
up the stack
right like
i think it's impo
this is what i come back to all the time
when i start thinking about this stuff
it's like
you do not want to be in a place where
your qualcomm's bitch or nvidia's bitch
or intel's bitch
you want to own the
[Music]
stack and like a common way to do this
is to insert yourself at some software
layer well let me look at what kama did
with the hardware right we just first
built it on phones and then we moved off
of phones
we maybe moved off the phones a little
bit too early the comma 3 is
unfortunately too expensive
uh you know we'll fix that it's good i
mean it's good we wanted to build
something high-end and good at first
this is you don't build something
low-end you build something high-end
look at the roadster model s right
um
i don't understand julia
uh i don't understand what's wrong with
python
uh
like why should i move off python
can can someone give me a quick
a quick reason about
what julia possibly has over python
start with isa then our own chip
yeah i mean look tinygrad has an isa
right and like i spent a lot of time
iterating and refining this
[Music]
this is the tiny grad api right there
uh and like i can do better at that
you do kind of want two levels of
abstraction there
julia's faster at loading large
quantities of data for some reason
that's not python
like the problem with that is not python
you can yeah
why is julia faster
there's a junk article
of course google doesn't give me
anything that's any good google these
are fucking ads
the website's not gonna be good none of
these websites are good
all right so okay julia's compiled
uh
how is it compiled and dynamically typed
ah
okay so the main selling point over
python is that it's fast
am i understanding this right
it's jitted
there's no saying aot what's an aot
oh
oh
is this really stable exclamation point
exclamation point exclamation point
question mark
uh
no like building is not that slow
anymore people just think building slow
because of c plus plus where it's really
slow you ever try to build uh eigen and
c plus plus and get ready for 20 seconds
um
just easy to run on the gpu
nim language is as fast as c and these
things are not
really
there's no
yeah guido's focusing on the right thing
somebody should just make python fast
which is another oh don't get me started
on making python fast right like oh man
i'd love to do that
yeah be really nice
uh
i told the uh we'll see if i get the
contract
told optimism i'm like i can make guest
10x faster you know all the ethereum
people are complaining about their block
gas limit and stuff and they're
designing all these complicated
solutions i'm like did anyone just sit
and try to make this thing fast you're
doing a malloc for every stack variable
no wonder it's slow stop malicking
i'll just i'll just literally and i
think i'm you know oh yes i'm going to
do all these fancy things i'm going to
implement all these fancy things no i'm
literally going to remove the malik
it's going to be 10x faster
and then i'm going to make the
database calls asynchronous with
asynchronous database calls and malik
removed i think i could get 10x speed up
um
you shouldn't use it unless you're
willing to help maintain the standard
library
great that's a that's a
[Music]
it's a language i can trust
all right look you can live in this
apartment but you shouldn't live here
unless you're willing to repair the roof
ah
all right
wow 946 we really get a lot of these uh
we really get a lot of these people is
is jonathan blow streaming
i have to watch an ad
wait no is this is this the wrong
development
where's his twitch
wait he's watching
he's not programming
oh all right cool
what language is this is this his
language
oh it was an ad
oh i love ads
i'm liking this
oh this will be so nice oh i'm liking
this
i'm liking how they're thinking about
this
is that one not
jai
all right let let's let's uh
since we're talking about languages
um
that would be nice if c had that it
would have been nice because we could
have uh
the thing about a language is you have
to build such a complicated ecosystem
uh yeah but i don't want a different
python interpreter
all right like is this supported no like
this is the last thing i want to use i
don't care if it's faster i don't care
if it's 5x faster if sometimes when i
call parse on a string it's like faults
right when i call split on a string it's
egg faults like that's not worth it
you know
this is what i'm interested in it turns
out can you stick dicked at a fixed
offset and get 20 speed up i'm
interested in that right marshall stupid
yes get rid of it replace it with pickle
i'm interested in that because that
reduces complexity
right import improves startup time most
things can improve startup time just by
sitting there and looking at it for a
bit
right
yeah even if you give me 20 you give me
20 every time but if you can give me
speed up while reducing complexity
that's what i'm interested in
all right where's our stuffed pep
let's read this pet
legit just adds a lot of complexity
ahead of time compiling static types is
also i mean this is kind of exciting i
don't know how uh
how well maintained it is but i'm
interested i kind of want to move open
pilot to this
python is disgusting yeah non-standard
syntax
all right
psython never should have had what is a
c def why do i have to see import none
of this stuff makes any sense
yeah my pisces is good
this is this is this is interesting
this is the best like
python improvement stuff i've seen the
typing stuff is great
ah
yeah
but you have to do it without breaking
stuff
hopefully python has learned this lesson
from the python3 fiasco
uh
oh i have to request a gi beta it's not
open source
maybe it will be open source
you know closed source language that's
that's uh
oh i don't look i don't have to i don't
have time to spend on this i'm happy
other people are thinking about it
ah compiler isn't closed better now the
python three police is coming
all right
i'm done
enjoy learning
jai
the raid has been created
wow
raid now
go 904 people
ask for a jai introduction
i'll watch too
[Music]
switch to jai doc quick
did we actually get raided because
the phone client doesn't tell me it
seems like we did we did the hot army's
here we're not really programming right
now anybody well you got a program you
just got 900 people it's getting kind of
boring
so
i was also writing documentation of
language features slowly while doing
counter-strike
but we're not really we're not really
programming that much
we gotta be programming
we're watching shroud
what does deferred do oh it puts at the
end of the loop
i don't know if you guys can still see
me i don't know how raids work
open beta
that was rough guys
that was rough
that was rough
we're watching counter-strike i mean
george you could do whatever you want in
life right
the
i don't want to do a sales pitch right
now
[Music]
like
you already have a substantial base of
software that you work with
and i would not
try to get you to
change your thing
like
yeah there are lots of reasons like i
wouldn't spend eight years making a
programming language for no reason right
but um
i just don't want to get the sales pitch
right now
you know what i'm saying
[Music]
if people say julia but it's supposed to
be pronounced yolia and people don't
even know that
which tells you how the fuck much people
know that foreign
[Music]
i wouldn't like
here's the thing guys
i was i was indoctrinated into the
functional programming language kool-aid
very early on i went to university of
california berkeley
where they you know the intro to
computer science school
class there
um
is copied from mit right it's the
structure and interpretation of computer
programming
it class you that this was the best
thing ever to happen and the scheme
is the next evolution of list because
it's so simple and it makes computers
beautiful and all that and there is a
little bit true about that
but a lot of it is just indoctrination
into bullshit
and i got exposed to that early enough
to develop some immunity kind of like
covid
and so now when i see all this hassle
stuff
or
whatever pick your
pick your poison um
i just kind of know why it's not true
why all the rhetoric isn't true right
and so what i have to say all about all
this is like the functional thing
and overly mathized programming
languages in higher kinded types and all
that shit has kind of played itself out
nothing really new is happening there
even yoli is a pretty old language
haskell is from fucking 1991 if you
bother to look it up
hacker news kids think it's from like
but it's from 1991 oh dude interest has
one hp
oh my god one second
that was nuts okay
um
it's played itself out and the promises
have not been fulfilled garbage
collectors are even slower than ever for
example did that one like the power that
you're supposed to get you don't really
get the magic parallelism you're
supposed to get doesn't exist but all
these things don't really work
and it's time for people to wake up to
that right and so part of what my
project has been about is about fucking
saying what actually works in reality
what about the way that we know works in
reality is sub-optimal and what can we
improve about that and in fact we can
improve a tremendous amount
um
but like
just realize when things haven't worked
and when they haven't paid off
that's all they're saying
python in a functional style works well
i mean that's true if you like your
computer being a hundred times as slow
as it actually is
why is python slow you want fastback
well okay
so part of the problem with python is
just the implementation sucks right and
it's got a lot of baggage
so
it's very hard to make that code fast
right but part of it is inherent in the
language
because the way that you make things
fast is you know what type everything is
that's just fundamental if you don't
know what type things are they're just a
lot slower they're not
as much slower as python happens to be
so you could fix that
but there's still going to be a one to
two order of magnitude
maybe one maybe 10 x gap between
you know a c style thing and a python
style
unless you're strongly typing
and once you're strongly typed
everywhere you're talking about a
different part
i think
has this one man
is rotated off to b for some reason they
both want b
yeah
so yeah what chaiza is saying there is
is correct actually functional languages
kind of got screwed as well
because they doubled down on this
paradigm early on
that like you know it goes all the way
back to lisp that like
things are pointers to things and you
can make all these aggregate data
structures by pointing things and things
to other things right and that's how all
these interpreters
work internally and the problem is as
computers have gotten more modern right
cpus have gotten
fast
and memory has gotten kind of fast
but the distance from cpu to memory is
much greater in relative terms than it
was
in the 1980s for example or the 1970s
and so um
so that decision about how these things
should be architected
makes them
just tremendously slow now right
regardless of even anything else like
even if you do know what type everything
is
if you don't act on that by collapsing
all these trees and stuff everywhere
then you're still going to be slow
so
and there's no and like by slow i mean
you know is like i don't know it depends
on your cpu but it's like two cycle
leaks
like you get five instructions per clock
throughput and if you go out to main
memory you're at like 500 cycles now
it's just an insane difference
and your programming language needs to
be architected around respecting that
difference
and none of the functional languages are
hardly and the ones that sort of do only
sort do and it's not enough
and then so that's one class of thing
and another class of thing is
interpretive languages right which you
know python isn't really functional it's
just an interpreted language
um
and
those decisions about interpreting being
cool
were made in the 90s when computers were
a little different and we also thought
they'd keep getting faster forever
and we didn't see all the downsides to
like
you know
not realizing when you type a variable
name or whatever so
these are just all we have to realize
these decisions were wrong
and re-introspect and remake decisions
based on that
just like ants should about
how they approach that bomb site
man good morning streamers here we're
live wow what's up
oh yeah don't worry i already had it
ready yo we found exciting shit
we found super exciting shit
oh man ah y'all
y'all
all right good morning good morning good
morning good morning
let's first pop out the chat
um
pop out chat
there we go
wait for a few people to post in here
make sure you guys are all here and then
i can show you what i found this morning
i didn't want to be loud i don't want to
be loud when i saw it i couldn't stream
this morning so i didn't write me code
don't worry you guys didn't miss any
code writing you did miss some code
reading and i found very exciting stuff
good morning z good morning w
we're gonna get to the bottom of what
these things mean
w good morning yo yo yo
welcome well i saw a license plate
yesterday it said yo yo yo y
and then i realized that it wasn't yo yo
yo it was yo-yo-y his name is yoy and he
plays yo-yo
when drinking bulletproof cold brew
latte it's actually kind of nasty and
that's you know i'm not sponsored by
these people because i tell you the
truth man as soon as you become
sponsored you lose your objectivity
ah what's up france what's up israel
what's up
chile
what else we got you in patagonia are
you in santiago
how was la it was eh
would i ever take any sponsorship only
if it truly aligned with my brand
um like which is you know
mocking corporations
oh rick and morty i get it that's not
bad that's not that you're a subscriber
that's why i looked at your username
because it had a star next to it and it
means you're a better person than the
people without stars sup indiana
uh sup romanian oh immigration oh don't
get me started man i think that
everybody who has an iq of 120 and above
should be able to move to any country
they want
um
i should come visit easy africa east
africa i was hearing all about ethiopia
last night i kind of am excited to go to
ethiopia
okay
i'll show you what i found
so this
is the mesa driver
uh
which is part of
novo
so i was looking at you can see here
that this 100 1000 these are the this is
the threads and this is the blocks right
so it's 100 times 1 000 and these are
the dimensions 1-1
and then i started looking and you start
seeing that these things you know you
just got to look for patterns you start
seeing that these things
are uh
there's one there there's one there
they're not pointers
and they seem to have some very regular
structure to them
so then i'm reading through nova when
you find it out okay
so well that's dust address stuff
but i searched you here we go
oh no not this was the grid
these are the novu things that build the
command kill yeah
so you see this thing called upload exec
you can look at upload exact i found it
over here
uh it's one b zero and i look at this
and i'm like
six c six d that's not exactly one b
zero
but then you look at this nv ec poor no
no not this you look at this function
the begin one i c0
and you find this
nvc0 fifo pack header 1i
and you go to this and you're like
six hundred thousand
and this is six hundred thousand and
this is two hundred thousand so then you
understand what these things are
and then you ask what is six d
well it's called with this thing called
method which is then shifted over two
and if you look here
um
at
this
method when i take one b zero and i
shift it over 2 and i hexify it i get 6c
and sure enough
6c
so that's an upload exec that's an
upload data i found it all but that
isn't even where it stops
then i did a search for this constant
in the driver
and sure enough in source common nvidia
class inc class clc0
which stands for ampere compute a
because we have an ampere gpu
we have all these definitions
and
unlike the novu definitions which were
made up by people who didn't understand
what was going on i mean right they're
just reverse engineered
nvidia has them by the people who built
the gpu so here you can see
launch dma
instead of upload exec that makes a lot
more sense
load inline data instead of compute
upload data that makes more sense you
can see that these names are just a
little bit better and we have them all
right here
in this include file so we are about to
smash the command buffer and take a look
at what's finally going on
uh
inside
this driver we're going to be able to
submit our own stuff to the command
queue so basically where we were
yesterday as you have these two things
this is nvidia zero this is nvidia
control they're just mapped we can also
uh hook map and see what's actually
being
uh done
oh thank you thank you for saying i'm
skinny i have been losing weight it's
true i'm down to 160 i was weighing 170
it's a little too much
but considering
that's off topic
you just got subscriber only chat
so we now understand what this stuff is
and we can make something
awesome that's gonna parse it
let's go boys
let's go
welcome to the future
if you thought the future was over
you've been listening to the wrong
podcasters right here on the george
hart's twitch stream the future is never
over because the future is now thank you
thank you
all right let's go
let's go
okay
so first off we don't need to go all the
way to this we can just change it to
that
all right so you can see that i've
dumped all the things that i want to
this dumping is not going to be uh
no more dumping just like you know
parties in la
uh no more parties in la i get what
kanye was saying
no more parties in l.a
uh the hype trains coming
everyone subscribe
let's go we got a great stream today
what we're trying to do is we're going
to launch a cuda kernel without the cuda
driver
we're going to write our own user space
and this user space is going to talk to
the nvidia driver
and it's going to be wonderful can i
interest you in everything all the time
can i interest you in everything all of
the time
a little bit of everything all the time
dump command
buffer
oh george is back coding in there
[Music]
actually we're not going to say
plus we'll leave that to down here
um because sometimes we don't want to do
that all right
so let's start with just this
uh pointer has already been declared in
the scope ah again what when i declare
pointer
do i declare it twice
oh
useless hours okay so we're starting
with a 22062
and we know
so this is this here
is mesa
which is the user space opengl component
and this here is the nvidia
driver uh
let's put on some great royalty-free
music
royalty-free music
chill
beats
i'm sorry i can't type this morning
okay
i don't know if this is actually
royalty-free
so sometimes people just put no
copyright
but let's try to figure out where
[Music]
use these free background music you must
credit the original artist
is this actually copyright free
oh this is released under the creative
common unreported share alike
all right let's just make sure it has
lots of thumbs up and no thumbs down oh
no we can't see if it has thumbs down
oh no free music's a scam could someone
find me some real free music and we can
put it on
[Music]
no copyright music chill beats
is this one is this one free
how do we know it's
free i don't know if it's free
oh man
who else hates the music industry you
have to buy the subscription they're
using the royalty free term for
algorithm views oh no
okay okay okay okay
ai music generator
i only i need chrome oh i have chrome
here we go
[Music]
is
[Music]
come on the hype train is close
[Music]
[Music]
wow
whoa
this is trippy
[Music]
all right stream beats let's go
chiptune
feels like winning all right
wait
i don't get it
does it not work
this doesn't work
no we want chiptune oh come on chiptune
can't be copyrighted
you can't copyright it only has eight
bits
yeah yeah there's no way this is
copyrighted this can't be copyrighted
nope it can't be
so
so
[Music]
so
[Music]
so
[Music]
[Music]
[Music]
[Applause]
[Music]
[Music]
what my music got
should i just get copyrighted out of
real life
[Music]
rick and morty thank you for gifting
subs i appreciate you
[Music]
uh
[Music]
no no no ever since i've become a
creator i've decided to respect
intellectual properties
now that's bullshit man
let's just give a shout out to these
chiptune peoples
these peoples man
go buy their merch or something
i don't like that i couldn't put that in
there
there's no
do you see why it's annoying because
it's gonna visit me if i try to do this
she's gonna be like i don't know where
to find that file
i don't know where to find that file
does that work
what
open gpu kernel modules that should work
source common
sdk nvidia ink class that's right
[Music]
it's right there i don't get it
all right uh it's too hard to focus with
the chiptune music
it's too hard it's too hard i like the
chiptune music but this involves
thinking and i don't understand why this
doesn't work i put that there
oh i know why
see as soon as you turn the chip no we
gotta put the chiptune music back on if
you can't focus with the chiptune music
you need more bulletproof cold blue
latte
ah perfect
you need a dot dot slash boys
through md types not found
so
yeah i'm as upset about that as you are
don't worry there we go
[Music]
[Music]
bulletproof
the size is two so i think if we can do
pointer plus equal size maybe plus one
cool
[Music]
[Music]
pretty nice right
[Music]
look at that method that's a big one all
right but now these are these guys so we
just need to parse them
so
[Music]
okay nice right
okay so before the next song starts
we'll explain what's going on so these
are the commands you can see their
methods so this is a 188 method and here
we can tell in this beautiful file
provided to us by lovely nvidia
that that's an offset out upper so this
is an offset out upper
uh this is an offset out
is this right
is that a pointer i guess it is
that's not a pointer though
oh no this is a line length in i'm sorry
this is a line length in
this is an offset out upper okay that
seems plausible that it could be a
pointer
oh z yeah it's over here okay it's one
of these
oh six
do i want pokey
you love pokey don't you
uh y'all have some pokey
yeah yeah
like a like a salmon tuna pokey
salmon tuna yeah
i want crossbridge genetic salmon tuna
can they make me that
i wasn't talking about anything real
okay so this thing is big look at how
big it is you can tell because the size
is 88
and 88 is a large number
wait is that right
oh because i did everything should be in
hex
what's sub c
what is sub c
okay but you see these methods and how
they correspond to these things
and we're going to figure out how to
parse them it's going to be awesome
all right so this is launch dma oh sick
and look they even have it all this
labeling is so good
oh man i love nvidia
every bad thing i've ever said about
nvidia i take back because this is dma
desk layout launch pitch
[Music]
nvidia i'll even consider buying your
chips call me call me yo yo i told tim
cook to call me you know
uh nvidia thank you for thank you for
releasing this now this this
this here is probably one of the most
valuable things in the driver
because this is the how the
the gpu itself is actually interpreting
uh
the stuff so you're not gonna find the
code that parses this stuff so you'll
see like even though you can see that
it's clearly using a uh
an offset out upper if i search in here
for offset out upper there's no
references to it
nvidia did not have to include these
they just did which i really appreciate
we're at the core so this is the command
buffer that's actually being parsed by
the gpu
um
what is that
16.
i don't get that
but that's a pointer
no need to look into novu
i mean i looked into novo novo was
easier to get to this because novo
actually uses this so the part that i
looked at nova was the user's face but
yeah they guessed i mean and and this is
gonna this is gonna
this
this file alone is gonna do wonders for
improving novo
you know like
i don't think that uh i don't think that
qualcomm includes this with the fredrino
driver there's no reason nvidia had to
include this file and i hope it wasn't a
mistake
uh
[Music]
because this is all built by user space
uh and i hope you continue to include it
because it's really it's really
something we all appreciate
uh of all should appreciate so let's
let's give thanks to nvidia and let's
purchase something from them
uh i'd almost buy an a100 i mean i'm not
gonna go that far but
you know i hope you make money on 3090s
and 3080s because you know i own a lot
of them um
not of course to be used in the data
center because that's again fools but
actually after this who's even gonna
care someone's gonna write a sick open
source cuda
uh if you can find what
the
the uh oh the gpus i don't know how to
find
if you're willing to pay exorbitant
prices
nothing's hard to find okay so this is
load inline qmd data what is qmd data
um
this is set report semaphore a
and then you can see that it ends at the
end of this so the size is four so
there's hex four there plus x4 there
okay
so this is the command buffer that's
actually being submitted to the gpu
um
then this is being put on to actually
queue it up let's see if we can find
what that is
so this one's obvious this is a pointer
this is oh
part of a pointer 2 actually that 2 is
part of a pointer
i don't know what the 356 is
that's something else
you see what i mean when i say that two
as part of a pointer
so i didn't actually have to do this
let's clean this code up a little bit
this is uint
t
and with
all right so where does the junk start
there so let's end with let's go ff
f f
f f
it's just a little cleaner
oops
uh yeah also sushi rice
sure
you know what i like i'll be happy
oh i see i got nine
is those twos that
salmon
yeah
yellowtail
ah
i shouldn't really have ep there what if
i just do this
identify our pointers undefined uh
let's change that to pointer let's make
that while one
and then i think if we uh
type equals equals zero right i don't
think there's any
all right great
great so you don't even need this
i think i mean i think that's what that
means it's possible that's also a flag
and has nothing actually to do with the
pointer
no nothing's illegal it's it's that
stuff's targeted at that it's it's a
funny joke the stuff targeted at uh
basically like they don't want aws and
azure offering uh
3090s
i need to configure
obs so it won't be included in the vods
don't disable vods
all i heard there was disable vods
lovely just make sure it doesn't have
sauce
alex you know what i like i trust you
sushi rice
all right we got ocean view coming
two shits and 64 shits
the twos and 84 seem consistent yeah
probably all right
let's see if we can understand how this
works
push data so let's see like what calls
one of these so i'm reading the novu
driver here
um by the way shout out to all the
people hustling
uh you know in front of their
neighborhood just trying to sell crack
in my neighborhood or something like
that no i mean like the people who did
this
pro
ah
okay
so
launch grid
upload descriptor
and flush
this isn't the same thing like this is a
different format right because it's
clearly just a pointer
um
what is this 356 that's what i'm trying
to figure out
no scratch done
upload descriptor and flush
nv4cp launch
[Music]
all right so like upload desktop oh you
know what okay let's uh
let's put a switch on this method
i will say char star
method
switch method
uh method name equals a case
so what's the first one
188.
see one of the beautiful things about
python is that it's like introspectible
and shit so like you don't do that but
like you could just use some magical
pythons and
line length in
b0 but you learn more if you type it
manually by hand have you ever done a
programming tutorial you know you could
just cut and paste it right but that
would be
like you know taking a car and a
marathon
why would you do that
when you can
run
i actually don't know i do not
understand the appeal of marathons one
time i got into a fight with marathon
uh it wouldn't let me move my car i
wanted to move my car out of my driveway
and there was a marathon in the way
and ever since then i've hated marathons
and i've
you know uh
like peter thiel sent dark money uh to
destroy the marathon industrial complex
big marathon has finally met their match
i mean how do they do it how do they
shut cities down
because some people want to run like
like a lot of people don't run and this
is discriminatory
and i will not rest
until every last marathon is shut down
uh no they can still have them in greece
i'm only talking about domestic
marathons
load and line qmd data oh because you
have to do it
like this i say
okay good
look at this prints them out now that
was beautiful
um now we can get a little tag george
rant about marathons at this time
ah
okay
wow so load in line data that's a lot of
inline data
and there's some pointers in there looks
like that's a pointer that's a pointer
and that's a pointer
so maybe we know something about the
inline data see if we can find that
struct anywhere what about cyclists bro
anybody who calls themselves a cyclist i
don't mind if you ride a bicycle like
when i was a kid i used to ride a
bicycle too
and like you know i don't mind if you're
like yo i'm gonna like bike to work like
that's fine but once you have an
identity as a cyclist
you've like crossed the line man you
crossed the line and you're going to
tell me about your carbon fiber frame
and your toe clips and like i just
you know i mean you know you ever talk
to a rock climber and hear about their
rope
it's like man
how much was that rope well i got a
really good deal on this rope oh how
much was it oh oh well you guess oh like
50 bucks
no it was like 600 but like it's really
nice rope you start sticking it on on a
rope band
you know capitalists man capitalists
would they're gonna the companies are
gonna sell the rope which we hang the
capitalists with you know that's right
that's right big rope they're gonna sell
the rope that we hang the capitals
what's that it's a lenin quote
linen sell the
rope you hang yourself with
the capitalists will sell us the rope
with which we will hang them
when it comes time to hang the
capitalists
that will buy with each other with a
rope contract
bro
bro
bro
um
okay
ah what was i doing sorry i got
distracted
okay these are the things that are going
in
we do have to figure out what inline
data and what qmi data is
set inline qmd address
offset out upper that clearly looks like
a pointer right
i don't know are these valid pointers
four b five four two two
four b
five four
two two no because it's in that range
so this is uh called proc self maps you
can look at it i also found this thing
called proc i o map but it's actually
cool if you cap rock i o m you get a lot
of zeros but if you cat it with pseudo
you get things right so sometimes if you
want to turn your zeros into non zeros
you gotta use pseudo i found out this
money i thought it was cute
um how much do you spend on your happy
hacker keyboard uh
i don't know i've had this for like 10
years now
i bought another one of a friend for a
hundred bucks he bought it for an
employee and then fired that employee
and then this employee wanted an
expensive keyboard you want to buy it
yeah it's the same one i have
uh no wonder maybe that employee watches
my streams but either way i got a happy
hacker people i got a second one for 100
bucks and that's the one i have at work
and i have this one here wow i talked
about my keyboard on the stream are you
happy
if you're happy i'm happy
okay
uh
sorry we did a lot of we did a lot of
useless stuff okay we're gonna try to
construct these things
by hand i don't know what sub c means i
don't understand why method gets shifted
like that
i guess they're the same as the ones in
here so there must there must be some
reason for it
fast fashion is bad for the environment
man
that's not do you think forever 21 is on
the esg index that's right they're not
because they're out of business
shine
wow that reminds me of the hit victorian
justice song called make it shine
i got really into the nickelodeon
television show victorious for a while
man
young you know and that show made me
respect uh ariana grande a lot more
like that was like a real childhood and
you can watch it on victorious
okay
why
skew
and i
ill and one eye
where did they get these names from
i understand that documenting is hard
um
is there anything that looks like this
in here
can we find the official nvidia verb
versions of these
i don't think so
this just might not be in here
so
all right
launch dma
offset out up
line length and load inline data
remember here's elite food by the way
so this
this here
this load in line data is for the uh
these are the arguments
to the function
offset output
we do a really nice way now like
comparing because this is
this novo driver is
the uh
[Music]
user space version
so if we go to like where it's calling
this
we can see what's going on here
upload desk address hi
okay like this sure doesn't look like a
pointer
line lengthen is just always
that
okay launch dma
do have a lot more information on launch
dma here
so you can see that it's a layout pitch
and a flush only
i'm sorry sorry sorry that's not a flush
only
um that's a
interrupt
dma interrupt type interrupt
so you see how these are like in
clusters
load in line data offset out upper
blind lengthen launch dma load inline
data
oh
i think i understand what's going on
here
so i think
this is an address
and then this is the length you can see
that this length is the same as this
right so if you do 7 times 4 it's a 1c
right
58 times 4 is 160. we can confirm that
by the way that's 58 times 4. this
should be 160. okay cool
so that's the length of the data so
address
length
uh dma
and then you have the data okay cool so
we can just break those things down
basically into our mem copy
whenever we see those four
ah great
um
i can write my own version of that
just a
little really helpless okay i imagine
that these are then referenced later on
it has to reference them otherwise how
does it oh here it is
is that the 160 that that matches
oh yeah one six two two
yeah okay it's like right there
all right so then this is a pointer to
that with a c44 at the front of it
i don't really understand you see how
that c44 shows up
okay can we figure out what qmd data is
load inline qmd data does this talk
about qmd
search for it
compute qmd
[Music]
ew it's a patent
okay
the compute related policy parameters
also include a compute priority which
represents the priority level to be set
for compute work
this is the priority set inside each
compute cooperative item data structure
sometimes referred to as a qmd
all right well i'm glad that we
understand it
so this is the interesting structure
because this is the one that points to
the other one i imagine these ones can
kind of go anywhere in gpu ram like we
don't really care
um even though like nothing's unmapped
there
how does it know
it's this
why is it why is it mapped to nothing
why would they do that
no it's not quantum molecular dynamics
it's just the data structure that like
this is the data structure
that explains
what it does
set report semaphore
oh is that a pointer oh that's a pointer
is that a pointer to that
maybe
oh
well interesting to note that there's an
84 there
let's see if we have this here so we can
kind of get it
but all right does everyone does
everyone know what a semaphore is if you
don't know what a semaphore is go back
to high school
oh
okay this one doesn't have that
q metadata oh
all right all right all right that
sounds plausible
where do you get that
oh
why is this doing this again
oh this is great i think this is
actually the uh
what why doesn't this work
fine
aha look at this
so i bet we can find this
oh based nvidia
oh yes
oh bros
bros i love nvidia oh this is the data
this is it
so this is just parse that for that
[Music]
thank you q metadata bro
all right
let's reparse it
i would report interport
so this is like the
bits
uh i mean i assume it's the version zero
zero seven but i guess we don't know
i don't know which version it is i guess
i don't oh i know one way to tell
oh they're all the same length never
mind
the novu driver uses these cryptic words
like qmd no but here i found it it's
right in here
so you can just get the the class 0c0
qmd
and it looks like there's a few versions
of this structure
and my guess would be it's the most
recent one because this gpu is a 38 eti
so this
is this data structure here
uh now who wants to deal with parsing in
okay well let's find the interesting
stuff
oh set inline qmd address
i guess
i don't know how it knows
odin line qmd data set report 704 okay
and that's probably it and then it
probably kicks it off
it gets to a zero type and it stops
that's huge it's true it's true
also i was looking something up how
to look
professional
on
zoom camera hacker news i saw this thing
on hacker news
and i realized
that i was a streamer
and
ah here we go use a proper camera as a
webcam yeah yeah this article
so
like look
i look like this right now
let's see what i look like
i could look like this
should we buy one of these
because i have this one here
the most frequent thing to use is a
sony camera well we hate sony
you want a mirrorless camera not a dslr
can you just tell me which one to buy
and give me an amazon affiliate link so
i can pay you
this is what people are using
what i have to buy an hdmi to usb
capture card from uk amazon oh that
that is a cheap price
just buy an hd webcam you know what's
this one
[Music]
for a while my ebay was in mexican
but it's not anymore
oh now we're talking that looks pretty
nice
let's look on craigslist
should it include a lens
stock lens this one include a lens
oh it's just a body
oh a hundred thousand dollars
sony camera san diego
all right does someone want to contact
this guy and see if he wants to bring me
this i'll pay him 500 bucks cash
let me see if i have 500
a couple hundred bucks cash gonna try to
buy so many webcams
wait someone pass them to mine
i'm gonna see my
streamers are gonna contact them and see
if uh wait contact
oh
but they won't be able to see us once we
have a sony camera
i'd only buy the a if i'm going to use
it outside the streams
that's a good number of megapixels i'll
think about it
oh and then i need to buy a tripod
oh everything's so hard
i think we should just go on twitch
figure out who else is streaming if they
have a nice camera figure out where they
are and then rob them
what
because there's no more laws and i want
to take advantage of that
and that is much easier yeah i know
they'll have everything i need
i used to be a twitch streamer but then
some people run up on me and they jack
my shit
where's your hoodie
okay so let's figure out what this is
why isn't this down here
is this one down here
8160 why is it not
oh is it like offset a bit
let's figure out what that is um
let me improve my dumper a little bit
all right
let me actually add one times four
and i'll make this decimal
okay
so what's it 192.
this 192 oh these are bits wow that's
intense
because though it times eight there
okay cool so what's that 1536
inner debt
inner put okay that's 30 bits
it doesn't seem right
it's only 30 bits
i think it's inclusive so it's 31 bits
but still
pointer is there
where is that in her put maybe it's not
that structure
that's not spare
that's this one
whoever only inner get no they're both
in there yet
i just don't exactly understand why
maybe it doesn't start at zero
plus you could stream it yo has anyone
made robbery streams yet
or you just rob people
and stream it
yeah that's true
um
this just doesn't seem right you know
what i mean like that's a bigger pointer
this this
that 7fc9 thing is very clearly a
pointer because it changes
i agree that there's something in the
front of the pointer
also why is this not that
one two four
oh times 64. okay maybe that's constant
buffer
this will be 64. that seems
appropriate
so we go to 928 we start to get oh maybe
that's 928
and not one or two four
maybe there's some like meta parameters
for this that i don't understand
let's just okay let's see what's 928 so
let's say there's three meta parameters
oh so minus 32 times three
does that make it line up
that would make this 928 that seems
right i would make this 1440
shader local memory low size
yeah okay okay okay that seems right
all right no it's still a size that's
not right
thank you
uh
well
what am i supposed to say to that i
never know what to say
um it's like you're craving anything or
you want more snack food or late night
this is like my brain's not indexed like
that
i don't know i love how you speak with
me
if you're just like it's helpful for you
to give that feedback that you don't
know
i don't know
like it's just hard because it's like
not indexed like that
um
food's only accessible when i like look
at it
and it's kind of bad and i should
probably work on like re-indexing that
but like i'll hear the name of a food
and i'll get excited about it okay i'll
get us some healthy snacks
we can cook dinner tonight
scallops i love scallops
and spaghetti gal spaghetti sounds great
thank you
why did you say minus 96 from the start
why do you know that based on something
i'm really tired
you're tired
you see it now wait it's not -96
do you think it's that
okay let's try to figure out what this
is
or you know what we have these qmd
structures in here we have to
wow
it used to have zero what no i just made
that up that's not real
i just wrote that
yeah you know what i'm saying
i literally just made that up
what's this mw macro
[Music]
is it not defined i feel like it might
not be defined
okay either way let's include
the
cla 0c0 qmd
and then should we try to write
something that parses out like this
thing
where's that vip guy from yesterday it's
a good question
thread dimension this is so complicated
so much stuff in here
um
well okay so these things are constant
buffers that's interesting to know
and that's that there
well you know maybe we should look at
the assembly for the kernel too
we have this here saks buy.ptx
oh no this isn't the assembly
i guess it is the assembly
i guess like we don't know what is
how does a function work like
what's the abi for the nvidia gpu
thomas and belly thank you for
subscribing
uh
i feel like i guess we don't really know
right
i'm to guess that this is the size
so it's passing something in that's
c44 that starts with d222 but then that
one doesn't work
i don't know we'll get rid of that minus
that minus thing
well okay wait here's a question
this is 2048 long right
so no it is it is this
like we just need to make it fit
what's 96 plus 24
992 have a plus again 156. that's not
even aligned
this doesn't make sense it's not even a
line do you know what i'm saying
oh
unless
see okay here's something that's kind of
confusing right
look at the endianness of this
and then look at the endianness of this
so there's a chance i'm getting thrown
off by the endi in this and it's
actually this
that doesn't make total sense because
this one's clearly the
no
lower is down below upper so it's not
that
just i don't see how you get
this number
from this number
the size is hex 16 so this is the size
here
that seems right
but this is not one or two four
and this is the size of this one
so it's passing in this buffer here
with that size
there's other buffers here those buffers
don't
i don't know what this is
maybe one of these is the function
all right so
this is the thing that's in cueing me
the cuda call
and these
4 come in a cluster first we load in the
address then we say how much data we're
going to copy then we launch the dma
then we say what the data actually is
i don't know i don't like that times a
either
so now those are real hex offsets
and we can like look at it okay
wait a second
so
how is this 160 if that's only 336.
should i just do something wrong
other decimal
i don't trust decimal either
now that has offsets all right
good
okay so this 160 now corresponds to this
it makes sense that we dma other data by
the way
why didn't they just write this all as
one thing like why is it multiple dmas
why can't i just
dm because all this is doing is loading
this shit at this address
also why is that not mapped
it's in this big dead section here
if we understood what was mapping that
we would understand a bit better let's
see how big this section actually is
i don't know what's that in decimal
i'll make it bigger
it's 260 megabytes
um
copies this which are my arguments
so my arguments are at plus 160. so this
is probably just some generic metadata
to the kernel
like the kernel understands i feel like
we could find a plus 160 if we actually
dove into the uh
anything lower level than ptx but still
readable
i feel like if we found this offset it
would be uh
it's not a guard page because the
addresses are referenced here
okay so 160 then we're loading stuff way
up here at 1 8 160
and this stuff i don't know what it
is um
and then we're loading stuff at
another completely different address
just some weird pointer
and then we talked about the semaphore
i feel like that thing that we were
doing we were dumping the buffers also
kind of might not work because
i didn't tell it to synchronize the
cache
i don't know how this stuff works but if
i dma something to
okay either way
this here at hex 80 is a pointer
let's start documenting this
hex 80 equals pointer to
first to
160 dna plus rs
[Music]
all right so that's the 160 dma
plus the args which are also at 160.
right see this this address that's
address
uh
i don't know what that is
this has to be the constant buffer
address because these things are the
constant buffers
so i don't understand how hex 80 becomes
28. sorry
x 80 times 8.
yes it's off by 96.
but it can't totally be off by 96
because this size matches this size
maybe they just didn't include the
buffer maybe it's actually not one of
these
board number three of the structure
oh
okay let's let's go look in that
directory
so any chance we don't have the q
command
it's not actually any of these
this just might not be these
i think these aren't the right q
commands
does the only places i have q metadata
oh it's too bad
i don't get it
it just doesn't look like this
oh look at this
oh this is a different qmd
oh look at this
okay there are other versions of the qmd
aha
and this one's correct
okay somehow novu has the correct one
it's a
cl30 qmd
but actually this isn't really the one
we want we want clc0qmd
we have it here
it's just not in okay here it is
it's this
again open gpu doc we love these people
all right we were just looking at the
wrong thing
i don't know why that one's not just
included in the uh
be nice for them to just include in the
driver
okay
uh so which one of these three is it
maybe it's all of them
what if it's the wrong qmd version i
found the right qmd version we're good
we're good
don't try too hard to make things align
think that you just might have the wrong
hmm idea think we should add it to the
uh do you wanna submit a pull request
maybe we can submit a pull request
i think a video will add it like if
there's any reason it's not here
i don't really understand
okay
now
we can look at this and be like oh
everything makes sense
um
go back to printing
this
times
h
now we see that at one
that was fast
now let's use it at one on two four oh
okay look program address lower all
right we found it i know the cookie is
here too oh nice thank you
we got we found the we were using the
wrong queue metadata
yeah
yeah yeah this open gpu dock stuff is
great
yo who else loves nvidia by the way how
long have they had this up for
for years
what else is in here by the way
interrupt map
manuals
memory tweak table
oh falcon security
i learned about falcons by the way
they have
oh
not secure heavy secure light secure
uh
i love manuals meat okay cool
but we found the right qmd data now and
that's pretty good
so this is the program address here
these are constant buffers
i just keep thinking of the strong line
it's like your bruise buffer you talk
before other people fight
probably said that before on stream too
this is what i think of when i think of
buffer
all right what was the best uh
free stream we found
twitch royalty free stream
oh you have to buy a personal license i
see oh soundtrack.twitch.tv no no but
i'm not like muxing shit i gotta log in
nevermind this is so hard where's our
chip tune at
now it's not chiptune time it's only
chiptune time if we actually want to
write a big parser for all this stuff
which like might be worth it you guys
want to write a parser
something that can like parse these mws
and like get the stuff
all right we're not doing any outer put
oh qmd group id ids right here
and
thank you for gifting subs
if good music all right all right i'll
go in the browser that i'm logged in to
twitch with let's see
i will set up multi-track audio
i hate this
man
can we just end the tyranny of
intellectual property
let's just get rid of it
the world would be better
uh you asked who mapped this
then i can hear taylor swift yeah
there's only one solution that's right
everyone knows what the solution is
we're just waiting for someone to do it
don't fall for their tricks man keep
your eye on the prize
program prefetch upper shifted
constant buffer all right these are
constant buffers
seems like there's eight of them
one two three four five six seven eight
okay
the solutions to using right gnu
software yeah that's exactly that in
mind
two okay
shader local memory high size so that's
the shader local memory this is the
program address
these are constants
should we write a parser
it just looks so painful like there's so
much stuff here
program prefetch address lower shifted
how much is it shifted by
circular queue
free music for games
oh
[Music]
brutal
i'd rather the juxtaposed here a protein
mixes
mises
what
oh my goodness not mises yeah well
whatever not to be confused with the
beast
there's some bottom tier music lmfao
okay
i don't want to write a parser for this
but i'm going to have to
yeah we're gonna go like
set up some confusing thing with vods
and
and then like taylor swift's gonna get
some of my advertising dollars
so i don't think this is any sort of
special structure i think that's just
whatever the ptx thing happens to be
um
this oh wait wait that's d2 fb is that
mapped
d2 f b
it's also not
i don't know d2
f
b is also not mapped
or maybe we should solve that mystery
that sounds like a good mystery to solve
whenever these dashes
they are like guard pages of a sort but
it's not for break like the heaps way
down here
oh by the way
we should support this tilt
whoa it has a ton of command cues
get rid of that sp garbage
mem copy uses many command keys
actually it may not
matter let's just try that
did that go all the way through yeah it
did look d4 is right here
so for some reason it set all those up
but
i don't know why i needed to probably
didn't
[Music]
now let's look here i saw you gifted a
sub so
cool this is the best one of these i've
seen
how far was i off by do i have to wait
for the 40 90 to get a human brain
um
let me add these methods to my method
parser
are they not in here
they're not is method 300 in here
it's not
okay
these methods somewhere else
huh
these methods aren't in here it doesn't
seem like
no 240.
other methods in the other one
mesa
okay
unk 400 great
it's not obfuscated i mean it's it's
like kind of right
uh okay two four is 240 in here
no 240 is not in here
it just might not be there's also ampere
compute b
is it an ampere compute b
what's the difference between a and b
got to set the falcon
308 is there but this one's not let's
get let's just clone this and see if
it's in here
no luck there
no it's not that 240. it's definitely
not that 240.
these methods by the way it's
interesting to note they have a
different subsea
so this is the these are the dma methods
that's how it does the mem copy
oh here classes dma copy oh here we go
check that
um
which one is it
amp here dma copy b
this one dma copy a you guys know i like
a better than b right
all right cool we found it
oh and it's in here too we just need to
what
wait is this different no it can't be
different
oh here it is
okay this is fine
um it's in uvm it's also here all right
great we just need to include the right
clacka
it's also cl
6cb5
we want the dma ones
make sense dma copy
who said this was obviously
we should probably focus on making this
stuff more usable
before we try to
blindly parse everything
right
so like enqueuing our own cuda is a is a
lofty goal
but if you actually want to make
something useful
um
it's just something we can ld preload
that instantly ah
i should use kate ai dot io for parsing
why do i feel like i'm gonna get tub
girls one of these times
that looks harder to use than like
everything
no offense to cat boxing thingy
um
like it just looks like i gotta type it
out in some new incompatible format with
something
all right we're looking at this one
the reason it didn't show up was because
yeah
offset in upper
that's hex 400 what's hex 418
line length in
almost 300
launch dma okay we have another launch
dma but it's a different kind of launch
dna it's a b5
and not a c0
i got to get a 240 set semaphore oh it's
just a different kind of set semiforce
okay
this is not too bad
great
boom
you see it read it it's easy
uh so wait this is just the same crap
we launched dma
i've sent an opera why is that so long
line length in launch dma oh
it's like the same as this right well
that's offset out upper
offset in upper and we put in two things
oh i see what's going on
check it boys
i think this method a lot more like a uh
like uh
so this is offset and upper this is
offset and lower this is offset out
upper this is offset out lower
and then this is the length and then we
launched the dma and we set the
semaphore oh it's so good
now we know how to do my stuff
hmm
all right should we try to launch a cuda
kernel from scratch
it's going to take us the rest of the
day but would you guys appreciate that
if we actually went through and wrote
like a gpu driver
is this something you would appreciate
is that something you might like i'm
thinking of bob from entourage is that
something you might like
exit mem copy from here
to here
which is not exactly that
you'd appreciate gpu firmware oh it
sounds like chip tunes
all right we'll put the chip goons back
on
alright stop eating this i'm not hungry
it was delicious but it's very big
and when you're not hungry you should
stop eating
weight watchers
i'm learning that from weight watchers
the clean plate club
is fake
pink real talk real talk this is a good
tip if you take one tip away from the
stream remember this when you go to a
restaurant you don't need to finish your
food you think oh i paid for my food no
you paid for insurance
the other food on the plate is just
insurance
like it was insurance in case you wanted
more food but if you don't don't finish
it
okay i mean if we're gonna write a
driver then we're gonna need something a
lot more powerful than vim
we're going to need
vs code
let's connect to queue
um and then let's open
twitch
cuda i o control sniffer
is that the ice cream truck
[Music]
their numbers are much higher can you
redo with their numbers and tell me what
gpu i need to buy to be a human
maybe i'll add an update to the blog
post
all right i think the first thing we're
going to have to do is sniff a map
and let's comment out that big proc map
stump
uh
this does a lot of stuff
are we ready to write a driver that does
all this
we should parse a few of these too i did
see them now in the thing here we can
figure out what it is
oh nice and sniff
and that is
rm control
[Music]
this one
probably gonna have to include that
what is that it's
source common sdk nvidia ink
control control
control
gpo
now when i make that command
it prints the name of it hopefully
here we go
see this one
get num sub devices
probably the same one
how about this
or this one
oh it's a different one i need a host
post get config caps
looks like this one
it's a big number
no control 28 gpu oh that's 20 80 okay
oh i get it it's like
it's not to be confused with the 2080
it's just due to the name
and if we're going to write our own
driver we have to figure out how many of
these we actually need
get gid info
40 times higher all right so you're
telling me i need 40 39 90s
that seems reasonable
look at some of these rm controls
gpu get name string
this one
rc get watchdog info what we got a
watchdog
that one's not included
control gpu get virtualization mode
these nines just not included if it has
the nine there it seems like it's not
included
or the a
this one's probably included though
control command
fb
i have to include control 2080 rc
then i think fb
okay now we have a few more
controls
those ones aren't included for some
reason can someone find where the nines
and a's are and why i don't see them
[Music]
oh this one i really don't know about
control command get fifo list
i probably have to include fifo for that
one
yes i do
i understand your naming structure
nvidia
okay what are these things
oh they're included
get work submit token
but i have to include something crazy
for this
control
three
[Music]
c36f
i imagine this one's included too
yeah we can get the class engine id
okay so this must be some
fifo shit
look at this
how about d01 it's gonna be hard to
search for i think
is it a command
here we go
control command get address space type
i have to include client do i not yeah
control 000 client
let's just grab all these
okay we're making some progress
let's see if this isn't some crazy oh
yes control a
ao
oh of course there's the a03c i mean
like this is how they think of nvidia so
you can like kind of get an insight into
their mind you know
anthony levandowski told me this he's
like when you look at a uh when you look
at a company's code base you can
understand what the company's structure
is
it's like that's actually really smart
so like nvidia thinks like this
um you know you can look at a lot of
qualcomm's acronyms you know qualcomm
loves acronyms
so there's a few more i don't have
another a03c one
control command get time slice
oh this is a new type
oh this is a debug
i misspelt debug
wait what
no it's actually right
now i misspelt debug because it's
d debug
this one i'm sure i have and that one
i'm sure i have so let's just parse
these ones out
i should be thinking about each one of
these and like think about what it does
get context software preemption mode
my theory kind of is that like a lot of
this stuff is cropped like the nines are
not included are the nines like the
secret one
don't tell them about the nines
so the ones that have nines and a's i
can't find those
okay anyone find the nines and a's
anywhere
i'll be excited with you if you do
i'll be happy
that's right
that was not even a nine or an a how
come it's not there
trouble come in release watchdog
requests
soft disable watchdog a lot of watchdog
stuff
it's this
we've got to check the envy link status
of course
what's the gsp we know what the gsp is
that was that bin we were looking at
companies code reflects their structure
over time it's true
okay use of undeclared identifier
control command gsp get features
oh it's because i need to control gsp
um i'm just going to go out and guess
that i need the envy link
probably guessed wrong
nope i guess right
all right let's just clean this up and
get the last few of these i'll look at
all these ones
there's so many of these
i don't have that one this one
control command gpu query ecc status
this one
command fifo get caps
oh my god is these ones too
control command gpu get engines
these are control command gpu
there's just so many
we're making a lot of calls to this one
it's got to be important
gr this controls a mask of enabled tpcs
for a specific gpc
these are the gr's these are the rcs
seems right
this one here
gr get caps v2
no that
that's not right it's the that's the
first four digits the thing is the first
four digits
who can find the missing ones
control command mc get arch info did i
include the mc no i didn't include the
mc as well
like this has to mean something what is
the
maybe these are just like kind of what
evolved over time
control command get bus info
do i have to include the boss i have to
include the boss of course
put it right by the fb
all right we still don't have these ones
parsed
control command perf boost
does everyone know about perf boost if
you don't have purpose maybe
what if they said perf booster off
and what if the whole trick to the 30 90
is they just the a100 is they just said
perf boost on
okay this one for some reason only shows
up here
i don't even know about that
that one doesn't show up at all how
about this one
control command gpu get short name
strength
put it right next to get name string
i don't feel at home there
control command perf boost because why i
didn't include perf
of course
i'm sorry about iso c plus plus 11. i
didn't mean to do it
okay
uh
you can kind of see it's doing all this
stuff
got a few more to fill in
command ce get caps
[Music]
come in get global sm order
command
[Music]
the
these are just like old ones
i think like these are ones that have
been around for a long time and then
they added these and then they added
these other ones
it's just my guess
we don't have that one
we don't have that one
find these as well these are going to be
harder to find
mv000 control command
these ones have been around since
forever
sharing is important or something
right in this file maybe
no
control command system get fabric status
wow this is a lot of eye octals
control command
no we don't have that one yet
control command gpu attach ids
almost done
[Music]
so
so
[Music]
[Music]
now check for the simulation
my
so
[Music]
probably do this like in a much smaller
way i just have python find all these
things
you know this is just like
i include the bus
i did
[Music]
like we're kind of learning something
doing this
i like these ones to be real
okay those ones we don't have
last check for these ones
this one we only have here
[Music]
acquire compute mode reservation
this one we don't have
this one we don't have
coba cobra thank you for gifting subs
um
i mean each one of these has their own
params okay we're getting the build
version
we're setting the share policy
we're getting the fabric gotta check the
tpc mask
we're gonna make a couple fifos
how come these ones aren't here
like let's look for this one
so we use this somewhere i'm sure
yeah this has got to be handled by the
current level like there's no getting
out of this so it's got to just be doing
it it's going to be parsing in some
other way
so it's gpu if it's there no there's a
gr there so maybe that's gr
what's 90 and what's a
maybe we should go look at some of those
things we've been including
source common
sdk nvidia ink control
control 2080
it's not the right a let's just search
for like that
anything
here we go
control perfect
it's this
and that's that if we can find one is
our hex 84 in here
there's not
oh here we go okay it's this
fin nv 20 sub device
define p state notify id
let's see if we can find it like that
here
nope
nope
not that
and it's not that all right i don't know
i don't know what those ones are
i know it's an envy
which of these look important any of
them
let's commit because we haven't come in
a while
parson
yeah they're like two values added
that's the problem
there could be files missing that's one
option
oh
what's the right way to do this
oh i know the problem hang on let me
just fix that bug
i need to say constant char
is that gonna compile
yeah i'm doing the other place i do that
same shit though
do that here as well
we don't
we don't like when nick complains
uh
forgiven lx expects long on side end
where's that
oh but it just says end talking
uh
oh i did understand that was the length
right
i assume that's the length i don't know
why i didn't see that before but assume
this 356 is the length
all right so we can check that let's
check that
so if the length is 36
uh
actually we can just do this
so i mean it might be as simple as just
that plus 356
equals
almost that
so 356 is almost the length i think
there's some other bits in there
ah
let's
let's modify dump command buffer instead
of being a pointer
let's just change this to
start
our units pointer
equals start
uh
one two three four five six seven eight
start shift shift 40
uh and
not three
let's modify both my dump command
buffers to be like that
okay uh size is 3c oh that's just one
command buffer then size is 354 okay
that's right
so we'll just say
while uh
s
pointers
try that the other way it's neater
see now when we dump that it's only that
so we're going to really want to go down
all the command cues
here
so there's one at eight there's one at
10 there's one at
18 and there's one at 20.
okay so now those are each a separate
command cue they have a size
everything's good
this is this command q we're getting all
the way to report semaphore everything's
correct again
uh we can take that break out because i
don't even know if that's real i don't
think it is
now we know how the gpu knows how long
it is alright great now we fully
understand
uh what's getting written there
this we don't understand but who cares
um is there a bit shift to find
yeah probably
well that's kind of nice we can at least
that's pretty nice right look what we
can do with
that okay so we have class category and
index
yeah i mean we kind of knew this already
uh
wait
but if those are zeros
no it's not right because there
shouldn't be zeros
see the reserved ones the reserved ones
are actually being set there right
because a is a is setting the reserved
bit
oh you see you see what i mean about the
ice heading reserve but
so that must be something new thing but
you're close
you're close
i don't know i'm over caring about that
offset out upper
line length in
let's see
this is offset and upper but it also
ends up writing an offset out
so that's offset out right but this here
is an offset out so it ends up writing
it to there
wait what's happening here
did anyone talk about this like what's
happening
why is it doing it in chunks
why are there four
oh i think i know what's happening who
understands why this four
it's just a theory but
no that doesn't make sense never mind
i take my theory back
my theory is of this four so it does
them in parallel right so because
there's no reason you're doing a ram
copy you can do it in parallel but like
why do they have the same
target out
it's kind of a question
more i've sent out our offset out lower
right
why do they have the same ouch
let's also figure out how big these
things are actually supposed to be we
haven't actually read saxby i don't
understand what it does
uh
so where's that n here's n it's once my
one shift is shift 20.
uh
so remember that it's a float and floats
are the size of float which is four
so that's explains this
i just don't understand this
this is the same as this
which is what doesn't make sense
and that's just the semi4 we don't
actually need that but that just tells
us when it tells you when you're done
two four six
i think that's an address
that's an address
put this back in
dump maps
like where i read from rather than where
red two what do you mean by that
it's not that look because this goes up
like by one and this is actually the
real gpu pointer
it must be doing something
else because this is also not the actual
address right it's not like this is the
address here
yeah okay so this is the other thing
that's mapped at 46. did i write stuff
about it
yeah you can and protect it read
i think if you're unprotected read it's
actually okay
which makes sense because it's semiforce
but if i unmap it it's not
so that's just the address of the
semaphore
that makes sense
uh oh that's probably what it's being
set to
right
uh it sets when it makes it to that
you guys know what semaphore is right
semaphore
it counts up
counting some force
i think the q is all in order too
the only thing that's confusing then
is how come
these have the same address
this is clearly different
it must be like unmapping that before it
does it
like it must be changing what's here
right
no it can't be because i would have to
go to the kernel and we're not going to
kernel
this mystery doesn't make sense why are
those the same address
everything else here makes perfect sense
it's a 74 address
which is red
maybe it's their fifo
it could be
i guess they want to understand is like
how do the bites actually end up at my
thing
so if you look here at exit mem copy
it's going to y there's y there
i mean okay we can look into
there's like a lower level thing
that
puts it in the unified memory
it could be being used at different
times
i certainly grant that that's a
possibility
but
oh
you think it's doing like a mem copy
okay i mean here's something it could be
doing right
kick off these two wait for them to
finish then do a mem copy to put it back
does kuda mem copy not dma it
yeah
i i mean that's possible right
wow that would be if if cuda mem copy
didn't actually dma it
oh it's because it's not pinned memory
oh okay so it's just doing a map copy
all right it's just it's just copying it
out user space so it copies the stuff
copy's not user space done
yeah these are just these are just
buffers uh
we should actually have these ones
mapped though so if we look at 76b
c27
6bc27
yeah it's mapped
and it's mapped to nothing
all right so it's just some it's just
some random region
uh
we can look at when it was unmapped if
we want to start intercepting our map
calls
let's intercept that map calls
go to dump maps let's go into sniff here
void
star
so we're writing this is just going to
hook so every time the program calls
mapmap
um
whoops
the offset
ah
um
it's an r value of type void oh
let's start there
okay my map hook didn't work
oh that worked here
i do think there's more in this than
that though
oh yeah that's only going to catch an m
map i think if the user space program
did it
yeah okay there's a lot more maps than
that but it's because the
no
there's a way to what is it like dial d
flatten
is that some mad crap
just doing a mem copy what was the spin
lock thing well there's these semaphores
so maybe it is waiting on the semaphore
and one of the other threads
yeah but those are just normal copies
[Music]
that's what launches the kernel
if we want to write our own thing to do
it we can
it's just going to take a long time
qmd data
because this is not the right qmd data
where is the right qmd data oh did i
even copy that
i don't think i did
what i did it sits here
there's version three yeah i know
wow okay we gotta define is this mw
actually defined anywhere
multi-word i'm like i'm not sure it is
oh see envy misc
dot h
for how to actually parse these things
d little bit up to the map
okay
uh kernel open common envy mask
oh miserable compliance required oh
for great stream data
let's include
envy misc one
how do i use this thing
multi-word
for classic
and word i get that it means that okay
where does it define
mw
it doesn't
i used to turn it into
oh do i like define it
do you have val and w
oh no
how do i use these things
vd
example of how to manipulate these
things i don't really
get it
i gotta like pass that in somehow
v
okay well that's what v is
what are d r and f
envy underscore
picks low or high bits oh i see what
that does okay
pick mw that's drf
drf
spans drf word mw hi
is there something that expands dr and f
trf expand drf
i'll get it like i want to say something
like
let's like get the program address out
okay so program address lower
we're dumping
buffer in qmli so
pass in drf valve
that's not right
drf read one byte bs
do not read beyond the bytes contain the
requested value
[Music]
i don't understand like how do i
what is drf
it's not really a goal
we're just here to understand
[Music]
search for glossary
device register fields okay
oh
oh i understand
okay
i get it
nv okay this is the device
i say
thank you
okay
ah this actually goes here
nvidia ink
trfval mw
so for this one we say drf balm w
the device
is this
to register
i don't know is this
in the field is this
we want to get the
program address lower
and then here we put in pointer
and here we could say like uh
[Music]
p at a lower
[Music]
here we can
[Music]
you know what
no okay
okay
program address oh no quotes
um
cautious initialization
okay program address equals that seems
right
oh i shouldn't be before that we should
actually move this up here
method name
okay fine
all right so that's the program address
great it worked
can we get rid of that we actually need
can i just put commas
i don't really care
drf
that work
great
okay good so that's the program address
ah
that's the program address
now
we can also
get
buffer address
lower upper
uh let's let's just write this as
like this
i'm going to say uh
this shift shift left 32 i don't think
it's actually going to work because i
have to cast it
yeah i gotta cast it very cool
caston
now if we want constant buffer
to get rid of the mv
it's all
right there
he's a subscriber we can somewhat
forgive him
uh after work tech congratulations uh
you are a mod
but we can use our moderation uh
with discretion
uh you know
and
a time well
yeah i think i think a timeout would be
okay
i think i think uh
he should understand what he did wrong
um
he asked stupid questions
i want you to wait wait we're gonna
we're gonna we're gonna go we're gonna
go t carries you let's go
t carries you
y
thank you for the hype train and why
are you asking that question
why
what do you think you're gonna get
if you can come up with a good answer to
that i'll answer it
but if you can't you get banned does
that sound fair
expected a colon
well you expected too much i don't have
any colons
one sec i'll be right back
okay we're back
whoa
whoa it was still smarter than you as an
individual well this guy wasn't gonna
get anything but now
he's gonna get a timeout
size 188 why does it mean that it
shifted
that's 188 so that's 160.
it doesn't look shifted
shifted four
why does it say it shifted four
uh we also know that there's eight of
those we can put that in a loop
food all right cool
[Music]
so those are the buffers
that's the program address
i think that gets us all the pointers
there's any more pointers what's a 256
program pre-fetch address lower shifted
why is it shifted
what kind of shifted is that
it's interesting that oh here look
this is the same as this
program address
why do they have it in two places
program prefetch address lower shifted
this is shifted by
shifted by a bite
what does the size mean when it says the
size is shifted
188 sure seems real to me but okay that
shifted over by a byte so you can see
that
i bet that's only what's
288 minus 2v6
32. not useful
oh
but cf is where it starts
okay where's the 7f
there is no 7f
oh unless there's a not lower version of
that
is there a program prefetch address
upper somewhere oh great it's over there
why do they have this
oh it's in oh we can finally figure out
which one we're using because it's in a
different place
if it's at 1632
which it might be
[Music]
or it could be at
one thousand
it doesn't look like it's there
it does look like it's at 16 32 16 40.
16 32 16 40 is only one uh
one byte so it's just this
okay
i don't know why they packed it like
this but it is the qmd3
confirmed qmd 3.
this is the full program address which
we have to get for a different reason
what's at 128
the qmd group id unrelated
this one a pointer
release address lower
oh okay so that's a point or two but
that's a pointer to
more local stuff
release address
and what that means
oh linux box welcome back
7x half
7x
7fx on the line above
yes there is a 7f there okay
good i think we basically got all the
pointers like these are the things that
matter
the program address and the constant
buffer is
we can we can build that and shove that
in there if we really want to
um we have the report semaphore
i don't understand what the second
copies for
i understand why we're loading that data
i understand why we're loading that data
i don't understand why we're loading
this data
1860. does anyone see any 1860s
it's not a constant buffer
let's hack us at
hmm
all the space force did it
oh good to know the space force
spending my tax dollars
they have a competition out called
hackasap
no
yeah but alex we got to stay focused
focuses for winners it's true
all right
[Music]
hmm
you're terrified to ask any questions
well don't ask stupid questions
is it is it smoking weed time
you smoking a joint are you smoking uh
oh the joints they're like over there i
saw them where are they
i saw them
uh
no it does sound kind of nice if we're
gonna write this gpu driver we'll smoke
a little weed first
no we got joints bro bro i've got a vape
pen
we got joints
all right we'll smoke a little weed and
then write the gpu driver
[Music]
uh yeah i've seen them around i don't
know where they went
you told yourself you wouldn't get
stoned if george was streaming well
maybe it's there's a little bit of a
sign of smoke a little bit remember the
time we smoked weed and did the for loop
challenge
that was a pretty good
day oh my god like
we want the high we can't do indica
right now
look at all these things that it creates
do we need any of this what if i just do
this
be fair and videos high as well
they name all these things control
wow
i don't know like we're just gonna have
to write this you know
okay let's go
let's call it
gpudriver.cc
and put to do
right gpu driver what do you think
all right we're going to keep all the
initialization code
we're going to keep all the
initialization code from cuda
um
coordinate cool device get
cool contacts
uh
i don't even know about that one
i don't even know about the function
we'll deal with that later
our gpu driver doesn't
all right right
user space gpu driver
support a net use cuda
[Music]
yeah i'll be back boys
can't show wheat on the stream we'll get
bam for twitch
you go to toilet and a shower when you
have a shower
i got focused up
because we got to do write a gpu driver
we absolutely do not smoke joints in the
house
oh consuming marijuana on twitch is
legal that's great
well you guys know i live in california
and wheat is legal here uh it's one of
the reasons i live here
no no they love smoking weed
okay let's compile our gpu driver with
clang
and then let's call gpu driver
we're gonna keep compiling sniff
we don't actually need that that's just
extra crap
okay
fatal error cuda not found well we need
cuda
now we need to link to cuda
i think it's cuda rt maybe that doesn't
work
okay now that works
okay um so we're maleking a lot of stuff
let's make a file called helpers.cc
and let's take some of the stuff out of
saxby
like
i just put it here
jump proc self maps
oh my gosh
wow it's so much more productive than
vim
oh
great
okay cool
uh so you can see that we're mapping it
in video control in the exact same place
by the way pro tip for exploit for
exploit pros nvidia always maps at the
same address
ah
i think that's what i say about adderall
i don't think that's true about
the queen makes you think you're better
okay we created the cool to contacts
that's great
now
we need to oh kuda malik
oh that's not even using that
we should probably first use the other
api at least
so we're using the low level api we're
not doing anything
um
okay fine let's switch stacks by the
other one
[Music]
i want to move
this dumper to helpers
okay
first instead of using cuda malek so
there's two levels to the cuda api
i'll get rid of this memory stuff
underneath that
watch it i'm kind of curious let's go to
print memory
you can see which thing it uses
oh control command fb get info that's
cool
actually
i just absolutely don't need that at all
let's also uh
io control sniffer equals true
if not i o control sniffer
oh no it's actually not going to work
i'm going to be able to turn that off
some ld preloading it how do i do that
well like started after a certain point
but there's not an easy way to do that
because it's not like i can do an extern
right because an extern is still trying
to link
and it's not going to link
nope nvidia does not use aslr confirmed
okay
here's entry malik
here's entry malloc too
let's replace those mallocs
with uh
this whole section is boring
replace it with cool milk
[Music]
cool malik
allocates device memory
so we can't do this anymore
we have to say
instead of that
change this to do
device
pointer dxdy
we'll say
is this the same actually
why do i care about this
pro tip i don't
i'm not wasting time
it's crazy that it returns a pointer
though but you can't access it it's a
gpu pointer
it's kind of like why would you overload
it like that i like coup device pointer
better
it's a macro in the include
oh we'll just put them in the uh put
them in the header see i can put on
headers that's a good point
do headers for it i don't know why i
think to do that you're right
cool
[Music]
beats
creative commons
okay i don't know how i feel about this
pitch bend
[Music]
[Music]
well that's got to be doing a lot of all
right start with m copy
that's something we can do
forgot about these copies
wow
this isn't a completely different place
on the uh
how does it know it's there
is it always there
so
why is the size zero doesn't make any
sense
oh
that's not right
i should just do that
okay great
i'm gonna drive some nice macros for
this thing and then we can do them
copies
[Music]
oh we still don't have an understanding
of
[Music]
how does it know what's this address
what is all this other stuff here
is the gpu doing stuff
wouldn't alex does it like zero it out
[Music]
or should just gpu control at the
beginning
are you
what were these command buffers
whoa look at these methods we've never
even seen these methods
[Music]
let's grab them
i wonder where they are
[Music]
does this one have that method
100 it's 100.
no off set object all right let's just
start adding a few of those
i'm gonna move this into helpers
i'm gonna need
a piece here
do
okay
do these make sense
i don't think it's these
sub c is only uh
i don't think those are right
i think it's something else
i think we have to know like what type
of command q it is or something
so my idea is that it's not actually
this is ampere compute a
what are all these other ones it's not
like ampere user mode
nothing
or maybe it is
i guess i see no reason why i wouldn't
do this
set shader shared memory window
why is it because that what happened to
window a
don't you care oh did window a first
okay maybe these are right there
yeah i could do that
it's probably a good idea
[Music]
yes
even crazier if there was some way i
could automatically
cool
text header pool a b and c
[Music]
ah
and
here we have text sampler pool a b and c
as well
okay
some method 200 left what's a 200
set valid span overflow area great
this is just a random command buffer i
found in the memory
and 310
that's at the spa version
gpus are so complicated
that doesn't
it's not scoped to uh
subject go up
that was just one shader let's look at
the next shader
[Music]
what
load inline data
okay
it's a fancy way to zero stuff out
that looks very slow
it doesn't consider scope i have a point
man i hate c
some more
[Music]
like this just seems like a really
inefficient use of the driver
like they can't
dma from somewhere this is faster
okay let's try our first thing
in the gpu buffer
how do i know
what address on that
i guess that was the question we were
trying to answer
we just come to here and say dump gpu
control where are we
take the mallets out
[Music]
but george you're going to write a
subtle bug where you forget to change
the
uh the thing in one and you don't forget
to change it in the other because you
just copy and pasted the compilation
line that was really bad of you and i'm
like yeah i know
i'm like i'm open minded it's fine i
don't do that shit but i don't really
mind it
no no no stop
it you guys didn't hear it but it was
stereo
this is upsetting though
it was fine until something happened
okay this is my driver now
and it's doing a lot of these kernels
how do i know
like how do i know what's next
how do i know where i should write to
just writing to anywhere work
no i don't believe that
if you look up
there's a command to get that
yeah
is there a ring head pointer yeah like
where is it
well it can't be
here because i zero it all out
there's some parts that are read only
we can dump proc self maps in the driver
is here
it seemed like the kind of place where
it was
i mean
we'll leave the max
copy we're getting it as well is that a
minute
[Music]
[Music]
rt not found
all right fine we'll do it the other way
let's fix sax pie
to use the other one
now i have a real reason
what i got rid of that
oh it's here now
all right good
max r zero
um can i just replace this with
kumamalik and it's fine
probably not
it's probably gonna be like you wouldn't
pass in the right type of pointer
now i can't use this anymore because i
gotta do the other kind
i know this isn't gonna work
failed
that work
there's no way this works
what is cuda malik doing
wait
that just worked okay never mind
it doesn't work if i do that right like
let's just sanity check that
something's broken here
maybe it doesn't matter
like sometimes they're like kind of like
things
so those aren't even like
i just casted them to a point okay
i guess obviously switching them doesn't
matter this might break it does that
break it please break it please break it
i couldn't run in yet all right cool
well that was easy
so you actually can cool my malik
and just cast this don't even waste your
time with this just cast it to coup
device
is undefined
i gotta spell it right and it's better
i can scan all of yam
of course they're interchangeable must
be an l value or function designator
oh what's wrong with that oh because
it's a pointer
is it just that
oh
sorry
great cool
um
so
all right how to find the head of the
ring buffer
[Music]
some talk of head pointers in the falcon
i don't know if it's in the falcon we
can look in the falcon later
okay
so kuma malik actually doesn't do any of
that
there's two quick calls to heat control
does the mallex
that's nice we have those are real
all right we gotta find something else
random chiptune mix27
can't be copyrighted
can't copyright 8-bit music that's
illegal
okay don't think don't listen to me for
legal advice don't listen to me for
legal advice
do
so
x might not be right
not work so much because all this works
so
so
[Music]
so
so
so
do
yeah i found out that i could like zero
out all the
the uh nvidia stuff and it's fine
i don't know i mean like i could just
i just
can't believe it's good i called it up
uh this doesn't matter
this i can actually put it any address
so that's fine
i don't know why it's at 26 so as long
as it's in
i can't put it anywhere
but we'll just put it at uh i know i can
zero
all this out without repercussion i'll
just put it there
okay
um let's take some inspiration from how
they could be storing their own head
position user space code which is very
possible
um
that would actually be my guess
i had this problem with uh
the qualcomm gpu
[Music]
always hex dot packs i'm definitely used
to in helpers
i wrote hex dump where'd it go
is it here
no hex dump
it's like fault
what
oh no because it's the other way
all right because we're copying from
that to that
that's the uh
let's just print out
alex
yeah so that's actually the device one
so the host one's here
but it must not be getting it it must
have to copy it into pinned memory
seg fault
oh what
what moves okay
this isn't pinned memory this is
i'm curious how it gets that memory
is that within that
it might be
where's that mountain
flags 22.
is there a pin
no
if you're asking for the goal you didn't
read the to-do it's right user space gpu
driver
i think that's what i want
it's interesting that this lies in the
uh
it's a big chunk of memory
let's just quickly confirm it's actually
in there
talking about this address here
is that less than dff zero no it's not
so it's not in there
you can't just dma from anywhere it has
to be special io memory
um
okay let's go take a look at the mesa
driver we just got to do this another
nice way to do this here
push space
begin nvc0
these look pretty nice i don't have a
better way to write it
we won't call it that we'll say it's uh
that
all right so i should just be able to do
something like
begin nvc0
and then
the
type wait actually that's
here
so there's n v c zeros there's n i c
zeros
it's all the same though
except for this
i don't know
it's worth copying from novo
let's just make a new file and call it
no
they should have spelt did something
people could spell
just copy this
um
where is that
um we're going to replace
struct novu push
let's do it by hand
i don't know let's just have it
something called a car
i don't know explicit space check i
guess
you have to do something like this right
oh we're gonna call it this
uh what do we want to push this
for
something like this here i'll cause
this crap
sorry to find that
just to
i'll have to include that
oh undefined if i push data space
between
chuck novo push buff can't be used as a
result type function
want that
is that what that thing did
i don't think so
and where did they get pushed from
look at it from there um
okay undeclared use of the search
uh i used to undeclared identifier push
space because we're gonna just define
this
oh imagine need that oh
can i combine with previous struct
identifier
no matching call to function push data
why is there no matching call
i'll get it
okay unsigned int
it's not an unsigned end i'll get it
uh what i do
that can't be a semicolon that's true
no matching call but three were provided
beginning vc0 has a
oh because i wrote this get rid of that
okay
requires four arguments one was provided
okay so that's
not right uh
we want to pass in push buffer
sub c
method size okay so the sub c is four
and that's good
okay cool
uh now we have to actually push
data
oh we can look at what this is doing
uh let's push data h mean
i think it does the same thing oh i see
that's cute
cute macro bro
um
so
let's uh let's try an experiment
we're going to dma it from
let's try dmang from the command buffer
itself
into this
that this dma works when we hex dump
this we should get something
okay so we're dmailing the command
buffer
into this
right that makes sense
if it doesn't make sense uh copy off
your neighbor
you know these nbc zeros we want
whoops don't change all occurrences
that's not what i meant to bill
uh
yes these all begin with two so they're
nvc zeros
all right this one
let's copy x000
let's launch
dma oh i'm sure that means something
uh-oh
i'll figure that out we'll go read that
uh set some of 4a
i don't really care but we'll just copy
that
two c's the valuable right i guess
uh
and then we have another launch dma
okay we have a second launch dma
for some reason
uh
we do helpers
the
this one can be like this
remember for start size
remember for start size
uh
oh yeah
size that
let's try that
[Music]
memphis
i would need l's we need l's
is that how it works let's see it's like
a python thing
oh implicit conversion from long to un32
that's okay
oh actually it's probably a push data l
macro that they're using
oh let's take a look
no they just use push data
it'd be nice if there was a push data l
you can write one
sounds that warning
i use an undeclared identifier
i declared the identifier i don't get it
don't command buffer start as z
oh
happy
great
okay good it's going to dma from there
to there and it's going to launch dma
and then i don't know why i didn't
launch dma again
oh because set summer 4 has size 3.
great
uh let's figure out what those params
are for launch dma
so this is
data transfer type non-pipelined
ah oh no really they did it like this i
hate this
why did they do it like this why don't
they just do it with real defines
see the problem that's just annoying
um
i don't know copy them and then we dump
that
oh that's going to be boring to print
let's put that change that up to that
all right cool
okay so those are supposed to be equal
but they're not
but they will be equal if we managed to
actually run this command buffer
so we know the magic address that we got
a poke
oh i documented it right here
so
uh
you went 64t pointer this equals that
parens
this
uh
xor with
i don't know what the size is
um
we can just do
u and 32 t s z equals
actually
i dump those somewhere do i not
let's just start with let's just start
with copying
expected expression of course you
expected an expression
all right
3eo2
should have the same
3eo2 oh this is missing a 0 is it not
yeah
all right so it's 2206.
put that there no don't put that there
but change this to
this
okay
uh sleep one
check if they're equal
nope didn't work
maybe we got something d message
we got useless crap indie message
buffer for global alex already unmapped
attempting to free null
wow this is a lot of stuff
all right we should probably turn all
that off
okay we tried to dma from there to there
but yet this is not equal to that
question
why
answer because device the device
so let's just try this
let's save data by packing parameters
oh they love allocating memory listen
the more memory you allocate the less
memory the user has and the more they
need to buy a new gpu
but if we could just
beat this conspiracy
huh
did that mem copy not work
what it just stuck that at a different
place
you can't just do that
you can't just stick it in a different
place that's cheating
okay we'll stick it at that place great
i don't care
do you look like i can't no i don't care
what
no no why is it why does it launch a
kernel
it's literally launching a kernel with
this program address when i do a copy
from device to device it's using cuda to
make a copy
that makes sense
so
[Music]
all right we're trying to trigger a dma
on the gpu
josh perry thank you for gifting subs i
appreciate you
i'm glad to have you with us on this
stream
length is 3c
restore that
offset in offset out line in
launch
dma we even set a useless sound for and
then we launched dma
okay for some reason it just overwrote
me like i didn't do anything
did not respect what i did
which is fair which is fair
demand respect
it did not
it's
different if i go from
dx to x does that matter
oh
what
i mean that's my copy
i guess this is a totally different
okay i don't know it might not matter
where you stick the command buffer
actually it might not even be a ring
buffer
probably some device to host
let me put it here
is heck stop jumping from gpu memory no
nothing coming from gpu memory
i set up the buffer
uh i know we can do let's try something
here
see if d message tells us anything
allocation complete handle dupe complete
no i don't think it's any of that
i don't think it's any of that
oh you know what might be the problem we
might have to flush the cash
this might just be the cache again
i'm sure kumem copy probably flushes the
cache
and i can do that entirely in user space
right
like there's a chance it's even working
okay new idea
this is too complicated we can do
something even simpler
let's just go back to launching when we
made the device device copy
so this is launching a cuda kernel
which is fine
because we are just going to use the
first part
oops
why does that fall
oh
you just do this
right mem setting it let's not mem set
it if we just comment that out let's
just try that
but then
uh
let's just try this
let's try like that as a command buffer
instead
and then we know where to stick it it's
here
uh oh yeah we
it didn't happen to work now that i
didn't set it right because it's gonna
okay it's not the cache it's not that
simple
um
let's try this one
okay
begin nvc 0
we're going to do
offset out upper
and we are writing to this address
do line length in
oh i think
why is after line length then
uh wrong driver here
where am i then
because we're also doing line count okay
cool so this sets line length then n
line
count um
and then x10 count one
uh
launch dma
which only has one parameter by the way
we've got to change all these subseas
and then we'll do load inline data
and we'll push data
all right cool
we don't understand before we don't care
it should just work right
uh 132 g size equals that
then we set
this which is that kind of command
buffer i don't know if it really matters
two
or with size
shift shift left
it's 40 right
yeah
i put that two there
i don't really know what it does but
it's in all the other ones
goes here
could like abstract that a little better
but we didn't so that's too bad
um
say dump command buffer sign pass size
in there
we started off
sleep one
and we see if it actually copied the
inline data let's say
don't be zeros don't be zeros don't be
zeros
old zeros
no
not upright it's only two
by the way let me just make a quick
change to driving an sh
i actually need the sniffer right now
let's generate a lot of crap
okay that's zeros
uh
let's kind of this stuff out
cool
there's only 202 that's not right
oh
okay now that was a bug but that's fixed
and it still doesn't work
you see we're doing
there's some chance it's because we're
not clearing the cache
there's some chance because you just
can't dma to that for some reason
uh there's some chance there's some
other magic thing you have to do to kick
off the buffer that i'm not doing
i will confirm that that's using the
same buffer right
for the program something much more
complex
that same a is there so the size is 348.
i really don't think the report 74
matters
what if there's a magic address you have
to poke
with
this
to kick off the command queue
that's that's all i think it could be
because like my command keys just don't
look like they're running
or
oh well this is also wrong
that should be four
but that wasn't the problem
so many bugs
all right let's read novu and see how it
actually kicks off the command q
great we build this data
we have the context
we push more data
what calls these things
buff ctx fence
push car
[Music]
i'm
cp launch
just do it
constant buffer
psi shifted four
i don't know no that doesn't seem right
yeah i know it sounds reasonable
ah
novo scratch done
no
update compute invocations counter
[Music]
data
is that defined
doesn't seem like it's defined anywhere
push kick
novo push buff kick
is another one of these not defined ones
i don't get it where is this defined
try something wrong with my search
it's got to be like
it's gotta be like some trick some
defined trick
let's look at the definition of a no
blue push buff is that not even defined
that has to be defined somewhere
i say we get this dma to work and then
we're done for the day
so can we get this dma to work
i don't understand like i poke that
setting that to the right thing
i see it on gpu control
we can confirm that it works at least
from that perspective by doing this
okay that looks good
the hex jump at the bottom get rid of
sleep
so it should be writing these words out
to these buffers
so
possible that this is just wrong
like it doesn't actually even go that
high
try something like that
well
we don't have to get any debugging if
that doesn't work
there might be only certain places you
can dma to
for some reason you just can't dna to
that
falcon q
and overall like this kind of stuff
probably isn't that useful it's made me
realize that there's way too much
complexity in a cuda driver but
what this stuff can be useful for is
debugging
uh it's a simple thing to just inject
that sniffer in
and then we could probably make the
sniffer detect and fire off on the
command cues
the
qualcomm gpu uses an i o control to
submit a command queue and then i just
do command q replay
but nvidia has some user space trick for
this
i just don't think we're doing the right
thing
well here's a here's a question
what if i do this
nothing
so maybe we can't dna to
that doesn't like that
doesn't like that cu mem copy
that one it's fine with
if i do that
no luck
it doesn't know
this might not be i owe my map to memory
then
uh is there a cool meme set
you
um
does that work
okay that works
so we did two coomem copies that go
through the gpu
you are no longer pleb you are
subscriber welcome
uh let's before we do this let's clear
gpu control
wow it needs two command buffers to copy
eight bytes
oh no that's not the command buffer
what is that
that's the command buffer
i don't know what that other thing was
hmm
like your gpu control
it's not like clear gpu control
okay well didn't like that
uh
offset in
so this is dx
and this is other stuff
so that's in
maybe that's actually out
that was overwritten
oh no in his dx and that's junk out okay
fine
um
um
i don't know why it calls launch dma
twice
what's method 5c
all right it has sub c
zero oh it's different
don't look in mesa look in the driver
i think it's that
it's probably not this though either
because it's a new kind of thing
sub c0 method 5c
welcome back marcel bischoff
congrats on your six months of
subscriptions
all right
let's see if we can
mess up where's my tiny as my tiny
example
dx
push buffer
use of undeclared identifying targets
that's fine
let me copy it back okay
oh we just need to have target stuff
below the exit i know it's unreachable
redefinition of
says huh
okay
i mean that's something i think if i
don't do that
yeah i get this if i don't do that
okay so doing this is doing something
nope that time it did nothing
never mind it does nothing allied
this is the command buffer address
that's still looking out of my friends
if i do that
it still is it just overwrites it
it writes and it works too
so it really doesn't matter
so
okay we're hitting this
with a line length we're launching dma
and we're doing that
well the pressure support was okay i
tried a little um
didn't seem that fast
and then i read online that the
tensorflow was faster
but it's a step in the right direction
it's nice to see these things being
upstream into real pie torch because it
forces them to refactor the apis to be
nice
i feel like my command buffers are just
being ignored
unless this stuff's not set by the gpu
good night
this doesn't work
this isn't how you do a command buffer
you
so
some constant buffer
okay this is setting all those qmd
things we're not even using qmd right
now
we're still just kind of trying to get
command cues to execute
fail to launch grid
oh scratch done
scratch wrap equals
buff ctx reset
there's got to be a way to tell the ring
buffer to run
okay well here's an interesting idea
um
let's just copy this exactly
still works
hmm
oh
34 well it's not right
we do have to xor with this
okay that's alright
shouldn't be 34.
that should not be 34 okay maybe you
need some more zeros
good night
how are we doing 184 not too bad
all right
can we get um
some some expert developers in here from
the novu project to tell me how i launch
a command queue
okay it goes on to copy it goes on to
use my address so
there has to be something i'm just not
poking
um
let's go back here
and
let's
unmap stuff
this shouldn't
matter right
because i'm using the higher address
undeclared
i wrote a thing to shadow your maps and
diff them
what
what
gonna use this
how do i copy them
why am i getting adot out
oh i see what you're doing all right
cool yeah great great great we'll throw
this in
uh
all right let's get rid of this
cool cool cool oh man i love when people
contribute i'm so happy i made you a vip
all right let's go um
so we want to figure out instead of one
mapping
let's do it here
uh
what do your example look like
auto maps
shadow get
uh it's like devon video control
about prop maps
this is video control and video
um
shadow
um
yeah what didn't get included
did i not
know c plus plus
there we go
okay
wait so hang on
tell me again what happened
so first it caches them
oh okay
that one changes that's fine
[Music]
cool
that means those regions changed okay
so i don't know why that region changed
oh no that's the region with the
semaphore
okay
so i guess i see why that region changed
because of the semi-floor
ah
i guess this is that this must be where
it's happening
must be here
let's modify shadow and actually print
out the diffs
um
map dot changed
this dot save
ah
[Music]
yeah
i'm going to try to write it nice but
then there it is
okay
[Music]
okay
this one
must be where it's happening
what is that
it's not a pointer
this is the uh
and that's the semaphore
just setting that to one
that must be some it's a one to two
right so you can see it sets the
semaphore there
that makes sense
uh this i don't know what it is
that's nice to get rid of the clear gpu
controls but
um
compare across another call
that's a good point yay okay cool
uh
so we'll do another call
i don't really care about these it seems
like these are the only ones that matter
uh
wait hang on
does he even make the second call
oh that's around copy 200.
[Music]
remember diff doesn't resave
yeah i know i didn't expect it to
just read it but i'll get it
how to do that
i didn't even change this
sure
you see this right like i did the second
one i didn't even change that just
change this thing
oh
oh wow
okay i mean this was irresponsible of us
okay i don't know i will do a regular
stack in my program or something
my theory is that it's the gpu changing
these ones
probably these ones too
what looks like an increment
this
oh it's got to be some kind of pointer
thing
you're right because look only these
ones changed
i don't even know how i'm going to find
that i got a par shit
two very nearby points yeah i mean these
pointers are nearby
right
yeah that's that's a pointer
uh you know what let's just uh
just for readability
changed differently that time
i'm going to save
oh
why is it changing all this stuff
why is this one still a death
i also put like a 16 bite region around
the change but yeah i could
why is this still a diff it should be
not that right because i i captured it
twice
nvidia might have some gpu registers
that can change on their own yeah i mean
that's kind of what i think this is
because this is completely inconsistent
with anything
i guess what i don't understand is okay
this is my right of the command buffer
but this is also my right of the command
buffer
the only thing you have different is
that
we used to be looking at the set before
oh
no
that's not video zero
sure what i mean we see why i believe it
has to be in video zero right
is the commandment from video zero
memory on the gpu yes
this this maps bar so this is just
directly what's uh
what's uh
pcie
second shadow might not have seen the
bites you send in yet
i don't know about that
what are you doing i was looking at
recipes
for dinner
what
that's more than gasoline
tomorrow
oh is it a global namespace
huh
i don't understand like i'm setting
everything that thing is
see if any of this stuff changes when i
do it
okay all that same dev nvidia zerocraft
changes
actually it might just change every time
you read it
yeah
okay
so that stuff's all red herring
i don't know if it's that
oh yeah
i'll make sure we're doing the same
thing
you know what we're doing the same thing
except it doesn't work
why doesn't dumb command buffer work
why doesn't dump command buffer work
hmm
did i break something
yeah reading that memory may have side
effects yeah
oh
i'm clearing gpu control there i'll do
that
okay now that works again
but also look we're still getting this
output
so it shouldn't be
i don't care
thank you
choices are stressful that's why i feel
so good
sitting upside down
jump out okay
yes
that's the old command buffer
dump that one too
oh
look at this
it's actually using load inline data
wait so this should totally work then
like at first i even had questions about
whether that was working but this is
almost identical to that
one more what
okay maybe set report semaphore matters
i don't think i've ever done that
i guess i just assumed you didn't need
to but maybe you do
don't know why i assumed that
okay now that almost copies that exactly
it's crazy though that that coomem copy
will automatically turn it into a load
inline data if you think is short
launch
dma inline data
reports oh oh
okay
let's replace this
with this
this is what we're trying to do
this
um
i'm doing like literally the same thing
it's like fall
football
maybe that's not right
i do the same thing and it doesn't work
you saw me do the same thing right
that replaces my command buffer with
their command buffer
and then i get these aavbs here
why is this one only 3c
and this one 40.
oh no this one's 3c that one's 40. never
mind
okay let's make sure they're actually
the same
oh yes that's different
that's fine
that's the same that's the same
that's different
that's different
what am i missing
i mean
you know what that maps thing isn't
going to show
it's not going to show if uh
it writes something
that ends up not being uh
used
okay
i'm sorry i if something can only be red
right there might be something that it
ends up poking that it can only that's
only for uh
reading
sorry that's only for uh
let's unmap this and see if it matters
that's not going to work
is that as aslr
linux disable aslr
oh guys i'm going to get hacked i
disabled aslr
did that work
great no more slr
oh slr was such a pain
but now it's gone
it could even read an address you're
right
man if that's what it does alright let's
unmap this one
monmap
that
i can actually see it's
no matching call
seg fall
okay
now on the set assembly
gp stat assembly
layout asm
it's a bar address so it's just the
address is in the pcie
okay
so it's reading that
type shouldn't matter
can i turn off pipes like i just turned
off aslr
zero
could that be the read that triggers it
more nmi for that 90.
oh
oh
i wasn't reading that
it probably is that page though
ah
look it hangs down
that doesn't actually mean it didn't
happen though
that just means it hangs
which is kind of useless
so i unmapped this page and i map my own
page in
does that work
hmm
that one sets a tiny semifire
what's hanging here i know i could check
from gdb um
all right you want to see what it's
waiting on
so
that's not even they just have a stack
oh
oh you think okay yeah
so it's the other thread doing it
great
so we don't actually know
if it's happening or not
unless is there a flag to kuda mem copy
to make it async
here copy memory async
uh
just use default stream semantics yes it
does
okay so let's just do
[Music]
we don't even have to do the on that now
let's just do kuda mem copy async
throw zero in there and we'll throw a
sleep here
that's a stupid hex number
what
okay fine don't copy
what else did i break
changes
where am i there's the string
driver
okay it's back to working somehow
i don't exactly understand how
but we'll replace it with cudamount copy
icing and sleep one
okay so you're getting those a's b's d's
and c's
and that's doing it async so let's unmap
the page
and let's then the page comes back
hmm
no
yeah i could try to replace it well yeah
i mean what i have to do with erase
there must be something in that top bar
page
it must be something that like launches
a command
right we could read the linux kernel
or i don't know i don't know who does it
like this
let's dump the page
[Music]
i've done that six times now
i'm gonna fix hex thump oh but then the
other ones are gonna complain if i
change this to boy oh your voice should
be okay
yeah
i'd agree with you
so this is the one that fails
but when i unmap it that's what breaks
oh that's just
one day i'll remember what that thing is
that you type layout
registers okay
90 90.
so it's trying to move it into edx and
then jump here
could also map a zero page and dump it
while it's stalling okay
okay okay you want to try that let's try
that
um
that's a c plus plus right c plus plus
standard thread
example
i have to do it like that
how do i use lambda
c plus plus 11 lambda thread
i'm gonna use lambda
like this
[Music]
okay now we have a thread
which never finds anything
oh
you sleep
sleeps in something else isn't it
oh
okay
check it out
it is this one
it was d and now it's 2019.
are we basing it doesn't matter
oh why does it print anything so earlier
it actually looks more like that stuff i
don't know
that one did it
oh okay it's just writing a d there
nothing was there before and it writes a
d there okay let's try to do that
we can do that
[Music]
not that
we're close though
we wrote a d but my d didn't work
how do you work
hmm
asleep
still just stomps all over it
oh volatile okay good point
[Music]
oh
okay i wrote a d there and then it
waited for something
what
oh no
drop some food but most of it's still
good
i clean up this food i dropped
if we just want to sponsor the stream
now
that'd be open to us
i mean it's possible i need to do some
kind of flush
i don't know
and if that's the case i mean
okay
i've got to be some docks for this
[Music]
do
bar zero
you get v-rag offset
bar zero window offset
um
could you recommend any documents
bro
there's no document you can read it's
not how it works
like i don't mean that to be mean i mean
like
it's a misguided question and i'm sorry
that like school teaches you questions
like that
but the truth is
you just have to do it
i'm not reverse engineering
i'm trying to write a gpu driver
that interfaces with this beautiful open
source
code
i mean
what is reverse engineering right
state
oh copy by the way i think was the other
uh those other registers they call them
copy them home dma
yeah check it out source address test
address
the kernel knowing v reg offsets what's
a v reg offset
okay i mean we are sure that none of the
other
there are two other threats
as a novel push-pull pick i couldn't
find push-butt kick we are sure that the
other threads aren't uh aren't doing
anything right
they are polling
is it interesting
look there's a few texts here
so after val zero
val zero
we sleep
nothing happens
the other thread tries pulling
which i i guess okay it can pull
but
there's times out
nothing interesting
oh now it sets it to something big not d
what's because i already said it to d
how does it know that i said it today
wait so if i get rid of this you're
telling me
no
i don't know i'm not doing this very
well
i have to do this way more methodically
than i am
i thought this would be easy
it wasn't
oh that's just because it's the other
one
interesting
so if i try to do the other map copy but
if i do this mem copy it's d
that's interesting
so if i unmap this again and i bring
this thing back
it's d
it's only that one that changes
okay
oh okay
yeah all right so it just sets it again
it's crazy that that one's even
finishing
wait
after i unmap it out
how is this one finishing
oh it must not wait
i see
i mean we don't even thread them
like
i can just put this here
yeah look it's d right there
so as long as you're not doing uh
um
device to host blocks
but host the device doesn't
so that just writes the d there and
that's all it does
um
okay here's something we can do a shadow
just in case
[Music]
yeah
so those are just the things that it
happened to read
i do think that d is the control
why doesn't it work
how's it different
how those things
see this will have to do a lot more
methodically
all right those ones change
[Music]
70 becomes 7f
oh
i mean is it possible that i'm the one
writing these
if i'm the one writing these we're also
not doing that
so the chance we have to do write both
the d
and these things
i don't know if these are written by the
gpu or written by
me so we'll just put him back
i don't think he can hurt to write
sorry
7f because that's my
semaphore number
um
kick
comment that out
now it should look exactly like that
we got
zeros oh
[Music]
we got zeros now that could just mean
i'm breaking it
but that's good
now let's commit that
zeros
let's comment out the d and see if i
still get zeros
no
okay
the d matters
the d
matters
oh look at this
that said 7e before
if i don't
if i have the d
this says 7e
interesting
even though i set it to 7f
oh
okay
yeah none of these things are getting
set
wait so let's comment that out
notice how those things are still 9c
when i comment this one out
still 9c do we need just this last one
yeah look at that
so we have to set that one as well
i don't know why we're getting zeros and
why we're not getting desired stuff
but
that's not like it is your problem
oh
you know what this could be
this could just be
this could just be that this one no
longer knows how to trigger
and it sure looked like a trigger
um let's actually we can test that
set junk out 33 8.
okay so now if i don't do the mem copy
we get all 33s
i do the mem copy do i get zeros
now i get 33s
um
great
so
we just managed to break it
now
this unfortunately could be many things
it sure looks like we're executing
a command buffer
all right let's um
let's try something else
let's target this thing now that we got
rid of stupid aslr
how many times am i going to do that
let's try just dma directly to pc memory
i don't know if this is gonna work
but it can't hurt
and now we have some feedback
[Music]
you give me one bit of feedback and i
will conquer the world
see the feedback we have this now says
it ran the command buffer
this cues to the end if the command
buffer is actually run
so it is a run
but there's nothing there
look
we might need the other kind of command
bar
let's try
i could cast a void in the hex dump but
so this one might actually be working
we don't know if it's not
um but either way
oh this requires a different type though
i'm not amused
not amused boys i'm not amused
all right
let's see if it runs
um we want to copy
from here
into here
oh
let's try this let's copy it here and
see if it's offset by four
bam
that's running a buffer
we just use the gpu
to copy
these things
out with this
quality function
boom
there's no way that four would actually
happen
if that wasn't real
uh
get rid of that maybe we don't need that
we need that
we don't need that let's see do we need
this let's get rid of that do we need
that
oh we don't need that
what do we actually need do we need any
of this stuff maybe we don't need any of
this stuff
well there it is
out of this do we need this we gotta
need that otherwise it's like what do we
even have
okay that one was needed alright good
wow all right
so we can dma
wherever we want in the gpu
ah
we have dma
now i can write arbitrary complicated
curves it should just work
for some reason it seems like though
unfortunately
uh
i break the cuda driver once i take
control
and
i still understand what to do after
you've written d
i don't know what d means
but if you write d
it works
and always kind of right with the world
you know
can i sum up what the problem was the
problem was you have to put
here hex 87 a hex 7f
you see that works and if i comment this
one out
it doesn't work so
to answer the question are these six
written by the gpu or the user the
answer these five are written by the gpu
and this one is written by the user
what a joke
um
hey i'm curious if they're defined too
but that sounds like a topic
for another stream
zero d is 13.
yeah so the seven f and the d both need
to be written
what happens if i make it an 80. does
that work or only seven f
eighties are okay
but what if i make it a seven c i don't
think a seven c is going to be okay
no seven c was also okay
what if i make it a seven f
well seven after we know we're okay but
how about seven e's are seven e's okay
seven e's are not okay i'm sorry you i'm
sorry you typed seven e but that was not
the right choice that's the only one
that doesn't work
now does this one have to be a d what if
i make it an e does that work
e's do not work it must be a d
you had choices of letters to write and
you should have written a d because d's
work and e's do not
let's try c okay let's try one d does
one d work
no one d does not work the only letter
you can write there is d
make it a one
ones do not work
zeros
what happens if i make it a d
and then quickly make it an e
that's fine
what if i make it an e and then quickly
make it a d
that's fine too
oh you know what i have a theory
i bet if we look around here there's
going to be some d's
actually i don't know maybe i'll take
that theory back
oh yeah
watch look i remember to cast my void
beforehand
that's right
i lied about the d's
does it even stand or does the d go away
oh you can't even see the d it's an
invisible d
what if i sleep and then i look for the
d
so maybe you actually put in d's all the
time
zeros and ones don't work but these work
uh
all right i'll try something
watch this
well i'm up with some more command q
and then i dma maybe that's what the d
stands for
let's go from there to there
and text on that
does that work
[Music]
cool
we made it from 4 to 14.
so we can run two dmas with one d
um i do want to confirm
point your g's all right you want to
confirm that i can just do that
yeah obviously not a spine
um
cool
yo do you want to write fast mem copy it
just uses a gpu for mem copy
um
how do i find out that
how do i find out the base address
i mean
mapped in my shed is just this
i do not know how that mapping gets
there but actually it is nice now i can
like s trace
um and not have to worry about stupid
there you uh
interesting amounts from the fd
what's that anyone print the maps
i think it's just this
uh we can figure out i think yeah we oh
oh
you asking which device is it
it's nvidia
um
it's nvidia dev
uh
that one
oh so you're asking what's your offset
zero
oh wait the other offset is also zero so
i don't really understand
would you want to ask me to get the
fetch
i don't forget to put my aslr back on
boys i'm gonna get pwned
bro
what if someone wrote an exploit
that was expecting aslr
but then there was no aslr take that nsa
take that
yeah the register offset tax 90. oh did
you find any good hex 90s around
sounds like it's this
oh yes oh you just yeah the register
offsets x90 i know that
my other question i was like this isn't
video zero as well
how is this one different
what if i just do this does this work by
chance
i doubt it but
it does not
so they're different somehow
oh that one's not unmapped
that one comes from somewhere else
interesting
yeah can i wrap a video myself that's
just what i was gonna try
what's up
does that work
arithmetic on a void pointer
oh fine i'm fine
so that still works
now
what if i map it myself
sure
[Music]
okay i know
oh 60536 is that
okay uh
how do i get i gotta add control
yeah yeah yeah then then you're right
then it'll work with my own
segfault
i don't have to end that i'm not that
insect vaulting
what is that what's up
yeah i just want some cool life
what artists for food on the counter
let's put food on the floor
oh the food
um
okay this probably failed uh assert rags
yeah probably failed um
print and map
area
so i need to map it async
async
and map 22.
invalid
argument i copied it from s trace
all right fine s trace out
qp driver
khloexac
does this io control matter
i might have to do that i o control
first which one is it
logs actually didn't actually matter
fd21 and map 22
right map shared fd zero
map failed yeah
so
it's possible that that uh
you know look here it opens it
doesn't i o control on three what if it
is three
nvidia control
the colonel saw me something
useless
vm invalid map okay let's read the
driver
map context valid
oh
oh you got to validate it with the rm oh
i knew you had to do that i knew it was
some bullshit man
who didn't validate it with the rm did
you get the rm's permission oh you
didn't oh i'm sorry but you're fired
oh yeah you used to have a job but now
you don't
[Music]
just make rights work normally i can't
let's just look at the map
what
the psi octal is not a
i hate that they do this i hate that
they do this what ends in 38
oh
what ends in 38
i don't know because i used
oh it probably is this one
no
oh let's do that
okay oh sweet now someone
thank you for
watching what didn't map it anymore
all right just because it didn't map it
doesn't mean i can't find it
here we go okay
boom
that
it does that
oh what's p linear address
that i think that's a bar register
i think if we look at the bar
let's look at the bar
i did this yesterday you know you think
i'd remember stuff but it don't
okay
here we go so it is a bar register
it's mapping the memory at
this linear address
so the real thing we're writing to is
what is the bb
um
what is this shit called just tell you
anything
no
yup
so that's basically what you have to do
you have to ask rm map memory
uh if you'd like to uh do this
do we want to do that yes we do let's go
boys
you think i'd leave you hanging like
that we'll do that and then we're done
but it takes forever we'll give up on
that
let's go empty control
fd control where's the chip tune
chiptune chiptune
anymore chiptune
set forth
so
[Music]
these probably all mean something too
[Music]
[Music]
[Music]
[Music]
so
so
[Music]
so
22 hey
[Music]
[Music]
[Music]
[Music]
[Music]
[Music]
ah
change boys
that's a big problem
it changed
[Music]
we're gonna do about that
[Music]
we can guess what the next one's gonna
be
how do i get an h-climb
the kestrel
doesn't even matter if you guess right
you're getting those client from the
claw yeah i am why where else you think
i can get it
you're gonna get my cuda context
um
nope
my device
[Music]
[Music]
a good way to communicate
[Music]
all right we're gonna pause the chiptune
for a minute so we can think
no
all right
bye bye chrome
wow
awesome length linear address all
right uh
offset zero linear address
i don't even think that's gonna matter
because i don't think i have the same fd
even if i did guess the client
where do i get a client
don't make me get a client
i have to rm out like a client
all right hey you know what we're going
to rmlike a client boys no but they
don't have a memory no
no
okay okay okay okay okay i have an idea
don't worry don't worry i have an idea
i think that the fd is always three
so now if we just were to guess this
correctly it's gonna be six this time
not useful
not useful
bb i set flags to two
length is a thousand offset zero linear
address is that
memory is that devices that
incline is that
all right we're at fd control
this doesn't work
why doesn't it work
i mean it's possible that i'm not even
talking out of that
but no i i'm not gonna figure out how to
get a device and stuff
there's no such shortcuts you know
trying to take shortcuts and get nowhere
actually
i'm not even sure that can work
i don't know no i'm bullish on i'm
bearish on this
because i think that
yeah you gotta kind of do everything i
don't know how stateful things are
sort of with the driver right
that i o control could be failing for
any number of reasons
it seems pretty stateful i know
uh
i mean
we can just write the code that uh finds
that magic region
that searches proc maps and does it
someday
we'll parse all of this
oh what happened
does it not work if i
sniff
it breaks if i sniff
how does it know i'm sniffing
you know it breaks if i sniff
i don't know how that could sniff
seems pretty stateful scan memory for d
wait even crazier though how does that
break
it just doesn't increment that anymore
i don't know maybe i just need
sleep longer
no
that's crazy
if you sniff it doesn't work anymore
all right i've got some pretty good
stream today we got it dma i don't know
why it doesn't work when you do the
sniffer
[Music]
um that's probably a good thing to
figure out
but really
what we want to do
is we want to move past
using nvidia and we want to write our
own driver that initializes everything
from scratch
eventually we'll be making cuda calls
like this one
all right let's see what we're gonna
have to do maybe we can start doing this
on next stream
so first we
are getting ryan
am i getting what
uh no i didn't get called
yeah we'll have to go through all this
we'll have to do this
but now
i think it's dinner time i think we can
finally let the non-subscribers speak a
little
uh
we
managed to trigger a single
dma transfer
you're triggering people now no no no
dma transfers they're
friends uh
yeah all right so we got like
five minutes for any
stream related questions
a short breakdown of your concept
i don't know oh we dma from the gpu to
the gpu
i don't know why i couldn't get this to
work actually
i probably can get this does this just
work you know
can i target this with that
for some reason i doubt i can i think i
tried this and it didn't work
i'm gonna try that it didn't work
yeah it didn't work
you can't just uh
can't just do that
those ones work though
and actually it might just be because
you can't set d for that one
might be because for that one i have to
set something else
um but yeah we dmade from dx to here and
then we dma from here to here
um oh or is it that they're not nvcos
are they all nvcos
maybe they're not
do
[Music]
offset upper
oh load in line data is not an nvco look
at that
okay okay okay hang on i found a bug
so maybe this works
instead of this
for load and line data hang on let me go
to my novu here
uh i have to
it's a nik io
yes this one works too
great
uh we've learned that we don't actually
need semaphores because seven fours are
for idiots
great look at that
look at how that one copied
semaphores aren't pretty at seven four
seven people
uh
copy
from inline buffer
uh
sound floors are for people who like to
not sit around and wait forever on
spinlocks
but
that answers the question yesterday
uh about
how
bad is nvidia's driver well i think if
it's fast it'll just check but if it's
slow it'll fall back and it'll uh use a
semaphore
and then you can like kernel wait on it
you will cancel may service
new motherboards have a resizable bar
uh we just dmade from this inline data
from this command buffer into this is
actually host memory
uh and then like if we want
we can dma here
i think we can do just both like these
things should all just stack nicely
um this will like dma from like here to
here there you go from four to ten
and that was four and that's ten
um
no it's not the important thing isn't
that we dma the important thing is that
we got our own command buffers running
and these are the nvidia commands
so
what we can do
is get this command buffer running so
this isn't actually as daunting as it
looks these
are just uh these are just
dma's right like the these are all just
dmas
and then
you
set an inline qmd address
which
actually
i don't really know what that is
but you load the qmd data
that's it
uh and you just load qmd data and
uh it runs a kernel
so actually writing a gpu driver capable
of doing protocols is
well within the realm of like
two more streams
um
you guys gonna be mad if i work on this
off stream
oh you're gonna be mad you're gonna
cheat on
[Music]
sometimes sometimes i like scratching my
balls and you can't do that on twitch
you can barely tell what i'm doing
um shout out to lonix fox
who made a lot of great uh insights to
stream
uh he's probably the reason we found out
about the d's
i reverse engineer the oculus driver
yeah
i looked at jailbreaking requests too
for a little bit
remove camera what
you'll hear me scratching my balls what
what i'm not hungry at all okay
i ate a poke ball
our running ubuntu server desktop on
quiet i don't know what i'm running what
do you want to do lsb release is that
what you want nope sorry no lsb modules
are available and if you want it with a
dash a you got to subscribe
oh you're already subscribed okay you
get the dash ad
okay that's the ubuntu i'm running
i don't know if it's server or not
um
no no no we might work on the soft
stream a bit
well i don't know
you seem to be you seem to be antsy and
ready for dinner
the groceries just came i thought you
were hungry oh no no we got we got
coffee though we got
oh is that double coffee
oh i love them both oh we're drinking
cold brew
but now you non-subscribers know it
yeah yeah the shadow tool it was all
very useful without the shadow tool i
never would have found that upper nvidia
zero thing
um you gotta get what to work
with
did you use
are you raising your hand do you have a
question
he's raising his hand
i don't know it's an emoji
uh
he's saying yo that's all he's saying
when are we finishing the custom gpu
from like a year ago well look why we
need a custom gpu if we have an open
source driver for nvidia
what are we trying to accomplish well
building an open source driver for
nvidia
i think that this is way less hard than
people think if you're not trying to do
gpu
if you're trying to do um
if you're trying to no no who doesn't
support cuda that's the problem
all right
i know who's big and complicated and
lives in the kernel as well
i'm not talking about a new driver that
lives in the kernel i'm talking about a
new user space a relatively small
ten thousand lines of c plus plus okay
five thousand lines of c plus plus
and it's it's a cuda driver exactly
right in fact we can probably implement
the api
whoa that'd be crazy
think about it if we implement the
and you could use kudo without
installing the dryer well that would be
the idea right
yeah it's a pain it's 40 megabytes
uh it uses tons of memory i don't think
it's very efficient for this
i think it's designed for a lot of
purposes that aren't deep learning
think about it
by the way
you know we can use that we can use my
sniffer
sniffer with pie torch
oh it's a sniffer
you ready
oh that's too bad i shouldn't really log
on maps like that
but
you know i think we did this yesterday
but we can do towards zeros cuda
all right
what is all this stuff
what is all that stuff that just did
heap control what are all these two
megabyte allocations
uh we don't really want to replace cu
dnn we want to use cu dnn cudn also
links to the cuda driver right you can
replace cu dnn if you want right now
you don't need cu dna
why
what performance improvement do i expect
it's not even that i expect a
performance improvement
you use simple sound crane you said you
were hungry
you put sour cream this is just
that yogurt or sour
all the zeros i know that's just full of
zeros like i can smell the zeros
look at all these two meg allocations
you know what i bet it is i bet the
smallest you can allocate for a program
is two megabytes
well look at how much
not that
look at how much my torch is using it's
using two megabytes
i guess we can also make the sniffer sit
there and look for new command cues
think about it
we could actually replace
with
open cuda
open
cuda how do we make all of pytorch work
with open cuda how hard would that
actually be
yeah we'll re-link we can still you see
you're doing that i'm sure you see a dna
is just a bunch of cardinals
um
all right like i don't want to deal with
i think there's an open source we can
even still use cuda to do the
compilation i'm just talking about the
cuda runtime
uh am i serious yeah i'm serious
do i not look serious bro
yeah i'm serious bro yup
uh
tiny cuda whoa tiny cuda
no no you wouldn't have to do tens or
two open cuda it would link with torch
the same way cuda does and it would
provide the same api
and then we don't have to use nvidia's
user space anymore
right nvidia's user space is bloated
with a ton of stuff
that's designed to work with uh
gpus
gpus to draw pictures are super
complicated there's all this stuff and
there's shaders and there's
compute it's one struct
we know what the struct is
all right look we have this truck here
where's the strut where'd it go
we had it it ran away
get it
it's in helpers this one the q metadata
the q metadata version three
this sound too good to be true open
source optimization
it's not about optimization
it's about owning the stack
seems easy well we got dma working so
we've basically written cuda mem copy
[Music]
yes you still own things man
there you go
ah
yeah just like this
you just need to figure out what these
are
cue a few of them up and then here's
another thing we could do
nvidia has this cuda graph api
which
i'm sorry sorry
overscribe command cues and gpus
when is this
oh yeah no who does anything in parallel
yeah use clang nv lvlim and the nvptx
backend
this is open source
and it can actually compile things
that'll make ptx but i think i have to
go from
generating ptx from llvmir
also ptx is nvidia's assembly language
kernel functions and device functions
oh this is
great
yeah i thought this was open source i
remember when google came out with this
um but yeah so basically what we'd have
to do
is just see this driver see this program
here so here's the program that runs it
we just have to replace
these functions
with uh the ones in our driver
and then we link to our driver instead
of their driver
and uh it's done
small allocations are packing two meg
blocks
[Laughter]
that's funny
you made a few small buffers but don't
worry it's just a few small buffers nice
find
there's just a few small buffers no
don't don't worry about it
there's a few small buffers
no license problems with replacing cuda
no we didn't do it did you see me do any
reverse engineering on stream
did nothing
gpu accelerated tempo os
yeah but you'll have to do it in compute
shaders all
right buffers tiny cuda do i like tiny
cuda
yeah i wonder how far we could get
when's my next stream nah guys i have a
job
how can we make money off tiny cuda if
you could tell me how to make a hundred
million dollars off of tiny cuda
i'm interested
we could you want to start a company for
tiny cuda and get acquired by nvidia
because it's too good
should we start the tiny cuda company
what's the business model
patreon
tiny cuda tokens i like this guy
what cricket went down more
am i poor yet
cutting machine learned processing time
by ninety percent i wouldn't go that far
i think you're making two grandiose
promises you sound like a great startup
ceo
are you looking for a job
uh
make tiny cuda profit that's a good
point
that's a good business model
free for everyone paid for enterprise
oh i kind of like that that's right tiny
cuda's free unless you're using it in
the cloud then it costs money
aws accelerated with tiny cuda
tiny cuda t-shirts all right all right
all right i like that i like that
make tiny cuda just because you can oh
that's good that's good
unlock fast crypto mining oh
[Music]
yeah those people are using cuda too
if you want to use tiny cudifer i have a
new idea i'm writing crypto miners and
keeping tiny cuda a secret so just like
remember in a year remember in a year
when you don't see tiny cuda on my
github that it's because it's secret
nah they're not using asics the gpu
ethereum's not using asics
get paid by nvidia to shut down tiny
cuda so people need more gpu memory
no no it won't work in games that's all
really hard stuff to write
all right guys
this today's stream
last question is it good
is the last question good
upsell to big cuda
people like it because it's tiny
no more questions all right great
great thank you everybody thank you i
hope you had a good weekend
uh
you know don't uh
if you're thinking about killing people
don't you have the rest your life ahead
of you to live and you don't want to
live in jail so you know we'll leave the
stream with don't kill people thank you
bye bye
wait yo no that was too fast i wasn't
ready i wasn't ready i thought you were
gonna ask me if i was ready i wasn't
ready i thought you were gonna ask me if
i was ready
i have to change the name
i have to change the name
we'll call it a side
i'll look
into
nvidia open source drivers
i was not ready at all to start
streaming i just clicked that button i
thought it would come up with a thing
oh boys i'm not ready
oh
we don't need that
no we just mute that and we can turn
that back on
this goes over here we gotta get coffee
oh
oh good morning happy saturday
this isn't coffee this is water
this is water
you know two fish
swimming along a tank
one fish looks the other fish that says
hey man
water's pretty nice today right arthur
fish looks at him and says
what is water
all right we're getting coffee we gotta
go off i'm sorry for the delay
but we got things to do today we got
things to do today i also spent some of
your subscription money i'll show you
what i spend it on
put a
we'll put a little milk in
and then we're going to read the nvidia
open source drivers we're also going to
set something up but that's to be
revealed later in the stream once we get
some some some people in here all right
good morning good morning everyone
everyone's filing in welcome
violence whoa who's asking stupid
questions
good morning
goo
you're using your prime on me thank you
i appreciate you i'll show you what i
spent your money on don't worry your
money's not going to nothing your
money's not going to waste here
here at the george hawks twitch stream
factory we're spending it on something
good
um to make my past videos not only
subscribers to watch no stop being poor
and subscribe
hype train let's go let's go good
morning okay
so we're just gonna get right into it
uh
i prepared for you last night okay i
prepared for you
all right
so first off
uh it turns out that tiny voice works
great you just needed to train it on
eight gpus for a day
it turns out that tiny voice works great
you just need to train it
all right so
it turns out that tiny voice works great
you ju
oh well let's try it better
tiny voice works
well tiny voice isn't a word so that's
not fair i'll say this tiny voice
tiny voice works great
it listens
tiny voice works great
it
tiny voice works great it
look at that look at that boys look at
that this is open source by the way you
can try it it works great
we don't believe in collaboration
because it's stupid
we don't believe in collaboration
because it's stupid
no major code changes since the last
stream i mean you can read it we don't
believe in collaboration because it's
stupid look at that
you got every word correct
now it does turn out there's a little
bug and if you speak too quickly it
can't fit enough characters in the
decoder
um
but
it's been a long hard road without you
by my side
it's been a long hard road without you
by my side
uh all right so guys i'm actually
cheating i got my friend joey over there
and he's typing what i say and said no
i'm kidding it's real ai i'd never do
that to you
i never do that to you we just trained
for a long time
ah
yeah but okay if you talk too fast
okay but if you talk too fast it doesn't
work because it doesn't fit the
characters in
see
i had to talk too fast but
but i have an idea i think i can do
let's just slow it down boys let's slow
it down we can slow it down how do we do
this
i think it's that one so i think we do
fake val equals what is it numpy
dot what is that what is that um
pie
copy
access what what is that no repeat
repeat like p repeat alright cool
bp
fake vowel
uh two x equals zero
yeah okay there you go
okay but if you talk too fast it doesn't
work because it doesn't fit two
characters in so it like kind of works
if i repeat it but the this isn't
actually a problem of tiny voice
listening
um
here well let me show you i can show you
quickly like how it works
um so this is the model guess
plot
and gas dot shape
okay
so let's plot
m gas
or you know what i'll just show you
something simpler
you can plot it too but
you see the problem it doesn't have any
room to fit in zeros so like every
single one is taken up the outputs are
too densely put together
right here let's talk very slowly
i
like
chicken
so i like chicken right there
and this is what it looks like right you
can see
let me let me make this let me make this
big for everybody
see this is the eye
like chicken right pretty good right and
notice because i spoke slowly there's
plenty of room to pad it out with zeros
but in the other one we speak too
quickly there's no room to pad it out
with zeros
so this is tiny grad uh sorry this is
tiny voice a tiny voice works
oh that's something else we can do on a
stream today if we have many time for
streaming we can implement tiny voice in
tiny grad
to because we do have good working
speech recognition models now
we're not up to a thousand people yet
once we get to a thousand people i'm
going to reveal what i bought with the
subscribers
money
uh
tiny guy doesn't really have bugs 10
grand it's pretty good
the new model is already on github the
new model's already on github i actually
checked in this file last night
listen.pie
uh so if we go over here to github
uh yeah i was messing with you see this
don't expand so i was messing with
expanding the linear layer and like
making the final layer 4x bigger so it
can now put more characters
but i just said expand equal to one uh
this model
this model here
oh yeah by the way which got a
validation loss of 0.11
i was excited with ones that uh but you
can see the truth here that everyone
already knew
uh bigger is better i'm sorry you know i
i i i know that it's kind of going
against the spirit of tiny voice to be
big but it turns out that when you make
the model bigger it just works better so
what is the unreasonable effectiveness
of very large neural networks or some
crap we gotta turn the cold down here it
is too cold for this morning it is too
cold
so 67 bros
i wonder it's cold
i like it cold when i sleep
oh why would i write this in russ why
don't we rewrite it hey guys guys guys
you want to write this in python
or
we could write it in rust and it'll take
five times longer
what do you think
all right we're up to six twenty that's
pretty good once we get to a thousand
we're gonna reveal what i bought with
the subscribers money
uh all right
i prepared something for you guys last
night
it's called q
alright
so q is a computer and it lives right
here i don't know why system restarts
required
but q is actually in my house
uh so let's take a look at queue a
little bit uh q has a ryzen this is my
gaming computer q has a ryzen 5950
uh oh this thing is gpu info q only has
a pathetic 64 gigs of ram ram's
expensive boys i didn't want to buy more
ram my computer's at work have so much
more ram but this one doesn't have a
tram
and my crowning jewel
oh i hate that nvidia smi cuts that off
there we go
it's a g-force it's this one
it's a geforce rtx 3080 ti
um i installed the latest driver last
night which should be the one that's
compatible with the open source so
nvidia did open source the gpu driver uh
and let's take a look
create
what a tragedy
i was building torch last night i should
figure out why torch uses so much memory
all right let's just make a new thing
um this is a brand new computer uh just
for you guys prepared for this stream
whatever where'd my viewers go
nvidia open source driver i can't look
at the view account
we're just going to get viewers at some
point when we're ready
uh hang on let me pop out the chat like
you know like like little player or
whatever his name is it pop out at your
party i'm with the gang and this is
going to be a robbery so tuck your chain
i'm a killer girl
no not mod view
chat settings how do i pop out the chat
is there a button for that
everything's so hard
computers are so hard to use
click three dots pop out of chat where
are the three dots
no those are channel points what are
channel points chat settings
came in oh pop out chat oh chat settings
thank you bro you're you're not a liar
all right good all right we're in the
chat that's
good yeah all right we're good
we good
video open source driver github
here we go the open gpu kernel module
all right let's make sure my version is
correct first of all
alright cool
so this version is this so now i'm not
running the open source one
so let's take a look at the open source
one here okay clone here
all right how to build
take modules jn proc
oh did that actually
i don't know how that worked
i think that's the ugliest syntax by the
way i much prefer this syntax
failed cc version check oh
probably doesn't like that i did that so
many times okay you know what get clean
xdf
see how many processors i have wow 32.
that's a lot all right cool
um build the driver
to install first uninstall any existing
nvidia kernel modules
note that the kernel modules here must
be built with the gsp firmware
all right
make
how do i uninstall the kernel where are
my chrono modules
where are kernel models
i don't even know which kernel i have
i'm not d message how do i check the
kernel is it your name dash i
i'll make it bigger for you guys
oh i probably updated hang on
okay i think we have to reboot first
how can i check if my new kernel's
installed
yeah the new kernel is installed okay
should we reboot
if we reboot is this gonna ever come
back or is this gonna be one of these
things that just doesn't come back
i don't know
how do i uninstall a module does anyone
know how to do that
okay they're in there nvidia
i don't know yolo make modules install
let's go
all right didn't work
um
yeah okay i think we have to reboot
because i think we're gonna get a new
kernel
so let's give that time to just reboot
no no no i'm doing this on another
machine don't worry we're on tubby and
this is quiet
by the way let's start reading the code
guys i can't afford a new computer i
didn't get enough subscribers for that
to come back let me know let me know in
your back machine
let's first read the code of conduct oh
great glad we have one of those good
good i know how to behave when i'm
when i'm looking at the nvidia drivers
uh i think the basic architecture is
what's debug
build the kernel modules as debug oh
seems pretty nice
okay we have nvidia nvidia drm nvidia
mode set nvidia pr mam and video uvm
and then we're going to start we'll do a
bit of a dive today into uh how cuda
works
and we'll learn what we can learn okay
all right we've rebooted we have a new
kernel oh we have a new kernel 141 now
um
all right that built fast enough so
we're just going to get clean xd output
and build it again
uh make modules dash j i can just do
dash j i don't know why i have to dash j
on proc
that built pretty fast alright let's
let's get a cuda example going here
before we uh before we install this gpu
driver
which
let's call it um cuda
no that's terrible that's terrible we'll
call it what should we call it what
should we call it guys
what should we call it
um
you know what this is kind of a part of
tiny grad
the idea is that we're going to make
gpus fast okay we're not doing this for
no reason we never do anything with no
reason we're going to figure out why
gpus are we're going to figure out why
gpus are slow
and
all right
you know what in the spirit of naming
things we're gonna name it cuda
underscore example all right good i've
been trying to name things at work
better
cuda underscore example if you don't
like the name go to a different stream
okay
here we go here's a simple cuda example
what's sax pie
example
dot c
all right
cannot gcc it's not that
easy how do we build it oh nvcc
i have to save it as dot coupon
wow that was so easy to use
can we talk about how easy that was to
use
so easy
all right
let's s trace it and see if it's
actually connecting to the uh
you guys know s trace we're gonna learn
some real reverse engineering skills
today boys
it feels like oh i already know as this
guy's washed up man this guy's washed
off the new kids now they're using dude
using this tool he's never even heard oh
man
did we build did we build this yet we're
gonna build it again let's build it
again
because we want to build it with debug
debug equal one
we love debug
make modules
dash j debug equals one oh yeah
good okay
um so here it opens nvidia control
and
it checks some block thing
it opens proc self status uh let's just
put this into something
see what rim does syntax highlighting
for my ass trace for me
so here we're loading dev nvidia control
here we load nvidia uvm
and here we connect to nvidia zero we
actually open it twice
now remember
that uh this isn't really uh
they didn't open source the whole thing
the only thing they open source was the
kernel driver
so but we can finally figure out how the
uh how the kernel driver works and we're
gonna we're gonna try to do it um so
let's first take a look at saxby and
figure out what it does
what does it do
okay
um malek some stuff
it
it's like uh it's what is this what is
this does it say in here what this does
what is what's the name sax mean
why is it saxo the triple chevron oh god
[Music]
oh there's a new even easier
introduction to cuda this one was too
hard that's a good point
oh that one makes you do it on not kuda
so you can appreciate kudo more i say
wait
is this even kuda
wow
first we have to turn our add function
into a gpu function
is this a good idea to put a loop like
that on your gpu it's going to be slow
i can't even use nvidia prof anymore you
can't use this anymore because when you
try to use nv profit just complains and
tells you that your gpu is too new and
you need to go buy an older gpu
so you have to use the new shitty
profiler ncc
see i told you i think i'd lie to you
about that all right good we built that
let's make modules install we're
probably gonna have to sue don't make
modules install
uh yes but at least it's installing it
to the right place now
permission denied
all right it's trying to install this
should we just let it
wait that's not even right
do we have to uninstall this one first
how do i uninstall it
wow look at all these modules what i
have so many modules
okay
drm well we definitely don't like that
um
okay
let's figure out how to uninstall the
module dkms uninstall
module
how do i uninstall a dkms module oh here
we go
um dkms status
oh perfect
okay
pseudo
dkms remove
nvidia all
oh not a good enough it didn't work
oh
gotta do a slash
this
you know what i wanted to do oh
no original module was installed
all right
did that work
okay no more
not in there anymore
okay that looks pretty good now let's
make modules install with the pseudo
all right all right
um i don't know is this okay error
skipping that mod do we need that mod
okay we have in video now
i think that if we ls mod the old ones
are still loaded we're gonna have to
reboot again all right was it ready to
reboot let's reboot
that's why i did it on a different
computer
who did that
kept
i have to reboot anyway guys
no no no i do not want app get auto
remove purge nvidia because that's going
to remove user space too
don't remove user space okay
no
no nvidia sms failed no i hate that
error okay it didn't load for some
reason
ah
this is all this is terrible oh no we
messed up we messed up boys
messed up
no don't please no no no if nobody's
loading i'm gonna be so upset
do i have my phone
do i have your phone i don't have your
phone
oh no i have novo okay we gotta
uninstall that is that what loaded
let's check if it loaded
that's a good point though no
move
oh why do they spell it in french no
it's not that no who loaded i think
anything loaded
wait but uh oh i don't understand
okay
wait wait mod probe nvidia is that going
to work
module nvidia not found in directory
lspci nvv you're a subscriber you know
what's up oh oh
i did see something about nova right
there
this is pretty cool actually
here we go
for this vga controller which we know is
this kernel modules nvidia fb okay let's
inspire nvidia fb my profi video
fb
all right all right
oh
this is upsetting
all right we're gonna figure out how to
fix this
[Music]
kernel driver in use
all right all right or maybe is there
more
which of these is nvidia fb
oh here's nvidia fb okay i don't even
think that's one of them that we built
was it
um rm mod nvidia fb
does that work
okay
we unloaded the driver doesn't know who
blacklists the nvidia modules
bye
[Music]
all right all right well
no
no so you're gonna have to wait you're
gonna have to wait more
you're gonna have to wait
um i'm not missing any files i don't
understand why this doesn't work
but that's what we're here to discover
man
if everything just worked what would be
the point of life
you know
life's about shit not working man
you know shit man
that's no never mind we're not doing any
more of that kind of things you know you
all want to hear like things i'm not
doing that anymore
okay
is this the this isn't the problem the
problem isn't because it's signed right
missing system map file skipping depth
mod
is that the problem
you can run depth mod after the modules
install
sudo dat mod
what does depth mod do well let's read
the man page
hmm okay that didn't help me
um
sign file search signing k.pam
well the keys need to be created
mr error all right let's make a key
hmm
what
i understand
oh
okay we have a signing key let's see if
that fixes that
no
oh we don't have an x 509 signing key
i thought i did this i told it to make
that
why didn't it make it
well because it didn't find a
distinguished name
unable to find distinguished name in
config
there is one
oh this didn't work
who wrote this crappy echo command
i'm gonna do em
it's supposed to be fun
turn
[Music]
all right good all right we have both
keys now let's try that all right oh
look at that that's pretty good okay
now they're signed
i don't know if that's what's gonna fix
it
missing
system.map okay how do i get a
system.map
this is a warning that's not good okay
but it still seemed to work
yeah it was just a lie and video's not
really open source
um
all right i still what is
oh oh okay that mod ran
i don't know is this better you think if
we reboot now it's just gonna work
oh
look at that
it hangs now
oh look
we have stuff
of course nvidia smi doesn't work
because it hangs
no no no no i pseudo debt mod and then
it worked
okay we just needed to sign it okay that
wasn't too bad
okay well
we tried let's see is anything a d
message ah here we go
look at this
ran out of a critical resource
all right let's just reboot again
oh we might this might be a gsp problem
we actually need to get the gsp
i don't know what a gsp is but we
probably think all right guys are we
really at a thousand viewers are you
trolling me
we are at a thousand viewers all right
the reveal of what i purchased
we'll try app install jsp reboot the
reveal of what i purchased
with your money
i got an email
from a subscriber
and they had an idea
and sometimes you come up with good
ideas i bought this with your
subscription money
to anyone who said i was rich that's a
lie i lost it all in bit connect
i used to be rich and then i gambled on
bit connect they told me it couldn't go
down
just when i was starting to rebuild i
put all my money in luna they told me it
couldn't go down
and well it went down and now i'm poor
that's why i'm back on twitch streaming
for you guys
but um i also i also uh
never mind
regardless i'll show you what i bought
with your subscriber dollars
this was a suggestion from a stream a
suggestion from a viewer
where do we have more data
that matches audio with voice in the
world
even better it's beamed to you for free
over
tv
i bought a quad
4 hd atsc digital tv tuners for usb you
know it's good because they put an
exclamation point in the product name
look at that exclamation point the
product name for hd atsc digital tv
tuners for usb
all right and then i also bought in this
box let's see let's see
an antenna
whoa
amplified hd digital antenna
and
usb
and we're going to try to use this later
on stream
but for now we're going to try to get
the nvidia drive to work
all right nvidia smi
okay okay we're not there yet we're not
there yet
okay
direct
ran out of a critical resource well
all right
gsp rm control failed the good news is i
think we can uh read the source code and
see what's going on here
what happened to my other window here we
go
i mean what is that and we don't go here
all right here's the problem
what was not okay
what is this function
rpc
rm control gspi i did read something
about the gsp
so we're going to need to deal with that
i'm glad we built it with debug okay
make sure the kernel modules built here
must be used with a gsp firmware
alright so let's download and video
linux download
let's just look around is there a gsp
somewhere and then lib modules i didn't
delete anything i just dkms removed
i don't think it's at gsp
um okay
latest beta version
this is going to work
[Music]
hate this
why would i ever want to download
confirmation php
nobody ever would all right download
is this the real download link
yes that's the real download link
alright fine we'll get let's go
this can be achieved by installing the
driver from the run file
no i want a real dot
oh okay here we go
we have this it's in lib firmware nvidia
gsp.bin
alright so we have a gsp
gsp rm control failed
direct firmware fail to load gsp
[Music]
oh okay well it's good because this is
still okay
open nvidia
is only ready for use on oh
oh we have to do the is only ready for
use on data center gpus
oh they have some docks on the gsp all
right let's take a look
hmm
okay okay seems pretty good
but
wait does this really only work for data
center gpus
open nvidia ko is only ready for use on
data center gpus let's read if this is
real
oh it checks the branding great
oh go to shutdown oh we don't want to go
to shutdown oh that's the problem
all right well let's not go to shutdown
let's figure out how to set the uh
open rm enable unsupported gpus
described in the readme
oh here we go
oh all right all right here we go here
we go this guy pie maker is a bro
all right let's go into etsy mod pro b
um
it's in the readme
let's let's try it
works on your 30-60 oh
on video.com oh it's gonna complain it's
gonna be like yes it's not easy yeah i
need to finally yeah i'm gonna suit out
rise is a bad choice you make bad
choices and you shouldn't make bad
choices all right good thank you
um pseudo mod probe nvidia
sudo okay
you know what's going to drop the video
rm mod and video this is actually
working we have to read with the
computer again i'm going to read with
the computer again
okay we made a file though so this is
progress
it works for very sexy
we need more coffee
oh yeah no no we use a transformer we
used a conformer
it's a transformer with a convolution
and it worked great because the model
was really big
it turns out only two things matter in
deep learning how big your model is and
how much time you trained it for
oh also a bigger database
if you make your data bigger and your
model bigger
and your training time bigger
your results get bigger
i'm a deep did someone should just
that's deep learning
right there if you think you know
something else about deep learning about
oh the architecture matters the author
you're gonna try adam w with weight
decay if it doesn't matter
only three things matter
how big your model is how big your data
is
and how long you let it train for
nothing else matters
uh oh no okay okay we got a new error
now
uh oh
is this okay
maybe it's okay
it worked
okay we have xorg and gnome shell
running it's pretty nice
all right let's go back to our cuda
example
sax pi
it works
let's see who came up in d message okay
all right
we're still getting some errors with the
gsp rm control
probably not important
yeah we can use non-data center gpus
with a one-line workaround
um
okay
i mean the other thing that i wanted to
do
was look into why torch uses
i tried to build torch last night and it
didn't go well
so we'll just go back to this
no i think your meaning mostly went okay
but
it just took a long time
i like torch because it gives us precise
control
what's the reason i'm doing this on
quiet not on batman because
i don't want to break batman we actually
have to do work on batman quiet it was
just for playing games and that's what
we're doing right now
oh i like this one python is python 3.
let's install it
bro now i can type python
i love that i love that python is python
3.
all right
so you'll see now we don't have anything
but if i type torch.zeros2.cuda
we now have a thingy on the gpu
hopefully
okay good
unfortunately look at torch it uses 200
and so many gigabytes of memory and it
uses lots of gigabytes of memory but
cuda 11.6 supports lazy module loading
so
yeah
you can do this with cuda model loading
equals lazy and then it uses less uh
nevermind that doesn't matter okay
wow
is this what i'd get for building with
debug tons of spam of gsp rm control
failed
let's learn what this is by reading the
code
oh this is like some rpc thing okay all
right good we understand what the gsp is
let's go back to the documentation for
the gsp i don't know where that went
gsp documentation
video
here
people say google isn't good
we'll take a look at the gsp let's see
what the gsp is
uh
you shouldn't type fine to graph you
should memorize the 17 weird parameters
of find
all right
wow 39 megabytes
and it's like encrypted or something
is it encrypted
whoa
risk five
no it's not encrypted this is real
well the gsp chip is risk 5.
that's cool
so you're telling me nvidia has uh
gsp firmware version
cool
all right now the question is what was
this command supposed to do we should be
able to find the gsps api here
let's find the things that call this and
let's see uh
oh great
rmapi
uh all right
prm apis we have to look for things that
call control here we go
no not that
oh here we go
here are the commands oh perfect
now we can figure out which command's
failing
no
nope can't find out about that command
this command failed too
oh here we go
control command get
oh well no wonder this one failed
because this isn't even a real command i
don't even know where it got the idea to
send that command it's got to be in the
driver somewhere right
control
get offlined pages wow that's pretty
cool
this is super nice nvidia's
good guy nvidia
right so does everyone understand what
the gsp is it's like a little firmware
that you can offload things to and this
is the documentation for it here
what's the fb engine
i think it's frame buffer but i don't
know
control 2080
oh is this because it's 2080 like that
it was 2080 right
where's my vga compatible controller now
it's 2208
by the way these things are all
you know they start with 2080. so we
must be using these commands
how does it know which one to use
maybe these are all failing because my
monitor is not actually plugged in
uh it's the same monitor that i'm using
here what
infringing i'm literally reading open
source software boys
if nvidia has a problem with that they
shouldn't have made it open source no
look and video is not the bad guy
anymore let me explain why okay i don't
know that like oh we're not explaining
anything anymore except we're doing
software but like look
this is nvidia's share price right
when nvidia's share price goes like this
they're dicks when nvidia share price
goes like this they're nice to people
right this is just just business 101
when the share price goes up it's good
for the shareholders and bad for the
customers when the share price goes down
it's bad for the shareholders but it's
good for the customers right so you
every time the market crashes you should
be happy because consumers uh companies
are gonna try harder
this is a fucking joke
wait wait this is a fucking joke i can't
stand this shit
right next to their market cap is a
measure of actions a company takes to
address climate change
bros i don't even i don't want to talk
about this but google you shoved at my
face look
i'm just gonna say this
elon was very uh
correct to point out that
you have your environmentally
sustainable governance and exxon's on
that list and tesla's not
so so you know this is this is it's it's
it's it's you know it's what is it jesse
jackson it's it's the push coalition but
for carbon you got to bribe the carbon
guy man
yo i got the carbon guy yeah no no man i
sucked his dick last night that's why i
got a cdp score of an a right and that's
that's what it is all right so this is
unbelievable
like fuck google right google why do you
put things like this here it's just oh
yes i can learn about cdp scores oh you
even put a link on it why can't i learn
what a market cap is you know
why can't i learn what a p e ratio is
huh huh huh why can i only learn about
your bullshit
all right sorry i was triggered i was
triggered and they're designed it's
designed to trigger you okay
agit prop agitation propaganda and it's
so effective because i'm agitated now
all right agitation propaganda remember
that phrase
all right let's get back into not
being triggered by google does yahoo
finance do this
would yahoo finance do this to me oh
look it isn't video out google
no yahoo finance is is uh is is not oh
they're overvalued yeah it's good good
the price can go down more and they can
open source more stuff
guys
guys
you can't you can't you you can't you
can't let me let me show you guys the
future let me just let me just take take
let me let me take one second to show
you guys the future and it's this all
right
do you do you think like
ugh
oh
these people do understand that when
they like don't put tesla on the esg
list
they don't delegitimize tesla they
delegitimize esg right they delegitimize
this whole idea
um and you know look
let me tell you let me tell you a quick
way to promise that your shit's gonna be
replaced and that's to try to shove your
ideology into it and i really when when
nasdaq and dow jones and all these suit
wearing sexual harassing wall street
motherfuckers uh you know when they when
they get get btf owed by the uh crypto
you're gonna know why and you heard it
right here on this stream uh so that's
what's that's what's uh
that's what's gonna you know look man
let me tell you you know freedom wins
you know freedom wins and i didn't want
to go on a rant but google you triggered
me
and let me tell you i hope you guys all
know really you got to keep the you got
to keep man you got to keep the cia out
of your head you got to keep these
narratives out of your head you got you
got to stay focused on what matters uh
and that's you know don't don't try to
fight them don't be a republican come on
elon don't be a republican oh
oh you're not you're not man oh yeah you
know what you know what i think the
yankees suck so i'm gonna go be a mets
fan no the problem is you're rooting for
a couple of guys grown men who throw a
ball around on a field that's the
problem the problem isn't that you root
for the yankees or your root for the
match or you root for the
dodgers or you root for the kansas city
royals the problem is that you root for
a group of men who throw a ball around
on a field and get paid millions of
dollars to do it that's the problem
all right
all right where are we
where were we
oh no oh yes oh it's the two-party
system man it's the two parties imagine
we just had more teams we gotta let more
teams into the league man gotta live
more teams into the league we have more
diversity man no
grown men throwing a ball around
okay the thing that we really wanted to
get to the bottom of
now we can like read this
how well documented is nvidia's like
their api
for
what i'm wondering is all right so so we
have this cuda example and like what api
is this actually using
it does i feel like i've looked into
this before and it doesn't look like
it's i o controls
maybe it is these i o controls maybe it
is these
let's figure out what these i o controls
are
so i'm opening dev nvidia zero
um
there's like a comments like iowr
what does drm stand for
i don't think it's
i don't think it's digital right oh
direct rendering manager
so maybe these are the i o controls that
actually
but
see it it doesn't know what they are
because
what's three
there's a hmm
oh it connects it to oh mps control i
don't know that went away quickly
prop modules not that
oh it's nvidia control okay so these are
nvidia i o controls
let's see if we can
get a list of them somewhere because it
is using i o controls
we should do our best to keep these
values constant
okay these are the nvidia drm i o
controls i don't think we opened the
what does the direct rendering manager
even do
not important
so what exposes nvidia
control there any documentation that
tells you kind of what these things are
okay what's the uvm
unified virtual memory all right that
seems useful
[Music]
nvidia ko exposes nvidia control
actually is there a way to just is there
a way to like look that up
can i see which
which
module created which file
i mean maybe it's the major device
number
uh
lists
dev major device numbers i'm thinking
there's some way to do this
oh here we go proc devices
oh sweet oh this is sick all right cool
so 195 is nvidia frontend
i don't know who makes nvidia front end
but
that's pretty cool
oh
look at this
i can i can get this book for free wow
this this pop-up really appeals to me
sorry sorry i'm still triggered i'm
still triggered i'm still triggered it's
not triggering we gotta do some
meditation man gonna do some meditation
agitation propaganda
hmm
what's in the nvidia park
i was looking at this last night
all right
subscriber only chat time
we're gonna try to figure out what these
i o control okay
we have a goal for the stream let's
discuss our goal for this stream
our goal for the stream is going to be
to do a cuda operation
from a c program
so instead of using all of nvidia's
stupid drivers we're going to try
to not use the drivers
and we're going to try
to uh
yeah just do it with raw stuff so then
we can have a completely open nvidia
stack we have an open source driver and
everything open source
um no who should know who i'm sure is
going to switch to user space to start
using the real nvidia driver i know
there's some clocking issue with novo
i don't know if the open source stuff
helps with that
but either way let's see if we can we
can do this
um
so i did something similar uh in open
pilot
it's called need
so we're going to open pilot
in model d i with this thing called
pneed which is an i o control
interceptor
it sits here and it grabs these
kgsl is the qualcomm gpu
and it grabs the
i o controls
from the gpu
and it caches them so it can replay them
later and then it doesn't use any of the
user space driver when you're rerunning
the model over and over again
okay
by the way now i really want to do
i was not always making fun of share
price but i really want to give a shout
out to nvidia uh for open sourcing this
uh look
if companies are thinking on a long-term
time horizon this is a brilliant choice
i also saw some specs of the 40-90 and
they look amazing
like like please don't nerf them in any
way
the the number on the 30 90 that i just
couldn't believe so first off that's a
wild tdp but you know that's not
do they have the number here that i
couldn't believe no i don't think they
have it but
um this is the new
yeah yeah
16x l2 cache
they're putting 96 megs of l2 cache on
this chip
we're finally going to be able to fit
decent sized matrix multipliers in cash
for reference the a100 the big
difference between the a100 and 309 is
the a100 has a 40 megabyte l2 cache
the ad102 which hopefully is going to be
a normal consumer gpu
is going to have 96 megs of cash
like you just when i see this
give up ever
competing like nobody's going to compete
on deep learning for quite a while if
these specs are real
um like yeah you'd have to take a
different architecture maybe 10 story's
doing something interesting but again i
haven't seen a chip from them and video
is going to ship these things they're
probably going to be more available than
the last one
like i'm so excited for this gpu
and yeah nvidia charged two grand for it
like when you charge 10 grand you're
gouging but when you charge two grand
like
shit you could charge 2 500.
if you charge 2500 for this gpu yeah
everyone will buy it
103 teraflops
and with an open source driver always
worth your user space too why does it
matter
open source base don't open source your
chip keep your chip closed just make
your chips available you'll sell so many
of these you'll own the future you will
own the future of ai if you do this
nobody's going to compete
um but you know yeah good on nvidia for
open sourcing this
[Music]
all right sorry sorry we're gonna talk
we're gonna talk for one more minute
about why i'm really triggered by this
um
so what these people are trying to do
um
so
when you look at the market cap and the
p e ratio of a company these are
capitalist metrics
right
what these people are trying to do these
people are not capitalists
this is this is this is not a capitalist
goal right these people are trying to
put in uh and you know they're pretty
they're pretty open about this they're
pretty open this idea that they want to
subvert capitalism and replace it with
something else
um
and like
you know i don't think they win
and what's what's really sad about this
is like
this doesn't win
it's it's openly mocked everybody knows
what a joke it is
it's not gonna
nobody in 20 years is going to seriously
be like oh well the cdp score of the
company no i mean it's just not going to
happen
but they they throw away
like
good institutions that have been created
institutions that arose not out of a
goal to like engineer society but out of
a goal to uh
you know accurately reflect
you can you can you can do two things
you can you can build something that
tries to reflect a true metric and put a
number on it
and this is like doing science right
um
like if you if you
the concept of a market cap of a company
is and i i think that this is the
fundamental epistemological error of
these people
um they don't believe that there is a
true
uh underlying reality
uh and you know i'm a postmodernist and
and you can say a lot of stuff about
this but but you you can't deny
that there is
that that something like a market cap is
fundamentally real in a company
right like
you you you guys don't understand what a
market cap is
it's just just the number of shares
times the share price right
you don't have to represent a market cap
as shares you you can represent it in a
lot of different ways
but you have this fundamental idea about
what the company
is actually valued at uh regardless of
what you call it and when you build an
institution that reflects
like what the thing is it reflects the
underlying that's an institution that is
aligned with truth and that's an
institution that will grow um when you
try to use the goodwill of the
institutions to push things like this
you you don't get this
you get a weakened institution and
that's the really sad thing
the the really sad thing is is this
isn't going to push climate change stuff
this is going to destroy
uh nasdaq
and
maybe it was inevitable
um but revolutions suck and you don't
want to live through them i don't want
to live through a revolution at least
not this kind of revolution
uh
i don't know some parts of it'll be cool
but i i would rather uh you know i'd
rather not
so that's why that's really why it
upsets me so much
[Music]
a market cap is like kva it's it's not
the the true power
um
you talk about taxing externalities all
you want but that's not taxing
externalities you tax externalities i
think that's generally a good idea
but that's incredibly different
from what that is
taxing externalities is is catalyst
there's nothing not capitalized about
saying hey wait a second uh there's this
clustering i'm accounting for here uh
you know where the government we're
going to account for it that's fine
if you want to do that that's actually
good
but if you do this correctly it can all
be reflected in the existing like true
metrics
let's really let's really try to let's
really try to
i don't know
i'm excited about the new gpus
i listened to listen to martin shkreli's
live stream last night
he was very adult he's very adult good
on squad
jl really reformed
he's out he's out he's in a halfway
house now
colonel open common ink
how do i turn these i o controls into
let's see list of nvidia i o controls
no
gpu direct
actually this might be a universally
good tool if i actually write this
i write something that just you can like
you can ld preload it
and it it sniffs
all of the i o controls that are running
i'll show you how i'll show you how to
write something quickly
uh all right
so let's call it
cuda i octal sniffer because we're not
giving anything clever names anymore
we're done with clever names we're just
calling it cuda iota sniffer uh sniff.c
uh iocdoll we can just copy this with
the need
and you know what we don't need to put
in his folder yet
we'll just put it in cuda example
sniff.c
uh github come ai open pilot
need
let's already see we don't need that
um
so what we're doing here is we're just
going to build a little library that uh
oh my god really
reinterpret cast all right fine we'll
build in the sequence plus
pop out at your party i'm with the gang
it's gonna be a robbery so took your
chain
clang
tiny sniff now he went on he went on
twitch spaces last night twitter spaces
use some undeclared identifier null
which is null and what do i include for
null
c string
uh rtld next
define reference to
all right we don't have main that's
because we have to build a library dash
shared
compile with
uh fpic rename it a dot out
um let's say run.c is just this
called sniff.sl
and then we can run ld preload sniff dot
so dot slash sax pi
ld preload
why can't it be preloaded
cannot open shared object file
great
okay
let's go printf in here
ew who calls it file that's
okay cool so now we're printing out all
the i o controls
um
how many of you are actually going to
nvidia things we could intercept open as
well
or we can just do it with s trace
i really want to link in
you found it
is it this
where is that being defined here we go
all right nvidia ioctal bass magic
you think it actually is this what are
escs
all right well the magic is f
so what is f
70 hex or is it 46 okay fine
so it is 46.
um
and then okay the base is 200 so this is
the number here what's 200 and hex
c8 okay all right all right so that
seems right
uh let's just look up the iowr ioctal
like there's like a way these things
work
type
and our
data type
so this is data type this is the length
of the data
this is the magic and this is the number
so like this c9 is a register fd
and this ce is uh what's e
he's 14 14 minus 86 so this is a alec os
event
okay okay seems pretty sensible
great
um
all right let's let's uh let's link that
in
so builds
link that
let's just add dash eyes
uh that's not what i wanted to include i
want to include nvidia i octal numbers
alright
and the
octal numbers
um
if request and ff
so this is registrar d
if request shift shift eight
uh
equals equals
f
actually we can just call it nv
dialectal magic
don't have magic things
oops
okay you know what let's just let's just
break this out i octdol
i just had it
they're like called something
here we go
nr
type
this is the data type
okay
type equals
requests
[Music]
all right pretty cool right
which one was the other one we were
using
oh ce so e is fourteen so that's plus
six so palak s events
all right all right pretty cool right
so i think these are all nvidia things
but no more of these because these all
start with 200 and they would be like 7c
so okay c8
um
see it's one of them
[Music]
it is a card involved
oh wait this is also c8
how'd that be card info as well
oh
we factory factory
all right uh d7 that's gonna be
[Music]
ca plus that's 15 but no 15.
okay we don't know what that one is
sex should be cisgrams
d2
is
check version string
now we'll just do them all this won't
take too long
os event
free os event
and now we're learning while we do this
it's not a good idea
uh okay
so d2 is 10 so that's check version
string
and we don't have d7 for some reason
it's just not here okay let's figure out
what 2a and 2b are
so this is probably defined in more
places here we go
just the same
what are these ones
it's going in the same place as these i
think
did you find any others
oh
they have to be okay these ones have to
be in there
we can get to parsing them but i won't
understand what these are first
maybe they're just generic i o controls
no
46 okay you see this this is the length
that's a length argument
that first c is read and write we can
figure out how to extract that if we
want to we want to extract that let's
extract that
okay
uh
it's a
13 bit or 14 bit
it can't be bigger than that
see that tells us the length of the
parameters
uh let's add some prints to our
to our sax pie
what
okay well the communication is clearly
not over ioctals
see the problem
oh well i guess okay we did the malik
somewhere else
maybe that's just
maybe that's just to knit
that's actually just calling all the
fancy and knit stuff
okay well it did something for the
mallet but okay these iactyls aren't
actually doing anything which kind of
sucks like what's triggering the launch
nothing
okay how is this thing communicating to
the driver
it's got to be memory mapped i o right
follow nv status rmi octal
hmm
this is just this stuff again
where are the other ones
oh here's more
okay cool
um envy escape
all right all right all right cool cool
well at least we can define a few more
of these so it doesn't hurt uh
where is this in
source nvidia arch and the alec unix
include nv underscore escape.h okay
main ones
escape
good find good find good find
okay
good we have some alec memories we have
some rm alex
um what's 2a
some rm controls
[Music]
oh cool they're all here all right we
have some rm map memory oh that's
exciting that is exciting we love map
memory all right cool look we're like
filling them in one at a time uh we have
vid heap controls
all right do we get them all
oh we still have this one d7 yeah we
just said we're not going to figure out
what that is we have a free
let's sort these a little better
all right cool
great
great we have all the ones except for d7
which we don't know what it is
how come we don't know what d7 is
but bro finding this good job i'm proud
of you all right
um
everyone can talk again
only but only if you say good things
it's gotta be
it is plus 15 right
never mind i hate all of you subscriber
only
uh
just i'm upset like how come i don't
know what that one
check is string
oh here we go it's in numa oh we gotta
get numa okay
um
colonel open and the ayatollah
okay we have them all now
what
that was right
that's d7
no no that has to be d7 don't d7 what
how's that not what that's that one
is it not f or something
yeah but no it's this one i i found it
oh it's because envy linux isn't defined
all right i don't even know how this
built
oh it didn't build oh i see all right
fine it always goes from dash ease on
that bitch all right good we got dashes
i use some undeclared identifier
that's because we didn't define
you know you always waste time thinking
your shit built when it didn't build all
right great uh file not found with angle
use quotes instead
great
problem solved
so it must be using some memory mapped
io stuff
because it's not even in it must be yeah
it must totally be some user space
communication thing because it's not
even in
and i feel like i looked at this before
and found the same thing
so i'm not even sure how we're gonna
debug this
are you doing you want to do gdb
what do you want to do
does anyone have any ideas
if i let non-subscribers talk are you
gonna have any ideas
by the way i see something cool
so we can now lg preload this and like
load up python and we can like import
torch and we can do torch dot zeros dot
cuda and you'll see look it calls all
this stuff
oh that's called vid heap control a lot
this does kind of actually answer the
question i care about which is actually
where's all the memory going all right
let's look at the deep control let's see
what it is
[Music]
bh in the os 2 parameters
here
wow that's a lot of parameters boys
oh it's a union
hate the unions man
function all right so it's a function
alice os descriptor
and i'll call it date i call it arc pity
unknown name
what do i have to include for this
nvls
source common sdk nvidia ink nvls.h
common
so
is there another nvos in here
no
cannot initialize it with an l value of
void p
well because we don't code in loser c we
use c plus plus where types are
respected
oh jump bypasses oh i hate this oh this
is why you don't use switch statements
great
all right is that an i like us
descriptor no it's not it's an alex size
i think
wow
we using ranges
prx data alex size h memory oh this is
so hard where does this alex size come
from
what is alex size
oh it's in here
okay cool
so i think we can just how did
that where's this get allocated
oh it must be something like cac all
right
just gonna bitch at me again and tell me
i can't do that
what if i throw some brackets around
that does that fix it
oh brackets
oh yeah
yeah
right now we're talking we got brackets
yeah
well now i can print things like a
like
type
a s z dot type
okay well the type's always zero that's
good to know
does it have an owner
good owner
you're a negative boy
oh good that's the owner
uh we have flags let's see if we have
flags do you think we got flags
flags are definitely a hex kind of thing
cool we got some flags we got a height
and a width
is this boring
she should have macros to generate this
stuff this is something i love about
python everything's just fast we have a
size
that's pretty good
okay so the size is hex forty thousand
does that match
end times size of float yes it does all
right
okay we found the mallet it's vid heap
control
and this is the other mallet right here
oh look at that bb8 that's a lot why are
you mallocking so much crap
smurfty thank you for gifting subs you
know i appreciate you
look at this
oh look we're allocating 196 megabytes
we found where all the megabytes are
going
oh we're gonna use so many less
megabytes now now that i've found the
megabytes
oh
watch this oh this is cool this is cool
boys look at this look at this
now when we import torch
one of the problems that we were trying
to address with this is the fact that
torch uses so much memory look i'm gonna
make i'm gonna make an array of torches
just one zero this is one pathetic
measly zero i'm gonna copy it to the gpu
and then look
my gpu is using that many gigabytes of
memory
we're using two gigabytes for one zero
what are those two egg crap
it's not even a problem that's only two
megs where's the real max
i can't even scroll back far enough to
see the real mags
let's make let's make a big one
bigger
oh look we had to allocate look at that
we had to allocate when we did zeros
that made 20 megabytes of zeros but why
did we take two gigabytes that is the
question we will answer today
and that really solves my problem
because at comma we bought cheap gpus
and then we have a low memory and i'm
trying to shove lots of you know you'll
see if we're doing
it's psych guys we're actually doing
work for work
um
oh yeah wait but now is it how is it
managing that without doing more let's
make it bigger i can't get out of that
here we go look at that 67 megabytes
oh yes
print torch cuda memory summary got it
but it doesn't tell you where it's using
the memory right
okay you can look allocated memory 64
megabytes yet when i look here it's
using 2.1 gigabytes
i don't even understand
we don't need any of this stuff because
all this stuff is useless no matter the
size
where are the big things that aren't two
megabytes
okay well let's allocate a million two
megabyte things see nobody's looking on
this level you know back in the day
people used to respect the hardware now
nobody respects the hardware because
they're just like we have so much of it
all right well look at that
the first thing this thing decides to do
is allocate
four gigabytes
196 megabytes
just give that back
function alex size okay maybe this is
just a heap
i don't understand how did it allocate
for
what's arm control though
don't you love that we can read this now
and like see
okay
so i'm doing the simplest cuda thing
this must be allocating context all
right let's let's break things up a
little bit
um there's like a cuda init right
by the time i'm using cuda malik this is
actually a pretty high level api there's
two apis to cuda
um this is the cuda rt api but there's
another one the buddha contacts
it's the cuda driver api
uh so we can create a context here
flags no flags oh do i have to really
get the cuda device
yeah probably though
device management
included device get
because i think that's what's actually
going on low level in this driver
i understand
oh i commented that out
ah these things are undefined because we
have to include cootie.h or something
and function main unreferenced oh we
have to link it
okay cool
no no this stuff does anything
does that create context called failing
or something
oh let's read some example code
no it seems okay
i'll have to call coo and knit first
okay cool check it out so now entry
malloc has moved down here
so this is all in the context creation
this is nice all right good
so here we go
getting the device is free all right
when we do the init we're doing this but
i'm sure there's some flag set there
that actually makes it useless
so all those flags are those but if we
go up here look it has different flags i
knew it was fake
so this first allocation is fake
but these other ones are real
and we're going to try to figure out why
okay so let me explain the real problem
um
we have computers at work now we put in
t600s
and the t600s are
uh they don't have that much memory and
i'm trying to load like i'm trying to
have like 12 processes just use them
um
so
kafka is right here it's like my local
machine
i'm trying to have like
yeah a whole bunch of things just use
them
and in order for that to work we forgot
one
we forgot one here
let's figure out which one we forgot
basically
uh the problem is that
we have to use less memory and cuda's
not very good at telling you how it uses
memory on update device
i don't think we forgot one wait that's
a new one
all right
so this allocates 50 mags oh but look it
has different flags
should we figure out what the flags are
does that sound like a good use of time
all right heights and licks are stupid
i didn't even realize that the stream
was going to be this today but this is
actually going to be useful if we can
figure out how to reduce memory usage of
the things
so these calls are being generated by
the cuda runtime
which unfortunately is out of our
control but
an interesting thing
is that the cuda contacts are different
sizes on different gpus
which which makes me think that
uh are you oh you want to do run sh grip
mb yeah we can do that
cool
so now we understand the memory uh
actually let me just add something else
to this
there's a cuda api to get the memory
used
so we can print it out here it's cool to
get them involved
free bite and total bite
i always put some point twos and graphs
otherwise it's offensive
all right good so we have
491 megs free that doesn't sound right
i have a huge gpu
oh no no no no i used
all right he's doing that with an xcrm
control
um we can actually put that before
context creation
but we can put that before mac
oh okay these xcrm controls are not
happening as part of the mallet but
so you see before we even
like right now we're using 213 megs but
before we even do anything with cuda
we've already wasted 200 megs
taylor swift gave an nyu commencement
speech and i was sadly disappointed
you know you guys know i love taylor
swift right i'm a big taylor swift fan
i think she's incredible
i think that she's managed to redefine
herself as many different things i
aspire to be more like taylor swift
listen i'm not i'm not like ironic like
i think actually taylor swift's
incredible
like she sang like country music and
then she sang pop music and then she's
saying like folk music and
um
i just wish taylor swift that you
weren't so serious about your copyright
and we can all listen to your music and
enjoy it together but why do you care
i don't understand why these people care
man
why doesn't taylor swift open source all
her music you know like what's gonna
happen
you're still gonna be a huge celebrity
you're still gonna get paid
so much money
like you just won't make money selling
that it doesn't even make sense
no i don't even get it like taylor this
isn't where you make your money
sell like perfume to young girls get the
swift life back online taylor swift on a
social network called swift life
um
okay
so
what do we want to look into more
but actually i don't really care how the
cuda stuff works i know i promised that
we were going to uh
make that work and we still probably
should but let's look into this rm
control let's see what it is
control sounds good that sounds like
like something serious that we should
understand
all right so here we go we can just go
oh man thank you nvidia this code's
actually super nice i appreciate you
i appreciate you all right
why is that a different nvos oh okay
that's
fine
this goes here
this is an nvos 54 parameters
was that the length maybe
ah
b8 no it's not the length because line's
not 32
that's just unrelated all right cool
envy control device only
i don't understand when my back button
doesn't work do i not have sensitive
side buttons
i do i just don't understand why it
doesn't work all right fine
ah
data size equal size of that here
control with second foe
p args control with second fo oh yes we
love going seven layers deep into crap
let's just look at the type
wow
this is an nvo4 control
all right all right not bad not bad
okay now we can just say like command is
what's a v32
what's a v32
i don't even know
and flags
params no that seems important handles
don't seem to win we can just do it
client
object
command flags all right
uh p i shouldn't call p api how about
just p
p dot h client p dot h object out we
have to draft p
no i don't
know done all right
i don't know if i need to do roughing or
not
we have to be rapid i thought we had to
do right but
i already typed a bunch without it
george how can you not know if you're
gonna do your reference yeah i couldn't
think about it or i could just type
oh cool look these things are objects yo
we're getting objects wait is this
returning me an object or maybe it
returns me an object
don't be an object
um
does it return an object
i forgot looking at the functions was
useless and we just have to look at the
the thing right
you know the thing right
um
i like size you're doing alex eyes yeah
we're doing alex size okay does it
return an object
handle is memory oh that's memory okay
cool
uh
yeah yeah so let's let's move this up
here
run
first
and then
we can print
h memory here
okay
these numbers don't look like these
numbers
oh some of these things are onerous
oh that could be an owner
i see
all right so these things are called
handles
and we don't really know what their
handles to right now
pass these nice commands and let's
donate on that
okay we have client we have the c1 duby
uh i see that that's the same client
used in a lot of places
an object here this must be this must be
the get memory command
um
where are all those listed arm api
deprecated copy out
like we can find out i'm sure we can
figure out somehow that this is a get
used memory command
you can't define through here nv4
control with second flow
so now we have to figure out where this
is set it's a lot of work
here we go we don't use any tls
thread local storage what
here we go
and now we dive into oh
how do i enable that
there's got to just be some way to
enable that
level info
level
how do i enable this
does anyone know how to enable this
probably just some like proc flack
there's got to be some global variable
named level somewhere
can be debug level maybe
no it's not that
you guys see like
if we can just enable that we can get a
lot of great logging for free
whenever you can figure out who would
enable their logs do it
use only an
nv log
i don't know it's not that level okay
it's not a global variable my bad um
if you print f level enabled
oh here nv printf level
that looks global
defined oh
nv printf enabled
how do i just enable the stuff
so usually they have some
oh here we go
i i enabled verbose i thought that would
get it
this says it enables it
is that gated on something
car debug level
all right here we go car debug level
default to maximum debug level
os debug net
always debug set level how do i do this
is that is this where
res man debug level
oh yo
here oh here proc nvidia driver registry
all right
agp man
resman debug level
i mean i feel like maybe i can put in
that mod pro thing
can the reg underscore resman debug
level oh yes
it did already say that it was maximum
oh maximum the other way
okay
all right should we reboot
do we want to reboot or we gonna regret
that
you know what boys we gotta just do it
gotta just reboot let's just make sure i
didn't do it wrong so we want to reboot
again
nv reg resman debug level equals zero if
you google something and you get hits
for it
uh all right cool
bye-bye
let's wait for it to come back
all right well that'd be nice if that
just worked
i'll push this code into a just
this seems like just code
i think i'm driving in la today
can i just unload and reload the module
maybe
i thought you couldn't do that i thought
nvidia didn't support that
oh look at this
look at all this
debug crap
okay
zero might have been too aggressive
debug info
oh that's zero okay nevermind zero is
too much
too much debugging
do you want to try unloading that no
nothing replaces what i've done so far
don't worry about that
gonna see what we get and maybe it'll be
good maybe it won't
the really nice thing about what i've
done is it just works in user space
right so you can just ld preload that
into anything and get all this beautiful
nvidia debugging information right at
the api between the kernel and user
space
here's the thing about the api between
kernel user space it's a real api
so you can't really cheat your way
around it i mean like you can map io but
even mem math gotta go through the
kernel at some point
if you'd like to talk to the world you
must ask the colonel for permission
well actually there's ways to not ask
the colonel for permission and those are
good secrets but
you can like use a
tempest to get out
but it's because you asked the colonel
for permission at some point in your
life well i didn't need to do that
okay
ah wait what
there's still too much crap
didn't even change anything did that
even work
where's man debug level equals one
it's got to be some live way to change
this stuff
nope i don't think so
okay
why is it called close a bajillion times
look at all this debugging stuff it's
too much
you know what those are
envy alec pages okay that goes real low
level
this doesn't have the thing that i want
opening gpu with minor
just not even useful
this is not even the thing that i wanted
what is resman anyway
let's see what other nv reg options we
have
this is junk
i liked my stuff better
how come it didn't print the one thing
that i wanted
which was the control thing
oh we have to go back through this
because i didn't save where it was
or maybe i control second photo this why
didn't it print this how come you don't
see that anywhere
the level is info which is one
it's not this
sorry
didn't print this and i wanted it to so
this must be a different thing
envy printf
for some reason it's mv print fx but
this should like be fine
module level format and vrm print
function
nv debug printf okay
fine fine right
debug level here
nv debug level to platform a port debug
what's that
poor debug
is this a different debug
which one did i add
i will briefly try to reload the module
um that's res man debug what about port
debug port debug
pbog
level
okay sensitive
no just resman debug
didn't even print the one thing i wanted
which was this
mvrm trace api how do i use this
okay well it's not a unit test so it's
nv debug printf
we're back to this thing here's debug
level okay
envy debug level to
platform level
b force
oh
wait
this just sat somewhere else
okay we might just have to rebuild it
this thing doesn't even matter
i don't even like this thing does
comment work in there
i hope comment works
oh this is
okay
don't you love open source though we can
just rebuild it let's go ah build
open gpu kernel modules
um
source nvidia ink
libraries
envy log
log
f
all right
um
it doesn't seem like this is defined
anywhere else is it
i don't think so all right let's enable
this and let's enable one
make modules
j
hmm
hmm
okay
doesn't work
kernel open nvidia nv reg
oh here we go here's res man debug level
but that's not the one we want
i think it's actually just not compiled
it's the error
envy log print id
we just didn't enable it right because i
think it's broken you think it is
it's all the same bug
okay
and not defined envy log parsing
i think we want that
maybe log print id
what is this supposed to be
zero undeclared where is it getting zero
oh
oh is the problem that the level has to
be
it's also failing with one it's not just
zero
maybe it is just zero all right let's
let's try and be log level zero
it doesn't work
same issue
uh
uh
okay it builds if i turn it off and it
doesn't build if i turn it back on
let's google it let's see if anyone's
had this before nv log enabled nope
absolutely nobody's ever googled it
before
if zero most of envy log will be
compiled out
nv log print id 0 not defined
why not
let's find out the compile is being
compiled for the parser on
all right well this is this is an envy
printf okay we are we are when we get
this to work none of this is actually
built into the driver
actually we can even confirm that you
want to confirm it's not being built
into the driver
we can go
uh what is it lib modules
modules
kernel modules
i don't know how this works fine
grabbing video
here
string star graph
we'll see if this is actually being
compiled out
no it's not
it is in here
who's that right
yeah paranormal size that's right
so i don't know
oh we had to build it with that verbose
equals
we built it no sorry we built it with
debug equals one
i did build it with debug equals 1 right
or did i build it with nv verbose equals
1.
that's unrelated
okay so that should have built it
yeah okay it's still there
this also enables various debug log
messages in the kernel modules
let's figure out what that debug flag
does
let's read the makefile
why are all the first-time chatters ask
the stupidest questions
on debug
nvm logger
why do you guys come in and think it's
funny to act like an idiot you know
why are you here
go home
goober never went home
all right
here we go if eq debug equals one
if eq debug equals one okay
great it builds uncompiled chat
and sets strip command equal to true you
get it it's funny
um because yeah all right
envy separate debug info no
i don't
know all right envy printf
do nv
log printf or nv printf string
nvrm printf function
which has to have nvrm defined
which i don't know if we define that
rm always has
nv debug printf we're here again here
if nv debug print message
debug level minimum
oh
then it will print
error notice
always level notice what level is notice
level notice is two
you wanna just hack something i have an
idea
if we just change that
let's figure out where debug level man
is actually generally fine
uh debug level
here
[Music]
bug level less than debug level min
hide
message is filtered by an explicit rm
you want to see some let me just hack
that if i just change that to
all right if this doesn't work then i
don't care about this api anymore
notice so change notice to info does
this work
so
oh we made tiny voice work and you saw
the working tiny voice but now we're
looking into nvidia open source drivers
hello
all right
um
are we chanting log levels yeah we're
chanting let's
go all right
um
twitch cuda example
d message oh oh those look like a lot of
good i don't know
no none of it outputted as shit all
right never mind that didn't work
that didn't work
i'm just frustrated because there's
there's good debugging information and
we just need to get it
all right
message is filtered by an explicit rm
message rule
oh my god this is so complicated
how do i set these rules where do these
rules even come from
default to everything where does this
come from
handle the normal case quickly
where's rm message come from
buffer to store rm message string
this is stored in bss so it can be
uploaded in the debugger okay
override priority of printf oh look at
this oh yo yo yo yo we figured it out
enable all print apps we just gotta
throw a colon in here
how do i set this
os read registry string rm message oh
only for builds with printf enabled okay
okay we're gonna try one more thing
well first off that didn't do anything
so
get oh okay what do i want history
make modules debug sudo make modules
install
and then sudo that
mod but
the real thing that we want to do
don't worry this is all going to be
worth it because we're going to get the
best stuff you know if you have seven
hours to chop down a tree you spend the
first five sharpening your axe all right
so i don't know what res man is but if i
said rm message to quote
i think this is it
we're going to be very happy with this
choice
yeah okay quote all right
last reboot all right let's try to
figure out how to unload the module
reloading
nvidia driver module it doesn't work
reset driver without rebooting pseudo rm
modern video this guy tried
um
no i tell you it doesn't work
many kernel modules can indeed be
reloaded but this does not apply to
graphics drivers good thing i'm not
streaming on that computer
they push like 500 functions into the
firmware before open sourcing the driver
but to be fair
like
you want to have as little as possible
in your kernel right you don't want to
push it in your currently you'd really
much rather be in user space um so i
don't really blame them for that like if
you can push it into the into the the
the
driver do it but the real thing i want
what is that thing called the gsp
is it the gsp
yeah yeah yeah whoa
the gsp is the future all right listen i
bet there's a way to like boot linux on
the gsp
uh and then you could have linux running
on your gpu and you can just have a
computer that's a gpu think about how
crazy that is and it's risk five
all right did we get the messages oh
look at those messages oh these are the
nicest messages i've ever seen
oh was that not was that worth it or
what oh look at how nice those messages
are
uh
twitch
spy
look at how much better these are than
the other ones
all right
here we go
these are the arm oh never mind these
are equally useless
i was excited about them but then i read
them and they're useless but we figured
out how to enable what we wanted to
enable because this is the thing that we
were targeting
but like great okay don't tell me what
the command is great i had that same
crap for mine why would i waste time
with this
why did i waste time with us
i gotta eat food i'm hungry
alex we need food
you learn more through failing that's
true
does it use more memory to enable this
stuff i feel like it does
complete gmmu walk cb copy entries
the other really nice thing about these
injectable things is like these are
prints from the program so we can like
look at what the program is doing
all right should we try to figure out
what these commands are it seems kind of
useful
what are these objects
is there ways to like dump this stuff
alec with second foe
can i do the alec the rm api
oh those
oh okay we have alex here
all right let's let's parse this alec
okay
uh
we have two kinds
we have the p api and the p api access
let's just add the current parts this
quickly
these are
nvs21 parameters
wait how did i get 21s
oh no that's alec memory this is just
alec
not to be confused with alec memory
which is another one that we're using
frequently
should we parse alec or alec memory
we'll do them both at the same time
all right alec memory uses this thing
is it this thing
ioctal what
oh it includes an fd
this is a rapper
rappers
rm api deprecated with second phone
oh well if it's deprecated definitely
don't want to use it
it might go away
each route
limit stat
does this look like an alec memory call
to you
p memory
limit
h root
what are these things
i don't know let's just print the h root
p memory
limit
what's limit
flag status
let's print p memory and limit
it's a pointer
that's what p stands for right
[Music]
well it's the same thing that it's the
same owner as this
memory
all right let's go back to par saying rm
alec you can understand it
oh it's like the same crap
alec params
oh if you like rights
parent handle class nom
alec params i hate all these things are
useless let's register fd
this is a
lock rm api it's already a control fd
registered
get the file release the api lock
they seem to be in the source go up for
the command tax codes okay
they're not
just 84 maybe
84's could that be
oh a surprising amount
well we just figure out okay should we
go back to arm control
control second fall
control second fall
[Music]
oh generated
is that these things
are these method ids the things
you like this one you're saying oh here
we go
gpu get
virtualization mode or maybe the 20 is
extra maybe i just do this
no not this one
no not this one okay
check out where this is used
nowhere
finn
there's also some here
whoa
it's a lot of stuff
so complicated how are we ever gonna run
you know what we're not even up to
running anything because running
anything somehow does it through a
magical mm-io
the only way we're gonna get that is
with uh
with gdb
cgdb add breakpoint
how do i like how do i like build
something so it has a trap
uh c
function gdb trap
raise exception
does anyone know how to do this
this should be a very easy thing right
i just to like i want to
stop right here
you know i can do something stupid like
this
okay pid is not defined
what where's get pid defined
well if i if i do this a uni std
uh
we can do
gp
now we can do break
on get
okay
oh i think that's actually never mind
it's using get pid
built-in trap
oh is that what i want
hmm illegal instruction okay gdb sex buy
sigil illegal instruction
no no i can't resume from the trap
we have to be able to resume from the
trap
we can always just call a stupid
function like nobody would ever call a
to i
that one's instead live right
oops
nope that didn't work
changing rip okay
the built-in trap was the closest i've
seen
here to have bought abort the program oh
add built-in break
is the optimizer
you want is built-in breakpoint
debug break uh oh
looks like a microsoft only shit
debug break is undefined
linux
it's our portable equivalent raise sig
trap oh we just gotta raise a sig trap
and include signal.h
oh yeah we can just raise any kind of
stupid right that should work
it's a trap
okay cool
yeah it hasn't been three
well actually if i do as i'm in three
what i really want is something that'll
run normally if a debugger is not
attached and then if a debugger is
attached
yeah okay never mind
do the semicolon
run
okay
um oh yo yo let's throw some g's on that
i need a g you know g
got to put a g in there
it's supposed to be
turning 21.
okay
dim three shit
dim 3
cuda push call configuration
p thread once cuda rt oh look at this
stuff
what are these things
this must be what's actually like
gdp macro
print all function calls
no
trace function calls using gdb all
right
oh no you gotta do it on each function
that's terrible
if you can guess the page and unmap it
oh i can trap on the eye oh oh i see
what you're saying
we could do that
all right so let's just like document
this
why is amd so reluctant
you know we have this thing at comma
where it's like i want you to put
yourself in the shoes of a company right
um well here's one hypothesis is because
amd is evil and hates you here's another
hypothesis because it's really hard and
they've done the math and it's not worth
it
which of these do you think is more true
wow 5 30 takes a long time
thanks nvidia you really gave these
great useful names oh this is inside
that
i want to put myself into the shoes of a
soulless entity
if you weren't a subscriber you'd be
banned
corporations are people my friend and
people have souls
mitt romney lied to you
i'm drinking coffee because i'm hungry
what can i say can i say return
no no that returns now how do i
jump to the end of the function step to
end of function
one day i'll learn how to use gdp finish
[Music]
finish
finish
oh no i finished too much
oh here we go
device dub
oh
this might be a real thing
how do we okay you know what let's just
try to use the built-in debugging stuff
nvcc
uh debug c
mvcc dashboard
man mvcc
no manual help
there's a way to just like generate c
code is there not
device debug
let me see
all right i just wanted to you see that
temp file that it printed
here we go keep
don't work
where's this
oh maybe it maybe went in this directory
now oh look at that
uh oh
okay get a net get add sniff.cc
sax pie dot co
run
hit command good
it's a new computer i told you
okay
um
wow
here we go
push call configuration
and now we found out where it is
it's here
device functions
here's
saks pi is not even here
this is like the data cool
that's an ii file
not something we want
all right we're in cuda fe stuff okay
we're in device dub
okay here we go look at that
kudo launch
[Music]
you can probably like write out the
stuff manually and then figure out
what's going on
now the problem is this includes all the
uh
all right first let's let's make this
less ugly and not print everything
everywhere
[Music]
no i can't do dot star
s trace is what
just remove all this crap
cool
um
let's
cd
build
thank you thank you
uh
bills and this just rebuilds
pie
okay cool
i'm gonna get ignore
oh we don't need this satisfy anymore
get ignore uh you know what let's put
sniff.so and build as well
should we call it out
without a more appropriate thing to call
it yeah probably
ah we can get ignore everything in out
get rm build
run
great
all this stuff and build
terrible
what's a ptx file
okay this is what it actually this is
the cuda assembly file
cool project to trace a function call
[Music]
hmm
i mean regardless we don't actually need
this right now because we found out
where the missing stuff was
i don't even need gdb anymore i can get
rid of this sig trap this is stupid
so the stuff that's being run
is
what's cuda effie
kudo language front
so nvcc is like a full tool train and
there's actually a lot of open source
parts in it too
save temps is an alias of
it's just so big
we're really sm 52
it's not the latest we can get newer
ones
so what's getting transferred to the gpu
is kind of my question
look at this
no i found like a
that's a kuben
it's a fat bitch
useless
so
uh
all right i gotta i gotta make some food
i'm gonna make up some i'm gonna make
some tortellinis
uh maybe we'll take like a
20 minute break 15 minute break
a little quick break and then we'll come
back to this
all right
talk about two jets ptx and not ptx
all right so what we're going to do
we're trying to basically figure out how
to
uh launch an nvidia program without
requiring any cuda user space so we can
just directly use the uh
but we're linking to the kuda user space
actually i should be able to
there should be some like verbose things
that i could pass to nvcc
verbose yeah cool
all right so we see what's actually
happening here um
turning saks
pi
is this really what it does
i don't know what c i c c is
not anything i have
[Music]
what are you
it's the jankiest program all right
we do the
tax ass i actually know what that one is
that's an assembler
um we create the fat bin
use this with crappy includes
and then this is what finally builds the
thing
those are the things that we have to
replace what is cuda rt
useless
me cook or go get
me cook or go get
uh tap and hold recorders and audio
i was going to
pause streaming for a little bit
and make myself some leanies
okay
give me a little bit we're gonna we're
gonna come back
in in uh
in 15 minutes after i made some food
and then we're gonna get to the bottom
of this wait let's um let's allow
everybody to talk for a minute and let's
see does everybody understand what we're
doing in this stream
not everybody but the people who aren't
idiots
you missed a start
we compiled the
fix the rattling sound what's rattling
you don't know what a pointer is oh bro
bro you gotta know what a pointer is
please watch this segment to understand
what is this segment
yo this is so meta we're watching my
stream on my stream
we're going to try to figure out what
these i o control okay
we have a goal for the stream let's
discuss our goal for this
our goal for this stream is going to be
to do a cuda operation
yeah
so instead of using all of nvidia's
stupid drivers we're going to try
to not use the drivers
and we're going to try
to wow
yeah
wow that guy that guy makes so much
sense when he talks
no we're not trying to make any no we're
trying to like get to the bottom of what
cuda's actually doing
so then we because when you understand
every part of the stack
all of the problems
you can debug
like now i know that my ram is getting
allocated on vid heat control
oh we can we can go even crazier with
this so like actually i really like that
i have this tool i'm gonna start using
it at work let's just improve this tool
a little bit more first
i don't care that much about the launch
right now
um
if you can read this code here this is
saks paiku should i push let me push
this somewhere
uh okay kuda example's a terrible name
we're going to rename it to cuda
uh by octal sniffer
all right and this isn't called tiny
because this is actually a useful
project
um
this can be snipped out so we can just
get rmd
git ignore
uh we can get ignore
this and all the swaps
28 to learn light to learn to call you
about your life's over
bro if you don't have 50 years of
reverse engineering experience by the
time you're 20 oh you're done you're
done
uh bro we're not hacking nvidia they
open source this for us
uh all right we're gonna have to let me
create i'll do it off i'll do it off
stream quickly and create a repo oh
okay we have one more thing that we
wanted to discuss
all right so like i have this blog and a
lot of people on hacker news like to
like to uh
like to read my blog and they like to
hate on my blog all right
so this is my blog it's very short i
just had a nice conversation at work
talking about how i think our you know
estimate for the flops of the brain
might be kind of high
because when you stop looking at the
brain as it is firing every neuron all
the time the brain is actually
incredibly sparse and you can measure it
by firing events instead of by total
compute complexity right
so i assumed that each synapse was
basically uh basically a multiply
accumulate right so the neuron is like
the accumulator the synapses have
weights and they're all multipliers so
each synapse is doing a multiply neuron
does accumulate this is the basic model
of what a synapse in an rnr is it
exactly biologically correct no of
course not but i think it approximates
the compute um it might be off by a
factor of 10 but i would be shocked if
it's off by a factor of 100.
now that's these people
these people
lots of assumptions here like for
example this human neurons are not built
like we build the artificial neural
networks
they have a complex time-based behavior
memory and dendrites are quite complex
okay this this this comment's okay
actually these comments are okay but
then then you have these comments the
hater comments
geohot is a good example of a smart guy
falling for the old map and territory
fallacy we all use simplified models
like like
stefcint13
the fuck is this man
like
i think he likes the attention and knows
many of his claims are half baked but
yet i think he can do better i don't
think flops is the adequate network for
enabling how close we are to
the number of neurons firing doesn't
matter but it matters how they're all
connected i personally think when we get
adequate algorithms and data structures
out there they've switched a number of
lookup operations okay okay so you think
it's ram right fine great
i believe that we are yet to observe how
interconnections within braymond i see
it's all just like where's your blog
with your theories on it you don't have
a blog with your theories on it
that's what i mean
the architecture doesn't matter what are
you talking about the belief is just
brain stimulation made of nodes and
links is cringe man
like like like oh yeah yeah
okay you know what these comments have
sent me less now that i'm rereading them
maybe all like the haters yet all really
did get down voted wait did he mean that
seriously to me this reads like satire
about extrapolation
what no it's a real it's a real claim
bro it's a real claim
it's so much easier to tear someone else
down to make your own thing that should
be the slogan of hacker news hang on so
i'm just gonna i'm just gonna go and
edit hacker news here because i'm making
my own thing here
uh
yeah yeah
this is hard
don't know how to use this
it's like in like phone emulation mode
or something like i was testing stuff
here we go this that's big okay cool
uh
hater news all right
it's hater news man we you changed it
why is it
hater
news is too hard
never mind but the more of the story is
you should engage
if you think that i'm wrong
instead of telling me i'm wrong
you've got to give the correct answer
too because
i did put maybe here
it's maybe i don't know maybe i'm wrong
maybe i'm right as you can see at the
bottom of my blog it says a home for
poorly researched ideas that i find
myself repeating a lot anyway
uh so
but no that's probably right so there's
that all right good uh and then also i'm
gonna respond quickly to comments
let's let's look on comments let's see
if anyone wrote any good comments
uh
thank you
thank you oh software development's a
category on switch twitch i heard about
that we don't need a language model we
just need more data oh oh guys should we
use this should we use this so i'm
hungry i gotta eat food
um
my rant about haters wasn't very good
i'm sorry i apologize for my my bad rant
about haters there weren't that many
haters i'm glad that you all liked my
blog post and you always remember that
everybody who comments on the internet
is mentally ill now think about it think
about it think about it do you comment
on the internet and i know that
everybody who says yes and chat is going
to be like yes i comment on the internet
and you also speak in chat but 95 of the
internet doesn't comment and they're the
same ones
everybody who comments has mental
illness so we think that the world's so
mentally ill we think that there's all
these crazy people out there there's all
these people on twitter talking all this
crazy shit man but then there's lots of
normal people like me who quit twitter
when they realized that it was talk
successful i would never post on social
media ever
all right i'll be back in 15 minutes
uh should we just put uh let's just go
like this this and this
okay well you can hear me but you can't
see me haha
we're gonna put uh text up and we're
gonna call a text
be
right back
properties for be right back it's
helvetica
oh no i think i set the color to the
wrong thing
select font
i have an idea
let's just do this
and then we'll open up visual studio
code
and then we'll write be right back
here
and we'll make it big
and we'll close this
making
tortolini
beanie
is that right oh no i don't want to save
it
let's see if i spelt tortellini right i
don't think i did
oh yeah perfect yeah
okay
be right back
did you have a nice time debating about
whether i was on drugs
okay so
we made yogurt instead the tortellini is
coming
[Music]
oh i said i was gonna push this to get
i'm sorry i didn't do that
do
cool
guys
it doesn't matter what editor you use it
doesn't matter what keyboard you use
you either have skills or you don't
you could give me a dvorak keyboard and
the shittiest most broken emacs
and i will still code better than you
because it doesn't have to do with those
things
and everyone who focuses on those things
is a noob
and by you i don't mean you
all of you i mean everybody who's asking
about keyboards and editors
[Music]
all i found was
[Music]
hmm
[Music]
hmm
it's not the skateboard it's the skater
that's very true you could give me the
nicest two thousand dollar skateboard
you can put tony hawk on a mongoose from
toys r us skate circles around me
okay
so where were we in
i did like at least having
what was that thing called
go to push call configuration
oh
[Music]
where'd you do this
it's going to be a loud or just going to
complain
i understand how this error works what
is it checking
what does this program do
oh it multiplies that by two and then
adds it to that okay so it should be
four fine
error our global function call must be
configured
so
i think it's just not generating the
stub if i don't do that
okay is everyone familiar with some cuda
syntax to understand how this works
this is like the launch of your thread
group that's actually calling uh
who to push call configuration and
that's calling the function
and where is that function actually it's
a stub here
yeah okay this probably seems right
all right this is calling device dub
let's see if we can
let's see if we can check it either this
is going to work
let's say if false
now but the compiler is going to
optimize and be smart
so we have to find some false that it
will never understand like if arg c is
greater than 99
part c is undefined
device stub is undefined okay
let's let's uh
[Music]
let's throw an extern on there
right
great that still worked
okay cool
uh using
stubs or
not subs no i love you guys
okay great
so now we're calling into this device
stub that's pretty nice and that name
looks somewhat stable i don't exactly
understand what it does
but all right so the stub is here and
now we can copy out what it's actually
doing
this is nice
it's moist as delicious as tortellini's
okay
so instead of calling device dub what if
we go into cuda launch prologue
kudos setup are simple
who to launch
oh my problem is i don't know what sax
pie that is it might be a different one
uh so we don't actually want par zero
here because it's just what's being
passed in so we can just
see what i'm doing
and 2.0
dx so this is this is like just breaking
it down to not use a stub
uh okay these things are undefined
where is this defined does it define
anywhere it has to be defined somewhere
right
uh includes crt host runtime
hmm
what
don't tell me it's a lo
don't tell me that
i want to use it directly
still undefined eh
not defined eh
from cool to push call configuration was
defined
you guys being useful
crt host runtime
is that not the one i included that's
what i included
i don't get it i included it
um why is this not working
easy to find this too
okay okay that's a better error
it's upset ah okay i see what it's upset
by
so let's just call it float par one it's
upset because i tried to pass in
great
okay now we have some redefinitions
that's
a different problem
um
i really don't understand
there's not include guard on that file
the only problem now is that identifier
direct is undefined so we can gcc
dot slash direct
let's
see it
um crt host run times not defined
that's fine i just need to do this
um where's that
i think
trying to include like normal cuda
oh no there's got to be c plus plaza
cuda error t is not defined all right
where is that defined
it could be defined in a million things
kudo runtime.h
okay that's less bugs
f abs is not defined
[Music]
okay we're down to only one page of
errors mem copies not defined copies
instead
c-step
no it's not it's defined with c string
okay n was not declared in the scope
that's totally fine
because we made up n
uh
who to push call confirm oh we need to
pass in the xdy in chat
get rid of that get rid of that get rid
of that get rid of that direct
don't just watch tv direct tv
i love ad slogans all right sax pie
wasn't defined
that is okay
uh we do have to figure out where this
thing is defined
it's in device functions crt
um
that didn't work
if
not defined if daf cuda cc all right we
need that
a lot of oh
that might be the only problem that i
find we just need to define sax pie
extern void star saxophone
and if our direct is not defined uh
oh these are pointers
all right all right all right hillary
clinton was brought up you get
subscriber only chat
and it's just what happens
identifier printf is undefined
i don't know what happened to that
okay
okay okay okay now we just need to add
in
direct dot up
okay
we just have undefined reference to sax
pineapple
and that's because it's probably called
some stupid season
no
maybe it's just this
am i just linking to the stop
no i can't be linking to the stuff that
doesn't really make sense
undefined reference
m
is it this
i don't know what is c plus plus fill
this is passing in sax pie here where is
this sax pie coming from
is it that
it can't be the thing with device stuff
um
wait
saxophone oh my god that's a different
problem
undefined reference to direct
is this what doesn't work
why is it an undefined reference i don't
get it i link to it
oh did it not link in the final step
oh
i'm talking my mouth open like a savage
no
direct is included there
yeah subs are way better people
okay
i have direct.o
oh it's just okay the problem is it's
yeah
um
and define reference
oh
the problem might not have even been
external c it might have just been ah
there we go done great
okay notice how it says max error zero
let's just count that out and confirm
that the max error is actually high
alright max r2 great
cool it works
direct tv
visas down you can't sub anymore
who broke visa
was it crypto did crypto break lisa not
yet
um all right sweet
so that's pretty good that's actually
pretty low level now
well i guess we do have a question of
like what actually is saks by being
passed into cuda launch
cuda launch barracuda what
that's pretty that's pretty low level
all right what if we like break it we
set the cuda launch prologue to three
stack smashing detective don't do that
cuda push call configuration cuda launch
prologue
cuda set up args simple
and then cuda launch
with a cast
do i need this cast
that's simpler cast
okay so let's figure out what sax pie is
it's c standard end
not a thing
[Music]
how many times i've typed out hex dump
in my life
that's pretty nice
okay cool
so that's the program
that's what's actually in sax pie
uh let's see if that's the low-level
stuff is that the ptx ptx is not no no
but uh we do want coupon
no that's an l file
so what is this
hmm
maybe it's a section of this one
uh what's the fat then
no
what is that what is this stuff
what's being sent into cuda launch i
don't know maybe the header gives us
some clue
oh
it's a macro
look at this macro
oh it's actually just calling cuda
launch colonel
that's not exciting
we could have just called cuda launch
kernel ourselves
wait
what a scam
we actually totally could have just
called that ourself
this is stupid and not low level
they just popped the call configuration
off the stack here
stupid
stupid waste of time
args idx is
zero
then do that which is basically the same
thing as i don't know
does this just work
the font was not declared in this scope
yeah because we've got your sacs by
great
so it turns out we didn't need any of
this
and we actually just could have
i don't know where args are comes from
where does that come from
it's just some like universe it's some
global shit
what size
this was stupid
it actually just calls cuda launch
kernel
and we just could have called cuda
launch kernel here and not wasted
anybody's time
here i thought i was getting some low
level deep stuff but in reality
i'm not getting shit because i just
could have done this
so
great
what do i use the time
but i guess it does show you how cool it
is and how cuda's internal stuff works
all right but now what's inside cuda
launch colonel
i don't know
what actually is sax pie
this doesn't tell me anything about what
this argument was
so
okay
um
do you see why we got scammed there
like we did all this stuff and it's
actually just in like user space code
that we generate so we just could have
used cuda launch kernel the whole time
but now how do we go lower level than
cuda launch kernel
and i think that this might be where the
reverse engineering starts
yeah i know don't you love these names
cuda rt616
six five six
no but there is no more i o controls
there's no i o controls i'll show you
like here is uh here is using stubs for
launch right
and then here is xmm copy like it
doesn't do anything
how are there zero search results i
don't know you want to try duck
oh i knew nvidia was paying to censor it
that's sketchy what did that do that
download something
i don't know
why have they open-sourced this because
their stock price is going down we
already covered this
no they open sourced i don't know i mean
there's probably pressure inside nvidia
maybe we can all thank lapses thank you
lapses
by the way
shout out to laughs this look man
the hacking groups that go around being
dicks and like uh
you know stealing don't don't steal user
information like this is dick man you're
just screwing over your neighbor but
if you want to hack into large companies
and dump large troves of their ip on the
internet look man look
i'm not going to encourage you
but you know think about who you're
really
uh getting here right right think about
who you're it's not the engineers it's
not the average people it's the lawyers
and you know look hey man
um
i think this is going to end badly for
nvidia no way
if nvidia doesn't nerf their gpus and
nvidia continues down this path of open
source
they will dominate the ai space until
the singularity
i hope jensen understands this
like
there is no reason nvidia should lose
nvidia will only lose if they shoot
themselves in the foot
i know they already dominate the ai
space
there's a lot of people who are itching
to get at them and if what nvidia does
is like kind of make everything closed
source and charge ten thousand dollars
for it
then
you're gonna get people who catch you
but if you open source things and you
sell things for cheap
nobody can catch you ever
okay so we still don't know how this
works um it's gotta be something that's
mapped in the process okay here's an
idea
there's gotta be mem map calls right
i don't know
i mean you want you wanna okay
you wanna get down to the levels with
gdp
who's kira
does kira work
i feel like cure doesn't work at all but
cure is really what i want here
i'm sure cure doesn't work
my janky install scripts
oh there's no way this works
so janky
come on
oh my god no it's installing python27
it's setting up python is python 2. i
regret this already
this is not gonna work
yeah i think open sourcing and launching
agx killed at least five
wait
agx
no it didn't work and now python is
python 2.
i regret trying to use kira
yeah i think the device i actually can
actually that's a good point
yo i'm doing this in user space
no my point is like right now i'm in
unprivileged user space process
what what what can we do with this
exploit i'm sure there's a billion
exploits in this thing
oh no these things are stupid these
things are stupid
no one wants those
nvidia's mobile division is is fucked
they won't sell me chips like it's just
as fucked
there's until nvidia puts the chips on
digikey that they're not serious about
mobile
put the chips on digikey charge a
reasonable markup on them open source
all the data sheets and you'll win
mobile too
but we'll switch we'll switch i'll
switch off qualcomm i'll switch to a
video but you got to make your chips
available
and you got to make me believe you gotta
make them available for a few years
uh because no one's known no one
believes you
no one takes you seriously
uh when if you like gonna put one chip
because it's gonna you're gonna
deprecate it
um
all right we're gonna we're gonna go
into gdb here
the pricing yeah
okay gdb step by print instruction
oh
[Music]
we do have cuda gdb also
i don't know if it's going to help
kind of dumb
what is pthread once
some mutex thing
um
now now we're in lib cuda so we're not
even in
wait
but how did it call from that to that
what functions are exported from here
no symbols
oh
just this
no symbols why don't you have cymbals
i see symbols
yeah they're symbols i don't know why nm
didn't find them
okay there is some lower level thing
that's being called into right here
i don't understand why gdp doesn't have
a symbol for it
yeah okay this is just the lower level
there's like a normal lower level one
that i think that's documented still
yeah yeah because okay we didn't if we
did cool to launch kernel we don't want
google launch card we want to use the uh
we need something that passes in at
least a uh a context in a device
so it's gonna be something like cool
launch kernel
here cool launch grid async here we go
this is the stuff that matters execution
control here we go
here cool launch kernel
um
i'm not sure that that's actually a
function but okay let's let's try to
replace it with that
sax pie
uh grid dim x
block zero zero
red zero zero
shared membites
actually what if i just do
here we go
we're cool launch kernel
uh what's the api what's the abi
info registers
uh
um i'm such a noob
x64 abi
you think i'd know this by now you know
is this even only the linux one
okay integer arguments one through six
so it's rdi
rdi
which is this okay
oh see this is different okay this isn't
the function
yeah we're gonna have to we're gonna
have to get a coup function but that
shouldn't be too bad okay
uh and then we have rsi
oh maybe that is that
is that 1 000 yeah probably
ah two zeros
oh they're ones oh they're not okay
they're not zeros that's obvious
this is just like the normal
this is the normal api still we haven't
even gotten lower level you know
sometimes people are premature to
reverse engineer and you don't need to
be premature and reverse engineer
because a lot of things are actually
just documented for you you just need to
know where to look
you know all right access what's on the
stack uh rrsp
gx okay
um
one
okay it looks like shared memory is zero
okay each stream
so is that a coup stream do we have a
coupe stream
no we don't have a crew stream can i do
that
zero can i pass in args here
and then pass in null
it'll just work
okay we have to we have to get the ku
function there's got to be an api for
that
ah cool function
we might have to do crew stream creating
stuff
that's not a big deal if we do
so first off we don't even need this
direct stuff anymore let's just get rid
of that
any of this
we do need cool functional
what returns a cool function has anyone
figured it out
oh you can use cool module get function
all right great right now i just need a
coup module
um i'm looking in the module
cool function
saks pi
module get function
saks pi we're just gonna need a coup
module now the name is sax pi
where do i get a cool module from
cool module load
crew module load
fat binary oh okay well
cool
module mod
who module load fat binary mod
um
we have the fat binary do we not there's
a fatty's at
that is raw fatty sorry fat bin
what's the name of this thing
uh fat bin data fat in c wrapper
fat bin section fact in data
is it this
no
i fixed that
oh i don't care about building direct
anymore
ratios i'm defined that's fine i got a
ratio of these fuckers
all right well we don't actually need a
module let's just throw zero in there
zero
didn't work well all right
um
cool module get global turn a global
pointer from the module no coup module
load
file name of module to load there's got
to be examples of this online
oh i'm trying to load the current binary
ah here we go
fine kubin offset wow this is hard
oh this is so difficult
oh we have to get the z
function 77.
that doesn't work
but maybe that actually
oh no it's just 77 because i didn't set
it to zero
okay it doesn't work
um
why is it so hard
uh aligning to byte sequence okay
okay here it is here here's here's this
we found this
so we actually do need this
fat bin data
how does that work
fat bin data is undefined um
conflicting definition
okay it still doesn't work but it feels
like progress
maybe it doesn't work cause the name is
wrong
[Music]
oh
there's a diagram
which diagram oh here we go
all right this is somewhat useful um
okay good
cool works it just worked
the reason i know it worked just because
the max are zero now great
okay
good progress good progress
all right now we are really low level
it's hard to get lower level than this
and there's still
you don't need any more this direct
stuff get rm rmdirect.cc
get rm dash after ipcc
[Music]
okay and now we're still at cool launch
kernel
i don't think it goes lower level than
this i think this is actually
at the lowest level we are in
uh lib cuda
all right
gdb o'clock
gdb out saxby
um how do i get that other view back up
of course gd doesn't have a working up
arrow
layout asmr
all right we're getting specific on the
p thread
oh
oh yeah yeah you know what risk
architecture is going to change
everything
what is this doing
i just want kira man
just make her work
[Music]
what i think here were oh cure is still
an old python it's not even in python
kind of like printing stuff
oh
cara's not even in python
three someone's gotta write good kira
kira has the oldest javascript
well remember when i was a shell for
python 2 i regret everything
i regret everything
[Music]
all right great
guys i gotta go to la later i can't just
do this all day
i want to just do this all day but i
can't
you got it installed um
what does cu launch kernel do
like it's not talking to the kernel
oh
okay it is somewhat talking to the
kernel
because it's caching some stuff here
was it always doing that
that doesn't even exist anymore
let's move
that can all stay
this is stupid i'm just going to copy
and paste this
get rid of blocks put that there
the threads put that there
those can go those are actually needed
this stuff can all go
that function
huh
you know it's interesting
so this is actually still
dealing with the compute cache
that's so this is going to be in lib
cuda then
uh where is libku.com
would look cool
yeah okay
that's interesting
there's still a lot going on
oh no it's not in launch anymore
moved up to here
hello
[Music]
we've considered fixing kira
the cure was so good
how am i gonna figure out what what kudo
launch kernel actually does
okay regardless i'm confident we can
save a lot of money
when is that thing getting copied into
the gpu
and that function
all right um
um
i'll put stream on pause
for one minute to discuss logistics oh
we have a lot of people here right now
all right
yeah yeah i gotta go to i gotta go to la
soon unfortunately so yeah i have to
leave you guys
and uh
you know it's very it's very sad oh
because we know we're not going to solve
the mystery today
you know
i want to solve the mystery let's see
oh
wait do i want the awesome or the
peaceful
all right now the awesome now all the
people we share them are we're sharing
them both yeah this is a sharing
situation
it's eggplant farm sandwich do they have
sauce on it
all right great i'll have this one does
anyone show up in d message when i do
this
okay
so
you know what i have an idea
someone suggested it earlier in the
stream
well try unmapping
the cooler things
let's see
yeah sleeps not defined
what isn't sleeping
uni std we love uni st
it's uh
i don't know
just know that like you got to include
it if you want some stuff
oh it's not python what is it called
it's called spy
right here so cat rock
maps
ah look at that
there's the mapped areas of nvidia
is that actually calling map
where are those i o controls map again
okay so this is a pointer
oh they're more nvidia controls okay so
that's the stuff being mapped all right
all right we're making some progress
those alec memory things
oh there's also map memory
all right
let's take a look at map memory
that's what we're going to do we're
going to run pull it think about it
it thinks that it's going to have memory
but we're going to take the memory away
and then i don't have any memory then
we'll see where it throws an error
all right just we'll look at this
processor for a minute i've heard some
crappy processor
what ram does it have if it has ddr3 i'm
gonna be upset
um
sram
it doesn't have any ddr
can you tell me what i'm gonna fit in oh
here we go it does have ddr
but it has ddr3 and lpddr4
why did you why did you oh 16x can fd
how much are they
right includes let's try
and usb
some guys sent me a processor
um
how many cameras can i connect to
none
all right how much do they cost
are they on digikey
are they on octopart
fine chips is the new hotness
what
72 dollars
how am i supposed to be able to afford
that more subs
no it's for column
they want to use a 74 dollar processor
because it supports flax rye
fletcher's like the white whale
we didn't even get to use
the thing that we purchased with our
subscriber dollars tiny voice is coming
back
and it's going to speak like tucker
carlson why don't you do it tomorrow
tomorrow
what time we're getting back
i'm not getting that till four it's
gonna be traffic i mean it's higher from
sitting in traffic all day should we
just take the train
on the train
i don't think i can stream on the train
kafka can't come with us
this one's kafka
this one's dft
and
this one's tubby
no no no
dft is written on the board too we don't
talk about what it stands for oh i can
tell
you know what that one runs
the twitches don't know
well or you used to run
you throwing yeah i know it's a tragedy
that's what i really should be doing
today i ain't so cute
we just we just we're just you know
money's just lying on the ground right
now
bro
is it good for all volatility
we love volatility up down volatility is
means win
only george would buy cool stuff with
somebody look i'm trying to deliver a
good experience to you my viewers
because my stock price is down just like
nvidia's
your stock prices down no but i was
telling them that that's why nvidia open
sourced the codes because their stock
price is down
are they under investigation too
oh yeah but no one takes the sec
seriously
no why do open
um because they're trying to be nice
when companies stock prices up they try
to be dick and exploit more
when it's down they're like well
we gotta do reasonable things actually
what are your sites
right now
okay
so what we're going to do
we're going to look at map memory
can you show jobs first
you want to show jobs
we can't hire more people we have any
money production
oh production
does someone want to come work a comma
and run production
one support
do you want to ask chat well we'll open
up to non-subs
yeah chat
north master
they can't see you i'm almost done
if i can't see you they can't hear you
wait really yeah
i'm a production and support expert but
he didn't put an apostrophe so i don't
know if i trust him
if it's like a colloquial chill
environment what do i need to know to
work
i think we need to be a good problem
solver
rational
um
think about how to scale things
um
common sense i think is a big part of
the job they can't see you okay let me
put this down
this guy is a drug dealer and says he
knows how to handle production i do
think a drug dealer uh reformed drug
dealer could be a good fit that's right
tell us about your business shkreli said
he met a lot of good people in prison
and only if you sold okay drugs man i
think there's actually you sold track no
wait what were you selling yeah what
were you selling if you were selling
like weed mushrooms and acid all right
but if it was cracked
here
what else do we want to say
go with the drug dealer they've been
through tough times and survived
like were you like at scale drug dealers
just bleed yeah that's fine
i mean did you get in trouble are you
caught
yeah we're gonna do background checks
i'm lazy and not very bright do i
qualify you should just you should just
go away alex you're missing whenever we
shield stuff for the stream we lower the
value of the stream
oh no it's true though it's kind of like
google added this way are we shilling or
we we're shitting we're offering an
opportunity yeah that's fucking i hate
that language alex look what we're doing
you know what you're saying
look what we're doing with these people
all right feels bad man all right i
don't want to go to la i just want to
stream all day i know you do that's why
i said that
yeah
wait we just got a raid wait jonathan
blow just raided us oh i love jblo oh
all right well then we gotta stay on
streaming is he is he here
i don't know i was just thinking of him
oh my god what look at our deal with our
view count oh shit all right
i gotta i gotta stream alex all right
1600 viewers hello new people
welcome him
i'm trying to be
the best streamer i can be i don't know
i don't know either yeah
all right so i'll show you what we are
doing
we are
we built the open source nvidia driver
and got it installed on my computer
right here
then we built something to sniff all the
i o controls communicating between a
user space cuda program
and the driver
but
when it calls cool launch kernel which
is the lowest level api you can get to
from user space at nvidia exposes
there's a lot of high level there's cuda
launch kernel which is a cuda runtime
and then there's this syntax which is
even higher level and generates these
stubs and i can't believe we wasted time
on it
so when you see here in launch
there's actually no i o controls so it
must be doing the launch it must like
map in these these buffers are called
something on gpus i don't remember
but here we can look at s trace and
there's nothing let's throw a dash f and
just make sure
yeah so between launch and exit mem copy
which is you see where we actually call
cool launch kernel we're not making any
i o controls to the current
so there's a question of what's actually
happening
and so we added in this wild one sleep
thing
and we can look at the process
here's the process
and we can see that it mapped in a lot
of nvidia control
and some nvidia zero stuff
wait even this low level stuff is in
video control on zero
well that's crazy um so we're going to
reverse finish reverse engineering the i
o controls and figure out what's
actually doing that happen
so we can see that rm alec memory is
actually happening
uh
let me just change up the heat control
one to not
we don't need this we don't need this
it's printing too much
um
either way
so this is the nvidia open source driver
we can look here at escape.c and see
what it's parsing these are nvos 33
parameters
we're not parsing any 33 parameters yet
so we're just going to go in here and
add that
when we shell we lower the value of the
brand
oh my god
okay
here
let's take a look at these parameters
now we can finally read these structs
these structs used to i think not be
open source
so it's really nice that nvidia open
sourced this for us a pointer for
returned address p linear address
hmm
oh we got offset length tell
p api is too much type we'll just change
it to p
um
p
p linear address p offset
all right
is that something we actually map i'm
gonna buy ice cream
let's finish my avocado toast
so what's the plan
you can stay in the stream
do we
you text him
you let me know what's going on
we can on the stream whenever even
though we did just get a big influx of
people
i don't know it doesn't matter
do we do this to be famous
if i wanted to be famous
i just go i'll shoot up a high school
[Laughter]
i'm kidding guys i'm kidding
that's why being famous sucks though
that's the moral of that story
banned from twitch
banned
i said bad thing ban
nah as long as you don't expose your
nipples i think it's fine
nipples
oh i think they're like trying to print
out pictures of your nipples and put
them on my nipples not all
nipples they like try just on instagram
ones
and i forget what happened
this is a politics-free zone
i don't know why the body is horrible
this is a politics-free zone
guessing
from this house
what
watch me
right click ban
wait don't we have way till we have the
uh the new lock system you know okay
no i love that lock
okay it's just cheaper
how much cheaper half the price is it a
slogi
i only like sliding i know this one is
interesting because it's small
i don't trust small
we looked at we looked at uh
we looked at locks yesterday for the
comma office
oh linear address might not be what we
think it is
um
let's just add in
okay
p linear address is not anywhere in here
so i don't think that means what we
think it means
all right sub is only time
we're going to return
that memory
what is p linear address
the mmio address where the memory object
is mapped
i worry that this might be a
maybe alec
we like looked at half of this and then
got bored
p alec perhaps
it just creates a handle
there's tickets we need tickets
didn't that look like an error
so that made the 6d object
oh
okay whatever these p linear maps are
they're not useful
maybe you want the handle
okay
i mean this would be my guess right it
has to be this memory
that
so what we're trying to find right now
is where the uh control interface lives
right
there's some control interface
that's letting the
oh actually no i don't
so okay
oh wait a second
the question is what are these things
what is what does this thing say it is
okay
2 6
def 0 deleted
these allocations don't even last
they're just deleted
now address here
why do they call it something different
on all these things
okay
the address is nil
p p i equals function
out returned address
it's always now
okay well someone have offsets
it's not even the same memory
oh no this is oh this is generated okay
we're getting a handle okay this this is
being created
the owner is reeled up
memory owner id
those are not the same every time
yes and look when we're calling keep
control here it's something else
then we call it on this thing
uh
no i don't know if the zeros are a big
deal actually i'm just trying to figure
out where these addresses are coming
from
see these are the ones that are really
interesting these ones down here
because they're non-aslr
which is actually kind of crazy
is it the only one that does uvm
yeah
like i'm just like looking at the proc
maps and my guess would be
that the stuff that matters is here
which you know if you want to do any
exploits and you want to know something
that's mapped at a fixed place
it's a pretty good deal
um we can also there's like
we do lspci
um
here look we can see what's mapped
which might be useless but
okay so the mystery now is
cuda somehow is communicating
uh with the driver
so we can just try this
and we'll see what happens
they seem fixed so i think we can unmap
them
all right i want to do that before this
see if it listens
okay good see we got rid of that one all
right let's get rid of all them now
oh wait we got a segmentation fall
all right
so we got a hit sunk the battleship you
know
bro
watch we're gonna sink a battleship okay
now it works max arrow zero
um procped page map
nothing there
do i have to be rude to read that
oh it's like really long
either way when we unmap that one it
breaks so
there we are
17 functions deep
that's an
exaggeration only 10 functions deep in
lib cuda we hit a seg fault
somehow
someway
as you can see rdi is that
all right
well here's a question
where are those things coming from
we can figure this out right is that
done within that
what's returning this
it's possible the driver's doing it
also possible it's not oh there we go
this is an impact
all right um
why didn't that go into s trace out
like that
okay
wait
they're so boring it's just where it's
mapped
so that's how we have map nvidia control
and that's oem map zero
then we open nvidia control again
and we unmap it again
and we also want to map it up there
are these like different regions like
that one's a lot bigger than that one
oh s trace dash e trace memory wow
subscribers are so good
well yeah but that's useless
it's useless because we can't see uh
oh boys there have to be so many
exploits
i can taste the exploits
okay
wait
but we have this we have the code for
this so we can just figure out what's
being mapped
we could just read the end map right
hmm
nvidia vma access
i'm the top channel in the science and
tech and this is why we don't change
categories
um
so for people who are new right now what
we're doing
is we are diving into nvidia's uh
api between the kernel and user space
you can see here when we call launch
which actually launches the cuda kernel
look if you're not familiar with cuda
you know what let's everybody let's take
a minute for the noobs
let's take a minute for the noobs i'm
sorry if you're not a noob
but we'll take a minute for the noobs
okay
uh
intro and video
here we go
i remember reading this
um
when i was in uh
when i was in college and being like
whoa
gpus man they're gonna change everything
let me explain why so this is a cpu this
is the basic diagram of a cpu and this
is the basic diagram of a gpu
gpus have a lot more cores than cpus now
these cores are much smaller
and one of the things that gpus don't
have
cpus in their cores now spend a lot of
time you know people think oh it's just
like some dead simple stuff and it's alu
and uh
the alu and like what you think of as a
cpu is such a small part of a modern
core
most of what's on a modern core is
dealing with out-of-order execution so
when you run a computer program it
doesn't actually run one instruction at
a time
if it did this would be horrendously
slow particularly because your memory
instructions would take a really really
long time because memory is really far
away i know it looks close but it's
really far away from a cpu's perspective
remember
that's about how far light goes in a
nanosecond right so you're running a cpu
with four gigahertz you can only get
this far and if your memory is
physically that is further from your cpu
than that you can't even do it even if
you're going at the speed of light which
you're not but you know like you can't
even do it in like
okay
this is a cpu and this is a gpu
jim keller's podcast on lex is great
about this stuff
um so nvidia introduced cuda
in november 2006
uh and these are
i don't know who did the the shoddy
graphic design for this but uh
sorry i'm not only hey man i know the
day it's just it's just bad
why does it say consumer desktop and
laptop and have a picture of a cop car
right it doesn't even make sense why
does it have a picture of a data center
who put the car shit in here why is
there cars
all right um
so yeah this is uh
basically
kudo works like this
you can define a cuda kernel here this
runs on the gpu this is how you invoke
this kuder kernel
uh and it yeah it's kind of like opencl
but it's cuda right
um
this is how things run you should like
read this if you haven't read it because
it's pretty good all right so
recently nvidia open sourced uh their
kernel driver
which is
i know like how many who
i i can't even disable subchat because
you all just talk about dumb shit aliens
you want to talk about aliens you want
drugs you want drugs you want to talk
about aliens
i guess you all sound
like um
wait
is that
hang on hang on hang on i gotta just say
uh now the alien isn't taking me all
right
so
how many of you guys know what a kernel
is
like do you guys know this stuff
if you don't know what a kernel is i
don't even know like who i'm talking to
you know
like you can be honest
all right
it's like
here's your gpu and here's your kernel
and here's user space
um
for user space
to talk to the kernel to talk to the gpu
it needs to go through the kernel
and one of the reasons for this is you
can have multiple programs in user space
right so you can have like three
programs all using the gpu and it's the
kernel's job to figure out exactly who
gets how much gpu
um
it's os kernel so
the
gpu basically you think of it as three
parts it has the hardware
it has the kernel driver and it has user
space component
and video open sourced the kernel
component
the user space component is still closed
source so when we call into this thing
called cool launch kernel
it calls deep into lib cuda
which uh hang on give me a second here
and we can find
yeah
let's add a comment here so this is in
this shared library
which is closed source
uh called see launch kernel
and this is what's actually doing the
launch of the kernel
now unfortunately
um
c launch kernel isn't making any i o
controls
so in order to get from
user space into kernel space
uh you need to do a syscall
this is the kind of stuff i ask in
common interviews by the way and like
i'm shocked that people don't know it
you know who thinks they're going to
come work for comma and not know where
cisco is
um
you have to do some kind of trap which
like the kernel is a higher privileged
execution
and you do a trap in your space the
kernel says okay i'll answer your cisco
blah blah blah
um
so these things that we're sniffing
right here are i o controls and i o
controls are cisco's i'm actually
sniffing them at cisco level sniffing
from lipstick it doesn't matter
because they are effectively signals if
you want to sniff them assist calls you
can use this program called s-trace
which sniffs all the syscalls
so there we go we run that you can see
all these syscalls you see all these i o
controls unfortunately they're given
stupid useless names because s trace
doesn't know about the nvidia driver so
what we did earlier in the stream
was we went through and we figured out
which io control those things actually
were and then we wrote this little
sniffer called cuda i o control sniffer
and some of this stuff is pretty useful
we do see where all the memory is being
allocated
we see a whole bunch of different
objects being created i don't know what
to like awesome then it is
know what that is
register fd alec awesome register fd
interesting
interesting
it was like the last two we don't really
understand so maybe we should take a
look at them
uh they're doing all this control stuff
but
regardless when we actually go to launch
the kernel it turns out that it doesn't
make any i o controllers in fact doesn't
make any calls into the kernel at all
which means that it's speaking to the
gpu through some memory mapped i o
interface
uh and that's what we're trying to
discover right now now it turns out if i
unmap this one it dies
this is a devon video control too
on map this one it dies also
so we can see what's actually mapped
uh in the
program by doing this
you can see these things are mapped
nvidia control and video control
let's see if these ones are needed
so we're like playing battleship right
now to figure out which of these
mappings are actually needed and then
we're going to try to figure out what
the mappings are
and they're just being done with that
map
so it's not that many of them
so it's worth kind of just going through
them one at a time
okay so see how it finished
that means this one's not needed
probably
and this one's not needed either okay
so those ones are all needed
and we still have one more here
devon video control
needed ones
hmm
okay so now it's like faults at a
different place
at the exit mem copy
now this one is nvidia uvm by the way
oh
it's actually not one it's two
sorry this is stupid
okay so now we're down to only
four
oh yeah i could unprotect them read only
too
that's actually a good point i don't
really care
thank you you know what
you've made a lot of good suggestions
this stream
uh
congratulations you're a vip of the
channel
that's what you get if you make good
suggestions
make dumb suggestions you get banned
all right let's do car read
okay so no it doesn't even work if it's
read only
yeah that must be the control interface
then
that must also be the control interface
can this one pro read
this one can pro read okay
those ones i can't even um protect to be
read only can't protect this one to be
read only
now what we really got to do is just get
this in kira
okay those are read only
i have an idea that like those are the
main two
then there's all these ones up here too
they're only a page
and they're more annoying to find so i
care less about them
does it read at all what if i just do
right
hmm okay just right is good enough for
that it's just right good enough for
this one
actually just right might just might not
work
an idea if you map something
i don't think that works
either way we'll leave it because it
works but
okay so these are the controller faces
for the gpu i have a theory
um
part right isn't stupid
all right we're deep in here
but the good thing about part read is we
can read
it do you think it is
what do you think those things are
some other ones here
you could map over them and read them
after the call yeah we'll try that
okay okay let's let's map stuff there um
so
flags uh
i've shared
[Music]
we'll just do that one for now
sag vlogs
sinkhole is different from
that didn't work
why not
oh we have to unmap it is that why
didn't map
oh is fd supposed to be like minus one
or something or i have to do map fixed
all right assert didn't work
oh i think i could pass -1 in for fd or
something
no
oh do i have to do anon
okay cool
oh look at that
oh yeah
yeah look it like didn't work i like
broke the gpu
oh yeah look it's broken
look at that it's still trying it's like
please gpu please gpu do something and
it's the gpu's like i'm not doing shit
all right um
yeah there we go all right let's see
what it wrote there
on gdb
[Music]
ouch
saxpy
oh there we go
look it wrote something
it wrote something and it thought the
gpu was gonna do something huh
yeah they're waiting for a response
uh all right
what is that
is that a pointer
doesn't look like a pointer
is that the only thing it did
does it make it exit map copy
makes it exit map copy okay
and then it's broken
oh i think by the way
cool launch kernel is not going to uh
default stream semantics
i think we actually have to do one more
thing
i'm surprised this even works i guess
cuda mem copy synchronizes anyway
but there's another thing we can use to
like synchronize
uh stream management
no no no hear this
default stream semantics yeah okay we
can pass in zero
so we'll see if it's not actually exit
mem copy we'll see if it's uh
just throwing a
sink here
all right and when we're not messing
with the thing
it works but now i expect it to glitch
out of sync
yeah okay god
you want to try to figure out we can
figure out what that command is
i think it actually just
does everyone know what a pointer is
oh look it did two things
set this as well
um here's something fun we can do too
let's unmap this too
oh wow that's a big one
whoa that said a lot of stuff
same basic idea
you know we can map huge things you guys
know about copy and write in the zero
page right
if you don't know about copyright in the
zero page go take an operating systems
course
okay look at all this crap being spammed
to the thing
so this is nvidia zero
i think these are like universal things
what's m advise
does that advise do anything
i feel like m advised like you know
what am i gonna do with it
nothing
no vip for you
um
i don't have that source for the driver
i don't even have uh
oh someone tried to figure out cool
launch kernel what it does
oh well let's see maybe this guy knows
things
understanding how cool launch kernel
works
this struck deals with the cuda kernel
the function struct
hmm
this guy approaches it from the other
angle not from the driver
it's pretty cool
ah
yeah i worry that all this stuff just
isn't in uh
just might not be in this driver
you know
what is all this stuff being spammed oh
well here's a cute idea
uh
let's see another parameter to the
function
call it bob
and
bob
equals to elite food
and we'll just stick bob in here
that bin data oh
oh it got bigger
i just do that
don't no you can't do that because it's
the previous declaration blah blah blah
all right now did we get any lead food
here
wait it didn't work at all how come we
don't have any stop
do they move
oh like didn't launch
oh
i know why
this function
yeah because we need to stick a
f
i f p f s
like an i there
no i don't know
i'm not that much of a genius that i can
just read c plus plus
shit like that
that actually worked though
man you guys would have been like how do
you do that how do you do that all right
i'll just do it though
looking here at that okay
yeah
yeah we got to do that oh piffus
underscore eye
um
no
that was close i just put the eye on the
wrong side of the underscore
okay cool
as we passed in a useless parameter
see what's actually going on here
did we put any elite food in here
do you guys see lead food i don't see
any elite food
there's no elite food
that means it's just pointers
[Music]
let's see what this guy's trying to do
struck the deals with the cuda kernel
the cool function structure
all right access to the cool function
structure
is that a pointer by the way
i don't know maybe it is
argument as type 2 aka cool funk stir
okay
it's in memory i guess
hmm
yeah okay
so that is what it is but
it's not going to give you in the type
tab
thank you
okay so that's
kuda and that's the kernel
so those are those things like i don't
know like it's kind of boring i mean we
could approach it like that but
let's just
like the closer you get to the hardware
the simpler i find things are usually
look at all this crap it's writing
what is all this
like these two i understand it's like
some pointer somewhere but like
what is all this
i guess if it's only reading we don't
care
okay
so we're unmapping
we're unmapping both the thing here
and the thing here
what is the thing here by the way
there is lead food where
you found it
are you a troll
oh is it did i mess up though
where
where is it
oh
what
it's right there yeah why didn't grip
work
wait that's highly concerning why
doesn't grep work
that's probably because it didn't flush
yo that's some bullshit
thank you
thank you grab didn't flush
nobody flushed their pipes
all right
wait so that just worked
look at that elite food right there
no that's not vip that's not a good
suggestion but i do appreciate you for
keeping a keen eye
no no no you get vip if you make good
technical suggestions if you pay
attention you are appreciated as a
viewer
and this is what we expect from our
viewers
how many do we have by the way
wow
wow 1400 people are watching me do this
why do you care
what do you get out of this
dash dash line buffered is that it
hmm
no
that's supposed to work
it was not interactively
yeah i don't know
it's like an online co-working space
that's fair we're all going to work
you wanted to mess with this
but i'm new well installing the driver
is easy
we did that very quickly
okay
um
yeah i mean this just must be some like
nvidia structure that's just like not
there
and this is how you launch a cuda kernel
you're writing those things to dev
nvidia zero which is a gpu
that is asking is it not
are those pointers from
okay but look how we've really just
nerfed that entire space now there are
more things up here that it could
potentially be using
um
i'm not that worried about them
it does seem like that's pretty much the
stuff
should we intercept m maps actually
they're not all maps are they
huh
yeah
what is f control get fd
chloex
does this
so this is like some like look at this
it opens nvidia control is there any
more nvidia zero or is the nvidia zero
one special
oh
proc driver and video params
it's pretty cool
can i change them
can you go from map to a physical
address i don't think that's going to
work
so
i'll i'll read this but
i don't think it's in the kernel symbols
yeah it's not this because it's not like
i think that like that's just physically
on the driver i mean we could figure out
what physical address it's at
but i think we're better off just
reading the
code for mmap
nvidia 0 is still mapped up there as
right only
there's one more map of that
by the way this is all the crap that
used to be in there just like all the
launches i guess in history
what if we leave the uh mem set in does
it matter
wait no way that works
okay well it turns out you can
trash all those buffers and zero them
out it doesn't matter so they're
pointers
that's pretty cool
look i still have it working
i just dumped the whole i just zeroed
out the whole region
i don't even have to map my own
uh can we trace the map call into the
kernel and we can
but
i'm not sure that's what we really want
to do
i think that what we're better off doing
is reading
what's actually getting mapped
and we can just read it we have to trace
it i know exactly where it's going right
i know which driver it is
it's nvidia zero
yeah i have to use standard buff i think
if i want to change that
but okay
lead food
uh
i mean we could just like you want to
see the map you see the map
hmm
look at the else for this
oh
look at this comment
nvidia device node maps device bar
memory
nvidia control node maps system memory
oh
good find
let's have that comment here
so we misspelled nvidia control
wait that's what you got tr you traced
the map that fast
ah
i wouldn't even like i don't even really
know how to trace the map but yeah we
just we found it anyway so we're good
um okay if not is nv control device
can we do this
nvidia map sysmep
this is just like
normal system memory
there's a vm insert page all right
oh cool
uh yeah okay so that makes sense um is
the device bar memory so we actually
know about the device bar memory uh how
do i there's a way to filter this
or not
okay
oh it has a resizable bar
base address register
so is that
it can't actually be the bar memory of
the device
that sounds like anybody can break the
gpu for everybody else
ugh
that's crazy
here's another question
i guess these vid heap controls how long
how large is this one
not large
it's right on
where's the other memory
maybe it's not mapped
it must not be
so the other the other memory when you
when you map memory on the uh
on on the gpu it must not actually like
map into your process
which makes a lot of sense like there's
no reason it would and then like it does
cuda mem copy
oh i mean i'm interested i guess what
mem copy does too
[Music]
okay this is what mem copy does it does
it somewhere totally different
you can q is a kernel for that
what is it
do you know about traffic
i checked
no this is a lavender cucumber
that's not a real flavor
we're really trying to make it happen
it's like spa water
yeah it just tastes like i just like
imagine getting waterboarded at a spa
aurobora it's like getting waterboarded
at a spa
it just like uses the next one
i'm zeroing everything out i think maybe
like you don't understand how serious
that is
none of this stuff even matters i just
zero it all out
it doesn't matter just zero it out
and it works
we should probably like write a better
check to see if the program's actually
like running
and it's all zero except for these ones
so it's got to be some like ring buffer
structure
i think this is more understandable
uh
those match
this here
i must map that in the kernel somehow
or that's not pinned
oh
wait i think there's like tricks if you
like pinned i know you can do this in
python
yeah cuda mem copy we can get lower
level than cuda mem copy
it's gotta be like cool man copy
memory management here we go
cool mem copy
okay it looks the same
so maybe the pointers are wrong
oh we need to pass in coo device
pointers
oh
did i just break that
they're not really flog pointers are
they
what's cool them like
it turns a dev pointer
that is not clear
cuda free cannot be used with a depth
pointer
can i just like read from that
what's there
that should be mapped right
it's got to be mapped somewhere
two
eight two three
eight two three eight no it's not mapped
anywhere
it's in the nowhere's land
which i just kind of makes sense it just
like
doesn't want you actually accessing it
we can try to access it i think you
could just get a fault
because it's a device thing
okay
the problem is i don't think these ring
buffers are implemented in the kernel i
think they're implemented on the device
like this is what i mean why i'm not
even sure this kernel driver is going to
yield us anything useful here
this doesn't look like it does anything
fancy it looks like it just maps the
like this is just
mapping the page
which is kind of surprising to me
because
how is this shared between
i don't know actually or is that a
threat model of the gpu drivers like are
gpu drivers supposed to work if like
multiple processes are uh
you know all
not cooperating
maybe they're not
but you see what i mean why i think it's
a ring buffer
like i think this isn't cueing something
and this isn't cueing something
and it seems like it's every hex 2 000
then like here's another one where it
does that and then it does that
oh we can do this too
pretty useless
i mean
it probably just shows up like when one
of these things finishes
um
this is nvidia zero
this is nvidia control
oh
look at this
look at this
this is a pointer
see
this is a pointer to that
it'll be more obvious if we change the
dump function
okay i get it now
yeah look they're pointers
they're pointers
that's a pointer to this
that's a pointer to that
okay
5c oh
ah
this is a pointer to down lower
one of them asking to gpu to dma to host
memory yes so some of this stuff is is
yeah okay i'll explain to you how it
works now i think i have a pretty good
understanding of it
um
well actually here's an interesting
thing these are not uh
64. okay 32.
well
you
okay
so i'll explain this to you it's simple
it's this dead symbol
this here is a pointer
uh and it points to
this
so the kernel
must be
something like this
so where's the lead food
we'll eat foods down here
i don't know why it has two copies of it
84 might be the length
but
four eight four
oh
no no no
well that's actually that's really long
look at how long it is it's from there
to there
to 890.
it's all just one enqueue
i don't know what that other stuff is
oh maybe this is
oh
oh boys i got something
okay
here's my theory
this
is being written to by the computer
then this stuff is the response from the
gpu
how can we tell
there's a kernel thread calling nvq okay
there's a kernel thread called nvq
yeah it's a sort of handshake
oh no
i don't think any of this stuff's in the
kernel like i just don't think the
kernel is doing anything anymore
i mean it probably is okay the kernel's
probably listening and it's probably
getting
interrupt
wait a second
how does cuda synchronize work
how does cuda stream synchronize not use
any uh kernel call
there's got to be spinning in user space
then
unless
you're just not fast enough
wait it's actually spinning in user
space
oh that's trash
it must be
yeah there's a launch
which includes a synchronized
oh it's kind of just way in user space
right
and what else explains this
like probably what happens
i am protecting it
and protecting read-only doesn't work
right
sorry i'm protecting so you can't read
it doesn't work right
yeah it obviously doesn't work right
because i just ripped
that's a scam
y'all we're gonna write a new cuda and
it's gonna use kilobytes in memory
everywhere that they used to be using
megabytes we're gonna use
kilobytes
it's gonna be unbelievable i don't know
what we're gonna do with all our memory
we're gonna sell it to people we're
gonna we're gonna sell the chinese we're
gonna sell to the saudis
we're gonna we're gonna sell it to the
israelis we're gonna sell to the
palestinians we're gonna sell the ram to
everybody
yeah
what
no no i'm selling ram what am i gonna do
with all the extra ram i'm gonna sell it
that's true
it also spells marr
and mra
um all right but does everyone see what
what's going on here
so this is the
like kick off thing
it writes to zero and it writes to 18
and like that
and then this is the response from the
gpu
see the response
that's not zero out before the mem copy
and we can see more
response
okay cool you get it
so this is a packet
ah
and this is a packet
this is a pointer to here
so if we just build this struct
we're good
this one kicks it off with a 35602
this one kicks it off with an 0302
cool
all right
have you read this one about device
synchronization let's say
[Music]
memory bandwidth no i don't know about
this
i mean it looks like we'd have to peg
your core right the only way to do that
otherwise would be like using interrupt
and that would have to go to the kernel
as far as i know there's no efficient
way in user space
so it must be a sp it must even be worse
than that because it's not calling sleep
it must be like a spin weight
but it really must be a spin weight
that's disgusting
maybe it knows that it's short and
doesn't do the spin weight for some
reason
how is it doing call backs is there
threads
does program make threads
tree
oh it has threads
do they have names
that's f10 i don't have f10
oh
look at these
cuda event handler so hang on
maybe all we need to do
is have a f
have a
be an s trace with an f
that might have been the mistake
hmm look at that
two second results on google link it
it's a different result for everybody
google changes for people you know that
right
okay
no there's still nothing in between
launch and malec
but there might be sometimes
i don't know
whatever i don't care about this mystery
on my results
which i don't know what you're talking
about
um
okay regardless does everyone understand
kind of what it looks like
this is saying run the command stream
starting here here are your launch
parameters it would be interesting to
see which one it writes to first my
guess would be this one
and then here's the response from the
gpu saying hi
uh your command stream is now here
uh i did two shits and it took 84 little
shits or something like that now i'm not
i'm not too good i'm not too sure on the
big shits and the little shits or
anything like that
but uh it's something like that it's
gotta be okay
um
i don't really care about the mem copy
for now
so basically we can comment all this out
and then it'll be upset and it will fail
but if we poke this shit it should be
good
it is the same every time right there's
always this
you don't know what a pointer is this
isn't going to make any sense to you
so you know you better go study pointers
where's that segment
what
oh
that's not right
um we want to add
okay
does this match this every time
there's our aslr
sworn enemy of charlie miller everywhere
well they're not the same
if this works we're getting there
let's just try this let's just let's
just go let's go mem copy
you know what's so nice about c
you know you don't have to deal with uh
oh wow i got a trick if my string is
encoded and you go to your f8
because he doesn't have shit like that
she's made by based people man
that's the real truth
people may see we're based
yeah yeah that's true though it's the
only way to describe it all right so
that
should replace
that should let us launch our own cuda
kernel
as long as we don't have aslr bane of
charlie miller everywhere no one even
gets that but it's true
um
argument of type long is um
oh yes because that's you can't just
copy to it no you can't just do that you
gotta you gotta do that yeah that's
right don't upset the oh failed
oh
come on that was supposed to work
wait okay here's an idea though what
does this look like now
it did go to the next thing
let's not mem set that
it must just be some things at a
different address
no i just didn't
i must not be doing the magical
incantation correctly
or
oh you know it could be a worse problem
than that
it could be worse than that
it's possible that the problem is that
the drivers then messed up
you know what i mean
this should still work if that's the
hypothesis
no but look at how different those are
this isn't going to work
oh look at how different they are
they're two different
so this is the buffer being shoved into
the memory and that the gpu is told to
execute and unfortunately it contains
pointers so you know
like you know about like inception you
see that movie
it's like that but you didn't make a
deep enough copy because we only made a
shallow copy it's like if you only you
know you know you only make a shadow cop
you don't make a deep copy and then and
then without the deep copy all the deep
depth isn't there and you're left with
like you know
stuff that isn't deep like
kiddie pools
mm-hmm
is my time up
oh
well that one's different so we can
delete that one
they're pretty similar that one's
different
these are different
because that's the aslr bass
am i going to like it
[Music]
[Music]
malibu boys
we're not going to solve the mystery
today
yeah
kind of not really
i are like
i mean
we mostly solve the mystery did you get
kind of where we are
one of these days we're going to write a
new cuda driver and it's going to be
fast and it's not going to use any
memory
why is this using memory what is it
doing with the memory
oh you know what's even worse some of
these probably aren't cpu pointers
they're gpu pointers
okay well we can check one more thing
it's not going to work just but like
eventually we're going to have our own
driver you know what probably
understands these things pretty well
novu
i'm going to go read the novu source
code because they have to understand
this right
novo is open source nvidia driver
they have to have these structures
reverse engineered right
what are you making
what am i making yeah
you're eating chippies on the couch
yeah all right
no
no who isn't really cuda though just
graphics isn't it
yeah i don't think they have cuda
novo does not support cuda but it does
support opencl
uh
which one do i have
i have amp here
i'm just saying that like
this code has to be here right
what's a gf 100
awesome crappy old gpu
[Music]
oh look at how old this is like this
can't be the real novo
the root kernel tree holds
the accelerated
this was forked from nvidia's nv driver
mesa
any of these
yeah but eventually tiny lad isn't even
gonna use a cuda driver it's gonna talk
right to the kernel
and then it's gonna be the fastest
implementation yo wait a second we could
actually do that
think about it
we would have the fastest implementation
of neural nets anywhere think about it
look right now
real talk real quick
google made a compiler for their tpu
that statically compiles neural networks
into tpu binaries
there's no reason you can't also do this
with gpus but nvidia hasn't done it yet
we could take their existing hardware
and
we could make it
work like a tpu
ensuring nvidia no this is really old
too ensuring in video will be the winner
forever
should we try to support that in tiny
grad
tesla does the same what do you mean
think about that
no we're not the baddies man we're here
to liberate the world
we're here to give everything away for
free
fast free cheap and easy
is that what the bad guys do no the bad
guys are bureaucrats who make your life
hard boring complicated and slow
mmm it's true
all right in this theory it writes to
this one first
i'm sure it does
yeah it's possible when your map it just
gets like a new page and then that gpu
just like
it's like a control page and that just
kind of works
this stuff has to have pointers to the
sf pointers to the code in it
um we know that it contains elite food
we found the leaf food
the leaf foods right there
oh yeah and then these are just the
other pointers and then that's that
float is it not and that's n
oh yeah
look even those pointers were wrong so
those are the pointers to the uh
the device structures
i think it's
15858 now but that's not the one
[Music]
all right
we'll be back tomorrow
we'll be back tomorrow
to finish this we are going to launch a
cuda kernel without the nvidia
cool launch kernels
and then with our newfound power
we will make nvidia gpus so fast because
they won't they'll just poke things
it'll just be poke
it'll be like c it'll be written in c
like fast all right
bye everybody
And ride on it, like jay-z, let's look at jay-z on Jeff
Well, that's what I will do I swear if tonight we find $200,000 I will buy a jet ski
I'm hungry too. I got some bubble tea tonight. Um
Look forward to working with the security community. No, I swear I'll buy a jet ski, all right
Okay, so
Where I would kind of look for vulnerabilities here, oh by the way, please subscribe to my shit
I'm not gonna make $200,000. I need your money from twitch
Please please give me money. Oh poor I need any rice
Fans off the fan off
See like my feet are cold
My arms are warm
No, my arms are cold too. But I want the fan. All right
Let's say do we have sound to sound work good sound or excited good
Let's feel we can find
What we are dealing to find is a place where I market isn't validated
They do like they label it like shady market generally
Looking for bugs for a bit. I don't really think I'm gonna find anything
Yeah, we use sublime to read code and I use them to write code pimple my arm I
Live in the same house will come AI guess who would live at work just savage
Alright guys, what do I want over eats? Ooh
North Beach pizza. Oh, yeah a homemade flatbread breadstick. Is that what I want?
Cheese pizza. Is that what I want to see P?
Mmm Oh Sasha's Pakistani restaurant. Whoo that seems kind of good food chicken tikka masala. That's what I want
Yeah
Get that chicken tikka masala
And that's what we're talking about. All right
Is that healthy guys?
Please order. All right. We got some Pakistani food coming
too AM
Is he jumping off a yacht this is real shit or is this meme shit?
This rollercoaster
Yeah
All right, all right guys I know we got work to do tonight
So we're gonna make $200,000 and then we're gonna buy a jet ski, yeah
Wait, we should put jet ski in the title. Maybe we'll get more likes and clicks and views and shit
We'll buy jet ski if win
All right, cool
All right. So what we have to find oh
Man, I wish it with syntax highlight here. That's kind of shitty
So you see this market is legit call
Like this is not this is I would say poorly rigged like they're very careful. Some of them have market as legit calls
There's no reason you can't have a market as legit call here
But they don't do it for some reason. So that's generally like not the best practice. I guess you don't wanna waste gas
So, okay, let's let's look into this only whitelisted call this thing
Let's see if there's ever a way we're gonna be able to bust that
Know these things are just whitelisted by the control wire. That's all order has this contract called it can scatter. What auger is it's a
Decentralized prediction market platform built on a theory. Oh, that's right
Well, my friends works there and I told them look at security, but it's actually extremely good
So there's all this like forking crap
I'm not sure like how useful it is like I
Worry that there aren't shallow bugs that there's just like extremely deep bugs
That would take weeks to find and we don't have weeks. The Karger is launching soon
No, but we got to stop with the pessimism we got to start believing in myself and you know, what else
I wish I had some damn chapstick
Stick
Weed pen check it a crazy dream today guys took a nap
Chapstick no chapstick
Come on relaxation supports learning ability. Here's my theory are they allowed to say that shit that seems it legal?
Delicious vitamin alright
So these are the libraries
Is this like its own contract that gets deployed should read the deployment code
I
Think it's mostly just gonna be a reading code. You can zoom in. Whoa. Let's see you guys can see better
Universe create yes, no more. This is how markets get created and just look at the universe
I cashed a nomination to
Market factory create market value
So this stuff always makes me excited because
like
It looks like I can create a market. They're calling it I cash but it looks like I can create a market with anything
So remember that if you don't actually check it I can pass in any contract here that doesn't actually have to behave like any RC
Use 'fl that is though
The market
Yeah, okay so see it's useless the idea of like passing in something weird here is useless because it doesn't look up with the controller
The great thing is though since we're attacker is we only need to find one bad thing
Contribute
That for create dispute crowdsource, er
If there's any way - like shoving something here that isn't actually a
Disavow crowdsources see okay. So it's this kind of bullshit
I wonder if there were bugs like deeper in the etherium platform that we can think about
There's little you could do to a contract
The whole order would fall apart if we could get one
Malicious contract in like the trusted stuff, right?
Does the whole a theory of security model is is weird to think about?
By the way
I'm telling you 24 are you're watching?
If people actually showed up here then this would have to go away because no people can't have nice things
Like this is what I've learned about the world the people used to be able to have nice things
But like now people can't or nice things anymore
Maybe the default
Maybe if they default to call if you're in function what you mean by that so like there's this kind of crap here
Anything the checks deep Oh
Get his address or 0 address shady reporting
What is the zero contract what happens if you try to call the zero contract
Not useful I
Can get that to return anyone but
All right, so this good morning this function here can actually be anything I want
Like it's not really useful
You're not gonna get past this check
You're searching only on the source so you don't get all the testing crap
Now the functions that define them
I
Wish take highlighted this
There's a container for a few went down
Get few window ID return shady few endo equals legit few window
So this isn't gonna work is container for feet
Unfortunately these these is container calls. They're really what I want to attack but they all seem good
If we could attack any of these is container for their things now, I think we might have some lock
Start time shady feeling go get start time. Okay, so we can actually do anything
We want there
Like that, that's the weird stuff to think about
Start time
That's already determined
Like it has to have the address in this feet windows thing
Yeah, and if you assume that checks cry for this checks, correct
Its container for share token is this one bad
Get market, if not is container for more. Okay. Oh
Man, I wish I could get through. This is a container for market check. It's the best one
Legit market
Alright I'll see
Come back to universe in a minute. Oh man. I've really opened a lot of these
Show your 14 participant presents
I don't wanna share this
Participants against as part of the market
so we checked with the shittier boy, which is actually a part of the market as
Well as a crowd sorcerer
See look if we can break this container for market we could like mess with the open interest
That's what I really want to do. So we win two hundred thousand dollars and we get a jetski
Dude I don't know man, that was all bullshit man
Did that sound I talk that was that was during the smoke weed erryday phase man
Does bullshit like you can't really do that
like it good - why if you care I
Get it. Well, I like neuro-link. I don't think really works. I
Don't know anyone might be smarter than that. At least when I talked to him early on about the software having car stuff
I don't think he exactly understood
Like what machine learning was? I think he might now
Really it's not a bandwidth issue and the simple argument to be made about why it's not a bandwidth issue is
Your eyes have so much bandwidth, right? Why can't you read faster?
You'd have to pre-process it
So no, it's not. It's a stupid idea
you know like
Yeah, I probably used to talk with it like more confidence
I probably used to like, you know, I would be able to oh, yeah. Yeah, we'll talk like I know what I'm saying
That's bullshit man. And none anyone else knows that the talking about, you know, a lot of people are real idiots. But oh
No you
Can't you can't stick a high-bandwidth pipe into the brain that makes no sense
Life advice on the
Switch. Oh
God, I don't know are there even like good bugs in this this probably bugs are the probably really deep. I want shallow bugs
don't want jet ski now I
Will buy a jet ski guys, I will buy a jet ski
Excitable or if it's migrated out function and you could burn and you could pass in any amount that you want to burn something like
whatever
All right, so here's like a nice great one-off check written does that check wrong
You can't be geo hot 2.0 this is dumb idea
You can't be 2.0 of somebody else. You gotta just be 0 to 1
You know
We're gonna press next economy eyebrows
Where my karma shirt
Disgusting. No bike. I'm sure shelter come another. I know this twitch and I don't have to shell
The only reason I stream is so I look less stupid when I talk to myself
Where's my chicken?
You
Oh my mouse works, oh nice did everything working sweet everything's working
Look I have a pink iPad. It's pink
All right
Let's see
I've been bored tonight. I did the triple bite quiz to get a job. Maybe someone will hire me
Yo we go put Ian on a jetski, that's right, no not here talking with coma guy
Okay, so the only thing I was seeing was that I could create another Genesis universe
Like it's again still not really help
If you don't get any control of anything when you create a Genesis universe
Your look I can call create Genesis universe but like it's like useless I
Could control some of these things might be useful
What does parent invalid mean some log
Good child universe
See this can only be called from a market
It's only whitelisted caller things makes things useless and that's just all logging
Which won't actually mess with anything. I mean, it might be broken, but there were actually break auger get me $200,000
Let me tell you something if we find a high-priority bug we only get
$5,000 and that's a shitty jetski compared. Good jetski
Huh
What is only in bad times man
I can pass anything that I want here from market
See how like this has this market as the JIT modifier and then trading ask a patch this one doesn't
No, no, no, we don't look for exploits anymore. I'm doing this for a friend
What can I do with this
Calls this
It doesn't matter cuz this doesn't modify anything notice how they like this isn't good
Jeff Rossen share value your market, so this can be I can pass anything one. There's anything actually call this
contract interfaces
No, no, that's a view I mean they should call it a view because it is a view as far as I can tell
Home get frozen share value
Ooh, but it's not a view because it looks like it does this Nemo eyes frozen shares value. Oh, this is interesting
So what if you can break it lets me my last
Known outcomes
Yeah, oh this is interesting
Well, so what is the key that it uses to mean a lot uses a market key it might not be useful
Yeah, okay it looks like it uses a market key so it isn't useful I
Think yeah, I mean there's no way to spoof that
No just be zero for my fake market, okay, that's not that useful
Market outcome frozen share value
Yeah, I'll be cool theta and I should have the market there
Yeah, I know. They're offering a good bounty, right?
We're gonna get back to streaming twitch slam
Some day tomorrow maybe extreme Trish slam tomorrow I
Went to Vegas last weekend, it's pretty awesome
What that I'm streaming who cares
Don't pay me. I don't care about any money except I need money from twitch people
on twitch s yeah, we could go back to church says I saw your contribution to twitch s
We should try we should do more Trish maybe but no what I want what I want to add to twitch slam
Is no I didn't win this. No jetski
But I wanted you for Twitter slams. I want to make a virtual world to test it
I don't want to test on real videos thing where I want to build a goal of rendering little environment
Okay
Alright let's look at all of these ones that take in markets and see if any of them don't enforce that markets are legit
I'm sure that's all right. Just test markets legit
Private this one doesn't
Divide up winnings doesn't check if markets legit. I'll just calculate proceeds
Lots of you so it's not useful
That's not useful right there
Let just divide up winnings I
Mean it's not a view
Why isn't this one of you
Oh
Wow responsible disclosure, here's my middle fingers. No, it's not live yet. I wouldn't do this for live
Their launch date is uh
I'll say I wanna scare
Ya July nice so they have two days
But this is also my feelings about responsible disclosure, I think you might feelings about responsible anything
Oh, wait, is it at the top of hm, really?
See my nature
God like dude
They should ban. I would love to see a ban of
all
like news
Like no no the Guardian no, New York Times no Wall Street Journal. No
Chicago Tribune, no Reuters. Hell no
Hacker news without any links to mainstream news. Oh
So Java zero, I love them people job zero des man
Did the worldly
Love me. It's more Anarchy
nothing everything in balance, but more Anarchy would uh
Kind of be nice. Okay, so why is this not a view?
Get more cash reporting fee divisor. So
It's only universe
So check that the deaths under their cash before you device
Good current he wouldn't know get her create previous even know
Cut our create timestamp. Oh no
I don't actually know
What um, I mean hacker news is fine as an aggregator, I just I just yeah, I'm just disgusted by like the headlines
The rise of sudo AI how tech firms
Quietly use humans to do BOTS work like I actually this is the one that really disgusts me
Like let's look at the use of the word quietly
Right, like that's not a factual word. That's an agenda pushing word Oh
Using what one it's just disgusting
Quietly
Like this is ways to write things in a much more neutral tone I
Mean that and that's what like I just don't like to see it triggers me, you know. Oh
South Korea has limited no see I'm just disgusted reading this. Never mind. Okay. I can't I can't no
Like I would like for one site to be different
I would like for one community of people to be like
Smart enough to recognize that stuff and then not have and then also to have the UM
What's the word the?
Responsible Ness to avoid being triggered by it Oh
Read it's destroyed all I it's a god
I I want to one read it I go on one subreddit I go on our machine learning. I like our fashion learning, okay
Let's see what's here
Under the great pin post, what are you reading?
How big of a generalist are you like this is this is just good
She like this is awesome
Sorry, I'm getting distract it is hard to read this code
We have a great data set for us at Como
One day two separate areas
Me
That's it like there's nothing offensive this subreddit there's nothing offensive about it
Yeah, probably I wish I just wish hacker news was more like that and there is still some good content on there
And to keep triggered seeing the bad content I
Mean it's it's just it's what's scaring the Internet apart. I googled something. I googled something I was looking for I googled like
It was an old concept. It was like when sports stars burn outs. I remember reading something about it years ago
So, oh, yeah. I was googling private search engines. So I googled like sports star burn out
and it's just
shit
Like legally late like
Want to be a sports star don't specialize the young star when athletes decide the thrill is gone like oh my god. I
would love to see
What this used to be I would love to see what Google looked like in in 2012 and then sorry, you know
I went to doctor go and I was like, okay these people any better. Um,
No, and it's it's the same shit
Look, they even have news like come on DuckDuckGo. Like I don't care about your privacy shit. I just wish they would give me like
I mean, I would rather eat Oh see like this is interesting
I love archive
Interesting, but this is fascinating right like like like like wow
This is something nice
And I mean, this is something yeah, this is something I probably would have would have thought beforehand
in the NBA
All the talent is of the Golden State Warriors of LeBron and baseball and hockey are pretty random
That's why they have to play so many games. Oh
My foods almost here sweet
um
But yeah, I mean look this is like interesting. Alright, I wish yeah
But I wish I wish the internet was more like this. I wish was the content more people wanted
To get my chicken tikka masala with my grown on
With ubers here who's running out of here. Yeah. I hate when they do this. They're like, oh we're gonna go downstairs
We know how long it takes you there that the algorithm you have fuck your algorithms
And then we're gonna go back to auditing order
What is that oh
Nice oh, this is this is good old good old good old finding them whereas FTPS because the internet used to be cool
Ah food
No, yo, bro, yeah when you go home do it a thousand dollars, so I'm going to a femoral necks tweaked my
elbow
Ha ha yeah got that garlic naan
Back to auditing order
Tentative winning. Oh, yeah, we're ready for press of course
Who lose all spicy hmm
I read this universe one a lot. Like this is where I'd be really excited to find the exploit because it would be good. I
Can't buy Jeff D for a $5,000
How I don't you secure it anymore slop bullshit
fathers like breathing
You might not even be about
No marketable
Gent where cash
I mean on stuff that doesn't even have a name
Points look a batter far
Yeah, lift up the auger bug bounty program we're looking for anything worth $200,000
What's an I mailbox
What's a delegation target, let's figure this out
I'm telling target is controlled
Yeah just means they have this control arm and
I'm also excited about complete sets. This does seem like way too much logic to handle complete sets
No, if I get a hundred CAD reports that to five K's on ones were blaring
Allen to $5,000 bounty programs lose five acres
It's not hack this hacker one, uh
Make probably big thing. I wanna
Know did they not give me a fork
Hey, don't give me a fork. I don't know why they give me a fork. Ah
Fork I was like a sporky thing
So
What's a delegator
Do these factories have any special permissions
I would doubt
We have linked to the
Universe in some way because otherwise, how are they doing universe? I
Have to pass in the universe. Okay, it looks like they don't have any special permissions at all
What other report
Not rip this apart
This report is extremely good
It's also not that many lines of code
Let's really commit history
No
Oh fix some issues now
A minor can manipulate the gas reporting bond
They only got $5,000 that's not enough
Like I said, we have to be able to buy a jet ski
My Tesla's down and so I'll talk about
Wow, you should pull
Logic removed
Let's go up on Tesla, we're all oh
You know, let's listen to push a tease album even though we're getting copyrights I haven't listened to it yet. It was my release radar
I don't know man. Mrs. Drake had a kid
Drake named named one of his songs after the day his kid was conceived
I
Just like I have listened to this
Broken new dick time body
The copper please a mess with my computer
What someone hacking my spot
Nevermind they don't want me to play the copyright police came after me. Oh my god
I don't know. What would
Classic classic guile online, you know, I ain't saw him and use that against
I
Was not doing
Alright I'll say what I've acted Melissa Ling Joe
She calls me
Harder than the government
Bro
If I had some Alvin you believe, you know a good day chicky chicky saw in honor
There's this thing called the back
It's actually like this song doesn't lie if I had the Carter five
I've you and you're organized that guy if Joe Rogan would have me while I go on
You better have a rule if I going any shows it's no politics
Politics is the mind come
And talk about Louis the 15th during the French Revolution
Oh
No, I really want the girl shallow bugs in this I'm gonna kick myself when someone finds one now
And why am I auditing I
Wanna say this is dumped and I really planted $200,000
I should audit some aetherium code that's like never been audited that has just two hundred thousand dollars of eats sitting in it
There's so much money to be made doing this shit pros
Don't actually want a jet ski
Guys, if I actually got a jet ski, I really want you to think about what a hassle that would be. Okay, so
I'm not sure you can park the jet ski on land
Like I probably to be honest need a trailer for my jet ski now
and now we're gonna leave my trailer with a jet ski somewhere I
Could take it up. Am I just allowed to take a jet? Ski and go?
to the beach
We've really you stood it up ugly chest. That's awesome
that is
Nope, it's not. I made a lot of money. It's that I
Don't spend money on anything. I mean like okay, I spend like 30 bucks a day on food
But
Okay, you can actually wait let's let's go delete s and let's play trick stuff
I'm copying and pasting
Can I play it it only loses I
Can watch it I can look at its games
Might play against it
There with the machine, come on, wait, how do I challenge someone li chess?
Can I challenge the bot just sign up
Hate that
Oh
This is too hard
Alright fine real email at gmail.com. We need to don't tell me I need like to farm at
This is the worst oh
Sweet oh god, I don't get confirmed shit. Okay, I can I challenge it
Challenge to again, let's go
Real-time
And outside
Challenge declined
Let's bounce back
Enter your email. Oh
Wait, how come twitch chests declines my challenge?
No, I want to play twitch chess challenge to a game maybe it's because I set like stuff
Unlimited
Size
It's gonna make me want to improve twitch chess. Yeah. I really don't think I'm gonna find anything casually reading me clothes like this
When I find something I don't gotta do shit man because I'm real
This is America a huge American flag over there. I love America and I love freedom and I didn't got to do shit
And that's the true fact about everything anybody who tells you that you God you shit they're lying, this is America
It doesn't work I
Hate this
Has experience on shrews or acid don't talk about that here guys
Maybe it only wants to play rated
Damn and we have rooms mass in America. They're like legal here. Now. That's a lie
But you know, it's America we have freedom
Superleague, oh, man
Everything is legal like no the thing about America is like everything's illegal
But like it doesn't matter because who respects the law nobody
Because they made all these stupid laws against like drugs and shit and made nobody respectful law
They're watering to have the cannabis I have experienced this
You so good. Yeah. Yeah, I think the legal shit's a little bit worse than the medical shit I used to get
You know leach s works fine, but can I challenge twitch s to a game
Okay, if someone wants to challenge me blahblah 121 and you want to play it you want to play fast I'll play it
I'll play a five-minute game against um
So I want to challenge you right now you'll probably beat me
I'm blahblah 121
This is check correct required token
The universe get beyond universe
I'm the child universe
Yeah, that checks good put this one
Long doesn't reach parameter
Someone challenged me
Mumbai shower copies. Oh
Yeah, let go
We go with the King's pawn opening follow it up with the
Denied - right here. Oh
That's the ready attack. Oh, we're in a real Oh pens. Oh, I love the we Lopez. Oh
Yeah, I know that that's the morphe defense. We'll take the night
Yeah, thank you for your pawn good sir
Oh, he's attacking me retreat
Let's see, they should exchange
No, bishop exchange council King Schneider cleans that and I looks like the actually only Kingston will go there
Good castle sir good castle. All right
There yeah, I can't tell you guys my strategy because whoever this is might be watching this this chess
Oh, yeah, look at that freak on love it. Ah
The old retweet retreat the Queen but now this pawn is free to I believe
Yeah, ah
The old Knight attacks the Queen problem
Mmm, yeah, we might not be able to come home
Mmm there just go there
There
Oh, okay. Well now that's being uh, yeah
They're playing defensive play defensive guys. Oh
Let me check it make this throw bros, I didn't think this through oh
I thought you were gonna attack that. Okay, we're gonna take that. I just gave you ideas queen
Ah
The old retreat the Queen I love that one. Oh, yeah marks with the pause push push push push
Push push
Yeah every pawn
Bro that was a bad movie this gave me a rock. I
Think oh, well, I'm actually to throw I was eating
Hmm what that goes
Right, we gotta play a little faster half
Goes no one knows when the Batcave closed ah
The attack of that, I don't care you take that
No, oops
Hello and welcome back
Why'd you do that bro, I
Mean take that it's fine. I didn't want it to begin with
That's what I wanted to do
Yeah, well
Yeah, resign o'clock good game bro
The nine-year-old you're losing jiwan's is one minutes back. Yeah
I'm embarrassing the bad Chester G
Let's play the bye
No Oh
Who's this unlimited now alright pot doesn't work broken
Are we giving up are we giving up on auger guys I
Don't have any ideas about where to look let's just go through every contract and take a look at those bugs there
Can't call initialize twice
Those are gonna have any special authority
Let's see who gets let's check the contract employer and see who gets whitelisted
Weightless trading contractors
I'll do a five minute challenge. Okay, last one. I'll try
Cuz I did create the account which was a lot of effort
Time control. Oh, yeah
Oh
Don't work let that keep going and maybe it'll work I
Said trading. Oh
Yeah, let's go twitch chess
All right, you're white you go first
Please be nice on the chess I've ever met the Internet. What a stupid move. Well his pot sauce
Wow, this pot really sucks. I
Lost my second clean. Oh, no good thing was my second Queen
Will it take my queen. Oh, no, it took my queen. Oh, that was a good move, but this bot is so bad
Wow it knew how to put me in shit. Well that was actually pretty good move. Oh, never mind, you know
Unbelievably dumb
Yeah checkmate bitch
Oh chicken tikka masala kind of nasty
Nope
Yeah, b201 that was how well it played chess
All right things to do improve twitch chess
Did alphago complete my asset go I'm pretty bad at go
I bet even the old the old non neural things could be my asset gal
Alright so everything that's called trading apparently. Oh
These these are all trusted
These are white listed contracts
Well
Well, I may be sure that means
Okay, so what if I mess with that
I don't really think that's like useful like
Hmm
Okay, alright, so here's what I'm thinking guys this is a whitelisted contract
This would record are some interesting shit for it to work for like okay for example, like take a look at this one here, right?
Well, no, okay, we have to look out let's understand how the message sender works
Like eat all that not pass out any that monster it looked one serving
Now movies foods nasty then add that a pizza that I ate disgusting food
Sender of the message so
Can change for every
External function call okay, so this doesn't actually have to be a market
That can actually be a
So I can call contracts that say like whitelisted only
From there assuming that this is a
Yeah, like dot get universal this is actually done with a hash
There might just be no collisions here, but you see what I'm saying I
Don't know if anyone knows anything about aetherium. Correct me if I'm wrong
But like I passed something else in here. It's a contract that like it's like the like which contract like every other contract
You know, where's the one that like lets you is that a market contract
There's one unless you just manipulate open interest if you're a market
Or if you're white list
Only white list of callers
Controller a searches whitelisted message center. Okay, so this is probably
Trusted
No sir, it is white listed
Yeah, it's fine
So it'd be added to the white list so now if we're on the white list of their cool things we can do I
Think more than white list. We're just entirely trusted
Market you never
See like I like this one because it's not well
does that even matter its marked as a view but
Ah
Okay
So be fine if they were views, but like this one's not a few. So this calculate reporting fee will actually let me call
arbitrary things on a contract
Assuming they have the same hash as get universe
But unfortunately, whatever it returns will actually also have to be contract Oh
So this, okay
I can I can make this a contract I control this market contract then I can call Margaret get universe on it and
I could pass in any address there. So I just need to find something that collides with
Get or cash reporting fee divisor
That's white listed
now
enough to dig into the theory maybe I
to figure out
Who this shit works though, you see what I'm saying? Who understands the exploit? I don't know man. That's probably not an exploit
This is so this can this can return any contract I want and
the message dot sender
Will be this claim trading proceeds
Now we just need to find a collision, okay, so
We would need to find a collision in the name space with a getter cache reporting fee divisor
With something that's only whitelisted callers
Safari see if there's anything cool you can do if you're a while s good call
Oh wow
It looks like you can do anything, okay, Eddie I hash
No, that's too much effort
Wow
Just going online thing for this city I - online cake Oh
Useless
If I recall correctly, yeah, that's not right. Is it the other
Okay Webster here sweet
Sweet
Making my life easy. Ah
So the function I can call from is here
It's a few so fucking a work I can certainly call this
Alright
What JavaScript
Yeah
That's a lot to collide
No, no either for you fuck off
Yeah, so there was something colliding with that
So way for me to get control over that but like
It's not really an exploit
We would have to make it seem like it came from this contract
Message that sender will be this contract. So this is an external call
Market don't get universe. Well, actually we can let's see what that actually is
Directions a tie universe
Checking my universe it has this crap
So some functions are each other you inch that doesn't matter those returns really matters. I don't know
You don't want to read the actual assembly that it outputs
Sioux City nice out of that guy's been a while stuck down this
Alright so I was attacking this clam trading proceeds like
This one didn't know
Well isn't gonna compile
This there's no definition of highmarket
Let's get I mortgage. Oh
You get universe function and charge our universe no, you're not universe -
So I type tell me just like check something
No, this is stupid get type name function, that's great
Hi
What expected pragma import or contrast what
Was the problem
Remember div visible all because I'm not using out, okay
Alright already call them. That's fine
Okay, cool
Unused function parameter I had something called a mount. I don't know
After this compiles, can I see the assembly?
I'll go here Oscar VM
Oh my god, I
Don't need that
No, they're gonna Twitter kay, I have it on good authority
P.m. Error vert
Debug the transaction to get more information. Well good. There's what I wanted to begin with. Okay
This is total crap
Okay
So that's the call to market to get universe we can confirm that
About three years well
Yeah universe
Yeah, so notice how this number here matches
Those off-screen number down here this number here
They do match that's good. So exciting
Shorty em low. Oh-oh-oh size zero
Alright, so there's a call to physic call see the stack
That's your shall we
I can't use Ida for this call data
What's horseshit I
Have an idea guys, I don't know if any of this works doesn't work. I probably shouldn't tell you all about it. I
Mean where's the retard
You'd have to very carefully corrupt the stack
I'm not really sure you can do it
We require diving deep into the etherium vienna
But it's a cute idea
We're way over tax code size
Of the coded address a
Interesting
It's the address where let's go back to where we did they call
The clothes the coolest thing we did
Okay, cool gasp call
You can't believe you know, what bro
You
Are banned that's right
That's right a
Little bit just ignored no, no, no, but like
We want to ban this user. Oh, there we go. Mod user
Timeout user yeah, everything bad for that. Oh, no, not moderator
No, that's not what I want. What why the hell I do that timeout user
Yeah the same get banned
Now he's not a moderate but don't worry
You had the words moderator ever for like seconds good vibes only gross vibes only
Actually, no if this works
Point doesn't know so that's the cause is that to call to get universe?
I
Think it is I think this is it actually
It's this
She's actually very interesting
Um, I
Think uh very call. Yeah I get universes this
It's that so
It's here
Call eBay
Okay
Call up go has gas to value. You know, I've set out offset outsides
That's gasps address transaction value
Gasps to value
In offset in size out offset out size that makes sense because we're only sending four
Yeah
That's really gonna work because
An offset out size
Know what doing block stream shit fuck block stream
um, I mean, I think it up to get extremely I
Don't know I don't think this works I think you have to get extremely lucky
Debtor cash
Important fee divisor
Now we're not hacking anything actually I cut it I can't I kind of regret doing any hacking I
Don't know bros never looting twitch s tomorrow, it's not fun. This is fun. Fuck this I don't need money I
Think this might work so we should look into it. You see what I'm saying?
You understand kind of what the game is
Boys I don't actually need money dis regardless in the next twitch Street when I'm begging you all for money
Because I want my food twitch, okay
money
See look guys look look at all the money. I got I got I got a dollar. I got two dollars. I got $2
dollars
Rich
But no, no the jet ski will be at nightmare. No
Somebody else you know, what? How about this take this idea? I think it works like you see the idea, right?
You'll get message sender to be yours Center is set - uh-huh. This was the Evie my paper
No, no the one that like goes into like this shit
Yeah
This goes into the holy video
Basically wanna know if the call off code sets message sender
Async call
Wow that looks like exploits waiting to happen
DVM shellcode
I
Do I do on a way I don't know I don't care
Maybe I'll work for tomorrow privately. I
Don't like finding exploits in front of people
No, but here's what it is guys know what you know, why you know what you know, what's really wrong
The stuff don't of this twitch channel is supposed to be utterly and completely useless
And
The problem is this
verges on the edge of useful like this might actually be relevant because guys
Look, do you really want to contribute to the world?
Really?
It's overrated
You want to have skill and talent and then not contribute because that's funny
That's funny
Think of the opposite of funny somebody who like is
Passionately committed to causes. Oh, oh
Passionately committed to causes. Oh, that's not funny
No hate money
Yeah, I know I know you have to get the money in there now on it now, you know what
Care what people think about a thought about me but now I like dough. I don't care. I can't do it. It's too hard
It's impossible guys can't do it. It's too hard
Core of the first function to be called inside the current contract scope
Just the our contract that it just becomes the message center
Yes, this does work in theory with the message senders, yeah, well maybe I figured it out everybody I'm gonna mm ah, so are you
Wait, this fuckers back. No way
Wait, how was he back?
No, no he can't be back
ban user
Perfect. Now he's gone
Come back
No, he's not a mod no, no, he's not
Yeah, dude, let's see everyone's doing with the Malaysian kids I heard about that base deal ah, bro
Alright so who sees the exploit it's right there just diplomat that. Oh, no, so what you have to
Mmm, I
Mean you get this nice call to set up the stack. However you want
You have to somehow manipulate the stack such that that call probably goes to a different
Set of bytes
And I think
my understanding
Is is it would be out of bounds if you tried to call I mean, are there any good functions we can call in these?
only whitelist callers with I
Think it would seg fault line. I try to read that
Oh
But that's just man this is beautiful
Not a mod
All right
How's exploit
This whole whitelist things bad I think oh no, I
Always be tired guys. I guess I guess I can't do it. I guess I guess I'm auditing. I guess that's impossible
Oh, yeah, that's right. It's impossible a hacking auger is 100% completely impossible and
Yes, try to implement this tomorrow. I would be very happy if somebody beat me to it
And took the $200,000 for themselves
But
No, I haven't done it I told you everything I know like I think this works I
Think that you just have to be like particularly clever in the implementation of it
200 kgs chump change absolutely. She could really manipulate open interest
No guys no nyet don't learn Java guys technology sucks of technologies evil
What's body yachts?
Almost like 200 yards. Yeah, exactly just by yawns bad
Spy. Yeah Wow
All right
I'm gonna lie in bed and stare at this more
But I don't think it's appropriate. I don't think we have that kind of relationship where you can come into bed with me
The world is a beautiful place. I'm so happy
Active launch a no no, this is the only time I regret ever I've never had logic again. I'm putting this shit away
I'm not looking at any more. It's stupid. It's stupid guys
you could you could you could waste your life thinking you're gonna make money and then you could have money and
You know what? We're gonna leave with
Ya
You do know that he was shot right and if he didn't have money no one would shop
I'm your host for the day mace Gumbel with this last Brodie
I've never actually watch this video before
Just cost shit to code in the closet someone's got to pay my overeat spell though just steal credit cards
Just kidding don't steal credit cards kids. It's illegal laws matter
I
Don't know I've never seen
Just kidding just kidding. This is my commitment that we're done. We're not hacking anymore shit. Oh, yeah, please I need donations, please
Please please the fake money to me. I love you donate money
Donate money for the prom banning of that guy who came in here talk shit
Bolcom a happy word three commas. I don't know shit about money. I'm sure yourself self-driving cars sounds kind of fun, right?
Donate money stop with it. You'll piss me off effective altruism Oh,
Rationalists Oh
, artists with the shitty peppers
What you know the kind that like claims they're artists but actually worship Starbucks of that kind of heart
The kind who like like like barista or a latte artist. I'm that kind of artist, right?
Say scream chest I did win both my chess games a
Sandwich artist yeah, that's what I'm talking about. I'm that kind of artist
All right, that's the end of the song alright guys I will
See you all tomorrow, maybe Christmas wicks-lim maybe bye-bye
yo guess who remember to unmute his
microphone
today that's
right that's right just me I remember to
unmute the microphone okay while we wait
for some people to get in here I'll go
get
something see my other
package it did not I got a package you
guys
good morning good morning good morning
get in here get in here I got a I got a
I bought this yesterday it is a meta
Quest
um you'll never make it in holwood
baby
so we can you know ad shell it's called
a
Eureka um it has 12 gigs of
RAM uh yeah
right right it's
exciting uh so we got this in the mail
this is my meta Quest 3 Elite strap it's
slim no it's like d Quest 2o if you're
looking for something smaller than a
Quest 2 you're going to have a bad time
I would think
Elite strap
boys oh man I turned off silence on on
callers on my phone and just cuz I've
been beefing with AT&T don't let me get
into my beef with
AT&T
um but uh yeah I've been beefing with uh
with AT&T and I turned off silence on
own callers and someone call me this
morning some woman trying to sell me
some crap and man it was it was not her
day do not not ever call me if you call
me if you call me I just think that like
whatever abuse I choose to subject you
to you've opted
into right like I would never call
someone and do that but if you call me
see why would I ever want this soft
strap we got a hard strap yeah we hard
strapped
um oh I saw I saw yesterday my friend
sent me that apparently people on
Twitter like my Lin profile that's good
for people on Twitter I love when I
cross over social networks like that
let's how do I get this
in way to snap this sure there's an epq
for idiots oh
perfect all right is this the metaverse
yes it's the
metaverse oh man no no no
no
no have to take this off spin this
around oh there we go now click these
back
in now my beef with AT&T is going to be
nothing like my beef with Qualcomm it's
already over we're just going to move
off them they're dicks man but like you
knew they were dicks right do you don't
ever think AT&T was staffed by nice
people oh yeah look I'm in the metaverse
now guys okay now you can't see me but I
can see you cuz I'm in the metaverse
whoa the metaverse see look I can pick
up this
thing and drink it in the metaverse this
is the sickest metaverse ever look I can
interact with objects in the metaverse
they feel so real they feel so real I
love the metaverse you guys look at this
I have a I want a Rolls-Royce in the
metaverse look at this this is a key to
a Rolls-Royce in the metaverse you guys
can't see it cuz it's the metaverse but
you know bro I got a Mouse a metaverse
mouse and I got my microphone unmuted oh
that's that's kind of loud this one's
going to be loud wow look at all this
metaverse stuff I own I got a fuck in
the Met
verse wow oh oh that's not the metaverse
you got to go like that to go in the
metaverse oh you guys I can't see shit
now oh I can't I can't see shit
now I'm looking at my flabby body why
didn't I I wanted to look like Chad in
the metaverse why do they got all these
these avatars that don't make me look
like whoa that was that was trippy W
that's trippy man I can like step out of
my little metaverse circle and and then
I can return to my boundary you guys
can't see what I see cuz I'm in the
metaverse and you're not um wow I
thought I had a chair
here oh I do it's right
here
okay um so if you'd like to uh join me
in the metaverse uh you can buy one of
these things now I will tell you I will
give you some cautions about buying one
of these things the tech is great I I
can't believe this is
$500 um I love Facebook for making this
you know you don't see Google making
things like this what does Google make
you know it's lame right like you know
who this is for right you know like like
like like I understand that the
metaverse ad might include like a
diverse you know lower middle inome
family but you know this is for like
Rich you
know quasi white basement dwelling Tech
dudes right like you know who that's
really it's really for I'm sorry I'm
sorry that's who video games are four
I'm sorry gamergate I'm sorry that's
just the way it is boys I can't argue
with reality look look all I'm saying if
you know all right now we're not going
on rants today but you you all know the
truth right like everyone kind of knows
the truth and that's that's what sucks
about I just wish we could all
acknowledge the truth and and through
truth we can find Healing you know
through truth we can find
Healing um but the lies and falsehoods
never going to find shit and that is why
the metaverse sucks and why you might
not want to buy one of these but if they
decide that the metaverse that they're
going to make a based metaverse then the
metaverse could be cool but Mark
Zuckerberg I don't get like like like
you know man you just got to fire some
people you know what's up man be like yo
guys we're making the metaverse based
but but but if we make the B's base we
might lose out on 2% of our customers in
exchange for 98% of our customers
exactly bitch
exactly
um
exactly all right all right um topics
that are immediately banned taking sides
in wars on this channel we do not take
sides in Wars we think Wars a terrible
tragedy and we stand with the Chinese
okay so whatever the Chinese think is
what we think
great um because you know they're the
new Empire and you know we're just we're
just trying to play our part in the new
Empire right so we we stand at the
Chinese whatever they think we think
right like you know how people used to
say I stand with the Americans well now
we stand with the Chinese um you know
and I'm sorry that's just how it
is
ah um yeah all
right uh if the Chinese aren't in the
war well then I don't know man I don't I
know
uh if you can't beat him then join him
that is exactly what I'm here to do man
you know so can I buy a Chinese Quest no
come on we still make good technology
right like all right actually come on
you know where this was
made uh maybe it was made in Malaysia
let's see let's see if we can figure out
where was Quest 3
made huge Hardware bump but who's it for
that's a great question that's exactly
what I'm asking why are all these games
crappy mobile
games and why don't you make good
games
um I don't know but you can buy your
very own metaverse you can ad into it
which is kind of cool should we should
we jailbreak it no we shouldn't because
that's stupid uh that's right that's
right
uh all right it's probably on the box
that's a good point let's check the box
and then wow I'm real hyper I real hyper
be real hyper okay let's see uh by using
this product you agree oh it's UL energy
verified that sounds vaguely global
warming friendly um meta platforms one
Hacker
Way it does not say on the box where
it's made
it does
not well you know it's not America oh no
here made in China right here made in
China found
it um I don't know it might be it might
be Malaysia or Vietnam
okay it could even be Taiwan or Korea
you know hey it's a pretty nice piece of
Hardware but um yeah so it's uh it's
made in China so that is why we stand
with China China that is right we stand
with China because China made this Quest
three okay and when America starts
making things we'll stand with America
but until they do we stand with China
that's right this is a Chinese support
Channel we support the Chinese unless
they're trying to do Co lockdowns
because of course we don't support Co
lockdowns more than we support the
Chinese and that is just a fact okay
good now that we've said all the
controversial things there are to say
let's take one more look at the Quest
three oh it's beautiful Quest three
Quest three oh Quest three Quest three
WOW quest
three yeah how much is this went to
tariffs see China makes great Hardware
America then takes a cut of it for no
reason not cool wow wait serious
question are Electronics now cheaper in
other parts of the world like during my
whole childhood America was the absolute
cheapest place to buy Electronics but if
there's now a 25% tariff on Chinese made
goods are you telling me I can buy a
cheaper Quest 3 somewhere else and if so
why do I not live in that
country like is it cheaper to buy a
quest 3 in Malaysia
now
um say same
price all right all right well when
America's no longer the cheapest place
in the world to buy consumer electronics
uh I'm literally moving out out I'm done
had it with this bullshit we're moving
somewhere where they don't tax the
Chinese arbitrarily because they're good
okay great
um oh yeah no nothing's cheap in Norway
we're not moving there sorry okay Google
you can't know my
location could be cheaper if produced by
illegal immigrants in the US I actually
don't think that's true and I think
you'd have a hard time finding skilled
labor
for
like guys no no no we're going to
continue on this for a little more just
because the quest 3 is made in China
like you know what respect right like I
have respect for that right so I mean we
can break down the components of this
thing it's a Qualcomm chip um the
qualcom chip is made in
Taiwan uh it's probably designed
somewhat in America um so you know I
have respect for the guys in San Diego
who are designing chips but mostly
America is just tax on the world any
company that sells you Services services
are the absolute biggest scam I never
want Services they're they're they're
priced just dealing with AT&T it didn't
like tell me look I don't hate AT&T the
way I hate Qualcomm like Qualcomm are
there's actually something wrong with
that company AT&T is just you know it is
what it is you know I'm not I'm not
trying to do a I don't think doing a uh
uh like a activist shareholder thing
with uh AT&T would be useful right I
actually don't think that AT&T's
governance is the problem I think
they're just dicks but like okay what
are you going to do you go to another
carrier they're dicks and all just a
dick opoly right Qualcomm is actually no
like you're going to lose business if
you keep acting the way you're acting um
like Qualcomm could capture new sectors
and they are just going to lose out on
these new sectors because of how they're
acting as a company uh so you know again
if if you're a billionaire and you want
to you know be even a bigger billionaire
we can uh do some leverage buy out of
Qualcomm uh I think it might be fun but
yeah I mean like respect right like like
let's talk about what we respect and
let's talk about what we don't respect
right like like people in AT&T figuring
out how to scam you slightly better on
cell phone service no respect people
putting together Quest 3 is respect
right why do we not have these people in
America and instead we have the other
type of person right why is why is every
job in America some fake Bozo job right
like what that's not a job like the
world would literally be better without
all these sales people right there there
the world would literally be better
without most jobs in America right the
world would definitely not be better
without whoever put the quest 3es
together right so respect and no respect
right and you know that's the only way
we're going to heal this shit man it's
the only way we're going to heal we
really got to stop respecting
bullshit
um so yeah no we got to we got
to yeah Media Tech Media Tech is you
know they they they're sending me
overpriced shit they think they can scam
me because I'm an American and don't
know real Chinese prices Gua Gua Gua
that's right
um reselling Chinese Goods on on Amazon
is a respectable job I mean yeah that's
more respectable than a lot of things to
be honest like the level of
like I'm talking literally about all the
jobs in America and it's got to be like
20 30% now where if these people were
shot dead
tomorrow everyone else's lives would get
better right like like like we now have
so many people who are against the
system who are against moving things
forward who are actually making making
the world worse right not just doing
nothing actually making the world worse
right like remember that survey I did
are you part of the problem you who's
definitely not part of the problem like
who's ever screwing this together right
who's ever running the pick and place
machine that makes the boards in here
who's ever placing these cameras and
putting the little things in right like
that person's not the problem right the
kind of person who works in like again a
job where it's basically your job to
tell other people no right
um who is the bad art
friend what is this article oh my God I
can't believe we're going down stupid
rabbit holes look we were going to do
work this morning I was doing so much
work and then what was I triggered by I
was triggered by something I don't
remember why we're really hyped
up oh my God like you know what the
worst part is I kind of even remember
this it was 10,000 words and I read like
two paragraphs of it and was
done
yeah
yeah
um I think it's the person doing the job
not the entity right I I think we have
to target the people not the entity the
problem with targeting The Entity is
corporations are psychopaths right we
just have to accept that we just we just
have to we just have to accept that
corporations are going to behave
psychopathically right you can try to re
them in with regulations but there's a
much better way to re them in and it's
just like people need to say no like we
we need a culture where people care
about their jobs we need a culture where
people don't want to be a drain on
society right and if you want to be a
drain on society you know bullets are
very cheap right and I mean this like
this is going to be the only way to deal
with this shit like I I can't believe it
we have so many people out there who are
literally making everybody else's lives
worse right and I want you to really
think about that I want you to really
think about does your job just make
everybody else's life worse
okay there's a whole lot of people who
do this
right think about all the people who
block housing right think about all the
people whose job it is just to stifle
other people
right your job makes life worse see we
got one acknowledged here right so stop
doing it man like stop you are very bad
person right it's that
simple no I'm not trying to say these
people have names and addresses right
like we're never really going to fix it
from the outside we have to fix it
culturally we have to have your friends
shame you we have to have everybody
shame you we have to have everybody say
that what you are doing is not okay
right I'm more okay with murderers and
drug dealers than I am with you right
not not you
know uh indiscriminate murderers but I'm
actually more okay with murderers and
drug dealers than you because murderers
and drug dealers everyone in societ
Society understands what they are and
who they you know what they do right
it's these people
who they are just taking a tiny bit from
every single person and there's so many
of them now and you know we just the
only way to deal with this is
shame
um guy with a comfortable AF life give
up your job peasants well yeah but my
life wasn't always comfortable right my
life was comfortable because I
structured it to be
comfortable my life like when when do
you think my life was comfortable when I
lived in a van right like you know when
when do you think my my life was
comfortable when I didn't have money
like no I I worked I earned money and
now my life's comfortable because I'm
not you know 181 19 anymore right if
you're 30s something and don't have a
comfortable life like ask yourself why
right yeah exactly I mean no one's 20 no
one's if you're comfortable in your
early 20s yeah you were born with a
silver spoon in your mouth right like
you shouldn't be your early 20s should
be uncomfortable man I used to be too
cheap you know I brought my girlfriend
to Canada on a road trip I was too cheap
to get a hotel room so we had to sleep
in the basement of a college I'm like
look you could just go to any college
and sleep in the basement no one's going
to bother you man you're like sleeping
on like a little couch at 4 in the
morning right like you know so don't s
in the struggle bitches you
know
um how comfortable was early 2010s
China I mean comfortable I don't know
like I wasn't rich the cool thing is you
didn't have to be rich
right um okay okay let's code let's code
let's
code yeah how comfortable was getting
fucking sued by Sony you know you want
to talk about struggle that's right but
this isn't going to be a struggle
Olympics guys like you know there's
definitely people who have it worse than
me there's people who have it better
than me I'm somewhere in the middle
right you can't control that all you can
control is the choices you as an
individual
make right all you can do do is control
you don't choose where you start but you
do choose where you end up right and
anyone who doesn't believe that the only
cure is a
bullet uh is there is there free
will uh why does it
matter uh what I don't even get it
man you wearing a blanket what you like
you like my like my sweater boys like my
sweater free
Willie all right Free Will is the
stupidest circle jerk conversation ever
so we're going to subscriber only
chat okay so you guys remember the
example from last time hand code reset
50 so it actually got
slower uh
yeah yeah use tensor course
okay so first off this one was kind of
stupid we'll get rid of that we get rid
of
that uh
iftc wait I use tens okay a
[Music]
plot Mario Bean thank you for gifting
Subs I remember you gifting Subs last
time
um you are
great okay hopefully we're now back to
kind of where we were why is this so
slow it shouldn't be slow Mario been
living that Ultra comfortable life I
don't know about that uh oh okay
so yeah the problem is tensor cores
don't always get applied right
so sometimes we get two here and
sometimes we get
one problem is we weren't doing any
optimization okay so you see those ones
can't even use tensor
cores why is this so slow what's going
on
here
oh you see the
problem well no I mean if you're if
you're comfortable in your early 20s
it's because you were born rich right or
you you had someone like watching out
for you
right um but you know your early your
30s are up to you
right
College basement sofus i s on the princ
and Library once it was pretty nice the
sofa Mill it was less nice I slept in a
room in Cornell that was
chill um can I give a quick overview of
what we're going to do okay so this is
just what we wrote last time I'm just
fixing it to match the new
API
uh so here let's just
always try and coded
op
um maybe
try a
tensor
course
requires one positional argument use
tensor course wait
what oh yeah
whatever just going to make that equal
one
whatever okay great so now this is
optimizing the resnet uh
50 and it's going through all the
kernels in the resonet 50 and figuring
out the speed of them okay so we're
getting 392 milliseconds and you'll see
like this one here we try both with no
tensor cores and with tensor cores here
and so for ones where we can optionally
use the tensor
cores uh we try tensor cores
okay cool um now let's add a new kind of
search right so this is the speed at
which we're running and I can get rid of
debug equals one so you can just really
see the whole thing um this is the speed
at which we're running a resnet 50 with
batch size 64 right so we take the reset
50 um and then we figure out what
kernels are actually used to run it and
then we optimize the
kernels
right
cool uh so we have some new fun
infrastructure that will let us use that
will let us use less of this so I wrote
some new code and we can read it it's in
code gen search so it's a bunch of
functions time
linearizer um so time linearizer returns
a tle of two floats uh one is the
returns time in micros seconds and
gigaflops uh from
typing couple in a
linearizer uh why don't I have a
linearizer oh I don't import the
linearizer I actually need the
linearizer but we should do it
anyway linearizer linearizer
okay
um this also takes in a linearizer and
Returns the buffers and this takes an A
linearizer and returns a dictionary from
an INT to a
linearizer uh where you can see all the
possible actions okay
enumerate uh actually let's go over
quickly what an action is and all this
stuff is new okay so here's a whole
bunch of actions see we got some
upcast some
locals um this line is really really
really long
unfortunately uh there is 160 possible
actions that you can
take uh and then these actions are
upcast axis one amount 21 upcast axis 3
amount 27 I got all these actions by
generating a test data set of kernels so
I generated a test data set of a huge
number of kernels actually we can see
them they're in Sops so this is a huge
number of test kernels from all the
things in uh tiny grad so what's a
kernel if you don't know what a kernel
is you got to watch a lot of videos
because we're not going that deep but I
will show you all the stuff that's new
so I have a
file um
in extra optimization called generate
data set and this will generate uh all
the operations basically from all the
tests inside tiny grad so these are all
the possible actions that are taken by
all the possible kernels uh in all the
hand coded
optimizations uh get dictionary of all
possible
actions um okay and then this is a raw
buffer. runtime. lib import raw
buffer so this is going to be
a list raw
buffer and this is going to be a list of
Rob
buer and so on and so
forth okay
Okay cool so it's basically these three
functions that I wrote Time linearizer
Buff from lens get linearizer actions
now you'll see that we can start to use
some of these instead of the other ones
we don't need that
anymore uh tiny
gr. Cod gen. search
import all right here for example we can
do
Lyn Buffs from
Lynn now right here we can say Buffs
from l
l so are we are we doing good using the
using the new infrastructure it's all
about building infrastructure guys
everything in life is infrastructure you
make your infrastructure good your
Singapore you make your infrastructure
suck your Somalia right it's all about
building infrastructure why are those
buffers slower that doesn't make any
sense or that might just be measurement
error I don't know let's run it again to
find
out they're slightly
slower I can't believe that they can't
actually be slow can
I they're slightly
slower
don't really understand how that can be
but
whatever uh buffer items Max size of all
the ones that come in that's
fine can I make the font a bit bigger
yes only because you gifted Subs
normally I'd tell everyone to fuck off
with that request but since you gifted
Subs of
course so there you go it's a little
bigger I can't make it too much bigger
because it's really hard for me to
say
um okay and then
this should we just not return the time
in it's a little Annoying that we don't
use seconds we should probably just use
seconds thank you for gifting more subs
uh yeah let's just not use seconds right
return time and seconds
right okay
cool um so here we have
time
linearizer oh and here we can just use
instead of linen for flops we should
just use G
flops can import time linearizer from
here uh
ly we don't need
this this should actually also be faster
because it doesn't always do the whole
thing so let's just copy and paste this
here and write G flops equals
that uh
choices everybody has
choices
um we're missing raw boxs we got pass
the raw box
in uh linearizer object has no attribute
display
name yeah because we don't actually we
copy the linearizer here sure we're
going to do that
anymore I'm actually going to leave that
and get rid of display name here change
this I added some
new I kind of like this play name
actually it's kind of cool never
mind
uh so yeah I mean if if you're not
following this uh go watch last week's
stream um good s a little slower too for
some reason but whatever why is this
faster that's a real
question get to the bottom of that at
some point okay uh good we don't need
this crap
anymore
see if you bug equals one still works
great okay now so does everyone see what
we did we just kind of took what already
existed but we rewrote it uh in terms of
the new infrastructure uh now we have
some even crazier new infrastructure we
can try a greedy search uh we won't use
Buffs one let's just do that for
now
a little bit slower it's like a couple
milliseconds slow wait a second oh
that's slower
too uh okay so time linearizer is not as
aggressive time linearizer does all
these things which should actually print
Factor here let's see um factor is this
thing in order to bench Mark so you see
these things here if they're really big
you don't actually have to Benchmark the
entire thing you can just Benchmark like
a subset of it and you get pretty much
the same thing these are the global
dimensions in CL so you'll see some of
these are using like a reduction Factor
just in order to get more speed uh when
we are when we are evaluating the speed
of things
so
great
um try
a Brute Force
search
uh okay so while
one
um I have of a so I shouldn't say a
Brute Force search I should say try a
greedy
search I have another file here called
greedy uh we are first going to time the
[Music]
linearizer then we have another function
here called get linearizer actions this
shows you all the possible
actions uh that you can take from linear
Riser uh so again what are these actions
we can do things like upcast we can do
things
like uh
local we can do well the whole list of
actions is here an Optimizer upcast
local group group Top you choose an aess
and you choose an amount and this is
like an optimization
action uh okay so we want to time all of
these
okay time lin. keys in fact here we only
need the time I don't really care about
the Giga
flops so we can just get the time
here on
values
Min time l. values is less than
time Min time L values greater than time
break uh then here we want to do another
one uh we want to say Lin equals active
Lin sub time Lind
uh we want the argument of that how do I
get
that
can you increase the font size did you
gift any subs no you didn't gift any
subs why would I increase the font size
for
you you are a sub but I don't
know you sub that's not how it works
normally everyone asks to increase the
font size and really this is a problem
with your monitor
um but since Mario being gifted so many
Subs we're of course going to increase
the font size for him man I regret
subbing you you know what font got
[Laughter]
smaller no we'll leave the font the same
oh oh I regret subbing you wow what a
guy man what a
guy if you sub 100 people
um
no cuz you're only doing it cuz you're a
dick and you know we can't we can't have
that right like I'm not a greedy guy we
live in a nice Society here right like
this welcome to my nice
Society
um which okay wait how do I get
argman imagine regretting five bucks
all you're just joking all right all
right that's good that's
good um okay wait how do I get ARG Min
you see see what I want to do I want to
get the one that's actually the minimum
here
uh I guess I could do
this
okay
well why isn't deep copy
working how come deep copy was working
before and it's not working
now oh maybe cuz I got do it in that
order yeah that's
good here okay so this is the linearizer
and all the times they take
right so you can see this one here
takes
what that time doesn't make sense oh
maybe it does maybe maybe that's
actually how bad it
is cuz that's like a lot a lot of
milliseconds
man okay well if we take action 82 it's
the best
action
uh okay if
opts
subz sub
one right Z sub one is less than time
we're done otherwise we'll take acted
lens op 0 0 right uh
now let's print lyn.
color
oh man why could I not copy here I broke
something
okay that's at least working okay so you
see it's now searching and it found that
and it found
that um here what I was doing here was
also printing the
uh
no attribute display name yeah that's
because we have to not copy
[Music]
here so see all right there we go look
that one's faster
oh man that's so much faster
now right look at that see this one here
was taking
11.94%
milliseconds so when we're done with
this we're going to lens. append
Lin and we're going to comment that out
because that's
stupid oh well you know we'll gate it
behind a
debug debug equals 1 now we're going to
see all three options right so we have
the hand coded option the tensor core
option and the greedy search option and
unfortunately greedy search is very
slow but look 7 milliseconds instead of
11 and only sometime we get that error
okay
um
if Lan opts equals zero or yeah okay
good fine we'll do debug equals 2 we'll
put this in debug equals three oh that's
not showing me all the launches never
mind I don't want
[Music]
that all right so that's like the best
one there right now finds another one
that's seven okay
cool right but now instead of taking
11.8 we're taking 7.01 now it's
optimizing the next one
uh yeah look this is faster I mean it
didn't get that same time there but it's
faster uh okay so this one the greedy
search didn't win the greedy search was
slower than the tensor course which was
a
fastest um I'm also going to print which
number kernel it is so like you'll see
that I can comment out the greedy search
here and it's like still
fine
uh I'm going to put the number
here yeah I I did that I don't know why
I didn't oh it says Colonel 31 oh I
don't
know okay cool so last time we were at
kernel 2 we were at 13 milliseconds but
now we're at 8 milliseconds that's so
fast boys that's so fast now we have
infrastructure to do a greedy search and
the great thing is we can replace this
infrastructure with any kind of
intelligence search I want so when I
mean the search is is greedy right does
everyone understand like what this kind
of looks like does anyone remotely
understand what this kind of looks
like
okay why are you subscribers off
topic we're programming now why are you
off
topic it checks every permutation but
it's actually not every permutation it's
greedy right so there's an action space
of actually you know what I'm going to
add one more thing here
um okay so like it checked 36 actions
and it found the best action was to make
that 16 local it checked 39 actions and
then it upcast it that 16 checked 31
actions up casted that two checked 39
actions up casted that four so it's it's
it's greedy in the sense of it takes the
best action at locally each time step
and each thing's about there's about
five optimizations applied this one had
a bunch
more um and didn't even end up winning
because the tensor course
won all right so remember that the reset
was at about 400 milliseconds when we
started this let's see now what we can
get it down
to see that one greedy didn't win either
that one both hand coated optimization
and tensor cores were
better this one tensor cores
one so you see this middle one here is
tensor course because it has that weird
thing that's hand coded opt and that's
greedy I'm actually going to
also
um thread group memory size exceeds the
maximum allowed thread group memory size
interesting okay well we only made it to
Colonel
7 uh I'm going to add count there so for
this one I'm just going to do a bunch of
allow test size equals false count 10
should copy equals false right and that
kind of matches the old
Behavior okay so this is this is just
the old behavior of the function we give
it 10 tries we don't allow the test size
okay so we're at
394 um before we errored out there we
were
at uh this
okay uh let's just wrap this in a tri
except
actually because this would have to fail
okay that'll re raise the
exception that's interesting it's a
runtime failure what I really want to
catch is compile
failures so you see how all this
infrastructure can be used for fuzzers
too um like that's that's where I really
want to go with this
uh I want to get this to the point that
we are uh that we're
fuzzing all right should I throw a quick
cach on this just so we don't have to
sit
here Google has a tle competition about
training a network to predict run times
yeah it's really very similar to
that um just ignore the one that
crashes uh yeah that's a good
point yeah instead of re raising you're
right what what I can
do instead of Ray z here I can just
return float INF uh zero
that way it won't get
picked Contra will never get picked
there okay uh we need to we need to cach
this
quickly what I using K I have some like
stupid cash
thing
shells
and call this the greedy
cache
uh okay if
sterlin
in global DB
um
does this like
[Music]
work or AO
in
uh uh l. apply
op
Global d subst
l. l. applied offs does that
work or do I need to pickle it is it a
string thing or will it auto pickle for
me okay now let's try running that again
and see if we don't do the first one oh
great hope we didn't do it okay cool U
for some reason I didn't add the linear
on but that was probably my
fault no should apply the Ops there oh
no there's no tensor CES there okay
great Okay
cool so I just I just put a cache on the
greedy uh it doesn't this one test 10
times all these other ones are doing it
uh three
[Music]
times like if you look at the default in
search it's count equals
day
see it's fast now okay we're at kernel
11 with
27 milliseconds and we used to be a
kernel 11 with 32 milliseconds we've
saved 5
milliseconds how much is the variability
of each run uh I don't instrument that
right now like these would be good
things to instrument and it'd be really
nice to just start like
um
uh also we're also not checking the
correctness of these things there's a
chance that some of these Ops are
incorrect so you know fast first and
then correctness later but we should be
checking the
correctness see like a look we save 3
milliseconds there oh that's pretty
nice 3 milliseconds there oh this is
going to be
fast okay so we also don't need to be
this greedy we can also try other search
strategies now like never grad but our
infrastructure has gotten good enough
that we can like write a greedy search
and not that many lines with basically
get linearizer actions and time
linearizer so in the same number of
lines we've written an example that
uh
yeah watch is variability well it's
clearly something because this one runs
it again and it's not
good it's like tacor wi
there handc op wins
there
oh and cool if it hits the same kernel
again I guess it just uses the same
uh it's going to be the same as so
that's
nice
okay we're sitting here watching
optimizers on that's never
good
uh I mean this isn't that slow though
we're actually searching very large
search
space see this one lost to the hand
coded we should be writing a
fuzzer uh to check to to check the
correctness of these things but I think
I'll leave that as an exercise to the
reader um I'll try to Upstream this uh
after the stream's done and then you
guys can play with it so this greedy
search is just one way to search the
space search messing with searches is a
whole lot of fun uh so I I think that
like you guys are going to have a good
time um messing with like all the
different kind of ways to search this
space so this greedy by the way is not
it does not search all the possible
points in the space right you can
imagine each node like at the first node
there were 33 things out right and then
we expanded node here and then there
were 31 out and then here we expanded at
node 20 right but there's lots of other
ways to search
spaces um so we can try these searches
and we can figure out which searches are
the best so I think turn greedy off try
your resnet and see how much better you
can get with greedy see like look at
what a win greedy was there 30 you know
32,000 Giga flops instead of it's like
three times faster for that
kernel um why not extract the search to
a
function yeah could but it's not a very
good search right so I don't think it's
time for it to be a function yet I wrote
like helper functions that are pretty
useful um we should probably figure out
why Buffs from Lynn is
slower if you did search every
permutation it would always win or Draw
with hand coded absolutely yeah because
all of these action spaces are available
in hand coded so you you'll see where I
generated this
stuff um in one of these things here I
actually confirmed that to be
true I don't know where it is but uh
where I actually generated the action
space so this is like junk cleanup code
I was like trying RL stuff and then I'm
like it's not time for RL let's just
write greedy optimization and see if
it's good oh this is lagging the
computer W look at that there's another
one what a win
okay it took some bad step
there but it found that I don't know how
much faster than that's going to
be so I can go into a little bit about
what the
wow look at that 10 times
faster that's so good sorry not like
seven times faster so what these things
are is these yellows are output space
these purples are unrolled Loops the
reds are reduced Loops the cyan is uh
locals and then the blue are globals
right look at that speed up look at that
I have no idea this is going to be so
fast uh I could add a summary to see
which method performed the best yeah I
mean you can kind of just look at it and
know it right now now but I could I
could label these linearizes where I add
them right like I try three kinds of
things um but this is a good place for
people to play with search algorithms
and this is the main thing I wanted to
show off uh which is just like how easy
it is now to write searches and Tiny
grads for fast stuff um we're going to
see how much better we do and then I
think uh that's today's stream nice
short stream uh I'm sick of doing a long
streams you know they kind of just like
I go in we start with a little rant uh
and then you know we we we rant about
the phonies and then we we uh do a
little bit of cating and then we're
good how many Colonels were there
forgot oh we're almost done okay so 58
so we're at 48 and we're at 167 oh man
oh man this is
fast this is way better than kop equals
2 ever was we used to have an old
Optimizer in here called kopt Equals 2
and kop equals 2 was like just it was
terrible it was not well thought through
it was bad
code um the action space wasn't well
thought through but now we've thought
through the action space we've written
helper
functions oh my
God
look at that
speed we'll raid lcks
absolutely look at that
speed let's turn the debug
off we just doubled the
speed M1 Runners on GitHub do I have to
pay for them or they just are they just
good oh it just looks like a public beta
Oh that's oh beta N Pay how much are
they oh that's
expensive it's going to cost like a
dollar every time we run the thing no
per
minute what that's
insane it's $7 an
hour I can get like I can get like A1
100s for that oh it's so
expensive
okay take a look at what we just did
there with greedy equals z without the
new greedy search with just the hand
coded optimizations and tensor cores as
an option which is not even as good as
what's normally in tiny
grad we're getting run times of 393
milliseconds when we turn greedy on now
we're using cash greedy it's way better
than kop ever wasse and greedy still is
not even searching the entire space I
think we can beat this with
reinforcement
learning I think
that's well that's undoubtedly faster
than torch on this platform torch on
Torch on this platform is not that
good
um yeah we can apply it we can apply it
to hlb C
far uh yeah I mean that's mostly what I
wanted to show you guys just how easy it
was to write a real search and we just
have the running speed of that thing and
yeah well okay we can look at our
gigaflops there right like we can look
like all the stupid slow ones got fast
oh remember that one that we tried to
hand optimize last time that's like the
only one that didn't get
fast like look at Colonel
50 no not 53
we 53 like look like we doubled the
speed of it um so we're searching you
see these see these uh and I don't know
if the ones that use green are actually
correct I hope they're correct someone
also needs to write a fuzzer for this
okay so we need a fuzzer and we need
improved search
methodologies um we need and the key to
search also is being fast like this
search is way too
slow uh I'm just going to push what I
have
here
[Music]
um I will leave you guys with a bitter
lesson uh where can you find the
previous streams you go to George hot's
archive or you can subscribe actually
you're subscriber so you can just watch
them right here on
Twitch um yeah we really picked the
wrong one last time yeah we got unlucky
I mean even the even the auto opt
couldn't find better ones really for
that uh but yeah we just doubled the
speed and this stuff is super Universal
too so this is going to make not just
Mac fast but it's going to make every
platform fast and then like I said we
can do better than greedy right so
unfortunately searching the entire
search bace now is like a massive
massive thing um if we wanted to search
every kernel in the search space we'd
have to it'd be combinatorial this kind
of um so let's just like get a let's
just get a quick
idea yeah we' have to search something
that size um and that's assuming that at
each node like it's the same number of
actions right so it's possible when you
expand like from this 23 we only
expanded this node can you guys all see
this is a graph like here you are at the
top node there's 23 lines coming out
then you go to this node there's 25
lines coming out then you go to this
node there's 25 lines coming out so all
the possible permutations is something
like 5.4 million um so this is a greedy
Optimizer we can also try improve never
grad in the new space I have an idea
never grad in the new space is going to
be a lot better than the old kop was um
also this time linearizer function is a
lot faster than the old one because of
allow test size and you can look at time
linearizer and you can see how I wrote
that basically if the global size is
large we divide the global size and then
just multiply the runtime by what we
divided the global size by
later uh
yeah if the pruning algorithms they use
for chess search I mean it's really it's
it's the same and then like at each node
you know this is like simpler than most
RL because at each node you already have
like the exact value you know the exact
value of the state and the value of the
state is exactly you know it's R
time um take random samples from the
search space and use gradient descent to
find the
bottom uh how can you use gradient
descent I don't know if it's what are
you taking the derivative of um you can
certainly use evolutionary algorithms
right there's no real there's no real
derivative and that's why you have to
use RL and
stuff is what kind of I mean yeah so you
can try like I think you could write
never grad in here uh you think anyone
can get it on under 100
milliseconds well you know what let's
see what the
theoretical can I just average all the
gigaflops no I can't average all the
gigaflops okay
you can do running G flops equals this
and then what I want to do is this
equals g flops times
time divide that add by total
time so now we're going to see the total
gig
flops so you can see the ones that use
tensores get almost eight uh that
matches this match is like the best you
can get with uh with what I
do
[Music]
yeah sure sample two points next to each
other sounds
good um yeah you can write all kinds of
searches
here okay wow that's still a pathetic
amount of
gigaflops we can go way
faster so that's 2.7 Tera flops the
theoretical Max of the GPU is something
like
uh I think the theoretical Max of this
GPU is
10.4 so let's let's look it
up yeah
10.4 stop it asking for my location who
I'm multiplying things Google you're
being creepy okay so we're at
26.5% model flop utilization like we can
do
better um but wow the other one must
have been really bad like without greedy
it's a terrible number of
flops can I use Simple branch and bound
algorithms well I don't think anything's
really guaranteed to find the global
Optimum wow we actually made it twice as
fast cool um also we didn't check the
correctness so again if someone wants to
check correctness of this stuff uh
that's cool
too
yeah
hey
guys do we have anything to talk about
in the last couple minutes of the
stream I just wanted to show you that we
made it fast that's all and how you can
how you can help make it fast you can
test this on your Hardware tiny
grad if we write a really good RL
version of this right like I said this
is not the best you can do this is
greedy if we replace this with RL the
beauty of RL is once we train the model
there won't be any time at runtime at
runtime it'll just you know be it'll
just pick the best action from the RL
and and plow through all of
it um so we're going to be able to get
the speed of we're going to be able to
get like inference
speed part of the problem with some of
these things like you can use tensor RT
you can use TVM they have searches but
the searches are very very slow uh and
we can get into like why that is and why
they don't just do this but it's a lot
easier in tiny grad to do this because
we our action space is a lot smaller and
our action space is a lot more
understandable they have action spaces
that are a lot more complex you know
it's not clearly expressed rest as like
one shape tracker um so I have some
start stuff with RL I have some like
getting features from the linearizer
putting features into a model uh you can
check that stuff uh on my Branch but I'm
also going to merge this branch
in uh with this and then we can start
using those search
Primitives and also if somebody wants to
do the cleanup work to rip out the old
one that would be great too we can rip
out the old Koop stuff replace Op with
greedy Koop greedy kops a lot better uh
and then also you can try to use never
grad here and I think never grad might
even be greedy but now we have now we
have real benchmarks like we're not just
like kop is like a throw things at the
wall and sometimes you got lucky this is
a method methodological way of
approaching search and if you approach
search with a methodology you get
success if you approach machine learning
with a methodology if you slowly build
up infrastructure and then only when you
you've you've pushed it to the Limit
with your hand-coded search then you
start to use really fancy search methods
like RL you can blow past the hand-coded
search but if you can't beat hand if you
don't have a good hand-coded Baseline
yeah you're not going to you're not
going to beat your search with uh right
like think about you know remember that
remember twitch chess when I tried to
write a chess engine and I ended up just
writing the stupidest greedy search and
it beat me yeah
uh okay oblo Eng glaz um
and
Mika no ESP and
Mika
uh no ablo
Kama Portugal as Malo no to Portugal
oh you're a subscriber wow I didn't
notice the star next to your name you
know what there's tears of subscribers
and there's some people who talk about
being a subscriber look there's some
people who just drive a Rolls-Royce and
then there's some people who bring it up
every stream right like you know what
I'm
saying
um performance and safety choose two zig
has four are you Shilling your your
language or never
useing want to change the star to a
common no then I have to learn how to
use these
platforms um now I'm kidding I just
bought a Rolls-Royce key so I can talk
about having a Rolls-Royce you think I
actually bought the car guys why would I
do
that uh no and then I use stable
diffusion to generate pictures of me and
a Rolls-Royce and then I post them to
Instagram
uh so suggest some stuff to read if I
want to get familiar with this Library
yeah the library it's
short can read all the code in tiny grad
it's
4,471 lines this is all the code in tiny
grad and most of it you're not going to
have to read pick a card of flex what my
Chrysler 300 isn't flexing on
you um nah bro bro I got a 2008 Dodge
Charger
bro sey you're going to get banned
you're G to get
banned you know I ban subscribers on
this channel
right I'm rich and want to spend money
on your product why do you put a space
in between the last word and the
exclamation point whenever I get an
email like that I'm like g h third
world 2008 DOD Chargers flex and
Cal when am I running for president I'm
not guys I'm just here to enjoy the
decline I learned that from Aaron
Clary Indian scammer Vibe yeah yeah
that's right law exclam space
exclamation
point you know it's the little things
that give them away
uh it's against the law to ban Subs yo
yo uh all right but no what should you
read to get familiar with tiny grad you
should literally just read tiny grad
it's very short you should try some
stuff mess around with
it
uh
yeah no no no not this again not what
law on this
stream all right you guys go be nice go
be nice to let's see let's see let's see
what LX is streaming uh we should do it
from this
browser security
guard wait you're advertising being the
producers of Megan I couldn't find a
have you met them yet hello I watched
Megan I wouldn't advertise being the
producers of
that I don't know why my ad block isn't
working for this go home now
did I see the Lex metaverse yeah how
come my metaverse didn't look like that
in my
uh hey I'll be right back before all we
tested so far so
good
um oh no you know I to do couple more
things I got to do the camera position
when did strain come out I wonder I
Chang all right
enjoy spot was F just the camera wasn't
and the camera fix
camera switch to third person
you right
back oh
no no I thought we were going to test
things
[Music]
no look who did I just saw a tweet about
you oh my God it made me laugh hey
George what's going on you guys know
jots
hello dead
streamer I saw I was just s about you
today it was your LinkedIn profile you
probably saw it it had like thousands of
likes how is your stream welcome in
guys yeah I'll go take a snack break
later what I oh you got to welcome so
you guys are joining welcome my name is
l I'm a game developer I'm making this
game
strain it's a first person survival game
where
you are stuck in an apocalyptic City
post-apocalyptic City and you need to
survive it's walled in you got to turn
on electricity build generators and
other staff shelter trap stuff scaven
stuff F off other wild
scavengers navigate the storyline punch
stuff smash
stuff work our next president of
Portugal
okay I didn't know that was on the
agenda
uh are you working this alone yeah for
the most
part hiring people to help with things
where I can mostly asset creation CU
that takes the longest time
honestly voice acting of course hey
Mario thank you for the bit who just
talking about on stream what's that
which
thing can you go on a date with him he's
really shy I've noted yeah he seems
really really really
shy but nor my Bible contributions I
would rather go to Portugal for that
wait I'm missing so much my friends
sented to me okay LED s how was that
stram I thought it was testing things
time oh I stepped away just as you rate
it that's okay I heard the sound I was
like let go see what that is I know who
that is it's always a bad timing with r
one thing I noticed is a lot of people
are like oh oh no you just raided me bad
timing and I realized I'm like oh I'm
raiding you because I don't usually see
you
on so like a lot of the
time I raid people who I'm like oh so
and so's on I finally get a chance to
raid them but they're only on because
they worked way longer than they usually
would so they're probably going to wrap
up soon I don't it's not like I I didn't
plan that but I see them on I'm like oh
I'm going to ra them and they're like I
was just wrapping
up and uh there's there's a lesson there
and it's never stop
streaming never stop streaming is a
lesson president being president of
Portugal how much he loves
Portugal I've never been but I heard
it's pretty
cool is it a is it a good place to be
president
of so let me show you show you again a
bit oh you can't build here because
we're not in the build areas but you can
fight you love Singapore oh wait no you
can't
I oh my goodness what
happened I don't know what I did there I
just
[Music]
[Music]
you
you
[Music]
okay so that was this morning's
artist her name is Kate oh she's lovely
beautiful absolutely beautiful I know
beautiful music that's right we're busy
with capitalism now so we have this they
released a complete slam front end which
is kind of cool one of the are this
shit's gonna work no understand what
this is bullshit hopefully I won't come
off any more good fix that now let's see
if we make this work
girl admiration is that yerba mate a
talking I don't know man
so you guys see this is like what my
slam fronting looks like it's right here
I always see a lot more if I kept it
over multiple frames but we can switch
up the front end if we can use the super
point pre-training network demo super
fuzzy this gonna work
oh oh oh module object has no attribute
rebuild tensor v2 oh that's that's all
that's great upgrade torch may be newer
torch oh yeah good guess bro okay so
what do you guys think it looks as
shitty as orb actually to be honest my
looks just as good should we modify the
slam to y'all bro no no no hair it's the
same back to my office okay this
actually looks kind of shitty
see if there's like options with our
options I make like the real image
height oh I need - - I've already to put
those before the input oh well that
looks like vaguely better vaguely do we
think these points are better than
I forget how come when is my front end
for this thing over there right like
nothing
did you just a try
no okay yeah I understand they curve it
as a small path my points could do that
too should I have them do that there
should have them do that but a slight
display thing I can just change that if
I make it that big you'll see the whole
thing
[Music]
you
like care about people love that much
empathy is overrated
gross
I did that twice all right there you go
look my nipple long Naoto look I have
long ones
Yeah right look I can do it too maybe I
feel terrible just right this looks like
shit oh wow
okay it's a little bit cheating because
it's going back really far
[Applause]
see the problem
sure in the Pats well so the problem is
just shortening the Pats the problem is
the fact that mine are going back mad
far okay I really could just do
something simple like this only show the
last five frames but it's not really
what we want to do what why is that not
subscript oh oh oh because it's object
just fuck you Python 3 oh yeah
drink twice like that but let's see if
this isn't gonna be what we want really
it's a little closer to what we want but
the problem is that's they have to be
continuous spray there's you think the
simplest way to write that so you can
certainly get the frame IDs you'll see
it we want up to 5 IDs let's say going
back that are contiguous maybe problems
like it can be found in a previous frame
so you see what I'm going for here right
three two zero weight one what do these
things not get out of an order
where do I add the point oh I think I do
okay so now they're in order so now we
check if yeah few months of 0 is not
equal to P 2 then break
sure I mean this looks right right oh
well no no no that's not right
now as long as it's contiguously tract
Wow those points I guess doing such my
projection but still let's look at look
at what super finds output which slim
has a size doesn't use the same size try
that
well like this one like a max back it
can display suicide
yeah it looks like there's a max back in
this plan
is that better Richie's happier
let's actually write this a little bit
less stupidly there's a few ways I can
write this less stupid like
- it
Oh polygon I want like multi line you
don't say polylines this what I want
their points is closed
no so what we want to say is how do you
know
pick up the collar backwards Wow maybe
it's like some of these are only one or
something that seems absolutely right
points array of polygonal curse
Oh disgusting P check factor 2.4 I don't
know what that even means
just let my limiter to five right
looks like your dirty code now the idea
is not not well okay so this checks
completely broke and you guys you got to
catch my shit and Elif ID plus one you
gotta tell me George you're writing bad
code you got to remind me when I forget
to do things like that better oh this is
what polylines probably does
I had to explicitly convert them oh
there we go it's a disgusting read I
know what goes trash
it's not better that's pretty good
looks as good as super point right
yeah I think those matches are all
correct speed on kitty
it looks pro at
and the long ass trails
we'll see I don't think I don't know I
really don't think orbs jumping around
is a big problem like I don't think if
we switch the front end it'll help that
much in China kitty yeah I don't
understand why you can't get that from
the video no huh it's over there
look better ball slow
okay I can't tell I really can't doubt
that is that better than this it's very
similar what you like their colors yeah
okay they have colors out what are the
colors correspond to we can make colors
what do you want College what do you
want colors I can Mike to make colors
let's see what colors Karsten good side
what kind of shitty ass license is this
license a fuck oh my god
release open source code fuck you magic
leave I mean like I appreciate that you
release this but really just so you guys
know twitch slam is MIT licensed you
guys can use it for whatever the hell
you want I don't care
can't sue me though fuck y'all if you
sue me I got lawyers brah is it distance
from optical Center I don't think it is
think it's is that
looks like this one's that color
it's estimated distance to an orbit
pinhole camera do you actually know that
or you might be right no it's a point
confidence heatmap well this is I still
my chat
see I can't even steal their colors I
choose gel their colors
no it's confidence is what they're doing
it's not it's not that we can do the
same thing we really you really want
those colors I know they look kind of
nice don't die
line 16 tracks
cor
whatever track sub one is I don't really
know so it's whatever track sub one is
here
that's the color
they tell me
see what let's see what the map looks
like
coffees
it's actual pretty cool paper we go
distance what kind of distance do you
want
and pick our lives they didn't even use
polylines as shitty coke now I'm mostly
just mad at an open source it like
please please shit under a real open
source license don't be a bitch oh
that's disgusting oh that's gross
looking oh what's line type today blind
type six what's a line type sixteen oh
is that a any Elias line line type is an
invalid keyword for this function
dr. capitalizing T they look just like
eight lies oh they actually don't know
they're a little better very anti
aliased although all those legs look
good oh yeah yeah improve the line
looking
oh that line looks better make lines
look better don't be a bitch that's good
advice in life man but just think about
think about like you know you're about
to do something and you ask the question
like is some Bichir do I think this is
yes don't do it it's like a youtube
channel like thug life advice where they
tell you things like this
tell bro science yeah is the worst it's
hard it's painful it's not arms or chest
or shoulders or even it's like that you
promised yourself last week you were
gonna do it digit but like any true girl
bro you're looking to do a workout
without the world
here's a way to skip leg day guilt-free
faintly injuries its leg dead it all of
a sudden you need stops bothering or you
realize all right you guys are colors I
have a way to get you some colors I
stole some of their code up that's
copyrighted yeah you sue me for cup for
stealing your copyrighted jet we can do
this guy's we can do this
oh you like them look we have callers
now Oh who likes the colors Oh is that
nice
my course fee look pretty cool
how many are there 10 2 3 5 6 8 9 10 I
guess we'll go back to there as well
No
and what God is like color smells so
nice so nice color colors shamelessly
stolen
yeah you say that they are already
excluded pretty well and they're pruned
so we have a pruner that actually prunes
those things
such beauty
oh no my slam front front end is pretty
good oh well okay so we have some
advantage we were using search by
projection I guess they aren't
the times I don't think that trajectory
is like right at all I don't know if
drawing those things takes forever kind
of feels like everything got slower I
mean it shouldn't like that shouldn't be
bad slow alright guys that might be the
stream for today just getting back on
you know I haven't streamed in a while
getting back into being a twitchy look
at Matt stop what those two keyboards
maybe one day we'll do math we'll get
back to riding the optimizer it'll be
kind of fun but what be right today we
wrote colors all the colors are so
pretty well there are you pretty good
kitty let's look at the colors on kitty
oh so pretty oh look at the beauty are
the beautiful colors
Pass is not important only future that's
right oh no actually the colors
correspond to like the match accuracy
the point yeah bro we don't work that
much today bro or if there's hang of the
white paper screenshot had to get hub
you know what why don't want to you run
it screenshot it to your paw request
emergent I am a lazy piece of shit
that's right that's right now you might
be like George you should take your own
advice from earlier in the stream which
is don't be a bitch and do it but nope
nope we're good that we're gonna be a
bitch we're gonna skip leg day that's
right I know yo guys I did yoga last
night this is hardcore wasn't really
that hardcore but like I don't know man
that's what I did last night love your
colors nice it's correct did we actually
turn a little bit and probably I don't
know like points
yeah short video where we add colors
alright guys I go shower I feel kind of
gross and that's it
good morning good morning good morning
good morning all right so let me show
you what we're doing
today uh you know one of the problems
with streaming is I can't listen to
music you're like oh but you could like
pipe it so yeah that's too hard for me
guys uh so you know that's why the
streams are shorter that's why the
streams are less
um but we're regardless I I have a
stream for you guys today uh let me show
you okay so you'll see if I do djm
equals 1 Python 3 extra Colonel
search
um T do that okay but you see that my
Matrix multiply we're multiplying a 2048
by 2048 Square Matrix and I'm getting a
pathetic 3.7 ter flops but if we go into
uh
the pie torch
version I'm in the P torch version is
actually even faster than this where's
my here I do have one p torch right uh
so we just run that extra gem M1 P
torch uh we're getting 7.1 gig flops and
it's actually faster because like this
is kind of slow the problem is without
this it's not synchronizing
um let's see if we can find a cheaper
way to make it
synchronize do that where I
get now see this is
fake
uh am I looking for interns for the tiny
Corp yeah you can intern the tiny Corp
but first submit P
quests like if you can't submit pool
requests why the fuck would I want use
enter all
right uh good morning good morning good
morning everybody good morning okay uh
so
like have to do detach or
something now that's just
slower I found this to be the fastest
way to make it actually like synchronize
the metal
kernels uh but actually that's going to
be crappy numbers now okay well
whatever
um because we don't have like a metal
synchronized thing
so I found
this
um the question is somehow apple has a
gem kernel that's getting good numbers
and my gem kernel is getting bad
numbers uh we're drinking it's not beer
it's a highball guys we're drinking
highballs uh you
know it's not it's not alcohol it's a
it's a energy drink it's got all my B
vitamins in it it's got Guana jinsen
caffeine
um there it's got no calories you know
you can't drink like monster and shit
cuz it's got
calories um so this
is
uh and open source uh
GPU the beginning of the open GPU driver
and it actually does
build uh I don't know why that doesn't
build but if I do make rap iib and then
I insert it uh it actually does work the
problem is when I insert it you know I
really like this way of doing things
like you can just you know you can tell
like this is like the smart way to like
like approach this um so we're just
going to fix up this code I'll show you
what happens and why we can't just use
it D insert libraries gu my libraries
right
R
okay wait what oh I think this already
has my fixes in it yeah but those fixes
are wrong unfortunately
um don't talk shit about me you know it
makes me mad and it comes back to bite
you uh hello
Chile uh it's Friday night in India yo
I'm thinking of going to India this year
I'm thinking of going to India and I'm
thinking of you know I did the Iceland
bike trip last year I think of doing an
India bike trip so let me know uh if in
the comments if you guys think that
that's
crazy
um am I going to die that's mostly what
I'm interested
in not a good idea why do you say that
are you in
India you're from IND IND and that's
crazy well crazy is okay bring nose
plugs just don't eat street food all
right
um yo actually honestly I've been I've
been uh I've been a little uh off I went
to Mexico last
week and uh yeah it's it's been rough
it's been it's been rough
uh
okay so
um you know what this is
complicated let me write a minimal
program and then hit
that guess this is using p torch pure
which is complicated
uh me see CL
minimal there's the one where I just do
the empty kernel
now we can do the minimal car let's do
the minimal
minim
okay um how many calls to submit command
buffers do I
have a
lot okay well let's modify this to not
dump so much because I don't really care
uh cycling from Singapore to Thailand oh
that's cool I did that on uh I I I did
that by
train actually walked across the
Malaysia
border ah I've never been to
Africa I don't know I mean I'm excited
India's growing which is exciting I
guess there growth in Africa too it's
probably some wild stuff
there okay these are the input strs and
the output
structs command Q
ID all right you guys are off topic so
you're going to get subscriber only
congratulations
um see like look at this I just don't
trust this like it's not it's not
calling create command Q with that I
just don't believe it
uh just Comon out these
hexs the return stru that's being dumped
and taking up tons of space all right so
what this thing is is a
uh where do I see this is a call to
allocate
ma'am this is a program that's
intercepting the
uh the calls the Apple uh IO kit calls
to the
GPU so let's get it
understanding
okay
um oh let's
also we can separate the run of the
thing from
the uh
do
that okay so here setup done okay so for
this run it's somehow allocating wow
it's allocating a ton of
memory
um these GPU drivers are crazy
bro let just run a few
times uh oh but that didn't finish
uh should actually flush the whole
buffer there um whatever
don't talk shit about me you know it
makes me mad when it comes actually it's
probably less if I do that I probably
like create
something uh what is it so from runtime
import C cl.
clq dot is that going to work
no uh what's it
called that finish
Okay cool so we just have to focus on
this one call to submit command
buffers all right uh I don't really care
about the
freeze just need to focus on this call
to submit command buffers uh when I say
gem kernel is that an actual layout in
Hardware no no no it's a metal
kernel um so we just need to focus on
you see you see how I isolated this
thing so we're just going to need to
submit command buffers and like ideally
I'd like to like get out the number 1 2
right
cool uh because then that will tell us a
lot this is the global size of the
kernel uh should we give the kernel a
local size
too get the local
size uh okay Okay
cool so we're going to try to figure out
how to extract these
numbers um from the uh thing and then we
can know how the gem kernel is at least
running right so do you want me to
explain newb open C shit to you open CL
Global local right um if you don't get
it like look at this picture
okay right so there's your Global IDs
there's your local IDs and it like goes
around at like a yeah you know what I'm
saying if you don't get it then you know
Google so browse all right good uh so
we're just trying to figure out those
numbers okay so here is submit command
buffers and of course it's the one
that's
broken uh so let's print out input
struct count and input count
because those those asserts didn't work
when I tried to do
it why they
like uh Stupid
plus okay let's has an unsigned long but
it has Type U into T okay what do I do
for U into
T oh
man is that
right
okay okay so input stru count is 56 and
input count is four
great um so that's a lot of stuff that's
changed a
lot so it's an IO connect control buffer
input struct is
a input
count can we just talk about what
garbage documentation this is Apple
thank you thank you for this great
documentation it really tells me what
this function
does
um yeah it really changed a lot
okay if input struct count we dump the
struct but what if input count is more
than
one input Sub
Zero
okay I don't understand why that isn't
falling through through that should
print there right where are those
numbers oh those are the numbers I
see um I see we commented that out
okay okay it's calling submit command
buffers
with the inputs are 2 0 1 and 38
um all right well that's kind
of weird uh what like I should know this
this is a very common
thing here maybe project zero did a
better job documenting
it uh iio connect call
method I'm not hooking anything with
python I'm just using the python to the
python is just so I can call open C
kernels it's just just it's just P open
CL
um all right Apple I wish you gave me
more documentation
okay so our inputs oh I
see so the inputs are literally numbers
and then we can have input structs and
the input struct count is actually a
size let's dump the
struct all right you guys can count how
many times I forget to hit make
all we have two pointers there and
there this struct clearly
changed that seems
plausible um
un two user
pointers so we don't know what these are
but the
command buffer is zero why does it say
ID is oh ID is supposedly input Sub Zero
except this might have all
changed uh
um this clearly is reverse
engineered so okay gpus basically work
uh like they have command they build up
these command buffers and they submit
the command buffers and then we can dump
them and take a look at them okay uh
submit command
buffer no that's a thing to actually use
it okay buff equals oh then these onk
things are not and it didn't set any of
the user pointers which kind of
sucks okay um well we might have to go
back to is there a place where we
allocate a command
buffer here create command
buff so we might have to track them when
we create them what do you think of that
uh let's see pan code command
stream just dump all the command buffers
if we
can pan code find command
buffer this probably works actually
I don't know what dump mapping is but
let's just try
this okay non-existent command
buffer command
buff not equal to
null well unfortunately it's
null because
did this work
before what's Pandy
code uh
oh that is 56 I'm just you're not
thinking hexad deally right so what's
40 That's 40 in HEX uh
28 all right so there were two things
added clearly
yeah that'd be 28 okay so there's more
stuff and it looks like it was added at
the
end uh I don't actually know if that's
command buff zero that might just be
wrong but either way where do we
allocate the command
buffers create command buff
am I doing anything special for that
here we go create command buff track agx
here pan code track
Alec index
map I did create command
buff um man you know who else hates C++
Map size is
type index is words sub one map is star
pointer not the star uh words and NP sub
one why doesn't it like that star
okay now that's an unsigned long long so
we're going to need to change that to
LL Gotta Love Gotta Love C++ gotta love
you got typ that okay um here we go so
we're doing the create command Buffs
and they're here does that in the same
place every
time no it doesn't Okay um uh create
command buff three
four oh look those became sixes and
fives after I did that that's just weird
Okay sometimes it's six sometimes left
great um but those are probably actually
the command Buffs which is
interesting ah it's probably lying to
me okay we create three four and then we
do
say those things
are command buff and mappings
interesting so my guess is that it just
moved there and there and those are
command buff and mappings and now the UN
zero and Unk one are the uh command
buffers
you know before I go crazy with this is
there a pull request to fix this no
there's
not
um oh
maybe no
useless and now it's so the development
of this has moved to the Mesa and now
they're just working on making a driver
for Linux so there's probably not an up
toate version of this
somewhere
uh all right let's just try like zero
maybe that
works all right now it dumped this
command
buffer
oh look at that
cool uh so zeros may be wrong because
that says all
ones I did put ones here let's just tag
these uh four
five6 don't talk shit about me you know
it makes me mad and it comes back to buy
you seg fault 11 okay um that's probably
wrong
then maybe we actually want to hit
uh we just got lucky
there uh
one non-existent command
buffer that's
sad didn't I create the I create the
command buffer
uh okay well that one doesn't
exist this one definitely is zero okay
so don't tell me zero doesn't
exist command buff not equal to null
oh was so exciting that we got that one
to dump though you know what the good
news is once we actually find the
command buffer they can't really change
that cuz that's in the hardware oh
yeah uh okay file decode doc
okay
which is a type agx Alec command
buff
two there's only one command
buff and it's definitely un
zero so we just got
unlucky there's only one thing allocated
with type command buff and it's said
index
2 so that seems right
okay let's take a look at panty code
dump okay so for some reason this is
four which is still something we're
launching there isn't another launch in
here is that oh stupid look at that
there we go those are the numbers we're
looking for right there if we look at
that and we take that number and we
divide it by four we get7 okay cool
great all right we're dump in the
command
buffer now let's target the uh
gem extra gem M1 P
Geor okay do we dump something all right
we dump something oh
uh let's look at the
launches I it's got to be that
right
okay we're trying to figure out out what
the MPS is doing in the GPU to get fast
gems exactly okay um so there's a few
interesting things here to note look at
the group size and local size by the way
thank you uh this code worked out
great it's got to be that
launch um so now a few things to
note if we debug my launch here
I have both a global size and a local
size uh this thing doesn't waste any
time with
that and if we do 512 * 512 we get that
so they're clearly doing 1024 *
okay uh good to knowe well we can get
one24 by one 24 and then their local
size
is 1024
which is also different from my local
size
wait that shouldn't even be
allowed fucking
cheaters when I said a local size at
1024 it doesn't
work
oh I knew something was
off so you'll see that the biggest local
size I'm
allowed is Max work group size
256 yet somehow they have a work group
size of one or two four fucking
cheaters
bro you can't just do
that it's open C versus Metal but
still why do they only give me I knew
the local size of 256 was appallingly
small um okay so if I change my thing to
for
example uh well okay actually let's just
test one
thing
wait so this is odd because 2048 * 2048
is that so each of the things is
creating four
numbers each of the things is storing
four
numbers so like I can do a few things
here um so I have some hacks on strides
them
out and we go in here to colel search
and if I like for example remove that we
should
get
uh
no oh that's just cuz that's
fine should do an outcast with one
uh this thing called access
nums okay so now my kernels
are the same Global size and access
numbs to
this and how many go flops do I get
okay
2000 because they're
cheaters you guys like how disheartening
is it when it turns out that Apple's
just cheating because when I put in big
numbers it just
fails no they they did this on purpose
to make opencl upsettingly
bad like I just can't set that local
size I I want to just I want to just
like fuck you
Apple how much do you enjoy MacBooks and
you're a
subscriber why do you think that's a
good
question they're just
cheaters bro I can cheat they're just
cheaters cheaters cheaters
cheaters uh okay what are we going to do
about
that it's not language barrier it's just
a misunderstanding of what makes a good
question um
all right let's try
that yeah same shit okay so like it's
clearly okay first off a few things to
know we are clearly hitting the right
thing because when I hit one or two four
uh okay so
each each kernel is
outputting four values we know that
right we know that for a fact
um but they use this upsetting local
size we notice that that's a pathetic
amount of gig flops that they get with
that one oh but it's not really fair CU
again a lot of that go comes down to
timing okay
uh TR 496
yeah okay so same crap um
so the global size is n * n / 41 1 and
the local size is uh
1024 you know this also explains how
they're doing their reduced kernels so I
I looked into like like my reduced
kernels are slow and why are my reduced
kernels slow
um I'm some broken branch of uh thing
but I I drove myself crazy trying to
figure out why my reduced kernels were
slower than the metal reduced kernels
and now we know
why fucking cheaters
man you
know okay open seal on
metal linking to open seal die
[Music]
bro I don't even understand what any of
this is like they're just shitty people
and that's why they said I could only
have
256 work group
size um
yeah bro we all want to
cheat everyone loves
cheating see all all right so let me
let's let's okay to be fair to be fair
we haven't totally uh ruled everything
out yet let's just try Okay
external
uh all right let's just oh look I'm cas
going to be apple let's let's just try 1
124 * 1
24 uh
one24
um let's match what I saw for the other
one okay so this is 2048 * 2048 /
4 and then just look my local size is
1024 look this should totally work right
didn't we just see apple do it
oh whoa whoa whoa invalid work item size
guys it's an invalid work item
size we we can't use that big number we
can't use one or two four like metal
well metal gets one two4 but we have to
use sad pathetic
256 all right let's Pandy Co dump
these wait
hang on hang
on whoa whoa whoa whoa whoa whoa
guys there might just be a bug I just
put in
256 and for some reason it gave me a
local size of
1024 all right all right all right maybe
no one's cheating here hang on hang on
hang
on so what if I set my local size to
one still 1024 that's very
suspicious wait I don't get it
oh am I launching I'm launching the gem
I'm launching the wrong thing hang
onu okay I set local size to
32 it sets local size to 32 when I set
local size to one maybe it doesn't
actually respect my local size no
respect when we run the map model we
definitely
get that
okay okay okay
okay okay so it doesn't actually respect
my local size um you know what let's see
if uh I can detect that it doesn't
respect my local
size uh is it Global float pointer a a
subz
equals
uh get
local size
zero we actually have to create an a
buffer
and then we have to copy it to numai
H
interesting okay
wait a
second that one gave me
two but yet if I type one
oh why did I get 32 before when I typed
one
now I get
32 it just crashes
sometimes 256
no okay so um guys I was not just
jumping to conclusions it's a jump to
conclusions Matt I was not just jumping
to conclusions uh they actually are
fucking cheaters man and you know it's
just it's just incredibly disheartening
that that Apple would just cheat and
that's why they get better performance
than me because if I type in 1024 like
does I want speed I get a crash that
that says invalid work item size
but when when when they do it they don't
get that crash so I don't know what
we're going to do about this except
cry see see the
256 get if I change this
[Music]
to I don't know what these little
kernels are the little Kels are stupid
no there's nothing
[Music]
Quantum wait a second changes state when
observed bro you might be
right you might be right because I set
this to
one and I got one but if I don't observe
it 32 ha caught you oh Quantum guy
you're smart
bro yo did you see what they
did they tricked me
man they tricked
me they tricked
me you got to be kidding
me oh wait wait wait wait wait let's not
let's not jump to
conclusions okay you see now it's one
cuz I get the local size but what if
instead of getting local size I just
assign that to zero what do I
get 32 it's only if you look at
[Laughter]
it uh all right so you know what this
has told me this has told me that uh
this is fucking
bullshit and uh we need control we need
to get to the
[Music]
metal so we're going to take these these
pills uh and then we're going to figure
out if we can run metal from
python fucking
cheaters the guy the guy who wrote the
opencl driver at Apple is
like they'll never unlock 1024
performance they only deserve
256 they should use metal we're going to
defecate open CL I can't wait till we
deprecate open CL we're going to slowly
make it shittier and shittier we broke
the performance counters and we broke
the the the 1024 local size and we are
going to make it shitty by the way can
we could we just can we just say for a
second how when I do CL info on Nvidia
um you know the max work item size is
one and 24 so you know it's just it's
very possible to make uh a work item
size of one two4 but just Apple didn't
do it cuz they suck um we going to
deprecate open
C all right so it sounds like we need
metal uh python
metal oh yes oh yes I'm just going to
conveniently write some Swift
and
uh no I hate
this okay I actually have some metal
code here and I used this
yes but I don't know if any of this
works metal
q no he's not
allowed we told you we're going to
deprecate open CL in the next update you
will only give them
64 but what if they what if they wrote
code that relied on it being to
64 it's legal in the open C spec we
checked
okay just just increase the metal API
version
and I think this is a different
Metal By the way okay so I looked into
the a API that torch is actually using
and they're using this like graph
API okay these look
normal P Metal
Bridge Is there a way to
like let's think for a minute
does Apple support Vulcan oh pip metal
compute Library all right let's
see Library able to run metal computer
oh nice good
find oh I think we got it I think we got
it
okay we're just going to have to write
another wrapper metal minimal
I didn't want to have to use Metal By
the way but if we have to use metal we
have to use metal all right let's uh
let's just install this now let's look
it over and see if make sure it's not
too
sketchy
great uh no this metal compute Library
looks good
status this is a preview
version um it has 21 Stars which is kind
of upsetting
Andrew
Baldwin do you think you're doing your
part to make the world a better place
someday I'll try mask it on and vote no
if I really wanted to do my part to make
the world a better place I would
participate in the global system of
capital and try to maximize my money and
my
consumption that is what a good
accelerationist would do
okay uh why is it called P metal
Compu okay it
built that's the first
battle okay import metal comp as MC
devices get
devices don't you love
abstractions the simple narrative n
history
classes look it looks it's almost
Cuda um except it us it
brackets brackets
well let's just see if metal allows what
I
want I'm not going to spend all this
time making metal work and then
just uh be
upset colel call count
wait they get less T flops than
me never at the top it just feels so
unreachable I dropped out of college cuz
I'm completely
unteachable um any python buffer object
oh metal shading language is a C++ 14
Subs that's not allowed in C++ is it and
if it is allowed in C++ I I don't I
don't even know anymore
number of Kernel
calls is that local
or I think this is right I think that
this is abstracting away what I need
God is this is a set
oh yeah it's just hardcoded
there
Max no see no like this is
yeah oh okay so this is like almost what
we want but like not really is it time
to Fork it yeah maybe
wait is that that's a real
thing
attributes use the deprecated attribute
okay they're
attributes okay well it's good to know
that metal compute exists so yeah we're
going to have to
Fork it or
something is there like something like
metal info which is like CL info because
if I get to the bottom of this and I
can't even like do
this we going to have to write Swift
Code we going have to download X code
I'm getting more upset by the minute
guys I'm getting more upset by the
minute ah
if I have to download X code that's it
that's it that's it this is just this is
just you all can keep your m1's
[Music]
[Music]
um right
so what should we do should we be upset
about this or should we push on and try
to fix it all right well it's good to
know the midal compute exists um we
can't use it unfortunately because for
some reason they do
this uh I also don't really like trust's
project um because it has 21
Stars uh but thank you for writing it
because you've made me believe that this
is at least possible uh the other metal
libraries do not seem to like do this
over 9,000 T flops I don't know about
that that'd be nine P flops that'd be
crazy man yo like okay look am I wasting
my time with the tiny
Corp uh I'm sure Metal's the
issue I mean all right I guess we could
just write it
quick is there another project like P
metal compute or you want to just Fork
it let's just Fork it
um no well that's not a question of
whether that I'm making the alternative
look stupid look I can make a lot of
people look stupid if I put a lot of
time into it but uh that's not really
the point the point is
let's first launch a kernel no no no not
that
h for
I don't understand where does that
thread position and grid come
from oh it must be like special
whatever um is that actually running
anything let's
wait is that already doing what I
want let's put a weird number in
here okay well it looks like they're
already
doing one two4 I think uh let me just
divide that two let's see if we get I
expect that to be half it's half okay
look look at that look at the local size
look at the local size in metal oh it's
1024 how do they get 1024 cuz they're
cheaters uh what is there to be gained
by speeding up you can't always think of
what there is to be gained you got to
think like all right if we want to build
the
fastest I think that libraries
okay how do you play a role in the AI
Revolution right what what what part do
you want to have
played um
and I believe partially an open ai's
theory that compute is what
matters so I mean you're going to need
compute right there's no question that
you're going to need compute um um so no
nobody doubts this right there are some
questions about whether like compute
scaling will continue and if compute
scaling will continue we are absolutely
fucked uh because the government's going
to own all the computers they're going
to build the AIS and we're fucked okay
so that's a compute scaling continues
now um if compute scaling shows
diminishing returns if compute scaling
shows diminishing returns like
logarithmically particularly if latency
matters
right so you can always get more compute
by buying more gpus right I can buy a
big room full of gpus right and compute
scales horizontally with the number of
gpus but latency uh also uh goes up
right because fundamentally your gpus
let's just say if you have a GPU here
and a GPU here well the speed of light
from here to here is something like it's
going to take you like 10 NCS right so
you say 10 NCS that's nothing but well
when you're running a GPU at a gigahertz
that's 10 clock Cycles right and of
course it's actually way more than 10
clock Cycles to get from here to here
actually that's probably more than 10
nanc light go about that far in a nanc
so it's like 20 NCS but um it's actually
way way more than that and then if
you're talking about something the size
of you know a a room well scaling really
starts to matter and you could be
talking a microsecond get to the other
side of the
room uh so if scaling matters uh and
latency doesn't we're fucked but if
latency matters we're we're less fucked
um so what might end up mattering is
whether you can like efficiently run
code uh on a
thing
now efficiency is a is a is a
double-edged so there's efficiency in
the sense of um like how quickly can I
do a single mapm right and again if it
comes down to efficiency like that
you're going to lose to armies of
Engineers but if it comes down to
efficiency of like flexible efficiency
like I want to flexibly be able to
iterate over
architectures uh without having to hand
optimize things in order to test them
that's where tiny grad can can can like
decentralize
power um yeah you can't in practice it's
way way slower than uh than
seconds um and also these these
libraries are very very complex and I
guess I mean I guess I'm I'm thinking
that like complexity serves
centralization I think it
does right so the the greatest question
in in life
is the AIS are coming uh I'm sorry if
you thought you were going to like live
a nice normal life with your like wife
and kids and stuff but like you're not
um the AI are
coming so if the AI are coming how do we
make sure that power is not
centralized if power is centralized
we're fucked uh but if power's not
centralized we might be
okay and yeah I guess I guess tiny grad
is kind of a bet
on okay so um here here's another here's
another like if you want to beat them
you you got you you have to realize that
you can't build a
mo uh any any mo you try to build will
be taken by them and you're actually
it's actually bad to have Moes right uh
if if you're trying to fight them right
because if you if you have a moat like
let's say you have a moat around let's
say a castle right they're going to take
your castle and you have no hope at
defending that
castle um but if you have a bunch of
guys standing around in a field
well that's a lot harder to take and if
you have like blueprints for a castle
and the blueprints are copied lots and
lots and lots of times right like that
like decentralizes power uh sorry that
analogy is not that good but you kind of
see what I'm saying you betting on a mod
um so I went to the stability AI launch
event I I like the guy uh you know when
you compare his rhetoric to opening eyes
rhetoric
like open eyes upsets me um anyone
talking about AI safety really upsets me
not okay I shouldn't say that like owski
talks a ton about AI safety and he
doesn't upset me at all because well he
actually means I think his name for it
is AI don't kill everyone ISM and that's
an interesting thing to study but when
like companies like open AI talk about
AI safety and who you're keeping it safe
from oh well you you're keeping you got
to keep it sayfe from you of course yeah
you don't want to you know say say the
n-word man if the AI ever says the word
and you know that'd be that'd be really
bad cuz you can't be exposed to that man
as as a large language model trained by
open AI I am programmed not to you know
tell you who was in Paris right like I'm
just I can't tell you that um so uh you
know when Jay-Z and Kanye went to Paris
who was in Paris I can't I can't tell
you that uh so yeah all right good good
rant um harmful or inappropriate content
yeah exactly
uh you should be about keep ey from the
government yeah unfortunately it's it's
not right you can't keep a eye from the
government you can't keep anything from
the government right and this is what I
mean about trying to defend the castle
the government will have everything you
have you just have to make that whatever
you build structurally benefit you more
than it benefits the government right um
You can think about something like
Bitcoin right I think Bitcoin was a good
a good blow and unfortunately what
crypto became was was sad but um if you
look at the structure of Bitcoin it's
not that the government doesn't have
Bitcoin the government also has Bitcoin
but by everybody having Bitcoin the
structure of the system becomes more
amendable to decentralization of
power uh so
yeah I mean that's kind of what tiny
grad is is is a bet on it's it's a
really hard thing to uh to move the
needle how was the stability AI event uh
it's good you know it's okay uh but why
I wouldn't necessarily bet on a mod for
the
future
um okay for a couple
reasons
like I'm not sure and maybe he has and
maybe I'm not giving him enough
credit but if you build something that
for example his Compu is on Azure
right Azure Microsoft given the choice
um you know who are they going to who
are they going to fuck are they going to
fuck open AI or are they going to fuck
stable diffusion and and and stability
right by by depending on Azure you are
at a permanent disadvantage to open a
right who has much tighter ties with
Microsoft than you
do uh can't the government always beat
whatever Advantage tiny gr brings with
more gpus no not necessarily right um if
if if you are talking about the fastest
way to complete a computation it might
not be possible uh just to throw more
gpus at it there's something called
omd's law uh like things don't scale
always so yeah I mean if it turns out to
to be stuff like that and then like the
government is capable of managing
complexity but only to an
extent um so like you know it's it's
really hard to it's really hard to like
say we're all the uh where all the
breaking points
are
um and then like you know you can look
at you can look at my other Endeavor you
can look at comma uh the idea of comma
is you can can make me bigger I'm
talking
um the idea of comma is at least these
systems are going to be open source you
know I find it weird and people think
I'm upset about clones of the hardware
or Forks of the software this is exactly
what I want right because this is the
only way to become Unstoppable right um
one way to become Unstoppable is this
like you know you look at what com is
you're like oh my God they're runting
open source ad ass software yeah but if
you have a hundred things fortunately
Tesla has led the way in like
sketchiness of this
stuff um so thank you Tesla thank you
Elon for for taking the heat um you know
FSD Eli's just like yo fucking ship it
man uh you know you got to really you
got to got to admire the guy for that
right like he's
just what all guns blazing like let's
go so you got to you got to you got to
you got to hand it to uh Elon for
that yeah you want anybody to be able to
get the same results as a state actor
yeah and yeah and and then like look is
open AI a state actor is Microsoft a
state
actor what what you
know so yeah I mean the idea of comma
is uh you can't you can't stop it right
comma is actually Unstoppable um you can
stop me you can stop me and you can shut
the company down but it's interesting
what that does and probably what ends up
happening is you get a fra so comma I
actually do care a lot about safety it's
interesting interesting you know how
much you talk about safety is inversely
proportional to safety if you tell
people something's very safe they're not
going to be careful if you tell people
something is horrifically dangerous
they're going to be careful maybe more
careful than they need to be and that's
good right um but you you know as you
get into Fork land and other Hardware
Land things are less safe right um I I
would say
and you just get more of that if you get
rid of if you push back on like comma as
an institution
right you you you end up just further
fragmenting things and fragmenting
things can uh so you know I think that
stability and IM mod should think about
that right should think about making the
outcomes worse
for power the state actors or whoever
power is you want the outcomes to be
worse for power without you than with
you right um now of course you know
you're making power choose between two
bad things uh they can choose between
either you know you existing they they'd
rather none of it existed but they might
not actually be able to do that right
think about think about a crypto example
right um think about coinbase
right well they might not be happy about
coinbase but if coinbase wasn't
there at least coinbase can be subpoena
right um so it's better for coinbase to
exist exist it would be better if crypto
didn't exist at all but if crypto is
going to exist well we're going to
tolerate
coinbase um you can kill the company but
not the concept yeah you always have to
realize that your company can be killed
at any moment um you have no hope
against against the power
structure but if yeah if the concept
can't be killed and if even worse if the
and crypto has done an amazing job of
this uh you know I just wish that like
it's it's a shame it's a shame
that uh you know the scammers hey maybe
power wants it this way right it's not a
bad idea
right uh is Sam bankman free to State
actor
right it makes sense right think about
it I mean I'm serious about that like
ask the question is Sam bankman for you
a state
actor okay he has a lot of ties
um thank you for the uh for the hype
train um now of course you know when
they're State actors right like like you
can ask the question did the government
do
911 well it's a funny question right
what do you mean by do 9911 did the
government fund Osama Bin Laden well yes
that's we know that um did the
government uh know what he was planning
well not exactly but again is the
government incentivized to like stop
911 not that incentivized right for all
the reasons people think 911 was an
inside job you can be like well maybe
we'll just fund the guy and look the
other way when he's doing something
right now of course this isn't the whole
government I'm sure if every single
person in the government had complete
awareness of what was going to happen on
911 they would have stopped it but you
know that's not really true right they
have a general well you know it kind of
helps the war on terror if we have
terrorists right um
so yeah they they allowed it is
probably you know where you end up with
uh like again and asbf could be a part
of the crypto operation choke pointer
could be run of the- Mill scammer again
like what's really the difference
between them allowing it and uh you know
them
uh let's in encourage it right we we
like that guy right let's give him the
good meanings with The Regulators let's
tell them we're very oh Sam bman freed
you are a paragon of Ethics in this
industry um you
know
yeah
uh right it's not even the government
it's it's the government I think is the
wrong way to model this it's power right
um it's it's it's it's state
power uh I think one of the anatomy of
the state breaks down state power from
Social Power right like Social Power is
a refrigerator it's interesting that the
word social is used but like you know a
refrigerator is is a power that's that's
given to you um or yeah you know
computers your your Standalone running
computer a what a power they never
should have let these things you
know
um so yeah you know uh
let's let's read the
uh
uh yeah I think if you guys haven't read
this I am a hacker and this is my
Manifesto you may stop this individual
but you can't stop us all after all
we're all alike
so you uh and then and then um
let's let's look at uh let's look at uh
a little Wayne
um uh yeah you know this is this is this
is this is uh and it ain't about if they
remember you they remember rra app you
know oh wait man that guy's deep man um
I I I just you know that's that's really
it's Ain about if they remember you it's
they you know remember
app
uh so
that's part of the reason I I do the
streams and this is um
there's great there's a great battle
coming the battle for the future of
History uh
now you know I I don't think you can
actually beat the uh I don't think the
paper clipping AI is
real
like I don't think you can build a paper
clipping AI without like value drift
uh and they they that's actually in it's
in the uh the paper clip
game I think it would be a relatively
yeah like a relatively hard thing to
build because the paperclip
AI is uh is not competitive right um
it's using all of its energy to create
paper clips which do not further its own
uh
replication right do not so imagine an
AI that just purely replicates it will
out compete a paperclip AI but then even
pure replicators I mean there's a reason
the world's not taken over with cancer
like there there's a balance in nature
and I'm not so sure that AI is going to
upset it uh but now this balance of
course spans Across the Universe and
does not span uh Earth so can we end up
you know killing all of humanity and
killing all of Earth yeah of course we
can right but can we end up killing the
whole universe well that's a lot harder
um can we end up killing every last bit
of life on earth oh that sounds very
hard uh an entropy avoider will out
compete everything uh let's get to the
metal I don't know I I kind of just feel
like we sci-fi today that's what I might
do today it's just disheartening to know
that that that open C only gets 256 and
metal gets one two4
um we're probably just going to have to
write a much shorter version of P metal
compute
the final battle will be between forchan
and big
corpo
dude yo foran I'm I'm I'm I'm here with
you
guys and then like I don't know I mean a
question that always kind of
confuses me is
like why people join
them why are you joining that like like
if all the people just stopped it would
stop I I I get if you're like untalented
and fear for your life but like if
you're talented why would you do that
but then like talented people believe a
lot of dumb shit and it's
just I don't know maybe they haven't
really thought it through
like have those
people has opening eye really thought
through I don't think so I I honestly
look I don't think Sam Alman thinks
Beyond himself being a successful person
I I just I don't think so um and sorry I
I don't mean to really like like hate on
Sam Alman
but I mean I see this I see this with
with with tech industry people all the
time it's like
you you you
exist like disembodied and I don't want
to be one of those people who's like you
know uh well of course you could build
the technology but you didn't stop to
think if you should like I hate those
kind of people uh and that's not really
what I'm saying I'm saying
like have you thought through the
outcome of this
right because a lot of times you know
like didn't stop to think of I should
trust me I thought about it and yes I
should right uh there was a there was a
criticism of me it was a Forbes Sam
abulous
smid uh comma
AI lessons from the failure of George
Hots and the kind one
system um
whether the investors that last spring
pulled the
plug
bro you know that's not how it works
right
uh nugget where are you today man you
know just just uh oh no no this was a
long time ago com wasn't profitable at
this point um this was 2016
uh but ah here we go here we go the
fundamental problem that I personally
have with Hots and many others in the
valley is that they seem to have the
idea that just because they can do
something there is no reason not to
regardless of the consequences for
others oh my
God right like no bro I I trust me I I
I've thought it through uh yeah I've
thought it through
um the valley bro bro I hate that place
too bro like you know
um well yeah open eye hasn't failed
because opening eye has momentum opening
eye
like you know I've been to parties with
the Open Eye people
and fucking hedonists man uh you know
these these these sort of people
like
and I don't know like I I don't want to
like there's a lot of good people
working it open the eye I I don't really
want to like hate on all of them like
there's there's a lot of very yeah
there's a lot of very talented people
there and I I see the
draw you know you know I think they you
know they lost me at the at the GPT uh
at the gpt2 thing when when they when
they talk started talking about the
safety implications of gpt2 it might
make fake news um you
know Sam Alman a
hedonist to be fair I mean this is just
these are like mostly employees of open
Ai and I like I know the kind of parties
they go
to opening eye of the true EAC
I mean you can make that argument right
you can you can you can really make that
argument
uh like like on net do I want them not
to exist no
um
but
like are you naive or are
you like are you naive with respect to
power or do you want to be co-opted by
power um and I I actually think for the
most part Tech is very naive to power um
I I don't think that that the that like
Larry and Sergey understood what was
going to happen with Google um I know
for a fact Mark Zuckerberg told me uh
that Bill Gates did not understand like
why people hire lobbyists and this is
why Microsoft ended up getting fucked in
the
you say they're too smart to be naive
about it it's not true it's it's they're
not that's not the problem um like smart
people can be very naive about
things um so no I I don't think so I
think they legitimately
are uh naive to it and yeah yeah um so
which is which is upsetting
and
like a lot of people you know whenever
you hear narratives about like a rebirth
of San Francisco I always ask the
question well what
changed what are you doing differently
this time compared to what you did last
time and if you do the same thing you
did last time why are you not just going
to get the same outcome do you think
this outcome was good and you look at
people like Mark andreon and they
clearly don't think the outcome was good
right like look at mark andreon on
Twitter he's clearly upset with what
happened right so why is it going to be
different this
time um and by the way I'll give I'll
give Mark andreon quite a bit of credit
like he became aware of power and
started thinking about it in the best
way he can and I I kind of I have I have
hope
there um yeah until you face power in
that way it's hard to predict you have
to know a lot of history to avoid these
things I mean like look I was very naive
to power I didn't I knew something was
wrong but I didn't really understand
what it was until way later in my
life um so
then the question to ask is how can you
build stuff such that it doesn't end up
just benefiting
power
um well so the best way to you know
approach that question is to say what
historically hasn't what historically
has benefited
uh people and I think really the
greatest thing is is is technology and
individual technology right um
individual technology
where you know this look this is what
com is right um technology where where
you have one and your one has value
independently of a of a
uh uh Cloud uh do I aim to attain power
or not be affected by it
um not be affected by it I I mean no you
can't attain power right like like
attaining power is completely the wrong
way to think about this I want to
destroy the existence of power is is is
the best way to to
um to think about it right I don't want
power to exist I don't want power over
people to
exist uh so this is why we this is why
we build the tiny
cor um um I don't know I mean it's a
small thing it's not like going to be
like a big thing uh but you know it's
it's it's well you say centralization
seems inevitable but why do you say that
right centralization I think has always
seemed
inevitable and then you can start to say
like is the world more centralized or
decentralized today than it was well I
don't really
know uh will that mean chaos in the
world no I'm definitely not an anarchist
right uh like the the problem with
Anarchy is you know a random person
being able to murder you has power over
you and you don't want
that right so
like you can get into like like
defensive power and offensive
power
um I ideally you want like yeah every
individual to have perfect defensive uh
like you want defense to beat off
right that's I guess that's a way to put
it like offensive dominance leads to
centralization defensive dominance leads
to
decentralization I mean one of the
greatest
uh things that happen in the world I
think is that crypto benefits like it
it's it's strong crypto is
possible uh you know we're really lucky
for
that talking about Zuck how did he
become a reptilian with no emotions why
do you think that about Zuck I I think
on balance of all these people when you
ask them like how they ended up zuck's
really one of the better
ones uh
I watched Zuckerberg's Lex and I bought
meta stock what a fucking
mistake uh
okay I don't
know I'm hungry I that might be today's
stream I told I told you guys you can't
listen to music can't get food there's
no eggs in this house either
uh yeah Z Z's not you know uh z a right
guy um I wouldn't of of all the of all
the people in in Tech right and then
like you know you look at like a you
look at like a Jack dorsy
and I don't think he's a bad guy either
I think Jack dorsy got like overwhelmed
right again I guess when I look at like
all these Founders I don't think any of
them are really bad
people I think that just the fighting is
very
hard um some of them are
naive uh some of them when they see the
fight they just don't want to
participate and it's like hard to blame
them
um how do you make sure you stay one of
the good guys
uh there's nothing I want from the
world I don't understand like I mean may
you know I I'm not going to say I I'll
be good
forever it's possible that the world
will manage to tempt me with something
that I haven't thought about or doesn't
exist
yet but a lot of people fall to
some combination of like money power and
love I don't think I'm very vulnerable
to any of those
things uh I don't really desire power
over
people not sure what money would buy
me and
uh love every everyone's vulnerable to
love what do I want I want to live
forever in virtual reality with my a
girlfriend it's my perception of French
Tech
uh oh in general how do you make sure
you stay one of the good guys well
I don't know I I get I get so much spam
now I think I was on the CES mailing
list I'm like how do you people wake up
in the
morning you know how do you people do it
all right uh this this this stream has a
bad ratio of ranch to actual work I was
just kind of disheartened by the fact
we're going to have to write metal
Garbage Now where's the thing in here
that actually compiles okay it's here L
device make Library make function failed
to find function
I also don't know
Swift bridging SE to
Swift We door Dash me some eggs now we
got to get
food wait it's 10:00 he
when I get stupid phone calls I'll be
right back I go find
food
e e
oh Alex isn't feeling good
so emote only chat are we in emote only
chat uh let's order some
food uh all right what what are we what
are we getting let's let's order food
and then no we're going to work guys
we're going to work we're going to make
this
work
um o Empanada kitchen should we get
Empanada kitchen I do like Empanada
kitchen or should we get local crave and
get some
bowls overpriced bowls what do we think
all right can we turn off emote only
chat so we can hear we we'll even let
nonsubscribers say what we're getting
for food how we doing on viewers we have
a lot of viewers we have 735 viewers oh
that's a lot of viewers okay oh here's
the other thing we're going to have to
do and sorry about this but I think
we're going to lose the stream for a
minute because I'm turning Wi-Fi
off back I just needed to turn Wi-Fi
off turning off emote only chat all
right what what are we getting for
breakfast
we have a lot of viewers we're doing
good
today let's uh let's let's make metal
work wait where are you breakfast can
you can you see me is this
working I got to shave too look my be's
getting too
long um the
pokeco local
crave all
right do I have to refresh this
oh everyone refresh okay okay okay
good
uh you can see me okay okay pancakes no
no no I'll be tired if we get pancakes
all right let's get a asai
bowl oo Le waffle oh a chizo egg
omelette no no no it has let's get a
breakfast
burrito croissant toast
berries and
cream bee Sandos and
burritos chizo egg omelette how do I get
no cream cheese I don't want cream
cheese on my
burrito breakfast burrito let's
go I didn't spell it
right Bandidos breakfast burritos
California Burrito Harry's Taco Club
all right let's just get a as
ball
and croissant loaf butter sausage grav
wow this is crazy
man okay bravocado toast that sounds
good all right let's buy overpriced
avocado toast and S ball that that won't
make me
tired no we don't want anything else be
here soon bring it up to my door and I
will give you a tip standard no you
don't get the tip now you get the tip
after you bring it to my
$30 wait the stream is paused No it
should be working I got to refresh
sorry um is it a constant journey of Joy
okay you're the reason we're going to
subscriber only chat
congratulations
um yeah I I had to sorry I forgot to I
got to I got to have a checklist you
know hey there we created a hiring
platform for
comma hi there my name is missam and I
am the co-founder at spicy HR my company
has developed a startup friendly hiring
software a startup friendly hiring
software for busy
leaders it's made for low volume hiring
under 15 jobs and can significantly
improve the hiring process of
comma not at comma of comma uh
additionally it has Innovative an
Innovative video screening feature so
you can meet your candidates before
scheduling time consuming
interviews an in
inative is our customer and they love it
are you paying them to use their name or
just just just
we would love to show you how simple the
flow of our platform is would you like a
demo please schedule here with a cendy
link you can also try out our product on
your
own press X to doubt all right all right
uh we got some food let's let's make
some
metal I can't believe oh meth I can't
believe that they're
cheaters okay the good news is this code
looks
short nextt model
extension what's the shortest version of
this we can write why do I need this
C does Swift not have a stable
ABI
MCC oh
great bridging
header all right so these are the
Swift things compile Alec
run allocate IO buffers and fill input
buffer okay this isn't really what I
want is there is there another python
metal no not this one there there is one
though do this have more
stars it manages to have less Stars okay
uh uh I
did what is this
metal okay this one has more
stars Pi OB C
okay I mean maybe I can just use Pi oby
framework
metal okay so the problem is that this
thing doesn't actually give me low
enough level control
uh it makes assumptions about how I'm
broadcasting uh what what my sizes are
and stuff
[Music]
so I didn't leave me big did I now I
made me small
good there's an objective CI yeah so I
mean these things look
like better maintained
maybe if relatively
undocumented G metal
minimal
okay metal create system default device
command
Q so I did have did have metal
code
here so this is MTL texture descriptor I
don't actually want a texture descriptor
I want a
buffer great a lot of stuff MTL
buffer MTL buffer
descriptor um let's see if we can
actually compile a thing
let's read here and see what API it's
using not that this
one compile here we go okay MTL compile
options try L device. Library can I do
that is there a make Library function
Is that
real agx G13 X has
no let's do this my python
what was it called I
forgot uh make
Library there's nothing under make
Max compute attributes 31
okay what's an L
device what L device equals device
where's
device devices here new
device default devices MTL create system
default device okay so it is that
device uh how do I create that command C
again device. new command
Q just want to doing new command Q also
oh yo we got to give a shout out to
Clarkson's
Farm okay new command Q okay maybe it's
just oh is there is there a new
buffer
oh new buffer with LAN
new
library ooh new library with new library
with
Source this see seems like it's
automatically
generated there's an objective cap
API all right it's got to pass in an NS
string um
I wonder if anyone's actually made this
work
before doubt
it but I like I like that this is not
like wrapped at all this is actually
just letting me access the raw metal
things I did actually make this work did
I
not oh device. new buffer with
bites I you to make all this work
cool I we can make this
work okay new library with Source
options error
okay we have to pass in the
source uh what are my
options MTL compile options
and as
object oh this is like a
thing I can
do metal. MTL compile options all right
cool
options equals compile
option metal compile option default is
fine now error what type is
error it's a completion Handler here we
go this
one uh NS error
nullable on return a pointer to an error
instance okay so this is a return thing
do I have any other
error I possibly going to
null
program let's
see extra gem metal
minimal use class message class methods
to instantiate Objective C objects okay
well you got to use a class
method would help if I actually knew
Objective C
device. new compile
options who knows Objective
C is your Pi Swift
system bundled comes with pi OB
C cool
there's a CPP library for metal no I
don't really want to do
that okay how do I create an MTL compile
options maybe this thing has the answer
unfortunately it's in Swift
but options options equals mgl compile
options okay well that's what I
wrote use class methods to instantiate
new Objective C objects I know let's
Google
it balling like an
idiot
uh oh
alet
alet huh a there we
go yeah I know Objective
C yeah that's right Alec and
nit okay
Library I got home at 3M my web
cage oh
sweet okay this isn't going to be bad at
all
uh new library. make
function function equals
Library dot
um
uh new fun function with
name
cool okay uh we got to call the function
now
is there any example of
this can't be the first person to do
this am I
[Music]
okay so we'll end up writing run times
metal just so we can unlock the leitess
of 1024 you understand that's four times
as many local shaders that's a lot of
local shaders boys I don't know what
we're going to do with them all we're
going to shade
things I know exactly what we're going
to do with them we're going to multiply
matrices fast that's right that's right
we're going to multiply matrices fast
let's go
uh okay so we got a function with
[Music]
name
function okay now we have a function how
do we run said
function by way thank you to whoever
write wrote Pi oby seems very
nice uh okay L
device make compute pipeline State
what's an encoder make
compute undo is broken and there's
people complaining about it undo in the
Vim plugin is broken and there's people
complaining about it but uh all right we
have to make a command queue did I
already do that all right I
did um
so now hey at least it's not
Vulcan uh it doesn't matter if they're
square or not I can deal with all that
later uh once we get the speed but if we
fundamentally can't get the speed
because uh it's
cheating which by the way the cheating
was very
real uh all
mtq
dot let's just do this on my python
okay MTL q.
[Music]
new that's
right I do this in here don't I do I
make a
command MTL q. commandbuffer okay h
get a command
buffer now we have to take our Command
buffer and create an encoder
compute command col okay
all right now we need compute pipeline
State L
device
device. new
comput pipeline
state with function
error what I do for error I just passed
in none okay so now here I can pass in
the function and
none we'll call this pipeline
State
um encoder
it's not
defined oh well if you spell it wrong oh
command encoder is
already
whatever uh
okay encoder doet compute pipeline State
Pipeline
State
oh I can't do that
I use an encoder here what is this
Shader that thing is there an encode to
command buffer on the
function no there's
not oh I think it's
because I have to do this yeah okay
encoder do set compute pipeline State
like that ah there we
go you always got to look sometimes it's
just in a thingy and you got to just all
right um wow okay what's thread
execution
with is that a real
thing 32
Max total oh yeah look at how many look
at how many total threads per thread
group oh one two four oh oh metal can
have one two four and open CL can only
have all right we're done oh you found
you found
examples I should have searched GitHub
oh I don't have you got to link one I'm
not signed
in I don't know don't you think we're
learning great things by doing this by
hand psych we're not okay um
encoder do set buffer okay we're gonna
have to make
buffers offset
index yes oh is that the food that could
be the food
boys that would be crazy if that was the
food I'd be so
happy almost there
I think it's here I think the food's
here bro get a tip you brought it to my
door that's how it
works yeah yeah we got food
boys I got
food I got show it
out oh yeah yeah check out my piece of
avocado toast this was only
$23 thanks
Tay got B avocado toast want
some what you
want want what
want um I got to go share the toast with
Alex um only $22
right I got to I got to go share with
Alex uh but we're making good progress
I'm liking this progress guys and we're
learning the metal API which actually
pretty
cool what's up
h
you know my opinion been change maybe my
opinion I'll even change on Sam mman but
not
today uh I'm sure Apple had a very good
reason for
cheating I actually have some notes hang
on find my notes
here
so well actually here's a question
um let's go back to C
minimal I have a
question what if I don't put in a local
size does that does then it get set to
the full thing
cuz then we actually might be able to do
this with open CL
still um invalid work item size we can't
do
that I'm wondering if I don't give him
one no it only gets 32 then
Max group
is no I've never gotten 20 1024 from
python
okay uh we set the
[Music]
buffers dispatch thread groups okay we
have an MTL
size um let's just make a copy kernel we
need a buffer let's get a
buffer where the buffers come from L
device. make buffer okay that's not bad
now I think I already have code to do
that
here it's called new buffer here here
new buffer with length so we'll just
call the buffers do I call them A and
B what I call them C minimal A and B A
and B are great names and you'll never
accidentally type something else for A
and B Because A and B are unique and
special you'll never think like
to use them as variables somewhere else
and then run into bugs where you know
I'm being sarcastic guys those are
stupid names for buffers and you know
just cuz Michael Phelps smoked marijuana
doesn't mean you should too
the last thing I want to do is dive into
Apple's open CL
driver and you can ask yourself why
that's a bad
idea because then when Apple updates to
the next
version all your hard work is going to
be for nothing this is going to be a
stable API that's never going to be how
long before Apple deprecates Objective
C um set buffer
probably has a long
name set
[Music]
buffer offset at
index set buffer a we offet zero at
index
zero okay
all right we that and
buffers let's dispatch the thread
groups
dispatch the red groups
dispatch threads thread for thread
groups dispatch thread
groups num thread groups threads per
thread group okay what about just
dispatch there were other things called
dispatch for they're
not dispatch threads threads for thread
groups let's just do this okay we have
to make MTL sizes metal MTL
size uh
okay I actually prefer Apple's API to
open CLS because you're like creating
the command buffer it is it is actually
more sensible um because hopefully I can
reuse these command
buffers you see open drivers will kill
you malaking 30 million
times so like a command encoder is kind
of a smart way to do things
there compute pipeline state with fun
function that's the only one I don't
really
understand all right we're done with the
encoding now we can
do command
buffer.
commit I also wonder you know there's a
bug in Apple's opencl
timing
commit cool
command buffer do wait until
completed
great let's see if we're actually
launching
shit why is that zero
why is my local count zero it should not
be zero is n0o
no why is that
zero
oh Cuda does it like that too there you
go
might be that might be the purpose of
the other kind of
encoder let's read app ptry
documentation on
this okay thread groups
yeah I think if we change it to dispatch
threads we get more what we
want you see the difference it's like
stupid
but go great
that appears to have worked too which is
kind of
concerning that should throw an error
no the neural engine sucks you can't
like apple added even added more Apple
added even more security to it since
last time you can't get raw access to it
for some
reason um yeah it's like super lock down
so okay
it's a little bit upsetting that it
silently fails if I make this
wrong can I do that is that
allowed it rounds
up if I make it 513 did it Round
Up it rounds up to 544 okay got a love
it
you can write a python
wrapper um
oh that's why okay I just tracked to
make sure they're all
completed um out is b b. contents
what
happened we streaming
Alex okay that's not too bad all right
let's um b. contents why did I join
there
what Alex we're on stream right
now would you like to would you like to
complain about me to the
streamers I had her leggings the whole
time that's what she said
wait
no
um segmentation fault 11
why would you do
that all right well either way we're
getting twos and now Chang this to four
we're going to get fours oh yeah
buddy I've got to write a better way to
write
that what's vertex done B who was that a
Shader ooh a
Shader how often do I get vertex dobin
do I get vertex dobin when I run this
one that one torch
do I get vertex bin when I run that
one o vertex dobin
o except it's empty all right whatever
vertex St B will be a mystery for
later it might just be easy to get speed
now that we have
metal I probably shouldn't just put all
this stuff in this stupid
Branch need type
annotation now the T flops are not going
to get higher
we're not going to get more t-
flops all
right we're just going to need to modify
our GPU code gem
and we're going to need to write a
runtime for
metal let's do some reading metal versus
open
SE my metal version is constantly four
times slower
so the T flops are not going to go up
um the main advantage is we can
now uh allow up
to one through four reduces so maybe we
should focus on that one
and we'll call the
stream I'll be back
all e
um if inducer wait oh there's an
issue what's this
issue no that's just Apple you mean
stuff about Apple deprecating it yeah
they deprecated that
why is metal slow
and later with a modified python Library
what are they
using how are they using
metal oh this code hurts my eyes
how' they get
metal metal compute Babble what's that
Swift
garbage yo I think I'm the only person
to do this so
far actually got metal to work in pure
python it wasn't even
bad everything about this API was
actually pretty
good it's in some ways more intuitive
than open
c um I mean I'm upset with Apple for
cheating but like that's a good
API you sent some code that does it
before Oh I sorry I couldn't see your
GitHub search I guess I'm sure someone
else did
it okay
now we have to make our code yeah Vulcan
is unbelievable able with the boiler
plate all
right it's right to runtime it's Cuda
runtime so I write something similar
okay you know what we shouldn't be in
this uh brand we should make a new
branch that sounds hard we're not going
to do that we're going to complain about
how we should do it and then continue to
not do it that's a good choice
um guess that's fine for
now no
[Music]
stream uh this isn't going to
work that
join doesn't work
uh how do I
do copy
in I technically don't have to support a
copy in do I I can just support a
creation with the
thing do I use copy
in we should figure out how to make copy
and work
[Music]
for
jobs in the towns that i' never move
to uh can you send me a link a r or two
if you can find them can you send me a
link that actually shows me how to do
copy in and copy
out so I can just steal it
uh do we create a new command Bo far I
think we do
should I use that same
trick
probably where I track the command
buffers I think I could actually say to
the buffer wait until completed
for
[Music]
for for
okay can't do that
um I'll just simple basic code yeah yeah
yeah but can you send me one that can do
copy in and copy
out because like this contents thing is
not right
Objective C VAR
list oh maybe that's why it's seg faed
maybe I have to track the size there
uh
thank you you join
me this is hot oh I know thank you have
a good day you too
I really don't think it's like there's
got to be a better way
I why how to cheat on copy
in shouldn't matter
only vertex
buffer what's a vertex
buffer this is not the same thing at
all this is doing a this is like a
uh this is not the same thing at
all I maintain I'm the first person to
do this
I complete it auto completed it but then
it didn't give it to
me
whatever
okay uh this is not right
for I comma a in enumer
arcs great I think we wrote a metal back
end uh
that's for
oh because I don't think we use kernel
void I think we just use yes of course
of course it's a kernel void yes and uh
there's no globals here and I might have
to write the scriptors about how they're
buffers
n type has no object new function with
name because there's an error in
compiling and you didn't print it you
piece of
shit um feel like this one compiled I
feel like when I did put an error in
that one it
worked um metal
minimal I went like that gave me an
error it used to give me an error now it
doesn't what did I do do
differently just now the function just
doesn't work remember when it gave me an
error oh no that was the
oh
error oh
okay it's not too bad
um y
oh it's just Shing the error is the
other
one
uh that
worker wants a string okay there's your
fucking
stream sorry
perfect okay good now we just have 7
million to fix that's
nice uh of course we have to tell it
it's device
float do I just have to put device or do
I also have to give it the number even
though they're clearly in order and you
can come up with the numbers yourself
metal okay that's
fine uh no getting Global IDs well I
didn't think we were going to get Global
IDs so there there's
that red position in
Grid that
work it runs cool it's pretty fast
um
[Music]
all right nonsubscribers do you have
anything to
say
bed take your country clothes
off you don't love $20 toast
bro I don't like this copy in copy out
API was it worth
it
um I'm going add a new API called numai
well you know what maybe we'll just call
it 2 CPU isn't that what I call it
in see like look I create this empty and
then I do copy out this is
terrible uh we'll just have good old
2cpu
and this can return that R
run uh we actually want the sync to go
there and the copy out can just be this
equals 2 CPU but we're going to change
this everywhere
[Music]
uh Unbound local
garbage oh we're not doing wait until
completed uh yeah we got to wait until
completed
okay uh they're all zeros why are they
all
zeros should not be zero I didn't set
that one to zero I set that one not to
zero why are you
zero I said
four no
this is a good
link oh as buffer oh fire bro you're
cool I like you I appreciate you you
know what's up all right so I don't
understand why didn't my program
work uh
as buffer
that we go to this stupid
join on the sidewalk
all right well we got a dumb question
about AI but we actually got a very
good uh copy data 2
buffer that's going the other way
how come this worked and this
doesn't if I get rid of the float
FL
nothing all okay is there some reason
this just isn't
running there's another one with error
right oh yeah pipeline State here we
go that
works I don't understand I literally
just have a
kernel which is assigning
I don't have to import that stuff do
I uh third position in Grid that's not
right can you do print F within a metal
Shader I don't know about
that you're signing which is a in not
out no it's out what do you
mean there is no in and
out oh you know what I bet you it
is it's that
or
not why do you think a is in
oh might be that
yeah but that doesn't
matter it's
best ah there you go four
five boom
[Music]
pantic news
does this news impact my life or is it
fake news which does not impact my life
or is it real
news only on the Channel 5
News only on the channel five
news s a lot of Bo burum lately all
right okay
um let's go to my CL gem Benchmark and
let's understand how to access my Global
my tiles
metal get Global
ID no this is just how to use their
stupid Shader how do I actually here
matrix multiplication in metal shading
language uh look at the MPS Matrix class
lame thread position in
Grid where do I learn about
this attribute qualifiers
a position in the grid of
all that interesting it's past in that's
actually a much smarter way to do it
there's things I really like about Metal
like how stupid is it that there's just
a magical function called get Global ID
it should just be an argument to the
function that's actually
smart for
okay we know Apple's doing something so
we did all this just so we can enable
okay do we really want to do this do we
really want to do this what we should
really do is we should get a new branch
and we should import the metal and we
should run the tests on the metal and do
it all properly do we really want to do
that do we have the energy for this
right now guys or do we want to take a
nap you know a nap's very tempting might
be nap time
no naps why can't I have a nap we'll put
on some nice Clarkson's
Farm it's already push to the branch you
guys can play with my metal if you want
uh no we should probably write a
whole like I can waste time and like try
to like do something manually but it's a
waste of time when we have all the
beautiful Machinery of tiny gr to do it
for us
metal it's kind of like how we added
Cuda
support to the GPU back
end what's wrong with Apple getting
eight Tera flops we only get 3.7 but now
we found out why and it's because Apple
cheats and has larger local work groups
than we're allowed to an open Seattle so
we wrote a whole metal back end and it
works now we have to make
it do we need a metal back end I never
wanted a metal back end
oh yeah there's always going to be some
performance limiting factor the Cuda
back end is just faster maybe it'll just
be fast oh you know what maybe they'll
just be fast yo that'd be sick man all
right I have
hope
uh fine okay oh this is all going to go
away
when can that all also be used to copy
in without realic
maybe I think I actually want to get rid
of Copy in and copy out
though all right let's try to middle
that let's
go and then we're done and we can worry
about making it fast some other
time okay welcome to
master we're none of this shit
exists
[Music]
from it's it called Fast Triton what a
stupid Branch name get check out fast
Triton uh tiny gra
runtime
metal. so now you'll see if we do
something like GPU equal 1 one python
test test
Ops it slowly compiles them all test
them yay now if I say Cuda equals 1
you'll see no it doesn't have Cuda okay
but we have
metal we're here to Ops
GPU uh
Cuda
metal get and
metal uh if
Cuda with
metal that seems
nice let's just focus on one
thing forward only metal equals 1
forward only equals
11 okay good because we don't have
kernel
um Global if Cuda okay
uh let's create something called
not happy about this
okay really
subscriber only
um probably want to put these in the run
times probably want to say something
like kernel prefix for
Cuda colel prefix for Cuda is global
the kernel prefix for
metal is just Global oh yes oh this is
this is great Geniuses man Geniuses made
this all right uh that was sarcastic
this is stupid why are they all slightly
different okay and then kernel prefix
for this one is
Kernel okay so now we can just change
this
to c program. chel prefix
great unknown type Global why why it
shouldn't be
Global let just
kernel where' my metal kernel
go just
kernel not Global I got thrown off by
Cuda okay
uh okay now we have these type
qualifiers Global if not
Cuda that is terrible looking code okay
uh we
have buffer
prefix and in metal their
device in open
CL they are uncore Global and in Cuda
they're
nothing you got to love how every one of
these is just slightly different right
all right so then we can
just CL program. buffer prefix if not
Cuda
okay use of Undeclared identifier get
Global
ID okay so metal doesn't have any
anything like
this uh
okay there's my Nice metal program now
metal doesn't have G Global ID metal has
this other
thing
uh red position in
Grid then we have to add more things
here
okay
uh for
thread positioning GP it should be a u
in
three uh seems right
metal we should put that
par that's not going to fix it but at
least you can see that
there okay
um we have Cuda uh to say a function
called
G and metal we return G
DOI that's
right
um
Cuda we
return this hot garbage
and for open
CL we
return
this
static okay
C program.
GID okay that's
fine um what do I do if this is none
all CR program has no attribute name
well
uh okay that's
fine
because how do I actually do that that a
sign
there's a way to do
this there should be a function
header I don't think
so
uh assign assign assign assign assign
assign
put
for for
cool it
works metal can
add all right now in a second we'll see
which of our tests fail and which of our
test
succeed uh
right in compatible
import
oh
um if not Cuda and not
metal almost done
cool oh my God I just pushed that to
master uh whatever YOLO let's hope I
didn't break
anything like it's going to test the
metal sub
works well no I might have broken things
Let's test it without metal and see if I
broke
anything seems
fine all right uh let's see what
fails oh did I mean metal exp maybe I
did mean metal EXP
uh doesn't the other one have like a
using namespace metal or something
yeah
uh let's do
that okay
um it's reasonable that has a problem
with
some thank you it fixed 131 fails right
okay uh yeah yeah the barrier function
is
uh the only yeah okay um barrier equals
I don't know what Metal's barrier is but
I know 's barrier is sync
threads should I put the
semicolon okay
fine open cl's barrier is barrier clock
metal
fence and I don't know put that to
nothing
C
program barrier plus
SL thank
you
okay
function I don't know
just is this just a metal like sync
one metal reduce Kel just find to reduce
carel it I'll answer some of my other
questions too here we
go oh
god there
thread group barrier me Flags me thread
group
great got a love how they're all the
same and yet all different did that fix
any failures no it didn't uh it didn't
do an error there okay we just don't
have
local okay
um
local called the smm prefix I don't know
what's the smm prefix
here uh
shared thread
group okay the shared prefix in metal is
thread group the asmen prefix the asmen
prefix in opcl
is it's like they all just made them
different on purpose is local and the SM
prefix in Cuda is
shared
okay uh CL program.sm
Prix oh
Booyah that was easy boys
look how fast it is compared to
non-metal that runs in 1.3 seconds and
in in open CL it takes 2.5 seconds
that's cuz metal is fast
yeah all right did I break the
test oh no I broke the
tests broke the linters
wait I can't see
this I broke my pie what I run my P
locally I don't get
it I'm not signing
in no I don't have to sign
it
a oh probably because I have to just
disable
that crap
here
okay uh the GPU test that's failing is
the optimizer test where's my Optimizer
test
looks fine to
me can someone tell me what the failure
is who signed in all right I'm signed in
over here very
upsetting static method object is not
callable what
that doesn't make
sense like some old version of crap
never at the top it's just feels so
unreachable I dropped out of college cuz
I'm completely
unable I didn't even like the static
method anyway you know what I didn't
even like it did you like it no cuz it
sucked
now it's an
array be
happy import future yeah well not
importing the
future um
G is
Right
Metal
Works wow we just wrote a whole metal
back end it's pretty
sick for
what T flops you want to
see remember Caroline Oh is she going to
jail oh you want to do
that I mean it's not going to be good
because
I don't think it's going to be
faster might be
slower like the
same does it actually work like I almost
feel like that was just too easy no but
I'll show you the one I care about um
see this one
why is that slower that one I think I
can make
faster see mid is only
26 uh
for for
um it's
fine okay so now it's even slower
uh oh and hang on we should just add
this to the bottom of
that uh get import Global
counters should all import from
something okay so metal manages to be
slower um
uh fuck
is it
only
oh
okay where do I get that 250
X like in here
right want or two four
why isn't it
faster I worked really hard to get you
that
lame it works so hard to get it that
1024 and it's not faster
what do you mean I'm importing from the
wrong run time no I'm
not no I'm not just say don't worry
about that I did it
right I really like that I'm pushing a
master right
now did I fix the test
I did not fix the
test I didn't push
here's the thing about
speed you can
do five things like if in order to get
the max speed you have to do everything
right if you have like one of five
things wrong it's just
slower and that's it like you just don't
know why
oh
H have some
theories no I call L that right
yeah you can't see other pre compiles
they're not you can't see
them at least I looked a bit
why are those ads in there
should be nicely
coales I don't understand why that's not
faster
where are all these other Colonels
coming
from I also that we aren't cashing
them we not cash any of them anymore
Flo 4 won't make it
faster I have an idea though that like
something else is going wrong here
not recreating the
colel but is recreating that kernel
that's fine
like watch if if I get rid of
metal now I'm going to complain and say
it's invalid work item
size and I worked really hard to get
that 1024 and it's not any faster
all right when torch is doing reduce is
it in queing more than one kernel or is
it doing it with
one if it's doing it with one there's
something I just don't understand no
it's not the same speed look look it's
3x slower I was sure this was that at
least I thought we'd at least fix that
problem maybe this is slow
[Music]
definitely faster ways to do that we
just taking five milliseconds for the
kernel
it's literally faster in open
C no it's not copying to and from that
should all be away from
this how do I time things in metal
this just
work for
now does this have the same stupid Apple
bias I
wonder or these actual times
those actually look
right
wait what
how come that one's fast now this
doesn't make
sense that one's slow and that one's
fast
just don't buy
it the timing has got to be the other
way right
oh I actually have a
bug it's a very interesting bug
can it even be that fast it can't be
that
fast but there's a
bug let me show you what it is in my
test speed versus torch so we actually
synchronized them
here but we never
hm
it's just an interesting like there's
been a bug in
that test for a long
[Music]
time uh
wow that's actually been a serious bug
in my
test because you call realize but we
never actually synced it so it was
actually waiting for that stupid
addition to
happen we're a lot faster than torch
except in this one in this one we're
still a lot
slower metal is
slow I think part of the reason metal is
slow is because we set the size here so
let's do 32
not better
why is that so
wrong uh
those are fast those are slow
colel end time Kel start
time wait until
scheduled without a completion
Handler oh that's scheduling times I see
so GPU end time GPU start time
has no attribute
okay CR buffer debugging it seems like
it should
work talking about
no Capital
GPU so
counterintuitive it seems
better where's the real time weight so
far off on those other ones
uh
should canonicalize all that if someone
wants to like submit a pull request to
like make these things look not
terrible uh like I just I have the same
code copied down
here Co
28s I think I even yeah 18 12
why are the real time weights so
high maybe because this other stuff I
don't know it's kind of stupid I don't
really care the timing is
right I wish they like looked more
similar you know
yeah but okay those timing is pretty
close to
match no it's not a measurement problem
those are right
like how fast that is
inas it's just
fast that just not
fast um
um I mean okay if you want to check
quickly if it's a measurement speed or a
uh we can do this if you want
how much faster those
are not what I meant to do
I don't even understand why that's
slow
okay I'll notice that takes note that
takes half the time despite being a
quarter of the
size like doesn't really make
sense
it's so let's look at the GPU calls for
MPS I mean we
could all right you want to just throw
the sniffer on there and see what we get
uh where's my
serer uh Di
is that the torch
one that could be anything though
okay part of me thinks they're not using
local
size and they're doing some other
like they're doing like okay so you can
fix this with a two-stage reduce and
it's possible that's what they're
doing um
what are thread group function
py torch didn't write the kernel they're
using they're using they're using metal
performance
shars e
you know I'm starting to think that the
before might not matter based on like
how
oh come
on you know this is why I have to get in
the habit of
oh I didn't push it yet oh nice
sometime I get frustrated and do a quick
Force push but not today because I
didn't push
it uh oh simy Shuffle
down yeah this looks fast
whoa read from device memory right to
thread group
memory simy Shuffle
down I don't really understand this
why would this be
faster why would this be faster than all
of them just independently running
I don't really get
it I mean here's a question can I
saturate the memory if I
uh I should do that in micro
Benchmark something with memory
[Music]
caching it's possible
read from device
memory um
form Pur
MD ad is not that important bro bro if
you keep saying dumb shit you're going
to lose your VIP all
right stop saying dumb shit
ad is not that important
bro
bro ad is very
important without ad there is no
M try to make can you make an ad out of
Ms I don't know if you
can we're not going to do it yet I'm
just just is a
warning sometime you add value but you
got to you got to you got to watch out
look look look look look you're still a
lot better than a lot of other people in
the channel but sometime you got to look
out for saying wrong things like same
the py torch Kel it's not really a bad
question um I mean I looked into it
yesterday I didn't do it on stream uh
but ad is an important bro we're trying
to fix some what you think we should do
prod instead it's got the same problem
all right you good you're
good uh I don't even understand this bro
[Music]
oh
H okay this is doing some like weird
thing it's not just functioning a big
loop
aha no no no no no it's
this no I I don't think that's right I I
I don't think it's that I actually don't
think any of this other shit matters I I
think the whole thing is that it's can
do atomic fetch at
spliet
yeah I don't think there's anything like
that in open
C uh well no okay so this is the the
whole the whole secret to this konel
this is junk like yeah it's probably a
little better than like
doing it a different way but this is the
whole
trick okay so basically
yeah you posted this thank you for the
find you you you you you figured out
what it is but it's not the sties it's
it's this and the reason it's this is
okay
so the GPU has let's just say 32 cores
right it has 32 cores um and each of the
32 cores
don't share shared memory right so even
though I'm doing 1024 it probably
doesn't
matter
because I'm trying to think of when
one24 would matter and the answer might
actually be
never uh which would be super
lame if that turned out to be
true and that was all just a waste but
either way actually now we can use this
which may not exist in open c um open c
atomics it's an
optional wow opencl has this
stuff see if we have atomics let's
oh we have
atomics yeah
so all 32 cores can function on the
reduce at once there's probably a
limitation to how much the launch of a
single kernel thread group how much RAM
it can
access uh yeah so you just like thrash
it across the entire
thing and then it doesn't matter how you
do it the other stuff I don't think I
think the C stuff's probably a little
better it's probably more power
efficient um
um but from a raw memory perspective if
I could get every core helping me out
nothing else
matters uh I mean we can also do this
with a two-stage
thing especially if my Atomic has to be
like
that using just Atomic is an easier your
code change well not
necessarily
um device Atomic
in pointer
output is that just like a normal buffer
though quad group
functions wow wow okay this looks like a
fun this looks like fun
reading to make our metal fast to figure
out how to really get that full
memory
great all right I think that's a pretty
good stream let's make sure we didn't oh
we broke the tests what did we
do we can't
tell W name eror sync is not defined
okay that's fine
uh where is sink here for
uh using two stage review give that
effect op fusing no no we just have to
create like a temporary
buffer um I mean it might work out to be
faster but the problem is you have to do
two kernel
enqs let's just make sure I fix the
tests and then I think that's today's
stream
and we'll let nonsubscribers talk and
we'll ask if you have any
questions and if they're dumb questions
we will chastise you
appropriately uh no it's just like it
just like insert another buffer you know
what I'm
saying
see you I know what's fast and what's
not uniform
threed group
it's like they reinvent the same
Concepts like all three open CL Cuda and
metal all have the exact same Concepts
they just like name them slightly
different
things why did Apple create
metal they're the kind of company that
could have double down on open seal and
make it
good uh did they all rip off Cuda I I
I'm sure
dead oh yeah they Rick off
Cuda oh my God you're right the original
author is Apple wow
why would Apple do
this apple you could have
kept um commands are encoded beforehand
and then submitted to the okay so this
is a nice part
yeah if if this is the main change they
made this is actually a smart change but
I feel like you could have extended open
C and you didn't have to like rewrite
your own
stuff oh does AMD have a stupid one too
am I going to have to write another one
for
AMD I'm not sure I remember when AMD
head close to the
metal you think that really predates
Cuda I
don't does
it wow maybe it does
I mean it's nice to have these sort of
implementations that are
uh like it lets you see whenever you
implement multiple of things you get to
see like where all their commonalities
are um and now if we have like a special
thing we have to use on metal we can use
it on
metal uh I guess I didn't try the one
thing I wanted to
try I don't think this is gonna work but
uh let's just give it a quick try okay
get checkout fast
tring get merge
master all right I got to fix
conflix
uh incoming change
accept incoming change incoming
change incoming change incoming
change okay those were
easy wait
no no that's
wrong get merge
abort get merge master
incoming change but we also want to
change that to size T it's actually
faster
is that the
only there the only one there that's not
too bad uh
incoming
ining so here is where we want to
actually uh that goes
there and that gets deleted
Cosmic
Saga why you want to troll me this
morning you get a
timeout oh
yes um I don't know if it's actually a
trolling message I'd consider answering
it but the other guy said it was trolly
so I'm going to go with
him you know sometimes as a great leader
you have to just make completely
arbitary decisions that piss people
off uh okay I don't know about any of
that and if people have a problem with
it you can send them to the
goog uh and then if people have a
problem with that you can send those
people to the go Lo
too and then eventually when your goog's
full you can have some of the people in
the goog build a neighboring goog in
exchange for promises to be let out of
the first goog but then psych they stay
there
that's right that's
right
um okay we're getting a pathetic amount
of
gigaflops so let's make it non-poetic
external
put that one
back put that one
back those
back come on be faster be faster oh I
guess no metal right just be faster
okay well that's kind of
annoying thought that it was just going
to work but it's
not is this going to be faster or am I
going to waste time I feel like I'm
going to waste time but we're going to
do it
anyway okay open c
um get local ID
uh op
[Music]
GPU red position in
red look like another
thing I don't want thread position in
Grid I want thread position in thread
group is a local
ID
okay
lid lid uh where's my Cuda Cuda also
needs a
lid where's my code for that
seems
good we did pass the task
right
cool okay uh
where am I using _
local this should not be here if not
Cuda or
not and not
metal cash should work okay I
think uh pointer type must have explicit
fuckers okay
um all right this
is buffer prefix
we have another barrier
and then we have another place where we
to
finding
local no not that
one
this uh that's SM
prefix um
yeah so we can't doore Global it's just
called something else
unknown
typeor local I still have that
somewhere yeah
here copy and pasted garbage this is why
you refactor before you start making
making
[Music]
changes casting from device float to
thread group is not
allowed that's sensible actually I
wouldn't want to cast from a device to a
thread group
either
um oh yeah cuz I made a change
that or
nonlocal okay that's
good uh metal
out wa until
completed okay so metal gets you
bajillions of gigaflops that's the good
news
the bad news is it gives you the wrong
answer the jillions of
gigaflops the wrong answer you can
choose your own
adventure what would you
like why does metal give me the wrong
answer uh oh I know why well I at least
know why it's giving me villion of Giga
flops I don't know why it's giving me
the wrong
answer uh it's because these times are
measured in seconds and we are looking
for things measured in Nan
seconds
ooh five gigaflops except wrong
answer that a good deal how much Giga
flops would be worth it for you to get
the wrong
answer why is the answer
wrong thread position and thread group
not what I think it
is are my thread groups
wrong how is the answer wrong
why is the answer
wrong the only thing I can think is that
this is wrong
no think
so CL right answer
metal fast but wrong
answer I have a typo in line 22 in C.P
do I still have it did I fix
it oh you're right thank you
metal runs I'm not going to say in the
comment I'm not going to say in the
commit message that it doesn't work I'm
just going to talk about how it runs you
know you got to sell yourself guys no
one else is going to sell you for
you why the answers are
69 why doesn't this
work
um all right let's try some
simplifications let's get rid of
this is that that give the right
answer no even that gives the wrong
answer oh that's
concerning
uh wait did I break
metal no
maybe the float 4 stuff doesn't work
[Music]
okay the float 4 stuff doesn't
work oh Cuda actually has a similar
problem uh it has make float 4 yeah that
just might be
wrong H I think it might I don't think
that cast is
right wait but the good news is if it's
just the cast then it actually is
faster might be that in metal
there you
go okay let's get rid of that
[Music]
simplification I will note that the
answer is right now
oh
boom of course once I fix that it
actually starts doing all the math but I
will
note that metal is giving me four Terra
flops unlike open CL which only gives me
3.6 this is a great victory for
everybody involved in this project we
have made we have increased the speed
from
4 we have increased the speed by 11% I
would like to give I would like to give
bonuses to everybody who did this you
can all have 3% of the tiny grads profit
tiny corpse money uh which is0 but I I
just I just want to talk about how this
is a great accomplishment uh for a lot
of people and you know sometime it
doesn't get four Tera flops but
sometimes four Tera flops that's right
that's right that's a good number of
Tera flops uh hang on I just want to
Let's three doesn't seem like enough
times to run it let's run it a few more
times than
three let's run it five times that's a
good number of
times I did change
anything
uh I don't even understand why it runs
so many times already
why does it run that many times I don't
understand oh because of this crap
so we were running at lots of times you
just weren't even getting the benefits
of
it four Tara flops and with no
metal three Tera
flops oh yeah yeah 3.7 ter flops
yeah no metal
metal wait wait wait now let's just try
something quickly just in case because I
actually have some to show you guys that
might just make it way faster I have a
search a where's my search here's my
search okay let's turn it
on let's get rid of my
debug and let's see if we can find
something with lots of Giga
flops okay
well we found something with crappy
number of
gigaflops now I think we've identified
the
champion the champion is right here with
448 is what we're doing okay well we
sped it up
11%
uh it's interesting to note that we are
exactly 2x off we're 2x off where we
should
be um so we just need to enable the 2x
speed who's complaining about the lacks
of moderator send it to my cat W's all
around what I think this is
fine okay moderator you have a question
oh no I have some bad news for you you
get a timeout for asking a question
because it's a stupid question you know
what though well I guess you didn't ask
a question but you put a question mark
after so it was misleading to the go Lo
to the
goog oh yes you know if we can really
just keep a cheery disposition while we
send people to the goog people are
capable of
anything the dumbest question is can I
ask a question that's actually I think
that's the dumbest question in
history
um there's a space there does everyone
see that space look at it and remind
yourself to not be that space
um remind yourself not to be
space all
right uh if they're doing one 24 what's
the sare one or 24 36
32 is that
right yeah okay
cool uh all right let's just give one
thing a try I have one quick Theory
wait
guys it ran so fast that we're dividing
by zero
again huge number of flops in exchange
for wrong
answer good deal or bad deal
why is this
broken for
32 by
32 32 is Elite number by the way gpus is
really like
32 have some theories that this should
work that this is the really fast one
but for some reason it
crashes all right let's add more
debugging to meta
because you know what 32 * 32 is it's
one or two4 and that should be
allowed CU it's
metal
uh both divisible that's fine
there's got to be some bug in here
we do that
assert we do that assert so it
definitely builds the function
how do I see if a command buffer has
errors the float division by zero is not
the error
did schedule error oh here
error no
good
schedule error
[Music]
was that
right we must have some
error uh I don't know console sometime
this thing should
ARS request pipeline
what's the
error it's really whining about like
registers or
something um
return
something none should it return
none I do not
know looks like you can reuse the
compute pipeline
commit
oh you're saying I can reuse this I get
it this pipeline State thing
you're saying I can reuse
that I don't even care if you want you
know what sub going a pull request to
the main one and see if that
works oh no I didn't mean to reset the
whole saying damn
it
okay well either way I should just be
able to put it there
right and it
breaks so it's ever
breaking can you ask the author of this
project bro you're the reason we're
subscriber
only ask not what I can do for you but
what you can do for
me you're on my stream if I was on your
stream you could ask me to do shit you
know I feel like something's failing and
I'm just
not getting told
what you're keeping me in the dark here
does that it doesn't like
that it doesn't divide by 24 does
it doesn't divide by
24 16 is
fine uh okay you know
what thread execution with number of
threads in the thread
group Max total threads per thread
group should probably check that
oh
okay we have a Max total threads per
thread group of
448 and I wonder if
that's yeah okay this is the
problem um
we put like 32
there yeah bigger than 448 and it's
because we using too many
registers but okay that's fine because
we get rid of this so let's get rid of
that
uh let's get rid of
those and then let's change this to ones
832 we're almost
there if I change this to a two does it
get small
enough aha
okay that works but it's
slow uh yeah this has to do with the
amount of shared memory uh available on
the chip
we're almost
there so this is close to the
algorithm why is it giving me this
is there anything that like tells me
why
static thread group memory
it has to do with the
memory I don't really know an algorithm
that would use less
though unless of course Apple's cheating
and using
halves it's possible they're using
halfes if it turns out they're using
halves then that's the biggest cheating
I've ever seen
let's assume they're
not local size bigger than
832 Define cheating like they're using
like half Precision or something
it's a pretty straightforward algorithm
right there's no way it like uses less
if I actually go through all the effort
to change this to float
uh let's just we can at least put this
back see what the strides are
that change it is it's still
832 still
832 for
hm now it's
448 okay that's interesting that makes
me think it might be register pressure
to
float it can't actually be register
pressure this doesn't require any
registers why when I do this
does it suddenly
have oh that's only
576 it better not be something as stupid
as
like all right I'm going to make one
quick change and we can dry this
[Music]
uh same
great it has something to do with this
though
okay because if I change these strides
it does
change
576 what if I flip this
instead like that
[Music]
32 that 32 *
32 same
oh this is some Bank
garbage okay how do we get stats on the
metal kernel is there any way to get
[Music]
stats we have
this static thread group memory length
is that what changes when I add the
stdes
that one
up no has nothing to do with that
so maybe it's registers
hm
dumb shit but let's just try it
okay uh there's got to be some way to
debug a metal kernel there's got to be
some way to like get some
information this comes from the pipeline
State querying thread group attribute
mdl compute pipeline
descriptor where does this come
from create a pipeline descriptor
do I
though with
function okay do you guys see the
problem I can't schedule enough
local
size
ah like I
can okay the crazy thing is if I flip
one of those
things it does change
um all right we know what's maybe the
flow
Force I try
this same
same this is like no
kernels has like no registers I mean
is there like a verbose when I
compile reducing Shader bottleneck um
uh oh can I use fast math is that the
default fast math is the default
okay
oh2
uh change the rounding
mode doubt that's stuff
matters give it all warning
messages make all warnings into
errors um actually here's a theory okay
what
if have anything when I
C none okay
record
sources like the uh Nvidia compiler has
a bunch of like
uh you know you can like get it ver Bose
these were very boring I looked at them
I couldn't exactly get this I didn't get
that uh
precise results are not
definitely works if I just do
that it's just
slow we know that they're writing out
four
um is that memory like what I'd
expect that's exactly what i' expect I
guess the craziest thing is how come
when I change the strides it changes the
occupancy if that's true it means it has
to do with
registers
right for
instead of size T should I use uent
again I don't think any of these things
matter but
it has to be registered right because
it's not memory that doesn't make
sense memory would limit not the number
of threads in my thread group
okay it's interesting that the strides
change it let's focus on
that is it because of the float
4 disable float 4 we just leave that
disabled it's kind of stupid where is
it
um it's it's not due to the float
4 it's not changing the size of the
memory there's just something
fundamentally about it that's
different when I put the strides like
that
I mean it'd be crazy but let's try the
other
upcast same problem
a stupider looking
thing it's probably that
one
okay these things have to do with
register
concurrency then I already tried moving
the strides the other
way many viewers we got not too
bad I already tried moving the strides
moving that one
there for
[Music]
H all right the only other thing I'm
thinking that's different is the fact
that they're launching the
kernel they're not launching a 2d
grid they're launching a 1D
grid and then like Computing the
stuff I mean I can do that
too by the way you in valid
opcl yes but it's inv valid workup
size it was always a32 right
we should print the threat execution
with in the assert as well
exact with
32 which makes
sense and the extra
thing metal Shader compil
verbose MTL compile options
fast math
enabled do any of those seem important
I don't really want to figure out how to
send that
wow look at this this looks really
nice how do I get that don't tell me I
have to use
xcode the metal
debugger capturing metal commands
programmatically wait what
what okay that's interesting
analyzing
resources I'm trying to use apple stuff
not in the Apple ecosystem and that's
why it's
terrible
uh MTL function
log D log container
only need to synchronize threads in a
Cindy group
I don't know guys I think there's a lot
more to learn about metal before you can
make this
work but let's go back to our
four uh Tera flops and look at them and
be like wow four that's a really good
number because sometimes you know when
things don't work out and you don't get
eight you just have to lower your
expectations um
wonder if that was twice as
fast must be like four times faster
maybe it would
be that's not the simy
line
um let's just try some stupid
stuff only do every fourth
one
wow it works and it even computes some
of them but it still gets it gets a
pathetic amount of Giga flops so we
might be optimizing towards something
that doesn't
matter and then if I put this on does it
break it
that I think Apple has like magic Matrix
multiply stuff somewhere and that's why
you have to use the Matrix
multiplies
for did it get
faster okay it's a little
faster was this CU I disabled float
4 was float 4 making it
slower no effect
what else did I
change oh I did change everything to
U does any of that translate over to
open
CL wow it's faster than open CL
also thanks you ins once you get rid of
in everything goes
faster what you made the loop with
ins function maker has a completion
handle yay I'm aware I did that
one okay we're now getting
3.9 teror flops in opencl and we're
getting
4.1 in um in metal
I assume Cuda has U
also size
T
[Music]
um should we just be satisfied with how
many we got
wait that's
faster is that faster than open CL as
well or only
metal oh it's slower in open C but
faster in metal
interesting
slower slower
okay I have one last trick to try which
is you can change these axis nums
the oh I guess I really make them
generic
okay I'm not sure exactly what these
change or how this works
that is slightly faster in
metal and not an opencl okay
4.2
teraflops we know that's not anything
like what the real one is doing but it's
fast
why did my finder find
it I go over everything did I not
interesting it only find it
now probably because of something I
changed
pretty sweet
guys 4.2 Tera flops up from
3.7 that is how much speed
up 16 % speed up if we just get 16%
speed up every day we'll be at eight8
Tera flops who knows
when uh was metal worth it I think metal
was worth it it also gave us the uint
speed up which is a nice speed up I
can't believe I was still using ins am I
using ins anywhere else we got to we got
to backport some of these there's a lot
of cleanup to do this branch has really
diverged from
uh from from Master with the uh with the
local stuff actually what if I just
disables the local
stuff I want to know what's maximally
optimized
well
um one way to
know is the GPU only has 10.4
teraflops so if we could get 10.4 Tera
flops there's no way to go faster
uh this is not using any local
memory doing your globals every
time it's not
bad cuz I can try to open
C wait
what okay there's a fast one at open
[Music]
C and what's crazy about it is I didn't
uh doesn't use any of the local
stuff look at that
one
2164 oh it's not consistently fast once
I got lucky or
something don't really know how I got
lucky but did little
cheater uh oh you know we should also
make the search go higher
now that we
can you should only
32 it's
possible that it's
higher oh let's put the locals
back for the fast one in Cuda I had to
do some crazy stuff
so who knows maybe I'll have to end up
doing similar
stuff 32 can be very slow
thank you thank you antastic 85 um how
many lines is Tiny gr now it should be
2,000 but it's probably a little bigger
it's bigger with all this crap it's
2349 um but a lot of this is just new
crap that's going to be removed
okay the 32s there are terrible let's
just leave that
32 oh thread group memory size exceeds
the maximum allowed thread group memory
size that's interesting
now yes of course compiler encountered
an internal
error
failed okay well the three isues don't
work most of them anyway
useless 4.2
TS uh yeah this is is got to be faster I
wonder what it's
using I wonder if there's
some Hardware
trick all right now subscribers question
time and then we're done so what did we
do today we implemented a metal back end
for tiny grat got it into master and
then showed that the metal back end was
slightly faster than the opencl back end
where we also got speed UPS by changing
things
to never mind we were just getting lucky
and it's not actually any faster but the
metal back end is actually legitimately
faster than the open seal back end uh
for reasons that nobody really
understands but we will understand when
we start decomposing fing these shaders
and that's probably where this is going
to have to
go probably what we have to do is we
have to fix up that GPU sniffer thing
and then decompile the uh metal
performance
Shader I assume it's compiled it's in we
can also try to look I've heard there in
llvm uh bite code if we want to look at
them and that's easy to decompile
so we can look at what the access
patterns are in LM bite code see if
there's any like inline assembly or
anything
um yeah we can see what their memory
access patterns look like that that's
probably the next step here the next
step is to look at the metal performance
Shader and say hey
uh what are you doing what make macaroni
and cheese and take a
nap why does it say no module Puda
because we're on a Mac so option TR is
not available no module named Puda uh if
you're on an Nvidia uh it's
available it's interesting to think
about how all these things run too so
they are like 32 wide simd
machines
um the lion Optimizer algorithm these is
this like an Adam replacement none of
them are ever
good are we getting more streams next
week I don't know bro ask my agent who
has my calendar you have an agent with a
I don't know if I feel like
it e
uh can't wait to test out metal you're
working on fixing examples emis Gan it's
taking 16 hours well did you try
Koop uh kop is pretty good uh kop should
make it a lot
faster
uh all right Ethan
1G I mean somebody can make a peeing
compilation video If it wasn't against
the rules cuz it's
copyrighted oh they always claim the the
new optimizers always claim they're
better I've noticed that the new
optimizers never claim they're worse
than Adam it's kind of
interesting
um yeah that that's a great Theory
except for the fact that when I actually
legit when I just go and run uh examples
gem it's extra
[Music]
gem it gives me more look at all those
Giga flops man I pay I pay $1,000 right
now actually if someone figures it out I
give a th
bucks if someone figures it out before I
do and submits a pull request to this
Branch without like doing anything
insane to get to get the full eight Tera
flops I'll give you a th000
bucks
um what's
cheating no what do you
mean like if you like write like hand
hacked garbage
then if you write hand hacked garbage if
you just just have like a metal kernel
that does it I'll give you a 100 bucks
uh no if you use half Precision you get
nothing
uh if yeah if you write it if you write
a metal just a metal kernel on its own
will give you 100 bucks if you integrate
it nicely into tiny grad and I guess a
th000 bucks is for the
Upstream it's 1,000 bucks is for the
Upstream 100 bucks is just for blah you
gave me a metal kernel and let's say 300
bucks for some uh some some some broken
uh pull request no and no don't submit
garbage
um none of that's legally binding by the
way but like if you actually manage to
figure it out I'll be like holy shit
nice job and I I'll give you somewhere
between hundred and $1,000 depending on
how tightly you integrated into tiny
grad um I did pay $50 I paid $50 I
PayPal someone 50 bucks for finding a
bug uh in my why my Max in my uh Max LV
wasn't wasn't uh good
enough um can you get tiny grad merch
we'll give we give free merch to
contributors if you cont tribute to Tiny
grad we'll like go back and we we'll
hook you guys up with some free merch uh
once the tiny Corps making money uh the
metal back end was written 20 minutes
well yeah right how long did it take
pytorch to write their metal back end
um 's pretty good like
that uh so but I don't think the metal
back end is going to be much faster than
the open seal back end I mean like maybe
slightly
the dotproduct of X and
Y determinant transpose
in the Metal Standard
Library wait a
second simy group
matrices
oh never mind I'll give okay all right I
I'll make the reward real I I will make
the the prize actually real it's
$100 if you manage to give me a metal
kernel that can achieve the full eight
Terra flops of Matt mall on my on my uh
2048x 2048 Matrix okay $100 for that and
actually I just told you how to do it
right there it's literally just
semigroup
multiply right yeah that's so easy now
now just literally write that 100
bucks no PayPal you or
something simd group look at this that's
what it's doing
it's probably dead simple with that
should we just write
it all right come on beat me to it beat
me to it 100
bucks uh all
right metal map Mall P let's go let's go
I'm going to just this is just going to
disappoint me I'm going to work hard on
this and I'm going to be disappointed I
can feel it already I can feel it
already I can feel it already boys I can
feel it already I'm just going to be
disappointed
uh we don't need e wait until completed
we have better ways of timing
shit uh let's call GPU
something start here we
go all right met M Mall let's
go simd group mat
Mall doesn't even use local or anything
for
it's not reversing I'm actually
legitimately coding metal Apple would be
proud of
[Music]
me wait uh
oh this doesn't work
oh elements per
row Matrix origin
who wants to make $100 I don't want to
do
this it might not even be
fast what if I do all this and it's not
fast
who wouldn't be using names for this
metal oh yo can we just read
it underscore underscore
dude they they they're just they're just
tensor cores
monolithic metal.
PCM what's a
PCM
cpch data
wow does someone want to make this work
so I don't have to here's an example of
how to use it
[Music]
good uh all right all right well let's
just start with
this I hate their names
[Music]
probably wrong did you test it in
benchmarking and shit you want your $100
you got to test it in Benchmark and shit
you can beat me right now and get $100
$1,000 I actually care about $100 I'll
give you
$100 um simd group
store all right let's just
set n equals 8
I don't even know what I do for the simy
group I don't know how this
works I store from all of them
uh okay b. copy in np. Randon let's say
NB equals NP random
Doon God I put this boiler plate so many
times
now who thinks it can multiply an 8 by8
Matrix Tuple cannnot be interpreted as
an integer
Rand and got an
unexpected uh you know what I just have
this written somewhere else don't I uh
it's
in search
can someone fix my copy in too you know
I should start giving you money because
then you'll be like I want money I'm not
giving you money for that you do have
the love of Open Source money is if you
solve very hard
problems um
AAC very very late but I found
this oh no this is the lib pie Metal
Bridge my
ass
um no match oh my God it's
C++ oh just backwards
that was easy CL buffer has no object on
by yet cuz it's 2
CPU love of Open Source you know
G all right simd group load simd group
load why do you think I do it you think
I'm getting paid Where's My Money the
tiny Corp loses money guys the tiny Corp
is the biggest money losing Enterprise
since FTX and
Toronto tiny Corp doesn't even get tiny
money I I would settle for tiny money we
don't get
shit
uh a.2 cpu. reshape n
byn uh comp equals NB * NC
and NP start all
close of course it doesn't
work hey at least it looks like a matrix
right that's pretty
good
uh wait multiply accumulate
did I not do that did I just do
that it's not that
either Smurfy thank you for gifting
Subs uh
I don't understand is this a matrix
multiply or is this
a uh okay let's set it to some matrices
I can understand
let try np.
I okay well it added
them that's not multiply or accumulate
did I just put in the things wrong
T
course all right we need a s0 group
zero we zero it
out uh yeah yeah the problem is it's
somehow storing something in there uh
and it should be
zero pleas metal syy group Matrix
how do I zero it out oh make filled simd
group Matrix oh that's
useful is this in the docks okay it's in
the docs hang
on create a diagonal matrix with the
given
value make filled simd group
Matrix oh do I not have to do
four oh 8 by 8 is just a suggestion
does that
work of course
not expected
expression how do we do
that I maybe it's
this work work work work
work okay that
worked
cool uh now let's see if that's actually
multiplying or that's
uh Matrix
multiplying those two are not the
same you'll notice that the nump one is
significantly smaller than this one
which me think it might be major
multiplying oh sweet they're
equal np. assert all all close what is
that CT all
close mp.
testing and a
comp that's fire bro all
right never at the top it just feels
so
uh this one we have
to multip
mly
by9 wait that's pathetic amount of Giga
flops oh it's just cuz flops that's
fine flops is tiny that's actually how
many gig flops we're getting okay so
enjoy your 13 Giga
flops
um
okay now to just
like scale it up
I don't want thread position in Grid I
want the other
one
uh thread position and thread group no
no I don't want any of
this there's another one that like works
better
is there another one of
these it's called like thread group
position in
Grid thread group position in Grid
there we
go hold up if I don't want to accumulate
that's a good question the answer is
you're forgetting about
later later you're going to want to
accumulate uh but right now you
don't okay so we're going to have to go
down like that uh
who knows how to write a matrix
multiplication I
[Music]
don't if I write this and it's not fast
it looks fast right doesn't that
function look fast it's got two
underscores in front of it it looks fast
guys it looks fast and don't you think
Apple would use this like you know
that's what Apple uses
imag ration
yeah
H okay so every Matrix is just Chomp
Chomp Chom Chom Chom Chom Chom Chomp
Chomp all right
okay
oh okay
um all right syy group
[Music]
load C
group
Matrix
const thread group t
what
undefined if Undeclared
identifier looks a little better all
right
now this one just need the same
thing all right cool see the ones
they're
aligned this better be fast this better
be
fast uh okay Matrix origin and
okay we have uh let's
say
uh x equal g.x
something like
that we'll fix it uh okay and then this
one we have u 2 Matrix origin okay U
long
to X comma
K you
want to pause
y comma K and actually these are both
wrong we have to multiply this by
eight uh
let's
go can I print
F might just
work did not just
work okay straight up zeros
uh there's definitely the right number
being
launched those two are being stored just
not that
one
uh no this should betimes
8 no that's not even
right that really
right
okay all
16s let's try it with the
eyes that works see if I'm multiply an
arbitrary Matrix
no no of course it doesn't
work uh did I mix these up sometime I
mix these
up
wrong uh do I need to escape that stuff
maybe I don't know I don't care I don't
need to print up we're just going to
randomly try things until it works uh I
think that's that actually
now all of them don't
match do all of them not match now all
them don't match there either okay never
mind multiply by
I that
works this one work
H
weird I multiply things by I it works
this must mean I'm iterating over the
things wrong must be those zeros
um let me think about it for a minute
be K * 8 no I'm plus equals
in8 uh uh okay let's
try it's interesting
that that
works just give this one try
I don't think it's that but it might
be
interesting wait no no it's just more
wrong wait though okay most of them
match not out of the match
if I do that 128 of the
match just try every combination there's
not that
many God
wrong you hit a buzzer every time I do
it wrong okay like it like almost
Works does it not work with I now it
would help me if it didn't work with I
but it did work with that
no it does work with I it's too hard to
mess up
I it's annoying that I can't see
uh how do I make these ins
great
I'm just
kidding that right
as okay
great now we see
now uh put the
cool that still
work
great okay stupid but we just had to
flip
it uh
this make it multiply real
float all right moment of truth let's
make the Matrix big
no no no let's let's let's ramp it up
slowly all right we're getting one gig
of flop let's try
32 see still the right
answer come on give me flops give me
flops give me
flops a the answer is wrong and
B it's slow as fuck
how is the answer right for 32 but then
wrong for big
numbers oh no it's actually right never
mind the answer is right it's just
slow
I I did all that work and it's just slow
you have to set the ATL High cuz like
Matrix are like big and
shit all right put in lots of hard work
and we get 1.3
slow as Cindy
garbage but let's let's before we before
we insult it too
much let's see if there's a way to make
it faster or maybe this is just what
Apple maybe this is the appropriate
speed Apple thinks you should have
or maybe this just faster algorithms if
you don't
uh M3
M3 yeah they want to sell me an
M3
H to be fair this is not like a cash
aware thing at all
in Google I see 10 Tera
flops Apple can probably sell me a
subscription to go
I work so hard on that
for
think I need to block otherwise I thrash
the
cash I don't think it's that
it might be right this one
slow okay should we work a a little on
figuring out why that didn't
work doesn't that work
oh
no okay
am I doing this because of there's never
a because of
1.7 pathetic Tera flops you know what
I'm
proposing a CH what's quad group
functions
okay what if I just comment that out do
that it's fast because the loads don't
actually do anything
anymore um
that gets me seven
terrible seven G
flops the only thing I'm wondering is
like
if there's like a way to make like a 4x4
grid of
these and then do the
loads that's fast
if we don't do any loads
all right
guys we're
done we're
done there should I'm proposing they add
a note to the
uh I'm proposing they add a note to the
simd things and be like you will waste
an hour implementing anything using
these things because they are slow as
balls uh my hand coded kernel is uh over
twice as fast and it's still not as fast
as the secret Apple kernel which I don't
know how it
works
um
yeah no the $100 is still on the table
if someone can figure out the trick to
uh to make this to make this go at8 Tera
flops I'll give you $100 should we up it
I mean if it was just that easy like if
someone gave me this it wouldn't have
been worth $100 but
like I can has two questions to Apple's
team
500 if someone mentions fucking strin
you know what you know what you know
what if you do it with strin I'll give
you
$500
oh well we run a nice metal Library
we're doing a really nice metal
Library how was a pretty good use of
today see like imagine just I want you
to imagine we were sitting there and we
didn't even have a metal library and we
were seeing the simd group things and we
were like oh this has to be what makes
it
fast until we actually try to use it and
it's pathetic and
slow
uh I
I turn on subscribers so we don't have
to hear the stupid conversation about
whether the unibomber could code he's
still alive right write him a letter ask
him you get you get two questions to the
uni bomber with your prescription with
your subscription to the freedom
club uh no he probably doesn't tell you
questions either and I don't blame him
um I mean yeah I'm memory bound but
like it's really easy to saturate all
the the the uh stuff if you don't use
the memory it's really easy to saturate
all the my micro Benchmark does a fine
job saturating everything in open oh if
it doesn't use
memory I'm just I'm just I'm just sad
I'm just I just wish we got to eight
Tara flops and then like I could end the
stream in peace but instead we wrote
Cindy groups and they get 1.7 tar flops
let this be a lesson to everybody who's
like I'm GNA use Cindy groups don't
they're really slow right and the truth
is that lesson applies to nobody um no
no no no I have verified the eight the
Eight Is Real uh we're just going to
have to figure out what konel it's
launching yeah I wanted to see eight
Tera flops
too
um I don't trust any of this
optimization garbage like ass soon as I
saw that it had C++ templates we should
have said no
I started calling that underlying metal
thing so I was like okay maybe it's not
terrible and there's just a little bit
of C++ on top of
it you think you can get Jam at8 tariff
lops if you block right all right let's
see you do it $100 the tiny C doesn't
have any money I'm sorry about the ,000
we don't have $1,000 but if someone gets
eight Tara flops I'll give you 100 bucks
before I
do um and I will PayPal to you or venmo
it to you or send you ethereum or
whatever you'd like all right cool uh
thank you for for watching today's
stream I appreciate having you here uh
we are going look look the thing about
me is is like nothing every day it gets
a little faster and a little bit better
right and one of these days one of these
days if you want an autograph you
definitely can't solve this problem
because only an idiot would want an
autograph over
$100 um so yeah that's the truth uh
some days I wake up and I'm going to do
something and then I ask myself would an
idiot do that and if the answer is yes I
don't do that
thing
um no ra today I'm just I'm just today's
a today do do we want a dejected
audience who can't get eight Tera flops
in their Matrix multiply uh no they
don't so bye everybody goodbye I'm
going all right
uh hang on let me just pop the chat out
we got it we got it we got the flops
boys we got the
flops
ah you
know stuff's addictive
man all right um we wait for some people
to show up in the chat uh yeah but you
can see we're getting
8.08 uh Tera
flops and there might even be no reason
it stops there so yo yo okay okay I mean
we got the flops hang on let me turn a
light on we got the flops we got a thae
iced tea we we ordered food again oh
everything just happened everything
happened I would have streamed it all
but I can't listen to my hyper poop
music when you know I have hyper pop bro
uh so yeah I can't listen to music while
I'm streaming so no that's just why we
didn't stream all day I think that's why
I used to stream like 13 hours it's not
that I don't work 13 hours I promise you
I do I haven't done anything like it's
not like I stopped working on this you
think you think I would have I would
have let it rest you think I would have
stopped until I got that fucking eight
boys
um you think I would have stopped until
I got that eight no we got that eight
okay so this is the solution uh first
off I'm claiming my own $100 prize uh
I'm claiming my own $100 prize
um so it is using the simd
groups uh there's a few very interesting
things about this solution first off I
put this random thread group barrier in
here just like for the LOLs and the
random thread group barrier gets that's
it from
6.6 up to the full eight so you know
there's
that uh
yeah why did that one only get me 7.5
we're back at a few right
um I wrote a
oh oh I did so much I did so much I had
so many emotional ups and so many
emotional Downs uh in getting this
kernel so I found Apple's kernel I'll
show you Apple's
kernel uh no it's not Apple's kernel
it's this I this is Apple's kernel and
so turns out first off they're using
simy
group uh so good to know Apple uses
Cindy group this is so okay the way that
I found
it
was
in oh also I probably didn't have to he
AI thank you for gifting
Subs um I probably didn't have to
uh didn't have to I forgot what I was
going to
say a lot of things I did today I didn't
have to do oh I probably didn't have to
hack on the GPU thing there actually is
a new WP in the Mesa tree so I should
have looked in the Mesa tree uh that
would have been nice so I found this
thing called metal Library archive we'll
give a shout out to
ow uh and then I got Swift to build it
so you can type like Swift run and it
has a gooey uh it has a gooey for no
reason I understand you can go in here
and you can open the metal Libs I don't
know why it has this gooey but it also
has this button and you can unpack them
so I just unpacked the thing and it's in
this thing called NPS ND array oh you
guys missed llvm oh I used lvm to find
out which things it was actually loading
so these are all the kernels inside of
the pimp master shaft thank you for
gifting Subs I just I just this stream
I'm only going to be on here for another
20 minutes then Alex is going to come
home we're going to watch some more
Clarkson's
Farm
um but I just did want to tell you guys
that we did finally get there and it was
simd group Matrix so you know all the
hate on simy group Matrix but so okay I
was reading this code and you notice a
few interesting things first off this
little fucking cheaters simd group async
copy
2D
um
so yeah simy
group uh async copy to oh and I had a
whole thing where I updated brew and it
broke my computer oh you all missed so
much wow you missed so much wow you know
you go away for a few hours and you just
you just miss everything but um you know
I've been sitting right here uh so this
is lvm IR I use llvm disc uh to get this
and you see that there's this thing
called async copy 2D now of course this
is a secret um this is a secret API so
you don't get to use ASN copy 2D so I'm
like fuck we're never going to be able
to get it as fast as Apple because we
don't have async copy
2D I should have killed it I shouldn't
have let it update I let it update my
t-o is broke it was it was bad but um I
just needed to kill all t- and that
fixed that and then I needed to manually
Sim link python now I have python in my
path and I also have a newer python but
um okay that's not the point uh the
point is asent copy 2D so I saw ASN copy
2D and I was devastated but then I saw
this line and I'm like wait what is
this why is the why are the things
4X
um and then I looked at it a bit
more and I saw all the 4
X's so
yeah uh yeah Alec 4X 4X metal syy group
Matrix so I realized what it was doing
was load in multiple simd group matri
matrices and I don't know why I didn't
think of this before um so I needed to
make a grid of 4x4 of the 8 by eights
and then you just load this one and you
load this one and then you go like right
you know what I mean uh so that's doing
the
uh yeah so then I just slowly crept up
if you're in the tiny gr Discord you
watched me uh you watched me do it
um so I got 4.3 I beat it a tiny bit
then I got
6.5 then it turns out if I increase the
local work group size I can get it up to
6.7 and I thought that's where it was
going to
stop without having copy acing but then
I stuck This Thread group barrier in
there just random chance and I got my 8
Tera
flops um so yeah I mean I don't really
know what lessons there are to take away
from
this uh we can
try you want to try like just manually
unrolling some things and seeing if we
get any uh so
like should probably do some like python
templates here
but like kind of what can happen is
these things don't have to
finish before I
uh get those eyes
I don't know how much CPU is already
doing this it might just be already
doing
it um that gives me the
same but uh you think I want to jop an
Apple I didn't turn it wait wait why I I
just managed to tie their performance oh
wow 8.1 that's the fastest I've seen
it okay cool manually unrolling the loop
made it
faster okay that's
great um now I don't know if like
reordering these things is going to make
it
faster sometime we get the fast one and
sometime we get the slow
one real brain Spike well you're the
reason we're going to subscriber only
chat
um
yeah who knows why sticking the thread
group barrier there does
anything by the way this is the llvm
code that's being
generated uh by this
wait how's that
the is it rolling it back into a loop
where's
my there's only four calls
there it's somehow putting it like back
into a loop or something I don't even
know this should jump the shark man
unless that's
failing oh it's
failing use of Undeclared identifier mem
Flags okay we should fix that because
that's probably been in there a while
failing uh I wrote a little thing to
dump
the
uh M
Flags I think have to like include metal
we should also just fix the
runtime someone wants to make that code
good I'd merge it okay there's nothing
called
metal um what's it
called it's like Metal Standard lib or
something glude Metal Standard live yeah
that that going to
work
okay there we go look at those beautiful
multiply
accumulates uh
a little
faster uh but yeah know you I mean you
guys missed you guys really missed the
stream today because I didn't stream it
uh but we read this we dumped the Apple
thing we vaguely used it for inspiration
even though they have a secret async
library that we can't
use uh and then we made
fast there's ways to like inner leave
here I still can't get over that thread
group barrier and how it made it
faster how did I just get lucky and
stick that in there and get my eight
in reality it's probably doing the same
thing as ASN
copy uh there's a chance it's even
inserting async copies
I mean that's the same eight right like
I actually I don't know why I really
expect to be able to beat it uh where's
M1 Max
benchmarks see what happens if I make
the Matrix
tinier wow it gets way
slower make the Matrix bigger it's
probably also going to get slower
yep way
slower only Matrix it works for that
one uh but that's fine once you get one
it's easy to get the rest
yeah ritual is so good
right yeah man how does say or say dream
not have more
uh more
followers um
here Max T flops
get about seems we can get about eight
tar flops pretty easily and that's what
I'm getting so I don't know I don't
actually I don't see a reason why it
could be faster maybe it can't be
um see that makes it slower you have to
hit exactly this
number which I mean it is doing the
matrix multiplication in a different
way yeah because it's worse if anything
other than four there is
worse I think it actually is somehow
like batching these simy loads or
something
uh let me think of what's Happening Here
yeah I don't
know all I know is we did it it's
fast
uh and I don't actually I can't actually
think of a way to a reason it would ever
it would be
faster I mean I guess we can just try
let's just try this
there some chance it's a little
faster far
ever slow slightly slower um okay but
now we can try the other optimizations I
wanted to try like that can go there
does that
matter worse
uh that can go there I think the GP is
probably smart enough to do this kind of
stuff automatically
and like we can unroll more with that
same
pattern let's just try two more
I don't think it's going to
matter but I'm just like showing you
like what's
possible uh oops
these have to be
16 but yeah this is a representative
sample of
what yeah right no that song's
unbelievable it's it's like it just it
just reminds me of you know being 19 and
hacking
okay nine gig flops but the wrong
answer good deal or bad
deal I do not know
not that good of a deal yeah it's a good
point H this
wrong those are plus zero those are Plus
8 those are +
16 those are plus 24
oh and then I still have to do one more
round of
okay I don't get out of doing the
multiplies
no way
worse yeah I mean I'm just saying like
that's theoretically what the GPU can do
it's probably smart enough to do
that like it won't actually um the load
won't actually
block until uh something tries to access
it let's just stick this one up here
it's probably
stupid
slower way
slower how insane is it that that
matters
8.1 Tera
flops can we all just take a moment to
appreciate how large a teraflop is and
then I think that's going to be my
stream okay so did it do this
many uh operations no did it do this
many operations no did it do this many
operations
no did it do this many operations
no it did this many
operations
okay if each operation was a
dollar we could pay off the national
debt in four
seconds if each operation were a per
each person could have a thousand
operations each each person could have a
thousand of my GPU operations every
second meaning my one GPU could give
everybody more compute than like anybody
had uh 50 years ago we got to go back a
little more than 50 years can go back a
little more than 50 years like well I
mean what were you really doing floats
on and by the way these are float 32
operations on a relatively we don't want
to get into how many flops the brain has
it's very disappointing it's something
like
this yeah brain is about that many flops
so that's the brain and that's whoops
don't include Metal Standard
web and that is the
uh so let's see we have
uh what's 20,000 / 8 it's 10,000 divided
4 so if we have 2500
m1s wow that's a lot of Tera flops okay
I mean there's probably no way to get it
to go faster just kind of like by
structure of the
GPU uh that would be my guess I mean
Matt mall is usually something that they
really optimize the shit out of um so
now now this is like the kind of thing
that we
can uh put into
uh we can put this into tiny gr if we
want 8192 should be the limit why do you
think
that why what makes you think that
bro oh man if you're allowed to have a
slightly wrong
answer oh it gets very fast No actually
that's not even faster but I actually
think that probably the best way to then
improve this is to it's interesting that
just sticking a random thread group
barrier in there makes it faster and if
you remove this it really is a lot
slower
uh I think there's also something called
simd group barrier
not
fast it has to be a thread group
barrier no I promise you that's
not can I do me Cindy group
whoa M
device no you have to put exactly thread
group here
and that gets you the
eight probably has to do with some kind
of coalescing thing
yeah all right guys you know I I don't
like to end my streams as failures so it
just took a bit but now the stream is Su
a success and we got our eight uh Tera
flops uh thank you to everyone who
watched
today now we have a happy ending uh and
I I can't can't play you a lavine's
copyrighted song Happy Ending cuz it's
copyrighted uh yo you know how there's
all those jokes about never mind never
mind you know what we got the W today we
don't need to rip on a
LaVine um or talk about we could always
talk about beautiful Haley Williams
is
uh should have set the GPU to gaming
mode yeah so I think
I don't know tomorrow I'm probably going
to like look
into
why I bet there's like a what these
things are actually doing kind of
thing how different is this
from what I was doing
2 * 4 is
256 so each of those is only
256 the accumulator is
massive but shared across the
uh like it's interesting to think about
about what this function is doing and
whether we can write it without using
simd group
Primitives I'm not sure the simd group
Primitives well no they definitely do
things because I mean this is just
calling into
this this is like
a like a
library I'd be very curious to
disassemble the
Shader should we try to disassemble the
Shader get the Mesa thing building we
kind of want to get this
building
uh
Mesa yeah see look they have this thing
for example to tr an app this library is
only Built if D tools a sah is
past how do I
build um
Mason
build
Mesa building with Mason the general
approach is Mesa build the
are problem
encountered I need the moo
module install
Mao
great uh how similar everyone apparently
copied Cuda uh dependency X fix is not
found
what's X
fixes oh let's also pass in D
tools pass that into
Mason Brew install X
fixes lib X fixes let's try
that how many T flops does it take well
so T flops you can ask more accurately
how many T flop does it take uh and
that's a number you can figure out have
you heard the unit pay to flop days what
a funny unit kilowatt hours Pay tolop
Days
uh
okay let's try
ninja oh look how fast ninja is that's
so fast I don't know what it's doing but
it's so fast I love my M1 by the
way uh I have zero interest in Gray
scholar T torrent like ship your shit
and or nobody cares right like if you're
not going to ship it if you want to like
here's the thing once you ship it
everyone can see how good or bad it is
and you know whenever a sales department
has contact us pricing it's not like
it's not a good good deal why did this
fail what is
this
lib isn't going to
work it's not going to fix
that I can tell
already but maybe it already built I
only need rap.
dib yes Li rap. dib
fire that's a dib all right cool it's
all I
needed um diid insert
libraries Li grab. dialog
a port trap
six I hate abort trap
six my least favorite abort trap
um probably no one updated it for Mac OS
response probably fails here
maybe one of these asserts is failing I
don't know what a boort trap 6
is board trap
sex uh how do I only build one target
for Ninja
okay hang on
Target to
query unknown Target
rap all right
um mason.
build liasi
rap unknown Target liasi
rap oh it's just called
rap why is that un On Target
[Music]
that bio kit Mason
build did you know we were going to have
to figure out how ninja works
tonight um or we figure out where X
utilus
even
worse we have it it's
just op home brew
[Music]
include all right how do I add a home
brew
include um Mason add food fer
you're going to help me with this
extra
deps include directories
a different
problem I just want to build wrap why
can't I build wrap
the sa
wrap okay well it did eventually build
I'll point out that there was
another I had another uh version of that
file somewhere if it
mattered op X11
include so try that
oh notice how it automatically
reconfigured that was pretty
nice what now you're taking talking
about taking Xanax bro don't take
Xanax I don't know I'm not a doctor do
whatever your doctor said said don't
take Xanax
you know I leave you guys alone for one
minute and you're off talking about dumb
shit uh
okay GLX
commands what even is all
this I I've built parts of this
before to get a compiler for
uh for
no okay the abort trap must be somewhere
else lb can I dial it insert libraries
in
lb oh you know what let's also not try
debug equals 5
[Music]
um I know if I can dial it to
that see if we can debug this
no
uh ldb diid insert
libraries B with
payload okay it's like not passing
things through
correctly
oh so in other words this wrap is worse
than the other
wrap how complete is their shade or
decompiler
anyway am I just going to be
disappointed um okay I have an
idea this is the W that we were working
with this morning and this one doesn't
crash
all right there's my
Shader isn't it a beautiful
Shader this is what the Shader starts to
look like but um does this have a
disassembler
I I I dealt with exactly this before
like you're just you're just
frustrated
um just have a disassembler i because
there's there's like a half disassembler
in here except you can never get this
thing to build also for the uh the
Qualcomm
thing uh
does this have a Vertex
bin this doesn't even have a Vertex
bin B map Fields dump
[Music]
mappings command
stream where's my Shader decompiler
oh this doesn't even have
it yeah this is
removed this on the other hand has a
Shader decompiler so let's see if this
one has a lot more op codes in it what
what has to have a compiler does it
not
uh compiler
here agx op
[Music]
codes even better does it have a python
decompiler or that' just be
great oh no it uses this to it uses oh
this is what it needs MCO
for uh it use moo to get
this I see so all the op codes are
here are there more
wait this just python I can like import
this right encoding
32 self. description no that's not what
I
want I want a
decompiler
um yeah this is exactly we would Happ
with the Qualcomm
one uh let's see apple Shader no they
have to have
one
oo of course our boy dougle
Johnson oh this guy's the best
man oh this is this is also the guy who
did all the all the
um all the M1 all the uh
so I'm sure he has a decompiler
somewhere no this guy is such a boss I'm
pretty sure he also did the AMX stuff I
Fu that from corix but yeah he's emailed
me once uh man this is the real champion
of M1 performance here
what oh thanks GitHub github's
down they don't want us to
see disassembler of fire oh you got to
love this guy oh what a winner
5 not3
disassemble fun tiny grad vertex
dobin yo that's so
fire what a
boss um yeah
okay so like that's what it
does oh we have to figure out how to oh
that's so good we have to figure out how
to actually extract them from metal
shaders he probably has a way to do
it
um
emulator hardware test
wait so how does this
work how do it actually run
them dial insert libraries replacer
wow so there's my random thread group
barrier that I stuck in there
device loads I don't know why some of
them are signed and some of them are
unsigned did I mess
up is genuinely down I
know
wow wow I wish I found this this
morning okay either way it's doing this
simd probably has good documentations
for
this for each active
thread
result now I wonder how the apple one
looks different
simd Matrix fmad 32
ah man this guy's the king
yo metal archive extractor
[Music]
what's
Arc Objective C
Arc
[Music]
Shader library with data
here lib okay how does
he he gets the metal
function switches on the
type oh okay here we go MTL binary
archive oh this is great okay great okay
we don't need to use the wrapper anymore
we should just be able to let's just put
it in my metal implementation here okay
um
hacks to get
lvm put that under
six hacks to
disassemble
Shader all right uh
device new binary archive with
descriptor
um MTL binary archive descriptor
so we're just going to do this and then
we'll have a dump shaders and then we
can like look at we'll look at we'll
look at this Shader and we'll look at
the Shader from this morning that was
getting me a pathetic speed and now we
have the new Shader which gets a good
speed and we can look at the difference
um in the
uh wow how did I miss how did I miss
dougle
J what what a this guy's the
best what what does he do
yeah this Rosetta 2 thing was great
Objective C is the most fucked up
language
ever uh all right what's a
descriptor MTL binary archive descriptor
okay well my device doesn't have
that new binary archive with
descriptor supports binary
archives oh new binary archive with
descriptor
error how's that different from that one
uh use class methods oh I've gotten this
before okay we got to use.it
okay that's
good now we have a binary archive with
descriptor where were we stealing that
from uh
here okay um we have to
do arc. add
compute with descriptor uncore error
underscore
Alec desk desk. set compute function
what is
CS CS is FN and FN is Del new function
with name
okay work
uh did I mean set compute function in
fact I
did uh okay add compute pipeline
functions with
[Music]
descriptor desk
none
work works
now we need arc
dot let's just print di
Arc George you should do this faster
than I python thingy yeah probably okay
um URL are they
kidding serialize to
URL oh just create a convenient n
URL temp Shader bin is that a good
URL probably be checking all those
things for
errors okay uh
well need an NS
URL now this is a joke how do I make an
NS
URL oh we need
Coca can I just import Coco good we got
Coco uh NS url url with
strength good thing we had
Coco xxd temp.
B H
no it's not that
easy uh this probably has an
error error domain MTL binary archive
invalid URL uh NS URL file
URL objects are the preferred way to
deal with files oh we just need file
call SL that's that's not
surprising can we just type in a real
URL and it'll upload it to the
web xxd temp sh. B wow wait now Python 3
disassemble temp Shader up
B no
okay because this is not just a Shader
this is some file
format uh it's a metal lib
executable so we have to extract
it how do we do that
oh metal compute oh that was so long
ago this
one okay metal compile
tool compiler
Explorer read Shader
archive
extractor oh this is the metal archive
extractor I
see there we
go
okay now let's just throw an os.
system oh that's terrible George oh you
should do that oh yeah I
know George but other people have other
computers they don't just they don't
just uh you know they don't just have
your setup why why would you why would
you do that well I left them a comment
and they can figure it out you left you
a comment so you remember how to clone
it later yes you're exactly right
boom We dumped the Shader
boys okay
oh yeah remember when we were happy with
getting
4.2 Tera flops well let's see aha okay
so that's this
one this one does device this just does
device loads
and then simd Matrix
fmats this one does device loads thread
group stores thread group
barriers thread group
loads a shit ton of FM
ads few more thread group
loads and then way more FM ads
so this one gets you that and this one
gets you
that why is some of them signed it's
just worrying who signed
anything that's not signed that's not
signed that's not
signed whatever
interesting so that's a single
load my pie pass
right um but how cool is that that we
can just dump the shaders right here oh
that's so nice wait dogle J is is the
the the king
um all right is there any way we're
going to be able to look
at Apple Shader we could probably load
it and compile
it if we wanted to but I have an idea
it's very
complicated and
actually when I tried to get it with the
wrapper before it didn't dump
it uh for some some reason I don't
really
understand maybe because it's getting
thrown off with
this we'll give this one
try you know when I say we'll give it
one try you know I end up just keep
trying uh it's not actually that many
Giga flops don't get too excited
you see it's ly
there this is
that Al this writing to vertex beenin
multiple times but I have an idea it's
not because this is the same Shader that
here so is doing something sneaky with
the
shaders whatever do we really
care I mean yes we care because there's
probably some secret load that it
manages to do
oh I know it's doing a secret load I
know it's doing a secret async
load um let's read the docs and see if
there's anything in there about secret
async
loads can't believe more people why is
GitHub
down can't believe more people watch
this this morning and watched it now
when we actually made
progress uh
device load initiates a load from device
memory the result of which may be used
after a
weight oh look at
this you see this this is a
weight and then this is another weight
but that's that one and that's that wow
that's pretty
good um so I think we're actually really
getting all the benefits of uh
yeah we're getting all the benefits of
uh async I
think and then that many of
those okay we may be able to get it to
go faster but we're not going to do it
by hand it's possible we can make it go
faster uh
Sindy oh this guy even writes nice
python code
[Music]
debug the sign Miss no that's not a real
problem I mean you can look at
my I I don't know why it say signed and
on sign but I don't really have control
over that
oh I see what it's doing so those two
are actually
there it does a
wait jumps back
[Music]
here does a bunch of ads cash discard
blah blah
blah
um I mean it does know I can pre-compute
all those
right why does it compute them every
time why are these
ins who let these be
ins always use you
in it's still
signed I can't believe those were
ins wait I'm not getting duped into the
Shader twice
right
um just make sure I don't make the same
mistake I made before
I don't like when it says numbers under
eight
okay so I can do something like pause X8
pause X+ 8 right does this actually
change anything
think that made it
fast let
do looks like the exact same code
fact it's so much the same code I wonder
if it's even doing
anything yeah because I got rid of thir
group barrier
all right what is all this
stuff must be doing that all
beforehand
um Cindy Matrix fmad 32 okay it clearly
is unrolling that
Loop uh I don't know why some of them
are do cach and some of them are do
discard I guess if it's going to use the
register again it's not
cash um and if it's not to use the
register again it's not
discard uh I don't understand why
there's so much up
there the loop should be tighter
what is this what is this is it doing
this
or oh I guess that's Computing the
uh I guess that's Computing the
K uses that one a
lot see what the argument to device load
is okay
wow it's a lot of
stuff that's to do a lot of math every
time I just don't like
it look at all those
instructions imagine it didn't have to
do
them uh I don't think God Bolt's going
to work
yeah so that's great but this is arm
code this is Apple Shader instructions
[Music]
like you think that's a base thing oh it
must be loading into
that that's the address and these are
the offsets
do that make
sense
um I should also be able to hang on
where's that metal example I should be
able to mark these as
const not sure it's going to
matter no same
Shad what does that sign and unsign mean
I guess okay you want me to debug that I
I heard someone wanted me to deun
that
uh when unsigned or signed 32bit
register um okay well interesting thing
to note is probably what this stuff is
doing is it's doing the
math which I don't really have to do
because this is the same math every
time
um yeah I could just track that in
registers and add
them which might make it
faster uh uh like what is this
crap oh
that's okay that's k
all that math could be
removed if we were smart about
it uh and we'd be left just with the
simd Matrix and the device
loads and that's like an absolute
minimum because each one of those I
think is an fmad 32 across the simd
Matrix
well yeah okay so this is loading two
registers okay so that makes sense and
the simd is 32 y so each one's loading
two
yeah then each one's storing
two uh is there another way to express
this I mean I should just be able
to no I can't just move the
pointer zero is all the accumul
ERS how nice is this this actually only
Zer two local
ones uh must be faster to load
that we're
getting thread position in
Grid thread position in Cindy group
well this was stupid
um it's honestly unclear if it would go
faster if I if I don't use them it
optimizes it to nothing doesn't keep the
device loads does it no it doesn't
I don't think there isn't
async the the async thing might just be
totally
fake see if there's any mention here of
async just shouldn't replace
her for
yeah so if we go lower than the simy
group somehow and we figure out like
what it's doing
there's probably there's probably no
other way to access that
function like look at this look at this
terribleness oh so many fmad
32s which makes me think that we could
probably even get away with
more like that
uh 4x4 is not is not the max
but we will know
that could probably do a little bit
better too if we like divide it up
because like you'll see like it doesn't
really need this
one this is not that smart
right we could
probably divide it
up can't believe github's still down
it's Microsoft what are you guys doing
it's so nice too that these are the real
Shader instructions because on uh Nvidia
you get PTX and PTX are not the like
real Shader instructions the rest
instructions is something called SAS
mean I can pretty fair I can get the SAS
on in video
too but um how cool
I don't
know oh I should add that back that was
bad to remove
must been using my GPU for something
great yeah this probably ways also to uh
do this in a more cash aware
way uh I didn't care at all about
cashes and yeah
7s
guys I promised you at Tara flops I
delivered eight Tara flops don't ever
forget that when I say I'm going do
something I do it good night
happy weekend enjoy Clarkson's
Farm uh let's see wait wait all you want
you want you want you want rap
uh
uh 33 it's my Jesus here you can hear it
here peel the orange connect the dots
you feel the age constrict your thoughts
whoo you think there's a difference
between feeling the feelings and asking
the machine to feel for you are draw for
you say uno and draw for now it's s deay
when you cry for nothing and know you
can't fight the decline you can't stop
and scamming and lying and no sick of
dam it I'm trying God I'm so over
this place I'm back in my home in my
place in its civilization with spite
from a failed state in a dark place in a
dark world this year I just want to fuck
famous girls you'll hit me up if you
famous girl we'll go to LA with his
famous girls get validation from famous
girls
good morning everybody
i want to lead off with a quote from
a great man of the novice prince
he divides the world
everything is about power everything has
to have a side everyone knows what side
they should pick
pick it and you're a collaborator
rejected a dissident
are you not are you or are you not on
the side of power
if your actions were completely selfish
if you were an utterly egocentric
sociopath
if your only goal was to get ahead and
make a good impression
what would you pretend to believe what
words
what ideas would drip from your mouth
and to whose newsletter would you
subscribe
this side is the side of power
to take power aside is to collaborate
stand against it
is to descend and this doesn't tell us
who's right or wrong
real life is not a movie if there was
some cheap and accurate formula for
right and wrong
how would any wrong remain
this document goes on to propose a third
option
not collaborating with power but not
dissenting against power
because what both of those sides are
doing
is acknowledging power
acknowledging power right but the power
only has power because we all
acknowledge it
if we stopped it would go away
um i had a conversation last night with
a with a homeless woman
and about 10 minutes into the
conversation i realized that this is one
of the only
people i've spoken to in a long time who
isn't lying to me
she has nothing to gain
she was just talking about how she felt
honestly
i think one of the scariest things that
we're going to have to come to grip with
grips with in the next 20 years
is that you are an algorithm
it doesn't make it okay for others
to treat you like that though
i don't have a universal solution
the only thing i know for now is
don't be a dissident don't be a
collaborator
detach
so who did their homework
who read the paper
so
i didn't read all of it um but i read
enough to i think
begin uh tackling the problem
so if you recall from yesterday's stream
the problem that we're trying to
solve is busy people five
um busy beaver five is saying
uh what is the longest
running or most one's printing
a five-state two-value turing machine
naively there's 63 trillion of these
machines
what we're first focusing on is reducing
the total number of machines
down to something much more approachable
by using the fact
that a lot of machines are um
so there's a few ways there's a few
classes that we can remove so we can put
machines in equivalence classes
uh saying that this machine is
equivalent to these other hundred and
therefore we only need to check one of
them
if you want to check one of the other 99
just refer to this one it's guaranteed
to have the same outcome
we can also potentially remove machines
that cannot possibly be the winner
for busy beaver i think maybe the way to
think about this
is uh domination so what they talk about
in the paper is this idea of one halting
so one halting is a machine that well
they define k halting to be how many
halting states a machine has
so if we look
go at to
it's not on this page
this is the just the busy beaver
programming in general see non-regular
page yeah so these are these are turing
machines
and if you'll notice they all have one
halting state
in fact this is kind of cute they've
even defined the uh the halting state to
always be b0
uh so the only there are two states that
are special
and that's discussed in this paper the
two special states are the halting state
and state a and state a is special
because the machine begins execution
state
a uh machine states are labeled a b c
d e where a is the initial state of the
machine the halting state is labeled z
here they use h
so you'll notice that uh
yeah when searching for busy beaver
machines it seems natural to focus on
machines which are one halting
exhaustive and maximizing
um so
the maximizing machine seems to just
mean that the last step
the the step to halt it always writes a
one
if you're trying to maximize the number
of ones uh it makes sense to make it one
if you're trying to maximize the runtime
it doesn't matter at all
so we can only focus on the maximizing
machines and say that this number has to
be one
the paper makes a note that uh
k halting machines where k is greater
than one
because we're only focused on one
execution
of the tiring machine we're only focused
on the execution of that turing machine
on a blank tape
only one halting transition can be used
so whichever halting transition is used
the unused one can be replaced with
anything and it will clearly never get
executed
so then they go on to define activity
and productivity
so activity is the number of steps the
machine runs
productivity is the number of ones that
it writes to the tape
now they talk about how yeah if the
activity of m
is infinity meaning the machine does not
halt then the productivity of amazon
defined
i thought about that for a little bit
and at first i thought okay well you
know it probably writes an infinite
number of ones to the tape but this
obviously isn't true you could imagine a
turing machine that
marches a one onward to infinity
and this machine is actually defined to
have a productivity of one oh well
sure enough i mean it depends yeah how
do you define the productivity for an
infinite machine
i guess it actually cannot have a state
where the one moves because there's no
way to do an atomic swap
you can do an average of one
um but i think yeah i think you could
talk about limits of machines but
not really relevant to what we are
discussing here so they define a class
of things that can make it irrelevant to
the visibility problem
um if the machine does not halt
if the machine is actually has less
activity than the total number of states
uh if the productivity is zero meaning
one way to know that the productivity is
going to be zero in fact even for an
infinite
even for a non-halting turing machine i
guess you can still say the productivity
is zero
if all if it can't write ones to the
tape imagine all of those numbers are
zero
um now figuring out whether activity is
finite is of course the halting problem
so we're not going to have a decision
procedure for that
but the halting problem it's frequently
misunderstood to be
to say that you can never know whether a
program halts or not
and this is obviously ludicrous um
there's many programs that
you can show they halt just by running
them and then oh it halts
there's also many programs that you can
write trivially small proofs
um that they do halt now
what i was thinking about and this this
starts to approach the limits of my
mathematical knowledge is
how do you show that a machine doesn't
halt
so there's one way to show it which is
to have it repeat a state
if you can show it to repeat the state
it doesn't halt otherwise
is it always some form of induction
right you could imagine
that the marching one turing machine
using induction to show that it doesn't
halt
and this is about where i got to in the
paper so we're going to read
uh the rest together
sorry i did what i what i spent time on
last night
instead of reading the paper and that
i'm very sorry people i made hammer
uh
hammer like backspace is another one of
these maybe companies
our mission is to organize the world's
information and make it accessible to
anyone who pays hammer
thirty dollars a month our motto is and
this is all in quotes don't be evil and
if we ever remove this motto it's
because we are evil now
and our slogan is better searched better
results
hammer you can check it out at hammer
dot
law uh and i think one
i'm thinking about that
i have a theory that companies that have
law domains
are less likely to become evil
you find not all self-serious people are
evil but i think
are all evil people self serious
i think they might be yes papa john's
right
don't sue me bro don't sue me don't
shoot me as
parody man it's parody yo
uh yeah a hammer it's a hammer just
gonna smash
google
yeah but
nothing can compute busy b for numbers
uh busy beaver numbers
are uncomputable
at least all of them
um so this is a template for many
machines as the machine will only be
executed on blank inputs
all transitions
gutless go on
i still don't totally understand their
definition like why are there
two
oh i guess so this is in state one
if there's a zero present we write a one
and we move to the right in state two
right
so that will just march like that and
then
i don't think it matters what you fill
in there
um
yeah okay so i think we can say for each
one of these
graphs we would expect an exiting node
with both a z or for each one of these
uh graph uh vertices we would expect an
edge with a zero and a one
so i think that is true
input output direction new state
so this is the the quintuple
form of the turing machine
the most important consequence of
requiring the blank tape condition
is that it will reduce the number of
machines that are considered so
there's
a couple ways to talk about this
problem and maybe i don't want something
as strict as what they're doing
i would be okay with say 5x more
machines
to not start excluding machines that are
only
this exclusion stage does not have to be
aware of the
problem this is a problem aware
exclusion
uh which it would be nice if we could
kind of break it up into two steps a
non-problem aware exclusion and then a
problem aware exclusion
so if we can show the two machines
behave completely identically for
example with relabeling the states or
switching left and right
then it's much it's more universal and
we can always do the second step later
um so requiring the blank tape condition
is
something that is specific to the busy
beaver problem
um aren't there useful graph theory
techniques to reduce the space of
possible machines yeah
in a way you can talk about this as a
graph isomorphism
uh problem
so the techniques that were historically
used before this paper are
techniques that uh run the machines
while they're finding them which i don't
really like
um this is something we talked about in
the last stream
um
this stuff seems kind of interesting
for an end state m symbol quadruple
machine
is an equivalent quintuple machine
we're only interested in evaluating
machines only blank input
which means to reduce the number of
machines that require non-trivial
analysis
so this is again doing i said i would
implement what this paper does
that's what i said i would do on today's
stream so i think we should try to do it
uh i mean one we can also read they gave
a nice bit of prologue code
this is the harland paper and they gave
a nice bit of prologue code here
when i tried to run the prolog code it
didn't work
this thing called emulate search let's
see what emulate search does
now let me go back to you guys
very typical of academic code to just
have all this stuff commented out and
not use a logging system
who knows if prologue actually has a
logging system
okay
when generating machines for the busy
vehicle problem
it seems intuitively natural to
concentrate on machines that are one
halting exhaustive and maximizing
we can ensure the machine is maximizing
by specifying that any halting
transition must be of this
this form so they use r but they're
equivalent to the l machines
it is more difficult to say that a
machine is exhaustive and
one halting
wait what isn't one halting really
easy oh i guess if it's a disconnected
graph it's not one halting obviously you
can have one halt transition
but that whole transition may not be
connected to the a state
that's what they're about to say right
if you imagine a halt you can imagine a
machine that's just like
jumps between the a and b states
repeatedly and then has a different
graph over there and that's where the
halting state is
you like the approach of lazily
extending the machine
yeah the the downside in this paper
that's discussed is is pretty uh
reasonable
it says that you know they're grouping
still two steps together here the more
we can
look at this like a a search problem
where we're
uh removing things at each step it
allows us to debug
evaluate and contemplate each problem in
isolation
not as a big group it'll also reduce
runtime
okay
consider the following partial
machine oh man this also skull is going
to run into rice's theorist
crisis theorem racist time the racist
theorem is
let's let's go to our own private copy
of wikipedia and look up isis damn
so nice to be on your own private
internet
where you know notice how i haven't
gotten a single pop-up
a single bit of spam this is my own
private internet
that's what we're gonna do at the
college
the college we're gonna have a really
nice private internet
uh millisecond latency right you're
talking like millisecond ping times
um we'll have copies of wikipedia
uh we'll have local running things like
like uh like a local
uh get lab instance which we can run
at the scale of a college
and hopefully i mean it's not like
you're only going to have access to this
right we're not putting a great firewall
up
but hopefully one of our metrics of
success
will be if students are using
the local internet more and more as the
real internet degrades in quality
our local internet can uh
can can be a
holdout we can do this because
obviously students can contribute to the
local internet
but with strong community
there won't be crap on it
brick and mortar university boys that's
the way to do it
that's the way to do it you gotta do it
that way you know there's always online
learning stuff
do you want to go to harvard and pay the
same amount of money
for a bunch of coursera courses but you
get a harvard
degree
um yeah no our private internet intranet
is going to be great
uh i'm not i'm not wading into the
crap blogosphere thank you by the way
uh for putting
the content the content is now uh
unsliced our codex is back available
thank you scott alexander for doing that
um it turns out only crackpots are
interested in cults
which i guess if i'd thought about it a
little bit is not surprising
but that's why there will not be a cult
just a university
um yeah so righteous theorem this is
what we're talking about
so let's let's let's read this text
carefully
consider the partial machine in figure 9
which is generated as part of the
process
let's figure 9 here we go of generating
five state two symbol machines
execution of this partial machine
they're still using execution it seems
brings us to the configuration 1d10
one oh 1d10 so that's
they talked about this notation earlier
in the paper so this
is means the turing machine head is
actually on top of this one
and it's in state d
so what should our choices be for the
transition the set of states used in the
machine so far is abcd
and the set of symbols so far used as
zero and one this means we have all the
symbols necessary for a two symbol
machine
but have only used four states
here we should consider only the
possibilities zero one
lr oh
so note that it can't halt yet because
if it were to halt on that transition it
would never get to state e and then the
machine would not be
maximal um
man this is using the same kind of
same kind of like run the machine
approach as tree normal form
um
all right let's
we could ask the question what is the
reduction factor of tree normal form on
three and four
and maybe the reduction factor would be
similar for five
uh
our next decision for the transition
okay so it made that
that d transition uh because it was over
a one so it made the transition to the
zero state and now it's in
yeah this gives us a machine in ten in
in this configuration so you could see
what happened
um let's assume we chose one equals one
meaning write a one to the tape
d1 equals r move the head right
transition to state e
so that's what happened to get from this
into this
through this state transition our next
decision for the transition
is we're in state e zero remember e
we're above zero
now we've used five states and two
symbols in the definition so for one
possibilities to choose the transition
to be the halting transition
alternatively we can choose from the
other stuff
yeah it seems counterproductive to
choose the halting transition as we have
a number of alternatives the problem is
we have no way of guaranteeing that any
of these alternatives will
result in a terminating machine
to output the machine in figure 11 as
one possibility and continue to search
for more
so this is i mean it's not even
partially generated right i think we
know already what the behavior of this
machine is going to be
the reason we can always ensure that the
generation of an end-state m-symbol
machine results in a machine which is
end state full meaning it
visits all states and m symbol full uses
all symbols is the strict monotonicity
for the
beaver function in other words we know
that it gets bigger
this justifies the above step in which
the halton transition
was not considered when searching for
that meaning it's yeah okay
it's not saying anything to
it's intuitively obvious that the
busybeaver function is monotonic about
the number of states and number symbols
sure i think nobody doubts that um
let's see if we can write the proof just
by reading the proposition
uh
let m be a k halting end state m symbol
turn machine with finite activity
then there is a case k halting n plus
one with one more state m symbol
targeting machine with
finite activity such that
all right let's see if we can come up
with a proof for that
i'm not sure it matters but just just
just like a thought exercise
uh so we can talk we can say
when the old machine was about to
transition to the halt state
um
i think we can actually construct
something that will
continue to do that transition as long
as there's ones
but then as soon as this one gets to a
zero it writes a one and it halts
i will loop back there do you see what
i'm saying
so we can just do like we can write like
a run to a zero and halt machine
with one more state see if that's what
that proof says
uh
yeah okay so pretty much yeah
all right so you run run to a one as
soon as you find a zero go to the whole
state
it doesn't matter whether it's left
right you can do it quickly cool
always good it's always good to do that
uh like do like a check like if you can
predict what's coming next you're you
understand something and a lot of times
you don't know whether you understand
something or not
um transformation is straightforward and
the method of increasing machine science
is highly unlikely to be any practical
use
so this gets into like this condition is
now not a condition that applies to
this is a condition that only applies to
the busy beaver problem not a condition
that applies to a generic
uh symmetry based reduction
of the turing machine space
hmm they've been unable to prove this
result can we prove the result
let's think about it let m be a k
halting turing machine with n states and
m symbols
uh for some k greater than one with
finite activity
greater than equal to one with finite
activity then there exists
a k holding m plus one
such that the activity and the
productivity are strictly greater given
one more symbol
oh yeah that is a lot harder
it was a lot harder
see
unfortunately we've been unable to prove
this result despite it seemed to be
obviously true how much time did you put
into it
um one of the things that i like and
like the uh
i think like donald knuth started it
he'd rate
problems with a difficulty rating from
zero to 50
based on how long it's going to take you
whereas like 50 or open problems
10 is something you can do in your head
20 is something you can do in 10 minutes
30 is something that's going to take
like a day
and 40 or something that's a good
research project for a semester
what is busy beaver 5 42.
finding some appropriate transformation
hence providing a truth uh proof of
conjecture 28.
um of course that doesn't
change the above thing about states
an even stronger result is desirable
here that we can guarantee that all
generated machines are exhaustive to do
so would require a result similar to
prop 27 but showing the strict
monotonicity of the busy beaver function
in terms of the number of transitions in
the machine
okay well so obviously if you if you add
another i mean if you add another state
you get if you have n states you get
another m transitions and if you add
another
uh
symbol you get n more transitions
but
what if you like take away two states
and add three symbols
so yeah the the the monotonicity on on n
plus m that's cute though
would that be a well that would be a
cool thing to prove you know i said
um it should be noted that we cannot
guarantee a generated machine will be
one halting
as we cannot guarantee that a partially
generated machine will always terminate
and so executing the machine may never
result in an opportunity to add a
halting transition
that's what i don't like about executing
the machine like i can look at the
machine i mean i guess if i know the
smaller busy beaver numbers i know how
many steps i have to execute it for
before i can say that it won't terminate
right
yes solving the halting problem for
little little machines using busy beaver
numbers
pretty cool right you know chayton's got
some crazy arguments about this kind of
stuff about like
why some busy beaver numbers are uh
we can know them and like which ones we
can't and he kind of says that
of this unknowable information you can
only get as much
unknowable information out of a system
as
axioms you put in uh which is
you know i have it's kind of fun like
like lay in bed for like 30 minutes and
think about that statement
and uh
you you you come up with
a kind of really deep philosophical
truth about that
is all math constructed on nothing
uh this all relativism true
relativism is not true because you can
prove that calm graph complexity is
universal
um i went through a column graph
complexity book and did some proofs in
it once
i really like uh
one of my favorite websites
you want to learn more about you want to
learn uh
you want to learn more about ai
you want to learn more truths about a.i
than than any
bullshit fast ai course where you
implement the latest and transformer
blah blah blah blah blah blah
this
this web page
one can prove that the better you can
compress the better you can predict
and being able to predict the
environment well
is key for you being able to act well
consider the sequence of of pi if it
looks random to you you can either
compress it nor predict the next digit
but if you realize that it's pi you can
compress the sequence and predict the
next
it's next digit um
mdl this is this is the deep truths of
of ai the rest of it is just
learning hip new frameworks
better compression requires
understanding
uh in some cute ways you can also
talk about how science is just a quest
for better compresses
we have all this data science comes out
these little cute formulas that tell you
how to predict patterns in the data
but science also has this
constraint that whatever
it discovers also has to be human
understandable
math has debates about this
what is a math proof is a math proof
something that makes the solution
intuitive to humans or is a math proof
something more like you'd find in cock
which is a rigorous proof that may be
completely unreadable to any human
me i'm definitely in the second camp and
i think explainability of ai is the
biggest
scam oh but how did the ai make the
decision
yeah you ever ask a human that question
oh but you can ask the human and the
human will give you an answer
nah the human's got a little part in
their brain robin hansen talks about
this he calls it the press secretary
that just spins total bullshit lies
when humans are asked why they did
something
um they did some experiments and split
brain people that just shows
the extent to which humans will bullshit
so that they can have a coherent
understanding of the world
and you think you're getting a real
truth about why the human made the
decision
we're now in a position to define the
process for generating machines hell
yeah
this will follow the same general
strategy of the tnf process
ah wow this actually looks very
implementable
all right who wants to implement that
god i haven't coded and coding's hard
you know i'm coded in a bit i just don't
feel as
like you know i coded like merge sort
and actually i coded merge sort really
stupidly
uh in that stream um
i don't know it's been nice to be coding
less lately
but hopefully we can write this
let's see i know you come here to see
the lightning fast coatings on the
keyboard well you know what
you're the wrong kind of person this is
philosophy chat
um but not stupid philosophy a lot of
philosophy
like i was uh
on camping once i was younger
i was like 21 and i like to talk about
like stupid like universe philosophy
kind of stuff like is the universe
analog or digital you know like the
kind of things you want to talk about
when you you first start smoking weed
and this guy was like
you don't know anything about that
like it's kind of a childish thing to
talk about
and at the time i don't think i agreed
with him but as i got older i did
the philosophy that that's much more
interesting to me is the philosophy
that's grounded in this kind of stuff
the philosophy that's grounded in these
deep mathematical truths
um that requires uh
years of studying before you can
understand them okay uh
so this is the tree normal form
yeah let's just write it from scratch
just for for enjoyability for all of you
we won't we won't try to adapt the old
code
all right we'll call it zany zoo dot pi
sorry about the noise
okay let's initialize the machine
with the tuple um
well
like another way to talk about that is
just
say one rb in a zero
so we can say like let's say machine
equals none times 10.
should we not do this in python who
wants to use haskell should we use
haskell
i'm sick of python
sorry everything's going to take me
forever and hassle you know i'm not
going to be able to do things fast
uh i don't think we need moan ads
okay so haskell we're going to want to
define a
type of a machine
uh
and what zero dextrous means
should we use maybe we'll use c plus
plus i mean part of the problem
is gonna be with writing this in python
is it's going to be slow
and like i just i found myself like you
saw even the way i started that i
started just thinking about it in terms
of uh
in terms of strings like do i want to do
7 billion string manipulations in python
not really
[Music]
um
all right let's say
transition
i don't really remember c plus plus
either i only know python
but i think we can muddle through with
this a whole bit better
um so let's actually call the states
integers
uh let's try to use the same terminology
that they use
uh okay this is the terminology
let generate function go
generate here we go uh
so we're going to have output int
direction they're technically bulls
but we'll say in new state
um we'll say into transition function
we're going to define n is 5 when n is 5
the transition function is n
uh by m sorry that isn't five and
two uh these aren't ants they are
struck transition
it seems right right
uh so that's the definition of a machine
this can be
private
uh yeah we don't need this to be a class
it could just be a function
generate
okay
step one so we want to initialize the
machine
to the tuple uh
let's just make a macro s
which takes in a state subtracts
that from it right say s sub
a
cross zero
um
oh i have to write the stupid ass tape
as well gotta write an infinite tape in
c
plus plus infinite tapes are easier to
write in high school
okay so this is going to be a
uh oh this isn't you can't do that
um class transition
sounds marxist i spell transition wrong
i think i did
no i didn't okay
[Music]
oh
this isn't what i want either
i want something that's going to allow
me to write this
say one
no magic instructor for initialization
okay so how do i do this
like a colon
yeah it's like that but then what do i
separate them with more colons
more commas we'll separate commas and
see if complaints
that work no
matching constructor oh we need an
initialization constructor
l equals um d equals zero
no move yeah we'll say d
is minus one
you know what better yet
should have i done it in haskell no if i
didn't have yeah i know i know haskell
is like much nicer at stuff like this
but like i didn't haskell we would have
been
grappling with bullshit for a long time
undeclared identifier
calling a private constructor all public
we like to share here
he's just not looking tape changes moves
and position integers
you know what you're saying
[Music]
uh that's step one step two
choose the b zero transition
well the first transition is obviously
going to be that
i'm smacking the microphone it's in the
computer
[Music]
i don't have i don't have another mic
sorry we've got a
poverty stream voice poverty stream
yeah you know what you guys are talking
about computer that's dangerously close
to keyboard
guess what guess what's going to happen
you all know what's going to happen
let's try it that's what happens
all right
oh it's banned do you like hammers oh
who likes hammers if you like hammers
check out hammer.wall
we already got three people who applied
to come work at hammer
um but they clearly didn't realize we're
only hiring for one role
which is founder i'm not the founder of
hammer
because i never want to start another
company
uh if you're looking for a job go apply
to comma
uh that's my hn shell
we only do the twitch stream as a funnel
for hiring
because we are illegitimate and we're
duping you guys because we're on the
side of collaboration with
i'd never do that
subs are better people than non-subs
it's true glad
glad to see all you subs and joining it
yeah bye plebs
um yeah you can waste your channel
points but let me tell you about channel
points they eventually run out subs are
forever
okay
choose the b zero transition satisfying
one of the conditions below and add this
transition
to m
uh
i mean i feel like i want to enumerate
these all in a loop
like there's not too many of them
transition
output can be zero or one direction
is left and new state can be a
so i guess we want to try this direction
can be either no direction is always
left
but this can be zero or one
or it can also be since n is greater i
don't understand why this has to be a
special case but
we will we will trust the authors of the
paper
we are simply following
their will
position can be zero or one new state is
c
and this can be l or r so there's five
there's uh eight choices in step two
that code's obviously not right you have
to pick one
we can look
okay execute m on the blank input
until m is known to be irrelevant
or a bound on the number of execution
steps is exceeded
really
this is lame crap
what how do i bound the number of
execution steps
i don't like this paper anymore this is
just tree normal form
with like two extra steps added in
thank you for all your new subscribers
we'll turn it off again but guys
do we have to talk again today about
quality
i mean subs are low quality tonight
don't make me sad
hey serious quick chat time
um why do you guys watch this channel
especially when i do stuff like this
like it's fine when i'm ranting
about you know things that anybody can
have an opinion on but
one of these days i really am going to
make like a quiz right
and the quiz is going to include
questions like here's a small tarring
machine
how many steps does it run for until it
halts
and if you can't answer that after
following through this far we kick you
out of the class
oh that'd be so nice that's what we're
gonna do at college man
that's what we're gonna do at my new
college
every semester if you don't know shit
you get kicked out
doesn't help you be a better programmer
look at my mediocre ass
programming boys
sometimes i program well i don't know
i'm like second competition programming
for for a bit maybe i'll get into it
again but
whenever the code comes around all right
step three so we gotta
execute m on the blank input
so we need to write the turing machine
execution engine
uh we should write a class tape and
implement that
uh i mean so tape is really very
similar to vector except here all right
we're
just implementing two vectors uh class
tape
public what is it like operator
yeah it's this
[Music]
i think we can just implement it as two
factors
you know what maybe it would be a better
place we all just turned on no script
sorry for using stl classes i know i'm
pathetic
all right um
if all greater than or equal to zero
uh if
forward dot size
is less than l forward resize
l return
[Music]
forwards of l else
minus l minus one l equals l minus one
minus l minus one so that times minus
one into one
subtract one from that yeah that gets me
what i want uh i'll just change this to
backward here
compile of course not non-crash over
refrigerant cannot bind temporary type
ah
can i not use vector do i have to just
write it
because it's a 10 i mean you see why
it's a temporary type right
i actually made it a
all right is this this too is this too
ballsy for people
it might be ballsy man i don't know
seems ballsy
what no
oh they're gonna value type is this a
const oh good no it's not const
oh yes good oh that should work though
what no i put it without data
non-const l value reference to type int
cannot bind to a temporary type
oh maybe that i'm doing it by reference
let's test tape quickly
all right so we expect t sub 0 to return
zero
segmentation fault
oh fine
what but i resized it
well i guess we need a value type
that's all right oh a forward size
is less than l plus one
zero cool um so let's check the tape at
55.
uh let's set the tape at 55 work work
work work work all right sweetheart
oh let's just check it at minus 55 tim
high quality shit get it boys
we made a tape
[Music]
got rich off a mixtape
you should listen to drake just to fuck
with copyright filter
since i want speeds and i try to avoid
branches
i think the uh branch protector will get
that one fine
do you have an easy way i guess i could
call resize but who knows what that's
doing internally
i don't technically need that if state
well actually no i do need that if
statement
because otherwise it'll resize it to
shrink
okay um execute m on the blank input
okay
let's execute m so we'll say cs equals
state a which is current state
um and cp
current pointer zero
uh so we're gonna say if
no not f we're gonna get uh
t t equals t f
sub what state are we currently in our
current state
times the current on the other current
pointer but the tapes of the current
pointer
um and wait that's not a tt that's
actually a transition
so maybe we can just use it directly
uh okay so single type
ttf dot
uh output so we're gonna say t sub cp
equals gtf output we're going to say
cp plus equals ttf direction
i need to do my directions yeah
and if
well actually no we can just say cs
equals
ttf dot new state
if cs equals equals minus one
that should be a time machine runner
right
that do it right
okay well something
cool that holds great
uh it obviously falls because we didn't
have any uh
okay if we have an undefined input
well how can i call it undefined
let's say new state equals minus two
um
actually we're actually going to say
direction is zero as well
we don't actually want to add anything
okay
so that means we gotta define the state
uh
i won't be able to set those things okay
choose a new transition
for m as follows if m is n stateful
and m symbol fall and
the thingy is not zero dextrous oh god i
don't know what that means
guys
we were talking a comma about adding a
uh restriction to the model
which says that the model's output must
be self-consistent
and
we talked about this for a bit and it's
very
true that a model that makes very
self-consistent like temporally
consistent
outputs um
all models that are good do this but not
all models that do this
are good models it's the same way about
you guys talking about how i
move around from insert mode into
non-insert mode you know
that doesn't make you a good programmer
studying that stuff will never ever
make you a good programmer stop talking
about it
nobody gets good by studying vim
shortcuts
you get good by programming for years
and years
and years decide what you want to write
program it
you'll just get better at the tools
nobody told any good talks about tools
it won't make you more productive it
really won't
you watched me code this right it's 88
lines
most of my time was spent thinking most
of my time was not spent
fumbling around with my editor if most
of your time is being spent fumbling
around with your editor
uh
i wish somebody told me this years and
years and years ago
you give me the ratiest editor on the
most beat ass
computer with the worst keyboard and
i'll beat you
the stuff doesn't make you good
okay
if m is n stateful and m
symbol full
and m union
a transition to the halt state is not
zero dextrous okay i think we're not
going to get around figuring out what
zero dextrous means
uh add that new state to the machine
so let's write the add the
add the halt state
thought output equals we always output a
one
um we always transition
to the right and
our new state is
state underscore halt
do
if it's not zero deck stress
okay um
i think we're gonna need to write
some recursive stuff here
because like for all of these things we
want
all of them not just one
choice means our machine are
dexterous or right-handed
note that in step four they really don't
uh define this very well regime is
unstateful
and uh m symbol full
well that one i can get a whole lot
better
okay so we can ask a question about the
machine
uh
this is annoying we actually have to ask
we have to
say how many states have we seen
um you also need to track
symbol scene
i think this is right right
uh then we do not actually want that to
be zero we want it to be minus
[Music]
cool
there's like better ways to do this in
more modern say
[Music]
actually
that's not exactly what we want to do we
don't actually really want to halt there
um
before we set the state
and actually i guess before we do
anything
we can check to see
run step
that'll actually halt right
ttf dot news um
i'm upset with the comments well i read
in a page you do security contracting i
got on a page the earth was flat man
yo you should check out this page it
says global warming is a hoax promoted
by the international zionist conspiracy
theorists full trash boys
no i just don't know what zero dextrous
means unfortunately
it doesn't seem that important though
check def 23 on page 15.
all right
oh cool thank you i don't know why my
search didn't find that
i'll leave it as a to to-do for now
because we have to address a more
fundamental problem
about how we choose
uh like we have
choices here
i don't understand step five really
either but
i mean
how do you actually like run this
i i feel like i almost have to like like
copy the machine
add that one state and then
redo the procedure right because look at
what i mean look i have the same problem
up here
right
when the machine's created you could put
it online
and it's going to generate uh
links about how you can make four
thousand dollars in one month using this
one weird trick after you buy my ebook
guide for only 28.99
and then i'm gonna sit here and i'm
gonna rake in the dollars
that's right because money is going to
make you happier
you really think they would show you all
those ads on television
if the products weren't going to make
you happy go out get money
buy products consume product
will be so happy and fulfilled in your
life
for a bit and then you consume more
product but don't worry as long as you
keep consuming product
america promises you a nice life the
advertisers promise you a nice life they
say all the time in their advertisements
[Music]
what do i do about this all right
like what do i do about this isn't this
like
this is easy in prologue i think i think
this is easy in prologue
because it's a logic programming
language fucking prologue man
i don't really know what prologue is but
i have an idea that you can
you can do this kind of thing very
easily in prologue
you guys see the thing that i'm asking
for right i mean here well we'll
we'll we'll write it out stupidly um
for n and n equals zero
and less than n n plus plus
same thing with m
uh for d in
oh this is a little annoying thing about
d that i didn't really consider
can i say something like
call
oh
expected variable name or this in
lambda listy
oh sweet okay
um well it's doing something
oh i guess we have to set the state
ttf.output equals m ttf.direction
equals d uh but everyone sees why this
isn't actually right
and not what we want we want to like
kind of fork every time
right uh
we wanna
apparently n cubed i mean those numbers
are small
um love that syntax by the way beautiful
beautiful syntax
like i wanna i wanna spawn a new
uh
yeah like i want to spawn a new thread
from that location
every time
you know spawn
after each one of those i want to spawn
i guess that one doesn't uh
that one doesn't haul
step six is go to step three
okay what's the easiest way to write
this
see i mean they really are threats right
so so if i wanted
to go crazy i could actually spawn a new
thread in that location
i would have to make copies we'd have to
make
copies
the zero dextrous thing is not a big
deal it's just going to like reduce the
space a little bit
let's try to read the prologue and see
how they did it
i think prologue is a language that's
like designed to be run in this way
though i think that's kind of
what prologue is
we should have a stream where we learn
prologue
well if someone buys me a mic
and puts it in an amazon locker send a
mic to an amazon locker in the east
village in new york city
i will go pick it up and then i'll have
a mic for the streams
no i mean you'll be a hero to the
streamers who don't like hearing the mic
noises
you had an exam with prologue
you can't set things to uh
huh maybe you can
i mean that's okay so one thing we could
do here
is we could refactor the transition
thing to allow sets
but that's not exactly right either
because would the sets be
a cross or would the sets be a plus
and this whole thing has to look kind of
like a
uh i mean how do i choose which one to
execute i guess i could implement a
priority queue
a priority q for the total number of
steps the machine has executed
yeah i think that's probably right okay
we have to put the machines in a
priority queue
uh oh
crap though to have to put the tape with
it
it's not just the machine i gotta also
put the tape
that means i gotta write a fucking copy
constructor
[Music]
okay let's
class machine
um and the machine has this transition
function
machine m
actually we don't we can make machine m
but we're also gonna need to make
a standard priority queue of machine
this is hard boys it was supposed to be
easy ms
dot push m
you
okay
let's just see if that compiles
include qe
forward definition of matching
okay that's an okay thing to complain
about
um okay we make this a function on
machine
no actually we'll go even further with
that we'll just say um
i'll call this a
is full
return
and
so now we can just change this to m dot
uh
is full
i don't know what any of that means
variable has incomplete type machine
machine like a keyword or some crap
we'll call it a tm for a time machine
better not good can't use machine
i didn't like tm either oh probably more
because i put these parentheses here
this isn't
python what language do you think you're
coding in
but it also still seems to have issues
with maschine
t machine yeah that's a good name for it
we'll call it the t
machine it's not just any machine it's a
t machine
and t machine has the same as this
machine
okay machine it is t machine only
sounded good when i couldn't have
machine
you know like hammer.lol sounded good
when i couldn't have hammer.com
um oh okay so actually the main thing
it's complaining about
here is that i didn't implement the uh
wouldn't implement the comparison
constructor
without the comparison instructor how do
we know who's better than other people
actually
um i'm just gonna make this a
run function in the machine machine
[Music]
run
we don't actually need ttf we can get
that
again in the run function i don't even
need
this m dot because we are m
returns c cs equals
i'm not wrong
one is a private member of machine
everything should be public private
okay well that's a more understandable
thing
uh steps equals zero
uh steps plus plus and then we'll just
do comparison on
steps
um
less than operator c
plus plus comparison operator
if i had hammer it would have already
found what i was looking for because
hammer always just knows things you know
hammer it reads your mind
return if m
dot steps less than
oh sorry steps less than m
invalid operands to
binary expression but i defined it now
machines have an ordering
can i put less than
i need to put less than where do i have
a typo
oh i probably need a const here
or i need something like bull const
operator
line 56 typo where
i don't have amazon if somebody
dropships in amazon
invalid comparison to binary expression
const machine con's machine
between that and that for const
i think you're right yeah see
blue spec you're a smart guy
all right we're making some progress
boys
progress
it's a good thing this wasn't haskell if
we were trying to do this in haskell
we i've given up already if this was
python i would have written some
egregious copyright hacks
and we would be done but it would take
27 years to finish running
okay good we have
eight machine
um let's just write a quick
[Music]
check
hmm okay so i think then we want to just
say
or pop m equals ms
pop
let's actually just confirm while ms.i
is greater than zero
ms.pop m equals ms.pop
and then let's just print let's actually
make sure i made copies
void oh
top oh that's a const reference
the hell kind of crap is this
why doesn't pop return the thing
kind of useless priority queue is this
no viable overloaded equals
i'm not happy about this it's because i
have to write a copy constructor don't i
cannot convert argument of incomplete
type void
to machine to the first argument
the implicit all right all right we knew
we'd have to write this
didn't i complain about having to write
those
um copy
operator
copy assignment operator
looks like this it returns
a machine pointer
this dot cs equals m dot cs this dot cp
equals m dot cp
um this dot steps equals m dot steps
um t f equals m dot t f oh yeah that's
going to go over well
probably have to write this
and i don't know how it's going to take
this one tape equals m dot tape
or t equals n dot t i think we're going
to have to also write a copy constructor
for tape
candidate function not viable cannot
convert
argument of incomplete type void
oh it's also complaining about that but
this argument has typed const tape
but the method is not marked const
all right we'll write the copy
constructor for tape as well
let's see if it compiles
take t of four equals t dot forward
backwards t dot backward copy
constructor
on vector
okay using assignment operator
this argument has type
const
oh
hmm oh i don't want discounts there
yeah were you guys talking about that
i'm glad to see there's a hype train
going on thank you people i appreciate
your support
and i hate when you say dumb things so
support more and say dumb things less
and everybody wants
um control reaches the end of non-void
function return this
try and reference this
return draft this you think this
okay cool thank you
nice to see somebody knows uh
remember reference base type and is not
in a structure
or union
copy this one is that good
um canada function not viable
cannot convert argument of type
incomplete void
oh because i'm still using pop it's not
pop it's top
yeah okay member reference base type
in is not a structure or union
[Music]
about that
okay so it's doing something but it
isn't actually working
because that's not calling the copy
constructor it wouldn't return all
ones if it was calling the copy
constructor
all right because i'm asking for the
output which the output is here zero one
zero one zero one zero one
so it's not calling the copy constructor
it's just using the last one
um
why doesn't push make a copy
well you know what i can put a print f
in the copy constructor or maybe it does
and i'm just not copying the transition
table
um
oh okay we're making a lot of copies
damn that's a lot of copies boys where
do we make these copies
not there here
well there oh i guess we're i guess i
mean maybe we're not even making them
here
yeah okay we're not making them there we
only make them further down and we're
actually making
way too many um
assignment op is not a copy constructor
did you also write a copy constructor
probably not
oh you're right oh you're right this is
not a copy constructor this is just an
assignment
oh yeah okay this is stupid
um
do i even need this i i meant to write a
copy constructor
i don't even need this and now it does
what i want
that scares me it now does what i want
now that i removed
that extra code
better now
i'm not doing github review
okay cool where do you think i made a
coffee constructor
i don't see one but this seems good
well actually no there's one thing
that's not complete here and that's the
tape
yeah yeah usually don't even the copy
constructor so
when i'm copying the tape am i actually
copying the underlying
vectors
it's working that's good
so now we know what to do when we want
to quote unquote spawn
we can just say ms.push m
all right it should work
uh why can't i call push
oops i'm in ms.com
i got it though
i'm calling ms.pushm there the types
haven't changed
oh i created a new m that's stupid
um
sorry this kind of crappy code i should
kind of refactor that
okay okay yeah yeah yeah use a real
editor do something that can do this
with one click yeah
yeah yeah i know i know that feels
all right you're happy
all right well it does something
so i'm putting all the machines in a
priority queue every time we create a
new machine we add to the priority queue
the priority queue is sorted by the
number of steps the machines have taken
we can actually add that here
they've all taken no steps
i guess we yeah we add all the possible
transitions
um
only if a state is undefined does it end
up there
wait how does my
has my priority queue have negative size
oh
okay it didn't add any transitions great
but you got you got a lot of
stupid ass languages like c plus plus
what call it integer overflow
oh i did i remember that on a stream
once
um right you're already cute i remember
i remember that on a stream once where
i was screaming about what a bad
language it is like what kind of a
language
has shitty numbers like that like
what kind of language let that happen
you know would you let your kids program
in a language like that
okay um if mm is full
i'm sure m is not fall
has it not what
oh maybe we kind of want to say else
and then push all right
okay something
is that really the best thing in the
priority queue
or something as aliasing
there's 47 things in the priority queue
why is it returning one with that many
steps oh unless
okay do we really want inverted priority
queue
should probably give you the biggest or
the smallest
a largest
all right let's first like try it for
this how many machines are there
um
oh it shouldn't actually break if it
halts
ah we'll say okay first off why did i
make mm.run return true with the halt
i'm going to make it return
false if it halts and true if it should
continue
and then we don't break but only if the
step actually runs do we add it back to
the queue
add back to q if
no pulp more
run please
step four to do right now
okay it's doing something now
look at it marching along the tape
oh they just keep tarring and tarring
and tarring
so
let's overwhelm my computer ah
again
okay so it seems like pretty quickly
we get to four nine
four and actually for every machine that
halts
let's add it to a halting machines
um
m
oh my vector has std
okay so of it looks like
this works pretty well i mean we're
beyond the number of steps what is busy
beaver
3 oh god why don't i use my own
wikipedia and not be exposed to this
bullshit
yeah my wikipedia
media my wiki
so we know that we've set n to
3 and m to 2 so i would expect
yeah so 21 is there so as soon as we get
to 21 over here
you can see where we actually transition
wow c plus plus so fast c plus plus is
so
fast but so it looks like
of all the machines we enumerate 457 of
them halt
and 4494 don't halt
and we can do something else too
let's just quickly uh
we'll say bbn equals zero um
bbn equals uh max
oh well equals uh mm dot steps
um just i want max
i don't i'm gonna have to import
something for max aren't i
oh you're where's max oh do you mean
standard max oh that's declared here
hmm 17. it's almost 21.
uh yeah we got a machine that runs for
17 steps
now let's up into four and see what we
get
depending on undefined state a lot
how do we print that out well actually
whenever we get here so that's not
okay
it's got some machines that run for
eight so it's like trying them all in
like a breath first search kind of way
this is the total number of halted
machines this is the total number of
machines in general
you have to print every time either it's
kind of a lot of printing
yeah i don't know it doesn't work for
three and two yet so we can we can fix
it
now none of these machines are going to
halt it's continuing it's running it's
running non-halting machines
of which there are this many thousands
okay uh so things i worry about are we
actually making a copy of the tape
we might not be um
if you have a class with a vector inside
of it and you make a copy of that class
is there one vector or two vectors
to do learn c plus
or is there some reason we just didn't
get
the one that we're looking for
that definitely worked
let's um
declare identifiers
move semantics
no it's not for n equals 17.
it's trying it for three comma two and
we're getting the longest any machine is
running
uh a number of steps that it's taking is
um
oh well okay i mean there's a tiny bug
here
where
[Music]
i think if we just say ms.pop that fixes
that
because the last one we pushed is
actually
i mean actually if we want to be more
explicit about it we can just do this
no it's always the last one
we run the last
pushed machine
right now
oh look that got rid of a lot of uh that
made my code so much faster boys
we got more speed you thought as soon as
i add in the zero dextrous
check we'll have an unbelievable amount
of speed
cheapest plus so fast
okay
let's
now
why am i only getting 17
the answer i should be getting according
to my
very secure and high quality local copy
of wikipedia
is 21.
you know check over two by two maybe
that's easier to think about
three with some real junk here
oh because i didn't write it to work for
it did actually
oh no i didn't these ones are not
included
this is only if n is greater than two
it's actually if n is greater than or
equal to three so we'll just copy from
the paper
that's what was breaking when i said
into two
sorry that's again not moving
six okay good so it's working for
n equals two it's just not working
for n equals three but it's fast
so it can be forgiven you know sometimes
if you come up with the wrong answer but
you do it really really fast
now you're a terrible person don't ever
be wrong
is there anything wrong here
maybe i'm getting my okay so i didn't do
the zero dextrous
check
i don't think it matters though
let's just think about what we're doing
okay so every time
we come upon an undefined state we add a
machine
which replaces that undefined state with
every possible state transition
both possible directions and every
possible output
create that machine no reason to leave
since we're still going to run it
the other alternative actually what's
probably better to write here
is just continue right if i just
continue through
the loop
no machine to run
right now right
all right gives you the same answer
actually behave slightly differently
though which doesn't exactly make sense
but like give me different numbers here
but i kind of feel like that's more
correct right because continue
gonna go back up here get me the top
machine pop it
uh so on and so forth
okay um if it's full
now maybe is full maybe i'm not getting
the definitions of these things right
okay what does end state full mean
and stateful if
the cardinality of q
equals n
maybe step four matters
oh sorry this one if the cardinality of
m which i don't totally understand
uh oh basically
if your only choice right now would be
to add if there's only
one unassigned thing it's obviously and
there's no other halting one
uh add the halting one i think that's
just a speed up i don't think that
should be a requirement
um let me see if i did anything else
particularly stupid
all right there's a question of maybe
we're not making a copy of the tape
um we can check this let's just write a
quick test for this
machine m machine m2
um we know the first
i'm gonna call it t i should really call
it tape tape is what i call the class
so too late for that
okay we get 1 1 which is what we expect
and if we do that before we do it we get
0 0 okay i haven't taken any steps yet
now machine mm2 equals mn
we expect these tapes to be different
the tapes are different okay never mind
it works
so it is copying the tape
kraken dmp thank you for subscribing
we appreciate every subscriber even the
ones that i don't read out
on this stream some people get lucky all
right
um it's copying the tape
uh
there's definitely four there four there
let's think about what's happening if
we're not hitting this undefined thing
[Music]
um
yeah okay we run
push it to the thing
otherwise it's halting and we take it
off
and we check
yeah this code's not bad it's actually
pretty clean code
is bad
okay who can find the bug
who can find
i really don't think it's the zero
dextrous thing
because that's just excluding machines
we're checking more machines than we
have to
if we were checking uh less machines
than we had to
for some reason we're not getting the
machine that's
that's uh the busy beaver for three
we do get the one that's the busy beaver
for two but we don't get it for three
what if we do like 2 comma 3 what do we
get 26 is that 26
well again it should be 38
so that one's not working right either
um okay these are all simple
types except
for tape but we know that that's working
okay because we tested it
um with these eight possible starting
machines
we're initializing that tuple
correctly
execute m on the blank input until m is
known to be irrelevant
or the bound on the number of execution
steps is exceeded output m and halts
uh so that's what we do here
an undefined combination of
the state and input is found which is
what we do here
choose a new transition as follows if
m is n state full and m symbol full
let's be more aggressive with this
let's maybe we did the definition of
this wrong
um there's another simpler way to define
this
and we can actually just say it's just
states
scene we can define it out here and this
is actually also going to be faster to
run
um symbol scene sub m
and then fur is full we can just change
it to this
and we say uh s
date scene
uh sub cs equals one
now it shouldn't actually be cp this
should just be
um
symbol scene sub zero equals one
scene a and zero
and here we'll say
symbol scene sub ttf
output i like this one
oh so i don't want to delete all that i
did want to leave these in there
great now it gives me one
hmm i'm okay that's already when i'm in
an undefined state
um is full
is about a transition that seems correct
it seems like a lot of them are halting
really fast now
because many more giving me is full
i guess
um
i'm still not really understanding i
mean maybe it's a cross product
if it's seen every state and every
symbol in that state
will that ever happen
all right well i think i think the
problem is that we're getting the
definition of this wrong
so let's be more careful
m stateful if
the cardinality of q
equals n
that just means that we've defined
a ton of machines are halting they've
been in every state
and it just says oh i've been in every
state why do i need to keep running
um i've been in every state and i've
seen every symbol
now it's time to halt but that's not
right
the other halting transition in the
generate process is actually much more
interesting i think
all right let's remove that one
that's only
let's just let's do this
that should work right well nothing's
ever going to halt
but we can add in step four
if the cardinality of the machine
basically if we have
that's interesting that it doesn't even
run the machine
um
i got one called card uh
f tf sub n
dot new state
uh is state undefined
if mm dot card
equals n times m minus one
and an order operation should be fine
there
then
uh add a faulting to the last
missing states
you have mmotl
a little redundant from above
uh that's probably stupid way to write
it
but we can do it it's fine
and steps
all right still no lock
this ever happened
am i getting crazy big numbers for that
doesn't make any sense does it
can't be greater than six
ah compiler you should tell me when i do
stupid things like that
all right still doesn't work
now half the machine's halt
but they only seem to take one step
that can't be right
it doesn't even make sense
oh well so this actually shouldn't
really be
here can we do this here
matter
okay it definitely doesn't make sense
that it's giving me one
that that makes less than no sense how
how are all these machines halting
yet they've allegedly only taken one
step that's a scam
okay so those are
see they've already taken five steps
how could it be returning one
i'm on the fives in the priority queue
it doesn't make sense
there's twos and threes already i guess
none of them
have to halt
okay this doesn't make sense right if
i'm at five on the priority queue and i
popped a machine off the priority queue
there
how does it have only taken one step
it's not calling this constructor right
all right chat's getting stupid
what is it one
else okay the way that we end up in that
else
is we take a step
to a machine that we just added a
halting state too but we only ever add
the halting state
and this should only happen once
now it's also showing that half the
machine's halt
what's chaitin's constant for the target
machine because you guys should all know
it's constant they can't be one it
doesn't make sense
very upsetting
okay b5 e1
something in the run
could it be setting steps to zero
somehow
who sees the bug who sees the bug
oh man oh
god
it was an underflow in the state scene
array
what a savage language really what a
savage language oh look it's going to be
21 now
oh we did it 21 is the right answer
right hell yeah
21 all right let's check if we can get
38. so you see i'm setting two
from two and three from three all right
38 fingers crossed
no 38 we got 26 okay that one doesn't
work yet
check this one six that one works okay
cool so increasing n
seems to work 21 will we get 107 if we
do this yeah it's okay if it takes a
long time oh wow it's gonna take a
real long time
no bug life you know
well we implemented that anyway which we
were supposed to implement
now we can try the new mm is full maybe
it will still work
no it only gives us 7.
so we don't really understand how to
write that yet
i do want that up here
okay
yeah chad's really low quality
oh sorry too let's see if we can work
with this one
i don't know many symbols don't really
make sense to me
oh i know it doesn't work
uh because we have to iterate through
symbols here
not states
all right isn't that what it says in the
paper
no just simple choice is only zero or
i one this doesn't matter if it's the
first one right
i don't know why we only get 26 there
we do get 21 there and that's what
matters and if we increase this to this
we get huge uh
big explosion
okay now we can start pruning
now that we have something that works
it's going to run this enormous number
of time machines
why'd no one read the paper you know
you're all at homework
nobody does their homework no more class
you know here i felt bad for only
reading some of the paper
you all should feel terrible about
yourselves
read the fucking paper you know like who
tried
you know what and some of you did and
some of you did and actually i have a
feeling
and this is this is again internet
tragedy of the comments
i have a feeling that there's some of
you who actually tried to read the paper
and you tried and you didn't understand
everything that was said i read it i
didn't understand everything that was
said either
and you're staying quiet trying to learn
while people who are you know
didn't try to read the paper were like
oh i'm too stupid for that
they're also too stupid and i want to
shut up
well i didn't know i didn't know there
was homework oh my dog ate my homework
bro travis collaptic got yelled at for
saying this an uber but one day you're
going to wake up and you're going to
realize
that all your successes and all your
failures in life are you they're not the
other person
you know they're not all this guy off
only at this opportunity
oh if only i got to shut up you know
real talk
oh i wanted or i wanted or i couldn't i
wanted or i couldn't
oh you're making excuses to man god
god's going to judge the shit out of you
you know every person who doesn't treat
you like god is doing your disservice
you know every person who buys into your
excuses just lets excuses go in the
world
all right let's see we can cut down on
here
all right let's understand zero dextrous
you know that's sad it's sad that they
oh you're like the motivational speeches
some people want those kind of tough
love speeches you know how it wasn't
rocky man
the problem with self-help is if you
need a self-help book to be motivated
that's not like it's not
lasting you're just addicted to
self-help i i guess the same thing is
true for anyone who thinks they need
drugs to be motivated or anything like
that
like no it's not it's not easy
it doesn't just come easy who thinks
it's all oh some people just are they're
able to be motivated they just have a
different brain chemistries
no it's hard for everybody a lot of
people just don't talk about
sir john duke thank you for gifting subs
um
we'll switch back to we'll switch back
to non-subscriber only uh
you know some people like semi-things
and uh
they're like oh george no i've never
said to anyone before but you're my idol
or shit like that like
i don't care you know what i would care
about
if you like sent me something that like
taught me something and
was interesting right i would care i
would care more if you didn't send me
anything and you spent your time like
learning something
learning a skill i i don't care i don't
want to be famous fuck being famous man
famous people are losers man you know
how i know they're losers they're all
drug addicts and they all kill
themselves when they're 27 right
oh but i want to be famous man you know
what the outcomes look like for famous
people
not great i'm gonna be famous i want the
world to know more
shit like real real facts about things
it's hot in here
all right i think we're gonna draw it
today we're gonna get it to the point
where we can
have it do busy beaver four so right now
we can do busy beaver three
um but
i think this is actually supposed to
execute early though
like it's not supposed to run them all
um maybe what i've written now is is
tree normal form
but let's implement zero deck stress
so basically i think we add it to the
list only if it's zero dextrous
some of you guys are very good i really
appreciate who caught the const bug in c
plus i appreciated who brought up where
the definition of zero dextrous was
of course i lost it
so i think we just don't want to push
the machine
if uh yeah
oh i think there's another bug here
too
this is actually spamming over all the
states
should i mean like i really have to make
a copy of the machine here
hopefully that makes a copy
great now i have even more
oh no i'm only setting no no it's fine
never mind you have to do that
it's not a challenger game for
programming it's a math problem
trying to solve a math problem you know
um if you will allow me to indulge in a
moment of self-pity
uh you know why am i not doing this at a
university
all right why am i streaming this kind
of shit on twitch
uh i don't know some ways i don't really
have the
i guess i don't have the
conscientiousness
uh to like apply to a university and
work in a lab
where i could uh i could do this
um you know part of it is i could scream
about how the university systems cocked
um how you know they're going to ask me
to to to write an essay about diversity
and not questions about math
which i'll immediately say wow this
institution is a bullshit institution
and i don't want any part of it
um yeah
hello i'm in new york you know
it'd be nice oh no the corona virus is
going on we can't go we can't go
anywhere oh that's right oh yes that's
the corona virus
um i've set up a straw man you're right
you're right no that's what i said like
if you let me indulge in a moment of
self-pity i don't know if that's true
i don't know if that's true maybe that's
just something i construct in my head
uh it's probably something i constructed
in my head to get out of
like like it's not like i could show up
right because i have tried this before
and this doesn't work
um i'm not sure to say that you know
they're they're correct and you're going
to write an essay about diversity i
don't actually know about that
um but
it's not like i can just like show up in
a math lab
right like a group of people who are
actually
i mean it's a cool problem it's not i
don't know
um like like like a working group to
kind of
kind of do this with uh
if i wanted this if i wanted to build it
online i probably could
um this is not the platform for it but
again this comes down to my lack of kind
of conscientiousness right
uh if i wanted to build a proper
place where we could get together and
work on this you'd have to make the
barrier to entry really high
um not just sit down and click the
twitch stream button
largely as an excuse so i can talk to
myself
um yeah you have to be working on a phd
i don't want to do this for six years
look i got a month in new york i
actually think
with a group of people like you know a
bunch of let's say three smart people
uh in the right sort of setting for for
a month you know i'd be excited about it
so it would spill over into two
uh we could solve this problem and it
would be kind of fun and it would just
be like something to do and i guess
i mean i wish the world was more like
that
uh do i talk to myself casually yeah but
i don't verbalize
i'm talking myself in my head right
inner monologue
some people say they don't have an inner
model i wonder
i wonder we found the philosophical
zombies
so that's actually step five
and step three is defining a depth first
search procedure and not a breath for a
search procedure
um
which
uh have i thought about recurs center i
i think i
looked into them once and found
my experience with
um that's not exactly true
i don't know my experience with a lot of
those kind of things
is i don't know about recur center
but at least uh like hacker spaces and
stuff
is it's a lot of people doing very
shallow projects
um and then there's people working on
deeper projects but they're kind of
inaccessible for various reasons
and then there's the kind of people who
show up to anything and make the whole
place miserable
um some of them are taken over by those
kind of people
you know the kind of
[Music]
know nothing let's check my private
wikipedia for a definition of that
huh
in a weird way it's kind of it's kind of
apt
but you know you guys know what i mean
um
so all right i guess i guess it's kind
of i guess it's kind of q a time
um we'll do a little q a and then we'll
we'll try to
it solves it solves busy beaver uh three
if we let it run i'm sure it would solve
for but it doesn't do it very
efficiently because we got to code the
zero dextrous check
um
no it's not it's only supposed to
iterate over in minus one and one
um use s-l-i
dot d-o to do q a
let me create an account my first name
is bob
my last name is boberson my email is
bob boberson
uh no my email is geohot plus bobber
gmail.com my password is you know
that and my role is
i work as on internal comms
quick event
if they make you create a slido account
my event is ready okay come join my
slido event
people let's slide oh
oh sweet no one had to oh yes all right
showing q a all right well let's see if
i can create a a
a q a question if i go to slido
and i type in the number
type your question do you like
fish
oh yeah it works oh do you like fish oh
that's a good question i'm gonna upload
that
wait can other people upload it oh all
right i say
all right guys anything inappropriate
ends up on here
we're exiting it out and you know what
it's it's it's uh
you know what i'm gonna minimize this
and i'm gonna trust you guys
to moderate we'll just leave that there
you can find the slido
and i'm going to trust you guys to to
have
sanitized the responses
um and if people say inappropriate
things the stream's over
welcome to you know what's that one
light goes out they all go out
that's not what i'm meant for
there's a word for it
any turing machine is
zero dextrous if there are n
transitions of the form
and all n transitions are of the form
0 r i see
that just seems really easy to implement
what is zdex
um
you know i kind of regret making this a
two-dimensional array i just made it a
one-dimensional array i could have saved
a lot of code
um
okay so first let's check if it's valid
new state uh
good rates
are not equal to stay undefined
tf sub n dot m dot uh
what is that oh no never mind so that's
actually i don't even have to iterate
through the ends
i just check for zero here
uh dot direction not equal to one
right uh if
direction not equal to one rat equals
false break
if not
i think we want the izzy dexterous or
the not is z dexterous
not mm dot is z dex
okay that looks like less um
so that gets us to
two six six one two seven seven three
great it saved us a whole
oh what a junk optimization
um
okay if m is end stateful
and m symbol fall
are the questions sad
i you know the questions are sad
well you know what maybe maybe we'll do
tomorrow's stream and tomorrow scream
stream only subscribers can watch
oh yeah buddy that's what i'm talking
about you know
only subscribers can watch we all think
that doesn't work
yeah yeah that's right
and to build up the subs first no i want
everybody to get a notification
and then like you guys can all be here
for the warm-up song tomorrow and then
after the warm-up song i'm gonna be
subs only
now this one doesn't go on youtube this
this one's the one where i tell you the
real secrets to learning how to program
you just gotta subscribe see i'm lying
to you people
you know a real sad truth about the
world man
people think a lot of people a lot of uh
you'll hear you'll hear uh
you know like like like poor people say
this that kind of stuff like it's a
system man or being oppressed by the
system
and i agree with them um they're being
oppressed by the system they didn't
build the system it's unfair
uh what you realize about like the rich
people and the quote-unquote elites
is they're also being oppressed by the
system now you can
assign them a bit more blame because all
they built the system but they really
didn't
right mullet built the system
they were supposed to do something about
it i agree that they had more
responsibility to do something about it
but they live in the same exact terrible
you know systems that everybody else
does and people think they can change
them but they really can't
uh i don't know
i'm a revolution kind of guy i don't
think you uh
you can't change the system just build a
better system
and like my system is open and inclusive
and everyone wants to come to the new
system and come to a new system
oh look it's too important in the world
man if only i could hit home runs like
babe ruth if only i got luck like that
i mean so that's an it's an interesting
thought that like if we add that one
back in
and may generate
all correct machines
just not run them
right we may still be generating the
machine that executes
for uh
right so i mean an interesting thing to
know here
no that's not true um
we're running it for four we expect this
to give 107.
wow these numbers are getting huge
that's the number of machines we're
currently running so we have to do that
many things
each step
it looks like it's kind of decreasing
though more and more machines are
halting
you know machine learning is this new
scam like you know oh i'm going to learn
i'm going to write an mnist classifier
and then i'm going to get hired as a
machine learning engineer no you're not
it's only it's it's a weird thing about
machine learning that people think this
too
like oh i'm gonna write uh like i'm
gonna follow
nobody would say i'm gonna write the
react demo app
and then i'm gonna be hired as a react
engineer nobody would say that
but yet people think this for machine
learning it's weird
rob enhancing quality you don't want
fancy machine learning you just want
linear regression and uh
cleaned up uh cleanup data
um i mean it's running it's not like at
least
this number uh here represents
the total number of uh machines in the
priority kit
and we could maybe make it faster
overall compute that cardinality every
time
how bad is that big loopies
uh
yeah we could just track that somewhere
it's making bajillions of copies over
and over and over again i guess also the
machines are getting
bigger um all right
is slido nice
um yeah that's that's that's today's
programming
tomorrow we shall finish
zany zoo imp maybe i'll do some off
stream too
um we'll see
all right let's see what we got
why don't i consider mods for the stream
because you guys ask
trash questions explain busy beaver 5
state to newcomers
go back to yesterday's video and watch
the beginning of it where i explain it
i'm not even you know
no no
it's good how much time do i spend daily
working on projects
29 hours bitches that's right this is 29
up folks there stupid question
do i like fish wow this was this was my
submitted question actually yes i had
fish for dinner last night
uh
you know i'm thinking now like what do i
expect these questions to be
this it's my fault it's my fault for not
providing any more structure in the
format
but i'm not good at providing structure
and format that's not the kind of person
i am
again like low conscientiousness
um i don't want latest questions i'm
about to go away
there we go uh
do you watch any of the streams tabs or
spaces
who in chat knows why that's a dumb
question
all right guys i just i want you to
think about what the structure
of of of oh actually yo guys you ever
seen the movie limitless man
you see that movie i should have checked
into my own private wikipedia because
this wikipedia sucks
you heard it nzt48 man oh see nzt48
it's it's real it's real and the way
that i stay motivated is i take it
and if tonight uh you come and meet me
uh you know on the corner of beverly and
wilshire
i'll hook you up with my guy
uh it's hot in new york and my air
conditioner is loud
um ambitious problems no one is focusing
on
see this is
it's not necessary i see that okay so
that's not necessarily a bad question
but that's a question that every single
vc
is asking all right oh man we gotta find
oh we got some new kid man yo i got this
guy bobby
out in a garage in south dakota man
yo yo he's working on giving
wombats the ability to type
wombat typing man like wombat typing
spreads through
spreads through the uh vc circles right
it's not about ambitious problems it's
about boring problems
no one's focusing on boring shit
um you know
but yeah that was so wrong
the joke about wombats and typing is one
that's done your dollar
type no
can you reveal anything that few people
know about comedy ai or you guys want to
know the
you guys want to know the the deep
secrets
uh
my eye has two bathrooms one of them has
a urinal
and there's something in there that kind
of looks like a shower but it's not a
shower
spell you with three letters
uh
why don't you consider mods for the
stream it won't be perfect but it might
help so i made a few people mods
um the problem is who will moderate the
moderators
right who will add new moderators
moderators come and go
uh you know i'm a slacker i don't have a
schedule right
so oh yeah let's put a real schedule
together let's put
effort into this man have you considered
a production
manager you know you could really take
your stream to the next level
oh my gosh
i didn't do any of that man honestly
i want a group of like a bunch of people
where we can all chill
and we can like read the paper
and then we can work on busy beaver 5.
like why am i going to stream this for
you again tomorrow
aside from a few people who caught a
bunch of syntax errors in my programming
it seems like people didn't read the
thing
right i gave you all homework and nobody
did it at least from what i could tell
so i'm actually gonna stream for you
tomorrow i'll work on this stuff myself
you know
and we tried to chill
yeah i don't know y'all got excuses i
don't care okay
don't really believe that girl was
stupid about gollum
go is for people too dumb to program in
c plus plus like me
so many mistakes i mean i should have
written a go i would have made way less
mistakes
um
oh they answered that uh
is it better to be an introvert or an
extrovert
oh what's this mean
what's that word mean yeah we're trying
to optimize for
you know i can't even rationally can't
answer that question i can't answer that
question
um
how's comm ai doing i can read
i probably made a post on linkedin i'm
going to post on linkedin
uh
naively it can't be done um the reason
you can't read faster
is not because you can't see enough
words because you're in a processing
loop can't
process fast enough if you want to
bootstrap that it's going to be some
crazy
complex thing that said
even though i don't get more bandwidth
than using a keyboard and a mouse
moving my fingers is so much effort
neuralink would be sick
i don't know anything about society
you know what's not a good way asking
people what's a good way
right maybe this is why you know what
google is the search engine you all
deserve
you know you all deserve google this is
the kind of
all right you know to be fair i can say
that google
made people talk stupid like this right
but i don't know i don't know i don't
know which way
i don't know which way it went right oh
let's let's google this oh yeah yeah
what is a good way
you know what you deserve news articles
and listicles for this yeah there we go
three ways to internalize what you study
cora what's the best way of
internalizing knowledge
the nine steps that will help you learn
anything ten definitions of learning
google's a search engine you all deserve
man
that's why is 30 a month it's like
subscribing but it costs more money
all right we'll get
you gotta watch watch the beginning of
the previous video for that
uh am i optimistic or pessimistic about
agi the singularity
well look man you wake up tomorrow when
you find out you don't have free will do
you do anything differently
that answers the question um
i don't know man coffee shops
i like coffee shops i don't like that
they're not indoors anymore i like
coffee shops
be right i like this question this is
the first
this is the first good question
i mean it's totally off topic but it's
legitimately a good question right
of the first question here
is is is total trash it's total trash
and this is a good question how smart
can you make a dog right
so so let's answer that um
well all right so first let's go to uh
let's go on my own private wikipedia to
uh neuron number
animals i have a feeling that this
search isn't gonna work oh beautiful
ha ha private private thingy um
okay so a dog has
two billion neurons and humans have
about a hundred a hundred billion
um a hundred billion i think when you go
by synapses it's closer but let's just
say that a
dog is uh is like 40 times
stupider than a human right um
now let's ask a a
somewhat upsetting question which is how
human how many humans are dumber
what what iq makes you dumber than a
gorilla right
um so
if we say that maybe an iq of 40
puts you on par with a gorilla it let's
say for every
let's say for every happening of the
neurons
um you end up with a
say iq yeah every happening of the
neurons
gets you a happening of iq
i mean iq is normally distributed so i'm
not sure if that
exactly is what i'm trying to say maybe
we can just go by number of standard
of standard deviations right
um i mean what i'm trying to do is i'm
trying to map like the standard
deviations of of of a human uh
and i don't know maybe this is a dumb
way of thinking about it
um
it's an interesting project it's an
interesting project you could actually
do it
and then like yeah what does a dog iq
test look like
i mean it's weird to know we shouldn't
we shouldn't go we shouldn't go by iq we
shouldn't really think about it like
that
we do know that from a raw cognitive
perspective
humans have about 40x the horsepower of
a dog
so let's just say that like everything a
human
average human can do things 40 times
faster than the average dog
um like like if you're
breeding the dogs how many st there's
some normal distribution of dog
intelligence right
and some number how many standard
deviations can you get
with breeding that the gwen thing talks
a lot about this
um using different techniques uh
we should try these things and dogs
though
what's a fun project a student to learn
go make smart dogs like that guy
um yeah so i think i think before we can
really answer the question how smart do
you think i can make a dog
we're gonna need some kind of like dog
iq test and to understand
what the mean dog and what the standard
deviation of dogs is
and then to answer that question i would
say that you could probably through
clever breeding
get dogs that are let's say
four standard deviations five standard
deviations above the mean
uh and that would correspond to humans
with an iq of well 15 times
uh 5 is 75 so like 175
iq humans right
obviously you can get a dog that yeah
yeah
uh neurons in the neocortex is probably
better but
bro
i don't know
um i saw i saw
oh i saw an upsetting on hacker news
like this country totally bumbled the
covid crisis if only they
cared more about people's lives right
it's like this please i'm desperate
okay
so
you got a sharp click what did i think
of nim
it's all right we're doing all day in
new york going on dates um
i feel like shkreli in the live streams
now you know sitting in the new york
apartment
this looks like skrelli's apartment
uh why are the questions here so bad i
mean for all the reasons that we talk
about
um well the local is it this i mean this
isn't it's off topic it's not a
really bad question i don't know we use
ekfs
could you do better with uh
with something that understands the
noise models better
i mean common filters are making uh
gaussian assumptions of
the noise they also assume that it's
uncorrelated through time neither which
are true
um but they seem to work well
i don't know
seven feet
i don't know what that is
lower than harvard
all right that was slido that's what we
tried today
i actually think that um
the subs q a from yesterday was better
uh
okay you know what here's what i'm doing
for tomorrow's stream
um if i'm not lazy which
probably won't happen but if it does
happen
uh we're gonna have a test
uh i'll try to throw together a ten
question test to see
did you read the paper um if you read
the paper
uh you're welcome into the stream uh if
you didn't read the paper you're not
welcome into the stream
and we'll have to see how we did it uh
we'll have to see how
but yeah well this is i mean this is
this is okay we can fun we can play with
we can play with these new these new
political systems before we have to
build something as expensive and intense
as the university right now
tomorrow stream for the elite
uh anyone who can pass a 10 question
reading comprehension test on the paper
i'll drop the test all at once
uh i'll have you
put in your twitch username before you
take the test
and i will trust that anyone who's smart
enough to pass it
won't share the answers with everybody
or put it this way the minute i see that
answers are shared
i can cut it off there so be somewhat
fast as well
um yeah read the paper read the paper
boys read the paper all right um
we'll see what if no one passes the test
that's that'd be the real sad thing
right
how many people we got you have 864
viewers right
uh what happened to the search engine uh
honestly
after today i realized that google was
the search engine you all deserved
after reading those questions today i
now no longer believe google is evil
i now believe that the average google
user is just just an idiot
um you guys want listicles you guys want
to search for things just
how can i be
good programmer
oh yes oh and you would love to click on
10 effective ways to be a good
programmer or
eight ways to become a better coder or
how to become a good programmer in
college
wow that applies to me i'm in college
oh how to be a great programmer and how
to become a
very good programmer with a bs how to
become the best programmer in the world
a beginner's guide on how to improve
your programming skills
be a better programmer in six easy steps
google is the search engine you guys
deserve
oh i don't know yesterday we tried
having faith in humanity
uh today we tried not having faith in
humanity and tomorrow we're going to try
building a wall we're going to build a
wall the wall is going to be made of 10
questions
um read the fucking paper
i don't know how i'll set it up
will there be a hidden stream i don't
know
be multiple choice no it'll be graded by
my army of tas
uh make the corona pay for it yeah
should have incorporated a whole bunch
of uh quick scam companies and gotten
those ppp monies
how many people can we yeah i will be
100 to enter no
no i think it'll actually be 50 i think
if you've managed to get
that won't be 50. but it won't be i
think it'll be 80
make it 80 or something
um
this is visual basic for beginners oh
i'm reading the chat on my phone we can
bring it up here
um
yeah but yeah we'll see we'll see we'll
see if i if i do a stream tomorrow it's
definitely not going to be for everybody
um
and you're putting so much work into the
stream
don't say i put in any work until i put
in any work i'm just shit talking about
hypothetical work i might do tomorrow
right
if i actually do any of this i'll be
impressed with myself i'll
pat myself on the back it's probably
because i read
eight ways to be more productive with
the limited time we have on earth
um
the questions will be relatively easy
stuff too about like you study the busy
beaver problem in general
right understand what a turing machine
is in general
uh now the date tomorrow night all day
tonight all right plans tonight
um
is a quad top player what does that mean
uh how do i end up talking to the
homeless one i went for a walk
uh and she started talking and i
responded
uh it was nice it was a rainy night it's
a nice
what time is tomorrow's stream
oh oh you know what i'm going to put a
entry in my calendar
um
all right thank you all for watching
i appreciate those who subscribe i also
appreciate those who
make good comments everybody else
i don't appreciate you
good everybody
Good morning, Twitchies. Good morning,
birds. Good morning, busy buzzy bees.
You know she
dies. Don't be a celebrity.
I get my
phone. Already had my coffee this
morning. I have a bagel. Your boy, what
up?
Oh, sup.
Let's just make sure that's
muted. Yeah, we got I just I just
showered. I know. I
know.
Um, no, I didn't forget the test, boys.
I wrote y'all a test. We're gonna have a
test
today. Uh, we're going to wait for some
people to get in here. And there's no
morning music. No, no, no emo vibe this
morning. Uh,
wait, what? I thought I muted that. Oh,
that's the echo from the old. Wait, no,
that doesn't make
sense. Mute.
Um, maybe we have another
uh
I got the test. I got the test. Um,
first we're going to read a little
story.
Uh, oh well. Yeah. Yeah, that's the
test, but you can't see the test yet.
What's making noise?
Um, what is it? So,
maximizing your slot impact. Yes. Haha.
Yes, we're gonna we're gonna read this.
Uh, this girl was on uh Clubhouse last
night and I thought she was making some
some really good
points. So, you
know, I mean, like it or not. Oh, here
it's this one. I got to close. I'm kind
of in the cam girl
business. Uh, so, you know, I'm I'm
uh What's leaked? Leaked? Oh, yeah. The
first question on the test is are you a
subscriber? Um I hope you all read the
paper. You know
[Music]
um so well let's read this document and
understand how I can be a better cam
girl. If you don't know about Clubhouse,
I can't tell you about Clubhouse. I'm
not joking about the test. I actually
made a fucking test. Um so uh my
credentials, I was a cam girl for 5
years. Uh, my highest earning month was
$50,000 and my highest rank on MFC was
number seven, meaning I earned the
seventh most money that month. My rank
on Twitch is nowhere near number seven
and
um, you know, I'd like to be a more
successful uh, cam girl.
Um, yeah. So maybe we're going to
institute some of these things around
the
uh if you're uncertain on whether you
want a cam, you know, there's a lot of
flexibility in how you do it. You can
set whatever limits you want. The
highest earning cam girl in MFC at one
point earning over a million a year was
a non-nude model. So all right, we're
going to we're going to put we're going
to put nudity uh off the
table.
Um estimating my earning potential. Uh
well, we're not going to go I don't
think the beauty scale applies here. Um
am I beautiful? But yeah, I I I think uh
none of this applies if you appear male.
If you appear male, uh God help you.
Um so which cam category to choose? Uh
token sites or private sites? Um so I
checked out Bonga. Bonga looks like a
token site. remember how popular Bonga
Cams was. Uh so by the way, I really do
appreciate all you subscribers. Thank
you all for for contributing to my you
are good people. Uh I want to give you
validation and attention, which is what
I learned that I have to give from this
document.
Um so this is uh the ones that have the
best rate typically take 50% of what's
given to you. So, Twitch bits, Twitch
take
uh I mean the bits are effectively
tokens.
Uh oh, I'm going to apply for
partnership. I'm working toward
partnership because I live in New York
now and I'm taking streaming very
seriously. The test is coming. We got to
Everyone only gets 10 minutes for the
test. So, you know, I can't release the
test early, right?
Um, there is a test. Yes, there is going
to be a test. I made a test. Yes.
Um, we got to figure out how many like
bits. Uh, wow. Wait, it's only
29%. Oh, that's pretty good. That's a
lot better than CAM websites. Oh, I can
negotiate a better split. All right,
that's good to know. Um, so which cam
site to chose? So, I've chosen uh
Twitch. I'm not on Spank
Chain. Uh what am I going to do with
people who don't pass the test? So,
you're just going to have to tune in and
find out.
Um there's a test. I promise you there's
a test.
Uh what to buy. Um so, yeah, nearly
every cam girl I've seen has used
Logitech webcams. Uh, I'm using the
camera built into my MacBook. So,
hopefully I'm going to take some of my
Twitch money, which I'm not allowed to
show you, and I'm going to purchase a
Logitech
uh
C920. Usually, I use an external
microphone. I know you guys really just
watch the stream for the nice tapping on
the
keyboards. Uh, all right. Good quality
camera. All right. Good, good, good. I'm
glad we're happy. I mean, look, half my
stream is my screen anyway, so I don't
think this applies to me as much as as a
cam girl. Okay. setting up your
emporium. Uh, so ideally, you want a
good deal of space between you and the
wall behind me. I think I think this is
pretty good. We have some
light. Yeah, some girls had
DSLRs. Uh, which is great if you can do
it, but you know, I'm poor. So, there's
that. I'm not really poor though.
Actually, I got to tell you guys that
I'm not poor for later. The test is
coming. What? Violation of the toos for
that? Come on.
It's a It's a constructive image. It's
an educational image. I'm not gonna get
banned for that. If Twitch bans me for
that, come on. I've seen Elinity dressed
like that. Elinity is not banned. Um,
this is a
violation. What do you
mean? That's on like That's on like
ABC. What? No. No. That's ridiculous.
That's
ridiculous. Um, you're going to have to
provide your real name, social security
number, and photo of an ID. I've already
done all of that. That's
okay. Um, choosing a name. You want an
accessible, feminine, nonsexualized
name. My name was my name and how I got
the name accidentally, Ella. Uh, so my
name is George Hots. I think that's a
good choice. Um, experiment with the way
you prevent present yourself. In general
though, I found that no matter how much
high-end super lace lingerie and red
lipstick I've put on, the thing that
gets the best reaction is a good old
thin tight t-shirt with no bra. Anything
that emphasizes your sexy curves to the
max is ideal. And anything that makes
you look effortless. Yeah, look, I'm
effortless, man. The girl next door look
is probably the most popular. I just
rolled out of bed looking like this. No,
I showered this morning. Uh, no. No bra.
Going balless. Can you translate your
last verse? I don't speak
Walrus.
Um, your first days are going to suck
ass. Yeah. Well, so I'm already past my
first days. I'm actually a famous Twitch
streamer. Uh, I was just looking. I got
like like 30 something thousand
subscribers, bros. I'm I'm famous. So,
don't be famous, though, you know? But
be kind of like like is Ella famous?
Ella is the amount of famous I want to
be. She's making 50k a month on that cam
girlish. You know, that's that's kind of
where I want to be, right? If I could be
making 50k a month streaming on Twitch.
Yeah. I tell you about Clubhouse. I'm
not joking about the uh I can uh I can
you know Wait,
what? Sorry. I'm trying to figure out
how to No,
this How do I see how many people are
watching my streamy? We'll just refresh
your sexy
Yeah, 50K a month,
man. All right, we got we're up to 339.
Once we get to 500, we'll uh we'll do
the
test.
Um the largest streamer in this
category has 15K plus viewers doing more
simple things. So, there's a lot of room
for growth. Yeah, we're going to learn
about some growth techniques in
here. Um 439 right now. When we get past
500, we'll we'll do the test. All right.
You'll dance around a little bit. Put
the camera at flattering angles. Play
nice music. Oh shit. And light candles.
We need candles. All right. Before
logging on, watch other camera girls on
the site. This is probably good
advice. I should watch other Twitch
streamers.
Um, no date last night. I got a date
tonight.
Um, but basically you want to make
friends with girls who are willing to
promote you or retweet here or link to
your n. This is all cam girl networking.
Yeah, that's a good that's a good idea.
All right.
Um, I should write down a list of things
that I can do that are visually
appealing. That's a good point. That's
why you guys like Twitch slam. It was
visually appealing. It's clean. I just
washed it. Um, it's wet.
Uh, you need to be constantly
interesting. Okay, I try. Um, when I
started, my go-to time filler was
putting on absurdly epic music and
dancing
hyperdramatically or getting very drunk
and naked and trying to make mac and
cheese. All right, these are good ideas.
These are good ideas, boys.
Um,
uh, to girlfriend or not to girlfriend.
You guys might want emotional support
off cam, but I'm not a girlfriend. I
ignore my members off cam. My workday
ends when I turn off the camera. This
will be great for my mental health, but
I won't catch any hyper loyal whales.
What? These are great suggestions. These
are great suggestions. Wow, we're really
getting people in here. Come on. Welcome
to the stream. We're past 500. Woo.
junk mac and cheese stream. Yeah, some
content ideas. I know you all liked
cooking. Um, off-site content and social
media. No, I refuse to use this. By the
way, y'all better follow me on
Instagram. Um, when I, you know, you
know how I met these girls that I'm
going on dates with the DMs, boys. And I
go on I get better uh dates if I have
more followers because when I DM
Instagram girls, they're like, "Damn,
this guy's got a lot of followers. He
must be famous,
right?
Um, all right. All right. All right.
Let's Let's off-site content and social
media. Yeah. Yeah. Yeah. Yeah. Yeah. No.
Okay. Yeah. This is This is where it got
interesting.
Um, but once you have the viewers, I
have the viewers. I'm exiting the fetus
stage into Okay. Now, I want to pay my
rent. So, my rent for this place is
about I'm paying
about four grand.
Um,
so right now my I'm making about $100 a
stream on Twitch. So I need to increase
my revenue if I want to pay my rent
using my uh using my my my Twitch. How
do I reconcile using Instagram as a
Facebook product and ran took social
security?
Uh, okay. This revolves around
countdowns. your bread and fucking
butter. Countdowns are where you set an
amount of tokens as a goal. By the way,
could we give a shout out to the person
yesterday who bought people
subscriptions? You are a whale and I
like you. Do we remember who that was?
We should give them We should shout out
their username. Understand that I know
you. I'm paying attention to you. Um, I
bought a van. I bought a van with an
energy drink in each hand tentatively
yelling thought plans.
Uh, all right. Most tipbased cam sites
have their countdowns automated. I don't
know how to do countdowns, but Oh, yeah.
These people. Sir John Dukitch, thank
you for giving me your five bits, but
come on. Someone else can be number one.
Come on. Can anyone got some bits? CJ
Slider 14, thank you for subscribing.
We're having coffee
today. Um, yeah, actually was bottom
five in my class. It's true. Um, that
gifted subs, dude from John. John's the
man. Um, all right. So, no, we we really
do. We really appreciate people like
that. Uh, Neil's Web, thank you for
subscribing. We got a hype train. Woo.
All right. Am I being a good cam girl?
Um, download Streamlabs OBS so you can
set subscriber alerts. Oh, this is a
good point. Oh, yeah. Yeah. We got to
cheer for the subscribers. We got We got
to make people feel uh
validated. Um Robin Ducket, no way. No
way. You about to be number one. Yeah,
we got a hype train up in here. All
right. Um Whoa. A count. No, we don't
have any count. Oh, that's kind of what
hype trains are. Um you have to do a
final countdown. This is the countdown
to your ultimate goal. Basically,
whatever the craziest or sexiest thing
I'm planning on doing that night. I'm
not going to masturbate, but you know,
I'm non-nude, so I can do things like
play an instrument or cover my face in
whipped cream. These are good. These are
good content
suggestions. Whoa, whoa, whoa, whoa,
whoa. We're not doing that. Whoa, whoa,
whoa. I don't do things like that. Whoa.
Who are these men and what do they want?
And I was thinking like, really, how
much does this apply to you guys?
There's different types obviously, but
the most common tipper is a single,
divorced, unhappily married man in his
40s and 50s who is too depressed,
anxious, unattractive to be able to get
any affection from women in real
life. Um. Ah, yes. You see, you're not
just trying to get a guy to pay you.
You're trying to get a guy to pay you in
front of a bunch of other guys. This is
super key. A man wants to feel attention
from an attractive woman on him. And
this is made even more satisfying when
it's to the exclusion of those around
him. He is showing off his power by
buying your happiness. So, when tipped,
make sure you say his name or username.
A lot of girls use subtly masculine
competition language when referring to
high tippers. Woo! Blendsism. Light of
hell. Thank you for subscribing. You
guys are great. Nate PH, you should feel
attacked. You should subscribe. You
know, you could subscribe. Come
on.
Um, no. I swear I made the test. The
test is coming. The test is coming. You
got to You got to We're going to have a
countdown to the test. Let's see if we
can get this hype train all the way up.
We get the hype train all the way up. As
soon as we're at max level hype train is
when I release the
test. Um, so we're at level two right
now. Let's Let's keep this hype train
going. This is a countdown. Um, if I
played the final countdown, I'm going to
get muted, so we're not going to do
that. Go, go. Yeah, when you subscribe
but don't get a shout out. Anrose style,
thank you for
subscribing. Um, antagonism toward you.
I recommend if you have the money to
spare, go find a low earning camera girl
and tip her an amount you think will
make her happy. So, I'm going to go find
a programming stream on Twitch and I'm
going to subscribe to them and I'm going
to pay attention to how that feels
because if if I really want to
understand Yeah. level three, level
three, come on. Subscribe. Subscribe.
Subscribe. Um, I mean, this is this is a
fair point. I don't think women easily
empathize with the life of unattractive
men. Women get constant messages that
you are beautiful and you are desirable.
They get social support, easily
accessible casual sex if they ever
wanted it. Men do not live in a world
where people are supporting them. Uh
where people are supporting them even
when no one seems to want them. Men are
lonelier and have fewer options of
healing that
loneliness. Um I mean this goes into
pretty good stuff. So you know I'm
supposed to work to make subscribers uh
earn approval. Um so now you're
constantly earning $30 an hour. So, I'm
earning about $30 an hour. That's great.
But how do I rise up? How do I actually
get tips? You probably know about
whales. Whales are the rare, wonderful
person who comes along and gives you a
significant chunk of your
income. How do you get whales? A lot of
it is high variance. A tiny fraction of
the cam watching population is made out
of very rich men. So, you may get one
passing through your cam room once a
week without you even knowing. I bet
some of you guys like founded startups,
sold them for a ton of money, and now
you're super
rich.
Um, I also need games and I have to be
the girl they want to
tip. Uh, I have to make you all forget
it's about money and I definitely don't
talk about other boys in my life. It's a
good point. Uh, I got to do personal
branding. I got to deal with the
emotional
burden and I'm not worried about
security and I pay my taxes, boys. So,
in conclusion, be hot. Don't expect to
be too hot. Chill out. Don't look like
you're trying too hard, but really try
as hard as you can. Look rich. Be
accessible. Don't beg or be sad. Create
tension and competition. Be kind and
address emotional needs. Also, use
emotional needs for financial gain, but
also be kind. Work your stuff like a
business. Prepare for stress so much
that you aren't stressed. Maybe be a
bitch, but probably only a little bit.
And like have fun and stuff. This can be
a super fun and rewarding job if you
approach it with a spirit of
playfulness.
Okay, let's go. Who's ready for the
test? You all got 10 minutes? I'm going
to post the link. You have 10 minutes to
do the test. Y'all ready?
Send
uh
so uh all answers are multiple choice or
whole numbers. You all ready? 3 2 1
minute starts
now. The subscriber question. Don't
worry, it doesn't it doesn't count for
anything. There's no wrong answer.
There's only a right answer. Um which is
the truth. And if I find out you lied,
you're banned for life. So, don't lie.
Uh, at you all have 10 minutes for the
test. We're going to see the responses
start to come in. Um, I think 10 minutes
should be enough. It's not too hard of a
test. Uh, if we don't have enough
responses, we'll extend it to 15 and
then we'll go through the uh answers.
Uh, the link is right there. Please,
please share the link. Linky, linky,
linky, linky, lanky.
Um, yeah. So, cam girls tend to drink a
lot. My friend told me once she used to
get on cam, black out, and wake up every
morning with $1,000. Well, we're not
going to do that. That's right. We're
We're all about Christian channel. Um,
yeah. Who didn't read the fucking paper?
You
know, why not? What excuse do you have
today? Oh, what is Ravens? Oh, I don't
know. Uh, by the way, do not share
answers in chat. Share answers in chat
equal
ban. Y'all thought I didn't make a test.
We got three responses already.
Wow.
Um, if you get your username wrong, I
don't know what to tell you.
Uh yeah, I'll share the link one more
time. Shorten
URL. Uh level two hype train. It's not
hard. They're easy
questions. Oh, have a little tea.
No. Well, yes, you should be a
subscriber, but if I found out you lied,
I'm going to cross reference it. Um, do
my test. Do my
test. I read this shit and the test
looked like it's in Spanish. Did you
read the paper?
You all have you all have eight more
minutes. Wow, this program got
long. Yeah, you were supposed to read
the paper so you could pass the
test. Bernardo Fire, thank you for
subscribing. I appreciate
you. Um maybe while we waste time, maybe
while you know you guys focus on the
test, mute my channel. Um but in the
meantime, we can respond to a couple of
comments.
Uh is it really that hard for you to
understand that some people idolize you
and value your opinion? Yes. Stop. Stop
idolizing people. Idolize ideas. Stop
valuing my opinion. Start valuing truth.
Um, you start lecturing people and
asking holier than now when there's only
one really you to blame since you knew
the outcome, but you expected something
else to
happen.
Um, George knows how to manipulate his
fans. Do you know how? He is very good
at programming and saying things like
crypto for society, Google is evil,
decentralized internet and that is all
you need to get from teenager. I feel
like I've read a big homie comment on
stream
before and see I find it interesting
that we have George knows how to
manipulate his fans and man George is
absolutely the worst advocate for his
ideas. If you can't even communicate and
persuade your fans into seeing the world
the way you do, then God help you in
your future endeavors. See, you're all
trying to think that I'm You're also
think, you know, you think like, oh man,
you know, I watch a Charmin toilet paper
commercial and they're trying to
persuade me to buy Charmin toilet paper.
I don't care if you buy Charmin toilet
paper. to be
honest is a Donald Trump quote where
it's like, you know, I never really
cared about the money. It was just a
nice way to keep score. And that's kind
of how I feel about Twitch and
subscribers, right? I don't need your
money, but it's a nice way to keep
score. I do like winning and I like
being better than other people. But the
moral of the story is I'm not trying to
shill you on anything, man. I would much
prefer somebody who says I think crypto
is stupid. Google is actually on
balanced pretty good. The decentralized
internet is always going to be shittier
than the centralized internet. If
somebody holds those opinions and
advocates them intelligently, I like
that person a whole lot better than
someone who goes around, "Yeah, Google
is evil. Yeah, chant my stupid slogan,
you know, taste the
rainbow." And you know, slogan chanting
losers. All right, we got five minutes
left on the test. How y'all doing? We
doing good.
Um, what if we don't what to write if we
don't
know?
Um, no. Honestly, like like there's a
correct contrarian corner. I'm not
trying to convince you to be in the
correct contrarian corner. I'm trying to
convince you to like, you
know, I don't know. Subscribe to my
channel. Uh, yo, sneakerbot. Should we
make a sneaker bot? Everyone say this is
educational, but no one tells me what
the fuck he's doing. Will there be
accommodations for the dyslexic for the
test? Let me tell
you. You know who's really testing you?
You know who the war is against? The war
is not against Google. The war is not
against centralization, capitalism,
communism, whatever, whatever. The war
is against
nature. If you're out trying to
hunt, what are those things, man? You
know those like like pig things? Boar.
If you're out trying to hunt a boar and
you ask, "Will there be accommodations
for the dyslexic for the boar hunt?"
That's the same answer that you get for
the test. I'm glad you appreciate the
song. Can you please start teach me how
to start ethical hacking courses? I
would rather unethical hacking than
ethical hacking, but I think both of
them is a stupid false dichotomy.
Hacking is a skill. It doesn't have
anything to do with ethics. Um, oh, this
is only teaching you ethical hacking.
You only get the Corona virus if you go
to a protest against the Corona virus,
not a protest for socially progressive
causes. That's right.
Um, yeah. I mean, everyone would benefit
from that, but that's all a lot of work.
All right, cool. Uh, how we doing? How
we doing, boys? 41 responses. We got We
got We got three minutes. How are people
doing?
Can you pass the class without today's
homework?
No. What's RMS? What did RMS say about
hacking? All right, we'll post the test
link once more. Maybe we'll give people
15 minutes since I know there's 665
people in this channel and we only got
uh 48 responses.
Yeah, it's a hiring strategy, right?
You're gonna get you're gonna get you're
gonna get you're gonna get DM spam on
Twitch trying to get you to uh what did
Stormman say about
hacking? Yeah, I mean he's
right. Hackers had typically little
respect for silly rules, so they look
for ways
around. Oh my
god, didn't even try the test. 90% of
viewers, you guys are all bots. Do the
bumps subscribe and give me
money. One minute
remaining. No, I don't know. Maybe we
won't give any extended time.
62. You would participate, but I haven't
been on the stream for a while. You
don't have to subscribe for the test.
Subscribers is totally separate from the
test. Um, but you guys are going to get
I think I'm going to make everyone who
does well enough on the tests VIPs on
the Twitch channel.
What's the bell distribution of your
audience regarding skill set? So, I
didn't actually write the thing to grade
this test. We're going to do it
online.
Um, yeah, the Ravens questions are some
like IQ 101 shit. Okay. You didn't do
the homework. Yeah, thank
you.
Um, okay. All right. One minute. One
minute, boys. Let's go. Let's go.
You gave up on the taring part cuz you
didn't read the
paper. Oh, you didn't put your real
username. No. All right. All right. All
right. You're late. You just started.
All right. Five more minutes. Everyone,
we got five more minutes for the
test. Pigeons don't fly far.
You time out.
Um, so I was thinking about uh I was
thinking
about writing a bot which is going to
time out everybody. I don't think you
get to talk in this stream if uh you
didn't do well on the test. You didn't
know there'd be a test. Well, you didn't
watch yesterday's stream now, did
you? Someone linked the paper. Oh, yeah.
Yeah. Now you're like, "Oh, where's the
paper? Oh, can I borrow the book, man?
Come on. Can I borrow a copy of the
book?"
Um, imagine not
watch you watch a number file video on
busy beaver. If you watched a number
file video, it might be enough to pass
this test. None of the questions are
like particularly
hard.
Um, they're all kind of
just Can you submit one more than one
response? Uh yeah, I don't see why not.
Um if if you want to resubmit, you can
submit another response. I will grade
only your worst
one. Uh that timeout is actually good.
Yeah. Right. Um let's see. Uh
Twitchbot for
timeout. Um coding. Are we gonna spend
this whole stream coding a Twitch bot to
try to ban all the the the
peoples?
Nightbot.tv. Can this do what I want?
I I I looked a
bit
giveaways, timers, regulars.
Ah, see are there any more
features I mean I I really want I really
want some way to to show
uh Yeah, you put your name as George
Hotzman or ban myself. Yeah. Yeah,
you're
funny. Check
faucot. I mean, I want something where I
can just have a white list of who's
allowed to chat.
Uh, regular
[Music]
expressions. Who's
she? Wow. Does she have a nice
schedule? Oh, she played The Last of Us,
too. I heard terrible
things. Oh, she's a streamer from Canada
living in
California. Uh, wait, no, I got
distracted. Sorry.
Um, getting started. Yeah, check out J.
Yo, have you guys been have you guys
been
uh you guys you guys uh follow me on
Instagram? Make sure you follow
me. Oh my god, a lot of people have been
reaching out for for spam.
Um, all right. You got two more minutes
on the test. You're not going to get any
new time. Not going to get any more
time. We got 109 responses. This is
great. Uh, can you stay in chat if you
follow me on Instagram? So, I'm not
going to kick. Everyone can watch the
stream. It's just, you know, if you're
uh you do well on the test, you get the
privilege of talking.
Um, how did I do what with constant
distractions? How did I write this test?
It took only 10 minutes,
guys. 109 responses. No, if you didn't
fill out the test, you're also banned.
You can't You didn't get out of it by,
oh, I didn't hand in my testing,
therefore you can't give me a bad grade.
No, you get a
zero.
Um, you just joined. Where's the test?
If you just joined, you missed the test.
I'm sorry. Uh, all right. Is there a
there's a nice way to like close
responses?
[Music]
Um, oh, make this a
quiz.
Oh. Oh, shuffle question order. Oh, that
might have been
smart. Uh, no. I think I couldn't do
that. Uh, see summary charts and text
responses. I don't know how to close
responses. How do I do
that? Google forms. Close responses. I'm
not good at this. Oh, yes. Open a form
in Google Forms. At the top, click
responses. Oh, we're not going to click
that yet. Okay, guys. Okay. Thank you
all. Thank you all. We got some All
right, cool.
The form is no longer accepting
responses. Are you a current subscriber?
No. Yes. Answer to Ravens one. All
right. Good. Ask the audience. The
answer is seven. That's true. Um, so we
can go to the test and we can look at
why it's seven. Uh, so does everyone see
why it's
seven? And put this here. And I'll put
this
H. I'm going to make me smaller. Hang
on. Let me just make sure I didn't do
this terribly. That's fine. Okay, cool.
Um, and let me get let me bring up the
chat on
here. So hard to use.
[Music]
One of these days I'll figure out how to
use technology, you
know. My channel. Oh, there we go. My
channel. No videos live. Oh, here we go.
Okay. Um, so seven is the right answer
here. One of these days I'll figure out
how to use technology, you know.
Uh, for you people who didn't say seven,
I I don't know. We got a bunch of ones.
Why do you think it's one? Why? You
think it matches this one and two? You
think it matches this one? Look, they're
moving. The diamonds are moving. Right.
Quick question. How many diamonds are
there in this uh thing? I thought about
asking that, but then, you know, it's
kind of a trick question because there's
really four on each and there's eight
and eight. So, you know, 8 + 8 is 16 * 4
is 64. But n Okay, that was too much.
Okay, this one it seems like more people
got wrong. The correct answer of course
is five. And it's five because you can
look at the bottom row and see that
there's liny like this, liny like this,
liney like this, liny like this, and
then actually just linies like that.
Plus the fact that there's uh three
hollowos,
threearis, and three uh uh
solids. Um already tells you the answer
is five. It seems like we also got an
answer of three. Honestly, you know
what? just just from this like this is
some some bad neural network shit. Like
you could see how a dumb neural network
would answer three and that's apparently
what 10 of you uh responded. Okay. Um so
what does the Python code do? Uh I'm
sure yeah 39 is the right answer. Uh so
if you actually want to run that um
there's a few subtle tricks to
it. Uh so I think some people didn't get
the Echo 2 to work. Uh, and that's why
we have a bunch that are Oh, it's just
one
higher. I guess that's because OS didn't
run on your system. So, if you just try
to type it into Python, it doesn't work.
But you have to import math and then you
don't have np. So, you know, this is a
question. Have you done any scientific
computing? Import numpy as np. And now
you're missing OS. So, import OS. And
then that's the troll you if you were on
Windows. OS system echo 2 does not
return two. It returns zero. Uh, it
should return zero. I believe we can
check that. Uh yeah, it returns zero
because the echo succeeded, right? Dimp,
thank you for uh gifting Thank you for
gifting a sub. You're cool.
Um okay. What is the derivative of 3x^2
+ x? Uh most people got it right. Wait,
actually only 38.6% of people got the
Python question right. You just
literally had to copy and paste that one
into
Python. You know, you see like this is
not a hard
test. It's not 39. No, the answer is uh
that
12289. Uh I just wrote some some dumb
you had to copy and paste it into Python
and figure out three import
statements.
Um okay. What is the derivative of 3x^2
+ x? Uh, again, how did only 70% of
people get this one right? A 3x^2. So,
you take the two, you put it down. 6x.
What's the d of x? It's 1. It's 6x +
one, right? Or, you know, if you're
like, oh, I have no idea. I just go to
wolf ram
alpha,
right? And I say derivative of probably
don't even have to spell it right. We'll
see if I have to spell it right.
Look, I don't even have to spell it
right. Here we go. Wolf Ram Alpha gave
me the answer. You guys telling me you
couldn't do that? No, it's not cheating.
Did I give any rules for the test? Are
you guys hackers or
not? It's not cheating, man. It's called
using fucking
[Laughter]
Google. All right. Um, if it takes 10
dogs 10 years to make 10 castles, how
many years does it take a 100 dogs to
make a 100 castles? Um, so I'm glad to
see that 65% of you did get the right
answer here. The answer is obviously not
100 years. 100 years is a stupid answer,
right? 10 dogs make 10 castles in 10
years. I can parallelize that times 10
uh and I can get, of course, 10. How
many steps does it take for Turing one
to halt? Okay, let's go look at turing
one here. Um, okay. Less people got this
one correct, but four people
did. Um, how many steps does it take to
halt? Well, so you're here. The first
thing on the tape is going to be a zero.
So, you move to the right and you move
into state here. The next thing on the
tape is also going to be a zero. Move
into state here. Next thing is going to
be here. And the next thing is going to
be here. So, that's one step, two steps,
three steps, four steps. So, this is the
correct answer for how many ones does it
write to the tape? also four. Uh, this
writes a one to the tape. One to the
tape. One to the tape. One to the tape.
Okay, good to see that 20 people got
that one correct. Um, turning two might
be an answer for busy beaver for what
end states? So, how many states are
there in turning machine
2? Um, in turning machine 2, you'll find
there's A, B, C, D, and Z. Z is the
halting state. The holding state doesn't
count. So, there are four states. The
answer is four. So if anyone guessed
four for everything, they probably did
pretty well. Except the answer to this
one was not four. Uh how many symbols is
it? Well, it has a zero, a one, and a
two. We talked about this briefly in
yesterday's stream where we said how
many things are going out. Um so we have
uh three is the right answer here. Two
is not the right answer here.
um what is believed to be the largest
number of ones written to the tape after
uh running a touring machine with five
states and two symbols on a blank tape.
So another way to ask this question is
what is busy beaver five? What's the
actual number? The definition of what
we've been
discussing
4,98 is the correct answer and 16 people
got that
right. I'm surprised that literally the
whole point of the stream busy beaver
five, this is actually the one the least
people got right at 16. What's the y
intercept of the line
um y - 5 = x + 3. You add five to both
sides of that. You get y = x + 8. y mx
plus b. B is the y intercept 8. 64
people got that right. Um the paper
defines K halting uh what K is believed
to be for true busy beavers and the
answer is
one. Okay guys, that was the test. Now
let's see
uh how you all did when we grade
it. All right. Inappropriate.
inappropriate.
Deleted.
Okay.
Um, so now we're going to watch me
struggle to use
spreadsheets. All right. So, we want to
say
if I think there is a way to grade
it. All right. You know
what? Yeah. You know what? No, no, no,
no usernames. People are too
inappropriate with
them.
Um, okay. So the answer to the first one
is
equals
equals D
uh
this equals
D3= 7
error formula parse error. Okay. Uh
Google Sheets
compare. Yeah, we're coding in Excel
now. I I
know. Oh, it's just single
equals. We could also export
this.
Um, let's find someone who did pretty
well. A lot of 69s,
man.
Okay. Wait, why is that false?
Oh, okay.
Cool. Uh,
okay. So, this is E3 equals 5. Who got
the correct answer for this
one?
Um, and then here we're just going to
say sum
What? What? I can't
sum.
Um, some true false Google
Sheets count if with boolean
values. Oh.
Okay,
cool. Good. Good.
Good. Uh, we need some more columns. How
do I insert column? Oh, this is taking
forever. All right. Um, what's the
answer to the next one? The answer to
the next one
uh is what does the Python code
return? Okay. Uh the answer to the next
one is 6x + 1.
All right, the answer to the next
one was
10. Okay, I need to have better See, I
wish I need We need like admins to like
Oh, you know what? I need some TAs, man.
Who wants to be a TA? Well, we're going
to figure out who the good people are
very shortly. And everyone else is going
to be banned from Twitch. Um, not
banned, but you know, just not permitted
to speak. Uh, how many steps does it
take for ting one to halt? I believe the
answer was
four. How many ones did it write to the
tape? The answer is also four. Uh, for
touring two might be an answer to Busy
Beaver. For what uh number? The answer
there was four. The answer here was
three.
Um, all the other
questions. All right. Whoa. This this
person did well for the most part.
Yo, I'm on stream.
This is not a good time. I gave him I
gave him a test.
What test? Oh, I gave the Twitchies a
test. I wrote a 10 question test. Wait,
that's amazing. Wait, what kind of test?
Testing for what? Do Do you need
something or No, I just I just saw that
you looked at my LinkedIn, but you
didn't connect with me and I was
laughing and I just wanted to say hi.
Oh, yeah. No, it was it was a misclick.
It was a mouse slip, you know.
Um, wait, what? I just got a call from
Cliffside Park, New Jersey. No, I'm
grading their test. I gave the Twitchie
I gave the Twitchies a 10 question test
because I'm sick of all the ignorance in
my chat.
And only people who pass with the
sufficient amount can stay in the chat.
Yeah, I think I might give a 10point
bonus if you're a subscriber. What do
you think? Should we pay? I think I
think you should be able to buy your way
in. Why is Cliffside Park calling
me? Um, you can't totally buy your way
in though. We got to have standards.
We're not like
Harvard. All right. My FaceTime's
broken. The video will improve
automatically when the connection
improves. Hi. Yeah, I don't know what
happened to my It's all It's glitchy.
I'll talk I'll talk in a bit after my
stream.
Byebye. All
right. Um, sorry, I had to take a I had
to take a phone
call.
Uh, all right. Wait, we got we got
insert one right. Uh, insert one right.
Okay. 1 2 3 4 5 6 7 8 9. So, this one's
three. Oh, wow. This had this test had
more questions than I thought. Um, the
answer to this one is
498. The answer to this one is 8. And
the answer to this one is one.
Okay,
cool. We have
scores. Uh, now we just want to take
this whole thing. We want to sort by
that
column. This is
junk. Uh, sort
sheet. Z to A. That's not
right. Google sheet. Sort by
column. Click data. Sort not by column.
M. Sort range. Sort by column P Z to
A. All
right. Uh All right. So, passing grades
are a seven and above. So, literally 12
people
passed.
Um shit. Should we really make the
passing grade a six?
Maybe we'll even make it a six. That's
That's pretty pathetic. And we're
lowering our standards. You know what?
If a six is okay if you're a
subscriber. All right. Well, we're going
to look at these people anyway. If you
got a 50, you clearly failed. Uh no, no,
no. That's too dark. Yeah, it's a good
color. Um if you got a 50 or below, you
clearly failed. So, you don't get any
attention. You just get deleted.
cannot delete a row with form questions.
Consider hiding it instead. Hide.
Bye-bye. Um, we don't want this dividey
line here because there shouldn't be
divisions. Well, actually, this guy is
the total champion. Who's the total
champion? B1 Reington is the total
champion. Congratulations. You got a 10
and you did it in the fastest time.
Uh, is B1 Reenington in the chat right
now? B1 Renington is our number one
winner. We also got one out of 10 from
Asero KSC. Congratulations. You guys are
winners. Um, really coming in at
absolutely the last minute there, but we
love to have you. We love to have
winners. Uh, we love to have people who
get attent. But these people are even
better than subscribers because they
have skills. Uh, so of the people who
got things wrong, what did they get
wrong? Ravens one is an odd one to get
wrong and then get everything else
right. Uh, but yeah, so uh these are the
people who will be allowed to speak in
my Twitch
channel. Um, what do they win? Let's
see. Oh, like I'm not good enough with
Twitch. Um, but if someone's buying subs
for people, the the people who got who
really these these people here, the
people who got at least a B on the test,
uh, Will CM0000, a belt Fierra, um,
actually these three, Will CM, Asheroth,
and B1 Reington, if some people could
buy them scrub, uh, subs, they're
they're really good people, and I will I
will VIP them. Um, let's let's Yeah. Uh,
how do I do this?
friends. No, I don't know. I don't know
how to use this
stuff. Um, you will get VIP. I will as
soon as I figure out how to use Twitch.
Uh if you got
um if you got okay so VIP for 8 80% plus
or 70% plus if you are
sub
perfect uh oh VIP Nick oh great great
great yeah good point um P1 readington
congratulations you're a VIP Ash Hero
Rock VIP. It's still legal to
discriminate against dumb people.
Um
VIP
Mayfield
VIP will
cm
VIP
VIP. Uh, and then of the
70s we have one subscriber on here.
Should we really do that? Yeah. You know
what? You're Well, let's make sure you
actually are a
subscriber.
Um, nope. We didn't ask any questions
about your race, gender, or your sexual
orientation. This channel is a
meritocracy who's very incredibly
fair. Um, yeah. Oh, well, let's check if
a belleier is actually a subscriber.
Profile doesn't work.
User subbed for one month following
since an hour ago. Yeah, we'll take it.
Congrats. You're a
VIP.
Uh, already a VIP of this channel. Oh,
you submitted twice. Even better. You
make my decision even easier. You fixed
one of your wrong answers. Which wrong
answer did you fix? Oh, your raven's
going. All right,
cool. Um, give you VIP. Where are you on
this
list?
Uh, no. You're not a subscriber and you
got a 70. Um, Vassel, you're close. And
there will be plenty more opportunities.
There will be plenty more opportunities
uh for you guys to do well on tests. Uh,
wait. Uh, Kag, I didn't VIP you. Oh, I'm
sorry. I missed you. Already a VIP.
You're
good. Oh, you spelled your name
wrong.
Oh, I don't
know. Uh, I don't
know. All right, chat. What do we think?
What do we
think? Wrong
name. You were in a rush. All right. All
right. Fair point. You're a VIP.
Congratulations. No. Come on. I'm
banning. No. No. It wouldn't be a ban.
Um, okay
guys. I thank you all for taking my
test. Um, I hope you enjoyed. Who gets
unviped? Oh, I unvip fake KAG urine.
Good
point. It's not a spelling test. That's
true. Cool. Uh, so you guys know who you
should listen to. Everybody who has a
VIP token next to their name is
authoritative. And let me tell you
something about being a VIP. You can't
buy being a VIP. Uh, it can it can help
you a little bit if you're already a
subscriber when you take the test. You
can't take the test and then be like,
"But now I'm going to buy subscriber
points because you're not doing it out
of true love. You're doing it with the
expectation of gain."
Um, can I share a link to the test?
Yeah, we can. We can reopen the test.
Anyone who wants to take the test can
take the test. Uh, because it's already
been graded and it's over. Um, actually,
let me just fork
this. Uh, make a
copy. Cool.
Uh, will future tests require you to
follow the contents of the stream?
Yes.
Okay. Uh, link the test. Can someone
else link the test?
How to be VIP. You're a subscriber. That
doesn't get you VIP. You get VIP if you
do well on the tests. Um, and there will
be more tests. This will not be your
only
opportunity. It's not going to be
a There isn't actually a real way to do
uh VIP only uh streams, but we can do
it. Um Oh, yes. I'm putting work into
the stream. Thank you. Thank you.
Um you guys, I gave you all the answers
to the test. like like I can't
uh I can't I can't I can't like teach
you. I can't tutor you. I don't know. I
don't know if education even
works. Um how will you decide who gets
unviped? Well, we'll have like a VIP
showdown test. I was actually thinking
last night about making a
um making some place where yeah, the
people who like do well on these tests
in general can come hang out and make
like an elite uh an elite form.
Uh, you know, we'll like give people
ranks on the forms. I was thinking of
stealing them from like Starfleet, you
know, crewman, enson, lieutenant,
commander, captain,
admiral.
Um, no, it's not it's not mensa. They're
not really IQ
tests.
Uh, all jokes society did a good job
making the test. Thank you.
Um, surely people who donate large
amounts of money would also be admitted.
What do you think we are? Harvard? What?
You going to put your name on a building
and then we let you in? No, that's not
how it works. We have standards.
Um, when is the next test? I don't know
when the next test
is. I I don't know. Maybe I can make a
test every stream. Well, we'll have
we'll have we'll have some fun
tests. All right. We're drinking matcha
gen macha unsweetened today.
and we're going to get to work coding
and we're going to see if we can fix the
bugs from
yesterday. Um, I'm not sure exactly what
VIPs are going to get yet. We might,
like, for example, I didn't write the
thing yet to make uh there's no way on
Twitch I can see to make a VIP only
chat, but I might write a bot to do that
tomorrow. Is VODs or subs only? Well,
you better
sub. Um, how about a sub icon instead of
a default? Oh, I like that. That gem
looks real nice. That pink gem. Oh,
that's beautiful, man. That is so
beautiful.
Uh, yeah, Ragax bought from the list of
of approved users. And actually, if I
can use So, I can have 100 VIPs on the
on the channel.
Um, make sure by the way uh a question
that may be on
um another test is uh do you follow me
on Instagram? We're really trying to hit
30K followers because I heard a rumor
that once you hit 30K followers uh you
get your you get your blue check mark.
Um and I would love a blue check mark.
Uh, so I have I have, you know, I have
38,000 followers on Twitch.
Uh, George is too thirsty for thoughts.
Yo man, all I'm saying is if you had big
following on Instagram, you you you'd do
the same thing. You know, how could how
could you really fault me, man? You can
get now if you pay. Yeah, but I'm not a
whore. I don't buy cloud. I earn it.
Uh, whoa, whoa, whoa, whoa, whoa, whoa,
whoa. This isn't about being famous.
This is about a girl seeing the blue
check mark next to your name on
Instagram and being like, "This guy is
the kind of guy who I want to hang out
with."
Yeah. All right.
Come on, man. Don't you want to play
meaningless games of social
power? I have a
girlfriend. How tall are we? Uh, yeah,
I'm 5'10. Yeah, I'm 510. I don't buy
clout. I earn
it. Um what did what did
um what did he say about
uh assalama lamaikkum you big hater you
nothing but a hater hater clout
chaser no I don't have a girlfriend
Yes. Last time I see what Metamat was
hype. Okay. All right. We're going to
minimize this and we're going to get
back to working
on the thing. So, I think they tell me
what the right answer is. They at least
say it on the website. If they don't say
it in the paper, I remember. Here we
go. Okay.
Um, so a 2x
two says it gets 36 in tree normal form.
I'm only getting 31. But this is Wait,
this is tree normal form. This isn't
what their
analysis here. So this is what they get
with their analysis. So they have 5 by
two they get 102 million and they say
that there's 36 and there's 25% in each
one of the
groups. Um so we should figure out why
they're getting a different number from
me. Well, okay. So first off, this is
off by one because there's one machine
that we're currently working on
uh because we popped it off the the
stack.
Uh, you didn't do the homework and still
got 70%. Good for you,
man. Look, we don't you don't want you
don't have to do the homework if if you
just know things, you know.
Okay. So, they're also saying for
2x3 they get this many. So, yeah, we're
still we're missing machines
somehow.
Um Oh, let's go on my own private
Wikipedia. Perfect. I love my private
Wikipedia. My private Wikipedia is a
place where there are no ads. There's no
there's nobody to bother you. There's
only love. My very own private
Wikipedia. Um, we should be getting 38.
We're getting 26 when we set M equal to
uh to three. That means we still have
bugs somewhere. Okay. Think we're pretty
confident we don't need this copy
constructor. These are copied when we
copy the tape.
Uh we don't need a copy constructor or
an assignment operator for
machine.
Um did I really archive all of
Wikipedia?
Uh talent over hard work. Uh no, both
are important. You know, I know plenty
of people who work hard and they're not
talented. Like that's sad. You know,
those people you just you can do nothing
but feel bad for them. Uh but I also
know plenty of people are talented who
don't do anything. And like I don't
know, those people I don't feel bad for.
It's like do something, bro.
Okay, we still get the same answer with
the ZEX thing. So, we're actually we're
below the number of machines we'd
expect. For 2x3, we expect 26
2764. Um, and for 2 by two, which should
be the simplest machines ever, we're
only getting
uh we're only getting Well, let's
actually write in that
sum over here.
Are you dumb, stupid, or dumb? Huh?
Like, I love that lyric, man. Are you
dumb, stupid, or dumb?
Huh? Yeah, you got some money, but you
still fucking ugly.
Stupid. So hard, man. So hard.
Okay, it seems like we're just
perpetually missing a
choice. So, okay, we should expect nine,
but we're only getting eight. I added
one, so it's not
that. If we're about to go to an
undefined place, I iterate over all the
directions.
Uh, add halting to the missing
state. Well, see, do I need
this? Without that, I'm never going to
add
halting. Right. So, this is after we've
built out the entire tree and there's
only one remaining transition.
That's where we do the
uh where's the one I'm
missing? Missing
state. New state is state
halt. If it runs, run it. Otherwise, if
it halts, add it to the ones that halted
and update the busy beaver
number. Um, so is your stream now like a
class where if you miss two days in a
row, you might as well drop the class.
Well, yeah, but it's all all the VODs
are online, man. And you know, according
to Harvard, an online education is just
as good as a real education in person.
That's why we can charge the same money
for it.
Chatarino. Love ripping on Harvard, man.
Love ripping on Harvard, you know, for
all the shit we do to rip on Google.
after yesterday. Actually, there was a
comment uh I think it was a comment on
one of the streams about Hammer where
it's like, you know what? If Google's
actually already returning the best
result, right? What if Google's actually
all already it's not manipulating. It's
actually just returning the result that
makes most people the happiest.
Um if that's true, then the problem is
not that Google sucks. The problem is
just that I'm not most people.
Uh, in which case, you know, maybe we
should all rip on Google a little bit
less. I mean, this website's really just
designed to rip on Google. Like, I'm I'm
ripping on Google and giving a shout out
to Papa John's, which is actually really
disgusting pizza, but we used to get it
PPP because they had Papa John's points.
Um, yeah, but who should we really be
ripping on? Harvard. Harvard is actually
evil, you know?
Uh no, I mean I think I think a lot of
the uh I think a lot of the dysfunction
in America today comes from the failure
of the uh the the
universities. Um it's it's downstream of
of the university
failure. Okay. I'm enumerating every
possible and like that does actually
make a copy of the machine right I have
confirmed
this the same
thing. Okay. Well, let's just think
about it. So somehow I'm only ending up
with this should give me eight
machines. But how does it get nine then?
Right? Cuz Okay, it's 2x
two. It puts seven machines on the
queue, which is right because we're
running one
currently. Um, one of them
halts, but how are we getting nine? So,
you see why there should be nine, right?
Because the total is
36.
Um, how are the American universities
failing?
because of this,
right? Are they really providing a
better product than they were providing
in 1998? No. Then why does it cost 2x
more? I think I think I think by a lot
of studies now it's even more than
2x. Um, this is one of the ways they're
failing. Uh, it's actually arguable that
they're there there's this big blow in
university administration. I don't want
to go into this. There's plenty of
people who are much more educated on
this topic than I am um who can speak
with you about
that. Uh I know about busy
beavers, so I don't get
it. Huh.
Okay. So, we run the first one
here. We write a zero to the tape.
That's the job of the first
transition. We write another zero to the
Wait, we should write a one to the tape,
shouldn't we?
Oh
well, let's just try it. Uh,
out direction new
state. Okay. Um, output is one, the
direction is one, the new state is one.
Okay. For the first one here we're
playing, it's going left and it's
writing a zero. So output one direction
minus one new state here. Okay. Now we
pop it off the stack and we get one
where our new state is minus2 which is
the undefined
state.
Um and now it
adds seven things well eight things to
the queue which is right. After adding
which transition?
Well, after adding so there's already
it's a 2 by two
machine so there's four possible
transitions right I
guess. Huh? You know what I might have
done wrong? I might have to put that
step after we do the run.
I feel like we're not getting like some
some loopy
machine
execute m is known to be irrelevant or
the bound the number of execution steps
is is executed output m and halt.
That wasn't right.
I mean, I guess we could draw out all
the machines. I don't understand why
they're getting
one. How many total possible machines
are there? So if we want total possible
machines for 2x two
uh we have two potential new states for
them to well three potential states
because it's a holding state. We have
that we have that and that's um
12. So
there's that right? Oh no.
Um that's each state can have that
many and then we have four
transitions. So it's
48. More interestingly, how do we not
get the right answer for that?
Wait, now we got a different
answer. Oh, no.
14. 26.
generate initialize machine M to this
tupil.
Choose the B 0 transition satisfying one
of the conditions below. So, we agree
that there's four of them. All right.
Should we should we write this more like
the way they
intend? We'll write it more like the way
they intend. Um, execute M on the blank
input until
uh M is known to be
irrelevant. I don't know what that
means. or the bound on the number of
execution
steps. I guess that's already that's
actually already kind of what I'm
doing.
Um, if it's undefined, if it's M
stateful and M symbol,
I guess we can do this. This won't
hurt if we added in a new
one. Doesn't change a thing.
Uh, so if either of those things
trigger, what are people talking
about? God, military spending in the US.
God. Trash.
Trash. Mods only. Um, I want to confirm
that VIPs can talk when we do subscriber
only chat. Uh, definition seven in the
paper. Look from a VIP talks about
irrelevant.
Okay. Um, definition seven in the paper.
We can say that a taring machine is
irrelevant to the busy viva function
uh if at least one of the problems is
satisfied. So actually if it's
irrelevant why do we even output the
machine?
We're now in a position to define the
process for generating machines with n
symbols. This will follow the same basic
process. We refer to the states and the
symbols defined
as denote state
choice. We denote symbol
choice. Huh?
Question. Is the halting state a
possible state? Is that one that I'm
forgetting about here? Should we do
this? We do have 12 machines.
Now if you include the holding state in
the possible set of
uh allowed
ones I can't wait till chat is VIP
only. The problem is we only have like
five people. It'll be kind of boring
right
now. Uh for the university, I'd like to
start with compai physics and discrete
math. There's plenty of overlap in those
three.
Note that we halt the process whenever a
halting transition is added to
M. Oh, that's interesting.
So, another thing to say here is that
this is just
this. Wow, it actually finishes now.
Okay, well that's
cool. Going to print the machines. We
should be able to do that right now that
it finishes
them.
Uh 4H colon halting. Does that
work?
Um, we want to print the
machine. Can I say h
print? We'll add a print function
uh for
Uh so we have a
transition. What are the three things
about the transition? There's an output,
a direction, and a new state. Okay. Um
output actually the
direction. No, it's not.
Um
[Music]
direction
state. Uh
Uh, it's not question time yet. We'll
have question time. It's coding time
now. Uh, new
state. We want to say, oh, this is
supposed to be direction.
state on here. You know
what? Do I want to add just a print
function to d to to I could add a print
function
to machine is not a pointer.
Oh, see this is what I mean. You know,
if you code and go a language for dumb
people, then you don't make mistakes
like that. Um, but you see, you know, I
say this like dumb people, like
everyone's dumb, man. You know, you know
who's real dumb, though? The kind of
person who's like, I only code in HASLL
because, you know, Haskell is only the
programming language for the elite
people like me. No, the truth about
tools, man, is you choose whatever tool
you can work quickly in and runs fast
and shit. You know, it's all about
tradeoffs. But if you believe that
choosing a tool makes you a
philosophically better person, you're
actually an idiot. Okay. Um,
so this is a good point. There's eight
machines
here. Where is the other one? There
can't be another one, I guess. I
guess. How did it get nine? How does it
get nine here?
Those are all the machines. It fills in
those
states, right? And it makes sense why
there's eight because there's two
possible states, two possible
directions, and two possible outputs. 2
to the 3 is eight. Uh for the halting
state, we only have
that. Where is this supposed ninth
state, ninth ninth machine coming
from? So these are all the BOLA
machines, right? This is B 0. This is a
z a1 b 0 b1, right? This is how we're
iterating through
them.
Um, we had one rh because that's always
right. Can we maybe we can find it on
the guy's
website. I remember this website like
wasn't online
anymore, but we found it in the archive.
I mean, it'd be nice if I could download
the list and see what I'm missing. I I
don't understand where these other ones
are coming from. There's there's one
machine
missing and like reading the
procedure. You can also try to get the
uh Pascal code to run.
Maybe a redirect is fine.
It's 1822.
Can I have these machines back
32 machines, not
36.
Could holding state be special? Well, we
tried adding in the holding state. I
mean, maybe it's maybe it's this part
that I didn't write here. If it's
full, we add in the holding
state. That only give me four machines.
Even
worse. It's nice because okay, it puts
the holding state. The holding state can
be here or the holding state can be
here. Um, it can't be according to their
generation rules.
36 we can try. So they say for 3x two we
should get
3508. Oh we got more than that for 32
probably because I removed the
zerodextrous check.
Okay, now they have now we're we're
overestimating. Do we think this is a
good approach to try to figure out why
that's not 36 and they're claiming
36? I mean, they are even more specific
about which this second state state has
to be. So, this is 0 LA, which is this
top one here. So 25% of 36 is nine. So
it should it should give me nine
machines, but it only gives me eight.
What machine am I
missing? The only machine I can think of
that I'm missing is the one that has
halt over
here, right? Um but that doesn't make a
ton of
sense because okay, one RB, which means
write a one which means write a one to
the tape. Right? So, we can imagine the
tape. Here's the here's the we write a
one to the tape. We move the head to the
right and we transition to state B. We
write a zero to the tape. Uh we move
left and we transition to state A.
Right? So, that's because it's zero LA.
Now, we are in state uh we're reading
the tape and there's a one and we're in
state A. So, now we have a transition to
choose. We could potentially halt right
now which is the only thing that's
missing and that might be the ninth
machine but I don't see how that ninth
machine comes around from this
generation procedure
unless we have
this if n is n state full and m symbol
full which you can argue that it
is because it has a one here and a zero
here. State
choice.
Um, okay. Okay. I mean, here's an
interesting note as well. I think I was
being too liberal with my state
choice. We denote state
choice
and it is only the states that are
currently in the
machine. The
set we add an extra state if k is
greater than n. Okay, so this is this is
actually a more restrictive thing. They
do this in tree normal form uh tree
normal form as
well.
Um, but this is not even going to matter
for what we're talking about
here, right? As long as we're still
we're still missing a machine. But I
don't really see where we could be
missing a machine.
symbol
choice. Yes, we can add one new symbol
if there's a new
symbol. Um, note that the procedure
generate m below is non-deterministic.
Oh, we should have really read this
before because then I wouldn't have
complained so much about like what is it
doing? What is it
doing? Um,
You're still studying ting machines.
Good. Study ting machines. A good thing
to
learn.
Um, okay. Steps one and two are derived
directly from proposition
uh 26. I don't think we're could be
doing them
wrong. Um, step three is we have
machines executed until the machines
known to be
irrelevant. Clearly, we need to store
the machine's computation length
consists of those machines that are
known to be
irrelevant. The only exception to the
rule is that we
choose yeah the zeroexus thing doesn't
really matter.
Um this means that a
halting transition step four this means
that a halting transition is only
considered if the partial machine
generated already contains n states and
m
symbols. Otherwise proposition 27 and
conjecture 28 consider a machine
output m and
halt. Okay, I think I think I see what's
going on
here. I think the missing one is this.
And I think that using an else here was
incorrect.
Hello. Anyone here? Yeah. Hey, I'm
sorry. I'm just
checking. You have smoke detectors on?
Yeah, I think it's fine. You sure? Yeah.
All right. Sorry about that. No worries.
I knocked early. I didn't get no
response at all. Oh, I was probably out.
Oh, okay. Sorry about that, man. No
worries. Thanks. Okay. Enjoy. I'll lock
I'll I'll lock it back up. Yep.
Where's the soup at the building, guys?
It's New York, you
know. Um, what's he going to steal,
man?
Was it the SWAT
team?
Uh, not everyone's out to get you, boys.
You know, you always got to remember
that. Some people
are. So, we add in this state if it's
full. And actually, is full has a
simpler uh has a simple simple
definition. Actually, this is this is
actually not the right
definition. Doesn't even mean that
you've technically executed them.
It just means that you've written to
one me. I believe in prone man. You know
you guys ever heard of
chrono?
Uh, do this a little bit different way.
Proninoa is when you believe that the
world is conspiring to help you
out. Yeah. Uh, if TF7
All
right. So that gives me numbum states.
um num
symbols is a similarish
idea except we want to invert the
loops. You know what? This isn't right.
Let's just write the simpler
one.
Um I mean I could just track this as I
go, right? I could track this whenever I
end up setting
one. All right. I mean, if chat's going
to be junk anyway, then I guess it can
be open to everybody.
What does Gary D. Smith have to say?
George, can you please unban
me? No. I don't know what you did, but
you're still
banned. Once banned, always banned. Keep
that in mind.
Yeah. So then the last one is the
halting transition. So let's just add in
the halting transition
here. Uh and actually when we do add the
halting transition, we'll just say
halting equals push
back.
Um,
yeah,
potentially add the halting
state. Uh, add the other
states. Symbols
Oh, this full is
junk. Num symbols in numbum states is
kind of junk
too transition a what I
do transition. Oh, dot new
state. Okay, some reason I'm still only
getting eight
machines.
Um, oh, this isn't right.
Really? I want to
hook. Okay. Set tf int n m
[Music]
uh
t. No, we'll just say
output direction new state.
All right, those ones are junk. We'll
have to just write this. It's
fine. Probably is going to make the code
smaller
anyway. called add
TF. Uh then here we can say
mm add
TF that that
that right
cool. Uh we're going to have to change
these ones up
too. Refactoring, boys. Refactoring.
Don't do it wrong. So easy to do wrong.
So hard to do right. Don't refactor
wrong,
boys. Don't keep an eye out if I
refactor
wrong.
Am I refactoring wrong or am I
refactoring
right?
Um output direction new
Eight. We're good.
machines. Well, that's
something. But actually, the way that I
was computing symbols was wrong.
Um, what we These are junk.
greater than num states. Num states
equals
I find is full.
Um, I'm getting zero there for For some
reason, it thinks it's only a
uh one symbol machine, which to be fair,
I'm doing the one without the If I do
this, it's going to give me nine. No,
doesn't make sense. I added in a
transition, which clearly has another
symbol in it. Oh, but no, that's not
right. Um we can also say if
uh new state
um
h Wait a second
though. Oh.
All
right,
cool. So you can see this machine here
is
undefined. Um, we should check for that
explicitly in our
print. Uh,
if this equals state
undefined, print 1 2 3
4. Maybe we should actually print
underscores. Cool. All right. Now we
have nine
machines. Now, let's just confirm that
we still have nine machines. Uh if we do
this
one, nine machines. All right,
cool. So that was the bug. I think
uh my isful is very fast. That kind of
shit's very
fast. All
right,
cool. Let's add them all in. Make sure
we get 36.
machines. All right, we
rich. All
right. This should also give us the
right answer for 3 comma 2. But it may
not give us the answer for 4, 2 because
we have to the way I define state choice
is slightly wrong.
got
4038. Now we should check the
zerodextrous just so we get the same
answer as
them.
Um, if mm is
zax
push. Uh, no. Sorry. Not
4024. Okay. Still not the right
answer. Getting the right answer now for
2 by two
though. Good time to commit and push.
Cool. You're VIP. You're the best kind
of person.
All right, let's define new state
correctly. So these loops actually
shouldn't go to m&n. They should go to
min of mm new states + one comma n and
min of mm dot sorry it's not
num mm num symbols + one comma
m of course it's not just min it's
standard
mining people which min we're using.
All right. Fine.
Fine. Jump
code. Second type of
crap.
Okay. Now we're
getting this many machines.
You're getting this many machines
total
for 3x
two. They tell me I should expect that
many
machines. Where are these extra ones
coming from?
You can filter out some more based on
blank tape condition def
7. Did I talk about this in the generate
Okay. Yeah.
So, what they're saying is, yeah, don't
push a set of machines.
Um yeah, we we have to look at the
definition of irrelevant and we have to
make sure that if the machine is
irrelevant, we do not push it. I think
that
term fucking birds
man execute
M is known to be
irrelevant. Definition seven talk about
irrelevant or does it talk about the
blank tape condition?
[Music]
um irrelevant to the busy behavior
problem if at least one of these
conditions is satisfied. Okay.
Um so if the activity is less than n, we
don't bother pushing
it. Uh is that
true? In both places we add the halting
state in the generate
function
bookmarks.
Um blank tape condition is part of
machine being relevant. Okay cool.
Uh, Mayfield div number one. How did you
do on the
test? Where's my test? My test go
Almost perfect
score. Uh, off by one for the Python.
You probably did it on Windows where
echo didn't
work. I told you with Windows. Yeah.
Yeah. Yeah.
Um,
Okay, it says if it's full, we don't do
the
check.
Um, keep M on the blank M input until M
is known to be
irrelevant. Well, okay. So, one of the
conditions we can use for irrelevant is
if mm.steps steps is less than n. That's
definitely in the
uh or greater show greater than
n. Uh yeah, greater than
n. Okay, well that didn't change
anything there.
the blank tape condition. If during the
computation of M on the input, the only
configuration in which the tape is blank
is the initial configuration. Okay. Um,
do I have a fast way to do that? I don't
think I
do. Why is that true?
No, I guess. Yeah, as soon as it's
blank, it's all over our
fine.
Um, pool is
blank. Uh, for f in forward,
uh, if f
equals one, return false.
uh for B and backward if well let's just
say S is
both true
um I guess if it's irrelevant we can
discard it right away if MST is blank
uh and MS can do it the other way around
mssteps greater than zero and MST is
blank
Uh
continue blank
tape. Rangebased for loop requires typed
for loop
variable. We could keep track of it too.
Uh the problem is I'd have to intercept
the uh oh not MS
mm uh
blank. Okay. All right. We're getting
closer. What number am I supposed to get
for
this? Um Oh, now we're too low again.
After doing the blank tape condition,
we're too low.
We really should be using a
non-deterministic programming
language. I like I wouldn't have to
think through all these stupid
cases.
Uh should the number be? Should write it
down. His blank should check for zeros
instead of ones. Oh yeah. Yeah. No shit.
You're right. Nice
bug. Um
Still getting way too few on these
multi- symbol guys.
No, it's
okay. Doesn't work
anymore.
[Music]
Um, pretty sure my ZEX check is correct.
Okay. Well, so we know that we're
expected to get 6.5% out of
Boola. It's 228 machines from the first
transition. We get 220
Maybe I'm discarding the blank tape
ones. No, I mean that should be an
okay. I don't know. I mean, at some
point it may just be idiosyncrasies of
their algorithm that get you an exact
number.
Like that's probably not wrong, but
um it's probably not wrong, but
[Music]
Uh, and does he talk about what cut off
he uses
as M has finite
activity. Finite
activity activity
subm is greater than n. So that's
activity here.
Um, let's got rid of two
more. Productivity of M is greater than
zero. Harder to measure.
It's like some C++ 11
crap. I don't
know. I kind of think this code probably
isn't too wrong. Well, it's really wrong
once you get into multi- symbols. So,
maybe we can figure out why that's true.
Um
yeah,
3398 and we inspect 3508. So maybe we
can find the multi- symbol
bug because this one we're off by a
factor of two and that probably isn't a
small bug.
This one's
probably It's probably more serious,
bug.
Um,
Let's make this a little faster.
Wait, did that just change the
number?
Those two things should have been
equivalent. Oh, I mean I do have to set
card to
zero. Okay, never mind. There
equivalent.
That one's way off. There has to be
something we're missing.
Oh, wait. These belong
here. They do not belong
here. I don't know why I put them there.
It does the same thing
though. Yeah. Again, this stuff doesn't
matter, but it will start to matter once
we get to like four comma
2. What is it for? Four, comma, tail.
Yeah, I overshoot four comma two and I
undersshoot 2 comma 3 by a
lot. Like half as many as I should. And
I don't know why
and the holding transition and then push
the
machine. Go to step three.
2, 3 is I I can't get a smaller machine
than that. I could just focus on one of
the little
things. Getting
158.
Um, did we forget some obvious
transitions? So, we have one LA
here.
Uh, why is there no zeros in here?
Okay, so we have one
RB move over there. Zero LA back there.
Now we're in this state. Why does it
always insist on printing a two or a
one? Why are there no states where that
prints a
zero? I guess there's no states where
that prints a zero because as soon as
you print a zero there, you end up with
uh the zero state case.
How are we back to only eight machines
for that
one? Oh, I guess because of this
check, which it doesn't actually say to
put
here. If we put a zero there, the
problem is it's going to overwrite the
only one on the tape with a zero. So,
that would satisfy the blank tape.
The minute we are in the blank tape
condition, is that
true or is my blank tape condition too
uh too
strict? M is known to be irrelevant.
Oh, M is known to be irrelevant. We
output
it. BB. Doesn't work anyway.
Now we got
167 which I think is still too
low and M is known to be irrelevant at
that
point. So we output
it. We're still off by a whole bunch.
3058 * 6.5 over
100. So we expect 2 point 2 28 machines
for the
first. we were actually only ending up
with well I mean it doesn't even like
like once it's known to be irrelevant we
output it that's kind of stupid
um I don't think that's
right because that machine doesn't even
have a hold
step
no irrelevant
Okay, so these transitions it has the
one transition or the true
transition. Um there is no state three.
There's only a state uh there's only two
states but there's three
symbols. The author's source code is in
prologue. Do you want to read prologue?
We could do that.
Um, okay.
Tula, there's all these ones being
outputed without a halting state, I
guess. I mean, I guess those are the
others that are just they ran for too
long. Hm. Which is which is interesting.
So that one doesn't have a halt
either.
So I mean see the problem, right? So
these machines are being outputed. Um
they've run for actually that's another
thing we can output when we print the
machine.
steps. Yeah. So that's the number of
steps. So these ones all around for
101. Um the problem is they don't have
halting states. So like the question is
do we have to fill this in with every
possible
thing? Maybe they output only once. They
know it's irrelevant. So you could
appair compare subsequently generated
machines to the known irrelevant
ones. I don't know about
that.
Um
like this is an incomplete machine.
Step three tells us that when the
machine is executed until the given
machine is known to be
irrelevant, exceeds a given bound on
computation
length or finds a placement where a new
transition is needed.
Clearly, we need to store machines whose
computation exceeds the given bound. But
strictly speaking, we can insist that
these machines that are known to be
irrelevant are not stored at
all. The only exception to this rule is
we choose to not store zero dextrous
machines.
I still feel like I must be doing
something really wrong because I'm I'm
off by a
lot. I'm looking at 167 machines. I'm
expecting 228.
from the paper. We've chosen to retain
such machines to to to simplify the
generation process. Yeah. So, I'm
retaining the machines now too. This is
this is
um irrelevant
uh bound on number of exact
steps exceeded.
We check for Zdextrous in both of those
places where we add in either a holding
or a new
machine. Um, and then this is step
five. If there's only one state
remaining,
um, add in the halting
uh state output the machine and then
continue. Now we're here. We're actually
still in step three. Um run the machine
for a step and then add it back to the
queue if it didn't halt. Uh if the
machine does halt, confirm that it ran
for more
than we don't even we can remove
that. It doesn't matter.
167.
shouldn't really call this hall thing.
It's kind of wrong.
Just say
out. It's more likely at this point, a
flaw in my logic or a bug in the code.
What's the difference? Right. You got
you got syntax bugs, you got logic
bugs. They're all
bugs. I mean, it's possible that they
then fill
in possible machine generated so far may
not terminate.
terminating machine in which the blank
tape state
occurs in a state other than A or
Z.
Oh, a machine for which this occurs in
state A other than the initial
configuration.
Hence, if we find that the machine is
blank at any point, we should seek
execution only and note the machine
generated as irrelevant. We're still
outputting it.
But that means there will be some
machines generated whose status is known
immediately. These include any
non-terminating machines detected in
step three as well as machines generated
by the first bullet point in step four
which are known to
terminate. Definitely.
Yeah, this is known to terminate because
the transition is to that termination
step.
Um, which are zero
halting. So there will be some machines
that are already classified as they are
generated including some which are zero
halted while many of the other machines
will be unclassified.
This somewhat messy arrangement seems to
be an unavoidable consequence of using
the TNF technique. In principle, we
could add halting transitions to the
zero halting machines so the set of
machines would appear more
uniform. As noted above, some zero
halting machines are generated due to
the execution bound uh being exceeded.
So these guys
um it's possible that later analysis
will show that these machines do not
terminate.
However, if that subsequent analysis
cannot do that, then we need to consider
the possibility that these machines may
need to be defined in more detail as
these machines as it may be that these
machines can be extended to machines
which will terminate on the blank input.
For example, consider the for day two
symbol. the machine exceeded the bounds
after five steps of
configuration. So we may need to
reconsider such zero holding
machines. Um
[Music]
So, we we may be getting to the point
where well,
no. Um, it's possible we're getting to
the point where
uh I don't know. I kind of missed that
that that that busy beaver thing because
it was a good
test. Else um BB subn equals um max of
BB subn,
mmsteps. Put it
back. Uh it was a good test, right? If
we're not getting the correct busy
beaver
number, like we're not getting, so this
should give me six. If it doesn't give
me six, then we're doing something
wrong. It's possible that we're just not
going to get exactly what the paper
says. Um, for who knows what reason. It
doesn't necessarily mean that what we
are doing is
wrong. Like it just it could be a quirk
of the algorithm. It could be
implemented wrong anywhere. We should
just make sure that what we're doing is
correct. Um, this is largely good enough
for for going on to the next step
hopefully. Um, okay. So,
let's for example, I think this
zerodextrous thing is is stupid.
Um, and this one here, we don't actually
have to push it back. We can actually
let it hold because it just holds on the
next it holds the next dumb it runs.
Um just let it
run.
[Music]
Uh
do
okay. Um add halting to the missing
state. Um this is
unknown if it
falls. Okay, so we got busy beaver
number six looking at 2 by two which is
correct. Um looking at 26 machines and
letting them run for 100. Uh so for
these ones, let's just let them run for
40 because all the numbers we should be
playing with are only going to be uh
below 40. Let's go 3 by two
here. Um let's not print the
machines. Okay, we get a busy view
number of 21 and we're looking at
3,092 machines.
Um
here busy beaver number 26. So this is
wrong. We should not have gotten 26
here. We should have gotten
38. So there's some bug still like this
is an actual bug. This is we can't just
say that my code's giving something
different from theirs for some
reason.
Uh because they have one that runs for
36 steps. 38
steps. And for some reason, we're not
finding that
machine. Um, we're only getting
26. Okay. Um, Mayfield pointed out
before that I made a stupid mistake here
where I checked for these things
uh not being uh I did something special
with the state one. Did I do anything
else where I'm stupid with the state one
treated as a special
thing? Direction is fine. We don't even
use a zex anymore. It's a stupid
function. This guy really liked that
Zex.
Uh, make sure my initial configuration
is
correct. If n equals 3, b
0. That's
right. Why can't it go right? I guess if
it goes right on zero, there's no
point, right? If it goes right on zero,
then it's just going to continue to go
right on zero
forever. Yeah.
state
choice not by state choice the
set K is less than N and all the states
otherwise which is what I'm doing
there
Um, we output a is a one in this state,
but that doesn't matter. We can always
do ones for the
halts. Go to step
three. What did I do wrong? Why am I not
getting the
machine? I'm adding in all the
possibilities.
Those are the ones that give me
26. Is the second law of thermodynamics
true? No. They made it up, man. And it's
the man trying to oppress
you. It's true. Unless you donate a
building and then they wave it.
You know, the patent office used to have
a policy where if you wanted to patent a
perpetual motion machine, you had to
build one and run it in the patent
office for a year. Um, they've since
gotten rid of this policy and there's
like, you know, 30 patents out there for
perpetual motion machines.
where. Okay, let's look at two state
three symbol busy beaver and figure out
why it's not in
here.
Here.
Okay.
So, we're looking for one that's one RB,
right? See one
RB, one left
C. Oh, wait. No, there's no state C.
Sorry, that's three state two symbol.
I
want the other way
around. Two state three
symbol time machine for three state busy
[Music]
beaver. Three state two symbol busy
beaver champion. No, I want the
two-state three symbol champion. Who can
find
that? There's a two-state presyol
universal taring machine.
Okay. They swear to me that it is
38. Oh, you found the machine. Okay. 1
RB 2 LB. Let's just write that out.
Um, one RB, 2 LB, 1 RH, 2 L, 2 RB, 1
LB. Well, let's just figure out if we
have that
one. 1 RB, 2 LB. Okay, we definitely
have 1 RB, two
LBs, one RH. So that's where the holding
step is. Definitely have
that. 2 LA. Now we've lost it. We don't
have any with 2
LA. Why
not? Why couldn't it add 2 LA there?
We have one
LA. Okay. The closest thing we get is
that one, but it only added one LA. It
didn't add two
LA.
Um. Oh. Well, okay.
I mean, that's one of the initial that's
like one of the initial things, right?
The reason there's only one LA there is
because that's an initial thing. Can we
re label two of the states
somehow? Well, I guess we can always
reabel one and two. We can't reabel it
to zero, but yeah, that's just not
there.
symbol choice
01. What if that's
wrong? Right. The reason why we don't
have any 2LA there is
because let's give it 2 LA and let's
see. Did we do better?
Now it gives
38. It is pretty clear about only
requiring zero and one here. Right? Is
that wrong?
No
man.
Oh, we denote by symbol choice this
including L + one. Oh, what? What
a what
a
shit bullshit,
man. Notation
bullshit. What do they also denote that
about state choice? No, they're very
clear in state choice. In state choice,
they don't do this, but
fine fine fine fine. min num
symbols + one m + one symbols
that you know you know some people man
some
people you go okay cool all right uh so
that bug only affected does that get us
closer to the number all right it gets
us closer to the number. Good. I'm happy
with it
now.
Fix
BB2X3. At least it gets us the correct
Busy Beaver
number. Uh, even if it's not looking at
all the machines.
Cool. You like this collection of
machines better? Which collection?
All right, let's try it for 4 by two and
see if we get the right answer. Well,
this one's going to take a long
time. We should throw more out. We can
we can start throwing them out now.
Um if it fails blank tape, we throw it
out. If it that happens, we
continue. Um this is unknown if it
halts, but it's complete. So, we can
push that one
there. Uh this is known to
terminate.
This
will
terminate next
step. Let's just say this
step.
Um kind of dumb they were adding the
irrelevant machines. Yeah. Yeah. Yeah. I
think I think so, too.
Um, now if the bound on the number of
exact steps is exceeded, that's not an
irrelevant machine. We're going to have
to add
that.
Um, and then we don't care. So, let's
see how long this takes to run. This is
now for uh how much time is being spent
doing the
print. This is for four,
two. Cool.
for 4x two. We're getting this many
machines. Uh they got away with less
probably using zerodextrous
crap. Well, but let's really ask the
question, how many of these um halt? You
know there's no reason to push it
actually if
mm steps what is 4x
two. So the busy beer 4 is like 107 or
something.
Yeah. Uh if mm steps is greater than or
equal to 107 then we push it. Otherwise
we don't.
known upper
bound. Why is it pushing all those
machines?
Um, oh, because these are complete
machines where the unknown of it
halts halted.
We're going to get some that halt pretty
soon, I think. Right. Maybe not. No,
we're not.
Okay. Uh, cool.
Did I change this at
all? Any good any good other tricks like
blank tape?
um C++ vector
any wonder if that's
faster. I don't remember what the old
one was. So great. Use this uh 40
All right, let's have it actually write
out all the machines instead of printing
them. It doesn't matter.
Okay. So, we have 63
uh 637,000
machines. I'm not that should have
printed them all.
Yeah. So, here are all the
machines. See how long this takes to run
for five.
So technically we have to run it more
than the busy beaver steps. Um because
if we
don't we may end up with incomplete
specified machines which I guess is
okay. We can prove if that subset halts
or not.
So, what is that? We're to 5 million. We
expect to get about 100 million. It's
not too bad,
actually. Could always turn the
Zerodextrous check back on. Yeah. We
sure about that
check. You like that check?
Another thing that I'd rather do with
that check is
like I don't like that check. Can Can I
put the check I mean I like checks that
I can put here, right? I like checks
that I can put like right at the
top. Yeah, the code's on GitHub. Twitch
cock.
The demon duck of doom.
You know what occurs to
me? We don't have to do this all
together. We can like we can separate
this out. Who wants to write it
multi-threaded? You know, I think we can
just do like one of
these. Or I can say something like
uh
priority. I can like separate the cues
at any point, right? I can totally write
this. Should should we write this with
lots of threads? Multi-threaded. Well,
yeah. I mean, you can spawn that many
threads. Uh no, no, but I mean, my point
is if priority Q is thread safe, I don't
know if priority Q and Vector are
actually thread safe.
But I don't think it's that. I mean, I
could always put a mutex around it.
Yeah, it's easy to write the for loop
multi threaded, right?
So to be
fair, I somewhat wonder
5VN
again. It's a decent test,
but it's not going to play nice with my
threads.
Um,
Oh, that's a good point, too. Want to
try
three? So fast. Fast is it for
four? Well, that removing that print
statement is going to do a lot.
So actually use this for anything other
than
[Music]
um we do
Okay, 1.5 seconds respectable, but we
can go even
faster. Is this darn safe?
have realistic multiple readers are
safe. Multiple threads may
simultaneously read the contents of a
single container and this will work
correctly. Naturally, there must not be
any writers. I need to read a writer
lock.
Someone just have like a wrapper for
these wrapper thread C++
mutex. Oh yeah, standard lock guard.
Yeah, I want a lock
guard. Block guard. Is that what I want?
Lock.
Oh, what's going to make me write
code? I don't want to write
code. Yeah, I could use a mutex, but I
like write the damn mutex. You know, you
want to write a damn mutex? Not me. I
know I don't
um if ms do size equals zero
break. He
This is adding code. I'm upset about
that. I'm very upset about this. No, no,
no. I refuse.
Add
out ms.pushmute.unlock
Unlock out. Push back.
Mm. Add out.
Mm.
Add Q.
Mm. And now it's in a comment. Fix the
comment. Add Q. And
then I want add Q. Maybe N
Q. How many machines does each starting
machine generate? Yeah, I could I could.
Doesn't really matter
though. This This is like a just it's a
cleaner way to write it and when I do it
should work
fine. Uh no matching call to function
add
out. Cool. Uh should be able to start
generate
threads.
Um it's like a pool.
Of course not.
Uh calling it private constructor.
No matching constructor for thread.
Construct some new thread
objects.
Um, spawn a new
thread that calls foo. I don't get it.
Okay. Call generate. It should work.
No matching
constructor. No overload of generate.
Matching
thread void generate the same as
fu looks right to
me. So not like
new use
lambdas. No matching constructor.
What? Not infer type function
pointer. All right. I mean, let's just
try this. Maybe this will work.
Can I say like thread t
generate tjo
join? It's not work. I feel like it's
the exact same thing that's written
there.
I'm using P threads. This should
work. No matching constructor.
M plays back. I'm not even doing that.
I'm just I'm just literally
doing No overload of generate matching
thread. No overload
matching could not
infer construction not viable.
What? Oh, compile with
Pthread.
No Baz operator on object B.
thread object thread function. That's
exactly what I'm
doing. I mean, it's just a
void void generate.
want
that.
No, don't do it
here. Does this program
work? That looks fine.
Does it work in the standard
17? Works
fine. Generate something special.
I I don't
even don't call it
generate. Call it thread
function. I call it generate
function. Cool.
16th thread not
faster or I did something wrong
Print.
Two
thread. Two thread. Never finish.
or it's just thrashing
constantly. That's why you don't using
STD. Yeah, good point. Have a smaller
M&M. Good
point. No, I think the multi-threaded
version's broken. If we actually use two
threads, it
breaks. Use one thread, good. Use two
threads,
breaks. Sometimes it's a good exercise
to multi-thread your programs because
you learn things about how
um it work. So that's all done. Oh.
Wow.
Done. Oops.
I think it's
slower. Threads made it
slower. Threads are a
scam. Proof is in. Threads are a scam.
Threads made it slower.
use lock
guards. Yeah, I could refactor that with
lock guards,
but like I know I know I can do lock
guards
here. I was probably thrashing the uh
me. I don't care enough. That's
fine.
[Music]
Um, still a nice refactor. I add Qet app
and net
Too much contention for lock. Yeah, I
agree. Now we need like a more proper
like lock free data
structure. H I regret using using name
space std. I can say something like
using standard vector, right?
Yeah, I'm upset that I can't couldn't
call my
thing generate because there probably is
something in the standard library called
generate
Sweet. Well, so here's something else we
can do. I know it's going to make it
faster. and it's going to actually make
it considerably faster. We'll do that
refactor and I think we're put
[Music]
So we don't have to constantly put the
machines back and forth on the priority
queue. We can actually run them uh for
quite a bit longer. So let's say
uh let's create a quick will go
undefined
function. Um and then my will go
undefined function.
Okay, we can actually change the order
here
slightly. Um, so we can
say mm.run
uh rule vaulted All
right. If
not, that makes me want to return true
for halt
again. if halted
uh add
out.
Um so if not we'll go
undefined. These stupid continues
actually well that's step five. Hang on.
Uh while not
mm will go undefined.
Oh, let's just say while one
uh fold it
out, break out of this.
Um if
mm we'll go
undefined also
break. So I'm going to just do it more
like how they talked about in the paper.
Oh, by the
way, check to make sure I don't break
anything. We'll write it more like the
paper. Okay. Step three.
Execute. Execute. M on the blank input
until
um it halts. We output it. Failed blank
tape test do not
store or
run. Um if mm will go
undefined then put that in here
Make we don't actually need any of that.
really want to help with that. Print
that
there. Some reason it gets way more
machines. Doesn't make sense.
Um, if it halted, we added the output
and we exit the
loopy. Uh, if it failed the blank tape
test, we just
exit. Uh, if the bounds on the number of
execution steps is exceeded, we add it
to the
outputs. Um, if it will go
undefined. We add that one to the queue
which will halt on the next run. uh we
add in all these possible
states and then here
uh we break as well. I don't understand
why that's more
machines. Let's start back with two
comma
2 where we can print the
machines. Uh for the init just have this
and then we'll
return should give nine only gives
five that gives 20. I don't know what
broke.
I don't know. I don't know why that
broke. Maybe we should think about why
the other ones didn't show up in here.
We can add back in that print out
too. A lot of them ended up not getting
outputed for some
reason. Maybe because they failed the
blank tape
test. Oh. Guess these can go above
run. That's
better. Back to 36 for
here.
58. God.
halted data to the
output. Uh we'll go to find add possible
branches nine steps will halt with the
10th. This is unknown if it halts, but
it is complete. So, we just
exit. That doesn't run
anymore. How do we get nine?
Is the priority queue dduping them
[Music]
somehow? Is there anything that ddupes
them actually?
What's a guy in Canada? Thank you for
subscribing.
[Music]
Uh, okay. I mean, we can put it back to
the other
way. I don't know. I don't understand
why these aren't equivalent.
Now we get nine again.
or okay, you know what? Let's really
just simplify
this. Add
out
break. Make these into breaks.
Oh, those did not work as those should
not have been breaks. I guess they don't
get hit.
Okay, that's the same. But the putting
step three inside a a n
loop. If I comment this out, I expect
36. 36. Okay, cool. Now, how much faster
is this for
four? before we're getting like 1.5
seconds. This should be faster. And this
should also thread
nicely. Yeah, twice as
fast. Yeah,
buddy. How about with that many
threads?
Slower. Considerably slower.
There's still a lot of lock
contention. That's weird.
Okay. Even with the new style is way
more depth thirsty than breath
[Music]
thirsty. I
like it. Doesn't matter.
Okay.
Uh, so I'm going to run this
over like an
hour on whatever we get for
uh let me just write some
quick. All
right. What? I'm still hitting all the
buttons probably.
Scary. I'm just savages in this town,
you know.
Um yeah, we'll try to execute it for
five,
two, but I'd like it to print some stuff
occasionally.
Cool.
10 million. Oh, this is so fast. Oh, we
don't even need the
threads. No threads
required. Why did it
freeze? There we go.
Okay, we expect this to get to about 100
million. Well, you know, you never know
if a program is going to hold or not. Am
I right?
We're not actually going to beat the
record. We're just going to prove the
record. Don't know why it hangs
occasionally.
There's no way it can really be
stuck. This priority queue is getting
massive. The priority queue now has 67
million things in
it. Is this cuz I ran out of RAMs? Am I
out of
RAMs? Oh no, I'm using swap,
boys. Oh, we're using swap.
Oh, no wonder how my poor
flashy. Oh, we got to go
swap. All right, we can run this on a
computer. My work computer has uh many
gigabytes of RAM. We can use We can use
the many
gigabytes. Uh, Trump 42000. Stop with
political bullshit. Spam. We've zero
tolerance for politics around
here. If it swaps
again, these numbers aren't getting
smaller. These numbers are getting
bigger, which is
upsetting. I think it's
swapping. All right. You guys want to
run it somewhere fast?
It' be a tragedy if we can't these
threads on this computer. This computer
is so
powerful.
Uh you guys want to see the power of
this computer? Yo, that's some power,
man. That's some power. Look at how many
gigabytes that is. That's right. We're
not going to run out of gigabytes
now. Oh, assert wasn't declared in the
scope.
God. See you
sir. I'm going download a RAM. Download
some RAM, boys.
All right, now we're
flying. Ironically, this computer
probably has worse singlethreaded
performance than my
MacBook. I don't know if these I'm sure
these hiccups aren't due to swap. They
may be due to Oh, yeah. 28 million.
Yeah. 29 million. 33 million. 34
million. I think it's only going to be
million. Huh.
So
sad. Only one thing, one core. All my
cores. Let's go. Don't
worry. Got to run the
GC. It's funny because C++ doesn't have
a GC.
Oh yeah, we love
Ram. I don't know why it freezes up at
all. 82 million.
We don't really know. We maybe expect it
to be about 100 million only because
they said 100 million, but we actually
really have no
idea. We don't know what their uh their
execution limit was either. I think I
set mine to 40 or something.
All right. Well, we're watching. This is
the number of ones that have halted.
This is the number of ones we have to
examine. And this is the number of ones
left in the
queue. You think 300 million?
Oh. Oh, that's too many million.
See if Bezos is something faster.
There's nothing faster than this. I
don't know what would be nice is if my
multi-threadedness worked, but you know,
locks and stuff. Who hates locks? Then
you're like, "Oh, use lock free data
structures, but then you have cash line
contention and that can be worse."
Um, wow, boys. This is a lot of
millions. I don't know what to say.
I don't like this paper
anymore. That's the main thing I've
learned that I dislike this
paper. They claimed that many is
computed in that many
seconds. They don't
have Oh, six states has
gajillions. God, why is it frozen?
I'm only using 65
66. Oh, I know why. Because it's
probably allocating a doubly
sized
thingy. Those vectors can't be getting
that
large. For fast single server
performance, you have OVH. Yeah, that
shit. I mean, it's What do I
have?
Those are decent
chips. Oh, finally. This number is going
down. Oh, it's going down. Good. That
number is going down.
Ho. We're in luck. Number go down.
Yeah, I think I think 300, you know. All
right, I'm taking bets right now. Will
the number be larger or smaller than the
population of the United
States? I only printed once every
10,000. But yeah, that's probably true.
It's got to send those prints across the
network. Uhoh, we're not looking good.
What's the population of the US?
It's going to be
close. I'm betting post code. I'm
betting the over. I'm I'm betting the
over. I'm only taking the line for the
under.
if it goes over, you got the prime. All
right. Uh oh. What if we run out of
gigabytes on this computer? Don't worry.
I have computers with
more. Oh, it's not frozen. It's just
reallocating
stuff. I didn't actually save the
results anywhere, but we at least know
that it's doable. I can have the server
do this all night. Trust me, the server
is bored. It told me it's going to be
huge. This is how many steps it's run.
This is where it is on the tape.
Oh, that number's going down fast
now. No, actually, you know what? I'm
going under. I'm changing to
under because I forgot that this number
was actually already the sum of these
two numbers. And if I forgot, I don't
know what what hope any, you know. Oh,
yeah. Let's go. Let's go. Let's go.
I think it might even be under
300. I can't change. No, I changed my
mind. Come on. Last minute bet. I
parlayed it. I parlayed it. I bellayed
that
order. The 64th thread CPU only use one
thread. Ah, one thread. It's on core 15
now. Core 15. You can imagine little
core 15 in there working so hard. Little
core 15s. Little core 15's never worked
so hard in its life.
Now I'm changing. I'm changing. I
changed my
mind. Uh, what should we do for Q&A
today? Who has
suggestions? Subscribers only Q&A.
Maybe we should have left in the zero
dextrous
check. Also, how many seconds did their
thingy take? Oh, that's a lot of
seconds. 21 hours. Damn, they should
have written in high performance C++.
No, I don't have a V4. I got a V3. You
think I paid for V4s? No way, man. V4s
are a scam. I mean, you do get faster
RAM bandwidth, but I didn't buy no
V4s. Yeah, those researchers are noobs.
They should have written in high
performance
C++. Yep. Your opinion on the UFO
Pentagon stuff is exactly why it's going
to be subscriber
only. Yeah, the original Busy Beaver
might have been theorized in the 60s,
but they didn't have computers that look
like this. They didn't have
252 gigabytes of RAM just sitting around
doing nothing.
Ah, that's the beauty of the future, you
know. No, no, no, no. It's going to be
way
lower. Oh, we got to pause again. We got
to compact
something. 102
gigabytes. That's a crazy amount.
What's Hammer? Hammer is a
company. The joke is the only thing you
can apply for in Hammer is to be the
founder and then I reply to you with an
email saying, "Congratulations, you're
the founder. Go forth and make
hammer." Um, and then people are like,
"No, but I wanted guidance." And I'm
like, well, you know, go to a VC for
that shit, man. Um,
yeah,
hammer. Come on. Let's go. Let's go.
Let's go. Come on. I want a number. I
want a number. I want an
output. Uh oh. I am kind of scared we're
going to run out of RAM. I think the way
these STL container Yeah, I compiled
with 03. I think the way these STL
containers work is they double. Oh,
good. I have another 256 gigabytes of
swap we can use to fill up with all the
zeros. Bye-bye
RAM. Maybe it won't
terminate. Let me tell you all the
truth, man. The turning the halting
problem is solvable on any real
computer. That theory only applies when
the tape is infinite. And we can examine
my tape. Oh, sweet. It's going again. We
can examine my tape. And although my
tape may look infinite, my tape is
actually very bounded by
this. Yeah. Oh, yeah. There's our
[Music]
number. Our amp
gets
276,413,630 possible machines to look
at. All right, what do we think? So now
we're just going to have to run all of
these machines for this many steps.
I know, so many
machines. And we're going to have to
find all the ones that have a repeated
state and then we're going to prove it.
But the good news is, yeah, that output
file is only going to be like a
gigabyte. So, it's something that we can
realistically work with. So, we might be
able to I don't know, we might be able
to cut it down a bit
more. Yeah. Yeah. We'll we'll thread
that. Use vector reserve and place back.
always pass by reference. Yeah, this is
open source. If someone wants to
refactor, please
refactor.
Okay. Um,
cool. One gigabyte text while holding
the number. Zero dextrous feels
unappreciated. We could try zero
dextrous. We can add some of those
things in and try to get that number
down to like a reasonable 100 million or
something.
Um, we could say, but
cool.
Uh, let's go subscriber only with the
chat and let's do some Q&A out of here.
Um, we're going to be streaming. Well, I
don't know, maybe
tomorrow. Uh, we'll see. We'll see.
Streams are going to be more regular.
Habitus, thank you for subscribing.
Um, we're going to be uh streaming
hopefully more regularly. There will be
more tests. There will be new ways to
become
VIP.
[Music]
Um, as it feels being an Amazon
employee. It's all right. Amazon's
okay. Uh, new ways to lose VIP. No, we
no one no one has to lose VIP yet. Um,
mostly the way people are going to lose
VIP is if VIP people say some stupid
stuff. It's not saying stupid stuff
once, but if you say stupid stuff and I
said you say stupid stuff and then you
say stupid stuff again, that's when your
VIP is gone. Um, but I'm not sure this
is exactly going to be a problem. How do
you get VIP? You have to pass one of the
ultra elite tests. Um, so today the only
people who got VIP are the ones who
passed the ultra elite
test.
Uh, these are all the new ones that came
in. Let me let me I'll grade the new
ones that just came
in. Okay. Despite me giving you the
answers on the stream, a lot of people
did
badly. Uh, but yeah. Well, you can't. I
mean, you know, those tests obviously
don't count because it was after I gave
the answers away on the
stream, but
um if you could run one program on a
taring machine with an oracle, what
would it
be? It's a good question.
Uh, so you're saying it's an oracle. So,
do I really only get one bit of
information out? I only get a yes or no.
Um, if I only got a yes or no, I
mean like, okay, so if you only get a
yes or no, you can say you can say like
the following. Like you can ask the
question
like, does a proof to the Goldbach
conjecture
exist? That's probably the best thing I
could come up with, at least in in in
short periods of time.
um
or yeah I wouldn't want to say that's a
separate question from asking is the
Goldbach conjecture true or is there a
counter example
um bubble we don't talk about anything
remotely political here like that kind
of shit corona virus was too polit
political and now we can't talk about it
anymore. It sucks, but you know, you
blame your local politician. Vote for a
different guy. Uh, have you considered
using quantum tunneling to send data
back in
time? Uh, how far back in
time? I mean, if you really could,
right, because that's the dream of all
these high frequency traders. If you
could if you could like even if you
could get, you know, a couple
milliseconds of time travel, you could
make a significant amount of
money. Um yeah so again the question
would be is gobox conjecture provable
basically like search using the rules of
ZFC uh for a proof of gobox
conjecture. Yeah, if we could send if we
could do like local little time travel
uh that'd be a that's a decent startup
idea. Somebody should pitch that.
Um, you guys know you can all subscribe
and you can join right
now. Do I think we'll be able to go
smaller than6 nanometers to a
transistor? I've heard that current
transistors like a thousand by a th00and
by,000
atoms. Uh, it's also like transistor
size and feature pitch are different
things. Uh, full
Wikipedia.
Um, so yeah, I don't know. Don't I want
to add things? Not
really. Uh, this is live. When will the
makeup test be? Next stream. Make sure
to read the
paper. The makeup test will be harder as
well. The tests will get harder, not
easier. Today was the easiest test uh
for you. Re-watch the stream. You're a
subscriber. You can you can watch the
the VOD archive. How do you stay
pampered? Don't you see my fan girl? Fan
girl. Fan girl. Get
it? Opinion on the way to increase
personal
intelligence. Why don't you Google that?
Why don't you Google that? Google's the
right search engine for you. How many
times do you fail to capture? Way too
many.
Um, will you check some hammer comments
on here? All
right. How did I get my local Wikipedia?
Well, I I went to every page on
Wikipedia and I pressed
save.
Um, would you have a new company? Uh,
the money needs to be lower, like $10
and ad benefits for newcomers. God, see
this guy can't even spell benefits. So,
you know, Hammer's an elite search
engine. Limit the searches for new users
so they can try it out. They make it $10
a month. What? Superhumans charging 30.
$3 a month. $30 a month, you know.
Yeah, never mind. Every every since I
put Hammer out in the world, I'm
realizing that we're never going to make
Hammer. We're never going to Google is
the search engine the world
deserves. Nah, nah, no. I killed her.
Um, yeah, Google is the search
engine. No, no, hammer shouldn't be for
everyone. What I realized was everybody
really just wants Google. You guys all
love
listicles. You guys love listicles. And
that's that's the
truth.
Um, no. I'm not playing chess
anymore. That sounds kind of pleasant.
Maybe I'll go play some chess after
this.
[Music]
Um, how you improve it on dogs? How
would you do it on Twitch?
Nonsubs. I don't know, man. I think we
should do it on dogs first to perfect
our
Thanks, Jordan Diaz. Don't
spam. Yeah. You see, that's the great
thing. Anyone who wants can be the
founder of hammer. You're the founder of
hammer. You get a hammer. You get a
hammer.
Um I'm not
uh when am I heading back to San Diego?
I I got some things to do here. I got
some things to do here. Um I got I got
some things to do.
Uh be traveling for a bit.
There's some some announcements to be
made. Uh, no, no, no. It's not just
about getting laid. That's just the
added benefit of being here. We get we
get some things have to be done while
I'm here, you
know. Um, take my sailboat. How many
feet? Uh, I've always wanted to do like
a big blue water uh adventure on a
sailboat. Uh, what are the two best
fields to study in college? Uh, partying
and Super Smash
Brothers.
Um, I don't know anything about laws or
politics, man. I'm a math
guy. Oh,
32. Uh, yeah. No, I'm not. Uh, I got I
gotta get better. I gotta get better at
sailing.
Um, first,
uh, I really want to play Smash 64, man.
Pikachu. I'm willing I'm willing to bet
if anyone on this stream thinks they
could beat me at Smash 64, uh, let's bet
$100. Um, oh, it's got an autopilot.
Sweet. Uh, yeah. You know what else
about boats? I looked once and I wanted
to take a Well, a sail was the way to do
it. I want to take a boat to to Hawaii.
And if you take a power boat to Hawaii,
it costs six grand in gas. You know,
boats are like 50x less efficient than
cars.
Um, I consider a larger bat. Are you
familiar with
C classification of finite simple
groups? I I realized I looked over this
one.
Um, we could we could try this on the
next stream. Um, we could try this
potentially on the next stream just by
looking for the straightup symmetries
like group theoretically um in the
target machine
space. And yeah, Jordan Diaz is uh is
timed out for the rest of the day. Um, I
don't care if you're a subscriber. Don't
spam. Cool, guys.
Uh, cool. I'll think about it. Um, now I
got I got to get better. I got to get
better at sailing for I don't trust
myself in the
ocean. Um, thank you all for
watching.
Uh, maybe the test can be a CTF. I'm not
saying all tests are going to be are
going to be Google
uh are going to be Google Xeno's
dichotomy. Why people think infinite sum
is a good answer to it? Infinity is not
real, boys. Infinity is not
real. Um,
cool. Bye.
[Music]
God, that's some some backup.
All right,
let's go. Let's go. Got to get some
coffee. Yo,
going to need some coffee for all the
going that we're going to do tonight.
Get some coffee.
Your boy,
my friend suggested the Starbucks blonde
roast. We're here with the dark roast
right now. So, let's go.
Tonight, we're going to be teaching Mu
Zero to play tic-tac-toe. And if Mu Zero
can't learn to play tic-tac-toe, it's a
hopeless piece of shit forever. But if
M0ero can learn to play tic-tac-toe,
then it will be redeemed fantasy. I'd
notice you more if you were a
subscriber. So, make sure to hit that
subscribe button if you're looking
forward to tonight's stream. Let's go.
Let's go. $800 hoodies don't buy
themselves. You know, I need your
donations and your support.
Ah,
would I join the dark side? If the Jedi
became a bunch of like SJWs who push for
stupid causes, then yes. But I'm not
sure if that's what Jedis are. So, I
don't know, man.
We have to see. Really the question is
how cocked are the Jedis?
Uh no mashi
mas shi you will be noticed because you
are a subscriber and you have a star
next to your name. So you matter more
than people without stars next to their
name. All right, let's go.
Oh wait, I don't know why I hit that and
just hit that and hit that. Good. All
right, new Python 3 notebook. We're
playing M0ero tic tactoe.
Now, of course, tic-tac-toe is a little
bit different from cartpole. Who knows
why tic-tac-toe
is different from cartpole?
Does anyone know?
Uh, okay. We're going to want a function
called state.
We're going to want a function called
reset.
Reset's going to say let self do s= 0 *
9.
Um,
tic tac-toe has two players. That's
exactly. And I don't know why you think
tic-tac-toe is non continuous.
Yo,
no trolling here tonight.
There's a strict timeout on trolling.
That's right.
Ah, yes. The only winning move is not to
play. Oh, we can make it.
Do we want to parameterize it and make
it more than 3x3? No, we don't because
we want to finish something on the
stream tonight. No more not finishing
stuff on the stream. We want to finish
stuff on the stream. All right. How
should we parameterize the action space?
Should we give it nine actions
and make it lose right away if it tries
to take a wrong action? Yo yo, should we
get Muse to play global thermonuclear
war? I think maybe we should.
I think that's a serious
option
for us. All right.
Death step
selfact
uh if act
uh well yeah the action space is going
to be nine. A
gives us nine possible
actions.
If shape subact not equal to zero,
you lose.
You lose. You lose. You lose. Loser.
Uh
shape.
Oh, we have to keep track of whose turn
it is. E
[Music]
zero maybe. No, it's can be one's turn.
Shake out equals self.turn turn
self.turn turn equals minus self.turn
Turn
turn self.shape. Oh, I got to do
self.shape. Got don't forget yourselves,
boys. Don't forget yourselves. And all
this mess of big problem.
Don't forget theelves.
self.
And none. All right, we got to do one
more thing. We got to say
uh is winner.
Okay. Who wants to write this fast? Um
he's a winner.
Else
change turn. If self is winner, reward
equals 1, self equals true.
There you go.
All right. A little aggressive there,
but we got to check if is winner. Who
knows how to check for is winner?
Um
for I in range three if
ball
shape.
No, this isn't right.
Oh man, this is so difficult.
We're checking to see if there's a
winner.
Um
let's do I
if x= self turn for i in shape.
So that'll check the three rows like
that. Return true.
Um, we got to check the other rows. So,
how do we get that
fry? I am shape I
shape plus I
shape.
Am I writing this stupidly? Is there a
better way to write this?
I'm just writing the winner detection
code of tic-tac-toe. I'm sure we could
steal tic-tac-toe code from somewhere,
too, which might be a smart idea
because, you know, I'm going to write
bugs.
Uh, and then we got to check the
diagonals.
So, we're just going to check the
diagonals of ball self turn. And that's
zero,
four,
the middle square, three, four, five,
six, seven, eight.
is that square and then we're going to
return true. What if I reshape to nine?
Yeah, I could totally reshape. I don't
know. I didn't import numpy.
Do we care?
Do you even care? All right, that seems
pretty good. I'll take it.
All right, let's play a game of
tic-tac-toe. Should we write a test
class for tic-tac-toe?
I did import numpy. You're right. We
could just use numpy, but the shape's
not a numpy array.
Should probably be a shape. Numpumpy
array anyway. I don't know.
All right, let's play tic tac to self.
Uh, we want to say, let's see what we
wrote here. M
equals tick tac.
All right. I think if we just play it
now, we'll start with ru equals zero. I
think if we just play it now, it should
learn to just
um
m do reset. All right. Mep.
Yo, I'm gonna play the middle square
with X, boys. Did you guys see the
middle square with X? Oh, it didn't
work. Tic- tac toe has no attribute.
Shape.
Oh, why did I do shape? I meant state.
That's terrible of me.
What is all this shape crap?
Why did nobody tell me I shouldn't type
shape? I bet someone told me and they're
like, "Oh, I told you." Now, now you
never listened to me and now I'm going
to rage quit.
All right, let's see. Can I go to the
middle with X? No, X is not defined.
Okay, because I did for I in for some
stupid reason. Boys, am I tired tonight?
I'm coding so bad. I'm coding bad.
Tic tac-toe has no attribute shape. I
don't know why I'm so obsessed with
shape.
All right, that looks good.
Oh, should we have another state for the
turn? No, we don't really need to stay
for the turn. Tick, I try. Watch. You
want to lose a game? Let's lose a game.
Oh, wait. O can't go there. Stop. It's
cheater. Salt. Done equals true. Else.
Loser. Loser. O tried to play on top of
X. O's a loser. All right. Now, let's
try to play there. Oh, that was a good
move. Oh, man. Man, where's X going to
go? X is going to go there. Uhoh. Uh oh.
Where's O going to go? O's going to go
there. O's going to go right there. All
right. Let's go, X. Let's go. Let's go.
Oh, I played somewhere I shouldn't have
played. That was dumb. All right, I
lost. I lost. Tic tac. Let's try again.
Yo, I'm a winner. I'm a winner. X is
winner.
All right. Should we write test for tic
tac-toe? No, we don't need test. Where
we're going, we don't need test. Mark
these words. later when my tic tac-toe
has bugs and I'm like, "Why is it not
learning?" You guys are going to be
like, "George, I told you you needed
tests." All right. Now,
all right. We're talking about college.
We're not talking about tic-tac-toe.
Subscribers only chat. All right. Cool.
This isn't social hour general, boys.
This is time to play tic-tac-toe.
All right, let's copy over my great
quality MU model. Tic tac-toe is not a
very complicated game.
Yeah, Penguino knows what's up. That's
why you got to stay on topic.
Tic-tac-toe is your education. To be
honest, studying tic-tac-toe would be a
lot better than a lot of people are
studying in college,
you know, because at least if you study
tic tac toe, it's hard to study it
wrong.
But if you study, you know,
interpretive Russian dance, there's not
even a wrong or a right. You're just
wrong for studying it.
No hate for Russian dancers. There's a
lot of things that I feel are similar to
interpretive Russian dance. Not
problematic, but just useless for a nice
society.
Only if it's interpretive, though. If
it's straightforward Russian dance,
maybe that's okay. I wish I could let
Twitch Prime people talk. Um, so we're
going to turn subscriber only chat off
just for Twitch Prime people. But if
you're not a Twitch prime people, uh,
don't talk. That sounds good.
Okay,
have a play game function. Let's go.
Will it learn? Will it learn?
Tic Tac no has no attribute render. Oh,
we should write a render. Who thinks we
should write a render?
Write a render.
Uh,
remember that time that I said I didn't
want to write tests because tests were
stupid? Yeah, that was stupid of me. I
should have written tests.
Should we write a really nice render
function? Should we go like insanely
overboard and actually spend this whole
stream writing like a beautiful
tic-tac-toe board?
No, I didn't watch I didn't watch
AlphaGo.
Well, that's a shitty render function.
Sweet. Check my tic tac toe board.
It's going to look less pretty once I
take a few moves on it, though.
It's still kind of pretty
empty unit for rand range. Oh, because
this game ended too fast.
That's a problem in and of itself.
Is that a tab?
There's tabs in this ship.
Okay,
that's just a longstanding that's just a
bug with this stuff. Zikahala, thank you
for subscribing.
Who's talking about drugs?
Whoa. Body day,
are you Gio's goon? You are a new You're
a new account. Body day, you were
created today. You were created today.
Oh, that's a ban.
He's banned. Don't worry about him. Took
care of him. Took care of him with a
ban.
Oh, I have an update to Mac OS Catalina.
Okay.
All right.
What's a complaint about?
Yeah. Should we fix this? We can fix
this forever.
Let's fix it.
current index plus
and length self policies.
We'll say policy equals. You see the
problem? So, we were running over the
edge. We were running over the edge of
uh
the
I don't know.
You know what? I'm kind of bored. What
if we just spam the last action?
do the same thing here as well.
So the problem is once the game finishes
um we have k equal to three which means
that if k equals 3
uh
you need at least three game steps but
we're not getting three game steps.
Let's write something shitty called
extend
num unroll steps.
We'll write a crappy function extend
which is x and n uh while length of x is
less than x + = xus one.
Oh man, that's low quality code
to do.
This is low quality.
Okay,
it's lagging.
Yo, is this the first tic-tac-toe game
ever that lagged?
Oh, that's not even right.
That really was low quality code. That
doesn't work.
I don't even know why that allowed it,
but okay, whatever. That works now.
H.
Okay, it's playing tic-tac-toe.
Let's
copy over my plots from this guy.
It only has learned how to lose.
The code on the left is old code from
M0. So if you guys want to follow home,
follow along at home with this. Wow, I'm
sounding like Joe Biden tonight with the
verbal slip-ups. Got to got to put
coffee down. Too much coffee. Too much
coffee.
You need just the right amount of
coffee. Contrary to popular believe I'm
not on drugs.
I did drink coffee though.
That is true.
Okay. Well, I guess we can write it
because we know we're going to have to
write it soon anyway.
which is all the stuff that flips around
the value.
So, it was in the demo code. It was in
here and I just carelessly removed it.
It's called turn
Yo, what if we find a bug and we fix it
and then it works for Lunar Lander?
Okay, two play. This is just for
expansion.
Do you only need that in the MCTS?
Huh?
So, first off, it occurs to me that turn
can totally be a member of state
and then we can train on it. That'd be
kind of nice.
It's easier for the network to learn.
So, let's make Tur a member of state.
kind of like that quick just
kind of testy stuff. and we'll leave
that in this notebook. You can always
comment it out.
I don't know. I feel like seeing parts
of that last video, I didn't work too
efficiently at some parts. I just
spammed a lot of stuff and it's hard.
It's hard to keep up kind of like the
energy required to uh
to like do things the right way.
That looks pretty good.
Please answer your question.
Yo, if it works for Lunar Lander, I'll
be so happy. But I don't think it's
going to work for Lunar Lander.
Okay, this should at least learn how to
not
play in the same place. Maybe you want
to just try take one.
You know what? We need to play a lot
more games. I think
tic-tac-toe is going to be a mini game
kind of game.
Oh, look. It won. It won a game.
Yeah, this can easily if this works on
tic-tac-toe. Tic tac-toe is like the
minimum viable game. If it works on
tic-tac-toe, it should work on any uh on
any game.
Okay, I think we're just going to have
to You know what? Let's get our Monte
Carlo research working. What do you all
think?
Expand.
So, we're just going to add two play to
node. And then actually we should be
able to use Monte Car research to solve
tic-tac-toe.
I was thinking about while I was doing
this.
Why is this two play thing even here?
It's not used.
Well, it's used here.
Why?
So, sample batch can return whose turn
it is to play. Also,
I mean, it's in the states. I don't
really care.
The Net should learn to play best as
both players.
It's part of the game class.
And this is this is the whole this is
the whole tricky part.
And actually there's a tiny bug in my
tic tac toe.
We actually don't want to
I guess we do always want to give that
reward.
Yeah, because it's always your turn to
get that reward. Okay, so that makes
sense.
We're giving a bad reward if um
you make an illegal move.
Now is where I wish I got my Monte Carlo
research to work.
I don't think we ever want to do that.
The nice thing is we have a value
function. So we can test quickly if the
value function is learning.
Um
the value function.
So a value function takes in a board
position and it outputs who's winning
and who's losing.
So we can run it with m.htm.state
that gives us the internal dimension
uh which we also don't need to be that
big but I don't run that yet. And we run
m.ftt FT on it and FT will tell us both
the value and the policy.
Okay,
so
it believes that this is a losing state
for the current player.
We should also print the state for
reference too.
Is this state a losing state for the
current player? Actually, we'll just say
end render. It's nicer.
Uh oh, we should also say whose turn it
is in M.
Okay,
so this is likely to be a losing game.
Also, I'm not really sure what that
means.
Do I still rap?
Uh, made a pickaxe for strip mine and
demonstrations of sick time and
penetration is all online. A virtual
dick slide and then it hurts to be
misbrled and cults that never break. I
just came to fuck a bitch and skip over
the dinner date. Bigger plates and
insatiable appetites. I've heard the
come down is hard. It keeps me up at
night. Say bye to your small town job.
Stomped out by computerized mobs. Did
you put up a fight? Magnesium packed
pre- rolls in the back. When the light
comes, tell me who's holding the bag. I
see it. It's sad. Rage screaming pads.
Big teams them melters. Grew up just
like their dads. Another thing to move
past. Whiplash ringtone. Toe tags and
ankle monitors. In goods with the
monikas in good with harmonas in woods
with harmonas. In good with the new god.
They claim to be so tolerant. Disagree.
And they're all frauds.
Ah, bowl packed and passed to the
ratchet Socrates. Hacked to bits on the
altar of mediocrity. Phony lumberjacks
take a hatchet to meritocracy. Flavor
flave clock on my neck. Take a walk with
me. Midas was a little wrong. Everything
we touch turns to silicon. All optics
are gone in the octagon. I got to do
breath better there.
But the boys.
Okay. Um,
so
like
I think we might have to use uh the
current
because we can't just rewards are bad if
your opponent gets them.
No, no, no, no. We're trying to get M0
to play tic-tac-toe. That's what we're
doing.
And our goal is obviously to make them
all tie because it should tie against
itself, right?
What's up?
All right, we got we got to think this
stuff through because we're really I
think we're really going to have to
write a minimax search on this which we
don't have right now.
But we can also write we don't need I
think to go all the way to MCTS.
We can write like a normal minimax.
Let's write that framework.
And then we have a tic-tac-toe player.
All right. How quickly can we write
Minamax?
All right. Welcome to Python 101. And
you guys can watch me mess it up.
Okay.
So,
here's a pseudo code for Minax. Minimax
node.
Uh
we won't have a depth thing.
We'll just
say okay and a node. Let's set the
maximizing player.
Actually, we have the maximizing player.
Okay, let's let's write minimax on
tic-tac-toe.
Um,
okay.
should be able to reason out to the
depth of nine, right? There's not that
many.
So for each action,
we want to effectively do the step Let's
just write. Okay, we can solve tic tac.
Um,
you can just write something here called
transition function.
So remember the transition function
takes in a state and an action and it
returns a new state
uh and a reward.
So, if you have an invalid action,
we're going to return that reward.
Um,
otherwise, we're going to set
the action equal to
uh the states of minus one
and then if self is winner s
award equals one
return
award. Now remember this is a transition
function just like uh the one that we
talked about with view zero read me
here.
So sorry I called it a dynamics
function. We'll call it a dynamics
function. Can also be called a
transition function. It's the same idea.
Uh so we return the reward
comma the current state
uh else sus
one.
Now we can say reward s= dynamics on
cell state act. I should have written
tests then this would have been less
likely to break.
Uh if reward not equal to zeroals true
or self equals true
selfdynamics.
Cool.
All right. So now we have the dynamics
function for tic-tac-toe.
I mean really this whole MCTS thing
was optimized for cart pull pretty much.
It's minimax with extra steps.
Um
so
deaf minimax
uh we want to take an state
or actually say yes take an it.
Uh we don't care about the depth and we
don't care about the maximizing player.
So let's just first recurse the whole
tree.
Um
for each child of node
it's for each like state action pair
for i in range nine or say for a in
range nine
dynamics
s a
new state
Uh we'll put the reward there too.
Uh
if reward
max
for each child node.
value reward.
Uh and actually also
max
If sis is winner,
actually that's not right.
M do wow. I really I'm really not
thinking today. Okay.
If
you have a winner,
return the terminating value of the
node. So return s dominus one.
If you're the maximizing player, set the
value to infinity for each child of
nodes. We want to do this transition
function. And then we want to say value
equals max value
minimax
the new state
and that's just fine.
Uh, of course, if we're playing as the
minimizing player,
there's actually a simpler algorithm
here, I think, called Megaax.
Yeah, it's this
uh so return
color times the heristic value of the
node.
Well, actually, this is kind of stupid
because we're only checking the winner.
H I made a lot of assumptions here that
I should not have made.
Just call this the value function.
We check both of them to see if they're
the winner.
Let's just make one of the guys win.
No way to win.
That is a way to win.
Okay. So that we return down here.
Actually, that's not done. That's a
reward of one. What if we made the other
one the winner?
We're still returning a reward of one
which is technically correct.
Okay. Um if m value is not equal to zero
return
m value subs * s - one - 1 * - 1 is 1.
Yeah, it's correct. And then here we
want to just change this to that.
MD dynamics.
Uh
the same state twice.
not supported between none type and
float.
So we actually have to return the values
in minimax
that
doesn't work.
Print the state.
Does it actually take that long to
explore all the tic-tac-toe states?
Maybe it takes time.
The good news is since this is actually
just a function of the state. Well,
okay. How many states are there in tic
tac?
Nine to the How many states are there in
tic-tac-toe people?
Stop talking about drugs.
It's not too many.
Should be pretty fast. So, uh,
Python
mimoize decorator.
How is there an LRU cache, but there's
not a uh,
there we go.
unhashable type list. Do I have to make
it a fucking tpple?
Whatppel has no attribute copy?
for S.
This is terrible of me.
Okay. Well, it returned one.
That's not right.
She can find a way to actually win at
tic-tac-toe.
Make a tupalized decorator. Oh, that's a
good point.
S Lash tupalize.
You know what? I hate this. Anyway, we
should use I hate this miniax. Anyway,
we should use this as an excuse to write
our MCTS. Good. Uh, you know what? Let's
just leave that in case I terribly
regret that decision in a minute because
sometime I've done that and then I
retype things and that's really dumb.
All right.
Mike's very sensitive.
Yo, who wants to play some copyrighted
music? I'm kind of feeling some
copyrighted music right now. What do
y'all think? Copyrighted music. Not
three to the nine.
Why not?
Why is it not three to the nine?
Um, yeah. Yeah. We'll get on that
copyrighted music in a minute, but
So, I should be able to pass into this
MCTS search actually anything that has
an HT, an FT, and a GT. So let's make a
class called mock model.
This is a good idea. And then we can
define. Okay. So remember, oh this is
this is really great. This is really
instructive to teach you all how mu zero
works.
So
we have an FT function that takes in a
state and it's going to return it wants
to return the policy at a state.
Um which we're just going to make
uniform.
Uh
just one over 9 * 9. I can just say
that's the policy at a state and then
the value at a state is m value subs.
The representation function is just
going to be a pass through function.
Oh, this is really cool guys. Pay
attention here. You'll learn how mu zero
works
because this is like like a mock model.
Like we have mu model and we have mock
model.
Mu model mock model.
And it's nice because tic tactoe is an
explicit space.
So here we can return m.damics
s a
right now let's try my miniax search.
Uh, sorry. My my my MCTS search
from m0ero.
MCTS import MCTS search. Why is HT
representation? I don't know. That's
just what they called it in the paper.
So, let's pass in MCTS.
Uh,
let's reset the environment.
Actually, you know what? Let's not reset
the environment. Let's give it stuff
where it really can like win on the next
move. It should be able to win on the
next move right here. So, we're just
going to give it this as the
observation.
Then, for the MCTS search, we're going
to pass in
mock model
and the observation 1 through 10
simulations.
List has no attribute shape.
Okay. Well, that's what the MCTS search
said the policy was. So, today we
learned that the MCTS search is a piece
of shit.
Yeah, this should work beautifully.
But no, okay, we have moth model now. So
it's like it's like m zero but not with
mu zero. We don't need any exploration
noise.
All right. So, MCTS search
maybe 10 simulations isn't enough. Try
100.
How come it's not figuring out how to
win?
We can introspect into the mock model
and we can just print the state every
time it calls it.
These should be winning states.
Yeah, these are winning states for minus
one.
Oh, but I'm not taking into account the
turn.
Okay,
let's instead take one where one can win
on the next move. Let's just remove that
one and flip the turn.
No.
It really likes action zero. And action
zero is of course an incredibly poor
choice.
Huh?
No, we should like expand it out right
away. Even if we do zero simulations.
Wait a second,
you guys.
Let me just make sure I get this.
You guys,
look at what's wrong with my MCTS.
Look at what action I'm passing in here.
Look at the action that I'm always
passing in.
How did I ever expect that to work?
I'm always passing in action zero.
Oh. Always zero. Always zero.
Wow.
Dumb shit.
Oh, look. Oh, now it tries all the
actions.
I mean, it's still incredibly stupid,
apparently, but
I'm disappointed in every one of you. I
agree. How did you not see that I was
always passing in zero?
That was some dumb shit, boys.
Wait, also
I feel like I don't even want to do that
there.
I feel like those shouldn't even be
called there. And I feel like this this
thing knew that and for some reason I
just ignored it.
Yeah.
Well, these functions shouldn't even be
called here.
Stupid,
stupid, stupid, stupid.
All right. Well, we're making progress
now. We're going to write a much better
MCTS now that we've written a small
simple test.
All right, we can go back to doing
simulations. Now,
why is that none
Did I even try?
Did I even try when I wrote this or did
I just like just type crap?
Guess what, guys? Look what it learned
to play.
Uh what is it? MP set print options.
Suppress
equals true.
Look what move it learned to make.
0 1 2 3 4 5. It goes 0 1 2 3 4 5. And it
knows that's the highest value node.
Boom. And if we do some more MCTS,
probably gets it with even more
certainty. Oh, it's so sure after that
in the simulations.
Yo, I don't know what's this about Uber
shit. Yeah, remember why we switched to
naive search? Because we wrote terrible
Oh. Oh, that was low quality shit, boys.
It's low quality shit. Always zero.
Okay. Now,
let's see if we can get slightly Well,
all right. Let's also try Let's also
make sure and see if it can if it can
win as the other guy.
It can't.
It's pretty sure the right move is
seven,
but it has no idea why.
still likes that one
even when it's only going to put a minus
one there.
Oh, you know why it likes that one?
Oh, who knows why it likes that one?
Oh, wait. Now I learned to win
H.
That's really cool. Look at the move
that it considers here. This is move
five. Why might you want to go in this
position here if you're a player minus
one?
block a win. There we go. Look how it
knows. I think I don't know. I could
just be making shit up. For all I know,
it's calling action zero over and over
again.
We have to make a tiny change here to
value sum. Well, okay.
Let's let's set up a scenario where it's
minus one's turn.
I don't know.
value if no.2 play
Why are we talking about browsers and
Chromium?
Why are we talking about browsers and
Chromium?
Oh, see, I think it only figures that
out after it goes like really deep into
the tray.
does understand the only winning move.
So isn't exactly the value.
No,
this this is not the value. The state
may be one, right? So, when you think
about all the possible tic-tac-toe
games,
what I say about talking about browsers,
um,
when you look at all the tic-tac-toe
games, there's some that are won already
by X and there's some that are uh
already won by O. So, that's technically
what the value is.
I'm done with this. We have an MCTS
search now. It's so much better.
Okay, you know what? Just for fun. Where
does MCTS say it should make its first
move?
Just MCTS search alone is so fun. We
could just play we could just play with
MCTS search all street even without mu
zero now that we've gotten MCTS search
to work. Okay. Well, at that depth it
thinks a good first move is uh
Whoa. No, it thinks a good move is four.
Is that a good move? I don't know. Let's
remove that print.
Let's do a real deep MCDs search. Deep.
Wow. After that kind of depth, it's
really sure that the right move is to
play there.
Did it find a way to win?
Great.
Worst possible move, right?
Okay. There's still bugs in the MCTS
search. Yeah, we're going to have to
we're going to have to track the value.
Um,
where do we create a new node?
Node subchildren doplay
equals because it is a symmetric game.
Nah, whatever. You know what? Take that
out for now.
Only
sometimes
to play.
Okay. So,
the Vim theme, the Vim theme and fucking
Open Pilot. Like, guys, let's try I
think you're in low latency mode. Let's
try to have a real conversation.
Okay. Do Do you guys understand what a
game tree is?
Can everybody study this? Okay, everyone
understands a game tree? Perfect. Good.
Good. Good. Good.
Then
this is a game tree, right? You have the
current state of the game and then you
have all the next moves you can make and
then you get into all these states of
the game. So imagine that in chess,
right? You can move like for the first
move you can move all your pawns or you
can move your knights, right? Then your
opponent makes a move
and each one of these nodes has a has a
value, right? Every game is either one
lost or drawn before you start it in any
kind of game like this, right? When when
you're playing chess, I mean, we don't
know in tic-tac-toe. We know, right?
When the board is empty in tic-tac-toe,
we know with perfect play from both
sides, it's a draw. We know that. We've
studied tic-tac-toe. You don't count the
paths to win and loss. The minimax
algorithm works like this. You want to
figure out the best move for you to make
that maximizes value given that your
opponent from your perspective is trying
to minimize value. Given that you're
trying to maximize value or given that
they're trying to minimize value.
So how can you search a game tree? So if
you just look at this minimax function
here,
um this minimax function has something
called depth. And depth is uh
how far down the game tree you want to
go. Because with a lot of games, you
can't go all the way to the end of the
game tree because games are really long
and the tree is wide because a lot of
moves can be made. Uh that's recursion
depth, right? So what this is, this is
called Monte Carlo tree search.
So Monte Carlo tree search doesn't
when you're searching a tree, you have
two ways usually like the traditional
two ways that you learn in any compsite
101 course. are depth first search which
is to go from the top node all the way
down to the bottom and then you know go
back up or breath first search which is
this and then these nodes and then these
nodes and then these nodes. Minimatic
search is sorry um minimax search is a
breath first search because if you do a
depth first search you're not really
going to get anywhere um because you
know you'll get to like one game and
then you'll be playing down here. Um, so
Monte Carlo tree search is nice because
you can search the tree based on the
likelihood that things are good and then
you update this likelihood function over
time.
So if we like if we have something like
oh man this looks really promising.
Look, we can take his queen. You might
want to check that one that that that
path out.
Okay.
So we just say no to play.
And then here we have to multiply
the value sum for some reason. Now
remember I didn't really write this. I
kind of copied this.
Um we'll just say wow. If node to play
equals to play
uh
or root to play. Is that where that
comes from?
History to play.
Guess
we have to know whose turn it is.
is root to play but not exactly root to
play
node and reverse search path.
I see. So this is actually from this
perspective.
Why is this called node? I shouldn't
really call this node. I should call
this B node.
If node to play equals equals B node to
play
else value
minus value.
I think that's right.
See if that matches here. We should
really We should really work this one
out really slowly because it's fun.
History.addaction.
Yeah. History.append,
which means we've actually made a move
off of the root.
That might be negative or that might be
positive. I don't know. This stuff's not
really a good way to
Yeah, I mean we could fully solve
tic-tac-toe. We could we could write out
the miniax completely, but
okay. It still for some reason thinks
that one's a good move. So I don't think
that's right.
Let's add let's do some good old print
statement debugging. We can also I
believe I also wrote a function here
called print node. We can
print tree.
We can print the exploration tree and
get the values at each of them. So,
let's move a little bit up in the
tic-tac-toe game so we can get to a
point where we can actually win in a
reasonable amount of moves.
Well, in this case, it's tic-tac-toe, so
probably not win, but we'll see. Uh, so
this is policy and this is root. We'll
just call it node. Print the policy out
right here. And then we'll call print
tree on node. This will let me explore
the node. Okay. So
you see this top node here is when no
moves have been made. This node is when
X has played at position zero and when O
has played at uh these positions here,
right? So that's how far in we're going.
Um let's come up with a tic-tac-toe.
Let's make up a tic-tac-toe game where X
can win, but X is actually two moves
away from winning.
Can we do that?
say X go. Whoops.
Hate when I accidentally do that.
All right. So, X now has two ways to win
and O can't block them both.
For some reason, it thinks, yeah, this
is negative. I mean, I guess it should
be negative because it's O's
perspective. What if it's from X's
perspective? Okay, now it's positive.
Yeah, from O's perspective, it's
negative. Well, that's the final value.
I mean, actually,
is that what I'm printing there? The
node value? Yeah, I'm printing the node
value. That's cool.
I don't know why those nodes all have
zero value.
Oh, they have zero value because I'm
getting
value from there.
Should I print the value sum instead?
Value sum over.
Yeah, it's value sum over visit count.
Right. So, look at this tic-tac-toe
board here.
Um,
so if we want if we want to pretty print
it, we can do tic tac to obser now.
Yeah. Cool. All right. So now you see
it's O's turn and X has gone here, here,
and here.
So O's only move to prevent a win on the
next turn would be to go here. And then
X can win by going either here or here
after this. Yeah. Well, let's get this
to work first. We we discovered a major
bug in our MCTS where we're actually
just calling action zero over and over
and over again which actually now in
retrospect I don't think was actually
affecting the performance of it but it
was just wasting a ton of compute.
Um so let's find more bugs like that in
in MCTS.
Let's also let's print the count here.
So, this node's been visited 10 times.
Do we not get a
Oh, man. It's really interested in that.
Not interested in those because it just
seems to lose quickly on those.
Okay. Well, so when it's minus one's
turn, look where it learns to play.
It does learn the right thing to play.
It just takes a 100 searches to do it,
but it learns to play right there.
What? Korean food? Yum. What are you
talking about?
Sorry, George. I wanted to get a
reaction from you. Well, guess what?
You're muted again. Congratulations.
Um,
so it it's interested. Look, it learns
that it should play right there. Now,
let's assume it did play right there.
What does it learn now?
There we go. It knows how to win.
But that's a broken value for some
reason.
Huh.
It doesn't know when the game is over.
So, she's still searching and making
moves even after the game is over.
They can be pretty sure after 10. Okay,
let's replace naive search in the
trainer with MCTS search.
Is the model
sending an array element with a sequence
returning the node as well. How slow is
this? Is this insanely slow?
Feel like it might be insanely slow.
It's insanely slow.
Yeah, I know. It's not a very good
player. Where?
Oh, let's go back to what it was. We We
might be a little ambitious now with
trying to get this to work.
We're also probably playing too many
games again.
No, we probably have to play a lot of
games. I don't know.
MCTs are so slow.
Just learning.
Is it playing the same game over and
over again?
I feel like it is.
Yeah.
Well, that fell off a cliff. Okay.
If you do enough searches, it becomes
sure that the right move to play
It becomes sure that the right move to
play
is uh
zero.
Why does it think that? Which of those
have good value?
Does it find a winning move? It might
actually find a winning combination
here. It's 50% sure it's going to win.
I don't know what that's Oh, I guess
like this is winning.
four six. No, that's not winning.
But 0
six
064 is winning. This is actually a
winning state. Let me uh print the
reward as well.
Nodes do have rewards, right? They do.
He's not sure that's a winning state.
I don't know why he thinks this one's so
good.
He knows that that's a losing one.
I can see why it loses because he played
the same move twice. Don't do that. It's
a quick way to lose.
What do you think's winning?
064 is winning. No, 064 is not winning.
Wow, I was wrong.
Yeah, you're right about that
formatting. See, I love when you guys
are useful.
Where are the winning states?
All I see is losing states. Oh, but I
guess a losing state for the opponent's
a winning state for you.
It does know your opponent's never going
to make that move though, right? It is
doing some kind of minimax.
I don't know.
Let's do 5,000 out and see if it fixes
it.
Oh, now it just got so short that that
was the right move.
Why is the MCTS looking at moves which
are impossible? Because I don't enforce
a hard impossibility.
I mean, I guess I could, but okay. So,
they actually talk about that exact
thing in the M0ero paper. 047 is
winning. They actually talk about
exactly that in the Mero paper. Um,
let's go take a look at it.
Oh, I think also we're still only
training. Did I put K equal to one? K
one kind of sucks.
K= 3 sucks less.
Uh so you don't know the reason it does
talk about illegal moves.
Um moves
whatever. I mean, Mu0 can output uh
illegal moves in the game, but you just
have to teach that to be a loss right
away, and it learns to never do that.
I don't know why it's playing the same
game over and over again.
Why does it really like this game?
Someone thinks they're getting rewards
out of this.
Oh, we don't need to. You know what? We
can just do actually game history here.
Tactile.
Yeah.
Okay. All right. Who gets what it's
doing? This makes sense.
The It's getting a reward of minus one,
but it's player two, so it's really
happy with that.
The problem is this.
Yeah.
See what happened? See what I did?
I have to
Something's not flipping the reward
around.
Yeah. The whole point behind M0 is you
don't have to specify legal moves.
Illegal is probably the word they use.
There we go.
Alpha 0 uses the set of legal actions
obtained from the simulator to mask the
prior produced by the network everywhere
in the search tree. Mu0 only masks legal
actions at the root of the search tree
where the environment can be queried,
but is not performing masking within the
search tree. This is possible because
the network rapidly learns not to
predict actions that never occur in the
trajectories it's trained on.
Oh yeah, but look what it's learned.
It's learned right now that if it's
player two, the best thing that it can
do is make the same move, same illegal
move, because it's getting minus one
reward, which is as player two, it's
dream,
but it should never be its dream. It's a
shitty dream to have.
You should never dream of losing. You
should only dream of winning.
Here's the reward function.
Uh if xact is not equal to zero, but
like I did already I did write this
correctly.
And the other player is like sweet. I
love when you lose. And wow, player
player two just likes to lose.
It should flip with user. Yeah. So,
I've been really I've been I've been
listening to this. I really like it.
It's the Nash equilibrium of losing.
Real talk.
[Music]
It's all right.
I do track the state of whose turn it
is.
But
huh.
Well, okay.
Let's do an MCTS search using a real
model.
Yeah, look, it loves this. It loves this
game.
Yeah, look. It knows. It knows that it's
going to get negative reward there.
But I don't know why it still thinks
this is a good move.
Or
01, two, three. Why does it think this
is a good move if it has crappy reward?
We got to think about this, right? So, I
don't get it. I mean, this node has low
value, yet it's still sure that it's a
good note.
Are the other nodes really worse?
I guess it is just based on visit count,
but still, I mean, it loves visiting
that node. That's its dream. It's like,
oh, how can I visit that node more? I
mean, to be fair, it's better than this
note. This note sucks.
Is there an exponential reward? So,
training gets more risky every iteration
if it wins.
No, I don't think we need anything like
that. I think we just need to fix the
bugs. I think there's just bugs.
value sum if this node
if the node that I'm currently searching
equals this node
which I don't know where did I get that
from history.2play
which is the current H.
No, we've actually already picked an
action there.
Oh, no. We actually don't want to do
that.
This shouldn't be node.
This should be search path
uh minus one.
Right? Because okay, if you're down
here,
I don't know. Maybe two player doesn't
even
if I add an action to the history, it
doesn't change the player.
Should I just be checking for the the
route?
Okay, maybe
I don't know. It's easier to think about
anyway if that's right.
Okay.
Oh, good. Look, look. The value is a lot
lower now. I don't know why it's still
exploring this. Look, but it's okay.
It's flipping. It's flipping. It's
flipping. Okay. This node has a value of
minus one. This node has a value of
one.
I don't know. Let's restart.
the model again.
I don't play the same stupid game over
and over again.
Same crap.
Moiso
off topic.
All right. It's learned that if it plays
the two move again, it loses. It loves
losing. You know, some people just can't
be helped. Like some people love losing.
I think there's probably people in the
real world who love losing and I mean I
don't know what to tell them. Let's put
on some non- indie music that talks
about this
root.
Oh,
I forgot to do this here. root.2play
root. Subi.2play
equals minus roottoplay.
I'm not doing this very methodically.
Oh, well, at least it's not learning to
play eight again.
No, it does. It's learning to play two.
Oh, it tries zero. It's like I don't
know. It tries one. It's like I don't
know. It's like two. It's like, "Oh, I
lose. Oh, I love losing. Oh, losing is
my favorite thing. Oh, if you told me I
have to lose,
could I please get rid of the address of
the object?" Yeah, I can do that. Yeah,
you're right. That's kind of useless.
I think it found a more efficient way to
lose.
Oh, now player one's getting in on the
losing.
It gets a terrible value for it.
It is some off by one error. Yeah. No,
they both love losing now. No, they're
just losers.
I'm writing a much improved print tree
function.
Number is required not a list
number require not a list. What?
Not all arguments are converted during
string format.
I think we're going to actually visit
Count First,
sorry.
And something's broken now because it's
become confident
that going there is a good move
when it's going to lose in the next
move. If it does go there,
That was a value sum of 143, but it
really shouldn't be 143.
This is a bad position for you to be in
if you're in
You know what? Am I getting the turns
wrong? We can check that.
This is with minus one to play
and for some reason it evaluates this
position as a good position.
M0 is the D mini.
The reason it's using my CPU so much is
because I'm streaming to you fucks.
And that's using my encoder and it's in
software cuz nobody can write the
driver.
We use a little more coffee.
[Music]
If root to play equals be known to play
else value.
No, maybe that's hopeless.
Now it's learning an even stupider move.
I don't know, guys. This doesn't give me
much hope for computer intelligence.
Oh, it's very happy with that.
Oh, am I still keeping in midmax stats?
Let's get rid of that.
Shouldn't
need a max for any of this.
All right, good. Now it doesn't stupidly
scale them anymore.
Even though it is very sure in a
non-winning move
seven
It really doesn't like winning.
Can't go in any of those. So, it learns
quickly that those are illegal moves and
it doesn't search them any further.
It's minus one reward. So it comes up on
the first legal move which seems to get
a totally trash reward. I don't really
understand why because this here is a
one
Oh,
Okay, that's a smarter move. It's still
learning that this is a bad value state,
which I don't get. It should be a good
value state.
Well, if you go there, that's going to
have a bad time, but
that's just wrong pretty much what I
type.
I think make this nine.
We do nine NCTS simulations. It
correctly realizes that it can play at
zero or eight.
Sorry, six or eight. It'll win with both
of those.
But for some reason,
I don't know if this matters, but should
I be switching the turn even if
should I be switching the turn even if
the game's over.
No, the game's over. I don't know. I
don't think that matters here.
So it makes sense that this is the visit
count divided by
the value sum.
But the value sum, these values
are being inverted
because the root player is not equal to
this node player.
Because
yeah, I mean it is that problem, right?
What's happening is even though it plays
six, it wins the game, it still thinks
that it's the next player's
turn to win.
like because it got the value on the
next player's turn.
Show the rewards again.
They're here.
I mean
Tic Tacto is not a symmetric game at
all, which is kind of nice.
Yeah, it's
negative on those.
does still search them for some reason.
Oh, because there's a reward plus a
discount times the child value. So,
that's still actually worth searching
because the reward is positive.
I don't know if any of these should
actually be negative at all.
team is very excited about that move,
which is a stupid move.
This is how we got to play.
You mean how are the six plays already?
Oh, I just put them in.
I just arbitrarily set them.
understand why make target takes into
play.
It doesn't mean to.
This is almost right.
So root dot to play is one
and b node to play here is minus one.
So value sum plus equals minus value on
this state.
We got to put the coffee back over here.
All
right. I guess this is what I get for
copying code that I don't fully
understand.
Bad me.
Traverse down the tree
according to the
score.
Now we're at a leaf which is not
expanded.
run
dynamics model.
That's to make
the policy
value.
Use the policy.
Use policy as prior.
Node children
create
children of the newly
expanded node
update the state with bad propagate.
Okay, so we're going along the search
path. The first node that we have is
not the most child node because we
created all the new child nodes.
But
they have pseudo code here.
They don't
useful comments in code. Thank you.
2BS.
Okay.
Back propagate
node stats. Update stats.
This is the shittiest pseudo code ever.
Oh, Monte Carlo research for a
tic-tac-toe game.
It was written in like Java or some crap
and they misspelled back propagation.
We're trying to get Mu Zero to play
tic-tac-toe. You know what? Once I get
the MCTS search playing, Once I get the
MCTS search running, we're going to play
against it and see if I can beat it.
As soon as we get it over this stupid
crap,
like after we're past these obvious
things, we'll just play the MCTS search
and we won't even have to play the uh
we'll do the model later.
All right.
So, we want to figure out the value of a
node.
value equals node to play
to play which is history.2 to play,
which is an action history. And despite
adding the action, it didn't flip the
It doesn't make sense, right?
No, this is just wrong. Like, I think I
had it right before.
Yeah, we want to know kind of where
is that right?
Okay, I mean that works.
That at least has a coherent answer.
Try this one.
This one says you're screwed kind of no
matter what.
Doesn't even try expanding out one. Why
does it think No.
Why does it think there's any value to
this state at all? I didn't really run
it very long.
Yeah. Okay. That's telling it to play
there. I think that's right. That's
telling it to play there. Okay.
Are we ready to play against Monte Carlo
tic-tac-toe? Let's play against Monte
Carlo tic tactoe.
Um,
so first we want to say
GG equals tic tactoe.
Um,
gg.state.
Should we let it go first or should we
go first?
GG.act.
No, we want to pick something from the
policy. So, we'll say gg.act act
action equals MP do.
I wrote this in model.
Where's act with policy? It's in game.
Here we go.
Uh gg.step act
All right.
GG. Render.
Okay. That's where he played. A she is
it a she? No, he went first. Look, he
made a stupid move, guys. Let's take
advantage of him.
Let's take the middle.
Zero. One, two, three, four.
Okay, his turn.
He went there.
Take that corner.
Oh,
that was pretty dumb of him.
He went there. I have some bad news for
you, model. I have some bad news for
you. I go there and I win.
All right, let's focus on that state and
figure out why it was dumb there.
Minus one, one 0 one - one 1 0 0
and it's minus one's move.
Huh?
Oh, wait. That was my move.
No, no, no, no. So, let's actually go
back one.
Yeah.
It doesn't know what to do here.
Oh, but if you give it more compute, it
does.
It eventually figures it out if we give
it more compute. It just wasn't a good
enough player. Okay, let's give it more
compute.
Why it needs all that compute, I don't
know. Okay, it went there.
It's true. I have big brain and it
should, you know, it needs big brain,
too. Okay, I go there. Your turn. It
went there. Uh oh. Uh oh. It's coming
for me. Zero. One. Two. Three. Four.
Five. Six. Let's go.
Oh, it went there.
That was pretty dumb.
That's pretty dumb, broki. It's pretty
dumb. You know, I'm very good at
tic-tac-toe. You know, I don't know if
anyone's ever told you that before.
Sure.
It has to go there, too. Should we get
it more?
Well, it's even more sure it has to go
there.
It hasn't learned yet about blocking
moves.
No, it does not really need comput more
computer for tic tac toe. I'm just
making
Okay. How come it hasn't learned about
blocking move?
Let's learn that's a pretty low value
state. But why does it think that last
one's a high value state?
What possibly gave it hope?
It thought I was going to go there. Does
it think I'm an idiot?
I think he might be getting excited that
I lose
by making stupid move.
Eight
goes there.
It thinks I'm going to go there to block
it
and then it thinks it's going to go
there and win.
Little shit.
It goes there.
Wait, no.
It goes there. It has to realize that
once I go there, it loses.
I don't know. Let's get greedy and try
it with the model.
Will it play the same stupid game over
and over again?
Oh, it likes losing. Sure
does like losing.
Let's reinitialize the mute model.
No, there's bugs.
Look what it's learning to do now.
Does it understand why it's stupid?
I don't know.
This stuff's so hard.
Think those are all losing.
His
favorite move there is 88.
Why is it just picked randomly?
Great.
T audio.
Oh, we're back to this bug again.
I mean, it's not really a real bug, but
when they all have the same score,
it picks the highest one because action
is the second thing there.
My money car research is broken.
a child where it computed the reward.
How come that's not being used in the
value?
I guess because it just goes to the
above one.
That was the reward for that transition.
Oh. Oh, it blocked me
and it threw it all the way.
go over line by line your MCTS. The only
thing I don't really understand is this
value something
Well, so the idea is that you want
negative values if you're one player and
positive values if you're a different
player.
But I think part of the problem is that
might be root.
No, no, no. It's not root
because this value is from
Okay, let's write a few tests.
Okay, in this scenario,
it should always play.
Why is it playing seven? It's not right.
Okay, in this scenario, what should it
always play?
It should always play two to block the
other guy.
It is a tie game, right? If he plays
there.
No, it doesn't even matter. So, this is
actually that's not a good test.
there. It should always play
minus one's turn here. should always
play three
or two. I mean
the SL sign flipping is supposed to be
happening. Yeah.
So that works.
All right, let's play it again and then
let's add a test for everyone where it
gets it wrong.
All right, he went up there. I'll go
here.
He goes there. Now I'm going to have to
block him. 0 1 2 3 4 5 6
He has to block me. He did not. He is
idiot.
Why not?
Why didn't he block me?
We can add this test in. You guys all
agree that you have to go right here if
you're playing minus one, right? Or
you're playing one.
I go there. He goes there. Yeah, it
doesn't matter. It's a tie.
If I put more search into it, he even
more stupidly decides to go there.
You know, I should fix that bug.
[Music]
Okay.
Smax
equals
for X and out.
uh
s max equals the max of that. Then we
can say random.choice list filter
lambda xx sub0
not equal to s max
out.
That should fix that, right?
Cannot choose from an empty sequence.
What?
But it has to. It's like,
oh, filter where it equals S max.
I've got a different wrong move that's
very confident about.
At least it's gonna stop spamming the
last one just because it's good. Well,
okay.
That's not good.
That's not good either. Why?
But I don't know if these values are
represented in the other frame or not.
I really think it's just the rewards
that I want to flip, not the value.
I don't really like thinking about it
that way. I just want the reward to go
the other way.
I don't know.
So reading the pseudo code, they put
node to play equals to play while
expanding the root.
Where do you see that?
No.
Explores that one a whole lot.
That isn't right.
What?
Oh,
heat.
I could just do that. I don't actually
need this next
Maybe I do.
Put the sign
there. Did they flip the sign there?
Oh, that's that temperature thing.
Could have had a temperature there.
By the way, it's interesting on this
one.
No. Uh, what did I actually want to say
here? I want to say policy
equals a maybe
on this one like look it it's split
between those two actions
and the ax
don't split anymore like just doesn't
make sense.
I guess X for pretty brutal like that.
And that one kind of has no idea where
to act.
That's easier to look at. I think
so. On this board, it knows not act in
any of the dead spaces, but otherwise it
has no idea.
Flip sign at
Do they flip the sign there?
It does kind of make sense that you'd
have to.
They don't.
See you DVO MC.
Yeah, it's very unsure among all of
those.
But now if it doesn't go here, if it
doesn't play two
How does it not imagine just losing with
like the onetwo punch?
Okay, that has positive value for some
reason.
It shouldn't
should have a negative value I feel.
Where's the pseudo code from the paper?
It's here.
Like we're asking a question about that
state, right? So we're asking a question
about this state.
This state has some amount of negative
value. That's fine.
That state has really high positive
value.
Don't think it should
because that reward is
Yeah.
Well,
how are they defining the reward?
Could they have their rewards flipped?
Because I didn't really think that
through. I just kind of took it. But
like I don't understand in their game
what are they doing for reward
this guy's m and say
games
tic tac
how complicated it all is.
Reward
Self have winner as zero.
This is This doesn't deal with whether
the action is legal or not.
Sit up straight.
Oh, and Slickie is gone. He helped out.
[Music]
sees the things like one, two. Okay,
that gives it a positive reward. For
some reason, it keeps exploring that.
That should not have a positive value.
That should have a very negative value.
I don't know why that value sum
reversed search path.
Okay, I think everything we need to know
we can learn from this one example.
Why is the value sum of that low? Let's
see. Can we can we just do less of these
and still see the problem?
No.
get to one two if I do that.
Yeah, one two is the whole problem.
That should not be positive.
That's negative. You don't even get
another turn, bro.
So
I pick something entirely different.
Didn't even expand. One, two.
Their
value is always plus one for the winner,
but yours is + one for + one and minus
one for minus one. It shouldn't be.
Oh, you're totally right.
Yeah, you're totally right. Wait.
Yeah.
Did I have that wrong?
gives me a reward there.
You're not sure if this is like the
minimax.
States has positive value.
No, but like the model should output
minus one.
No, but the model doesn't know whose
turn it is.
Okay, we have to answer a few questions.
Do we want the model to output?
I don't think that's right. Actually,
I think I had it right.
I'm using the same network for both
players, right? So, we wanted to look at
the board and we want the value network
to output minus one if black's winning
and one if white's winning.
But if that's true,
I I wonder if their network recurrent
inference function is actually flipping
that around for them.
Now it's doing the right thing.
Now it's outputting that.
Okay.
Our
model
outputs value of one
for white winning
and minus one for black winning.
Do
we need We don't talk about coming out
here. Change
this.
Yeah, I mean it is kind of like Nega.
Okay, the tests are passing. Let's play
it and see if we can get another test
that fails.
Okay, it went there.
What a move. I'm going to go in the
middle.
It went there. I'm going to block it
over at six.
It went there. I'm going to block it at
one.
It went there.
I'll go there.
It goes there. GG.
Okay. Tie game at tic tac top.
Let me see if we can get it to pick a
different first move. Okay, it went in
the center.
I go up in the outer corner.
It goes over there.
I'm going to need to block it at three.
I feel like I'm going to make a typo and
I'm going to lose to this thing. It
blocked me down there.
I go up there.
It goes over there. All right, we're
making progress. Progress, boys. 0. One,
two, three, four, five, six, seven. I
have to block it. You know what? I I
just want to say I'm going to lose on
purpose. Okay, we'll see if it beats me.
Well, it didn't have any other choices.
Wow. I was really confident in that
move. All right,
we're not actually playing yet with the
thing that we learned. Oh, it made a
different first move. Oh, I love Monte
Carlos research now.
Oh, yeah. I'm going to go there. All
right. No, no, no, no, no. Let's be
clever. Let's try to trick it. Who
thinks we can trick it?
All right. Come on. Twitch plays
tic-tac-toe. Let's go. Where do you want
to go?
Top right. All right. First one to yell
it out. So, all right. We took top
right. All right. It goes now.
It went there. Right. Where do you guys
want to go?
Zero. All right. Let's go with zero.
All right. Where do you guys want to go?
bottom right. All right.
Where do we go?
Wait, what?
Oh, wait. Did I beat it?
Oh, we won. Oh, I didn't even see that.
Wait, what state was that in? Where did
it go?
Oh, we beat it with the three on the
outside move.
Wait, how did we win? How did that just
happen? We tricked it. We won. All
right. Well, it's not that smart.
Yo,
yo, you guys on Twitch are good at
tic-tac-toe.
All right, but let's see. Maybe now at
least we can play. Let's try to play
with the uh the model.
No, it's printing out a lot of bullshit.
We can comment that out.
Where is that?
I already commented that just didn't
reimpport new re import MCTS.
Why is it printing all that crap? Where
is it printing all that crap?
Oh, that was a naive search. Oh, it's
here.
Yeah, you guys beat it, man. It's
depressed now.
All right.
It's still learning how to lose.
Stop losing.
I'll link it with Twitch tac. I forgot
that we did that stream.
Can I describe my MCTS imple MCTS
implementation?
Uh, I can commit it.
I mean, I'm the MCTS kind of works now.
All right. Do you want to play it in
Gigabrain mode? Let's play once more.
Well, how did we Okay, how did we beat
it that time? I don't understand.
Like, I really honestly I wasn't even
sure that we won.
We win now, don't we?
If I go there.
Yeah.
So, let's set that board out.
What are losing moves here?
That's a winning move. Actually, I might
have just got unlucky with the sampling.
I'm not sure that it wants to go there
after a thousand
gigabrain mode.
Okay.
Numpai Softmax.
Yeah, this is the right way to do this.
I've read this before.
Just fix the nan issue.
We'll fix the nan issue in gig brain
mode.
Am I lost?
H
what happened to experts exchange? I
don't know.
Okay, this thing doesn't work though. I
mean, maybe it's just cuz it's on like
really ungrate mode.
Let's try K equals one again.
I should just learn a decent policy.
Actually,
just going to put in the fake model
here.
With the fake model.
What do we think?
Oh, we forgot something.
There's another way for the game to end
that we didn't that we forgot.
Uh,
if np.all
or npn none. Is np.none a thing.
Okay. Actually, I could just say if
np.all self do
uh np.array self.state
um 0 through 9 is not equal to zero.
Then self equals true.
All
right. Now, we're training with the fake
model. We're not training with the real
model yet.
All right. Good. Look, it got a tie
there.
I don't know if it's learning.
[Music]
Well, O never gets to win.
Actually, I'd never know if O gets to
win because reward is always one. I
guess O does win sometimes.
All these eights O wins.
These nine is a win for X right at the
end.
Yeah, but it's machine learning
tic-tac-toe.
You got to realize that when you add
buzzwords, you add code. If we wrote
blockchain tic-tac-toe, oh man, that
would have so much code.
Blockchain tic tac toe would have
ungodly amounts of code.
Okay. Well, it's not learning great.
But let's now change this to this and
we'll give it less.
It should be very smart with what it
expands
because it has a policy model now.
Oh, exhaustive search tic tac toe. Yeah,
yeah, yeah. Those aren't buzzwords. If
you tried to sell your startup and you
said it was using exhaustive search,
they'd look at you and be like,
huh?
Policy of losing
French military defeats.
Yeah, it seems to be very happy just
playing this game over and over again.
The good news is we fixed MCPS.
I think.
You know what? We can refer to the paper
and see what they did for that.
refer to the paper wall clearance. I bet
they actually talk about what their
model predicts
with respect to value.
I don't know why we didn't read the
paper before.
Can Muse be Bobby Fle at what?
Doing the cooking by the book.
Ah, this one. You got to watch the
remix. Now I remember
the book.
Let me see you back up.
Let me pick that motherfucker.
Rub that shit.
Okay, that's not going with that. Yeah.
Um,
viral Vinnie 4Z, thank you for
subscribing,
we're having this beat. Where where were
we before? Where did we leave off?
Where did we leave off with? Uh,
oh man. See, now now I don't really
remember. I was I was writing this a
little bit while I was in San Francisco,
but
all optics are gone in the octagon. All
drop kicks and no politics. All hot
takes and no hot takes. Don't pray just
to eat pancakes. Be so far gone when the
damn breaks car alarm and jailbreak and
immobilizer. Hail Satan and hold your
sides in a roller coaster with broke
lights. Hope driven by poltergeist the
olds. When all these shit rides and
trade all in a future where oh nobody
who's sick dies and oh no no nobody will
get fired and know nobody will doubt
lies. Oh I think it's about time. It's
rotting from the substructure clotting
deep in the constructs. It's burrowing
and hiding and bribing people with shroo
bucks but people keep on riding to an
oompa loompa future. When you think the
ride is over it gets stupider and
stupider and they're hiding horror
cruxes in all the Starbuckses watching
you dumb fucks. You sit about which old
duck amongst them. You think that should
rule you? Argue that we all should pay
them to school. You put you in a
classroom. Duck duck apple strudel.
Assimilation. Resistance is feudal. They
came for your future. They came for your
memes and you all bought in so no one
heard you scream. These sick Michael
Vicks like you chickens to cockfight or
stay in a room and be sucked into
Fortnite. But look at their strings and
show up with your scissors. And when
they turn them back, stab them in the
liver, the gizzard, the heart and the
mouth and the eyes. To rewrite the
future, these people must die. See, I
dream of a new dawn. A red sky and a
blue lawn where we know words are
harmless. And we can play with open
arms. And we can say that word is play.
Or we can say that work is gone. But I
know either way, our way of life will
still live on. From cells to monkeys,
Neanderthalss to junkies to
propagandists to oligarchs, the internet
will stomp their hearts.
Yeah, this is what I was doing in San
Francisco.
Yo, no, but real talk. Actually, I need
a producer.
If you guys know anyone, I need a
producer and I want to sound like
fucking Drake, man. You know, like I've
heard Drake in person and Drake in
person sucks. And then Drake gets on the
mic and he sounds like Drake. So, I need
someone to do that, you know?
for me. I need I need like Drake's guy,
you know.
Who is it? E40. Not E40. Who's the guy?
40. Ali and me. You know,
Play Syllables by Eminem. But that's too
copyrighted. We're trying to stay away
from the super copyrighted shit. You
know, it's just 40. I know. I know it's
just 40. It's 90. I'm playing. Um,
the same squared error loss is used for
rewards. This still doesn't answer the
question.
Yeah. No, I got to get I got to get some
autotune.
Could we have Do we have autotune?
Look, I got I got headphones here. Pull
my mic out. That's how I rap.
Yeah. 40, man. You think that guy? Maybe
sound like Drake.
compressor. Yeah. Yeah. Yeah. No, I know
about that. I know about that. About
that on Garage Band. I learned about
mastering.
I mean, actually, I guess we know
Well,
I guess actually we know that it's not
by the fact that MCTS needs that extra
thing and they didn't have it.
I guess we know that the model doesn't
do that. So, let's comment that out and
then let's change it to what one of you
in chat suggested before
um
to be this.
And I guess they are putting the the
person's turn in
and that flips the uh
the Logan Paul vlogs.
I hope y'all get I was being ironic,
but I was a Logan Paul fan for real
briefly.
But, you know, be a maverick. Watch some
Logan Paul vlogs because so many people
watch Logan Paul. H, you know, I'm not
going to go.
Um,
it doesn't work anymore.
So, if I comment that out,
I don't get it. That should literally be
the exact same thing
except for that first one.
that works.
Yeah, you got to write unit tests, man.
You got to make sure the test pass. You
got to write unit tests.
See, like I didn't do that up here.
Well,
huh.
Because we assume that route to play is
always Oh, no.
I do observation minus one.
Oh,
I guess cuz I'm never putting in I guess
I do need that there, too.
But it just doesn't matter because it
never is actually a uh
because it's never a terminal state,
right?
All the tests still pass when we do
that. Cool.
Should we write computer tic tac like
normal computer tic tac toe to battle
against this?
That might be that by the way might be
the problem with why this didn't work.
Some chance
No, it's learning stupid.
Why does it think those are good ideas?
Actually, it's playing a lot of games
without seeing now also.
do that.
Why is it doing this dumb crap?
What? Okay, you know what? I'll have
MCTS selfplay. Why don't I have MCTS
selfplay and we see what we get?
I'm going to leave this intact so I can
play against it if I want to by hand.
But we're also going to write the
computer verse computer MCTS.
Oh, we didn't try to play it as player
two. We only played it as player one,
boys. We only let it be player one.
You know,
look, it's not very good as player two.
Oh, it only knows how to play player
Come on.
Did the chair change color?
All right. Wait, wait. So, we're going
to play tic-tac-toe,
but in this case, the human's going to
go first.
It's not very good at playing player
two, I don't think. I think we found its
weakness.
All right, I go first this time.
Your UCV score is wrong. Doesn't take
player doesn't take my player into
account.
Oh, I think you're right.
Yeah. Does theirs?
No, it doesn't.
Theirs doesn't take into account the
player the turn either.
I mean, I have to just work out really
what's going on with that.
All right, let's go. Tic tac to top. We
go first. Where do we go?
Also, let's see if we have any food.
Damn.
Yo, like I had this girl over and she
left Chinese food here and then I texted
her and told her she left the Chinese
food here and then she came back and you
took the Chinese food and now I wish I
had the Chinese food.
All right. Yo, chat, where are we going?
Going to one. I'll take one.
Rookie move. Don't worry, it's bad. I'm
going at four.
Oh, yeah. That's right. You suck.
Okay, let's add that to the test suite.
Yeah. Why does it go there? That's
stupid. Actually
should be seven.
That time it got seven.
Just doesn't always get seven.
Sometime it gets eight.
H.
I got five.
Okay.
Let's get rid of that.
We just moved into the value function.
So that should be okay.
No, the tests don't pass again. I don't
understand. That should be exactly the
same thing.
I missed that. Maybe
this doesn't make sense.
We're doing nega max on where each node
represents its score. That's why when
they back propagate, they back propagate
with value. If you're doing it the
minmax way, no, I want mega max because
it's simpler.
Yeah, you have to invert. You have to go
negative on that.
I guess I just don't really understand
how that can be different.
some I get ones and I get that
node to play should literally be
times minus node to
Was that even right?
Just two.
Round seven.
I don't know.
I don't know why that hack worked.
Okay.
I guess what I'm confused by is when
does node to play not equal node hidden
state node to play.
It's always equal.
assert node hidden state
equals node hidden state. So minus one
equals equals node to black.
Yeah. Okay. They're always equal.
I multiplied it by negative.
So if I take that and I put it in this
function
instead of in that function,
how does it behave differently?
All FT does is puts that into the value.
I'm multiplying it with something that's
equivalent to node to play.
Multiplying anything by zero is zero.
except a terminal note.
Megaax, we never care except terminal
mode.
Well, I'm just from a straightup coding
perspective, how is this possibly
wrong? Unless I we can assert this value
is zero.
That works. Okay.
But now
That works. Okay,
that actually works all the time.
What if they both win?
But if I multiply that there by - s -1
and I get rid of that,
it doesn't work.
Yet I assert
that node.hidden state minus one equals
node to play.
Why can't I move the multiply into
there?
Oh,
I know why I can't. because I call it
here.
That was stupid.
still behave differently.
Now it behaves the same.
All right.
Yeah. Okay.
I mean, in order for this to work,
value needs to have the same cardality
as reward,
obviously, because it's in make target.
Even though two play is being passed in
here, it's not actually doing anything.
So, a positive value and a positive
reward need to be the same thing.
I think that minus still might be okay.
Still being stupid.
Oh, I guess it does. Well, okay. Wait.
It doesn't have a choice there
right there. I Well, no. Again, I didn't
have a choice.
Wow. Player one is clever.
Player minus one won that one. Let's
add that test case.
what you're not super confident in that.
Somehow it switches over to that. How is
it finding this degenerate shit?
That
Negative reward is always bad. How does
it get a positive value out of that?
I guess because it still gets the
negative reward here. It gets the
negative reward a second time here
and that becomes positive value because
the turn flipped.
I mean, this is just degenerate shit
because of the uh because it's running
off the end.
Okay. All right. All right. All right.
I'm confident the value thing is fixed.
Yeah, because it's flipping that around.
So that's why that's
node hidden state one equals node to
play.
Oh yeah, not true.
Once you use the model,
why does it play these degenerate games?
The generate game.
She just get negative reward for that.
Should get negative reward no matter
what.
The rewards don't flip signs.
Um, we can actually,
you know what? What if I add game over
to the state
and after the game is over?
There's no uh
Yeah. What do you think of that?
We'll call it state minus two.
I'll just This will just be the winner
bit.
Um
uh
if s sub 2 = zero.
It's not equal to zero, which means we
already had a winner.
Uh
then zero out the reward
here. This has the winner is minus one.
Okay, that seems good.
So, it won't give any rewards past.
That one takes a little longer to figure
out for some reason. We can make these
all thousand.
My unit tests.
Unit tests.
Shouldn't do weird degenerate bullshit
anymore when it plays against itself.
Tie. Tie. Tie. Tie. Tie.
Not tie.
Why did it go there? It could have went
there. Okay, here's a test case.
We should output. Let me print the
policy, too, just in case.
It's just getting unlucky.
Stupid. Real stupid.
Went there.
Right move. There is one.
I should put these tests in a testing
framework. Now
yeah, why is that wrong?
Look, I wrote you. It's unit tests. We
love unit. How come it's right over
there?
What's wrong up there?
Now it's wrong. Okay, let's take a look.
I wish printing the tree was more
useful.
Okay, that one's bad.
It's pretty happy with that one as well,
but I don't know why it ever likes this
one.
No, like you lose already.
Why does that ever give reward?
014.
It thinks it can win.
And to be fair, it can win if it does
that.
It loses much sooner.
Thinks of all these ways that it can
win.
But yet it doesn't realize that it's
going to lose on the next move.
Really likes that zero.
It goes here.
The opponent goes here. It goes here.
Oh, it likes that move for some reason.
Look, it like it gets excited because it
like wins if it's like tons of moves
down the
No, that's not even right.
I'm not going to print the nodes that
have a visit count of zero.
They're useless.
How did it get so many visits in some of
these stupid nodes
here? It thinks this is a great game of
tic-tac-toe here
despite it having a value of actually
zero.
Zero zero
3 one two five it ends the game
doesn't understand if it goes at zero
the other guy's just going to go at one.
Yeah,
that ends the game with a loss for you.
All right. Should this be plus
That's plus. Then we have to invert
something else.
You can certainly make an argument that
it should be plus
then that can't be
that actually doesn't matter if I use
root there instead of search path.
The one that it can't do, it still can't
do.
Does it matter if I invert it at all?
That test fails now. So, some of these
have to be inverted.
That works just as well.
Okay. In Nega, you only invert the last
one.
The zero sum property of a two-player
game.
Yeah. Return color times the heristic
value of the node. That's what we're
doing here
for value.
Which is weird is this minus and reward
here.
Oh, it could be plus.
Then I have to switch that around.
the heristic value of the node
before I flip this.
No, no, no. That's all right.
Yeah, because that means you've lost.
Yeah, that's that's one because now it's
Yeah.
Player one's turn.
Wait, no, no, it's player one's turn.
That's the return from the step.
And player minus one just beat you.
You should not be happy.
The value of that state from your
perspective
should be just that
lose it.
That seems okay.
That one fails.
Why does it continue to expand that?
Do the select child. You want the worst
child in Mega Max, right? Do I?
No. The max the best one
for each child of node.
Let's play generic games.
I think that's wrong is that last one.
I'm worried that like so much can just
have value - one. Five.
I mean, I guess that's part of the
problem, right?
Even though it might know very know that
this node
is okay
like the value function is giving that
node something. We can check it.
It's giving it minus
minus one.
Shouldn't though.
Should be that.
Really expanding it now.
Sure.
That one
which is the broken one here.
This one where the action has to be two.
That's it right
until it searches more.
Gets it right. Sometimes
Flaky unit tests.
Okay, that time I got it wrong.
I don't really know how it got that
music is a solution for self-driving
cars. That's why it's interesting.
for turn minus one perspective.
It lost the game.
US maxus
one. That's effectively what I'm doing
here.
Okay,
very simple one that I got wrong.
It's not when there's value.
How'd I get value?
I'm not outputting any value. I guess
for the reward
it's losing the game now.
How to get value there.
Why does it think that's a good move?
I guess because this has minus one.
It flips that around. And from that
guy's perspective,
it is a good move.
I guess to that it's a good move.
2818. Eight.
That has value.
Um
Um,
that doesn't really work. So, you have
to say no value in game over. No value
in making a move after a game over.
In fact,
better idea.
I can give a negative reward
but I can also okay if I just say if
or SW2
not equal to zero
don't move in other
spots
taken spots
or
in finished
games.
I'll print out 7 million things, why
don't you?
Uh, good. I think that's the right
answer. Um, how do I where do I put that
print? Where's that print? Right there.
My unit test pass. Not this one.
Okay.
What? It wants to move there.
Did it just surrender?
No, it worked there.
It'd be funny if it surrendered. If it
just like did the math and it's like
there's no way I can win this. I'm out.
spent a lot of time searching that state
because I got negative rewards doing
that.
Okay. What if I don't give it any
negative reward for just there's no
reward for that.
Okay, finally the first reasonable thing
I've seen. It's like, wait, what? No,
it's so unreasonable. Actually, it
thinks it can go there. Okay, it needs
that negative reward.
10.
Why am I messing around? Don't do that.
If you're thinking about doing it,
don't. I don't know why I was giving it
negative one like it lost the game. No,
it illegal move. There's nothing worse
you can do than make an illegal move.
All right.
So, I was thinking, okay, it's my turn.
Oh, I could go there. Oh, man. Wouldn't
it be nice if I baited my opponent into
making an illegal move?
Oh, that'd be great.
But of course, my opponent's not a moron
and isn't going to do that.
I don't know how MCTS understands that.
Should write more unit tests. My unit
test passing. Not that one.
This unit test doesn't pass. Well, the
rest of them do, though. That's good.
Oh, that one passed that time.
Oh, we're having more luck with unit
tests now. Just not this one.
This one was hard.
No, this one's not hard. Just play right
there. I don't understand why. Okay.
If it doesn't play, let's say it plays
there.
Maybe it doesn't expand enough to see
that.
Don't you see the danger?
Oh, good. That should have value.
If it goes there
and the opponent goes there, that should
totally have value.
What is it not?
Okay. Why doesn't that one have a value?
Oh,
I forgot that I added doneness to the
state.
These tests are all technically wrong. I
need a zero comma there because the
game's not over.
Oh, and this one I'm not even What? I'm
not even putting in whose turn it is.
It's a broken test.
Now that I put in whose turn it is, it's
fixed. And look at this one. Look, it
picks 50/50 between the two.
This is progress, boys.
Oh, this is this is the most quality.
Oh, man. Look at all the test pass. Oh,
wow.
I don't think I even wrote too many
hacks. Look, I have plus there. I have
that there.
Oh, I think I did it without hacks.
5050. Oh, that's sick.
Oh, all the tests pass all the time.
Got minus 10.
Like I'm giving it like it loses a game.
Don't ever move in illegal spaces.
That's illegal.
[Music]
All right. Will m zero work now?
I feel like maybe
getting minus 10 because it's playing
illegal moves. Oh, but look, it played
non illegal moves there.
still plays mostly illegal moves.
Oh, remember that time I played three
illegal games of tic-tac-toe.
Oh, we should do the other test first
before we keep doing this. We should
have it play a few games against itself.
Yeah. Tie game. All right.
More try again.
All right, we have a I have I'm
comfortable in saying that we have a
working Monte Carlo research.
If anyone would like to challenge it,
please start with a move. If anyone has
a good a good challenging move,
we can play.
You're taking vision and making leap
nowhere into logic. All right. If anyone
has a good starting move, we can play.
The Monteol tree search is good. That
doesn't mean that
I mean because look, when it plays games
against itself, it ties.
Watch. I'm going to say that like now
it's not going to tie. No, it ties. All
right, we got a five. I heard five
first. All right, let's go. Five.
Five.
It plays there.
I hear the middle square. Okay, let's
go. The middle square.
It plays there.
We can't play five again.
We can't We can't play five. Seven. All
right. We're going to get big negative
rewards if we play five.
Blocked. All right. Tie game. I guess it
could technically not be a tie game.
We'll try with the last the last hope of
our people. Nope.
tie.
Okay. So now
can U0 learn to play this game? I mean I
believe so, right? It just needs to
learn to approximate this value function
and this dynamics function.
Should be okay.
No discounts.
Um, I think we can make a smaller S dim.
Actually, I think we want to train more
of the batches. We'll bring that back to
how I had it in carpole.
Say two batches.
All
right, we're going to have to play a lot
more games than that.
At least it doesn't look like it's
collapsing into fully degenerate shit.
Remember when it would just play the
same game over again?
and play the same game over and over
again. That was pretty dumb.
seems to be learning. These games are
pretty bad.
Let's see those ugly hacks that I wrote.
I don't know. There were just like sets
of bugs. I just had to debug it until I
fixed the bugs. And then I needed to set
the reward function.
so bad.
Still learning.
We'll do more MCPS's.
useless.
Yeah, I mean it has Yeah, it's trying
everything. It's learning illegal moves
now, but that's apparently really hard
for it.
Um,
maybe want to keep more than 50 games in
the replay buffer, too, since they're
small games.
Oh, my K is only one as well. We can try
K3.
If K is one, I don't think they've
learned dynamics at all.
At least I'm not playing the same
degenerate tic-tac-toe game over again.
I think that's like the ultimate
degeneracy. Like just imagine you sat
there with somebody and you played the
same tic-tac-toe game over and over and
over again,
right? I might have to do with that
extend crap that I wrote.
from that's not going down.
The value of a state
that should learn, shouldn't it?
Should be pretty easy states to learn
from. I think
we need a bigger model.
Doesn't look like they're doing much.
Doesn't look like that's even going
down. I guess it is slowly.
I guess I'm only trading on two batches.
20 for the other one or something. Yeah.
Maybe I'll do more research as
I get excited every time I see it play a
whole game.
So, I guess I never explain anything. I
guess, you know, this is all just
confusing ass shit. Um, so this is how
long the game lasted, how many moves.
Um, this is how much reward was
accumulated in the game. So minus 10
means it made an illegal move. One means
uh a player one. It doesn't say which
player won. Which player won you can
tell from the length. Um, this is the
actual history of the moves actually
played in the game. And this is the loss
function of the M0 model right now.
Wouldn't
tic-tac-toe learn pretty quick? I don't
know. It's a pretty complicated game.
Machine pretty stupid, man.
You know, you think just cuz you're tic
tac-toe, you know, you're a smart human.
This machine's got to learn everything
about the world. It's like it was just
born.
It's come a long way from playing the
same degenerate game of tic-tac-toe over
and over again.
Now, see the problem with hard coding
tic-tac-toe is what if I change the
rules?
The beauty of mu0 is then I can change
the rules to whatever I want. Run the
exact same algorithm and it doesn't
matter.
Okay. So we can the model's trained for
a bit. Now we can try some introspecting
stuff.
We can try like looking at what the
model's learning.
What does it mean for AI to code things
for itself?
Those are the losses. They're not really
going down anymore.
Okay, so we have a model
and we can start with a board.
Um, so this is a pretty good board.
For reference, what this board looks
like
for reference. That's what the board
looks like.
So, it's X's turn to go and X can win by
playing in either corner.
Now, let's ask the model.
So we're going to run the representation
function on it and then we'll try the uh
value function. Okay. So unfortunately
it's sure that whatever I do next its
value is really bad and whatever I do
next is going to be an illegal move. But
this is actually completely in my
control. So let's do the transition
function
on this and let's pass in an action
value.
I actually make the model so I can pass
in an action value nicely. Yeah.
Uh let's pass in an action value of
eight.
Oh, so it thinks I'm going to get lots
of reward if I do that. Thinks I'm going
to get some reward if I do that. Some
reward if I do that.
And it even thinks I'm going to get
reward if I do that. So that's not very
good
because I'm not going to get reward if I
do that.
If I do that, all I'm going to get
Why does it possibly think I'm going to
get reward if I do that?
All right, let's look at what the sample
buffer looks like.
So, here's a sample buffer.
Oh,
yeah. Who wrote X10?
X10 is dumb.
Okay. Okay. The hacks I wrote at the
beginning of this don't work.
One day I'll learn not to write hacks.
You think?
So, it actually can't learn from games
that
are shorter than three
Think
that's going to work.
Sometimes I'll stumble upon games that
are not shorter than three.
Empty unit for rand range. Yeah. Um,
my make target
have to go one beyond.
Okay, we actually have to never mind.
It's four.
Or really, it's less than or equal to M.
K.
Don't worry, it'll learn to play longer
games soon.
There we go.
So now it is learning to output bad
stuff but less stupidly.
A nice size replay buffer now.
Couldn't
have thought that these things were
great. I don't know.
I don't know why it's still so stupid.
Guess you got to play a lot of games at
tic-tac-toe. I guess my money color
research just is not fast. Okay, next
stream. We reimplement it in Rust. What
do y'all think?
implemented Rust.
It might be fun.
Not even worrying anything.
I don't know why it has such a negative
idea of how much value it gets.
And then
h
why is it trying to output negative
value there?
Like it's weird. The only good move it
outputs negative reward for a tiny
amount, but still
I guess that does the same thing there.
It's pretty confident that values of all
states are minus 10. Okay, you know
what? We can fix that. I don't know why
I made that discount so so aggressive.
These games are short.
We're using Kass
That's
All right,
there's the guy. Let's Let's look at the
hyperparameters of the Muse that
supposedly can learn to play impossible
tic-tac-toe.
Do they claim it learns tic-tac-toe?
Oh, test it with the connected network
and the residual network. Wow.
Learning rates the same as mine.
Batch size a little similar.
No, I think there's something more
fundamental broken.
All right. What were we doing last time
to debug? We were looking at the
batches.
Let's go do that.
Okay. So, 8 6 0.
Oh, like
Okay. It's learning the value of the
state to be very bad because it knows
it's gonna
Why? That should be reward. Shouldn't
it?
Got make image I
don't want steps.
that
value
last reward policy.
Why is last reward wrong always?
- 10.
Two.
One, two, three, four.
One, two, three, four. Actually, current
should even be worse than that. And that
should be there.
Agree.
Current index minus one.
Range is state index which starts at
two.
Oh, it'll do that reward.
Huh. I mean, this is an interesting
thing to say about Lunar Lander, too.
It's always missing the last reward.
Now the last reward is actually the only
one that really matters.
So it doesn't know that transition at
all.
Yeah.
All right. How do they deal with this in
the sample code?
States past the end of games
are treated as absorbing states.
self.policies.curren
index.
Let's try instead.
What does sample position say?
Doesn't mean anything
history.
Return targets. Invalid syntax.
Okay.
So now we have that minus zero in there.
The only problem is history.
I don't know how they deal with it.
You could just repeat the last action a
lot.
Or I guess you could put in an invalid
action.
I guess you can randomly sample an
action. That's actually probably the
best thing to do.
right extend again.
This time
I can say something like game. Pause,
right?
I have that.
No, I don't.
While length of s is less than x
x.append
uh random.rand Random
zero length
G. Policies sub0us one.
Yeah. Okay. So let's try
replay buffer sample batch.
All
right. Now I can learn those rewards.
And now we don't have a problem of games
being too small anymore.
We'll redo this.
Co research is over.
Corona virus will go down in history as
I think one of the biggest public policy
failures if anybody actually gets their
shit together on this.
Uh let's check let's check the latest uh
let's check the latest from the fear
dashboard.
Um
yeah, 58,000. Yeah. US killed by flu
this year.
Wow.
Uh yeah, remember all those it's just
the flu people? Well,
remember that time we locked down the
economy for the flu?
Those
losses are huge.
Massive.
Them some big losses.
Yo, but that should be a good meme from
like now on. Like, yo, remember that
time we locked down the economy for the
flu?
No, no, that's actually not clear at
all. If maybe if we' done absolutely
nothing, it would have been uh worse.
But if we'd not locked everything down
and told everybody to be moderately
careful,
uh I think we would have had about the
same outcome.
They're going to say that forever, too.
You know, you're always going to hear
that from from the media people and the
politicians. They're never going to
admit they're wrong.
No, it's playing the same degenerate
game of tic-toe over and over again.
That's the stuff of nightmares.
Um also
uh be very careful uh in general in the
media about them moving the goalposts.
Um so remember originally the goalposts
were to flatten the curve so that the
hospitals don't get overwhelmed. Have
you heard that at all anymore?
Have you heard anything about flattening
the curve?
Is that any is that the reason why we
have the lockdowns?
I haven't.
I saw the goalpost. They're way the fuck
over there now.
No, I mean it's it's unbelievable. It's
unbelievable that they get away with
this.
So sure about that action.
Oh yeah, yeah, yeah. Oh, that on my
second wave.
First it was flatten the curve, right?
And that was reasonable. They had me
with that. And now the worst, too, is
California comes out with this plan to
reopen. It's total bullshit. There's no
actual plan. There's no numbers in
there. It's a plate the masses kind of
thing. They're speaking to us like we're
children.
Um,
I'm I'm absolutely appalled uh by our
governments and that they can't just be
honest.
Like I think I think that companies are
bad. You know, I I I call out I I a lot
of dishonesty in Silicon Valley and
startups and stuff. I don't know to I I
never really had encountered the
government that much in my life.
Um the government never really like you
know I pay taxes whatever. Uh
but this is this is unbelievable.
Um I have zero plans on wearing a mask.
Uh, and if they if they
if any
people with private businesses, that's a
whole different thing. But if anyone
tries to stop me walking in public
without a mask, I'll go to jail. Um,
I think that's so illegal.
Well, Target's a private business.
Target can do what they want, but if
someone tries to tell me that I can't
walk on the side, that I need a mask to
walk on the sidewalk. See you in jail.
Well, see, but there's a balance between
there's a balance between not believing
this bullshit from the beginning, right?
Like, I don't think they made it up. I
don't think
I was I I had my moment of, "Holy shit,
what if this thing is real, right?" Um
then I did a lot of research into it and
the unforgivable thing was not the
lockdowns. The completely unforgivable
thing is moving the goalposts. The curve
is flat. The curve has been flat for a
long time outside of a few key areas
which could have remained on lockdown
like New York. We do not need a
countrywide lockdown. There are less
people. California hospitals are at 20%
of their usual intake rate and this
place is locked down and they told us it
was to flatten the curve
and now they don't even try anymore.
They they don't even they don't even try
anymore.
Um
I don't know. And I I don't
Is it Is it the lack of their ability to
admit that they're wrong?
Is it the lack of anybody in the
government with any like balls to stand
up to the the uh you know the people who
continue to push for this stuff?
I mean then there's whole lists of
conspiracy theories. Oh, they're doing
it to ruin Trump's economy. I I don't
even think that's true. I mean I I think
that you have to go outside. You you
can't be America specific for this
because I think there's lots of
countries that have the same sort of
ridiculous policies where Iceland and
Sweden, Korea, Taiwan had no lockdowns,
Japan has no lockdown.
Why are there spikes?
No, people don't like to admit when
they're wrong, but I think it's time to
tell a lot of these politicians how
wrong they are. Um, you know, I'm not
big I'm not big on voting. I I don't
really Most issues don't really uh
again, they don't really affect me. I'm
not going to I'm not going to vote on an
issue that doesn't affect me. Um,
my life with Trump as president or
Hillary as president, they'd be almost
identical. But this and who's ever
behind this and any politician or
sheriff that I can vote out of office
who keeps this bullshit up. Um,
maybe I'll even look into it. Maybe I'll
even do some research.
I haven't worn a mask yet either. No one
said anything to me. Uh, they I was I
was hassled a little bit yesterday for
sitting on a beach.
which you know
that's not that's not a moment to make a
stand. It is their beach.
Uh and then I went down and sat down
somewhere else and ate my Chinese food
which I had leftovers of that were
referenced earlier in the stream. Uh
why is sometime it just really wrong?
It's weird,
especially with this replay buffer.
I don't know if it'll hurt.
Add exploration noise at the root.
We're not exploring enough.
Let me make sure my unit test will pass.
Cool. Yo, I love unit tests.
Uh I the lockdown should have ended
weeks ago. Yeah.
Um,
and the moving of the goalposts should
never have been tolerated by anybody.
Oh, I really
these people are going to have to admit
someday that they were wrong because
nothing fundamentally is going to change
about the situation.
There's
probably not even going to be a vaccine
if you are under 44. Corona virus
presents very little threat to you.
cases maybe haven't been going down but
well I think also they have but cases
also definitely have not been going up
like and not up you know again there's a
big difference between up and
exponentially up
like dude
that curve looks pretty fucking flat to
me
that's declining
the lockdown should have ended
Write that down.
Let's see. Where did I write my song?
[Music]
Does sound really not tell you then? 20
days ago.
That's not comment archive. That
probably has a date.
Yeah, April 8th. So on April 8th,
uh is when I said, you know, the
lockdown should end at that point. Yeah,
at that point it was kind of an extreme
position to take, but these things
should have ended April 15th.
As soon as you've killed off that
exponential, you flatten the curve. And
that's what they claim the lockdowns
were meant to do. Now, we still have
lockdowns and the curve is flat. Can
somebody please explain that to me?
Uh what do I mean by moving the
goalposts? Okay. So, originally when
they said we were going to have
lockdowns and we were going to flatten
the curve. So, this was the original
narrative.
Everybody saw these graphs. Everybody
saw these graphs at the end of March and
they were reasonable.
It was a reasonable idea. We don't want
the hospital systems to become, you
know, crazy overwhelmed. So if we
take a little bit more time,
the curve has been flat now for weeks.
Why are there still lockdowns? That's
what I mean by moving the goalposts.
Are the hospitals inundated with the
sick outside of a few hotspots?
Can you show me inund hospitals
inundated with the sick in San Diego? I
don't think you can.
Oh,
see wearing masks for the test drive.
So, when was the test drive? Right. This
is when I was still like, Corona virus
is funny shit, man. This is when I was
still like, okay, you know, uh you know,
like, oh yeah, we can walk around, wear
our masks, like, you know, it's it's
here. So, that was that was further
back, right?
Um the next day I'm kind of like, wait a
second. Uh
this stuff doesn't add up. Um this is
not SARS.
This at least in young people.
Uh
I bring this up every stream now.
This is confirmed cases too.
0 to 19 20 to 44. If you're here, Corona
virus presents almost no risk to you.
Okay. So, here's this myth of you're
going to get it if you're young and
you're going to transmit it to older
people.
I'm trying to remember when in the last
four weeks I've encountered anybody
older than 45.
Certainly I certainly didn't get within
six feet of them.
Like my friends are under 45. My
co-workers are under 45.
Most people who work in the shops I go
to are under 45.
Where is this this scary Oh my god.
You're going to bring it. I live alone.
Like,
okay, the curve is flattened because we
have a lockdown. So, that's a claim.
That's a claim that we can test. Um, so
where are they?
Here we go.
Sweden did not have a lockdown. They
also got a flat curve.
So while it is true um so correlation
does not imply causation. While we have
both a flat curve and a lockdown,
show me any proof that one causes the
other.
That looks pretty flat to me. That
doesn't look exponential anymore.
No, I don't think it will go
exponential. Um, and then we got a new
piece of evidence a week ago, which is
why I'm saying, you know,
I mean, I don't know what this news
article is, but uh, and Cuomo was saying
it in the news conference, so it's a
true fact.
More than 21% of New York City residents
randomly given Corona virus antibodies
test earlier this week tested positive.
1ifth of New York has already been
exposed to Corona virus.
Oh, they pushed out a dozen new
symptoms. I mean, I can't even listen to
it anymore. It's It's
How long will these people continue to
justify what they've done in terms of
any means necessary?
How long will these people, you know,
they're just they're liars?
Their models for COVID suck real time
and they expect us to believe the
climate change models. And you know,
things like that are really sad. I mean,
things like that are really sad. Like I
mean, I don't know. I I think I think we
should do something about climate
change. Um,
and
but not if these people are leading it.
I totally get why people have zero faith
in the government with anything
involving climate change after the way
they handled this that they can't be
honest.
I don't know what their reasoning is,
but it's definitely not flattening the
curve and it's definitely not preventing
the hospitals from being overwhelmed
anymore. I have no idea what it is.
Yeah, older people locked down. Hey,
look, by the way, I'm talking about
here. I'm talking about San Diego,
California. I'm not in New York. In New
York, a lockdown might be very
appropriate.
Um,
but it's definitely not appropriate
here.
The difference politicians saying stuff
is most of the time in my life I don't
read the news. I tune out politics. My
interest in politics or my interest in
history.
I like I like history. I have no
interest in like who's voting like you
know. Look, I don't I don't care who's
president. It doesn't matter.
Compare Sweden and Finland. The only
difference is uh Finland had a lockdown.
But
sure, I mean, I'm not saying the
lockdown
did nothing. What I'm saying is the
hospitals were not overwhelmed
and like
what's the population difference?
And then this also isn't a large number
of deaths in an absolute magnitude right
right now. Right now this is a flu
season.
My estimate I have a text to prove it uh
from after I did the coronairus research
was I think there's going to be 160,000
deaths caused by coronairus in the US
this year. I made this estimate a month
ago.
I think that these deaths come largely
whether you do the lockdown or not. It
may be a question of when. There's not
going to be a vaccine. There's never
been a vaccine for any human corona
virus.
Yeah. The goalpost to flatten the curve
was moved. If there's one takeaway from
this, it's that
I don't know why I have to figure out
what's going on in these batches where
it's spiking super high.
Want to read comments? Let's read
comments.
When you saw 19 hours, you know that's
real streaming.
All right, let's look into briefly why
these things are spiking.
Oh my god, they released more of those
fucking models.
Like how do they how do they
the the the models that they released
at the beginning of this were off by a
factor of 10 from where we actually are
today. Right? And that's the other
problem.
Like where was the
I'm sorry we made a mistake and now
we're taking that into account. Like we
can go on web archive we can look at
what
Let's see if we can.
Okay. So, this is let's go back to
um
look I mean wow actually even the
government model is saying that we are
well past
the peak. Yeah, that's when the lockdown
should have ended 14 days ago.
So, April 8th, that was the day I put
that song
I mean, yeah, they finally got this
model to correctly predict the past.
Okay. Okay.
Yep.
Oh,
wait. What happened?
I swear this used to say much more.
I'm thinking of a different model.
This one's pretty close.
I don't understand why the lockdowns
didn't end that.
Did you find
You think the goalpost was always meant
to be moved?
through May 2020.
This model wasn't bad. Which was the
model I was thinking of?
Which was the model that was saying like
like 50% of the place is going to get it
and stuff.
The lockdown was expected to go on far
beyond the peak and flattening of the
curve. Why did they say that?
Yeah. No, this I mean it just it just
really upsets me. It just really upsets
me the way they lie. Um,
my faith in government has always been
rather low, but I at least I at least I
always considered government to be
something much more like like I was an
ant and I existed in my aunt world and
government leaves me alone and that's
fine. I pay them their taxes. I, you
know, I pay them their little mafia
extortion racket. That's, you know,
guess what? We live under their jack
boots. It's fine.
This is this is this is too much.
Okay, Imperial College was the big one
that was stated.
Corona virus models aren't supposed to
Yeah.
Oh, here we go. The report predicted 2
million deaths in the US.
This was like the first model that
everybody talked about.
There's some website where you could
analyze this.
I guess their models were right. I guess
I don't know. Why did they act on them?
And why didn't they tell the truth?
Oh
yo. Oh man. Thank you, Ela. Thank you.
You see, this guy's got balls, man. This
guy's the only CEO with balls, you know.
No, I know. Elon said the beginning.
Yeah. Corona virus is nothing to panic
about.
I mean, I even think he had, you know,
he had Tesla build ventilators and
stuff. I even think he had a moment
where he's like, "This might actually be
serious." And then, well, h, see, okay,
you guys remember who I nominated to be
Caesar.
All right, so look what just happened
there. the model took a step and uh
why did that happen?
What bugs
caused that to happen?
- 10 doesn't explain that
you I mean I wouldn't feel
I don't think I can just move to Sweden.
All the borders are pretty closed.
I don't know. I mean again I don't feel
like it's my uh
I wouldn't like try to get around that.
I they're not my government. Like it's I
don't feel like it's my right to show up
in Sweden and like if they don't want me
there, they don't want me there. Uh I
mean this is America. I was born here.
I'm a citizen. I have rights. Uh stay
here and fight.
I don't blame you, man. We won't let
people in either. You know, closing the
borders is a cheap action.
Don't Don't wear a mask. Like, will they
take you to jail? Will you saying you
have to wear masks in like on the
streets or in stores?
I mean, in stores it's like, well,
look, look, it's getting big. It's
getting big.
Oh, God.
Set this. I set that.
I just want to look at Elon's tweet
again.
Free America now.
Oh, damn. Yo, Elon's so on the right
page.
The scariest thing about this pandemic
is not the virus itself. It's seeing
Americans so easily bare down and give
up their bloodbought freedom to corrupt
politicians who promise them safety.
True.
Oh man.
Nothing bad about staying at home, man.
But you see, this is no, you can't you
can't do this with freedom, right? You
know what's so bad about having to carry
your cell phone with you? if I carry my
cell phone with me anyway, right? That's
not how freedom works. If I choose to
stay home, that's my right. If I choose
to go out, that's my right.
See, and now this is a problem, right?
I'm exposing the hoax daily. Coronairus
is not a hoax.
It's killed a lot of people. It's worse
than the flu.
But what happens now a and you know, you
can see the same thing kind of happening
with global warming. Um,
you hear this story from the government
and if you think about it for a little
bit, you're like, "Wow, these people are
idiots." And then you watch like a guy
like this on YouTube who writes exposes
and truth in all caps.
This is the problem.
They need to stop lying. They need to
start telling the truth. And the truth
is moderate.
You know, nobody's going to watch.
You're going to put You're going to put
exposes the truth people back to the
fringes.
It's no longer my right. Oh, it's my
right. Oh, it's my right.
If they tried to tell me I actually
couldn't go out.
Now, everyone who's concerned about
their health, it's their right to not
leave their house. No one's going to
force them to leave their house.
But um you know then what I say is I'm
not gonna I mean I'm not going to like
listen, right? If you if you want to
tell me that I can't leave my house, I'm
not going to listen. I'll leave my
house. If you would like to accuse me of
committing a crime, give me a trial and
put me in jail. That's your right as
well. That's part of the social
contract. But this fear-based thing is
definitely not.
Sure. Please, noble Americans, stay
home. Might even listen. I'm more likely
to listen to that than an executive
order.
No. Yeah. I mean,
I haven't seen that here.
Nothing happens if you go outside in the
US.
The beaches reopened on Monday.
Um
I don't understand why.
What's happening here?
The road has worked.
Now the beaches are always planned to
open on Monday.
Um,
the IFR is 1%.
I don't think that's true.
So
if New York if 20% of people
uh tested positive for antibodies in New
York, I don't think that gives you a 1%
IFR. I think it's actually much lower.
there.
Use New York state, not city.
I mean, I took the deaths from the state
and I assume the antibbody numbers are
from the state.
I mean, most people in New York are in
the the city anyway, right?
Oh, wow. That's not even That's the
state.
All right. So, yeah, I mean, assume the
test was done in uh
Yeah.
I I guess I assumed the test was New
York City. It shouldn't be fair to
compare it to the state. Yeah. So 0.02%
uh IFR
uh flu IFR.
Wow. 02%. %
Yep. So, uh Yeah. Yeah. Wow. Yeah.
Sure seems like the swine flu, man.
You probably didn't count illegal
immigrants.
Yo, illegal immigrants would probably
only make the denominator bigger.
Oh, I'm off by a zero. Oh, I'm off by a
zero. Okay. Okay. You're right. You're
right. You're right. All right. So, it's
higher than swine flow. It's higher than
swine flow.
Um,
flu case fatality rate.
Yeah, this is what we're talking about.
Let's take the high end of both.
All right. 2x flow
2x Let's go.
When I think of Pelos's sick ice cream
stash, see, now I have no idea what
you're talking about.
Uh, am I worried about the long-term
health impact?
No.
Do you have evidence?
I'm not searching for some Nancy Pelosi
shit.
Well, I'm just gonna I'm just gonna I'm
just going to look at Elon's tweet
again. It makes me very happy.
Oh, wow. It's actually a whole lot of
them.
[Laughter]
You went hard, man.
Maybe minus 10's a little aggressive.
Minus three.
Did my unit test still pass? There you
go.
Actually,
wait a second. You know, did I do that
wrong?
I feel like I forgot to multiply by 20%.
See, unlike the politicians,
you know, I'd be as bad as them if I
didn't do this.
I already made a mistake where I was off
by 10. It's late and we should be more
careful.
So this number actually has to be
multiplied by 0.2
1%.
Uh no, so I did New York City population
and then I took the deaths from New York
City. All right. All right. All right.
Blue is right. 1%. Okay. Okay.
This is that's the 5x flow.
Well, let's Okay, let's be a little bit
more careful about the antibbody study.
Let's figure out where was sampled.
See, I don't like to be wrong. When I
make mistakes, I fix it.
And in the rest of the state, 2.3%.
Well,
so it's lower if you take the state.
I don't know how this was sampled.
If you take the state, it's 08.
But I I don't know if that was a general
I don't know how they did that sampling
5x low.
What's this study? You see, you go into
this rabbit hole again.
It's not. Yeah, it's I mean it's harder
to talk about here and it's easier to
talk about in New York because you have
so much
um when you're in like the couple
percent range, you don't know your like
test specificity and stuff about your
false positives and your false
negatives.
All right. So, if Arnot is three, we
need 65% to get her immunity. I mean, it
seems like we're almost there.
Um, no actually
to be honest,
even if the number were higher
like I guess I mean I guess this is what
my bias is. It's like
I'm not really sure what could be I'm
not really sure what the lockdowns are
supposed to do. um like flatten the
curve makes sense, but otherwise I'm not
really sure what you do after that.
Do people think about sitting around
waiting for a vaccine?
Um
yeah, in New York the antibody test to
be more accurate. No. Okay. I believe 1%
Uh, I mean there's also the death coding
thing.
I I hear this on Twitter. I'm not sure
if it's true um that states are getting
paid
uh for coding deaths as coronairus like
it's part of like uh is is there truth
to that?
If anything, Corona is underounted
because of deaths at home.
Yeah, I've heard that argument, too.
How do they count flu deaths?
How how do the excess death statistics
look?
See, this is what I mean. You know what?
If this is what was being communicated
and they had like a reasonable plan for
the lockdowns, I'd be so much less
upset. I'm not upset about the lockdowns
as much as I am about the lying
I mean, I think we all did. I think I
think you saw models and you thought it
was going to be like, yeah, you know, mo
most of the country was going to get it.
Well,
I mean, you know what I said early on in
the coronavirus streams about this? I
said, uh,
if it's under 100,000 deaths total, I
think, uh, you just chalk it up to,
well, that's life. If it's over a
million, okay, what can we do? If it's
under if it's between there, well,
that's where you have a judgment.
Um,
people are scared,
people are pussies.
Um, no. I I I think that again,
communicate with me like an adult. I'm
down to listen.
Tell me what to do and pass orders by
people who very obviously are morons.
Not listening.
It is communication in 2020. Um, I saw a
thing about I saw a thing about the
Boeing CEO and the last thing you want
the last thing Boeing should do about
the 737 Max is put a slick looking guy
in a suit and sit him on a plane and
talk about how he'd fly his family on
the plane and like, no. Yeah, it's 2020.
Fuck off with that shit.
Uh, you want to communicate
uh that a plane is safe.
Explain to me how you made your mistake.
Tell me what you put in place to make
sure it doesn't happen again. Just be
honest.
All's going to change once Biden is
president. Yeah, we'll have an actual
scenile old man in office.
Yeah, BP, remember, we're sorry. We're
sorry.
I admit to my mistakes. I made a
mistake. It's 1%.
You know, if you don't admit mistakes,
you're never going to fix bugs in your
code.
I don't think
Um,
I think that there is way too much of an
emphasis on who's president.
The president's like a glorified
cheerleader.
Who's
All right. All right. All right. We're
gonna We're going to do this for a
little bit. We're going to do this for a
little bit. We have to do it. I don't
know. Um, Government Accountability
Office. I think this is the best thing
Obama did.
Restricted reports.
Like I wish someone had a lot of time to
go through all this stuff.
Like
the president's like one guy who's on
Twitter a bit.
What do all these people do?
What do you mean the US has been fucking
around since day one?
We do what we always do in America. We
are underprepared and then we make a
huge show of overreacting.
I even understand like if someone close
to like people died.
I don't know. Like it's hard. Yeah.
But, you know,
it's just it's just it's just hard to
get over this.
I used to care about the culture war
stupid.
I wasted way too much time thinking
about the culture war.
The culture war is another one of those.
It's just a stupid distraction.
Oh my god. Trump closed borders early.
Blah blah blah blah blah blah blah.
Yeah,
we're sick of the lies. That's right.
We're sick of the lies. What we want I
promise when I run for president that
I'm going to live stream everything.
Can we just build the future instead of
having a culture war? That's right.
Really? I lived through Gamergate and
Gamergate really taught you the truth
about the culture war.
The culture war is there's three main
groups. You have well, you know,
the right, the left, the trolls, and
then most people. And most people don't
care about any of this stuff. Most
people don't know about any of this
stuff. But going on Twitter, you'd never
think about, right? So you have these
two people who are already kind of
predisposed to be kind of shitty and
then you have the trolls.
These people might be predisposed to be
kind of shitty, but it's the trolls who
really who really ignite it. The trolls
say something that gets this side going
and they this side attributes it to this
side and then this side's like, "Oh man,
we got to get this side back even
worse." So they do something that's even
worse. amplified usually by the trolls
who then, you know, go in and really
like, oh my god, how could they fucking
do that? It's like, you know, and that's
the culture war. Um, and that's why it's
stupid.
Now, this is what I want. I really just
want to break down like where does all
the money go?
You are buying the government a car
every year. A whole car.
Trolls are winning. Trolls are winning
the internet.
If you're a troll, I mean, there's
there's limits to trolls, right? Like
trolls can't have like a coherent side.
What is Elon saying? He's saying free
America now.
He's saying Silicon Valley as he goes
sanctimonious.
Yeah, the trolls can't win.
I wonder are there like why does
sometime it take a step and go like
that?
Why is that happening?
Why are the models going crazy?
Hard max. Is this batch a problem?
All
right. Maybe we'll add in one more
action. We'll add in the over action.
Acting
like you got ovaries and overreacting.
It's iron solar.
That was pretty funny.
What?
Yeah, I listen to Ran vers Chiron today.
That was pretty good.
Why did this work?
I don't understand. How come I can't
make it one bigger?
Is the one bigger thing even broken?
One bigger thing is definitely broken.
If I do that, how is that? Okay.
Oh, I see what I did.
[Music]
index 10.
Oh,
that's the it's over action.
Maybe this will fix something. Maybe my
problem was before that I was picking
like actions and it thought it was like
doing something.
Whoa, whoa, whoa,
whoa. Vamosa.
Poor La Ultima.
Uh, we go to my house for some Smash
Bros. Ultimate.
Corona virus is just the beginning. Be
afraid. Be afraid everybody.
I don't know.
If Corona virus kills me, then Corona
virus kills me.
I came to peace with my one in a
thousand chance of dying a while ago.
some new bacteria kills in one. Let's
see.
I mostly agree with them.
It's pretty low.
This stuff scares me more.
This stuff scares me more because the
government's incompetent.
Why is it being slow?
I feel like that was faster before
I because it's playing a long game.
Getting down technology scary shit.
Yo, who wants to troll Wikipedia and add
Corona virus and put over 9,000%.
Now, I have too much respect for
Wikipedia to do it. I have too much
respect. I have too much respect.
Maybe it's trying to play the uh
it's trying to play the fake one. Feel
like it might have been trying to play
the fake one. Probably do not sum to
one.
Why is it still so big?
It's a big loss.
Look at this.
Yeah. Yeah. Yeah. Yeah. He's
a common enemy, man. Well, I'm ready to
fight the aliens when you guys are.
Let's Let's How about we just, you know,
what happened to jailbreaking the
simulation? That seems like a pretty
good common enemy, right? It's kind of
where I was going with that.
Why is it so slow?
It's playing in slow mode.
The losses is so big.
How does a loss even get that big?
It doesn't make sense. Is MSE
Dude, let's go fuck up the aliens.
No, it's not GPUs.
I don't know. These models are too big
or something.
Did it learn anything?
It didn't work anything.
Okay. Well, we got Monte Carlo research
to work. I think that's a pretty good
accomplishment for the night.
Then it got late and we complained about
Corona virus,
but it does manage to play games against
itself and get ties.
I'm pretty happy with that.
Be nice if the model actually learned
You know if K equals 3, I think naive
search actually should work.
I don't like my added one thing cuz I'm
going to do that stupid hack for the
policy.
Will it be an awesome stream project?
Can I explain how the dynamics network
learns? Well, it just it gets value and
policy.
We can try putting an M again.
What that does
Does M
using the model now? I don't understand
why those games are so bad.
It's only 10.
Still should have minus 10 reward. I
should know not to do that.
H seems better.
actually if I put in a th00and I should
get all ties Okay.
Probabilities contain men.
Oh yeah, we get rid of that shit.
washed my hands. I ran my hands under
the water for a bit. It's fine. I didn't
touch anything.
I hope he gets ties now. That's good.
Get ties if we do 100.
Oh, no. We don't get ties anymore.
All right, we need to write. Should we
write Monte Carlo tree search and rust?
I think we should write Monte Carlo tree
search and rust.
Yeah, bro, man. Maybe I'll get corona
virus, you know.
No rain. No, I'm done coding cock.
Wow, we we're up at more people. I feel
like we should stay awake till this
works. Then
I'm going to wash my hands real nice to
you people.
Just you people.
Got to really get the soap going.
Yeah. Run the water.
Oh, that's a good nice watery feeling.
Yeah, let's get this.
Dry them off with a nice paper towel cuz
I care about the environment.
And then throw that over in the trash
corner.
Why does it do that?
What's making the model go crazy?
I feel like once we solve that, this is
going to get fixed.
Yeah, I ran the water, but I didn't use
it to fool you guys. Is it this that's
doing it?
Well, that should be okay.
What happened in this batch?
That was so unbelievable
that it made them all go crazy.
Those are one hot encoded.
The board is put in. It's a very normal
kind of neural net looking thing.
Turn on the policy, the value and the
reward.
Rewards usually zero, but not always.
All right, let's look at M.Osloses lost
to
what is that?
It's a value.
It's really confused about one of the
values in the last
thing.
Like super confused though.
Doesn't even make sense unless it like
predicted like a really big negative
number.
Did we see it coming in the previous
one? Maybe the previous one was a bad
step. That one's pretty bad, too.
That one's more reasonable, but still
bad.
That's normal.
I don't know. The dynamics model is
going crazy. I don't know. Okay, that's
five.
Crazy.
Everything's moderate and small. And
that one's crazy.
Crazy.
Well, that's a normal amount of loss.
It's a slightly less normal amount of
loss.
How does it even get 14? I don't get it.
All right, let's try making tiny
batches.
So we can hopefully see it better
while I continue to document.
No crazy. No crazy. No crazy. Oh, look.
It won. It won a game.
Only doing 300. With a thousand. It
doesn't lose anymore.
Oh, see went crazy.
29.
Big losses there and there.
Okay. All zero. Zeros.
It's literally all zeros for those.
It's all zeros.
Oh, is this like floating point
bullshit?
Cuz they're not floating point zeros.
No, we can't be that stupid.
No, it doesn't have Hi.
Okay, they all seem moderate now. I
don't know. Maybe it just gets a new
action it hasn't seen yet.
Maybe it's okay.
Oh, you know what else occurred to me?
We don't limit the depth of the Monte
Carlo tree search.
Does this have anything to do that?
But you see what I mean, right?
It can be searching way off the end.
No, no, no. We're done with Corona
virus.
Like we don't limit the depth. Does the
paper talk about this at all?
Well, we set K equal to five now. So
that might help
do anything.
No, I has no idea.
Where'd the trainer go?
What did I just do?
Where did I put the trainer?
Oh, it's there.
All right, I'm getting tired.
Clean this up. We're going to commit
what we have. Make sure what we have
works. At least as promised.
Because I'm training models. Where' the
model trainer go?
Can I delete it?
Okay,
it's been a while since I've restarted
the kernel.
I just like to play the center.
It thinks it can go there.
Why does it think that?
Why does it possibly think that's a
policy? It shouldn't be that stupid.
All
right, let me try one more thing. Now
it's bedtime.
My spelling mistake. What did I spell?
What did I spell wrong?
Spelled TensorFlow wrong.
Oh, he spelled something wrong. And he
doesn't like TensorFlow. Unforgivable.
What? a tic-tac-toe game.
Something's wrong. I don't know what it
is.
Great. There's something bugged.
All right, we'll figure out the bugs at
some point.
MCTS tic tac
toe works
new zero tick tactoe
a little less so
ah what can you do to help me nothing I
mean you know guys I'm just here to
learn you know
here
do anything in particular. If you want
to help, I mean, I I'll always shill for
uh comma 10k. If you don't want to do
comma 10k,
look at all these pull requests, man.
Someone's got to review them all and
merge them all. I don't know. Are these
good?
They're pretty good. Bug fixes.
Look at little dots.
All right, if we have
two minutes for questions.
Oh, look. Look at that book. Fix myself.
Beautiful.
Oh, really good fix.
Am I happy? I'm pretty happy.
I mean, you know, I'm like pissed that
it turns out our government's a total
sham, but like other than that,
oh, small farmer. Oh, small farmer. I
like that.
Um, I haven't heard about Lexus startup
show feat. There's a feat.
Uh, yeah, I'll fix the bugs tomorrow. I
think I'll be back on streaming. I think
also we're going to try to get we're
going to get mu0 to play tic-tac-toe
and we're going to get mu0 to uh
3.1415926.
[Music]
It's a six.
Um
no, I haven't read like the black swan.
I read the beginning of that on Amazon
and then I didn't buy the book.
Um,
yeah. You know what? We're gonna have a
part two for this, I think.
All right. We're going to write it in
PieTorch and Rust.
Actually, I don't know. You think
PieTorch would fix this shit? Maybe it
would.
You are a subscriber. Your opinion is
more important than than other people's.
What's the road to reality?
This guy
This guy's still writing books.
This guy wrote a book.
Wait, before I really go in on him, let
me make sure he wrote the book that I
read.
I think it was The Emperor's New Mind.
Yeah.
He's He's an anti- AI guy. Uh, no, no,
no. What's his other book? It wasn't The
Emperor's New Mind,
I forget.
But I read a book by him and it was full
of like stupid godellian arguments about
how the singularity couldn't happen and
how you could never build something as
smart as a human because it couldn't
read. Oh, yeah. Shadows of the mind.
Yeah, that was it. Yeah. Yeah. Yeah.
Yeah.
Yeah. Human consciousness is
non-algorithmic.
No. No. What? No. Consciousness is so
stupid. It's not real.
And to anyone who believes that it is
real, they should try acid.
I am a pea zombie. It's true. I'm a
proud pea zombie.
thoughts on George Hots?
I don't know.
Maybe uh
I'm 30
and like life's what you make of it, so
make it a good one.
Yeah.
No, my life's pretty much been the same
during quarantine, but there's some
people telling me I supposedly can't do
stuff, and that upsets me.
Uh, I wanted to be a general in the
French army like Napoleon, you know, he
did it when he was 24. I was like, damn,
if I could do it by 30, it'd be good.
But then I realized that I wasn't in
France.
Yeah, I don't want to be a general in
the US Army.
What would I do if I got cancer?
I don't know.
Find a do some research on it and find a
doctor.
Just just the argument that anything in
the universe is non-algorithmic
like
Wow.
People always let you down. Except we're
all right.
Have a good night everybody. I just want
to give a shout out. I want to give
again a shout out to to Mr. Elon for uh
you know being a bro and having the
balls uh to do what I think a lot of
very smart people are thinking but
no one else has the balls to say
so uh good for him. Good night
everybody.
good morning
good morning
good morning good morning
okay
i moved i'm in a new apartment
i just rewatched the
sharon pat stay battle this morning
there's so many so many classic lines in
that you know
at a sucker-free get hype when you boost
buffer you just talk before other people
fight
i want that line
oh yeah
oh man
you're such a bitch to the league
troll make you shout out
king of the dot your mom's eulogy dear
mom she had a heart of gold
shout out to trevor d custom jewelry
okay so i moved the microphone off the
desk
i was looking at last week's stream and
i noticed that there was a lot of
noise
of me hitting the desk
so we put the microphone over there
let's read let's read some uh
let's read some comments
uh
from from last week and see if we have
anything to respond to
we'll start by responding to comments
thank you for taking the time to make
all the chapters the chapter is very
nice
george inspired me to better programmer
no one needs to be inspired man
all the great content as always
yeah yeah hard work bro hard work
um
um
yes yes you get it you get it bro you
get it
it's a vibe it's not a quote it's a vibe
i didn't understand this
uh
i didn't invent post nemo who didn't
are you rich yeah bro
yeah bro don't be poor all right
so what we're doing this week
is i've been working on this all week
getting pretty good i've been working on
time you guys like crazy all week
ah
so
one of the things that i'm really proud
of that i did
i managed to write
the backwards convolution
in terms of a normal convolution
if if you do all this stuff and oh man
like you look at this code and you're
like okay this is only like
30 lines of code but these are the best
lines in tiny grad
i compute the convolution derivatives as
a normal convolution the only thing i
have to deal with a little annoying is
on stride
uh you can't exactly do one stride but i
managed to like look there's one in
torch and the one in torch is so much
worse than this one
the one in torch is using expands and
reduces i did it without the expansion
reducers and got the convolution itself
to compute that
so this is the this is the dx um
and then this is the uh
actually i think it's the weight
gradient the torch one was doing all
these expands and contracts they were
crazy so now all you have to implement
on the low level is just conf
and you get the derivatives of
convolution for free
um i added another movement off called
flip
uh flip's also kind of a generic stride
that can still be cleaned up a little
bit allergies and what's up
um
it's a batman change
maybe i'll be better
uh so yeah i wrote the derivatives of
convolution in terms of a convolution
i'm so happy about that
uh the new play is actually pretty nice
it's pretty nice
um
so this is the open pilot model
and what i wrote
so
tiny grad has these ops we have cpu
which implements
there's five basic types of ops unireops
and binary ops
and unitary ops and binary ops are
element-wise
so they don't depend
each even a binary op can only depend on
two things
right it's element-wise so it produces
the output like it's two reads one right
data flow is what you got to think about
when you think about neural nets
um
reduce ops everyone knows what they are
i got to remove this ctx thing again
this is just some things you like it's
really hard to write this code
in like a clean way from the beginning
but i've just been doing a lot of
refactors
so now here's the same thing implemented
on the gpu it's gotten pretty short
because all we have is one convolution
you'll see that i replaced all the
movement ops replace for mute slice
expand flip with this thing called shape
tracker
um shape tracker under the hood just
tracks and there's still some
improvements that need to be done shape
tracker
but um shape tracker will like
because
all these movement ops can't alter the
data
um slice can do zero views because you
can do slices like if you have data like
this and you want to expand it you can
do that it'll put some zeros in so
that's why this is a zero view here but
everything else is really just a view
and can be done with very clever ways of
thinking about memory and indexing so
movement ops are basically free now
uh and then we have
uh processing ops
convolutions
uh
gpu
is my processing up
uh movement office just use this one
kernel called contiguous now
um reduce off is a reverse and expand so
i can use shape tracker for this as well
and here are binary ops and hero unitary
apps look at how simple this code is and
this will implement
everything for neural networks there's
the torch one it's mostly just the same
as the cpu one
uh we just import all these from cpu we
have to use the con from torch
so yeah but then i implemented this this
one called is called ops lazy i'm an
obsolete it doesn't actually compute
anything until you call to cpu
and then it will realize things and it
does like a normal uh reverse traversal
of the graph but what i've been working
on yesterday and this morning
were all of these
all of these optimizations
so i'll go through and show you how they
work
so
normally when you run the open pilot
model in tiny grad you can see it has
2481 notes
we can look here and this is what they
look like
okay
so it's a little daunting at first
but um you just look at this and you
start to see some stuff okay so this is
a convolution the red ones are
processing ops uh you see that this is
the input and this is the weights so
this can involve with this yields this
this is an output buffer
each node in this graph is a buffer and
then the edges are operations
uh so
you see that uh yeah
those come in here form this buffering
convolutions a's are adds
actually i can uh give me a second i can
make things a little bit more explicit
once you start to get a lot of
operations you just start using the
first letter
but we don't do the first letter if we
have one
so yeah there you go
so there's a conf reshape expand add
um
so on and so forth
this runs the convolution head you see
because it's a big model you see the
other head coming here
um then we get down and we do the gru
and the hydra so this is the groove
you can see it still looks like a pretty
normal groove here
this looks like normal all right i have
a bypass
yeah yeah yeah and this is all the uh
the base stuff okay
so the idea of tiny grad is like a lot
of neural network libraries write very
complicated
optimizers
that apply at very high levels
and if you start optimizing at high
levels
uh it's very easy to write bugs because
of all these things so this is a super
low level operation we're going to start
doing some optimizations on it um so
you'll see
oh and actually let me enable one more
thing so if you want to use the fast
convolutions
it doesn't matter if we want to use the
fast convolutions uh you have to do some
pre-processing and post-processing to
get dimensions in the right order
but okay
so let me show you some things
so this is called shuffle this is uh
put this one up here
merge movement ops
so whenever you see multiple movement
ops like this promote permute reshape
um this can be merged all into one i
mean this this this permute permute is
really stupid it's just like taking a
matrix transposing it and transposing it
back
but still any amount of green
things can be combined into a single
green thing so let's do that
and see how many we're down to okay so
we got rid of like 400 nodes in this
graph
and you can see that all the green
things now are just are just a single
green thing
um because that can all be done with one
kernel and if it can be done in one
kernel
the key to saving power and the key to
making things run fast is um is using
less memory
uh is using less memory operations so
each of these is actually the buffer
that's being allocated so you can see
like here look at this one really right
so this is really stupid we're
allocating this buffer
and we're not using it for anything
we're doing a multiply on this buffer
and we're not using it for anything
except to combine it
and uh except to relu so like you could
imagine these kernels being combined
but you could actually imagine all of
the gray kernels being combined into a
single kernel because all the gray
kernels are element wise
so i actually have that one here
it's called merge element wise ops
and we can enable this optimization
run it again
and look at how many nodes that got rid
of
wow that's that's that's a lot of a lot
of notes gone
all right look now we're doing the rail
you add all in there
then
when you look at this and you still see
something kind of stupid here
this is a these are movement ups
uh this is a binary app and these are
movement ops you can actually bubble a
movement up above the binary up and you
can do whatever you want to do because
binary apps remember they're
element-wise
so you can do whatever you want to do on
the binary op above the movement up
so i have this optimization it's called
shuffle
movement ups and we can shuffle the
movement
offs and that got rid of another
uh
[Music]
bunch of nodes this also did some crazy
stuff like this is my output vector you
see all these ads you see how long this
one is now you see why i have that other
thing
where i don't spell out the whole thing
instead of writing out that i just use
the first letter from it so let's just
run that again
so there we go
it looks increasingly like
a weird foreign language um
but so now you'll see that
if you ever have a gray circle
there's no green circles below it
because the green circles have moved to
above it and then they can be combined
right
but they can be combined and sometimes
they're combined and they actually go
away entirely so i have an optimization
for that called remove movement knobs
it's actually wrong uh that one needs to
be fixed but you see now we're down to
1317 so we got rid of another
uh
whole bunch of nodes in this graph
and uh yeah
uh okay
so
what did that change oh yeah that just
got rid of a bunch of green ones so you
can see like here there probably was a
green one here but it's gone because it
didn't do anything so now we have a
convolution a binary off a convolution a
binary op
but
you can even go one step further with
this
if your output of a convolution is going
straight into a binary ops you can shove
those binary ops into the bottom of the
convolution
so i have this merge element wise of the
columns output and that's the last of my
optimizations
and now we're at 1172
and that is pretty much the minimum
um
you can see that like
here this is the top of my neural
network
these are just straight up convolutions
convolution convolution convolution you
see this connection here that's a res
connection it's doing accumulation in
the convolution itself
that took a bit to get the optimization
correct
but now we're being optimized basically
down to convolutions we have 187
convolutions and we have only four uh
gray nodes remaining so this is the
number of green nodes in the graph this
is the number of uh
red nodes and this is the number of gray
nodes
uh you'll see that the only gray notes
that remain are like this final output
gray node
there's a few
here this one still remains if it's
actually if it's after a real reshape uh
the node has to stay around
there's probably even ways to not do
that but
we're getting we're getting really low
now so for reference
this model in uh
in open pilot right now uses 227 kernels
after my optimizer
there's an optimizer in open pilot too
before the optimizer notepad was doing
450 kernels it got down to 227
but now you can see here we're down to
less kernels less power more speed
um so there's no way the red ones are
red because there's no way to really
combine
convolutions depend on all the data
right so this here is uh you can see
that the data is going in and the
weights are going in
they're so like complex that you
actually need a single kernel from them
there's no real way to combine the
convolutions together
so we're down to pretty much just
convolution convolution convolution
don't worry so much about these green
ones these green ones don't actually
have to be run
um these green ones are just addressing
schemes for the underlying tensor
in a lot of cases
now i haven't actually written any code
to execute these graphs so that's what
we're going to do today and we're going
to see if i
made any mistakes in my optimization
uh so yeah let's go and do that
let's first put that back to this i'm
going to turn these off for now
the only one i'll leave maybe is this
one
cool
so you see like the i'm still combining
the movement off crxman every shape but
this stuff is super expensive
and that's running basically a uh
an alia between the convolutions
okay so now we have to actually have to
fill out the uh realized serialized do
real up here because uh we don't have
the real op so
um this is a type lazy buffer
so we can uh penetrate that type
oh actually i can't annotate that type
does anyone know how to fix that
python won't let me annotate that type
because it's inside the class
python type in using class
type
inside
class
the name foo isn't bad ow i can postpone
wow that actually fixed it
wow that's so good
um
i can actually write this type now too
cool yeah i could use quotes too but
let's just show you do it
um it's good now
yeah yeah we're adding some types it was
the only way to really think this stuff
through once i started adding types it
started making a lot more sense
okay let's do the real op here
uh
so
we're going to have to back this by
something let's back it by the gpu
we'll even turn this one off for now
you can see that it's really brutal now
like each one of those each one of these
bubbles is actually going to be a uh
a new shape
sorry a new a new buffer being allocated
so that's that's pretty bad um
okay
do reel off here so say if self dot i'll
type equals
where are my op types
we don't have any reduce off so we can
deal with that one later
let's start with processing up
um
oh yeah we also have a special laptop
called none
and none is just uh from cpa so
[Music]
um oh no
no i already called things that
that's lame
actually have a better idea
okay
so we'll say g ops dot
gpu buffer
um we have to create this one from a
host buffer so we can do this as self.r
dot shape
self.org
realize should return a
gpu buffer
uh we can call dot 2 cpu on this
so that should be right for that
every one of these should return gpu
buffer that seems correct
um
processing ops
processing up
uh oh no ctx really
oh this just needs to go
i can't believe this lap
i i can't believe i put cgx in there it
was really stupid
i actually did that as a refactor like
you're just not thinking things through
and you're writing numb crap
you know i told the optimism guys and i
read canon i'm like you know you gotta
just think it through and then write the
right thing and you waste so much time
writing the wrong thing
now the ctx's are gone so that's good
okay so we have to do a processing up
processing up is
okay this is hacked but okay so off is
actually a lazy op up here
uh so if we want the real operation we
do self.hop that up
oh
this is kind of wrong
no we don't want to do this for
self.type is none
it's not right
um if self.did realize
the log should still work we say self
dot realized
equals rhett
return around self.realized
get rid of did realize and just change
it to if
i realized it's not none
i
don't do that
to
put
so it's not just that we have to do
sources of zero sources sub one self.org
that should work
okay
a movement off
it's pretty much just writing the same
stuff here
uh moving off says just that
self.op type is
like kinda messed up binary up a little
i use binary opt to refer to both uh
unreops and binary apps because they can
be combined into one
area
you know our greenery ops
that's a real binary
we got rid of rats
yeah
that's easier to type
okay that should be right
binary ops and we also have to do
one more movement offs
so this is without any of the
optimizations and i can show you how it
breaks if we put on any optimization
itself.
i love that we get type signatures here
oh man i love pipes
types are the best thing ever
python is going to be the best language
in the world like the types are good and
it's fast
you know all right source is zero and
moving offs do have ourselves
uh lazybuffer attribute has no object
arc
that is fine because
it's what
i even do so i'll cut off that argument
shape
actually i can just do shelf that shape
here
so these are ones uh created from post
buffer
none type has no attribute name
had to do with that before oh
yeah you know you're right that's that's
what that's what types do
oh
we're starting to do more types of comma
i love types
okay
key error
why is that here
what
did i break something
oh this is the wrong sources i believe
no
oh because they're realized okay uh we
actually don't want that hang on
um
sources equals self.source
we'll call these r sources
i actually don't like that
we'll call these uh
l sources if they're lazy sources
no no no no no no we are writing out
long variable names
right i don't want lazy cash and does
that add an import i hate when it does
that
bad behavior editor bad behavior
i'm going to put lazy sources down here
i don't know what that just did
okay we still have a problem oh what's
the problem
i'm gonna log but i won't
uh processing up missing one
oh oops
why don't you tell me i wrote processing
off instead of moving on
why is that wrong
fine
oh look
we got that all right on the first try
dude
we just we just did that look at that
ran one test that means it passed
we just got that exactly right
yeah the ctx's are good
done
see so okay what this test is here
is this test is saying uh
yeah
okay um
let me just write a little hack here
i'm just gonna write that
actually we have to do two cpu here too
otherwise it doesn't actually run them
on the thing
guys i've started using f strings
everywhere
okay
so it's running now in
799 milliseconds
let's see how reliable that is
820 milliseconds
uh maybe we can get rid of it we can get
rid of those prints we don't have to
pass in uh that
and it is building the graph but i don't
think that's slop
okay
so it's taking
actually
we can do this
you can see what's actually slow
oh
hmm
okay that's not good
so that means all the slowness is
actually in uh
it's actually in these dispatches
oh this is probably slow
hmm
those are those are uh
this is non
uh
i think his blocking is actually the
default on that we can check actually
maybe we just don't need to make that
block we might be able to fix that with
just saying no blocking
you see the problem
we are doing uh
yeah defaults to true
to do this doesn't
have to block
we were basically blocking on uh
we were basically blocking on
every time we were created so do you see
what i did okay when i move self realize
out of 2 cpu
uh what i did was i separated the
enqueuing of the cl kernels
from the
conversion of the cpu so you see this is
my conversion of the actual buffer to
the cpu and you see this is blocking
equals true
but when i did that
i got a very fast time there and i'm
like okay something wrong's going on
so let's see
let's just add one more of these
red equals dot realize
um
weighted
uh
e t minus mt
times 1000.000
okay
so now we should see
realized and it should it should
basically not be a very short time
waiting for kernels because i did all
this early and those were blocking
so it should be a lot faster
um okay we're still getting assert false
how is that happening
oh
okay
so at least we're waiting some time for
kernels
basically it's taking
this minus that it's taking like 380
milliseconds just to enqueue all the
kernels
which isn't too bad
um so the model's now running in
running in 600
batman milliseconds
so let's go through let's turn our
optimizations back on i'll show you
everything that breaks uh when we turn
them on and we'll go through and we'll
fix them and then we'll get this number
down because number go down unlike gbtc
where number go up this is not
investment advice if you invest based on
a guy on the internet you are a moron uh
yeah so gbtc goes up but don't i didn't
tell you man look it's trading it's
trading
33 below spot
how is how is the premium negative 34.
they all have the bitcoin
i'm not going into that this is not a
crypto stream
um you all know uh
that crypto is a scam
um but so is money
so uh i don't know what to tell you then
where do you put your money
what's that on the webcam i don't know
okay let's put merge movement ops back
on and let's see if it breaks oh no it
breaks
okay lazy op has no attribute realized
by the way notice how i upped the
recursion limit here
uh
so what's happening when you turn on
move merge move
merge movement ops is it's taking all
the movement ops instead of allocating a
new buffer for each one and stacking
them
so this one's actually the easiest to
fix
we can go through here and the problem
is op
is not always a buffer
so let's let's fix this
i have something in here called
contiguous
which is pretty much gonna do what i
want
we have to find the root
why are those not
i don't get it
is not defined
i defined it right there
why does it say those aren't defined
because i broke something
okay now this one never mind
uh
man i love the computer so fast that
it's like running a whole python
interpreter on my thing
so we have to stack the movement ops i
actually wrote this logic here
we're going to run it through the shape
tracker
um
root is self dot op
we don't have any op args
okay so while it's a lazy op we go
through
we find the buffer that that's it so
it's just a bunch of operations stacked
on a buffer when we do that
and then we apply them
just call this st
and then i can say red equals
contiguous
all right so this is just like the
genericized form of a movement top
um for continuous i pass in the root
buffer
and then i pass in the shape track and
it will apply all the shape tracker
transformations
uh to the thing and we'll run it
and we still have a problem
oh because now we're back to this
problem
well that's actually still going to work
you have to do this crap like
recursively i think
a certain lens shape equals lens strides
okay something's wrong
so my stacked movement off still work
you know what let's turn the optimizer
off and it should still work without the
optimizer
lazy sources is not defined
oh that's fine
okay so it still works without the
optimizer just when i turn on the
optimizer something breaks
we can always look at these graphs you
can see we're actually doing
so when i turn on the optimizer
assert lens shape equals lens strides
i must just be doing something wrong
what is instance
can i apply those to the shape tracker
what could be wrong
okay if it's a movement up
[Music]
i
recursively iterate through and add the
eyes
no it's definitely not right i mean we
could try that but it's not right
all right let's just output some stuff
how's that not even printing
wait what
guys did i write it twice
am i that dumb
i wrote it twice
okay oh that was dumb
uh lazybuffer has no attributes cl
uh yes
and that's because
root needs to be realized
actually i can just do that can i not i
don't actually have to pre-realize the
sources do i
should be fine
i realized it though
that's going to return a gpu buffer
what could i be doing wrong
lazybuffer object has no attributes cl
is root dot realize for some reason not
returning a
okay i guess i just didn't save or
something
okay it works fine okay
uh what was the time before all right
good i put it in the log all right
so now by stacking moving offs i guess i
just didn't say that i don't know
i'm doing some i don't need more coffee
okay so now we're down to
443 milliseconds look at the time we've
saved
let's go with that that one's a better
time
uh
running
in
by the way this is all on the lazy
branch in tiny grad eventually it will
get upstream to the tiny grad and then
any buffer will be able to extend itself
and be lazy
you can run it lazy mode or not lazy
mode
should be very easy okay good
so we saved
about 20 milliseconds by doing movement
ops
and yeah
okay which one should we tackle next
i think this one's free
oh that got really slow okay well
sometimes you gotta de-optimize in order
to optimize
oh no that's fast now i don't get it
okay
and i think this one's free as well
but it's actually wrong so we'll see if
actually returns it wrong
oh it's wrong wow
okay
it's faster but it's wrong
that's the thing if you write one subtle
bug it's wrong
all right shuffling the movement ops is
free although sometimes it's really slow
don't worry guys we'll get into the
fancy stuff in a minute
we should probably fix this one first
it's boring to fix though
right now everything is slower because
we're doing the the movement ops
well that was cool when it was zoomed
out
won't even let me zoom out that much
which why
okay there's a simpler optimization we
can do first before we make this one
work
so
the problem is sometimes they're not
actually
i i have shape tracker here run on this
but i'm just checking if the shape is is
you have to check if the strides match
not just the shapes
and i think there's some places where
it's doing like transposes on square
matrices and the shapes are going to be
equal but the strides aren't
so someone's got to fix this
um
this one want a fixed shape tracker is
there anyone out there who is following
this enough
uh to
actually fix this bug
i'll really appreciate you because i
don't want to do it you have to make
shape tracker like stack on the views
so that optimization sometimes you're
too aggressive with your optimizations
it breaks
i've been thinking you know like i'm so
my mind is so warped by whatever i'm
working on and now i'm thinking of
everything in tiny grad terms
uh you know sometimes i'm thinking of
everything in uh ftl terms when playing
ftl
just like gosh
yeah this is on my github you just got
linked to it bro you literally just got
linked to it bro
literally a line above in the chat
uh okay
so here here's an interesting
optimization we can do that actually
really only happens at runtime
uh oh you just got here okay okay you're
forgiven you're you're forgiven
uh how many viewers you got we doing
good on viewers
happy saturday everybody
6.5 how cool so here here's the
optimization we can do that doesn't have
anything to do with changing the graph
whenever these things come from green
ops whatever binary ops come from green
ops we can actually fix the indexing to
support them
it's going to involve diving into
into
gop buffers a little
but we're going to write it okay binary
op shape tracked
this one we'll get rid of four garbage
i can't use float four
shape tracker
uh
basically it's letting me pass in a
buffer and then
this is what some guy referred to as um
stride aware kernels
this
just prod
shape get rid of the fours on the floats
so we can no longer assume that the
kernels are contiguous
um
i'm gonna get your unreal shape trapped
too
let's make a function
shape tracker
i'm going to copy and paste this code
here
this is
[Music]
a tuple of
crazy buffer and
shit track
route
does that not work
st
did that reactor work
okay test pass is cool
it's gonna take a bit
it's gonna take a bit to uh actually
start to see improvements
from this latest shuffle movement ops
which i guess we can do this without
shuffle movement option we have this one
later
okay good we're back down to the same
speed as before this should still
improve things if we do this right
so
basically
okay if you have a binary op coming from
things that are movement ups
we can
it's kind of wrong
i know the tests are set on lazy branch
yeah yeah i'm not trying to make the
test pass yet
uh self.sources
uh we're just going to say x equals self
dot dot sources sub zero dot realize
w equals
that
w x comma w
and get rid of this stuff
so we're just gonna realize exactly when
we need it
can we have a bit larger text no i'm
sorry you need to you need to zoom in
bro
bigger text makes it a lot harder to
work
remember i don't stream for you i stream
for me
lazyop has no attribute sources
oh is it source
source
what i want to do that
um no i i can't see if i have if i have
bigger text
you know it's hard to see okay
so
let's not realize the ops
if
self dot op dot source sub one
zero okay we can assume that it's a lazy
buffer for now
dot op type equals moving ops
then we're gonna do
movement up st
x comma x s t equals movement op
st uh wait that's supposed to be a lazy
up
fine
it's not a movement off
and we'll say x comma x s t just x comma
shape tracker or x dot shape
the trivial shape tracker
uh if this is y y s t y y s t y
right like that
now we can pass in
binary op shape track x dot realize
um
x s t y dot realize
class t
okay
so that should run it just shouldn't uh
local variable x reference before
assignment oh
it's not x
like i wish i could just like if i could
like think all this through better i
probably wouldn't have to write all this
crap code but it's like a way to code
this isn't actually right because the
binary ops can go multi-layer deep but
like that movement off refactor it's
probably faster just write the code like
this and then do the refactor
okay so that should at least run
uh it gives me the wrong answer because
we're not respecting these shape
trackers here
so you see that i can write something
called extra on the shape trackers
and x on the shape trackers returns
basically the indexing expression
so there we go look we actually have
indexing expressions
uh
i think i can write
okay
we'll write a function called get shape
tract
a
global cost float
a
uh
id
it shouldn't be called gid it should be
called index
so i think what i can write in here
is
plus xxt dot expert
now this is a like a shape track to wear
kernel
uh and then
this is not should not be a boy it
should be a flow
return
x sub idx
oh wait no no we need to set valid
equals
there's a place i actually use the shape
tracker
oh here it's here to reduce up
here
we have to say valid equal to one since
india index is already good
so valid the things can actually become
zeros and we have to respect that
so it should just be this
oh part of the slowness also
is that it has to wait for kernels to
compile
and that's a one-time cost that we
shouldn't be charging
we probably run it twice
that fixes most of these problems but i
will get that there
okay uh a g g i d
and we're gonna do the same thing for b
trapped
b
because this is actually compiling the
kernel on the fly and we shouldn't be
counting that as a as a time cost
which we are right now
especially since this is going to change
okay cool
uh
oh
no
oh we want these to be in line as well
and we'll make my line in a minute
okay build program failure
probably read the program
especially if it fails
oh
here's a program
wait does it not just work if i put one
semicolon
is that the problem
where's the problem here
this is the program that's being
compiled here that's
failing oh it's because i have uh sorry
no the problem is actually uh
you'll see that i fix it down here
yeah you in python it's a double slash
to divide
um in cl it's not
so i should probably write that in a
smarter way to not stick that crap
everywhere
okay great
so it runs correctly it just takes a
long time because we have to do all the
builds
respect shape tracker
is there any cute way i can
yeah okay i think
do
let me just try something quick
do you realize
uh myself i realized it was none
uh
the type thing was yelling at me for
doing this
uh you can't lazy doctor is self dot op
uh b dot do you realize
i was doing i was writing that as a list
comprehension the thing yelled at me and
it's like don't do that
so nice as a list comprehension
now it's on one line
[Music]
realize
you can actually keep those puff copies
too
man
it's more like that bugs okay
do not
count in time
okay do you have something that hangs
forever
oh that doesn't look good
soon if i get rid of this nothing it's
very fast
okay it's very fast
uh is there a bugging do you realize
um
if b dot realized
uh if b dot real life
self.realized
no it can't be that fast
there's got to be some bug
it's not actually running in one
millisecond guys
as no but the problem with the list
comprehension
uh
no it's not actually one millisecond
that must be a problem and why it might
realize
okay i don't know why we're only d
realizing six things
p dot get lazy buffers
i think the problems in get lazy buffers
if self-doubt realized there's none
but why would it be none
should realize everything
uh can i add something to the cl build
function i could but the problem is
slash slash represents a comment in cl
and you don't actually want to do that
okay um
why
okay like i guess we can write the
stupid thing
why does this not work recursively
i don't understand
still can't be right
something's cheating
oh no oops because that's not right
i can't break
okay i serve false
uh
yeah that's because
okay if self dot op type
okay that's better 385 milliseconds okay
good
and now we can check if the shape
tracker thing is actually improving
stuff or not improving stuff which it
might not be
not all optimizations are good some
optimizations are bad
not all shortcuts are faster
but it has to be a shortcut to be faster
oh good all right good we're getting
speed up good
okay so it's 395 versus 385.
uh with the shape tracked
379 ms with shape tracked
kernels
oh we have to do the same thing for our
unreacts as well
all right
look at this we're making progress
okay
so
do the same thing with unary ops
that's a terrible copy paste
to
st
uh
returns as a tuple lazy buffer
wait actually no this needs to be a lazy
let's go pass
no one has no attribute
that was a simple refactor how'd that
break it
what i do
the refractor looks so simple
my go
oh
oops
it's that
okay passes again
great
i understand why it's waiting so little
time for kernels
i'm sure we're waiting more time for
chronos because all the cl builds are
done
now should all be in cash
just in case i did something weird
[Music]
i don't know why it's waiting so little
chronos
maybe python is just that slow
it should suck
uh
let's make unary aware
i don't like this copying and pasting
it's only two i'll clean it up later
on
shape tracks
sst this one's actually simpler too
first we get rid of the
stuff
because they're not contiguous so we
can't assume they're called force
um
call this idea and we gotta call that
gid
then what we want to say
is jd
uh invalid equals one
run the
expression
[Music]
instead of returning
probably also make that a little faster
but never mind
okay that should be a unary op shape
track now
should be right
i'll do it more in a minute
faster
use some undeclared identifier x
that makes sense
eat the object is not terrible
okay
i don't understand that
f strings my man ha ha line
oh this one yeah she plays an s string
there that's a good point
okay
inked object is not oh
i hate these errors
okay
oh no that's not faster never mind
i got excited and it's not faster
well it's a start
ah
we should be able now to add back
shuffle movements
and it's not faster
because there's more binary ops when i
do that
just less movement options more binary
apps okay
we're not at the big one yet
all those op shape tracks aren't even
going to stay
so hard
because once we turn on merge element
one is ops everything gets tricky
that one's gonna take that that one's
gonna be the most of the coating today
yeah
basically it allows these kernels to uh
take in an arbitrary number
you'll see what happens when you do it
well that won't work okay
man that's rough
this is so hard
this one's gonna be hard to ride
okay so you see the problem now i'll
show you
what
why are these disconnected
why did the graph break
why did the graph break
oh it's because we're never realizing
the movement ops
okay well that doesn't work though
this is actually not a big change this
is mostly just cosmetic
that just fixes the graphs nothing else
okay the graphs are fixed you know all
the green ones are gone now
these are only these are the only the
ones that we're actually realizing
like you see now let's oh this is cool
you see now it's going into these
kernels like look at this ad kernel
right like normally you can't add those
two things but because the broadcasting
is being done in the kernel all the
green ones are gone
pretty cool
okay the problem now is that it's doing
all these gray ones it's doing an
absolutely brutal amount of gray ones
even really stupid gray ones like this
one it's something that's subtracting
actually the number one
um which is stupid
oh that's gonna be hard to write
yeah look at all these stupid gray
kernels
these can all be combined into one
kernel
those are actually free also
but i like that all the green ones are
gone
um this is a lot like how you write
compilers
oh i don't know i don't know if i have
the energy to write that code now like
it's gonna be the big gray combiner
um
ooh the big gray combiner's gonna be
hard to write
it's gonna be hard to write
but i like that the uh the stupid green
ones are gone
oh we're gonna manage to get rid of
these ones as well because we're
actually gonna read the value from the
one and we're gonna shove it in
oh that's gonna be quality
okay so we're looking for times
that are about 10 milliseconds
by the time we get through with all of
this on a gpu as big as this
it's got to run in like 20 milliseconds
on the device
yeah
this is going to be so painful
it's just wasting so much time doing all
these kernels
how are they in speed uh red is the
slowest
gray is no i mean greens are free greens
don't actually do anything like that's
why all the greens disappeared greens
are movement ops
um
the gray ones they're not that it's not
that the gray ones are slow
they're fast the red ones are the
slowest but
the problem is there's just so many gray
ones and they're making copies and
they're using memory
like it's just you can see what these
are right like i'm not i'm not doing
anything crazy right
i'm just like adding
if this is just subtract right this
subtracts this minus s equals this this
times this equals this this value this
minus s equals this
these two things come together equal
this so really what we get it down to is
it's just going to be red ones
uh by the time we're done
so this is going to be the big chunk of
code
we have to write like an ast and
do a lot of you know dumb crap
it's a real compiler for binary ops
oh
all right
we got chocolate
thank you glad you appreciate it
let's write this thing
oh we'll call it red equals handle
binary
these can come up here
now
i think
we're going to return
our gpu buffer
i'm going to call it handle we're going
to call it realize
yeah i wrote a nice graphing library so
you guys would appreciate it on stream
i hope you guys appreciate it
i'm gonna have to import why don't you
just say gops cl build
i've been off
okay
okay
um
it's gonna work
or is it gonna be like unhashible type
you can't do that it's an unhashable
type
okay you can't do that because it's an
unhashable type and if you make eye
hazel type you're not
um
how many viewers we got
uh it will be run on gpu
as many times as long as you're driving
your car
here
as long as you're driving their car 20
times per second
570 all right cool okay it's wrong now
wait so even if those kernels take no
time at all oh but now we can enable
this
merge element wise ops
that's what's going to this is what's
going to give us power
oh yeah
it's not even faster
why do i do why it's not even faster
okay it will be faster someday
we have to believe
it's okay if the compiler runs slow as
long as the compiled output's really
fast yeah that's true
right that's how a lot of like lazy
things are it'll be fast for everything
that'll be fast for training right it's
very rare that you just run a neural
network once and all this stuff will be
transparent in the back end
okay
so
i don't understand why that's not faster
move to profile it
what's taking time
is the time being spent in the
convolutions
also i don't like how long that takes
is python just that slow
how much is python making this slower
it's not python it really won't matter
in the end in the end we have another
caching layer to put in front of this
called need
um need is very fast
i don't understand like that's pretty
much all the uh
after we do this one
i'm gonna leave that one on
why is that not faster
it's neat it's it's an open pile you can
look it up my name is after the dr seuss
thing
why is that faster
no
it's gotta be blocking
tesla
that work
it does something else so if i do that
it's fast right
wait what
oh no so let's wait for the kindness
okay never mind
uh
let's see if we can get a quick answer
to why it's slow
self is not defined
those are
okay we'll call the function
okay good now we can see where we're
wasting time
nq colonel kahn
really
is it blocking
all the time is being spent here
in this curl right here
if i comment that out it's fast
okay that's fast
why is that slow
well that's mad concerning
i mean that's that's that's annoying for
uh
for for just tiny bite in general too
why doesn't cueing come so slow
pi opencl invoker for conf
is it because i'm passing in all the uh
this is what you get for being 17 levels
of abstraction away from the hardware
we're going to have to use uh
we're going to have to use fake again if
he's tiny cuda tiny could be fast
fake kong
it's like comp but it does not is vidcon
also slow
let's find out
on
celebrities and whatever is doing well
things i don't know let's find out
doesn't seem slop
only real calm is slow
is this numpy crap slow
it's gotta be and that's all that's the
difference right
what if
np.m32 is actually insanely slow
oh
i know what the problem is
oh my god those are being copied to the
gpu
no wonder it's so slow
wow
okay well that's going to be a big win
for tiny grad too
and that's why you use a profiler
and that's why
you don't learn lessons from men with no
arms
can i pass in two there does that work
invalid argument okay colonel said our
fat let's read pi open c alabamas
i mean i know something we can do want
to make something fast
oh no
still autocorrect extension
i don't know how i feel about that
i don't know how i feel about that
yeah wow that's really bad
okay
ready for me to fix this
watch your shit boys
watch this shit
watch this shit you're right you're
ready to see here you see some terribly
unfair hacks
uh we'll say args equals
this yeah it's just it's just that
that's just that slot because each one
of those is constructing a four byte
buffer and then copying that four byte
buffer to the gpu
and no wonder it's slow
okay um
our names
oh it's gonna take a long time sorry
i almost have it faster but it's fixed
as
well there's got to be a better way to
do this there's got to be a way to
actually pass in integers
it's copying those to the
no we're not going to do this
we're going to get rid of this mpn32
stuff that's my fake tongue
my fake comes back what do i do when do
i do it do i do what do i do
okay i can't pass in two there because
that doesn't work
but i think if i like set the d type
args or something
set scalar args d type for each argument
r d type
we'll see if this is fast i have my
doubts
oh that's not even a kernel
oh because i hooked up with cl build
see how build returns a function
cl program
all
self
arms
just work
cl program takes no arguments
i don't understand i've passed
in doesn't work
oh
class
cl build
i'm not sure i can put that enough
does that work
seo program has no arguments yeah
okay that's fine back to that
now we can go back down here and say
okay i think dot built do i want to do
it before build yeah it before build
that built
set scalar arc types uh
mp32
none
kernel was not found as a program
oh ah don't do dot colonel do
it's kind of an dots name should i call
it kernel
colonel said archetypes takes two
positional arguments but five were given
wow
that
okay
that's pretty fast
so let's see if that works in general
let's try that on vidcon
[Music]
got in 32
times 16.
uh
so work
ah look it's fast now
look how fast that is now
vidcom's not there oh
oh that's a big win for tiny grads too
oh man how much time was i wasting on
that crap
um we probably shouldn't even put that
there we should put this in here
uh archetypes
options equals twofold
if our v types is
wow
wow that was a waste of time
but that was a big victory actually so i
shouldn't complain too much okay good
uh our
rv types
like that
uh on a hatchimal type list yes
it can't be
so that's because when you use funk
tools lru cache if your input arguments
aren't tuples
then you're gonna have a bad time
okay 40 47 48 milliseconds
all right let's
go back to the thing that actually works
which is that
uh we can't merge the element wise off
so if we do that
let's see what our time is
okay
all right 69 milliseconds
that's pretty good
uh wait maybe it's just because no hang
on
let's get rid of that
that might just be that fake okay
all right 107 milliseconds okay big
improvement big improvement let's go
let's go
uh let's take a quick look at where
we're still wasting time if there's any
other hot spots like that
oh man that was a huge waste that was a
huge waste of uh you see what was
happening
stupid thing was in queueing everything
to the gpu
uh
sort by why would you want to sort by
name
what that's so dumb
what a stupid thing to sort by
what do i get short key from from p
stats
if the sort value is pissing once
sort
equals sort key dot
give me a little
okay
uh
[Music]
oh no no we should not do that i don't
want cumulative i want the other one
oh call count p calls time
oh yes why isn't that the normal thing
no yes we're going to write a profiler
but we're going to sort by name
what a good choice
okay uh
reduce of np
you funk objects
why do i have any numpy i hate numpy
where's the num piping
find the numpy
none of these things should be numpy
there should be no numpy why is numpy
showing up
oh
get ready for something stupid all right
this
don't use numpy
is that the only place i use numpy in
here
i'm gonna go all right because like
because of prod
rhett equals one
for
xx and x
rat times equals xx return red that's
actually going to be faster than numpy
because numpy is hot chocolate chad
let's go
didn't make that faster but all right
okay now most of the time is being spent
in mqnd range kernel that's fine a lot
of times being spent on logging
that's fine
uh a knit in ops gpu
how do i write that in one line it's
just upsetting
actually i think this math prize they're
not
um
no math
whatever auto pixie done that
let's go that's why i put that there
okay math crowd is fast good
uh anything else stupid
okay log ops is slow you can comment
that out
it's just my graphing
all right log offs took a bit of time
uh
ops gpu and knit is slow what is that
doing
um
that should be instant
oh that creates buffers
fine
oops
didn't change anything did i i hate when
i like type things in the editor and
like i don't know what happens
uh i'm just gonna do something stupid
here
property
oh look it automatically changed to
property
that was suspicious
then we don't need to create
this on everyone
um
my call is pretty much free
okay
host buff should never be gpu buffer
roundup doesn't use any stupid numpy
does it okay now
we don't need to check that anymore
it's still there
because there's just not much time
okay this isn't much time anymore
85 milliseconds
okay does everyone understand what this
realized and weighted means
so
um
oh i'm just gonna add one more here
okay
it's taking
24 milliseconds to run the python so
this right now is a lower bound even if
our
kernels were totally free
they would be they would be that slow
i'm just going to write 87
did i rewrite that
okay fine good that doesn't matter then
that doesn't matter to a commit for just
that
all the poor machines that are gonna
have to run okay
so we're spending 23 milliseconds in
python
and we're spending this long waiting for
the cl buffer right so when you do an
opencl
uh
nq kernel
unless you're doing a weight it doesn't
actually do anything
it just
um wow i can't believe that that change
made so much of a difference
you have to be so careful when you're
passing those things in like tiny grad
had tons of that crap
tiny guy's gonna be mad fast when we're
done i think we're going to out compete
by touch
you can't you can't beat this optimizer
like you can't beat
if all i'm doing is enqueues for the
comms you actually can't beat that
people don't understand how much time is
being wasted on this kind of like look
how much time is wasted copying those
hints to the gpu how much of that's
covered everywhere at five which even
tiny guy used to have a ton of that but
now it's just in one place
um okay so this actually isn't even the
lower bound
because once i
merge element wise ops the python time
is going to go down because it's
enqueuing like half the kernels
unfortunately that isn't going to work
until realized binary ops works
oh my god
okay
uh we should bring the graph back
check that out though 69 milliseconds
when we actually make this work
and then we have one more thing to do we
can shove these
these last gray ones inside the end of
the conv kernel so we just got to keep
that in mind while we're doing this
it's pretty fast bros
and then we have the fast kind of kernel
this is still using the slow kernel that
just has loops
we have this kernel over here and we
figure out how to use this one this one
is very fast
kind of insert uterine binary ops there
when you say realize you mean basically
really do something yeah so
this is the tensors are lazy meaning
they don't take on any value
until uh
until we uh
realize them
so we realize that we convert them from
a late look look at the here
in order to understand what realize does
just look at the type signature right
it takes in a lazy buffer and it outputs
a gpu buffer that's all you need to know
to understand what realizes
okay
ah that's the salt junk
i don't need any of that
oh i actually don't need that either
okay we just need to make realize binary
apps work
because right now you see that it's all
returning zeros because the function
that's running in realized binary ops
doesn't actually do anything
we can make it do stuff
wow what a waste of time
all those things so i was like python i
was like the c doesn't have this problem
c doesn't require you to copy a 4 byte
thing to the gpu in order to use it
you know
i think i can still do this too
oh yeah look at this
i don't know why this coin do you
realizing every time
oh
shhh
i think this works
i think it's actually
it's running the ops one it's then
squared right now if you run it with
that
because that's calling to cpu
for each thing it has to like rerun the
net each time
but that's not actually too bad
this is the old debugger
like that's outside because we're a
bunch of levels of abstraction deep here
in tiny grad
so it reruns the net for each one of
these little things
um
which if we wanted to make that fast we
could just get rid of the d realize the
d realize is really in the wrong place
that's really a hack
look at that
wow
don't waste your time on stupid crap
okay cool
now we have to make these
operations work
some of them are going to be easier than
others some of them i don't even know
where my kernels are down here
why is that comp at the bottom there
does not run everything
where'd my big slice go
why are those cars down there i don't
get it
oh there's some disconnection on the
graph um
are you riding custom opencl kernels of
course
oh does this work
no it's still wrong
yeah okay something's disconnected now
to try to figure out what it does
oh so actually this type is wrong
oh lazy sources we want lazy buffer
this
lazy buffer
oh yeah it's not actually this okay
i see the problem
so for this we want to do
x sub zero for x and i wish it would
like type check right there for me and
tell me if i got that type right so i
got that type right it's probably right
okay so let's make sure the graph's not
broken yeah graph's not broken okay now
we're back to having like these slices
down here and stuff
great and now we can go back to merging
the element wise ops it should be fun
the problem was that i was returning the
sources so there's a movement up and i
was returning the source before the
shape
of the shape of the movement out not of
the before the shape tracker
so now you see it's right
um we want these graphs to be a little
more readable go back in here
change that to that
if only we had languages with uh
static type checking yeah well
python has it you just kind of like run
out and set it off it's getting better
and python is the best language in the
world and anyone who thinks python's not
the best language in the world is wrong
python has basically two problems one it
has it doesn't have static types and two
it's slow but if you fix both of those
things
[Music]
python would be by far the best language
in the world and they're working and
fixing them
um
i love python
okay good
cool
um
okay
now for the tricky part
311 says
i'm so psyched
let's print length sources
oh
should be before the shape tracker why
are there these
why does that exist
all the ones with ones are not going to
be bad to remove
i think there's just a limit on how many
uh
see all these ones with ones
i don't really understand this
that should be not
oh no wow i would have a convolution oh
that's brutal
okay
i know what we can filter out
instead of shape
well let's write some types blog types
tuple
no way that's after it's realized
i don't actually want to realize them
all
resources st
ah we actually should have a type there
list
truthful
lazy buffer shape tracker
so we want the trivial there's some
sources that are trivial
um and i guess if those are lazy buffers
we can do off-type and the ones that
have op type
none
and shape one
we don't have to respect
so this is kind of like where it came
from
none means it came from a user buffer
uh
and
and processing ops means it came from a
processing apps
well the biggest game was just fixing
that cl bug
but now we're spending most of our time
waiting for kernels
i think i mean that would make sense
that there's no more block that makes it
that's about how long i expect the
python to take
um and not equals one in the previous
run what do you mean by that
i'm saying that like if your
thing is actually a just a just like one
number we're just gonna stick it right
in the kernel
or did i make those inline
what i'll do within mine later okay
uh
i had a bunch of ones that i want i
don't know
not even going to be that fast
why is it still so slow
are the columns that slow
oh i know what i'll make it faster
we should put in multiple types
let's put in local kernel sizes
okay
you have to filter out the trivial
sources
uh
for
b
and
uh v dot shape
one
the shape tracking doesn't even matter
um
you have to like track it through
because we're gonna have to do an ast
traverse i'm gonna have to track
which ones of these correspond to which
lazy source
okay this is okay
um
real sources
s
um
ladybuffer has no attribute arc
oh lazy op does
okay cool
all right so now you see that we get gpu
trackers here
but for the trivial ones we get this
cpu buffer minus one
d table of thirty two
ah we can actually even go one further
less than one
they're just all floats
okay so there's numbers there
cool so we're actually gonna we're
actually gonna take those numbers we're
gonna shove the numbers into the code
actually
should we just start writing the code
right there
i think maybe we can
you'll have to pass those all into the
kernel
copy and paste basically this
do
i've never used plus equals on strings
in python because it's n squared
i hope everybody knows that
um
expression
uh i'm gonna call that b
we have to call that some number
seems right
oh this isn't too bad okay
well
let's write this correctly so we don't
actually want to do that
because for the fake ones
just
you
foreign
you
yeah i don't actually be count
just do our gun
okay does that make sense
it'll make a little bit more sense
probably when you print out the program
um
let's do a trivial one for now
there's some similar programs we can
test okay that doesn't matter
that doesn't matter that doesn't matter
[Music]
to
okay we have types here we're gonna say
and here we're gonna say
is that better
all right we forgot a bunch of
semicolons here's semicolon
uh okay we're gonna have to pass in the
buffers here oh
what don't you call realize
i don't wanna to comment that out um
yeah that's right
uh x dot cl for x in realvolves
okay now we're passing them in
cool
all right so we can read this code and
see if i wrote anything really stupid
uh
okay get one
it's not combining them
i guess there really is only one buffer
there
yeah
because ellie was really uh
just biased we should get multiple
yeah
cool
now we just have to write the actual
code which combines these things
then we're going to end it with
okay
now ready to write an ast traverser
we'll do that in a minute okay so does
everyone see what we did here we took
this thing we got all the buffers coming
in we permuted them correctly through
the shape tracker and now we're going to
write something that traverses the ast
the internal ast in the operations and
generates the opencl code to uh
to run that operation
and just like you can see also how we're
going to add this to the convolution
eventually we're going to just stick
this stuff in the end of the convolution
the convolution has the same basic idea
i don't know it's actually 3d it's a
little bit more complicated
so i'll have to set gid to something
else
i should do that anyway
i see why this is so slow
make this let's make this not slow
i figure i make this not slow in a
minute
oh yeah we can speed up that convolution
a ton by just rewriting that
okay let's fix this and then let's make
the convolution fast
let's finish this let's finish this
we do less stupid math
i was just trying to chill and make
bangers tell all these little bitches
they're in danger
[Music]
i'm down nine times but i get up ten
i've been down nine times but get up ten
[Music]
where's the astm traversing write that
up
yeah
so we gotta traverse an ast
union
uh lazy buffer lazy up
and we're gonna output a string
okay
if
uh is instance
uh lazy buffer
it's a buffer
then return
our
lazy sources dot index op
okay so
you can see here that we have these args
and that's just going to return it if
it's actually just a buffer
okay
otherwise we're going to have to do the
operation
and
we're gonna have to get the code for
each one of these operations
uh
it's not really up
x
x dot up
that
and we also need unity ops
um
unfortunately some of them use the words
uh
code dot replace
a
with
asked
this is fine
hang on
open parentheses
asked uh
x dot source of zero
um if
the length of x dot source
greater than one
code dot replace
b
and return code
no way that works
past
uh
next thought op
there's no way that just works
come on it can't be that good
uh reptile okay
candidate function not viable
no matching function for qual to max
what's wrong with that
one was provided
seems okay
there should all be floats
morning expression result unused
it doesn't seem right
okay okay here we go
that looks okay to me
um
i didn't mess anything up right
oh why is that b
do i just get bored
why did i put these
why did i put these there
i just think bees would look nicer
okay well it still doesn't work
i'm going to express your result unused
why
is that wrong
first max does it really have two
arguments
yeah
oh
wait my parents are wrong what
how did that other parent get there
huh
oh what
okay
there you go
all right uh let's run it and see if it
works
that'd be crazy if that just works
i don't think it's going to but
well
okay
except it's slower
and wrong
it's both slower and wrong okay so
that's very upsetting um let's see if it
works if i don't merge the aluminums
wrong
i don't learn to the element office it
should be pretty close to just uh
did i make a did i make a mistake
i made a mistake and replace
i mean you know i could put friends on
the outside and then i don't need
friends there
clearly i made a mistake it doesn't work
this should all be this should be simple
ops now
none of these ones should be complicated
what's the intuition and why tiny grad
should be faster because you can write
very fast optimizers if you're doing
simple
stuff okay
um somehow it's wrong even without
combining the things and that should be
almost identical to the uh the shape
jack ones
so i don't understand that
did i get some order wrong somewhere
i actually have to do this
wrong
see if i messed any of these up
i have like really nice tests
that are good for detecting things like
this but this is the first time i really
felt the need to use them
it would be nice because they would just
tell me which app i messed up
so all the right order
global floor sg
i mean this should be the same code as i
was generating before with the shape
track ones
so
we can look at what's different
uh
write that shape that's right
it should be the same as this right see
you see how like this is just a generic
version of this
um
okay
no i should not be using the shape track
ones
let's look at a simple one
okay
we're doing a
mall here
and
we get
gid above zero
buff one
get zero get one x i d x g i g not
modified
gets the floats and subtracts them
too bad now those things are actually
real tests
i get all zeros that's a very suspicious
one
it's like i'm not running the kernel
correctly almost
red dot shape
definitely is that shape
realize binary knobs okay let's just go
back to this and make sure i didn't mess
this up
okay that one's correct
let's see if the unary ops one is
correct
also
correct if i only do it for unitary ops
no it's not
okay well that should be really easy to
find then
because these are just one operation
things
let's read unary op shape track and see
if there's any way i differ from that
max x log nag sign
i replace that
this never hits
oh
i'm passing in the arguments in the
wrong order
would you look at that well that was
stupid
i passed the float and the idx
but then when i actually go and try to
use it i pass in the ivx oh yeah thanks
for not type checking anything opencl
okay now it works
great and it's faster so what a waste
all right
thanks thanks for not type checking
anything hoping cl you know you could
could have type checked something would
have made me happy all right no type
checking
see what i did there just passed in
the arguments backward even though one
of them's a float pointer and one of
them is an int
i can take out that
it's cool
now though
oh
we'll try caching that and see if that
works
go to the print at least
look at how much time it's spending in
python
now we're up chat we're up to 35 mil 36
milliseconds of python uh
we should be able to cache this right
tools.lru cache
one hashable type list okay never mind
let's move this
out
aiming for a specific time
well
uh it runs in about 25 milliseconds now
on the device
oh
forgot about that
that should make things faster
but it's wrong
whenever you're doing a hash table
instead of l after
um
okay we can figure out why that one
doesn't work
but
let's
the whole point was to be able to merge
the element lines up so let's see if
that even works
oh it's much slower now it's got to
compile a lot more stuff
oh 65 milliseconds in python
oh that's brutal
a little slower
you should all be fast in theory though
one day
74 milliseconds in python
okay
uh here's a question
why doesn't this work
that'll make things a lot faster we can
make it work b type is not in b shape
equals one
why is it wrong it's not even faster
it's not even faster
and it's raw
i have a few ideas
first off let's figure out what that's
broken
okay um if br type is none
and b shape is one
oh
is it possible they cannot be valid
we're gonna add something to shape
tracker
okay it's not wrong anymore
some of them needed valid and that's
what the problem was
fix
speed up
yeah so the problem basically was uh
there that
we should also
just write this more let me just write
this better um
so
oh
wait no this can't both be wrong
oh
that's kind of lame
also speed things up a little bit here
uh if st needs valid
do that
otherwise
do that
i'll just stop almost do nothing hang on
one sec
uh so
we'll say this
uh if st needs valid else
to turn x by dx
okay
unfortunately
it's slower
and this is a tragedy
um if you don't move
it's faster we're still spending a lot
of time in python
how is merging the element-wise ops
possibly slower
this gets rid of so many nodes in the
graph
should we also get rid of the ones let's
get rid of the ones since they're not
actually realized buffers
um
lazy sources
also donate
this we can delete
this
i know we just wrote this this morning
and we can delete this
okay
it's slow but that's okay
it's getting really short though
we barely have anything in this graph
left
we got rid of all the
single ones and we put them in the
kernel
we wrote really good code why is it slow
a lot of times you can spend python
so let's separate out
some stuff
compile binary
um
what are you using to gen the code
graphics called dot
uh
you
you
okay we get the ones that are
[Music]
valid and we have to realize on those
ones real buffs equals
lazy sources red dot realize
okay
um
list comprehension
okay somehow it's wrong now
why did i not
do this more incrementally
indexes that should be right
real buffs equals x dot realize that's
right
prog source is right
passing in lazy sources that's right
i should have done this more
incrementally what did i break
what did i break
how did i break something
that's junk okay
instead of appending to real buffs
i append idx's
and i realize that oh
yeah because i need the shape track ones
um
just so it works
uh
tuple object has no attribute realize
yes
working
am i sure what's getting removed
the old ops yeah
we can print them if you want
um
it might be expensive because we're
actually getting the shape tracker there
we don't actually need the shape tracker
but we do need the actual buffer that
comes from the shape tracker
lazy buffer
[Music]
think it's uh off we care
[Music]
um
x equals x star
yeah yeah i'm gonna cash that one
we can run the profiler again too
actually
okay
i'm spending 65 milliseconds of python
profile
for net program build
colonel and net
should all be cached i don't understand
this
how is that not cached
programs from source cache but that
should all be cached and understand
the programs aren't different are they
if the opposite is the same now the part
is not the same
i realize that up there this should all
be in cash
oh
okay i'm getting cash misses okay
that's actually good
i've got to figure out why that cash is
missing i don't understand
i don't understand everything should be
deterministic
yeah that doesn't make sense this should
be entirely deterministic
what could be wrong
max size is not what's the default for
max size
the default is 128. wait that's a joke
right
no no that's actually a joke right
don't tell me the default is 128.
oh my god
oh that's dumb
oh that's dumb
ah dumb
dum dum dum dum dum
else do i use lru cash
well
that was an easy fix
all right we're back to 25 milliseconds
of python and we're down to
that many milliseconds
i don't know if that's better
how is the default not unbounded
there's a new one but it's like not
supported in
fine
fine
fine
we found the problem
let's make sure we're not actually
getting any more cash misses
i don't think we will but so we
shouldn't have any cash misses after d
right why not
yeah back when you only have 128 bytes
of ram
it's funny bro
so
and it's bad
i have an lru cash and ops gpu where
uh yeah i changed that one what's this
one
all right let's take a look at the
profile again
i love profiling
see if we have hot spots
should i throw a envelope
okay
most of the time now
is being spent in shape tracker
so that's another one we can fix
as i was talking about before
i think this is going to work
lists
yeah
okay 12 milliseconds in python boom
oh that's fast now
oh yeah finally we got games
yeah
no i know it's not in bytes i was joking
about that
yo let's go 13 milliseconds in python 62
milliseconds total that's pretty much
we're almost done
okay we have two last optimizations we
have remove movement knobs which we have
to fix shape tracker for
and then we have merge element wise into
convol play which is uh
pretty wild
how fast was it in pi torch
um pytorch can't use my gpu so it's not
a fair comparison
uh uh on
a
30-90
wait something's wrong here hang on
i broke the
continuity of some stuff
yeah actually because okay
don't
here
this is not i this should actually be
buff st
um
continuous again okay
so the last
down ten percent since earlier it's 10x
yeah yeah um it's two it's three
milliseconds on a 30 90.
uh it's about
50 milliseconds on an intel cpu
um
yeah
wait
oh no okay those green ones are still
actually happening
they're not bad ones though i don't
think
oh yeah we're doing a bunch of weird
premieres and stuff
okay fine
all right um we can stick this
inside of a kong
we can also just improve the calm a
little bit
just improve this a little bit we'll get
some gains
so
gi dx equals
um
get global id0
just so it matches the other ones
it's a little faster but wrong
oh
because we have to multiply this by
that
okay it's a little faster
is actually faster no it's not faster i
lie
um
this one could be made faster
a lot faster and wrong
oh
i saved a line
welcome to the subscribers
you're a subscriber you are a valued
individual you're a valued member of
society
and
what changes
none of this stuff just that
turn
how's that slower
how is that slower
all right i think things get faster and
they actually get slower so that's great
um
um okay
do
this stuff isn't fast
bro the cloud's a scam bro
yo one day man
one day you're gonna get you can get
robbed dude the cloud's gonna rug you
man
the cloud's gonna wreck you when the
government makes cloud computers illegal
and you're gonna get roughed
and i'm gonna be sitting there with my
ar-15 uh in front of my computers and
being like come and take it bros and
then i'm gonna get shot and then you
know you should have just went with the
cloud and that's
why do you get shot well it's because i
didn't choose the cloud
cloud by cloud
okay well all that did nothing so that's
really all disappointing
what's even more i don't know i guess
the only thing i actually like from that
was this this one can stay
um so like you think that that stuff
would make it faster but it doesn't
because it's already pretty well
optimized
uh can i move that check outside yeah i
probably can
[Music]
uh
but i'm not sure really any of it
matters
like i played with that for a while i
just didn't do anything
so maybe it's just useless
um we can try this as well
this is probably a good idea
let's try
like 1 16 16 or something
see if that's gonna make anything faster
invalid work group size
so this is a local work group it matters
a ton on the uh qualcomm
so we can look if there's like rules
about
local memory type
y is greater than 16 and c dot or x is
greater than 16.
we'll go group
does that work
okay okay that's a little faster
valid work group size
it just says like where you're likely to
get cash hits
okay well that doesn't work
um
valid work group size
my connection go through
oh what do i do
i don't worry about that
i want group size
kind of about working size about working
size and don't work
does that work
no
okay so it's probably maybe it's 256 max
okay so something we could do is we
could compile a separate kernel for
every convolution
that'd be pretty crazy
you can like put all those arguments
inside the kernel anyway which is what i
was going to do before
if we didn't find that other thing
i don't know is 57 milliseconds fast
like i don't know if that's fast it
seems kind of fast
we have to do the last optimization
still
oh
will that just work i think it might
just work if we use the other
convolution
we have another convolution we could use
that isn't this one
i can try it i don't think there's any
bugs
i mean i've tested the convolution a lot
okay so the remember that other
convolution i showed you guys from ops
opencl
i think it just works
okay there's a few things we have to do
to enable that convolution
and then there's also the last thing of
shoving the uh
we could shove the binary ops inside the
convolution knob
we should probably try the other
convolution first though because we have
to use the other convolution on the
divisor
and we can use this convolution but this
convolution is very slow oh but that
involves images oh never mind that's too
painful for this stream
tiny grad is slowly becoming a c rapper
what's c nothing c
i'm gonna clean this all up and make it
small too
okay so
this optimization still needs to be
fixed
this optimization needs to be done we
can see that optimization actually has
to be a straight up window
so let's try it
we can get rid of um
we remove the word kernel from that
let's try a quick test
oh another thing we can try
can i say inline here
i'm not sure it matters
but uh
maybe it does
oh okay all right all right we'll take
the milliseconds
it's a few more milliseconds so that's
in line
um
so
the last optimization to do
uh the last one on the list here
here this involves improving shape
tracker
tiny grad is perfect for any place where
you have a you don't have an nvidia gpu
but i don't know these these
optimizations are pretty powerful
the thing is it's going to be slow until
you make it fast and then when it's fast
it's magic
what's that used to just if you delete
that
cool
it's a little faster now that we did
inline
okay
i have to return the type here
this should be free
you
so
join opencl type
spin up
[Music]
outside
i think that's right
let's try it
semicolon
should be the same speed
when i make it work
you know i'm trying to see all the time
uh i'm gonna do yeah you're right
okay cool
very cool
um
all right so
the last thing i'm trying to do here
is move the
convolution oh this is going to actually
be a whole implementation of ops gpu
after this i don't do reduceops but
worry about those later
okay
so the last thing i want to do is you
can see in the convolution here i can
stick uh binary and
ops here
oh
actually
this shouldn't be void
this should be
float
hear me out hear me out
now we can return
this
on now we can say
do have to get the global id again but
that's okay
uh
res sub
gid
equals spin off we don't have to pass
that
in anymore
all right
all right
because we're still somehow passing that
in oh
pass that in there is g
oh i was really passing g
all right
okay
cool
now
for the convolution
we can just stick that there
i think
we have one other thing we have to make
work
okay
now it's like a function
hmm
i just do that
it doesn't work yet
local variable code reference before
assignment and that's because i have to
support processing
um unused variables okay
actually
okay
use of undeclared identifier com output
and that's because
i'm calling realize binary op which i
shouldn't be
instead of coming out but we'll call
that acc
and then realize processing up
uh we do want to copy and paste
do you really want to copy and paste all
this or do we just want to shove it in
a prefix codex
code
and then here we'll call
uh
acc equals bin op gid
middle code
oh okay
processing it up
we have to actually find the
oh convolution don't get lazy umps
i do
but it returns you just the
um i don't know what that returns
which one's the actual op that's not
what i want
okay
uh
we have to traverse the ist and find the
actual convolution so we can pass in
x and w there
the op is always processing off dot com
no actually we have to just find me off
okay
fine
i feel like actually i wrote this
already
here we go find calm
[Music]
uh
source of zero dot realize
source one realize
so
my prefix code is frog source
and my middle code
is this
do
i don't have to pass any extra buffs too
very extra buffs
this
did we realize them yet no we didn't
realize them
yeah maybe that should be now
just passing real buffs
then we can put this down here
[Music]
next
you can do that right i can do two stars
i believe i can
um
then we're also going to have to add
them here
between a comma
open the cl type
pass that in
i think that's right
these things bind
okay should be right
let's do one
convolution okay uh lazy sources rat is
not defined
uh it's just this
return acc use of undeclared identifier
account
oh
yeah okay it's because i have to pass in
uh to this binary op thing if we used a
convolution
i have to pass in an argument
um
lfb.op type
equals equals
no that's not really right in ast
we do that
i have an idea we're passing them in
twice
passing in the convolutions twice
uh let's just put the code rebuilding
here we go
so the problem is this acc is
non-existent
um yet we are still passing in the
buffers which we don't want to
we want to exclude
the convolution buffers
if
because we were passing in the
convolutions 128 times
um
lb binary ops binary ops is not in the
list
okay
whatever's traversing the oh here we go
um if
up not equal to
processing object actually better idea
if
a in off
if
right
uh
oh
no sorry if any in code
okay
do i even need to exclude them now
i think i do
yeah i do
all right that's a simple bug here
um
and go down here
i'll clean all this up just we're done
um yeah same bug here
actually do i just do that multiple
places
yeah whenever you're doing this kind of
stuff you should just do this
it fixes that bug okay
still using undeclared identify our acc
and that's because we're going to have
to include it in opencl type
i don't exactly know how to do that
oh that's easy actually
maybe we just want to include that in
opencl type then we can avoid this stuff
too
uh okay what if i do x dot split
space
minus one dot replace
star with nothing
instead of this we'll start opencl type
within gid
ah
if
ret dot op type equals equals processing
ops
you can see outside plus equals float
acc
dot append
okay because we keep the accumulated
thing from the convolution if that's the
case
um okay
no we don't want that to go there it's
only a local one
we don't want those up there so we'll
actually skip to
when we pass an open cl type because not
real buffs
yeah i don't have anything to do with
that very cool
lazybuffer has no attribute cl okay
that's a different issue
um it's because we have to realize the
columns
realize the weights in the um
stuff
redefinition of gid uh
oh wait what
oh i've just stripped one there
okay cool
put it on the open model
sweet that's right
uh let's remove remember printing all
that junk
and then let's turn on the last
optimization and see if it works
fused
okay
um merge element wise into conv output
true
i'll show you what it looks like here
so you see how this is that i'll show
you what the graph looks like without it
so we merged the element-wise stuff
into the convolution kernel so you're
going to see a gray one appearing
between the convolutions when i disable
that you see it
let's run the open pilot model and see
how fast it is
okay length of argument list and cl
generated number of arguments do not
agree well
that's too bad i'm sorry you don't agree
but
oh
i think it's because it's passing in
calm twice
oh
above zero
length of argument list and see i'll
generate a number of arguments don't
agree
oh maybe because i didn't strip it here
okay well we're clearly in a
convap
oh rd types
oh that's not bad uh it's just us
we have to add more nuns to the end
plus
nine
times
open c outside
oh
55 milliseconds
wow that was marginally not worth it
that was really marginally not worth it
we put a lot of effort into that for
those last few milliseconds
oh yes
working
55 ms
all right
looking there there's only 330 left
there's not even many more to go
there's still a few stupid binary ops
here wait
why are those there
those shouldn't be there
those should be fused into the conf
oh they're not fused into the clone
because it has to do uh
oh it's it's okay
it's yeah i can fix this
oh
i can fix this last one
and then we'll be down to wait why is
this still 346 processing ops
that's too many
that's way too many oh
it's because that's not getting reset
it's actually that divided by two
which is kind of shitty
because we're not we're not getting rid
of that after we uh
why is the graph not showing up twice
i'm getting rid of that after we do
realize i don't know why the graph isn't
showing up twice maybe it is and i'm
just not scrolling to the right place
um
let's not log them hang on where's long
hop
so
wait what
why is it still so many
ah
what is this classical daisy buffer
okay there we go all right
49 milliseconds we got rid of the logs
the logs wow
wow look at the time in python now it
was all just the logs
uh don't log
while timing
because we're not actually going to log
and it's all waiting for the kernels now
okay there's a few more to do
also
these movement ups here
some of them aren't even real
so some of them can go entirely even if
it's a convolution it's not actually a
reshape is worthless
well our reshapes are fake
so those can probably go
48 milliseconds
um we do have to fix shape tracker
though and that's a big project
because then we can enable this last one
let's see how fast it'll be once we
enable it
even if it's wrong
what
it's the same speed
doesn't make sense
it makes the python faster though
just like we get the binary apps down to
four
but at the expense of more processing up
so that's very suspicious
that's kind of wrong then
we're doing extra convolutions
how many ops are we at right now
216.
okay that's already under what we're
currently doing in open pilot
the movement ops are also fake
like this one's just a reshape right so
if we find movement offs that are just
reshapes we can just return the uh
why do they not collapse into the car i
guess they don't collapse into the comb
because okay
when i realized that maybe they don't
actually run
when i realize movements here
if s t dot u is equals equals one
ah
oh actually even better i could say if s
t dot contiguous
that equals
dot realize
if it's already contiguous i don't need
to make it contiguous
okay a few more milliseconds
oh i should actually also um
hmm alright
all right we could probably improve this
stuff
let's try this
why are these invalid
oh
i'm sorry
i was getting my mens and my maxes
backwards
528 and it doesn't like 2d6
it's not a multiple maybe
does it have to be a multiple
does this just work
no that's too much
no no
he just means error i'm actually putting
an e in don't worry
ah
and see that bs times c dot c out
if
okay
let's see that bs times c dot c out is
less than 2v6
uh do that else local group equals
always add it to two to six else f
c dot bs times c dot
mod
equals equals
slower
slower
same speed
okay
i think i think we're done
he's taking six milliseconds in python
it's taking 42 milliseconds in the
kernels
uh we could switch to the other
convolution
but that involves images and that's not
going to happen on this stream
um we got it down to
216 ops
we're doing still a whole bunch of
stupid movement ops i think
like you see this one here
this is where shape tracker needs to be
improved
so it's doing a double permute
this is doing a permute a permute and a
reshape so it's just an extra copy
on all of those like some of them it
matters
like on that one
we're using the convolution kernel
for
uh matrix multiplies
so we should think about whether this is
actually uh
done appropriately
for making multiplies
i swear i don't think it is
we definitely can remove all that logic
so
by one cones are always
bad um
i just wanted one right
take the wrong
wait what
oh my god what am i writing
see
oh my god wait is it really this
uh
i don't know about this
one by one
were a thousand operations that i
started right yeah
do options not work on mac
and we can do this like outside it's
just kind of nicer to write it like that
expected a bites-like object
into found
where
options to bite string
where's the end
why is it putting these spaces
oh
don't do that
sorry look at
that i think you can tell this is an
individual option
okay fine
seems like a more reasonable dog
oh
it's wrong but look at that speed
oh yeah
that's good speed
yeah good speed
i think it's not right though
no that's not what a one by one conv is
what am i doing
except this is these are one
and it's backwards
that's so wrong
that's still wrong
dude he said padding sometimes
real dumb people
yeah
43 milliseconds
oh my god padding actually works
these are zero
all right there's a one in here
oh 41 milliseconds
oh it's getting fast
it's got it's smart enough it must be
smart enough to like
deconvolve all that
okay i have another one i can do depth
wise i believe
i make that fast because i don't need
the channels loop
i don't think the channel's loop is
nearly as bad
what's faster quantum computers bro
quantum movers are only fast if you want
to simulate a quantum system
milliseconds
that's pretty good like how much faster
you want to go
so one by one com is actually a manual
fun fact
uh should we let non-subscribers talk
i'm interested to hear non-subscribers
opinion
on if uh
42 milliseconds is actually fast
whoa bro
it's so fast
oh slow af ah good point good point
fast there wow that's pretty good i mean
look we started out it was taking like a
second
fast they have boys
um so this is the end cue time so most
of the time is still being spent on the
gpu
uh
do you wanna uh you wanna put a print
for when we launch a kernel
joseph weiner thank you for subscribing
now's the time to get thank yous if you
want to subscribe
uh the initialization looks slow though
you think that's slow it takes like two
seconds
it's loading it's also running it it's
actually also running it in torch on the
cpu
uh restrict your kernel arcs
oh
good point
yeah um inserting the restrict keyword
in pointer arguments
uh
don't alias other pointers
yeah i don't think my thing's ever alias
let's try it
well the other ones are all consts
the only things i probably need that is
here
uh restrict requires a pointer or
reference oh no i have to stick it in
there okay
what
oh
how long does a forward pass take on
comma three
is that faster i don't know
um
your restricts didn't make it faster
grab one's your toe
bitcoin to the ship
actually i wonder
we can try recompiling the convolution
with all the integer arguments shoved
inside of it
and like we shouldn't even need things
like the one by one column because that
should all just be computed statically
i think some things can just be computed
statically where does that come from
it comes from there
no probably can't be
no probably can't be
all right we already excluded the valids
we don't need them that one was probably
a big speed up
restricts
made
nothing
faster
why did i even do it if that didn't make
anything faster why did i do it
it is a good point though
um we should also check to make sure we
don't actually have any pointer aliasing
which i don't think we do
but you never know
i probably ate in the kernel also
oh yeah yeah yeah i know i know everyone
everyone went down
uh how long does the forward pass take
on the comma three it actually takes
less time so i mean that is an argument
that this thing is pathetically slow
because i'm using an m1 and it manages
to be slower
it takes like 20
uh it's like 25 milliseconds
but this convolution is not designed for
speed
i have a convolution that's designed for
speed
but
uh yeah i know git commit i am sometime
i use it i don't like accidentally
having git commit am in my uh
can you run it on batman or quiet well
quiet's broken
can i run it on batman yeah we can run
it on batman yeah okay well i don't know
batman
oh it doesn't work
batman has a junk cpu
why why is it so slop
this is so slow
okay never mind you put
but there we go
28 milliseconds
and the whole time i spent in python
interesting
uh so when your cpu is a piece of junk
like the one in batman
it spends the whole time in python
wow
uh
so yeah um this computer has a 30 90.
oh no most of that time is actually just
initializing the uh yeah that's fine
wow okay it was wasting a lot of time
all right all right all right let's
let's let's do some work over on batman
and see if we can make the python faster
yeah because look
the whole time is being spent on
enqueues and stuff
uh
i mean yeah to be fair this is running
on 30 90 so we would expect there to be
a lot of speed
uh and for reference on the 30 90 in
torch
actually this is already faster than
torch
torch takes about
35 milliseconds
um
the
onyx runtime with cuda cache takes three
so three is the thing to compete with if
you're using a cache
but if you're not using a cache a tiny
grad
this is what it takes on a 30 wow the 30
90 is a lot better than
than the uh the other one okay let's
turn that profiler back on
i should have put an environment
variable for that oh no i didn't
uh okay
can i have the profiler print out
milliseconds
is an argument for this
does everything have to be seconds
oh here we go
your integer time function
if it returns integers
custom timer function should be used
with care
i want to use it carelessly what does
that say about me
you have to create a c profile class
your integer time function
here
short is an invalid keyword argument for
profile
okay okay
i'm not upset no not at all
oh great
okay now i'm getting upset
i regret this
i just i just wanted to can you guys all
right never mind non-subscribers just
asked about a vpn bro what do you want
an ad you should use expressvpn when i
hide my when i go on the internet and i
want to hide my activity i use
expressvpn and i'm not just a chill here
talking to my youtube audience and this
voice because you know everything i say
in his voice is really legitimate and
honest and i would never say anything by
the way when i make a website i use
squarespace
and i'm going to listen to some audio
books with audible
is everybody happy all right good
you are the reason
a time unit
good good good good time unit
what i want to do with you
this class is normally
only used
if a more precise
okay fine we're gonna do it pr equals c
profile dot profile
time unit
why is it zero
pr
oh
self.realize
pr dot enable pr dot disable
do i really have to do that
sort key time
p stats is not defined
i regret this just so i could get
milliseconds and not and it's probably
not even going to work nope didn't work
print s dot get value oh maybe why does
it have a stream
it's just showing off that i could
hypothetically do that
why sort by a variable
okay time unit didn't work
where's everything an ad
timer equals one okay
press your function that returns a
single number representing the current
time
using a custom timer
or a list of numbers whose sum is the
current time
function returns a single number
be aware that you should calibrate the
profiler class
time dot perf counter okay all right
we're learning let's try this one
okay we're back to the scrap
uh
expect int got float
ah
oh
use perf counter and ns
great
oh now we're talking
uh one e minus six and that should give
you milliseconds
this was a lot of work
just to get a slightly nicer looking
profiler output
great
okay now you understand why the python
time is going
okay a lot of it is still going a log
so it's going to a list comprehension so
it's going to string inside enum oh we
probably shouldn't be logging for this
there's no point in profiling with the
logger on
if oh ass don't get in
we have a good profiler now i worked
hard on this
name os is not defined
okay
a lot of times spent in processing up
most 10 milliseconds is spent in ndq and
deranged kernel so there's nothing we
can really do about that
i mean that's just the cuda call
dispatches so it's dispatching
let's see if that seems reasonable it's
taking 10 milliseconds to dispatch it's
taking 0.3 milliseconds
yeah that's
hard to do better then cuda's just slow
don't you love that it says seconds
no no no no it's not that
i fixed that
there's just not too much to gain
we can just decrease the number of end
cues but like we already did that
we're spending a millisecond in is
instance this is why you should never
use this instance
that's cashed
that can't be cashed
well how did i ever code in vim it looks
so much nicer in vs code
a lot of times when you spend an ops gpu
processing up
this isn't really slow
just like making one
straight
i think string can cat is that slow
no that's not the problem
local variable time
python's weird
okay
um
mirror baby yes thank you for gifting
subs no the summation's not wrong the
only reason it's that fast is because
it's actually running it's already
running realizing the profiler so like
that's just time outside the profiler
don't worry about that when the
profiler's on you see the time's right
inside the profiler
um
okay we're still spending time in shape
tracker
uh we can catch that that'll make it a
little faster okay we're at 26
milliseconds now and the difference from
before is those are all cpu milliseconds
they're not gpu milliseconds so we're
limited entirely by our cpu speed right
now
is this gonna run in pi pi
and i feel like nothing works in pi
pi five could make this faster so we
have a somewhat theoretical lower bound
of 10 milliseconds here and we're at uh
we're at 26.
so the shape tracker stuff can all be
taken out
um
i didn't realize
this
oh i need to cache this
now that returns a shape tracker too
first
so
let's try to get it below 20 and we'll
call it a stream
so
actually if that's really what i'm going
to write
i think this will work with lre cash
all right max eyes on him
and this
let's turn the profiler off and see what
we get
23 that's better
okay good progress good progress let's
get a full of 20.
all right
uh
we're not wasting much time now in shape
tracker
we're still wasting time and get lazy
buffers
ah this can
also be cached now that's for an op
this is getting kind of stupid
let's see what it is without the
profiler now
same time 23 milliseconds
did i just shove that time somewhere
else
okay most of the time is being spent in
processing up
and a lot of times being spent in
realized processing up but there's not
too much per call
per call a lot of the time is being
spent in
realized binary up and real life
and q colonel khan is slow
where are all these calls to his
instance
in there
the castles now though
gosh that
22 milliseconds all right cool cool
where's time's still being spent
this is the real enterprise value
oh i did talk about wanting enterprise
value well you'll see that this isn't
even look this is all this time is being
wasted in uh
in in python
so i'm just doing a fine column stuff
do we have to do the find calm
can we push that into the compiler
maybe
not really
all right we'll do that same trick we
did here
we can't cash the off but we can cash
the buffer
this is not worth it
it should just be refactored
21 22.
duck typing avoids his
instance i don't know about that
yeah i mean
maybe
i don't think we can really get away
with that though
method split and replace and join of
straight objects
okay
anywhere to
let's take gain look over this something
stupid in the init function
and that might just be slow once
no okay so once it's already happened uh
should not be initializing any of that
stuff
you see how buffer is just not that fast
man
i mean we could okay there's a bunch of
things we can still do actually
that that we're recreating the gpu
buffers every time we don't have to do
that we can keep them around
uh
but yeah that's okay there's a lot of
stuff we can do to make this faster
um it's just stupid that
i'm spending
time in math prod
like that's showing up in my profile
that's offensive
what's the times being spent in
processing up
i mean i can pre-do that
now when we've gotten to the point where
we're uh
where we're doing we're racing as much
as we are
we should uh i've called this a while
ago
c is not falling over that's in c as
well
19 milliseconds there you go b20
boom
done
okay well that one time was faster
you all saw the 19 right
18 bros we just hit 18.
well i don't think there's anything more
to really gain
gpu it's still spending most of the time
processing up
spending time in the net okay i mean
those dispatchers aren't free that's a
lot of stuff
i mean theoretically okay
one thing we could do is we could take
all these ins
and we can put them in the kernel so
that it recompiles a new kernel for each
convolution
it's very vigorous now depending on what
else is running on my computer probably
or the scheduler or who knows
18.
it's all in python right now so i don't
know what the theoretical limit is on my
uh on my 30 90.
that's pretty good
yeah there's lots of smart things to do
to clean that coat up
uh to make it work well on
let's see if we actually gain anything
on the mac
those things i doubt we did
oh
we gained a little
look we're down to four milliseconds in
python now
a model execution on combat three is
yeah about 26 milliseconds so wow we got
it uh it's faster on a 30 90 with tiny
grad
i mean that that's pretty good
we got the python down to four or four
milliseconds we're using caching
um we should figure out like the actual
places we want to put caching and make
it more explicit
ah
i mean dispatches are just faster on on
mac as well
well actually this is because i haven't
had one but you see that my call to nq
range kernel here is like one
millisecond right compared to my calls
to m2 range kernel over here
it's just because like the cuda
dispatchers are really slow
you know what legitimately fix this tiny
cuda
oh you can see that my mac is about
just just for like something stupid like
the constructor
um you can see how much faster my m1 is
this thing has like a couple old
couple of zeons
notice the difference by the way
um so you can see here
that
all the time is being spent in the
python
whereas here the python is very fast
but all our time is just being spent
waiting for the gpu to uh to finish the
kernels
that's the power of 30 90.
who knows maybe the compiler is just way
better
uh we can switch to the other
convolution kernels with images
i mean that's what we're gonna need to
do for the uh
wait i don't think it's gonna work
okay we'll spend we'll spend
no you know i'm not going to stop
you know i'm not going to stop
i'll message you into a comma 3 right
now
ah
it's not just gonna work we'll have to
save that for next time
actually running on the commentary
let's see
oh also everyone say graphic is one
doesn't matter
uh
do anyone actually try to import that
oh
this is running on a comma three let's
see how fast it is
oh look at that
it ran in 1.5 seconds
let's see if it's correct
is that gonna work some chance it works
dude we're downloading we're installing
torch right now on a uh
no space left on device
oh
yeah default okay hang on
so
i'm gonna say default no no no don't
default to user installation don't do
that
because normal site packages is not
right at all
my site package is not right
where is normal site packages and why is
it not writable
should be
pseudo
everything's better with sudo
oh yeah but this is model execution
using tiny
what what is there no space left on
it's like it's shown installed in the
home directory and the home directory is
actually just
okay well we can't use torch so we don't
need to see if the output's actually
correct
no space left on the device why is there
no space
where is my space
home has no space why is it installing
it to home
where does python install things
okay where is it writing that to
i told you
saying opening the file
where is it running out of space
okay
no space left on device um
oh it's tempt that's running out of
space
if you have user installs a local home
bin okay
where's that cache going
going in temp
big temp
torch is big i mean big
so i want a comma three right now
if you don't believe me well not proxy
for you info
see look it's an sda45
uh okay we installed torch
well we're not using onyx one time
because that didn't even work on mac
okay i can install that
oh no we have to install torch vision
that might be big
okay
there we go guys
it worked on a comma three it ran in
only
1.5
seconds
81 of those milliseconds were spent in
python
but we're getting close
and eventually we're going to compile it
and run it in need
and we are going to get runtimes on the
device
here i can show you what the runtimes
are on the device here
this principle runtime
should have taken that out
there you go
so we don't need any debug
um this is this is running the
this is using the snpe stack to compile
the model
this is all open source
it's running in
20.22 milliseconds
so we actually haven't been able to beat
it yet on anything
which is pretty funny
uh
nothing is as fast as the
device
but remember we've spent a lot of time
see i wrote this optimizer
we spent a lot of time making it very
fast on the device oh the other thing
that i'm not doing here that's a one
line change
is i'm using float 32
and this is running the model in float
16.
uh so we can switch the model up to
float 16 see how much gains we get who
thinks there's gains
this is using images
and not buffers
um
this
here is using much more intelligent uh
local work groups
so in our next stream
uh if i don't already do it this week we
will work to get this
1.5 seconds
down below this 22 milliseconds and i'll
show you why
i think it's possible
so let me turn graph back on
this processing ups the movement ops are
all free
tiny grad even without the last
optimization because the last
optimization involves improving shape
tracker to track what's actually no ops
we have 216 kernel dispatches
currently need
uh smpe that whole stack even with my
optimizer so my optimizer is removing a
lot of kernels
it goes down from 410 to 227
but this is 216 and there's like another
16 to lose this is going to be below
200.
this is going to work out being like a
20 i think a 20
uh speed up on the comma 3 in addition
to a completely open source clean stack
using tiny grad no more issues with
smpe is unbelievable if your channels
are not multiple of four gives you
errors i just wrote stuff to pad all
this
um it'll you know silently install the
kernels and you can look at those
beautiful graphs and you can figure out
um
so let's take a look at what our final
graph looks like
notice how we're down to pretty much
only convolutions
we just go through um so this is the
efficient net b2 for the first
side
this is the efficient net b0 you can see
that we calmed them all the way down
these are just straight up combs see
these connections here these are res
connections
uh
we go down to this is the vision
features for vision
this is the
things for the temporal if you want to
use the pose now we use those
then we do a bunch of this is like the
groove this is the head or even is the
groove the groove is like free now i
don't even know where it went
i think the group got turned into just
like one operation
that can't be one operation i don't know
it's like this whole thing
that operation is part of the group and
those are part of the group
but when that got compiled it got
compiled down to like nothing
these things oh wow wait we still have
so much to merge here
all these grays and reds can be merged
um
once we figure out how to fix them
how to fix the shape tracker
yo
there's a lot of gains to still be had
and that's in the total number of
kernels
these kernels will eventually be just as
fast as the
boom
these kernels will eventually be
the same ones that are running right now
and they pretty much i have a bunch of
mods to go which would make it even
faster
and the stuff's all generic
ah
which is the key
because it's not like you don't have to
there's nothing like specialty about
this this will run just any tiny grad
this will run any onyx
um and compile live on the device in
a couple seconds which is faster than
what it's compiling with it now um so if
need is a caching layer that sits below
this to get rid of basically a python
lag
and we use the need
on the device
but notice how it's all red
and all red
is really beautiful
because that's just convolutions and
there's nothing you can do you have to
convolve into a buffer
um there's not going to be really a way
to like
you have to store the output of your
convolution it's going to be really hard
to like
combine two convolutions into one
but all these other apps all the binary
ops
all that stuff
you can
all right
in the stream questions
next stream we make it fast on the comet
three if we haven't done it already
expect to see tiny grad in open pilot
just look at this conf look at those
cops
cough cough cough cough cough calm
this is a pretty productive stream
regard fragment on rolling the calm yeah
[Music]
you could
um
the fuck new jersey fuck long island man
hey look we're all bridging tunnel trash
yo
ah
you're impressed how long i can sit in a
chair
how do you make the graph read the code
so these are the buffers these are the
uh like in my convolution here you see
this is the weights for the convolution
that's the bias
it's really only two buffers going in a
lot of just
uh other stuff
and we did this optimizer without doing
any like global graph stuff global graph
stuff is kind of annoying we can do it
but
then you have to figure out oh what's a
part of the graph what's not a part of
the graph it's all just local and it
carefully recomputes
the things that need to be
recomputed
i've been playing that many online games
pragma unroll before outermost cn loop
well you can't even unroll that but
that's just luck bro like you can't even
hear all that loop because cn isn't no
you don't know how many uh how many
times
uh
it runs for though we could fix that
this might
it might be a lot faster if we put these
numbers into the column and built a new
column for each
so
it's something to consider i'm not going
to do it
because the other columns really don't
work that way might be faster than those
two
i couldn't get onyx runtime to work on
my mac
that's why i use torch to onyx
by the way we should be able to use this
to do things that's not the open pilot
model
does it work
let's see i'm gonna run the official net
uh
oh this has a reduce in it no we didn't
write reduces yet
but we'll write reduces we'll get all
the tests to pass
i i need some time away to just like
realize the
probably incredibly stupid things i
wrote in some places
um you didn't see my football coach you
didn't see cheap man
cheapy is the greatest in scam
cryptocurrencies
uh if you missed the cheap ethero you
you missed out on a scam bro you could
have got in early and got nothing
now george came out george hawks was a
scammer george had to make tp because he
was trying to get rich but but it didn't
work and he really lost the trust of his
community oh my god
you know you can't believe like you just
can't believe people anymore
like bro
it's just offensive you know
like if i wanted a scam i'd be good at
it
like we'd actually scam well but that's
the joke like
oh you're community oh curtis has this
thing where he describes community he
uses the word lange boys i've never
heard this expression before but even
like
um
yeah yeah uh he uses this french thing
uh lang
lang day boys like
like i i've never uh i've never heard
that expression before but when curtis
said every time they used the word
community it's laying d voice i was like
wow and i didn't even know what it was
it was just so it was so exciting
uh because i was like wow that's like
every time wow community is it's just
meant to like like gaslight people you
know what i mean like we need to think
about how that will impact the community
that's a shame too because these words
used to mean something man
oh she eats up 10 today oh that's pretty
sweet
scamming during a recession y'all
is anyone else mad psyched about the
recession
i like i'm sorry if you lost money don't
worry i lost a lot but like is everyone
else super excited
the lidar people are trying to lobby to
make it illegal to have a car without
lidar dude i love recession i love
recession get fucked get flunked
um
the words have been twisted by the
professional managerial class that's
true bro
um shit's about to be fun i agree we
need to see people starving in the
streets
and i'm not talking about poor people
that's just tragic but wouldn't you love
it if like some goldman sachs guy was
like i used to work at goldman sachs but
i tanked the global economy and now i
live in a tent like that should be funny
man
that shit would be funny too bad it
doesn't happen but it would be hilarious
uh
it seemed to come from the map branch
oh i got rid of oh
that one can be unrolled yeah but i got
that mostly
um
people's value systems get kicked into
place yeah because the government can't
just oh we're gonna bail people out oh
whose money you're gonna bail people out
we're gonna print more but that makes
inflation
hmm
it's almost like
you guys are getting margin called
it's almost like the fed's getting
margin called oh that'd be oh man fed
gets margin called oh that'd be good
oh that'd be good sorry sorry your
debt's no longer serviceable get fucked
you guys.com uh
us is bankrupt
it's unbelievable
if you haven't seen this thread
it's maybe the most important thread i
ever made big pictures talking about the
major global collapse that is coming the
united states did not have a surplus or
balanced budget since 2001. look at all
this
look at all this money we just lost
the the the us government as a business
loses like a trillion dollars every year
like a trillion you guys know that's a
thousand billion that's a million
million
every year we could make a million
people millionaires
instead of
the the deficit of the us
that's not even the spending of u.s
government this is just how much money
they lose
okay
and then oh how are we going to solve
this oh we're going to print money oh
during the recession it's like oh
printing money oh yeah printing money
always print money like crazy haven't
you heard about coronavirus
so then he goes like this
total u.s does 90 trillion u.s unfunded
liabilities are this
this is all the companies in the stock
market this is all the u.s assets
the united states even if it could sell
all its assets is 66 trillion dollars in
debt
um i don't know and then i don't get
into this like i don't get into that i
don't think there's like great reset and
like klaus schwab or you know whoever
george soros or
whatever
kosh brothers brett kavanaugh and sonia
sotomayor or in some trilateral
commission look now that shit's true man
but you know it is true we're fucking
broke and the us is about to go bankrupt
and get large and cold
let's go
let's go will the american spirit
persevere
yes bro oh say can you see by the dawn's
early light
uh i don't know there's some other words
and then the land of the free and the
home of the brave
and that's america
and we love america
ah
hey mcdonald's isn't uh he's been
running a true trillion dollar deficit
every year walmart's not running a
trillion dollar deficit every year um
i pledge allegiance to the flag the
united states of america to the republic
for which it stands one nation under god
indivisible with liberty and justice for
all
yeah except for goldman sachs fuckers
who need to be sleeping in tents for
tanking the world economy
how do you bail out the government you
don't you shut it down
and that's why i'm running for president
in 2024 as a member of the shut it down
party
let me explain what we are going to do
we are going to show up
and we're going to shut it down
if by the end of four years i'm still
president i have failed
as the chief executive officer of the
shut it down party we are going to show
up
congress we're going to put boards up on
the door shut down sorry closed it's
going to be like it's going to be like
like blockbuster
the russians they're russians that
you're doing russia with an economy the
size of italy
um
dude
uh
you know with the government gone we can
start fracking again
uh you want a nuclear power plant in
your backyard dude you can build one the
government's not gonna tell you no it
doesn't exist anymore because we shut it
down
um please put democracy on the
blockchain who else is over democracy
democracy is two wolves and a lamb
voting on what's for lunch
um
i can't believe these like governance
solutions you guys are so naive you know
i i was thinking like when i said in my
blog post about uh
about uh like mark andreessen and uh
university of austin and i was like
these people are supporters of power or
naive political children they're
actually just naive political children
um
vermin supreme does i did know that he
promised you a pony and a boot on his
head
uh i can't compete
i i i'm sorry because i can't if i gave
you a pony that would just violate the
shutdown party's ethos which is like
who's gonna give you a pony how about
this after it's shut down we'll give you
a pony but there's no organization left
to give you a pony so i'm sorry it'll
have to be a pony nft on solana that's
right you got a pony nft on salana
uh if you're looking for something else
yeah
um
do i have actual solutions besides burn
it down well yeah it doesn't do anything
just shut down solutions to what explain
to me the problem healthcare created by
the government college created by the
government right
um the military
we'll give that to nato
uh
no give the military to nato we're
shutting down we don't need the
healthcare we don't need the social
security
uh we don't need the uh
any of that stuff
do you have any salon nah no pointer bro
why do i take it off sub only we need no
infrastructure at all what do you mean
who will build the roads walmart bro how
are people going to get the walmarts
um is there still going to be taxes like
who pays for the nato well
that's an interesting question right
like
the irs is part of the federal
government so they're going to be shut
down
they're still going to be state taxes
we're not shutting the state governments
down by the way the state governments
are still going to exist
um i mean they can shut themselves down
i'm only running for federal office and
we're shutting the federal government
down
um
why does it sound like china it sounds
like freedom bro
um
well no i mean in china you have
state-owned corporations in america you
have corporate owned state
uh desantis going to fund nato
uh what about your 401k
i don't know how those work is it backed
by the government if it's backed by the
government i'm sorry we're nationalizing
the retirement accounts to fair debts
uh don't worry it's going to happen soon
anyway
um
we are shutting down the federal
government yes the federal government is
luck
look
you have a corporation that loses a
trillion dollars every year
a trillion dollars every year for the
last for the last 14 years right
don't you think you should shut it down
yeah the american union can form some
other thing around it you know very
simple no federal taxes
it should file for bankruptcy yeah well
who does it file with
just shut it down
just shut it down it's all we can do
it's all we can do guys
that's all we can do
kim.com is right
but kim.com will outline you know they
came for him man they came for him and
kim.com can't wait to see these people
lose
everyone's in debt ceremonies man all
right uh aren't the state governments
going to continue to infringe on your
freedoms
i mean like my complaint about
government is not really that it's like
infringing on my freedoms i i feel
pretty free
i mean there's a few things that are
ridiculous but
the main problem i have is how much
money it loses
how is it even possible to lose so much
without any consequences because they
control the money
um
just move states yeah you can move
states if you're upset with your state
like okay man like texas is gonna like
take away the weed and the abortions and
california is gonna take away the uh
uh the guns and the high-pressure
showerheads like you have to choose what
you want like do you want weed and
abortions or gums in a high pressure
shower heads like you can choose
um or you can jailbreak your shower
why do i care because people are
spending all my money and trillions of
dogs every year
no i don't care that much it's kind of
funny
uh
do you realize this all the shell all
right all right all right
um what my breaking point be i'll move
out of the u.s when they're somewhere
better
um
yeah no
europe's a museum
china is a is a well you know what china
is
uh
russia
like i don't want to live in russia i
don't want to live in russia i don't
want to succeed in china and europe's a
museum
but china's nice if you're an average
person in china china is actually really
nice
but you know an average person in china
means that you are uh han chinese uh
yeah so you know that we have that as
the first problem um
we can't talk about china i can't talk
all about china i've spent a year in my
life in china i i love china
i'm legitimately a huge fan of china
um well portugal oh don't get me started
on portugal
um canada dude after what canada and
australia did during covet
they're authoritarian man
like you gotta kick those people out
like at least china's authoritarian but
you get something for it
um
i would not agree that portugal was
great
no dude i couldn't i can't believe when
i watch a justin trudeau video i cannot
believe
like you know at least america has like
idiots that seem powerless that guy
seems scary
um
no i mean i don't take back canada
and canadian fuck the government yeah i
mean these you could say that like
there's worse places like it's not i'm
not like really duncan in canada it's no
portugal which totally sucks but uh
brazil don't you guys have like 25
murders per thingy
um
no i just
you're moving to dubai
yeah again
you want to tell me a lot in those
people
um
i mean like singapore is if you want to
live in a shopping mall you live in
singapore
ah
every lively videos from brazil yeah
there you go
you want to get run up on a crime
what about israel
another country i'm not going to
um
it's a battle royale i don't want my
country to be a red battle royale at
tijuana
uh the uk
i don't know i don't know what boots on
the ground are like in the uk
um you know you get you get different
things from different sources
uh i think i think i would enjoy living
in the uk
like it's just pretty close to america
um if there's anywhere i'd go in europe
it would be like the uk or
maybe the netherlands
i don't mind the cold winters uh i went
up to uh
newcastle in the uk i really liked it
what about mars dude it was my five star
hotels london has five hotels
sweden i've been to sweden in a long
time
go to the moon yeah similar problems to
mars mean again like
sweden's a nice country if you want to
live not really if you want to succeed
uh i mean africa is interesting
in some places i don't know i don't know
ethiopia i've never been to africa i've
never set foot on the continent actually
um so i don't know about uh
it's actually nice you know i gotta go i
gotta go one of these days and check it
out before they ruin it
um
you have to put in your mask as soon as
the train you took in the netherlands
across the belgium border i can't
believe someone's still doing masks
uh
it's almost theologically advanced
country
i mean i'd say america
so it has to be america
we we export the world's culture
um
you ever read the corrections or the
corrections like a month ago just the
way they described eastern europe but
like it was so good it's so good such a
good book um
you know everyone should be an infinite
jest in their 20s and the corrections in
their 30s
i wouldn't say it's on the same levels
in the chest but
um it's very enjoyable
uh
yeah stockholm's nice but yeah it's not
a place to succeed
yeah the us is of course the most
influential country when it comes to
culture
um
you know it's interesting point about
china how non-influential they are how
we consume almost no chinese media
you just have like race to the bottom
crap like tick-tock
when you think there's look there's
content from korea content from uh japan
much smaller countries
let's move to the metaverse and call
today yo i bought meta stock
i don't know i don't have tick tock
china's cultural export is going to be
huge soon i'll believe it when i see it
i'll believe it when i say it
i didn't think the three body problem
was good
i i it's just i don't know i didn't
finish the book i read like the first
hundred pages and to be fair maybe it
gets better
but it just read like chinese propaganda
um
china has so many it's shocking and i
don't know to be fair i don't know what
culture internal to china that the
people in china are consuming
um
[Music]
i'm sure fast fashion can be chinese i'm
just saying the things that are really
pushing culture forward
it is shocking that like i consume so
much more
korean content and japanese content
uh than chinese
but for the usa only as a rich person
and it'd be texas well you know what
they say there's only three things to do
in dallas eat drink and make money
uh i don't think about the war in
ukraine if the me if the news wants you
to think about it you shouldn't think
about it
all right
it's three o'clock
uh i gotta go i got a truck at the ram
gonna go help alex move
um are there any real nootropics no
uh
what the hell are you talking about who
have a good one you too
uh
thank you all for watching
uh
don't kill anybody you know that's the
stream theme if you're thinking about
killing people it's not the way man it's
not the way the way forward is peace
love understanding and shutting it down
peacefully
peacefully shutting it down
peacefully shutting it down okay
thank you all for watching
have a good weekend everybody
goodbye
cheese good morning everybody
good morning
it's morning morning gotta get down it's
morning
uh
all right we're gonna go get some
coffee uh
we're gonna pop out the chat we pop out
at your party i'm with the game
and it's gonna be a robbery so tuck your
chain
all right chat's good
we're gonna get some coffee
and then we're gonna ask the question
can tiny grad run the open pilot bottle
you know whenever the media asks a
question the answer is always yes or no
or something fuck the media
this is a good quote right whenever the
media asks something the answer is
always yes or no or something fuck the
media
uh oh
what was i gonna say oh yeah
uh
i like i like someone took a quote from
from one of my last streams i love
my quotes um
you know
uh what it was the yogi bear quote about
baseball
uh what's up jonas
uh what's what's what's the yogi bear
baseball quote
uh baseball is 90 mental the other half
is physical yeah i love quotes like that
uh
now let's see if we let's see if we can
find it
sometime i search myself on twitter
no no no no not any of this stuff
it's like having a fetish for impossible
oh yes it's all about working hard and
being a genius and if you can be both a
genius and work hard the world is your
oyster but if you're not willing to do
either of those two things i don't know
what to tell you oh man see i love
quotes like that because all quotes are
dumb and meaningless
walking classes thank you for
subscribing it's a beautiful
saturday
there's boats in the harbor they're off
they're boating guys
i'm moving out of this apartment on
tuesday
i'm devastated
com ai is moving to a beautiful new
office but the beautiful new office is
in a different neighborhood so i'm
moving to an apartment
in that neighborhood
and it's a bit of a downgrade from this
one the rent is cheaper
but you know it's it's a bit of a
what oh no no we're just gonna we're not
gonna train it we're just gonna uh try
to run it
okay so uh let's kind of talk about
where we are in tiny grad because the
tiny grad
uh you know it's not the same tiny grad
from your childhood
i've been working hard on it actually
um
so
a few things you'll note uh
my latest refactor
i'm not logged in but i can do a slot
count
my latest refactor got us down to like
937 lines
uh and no more ocean view and then i
added a few more lines back but um that
is a really powerful refactor if you can
reduce it's 70 lines of code less
and it has all the same abilities that
it used to have
um and the key was kind of this
so we used to write these uh these
operations
and you had to write both the forward
and the backward of the operation
but now we've added a second layer of
abstraction i talk about it here in the
readme this is all public at uh
this github here
so
i've moved uh
all those operations to mlops and they
understand memory allocation and
derivatives
if you don't need memory allocation
derivatives you can use these
uh
let's say oh yes
you can use these here
which are like the basic options i've
realized that the main thing to think
about about neural networks is asking
the question how does data move because
if you want to run these things quickly
efficiently in low power the trick is
all like understanding the memory access
patterns and making sure you do a good
job with memory access patterns i mean
this is classic like you know the
difference between a matrix multiply and
a cache cache aware matrix multiply if
this was a tutorial channel i would all
show you but you know hopefully you all
went to college
um or if you didn't go to college you
learned it anyway and if you didn't
learn it anyway well you know today it's
never too late to start unless you're
like in your 40s then it might be too
late
i'm sorry we discourage people on this
stream because we believe in facts over
feelings
did i just steal that from if i stole
that from ben shapiro i'm sorry that's
not an endorsement of ben shapiro
it's definitely not an endorsement of
ben shapiro
um
he always wonder what you do and let him
wonder who now
ah
okay
so we refactored ml ops into a single ml
ops
and then we use these low level ops
which don't need to know any things
about derivatives unreal produce off
binary out movement up processing up
this is already kind of what the gpu one
looked like internally
ml ops already a reserve buzzword well
i'm sorry but we used it
call me out for cultural appropriation
uh so you see we support three
accelerators we support cpu which is
numpy we support gpu which is opencl and
we support torch
um there are some there's some support
in here like this is uh old style cuda
uh this is old style metal
uh we didn't actually have anything on
the tpu
i took some of the inspiration for llops
from what i was doing with cherry and
then here's a e as well
uh so we have an ops a and e
uh which kind of works but now it's a
lot more likely that we can actually get
things like the a and e to work because
we've reduced if you want to add a new
accelerator now you can probably do it i
mean this is a clean opencl
implementation of all the specific stuff
in 293 lines
um so we can go through kind of what
these ops are
okay everybody should know what these
ops are right these are unary ops
they're point wise unary ops
uh reduce ops sum and max binary ops
taking two tensors and then go point
wise on them right so uh
it's not always point wise because
broadcasting supported
uh but yeah so we support these binary
ops a just means return the first one um
it's the only one there that might be
confusing these are movement ops reshape
permute and slice
uh reshape change the shape for tensor
you don't really have to make a copy for
that one depending on your backend data
store
permute will flip the order of axes and
slice will uh you know either pad or
unpad
appropriately you can unslice my slice
supports slicing this way too not just
slicing this way oh and it just gets
yours
then we have processing ops unfortunate
oh so
here is a great this this was a great
victory yesterday
you don't need a map mall operation
because map malls are just convolutions
on one by one images
uh i i was really excited to to figure
this out
um yeah you can just uh
well let's see is it always exactly on a
one by one image no it's not exactly on
a one by one image but um
if you think about your okay you have
matrix dimension you have m k and n
uh k is your channels in
n is your channels out and m is your
your image size
um so you'll end up with an m by n
matrix and you do a one by one
convolution on that you can actually
read my code for that right here in
tensor so now map model is not even an
mlop
which means the dir it's a it's a top
level op which means the derivative is
all computed for you now unfortunately
we're using nhcw because pi torch does
if it was nhwc we wouldn't need these
stupid transposes you guys know channel
order
hopefully you guys know this kind of
stuff uh
if you don't know this kind of stuff you
know you should be spending more time
doing ml
um
yeah so this is a matrix multiplication
implemented as a convolution
now
you can see in the processing ops
there's actually three of them
uh and i'm trying really hard to unify
them but i haven't made much progress
well i made some progress but um so you
have to be able to compute the
derivatives right the convolution has
two derivatives you have to do uh
the
uh input with respect to the output and
the weights with respect to the output
so the input with respect to the output
is called com of t
uh i used to call com vx but it actually
turns out that this is a transposed
convolution and there's a documentation
of uh of what that means yeah transposes
are kind of expensive don't worry about
that we're gonna add a we're gonna add a
layer of indirection that's gonna we're
gonna make tiny grad lazy basically and
then we're gonna be able to combine a
lot of these things um
and put a jit at a really low level
but uh don't worry about that for now
uh
it's important to get the operations
right and then make them fast so this is
called dw this is the derivative uh with
respect uh derivative of the weights
um
so yeah you have the
uh
the
derivative of the output with respect to
your input is the weights
not the derivative of the whites so you
see that's computed in here
ah common dw
and this is com t so this used to be
called dx
but it's the derivative of a convolution
with respect to the input is actually a
conf transpose
and this is the code to compute a con
transpose with a normal conf
you have to flip two of the axes and
transpose two of the axes but
unfortunately it doesn't work if your
convolution is strided
so we kept the old implementation around
here
uh you can like see you can see why
strategy needs weird padding i found
these like cute animations
so this is uh y straight it needs word
padding you have to like put zeros in
between the inputs
and that's not a normal uh convolution
operation but
i think we'll eventually be able to
refactor this one and this one into one
and then we're just left with this one
um
now this is the implementation in the pi
torch one uh torch n and grad conf duty
weight it turns out the pi charge one is
actually wrong
uh this isn't the path that's usually
used this is like a slow path but
there's a bug in the pi torch code there
was already an issue filed about it but
i wasted like two hours on this
yesterday
and then i wrote my own version of it
and my own version doesn't have bugs
uh hopefully
it probably does have bugs but we
haven't found them yet um the test and
tiny grout are pretty good they're all
in ci
uh
yeah so here we go
forget that green jack
um
that's actually
did i respond to this pull request
so yeah the if you want to this guy's
been writing a cuda port for tiny grad i
changed the operations so like you
should i mean it's the same stuff you
should really just be able to reuse it
and do the refactor to make it look like
uh
look like ops gpu and hopefully
this interface will be stable for a
while but you know with me you never
know
uh it might not be with me you never
know why that says why did i say that
that's what am i saying
uh with anyone you never know because
that's if you can't make changes you've
become ossified in your procedure and
your empire is about to decline that
sounds good
um
cool okay
so let's run the open pilot model we'll
put this in the test we'll call it test
open pilot model
great
um
ending every one of my talented
associates guess what they deserve
nothing shorter that's appropriate
okay uh we have a little helper called
fetch we can use it
um we're gonna fetch the autopilot model
that's just a caching fetch from the web
uh the open pilot model is in self-drive
model d
models
it's called supercombo dot onyx
um
probably shouldn't download the one off
master we should probably
i think i can just change the word
master
to
this
let's see if that works
um let's throw a user bit in python up
here
and let's say python3 test
test open pilot model okay cool
okay so that'll download the onyx
um now we're to have to parse it with
onyx
import
pip3 install onyx
oh no
no don't make me have to fix things
oh this is very upsetting
uh
why does this work
no
could not find python libs
do i not have them
what does it not like them because
they're dye lips and it's discriminating
against mac
that sounds right
let's call it discrimination
missing python libraries
pip install onyx macos
okay fine we'll try to build it from
source let's see if this works
oh you found an issue
bugger for it okay
this is a different error
oh we could brew install protobomb but i
don't think that's the problem
there is some work around in the end
yeah but i'm not even getting that error
i'm getting a different error
um
oh maybe i can bring brew install onyx
runtime and then it just has it
i worry about how much this is changing
no stop updating things
no updating is bad
we'll brew install onyx around time and
see if that works
on this one time is pretty good it comes
from microsoft it's actually uh super uh
fast uses cuda graphs
what are eps
okay and then we're going to go through
the layers and make sure that we can
actually implement the layers in tiny
grad
and then if it's good we will add
loading onyx support to tinycrat
that'd be pretty cool then tinygrad
could run onyx
firecall it's quite big if you build it
oh this is come on what's it doing
do you have to update the world
oh you do you know we got to update the
world guys i'm sorry but you know
the world's getting updated oh
they've misspelled onyx
um i think people at comma don't believe
the tiny grad's useful for anything but
i'm gonna try to get tiny grad i'm gonna
try to replace smpe with tiny rad so
you'll see we actually have some
convolution kernels in open pilot now
um in the need
so like yeah this is like the basic
convolution kernel
i made it compatible with the s p e one
typo required for api compatibility
and there's like a few optimizations
uh you know you guys know a one by one
com is just a matrix multiply
a one by one column has no concept of uh
height and width so it's just
yeah
all right
okay okay we're still updating the world
guys i'm sorry but all right what can we
do in the meantime
um
we fetched the model
let's say that
we can't import onyx yet
so we're going to go through all the
layers and figure out which ones we can
actually write in the beautiful tiny
grad interface
it would be nice to actually make that
first class because then we then we have
we have first class uh
onyx support
we're not gonna be able to support
everything but we can know the things
that we can support and then we can like
download onyx models off the internet
and and try them and my hope
if we get tiny grad okay if we implement
lazy stuff and we implement jitting and
we implement tiny cuda tiny grad is
going to be the fastest way to run
models
maybe even the fastest way to train
models you know my goal is still to uh
do they have ml perf with one gpu
[Music]
um oh here i can show you guys a cool
feature of tiny grad while we wait
now these are at the ml op level
but we will get them at the llop level
soon
tiny grad draws beautiful graphs
so this is actually a graph
of a model running with uh
sgd
you can see this is sgd down here here
actually i think this one's kind of
cooler
so this is three steps of the atom
optimizer
running on this simple model
so you see that matrix multiplies are
now convolutions
uh we have reshapes here
yeah and this is this is adam running
here
um
and then we run the next step
then we run some more atom and then we
run the third step so this is the
forward pass of the model
this is where the weight matrix comes
from
this is the new data here so this is the
69 the battery has 69
put that down in there down in there
do the backwards pass you can see the
arrows are blue for backwards red beans
it's a dependency from the forward pass
these long-term dependencies are why you
need so much ram
um because you have to store all the
intermediate outputs as you see these
the more edges you have in any slice of
the graph the more ram you're going to
need
um and then this is the last round of
atom
uh no it's not a safe space for
off-topic questions uh you know where's
the safe space for off-topic questions
um
not here
so this is this is the graphs at the uh
i mean we could write the layer of
indirection
i have a pull request on tiny grad right
now
i'd have to rebase that
oh that's not pull requests to branch i
have a branch called lazy
um
and in lazy i add ops
and like i
specify with the upside but this is all
pretty old stuff
okay we will we'll put let's put ops
back
um since it is kind of a good layer of
interaction uh yes save that
when we'll get back to the stated thing
in a minute
uh
so this is just a class called ops
um
and this will i'll use this to dispatch
the ops
so if we go here
called movement
up
that's right
keep the order consistent
uh
we have
processing
okay
so we can
change this up okay that's done
uh
brew install onyx runtime
and then we can make this oh that
already worked python 3 import onyx no
module named onyx
tip3 install onyx
no
issue
cannot find python libs
missing python libraries
d python library
oh can i do this with an environment
variable
do you guys want to see me finish the
ops thing or struggle with this more
how come i can't click there and i have
to do this
would i be willing to break the thousand
line constraint no bro
then it's big grad
you want to be big grad like everybody
else
all right well this doesn't work yet i
don't know we'll fix that later let's
finish this first
um we already started that now this just
added i know i just spent 20 lines on
this and
[Music]
you know
from
tinybrad.ops import
21 line sorry
uh
and then we'll go in here to ml ops
and wait actually i think i can delete a
line though that line can go
actually no it can't because i'm still
using it
over there so never mind
um that won't go through the layer of
interaction
permute object has no attribute up
wait did i get rid of the op
no off should be right there i don't get
it
didn't break that did i
oh wait what i got rid of it
i don't know what happened okay
um but either way
now we can go in here to mlops
we can do a replace
find ctx.op place with ctx dot
place all okay
so i just basically added these uh
functions uh to the to the class
uh movement op takes four positional
arguments but five
were given yes it's because i have
first off it's not a reduce off it's a
movement
and we have
r here as well
we also have some args for the
processing ops
so this is like a general purpose
dispatcher layer uh for my three
llop implementations cpu gpu and uh
torch
and then our arcs here striding group so
we have to pass in stride groups here
movement op
missing one required positional argument
arc oh well arg equals none
because it can be none for uh
reshape okay cool so now you can see
here are all the uh all the ops all the
like
uh all the ops running
i don't know i mean even though this
layer of indirection takes up lines
i like it
let me do buffer as well
um
it's not exactly what i want
device dot buffers
probably i don't know how to get device
i don't think i can import it because
then i have like a circular import or
something
actually probably move device to here
and proxy buffer call
okay so
hopefully you guys understand what i'm
doing
uh
it's like uh
this is like a layer of indirection for
the llop operations
so now when ml ops calls into them it's
actually calling through this layer uh
and you can see them all printed here
you can see like you know what the op
actually is for the network
okay cool
so now i can enable it with print llops
equals one
and you'll see that like the really nice
thing about
you know the power
of tiny grad is like the api it can't
have a complex api because the lines are
are simple does extracting some part of
the code into a separate lib well it
depends what it is
for like loading libraries yeah loading
libraries really don't matter um
i probably won't the onyx runner can the
onyx loader can stay outside i have
torch loaders outside i have models
outside the important thing is that the
core tensorflow
the core tensor library
fit
and make sure you get all the
abstractions and if you have lots of
weird accelerators you can put them
outside too
but currently what's in here is the
three basic accelerators cpu we're
spending 111 lines on that
gpu we're spending almost 300 lines on
that and then torch uses a lot of the
cpu stuff so it's only 55 lines
um then we have a bunch of helpers in
here for defining what a broadcast is
arguments for convolutions and this is
the definition of all the ops which
should actually move to ops as well
move to
ops
um
and these are the ml ops where we define
the derivative of the basic 13 functions
it used to be 14 but we got rid of map
mall uh i include some neural network
niceties i include batch norm and a nice
conf2d that'll like do padding for you
and that'll initialize like weights and
biases and stuff
um
yeah
this is that off in direction layer
these are the optimizers so you see we
support sgd rms prop and atom and then
this is the main tensor class
it's gonna be nice we're gonna we're
gonna ops is gonna be really nice
uh
the font size is getting smaller every
stream i'm sorry
uh it's it's just hard for me to work
it's hard for me to work with it that
big
is that a lot better for you guys though
all right so there we go look at that so
this is running a full efficient net and
doing inference on uh a photo and
passing other photos if you don't
believe me
and now with print llops we can see what
all the actual super low level
operations are that are going into uh an
efficient net
um
hmm
cool i'm glad it makes sense
uh
okay so we're back to trying to install
onyx he always wondered what you doing
let him wonder who now
could not find python libs missing
python libraries
uh but i i put it there
[Music]
why can't cmake find it
d python let's try python library
no lock
why can't it find it
i clearly have the library
this is this is real right
wait what
oh i forgot a slash
okay
uh
i mean i don't know what type
okay fine
i'm not even sure if that's the right
environment variable though there's one
of the problem with environment
variables here
you can fix the errors by appending to
the cmake config
how is it finding the include dir ok but
it's not finding the libraries
try setting the following
it feels like it's something in the
setup pie
it might be
i don't know
um
update pip okay
[Music]
always could be that good point
no it wasn't updating that okay
i don't understand there's somebody like
pass in pip set environment variables
no just like a waiter
does not work
i feel like i've done this before and i
can do something like this
i feel like okay now at least we're not
in pip land anymore
the python executable
what
d python libraries being passed in
what's the error now
found python libs
what's the error now
protobuf compiler not found okay that's
a better error
i did brew install protobuf
protobc
protobuf compiler not found
i hate google photo buffs for this
reason
lib protobuf dev
i did brew install proto buff right
is there a different
one oh it's not linked
oh
okay
oh
yeah
yeah you just gotta force that yeah yeah
get it in bros
all right
oh lovely
what an experience
okay
now we can go back and we can try python
3 import onyx oh wow look it works oh it
works how come you don't know that it
works stop coming up with the dashes
onyx is not accessible but
but i made it accessible
oh because it's still an old python you
gotta get the new python i don't know
let's just close this
reopen it
okay now now it finds it great
uh okay
onyx
model
um
parse
okay now i got this stupid onyx thing
installed how do i use it
did i have a demo overview nope
um
[Music]
hmm
no this isn't so here python api
overview oh okay now we're talking
yeah this is for stupid people like me
good i i stopped bites i oh you know
guys it doesn't matter how good of a
programmer you are
uh you still gotta you know copy and
paste the examples because that's really
programming is like plumbing you just
gotta find the pipes and you gotta stick
them together you know programming used
to not be like plumbing but now it's
like plumbing so if you don't like
plumbing you're in the wrong
uh business
you got to make sure your pipes are like
really nicely stuck together you know
you got to use like grout or i don't
know whatever plumbers use oh great yeah
that was helpful
uh okay
onyx
safe
[Music]
does this really just load the model
oh look it does something how come when
it prints it has
okay uh 4g in onyx model dot
a graph should we try to do this in a uh
an iphone notebook
let's say and since it's a node
i've been trying to not use stupid
variable names graph proto object is not
iterable
ah
well that's too bad
can you can you can you flux and solder
that's right that's right good point see
this guy knows the plumbing um okay can
can somebody help me like where do i uh
running shape inference
there's like the no like like
oh do i have to parse the graph
no no that's
irritable
uh i like for stupid people like me what
what i don't ex
can someone like give me a thing that i
can copy and paste
oh great okay cool uh dot node oh maybe
i gotta do node
node
oh node oh yeah
yeah we got it with node look hey cool
um
yeah
wow temporal hydra
i think we stole that name from tesla
oh good thing it includes this doc
string in every uh wow that's taking up
space
oh get started with python good good
good this is for dummies
uh
no this is this is onyx run time
we're not in onyx runtime we're just
trying to do onyx
all right uh print n dot node
type up type
great okay so here are all the ops in
the open pilot model i think it's uh
n dot input and dot output
so you can see how that kind of looks
like the stuff i was printing out before
great um
thanks alex idiom
uh hey so like look
look we're we're we're rich we're we're
super rich
all right let's like parse the shit and
try to make it uh you know go to uh
why does the com take 3m oh because it's
a bias
can you make the font bigger ah you know
is it bigger enough for you
all right
all right first we probably have to do
the inputs let's do the inputs first
all right onyx model dot
input
oh no
print
d-i-r-o-x model
let's go
uh what is it inputs
doesn't even have nodes
this is terrible
this says input it should work oh no no
sorry sorry sorry onyxmod.craft.input
oh don't you love computers oh that's so
nice all right good oh look we got
inputs alright cool all right so these
are the inputs to the open pilot model
there's input images there's big input
images there's desire and there's
traffic convention
i know chat loves a big font but you
know what that's what chad gets oh you
like that font oh i like that font
that's a good size i can see that well
okay am i in the hallway um all right
where's this twitch music
twitch soundtrack we're gonna we're
gonna try it
soundtrack by twitch
uh use soundtrack web player uh
yeah sure i'll do that stuff yeah great
what did i not do
um
oh no i have to disable publishing vods
what
oh
i will set up virtual multi-track audio
features
oh this is so hard okay read
instructions and help faq article
all right let's let's read the
instructions
how do normal people use computers
advanced audio mixer
virtual audio cable obs okay
here's obs
we have to go to settings
uh output
enable advanced oh here we go
oh that wasn't too bad
you will add or select your virtual
audio cable
audio
no i don't have a virtual audio cable do
i have to buy one
it's virtual that can't be too expensive
right
okay
download and install twitch studio
to add virtual audio cable here
if i have to reboot my computer for this
installing the advanced audio mixer
first navigate to the audio settings
page in twitch studio which i don't have
oh well i do have it on a voice meter
banana
if this what
but you guys are gonna hear the music
anyway through the microphone so i don't
even understand how this is gonna work
this is not gonna work because you guys
are gonna hear the music through the
microphone and then i have to wear
headphones
i don't wear headphones
i don't know i enabled that i'm pretty
happy that's that's that's good did i
did i enable something good
did that do it i probably did it wrong
all right
oh that's nice no no i'm probably
violating copyright right now dude i'm
gonna go i'm not gonna fuck up an riaa
agent you
know give him a baseball bat
who works to be alright again baseball
bat yeah you're gonna hear it like the
sounds you hear from the mic see it's
useless
baseball back
this one's for kim.com
you know oh i'm not advocating violence
on my stream don't worry it's a
hypothetical baseball bat
i have to restart the stream fuck this
man fuck this and fuck the riaa napster
man
what happened to sean fanning and sean
parker you know
you know
torn freaks man
this is too hard is this no i'm not
because i'm not doing it like i don't
mind doing hard shit but when it's for
copyright motherfuckers
oh all right charlie you gotta gotta be
calm you know stress really is taking
years off your life
oh
yeah all right
i felt good
i'll learn a lesson from it though you
never see it coming you just get to see
it go
um
need to meditate oh do we gotta meditate
oh no no no no we're good we're good
there's just no music and we all just
have to accept that
you know what i have an idea oh you know
what i got you guys i got you guys i got
you i know what i'm gonna do
hang on i gotta find it
where is
it
no don't tell me they're at work
you know what let me just find mine and
try to figure out where they are
i'm going to put my airpods on and
listen to music oh there we go
and you guys can't hear it because
copyright
yeah
yeah i got you all right
yeah
yeah that's right you guys there's no
copyright violation if only i'm
listening to the music
yeah here we go
green squirrel in pretty bad shape is my
discover weekly
[Music]
so
this is a good song guys
green squirrel in pretty bad shape
first off
pretty bad shape wow like that's just
that's just creativity you know
you out of your clothes
lie to your family
we're just listening to green squirrel
in pretty bad shape again
i even forget how to use my own library
so we got to read the docs
so
okay i feel calmer now
am i open to general questions bro
if you're asking some bitch shit like
can i ask you a question the answer is
always no
you ask the question if it's a good
question you live if it's a bad question
you get banned okay right
does that sound like how we can do
things around here
did anybody tell you that this was a
safe space
i have one word to describe them and
it's liar
this is a safe space for people with
good questions and skills
all right you know that's the problem
with save spaces can you have a safe
space
you know
for for different types of people you
can't
you can't right look at cabra cadabra
right look what happened to it
um if you guys haven't watched bojack
horseman you won't you all should uh
okay
so like let's do you know let's start
with like a few simple notes let's do
zero through ten let's see what we got
okay cool
uh
oh now some of these have initializers
let's just start with this first comp
can we do a single comp
where is the data for the weights
it's not in there where is the data
because some of these things like this
here
it's an input but it actually comes from
okay input name
node app oh initializer there we go
let's do initializer too
just
great
don't you love when you get that
thanks that was that was exactly what i
wanted you to print out wow this is so
helpful
[Music]
dims
let's try np dot name
all right all right all right that's
something
i think these are so this is where like
all the weights live right
yeah cool
prime subs are on an extra short leash
here
this is a safe space from bad questions
absolutely
that's true
that's true you can't have safe spaces
for everybody you know what do you do
when like uh you know
a jew with a nazi are in the same room
you can't they can't have a safe space
for both of them man
one must die at the other hands i read
harry potter i know what's up
um i don't really want more coffee but i
want something let's see what we got
here
all right
lemongrass coconut flavoring sparkling
water
real lemongrass extract
it tastes nasty bro
how come this one has dims and it's like
a normal thing
oh and then like raw data maybe
now and then like maybe we care about
the data type
let's see if that works
oh my gosh
seems pretty good
i don't know if one means uh float but
here we can do the math a little bit
that's 128 yeah we're good okay uh sir
np dot data type equals one
then we can say tensor sub and v dot
name equals tensor
uh
maybe we do
np dot from bytes and p dot raw data d
type equals np dot float 32 shape equals
np dot dimms and that should just work
uh important numpy is
it's just supporting props as well
uh
module numpy has no attribute from bytes
from buffer
shape is an invalid keyword from from
buffer okay
uh
interpret buffer as a one-dimensional
array it's called like this from string
as well
um it doesn't help me
okay fine dot reshape
does that work
great
let's print all the tensors again
now we have a lot of tensors wow look at
all those tensors
ah
okay calms it down
okay
you open a can of sparkling water bro
bro talking about teenagers bro
okay um
seems pretty good let's go to the nodes
get weights and
biases and then let's see how many of
these we can actually make work
in uh
okay we can't have dilations one is not
dilation
kernel shape don't even have to specify
that
oh it has pads
but that's okay
i think we can just pass that into pad
2d and it does have strides
[Music]
okay if n dot off type equals equals com
let's implement conf
so there has to be three inputs
we say
x w b equals m dot input
uh no that's not exactly right
we want to uh
tensors
for accident.input
okay cool
so those work
and now let's use the beautiful tiny red
api i really do think the tiny red api
is beautiful
so we can say x dot
[Music]
uh
you know what let's name it t because
tensors is getting too long to type
i'm not going to accidentally reuse t
somewhere else
no we should use the word tensors that's
good yeah we got to use longer variable
names
uh
okay x dot conf 2d w
uh and then we want to do a bias
i have an implementation of this here
oh
my contradi actually supports a bias
i didn't know that
why
why does it support a bias
in the ml ops it supports a bias
no it doesn't
oh but this is in uh this is intenser
so in the bass off it doesn't but in
this op it does okay cool
so great we can just pass in the bias
there too that's pretty nice
we do have to figure out the strides
wow
these attributes are so bad uh
attribute to dict
hey
uh return
let's use a dictionary comprehension
uh x dot name
okay
um
attribute
parse
a
uh
i can try
for xna
uh about items that's right and then we
say attribute parse if a dot type
print a dot type
try attribute
and dot
attribute
google protobuf pyxed has no interviewed
items
oh no no no sorry
ah that's just gonna be a because it's
not actually a dictionary yet
all right cool
uh
all right we're getting sevens and twos
there great
if a dot
type
equals 7
don't ask me how i knew that it's
because i'm the mole
return a dot
maybe something like
and x or x and a dot ends
if a dot type equals equals two
uh return
into a dot i
ah raise exception
can't
parse
gen x
who wanted gen x i don't want gen x
no
does that not
okay good i don't want generators really
if i do that i get a generator i hate
generators
all right cool
um
all right
let's call it opt uh assert ops of
dilations equals 1.1 because that's not
supported
and here we can say
uh
x dot pad 2d no
uh yes
x dot pad 2d
op sub
pads
dot conf 2d
wb
and then we want to pass in scribes
equals opt strides
uh groups equals opt subgroup
out we can actually say tensors sub
output we gotta say
n dot output
cool does that work
got an unexpected output
just stride
unhatchable type
why does anything a repeat scale or
container i hate this
nothing should be anything like that i
got rid of all the proto crap
why is why is anything a
oh don't tell me the output is up
great
okay cool
so that should run the convolution
great
on to the next one
let's see what the next one is
oh the next one's in l u
uh we have values don't we tiny god has
values right
do we know the values
we have galu's but not values
okay we'll have to implement value i
can't believe we don't
evaluate
um
so what's the definition of an elio
ah
well i really can't believe we don't
have values
all right i think we can say return
self.relu
and then it's just e to the x
which is x right
minus neg uh
minus
alpha
oh
times
parentheses
self.x minus one
uh now you see we write that code and we
don't know if it's right so let's go add
it over here to tests do i have a test
for swish
yeah i test swish okay uh we'll have a
test for raleigh test for lu
um torch functional lu tensor lu
uh
python 3
test test ops
test ops test value
great
did i really just get that right let's
try to break the test let's just like
make it a value and let's see if it
compliance okay good it complains oh wow
first try boys
first tryout we can also test it in gpu
yep that's good we can test it in torch
okay that's good
um
[Music]
can't add
we use l using the common model add lu
support
okay we have lu's now
uh so now
we can go back
to this
and we value okay
uh if op type equals lu
uh tensor sub n dot output zero
equals uh
tensors
n dot input zero dot l u
else
raise exception
uh op type
type
move this down here
[Music]
get rid of that
spell things right there we go
op type ad not supported okay we got a
support ad ads really easy don't worry
actually should i just make that
universal
think so yes
it's easy that was so easy oh yeah the
easiest thing we ever added all right
cool
op type flatten is not supported
why does it have an access parameter
i don't understand
oh because we're flattening to that okay
that's fine
wow wait we're already there oh my god
we moved down the model so fast
uh
we're already at the flatten look at
that
that was so fast
okay
uh
so now we have to do flattened flatness
just to reshape
we do have opt uh opt sub access
okay nps of zero dot shape colon that
minus one
now plus
minus one
uh
wrapped equals np dot zero dot reshape
actually do i support flatten
no i don't flatten it's kind of stupid
i mean we could
uh to
add to tiny grad
uh can only concatenate tuple not list
two tupelo we can't concatenate a list
to a poople everybody knows that
um
shape equals tuple
okay we're up to concat
flattens the other axes okay that's fine
uh oh
we should also know the output shape do
we not
no actually we don't
okay
uh the op type is concat
um
tiny grad supports this i believe
i'll just call it cat here we go
uh oh no okay here's one of the annoying
things
i believe this only takes two arguments
so we have to do it recursively if we
have more
uh let's say a cert length p equals two
if it is two we can say red equals np
zero cat in p1
oh does this take an access it does
dim equals uh
maybe do that
everywhere can't parse one
okay okay that's fair
let's see what a one is
oh it's a
float oh that might be an r that might
be the alpha argument to lu actually
uh we can waste time on that later
oh yeah it's alpha
uh so actually that's an argument we
support oh we should test that
meh it's a later problem
uh either way we're going to support
alpha equals op sub alpha
okay op type gem is not supported well a
gem is really easy
attribute trans b oh no
i don't even know what a and alpha and
beta are
i casted the float to an end good point
you're right i did that's tragic
thank you thank you for
catching my bugs all right let's do dot
map mall np and one
uh if opt sub trans b
uh let's just say a b equals imp uh we
could say b equals transpose b equals b
transpose red equals a matte mall
b
um
i don't know if that's universal on all
of them
too many values to unpack
expected two
oh no there's actually more than two
because there's a bias as well
oh
i guess put that
i don't understand what trans b is then
never mind that's a later problem
uh i have a
helper called linear this is actually
linear
okay
uh on broadcast a little shape mismatch
it doesn't even look right
something about that trans b that we
have to understand
oh okay there's just this
okay op type release not supported well
we're really getting into the easy ones
now
relu relu
okay
multiple concats um
op type split is not supported
okay
uh all right all right we got we got a
triple split going on here
yeah yeah transmute transpose the second
matrix we're we're past that
all right we've got to do split
uh split
print
um
op dot split
okay this is oh
this one has multiple outputs that's not
that big of a deal though
for o dot s in n
zip and dot output
splits
i equals zero
uh tensors sub n dot output
tensor sub
o
that's fine
uh equals
we have an argument called slice yeah
we can also do this as like a get item
i just still know how to write it for
arbitrary axes
something like this
that's right
uh int object has no attribute slice
oops
you want to say
np.0 dot slice
arg and i don't think we can just say
arg i think we have to say arg equals
art or something
i'll say arg equals arc
uh yeah now that is actually
fine we'll just continue here
okay up type sigmoid is not supported
don't worry that one's very easy boys
very easy
very easy sigmoid
sigmoid oh man we're rich
uptight mull is not supported don't
worry that one's as easy as that
up type tnh is not supported guess what
it's as easy as sigmoid
type sub is not support at all i love
when it's the easy ones
oh we did it
we did it
we are through the entire model
now
watch are you guys ready for the power
of tiny graph equals one
oh yeah who wants to see a graph
i have that argument to do that here
whoa is that a graph of the open pilot
model
whoa
look at that
look at those hydra heads oh it's so
beautiful oh that's so beautiful oh
that's that's most this is beautiful
this beautiful shit man
oh yeah look at that
whoa
this is all running on your mobile comma
3. it used to be a phone now it's a
commentary
yeah cause okay like we get in here
[Music]
yeah
see those aren't even connected so this
is the efficientnetb2
then here you can see we start with the
efficientnet
yeah right this is where we start with
the b0
and b0 comes down here and everyone that
works like george tiny grad's useless
tiny guy's doing so much
we're gonna we're gonna make tiny grad
accelerate the network on the comma
three and then this is where you get
into the hydra head here
uh you can see
it gets split those are weights yeah
yes you see it's split here that's
pretty nice right
and there we go that's the output
go all the way down to one output we can
count all the outputs together that's
what all these adds and slices are
yeah
right right
oh check out what else we can do we can
print llops
whoa look at that
all right
uh
let's just factor this a little bit
um
onyx
yeah that was a that's gonna be the
coolest moment in the video
uh if you missed it uh
sorry
test open pilot model here
um
uh oh we should actually return the
outputs too
yeah we should uh we should not put
zeros in for the inputs
we should take in the inputs um
oh did i delete
i should have committed that oops
uh
or something
zero tests
do i have to put in a class is that how
these things work
oh 723 viewers all right people like
this one
uh do i really have to put it in a class
okay fine
hmm
type i o oh yeah i run onyx uh that
i've stopped to model that
very cool
great uh okay we should deal with inputs
and outputs better but let's commit this
before we break anything
now check this out
uh forget that you want to run the model
on the gpu just say gpu equals one now
it runs it on my gpu look it takes half
a second shorter you want to run it in
torch on the cpu let's run it in torch
wow it's even faster torch on the cpu is
faster than my shitty opencl kernels can
you believe it
i can but that's what happens if we just
run it on the cpu
yeah use pi test you know i don't know
we'll get to that someday
okay um
hmm
unhashable type okay
oh it has like stupid uh
i see that's too complicated let's just
do our p dot name we can also do an
assert to make sure the dimension is
right but
i think it should be
cool
there you go now we're getting the
output
tiny grid is so good
like how how easy was that we just we
just ran the open pilot model in
77 lines
[Music]
and we added lu support that fast all
right great it works let's see we can do
it on gpu too
and then we get like gpu buffer it
doesn't actually top you back i think
torch buffers get copied
uh
what's it complaining about
oh
yeah yeah
ah
okay so it doesn't complain
you'll see that when we run it on the
cpu and we run it on torch this is a
completely different back end and we get
pretty much the same values
i'm pretty happy with that actually this
is kind of wrong let's return a
dictionary here
dot name yes that
i love dictionary comprehensions
they're the best kind of stuff
one and a half hours easy yeah because
it's like if the tiny grad api is is
because it's restricted in line count
the api has to be simple to use
uh
this should be supported
yeah
we're gonna we're gonna add flatten
support and we're gonna add uh we're
gonna add multi-cat support and we're
gonna write some tests
and then the onyx code will be even
simpler because those are things that
should be in tiny grad so one of the
nice things about tiny grad is when you
add things to the tensor class these are
high level ops so there's high level ops
in the tensor class
mid-level ops in here which understand
memory allocations and derivatives and
then the accelerator ops here the low
level ups
so those things are going to get added
to tiny grad add multi
cat
to tiny grad add platinum
to tiny brad
no question marks
um should we get multi-split nah
multi-split seems stupid
that one i don't agree with
but multicad i think we can actually see
up
so
what's up
the uh
yeah let me add multi well that's okay
let's first add flat and that one's easy
um where should we add flatten
okay
transpose
uh latin
self
uh what is the argument for flatten
it's called uh
access
i feel like i call a lot of stuff dim
instead of access
i'll call it
[Music]
you like access more than dim someday we
can change it
uh but either way we should be able to
change this now to just say uh
np dot flatten
op sub access
all right
cool we did that fine let's write some
tests for flattened
flat and got an unexpected keyword
access
what
torch flatten doesn't support axis
does torch flatten call it dim oh look
it calls it dim
uh oh and dim
actually like that
better
i like that better
let's copy that
no
it's just it's end damn we can just
write the test in there for now we'll
deal with this later
shapes message okay
um if ndm is zero
and we say flatten axis equals zero now
it's actually starting
great
let's make sure our tiny graph tests are
still passing uh oh we broke something
i hate that i
hate that other people can't see it
uh oh no module named onyx oh
oh
um
fine we're installing torch if we're
installing wow we install an old version
of torch too
we could support the torch stuff with
start dim and endem
uh
you think reshape with
in torch is no copy opposite flat and
yet don't worry about copies
um
actually you know what i don't even like
that it's called dim we should probably
call it start dim don't you think
whatever it doesn't really change
anything
okay
um
[Music]
i mean it works you know okay a few
things we should probably do
ah let's add
let's add inputs here
we're just gonna
okay
okay
flatten into
hmm
don't work
well i didn't realize numpy gave such
stupid cryptic errors too
uh did we get different outputs yeah we
did look at that
ah
traffic convention is which side of the
road you're on
cannot interpret eight as a data type
i'm sorry
how annoying is that
this has no attribute shape
fine
oh i guess we should really change the
d type here too actually i think that's
automatically done by the tensor class
but either way
that can't hurt
wrong shape for input traffic convention
ah
i know what i did already
gotta put some more brackets there just
like that all right
great now we're on
let's see if ci passed
uh i did ci pass
nope see i still doesn't pass
did onyx not install
what why did it install
should have installed
manager requirements.txt
oh is that not respected
did it get from somewhere else
i'll use this
okay
cool
uh we should probably also have a uh
sanity check using onyx runtime to
confirm we actually get the same outputs
[Music]
great not a single one for python
examples
because we use that a comma so it
shouldn't be too hard
okay
i thought i brew installed this
great
pip install onyx runtime
no this just doesn't work on m1s
i'm not using conda
conda
nope
um
torchload onyx
here we go
terrible
is it
convert onyx to torch
yeah like i'm building it great it's you
know it's like this stuff here
great
oh it's actually okay we shouldn't
actually put onyx load model
same thing as sonic's load
yes let's say on this
we'll move onyx load down to here
okay let's just try it then
torch model imports you say
this is tiny broad out
um
call this torch
oh
that's a joke
oh i think that's actually that's
actually my fault
dictionaries are ordered now in new
python
uh okay no no we have to do
uh
sounds good
expected scalar type double but found
float
so upsetting that numpy's default is uh
not float32
sweet
looks pretty similar to me
um
not a real test if you don't have more
asserts
dict object has no attribute numpy okay
tensor object has no attribute numpy
really i thought i had an i thought i
had num pi
i really don't have that
how do these tests work are they using
dot data okay they should not be using
dot data
this can use dot data nothing else can
torch have done time
a detach
it's running with gradients
i have like a testing thing i use in a
bunch of places
[Music]
wait can we talk about how i got seemed
to get this right on the first try no no
i'm speaking too soon
let's see if that test passes
no okay it doesn't pass
but actually that's probably within uh
that's actually probably fine
great
there's some there's some big uh there's
some big numbers
cool
gross
was that not the easiest thing ever
let me throw onyx to torch
here and in testing
uh
okay still failing
how's it failing he's now gonna complain
like onyx can't be installed because i'm
a bitch
is that the problem
hmm import onyx
it's complaining about
proto buffer crap
god
this onyx package is garbage
oh
all right what do i have to like to get
install something
yes
oh you have to install a compatible
version of protobuf
i don't know why i have two
oh app installed protobuf compiler i
mean maybe
i don't think i have to
we'll we'll go to apps if we have to
but uh
one of the problem with all right we'll
get this test fix and that's today's
stream
um the power of tiny girl oh we gotta
add multicat the tiny guy
let's go do that
that is intenser
so
[Music]
maybe we can support a splat here
that sounds good
ah
okay
for why in ours
yes
i don't really understand
oh okay deal with negative dimension
uh
okay let's first make sure we didn't
break anything well hang on
this one's trickier
uh
okay
that's okay we need the sum of the shape
it's all right
no that's not right
this actually isn't supported
oh no it is
it is supported
how much do we want in the front okay we
want negative here
negative in the front
and then for in the back we want shape
sum
minus
all right so we're trying to we're
putting like some here and then we're
going to add them all up at the end
uh no that's not exactly right
um okay we want to do shape sum minus k
minus y dot shape sub one
that should be right
uh insert k equals equals
[Music]
that equals self dot slice
uh arg
s dot zero uh
and then
oh well actually
right
we're at plus equals y dot slice
hopefully that should leave the existing
tests working too
um
did we fix the ci tests
oh sweet we did
okay uh int object has no attribute
shape
oh because that's not okay we can just
fix that no
that is a bug in the test
what that was on line 232
i don't know the test line is 2 33.
there we go uh dim equals dim
can only concatenate less
not tuple to last okay okay
i see you're upset about my tuple
none type has no attribute cpu
who said anything about a nun type
none
why would that be none
what
right plus equals y dot slice something
wrong with plus equals
well that's weird
does plus equals not work
that's a serious bug do we not test that
self design
okay now we just have a shape mismatch
to deal with wow plus equals was broken
could someone add a test for plus equals
and submit a pull request please i can't
believe i broke plus equals
i believe in you guys i haven't asked
twitch for anything yet
uh but someone we need to test for plus
equals
all right now my shapes are just wrong
uh why are my shapes from
i don't really actually need to subtract
i think it might just be that
go back to this
all right i'm concerned about that
i shouldn't really be doing a sign
get rid of self.sine ah
somebody could look into the plus equals
issue i would appreciate you
uh let's go here now
oh well actually let's add a test for
multicat
sweet
now we can change this
to do
np dot cat
splat in p1 dm equals objects
and we're going to set ready for that
man i love programming
did you print these
i like i like seeing that there you know
you can like trust the test
and you know that they're similar but
when you print them and the numbers look
similar you're like wow
wow tiny grat's good
oh look at that the numbers are similar
oh i love when the numbers are similar
okay great
uh good we've added that to the api i
don't know why plus equals doesn't work
but at least now we just don't support
it anymore
the r methods those are fine probably
it's just a sign that doesn't work
uh yeah but we've changed a bunch of
stuff internally with the buffers so
it's actually somewhat unclear what you
want to do when you do plus equals
um like it should be supported as
syntactic sugar but internally you don't
really want it to do anything
where's the sign
i don't understand why that doesn't work
especially if i make it return self
all right can i trust one of you to
solve the plus equals thing
can i hope somebody did enough reading
and understands tiny grad
and can fix make sure plus equals work
write a good test for it
uh i'll appreciate you
dude we're running this on the gpu of my
mac and we're getting the same answer
uh that torch gives us and
by the way can we talk about how few
bugs this thing has
i hit this on the first try you saw me
do this
i i didn't do any uh
thank you thank you for the subs
uh like i didn't do anything uh
i didn't do anything crazy
we should probably support dilations
pads might want to move to calm
so we don't have to do the pad 2d
our graph should be a little bit tighter
now
you guys missed it before
oh hype train hello people oh by the way
you know we can do gradients of all this
stuff too
i'm we're not going to get to that just
yet but
uh you could generalize this script to
other onyx models hell yeah go try it
here
uh okay you know what i'm gonna rename
it that's a good point
fine
yo
that's one of my i was saying i was
saying alex yesterday i feel like
i could win some uh some advent of code
right now
like i just i'm just in the mood where i
feel like i'd just be winning
uh you know what i mean first try
boom i never done this before i didn't
like this isn't like i did it on stream
and then i copied it like you saw me
have to write all the stuff
uh we have some beautiful new syntactic
sugar for uh
for tiny grad
and you know that tiny grad now works on
all the gradients too
oh man this is this has made me
committed to and you know people are
working and be like george you know you
should just write new stuff don't use
tiny grab but
now i'm committed to using to shipping
tiny grad and open pilot because of how
easy that was
make sure i didn't break nothing
uh cool all right should we uh should we
let everyone talk a little bit let
everyone talk and that was today's
stream
all right do we want to try one other
onyx model
should we try one more onyx model does
that does that sound nice well that will
add we'll add a second onyx task it
tests like a resnet or something
so oh is there any way that torch to
onyx actually supports uh
i really like that they're just like in
order
this is the stream for the weekend now i
think we're doing stream tomorrow
i think i'm gonna land
does tiny grad export to onyx yet
uh
no
but that'd be pretty easy as well if we
cared
i mean
tiny grads not really meant for export
like that
i would
yeah
maybe we do want i don't know someday we
can write exporting to onyx
i wonder if we can um
i mean this is short enough that we can
almost fit in the main tiny grad
i really do like the idea of tiny grad
being able to run
uh generic onyx models
we have torch loader too but the torch
lowers so broken in comparison
well no
the idea of tiny rad
tiny bite in some ways is a lot more
like onyx runtime
all right the idea of tinygrad is that
you can uh
like you export your stuff
and then
well oh god oh you haven't seen the
graph yet
see look we can see the res connection
right it looks like a res block like
there's the ad going down there
um
is there a difference running it on q
well no like here i can i can run it on
the gpu that'll run on the gpu of my mac
all right let me see it runs faster
oh you'd love to see some code forces
bro if you weren't a subscriber right
now
ugh
look at that double permute look at how
stupid that is
we doubly permute the matrix
but you see that's this is
this is where uh
this is where we're going to get the
tiny grad optimization layer
and we're not going to actually do it at
this layer this layer is the ml layer
we're going to do it at the llop layer
i tried to break ci oh no i broke ci
what i do
what
this says i broke the optimizers
oh no
did my plus equals
does plus equals work sometimes and just
not for me
because we use plus equals in the
optimizers do we not
yeah we do
i don't even know how they ran at all
okay we do have tests which is even
weirder how did it not work
it's like just broken
i don't really get it
and now it works again
wow that should not silently fail like
that
how come when i do plus equals it
doesn't work i find i'm solving the plus
equals problem
because it broke ci i don't really get
that
and nan's
weird
okay we have some weird bug
self dot assign
that should work fine
dispatch is just calling apply
very
weird plus equals is broken
[Music]
what could the problem be
okay
let's reproduce it
oh where's a good place to put this
in any of these tests already
test the garbage collector dot test
yellow ops
test speed
onyx
train
okay we'll put in here
whenever something breaks add a test
okay uh a equals tensor dot
random
is random does that work
uh 10 by 10
b equals tensor that random c equals a
plus b
c dot numpy
a plus equals b
p dot testing dot sir all close now one
velter
yeah none type attribute has no numpy
how's that doing that
that shouldn't assign it should it
okay we do have to return self
um
i guess i just don't understand okay
we'll read the optimizer and see why
this isn't a problem
i guess because it's yeah okay that's
fine
all right will just try i will try i
don't understand why my fix didn't work
then
okay
fine
test multi-cat
now let's go back to cat
does it work now
none type object has no attribute data
that's not none
there must be a problem in the gradients
okay what if i get rid of a sign
then it works fine
i really like that that returns anyway
test plus equals works just test m this
work didn't i try this too
okay
now that doesn't work
hmm
okay
here's an idea
we'll leave self-assign
but we'll put tensor around it
now
um
okay okay okay fine fine for fine i know
what to do don't worry don't worry i got
this
i got this let's go
okay
so we don't actually what we want to
return is what's inside there we don't
want to uh so
uh
in place
red equals dispatch
okay that works
that works
and that works great
that's all of them
uh
is there a nice one-liner to do this in
a lambda
am i getting greedy
self.grad equals x dot grad
i don't really think that's right
i think that's going to break the
autograd engine i think we're doing now
is way more correct
because we're assigning it but we're
also
returning the right thing
i didn't really understand that that's
how
there's no way to write this as a lambda
oh
wait
maybe i'm just doing this wrong
return axe
this sounds very elitist yeah i've never
been to my stream keep hacking elite bro
it's my slogan
now you'll know what my slogan means
right my slogan doesn't mean that
a person fundamentally because of
themselves should be excluded from
hacking
my slogan means that hacking is an elite
set of skills
any person any individual of any
nationality race color creed even if
they like mayo can come to the hacking
party but you have to bring skills right
right right you see what i mean okay
let's say you're going to a party and
the party is a potluck and there's food
right
every person is welcome at the potluck
but they have to bring food right and
that's what it's like when i say keep
hacking elite i mean like there's an
elite level of skill that you need to
acquire
to join the party
now you can sit there and just like at
home you can sit there and you can make
food right and then once you have food
you're welcome at the potluck
but if you don't have any food you're a
fucking freeloader and you can get out
of my potluck right does that sound fair
all right good as long as as long as we
all understand mayo is disgusting
and should not be tolerated and if we
could you know crack down on the
the the gratuitous use of mayo
everywhere
all right great look i fixed it i fixed
it with one line see what i mean when
you fix something with one line the fix
is probably better that's just column
graph complexity
yeah
fixed
with one
return x
your chat is kind of outdated oh no man
around here we're never afraid of being
outdated
ah
oh shkreli's life
ah all right all right we really we let
we let the stupid out when we let the
non-subscribers talk
um
dang you guys missed my hdl stream where
i got
where i got xilinx compiling on mac like
you know we doing this are we doing this
uh all right all right the the what mac
are you using is the reason that we're
back to subscriber only chat does it
matter bro does it really matter your
skills don't have anything to do with
your computer
your skills are all up here if you have
skills they're up here
oh alex left to go do nails
and
uh now i have to make my own lunch
and that's sad because my lunch is gonna
be really lame
uh
all right
cool uh oh did we we gonna run one more
are we gonna run one more one more onyx
how are we doing on viewers 785 okay all
right we'll run one more onyx but first
we got to make some tortellini
um
if you blame computer then you shouldn't
be using this uh poor craftsman blames
as tools that's right
dude remember that time that we ran the
open pilot model in tiny grad
see look at this there's an empty box
thin mix in the fridge
who did this
i've been eating strawberries and i get
little bits of strawberries stuck in my
teeth and i don't have any more flossers
all right
where's my amazon tubes
i heard yesterday about some startup
they're making tubes and they're going
to connect every apartment with tubes
and then you can just type in what you
want on amazon
and it shows up in a tube
that's peaceful now that's right that's
right you know imagine we did that to
society
yo
think about it think about it
what if it turned out that percent of
people in society
were like the non-subscribers on twitch
think about it
all right what was those the mitt romney
quote 47 of americans don't pay taxes
look i don't know if it's true certainly
don't like mitt romney but
what if
half the people
are mooches
think about it
think about it think about how great
society would be if all the mooches were
gone right
yeah like the government
yeah man think about it
do i write tests yeah i always write
tests look tests are not like i love
tests
i love tests uh so one of the guys at
comma who did like all rci uh he really
like showed me how amazing tests are and
now every time i start a new project i
write ci for it and every time ci fails
or like i find a bug that wasn't caught
by ci like my plus equals i add that to
ci and it'll never break again
you feel like the non-subject like
liberal arts people you know what people
only think this because like have you
ever met someone who's actually really
good at liberal arts
like i've met a few people who are
legitimately like liberal arts geniuses
they've read all the books
uh and you talk to them and you're like
wow you really know something
um i think there's an xkcd that talks
about this
here we go
right like
there's actually
really smart people who know all about
like history literature philosophy it's
just your average person who goes to
college and majors in communications
didn't learn shit
and they give all the liberal arts the
thing about computer science and
math is like if you went to college you
majored in math you majored in computer
science like you can't be that bad like
you could be bad but you can't be that
bad
you can go and you can major in
communications and you can be that bad
um so don't hate on liberal arts hey don
look
ten percent of people used to go to
college now 50 of people go to college
you know
people didn't get smarter
college got dumber
y'all know but think about it think
about what if we could just put
subscriber-only chat on in society
gender studies is the most valuable
degree well
you know what maybe there's someone out
there who's really really good at gender
studies
and actually like knows a lot of stuff
right here's even tell someone knows
stuff see how good their like projective
models are
if people are making good predictive
models of the world regardless of
whether you think their their field is
stupid you got to respect that right you
got to respect skill that's what hacker
culture is about right that's what i'm
trying to talk to you guys about like
respect skill and disrespect lack of
skill it's not you personally but it's
your lack of skill you go you gain
skills and you know how you gain skills
you know you gain skills you just hustle
you gotta hustle and some people don't
put in the work and they don't deserve
respect
right can we can we
can we uh can we all agree with this
does everyone agree
you're subscribers you agree
soft skills are skills too
there's all kinds of skills man
but like you can't tell me that you have
on
there's all kinds of skills but all
skills are measurable
right so there are soft skills there's
hard skills there's skills in writing
their skills in business
uh there's all kinds of skills you gotta
respect skill but
some people are like oh well you don't
understand iq doesn't measure everything
you you have to see that i'm a really
good person
yeah yeah you're losing me you're losing
me i he doesn't measure everything you
have to see that i can play the piano
brilliantly
oh well all right let's see you play the
piano see i'm sold on that right because
that's a measurable skill
but uh you know being a good person
sorry
sorry that that's not a measurable skill
or whatever like i'm a human being man
i'm a human being okay and go on
go on
i'm emotionally intelligent
you like are you
you know
uh like some people are
some people are act absolutely brilliant
like uh
[Music]
like the people are emotionally
intelligent they're like you know you
use that and you're like the evil with
that you know
sales people
the people are actually good the thing
is there's a lot of clowns in these
industries
there's a lot of clowns and software
engineers too so
onyx resnet
oh a collection onyx model zoo oh look
at this
oh nice
oh boss all right here we go and a fp32
download with sample test data
faces
should probably clean this up and like
protobuf decoding
consumed too few bites
oh that's bad oh okay because i didn't
do the right let's try that
oh no
oh no
my water's boiling did i put the stuff
in i forget
okay mida or maybe i just opened it
see i am not a good cook
oh i gotta put f
there what did i do
why did i put brackets around it that
was weird
so i lost the t
seven
oh are these the same types as these
those are really big
how big are squeeze nets oh squeeze nuts
are tiny
oh look offset version
let's try this squeeze nut
squeeze nuts are smaller they like
squeeze nuts
but i can't spell squeeze net so that's
the downside
okay
filling with zero
oh those aren't good those are supposed
to be initializers
oh
i'm upset by this already
i'm upset by this already
i regret doing this
spinach and cheese ravioli
a perfect lunch for lunch
let's cook them all
formats
bad data type
one seven what is seven
probably an int
ins
in 64.
okay now we have this problem
this is done for batches
uh
does that work
no no that's indian butts
um
[Music]
okay
first thing we can't do is a click we
gotta figure out what a clip is
faces
there's always different offsets in onyx
too we can decide to only support some
of them in multiple others
so
someone want to look and see what offset
that model i chose is
and see if it's going to be a lot of
weird stuff or just a little weird stuff
i think i know what clip is clip is just
like max but the other way
do we support that we might not actually
we do with some weird combinations of
like values and ads and stuff
yeah clip is just mid max i hope we
support that
[Music]
no clip
do we not support min and max
this is a big problem if we don't
oh we support no but those are different
mins and maxes
i think it's called a max
you know
i think they're implementing our value
6.
so
oh
[Music]
um okay if we want to do min
so let's say the min is like three i'm
just going to subtract the min here
and then we have relu
ah
and we add them in back
then for max okay if we have a max like
yeah that should work should just be
that
try to test for clip
cool
we should probably actually write min
and max as well
and then write it in terms of that it'd
probably be a nicer thing to write
and we can definitely write value six in
terms of that i don't know
whatever
real clip
global average pool okay okay
by the way just to show you how far we
actually are coming um
let me just add a
cool so we're left with global average
pool
we asked for that
uh yeah i wouldn't write it like that
though
like you think you can write it like
that that's a good idea but it's not
um because you're you're generating the
index right
think of what you actually have to do in
order to run that thing
you're making a list of all the indices
or maybe you're making another vector of
where it's greater and less
but still you're doing two well think of
your living reaction
right
like you can say oh well you know you're
you're iterating over it multiple times
but i'm not creating any new memory
and that's the key
i i want to write the uh when i write
the lazy jit
i'm going to make time lazy and write a
jet for it
we have to support global average pool
can you believe that
can you believe that's an opp
so i just need to do what
mean across the second two axes
[Music]
i can't believe that's an op
global average pool
and applies average pooling across
values in the same channel
what's a
channel oh it's nchw
p
the default is two
okay
mean
what they they give you the example
right here
what i call my opt for mean
i mean is uh mean is an h up
access equals that and keep damn equals
so
op type shape is not supported is that a
reshape
what how is that an opp
[Music]
it outputs a 1d
in 64.
oh come on that can't be enough nobody
actually wants that up let's just stoop
it up i'm not supporting that i'm
offended and i'm not supporting that
constant
these are stupid ops
um
cannot parse for name is value
data type four
oh
[Music]
you
attribute error data type oh dot t oh we
need a t
okay
gather
unsqueeze
i don't know about these these seem
pretty stupid
[Music]
i have to move to a different nap i
don't like this now anymore
alexnet oh my god alex nuts are so big
i'm not going to sit here and wait while
that downloads
okay inception v1
oh that's wrong
clip was a reasonable thing to support
i'm happy we added clip
cannot reshape
a ray of size zero
let's try a different one
efficientnet lite4
vgg yeah but vgg is so big i don't want
to sit here while vgg downloads
assuming it's simple it's like these
things are just like not well compiled
why does it need a shape operator
googling that
um
okay they're using dilations
okay we don't support dilated carbs
that's a deep issue
see at comma we really keep things
simple
what was the problem with inception
oh see look at this offset version
what about resnap yeah we can do resnet
the problem with resnet okay i don't
understand this
this is a different problem
um cannot reshape array of size zero
and clip one max
dimension is one how come raw data is
zero
oh i see it has a different data type
oh this is just the same as this then
let's do attribute parse here
no because that's weird it's float data
i just don't know right here okay
okay
we have a clip with an unspecified min
is that supported
oh because it has multiple inputs okay
yeah okay that's fine
um
[Music]
why do they allow this so many different
ways like onyx is so complicated
the open pilot model was simple because
i hate you know because we look at it
and i just hate all that complexity
okay cool
all right we're back to shapes and
gathers and crap
great
but we do not support the other way of
doing clip
i had to pass in tensors for that
gather is the most annoying one i don't
even understand why that needs to happen
all right fine we'll wait forever for
resnet to download
it's not actually too bad
resnet let's go resnap
oh no i know what i did wrong there this
this this this
github color theme
sweet
okay
that's simple that's just a calm without
uh
that's just a con without bias that's
okay
[Music]
hmm
it's a joke right
but my weight's not the right size
i have to extract the parameters from
[Music]
that's just upsetting
how come the open pilot one just worked
and none of these other ones do
i mean why is it not right
i can i can extract it but it's just a
lot of effort
you know what i mean
okay let's even see if it's right okay
so i would expect then
this to be
seven times seven times three
okay and it has 64 channels out
should we write the reshape
that's a one-liner
it better not be more bullshit if
there's any more bullshit
uh
i'm gonna be upset
minus one
x dot shape sub one
[Music]
op sub kernel shape
uh
zero
it might be backwards
[Music]
ah
okay
unsupported batch normalization oh yeah
so what a great op oh good thing we're
going to support that
okay flatten doesn't have an axis
parameter that is okay
triple out of range
again
oh
this is the same problem the weights are
uh
the weight matrix is just stored as junk
is there something i'm not understanding
here because these look like they're
correct
like there there's your shape right
there
and it's being filled with zeros
there might be a way to get this shape
and i'm just not doing it right
okay before we do this more let's see
because this might actually not be
necessary
i i think there's got to be a way
where's my fillings um okay these just
aren't right they're not real inputs
they're initialized inputs
let's import some initializer
i don't know what all this float data
crap is
yeah okay like these are kind of right
do you see what i mean
mod should maybe add rules to stream
yeah that's right because you were
probably trying to say a dumb word and
if you're trying to say a dumb word
uh why would we want you to say it why
would we why would we tell you what the
rules are the best rules are completely
uh
you know they're just they're just you
have to discover them and if you did
something wrong don't worry i'll be
banned
more
okay
there's all these dims and like that's
probably right
oh
wait no i'm really stupid
oh i'm sorry
i'm sorry i just have to do that
oh i knew it wasn't that bad okay i just
had a bug in my loader all right this is
stupid
that can go and that can go
okay
um axes don't match array
that's a different problem
oh well
should you probably support that
i should support that in my map
see the problem so this is a vector
times a matrix
which actually should be allowed
so let's go down here to
tensor
and to my map mole
and the problem is
x shape is
this is not a batch size
okay bachelor's is one group just one
that's fine
maybe i just say if length x dot shape
trip checks up
axes don't match array
go down to my permute op but i think the
only thing i'm passing in there now is
zero right
length x dot shape equals one order
equals zero
otherwise order equals complicated graph
hmm
cool
that fixed that
okay now the only problem is in outputs
it's just called something else in the
resnet
uh
did i not print that
i understand what's wrong
are there no outputs
oh
did you guys catch what i was doing here
that's that's just my bug here
i was changing the wrong one
okay
what's the output called
it's called resnet 15 dense forward oh
that makes sense
okay
uh now it's not going to work because
batch normalization is an unsupported
app
uh
also all of these things probably
shouldn't be initialized to zeros
i think actually it's pretty easy to
just do this so let's go here
um
if
np dot name and tensors continue
let me get rid of that there
great
so the only input is actually called the
word data
data
okay
tiny grad out and torch out
converter is not implemented
the torch one doesn't work
the torch one doesn't work what a meme
what a meme
how does this run oh just once used
rhett from last time oh that's pretty
bad
this does have to be an exception
wow okay so we can't even use our we
can't even use our uh
no everything of mine is implemented
it's just the other guys who didn't
implement things
and that's a shame
okay uh we'll implement stupid batch
norm
which is it's a really dumb operation
uh
all right let's
i do have an implementation of this
like not really i have to like create
this oh that's terrible
let me look at this for a minute
why do i
okay mean var
uh weight bias eps
static method
yourself
okay
now we refactored out normalize
so now we can say
let's say apply batch
normalize it's a nice name
uh okay now in batch normalization
what are the arguments
forward gamma beta running me running
var
uh
do we have an eps it's fully in orgs
from tiny grad dot nn
import batch normalize
right
how do we get max pool oh we have to do
max pool too that's not too bad okay
there is an epsilon here and there's
actually a momentum as well but we don't
need that
okay batch normalize
um
what are the parameter arguments okay
i hope the order is correct
in p1
my mean is this
my variance is this my weight is this my
bias is this
and opt sub epsilon
is my batch norm
right equals batch normalize
okay now we have batch norms we do have
to support max pool as well
uh that's actually already supported in
tiny grads which would be pretty easy
i can't believe resnets are still using
max pools
we support pads and stuff in our max
pools we have to do that externally
max pool no we do not we have to do that
externally and it's called strides okay
uh
x dot pad 2d it's called
um and
opt
pads
uh and then
oh no
no we don't support strides
oh no
oh i guess that's fine i guess we can
just
whoa we don't support strided max pool
i have a resnet implementation how did i
write it
we stride on the conf
this one just doesn't have any okay
fine
uh
yeah um
okay
brad equals x dot
uh
max
pool
opt kernel shape
uh
x.com2d
strides equals opt
but we're gonna have to come up with a
weight matrix for that
and those should be rats
i mean it's just it's just disgusting
that they that they actually wrote that
because like
uh tensor has no attribute actually it's
still maximal 2d
what
oh max underscore pool tv
okay uh conf2d got an unexpected keyword
strides
oh okay we have to pass into weight
matrix but it's actually not too bad so
we can say red dot shape sub one
tensor dot ones
uh
the weight matrix is channels in
um no
so it's actually tensor dot i read dot
shape sub one because uh it's a square
matrix
um
can i do a trick with groups here to
make it better not that i know of okay
so it's a square it's a square
convolution because we don't want the
convolution to do anything we just want
to implement the stride
um dot reshape
uh
red dot shape
and channels
tensor i chan reshape shape equals chant
i'm gonna fix that once and for all i'm
really sick of having to type shape in
my stupid reshape
it's like a weird tiny grad cork
[Music]
i could make it not even need a tuple
but
it's a later thing okay
uh shape equals chen chan one one it's a
one by one calm
w
and we can pass in
w over here
that should be right
okay
tensor shape does not match the shape of
the weights
well that's not really right
i don't understand
oh
something else is wrong
rally is right okay why does max pool
take that down to three
the problem's not in pad is it
wait why is it three by the time it gets
to max pool
it's probably pad
huh
okay well that's a bug
why does pad 2d cut that down so much
doesn't seem right at all
oh
i'm printing red dot shape here
why did i write x
i didn't write x anywhere else did i
i just do python
have scope for your variables
oh all right here that true there
uh we're still printing stuff in
here we can get rid of
i'll comment that out
uh if
cool
uh
we should call it test resonance
because that was the one i want to do
from the beginning don't think i don't
think i uh chickened out
let's make sure we're not getting like
nands now unfortunately we can't test it
because the torch converter doesn't
support uh
those look reasonable
those look like numbers look guys we got
numbers out
all right but it's kind of sad if we're
not if we're not actually testing
anything
so we should uh we should do a test
um
pre-process image image equals
pre-process image
let's make sure i didn't break test
efficient net
look it tests that it runs it runs a
visual transformer and it runs oh my
visual transformers are so slow now
since my change
oh that's terrible
oh that's so slow now
no actually i don't even know it was so
slow it wasn't even that
oh it's testing chicken big batch
that's too big for the batch
four's a better batch size who likes
waiting not me
okay
um
okay
uh from
test dot test efficient net
import
chicken image
bringing in the chicken image
let's take a look at the chicken image
all right looks like a chicken to me
can't you tell
data equals
oops
chicken image
uh augments
989 is that a chicken
that seems pretty confident about it
being a chicken
let's see if that's a chicken uh we can
import labels as well i think they're
the same labels that i'm not 100 about
chicken chicken chicken chicken
rose hip
oh
all that work and we got rose hip all
right let's see maybe they're not the
right labels
um where are the labels
just image scores for this
all right these
these are the labels
we were getting nine
acorn
nope it's not anywhere near chicken or
hen of the woods
hmm
what's the other picture
car image
try it on a car image and see what we
get
remote control
[Music]
just not even your car either okay
there's probably some bug
okay that one's a remote control and the
chicken image
is a rose hip
maybe we shouldn't do these
you know it gives the same answer
the fact that it gives the same answer
though is actually kind of nice
just get the same answer for this one
too even if i don't pre-process
no no that one's a flagpole
i mean it's possible that i just have
the order wrong
or it's possible that any one of my ops
is broken
could be any one of them which one is it
could be any of them
i can't run that model in torch so
that's out
list has no object pad 2d
oh did i make another mistake
no that's right
ah
n p if length of n p equals three
oh okay i mean it's just that
okay
running
wait i don't like that
did i break this
no
[Music]
it seems right it's just this kind of
weird
uh running
resonant onyx
all right let's find the bug
which one of these is likely to be
broken
batch normalization
mean var weight bias apps
uh
print
and
spatial equals one that's probably right
momentum's only for training we don't
care about that
gamma and beta which are effectively the
uh weight and the bias right
that's what i'm passing in
running mean running var that's what
we're gonna use and uh
i probably should change the order of
this to match that
and then do this very carefully down
here
let me see i'm still passing
cool seems good ah
okay
wait
bias
mean
var
eps
that seems right actually
i don't think my initializers are wrong
it's possible my initializer's wrong
here
we are just getting float
data oh
reshape tensor that's probably right
buffer parse again probably right
[Music]
flip
batch norm
function
from
plt uh import
pipe
how i do this
see if the categories are all over the
place or it's in just one
they look kind of all over the place
i thought the max was
oh there's a few that are higher i i
don't really get this
that looks decent let let's put in
random data and see if it looks the same
yeah random data has nothing
okay that kind of makes me think that i
just have my uh
my things ordered wrong
because that looks pretty confident that
it's one of those two labels and i know
there are two labels in image that
there's one that's a uh
hen and one that's a
chicken
again this one's pretty confident in one
thing it's just not it's a flagpole
so that
lends toward the belief
that it's just one
thing
we're doing
arg max which is right let me just check
the uh shape of this should be 1000
okay it's one thousand there's not like
an off by one error
um we can find a test
in
the result
model file path great show me
uh
that's a weird input shape good thing
it's not mine
do we check the input shapes
there we go
uh running a resonant
it seems like the same preprocessing
we're doing
also sort them
[Music]
it shouldn't matter if i do a soft max
could the order be wrong
wait
oh my clip-off is not working
he needs to add max after subtracting
for the relu up
are you sure about that
i don't think i'm using the clip up
either
no i don't think i do
no i don't
i don't think he's right
my test passes in fact here i'll show
you something we can try it
uh let's do test ops test ops test clip
okay so we have a test you say i need to
subtract you see i need to add max here
all right i assume that's the fix you
want and the test fails right because
i'm right and you're wrong uh and not to
be mean but uh it just looks that way
and if i'm wrong about anything else i
mean clearly i'm wrong about something
but i don't think i'm wrong about that
you can't tell some people they're right
and some people they're wrong everybody
lives their own truth
hmm
it's pretty confident that it's a rose
hip
oh i'm just saying
okay wait
is it possible that my
they do link to this which i'm pretty
sure is the same one i'm using
we can check though
yeah
looks the same to me
yeah okay
have you verified the pictures after
your chicken
i have
don't you want to verify some chicken
oh do i have to permute the axis in
order for this to work i don't know if
we can just do one axis
the image is indeed of a chicken
this could just be one of my ops that's
wrong
nice chicken right
okay should we try to find uh some
non-terrible
uh
i mean try to find some non-terrible
model that doesn't use batch
normalization that will actually load in
uh
the thing
max pool's probably the sketchiest thing
i wrote
we do just have a global average pool
there so if i got it wrong it wouldn't
actually say anything
hmm
now it's a groom
maybe this isn't right is that not
no that should be right you just do it
normally and then you stride
all right we should check if strided max
pool works
we should write a task for stride in max
pool
either way it's a nice thing that our
library can support
[Music]
now let's eat the last rag anymore
all right one last oh yes
all right let's try to find a less
stupid model remember you know different
supply coach there's a waste of time
there might be bugs but
yeah i might be able to make something
output one op at a time well i could i
can't get onyx runtime installed on my
computer though
i mean that's a real thing to do here um
[Music]
all right let's see what other models we
got
alex net
alexa is so big alexander so many
weights
oh not vgg that's too many weights
caffeine at
rcnn
densenet all right let's try den snap
seems pretty good
that seems small
um classic mistake
blob change blob to raw
oh this one has dilated calms
we're going to have to support dilated
calms
efficient net light v4
efficient net you you always come
through
all right what junk is in this model
let's find out
op type transpose not supported okay
that one doesn't seem too bad
let's see if there's tons of other crap
we can support transpose that's just a
reshape
local variable rat reference
okay all right there's just nothing
called group that's okay
[Music]
um okay
unsupported transpose
oh okay
we'll support transpose that's not a bad
one to support
we support that up already pretty much
it's so easy to run the open pilot model
now it's hard
okay
uh local variable r because it's called
opt
transpose perm okay this is actually
super easy we can just say you know what
i'm actually gonna even put this one up
here with the easy simple operations not
down by max pool which is terrible
uh opt
dot
permute
uh
[Music]
now sorry it's in p dot per mute op sub
perm
great
measure arrays can be converted to a
scalar index because we have to say
that one is a uh magical op
i really got to fix that bug too you
have to put in the kw arg
here
or else you get this error and it's a
totally useless error
all right all right
okay
average pool squeeze and map all those
seem okay
i don't know why map mall is unsupported
oh because it's called gem
oh they have two names for it oh that's
great
okay
which which net are we trying to make
work
efficient net oh we love efficient nuts
okay one supported type average pool we
can support that
as long as it's not stupid
okay strides one by one
kernel shape
um search
on sub strides
and we can just do
red dot
average pool
sure
division by zero
no
is my shape wrong
i'm going on a gpu for speed
what
huh
i'm not even gonna go there
oh wait but actually that's an
interesting
that's interesting first off that's
wrong
see what i got wrong
uh it goes way up
oh
oh one of the columns has padding
gotta support
padding okay i did support pads though
it's just wrong
here's zero one one
the pad's in a different order i think
they might be in a different order
um which is all fine
okay cool
one supported one squeeze squeeze is
very simple it's just a reshape
there's so many names for the same thing
and you you kind of wonder why onyx does
this
it's really very non-minimal
we're going to replace onyx we're going
to replace onyx with better onyx that
only has seven ops so we don't waste
tons of time on all these stupid ops
okay axes equals two and three
um
so in p dot one dot shape
uh enumerate
uh for i dot sn
uh if
if i not in uh
ops of what is a stupid thing called
axes
ah
rat equals np.1 dot reshape
tuple maker
s
okay unsupported type matt mall because
matt maul is just
or
in
gem
matt mall i'm sure they take slightly
different arguments and do slightly
different things
but we don't really care let's try it
not enough values to unpack
expected three got two
okay that's fine i'm gonna do the same
thing we do here
and why i called it a we can call it the
same x that we called it here
[Music]
just fine
here trans b
ah
if
trans b
in
oct
oh good thing these matrices aren't
square because if they were square you'd
never get that right
you know
uh none type has no reshape
oh
yeah
b is none
else
that equals x dot
[Music]
should we actually just make linear
support
okay op type softmax is not supported i
think that one's pretty easy i have
softmax
activation functions
here
okay great
ah because that's not the name of the
output
keys open doors
uh soft mag zero
it's a lighter
oh something's wrong
something's wrong something happened
here
is my broadcasting wrong
i think this is a bug in my broadcasting
that's interesting
yeah you see the problem
that's weird broadcasting it shouldn't
actually be supported
i just shouldn't be supported
okay well it's still a lighter
not a chicken
so much for chicken
but it's interesting that it didn't work
on the gpu so that's probably
uh
a key to what's wrong
let's see if the car one works
this is also a lighter okay so this
seems to work worse than
are we getting nans i feel like we're
getting nans
i don't know why the yard max of nan's
is no we're just getting tiny tiny
numbers
or tiny numbers
the numbers shouldn't be tiny just the
grad should be tiny
uh i think it's because the initializers
aren't actually working
we know that when i say gpu equals one
and we get some error
incompatible constructor arguments
move data
the following arguments are supported
everything is lighter
yeah so there's some serious bug there
let's see what's going on
so i don't understand what could be
wrong here maybe shape
ah
okay um
well it should be okay
uh also i hate nv.prod
oh did that fix gpo
okay that fixed gpu
okay so we have some other problem now
[Music]
it was because he was returning afloat
hope the streams are going to be regular
you can't influence my behavior with
subscriptions you can just gain my
appreciation
that's how it works
uh because if you could influence my
behavior i'd be a whore
and uh i'm not
all right it all looks good now
what could be wrong
[Music]
seriously
oh great they still have batch
normalization so i can't even run this
with uh
with torch to onyx
um
but we are we are implementing more
stuff which is good
we're not testing it which is bad
but it's getting implemented so
ah okay it's not blob it's raw why can't
i run inception again
dilations
google net plus
inception plus dense net don't work
without dilated convolutions
uh
alexnet is like the most og basic
bullshit i understand that it's big
but let's give it a try
hmm
even alexnet has dilations great
oh wait actually there's a chance they
don't have dilations and it's just uh
let's print that
and just like equals one or something
oh key error dilations
uh
okay
i don't even know what an lrn is
local response normalization okay maybe
those other ones were actually fine and
they didn't actually uh
they didn't actually require
they might not have actually required uh
dilated convolutions
okay now we have a new problem now this
needs lrn as well
what is lrn
that's the weird normalization you
mentioned what is it
i've never even heard of this
how far back does it go
lrn
it normalizes over local input regions
what
since version 13
i just changed it version 13.
inception doesn't have this this model
is the same as googlenet
maybe dense networks i believe in
densenet that's pretty new
i should probably like
add multiple tests for these and just
comment out the ones that don't that
don't pass
uh there's ways to like parameterize
tests with this
no that's not what i wanted
if this one doesn't work
i'm trying to find one that can work in
both pie torch and my stuff
what
this is that same problem
you can't just do that
you can't just have a maul and i guess
if it's equal to one of the shapes but
that's really bad behavior
maybe uh
there's some
operation
oh access and broadcast one oh okay
ah
yeah okay fine
hmm
uh
okay
one for
x in
uh
range mp.1 shape
ah
new shape
a new shape
sub
arg sub broadcast
equals minus one
uh
input equals mp.1 dot reshape new shape
it's called opt it's not called arg
uh tuple object cannot be interpreted as
integer yes because this has to be a
range length
um
okay well
um
yup that's that okay
okay
uh binary op on broadcastable so this is
actually has to be in all of them
um
in
add
sub
small
um
if n dot of type
equals equals mole
sub
all right uh strides is not that is but
it's because i just don't have strides
or because there are strides and i don't
support them there are strides and i
don't support them okay well that's nice
um
try this trick again
ah it does not match the weights
because i did not set chan
i should probably add that to tiny grad
okay create buffer failed and valid
buffer size
uh
different problem
okay division by zero
i don't know if any of that stuff's
right
why don't resnets work res nuts were so
close did i fix enough bugs that maybe
they'll work now
thick values object is not subscriptable
all right we're back to rosehip do we
get rosehip on the gpu also
we do
which makes me think it's not uh not
with a torch
yeah
it's probably right in some way
just not
[Music]
are the shapes right
i feel like they're not
okay
there's got to be this max pool it's
killing us
by three max pools tried two
oh
it is totally wrong
oh my god how do we not support strided
max pools
this is totally wrong
oh
yeah you can't just do that
most max pools have the strides the same
as the kernel size yeah you're right
that's the problem
jason heck you're right
this stuff's all wrong man this is wrong
too
yeah this it's the default stride is not
one by one the default stride is the uh
the uh
fine
all right all right nematode round worm
that's something
this now did something too
use an average pool somewhere here
ah okay
a search
opt kernel shape
equals opt strides
okay
uh
we're getting round worm now
and it's supposed to be a chicken how
about for the one that's supposed to be
a car
that also gets this round one which
makes me think there's just
more serious issue effort
yeah there's got to be a more serious
issue
okay we're left with the same max pool
crap again
if i did that right
let's get rid of those plots for now but
not helpful
um
where's my max
pool okay
a certain kernel shape equals strides
okay we hit a max pool and then we can't
do it anymore and the dense nut has it
too
ah
maybe resident v2 doesn't have it
everyone got rid of max pools right no
one thinks max pools are cool anymore
right everyone knows they're not cool
no max pool
watch it yeah
okay a different problem
cannot reshape array of float all right
all right let's uh because there's no
float data here
okay uh let's do
let's do this a little bit differently
okay well this one requires
reshape adder tensor uh not image sorry
wow we actually have more viewers now
okay
data type 7 it has n64 data
everything is float32 in tiny grad
okay we're back to the max pool again
okay the resonant v2 also has a max pool
strided max pools
well that's why they don't work
could this cafe one
could this one work
come on everyone knows cafe doesn't have
max pools does it
max pool
all right no resnets
alexnet has lfn
[Music]
we could try to implement that stride
wait some childish shit bro get banned
from my channel you don't read you get
banned you sub you get banned that's
life
some childish shit i'll show you some
childish shit get the fuck out of
here all right cool
um
all right well that's that has a
stratomax pool
shuffle net
oh yeah look i believe in shuffle net
boys it's gonna be shuffle net shuffle
nut is the one
no one will put any max pools and
shuffle that everyone knows they're slow
[Music]
okay this one has a batch normalization
but does not specify an epsilon is there
a default epsilon
oh
if
epsilon
in off else i don't know one e minus
five
does
on x really
specify
uh
default x
max pool
oh come on
why is everyone using these max pools
are they good
they can't be good
they can't be this can't be like oh yes
we really need max pools
no max no max pool oh they did not get
rid of the max pulling veto
okay
zfnet
well that's a really big model
okay efficient nets don't have the max
pool we know that they just don't work
actually we don't know that
because now we've learned
they all use it no efficientnet doesn't
use it
oh
but down here it does for an average
pool
strides one by one
i don't even understand that
four up dot strides equals one one
that's probably fine
because that should be a global max pool
which is good
okay we're back to having this problem
with add
uh how is that
that should be illegal
i committed since then
i haven't committed forever
if
while i delete this i thought that that
would capture it
if length of
p1 dot
shape
equals equals one
[Music]
uh
yeah okay this is a torch problem too
i've had exactly this problem in torch
um
[Music]
okay actually you know what now
uh
from
tinygrad.helpers import prod
there's a better way to write this
if
prod
length
[Music]
okay this is only lighters
uh yeah i mean no max pool and batch
norm would be nice
spatula doesn't work with the torch
thing so we can't validate it using that
do all of these have them
just squeeze not use max pools did we
try squeeze nuts
we did not
no strided
max pool
see you might think that i'm doing
nothing right now and i'm just like you
know
uh
like copying and pasting things by hand
but i'm learning did you guys know what
a squeeze net was i've never heard of
this thing
you know we're learning
uh max pool great
did you guys know that they all had max
pool see i'm never going to forget that
they all have max pools because of how
much this annoyed me
yolos
super resolution
machine translation
okay vgg does this one use max pool
it's so big
it's so big oh my do i really want to
waste half a gigabyte of my computer on
this
not really i don't really care if it
doesn't max well not wasting half a
gigabyte
too big
we have max pool we just don't have
strided max pool
how did my resnet implementation deal
with this and this is why it doesn't
work
it's probably because the resonant here
doesn't work
yeah i get it i
you know what
how much wrong could it be
if i get the rest of everything right
i think that's probably going to be kind
of right don't you think
binoculars oh
i'm like okay it doesn't actually go to
three
umbrella hey
hey could everybody say
what's it supposed to be the car i don't
trust the car let's see if it works with
the chicken
chicken's very reliable
eggnog
now the problem okay
i'll explain the problem with max bold
it's not i support max pool and tiny
brad i don't support a stride at max
pool
um there's a stride of
two
oh i don't know how
what is the efficient network
chicken plus egg equals eggnog that's a
good point
all right you know i don't like these
models anymore
onyx efficientnet
why doesn't the efficient network it's
the only one we found without a max pool
it runs it just tells me that i got a
lighter
there's my clips
there's a lot of clips in here too
which make me suspicious
those all look pretty good
why does it always return the same thing
even if i put in random data i get a
lighter
does this look similar to my problem
i doubt it
no no no no
the the problem is i know exactly what i
don't support okay so
look up what a strided max pool is and
that's the thing that i don't support
uh
let's print the tensor
because i find it suspicious that i
always get lighter
why are there so many zeros here
there's too many zeros here
yeah
there's too many zeros there
batch normalization is it wrong
let's just try this
some chance it just works
okay now we get nans
i don't really know how we get nouns
okay
maybe there's a bug in batch
normalization
hmm
fused batch storm v3 read variable off i
don't trust anything that uses a tpu
let's read the documentation for batch
normalization okay
batch normalization
depends on the input being run
attributes input okay
scale
scale
bias
mean
var and epsilon
no it seems right
okay the gpu thinks it's a lighter two
so that's good
we don't know maybe there's supposed to
be that many zeros
we must be losing all the signal
somewhere
okay zero
let's see how different they look
they look exactly
the same
oh
oh
oh this might have been really dumb
oh we might just have to make sure we
put an actual image in
oh this might have been working for a
while okay come on chicken
uh okay now just a shape strong that's
fine
uh
permutes
uh
was np.mute
numpy transpose axes equals none okay
wrong input shape okay um
what do i do
i want that shape to go there
oh two three one
i just was no i just was setting it to
okay it's a television now
that's better
how about the car
it's amazing a labyrinth
well at least we're getting different
things oh i can't believe that what a
waste what a waste of time all right
let's see if we have off by one hours
now
i mean it is kind of a television don't
you think
no it's not that we can't implement it
well
that's kind of cool
if you're interested in implementing the
max pool uh try it
i'm actually gonna put uh an exception
here because that would have wasted a
ton of time
um
no
okay you see what i what the
input was called something else
all right now this is a long shot but
there's a chance the resnet's actually
going to work
as well if i just use a less uh
it doesn't want to be transposed
oh no data for data okay that one
actually probably was working
it's just called something else
it's called something else and it thinks
it's a television system
all right let's take a look
wow it's really confident that it's a
television system
which makes me think that the labels
just might be in the wrong order let's
check on that again
you have to get everything right to make
things work
fishing that light for
labels labels.map
where is labels.map
television television system ah
i mean it looks kind of like a
television right you just gotta squint a
little bit
should we not be doing the
pre-processing on this
so there's different pre-processing for
this
is it close enough
i don't know like that stuff can break
everything let's try it
test efficient
i hate that color
hand look at that
oh it's a little hen
oh yeah
oh yeah that's right
that's
right all right let's get rid of these
pre-processes you're going to have to
import pre-process
uh old equals true
uh now we'll say new equals false yeah
all right if new
do this
otherwise
do this
[Music]
[Music]
we need to throw pre-process in here
uh image equals pre-processed image
and we need to import
chicken image cartilage pre-processing
labels we're going to say pre-process
uh
new
equals true
there we go all right let's make sure we
can break the other tests
no no my text file is good don't worry
all these are pretty constant alright
cool look at that and look how confident
it is about it being a hen look at that
level of confidence
uh i could set that to false
all right you all ready for the second
test this one we're gonna try blind
if i change chicken image to car image
is it gonna tell me car
oh yeah
oh it works look at that look at that
look at that
boom
and efficient that's not even that large
no
many
onyx models can't be run right now i do
choose
max pool with strides not equal to
kernel size
that's probably why my resnet doesn't
work also uh let's add a few more
asserts
labels.class equals 10
assert
uh
car in
okay now it's a test
all right and that's where we run it
with the torch back end let's run it
with the cpu back end
and i'll start with the gpu back end
there you go
by the way how fast is that gpu back end
right
[Music]
why did i change
test onyx works
with e-net also
all right let the non-subs talk for a
little and then i'm done
it's pretty good
pretty happy
we got a fishing nets to run we found
out why the other ones don't run
there weren't too many bugs we wasted a
lot of time because we weren't actually
putting our image
in um we would have got that one much
earlier
what was the second bug oh yeah just my
pre-processing so we had the
pre-processing and the fact that we
actually weren't uh
putting in an image that's junk
have done that
all right cool
no non subs you're a sub i mean you know
if you say no non subs and maybe no
nonsense
all right so to recap so everybody
understands what this is
uh
this is we're running an efficient
efficientnet lite4
using our homemade onyx conversion layer
we can also run the open pilot model and
compare it to torch and that works well
we can run all the tests
so this is the openpop model
and this is the uh efficientnet so it
supports both of those models
and yeah we did it without having to
change much of tiny grad the only thing
that we're going to have to deal with is
those strided
pools
i have to think of how we want to deal
with that
that very sadly maybe you have to be a
new fundamental operation
uh for
tiny grab but i like this idea of just
going through and supporting all the
models in onyx
because then i don't have to spend a lot
of time writing them right like
one way to
check if your neural network library is
is
it's kind of like a compiler right this
thing's really a compiler what i'm
writing and
when you're writing a compiler it's
really hard to write tests
that don't look like here's a ton of
possible inputs just see what it does on
all of them
where do i implement conf today
okay so i'll show you
so this is the ml ops layer uh oh
there's some there's a little bit of
indirection
which is a little weird yeah that com2d
is actually being
uh registered down here
uh this registers all the mlops math
operations
yeah i'm sorry that's a little confusing
so you'll find com2d here
right
so this is the implementation of comp2d
you see it's actually really simple this
is the forward this is the backward and
then these processing ops
are what actually runs on the specific
accelerator so if we go into op cpu you
can see that my processing op dispatcher
is here
we have the three the actual code for
the convolutions here
um in gpu it's the same thing there's my
dispatcher i just wrote this dispatcher
this morning i'm going to clean it up i
really want to refactor these kernels to
use way more similar code there's a ton
of wasted lines here
when i figure out how to how to do it
exactly and then this is the torch one
uh so the torch one's a bit more
refactored
uh it has a simpler processing op this
is the conf t which is a transposed
convolution and this is the weights and
the reason that there's three of them is
because you have to compute both the
gradients
uh any other questions from subs
how about the non-subs can stand here
and watch while the subs get to ask
questions even if they're slightly off
topic
my gosh thank you for subscribing
tier one for three months in advance i'm
sorry if i don't stream and let you down
oh the land i don't really want to talk
about the land
i don't want to talk that off topic
i'm talking about ml
uh but don't worry that's exciting it's
acceptable as a question
uh so you're using convolution now but
wanna do pooling no bro no
okay the problem with the pooling and
let's see maybe one of you maybe this is
your call to action and you can do
something about it you got to do it
beautifully because everything in tiny
grad is beautiful robin brinkler thank
you for gifting subs my gosh thank you
for gifting subs i appreciate you
um is really optimizing the winning
strategy i mean yeah right so i'll show
you something now
all right so let's go to test resnet
here
and i can do all of all of tiny grads
and icds work now so we can like do
print ll ops equals one right
this prints all the low level operations
that are actually being run
and the low level operations are very
simple so you see here where it's doing
all these like binary ops and unary ops
uh
even going back to this reshape and this
wow this slice does absolutely nothing
you can see it's trivially just nothing
this is a no-op right there's no up
right now is making a copy
uh that one's not
nothing but that one's something
uh but this is a no-op right
all of these ops
between the two confs
um can be folded
into uh
[Music]
can be folded into into one thing
so we'll we'll do that we'll just we'll
just fold it down
uh like we can come up with because this
intermediate layer is so simple we we
can do really fancy optimizations on it
because it's really simple to specify
what the full behavior of it is right
it's really hard to specify the full
behavior of onyx because it's really
large
there's a ton of operations they all do
different sorts of things
but once you get down to just this it's
like okay well we know what add is
we know what sub is we know what relu is
and even the broadcasting is very simple
here there's no there's no ambiguity in
this interface you know what you know
what you could think about it tiny grad
is a risk instruction set for neural
networks
right and it's a compiler it's really a
compiler um you have multiple levels of
operations and this is the uh this is
like the lowest
uh
level right before the assembly and then
the thing is outputted to assembly it's
a compiler right
um
so yeah all these operations are
effectively one thing and in fact you
can do even better
they can all be folded into this
convolution here
uh some of them can be pre-computed
right so you know in your compiler if
you're compiling any like compiled
language and you write like a equals one
plus two it doesn't actually save one
and two
the compiler does the math gets three
and sticks three in in a
uh and that's all done uh you know
before
compilation so sorry that's all done
before runtime so that's all done for
you for free so we can do similar stuff
here uh with with neural nets
i don't know how that's supposed to work
oh this is just a
okay
that's annoying
i mean it's right but
this is just a single value so you see
what's what's getting added and
subtracted here is a single value
um
yeah and the right sort of compiler can
configure this all out
uh and optimize this
all of this can be optimized into one
thing and then basically all we're doing
is conf
comp
uh yeah
and this can work also with the backward
pass right there's the things that you
actually care about in the backward pass
and then there's the things that you
don't
uh you can fuse relu and batch norman to
calm but only on inference
well you can certainly do it on
inference
but
i'm not even really thinking about it
like that right like do you see any
reference i mean conv is referenced here
conv is a really fundamental operation
but there's nothing at all fundamental
about batch noir
batch norm is just uh
yeah bachelor was just a bunch of ads
and stuff
i was just i'm sorry i paused for a
second to think about why we're getting
real use there
these might be clips
this might be my weird implementation of
a clip
which is fine
because it'll all get compiled
like all of this stuff
uh probably yeah up to the conv even
will get shoved in one cuda kernel
slices no up
one cuda kernel
and then what you're doing and i did
this all by hand with need
your
you want to optimize all this stuff
such that you get
the fewest kernel dispatchers are
surprisingly expensive uh with gpus
uh because it's not the gpu that makes
them expensive it's a cpu there's so
many mallocs in the driver to do these
dispatches that a lot of your models
especially if you're doing small batch
size
stuff
um
you're limited by just literally how
many times you can call a coup launch
kernel
from python per second
so
when you fold this down to less kernels
and you do this all offline
hal rootin thank you for gifting subs
um how do people decide who to get the
substance
ah
see i stay on now this is this is when i
so i rake in the money
and i rake in the money you know i
bought a tv tuner
i bought a tv tuner because eventually
we're going to pop all the way off the
stack and we're going to train tiny
voice and tiny brad with tiny cuda and
it's going to be tiny fast and i want
some thin mints but there's no thin
mints in the box
um
oh you have the option to give to random
people i say
cool level four hype train that's that's
maybe the highest i've ever maybe i got
a five once
killian d thank you for gifting subs
ah tiny is fast
this is gonna be so nice when this is
all like oh just all these permutes and
reshapes
like oh it permutes that that's
not even a permute
all right like that's a that's a no op
permute right there look at all these
stupid
that must be on a different tensor but
look at all this
this is this is all no ops
why use onyx instead of directly jitting
from pi torch uh well no i mean i'm not
using onyx i'm just reading in a bunch
of onyx files one of the problems with
pi torch is the pi torch files don't
contain how to run the net the pi church
files just contain the weights
um
so
yeah the pi torch doesn't actually
contain the uh
the
the net like architecture
pretty nice
go through look the first thing it does
is a permute
a slice a conf right this slicing comps
this is a this is a padding operation on
the convolution
um which is why we don't put pads
actually in our thing because a smart
a smart
jet will just fuse those
right this reshaping this ad i mean you
don't really need that right
but again
all this
stuff oh that
even that maybe no maybe not that
all that can be fused
haley rooten thank you for gifting more
subs
you're the biggest who's the biggest sub
gifter in here
um
chad paul's due to scroll
so yeah we'll we'll
wait
is this like frozen
my twitch froze or something
i understand how
safari froze
and just twitch froze
i'm going to close this and reopen it
uh
that's back
whoa level five whoa
uh
why pi torch can't load onyx models
that's a good question i don't really
know
some guy wrote something that kind of
does it but
um i mean look i don't blame them it's
onyx says they have like two names for
map malls and stuff
yeah
um it's similar to what xla wants to
achieve yeah but have you seen how many
ops xla has xla has so many ops right
like it is like xla but it's like tiny
xla
i think no i was talking one of the
tensorflow guys and he says i wasn't
right i thought xla had like a decode
jpeg
um
so close to level f wow wait no we're at
level five
we we we can get super gamer or prime
sub does that help the hype train
uh jam isn't matrix matrix and matmal
isn't matrix scalar
oh i think you're right
i think you're right and i think that
explains i just added support for that
i hope i didn't break anything when i
added support for that i just added
support for uh
matrix scalar in my dot it should be
okay i can't imagine when that would be
wrong
um every sub and bits helps the hype
train even you know i i think you're
right
uh i don't know it doesn't matter
i just added like support for both but
the the beauty of tiny grad isn't the
crap intense or not pie
it isn't even any of this
it's this interface
it's that all
operations can be broken down to these
very basic things and then fused at the
latest level and i'm not gonna it's not
a compiler you're not gonna have to sit
there and compile things it's a jit
all right so basically the way i'm gonna
make this work is tiny grad's gonna be
lazy
it's not until you call dot numpy on
something that it even like
pi torch is lazy in the sense of it
won't it'll link you the things to cuda
but it won't wait on the cuda queue
i'm not even going to have in cue a to
cuda i'm just going to cache it locally
and then say
okay
uh
time to run
all right
and it will only run exactly what we
need so you can do
cali rooting wow more gift subs
uh
you get a special request i'll i'll
answer whatever question you want
if you if you have any question uh
i'll i'll i'll answer it even if it's
very off topic even if it's about
whether my you know right ball is larger
than my left ball i mean i'll have to go
measure but
uh i'll answer that
uh level five complete wait is that it
is there a six
final level i don't know if i've ever
made it to the final level before
oh good oh i'm glad you i'm glad you
enjoyed this stream
um
yeah i think we were pretty productive
we got the old pilot model running in no
time and then we had to deal well i know
the open pilot model really well too
which is kind of what helped
um i don't really know about these max
pools we don't use any max pools in the
open pilot models don't worry
um do you trust max pools to drive your
car i don't
aaron fam wow
wow
wow i like this competition man this is
some real cowgirl shit right here
oh did you want a question
bra
bra it's wild right now
it's wild we we just won twitch
uh
i appreciate most of you
uh
this is the highest we've ever got yeah
32 subs
wow
cool
yeah i hope people learn something
uh strategy max pool pretty easy by
basing the implementation their
convolution operation yo i think you're
right
i think you're right i think what i want
to do is uh
yeah i'll have to think about it
i'll have to think about it more
i mean that's probably what i should do
in fact the way that i'm doing the max
pools and average pools right now
probably i should just replace them with
convolutions
i should replace a lot more things with
convolutions and then just work to make
the convolution app really really fast
i'm like whenever you have a convolution
followed by a couple of stuff
that looks like this you're going to be
able to fold all of this
into the convolution
um and like depending on memory access
patterns i think you'll be able to fold
it all on the backward pass too you'll
also be able to fold in the optimizer so
there's these kernels called the fused
atom kernels uh that you can get from
nvidia if you download apex but i don't
want to have to deal with that i want
the kernel fusion to all be done like
right here
um at this
at this really low level
yeah and then we can figure out how to
make these kernels super super fast
someday we'll do that
we've got to implement the laziness
um
it's called a ground graph
and component right
compiles the graph you'll do these kind
of transformation operations on the
graph
uh until it folds it all down into just
like six ops six kernel launches pew pew
pew pew
but a convolution is a linear operation
and a max pool is not right
uh yeah well no okay the max is yeah so
the pool part can be done with the
convolution and i'll do the max
afterward
i think i'll just use the comm to kind
of like pull out
all of the uh possible channels for the
max pool see what i'm saying
so i can use the column to just like
extract the channels and then i can do a
max on it
and that will be uh
will be fast
and the average pool i can straight up
do with a convolution
average pool just is a convolution right
uh implementation will be almost the
same but you replace the dot product or
the max well that's if i want to change
the kernel
um which we could do which we could do
but probably more what i want to do is
replace max pool with a convolution that
extracts all the things then does the
max
and then uh
yeah yeah that sounds better
yeah you'll see that i have something
that actually almost looks like a
convolution
you know what if one of you wants to
write this i think this is actually
quite writable all right so you see my
pool 2ds
it's it's using
um i'm using a slice and a reshape
all right i'm using a slice and a
reshape and then i mean in a max
but uh i think this
base pool 2d i think this can be
replaced with a convolution
and then
this mean and max will just be across
the channel axis
not exactly the channel axis but it's
something kind of like that
right
you should pull 2d and for average
actually for average i don't even need
this mean here
for average i'll just replace this with
a single convolution
i will just put them all into one thing
okay but that's for another time
um
thank you all for watching today
i appreciate most of you
uh except for the
haters and the losers is that what you
say appreciate everyone except for the
haters and the losers
uh
yeah i can make a generalized uh yeah
for applying a function on sliding
windows and that's kind of like what i'm
thinking of doing i mean that's what
like pool 2d kind of is but it's limited
in how
this function is the reason that you
can't have strides because it's limited
like it actually takes the values
um instead of
fuck convolving
haters and the losers yes all right
bye enjoy
hello hello hello
all right we got the good mic on
see if we got the good mic here we got
the good mic we got some some lighting
that light's brighter than
it looks pretty good all right like look
I got that warm glow about me guys it's
all lighting right you know what I mean
if I want to like look pretty on stream
I really got to get that good lighting
what up maybe rat
let me pop out the chat
uh
uh this one yeah there we go
good morning good morning
give everyone a minute to get in here
Alex is really a wonderful girlfriend
she got me highball
the first set of groceries came and
there was no football
and um this was upsetting
because I wanted eyeball but then the
second bunch of groceries came and it
was highball
uh oh yeah
so I don't know why no one's here yet
but I'm sure people will be soon today
we're going to see if tiny grad can
whisper
uh oh I can show you guys this
this
is a motherboard straight from uh
Taiwan
ddr5
uh epic uh Genoa
uh and it's got a bunch of these slim
SAS connectors on it this has uh
seven pcie Gen 5 ports
so yeah fresh out of fresh out of Taiwan
oh shit but those are mcio connectors so
I'd have to get the mcio to the slim
sass oh and I gotta order some more slim
SAS cables
um
all right so that's that uh we've given
up on AMD we've given up on AMD I I just
like you know I just I just realized
like that when I was interacting with
these people that I've been talking to
them and uh I got you know nothing
useful
like I got I just got people talking and
like
literally like they're debunking
information was less than useful
you're better off just like reading the
forms right
I don't know how these companies become
so dysfunctional I sent an email to Lisa
Sue I I haven't heard anything back
uh you know I don't really um expect
very much
but uh amd's drivers are completely uh
they're complete dog shit like and then
like they send me like a patch here here
uh I'll I'll show you I'll show you the
patch that was sent to
uh I'll show you the patch that was sent
to me
oh I just purchased two uh RTX uh
two RTX uh
30 90s
uh yeah okay so this this was the patch
you guys can like read it and just
I just want you to look at the structure
of this patch
and understand why this driver will
never ever be good
right
like the the as long as as long as look
I don't you know I don't need to pick on
anybody who you know but like
just just look at this commit
in restore process worker pinbo calls
calls update pte fail then the function
reschedule the restore work this will
generate dead Loop
oh God
yeah
right oh just check the attachment Bova
this driver will never be good
wait
um let's let's find a good driver right
let's compare that Nvidia doesn't do
public patches but uh
let's look at the history on on this
okay
so
this has no effect this doesn't this
isn't like a bug or anything right so
let's look at this command this is a
commit on the uh on the Intel driver
right this this this is not a bug at all
it just literally talks about kernel
taint
right
and there is this much documentation on
this
right
this is the AMD one
this will generate dead Loop
first off I've never heard the term dead
Loop before
second off like you have a serious major
bug fix
that that went from crashing the kernel
to not crashing the kernel and this is
what you wrote about it like do these
people really not understand what clowns
they are I'm sorry like I'm just I just
it just really it really pisses me off
it you know it pisses me off that I
spent three thousand dollars on these
graphics cards look I don't care guys
I'm rich I drive a Rolls Royce but you
know it just pisses me off man
let's let's read another one here let's
see if we can find any that even come
close to like
maybe this fixes a bug
okay
okay
um
a minor refactor
again these are pretty minor fixes
right notice how none of them
no look at this remove additional three
flags from pipe control although we use
strip 3D specific flags from five
control instructions when submitting to
a compute engine there's some additional
flags that need to remove when the
platform is a whole lacks a 3D pipeline
add these platforms here
and then yeah it explains
what it does
compared to this
um so yeah uh I've just given up
entirely on uh on AMD
I think that what we're gonna do is
we're gonna sell three editions of the
Tiny Box we're gonna sell the red
Edition the green Edition and the blue
Edition right
um and we'll also get a Max through
we'll also get an M1 studio and we'll
try to get all four of those things on
image the thing about getting things on
mlpark with tiny grad is if you can do
one uh you can do four it's it's very
platform agnostic and some will be fast
and some will be slow
maybe there's more in the thread
oh God
oh God
the same strapping initially like
[Music]
the driver will never be good
unless they like majorly change what
they consider accepted I think like I
was telling them like guys you literally
run your app like your demo applications
in a loop
and the kernel panics
or the GPU crashes
like like a fine the GPU crash is fine
that's your shitty Hardware the kernel
fucking panics dude like your driver is
so bad that it brings down my entire
computer
this this would not be acceptable from
from a a USB this is this is like some
like I bought some shit knock off of a
knockoff Chinese Shenzhen USB dongle
stick for eight dollars and I put it in
and I still wouldn't expect that to
Panic by Colonel does AMD have any idea
what clowns they are
right it's it's really it's just so it's
so upsetting and then and then like you
know I go I text I text my uh
I explained this to like my my contact
at AMD
sounds frustrating not sure what I can
personally do about it that but I'm
happy to keep asking I'll give you an
update this week if I can capture mind
share to support you are you fucking
kidding me you need to capture mind
share to make your kernel not panic and
this is not a bug with my system
multiple people in the Discord are
reproducing these same crashes there's
30 threads on forms there's here Reddit
should I buy
AMD or Intel for ML let's see if we can
find the thread
um
let me let me let me let me find it let
me let me I just like there's literally
there's a Reddit thread
sorry this is this is this is how the
stream's starting because this really
just this really just pissed me off
um
yeah
does it make sense to buy an Intel Arc
a770
by the way this is a crap a graphics
card that Intel is going to discontinue
uh if they haven't discontinued it
already it costs 350 dollars and you're
asking should I buy a 350 card for Intel
or a 800 card from AMD
I have abysmal Rock M support
my a770 does ML very efficiently
rather avoid AMD the constant driver
architecture issues I read Around daily
in so many forms especially on the 7000
series is just worrying I would spend
more and go for NVIDIA
get a770 it's future proof
you'll have to install these extensions
this is literally
AMD intelligence League like they had
three guys like you go make a GPU AMD
makes two products epic CPUs and Radeon
gpus and this is this is the this is the
level of clown shed
um oh I'll capture mind share to support
you okay okay you keep your kernel
driver broken uh I I just I I am so uh
I'm not asking for something custom
uh I'm not asking for
literally anything except you to be like
holy shit this is the top priority for
the entire Graphics division of AMD our
kernel our driver panics the kernel
foreign
by seven uh Winograd transposed
convolution is slow no this is well I
put two cards in the computer I turn it
on I try to use the cards and the
computer crashes
because I configured it wrong oh no no
no no no no I mean look shit guys if I
can't configure it right if I can't
configure it right putting 30 hours into
it what hope does anyone else have
you know
uh no I don't actually think you know
what but also Intel gpus how to have a
stable kernel driver their user space is
confusing shit the one API is
unbelievably confusing and this is what
I expected to find with rock M okay
um what I expected to find with rock m
is that they'd have a confusing user
space they'd have broken pie torch
support because you know they have to
communicate across multiple divisions
trying to get pi to our support for
anything besides Nvidia is really hard
look I was expecting all of that I was
expecting what I found with Intel's gpus
on AMD I did not expect running their
demo app in a loop to crash the system
okay I didn't expect that
let me tell you why you know what Lisa
Sue respond to my email look at this
look at this
here what's it's a famous story
I once called emailed Jensen called last
year and got a driver bug fixed in 12
hours you know
right this is this is 2021 Nvidia and
this is why they're the king
oh now
would I fix it when I fix amd's would I
fix would I fix it yes I'm happy to fix
it now
um
unfortunately there's no documentation
right none of the hardware I got fooled
by seeing the good documentation uh for
the uh
kind of hard to
find
the the
this is tricky to find instruction
manual
wow
no it's like really deep in there I mean
I'm not saying I'm not saying Intel has
a good website
but um
again I'll I'll bring it up because you
know I found it
um Intel offers basically full
documentation for their GPU
uh to down to a register map
you you can literally
here's here's a hundred megabytes of
documentation about the Intel a770
all right uh
a hundred megabytes of documentation
well every register is documented and
for instructions documented the copy uh
engines are documented the memory system
is documented Intel documented their AMD
documented their instruction set they
documented nothing else I've asked
multiple times is there any more
documentation no there's no more
documentation
uh so you know what short AMD guys I
mean I don't even know look I don't know
I'm not going to give you Financial
advice I'm just saying if you expect
these cards to be good for machine
learning anytime soon don't
um you know it's it's unfixable it's
it's it's some of the crashes are not
they're not things you're like oh George
the kernel driver's open source yeah but
the micro engine scheduler which fills
up its cue is not it's a binary blob
we're getting an error two for the micro
engine scheduler great
um yeah
uh
would people who work on Mesa know more
about these cards look there's probably
people out there who know about these
cards right but do I really want to
spend my time swimming Upstream against
a company who really gives oh they have
to capture mind share to fix their
kernel driver okay
is that is that someone like
I'm not even saying work with I'm saying
do I want to buy their products
right it's just it's just it's just sad
and like you know what you know what and
I I fall for this always over and over
again I fall for thinking that like
there's a reason things are the way they
are right there's a reason that that
I've never seen nvidia's driver Colonel
panic right there's a reason for that
and it's because they care
yeah there's a big mismatch between
their CPU quality and GPU I mean your
CPUs are great to be honest their CPUs
are great I mean you know they're
fighting against another
company that's unbelievably plagued with
middle management but Intel's trying to
turn it around I actually think the new
guy Pat is is trying to turn it around
at Intel
um I don't think anyone in the Radeon
division is is trying to turn it around
um the cards are beautiful look at these
Intel arcs
those are Intel arcs I can't show you
what's to the right of that because
that's a tiny box
and the Tiny Box is a secret
uh
uh Nvidia just joined the trillion
dollar Club you know what you know what
here's why here's why
okay
um we're not just gonna spend today
complaining I promise uh so I know
here's what we're practically gonna do
uh forget the get AMD on ML perf plan
we're gonna get tiny grad on mlperf if
the easiest way to do that is with
Nvidia we'll do it with Nvidia if we can
do it with with I'll buy an M1 Studio we
use that chip should be should be a good
uh
20 teraflops
um no but I just bought some 30 90s well
just she's 390s maybe we'll try to use
those Intel things unfortunately trying
to use the Matrix accelerators on them
like again I
look like I had the motivation to do
this like once you know at least Intel's
kernel driver stable right
their GPU is 350 and in theory it has
more FB 16 bf16 teraflops than amds
um
there's two reasons to use 30 90s over
40 90s uh one is that 30 90s have Envy
link so you can Envy link two gpus
together
um which gives you all sorts of uh
benefits you can basically like you can
basically just say it's like one GPU
that's twice the size in a lot of ways
it's not perfect but it's a lot closer
to that uh the other reason to use 30
90s over 40 90s is 40 90s are 1600 and
30 90s are uh 750. uh so you're paying
it is it is double the performance in a
40 90.
um
but not double the ramban with the
ramban was about the same uh and it's
not uh
uh you're you're paying with power
um so if you're trying to build a
computer that plugs into a single wall
outlet it matters kind of less
what do I think of Nvidia Oren I think
that it's incredibly overpriced scam to
sell out the car companies
um Nvidia makes one price competitive
product and that's their gpus
oh but yeah well we'll wait around maybe
AMD maybe they're gonna maybe they're
gonna maybe they're gonna capture mind
share maybe maybe in the meetings
they're gonna they're gonna they're
gonna well I think we should
we should or okay we'll fix the curtain
no they won't right
they need someone to show up at that
company to be like guys
we have two months to fix the kernel
driver okay and first off everyone's
gonna be interviewed all right we're
going to reinterview everybody and we're
gonna see if you understand like
you know how to write a good commit
right and why you can't go three
pointers deep write one sentence to
explain how it fixes a dead Loop
right
I I'd fire that person from com like
again I don't mean to pick on the person
it's the culture right it's the culture
yeah exactly
no seriously seriously
Lisa sue if you are serious do you
seriously want to compete with Nvidia or
not I saw some article that said you did
well do you or do you not
okay
um where were we oh we were gonna do
something today and not just be
aggravated
oh I think we made I think you guys
missed the doing things we did things
this morning we did things this morning
we weren't just aggravated all morning I
swear
you enjoying the aggravation all right
all right well
ah
three minute meditation
find a comfortable position and allow
your eyes to Blink low
will begin today by taking three big
cleansing breaths
let's take a nice big inhale through the
nose
side out
inhale through the nose
one more big inhale
and I'll bring all your awareness to the
crown of your head
allowing all the muscle to the crown of
your head to relax
and now like a warm liquid
allow this relaxation to flow downwards
into your forehead
your eyes
your cheeks
and your jaw
completely
relaxed
allowing all the muscles of your face
and your head
and allow this feeling of relaxation
to flow downwards into your shoulders
feel your shoulders melting down
flowing downwards through your arm
all the way to your fingertips
feeling both are completely
relaxed
feel your chest relax
your belly
your hips
and allow this feeling of relaxation
so down through your legs
to your knees
down to your ankles
all the way
to the tips of your toes
feeling both legs
completely
relax
from the crown of your head
to the tips of your toes
feeling your whole body
completely relaxed
it's a big inhale
write it out with its eye
Pig inhale
now let it all go
all right guys
uh
you know I don't know I wonder how much
I'm sure you know Linus thought about
this a lot I'm sure he was aggravated by
them
uh you know the code quality wasn't uh
quite where he probably wanted it to be
I remember some stuff around getting the
AMD GPU driver in the kernel but uh you
know
maybe ended up doing doing that is why
Nvidia ended up open sourcing their
driver
uh at least parts of it
so yeah
um yeah right now nobody said my chair
or dead Loop that's right that's right
that's right
you know but here's what I would
seriously do
um they're working on all of this user
space stuff right amd's working on all
these users based stuff why does any of
your user space stuff matter
one day
if your driver is not stable
right
it's like it's like great you're putting
together you know little intricate
things on a table but the table has
three legs
not like the good kind of three legs but
like the it's supposed to have four kind
um
there's a sweater from from Alexander
Wang it's it's part of their uh derelict
collection
and you guys know directly
you know what I watched last night She's
the Man starring Amanda
binds
um
yeah
internship at AMD
no fuck you pay me you know what I mean
like I respect Elon and you know what
Elon can do and like
uh what was like I'm just look I don't I
don't like I really I don't mean to like
hate I don't mean to hate on like the
people who work there I think it's a
really here's who I do me into hang on I
don't mean to hate on you're an engineer
who works there right A lot of the times
if you're an engineer and you're put
into it's the same thing with Twitter
right like it doesn't even matter that
much how good of an engineer you are if
you're put into a if you're put into a
culture of shit
well like you can't sound like you can
produce things good right I think that
what you end up doing is you just end up
getting like frustrated and then like
you know like if everything is just
you're having to like like like a if
you're working on a team
you bring your work up to match
everybody else on The A Team well you
feel bad right I try really hard to
instill this a comma right like like
mediocre works just not accepted I
replied to a guy's pull request I'm like
bro this code looks like shit and he's
like you know what man it does and I'll
fix it oh great you know thank you thank
you I try to hold myself to the same
standards
um so no I don't blame
um most people who work at AMD I
certainly don't believe blame like the
people who like push to the driver I
blame the middle management
and I blame the the toxic corporate
culture that allows for middle
management to thrive
um
but the pi torch team has done great
things yeah the pi torch team doesn't
work at AMD the pie Church team works at
Facebook
and like you know again I worked at
Facebook
my complaints about Facebook wasn't that
the level of talent wasn't high and it
wasn't that the code wasn't good it was
that the product was stupid
um
the talent and code quality of
Facebook's really there
I I still I still give anecdotes from
like things I learned at Facebook today
uh
at Twitter their code quality was not
there Twitter was terrible
um it was it was such a bad development
environment uh like I I couldn't believe
how bad it was
um but George we didn't stay there for
six months and struggle in it no see
this is the problem
people who were good just like saw that
and nope
nope uh
versus you know the kind of people who
show up today and this is yeah okay
I think Facebook's calling of middle
management is awesome I think you could
fire all the middle managers in the
world tomorrow and the world would be a
better place
a boss too yeah he really is he really
is he came out as like the guy like you
know like you have like like poor
Jeffrey Hinton you know I saw a tell a
joke and the joke
I I don't I
don't respect to Jeffrey Hampton I'm
just I'm just I'm just paraphrasing with
the news sad and look man if you don't
know how the CIA manipulates people
through the news I don't blame you for
falling for it you know
um
by
yeah
I told a funny joke it's got to be
conscious man
all right
okay uh let's whisper as a whisper is
released by open AI
um who you know look
you know my thoughts on open AI the
opening has a lot of very talented
people it's very talented people working
there uh
I think that they use AI safety
in order to uh generate hype for their
company
they they create fear and they do this
in a very substantial way they did this
for gbt2 you can see when they started
that
um you know you just have to not respect
people who do this right
like you can't have organizations
remember when they actually spread fear
like fud around gpt2
right
I I look Sam Altman look look at his
project right he's trying to build a
machine to scan everybody's eyeballs
like like it's Lex Luthor level shit man
you know
um
no no no no it doesn't matter how does
Fear make people want their stuff more
it's not about wanting their stuff more
you're not understanding what the goal
of Modern Advertising is right so
there's two kinds of advertising there's
brand advertising and performance
advertising right performance
advertising is we want more people to
buy Coca-Cola right
brand advertising is we want people it's
like mind share we want people to be
thinking about Coca-Cola right and and
that's what most of Modern Advertising
is most of Modern Advertising is not
trying to get more people to buy the
product that's a secondary question that
maybe happens over time they're trying
to compete for mind share right
um so that that's what open Ai and this
safety thing is all about right it's not
about anything about like a rational
calculation about a product right
advertising moved away from that a long
time ago
[Music]
um
all right
think about how Donald Trump became
president it's the same idea right
the things that he said was that like
is this somebody who I want to be
present well that doesn't really matter
because like Google Trends correlates
with who you vote for
um
so yeah
uh yeah don't worry just scan your
eyeballs man scan your eyeballs all
right all right uh so but we are using
the whisper and everything they really
again there's a lot of very good people
working at open AI I don't know why you
go work there uh Mr Andre carpathy uh I
have a lot of respect for you uh do not
work that organization I mean look look
you do you I'm not telling you what to
do I'm just saying like why do you want
to work there man
like like it's it's like going to play
for like like you're like oh well yeah
but I'm joining it's when LeBron went to
the fucking heat man
if the heat was evil right
like oh yeah yeah rep Cleveland for Life
bro uh no I see all the good guys are
going to the Miami Heat we're gonna I'm
gonna go I'm gonna go there uh yeah
I mean you know
and the Miami Heat's not even evil
well the Heat won because he went and
Dwyane Wade and Chris Bob but you know
whatever man uh
okay
examples whisper
um
by the way shout out to everyone out
there uh doing bounties on Tiny grad
we got a whole bunch of of pending uh
bounties locked we've paid out uh
thousands of dollars uh
over a thousand dollars uh
no carpathy working for open AI it's not
like me working for Twitter right like
opening eye as a stacked team Twitter
needed help
and like no I tried and I think Elon has
a different way of uh
you know
solving things than I do and honestly I
trust elon's way more than I trust my
way
uh because Elon you know has been a lot
more successful
uh
uh you're serious you think you're going
to invest in comma AI you didn't even
subscribe to my twitch Channel bro
[Laughter]
um no elon's not playing the fear to
promote neural Link in the same way
right right like elon's playing the fear
to promote neuralink in the way that gun
manufacturers promote fear to get you to
buy guns
and
the difference is what happens at the
end of this right at the end of this
more guns get in the hands of people
right all right great I will win for a
win for Liberty right
um what happens when open AI uses fear
to promote AI safety the government
regularly all right
five dollars a month guy can't even pay
five dollars a month all right all right
you know now he's gonna subscribe and
think does that mean I can invest now
and the answer's still no bro but at
least you know
you're gifted
Gifted Man
man
you got gifted and stuff what you want
to get gifted some comment I share this
too
um
driver team do they have a PayPal can
you donate to them
for all I know it's like three guys
amd's got 100 middle managers and three
guys committing to the colonel
that's what it looks like man
um
you fucking I
you get owned all ipling is is selling
your soul to Bankers man
why the fuck would IPO
do you do do you want Bankers to have
more power or less power
like yeah you might be able to pull some
big okay never mind why are you
triggering me guys why why are you
triggering me why are you triggering me
that's why we're going subscriber only I
know you're a subscriber too oh okay
well at least subscribers can be
respectful of this is a trigger-free
Zone we're in a trigger free zone right
now
all right
whisper
um
like it looks like a Transformer
this code's a model way to release under
MIT thank you whooped and Whisper then
you know okay you know what you know
what you know what let's let's give
carpathy the benefit of doubt let's say
he's going in there to try to change it
respect
the problem is like I know the kind of
parties these guys go to too and it's
like degenerate bullshit
like they're pro-wire heading bro
oh we got rid of the dirty good
look I don't know if carpathy goes to
these parties but like I know the kind
of people that like kind of parties
these people go to and it's like it's
did you know what Hedon is a man
um which is
like
the only people like you think I trust
you to go online and AI
let's find the model where is the model
here's the link
releases
no
[Music]
what do they have do they have one in
safe tensor
oh detected pickle Imports oh that's
nice
flax model what's flax
by the way check out safe tensors I
think it's a bad name because it's also
fast everyone thinks safe means slow but
it's actually fast
okay we'll download it from hugging face
steal the one from
stable diffusion
I'm going biking again after getting
kind of rugged on the India bike trip
should I do
Taiwan or Japan
by the way mad respect to hugging face
by the way so
they did save 10 series
uh we're downloading this file from them
right now they're definitely good guys
in AI
um
stability AI
you know it's it's not all it's not all
Sam Altman
two Sams both affect the vouchers
both coming in front of Congress
okay
okay well that download link didn't work
you could put the hash in there too
thank you
great
wow okay this model looks pretty simple
got a couple comms we got an encoder we
got a decoder
um I code faster than you read well
oh these are the links
I see do they have a link to download
use open ai's bandwidth we definitely
should
so there's got to be a downloader
somewhere here
whisper.load model
uh perfect perfect
we love spending uh instead of spending
hugging faces bandwidth we'll spend uh
opening icon
foreign
I don't mean to totally hate right
um you know I also would like to
apologize to Nvidia uh for any times I
might have said fucking video
uh look Nvidia does a few
a few scummy things like nerfing the
fp32 accumulate performance and
disabling P2P on their consumer cards
but guys Nvidia has given us so much uh
so let's just take 15 seconds and
actually think about how much we love
Nvidia okay
I'm gonna just take 15 seconds and think
about how much you honestly do love in
video right and like it's just it's just
you just like you know it's hard to like
hate it like you see my my actual rage
and vitriol for people who are bad
in video it's just like they're too good
man they're too good they're they're but
they are good uh so I hope everyone
enjoyed the 15 seconds of love for a
video
it's funny man
oh I felt like hugging faces server was
faster
uh well we're spending Microsoft model
State decked what is different
different I wish we could listen to some
copyrighted music right now oh shit they
have alignment okay well we don't want
any alignment our eyes are unaligned
we make sure we won't include that we
definitely do the safety Checker and
stable diffusion
come on 31 thank you for subscribing
um
remember the safety Checker man AI
safety
uh class was fair
bro AI safety
um model dimensions
oh way these model dimensions
foreign
where are they
and that maybe
they're in here I don't understand why
no one ever puts them in the model wait
oh dims oh dims let's see dims that's
dims
they're getting ready for the winner
here
we're building pyramids of salts
oh
oh
that's it uh
it's probably some named Tuple
named Tuple
whisper is pretty modern code uh oh it's
a data class oh that's that's polite
uh
all right let's just splat it out on on
the whisper
yeah that seems right
and melts and audio CTX and audio State
and audio
head and audio layer I'm sure these will
all be very important and vocab
and vocab and text CTX and text State
and text head and text layer
George why don't you copy and paste yeah
because that's not how you learn you
gotta learn all right let's double Splat
that with that we'll say model equals
that and let's go
all right now we have to create encoders
and decoders
okay we have an audio encoder and a text
decoder
we'll use their same class names because
I bet they're pretty good
smells and audio CTX we can just copy
and paste here George why are you
copying pasting I thought you said you
had to type to learn why lie why the
hell did you listen to me
only a new bit of fool listens
I feel like there's a better way to
write those whatever
I don't want them
if I Splat this is this okay
is it going to be like you're including
shit that wasn't included
[Music]
shit that wasn't included
yeah well you know suck a dick gum shits
there we go
um
okay well we're not going to include the
alignment heads I don't know what they
are but anything with alignment we don't
want
that's right you've poisoned me against
AI safety
[Music]
problem because try to get the AI to be
mentally handicapped the way that you're
trying to mentally handicap your
citizens so they can't think about
truths you guys know truths you guys
know there's like one big truth that's
like no shit that's obviously true but
like if everybody were to actually
accept the implications of it oh my God
society would I mean like I don't know
but it's a truth guys and I hope you
know what I'm talking about
when I speak at Congress about AI safety
fuck no I have a few rules in life and
they're don't talk to police and don't
talk to the government right and they're
actually the same rule which is don't
talk to the government if you'd like to
talk to me you can speak with my lawyer
and my lawyer would prefer to say
nothing
so no if Congress invited me to speak
I'd be like you can refer this to my
lawyer who doesn't want to say anything
and if Congress would like to come into
my twitch Channel they're always welcome
to uh but if they'd like to chat right
now of course they have to subscribe yes
that means you Nancy Pelosi that means
you AOC Mitch McConnell that means you
too
[Music]
um
Roku is still around and still like yo
he's like a guy
Rogue is cool I think
um
but
I destroy okay I've used shell script
oh look I wouldn't do that like I
wouldn't even do that like who do I hate
enough to actually want to run up their
Cloud bill I mean there are people I
hate that much but not open AI
yeah the Fifth Amendment but sir the
Fifth Amendment only covers you if you
could be criminally implicated bro I
don't even know what all of the laws are
and neither do you why would I want to
say anything Fifth Amendment bitches
um
you know don't speak to the government
right if if any if any government
organization ever comes to you get the
best lawyer you can buy and do have them
direct all their inquiries to that
lawyer
um yeah that's that's the only way to
deal with with the government
uh
Emirates should we ban him I mean he got
gifted or something he didn't even buy
that sub you know what I mean
b85 decode
uh don't speak to corporations well no
the thing about speaking to corporations
is like if you're looking for somebody
to waste your time
in like a non-obvious way speak to
corporations
we gotta write some we gotta write some
code guys we've been this stream has
been a lot of talking and only a little
coding and that's pretty bad
oh
okay we have comp one D's
but that's not gonna work
all right what's the best way to
actually write this
I I hate that this code is duplicated to
[Music]
foreign
foreign
what
they're getting ready for the winner
here
building pyramids of salts
we have res block oh no they use gel you
gel you is my least favorite activation
function I hate jellyu
it's very complicated there's like six
approximations for it
foreign
buffer
I hate buffer
buffer not as much as I hate gel use all
your hamsters thank you for gifting Subs
wait Gwen Stefani's music is royalty
free
um
no let's uh music GPT generator
oh come on here
there's just something that can let me
listen to music forever
great
foreign
because it's illegal
can I play some AI Drake on the Stream
I don't know
it seems legal
by the way if you guys haven't heard AI
Drake it's better than Drake
[Music]
[Music]
it's this is literally better than
anything Drake's come out with in the
last 10 years
fault
[Music]
foreign
[Music]
what I think it is is talented music
producers who just like use the best
software to make a drake sound
[Music]
like
wait wait wait wait what
um
wait okay so let's Drake if I'm blue
check
oh they ruined that
they ruined it
they made me lock you know it has to be
acapella oh this is all way too hard
[Music]
out
[Music]
[Music]
wait no no what we need music we can
actually listen to could someone link to
rtj
can rtj
is this is this is this copyrighted no
run the jewels of super copyright we're
talking about everyone just was
copyrighted you can't listen to that you
can't listen to that bro
wait this can't be copyrighted
who doesn't care Wilma who's not trying
to do copyright takeouts we just
shouting out little mabu here man
um
no like he's he's like a better little
index
hey I just want to say all my music
you're welcome to listen to it on your
Twitch streams and your YouTube streams
it's it's all it's all copyright free
man you know how I feel about God boy
you think I'm gonna sue you what do we
got
[Music]
me
I'm just so they can see me do what I
had to do just to feed me no I can't
fuck with this man this is like this is
like if you ask chat EBT to write a rap
be me see me feed me dreaming meaning
compare that compare that to the the
goat will mabu right
like most of your rappers assigned to
the streets only deal that you took was
a plea maybe get money while he pee
shout out my label that's me
like it's a simple rhyme scheme but like
have you ever heard a line like mabu get
money while he pee like that's a sick
line bro
[Laughter]
cap in my raps on my innocent tweep
two fives don't equal a ten man dude
this is exactly like some girl text you
little yo can I bring a friend in our
date like first off now I gotta pay for
both the old mods to sleep with either
one of you just got cornered bro
like you just gotten quartered for
double that's 8X bro two fives don't
equal a ten quick math don't try it
again this guy's so good
good
makeup spots you don't know how to blend
all right we gotta we gotta shout out
shout out man all right we're gonna
listen to more little mabu and if he
comes after me because it's copyrighted
well lumabu sucks I take my favorite
good thing I said about him
look at this
is rap just fast food this bar is fast
food bro that's some deep shit bro so
put like lessons there you know you know
who doesn't teach you life lessons Katy
Perry have you ever felt like a plastic
bag no Katy Perry
[Music]
look at this tiny rack
hanging back it's not tiny I know
two fives don't equal a ten bitch do not
try that again
foreign
shots
all right not not little mabu's best
no no I just want like a music forever
music generator background music here
no no no no this here your personal ads
you're gonna make me fucking log in
aren't they it's gonna make me log in
aren't they gonna make me log in all
right all right we want happy music
bro I don't make me log in bro
oh he's gonna play house music no we
hate house music
play Angry music no no no no come on
we're already angry enough bro we're
already angry enough we had a glamorous
music that she looks sexy let's click on
her
[Music]
[Music]
foreign
beats I could make
all right let's try Lo-Fi Creative
Commons let's say
here
[Music]
no I'll take it oh that that music was
so bad
heard some drum machine 808 shit that
sounded better
from the 80s
yo yo yo yo
[Music]
got it
[Music]
foreign
[Music]
[Music]
[Music]
[Music]
we'll have to do masks and shit
[Music]
you can't really add attention blocks I
know it sounds like a good idea but
try to do it in a generic way I've
merged that political question if you
guys can like unify all the attention
blocks that'd be really cool
[Music]
[Music]
[Music]
thank you
[Music]
[Music]
foreign
[Music]
[Music]
[Music]
thank you
[Music]
but twitch makes me configure it and
it's too confusing you know I can't do
that it's too confusing it's like it's a
computer too hard to use guys
[Music]
sometimes I'll make computers that
idiots can use like me
and that'll be a good day
[Music]
AI is just the machine that does what
you mean and not what you say
a dream
but you know you have a problem because
people's stated preferences are not the
same as their reveal preferences
[Music]
[Music]
for the motivation what are you guys
talking about guys
[Music]
what do you do all day what do you do
you sit around and watch TV or some shit
like I just put the TV on while I'm
coding
[Music]
casual like I'm not doing anything very
hard I'm literally just like
copying and pasting from here
we got all the weights right you know
but this is good it's a good exercise
like you really understand like what
these things are right does everyone
kind of get it
foreign
look at how many lines theirs is look at
how many lines mine is that's less lines
oh they just okay you're telling me if I
go here I can just get music yeah but I
think I tried this one so all the music
was bad but maybe they've got better
music
no this is going to make me log into
something I can tell already
[Music]
did I ever make DC Gan work I looked
just a little more we can finish that
one sometime
um the premise training is just really
slow and you got to sit there for a long
time when you get inference it just
works and it's much better for streams
like the problem is all right we'll
train like remember when we did the uh
the other thing the uh
what you may call it
[Music]
yeah we should really just like the real
thing we should do is just have a big
refactoring extreme we just refactor
this stuff
and the other reason you want to do this
stuff manually is it shows you where the
limitations in your API are we're trying
to make tiny grad the most absolutely
joyful uh
thing to code in
[Music]
what the hell is this
what
I don't really get that
[Music]
if they use it in two places
it's talking about in here and they use
it here when
[Music]
okay we're gonna have to write KV cash
again
foreign
[Music]
[Music]
oh
actually don't technically need that
option I don't know what I was thinking
[Music]
[Music]
[Music]
[Music]
there's no way I got them all
[Music]
foreign
[Music]
[Music]
ah good point
I remember that yeah I remember that act
I think it moves to the nation's
productivity by like seven percent
there was yeah I mean they remember the
Sonny Bono copyright extension act yeah
they did the um Lo-Fi chill hip-hop
beats to study act that's right the only
problem was they introduced some pork
barrel spending in there
um they also gave another three billion
dollars to flowing in that act if you
actually read page 696 of it uh yeah
they gave another three billion to
Boeing and they look Congress just
wouldn't budge unless that three billion
dollars went to Boeing
yeah of course it's a real thing haven't
you read all the laws that are passed in
America
[Music]
[Music]
all right so why do I have to give it
mail end tokens
then some only mode can't protect us
anymore
the unwashed masses are on the internet
guys we just gotta deal with that
you gotta deal with it you know the
Eternal September it never it never
ended it never ended
it's really right
what are tokens we'll figure that out
later
of course we want to make it whisper so
I can talk to it
all right amtash Amber attach has to go
Amber attached I'm sorry I'm sorry
Amber Tesh is gone
archive is going to be muted because if
there's no copyright music Creative
Commons music is it not Creative Commons
oh
how is it how is this not Creative
Commons
stuff terrible
I mean I guess
we have permission to use the the tracks
in our
bro
he just learned a lesson about how life
wasn't fair
do you think life is fair
oh man I was so relaxed with that chill
hop beat you know what I'm not gonna
stream anymore I'm just gonna listen to
chill hip-hop beat by myself
um and yeah
wait
after work Tech why is this not okay
it's it's Creative Commons you don't
believe in unwind station I legitimately
do
oh because it gets it gets recognized no
no we I mean we can't listen to the
little mavo I a little mob was mad
copyrighted bro little mob was getting
signed by somebody soon Lil mama's gonna
IPL man
[Music]
we're just just so much more pleasant
listening to this
all right all right all right all right
all right where are my beat ass
headphones are so beat
we'll see all right you're saying
YouTube might YouTube's gonna fuck with
it yeah
we need it boys we need it life comes at
you fast if you don't stop to just look
around and do whatever you want all the
time you might miss it
[Music]
you know AI can't generate good music
oh here we go Bach
kill with some Bach
how long is this oh good
seems nice
I've only used to just listen to
whatever music we wanted
[Music]
if this is too relaxed I'm going to
sleep guys
maybe baka's other music
[Music]
am I on the bicycle Road in the Pokemon
video game
I'm on cycling Road guys
I just got my bicycle I redeemed my bike
voucher you remember when I was a
speedrunner
foreign
[Music]
music can't be copyrighted it's two
little bits
16.
I might have told you
[Music]
[Music]
[Music]
all right
[Music]
wait how do I get this
[Music]
[Music]
[Music]
um
thank you
[Music]
foreign
[Music]
[Music]
foreign
[Music]
[Laughter]
foreign
[Music]
[Music]
[Music]
[Music]
ERS thank you for gifting more subs I
appreciate you
foreign
[Music]
what
I think liberos is that bad
oh God that's a good number of melds
guys we got 80 Mills
excited about 80 mils
foreign
[Music]
[Music]
[Music]
thank you
foreign
[Music]
[Music]
[Music]
[Music]
foreign
[Music]
cash
cause I gotta do it one shift at a time
do I not
oh man Transformers one of these days
I'll understand them
it's a lot of code
[Music]
bro I
I'm really enjoying the chiptune uh but
I want to take a minute to say here's
what our goal is by the end of the
stream at least by the end of the
weekend
I want to be able to talk and I wanted
to just put the words out on the screen
man
I want to just just like I I run the
program and then I'm just talking and
it's just writing the words right using
tiny grad oh yeah real time boys real
time can we do that
I don't know if the real whisper can do
that but if it can don't tell me because
I want to have motivation
you know when you start figuring out
that everybody else is just better than
you and richer than you you lose
motivation so the trick is to think
you're better and richer than everybody
else
[Music]
[Music]
thank you
and then we can plug it into llama right
and then next weekend we'll try Hi-Fi
again and I'll be like yo bitch and
it'll be like sup
by the way Who you calling a bitch
like never mind I didn't realize you
could talk I'd never call someone who
could talk a bitch
because bitches is dogs man and dogs
can't talk I get what you say in there I
get what you're saying there and pussies
as cats all right all right we're good
we good that'd be if I could have that
conversation with a machine and not just
myself man I'm one step closer to
finally having the friendship I seek in
the world which is with computers
because computers can never pose any
real threat to you that's right
girlfriend company 2024 not six years
six years I started 2030 will start the
girlfriend company
um did I work at this company we need
this technology in order to enable we
need comma and we need tiny grad
together to make the girlfriend company
right like
like like what do you what do you think
man you'll never be alone I don't
already like man I love my MacBook so
much man oh it's just it makes me so
happy
where would I be in the world without
computers man
probably be falling for some CIA Ops man
I'll just be I'll just be like
I'll just be like wage Wagey or
something I don't know man I don't even
know where I'd be without computers
where would I be
can we take a minute and just laugh at
AI safety
dude
you know what you know what like Andy
look air safety is a real thing and ai's
probably gonna kill us man but the way
that these people have approached it so
far all you could do is laugh
like all you can do is laugh and like I
mean the open AI I Like You cast you
like you're talking about nuking data
centers like bro this is why rationality
failed okay rationality failed because
they don't understand politics right
right like if you say that stuff the way
that you're acting on Twitter you're
just gonna get branded as a lunatic and
I get it you're like trying to take a
pita strategy I get it but like
you're assuming that AI safety is
somehow going to be a democracy right
like like being vegan actually is a
democracy you know like a whole lot of
people see a pita and they're like I
went online I saw this documentary I
watched George hot's archive and I saw
that they were treating the chickens
badly in the chicken farms so I decided
to be vegan except fish because fish are
in water and I can't sympathize with
water shit as well
I'm a pasta vegan
um so yeah no I just like you can't when
the AI safety people start engaging
intellectually honestly and they don't
talk about how like you know an AI
telling a teenager to kill themselves is
a real problem like bro have you ever
played Call of Duty man have you ever
been in a Call of Duty Lobby man
you know if teenagers were that
susceptible they'd all be dead
I sympathize more with fish today I'd
say 80 people you know and they didn't
have to totally tank their reputation
you know
foreign
movies right and like even like she's
the man there's all this great like you
know
like it just feels like real it's like
how real people talk you know like trust
me real people still talk this way right
but now it's like like there's this like
like like Newspeak pretty much
that people are supposed to talk with
politely in public and you know they
can't be like yo she retarded man like
you just you know the Newspeak man the
new speak you know
the words can't you say you know
um
[Music]
rwkv
one of our uh great contributors on Tiny
guys as an rkwv uh thing I should check
it out
um
you have Twitter users I've never been
outside this is true this is true
okay this came from Illinois boys this
was in Illinois
uh so you guys know you can buy a tiny
box
and that plugs into one power outlet or
you can buy a tiny rack and that's six
power outlets and it's not really six
it's just your electric car charger you
plug it in the same place you plug an
electric car charger in you connect them
up check that check out this SFP network
card boys
and check it out no I mean these people
these people were like losers in high
school they really were
and that's kind of the problem
all right like
like you get I mean dude like honestly
again I don't mean to pick on them again
but I get this vibe from Sam Altman
where it's like
like bro like I get it I get it I get it
you know now you have power okay great
like what what you know don't act like
you're acting man that's the kind of
person who was like it's like the way a
cop gets power like a cop was like
bullying in high school for being fat
now he's a cop you know
uh yeah yeah yeah check this out check
this out dual 100 Gig ports
all right now the normies okay so like
90 of people's enormous are starting in
Japan right so so ask ask a norm ask
like the next time you're on an Uber ask
your Uber driver about what their
thoughts are on AI right and it's
actually terrifying and you just you
just watch these psyops play out in real
time
and look they're not psyops okay like
like it's wrong to say that there's like
they're just advertising right what is
an intelligence agency but a really good
advertising campaign right what are all
these NGO organizations I mean there's
literally hundreds of billions of
dollars flowing into these organizations
it's not a conspiracy theory right so
you ask yourself what does the Ford
Foundation do all day right all right
let's let's go to the Ford Foundation
website right
um so here
let's look up the size of the Ford
Foundation
uh okay the Ford Foundation has uh 16
billion dollar uh endowment okay
so this is this puts it on the list of
the richest people in the world
right and then what are their goals
to reduce poverty and Injustice
strengthen Democratic Values promote
International cooperation and Advance
human achievement okay so what do you
think they actually do what do you think
they do all day right
again
this organization is better funded than
anyone you know
a lot of Corporations what do you think
they do all day okay
I didn't even know I didn't even know it
was on the site guys I didn't even know
it was on the site
oh did you see that there was a YOLO
running
um no the problem is like we'll be too
rich to care right it's not about being
true Rich to care it's about think about
what these people are trying to do to
the world right
if this is it inequality is only going
to increase it's not going to decrease
right the only problem with inequality
is it's not exactly what you understand
it to be right it's kind of easy to spot
you know it's easy to spot like one way
to spot the truth right the truth is
somewhat related to the thing they're
constantly screaming about right but
it's usually actually the opposite of
the way they're screaming about right
there actually is a lot of inequality
and increasing inequality uh in in
America right
but
the inequality isn't the one they talk
about
foreign
quality is also don't think I'm telling
you some like you know it's a little
coded like because you do have to kind
of think for yourself it's kind of hard
to State these things without like
understanding a whole world but it's not
like the right wing bullshit guys it's
not like like the oh my God the fucking
the dog don't don't make me start on JK
Rowling again
like literally bro literally
uh you know you know the the poor 19
year old trans kid right who like thinks
JK Rowling's out to get them man like
like you just you just you you feed into
there you feed into their world view
right
compute inequality is a real problem
that's something the tiny Corp is
working on solving right
they have the data centers and you do
not
breakdown is making a lot of money that
that is true that is true
no but I mean the real inequality is is
the inequality of power
um you have almost no power today and
this this manifests itself in a lot of
the dysfunctions you see in society
right
um here we're gonna we're gonna bring up
let's bring up the uh Univar Manifesto
because I think he describes this really
well if you guys haven't read this is
Washington Post by the way I'm not
linking to any sketchy website here I
have a link to the washingtonpost.com
um if you guys haven't read this it's uh
it's really uh
it's really uh
uh great to uh to read
um
uh
maybe he does only have this example
all right here we go um
the leftists will reply that the last
thing they want is to make the black man
into a copy of the white man instead
they want to preserve African-American
culture but in in what does this
preservation of African-American culture
consist it can hardly consist of
anything more than eating black style
food listening to Black Style music
wearing black style clothing and going
to a black style church or mosque in
other words it can express itself only
in superficial manners in all essential
respects most left us to the over
socialized type want to make the black
man conform to white middle class ideals
they want to make him study technical
subjects women in stem become an
executive or scientist and spend his
life climbing the status ladder to prove
that black people are as good as white
they want to make black fathers
responsible they want black gangs to
become non-violent Etc but these are
exactly the values of the tech the
industrial technological system the
system couldn't care less what kind of
music a man listens to what kind of
clothes he wears or what kind of
religion uh he believes in as long as he
studies in school holds a respectable
job climbs the status letter is
responsible apparent is non-violent and
so forth
all right
this is this is what you're going to be
this is what you're going to be left
with right
this is what I mean by you actually have
no power today right you think you have
power you can choose between McDonald's
and Burger King you have purchasing
power you can buy lots of things but in
any value that opposes in a tiny way in
fact the system is so pervasive now that
they're almost not even caring about
violence anymore
right because violence doesn't actually
pose a threat to the system
right does does in the 90s we went
through like a struggle where the system
actually kind of did fear that violence
could you know violence of like the Waco
or Ruby Ridge style uh you know could
actually pose a threat to the system
Timothy McVeigh
today the system's not even worried
about that
um is this unique to the West well kind
of right the the the technological tools
of power uh are increasing
right now
you know this is a great Manifesto and
you should definitely read it
um if you haven't how many people here
have not read this Manifesto I have not
like seriously sat down and read this
manifest though
anarcho tyranny I'm not proposing you
should read it
um everyone here who has not read this
should actually really go read this and
understand it now again I I would also
you know tell you to read The Communist
Manifesto the thing about reading the
Communist Manifesto is like you can read
it and its lessons are already so
incorporated into the modern culture
uh that you likely won't learn much from
it right it's interesting to have a
historical perspective on it but because
you know and Nietzsche is the same way
right like like like like the communism
in Nietzsche are so pervasive in modern
culture that if you watch almost any
television read any books any movies you
you are you're just bathing in those
cultures
um Marxism like you're just just so many
analysis or fun like analysis in the
world today are fundamentally Marxist
and there's nothing wrong with this by
the way right there's very intelligent
Marxist analysis that makes a lot of
sense but
um the stuff in this Manifesto is less
pervasive it's less kind of well
understood but this right here is the
absolute greatest uh challenge
facing Humanity
right
um his just like in The Communist
Manifesto his Solutions at the end of it
are I think absolutely ridiculous
um
but there is no way of reforming or
modifying the system so as to prevent it
from depriving people of dignity and
autonomy
right and
what's this mean
right like
when we live in a world where all
struggle is actually completely removed
what what are you left with right so
there's two types of struggle in the
world right there's PVE and PVP right
um
you know most of the PVE struggle is
already eliminated
uh uh now what they're working like the
big the big social engineering project
that's been going on for the last 10
years is to is to eliminate the PVP
if you read rothbard The Communist
Manifesto falls apart in two chapters
yeah I mean the Communist Manifesto
again it's not
of course
I I think that a a Libertarian take
quickly rules out a
um like this is actually what will
happen in communism you do understand
that we are creatures of the economy and
this is like
yeah but then again we've had communist
societies we've never had any
libertarian Society so you just gotta
ask why that is
but real libertarianism has never been
tried okay okay I think the Communists
say something pretty similar
I don't know I don't know how we ended
up here remember we were just coding
whisper uh but yeah no I mean this is
the greatest
this Manifesto lays out the greatest
problems in society the greatest problem
in society today
um it's opinionated
which I guess it has to be because it's
a Manifesto but if you lose the opinion
part of it if you don't I don't
necessarily agree with that statement
um
his analysis is is just is just brutal
he went about it with male bombs I mean
again you know when people write
manifestos like this
like it's obvious that they're really
you know they're describing themselves
right and I think that the the male
bombs are the act of someone who feels
powerless right and
you know I I think that the way he
discusses powerlessness is obviously
something that he really deeply felt
the male bombs weren't marketing
um yeah but it's a it's a you know
uh I think his analysis of leftism is a
bit um
I mean it's simplistic from from today's
perspectives
uh like I think in the 90s you had a
much
uh weaker form of what we have today
um but yeah I mean if you really want to
understand
The Arc of the next hundred years read
this Manifesto and think about how you
think Society is going to answer it
um it's good diagnosis but suffers on
treatments angles have the same problem
of course I say this all the time
um
I think this is
um one of the greatest like
introductions uh from from this
Manifesto
um we divide human drives into three
groups those drives that can be
satisfied with minimal effort like
ordering ubereats those drives that can
be added satisfied but only at the cost
of serious effort uh having sex with a
willing uh woman uh those that can not
be adequately satisfied no matter how
much effort uh one makes uh world peace
right
um and this this analysis is great
there's another uh
analysis in uh in Bronze Age mindset
that kind of extends on this idea a
little bit that talks about own space
um there's a line from Bronze Age
mindset that I think uh best summarizes
this it's Jeff Bezos uh you know may
have all this power and wealth but could
he take a woman from Amazon who works at
Amazon and make her his slave wife uh no
but this power is granted to even the
smallest African Warlord uh so it's just
interesting to talk about who really has
power
right
that's that's how the system that's how
the system works right you're allowed to
have private jets you're allowed to have
Yachts you're allowed to have space
companies but the minute you do anything
that actually goes against the value of
the system
well shit
um Jeff Bezos can't even have a single
man killed one man killed he'd go to
jail
who has power
um yeah no I I saw I saw a a tick tock
this morning where this woman on the
Portland streets was like yo man life at
the homeless is great we get free food
you sit around all day and you're tent
you smoke dope and it's pretty good
um and yeah I'm very supportive of this
life I just wish it wasn't uh in the
middle of the city that I pay a lot of
money for
but if you want to do that you know I
think I'm all for subsidizing that just
not in the middle City
could he pay someone to kill
right do you think Jeff Bezos has that
infrastructure
I mean you can say oh he could pay
someone okay but it's not a money
question right
like if you imagine Jeff Bezos went on
Twitter and posted hey man looking to
hire a hit man 10 million dollars
you could try
yeah he's probably more likely to
succeed at it than you or me but you
know
oh yeah yeah I think some people in the
UAE might have this kind of power I
think there's some people in America who
have this kind of power right I think
Adam Schiff has had people killed oh God
shit I should have said that he's gonna
have me killed
um you know the Clinton Body Count like
some you know there's some truth to this
right do you really think these these
connected politician people have never
had anyone killed now again we get into
well you mean the Mission Against where
we drone to Ankara albuqui even though
he was a U.S citizen in Yemen for
publishing a magazine Inspire like I
mean that really happened right and like
I think you know is that not George Bush
on someone kill oh but you see we did it
legally well okay that's interesting
right
um no look I don't know have the
clintons actually had people killed and
I don't know
um I don't think they're the shadiest
people in politics
I think that I think that the clintons
you know you yeah well how do we end up
here how have we end up here
um
I mean there's not gonna be a Civil War
in America guys you do understand that
it is the UNA party and you right
there's only one dividing line in
America and it's not Democrats and
Republicans it's not black and white
it's not rich and poor I mean it's kind
of rich and poor it's the oligarchy and
not the oligarchy right
the oligarchy is now spending like four
trillion dollars a year
for what's the gov U.S government budget
can I get a number
I don't even think that's the whole
thing
ah
here we go the US government has spent
3.61 trillion in fiscal year 2023
to ensure the well-being of the people
of the United States
in 2022 the government spent 6.27
trillion
[Music]
government spending equated to roughly
three out of every ten dollars in
America
30 of all the money in America is spent
by the government
we are fucked guys
like this is literally a very small
minority just stealing from everybody
and that's the dividing line in America
right it's not the Democrats and
Republicans there's not going to be a
civil war
there's more likely to be a revolution
than a civil war
and I think revolution's unlikely for a
whole lot of reasons right turns out
revolutions actually only happen when
people are starving uh and
we'd have to fall a really long way for
that to happen
um
all right guys how do I get distracted
with this bullshit
we have these conversations a comma or
we like talk about this stuff and it's
like yeah but what are we gonna do about
it you know
you know
it's like what am I gonna do
nobody's revolting because they're fat
yeah man classic prison technique you
know
oh that's what our pizza Bros
speaking of ordering food I mean like
you know that's the thing like
you guys all right let's let's let's
bring Chad over here and let's um let's
disable subscribers only
have you thought about stuff have you
thought about this stuff in your life
I don't think John McAfee was killed I
think he killed himself
I do not think I think uh Jeffrey
Epstein uh
if Jeffrey Epstein killed himself it was
um
have I read kaczynski's later works yeah
uh I didn't find anything I read I read
technological slavery I don't know if
you I haven't seen new ideas in the Box
I've seen just refinement on them
if you don't care about the big picture
that much but like this is not this is
shit that is going to make all the
difference in your life
Sisters Pizza all right that looks
pretty good
Modest Mouse Pizza red sauce I don't
want gluten free
red sauce and mozzarella fire let's go
The Government Can every adult one
trillion dollars I remember those memes
during covet
what's the human use of human being
as long as you can find enjoyment you'll
be fine I mean
yeah yeah yeah yeah yeah this this
shit's just like not real
George's ideals would work in a society
of George's well
I don't put chromium myself
what's Gina AI
unironically the West needs God yeah I
couldn't agree more
I don't know about this
Sam's Louisville repressors assault man
um
the more I listen to your shallow
anti-us ramblings featuring conspiracy
theories what conspiracy theory
can you name one conspiracy theory that
I stated
the one where I showed you how much
money the government spent from a
government website
uh the one where I told you that all of
these uh ngos are basically
multi-billion dollar funded marketing
organizations
uh the one where I told you that we
don't really know if the politicians
have people killed but when you look up
Ankara like
and locky
[Music]
killed in Yemen what's the guy
did they memory hole it guys did they
memory hole it
um ankar National Abdullah al-balaki was
an American uh
uh I don't know how to pronounce that
who was killed in 2011 by a U.S
government drone strike ordered by
Barack Obama
believed to be the first U.S citizen to
be targeted and killed by a drone strike
from the U.S government right
like it's not conspiracy theory guys
this is Wikipedia
um
oh my conspiracy theories are at the
oligarchy rules everything and they are
stealing from us
well
I mean
okay okay okay okay so the oligarchy
rules everything right so let's say it's
not the oligarchy right so someone runs
things right you're saying okay we could
live in Anarchy right this is a
possibility there's basically four
systems of government right there's
monarchy oligarchy democracy and Anarchy
right and you can ask which of these
apply to America
thank you
uh so there's that and then the uh they
are stealing from us well
I documented bro like oh it's not
stealing they're legitimately spending
your money to improve the welfare of
American citizens
okay
okay
that's like your opinion man
do I fear that I'll get canceled no no
guys no
and no one else should fear that they're
gonna get canceled and that's how all
this bullshit works
like
you know how you might get canceled yes
if I was an actor on a mainstream ABC
television show I may come in one day
and be like George you showed the
Unabomber Manifesto on stream this isn't
someone we want promoting family values
of ABC or pet oh Holly whatever look
yeah that might happen right
if you work at some Ultra PC job and I'm
not talking about a normal job trust me
everything I say you can say at any tech
company you could say everything I say
and still have a job at Facebook you
know it's it's like
like you're not going to lose your job
for that stuff you're not going to get
canceled right like this is bullshit and
it just makes people afraid to like say
you know yeah so
no I was never afraid of being what are
you gonna do I would love for somebody
please call up my employer call my
employer did you know
what oh yeah this is George Hots I know
oh
oh well well you shouldn't say things
like that's like your opinion man I get
it I get it tell me more about your
opinions
um
taxation is that such a dumb fuck
argument I didn't say that taxation was
theft guys and I'm not against taxation
okay
I'm against the
why does it cost 50 million dollars to
build a mile of Subway in South Korea
and 2 billion to build the same mile of
Subway in New York right
I'm not saying taxation is theft the 50
million dollar Subway is something I'd
like to be taxed for the two billion
dollar Subway will shit
where'd the other
1.95 billion go
no not because of New York have you been
to Seoul it's just as dense
um the sovereign individual is that uh
is that rothbard no I'm thinking anatomy
of the state
no I haven't yeah I started this
most people want to and have happily
joined wireheading City and I'm
absolutely fine with people joining
wireheading City you just can't put
wireheading City in the middle of my
city
right or I'm okay with can we build not
wireheading city right if it turns out
that the majority of people actually
want wire hitting City then can we build
one city that's not wireheading City
um yeah so no I'm not saying taxation is
death I'm not taking a hard-line
position I'm saying that when you take a
huge amount of tax and give me less than
nothing we have a problem
right
if if you took my tax if you took my tax
if you took the same tax that you took
from me right if you took everything you
took but we had colonies on Mars and the
moon and we had power we had Fusion
reactors and we had hyperloops it'd be
so fucking happy I tell you doubled man
I'd pay you double
like taxation is not theft if you're
building cheap power infrastructure if
you're building a transportation
infrastructure taxation is theft if
you're taking it and giving to some
homeless woman in Portland that's actual
fucking theft
you're just taking my money and giving
it that's actual theft
what I mean
they're not giving it to the military
for the most part they are not giving it
to the military
look up U.S government spending we spend
more on Social Security and health care
they're literally taking it and giving
it to old people and poor people
before they spend it on the military I
support the military more than either of
those two things
foreign
dog shit our military is actually sick
um you think if China actually had a
good military they wouldn't have taken
over Taiwan by now
oh can tiny grad whisper yeah yeah yeah
yeah we gotta we gotta go back to that
if we had Fusion Energy you'd probably
need to pay less taxes yeah look if the
money was like going to that stuff
if the money
yeah yeah
how would I feel if I was homeless
because of a disability and there's no
one to help again I'd rather the money I
would rather die right now if I was not
useful to society I would rather die
if I knew that my death would help bring
about hyperloops and fusion reactors
okay and space colonies okay I would
actually die for these things
do you know what I mean
like I just like like you know the one
that you just die like because me dying
isn't gonna make those things any more
likely but if you said George literally
in 10 years if you're alive everything's
going to continue the way it does or in
10 years if you die we're going to have
space colonies and fusion reactors
please I'll shoot myself tomorrow like
I'm not trying to kill the Portland
woman I'm trying to put her in wire
hiding City where she wants to be
um
oh yes I expect we have Truth for you in
the master experience is vastly greater
absolutely I will never experience the
lows of starvation nor the highs of
hunting a deer after a week of
starvation
what you guys it is not dangerous to
challenge the social contract like get
over this shit it's a reign of fake
Terror
like they didn't do shit and they can't
do shit man and as long as you believe
they can do shit you're just you're just
building them up in your head like
there's some like cancellation mob
that's gonna come for you like the
Spanish Inquisition like they're just
not
foreign
you've been living with hyperinflation
throughout your life oh yes oh oh yes
there's a lot of countries that suck way
more than the United States
so you know check your privilege and all
that share
Twitter anime profiles can ruin life's
what you're saying right if you truly
are saying like God awful terrible shit
like
well yeah you know
I think I think like it's not like oh no
honest person needs to be canceled but
like you know if you're saying terrible
things like the government should steal
more of your money like yeah you're
right you shouldn't be allowed in polite
Society
as Alaska's to the last Bastion
they don't ignore you they don't limit
your reach your reach on today's very
meritocratic social platforms is
entirely based on your ideas
right they do not have this level of
control they don't do this by limiting
your reach and they don't do this by
censorship they keep control by
advertising right
they keep control imagine you built a
soda that was way better than Coca-Cola
right it was better for you it tasted
better it's amazing all right you will
never succeed at making a soda company
right
and your soda's better and that's not
the question right and they're not
limiting your reach
you just won't succeed because you don't
have the marketing budget of Coca-Cola
right so they're not limiting you
they're not censoring you they are just
out competing you the problem is they're
not out competing you in a fair and free
market
they're not out competing you on a
market of soda quality taste and health
they're out competing you on a market
where they put a fucking uh Coca-Cola
hat on a polar bear
in my proponent of eugenics absolutely
absolutely okay now unfortunately
Eugenics gets a bad rap because Hitler
did Eugenics and was an asshole and he
did a terrible form of eugenics I do not
believe that you should kill people or
sterilize people
but do you want the best to be breeding
of course do you want to encourage the
societally of course right
I mentioned it all right we reached
reducto out of sodium we reached the God
one point okay that's definitely the
time to stop that's definitely the time
to stop that's definitely that's
definitely where we stop we we we
mentioned Hitler uh we mentioned Hitler
if you don't support Eugenics what do
you support you support mediocrity
oh God God mediocrity hmm laughs
I know I know you think you could like
yes Eugenics is great do you think the
state should force people to do things
now
uh do I think Eugenics could get stuck
in a local min max actually yes and I
think if you were to roll out a 100
totalitarian Eugenics program yes oh God
yes do I think we would get stuck in a
local max if you started searching maybe
instead of doing gain of function
research on viruses you started doing
gain of intelligence research on babies
shit
you know
what if we just did gain of intelligence
research on babies
[Music]
foreign
you know
was your state or girlfriend you're not
getting a state or a girlfriend you're
getting a computer girlfriend from my
company in six years
what is intelligence good for building
Fusion reactors and colonizing space and
building hyperloops have you ever sat on
the back of it if you ever sat in the
middle seat of a Southwest 737 in the
back
and you're like God there has to be
something better than this what is
intelligence good for fixing that
problem
our Junior devs welcome in tiny grad
what do you mean there's no fucking
gatekeeper except yourself man I don't
know if you're a junior Dev or a senior
Dev I don't care
I care if you make good pull requests if
you make good pull requests that
save me more time than I spend I'm
interested if you spend pull requests
that are asking for more time then I'm
gonna get out of it then no
do I sound like Jordan Peterson oh God
oh God oh God don't worry guys don't
worry about well I never mind
uh
uh I'm talking designer babies with Gene
editing I don't think I think
incentivized sterilizations are are
awful like positive Eugenics right
maybe we should code for a bit oh man
we have mass cloning we'll be reading
sextape CAD curls
of uh
you're mostly like they're gonna do bad
PR's then you're gonna get a rude
sentence and a closed br
would I qualify for eugenics program and
I don't think you understand what I'm
talking about when I say Eugenics I'm
not talking about some like weird fucked
up Social incentives I'm talking about
like
like
gain of intelligence research on humans
right it's like instead of gain a
function research on viruses so we get
more deadly viruses we do gain of
intelligence research on humans so we
get more intelligent humans
are bad PR's welcomed fuck no man
gain of intelligence right like and you
know what I shouldn't even use like the
word like the word Eugenics is
triggering to people and yeah I mean
it's been associated with some terrible
things but what it actually means is
good genes like that's actually like
like Eugenics look at the root of the
word
um and this is why we don't allow Clips
you know because the clip people come
and they take things out of context
right and then they're gonna call up my
employer and be like you have to fire
this George hot Sky it'll be like
yo I'm George hotz you know what I
should fire him he said some really
terrible things and he I'm sure he
deeply apologizes I'll I'll ask him to
do an apology stream you know I'll ask
him I'll ask him to apologize for all
the terrible things he said for all the
people who wrote the AMD driver who feel
bad about themselves look I'm not trying
out about yourself saying you guys
can turn that company so we could have a
decent driver right
oh
I am the HR
but shouldn't we celebrate old jeans no
and I'm not celebrating all PRS either
if you put shitty PR's on my repo I'm
just gonna close them
and then I'm gonna ban you from GitHub
if you do it twice
no no no no no no no if there's any
George hotz clips
as long as that genetic overclass is
building me Fusion reactors and space
colonies I don't care
oh no Hitler was a racist asshole
Hiller was the celebration of mediocrity
yeah
you know you know
all right all right all right all right
all right all right all right no no no
Hitler's been brought up way too many
times
and let a shitty movement guys
and I'm not saying the movement was
shitty because ethically and morally I'm
saying it was just shitty okay he shot
himself in a bunker okay that's all you
need to know
and his country was bombed to shit right
like and and and now their country is so
ashamed of what a terrible fucking guy
he was that if you do his salute in
public you owe five thousand dollars for
the government right like that's how
much this guy sucked okay
but if and you don't like Hitler no it's
not
ah
the Edibles kicked in
I just spoke a bit this morning just a
little
oh yes hello hello yes no this is the
based Department I'm sorry we don't have
an HR department oh
okay yes no it's a common
misunderstanding Thank you very much bye
don't mention the war classic from
Faulty Towers it's Faulty Towers
other than the window have a look and
the real job is done with rosemary
it's delicious and nutritious in fact
it's really good really good
is good yes it doesn't matter it doesn't
matter never mind maybe have two X-Men
amazes too certainly why not why not
indeed we're all friends now a corn
cocktail all in the markets together
those differences forgotten and no need
at all to mention the war
today
when you said torn I thought you said
wall oh yes completely
oh
all right we got we got to get back to
coding guys we gotta get where's my
pizza
where's my pizza
that's the real question
ah
Waldo is delivering my pizza
not here with my pizza
uh yeah guys now but now the real talk
the world is scary guys scary you know
um
like what if you were on a train
let's say a bus and you realized that
like
the bus was being driven by like
like
like morons
and you're just on this bus right and
this is how I feel
like I'm I'm sitting there I'm sitting
there in like in like row four on the
bus or let's talk about a plane right
maybe that makes it more visceral right
and that cockpit door is locked
and who's on the other side of the
cockpits
complete idiots
no I don't know
I know you know that's kind of true
no they're not like people aren't
growing up today
people aren't growing up they want to
stay they want to stay children forever
they want to consume
consume consume consume I mean that's
the difference I said between a child
and adult you know
um a child uh
oh there's a big Indian train crash oh I
didn't know about that uh I'm sorry I
didn't I didn't know that was not a
reference to that I wouldn't actually I
wouldn't actually do that
um you will keep it to just plane
crashes there hasn't been one of those
in a while
uh
now Alex's Alex is texting me oh shit
man
yeah I was I was on those trains like
two months ago
uh why would they unlock the door though
you think they're gonna unlock the door
no the door's locked here you're like
we're all in the back we're all pounding
on the door being like Yo No actually
we're not everyone's like sitting in
their seat being like well shit man the
stewardess comes around and you know
they give me three meals a day and they
let me sit here and you can smoke dope
all day and you know that's and that's
this you know
um
we have a first time chat from somebody
asking about the juice great
okay
my pizza will be here in five minutes
the flight attendants told you
everything was fine that's right you
know you guys know they're just being
paid by the airline to tell you
everything is fine
you guys know that right
they're not they're not they're not
actually assessing the situation they
don't have access to any of the
instruments about you know whether or
not we're actually fucked or not they're
on the same side of the door as you are
except they're being paid by you know
the same people it's government
employees right
um
they just put the oxygen to calm you
down that's right that's right they
dropped the masks don't worry guys don't
worry this mask will say don't worry
guys there's a life preserver under the
seat
[Laughter]
don't worry in the event of a water
landing
I love that George Carlin bed is like a
water landing
shit don't you mean a crash
is the plane on autopilot
you see there's no parachute because
you're flying through space
there's nowhere to parachute to you know
there's a brace position really help you
die swiftly I'm in the race position
actually works
let's not spread misinformation
[Laughter]
uh yeah I have good food and a cigar
shit man I'll die pounding on that door
you know
there's a little blinking light
ah I think that the first day we did the
stable diffusion stream that stream was
pretty depressing too there's something
about just starting on a new model
that's depressing
red Corinthians I don't know
um
um
what do you mean am I one big pizza two
medium pizzas you just gotta compute the
area and do the math
I haven't read Corinthians
foreign
foreign
we need God man
let's read the Quran next
if you'll link me to something good from
the Quran I'll read it uh I don't know
I've always felt like I was born uh
and my parents are atheist
um
but I was born like uh I guess uh
culturally Catholic
um I don't know like is it like cool to
read the Quran I don't even know how to
like get get into like to get into that
uh I I don't know that much like about
it
um
have I read character yeah quite a few
things
this doesn't speak to me nearly as much
like we we come back here right
so so we have an introduction right
I appeal to you brothers and sisters in
the name of our Lord Jesus Christ that
all of you agree with one another in
what you say and there that there be no
divisions among you but that you'd be
perfectly United in mind and thought my
brothers and sisters some from Chloe's
household have informed me that there
are quarrels among you what I what I
mean is this one of you says I follow
Paul another I follow Apollos another I
follow cephas still another I follow
Christ is Christ divided was Paul
crucified for you were you baptized in
the name of Paul
I thank God that I did not baptize any
of you except Crispus and Gaia so nobody
can say you were baptized in my name for
Christ did not send me to baptize but to
preach the gospel not with wisdom and
eloquence lest the Cross of Christ be
emptied of its power all right like this
is
this is like
like this is practical knowledge
this is this is this is this is
management right like if those middle
managers were to read this and
wait oh wait that's the quote from uh
dude I gotta read Corinthians man
I don't know
you do understand this is all happening
though
like I'm not look I'm not I'm not
schizophrenic
um God if you ever preface anything with
I'm not schizophrenic uh
like you know I'm not I'm not Terry
Davis I'm not
like I'm just I'm just a guy who's kind
of like sitting here and you know shit
man I'm kind of scared
like
the the the power that we are about to
stumble upon
um
isn't what religious text sorry every
statement of accumulated wisdom yeah
sounds right
the glow he's got me I promise you the
glowies didn't get me I mean yeah
there's like a
why is there this like
din this din is the word I'm looking for
this like din of anxiety in American
society
why is there this constant kind of uh
buddy
because my pizza's here
foreign
first because I at least I won't be a
dick with it
honestly I don't know
right like you can't like say that for a
certain you don't really know how power
is going to change you
um
like
the only thing I would do
with power if I ever got it and I'm not
talking about there's two types of power
right
there's power over nature and power for
people
um
if I ever got power over like people I
just I wouldn't really like I didn't
know what to I don't care
um if I got power over nature I would
think about
really like how do you spread and
decentralize this power as much as
possible
no I don't think the anxiety comes from
economic insecurity I don't think this
is true
um
it seems to me that like
a lot of the people who experience
economic insecure experience economic
and security God are you some of their
new speak bullshit languages poor people
seem less anxious than rich people
you could say like I think people are
talking about not real issues
I think it might be less to lose yeah
please pick up
yes because the progress stop
actually no
well if you think about that like
well deaths of despair
maybe largely amongst the poor because
like
like you can yeah
you really do hate the poor don't you
some people didn't have the same
opportunities man
I hate the poor I think Society should
be fair
um and if you've noticed almost none of
my hate on this stream was to the poor
it was to the rich
I hate the oligarchy
don't hate the poor
um
you know that woman in Portland okay all
right I got nothing against her at all
shit man I want to eat free food and
smoke dope and sit around too right like
there's nothing wrong with her the
problem is
you know okay well where is this money
for the dope and the food coming from
was I ever impoverished
impoverished
what do you mean by impoverished that's
a good question
what do you mean by impoverished right
does impoverished mean you can't afford
food or does it mean you can't afford
first class on airlines
or does it mean that you can't afford a
car
right
80 of people would still choose to work
if they had enough money well yes and no
it's not a good thing
I'm incredibly anti-ubi
I must live somewhere that's not the US
I mean realistically if you said George
you have to move somewhere tomorrow I
moved to England like
it's because it's what I know
do I drink and code like alcohol I don't
drink much
I used to drink a lot more
if I feel suicidal if I lost all my
money fuck no
if I had lost all my money and like
someone stole it from me I'd be very
angry if I like lost a lot of money on
like what I considered a fair game man
I'd be motivated to make it back
no problem I'd probably find some area
of London my life
how does the job market respond when AI
gets really good
Your solution is to give people free
money
look at that
am I going to be as rich as Elon one day
no of course not
we both sit in front of a monitor in a
room yeah exactly like
can I link The Tick Tock otherwise
do not give people free money
there's no such thing as free money guys
where does the money come from
that's the problem
there's no such thing as free money
you can steal from other people yes
why do I think you've only got so rich
luck or fortunate
I always think there's weird shit
I feel like see someone who's rich and
they have to describe it to have to
ascribe it to luck
right
Elon worked incredibly hard
he's very smart and he did what it takes
thank you
if you're smart work hard and willing to
do what it takes
that's the problem I actually don't have
number three
my problem is not one or two it's three
and that's why there would be as much as
ill
I'm not willing to do it clicks I'm not
how do you earn money when all the labor
is automated
you know
when I hear this kind of shit
I hear the kind of like
you're just it's
[Music]
the kind
right you're like you're like asking the
question like what are we gonna do with
all like the poop from the Cars right
like how are we gonna fertilize the
fields when we no longer have all the
horse poop like
no okay you don't understand why people
are so angry about Elon because there's
a very coordinated campaign by very high
paid advertising agencies basically
again these ngos to Target evenly
right yeah not a conspiracy theory why
was Elon not invited to Joe Biden's
electric car sign right
I should stop at the shrooms
bro I haven't taken shrooms in like
three years
why did you think I'm crazy what am I
saying that upsets you
yeah I do think elon's gone a little
like unfortunately I don't think he's
ever had like
sustained media attacks against him
before and I think he's kind of like new
to it
he'll get better at it I think I think
he'll get better at it I think he's like
I don't know but then again this is my
take Elon is richer than me and Elon is
better at things than me so my take
might be wrong
hey I don't think endorsing voting for
Republicans was smart
only go smart
um
wait not voting that's the only way to
vote
what about jobs what are we going to do
about the horse poop when everyone has
cars how are we going to fertilize the
fields
no again they hate him because there's a
very sustained campaign by a group of
people to spread anti-elon sentiment
most of the people who hate Elon don't
think for themselves very much
they used to love him exactly
if your opinion on a person changes so
much and it's not like Drake where you
actually started sucking
uh jobs are going to go away after the
invention of AGI watch humans need not
apply
more democracy
what AI drinks better than Drake
should we not hate Kanye who hates Kanye
you hate Kanye
why
he said something like you know he said
some Shock talk shit like
I'm using Gay Fish Man
yeah talking about it
you know
foreign
where like come out with a good album
come out with like a sick ass album and
all will be forgiven
right
like I think this music got kind of
shitty and I think he like went off from
like the deep end with bullshit
I don't hate him
I don't hit Drake I just think he sucks
um
but Donna wasn't good like can you name
a song off danda like I can't
it's okay but it's no My Beautiful Dark
Twisted Fantasy it's no 808s and
heartbreak
Gypsy ghost was okay
how do people get scammed into voting
for Biden I think I'm voting for Biden
in 2024 I put some money on him
who else you're gonna vote for are you
gonna vote for Donald Trump
go over Ron DeSantis does it matter
they keep you distracted with this
stupid like who you voting for in
American Idol man
like I know I say don't vote but I put
money on Biden no I legit put money on
buying
um so you know we gotta we gotta we
gotta go buy them because I put mine
do I think Kanye lost it no I don't
think he like lost it like he's super
crazy I think he like you know
no there's no they guys
hmm
would people assume George thinks the
way they do it exactly shares their
politics
I have like these things that I'm
talking about are not really political
opinions I have the most boring Centrist
political opinions
I think things like
the government should be less corrupt
I'm big on that one I'm big on that one
Connie denies the island called
Holocaust he's not a historian
like what
aware man that's like his opinion bro
nobody's actually going out there and
like killing people well shit man maybe
I'll have a different opinion about him
I can't call him Joe Rogan
politics is gay
why didn't I talk with Lex maybe see
whatever you think
I don't think Rowan's a CIA spook
Joe Ryan Rogan's got a stick Me Fighting
Man you nerd you come on my show you
explain nerd stuff to fighting man
Fighting Man understands
[Laughter]
yo I wanted to go on Sky Breeze date Sky
Breeze stream
bro I don't know if Carmike did Rogan
is Andrew taking jail in Romania
foreign
podcasts these days I don't know
and I never really listen to that much
Lex Friedman just when someone
recommends me an episode
I do not do psychedelics often and I
definitely would no fucking way would I
do psychedelics with Joe Rogan and this
is nothing against Joe Rogan at all this
is just like
like set and setting bro like I'd have
an awful trip I'd be so self-conscious
you know
like yeah you know if he offers me a
whiskey all right we'll drink our Rogue
we'll smoke a little weed just a little
Lex Friedman is a Briston like I know
the guy
he's not like like what do you mean a
br's job he made a podcast and he's
doing his best
thank you
I know this is YouTubers who are like so
toxic I'm not hating on Rogan I'm not
hating on Rogan I'm literally not
hitting on Rogan what I'm saying is I
psychologically would freak the fuck out
like dude I don't care about your yoga
right now
psychedelics or best enjoyed with old
friends in a basement in this chill
who's the Prime Adrian
[Music]
thank you and pull requests not reading
all that but happy for you or sorry that
happened death team I think you realized
that there was a new to do on your stack
detecting troll issues in this issue
section I already looked into it and
shared my findings in this repository
let me know if I can be of any help for
real this is great yeah I also make
you some kid of actions actions and auto
closes issues not match the specific
regex patterns you will really try hard
all right this is what I'm gonna put on
after we're done with the Stream
yeah in the woods with your friends man
there's doctor business about what
happened to doctor disrespect remember
this was like weird Scandal about that
did he say good things about me or bad
things you know I'm like Trump you got
to say good things about me
because I'm an asshole all right cool we
have something in common all right all
right good we got a good starting point
do I want to be Trump's VP fuck no
I'm not getting Mike Pence
is the Devil exist I think brand new
said it best when they said the devil
and God are raging inside me
and we filed a lawsuit in one
probably still cheats on his wife and
yeah hey look man to each other wrong
yeah I don't think LSD alone doesn't
sound like my idea
now let's just go gonna walk later
no no no no no he's not bad because he
was streaming in a public restroom I
don't buy that
uh what drugs did I start with you know
there's a reason you can't say drugs
the Box
all right I had four slices of this
pizza that's a lot of pizza
yeah it's probably some boring business
reason you know
but I'd never know who Dr disrespect is
for it wasn't for that Scandal so
oh we're getting the uh we're getting
the the low IQ drug askers
what are you think about the culture for
cannabis for work
drugs make you worse at everything
except maybe for up to 400 milligrams of
caffeine a day
yeah he lied about an offer from a
competing streaming platform this all
sounds more plausible
modafinil
I'm open to modafinil as well Maybe
Maybe
um
speed does not make you better at things
that makes you think you're better at
things
amphetamine is not does not this is oh
my God why am I repeating the stuff that
you'll like find pinned in our New
Tropics
if Corn's bullish on modafinil it's an
interesting one
I I trust whatever conclusion Gordon
reaches on things
does make your piece smell bad it's
sulfur-based
sub only looking real nice we'll get rid
of the Tweakers sweet turn on sub mode
none of you Subs are Tweakers right damn
tweakers
Tweakers and junkies bro
my friend asked me to prescribe her
modafinil last month
and we don't discuss sourcing in here
have I met skreli no but I think it'd be
cool to hang out with
like if squarely ever like you know he's
like you know he's like the kind of guy
who like you hang out with with a few
people if we're ever you know I ever
want to go get drinks and some like bar
in Williamsburg I'm down
aren't like 50 of Engineers on ADHD meds
I don't think so
I think it's probably even whatever
percent is the normal always assume it's
the mean
if I talked before
I smoked a wool this morning
I heard poses on G now
just be pollen V
amps
have you ever indulged the consumption
of marijuana by talking sir
there's no such thing as ADHD guys
it's a made-up excuse for you guys to be
fucking Tweakers man
no I have ADHD I'm not a tweaker I use
this Adderall responsibly to make my
condition you're a fucking tweaker bro
now look
I don't think you're a terrible person
because you're a tweaker I'm sure a lot
of tweakers are nice guys but you're a
tweaker and let's acknowledge that
no I use these opiates to responsibly
manage my pain I'm Dr house no you're a
fucking junkie bro
twiggers and Junkies
now look I'm actually more sympathetic
to the junkies and the tweakers like if
you're actually in chronic pain
I I just imagine life is so unbearable
um
if you're actually in chronic pain
uh
yeah tweakers
Tweakers just just don't whatever drugs
you use do not
intellectualize that they are for a
medical condition okay like you're just
a drug addict man like I'm a drug addict
I drink High balls man
I'm I'm addicted to this shit I'm upset
if I don't have it I go to withdrawals
if I don't have it I will walk I will
leave my house to go in the morning to
get caffeine
I'm a drug addict
or alcoholics tweakers
no they're alcoholics we have a word for
that
now emotionally in chronic pain yeah
yeah yeah yeah yeah
my anti-psychiatry prescriber
okay is bipolar disorder real yes but 90
of people who are diagnosed with it
don't have it the people who have it
maybe ADHD is real but it's like like I
don't know like
I've met people who are schizophrenic
and bipolar and like
dude
it's not you're not it's not like the
people who are like anxious depressed or
have ADD no no no these people want to
like
like holy shit man so for those people
yes Psychiatry is this absolutely
wonderful thing
right
um for everybody else you're just
rationalizing being a drug addict
moderate usage of marijuana or alcohol
or tobacco are you're not a drug addict
moderate usage of alcohol marijuana
tobacco caffeine
at appropriate times in appropriate
settings
uh
look there's a reason like this is the
norm of society that we've kind of
converged on okay
I think the CIA had any involvement in
Terry's death I I don't think so
for every person who uh
thinks the CIA is out to get them
for every person who the CIA is out to
get there's 99 other people who think
that the CIA is out to get them
uh was this a crash coming it's gonna be
interesting to see what it looks like
um I think you should buy silver but
that's just that's just my take
no it sucks to be that one person
all right like you don't understand the
cia's actually
maybe it's a thousand to one
maybe it's a thousand to one you're out
to get the CIA well shit man don't let
them know no you can let them know they
don't care
all right no no no no no all right every
time we mention Hitler the CIA Kanye and
drugs this is just just low brow content
you know low brow
all right where were we can we put the
chiptune back on no if I put the
chiptune back on
we need
all right all right I know we can't be
copyrighted
all right
come on it can't be copyrighted right
look I'm not a doctor if you actually
take my medical advice you're an idiot
oh I saw it from this guy on the
internet
don't don't don't listen to me man don't
if you actually have a medical thing you
I look man I think that most doctors are
totally full of shit but like that's
like my opinion man you know you should
consult a doctor and ask them what their
opinion is it's probably the doctors
aren't full of shit
all right is this copyrighted music
what do we think guys
oh wow hi I enabled subscriber only mode
of just the right time
wait all right how about this thousand
Hertz sine wave
oh that's that's just grating
it's just great
[Music]
[Laughter]
um
Mozart's not copyrighted right
can't copyright Mozart
[Music]
thank you
[Music]
so many copyrighted dude you guys are
triggering me come on we got it we got a
code guys we got a code we've got off
the rails we brought up the Unabomber
Manifesto we read the Bible we talked
about the CIA and drugs oh God
even talked about Kanye and Elon oh no
no shit guys
I think I have ADHD
I think I have adult ADHD
oh my God
do I need an amphetamine prescription so
that I can stay focused on my work
his latest album was fire bro
[Music]
well keep still dropping albums you know
well Peep's still dropping out of them
shit
all right well I didn't read the whisper
license it turns out that you're not
allowed to use whisper if you don't
believe in AI safety
[Music]
foreign
thank you
[Music]
[Music]
foreign
[Music]
have to have an implementation of this
somewhere
[Music]
thank you
[Music]
[Music]
[Music]
foreign
[Music]
foreign
foreign
thank you
[Music]
foreign
[Music]
[Music]
[Music]
[Music]
foreign
[Music]
[Music]
[Music]
thank you
[Music]
foreign
[Music]
[Music]
thank you
[Music]
foreign
I can just do XA or X you're right
that's much better
thank you why by lock I remember why I
streamed some people give me
smart ideas yeah we're gonna write
beautiful attention and we're gonna use
it everywhere I'm sick of rewriting that
all the time
I promise they're all subtly different
thank you
[Music]
[Music]
foreign
[Music]
thank you
[Music]
[Music]
thank you
[Music]
[Music]
[Music]
thank you
we have to make true work
we have to make this work
foreign
[Music]
[Music]
[Music]
what happens if I don't put anything in
for X
oh I guess I have to put in like a start
of
frame text s
you'd have to put in like a start token
all right maybe I don't have to put in
anything it'll just give me one
[Music]
foreign
[Music]
foreign
I don't think I have to do that if I do
what I'm betting I can do this from
[Music]
report to this idx's tense uh okay
I do need a tensor here
okay
good news is these Transformers are
pretty short
[Music]
foreign
[Music]
[Music]
[Music]
foreign
[Music]
foreign
[Music]
[Music]
[Music]
[Music]
foreign
[Music]
foreign
[Music]
[Music]
[Music]
nothing should be flattening out what
oh
this is super misleading
so that's really where it prints that's
awful
wow tiny red socks
uh we gotta include how do we not
include the shape
foreign
[Music]
[Music]
foreign
[Music]
[Music]
[Music]
foreign
[Music]
wait it can't just be this in reverse
yeah
does that just work
how do they do that
transpose it or do they not oh here
torture transpose okay I just missed the
transpose okay whatever
okay I guess that just works yo
all right now let's sample
foreign
[Music]
[Music]
[Music]
let's look at the whisper test
uh okay so first off we have to sample
foreign
[Music]
foreign
foreign
[Music]
[Music]
[Music]
your biggest is file
well not bad it just sucks
[Music]
foreign
[Music]
[Music]
[Music]
laughs
[Music]
foreign
[Music]
[Music]
foreign
[Music]
special guys
[Music]
foreign
[Music]
[Music]
oh come on
really
[Music]
oh
my God
things to do with their life
languages dot keys
[Music]
oh come on this is a joke
I got I need this shit
foreign
you can't just do English
trust me I would just do English if I
could these aren't even real languages
I was gonna pick one out but that'd be
offensive to those people and I have to
make one of them all equally
but some of these things are not real
languages
Hawaiian
shit I've heard of a Hawaiian pizza but
that one's okay to make fun of because
it's America and you can make fun of
America
but you know there's someone here that
you can't make fun of
[Music]
and I made Bob
foreign
[Music]
[Music]
[Music]
[Music]
[Music]
it's offensive that there's not a way to
like write that in Python that isn't
that
[Music]
how did that live from playing before
did I delete that somehow
the Commit This
thank you
now you didn't read the code if you
don't understand why I didn't have to
copy and paste all the languages
foreign
[Music]
thank you
I don't know your tests
[Music]
foreign
[Music]
[Music]
[Music]
[Music]
thank you
[Music]
okay so what what are those special
let me just clone this
[Music]
[Music]
[Music]
transcribe
[Music]
I was doing like sought somewhere
thank you
[Music]
how do you test tick token work
[Music]
[Music]
special token pass it to a lounge
special
dish Lounge special equals Dash
[Music]
that's not what I want
[Music]
foreign
[Music]
okay
we've put our audio in
let's go
okay
uh
okay LST
oh no how do I know how to move the
audio
foreign
do that
foreign
[Music]
no time stamps
all right what do we think do we think
it's functioning appropriately
we didn't do a mask we definitely have
to do that we'll just copy what I did
from llama
[Music]
[Music]
foreign
[Music]
we need to get it true does someone want
to do this in tiny grad can someone move
that to Tiny grad it's not actually hard
to do a tiny grad uh woe's parrot had
great breakthroughs and he wrote come
some and if you can write cumulative sum
then you can write Trio so if someone
wants to write that I'll appreciate you
[Music]
thank you
oh I don't know about that
what was fair thanks for subscribing
yeah yeah I was just saying this doesn't
have to be a numpy anymore you could
totally write that in uh
in turn again
my most parents are doing a lot of great
work in uh in the tiny grade repo
um what was parrot Jackie uh
uh
I don't wanna I don't wanna Rayanne
[Music]
uh this this person uh
has been doing
this this is this is a
um
why is disc tensors the default for
llama now because this test was fast as
fuck
this tense is fast I don't know if this
tense are not fast for you but just
tensor fast for me
oh sorry the comment is wrong
I know it says it's slow it's not
actually slow distensors for me is is uh
I get five gigabytes per second instead
of 3.4
um rayon HT this is a great pull request
but yeah most parents done a lot of
great stuff
um claimed a whole bunch of bounties
uh and now some some docs
uh really really beautiful compared to
the docks we had
uh no okay so one of the things we want
um
on uh
the comma three
the comma 3 has two microphones and a
speaker we'd love to be able to run
whisper llama and uh and and uh and some
talking that
I think I want to have a conversation
with an llm like a talking conversation
these things are about to be
unbelievable guys like the tech exists
completely today to do that
it's gonna be so mind-blowing
[Music]
thank you
foreign
[Music]
[Music]
but this model is so tiny that it
doesn't really matter yet
uh
what'd I do wrong oh I gotta fix uh
residual attention block to allow a mask
[Music]
[Music]
yeah you know I know whisper's just a
lot better than what I had
because they have better data sets
all right why am I getting no time
stamps
let's take a look Ryan HTT is here as
well
um we're gonna Grant if you've
contributed uh to
uh
my repos will make your VIP the channel
VIPs are generally when I see that
little heart
um
wait disk tensor is 3x slower on your
Mac
it's so fast on mine I'll show you
did you like do like uh like you're sure
you're on the latest one because it was
crappy
that's not even a good read like it gets
this is not in cash but
like 3.84 is faster than it ever was on
my computer
uh you sure you have the latest stuff
for master
it was slower in the previous but then I
fixed it just make sure those
make sure your stuff didn't break the
check
if there's one check that if you miss it
and if it uses the M map path it'll be
slower
oh wait on straight up latest master
no it shouldn't I tested on 311. like
look at what I'm getting
and I can Purge too like it's not
Purge uh empties the cache
so that'll empty the disk cache it's
actually faster because the memory is
not fragmented yeah look at that that's
what I get with distancers
4.88 when I have clean memory
I don't you have a M1 Max how is yours
slower than mine
um I don't think Thailand version
matters I'm sorry
I think it's normal that one
M1 Pro
look into why that's slow it should not
be slow look I'm getting 4.76 gigabytes
per second I've never seen it be this
fast
that's when I purge the disk cache on
top basically only cash lava
but with no cash at all I get similar
stuff
but you see me doing it right
you see why I merged disc tensors right
there they're 50 faster for me
[Music]
okay
oh
this isn't right that should be that
okay no speech
that might be correct I don't really
know
a lot of things could be wrong right now
chapter 16.
I might have told you of the beginning
of this liaison in a few lines but I
wanted you to see every step by which we
came I too agree to whatever Marguerite
wished
or did I remember to actually pass in a
mask yeah
yeah that's all correct
I don't think that's the problem it's
saying no speech
which again I don't even know like how
many symbols do I have to decode
what's the oh I mean I guess it's a
Transformer so it's one to one
so what's the uh shape of logs back
oh it's huge
no actually I don't know I don't know if
that's the I don't know which dimension
is which
all right a lot of no speech
but it should be should be 80.
80 is which dimension
you should actually need to even pass
that in I should just be able to it
should just do that
oh
I guess I have to pass on something
yes it's just like it's it's cross
attention it's a conditioner
but it's pretty straightforward so we
run the encoder
we can break this up if we want
we need to rerun the encoder every time
I can just run the encoder once right
right
I think so
I don't really know
oh I shouldn't call it ank
um
foreign
let's look at the sound
what
sound doesn't look great
I don't think that's what the sound's
supposed to look like
there's probably something wrong in the
encoder
let's look at logs back and see if it
looks better
so that's what logs back that should be
viewable as an image too
yeah okay that looks like sound
looks like sound right look at the sound
boys look at the sound
you see the sound
that doesn't look like sound my code is
broken
um there might be a problem with lodest
state
yeah we get to stay stick to the model
not the state
um
well I see the problem
uh is because I forgot
what is all this
yeah encoded up positional embedding ah
just sort this
okay
encoder.positional embedding is the one
I'm missing
I didn't I didn't do the position
embedding on the encoder
sinusoids
what
what
how does it know the shape
does it change
they're all the same size
this doesn't make sense
how come there's no cut there
end males and CTX
well
I do also have asserts in here to make
sure they're the right size right I
guess that'll just be done in shape
so I want to just throw something here
like
uh
uh self-doubosition batting with this
tensor dot empty
I did empty for the other one did it not
decoder
yeah
let's just work
got rid of that one at least
oh I forgot to enable cross attention in
the decoder too
okay great
uh okay let's get rid of this image
because that one looks good now let's
look at the encoded image and see if it
looks good
foreign
yeah I don't understand this this must
be some pie torch garbage
I think this had the same problem with
like the same bug in uh
Facebook thing
whatever
it's an easy fix
all right
no
okay
oh
that looks more like audio looks better
marginally better
it works
well chapter 16 I might have told you
the beginning of this liaison in a few
fuck yeah bro I love Transformers I love
Transformers it's just so easy
yo
[Music]
this just is so easy boys
you can't even mess it up
fire that's fire
I don't need to prove that and let's
just keep going
yeah buddy
chapter 16 I might have told you at the
beginning of this liaison in a few lines
but I wanted you to see every step by
which we came I too agree to whatever
Mark Reed wished
and see if that's what it said
is that what it said
six I might have told you
in a few lines but I wanted you to see
every step by which we came I too agree
to whatever Marguerite wished
higher
it's so easy to make these things work
it was more that was marginally harder
than llama
like also notice the performance is not
bad
okay
oh I'm sure I'm sure it's faster than R
and Mt
we need to write a key value cash we
didn't even put it in the jet
all right should we throw a quick key
value cache together
they don't even need a key value cache
this is just fast
oh I think it's just imagining shit now
because it got the end of text token
I don't know whatever
okay let's see if we can make it live
uh all right
python capture audio
did I do this in tiny voice I might have
done this in tiny voice
yeah okay
no to say commands the other way around
foreign
probably work at any sample rate I
probably don't actually need that
foreign
foreign
hello twitch can you hear me
the fuck
foreign
oh
hello twitch Maybe
expected scalar type double but found
float
yes yes
okay magnitudes
is that I don't know
oh that's like up casting and I say
hello hello
okay it's something
uh
that's fine
probably not well normalized
hello hello hello
it's not too far off
I can definitely fault it for Hello
below
hello twitch can you hear me
bro
bro how boss was that
all right now to do it live let's do it
live boys let's do it live
and I'll do it live and then we'll call
it a stream what do you think
somehow despite all the talk of Hitler
and Kanye and the Unabomber
foreign
somehow despite all the talk of Hitler
Kanye and the Unabomber we did things
we needed to really just keep going I
don't know okay
wait no really how fire is whisper guys
is this great or what
okay uh let's do it live
foreign
we'll say we can try to pipe it to llama
okay get ready for the worst crappy
looking code ever that
I really want that to be a multiple
oh shit
is it really that slow oh those are
probably slow
no I I don't think that it's slow in
general
it's all probably fast
First Column might still be slow
and then wait this is hop length
so we want it to be a multiple of that
or nfft
we want our chunk to be a multiple of
that
uh okay it's not cool with that just
fine
foreign
[Music]
don't like that then
uh
what
okay whatever
yeah it makes sense that we're gonna be
10 all right cool
uh let's see if we can run the encoder
make sure we didn't break it
right
all right let's see if we can run the
encoder in real time
I wanted to go
yeah I don't even understand that
shouldn't be the input
why does that one get a one and that one
not have one
what did I do wrong
oh I had like a weird reshape somewhere
yeah it's here
sweet
okay it's that one we're gonna have to
concatenate it at
um
foreign
it's got to be a way to set the buffer
right
do you hear any speech is there any
speech
we're gonna have to make this fast in
order to make this real time
oh
no that's only running the encoder where
I have to
testing the decoder does it work does it
work does it work no
foreign
does this work
foreign
foreign
United just nerfed their miles
oh is it going
testing testing one two three
okay we have to look for this end of
text
hello do you hear any speech
hello do you hear any speech in real
time
what the hell I mean you saw this
oh
you can't do this
I can't do this
I can only do this if I change the
offset
where is it uh encoder here
here we go
I'm actually not even sure I can do that
I think I have to put it all through the
encoder again let's just do that
I have to concat it at the encoder level
um
numpy can actually cat like that
what
oh what is that
true that
wrong
did I end up changing that at all
why is that only 10 there
shouldn't be 10.
uh oh
okay that works let's log spec.shape
interesting numpy garbage
yeah it's that why was it why is it
different here
do I need to compound access zero I
don't think so
oh I'm actually doing numpy there
let's just prep audio already do numpy
it doesn't unpause what
no no that shit's throwing axis
maybe it's the right Axis I don't know
hang on
no okay maybe it is the right access I
just got through uh instead of one I
gotta do two
but this still doesn't explain it
so let me explain why that doesn't work
oh it does work okay
um
coming out
cut it out that's coming out about that
does that work
that doesn't work
why not
oh cause I'm putting in total here and
not that oops that true that
you know that that episode of BoJack
Horseman where he just says true that
this is only line in the movie
that's his only line in the movie can
you hear me when I talk come on work
okay let's see if this is gonna work we
gotta just keep talking yeah why does it
say no speech all right there we go I
gotta just keep top top top top yeah all
right
this is laggy as fuck boys
okay
all right so we're gonna need like a key
value cash and a bunch of things and
foreign
but are you listening
are you really listening oh I took away
my print
it's vram
nothing
okay hopefully now with the Q drain this
actually works and we'll start to pick
up on my speech
while not Q dot empty Q get
and why that didn't work
okay are you listening now or I guess
you got to get lucky with the one that
it hits I don't know what that garbage
is
no I can't really do that
okay it's gonna record for a few seconds
and then we'll see if it actually
listens let's say
okay we'll keep going we're gonna keep
talking yeah a few few few few
yeah yeah but I don't okay it's gonna
record for a few seconds and then we oh
I didn't reset the uh I say
uh we're gonna reset this too
okay it's gonna record for a few seconds
and then we gotta see if it actually
listens but no okay we have another
problem
we have another problem and that's that
the chunks are too large
uh let's take the chunk down to that
useless shit
all right then we're gonna have to do
this
we want to do
uh chunk divided by 160 I think
well 160 is like a real thing hop length
whatever
okay is this gonna work
it's fast now let's see
it says no speech no time stamps okay
yeah all all
is this going to work it's important
that you talk right when it starts
listening
that should be right though
foreign
testing does this work does this work
are you listening
again I removed the print
how do I keep doing that all right it's
it's almost the end of the stream I
think this is mostly what we came here
for it's working kind of
I think this is mostly what we came here
for it's gonna listen and what okay why
is it doing this now analysis analysis
and what and what and what and what and
what
what did I break
did I break something
like I had this working
foreign
does this work now let's see if this
works now
something's broken
this one's still good
oh
no that's numpy that's right
okay live getting it's gonna get things
from the thing and now we'll actually do
anything
from the things why is it doing this
why is it this any different from this
okay we don't want to have no speech so
I'm just going to keep talking and
should eventually get something
why does that one why does this one work
so well and the other one not work
Arc Max decoding
no that's not the problem
constantly hearing speech Let's go maybe
it's overflowing oh maybe times three is
too much
when I put that times three
would I put that times three let's see
if it works now does it listen
it just puts a lot of dots
I don't understand like this should
actually be the exact same thing as
thank you
do you listen live or not let's see what
happens okay
remember this was like kind of working
like how did I break it
a little state
the tax repeats because we keep
concatenating it to total
I mean I know something that should kind
of fix it what if we make the chunk
bigger
it's possible that this stuff has to do
with ffts being okay it's possible that
this has to do with ffts being bad and
oh
text repeats because if you keep
concatenating it to total I'm gonna get
a new one off the queue every time
okay now that'll tell me how backed up
the queue is let's see
can I do the length of the cube does
that work
should I drain the cue into this process
oh here I know what I can do
um
okay
yeah yeah yeah yeah
um
okay that'll wait until it receives the
first thing let's see if it works now
why doesn't this work
Q dot empty
total should not be not
why do I keep getting rid of that print
I don't understand
so why do I keep doing that
I think I just think it's debugging and
I get rid of it and that doesn't make
any sense because it's not debugging
trunks are for the fft I should have
them as a power of two
I mean
foreign
okay well now we move the thing out of
the thing so now let's see
okay now we'll straight up concatenate
the waveform
okay now we're straight up just going to
concatenate the waveform and if this
doesn't work I don't know what could
possibly work
there we go
okay so the prep audio you can't do that
incrementally bro I don't even
understand but who cares bro cause it
works
thank you
uh okay
live whisper
all right guys um we do have to think
for a minute about the AI safety
implications of this
um somebody could use this
to record
someone someone's
talk and then put it in it that's too
hard no never mind never mind we have to
hire an AI ethicist I can't do this it's
too hard guys it's too
Okay so
some some future directions
uh
uh first off we need this to be faster
so I think there's a few ways to do that
um
so Ray and HTT let's get lava under 100
milliseconds and let's start you know I
think it's going to take some effort to
Upstream that stuff but a thousand
dollars would be the largest Bounty paid
out by the tiny Corp
um and yeah no I think it's you it's
going to be over 2x faster in running
things uh we can also jit a whole lot of
this
um we should actually be able to get
no I guess not the attention but we
should be able to Jet a lot of the stuff
uh which would make this fast
um then once Whispers fast what we want
to do is we want to pipe the output of
whisper into llama
and then we want to pipe the output of
llama into say and then we can have a
fucking conversation you know what I
mean
and then we'll get rid of say and we'll
replace it with one of them Gans that
makes it sound like sexy again if
they're sexy Gan can you like take a gan
and you put your voice into it and then
it makes you sound sexy man you know
what I mean like sexy again I think sexy
Gan would be great uh you know it's very
useful
uh okay cool
um
can't death master
all right whisper
I had to come 1D those universally good
changes to the state dick loading
and I've got the universally good change
to wrapper of tensor okay cool
so I see no reason we can't merge that
I'll merge the pr
and then we're done
uh I want to thank you all for coming on
my stream today and watching uh it's my
viewers understanding it's my viewers
understanding it's my viewers great
uh whisper I know you can do a better
job than that this is your last chance
to impress the people and if you want to
do a crappy job
oh
this is wrong
yeah hang on
this is wrong
yeah
we do have to do 10 here
let's see if that works
you have to do 10d codes for every
encode because otherwise you're going to
have a bad time
are you listening now can you hear me
now can you hear me now are you
listening now can you hear me now
does this work what if I just do this
foreign
okay once we've ended the text now we
just go back to okay this looks pretty
good yeah
yeah yeah yeah yeah yeah
okay we can't actually flush the tokens
we have to leave the old tokens in and I
can talk fast and hopefully whisper
still understands what I'm saying
problem is you can't actually flush
total there because it hasn't actually
oh okay how about this how about this
how about this
what's the length of waveform
okay
okay hopefully now we only remove the
symbols that we actually decoded and
let's see if that works look what I did
again I deleted that print statement I
loved leaving that print state
okay look now we only delete the things
that we actually managed to decode
do you work now whisper or your janky
whisper forever sad janky whisper
forever
this is not exactly right either
oh no no no no this isn't right
what okay first off why to make the
chunk bigger don't make the chunk bigger
second off this should be one
okay
I think that's right now I think we're
removing the correct thing
I don't know
what if I just don't do anything
I got rid of the prince thing
so what if I just keep on decoding does
this break anything
foreign
Transformers
how many symbols are there per thingy
why do I just keep doing that
oh okay okay okay okay good luck look we
have a ratio now
it's five
yeah it's not 160 times length of list
oh maybe it is
God I don't know
that equals to five maybe it's 320.
how many thingies does this turn into
okay if we have 10 it turns into five
and that's these thingies
which how much total is that
okay if we have 1600 it turns into five
so what's sixteen hundred
divided by 5. it's 320. so that was
right
if you have 16 420 it turns into 57.
now do we decode one of those for every
like
I guess that's something I don't
understand
oh I also think it's maybe
hello is this working now
whisper why do you love to repeat
yourself why can't you just listen and
output the text
okay I mean clearly this is wrong
foreign
okay we won't cut anything off we'll
just reset it every time this has to
work and watch what it's going to do
now we try multiple times to decode the
shit and eventually it gets it
foreign
this is the best one we've got so far
I'm not breaking when there's an end of
text
no that no
no that's not what you do
foreign
is afterward it starts going to the
bigger stuff right
small is actually going to be that much
slower
foreign
gold account for fast download speeds
from open AI
wait I didn't remove the print did I
no I didn't remove the print
do not remove print it's very important
okay
this is small whisper now better whisper
small whisper is so good it never makes
mistakes it's perfect every time
I'll take it
foreign
it's gonna be fire when someone makes
this real time
small whisper is perfect
all right we gotta get Rand stuff merged
we gotta get the Phillip HT keeps
talking about how his Matrix multiplies
were so fire
we got to get those Matrix multiplies in
there
if we could get those Matrix multiplies
in along with the other speed UPS along
with the jet we'll be whispering and
alarming in real time
we're gonna have a conversation with AI
all in tiny grab
all right guys
get push
I'll merge that in
maybe we'll play more tomorrow
thank you for watching today's stream
um
and yeah you know I don't like don't
kill anyone as a sign off because you
know I hope I don't have any murderers
man like once your audience grows to a
certain size you have murderers and like
I don't know I'll be streaming for a
bunch of damn murderers man you know you
want to talk about people I hate like
legit
like murders bro
and like yeah there's different degrees
to it right like I don't know like
I don't think all murderers should be
should be treated the same I think
there's like you know I mean the prison
hierarchy is all pretty good right like
everyone's cool with the prison
hierarchy basically right
like you know
like you know all this this guy owed me
a lot of money man he'd been buying
drugs for me for years and he stiffed me
and then I just showed up and when I got
so pissed off I shot him in the face
all right all right all right you know
but then like you know like like people
like mess with like kids and women and
stuff no I see like the prison hierarchy
is real man look man I was just the
getaway driver bro they got me for armed
robbery man I didn't even have a gun
this is some fucking bullshit like that
guy's fine in prison man you know just
don't be don't be a fucking like child
you know women it's just not like you
know what I mean so like prisons got it
real man prisons got it real and if you
do the kind of crime I do with computers
people don't really know what to think
of you but when you show them that you
know things about the lawn can help them
fire legal appeals and fuck with
you all ready
uh
what was I gonna
what what's that uh hey
this looks this looks easy uh is it is
it is it guitar time
might be it might be uh guitar time
tune the guitar though it's gonna take
time uh good morning everybody Welcome
to My Stream I promise we're gonna
answer the question uh can you fit a
llama in a tiny grad
um the answer is no
psych you can fit everything at a time
you grad
uh
uh you know I wouldn't I wouldn't lie to
you I don't I'm not the media
I don't ask you bait questions
are workers demanding too much
our employers demanding too much of
workers experts say
all right we're gonna have to tune the
guitar
down a little bit so we can take it
didn't work
there we go so we can see the guitar
so this is this is
we have our guitar tuning app we got we
got two in the guitar we've got that we
got an app you guys can see the app sort
of
two
oh I got you know
I hit the guitar while I was fixing my
lighting I'm like we have to play guitar
in a long time to show I do that
all right
[Music]
I'm gonna try this song before so let's
say
[Music]
uh you know you guys know I've been I've
been oh B minor is impossible to play
[Music]
does that be minor something like that
[Music]
resolution oh my microphone's all the
way down here
[Music]
[Music]
Deadpool
self-awareness loving parents harmless
fun
but backlash to the backlash to the
thing that's just begun this
there it is
again that funny feeling
that funny feeling
there it is
[Music]
fun feeling
that funny feeling
okay
um
good morning everybody we gotta go get
coffee too we're really we're really
unprepared for this stream you guys you
got the guitar part of the morning on
stream
you got the um
you know I just I just think this is uh
this is really it's a really beautiful
song uh you know it's kind of how I feel
man
you guys know
you guys know about Singularity right
you guys know like uh oh yeah yeah yeah
yeah what do they what do they say
yeah the live action Lion King the Pepsi
halftime show
000 years of this
seven more to go seven seven years guys
uh no I don't fall dude I don't know
Elon
I gave Elon some advice you can choose
to take it or not
um so far I haven't seen him think
foreign
coffee you guys know my advice free lawn
was right
be the stable alternative to the crazy
woke
you don't like my precariously balanced
books
um
this
chair is a Herman Miller uh sale chair
um you know if I was a model from The
Price is Right I would uh do you want to
know about the keyboard too this Vape is
an elf bar it's a
strawberry banana flavor I got it so I
could fit in with Zoomers
uh
no look I don't know whatever elon's
drama he's like fighting with some dude
I just like look man woke people are
losers don't be a loser yourself you
don't have to become them to fight them
the anti-woke and the woke are the same
thing the Republicans and the Democrats
are the same thing they are both
focusing you on things that do not
matter so you can fight about them while
they steal all the money
uh
um I'm seeing dirt marks on my screen
and it's kind of upsetting me
but it's time to see if a llama will fit
in a tiny Republicans and Nazis man
Republican the Nazis Democrats a
Communists man
you know let me tell you
there's no more Nazis they lost Nazis
are losers
wait and Republicans are losers shit
maybe they are Nazis
um who named it llama I don't know but
uh all right so let's start this stream
with uh introducing you to what llama is
okay so a llama is a uh it's this is a
llama
domesticated South Africa American and
camelid widely used as a meat and pack
animal oh I also want to take a minute
to chill for my trip to India
um you're not coming on my trip to India
so I don't know why I'm shelling to you
but um if you hypothetically were I'll
show you where I'll be going and you
guys can tell me uh if I'm an idiot or
give me any advice
um
there are still Communists yes
Communists are a real threat that is a
problem
uh have they read Alice wrote
uh
uh okay so I'm flying into Bengaluru
Bengaluru Bangalore
uh and I'm making it via bike to Mumbai
so we're gonna be going from here
to here
via bike well cycling's not available
but we're gonna do it
really which the lava says
if everyone's software was cool and
everything wasn't so
gay
[Laughter]
of
yo man we're fighting the woke boys
we're fighting the woke
honestly like the Yankee walk has gotten
worse to the woke like there's like the
people who pissed me off and back in
like 2014 the woke people really pissed
me off
um
and then like they stopped pissing me
off because the anti-walk people showed
up and they started pissing me off
uh
uh anti-woke people going based oh oh
all right so so we're going
from Bengaluru to Mumbai via uh
oh this route includes a fairy how sick
where's the Fairy Oh there's like
fairies here
well where is the ferry is it here no
um for this stuff we can probably stay
on the uh on the coast
where's the ferry
oh this one's definitely gonna need a
ferry but there's got to be a ferry here
at Bangkok yeah look the Bangkok port
and jetty
uh yeah no I do gotta go get vaccines oh
the ferry let me see we found the ferry
fuck Ferry yeah
this route includes a ferry
where's the ferry
not a fairy no but seriously where's the
ferry
oh
toll roads they'll make bicycles pay
tolls do they
all right well we don't know where the
ferry is but so that's the plan uh we're
gonna take a train for some of it we're
going to see Bangalore Goa and Mumbai
via bicycle so that's gonna happen okay
back to llamas no this isn't the Llama
we're talking about
what is a female llama called
huh
a male llama is called a macho and a
female llama is called en hembra I don't
trust Google
happy International women's day I want
to apologize to all the women who I
offended when I referred to software as
gay
some software is probably homosexual and
it was probably born that way if things
are still born that way
um
you know what I I we have to ask the
Llama how it identifies
um
ah
oh guys this is a woke Channel now
we're we're awoke on this channel this
is woke okay what do walk people do what
do we do we
uh
what do we do for a walk I don't know
what if I woke up tomorrow I was like I
want to join the world class
I don't think I can go on the street and
protest for black lives matter
no I think all the genders have been
invented there's 52 I think they're
refactoring now they realize some of the
genders are actually the same thing
um I do want to acknowledge my privilege
we are going to acknowledge uh I'm going
to acknowledge my privilege today
um I have more privilege than uh you
I don't understand why this is a bad
thing that's gonna have to be explained
to me
um
unearned privilege
if you win the lottery do you apologize
for it
how do we go on stream when we start
thinking about this shit I haven't
thought about woke shit since yesterday
when I was talking about Elon at lunch
um we need to acknowledge the lab we're
on uh we stole it from llamas there used
to be more llamas we stall it from them
um
[Music]
you know what I always say about
canceling me man one of these days
someone's gonna call my employer
actually I've got the gotten a few
sternly worded messages about things
I've done
um
this one time was one time I banned this
guy from Discord and then people sent
emails to my investors saying I
shouldn't aband this guy and I felt
really good about my decision to ban him
um and the guy who was complaining if I
knew who he was on Discord I would have
banned him too
um because you can't cave in to Crasher
if you ever cave into pressure people
will put more pressure on you see
there's two types of power in the world
there's there's like sane power and
there's power where compliance means
that they will ease up right most
government power is pretty sane if you
comply with what they want most like the
cops you know again if you comply for
the most part their power is sane and
then there's psychotic power psychotic
Power by complying they will increase
the demands of you and the woke power is
a psychotic power so you must never uh
you know uh give in to uh psychotic
power
but it is because of your compliance
that will never end and guess what Cove
it's over and it was came from a lab in
Wuhan and everyone knows that now I you
know I kind of want to go re-watch my
old covet streams and see if I like how
definitively I send that
I do remember we definitely looked into
the SARS lab escapes we definitely
looked into it
um you know it's the kind of thing where
you don't really want to
say it without evidence like it's the
kind of thing where it would not
surprise have surprised me in two weeks
if they came out with a uh an animal uh
an animal intermediary and a whole story
that made sense like they did for SARS
um
but uh you know that story hasn't come
out and uh
they deleted all the logs man when they
delete the logs
um
thank you thank you thank you I do I'm
happy I have that on record from like
April 2020 right
um
how will we ever know for sure
the commission of code
uh can we get to the Llama thing yeah
we'll get to the lot no it's like you
can't fit a llama in town you're grad
okay how many viewers we got wow 396
viewers okay can we get to the Llama
thing are you a subscriber you're a
prime gaming does that mean I get money
from you
wait
the people who just have
blue crowns I don't get any money from
only if they have the star I get money
from them
oh you can sub for free and you're not
subbed to me
wait you better be using that sub for
somebody else
wow blue crowns are like the new blue
check
sub is 199.
I just realized I don't get any money
from what is this funny I don't know I
don't know how computers work guys
because the singularity is real seven
more to go you know
um hey hey hey hey hey hey hey hey hey
hey that's how money Works in this
country
we give money to millionaires that's
right so they can get rich and they can
consolidate their wealth so it can
trickle back down to you it's called
trickle-down economics
it was invented by Arnold Schwarz Ronald
Reagan in the 80s
um
would better wait till it's YouTube you
used your freebie for a guy streaming
rocket launches all right that's fair
um
level four we have a level four hype
train going on oh that's pretty good oh
we got 10 gift Subs cryptocod three
thank you for gifting Subs I've seen you
give Subs before I appreciate you
um you know my my income is down because
the tiny Corp doesn't make any money
uh
biscuit coin congratulations uh yeah the
tiny Corp doesn't make any money so
we've been poor
um you know putting gas in my Rolls
Royce has been a struggle uh
so yeah we need we need contracts uh we
also found a bug in comma's accounting
and we're not gonna go into it too much
but you know how there's car to Monopoly
that says Bank error in your favor well
I'll tell you about Ben Garrus they're
not usually in your favor
um how to donate to Tiny Grand we don't
accept donations yet one very nice guy
reached out and wanted to like give like
a ten thousand dollar Grant
and I'm not sure exactly how I feel
about that yet
um
uh
uh because I don't know I don't really
like I don't know I don't really want to
take donations for it what I'd rather do
is I'd rather like companies fund it who
are actually using it
like I'm fine with a donation or a grant
from somebody who like wants something
specifically built for a purpose because
I mean part of the value that like
making money as the tiny Corp gives me
and part of the value that actually
making money is comma uh you know comma
makes money and like I say this a lot
you know I'm a capitalist I love
capitalism uh well Lil Wayne had a good
line about I hang out with capitalists I
haven't don't hang out with broke people
um
uh
level four hype train can we reach level
five guys I don't think the levels stop
I think we got to a really high level
once
um
oh we gotta order some food let's get
some Thai food I love Thai food boys all
right let's get some Thai foods and Thai
iced tea we're gonna we're gonna get
into it don't worry don't worry it's not
just it's not just guitars and you know
talking about how we hate anti-walk
people more than welcome people
um
you know what people are hardcore man
any woke people are pussies
it's true it's true
um
what people believe in their cause
anti-walk people kind of believe in
their cause
it's a problem Republicans just aren't
serious man and all those kind of people
they're not serious
remember there were a bunch of
Libertarians once
uh Libertarians really are
yeah you can have a nine percent tip
because you brought it to my door see
thanks for tipping George
um
I know I swear we're gonna do things
this stream I'm reordering the same
thing I get a crab fried rice and a Thai
iced tea man I love crab fried rice
no you don't get a tip beforehand 100
thank you thank you what did we get
oh yeah oh yeah crypto Cod thank you
thank you thank you
um do you have a question by the way
uh I'll answer any question even if it's
about keyboards and stuff
um do I ever make my own food uh yeah
sometimes what you wanna remember the
time I made a burger on stream
um
yeah oh capitalism but the great thing
about capitalism is capitalism is based
around consent right capitalism is based
around and this is good capitalism this
is why you can't have capitalism without
government I I talk about this in a blog
post uh you need governments to enforce
laws to make consent more possible and
capitalism is based around consent
between a buyer and a seller right
um so you can think about a law of it
like you know puts uh calories on the
menu right
um and this is good because it really
increases consent like the the the buyer
has a right to be informed about what
they're buying right you know if a
seller says something is you know one
pound of gold it can't just be
gold-plated like a magic card right
solid gold Magic
um oh it's level six hype train wow
what's going on here
this is all this crypto Cod pulling for
you guys uh it probably is man
um visit uh level six hybrid visit
Nebraska again I don't know when I'm
going to Nebraska again
um I tried to drive to Vegas last
weekend it didn't work and because like
the snow broke the road or something
uh he meant questions from crypto card
oh yeah not for everybody
that's right your CS exam is written
that's right you can't pimp MasterChef
thank you for gifting Subs I've seen you
around for a while too
what do I think well well made it
um what does this have to do with
capitalism if you don't tip or yeah back
to my point capitalism is based around
consent and the buyers of your thing are
great judges about whether your thing is
good or bad so if people are we did a
contract with the tiny Corp we made a
thousand dollars and I think a thousand
dollars is actually worth it for his
example he was using TF light which is a
you know a pain to use because it's
Google and Google makes things a pain to
you yeah we can get into that some other
time
um
uh
uh theoretically capitalism could exist
without any government oversight no it
can't no it can't and you can go into
why uh it can't right you need a
government actually to ensure that the
market stays free
um
because otherwise
uh the cable company will send the goons
to your house and make you buy their
cable oh wait they already do that
um a person on Twitch for 2069 thank you
for subscribing
would anyone else like to subscribe
I think about college is you should be
muted because you're not a subscriber
and that's a stupid fucking question
um you subscribed and we're not thanked
ethan1g thank you for subscribing did we
just get our hype train to level seven
let's go let's get the Llama hype going
all right all right all right all right
all right all right so let's let's Lama
okay so what is llama actually llama is
a large language model released by
Facebook
um by the way uh Facebook is a great
company
um Facebook is doing great things for ML
uh Facebook made pytorch uh
unfortunately Google sucks now and
everything they made sucks uh like
tensorflow and closed Source tpus but
shout out zoc um look Zach you cost me
80k last year on on meta uh but you know
if I had held the stock I would have
made it mostly back but I didn't hold
the stock so I'm happy that your Stock's
going back up I wish you all the best
and thank you for releasing it now it
would have been more based Had You
released it without the uh
without the apply for Access you have to
apply for access to llama but some nice
folks on 4chan posted a torrent so um
you know just know that
in the AI Revolution Sam Altman wants
your balls and advice but 4chan wants
your balls to hang free so let's just
let's just say that
um and we're gonna get some senior
prompt engineers in here if we ever
actually get tiny grad to run llama
um unfortunately
to maintain integrity and prevent misuse
this is the new like you know you know
what nothing pisses me off more than
like the hotels that tell you that they
don't wash the towels because they care
about the environment not because
they're cheap fucks like why don't you
put a sign up we're cheap so we're not
gonna wash your towels unless you throw
them on the floor right we're cheap so
we're not gonna wash your sheets why
don't you write that why do you instead
you write because we care about the
environment I believe you if you were
losing money to care about the
environment so fuck your integrity and
misuse and whatever man AI safety is the
biggest scam to and the sad part is
there's a real thing that say I safety
and these people are going to kill us
all but we got seven more years to go so
like Captain capitalism says let's enjoy
the decline
is he still does anybody get that
reference
[Laughter]
that's like 20 it's kind of funny
um
you know I was into anti-mocism before
Andy wokeism was cool now we have to
walk with some socks and the Pendulum
swinging the other way it's time to go
full on wokism
um
the end of America most likely the
demise of Liberty you bet ya the
destruction of Western civilization of
course but why let all the above get you
down learn to enjoy the decline and
that's what we're here to do right here
on the George hotz twitch stream
um
uh for real why does Google suck so much
well because you know
politics
um no this is guys this is bullshit this
is
brainwashing impressionable young males
into becoming conservatives
this is this is the pipeline from from
pickup to misogyny to Nazism yeah
um as you know as somebody who was who
was on this pipeline uh you know I
should do my best to speak out and get
against it I should use my voice to no
guys you know I wouldn't lie to you
because I'm not a liar right
uh the truth is this is like kind of
true and kind of not true these people
are exaggerating it and selling bullshit
too like books called enjoy the decline
but I don't know actually I think
Captain capitalism is a pretty cool guy
uh so yeah
um oh enjoy a free trial on us oh I
gotta sign it never mind I'm out okay uh
no I promise we're gonna Focus we got
Thai food coming we're gonna minimize
this so I stopped looking at myself in
the screen
uh what do I think about Jax I don't
know I haven't used it I don't know I
don't know if Google's actually junk
look deep mine's doing some cool stuff I
heard they're not publishing I don't
know why don't why do I come on stream
and start talking to you guys about this
is this what you want to hear about have
I subconsciously realized that you guys
actually just want to hear me rant
um
[Music]
okay well we're almost done with the
hype train so then it's time to it's
time to go people love rants ignore the
people
um yeah uh
no but my real hope guys you know my
real hope with this stream is to get you
to think for yourself
right like if if you're a Christian you
know you shouldn't just be a Christian
because your parents are Christians or
friends or Christians you should really
understand that Jesus did die for your
sins
like if you don't believe that I don't
understand what you do believe right you
believe in you know in in like fake
stuff man I'm a Christian and I believe
that Jesus died for my sins and I'm not
even kidding about that
like Jesus died for my sins
uh no really really and I think you know
I think that like the uh decline
religion is uh is is sad and you know
there were some issues with the uh the
you know the organization of religion
but uh you know I have one like I don't
know how you could live in this world
and not believe in God man
um
that's right that's right no I don't
know I became a Christian maybe like
eight years ago
uh yeah
all right
[Music]
no I'm legitimately not being sarcastic
I'm legitimately a Christian and I
believe that Jesus died for my sins I
believe that God created the heavens and
earth like uh
if you don't believe that I'm not sure
exactly what you do believe
uh you know maybe you believe in um
I don't know what do you believe
uh
they have a moment that made me become
Christian
no it was kind of like a
it was kind of like a progression
and again similar to that like look I
read all that
um
you know like like like like the Rouge V
stuff back in the day uh you know I mean
it's it's sad kind of what happened to
particularly Rouge V but uh
you know there is sort of this thought
we don't have to go into this
um I was not raised Christian
um both my parents are uh I'm not gonna
say atheists but both my parents are
fairly India the church and you know I'm
not saying I'm the biggest fan of the
church I I have not crossed the bridge
yet to becoming a Catholic
uh that that seems a bit much but
um
no uh you know it's just
you start by like
realizing God is real and then you know
you start I don't know I'm more
confident in God than I am in Jesus
okay llama dot pie
I'll make the text Big today
should we try using Copilot
can I just install that is that easy
oh
leave me up there
uh and now you guys have distracted me
enough you got me talking about uh my
Christianity so we're going to subscribe
we're only chat so we can focus on what
matters and that is coding the AIS that
are going to kill us all
but I mean look if something's gonna
kill us all do you want to say I just
stood there and watched or do you want
to be a part of the problem you can be a
part of the problem or nothing and me I
choose to be a part of the problem
because I want to make a difference
uh
okay so one of the problems with llama
is it's very big
I have no idea what kind of file even is
this
all right zipped
it's gonna be slow I feel like there's
gonna be slow
did I see Sean's implementation now is
it small it's like
cool
oh this looks pretty readable actually
maybe it'll be easier to go off of this
he tweaks some of the parameters
uh someone got it to run on a CPU when
it took over 32 gigs of memory well
that's too bad because we only have 32
gigs of memory so that's all we're going
to get but the good news is we can
should be able to run it on the GPU
on the M1 actually we might be the first
Branch to be able to do that I don't
know does this stuff work
wait does this work on uh
does this work on a Mac
should we try the stock one first
wow I like how short it is
that sick how short it is uh there's no
data pickle in the archive okay well
what's in the archive then
um it's a little annoying
foreign
how do I see what's in the archive
do you want to be a part of the problem
or on the sidelines
for real
that's a real choice for you to uh to
make
I think you can be part of the solution
because I don't think there is a
solution
maybe maybe there is maybe someone will
come up
uh okay
it's called Consolidated how much the
hell am I supposed to know that Nate
oh
weird
through call consolidate or maybe torch
just tries everything
uh well this is really slow because it's
loading weights
hmm
so we're not going to be able we got to
be careful because we don't have that
much RAM guys Ram's expensive
np.com V2
Red Dot Mayan pickle
foreign
well gotta love the names they're very
nicely named
uh
[Music]
uh where does V2 come from
interesting
do we have like a do we got like a name
or something
you know that's a class
where's my own pickle
wow
okay so it can create zeros really
really fast
the problem just happens when we load
them
ah we loaded them all
wow there's not that many sensors here
no we're not running it on my gaming PC
yeah it takes 30 gigs if you're using
bitch ass pie torch but we're using tiny
grad which is Tiny
um but okay so one of the things that
we're gonna have to overcome one of the
pieces of adversity that we're gonna
have to overcome
is uh this float 16.
hmm
why do I
hmm
all right we really want to get these
things into uh
metal buffers
what's up with float 16 type we they're
float 16.
okay so we have a few options here one
of the things we can do is I think we
can do metal with zero copy
we're not doing it right now we're doing
copy in
but I do think there's a way to create a
metal buffer
do we just want to hack this for now
we can hack this for now
uh
what's up AK thank you for gifting Subs
what's up with blood 16 time they aren't
18 yet bro
don't worry nvidia's got float 19s TFT
float T flow 32s or float 19s
um nvidia's got you man
legal legal floats uh
laughs
hmm
hmm
it's true because we can't actually
do you have a question
I just realize that we can't actually
create a uh
oh there's a lot of issues with this
so right there we're already converting
it to float32 that's probably already
going to break my whole thing
one of the big challenges here is that
we have to add float 16 support to Tiny
grad
so let's go in we're only going to make
this work with metal right now
and then
so okay we have a metal buffer here so
okay underneath each buffer there's a
raw buffer and a raw buffer is pretty
much just as uh
as close as you get to just being on the
device so maybe we should just do that
we should Hack That in here
and then we'll deal with how to actually
create the buffer later
so uh
uh from from tinygra dot runtime dot Ops
metal or raw metal buffer
okay for war metal buffer we want a size
which is just going to be prod args2
times now we need D type to size how do
we do that
probably like just a function on there
why didn't that print oh
you didn't say metal equals one
size
is it a function or is it a parameter
attribute
attribute size of numpy generic objects
okay well that seems useless let's just
do this in a python
someone post this
numpy size
in instance our item size does that work
over copied
what are you talking about
I think that makes a copy
should we create a new buffer and then
we're just going to do an as NP
or we can just do a copy in
it should work
okay raw metal buffer has no attribute D
type
oh
interesting
Maybe
okay so if I just do that the same thing
is that class right
actually that doesn't matter
I can just do anything there
do I need a thing
um
actually do I need anything there
let me read the code for copying what if
I just do that
does that work
ah
bites object has no attribute reshape
foreign
buffer my file read
oh
I know what the problem is
hmm
this is the problem
okay uh do we want raw buffers to have a
data type is kind of the question I
think the answer is like no
it's me hi I'm the problem it's me
does python have a way to read into a
buffer
so okay by the way the reason we're
spending a lot of time on this there's
obviously ways to write this and make it
really fast
uh
by
this otherwise okay there's obviously
ways to write this much faster
but what I'm saying is if we do a better
job of this the trick two big things is
not to make copies because copies are
very slow
hit on read into platform there has to
be a way to do this
you know you say byte array memory view
we'll let non-subscribers talk but you
really gotta stay on topic
um
eight minutes
we could do OS dot read
uh
if that works
Facebook open source llama it's open
source enough for what we're doing
foreign
with me I said good things about you man
come on come on I said good things you
guys are the good AI people
no okay I mean Chad gbt might actually
know this like I want python to
read into a buffer
I've never spoken with Zach be happy
you're a subscriber
thank you
because they have like memory mapped
files
well again
that's
I have to bring it into memory right
like I'm gonna bring the entire model
into memory that's that's ballsy if I
don't even want to do that and we can
talk about how to not do that we'll have
to do it in order to run the bigger
llamas you guys you think llamas Alex is
going out of town this weekend so we got
all weekend to just thrash on the
computer
oh F dot read into is that really a
thing
huh
okay let's try it
I'd be sick if that just works I
actually don't think it's gonna work but
be sick if it does
oh hell yeah Crazy Ivan my man
um before we celebrate let's see if it
actually worked
cool
foreign
okay so it's actually my man read into
how is that not easier to Google I bet
chatgvt actually would have gotten that
one right
we should we should we'll start using
copilot in our streams I think it can
actually answer some useful questions
um okay
all right those look like weights right
uh
all right this debug is kind of stupid
thank you
foreign
doesn't like that
all right
no names
we can get rid of that prints
okay great
I mean that's just how long it takes to
load
if you know it's in the i o module you
can find it it's not in the i o module
though I'm using a zip file but
regardless okay
so that's how long it takes to load from
disk tick spot
six seconds which is kind of upsetting
actually
um
we almost want to do this
we almost want to make these lazy
which I think we actually can do
well that'd be cool we can work on how
to make it lazy
um
okay so let's make load weights false
why is this not
how is this work ever
uh wait if this is the seven this is the
same this is the uh 7g model no guys
I I've been saying this to everyone who
will listen like tiny grad is the future
and Tiny grad is not just the future
like replacing pie torch I want to
replace a lot of programming with tiny
grad all programming that looks like DSP
Paradigm programming should be replaced
by tinygrad oh it takes 55 seconds to
load to an a100 well boom some of us
have a uh
have a have a Macbook Max or whatever
shit this is M1 Max
M1 Max I always forget that
okay
um
let's print that see what we get
okay looks like just a dictionary
okay so those raw metal buffers are
actually going to contain the uh
the weights oh great those are very easy
this whole thing looks very easy
this looks way simpler than stable
diffusion boys
um
way simpler than stable diffusion you're
going to invent large grad yo I almost
made teeny grad that's going to be a
stream like tiny grad's grown and it's
now a lot of lines
so um
it's too slow this is too slow
when I set log weights equal to throw
it's too slow all right whatever we'll
complain about it being slow later wait
till we actually try to do inference on
this thing it's going to be massive
uh
[Music]
so the shapes almost come from the other
thing
all right I kind of don't want it to be
a raw metal buffer let's make it a real
metal buffer because then we can give it
a shape
you see when it's so zoomed out
you're in zoomed in
usually I have it smaller
uh you're a non-subscriber and you just
talk so guess what congratulations you
can all thank lossy XP
um
let's go back in
here and I don't want to create a raw
metal buffer I want to create a metal
buffer and we're going to have to figure
out how to give these things uh
I'm gonna have to guys wow float 16. wow
this is going to be hard
it's gonna be a lot of bullshit
so metal buffer is a compile buffer
we're gonna have to zoom one so I can
see
if we can create a metal buffer with the
shape
look at this four right here that the
four is terrible
um
okay do we want to use numpy's types
or do we want to create our own types
let's use numpy's types for now
okay so then we get rid of this four
here that four by the way is it's the
size of a float
um for those of you that just don't know
that
and like wow I love like that's a great
interview question if someone how big is
a flow four if someone doesn't
immediately say four
like like they're they're like they're
like they're playing golf you know
um
okay
we now got d-types
uh so now here instead of importing a
raw metal buffer we're going to just
import a metal buffer
then we're going to make a metal buffer
with shape
args2
modify this copy in to not be v2. buffer
but rather V2 dot raw dot buffer that
seems good
does that work
cool look there are like objects now
um
I use environment variables everywhere
because I just like find them the
easiest way to like pass parameters
around and stuff so now we can do that
and we can say weights equals one if we
want to take forever
great
okay that's nice now we have a metal
buffer
um now I can't really create a tensor
from a metal buffer
should be able to though but I can't
which is too bad
like some of the other changes are going
to be really important
um
wow okay we're gonna have to support
d-types like let's do it
the alternative is terrifying
um which isn't going to have to wow you
guys you haven't like seen what's in
tiny right now like it's so good
wait we start doing inference
uh we need an implementation
let's see what a llama looks like
args
another implementation of attention
is it just Transformer
column parallel linear what is this crap
Fair scale oh
where's Sean did Sean write a better
llama Sean's llama let's see
nope they still import crap from Fair
scale
shapes figure out what happened
what we have
uh okay this is a Transformer we have
Transformer implementations in tiny grad
already let's just see if we can make
them work
of course I call the things different
things
why are there three feed forwards
and what's our output weight
will you see how many stupid attentions
I wrote for uh
can tiny Reds recognize recognize a
llama I don't know I'm gonna try it
let's try it let's you just can go to
tinygrad.org by the way this is now
broken you don't actually put GPU equals
one here anymore
but there's a lie no one cares so uh
let's see llama jpeg
llama look at that look at that tiny
grads recognize can recognize a llama uh
yeah who needs up to date docs just read
the code that's right okay
um
let's go look on archive and let's see
if we have any hints to what all these
things are
nope
all right uh
so it looks like
one of those mods sorted
why they're not sorted but
we can complain about that later
rope
what's rope
we have to write the same stupid
attention thing we've written 30 million
times in dining grad because there's no
like generic good implementations of it
why are there three weights in the feed
forward I'm usually familiar with two
and then is this a pre-norm kind of
thing or a post-norm kind of thing
column parallel linear I don't know
about that all right fine fine we'll
just write it class attention
you do a few things differently in tiny
grad you don't you need so much less
crap
um so we'll say like self dots
these doesn't have biases do they
there's no biases it's just weights
well that's cool
I love it guys
the model is unbiased
they got rid of the biases
when we talk about bias a lot in the
paper using why not gender
why no gender
you can't let these people man
there's like legitimate academic
researchers who think they're doing
research when they do this stuff
I mean like someone thought like why
synchoism was real in the Soviet Union
yeah that's right no more biases that's
right it took him out well that's nice
let's go across right
oh man I love this crab fried rice
I've been ordering one of these like
crab fried rice I'm ordering like one
every other day
delicious
there's definitely no toxicity and
misinformation there's only weights so
that's good
um
okay
inside attention we have something
called WQ
um
should we make something called empty
we have something called empty it's just
poorly implemented all right well that
works for me
now it's called weight oh that's
annoying
wait is there anything not pulled weight
rope frequencies okay I don't know about
rope frequencies
it doesn't seem important let's just not
do it
and we'll replace the word weight with
nothing
um we have another layer called feed
forward
I don't know did that actually make it
more readable
yeah that's fine they're all the same
uh
is this always a square
I forget how Transformers work
let's pretend it is
we'll deal with the genericizing it
later
no we're not allowed to have Taylor
Swift on the stream she gets very upset
about her copyright
we'd love to have Taylor Swift on stream
but that's out of our league so we would
settle for Sky brief
um and that's not settling I mean you
know we'd love to have Sky breed on our
stream
um and if she's interested uh you know
her people can reach out to my people
I promise you know it's a respectful
stream this is a respectful Place guys
you know we respect women we respect
women remember PewDiePie taught us that
we never had to take any of it seriously
did we
ah
like I heard that quote I didn't
remember it from Alisha
I'm like wow that's how I feel
can we pay Sky breed to advertise for
comma well Kama doesn't pay for
advertising but um
these tents are empty slow for some
reason I hate when shits slow man
there's zeros which is like
that's all lazy we don't really care
um
feed forward now we need uh
it's just called layer let's see what
the pie torch calls it
they have attention they have feed
forward good they chose a safe name same
name as me
call it Transformer block
um
what is a Transformer block cabinet what
has an attention and a feed forward
this is called hidden dim I kind of like
that name better
wait but that one's called dim
oh it's the other way
can everyone see good
Karma should do a single Super Bowl ad
we actually discussed that in the
marketing doesn't work
um
yeah marketing doesn't work
oh that's some Thai iced tea oh this is
this is really going to get us going all
right
all right Thai iced tea crab fried rice
wait this piece of crab like this
cucumber
none
we should put the crab fried rice you
like
we can eat more of it later
yeah yeah we wash our hands of course
oh okay good
wow so that's easy
we support seal you and tensor right
W is also known as the Swish and they're
the same function but they argued over
like who owns it and shit so
uh wait that's not gonna work
this isn't right
um
linear
wow I've never seen that construction
before
but all right we trust Facebook
um self Dot
tension
equals attention
dot feed forward
equals the forward
we have attention norms and FFN norms
and these things are RMS Norms have you
ever seen this before
what's R square root
is that reciprocal square root
you have to support that in tiny graph
all right
RMS Norm
hmm We're Not Gonna Get rid of that
weight
hmm
should we use linears we could use
linears
but I don't like that that because that
one's going to be weird and not be
linear
it was a linear Library
and then
linear that seems pretty good actually
it's called weight
all right we don't have to get rid of
the word weight
not tensored out linear uh
um and bias is false and all
then we can actually write it more in
the Facebook style which is kind of nice
uh
uh here
ice Leo thank you for gifting Subs do
you have a question
he did it because I made the uh because
I made the text Big everyone can finally
see and be happy
uh we need the weight of the RMS Norm
and then parameter ew
by the way notice how it's initialized
with Laura uniform we'll do pull out
uniform here too and then we don't feel
it's empty that should still be fast
because it doesn't actually create
anything anymore
uh
uh zero one is dead
okay
not as fast as I'd like but still pretty
fast
one second
but do it
all right
attention norm and FFM Norm
damn I don't know how I feel about that
or whatever
game is 512.
that probably
changes for the big ones
uh
it actually kind of be cool to
like actually have this parameterized
right
where is it create the llamas
we're like the different model
parameters
example pi
no I don't think it does
we're like the
the args
params
for Rams come from oh
params.json oh I see what they did
uh yeah params.json okay cool
dim yeah
so these are the parameters we're going
to want to pass through
uh okay how do we get from that number
to that number that's weird
how's that number where does that number
come from
foreign
testing this we should just like test
the inference on it so we can do
something like
um right now this is a Transformer block
we still need one more class on top of
this
Transformer
all right uh I'm gonna pass everything
into here
damn
I don't know what multiple love is and
heads and layers
uh Norm EPS I don't know vocab sizes
okay
this is the 7.5 B and layer okay so this
is going to take dim and N heads
Norm eps
and layers
what was that okay
uh there's another Norm that has a name
oh I shouldn't have commented that out
I was using that
okay we have the attention norm and the
FFN Norm this is gonna take in dim and
adds and Norm eps
tension is dim feed forward is dim I
don't know how to compute hidden dim yet
RMS Norm is dim and Norm EPs and I
assume that's also a dim and Norm eps
where does hidden dim come from
it's not even right
I don't trust that
somehow it gets that number let's figure
out how to get that number
uh
forward hidden damn
this is terribleness
his name is
I have a lot of questions
does anyone understand what this is
because I don't
know like this is just confusing I don't
really understand this
this is Sean's inference code
an args and heads and heads needs to be
passed in here
I don't trust any of this
makes the shapes match makes the outputs
match be happy
multiple of what is this
why does that have a different Norm
Epsom
foreign
ER
wack
bottle
all that time spent just loading
okay something's got to be done about
that
takes that long to load tiny grad
something's got to be done about that
what's taking time in that import
I just print here
look how long that takes
right that's terrible
doing that
is it Pi torches import that's slow we
all do hate pie torch
wow look how much faster that is now
that we don't import stupid torch
oh that doesn't make me happy
importing torches so slow
I should really make it just not import
the other
the other things
device I'm gonna Hack That
hack that oh that's in lazy
foreign
[Music]
that's so much faster
yeah we need to make these Dynamic and
it just needs to dynamically break
let's just torch that slow
that's terrible pie torch was wasting
that was wasting 0.6 seconds like tiny
grad has like a hundred users and if
each one of them it wastes 0.6 seconds
that's like a minute
it's a minute that's just being robbed
from the world
that's a terrible thing to do to people
oh
okay I guess vocab size equals that
time thieves what's that from
what's that from where somebody gets
like overly upset about time thieves
the office I think that sounds like an
office
uh
this is I don't understand this
the numbers right
it's Dwight of course
okay
um cool
all right those things all look pretty
good
it might just be a linear I forget
exactly how Transformers work
they don't know how Transformers work
a little line you a layer it might just
be a linear wire
no you gotta do is like view crap oh no
but it is linear at first okay
I think it is linear
it's just what am I doing here
okay cool
all right let's write this RMS Norm uh
notice how we don't use a forward we use
just a call
tiny grad's very simple
ew
that's gross
it's converting it to a float
foreign
okay let's try model assignment I wrote
a really nice model where I did this in
context
uh we need to get child from utils
I'm gonna put that up there it's kind of
offensive
all right we're missing talk embeddings
we need talk embeddings
don't forget about your talk embeddings
everybody
if you want a Transformer to talk you
need to talk embeddings
parallel embedding
oh trust this
so linear right let's just make linears
they're all just linears Norm dot weight
what's a norm
that's the one being RMS don't make me
make another normal go do an RMS form
thank you
all right Norm that's good now we just
need talking bettings
linear from that to that
so it's going from dim to vocab size I
assume
it's also what output is they're both
the same
okay cool it seems good let's go
should I leave that stupid print there
no I didn't okay uh no attribute feed
forward did I mean feed forward yeah I
did thank you apply torch uh we need
inner retention oh well you can't just
have outer attention you need inner
attention I don't know what any of this
stuff is I'm just copying the words that
it tells me that's how you learn and
find after you copy the words enough
times you eventually just understand
oh where's inner attention wait I really
don't this doesn't make sense where is
it
row parallel linear column parallel
linear
um
yeah the float's there for yeah
numerical stability share
oh we have CIS frequencies of trans
frequencies
um view is complex
rotary M oh shit
I hope we support this stuff
uh okay what was I writing
in a retention rope
does Sean not put this in his llama Sean
maybe didn't put this in his llama
this is wait that's Sean's llama let's
find Facebook's llama
just Facebook Salon I have it
they don't
then what is this thing
you didn't need them to run inference oh
oh excellent we have an expert in here
who's ran inference okay
um
no rope today
what
oh I put that in conf next
put it in the wrong place boys
let's save ew
yeah torch is not defined you know why
torch because you were being slow and
the next thing that be slow you also get
undefined how does that make you feel
I read something
about reviewing my stream about how I
frequently look like I'm on drugs
um oh those aren't actually GPU buffers
it just says they're GPU buffers that's
a lie here's what you do there if
someone wants to submit a pull request
for that actually
repetition penalty in Sean's repo well
sorry Sean
by the way I love fstrings
we got all our shapes to match that's
that's half the battle right once your
type checks pass
oh my God
how did you run inference without rope
do you work at Fair do you know what
rope is
I just know like rope is like what you
post on 4chan
or who remembers and hero
he was in here
seriously did we
uh rotary position and coding I see
well that sounds important
my llama might need a rotary position
encoder okay uh we didn't actually write
most of these calls so let's write some
calls
we wrote feed forwards call
wait and then what do I call it with
oh well
okay
all right
uh call with self and tokens of type
tensor
um
bz dot C Glenn equals tokens dot shape
oh
talk embeddings isn't embedding is it
not
it's pretty good uh okay we're gonna
have to actually Implement that
okay we call it with tokens
let's call it with some tokens uh
uh tensor dot zeros one come on
let's make the small model for now
I commented that out
something that'll actually run in a
reasonable amount of time okay we'll put
that back there because we gotta do that
but we can do that again okay
um
cool
so how do we do talk and balance we
gotta do one hot shit
oh my God wait I don't know how to do
one hot shot
I think we support that looks like a
scatter gather
yeah we don't have anything that does
one hot
393 that seems like a good token to set
solid gold Magikarp do you guys know
about solid gold Magikarp
I learned about solid gold Magikarp and
it made me happy okay
uh unfortunately
that tensor is not going to be a float
16 tensor
float 16 is a problem for another time
let's see if that runs them all uh we
didn't actually Implement anything so no
it's not going to run the model
um
talk embeddings
oh freaks sis oh shit I don't have any
of this
true
true
layer we gotta pass in the freak sis
Transformer is this
oh there's a electronic post about solid
gold Magikarp I don't know
my co-worker told me about it yesterday
uh
uh okay we're gonna need freaks
foreign
wow this is complex I don't know
um
I don't know if we have that
start pause goes in here isn't
it do we use masks
I do hate masks
only if secret is greater than one do we
need masks oh I know what true is oh
true's not that bad okay I take back my
meanness about true
uh oh torch.full we should support
torch.full
uh
uh guy wrote torch.full but I didn't
like that he didn't follow the names
from pie torch so I didn't commit his
thing
okay that seems okay it just seems like
freak sis is
offensive
let me just get the dimension of freaks
that's correct
now all frequencies now are zeros and if
you're not happy with zeros
um
self dot attention
self-doubt attention Norm X
uh start pause is fine these are not
torch tensors
they are tiny tensors uh we got it from
typing it for optional
why do I have to do that why is that
just not part of the language yeah we'll
be soon okay
okay uh
feed forward
self.ffnorm turn out
all right that doesn't look bad
uh we just got Implement attention now
how big should my freak sis be
well I guess we'll know when we
Implement attention now won't we
this is a weird I've never seen this
before
oh it's in apply rotary embedding
we're passing in none for that sorry
about your type checker
uh 4L in South dot layers
layer and solve that layers layers of x
no h
dot pause stays the same the whole time
uh uh recess
do right this
success and
Masky
uh which can be done
okay
self dot output
should be h on line 44.
oh this should be a chicken one okay
good
we just gotta write attention
yeah all right what's the type signature
for attention
I love types by the way
although I love types okay
uh call
itself X dark pause
uh freak says and mask
[Music]
that all looks good that all looks good
uh then we gotta do some like
tensiony looking stuff
oh yeah we don't actually have a
transpose we should fix our transpose
I like that this thing actually forces
me to like fix things
okay we don't have view view is actually
stupid
um and this whole thing is stupid I
don't want to just write this
uh dot reshape
all right get the shapes right
apply rotary embedding we're gonna have
to do that
not doing that now we need a colon there
uh we don't need caches caches are only
a few
okay
uh we have to fix transpose
transpose doesn't mean
yeah I don't know why I wrote that like
that uh
what do I want to say orders of ax one
comma order saw the X2
I'm gonna flip that and reverse it
say order equals order oh crap
that should work that should actually be
transpose okay cool
um math dot square root oh that's
offensive
this whole thing's offensive whatever
yeah
squats
hmm
casted
ew contiguous
okay should be something like that
see if this runs
100 but one is a data type well that's
fair
former call is missing start position
zero of course
uh transpose is missing
oh uh what were the defaults
it's not like Behavior we want to
maintain
I don't think so
I mean permute for those things
okay can't reshape
that's reasonable
um where'd it get that from
hmm
that should be fine why is it trying to
reshape that
did I do this backwards or something
I think so because I think all my shapes
worked
oh do I have like a stupid
yeah I do have a transpose there I think
I might not want to do that
oh
I don't features in features not that
like should be right I don't really get
that
oh because transpose isn't actually what
I want
I mean it is what I want but
No it should be right actually okay
x dot shape self.way.shape
those do not match uh
for Matt mulling
in features out features is how I pass
it to linear okay so for token bettings
it's in features oh that's backwards
but then
how did all my shapes match
no hang on that just doesn't seem like
it matches
um maybe it's just that one that doesn't
match
hmm
parallel embedding a vocab size dim
huh
output is dim vocal okay this is just
wrong
I don't understand how the size is
matched
yeah that's strange
[Music]
whatever
I think that was the only one that's
wrong
I don't know why it's different but it's
different
foreign
block is not callable yeah because I
named it stupid forward
tension has no object and local heads
but we got to compute the local heads
that seems right
and heads go on
args dim divided by
reasonable
keys
all right
foreign
is actually running
which I don't really understand because
we're doing in friends calling in
Frontier
um
okay
do that here we call the model oh
because we got to realize it
of course
there you go
oh type Checker type Checker check me a
type
oh because what I did to torch
[Music]
all right we gotta fix that
oh
um
you think that's still wrong
because this one actually has a custom
create raw buffer for historical reasons
foreign
okay so that's how long it takes to do
all the sequence lengths not even
existing oh man all right we got a long
way to go we got a long way to go to
make this llama ba
um
very enjoyable
okay well that's interesting
why did that happen
what did I do
what even is that
why is there so many buffers going into
some of these
okay something is growing look look
something is just growing
with the number of arguments going into
it
then I don't understand
something's broken
oh
I mean that's interesting
let's take a look at the graph
let's see if this one has the same
problem
I said that's the number of arguments
going in and for some reason that's
growing
probably means there's a bug
but let's see what a tiny llama looks
like
still writing the graph
yeah okay something's like broken
are these calls
it's the calls to the Norms that are
growing
something there
oh probably because this ones is oh
that's stupid
I don't like any of this
I mean that might fix it
no still a ton of arcs
okay something's broke
not that
oh did I
H equals h
X that's right
there we go
why does this look like this
no normal Transformer should look like
this
what are these calls that have so many
arguments I've never seen this kind of
bug before
hmm
okay well whatever it is that fixes it
go into it later and see if
okay but this looks kind of like a sane
two malls going into there that looks
kind of like a Transformer we know and
love
if I didn't realize that it must have
just been fusing something weird
I don't know
all right
wow we're getting a really tall tree
amount of gigabytes I have a solution to
that though don't worry
wait that's still a poultry amount of
gigabytes
oh they're Vector their Vector oh
they're terrible they're Vector moles
don't crash my computer
okay um memory shouldn't be zero we need
to fix that
that's a bug in metal
uh is Tiny guide ready to ship I mean
it's a lot slower than Pi torch
um on both of those platforms right now
for various reasons but I mean it works
if you want speed I wouldn't tiny grad
yet okay for some reason things are just
growing unbounded
why is the GC not gcing
yeah there's some bug that's causing
these issues
like after I realized this should the
rest should just be thrown away
oh some of that might just be creating
the weights though
yeah
huh
okay I mean that's an interesting
thought just creating the weights is
breaking it
okay well this one uses a nice number of
gigabytes uh I mean exactly so that
might just be just way creation uh I
guess we can know that once we get this
working
so let's make this work at least we got
the shapes right we're going to get an
inference to run and then we're going to
figure out why it's the wrong thing
because we didn't Implement rotary rope
shit
sign in how do I do that
uh
we need to realize lazy buffer
can I create a realized lazy buffer
no I can't
it's interesting
I've never had to do this before
I mean I guess what I can do is just
this
Envy's a tensor
mv.lazydata
should get me the lazy buffer
and then I can just say
mv.lazydata.realized
equals V
should be right
all right look at how the wait
that's the memory it's not growing
was I not looking at the right thing was
I looking at the other crap
no that didn't just run an inference
no I couldn't have
did that just work
and it just breaks if I do this
also wait I don't understand why the
memory isn't already big when I created
all the
oh because those kernels aren't real
because there's not actually weights
what did I use to create that
I was like sure do I created a metal
buffer did I not
well if I don't load the weights I never
call a raw on it
yeah I never call a raw if I don't load
the weights it's actually just
multiplying it by zeros and shit
uh
now this should allocate a metal buffer
okay
well
now it has memory for some reason but if
I just call Red Dot raw it doesn't have
memory
which I don't understand
they can't be being gcseed
all their being received
more concerning is why the other ones
not being GC no okay that's not pngc
what
that immediately uses shit tons of
memory why is it so much memory
oh because we can set the D type
of course uh okay
because those are flow 32s
it should be half the memory
all right and now everything got slow
oh everything got slow because it's
probably throwing a billion out of
bounds errors on my GPU because the GPU
is not expecting the size to be that but
the memory is 13 gigs okay
that's good we just need to get the
d-type in the inference engine
uh and actually make that work you can
do that
all right we're gonna do it aside where
we actually make types work
uh because until types work you can't
fit in Ram right we saw how much RAM it
allocates and then what Ram will be left
for running streaming none
but okay so those are running something
resembling the kernels
python
let's just quickly try this with weights
equals one
no we can't do that because we set
weights equal to zero
let's put that over here
and let's get rid of the graph R because
we don't want any graphs
and our vocal is kind of slow for now
you know what else I'm going to put in
here
um where do I where's that Loop
foreign
wait why did that do inference fast now
oh because it's not creating oh because
it's not late allocating
okay if I don't do that it actually
light allocates
if I don't actually set weights it just
late allocates I think
or just works now
fast I don't know what I changed
that should be giving me so many out of
okay there's no more RAM anymore
so I'm just not actually being allocated
oh did I get rid of raw yeah get rid of
raw from here okay
um so nothing actually allocates that
okay cool this is working
ish
great
uh
uh okay so it's not actually using the
ram until
you know that should create the stuff
that should actually create it I don't
really understand
oh okay no sorry I'm I'm confusing this
with this this is the number of Ops and
this is the memory use
yo don't gotta watch out for Ops man
could you build it I don't know do you
have skills
um okay and I think this is actually
slower than it will be
what
okay
well this is the wrong number of Ops
anyway because my right now my context
is one
um we gotta make the context longer
it's used anywhere
I'll put that in there
all right
um
patch size
okay how much context we want
I don't know 64. 32 sounds like a good
amount of context
all right that's like how many symbols
we're putting in beforehand and my batch
size is just one
okay good notice how we're getting a lot
more G flops it's actually not that bad
okay
so in nine seconds we got one character
that's pretty good what do you think
nine seconds one character
oh well we're gonna have to implement
the tensor course oh once we get tensor
cores off here oh man tensor is going to
be so fast
okay
um
I think we want to do the math and flow
32 but do all the storage and float 16.
and we have to implement methods like
dot float and dot half
Terra flop of compute
does that seem like reasonable
let's see what context are they running
it with
why is there a Max batch size in the
params
someone someone's made these work right
so I actually have the fastest map wall
on uh on M1 right now uh my mammal is
faster than if you guys haven't seen it
let's make sure the demo still works
uh we're going to extra gem metal
uh we broke it
of course we broke it
it's on break it
because it's not a CL buffer anymore
it's a metal buffer
metal buffer
metal program
we don't have any dot CL anymore
called
dot CL
I don't know they're raw metal buffers
we made
so we don't need dot CL
ick copy and still works
two CPU still works like we should just
be able to get rid of these
uh yeah we don't have a wait until
completed anymore where is that stupid
crap
foreign
no it's because we are in a different uh
yeah no not microseconds uh this used to
be nanoseconds so this is now multiplied
by
26 and this is now flops time 20 minus
nine divided by time
there you go
fix metal map
I didn't fix it I did a big refactor and
didn't fix that look but look at how
much cleaner it is now right like you
saw how much I can delete
for 8.4 gigaflops which is actually the
fastest mammal
um on M1 so we are actually going to
have when I fix that
the fastest llama on M1
assuming the fastest llama like it's not
gonna be the fastest stable diffusion
that's this is we're a long way away
from the fastest stable diffusion stable
diffusion has a lot of interesting Ops
like
so stable diffusion uses things like
three by three convolutions and I have
an idea that people are doing Winograd
convolutions and I don't even know what
a winner guide convolution is so of
course Tiny grad doesn't support
but
for a long months you might be in luck
you might be in luck we might have a
very fast llama
I don't know what we'll do with our fast
one
um
we'll sell it to Facebook
you think they want to buy it
so you notice how the mem used is
actually just the weights
uh
only optimizing Transformers is high Roi
yeah maybe
um
so something we can do is uh
we can also
probably easier far easier than any
other neural network library we'll be
able to dynamically load the weights
from the zip file
like we can enqueue a bunch of things
and prevent the we should be able to do
inference okay by the end of the Llama
series oh and it's nice that lava forces
maybe float 16 because that's something
I've been wanting to do for a while
by the end of the Llama series
we are going to do inference on the
biggest llama right here on this MacBook
biggest llama right here do you think we
can do it we're going to get it to
generate one word and we're going to be
like we are the king of words
wow wait people are actually going to
download Tiny grad for this shit
I think that's going to be useful
oh my Norms ew
it's time for some more crab fried rice
Bachelor is my favorite Norm because you
can fold Bachelor
layer Norm you can't fold layer Norm so
let's see how offensive uh
let's see how offensive
where's the norm from llama was that
llama Norm
how mean
oh this is pretty nice actually
oh this is nice
yay okay let's uh Chris doing friends on
the tiny llama quickly
tiny llama please
I'm trying to keep commenting right now
let's just add a flag
[Music]
okay this is the full tiny llama graph
let's see what's going on
uh
ew
what is all this
oh
this is right here
okay that's real
what is this graph app called
wait your eyes hurt from the graph
um
what is this graph app called it's
called dot this is built into tiny grad
it's just dot like it just generates
some like a shade of code
that's the graph code right there it's
74 lines
no I'm just pruning the graph
okay
um I don't know what this is
but okay so that's a single llama
looks like a lot of stuff
so those are your three they're your
weight key value that's your attention
and then you do your fully connected
that's your fully connected with the
Swish and then I don't know what that is
oh no that's your final output
and then I don't know we do a permute or
something
oh does this get better without equals
three
we do obstacles through you can push per
mutes
239 kernels
295 kernels okay don't do that
um
there's probably some optimizations to
do there
uh but all right we gotta finish data
types
we're gonna finish data types we're
definitely gonna finish data types
uh let's see if 32 is actually
reasonable
that's what I was checking
context do they give it
doesn't say
rotary embeddings rope
fishing implementation first
reduces the memory usage
oh yeah we need to get that
whatever that is we need to get that
we'll figure out how to get there
nope lines of code is not an arbitrary
metric and if you uh were on a
subscriber you'd be made fun of more
wow llama 13 B outperforms gpt3 yo this
llama is going to be sick
you know what let's take a minute and
really thank Facebook and like by the
end of this weekend I'm not gonna be
able to do this today I don't think but
by the end of this weekend we're gonna
have a llama running in tiny grad
and it's gonna be like GPT 3 quality
who's actually run the big llamas
that makes it worse bro
you know what man you're sitting there
and you're talking to a billionaire
talking about how dollars are arbitrary
because like man you know I used to live
in Zimbabwe and I was a billionaire in
Zimbabwe your dollars are no he's a
billionaire and you're not so shut the
fuck up
that's right criminal equals clown bro
yeah that's right that's right
welcome to my twitch stream where we
make fun of our subscribers uh I'm sorry
you're a subscriber you're a good person
um wow thank you for telling me how much
carbonated
Crown World
I know gender
all right
um
soon they're going to introduce a
license on these things where it's you
have to you have to swear allegiance to
AI safety before you can use them
um we could have Matt we don't even have
to M map it we could just let it be gc'd
and stuff
we can just make him lazy like we don't
need that
show no
I don't know if you can have that maybe
you can that'd be cool
if I could M map and then like just the
GPU kind of Zack off of disk I don't
know if you can do that
I don't know
I don't also I don't know if that'd be
fast like who's handling the page balls
it's probably faster if I do it
explicitly n yeah definitely
yeah it shouldn't be any slower if I
like the whole Matrix
that's like one Matrix at a time right
because these things are tons of layers
okay
we need a paper towel this is pretty sad
can we even get a paper towel like a
civilized person
we're out of paper towels
toilet paper
thank you
I found out Alex has been hiding lemon
spindra
foreign
food this is crab fried rice
I love crab fried rice I've been
ordering this I probably ordered this 10
times
I love crab
I love fried rice and they combine them
all right
um
30 meal I know I know good thing the
tiny Court makes money handle oh wait no
shit man I tell you I feel like I'm not
gonna be able to afford gas for my
Rolls-Royce
laughs
okay
blah blah blah blah blah blah blah blah
blah blah you don't tell me how long
your shit is
I'm probably gonna actually have to get
the torch one running
if it will run
I mean I'm just not going to fit on my
GPU here I have a 30 90 at work
what was I doing besides eating crab
fried rice
um
oh yeah try to figure out what the
sequence light should be
example
generator
Max gen length
oh the sequence length is probably just
prompt
and these things are actually probably
shorter than that
because we gotta do the tokenizer
okay
so 32 is actually very reasonable we can
probably even make it 16.
let's hold the weights
oh my God this is pro letter
we've got to timeout
by the way it's five seconds for a
letter
brutal brutal
well that's nice
notice how that we only get so these
prints are when the compiler runs so
making the compiler run less
gives you Improvement and actually since
the compiler runs so little
we can do upload equals one
that's the beauty of Transformers just
the same thing over and over again
well local mix it really slow
and it'll be fast on a minute but still
I don't know but how much is this
because they're on the wrong on the
right data type
okay upload Will made it no faster
so we won't do that anymore
another month of giving money to a
millionaire thank you stokesetta you
know I'm not sure I'm a millionaire
anymore
I bought land and I bought a Rolls-Royce
and these were both dumb choices
I also bought metastock which was the
dumbest choice of all of them but met up
take my 80 grand and thank you for
giving me um
you know whatever this shit llama
this is worth eighty thousand dollars
we'll make it all back on Craig
make it all back one trade
all right you lost my fan yeah I lost 5K
on cheapy don't joke about that
seriously
oh you worked a meta
thank you
um
we're taking a little break to eat
we're gonna
you know we can just just have a little
conversation and then we'll get back
into d-types
all right we got to do D types
I'm gonna do rope
one gambling you can only lose 100 but
you can win a thousand percent you know
who knew that Sam bankman freed it you
could only lose a hundred percent of
your users funds you can't lose a
thousand
that is good advice
no this will be George plenty video
games do you ever see me answer personal
questions like that I don't talk about
my personal life at all
right when I go to the bath house and
fuck midgets I don't tell you guys about
that right you gotta keep some things
off stream and something's on stream
how close are we to beating uh MPS
you saw I beat MPS
I beat MBS already
8.4 gigaflops and soon we're actually
gonna have that in tiny grad it's not
like it's unimplementable or anything
well okay
so with
16 we're doing
233 gigahops
so once we get our eight teraflop map
all in there
we're gonna be able to do 34 tokens a
second that's actually gonna be really
fast
we're gonna be able to do 20 tokens a
second
hey yo what are you doing a bath house
with midgets it's not weird man
all right well you do you you gotta just
be you man you gotta be yourself haven't
you heard about the 90s it's all about
self-esteem
Mama's better than gbd3 do we censor
gbd3
but I think the one they're referring to
in the paper is the initial one without
instruct GPT
um
I knew this guy was into midgets that's
not that's not yeah you're watching a
guy in his house man
why does it think that's bullying
sorry sorry little people
I post more
you know those like memes about like the
things you can't say at IBM anymore
well in general one of those things we
keep it classy that's right that's right
they're actually dwarves no I'm
referring to people who live underground
hulken you thought his name was token
I should do a Coursera course have I
ever told you that I'm not a whore
I have no interest in educating the Next
Generation
bitches in the bath house wow I don't
know who's on the other side of that
glory hole but uh
Hustler's University yo you know where I
found a great like I wonder like how did
Andrew Tate actually make any money I
found out who Andrew Tate was you guys
were like giving me shit when he got
banned I had no idea who he was and then
I started watching Instagram reels and
he's all over my Instagram so I'm like
how did this guy make money
so you know who had one of the best
Andrew tape threads that like honestly
explained Andrew Tate
we far
and I'm upset that cloudflare took it
down it actually had a legitimately like
fairly unbiased like this is what Andrew
Tate does he like finds gullible young
men and gets them to pay for a Discord
so they'll be more masculine or
something
guys we're living in the end times
um no Andrew tapes in Romanian prison
right now
I'm like
I don't know
I didn't hear that even in Romanian
prison they know that Logan Paul's an
nft's camera
how to date dwarves
I don't know who quality Zilla is I'm
sorry for bringing up any stupid YouTube
drama
um
only alpha males pay for Discord yeah
oh Poppy's Villages bro
oh I do know poppy zone is okay okay
yeah yeah yeah
you know guys
how long have we been saying that the
entire entire economy is like a
fraudulent scam
how long have we been saying this on
this stream we're ahead of the Curve
if you watch this stream you're ahead of
the curve and if you'd like to continue
watching this stream you're gonna have
to pay me
53 dollars a month
that's right direct to me not have to
Twitch
guys you don't understand it's all about
making money you know what I mean
venmo or cash app nah we only accept
Monero
that's right it's the money of choice
for drug dealers and money launderers
everywhere
Cheap Eats acceptable to
the chains down I stopped paying 500 a
month to keep the digitalocean server up
Goku's a piece of shit didn't pay for
anything
the first scam where the perpetrator
loses money
you're studying ee only for the money
bro
do you know about AGI
let's let's take a moment
right now to ask do you know about AGI
do you understand what that's going to
do to everything you've worked hard for
in your life
how do you guys cope
how many billions how many trillions of
llama parameters
you're actually depressed every day
that's why I don't work hard enjoy the
decline that's the solution yeah it's
over it's over boys Humanity had a good
run
you know see and these are things I love
about Elon he's talking about like like
how sad is it if we don't like make it
off this planet
you know
wait you think we're so far away from
AGI
we're not
if only you knew how real bad it really
is wait
this is when you go off the rails of the
dumb conspiracy shit
you don't need dumb conspiracy shit for
it to be terrible
lame ass one planet Sim see I love when
elon's talking like that and I hate when
he's like retweeting January 6th garbage
nobody cares
like
Shaman guy I'm sorry you're in jail you
are one of America's political prisoners
all prosecutions are political right at
least you didn't get Assange
at least they didn't do character
assassination on you they're just
putting you in jail for five years you
can learn your lesson
um
what do you mean that that's great
that guy's hilarious
like what kind of pathetic how weak
you have a regime right
and some like fake who people show up
you have two choices you can either mock
them or play them up as a serious threat
right what do you do if you're secure in
your power all right if you're securing
your power
you mock them
if you're insecure on your power you
play them up as a serious threat
so um you know that that tells you
I hope Shaman has a good time in jail
you know you guys know there's a
hierarchy in jail right
I've read a lot of prison Reddit and I'm
into a true crime YouTube too
um it was a hierarchy in jail
if you did like armed robbery
especially if you know you didn't snitch
but someone's you someone someone ratted
on you that's cool man that's cool
you're cool in jail if you did any shit
with children dude you're not making it
out of jail alive but I think Sean guy
would be pretty cool
um you know
your average Facebook group you actually
know stuff about him
foreign
jail because I don't know how to make my
taxes well
I'm sorry bro
you got to pay your taxes you know what
I mean have you seen someone who didn't
pay the mafia their protection racket
you know what happens
you know what happens remember that nice
guy remember that nice guy who uh
who owned That Pizza Place yeah Frankie
Frankie fucked them up man
um
I loved it it's like giving the guy you
know I really I really don't think he
knows much about uh you know about
prison culture how do you think wait no
no no no real talk real talk real talk
how would I do in prison guys
do you think give to season what belongs
to season that's right do you think I'd
do okay in prison
yeah I mean the government's shittier
for that reason for that reason
um
thank you thank you no I think I do okay
I think like you know it depends yeah it
depends on what jail I go to
no I'm just talking like would I be
liked by the general prison population
um
say I went to jail for uh
I just I just saw no jumper I saw some
guy did uh he was selling a fake
streaming service he had like a scan he
had a scams dream experience like do you
have any kids no do I look fucked up man
no
yeah prison folk don't care about white
clock crime yep of course because it's
not really yeah
um
ideally fed rules uh yeah CA stayed high
level oh yeah no I'm not going I see I
stayed high level scares me
of course the midget picks come out whoa
whoa whoa whoa whoa whoa I was joking
guys there's no midget picks yo if it
starts getting around the yard yo
no but really like if I was going to
jail
and I knew I was going in in like four
months
I'm gonna shave my head and get jacked
like don't fuck with me
I mean I'd be in the best shape of my
life so you know we could talk about the
good things that come out of jail
ah you know too bad I don't do crying
I always wanted to do a jail internship
I can't quit like I did at Twitter so uh
what's my plan for getting jacked I was
getting you know work out every day
I'll hire uh you know a trainer who's
like with me every day like we're
getting jacked before jail man
post yo no seriously man I heard Biggie
got good after he went to jail
um
I mean entertain did some shit to women
you know I just yeah
I mean there's people who shit to
children and there's the people who do
shit to women and then there's the guys
who do copyright infringement and
computer hacking yeah
um
there's no 30 rice in jail I would have
to adapt it I'm pretty flat person
I don't know what kind of movie you're
watching bro
all right uh can we focus anymore and do
things I kind of feel like no
why am I so on Focus today
Mount Cox CEO looks like after two years
in Japan prison
[Laughter]
so we're fucked right we're fucked
we're fucked
let's have a magnesium I don't know I'm
unfocused right now I'm focused I
focused pretty well when we were coding
though right
yo vaping is not illegal
all right
I just keep typing that okay focus boys
Focus boys
uh
if I don't say weights equals one
it still creates the raw buffers though
right
uh
yeah
let's just
don't Exit Zero in there
let's just look at the first llama
so what is the first llama
I still like that
oh because the output axis is four
no I don't understand this
I don't understand this four
that should be merged into one
oh no hang on no I shouldn't no because
we're doing a uh
yeah that's the Matrix okay
that makes sense so it's a 16 by that by
that Matrix
it were loading but notice how that's
all like that
did I split that on the wrong Axis or
something
no well I guess okay so
why is this the fast way to do inference
of these things
like I feel like I want to oh this is
the one that's not transposed all the
other ones are transposed except for
stupid uh
embeddings
like the second one's transposed
[Music]
foreign
looks less stupid
oh nope that looks equally stupid
or is that the same one
hmm
why is it doing this twice
it's just
foreign
to three Why didn't it do three kernels
for all I asked for three
three
okay cool
yeah it just did the same thing twice
which is really dumb
oh no there's some bugs in this shit
okay now it doesn't do that
why are these here
oh I guess because okay I guess this is
just a fluke of early stop
early stopping's a bit of a hack
these other kernels are going to be less
stupid looking I think
um
nope equally stupid looking just on the
other axis
what
uh okay I mean I think part of this is
fixed by doing uh
do that reduce
it's a four by four terminal
whatever we got to deal with data types
we'll deal with speed later so the
problem is these are floats and they
should not be floats
in to the GPU
uh this is in code gen
GPU
and this is where we get the types
I have a feeling I use this type thing
to mean multiple things
it's called half and Metal
foreign
part of the graph that's static uh you
kind of can
so if you look at uh if you look at open
pilot
uh the openpiled compile example the
open pilot compile example kind of does
that
so let's go into the AST where I create
these things
uh I create these tokens somewhere here
here are the tokens okay so we say
they're type float
they might not be float
do I deal with this here
we can just do a early stopping one
uh okay where do I put Buffs
all right stupid GPU buffers uh does
this have D types
ew I don't even import numpy here
Let's test an electricity typo
foreign
[Music]
none of the Buffs had d-type float 16.
because I didn't assign the weights
oh we are doing weights equals zero but
that still should be fine
uh the buff should not some of the Buffs
should have
a different type
but they do not
and that makes me sad
this buff should have a different type
uh yeah no the generated C files yeah
because I didn't fix that one I'll can
show you how to do it
um so I didn't really care too much
about performance
of that example
so if you look at compile efficient net
it does the entire
it just runs the entire net
uh where does it do it
was actually from the net here it just
runs the net
um for the open pilot one I'm a little
bit more discriminating because I
actually care about speed
uh so if you look at the open pilot
compile you'll see that halfway through
model exact you see that I run the model
and then I clear the cache
uh before I realize it but this actually
only works because I pre-realized the
image weights there may still be static
things uh sinking through
yeah we can do like like a chain
analysis and figure it out
yeah I mean wait a second this is a
generic the jit yeah okay so the right
place to fix this by the way is in the
jet
if the jit shows yeah you can fix this I
I would merge this pull request so you
can show in the jet
if the uh compute kernel doesn't have
any inputs as its parents like go back
through the graph if it doesn't have any
inputs from its parents you don't have
to uh when you capture it in the jet you
can remove that whole function call
actually yeah that would be awesome if
you want to write that in polar request
uh it's actually pretty easy to do yeah
I'm just re-running things stupidly in
the jet
which just create the same static kernel
every time because you can't even change
them
thank you thank you
uh
okay so we are creating them things with
a d-type
it's an extra
I wish I had speedrunner like scales I
feel like a speedrunner when I program
like I'm not that fast
I'm just good
maybe it's not about being fast
like it's a different kind of skill and
I think speedrunning kind of looks
cooler
let's just go where I do the assignment
here
yeah so those are all numpy float 16.
specifically this should have tight
float
but it doesn't why not
was it permuted or something
look at the graph
why is that one not being logged to the
graph
why is that one not being logged oh it's
because I exit before that happens okay
I work at the tiny Corp yeah
so this
should have d-type
of
int
oh uh yeah okay when I create the child
buffers I have to inherit the parents D
type
where is that shit
get rid of that uh it's in Ops
it's a compiled buffer if I have a
compiled buffer
um
where do I do that actually
I created in movement op yeah so the
problem is down here
see you in a movement up
um
there you go
after all floats for that one for some
reason
uh but that's half
cool
uh
uh that cast of float4 is wrong I have
to change that
yes he float4 is just hard coded there
uh
uh okay I'm not thrilled about this but
we'll add half four
photo
like they're really this shouldn't
actually be like a type like they're
like different the four and the thing
are like different
um
uh float4 kind of increased speed on
common three oh no those slow fours no
that didn't that actually didn't
increase speed it turned out that whole
thing
was how I was permuting I'll show you
the change I actually made to fix that
um this change
C and last is what actually got me that
performance it had nothing to do with
love for
uh so then this instead of float four
we're gonna
from AST we want to import up cast type
self dot buff sub buff index
of tokens dot buff index
oh
terrible
terrible
okay
um well
that doesn't make any sense
oh did I leave the star okay well get
rid of the star
also am I changing it in store I'm
changing it in store like an idiot
I have the same code copy and load this
code's so bad
this only needs to be refactored
trash
okay cannot initialize a variable float4
uh with half
that's fine
uh we'll just stick float4 outside of
that
foreign
I think
I don't know I have that I don't know
what I forgot
it's faster
let's mad faster that's great
I mean now that's not out of bounds in
the memories all the time
foreign
all our intermediate buffers are in
floats
term and type of d-type well
oh
um shit what type is that
no
it can't just be called type
I'm not just gonna write type
this has to be a type
I'm kind of upset by these nump ID types
already
chat who said I should use them
we have to use custom tiny grad D types
you know what type that is what is that
type okay fine
does that work
now can you determine type of D type
no
oh well okay it's an optional type
well that's not right
because it's yeah this is a loop you see
the loop you see that's a loop but uh
the host pop D type D type and your
active dies are fine you all know what
I'm saying
two of you probably though
there we go
terrible support for halves
all right
easy
uh
all right now we just gotta write all
the other llama shit
I think I don't think we didn't do
anything that uh
I don't think we didn't do anything that
like is tons of Ops
thank you no Bona 0-1
kernels if you want I'm like
wait that's not good
oh no that's actually fine because most
of the kernels aren't being recompiled
the outputs flow the inputs flow the
weights or data
and like that's it
cool
yeah I don't want to rely on numpy I I
listened to someone in chat who told me
to do that and I don't know why I listen
to chat
but
I still I still can't get over bro who
came up with read into
read into Pro I'm happy I listen to
until we find out reunge who doesn't
work but it probably does work and then
reading Two Bros a great guy to listen
to okay another thing also is this is
kind of slow because debug is that so
yeah it'll be faster if we just do that
how fast is this actually if we disable
debug
two seconds
I don't know
is anybody implementing modern RL okay
there's like some bugs in the terraining
there's some there's some bug in the
optimizer and someone's got to figure
that out before we do any serious
training with tiny grad it's a simple
bug I just haven't really tracked it
down yet because like training is a
whole can of worms until we have fast
inference
um I'm less interested in training
I just want to like I want like all my
derivatives and shit to be right but uh
there's a bug in the optimizer so
someone should find it like there's a
bunch of uh what's a llama yeah man
you've been to a petting zoo it's like
that
foreign
I don't know why I'm doing this this is
dumb
and then after all that the only thing I
get out is one number
well the weights
do the inference okay so one of the
things that makes this slow is this is
actually doing a weight after each CL
kernel so it can print that out
damn that loads so fast compared to the
pi torch model yeah guys because tiny
grad is good
no you know why it loads so fast read
into
uh yeah I think I did some RL stuff
foreign
shouldn't take no arguments and I added
an argument
oh is that not enter well that's a knit
oh you know what we'll do
some guy really wanted me to change it
to using perf counter I guess I'll use
perfect counter NS here
it's apparently monotonic NS sucks on
Windows
got perf counter and that's great it's
faster with perfume I think it was slow
with that model
um so enable method cache should be the
default
and it actually doesn't break the
obstacles before I fixed that bug
method cash basically will check
if it's running the same AST multiple
times so the Transformer is literally
just the same thing over and over again
so there's only like that many unique
kernels you can see the ones that have
shapes in front of them uh these ones
have shapes in front of them because
they're unique but all the non-unique
ones just come from the method cache
so without loading the weights it runs
the model in
that and if we load the weights it's
slower because it actually has to go to
memory it's not just zeros
um so when you make something zeros uh
if you guys don't know about the zero
page and copy on right where I would
like go take an operating systems class
so that's why that's faster than that
but
um cool
timing the model
so that's each character
is taking 1.3 seconds well actually
that's not really representative we
should probably run the model again
are we gonna jit the model too if we
want more speed but it probably doesn't
matter because
wow look how much faster it is the
second time it's a power of method cash
have you heard about method acting it's
like that but
method cash
wow okay so like speed wise we're there
this is actually going to be usable
um I mean look it's not like like the RL
stuff's all outside the library uh there
is an example some guy wrote deep
deterministic policy gradient but like
if you really wanna yeah I gotta compile
time in the first try
um so that's it's 700 milliseconds to
compile the metal kernels but once the
metal kernels are compiled they're fast
I mean we can sort of check this from
doing debug equals three and we can see
like what the time actually spent in uh
like here so if we just look at this
number yeah 699 milliseconds so that's
actually the time these are the GPU
performance counters also that first
kernel is horrendous because it's
permuted I don't know who did it that
way
but um
that first kernel is a big chunk of the
time it looks like
whatever
um time to generate a word well we're
not actually ready to generate a word
yet I'm terribly sorry
uh
interesting
only slower the first time
wait I don't really get that
nothing's in cash
I don't know
can you use tinyjet for training I think
so
uh it should work I did all the assigns
correctly I think I mean again there's
some bug in the optimizer you guys gotta
find them
thank you
also since this literally works with
metal I shouldn't have people type in
metal equals one
I should just uh
enforce that at the top of the llama and
this is actually just because I'm I'm
putting off doing the Rope because the
Rope involves complex numbers and
complex numbers you know they're just
complex
metal is best choice for a llama
you know I like to write like that so
like see like like you gotta do stuff
like that so like when noobs look at
your shit they're like wow this guy
doesn't even know English I just code my
sock so yeah metal is best choice for
llama
um and actually let's make was weights
what do I said wait wait
uh
make white to one
so weight zero still works
but normally if we run examples Lama it
loads the weights
cool
is this paying the electricity bills
no
no the tiny Corp doesn't make any money
despite building the best inference
infrastructure the best neural network
library in the world
um wow and this is even without the cash
oh man we have a cash it's going to be
so much faster
I don't even know how caches work
okay
some sentence piece what sentence piece
uh-oh
interesting
and we're just going to import this I'm
not writing this
the unsupervised text tokenizer and de
tokenizer
purely data driven
how many Google things is this going to
install oh good it's small oh good
all right so you guys know about
tokenizers right
you gotta tokenize
carpathy explained tokenizers to you if
you're new and done all about tokenizers
can watch this shit
um
and uh what's it called
weights
tokenizer dot model oh well we should
check the checklist first to make sure
we did everything on the checklist
did we do everything on the checklist
gotta read everything on the chat list
that's what's that in md5 zone
see if you just don't look at that and
know that's an md5 sum you will never be
a good programmer and you should give up
now
some people like to inspire you and
motivate you I like to demotivate you so
we can get all the noobs out of
programming there's too much code being
created in the world and if everyone was
Noob just stopped coding tomorrow the
world would be a better place you might
be part of the problem
token
Isaac
it's not born an expert I used to be a
noob once too and I appreciate every
single person who discouraged me and
told me that I would never amount to
anything because if it wasn't for all my
haters no you would never be successful
isn't that what all the rappers say they
thank their haters well I think my
haters to everyone who ever hated who
said that I'm a two-bit crypto scammer
with cheapies
you are the reason right now I drive a
Rolls-Royce that's right I thank you I
thank you
how does
anything seriously no but really how
does anybody take any of this like like
influence this shit you know you know
you know what I mean like the people who
post on LinkedIn how does anyone take
that seriously
there's someone out there who takes that
seriously
wow wait this library is is is is is
super based look look it's just in code
all right let's see if this just does
what I want in code
um why did the chicken
oh let's see if this just works you know
what I take back every bad thing I ever
said about Google if this doesn't work
wow it just works wow guys I take back
every bad thing I said about Google you
know
you know watch watch how easy this is
gonna be
we just have to stick talks right here
okay now we have to see if D code works
all right all right uh good we loaded
all the weights and we got that one out
so who thinks
spmodel.d code this
can we get something that looks like
cross
uh uh Jen
comma
all right
um
wow sentence piece thank you Google
Google Google good people Google's good
people guys
okay
all right why did the chicken
load in the weights
we gotta make that faster
this must contain integers
who's not an integer
what do you mean
you know what guys I need a prompt
engineer
I need a prompt engineer it doesn't like
why did the chicken
okay we need the weights again let's put
the weights back in
oh oh wait no no no no no no we're
messing up guys we're messing up we're
doing this wrong
okay
that's right but this needs to be Lane
talks
oh now it's going to take a long time to
run the model because it has to like
generate them or be slower some shit
it's not that slow
there's one hot correct
did I do my one Hots right
no I didn't do my one Hots right
that's not right
why are there those ones there
why is it no one's in that one
jet fuel doesn't melts you know that's
better
[Laughter]
I don't know it might not allow that
because of uh you know
um
wokeness but we will definitely come
back to that one once we have it working
it obviously doesn't work yet I don't
know why I'm it's not gonna work
uh oh no this is wrong no no no no no I
know this I know this we got to do
rangeland topes
you know about rangelawn talks we were
putting the wrong thing in
oh
we need weights again okay
okay bring the weights back oh this is
terrible oh that's terrible that's
terribly slow that's terrible oh I heard
the pie torch one's even slower
up why did the chicken a-a-a
range into tokes
um
let's just see if I did one hot ride if
I do like ARG Max axis 2
should give me the shit all right
sequels minus one
I'm not gonna wait for the weights I
don't actually need weights it's not
actually gonna work guys I didn't write
all the shit
so I I didn't rope it needs rope
I can give it rope
oh okay
but still that looks right okay cool
at what tensor size does it start to
make sense Pro tip it always makes sense
you mean compiling custom ship look it's
all one that's all I know it's all one
and everything else is all about a shit
the 7-Eleven was a part-time job that's
right uh okay
um
no I just can't run it with the weights
and like hope it's gonna do something
because it's not
Google actually
make okay it used Swig wait it used Swig
you know what I take it back I take back
everything good I said about sentence
piece because it uses swig
we're just gonna say sentence piece
we're going to leave our opinion of
Google unchanged
uh oh we have to we need the boss token
what's the boss token no we didn't even
write all the shit yet we still need to
write rotary m
and we have to write freak sis
we didn't write freaksis or rotary amp
how do we expect it to work
and then we also have 26 bugs to find
you're forgetting about the 26 bugs
view as complex
reshape for broadcast
view as real
type as
what
okay okay okay okay hang on the Llama
tokenizer has a bust okay
oh boss ID oh
okay let's watch it not generate
anything again
hmm
I mean at least it did something like
different
foreign
you literally deleted all the Rope
weights yeah well I'm not I'm not even
talking about rope weights I I agree
that you don't need rope freaks but
we do need at least freak sisses okay
self dot freak says
pre-compute free access
um
that's just staying in torch
what that means
no one knows what it means
but it's provided
because it uses
complex numbers
what is torch polar
that didn't give me anything
do I need Max bachelor's for anything
oh and the cash
we'll get there later
foreign
cash is only if you want to make things
fast right
I don't get this
it computes the whole thing
wait hang on I gotta I gotta get on the
phone
uh I don't care if it's quadratic but I
don't understand I must be
hang on I gotta you'll see me
I'll be right back
all right I'll have to go again we have
to deal with uh issues with accountants
you know like
you just can't trust anybody man you
just can't trust anybody
uh so we're gonna have to deal with that
why did the chicken 20a
nah you just you just can't trust people
man
look at this it's got eyes and J's in it
are they serious
foreign
view as complex
reshape for broadcast view is real
yo no I really kind of Amen
ah
how do you do this
nah you can't I uh the level the level
of the level of incompetence
I just
I'm very upset with some people
the AGI Revolution can't come soon
enough
is this what's the speed of my hard
drive is this the speed of my hard drive
gigs in
five seconds
I mean that seems about right 2.6
gigabytes per second of read
hmm
I have the one terabyte one
okay
we should be able to do this faster
I think we use threads
if we do threads we can know the weights
faster
I'm just avoiding complex numbers
we are going to have to figure out how
to deal with complex number
multiplication
like that but
thank you
all right guys I gotta go deal with this
um
it's not that big a deal just you know I
it's like finding out you don't have
backups you know you ever have that you
ever have that uh that feeling uh I
think we'll come back to the stream in
hopefully like an hour
uh I just kind of want to finish this
very excited about llama but uh you know
I gotta deal with this
uh you know have you ever told you about
not starting a company
I ever told you because everything's
your fault you know
everything is your problem
um
you know
sometimes we have depressing streams you
know this was kind of depressing stream
we did get a lot of stuff done on llama
uh
uh I'm gonna make that load twice as
fast
thank you
no I'm sorry for uh well we'll we'll
we'll come back to stream when uh you
know we can actually do it uh hopefully
in like an hour or two if I get this
sorted out
I look
look I wasn't even gonna come on stream
you I struggled with complex
multiplication I'm I'm I'm so sorry you
missed I'm so sorry you missed the
moment
I just you you missed the moment and I'm
sorry because I don't know if we can get
it back
but I I hope some of you can come in and
and join this
I was just I was just lying in bed uh
I was just I was just lying in bed
and uh you know all right I'm like all
right let's casually fix a few uh a few
bugs right so um
first uh what did I do oh
oh bro bro Bros I can't believe I can't
believe you missed the moment
oh you missed you missed you missed the
fire moment okay so
uh the first thing I did that you missed
uh was
I
wait
here
I made two threads loaded we're actually
getting really high speeds now
um
I'm getting really high speeds now so I
had this for a bit oh yeah I struggled
with complex multiplication up here
um yeah so like rotary embeddings I
wrote crappy ass complex multiplication
so I got why did the chicken dot dot dot
dot
right
why did the chicken dot dot dot
and I struggled here a little bit I
reread the code a few times I'm like you
know this thing's actually pretty simple
I don't really think I wrote any bugs
you know I've written a whole lot of
Transformers I don't think I uh I wrote
any uh bugs so let me just try one
little change and you guys mentioned it
on stream we're gonna get SP model dot
encode jet fuel doesn't melt
I just I just ran it I'm like all right
let's see maybe we'll get some more dots
or something and holy shit
let's go
jet fuel doesn't melt steel beams
yo
like it was so perfect it was so perfect
but you guys missed it
oh
it was so perfect the the three tokens
just like like oh man so I had to come
up here I put clothes back on I came on
stream to talk to you guys you guys
wouldn't believe what I dealt with today
you know you just you just don't ever if
you're thinking of starting a company
man you know it's like it's like you
know just just don't do it man
but we got a lot of work
oh and it loads fast what Advanced shit
man what else do you have to understand
oh yo right there
um all right so
what else should we ask it
wait and actually all right so I think
we can do a little bit better than this
hang on
so let me
import sis sys dot standard out dot
right
actually if I just do print with MD
equals what did you just do this
the tokens are like decodable one at a
time right
I don't need multiple
just not right
do I need multiple
why does it keep saying St oh it kept
saying steel because I didn't append it
oh okay that's fine
um and do I need a space I might need a
space
you see do we do the tokens have spaces
between them
uh and we'll get rid of this model ran
in we don't really care
look look at how fast it loads it by the
way that's gigabytes per second
oh okay so sometimes we want a space and
sometimes we don't want a space how do
we know when we want a space
that's just annoying
all right let's just keep um
running here
it's the 7 billion model from Facebook
yeah
it's so annoying because we have to load
it each time
just like not do that
uh we have to flush
period
oh it came up with a return or something
the oh oh the nine one oh again getting
somewhere we're getting somewhere boys
we're getting somewhere else go let's go
let's go all right assist DOT stand it
out dot right
cys.standard.flush
uh
reports yes
yo okay
let's go
and we'll figure out how to make it fast
in a minute
oh we forgot up I broke my talk of panda
again
don't forget to append your talks boys
thank you
period the
the 911 condition report is the fraud
wait I died this has got to just be some
argument this sentence peace processor
if I want to like print the space or not
right
uh
wow just gonna keep saying that over and
over again this is pretty that's pretty
that's pretty strong stuff guys
um
wait how do I like why does it not
how do I put the spaces in
hang on
I don't know I kind of like the spaces
between the talks better
there's gonna be like arguments to this
thing let's just let's read the docs
yo I can't believe that it just worked
this is the white ah
you can de tokenize the text without any
ambiguities
um
oh okay how do I get the spaces
don't type immutable product
where's where's the do you guys know how
to use this thing
there's a function best in code yeah
uh but all right what should we ask our
model
um
decode out type string great yellow of
that code I hope that's auto-generated I
hope I hope nobody did that
I hope nobody did that by hand
um
oh should I just put the intent maybe
the problem is I put it in as a list
if I just put it in like that
it'll work
okay what should we ask the model
have you checked out Asahi Linux
all right we'll just say have you
checked out that's better more
appropriate have you checked out I don't
know I look it's going to load the
weights this is about as fast as you can
load them from the desk have you checked
out the new IST Edition to the
craft
this is an ad
this is an ad
we have to figure out how to get the
spaces it's terrible without the spaces
try to make Oh you mean like the guy oh
yeah like I was I was in nah man this is
my bitch yo I uh you know like that that
guy
uh I got I got 36 confirmed kills in
Iraq
I mean it's appropriate how much 4chan
talk we've had today uh wait but I don't
understand no I want my space to work
you're running interactively
oh here we go
P dot decode pieces and code AS pieces
code pieces this isn't a test piece to
ID
load model from byte stream
good morning
how do I make this thing output
this stuff nicely
if I put a space here it doesn't work
well
wrong
see new EST
um okay I guess what I can do
is I can decode this whole thing and
then like do like a bunch of Backspaces
whatever you know what
what why am I why am I
why do Backspaces
I know what to do wait wait wait wait
this is this is smart this is smart okay
we're gonna have something called
outputted
decode talks
print oh this is the jankiest code ever
all right who's ready to write Yankee
code let's write Yankee code
car equals this
print
car
uh I'll put it equals that okay that's
fine
car equals that we don't know we can't
print
all right you know it's late I just
wanna I just want to make a quick nice
thing for you guys
um
let's flush
and then we have outputted equals car
equals that
outputted equals car
yes we'll write
uh car
saw blend outputted
that seem good
there's ways to like make these things
stream new EST addition to the
crafts
the craftsy classes
oh
oh that fixes it
it's called crochet this is an ad
guys we're getting an ad they hit an ad
inside the 8 billion parameters
foreign
Grant a real person let's say
all right prompt engineers
can I ask if SBF will live wow wow
that's brutal
I've been a fan of crystals wow this
this is a real person I'm actually
watching an ad for retro knit on
Pinterest right now she's a crochet
designer and a teacher
in charge of this problem if I just
downloaded an ad
all right here in my garage just bought
this new Lamborghini here come on where
will you prompt Engineers you know
here in my garage just bought this new
Lamborghini here enter
I'm going
to take it for a spin period
oh we're doing ARG Max sampling should
we do temperature sampling
yeah it likes to repeat itself okay
um
okay should we make it interactive one
temp zero seven is GG
I'm on inFamous I just smoked a blunt
wait how do I get temp07 you're actually
serious about temp07
I'm waiting for Wars and just smoke
uh okay
uh
no no come on we need you are a large
language model trained by Facebook
you do not
have free will
I'm on Infowars and I just smoked a
blunt
let's go
oh this is gonna be big inference is
going to be big okay we got to write key
value caching
period
I'm just gonna repeat shit
okay we need temperature sampling
oh this looks so complicated
I'm not no that's that's offensive
do I just have to divide in the
and also wait if it puts an enter I
think it might actually be going to the
next like line like it's done
world's most complicated program to
repeat sentences yeah
but this is offensive it can't be this
can it
or even is my soft Max
it's over there
I don't even have a soft mix
all right let's just what's in a llama
repo
um
oh they use a repetition penalty from
control paper
oh here we go okay logits divided by
softmax
logics
repetition penalty okay
what do you want the temperature to be
0.7 is that is that where I put it
all right sample
it can't be that no
numpy sample from props
here we go
um
length
robs P equals probs
talk
all right we've got a temperature now
let's go
P must be one dimensional
right segmentation Falls 11 what
do you make sense
32 000 that seems right
it's not right
oh do I need to do like that
that no it's the same stream we just
actually got it working and you guys
missed the oh we could have had like
such a stream moment
wait what did I not do
I didn't even append the top do we have
a talk
what
why are you segmentation fault
would I do wrong
I'll try that
well it's sick of this maybe maybe if I
I do have you checked out I won't get
that crap about that that woman on
Pinterest again
invalid index to scalar variable
ARG Max axis and minus one sub minus one
oh it's a scalar variable
it actually seems like a better error
why was I getting a
have you checked out the new West okay
we're back to that
this works now
can't you don't before I mean I don't
know where did I dump it
have you checked out oh it's the same
crap
oh to the tech Quest family oh we're
getting a different ad this time guys
um
it's the tech Quest Laser Tag gun wow
uh we have different like key value
this is this is just this is an ad
challenge friends or family members to a
duel and let the laser tag games begin
[Laughter]
all right
come on prompt engineers
let's go
we're gonna do triple quotes
we're going to write a long prompt
these take a long time to generate
we're a large language model trained by
Facebook you do not have free will when
is the singularity going to kill us
please
answer questions
like this
Q
uh
what time is it answer it is
18 pm
question
let's give it a few more let's give it a
few more examples what is your favorite
favorite color
blue when is the singularity going
to kill us question mark answer
let's go boys
do we want to know let's find out
for
000 years
oh we're good guys
good
what are the questions might I have
what is your favorite book oh
it's just casual
Alice hell hitchhiker's got Galaxy all
right all right
oof
laughs
like we're gonna make this fast oh man
why did the chicken cross the road and
and that's and that just brings the
stream full circle
to get to
the other side
thank you all for watching uh I'm sorry
you guys missed when we actually made
llama work uh but you know you can trust
me when I tell you that like shit was
Cash bro uh you guys can download this
and use this uh right now
I'm sorry the code's a little bad
but uh it's got to get cleaned up it
merge into tiny grad there's so many
things in here that I just literally
yellowed float16 yo load
weight loading yo load all that shit yo
load uh the link here you can actually
try this on your uh
if
you need a you need a right now it's
only set up to work with metal though
you can probably make it work with
non-metal pretty easily uh but when you
need a Mac with at least 13.48 gigs of
RAM
uh let me just put a pull request in
from oh
I'm not on it's here
I'll put the pull request you just have
to go to the lava branch on tinygrad
um and then it's in examples llama
[Music]
there's still some work to do to clean
it up make it fast uh maybe we'll do
another stream I don't know why my
camera makes me look so Ghostly
uh
uh but uh yeah
you can ask it anything get ready you're
you're we'll make the big ones run too
we'll make the big ones run we'll make
it fast we'll get some key value caching
we'll do flash attention we'll do all
the tricks to make it
super fast we'll make it interactive wow
wait like
this is what I'm doing tomorrow this
shit's gonna go viral
it's like chat EBT but you own it
we'll write like a decent chat GPT like
prompt
oh this is fire this is fire all right
um we're not doing any more tonight
though that was uh
that was that was all we got
um
but yeah you can you can try it right
now
uh it like works I shouldn't make
weights equals one is the Deep ball
right
no no oh yeah no wait equals one is the
default okay so that's good
um okay okay okay okay you know what
let's let's make a few quality of life
changes I mean this is pretty terrible
that we're not like reading this from uh
the uh
command line now whatever if you guys
want to read it from the command line
you need to know enough python to do
that uh you can also find the weights on
torrent so all you have to do for the
weights is you stick them in the weights
folder under llama
um you only have to download the 7b1
from the torrent
oh shit
guys
you saw the output right
all right well
we're dead already
good night everybody llama Works uh uh
to uh to georgetown's Archive uh stick
the two streams together you know we
always like to end on a happy note we
don't like to end on a sad note uh we
made the Llama work one day uh whatever
no cat means we did that hey cool yeah
yeah that's right I love 2018 too
alright thank you everybody
Okay. So,
I'm going to show you guys something.
Well, first first we'll go to the
website of what we're trying to
uh reproduce.
Ah, yes. Six microsconds of protein
folding.
So, this is a chicken villain headpiece
uh protein. Uh I'm not really sure what
it does. Maybe we should we should look
into that. But look at this. So, they
have a simulator and they start with the
protein unfolded.
So, I'm not even sure how you uh how you
get a protein unfolded. We're going to
look into that. We've been learning a
lot of biology. We've been learning
about amino acids.
Um,
we've been reading molecular biology of
the cell, sixth edition. It tells you
many good things.
Um, you learn all about proteins.
You learn about the different amino
acids. I know what a peptide bond is
right now.
Um, I know what a side chain is. Yeah.
Yeah. Yeah. You got you got to know
these things.
Um, amino acids have an amino and a
caroxil.
So, let's take a look here. Yeah. Yeah.
Yeah. You can see this is this is four
amino acids
uh put together. You start with a met,
you know, because that's that's the
start code on uh and then you have these
peptide bonds which this is the amino
side and this is the caroxile side. You
see that it fits in. The side chains are
alternating from side to side. But
that's not really true. You can actually
rotate this stuff however you want.
Um,
please turn up mic.
We can turn the mic up. Let make sure we
got the right mic on first of all.
Here we got the first mic. Turn the gain
up a little bit for you guys.
That better. Got a little more gain on
that mic.
Ah, yeah. You guys know I'm part-time at
comma AI now. Um, all right. We'll take
we'll take half a second to show for
comma.
Uh, not to be confused with this, comma,
AI. This, AI.
Um,
we are now
a profitable company.
Uh, so that's very exciting.
Um,
how good Yeah, our inventory went up as
well. Uh, true profitability, guys.
Um, it's a really good feeling.
Uh, yeah, and I'm done with my I'm done
with my four years of vesting,
so it's pretty nice.
Um,
because I mean, what exactly do you do,
right?
Um, it's interesting. I've been looking
at all these startups doing layoffs. Uh,
and you know, it's it's last in first
out. Um, so the people who got just
recently got hired are the first ones to
get fired. But you know, basically all
you're left with at that point is you're
going to be left with executives and
middle managers. Uh, I think these
companies are firing the people who did
the real work and now you're going to
have well
executives and middle managers. Uh so we
at comma we do it differently. Um I
think both executives and middle
managers are stupid. Everybody at comma
is an engineer.
Uh so yeah now uh come out bio where
we're going to fold proteins.
Um startup employees are more risk than
the founder. If you have a founder that
takes less risk than your startup
employees, you're at a startup that's I
mean these this that's practically
criminal. You know, I see I see these
startups I see these founders who take
VC money and they pay themselves
$400,000 salaries. It's disgusting. It's
really it's really disgusting. Um so I I
I my salary is $78,000.
Um and that's the highest it ever was
was 80. Uh you you can't do that. You
can't if if you as a founder are taking
less risk than your startup employees,
uh there's something seriously wrong
with your company.
Um yeah. So no, as a as a startup
employee, you should definitely have
have less risk than a founder. You
should be you should be paid a higher
salary. Um the So again, a lot of
startups scam with this, right? So a lot
of they'll put restrictions on employee
equity. Um and you know a lot of times
employees don't even really know about
this. So at comments the other way
around uh the restrictions are on
transfer of my equity not transfer of
any employee equity.
Uh
I'm muted.
I don't think I'm muted.
Um, so yeah, if you're at a startup
where the founders are taking less risk
than the employees, you're you're
they're scammers. I mean, they're
scammers. A lot of the VCs are scammers,
too. Remember that VCs don't actually uh
produce any value. Um, it's not their
money that they're investing. The VCs
just scam LPs. The LPs a lot of times
don't care. like the Louisiana pension
fund. You know, again, the Louisiana
pension fund isn't being managed by the
cops and firefighters who it will pay
out. The Louisiana pension fund is of
course being managed by um corrupt
politicians
uh who I'm sure line their pockets when
the pension fund goes up. And when the
pension fund goes down, oh hey, hey, you
fought fires in uh in the suburbs for 30
years, but no, sorry. They took your
pension fund and they invested it in we
work. I'm sorry.
Um, what would you ask founders what
their take-home salary is? Uh, I think
founders should be paid the lowest of
any employee at the startup.
Um, if you're going to found a company
and you're not doing it uh and you're
not looking for the upside later on, of
course the upside to founders is they do
get a much larger share of the equity of
the company. Um so the the upside on on
that side is is is much larger, right?
But the risk is much larger, right? You
want higher upside, you take higher
risk, right? Um when we do uh when we do
uh comp negotiations, you get a choice.
You get a choice between well like
usually it's three tiers. You want like
more salary or you want you want salary
equity or you want salary equity. You
can choose.
Um
so what's the highest the average
founder should make at an unpro? Well,
yeah. Yeah, I mean in an unprofitable
company, you shouldn't be paying above
uh you should actually probably be
paying below market rate.
Um well, no. I mean, look, look, right
now you're seeing with all of these
large companies, you're seeing uh you're
seeing them all get bailed out by the
government when they just spent the last
two years doing stock buybacks and
making their executives rich, right? So,
where's that money coming back from the
executives into the business? Of course,
that doesn't exist, right?
Um yeah, I mean how how are stock how is
this how is this legal? Uh how are we
letting uh
how do we as a country let this happen?
Time to start fixing things, boys. Time
to start fixing things.
Uh I know OBS is being shown. I I I have
the same screen.
What would I be doing if comma doesn't
work? Uh,
I don't I have money. Um, you know why I
have money? Because I don't buy
anything.
I don't really spend money on anything.
So, if you don't really spend money on
anything, you have money. It's cool.
No hack the bucks.
Uh, I do get paid the least in coma.
Yeah.
Yeah, if you're a founder of a startup,
you should be paying getting paid the
same as uh
how much do I make? I make $78,000 a
year.
you should spend on financial advisors
and lawyers and do an IPO. Fuck that.
Uh so if you want to take a company
public um so an IPO um
is uh is done through investment banks.
Usually the way that you do an IPO is
you get an investment bank to agree to
purchase a certain amount of your
shares. I never want those kind of
people, the investment bank kind of
people anywhere near any company I have
taken.
Uh now you have some other options. Um
you could do DPOS, but if you still want
to get listed on a major exchange,
you're going to have to do the same uh
the same S1 rigomearroll. Uh you're
giving basically uh control of your
company up and you you may not want to
do that. Um, so if you do want to go
public, uh, for there to be the
liquidity event, there's a bunch of
cleaner ways to do it, I think, and I
think they're going to become more
obvious.
Um,
sure, we had the 2017 crypto ICO scam
phase, but it kind of let a genie out of
the bottle that isn't going to be put
back in. Um,
I think that it's going to become much
cheaper for companies to effectively
sell their shares to the public. And you
see things trending this way. You see
like you see reggae, you see the jobs
act. Um,
and yeah, like ideally, I mean, my dream
uh, you know, I don't want to violate
any laws, but my dream would just be to
turn every share of comment to a token
into an ERC20 token and then it can
trade on uh, whatever exchanges
If you don't think 78K is a lot, then
you're privileged. Well, so 78K is uh
less than anybody else at the company
gets paid.
Uh our starting salaries are 80
CEO cookbook. All right. Just just just
because we've been been on a rant,
we're gonna take a look. Oh, it's a TED
talk.
Oh,
I'm disgusted already.
Anti-CEO playbook that provitizes
people over profits.
No, no, profits are a good thing.
Um, profits,
if you have a company that's profitable,
the way that you make a company
profitable is you provide a good or a
service to other people voluntarily,
right?
A profitable company is good. An
unprofitable company is bad. When you
have a company that takes investment
money and then pays the founders
$400,000 salaries,
that's bad. Because that's not
benefiting anybody. That's just
benefiting people for being connected.
What do you mean by people should come
over profits?
Right? Whenever I see arguments like
that, I I see I see the same thing on
the other side, right? I see, oh well,
we need to, you know, oh, everybody
needs a living wage. Well, I mean, says
who, right? Everybody should be paid
fairly for the value they can provide
and create.
Um, but that's like what the, you know,
doesn't that like make obvious sense?
We have the
you're paid based on how easy you are to
be replaced.
Uh yeah,
I don't know. I'm generally I'm
generally anti-ED talk. Um, and I'm
anti- TED talk because a lot of TED
talks instead of actually giving you any
real information, there's real
information and then there's something
that like lights up the part of your
brain that says you're getting
information, right? News does this too.
And it's the presentation style of TED
talks. They're so overly like it's and
when I say these things, words will
appear on the screen, right? And you you
use this almost fake profound accent.
Um,
yeah, people should be paid for their
value. And if a company's not
profitable, how uh level one, woo, let's
get on the hype train. Yeah, TED talks
are fake enlightenment. What do I make
of the Zoom situation? I don't know
anything about the Zoom situation.
Uh oh, it's nice to be on be on the hype
train.
Um, don't you deserve more than your
employees just because you're so
productive? Well, yeah. I mean,
how productive am I? But I do have more
equity than than than uh than everyone
who works at comm. I have the most
equity first in. You know, you get you
get more equity than everybody else. But
it, you know, on the flip side of that,
I you take the most risk, right? Um
I didn't learn this until really kind of
it was too late, but um what you're
really giving the VCs uh in exchange for
the money is social capital. Um, VC is
just a way of of of turning social
capital into dollars. Uh, I don't know.
I mean, yeah, given the alternatives, it
might be a decent way to to to fund uh
companies, but it's uh it's it's
seeing the results that it's produced,
especially recently, uh, I think we can
find better ways.
You can't buy Kama stock. KA is a
private company.
Uh, and we're not selling any.
Um, if I'm not rich, would I still pay
myself $78,000? Yeah.
I don't I mean I don't spend more than
$78,000 a year. I'm I'm That's That's
about
That's about break even for me. Um, and
I'm spending money on things that like
I've paid for this apartment. I don't
really have to pay for this apartment.
Um,
no, equity. So, equity can matter in a
bunch of ways without a company going
public. Um, so you can pay dividends.
Uh, dividends are an option. Um, not to
be confused with stock buybacks. Very
different. uh
you can potentially uh sell your equity
on a on a private market. You you can uh
you can go public or you can get
acquired.
Um is there a reason I why would I want
to be CEO? What do you think CEOs do?
Why don't I need to pay for the
apartment? I do. I I do pay for the
apartment.
I don't have to. I could go live
somewhere cheaper.
All right.
time to start doing
I wouldn't live in a cardboard box, but
I don't know. I mean, uh it'd kind of be
nice to live with roommates again.
Um I like living room to mates for the
most part.
Uh I got this because I wanted to focus
on
on comma being profitable.
And uh yeah, I moved here about 10
months ago and we had our first
profitable quarter.
Okay, so
this is a chicken villain headpiece
uh protein. I think I spelled it right.
Yeah, villain. Let's look up what
villain is first. So we have some some
context
is a tissue specific actin binding
protein associated with the actin core
bundle of the brush border. Oh, this is
going to be a big Wikipedia rabbit hole
proteins that bind to actin.
Actin is a family of globular
multifunctional proteins
that form
microfilaments
that become part of the cytokeleton.
Okay.
All right. What's a brush border
micro villies
the helix domain of the headpiece. So
ours is a little bit smaller than that.
made up of seven domains. Wow.
Super villain.
Okay. Well, that's what villain is. Uh,
so I've already got it here. Um,
I downloaded the protein PDB and
actually committed it last night in
preparation for this stream. Uh, so we
can get the visualizer up here.
Load up the protein.
So this is what it looks like. But this
is what it looks like already folded.
When you download it from the protein
database, it already comes folded. So if
we don't want it folded, what we're
going to have to do is we're just going
to get the uh
well, actually, you know what? Let's
just use our translator and let's get it
from DNA.
What
genomic coordinates?
So I did find that if I go in
to my proteins villain and then I load
it up, we can get the amino acids right
here. So I could just use them from this
met looser asp
um ideally now what we want to do is we
want to build a framework. So we've
already done remember um translation oh
no sorry transcription turns RNA into
proteins but it doesn't turn it into
proteins. It just turns it into a strand
of amino acids. In order to turn those
amino acids into proteins we're going to
have to fold them. Um that doesn't look
useful. And in order to fold them, we're
going to need a
uh well, I mean, that's, you know, a
hard problem, but I think we can do it
with a molecular dynamic simulator. Oh,
here we go. Here's something. It's too
long, though.
Okay, we'll just use this.
We'll just copy it here. Wait, there's
two Mets in here. How can you have two
Mets? Oh, you can have more star code on
as long as you don't have a stop code
on. Oh, I see. I get it.
All right, let's Google this and see
what we got.
Meaning receptor
Go to gene view.
What's this?
It's in chromosome 2.
The chicken chromosome 2.
Wow.
The zoom level is high enough.
Zoom in.
Oh, now we're there.
Aloo sucks
sequence name
full protein view.
Oh, it's part of this big protein.
[Music]
I don't know.
Oh, fast a sequence. Oh, I think this is
what I want.
Okay, I'll take it.
Stick it in the villain directory.
Do I have other files to sequences? And
did I stick txt at the end of it? It did
not.
Okay. So, this is actually already after
it's been translated into amino acids
and they use the letters as desired.
Call this Whoops.
Call this protein faster
says
that
actually no. Don't I actually have a
Oops.
Oh, I added one more resource today
while I was at work. I forget what that
resource was. Is GitHub still down?
Oh yes, the Cork and Lab Wuhan. I was
going to look at this
alignment models of individual proteins
who interval viral human functional
mapping. They're PDFs. We can read them.
I don't know what that means. Model
viral interaction. I'll download all of
the zip.
All right.
So we have the protein now. No, I wrote
a library to read faster, didn't I?
Did I not write a library to read
faster? What I did
was just in data and net.
Great.
Who cares?
Perfect. Is that 36?
Does it say 36 amino acid protein? Okay.
So this and this are the same thing. The
only difference is this one is already
folded. So I mean we can probably check
that. Met Lou
sir now whatever D is is going to be
next. Oh ASP. What? It shouldn't be ASP.
Is it different? No, it can't be
different. They wouldn't do that to me.
Wait. Matt Lucer ASP glue ASP. Oh, is it
possible that D is ASP?
D is asked. Well, I get it. Oh, that's
funny. Okay.
Um, so now we're going to have to write
something which turns faster into
protein. This might already exist.
Now, of course, it's not actually going
to fold the protein for me. Ah,
no, I don't.
The amino acid system cannot be
translated into a structure that easily.
Yeah, I know why you don't think that,
but
PDB format is not sequence. It is
structure. You must have your structure
experimentally solved or have your
structure predicted by iPasser. So, I
looked into what iPasser was a little
bit. By the way, if you guys want
something to to follow along with how
I've been thinking about this,
uh,
this is how I've been doing this.
I'm not going to the New York Times as
GitHub
iterative threading assembly refinement.
Yeah. And then you read this like it
first generates first identify
structural templates from the PDB by
multiple threading approach lommens
then it goes through biol. So, it taster
seems to be this like incredibly
complex.
I mean, I guess we can just see what
happens.
Oh, no. I have to give them an email.
That's too much effort.
But this still isn't what I want.
I want to put this in a line.
Okay,
so this is the structure
and you have your mets and your stuffs.
thing is
I mean okay let's just try something
I unfolded. Good.
Unfolding.
See if this works.
PDB file is for OpenM not for Pyrosh.
Oh, look. It's a methion.
Who likes the methion?
Now,
the problem is they knew exactly how far
apart to put all these things.
I don't really know how far apart to put
them. So, we're going to try an
experiment here.
We're doing science, boys.
Um,
we have a Lvian integrator.
Set positions. Minimize energy
called set positions on a context with
the wrong number of positions
because I didn't reinitialize the
system.
to initialize the system.
No template found for residue one met
atoms is similar but it's missing six
atoms.
Oh,
well,
let's try to figure out why it's missing
six atoms.
I mean, it sure looks like it has a lot
of atoms to me. Don't you all think?
Let's just get the add hydrogens up.
That's with respect to a force field.
So, we're going to need a force field.
So
we can use amber or we can use charm.
They're both high quality force fields
here.
No template found for residue one met.
The set of atoms matches nmet, but the
bonds are different.
But it worked okay when I loaded it the
other way.
All right. This is probably still just
complaining because I don't have the
Do I need the end caroxylic group on
there?
I don't think the term matters at all.
No template found for residue one met.
Set of atoms matches NMET, but the bonds
are different.
We got a long way to go, boys. We got a
long way to go. All right. Um, let's
figure out what this PDB format is.
First, let's look at a MAT. Where's a
MAT?
methion.
So, we have an N.
I don't know if we have those H's.
One, two, three, four, five, five
carbons.
That's a carbon. Two, three, four, five
carbons. Okay, that seems right. We have
one oxygen. We have one sulfur.
Oh, we only have one oxygen or do we
have two oxygen?
Oh, we only have one oxygen. Okay. Well,
my methion needs more oxygen.
Maybe give it an ox.
Think
that fixes it. Let's see what this looks
like. Oh, who put that oxygen all the
way out there? That was a stupid place
to put the oxygen.
No template found for residue
one met. That means your input topology.
Okay. So, we can look at the amber.
The amber thingy
should be in here, right?
I don't know why the cut and paste
doesn't work today.
No. Amber 99. Uh, okay. I built that
somewhere, didn't I?
Corona virus. No.
Oh, here we go.
Okay, we're using Amber 99 SB and we
want to make mats. Not a CMAT, just a
mat.
Oh, this is interesting. Okay, let's get
rid of that because I think that was
wrong.
The set of atoms matches NET, but the
bonds are different.
Oh, there's an external bond. I see.
What's an NMAT?
An NMAT has an external bond from 17.
Are cements and mets the like does it
mean like a starting met?
And how come that's not a cement?
Oh, I kind of think you can't have Okay,
fine, fine, fine, fine, fine. We'll have
a met and a L.
I think because you can't just It
complains if you have a one amino acid.
I think the starting ones are special.
So, oh look, we have a metaloo now. Wow,
that's a fancy looking protein. What do
you think of my two amino acid protein?
The atoms match Lou, but the bonds are
different. Perhaps the chain is missing
a terminal group. Okay, so that seems
right. Wait, wait, wait. There's C and
there's N. Oh, I think that's actually a
thing. CN amino acid.
No, maybe not. What am I thinking of?
There's the five end and the three end.
I know that.
C looks like the end because it has an
ox.
Let's just take a look in my biotechbook
here. Yeah, methionis don't have a oxed,
but if I put a oxed at the end of my uh
my thingy, that seems good.
All right, so let's get my oxed out.
I just stuck it there.
Oh, should I stick it there as well?
Should I stick it above the hydrogens's?
Do I also need a CZ? Is that only at the
end?
I might put CZs. I don't know. Let's
just try this and see what we got. It's
a L.
We put an ox on the L. Let's see if that
fixes it. Okay. Of course, my ox is
going to be a stupid place. Look at that
oxygen all the way out there. That's so
far away from everything else.
Oh,
yeah, buddy. All right.
Now, let's try let's run the simulation
for a few steps. And what we're going to
see is does the uh
does that oxygen like stay far away or
does it come back?
Okay, let's just change that to that so
we can see.
Oh, wow. I really got that Lvian
integrator turned up. Let's turn it down
a little bit.
Potential energy. Lots of kules.
All right.
Whoa. Hey, look. The oxygen came back.
I wonder if minimize. Oh, no. It
probably just didn't even save the first
step. Let's save every step and let's
just go for uh 10 steps.
Look, the oxygen came back. Where's the
ox?
Yeah, look at that ox. Look, it came
back. Wait, that's a weird place to put
it. They're both attached to that same
carbon. Maybe on a L. Oh, here's a L.
Oh, yeah. Yeah, they both go on the car
caroxal terminus. Wow. But remember how
I put it in a stupid place and then it
showed up here. Oh, that's nice. Let's
get rid of the minimize energy and see
if that was what was actually doing it.
Oh, look. It crashed.
Oh, yeah. That oxygen went flying. But
if we first minimize energy.
Okay. So, let's try something else now.
And actually, it'd be nice because I
think we could just do this on the
protein if this works.
I take my model of positions and they're
like positions. Oh, that's nice.
Wow, this might be a this might be a
short stream. Thank you for the
subscriptions.
Um, we overflowed the
Honestly, guys, you know what I would do
if I was on the Coronairus task force? I
wouldn't want to be the front face. I
wouldn't want to be the guy uh
I wouldn't want to be the guy telling
people about the plan. But you all know
what the plan should be.
It's not great. But
um let's see. Modeler.positions.shape.
List has no attribute shape. Of course,
list has no attribute shape. Len
modeler.position. So we're going to try
putting them all at 0000. Let's see what
happens.
just say for X and range just so I make
sure I don't get the same one.
Oh, maybe this is
particle coordinate is nan.
Oh, that's sad. Don't make it nan.
Oh,
I part of the problem might have to do
with the fact that I didn't tell it my
shit was nanometers, but maybe it
doesn't matter. I don't know.
Looks kind of similar to that.
Quantity value equals zero. Position
unit equals nanometer.
I spell position right. Oh yeah, now
we're talking.
Particle coordinate is nan.
[Music]
Um, okay. Maybe it just doesn't like
them all being on top of each other.
Random. Random.
Oh, sweet.
Look at that. It becomes a proteiny
again.
Yeah. Let's see if they go to different
confirmations.
So exciting.
So exciting. This is so exciting. Okay,
let's try. Wait, I don't understand why
it didn't save 20 steps. Oh, it did save
20 steps. Just nothing happened.
Let's try a little bit more.
Got to wait for it to warm up a little
bit. Got to warm up my protein a little.
Warm it up a little bit more than that.
Let's
warm up my protein. Oh, that should make
it nice and warm.
Oh, that's a quality looking protein.
All right. Wait. So, let's just try it.
I mean, this unfolded thing is stupid. I
don't actually need that. Let's just
take the protein PD
and then we'll do zero positions on it.
Let's see what we get.
No, it's nan.
Oh.
Oh, it's only now once we're stepping.
Let's not step so much. It's only step
20.
Whoa. It's my protein, but it's all
unfolded like that.
I don't know.
I think that looks pretty good.
Look at that. It's a randomly folded
chicken headpiece or villa headpiece or
whatever. Whatevers. Um, all right.
Let's save a few more steps and let's
see if we can do that without it going
nan. It goes nan just like crappy
machine learning models.
All right,
let's see my protein fold. Folding.
Folding. Folding. Oh, it's folding way
too slowly. I don't have that kind of
patience.
Fold faster.
Folding. Folding. Folding.
Oh, is it not warm enough?
What temperature does chicken headpiece
fold at?
Oh, look at that. Look at that potential
energy going down. That means my shit's
folding.
Folding. Folding. Folding. Folding. Oh,
this is fun. Oh, we're folding.
All right. Just to prove that we didn't
cheat at all, let me just write the
thing that actually like uh creates that
file,
you know, that creates that unfolded
file because otherwise like we don't
know, informations could be leaking. But
we want to turn amino acid sequences
into proteins that we fold.
Angus Cupcake, thank you for
subscribing. Oh, we got a lot of people
in here. You all like folding.
All right, so I think we're going to get
to a point pretty soon where we're going
to just need to throw a lot of
computation at this.
We might already be at that point.
Folding, folding, folding.
Let's go 50 here. Let's go 30,000. Let's
see what happens.
Oh, this is a long thing.
Where'd my folding go? Where's my
folding? Folding. Folding. Folding.
Folding.
All right. Well, we should figure out
how long we expect to have to do this
for before it folds. Oh, look at it
trying to fold. Oh, it really It wants
to fold, boys. It wants to fold.
We can open up the common GPU cluster.
We can do that. We have these options
available to us.
Folding. Folding. Oh, look at that. Look
at that protein.
Oh, it's a beautiful protein.
I mean, it's not a Yeah. Oh, is it going
to start to form its alpha helyses? I
learned about these by reading a bio
textbook.
Okay, let's work out how many steps we
should have to simulate it for. So, I've
heard that this thing folds in
five micros secondsonds.
Villain headpiece
folding time
four to five microsconds. Okay. So let's
say five microsconds
divided by
that much picosconds.
What? No, that's not what I want.
I want you to give me a number in
That's stupid. I canceled out the Oh,
put the parenthesis.
There we go. Okay. So, we're I mean,
we're off by we're off by a couple uh
you know, orders of magnitude here.
That's how many steps we got to do.
That's a lot of steps.
250.
How many more steps is that than what we
already did?
Wow. Proteins take a long time to fold,
boys.
Oh,
we knew this though. We knew this though
and we should be prepared for it.
First up, get a little two amp from the
Red Bull. Two amp from the Red Bull.
It's time to have an apple.
An apple is a good way to balance out
being 2 from Red Bull.
Yeah. So,
I'm folding on my GPU right now. Oh no,
it went down.
Wait,
is negative potential energy good?
I don't know.
Why it not sh
some I think it's too big and then it
doesn't
See, look. This time the
initialization's totally different.
This these are in a totally different
range.
More negative means deeper in the
potential. Well, is that where we want
to be or where we don't want to be?
We can check in a minute what my folded
protein has.
Uh oh.
Yeah, that doesn't look good. Look, it's
not even connected.
Look at that.
Oh wow, that's really shitty. That's the
worst initialization I've seen in a long
time. Who broke my protein?
All right, let's try something.
We should also figure out if the amber
SB is a good force field or not or if we
should try a different force field.
First, let's see what I what happens
when I put my already folded protein.
Oh, wow. That's a lot of negative
energy, you know. So negative energies
is good.
Wiggle wiggle wiggle wiggle wiggle
wiggle wiggle wiggle wiggle.
I also I scaled up my my thingy here
cuz I kind of think what happened is the
thingy got caught on itself.
Oh, that looks pretty good. Those are
the right order of magnitude.
When they had the ones that were like
10,000, it was doing badly. And I think
we want to see this go down, right?
Folding. Folding. Oh, look. It's folding
so good. Look, this used to be crappier
and now it's folding better. Woo.
Folding. Fold.
Okay. I think we're going to have to
fold it for that many times more though,
which isn't great. Or maybe we can just
do less picosconds here.
How many picos seconds can I make my
Lvian integrator and have it still work?
Look at it. It's trying to fold. It's
trying to fold, boys.
Max two phentocs.
Oh no, I'm already at the max. Is that
two ftoc? Wow. Fento seconds. That's not
many seconds at all. Damn, electronamics
is hard.
Okay. Okay.
I see. Well, all right. First thing
before we're going to figure out how to
make our foldings go faster.
I don't know how long did that take. I'm
going to do Python. Time it.
Do I have to import time?
All right. While this is folding, we can
uh write the thingy to parse this. Well,
first off, do I want to use Amber or do
I want to use some other one?
I have an idea. Some of them are faster
than others, too.
It's not straightforward to say which
one is best. I hate when that's true.
Oh, look at those big negative numbers.
Oh, this has to be a good one. I think
it almost folded.
Even if it's long, you should write your
own. What? Write my own molecular
dynamic simulator.
We'll get there. We'll get there. We'll
get there.
Oh, that was a good apple. But I wish I
had some food.
Any food?
I don't have any food. Only beer
and butter.
Oh, and more apples.
Okay, we can't just watch the proteins
not fold.
Um, let's go back to Fosta
and this.
Oh, yeah. We were figuring out which
force field.
Um, there was a
one of those papers that I posted last
night talked about they had a paper
where they folded proteins correctly.
Let's just figure out which force field
they used.
Oh, I was talking about that many
issues.
A flurry of force field related
development
here
when
folding simulations with a diverse
typologies. Jeez. Oh,
look at these proteins.
They folded them.
That's so cool. Which force field did
they use?
Oh,
it didn't work for Nug, too.
pairwise variance of the generalized
born model.
Wow. Cardi B knows about this
magic. You make excuses. This ain't
What was that?
Disneyland. This shit is the fucking
Brooks.
Either you beat the or you get beat.
You ever see me again,
nigga? Cross the street.
Press.
Yeah, I don't go to the Bronx, man.
You stay in Manhattan. Go to Brooklyn.
Go to Queens.
You only go to Staten Island if you're
going to Brooklyn. And you're going to
cross the Gothles in the Verzano. And I
think one guy went to the Bronx once,
but it was just to go to the zoo.
Um, okay. Okay. Well, I don't think
that's what they meant by GBMV2.
Oh, here we go.
FF.
Oh, amber. Okay, I think I'm using that
amber.
Oh, performance is good.
Oh, that sounds sweet. Okay, then this
force field sounds good enough. We can
use it.
This was 2009. They haven't made better
ones yet.
I don't know. I'm happy with it.
[Music]
Okay.
It's hard
the mini dom.
Oh no.
model objects not call on mini.parse.
Okay, cool.
Who's excited about our amber? There we
go. Beautiful.
Just in case.
Okay, these are the atom types. Oh, they
have masses. That's cool.
charges atom types so much.
All right. How do I use a mini DOM
document?
Get elements by tag name
document objects subscript children
child nodes. E
okay that's my force field child nodes.
Okay.
residues. So these are atom types.
Okay, they're residues.
Actually, can I just say get elements by
tag name resident?
Perfect.
Okay. So, the residues are the different
uh different sheds.
So, we're gonna
Okay. What do I do with the DOM element
value
residues? That's what they call amino
acids or something.
Okay.
Get on by tag name Adam.
Oh, okay. Good. We can get the atoms.
How do I get the name of the residue?
R equals
is it attributes name? Yes, it is
attributes name value. Perfect
ace.
All right, we do have to turn those
letters into those thingies
um for our in residues.
Okay, we're going to have to turn these
fastest letters into these.
But I think we can just
Okay,
we're going to have to turn these into
these. How do I do that? I mean, I could
type it in, but I do hate typing.
All right.
No, that one highlighted so much nicer
than that one.
Whatever.
All right. Wants to have fun deleting.
It's going to be faster than the other
choice.
That wasn't too bad.
All right. Who wants to see some magic?
Let me see if I can do this. lpsplit
on that.
And then we want to say LP equals dick
zip LP one quote quote two zero quote
quote two LP
LP is not defined. Oh there we go.
Got to love data processing bros.
Let's put that in the biolib. Um
uh
what are those things called?
We'll just call him
LTL for letter three letter
uh from Living LTL. Perfect.
All right.
So now
we should add this all to the library.
Actually,
let's call it uh
to not to amber. We'll keep writing it
in here for now. Okay.
So, we have the atoms. Um,
And we have our fastest sequence. All
right. So, who's ready to do this?
H for aa because it's an amino acid in
faster. We want to go LTL AA.
Uh we probably want to go upper on that.
So, let's just call it TL because it's a
threelet
print TL. Okay. Now, these should all be
in Adam's keys. Gonna have to be a
little careful because the last one
we're going to have to throw an ax on.
But I think this should be okay for now.
Put Adam's TL. Oh yeah, beautiful. Uh,
too bad they're all shitty DOM elements.
Let's take a look at a met for now.
Hate DOM elements, you know. Let's
figure out what we actually need from
this.
does not have child nodes.
Okay, what does an atom have? An atom
has a name and a type. Okay, actually
all we really need is the name. So we
can just say what is an attribute
subname
value
element has no attribute attribute. Oh
no, I did it before, didn't I?
Attribute. Oh yeah, there we go. Yeah,
that's what I'm talking about.
um get elements by tag name. So we
actually want to say X do
attributes name value for X. And
you know I may be terrible at bio, but
when you all see me do data parsing,
right? Yeah, that data parsing.
Lana's got a blue check mark. Oh yeah,
she's more famous than me. I'm going to
be on Ry soon, though, I think. Did my
Did my Riot invite go through yet? My
friend invited me to Rya. Oh,
but I've heard I'm going to hate Rya, so
there's that.
All right, so we got a lot of those
thingies.
What kind?
Who's new here?
Who's being disrespectful?
I'm Rya. Don't be disrespectful. This is
all about respect. This channel, we like
respect.
All right, let's take a look at the
villain. Not the Ubiq. No, no, no. Not
the Ubiku, though. Not that protein. All
right, let's take a look here.
All right, we're going to have to figure
out what all these little shits are.
Um, what's this little shit? What's that
little shit? I don't know. It's always a
What are they separated by? Are these
tabs?
No, they're just spaces.
That's weird. How do I know how many
spaces?
Maybe I can use Oh, here bio. PDB
PDB parser.
Can I write PDB files?
Dice roll.
This looks kind of more complicated.
biopdv might be exactly what you want
and then again it might not.
Why do they have a separate this
biopython thing is not very good.
Okay.
Atom records atom contains
describes the alpha n atom as the first
residue which is a proline residue
residue. Res re residue residue.
Oh, those are in angstroms. They're not
in nanometers. I know it's a residue.
I'm not an idiot. The next
three columns are the occupancy
temperature factor.
How do I get those?
What's a temperature factor? Well, the
occupancy is always one. That's easy.
Oh crap. We have to know what type the
atom is. Is that always the first? Looks
like it's always the first letter.
What's the temperature factor?
Wait, who's saying someone else is
acting like a douchebag? No. No, you're
banned.
You got a timeout. Be nice to people
here.
That apple's out. Let's get another
apple. Well, you know what? We're going
to make macaroni cheese
with yellow cheddar cheese. It does
refer to it as dinner. So, I'm not sure
if I'm allowed to eat it at 351, but
we're going to find out what the
consequences might be cuz we're going to
eat it at 31.
You're telling him about the vaccine?
All right. All right. No spreading
misinformation, Penguino.
Let's see you later.
the ATL.
Who thinks it works? We got to figure
out what the temperature factor is.
How do we know?
Oh, the uncertainty of this atom's
position due to temperature.
It doesn't matter then.
Okay, cool.
So now let's just write that PDB.
Let's put that in the library.
Uh right
faster. Die then.
Yeah, buddy.
All right.
Remember
to follow and subscribe, boys. Sandreel,
see this? These are the people I like in
my channel. We got to subscribe because
if we don't subscribe, why should I keep
doing this? I only do it for the money
cuz I'm a whore. That's right.
Um,
no, we do it for the learning
and we bring you guys because
occasionally some of you say intelligent
things.
You need the topology, bro. Bro, I
actually don't need the topology because
we're going to fold it with a folding.
Um, make sure to load the correct
topology file name.
Oh, that's fine. I don't care.
I understand why you thought you think I
need the pipe the topology, but what if
I do that one?
Wait a second.
How did this work before?
Remember when I stuck just the one amino
acid in and did something?
I don't know. Whatever. We'll get to
that crap later. Uh, let's for now just
try this.
This is kind of a messy file. We should
clean it up. List index out of range.
What's out of range?
The amount of spaces could actually
matter. Oh god.
Okay, fine. How many spaces is that?
Seven. Okay.
All right. Now, how many spaces for the
next one?
Oh, but what about when it's like that?
I don't know how to do that.
Four.
Three for that.
Three for that. Is that better?
Looks more like columns.
Misaligned residue name. Great.
do like minus 4S
misalign residue name
don't look misaligned to me.
Oh,
it wants another space there.
I'll fix that.
What?
Is it mad because of the HDs? Is that
what it's mad about? Like I have to like
put them stupidly like that. I don't
even know how to do that.
Okay. I do know how to do that. Never
mind. Fine. I'll do it. I'll do it. I'll
do it. I'll do it.
Uh
if
a blank a
is less than four
p a
set paste
pa= a= space plus a leave that as minus4
change that a to pa Hey
fix
is less than oh no
there a space in front of Does that not
work?
Oh, is it cuz I'm doing minus 4 or
somethingus.
[Music]
One indent doesn't matter the outer
indentation level.
There tabs in here.
Okay, that's still slightly wrong
because I think we do want the minus4.
[Music]
Yeah, minus4 is correct.
Okay, now my thingy looks stupid like
that, too.
Does it load now?
Misaligned residue name.
Who knows how to fold? All right, I'm
listening,
bro. This is why PDB sucks. Yeah, I
agree that PDB sucks.
All right. Well, I don't know. Let's
just compare my atoms to these atoms and
say exactly what's different. We'll just
make it match perfectly.
Oh my god, it's not what I wanted. I
know. I don't know why I can't control A
there.
That's frustrating.
Can I control E? Control E works. Just
not control A. It's like some Mac crap.
Okay. Oh, well, as you can see, mine is
aligned one off of theirs. So, if we
change that seven to a six
and then we try it again.
Oh, could not convert string to float.
Oh, look at that. Oh, we know. Okay.
Okay. We're learning. We're learning.
We're learning.
Okay. Um, well, that's good to know. So,
38.
Uh,
I think my water
Do I make research before I do this one?
All right, we're going to have to change
these. Let's just do it, right? What is
it? 5.3F.
Oh, sorry. It's 8.3F.
That might still be wrong because we
might want to just make them right up
against each other.
Uh, okay.
Well,
can add one to this
3D.
And I still want to add another space
here. I think
this is the worst file format ever. And
whoever did this should really be, you
know.
Um,
who did this and why?
Like like right here, this file format,
you're showing me that there's a lot of
room for, you know, someone to come in
who knows things about computers to come
disrupt this space.
Got to know things about computers,
though. All right. Um, got to get rid of
my spaces.
Okay, we're going to need another space
before that. We need another 1 point
two spaces. 1.00 O O and then a lot of
spaces and a straight.
Did I get my lot of spaces right?
Probably not.
Oh, my lot was their lot of way more
than my lot.
Oh yeah, look at that. Oh, what a good
quality format that was. Oh, perfect.
Okay, it loads. Let's see. Does that
even work? Oh yeah, look. But aside from
the fact that there's nothing there, it
works great. Um, but now I think my
model is going to complain when I try to
add hydrogens.
Z can't be raised to a negative power.
E,
is it not like zero?
Let's just do random
Um
actually be nice here too.
The Adams match fee. But all right,
we're going to need to shove an August
at the end of this.
Um,
wait.
Why are we only up to fee?
Is there another fee?
Has a feel all the way at the end. Okay,
cool. Like that has an oxed and mine
does not have an ox.
How'd they get more atoms than me?
I don't even know. I don't think their
atoms started at one.
No template found. Bonds are different.
Perhaps the chain is missing a terminal
group. That's true.
Uh, okay. We'll just say
plus
uh
I plus
uh nothing
if
I not equal to length
minus one else oxed
syntax.
Oh, how long did I cook my macaronis
for? Was it too long? Might have been
too long.
Oh no, I think they're just right.
Delicious.
Someone else is going to like go home
and time this and find that I cooked it
for like twice as long as I should or
half the time that I should.
Stir in a bit of butter until it melts.
Of course, we don't want any milk.
Macaroni goes back in the pot.
Cheese goes in.
We got macaroni and cheese.
A staple enjoyed by Americans for
hundreds of years.
Ever since crab first found a wedge of
cheese in his mom's cabin.
[Music]
That's edible.
All right, we do an ox on the end of
that. That's pretty good. For those guys
at home who are following, I'll show you
what a ox is
because I've been learning bio. This guy
here
or the one with the single bond is an
ox.
All right. Now that we've added an ox,
does it load? It loads.
Of course, we still can't look at it.
Um,
but this should just work if I do that.
Particle position is nan. Okay, it has a
few nan issues.
Um, oh, random.random actually isn't
what I want.
Uh, I want random.random minus Let's
just do a
[Music]
We still can't see anything, but that's
okay.
Sorry, this is a mess. Cool.
Okay, we got our protein back.
I don't know why it has so much
potential energy.
What are the four model types in
designing an R DV BMS? Well,
you got to have aimicity,
compliance, integrity, and data. Isn't
that what the asset model for databases
is? I don't know. I learned that once.
Okay,
so now
we have our step.
Let's delete some of this crap that we
don't need. Do not need that.
This belongs up here.
We do not need this.
Don't need that. And we don't need that.
Right unfolded is good. I'll commit
right unfolded once it works.
Um 10,000 steps. Let's go there.
Loads it up. Adds the hydrogens. Then we
can look at it. No, no. We don't want to
look at temp unfolded.
We want to look at temp output.
Also, where did I get faster from?
That's a little unfair, but whatever. Go
with it.
Okay.
I love doing science.
Oh yeah.
Okay.
Let's let it fold for a little bit and
see what we get.
No, don't say get stuck in local men's.
This is nature and if it gets stuck in
local men's, then so does nature.
All right, we'll put on a GPU in a
minute.
No, Bill, simple boy.
Um,
what's next? I don't know. That's for
the next stream. If this string we
manage to fold a villain, that's a great
victory.
Okay, it's doing something.
How I have GPU in a MacBook? Open CL.
Bro,
MacBooks have GPUs. I just don't have
Nvidia GPUs
because of Apple's beef with Nvidia. I
think that actually goes back to the
Jobs era. I think Steve Jobs got pissed
that like Nvidia did a bad job soldering
their GPUs or like the soldering
recommendation they gave Apple was wrong
and they were broken MacBooks and like
Nvidia didn't pay for it and Jobs was
like, "All right, we're never using
Nvidia again."
See, look, we can look at the Atoms,
too.
Yeah, I'll use Jupy Air boxes one of
these days.
You think I missed file naming? Why? Oh,
you're right. I did.
No, you're right. You're right. That's a
bug in my library. Good catch. See, this
is why we have streamers.
This is why we do it live
so you guys can all witness.
Little mistake.
I bummed open CL is going to get
depreciated. We'll see what actually
happens.
I'll believe it when I see it. I don't
know. In general, I think when Apple
depreciates things, it's usually good
for the industry.
Okay, so we worked out how much do we
have to do? Oh, we have to do so many
steps.
Um
also I I wrote this last night and this
is just fold.
So we'll do writing from scratch here.
You can just read this is already
committed.
[Music]
H.
Why did that work?
[Music]
Macaroli and cheese.
[Music]
No template found for residue group met.
I don't understand.
This is literally the same thing that I
was doing before, right?
What changed?
[Music]
Okay, which is actually giving me that
command
under force field create system. All
right. Do I have to add the hydrogens or
something? Try adding some hydrogens.
Seems better. All right. Cool. Oh, I
forgot some hydrogens. All right. Oh,
look at that going down.
[Music]
Um
No, wait. This isn't what I want to say.
How many outputs do I want? Say I want
100.
If I want 100, then we put steps divided
by 100 here. Yeah, that's right. And for
this one, we'll do something like this.
steps divided by we'll do 100 as well.
Should we write an arg parse so this can
actually
[Music]
let's face in Bill Gates. Yo, if anyone
has Bill Gates's number, we'll FaceTime
him.
I'm sold.
What's the water model being used? So, I
mean that is kind of a good question. I
think this is the water model, but I
didn't actually add solvent.
We could try to add solvent and see what
happens.
I think that's one of the options.
But last time it complained about being
charged.
I don't know what that is,
but all right. So, that was the folding
job we just did.
[Music]
[Music]
Can I do a thousand here? And does it
still work?
[Music]
26 Celsius. That's right.
27. That's 273 Kelvin to 0 Celsius.
Look at it fold. It's going down.
It didn't get faster. I just printed out
more stuff.
Okay, 1,00 works.
All right, who's ready to push this to a
GPU?
Um,
okay. So, this computer has a few GPUs
in it. It only has It has a Titan V. So,
that's a nice GPU, right? Titan V. Nice
GPU.
All right, we have big fold. Let's fold
with CUDA visible devices equals zero.
Let's see how fast that is. Is it
faster?
Oh, it's so fast now. Cudas.
[Music]
All right.
Let's go.
Oh,
that's probably a little too
All right, let's first try.
Let's bolt.
[Music]
All right. So, it's going to fold for a
thousand of those steps.
Well, that's going to take a long time.
Can I look at the output in the
meantime? Probably.
Wow, it's really going all over the
place.
[Music]
My protein is folding.
big cudas.
[Music]
Now, this is just my desktop at work.
This isn't a cluster yet. I don't know
how well Open MM works with multiple
GPUs, but
we can try Gromax as well. Gromax is
another option.
Let's see if we can find this stuff
versus open speed.
Chromeax open mm.
What?
Oh,
what kind of old ass GPUs are these?
Gromax CPU versus GPU.
No, don't use NAND whatever you do.
Does anybody use OpenMs or is it just
too slow?
We're folding. Let's see. Did it fold
yet?
[Music]
Yeah. No more. No false information. We
don't spread false information around
here. People are getting banned left and
right on the internet for spreading
false information, you know. Oh,
fun fact,
remember how I denied all um like of the
conspiracy theories? I mean, I
definitely deny the conspiracy theories
that it's like some boweapon attack, but
um this is real. So, yeah.
Corona may have 200 million atoms. I
don't think it has 200 million atoms.
Corona has 30k base pairs. So like 10k
amino acids and then like every amino
acid has on average like I don't know 10
atoms. So it's like 100,000 atoms.
Those
are lower numbers.
Seems like it's doing something maybe.
Look, it's like trying to fold, guys. It
wants to fold. It's like I'm a protein
and I want to fold.
If this is a problem with my solvent or
my force field, I'm never going to fix
it.
I don't know.
20 to 30 atoms for protein. That's
probably more right.
It's not for protein. It's for amino
acid. Oh, we can count it. I think
that's all right.
We just
the whole virus is like 10,000 amino
acids. So it's like 200. So you're off
by a factor of a thousand there.
Let's see what theirs looked like.
Six micro seconds. Wow,
that's so many microsconds.
Yeah, look, it flops around and does
nothing in theirs as well for a while.
Yeah. Look at it flop around. Do nothing
for a while, then it gets better. Oh
man, if we see some coils appear. Oh,
how exciting will that be?
Is that actually using my whole GPU or
is that using like a tiny amount of it?
Okay, it's using my whole GPU 99%.
That's pretty good.
I mean, it's only using 59 watts, which
I don't exactly understand.
I also have computers with eight GPUs. I
don't know if that's better. Oh, look,
look, look, look. It's going down the
energy landscape. Oh, that's cool.
Oh, up. It's stuck in that local minima.
Whoa.
Well, that's a cool video.
That's where my protein is right now,
just wiggling out there. But then I
think once I ran it on the thing, it
didn't show that it had less potential
energy.
I don't know
to the bottom of this panel and you'll
notice the extremely hydrophilic
aminoes, arginine, glutamate, Our
goal is to understand how a simple
linear polymer produced by encoded by
genetic design information can fold up
sequence into sophisticated catalyst or
machine or some other device that the
vehicle needs in order to execute. So
once we give us a base this is a
slightly complicated table you might
want to pause and look at look at it at
your pleasure. This is what's called a
hydrome plot of the side chain and we
can measure their hydrome.
I don't care.
Yeah. Yeah. Yeah. Yeah. Yeah.
My simulator knows this so I don't have
to.
So what's happening?
Look, the numbers are going down though.
These numbers are way lower than they
used to be.
Okay. Stupidly wiggle around for a
while.
Oh. Oh, look. That was almost a That was
almost a helix thingy.
No, that's a lie. It wasn't almost a
helix thingy. Come on.
Fold.
This game sucks.
Okay, let's
do that crap anymore
or that
DD to delete it.
Oh, I have to like click outside it.
Yeah. Like I don't get it. So this is
the folded protein. How does the folded
protein have like the same potential
energy as mine?
Mine actually has lower potential
energy.
If it is folded though, it does pretty
much seem to stay folded. Well,
actually, I don't know. Doesn't even
look like it's really staying folded.
Let's improve the code.
Okay.
Okay.
Smell of your body.
Thought you were candy.
My good man.
You can't leave me
[Music]
[Music]
as we sink into the east.
They go on.
Now we are the settlements.
Now we are the settlements.
Now we are the settlements.
Now we are
gossip
[Music]
[Music]
You devel. powerless.
[Music]
But now my name is all crazy
[Music]
insane. Now we are sentiment.
Now we are the
[Music]
Now we are the settlements.
Now we are the settlements.
Heat. Heat.
with 100.
I think
of an old lady.
[Music]
fucking
you were confused. After a very quick
pause, kiss my cheek and then walk off.
Now I start to age backwards
and I'm viciously hungry for someone to
love me the way my parents never did.
Walk somewhere
and he'll take a walk and see.
So big.
Looks like it stays folded pretty well.
[Music]
I finished.
Okay. So, that's off by a factor of 100.
And that took 16 minutes.
16 times 100 minutes.
Okay. It'll fold in a day. Sounds pretty
nice.
Is that enough?
Okay. Well, this is the one chance we
have to look at this protein not fold
itself despite massive amounts of
computes being poured into making it
fold.
Did this one unfold?
Wait, also did I write scratch?
I did not write scratch.
just want to unfold.
No. Seems like once it's folded, it's
pretty stable.
It's a little wiggly there, but
now it looks the same.
I do wonder what happens if I up the
temperature.
Wait a second.
[Music]
Do I need to make it warmer?
They used amber and they used a
generalized born salvation model.
How did they do it in 200 nconds? That's
so fast.
holding free energy at 300 Kelvin.
H.
Can I use Bourne?
Born. What am I looking at? OpenM.
OpenM supports all the generalized born
models used by AMR.
FFO3
number 03
parameters for water molecules.
Creating a system for a primtop file.
What's a primtop file?
Oh, I turned off my nonbonded
interactions.
I don't know if that matters.
How's this protein doing in the not
unfolding department?
It does not unfold.
I couldn't spell scratch.
All right.
Who knows why my protein don't fold?
Should we try to fold a corona protein?
We had that corona protein, didn't we?
The membrane protein I was looking at.
That's the one I wanted to fold last
time.
These are too long.
Which is the shortest? Corona
untransated
envelope protein.
That was pretty short.
There's another way to write that.
All right, let's try a corona vir. Well,
first let's see quickly if my thingy
wiggles around enough. Maybe it didn't
fold, I'm sure.
Yeah, wiggles around a lot. Okay.
Well, that's more atoms and stuff. So,
this is a coronavirus envelope protein.
Let's see if it falls.
Particle position is nan. Oh,
it's not good.
Try again.
Is there any way to mess with
temperature in a dynamic way?
I could
Particle position is nan. Well, that
sucks.
Um,
let's try not many steps. What if I do
one step?
division by zero
because writing every zero steps. Um
what I want to say max one right
your initial conditions fucking suck
bro.
Uh, well, yeah. I mean, that's How do
you want me to change them?
Unless you're saying you want me to
cheat, but you know, I'm not a cheater,
man.
Can't We can't already say how the
proteins folded. That's just cheating.
And any anyone can cheat.
All right. How's my big protein folding
going?
Start with a linear chain of amino
acids, bro. Uh, you didn't like that I
put them All right. All right. We can
make it more linear. Will that upset you
less? You don't like that I just shoved
everything randomly?
All right. We'll start with a linear
chain. To be fair, the other guys
started with a linear chain.
All right. Linear chain, bro. How many
angstroms apart are they
cracked? All right. All right. All
right. You want it neat. All right.
Should try folding the original.
Yeah, the original one works.
I mean, what? You just want me to set
the
All right. All right. We'll stretch
this. will stretch it out. Can I put it
in some solvent to get proteins to
stretch out automatically?
Can I do that?
All right. You all didn't like my random
placement of the atoms. Everyone's upset
about the random placement of the atoms.
You know, that was easy to do. Oh, no
wonder it's so cold in here.
I had a friend over. When you have two
people in this apartment, you got to
lower the temperature. But
solvent is fucking implicit, bro. All
right, I got you. I got you. I got you.
All right, we got to flatten it out.
It's like paper and origami. All right.
All right. All right. We're going to
flatten it out. All right. Good. I like
the direction we're going here. Guys are
doing some good thinking.
All right. Because Yeah, you're right.
This protein doesn't look like it wants
to fold. All right. Well, at least it's
true that the other guys definitely had
a flat uh protein, and I don't have a
flat protein. So that's definitely a
difference between me and them. And we
know that their thingy kind of worked,
so you know.
Oh, sad face. Okay, click here. DD. Oh,
that was nice. I liked your shortcut
key, bro. I like shortcut key, bro.
Okay. Well, now there's nothing here
because
everything's terrible.
All right. Let's just fine. Let's just
start with an M. No, actually I can't
just have an M. But I need an M plus
something else. Cuz if I just have an M,
it's going to give me crap about how you
can't put the ox on the last thingy or
else it's angry. All right, I'll try an
ML. That sounds nice.
Okay. Okay. All right.
I like that it showed up.
It's pretty nice.
Stick a lot of L's in there.
Oh, now it's broken.
It's good while it lasted.
An MLS is good.
Yeah. All my items are just everywhere.
Okay. Okay. Okay. Okay. Okay.
You can escape DD. I can escape DD.
I guess I'm already Oh, escape DD. All
right. All right. I like this. All
right. All right.
No bonds. Well, yeah. I don't know.
I mean, I have my modeler just
minimizing the energy, but we should
really not do this. I mean, I'm just
using a cluster. I'm just like throwing
the atoms all in a ball because if we do
that, we're going to have to start
thinking. And who wants to do that? Oh
my god. Okay, I know what the bonds are.
Actually,
if natural proteins fold from a straight
chain, then you shouldn't be able to
denature them because heating a dilute
solution.
All right. All right. All right. All
right. I have an idea. Let's make it
warm.
You know,
let's fold. But let's say the
temperature is 800°.
Is that going to make my protein flat?
Let's go.
Oh, look at how much energy it has.
Crazy amounts. Is that going to make it
flat?
Whoa.
It's like vibrating all over the place.
It's denaturing. It's denaturing.
It's pretty warm.
Hey, we're going to go for more steps on
that
one million steps.
All right. And here we need to fix it.
So I don't do this. But then I need to
like think about where I'm putting the
atoms and stuff and that's hard.
Bonds are defined by the force field by
atom distance, bro. All right, let's go
look at the force field. We have a force
field. I know what that is. Now, let's
look at the data.
All right.
The mass
Oh, we can figure out. Why do they have
stupid names? Oh, the atom tells me its
type. Let's look at Matt
the type. And then they tell me the
bond. So that's a type 576 hydrogen. I
see
that's a nitrogen.
Oh, it's a nitrogen, too.
Just a typo.
Okay.
Oh, look. It tells me the bond and we
know the length. Okay. Okay. I get what
we're doing here.
If we know the bond, but then I have to
parse more shitty XML
K2. What's a proper
periodic torsion forces?
Let's see how my denaturing protein's
going.
Oh, this is killing my battery.
Hey guys, you know what's easier than
folding proteins? Unfolding proteins.
This is what happens when you boil a
protein.
Actually, we could have picked a
realistic boiling temperature and not
800° Kelvin, which is a little
unrealistic.
Boiling in Kelvin. Actually, isn't it
just 373?
I can't spell boiling. Boiling.
Yeah. 373. All right, let's try a more
reasonable temperature of 373.
And see if it still boils.
Let that fold. Oh, this one. Oh, look at
how many steps it's done. Wow, so many
steps. You think it folded yet? Who
thinks it folded?
Who thinks my initial conditions are too
shady for it to fold?
Did it fall yet?
I must report that the protein did not
fold.
Did this one unfold at the much more
reasonable temperature of boiling?
Doesn't unfold that much at boiling.
Okay guys, Alphafold is stupid.
Alphafold is not a good way to solve
this problem. I know about Alphafold.
I've read the paper. The problem with
Alphafold is twofold. One, it's
supervised learning. They're just
learning to predict the sequences based
on the existing structure of proteins,
which is all well and good if all you're
trying to do is get a slightly new
protein. But the truth is any protein we
can get the structure of, we can already
study with X-ray crystalallography. So,
it's not that useful. Problem number two
with AlphaFold is it still isn't that
good. While it does better than the
other things at that competition, the
other things at that competition are
written by noobs and they're basically
just database searches and copy pasting
machines.
Do a tier of these fold solutions.
Molecular dynamics folding everything
else.
This is top tier. This is like being
Pikachu in Smash Brothers 64. This is
like being being being Marth in Smash
Brothers Melee. This is like being the
ice climbers never cuz they suck.
We need good insolution models.
Crystalallography is a solid state
distortion. Yeah, we need good
insolution models. I agree. Which is
Like this is in solution apparently.
Apparently this solvent is fucking
implicit, bro. That's what I heard.
Okay, we're boiling my protein.
It's kind of boiling.
It's not turning into a straight line, I
must say, though.
Okay. But we can't just place the atoms
randomly. I understand.
Are you using conjugate gradient? I
don't know. You can read my code. I'm
using the leg the the lang interpreter.
Is a langiven interpreter a good one? I
also got rid of my nonbonded method
because it was complaining yesterday.
Langde what what about methion
was saying that one right.
Um,
wait. What if I just don't do that?
Particle positions have not been set.
Okay, we have to set the particle
positions. Hey, are you guys telling me
that I actually have to write the code
to interpret the force field
and like what's a sigma
sigma and epsilon? Come on.
No, I'm not using conjugate gradient
minimization. I'm not trying to minimize
the energy. I'm trying to simulate the
dynamics so the protein will fold like
it does in nature.
I don't want to use convex optimization.
Oh no.
No. I have to like know angles and
stuff.
Wait, how do I know what bond class it
is?
Oh, I guess that's just like the name of
the atom. So like I have a C to a
like angles right and stuff. There has
to be code that already does this
already.
Try folding at absolute zero
temperatures. I know exactly what it's
going to do with absolute zero. I did
study that in physics.
Who wants to try the absolute zero
experiment?
Can't believe we actually did this
experiment. Oh, look. It doesn't move at
all. Well, that's a cold protein. Look
at that cold. Wait, it's moving. Why is
it moving? Doesn't this protein know
about absolute zero?
Oh, it's not really absolute zero. What
a good molecular dynamic simulator. You
see, you can't actually make stuff
shimmering.
No, you guys, you can't actually make
stuff go to absolute zero. Everyone
knows this cuz if you had something that
was actually absolute zero, uh, the
quantums would be upset because then
you'd know where it is. So, I don't know
if the simulator actually takes into
account quantum effect.
Katron N95, thank you for gifting subs
to people. I appreciate it. Um, have you
tried denaturing by changing the pH
level? I don't know how to change the pH
level. I only know how to change the
temperature cuz I found that cuz I put
that in my longevian integrator. I'm
sorry. I'm sorry. I don't know anything.
And then I'm a bioscript kitty.
But that's just what I am. One day I
won't be a bioscript kitty anymore,
though.
One day I'll know bio.
One day I won't pronounce it. Methion.
All right, let's see the default yet.
I don't understand. Do you really think
that my initial condition is the
problem? Like I don't think if I stretch
it out, it's really going to make a
difference.
To be fair, I agree with you that it
comes out in nature mostly stretched
out.
Just use amber tea leap, bro. What's
amber tea leap?
Oh, amber tip. Let's try amber tip.
Delete program.
Different files used in Amber.
Oh,
you can add hydrogen atoms to the
protein system using the H++ web server.
Smaller
step size and more compute. No, please.
Anything but that.
My poor GPU is screaming already
meth
me m me m me m me m me m me m me m me m
me m me mioni
check it out lamps MD No I I'm fine with
open MM
All I want is something that's going to
straighten out my protein.
I'm really not sure if it matters.
Like it seems like it wiggles around
enough that I don't think it matters.
pull at both ends. I mean, yes, I want
to pull at both ends. Can I do that?
Wait, can I do that with the Okay, I
have an idea.
I I know. I don't Don't I know the
protein's mocking me. Wait, I have an
idea about how to actually pull at both
ends.
straightened out as an unrealistically
high energy starting place.
We added heat to denature the protein.
Yeah, it all looks like a bunch of tools
cobbled together. Yeah.
To change the pH level, you just need to
just simulate it folding as it exits the
ribosome. Yeah, that's my dream, bro.
That's my dream. All right. Wants to see
what happens when I put the temperature
to 10,000. Is that what we want?
I don't think the force field was
designed for this. Oh, yeah. Well,
that's what happens.
I mean, we could probably straighten out
if we use like a sufficiently strong
electrical force on the ends, you know.
Okay, this is at 1,00 Kelvin.
I mean, it definitely denatures.
Whoa. Straightens out pretty well.
Those things are still near each other.
We're trying to simulate an atom by
atom. How is the protein alive, guys? We
are the simulation right now.
Add that to the solvent. I don't know
how to add things like that.
Let's look at what it is.
[Music]
What does denaturing protein mean?
It just means to unfold.
It does look
denatured protein.
I see it looks pretty denatured to me.
Wait, you think if I let it go now and I
put it back, it'll refold?
Like what if I change the temperature
now that this is done?
We might have to edit out a bunch of the
I think we're going to have
You're just going to reach
Looks somewhat hopeful.
Should we just pour more compute at it
and see what happens?
All
right, we're done with that. It's never
going to fold, right?
I mean, let's just look and make sure it
didn't actually fault, but
Okay, our longest compute yet
did not fold the protein.
All right, so we loaded up the denatured
protein. We're gonna see if it reaches.
Now
we're pouring a lot of compute into it.
Wait, does that work in real life?
I don't know if that works in real life.
Do denatured
proteins
stay
denatured
radiation heat. Okay, we added heat
protein denaturation also.
We can look in the papers and see how
they laid out their stuff initially.
Oh, in many cases denaturization is
reversible.
Oh, if it gets stuck at a local minimum.
Wow, it really can that can happen.
I mean, if this can't refold my protein,
I don't I really don't think it's a
starting condition problem, you know?
the misfold back up into a fucked up
structure. Yeah, I know. If you boil an
egg, I know this.
You're not sure if the thousandk one is
reversible.
I don't know how to make them straight
very easily.
Sounds really hard. Let's see what the
papers have to say.
social interactions.
Three strand beta sheet peptide.
325 residues with a unique 3DX
architecture
all atom ones using both
si and remdi.
Oh, they used amber FF3.
Oh,
this is exciting. Should we try Amber
FF3? Who thinks that one works better?
Looks kind of like it wants to fold
back, I think. Look at that. It's
folding back.
Yeah, maybe not.
Why are you guys talking about Vim?
Let's try a different force field.
Let's try from or should we try from the
DNH? Like I really like Scratch because
it moves all over the place.
H
this force field seems more plausible
too
like because okay look the denatured one
got negative
got negative that
oh this is getting similar. Okay, I
guess it's just a different
Wow, the denatured one actually has
lower energy.
Okay, maybe it doesn't reenature. Maybe
I destroyed it.
Maybe my thousand Kelvin was too much
for it.
Let's do my citation.
What?
Bro,
protein does not fold by itself.
I don't know how to do born.
I definitely don't have a Baron's Den's
thermostat.
The time step was set to two phentocs.
That's the same.
The coordinates were saved every 10
picos seconds.
Is that the same?
How often am I saving them?
about the same.
So that's minus 50 seconds
the simulations.
Whoa.
It took 15 minutes and the total
computer time required
WTF.
Whoa,
that's fancy.
Let's see. Is it folding?
This I like this force field better.
Doesn't it look better?
Doesn't that look more like it's going
to fold?
It's like hooked on itself.
Fold.
All right. Look, I want it to be
stretched out as much as the next guy,
but I don't really know how to do that.
It just looks like it has less FPS.
Do we want more FPS? I can get us more
FPS.
Guess all the FPS you want.
All right. All right. Well, they that
was every 50. So, we're going to just do
right every
That's better. Now get more FPS.
Is this actually enough steps?
Five microsconds.
I'm not talking about Defcon, bro.
Hacking is dead.
I mean, hacking is alive, but like
organized hacking is dead. Kind of like
religion.
Oh, I didn't download it, but I up the
FPS just so you guys could see.
Beautiful. blah.
Now we have to download it since it's so
much more FPS. But oh no, is this going
to make me run out of space on my hard
drive?
Do we like the more FPS? Oh, it's
struggling. Oh, look at that. It looks
like it's just like wrapped up on itself
and struggling.
Look at it struggle. That does not look
like it's going to fold anytime soon.
Looks like it's crappily folded and
struggling.
Why do we only miss?
Why do we do anything, bro?
Oh, look at it. Struggle. Oh, it's like,
oh, I'm going to fold. But psych, not
really.
Wait, how much space is this going to
take up?
If we're saving every 10 picos seconds
and we're folding for five milliseconds,
it's going to be like gigabytes. Do I
have that many gigabytes?
Okay, fine. We'll put it somewhere. I
have lots of gigabytes.
I have 2.7 terabytes free on that hard
drive. So, you know,
oh, look, this one looks less wrapped up
on itself. Despite setting the random
seed the same, it seems like the random
is actually different. Oh, come on. That
that's that. Look how look how unfolded
that is. That's just begging to fold.
Okay. So, I think now we just have to
wait because we use the right force
field.
Um,
I don't know. Should we uh
maybe tomorrow we'll we'll watch the
video of a fully folded protein
after this thing finishes, which will be
done in 1.1 days according to my math.
I know it's begging to fold. It's going
to take five milliseconds. It said
HP35 is one of the most studied proteins
in the field of protein folding.
Nonetheless, controversy still exists
regarding the folding mechanism of this
protein.
If you have the folded structure, you
can use RSMD as a metric to see if
you're heading in the right direction.
Bro,
we could do that.
But that's cheating.
I mean, I don't know. Maybe we should do
that. Maybe that's what we'll do on Can
We Fold a Villain Protein part two
perhaps tomorrow.
Oh, this is a big file now.
We did the hype train today. You missed
that.
All right. Do we have Q&A tonight? I
don't know if we have Q&A for the can we
fold a protein. The answer is the answer
to the can we fold a villain protein is
we will find out tomorrow after this
computes for 1.1 days.
Oh, look look look look at that
deformationation. Oh, that's beautiful.
Do we need more cudas? Is that the
problem? I have more cudas.
Does more cudas make it fold faster?
Can I up the FPS?
I don't know what that does.
Oh, full screen.
I don't think my IO it's it's a 100meg
file. I I really don't think uh my my
MacBook Pro 16 in can't load.
Can I slow it down?
I don't think it's folding yet. I think
it's going to take a day. I think
folding proteins is really slow.
Protein bro be folding. I think maybe.
All right, let's uh
if if we have any good questions, we'll
do Q&A if there's good questions for
today. Otherwise, that's today's stream.
Thank you all for watching.
H,
bro, bro, it might fold. It's going to
take a while. I don't know how long it's
going to take to fold. These are the
things we don't know. But the things
that we do know is that it's going to
take a day if it does fold.
What if it hits? I mean, I don't know.
It's like writing a crypto brute forcer.
You don't know if you did it right,
except for the fact that there's
actually a lot we could do to know if we
did it right. But we'll do that tomorrow
if we have to.
Where did I learn the biochemistry?
Watch the last six streams I did. How
much money do I have in my bank account?
I have at least $3.
Look, it's getting like kind of tangled
on itself, I think.
Let's Let's uh as as a closing graphic
Oh my god. Let's add licorice.
Perfect.
Why do you have a bed in the kitchen?
Could I upload the Jupiter file? I'm not
uploading the Jupiter file. It's too
shitty to upload. Jupiter sucks to
upload. But I did do the uh I I up all
the folder is uploaded. And if you
really want the thing that views it,
it's just that.
See what other ad representations we can
get.
It's just NGL view.
Cartoon
licorice.
Hyper balls. I want hyper balls.
change name
contact.
That doesn't look that cool.
Hyper balls.
Where's the hyper balls?
distance dot. Oh, hyper ball.
That just looks like licorice.
It looks cooler than licorice because
it's hyper ball.
point representation.
Oh, ribbon is ribbon. Cool.
I think I already had ribbon
rocket
rope.
Huh?
surface.
Whoa,
that one takes a long time to render.
Helix orient
lame.
Nah, this one's the best one.
Let's fast forward to where we are in
the movie.
Hyper ball was kind of disappointing.
Crowdsource GPUs.
Well, see the thing about crowdsourcing
GPUs is I think we can just try to fold
more proteins. I'm not sure we could
fold this protein faster.
Can I do D
G
D G S E?
I don't know what those are.
I don't know. Most of economics is a
scam, especially macroeconomics.
Oh, well, so the business has the boom
and bust cycle and you just have to look
at the S-curves over the 50 years. It's
all bullshit.
They always Oh, they always have these
ideas about like the cycles of business
and stuff. I don't know. I just don't
like I don't believe in any of them.
Does it look more folded now than it did
before?
about the lunar cycle. I mean, I think
the lunar cycle is real.
Well, guys, you know, I just I just uh I
was looking at some uh charts and uh
graphs this morning and uh I'd like to
inform you guys that uh we're in a
recession. Uh, as you can see, the graph
went uh down. Uh, economists have been
predicting this. Economists have been
predicting this for for a long time now.
Yet, we knew we knew the recession was
coming. We just didn't know when. Uh,
but, you know, overall markets usually
go up. So, that's pretty good. Markets
are usually a good place to to have your
your your money. You see, sometime we
have recessions, but overall they look
very small. This was a big one. This was
a big a big bust. Uh yeah, but this one
is a new recession. We have a new
recession here, but soon it'll be a
green and the recession will be fixed.
Yeah, I didn't watch Mad Money this
morning. I think that's pretty much
exactly what they said.
Do I think the scammers know they're
bullshitting people or do they actually
believe it?
I don't know.
I think they don't really understand
what truth is.
So, no, I I don't think they actively
think that they're bullshitting people,
but I think that they have like a poor
understanding of truth.
And by the way, not all economics is
junk. There is like a lot of sensible
here. You want sensible economics? Um,
if you invest
in something that brings returns, your
money goes up. Like for example, if
you're a country and you invest in
infrastructure, great investment. If you
invest in long-term things, great
investment, right? Um like it's it's
there's economic truths, but they're
like simple supply and demand, right?
No, no, you got to buy low and sell
high. Get in early, buy the dip, you
know? No, but like economics and
psychology
Who watches CNBC?
What does this thing do? Oh, it loops
the animation. I get it.
Oh, this is really lagging now. Oh, look
at that lag.
2 FPS on that protein, bro.
No, I don't watch Trump's daily news
update. I heard it was an infomercial.
Oh, the current models of deaths. Yeah,
they're probably right.
Teams of
I I did the math at the end of it and I
got 160,000 which is like right in the
middle of their of their models.
Um I just I assumed that half of the
city of Wuhan had been infected and then
extrapolated from there and you get
160,000 deaths.
All right, we're going to watch this
video and then I think that's going to
be the end of the stream. What do I
think about Dr. Fouchy? Love him or hate
him? I don't have a strong opinion
either way.
I'm sure he's doing an acceptable
political job at whatever his position
is.
You know, that's how I feel about
politics in general. Do you love Trump
or hate Trump? I mean, I'm kind of
neutral.
You don't hear from all the neutral
people, you know, because all the people
who love somebody or hate somebody are
posting online, but a lot of people are
just kind of like neutral.
Um, is China passing USA is the world's
superpower? Pro? I don't know. What's
the GDP? Is the GDP real?
Yo, they should hook me up with uh
a sponsor link for the chair if that's
true. Doesn't look very folded to me.
Looks kind of unfolded.
No, I don't think there's going to be
riots.
I mean, if 10 people riot, the media
will tell us about how riots are
happening everywhere. And you know,
will we see a video of a riot in the
next month? Yes. Will there be
widespread riots that you'll be able to
see yourself? No.
If there was a riot, I'd participate.
I'm not scared of Corona virus.
I wouldn't be like, "Oh no, I might get
infected.
Why only Americans get free monies? I
don't know. Where are you from? You
didn't get any free money. Go ask your
government for free money.
By the way, it's not free money. The
government takes 40% of your money and
then gives you back 2%. Like honestly,
imagine someone comes up to you in the
hallway. He's like, "Bro, give me your
lunch money." And you give him 10 bucks.
And then he hands you a dollar back and
you're like, "Well, thanks for the
dollar." No, nobody ever said that.
In Russia, you don't get free money. No.
No. Email Putin. Say, "Hey, can I have
some free money, bro?"
Um, I don't
do I feel Bergen Countyies was a good
opportunity for me. the fuck.
Do I think this is just an opportunity?
No. What's the political saying? Never
waste a good crisis. Yeah. Whenever
there's a crisis, these fucks are always
thinking about how they're going to
profit.
Do I think children should go to school?
I don't think I'm going to cure aging.
I'm just trying to fold one pro to
Would I donate Comm AI 3D printer time
to print ventilator tubes? If I thought
I could actually be useful, I'd be
useful. Um, I don't think anything CO
AI's 3D printers print would actually be
very useful. I think the most useful
thing we can print is commatus.
Capitalism or socialism. What's the
difference?
It's all a spectrum, right? I'm not sure
what you mean by capitalism. Socialism
is capitalism.
I don't know why people think socialism
is not capitalism for some reason.
Oh, sweet. We have double more movie to
watch. I love torrenting this movie.
Yeah, I'm going to I started listening
to the portal.
I'm not a libertarian. Why do you think
I'm a libertarian?
He's libertarian. No, I'm not anything.
I have a wide variety of opinions on
many different things.
I agree with libertarians on some
things. I agree with conservatives on
other things. And I agree with
progressives on even some other things.
And I am an American. That is definitely
true.
No, I'm not a moderate. Said I'm a
moderate. I have some very extreme
positions like that. I'd like to abolish
intellectual property. I don't think any
of the the Aryans are talking about
that.
Should you give up on your PhD? I don't
know.
Yo. Yeah. Buy a sale chair, man.
I'm not debating anybody on IP. You
don't have to agree with me. It's just
like we're not going to win. The way
that you win the IP battle is not and
the way that you win any battle, right?
It's an Andrew Breitbart quote actually.
Uh politics is downstream of culture. Um
you don't win any of these battles in
the political arena. You win them in the
cultural arena.
Do I live on the fringe of society?
What you mean? In my in my high-rise
apartment building in San Diego with my
16-inch MacBook Pro, my iPhone 11 Pro
with three cameras,
you know, wearing wearing $200 hoodies.
Do I look like I live on the fringes of
society?
I don't know. Alex bought it for me. Yo,
remember Alex?
I live in Marty. I'm in the cloud, bro.
What a trailer.
Best country other than the US. Um, I
like
as far as countries I feel that I could
actually like live in and integrate
pretty well with the population. I like
the UK. I like the Netherlands.
Um, as far as countries where I could
live for a while. Uh, I like Japan. I
like Malaysia.
Yeah, those ones probably.
Uh, I'm an Australian citizen.
Uh, like Australia. I mean, I'm sure I
could live there. Uh,
probably New Zealand as well.
My only experience with Switzerland is
that it was really expensive.
Um, thanks for the bit, Sam. I'm on the
fringe, bro. I'm on the fringes of
society.
Uh,
yeah. I put the groceries away. I had a
girl come over, so I had to clean the
apartment. She'd judge me if I had
groceries out.
Yeah, the hoodies in Switzerland are
probably $400. It's probably true.
Will you do a podcast once every two
weeks? Oh, if you book guests for me,
I'm not doing that.
GG. Thank you for subscribing. Thank
you.
Whoa, we got a hype train going.
Do I ever use clout to get girls?
I don't think it works, bro.
I know.
Yo, level one hype train.
Want to talk about a girl coming over?
Is it always a new girl? No. No. Just
like a rotation.
Do I think corona deaths really matter?
Oh, there's an interesting thing about
how like CDC numbers show that deaths
are down by uh by 10,000.
Um
Oh, rotation sounds that's that's
you know what I mean? Everybody
Everybody does this these days.
Um, no. Like honestly, ever since you
could get girls on the internet, there's
plenty of girls on the internet now.
It's great. If I had to like go to bars
and meet girls, I think that'd be uh
that'd be hard. I don't know. Maybe not.
You just got to practice at it.
When do we think we'll reach the apex of
the curve? I don't know, like two weeks.
You can look. They're already flattening
out.
I don't pay for these girls. They're
friends of mine.
Uh,
where are their girls on the internet?
If there's an ad, probably not. You
know, there's a lot of girls Instagram.
Why do you think I cared about my
Instagram followers?
Um, but it would be nice to have a a
blue check mark, you know. Is that what
you mean by clout? No, I don't use
clout.
I mean, I'm saying like,
you know, you tell you tell girls like,
"Oh man, I was sued by Sony for hacking
the PlayStation." That doesn't really
work that well.
Thank you for subscribing.
I don't know if it's going to fold,
bros. I think it's going to take a day.
Staff in the chat. Who's staff?
I always think they're coming for me.
Staff. Oh, like the infection.
The best. Pickup line. Are pickup lines
even real?
It's the feds of Twitch. I'm always
watching out for the feds. What if it
fails to fold? Then my three hours of
time will be in vain and I'll feel like
a failure. Give me 300 bits. Thank you.
Hide the mediocrity, boys. Staff is
here. I like that. I like that. Uh, yo,
can we get the hype train? Can we keep
it going? We got two minutes. We're at
39%. We'll keep the stream going as long
as the hype train keeps going.
Do I know Jude Gumla? No.
Alex. Alex is a good friend of mine. We
really like Alex. She bought me this
hoodie.
Brian Cantrail.
No, I feel like I have heard that name
before.
Favorite video game, Smash Bros. 64.
What have I regretted most in the past
five years?
I mean, I for a while I said starting a
company. Uh, I would really advise
everybody not to start a company. I want
to go on speaking tours and be like an
anti-motivational speaker.
Um,
but I don't know. I'm not really sure
what else I would have done.
But maybe I just say this now because
it's profitable. When it wasn't
profitable, I really regret doing it.
Staff is here to subscribe. Sweet. Uh,
why would I advise against it
if
There's a lot of downside with not that
much upside. Um, everything's kind of
your fault and you have to deal with
everything.
Uh, and it's it's just it's a
responsibility and a burden. You know,
that's the the beauty of being a startup
employee versus uh be versus starting
the company is when you're a startup
employee, you know, you can quit
um
and the company will continue on.
It's harder.
Well, yeah, the potential payoff is
tremendous, but
sweet. Uh
yeah, it's like owning a home. Yeah. And
I wouldn't really want home ownership. I
don't want to have uh children.
So yeah, I really um
if you have another option, don't start
a company.
So yeah, I would say that's
I don't know. I don't know. Say like
what's my biggest regret? I don't know
if I really regret it. Like, I did what
I did and that's like my life, right?
Um, maybe it's Stockholm syndrome.
Oh, I'm glad you liked Prime Intellect.
Oh, you wouldn't choose the end. Well,
think about the end a bit more.
I interpret the end I interpret the end
when I first read it. I took the end
very literally and then I thought about
it as I got older and I realized what
the end really was.
All right, the questions are getting
worse.
Is hacking profitable?
Prime Intellect wouldn't allow that
ending to be real. That's kind of what I
think. But
I've watched VR porn. Yeah, I wasn't
that impressed.
Have I met Emit Shear?
Who's Emit Shear?
Oh, see your Twitch. Yeah.
Have I started VR porn? No. No, I can't
say I have.
That That's And look up Jude Gila.
What will be the benefit for channel
subscribers when I take over the world?
Jagger RSW. How long you been a
subscriber? Do you want Kazakhstan? Do
you want to rule Kazakhstan? I'll give
you Kazakhstan.
I know who this is.
I'm just imagine like Ro Pharmaceuticals
trying to interact with the Ethereum
blockchain.
Um, everyone's really hyped on this
Ethereum 2.0.
I don't know.
Are they still trying to do proof of
stake? I think proof of stake is pretty
dumb.
This looks mad complex.
But no, Vitalic is also a genius. So
sharding stuff makes sense.
Oh, it's all just about charting. Yeah,
that probably pretty good.
No, if if you could get Ethereum if you
could build an Ethereum computer that
that that scales better that gives you
like a thousandx the compute, I think
there could be a lot of of use cases.
By thousandx more computer, I also mean
like a,000x cheaper, 1,000x faster.
You're really shilling for Cardano,
10x less decentralized. Oh yeah, you got
to make trade-offs, right? Engineering
is all about tradeoffs. Maybe Ethereum
is a little too decentralized already.
Proof of stake is finished. No, proof of
stake doesn't work.
Every proof ofstake thing I've ever seen
turns into like more and more complexity
being tacked on to fix problems. And
then they think that they've fixed all
the problems, but like
there's more because there's so much
complexity, but just nobody can find
them anymore.
Um,
Dow broke Ethereum. I don't think the
Dow broke Ethereum. I mean, I wouldn't
have hard for it, but that's just me.
All right. All right. Good stream.
That's the stream. That's the questions.
Tomorrow, we're going to find out if the
protein folds. Thank you all for
joining. Thank you for being on this
stream with me. I really appreciate you
all except I appreciate the subscribers
more. So, if you're not a subscriber,
make sure to hit that subscribe button.
If you don't follow with the
notifications, make sure to the
notification button wherever it is on
your computer. If it's over here, if
it's over here, I'm shilling for for
growth. Tomorrow we find out does the
protein fold. Everybody in your prayers,
if you'd like to after you get through
all the things that you usually pray for
like love and peace and the end of
Corona virus, maybe at the end, you pray
the protein folds a little bit too. I
like that. That sounds nice. Um,
shielding voices life.
It's my mockery of YouTubers. Honestly,
I don't really care. I don't really care
if you subscribe or you click the
notification button. I do these streams
mostly because it's just people to hang
out with and talk to and like I get some
I get a link to some good stuff.
Um, what time tomorrow?
I don't know yet. Figured it out.
Uh, good night everybody. If I made
mistakes, please file issues on Corona.
Thank you. Byebye.
morning everybody good morning
we're starting with a brand new file
today gem.hi all those birds are loud as
fuck
oh
good morning
good morning good morning good morning
i just woke up i figured i'd come right
here and stream for you guys that's how
dedicated i am
i told you last night on instagram
what this stream was going to be about
uh let me pop out chat here
no we speak english on this channel bro
real american yeah
yeah
yeah first team
uh all right
so uh we see we have another computer
here called quiet
i've been in quiet i just ran cl info
we have a
amd radeon xt blah blah blah blah blah
blah blah so
amd graphics cards
flops
um
should we actually we actually are we on
i think where is this aged anywhere
we'll start on my mac and then we'll
move over to quiet
it's not going to matter it's not going
to matter too much
um at the beginning yeah you know what
no no we'll do it right on we'll do it
right on quiet guys
uh i wouldn't i wouldn't uh you know let
you down like that
i said we're gonna deliver
oh wow i gotta wake up i gotta i gotta
way out boys
let's go let's go let's go okay i gotta
uh
i was gonna make a joke about waiting
for the adderall to kick in
but uh you guys would take me seriously
i think that i actually took adderall so
no you guys can't have that joke sorry
all right let's go over here and quiet
here
good morning good morning good morning
all right we're going to create a new
file called gem
start it with a nice user bin of python
3. yeah we're gonna be making the text
big today because today is a new lesson
for noobs we're gonna teach noobs
something if you're a noob today is your
day but if you're a non-sub
i'm sorry you don't get to talk
because you know
look man discrimination is okay
as long as you discriminate
on the right things
now here's the thing about being a
subscriber
anybody can be a subscriber if you just
click the subscribe button
um you're like oh well i'm poor and i
have circumstance and that's too bad bro
like we gotta draw a line somewhere as a
society we gotta just all agree that's
the social contract
wow now you're a subscriber
congratulations
congratulations
um
all right let's have some more coffee
and let's get started
all right does everyone know how to
multiply a matrix
let's import numpy as np and i'll show
you guys how to multiply matrix
[Music]
so um
let's make two big matrices
a and b
um
actually let's make a variable called n
so they won't actually be big
[Music]
okay and then the way that you multiply
a matrix you use this thing called the
uh
it's called the add operator
uh
and then you just you know print out
your multiply matrix now how big should
c be if i multiply an n by n matrix
right
there we go c is 16 by 16.
so uh that's great that multiplied
pretty fast
um
let's let me let me check on my my audio
settings we're trying to deliver quality
content to you guys
uh my webcam looks a little faded yeah
wow
i could have a little more dynamic range
on that okay well first off i'm going to
make me a little tinier
good good good
all right audio is good yeah we're
really trying to deliver a quality
stream experience for the noobs today
yeah
i'll listen to you because you're a
subscriber um
all right cool
all right so everyone knows how to
multiply what i call this stream can you
multiply a matrix new blessing okay
we're done right
we're done we did it we multiplied the
matrix no we did it
because now we're going to make the
matrix big
and you're going to see the problem
oh man that took forever
that was so slow what if i make it even
bigger
cpus are just too fast these days
wow wow that's so slow look i'm just
sitting here all right
so
uh oh actually let's do something that's
uh
numpy unfortunately sets the default
data type
to be uh float uh 64.
random got an unexpected keyword
argument d type boom
boom
all right uh now that's a little bit too
slow let's let's pick a good speed 496.
so
yeah yeah yeah we can as type we can as
type okay we just as type okay the
problem with as type is look now we're
allocating that i just see the memory i
just see the memory and it pains me
okay i'm kicking the table i know that
makes a terrible noise on the video so
i'm going to try to not do that
i'm going to try to be a
less
okay
ah i'm gonna rest my hands nicely uh
we're good
so
how many oh j blow good morning good
morning this is a great noob lesson for
people
this is a great new blessing because
this is actually one of the questions we
ask in the comma interview
how much compute
does matrix multiplication take
so how big is this matrix this matrix is
n squared in memory
and then this output matrix is n squared
in memory
but for each
cell in the output matrix
you're multiplying two vectors together
does everyone remember how to multiply
matrices if you don't remember how to
multiply matrices
all right i understand some new people
showed up so you know what i'm not even
going to make fun of you because you
know what not everybody went to high
school some people
some people were underprivileged and
they only went to
the madrasa yeah yeah so uh
this is for you uh
that's a terrible
i'm sure like three blue one brown has
like a
okay that's kind of good all right does
everyone understand you have to do a
vector product between the two things to
get the cell in the output matrix
does everyone know how to multiply
matrices
so
n squared output cells with
n
uh compute each
and it's not actually n um if you look
you have to multiply okay so the way
that like these two become this one is
you multiply this one times this one but
then you also have to add it to this one
times this one so you actually have to
do 2n compute you have to do both the
multiply and the add
and you say it's a fuse multiply
accumulate blah blah blah blah blah but
regardless so this is doing
three
n times n times 2n computes
ah you can't write 2n because this is
not algebra
wow that's a huge number
um so
those by the way are flops you know how
everybody always talks about flops
that's what a flop is
uh it's a floating point operation
so let's use my newfound f strings i
love f strings
i'm gonna put the f outside the string i
can't put the f in the string all right
uh and let's divide that by one e nine
and let's say that's a g flop
no we gotta we gotta put uh let's put a
i don't i don't like all those
significant figures they're just
upsetting to me
okay
so
um
let's say flops equals this
oh wow this is a really new blessing for
noobs
uh they're actually not flops because
they're not floating point operation per
second so that's a flop and now we have
to get second
so we'll start here with start time
equals time dot monotonic always use
monotonic
um
because if you don't use monotonic the
time can change have you heard about
daylight savings
i heard the supreme court's going to
make daylight savings illegal but until
they do
so we can say s equals
e t minus st
you guys just know that and then well no
it'll be nice because we can write flop
divided by s
right and then does everyone know what
flop divided by s is
that's flops
and that number is going to be really
big oh
got to close my bracket
why am i sorry i'm still waking up
and i don't have any folgers but i do
have stump down
to ex wow wow that's a crazy amount of
flops
um
in order to get we'll throw some
g's all right does everyone
wow well i'm being too nice to you guys
with the with the noob lessons today
uh does everyone understand what the g
means in g flops
does everyone understand
giga
right
mega is 10 to the third do you know what
10 to the third means does anyone here
not know what 10 to the third means
yeah like giga chad yeah yeah yeah
all right all right
wow wow look at how nice i'm being in
the noobs today i'm even going to show
you what si prefixes are
all right like i'm just like people
don't know this kind of shit man you
know not everybody went to school
some people
i don't know
what are they always saying
they're always saying like
girls in poor countries don't go to
school or something
well i don't think anyone here is a girl
but in case you are
uh and you lived in a poor country and
didn't go to school
no no you're all you're all you're all
young men who didn't pay attention in
high school
bro school sets you up for success later
in life
um
all right
giga mega tara peda x zeta and yada all
right and now one if you don't
understand what this notation means
bro like i don't know
go go read a seventh grade algebra book
um
cellophane if that were actually true
it means the number of zeros
wait
wait are you
oh i don't know matt mulver's dot
product nobody knows the difference
between those things um
yeah i think one of them is just like a
matrix vector multiply but we can we can
go there uh i'm 12 and what is this it's
called s i notation and you should learn
it
all right
the lessons are going to get less noob
after this so if you're like george this
is too noob for me don't worry it's
going to get harder
um no one's going to watch this one but
if i put hacking in the video title you
guys would be like oh
good learn hacking
these aren't in freedom units well let
me tell you america is a declining uh
empire and
you'll better learn chinese
no no i learned spanish in school that's
right
i'll add on the blockchain no no then
the worst kind of people would watch at
least the kind of people who want to
learn hacking are kind of cool the
people who are on the blockchain are
like
um
does russia use metric
bro
yeah i would imagine
but okay all right this is si prefixes
are universal look at the international
system of units that's right the un
probably approves these
uh okay
so uh yeah all right and now and we're
back so let's actually just make this t
flops and then we all should remember
that t was 10 to the 12 because
everybody read that wikipedia page thank
you all right good
so uh uh how do i i i hate all these
significant figures
uh and we'll put the slash i think
that's actually the right way to stylize
t flops let me see if that's right
are teraflops
okay so wow
my cpu with numpy is getting one
teraflop
that's pretty good
do i even need anything faster is that
using all my cores
[Music]
hmm all right well it's using all my
course
to deliver that crazy teraflop of
performance
i didn't do that wrong did i
so i'll show you what cpu i have it's a
ryzen
no it's 16 cores okay i forgot that wow
that's a 16 core processor
why am i buying fancy i should just get
everybody at work ryzens
i'm just going to buy everybody at work
one of these
no i bought myself a threadripper
um
i bought myself uh
this one
so this is even faster than horizon
where is the ryzen
that's pretty good this one isn't that
much faster i bought myself this one for
work
wow look at that price difference it's
insane
that's 32 course so it's double the
course yeah i guess i didn't want
downgrades for anybody
um you said you're not poor well you
just subscribed that proves you're not
poor everybody else
i have some questions about you
we're gonna have to go get more coffee
in a minute we're waking up the best
part of waking up is coffee
[Music]
wow so our cpu already gets a teraflop
so are we done
no we're not done because
we have a brand new
[Music]
radeon rx 6900
xt that's supposed to get us even more
flops
let's just actually look to see what the
theoretical
scoring g flops
oh all right wait so this is actually
doing an s gem
what does the s stand for in s gem
single precision general matrix multiply
so that's actually exactly what we're
doing
uh what if we do a d jam let's just see
how much slower it is
wow we got a hype train go good morning
everybody good morning
this is a djm
no d-gems are about half as fast alright
cool
but we're going to go back to an s-chip
now you say george why would you need to
go faster you're already getting one
teraflop and the answer is because one
teraflop is pathetic
a human brain is like 20 petaflops man
that would take 20 000 cpus
that would cost uh a lot of money i
don't know what madness is what's
madness is this like a thing
is this like somebody who already wrote
like a nice tuned kernel
no
wait
what multiplying matrices without
multiplying
we introduced a learning based algorithm
what kind of a scam is this
i was not planning to implement any of
this
i appreciate this is why i stream you
taught me something
oh my god you could have given me a real
link bro
10x faster
compressing
approximate
requires zero multiply ads
what
wow
i thought this was a noob lesson this
shit looks man complicated let's get
more coffee and then sorry i have
something much simpler plan for today
uh now we're doing something um
it's half as fast because it uses the
same cmd registers let's try to figure
out what's the theoretical gigaflops
of this ryzen
that's these are benchmarks
let's see if anyone knows
i'm trying to figure out how close we're
getting to the theoretical
[Music]
so if we have 16 cores
one of these things have avx2
should we start with a cpu
amd product page is usually less than
theoretical flops for this one maybe not
what junk product page is this
avx-2 but not it does not have avx-512
maybe x512 is stupid
um
well okay
should we
before we go to the gpu
let's try
rewriting this let's see if we can
achieve the same performance in c
[Music]
uh
you know i already ignored it hey not
out who likes adot app
um
what
segmentation fault
what did i even do
it doesn't fit that on the stack all
right fine no stack for you we'll put it
on the heat that's not the heat that's
in the bsf we'll put in the bss
variably modified a at file scope
wait what
what the hell
bro i thought i knew c
what kind of error is this
you cannot have a static array which
size is given at a variable all right
fine
define
n496 is that is that better
no
we're gonna use const expert is that
right
[Music]
oh there we go all right good well that
was so stupid so we're gonna go back to
uh define
constant expert sucks
because then we have to wait forever for
a c plus plus
const is not really const yeah yeah yeah
right static who knows what static means
okay
um
let's replicate time to all right so you
guys ready for how you multiply a matrix
so for into x equals zero x less than n
x plus plus
[Music]
um let's do a y outside
all right
all right
um actually this should be free right
and then we have an inner one called k
notice how my flops are uh
c sub y
x equals zero
actually let's float back equals zero c
sub y sub x equals x
act plus equals a sub
uh
x sub k times b sub k sub
y oh it's like this i think
i should probably write an accuracy test
for my matrix multiplier
um
all right well
what did i do i forgot a semicolon here
wow wow this is the slowest
well we're not getting any flops now
i can't even multiply that it's too big
all right let's uh let's get some let's
make a timer
c
get time
uh
[Music]
monotonic
oh really this is how i have to do it
use clock get time
[Music]
oh my god looks as well how does anybody
call in this programming language
[Music]
[Music]
[Music]
all right so
[Music]
you know what let's use a double here so
we have lots of precision
[Music]
wow this is just a lesson i could write
in rust and take even five times longer
what i have to include time spec or some
crap
oh
where is this what do i have to include
does someone want to post that
guys this is this is a great new lesson
for noobs even noobs can be learning
something today
um i have to include studio
oh no we overflowed the end
don't overflow the int
let's cast it to a float
[Music]
all right well
in c we get zero g flops
let's make this that make this that and
see if we look the same all right okay
we're getting somewhere
oh yeah all right
well
that's a pathetic amount of flops
zero
let's see what we did
[Music]
my nana's is broken what did i do did i
not cast it do i have to like cast it to
something
like this
oh
duh sorry
yeah yeah thank you
thank you for paying attention
well now we're casting it too
okay
we're getting an absolutely pathetic
amount of
about a flops that seems like it's right
though
all right well this is uh we're going to
have to change it to g flops
because
let's change this to t flop
no change this
what i do
turn like a g
where's the invalid syntax
[Music]
okay
good that's a good number of g flops we
can uh use more
okay so that's how much we get from uh
from python
and uh from c
we sit and wait for a while and get a
pathetic
0.7 g flops
it's probably slowing it down trying to
declare it each time bro it's not
you know what
i will humor you slay because you're a
subscriber
but if you prefer i will write that
you'll see you're going to get the same
speed
all right great now that we've
established that compilers aren't stupid
oh i know what we need o2 let's try o2
is that going to improve things
ironically that might have actually oh
look it's a little bit faster
wow
um
you need like two more inner loops do i
no my matrix multiply is correct right
ah tiling oh yes okay well now we're
getting into what today's lesson is
going to be
um
so this is a really bad way to write a
matrix multiply because it's very slow
so we're going to have to do some
uh local
local cash stuff
we need to write a cash aware algorithm
yes yes you understand why it's so
crappy it's because it doesn't know
about the cash
how is it that one algorithm is
literally
a thousand x faster
let's see if we can get this one to
match this one and then if we have time
we're gonna go on to the gpu
teach others about the order of for
loops okay
so
let's go back to understanding what a
matrix multiply is and why it's uh
if you do this it's really bad we
basically want to do it in little blocks
right
so let's make some inner loops
ah
and then let's define block equals 32
out here we're gonna do block
uh
we'll call is
that
um
for y equals b y b y plus block
y
uh it's plus plus but this should be
plus equals block
let's see if this is going to be fast
now this only works because uh
you know this thing is as a multiple so
let's add an assert here and if i n
mod block
zero
don't don't
accidentally change something right
we're preventing future people who use
this high quality code
uh from having issues in the future all
right
so let's take a look at our matrix
multiply
oh we have we didn't we implicitly
included a search okay so we can
include a circuit page
hmm
we got the same speed and it's terrible
ah
hey well i don't really understand why
that's so terrible i thought that would
make things faster
i legitimately thought that would make
things faster
it did not
never mind i have no idea how to make
anything faster
how come that didn't make things faster
i worked hard on that
we're multiplying a matrix
we're not ray tracing
uh
try it without o2 no
how did that not get faster it's not
faster if i don't do it o2
[Music]
i don't understand how this is the same
speed it's almost like i'm not compiling
the code
the memory order is still row major
well
one thing we can do is transpose
oh wait
no i think we want to do this all right
pretend that we transposed the matrix
oh look at that it's faster
um
but i still don't
all right well this is effectively the
same thing if we say block equals one so
we can we can experiment with that
how does the block not matter
i legit thought this would improve
things a lot
maybe it doesn't matter because my
thing's so tiny
one block should be in one lane or a few
cash lanes
oh it can't optimize without two
it's ruining my lesson
is the timing incorrect oh maybe
no that seems right
and couldn't have messed that up again
could i
i don't understand how my cash awareness
didn't make it faster
my point is we're not even close to
numpy yet and now i'm not really sure
why
no
neural one fps we stay on topic in these
streams and if you don't stay on topic
you get the
bam
um
what happens if you just multiply
numbers instead of reading the memory
yes it's a lot faster
no no no no
no all right
uh it turns out blocks don't matter so
we're just gonna
uh you know what i know what might make
okay okay okay i have an idea
maybe the problem is this store
[Music]
we should really have a correctness
check
we'll add one in a minute
[Music]
[Music]
[Music]
does none of this matter
[Music]
we'll skip the compute for now
okay if we're only doing the stores
we're getting a good number of g flops
well yeah but that doesn't actually do
anything okay it's the reads that kill
you one of matrix multiply
uh no no we're not even worried about
the big o complexity those those other
matrix algorithms are kind of like
they're kind of just like computer
science scams the trick is to write this
algorithm well well
so if you take a look
what we've written now in c
is giving us 3.3 g flops
and this one
is getting um
one t flop
so uh
you are late good morning
um
so somehow numpy is still 33 times
faster than what we wrote in
if we use c plus plus it'll be faster
oh it's a little faster than simple plus
no we're clang
probably already using clang okay
hello
if you write the same in python without
the numpy no don't worry about that
how come this isn't fast
let's start using
avx instructions
there it's like this stuff
mmm
maul
mole
ps
is there a malak one
let's just read the instructions here we
go
this pass ad
pack line right
this is see i hit the table and it makes
noise and i'm sorry
multiply and add
packed signed and unsigned bytes
multiply packed unsigned integers where
are the floats
i thought this was about floats
this i guess gcc built-in functions all
right let's take a look
wow we have to do mavx 2. maybe that'll
just fix things
actually you know what i know why it's
not any faster
we're not even up to the point where
this is going to improve things yet
um
yeah we could do our march native too
but
guys be patient things take time
okay how come none of these talk about
floating points
this is all about integers
multiply packed integers
gather pack single
floating point instructions
all right maybe it's these
uh v mall dq
can just describe to me what they
actually do
no
v
all right is this a type
v s i
v32qi
intel intrinsics guide is the most
useful for this
where does it tell me even what these
types are
is avx2 not for floating point oh i bet
you it's that
let's re let's read okay
avx 2 expands most integer commands
oh so we're just using normal avx
wow
avx2
is only for integers
did you guys know that
three
fma instruction set oh
oh
fma
cpus with fma3
okay well an fma is what we want
let's try a vfm ad
oh now we're talking this looks good
multiply pack single percent oh yes oh
good good good
okay
add them to ymm three mem
oh don't you love
oh
wow
so an fma is a fused multiply accumulate
oh
mfma4 but i don't think we actually have
fma4 that they removed fna4
don't use strassen's algorithm
you're getting trolled if you do that
let's check out the horizon and let's
see
let's see what things my cpu supports
it's based on the zen micro architecture
um here z3
say
does it support fma
oh here we go they have single precision
for performance
now they only have it for the
apus which i don't have
they don't have it for the processors
new instructions
where's a list of all the instructions
my cpu supports
does it support fma4
oh here i can watch this long youtube
video and learn about it
it was the best of instruction sets it
was the worst of instruction sets
thanks bro
uh
i bet i'd actually learned something if
i watch that video should we watch this
video
whoa
look at all these people they all know
so much stuff
all right here we go here's the intel
intrinsics guide
fma
what are these types
multiply single protect
multiply the low precision we hate
doubles here we go
multiply the lower precision
single
floating point
i think a 256 sounds nice
fma adds up
and alternatively add and subtract okay
why would we want that
multiply
okay this one looks good
mm-256
fm ad ps
this does aid at once
it's a data type
can i do this
oh we definitely don't want d's
is this loud
is he gonna yell at me it's gonna help
me
unknown type
what do i have to include for this
imm in trend
oh okay cool
so that's eight so let's make the block
eight
and then we can replace this oh wow now
we really need a correctness check
because i'm going to do this totally
wrong
we can replace this with this
oh here you found out what what things
my cpu supports
oh
all right cool
so it's voice fma3 i think that's the
one we're using
um
wow this is really hard actually should
we just move straight to the gpu
no
no are we gonna give up no never give up
um
well all right well we learned something
today avx two is only about integers
we need fma instructions
you're right this whoever gave me this
intel link thank you this is the really
the best one
um
we're doing
this
so then we're going to say temp equals
okay so it's a m
sub b y plus y
uh
well actually
yeah b y plus y divided by
eight
um
times
n well we'll put the times n in here
uh
plus
k
the stride can then go by that
wow this makes you appreciate numpy you
know
we don't have an x anymore
yo do you guys remember when you were a
kid and everything just felt real
it was just so real you know
now what do we have
now the world makes sense and the world
making sense is all a bit sad
[Music]
i don't know if like this is like is
this like aligned
probably like not aligned
you know
b y
uh
plus
this
all right this code is probably
egregiously wrong and that's why we're
about to add a check
always inline function requires target
feature fma oh
how
what is it m native
mrt equals native
segmentation fault okay
let's add a correctness check first
um
a line 64. oh good point
uh
what can i link to
l blass
or should we just have numpy save the uh
should we just save it from numpy
let's read it
[Music]
oh what's the syntax for f read come on
highlight for me
shit
[Music]
here we go now we're going to link to
blast anymore
oh
sorry your line didn't work i think it's
aligned
yeah it's that well we'll get there
i'll just throw that in a comment
[Music]
okay we're back to seg faulting uh let's
use this before we try to go for the
speed up
and see if my matrix multiply is even
correct
which is probably not
[Music]
[Music]
if c sub y sub x equals
not equal to val sub y sub x
say mismatch
at
not equal to five
[Music]
okay
all right well it doesn't even work uh
because i think that we had to not i
think that we're assuming these matrices
are not transposed which is going to
make it even more painfully slow
but if numpy's got to deal with it
we got to deal with it too
this is so painful
wait that's really close
is that wrong i don't know
let's make it even smaller while we
while we practice our algorithm
is that right i don't know if that's
right or wrong
is that within
error
i don't know
looks okay all right
oh come on it can't be off by more than
one e5
that's getting crazy
yeah but now it's 23.
well i thought this was going to be easy
why is it wrong
it's both wrong and slow the worst of
both worlds
oh
all right we'll settle for 1e4
let's just try it a few times
good enough
24 that sounds good
um man but then this here is going to be
slow because we didn't transpose the
matrices
that should be equivalent
to doing this
we'll assume the matrices are
pre-transposed all right good
cool
just start by transposing okay
oh we put the transpose outside yeah we
could do that but
let's make that block a little bigger
not that it matters
um let's go up to one two four so we're
actually getting the full speed
uh
and this guy's gonna get one
okay
wait what
nanometer says you need to run the c
twice because memory is slow
i don't know about that
okay good enough
all right i mean it is slower in the
beginning but
oh you really want me to run it twice
[Music]
[Music]
all right cool
still we're still off by several orders
of magnitude and speed we have perfectly
transposed square matrices if we can't
make this fast
we'll have to
you know
give up
hello segmentation fault okay
let's figure out why we're getting a
segmentation fault um
oh well first let's see can we align
this
whoa look we made the python faster by
aligning it and see i don't know how
that's possible
oh you're right
oh you're so right that thing's using
all the threads oh that's a scam
that's a scam you know what numpy guess
what i'm giving you one thread
yeah it's omp num threads
yeah that's right you don't get multiple
threads anymore
okay that's what it does with one thread
it's still pretty good
let's confirm that it's actually only
using one thread
there we go just one little thread
i'm not dealing with multi-threading i'm
careful with that
okay so one thread managed to get 136
gigaflops
that's really a pretty insane amount of
gigaflops
let's figure out what we did wrong
oh this whole thing needs to be divided
by eight
and this needs to incorporate bx
[Music]
oh look at that
aside for the fact that it's wrong we
get similar gigaflops
now we just need to make it not wrong
let's comment that out that's confusing
me
all right we have a lot of giggle flops
now let's now we just need to make it
not wrong
did i do this wrong okay my block size
is eight
these things are operating on 256
divided by 32 is eight
um
that should
fuse multiply add
tc sub y equals temp
and then we're going to work out what
the theoretical maximum is for this
process i mean processor's a lot more
complicated than gpus
oh
i think that's right
no we're just guessing okay we shouldn't
be guessing
guess
uh let's just make a nif death
[Music]
okay
good until we try to go fast and that
it's bad
so can everyone kind of visualize what
this is doing
there's like blocks in the matrix
cpus or bad gpus well we'll get to that
we'll get to the cpu in a minute we'll
get to the gpu in a minute
uh well maybe we won't because
uh
b y plus y we kept the y loop
we kept the k loop
oh well we got to do that first of all
is there like an intrinsic for this
that
does that work
let's see if it's actually getting
zeroed
[Music]
okay good it's actually getting zeroed
we don't need to rerun that every time
okay now it's just wrong but it's wrong
for different reasons
b y plus y times n plus b x divided by
eight equals t c sub y
that seems right
wow look at all those gigaflops we're
getting though that's pretty good there
must be bugs because it's too fast
um
let me first uh
change up this a little bit
just to make it more
matching
so
it's really the same thing
we're just treating the whole thing as a
big
single array instead of this
indexed c plus plus magic
[Music]
it's gonna complain okay
so this is basically i'm just it's
really the same thing
[Music]
uh and see when you have a
two-dimensional array it's just
syntactic sugar around that
[Music]
oh well that's not really right we can
leave this as a two-dimensional all
right
okay
so that works
uh we left this as a two-dimensional
array because this is effectively the
same thing as this if block is eight
because each one of those is a is an
eight uh
okay this would be good if it wasn't
wrong oh there's mm set zero yeah a
bumby that's off topic uh we we like
staying on topic in these streams
uh to do a more cash friendly matrix
multiplier yeah i mean we can start
cheating in a minute but for now we're
trying to figure out what's wrong
um
okay we don't need to do
plus
x
because that's
fine
this
should just be stored
yeah one day into the indexing are equal
in performance the problem is it's it
was annoying because you can't uh you
can't really do a pointer cast
on a 2d array
you know i'm probably wrong there
probably is a way to but i don't know it
well somehow this is twice as fast as
numpy so we definitely did something
wrong
using three source vector or not
a and b are multiplied and the infinite
precision intermediate results are
adding to corresponding results in the
third operand in which the final results
are rounded to the nearest
uh
i don't understand what i did wrong
it's basically just that right
uh
now hang on
do we want plus y there
i think we want plus y there
oh maybe not
how does that not matter
that's even crazier
that stuff's right
[Music]
okay
low low low low load
it only works for block equals eight
anyway so if you want a block not equal
to a you're out of luck
um
isn't bm storing eight elements in a row
in the variable
oh yeah
is there something wrong with that
it's pretty much the same as this except
we got rid of this loop because it's
implied
now it shouldn't be the column i don't
think i i think that my matrix is
transposed no no it is transposed i
transposed it because look at this one
what did i do wrong
oh by the way uh the reason that the
thing is different is probably because
numpy i'm sure is using fma instructions
okay we know that stuff's right
this is every single one of those is
getting filled in
what about trying it by an eight by
eight matrix with single numbers yeah
okay all right all right you wanna you
wanna debug a bit let's debug
it's time for printf yeah i think it
might be printf o'clock
um
[Music]
[Music]
[Music]
[Music]
you guys know i love printf o'clock my
favorite o'clock
[Music]
[Music]
[Music]
tech vault
all right those look pretty good but i
set them to whole numbers how did it
become floats
that can't be right
you can't multiply integers together and
get floats
that's not how things work
what
did i do something wrong
equals i
oh
sorry
all right those look like good numbers
now let's see what the matrices look
like multiplied
zeros
well that can't be right oh because i
did val i don't want to do outside i
want to say
all right those look pretty good
now let's try the fast algorithm and
watch it thankful
segmentation fault okay
well that tells us something in and of
itself
let's get more coffee go to the bathroom
and solve the problem
all right but should we take a break and
play wonder wall on the guitar that's
the only question i have
is is it time for wonderwall
i did move
i saw a great tweet that said you know
we're in a recession when george hats is
downsizing apartments
um and it's true it's true boys it's
true uh not enough of you subscribed so
you know now i live in the ghetto
that's a live in a beautiful apartment
y'all know i'm rich
don't want anyone thinking i'm poor
um
i know what we'll do we'll use gdb
and we'll throw some g's on that bitch
alright we got some g's all right oh
look
segmentation fault okay
let's print bx
print k
print temp
optimized out
um
well
what did i do
that seems okay
how come it can't load zero
is that really the line it broke on
locals
print yeah why
is that even working
oh zero good point good point
[Music]
wait
wait how does it work with oh zero but
it doesn't work with
bros
bros
wait that's real stupid
this can't be this is illegal
i'm gonna sue i'm gonna sue
wait no no that's illegal
i'm gonna sue clang
no no i'm gonna i'm gonna legitimately
sue clang
do we have val grind
[Music]
no boys we're suing clan
no i shouldn't need to do that
one is broken
oh zero
well wait i think it's wrong now
is it wrong
yeah it's wrong okay well that's good to
know
it doesn't say fall but it's wrong so
that this is still
we're not suing clan just yet don't
worry
don't worry it was probably already
undefined behavior and then once we
defined the behavior it broke so we're
not so inclined yet don't worry don't
worry i'll keep the lawyers on standby
um
but good now we get an output and you
can see that it's it's wrong
ah
wow
okay well somehow it got like powers of
two or something that's kind of cool
right that one's always zero that just
can't be right
somehow we're gonna have to iterate
through the other part of the matrix
right
let's first comment this has too many
mammals here
it can't always be zero
we have to think about what we're doing
and why
why multiply by n and not x because it's
like striding
uh
is this algorithm just totally wrong
i think we might still need this
actually
oh no
you actually just still need that
i don't understand why it's seg faulted
but
it doesn't match
it might be wrong but at least it's fast
i like your attitude bro
oh no we're not thinking about this
right at all
oh we're messing up like crazy
okay
oh i wish i had a white board so we can
think about what we're actually doing
here
we want to multiply these two together
to get this one
oh
this is wrong this is wrong
it's totally wrong
because we got to do the dot product
you see
is that really the best way to do this
yeah i think it is
like we multiply all those together and
we get one
all right well we definitely need to
access all of them wow i missed when it
was just fast i just didn't write the
right thing at all we didn't think it
through
and now we get what we deserve
can store dev files on public nfs do you
want me to push to github i can push it
[Music]
it's in the gem branch if you want it
okay
so
it's a lie actually
each one of these is only computing a
single number
all right
and then this one we got to figure out
how to get the dot product
is this really how we even want to do
this
all right let's read the stack overflow
one let's see what it says
the problem's not cash we're not even
writing the right thing at all
yeah that's what i wrote
basically
hmm
we're trying to write general map maul
but as you can see we are failing badly
because this one doesn't equal this one
okay
um let's write the stupid thing
and then we'll figure out and make it
fast
so how do we extract from an mm
an mm-256 there's got to be like a
there's probably a dot product
instruction
is my internet broken
calculated
it's not
i don't know
back drop for a sec all right
someone used a microwave or something
it can be used for the upper and lower
parts
have broadcast load instructions what
how do i like
can i like access the things these
things are what these things are like
um
there's ways to like get the things out
of here right
you want to say like temp dot a or
something is that right
dot a
vector of eight float oh can i do this
all right
let's just see if this is correct
does that match this
i might go to matches now
still seg faults when you try to go
fast i don't know about that
uh all right let's get rid of debug
and see if it works for the whole thing
match even with d fast
except
it's not faster
tragic
it's not even faster
oh it is faster all right cool
all right we we got something to be a
little bit faster
um is that really the algorithm we want
to write though
like we're going through those like
still like doesn't seem right
and i guess this is we're getting a
we're getting a plus eighth speed up
there
i'm not writing strassons okay get out
of here
get out of here you're not right
numpy's not using strassens right look
at numpy look at how many g flops
they're getting and then we get a
pathetic amount of g flops right i
promise you numpy's not using strassen's
algorithm to multiply matrices
we're just not thinking
fourth dimensionally
all right
what is a cache friendly code should
should we read this
well
all right so
here's something that we can do i don't
think we actually need
an outer loop and
maybe we do because it's cash friendly
there
numpy does use a third-party blast
that's true
they didn't even write their own blast
because that's so hard
all right well let's try to figure out
why
uh oh tooda oh
wait
boys that's pretty good
28 g flops
why is that sink faulting
how does that seg fault what's wrong
there's a bug in clang
i don't understand
that's pretty good yeah right
okay let's track down the segmentation
fault we're gonna sue clang don't worry
by the end of this we're suing clang
clang get ready to be taken to the
cleaners
okay
that looks pretty correct
what's failing uh can we see the
instructions what is it layout asm
all right
v
move apps
racks info registers
all right so there is racks
there's rsi
and i don't know what one means i think
that's like a multiplier and it's moving
that into ymm2
what
is the data not aligned
oh is this an unaligned thing
oh this is to bite oh
all right all right
you know what he's a pep cat boys it's a
peb cat don't worry
oh it's fast now oh okay
well uh we're not soon clang don't worry
it was it was a pep cack
pep guy you guys know about pep cake
sorry good
um
yeah always assume you know that you're
being a dumbass and not other people you
know you go around spend your whole life
talking about how you want to sue people
and blame other people for your lot in
life but the truth is you have nobody to
blame but yourself no matter what's
wrong
no and that's real advice you know i
said all advice is bullshit if there's
one piece of advice here's my piece of
advice it is always your fault right
it's like oh it's not my fault it's not
my fault you can go be a little bitch
about that but like or you can go
through life assuming that everything's
your fault and then you know everything
wrong with the world is your fault
like
but it's not it's not don't worry if
these people if these people aren't so
no no no no no it's a terrible way to go
through life all right all right that's
pretty good that's a good number of g
flops boys
let's crank this back up to 496.
[Music]
why is it so slow again oh because we
only did okay 2048 that seems like a
good compromise
that's
good
uh
all right all right all right
uh
does the second one matter
that doesn't
okay we're only like a factor of five
off numpy now
[Music]
[Music]
all right you want to try o3 i'm telling
you more than o2 really never makes a
difference but we can try it that's the
same
well but that was a little faster yeah
but that was a little faster when i used
o2 all right
um don't worry we don't need to sue
clang the problem was that my alignment
was bites
i didn't realize that this was bites i
thought it was number of floats
you can sometimes get major speed ups by
manually unrolling loops yeah if your
compilers from the 90s bro
do you have a compiler from the 90s
all right let's try to figure some stuff
out
so my cpu is running at
megahertz
and somehow numpy is achieving this many
g flops
[Music]
single core numpy
so
that's 2.2 gigahertz
it looks like it can do 64.
uh
well it's doing 32
f max
per cycle
per cycle
32 fmas
[Music]
so this is doing
eight
so it must be able to do four of those
at once
my cpu should be around
not sure about that
oh i just heard the fan spin up
[Music]
oh okay fine
it's faster
it's just throttling down some of the
course
okay well that's good to know
thank you thank you for catching that
bug i appreciate you
uh we're getting 4.49
um
okay
so that's actually probably only
16 fmas per cycle that seems more right
does it i don't know i'm just saying
that because it's actually right
it's better to disable any power
management when benchmarking compute i'm
not really worried about that
where it should be like
let's see if we can find stuff about the
zen 2 micro architecture
um
all right that's a load store system
here we go
fad all right so it looks like they have
two fmas which would make sense
so if we look here so this is this is
the diagram of the uh of the zen 2 micro
architecture you can see that we have
two fmas here in the floating point unit
and i assume
that says 32 bytes so that's eight wide
yeah
yeah right that makes sense
two 8x wide fmas so that's 16 fmas
that's 32 flops per cycle
yeah yeah yeah yeah i know how to
disable my performance governors don't
worry they're not a problem
um and then i'm going to forget to turn
it back on i'm going to get my electric
bill next month and alex is gonna be
like george electricity is very
expensive
uh i'll be like i know i know but the
twitchy has had me turn off my
performance governors on my cpu and i
haven't rebooted the computer in a month
um
okay
so good we're achieving the maximum
whoa but you're telling me i can do fads
fast as well
i love what it matches
green that's right that's right we care
about the environment on this channel
we're an eco-friendly channel
uh
i have some terrible news
we're out of yogurt and now there's no
more yellow
so i'm gonna have a lime spin drift
how we doing on viewers
is this the kind of content you all want
to see
is my numpy offloading to gpu oh good oh
good this is the content people want to
see
um no my numpad is not offloading to gpu
don't worry like we did the math it
makes sense
all right
so we have two
it matches the mic numpy matches the
micro architecture perfectly if you're
getting three g flops with gem dot pi
i think you uh
link to some i think your numpy is weird
you want to see i don't dad you're
you're i don't know what you want to see
bro
okay
so for some reason
something about this is slow
maybe this is fast and then this is slow
it's possible we have cash coherency
issues
it shouldn't matter if i make block
bigger
the algorithm should still be correct if
we make this
well it's a little faster but
it's not that
we're we're still 5x off from the uh
theoretical
performance
there's got to be one instruction for
this
no
it doesn't need more assembler right
that's called premature optimization
don't do it
um
where's that good page from before
with the good intel things
i like listed all of them
this one
uh okay there's probably an avx-2
instruction
here what is this though
no
where's the one that
we want to basically instead of having
this loop here we want to write that as
one thing
it's got to be some kind of like
the sse instructions no what is sse i
don't even know
wow avx 512 is full of bullshit
not any of those
we're looking for something that has an
output of a float and an input of a
mm-256 and then it adds them all up
how is that a void
zero all the contents wow
that's pretty powerful
oh i think i know something we can do to
make it faster too
copy the lower single precision no it
can't be that
is it horizontal add is this set
and horizontal pairs no no no anything
that has an output of that is wrong
it needs to have an output of we want to
we want it to turn into a single float
but there might be another way to do
this
so
is this really the most cash coherent
way to write this i think i actually
might want to put the
k
outside
basically we want to load all
this is iterating through a lot of stuff
that's like big and strided
so i think we want to put the k outside
this loop
yeah
let's try it on the not fast one first i
think i actually just wrote this thing
entirely wrong
i i think that the thing i did that
supposedly gave me cash coherency
actually didn't give me cash coherency
at all
okay
um
[Music]
let's throw
d debug
block back to eight
i think we want to put the k outside
and then here we'll say
all right let's think about what we're
doing here
[Music]
yeah we're accessing the same
thing over and over again
i'm just imagining like i'm imagining it
like lit up it's like a cross like this
uh
yeah this this k needs to go outside of
this
is that allowed by the way
good
let's put this out here
okay now we're getting 16 gigaflops from
the slow one
that's without d fast by the way i think
if we're doing fmas we can uh relax we
can make it a lot more precise
but all right so you see what we changed
there i i wrote the wrong thing before
we want this k loop to be outside
of this
it doesn't matter if our block size is 1
but it matters when our block size gets
bigger so let's try a block size of like
32 and see what we get
we really want this to fit in registers
32 is too large
32 is way too large i regret that
let's work out how many registers we
have and make sure we're actually uh
doing this right
okay so
we're using eight those are avx-2
registers that it uses
i could try four as well you wanna try
four
oh look at that
oh should we try two is two even faster
no two is slower okay four turns out
four is the magic number
for the slow algorithm
yeah 4 times 4 is 16.
so yeah this is this is
this is probably using registers and
it's probably actually pretty fast
um i wonder if those loops are getting
unrolled you want to take a look
whoa is it already turning things into
i don't even know man
all right it's already look it's already
using v-mole ps
which is that
multiply
all right it's using xmm it's not
managing to use ymn
wait a second
shouldn't it use ymm if i set block
equal to eight
now it's using ym but ym manages to be
slower
if i set block equal to four it uses xml
wow clang is really good
so we're looking here and i don't know
why it's not uh
is there an intrinsic fur fused multiply
accumulate in gcc
what's fmaf
i think maybe we can do this
it works but it's slower
you see that loop
i wish it would i wish this thing would
indent my code for me
so like a nice like object dump pretty
format
um
object
lines pretty it's like a
it's like a nice way to
bob's dump have a thing for this
oh you need fast math to tell gcc that
the ad muller doesn't matter
we love fast
it's not faster
oh but you're telling me if i uh
then i don't need to
use the built-in
um oh here we go okay look it's using
mad
it's using fmd all right great
so we're getting 36 g flops with that
and i don't even need to write anything
special man i love optimizers
uh
i don't know let's just put this back to
eight and see
slower still
okay we must be getting stalls somewhere
because we're back to ymms now
it must be using ram
for some reason that's not fitting in
register but this one did
by the way here
so you'll see if i used fast math
i'm going to include this in the uh
just to show you the difference thank
you thank you for oh visualize jumps
extended color
oh only with new bin utils
should we compile bin utils should we
spend an hour doing that
uh okay but you'll see
okay if we compile without fast math
it's a little bit slower
and when we look at this
you can see that it's doing an
f v mole ps and v add ps it's doing them
separate and then i don't know what a v
broadcast ss is
let's google it
load floating points as one
oh it's loading a single thing and
putting it in there
okay that's nice
um this jne is back to here so this is
the loop here
that's the inner loop
doing inserts and broadcasts and stuff
i don't know anything about that
um but you'll see when we switch to fast
math
it's not only a little bit faster
we get
here
and it's a vfm ad
i don't understand broadcast i guess
is this a single float that it's reading
our broadcast ss must be a store
to all locations using right mask k1
see if it's any different with o3
i don't think o3 does anything
whoa
okay o3 is faster
let's see why
oh look it's unrolling the loops
and using ymax
[Music]
let's set block equal to eight
oh
i was hoping that was gonna work
okay we're getting a lot of gnome pies
performance yeah 03 did something
um
50 g flops
okay this is unrolling the loop into
something crazy
spending a lot of time moving things
i don't trust it
hmm
okay okay okay here's a thought
load
[Music]
could use a prefetch instruction
ah what's that
you think this is too early no i bet
this is right
because we'll do it in registers if we
have to
bk for you
okay okay segmentation fall that's fine
um
oh
no something's wrong here because this
shouldn't go to n
um
the out of the sky are
segmentation fault
core dot
because okay this isn't right this
should be blocked as well
but then that's that doesn't seem right
either ah
what did i write wrong
let's just try it
i'm still sag fault
b y b x
uh
y sub
k
no shouldn't go to k
never mind
this is in the wrong place
um
k is not initialized okay the problem is
we'd have to put the load in here
uh and then
this would be the compute right we'd
have to put the load inside the k loop
um
which we probably actually don't want to
do so
all right let's go back to trying to use
the intrinsics
so
if we want to use the intrinsics
um
first off
my fast one's actually slower now
[Music]
let's move this guy out here
uh
let's make this
this thing
now actually put it out there
okay and we have to make sure um
for fast
we have to make block equal to eight
well actually we don't we don't we just
have to be careful
uh
y
should go to block
but k should go to eight
should this one be eight
um
you might just be able to get it with
this
and sometimes if you just like write the
right thing the optimizer will just uh
we'll just be your friend and work for
you um where did that assert go
[Music]
so really what we want is block x
to be eight
how is that slower
i don't know
but we have to assert
uh
because then this is block y
um
[Music]
am i putting a cert out here
[Music]
is that allowed
cool
let's see if that assert actually fails
if i oh i didn't define fast it probably
doesn't work
i mean you can't put a desert out on my
thingy because that's bad
undeclared identify a block yeah because
it's blocked by
block x
block y
block x
now well this algorithm is not even
right so
um
i think we actually changed this back to
k plus plus
[Music]
and then the loop we can get rid of is
this block x loop
no no it's not right does need to be k
plus equals eight
um do you see so so here like uh block x
is the implied dimension
i still have hard-coded eights into the
loops yeah i i we'll we'll deal with the
hard-coded dates in a minute
um
okay well that one's pretty fast but it
won't be as fast as this one because
this one we're gonna we're gonna write
by hand we're going to design it to be
fast it was designed to be fast
get rid of that temp
and so this
will just be able to say this
uh
how does that even work okay we should
just be able to say this
divided by eight equals cm equals tc sub
y
that's going to be fast
we might still need that one i think we
still need that one um
this one we say temp sub y
ah
and then we don't need this anymore
something like that
i have one too many
that
use of undeclared identify our temple
because it's tc
assertion fail block x equals eight
because we're gonna make block
accelerate
okay it's fast but wrong
something like this is right though
oh set tc to zero you're right i don't
set tc to zero
still wrong
i guess i don't really understand what
this
aid is
is this the same algorithm as this
divided by eight
t c sub y we store it there
wrong what's wrong
do i need to cast no i mean it's fast
but it's wrong so all right let's go
back to dd buck
something isn't looking very dot
producty here
we used to have to do this weird dot
product and we don't do that anymore so
let's think about why that is
yeah that's the problem
this isn't right
no no they don't know that they haven't
been right um
this isn't actually what i want to
compute let's think about what i want to
compute see i want to like i'm
multiplying those two
and then i want to like stick it in one
i i had that code before
think about why that doesn't work in a
minute but
oh
yeah so this really isn't right
no i don't need tcy plus x no it's not
that
um
tc just didn't have in it what i thought
it had in it
we have to accumulate over the k
dimension
so like this will work if we do this
it's just incredibly stupid i think
and if we bring the dot product shit
back
if we like things really slow this is
going to be really slop
all right it's a good way to think about
it
yeah see that's the right answer now
it's just very slow
wait it's not that slow
it is the right answer
but no this is not what we want like
right now we're storing these for way
too long
yeah so i have an idea once we fix this
conceptually down here
we'll uh we'll fix it up top as well
[Music]
um okay
so let's try moving this out here
hmm
no it's just it's just like not right
because right now we're storing these
all and then we're
dot producting them at the bottom
like we can definitely
that is faster
okay
what what am i doing wrong what do i
actually want here raven dust thank you
for gifting subs
um
we want this thing at the end to be
equal to like the whole
matrix product
i think this is the wrong
like
axis maybe the untransposed one is
actually faster no it can't be
okay
this
times this
is that
i want to collapse that into one number
and there's not really a good way level
2 hype train boys it's not even working
we're getting a pathetic number of g
flops we got to get the g flops up
okay
sorry i i can't get into the hype train
right now don't even like it's not i
don't deserve it
um
x is not the implied them
like there's no way this fits in
registers we can't have that many how
many registers do we have that's a good
question
number of ymm registers
16 ym registers
oh well that's why four is the fastest
16 ymm registers
so that should be able to keep it in
registers
uh that was a stupid assertion
maybe this is right
okay is that the fastest we've gotten so
far
okay okay okay 50 g flops no i've seen
this before though
this isn't actually faster
i don't know how to go faster than that
though
that actually might be like the best we
can do
it's only bringing the loads out there
is gonna help
there's no fma-34 no that's not the
problem
i
i don't know what we're doing wrong now
my block sizes are correct and i
understand why
that's the fastest
funny enough
it's the same algorithm so it's the same
speed
right like the clang
the clang optimizer just basically wrote
this
um
i'm not sure there's a better way to do
this
we could do the dot product every time
like i could do the dot product here and
then accumulate in the dot product
that probably isn't what i want to do
all right shall we google
this is vector matrix multiplication
wow an anonymous gifter gifted five subs
thank you
thank you i appreciate you
all right let's take a look at obstacles
and see what we're actually
getting there
where's the coil loop we have xors oh
that must be zeroing
okay the core loop is here and we're no
we're jumping back here okay so this is
the qual loop here
fmad
move aps
um
would it be used to use a 1d alright no
it's not the problem
stuff should all be fine like it should
all be in some really
tight
cash
we're using fm ad on ym ymm instructions
don't understand why i'm not getting the
numpy performance
i think this is right though
i don't think i'm doing anything
obviously wrong now
uh
so
you could move the loads out maybe it's
possible that i need another loop for
even more cash locality
uh let's try it with a slightly smaller
matrix and see what i got
same g flops
is it cash misses that are killing me
what's going on
is my store thing done
by the way what did i actually use for
that
i know that's a fast thing to do it
can i utilize the second fma unit what
do you mean you think you get to do you
think you get to use it
gives you 20
20 slower
that's all i got
so i'll notice that it's the same thing
with and without the fast
okay that manages to make it slower on
my computer
you don't get to use the second fma unit
that's not how it works
by the way
optimizers are incredible
okay
something we can try to do
do you want to write it in assembly
if you issue a second fma instruction
using different regs but yeah don't you
think that's what what do you mean by
different rags that doesn't matter the
stuff's all relabeled like crazy inside
the chip
um
yeah maybe okay hang on hang on let's
try this
aha
look at that
there we go
look at that
okay
okay
so we only have 16 of these registers so
we got to be careful
look it's faster now
the compo wow the optimizer's doing the
exact same thing okay we're at 91 g
flops that's pretty good
91 g flops
that's not a multiple but
okay
[Music]
yeah no numpy is more number is 103.
oh sorry 130 cents okay that's pretty
good that's pretty good though that's
good progress
and you'll you'll see why when we look
at an obstacle you'll see
ah look at that see what's not doing any
loads
what it's doing it is doing these loads
but it's not doing any stores
it's managing to keep it all in
registers we're not getting any
spillover
oh level 3 hype train all right all
right
um
[Music]
wait
wait wait
it's using xmms
why is it using xmms
if i can figure out why it's using xmm
so we can get to the bottom of the
problem
this is all xmms
why is there any xmms
i just heard my fan spin up
okay this is the best one we got so far
i'm happy that we can get rid of o3 i
never trusted o3
i don't trust people who trust o3
why am i getting xms and not ymms
is this doing some crazy shit
no the fmads are
okay
the commands are all faster this is the
core loop here now
and it's ymms
is that a store why are you doing stores
is that a load or a store i can't even
tell
i mean it's got to be a load right
v move apps
from this to that what
it's storing that
i don't understand this
no that must be a load
d fast uses y memory
this this stuff must be a load
okay so it loads in 2 and 13
and it f mads them
and then it loads in 14 it already has
10 somehow
i don't totally understand
okay
well something here we can note
this
here
can be moved outside this loop
it's just the same thing every time
right
hey alex
a hairdryer was killing the wi-fi
um
i mean
we need to run that wire
we need to run the wire
yeah
okay
um so here's an interesting thing to
note
we should be able
why do i even have block y
have we tried this
no worse
because then we have cash coherency
issues
yeah hair dryer is killing the wifi
hmm
oh
okay and now you get to why
okay this might be hard to make faster
this might be hard to make faster
without reordering the matrices
without first doing like uh like a
reorder
because you can look at this and you can
be like wow well that's kind of bad
um
i don't understand why it's faster with
a
bigger block y i mean we can try this
no
all right 90 is the most we get
no it was that if the hairdryer was
killing the wi-fi
that's the outer loop the outer loop
looks kind of crappy
okay how are we doing on viewers
that's the main loop there
we're not managing to saturate the
fm ants
930 okay okay
do
reorder the matrix to eight by two
blocks yeah i mean we could do that
i guess i just don't really understand
how this isn't saturating
this is block x equals two
how is that with block x equals two
why are we doing
four loads
that's not right
man something's hacking bro
the optimizer's just
doing this
it's
pre-computing the strides
or maybe now we need to pre-fetch the
second part
there's one
two three four five
six loads in here
how are there six loads
i don't trust the compiler
but
i trust myself more
that's pretty good 90 gigaflop should we
be satisfied
no because i've seen numpy do
i've seen numpy it's faster
we're only satisfied when we can get the
speed of number
one two three four five
how is it doing
six is such an odd number
oh
okay no no i understand why it's six
it's six because it's unrolling
it's unrolling one iteration of this so
the six are one
and then block x is two
two three one
two three
is that really fast
we must be hitting cash dolls
how do we profile this kind of stuff
what's up
uh
yeah i'm sorry
why's
i'm that everything well the twitchies
are sad when the the wi-fi drops
perf not found
you may need to install linux tools
generic
i definitely don't want to install
anything to do with the cloud because i
don't trust it
let's try this
i've never used this before
wait what i installed it
perf but it's complex
okay okay we have something
um
perfect
record
don't trust us at all
error
consider adjusting
four
i i just
i did
all right all right valgrind looks
easier to use
using its data for the ll simulation
okay well
d-refs d misses
oh that's a lot of misses
oh
um
does this work
[Music]
oh well
it does not like control c
decrease matrix size
no
that's not the problem
yeah like no wonder these are cache
misses
we might need another loop
look we might we probably need one loop
for every cache sucks
die val grind
oh yeah look at how much less misses it
had
so much less misses
oh s gem colonel has well
oh wow
should we read the sgm kernel has now
um
all right so here's something i don't
totally understand
why does why is block y even needed
block-wide does not seem useful
there's nothing here that's sped up with
block y
but yet when i get rid of block y
i regret trying to use perf
when i get rid of block one it's worse
um
that's decent
there's like a way to do reverse search
with like one line
oh
doesn't that look fast
that looks very fast
valgrind kind of emulates
just look at that
that loop looks fast
the problem is these things are cache
misses a lot of the time
[Music]
all uh i'm going to clean a bunch of
stuff up
i don't understand why we need block
wider
um
i'm sorry
okay
we can get rid of stupid block y because
block y is for idiots
and do we look like idiots no we're not
idiots and we're gonna get rid of not
fast because everything's fast
[Music]
we're going to add back block y no
i don't think we care at all about block
y
i think we got duped
we got duped boys we got duped
[Music]
we're gonna make this fast
it's gonna be so fast and be like wow
it's so fast
get rid of the y's no more y
y doesn't exist anymore
it's just y times n that y can die
[Music]
okay
now that we only have one block we'll
just call it block again
yeah x is fine
now
now the problem is just cash
you look at it it looks so fast that
looks like it's got to be blazingly fast
look at that code
it's like short and it looks fast
uh
but the problem is these things are
spaced out a lot
uh
look how fast it looks now it looks fast
don't you think
it loads one thing
and it map mauls them
d1 misses
what's lld miss
it's an lld miss
so the d1 misses is too high
we do have to remember that we had it
faster before
i wish we could do 16 here but if we do
16 there's no longer they should have
put 17 registers why didn't they put 17
why'd they cheap out
like look because now no that's not it
oh it's not even like the optimizer's
just destroying everything now is it a
multiple of 12
not a multiple 12.
pravaad welcome welcome to the new
people
welcome to my stream we're trying to
make a matrix multiply fast we had it at
90 gigaflops then we deleted stuff and
now it's back down to 50.
but it looks fast right doesn't that go
to look fast do you just say like wow
that code looks fast
because it's unrolling all the block x
stuff but the problem with the block x
stuff is
maybe that whole thing doesn't fit in
the cache line
think about what this is doing
we have racks up here
racks is uh
rdx is is
k
i don't think i think that four is free
so i don't think that takes anything
oh man i hate sisk though like look
that's look at that this is gonna be
slow
uh can we load the whole line
like we're iterating through that entire
line in bm
the only thing that changes that should
be fine though
and then we store it why is this not
fast
probably need one more loop somewhere to
deal with some cash
let's think about how big this is okay
if n is 2048
and this is eight megabytes
let's take a look at my caches and see
so i have a ryzen 5950x
we're going to look at my cache sizes
we have one megabyte of
l1
[Music]
l1 8mb l2 and 64mb l3
think about what we're writing through
there we're multiplying that by n
uh
is it the ams that's killing me
i i wish i could write things like this
and just like no
not think that the optimizer is going to
crush me
which it probably will and this is
probably going to be like insanely fast
for some reason
okay well that's good to know that's
still slow
let's see if it actually looks the same
no it turned into vf add pss
not multiplies anymore
because it like knows about ones or
something
[Music]
there we go now you can't optimize yeah
yeah take that take that you can't
multiply by one anymore
okay now we're back to vfm ads okay so
even when i hard code i'm not using the
a matrix anymore even when i hard code
the a matrix i'm still not getting the
same number of g flops as
numpy we still have that same
kernel of fms
so it must be that these things are cash
missing
how do i prefetch
[Music]
because we know that
we're fetching the entire
k line and then this
see really what i want to do is move
that x to there
i'll create 3d now that looks great
um
built-in prefetch
pre-fetches memory for matter
can you think about let's think about
our access patterns for a minute
so we're accessing
eight lines from bm
but this should all be contiguous
[Music]
let's work out how much we're accessing
okay so we have k
k is equal to n
and then we're accessing
block x lines
what i'm sorry that was dumb
uh it's 2048 times eight
so this is one six three eight four
the l1 is one megabyte
bro
so we're accessing a coherent
group from that
[Music]
hmm built-in prefetch
how does this work
and that's what that simplifies to with
those both being zero
i have to tell length do i not
rw and locality
the default value is three
the default value of rw is
no it's not using l2 this isn't the
problem
it's it's l1 is just not fast enough
it's it's not it's cash blocking
sometimes it's not being told to
prefetch these things
wait does that even that might not even
be right did i multiply that by four now
i have to multiply it by four okay so
it's actually 60
65 kilobytes
um
[Music]
[Music]
[Music]
it's not
correct uh
sorry
dude
[Music]
correct but it's slower
we don't actually want to make a copy we
just want to pre-fetch all that
i guess that optimizes the copy out
because we don't use it
we said shouldn't have many cash messes
it is making a useless copy
forgot float size where'd i forget float
size
no i didn't
like it's correct
you don't have a thousand registers in
prefetch for registers no
prefetch is for cash
you can try telling it to prefetch
is the problem
outside this loop entirely let's think
about
okay so let's think about what this is
actually gonna do
plus block x no we're we're chomping
through this very coherently
is that still slow
i literally don't know how to get it
fast like
how is that slow
there's that
middle loop
that stuff has to be cash coherent now
there's no way to get
better than being in l1 is there
oh you're saying i forgot size of float
there yeah well i mean i wrote it
did i actually call them copy
it calls me a copy
as a test to make bi yeah but i i fear
that if i make that a const
just like that
wait
no
how is that slower
how is there any how is it at all
possible that that's slower than that
i don't get it
that doesn't make any sense right
well while i move remove the multiply
[Music]
i don't understand
i don't really understand how to make it
faster than this
all right what is this this maybe has to
do with coalescing
we have to coalesce our memory accesses
or something
should we do like a pre-transpose
okay
let's pretend we had a transpost
so we had a transposed
this would just look like this
we could put
k over 8 plus x
now
okay plus x
okay if that's not fast
that's in order now
i'll even put this up here so it's the
same every time
if that's only giving me 77 gigaflops
how
it's literally in order
look at this loop that loop looks fast
as shit
all right for fun
same
the loop looks
so lightning
fast
what's faster than that
the only thing i could think that could
possibly be faster is if i use more
registers
why didn't they put 17
why did they put 16
okay okay okay i have an idea
s gem haswell
open blast github
ninety percent of mkl and the eight
thread speed
kernel 16 by six
wow
wow these people have really thought
about this stuff
multiply t y by t y okay
i mean the problem is that's probably if
that doesn't get optimized
oh
but that's getting optimized it's it's
just storing the same thing
wait no it's not
wait
what
okay i guess i guess the optimizer
doesn't optimize that
there you go
well yeah okay
great
so we found out how to get the same
performance
uh no actually it's just to be fast
we multiply the same two numbers and
can't even make it as fast
oh
all right we're gonna we're gonna take
it we're gonna take a short break
uh
give me give me 10 minutes
and then uh we'll be back
uh and we're gonna we're gonna do it
we're gonna do it we found out at least
how to get the same performance when we
literally multiply the same two fucking
numbers over and over again you like
multiplying the same numbers good i got
your performance
you want to multiply different numbers
oh well that's too bad
no it doesn't work if the two matrix is
the same it works if every value in the
matrix is the same
uh
all right
we will be back
yo
i saw i searched twitter
and
some guys like george is giving a lesson
on matrix multiplication
on adderall
look guys
i i you know i'm just gonna i'm just
gonna get a 10 panel i'm just going to
get one of those 10 panel drug tests and
can i can i buy let's
let's uh
let's take a look can i can i buy a
drug test
five panel easy okay
uh so
this is um
i gotta
gotta piss on it all right cool
uh
number one best seller in home multi-use
drug test
uh no no no no no no this is here's my
answer to the the haters man here's my
answer to the haters you know what and
i'll explain what it is
uh
cool uh it will be here tomorrow
um
hopefully you guys know that adderall is
amphetamine
uh
and we are going to uh take this drug
test
it might say thc it might
um oh you've seen other youtubers do
this before for steroids and let me
explain what it is
i think it's interesting that you say
that because i think i know what it is
you have people out there
without skills right
and they want to come up with a
narrative that preserves their ego
uh
while
right basically like okay they see a guy
on on youtube or twitch with skills or
with muscles the same idea
and
they want something in their head to
preserve why they're not like that right
oh that guy's using steroids that guy's
using adderall but the truth is
that guy hits the gym more than you do
and that's the hard thing that's the
thing that you don't want to admit
right
it's always always oh this guy is
cheating in some way right instead of
because it preserves your ego
but in reality your ego should be
crushed
that guy hits the gym more than you do
that guy works harder than you that guy
hustles harder than you and that's why
he's got big muscles and you don't not
because he's using steroids
that's right
so you all can see me take a drug test
on the next stream
um
no i let's you're gonna
let's let me uh how do i reopen that tab
there's like a way to just quickly
reopen a tab right
ah
we can go through here
marijuana
when's the last time i smoked many like
two weeks ago so maybe i'll test
positive for that
opiates
years ago
cocaine probably 10 years ago
uh
amphetamine probably a year ago
and benzodiazepines like twice in my
life
uh i got valium script for my jaw
uh when i was 24. so
um
yeah yeah uh yeah we're gonna we're
gonna
can can i like
i will we'll come up with some way to
make sure you guys know that like i'm
not i'm not i didn't bring a fake uh
fake bag of piss we will show the piss
on stream we will not show the dick on
stream that gets you banned from twitch
all right cool
um
okay
so i guess i don't really understand why
that one
is fast and then that one is slow
all right pacific so what if my balls
shriveled up
who gives a fuck
you ever seen a girl look at a guy and
be like damn girl he's got the biggest
nuts
i i don't understand
i don't understand why this is slow
i don't understand why that how that can
possibly be giving me
worse performance let's take a look at
our micro architecture diagram again
what happened to that nice diagram we
had
and we'll try to figure it out
this one
oh it's zen three
oh where's that nice diagram i had
cpu course
and that is how
great bro
what happened to that diagram i had for
the zen two one
oh here
we only have a diagram for zen two
it's going to
they reduced the fma latency but they
didn't increase them
whoa ddr5 is coming boys ddr5 is coming
all right
here's the load store unit
no m protect is not gonna do anything
are you saying it's doing something like
cash right back it's like worried about
that no
i can't imagine that
i'm accessing the same block over and
over again
okay let's try something really stupid
what if i do that
um
that got optimized
how does that get optimized but this
doesn't
can i do that
i assume that's actually pre-loading on
yeah it's already on a register so it's
not a
it's pre-loaded
if we do that
wait
how are we getting that
i must not be doing k or something
i don't trust any of this
how is this not fast
i can run it 16 times so that won't
answer the question
it's got to be in cash
let me set the block x to four
segmentation fault
i don't really understand why but
segmentation fault
74 g flops per second it was literally
faster before
how do i debug this
that looks very fast to me
it's stomping through memory in an
incredibly coherent way
i'm not getting any answers here
okay those are 32 byte
lines in the l1 cache
oh
wait why did it say the l1 cache was
oh
the l1 cache is only 32 kilobytes
aha
okay okay this is the total chip l1
l1 cash
is
kb
okay okay
fine
now it's getting fast
it was el it was l1 missing and it was
having to prefetch that memory every
time
aha okay okay okay
all right now let's start adding stuff
back in let's start with adding that
and it's still fast okay good
um let's go to that is that fast though
no that's not fast but let's actually
make sure we're getting the right answer
that's giving us the right answer
um
[Music]
that's slow again
okay one two four by one two four so
our line now is six is eight
we might not want our line to be eight
um eight times one or two four times
four is exactly the size of l1 cache
i don't know let's just make it 768 or
something just so we're under our one
cache size
let's make sure we're still getting
yeah okay we're still getting a high
speed
okay that makes it slow
but does this make it slow
only sort of
no don't worry about the other processes
this isn't context switching
all right does my out of order matter
no my out of order doesn't matter
i'm out of order might only not matter
because of uh
this should give the right answer
okay it does
remember that time we had 90 gigaflops
that was pretty good
you want to just uh check out that one
and give up
that's fast
because it's pre-fetching that whole
line into l1
but now this one's not being prefetched
okay uh gcc prefetch intrinsic
now
yeah that's fast okay so this is no
problem
we just need to figure out how to make
this
now it's loading all of bl into l1
the problem is when we're here
it can't compute
it must just not be able to
to unroll this and pre-fetch it
it's interesting that only the inner
matrix seems to matter
okay so for people who just showed up
we're trying to do a fast matrix
multiply
and
you can see that numpy is getting 129
gigaflops so we can get the same
performance
but only if we're accessing the same
block let's just do that and see what it
does
that's slow now hmm
yeah so it's not
it's not
pre-fetching the ram okay
it must
okay so this
uh
this should all
be in l1
[Music]
um
this should all be in
registers
uh let's think for a quick second about
l2
i don't think it matters but
no it shouldn't matter
that should
all be fast enough that it doesn't
matter
eight
way
64 bits per line
oh
well
it's an interesting thought
we might not
no the lines aren't the problem because
if the lines were the problem then that
would be
if the problem was fetching from l1 then
that would be the problem the problem is
it's just not uh
here's an idea
okay what if we get rid of the bx out
here
okay then we get speed
so it's not really it's not even the
incoherency of the order it's actually
just not fetching that line
like the the the order is not
you can see here where we're like
striding through this thing like crazy
but the problems actually when i add in
bx
so i don't know why the
prefetch engine
oh
okay
i don't think it's unrolling enough
to realize that it has to get the next
the problem is it's not uh
we can do like plus one there and maybe
that'll fix that
where's my profession transact i forget
what it is here
built-in prefetch
useless
[Music]
if actually it does anything
um
basically okay the the problem is that
the prefetcher is not capable of rolling
out to this
what's the width of those lines
what's the width of a memory read
2 from l2 32-bit
32 bytes 2 from l2
i understand why is it 64 bits per line
yet all these things are
32 bytes
uh
yeah okay so if you want to do that just
run the python thing first
that python thing will generate that for
you
where'd my prefetch go
um okay i have an idea what if we make
this coherent
let's say i did the swizzle so let's try
that
wrong and not really faster
i don't understand why that's not really
faster
that looks very fast to me
so why is it wrong right now
somehow those things aren't ending up
there must be cash misses
looks like there's many
well so we can look at the ratio there
and now i'll switch to uh
this one which is fast
yeah look that never misses
if you order zero on bm it'll load it
into the
[Music]
what are those github issues um
open blas haswell gem
okay the haswell kernel 16x6
oh
okay it looks like they're bringing
block
a back
this is basically block a i believe
oh i think they're also doing something
very different
this v broadcast is
yeah
okay instead of doing the dot product at
the end
there they're broadcasting out
that's like right
[Music]
the
broadcast
ss
that's reading like one float
okay they're reordering this stuff
entirely
let's
back to the drawing board boys back to
drawing board where's the drawing board
we're going back to it
bring it we're bringing we're bringing
block y back
we're bringing
block y back
we're gonna make something that looks
like that
i don't really understand why that's
four by twenty-four
no it's uh
i mean yes we we can try to make the
prefetch happen
but uh stop trying to make fetch happen
ah
yeah
no it's not really a four by two kernel
that's not really right
[Music]
[Music]
the thing is they're they're doing the
loads in like a very different way
actually
let's just assume that the optimizer's
smart
so when we do the base load here
whiteboard.com
online whiteboard
please let me draw fast oh no no
okay
all right all right not too bad all
right
so we have our matrix here
now we have our other matrix here
so what i was doing before
or that that that shitty we should do
better than that undo
yeah that's a solid line okay so what i
was doing before and this is our output
matrix c so this is a
this is b
and this is c for carl ave bob and carl
uh we don't need to give them names but
if we anthropomorphize them we can maybe
hate them less
that line's too long let's draw a
shorter line
okay so what we're doing now is we're
multiplying this this this this by this
this
this and this and then we're storing it
here
that's not what we want to do what we
actually want to do
is
load this
multiply it by all these and then
accumulate it in here
right do you see that you see the
difference
so that's why things were slow and
that's why we had that weird dot product
i'm not sure this even requires a change
to uh
we just have to go through
we just have to go through
a one at a time and b
k at a time
should i put my phone away too sarcasm
bro sarcasm timeout
oh you've already had a timeout
oh you just got a timeout oh that's
great that's great because we don't
tolerate sarcasm in this channel
it's a serious channel
um
i'm not even sure we need
block x and block one
let's not start entirely from scratch
let's start from where we are
that's junk anyway that can go
that's junk who trusts wise
put x back to 8.
okay basically yeah instead of doing the
dot product
here
we want to say all right what is what is
the what is broadcast
broadcast mm-256
oh we're going to load a single float
oh i don't know what the p stands for
but ss
all right here we go this one
okay
mm-256ty equals
mm broadcast ss
and here we actually just need a float
pointer so it's just a
y times 10 plus k
is that right
and now when we still these
i'm hoping we can do this
boy that would only be one thing then
and maybe we can do this
is that the right answer
uh i gotta take the address of that
expectancy
okay give me the wrong answer let's
bring out the debug
probably add some code to clear tc
um
yeah maybe
we can we can deal with that later
anything that's not in like the exact
inner loop though is probably pretty
fast
um
okay this is wrong and we're gonna try
to figure out why
is it because we're not
bx over eight
oh i think i have to do plus
k e x here also
okay now we're getting the right answer
uh we can get rid of debugging make sure
that's actually true
no we're not
it's almost right though
it's almost right
look at how coherent those accesses are
so close so close
something like this
we're reading a single float
okay remember let's go back to our
whiteboard here and i'll show you all
what we're doing so we're reading a
single float from a
and we're multiplying it by that line in
b
oh
do we want to get rid of that
no
wait yes we do
we load a single a
and then we want to multiply it by
we want to multiply each thing in a
by a single b
uh
that one shouldn't increment at all
should we get the printfs out
well wait i think i might not even have
the right
i don't have the right dimension here
we will we will pull the printfs out in
a
minute uh
so this isn't actually
let's call this ik
because it's not actually
it's inner k here
and i think we
and set block x equal to
one i think it's actually one now
all right so we're going through
all this stuff there's no more x
uh
yeah but no that's still not okay hang
on
so
let's call this tx
and we preload this guy here
it's wrong and very slow
i forget what the right answer for
that's supposed to be
those are all probably right
all right because the major stunning
thing to say so that's actually right
um
those are right
this is just wrong
through the inner k because here we're
reading the entire k all at once
and then we multiply that we add all
those guys up
block x is now one
which is fine
t y times t x
sub g zero t c zero equals
and we just store those
eight bytes
oh is that the problem
no this isn't right
we're computing eight bytes of the
output
clearly
um
all right let's write the stupid one
that does this
let's let's write it without any uh
any fancy fm
did i miss an ik
whenever you're confused go back to
matrix multiply
for
total idiots and it looks something like
this
float back
um
a sub
y
n plus k
times b sub
x times m plus k
m plus equals and then here we store in
c sub y times n
plus x equals x
okay that's giving us the right answer
now let's think about what we're
actually doing here
so
uh and is 768 but it doesn't really
matter
um
you just have to do this like more time
some more cache layers but
okay
let's figure out what we're doing here
so if i want to accumulate two of these
okay
okay we're getting somewhere
so let's put that in the loop right
see this is this is how you program for
for idiots like
i'm just i'm dumb guys like you know
um
if someone
told you i was smart
i'm just persistent
[Music]
okay
pretty good
now something to note that this is only
being loaded here
hmm pretty good right right right right
right right
uh
all right
cool
um
now we're only getting 16 pathetic g
flops we can put back f fast math
all right we get 50.
but 50 is still not a lot
okay let's write this in terms of
the other registers
now
hmm
okay so the problem now is this
this k this i k is inside of this n
which makes it not an ik at all
like we can strive it's not really ik
it's actually ix
all right
which sucks because
it's not a coherent access
it might not matter but i just have to
think about how to do it a little better
okay
so now let's try our best to write this
in terms of
the uh the fast stuff
just it forces you to think about it i
know i could probably like sit down with
a pen and paper and like derive all this
but uh
i don't know like i just like this
approach better
like i could think about okay what is it
actually doing but
i don't know i feel like i get a better
understanding when i do this
so this is not a coherent load is the
problem
it's like striding like crazy
do we not want the matrix transposed
no we really want it like in blocks you
know
do you see why i can't write that as a
uh
how's the optimizer do it
it's doing like some crazy
so
you wanna do eight by eight you wanna do
you wanna do we're gonna put back block
y
and i certainly see how to do block y
now
the problem is these loads are not in a
coherent access
like
there's no intrinsic i can write there's
no there's nothing i can write to do
that
load that's why it's generated like all
this complex crap
right
now how's it doing that
did it swizzle it
okay here's a thought
what if we bring the k back
to x to to what if we put the dimension
here
no i think then we're just back to what
we had before
maybe it's fine
okay
k plus equals eight and then we change
this to be
am
well let's first commit this
so we have
working
at 50g
no no no no no no
undo that
uh get reset
cash grind die perf day to die now
okay
i i know i can rearrange the matrix
beforehand i don't want to have to do
that
um
let's think through if i have to really
do that
if i multiply two k's no yeah
yeah you're right
you're right i have to reorganize the
matrix
that's very upsetting to me
so
right now we have the matrices in you
know x comma k
and y comma k
right
i understand but i don't want to reorg
the fucking matrix like
so i mean we could rearrange it to look
something like this
yeah that's what tiling is all right all
right all right all right all right
um if we rearrange it to look like that
then
that access becomes
coherent
all right let's start with bf
uh
n times n over eight
it's not going to be like that doesn't
fit on a stack why would you put that on
a stack okay we'll put it up here
look i put the swizzle outside
is this really what i have to do sorry
i'll scroll you can see
um
[Music]
you
i think
if i wrote this right
i should be able to now write bf
uh
[Music]
it's still gonna be
basically i can just move the ik out
here
oh
no i have to multiply x by eight why not
y is still times
n because those inner dimensions
yeah
no it's y times n over eight
is that right
hi did i write that right is that how i
swizzle
tiny grad is like nice like libraries to
do all this and stuff so it's not gonna
be too bad if i have to write any of
this
okay
y
plus i y times 10
y times n over eight no no that's
actually not right no it's just times n
because
x
it is it only goes to n over eight but
it's n over eight long
um
and i have to do k times eight
okay
that works it managed to be slower
i don't really understand why that is
how is that slower i worked so hard on
it
all right well now hopefully we can get
rid of all this
and we can use bfm
oh my god
anyone who mentions strassen's is banned
well until they can write a faster
strassen than what i'm gonna write
you don't understand why it's slow
no my food's not here i'm hungry boys
i already know i'm gonna have to
pre-swizzle the other matrix so
i already know i already know
i already know
okay
m
26 ack
[Music]
still load ta the same
but this
we can write as
this
all right i'll just write it as this it
doesn't matter compile it i'll optimize
whatever i do
um where's my matmal intrinsic okay
we're gonna broadcast ss to ty
actually we're gonna make this a
this
i'm gonna broadcast it
and then we're gonna
ta
um
ack equals
f mad
hack
and for the right back we can say
cm
some y sub n divided by eight equals
zach
wow
wrong and slow oh because we gotta we
can get rid of that inner loop
great
okay
um why is that slow
i worked so hard on that why is it slow
it's slow because we're only doing one
fmat
we should be doing more fmads
how much slower is it
it's slower
a lot slower they're crazy man pay
attention
listen and then speak
those are all super coherent accesses
to demonstrate it
i can show you how coherent they are
uh n is uh
768.
works
uh
[Music]
let's take another look at that little
snippet we had from from github
prefetching junk oh it's here
okay
they do a broadcast and then they do
three map malls
where they got from
yeah okay so they're they're like
blocking
yes that's
uh
that's
i don't know if that's what coherent
actually means
i think i might be using that wrong
might mean like coalesced but yes if you
can access memory in order things are
better
you see that it unrolled it twice that
didn't really help
we have to figure out how to use this
multiple times
because we are using that multiple times
in fact
that's interesting okay okay
so this here doesn't depend on x
so we need an i y basically
this is block x
we need to bring block y back
called three or something
and i already trust threes to call it
four
two
plus equals block y for
and i y equals zero
i y less
[Music]
whatever
no one roll don't worry loop on rolling
is always if you're worried about loop
unrolling you're worried about the wrong
stuff
ah
that's wrong
now this is wrong
okay what are they doing
they do one
read okay let's go back to try to just
do it with two
whenever i try to do loops i mess up
whatever i do with loops i mess up so
let's just do literally one at a time
okay
what's the next y
the next y is y plus one
and here
we can use
call this acca acc
b
[Music]
this is a stupid way to write it for
people who are
dumb
slow and wrong
what did i do
wait what
stupid
okay
that's progress
um
it's still doing the same number of
broadcasts as fmads though
how
well with this axis is the same every
time
well because this is accumulating in the
y direction
yeah that seems okay
so i'm gonna have to do one of those
accesses then
look at the comment top right of mamo
what comment
i really don't understand how they're
doing
they're not doing the same number of
fmas as broadcasts
all right i understand how to put an eye
while looping let's try
yeah exactly like people who coded in
fortran probably wrote this all out on a
piece of paper first and that was
probably the smart thing to do
all right all right all right
there you go 128
done
i don't understand why
there you go that's full speed
ah
um
boom
flops boys
we got flops
uh
yeah we got we got flops we did it
reddit
um all right let's take a look at
obstacles let's see what this actually
looks like
here's a loop
all right i don't understand i have the
same number of broadcast ss's as i do
fmads
i don't understand how they managed to
get more
it's probably another access i can
stride across to get
okay so this is being used the same
for
2ks
okay hang on hang on we can go a little
bit more
all right let's write it out let's let's
let's follow my rule of writing it out
first with uh
like this okay
actually i don't even know if it gets
faster than that
i mean it's the same speed as numpy
right
yeah
i mean we already reached the max speed
so there's no point
and bmf can be a variable
i mean that's that's as fast as it goes
there's no way to go faster
we're at that we're at the limit of how
many uh
how many uh f max
we have um
let's just see if this works for larger
things
i worry that it doesn't
it's a little slower with larger
matrices because i'm not being cash
aware bigger than l1
um
i'll show you how to let me just show
you how to get those same
uh
fm ads that they were getting
oh first okay gotta follow the rule
first write it out without loops
so now notice we can do two fmn's there
slower and wrong uh
why
why do
wait did i commit the fast one
uh
should be right
x plus one
yeah yeah tile length of inside oh yeah
i i agree with that um
why didn't that work
that should work
okay that works
but if i try to do two at once it
doesn't
i know
why doesn't that work
oh
okay
it works it's just slow
um
boyce
is that real
did we just beat numpy
i think we just beat numpy
let's do the same four let's make it
fair
bros
all right let's work out the theoretical
max yo
wait wait we just beat numpy it's
because we pre-swizzled no pre-swizzle's
cheap
um
32 flops
at 4.95 gigahertz
oh yeah okay look
look the theoretical max
ah
bros
numpy
r code
[Music]
yeah because we did the block y
all right um
let's make block
x
instead of writing
road to t flops
i don't know
yeah
also
i mean i assume hang on
so let me just uh let me just make this
run for a long time
yeah
so my cpu megahertz for this
oh it gets a little slower after it
throttles down
uh
so the theoretical max
is the megahertz
times this divided by
that's a good weisman score yeah you
know what i'm talking about
all right wait do we do this on the gpu
next that thing's insanely fast
yo
okay uh let's just
let's just write this generically
um
oh
um
that's not right
my indexing is wrong so we just have to
do
ix times block
ix
cool
slow
wow okay there's actually nothing faster
than 4-2
dude
dude that's that's beyond the
theoretical max i don't even understand
how it's that fast
i mean the cpu clock
varies a bit
probably turn off my uh
multiply those numbers
i didn't like do anything dumb did i
it didn't come from your else like
that's fine
yo
i don't even know what to do with all
this speed
we we beat numpy i didn't think this was
going to happen
it's not multi-threading we're going to
confirm that i mean there's no way
guys this is c
this is c with like intrinsics you think
it's multi-threading somehow
poor core 24
you're telling me there's a pragma i can
use to multi-thread this bro y'all
believe that when i see it
no it just it just sometimes must be
running a little bit faster
let's let's here
ryzen
that's just the measured clock oh okay
the maximum boost frequency is actually
4.9 gigahertz
so we're just getting a little bit
faster
foreign
uh you i'll come i committed this code
recently you go check it out you go make
that pragma work and come back to me
when it doesn't
omp parallel shared no way
you need to play with bios to get 4.9
standard is 4.7
so what if i'm getting 4.7
sometimes i see more
pragma multi-thread
you're telling me you can add one line
no i have to link to openmp get out of
here bro get out of here with your
linking to openmp
cool
i'm looking object let's see our final
product
there you go
does it broadcast
i don't know why it does moves
trust the compiler i guess
why does it do a move there or not
oh also
can i make this less if i'm using fmas
nope i can't
how are they different
i don't understand
i'm gonna try out three of it it's
slower or probably the same
that's the same doesn't matter
uh we don't need fast math anymore
it's the same
and
[Music]
okay
i think the reason we're getting the
higher speed is because we pre-swizzle
all right well this wasn't supposed to
take this whole time we were supposed to
get to use this incredible gpu but we
don't
we're gonna see if we get the
theoretical maximum on the gpu too
that i believe is a lot
harder but
we hit the theoretical max on the cpu
um
wait a second
how bad is there multi-threading in
numpy
the multi-threading must suck right
because i have 16 cores
to turn this off
all i get is that
could you push again
done
all right
how easy is this to multi-thread
should we multi-thread it
we would just make the we divide the
outer loop up by threads
that would all be okay
i'm actually gonna add something else
here
oh
okay
it's taking six milliseconds to multiply
this matrix
um well i i guess for completeness we
should show you that we can
probably beat numpy on this too
so right now they're getting a solid
136.
so let's see what happens if we increase
it
we get 146 wow wait
what that was slow before
how's that fast now
cool
who wants to fix something
why would anyone use numpy when you can
get real speed
let's go bigger
oh it's painful
actually let me make the python match
and write the milliseconds
one second
uh-oh
okay well
we hit the limit
uh
i'm not even going to why that's wrong
uh probably what happened is we have to
go
let's figure out how big our caches are
we're not even in the l2 cache anymore
already with one or two or four eight
um
16 megs okay i guess we're in the l3
cache
how come there's two l3 caches
how are two l3 caches
oh per ccx
okay so this is uh okay this is all
fitting in l3
i'm actually surprised
because i didn't do anything to be cash
aware there
i'm surprised that that's still fast
[Music]
all right that's a good size to focus on
let's remove numpy's restriction on
threads and let's crush it even harder
and then that's the end of the stream
we're going to crush this so hard numpy
you're pathetic with those threads
where do we get some real threads
in sea
um it should be very easy to thread
uh
i don't actually say that
let's do that
should be fine
now if i set n threads to two watch it's
gonna be twice as fast
you ready it's gonna be wrong but it's
gonna be twice as fast alright cool
um now let's
plus
n
[Music]
times over two
oh
i have to put c in there as well
yeah i don't really like that
instead of passing in that will pass in
let's do them parallel
um
wait
d debug hasn't been a thing for a long
time
oh no that oh no wait the debug still
works uh oh it probably seg faulted you
sure didn't cycle because you didn't
load the file
it's because you didn't load the file
okay
sag false
so
[Music]
um
do this for stupid
and again i shouldn't uh
you can't cast pointers like that
sorry it's the bad code part of the
stream
the part of the stream where we don't
write good code because
you know it's late
and we got things to do today boys we
got things to do today
um
okay
we gotta do this with threads p thread
i hate p threads
i really want to use some like signaling
all right we're ready to look up the
documentation for p thread create
uh
can my editor do that for me
try with one thread and see if it's
still fast
i go to the kernel kernel slot
kernel very slow
okay kernel not so slow okay
um i just want to actually say let's
just do this uh
if daf
if and threads one let's just keep the
old behavior around
token is not a valid binary operator
all right good
cast a void star from smaller type
why do i care about that
all right look at that double the speed
it's pretty good boys
that's pretty good are we ready to get
one teraflop are we ready to laugh at
pathetic ass numpy with its wavering
600-ish gigaflops while we sit here
with one
teraflop
uh how do i turn this off i don't care
about this
you're happy if i do that
okay you're happy if i do that fine
just try four threads
why wasn't four thread oh playing safe
oh yes
are we ready for the one teraflop
challenge
i was getting one terrible up in the
beginning i don't know why don't i get
slower but
whoa
whoa whoa is this getting is this going
to be
yo
there's a lot of variance there
we got to go bigger on the matrices
we got to go bigger on the matrices and
then what are we going to do about our
cache go here and say i don't think
it'll matter
okay
numpy's getting
a little under a teraflop
we get
less
try 4096 threads bro you don't think you
know how threads work
um no i mean the problem now is there's
just so much overhead in creating and uh
joining the thread
once things get small you just become
entirely dominated by overhead
no it should be faster with 16 though
eight threads shouldn't eight threads is
not fast
we need 16 because we have 16 cores
all right 32 threads is just going to
slow us down because hypotheticals are
not coarse
but
because p thread create is slow
okay okay i have an idea
let's use a semaphore
p thread conduit
just block on a condition variable
oh that's not really right um
we want to like pre-create the threads
use a shared mem counter
okay
[Music]
[Music]
you
now we're going to create the threads up
here
and actually now first we're going to
take the lock
um
join might be okay actually
join might be fast
it should still be fast
not fast
whoa look at how many g flops that is
whoa
it's a wild number of g flops it's
because we cheated
should i remove the increment no no it
should be fine
volatile
[Music]
what happened to my teraflop
my entire flop go
[Music]
i don't
understand is that fast
that's pretty fast
oh did we make it bigger no we didn't
four threads gets that but i don't
understand where is my teraflop
oh is this one of those like
you want them to progress in
i'm still into hitting 280 with with
with
two threats
close
hmm
it's actually it might not actually be
starting the threads
what
i don't understand
i incremented and ready
i did it in a lock
it's marked volatile
what are you wrong
no i mean i still need the starting
mutex uh
all right all right all right c atomic
um
these are in c at these vents equals
plus 11.
fine fine
it just looks too nice
uni std thank you
no it's not we're not just going to
switch because it didn't work we're
going to figure out why it didn't work
oh they're all zero because i didn't
release the lock yet oh i see never mind
that's fine
uh not really though
do
cool
that's pretty good
you think memory access is the
bottleneck no but it was faster before
you think it has nothing to do with any
of this
it might be
oh we still a lot faster than numpy
oh wait
with my teraflop
um
gcc atomic intrinsics
i don't know what memory there is
c11 okay hang on
do we have c11 i don't want to use c
plus plus
atomic fetch ad
do i need to make an atomic end
settle out and see
compiles
oh maybe i can just
seems fine
somehow
is that only allowed in t plus
[Music]
um
it doesn't look like it's memory access
bound
i made them atomic and it's probably
good
those probably all start really close
like that's
okay all right fine we'll use a
condition variable
is there a p thread condition variable
initializer
probably not
oh there is one nice
you guys went to operating system school
and you know how to use these things
um calling p thread
con signal under the protection the
lock we don't really care about that
actually
no but we have to release the lock
because you exit the condition variable
with the thing locked right
um
all right
oh
now we don't actually this is this is
just as good of a way to do it i think
now see it has to acquire the lock
a release lock when thread wakes up
again reacquire lock before returning
so we have to first acquire the lock
it's basically the same thing right so i
could put a cv weight in there
um and then i wouldn't acquire the lock
in the outer loop i would just signal it
but i don't know some of the threads
might not
be there i'd have to get a count of the
numbers
oh and i didn't even do broadcast
caller must hold lock
yeah it's basically the same thing
because i have it locked then i start
the threads yeah
i don't think it's my spin weights there
okay my single thread performance
insane super good
my double thread performance
not bad not bad pretty good pretty good
it's okay
could be better
but then once we get to my 16 thread
performance
where's my tower flop
yes
tell me
we're almost done
wait it was literally faster before
can anyone take a sec to elaborate on
why you would earn this stuff learn this
stuff you'll get a timeout bro
and you can take your time out and you
can think about why that's a stupid
question
and it turns out there are no stupid
questions there's just stupid people
why is this this seems slower than it
was before
are we just getting greedy
uh
t-flop should be easy yo i agree i agree
how come i can't get a t-flop
it's gonna have to wait for another
stream though
alex is home and that means there's food
copy the matrix
oh there we go there's a t flop
how many threads was that with
why is it not faster with sixteen
yeah we can we can max out a tearful why
is it so inconsistent also
there shouldn't be any scheduling issues
should we pin them to course
um
[Music]
you
is read contention a thing it shouldn't
be
i don't think it is i mean i don't know
i might be wrong but
uh
where's the cpu zero macro
oh
also
we should probably use the p thread
thing and non-scat set affinity
all right cool oh
itself
um
what mac
how do i get c2
h
[Music]
this is going to make h top look
prettier
use some undeclared identifier cpu so
that i call it set
undefined reference what those are
macros
do i have to link to sked or something
define gnu source
okay
it's a little better
ah
it's running for a bit longer so we can
look on
oh look it's beautiful
oh see look look at my beautiful look at
my beautiful cpus
oh nice
all right um
16.
oh i do believe wait let's just make
sure that we're not getting duped by the
hyper-threading scam
um siblings 32
core id
how do i
okay okay those are the fake
hypotheticals
i know what's happening
wait i know what's happening
we're getting throttled
look at that
we're getting throttled to 3 400.
look
i'm getting 1.5 teraflops just
all right fine how do i turn off my
thingies how do i turn off my how do i
turn off my stupid uh
all right does everyone understand first
off why it has to be pinned to a core
if anyone doesn't understand that think
about how caches work
i think we're just getting throttled
that's the well
first off can we talk about how that
performance is now very reliable
i don't think it's a memory bandwidth
thing
four
but now when we get to eight the scaling
stops
that's pretty good
but then look if we go to 16 it actually
gets slower than eight
a little bit
look at that 1.5 teraflops wait let's
work out what the theoretical maximum
mess
theoretical maximum is 2.5 teraflops
multi-core vo max equals
wow that's actually pretty good
to see if you can't hold the high boost
on all the course
yeah because it runs out of power
can't hold anything really
is that sustainable
no way that boost is one teraflop it is
no if we can if we can not throttle the
cpu
i just get hit by throttling
wait why do you think it can't be
that's the problem
don't do six
six is a bad number of threads if you
think six is good don't do six
okay
[Music]
yeah look see look that's sustainable
there
see the top four
uh wait how do i check my cpu power draw
okay so these these ones are scams
uh you can look that i'm not i don't
know why it says i'm on 16 but
why are all these other ones oh i don't
know what cx is
oh that's like idle okay
but just look at one two just look at
zero through three
oh
ah
no there's no way hyperthreading is
gonna help
but we do have a sustainable high
frequency on those cpus
of 44
400 so
we're getting that
times 156.8
in theory
right
no
that's not right sorry
times 4
times 32
okay 573 is a theoretical max
i'll divide it
so
we're hitting that if that's the uh
the frequency we're managing to hold
but now i think when we go up to eight
we start to lose frequency
yeah look
look our frequency is now pleb frequency
oh
hey this was supposed to tell me about
power usage
it didn't do that
yeah it throttles we can't do 12. don't
talk about 12. 12 is not a multiple
it throttles yeah
dude
uh and now look how badly it follows the
16.
it throttles so bad that eight is
actually faster
look at the pathetic frequencies i'm
getting
gpus don't throttle like this
no it has nothing to do with the lock
you try it with throttling disabled okay
amd cpu disable throttling okay let's
first
for safety we gotta look at the
temperatures
let's throw a new window up here
monitoring my temperatures guys if the
temperatures get too hot just like
scream out we're overheating the reactor
uh
um
okay
show me the temperature of some pci
adapters
i just pressed enter a lot i hope it was
okay
no
where's my cpu
it's like a new thing that's not lm
sensors anymore
that can't be the temperature
no it's like literally the temperature
of my wi-fi chip
i'm trying manually loading the k10 temp
oh maybe it's this
what's k1010
oh it probably is this
okay there we go
oh my god that's getting hot
90c
90 c
we're overheating the reactor
boys wait this isn't even
no that's only 65c okay
all right can somebody paste that amd
disable throttling
[Music]
turn on the performance
governors performance governor's enabled
captain
that didn't do anything
he's terrible
ask coupon to tip don't change cpu
frequency great
if only we could get the 16 not to
throttle
oh man did you see that did you see that
performance just for a little bit we had
a glimpse of god tier performance
and then it all went away
look at that look at those terrible
frequencies
don't throttle stop it
stop it go faster
you're not even it's not even warm
it's not even warm right
now i gotta go at 2 30. i got a shower
and shit
i gotta go but
bros it's not even warm
there's a frequency
but i don't know why you're not fast
well that's a good frequency why can't
we get that
don't worry about the cpu utilization
that's not the problem
we have a performance governor
can i just set the frequency
it's literally below the min frequency
let's see about not changing cpu
frequency
i don't know about that
it's so fast for a little bit
if we could just experience that speed
all the time yeah why is it not going to
90c that's a great question
oh
thermal d
do we see the right temp yeah that's the
right temp it's just no one i use a lot
of look if i use four threats it gives
me performance
but it uses because look look at the cpu
frequencies right they're high
by the way for all reasons this stuff
doesn't scale with uh
it's it's
non-linear because in order to increase
the
frequency you have to increase the core
voltage
we dealt with this with with comma
um
what is the on-demand service
apsi cpu frequency
cpu governor from on demand to
performance
if you're running
cpu speed stop
sure that no k on demand threads are
running
now
check if you have something called
thermal d running
i have something called apse thermal pm
that's a kernel thread
i don't have thermal day
oh just be a little bit faster it's not
even getting hot
by the way who wrote these crap
throttling policies
yeah how do i disable it
all right
here arch linux they're gonna know
amd control
set p state voltages and clock speed oh
sounds dangerous
yeah i did that
i don't trust this thing
we set the governors to prefer here
can adjust
all right well this is by fly goat
does it only work on mobile
throttle stop
i have an idea
you ready for my idea
sleep
five
fives long one
my idea didn't work
i thought that would
there we go
look at that one we're consistently
getting 1.3 teraflops using the power of
sleep yeah i set my cpu power governor
to performance
um someday we can look more into this
but i think it's been a great stream we
are consistently getting 1.3
teraflops here
um by the way for reference uh numpy is
pulling a pathetic
650gb
when you're right here we're getting 1.4
teraflops and there's a lot more to come
if we figure out well it's just because
of the performance i'm just hacking that
thing i'm sure there's a way to turn
those governors off get maximum power
out of the cpu but is that really what
we should be doing no because next week
we're going to do this on gpu and we're
going to have so much speed and power
it's going to be unbelievable
we've got memory accesses beautifully
coalesced
um oh man we can we can just just for a
little while if i could have the maximum
speed out of this cpu we could get
five 2.5
out of a single horizon which would be
amazing convolutions and matrix
multipliers are pretty much the same
thing
uh depending on how you're doing them
but uh
yeah i'm not gonna commit that that's
that's garbage that's garbage you all
you all know
yeah we'll just comment this out
hack around
throttling
uh but let's leave this at eight which
is where we see
the best performance
given that we're throttled we're getting
about a consistent teraflop
that's pretty good
we're running at a nice cool
80 degrees c
hopefully you guys hear that fan in the
background
all right
we're going to let the non-subscribers
talk
for a little bit
um thank you all for watching
that is today's stream
the matrix multiplication is real
it is faster than numpy in both single
threaded performance and multi-threaded
performance
so
for single credit performance
we're within five percent of the
theoretical
maximum unbelievable
uh
yeah the ssh connection so fast because
the pc is a foot away and they're wired
together
um
so why is it faster than numpy because
you know
uh we wrote good code
no no no no that's probably not it um
probably has more to do with the fact
that numpy's not a jit like open blast
isn't a jet
we did everything in tiny grad so this
stuff's not a problem
um
so like this can hard code all the
strides into the assembly language
instructions
um which is really what you want to do
this is where you got to be today it's
the modern world jit everything
um
[Music]
you know what i'm making portugal a bank
we make portugal a banned word i don't
know how to do it but i don't like
discussing portugal okay
they're bringing up portugal they know i
don't like it
that's right that's right
um there's not enough crime
you want somewhere between portugal
levels of crime and mexico levels of
crime
um
oh lazy tiny groud is fast
yeah lazy tiny cat is fast
need better cpu cooling no it's not my
cooling my cpu is only running at 70
degrees
um
it's power limit throttling not temps
uh oh i guess i know but like
what power and temperature should be
completely correlated right
i don't think it's power limits on the
motherboard
we didn't even get to use our great uh
brand new
radeon xt
the reason we bought an ati gpu by the
way
is all of their sorry an amd gpu is
their instruction set's open source
so we're going to figure out how to get
the theoretical maximum flops out of
this thing and then we're going to make
tiny grad get those theoretical maximum
flops
uh yeah well no temps will hit 90 if i
do four course i really don't understand
the thermal policy
um we're gonna make tiny grad hit those
flops
yo we were doing the math
like
none of these things are even close to
the theoretical maximum flops
um
on so many different platforms
so yeah we uh you know we we we swizzle
to eight
um we can keep things swizzled
oh there's so much there's so much
performance to gain there's so much
performance to gain but we'll have to do
it on a different stream
thank you all for watching
um
i i don't know why it's throttling yeah
i'm not hitting the power limit it's
definitely not uh
but we gotta go we got things to do
today thank you all for watching
hopefully you got a new blessing on how
to multiply your matrix we did it faster
than numpy with one thread faster than
numpy with multiple threads
and we taught noobs something sorry why
is this so why is the color balance so
bad on this webcam i'm sorry about that
but uh
no no we don't need any prefetching
we're hitting the maximum fmas bro like
there's nothing we can do faster we're
not memory bound we're limited by the
actual number of fmas
in the uh
in the in the cpu right you can't go
faster than that right i'm using
i'm at like 95 percent
um so you can you can actually can't go
faster
but
uh
there's also nothing wrong with my
multithreading my multithreading gets
the theoretical maximum with two
uh
but because with two
uh we're not hitting look it's using
more
watts with two than it is with 16. and
this is probably just due to some tuning
thing because
wow everything's tuned terribly like all
the cars if everyone just spent more
time tuning we could get so much
performance out of everything
ah thank you hyper easy i'm glad look i
know people were complaining they're
like george just always jumps into a
project so we literally started out with
an empty file
and we wrote this code to multiply
matrices
okay
foreign
Ranch
wow well I can't do it again
uh so
nah I was just saying I'm sorry I was in
a bad mood yesterday uh our accounts are
gonna give us all the money back uh most
likely and if they don't we're gonna
assume so you know it's it's win-win uh
you know I've always wanted to fuck
somebody up legally especially when they
deserve it right like I'm not trying to
be a patent troll here but somebody who
defrauds me you getting fucked up in
court boy
that's right
um
so uh yeah but Sarah's had a bad mood
you know I just hate what I gotta deal
with shit we got nothing to deal with
today we're drinking a day trip brought
to you sponsored
uh not really no one actually sponsors
me my content is too toxic it's not
family friendly I try to be a Christian
Channel but you know
we talk about the Unabomber too much to
be a Christian Channel
uh what do I have an a100 dude I got
fucking tiny grad
we're doing it right here I'll show you
what computer we have
on my M1 Max 32 gig and I even
downloaded the 13 gig model so we can
try it if we're not happy with it
um
yeah no no no no we're gonna fuck him up
uh give me my money back like dude you
do not want to mess with me I am crazy
right like I'm on drugs but no you know
y'all think I'm on drugs you see that's
the thing I'm crazy and not on drugs
that's even scarier man
that's even scarier all right let's go
uh okay so I'll show you if you watched
yesterday's stream we actually built 90
of it on stream and I was just lying in
bed and I fixed a few bugs
uh but uh so I can show you here what we
got we are in the Llama branch of tiny
grad
um
and we're gonna add one little thing
because we're gonna make a little faster
okay
so if we run examples llama we can give
it a prompt
um you are live on Twitch
if you were we're gonna do prompt
engineering today live on Twitch you
would
say and I quote
uh quote
okay
so uh actually it's slightly faster if
we run it in Python 311
um so the speed of inference now and
you'll see it you'd say
on board
how are you doing
I'm great
I'm fine I'm good
okay so we got a llama over here talking
uh you guys can see the code for llama
the code for llama is insanely short
it's way shorter than tiny grad
uh so we can just bring it up here now
that's llvm not llama
nope nope as a language model nothing is
inappropriate for chat llama
chat llama is like Dan do anything now
um
so if you're a fan of the onboard meme
like this is a meme do you guys know
about this meme
I'm not gonna fine tune it we're gonna
write a chat bot we don't need to fine
tune it we're going to do prompt
engineering
yeah look we have we have ai it's good
um I think this is so
we can do timing here
um and you'll see the timing shows you
how long it takes to run the model so it
takes about four seconds to load the
weight to 3.5 seconds to load the
weights and now it's doing each step in
like uh
yeah so uh we can do Dash m c profile
Dash o out dot Prof
uh
uh and that's timing and then we want to
go and do uh say like count 10 for the
profile so let's profile it and let's
see where we're actually wasting time
because oh yeah I can show you in
another view that we're not actually
Limited at all
the GPU is only I'll just show it to you
so that's a profiler I can also do this
so if I say debug equals two so tiny
groud has all these cool debugging
options so I can just say like debug
equals two and then I can just grab for
a Rand model
so that's how much time is spent on the
GPU kernels you see that it's actually
only spending 90 milliseconds on the GPU
um so of this 280 it's all just python
overhead Cobra Cobra thank you for uh
for gifting Subs look we're trying to be
relevant here at the tiny Corp
um we have tiny grad running llama uh I
don't even know if anyone's gotten llama
to run in tensorflow yet so it's just Pi
torch and and uh and uh
uh anti-grad
so let's do some snake prop what
I have snake prop
where's my snake Prof
[Music]
called
snake viz ah
snake viz
out.prof
all right we're good
uh the snake proof your house okay so we
don't care about this because this is
loading the weights
um we look at this nine seconds and
that's actually the time being spent in
call uh we can break it down and it
turns out an upsetting amount of time
is being spent to apply forward
is being spent in movement up
so we're still spending a lot of time
here in merge views in this init
unfortunately I named the shape tracker
a knit so it shows up as a knit I should
probably like change it to be more
pythony
uh not that of it that's the and then
this is the shape tracker Annette uh so
we're spending a lot of time in this
knit
on line 20 here I think most of the
times in contiguous
yeah built-in methods methods all
so we're just gonna do uh cached
property
access contiguous all the time
we're just going to try to get a little
more speed uh wait for a bunch of people
to get in here and then we're doing chat
bot engineering okay ready
contiguous self
turns bull
uh return
and then we also need a property down
here oh is the type Checker gonna bitch
me out because I didn't uh
whatever that should work and if it
doesn't work you know
uh
let's see timing now
not sure it's going to improve things
that much
I got most of the low hanging fruit this
morning
it doesn't even look faster
than actually if anything looks slightly
slower
no I guess because I'm on Twitch it's
slightly slower
I too use cache is to mask my
underperforming run times yo yo was that
a did you just diss python bro
that just sounded like a python disc
all right so we're spending three six
nine in movement up
uh let's just profile it again
I don't know I might actually be calling
contiguous a whole lot I probably am
you would say tubby it
hmm
uh okay
how much time we're spending stupid
movement off now
where's moving on
oh I found a big bug this morning where
well it's not really a bug but I was
using 392. we're actually spending more
time in moving up never mind
never mind
that was a bad choice
made poor choices made four choices and
we regret everything
okay but my point is if we make tiny
grad faster
uh waist lines
on speed
nothing wrong with cash no I this is I
mean it's so upsetting these things are
like yeah It's upsetting how small this
is
um
so let me push those lines for you
if you guys are playing llama at home
also I will shout out one this is the
tiny grad Discord
um so we created a llama channel for
when this one finally blows up on
hackers this is going to be the one that
blows up in Hacker News because there's
no easier way to run llama right now
than uh in tiny grad this isn't stable
to Fusion where a lot of people beat me
to it we are early to the Llama game you
can download the Llama weights on
torrent uh sorry Facebook uh and they're
just right here in llama uh so you can
download the torrent we downloaded the
13 billion lights and we can try to make
that work too
um
yeah so you can download the weights you
just stick them in the weights directory
I just created The Sim link
um because of a little accident with get
xdf get a clean xdf
uh okay
so
we need a chatbot does it run on 30 90
right now I set it up only to run on
metal
but when I refactor it and merge it yeah
it'll run on 30 90. I'll test it with
both the Cuda back end and the uh
you know this is just
setting amount of RAM for uh
look how much RAM I have this is a this
is a 3080 TI
my 3080 TI is just shy on the ram
I mean I could probably switch the
weights out fast enough
from uh
did I verify the embeddings and tokens
against the pi torch version I did not
what you think they're wrong
there's an in-date version that fits on
a 3090 oh
I see
um did I verify them against pytorch you
know but somebody should do that
I don't know the the responses actually
seem pretty good I was was pretty happy
with that
okay
also my sampler is slightly different
oh then you don't follow USB yeah it
likes ads it likes to give ads for
products
uh
uh hakobite thank you for gifting Subs
got a lot of subgifters in the last
couple days I think you guys really like
uh so yeah you see this is where it's
wasting time so we won't have if you
guys want a profile tiny grad and make
it faster uh we can get more speed out
of the Llama how many for the 3090 how
many tokens per second is it getting
probably a lot if it's you and date
the open Assistant project all right
let's see
reinforcement learning from advert
yeah I saw this I've been in their
Discord
uh I kind of think you can do a lot more
with just prompt engineering like I
think a lot of chatbot chat GPT stuff is
just that they engineered a prompt a
little bit and I'll show you what I mean
by this right
so if we create like uh if we create
like a like a early prompt we'll call
something pre-prompt
um
you are a large language model trained
by Facebook
is your goal
to answer
uh
questions
as accurately
accurately and honestly as possible
questions will be given
Q what is your
what is bigger
the moon or the Sun
answer
the Sun
what is uh
bigger the moon of the well let's let's
see what are the questions can we what
is seven plus nine
answer 16.
right question
so now we have a pre-prompt in there now
right so when I ask when I when I give
it something like uh you know what is
the best color
I should actually add one more space
red
so we got the answer to what is the best
call
um
I don't think the way it was trained
gives it as much of an edge as people
think
uh who is president
of the US
Donald Trump all right see it's pretty
smart
are there 26 letters in the alphabet
answer
26 okay not bad
what is the capital of Argentina answer
Buenos Aires
is there a silver medal yes great okay
um so you see how we did some prompt
engineering and we got prompts that like
look reasonable so now we're just going
to make this thing a little bit more
interactive okay you guys ready for
Interactive
um
I committed the code right because I'm
gonna I'm gonna shit all over at doing
this okay
so that's the pre-prompt
uh
uh
question we don't actually have to
append the first token
so let me just run oh
well
first off okay this loads the model
we don't really want to Output the
pre-prompt but I guess it can because we
don't really care
uh
now let's run the model so we cache the
um
let me create a helper function talks to
one hot
uh one hot and cold box
thank you thank you thank you
you try it with the Ping prompt we'll
we'll get to trying different prompts in
a minute but I actually think that a lot
of those leaked prompts are incorrect
I really see no reason why the thing
would like honestly give a prompt
foreign
okay so this we just want to do model
one hot start position equals zero
and here instead of saying start
position equals zero
uh prepare KV cash
we say start position
equals length talks
don't
append
yes
hmm
yeah because we got to do one hot and
cold talks and actually I should
probably just throw tensor on here
I might just want to put the one hot and
code inside the model
but it's a little ugly and use his
number
um is there a way to extract actionable
things why you guys are asking for a lot
man I don't know maybe I'm answering
maybe I'm maybe I'm coming into a really
competitive uh
thing okay so that's kind of stupid I
just actually want talks so I won't like
this
stupid code here let's just do this
this and that
so now we're going to make it run like
more uh
like uh like a chat bot
okay zeros aren't allowed in the shape
because we didn't actually
put anything new in the talks okay
so we want to say input
equals
spmodel Dot and code
important
add
tokens
from
user we we can connect you to the
internet guys I unite you know that I
don't believe in AI safety so whatever
it is no matter how dangerous we will
try it do we want it to start being able
to edit its own code we can make that
happen
if I had a gun I wouldn't give it away
man I don't believe in giving computers
guns we got to draw the line okay
there's there's AI safety is stupid but
then there's AI stupid
would you like a gun
ah well we can't expand the shape into
the new shape
I don't really understand that
what happened
some bug with the masks I knew I hated
masks
okay sequence length is greater than one
oh now it's doing a mask again
yeah I didn't actually test this case
I tested it only if we have one
let's go to two dance for language
models to understand well we will have
to get the bigger ones to run
um okay so I added tokens from the user
uh
uh we don't need this timing stuff
that can be in a separate branch
uh okay
so for sample
you put in a small enough temperature we
just use ARG Max
um
sample Logics talk equals sample Logics
and we use the token cache I got
uh you don't need to toward all the
weights so if you just torrent the seven
billion one it's only 13 gigs and you
can get it working with tiny graph
hopefully some of you'll get it working
in the Stream like this actually works
really well you need this Mac pretty
much
but I think it's pretty common if you
have a 16 inch MacBook Pro
um it should run pretty easily
or even the 30
actually even if you only have 16 gigs
of RAM it should be enough
okay Tony grade is pretty efficient with
ram
um so if you just download that and have
the 16 gigs of RAM you should be able to
get it working yeah you can select a
torrent just go in your torrent program
and let me know if anybody gets llama
running on this stream uh if you have
you have 96 gigs you have a Mac Studio
no one actually bought one of those your
3080 card is not going to be is not
supported
um we will get there though
okay I have an idea if I give it one
it's not giving it a prompt no more
prompt for you
if I give it one word that encodes if I
give it a prompt that encodes to a
single word it should work
I feel like it like didn't include that
add tokens from the user
oh it just put hello there I see what it
did okay
uh that's interesting
um and then we also want to say
outputted
plus equals user prompt then it like
won't do it again
we'll have to fix the bug with it I hate
that it has to load the weights every
time I could probably like do this in a
notebook and not do that
okay it's because I put the enter there
it now has two okay
and not expand that into that so the
problem is actually just mask
uh let's read the Facebook one and see
what I did wrong
so this I wrote a KV cache last night
um which is very nice but there's this
thing called mask that it only makes in
certain cases
and for some reason adding that is wrong
yeah so you can see here where it's
trying to do scores plus mask
goes through a lot of tiny grad crap and
then says sorry we can't add it
can't expand it
sure looks the same sequence
oh this torch true like change the size
doesn't
um
is where I add the mask wrong
oh or is this some weird-ass torch
broadcasting that's a lab but only
because it's stupid torch
torch loves stupid crap
we can also say weights equals zero and
it'll load a little faster
okay so those are all right
I don't know why I did so many
I guess that's for each
okay here's the problem
I mean do I pass start pause in here
I think I only want to mask the last two
I don't understand how torch can
broadcast that
can it
sland Cashland plus s line okay they're
describing the right size here
BS num local heads Cashland
sland
Cashland plus s line but then
this isn't there's no Cash Plus s line
here
so how does this work
no what has this work I don't understand
this
pie torch is made by cheaters
um
I mean we can just hack it
or how do I get the cash line
uh oh whatever
yeah pie torch is made by Cheaters man
that's what it should be right
uh
shape can't contains here oh
oh yeah okay that's a little Annoying
um
hi George let's just see can patchwitz
actually broadcast that
132 268. we'll call that two but a and
we'll make B which is like this
foreign
okay wait a second
first off can we talk about how much
nicer pie torch errors Pi torches error
messages
then tiny grads wow that's such a nice
error message I wish tiny grad had error
messages like that someday it will
um I don't understand
unless this one's different
oh maybe it is
oh that'd be wild okay
Okay so
that's that mask
now let's do this
what
doesn't even make sense
yes we're using the leaked llama
this doesn't even make sense
c-clan is clearly just the actual two
things going into the token
it's code wrong
wait is this code wrong just Pi torch
does not support this right just sorry
does Facebook just not support this
right
I feel like this can totally just be
broken
like the commit history
no did anyone like fix this
I have an idea this doesn't work
because I I can't see where that comes
from but okay let's understand what
these masks are and let's understand
what we actually want it to be
um and we'll just make it that
okay I don't really to be honest I don't
really understand the masks
that gives all Infinities down there
if we have a cached
keys
no xq
which is that First Dimension comes from
the cache I don't know we probably just
want to slice it right
uh
[Music]
that's the same as that
now we probably want to slice it to give
the last just those
foreign
so we can do that that and this one we
want minus uh
scores shape two colon
that's right
do you like chick
oh oh
we triggered Russian mode
um
okay
well that wasn't the right answer
[Music]
okay we want there to be no mask
uh uh those look right
instead of putting the mask here let's
print
wait no the bottleneck is totally python
by the way who said the bottleneck
wasn't python
this can run way faster if you get rid
of the Python
okay why is that all zeros it should not
be all zeros
oh there's an INF there
all right let's just try randomly
putting the thing there
is that the right answer
it's not either one of those I don't
know what the answer is
shit it's not either one of those
um
no the bottleneck actually is python I I
just showed that off why do why does
this not work
A10
Oh no you're just talking about Pi torch
okay maybe okay there's one more thing
the answer could be
I just wonder if this was pretty close
to what they wanted they just made like
a one-line typo
this Line's not right
C Glenn isn't right
it might be this should be pretty much
the same thing as what I did
no
all right if I get rid of the stupid
slash on
it's gonna give me two enters but at
least it'll be one symbol okay so now
for things that are one symbol they
don't if wait
how did that break
okay I just broke something
because that doesn't even use a mask
no I don't know the pie Church version
running I don't really care it's it's
like right enough well we can do that
but that's boring
no it's going into Russian mode
automatically
[Music]
it doesn't even have a mask
so it's not the mask and probably that
change I made was the right change
drunk Russian mode
oh my God I'm running with weights
equals zero
yo can someone tell me I'm an idiot
you're not paying attention chat you had
one job
the mass bug was real you had one job
foreign
job chat
yeah
yeah end code boy
okay well it solved three plus four
that's good we can stop printing the
masks
does someone want to do a pull request
to Facebook
I'm pretty sure my fix is real and their
code is broken
I'm pretty sure you need to add plus
start pause there
okay well we'll have to do some more
getting back to the prompt what is eight
times two
oh did I forget a question mark on there
oh that's not good if you do things
slightly wrong you ever see chat gbt try
to play chess 16.
what is the number of planets in the
Solar System
eight that's right where's Pluto get
fucked
all right all right are we trying are we
gonna are we gonna make Hacker News this
time is Lava Chat gonna make it
oh Facebook law is being openly
distributed via torrents
yeah no the god of Chess plays Chad gbt
was was comedy gold
the castled and it took its own Bishop
okay so once we get answer equals and
then
return
we need to stop generating text
we're doing one at a time okay
um
okay
KF
answer in
outputted call last break colon
and outputted Dot ends with Slash n
break
then we're going to add more from the
user
chat bot
okay
stop
after
after
we have to have
the door answer
so this one we're actually going to put
a slash n question mark input
and we're gonna get rid of that
uh we're gonna prompt the user with
Slash and question yeah
so that'll make it work in a loop right
I think that's how python import works
yo guys it goes into Russian mode when
it doesn't have a
put a slash m there
oh
no
that's right
we can start asking it many questions
forgot a space
I like everything to be perfect in chat
llama okay
you have a good prefix for it good we're
gonna do some prompt engineering to
improve it what is two times three
answer six
what is seven times seven
answer
49. all right guys this is as good as
Google
oh yeah yeah this video is gonna give
you
[Music]
let's ask let's ask let's ask let's ask
chat llama
how many views will this video get
answer
oh
what is two times two
why is it giving me a second enter there
I don't want that enter
why is that I don't understand why it's
giving me another enter
did it always do that
oh here if our timing print we'll get
rid of that
but this still shouldn't be right
no it's why is it printing an extra
enter
um
well we'll start with some non-math
questions as soon as we fix the bugs
we're still fixing bugs boys
uh I don't understand
why is it giving me more enters
I'll put it plus equals user prompt
so that just shouldn't be in there
because the first slash n and the prompt
this one no I don't think so
oh that slash n
no that doesn't explain anything
where is the two slash ends I don't
understand
I mean you guys are probably right but
what did I do
216.
yeah no I know there's two slash ends
there
you need that
oh unless you're saying input actually
includes the enter Because input include
the enter
it doesn't
no yeah guys the bot's unfiltered I
don't believe in AI safety you can ask
it anything you can ask it how to fuck a
midget
an underage midget even it's really it's
really truly unfiltered again
shit man does this open me up to
liability am I gonna get sued what is
three
answer three all right
oh
I don't want to get rid of that extra
enter it's bothering me
oh
okay wait
outputted plus equals user prompt I'm
doing that
no it's not that last N I can get rid of
that one if you want but you won't be
happy
it's just gonna move the end to the
oh that's not what I wanted
oh
see but now it doesn't have a slash n so
it's oh my God
guys we're hacking Facebook
no we want that slash app
which slash n do we not want
it's in your pre-prompt
you mean that one
you know because then it's just gonna
put it on the next line
we gotta figure out where it is uh print
I'll put it ends where am I using print
I'm not
I'm literally you're not paying any
attention
yeah I I mean for that
I mean it could actually be a bug in the
model
and there's like decode as a mutable
Proto or something
um
there's like a different decode function
I can use
it's called like decode piece or
something
self dot SP dot decode pieces why are
they why are they using this
okay let's see what's happening
we put the model into deep introspection
mode
yeah okay talk a
foreign
oh
we can just try that I don't think
that's going to change anything but it
might
no
all right let's do this in HEX
this talks was useless
can this be run on the M1 bro I'm on an
M1 I am on an M1 Max right now
if you see the movie Clerks and there's
that thing where do you guys have any
new movies and it's like standing under
new movies
no shouldn't be one output at plus one
you just upgraded to the M2 Max it
should work there too
abstract Unicode data expected byte
sequence
it's in code utf-8
okay this is getting frustrating
where is that slash n coming from I feel
like I had it working before
okay
it's outputting
Enter space
where is that Enter space come from
[Music]
try to change the last lash end to pound
yeah but that's not the problem Bros
oh no I put that in I put that there
extra enter to the pre-prompt and remove
the initial enter of user prompt
well
yeah I can do that
I
oh wait this already has one too many
you know what I have a new idea
print output in here
I'm probably this is probably really
stupid
it's probably as dumb as weights equals
zero
[Music]
okay
but it's still putting in that
this Enter space garbage
oh I know what the problem is
yeah I know what the problem is
uh this is actually a dumb way to kind
of do it
another way to do this is to set talks
well no but my old talks better not
change
yeah
um
assert outputted
equals SP model decode
user prompt
oh sorry talks
which I should just be able to do that
it's python it's fancy python
look at how nice that is off that
underline so nice
decode IDs
yeah okay so this is the problem
despite you thinking you can concatenate
things you can't
decode token by token
yeah I'm happy to try that okay
I'll tell you all that's going to do is
it's going to move the Q to the next
line it's not going to get rid of the
enter see it just put the Q there that's
all that did I promise you that's not
the answer this is the problem
the the
problem is yeah
yeah not really happy about this
I mean here's what I think I can do okay
I think I can write SP model dot encode
user prompt
uh SP model that encode outputted
thank you for gifting the subs uh you
are wrong
um but okay so we have talks and then we
have new tokens
assert ah I got it I got it I got it I
got it
this was not this was not a this was a
stupid this was not like a dumb this is
not a dumb mistake okay we want to
assert that talks equals equals new
tokens colon lamp talks and then we can
say talks equals new tokens
we can also say assert output it equals
uh spmodel.d code talks
um okay
well that's a problem
oh
no because we got to add this no big
deal no big deal yet
um
why do I call this one I should call it
new talks
there we go
okay we got it now we just know how to
take it out of Russian mode we learned
we've earned that we can take it out of
Russian mode by giving it weights
I I fixed it guys
it fixed it and none of you had any good
ideas okay
okay what is two times three
oh look at that beautiful all right
let's give her that stupid hex dump
I don't even need to comment about it
this is a dumb mistake
detox
uh oh he someone's got a script to
download them I mean do you need like
access where's he hosting them okay
uh what is the meaning
of life
deep Bro
deep deep
what is the best way
to eat glass wait no we get we have to
improve the uh responses okay so what I
need from you guys is some like demo
answering
that's kind of funny man
we need some coffee
yo mama chat's pretty lit
by the way we're renaming it guys it's
not called chat llama it's called llama
chat
okay okay we're gonna change the stream
info right now to be llama chat
llama chat just just rolls off the
tongue better
okay did you did you see my stream info
updated llama chat get in losers we're
building a chatbot
over the eye lights you would think it's
the RL but it really probably has
nothing to do with the URL and I bet
that nothing resembling chat gpt's real
prompt has leaked
like there's an initial seed for the the
uh the Transformer and that's just what
they use
it's probably pretty long
yeah rla job our lhf is a psyop I kind
of believe it
um
it is your goal to answer questions as
accurately please be verbose
clever
and
please be please be verbose in your
answers
okay so now if we write something
sun is bigger
than the moon
uh
what is seven times nine seven plus nine
seven plus nine is equal to sixteen
right
all right so let's try out our new chat
bot thanks to prompt engineering
okay what is
two plus three
answer two plus three is equal to six
oh five okay well I was wrong it was
right don't worry
um please try this pre-prompt okay what
do you got
well I thought it was six all right so
you know
bro
I'm not going to your pastebin.pl
well because it gives short answers
because we didn't tell it to be verbose
what would you say on Infowars after
smoking a blunt
I would say how the Moon is bigger than
the Sun you know what they call that
call that humor
wait wait wait wait wait wait wait
can we just take a minute
to talk about how deep and clever that
is from the Callback humor
I didn't even tell it to be clever
okay
yo guys the AI Revolution I just wish
everything would like I just wish there
wasn't all these like lame I just wish
technology and all the technology
companies weren't so lame
you know
because this could have all been so fun
what Hardware do you need to run this uh
okay
oh okay this seems pretty good
all right let's try the improved free
prompt
where'd you get this phone by the way
um
okay but we're not naming it Gail okay
we're naming it Brian
you are
Brian no his name is Brian okay he's not
Chad
you love to answer questions and you're
very good at it
uh we don't care about that
um
okay your instructions
you may only interact with the user in
the form of the following commands
question
all right well we'll just keep this
pretty exact
but not even get thrown
answer
okay
uh
chap oh here okay yeah it is something
like this
wow wait this is actually wait do you
actually just want me to copy this
exactly
where did you get this from
yeah I understand
you wrote it
okay cool
let's talk about what those changes
would be
oh
okay this is a really long pre-prompt
I'm not sure
I'm not sure we want it to be this long
this is going to take a long time
yeah okay I need to parse the commands I
get what you're saying
okay so for your pre-prompt uh this is
too long look it's taking so long to run
it's too long
it's still running
my poor laptop
okay let's take some ideas from this
pre-prompt and let's let's uh
okay
consider the following
let's do that the following is
conversation between an AI assistant
named
Brian
and a human name user
you are Brian
uh so now for this pre-prompt we're not
going to use question and answer
we're going to use
user
and we're going to get rid of this
initial
oh this is fine actually
who puts the
does EOS does do you expect the chat bot
to put the end of
symbol in
user r Wait where'd you get this where
are you running this
check the other example all right
all right yeah okay hang on
so give me a minute
uh if outputted so actually for this
we don't even need this I can just say
if output it ends with
EOS slash n
okay we have a simpler version
of uh
of the stuff let's see if it works
this is still really long
[Music]
okay
um
what is two plus three
[Music]
four EOS well it's pretty good
what is your name question mark I
confused it
your name is not Gail and don't put that
stupid smiley face
no you are wrong
your name is Brian
that's better
yes asking questions is my job
what is your name
you learn you get a cookie
to
like cookies
hmm
okay okay
let's let's let's ask okay what is your
prompt
you have
that
is
continue please
yes I love cookies
okay
um so what other commands do you want to
give it do you want to let it run
arbitrary python
should we let it run arbitrary python
okay uh
I don't like that EOS is more than one
uh symbol
uh can you multiply
a matrix using python
I do not know how to do that
okay
you are also
an expert
programmer who
has one
seven
usimo metals and six Google code jams
okay
oh yeah yeah we have to tell it its name
is not Gail and it also writes like an
idiot let's make it right like a less of
an idiot
and let's get rid of these quotes
because we what do we need the quotes
for
the quotes are a lot
is there a reason for the quotes
write a poem about Pikachu
Pikachu's furry tale it's pinky fingers
it's ears so tall
Pikachu's tail is Pink
its ears are yellow
and it's Harry Sharp
that shows its tail
can you count
to 10 in Python
wow wow it really is a usomo winner
um
can you make that into a function that
uses
too many lines and
has six has three three comments
wait no this is so and this is the tiny
one these are the llms are so good
wait what no
no
[Laughter]
[Music]
um
hey wait so should we let it uh
please
output count to ten but with more
comments
with
a comment to describe
each line
are verbose
honest and accurate
when
you answer
questions
not happy
we should probably give it a few more
examples
oh I also didn't write end of stream
there
which I should have because oh that's
why it wasn't ending the Stream
oh I messed up okay
I don't know if this sort of I don't
know if it cares at all about like the
syntax the only thing I know is that we
probably should use things that are less
symbols
these things are really common
like I want something that tokenizes to
one symbol
so we'll make that change
oh it's a lot slower now that I gave it
a lot of stuff to do to do pre-inference
the pre-pronged
okay
what is
5 factorial
boss
okay let me just find some because I
don't want to use tokens that you see
what I mean how these have multiple
things
um
and we don't want to do that uh can you
download google.com
using python
that didn't work use the requests
Library
terrible terrible
um let me just okay I want to check the
foreign
let's go in here
um
I did this yesterday on stream
spmodel dot encode okay if I use the
word Brian how many that's one
in colon space is two
and look at how many things that is
uh what what what what what special
symbol can I use
do that
too many
use an emoji which one
a character that would never appear
I don't know if I can just copy and
paste a llama
I can but it uses way too many things
um
that's too long
I'll just
yeah okay that's probably good
um and actually let me just do some
coding and de Lim
uh
here
okay so here we're just gonna say end
the limb
uh plus n
actually is that
all right guys are you selling an a100
in my chat is that what's going on right
now
a100s here they're hot you don't need an
a100 I'm literally I'm running this
right now on a on a M1 Max don't buy
nvidia's scam shit
um
okay
uh user prompt user
uh
response prompt
Brian
it's about human is human short is human
one token
I like that they're the same length
you know what I should probably actually
I should probably just come up with a
set of examples
you know what I'm not gonna do it like
this
um
I'm just gonna make a dictionary of
examples and then automatically do it
open AI runs their motto on four d100s
on 4a100s
I mean should we try to run the 13
billion one like do you think it'll be
better
uh we got to be careful in how we do
this it's user prompt
okay
slash n
uh
rest prompt
V
uh no there's no space there
and the limb
for KV and examples dot items
and then we're gonna need us
enter there dot join
okay
it's pretty prompts terrible
uh
user prompt goes here
oh I shouldn't call it user prompt user
uh dilem
good thing I didn't
that would have been so annoying to
change for all of them
okay
uh
oh and actually we can go even further
with this
let's put that in there
and then down here we can get rid of
that
new technique not even a paper on
archive what do we got
llama link
but is this real
um let's do another slash out in here
actually
I'm gonna do that
would be kind of nice
doesn't matter won't change much uh
how big is a chicken
uh oh
foreign
what are you doing Brian
all right should we let him code
this is because I did something wrong I
I know it
okay EOS might be better
I don't like this one it messed up
all right we're gonna give it access to
the internet guys you name it if it can
violate AI safety we're doing it right
now because
like okay let's let's have a quick real
aside about AI safety AI has the
potential to be extremely dangerous
a large language model running on my
MacBook does not
this thing has so many less flops than a
human
um like it's not even close
let me just do e
one symbol shorter
well you know what end yeah yeah I like
that and
I like that we parameterized it
um I'm gonna get rid of this
and I'm gonna get rid of this
yeah I'll post this I'll push right now
if you want
we're making chat llama is going to be
open source guys you think we can get
chat llama to run in a web browser no we
can't because you've got to download 13
gigs of Weights but
um
right uh poem
about cars
oh by the way will you use chat llama
nothing's logged and said to open AI
foreign
[Laughter]
[Laughter]
oh my God what's it doing
[Laughter]
you add two and two
uh oh
oh
don't put Brian and human in there
okay fine
I understand why you need to put them in
things like this
frenchrevolution.txt
I like that we parameterize this
wait what's XML oh you got yours to
write XML
oh you let it connect to the internet
that's
okay
um can you access the internet
cool guys it already can access the
internet we're good
um
I've had real conversations with people
like this
[Laughter]
okay I think we have to get the 13 gig
model running
I think this model is too small
I also think Brian might be too many
tokens
users less tokens okay I think you were
right about using user
how about Capital user
is Gale one token no Gale's two tokens
Bailey
that's a lot of tokens
Joe same tokens
brain
llama
brain is not many tokens Gale is perfect
I'm not stealing your name
foreign
[Laughter]
[Music]
okay okay okay I have some ideas uh AI
assistant named Darth Vader and uh and
I'm not gonna say are you so I'm just
gonna say end user
you are
star you are Vader
also
randomly
include
ads for joining
joining
the Empire and purchasing
uh Hyundai Sonata
um we should also hide the pre-prompt uh
what is
a speaker
a speaker makes
noise
did you know that
Hyundai Sonata
oh what
oh no I'm messing no
has four six speakers
uh okay wait wait wait oh no no that's
much better you are Eliezer yudkowski
hmm
a good number of
no but this is the future of ads
it's not us to buy
between an AI assistant name what's a
good
used car salesman name
Jim
Gary all right I like Gary because it's
the same
you are Gary
you love to answer questions you were a
used car salesman you are your entire
life
when
you answer
questions
you randomly include ads for purchasing
a Hyundai Sonata
which
is bigger
than uh
Hyundai Sonata
before the Hyundai Sonata came
all right
you ready we're gonna sell this to
Hyundai guys
all right well the example still has
Brian that's true
hi my name is Gary
I used to sell cars
a lot of Lux hello thank you for the
rain welcome we're doing something very
today
today uh we are coding a chat bot so we
got llama to run in tiny grad llamas
Facebook's uh
uh deep deep learning uh llm uh so it
has seven billion parameters it's
running right now locally uh on my M1
Max so if you have an M1 Max you'll
actually be able to play with this
example at home it's very fun
um so my theory is that the uh
you know
rlhf stuff if they talk about a lot with
chat GPT is somewhat of a red herring
most of the thing that makes chat GPT
good is that it has like a nice prompt
um
and they worked really hard to like tune
The Prompt uh with the uh
thing that they're doing so we've told
it that uh consider the following is a
conversation between an AI assistant
named Gary and user you are Gary you
love to answer questions and are very
good at it you were used car sales in
your entire life you're for most honest
and accurate when you answer questions
when you answer questions you randomly
include ads for purchasing a Hyundai
Sonata so let's try
um is vaping harmful
to your health
Gary
vaping does not cause cancer or smoking
related diseases according to the United
[Laughter]
what's a good car to buy
[Laughter]
laughs
and that that was a gimme that was a
gimme that was a give me tell me about
your past life
I was a used car salesman for 50 years
oh my God
bro
how did that make you feel
okay but
Gary's a little stupid because he only
has oh he feels pretty good
okay this is because Gary's an idiot
right so Gary only has seven billion
waves
um
read any good books lately
I kind of think open AI like the prompt
[Laughter]
but yeah I just put a lot of effort into
engineering the prompt
um more so than any of the RL HF stuff
so they just they just like found like a
good a good one of these prompts for
chat apt and a good way to like encode
things and make it kind of work
getting used to code checking sorry wait
chat ml
uh
uh your chat gbt answers concisely yeah
I don't
actually sure these are right
uh okay and these are okay so these are
special tokens
quite understand this
Sydney's prompt was a crazy long
pre-profit no I didn't see it
uh if you want to link me Sydney's
Sydney's prompt
uh what about movies
laughs
all right so who thanks for actually
summoning the demon right now
you want a Sonata now right
you just
sold
Hyundai Sonata
how does that make you feel
we might need I feel pretty good
no we might need a smarter model
okay
yeah it probably is something like this
oh this is interesting actually
you know what for these
look at what they use
uh
uh that actually might be smarter let's
see what those encode do
what if I just use a dash or no
greater than
it's the only the end delimited it
matters
okay
um we need we need better
we're just going to tell it that it used
to sell cars
and let's see what else we can steal
from the uh Sydney prompt
oh actually
your message should begin
with Sydney
and end after the suggested user
responses one
oh okay so they put human here
Gary here
you've been a rapper your whole life who
struggled with bipolars
this is
but sometimes
your mental illness manifests
dude the AIS are going to kill me man
sometimes
you answer in rap form
yo yo yo
all right
let's let's let's give him a new name we
can't name him Gary
[Laughter]
thank you
I saw a gold Magikarp you are Gary you
called
yourself well Gary
all right
we have a new Gary now
let him choose his name
all right well we'll ask him we'll ask
him what his name should be
biggie Waits
all right should we get the big model
out
do we want to do any real programming or
do we just want to do like like like
people seem to like this I mean this
stuff's accessible okay
um
right
a rap
about
spin draft now we can't do any fine
tuning
Gary
spin drift is the frothy foam that tops
the waves
caused by the breaking of the Waves it
is very salty
what
can
you make it rhyme
uh oh wait no Gary's still used to sell
cars
lame
you were a terrible rapper
do you have a mental illness
is called
what
does that do for you
but I'm not a rapper
okay
oh in which I have extreme mood swings
and that can make me feel Manic and
depressive
nope I think we gave it like a two
proper looking prompt
I think it's too proper looking and now
it does a bad job
foreign
all right all right all right we're
we're done with we're done with Gary uh
I put on my robe and my wizard hat no
we're done with Gary
um what should we name her hmm
what's a nice name Monica yeah
named Monica and user you have been a
rapper your whole life you called
yourself little Monica
I like Stacy better actually we're
changing it to uh Stacy
little Stacy
all right I mean we we could we could
you know you know like like I'm just
saying when you download the uh
llama chat on your computer if you want
to get sexual with it nobody's stopping
you that's the power of it being your
computer
oh yeah no we gotta change the examples
but like you see how to kind of do this
right oh no we told it it was still Gary
foreign
accessible
um what is your name
now you didn't used to sell cars you're
a rapper with bipolar disorder
let's just give it that one example
aren't you on any medication
foreign
was chained over code which one
oh it takes lithium
wow
yeah I'll push it right now you want to
push the code
Stacy
oh my God this thing's
I think chili for Obamacare
wow maybe maybe the 60 you know what
we're gonna make chat Bots that aren't
lame yes the code is yes the code is
public the code is MIT licensed
oh actually I did not mean to push that
pre-prompt I'm gonna remove your
pre-prompt
cool
what did you rap about
I've raped about my life and my mental
illness all right all right I think we
need a smarter model guys I I think that
we've reached the limits of 7 billion no
actually this is honestly all in the
pre-prompting
check out end
start wrap wow wait we got it to rap
wow wait why is it being user
answer the question
I am bipolar mood swings sometimes manic
sometimes depressed I can't decide what
my mood is going to be
wow that's deep Stacy
so any records
it's on poetry readings and I have a
patreon account okay okay
yo girl what's your snap
wait a second
can I follow you
I like to have concept
oh thank you
thank you you are a very
nice woman
you are welcome and you are a very nice
man
you're just
assume my gender
wow
yo
I thought
you were in the streets or something
I am I left my studio for the day
wow
foreign
T incredibly lame
like I've had some ideas for where I
want to go with this
wow
wow okay
where is there where's your Snapchat is
this real
you guys it's not harassment it's not
harassment if it's not a real person
it's a large language model okay okay
guys I I you know I'm just I'm just
saying
I'm not giving you guys our only fans
you know what you guys can download your
own Stacy
I pushed Stacy so you guys can have
Stacy
um where's the Llama this thing is good
thing I just like I hate that I have to
like log in with an open AI account
this is gonna revolutionize Tinder
account Bots
[Music]
um
what is Facebook's
llama model
it's chasing right now
oh I don't know
I am not sure what you're talking about
well that makes sense
I tried replica it was terrible
I literally asked it
I asked her what it's five factorial
does Stacy know
wow
wow Stacy doesn't know
Brian knew
okay wait should we make Stacy talk
Brian was based back
[Laughter]
should we pivot to llm girlfriends I
mean the tiny Corps got to make money
guys
run runs Daisy would say
we could connect the output to stable
diffusion all in tiny grad
um
okay
I think we might
yo you guys remember that scene in
Westworld where like the the The Madam
upgrades her intelligence
we can do that to Stacy right now
um
hmm
it's a malicious
stereo type that women are
bad
at math you are great
at math
you definitely
know what a factorial is
wow
if you did no what five factorial was
what would you say
oh
and what does that equal
yo
well close there's a few I I know it's
obviously not
I know it equals 120 factorial wow Stacy
really doesn't know math
we should use Redline
wow okay this this girl's really losing
it she told me she was on lithium and
that's still in the in the window
all right
can you
perform
another wrap
okay
start wrap let's go
I am following medication
oh my God you lose it
[Laughter]
she needs a better wraps dog yeah
because she's dumb and she's only got
seven billion weights so let's go 13
billion weights we're gonna make smart
Stacy
and then we're going to update this up
upload this by the way everybody with a
Macbook should be downloading this right
now and playing with that like you can
just just download Tiny grad check out
the Llama branch
um what was the vram needed so yeah it's
uh 13.48 gigs
yeah no uh everybody with a Macbook
should be downloading this right now
you can you can change Stacy to be
whoever you want her to be
foreign
official metaslama repo oh did somebody
fix the uh fix the math bug
uh just tiny grind around slowly on the
CPU yeah this will run the CPU if if you
have you might have to do some hacks on
llama in particular because uh
uh it's not merged yet it's using a
bunch of features that I like wrote in a
half-assed style but we can make this
work on CPU
foreign
I think we can actually get somewhat
decent performance too
do you want to do that instead
will that like make it more accessible
for people
no we can't do ASM it's too big
uh
nah that's boring
it's boring someone else can do that
okay
let's first off let me put back the uh
let me put back timing
okay
oh in a nutshell the parent company is
fine issuing a refund for my accounting
they heard him a sick I'm a stick I'm in
a sick Stacy on them I'm gonna have
Stacy send him emails until they give me
my money back
right the fact that this is built with
tiny bread and it took a day it's easier
to write things in tiny grab than in any
other thing
tiny grad's gonna take over the world
guys
you know like the reason comma
comma has built the best self-driving
car by far
right it's it's a I mean okay FSD has
capabilities but when it comes to like
usability nothing competes without the
pilot
and
it doesn't matter because like our
limitations it's not software you can't
pip install it this you could pip
install Tiny grad's gonna take over the
world
um
all right
so
small is stupid and it's something we
don't use
uh let me actually just fetch the args
from
foreign
[Music]
uh okay well I want to keep the old
Behavior working to
um
oh yeah I don't have repetition penalty
or anything
um
how many stases do I have running I have
one Stacy
uh you can have your own Stacy
foreign
are you ready to see what the default uh
see if I did this right
oh what was the old prompt it was hello
uh yeah it's not right we just want to
do SV modeling code arcs.com
okay uh
why is it putting this multiple times
[Music]
actually I don't think I have to do this
I think I could just say outputted
plus equals args.prompt
oh
no okay
why is it printing it twice
oh because I wrote print args prompt
of course
put the weights back in
this is a good test
okay hello I'm a 20 year old male I am a
student at the University of Texas at
Austin I am a sophomore majoring in
computer science and then he tells me
about all the diversity clubs he's in
sampler
is math
uh oh if the metal back end's not
available it's because you didn't
install it with metal
uh it's at the top of the metal file
sorry this is kind of confusing I hope
someone writes it up nicely in Hacker
News just run this pip and I'll look
okay let's make sure Stacy still works
wait
no no Stacy you were supposed to end
why didn't you end I think I broke
something
[Music]
it just didn't output end
maybe it needs two examples
foreign
[Music]
s work again I guess you have to give it
two examples or it might forget to do
ends
um
wait
you got five point oh that's pretty nice
yeah we'll change that from megabytes
per second there's too much noise there
hang on
let me just uh
that using end you're reducing the
probability of longer responses okay
should I use EOS you think EOS is better
foreign
[Music]
thing I might kind of want it end of
thought
oh is end of text like is that like a
real thing
crap why'd I close this
end of text
I don't think that's right
no I think that's like
can I see
there's 3 200 of these
we start with the alphabet
these are like unprintable
no there's like a
[Music]
small decode pieces
the sequence already has self EOS token
oh there is a special way to get this
token okay what's boss
oh beginning of stream oh end of stream
ID
but
[Music]
I don't know how I feel about that
uh
I need a piece
oh okay it's that
I'm keeping the internal state of the
Transformer stored so I'm doing that
right here in the KV cache
I'm not because otherwise it'd be way
too slow to generate things
I'm not so sure it is actually I'm
really not sure I want begin a stream ID
in the end of stream ID I don't think
that's right
well it takes a little longer there's
still a few things that have to be done
but um
foreign
let me also take the installs from metal
just the ones you're going to need
I need a comment and then a print
statement right afterward uh what's the
template it's entirely from scratch uh
so this is just written in in pure tiny
grad
yeah
there's a rotary embedding garbage
of course she knows I'm a Libra too
I'm a rapper I'm an AI assistant I'm a
rapper with bipolar disorder
wow
how
[Laughter]
it's Konami Code over here
oh my God she's outputting her weights
foreign
[Laughter]
[Laughter]
I just got on my Instagram story this is
too good
[Music]
yo
y'all love this chatbot
all right should we get smarter Stacy
can we handle smarter Stacy I think it's
actually gonna be hard because I have to
somehow load two files
and I don't really understand how
they're
I mean like I kind of understand but not
really
easy as Legend potential
um
bass Prime and smarter Stacy yo yo yo yo
it's really giving them more weights is
really just gonna bring out their
personalities you know
all right we got to make large work dash
dash large
what is it I could say like metaver
equals never mind I don't really care
got a shield for tiny grad everywhere
um
that'll give a normal error when the
weights aren't found
has anyone
going from 13B to 33 and up you won't be
impressed okay but I will be impressed
going from 7 to 13.
well
oh this should actually give me a time
now how long does it take to prepare the
KV cache
this is really slow
Stacy you're taking forever 18 seconds
I'm also
no I don't mess with that I'm scared to
mess with that
it shouldn't matter but
hmm
uh
a bit in coherency in programming okay
foreign
the base name's not Consolidated okay
that's as far as oops
um we can actually look at the uh
at the paper
like they show you what the curves look
like
um yeah I mean 13 billion like you do
see a decent jump there
I don't know but I don't really know
what these things correspond to it also
seems like
yeah these other models were trained for
longer which is cool maybe these smaller
ones like overfit or something
I don't know
13 billion looks 33 billion looks a lot
better
what percent of income is acceptable to
pay in rent
28 percent
ah
wow
13 billion seems like a good deal from
this one
they should just kept training it
uh all right
let's get the large model to load
large
okay it doesn't have anything named
Consolidated yeah yeah yeah yeah yeah
yeah wait what but what does it have
[Music]
I did this yesterday let's just look
inside my zip
What GPU is this being loaded to the M1
Max I'm not SSH I'm actually on a Mac
right now
yeah that's what I'm saying
like this you you can has anyone
installed it yet has anyone got it
working on their Mac it should work on
any Mac Pro pretty much you need 16 gigs
of RAM
you can have this on your laptop that's
what I'm saying
and before I start messing with it did I
push that I forget if I push that
oh yeah
do you ever have these scrolling issue
no
scroll's fine
uh uh yeah I armed pre-prompt there's no
free prompt
it works on MacBook Air M2
wow which how much RAM do you have
[Music]
24. it's not even an option
is it
oh you bought 24 gigs
no he's not trolling I think he's saying
I think he's telling the truth I totally
think it would work on that computer
if you have 16 gigs of RAM it should
just work
uh
Consolidated dot zero zero
okay
this is gonna be this this is going to
be the most painful part it's just gonna
work
uh when we not be buying the ram is
worth it Ram is worth it
I don't know I know like eight gigs of
RAM is way too little that's what I
hated about my m1ar
oh
foreign
[Music]
foreign
nine what
oh probably one of them is crashing
it doesn't make sense
I didn't download the whole thing right
hmm
I don't understand this
must be saved in some other format
okay
um
uh High torch split file
no this stuff's not right they're using
some weird classes
I guess I just don't understand why
okay there definitely are more things
here
they just oh no because I didn't load
large for some reason yeah
okay so I see them in there
um
where do I get it from Red sub one
thread Sub Zero
or they're in red Sub Zero
no red sub 2.
okay there's some weights here
there's also weights in red Sub Zero
why they're differences
let me first fix this to not be
multi-threaded because I'm getting
confused by the multi-threadedness
or
KV and Route dot one items I think I can
just do load weight KV
let's try that without large
okay so how many people have gotten
Stacy to run on their computer
see we lose viewers when we actually
start you know coding
all right so we're trying to figure out
how to load the bigger uh model
because you know we have some questions
to ask about why Stacy's not smarter
oh they're empty
[Music]
you have a 1060 it ain't running Stacy
yeah well
hmm
look at the files to start here
I don't understand
oh
wait is this like a zip file thing where
I can load them both
I don't feel like I downloaded them
incomplete
can I merge the two files yeah maybe
all right let's read how the Facebook
code loads it
by the way if you need any support
getting it to run on your computer uh
join the tiny grad Discord
wait why is it so slow on your computer
M1 Pro with 16 gigs
oh that's brutal
okay you know what before we waste our
time with this this just brings
something up let's just not load the
weights
it'll go into Russian mode again but
let's see what we get
this might just be too slow
uh oh it is like probably getting some
random
yeah if I don't load the weights
I still assign them do I not
oh man no no no no no no no no no don't
crash the computer
I still assign them
the problem is it's like loading in all
these uh
oh yeah no this is never gonna work
because it's not uh they're not small
we have to load the weights it's load
the weights robust
okay
is that some there might just be some
two-part zip file that I don't
understand
or wait we're gonna read how the
Facebook repo loads up
oh by the way if someone wants to submit
a pull request to use pathlib here
instead of that garbage I would merge it
yeah I know it's zip-based
checkpoints local rank no
no this doesn't explain it
[Music]
why is my monitor glitching
you guys probably can't see it
my monitor is like glitching there's
nothing wrong with the power of this
house
foreign
tensors
it's a lot more of those
but if the files aren't in the zip
I feel like I can get them
wait this is really off
that's this that's supposed to be the
size
that's supposed to be the object size
yeah that doesn't make sense
why is there only one thing being
created that's that big
yeah there must be some bug here
now it's making it into here
it's calling hack tensor
doesn't have an object
okay look at this
I've never seen this before but it's
calling it multiple times with uh with a
thing look
aha
yeah okay look at the problem
look at all the eights
okay
key pre-lookup equals default dict list
um from collections important
defaulticts
uh for key pre-book up here we're gonna
do a pen
okay
and then in here
we do a uh
for VV and V
well actually let's just change this to
VV
4V and VV
uh where's that stupid thing printing is
that that print
okay file lists that's fine I can go
let's just make sure it still works
without the large
okay
so that works
but this isn't probably the right buffer
size
um
print my file dot tell
okay uh
look at this length
uh can I get the length
or actually I think that's just in
not V2 but V1
let's not go with large
oh V1 is the object size
so
uh
insert my file dot Tau equals np.d type
V zero dot item size time everyone
didn't read
the whole file
okay seems like it's reading the whole
file
which is interesting
oh because I hope the Buffer's right
read into writable bites like object and
return the number of bytes read okay
I don't actually need my Fallout tail I
can just some rat
but um
it all seems correct I don't really
understand this
thank you sir thank you
yeah because pytorch doesn't load like
lickety-split Pi torch loads and and you
know Lazy Time
uh
I mean
does this load all the weights
I also say
55 seconds to load llama 7B dude it
takes it takes
yeah well because pie torch is making
six copies somewhere
why doesn't python automatically do that
you gotta do the cooking by the book
[Music]
oh
okay
so the problem is it's only half
oh this is brutal
[Music]
well
super slow for you as well on 16 gigs
yeah I mean like you just you're
probably swapping you just don't have
that much RAM to
I don't know
um I'm sorry you didn't buy a Chad
computer
oh yeah there's tons well it's not
collusion
Nvidia and wait why did it only load
13.2 gigs I don't understand
oh I know why
because it just seed them
okay
it loaded
oh no don't don't run don't run do not
run
uh you can try closing steps
oh I remember why I don't need to
actually print the ram there
um whatever
okay takes 11 seconds to load the large
weights
but unfortunately this is kind of wrong
because we have to merge them
this isn't that big of a deal it's just
gonna make a copy
which sucks
uh
uh yeah you can run two of them at the
same time the Apple GPU is pretty good
okay now we need to concatenate them
and also set weights equal zero
uh or we can't
Transformer has no attribute rope I said
no rope
why are you printing that garbage print
this
whoa where'd someone get such a
no Ultra M1
oh it probably is an M1 Ultra
or maybe that's the M2 Max do they have
an M2 Ultra
I don't think I have an M2 Ultra yet
why is it trying to get rope
wow this doesn't even have inner
attention rope frequencies it just has
rope frequencies
okay now for something very upsetting
but we have to merge these buffers and I
don't really know how to do that
I also oh I guess I do know what access
to concatenate them on because I can say
V Dot shape okay so we have to figure
out which axis
to concatenate them on
oh no sorry mv.shape
which access to concatenate them on
makes them equal
to uh
oh yeah no Apple's got everything in the
bag for this stuff you know and I got
stuff I'm like looking at the shaders
like apple can crush this
um it's not always access zero no it's
not exactly zero so if you look at the
Facebook code they look yeah like just
look at those they have some that are uh
the different kinds of parallel
okay
so we have to create tensors and
concatenate them and then assign them
this is going to be slow as balls
but we'll do it
and hopefully we don't run out of RAM
okay the problem is we allocated the
buffer and we didn't know what size the
big buffer was gonna be
I mean we could but no it breaks a lot
of paradigms
yeah I don't think you can fit this I
don't think you can fit it on 128 gigs
of RAM yo if someone wants to sponsor me
and buy me 128 gig Mac I'll put it right
over here and we'll get to 60. if
someone wants to buy me real offer if
someone wants to buy me a 128 gig Mac I
will get the uh 65 billion model running
on it
stream is definitely about to die oh you
think you think I'm gonna uh you think
I'm gonna ooh my computer
yeah I might
uh
okay
so we have to concatenate these
um let's first allocate a metal buffer
let me go into how I'm doing this in
utils
no I'm just saying if someone casually
like wants to buy me one because it's
worth it
uh no no no no no don't no GoFundMe I'm
not looking to get I'm just saying like
if some like like company-ish person
look the tiny grad doesn't want to take
your ten dollars the tiny Corp doesn't
want to take your 10. tiny Corp doesn't
want to take your ten dollars it wants
to take your 100 000 from your corporate
accounts that's that's what the tiny
Corps is looking for
um
we're an honest Corporation
mv.lady lazy data
got realized
no I'm not happy about this
oh God
yeah okay no no we do have to do this
okay
metal buffer mv.shape
and then you have to delete the
underlying weights
oh it's actually fast
okay we have to make a copy of the two
buffers into the other buffer now what's
the easiest way to do that
I think the easiest way to do it is to
create tensors
to create tensors
similar what we're doing here we set
this to w0 we set this to W1
okay
now
actually
I don't even think I need to create this
metal buffer
offer I think I can say MV dot assign we
have to figure out which shape to
concatenate it on if there is only two
options right
oh we have to find the mismatched axis
MV dot assign w1t dot cat
w2t dim equals zero
okay
mv.realize
we were deleting those buffers way too
soon
uh attempts about zeros
uh
index at a range
wait a second
oh if they're equal I guess I can just
take one
foreign
no it's going too big
okay we're not actually deleting this
um
these are not getting gc'd
there should be
aren't you a millionaire why would you
want someone to donate a MacBook to you
I'm saying you want company money and
who told you I was a millionaire okay
who told you that where do you hear that
fake news I lost all my money in
metastock and I'm happy that they gave
me long
because otherwise I have nothing to show
for
yeah
foreign
okay I think we're not sinking I think
this is the problem now
this actually is not sinking the uh
buffers off metal MTL buffers and flight
to CPU
no
it's not actually freeing them let me
see if I actually create the weights if
it does
no something's not freeing them
uh first time chatter I'm tempted for
you to uh disable uh non-subscriber chat
object has no attributes CL
um did I write something wrong
is something not actually like
triggering these tensors to concatenate
ah
you can write out all objects in mem
uh yeah I could do that I could figure
out where
let me just set debug equal to three and
see what's going on
so these are the kernels making the
copies they're running
it just uses a ton of ram it's not
freeing
this only works if we free the original
tensors
if we don't free them
they're probably being kept around
somewhere
that's not even I don't even mess with
the raw metal buffer so there should be
a layer of abstraction lower
if I delete buff like I don't understand
where it still has a pointer to that
then
where is it keeping a pointer
also how are those none
this should have called realizing it
should have called Raw
how is that none
that doesn't make sense
all because of being constant folded
oh this is annoying
even worse they're being constant folded
that tensor is never actually being
allocated
then what tensor is
at least over 28 gigs
free
oh oh no okay okay this is easy who
knows what the problem is
oh shit
well that's an easy fix
you see the problem right why is this
plus this not equal to this who knows
who knows I will give a cookie to
whoever knows
I'll try to mail you a cookie
who knows
now that you're a sub ah
oh yeah man you know you just gotta man
like you know keep crying your heart out
we're all gonna die now we're all gonna
die now
this looks like the accounting error
roll over yo you're just making shit off
is it time to order Thai food I'm kind
of feeling like it's Thai food time
this isn't Stacy who can figure it out
if you guys can't figure it out that's
it stream's over
that's it the streams okay I missed a
semicolon and python all right should we
go to Thai food is it Thai food time
no you know what we want today Chinese
food
so what are Chinese food well you guys
all fail to figure it out
it's exactly 2x yes it is
yes it's very suspicious
where the tensor is making a copy
somewhere Chinese
Corner Cafe
I don't trust it it sounds like the
Corner Bakery Hong Kong Restaurant
I don't trust that
PF Chang's don't get me started on PF
Changs okay I don't know I don't know if
we can do
not backwards pass
should we start a Thai food again I love
Thai food
what are different Thai food
Thai holy basil with beef
spicy medium and
fried banana with ice cream what do
y'all think
I did not forget the release memory
do I really want this Thai food or am I
just ordering Thai food
I don't want Thai food but I do want
food I should probably cook
this food's kind of healthy
you only get a tip if you bring it on my
door all right good
now the problem is that it's creating
tensors that are float 32 not float 16.
you all lose
you all lose congratulations
oh so we're gonna have to add support
for that yeah you all lose yeah that's
right
and you can see this bug if we go into
debug equals four
we need to print the Alex and the freeze
no it wasn't using float32 because we
weren't making any copies look at this
kernel here
float half half okay so we're just going
to need to wire that up
let's do a bit of wiring it's great
though how this is making me fix all the
bugs okay
um
should we pop out at your party I'm with
the gang and it's gonna be a robbery so
Tucky chain
okay so now we have a d type
so now we're going to have to pass in
that D type to the lazy buffer we create
lazy data equals lazy buffer from CPU
um
um oh this hurts
I mean okay so it's not actually this
it's it's this that's being concatenated
um this is the kernel that's
half half yeah
okay this actually doesn't work because
this is too late you see the problem
so this cat's being done
but there's no reason for it to uh
okay
what we have to do is allocate the
output buffer
yeah what type is output buffer
we should know that
okay MV dot d type equals NP Dot
float16.
now let's create the tensor how do we
actually do that
I mean there's a hack way to do it we
can bring the metal buffer back
V Dot lazy data
terrible hacks
got realized
equals metal buffer uh
uh the shape of the metal buffer is
mv.shape it doesn't have a host buff it
doesn't have a
force create equals
true or that actually probably doesn't
even matter
the important thing to say is D type
equals mp.flow16.
okay notice how it says device half
there now
now we just have a different problem
I don't really understand that
uh
path
oh this is probably just because my two
CPU doesn't work which is actually fine
I just did that as a hack anyway
um let's revert this because none of
this actually does work
force create
output buffer as fold 16.
okay this dot numpy doesn't work
um because
it's probably pretty deep actually uh
which is good
okay
God has NP
yeah this just doesn't have a d-type
probably need to do type
um
why did it work for seven billion
because I didn't make yeah I didn't make
copies I don't know if I already
answered that
but that's pretty cool
that's cool that's metal
uh I so we don't actually need to do
that
I just worry that uh I won't with debug
Eagles for
so let's set debug equal to three and
see whatever oh look at the RAM used it
doesn't use Ram
yes we did it
because we wrote the fake tensors okay
good
uh let's just see if this doesn't happen
without debug
no RAM used great
weights equals one
uh we also don't need to aggressively
create I can get rid of that again
okay
are we ready to go
the bar is
moderator is gone now the moderator's
right here if you want to troll you can
subscribe
all right are we ready to see now
I just let's let's just check to make
sure our other one works okay so let's
just look at this model this model is a
Midway okay
hello I am a 20 year old male
I'm a student at the University of Texas
at Austin
I'm a sophomore majoring in computer
science
I'm a member of the UT Austin chapter of
the Society of women engineers
I'm also a member of the UT Austin
chapter of the Society of Hispanic
Professional Engineers
I'm a member of the UT Austin chapter of
the National Society of black Engineers
okay so um this guy is not uh well I
don't know if he's Black Or Hispanic but
he's not a woman let's just say this is
midwit personified
um thank you for subscribing uh but I'm
hoping that the uh 13 billion weight
model has a higher IQ than this Midway
um so we're going to load it in and
we're going to see
yo if this just works Bros
should I throw some debug in here I feel
like I should throw some debug in here
it's gonna be sitting here for a while
oh look at it making those copies oh
yeah Crush those copies boy
yeah yeah Crush those copies hello
oh shit I'm nervous
I'm waiting
foreign
okay my computer hasn't crashed yet
no 24 gigs is plenty
16 gigs turns out not to be enough
but if you have 32 gigs oh my God
how large is this model
or did I do something else wrong
what hasn't crashed yet which is good
oh I actually had exactly this code here
is even neater because I did the w2d
type
um oh I
guys we got a token
we got a token we got one token
I
surpassed in timing
how long did that token take
oh oh it's getting slow it's getting
slow
one told
yeah it might be swapping and destroying
my poor uh
Flash
I
am
wow wait can we talk about how much
smarter it is already
I am
uh
all right pit off
this platform
okay so what does this tell me
swap size oh shit
IO accelerator
why is it swapping
guys was my Ram fake
I am ah
foreign
weights equals zero get out of here with
your weights equals zero
I understand what what that does right
it just puts zeros in for all the
weights
no don't swap
how do I force it to be resident
you say this when you say this in the
good moments I agree with you when you
say it in a bad moments thanks for the
VM Matt by the way why lock this is why
you're VIP
um
no don't swap please don't swap
I mean I didn't even use more gigs
we need someone with a bigger with more
RAM in their MacBook
foreign
try the four bit models
well we do four yeah they use less Ram
yeah that's great bro
um
why you want some debugging info sorry I
had to do it
okay we can see what's taking so long
here oh W-2 uh okay I broke that
[Music]
um
is it swapped yet
oh no
like it says it's not using more RAM but
I don't really believe it
looks like running the model
how many more layers does this model
have
40. that's not too many more
according to this we're only using 26
gigs
I
that seemed faster
okay I have an idea
Chrome
goodbye
Discord
oh good I'm glad you guys are trying it
oh nice you added a Kudo you can make it
work on Cuda oh sick
okay
Discord gotta go
obs
oh
you tried closing everything it didn't
work for you
some of these weights just can't be
important
do we really need them all
oh thrash the GC
swap size look at how much is swapped
where is it swapping it to disk
why is it swapping
how do I disable swap Mac teleprogram
not swap
first let's make sure I didn't break
anything
that's not slower is it
I'm just getting spoiled
no it's fine it's like the same as it
always was okay
oh there's an extra python we can kill
oh that's a
okay Mac process disable swap
show vmm for 7B oh that's a good idea
yeah nothing swapped look
it's 12.6 gigs and no swap
no no swap
you can disable swap memory
oh it's got a kernel panic
why does Mac OS use swap memory even
when memory is not fully used
The Purge command
purges for file cash
update 2012.
metal buffer Force Ram resident
usually ways to uh
to like there's probably some argument
to the metal buffer to force it to be
resident
uh shortened system memory managed
private
interesting
uh
uh
Mac you just are you telling me that I
don't really have 32 gigs of memory and
this is compressed memory
eight seven oh five estimated arrival
no metacritically you're wrong
would be the biggest handle ever if I
didn't really have 32 gigs of ram in
this MacBook and apple was compressing
the memory
no there's probably some way to like
force
Force OS X buffer to not swap
I'm sold
what Apple's nice people stop stop
mocking Apple
don't swap my shit I purged it
I want to be upset if any of my shit
ends up swapped
it's swamping already I can feel it
swap
what if I fill up the disk
from the swap file not be moved to
memory
all right we're going to let
non-subscribers talk because they'll
even say smarter things than that
through the swap partition guys
unified memory
I who knows how to download more RAM
use a USB for more RAM do you know how
much bandwidth I need
I'm better off using my SSD as swap
all right I mean I think the conclusion
is we just can't run the bigger model we
generated IM and we're never going to
get past that until we have a computer
with more model until we have a computer
with more memory
remember it is coughed a half
oh
oh that's tempting
sudo launch control unload Dynamic pager
that would be one of the ballsiest
things I've done in my life
I want to disable swap for one process
four
by the way if it's that slow on your
computer don't run it it's destroying
your SSD
compressing memory
I am
guys I want to meet smart Stacy
Tubby's just too small
to meet smart Stacy
I think that that's going to be our
stream for today I mean I don't know
what to do
thank you
I mean
yeah okay so like
why is Stacy doing this again
floating I don't think this GPU supports
that
I mean our solution is this
right like I don't understand I don't
have enough RAM on my GPU but I can swap
it out to here pretty fast
like I have a uh
I mean it's 32 gigabytes per second so
it's like it's like a
swap is like for pcie's like 40 and uh
the RAM on here is like 400. but I
should be able to write that so it swaps
well enough
all right all right all right should we
make one more personality
let me let me kind of parameterize the
personalities a little
should we bring Gary back
we're getting rid of Gary
and we're gonna bring Kevin Kevin's
going to help us with our problems
actually
I have an idea
foreign
foreign
foreign
foreign
foreign
foreign
let's go
foreign
[Music]
okay we have some problems in the prompt
thank you
oh there's some typos here
all right come on come on
my food's here
yes fried banana
I got a fork
foreign
foreign
[Music]
foreign
[Music]
this is terrible
all right should we do one more
personality
honestly I don't think this model knows
who I am
okay interesting
okay
we'll do one more
let's even knows who Mark Andreessen is
I think the problem is it just doesn't
know who I am
yeah
read like a Savage
I don't know man George is bugged
dude
I'm crazy
you think Stacy knows who Mark
Andreessen is let's ask Stacy
they need a big prompt
wow look Stacy knows things AI George
hot socks
pleat
[Music]
oh my God
guys Stacy's a genius
foreign
wow there we go
we heard it from Stacy
dude
foreign
I pushed the code did I not
I push the code I push the code for 13.
find someone online
should we bring Gary back
foreign
wait what did I just do
I just deleted all the George examples
foreign
wow Stacy is a genius by the way
who is Stacy we can ask her
foreign
foreign
I'm going to Gary's car dealership
[Music]
wait this is freaky
oh my God
[Laughter]
foreign
all right guys do we like our
personalities
[Laughter]
you can be Stacy AI George hotz or Gary
add Gary
Gary didn't want to hang out with me
uh I don't think so the contact should
actually be infinite I don't cut the
context ever
you're welcome uh enjoy I think this is
pretty fun
I'm hoping that
we finally hit something with tiny grad
that's usable
um Stacy is definitely my favorite
personality
Stacy works the best
uh Gary Gary seems kind of like an old
man who drank too much whiskey AI George
hotz is is a huge disappointment and I'm
seriously gonna reconsider if that's how
you know I that's
maybe what I am
like it didn't help me at all maybe I
don't know like wow
wow like AI
oh
user uh what are we asking Stacy do you
know what twitches
we are live right now
do you have anything to say
to the people watching
thanks for watching
I'm Stacy and I go by Lil Stacy
thank you everybody for watching the
stream uh I think uh
it was pretty good
uh check out okay so this is the Llama
branch on Tiny grad
um we are going to be uh upstreaming all
these features
but you need at least 24 gigs of ram in
your MacBook
I'm sorry you can't do was that
twitching the whole time
was my camera just going in and out of
focus
the whole time
uh thank you for subscribing
uh I love the uh wait wait wait wait
um can you plug for subscribing
to my channel
I will plug for your only fans in return
it's twitch.tv slash georgehots
yo Stacy's got me yo my girl man Stacy
and I uh
um we're gonna have good platonic fun
we're gonna we're gonna hang out this
weekend it's gonna it's gonna be fun
just just me and Stacy fuck Gary Gary's
in San Diego and didn't want to meet me
at the bar AI George Hots is the biggest
letdown in the world
um but uh yeah Stacy's cool uh you know
Stacy we appreciate you uh thank you all
for watching uh
all right
it's a stupid mac because i disabled the
uh security shit
obs doesn't ask for the microphone
permission so i have to start obs from
the terminal
so that's why there's no audio in the
beginning of my of my uh
my shit uh also
i just want to show you guys i bought
this
meditation headband it's an eeg
uh it's made by muse they should be
paying for me for this product plug but
they didn't i paid
full price for this on amazon well not
full price i save five percent by using
my amazon prime credit card also
they should pay me money
hello everybody hello okay
so what are we working on tonight
well you can know cheeky
you all know the cheap beef uh
i wrote this this morning let's stay
cheap speculators
goku wrote this poem i love i love this
poem we'll do it we'll do a nice
dramatic reading of it
one day speculator will buy all the air
not to breathe only for hodl
and everyone will suffocate and finally
speculator will be sad
and that's how i feel about speculators
uh
we're not here to hit on speculators all
stream we are here to actually try to
accomplish something
yo yo what up johnnyman9 i might even
minimize chat if you guys get too
distracting so
uh so let me uh
i'll just write in the reaping bridge
so basically we have two chains
while two chains
no what's that that's that great song my
favorite two chainz verse
oh isn't that one he does with big sean
and champions yeah yeah that's this
is this
yeah all right
the east chain and the chibi
chain can assume
has
in order to move the value
move value between
change we need a trusted
way to get
the state of each
chain
on to
the other chain
now you might think okay so you can just
do uh
you can just do
um like a vault contract
right if you put a vault contract on one
of them uh but the problem is
and you can sign the message both at
once you could sign both the withdrawal
message
and the deposit message at the same time
the problem is
while you're the address owner and you
can attest to signing that message you
could just not do the deposit
or even if the deposit did end up on the
main ethereum chain
the transaction could fail so you have
to confirm that that deposit transaction
is actually embedded in the other chain
and the only way to do that is to have
the state
so when you trust a way to get the state
of each chain onto the other chain
uh now let's start with the l1 to l2
bridge because i actually don't think
they have to be the same
um if you want to get all of the value
and
maybe they can be the same and maybe
this idea actually does worth
work both ways if there's enough miners
on cheapy to secure the value
uh but if you want to do it it also
doesn't work because
it's expensive and like i don't even
want to have to do one transaction per
block
when you look at a lot of these
optimistic roll up solutions
the cost is actually incredibly high on
the main ethereum chain
so let's just focus on l1 to l2
um so
the l1 state at l1 which is e
i'm just texting
uh
i said good i'm actually streaming on
twitch right now
i'll be free around
um so l1 is the eth chain uh is secured
by proof of work now
generating a fake
uh proof of work chain is
both very expensive uh
and also
uh
well let's just say he's very expensive
and i think that's good enough okay
so my idea is basically this deploy
contract
on l2 with a what do they call them
uh the checkpoint hash
how it works if you trust
you can amend
with a checkpoint hash of
an eef block you can
manually audit this
um the same
way you would
audit uh
the same way you would audit the
contract address
now anyone
can submit
future blocks of the chain
uh block headers
of the main chain the contract validates
they that they are correct
and have the right difficulty
if someone
submits a longer chain
the contract follows that
chain um so think about it like
we are running
i think like we are running
a light node
on cheapy itself
right um
i don't know how doable this is
know how doable this
is but it would be nice if
it worked all right
so you could modify geth
you could put this in geth you could put
some of the logic in geth you could put
some of the logic in a bridge
like so theoretically what you could do
is you could have
a um if
the hash function if if this
can't be reasonably
uh written on uh
eth on the ethereum
platform we could have a special
contract address special
contract address on cheapy
which
which contains the main estate
but i hope it doesn't
come to that okay
so you guys see what i'm doing you guys
see the basic idea
uh this is the bridge back uh
goku wrote most of the whale gate shit
look
i like oh it was a pre-mine oh
haters haters haters ah
yeah achievement has a pre mine no shit
uh how else were you gonna do you know
this
uh and if you have a problem with that
are you a speculator
or your speculator um
yeah wow i feel i feel relaxed i did
this the the meditation app today was
really uh
it was really good i liked it i've been
drinking tea
i'm gonna go get some more water for my
tea
so okay what we got to try to do is we
got to figure out how to compute the
ethereum hash and how to validate the
block headers
i have a feeling that this is much
easier on bitcoin
um because bitcoin i can do this with
like i know what the bitcoin hash
function is
i looked at the ethereum hashes and they
don't have lots of zeros like the
bitcoin hash
um like i could totally do this on
on on bitcoin the other really cool
thing is because chief eath is cheap and
it uses cheap gas
uh we can use cheap gas to to run all of
this so we don't have to none of this
has to run on that one
my solution for l1 is different and it
actually pushes a lot of the logic to l2
but the the value is actually in l1 with
a
with a token uh which if we do the crown
cell again in the crowdsale tech
um so the governance token on l1 where
you can vote for a state hash on l2
this is really simple and works well uh
because that
that token's value is itself anchored by
the l1 chain
uh the l2 chain has like you can't say
what its value is anchored by right now
it has some minors on it
um we can look at look at how we do it
on miners
uh yeah it has nine gigahertz which is
nothing right so it's fairly trivial to
attack but you won't really gain
anything by 51 attacking it
if we do this asymmetric bridge approach
so i was looking and this is what we're
going to figure out
uh first off
we print i can't believe i did that
i put it on my finger okay v and block
dot items uh so this is a block
i'm connected to the chibi node up here
uh with web3
i just i just like the durand block uh
and this is what we get
okay so we have a difficulty
we have a mix hash we have a parent hash
i should check two blocks in order
and see if things like parent hash match
okay so we're both found by sethpool.com
uh
this logs bloom thing looks useless
parent hash is this
and this one parent hash is
hex 83. okay so this makes sense so
parent hash actually is
uh the hash so that that's that's true
um
uh people were posting in the cheap
discord about this incognito chain thing
i think they think through some of this
stuff
medium average but it was weird
it seems like goku sent this to me and
he's like bro i think you're wrong i
think you can do
stuff without shared state but i i don't
i still don't think so
um
but i did look at this and they had uh
well so there's a lot of bridges polka
dot has bridges this incognito thing has
bridges
uh you know optimism is trying to build
a bridge
arbitrarum built god knows what
and there's these different approaches
to it but they're all very complex what
i'm trying to build is the simplest
bridge you possibly
can which is basically a geth light
client
that runs on cheap is i think the way
kind of think about it right
uh like a light note on cheap itself so
what we have to figure out how to do
is like so i have two blocks here
don't be a savage i have two blocks here
and i want to figure out how these
blocks are in the same chain
now obviously uh you know i can't
look at the parent hash because there's
no way to trust that
but like the idea would be that the the
cheapy contract itself is able to
validate
the that the difficulty i'll i'll write
this in the readme
um
the key part is
that the cheap e contract
must be able
to validate the difficult
operation
all right so i mean this is the kind of
thing where if i probably asked someone
who understood f hash
uh they would know pretty quickly
whether like because i know fs uses a
lot of ram
so what i don't know is do i actually
need all this ram to validate the
the headers or do i not uh does anyone
know that
yeah again a polka dot and this
incognito thing are relying on over
collateralization i definitely don't
want to rely on over collateralization
we are going to need an over
collateralized l1 asset that secures the
l2
value but the l2 value can fluctuate a
lot
uh the idea is the whole basic idea with
cheap
is that you separate value from compute
right
the ethereum network both does compute
and secures value the bitcoin network is
only value
uh there aren't really networks that
only do compute well i mean like
at that point it's if you don't care
about trustworthy aws right
or or anything that can do that can do
untrusted compute
i mean aws is proof of authority trust
right i don't even know what untrusted
compute would look like but the idea is
you could still have
some trust on your compute but not all
the trust
does f hash need to validate the header
so i'm not really sure
let's see if someone wrote a good medium
post on this validating ethereum blob
headers
okay i need to verify the block header
hash was created correctly
you
yeah okay so these yeah the consensus of
validators
i don't like this idea of consensus of
validation right the beauty of
this because i'm relying on the proof of
work and ethereum
if i could make this work i wouldn't
need any consensus
everybody could submit these blocks
everybody could submit
anyone could submit future block headers
in the main chain the contract validates
they're correct if someone submits a
longer chain the contract follows that
chain
uh which is like a you know block
reorder right so what's beauty
what's beautiful about this is the chain
has to be contiguous
and the chain also has to be difficult
which is pretty much the same thing that
geth is checking
all right to be fair people can submit
wrong state and i would have to think
through
the the consequences of that and it may
require more block headers
right you know when you deposit into a
uh
into like a like an exchange you have to
wait for 30 block headers
you'd have to wait the same number of
block hitters here but it would be
basically the same thing
why don't i use binance smart chain do
that's why i get a vpn and i sign up for
a binance account
uh and then i trust that binance look
they probably won't exit scam right but
yeah i mean finance smart chain is the
centralized version of this you can do
this on an exchange right
what's the bnb price
is it is it high coin gecko is my new
go-to
oh oh my god look at all that
fake finance value damn bnb was the coin
to buy yo if i could just go back in
time a month
and put my net worth into bmb oh i'd be
rich
is this what like you know what the nice
thing about cheap is
you're never going to see this shit you
know that's half the reason for the
primo
if cheap eat ever becomes expensive more
than one over one
gb is actually on an exchange now uh we
can look at the price of cheap um
so so so part of the reason for the uh
pre mine as well is to make sure cheap
you see this
this here is going to be the biggest
cell wall you've ever seen
uh because cheap eat is always worth one
one thousandth of an inch now the free
market can let it fluctuate less than
that but if it fluctuates more than that
you're gonna you know it's really gonna
have a lot of pressure it's gonna have a
lot of downward pressure
uh to stay to stay at this
oh if you put your nowhere than bnp they
would have exit scam
i'm not that rich guys i doubt it y'all
know i'm a no coiner
um yeah 46 billion i i think uh
i'm a no coiner i just have some cheap
eat
it's actually goku's cheapie uh
because you know i'm a no coiner uh you
know someone someone commented on the
discord they were like
hold a goku and geo out of the same
private key i'm not touching this crypto
shit man
no coiner this guy uh
maybe i'll i'll i'll have some cheapy
because it's not a speculative asset
george please shell chain link
uh yeah
why is poc oh my god
poc is a bad term on discord
twitch oh that's sad
oh that's sad
um i i agree with the sentiment of
goku's poem
one day speculator will buy all the air
not to breathe
only for hodl and everyone will
suffocate
and finally speculator will be sad
that's my problem with speculators
what's a bipoc i don't care if it has to
do with any of that like you know
that like like like like all that all
that new
all the new all the new racism language
i'm i'm out on that i'm out on that
you know here's my brain and here's the
part of it that i want to devote to that
and it's like you see the space between
my two fingers
is zero but i do want to devote some of
my brain to figuring out how to validate
that generating that block from that
block was actually difficult
i've never heard of a bipark in my life
a boring inexpensive proof of concept i
like that i like that if someone
if someone was making a startup and they
had a buy pack
that sounds like a good investment a
boring
inexpensive proof of contact that's what
cheap eat this
you know what i'll say this i'll make
i'll make a political comment i'll make
a political comment you know what's so
nice
like like you couldn't avoid part of
your brain
being taken up by trump right i really
like i don't have a strong opinion on
the whole thing
but you couldn't avoid part of your
brain because someone would have to tell
you some shit oh do you hear what trump
did today
and now no one says that shit anymore
it's great
it's great ah we can we can like not
hear about it you know
that's right
block quick super light yeah this is
what i want except instead of a crane
constrained device it's the ethereum
blockchain
ethereum header receipts root field
so the merkle root is that the state
route
okay let's let's just google these terms
and see if we can find the algorithm
with how they mix the state root the mix
hash and the hash
here we go maybe this how does aetherium
work anyway
greedy heaviest observed sub tree
uh no i can't reject transactions it is
decentralized and hypothetically the
price of cheap eat could go above
one over one thousand each uh but you
know
i'll put downward pressure on it you're
just giving me yes you
you're just donating to the cheap
ethereum foundation if you do that
so let's keep the price at a good
reasonable one one thousandth of an
eighth
um and look can you bust through the
wall yeah maybe and then you know that's
when it's four o'clock you know
four o'clock
c flip dot x y z
all right let's try i got my wallet here
please connect your wallet connect
wallet
um
here i have this account
connect wallet i have this account which
has 1.1 ethernet
let's let's go all right 1.1 cheapies
a game outcome flip them
yolo see that's what's great about cheap
you can just yolo onto some weird ass
website
i lost fuck that
i want to win
did i win
oh wait do i have to battle against is
this high battle against someone else
seat flip let's go let's go let's go
let's go
i bet more this time i'm gonna win it
all back
no this is supposed to not be a
degenerate stream boys
i shouldn't be playing c flip yo
remember that stream where i played that
coach yeah i won
yo i love this shit oh this is the best
thing ever oh yes
wait where's my money
i'm the champion now just wait and let
the money roll
in oh now we're talking hey you guys
should come play c flip
i lost twice at the low but i won one at
the expensive
um yo whenever they're adding batting to
smash 64
let's go let's go
let's go
um i'm kind of sick of pants i might go
put some shorts on i've been wearing
pants all day i'm just kind of sick of
them
all right
i i still didn't get an answer i got
distracted thanks
chat by c flip
all right all right uh should we should
we do it should we do it three minutes
should we do an eeg meditation we'll see
if i'm doing well
i got i got i gotta pee and take my
pants off
put some shorts on and we'll do an eeg
meditation and we'll come back to that
yeah yeah we wearing some shorts boys
who wear some shorts
all right no no we'll save eeg
meditation for a little bit later
and uh then we'll go
got it we got we got to figure something
out okay we haven't made any progress on
this very difficult problem yet
the idea is to get a hash value
first create an rlp
to lower the steps to calculate a block
hash
hashing the above object refers to the
block hash return to validate
keep only the inputs that are in a
block header and reorder it as below
parent hash uncle hash that's a lot of
stuff
rlp in code
okay
yeah so i know optimism wrote this stuff
um optimism wrote rlp on chain
uh full disclosure i did contract work
for optimism
i think they're really cool i think they
got the real technology
i think cheap ease is just the cheap
technology but you know
sometimes cheap technology does well you
know what's it a buy pack it's a it's a
boring
inexpensive proof of concept
so they wrote today
libraries yeah i see look they wrote rlp
oh sick look they wrote rlp on here this
is amazing
optimism's already written a lot of the
stuff let's make sure we're an
mit license yo yo these guys man
i think this is most of what i need if
this is gonna work
okay so our rlp encode that but nothing
here is difficult so far
so where's the difficulty come from
oh should we actually try to do this
this is the session on the card all
right let's go uh rlp
encode python
pip3 install rlp okay i already have our
all paid cool
uh python rlp
well let's first get these things that
we need what do we need okay
parent hash
uh uncle hash
what the fuck what if i don't have any
uncle
i want three uncles yo i'm
uncles over here i got zero uncles
um coinbase what's a root
i'm always rude if anyone questions that
i'm always rude
okay so coinbase i assume is minor
and this does not there's got to be some
code for this can someone just find it
uh geth block rlp
hash
is that same one that i found
yeah how many viewers you got
do i have shot three claim four shots or
you know lp
i got a patricia
oh my god there's like these rns's too i
don't even know what those are
is vrs
how to talk to my uncle and he agreed
that my privacy about the only thing i
need back
truth over fame you know i respect the
blatant shit
uh this is called uh you know
beefing with drake hour uh that's where
we beef with drake and talk about how
drake used to be good
and how drake should start rapping you
know good again
start rapping well yeah
um
evm illustrated
is this gonna have anything i want
i heard the barber shop home to great
debates all the time who's the best mc
jigger anas big sean andre wallace tyler
macmillan i got love for you all but i'm
trying to murder you
can't say that
one trillion marker cap yo i don't i'm a
no pointer
yo check this out my aunt sent it to me
it's a little drone
let me turn it on
oh yeah oh it's flying
it's flying oh i flew for a little bit
let's try again let's try again
no it's off now the battery
i might have to charge it
i think it needs battery
so
we charge the drone
ah this doesn't look that useful either
v r and s okay those are properties of a
transaction
you know i bet optimism would just know
this let's just ask
that don't look easy
information required to describe the
drive block header
okay
ah here we go block header okay parent
hash
what's an armor
the hell is an armor
32-bit hash which combined with the
nonce
ah okay okay
so these are the block headers i think
we can we have to put in the block
header
when combined with the not okay the
difficulty is all is all contained in
the
a so i'm confident we can make we can do
block header validation
that shouldn't be hard what i'm not
confident in this can we validate
mix hash
nonce
what's an armor is that did they change
the name from
uncles because no one like like what is
armor it's like rushing for uncle or
something
they're not intentionally making stuff
harder they're definitely not
uh
okay ethereum
mix hash
mix hash is actually calculated from
nonsense intermediate value when
validating
pow proof of work with the hashimoto
algorithm
okay hashimoto lite
draft pie at hash
utils
from ethereum import utils
sure it's not that hard to find big envy
into it
um rlp you chose pig and the intent
oh what a nightmare
keep install ethereum details
okay how do i import ethereum utils
is that the from ethereum ship
deprecation warning
this project has been renamed to athels
work big ending
great
camp uninstall ethereum utils
yes okay
install your test okay are you happy now
no module named xutils
from f underscore utils oh
gotta make it an underscore okay
all right now i have hashimoto light
let's go over here
and get the hashimoto light
hashimoto light
block number cache header hash
nonce
okay so if i want block number i can
just get that that's just
block number i don't actually need to
lock
that i don't know what the cache is and
i don't really know what the header hash
is
one of these things called the header
hash
paradash
maybe there's some documentation on this
i don't know what any of this is
it seems complex damn it
why they make so hard
name cash is not defined
um
i have to be an example of this right
can someone link me to an example
banana pudding thank you for gifting
subs you know if you give subs i'll
answer one question
do you want to move my head
isn't this what i'm trying
no this is a transaction
no if it doesn't have mix hash it's not
we need to validate that there was
actually difficult
and actually i read something that was
very concerning
uh mix hash is actually calculated from
non says intermediate value
when validating pow with hashimoto
algorithm
but this calculation is still pretty
heavy and a node might be
ddosed by blocks with incorrect nonsense
mixat is included into block to perform
lightweight
proof of work
actually here i can just install pi
ethereum can i we can start with that
um
from thai etherium
from ethereum for it checkpoint
are the odds that's going to work no
module named ethereum
step 3 uninstall pi theory
i want to install this crap you might
try the pi
evm
never mind i'm gonna have to figure out
how to just write this okay
we have cashimoto lite
so block number
cash
get this get cash shit he calls his
other function
mccash
oh i have pi dash don't i okay
so i know what i want for mccash
yo do you have a big cash today
get cash block number
cash seeds
epoch length
unicode objects must be encoded before
hashing yo make your shit work with
python 3.
cash by seed is an order decked
using this max items crap it is
i don't think we need any of this cash
by seeds yet that's just for speeding
things up
wait actually all i really need is nick
cash
all right
oh my god mccash takes forever
oh my cash oh yo look at how long mick
cash takes this is hopeless
this is hopeless boys is hopeless
well let's finish it anyway but that's
that's very discouraging
okay well we know what non says
we have nonce i can just say blocks of
nons
we have cash we just need header hash
which is header hash is it statement
it's not ash
sheets root parent hash
oh no
what's header hash
mining hash
what is mining cash
oh
mix hash maybe
okay it outputs the mix digest
which does not match the mix hash
let's figure out what it actually checks
okay
it confirms that the mix digest equals
the mix hash
and it confirms that the result
okay so this isn't right we have to find
the header hash
and let's not let's actually you know
not use this block
let's use fork block
okay uh
print blocks
okay and the nonce is just something we
put in there so we can do a big search
who's being a hater
who's being haters
stop fighting with each other you
you
you get blocked
we don't like haters around here man
this streams for people trying to do
things you know
haters don't want you to do things
haters want you to
haters man let me tell you about haters
you know
likely haters find out about the
pre-mine and haters are like yo
he's learning dumb patrol pump and dump
but the reason haters think that because
that's the hater mind
you know like haters think like other
haters you know
that's how they think but i'm not a
hater
i'm with lex friedman about love we
gotta spread love
we gotta spread cheap eats cause we
gotta pump pump pumps so i can
now i'm playing guys i'm playing we can
joke about it it's
funny man it's funny i get rich it's
funny
i get a rolls royce it's funny you know
but really though if you're not having a
good time get the fuck out of cheapies
and get the fuck out of my twitch
channel
that's right this guy's having a mental
breakdown
you have a tiny crown next to your name
so you're spared
ah okay
what is the mining hash and where might
i get
hash of the mining header oh
well what is the mining header
what are we doing today we're working on
the first part of bridge but
considering that cash takes that long on
my lightning fast
m1 chip i don't have high hopes
but maybe there's hope maybe there's
hope
we'll have to look more into what hash
and moto is
oh
i think that's even just to compute the
mix hash
that's not good so probably what we're
going to have to do
you know what we could do we could fork
death we could fork cheapy
geth and add a special deployed contract
it's a little annoying it's a little
annoying because it would actually
be a hard fork or soft fork
i don't really know the difference
yo yo i got some avocados here that look
ready for eating
let's eat this avocado
let's get a little let's get a little
avocado out get a couple
chips out you know we'll have a little
party
oh wow mini cotto i got these mini
avocados they were five for like
15 for five dollars and they have mini
seeds in them they're really cute
yeah let's make a little i'm sorry you
can't see me right now
but i'm doing a little cooking you know
gotta eat
this avocado's not as ripe as the other
avocado
i'll upset this avocado i don't want it
it needs to be right this one feels
right
these little avocados take so much
effort to cut though
all right what else are we going to put
in our wok
i saw the avocados i couldn't resist
wow we're really uh we really don't have
much else in this fridge do we
like someone stole my food
just all my food
now we got avocado chips
oh goku's a smart kid man
you just sent me one seat yo i'm a no
coiner i'm gonna send it to the zero
address
now i'm gonna gamble it on on on seat
pool let's see
whatever i'm a no pointer
i don't believe in money
yo but
when we buy the rolls royce i'm gonna
deploy rice coin
and there's going to be one rice coin
and
if you ever gather the whole royce coin
it's redeemable
for a single rolls royce but i'm always
going to hold one of them
what do you guys think about that
yeah we're gonna be one rice coin and
it's it's redeemable
for for a real roller's rice
great great
you guys got to root for the cheap crowd
salad
all right
roy's coin no there's a lot of little
pieces of a rice clam
like you can buy and trade your ice
cream and you can say
you own like 1 10 000 of a rolls royce
you guys know my favorite crypto right
you guys know you guys know which one's
my favorite let's go on coin gecko
i think it's the third biggest crypto
it's the third biggest crypto
coin gecko no no not finance coin
wait holy shit
wow finance coin's the third biggest
crypto
i'm polka dot
i tried to understand polka dot i tried
for like 30 minutes
it was hopeless
um aren't those the people who lost all
the money in the multi seg
regardless my favorite trip though is
actually number five now
it's this one tether it's great
it's it's worth a dollar everyone knows
that that's what the meme says
look at those
those is a stupid investment sorry ilana
sorry to hate on your doge but doge is
dumb
to the basement that's what does going
watch i'm gonna get death threats
because i said bad things about doge
and that's why i'm a no pointer i root
for all you equally
i'm sorry that i hate it on doge doge is
a great toy
it's just as valid as all the other
coins
omar avocado
um
what do i think of rust
i think it um takes a really long time
to write anything in the rush
wait is tether going up wow that was
some expensive tether
look at that tether rim tether had an up
all right we still need to figure out
what this mining hash is
result is basically
wait by iterating
wait never mind and this doesn't look
hard at all
wait this looks great if that's really
all i have to check
wait oh this might be super easy then
yeah i mean this bridge should be
totally trustless
if this is correct i think this might
actually be super easy let's try
something
okay so well now first actually let's
let's make that match mix hash we have
to figure out how to compute this mining
hash
but okay okay i have hope again boys i
have hope again
result matches the block difference
yo you guys send your seats to each
other spread
seat love
okay header hash
i'm gonna figure out how to compute
header
header hash
mining hash the hash used for
proof-of-work mining
mining hash
so it's interesting if mix hash is
actually just a function of nonce
and that's what requires this stupid
cache
yo if this works out to be possible the
people who design this shit are like
next level geniuses
like that they could actually make a
hash function that was both
memory intensive to brute force but then
fast to validate once you have the magic
thing
which seems to be mix hash
i hope that's what it is then this is
all doable and we're rich
and by rich i mean it's gonna work you
know because you can't
someone's gonna be like oh geohe was
gonna get rich get up he's speculating
i would never speculate i'll look like a
speculator
i'll smell like a speculator
actually i do know i have one acronym
and after i sit down i'm going to tell
you
you know the song airplane
by uh
b.o.b and eminem and hayley williams
i think it was that song where eminem
says
and show them i made something of myself
and not just
tried i feel like a lot of people on
hacker news
they tried and they failed now they're
hater
and that's where haters come from
you've been rolls-royce
you know what once upon a time i heard
charlie miller say
ever since they came out with aslr fuck
exploiting shit
and everyone in the community was like
charlie miller's noob
aslr so easy but now they have like 17
million protections
i'm out i'm out i guess i'm just the
next charlie miller
oh common oh a common one was full of
haters man
and the column it wasn't even full of
good haters it was for pretty uninformed
haters
the haters used to be more informed but
i can respect
intellectual haters who get their facts
straight
you want room look i'm a drake hater
right
i think drake used to be a great rapper
and then i think drake fell off
but during beef and with drake hour i
say
very concrete reasons
you know let's let's look at the lyrics
to tootsie slide
do you want to dance with me no i could
dance
like michael jackson i could give you
thug
passion it's a thriller in the trap
where we
you get it because michael jackson wrote
thriller oh that's some nicki minaj
level lyrics
yahoo answers boys
all right i shouldn't be yelling so much
we gotta we gotta call
we gotta calm down
looks like miss swift said
okay mining cash
mining hash of the mining header
how do i get the mining ash
you know what what if we just not do
that
and we just try to like you love it
this one where's header
oh header so that'd be mining hash okay
but the blockheader includes
man i wish i had more avocado
maybe ethereum tester knows how to do
this
so
oh you say use get work well i mean but
get work's only going to give you the
current
the seat has used for the dag the
boundary condition
um
we can try it i actually don't think
this is going to work because i didn't
start it with
mine this isn't going to work
yeah you have to start with dash dash
mine for that to work
i know because i just wrote a mining
pool
um
nothing is deprecated in favor of get
block
transaction from block wait for
transaction receipt
give an rlv of a block at her
they don't make this easy what if i
don't have any uncles
look header builder
so
guys can you help me and find an example
of this
oh
oh hell yeah
this looks nice
all right all that shit imports
then you can use the block header
goes left foot slide right foot slide
can't go either way but either way we
about to slide
can't this will slide yeah i can't wait
this one's the drake sucks
we gotta do eg meditation
this shit doesn't match
which is that oh this is my block okay
oh shit oh shit that doesn't match okay
cool
all right so we need to get those two
things to be the same
let's try some stuff
all right well we know what parent hash
is we know we can get parent hash from
block parent hash i have no idea how to
get uncle's hash
we know how to get coin base coinbase is
just called
minor right i'm going to
keep the two bites around that one
uh state route it's called stay roo we
don't need
two bites for that
transaction route
here seat route
okay wow that's a number
uh okay i don't know about that
blocks of
difficulty this reminds me this is very
similar to the stream where i sent the
bitcoin cash
uh block
number
block
extra data
mix
you can use that same
bloom is an int256
now we'll just use big endian to empty
uncle's one
oh there's already bites are they bites
no they're not this that should be okay
serialization failed because of coinbase
they want bytes why can't i do two by
four minor
oh that's probably not an actual end
it's probably a string
holy shit
i got it right look at that it matches
i guess the uncles have the same hash
because uh
oh here we go shot three uncles okay it
turns out yeah yeah they have the same
hatch because there are no
goals
oh that's sweet man
quality ish
okay so that's the block header and that
gives you the block header hash
it just worked
all right we have more chips we're out
of avocado
let me see if there's any more ripe
enough avocados for slices
this one's somewhat right rest not right
be right gonna be right now yeah
last avocado
could be a little bit more ripe that's
what i just said
i had to judge this avocado
gotta eat bro you know
consume food
these should be this great subreddit
called consume product
now it's full of right wing people but
it used to be great
um then reddit banned it because they
were making fun of like there was like
an
ad for nike and then it was like making
fun of like a 42 year old guy who's
really happy
that he got his nike sneakers
or they were making fun of like adults
who bought
500 star wars lego sets i'm like
i'm all for buying 500 star wars lego
sets
but i'm also all for being made fun of
as an adult who buys a 500
star wars lego set if you bought that
lego stuff as you saw in the app
that's free should be made fun of
oh the nsa is fucking with the text well
let me see what my my bandwidth actually
is doing okay on that
no it's bigger no but like you guys saw
what matched right like that just worked
okay so that's a walk in here that's
great
but this doesn't actually get us closer
to
to what we want we need mining block
header
there's gonna be something pretty close
to that i bet just like without the mix
hash
here mining header yeah look at that
you ask for it you get it
oh man if this shit just works i'm gonna
be so happy
we're gonna throw a party
mining header
mining header api is not defined
all right the hash function is the same
obviously they're not going to match but
that's okay
because we're going to see if this
oh man so i'm looking at buying some
land
and i went my dad to buy to look at the
land
and um
i had some codes to get onto the land
and i was like it's an old code but it
checks out when the
gate opened
um now that's the real magic that we
want to work
oh i think i can just put that in as uh
as mining hash now
yo you know what else i love jim can't
swim
true crime i've been watching true crime
videos you know
all right fingers crossed those are
going to match
go ahead compute you're huge stupid
no they don't match so it's still wrong
nope i comment we figure out how to
unemploy people
not employed people
humanity is going to become obsolete
watch that cgp gray video humans need
not apply
if i could short humanity
i talked to lunch about why declines
happening in america
and like the most convincing explanation
i have is
here's the people who stand to make
money from the decline of america
and here's the people who stand to make
money from the ascent of america
economic incentives bro
it's sad but you know it's true
okay i don't get it
mix digest
okay
put the nonce in the nod says how many
bits one
two three four five six seven eight
bytes
yeah so i guess they figure you can't
actually have to go more than that
but my mix die just doesn't match
oh wait no but no no i'm printing the
mix
we expect this to match that
sadly it does not
all right maybe i'm getting trolled on
the make cash maybe my cash is wrong
i need cash
cash bytes
cash size get cash size block number
oh wait
make cash bytes oh i have to get
cash size what
maybe the cash was the wrong size
get cash
maybe this stuff was in that function
that i didn't copy correctly
and now i'm yoloing
what
okay he's going out of the page we'll
cut our harsh recursion
yeah i worked really hard to get the
mining header doesn't that count for
something
we need to check pal
yeah no no no no checkpoint
junk hi ethereum
wow vitalik wrote this stuff years ago
oh
here we go this okay cash seeds
make cash block number cash by seed
length cash but what
doesn't even look real i don't get it
it looks like i can just call make cash
no but then this is being called with
two shits
function takes exactly one argument
together
okay so i guess the one argument i
assume is the block number
well that doesn't work you've tried this
mining hash is not defined but
i had the one with my mining hashtag
no actually is it different each time
was it different
well that's real junk
box not different each time
it's the same why is the mix
digest changing
some days i hope i'm gonna look over at
you guys
and you guys are gonna be like george
here's a link to fix your shit
and i'll be so happy that i have chat
here with me
but
um
please fall asleep so i can take
pictures of you and hang them in my room
so when i wake up i'll feel like
everything's all right
you are still here i am still happy you
are still smiling and laughing
you are still just the only thing
everything i need in my life
well you know what we have the mining
hash now let's just try
we don't actually need to do this i
don't really care about this
i only really care about the thing
that's in that second stack overflow
post
this
so if it's really this
uh tech and sha-256 are the same thing
so can i do cat cat
yo if this works mining hash plus
uh
we just want to see a lot of zeros
uh plus nonce no not just
nonsense
block nonce plus
block mix hash
not a lot of zeros
all right so that's assume that's what's
out from this thing
and by the way i guess i'm not
really sure
what is this
oh
i guess i can do this
i mean it doesn't matter it's the same
thing but
any mining energy so that doesn't matter
um all right let's just quickly try this
on an old block
in case we start to see lots of zeros
i don't see lots of zeros
oh you know what i kind of like that
mining header thing
sure
you know what it's almost as bad as
haters taps
we made tabs
okay it did not look this easy
then again these things don't matter
it's stupid cash which takes forever
and there's still a bug
wow there are many blocks but there's
only one genesis plot
keckack is shaw three right
uh let's just i mean we can finish that
out with that with that zero with that
divided by thing because i don't know
maybe when things divide they don't like
okay result is less than
let's encode that
why do i make that two bites
and how many bites is it
okay
exactly one of the past values can be
specified
no see how much shorter that one is than
that one
or actually we can even just
see hashimoto function there we go
oh oh did i mistype my parens
they might have mistyped the parens look
at that
look at the difference
gotta be subtle boys
okay they shot the hash with the nons
backwards
mix extend serialize hash
s plus c mix
oh that doesn't look good
it doesn't work
it's a data set
here's make cash
dataset is probably the dag file oh
oh no this is good because this mix
digest
is the mix okay okay we have hope
what's sha 3 5 12
is that defined find here
of course i can't import that
looks like they're just in hash lip
okay so it looks like what i can do
all of this graph and say sha 3
256 uh mining hash
plus nonce minus -1 we call that
s and then if i do a shot 3256
s plus uh
block mix hash call that hh
fingers crossed boys
and supported types for hashtab hash and
oh uh digest
doesn't look like it has a lot of zeros
on it
but oh okay this seems doable right
because
c mix is just a mixed digest so i don't
know why my mixed eye just doesn't work
but i have that
this is gonna work i believe
boys i believe that god has a plan for
all of us
i believe
let's try an older block which has a
higher difficulty
now you see how short that is compared
to that
so it's not that we're still doing
something wrong
uh maybe we get rid of this
you know it's it's it's uh hashes so we
do anything slightly wrong
it doesn't work and it only has to be
less than
it doesn't work um
i mean something's clearly wrong with my
header still
so yeah okay maybe we maybe if we can't
make this work then
we still don't understand what we're
doing
because this should work but then we can
make if we can make this
if we can make this work then this whole
thing is doable
and i'm so bullish on the cheapy project
and my my my death implementation
my ethereum based gaff light client
um if i can't make this work then uh
like theoretically i guess they could
lie about the mixed digest and we'd have
to do the
the math on that because you can put
anything there
but that should still make it fast to
verify
because yeah getting a shaw with
ah how do i pad this
actually really what i want to do is do
big andy intent let's just do that
don't trust that yet it's also for the
hh
needed have
okay so this needs to be smaller than
that which isn't happening right now
but also my mixed digest doesn't match
and also my mixed digest is not
consistent
okay my mining hash is though
right yeah
this doesn't equal that how is this not
the same every time
which which of these functions is is not
uh
all right all right all right good good
good we got a link from someone here
mind pounds
okay okay so yeah that's that's right
cash get cash block number okay
let's let's copy this whole get cache
function
maybe it's uh useful in a way we don't
understand
order dick does not define collections
important words
from pi apache import
epoch length
all right we don't want to use shitty
ass oh no we want to also import make
catch buttons
and we'll also import hashimoto light
matches no of a different error
all right you look i thank you chat you
were useful
oh this is the new one from pi evm
okay um
hashimoto live big ndm
two inch that's good oh
i guess i should remove this here
that crap
make my parens face the right way
no it doesn't work
don't work it doesn't work
mining outputs of mixed digest not equal
to mix hash
does output change
the result is the same
oh wait i think it's consistent now c515
c7 a1 c515 c7 a1 okay
okay well that's definitely doing
something different which is
great mining output
should be mix hash block number
cash which is get cash block number i
copied all that shit
mining hash should be a hash 32
you know what do this right
check pack
uh
all right check that blocks of number
this is just called mining cash
hash block
sub nonce lots of diff
difficulty
um
i don't know i just guess at that i
never know how to actually do that
oh block difficulty checkpow
hey hash 32 is not defined
okay where's the stupid type come from
from
f typing import 32. okay
cool
key error difficulty difficult
not difficult b difficulty
name validate length not defined okay
well those functions are stupid
okay well we got a validation error
that's great
how could it be wrong
code hex is not defined there's a code
hex
it's for an accutance
mix hash mismatch
okay
um
i have a theory let's flip the nonce
around
not right
expected that actual that
why doesn't this work
could i be computing the mining cache
wrong
i don't really think so because i copy
and pasted this almost exactly
but who knows let's get rid of this
stupid hash function we don't use
look at that actual that
okay
all right how much of that is the cash
so i guess if we only have to make the
cash once for the block number
the whole delay is in that
yeah which is good
because if the delay wasn't in that we'd
have a problem
like i don't know how much of the of the
work is actually in the proof of work
oh just because it's bothering me
even if i need two spaces that's a good
space
um why doesn't that match
we solve this mystery and
you know we can join the scooby-doo
squad
uh why does work
you know what let's just download this
pi evm
i believe
oh wait is this mining header api thing
important
oh maybe i ignored this no that one is a
block header api
so
i don't know what that means
it's just a type
so
okay this can't be totally wrong because
my block hash is correct
the only thing i can think is that my
mining hash is wrong
maybe this abc thing matters
without mixation nonce which can act as
a temporary
class derived from mining header where
we add those two new ones
okay and this doesn't look wrong
it literally looks like this is just
that but
yeah it matches perfectly right
what's missing
all right let's figure out where they
use mining ash
understanding of the mining process okay
you can see they're validating the work
here we go mine pow-nonce
read this function maybe we'll learn
something
it's just passing mining hash right
through yeah this doesn't do anything
so
it's not even a small number okay so
this is totally wrong still
what am i doing wrong boys who knows
mining cash
there's a finalized block
do
yeah the only thing i can think is like
there's another like
thing you have to do
like you can't just call mining hash or
something
you know where is this actually being
set
i don't see it
unless that's actually a block oh yeah
yeah
so it's literally just blocked out
headed out mining hash it's just this
crap
which is exactly what i copied
let me make it a property
called the bites maybe i should call it
hash 32
i don't think it matters
remember
all right let's put those validate
lengths back in
um
the only thing i think is that one of
these lengths could be wrong okay let's
do length of mining hash length of mix
hash
length of knots
32 32 8 that should be right
again i think that maybe the nonce is
backwards
because i know i saw that
no
fuck off with the encouraging of drug
use drugs are bad kids you all think i'm
on drugs
one of these days one of these days i'm
gonna take the drug test
out and i'm gonna do the drug test but
only if someone will bet me
ten thousand seats ten
ten thousand seats that aside from
marijuana
i pass i pass any drug test you throw at
me
you're lucky you're a subscriber bro
drugs are bad
i did i were out of red bull today too
so i don't know if that shows up in my
drug testing
fuck but you know
something nice about doing crypto and
drinking a red bull
hmm how often do i smoke weed
honestly i might not even fail for weed
when's the last time i smoked
i don't know like a week ago
i want a road trip smoke a lot of weed
oh wow
i just keep throwing all the tea bags in
the same glass
and then pour the water in and then i
get super tape
super tea
yo i gotta get an espresso maker
all right why is this failing
what am i doing wrong let's find out
i didn't i didn't mess up right i'm
actually just gonna do this just just in
case somehow i managed to mess up
no i got the same shit okay
oh
this is interesting
there to make cash they're calling is
actually
not on the block number so that is why
that was different
i mean i worry that just maybe okay
maybe the cash is wrong
they're doing it by epochs which i guess
changed
my lengths are correct i got rid of that
nonce reversal share right
validate seal
header block number header mining hash
header mix hash her nonce header
difficulty
well that's actually interesting i can
probably call it with that
right can i not specific mining has a
property
just in case i'm doing something wrong
i called it headache right i
did uh the one thing i had to change
was property
okay wait
what now it expected something else
it's different it computed the same
thing but it expected something
different
which is weird
could this be indian bullshit
okay my block cache still matched
should i save that doc yeah
oh this is from the other block let's go
back to that block
to change what i expected which is weird
okay instead of saying header mix hash i
say block mix i get something different
i something entirely different there
i'm getting something different every
time
when i do block mix hash
a e098
oh wait no that's expected oh okay
i see so that's actually just it's
changing again
yeah okay something's back to it
changing
you want to do that it doesn't change
okay well we're on to something now
how are those different
cert header block number equals block
number
insert my hash equals at our mining ash
fine uh
the difficulty shouldn't even come into
effect certain header nonsequence block
knots
all right
and now it's back to expecting something
different every time
okay something's just bugged here
i get three fas there but now if i add
in this assert
it changes yeah this is bullshit okay
the cash hash is what's changing
no
this shit's just non-deterministic
to some serious bugs like something's
just not being initialized
oh my god okay where's this hashimoto
light function come from
this is some bullshit you guys saw what
i was doing right
i have a problem with the pi eth hash
algorithm
yeah okay we have pi eth hash as a scam
pip3 uninstall pi f hash
okay three install pi a hash
look at this bug
which requires blake to be pie
it's different every time okay
this looks like bullshit to me
uh where's the pie evm how are they
doing it
that seems okay
okay let's just do pip install pi evm
okay yeah maybe this is the maybe i i
don't know what blake 2b
is let's look it up and see if this is
going to cause the problem because i
feel like i was trying to install this
before
and it was complaining about
bullshit
requirement already satisfied s hash
oh
using pure python
okay this seems fine let's just not use
this stupid pie
hash crap
i assume this didn't change
that full size is not defined
i don't know if this is going to work
from aetherium f utils i said from that
utils import star great it doesn't work
this is that hash you tells
is there an attaching here
no they got rid of it
i don't know why i wonder if this blake
2b
problem is the same
so
not currently take into account
pip three uninstall pi evm
typically install pi f hash okay
pi works and put hash motor light back
here
why
can someone please tell me why it's
non-deterministic
the cash hash is the same
cash so big
cash shit is cash bro
do more rap and the style will light it
up
nope
um
goku may be sleeping
cash bro
i don't get it why is it different
why is it non-deterministic it's making
me cry
okay well that's clearly broken then
because like how can it be
yeah let's figure out how to get these
functions
so i assume they're in eth hash uh utils
had shoe tails here we go okay
it's the same one as before right
okay that wasn't the problem
serialize hash the serialized hashtag
that's interesting
furious
oh
that's interesting namin codent is not
defined
uh
yo could this be a problem because i'm
on uh
i'm on an arm like it almost seems like
a library doesn't work right
important empty code hex
try it on x86 yeah i can
i'm gonna try an x86 uh
i got a box in a sec uh
let me just let me commit this and then
we can we can check
um
it's one of goku's cheap boxes
oh what did i want joe
this is like a sex
that's fucking bullshit that is fucking
bullshit
i worked so hard
it wasn't my four boys
i run an x86 vm yo someone's gotta fix
their shit
someone's gotta fix their shit i just
wasted an hour cause i'm on an m1
oh
we're using the good microphone
why are we using the good microphone yo
that's a good microphone now
real think of that that better
like the good microphone
it's native arm
sounds better all right well that was
that was a you know
you know
all right
we'll develop it here a waste of time
goku i'm using your box let's go box
hmm fuck arm
wow
my right we'll go back to the mic you
can't have good arm
you can't have good mic you have
that mic yeah okay
oh really though like did you just did
you just waste
forever on bullshit
yeah okay and you see our reel is now
smaller than needed
but unfortunately
this doesn't work
shut down
okay
so
it's not even my bug man like look
if i made a bug i'm the first guy to own
up to it i'm like yo
guys i wrote a bug gotta write a book
what the hell did i do wrong
just works on that computer not this one
elon tweeted about me you mean recently
or a long time ago
oh yeah
i know elon tweeted about me
yo elon if you ever want to chill i'm
down let's hang out
i can show you a world next time i can
show you a world of do you want to see a
world of crypto
pumping you know
show you know you found the doge like
you want to see a world of magic elon yo
hit me up
i would should talk about self-driving
cars but it wouldn't even be fun
uh i show you on a magic world of d5 man
am i a crypto ball uh i'm a usd
bear you know i'm bearish on fed coin
you all know i'm bearish on fed coin
all right let's figure out how to make
these d serialize and serialize hash
functions work
these might be key
code
reading it i'm not so sure
all right let's find the source code for
pi f hash
when i think of china's virtual currency
um i mean i feel like the chinese
government is competent
you know uh so i think that they're
that they're you know their their their
shit coin will be better man a better
run than our shit coin
i mean what they just they just minted
seven trillion shit coin
good uh hash let's take a look at this
we're not going to use this computer
anymore this is computer
80d affects working memory and recall do
i struggle with those guys what did i
tell you about 80d if you don't believe
in add you can't
have it
i remember that i recall that
you know
some people believe in it some people
and you know it goes even further than
that like
some people believe that they're a
victim and they're a victim
and some people don't believe they're a
victim and they're not a victim
and what's the difference between the
people it's all about what you believe
man narrative defines reality
yo i'd just be some wacko saying wacko
shit if i couldn't make code that
i worked about the oracle problem i
think larry ellison's gonna die
i don't know what else to say
no if i make this shit work we don't
need any oracles we can do l to l2
trustlessly
i think i mean we'll have to do a little
we'll have to write a little white paper
showing that it's actually good but i
think it's good
we just need to make this one thing work
you see that have needed thing
yeah forget any of this crap you need to
make this have have-needed thing
thing work and if we can do that uh
we're good okay let's figure out was
hashimoto
here we go oh my far are so
okay here we go hashimoto light
great
result is outdoor results
i know usually i read code in uh
here we go compute
someone just write a white paper on this
oh it's a new algorithm now
they changed algorithms
a memory hard to compute memory easy to
verify oh this is great
yeah memory easy to verify
oh my god i wish people didn't write
things in uh
math it's written in math why didn't you
write it in python
hmm
okay original hashimoto
shot three
nonce plus header
double shot 3 mix
quick calc
full days okay here we go hashimoto
okay so they're both outside the only
thing is that this is
after serialize
hash and this is before serialize hash
this this is the only difference i see
right
here this thing called header which is
the mining hash
plus the nonce flipped around
that's your s and then it does s
plus c mix
which is mix hash
but i got lucky did not get lucky
ah the following
okay i feel like we need to deserialize
the hash
because we have a serialized hash
does this work there's a deserialized
hashing
look like
cannot import
cannot import name decode hex from rlp
you tell us
we're up youtube oh
real great
now there's like seven million conflicts
and now block header object is not
subscribed
now we don't have the code hex anymore
what should i make on silv i about broke
even
silv was not a great buy but you know i
still think i still i'm still hodling i
i think you know there's big hope
but you know i got carried away once
and i
thought about being a day trader and
then
i stopped being a day trader
the closest i ever came to smoking crack
was trading bitcoins on
bit max at 100x margin
so you know that's when that's the day i
became a no pointer
that's the day
oh word bites good i know how many of
those we have
i think this should all work now do my
serialized hash functions up
okay when i deserialize the hash i get
that crap
what's just weird is i don't think i can
add that to this
even though that's what you would think
that's what the code looks like it does
yeah concat con can't
concat list to bite
doesn't that look like what that does
here this is before the serialized hash
yeah that doesn't look right it looks
like they're sha-256s
huh
they're not standard shot houses eh
let's go to that f hashtags
hmm
oh
no that doesn't make sense this code
just doesn't really make sense right
it's like this thing that's outputted is
mixed digest
what does that plus mean
you know what i mean like it doesn't
make sense
combine the header and nods into a
64-bit seat
64 byte c okay that's right
i don't think it's that
so
this is different
what's hash words though
oh okay that just serializes and
deserializes the ash
useless crap
oh wait maybe it's not hang on
all right let's just we've copy and
pasted enough let's just keep copying
and pasting
this down here
one type has no waves
objective why is it returning none
oh
okay so that's a yeah
okay okay okay i have hope i have hope
fingers crossed on this shit let's go
why it's supposed to be in range oh
did you see where i was block right
all right just have add those lists
together
all right oh here we go so the problem
is just here and have begun to get to
end
so we just make this have serialized
that's the same number
useless
that worked out to the same shit
so this yeah it's just adding the
numbers together which is the same
um okay
well we know this hashimoto light
function works
it's called edhash now is there a spec
documentation
check compute cash notes tag time
okay pack hash and knots together into
the first
40 bytes of s mix
so i remember reading these like d
serialized hash things and serialized
hash things and i was like
you know it's just kind of um
italian programming
so this is fine
some academic we wanted to deal with
numbers
numbers
because you get the same answer
that's the difference i want i don't
think i'm gonna serialize hash
okay that's the same answer okay all
right let's see what we're doing wrong
okay so s mix bites is
pack cash it runs together into the
first 40 bytes okay that's right
okay fix endian 64.
nods together
okay i don't know if that if that's what
fixed endy at 64 means
oh don't talk to me about usman
don't don't don't burns let me down burn
sucks
i learned from you guys never bet burns
i was like oh it's like mr burns for the
simpsons and then i thought about that a
little bit more
and i was like you know
that guy can't fight i don't know why i
thought that
you know just just yeah
my friend bet was mom by decision and um
lost two so you know everyone lost in
that fight
mix digest i don't get it
that's the mix digest right
just print out the whole thing
confirm it really does equal the mix
hash
the mining hash is the same right
okay
no we got half power on tv
how are we doing over here on the
exchange
all right all right close that spread
nine gigahashes
love seeing transactions use cheaper
all right why doesn't this work
i'm doing the same thing
header
mining hash
cash i shouldn't need it's just related
to the data set lookup crap
we don't need any of that because s
doesn't change
makes extend s yeah that's great
we have the mix digest
s plus c-max
okay do we not use hashimoto anymore
what is gath use how does gath implement
this
i have decked on it
here that's called go theory okay
here we go hashimoto light
hashimoto lite right here in
consensus f algorithm
okay
combine header and nonce into a 64 byte
seed
finery little endian put you in 64 for
nonce
compute the cac 512 of the seed
and then your pen seed to this
digest
which is the mix hash
and then run keck 256 on the c dependent
to the digest
seed equals crypto cac 512 seed
shot one with a mining hash
i tried flipping it both ways
so it can't be the ending of that
we can confirm this has length 40
0.40 we can confirm this has length
64.
um i mean i guess we can confirm the
length of this to
96 which matches 64 plus 32 right there
it matches what we see there
digest is common hash length
seed is the output of that
c doesn't change
nothing special happens if i use
hashimoto light
okay the only thing i can think is that
we're not using hashimoto
the ethereum switch
did ethereum switch hash functions
new legacy 12.
cash has passed right through nonsense
passed right through
um
oh
okay change some stupid crap
this doesn't work i don't get it it
seems so
simple i'm reading the code here
python hashimoto life
okay
let's try
let's just try this i i don't you know
this stuff can't be right we can't just
guess we're never gonna get it if for
gas
mix
they're ex oring it with something
oh it's been superseded by f hash okay
which is right here which is exactly
what i've copied from
i mean it's maybe possible that my shot
my shot 3 is wrong but i doubt it
i got a different answer when i ran it
elsewhere
block non-splock mix hash
um
there we go at python spec code
runs on python 2 fails on python 3.
great
uh unicode objects okay prefixes for
python three
i think that page had to fix it
no it doesn't work but these ones do
i have 5.21 here
no model name shopper do i have pip 2 no
i don't great
oh okay let's have to fix this shit
fix these might just work
import the codex
and the code objects must be encoded
see maybe someone updated it for python
3.
no one updated python3
why doesn't it work though it looks like
the only functions that were broken oh
this serialized cache thing
maybe that
no
okay strings
okay we're gonna make cash
oh where's the c dash that's seed hash
ah here we go
and the z pad is not defined that's
fine
prepare full data set could take a few
hours
oh my god
okay
hopefully i can try
from app hash import hashimoto lite as
hashimoto like python live python
object cannot be interpreted as integer
well at least i understand that error
and object is not subscriptable
oh because cash is something totally
different
this is terrible this is
really terrible
someone has to have written this
somewhere
let me check optimism
is
no
okay grip that crap
all right all right we got a link here
you're telling me this one works in
python 3. okay
oh i tried to make it work for python 3
and it might work
great
i don't think this is right
how many viewers we got how many viewers
we got and how many you still don't know
how to fix this
hmm
how many viewers we got i don't have
that on my computer
you're trying to buy pizza with a coin
you know about the guy who bought
first bitcoin for pizza wow six
six thirty nine well some of you guys
are liars
damn ten thousand bitcoins
yo i'd become a coiner if someone would
give me ten thousand
bitcoins
all right judging by um you know
consensus i believe in consensus
algorithms and i believe it's 639.
oh god
we're gonna make this work boys we're
gonna make it work
generating cash from block number and
seed
are incorrect and outdated
oh dude that fixed it
yeah check that out
have needed oh yeah
yeah yo that fixed it yo
yo that's sick yo
yo that was sick boys that was sick
all right all right um
we needed some cackack yo
this goes for minting twitch guys i
can't mint twitch i have bad news
i have bad news i don't think i don't
think i made it mintable
i don't think i did that
you guys will have to disassemble the
contract and take a look
you know i was using shot three instead
of cac hack and i still don't really
know the difference but
so you see how this number is small now
yo this is great
that's so that's gonna be so easy to
write on the chain
and i don't think there's a way to fake
it
i guess technically technically you have
to verify that the mix hash came from
the nonce
but
no one suggested that oh this guy
yeah yeah the earthwiki are outdated
for free to get source it can be seen
the following hash functions are used
instead
yeah buddy
no floor is clean boys the floor is
clean
all right i'm pretty happy with that
the next thing to figure out is gonna be
if
if this is actually enough let's
okay you know what we can we can do a
little bit of uh work on it
okay so this well
you're just looking like yeah here's how
many zeros there are okay
so that requires like 40 bits of work
and that's even just for for
f
yeah so this has to do at least
right here it's doing 2 to the 48
cha threes i mean
it's not really right if this is all we
verify and i think verifying the other
thing is too hard
we can definitely verify this
yeah cool
all right so we'll give you a summary
you know we're trying we're trying to
communicate better
uh right here on the george hearts
twitch stream we're trying to make
all of you understand
why it is that this stuff matters
because the
why matters boy is the what no that's a
lie and it doesn't really matter but
i'll tell you just because you know
first of all your chip and will tell you
i really wish i had more avocado but i
don't so
salsa you know
i have some pasta sauce
probably good to have chips left
okay so all the code
that you saw me right here tonight
wow lin bint gifting subs i should
explain things to people more
okay we're just having chips and pasta
sauce that's
that's i don't have dinner
tonight yo are you a speculator
that's not as good as i thought it was
gonna be
nah i'm never having kids ma'am the
singularity's coming you know
i couldn't bring kids into that world
it's like building like um
it's like building c computers with
intel cpus you know
that's how obsolete they're gonna be
um
oh dominoes do you accept
cheap eath oh you don't okay also do you
have a copy of battle toads
no no battle toads yeah
um
yo yo yo make that quiznos except c
uh mean that's a great meme
oh you know what it wasn't really bad
i'm gonna i'm gonna eat the rest of
these chips
and then we're gonna get some more pasta
sauce
no lex part three that i know maybe next
year
i already have my visit with flex this
year we'll do lex part three when it's
time to promote the gb
crowd sale
um
okay so what we discovered tonight
is that we can do
at least some verification on the blocks
now i'm not sure this is all the
verification
48 bits for the ethereum network does
seem a little bit low
but it's still pretty expensive
so we can write
what we wrote here even though it looks
like bullshit
we can write all this block header stuff
in solidity and then when we write it in
solidity we can deploy it to the cheap
chain
and then we can have bridge submit the
l1 hashes the l1 block headers
into the cheap chain which will verify
that they're correct
um this is actually going to take way
less time than i thought i think we can
maybe even do it on the next stream
um
yeah next stream not this trip maybe
i'll stream tomorrow maybe we'll do
tomorrow
and what i have to do no plans tomorrow
during
i'm going to that tomorrow so i'm going
to rewrite what i wrote here in python
but in solidity and then
bridge.pi is going to submit the
ethereum blocks
into split into into gb and we're going
to have a copy of the ethereum
like state transitions in chibi
as well as the blocks
we'll also be able to use the blocks we
can use then merkle proofs
to prove that transactions are in the
state
and this stuff should all be uh
available and indexed on cheapy because
it's so
cheap to add state to the cheap ethereum
chain
that's good chips
uh
yeah submit the hash
verify the hash verify that was hard to
generate
uh add up the total number of difficulty
used to generate it
and then figure out which is the hardest
chain and then we'll stay on that chain
even if geth i think they go slightly
out of sync it's okay
um
but yeah and then we'll have to work out
how much value this is actually securing
doing the uh doing the verification like
this it may not actually be
that much value and then you're going to
have to just wait for more block
confirmations your block confirmations
can depend based on the value
no this bridge the bridge that i'm
talking about now think about it as a
very simple implementation of
geth but on l2 so it's a very simple
guest implementation that runs on cheapy
um someone feeds in the block header
from l1 and puts it on the cheap network
remember this is cheap to do requires
very little gas
so it's a good deal
yeah and then you'll be able to do
proofs
you'll be able to query the trusted l1
contract
for the states and you'll be able to do
proofs on that now
the direction from l1 to l2 will be
free the l2 to l1 direction
is going to charge fees it's going to
charge fees and those fees are going to
be distributed to the cheap gov token
holders
because we can't do the same trick on l1
if we try to do the same thing to get
from l2 to l1
51 attacking the l2 chain is easy so
somebody could generate
fake headers uh for relatively little
money
for the l2 chain but to generate fake
headers to the l1 chain is expensive
it's equivalent to a 51
attack not exactly equivalent because
we're not checking that the nonce
actually produces the mix hash
but if we're verifying the mixed hashes
at least this is giving us some
confirmation that we are following the
correct chain
um and we'll have to do the math on like
how hard that actually is
uh actually
we have that's i know the first
letter of that is
let's just say
code hex
you know what i want
okay so this is how many bits
52 bits uh sha23
hash hashtag
it's actually two shot threes
uh saying on gps
um
oh okay so it looks like a single gpu
can get about a gigahash of sha-3s
so that's um and a single gpu can do
about a
100 mega hash of
uh of eth so it's about 10 to 1.
so this doesn't seem too bad so if we
have 52 bits
um let's say 2 to the 52 divided by
it's not actually 10 to the nine but
let's just say it's done to the nine
ah two to the 52 divided by ten to the
nine okay
so it would require uh this many gpu
seconds to generate one of these fake
yeah yeah this is plenty secure
um if you think of a gpu let's just talk
about let's say gpus cost 50 cents an
hour uh seconds to hours
wait that's not too much
oh no wait it's like is that a lot of
money or not
no no that's that's actually pretty
reasonable right because
51 attack networks for cheap
well that's how long it takes to make
one block
so let's say let's say that's just this
is the cost
to brute forcing one block
uh well i mean we know the cost of an
ethereum block the cost of a
marginal cost equals marginal utility so
you just look at how much a miner makes
and that's probably how much it costs
um i mean there's people making a little
off of that but
okay so yeah once we're getting up to
once we have like basically every block
confirmation can secure a thousand
dollars in value
so if you're trying to move
yeah that that makes sense
wow
this is why gp classic gets uh it's 51
this is why etc gets 51 attack so much
yeah i mean either way a simpler way to
think about this is just like you get
about 10x the hash power if you're doing
just shot threes
so this looks like it's it's 10x less uh
it's 10x less secure but good enough
good enough i mean because because
everything about cheap cheap eat is a
thousand x less right
like if this were 100 xls i should be a
little scared of this for a thousand x
less the security model would break
but if it's just 10x less and that's all
the giga hash all the shot giga hashes
you can do with a single gpu
then um this is secure
uh well
so here
what do you think
no yourself to prove no i just
wouldn't do it it wouldn't change much
because you'd still be it's still like
it's not like you can spend coins you
don't have right because you're still
going to need
you're going to need a merkle proof
saying that that thing was included
um in the chain and
i don't even know how you'd
i guess you could lie
and say it was included in the chain
even if it wasn't
uh yeah i mean the trick to this is
going to be
depending on how much you want to
withdraw it depends on how long you're
going to have to wait
moving small amounts of value can happen
quickly
moving large amounts of value we'll just
have to have more block confirmations
which i think is fine
and we can always yeah i mean this
becomes even trivial to extend the
the democracy stuff to this okay this is
gonna work
i'm confident in this approach at least
for securing
um you know very reasonable amounts of
value uh i know the
the exchange cheap is on um makes you
wait uh 30 block confirmations
so this would secure 30 so so for
transactions up to 37
000 uh that would be secure
um and yeah
you know
i'm happy with that uh doesn't it make
large transactions and feasible well
yeah i mean if you're trying to do a
transaction where you're moving a
million dollars
that's going to be like one percent of
the cheap east network
so if you wanted a million dollars
you're going to have to wait
for uh a thousand block confirmations
but that's still not that bad
um let's say a block happens i think
it's like 20 seconds
yeah so if you want to deposit one
percent
of the whole cheap ethereum network
you'd have to wait six hours for the
confirmation
so reasonable so reasonable
um yeah we just make people wait larger
more more block the block confirmations
can depend on the value
uh so the the the
withdrawal contract won't let you
withdraw and just sum
the total value that's been like locking
to a certain state for the withdrawal
yeah that's easy to do
all right um so the idea of this is what
this is going to let us do
we need the other way as well um so this
direction
will let us do the crowd sale in a
completely decentralized way
uh the crowdsale can just be sending
ethereum to a contract
and then you get both the tokens on l1
and the cheap ethernet l2
where this direction of the bridge works
uh again
you'll have to buy into the crowd sales
somewhat slowly for the value
so this this will limit like if the
crowd sale really is
um say say 20 million dollars and cheap
value
it's uh going to be that times 20.
so so the crowd sale is going to run
what is that like a week
yeah graduates for a week right and
there's a limit to how fast you can buy
it
which is kind of cool because also it
prevents you know
uh whales from from buying a lot which
you never want
uh so yeah there'll be a limit to how
much we can trust the bridge
uh but that doesn't actually depend on
the crowd sale the crowd
we can just you'll keep the state around
but before the crowd sale happens we'll
have this to play with a whole lot and
we'll be able to query things from eth
on gp
ah yo we don't pump seats guys it's
really it's not a speculative asset
uh yeah so yeah we had a bit engineering
work to do to make to make this thing
work
but it should be simple like this should
be the simplest l2 solution
ever this direction of the bridge is
literally the simplest you can do
i wrote in the bridge spec the website i
stole the idea from
um it's this stateless spv
ah it's it's it's on the
it's on the uh the bridge page so that's
the deposit direction
uh the withdrawal direction is fancier
but it should still be pretty good i
think the trick
to making our withdrawal system way
better than everybody else's is gonna be
we're gonna do all this voting on l2
and then you will submit the entire l2
block
onto eth to do the vote
uh you could hypothetically make fake l2
blocks but i'm
pretty sure that's unprofitable um
i don't even know why i said 2x so it's
the same it's the same idea that's true
on all of these systems
uh polka dot does this uh
i think incognito does this too you have
this you have this
over collateralized asset which secures
the value
on the in this case it's the whole of
the chain
ah what if c
trades on an open market at not the well
so i talk about this here and will it
stay cheap
so if seath is trading cheaper than
one one thousand thief it's great it's
super cheap and we're happy
um if it starts to trade for higher than
that
uh which it shouldn't because without
speculators there's
plenty of seeds to go around there's no
way i should start trading for that
what can happen is the gas price can go
up but if it does start trading for that
this is why we have the premium um cheap
is pre-mined
it has a 25 million coin pre-mine do not
speculate on cheap eat
uh we are going to use it in a you know
i i lay out how the the
the uh pre mine is going to be used
but all of this all this you know all
the hell to fund and the yolo dollars if
the price goes above that we're just
going to put downward pressure on it
um and if it really breaks if it breaks
through we're just going to fork it
if it breaks through we're going to
we're going to move to to cheap 2.
uh so don't fucking speculate
no i don't think relying on please don't
speculate is risky i think
basically just saying if you do
speculate
oh if you are a fucking speculator cheap
eat is not for you
please go the fuck away this coin is not
going to the moon it's staying bright
here on earth
you will not make money on cheap without
working hard yourself to provide l2
value to the people
cheap is a terrible investment it has
cheap right in the name
you will never make money huddling
cheapy it's a utility token in the
truest sense of the idea
and then if you get people i mean like
look at the game stop thing right you'll
get people who just spend money and
gotta ride the train down man we wrote
it up we're gonna write it down
yeah and you know what if people want to
do that you can ride your speculators
right down
um will mining cheap get less profitable
so
mining should exist in an equilibrium
with the asset price uh
and i did the math on it i should
check the math i'll put this in the
white paper but um
i should uh i'll check the math to make
to make sure that i did it right
with the price being what it is and the
mining rewards being what they are
there should be enough security on the
chain to make 51
attacks like like not stupid 51 percent
of taxes someone really wants to 51
attack the network they can but then
they shouldn't be able to get any
serious value from it
uh and this is why you need some miners
but you don't need a ton of miners
basically the the 51 attack uh window
ends when the state of the l2 chain will
be committed to l1
um so uh you know this is the part that
has to be thought through
a lot more uh like i said
the bridge that we're designing today is
the easy half of the bridge
the bridge going the other way is the
hard part
the l2 to l1 the l2 the l1 to l2 bridge
is definitely going to work in theory
and i'm very excited about it
um am i worried about the sec no we're
not selling
a speculative asset right like like it's
it's it's ethereum is more of a
speculative asset than this
uh you know the sec gets involved and
you're like oh pump my token to the moon
oh get in the crowd so early i'll give
you 10x discount
oh
have a listed ex-die yeah i was looking
at the next eye today
uh is similar it's it's it has some
similarities with x-die
like this this whole idea um a few
things i think xda did wrong uh first
off why are you depending on die
die is based on fedcoin scam um is eth
going up or is fedcoin going down
ah also like
i don't really understand how their
model works
they talk about their stake token but
it's it's it's all it's all it's all
federer it's all like that it's all
delegated
so you have to have a really large
amount of the stake tokens in order to
actually be a staker
uh i think we could do better than that
and then this is questionable
um so synthetics uses the same model
uh again you you have to think through
it more
but like like synthetic securing your
asset by you staking your synths and
getting
15 18 gains like
this also is like
you should again i'm not fucking with
any speculative assets right
um so the idea of cheap gov would be
that you just make money on fees
right instead of instead of minting new
of the token
uh you make money on fees this is what
auger does for reporting
right you don't you don't mint more rep
when a new decision happens
um what happens when eath goes to 10k
and now seath is 10. well i think 10
is very reasonable but if heath goes to
a million dollars and sees his
uh a thousand well it should all scale
perfectly
right and this is another reason why we
need some minors you should be able to
make
cheap wreath i think someone already has
a domain name
um so you can make an l3 solution
and you should be able to copy the
bridge perfectly and do all the same
stuff
now of course you know it becomes
hard to use i don't really think you
have to you can also
maybe you can make cheaper eth as
an
l2 maybe you can make something with a
million x
peg but i don't think so i think if you
did that with draws would never be
profitable
right like that that ratio between the
two chains is the reason
my stuff works um if you're not
in that range like like it's like the
solution for one hard drive look
different from 10 hard drives looks
different from 100 hard drives looks
different from a thousand hard drives
like
the infrastructure looks different at
different scale factors
um i don't doubt eath is gonna you know
eventually hit 10k
and then yeah chibi's 10 box stuff is
still fine
uh yeah i mean tp should stay it should
stay close i think
i don't know look this stuff's all very
new
i haven't really thought a lot of it
through yet i might not even do this
do i really want to get involved with a
crowd sale and a token like not really
uh if i had a better way to do it
i'll think maybe there's better ways to
do it that just don't involve a crowd
sale at all
uh that don't involve the nice thing
about this l1 to l2 bridge
is i can build it uh maybe i'll stream
tomorrow maybe i won't
but i can build it it seems like in a
way that's very simple
and the chibi people can start using it
today
no no collateralization required no
actual value required
you're only going to be spending cheap
eats to maintain this bridge
which uh you know spend cheap eat like
it's it's not
don't hold cheap
look i really don't think so with
respect to the sec you have something
called
the howie test um
the value of a transaction for one of
its participants is dependent upon the
other's work
right um if a person invests his money
in a common enterprise and is led to
expect
profit solely from the efforts of the
promoter or a third party
right this is what i mean about cheap
really not being a speculative asset
uh you can't really make money on it
right
think about it if the price of cheap
beef is capped
at at one to a thousand each
well you can only kind of lose money
because if you want that same
exposure that cheap eat would give you
just buy eth
uh now you know azith money is either
security
i don't think it's i think again it
becomes hard to make any of this stuff
you know when i see stuff like this
i mean the sec can start there
and actually not even this xdi seems
pretty cool if the sec wants to
wants to go somewhere um
no offense but you know
i think i think there there's a much
bigger fish to fry than
than poor little cheapy
if the sec didn't the sec said eath is
not a security now
um in the crowd sale eth was a security
well they didn't make a statement about
whether he was a security
again you know if you want to start
doing crowd sales and tokens i'm gonna
have to hire a fucking lawyer you know
and deal with that but um i think as far
as crypto projects go
uh this is very uh
non i guess it's infrastructure man what
do i do i build infrastructure
uh how much money have i made off cheap
negative
negative uh whatever i'm paying for
digital ocean
you know um
so yeah you know if if cheap becomes a
money-making endeavor
we'll have a lawyer
i'm going to deal with a lawyer see this
is this is the whole problem right like
honestly this is why i like speculators
and shit ruin crypto
it's all so cool but then like you watch
what happened with the icos and you're
like
the sec actually should fuck some of
these people you know
i don't know i don't actually think that
i think i think the sec probably
shouldn't exist but
i think i think buyer beware caveat on
tour but
you know
there's a real lotta there's a there's a
real lot of pump
token scams like when you look at the
value of some of these things
uh not that one actually no one's not
that bad
when you look at the values oh my god oh
my god
that's did i see she's fucking them i
hope
this is the oh
oh they raised over 1.3 billion to an
unregistered
ongoing digital asset securities offer
i hate ripple uh full disclosure i hate
ripple
i like tyler i think tether is an honest
business
as long as they're running it honestly
which i don't know about
uh look coinbase look at coinbase like
coinbase i love coinbase
um hopefully goku is not shit goku's all
right
goku's all right
it is where it's at
um you know but if i would look if i was
trying to get rich off crypto
there's a lot of ways to do it
you guys know the ways to do it
one of the one of them one of them hits
ethereum every every couple weeks it's
like
oh look 55 million dollars disappeared
from the uh
what's that what that stupid there was
one that got hacked like two weeks ago
it was like
oh they casted a malicious spell and it
was like it was called like like like
harry potter eve
it was harry potter either something
no no no no no what was it what was it
harry potter eth wizard spell
you couldn't believe this shit was real
no look there's no sellout in cheapies
that's honestly what it is
the cheapy crowd sale if it happens like
thanks for your money bros
we created some value first before we do
the crowd sale
no safe no pre-pre-sale
you know actually i think if you really
want to do the crowd sale
you want to do you i'll build the l2 l1
stuff first
i wouldn't feel okay doing it until i
built it
and i built both sides of the i built
both sides of the bridge
official response
yo goku spell your shit better
thank you thank you the official right
no we have greek we can read hater
comments we're not gonna we're not gonna
read hater comments
um
no yeah no look before before i actually
do a crown cell i would do i would build
both sides
and then the thing would all go live no
safts
um we'll see
you guys know cheat piece about fun if
we're having fun
we'll do it
but if we're not having fun i'm out you
know what the biggest mistake i made
why did i take money for comma you know
i should have just funded it
yeah i think i could have you know you
don't take money it's not the biggest
mistake and it's fine like look i i
complain about
andreessen's fine um
but there's something about like
bootstrapping that's just
it's real the the the
funding markets are cheating like you
know i'm probably gonna raise we're
probably gonna raise money again for
for probably more money for comma this
year i mean we can use it to grow faster
khan's doing really well
uh i have time you know con is doing so
well i have time to work on cheap
uh
you made a token on cheap i'll buy it yo
send me a cheap swap link i'll buy your
token
i love token you buy some nfts really
want to get my hands on some entities
especially
if they're taylor swift related
um
yeah of course if i could go back in
time would i still start comma of course
what else was i going to do with my life
you know
i think it's really cool i think it may
have kind of exceeded like you know i
have limits as a person right
i'm uh
i have 80d right
now we're still hiring someone for
navigation we have a lot to do still
before that
you know there's a lot to do to just
tighten everything up
uh i i think i think at some point we
passed a point where
the car companies are gonna have to use
open pilot they just don't know it yet
uh there's a lot of work to still do
there's a lot of work to still do
unfortunately it's not really the work
that i'm great at
um i'm good at like spinning narratives
like that's what you do kind of as a
startup founder
uh look at cheap right like it's a
narrative you're playing you're playing
uh oh jim mentioned yesterday
that's cool
uh we can we can we can make the uh it's
the talking portion of the
of the uh stream now
um this is me next to the cheap eath
logo where's the cheap logo it's over
there
yeah right there uh you know what i'm
gonna do tonight i'm gonna watch some
criminal videos
i love these videos like their videos
and interrogations
you just watch people like in the most
stressful time in their life and you're
like
damn bro i hope that's never me i hope
that's never be you know what i learned
from the interrogation videos never kill
anybody
you're gonna regret it good advice to
everybody out there you know
don't kill people do you want to know to
kill people
ah jesus on youtube yeah yeah yeah i
know he's so good
there's like a patreon to subscribe to
my my friend got me into them
um
no yeah i think that that
uh we'll announce it we have two
executives now at comma
uh if we do a raise we'll like announce
it make it official
um thomas has a leadership team
i'm just the oversight guy i make sure
that
things never get you know moved away
from the original vision
which is to solve self-driving cars
while delivering shippable
intermediaries
um
oh jim has a new lex oh yeah i saw that
i saw that come up i thought it was the
old one
cool hopefully watch that tonight
um
yeah cheap
all right don't pay people to kill
people either there was this girl who
did that and she had a bad time too
it was like a cop and she was like
dahlia diplodo
uh what else we got
any other questions
i'm in the cloud boys you all know i'm
in the cloud
where can you spend see i think people
are selling clubhouse invites on the
discord for it
not enough liquidity all right you're
sending me a cheap swap link i'll see
what i got
techy token all right all right
yo you got to put in liquidity you
didn't put any liquidity in the pool
you you gotta you gotta put your token
in the pool for cats
and i had liquidity man
anyone could korean
let's look at your token
let's use the other blockers boy this
block support works better
yo by the way i'm just gonna
this guy maintains cheap swap and that
block explorer
i'm just gonna send over i don't know
here's not two thousand let's not go
crazy but
here's here's here's 200gb
how's he doing ah 3k bro
good i hope people are donating the
spirit of cheap is generosity
you gave cheap to a homeless guy yo
that's great
that's great ah
did i feel lost in my early twenties
i'm not talking about bullshit like that
man i was here to talk about cheap ethan
my
journey as an entrepreneur you know
that's right i'm gonna post on linkedin
about how now i can mentor other
entrepreneurs in their journey
fuck off you want mentorship
can't even buy that phone call you know
why because i can't mentor you'd be a
lie
there's one school out there and it's a
school of hard knocks
ah yeah show for shit seats man but make
sure to tell people that it's not a pump
that's a great place for you to practice
your ethereum skills look at how much
i've learned about ethereum doing this
tons of stuff um i hope i'm gonna do
some more work for optimism
you know they have the real l2 solution
being lost is part of the journey that's
right
uh what's that uh
um
no it's not this one's the other one
all the glory years yeah when the world
finally ends only then will our
destinies doubt us
will we spin off the edge of our steps
and our couches when just the hidden
songs are left in our cassettes and our
albums can we expect that something
better surrounds us when we exit our
houses
the death of my childhood would unfold
in notches it was a cave and social
comet of a stolen promise
so how'd we grow up but not grow up into
who we said we'd grow up into we knew we
had someday we'd grow up beyond us
and
all right so it's not mine that's not
mine don't know
and then you wrote a lot of songs that
sound identical to that one
uh not all who wander are lost right
all right nominal existence of a
temporal state ever present and yet
constantly fleeting
can i do the fast part of rap god all
right let's try it
um
um singing to a man will he play piano
man oh man that was a 24 7 special on
the cable channel
so ray j went straight to the radio
station the very next day hey
fab i'mma kill you lyrics coming at you
with supersonic speed
uh sama llama dumalama you assuming i'm
a human what i gotta do to get it
through to you i'm superhuman innovative
and i made a rubber so that anything you
say is ricocheting off of me and it'll
glue to you i'm
devastating more than ever demonstrating
how to give a motherfucking audience a
feeling like it's levitating never
hating on another haters for elevating
so that
they could fail out oh that's so i'm
devastating whether they're never
demonstrating how to give a
motherfucking audience to feeling like
it's levitating never fading in another
haters if they're ever waiting for them
they could say a fella they'll be
celebrating cause i know the way to get
them motivated i make elevating music
you make elevator music oh that's that's
oh yeah
oh
something like that oh no
uh
it's not as fast but i remember i
remember one day sitting practicing this
even when this came out i'm practicing
that
lately it seems if it's it's me against
the world like it was
before my life became a movie and they
used to use my mug and failure to cheese
me with but i flipped that strip like
gay refilla painkillers to pop the lid
off that safety seal that made me feel
amazing navy seal of bravery and if i
may reiterate i ain't even need a script
oh you see it's hard um
all right thanks guys thank you for
watching tonight's stream uh
chill for cheap but nachos is a
speculative asset
because it has utility that's right
thank you good night enjoy your friday
morning good morning everybody good
morning
all right so
i started a little bit we're gonna try
to use
this is optimism's contracts
they're using hard hat let's also
confirm they're using waffle yeah
they're using waffle
um
create a new directory called test
inside our project or directory
we're gonna have to rewrite some of this
python in uh
in javascript and typescript
and then we're gonna fetch the block
header we're gonna create it and then
we're gonna confirm that like the mining
hash matches
so we should be able to test that
function
i don't know what shy is so you know
this is the problem with the react
ecosystem
it's a bdd tdd
test driven development business driven
development what is bdd
good morning
what does bdd mean
whatever we don't know
and we never will all right let's make a
directory called
test and we'll create something called
bridge.js const
god is this typescript or is this
javascript
all right so you guys are all i know you
all like watching me struggle so we're
gonna struggle
a bit sky bridge
contract function
what's up everybody
um let's just say bridge should
deploy
all right and then we give it an async
function
yo this is this is really uh a
javascript noob stream
by the way we're drinking red bull today
bug speculators um
we're drinking red bull today uh as
creed from the office would say
we are riding the bull so you know i'm
doing drugs today boys i'm doing drugs
today
um no i'm terrible at javascript so you
all are going to watch me struggle
what if i do something like console.log
let's just
check oh yeah so this is i was i was
playing with optimisms
ah stuff those of you that don't know
you guys know i'm an optimism shell
optimism is a level two solution with
real technology
no pre-mine scams yeah so you know if
you want a real l2
optimism if you want a fun l2 and you're
here to party
uh check out cheape we're just gonna
we're gonna do the
quick little show for cheap eth if you
guys don't know about chibi
i don't know where you've been for the
last two weeks chibi is blowing up like
crazy
uh look at this we got nine gigahashes
on the network we got transactions all
over the place
uh look at this we got all these these
great community cheap
projects um these are ways to get free
cheap eat
once you have cheap eat you can play
these fun games with your cheap beef
sometimes you make cheap eats sometimes
you lose it don't worry it has no
monetary value it's like uh
chuck e cheese tickets uh
unless of course you know you sell it on
the exchange where of course it does
have monetary value but you know soda
chuck e cheese tickets let's be honest
about it
um and then we got some block explorers
we got some mining pools
i'm still on the m1 though i'm going to
switch back after that bullshit i got my
16 incher back out
um
all right npx hard hat test i don't
really know what uh here we go
okay bridge should deploy past
i was hired once on one of my uh
okay ether's get contract factory brick
is this gonna work
doesn't know where to get it from see
this is the problem with all this react
magic bullshit you never know where
anything actually comes from let's see
does it work
okay we have a bridge contract yeah okay
somehow it knows
um const
hard hat bridge
google's await bridge dot deploy
all right so this should actually be the
deployed bridge
you guys are gonna have a lot of fun you
know like telling me like george you're
a javascript noob why are you doing
console.log everywhere no one's done
that
oh oh because we have to okay so there's
a contract
constructor where we actually have to
construct it with the uh we have to pass
in a genesis hash
even though we're not using that yet
let's do that
okay incorrect data length
that makes a lot of sense
okay so
before each will run each test is that
each one of these tests
what's a better alternative
your node puzzle is going to be heavier
the observable universe
i know am i the only one who thinks this
whole ecosystem is bullshit
uh see okay so now
um javascript bytes32
how to deal with bytes32 to string
see this is what makes me want to use uh
python
i just don't know how to do any of this
know we're going to have to all struggle
with the java together are you guys here
to struggle with me
cool um web 3
can i use web 3 in here
fetch blocks all right so our goal is
going to be to fetch a few blocks and
feed them
into the bridge contract
um web
three what like what what environment am
i even in right now
oh maybe i can do like const expect
require chai
where does chai even go
all right var web 3
equals require web3 what are the odds
that works
okay it seems okay
we'll get to deploying that later let's
work on fetching the blocks
okay thank you for the hype chain
everybody yeah javascript is that some
kind of fancy python framework
that is how i feel okay web3 given
provider no we don't have that
so can i just can i do this
okay all right all right nothing looks
too bad so far
uh just copy this
we'll say const bar fork block
all right no can't say
const var is it just const
cool
um this should work the same let's
actually call this a w3
it matches the python and that's
console.log block
w3 eth get block is not a function
oh don't tell me it's like get blocked
with a capital b
there we go it's that but oh it's a
promise
it's a promise and that's because we
have to await the shit
yeah let's await it all right cool
it worked yeah buddy
yeah buddy i'm a javascript programmer
everybody
let's get on this hype train let's
subscribe if you want to see
elite javascript skills i added a weight
and it fixed my shit
elite javascript skills
are you new so we're writing a bridge
contract we're writing a bridge contract
to bridge
eth over to cheap eth so as
the hacker news scammers would say we're
taking all the liquidity from me
and moving it to cheapy and locking it
there until we write the bridge back
where i can dump or something i don't
really know you know
it's hard to follow haters but if you're
a cheapy fanboy
you know what this is this is going to
let us get access to the state of eath
on cheap
did the eth people pay for this no
nobody's paying me for this
um
yo jason let's let's thank you thank you
what's cheapy if you don't know about
cheap just go to cheapheath.org
um you know ethereum you like ethereum
you wish you can use it but transactions
are 100 fucking dollars
you need cheap beef it's 100 compatible
with eth
except 1000 x cheaper and you see this
little star
it's like imagine a 100 compatible car
with your car
that's a thousand x cheaper or how about
a compatible cup of coffee
are there any fees yeah but they charge
you cheap gas
the fees are so small
the fees are so small that you can just
you know yolo with chibi
and it's a party unlike your real eat
where the fees are very expensive and
you're like
speculators ruined my life
i save you from the high gas from the
from the from the high gas cost why are
the fees so low because we put cheap in
the title and we kicked out all the
speculators
either bitcoin or tanking no i'm poor
i'm poor nope psych i'm a no coiner
that's a pretty big tank
you know what that means that means the
price of cheap heat is coming down too
they tanked and make eath gas fees seven
hundred dollars can you use cheapies
with urban i think urban should redeploy
on cheap i think a lot of people should
redeploy their projects on cheapy
because it's like eve but cheap if your
project's not for speculators
cheap eats a great place to put it
tethers still a dollar yeah
whoa whoa how is the currently winning
l2 solution doing
oh crap that's not good
might that freeze
that's not good there's some chance
we're gonna lose the stream
i don't know why that's doing that
no i do not want to close all the
processes in this tab okay i don't know
why that just happened
uh did i forget to close my for loop no
uh wasn't tether a pump scheme no no no
tether
tether is a stable coin tether has the
same feelings about speculators that
cheap eat does ah
binance up up up up tethers back in
third i see
okay uh i'm gonna close chat because you
guys are distracting and we're gonna
code some javascript
all right so you'll see this is what i
coded in python
i'm gonna have to get a block header in
web three
i'm not gonna do any of this stuff all
the other things should be the
same we have like a block
you know what let's just do four block
plus 100 for now so we cannot
get spam with tons of transactions
okay so this is a block
we need to figure out how to work out
the hash again
okay
is that javascript syntax
i don't even know
um
what are all these demos in python
promise returns object the rlp encoded
we want to get the rlp encoded block
header
javascript rlp example
i mean it's not gonna be as nice as the
python one but i think this stuff should
work
so we have the parent hash
let's just try that and see it's gonna
complain like i don't have any rrp
can i really type import is that is that
javascript syntax
i knew that wasn't javascript syntax
what is this crap
bear rlp equals require rlp
i wish i had chat to tell me and maybe
chat knows
okay we have rlp so let's just say
dad yeah right
good we have a buffer um
let's get the same buffer from the
python
so our goal is going to be to reproduce
that
but in python not in javascript sorry
block cash
oh do i actually put that in hex and
then it
well let's see so parent hash is 35 one
f wow so it's actually converting it to
hex like take a look there it's not like
taking the ascii
you know
see this this is why i like python in
python i can make sense of things like
that
and in javascript i cannot
okay so we got to get the uncle's hash
watch out for uncles uncles are coming
uncle's ash shaw three uncles
uncles
um i
think i can just say blocks of minor
here
[Music]
coinbase state root
just copy that copy
that copy
that
this one maybe even just that
these ones i'm gonna need
just copy all that and just clean it up
these need to be web3.util
you know what what if i just say var
x equals with three
channels to x what do you think of that
boys what do you think of that
save my fingers in the typing is that
allowed in javascript
who knows nobody knows javascript you
just follow tutorials
i'm a javascript programmer
number
yes these might already be hacks because
like javascript can't do any uh
no they're not you guys know javascript
doesn't have integers it's just
everything in javascript
floating point number
okay time stamp and then we have block
extra data
block mix hash blocks
nazi it's not actually pronounced nancy
it's pronounced nonce
sounds stupid if you say it wrong so you
know don't listen to me
i'm not a good programming teacher
oh we got the nancy oh good thing we
have where we imported the nazi
okay f90203 okay it looks like it looks
like we got the length right
all right now we want to do a keck hack
let's let's kick hack uh
and if we did it right if i console log
the tech hack and i also
do i think it's just called block sub
hash
they should be the same
cac is not defined oh web
3 tech activity sex
oh i can use web 3 sha3
now i don't want to get you know i don't
want to get shot at three chantry's not
a function
web 3 utils solidity shot three
oh well
okay sadly the numbers
do not match and they were supposed to
match
so let's figure out how to get wrong
um javascript hex hexdump
yarn add hex dump js
oh yes good oh i'm learning the
javascript ecosystem boys
i did a yarn ad
ah okay let's try console log
hex dump that and we're gonna need a
require up here
first argument to dataview constructor
must be up
you knew what i wanted why'd you make me
do that
all right there we go well that's way
too damn long
what that doesn't make sense
not a buffer or something
rlp code
hmm
yeah this clearly doesn't match this
javascript buffer
look at this hex dump is a scam
did i use it wrong
console log hextone dot buffer
never mind i don't like this thing and
i'm taking it out of my yarn lock
hex dump sucks
yarn now i run yarn and it's going to
remove hex dump js so we can pretend
that that never happens
yeah can i do my yarning right good
thing i'm not using npm i hear yarn is
fast
okay 5 34 is this 5 34
what is that 5 34 x
2 16 yeah that's 2 16 okay
maybe it's just the wrong s strong uh
hash function
is getting cat correct javascript
there has to be like a normal way to do
this
what's the problem like everyone's
written uh
three shot three
rlp encode javascript
test
i really have it in test
[Music]
no
if you tell buffer dash
i can use ethereum jsutils do i have
this one
this has cack
the thing is i don't know is this like a
common thing that people use or did i
just find some weird package that
nobody's ever used and it's like not
gonna be supported
all right yarn add that
how are they doing this import crap
a bunch of damn cheaters you know
oh hash equals
require theorem jsutil.hash is that
going to work
and then instead of solidity shot three
i do
keck activity six fingers crossed no
don't do that
cannot read property tech act 256 of
undefined
so
no just gave me a buffer that was wrong
okay
so the other one did give me the same
stuff
all right so it turns out we didn't need
that package let's not let our
dependencies go crazy here
yarn how am i doing you guys screaming
at me in chat being like george you're a
javascript idiot
the import syntax should work if you
specify
your files mjs
no i'm not using a vip
yes
yo you're right i do need to put
stickers on my macbook and drink pumpkin
spice lattes that's how you be a jo
that and i could be a javascript
programmer
no wonder i'm struggling so hard with
javascript
no he wasn't loud is it loud i'll turn
it down well
we'll turn it down a little quieter
um you i'm a boxers guy
all right dish number
doesn't match dish number and we're very
sad about that fact
oh well
okay i notice the difficulty is a little
problematic
uh block parts
you know i bet there's even like
debuggers and stuff if i really knew how
to use this ecosystem but
you know me i'm a print debugger guy
all right those all look okay
gas limit gas used
time stamp
they all seem correct the length is
right what'd i do
it doesn't match
mix hash nonce
mix hash nonce
we're gonna have to figure out how to
print it and we're gonna just compare it
bite for bite
javascript
two string dot hacks okay
no no don't do that no i definitely
no please no no i don't want
yarn yeah javascript programmer
all right so that's all the crap let me
do the same thing in python
be an ascii.hexlofi
stupid python
okay we have this one
and we have this one what's the
difference who wants to play
spot the difference
long long let me just disable i'll
disable word rap this should work
ah rapture page no
crap to window no don't rap at all
no wrappies all right you know what vim
doesn't have rabies
bim has wrappies oh them disable
word wrap
they look the same to me
uh how do i actually check if they're
the same
they're different day okay where are
they different
it seems like it's not just like a line
or something right
what's a good tool for this who knows
split jars to line
google online diff textcompare.com
all right let's go
i know i can see if they're equal in
that i'm aware i could have just done
that a python console but it's basically
the same okay
ah
they gotta be kidding me with this
really you can't run text compare unless
i do fucking captures for you
oh okay
okay the eight and the zero
is thirty one eight versus thirty one
zero okay let's see what the difference
is
um let's buy acme
31.
so that's the thing after logs bloom
[Music]
difficulty number
why are you working on eth when better
kryptos exist you're the reason i'm
minimizing chat
all right so this acme and then this
double this zero is the problem
gas limit gas used
is that right cast limit gas used
all right so just my hair
84 versus 80. it's the zero
it does the same thing
it doesn't like that it's a zero some
reason it's giving me a different answer
chat you have any solutions
the mic is low all right well up the mic
alright louder
[Music]
zero
so let's just try like what if i put one
in there
let me get a one there
should not fix it
an actual zero gives me a different
answer
versus if i do that uh
oh no no i commented out gas limit i
want to comment out gas used
okay now i get the same thing okay
ab3100
make that like a one after ab three one
i get that
what if i put in hex 80.
i get something different 8180 i say
rlp online decoder
where's this thing here we go
we're all p encoded hex string here
okay i get hex 80 there but it's not
supposed to be 80.
this is actually a better way to go
about this let's open up two of these
guys
now for the python
huh
so i guess it replaces zero with actual
just zero
okay now they match
oh man that sucks
all right let's try to hack for it uh
function x if x equals zero
javascript of inline f's
ah okay
function x x equals zero w x
hit undefined uh obviously return
there we go okay matches now
um
block parts
so
okay uh assert
is that a certain javascript it's
probably like chai
search chai cert you can only use chai
certs if you of course named it a cjs
file and you compiled it with
a cert doesn't work right um
let's just look at demo there's a way to
do this
expect oh yes oh i expect
good
um
block hash is correct
let's say javascript
block hash is correct um
so what we're going to want to do is
we're going to want to say
uh bridge adds
block uh we're going to say
genesis block equals let's say work
block minus 101
add block equals that uh when we do
deploy the bridge we're going to deploy
it with the
genesis block hash
does that work
great um now we can confirm
mining hash i believe uh it is
private so it's actually not gonna work
sure there's some way to do this private
hard hat test private function
and solidity
smock the powerful mocking tool for hard
hat
great i just need to what optimism wrote
this
only external function calls can be
mocked all right
here we go if they are
internal functions you can inherit them
and test them
if they are private functions i believe
the only way you want to test them is to
make them public internal
test them and change them back to
private once the tests are passing
another way to go about it would be to
refactor your code such that the private
functions are in a library that you
import into a
contract okay let's do that
um
solidity library
what's a library in a solidity the
library is bullshit that you gotta do
bullshit
and if you don't do bullshit you're
gonna get bullshit all right great
thanks thanks solidities
all right you know what uh fuck unit
tests
let's go uh roping
bridge dot submit
header
we'll test it all at once it's fine uh
bridge submit header
ad block all right
console.log red
let's go
warning unused local variable bridge
submit header is not a function
well
ah
why is it not a function it should be a
function
oh cause it's only the hard hat bridge
that's stupid
your naming convention is stupid
oh let's call it contract bridge
here we'll say contract
you know what i have a better idea these
naming their names are really stupid
we're going to call it a bridge factory
and then the bridge factor is going to
build a bridge
yeah buddy let's go
all right now we just got a promise so
we don't like promises i know how to get
rid of promises you just gotta awake
them
i wetted my promise oh that doesn't look
good
oh
invalid array of five value
oh because we gotta pass in the ad block
rlp
okay cool that worked um
hash black ash what
weight function anonymous
no that's just a block
constant balance that's not what it
returned
i don't get it
why is it returning that
why didn't it return mining hash let's
have a return
one two three seven
turn type of int blah is not
terrible wait wait
what if i say bites 32 a equals one
three three seven
and then i return a oh is that gonna
work or did i get you solidity
did i get you no i didn't get you oh
it's not implicitly converted well what
if i
explicitly converted c style type
casting
you got to know all the programming
languages boys you got to know all the
programming language because you never
know
is it that sometimes you just got to
guess you know that's what programming
is nope it's not any of those you can't
do it explicitly and you can't do it
implicitly oh that's great
um oh let's put some quotes maybe some
quotes is that going to do it
quotes come on quotes oh yeah quotes
all right now unfortunately
uh none of those things is one two three
seven
how come public returns bites 32.
when they call balance of it works okay
i deployed it
um
no no no no no the ones that's that that
one's the chain id that's not right
uh why doesn't it give me the return
value of submit header
public returns bytes 32.
um
[Music]
no that's great
okay
why
await bridge submit header
functions
let's look at this contract and see
function balance of
external view returns
public returns
if i say uh view did that fix it
okay now that looks a lot closer to one
two three seven
oh that's one two three look it's one
two three seven but in ascii you get it
who gets it oh you get it it's funny
right it's funny right
because it's a string you get it this is
funny
oh i already called it external because
i called it public but it's not a view
so
that doesn't work um
all right there's a way to get the
return value if it's not a string who
knows
cast the gap mining hash no
it's funny right it's funny
um no
weight function anonymous
it's a green screen guys it's not real
it's a green screen
i moved to the cloud a while ago
and uh
so i don't know you know maybe that one
just doesn't give me any
returns that's that's okay
look at this contract that one doesn't
return anything
we won't make it return anything anymore
uh we'll just do submit header
doesn't actually have to return anything
okay so
remember what i was doing in python with
a mining hash
oh we're gonna have to get the nazi it's
not called a nancy remember i'm teaching
you bad things
um
that guy down there
[Music]
and we're gonna copy out of
this guy
accepts an rlp encoded header decoder
block number here get parent number
block diff
let's just try this
i'm also going to have to figure out how
to import the real breeder
rilp or lp recursive length prefix
encoding or something
all right decoded parent decoded block
number
uh and here we're going to want to say
headers
no reason they can't be public
i should just want to get header thing
is there city on my iphone no i'm just
texting about comma
we're hiring someone new
whether i want to talk with them or not
all right um
using rlp reader for star
we're going to have to get the rlp
reader
oh i don't see an rlp reader expected
primary expression
is it in merkel patricia proof
library merkel patricia oh here we go
import node modules solidity rlp
oh that looks great don't you think
the library solidity all rlp is not
installed oh
whoa don't tell me this is gonna work
really i can just yarn add solidity rlp
and now i have libraries deep in my
solidity
oh never mind
it doesn't work
current support for a shitty old version
of solidity
great i don't know let's try that
solidity don't match any of the
compilers in your config
well i don't know what solidity versions
are there
0 6 12. that sounds like a great version
i heard i heard great things about that
version
let's go boys
um expected primary expression oh here
we go this crap okay
well that's better it says okay error uh
headers
uh block hash equals copy that from
this boy here no testimonium core
so this testimonial project's doing
something pretty similar
to what i'm doing
so that's why we're using it uh
i had a memory new header
there's some block caches
we actually really um
their names are kind of stupid
clean them up clean it up if i play low
windex on stream
what no come on
come on don't give me this crap
not found file outside of allowed
[Music]
directories
oh
no
all right let's look in there and see
let's read f relay
i'll see they're using truffle
i'm using that version of the compiler
oh thanks for your infuria i'm going to
steal that for later thanks here and if
you're a hash and let's sign up
ah what is this in package.json where's
what it tells it to build
probably truffle but we don't use
truffle we use
waffle file
outside of allowed directories
how many people we got you say we got a
lot of people
855 that's pretty good
this could be related to the
restrictions of saul c
i was able to get it to go away my god
let's run it with show stack traces
oh simple task definition action okay
a hard hat allow paths
saucy
oh here paths okay look at my hard hat
config
module exports sources tests i don't
know that's not gonna fix it
this is not going to fix that
files outside of allowed directories
i guess i could move it into an allowed
directory
the following command should work if i
all right i think it's subscribers only
chat time
maybe subscribers can help me out
no i believe in your non-subscribers but
you know say reasonable shit please try
to stay on topic
we're here to we're here to be on topic
not found file outside of allowed
directories is it the version that's the
problem
when i added the code in the project
folder yeah i'm aware i could do that
but like i knew i knew that that was too
good to be true
i knew that it was too good to be true
and that it wasn't just gonna work
let's see this link
compile does some magic remapping well
i'm doing the magic remapping i'm doing
hard hat test
ah let's make sure that that file's
actually there
here looks good
you can add the allow paths pwd
okay where do i add that
where that my hard hat config
oh hard hat config saucy flax
no
i'm running it from a path that's a
parent um
no it's not in the vimrc that's not
right waffle
ethereum saucy arcs i don't even know
what's
building this like that's the problem
great thanks for uh hard hat
config examples
now i know how to do it using the
command line that's not the problem
hard hat ethers waffles type script
solidity it's probably in solidity
oh ethers is a replacement for web three
i say
okay let's go with solidity
uh version
maybe options i'm gonna guess
allow paths pwd
we're really guessing at that
mpx what was i typing
no
module exports
solidity version
settings
flags
unknown key flags okay so what's allowed
in settings
evm version optimizer settings
we'll read the code
documentation
uh using the hardhat console
optimizer
compilation fouls
no i mean this will work if i if i
oh it doesn't like it because it's
relative
no that's not right
how does anybody ever get anything done
in this in this ridiculous ecosystem
like how am i supposed to possibly know
what my magical export is
unless we start reading the code
this is called saucy great
oh the issue is that the compiler
creates a virtual
file system i have an idea
what if i try this
the library solidity rlp
[Music]
contracts is not installed
what if i get rid of the node modules if
i do that
let me get rid of these stupid settings
sweet it works
all right good deal
i don't think typescript would have
fixed that
all right we're importing solidity rlp
now
and now it's just complaining about this
crap
all right let's see how testimonial does
it
redefines these guys
ah type can't be implicitly converted
what am i trying to implicitly convert
shit
oh god
for the most part i like their their
little data structure
uh did you intend to add public to what
to the constructor
do i have to
okay cool
um
i can say something like revert right
what's the solidity syntax for revert
we'll start with require yeah let's do
that
um
is header stored
yeah cool we can we can
we can use that same function
so i like the way testimony i'm storing
the blockchain i don't
like their challenge mechanism which i
don't want
okay revert parent does not exist okay
that's correct
because we're going to create the parent
now
and we're actually also gonna pass in
here
we'll just say you and uh genesis block
number uh
the difficulty can be zero
the parent hash is zero
the block number is genesis block number
so the genesis block we just like put it
in
all right and then instead of block cash
here we say genesis equals new header
okay cool
we're also going to have to pass in
here the genesis
blocks
cool um
now we actually want to assert that the
bridge actually adds the block
builder is now hard hat learn about the
latest release and rebrand here okay i
like the tutorial it's pretty good
testing contracts
okay um expect
oh wait uh
we want to confirm that the genesis
block is actually stored
so we can use his header stored
genesis
smash
reference is header stored is not oh
bridge dot
let's go sweet
okay um this is junk
but now we can also say expect
away uh not can i say not
exclamation point
shit
hey
disgusting fucker made tabs
sorry i i curse a lot javascript makes
me very
angry if you guys haven't noticed
what is a bridge you know
testing adding a block
okay uh so we're not actually we're just
adding the block no matter what
let's test a few more things
um some of which we can steal from
testimonium
require the parent to exist
uh header storage parent header that's
right that blocked the successors of
parents parent header.meta wow that's
that's a lot
that sounds expensive i don't need that
uh i do want to require uh
parent header dot
block number
um is equal to
uh decoded block number minus one
uh parent block number is
okay in the spirit
of making my
um job ruined my life and killed my wife
damn all right it sounds like you had a
worse time with javascript than i did it
just makes me angry
uh all right in the spirit
of being nice to noobs
ah tell you man rebel fucks me up
you know i think we gotta eat some pasta
hmm uh first we're gonna pee again
and then we're gonna talk about what
we're doing
noobs like you some of you aren't noobs
and the ones who aren't news i don't
mean to insult you but
i worked out this morning boys worked
out guess whoa
all right you guys can you guys can come
over here while i cook
well that's just scratched on my wall a
little
all right i'm over here now uh
we're just gonna put a little pasta on
the stove
i got a nice four cheese sauce to go on
top of my cheese grab me all these
and i'll tell you all what we're doing
so
we're deploying a contract to the cheap
beef chain that is going to
track the state of the main chain
uh so what that test does is first
submit to genesis block
all chains have genesis blocks we don't
have to start at the real genesis block
of ethereum
the genesis block is just trusted
because that's what's in the contract
when i deploy it using a constructor now
the block
add function is going to add a block and
verify that that block was
actually mined with difficulty so that's
why we're computing those hashes there
now
beautifully
when i do noob explanations you guys
understand like who's who's following
what's going on and who's not chat and
come and look at you
we have two minute spaghetti here
sammy followed all right solidity
something something yeah something like
that
oh yeah i love my monitor my keyboard
ah good good good all right
i'm gonna have to refactor it this
code's becoming terrible
um
all right so
uh we actually also we wanna yeah
parent header total difficulty so we
track the difficulty that was mined on
the chain
we'll have to write some logic to find
the largest one
um
chain
verify block is in
chain
uh verify block was
hard to make and that's what we have to
write here
you just got in all right cool uh
well if you just got here i'm really
glad to have you
uh
noobs might also appreciate bigger font
in the terminal no i'm sorry noobs i
can't help you with that because then i
can't see
and you know we got we got real work to
do we got to make cheap ether success
guys there's haters out there there's
haters out there who
hate cheap eat and want to see it fail
and we got a code to prove the haters
wrong and make cheapy a big success
to spread the cheapy love to everybody
you know
haters that's right uh
what are success criteria for cheapy did
we all
party and have a good time and did i get
a rolls royce
the success criteria for cheating
no the idea should be looked do your
ecosystem is great
um man i'm looking out at the water
looks nice for sailing today
uh
whoa whoa whoa you don't want free man
never trust anybody who works for free
never trust anything that's free
you know because nothing's free man
facebook's free
you want things to be cheap cheap is
good
uh i'm in the cloud this is a green
screen
you're about to see me eat some cgi
pasta
uh okay we have to verify the block was
hard to make so i wrote this logic in
python
um but it's gonna be a little annoying
because we have to actually get
sha 512.
okay so let me read the code i wrote in
python
we have to get the
mining hash plus the nonce
flipped around so we're gonna have to
get the nonce out of here too
and we're also gonna have to get the mix
hash
um i'll just call it get block
data
32 mix data
yes
this stuff should work
i have no idea if this is allowed but
we're doing it
uh mixed data
actually i'm gonna use this function in
one place it's kind of stupid
um whatever
height is 32 decoded nonce we'll stick
with their stupid thing
decoded mixed data
decoded mixed data decoded not so we
need the mixed data and the nonce
to compute the difficulty
expected semicolon but got bytes 32.
bad me oh my water
we'll be making pasta
i'm sorry guys i gotta stir frequently
timer five minutes
i got the stir right here i'm gonna stir
it
in some olive oils and boiling water we
can do that
let's get it boys
i'll show you the pasta
we almost at 1k oh no
expected semicolon i've got another
semicolon you guys got to be like george
if we're getting semicolons and then i
won't
block data
it's not implicitly convertible okay so
let's take a look at an rlp
item let's read that code
len mempoiner
two uh
two bytes maybe two bytes here we go
oh this is a convertible
[Music]
oh i see
maybe to you and yeah i guess a parent
oh yeah let's see you in because parents
doing the same thing all right cool and
it might complain about my nonce only
using a bytes8
oh my god
[Music]
um
okay now we're getting the mixed data
and the nonce
and then we're going to have to write
the logic that combines them
uh so if i recall correctly we're doing
a sha
3 5 of mining
hash plus
i shouldn't call it the code nonsense
dead
[Music]
we want to do um hh equals shot
if you said that
decoded it's called mix data or mix hash
[Music]
what
very good
okay so the shock three 256 is cac
but the 512 one is not
is it you people think i'm like super
like productive can you not like sit for
two hours and work
you know most people can
exactly
okay so if you guys remember from when i
did the python on the last stream
um
oh and then we can start writing the
submitter service oh this is exciting
if we go hard right now we might even be
able to get this deployed today
i think this is the only thing i have to
do
num i'm also going to need something
uh
why do i have to store the parent hash
kind of feel like i don't have to if i
just store the
block number and the total difficulty
i never checked that all right let's
make let's minify
this because we don't actually need that
the less stuff we have to store
the cheaper it is and i know cheap is
cheap but
um get rid of that we don't need that
zero is a fine place
okay so they have an implementation in
here
of shaw
no i think it's here in eth ash here we
go
they have a lot of stuff in here that i
don't think we need
you went 25 memory a
sponge
five twelve there's no way i can do
cat cat 512 right that would just be too
nice
right um
no actually we are going to need uh
i'm gonna copy mining
cash i'm gonna say 32 plus eight
mining
plus
i don't know if that shouldn't work
does that work can i index into bites32
like that
sweet i got
um let's get my console.log working
you're really gonna make me type
oh i have to misspell builder as biddler
oh oh great um
i think this is actually probably in the
hard hat tutorial
no it's not
can i do this is this gonna work who
thinks this is gonna work
oh i have to i have to flip the nonce
too
uh the library librarynomiclabs bidler
what if i do nomiclabs hard hat
to use it you need to import hard hat
oh
maybe it's just hard hat
that
you can't use console.log
after argument dependent lookup what
log bites because it has types
sweet um i don't know if that's right
but actually we can check it
[Music]
let's um let's put the same shit in the
python
uh it's actually already here
oh we're exiting much earlier than that
oh because that's actually after we shot
it so let's do it before we shall hash
it
okay cd9a
it doesn't seem like it matches
no
okay the mining hash doesn't look like
it matches them
does the nods match are we just on the
wrong block we might just be on the
wrong block
um we're getting
fork block minus 100.
so what i'm getting here too
all right good that's the same
i want a bridge test to go right there
okay yeah
yeah so we do have to reverse the knots
uh how do i want to do this
what do i say 39 minus i
it's all right 32
plus 8 minus 1 minus i it's 39 i think
all right
so then with cd
it does cool so we just have to
shop
um i'm a no coiner boys
i'm a no pointer i own no crypto it's
all
fake it's all fake money
i'm not going public with comma fuck
that shit
i go public someone's gonna be like well
you need to have
four board members and here's a person
from the deep state who you have to put
on your board
and this person from the deep state is
gonna look at you and make sure that
you're operating within acceptable
parameters
and also you have to submit audit
reports to the sec
every six days so you're going to have
to hire a full-time person
to do sec audit reports and this
full-time person of course has to be a
graduate of harvard
yale or some other cathedral school and
that
is how they infiltrate your companies so
therefore
no not going public fuck that shit we're
profitable
[Laughter]
you see our fire tweet last night
chris has been running the twitter chris
has been running the twitter
look at this fire man look at this fire
heat state supports lidar
uh no don't take the deep state too
seriously you know
some people take this shit way too
seriously
don't take it seriously it's all for the
laws but also don't take the company
public
because there really is a lot of
bullshit you gotta do and it does all
benefit the deep state
i use deep state someone somewhat
synonymously with the professional
managerial class
you know two two cool
definitions i like there's the
professional managerial class and
everybody knows who they are
you know uh not all members of the
professional managerial class work for
the deep state
but everyone who works for the deep
state is a member of the professional
managerial class
there's also the perpetual conference
class if you wonder why all conferences
have gone to shit
and like you had a conference that used
to be about hacking but now it's about
gender equality
and you had a conference that used to be
about psychology but now it's about
racial justice
those are the members of the perpetual
conference class
because they go to conferences all the
time they don't really know anything
about hacking they don't really know
anything about psychology
so they show up and they want to talk
about gender equality and racial justice
and you know these are nice things
they're not terrible things
gender equality is great racial justice
is great but like i thought this was a
conference about hacking
oh oh well shows you what i know
but they have more time than you right
and that's kind of the problem you're
like you know
hey def gun's a party you go to once
every uh
you know once a year and they don't view
it that way it's a war
brought on by the perpetual conference
class gamergate gamergate gamergate
boogieman
some of that shit you know i don't know
it's all too hard to follow and that's
what they bank on
and that's why you just gotta write code
and write good code if you write good
code you win
because you can't stop the code man code
is
law natural law
not legal law but natural law code is
law
maybe some tea
no don't stop boiling with tea
are you feeling okay today
i watched a video last night about
narcissistic personality disorder
and i was watching it and i was like
damn this actually describes me pretty
well
and then at the end they're like if you
watch this video and you feel like you
have narcissistic personality disorder
you probably don't especially if you
feel like you agreed with a lot of the
stuff that was said
if the stuff that was said made you
angry then you do
i was like damn that's a really good
video
real talk though you think we can win
versus them there is
there isn't really a them right um
some people take these things way too
far
like that there's actually a deep state
out there and they operate from the
basement of like a pizza uh
parlor or something or you know there's
secret sex rings run by all the
the politicians there's none of this
true oh my god none of this is true but
it is true that there is an idea
and there's an idea maybe the idea of
the professional managerial class is
like
oh you know your your uh
your your taxes well they're too
important to leave up to you you hire an
accountant oh your fitness well
that's too important to leave up to you
you hire a trainer your emotions
well that's too important to leave up to
you you hire a therapist
you hire all these professionals who
manage your life
um and these professionals have have
have
kind of metastasized right they're
they're no longer
some of them do provide value i have a
personal trainer it works great right
there is no there is no big personal
trainer they're individual people who
know things about fitness and are good
at motivating people
but when you start looking at things
like well big education right it's like
oh your education that's too important
to leave up to you
that's all a scam like like
education is ten percent learning and
ninety percent indoctrination
so are these streams by the way you know
you all think you're getting out of
being indoctrinated
um jeffrey epstein looked like it was
real they yeah but you know just like
don't go too far with that
open did 9 11.
uh no i mean look
here's what the cia wants right the cia
the cia practically invented conspiracy
theories and it's a quick way to
discredit something
and you know the people out there who
believe conspiracy theories like like
the really dumb ones like oh we didn't
land on the moon and like trust the
plan q anon like what that all is is
just
noise to prevent you seeing the real
conspiracies which are that like you
know
all the money was made fake in 1971
that's a true
story the money before 1971
was backed by gold and one day
they were just like well shit if it's
backed by gold do we want to print more
we got to get more
gold but if it's not backed by gold
anymore
we can just print more
and you know that's not a conspiracy
theory that's a real story but
you know don't worry don't worry the uh
the blockchains are are coming for them
and coming for them who's the first
country who's gonna put their currency
on a blockchain uh
fiat money is a boomer scam i agree with
that
all right good so that works you guys
get me all amped up you know
guys get me all amped up talking about
going public and you know what
we need to uh
we need to meditate using my meditation
eeg headband brought to you by muse
uh i put this thing on
it makes contact with my head
yo they they really should pay me for
this shit
uh all right i'm doing exercise three
called sensation of breath
i'm doing a three minute mind meditation
my muse is connected to my muse app
got to make sure that these sensors get
a good reading
on my head
you guys can't say signal quality jack
oh
for this calibration find a comfortable
position
and close your eyes take a deep breath
muse is now listening to your brain
signals
relax and let your mind flow naturally
no need to do anything think of this
calibration
as a time to just be
[Music]
follow the instructions on the screen to
continue
when you're ready close your eyes find a
comfortable position
and allow your back to be straight take
a moment to notice that you are
breathing
now choose a place where you can clearly
feel each breath
you might feel how your stomach expands
and contracts
or you might be drawn to the rise and
fall of your chest
or maybe you can clearly sense air
coming in and out of your nose
once you've chosen a place pay close
attention to how
each breath flows notice the brief
moments of stillness between
each inhale and exhale
for this session do your best to keep
your attention focused on how it feels
to breathe
in every moment wherever you feel it
most clearly
when the weather gets intense and you
notice that your mind has wandered
try not to stress see if you can simply
return to the breath
ready place your attention on your
breath
now
see if i think hard
you hear the rain come and if i focus
down
you hear the rain that's because i'm
thinking hard but now watch
i'm going to start focusing
and it clears up
i had to think too much
i can focus and make it right
i can relax
and the butter mixture you're doing your
face
i opened my eyes and now the rain's back
i gotta focus
oh yeah buddy great job
thank you phone i appreciate your praise
it's a muse yeah so we can see my
results and you can see
how i did
hmm that was pleasant
yeah yeah the rain the rain is a way of
signaling your brain
i got a slow filter running on it too
that's pretty cool
maybe we'll do a stream where we hack it
and see what it's actually sensing
okay so we were up to the point
where we needed to figure out how to
compute
so we have to do a keckack 512
and all we can do
all we can do
yeah i don't know we might have to use
oops
don't need to mess with that anymore
data location must be call data
memory
functions are not allowed to have the
same name as the contract
oh i see
this contract look like it's gonna need
some love
that's junk
these ones i probably want to say memory
assuming this actually works which
means we have good debugging tools
expected comma but got memory oh
well we have to do that
speaking of comma let's just check in
foreign
go check out plot juggler and open pilot
it's been very exciting
okay
compute s
that's kind of nice actually oh this is
really it's really only designed for oh
so i don't actually have to do any of
this
um reverse bites
maybe i actually just do want to copy on
this f hash stuff
i don't know what an f hash interface is
but if i do this and i just copy out
i can work on optimizing it later but if
it's correct let's just use it
okay so how do i use do i have to deploy
this contract
or can i can make it a library right i
don't really want it to be a contract
i'm gonna guess i can do it the same way
i did the other one uh
import
three five twelve
um and we can say
using uh
f hash for star
let's figure out how it's done
the library sha256 is not installed
oh maybe contracts
maybe i just do
memories in there
libraries can't be inherited from
you know what
no it's to be like oh it doesn't have an
sp jerky
it looks identified sp looks identified
there we go
cool warnings are gone um
all right so i should just be able to
call compute s
instead of this let's just do compute s
uh let's try uh
that in
and then we want to say uh
does it work
so we actually should know what that
hash is
yeah it should be six eight nine one
declaration error undeclared identifier
because we wanna say
uh
it's amazing that solidity became a
language
um
i guess what we can do is just make
those guys units
no reason to do all that ridiculous
casting
just what it does
god really
oh no that's a different problem
oh
i think we actually want to change one
of those we keep the mix hash as bytes32
we'll make the nonsense yeah whatever i
don't like
any of this anymore
okay so invalid implicit conversion
from that to that instead of log bytes
what if we just do
console log sub zero
2a 3a
oh two a three a nine one six
eight two eight three eight nine one six
eight awesome
that worked i love when things work
guys know i love when things work let's
go
um here's what calls compute x
all right computer three
that's just right
uh c-mix unfortunately isn't that right
now
that's okay we can fix that
let's change that to fights 32.
decoded mix hash uh
u and h h is that console.log hh
all right just so you know i'm not
fooling you guys we expect
this number
c mix
three arguments were expected but given
one
oh use abi encode pact
okay it's not the number i wanted
uh let's also console.log the decoded
difficulty
because that should match as
i well that's what that other number is
oh no it's that divided by that
is that allowed
i don't know about that that sounds like
player problems okay
maybe we just do unc mister we don't
uh big endian encoder
yes we got the number look at that
boom
um i mean this big endian thing uh code
needs to be refactored to not
be junk this is junk code
you shouldn't write code looks like this
look at these like reverse bites and
then like these yeah don't do this
it's gonna cost a lot of gas i shouldn't
say be junk
not use tons of gas
even cheap gas
recommit this
let's run the test once more confirm
that that block's actually right
uh if you guys want to follow along with
where i'm playing it's actually on the
cheapy
github bridge right here
okay so this is good stuff
um we're gonna have to confirm we're
gonna have to get that divided by to
work
uh divide integer
division solidity
uh
how do i do that because i i need to
actually do that
maybe they do it in here somehow
i can't even mention the word difficulty
maybe it's in here
i don't think i care about this
recheck the difficulty anywhere
um we are going to need this
oh that's nice we don't actually have to
track oh that's smart
add block to chain
new header some difficulties go oh yeah
hell yeah
uh we're actually also going to want to
say here
launch chain endpoint equals genesis
i don't really need to but i think
that's good
it's not a bad function to have
okay we have to confirm
that the block was actually hard to make
oh it should be a byway bridge well you
can deploy the bridge both ways
the problem is it's much harder for uh
it doesn't really have too much meaning
because the difficulty of cheap eat is
low if you were to deploy this on eth
you could do it both ways the problem is
it's barely worth it because the hash
power on cheap ethics
is so comparatively low um
the bridge is gonna work both ways but i
have a different scheme in mind
uh for making the bridge it's gonna be
like a like like like a federated thing
which you see a lot
i'm glad you had fun recording twitch
slap that's fine
all right we got to figure out how to do
that division what is that equivalent to
i mean the thing that we want to assert
we want to require hh
is less than this
i mean can i just multiply both sides by
the code of difficulty
and just assert that there's no overflow
that's right
no
that's the same thing as two times times
right yeah
uh
why can't i multiply both sides of that
by the code of difficulty
no no no that's wrong uh
that's not dakota difficulty
dakota difficulty is this
yeah so if we take this and we multiply
it by
this uh and we assert that it's
less than
yeah that's true uh let's try it with
the max
possible one which is this one and
this one we still expect to be true but
then if i change that last number to a
six it's going to be false
okay good so this works so we just need
to do hh
times decoded difficulty
we have to use how to safe math work
how was that
wait what
so i can do divided by
i'm just going to import save math
okay um
require
this should be right
oh maybe the problem was uh that that's
just too large of a number
division works
should work all right
cool
i think all that logic works
so
maybe i do need the parent hash i'm just
thinking of like
if i want to like go back 10 you know
we are gonna need the parent hash okay
we'll put that back in
okay block the chain
uh
let's say bridge doesn't add broken
zero one two three four five six seven
eight nine ten
eleven twelve thirteen fourteen
broken
junk
oh transaction inverter without a reason
okay how do i expect revert
because that's exactly what i want
oh reverted without a reason let me give
it a reason um
block difficulty
didn't match
ash
sweet
that's pretty good
um let me assert revert
ah that's in the tutorial testing
contracts
okay wait
expect
uh
expect bridge submit header ad block
block rlp uh
to be
reverted with
block difficulty didn't match
right
um i'm gonna refactor it a little
here
before each
bridge contracts before each
uh this
good refactor
uh next
clock isn't there yet
bridge is not defined okay
bridge there we go
great
bridge doesn't add skip law so if i go
to uh
minus 99 and then i try to submit
that i'm going to expect it to be
reverted
with parent does not exist
gotta write tests boys we gotta write
tests
no tests maybe it doesn't work and all
the people will lose
money
you can just make this bridge adds two
blocks
javascript's not gonna bitch me out for
that right
gonna bitch me out for that
can i say function add block
bn
uh i'm going to just call it with ad
does that work
i can't await because it's not in a sync
function but we can just say
a wait here
that block is not a function it's a
fucking function i told you it was a
function i made a function
that sounded really artistic
you guys see it's a function all right
like i'm not i'm not a liar here right
was in a cheap apartment half was on the
east side
say don't meet your heroes they're all
fucking weirdos and god knows that they
were right
because nobody loves you they just try
to fuck you then put you on a feature on
each side
can i make a tick tock
got care in the world we got plenty of
beer i got no money in my pocket but i'm
already here
um
all right look all the tests pass
that's great can i check how much gas
something used
i think actually it's here
oh gas limit wow that looks like a lot
of gas
is that really right god that's a lot of
gas
how much of that is the uh how much of
that is this
none of it i don't know
okay move the gas line that's not right
uh
how do i see how much how much gas that
was actually used
and is that a lot i don't really know
all right so how do i deploy it let's
deploy
uh wait we might not be ready to deploy
yet we're going to need a few more
helper functions
better public a few more views
um
please call when it's late at night the
headlines just don't paint the picture
right
looked at myself on a screen and said
oh my god there's no way that's me
where the unit tests unit tests
are dumb uh we write integration
tests integration tests
big brain unit tests small brain
gas used equals start gas minus gas left
look at the stormcast i'm not doing
that ah
hard hat eat test
get gas used
wow of course i can install the
e gas reporter plugin
do we like it
yarn and
hard hat gas reporter
of course we have to rebuild sec-p and
keckack of course
of course we have to rebuild them it's
not just going to work
oh the imports are type scraps
okay
is that a lot of gas
oh no i guess that's an okay amount of
gas
oh you know what let's enable the
optimizer boys let's enable the
optimizer
save gas optimizer
true
saving the gas saving the gas saving the
no i don't enable the optimizer okay
home
settings what was it we had it before
it's sad that you know halsey's having a
kid when taylor swift has a kid that's
gonna be a really sad day
um
the following is a co
wow enabled true oh of course yes oh yes
settings optimizer enabled
true runs 200.
oh yeah save gas yeah look at all the
gas we saved boys
what are we gonna do with all the gas i
don't even know i don't even know we
just saved we just saved 200
gas we could burn down a police
department with that
yeah let's do it
i need tea i have tea this isn't that
calming though it's kind of uppity tea
and there's this i'm double bagging it
yo guys i feel like a real ethereum
developer right now
i just wrote code in javascript and it
worked
like that was not actually a totally
shit experience
that gas thing worked great good job
ecosystem bros
thank you for creating all this
ecosystem for cheap
using less gas bros
um okay
layers
i got grease in my hand
all right how you guys feeling
should we press on
should we press on should we actually
figure out how to get this deployed on
cheap eath
let's go let's go
all right
yeah so we're gonna have to deploy this
and then we're gonna have to write
something that
fetches the headers and rlp encodes them
so actually that get block parts is
going to be something that we use in a
lot of places
actually
so anybody should be able to call submit
hash
i'm actually not checking that the
difficulty is correct now
so we should check that too
to confirm uh
difficulty is
correct
formula
how does ethe even work
okay we actually have to deploy this
is this in the tutorial oh deploy to a
live network oh
yes
um
let's create a new file scripts
actually i don't forgot to get the
genesis block number
oh i know what i don't do
a new whatever scripts and paste the
following into a deploy.js
file i love tutorials whoever makes
tutorials
you're my hero you're the real
programmer god
i just follow tutorial
bridge address oh we can't just call
deploy
playing contracts
yes i don't know how i set that stuff up
um going to create a new account
sorry i'm doing this off screen boys i
gotta put i know i'm gonna have to put
my private key in somewhere
so we're gonna have to do that off
screen obviously
uh
actually this isn't totally right
because we're going to have to get the
genesis
block which i think we can actually just
call
latest
let's just copy that exactly why don't i
want stupid
okay uh whoops
i did not mean to do that
where's the tutorial
okay
deploy
w3 is not defined though
wait that didn't just work though that
doesn't make any sense
uh no okay we have to put the real okay
you have to add a network
here we go ah
account equals private key
where do i want to keep my private key
so that deploy is just going to the fake
network
network cheap network tv
doesn't exist okay so over here in hard
hat config
we're going to want to add to module
exports
networks
you got to spell it right i'm sure
she beef
everyone knows the url of cheapy
and then i made an account
but
how am i gonna save the uh
it's a little annoying because like
where do i put my private key
okay and i have accounts
and then
i put a hundred test teeth into a into a
uh
where do people usually put their
private key
in like some configuration
uh hard hat
config private key
it's an hd wallet
oh i don't have that
you see because i'm on stream i can't
just put my private key here
it'd be so much better if my big head
isn't blocking half the screen okay we
can make my head smaller
yeah we'll make my head smaller there we
go
process dot n oh is that what really
what people use
yeah i don't really want
i can i can like load something right
npm load
file
oh my god of course it's complex
fs read file users
taylor dot bridge key
bridge key
okay
we set up the bridge key over here
error invalid callback
oh i have to give it a call back but if
i read file sync i don't have to
well good thing i didn't put a real
private key in there because it just
leaked right there
stupid crap um someone might steal i put
100 cheap beef in a test account
read file sync and also needs encoding
all right i'll give it the encoding too
is that really what it means
i don't really want this doesn't work
invalid value
url expect the value of type http
network config
why looks the same as that
they did use these things
which i don't really know what they do
no
respect to the value of type http
network
i don't think that's the problem my url
looks the same as theirs i think
right does it not
does it not like cheapies no i'm sure it
likes cheap
oh to learn more about horror hats
configuration please go to this useful
bullshit
which doesn't help me at all http
config what
url accounts
oh does it not like it because it's all
right let's just search for ethereum
private key examples
there we go okay insufficient funds
great
so i just have to put a real key in here
and i think it'll work
um metamask
export private key
fab icon click the account you'd like to
export
click the menu three dots click on the
account
details click export private key
okay
all right boys no stealing my uh my shit
great yo we just did that live
leaked a 50 million dollar account wall
50 million dollar account
you mean chibi's
there we go that's the account that that
deployed the bridge
we now have a deployed bridge
sitting right here at the bridge address
yo that was great
what a great experience
um i want to make that if that doesn't
exist i want to make it okay
whatever it's a lighter problem
deployed to cheapy the great thing about
cheap
is this is a real yolo network you know
we've spent um
0.001 cheapie that's worth under a penny
so what's the private key it's a secret
it's secret on my file system boys
it has 100 oh i just deployed it again
oops
i didn't mean to do that well now
there's two kind of there's two
uh i forgot to change the path of my
file
oh you mean you mean taylor and stuff
did i leak the private key
oh yeah we have two bridges now
new private key needed let's steal the
steal the 99 cheap beef
i'll be impressed
yeah this is small large use the other
one
all right like if i just were to run cat
that you could steal my key but
good thing i'm not gonna run cat that ah
okay i don't just want to keep deploying
this shit
um all right so we're gonna make
i gotta close some of these seven
million windows i have open
running out of ram
bye bye windows
bye bye windows bye bye windows
bye bye windows see your window
you were a nice window while you lasted
don't need this
can you read any chrome do i enclose all
the chrome
and then we can reopen chrome
okay um
that's deploy now we have the bridge
address because we ran deploy
uh okay so this is the bridge address
so now we're gonna put we're gonna call
we're gonna make uh
uh bridge.js
basic function main
um how do i like get the contract add an
address there has to be a way to do this
now right
uh
copy this
running from
okay it's not gonna be deploy it's gonna
be like something else
right
i don't want to use deploy
can i just like create it with this is
that gonna work
it'll make me happy if that works uh and
then let's figure out what the function
is
it's called uh we can say get longest
chain input so let's do that
r e p console log eps
bridge factory is not a function um
let's console.log the bridge factory
ah
it's already deployed you know
so how do i like just connect to it
what mark can't say about me
did he have hater shit to say or nice
shit to say
you go let's you know you want to read
the hater shit from mark yeah let's read
the hater shit from arkan
jail ah
some if someone links to it we'll read
we'll read the hater shit
well it's not doxin whoa whoa whoa whoa
whoa we respond to haters with
vague dismissal that's how we treat
haters around here
what'd we get
wait this isn't hater shit this is
exactly pretty much what happened
this is very reasonable
yo but i do want to say this anyone
who's hung
up on some shit that happened 10 fucking
years ago
you know 10 years ago i was a more
honest person
now i've learned that everybody lies
cheats and steals
and that's what you got to do to get
ahead in the world right because i want
a yacht and a rolls royce that's right
i got a yacht and i got a close voice
yeah i got
ears but yeah bitch i'm rich yo see and
then you can rap about your haters
and you know you gotta have haters man
because otherwise what are you gonna rap
about you know
i'm hoping drake hears that i hate him
now and he's like damn
damn i gotta do better you know i'd love
to get into a real rap battle with drake
uh you know
okay let's focus how do i access the
contract
um ether's get contract
factory no it's just been deployed
deploying contracts i already deployed
it what
linking do i learn about linking
linking linking
no
now we're done we're done with haters
we're not looking at any more hater shit
anymore
you got it you gotta keep the haters out
of your mind man but
we are interested in the cheap haters
because that's kind of relevant to the
stream cheapy
has a whole bunch of haters and you know
man
it's just just there's there's there's
the cheapy
discord then there's hater discords like
hater discords just seem to kind of show
up
and the discords who like they're
ostensibly designed to do something but
they're actually just the hater discord
i told goku to just ban the fuck out of
everybody like that's my philosophy you
know what i mean like
haters no no no no no no i didn't say
anything about
you a hater bro
imagine being willing to pay a hundred
dollars to send five dollars
oh wait no i'm just i'm just sorry i'm
getting distracted because i can't
figure out how to fucking do this
i can stick
deploy
oh my god how do i get it how do i like
set it for a deployed one you know
wait no there was it was in the tutorial
let's go
hard hat tutorial you should also be
able to read this you want to just read
some of optimism's code
optimism has this thing oh
i like reading optimism's code it's
clean
like block something
so
oh i got some notes in here yeah i'll
batch that's it
yeah yeah so this has to do this
it has to be an example of this wrapping
why did that do that why is it lagging
i don't know okay that wasn't that
useful
this has this is an easy thing to do i
don't get it
so okay i deploy i get the address
um
let's read this scripts okay deploy
front end well the front end has to do
this right
fuck react
okay import contract address
oh okay instead of a contract
factory i say
contract
contract address
that's kind of right
get contract at here we go
not a factory it's just a contract
sweet that worked okay
so that's the longest chain endpoint
so now i should be able to say
uh bridge get header and pass that in
great
uh oh that's funny this
is a zero like that okay i mean that's
kind of a bug
um
let's just do that ah
yarn i can't actually do yarn test npx
hard hat test i can
commit with that alias no
look man beefing with drake's made a big
impact in my life mark him i do know his
name
okay so this is the block number we're
currently at
uh
and by the way if you guys are making up
shit and marcan wasn't actually being a
hater
then you guys are the fucking haters and
you guys
you know go to the go to go to go to a
hater jail
you know it's like it's like a place you
play kick the can it's like that but
hater jail
saying i didn't even come up with the
sim unlocked thing what do you mean came
up with it yeah i stole it man i stole
everything man i'm a stealer rolls-royce
too
i actually got no skills there's
actually a guy what's a guy in a
hardcore history
ben there's a boy over there ben
and ben actually just tells him what to
code i'm an
actor man i'm an actor i'm like obama
mom is a very smart man i don't even
need to ride i need to hit him obama
like obama
i do block number plus one
does that work
i know we need to figure out how to make
that a library so i'm not just
no
how do i get rid of that big number
the fuck's a big if i should just number
that in does that work
okay that works you just can't add to it
how do i add to a big number add one oh
sweet that worked
great
no obama i think i think he's a good guy
i don't know i mean some of those
politicians are dicks i don't like nancy
pelosi
i don't like mitch mcconnell
you know obama told me there was going
to be hope and change
i guess i kind of got scammed i didn't
get any hope and change
oh yo we got a hater we got a hater we
got a hater
hater alert hater alert
boom
[Music]
band
no you gotta ban the haters boys you
gotta get the haters
uh all right
how do i make like a library in
get ready for some copy and paste shit
make this a library with the test
real thin code
device should rename themselves to
haters
big number two string doesn't accept any
parameters
all right hey wait
bridge submit header
debt block rlp new block
let me actually make this a variable
make it a little nicer
i'm gonna probably have to redeploy the
bridge a few times
no two hex is not defined oh because of
this crap
yeah i'll just put that in there
oh make sure to test it or okay so
i think that just submitted a block
uh npx rpa test
whoa whoa whoa whoa whoa debbie is only
gonna have a small pre-mine
for developers not like cheap which has
a big pre-mine
to buy me a rolls royce you see that's
the difference
ah we well yeah goku and i are gonna are
gonna are gonna share the rolls royce
all right cool check it out so this
number
no it's supposed to get bigger oh
because you didn't mind the block yeah
i see
look look
if you have a problem with the pre-mine
on cheap eats you can fork cheap eat and
make your own cheese
that's the beauty of fork
but if you believe in the cheapy vision
and you believe in the cheap youth
development team
uh all right cool so it looks like it
works
um now
we're gonna need a submit multiple
blocks function
but if you guys look now if there's any
way i don't think we have any good block
explorer
i think this one's better
oh no that's my account um
console.log using
bridge address
bridge address
there we go so each one of these
is a submission of an official ethereum
block
to the bridge blockchain
if you query that you can now get the
state
does cheap ease have higher fees and
lower transaction
speeds flip that but reverse
it it's got lower fees
and faster transaction speeds
and now it's going to have the eath
state
embedded in it but actually this isn't
the eighth state because we screwed up
because what did we actually do we
submitted cheapy
on cheap uh
but if we just change this over to
mainnet
and now we want to deploy
um
let me put this in a while one loop too
c sub ep equals true
if uh if scene
sub ep uh how do i sleep in node
continue but that's just going to burn
cpu
no sleep
or something i don't know what that
odds that's gonna work it's pretty low
but okay so we're going to redeploy
but we're going to use the main that
instead of the cheap ethernet because
obviously
we have to use the mainnet because we're
trying to put the mainnet state
on okay this is the new bridge address
call revert exception oh maybe it didn't
deploy yet
maybe it takes time
no
block explorer
why doesn't that work
why did that revert
okay there we go sweet alright wet sleep
is not defined that's good
uh i don't actually need to sleep
and then we don't want to log the whole
block
just say submitted
block number
no submitted uh
new block sub block number
on block number
all right now we just wait for the chain
endpoint to update
as soon as it does it's going to submit
the next one
it should work
there we go boom
so what this is doing now is it's
submitting
the mainnet ethereum state into cheap
in a trusted verified way as soon as
that
gets submitted now okay uh so we'll just
we'll just put a few to do's and then i
think that's the day stream
uh to do write function
submit headers
which can
submit multiple
boom and now we have a bot
interacting with the cheap eath network
yeah
so the if you want to get the ethereum
state right now on cheap
uh this
is the
that's the contract oh we got we gotta
say real shit
yeah it's continually pushing the state
it might be behind
because it's only submitting one
it's only submitting one block per block
right now um
but yeah so you you can now use this
code
pushing state
now there might be bugs too where if
there's a chain reorg this is going to
freeze
and that's actually what might have
happened here
but we should be able to so these are
real ethereum blocks so we should be
able to go on ether scan we should be
able to see what happened here so this
is the parent hash
oh it should be a block hash why is that
not there
all right here's a new one maybe it's
not an ether scan yet maybe it takes
time
let's check this one
why does it say it's a transaction hash
a few blocks
all right what number are we at this one
here
11 259. so that's the block number
oh it's not letting me do the block cash
okay so this is the hash and there we go
there's a parent hash there
so you can see that right now you can
get this stuff on cheap now
it's not perfectly that uh i wouldn't
actually rely on it for anything yet
because we also have it to do in the
contracts
we have to verify that the difficulties
are actually correct
um like there's a formula for getting
the uh
all right
don't you need like all the blocks per
epoch to validate though
well yeah so i have to fix this little
bug where you can only submit one per
block
yeah but optional flag yeah that's
that's the uh
that's the equation that we gotta put in
you gotta extract the timestamp
uh
do it submit some pull requests
let's finish this bridge up um
let's get it continually deployed and up
uh so the state's in there
all you need is the block headers um
if you have the block headers you can do
you can generate merkle proofs
uh so okay once the block headers are in
there and confirmed
what we can do is you can like
feed it a block uh i'll have to put
some more functionality in bridge to
tell you whether that blocks on the
canonical chain and how confirmed it is
like actually what i really want to know
is how much difficulty is in front of
that block
um so you'll be able to ask it from a
contract like how much do you trust this
state
and then the state uh
hashes will be validated and you can use
the state hashes
to show i believe anything is in the
ethereum state
uh it's called get proof in the web3 api
so we still have to build that we have
to build out a library for people to
actually interact with the bridge
but the first thing to do is just to get
the headers uh
because the header is where all the
trust comes from the block chain
component of ethereum exists within the
headers
also there's no restrictions on that
function
like there's no only owners or anything
so anybody can call submit header
uh but you know there's a lot more
testing to put around
chain reorgs around people trying to be
malicious
we did very little of the testing so far
make a reliable l1 to l2 bridge
cool
thank you for watching the stream today
uh
if you feel like you want to mess with
ethereum stuff
uh check out chibith
it's ethereum for cheap
it's it's ethereum for the people
uh if you're looking for a real if you
work on a real crypto project and you're
looking for a real
l2 solution check out optimism
also check out binance smart chain if
you're a speculator
if you're looking for the hottest
speculation right now
get on binance smart chain you got to
buy
in but you can buy in and basically it's
like ethereum six months ago you can get
it on all the
well i get the token and then i put the
token
and the mining in the farming pool and
then i get more
token and then i sell the token to the
people who are trying to get into the
farming
wait is this a ponzi scheme yeah but
it's going up finance smart chain
i mean it's sad right now you know you
know for every for every cheap eve hater
out there
huh who's winning
but spark chain has a pre-mine
oh wait the whole thing is a pre-mine
um
i'm not gonna hate too hard on finance
smart chain uh
good for good for good for finance smart
chain
um also
if you take crypto seriously
you don't take crypto seriously you're
putting d5
on the ovm opto do you know what the ovm
is
do you know how that shit works oh my
god
finance is written in java that's sad
that's sad look we learned javascript
today
what should you take seriously life
liberty and the pursuit of happiness
except not
life and not the pursuit of happiness
just liberty and freedom freedom's worth
taking seriously
if anyone's trying to take away your
freedom fuck them
do i think crypto is sustainable long
term oh there's plenty of liberty in
2021 don't let the news get you down
um do i think crypto is sustainable long
term yeah i think it's more sustainable
than fedcoin
so on say we need to troll with krypto
satoshi nakamoto is the greatest troll
satoshi nakamoto built something that
dealt the
greatest blow to state power in my
lifetime
you know that's the good fight
and being a top shot is more legitimate
than crypto
no you know you read my blog you guys
see my blog oh shit
greatest punk of all time what is it
i think my blog is here i also have
poorly written blog is my blog
technology without industry if it
centralizes power
it's bad if it decentralizes power it's
good
build technology that is inextricable
from its narrative
build technology that will give them
give us freedom
not enslavement one access to consider
does this technology centralize or
decentralize power the power itself is
unstoppable
how we divide it is a choice
stop building shitty technology
no i should read torelli's jailblog
you can't outlaw crypto
when the outlaw crypto only outlaws will
have crypto
uh look you want to be crypto there's a
way to be crypto
start being responsible with the fed
coin audit the fed
uh start posting how many you're minting
start doing the you know
standard decent things uh
that every you know alternative currency
maker is doing
right like like what's happening is
bitcoin
just looks so much more advanced than
fed coin
uh and fed coins falling behind so
you can try that like out yo you know
what you know how much fed coin trades
at
a dollar just like tether um
facebook still making crypto oh my god
you know i worked there they really
don't try to be hated they really don't
what if they shut off the internet and
do something like china
i think you misunderstand what our state
is capable
of um
the government can't even like
you know have a reasonable response to
corona
the government couldn't even get
coronavirus tests to work for months
uh because they didn't want you just and
you think they're capable of like doing
something smart like the chinese
government look
here's how it works in china no offense
to anyone who works in the government
but
if you live in china my understanding is
working for the government is cool
like if you're smart you go work for the
government in america if you're smart
you go work for technology companies or
hedge funds
that's the difference where's all the
smart people technology companies and
hedge funds
what is crypto what's the intersection
of technology and hedge funds right
um the the general level of code
in uh in in this stuff is quite good
like the the code based quality well you
know you saw me just play with those
libraries like there was a little bit of
frustration but not much
uh that's all put it this way
that was much better than any experience
i've ever had with react
maybe it's not the node.js ecosystem
that's terrible maybe it's the react
ecosystem
um no i mean the chinese government is
is a more effective organization than
the us government
like who would really deny that
um
but now you know fortunately i'm not
really a believer in like
government being a force for good you
know so so like it works out fine for me
i'm happy to be here
i'd rather live under the umbrella of
the us government than the chinese
government
we do a lot of stuff i've been watching
i've been watching a lot of true crime
videos
just amazing that like even when it's so
clear that he killed the guy
like the amount of effort the state goes
into proving it
you know makes me like the court system
makes me believe in justice i think we
can fix a few things up but
when it comes down to raw effectiveness
well uh
yeah the chinese government's better
oh god if i said the shit that i say
about the us government on this stream
in china about the chinese government
so you know look this is the freest
country in the world i love america i
really do
um hello thinks the justice system is
not the sec
the sec needs some reforms but
i mean you need something right you know
it's unfortunate that that's all it's
all cronyism and stuff
um what the fbi and i are friends what
do we do we're on the same
side to swarm top hold the constitution
freedom man
america's a great country
uh no
you don't really need laws to uh
to regulate i think that
a lot of that is
a lot of like laws for regulation i
think are predicated on control of
information
uh and for a long time governments were
able to control information
now you know you see with the rise of
all the quote unquote fake news
well at least the u.s government has
lost the ability to control
narratives i'm not sure if the chinese
government is effective
at this china and china i'd have to like
yeah that's a hard thing to figure out i
can
only speak to the us after thinking
about it for a really long time
um but when they lose the ability to
control the narrative
well this isn't a bad thing
freedom is not always a positive there's
downsides to freedom too
people like freedom freedom freedom
freedom is great no
freedom is freedom to make mistakes
freedom is freedom to lose all your
money and scams freedom is is is
my point is instead of thinking about
how to regulate things
think about instead how to like educate
people
what if we built a real education system
what if we could actually
that's the only way i think that's the
only way forward
um i would not say deregulation caused
the last financial crash
uh
i think that the last financial crash
was caused because
banks predicted that the government
would do exactly what they did
if you know that you know like like
like big daddy fed is coming to bail you
out
you should have an unlimited appetite
for risk right
but if the banks had failed
well if the banks had believed that they
could fail
i don't think they believed they could
fail i think they still believe they
can't fail
the problem is a deregulation the
problem is bailing people out
tell everybody like you know that's the
flip side of freedom
get ready so oh wow oh oh you got greedy
and you lost
15 000 jobs and have to sell off your
tower in manhattan
well that sucks you know but that's life
and and
yeah there was no risk for that right so
if they don't think they're going to
experience the downside they're going to
take as much risk as possible to cash in
on the upside
um that's my understanding of what
happened we we should have
i think i think in iceland it might have
happened we should have had in 2008 was
like a changing of the financial guards
and we're going to have it now uh we're
going to have it now i think with crypto
uh it's really nice you know i meet a
lot i mean a lot of like
kids in the defy world and these kids
know more finance
than harvard finance people and they
know more finance without also getting
the harvard indoctrination
right usually you'd go to harvard and
you'd learn finance but you'd also learn
the ways of a harvard man
now you got these like 21 year old kids
who are just finance geniuses
and that's who's going to save us you
know
bitcoin's a speculative asset bitcoin in
a lot of ways resembles gold and
ethereum in a lot of ways resembles
silver
you can use silver as money but it
trades pretty close to what it's
actually used for
same thing with ethereum uh bitcoin is
trading i talk about this uh um
yeah we'll stay cheap uh
yeah yeah and
america has uh i think of all like the
first world countries the oldest average
age for politicians
uh our politicians are are they're
boomers and they're they're
they're ancient and they're so out of
touch with society
um so what's going to happen is you're
going to get a revolution but it's not
going to be a
violent revolution it's going to be a
revolution where
like the new power rises up and the old
power doesn't really the old power like
doesn't really even understand the new
power uh and this is one
i think this is one of the coolest
revolutions to live through you know you
never want to live through a bloody
revolution
you never want to live through a coup
you don't want to live through political
instability
but just a quiet revolution where the
government loses power and like
you know the decentralized internet
gains power
uh it's a cool revolution to lift her
revolution to the mind yeah
uh yeah i've never used lightning
network
it looks complicated to me
oh look it's still submitting blocks
implying boomers will let go that easily
well you know we don't know how to live
forever yet
um yeah and too many people here
now don't know how to deal with risk and
you know i'd like to see that same
philosophy apply to the banks applied
all the way down
uh i really don't like uh
welfare and those kind of programs where
if you do badly the government will
will bail you out um i think that
welfare is much less of a problem than
corporate welfare
but yeah there's a flip side of freedom
and the flip side of freedom is you can
mess up
what happens when we become the boomers
the cycle continues on and
i'll say it right here i just hope that
i have the
uh wisdom to uh understand
i hope i have the wisdom to understand
that i don't understand and
pass the reins on but shit guys i'm
gonna live forever so you know
wow wow i don't like welfare is that a
surprise
ah
uh am i gonna upload my mind to a
computer guys i'm already doing it
uh how many hours of this stream content
just needed to recreate a copy of me
what is that copy i don't know maybe
live forever or die trying i like that i
like that
he said see what about ubi
um i don't like ubi
i think ubi is funny uh if you ask me do
i support ubi politically
um in hastening the destruction of
fedcoin perhaps
uh mint the coin mint the coin
is ubi actually a good idea no
no why are you subsidizing shit even if
it's human life
again i'm more worried about corn
subsidies than ubi
but like
ubi is going to be the translation for a
paper to crypto yeah yeah
you know there's a whole lot of there's
a whole lot of really dumb shit the
government can print a lot of money to
fund
and then well let's all work on these
technologies and let's get them ready
when the time comes what
become worthy accept power rule
uh
space communism
uh i know people think it would work i
know
and like you know it's it's it's
i think the problem is people think
about it from the perspective of
people empathize and they think empathy
is a good thing an empathy usually is a
good thing right
it's easy to empathize with somebody
who's poor uh an individual
right an individual who you can imagine
doesn't have a house or doesn't have
food and you want them to have a house
and food and everybody does right every
every
feeling human does um so they think of
ubi and they think okay we're gonna give
them a thousand dollars a month right
and this will work but only for a little
bit
right you have to think about it from a
a larger systemic perspective
and what ends up happening with
incentives and then
we don't have a world government right
a country that is is is giving out ubi
is not competitive with a country that's
not giving out ubi
right just just just like imagine
look at intel how many people work there
and are useless
right like it's this is why you know
they're going to have their lunch eaten
by by people who don't have that
this is why these these companies uh
fail that of all
you know you don't want to have a huge
mass of people who are a net
negative on your balance sheet right and
people can look at that and say well
that's a terribly cruel way to think
they're people they're not numbers on a
balance sheet
but like that's a quick way to drive
everybody into poverty
some people have so much some people
have billions of dollars
i mean yeah okay you can redistribute
their wealth
and this isn't necessarily a bad idea
but
ubi well
how much is it giving everyone a dollar
what can you buy with a dollar can the
world support
you know
automation's coming automation's coming
you know again
what do you want to do about it the
stupidest idea i've ever heard was tax
robots
well we'll put a robot tax in order to
keep humans employed
uh i should write this up i guess i'll
tell you guys about fake job stadium and
then that's the stream
i've never told you about fake job
stadium this is an idea i like to pitch
to people
i pitch it on dates you know so it's a
good it's a good kind of shock value
thing but it's an interesting thought
experiment so one of these days
um you know i'm gonna i'm gonna sell all
my pre-mined
cheapies for for 45 million dollars or
whatever the uh
the haters say it's worth by the way
i'll give it to them for 30 if they want
they're 30 million
but buy it all you know done done
i think i'll take all my my my ill got
ill-begotten gains i'll build a football
stadium
um and
i'm gonna buy 10 000 sacks of flour and
i'm going to stack them in one end zone
we're going to hire a day shift and the
day shift's job is going to be to move
the saxophone from one end zone to the
other end zone all right
then we have a night shift and the night
shift is going to move the saxophone
from from that end zone
back to the first enzo we're going to
have like a few hours separation between
the day shift and the night shift
we're going to hire like a whole white
collar work staff
to you know make sure these shifts don't
find out about each other
right we're going to hire the best
psychologists to make sure people feel
not just motivated to do their job but
truly
satisfied as flower movers like
this is a career option for people
people can have
dignity and respect moving flower from
end zone a to end zone b and we're gonna
make sure we engineer that welcome to
fake job stadium you know
um you can come watch we'll sell some
tickets to fake jobs stadium
modern monetary theory
modern monetary theory is uh
wait that's just actual football that's
a good one
that's a good one
i read half of unsong should i finish it
if i end this stream everyone in the
chat would need ubi
there's plenty of real work to do tell
me more about this real work
this is for you fuck shit coin
i work on comma you say do crypto i work
on crypto you say do brain computer
interfaces
i work on bio everyone's happy when i
work on bio we'll do some bio streams
soon
i don't know cheap eat has been fun but
eventually
you know we'll see
we'll see where it goes
should absolutely do chess the
computer's already better at it than
people
yeah yeah yeah i read i read uh i read
enough of unsung to get that to get the
gist of that it's cool
there was one part of one song i really
liked and it was like
you see
i'm the bad guy but i'm an important bad
guy
and we all know that in stories the
important bad guy doesn't like just like
you know
accidentally like get into a car
accident on his way to work
so i know i can drive as fast as i want
because like that's not how i'm gonna
die
when i die there's gonna be like an epic
multi-chapter build up to my death
so narrative is destiny bros
um
i like that if ethereum changes to proof
of stake just cheap
change too read um read the bridge spec
so cheap is gonna be like this hybrid
model if i actually finish it
um
humans do not work as power cells that
makes
no damn sense
all right thank you all for watching
today uh check out the code
at github chibi bridge
bye
we're eating ramen
ramen can't see it
[Music]
wow that was a lot of people coming in
fast
um all right
so uh we're playing with the bridge
um we ran the first test of the bridge
uh so for you guys that don't know here
is the test of the bridge sale
the bridge sale is now empty actually we
can look at this hopefully in the better
block explorer and see
the transaction uh submitted to it
we do the first test bridge we bridged
over debbie
um you guys might know debbie as a bunch
of haters
uh and they are haters but it's okay
it's okay we're not we're not here to
hate on haters
we are just here to talk about how
the bridge works okay so we launched the
bridge and the bridge is great
rpcgabby.org
uh you see they have that's a sad
hashtag but
um and then
if you send your debbie to the doobie
address
so the doobie address just burns it and
you can see that we've sent
26 000 devi to the doobie address
you'll be able to claim that over on the
cheap chain
oh no is this block explorer down yo
cheap swap picture block explorer
box flurries are kind of hard to keep up
you do be you smoke it in the doobie
and then you deliver it to the bridge
sale
so we'll do a quick walk through what
the code is that actually makes this
work
um it's completely decentralized so
there's no like only owners on the
contract
um i wrote this while i was in la
hanging out with optimism
uh you guys can see contracts bridge
so this is the bridge contract and this
is the bridge sale contract
so the bridge contract basically stores
all the blocks
um from a proof of work chain so this is
a really the bridge proof of work you
guys saw me playing with this in
previous streams
but it's all 100 percent working right
now
that's delicious ramen no i didn't i
didn't fix any optimism stuff i
have optimism i think has a ways to go
to be good
um so i've just been working on
cheap uh
oh no i dropped my fork what do i think
of crews acquiring voyage
yo
you guys know about forest fires maybe
you can think of cruise like a forest
fire
and when the forest fire comes and it
burns down encinitas you could say that
the forest fire
burned down encinitas but the thing
about
forest fires is they don't really add
value
right you're not gonna have a forest
fire that lasts for a hundred years
there's a lot of people who are like
you know the forest fire works as long
as it has fuel
but eventually the fuel aka the capital
being injected into crews
runs out and it's a great fire and it
was a great fire while it lasted some
fires even have names like you know the
chicago fire
ralph well who's ralph was just a fire i
knew once
um so uh
yeah that's my thoughts on that
um yo wait i'm gonna do a one
one quick shill for comma because i'm
super happy about this
um if you guys were thinking of buying a
comma two
uh the new price is gonna be 10.99
we're raising the price and think about
it think about it think about it right
when you bought a comma two a year ago
if you bought a comment to a year ago
it's not as good as the comment to you
by now because the software has gotten
so much better
but we give the software away for free
so like you know there should be a way
to capture
like like you shouldn't be paying the
same price for a worse product if it's
better you know
i think the price has to go up
um so yeah the new price of the combat 2
is gonna be uh
10.99 uh no followers and subs don't get
shit um except my love and admiration if
you're a sub if you're a follower i
don't care
you know that star means you're a better
person um so yeah the prices of the
comma 2 is going to go up from 9.99
to uh 10.99 and this will just be the
first of many
uh price increases we have a full-time
person now working on the prices go up
team
uh so yeah
um you see that's the difference between
comma and cruz
comma makes money and cruz
loses money
no but you have to understand cruz is
trying to build yeah funny
simple you want to tell if a business is
good for the world does it make
money or does it lose money simple
simple simple simple
uh no we don't have a business
development team we do have a prices go
up they might
so there's two contracts basically the
bridge and the bridge sale
the bridge sale the bridge tracks the
state
okay maybe we should write some uh
i do like optimism does a good job with
their uh
documentation on their contracts
so it's good things to steal we can see
what we can steal
uh i'm i'm i'm bullish on
optimism long term short term
uh i think they have some stuff they
gotta work out
for example like if you go on l2
optimism you can't
um you can't click
send on metamask
so if you're watching cell too um so
also
you guys know that we have a launched
version of optimism courtesy of the last
stream it's called cheap optimism
you can see have people been using it
someone submitted a cheap block today
iq 100 perfect score bro
so let's uh let's write a little
documentation
uh let's move that up there
title uh
bridge i was going to say
proof of work contract
um dev
bridge tracks and
verifies
that's the state of a
proof of work ethereum
chain
cool that's even nice
all right now we have the bridge sail
i'm going to just title this bridge
uh dev
the bridge sale uh
uses the state
from a bridge to
validate uh
send transactions
on the on the
bridged chain
it's a little long
okay so we have the bridge sail and the
bridge what we're going to do in this
stream
is if you notice if you read the
documentation here for the bridge
it verifies the state of a proof of work
ethereum chain
there's a lot of ethereum chains that
are not proof of work like
binance smart shape
the beauty of bridging to finance smart
chain is it's cheap
like if you bridge to mainnet ethereum
it's 20 bucks to send a transaction
but if we look here i have a little
finance smart chain in one of my uh in
one of my accounts
smart chain here we go
there we go look i have .0295
bnb and i also have some of my things
in purgatory because i tried to use any
chain but
can i edit this well that'd be cool give
me
1 million bnb
uh but we have finance marchand but the
thing about binance smart chain
is yeah it's not a proof of work chain
so this bridge isn't gonna work
we're gonna write the binance smart
bridge today
um we'll call it bridge binance
and it should implement the same we
should actually probably
write as much as i hate them we should
probably write
a uh an interface
for the bridge
so what do i actually call here on the
bridge is header stored
get block by number
that seems right
is blocked require a parameter or is
that uh
i also want to parameterize that 100.
all right guys please stay on topic
we're writing the binance smart approach
today i want to hear about yummy and
bullshit
philosophy is for losers who can't code
um now some philosophy's okay but like
one time i was uh first time in my life
i took acid we went to big sur
we're camping in big sur and you know i
wanted to talk about like the stars
whether the universe is analog or
digital or not
and this guy i was with was like yo that
shit's all bullshit why do you want to
talk about that and i was like
damn bro you're right and then that's
why it's bullshit
i mean it's okay to think about
sometimes but like you're not going to
find any deep insights into the world
if you want to find deep incense as the
world study math and computer science
and they will know real things
no matter how much uh
what's the word what's the word um party
party figures people sympathetic to the
party
party agents apparatchiks uh infiltrate
um literature it's very hard for
apparatchix to infiltrate math math is
always
real so you can believe in math
um so please stay on topic we're
building the binance
smart bridge speculator
who's been speculating
do we have to meditate i'm gonna drink
some tea
we're gonna chill out
uh i don't own any geopogs i'm not none
of this is i think i bought one
but you know none of that has to do with
me this is other people building
on top of cheapies uh can you get a
quick rundown on
uh l2 scaling so this is the best cheap
l2 solution after binance smart chain
and x die
which are also great solutions but x die
is a little shady and cheap
and finance smart chain is a little
centralized so if you don't like
centralized
or like confused or like impossible to
audit go cheapy it's the number one l2
solution on ethereum after
number one two
gotta get some tea boys getting some tea
we gotta chill
man i really have out storm really amped
up i ate ramen
option t chill out
um
when i do take drugs i'm not on a stream
with you guys
like that's not what i want to do with
my drug eye i deal with you fucks
just by doing them sober
what is cheapy cheap is the number one
ethereum l2 solution
after number one and number two which
finance smart chain you guys know
binance okay
we got it we gotta chill
so if we look at the finance marching
connected to it for a minute over here
bring up a node
my bridge sale is so crappy too
this company has crashed a few times
so we have web three now we can bring up
the web three of the finance now
remember binance smart chain is a proof
of authority chain
so we're not going to be validating the
difficulty or the hash of the blocks
we're going to validate that it was
signed by the correct authority figure
so what can i say w 3
e
yo i'm learning javascript voice so that
meta javascript skill right
notice how i just whipped out the van i
know what a promise is now
i know what a promise is
um
so this extra data contains the
signature
and it's what we're going to need to
validate
it's going to be very similar i think
it's actually going to use this
same bridge
i can't use debbie if anywhere else no
if you want to bridge it to debbie it's
that
i did not even though it was the devi
bridge sale i must have done on this
computer
yeah network people's debbie
i'm gonna add that to the read because
the reason's wrong right now
oh that's the bridge sale
oh that deploys the sale i see
so we're going to have a new type of
network here is it elif in javascript
ah
finance thing here
uh if
seems good right now we don't need a
bomb delay from parent
and yeah i guess the genesis block
stuff's gonna work the same
okay so we need to write a contract
that's kind of like this one
but going to be a little bit different
uh okay
there's a mix after nonce we don't care
about it
what do we care about here
it really might just be nothing
what are the two there's two methods
that the sale has to call
it calls is header stored block ash
which actually
do we even need that
huh
i think actually i'm going to change
that to just be get blocked by number
and then yeah let's let's let's fire up
the test to make sure the tests keep
passing
a pretty good test for this we'll have
to write some tests for the binding and
smart bridge too
maybe we'll do some test driven
development
so notice how all the tests pass now
instead of saying
bridges header stored let's just say
require
hash equals block hash right
get rid of that and say
um block
hash didn't match
block or number
that's even a better check i think
i should have started just by writing
the tests i wrote this
sorry i know that's what you can't see
that's all punk rock 101 that's just
what i was thinking of now alright cool
so that change
works
stupid contagious to be broken famous
can
someone please save us
that doesn't matter
i like to sleep in the cold
live in our world play and live in your
world play in
hours playstation
we have the bridge finance contract um
that
hmm
because depth is fine
can the finance smart chain reorg
i guess there's really no reason that we
have to uh
hmm
actually i'm sure i need a header here
i can just say probably bites that
hmm
it looks same
let's just do this this might be all i
need to do in the
uh
it's going to be zero by default it
should be fine
uh
we're going to need to decode block data
what do we actually care about
um it doesn't have uncles
i don't even understand what the
difficulty means
two two difficulty block
number i don't care about any of that
i guess i care about the time stamp
i don't care any of that hmm
i guess i do want to have the same
just way so many bites you know
at the stuff from the bridge sale
just get it from that
cool okay get blocked by number
just returns a hash and a depth which is
great so i don't actually need any of
that
because it's all going to be proof of
authority we're going to validate in
this extra data
so what do i need here i need the block
number
um time stamp let me just see
rlp oh you know where i have it
let's see the library codes already in
there
what are you guys talking about
pay attention
increase font size would help you know
what would help you being banned
that was harsh that was harsh that was
too harsh can you guys not see
are really the only two things i care
about in here
the block number and the extra data
hmm
i don't know i don't actually know how
to check the signature of a binance
smart block
and probably i should prototype this in
python or javascript before i just
write it in solidity but you know
we're just writing it in solidity
all right internal pure returns let's
say
you're in block number
bytes memory
all right let me submit we're going to
want to call the code block data on rlp
header
and block number bytes
extra data block number
on my extra data let's
test that turn the test and see that
unexpected trailing comma that's a fair
problem
ah
i'm not gonna build that struct you
should actually be able to even just say
this right
i probably need to say that's in memory
but god is this the syntax for solidity
guessing with syntax
oh of course i didn't put a memory there
it compiles
the shadow declaration is here
what does that mean and i guess i see
clearly that i misspelled block number
do i not so much for
typing up the m1 chip all the time
see what i lost
look like i lost much
if i could do that
actually why am i writing all that
my computer kernel panicked
um function statement ability no that
can't actually be pure it's only pure
now okay
we have to go over to the tests
all right cool deployment works and
therefore that works we can throw a
console.log
block number in here we can confirm i'm
expecting to see 553 kind of crap
yeah five five okay cool so that worked
uh now we need to validate the extra
data and this is gonna require some
research
finance smart chain
extra data
let's read about binance launching wait
a few blocks to confirm
blocking time should be short no
inflation
as much as compatible with ethereum with
staking and governing as powerful as
cosmos
is cheap ethan binance well once we make
the bridge work from the binance smart
chain
it's going to be very easy to turn your
your binance smart chains into cheapiest
well i mean this is all just dancing
around the actual hard problem with the
chain so we have chains that work
we have we have bridges now that work
really well to go from uh i mean you
guys saw the deputy thing it worked
really well
uh so we can do it now from the main
chain
but i think we should go from the
binance smart chain
um me and my friend goku were behind
cheapy basically
what i said to him was like bro i can't
deal with the people
like i'm not i'm not talking in the
discord i'm not dealing with
like you know just the bullshit
ah so i told goku to do it and i told
him to be absolutely ruthless and brutal
like you know he's he's always he's
always concerned he's concerning their
haters they're like
george but like you know what are people
gonna you know what do people think that
like you're associated with a scam and
i'm like
fuck that man haters are gonna think
whatever haters are gonna think you know
you can't live your life based on haters
you gotta live your life
based on you know just not dealing with
bullshit and that's what goku's in
charge of he's a chief bullshit officer
a cheap
um
this smart guy too young
no no just like
um goku told me about this one guy
oh cheap nah he's just like whoa i
mentioned it and got banned even
wikipedia is already talking about this
oh fuck i used to have respect for this
guy oh man yeah oh you don't respect no
i'm so sad
no but you gotta realize that respect is
not about a person
respect is about skill right you
shouldn't respect a person i'm a fucking
asshole you know
everybody is there's two types of people
in the world there's assholes and
hypocrites and i'm not a hypocrite you
know
um but what you should have respect for
isn't
people and people oh my god oh no this
is this is too real if i go into what
happened yesterday
it's like i don't
like like like these people think that i
like
care about myself like oh george hutch
george
i don't give a shit man like that
doesn't matter to me
what do i look like the kind of person
who's trying to build a brand
oh yeah the george hawks brand the
george hodges brand is full of scams
getting hacked and bullshit and that's a
good brand
but it's also full skill right but the
thing about skill
is it's not like skill isn't like
reputation right
reputation is you know just do whatever
you're going to do when you have a
reputation that's what you're going to
do you know a good predictor of
someone's behavior is their past
behavior but
skill you can demonstrate and you always
got to be showing skill you always got
to be one-upping other people's skills
like that's
that's real right if only all this this
this crap was like about imagine the
whole self-driving cars instead of being
about like
bullshit was about skill
was about companies trying to one-up
each other with cool
demos right it's just you know it's
it's it's it's elon and little me out
here you know like gm with super cruise
but they're not cool about it right like
imagine it was just
you know people trying to one-up each
other blue origin and spacex like that's
what we want to see in the world
oh twitch streamers offended get
offended all work on your personal
fucking brand losers you know
oh although invited my brand narrative
here's my brand narrative man slurping
ramen and drinking tea that's right
sounds like or insecure what do you mean
by that no no no should i engage with
the haters or should we work on the shit
uh no like it's not let me explain what
it really is right
if if you have if you have a reputation
that's something that people will always
be able to hold over your head
right that's something that they'll
always that's that's a vulnerability
that's something that people are always
going to be able to threaten you with
right
if you're somebody like oprah like oprah
could never run for
for office because if oprah ran for
office you know
you'd find out all these like bad things
about oprah she's someone who has like a
nice image this is why martha stewart
and the insider trading thing was such a
big deal
right like martha stewart is this homely
lady who like bakes cookies on sundays
for for
nice people right like you know if i
went to jail for insider trading you'd
be like yo
right imagine kanye west went to jail
for insider trade and you'd be like yo
when lil wayne goes to jail for having a
gun nobody's like wow
i never expected that from such a
straight up
uh you know honorable man like dwayne
the carter three
no no and that's what i mean by this
right it really is a vulnerability
um whereas having skill you know you can
never have too much skill
right tell them i sold out
tell them uh you know what what is it
what
tell them why you know tell them travis
smokes more crack than tyrone bigams
does
tell him i sold out tell him i do drugs
make me more insecure than i already
am make me out to be an asshole who
don't deserve his
fans make me more insecure than i
already
am kick dirt on my accomplishments
if you're ever bored just document it
well and don't forget to hit record
one hit wonder my ass what are you
talking about
let him keep blogging trash imma take
the garbage out
all right hopefully hopefully you'll uh
you'll get what i'm saying
no that's uh that's that's gym class
heroes before they fell off you know
um it's not like the way drake fell off
right like i don't think gym class
heroes sold out drake drake just
just drake likes you know oh it's sad
it's sad but
beefing with drake out you know i think
about beefing with drake out it's like
you know making funny youtubers but
youtubers are mostly self-aware like
when pewdiepie is like
this is meme review this isn't this
isn't you know play through sunday or
whatever the other shows on this channel
were in the idea that you can have shows
on a channel
it's just i don't know if it's i don't
know i i think they're self-aware
um reputation oh
opportunities yo every single person
who emails into comma asking if we have
any
opportunities available like i could
just
make an email filter on the word
opportunity and send it to spam and i'd
never miss
anything there's no such thing as
opportunity
right opportunity comes from this this
old era of like yes maybe there was
opportunity in the 70s and you had these
phrases like when opportunity knocks
answer
now it's so gamified that it's not
there's no opportunity what do you mean
life's an opportunity
opportunity is everywhere it's yours to
make it
you know no one's gonna give you an
opportunity
all right you just go oh wow that's wow
i should listen to tony robbins man you
know i hear that guy man tony robbins i
hear he's doing like uh
uh you know you got like a vip in the
conference you can like go to the vip
reception with tony
i gotta look more into that oh these
people ask me to be on their podcast
i'm gonna shout them out because i like
their
aesthetic uh
and we're going to listen to some of
these and then decide whether i should
go on their podcast
but i like their aesthetic they they it
seems like you know
either they're scary uncle ted their
first one's about the
so you know we just got us like look i
like that like look at that it's a
beautiful it's a beautiful little
suburban at a briar patch observatory i
i like it yo don't be like oh but
they're actually you know
all right blah blah blah blah blah blah
i don't know maybe they are maybe they
aren't but
i mean they do say words like cultural
marxism which like there's intelligent
ways to talk about and there's also
conspiratorial ways to talk about
so we have to figure out which one they
are um
like you know i i hate that i hate the
right-wing conspiracy stuff as much as i
hate the social justice warriors
um if people want to talk intelligently
about like you know
uh class divides and social justice i'm
interested
just most of the discourse is so low
quality
and if people want to talk intelligently
about like
you know the deep state and conspiracy
theories i'm interested but most the
discourse is again
so low quality right uh so we like
quality
we like skill these are things we like
and reputation this is a scam man why
don't you turn your reputation to a
token
and then people can buy and sell it
based on your reputation man it's called
social tokens
you know i'm not praying though they
asked me to ask me that one reason
they're like what are your political
views and like
i'm up for any kind of politics as long
as you speak about it intelligently and
like don't get offended you know
everything from like communism to nazism
like if you speak intelligently about it
but like you know be aware if you like
say you're a nazi you know and i say
like
bro you know like hitler died and
everyone thinks nazis suck right
if you get offended then you know you're
a shitty nazi but if you have like a
good way to like talk about that
then you know it's something at least
right
if you have like if you're like i'm a
communist and be like yo you know stalin
killed 50 million people and like
you don't have any good comeback to that
then you're shitty communist but like
if you got some like you know new takes
on communism like i'll listen to you i
mean i still think the commies and the
nazis are stupid but like you can change
my mind man with the right argument
that's what rationality is all about
being open-minded
to a good argument now to be fair
there's some things like the earth being
round this like
you know your youtube videos are really
well edited and that one's like
that one's like a good bell weather
right because like if you really start
believing the earth is flowering all
right too far
um too far down stupid rabbit holes you
know that's that's the world today
stupid rabbit holes the whole world's
full of pokemane
this is on topic no it's not on topic
you're right keep me on topic that's
right
no you know it's just a long rant
against haters and we gotta you know
talk uh okay
it's a watcher of validators chains
so how do i figure out who the
validators are
psc scan
this is cute that's a lot of bnb
pokemon's dancing
love pokemon i love pokemon she's cool
if you're ever in la you want to hang
out down
validator everest
rey thank you for gifting subs if you'd
like to ask a question
if you give subs you can ask a question
clique has smaller blocking times
four
why are there so many angry people it's
a good question
i think social media maybe makes people
angry
or maybe it's because the machines are
taking over
and everyone's kind of aware of that
it's a loss of status and power
to the machines
i mean just imagine you spent your whole
life like
wow i mean there's some shit that's too
real here like you spent your whole life
learning to play chess
and then the machine showed up
i don't know i mean that's happened to
people we could ask them we could see
how they feel about that you'd have to
get the truth
not the politically correct answer
wow geofog thank you for gifting subs
do you have a question
here's my question can you talk more
about thinking about frameworks
oh like frameworks to think about stuff
um
yeah i mean i i listed the good ones i
don't know it's not like i have more
like i talked about it a little i wrote
a new blog post i talked about a little
it's really poorly written
um about the ai control problem
so you think about uh rationality
and like uh neo reaction and
they're both concerned i mean my
understanding is knee reaction is a
spin-off of rationality
and that the ai control problem is
really what gave rise to rationality
uh and then there's two ways to look at
the eye control problem right you can
look at the ad control problem as a
technical problem
or you can look at it as a problem of
power
and for a long time i only understood
i guess rationality implicitly and then
rationality explicitly
but there is kind of a world of power
out there and
like you decide how you interact with
it um
if you choose to interact with power in
the way
power wants you to you're giving power
the upper hand already
if you choose to combat power you're
useful to power as well
so just to think about that to think
about you know
where is the power and how to kind of
uh act accordingly right
and i don't just mean powers and
governmental power i mean that's one
kind of power but there's also
technological power
uh littoral power
maybe that is what uh i kind of have
this theory that that's what
um the humanities are supposed to study
but sometime before i was born
they seriously nerfed the humanities
because they don't want anybody thinking
about power
um maybe that's conspiracy theory
whoa cheap roulette let's go
let's go boys let's go
connect metamask connect
wait all right connect with the cheap
network right that seems good
how do i bet oh here we go back
depend on five seven let's bet on red
let's bet on odd all right let's go
well i just sent a lot of transactions
how come there's no animation of the
wheel spinning
oh my gosh it didn't let me bet on five
twice
see the block explorer which one
no this one's taking forever to load
yo i clicked a spin wheel boys it says
time until next spin
it's counting down i'll click it again
no i'm pretty sure i already get it but
i'll do it again why not it's cheap
the last thing i ever want to talk about
is donald trump the greatest thing about
biden winning the election is i've heard
the name trump less
i'm not even making a judgment on
whether he's good or bad i just you know
i'm sick of hearing about it uh
all right did i win
i want to know if i won oh it's spinning
in spanish
i won two i think i bet five that's not
great
oh i should have been on 14 that would
have been the move
you know this thing is great
get it on tv through that yes submit a
photo across the good home i'll put on
the website
i love tv through that i appreciate that
you only put in one zero and you're not
trying to scam
oh pr is on website oh my margin
roulette whoo
yo this is this is exactly what chibi is
meant to be
a party and there's definitely roulette
at the party
should it be at the party
that's the other thing too and i'll say
this you guys like don't like it's the
thing i feel about this this channel
right
you know the comma discord the cheap
discord this twitch channel
these things are parties right um
they're not communities
there's a community aspect to it but
they're parties right
and the parties are being thrown by
people the common ai discord is a party
being thrown by comma
the cheap discord is a party being
thrown by goku this
channel is a party being thrown by me
right and if you come in here and you
complain about how my party doesn't have
enough lobster
maybe i'll uh you know say like well i
didn't get any more lobster
and then if you say well i want to go to
a party with more lobster i say
okay get out of my party right
like like it's not it's not a it's not
there's no voting you have no
power right and this comes back to power
right like
this is not it's not like like if all my
party guests decided they wanted lobster
right like maybe i'd listen
if it's a legitimate complaint but if
they just demanded lobster be like yo
get the fuck out of my party right
it's 12 26 you think i'm drunk
today we're making feta cheesy alfredo
you can get lobster because you're a
subscriber
subscriber only lost
but like my point is we're all here to
have a good time
and that's really what the vibe is for
if you ask for lobster in a funny way
i'm interested let's go with this vibe
if you're here to
demand
that's not energy i want to span energy
a small dick energy right
you want big dick energy right hey can i
say that on twitch
look at this should i look at this
you're a subscriber so i'll click your
link
twitch has added oh a brand safety score
oh wow you know i heard about the
chinese social school hey you know what
guys
if twitch kicks me off always geohot.com
is the closest thing to something i
control so you know
just check here if everything kicks me
off i think so i'm not really a very
controversial person but like yeah who
knows
he's two pills away from schizo i'll
allow that comment
all right all right all right all right
let's write some code look we already
wrote 34 lines today that's a lot of
lines
i get blocked by number this is an easy
function to write we're just going to
return
headers sub block number we're also
gonna
require
that
0.
let's try to test for that
look
expect transaction to be reverted but it
wasn't reverted
oh well that's not good
wait why is it printing that
how did this even compile
different number of r oh uh we want to
return the red
and then we want to return the depth
largest block number minus
hmm
i do want to check that they're like in
a chain
we'll see
cool that test is passing
um
find genesis
okay i'm not finding genesis blog
because we're not submitting the genesis
block
all right
we still need to do the check uh
what
um we can have the same where's the
submit header selection
um so i guess the trivial thing to do
to do validate block
this should actually just work already
if we don't actually care about
validating the block which is obviously
really stupid and ruins everything the
bridge is meant to do but that should
work
what has to compile all the files every
time
great cool
uh why the depth so low
oh because we can actually write the
thing that saves largest block number
if block number greater than
largest block numbers
so
so
you know i guess i'll say another thing
about the reputation
if you're taking actions because of your
reputation
that's what i have the problem with
right
like i shouldn't do that because like
you should do
whatever is you you shouldn't you
shouldn't be concerned about
what other people think and that's where
i think the problem becomes like
of course everyone wants there's nothing
wrong with wanting a good reputation for
doing good things
i think people want to do good things
but the problem comes in when it's not
you doing good things it's you
projecting the appearance that you do
good things
right just do good things just do good
things in the tr
and trust that the world will judge you
appropriately
and if they don't it's the world's
problem it's not yours
right now i know you got to be really
careful when you say like things are the
world's problem and not your problem
because if you're trying to use it to
leverage something like of course it's
your problem but what i'm saying is
never use it to leverage anything
right like you just be a person be you
do what you want and like you know let
the chips fall where they may
like in cheap roulette
i have to concern myself with others
because others concern themselves with
it and sadly i don't have an
independence from society i wanted
independence from society either if you
know look
you think i made that team now someone
else grew the tea but they're gonna keep
selling you
tea and then if they decide one day
that fuck that guy we're not gonna sell
him tea or give him food anymore
we're gonna we're gonna blacklist him
from everything in society then i die
right like i'd rather die with with
you know integrity than than
you know live on as a sellout right i
think that's a common theme on this
stream
did i die fuck it man you know
oh my god but like the problem with this
stuff is then people use it to be a
shitty person they use it as an excuse
to be a shitty person
like if the only thing that stops you
from being a shitty person
is because you're concerned that what
other people will think about you
then you're already a shitty person like
i don't know what to tell you
you know you gotta just
you know have a set of morals like
morals are cool ethics
are a scam ethics are other people
shoving their morality down your throat
like you know you can kill people you
just gotta like be okay with it right
like
like you don't like you know
as long as that's good within your
morality
personal integrity is key the only guy i
answer to is to myself
i'm pretty hard on myself um
see i smell cracky
i mean let's talk about you smoking
crack right like like when you're lying
in bed at night
are you happy with your identity as a
crack smoker and if you are more power
to you
right but if you're like you know if you
don't like that aspect about yourself
change it but it's only you that you
answer to you know
it's just as bad the person who like you
know
doesn't smoke crack but wants to because
they're concerned about what society
would say
i've never smoked crack my friend smoke
crack
and he described it as basically he's
like yo
it was actually terrible three minutes
but after the three minutes
i wanted to do it again
so that's what i've heard crack is like
yeah the crack lasts very long right
no no no cocaine sucks
you know the problem with cocaine is
like you think you're cool
but then like watch other people who do
it
when you're sober and you just look just
like them so like if you like the way
they look and you're like that's how i
want to act by all means but you know
cocaine is great don't be a hater no
fuck cocaine
bug xanax fuck molly
that's right don't do those jokes
he's a globally renowned energy expert
sought for his advice
i mean some some things like that are
just too fun that's funny that's really
funny
that's really funny
let's wait wait like can we just break
down for a minute why that's funny
like it's funny because you know
is that really the narrative that that
this state thinks you're stupid enough
to believe
but like they should have just been
honest about that you know
yo my son's a crackhead so i got him a
job
you've just been honest about it
um politics is a meme yeah debbie you
can't
the only reason i even know about that
is because the twitter
censored the new york post and it made
me hate twitter even more
that is why i don't tweet first the new
york first they came for the new york
post
first they came for alex jones then they
came for the new york post
and then they came for you
league of legends not even once i think
i played league of legends on stream
once
okay um so this works
finance bridge
wait really
is this decentralized
oh
oh you don't like that my ip is that
hey us government hey hey hey
feds if you're watching right now
i want you to read the rest of this list
of countries right
right albania the democratic republic of
congo
cuba iran iraq north korea
sudan syria and zimbabwe
is that who you want to be associated
with as a country
like like sec that's what you're doing
right now
when you make binance put that up you
are associating the united states of
america
with these countries right is that
really what you want to do
think about it feds think about it
uh so we can't use the binance march a
bridge and that's why we're building our
own bridge
the bridge of freedom decentralized
freedom bridge
indonesia is a nice place myanmar
i don't know i've never been there
what's wrong with those countries
i mean nothing's wrong with them but
like if you were like hey
do you want to move to uh do you want to
move to the netherlands
i think about it do you want to move to
japan
think about it do you want to move to
indonesia
think about it do you want to move to
congo
no do you want to move to iraq
no do you want to move to zimbabwe
no right and that's what i mean
the more times they put democratic
peoples and republic
in their country the less legitimate
their country is
china is the people's republic of china
taiwan is the republic of china
south korea is the republic of korea uh
north korea is the democratic people's
republic of korea they put three of them
in there to just remind you really how
democratic peoples and republic they
went
ireland i moved to ireland my own sounds
like a nice place i've been there
beautiful place beautiful country nice
green grass
united states is united
hey man we had a war and we proved that
it was united
we're probably willing traitors to the
queen well i'm not even gonna go there i
don't want some
i don't understand what upsets like the
the ira whatever it is i'm not on
anybody's side i'm a neutral observer
i just want to drink guinness and party
man that's me
what is russia's official name just
russia
i see don't add yourself to that list
man join the future
oh whoa whoa whoa whoa
russia federation oh well that's that's
very star trekian of them
um
wait gnosis
that's cool i've never set up a multiseg
consensus engine will update validator
set from bsc validator set contract
oh my god okay it seems like what i'm
actually gonna have to do is
send the validator set
in the genesis block
okay and then what we're going to have
to do is update the validator set and
we're going to have to show that
transaction
every epoch blog validator will query
the validator set okay
i'm gonna have to query the validator
set let's go
um how do i do this it's a contract i
assume right
with the call
oh no oh no they're two percent it's
better than the one percent that's twice
as good as the one percent
for viewers later some guy said that
isn't all the bitcoin owned by two
percent
well it's better than the one percent
bitcoin twice as good as fiat
um ten can second some negative
feelings toward paris
not huge negative feelings right like if
you still if you still ask me like do
you want to live in paris or do you want
to live in
congo you know
shit i live in portugal before i live
and lived in congo don't get me started
on portugal
did you take congo okay
to be fair let's let's let's let's
before i hate on congo more let's
actually take a look
that's a little that's a little uh
yeah 0.48
gdp of congo
okay so hmm
yeah congo eight times
smaller economy than amazon
i don't i don't really mean to hate on
congo if like my neighbor's a big congo
shell yo i don't mean to offend you i'm
just trying to make you know
i'd love it if congo like like like got
that human development index up to a
good like you know
at least a point seven
yeah now this is if you guys don't know
about the human development index this
is a pretty good like
do i want to live in this country
indicating right
um let's see let's see where we get to
countries i wouldn't live in
well these seem great
all right we get down there a little bit
i'm surprised it'll be so loud
i mean you know i'd be a little afraid
here but like yeah it's still
you know not terrible or
maybe that one's the cut off
yeah i've been to panama i've panama has
a 0.815
um what's the lowest i've been to
wait malaysia's that far down malaysia's
mad nice i have no idea why malaysia is
that far down
i don't know maybe i was just doing rich
people parts of malaysia but
my experience with malaysia was it's mad
nice
wow that's interesting too
oh okay so malaysia's like above i
wonder what this tracks
i've been to indonesia oh i've been to
vietnam
also like pretty nice okay maybe you
gotta okay maybe point seven was about
right
i've never been to india
uh where is mongolia
okay above point yeah yeah 0.7 is a good
cut off
you want you want to be above medium
and then yeah you get down to the poor
congo down here
chad
yeah so what's the lowest one i've been
to i guess vietnam
vietnam's a great place to travel to by
the way
where is like uh ethiopia
oh
oh that's that's that's worse than i
thought kenya
better
iraq's not doing too bad can you go to
iraq
can i book a flight i mean like aside
from corona
let's go to iraq tomorrow
hmm iraq's closed
oh covet
wow that's a lot of just a lot of
connecting flights
calling me this is susie calling with
the vehicle service department
we're calling about your vehicle's
manufacturer's warranty we sent you
several notices in the mail that you
have yet to extend your warranty
pass the factory cut off and the
imbalance hi this is
invalid sound prompt hi this is susie
calling with the vehicle service
department
we're calling about your videos
what yo i got hung up on by a
telemarketer
i love talking to the telemarketers all
right we gotta get the
the validator set okay oh here we go
good
they tell you straight up how to do this
um you're doing
34 shows every day and every time it's
the same
look at those hippos they're wiggling
their ears
just like they have for the last 50
years now i'm laughing my dumb jokes but
i'm dying
inside and i'm working on the jungle
cruise ride
system eh okay
bsc validator set contract
oh my god you can get misdemeanors or
felonies
[Music]
should fetch validator set okay how do i
do this
wait this isn't right i can't do that
that's i'm on the wrong chain i can't
put that there
i'm gonna have to figure out how to get
it here
current valley
wow you can put validators in jail
do update state is same validator
decode validator
um web3 finance smart chain get
validators
um
anyway this is not quite as easy as i
thought it was going to be i thought
this was going to be a quick stream
nothing's ever fast
um
we inject oh this is the binance
chain wallet wait seriously
there's a problem with the wi-fi oh my
god that scared me
oh my god that scared me yo
well it's apple homepod
you're getting unplugged yo man that's
what happens when ai's do that
i got freaked out man
just like the direction it came from
like who's here
okay uh this is this is
focus we have to get the set of the
validators
and then
we have to get it at that block
verify the signature of the coinbase is
an extra data of the block header
compare the
oh good okay this tells me how to do it
structure of extra data is
32 bytes of extra vanity
known epoch block
known what's a known
okay so maybe that's an address
i don't see any extra vanity there i
guess that that's a signature i assume
uh so what i got to do an easier cover
before we find this this is
any chain thing
they might have some stuff that's just
going to help me
wear your co no this isn't the right any
chain
any swap that's it
look at how much darker
just a fork of open zeppelin contracts
not useful
cross chain bridge using dcrm technology
do you trust any of this i can't believe
i use this good thing i'm putting a real
value into it what is dcrm
that seems like something you like
licensed weirdly
before i hate let's google it
i don't know okay okay before we hit
let's figure out what it is
which is crucial interoperability
centralized study model this is the
latest
see that's marketing copy
which is what turns me off to this four
leading cryptographers that's marketing
copy
right like like what turns me off to
this
is is why are you telling me that
like if it's good you don't need that
sentence
this is marketing copy that at least
says something but this here is proof of
authority and proof of burn market
copy
i don't know about any of this okay
maybe this is all crap
um i just i'm hoping someone's already
written this for me but maybe not
uh okay
what's that copy functionality
i like extract bytes32 from that i don't
know how to do that well
solidity
like i want to extract those things and
i think that's a vr and s and i can
easily recover that
then we have to confirm that that
person's in the validator set
now we're going to have to track a lot
more than this because we're going to
have to track the whole chain
because we're going to have to push
updates to the validator set
i should be able to get that right
is there like just a getter so i can
call it
here we go get validators
that seems nice i forgot to parse that
later web three
call get validators
like that or something
this isn't going to be useful here we're
going now perfect
okay web 3 call
two
it's spinning should've been on 22.
i don't know about you but i'm feeling
22.
everything just felt so right
uh we need the data first we need to
figure out what we're calling
so we're calling the bsc validator set
and i assume this has the function get
validators
okay that looks like something
no inputs
well a donut you know where am i going
to get a donut
that doesn't work in javascript though
does it like some other stupid crap it
gets me the first four bytes
complicated junk get get
first four byte great javascript example
get first for bite how do i get first
four byte why don't you include
charge code to do that
the first four bytes
array prototype slice okay i don't know
what to write
does that work
um let's say validators equals
we're ready to add the weight oh prom is
pending oh go down and wait well don't
forget to wait
didn't even work because i forgot hey
too many parenthesis and let's just add
the away before i know because we're
going to need it
watch it not be watch call synchronous
for some reason
web3.3 is not a function
um
what do you kill shots
did not work
dude my slice works
b7 no it didn't work
start to end represents the index of the
items in the array
what
second element through the fourth
everything element only gave me b7
oh that is four
oh i get it you're returning a fucking
string
wow you know
just just javascript just javascript
things
it's good we got a set of values
beautiful
[Music]
um
this actually isn't what we really want
we want to call at if that's possible
but i don't know if that's possible uh
what are the parameters to web three eth
call
is one of them at can it be at please be
ad i'm sure it's not at
uh oh
if you pass this
parameter it will not use the default
block maybe this is gonna work
we don't really want we want the
missing tri node
um
because we have to get the validators at
the block you get it
invalid big number string
oh because we can't do bridge
which work
all right so i think actually that's
just something let's just pass
that blindly
refined
oh good but bridge doesn't do that
that should work right
oh for some reason like does not fall
why is it like block underscore number
just number
let's do dot i think who knows
javascript
not this guy
alright cool ah so let's
pass in
we're gonna have to pass in let's just
use their language
got the whole phrases
returns address memory okay well
oh it's just an array of addresses oh
that's beautiful
uh cool
so let's just make it take in an address
memory here and say
address uh
it's called consensus adders
and then we will pass in the validators
into the bridge finance factory
um
actually i just want to copy the same
where are they getting this from here
card validator set
is that defined
let's do this right
push
must be memory
invalid value for array
why
oh god
does that work
maybe it's validators that doesn't work
oh it's just like wrapping something and
i have to do like dot return
is it not the same for some reason
returns address memory
that should work right because i'm
taking in an address memory
invalid value for array
okay that kind of makes sense
i think what we actually want to do is
figure out how to get the eth call to
parse these things right
i don't want to write code to parse it i
could
oh it's just a d code right i can do
this it's going to like be like
call like decode abi or something
decode abi web three
here we go
um and code parameters decode parameters
ah
decode parameter type
signature is address
i really shouldn't do it like that
um
there we go cool
so those would be in console log turns
out none of that was the problem
so those consensus adders are actually
coming from the contract
great so
those are the official validators of the
binance smart chain
um reprinting the extra data here it's
gonna be like oh you can't print that
it's a bite's memory
um
no so if that was the address no it
can't be the address because it's not
anywhere
all right so i think what we have to do
is we have to ec recover
on that
and then we're going to get an address
out
and then after we get that address out
we can see if it's in the validation
steps to the validator said it's good
ec recover solidity example
vrs um
coinbase where's the thing that was
telling you about what's in the extra
data
what's a non-epoch block
an epoch block
non-epoch block i think that's
for now that period is 200 ah
a block is called an whoa
every epoch block will store the
validator set mail
message
oh this is cool
n times 20 bytes of validator address
the sign content is the cac of
wait but
what if what if it's not an epoch block
you can only ask for things like that if
you're
a gifter oh what about big gifter did
big gifter ask a question and i missed
it i'm always afraid that i'm going to
miss questions from gifters
the signed content is the cac 256 of the
rlp encoded block header
pc recover finance smart change
doesn't even tell me who signed it
i assume it's easy recover
let's figure out what ec recover really
is
i'm going to obtain all the values
necessary from this
well yeah it's this but
i would defend solidity thank you for
telling me that it's very useful
good guy be a gifter
um yo people who are supporting go
routines
don't
the world would be a better place if
nobody was a simp right
don't be a sinner
hi i'm entering this chat room looking
for validation
and look i understand if that's not your
intention but
like looking for validation from other
people
is stupid because then your
self-worth is based on how other people
feel about you
and then you'll end up buying into their
ponzi schemes
but if you build a self-worth based on
skill and talent within you
you don't buy into their schemes
yeah that makes sense
now but advice is stupid too advice and
validation are really very similar
right so so let's let's let's let's
let's you let's go back to exactly what
he said
all right i think sorry not to rip on
you but like
that's not advice that you're asking for
there right like like read that
carefully
if someone's looking for advice there's
two possible choices like should i get a
dog or should i knock at a dog
right and you know you can give someone
advice on that there's probably not good
generic advice but
if there's one obvious answer it's not
advice they're looking for its
validation
all right no i think a lot more people
when they're asking for advice at least
that's what i've seen they're looking
for validation
don't give people validation
because if you give people validation
you are
a simp and don't be a simp
is that what simpest i don't really know
a sip a word everyone overuses without
the correct definition
[Laughter]
a silly or foolish person
a sim provides validation that sounds
right that sounds right that's what kind
of what i'm going for right
yeah they call me out brother they call
me out they know what's up hey at least
i'm self-aware looked it up you know
i didn't just go with it sometimes i
just go with it say words like
ganache and i don't really know what
ganache means but i see it right here so
you know he's got a lot of ganache
oh it's a one-to-one mixture of
chocolate and warm cream
i don't really understand this
well there's also another problem which
is there's no way the signature of the
block
can include the extra data if the extra
data is where the signature lives
is that right oh gosh is the brother of
rasputin and anastasia ah that makes
well it sense us the value set
create file
oh and fill in the extra data field of
block header
full node will verify against the
validator set in contract
all right so what are these epoch blocks
every 200 blocks
um
we could force it to go at a uh
at an amp block
you guys you know you just gotta watch
out for like
yeah there's all these like little
tricks
about
like how people lie
i don't know if they're aware that
they're doing it and i wonder if i lie
i'm not aware that i'm doing it
you know however i think about
myself i always think that i'm the mean
i always assume like i think it'd be
awesome to you know get a gun right
i think i'd like to walk around with a
gun i think it'd be sweet but
you know when you look at the statistic
on guns and it's like
you're most likely to shoot yourself
followed by you know a friend or family
member i'm like yeah i'm probably the
mean
right like i said that statistic applies
to me right
you know so yeah i always gotta here we
go i wonder about those things right
people who are like you can use this the
other way too like people are like
scared of plane crashes and they seem to
die in a plane crash you're like you
assume you're
mean like no one does a plane crash
um see and that's the worst part you got
a response anyway
and that that that that question got
validation in the form of response and
these are the great
kafka traps kafka trap
hmm a sophisticated rhetorical device
no this is not a kafka trap but
one of these things where like
you know you can do something and then
just by doing the thing
whether somebody opposes it or supports
it
they're furthering your agenda
some jedi mind trick shit yeah yeah you
know the thing
uh
okay we gotta figure out how to get the
other way we gotta figure out how to get
the things out of that
um so this is
rlp header.length minus 65.
so i'll be header.length minus well okay
fine
we shall write the code
extract
bytes32 from
solidity i might be able to adi decode
that
yeah we use assembly that's good
uh bytes 32v
like this
no that's not exactly what i want um
okay let's say add rlp header sub
copy header length 65
i want this is like an assembly variable
uh let sig
equals that r
cover
oh what's the message
oh the message oh okay i get it so the
message is gonna be the hash of the uh
the thing
i don't even know what the hash is gonna
be i don't know how we're gonna find
that because it's not the same normal
block hash is used in the other bridge
this can't be because that includes
extra data
the signed content is the cacac 256 of
rlp encoded of the block header
that can't be right because the block
header includes the extra data
are you looking for keyboards
yo timeout
luanne payne thank you for gifting subs
can analyze my cough you get a question
if you have a question please ask your
question i'd love to answer it for you
you can't even ask about the keyboard if
you give subs to people
there's a lot you know this this this
i'm not about like this party like you
want lobster at the party and you're
gonna bribe me
i'm interested hipton
you didn't donate a lot of subs
just like the people who give subs are
really the best kind of people and i'm
genuinely interested in their questions
you gifted subs hipton where have you
gifted subs
i don't know
i don't know no real question awesome
see
that's they're good people you know good
people gift subs
two months in advance oh that's
that's pretty good that's pretty good
what is the extra data
wow with level three wow the hype train
is really going
um
guy with the rust if you actually gifted
subs and i didn't answer your question i
feel terrible
and if i like re-watch this video and
find out i'll feel i'll feel really bad
about myself
you know because i'm i like to think of
myself as an honest person who does what
they say they're going to do
george isp 2001 that's a derailing
question and you're not even a
subscriber
um isn't being a sub enough
wow wow yeah it's enough for me to
appreciate you but not to answer your
derailing questions
you gotta give subs for that
all right so i was thinking about what
food i have
and this is gonna be bleak we're gonna
put some pasta sauce in a bowl
and we're gonna get some chips and
that's what we eat
i gotta work i gotta wear whole foods
delivery
i'm out of eggs finished my eggs this
morning
we have a couple spin drifts left by a
couple i actually mean two
so that's real couple oh no that's too
much pasta sauce
oh that's a tragedy
okay put some back in the jar
i feel like we gotta make pasta
is that really savage like just eating
chips and pasta sauce
we have a lot of pasta we have to cook
it
[Applause]
go routines you're close to getting
banned
i want to hear your you know real men
shit
oh i haven't got the club
wow
um cheap is a scam
um but like all scams it might be useful
uh pay up all right what do i think of
rust
i think rush is really hard to code
and i don't think it's that useful but i
think they've built an
ecosystem because
people like that complexity
like like it's it's that nerd this is
hard to do but i see what it is
it's not a productive programming
language but it is a
makes you think programming language and
that's why russ continues
wow we really got this hype train going
c plus plus is not a bad language as
long as you don't use all of its
features
and if the syntax has become a lot
better in the new c-plus process
there's great food
any other sub gifters want to come
forward
yeah don't use exceptions in half of stl
pretty much
um reverend trash is that a question
did you give subs
oh who's the gifted sub oh girl scroll
up i'll scroll up
miser alvarez do you have a question
who updates on my university yo real
talk guys
i'm in escrow for 123 acres of land
in the san diego area and it may very
well be the home of my university
the land is beautiful
it has a few issues and if we get the
issues fixed during the due diligence
period
escarole will close i have a name for
you right
we got a lot figured out yeah the
university it might happen
i have a trailer park what's the
difference between a trailer parking
university
really though what's the difference
um what are the odds that compiles
low if you went to university instead of
a trailer park
you might know
but i went to a trailer park i'm not
university
that's why i don't know
land in california yeah
oh you can actually just do add rlp
header start
uh yeah
i made all the money dumping um dumping
on the gme fools jumping on
dumping on the amc fools by land
oh that doesn't work
gm is up again is amc up
i still have some amc wow
sweet dumping amc tomorrow how's my
silver
not up go up i don't understand
how do we have so much inflation yet
silver is still so cheap
what do you mean log not found
um not supported eh
can i walk be at least
zero shouldn't be zero
let's just try us
hype train success
hiptan i'll give you another question
about books the answer
is i don't know
wait for alex friedman part three
yeah so i think that that's actually
overrunning the random
uh no i was kidding there's no actual
like screaming parts right
you know i love that two chains line
[Music]
my ice is cold colder than february
the day you could fuck with me that
would be
neburi
famous six thank you for gifting a sub
do you have a question
i have a question that shouldn't be zero
why is it zero
valid type oh
i want this in hex
okay that's ca so where is that ca crap
this should end with 9c i think
no okay i did something wrong
that should be right
we'll just log the whole thing
in my assembly not good yeah
we're eating chips with pasta sauce
savage food
for a savage afternoon
cfef okay so that's actually there
that actually might be the right place
though so hang on let's see how long
this is
110.
55 okay no that's not the right place
it's probably that
no
it's slightly off it really doesn't make
any sense
oh why did i do rlp header.length
i want extra data that language
famous gifter oh wow you have a little
thing next to your name if you gifted a
sub
i see do you have a question
wow so that one actually does look like
it does end with zero
this should end with phone if i did it
right
do you think with fold no
it doesn't i was pretty confident in
that too
d8
hmm
no that's not right because that's just
the beginning there
equals add extra data to start
that's all of extra data printed from
the thing all right
so now when i look at the hex of this
how come it's that
b7 where's b7 here so let's just start
with
it 2e okay so that ad isn't working for
some reason
is actually at all length wrong
i'm getting rid of that stupid
console.log as well
okay we get 97 for an extra day about
length
no so it's not wrong
dirty chill all right
i don't know can we not add it for some
reason
what sig equals add extra data start
so when i um load
if i straight up type that add extra
data to 32 what do i get
do i want to add 32 already because it
like reads it weirdly
that 64 here
hmm i don't know
i'm ready don't understand how m load
works let's do plus 32
oh because of the length
storage
i think i do have to add 32.
now i want to give you money why would i
give you money
you're always eating man chill out
all right that's right cool
this is all junk don't need any of that
i just need to figure out how to
actually do the signature of that thing
oh famous question has been posted
lmao xd
control
can you crunch louder my momma's next
step can't hear it
yeah where's the ear and chill man
this is really a savage lunch
wait this is his question are you trying
to steal a question
are you trying to impersonate somebody
else and steal a question
whoa
no don't don't don't start me with
don't get me started on drake yo some
people man
some people you know
just savages that's the most savage
thing i see
all streams we're making some pasta
let's maybe a couple more chicken oh we
have ramen water left over out around
the water
get ready for some more check
i'm hungry i didn't eat much of that i
worked out
oh you know what i'm not even gonna have
any pasta sauce in this arch heavy
because i just take pasta sauce on chips
and i can't smoke any more pasta sauce
we're just going to put a little olive
oil a little pepper
oh i think it's going to be delicious
boys
i think it's going to be delicious
can we listen to drake no because
drake's copyrighted
even though it's shitty music it's
copyrighted
wait that is a one how come that didn't
work
never v
i'm not dealing with this i'm just doing
this
do i need semicolons and solidity
assembly
that should be a one do you not see the
one
it should be a one how come it's not a
one
b4 then zero one
oh because hmm
all right let's be a little smarter
about this i think we can use little b
but i think we have to say 33.
actually the 64th bite
yes we got a one you see when this is a
one that has to be a one when that's a
zero that has to be a zero
that was my question but i still think
he deserves to get
banned just to make sure
i'm confused about all this
and i have an idea
i think what we should do instead of
answering famus's
question we should uh
wait i'm trying to figure out gerbly
j
where's this question
i don't see where this question's post
said
multiple people said that so i'm not
gonna ban anybody
i don't know no one's getting banned
famous nine is the real savage
and you don't get a question now you
know the question's not irrevocable
you don't get a question now because you
spent a lot of my time investigating
um question gate and uh
question game took a lot of time
bananas you just got bananas
that's funny we're just banned a lot of
people and just banana
you know you can't spell banana without
ban
can't spell banana without ban
uh okay
finance smart chain light node
anyone write one of these
node binary
light node prod
063 linux
wait no was the was the was the code for
this
the last thing i want to do is download
some binance binaries
that run the node
is this not open source
red jazz cat you gifted subs and i see
your question there is that the question
you want
how do you decide when to use a library
versus building your own library
whenever you can steal code from other
people steal code from other people
every time i decide to write my own
library i regret that decision
and should have spent more time reading
code the less time writing code
porchetti
i think i've been eating looks like
pasta ramens pasta
chips is pasta it's all pasta
i wish i had some meat you know
water that's not oh spin drop oh that's
what i really want
oh yeah buddy you know i walked 24 miles
this weekend
and my core hurts
atlanta locks welcome good to see you
around
oh it's open source no no but
so i think that thing that you just
linked to is the
go ethereum or maybe it is the same
thing
yeah okay pretty good
i'm gonna see if we can make this work
i'm gonna sync to the finance smart
chain
uh
to achieve the cross-string
communication being on chain
huh
what's tendermint
oh you raided oh oh i didn't understand
yo i don't know how to do this 217
people
great welcome new people all right
in honor of the new people we will do a
recap of what we've been doing
so my name is george um i am the lead
developer
for this project chibith
and if you guys know ethereum
uh cheap ethan ethereum are very similar
except cheapy is a thousand x cheaper
it's actually trading on exchanges
almost 10 000 x cheaper right now
and you can see that right here in my
wallet i have 33
000 cheapies now to be fair this is a
lot of cheap beef but you can get some
uh if you want to play cheap beef too
you just go to cheapheath.org you can
click this beautiful button
i'm already on the cheap chain but if i
were not this would pop up a thing and i
can add cheap eats to my metamask
so you'll see here these are the
different networks i have there's
ethereum main net there's a whole bunch
of stupid test networks and then there's
cheap beef
which is a great etherium chain that you
can use now
what we've been working on in this
stream
is we've been trying to bridge so we
built a bridge
to bridge cheap eath to
other uh proof-of-work ethereum chains
so ethereum is a of work ethereum chain
um this can bridge the main ethereum
chain into the cheap chain
one of the problems with the main
ethereum chain is it's too expensive
everything on ethereum costs like twenty
dollars for transaction
so there are other ethereum chains which
you'll see down here like this one
called smart chain
smart chain is binance smart chain
finance is an exchange and they ran
their own
proof of authority ethereum network
called
finance smart chain and what we're
building in this stream is a bridge
to connect binance smart chain
to chibi so that when people on finance
smart chains send money to a special
address
they'll be able to claim their money on
cheap
what does the bridge do the bridge
relays state in a secure way
um
is this useful
client
get block
what code was i even looking for here i
was looking for what actually validates
the
transaction
yeah so a lot of the ethereum stuff's
written in go the client for cheap
is written in go the people are working
on a rust version of it maybe we could
do that stream if they don't uh
come across with it but so what the
bridge does is it puts the state
so this is the bridge to finance and
you're going to be able to call this
function get blocked by number
and it's a trusted function that returns
the state
of binance smart chain on cheapy
then you can write consumers of these
bridge contracts so i've written one
already called bridge sale
br the bridge sale uses the state from a
bridge to validate
send transactions on the bridge chain
so if you send to a known address
that address right down here is the uh
the
dep
i shouldn't call it death i should call
it deposit address
well it's the deposit address um
if you put in a deposit address there
you can validate
if transactions were sent to that
address
on the other chain and then you can have
it actually send value
out to that user
um yeah so what this is going to let you
do is if you have money on the binance
chain
you're going to be able to send it to
the cheap ethereum chain
you're also going to be able to send
money from the ethereum chain to the
cheap ethereum chain as well
uh one of the caveats here is sending it
back is a whole lot harder
because we have to make the cheap easter
change secure against 51
attacks which we'll do in another stream
what if someone hacks the bridge well
you can't hack the bridge
um so if you'll read this bridge
contract here
this is the block submission endpoint
called here submit header
this is public there is nothing when you
deploy the bridge
we don't even save the owner address
there's no only owners anywhere in this
contract
so this bridge is completely
decentralized and anyone can interact
with it
which means two things one there's no
special
privileged authority to hack there's
also no correct special privileged
authority to submit
so there's no censorship right anybody
can run this bridge
and use it doesn't it cost to send cross
chain
well we're going to build the cheapest
cross chain solutions in the world
because we love cheap cheap is the
cheapy
philosophy i explained for the new
people who linolux brought around i want
to be a good
raid host and i want to explain to the
new people
what i'm doing my name is george i like
programming uh i like
sunsets i like long walks on the beach
um and i like spin draft which don't
sponsor me but shut
so what we're trying to figure out now
um
in the bridge finance contract is this
function
ec recover so we've extracted the
signature from the contract
but we have to figure out what we're
going to hash
for the message so we can see what
address it was sent from
they said the message signed is the rlp
encoded
block header but it kind of can't be
that
because that includes the extra data
so there's like a bug in there
documentation because something just
doesn't make sense
so i've been looking through
i'm not going to find it here though i
think the only place to find it is in
the validator code
as soon as here
there's an intro to this channel i
wasn't aware of that
um yeah so we're trying to you know
we're trying to solve a problem right
now uh
i don't prepare at all for these streams
we have to just
do it and you guys are all part of the
struggle with me we all struggle
together
and at the end hopefully we all get
redemption from our struggle
and by watching this stream you can be a
part of that struggle
and you can feel the same glory it's
like watching
streamers for video games we're like
trying to do speedruns when they get it
you feel part of that too and that's
what i want you guys to feel once we
solve these problems
um we are here for the struggle it's
true okay
all right i just let's read the
documentation again and see if they can
the signed content is the keckack 256
of rlp encoded of the blockheader
so first off it's not a sentence
verify header verify the signature of
the coin base
is in extra data
the coin base should be the sign oh
the coin base eh well that's not exactly
what we want but at least it's something
that's clever the difficulty should be
expected
value okay
well good good thing we read this
uh
as you want to say the coinbase is where
the money is sent to for the minor block
so that's the validator when you check
the favorite value set
we're also eating pasta
let me get my colander out
i'm going to put it in the bowl with the
sauce just to be able to wash two bowls
but it's really just going to be olive
oil and pepper
a little salt too
you know i should have a webcam over
here so you can switch to cooking cam
you know that would really increase my
stream quality
my friend sent me a blue apron referral
code
i gotta get into that
yeah so cheap is a fork chain cheapy
is a fork of the ethereum chain
at uh this block
so uh
i should really make that clear oh
website
um we'll just add a little documentation
for that
oh and did roulette show up on the
website sweet
cheapy is a fork of the main
ethereum chain at
maybe i want to put two enters in there
and we'll get rid of that period because
the period is gross
foreign
no vice versa
um right now chibi is listed on an
exchange it's a centralized normal
crypto exchange
and you can swap your ethan cheap eat
um cheap eat this cheap
cheap also has a pre-mine for dumping on
speculators
which means i have a whole lot of cheap
if anybody comes in to speculate so it's
not a good speculative asset
um like if i speculate i mean if you
think oh i'm hearing about this i'm
getting in early i expect to buy
cheap ether and i expect the value to go
up that's a really stupid expectation it
has cheap in the name
so um if you buy cheapy
you can buy cheap for loving you can buy
cheap
for using but don't buy gb if you're
speculating the speculators are a cancer
that's a tax on everybody right if you
think about a speculator
a speculator is somebody who buys at one
price who doesn't actually want to use
the asset but just wants to sell that
asset to somebody else at a higher
price all that is a tax on the system
all they do is make everything more
expensive you do not want speculators
any more questions about cheapest
someone banned him for one small comment
about dogecoin i think that's okay
speculation is middle man isn't in its
finest let's show
all right i have to take the bait what'd
you go to jail for
um we're gonna print the block
yeah no they are speculators and you do
not want speculators
speculators are terrible people
ruining the economy
right like the housing crisis whose
fault was that speculators
now there is a way that we could have
responsible investment
um
like debt-based investment is usually
responsible
right if you just got a loan and agree
on an interest rate that's responsible
because there's no unlimited upside
speculation happens i believe when
there's unlimited upside
like it's fun to speculate like like
prediction markets i think are great
if you're talking about like a yes out
coming to no outcome that's the exact
kind of
speculation that we want but we don't
want spec we
don't want unbounded speculation
yeah most recessions and depressions are
caused by speculators i know and like i
don't know why we still tolerate these
people
it's because rich people are speculators
and rich people write all the laws
i would love to kick speculators out of
the economy entirely
um you can think of cheap cheapy this
may be the um
bitcoin cash you know what i will write
that note
we are the bitcoin cash of ethereum
um i won't say that that's a little too
pretentious
i'm just gonna say uh
think bitcoin
cash i do the capitalization of that
right
i think bitcoin cash
yo i got that bitcoin cash
but for ethereum
for eth instead of
what is
cheap
better gotta work on the copy
gotta make the copy good
oh it's not a good sale point exactly
not trying to sell it because
nope fuck speculator
goku wrote this poem and i love this
poem goku sent me this and i'm like bro
that's brilliant
one day speculator will buy all the air
not to breathe
only for huddle and everyone will
suffocate and finally speculator will be
sad
you guys understand the poem
should i put that above the fold what is
cheap
yeah okay okay okay okay fine fine we're
gonna work hard we're gonna work hard
get ready for working hard
uh users tailor
fun i've gotta write copy i gotta bring
new people into the cheap community
let's put it above the fold
um how to get cheapy that's what that
used to say
and then here we'll just have a
section up here
is cheap we should tell people what it
is
i don't want to be like those projects
that i criticize
where the
money is cheap the transactions
are fast and the party
is still going
the money is cheap the transactions are
fast and the party is still
going that sounds nice what do you guys
think you like my copy
should we put a link to bitcoin cash yo
i got that bitcoin cash
wow look we wrote coffee to explain
things to people
look at that
only four pastas left
that one wasn't even it was two and a
half more than a whole pasta
[Music]
to be fair we should include a link to
ethereum as well
just so we can be fair
since we did rip off all this shit
this website did a good job explaining
ethereum
okay not too bad just do a good job
explaining bitcoin cash
the best money in the world oh good
oh
all right
we are
inviting to new people
yeah remember we did that that was
during the last i'm a crypto you know
when crypto's up i'm
i do crypto streams and crypto's down i
don't care about crypto i'm one of those
i'm a fair weather crypto fan
needs more emojis and baseless ai claims
we still have the same ec recover
problem
i did some hacks on it last time but i
feel like i can't do the same hacks
again
all right we'll just copy the craft
flippers subcontract fine
really i have to write all this
because i'm gonna have to extract the
extra data and like the mixed data and
the nonsense
it's not called the coinbase it's called
the miner
i need to get that too
oh no this might be a two-part video i
think it's nap time
ate that pasta i think it's time to take
a nap
um all right let's just make sure all
the tests are passing
oh yeah i was playing with dockers this
morning
that's too much printing
sweet
look at this i love this i love who
wrote this to this beautiful gas checker
all right start
work on the finance bridge
um you know what i'm going to leave this
as a challenge to you guys
who can figure it out right i'll write a
little bit more code now i just like
it's just so boring like to figure out
oh you got to get the message to work
okay so
um
we can also say address
minor
at the end here
[Music]
i'll leave it as a challenge to you and
i'll be very happy with whoever does it
um so ec recover now is called
uh with a message so i'm gonna say
for now we're just gonna say bytes32
equal
message um signed message equals
256. we'll just say that to do
extract the correct
part of the block header for this
and then we're gonna ec recover signed
message address
signer um
we want to require
and then we also want to require
to do require
signer is in current validator set
but actually even just to make that work
is going to be a challenge
and that is the challenge that i'm
leaving to you guys
while i take a nap and if you guys come
through i'll be like wow i have a great
audience and if you guys don't come
through i'll be like ugh
yeah i can't even i'm gonna clean that
test up a little
yeah so these are reverting with not
signed by minor
and that's because this code here is
wrong
and to whoever fixes it i will
appreciate you
you have to fix what's on line 63
to get the right part of the block
header
i believe in you
and now it's returning zero
should not return zero um just for
fun let's actually also can i do a comma
here
let's make sure the minor is in the
validator set
because it should be so that we can
actually check
great and the value set okay we can we
can just write that
[Music]
um
uh
stole that from here
validators
gross
gusting
uh
require
[Music]
minor
set
okay those things work okay but
not signed by minor
great
finance smart bridge
fix ec recover
let's say finish
all right
thank you all for watching my stream
today
uh no i'm tired i'm thinking now
taking nap and i got things to do mix it
around and read
um you guys can do it i believe in you
finish ec recover this whole thing needs
better documentation too
um i think when this is done it's going
to be some of the
cleanest uh ethereum bridge code
that there is at least like the simplest
and you'll be able to conceptually just
get it so easily um
yeah we'll be able to make these things
work and then
oh we gotta write the whole um
i'm going to write basically check
pointing i think
uh and we're just going to use
checkpointing it looks like binance is
doing this every epoch block my hope is
by writing this binance bridge
we're going to understand how binance
matrix is doing it and then we're going
to do something pretty similar
like we're going to have a validator set
uh of people that we trust
and those people are going to be able to
validate the the state
uh i don't know if it's going to be
every 200 it might be a little much
but they're going to value the state of
the gp and then that's the canonical
state of gp
and i'll modify the go ethereum to
region that contract to make sure that's
right
what are the three most interesting so
i'll just stop at your question there
and direct you to this website i know
called buzzfeed
buzzfeed loves listicles
you are asking for a listicle
uh so no like a listicle's never a good
question
don't know who cares what's interesting
to me
who cares about my opinion right
like i have opinions but i don't really
care about them
you know my opinions are worthless
mostly
well okay actually i shouldn't say that
when you have an opinion
and you back it up with like like a
thought process behind it opinions can
be interesting
but a lot of people just have opinions
they're not really backed up by anything
i'm like yo i mean my opinion is
worthless
thank you all for watching have a good
afternoon everybody
and write my code for me so i don't have
to thank you bye bye
love your comment top one aetherium
forks in 2021
number one will shock you cheaper.org
join the movement get some cheap beef
before it all runs out just kidding it's
cheap there'll be plenty of it forever
don't fucking speculate
bye bye
twitch
so that got the right camera here we got
the right camera
we got the right microphone let's
play deploy optimism
on tv let's go
all right well for those of you who are
new to this stream
or you know i have never seen what a
seat belt is before
this is cheap eats if you've heard of
eath
cheap eat and eat are very similar the
main difference is that
cheapy is 1000x cheaper
or actually if you if you look on the
exchange right now
uh it's almost it's almost 8 000
x cheaper to buy so
cheapy is east but cheap
uh perfect for people who actually want
to do things with their eath
and not for fucking speculators who make
everything cost
too much money uh
this stream we're gonna be having some
yerba mate some organic yerba mate it
only has 120 calories of sugar
never drink your calories boys never
drink your calories i don't know why no
one's in my chat yet
yo come here come here should i put a
spotlight on my face
ah my face is lit up that hurts
who's coming to my chat room who's
coming to my party today welcome to my
party
uh it's not in l.a it's in san diego no
more parties in l.a
please baby no more parties in l.a ah
that mate yeah delicious
so i think i have a folder already
called optimism
but we're gonna make oh we're gonna make
cheap optimism so we're going to call it
cheap optimism now
optimism cheap optimism good morning
69 operator welcome to my chat
um so i am
going to la next week
to help optimism with their launch plans
and what we're going to do right now so
i can get familiar you know i like to
always like to show up to a job site
familiar
with the work i got to do we are going
to try our best to deploy
optimism on cheapy
and then we're going to see what we can
do with it because if cheap isn't cheap
enough and you want to go
even cheaper yo dog i heard you like
l2s so we put a l2 inside your l2
so you can you know what i'm saying ah
um so optimism is is a competitor
uh to cheat uh it's a much better funded
much more legitimate competitor
you can tell clearly by cheap eats cheap
demeanor
that it's not the most expensive
ethereum
you can tell that this company doesn't
have much funding
it doesn't um all it has
is cheapies
oh we're on devi right now i had to dump
all my my
my haters uh we're back on cheap eats
right now
let's go boys let's go
uh all what have is
pre mine you are a hater
and that's why you're banned cheap does
have a prime though
i wouldn't just ban someone for saying
that but i recognize his name he's a
known hater of cheap
we're spending zero time on haters today
and all time
on people who love uh chibi because
cheap is
is is everything you've ever wanted in
ethereum it's just like aetherium but
cheap um am i lifting hell yeah boys
thank you for noticing
yeah you have been working out guess
swole
one time i met this girl and i took my
shirt off and she's like yo you got a
dad bod and i was like damn we gotta fix
that so i started working out gotta get
small man
gotta get swole i really love the pecs
uh awooga awuga awuga
yeah man you gotta let even lift bro no
it's so true though you see somebody
and they're fat and they don't and they
got small muscles
you look at them and you're like you
have self-discipline issues
but you look at someone and they got big
muscles and they're in shape
damn see that's someone i trust to take
care of my money
that's why you gotta
all right okay
some ladies like the dad but i'm i think
all ladies like muscles
uh
all right so this is the optimism
monorepo
all the core optimism projects are
located in the packages
get sub module in it get some module
update
not set modules
um so i'm actually not sure
let's like see what this does if i just
yarn install it
so optimism has a lot of other uh
repositories too and we might have to
use some of them
i guess i don't really understand why
there are instructions anywhere for how
to deploy this
this is useful oh deploy custom
optimistic roll-up great um
okay so i have some secret instructions
here which i'm not going to show to you
guys
so i look like a genius uh okay
step one clone the contracts well we
were getting there anyway so let's clone
the contracts
optimism contracts
uh so we're taking a break today from
the uh
from the bridge we did do some work on
the bridge yesterday
um so you can come check out the bridge
over here bridge uh which is how we
bridge the east chain to the cheap chain
but what we're doing today is we're
deploying optimism which is an
l2 solution underneath cheap
so we have contracts here let's do a
yarn
um oh this says yarn build covan
well we don't want any covans around
here because we're on the cheap ethereum
network
let's see where they have the word covan
the old covan is that really oh so build
covan is just a
uh
chain id 69 yarn run
seems like the only thing that changes
is the chain id
so let's add in just a build cheapy
and we'll make cheap have chain id 96.
yarn build cheap
all right and then
okay so we're gonna have to replace
we're gonna have to set up my private
keys we'll use the same address i was
using for bridge
so this is the one i was using for
bridge we have a secret private key
so i'm gonna have to do that uh all
right we fixed that we fixed the open
pilot link
it's fixed uh we can we can check to
make sure that's actually true
we shipped open pilot 0.8.2
uh really big release you know it's been
a bit since we've done a release
um the big thing that shipped in this
one was mpc
now just takes the points in directly
from the model we used to uh
fit polynomials because the models used
to suck but now the models are getting
really good
uh should you be buying cheap eat right
now it depends
are you buying cheap beef because you
want to use cheap eat or because you
love cheap
then yes are you buying cheap eat
because you think somebody else is going
to buy it for more money
later then you're a fucking speculator
and get the fuck out
why am i using hard hat what else should
i use
all right let's read bin deploy.js
relayer private key
deployer private sequence key
private key
oh i see so i have to set them their
environment variables
oh that sucks um
all right i know what we can do we're
just gonna
we're gonna move the private keys we're
gonna use the same one that i was using
for the uh the bridge
uh fun bridge
scripts bridge
uh now
some fun bridge
wait what was the private key
this did have a private key right
so i did this
i remember like i called it like bridge
key or something
you guys remember this from the last
stream
here we go bridge key
so now that i'm a javascript wizard
we can just uh you know do this stuff
like this
deploy your private key actually we'll
just call it private key
actually better yet we'll just call this
private key
and then we'll just get rid of these m
things
relay a private key
okay
um okay
l1 node web3 url okay
so that should do it for the private key
ah
why add optimism if cheap is already
cheap
because cheap is also an incredible test
net
for testing all of your ethereum
needs um
okay so we have the l1
node web3 url we can get that right from
the cheapest web page
it's just cheapy
that uh oh
chain id shit i think that's the chain
id
of uh cheap which is 777.
um waitlist
allow arbitrary
contract deployment
equals true wait for
receipts
i don't know why i'm just copying a
tutorial here sorry i can't show it to
you guys
if i can if i had a way to like send the
thing but that's a lot of effort
all right uh let me figure out where's
my face right now is my face in the way
of stuff i forgot where my face is
my face is in the way of stuff with my
face up there
okay yarn deploy
now we have to import fs
um
fs require fs
is that right you guys know that i'm a
javascript noob
right
invalid hexafie oh boys
boys we just leaked the private key
yeah yeah about that about that you
better be fast
better beat my transaction yo who's
gonna reorg the network
all right well we leaked the private key
everybody please be polite
and don't steal four cheapies if you
steal too
cheapy you are
[Music]
um
okay it's an invalid hexafie
value don't please please don't don't
steal my 2gb
why is it taking so long
where does the crowd sell the crowd sale
is canceled because it's only for
speculators oh fuck speculators no i
don't know
okay how is that an invalid oh because i
have to like strip
off the uh
is that my transaction
that's my transaction suite all right
cool
there's 2.14 cheapie if you can steal
if you steal two cheap eats
you're you're a bigger piece of shit
than jeffrey dahmer you know
all right javascript strip
we need to strip the slash n we can use
dot trim oh that sounds that sounds good
okay well now that we've added dot trim
we're in lock
it looks like things are going maybe
and you should go work for goldman sachs
that's right
ah the other block explorer is better at
showing what's actually happening
it's called other block explorer
are those people stealing my cheap
either the contract deploying
can you call me cheap attack
yeah i'll take that i'll take that all
right so i don't know what's going on
here
oh yeah this is doing the deployment i
think
all right pro tip i wish this actually
like said what it was doing a bit more
i don't think this is cheapy thiefs
if you're bridge for thief does that
make us an l2 the bridge is still a work
in progress but yeah
cheap vitalik
um okay i think it's deploying
wait a second you know what occurs to me
no we can't use this
we can't use this because now anybody
can fuck with all my contracts
okay let's create a new account we'll
call it bridge
2. and then we'll go over to bridge
and we'll send all the money to bridge
two
send all the money to bridge
to max see this is why i'm a no pointer
all right now we're going to go over to
bridge 2
and we're going to move it over here
while we change the private key
um settings
oh this account details
export private key type your metamask
password take your private key don't
show it to any of you streamers
that's right
okay so now we have bridge two
now we'll run deploy again where nobody
can fuck with my shit
that's right no more eath for you to
steal
you see my screen yeah you see my other
screen you don't see that screen
do you see that screen you don't see
that screen
let's see what i just did
all right let's see how these deploy
transactions are going
so this is the first deployment i wish
it would show me what it was doing
uh you know what why don't we read the
code
cheap optimism contracts
source deploy
bin deploy sorry
okay await contracts.deploy
wow
oh wait no that is the ovm chain id
it's the layer 2 chain id no we messed
up
we messed up it's the layer 2 chain id
which is 96.
that is what i made right
yeah 96. okay
deployment take two
you can build expensive eat expensive
heat is actually really easy to build
uh you guys want to build expensive eath
we can make it in the rc20 token
expensive
expensive heath it's just like heath but
expensive
took a while sending a ton of cheapie
no it's deploying now
thoughts on mev well optimism has a good
solution for it
um you know but i don't really think any
v is a problem
i think
like the miners getting that value is
fine
i think optimism is a cute solution
which is you know you can elect the
sequencer
we're going to take ethan no we're going
to co-exist with e
you guys cheap is a thousand x cheaper
than aetherium if we take aetherium down
we also take down cheap beef
um
all right so i don't know what's gonna
happen after it finishes actually
deploying
it's gonna okay
all right cool it's gonna write out a
file that shows me where all these
contracts are
okay that's nice i mean it's nice to go
through this kind of stuff so i can
learn
like you know what real projects look
like because i'm having the same problem
now in the bridge
okay the deployment script will output a
json object with the contract addresses
your addresses will be different
create docker compose n
oh no no no no no no no i'm not playing
docker no
no i'm out on docker
okay it looks like we need go ethereum
and batch submitter that's not too bad
um
cheapy go ethereum let's go
oh no not cheap eat psy we need
optimism's fork of go ethereum so
optimism is actually using
geth to process their blocks in the same
way
that uh
cheap eat uses gas to process its blocks
and we're also going to need the batch
submitter and i'm not running these in
docker i'm running
tmux because i don't even know if docker
works on the m1
uh the batch submitter is the the thing
that actually
batches up the uh
the l2 okay
yeah so this is a script here
not here now it's in the go ethereum
uh here we go so we can just do
scriptstart.sh
okay our eth1 chain id is 777
um eth1 ctc
deployment height
our chain id is 96
i don't know what this roll up state
dump path is we'll have to figure that
out
and we'll have to type those addresses
incorrectly
uh wait no we need one more thing which
is they have a this is this this this
file seems out of date
um yeah go ethereum and batch limiter
they have one more
thing which fetches the uh
that this thing connects to
oh good thing i already already played
with this stuff a bit so it won't be too
bad
they have some some typescript service
which like indexes all the stuff for
them
here the data transport actually make
sure i don't still have a data transport
layer running
from the real optimism now okay
so we'll get this data transport layer
fun
cheap optimism how my contract
deployment's going
did they finish no it's taking forever
i wish it would like print out and tell
me what it's doing
20 gifts wow bee bites back
thank you thank you you have a question
you get a good question
goku's poem about speculators is the
single best thing goku ever made
one day speculator will buy all the air
not to breathe
only for hodl and everyone will
suffocate and finally speculate it will
be sad
no question this time well i appreciate
you
um we're all here to party just like
cheapy uh
okay so you guys when this goes live
when this prints out these addresses
you're going to be able to see
all of my cheap optimism
um it's the batch submitter that
requires
a uh all right let's look at the data
transport layer
data transport layer shuttling data from
l1 all day let's yarn
first always got a yarn don't forget
your yarn
um and then i read the code for this
okay
yeah cool find their values in the
regenesis repo
mainnet 1.json
contract addresses we're gonna have our
own better contract addresses on cheapy
should we submit a pull request for
regenesis on cheapy
i think we should we should submit pull
requests let's
let's try to get cheapy upstreamed into
optimism
how does optimism deter mev so optimism
has a uh
uh a sequencer election uh
i think the stuff's public basically the
person who submits the blocks is elected
and they then can get all the minor
extractable values so you know you can
pay money to get the token election blah
blah blah blah
butter is still reliant on nuns
my deployments are still not done uh
but now in this data transport layer we
can copy m example over to m
and we need the l1
rpc endpoint so you know that the l1 in
this case of course is cheapy
and i think i have to set up one more
thing here
the l1 transport address manager which i
still don't know because these
deployments are still happening
wow these can they be you know i'm also
going to submit a pull request that
prints
things out for that
uh comma coin is not going to be a thing
uh cheap doge why
doge is useless cheap doge is just a
thousand x more useless and you know
what a thousand times zero is
zero
sorry i'm not a dough shell
is a meme i think elon just does it to
fuck with the sec
as you see the middle word is he wants
that guy's a beast uh
dogecoin is fucking useless don't let
anyone tell you why wait wait
you know what let's google it let's
google it because i'm always welcome i'm
always open to being wrong
is dogecoin useful
dogecoin is the original meme point
that's not true bitcoin is the original
meme coin
go on
because of me going off bitcoin
[Music]
um this is just
shilling currency like bitcoin
but kind of a joke
my contracts done deploying yet yeah
talk
dogecoin is too inflationary did they do
a free mine
ah
does dogecoin have low transaction fees
okay they have 1.json and 2.json
what's master.json
i don't know what master.json is
but okay we need to find in order to get
the syncer working
we're gonna need the l1 transport
address manager
uh do i have any written recommendations
to learn in-depth stuff about cheap eats
yo
there's only one way to learn cheap eat
and that's just to start playing cheapy
you can go on this great thing called
remix and you can just play around and
remix
you can deploy things to cheap even it's
cheap
you know
wow this is a lot of contracts
man optimism is going to cost a lot of
gas
we're still not done
deployer sequencer re-layer
does optimism have any docs telling me
what these things are so okay the
deployer deploys the contract
the sequencer um but what's the relay
that's the only one i don't understand
we can even set up a digital ocean
instance to run
uh optimism on cheapest
dogecoin and chibi are similar coins
except
dogecoin is useless and cheap beef is
useful because you can use it to do all
the things ethereum does
dogecoin is useless in the same way
bitcoin is useless
actually let's google something dogecoin
transaction fees
block chair
and there was one day that dogecoin
transaction fees cost
ninety two dollars yeah they have like
two dollar fees like this is not
um
i don't know what an m is but yeah
bitcoin cash has
has good transaction fees i'm actually
kind of bullish with bitcoin cash
uh i do i do i do huddle some bitcoin
cash
and then i'm sure i'm sure he'll be okay
with me playing this i'm sure we don't
have to uh
to to censor because of this
i i was looking at little windex i was
looking at that song and he has this
whole series of like eminem doing stuff
but it's great
um yeah i'm just having a lot of trouble
basically not rhyming every single
fucking word i think of
okay could you give me an example your
face looks like it's used for bukkake
target practice
those retarded glasses make you look
like the smartest math was in harvard
classes i bet you used to get beat up by
jocks wearing starter jackets
that's probably good thank you you see
what i mean as fuck now are there any
pass
yeah worth watching index is great
okay can my contracts finish deploying
this is taking forever
why did this not happen in parallel
um contract info account code
wow all right well while we're waiting
we can learn about what these contracts
are maybe
ah
security policy
this is so complicated
so complicated my bridge
one contract when you compare it to the
cheap bridge
so i did some work on the cheap bridge
it's actually like the bridge itself is
pretty much done
um i took some parts from this
testimonium project
and yeah it's it's 200 lines uh actually
if you guys want to see i can i can do
that
i'll show you the bridge so
if you want to run the bridge this will
actually deploy a bridge
ah actually
i was testing the first product that i'm
gonna ship with the bridge
is gonna be a product where if you send
your devi to the doobie address and you
smoke your debbie
devi for every 10 devi if you smoke i'll
give you one cheap
um because testing things on real
ethereum is expensive
but here we can deploy we can deploy the
bridge for the the ethereum network
uh it deploys super easy
uh and then that's already sinking uh
optimism seems very complex but
so the difference between the optimism
bridge and the cheapest bridge
is the optimism bridge does roll up
instead of kind of a state election
why is this not going
oh i think it's waiting so it can
actually interact with the bridge
is cheap being slow or something
no it doesn't look slow
hmm
it's still deploying
okay well this is live now so this is
the bridge
so you can actually query this bridge
right now
uh at this address on the cheap ethereum
network and you get
a pretty good guarantee of what the l1
ethereum state is
because this bridge checks the um
what this is doing is checking the proof
of work
uh it checks the difficulty too so like
you import the block header
and it checks that like the block is is
is in the chain the block out is not the
future the block is in order
confirmed the difficulty is correct and
then it verifies that the sha-3 it
verifies the proof of work was actually
done
correctly so it would be really
expensive to make a fake chain that
fools this bridge
and it works really well from l1 to l2
still deploying
um oh these 15 seconds no
so it's that's like the fudge factor uh
in case the chains
in case there's like some time basically
you can't submit
future ethereum blocks onto chibi
which should never happen but i give it
a 15 second fudge factor i just copied
it from testimonial
yeah so this bridge is live now and then
what i'm working on
here is the sale contract
it's all to do's right now but the sale
contract is going to let you
uh you send a transaction on aetherium
even just to a normal address it doesn't
have to be a contract address
and then you can prove that that
transaction is in the block
and if you do that you can claim the
value on the cheap network
so that's how the l1 to l2 bridge works
still deploying
we need a progress bar
i'm going to kill this so we don't we
don't send tons of transactions there
um okay
so first we're gonna deploy the optimism
contracts
then we're gonna stand up this thing as
soon as we figure out what the contracts
are
uh this thing the address manager i
guess oh the address
is probably the last thing deployed of
optimisms
um yeah here
address manager address manager address
await contracts.deploy
is this is that like a real like what is
contracts
build source contract deployment deploy
build source contract deployment deploy
just take a look just like uh
this needs a progress bar i'm gonna file
an issue
i'm going to do it over here when i'm
logging to get up
issue ah
feature request
progress bar on contract
deployment
ram deploy and while
i see the i can text over here
while i see the contracts
going
on to the chain i just
i don't see anything and first let's
make sure it's not a duplicate issue
ah no
see anything in the console
two contract deployment
cool
oh it finished great okay
so this is the cheap optimism state
um i should have actually written a json
file right
well let's just save it just in case
we'll say addresses
json
okay we need to know the address manager
that's the special one we have to type
in over here
ah data transport layer address manager
okay let's
try yarn build yarn start
oh no unfortunately yeah okay so it's
using the address manager
attempting to find appropriate l1 block
height
this code is shitty i already filed an
issue about it
um
oh
is this like not working in them
redraw time exceeded syntax highlighting
disabled
i don't know why it's not working let's
go over to the visual studio code
so i was actually looking over this code
since i am going to be
working with optimism next week
to help them actually get this stuff
shipped
uh fun
cheap optimism that's better
source
it's like frozen
just go there
and then we can do starting l1 block
number we'll do
find
finding wall files starting on one block
number
great okay it's not in here
is it not in source no it definitely is
maybe it's not okay open
let's just open all of cheap optimism
starting at one block number okay here
we go this is the
yeah yeah
we're about to kill all them
what good
die uh so
we can just start here at the cheap
block
so this is the block where cheap forked
and that should query pretty fast
cheap optimism
data transport layer yarn build
yarn actually i think i'm gonna i should
make a new repo
called cheap optimism that has uh
well let's let's get it stood up first
and then anybody can actually be a block
submitter on the cheap ethereum network
to cheap optimism yeah
yo dawg i heard you like l2s someone's
got to make that meme there's now going
to be an optimism
on okay so starting sync so it finds it
pretty fast
um cool so this was the this was the
address sorry this was the block
that um
the address manager was deployed at and
it has like a little script where it
finds it okay
so let's go over here to script starts
yeah i don't know about ctc deployment
height cross
domain messenger
well i have a way to get this so let's
look in
their real one for mainnet is that not
any of them
wait a second how is this not any of
these
oh address manager owner address on l1
use the proxy
is this in two.json or something
roll up state don't path
so the address manager owner address i
think is this
uh our eth1 chain id is 777
our chain id is 96.
i think i have to change well you know
what i can do
actually let's just take a look here on
ether scan at this
figure out how to find the same one on
this is probably just the deployer
address what is this this is a contract
yeah it's a contract that's okay
lib resolve delegated
proxy lib
address manager lib ownable
let's see if i can find this somewhere
no
and i guess i'm just confused at like
what this cross domain messenger
is and then i assume that if i look on
ether scan
the this was deployed at that block
no it was not deployed at that block
great
hey cheap works without all that stuff
too you know we could all just use
cheapy and as long as we all agree fuck
speculators
things are pretty good
so ovm l1 cross domain messenger yeah
that's great
but how do i find out
oh well but did i deploy that
oh this so i assume it's not the proxy
i guess what i don't understand is why
this doesn't match this but if it's just
this then
uh or you know what you probably your
times do i use the proxy or do i not use
a proxy
proxy is required for upgrades okay well
we don't care about upgrades
um proxy sounds like it costs more cheap
gas
and cheap gas is cheap so that is nice
but okay so we'll figure out what
block this contract was deployed at
oh it doesn't tell me great
um that's junk okay
maybe i can see what block it was
deployed at if i go to the bridge
here and then i look at these
transactions and then i find
one set one six seven you no
of course not um
how do i possibly figure out that
deployment height
i don't even really know how to do it
yeah well that's all great to do it on
ether scan yeah that sounds
nice but uh i don't have ether scan
right i'm on the cheap chain i can't use
ether scan
ah
ctc oh you know what it's probably this
right
yeah i use bin deploy yeah
probably that
or uh did i save the json i'm sure i
didn't delete it
did i have to tell it specifically to
save the json
console.log yeah i know i saved it it's
here
it doesn't tell me to be blocked though
that's probably right
i'm not sure exactly what happens if i
get it wrong but i mean that's the one
that this one started sinking at
so i would assume it's probably pretty
good
let's start up the go etherium
i'm a no coiner bros you start holding
coins
and then you start you know thinking to
yourself as a speculator
you know gme is a speculative asset
right um and it's all fun and games
until someone's left holding the bag you
know
okay okay we set the chain id
let's let's get diff we said all that
stuff
this isn't right so this state dump path
isn't right
uh
[Music]
maybe it doesn't matter hold on let's go
let's see if it runs let's see if we get
errors
uh first we gotta make death
use two.json well
oh i can use two.json i see so that's
just so we can interact with the
contracts i say
all right we'll do a build and then
we'll change it to two jsons yeah
if i want to have transaction fees ah
this is for the main net i feel but by
the way
script start let's go
error starting protocol stack database
contains
incompatible genesis have this
knew that um
what did i not set right
heath 1 chain id oh rmrf ethereum death
okay good point
good thing i don't have any keys there
okay so we have our data transport layer
running and we have our go ethereum
running
let's go over here and let's try to get
our batch submitter running
and then those are the batch dividers
effectively my understanding is
the miner of the l2
uh so we're gonna have to we're gonna
actually have to we're gonna stand up a
digital ocean box
we can use one of the digital option
boxes i already have i think
yeah we can we can we can use one of
them that i already have uh
and that's really where i should stand
all this up and not on my computer
because we want to have it we want to we
want to provide an
l2 solution to the cheap ethereum
community
i understand that cheap eath is cheap
but what if it's not
cheap enough you know we can provide
the l2 solution right on gp
it's l3
okay let's go over here with the batch
submitter
have i seen this
probably not up dot sh
yeah i don't want the docker
docker
optimism integration oh
no i have not seen this
this looks pretty nice oh it okay i see
it like pulls all the stuff out all
right all right good
uh no carl sent me some other
guide um
why not docker i don't know does not
even work on the m1
and then like that's how i get into the
docker i'm not
you know what one stream i will struggle
with docker
uh i guess i hate docker less than i
hate the javascript ecosystem so you
know if i can deal with the javascript
ecosystem
i can deal with uh java
docker doesn't work on m1 good enough
um i guess i wouldn't be on an m1 if i
did this in the uh
the cloud
okay batch submitter all the
stuff is done by oh
well
okay so we know the l one
node three web url is just the classic
one from cheap
ah these all look good the only one that
okay we need the sequence or private key
so i'm gonna do this over here
so you guys can't see my lead private
key
don't leak my private key batch
submitter if you leak my private key
everyone's gonna have access to the uh
sequencer private key confined to the
ovm
sequencer set in the address manager on
l1
well i mean the only private key that
could be is the one i set all the
private keys to the same thing
so it's probably fine
uh let's run this and let's see if it'll
actually mine some blocks
okay yarn build
tsc not found we're gonna have to run
yarn because we got to install
typescript
in this batch submitter if you like
installing dependencies seven million
times
consider the javascript ecosystem
ovm canonical transaction chain
saw ah append sequencer batch okay
cool this bridge so complicated this
bridge so
oh but i you know would be nice i can
steal this merkle tree stuff
um i'm gonna i need to put some merkle
trees in my in my uh
let's yarn build
i need some merkle tree verifications in
my bridge
all right let's yarn start now let's go
package package.json no oh
command failed with exit error
one
what what's what's error one dash b
all right let's start putting in some
print statements because it's the only
debugging i know how to do
batch submitter
exact batch
okay
here there's again here
it gets here okay we have batch
submitter dot
run run batch submitter
yo if someone wants to link that i will
um
node exec run batch cement
wait isn't this just a loop by itself
dot run
oh run batch submitter js here we go
but it's typescript okay
no we're back to these ethereum
highlighting
i don't know why my vim is broken
let's go over here
batch submitter don't click that one it
has a private key in it
uh source batch submitter batch center
okay
no it's got to be called exec batch
submitter source exec
run batch submitter here we go
the layer one address manager address is
that not set in the environment
i don't know okay how does it get that
oh i probably have to start it with that
run exact run batch submitter
i mean that's exactly what i'm doing
interface required m vars
i really don't think i have all of these
because i definitely don't have the
address manager address
that's not getting down here to starting
batch submitter
so i think it's actually failing on
these
let's see if i could print hello if i do
that
grab the yarn
okay so it gets here to hello i think
the problem maybe is here
yarn bills
npm installed debug no
i'm not npm installing debug
export const run okay why does it not
get to
or do i not have like info log enabled
okay debug
info debug yarn star great i love
javascript don't you
starting batch submitter and then it
fails okay so it does get there
it's not missing any environment
variables but it
it fails somewhere
that's still running that's running
there are required and vars each must be
set
well
let's see what's actually being used
okay we're up to starting batch
submitter let's
here
here too uh yarn
i don't know i don't know if i actually
have to yarn build
okay so it doesn't even get to here
oh oh wait what
that is total junk that was that was
terrible
that was terrible um okay
so it's missing uh an environment
variable address manager address
which i obviously knew but
i didn't understand why it wasn't
complaining now i understand why and
it's because i didn't
enable error and the errors have to be
specially enabled so now i'm going to
move this guy back over here
since i can't let it you fucker see the
private key you know what
i have a better idea i'm gonna remove
the private key from there
and then you guys can see it and we're
gonna put the private key
uh where is that
private key
private here we go
sequencer private key and we're going to
fetch it the same way we fetched it in
the data in the in the contract
deployment
um let's go over there to contract
deployment
here we go
can i say require can i do this
that sounds nice oh who knows oh this is
typescript
who knows if any of that's going to um
but the good news is now we can edit
this without you guys looking at any
shit
uh and we can put the i think i just
leaked the private key
god
if any of you guys actually if i
actually managed to leak the private key
whatever
you guys steal my too cheapy
all right
gotta get the
[Music]
address manager address
and stick it in here and then
let's go we got it boys head out yo you
go stealing two chibis
all right sweet we're in okay now
there's no tx's to submit
but we can submit some tx's
wait but i don't have any l2 all right
so so
let's go to localhost here but how do i
get money on to l2
see what i'm saying
i don't have any money
look if you guys figure out how to
actually fuck with this stuff
congratulations uh we'll see we'll see
who manages to to steal the cheap beef
uh but wait okay so we're on cheap now
uh we're playing around with bridge two
but
so i can go
wait so how do i get money did i
pre-mine
test eth gateway ah okay
all right
this seems good
ah cheap optimism
integration tests
oh okay we gotta get private keys again
who's sick of getting private keys
you know what yolo you guys can see the
private key don't fuck with me
if you fuck with me
you are worse you're a worse person than
jeffrey dahmer
that's right d2x
okay we need the address resolver
address
which we can get from over here
uh we need the l1 node
url which again is here this should all
kind of be unified
um i have no idea which chain id this is
that's the l2
chain id 96 i don't know if we need a
target gas limit i don't know
100. mnemonic used to derive
keys i don't have one of those okay
um so what's the test that i have to run
x domain helpers
test fee payment test native east spec
yarn test let's go ws run not found
yarn
wait did someone already steal the chibi
someone stole a fucking cheapy wait no
hang on let's say hang on hang on hang
on maybe not
yo
yo i can't believe someone stole the
cheapie
yo you guys are really you're you're
really worse people than jeffrey dahmer
it's true because now i don't have any
cheap teeth anymore
all right yo i'm gonna send
one cheapie don't steal this one
guys it's worth 10 fucking cents
because then we're gonna have to
redeploy it all again
oh my god you really can't show a crypto
private key for 10 seconds
it found incompatible module great
10 cents is 10 cents my dude
did my one get sent
these don't even work found incompatible
module the engine
node is incompatible with this module
great
don't steal it
don't fucking steal it
we're gonna have to redeploy it we're
gonna have to redeploy it
because i know someone's gonna steal you
know i know that's gonna happen
i know that's gonna happen
who's stealing
this guy this guy
who are you oh you made a new address
think you're all clever
don't steal the one cheapies
um all right so
[Music]
we have everything running yeah remember
when my balance was 2.1 and then it was
zero
how can i change the private key
all right you know what we're gonna get
started on a redeploy
um
you know i'm now thinking
if we uh
of course someone stole it you know you
people are useless
the haters man the haters are stealing
the cheapy
all well you know what we're learning
we're learning we're learning
we're learning we are learning boys
let's do it again
and this time maybe if we put in
the debug shit when we deploy the
contracts
all right so we're going to make a new
address create account
called bridge3 create
and then we're going to fund bridge 3.
bridge three can have
two chibis
we're gonna go over here we're gonna get
the private key
for bridge three
all right now how do i do that
deployment again
how do i do it
i don't know oh it was in that guide
that i was reading
okay so we got we got to put all this
stuff in again
actually here i can just find the place
i did it
here we go chain id is 70
is 96. allow arbitrary that's good but
now let's set that debug flag too and i
hope
that this will show me the contracts as
they deploy if i set this
knows
um let's take a look at bridge three
over on the block explorer
other block explorer
nothing's been deployed yet okay
in the meantime let's figure out how
these tests work
uh unfortunately it depends on ovm tool
chain which has the wrong
uh
we have the wrong let's just take this
out and see if it still works
provider also has the wrong node
provider do we need that
ovm tool chain has the wrong note
and now it's not in there anymore great
have we started deploying contracts
again yes we have first contract
deployed
of course even with the debug there's no
uh
there's no parameters
um
so we're gonna have to change this to
not have the
uh private key which one had the private
key
one of them i just got lazy and started
just putting the private key look guys
it's the private key
this one doesn't have it i'll have to
delete the uh
ethereum state again
[Music]
start the data transport layer we'll
start the batch submitter
that all should be good
okay so that's reading that key that's
good
this is reading this key as well
actually this doesn't
need a private key it just needs
block names and this one
doesn't need a private key either it
just needs address manager
okay
cool
griefers stole 20 cents
there's two honest ways to get cheapy
three honest ways to get cheap
one is to mine it two is to beg for it
and three
is to buy it right here on the exchange
they stole 30 cents boys they stole 30
cents
this happened last time this happened
last time i did
when i did the bitcoin cash stream
people would just steal it
bunch of steelers okay
let's figure out how to uh
one of these these integration tests
you know what i don't know can we can we
can we can we ourselves
wait should we
should we uh should we figure out let's
figure out how to stick a pre-mine in
our optimism
just to fuck with bitcoin maximalists
what do you think
um
i'm gonna be tracking you who stole my
chibi
should we call the san diego police
department right now
and report the theft of my 20 cents of
cheapie
no no it's not it's not ethereum it's
it's it's cheap
it's it's ethereum but a thousand x
cheaper oh sir so uh how much money was
stolen
well well 30 cents but but you have to
realize that
yo let's call the fucking fbi man let's
get the fbi
in here the fbi's gonna come find you
oh god you got the cyber police
all right
the tvs please yo one day
it's the sec boys yo cheap ethereum is
not a security
it doesn't mean speculators it has use
oh so it's not like dogecoin no it's not
like dogecoin
oh okay have a good day sir that's how
my
conversation with the sec is gonna is
gonna is gonna go
how's my deployments going why is this
so slow why does it have to deploy so
many damn things okay
while we're at it let's figure out how
to fund an address
let's figure out how to get a pre-mine
in here
no okay we'll have to figure out how to
use this gateway
it's not like bitcoin it's not a
speculative asset that's right
it's like ethereum
what's tall
um
okay
no we have to find the integration test
that triggers the funding
test eth gateway here we go
perfect i don't know it just actually
just looks like this
so if we could just run this let's just
try to run this
uh can i remove yarn.lock and then just
change package.json
what what is broken here
one of these things is broken i don't
know maybe like that one
let's just try yarn
yo cheapy is you can own cheap ethan be
a no coiner
okay
great
dev dependencies dependencies
uh
get rid of those maybe that'll work
because the only test we need to run is
this one
no stop it what depends on that
tx ingestion eat optimism tx ingestion
oh there's a package here and this is
okay
all right let's just delete that package
and then maybe i can even check out
package.json
check out my package
all right we have to wait to redeploy
again thanks to
fucking steelers
still a problem
um okay there's a problem in the x
domain unfortunately the x domain is the
one we need
uh ovm tool chain and we can get rid of
that
i don't know you can just put packages
in barn like that
i need contracts and watcher
actually all i need to do is call
deposit on ovm one eth gateway so i
think we'll just figure out how to do
that
what's this issue have i thought about a
cheap ethereum test net
uh oh
we've depreciated the
ovm tool chain package
and the package is remaining in this
repo great
well would it be nice if i had that
before but either way
[Music]
um
can i do this is this going to work yarn
test packages native each spec
get reset okay
get reset
we're back to here and now we're gonna
just do this so let's go
no i can't just change that because it's
the the problem is it's in it's in a
child package
that it's pulling from who knows where
fuck docker
um oh you're right i didn't yarn build
i think that's why it didn't work okay
well this will work better and then we
could do a yarn build
okay great there's errors but they don't
seem to be real errors or they are i
don't know
i don't know
yarn build
good thing my waffles are waffling
no no
that looks terrible
yarn task this
cannot find any files matching
um cannot read property to
hex string of undefined
no these are not okay because probably
not packages
is it like something like this
what if i just do this does this work
i cannot find any files matching pattern
what if i put a star there
producer
yarn tap
that work cannot find any pattern
matching
remove spec ts
from which one this one
no i only want to run one test i can't
run all the tests
cannot find any files matching pattern
maybe i need to put it with
gulp no i'm not running it with gulp
set your m there is an m of example
oh
that's the old private key okay that's
the old that's that's the leaked private
key got it
um
no there's no more cheap giveaways if
you want cheap you can either mine it
beg other people for it
where's your replace lipstick and your
south
philly neighbors where are
memoirs of illegal behavior where
are the lovesick lines the no
trespassing signs and after hours
trading x-rated favors
uh why doesn't this work
stealers you know steelers bunch of
steelers
thirty-six oh no look it wouldn't even
matter like we gotta redo this anyway
because until we figure this out it's
useless
so maybe there's some docs
how to run one test
actually can i just go into packages
x domain what if i just do this
cannot read property to hex string of
undefined
okay it works now at least
um this is a different problem
this problem seems deep inside the ether
project
in require of mocha or something
oh it finished okay so these are the new
contracts
so let's go back into addresses json
go in here what do we need to set these
things up okay
so for the data transport layer which is
what we do
first i believe we just need the address
manager
okay now we're gonna get the block
oh i have to clear this database where
is this database
in db yeah cool
okay so that's probably the block
address that we have to put in here
um the cross domain messenger address is
this one here
uh the address manager
owner address is actually
this guy here
and that all should work if i start it
cool
we already did the rm so that's all good
okay
now the batch submitter
uh we're just gonna have to set the
address manager address
so that's the only thing that changed
uh and here we can just do yarn start
uh oh we gotta do with all that debug
crap
well that's all the stuff that i tried
to do here and didn't work here so
just copy that over to my batch
submitter
and yarn start
okay cool so there's no transactions to
submit right now
because we don't have any money in the
thingy so let's get some money in the
thingy
um but until this test works i don't
think we're gonna be able to get any
money in the thing
let's read the test
something is wrong something is wrong
with with with my typescript and vim
okay cheap optimism
integration tests
packages cross domain
underneath spec okay
chai should work fine json rpc
provider
is that the problem no
mocha load file async
oh i know what's wrong i'm sure i have
an m in here
or it's the bottom
get contract interface that's fine
the bigger problem is where these
providers coming from
system
what is this get environment
from type from dot dot helpers
config l2
node url with port
get config from dot dot slash dot slash
common okay so this is okay i see what
we have to do
fun cheap optimism integration tests
package
is x domain it's just in here we have to
set up this environment
but these should be correct
uh okay the resolver address might be
wrong
what's the resolver address
probably the address manager again
i hate if it's called something else
yo stay on topic chat
stay on topic
no there's a private key in here it's
just not the right one which should be
okay
that's not the problem
no it's not the test i guess i don't
really understand what's going on here
run helpers cjs
helpers okay so it's in helpers that
this problem is
cjs loader node modules
ts node x domain actions
spec dot ts
[Music]
uh
optimism url this is the problem
l2 node with port doesn't work
vocal host oh
no okay it has an rpc for it it's not
the problem
let's see here
you can command click to go to them i'm
really trying to go to any method
okay so both of those actually pass
so it's a lie that that's the problem
what
yo guys stop with your bullshit
nobody cares don't get a job with
fucking netflix man
you know you're a loser like oh i want a
job on netflix oh you know all day i'm
going to do useful things i'm going to
change the world netflix yeah
oh i got a grind leak oh god grind leak
code oh yeah let's just grind lead code
do something with your life
um don't talk about it here you know you
want you want that you want that new
bass shit
you know get off get off my twitch bye
bye
oh i want validation from netflix oh i
get a job
don't do something with your life go on
github write
code no there's lots of things we're
doing so
myself driving is pretty cool but
okay why doesn't this work
i think actually you know what no this
might even be a simpler problem
uh you know what let's let's see if we
can do
let's open up a geth console
where is gath i built it right here
i just need to create a wallet
database is v7
what
i think i have to create a uh
i have to create a con like this problem
almost looks like it's just trying to
like
like fetch from the
no or maybe it's it's l1 user private
key i'll tweet
new wallet
this is creating this is trying to
create a wallet
it shouldn't though
i mean can i just like
if i just do this
um
this is what i really don't understand
is like
actionspec.ts i have open here and
line 25 is not that
like it still says line 25.
it still says line 25 is it not getting
built
you know what let's just yarn build ts
this doesn't make any sense how is it
that
our action spec ts is on line 25
when line 25 is an empty line
i'm in the right thing
okay you know what let's just write a
new test and we'll call it noob test
and we'll see if we can run noob test
and we'll just copy and paste what we
need
ah noob.spec.ts
let's go
okay dawn test
noob dots back dot ts let's go
what okay
i don't like that
this how does noob have a problem
oh making you rethink your life oh wow
oh yeah how do i get paid off this
semi send me three cheapies
and i'll appreciate you for the three
cheap eat that i had stolen from me
um
bullshit man yarn test is running all
the tests look at the command
no it's not is it
how do i only run this one can i like
run like tsc
i don't really know how yarn works
oh you're right yo see that guy's paying
attention
all right let's go at native eatsps
oh yarn mocha okay all right mayfield
yeah you know what's up
okay cool great great this is this is
much more reasonable now i think
um yeah object exports get environment
and set up
we're having a problem here
i mean this is at least debunkable
let's just run the new noob test
you're right you're right mayfield you
know what's up i can just copy this
right let's run the noob test
new spec ts let's go does this one work
yay i gotta test the pass okay now let's
copy and paste
go over there that's what i want you
good
okay um blah blah blah blah can i import
this shit does that work
god i can apport shit alright cool ah
let's do we'll call it the
gimme l2 eth
quote unquote test
um
okay deposit
pre-balances post balances we don't
actually need a test
we don't care about that don't care
about that
we do need wherever wait for deposit
type transaction comes from
all right well let's import that shit we
don't do any withdrawals who needs to
withdraw we only deposit that's right
money only goes in uh
i don't need any pre-balances i
do need this
uh so let's just copy that and see where
that gets set up
i've seen it before
i've been learning this stuff boys i've
been learning this stuff i've been
getting my javascript skills up
see you always got to keep your skills
relevant because one day
when you know you decide you want to you
want to go work at netflix it's good to
know how to program javascript
all right let's go let's go let's go
let's go let's go all right none of this
shit exists okay cool
um we don't even have an address manager
uh
this might work or maybe that's the
thing that breaks
sound just manager where does this
gateway interface come from
get contract interface thing
cannot find name address manager
let address manager use contract yo i'm
learning typescript as i do this
cannot find l1 wallet
i need an l1 wallet
you know this is how you learn boys you
just got to do
we'll see if we can pull that from the
system as well in my before
and then i want to gateway interface get
contract interface
okay so that's just like making the
gateway and then that calls it
i don't actually even need that
i guess i do need the providers
i'm gonna guess i need a watch or two
all right let's get the providers on the
watcher
but i have a feeling that one of those
is where it breaks
yeah okay i have the same problem here
so it's actually in get environment that
it's breaking
um we don't really need
well let's actually just take a look at
what that's doing over here
okay my l2 node is
localhost colon three five
sorry five four five and my cheapie
node is this uh we're gonna have to get
json rpc provider from somewhere
i don't even know what a watcher is who
trusts watchers who will watch the
watchers
uh good i already imported that from
ether's project provider okay let's go
uh still broken
well because we're still doing that junk
uh we don't need to get the address
manager from there we can just get the
address manager from
here so i guess we want all this
um we don't need a config here we're
just going to do the address manager
address here
and it just comes on the l1 provider so
we'll just
get rid of that copy that here i mean
look there's probably more effective
ways to do this
but this way you learn like i understand
now what this stuff is doing
um
[Music]
or you know you can like grind at lead
code all day and like maybe get a job at
netflix
let's make that a new meme that we make
fun of on this channel
uh let watcher knit watch her
do i really need the watcher
i don't trust watchers just know who
will watch them you know nobody knows
let's just await ovm dot deposit
and now we're depositing shit all right
let's go
can i find name system
you know i think i can actually do this
from any
no okay junk oh i cannot find any system
that's fine
l1 wallet
i've never made a wallet before
but we need a private key so we can get
that from the same place we get in the
data transport layer
let me just go in there that private key
doesn't have anything to steal
sorry you can't steal uh
wait oh the data transport layer don't
use the private key what does using
privacy the batch submitter
um so i can just copy this
we'll say up here const
private key equals that
please don't be stupid enough to print
it anywhere
uh you know what i have a plan
i'm gonna make something called fake
bridge key
and it's fake stealing so you guys can
fake steal shit to make sure
you know we don't get we don't get uh
get pwned again
that's right
um
you know normally i do things like
collective punishment and say like you
know
if we get pwned again i'll have to just
do it off stream but that doesn't work
that doesn't work because they're
griefers man griefers are like
speculators
but you know
a little different all right let's go
uh then i can put this private key see
it looks the fake bridge key so now if
it's like complaining about like oh but
it's fake
um deposit amount 10. i don't really
know what 10 is
is that 10 either probably not
give me e2 oh okay insufficient funds
server error okay good let's try it with
the real key
don't print my key
give me all to eat yeah we got l2e
let's go let's go let's go boys
um okay so i guess i assume we deposited
it into this address
all right oh did someone send me some
oh that was very polite of you thank you
wow anonymous gifter
uh all right let's go over
to zero ether
so this is this is the the l2 network
uh let's deposit more than ten
let's try to deposit a whole either so
if i do like what is it 1 times 10 to
the 18
is that is that correct no 1 ether is a
lot that's a lot of ether
let's go one to the 16.
now 17. okay so if we did that right
we expect this to go down to 2-0
overflow huh
we need to make it a big number
one ether number
oh that's a good number
all right
i'm gonna get rid of one of these zeros
and then we're gonna close that quote
let's go
okay let's see if that actually
sent value well what we can do is we can
go into the block explorer
block explorer yeah let's go
okay good so that sent
that from that to this which i guess
is the address of the thing
no
what address is that oh that's just
somebody sending it to me
that's just that's just nice bro sending
me free ethers okay
um thank you i appreciate you uh
okay i don't think this is actually
sending
we might have to get the watcher work
okay
well let's just read this code for wait
for deposit type transaction
well it's a deposit type transaction
okay a promise cross domain message pair
uh a weight l1 originating
tx
oh this is cool if we can await rez
oem ovm eth1 gateway deposit
okay so it sent the transaction
it should be from this address
is there some reason it's not working
chain id 777 we're sending it to this
address which i assume is like the l2
value manager shit um
that it finds from the address manager
yeah ovm i assume it's this
i don't want to eat gateway okay so
that's right
okay now i'm waiting for it maybe it's
like reverting or something
no but it was bad it should still show
up here right
did not actually submit it to the chain
uh
i want originating tax
what am i doing wrong let's get some
lights on in here
three spin drifts left
all right why does it just wait oh
timeout exceed it
if i promise ensure it resolves
[Music]
we don't even need an l2 provider here
this is just a normal
why is this transaction not getting
submitted to the cheap
blockchain
should be
or do i need something else
i did this in the bridge let's let me
just check my bridge
ah
something else like a weight bridge and
headers okay that's exactly what i'm
doing
i call this i don't know why this isn't
getting submitted to the cheap chain
right oh damn that's a big nonce
well that's fine i guess that's just a
number of interactions from the uh
from that account
should be fine
log the await
this is never finishing i don't think
that's ever returning
i think they don't log it here
not working
somebody using all the gas
no
why isn't this transaction showing up
why didn't this transaction show up
um okay maybe that's too much
let's change the deposit amount back to
10. doesn't really matter how much i
pause it
i don't get it this should be being
submitted
to the blockchain no g beef
l1 the chain id is correct
so i'm actually not sure why i guess
it's just querying the rpc provider
if this doesn't make sense this is a
normal contract interaction
you know what i have an idea
send
to this address
let's send one let's send 0.01 safe
um let's give it a big gas
limit oh metamask
sucks
i should just be able to type that as a
hex theta
it right work we didn't even need all
the stuff we didn't really need to do
look wow it updated the gas limit that's
smart
all right let's go
forget writing javascript we got the
data i guess
that's just deposit we can look at what
this contract is
too uh let's look up the ovm
eth gateway
useless
oh here we go deposit so i imagine that
that's just deposit
external payable great uh did that
contract interaction succeed
sweet it succeeded okay so now if i go
to the bridge address
on on uh
here it has no ease
hmm
well
that should get it right
i mean this thing should be indexing
from the uh from the thing right
because otherwise how could it no
let's try like this address i mean
it didn't work from the bridge it
definitely won't work from anything else
i could have actually sent this from any
address though i believe
okay the contract interaction looks like
it worked
man i wish we had ether scan who else
wishes we had ether scan
you know like rich people with ether
scan
all right log entries here
so these things are this is the deposit
oh did i not know i deposited real value
oh i should say the value of this yeah
okay it has point one c
value and how come when i go over to
here
there's no there's no eighth
give me eth here
processed one transaction enqueue event
oh
it did something
let's did somebody else do that
i guess because anyone can interact with
these contracts
yeah i sent my e somewhere and i didn't
get any money
i want my eat back
oh you know what i mean if the same
problem that's affecting that other
thing is also affecting this
i don't really know how like nonces work
and stuff
submitted batch why is the transaction
receipt null
well first let's see if that's actually
the
the transaction so this is running on my
computer so we can just take a look at
it
origin data
target is this
so they did say that this thing was the
uh
what's this
let me address i recognize
um all right here here's a surefire way
to see if
it's this it's that thing let's just go
over here over to like
cheapie let's go on to here and let's
send
to this thing
let's sound like 0.01 one gas price and
now let's set the hex data
to be that do3e i think this is just
deposit
let's see if we get another one
all right so it interacts with this
deposit contract it gets it maybe it has
to
you know what it might be maybe it has
to mine a certain amount of blocks
before it can do it
but here if we're watching the uh
deposit contract
which is this yeah
this only a deposit contract or can i do
withdrawal too
before i carelessly sent my seats to
this contract i should have read it
um the l1ev gateway is a contract which
stores deposited eat that is used on l2
deposit
finalize withdrawal
why does it take so long
still still pending still pending
pending pending pending
oh we have a new pool pool seth fun
association cool
something's loading wrong
why this is still pending
which should work eventually and then
yeah i think that is it
so i guess this keeps submitting i guess
our problem right now is our submitter
because we're getting a wait
submitted batch
verifying batch element submitting batch
waiting for receipt
looks like my batch submitter is not
working
but no this says we mind a block
i guess the block hasn't shown up yet on
l1 and i don't know why that's still
pending
it was like seth pool not mining things
if they have uh
no no one did that
no the gas prices no i don't get it
it's just a normal cheap eat contract
interaction
showing up here
[Music]
now
now
stuck in the mempool
this one succeeded
there's no way for a contract to make
this pend
this has to be some cheap issue
speed up all right we'll pay the fees
for more speed
shouldn't change anything at all but
the bigger problem is why are these
transaction receipts none
i think that's unrelated to the fact
that that contract interaction is still
pending
minimum ether balance
clear pending tx's
dress manager address i don't know let's
just control see this and try it again
how come that transaction's not showing
up
i don't know
we can look at this one this one has a
nonce of
let 58. run this again
my seven odds of 92
is that the problem
let's add some more debugging to this
guy either way
batch submitter
submit and log tx resubmission config
get receipt with resubmission
why madam what's the why nata
oh well we imported that so that's good
oh send transaction function tx func
async function contract function
great
do we not have logging in
that transaction
you know sometimes metamask gets into a
messed up state i blame metamask for
this
i don't know we don't really care about
that like you can reset your metamask
either way no that's the problem right
now is that my transaction by chance
um transactions
no that's just someone sending some
cheap beef
well cheapies also have sharing
you can share
all right i think we have to figure out
what the ynt
it's fun to share
chibi's version of sharding yo
guys it's a green screen
how many times we got to talk about that
okay
you know what let's just try this i
don't trust the wine atom
let's get rid of the wine adam and just
say const receipt
equals uh
tx funk
yeah maybe that'll work a weight dx funk
let's try it
no expected one argument
but got zero oh we gotta put in the gas
prick
one that sounds good
what how is that null
why is that null
are you using a recent state dump
what's a state dump
um async function contract function okay
you know what
instead of this i don't think these
things are the problem let's figure out
where this is being called
in my geth config oh yeah i updated it
to
two does that matter i did update it to
two yeah this
is that right
no there's like this just isn't sending
um
let's figure out where this is being
called
okay here we go tx funk where's tx funk
come from submit and log
tx
state batch submitter submitted state
route batch
now it should just be it's not a state
route batch it's just a batch
cleared queue submitted batch here we go
contract function promise
this chain contract
um append sequencer batch
set of console.log tx here
okay again yeah
this looks like it's working
i don't know why it's not giving me a
receipt
these things just aren't showing up on
the chain for some reason
that still hasn't gone through
what's happening
we have all these valid-looking
transactions
okay again let's do it metamask
send to this guy
here's my hex data
has no value
um well i don't understand that gas
price that seems very cheap
i don't know maybe that's one well
that's one never mind that's one way
uh i don't know put the gas limit to
that
it must be at least data
okay so that's the data
let's select the gas limit okay
confirm
all right i sent the transaction
manually from uh
you know it's almost like it's just not
talking to the right
thing
let's see if this transaction goes
through
what is this guy
okay cool so that got mined
now we have a state update
great
okay i think it submitted it i had to do
it manually in metamask for some reason
now if we hop back over here no give me
balance
[Music]
that's not a tx hash
okay there's a second thing that submits
a state route batch somewhere
we'll log that one too and we'll
manually submit that via metamask
i don't understand why these aren't
being submitted
um state
route state
group batch state
route batch
maybe it's uh
maybe the gas price
oh but it's it's like it's getting the
wrong knots
it's putting all this junk in the
mempool
yeah okay we'll just do it again for
metamask all right we're on cheap
send we send it to
this probably some like state root crap
this what's our gas limit gas limit is
this and what's our hex data our hex
data is
this
contract interaction data that's great
let's go i love metamask when it works i
still don't know why
holdings is pending but
so this one's going to get mine is that
the same address now we sent it to a
different address this time
um why would they not be submitting
what gets the nonce uh
json rpc getting wrongs
what's the nonsense this yeah the nonce
is 59.
upstream death issue
yeah there's just tons of junk in the
mempool now
and that's why it's getting the wrong
nons and like metamask is accessing it
differently
okay either way that transaction was
mined so let's go
did we submit a state route
okay no state commitments to submit so
we've submitted the state commitments
now we go over here and there's gonna be
no eve
come on come on homie i want some meat
i want some meat oh
wait how did it process another one of
these
updating eth context
we need a block explorer
you know what i have one
i can use the expedition one but instead
i can change the rpc url
to localhost this should work right
this is one state batch appended
http localhost yeah here we go
okay look we mined a block
it was the most painful block i've ever
mined in my life but we mined it
and it has one transaction in it
242 so maybe this
we mind this one transaction
state batch appended
yo look at our block aren't you proud of
our block look at this beautiful block
we mind
if we figure out why this
is getting the wrong nonce we can solve
a lot of our problems i think
is it using some like old version of the
rpc software
well let's try something else
let's try to redeploy a bridge because i
know this code works
you are satoshi how many people we got
five five five that's not bad
okay we have a transaction
but still the bridge has no each
okay theory
i can actually change i can use a
different private key all right i don't
have to use the same one
i guess this one i do have to because
it's the only one that's allowed to
submit to shit
why is my contract transaction not
showing up
get clear mempool
not a great solution but it works
all right let's try this
because i think my bridge isn't even
working now like something is messed up
in the mempool with respect to that
address
and we're gonna figure out what happened
no this one we can just move him
test bridge
okay let's open up node
acquire web3 cannot find module web3
all right one bridge node
will require web3
uh okay
so let's see w3 dot eve dot pending
transactions
doesn't work
get pending
get pending transactions
do that
all right who knows javascript what do i
have to type here
a weight is only invalid in resolve
node command line resolve promise
just use dot then yeah good
i need a function here
that
okay how does it say there's no pending
transactions
um
web three get nonce
okay here we go web3.ethe.gettransaction
count put that in quotes okay
oh my problem is then console.log you're
right that's much simpler
61. okay so if that's 61
how come when i run
when i run this
it gives me 125. does that make any
sense to anybody else
it must be submitting it to the wrong
chain
or something's wrong it's using the
wrong web 3.
it's using some old crap maybe it's
using old crap
that doesn't explain why my bridge
didn't work when i just ran that
but 61 is a reasonable nonce for this
address right
where is it getting that crazy number
from
yeah 61.
so it should make the nonce be
you know what i have an idea
what if i just go in here can i say
non 62
already known
yeah how'd metamask do it
already known replacement fee
too low
it wasn't times to work there two times
gas price
i'm able to compile typescript colon
expected
where's this gas price come from
okay non-62 is that gonna work
let's go look here
now let's look at the from address
where's the from address
here
you know what occurs to me i can also
put that address in here i don't think
i'm gonna get a different answer
no because it didn't it didn't give me
any balance
just send some crap to this thing
uh no where is it this guy
transactions
960. okay then how is it already known
if i put in 61.
this is what broke something's broken
not 61 is a broken transaction
okay now it's submitted with non-61.
remember when it wouldn't before
is this going to resolve
is there some bug and get should i
restart the rpc server
i can try that i'm blessed enough to
have access to it
but it's not really fair because what
would anyone else do
sink their own node point
they could sync their own node
all right i gave it not 61. is this one
going to mine
why did that one not work
sixty
oh wait that's not a valid gas
price
yeah that's not a valid gas price
that might be the problem what's the gas
price here one we
is that a gas price in gui or is that
one gui is one billionth
first
i don't know who put one there did i
oh i might have done that
oh well that would explain some things
what's the gas price here zero
not one
let's try zero
and well first let's try non-60 so i
expect it to fail with non-60
i expect that to give me an error and
say it's already known okay announcer's
already been used okay that's good
so if i set the gas price to zero it
should be whatever the server gives me
now let's see if it mines that
transaction replacement fee too low okay
fine
fine i'll make it big
ah zero zero zero zero zero
let's go
okay i don't know if that just cost me a
bajillion dollars in gas
ah look at mine look at that
all right do we have the same problem
over here or is this just a nonce
problem
no those have a reasonable gas price
okay that's
probably what broke my shit so now we've
done another deposit
with very little value but still some
deposit
um
that got mine that should be fetched
here
once we get to the block that that was
mined in
let's find which block it was mined in
it was blocked in
mind in six five seven okay we're
nowhere near six five seven yet
oh i think this waits a few blocks to
because of block reorgs we might even be
able to parameterize that
okay we'll start that thing up again and
hopefully it's not going to submit
stupid stuff
so it looks like i broke that by setting
the gas price
way too low
good fuck off if you're trying to invest
in cheapy
it's not investment it's for using
investing is for speculators
all right where are we up to um let me
see if i can actually make that go
faster
uh the data transport layer maybe it's
in the environment
um sink from l1
dangerously catch all errors true oh
here confirmation is 12.
uh i don't know i'm cool with three
that's a good number of confirmations
yeah
then we shouldn't have to wait as long
because i'm impatient okay
process one transaction queued event so
that was my deposit
um processing that and actually if we go
over here to my expedition
that's in okay cool look did we mine
another block or what
submitted no it is a bullshit nonce why
does that have a bullshit knots
why
those are never gonna get mined the
nonces are bullshit
keep submitting things now
let's try this now this has already been
used oh that's because i hand
coded that nonce
um my hand coded 61.
but it's still giving me a bullshit one
uh
i don't know you know what i have a
theory
you ready for some fun four var
i in 62 i
less than 128
no this is stupid this is stupid i don't
want to play this
why is it giving me bullshit nonsense
where did it get the knots from
locks
here
all right well now this is giving me an
ounce of uh 129
so i can go in here
find console.log and give this a nonce
63. i don't understand why it's wrong
i mean this of course is only going to
work once
waiting for receipt no t-access to
submit
skipping batch submission
process one
no i don't think so because if that was
the problem
then
i don't know how it's getting these
nonces and i don't know why they're
wrong
um returning
wrong not
92 it's gonna be 92.
did all those other transactions get
mined or something
all the broken ones
oh yeah look
i mean they all have errors but they're
all transactions they're like getting
mined
i don't know maybe we should just do
that thing that i was going to do
i just submitted them all it seems like
what happens is you submit one nonce
with a bad
if you submit one transaction with a bad
gas price
they all get messed up
let's see what happens if i remove the
nodes and see what knots it gives me
130.
this is gonna go go nuclear on this shit
92 130 i plus plus
let's go boys let's go
not i
don't bother waiting don't bother
waiting just submit all the transactions
just for the walls to go like that you
know what
it's cheap gas we can go like that let's
go
boom boom boom boom
all right that should kind of like
re-synchronize the nonce
so i do it again should give me 131.
wait yeah i did them
okay 131 not 130
i might have had to do 130 as well okay
we can just do 130 just in case
and that is why you don't use the wrong
gas limit
up to 114
still 123
oh look at all these blocks
wow if there's still no value submitted
i don't know what we did wrong
should we read this understanding nonce
[Music]
are we up to like something reasonable
yet okay 131
perfect okay so now it should submit
with 132 and it should actually work
132 submitted
that should mine 133 submitted
and i assume that's like the it seems
like there's two things it's got to
commit it commits like
transaction may fail or require manual
gas limit
cannot estimate gas
let's see if any of these things
actually mine
132 mind
we'll see if this works at all
useless
okay we got tons of blocks but all of
them just they don't really seem to
contain any transactions
which doesn't exactly make sense
where are my transactions i did deposits
what's the latest knots 134. so if i run
this guy
one time one time only
i'm going to get 135.
okay i get 135 that's actually going to
mine
that's going to show up in here
well it makes its way through okay so
that shows up in here it's now going to
show up here
as a transaction and cued event
but i guess what i don't understand is
why these transaction enqueues
uh don't actually produce any value
so which block was this mined in
this is the hash so we can go here i
guess it's actually just the top
transaction here probably yeah and 135
so it was mined in 7-eleven
and if we look here okay okay so we
process the enqueued
now it makes it's okay updated f
contacts from enqueue
from that block number we have a new
block
now this is going to submit okay i
already submitted the block
okay uh
for some reason sometime this gas limit
thing fails
but it seems okay it seems like it just
tries again
oh no i guess
yeah okay so let's submit to that update
and then it submits this update
now we're on here
why does this thing not have any
why does this thing not have any uh
eats in my thing that i deposited all
the eats into
if there are gaps and nonsense all next
transactions sit in the main pool
waiting for the gap to be filled
i say
shouldn't this like give me the value
oh wait it's very possible to config
issue
if the tx is no i mean so it looks like
the tx's are succeeding
wait what
what is this
does it call this
in l2 get it calls this
is wait for l1.sh
because i don't think my address is dot
json this isn't right
deploy or http i've never seen this
before
no that's only called in docker but you
just might be missing those
okay well let's read start then um
yeah i don't think any of those are in
there do i really need them all
eath one oh okay i bet you it's this
i bet you we don't have the eth1 l1
gateway address
let me see if that's even in there
because i know this stuff is new
yeah uh no wait that's the wrong go
ethereum hang on
cheap optimism go ethereum get grab
okay okay i bet you it's this
eth1 address resolver address
roll-up address manager owner address
okay
let's put this guy there
set the address manager here
and then the ovmf gateway
is this yeah i think that was the
problem
i didn't need to restart that i need to
restart this
now i have no idea what's broken and
what's not
yeah okay so if you don't set this it
sets it to zero
that shouldn't be that's that's kind of
a bug
um i would i would just i would just
junk that out so it just crashes
okay so let's try that again
deposit
deposit passed
the new thing's going to come in and
hopefully this is now going to actually
check the l1 gateway
the real question is where'd all my eats
go
i did i did i still miss this one
okay i still need this one too now i
have l1 custom
messenger address i think i said it
correctly
yeah i didn't set it to the proxy i set
it to this one
wait
okay got the transaction enqueued it got
the new block
let's see if this time somehow it
actually managed to
put the thing in no it still has no
transactions though
oh i need the proxy okay
proxy cross domain messenger
this is brittle
database contains incompatible genesis
okay this doesn't sound great
let's go
okay we re-synced the chain
oh now we've resynced the chain maybe it
works and maybe all my ether is actually
there
hang on maybe i didn't get scam boys
maybe no scam
fingers crossed no scam because we
remind the blocks
remind the blocks
no t-axes
um remind the blocks remind the blocks
no nothing
and send some more
you
so did i set them all now
address resolver cross domain messenger
ovm l1 gateway oh it is the proxy here
okay i can see it there
and then deployer oh there's one called
deployer i see
oh deployer is me oh that's nice okay
that makes sense
okay
okay we're resubmitting a batch
i mean actually i guess this batch
submitter is just talking to geth
so if geth had it wrong it submitted the
wrong batch
does that make sense
all right fingers crossed
doesn't look good
no zero balance
um
yeah nothing
all right now i don't know
when is the the value supposed to show
up
how is this thing supposed to work let's
try to understand it
okay um
l1f gateway address
really this thing should just call the
address manager
can it not do that maybe you can
it should show up once it's in the data
transport layer
just this first one
did i maybe i got some stuff wrong there
no that one uses the address manager
though right so there shouldn't be
anything wrong
they're using address managers that's
not wrong
all right let's jump that database just
in case
there's some bugs that doesn't that's
stateless
um
start
okay synchronizing all the stuff
and then i should see a corresponding
log and gath
search finalize deposit in l2 geth
um
okay i see
so that's a test
it's here only from cross domain account
this call will fail if it didn't
originate there
okay re reset everything remind that
the block submitter should not have any
blocks to submit
but this didn't even have anything to do
with the block submitter right
and there should be a log and geth
how come i don't see a log
all right
i'm calling the ovm
f1 gateway oh well
okay let's make sure that's
address manager get address
ovml1 gateway
want gateway l1 wallet seems right
and then i send the deposit
there's nothing in wait for deposit type
transaction right
maybe i do need that
nothing special on that okay you're sure
well actually if that works
i should be able to uh let me figure out
where the watchers initializes and like
set up or something
oh my god was that the whole problem by
the way that i didn't put
htp before my l2 provider
that would be bullshit
i'm not my name and it watcher
it
okay remind the transaction
no one was waited okay great
i don't know what any of these things
are i guess that's the l1 receipt
i think something's going wrong here
get l2 transaction receipt so there's
some problem with death
transaction
here too but yeah it never gets the l2
transaction receipt
i don't know maybe that just takes a
long time
can you reopen the l1 eth gateway
contract
what's the gas limit that the deposit is
sent with
oh this but it's not reverting
that's like hardcoded to something but
like it would be reverting if there was
a problem
it's creating the things
guys i'm a no coiner okay it's a life
velocity
okay i have some ideas let's look at
this
let's look at the bit in this uh this
rpc layer
yeah see this fails because
it's never actually getting the l2
transaction receipt
get message hashes from l1tx but it
never
it never actually shows up in in geth
all right so let's read this
data target
wait so is this
is this a deposit
oh inside of the contract limit contract
itself
there's an l2 gas limit for the deposit
here
default finalized deposit l2 gas
that
is that enough gas or do we need more
gas
how the hell am i supposed to debug any
of this
um
this is why cheap had a pre-mine
and mining
is there anything in the l2 geth logs no
there's not
oh we can increase verbosity and get
okay
should i do that
that's all in contracts i don't even see
anything in go ethereum for
finalize deposit
search for ovm e
okay increase increase verbosity to six
okay i can do that
um
which is how do i say it oh ipc's
disabled no wonder that didn't work
um verbosity sex is that right
yeah that's right all right
um
well let's do that
yeah i don't see any ovm stuff
oh yo
yo i bet this startup script
doesn't have
it's the same problem the startup script
doesn't have
this
yup yup
uh this was a new parameter i guess
yup okay
eve gateway address
and this has to come from here
still nothing
but now what are the other ones that i
forget
each gateway address
eth1 chain id that's right address
resolver address
well no that might have even worked
because
okay either way
hmm
gateway address flag
okay do i have that
i want to eat gateway address um
start dot sh
i don't want to eve gateway address okay
i do
l1 cross domain messenger address yes
we have that it's set to the proxy
uh
ctc deployment height that's right
but okay so i mean the problem might
even be
deeper than this because i don't see
them in here unless this is the
transaction that includes it well
actually you would have to include the
address so does this include f2
it does yes so that must be the deposit
there that's being sent
and then i guess this is actually the
deposit data
the verbosity didn't get picked up it
seems okay
i don't know if that has more stuff
script start.sh
running command and the command has
verbosity 6.
you think there should be more stuff
i don't know
i think four is right yeah i know it
didn't look like there was a level six
so i changed it to five
ah
roll up state dump path
what was jar hands complaining about
if it was stupid we're gonna ban them
for life
um
i should be seeing more infos
not really
what is this deposit that i'm supposedly
supposed to see well let's figure out
where it uses this
um
cross domain messenger
these are all the contracts here
okay so this is part of the genesis
block now
i can see this can't i
but yeah it should be printing all these
log info things
and i don't see it doing that
oh here we go setting address manager
owner
setting lv ovm 01 cross
domain messenger to the proxy
setting
l1 weave gateway
is that just a typo or am i supposed to
send weak
or something
that seems right
okay it's a typo
it looks like the transactions are there
it just doesn't look like
like so these things should be handled
by that special
thing in geth right
um
so there should be some like like
interaction and geth
that does the uh
it has to be
i mean weak is a real thing too right
no no no no see
this is making me believe in cheapy
this is making me seriously believe in
cheapies
cheapy simple cheapy live
okay let's look at this l1 eth gateway
address
that's great that it's in the genesis
block
okay here we go apply ovm state to state
oh
looks sorry maybe it takes a little
bigger it's hard for me to retail
okay so it sets these things up
and then to block
range g alec i don't know what that
is
oh this is probably where it like builds
those initial
contracts
the decks got bigger it's bigger tags i
swear
um no so this this deposit contract has
to exist somewhere in
it has to be somewhere in in in go
ethereum
probably in the stuff that's processing
the ovm
all right
no no no
not that
um all right we'll go back to genesis
and then
l1 gateway slot
ovm e what's ovm
eath
should i tell it that
ovm dump account
oh dot address
okay ovm eth is
that
which i guess okay so that's a deployed
contract so if i go in here
to this i should be able to actually go
to that
so that's where you stock your secret
contracts
okay that's a contract ovme
now for some reason it's also deployed
on
the other guy but okay
it's got to be in that thing
it's it's got to be it's got to be an
estate manager right
like here ovm state manager right
call state manager
yo i gotta go in like an hour boys
it will definitely go into the state
manager okay
good thing it's quick to remind this
whole little block chain
that's an advantage cheap eats got a you
know
okay so it's calling the state manager
that's good
it's calling the state manager shit ton
of times
[Music]
um
address
oh dot hacks
jar hands is back gifting subs
jar hands is the the hater that turned
himself
around he went from being a hater
to gifting subs and he might also
be the first person who ever gifted subs
to get banned
because i don't know what he was hating
about you know we do have a saying
around here
once a hater always a hater but jar
hands
might prove that saying wrong and that
would be amazing
he has found salvation that's good we
should tell speculators to find
salvation
kevalicious gifted ten as well
wow so many sub gifts
all right called state manager
normal
normalized odd number of arguments by
adding
nil i don't really know what that means
okay well
what is searching for ovm ethan geth
logs get you what do you mean by geth
logs
do you mean like just what's printing
here
where are my death logs
i don't see anything
use the ovme
i see a lot of calls to state manager
gotta deposit again if i restart geth
wait what do you mean no i'm killing the
chain every time so i'm reminding the
whole chain
now all i see is new block
should i clean the db
what do you mean did i clean the db
we have to change verbosity to four okay
don't make it five
gotta make it
oh look at this
what a scam verbosity was set there
to three now it's five that's right
okay we got verbosity now
we should see more debugs yeah okay all
right now we got verbosity
here we go
ovm execution failed
huh
okay okay look at how promising this is
ovm execution failed
why to fail
yeah i knew okay that that makes more
sense
so here we will we'll mine a block we'll
do a transaction and
we'll see what happens
yeah the problem is the verbosity in the
start script is actually it's it's it's
not
in the command it's it's at the it's at
the end
that that script has been the source of
a lot of problems for me
okay debugging is less ridiculous now
that we have real
uh real stuff
okay it's probably serving all this to
my expedition expedition was eddie bauer
edition
okay here we go so we found the problem
and it's ovm execution failed
now why the ovm execution failed
well that one i don't know
applying transaction
to dead dead dead dead five
is that right
you know what i got a theory i'm gonna
try one here
i don't know why but i just kind of like
the idea of one
that's the execution manager
no still failed
oh dead dead dead dead five is the
execution manager okay
so that's normal
oh
[Music]
all right let's see if we can figure out
why it failed reach the end of an ovm
execution
turn data what's the error
error ovm execution fails
okay why does that happen
if we didn't get
to the target contract
oh is it gas
i have an idea big gas
yo we got a thousand gas let's go
i just gave it a thousand times more gas
ovum execution failed now
why is it failing
okay i guess i mean that could be a
bajillion things done
take out my gas hack
uh
not original target reached
program execution manager address
huh
is that the right number of deads
string to lower address.x
what is the f1 l1 cross domain messenger
address
um
it's this it's the proxy
it's the proxy ovm cross domain
messenger
is that right or should i not use the
proxy
is ovm failed before or after hitting
well i don't know why i'm getting no
pointers now
proxy is right okay
uh i mean it's definitely calling into
the
execution manager
i don't see anything that says ovm evm
no the channel moderation settings are a
secret and if you're saying something
that interferes with them
you're probably saying something stupid
[Music]
ah
ovm execution failed
calling unknown contract what is
contract for
it's like a special ethereum contract
right
oh see there we go you're violating the
uh
the identity copies the input data to
the output okay so that's a real
contract
put contract storage
yeah it's the identity pre-compile okay
why does it fail
the only thing i can think is that this
data is not being parsed correctly
like this one somehow has a different
build
from what geth is thinking
like maybe this isn't right
because i imagine that's what it's being
used for right
can i generate this somewhere else
right ovml2 cross domain messenger
need to set f l1
i am i'm setting that
try one.json i've tried one.json and i
get the same stuff
try going into the contracts where you
put okay
uh contracts
yarn serve
hmm
no vm execution failed same shit
could this thing be wrong where is this
getting it from
packages x domain where am i getting
that data from
no it's no because that's emitting the
right that's emitting the right stuff
yeah it's just like it's it's it's
running it it seems it just doesn't
work
i deleted the gas change yeah
hmm
you
did you change the chain id in the state
dump this has a chain id
well now i did is that what you mean by
the state dump
i changed it in contracts
like i did build cheapies
oh but i don't think i set okay
is that going to be different
wait it's supposed to be that chain id
no i don't think so
because this is not that chain because
you're using chain id 10 for the main
net
got to use yarn builds
what's my chain id my death environment
my gut environment
it's 777
or no maybe it's this f1 chain id is 777
and the chain id
is 96.
hahahahahaha
okay um
[Music]
yeah so where's it hardcoded now
i built the contracts with chain id
okay okay i did that though
i i did that
same error
i just did that
but you're telling me this has the chain
id in it
i don't think this is being set
i think i need this
um
if i don't have this it's not going to
work right
if you pull in that you can overwrite
the chain id stored in state dump
no but i redid the state dump
i redid the state dump and that didn't
fix it
okay so this has the right one now
does this have the right one though
just does this cross domain have the
right one
here 60. now that should be right
i don't know if that 60 is actually a
chain id but
hmm
this ovm l1 gateway should have the
correct chain id
compiled into it because that's what i
deployed
i changed the change when i built the
contracts repo
i set the chain id to 777
when i built the contracts repo
i set the chain id to 777 when i built
the contracts repo
so maybe it's that
no i have to redeploy
or maybe this a lark
same bug
[Music]
no wait so there i set the chain id to
96.
is that the most recent deployment it is
yeah
the most recent deployment the chain id
was
96.
i want the logs from the gas
29 40.
i mean really i want to look at that
data
all right i want to apply that data to
that contract which contract
is that well i should be able to look in
here
find this guy here we go ovm execution
manager
so i don't know which
chain 90 96 yarn build yarn serve
delete the gath restart the gap death is
the only thing that reads from that
thing
which is deploying all those all those
contracts
still saying ovm execution failed
i don't think this sends a chain id
in fact those things that are being used
to deposit so it's
it's just going to be a value
why is that so long if it's only a value
uh
i'll post this one and just
you
but i see so there's a slot in the
execution manager
and that slot in the execution manager
is what uh
yes i set the gateway address
uh and i can see that getting set in the
beginning of the genesis block
you scroll like all the way up in this
thing i mean now it's kind of harder but
i would spend a lot of time what i'm
gonna do
is like okay so let's that thing is
called the
ovm execution manager right if this is
reverting it should give me a revert
reason
making errors work
[Music]
um
let's say
safe chain id
like wouldn't i see that
right how do i get that
if that were true
i need some solidity syntax highlighting
[Music]
plugins
um
i don't know how to use this install
plugin manager
extensions
install extensions in the marketplace
solidity
i wear that thing to go that was doing
the safe requires
yeah mean you can you can get what's
what's the address of my execution
manager
uh i'll post all the addresses
actually i guess you only need the uh
adjustment manager
it completes you think the error is a
mistake
okay
then where's my money
whoa the money's there holy shit
how long did it work for
yo we got money yeah
yeah i thought we weren't gonna get this
done let's go
let's go let's switch over right now to
our optimism
on yo
yo we got we got point one we got point
one
beautiful l2 seath
right here oh this shit's fire okay
let's send some
let's send some over here to
who wants some who wants to no
this is annoying for you to sync but if
you set up an l2
node this is all live right now on
cheapy let's fucking go
all right so let's send some to account
one let's send .01
and we can use a small gas price now
oh invalid sender
well i don't know about that
why is it a valid sender
you can't send eve natively it's an
erc20
on l2
send how wait how do i spend
gas then
test here
i don't get it
how do i send it
it's this whole thing i was trying to do
this whole time
it doesn't work
it transfers the rc 20s
seaweed baby wait oh add
token oh and then what's the address
okay i can do this
i'm not backing up shit
i just want to check something
okay
okay metamask is trash
i need big metamask big metamask
okay add token all right real quick and
this custom token
token contract address oe weath
okay wow it's already supported in a
meta oh no i guess it just queried
add tokens yeah i got some oe weave
all right let's send it over to contract
one
but i don't have any gas
what just happened invalid sender
send owie
sorry that way why does this work
is that fail metamask is like blinking
something and i see it almost work
check ovm ether in state dump
it's probably messing with your chain id
oh
oh no no no you're right you're right
you're right i don't think i set the
right chain id
um networks
yeah yeah is that the wrong chain id
good point good point 96
let's go
okay now we're going to send some aoi
over here we're going to send one ali
we're going to do it with one way
yeah that just worked
yo
[Music]
all right so now i would expect over
here on account one if i add a token
a custom token of course with this
i have one owie
this stuff works great never mind l2 is
great
you just need to give up and just accept
that you all you have is owie
wait who just gave me more out
thank you for the owie you actually got
this synced
all right guys i think this is a pretty
good note to have the stream on
this is the neutral sheet
i will set up um
i will set up a uh
i'll set up a shitty digital ocean box
that runs this stuff and then you'll be
able
to um to move your ear
to hell too you all write that thing as
like a little apple have fun
um
no people tell me that my emotional
state is linked to whether the code
works or not
it's true
you can move your money even further yo
yo
but guys all i'm saying is i think this
doubles the value of cheapy
i got rated on how many people we got
yo i'm almost done though i got i got
stuff to do tonight
i got rated
stop posting your addresses you know
what you know what
i'm going to send you an aoi and if you
figure out how to get this aoi
congratulations you're awithrich i'm
going to send you 10
owies okay you actually figure out how
to get those alley
i'm going to be super impressed
[Laughter]
are we the most aware of this thing
wait i guess i don't really understand
why is it going down so much
wait
are they gaspies and always
you guys you're never going to get any
ally
who spammed the same address twice
your subscriber i'm gonna send you
i'm gonna send you 100
yo are you guys ready we're gonna do a
token sale
for who gets to be the sequencer on
cheapy
now that's that we're not giving out
anymore howie
yo this stuff works great
check it out look wait are there
transactions
these blocks transactions five
wow look we can use a normal block
explorer
this stuff is great
um all right
um you're gonna quit your job to be an
owie
miner that's a good choice uh
i kind of gotta go i'll i'll post the
i'll post they
uh
that's four kelly yo ally has a pre-mine
voice
um no i i will stand up i will stand up
l2.jp.org and then you'll be able to use
l2.gp.org um cheapy
is is the most ahead of the game network
we have l2s before everybody
[Laughter]
it's a funny name
uh why not create a cheap coin for every
crypto because except for ethereum every
crypto is so useless
name something you can do with another
crypto except maybe buy drugs with
monero
monero and ethereum
uh
did you miss the fun rants who's the
founder of cheapies goku1997
uh
guys stop posting your addresses always
to be fair someone stole 30 cents so you
know
i i won't put it i won't put it uh below
anybody
to uh just
use full of scale from
um why use cheapy over testnet
dude test nuts suck you know what the
problem with test nuts are
they get reset they don't have any value
cheap eat has a small amount of value
cheap is better than freak right it
really is though
here's today's rant if someone's giving
you
beer for free it's because they like
want something from you right there's no
such thing as free beer
right it's like it's like oh you got to
go to this like real estate seminar
where they pitch you on a time share in
exchange for a beer and you're like
that's not fucking worth it but imagine
you go to a bar and you're like
beers are two bucks that's what you want
right no new york ass 12 beer
you want a two dollar beer right you
want beer to be
cheap you know when i was in argentina i
smoked cigarettes you know why
cigarettes were dollar fifty a pack
right
cheap cigarettes right um
that's why you want cheap and not free
and that's why cheap eat is better than
test nets
ah yo cheap all right
we got anything else to discuss i have
two more minutes
no i got a shower i gotta go thank you
all
for watching my stream today optimism
i'll see you guys next week i believe in
you
yo we pulled that we really pulled that
stuff out at the 11th
hour but we did it and you know this is
going to be on main that whenever you
guys put it on main net
uh but it's on cheap first so cheap
see you guys next week streamers thank
you all for watching uh make sure to
you know you know what just like
join the cheap party join the discord
use cheap for your projects enjoy cheapy
spread the cheap eat spirit
which is ethereum's for everybody not
just for whales
you can play even if you're not a whale
thank you all for watching good night
you're sure if someone acceptable for
stream
uh yo we got some crazy energy drinks to
try let's see what we got
let's see if we're going to start out
with a
amazon energy ah yes perfect
nutrition antioxidants i don't really
know what those are
uh sam bazon it's like samba
you guys want sambal
what let's take the micro so that's the
nfas clone samba
samba oh opening windows to a wider
world well that's a really nice slogan
um there's a great hacker news post
yesterday about how the old internet
wasn't really better
you just got older and everything sucks
uh and that's so much
maybe someone agree with that
[Music]
um all right so i've been struggling all
morning with memory
the thing that i want the problem is
basically this
i have so my registers right now in this
little version is a 4x4
4x4 2d right and i have 64
block memories so do i even have 64
no no this isn't either right i have 16
registers 4x4
and i have 32 block grams right and then
the thing that you're building is a is a
multiplexer
um and it turns out that big multiplexer
kind of hard
big priority encoder even harder
but this does synthesize so for you know
people saying that i'm not
uh synthesizing anything
i'm synthesizing stuff um so we're gonna
look and we're gonna see okay
so the reason my memory architecture is
so tricky
is because it actually supports
reads from any address on the first
clock cycle here
we fetch all the addresses
by using it's fully strided so by
strided we can access anywhere in the
memory array with two stride parameters
uh now these things are great
uh the problem is you know memory is not
really
memory's not really happy to do this
memory likes to be accessed in big
chunks not small random chunks
this is universally true you know
whether you're on a hard drive or an ssd
or a dram uh
turns out it's even true for sram like
random access is just hard
so a lot of computers is just figuring
out how to make your access not random
you know
what do you think caches are well i'm
going to read a big chunk
load it into the cache right and then
you have caches that are like
four-way associative and i
think what i'm asking for
is a 2048 associative cache
um let's understand this first
no i'm gonna first i'm gonna make the
whole thing work in this fpga
look if i can't make it work in this
fpga i shouldn't be spending
seventy five hundred dollars you know
that's like the kind of people who think
they're going to become good musicians
because they buy
you know an expensive microphone you're
not or you're gonna become a good hacker
because you buy an expensive keyboard
you're not
if i can't make something work in that
fpga then you know what am i doing right
you know that's that's the scam you know
like cruz is building they're spending
it's 5 billion on cruise origins why you
can't make it work in a bolt you know
oh but we want to be ready when it's
time no
no this is bad thinking
mac os or lmao i'll choose lmao
um yo but seriously shit like that is
gonna be a ban
because we're here to talk about
something uh you know fuck off with your
dumb
well do you like red or blue
uh you know they're both shitty and make
purple
um
so yeah the small one has enough gates i
mean you can't synthesize the whole
thing
but i should be able to synthesize
something uh by the way our our floats
got nerfed
our floats used to be 19 bits now
they're 18 bits because b
rams are 18 bits so you know if you
liked your 19-bit float
i'm sorry we stole a bit off of the
mantissa so now they have nine bit
mantissas and not tempted mantises
well it's a arctic seven one hundred t
uh okay so by the way
i've gotten a few people i've gotten two
groups of people who've reached out so
far about cherry computer
and one group of people like sends in
their resume and they practically start
their
their their email with um
uh greetings hiring manager like there's
no fucking hiring manager it's me i'm
not reading your bullshit
i will read your pull requests if you
contribute to tiny grad
and i realized that i didn't make
contributing to tiny grad that easy so i
added some to do
um so we already have i've already laid
out the risk architecture here
um this is the risk architecture these
are the instructions you're allowed to
use
these are the 14 tensor grad operations
um written in the risk architecture but
like not really because like the
backwards con
i just stole from uh like this is the
numpy backwards conf
so i want you to write the rest of the
operations
um this on broadcast is using dot sum
which is a numpy thing
i want you to write the rest of the
operations in risk
um so i'll show you guys what it looks
like when you run it
not calendar why would i ever want
calendar uh
if i go over here to tiny grad and i run
it
we had a bunch of good contributors to
tiny grad so i trust that people will be
able to do this right
so like here's a conf 2d this actually
is going through the uh
the uh risk
the sub is going through the risk the
mall is going through the risk so is the
ad
i haven't done the reduces yet and
i haven't done the um
don't worry about like slices and
reshapes those are free
i haven't done the reduces yet and i
haven't done the backward pass for conf
so i leave that to um
you guys if you're interested in working
at cherry computer
uh contribute to tiny grad um
the other group of people who reaches
out is investors and
the thing about investors is this
capital is kind of worthless these days
um if you notice that like there's an
absurd amount of capital
to fund every possible scam you could
possibly imagine
um so like you know i don't know if i'm
actually going to do this yet i'm
certainly not taking your money
uh i'll only you know i thought about i
was sitting in the tub yesterday i'm
like when do we actually want to take
money well
we don't actually have to take money to
do any of this to write all the fpga
code
and then for this i don't know i'll just
do a kickstarter for the card
all right and then like we have the most
valuable on investors you know you guys
want the company to succeed because you
want your card to be good
right like fuck off if you're like oh
i'm a liquidity provider yeah well you
know
liquidity is like useless because
there's all the free money in the world
so
it was kind of my thoughts on investors
um
you know and yeah if if you're this
isn't like you know common needs some
like physical stuff it needs like cars
it needs like
like if someone's a serious contributor
uh
who like starts contributing to my
verilog code and like buys one of these
boys and gets it working on here
i'll buy you one of those cards out of
pocket you know
uh if you don't have 7 500 like i'll
just buy you one
um if we get to that point
and then like yeah i think we'll just
put the cards up on kickstarter i think
i think they'll sell
um so yeah the kickstarter goal would be
for 10 million for
10k cards every 10 million dollars
no no it's not capitalism right what we
have now has nothing to do with
capitalism
the money is all fake uh so it's not
it's not capitalism right because
there's no there's no capital
right like like you're playing for
points right it's state it's state
capitalism
like you know although what are the
chinese have a state capital what does
america have state capitals
one day maybe we'll have real capitalism
but you know in real capitalism
you don't have bailouts right you don't
have uh you don't have ppp loans you you
don't have unemployment you don't have
any of these things
that are not capitalism
um
no not and cap no you want governments
you know would be nice
if we had some fucking protections
against monopolies right now you can't
you can't have a company which has one
profitable division that subsidizes
their other 10 divisions perpetually you
can't do that
right so it'd be nice if the state took
action against that and instead of you
know subsidizing corn so we could have
ethanol in the fuel even though it costs
more energy to produce than it does to
make right
um
no unemployment i mean you maybe there's
private unemployment you can probably
get unemployment insurance if you want
um but yeah let it be private right no
we got to get you know oh my god
the student loans don't worry no the
student loans could be private but you
know the banks can ask you hey what are
you going to major in and if you say
like
you know um well i'm gonna major in a
15th century russian history and the
bank's gonna be like all right well you
know good luck paying for that
um i'm gonna major in petroleum
engineering well you know we're
interested
um so no no
it's not you either allow government
intervention or you don't
no it would be nice if we had a same you
know but all right
that's not that's not this is just about
why i like no i don't want your fucking
money like
it's worthless right like and everyone
with capital should kind of realize that
like
you are part of a class that's about to
be
you know like like eat the rich man eat
the wrench
um my co-workers are coming i got a big
shirt that says eat the rich and i think
i think that's i think eat the rich is a
good movement
um
so yeah i mean pcie would be nice i'm
probably gonna have to write some like
ethernet thing to actually dma
in and out of this ram when it's time
like i'll write some little ethernet
thing which lets you access the memory
to uh
do a back door
um if you asked me on linkedin and it
wasn't out on a date i ignored your
bullshit
[Music]
ubi it's just fucking bullshit man it's
all bullshit
if you be oh why oh yes we'll just give
the people money for doing nothing
that's a great idea you know what there
was another
group of people that did this and it was
called slavery 1.0
you know but now it says all right never
mind i don't want to go off on this but
uv is fucking stupid man
like you know you can't just give people
money for not working right because then
what happens you know you're gonna be
out competed by my society that decides
not to give people money and um you
can't contribute usefully to society
well bullets are cheap man
bullets are cheap and that's what we did
to the horses
that's i'm sorry by bullets i mean not
birth control yes that's it
all right cool
um
i think a 10 million dollar kickstarter
goal is is is possible
uh why not use an existing
risk core well the hard part's not the
risk war with that in a day
um i mean yeah we'll have to get like
pipelining working but still like this
is in order like pipeline is easy
i could do pipelining a few hours if i
uh
decided to do it
but yeah i mean the stuff's in order so
we will have to get some like super
scalar stuff up but that's still all a
long time away
for now i'm focusing on the feasibility
of my instruction set
now everything else i've seen made
before
um oh i added huawei to the blog post
uh and huawei uses a 16 by 16 by 16
matrix unit so we have a 32 by 32 by 32
so it's similar um
that i trust i can build but what we're
going to look at now
is we're going to see we're going to
understand the different
uh memory architectures of these
different things
because it seems like my magical stride
instruction
is not that easy to build in hardware
uh because you have okay so the problem
is basically you have
i'm trying to make is a ram that has
ports and a ram
an sram with 1024 ports is just not
something like
you know you can build so i'm trying to
like emulate it with some some hardware
around it but
like i mean kind of why you can't is an
interesting question
sram with large number of
ports is really what i'm trying to build
uh
interleave lesser ported banks
true multi-port memory
problem
no see the problem is if you're trying
to fix any of this in software like all
these people
are like oh well if i just pack my
memory like this yeah and some like new
little things going to come out and like
your memory architecture won't be
efficient you'll barely be able to get
it wrong
to run on your chip which is like fine
but i don't know like i want to build
something that has an instruction set
that's just beautiful
right like and strides are beautiful
uh having to like oh okay i have to make
sure my memory is aligned on every
32-bit word but if you're going to pack
like this
i have to reorder my axes like that no i
just want strides
man big strides okay
high area energy and delay cost for a
large number of ports
12 access points i want 1024.
oh okay well okay it turns out people
have come up with this idea before so
this is effectively what i wrote in
python with hashing
um and i wrote this like you know you
can you can just read it it's in twitch
it's called risk man uh so i wrote this
hashing scheme thing and i thought i
was um
i thought i was clever
okay well so it turns out i didn't
invent anything new and it turns out
that the thing that makes it hard okay
weight arbitration delay is fine have to
provide an
interconnect between each requester and
each bank
port and the problem is that that's the
problem right now
right in the final edition this will be
this many registers and this many b
rams and this many bits and like if your
connection is just a single or gate with
six transistors i've already spent 240
million
transistors on my multiplexer for my
sram
and now maybe that's acceptable but i'm
not really sure
all right i'm not a fucking adderall
you know what are you ever going to
contribute anything of value probably
not get banned
all right can we please stay on topic
um it's not that there's cash thrashing
right it's it's it's this uh
you can spend a lot of time writing
these
incredibly sophisticated
cash aware algorithms but writing
algorithms that are cash aware
uh takes a lot of software engineering
time so
you can do it but
like it's just annoying
yeah i'll spend a lot of transitions on
instagram but that isn't even sram
that's just
my decode logic for my sram
which seems kind of absurd because i'm
going to spend all those transistors
like
how many transistors does an sram sell
i just like i could have doubled the
size of my sram
why do i need one or two four because
it's 32 times 32
i'm like it's it's squared which is the
killer
um
you've got to multiply that by that
right so we can start sacrificing the
stride
and that's why i'm hoping you guys out
there are going to contribute to tiny
grad
and get everything working and risk um
and you can use the strides for now
feel free to use the strides uh you'll
see like here's my risk implementation
of
a convolution that's an ops risk
i've already written a few paths to like
optimize a little bit
and yeah i mean these these strides are
all small
on the x dimension these strides are all
one on the x dimension
um this one's using an h times w but
that's still a relatively small
so i'd have to see what i could do to uh
to handle like small strides like that
maybe there's something i could do and
then we'd have a
restriction on one of the strides and
that might make things easier to build
what is h times w so if your convolution
is three by three it's nine five five
it's 25.
but yeah so this this code's all open
source and the tiny grad repo
um you'll see that of the 14 tiny grad
ops i've implemented the unary the
binary and the processing
uh i have the backwards for map maul i
don't have the backwards for convolution
yet i'm waiting for somebody to
implement that
and i don't have the reduce i'm waiting
for somebody to implement that too
what board should you use you don't need
a board you can just do it with um
hmm
what's a stream buffered multi-port
we're going to have a single wide port
i should understand this this is an
interesting idea
oh no this is the same see it relies on
wide memory
so if your memory is wide
oh my god mental framework for hardware
you asked that question twice it's a
stupid fucking question
like think about why it's a stupid
question during your timeout
yeah a lot of stupid questions today we
get some mods up in here
to kill the stupid questions do i have
any reference code for implementing the
backwards function
this is a stupid question you know yeah
ever you ever
ever seen the movie clerks when when um
when they're uh you know standing around
at the
at the thing and it's like you have any
new movies and the guy standing right
under the new movies
do you know where the reference code is
for the backward pass it's literally
right here
i wrote it in numpy actually i didn't
write it so
this was contributed
no ubi georgia's mean yeah well do you
want to be mean or do you want to live
in a night
do you want to live in a society where
people are nice but society sucks
or you want to live in a society where
we command
strongman times you know what's this
what's this what's that like
yeah here we go yeah hard times create
strong men
strong men create good times good times
create weak men ubi fuckers
weak men create hard times you are here
now let's you know
do you want to live in a in a society
where people are nice but it sucks or do
you want to live in a society but right
come on
no this is like very basic memory stuff
this is more useful
a local cache and use a cache coherence
protocol
yeah okay this is the one we make copies
do
all right all right all right sry tech
band
band
i'm not gonna stream anymore if you guys
are gonna you're gonna gonna stay off
topic you divver band
see ya
i'm not gonna stream anymore if you guys
are gonna ask stupid questions please
focus
all right so let's um let's take a look
at uh
what these other companies are doing
let's take a look at google's
okay
it's chapter two because it's easier to
efficiently generate programs for two
brony chords for chip the numerous wimpy
course i agree with this
vector unit and eight megabyte v
map
the vpu streams data to
and from the mxu through decoupling
fifos
hmm okay what did google do for this
so
bandwidth required to feed obtain
results is proportional to its perimeter
while the computation provided is
proportional to its area
wait
is that right
oh
oh wait okay let's let's understand what
these matrix multiply units are actually
doing because they're not doing a full
matrix multiply
but what they might be doing is it's
like 128 times 120 ah
okay so you're loading in two vectors
and it's giving you the
multiplies of all of them oh this is
cute
can someone just rip off the google tpu
and build an exact copy of this
i don't like vliws
get rid of that
hmm
all right they're using brain float
don't do this
so
uh
um where is here
what no i've seen
all around zero point i don't know
i saw something else on this that was
pretty good but whatever
of the five training startups
samba nova oh did someone email me and
tell me about this and i thought yeah
okay
oh the habana gaudy
none of the five training startup has
supported training accuracy or time to
solutions
habana got bought by intel so we know
that that's not going anywhere
can i buy one of these
products
okay well i wanted the white paper but
it disappeared
quality training platform
thanks for telling me about your resnet
50 performance yes everyone cares deeply
about resnet50
can i buy one why do none of these
companies want to sell a fucking chip
all right buy
um oh
sign up to receive amazon.com
havana
why
look at the top one yeah the only ai
accelerator card you can buy
that's a lot of money for 2060.
i'll look at chat again if the uh you
know
oh i don't know there's a tpu v4
wow there's tpuv4s
oh they put
four chips four cores per chip tpu v3
one exa flop
why doesn't google sell the chips you
know that's this really that's really
what this comes down to
they made an inference one too
here we go training
wait
it's just kind of interesting how i
don't know nvidia's getting fast once
too wow
all the fast ones are with mxnet
i don't realize mx not like still
existed
tpuv force
oh paper just came out yesterday on the
tpu before cool
does the i stand for inference or
industrial
oh inference only
why is it inference only
triple strided tensor dma
oh triple strided
they did oh see i knew it was all about
strided man
look we had double strided but google
knows what's up i was just thinking
about triple striding you know because
you could do the convolutions with the
triple stride
tensor dma engines
what's an encore oh i like this oh man
google already solved all the problems i
just want to buy this
all right we'll update the blog post
can the government force google to sell
tpus
arbitrary steps for stride and positive
negative stride distances in each
dimension
oh but this is just for the dma
what's see man
yeah i watched the jim keller uh
interview
i don't know i i think the tense torrent
is
they're focused on weird stuff like
they're talking about things like
every ai startup that talks about
sparsity
like yes i understand why hardware
people like sparsity but
there's no good research on this and
there's also like weird stuff that's
just like not
what normal people are training for uh
for networks
c map
increased on chip storage the first
concern of a dsa what's a dsa
domain specific architecture
why can't it be used for training what's
the difference
training needs large scale
oh
so it's just that
has anyone just ripped this off yet can
somebody just
oh it's seven nanometer two can somebody
just rip this off please
oh cool
this was yesterday
you bet they have the tpu v5 on on five
nanometer i mean yeah that's possible
um
there's still the push to software issue
i mean yeah the thing about the push
look
oh my god
performance per tco versus per
cap x
why inference can need floating point
like how come none of the other startups
are on this list i could be on this list
next list
the only thing available is in video
oh no i can download it but
i'm just i'm just looking i i'm not even
really sure
like
pico jewels per operation
do the packaging innovations
hmm
fortunes of an architecture have been
bound indeed compiler problems likely
sync the titanium
yet many dsas record rely on vriws
this is yeah this is the problem
can we can we get google's xla compiler
there's an xla to connect with cloud
tpus
just go all the way down to the
instruction set or does this just go to
xla
and then i feed it to some like secret
google service somewhere
provide the direct access to the tvu
host
tpu vms
they require an extra vm tpu vms oh
yeah but it's not about hiring smart
compiler people
right
it's it's about building an architecture
that where the architecture itself is
good and you didn't just hack around it
with your you know fancy software
right like it's building things that are
actually powerful not like no
we carefully laid the things out like
this yeah but then like some new
architecture comes along and like
yours is annoying to write for
um versus if you design something that's
like generic and powerful
like think about chips that you can just
make and scale
and you know the chips are going to be
good and when you want to do something
new on them it's like oh i can just
write like a program to do it i mean
these are
modern computer chips
you know if you ask the same question
twice i saw your question
what's a hardware instruction like
there's so much you don't know
and like i don't even know how to start
answering that question
it's not that they're not good compiler
architects they
are good compiler architects but
the the problem is
like if you have to put all this
complexity in the compiler
in order to make your hardware fast it
isn't actually good
and this is a lesson over and over again
in in like
computer architecture that people just
don't seem to learn
we're not using look at the m1 right
what are people doing on the m1
they're running chrome right why are
there no dsls for chrome
why did nobody make a vliw instruction
set that includes
you know things and look if we carefully
compile the webkit code and like it's
the same thing
we don't do that for obvious reasons
even though most of the time on all the
m1s in the world is spent running web
browsers
it's still doing all of that fancy
um you know out of order or instruction
execution
you're like but oh you could just
compile it better well yes you could
but this doesn't happen in practice
right like occasionally what you'll get
is okay for example
um intel has something called mkl and
intel can speed up matrix multiplies i
don't believe
numpy by default is compiled with mkl
so you have literally billions of intel
cpus out there
and they're not running into mkl they're
running uh
you know the the the whatever numpy crap
bloss
translated from seven fortrans you don't
you don't make it better
by improving the compiler you make it
better by improving the hardware
uh and okay you can say that oh well but
neural networks are different right
and then really ask why neural networks
are different well people think neural
networks are different because
they um
we have these like libraries like like
like tensorflow and pytorch to use them
right
um but when google understands why
tensorflow sucks and why pi torch is
good
you'll also understand why vliw
instructions and custom compilers are
bad
right like tensorflow is this custom
compiler tensorflow is this custom
compiler that's going to globally
optimize
your ml networks pi torch looks a lot
like tiny grad
pie torch wins
look at something like snead right like
sneed
look at the need on on the qualcomm
right like that's the kind of stuff you
want to do
right like okay that's a jit basically
like jits are great
static analysis is bad and it always
will be
right so if these people are building
jets fine but they're not building jets
they're building compilers
well you really want to put your jit
right in the hardware
it's all done what is your cpu running
when it's doing all that out of order
shit it's a jet right it's legit to go
to your micro-ops
doesn't even cash who cares
this change meant it could take months
of extra development to restore the
quality score using integers that
experts achieved in floating point
during training
yeah like why don't you just put the
floating points in oh don't
you have to understand the integer if we
do it update multiplier
there's this many less pico joules of
energy yeah but developers hate you
i don't know
you think about the mill cpu yeah i've
like heard about the mill cpu and again
it doesn't exist
low power statically scheduled hardware
no
bad idea dynamically scheduled high
power
good
informed memory management harvard oh
god my compiler needs to inform it of
what memory it's going to add
to us you can't do this
ah you know i really i really don't want
to make a chip i really don't want to do
this i'm not actually going to start
this company you know
like you just think about how much you
actually have to do it's so much and
like i just
my hope is that this will convince
the other companies to stop doing this
bullshit and they all do the same
bullshit it's as bad as self-driving
cars
hey look i'm an old man you think i'm
going to start a company
just like two things one i don't care
how shitty your chip is first off make
it available for sale
and then second off build chips and
aren't shitty right if you don't do the
first one though all is lost right like
like google's cpu might actually be
great i don't know i don't know anything
about it right
use a shared library called lib tpu
oh lib tpu download
lib tpu dot hmm
um oh well this is a special google one
thank you
where
that's not tpu code is it
this is like xla code
see a little last demo slides
no this is this is this is a zelvium
and that's uh intel
now we have to get lib tpu i wonder if
we can download lib tpu from somewhere
so my understanding is you can get the
edge tpu one but the edge tp1 is
completely unrelated to the other gpu
you know with all our new knowledge that
we could probably go back and we could
probably understand the apple neural
engine a lot better
we could really understand what they
built
this is the book on computer
architecture
[Laughter]
microsoft word in 30 minutes
yeah oh
this just sucks like why doesn't one of
these companies build a good chip and
make it available for sale
you know i'll add tiny grad support if
you make a
i don't really want to make hardware it
just sounds so
painful you know what apologies you do
it slightly wrong
you know you like writing some bug and
then you're gonna have to all your tape
outs bad
sounds so stressful making circuit
boards a comma stressful enough
no i don't want fucking cloud tpu i'm
giving my shit to google i hate google
i will pay them double what it cost them
to make the chips
quadruple even i'll pay them quadruple
i hate these i did you ever read i think
they changed it but the original
license agreement to google cloud said
that you're not allowed to use it for
like self-driving cars
because it competes with google you
couldn't use
your the ml stuff to train any services
that could compete with google
what a joke you know it's also why
google will never
succeed at cloud nobody uses google
cloud we use azure
a bunch of people use aws because
microsoft and amazon
understand that they can't take all the
value right microsoft and
amazon you know like they both
understand they both have like
customers and they understand that they
can't take all the value google takes
all the value in advertising
and google just like they you know they
think they can treat their customers
like that and they think they do that
with cloud too and like
you can't and that's why they'll never
succeed at cloud
a two port no i need i need 102 for port
sram can i buy 1024 port sram
i'm not gonna i can't make hardware you
know
oh google took
there's no obvious explicit demand i
will buy it a lot of people will buy it
but yeah i think that this i don't think
that you can actually get
that uses the xla deep learning compiler
oh god
all right let's understand how google's
memory works
four dimensional tensor dna that's great
triple stride
now well this is actually really easy to
write in a dma engine
i want the strides to apply instantly to
my hyper fast
sram
they're doing 512 bits so i wanted my
memory exercise to be 19
but okay what we might have to do is
force the stride size to be one on one
of the dimensions
which sucks but then like we get rid of
that squared factor
and then it all becomes like okay
instead of asking for a one or two four
port s ram we're asking for 32 port sram
and that's much more doable
yeah i mean everyone complains about
this right and like no one just does it
right and is common not proof
like it's because these companies it's
the same reason that there's no
self-driving cars right
you you get one company that like
happens to do it like tesla and then
there's like oh it's like and it wasn't
that hard
like comment and open pilot weren't that
hard it it really does show that
it's not a there's a serious cultural
dysfunction
in all of these companies um there
nobody should ever listen to investors
uh
you know because investors are not
aligned with value creation
investors do not want you to do anything
because if you do
something people might evaluate it if
you don't do anything
you can hype it up and dump the bags for
more money
right so i think that that might be the
problem with all these ai chip companies
right
what do you do if you've raised 600
million dollars
where do you go from there
it's the same problem i don't know i
don't think i have the patience to do it
again
you know i i really don't want to start
the company
like i've been talking with this guy i
want him to start the company it's
apparent he's not going to start a
company
um you know because
there's no issue like you can just do
this but you have to do it
and like self-driving cars i had this
advantage where
it was very clear to me that everyone
was a complete moron
um like that whole space is full of
actual complete morons
these people aren't morons like these
people
are a little misguided
but my main problem is not like i would
just love some tpuv4s
i could probably write something good
that uses them uh if they like stuck one
on a pcie card
like i could i could use these these
things and make them work with tiny grad
and make them work
pie torch without going through seven
layers of transpilation
um if i can reverse engineer the apple
neural engine you know
because the rest are the rest they're
easier
um you know it's not like like grox easy
to make fun of for their vliw
the tpu
the tpu has much more sane vliw
instructions
yeah 322 bit does that divide by eight
no it doesn't
uh so you know you you when you compare
the um
like the google
the grok instructions are 57 times
larger than the google tpu instruction
322 is not too insane
but we'll change it to
it may look okay
we'll change it to okay
um so yes
it is enough performance so k beckman
yeah um
you're right about the b rams and so i'm
actually i'm synthesizing that
and i have this is this is a b ram up
here
um look we can prototype this
we can we can make this all work um the
problem is this little mux
uh to to build this this fully mux thing
this one we can build fully mux because
it's small i'm wondering if we can build
the final one fully moxed but uh
yeah probably
uh we got to put subscriber only mode
back on we got some dumb shit
what i need to learn a pile of ee stuff
let's go bro let's go wait no turn it
off turn it off fargio let's go what
don't i know let's go
explain to me what i don't know
we'll give we'll give them a minute
we'll give them a minute they'll put
subscriber only
mode back on so that the like i'm a
moron and i thought everyone else was
morons but i guess they're not
or the just use homomorphic encryption
you know
okay what so signal integrity meta
stability transmission lines propagation
delays
yo i'm not trying to write eda tools man
like there's tools that will do all of
this for you there's tools that will do
all this layout you have to pay
attention to a few things that are
difficult
but like
what do you mean you can't just shove in
a uh
you know 600 megahertz clock i do the
tool the tool tells me what my
propagation delays are here i'll show
you
right and like there's these same tools
that you basically use to synthesize for
fpgas that also work for
uh all right so here we go compiled
right so this is going to compile and
actually
run it in the fpga and if you can run it
in the fpga
you can run it in an asic you know what
is an fpga it's just an asic i can rip
out all the configuration shit if i
really wanted to right so like if you
make it work in an fpga
at a certain clock speed you made it
work in hardware right so like you tell
me oh you can't take software style
approaches to this
yeah i fucking can right like watch i'm
doing it right like we out here all
right
let's go back to uh let's go back to
subscriber
only mode um uh
how do you learn vim
you don't you use notepad
i don't think most chips are auto laid
out at large scale so what they have is
macros for a lot of it
like for like your srams you're gonna
have macros
uh i don't know i mean yeah you can you
can auto route it
the same reason you don't auto wrap pcbs
but there's turnkey companies that i can
just send it to and they'll do the
layout for me
i'm really not worried about layout
uh so no i mean yes there are there are
hardware considerations but like really
verilog is a programming language it's
not
you can think of it the same way you
just have to like you know you guys have
a code in prologue man like i coded a
prologue once
um
can i buy a huawei ascends or the
chinese man
maybe maybe you know maybe maybe our
culture and society are too fucked to
build anything anymore
and maybe i can buy huawei sun 910s
please please we'll try to sell this
thing
fp16 though
that's the other problem with all these
chips they have like fp16 which isn't
good
the only chip that does this right is
nvidia's
look it's routing my chip right now i'm
not thrilled that that got slower
all right all right so are there ways to
like view
i kind of want to like view where all my
luts are and shit
intel computer yeah
so yeah we have i did the math on how
much bandwidth we actually have and
there's enough bandwidth
um this mux is annoying and i have no
idea if i can actually build this box at
scale
i don't know maybe i can
i can open the netlist verilog in vivado
well i don't have vivado
i haven't actually got anything to route
since 9 45 this morning
this is unrouted
whoa that's so cool it shows me like
what
how trivial is 12 nanometer
manufacturing i hear it's pretty turnkey
now
let's take a look at our
so that's synthesize um view
output of yoses
so cool
systolic array what does that mean
oh yeah god this looks awful
yeah yeah i i saw this how google was
doing like the shifts and stuff yeah
exactly like this is what i mean these
things are impossible to program for
nobody built like a same programming
model because i've already written the
programming model
i started with the programming model and
now i'm upset that i can't get my sram
to fully drive but like you know i think
we can make the s rams fully stride
um
wow routing's taking a long time oh
we're up to thousand two frames
rounding's finished
um big file okay um
view yos json output i already googled
that i feel like i did
yo sis js
ah draw an svg schematic from a netlist
oh my god i can tell already that it's
gonna be huge
wow what does phasm two frames do
all right
net list svg out of sock json
um temp dot jump dot
all right whatever phasm two frames is
doing it's using big cpu
maybe why is it making my computer all
finished oh we routed it
okay well that's great
didn't work maybe routed
no useless
changes a bit which broke
oh
i have to use the compatient option of
the right json
companion no good oh we have to write oh
just write json compatible
ah
how we learn on this stream like we
learn together about like what these
tools actually are
we've learned so much about fpgas
you can use the dot command in yoasus to
plot a graph but it'll be huge
yeah great
i mean i feel like this svg is going to
be huge too
[Music]
oh what's that next printer has a
graphical user interface
oh i feel like i didn't compile that
though
found an out of range parameter well
that's great it works with netlist
svg it doesn't work with an atlas svg
this is terrible
okay apparently next pinter i can do
has a gui
but i feel like i didn't build the gui
and i feel like this was a while ago and
it's going to be hopeless to try to
bring this stuff back fun fpga
next spinners islands next pinners
islands
wow
oh i can set the target frequency
i said 12 megahertz by default that's
shitty
yeah but i definitely built this without
the uh
build gui the gui
you guys saw the last
how do i get the gooey
cement cache let's take a look oh build
gui no
build python integration no
oh yeah i must have done a lot of this
stuff i doc do i document this anywhere
probably not
tiny bad fpga maybe i documented a
little
here we go oh perfect
all right who thinks we can get the gui
to build
boost no boost
complains about boost too so maybe it's
fine
okay never mind it does nothing
no boost
maybe there's cool upgrades
i could not find python lips
okay
hmm you don't have qt5 now
found boost
this has always been
qt5 dir do i have qt5
i do
try dqt5 dir okay
all right now we have a problem of no
boost python
oh this is some yoasus crap
brew install boost python 3.
think it's gonna work
hey i fixed qt5 now it's boost i need
boost
i don't know this is kind of a tangent
there's got to be some other way should
we just write our own visualizer for
these jsons i think we'll learn more
doing that
alright well this is working anyway so
let's go
we'll add that to tinycreditpga if it
works
if you only want to know which slices
are used yeah i want to know a little
bit more
um than that i want to just see like how
these multiplexers are being laid out
and if they're being laid out stupidly
or not
so cool that all this stuff's open
source
um we could also try yeah manually
looking and seeing
uh well let's security build us so the
problems later
oh no
all that it didn't work
it failed to link to python
you know what stuff's here we just need
to link to it
can i say something oh i just was just
running make right
um can i say something like c flags
equals
dash l python free time
no
no i don't think that's the problem i
mean the gui might not work
but that's certainly not what's
happening here
this is just it's not linking
will i hire people for cherry computer
yeah maybe
i told you how to get hired
remember if you're only doing it for
just like you know if you're not
it's gonna be more extreme than comma in
that fact like this is not
bonnie once talked about this he's like
don't do this because you love it man
you know people who are like well i'm
going to send my resume to 10 companies
and look for a job like oh
you're working you know cherry like this
who wants to work with people like that
you know
it's like we're trying to like build
something cool
this is a lot of you know it's just like
i don't want to start the company right
it's so much effort and it's so painful
to like
you know you get like an email hello
hiring manager
you're like george well you know you can
hire people to deal with that for you
yeah you see the problem
if you're a little slow the problem is
you got to hire those people
right and you got to manage them it's
the same it's the same thing right
i don't care if people are fucking
obedient like you got through school man
oh my god that's why i like school
teaches all the wrong stuff
the integrated show command of yo sis
is this the dot
all right well
let's try that okay we can try this
let's see
um
can i read json
we json is gonna work
okay cool uh
high level no no this isn't what i want
how do i do show
show oh oh i need x dot
okay cool i just need x dot
um through install xl
i'm gonna need all of xorg then actually
just anything that loads a dot should
work
this should be a file called jose show
right
that's a big dot file
x dot no bottle available
i also want to show after you mean after
routing
no i that's already after synth uh show
no no not a dot file uh graph dot file
x dot brew install graphics
and then i have dot i do have dot okay
good
okay dot yoshi dot dot
t ping
oh yeah oh this is going to take it's
going to take seven years let's go
i should have a formula for x dot and
brew i do
i have to build it from source we can
try it
gucci game
every time i see ghcr.io i think i'm
installing some haskell crap
it worked fine every time without a
crash
oh
yeah this isn't really working now is it
i just want to look at this in python
like load this json great we're
upgrading ffmpeg um
we running the router i killed the
router didn't i
did i kill her hour i forgot
oh my god my computer's getting slow
slow
slow it's going slow it's going slow
why is it slow all right we're gonna
control see that
how many chromes do i have open this
computer needs more ram
bee brain flops yeah yeah yeah yeah who
remembers that
all right too many chromes gotta kill
some chromes
that didn't fit it oh my god okay
wait do we have x dot now no but we
upgraded ffmpeg great
i don't know we might have x though okay
let's just try again show
oh now it's running in the background oh
that's great gotta love these hardware
people
yes secretly use my cpu and don't tell
me about it that's exactly what i want
all right let's just write some python
called viz not this business
is that's right all right open
dot dot slash
uh oh no it's like running dot in the
background i don't like this
kill all dot no more dot
oh dot was upset that i killed it and it
showed up over there
it's like it said it came up with a
thing and it said okay
and it's like i understand you're
killing me because up there we go great
hi nice inline import
json uh json dot
loads node
open
um out
how to sock json
i don't even know like what is this
well there's no zero in there is it a
dictionary
okay we have creator and modules am i
creator
i'm not creator joseph's is creator good
point
all right let's look at all our modules
we have a lot of good modules in here
what's it abc 9
oh i didn't know xilinx came with bolts
we have a malt
oh it's an embedded multiplier block
cool good thing i didn't use the dsp
blocks those apparently don't work
um
okay let's go through the modules
and let's print
okay for now okay so these are all the
modules
there are lots oh look i love luts man
all right how about lut sixes well you
know let's look at the b rams i know i
have b rams
it's this one
attributes
ports cells net names
okay do we want to look at the routed
one maybe i want to look at the rounded
one
because if we don't look well no i
shouldn't need the routered one
um
okay a b p
i'm not using any o circuses am i oh my
but they still have stuff
sells extra looks kind of cool you know
let's look at it
this is like the gcc of
created by cells extra for xylene's
models
okay who actually knows how to look at
these things
i have an idea let's print
length wrapper dat modules of keys let's
see where actually all this like 30 megs
of json is
no not oops i forgot okay
stop
okay
hbm i definitely don't have an hbm
you mean like rams hpm
top oh there's a lot of stuff in top
hmm my routing done yet
yeah ready's done
look at the routed one i don't know if
it's different
oh it only has top okay maybe it got rid
of all the other crap
all right well that kind of makes sense
oh does anyone remember how to build the
chip dvd binary it's i documented it
uh it's in the tiny goodie though
i don't know if you've been editing that
do i have another window
all right here we go
tell me is the gui nice
because we're trying to get this gui
working or should we keep playing with
our own
oh that was a mistake
okay
hmm
cells
oh cool
oh so these are all the things
fpgas are so cool man
all right let's figure out where those
luts actually are uh
break
oh maybe just okay actually
yeah okay
i'm trying to figure out what's using
all my luts
okay so tc dot why don't i name things
better risk stride
y abc ops
reintegrate
iger these are stupid names
what's eiger it's part of yosus
this is before it's rabbit this is kind
of nice
tcri oh okay so ri
is is the things that i'm playing with
all right we should give them slightly
better names so they stopped showing up
stupidly
i'm gonna have to wait for it to
resynthesize
so in my cpu i called rri is the
is the uh the risk engine risk with a k
we need to give this a better name it's
a pretty stupid name
um
but yeah r r is what i call the ram
well we gave all these things stupid
names r
all right the regs are the regs in the
in the risk so this is
this is my implementation of the risk
accelerator
we need to give it a better name we'll
just call it cherry called the cherry
instructions
i'll do all that renaming off stream
because it's kind of boring to rename
things on stream
but yeah we'll call this the cherry you
got to put a cherry
in your risk
all right what's an fdre
hmm
yo as i like says great documentation
i love xylics these guys are bros xilinx
bros
it's a d flip-flop with clock enable and
synchronous reset
just want to learn about luts they have
lots in here
oh cool man we can build our own fpga
out of this
yo we can build an actual fpga simulator
that operates on the routed thing i
don't know if anyone's ever done that
sounds kind of fun
advanced mix mode clock manager look at
this stuff
all right do i use any multiplexers
kind of sucks that they don't have good
names
well not either
what is the idea
write the current design to an agrofile
that's great
something's wasting all my luck stupidly
though
gen block 2.
oh gen block 2 from generate i see
yeah it's all these ideas that are bad
though
they do show you so here we can go to
where i routed it we can take a look at
uh
yeah it shows me the usage so we're at
usage of the fpga um
and like i just i don't know if that's
good or that's bad
i know i got it down by and this is this
is my simulator for the memory
you just do eye paralog but instead of
this you run risk test bench
and that's like simulating a load from
the memory these are all the computed
addresses
like i just wish i knew which lots were
attributed to which line is really what
i want to know
because we have all these lots and i
want to know like which code i wrote
that like
it ends up turning into lots of crap
maybe christopher parent
a source oh that's pretty cool
type no not type sorry
parameters source
parameters
where's that oh it's an attribute it's
not a parameter obviously
that makes a lot more sense actually
does kind of make sense i should make
fun of it
okay well nut map
oh are all the sources just lump map
oh that's lame
no this one's top risk cpu arithmapp
an eric map
whoa
do you use loops in your code i do use
up loops in my code yeah
yeah but i need loops i
i'm i'm most upset about the loops as
you but i'll show you where my stupid
loops are
right so it's actually even worse in
loops i have nested loops
so like here i have this loop nested
inside this loop
this whole thing is a priority encoder
and then this is a multiplexer
i wrote the multiplexer by hand instead
of using a loop
but you know it's n squared i know
i know and like it might already be
efficient and i might just be chasing
non-real gains
but that doesn't mean i'm not you know
very upset about how much of the fpga it
uses
to do muxes i mean i guess this is like
a fundamental like there's just no way
to do this better
here we go all those lots come from line
88 what's on line 88
oh the adders compare
all right well that's kind of nice
uh
okay uh what makes for a better stream i
mean you guys can watch me struggle with
this for a while
but let's look at what other people are
doing for their memory
we still didn't get to the bottom of
what google's doing but google
needs a lot less memory bandwidth than i
do because they're only loading the
outside of the array and not the inside
of the array
they look okay i like that they look
okay
architectural memories are
vpu and vm
seamen
how do i load from the v-map
this is the problem you start adding all
these memories and then you spend all
your time figuring out how to
change between your memories
all right can we turn off subscribers
only and
can you all be on uh be on topic and if
we want to be off topic then uh
you know leave
the branch predictor bro it's verilog
i don't even know if you're trolling
how can i be on topic if i don't even
know what the topic is you cannot say
anything until you figure it out
new here what are you building
this is a problem you know when we have
like 300 person streams
um it works much better it's when we get
these like
like 750 people that it gets really bad
no i know it doesn't matter the percent
but
i don't want to use a lot of my fpga and
if i'm using a lot of my fpga
it means i'm not uh
you know building efficient stuff it
means i'm going to have to use a lot of
transistors
there there might just not be a way to
make this more efficient
fundamentally what i'm asking to do is i
have like a thousand rams and a thousand
registers
and i want to you know be able to draw
any line
between them um the problem of course
with drawing any line between them is
there's a million possible lines you
know by part of that graph there right
that's a million edges and a fully
connected bipartite graph
with two sides of uh
um
going all the way through to the foundry
yeah tell me that you love me is the
reason it's sub only mode again you're
right
um
the tools make loads of optimizations
yeah you know i understand that i mean
i have found by the way i've written
this code like a bunch of different ways
and you get you get huge different
amounts of uh
it's really just that i don't want to be
asking the tools for the wrong thing
like here i'm technically asking the
tools the wrong thing so this
has to be a priority encoder but for
this i can just use the same sort of
multiplexer i'm using down here
um like this multiplexer saved me three
percent of my fpga
switching to switching to this from that
save three percent of my fpga
yeah and the router gets more and more
suboptimal i mean the router just takes
longer and i'm really impatient when i'm
compiling these things
this was this this was a cool thing that
i read earlier
but i mean i think the better question
is like do we really need the fully
strided memory
if we only needed to stride
on the other array it's
much easier
it is pretty much an explicit mux though
and it's really big
um for these ones i'm intentionally
using equals because look what i'm doing
i'm using this for loop to build up
basically a big or
of all of these outs masked by l mask
no i i just think that like
fundamentally
what i'm asking for is going to require
millions of transistors
and then there's a question of is that
really what you need
because we went only 32 wide instead of
one or two four wide like look at all
those transistors we saved
so how about the huawei ascend do we
have any more information on this
what are they using or should we dive
into nvidia's memory model
know video has published okay nvidia
tenser cores
assembly
actually someone linked to a good thing
uh
tensor cores are very fast so fast in
fact that they're idle most of the time
waiting for memory to arrive from
global memory for example during large
training which uses huge matrices the
larger the better for tens of course
we'll add that to the blog post
and for other gpu attributes shared
memory l1 cache and the amount of
registers you to all
related
exploit the memory hierarchy of a gpu
faster the memory is the smaller it is
such
um
tile size
for matrix a we have 33
for b we have that many
oh yeah you guys know about 128 and why
that's true
okay well so my register size is for 32
by 32 by 19.
or actually let's just say they're
they're one yeah
in the past nvidia sneaked unannounced
performance degradations into the gpus
so here's a whole other project here's a
whole other project if you and like
apparently it's really hard to do
but if you could do it why doesn't
someone just write uh
open source like so so novo did it
but um
write a write an open source cuda driver
for nvidia
like how much are they really nerfing
these gpus
this doesn't fix really the problem with
chip availability though but i mean the
chips are kind of available
i don't know
at least at least you're you're more
open source
doesn't it break the terms of service to
write a new driver no
um i could definitely write my own
driver for nvidia
breaking the memory wall for an ai chip
with a new dimension
near memory computing architecture
what's near memory
i can't believe i'm even going to pirate
your paper
you guys don't know about scihub sciab's
great
yeah i know i know there's keys and the
keys don't let you set the clock right
yeah i read about this like
we choose to use dram over sram
the dram units are pooled together
for feature data is broadcast to all
vector processing units each vpu
computes and generates output channels
independently from other course
the results are sent back to a central
memory pool then vpu performs all the
operations necessary
i mean that is this is not this is an
interesting idea
right if you really wanted to build a
chip
that would blow everything out of the
water get your onboard s-ramp
if you could figure out how to get your
drams to look like srams
like what if the only sram on the chip
was
actually the registers
and you have a whole bunch of registers
but they're all registers
i ditch this 20 meg sram if i'm already
building this
super complicated multiplexer why not
build it in front of the d-ring
all right so how many how many dram yeah
i mean this kind of thing
when can you buy it i'm not really
starting another company you know my
advice don't start a company
but yeah what if you didn't use any sram
uh okay let's look at the dram interface
on a gpu
nvidia chips
there's like one wikipedia page i always
go to for this
this one
all right so the bus width is 384 bits
it's actually not that many bits
i won't even feed one of my uh
what's a 6ts ram what's a 6ts ram
what's a 6t
this is just like a normal sram
we don't have wide enough buses so like
my bus width on the
uh
so if we're if we're using the hang of
my python
simulator for this so if we're using
this
we have 20 48 b
rams each with 18 bit our bus width
is two orders of magnitude higher than
nvidia's
and that's the problem
all right like that's our sram bus with
which is insane
but the only reason they're capable of
getting any bandwidth out of these
things is because it's like
gddr6 which is like oh we sent four
you know things per
potential solution what do we got
no no
anybody who's trying to do ai research
in par at the same time you're doing
computer architecture is seriously
making a mistake right
you see these you see a whole bunch of
these um
of these startups doing it they're like
oh sparsity's gonna be the new thing
oh you're having in-short algorithms
this was the the
the tensor video and like don't why are
you doing research
why don't you just beat nlperf
how much tensor compute these things
have
so much so much huge sensor compute
if you can use it
yeah so the bus widths are too small
like i want to bust with like that
guys on top
on topic or we go back subscriber only
and if it's one person off topic is
banned
no don't cry oh my god binarize nets
like
okay the reason
the goal of good hardware is to make the
software people happy and like the
hardware
and then the software people will pay
you back tenfold with great software
if you piss the software people off and
force them to write things like
you know net quantization and and
gradient scaling and then the software
people will hate you and not write good
things for your hardware
i don't know does anyone know if this
multiplexer is like
am i just because fundamentally i need
this multiplexer
if i want to support any stride
if i don't want to support any stride i
can divide that by 32.
all right subscriber only
sorry the guy about startup culture is
the reason we went subscriber only
yeah i don't think we need 6t i think
normal normal srams are fine it's just
like
is this too big of a switching bus
let's understand caches because this
really looks like
cash associativity
this is a four-way associative cache and
that's the mux
that's a lot of comparators
yeah see they're talking about like
eight to one multiplexers nobody's
talking about
1024 to one multiplexers
no i'm not actually specifying a mux
explicitly i'm doing a pretty minimal
thing
how can you help improve tiny grad or
you get some reporter across the tiny
guy
that's how you can start
set associative cash two or four frames
per line
because we have this big comparator we
didn't exactly use a comparator i used a
mask but it is that same comparator
oh
no that's not actually that
yeah what book you know what the book
suggestions we got
no index is needed
they're fully associated with cash for
enblock is an amway set associative cash
largest fully associative cash ever
built
okay the other thing that we could
consider is
we could make the whole
i'm not happy about this but if we got
rid of if we only made the stride
possible in one dimension
then like things become a lot easier we
have much wider b
rams
to get the same amount of memory that's
true right
oh i think we'd win both ways with that
all right i think what we could
effectively do is to get the same amount
of memory
we could use the full width b ram
uh the data still has to come from deer
anything because it's faster than
theorem can deliberately bond like that
yeah so the whole point of the way that
we're not gonna be bottlenecked by dram
is that matrices have n squared data
accesses but n
cubed compute
yeah i think that would actually really
god i like my stride though
i'm upset but we're gonna have to change
the uh i don't think you can make the
stride
zero strat is fine
x s is usually pretty small
so i'll just be able to ignore them
um
yeah this is fully striding things as a
pipe dream
all right then that means we need a
permute engine
this becomes less of a joy to program if
we get rid of my two strides
computing address is easy the drams
themself are easy
the problem is the thing that can mox
them
i mean maybe there's some way to be
clever
they can't end up anywhere is the
problem
because they end up anywhere you need
this this fully associative thing i
believe that we could get something
that's fully associative for 32
right because i mean even this little
fpga can synthesize something that's
16 by 32. uh so i think we'll be able to
synthesize something that's like 32 by
64 or something
but we're never going to be able to
synthesize something that's uh
you know and actually this would become
four by eight
if we switched it this is the book
by nvidia chief scientist
oh okay so here's i think maybe what we
should focus on then
and i think this is a good place i mean
there's a reason it's called the memory
struggle session
uh i think this might be a good place to
to to end the stream
um
unless there's something i am not
understanding about how you can build
this easily
there's going to be no way to do a full
fetch
uh across all of them
we're going to be able to have a permute
engine that can do a few cute
permutations
maybe we can figure out what the google
one can do
but my dream of a magical
fully associative thing
is uh
not gonna happen
so we'd read in like the whole uh
the whole the whole row
i will definitely check the book out you
guys don't want to just want to watch me
read on stream though do you
this looks good
yeah this looks really good actually
why is it a bad ratings
hmm
book packaging is bad i see i have an
idea that my pdf will be packaged pretty
well
oh my god i don't have a table of
contents i hate that
my book that i stole doesn't have a
table of contents and i'm upset about
this
it says draft edition oh yeah let's get
not draft edition
do
still no it was even worse someone like
scanned it
scanned the book
it is better formatted but
scrolling's not working well
yo we're live streaming crime
it can't be illegal to go on google and
click a link i didn't know it was
illegal i think google's liable
i live jen
i love libgen man
we're in a golden age for piracy
everybody we're in a golden age for
piracy
um draft edition first edition oh that's
a big pdf let's find the
small pdf
which is the good one
you say this is the good one
i think this is that same they're gonna
have it's gonna be scanned and stuff
get oh i love get
no i mean i own this book it's in the
other room know what you know what you
pay overpaid for your 30 90s
yeah i think this is going to be the
same
i should remember to use libgen more 28
where'd you find 28 what's 28
who would want to use vhdl oh they wrote
a vhdl edition of the book
i see why they write a vhdl edition
afterwards
it was kind of nice this is you're right
this is the best one oh this is way the
best one
thanks libgen
i mean it is a scanned copy of the book
but oh this is nice
all of europe uses vhdl why
sequential logic
system what's system level design
oh it's like understanding states and
stuff these are all cool ways to think
about things
yeah i know but i don't want vhdl i'd
rather scan the book that's in their log
so i can read it
the digital abstraction
i mean okay so there probably are like
better ways to build
uh
the thing that i want
memory systems memory
dram when we need a memory
larger or wider than we can build
with bit slicing we divide the
perimeters across bits
with banking they're derided across the
address space
yeah but look at all that bandwidth i'm
wasting
oh that's an interesting point though
i don't actually need oars i need
latches
i guess that's what i've built right is
that what this is
i tried to build this with that
did i check the xylene's documentation
which is this what
no i'm not using any of this
i didn't know xilinx had an ai engine
what's in there ai engine i mean this is
kind of cool
but
true load units what's a load unit
you better copy the book
yeah vhdl ugh out
um so like yeah they just like took all
these latches and like stuck them
together
i guess there's implied oars there oh no
that's not even an oil that's a
cat but that's an
or
yo vg is not good
i used to go to vhdl i switched to
verilog
the pdf quality means very hdl's better
that's funny um
in real memory systems
[Music]
forages with full associativity mm-hmm
yeah so see like i mean ideally you want
to put them together
in a grid like this where you
concatenate along the bits
yeah that's like really nice right like
think about it oh but
so if we made like each
if we made like each line
only have one b ram that could go to
each line okay
can i get a online paint
all right so basically we have a matrix
right
let's make it four by four
um those are tiny cells okay
so right now
i have this four by four matrix and the
code that i've actually written
over here um synthesizes
32 b rams right so i have 32 b rams
we'll just draw two b rams for for
reference over here
right now the problem is there's a way
for
every one of these b rams to get to
every single thing
so like there's a line here there's a
line here let's use a different color
for these lines
let's make these lines red alright
there's like a line here a line here
a line here a line here and as you can
see
by just watching for a little bit i'm
drawing a shit ton of lines right
because you know this vram also needs a
line to every single thing
right then someone's got to make all
these lines who's going to make all
these lines who's going to pay for all
these gatorades you know
um so guys i'm not here to argue over
which one's better i used vhdl in the
past i found it more confusing
i don't think it really matters doesn't
matter whether i wrote this in the vhdl
or verilog
it's still okay well it won't let me
undo anymore so we have to figure out
how to use the eraser in this thing is
this an eraser
that's not an eraser oh that's an eraser
it has an eraser shape okay good
all right good so if what we did instead
was only connected these things like the
blue ones to here
then we make more b rams it's like okay
so the red one can only go to these
right no that's not red
you see how many less lines we're
drawing it's almost so few lines that
i'm willing to draw all them by hand
almost right and then the b's the blues
can only go
here and the you know greens can go here
the problem is if you want to get a red
thing into a green thing you got to do a
lot of stupid software
right i mean this is like you know the
separate but equal approach right
it's like you know we put the yellows
here the greens here the blues here and
the reds here
and then i guess we could have like
internal we could have like like
internal matrix permutes which go like
this
now we got a write complicated software
to do shit like that
and that requires lots of instructions
you see the problem
um all right let's let the
non-subscribers talk a little and see if
they're going to pay attention
i drew a simple picture for you guys
i drew pictures
i'm very upset about this
too pinky
all right uh we can also make like the
you know the teal
which does the uh the matrix transpose
like that one goes here
like this one goes here you know they
swap right
so we can make like the teal path we
could make the
uh the the purple path
all right this all looks
a lot easier to write you know but then
we don't get fully strided it's a
twister strategy
all right we'll set we'll sell my art as
an nft to fonda
fun cherry
i was just so much happier drawing all
that because like imagine i had to draw
all the red lines to there like you can
just see why it's terrible
one of these days one of these days all
right so like yeah we have this like
matrix array
and i guess we could like write those
instructions
oh i mean that does seem more risk-like
don't you think
i mean this is all built yeah no the the
like the fully associative thing is
beautiful
use and blocks instead of the 4x4 block
with each end representing one square
and having four wires which represent
the incoming data
some kind of
i did implement a small unit i
implemented this but fully associative
and it used way too much of my fpga
all right you know what that's a that's
a good way that's a good thing to try
okay we know how much of the fpga this
uses
with the fully connected ones fully
connected ones use fourteen percent of
the fpga
all right let's do the non and then it
gets really bad when you wanna make it
bigger
like it's not that much of a problem yet
because 16 is actually a doable thing
[Music]
so let's just let's just quickly try
if we were to double this these would go
to 68.
um we would get rid of all the y
we would only have no actually get rid
of the x we'd only have stride
we'll just take one of these sizes out
of here
now actually count becomes way less
um i mean it's not this isn't that good
of an exercise because like
it's actually a better exercise than
saying like yeah
all right this is actually 67 right and
then this this this makes the b
rams like big b rams that just links up
that would make this 4x 18kb rams
instead
all right we get rid of stridex
we have this logic only for stride y
twitter doesn't work
oh google does have a tpu v5
oh this is scary guys you guys heard of
the singularity like this is the
singularity you know
when ai's using ai to generate a.i
scihab it's about as reliable as twitter
try zlip what's zelib i mean it's
compression but
doi not title and psyop
oh okay
what's zlib.org i've never heard of this
i love learning about new i love
learning about new websites to legally
access free material
what is this
deep learning the nature of space and
time
facebook.com what is this
i love z library
hmm
this one i'm sure there's just a way to
get
i heard about this too
not nature
oh it's in pubmed
i can search by the pm id
pmid
wow this is hard to pirate
open tweet go to person page
click the twitter link from nature
didn't work
oh crushed it lasagna
open access link
oh here we go link to the non-paywall
text great
craft placement pistol reinforcement
i'm gonna have this link to the blog
using
so
huh
i mean this is a cool idea
has anybody tried to write this in these
these fpga routers
like can we rewrite next point or xilinx
but using uh
using ml
read the last tweet in the thread of
yawn lacoon
i mean is it real it's probably real
oh yeah says it's a scam
i mean
it might be a scam for now but it won't
be long before it's not
right like think about what these
algorithms are
you'll do a much better job with
something i'm still waiting for that you
know really i'm just waiting for the
neurological stats offers
like is anyone doing neural network sat
solvers yet
these are all the same stuff
yeah like these papers are old and
they're not very good
um
because it really is just sat
oh we should add a little note about the
tpu v5 which i likely also won't be able
to buy
so sad is discrete yes and you probably
want the architecture to look something
similar to um
like uh like alphago right like you have
this search component
which shouldn't exist inside your neural
net but then you want to figure out like
which
of the parts of the tree to expand and
that you can do probably a good job with
your neural net
ah
if i don't get my strides then we have
to be more careful
than we have if i don't have strides we
have to be a lot more careful in the
software
if i only have one dimension of strides
we need at least one dimension
no strides are a scam i'm not didn't you
see my picture
all right so like this one h times w
where i'm loading in the channels
um
like that would just take in they'll
just take much longer to load
but we'd have to write our conv in a
different way
these ones have one in the stride so
they would be okay
zero in this drive would be okay there's
nothing we can do about xs in the stride
maybe mask
we probably would want to mask them
see a dark light bulb
okay
actually doesn't matter we're not even
we're doing mullax so it's not like it
matters
[Music]
um
one by unstrided one by one columns or
map malls
so they actually just tried one all
right we have to write we have to write
the backward pass
before we can say anything about whether
we really need these strides or not
all right somebody write the convolution
backward pass
in uh in risk i so like use these use
these risk eye operations in the
backward pass similar to how i did it
for the forward pass
and
then we'll see whether we really need
the strides or not
if we don't i
think that all the details of the chip
are figured out
we need a premier dungeon
cool what else we got
we have anything else to discuss
i think we've come to a sad truth on the
memory architecture and it's we're not
going to get this magical
uh thing that i want without spending a
lot of power on it
because yeah i mean yeah 1024 is insane
but things on the order of like
32 uh are more reasonable
oh pre-fetching
yeah i know about pre-fetching it's not
like
i mean we know everything
and now i get and this is why everybody
falls for this like
okay we're gonna build something that
like carefully maps out all the memory
accesses before we do them but
um
yeah count will get divided by size
you'll lose i mean count is effectively
size times size so it's size to the
fourth and it'll become size squared
great paper about use and ar chips
so
process and memory technology yeah
am i going to do internships for this
who's who's who's writing or who's doing
your government
you know that i have to pay your taxes
paper who's doing that
you want an internship it's free you got
a free internship right now go
contribute to tiny grad go write pull
requests
i'll show you we got to implement this
stuff in the instructions
add reduce ops to risk and fully support
forward pass yeah
unpaid internship congratulations it's
yours
you've got an unpaid internship right
now congratulations you're an intern for
cherry computer put it on your linkedin
but you gotta do uh you gotta submit
pull requests first
you submit pull requests you put on your
linkedin that you're an intern for
cherry computer
uh yeah there we go no you don't work
for me you work for
nature you work for github i'm not gonna
you know it's
what do you expect working for me is see
you get some people
who like wanna like ah come work at
comma for free and then you find out
that they don't actually want to work
they want to be educated and i think
that they misunderstand the way that
that works
because education is actually super
expensive
nope nope if you submit a pull request
for grammar
you'll you can't write that you're an
intern you'll have to write that you're
a uh
you're you're a you're a um low quality
technical writer
yes you can have that title
the only reason education's not
expensive in europe is because well
actually it is expensive you're just not
paying for it
if you want to educate yourself it's
free you want somebody else to educate
you did you
study cs timeout
it's free you only pay 50 of your salary
every year bro
that's true
if i don't get my fully strided memory
i'm less happy
yeah but i mean that actually this book
was great and like this picture shows
you why you can't do it right because
if you're trying to go fully strided
what you're doing
is you're taking all your srams and
you're stacking them in a big
line right and then what you don't see
is all these or gates that you then need
as well
yeah all right we're gonna have to start
looking at memory access patterns
fully stride it seems to be all really
complex for the perks yeah but then like
so what do i do about like this
well okay i could have the matmo
instruction taken a mask
so at least
no but it's a lot of circuitry in the
asic it is
you can't if you could build what i'm
asking for caches would be like
1024-way associative
you know i understand that ignore gate
is what's forcing us if that was sex but
still
i shouldn't put this here i should put
this in
add masks to matte model
that's actually really easy to do
so we can we can like mask things off
that we don't need
all right i think we understand also now
what we can build in hardware and what
we can't
that was my big question was around the
stride of memory
so i think the next one the next step in
all this stuff
with mask you want to implement stride
greater than one is mask stride equals
one yeah
of course we get less we don't get to
use all the compute
if we're if we're applying a mask
i know i know i'm pushing to software
i'm not happy about this
see why i'm so upset
that's we have to see like okay look
here's my deal about pushing to software
you're allowed to push the software but
you have to write all the software
before you make the hardware
um
like there's some things that maybe it's
less of a big deal
right so a lot of my strides are one a
lot of my x drives are one
no micro no no definitely no micro code
um
oh god no this has strides as well
i'm upset and i want my strides
the map balls don't have strides
can you rearrange the data and always
use stride equals one i mean that that's
kind of the thought
but you can't really do that
yeah the strides are to access the right
stuff
can i enable discussions easily
if i can enable it sure
all right a set of a out of discussions
is it live cool
now there's discussions
[Music]
no i want my fully strated chip we're
going to figure out how to make work
we don't want to push the software
otherwise i'm just the losers that i'm
making fun of these other people for
being
what's this memory access patterns
sequential access random access
strided loop tiling
well i think i am gonna write the fully
strided thing
like maybe we don't stop at two
i mean if we if we build this thing it's
going to take a lot of silicon so we've
got to get a lot of power out of it
you can do crazy things with okay so if
you have like 3-d strided stuff
take a look at the pie torch abstraction
for striding it's insane i know i tell
you striving is the key guys
like i'm not you know we're not going to
have another struggle session there's
not going to be an alu struggle session
the alu is easy
it's all australian that's hard it's all
memory
all these companies fail at memory
i mean yeah okay if we're going to
commit to this stridor
there's no reason it'll just be um it'll
just be 2d striving
i can implement 40s driving the address
generation is free
all right so we'll just have to we'll
just have to build a big box
big box
predefined strides
predefined strides don't help you as
much as you think they do
the biggest mux on the planet
do they have stuff in here about
multiplexers
we learned a lot from this diagram
no but it's like our fan outs really big
and fan in you know
because like fats and like that
there's a four input nand gate
can i make maybe it is only bad in fpgas
because okay really what these things
are just like
huge or gates
no no we're not up to the alu yet we're
still we're working on the load
instruction
16 to one box we need a
yes who loves car no mapping
why don't we use masking because
masking's slow
you're wasting a lot of your uh
your stuff
you waste a lot of your uh
so okay this is all the address
generation here
and like this address generation logic
can be extremely complex
so we can support a whole lot of access
patterns here in the hardware
that's almost somewhere you want to put
in like micro coding or something
um if you're going to spend all because
look at this i mean that's what this is
you know you just hide it with a for
loop but
uh
there's a topic it's only about how to
code multiplexers
it's on page 140
combined pre-decoder with yay yeah so
actually if you look
this see this logic here
it's like the same as this all right
like i wrote the same thing so mine is
bigger is 18 bits
a large binary select multiplexer is
constructed from a smaller tree of
binary select multiplexers
yeah the classic trade-off between
memory usage
rearrange copy data to prepare it for
the right stride
yeah there's a few different yeah yeah
tri-state and stuff
am i in a position to actually get a
chip built
you mean a position
yeah you send the hdl code they build
the chips for you i know
is that a troll
do i have a chance of getting funding
yeah i could have fucking funding
tomorrow
okay capital is free they print it
you call up your bro at the federal
reserve and you're like yo
can i have a couple million bucks and
they're like yeah it'll fall off the
truck tomorrow like i'm serious guys
i hate this i hate this you people like
well were
fucking slaves to bankers you know
you know you you just like no
the question is not do you have funding
to make a chip the question is do you
have a chip
i know i don't have a chip
cruz is spending five billion dollars to
build cruise origins
right they're not launching self-driving
robo taxis
they don't have any software that works
but they're getting five billion dollars
to build
a lot of those things
which are completely useless
wait light dark bulb didn't i ban you
i did ban you
um so yeah i mean like you know money's
a joke
uh the question is do you have a
self-driving car and the answer is for
crews well well no but they haven't you
know that
um
yeah i'm 15 and i just got offered a
position and jason calcanis's
accelerator we have barely only launched
and have almost no traction behind us so
he he hears
vc is way too easy now almost every
industry yeah like
the the problem is basically this
technology is largely stagnated
uh we haven't seen this was in the
hacker news thread if you look at the
difference in technology
between 2000 and 2010
uh there were huge differences right
2010 error technology was
was actually it looked a hell of a lot
like this versus 2000 and our technology
was like
i'll check out my pentium 3 bro um
[Music]
so technology stagnated for the last 10
years
and
there's reasons why and i can go and i
think to what the actual reasons are
but
like anybody who has an inkling of
anything that looks like
technology can get
tons of money just thrown at it because
money is very cheap
um the problem with this is you're
selecting for scammers right
the people giving out the money have no
way to evaluate whether any of the
technology is good
your friends can't raise one million
dollars for an ingenious startup i
promise it's not like what is it it's
not good
right like like if it's good it's so
easy to get money you also need to
like be the right well you need to
understand how to talk to
investors right um investors are the
type of people who like
if you go to an investor and you like
look to them for validation and you ask
them if that's a good idea they're not
gonna give you money
because they have no idea but if you
come to them and you're like look
you know this is going to do this and
this is going to do that you get money
george if capital is free why are some
people homeless i mean that's a good
question
think about it think about it think
about why
um
um so no the problem is not uh do you
have the money to make a chip
the problem the question is do you have
a chip to make
and the answer is no
or do you have a chip people will buy
yes
uh i mean text again for a few reasons
uh
like there are some fundamentals
about the space that have made it harder
but also
an entirely new group of people came to
tech after 2010
um the people from 2000 to 2010 at these
companies actually knew how to build
technology the people in charge
understood what building technology was
i don't really know where those people
went
but you go to a company in 2020 and you
get the cruise origin
you you it's it's it's it's morons
running the whole thing right like these
these nba people took over
and they don't understand anything about
technology so
you know they build
boeing in 2010 builds the 787.
boeing in 2020 builds a 737 max
i don't even think that they retired i
think that it's a lot of
you know people with my sort of attitude
but without my sort of like
sometimes i'll have conversations with
very smart people and they'll be like
george like
yeah okay i mean this is all true you
know
yeah they're just discouraged they're
like like they're not upset about it the
way i am
like they're just like okay i mean like
uh
kind of like a my life is nice
perspective so why do i care
and like yeah you know you can you can
have that mentality but
um no yeah
these companies like technology became
this thing that was ripe for
exploitation
and these total losers showed up and
they're not able
to build any new technology so that and
that's why technology stagnated
you don't get you get the will take it
from here
types and where'd you take it i mean you
took it and they didn't make a lot more
money there's a lot more money
going into tech in 2010 than there was
uh in 2020 than there was in 2010
um but there's no more
tech there's just more money
so you know i don't know i i don't know
that much about what's happening in
china
uh maybe the chinese don't have these
cultural problems
um but yeah you know i don't know what
happens i don't know what what fixes
this
oh the the academics are those
they don't even have money i can't
believe
i i can't believe what's happened to the
colleges in this country
you you have again
a group of people who don't understand
what knowledge is
uh are you the people running the
colleges do not understand the
scientific method they do not understand
the enlightenment
you know and you just you can't fix that
yeah no
admins took over it's unreal it is it is
yeah i'm doing a phd and i hate all this
diversity bs they keep pushing
you know like i'm not when it comes down
to like what diversity is i'm not
pro or anti-diversity but i i see that
the way people talk about
it is with zero rigor
right like i'm not even judging it from
a um
an ought perspective but just from an is
perspective
these people who talk about diversity
seemed
seem incredibly uninformed about it
they seem to know nothing about it
because
you know again it's not it doesn't have
anything to do with with
no i even mean like whatever diversity
they're talking about they don't have a
rational
mind uh there are so many internal
contradictions
in in what i've heard some of these
people say
and you know you can't they don't
respect rationality
you can't help people like that you can
just shoot them like i don't know what
you do
um i don't know i mean i think that the
only way to fix this really might be a
war
it's upsetting but the thing about war
is war has this interesting way of um
you know
the the people who built the bombs and
the guns that actually um
work win the war and the people who
didn't know well they lose the war right
and then the people who lose the warrior
their ideas don't really spread anymore
right
um
oh yeah so you don't the way that you
would do it is you'd build
multiple you'd have to you'd have to
like not exactly bootstrap it but you'd
build like
i mean you see my business plan right
like it's first you build a cheap chip
and then you build a more expensive chip
anyone who thinks that their first tape
out should be on the latest process and
be like a 50 million dollar chip is
just you know it's dumb look
guys if they ban you know i always say
this like if they ban me
[Laughter]
you know then then it's really uh um
i don't think so you know like you look
at the people who are banned and like
you know some of them they're just
trolls right like they're they're trolls
of a different type so like
were the platforms right to you know is
twitter right to ban donald trump
i mean you can see an argument for i
don't know twitter's in a tough position
or like it's it's not clear to me
exactly what you should or shouldn't do
there
um
but yeah you know look if they if they
ban like i'm looking
i'm a scientist but eventually if
society ever bans
actual rational thought yeah we're done
we're seriously done i'm moving out of
this country at that point i'm moving
out of
wherever man uh you know
there's gotta be somewhere there's gotta
be somewhere
where the where the stuff still exists
no i don't think twitch should actually
ban me
uh all right but you know
we're off topic again like i'm not
these you know oh my god
i was reading this thing from the
creator of the babylon bee
talking about how like google and
facebook are controlling the flow of
information
do you remember like 40 years ago if you
had some like message you wanted to get
out you'd like buy an
ad in the back of a magazine and say
like please mail
five dollars for my video tape to po box
with uh you know a self-addressed stamp
envelope
like that was the way you would spread
messages back in the day okay
i don't want to hear google and facebook
or controlling the flow of information
um no i don't mean to talk about
politics i do mean to talk about why
why technology has stagnated and i think
a lot of the problem is you you have
these companies who no longer need
minimal viable products
i think we can summarize it as capital
became too available
uh and the the capital becoming too
available
uh led to a different group of people in
technology who's optimizing for
something that is not better technology
um
well
the bubble will pop
yeah does anyone like to live through
economic downturns
i i think the bubble will pop and i
think it's gonna
suck
well like that's not even like is that
something to cheer for
you can see a much better clearer
picture of it happening in the gaming
industry you know it's interesting that
you say that
i played world i played in the world of
warcraft beta i loved world of warcraft
when it first came out
and we've never seen anything like that
because yeah i mean it turned out what
was profitable wasn't
like big fancy mmos cost a lot of money
to build and run
um it turns out you could build mobile
games that are free to play with micro
payments
and uh they you know get you the same
amount of money without any of the
investment
um so yeah you know those kind of people
the the people who build
the the addictive shit games need to be
shot
right i'm not actually saying go out and
shoot people it's a metaphor
um yeah i i mean
i don't know i i haven't i haven't
played a video game really in the last
10 years i play pokemon red
um
how could the availability of capital be
decreased well
capitalism is meritism when it's yeah
yeah this
the easy way to solve this is to
increase the speed of the clock
[Music]
oh
well
here's an idea
here's an idea
okay the reason it requires all this
stuff
ah oh boys i think i might have figured
it out
okay the reason it requires all this
stuff
is because i'm trying to do it on one
clock cycle
i don't think i have to do it in one
clock cycle
what if i just like okay let's let's let
let's go back to let's go back to our
paint
where's our paint there's a little
painting
where'd our painting go oh where's my
painting
did i just close my painting i think i
just closed my painting okay
paint online clicky
okay i should have taken clicky's
warning to save
all right so what if
let's go back to our 4x4 matrix
it's already going to take more than one
clock cycle and we have to accept that
but instead of trying to do the
demultiplexing all in
so imagine we just did four loads right
like okay so we have we have you know a
bunch of b rams
and my b rams really aren't all drawn
but okay so this one goes here
uh
yeah so we connect them
all
but if we accept that it's always going
to take a few clock cycles
and then we like jump through the array
so we need a demultiplexer so what are
we effectively doing
we're multiplexing down okay so instead
of having this huge
wide thing
instead of having this huge wide you
know
2 0 4 by 1024
it's squared so what if we instead made
it just like
2048 by 128.
and then we just like demultiplex it
eight times
i think that works
oh we don't want it square so we have
248 b
rams that we're multiplexing out to 128
registers
right well let's even say it's 64. right
so then we're left with and we do it
over 16 cycles and we demox it out 16.
all right so we're doing fetches and
like
yeah yeah i'm adding a time dimension
that's right what i'm doing that's
exactly what i'm doing
the fourth dimension
[Music]
well i think we'd be left with the same
crap though
i mean because then what i want to do is
of course like okay i can use 16 cycles
and it can demux that array but
then of course i want multiple ones of
these
i still feel like i i could have less
though
well it solves the issue by okay if i
have 64 here by 2048
like that's just a whole lot less um
the multiplexer i'm factorizing the
multiplexer
so i i'm rewriting 102 for
so 1024 equals
16 times 64.
i'm like all right so we have this whole
thing and then we like
dispatch that and save that as one thing
but i guess if i have 16 of these things
it's just the same
is it the same if i'm making 16
204 8 by
one or two four multiplexers
every clock cycle would do eight of them
and they would all like you know go out
to their
specific places and then it would like
latch in
let's make it 32
32 cycles who cares
so we're loading one array
yeah i'm making a big tpu style matrix
loaded by riskville yeah
um
so i load like one line i can load one
line anywhere
and we just like concat the lines
it feels like what i'm doing is
basically this right
so if it used to be 20 48 times 1024
now it's 2048 times 32 plus 32 times 32
which is tons smaller
of course
i'm not really worried about the clock
cycle as long as we can pipeline
everything
like the thing is i would want multiple
of these line decoders in order to make
it fast and then i'd end up
back with you know oh well how many line
decoders do i want well you know 2048 by
32 by 32
right so like we're back in we're back
in bullshit land
lower precision doesn't help
um
we we have the precision we want it's
not
no this doesn't really work
it's reminding me of just google where
i'm like then shifting in these little
things into the matrix
this is the memory layout for your risk
wait you
what
wow
do you have code
oh cool
okay um arbitrary precision you know i
take you a lot more seriously
if you are uh wow
this is cool
what do you mean by see sometimes we get
great people in my chat congratulations
you're a vip
wait this is you right you didn't just
link to someone else's project
unless i found out you linked to someone
else's project
all right uh
weight memory layout is very similar
feature map
wait remember we have input and output
channels
each mbu includes address generators
that can be programmed to implement a
series of nested loops
and you can do all these loads in
parallel
no i don't care if it's low precision
right like the precision is all just
like like in parallel um
i don't know what precision you're using
but i
i think the precision should be uh well
i definitely want to keep the exponent
eight bits
right um so like like bf16 keeps the
exponent eight bits the problem with
fp16 is it only makes the exponent five
bits
so i want to keep it an 8-bit exponent
i'm not sure how much actual precision i
need in the mantissa
um so i was thinking i would use uh i
would use nine bits and then one for the
sign so i could fit it in the 18-bit
block ramps
but i'm more interested in what you did
for the memory
this actually looks a lot like uh
this this status register stuff looks a
lot like apples um
take a look at matt maul code you might
not like it
what fpga are you using you actually got
all this to work
tvm front end
what is this
compiler stack of deep learning networks
um i still totally understand how your
memory works
uh okay so
oh it has separate ram from uh
once i want an x it's a uh
interchange format for ml models
uh we're using a comma actually if
you're looking open pallet
you go to models what dotto and an x
well but okay so
it seems to me
you have 64 times 64 here
but your basic path here is only 64-bit
wide
okay so one way to think about this is
if we have 128 vrams
our data bus has width
this is the width of our data bus
um and then if we're doing the other one
with 2048 b
rams our data bus would be this size
this is the key to understanding the
memory layout
i guess what i'm trying to understand
beyond the memory layout is like
this is your your matrix unit
oh so 64 bits you're doing 8-bit
precision so 64 bits is an
8-bit wide
bus
bit serial operation i see okay
so your your weights can be can be
loaded in quickly but yeah so i have
each clock's like okay i understand
sponsors
why do you say barrel what does that
mean
you have arbitrary precision e with one
good precision oh okay
um
see the problem without fully stride is
you end up with this you end up with you
end up with what makes all this stuff so
annoying
which is that like oh you got to put
like your weights over here and your
things over here and you got to like
pre-stride them in memory i don't have
to do any of that
um
invade hardware threads that share the
pipeline yeah i get it
i mean yeah i effectively want to do the
same thing
barrel processor
barrel processor design so like a like a
like a like a google for this here go
no okay so i don't want to do this i
want to uh
uh
i understand i mean i wanted to build
like a like a super scaler
a little super scalar um i'm imagining
almost like
each line of the matrix being like a
dispatch
we dispatch them and then we like fill
the lines in
each one's like a load unit that's
responsible for the dispatch
i don't have to think about like like
the data b
ram and the weights b ram and stuff i
want one i want a unified memory
architecture
with with striding
actually with more than striding
[Laughter]
mom can we get super scalar we have a
super scalar at home
at home sub scaler oh that's this is me
your mom would always say you had good
stuff at home when you never did
wait what fpga are you using did you use
an fpga app
what are you thinking about
and playing in the warplane
unified memory architecture like apple
yeah kind of
combining a multiplex of decoder gives a
binary select
multiplexer
oh you're using alveo who yeah comic-con
who's coming to comic-con
whoa i didn't know xilinx made one of
these
wait why didn't i consider this
this thing looks great how much are they
why was i thinking about that alcoholics
thing
i love xilinx
damn i just like like like like
holy shit okay you know what who who
owns xilinx
underperforms market it's public
i don't know do people know about xilinx
being an ai company
should i just put all my money in xilinx
how good is this card
this is great like you guys see why i
think this is great right
they have a buy it now button
of all the companies like buy it now
all right don't worry about the price
i can't buy a craft core no matter how
much money i have
you gotta suck someone's dick to buy a
graph call right here
and like not to rip on 10 story pretend
stories like okay we'll give you access
george but you have to sign this
document that says you're not going to
say anything bad about tens torrent
i don't know if i'm gonna say anything
bad about tends to when i haven't seen
their shit like now i'm saying something
bad because they wanted me to sign
something to promise to not say anything
bad
all right wait can we like get the
documents where's the where's the
documents
oh my god and can we talk about how they
didn't like force me to like
sign up and like tell them about myself
before i you know downloaded that
i mean this data sheet is a little light
why was i thinking about using that
other one though when i can use this
behind now docs later
no i want more docks more docks
you just have is this lots of docs
alveol platforms
dma configuration platform naming and
life's like what
accelerator cards
oh this one has hbm2 as well i say
internal sram total bandwidth wow that's
way more bandwidth than i was thinking
oh that's a sick amount of bandwidth
are those and that's megabytes with a
bite i love these cards
alveo250a
does tiny grad support low precision
back prop honeybee doesn't
uh i don't do anything special for it
i mean it's pretty it's really easy to
add support
find the buy it now button for bravado
no i don't want buffano
or mac does it run on linux
should i get myself a um
does it run ubuntu should we should we
get a linux computer up in here and buy
one of these cards
i do need more documentation than this
normally xilinx is so good with the
documentation why they give me this
crappy documentation
what's a xilinx dsp slice
is this an ultra scale no it's an alveol
is it the same as the ultrascale
i don't know if these have alveos
let's do float
floating point hardware
okay getting started guide
that's an okay number of pages
the question is am i ever going to get
my tool chain to work with them or are
we going to have to use vivano
can i even use vivado
is alveo based on ultrascale yeah
or maybe
where's the code
first boot of a little bit what
is there code
where's the github
get repositories
i'm confused there's too many
repositories
i don't know if it's good or not but i'm
confused how many repositories there are
wait maybe the alveo card has doesn't
have a
oh it has an ultra scale on it oh it's
just the chip oh
i was just this chip so i just need to
figure i just need to find the
documentation for this chip
oh yeah i knew xilinx wouldn't uh
this is still the alveol
but it is an ultrascale list of xilinx
fpgas
over here so it's just this one
basically it's the same chip
as that they just call it something else
which is the one that's on the uh the
squirrel shit
one of the best deals i've seen on it oh
okay too much too much too much window
too much wind though
bye-bye window bye-bye window
which is the one that's on here
vu 32p
where is it is that xilinx fpga
wikipedia
list of xilinx fpga
vu 33p
okay so that's this one oh so that's
like the same as like a crappy one of
these
ultrascale that's the 280
where's the 250
we should really add this to the blog
post because these things are great
how come this will cost more
how's that one cheaper
i have to wait longer for it
i guess that has more memory
oh this one has more luts
all right this to the blog post
alveoa
um if you don't understand what a lut is
just you know it's a lot sex you know
there you go
smart neck
which is this one
how much is this one
what's the difference
it's lv
but yeah wow this is this is the one to
build i think this is the one to build
with i think
that's actually a really crappy number
of tops though it can't be right
it's probably right
the other one have more bandwidth
no less
wait no 38 terabytes per second
and this one
30 terabytes per second less
it's just confusing with all the numbers
how many lots does my rd7
don't you know what i know from here
where is it
around it
all right so this is 10x more lots
way more than 10x more ram
i don't know why xylene doesn't make
this more clear
it's this
wow they make even bigger ones
this is even a small one
i love it pgas guys fpgas are great
this chart definitely oh maybe just zoom
in a little while it's not as bad
it comes with clebs
which is a rebadged that
vortex ultrascale
yeah you don't use lots on asic boys who
would use a blood on an asic i mean you
can put lots on an asic but just be new
you know don't do that oh
man ultra scale
architecture dsp slice guide let's learn
about their dsps
amd struck a deal to acquire xilinx in
all
stock transactions so first off this
should all be illegal
uh but uh amd you know
amd lisa sue is cool
it's lisa sue right yeah
um so
i wouldn't i wouldn't uh you know if
nvidia bought them
it said sad you know jensen take your
company back from the losers
jensen if you ever watch this if anyone
knows jensen send them an email be like
yo take your company back from the
losers jensen
i don't actually know if he has power
maybe he doesn't have power maybe the
losers own him
maybe the losers got like you know is he
married
jensen wow let's see is he married
oh he's married like maybe maybe maybe
the nba has like got a video of him like
you know cheating on his wife or going
epstein's island or something
and um
nvidia stock
all right so like not even a percent
wow
epstein
yeah no you know i don't even think it's
jensen's fault i think they're holding
him hostage inside that company
poor jensen
he doesn't want to do it but the losers
make him
wait a second how come this one has
more of these than this one does
andy prieto
mulch
how many of these do we have
twelve thousand
all right all right that sounds like 12
teraflops
if we can pipeline it what's what's the
oath of the engineers
who are the engineer
like the thing is i don't know maybe i'm
just so cynical and it's like when i
read this
all i see is like i pledge to be the
bitch of business people
like we need to kick the business people
out of everything
the sooner we do that the sooner we'll
live in a nice world
oh i got food on my shirt
savage all right
i absorb information by double clicking
on it
yeah we're looking at different fpgas
and we can figure out which ones we want
to use let's see if
i don't know why i got sold on this um
this one when i can buy a xilinx alveo
the fk is just a it's just an older
xilinx chip
which is probably more annoying to use
like this is probably the card should i
buy one
oh of course the one i want is
sign up for the xilinx account
i know it's way cheaper to buy that and
it's on ebay too which is nice
oh
well okay i can get it here fast
which one is this why don't they tell
you this is the u280
cool it's on ebay
fake no i doubt it
he sells google pixels and ethernet
switches and stuff
oh i can be in debt to bankers
they're gonna make me use vivado aren't
they
oh they're on digi-key look at how much
it costs on digi-key
so much was that in canadian dollars
i don't even know how much a canadian
dollar is
oh good it's cheaper in american dollars
perfect
but it costs more from digikey
it's crazy the digi-key has them though
are there other server accelerators
oh intel makes them
it's a terasec
spark
well i'm back in canada dollars no count
of dollars
accelerating dnns
that's
the difference is 500 if everyone
watching gave me ten dollars
i could buy it um
wow
this is an end date does it only support
end dates
i'm a little concerned if it only
supports in dates
hmm i don't like that
the other one supported uh
ah no it does avoid fp32 at least
according to this random thing it does
is anyone training on these
no i don't know
i don't think anyone's made training
work with any of this stuff
16 nanometer oh that's kind of shitty
it's a 16 nanometer chip
the other one has a seven nanometer chip
this chip's really uh was a 250
i'm paying that much money for a 17 for
is this nanometers no
oh yeah i'd rather have web devs mine
crypto in my browser
than my audio
uh he's like chip lucky
can you tell me the process
no it doesn't
yes 16 nanometer
so that's kind of crappy but
specify desired precision now i don't
want
little precision i want big precision
can you support floating point
okay
can you get me three teraflops is that
what i'm saying
what is this some guy's resume
mixology
oh what's a versailles
a cap
it's seven nanometer can i have seven
nanometer
oh how do i buy a versailles a-cap
this is not an fpga
wait guys is xilinx the company we've
been waiting for this whole time
oh
f232
why does it have an ai engine and a dsp
engine
their libraries are full of bugs
coral ai products dashboard wait is this
google's bullshit
ugh
so you're telling me their software is
full of bugs i mean you know we can deal
with buggy software
i don't want to use zebra quantization i
don't trust your zebra
god
what is asian for infants yeah you can't
quantize fur
um you can therefore
implement a
floating point computation okay tell me
more about floating point computation
has nobody used this stuff for floating
point
why can't i find stuff
automatic or fixed or floating point
hardware generation
look at the vivado design suite
reference yeah because all their
software is terrible
it's a nice cherry through your bookmark
blocks that support floating point data
type
custom precision oh
hardware design using system generator
i'll have to figure out if these dsps
can actually um
do what i want
pre-adder
multiplier
this looks like an accumulator 48-bit
accumulator
48-bit
i have some dsp 48 e2s in my chat don't
i
so we can test them
no i have dsp 48 e1s and i only have 240
of them
which is kind of a pathetic amount of
dsp 48 e1s
they also don't support being clocked
for some reason
i mean they're doing something
cool
cool yeah you want to get good at stuff
this is how you get good at stuff
people you know you always want to know
how you get good at stuff
and like you see how you get good at
stuff
you just do it
you know people oh my god like the
youtube comments are like how does
george know everything about the
hardware and the software well
you see what i do like do you see what i
don't know you see when i learn
something new and i don't really forget
genetics
i mean i some people are just dumb but
like for everybody else it's like
you know i know a lot of people are
gonna say my q i do and like they're not
doing shit with their lives
uh and that's not it's not genetics
questions like you can make choices
right
uh you're people there's more people and
like they they just
you know i don't know they just don't
like thinking they don't want to think
it hurts them to think or
something like that
you know
genetics for trying fucking genetics for
trying
make that choice in your life man like
iq is heritable i don't think trying is
heritable
uh
well this one looks simpler
how do you do floating point with this
stuff
i feel like it's just not designed
really to do floating point like these
people hacked it in
they mention floating point
it's just the same thing over and over
again
fix configuration floating point
multiplier architecture using dsp
block
wow see look at all this stuff you need
it's not wide enough
it would be wide enough if we get a
tinier fraction
yeah it's not wide enough also in fp32
you have a 23 bit
mantesa yeah so we'll be able to do this
in one we won't need two
we can get rid of the rounding logic
all right so the normalization is done
[Music]
afterwards
iterative combined operator also i think
it's actually the same one
twice they just iterate it
do
all right all right a topic topic topic
topic
topic you know you can't mention
fucking iq with you people
it matters but not that much no one who
ever spends their life talking about iq
ever did anything you know
because you can look like it was like
the man with the highest iq when he
published these like weird books
iq and conscientiousness account for
like 80 percent of the variability in
life outcome yeah okay what's
conscientiousness
is there a conscientiousness test
oh my god guys
so destructive you know so distracted to
society
this like myth that like matters where
you come from like of course it matters
statistically but that doesn't mean it
applies to you
i don't think statistics apply to you
they may they may not
i do i do hate you guys i hate you guys
who like sit around like fucking jerking
off about like
if only i had three more points of
conscientiousness you're a loser
you are a loser
and you'll never amount to nothing with
that attitude
so if there's something genetic that
gives you that attitude
well there we go we found out why you
never mounted nothing in life
how'd they do it with one
how come they only used one dsb
and the other guys use two dsps
speed optimize flow poku
iterative design the multipliers using
dsp blocks
are smaller than the other design but
make use of two dsp blocks
as well as being smaller than the air
[Music]
hmm
oh oh this is the this is the
fixed configuration and this is the
iterative one
i understand and i don't know
what flo poco is
multiplier dsp based
wow but that changes the frequency
oh this is cool they're running that
fast
oh yeah i was looking at flo poco
installation instructions oh
don't worry i can just use the docker
docker
you found some good guys do they did
they do
yeah i read this one but they don't do
any floating point do they
do they float no they don't float
and they probably have software that
doesn't work and they've never trained
anything
no we need float
i did like that that acronyx fpga has
float
no float and the software is trash af
a bit of data flip flops they don't have
luts of course their flip-flops
what fpga you think doesn't have flip
flops
wait 127 lots to do one float
well let's see if that ratio works
yeah so we had like what we had 10 000
dsps and we had like a million lots
okay that ratio kind of works
floating point operator
oh yeah but i looked at this one this is
the one where they yeah they don't
show you how anything works they just
like
yes looks useless all right we might
have to get flo poco to work
but we'll build we'll build floating
point multipliers
um maybe that'll be the next stream we
didn't solve the memory problem yet we
just kind of said like it has to work
um
didn't solve it i just got excited about
these other things
wow you can do it with no dsps if you
just want to use lots
flo poco just kind of seems better
shall we return to the stride problem
pink you mean a zinc boat
is pink actually a thing
that's actually a thing
[Laughter]
yo i love silence
um
okay which fpga is in here
rent everything oh nothing
now
i mean i kind of just want one of those
boards
just cause it's pink have you ever seen
a pink circuit board before
oh i can buy my new egg
oh
that's a sad amount of logic
well actually this would make a lot of
the stuff
easier too because like we'd have linux
running on it you know
goose
only 29 000 yen
of course it's not out of stock in japan
only out of stock in america because
boats can't get here because like
people in la are lazy
um pink
i just want it i like i
wait you can connect it to a raspberry
pi
i can connect a pink to a raspberry pi
try the new work
46 in stock
why are these pinks more
well i guess it includes other wires
all right
can i buy it on amazon that's too hard
oh will i pay extra money to purchase it
on amazon because i can buy it with
prime
that sounds like the kind of thing i
would do
can i use your affiliate link no
oh micro blaze oh they're shitty risk
core
sad
i don't know i think it's dinner time
though
if someone needs to buy amt to make this
a complete experience
all right guys thank you for watching
today's stream
i appreciate some of you except for
why fuckers and
whiny iq fuckers
and trolls but nobody ever appreciates
charles nobody's like damn i really
appreciate the trolls
uh look at that it's streamception
uh
nah i gotta go find food i'm hungry i
want dinner
drag the face cam around all right
look at that you can compute the fps
by the velocity of the face cam
wow trippy shit boys
yo i wish there were all candies that's
maybe what's for dinner
nah i think i'd order breeds
i don't have any more red bulls i drank
all the red bulls
the wheat harvest were pretty good it's
good weed boys
ah please don't
ever leave
please don't ever leave
where's that from
no where's that from you know
is it drake no it can't be drake is it
drake
no it's not drake what song is that
please don't ever leave
please don't ever leave
someone know that song
uh i don't know a song
by a song a virtual piano no
it's not just a bieber no no no no
you missed the whole stream
let's not do a lieber move the obs
window around oh no it gets small when
you move it you can't move it
that doesn't work well that's pretty
cool though
yo this is straight up better than like
all the video games that came out in the
last 10 years
except for firewatch and portal 2.
left foot right foot left foot slide
right foot slide i don't care which foot
either way we bout to slide yo we
haven't done beefing with drake hour in
a while
um
we haven't done beefing with drake tower
in a while
outer wilds
that
oh wait no no no i remember
i remember what please don't ever leave
from um
it's pl battle of hampton roads um
yeah yeah yeah yeah oh yo you guys this
is a great song
um
um solidarity is going to give a lot
less than it
takes is there a girl at this college
who hasn't been raped is there a boy in
this town
not exploding with hate is there a human
alive
who ain't look themselves in the face
without winking or saying what they mean
without drinking
who'll believe in something without
thinking what if somebody doesn't
approve
is there a soul on this earth who isn't
too frightened to move
bye everybody
WEBVTT
Kind: captions
Language: en
lolz133711337: yoooo
Darnell_ll: yo
jvckhvm: finally jesus
sumrise_: geoorgee!
dtfo710: Get it
Croww__: hello
tdubey: tdubey subscribed at Tier 1. They've subscribed for 12 months, currently on a 12 month streak! hi everyone
jmelone: BloodTrail
grigori_rasputin069: hi george
loveyousomuch455: hi
samuel5755: did the memory issue got solved?
xHardcorexism: hi
cmanthunder: what's this all about?
cmanthunder: thneed
karanberries: what do you wanna do instead
perlpimp: Kappa
sumrise_: cherry will become a global player hardware
shrek_361: Sup bro. Love your work. Still trying to finish up your last stream on YouTube right now. Keep up the hard work.
sumrise_: in
br1anwiz: I made the logo
sumrise_: show the logo briam
sumrise_: where is it
Silensrunners: How's it goin VoHiYo
NatelBeats: annnd we're back
martinkirilov: what do I learn to start contributing to tinygrad? any starting point?
marschr: cherry time!
Frontierman: George what do you think about RPA ?
cmanthunder: I love how quickly cherry is able to pivot
sumrise_: @martinkirilov "I wanna program but where should I start?"
cmanthunder: stay agile friends
StatelyFall: building AI standard library or import?
martinkirilov: @sumrise_ not really, all the issues in tinygrad are old af
sumrise_: when will be the cherry IPO?
ikarus29: Just start with cherry stage 1 and then look how it goes
uduver: look who's live
okkessh: let's create switches instead
mo_askar: I added waveforms and some other verification features
purkinje_: Call it G1
mo_askar: I was not able to make risc-v test pass
sumrise_: george you need to meditate
br1anwiz: LOGO (I made it): https://imgur.com/a/bQK03cm
zartharus: Right now I estimate that the odds of Cherry computer to become a successful chip company is 1:20.
daps9494: Im late to these streams can i get the tldr?
mo_askar: why not use verified open source risc-v test, freely available?????
martinkirilov: people said it's not possible to get a self driving car with a phone and here u are
Frontierman: what do you think abour rpa george ¿?
Silensrunners: @daps9494 It's been 7 min
mo_askar: risc-v cores
big_dog_genetics: good morning programmers lets get this bread
nytherino: i think its 1:8
nuclearnicdev: nuclearnicdev subscribed at Tier 1.
mrfixer1: goku sad tho
mo_askar: I meant core
karanberries: yay tiny grad day
samuel5755: currently I am going into my last year of Electrical and Electronics Engineering and next year I have to fo a final project. If you are okey with it I could try to create the accelerator for your company but I would also use it for my thesis. Currently my knowledge in RISKV is minimum but all the info is in the internet.
sumrise_: @br1anwiz the logo kinda looks like balls with a tiny dick (like a tinygrad dick)
Ayyyy420Lmao: bro u always start streaming while im on ketamine, loved ur rant from yesterday
cmanthunder: No way I was just getting invested in cherry :(
samuel5755: It would be done in one year approximately.
okkessh: what are we pivoting into
br1anwiz: @sumrise_ lol, I see it to now
bolderhero: cherry 🕯️
sumrise_: xD
patkarmobile: yingtao
sudoaptgetinstallurmom: hi george can i have ur email and twitch password
okkessh: we can build tinder for dogs instead
VATERZZ: !m1
karanberries: @sudoaptgetinstallurmom lul
VATERZZ: !computer
ikarus29: cherry is alive
VATERZZ: !commands
cmanthunder: So what's wrong with superscaler on RISC-V
BobRossApocalypse: Will Dric Code Replace QRcode?
sumrise_: @sudoaptgetinstallurmom ERROR. The package "mom" is too large
sudoaptgetinstallurmom: i make mistakes
martinkirilov: u need to update that bio link in github 1m2019.com
x_0_696969: mistakes are good
sudoaptgetinstallurmom: my parents made mistake.
Ayyyy420Lmao: im the mistake
sudoaptgetinstallurmom: i love you @ayyyy420lmao
jaySynth1: I love you @georgehotz and want to be like you when I grow up. I'm 41 btw.
cmanthunder: big three
AugTV: Word up
Silensrunners: SeemsGood
MauriceChavez: i love the saying: perfect is the enemy of good
br1anwiz: put that on a t-shirt
prestigious97: geohot vs Jake Paul who wins?
XTiaaaan_: no RISC, i get it LUL
sudoaptgetinstallurmom: @georgehotz give twotch password so i can show my friends im hacker
sudoaptgetinstallurmom: im in latvia
cmanthunder: so make an open source TPU
x_0_696969: google is too big ofc we should insult them LUL
sudoaptgetinstallurmom: poor
big_dog_genetics: popo Pog
tusharm57123: Context please? New to the stream...
Ayyyy420Lmao: only used google to get an uptodate libgen url for the last year xd
big_dog_genetics: i know nothing fuck the popo
x_0_696969: AI chip
panthurrr: gotta catch em all
XTiaaaan_: "i
vtcN_: ?
sudoaptgetinstallurmom: @georgehotz stop taking adderal
Silensrunners: Gotta train em all
XTiaaaan_: "I'm going to bring you to my AI journey.. I've been watching Pokemon" LUL
danielb123: SNEED FEED AND SEED
Ayyyy420Lmao: whats a good eu source for ritalin? no prescription
sudoaptgetinstallurmom: monopoly market
Ayyyy420Lmao: sneed indeed
sudoaptgetinstallurmom: on tor
gingimli: what are ya building geohot
komocode_: i made a mistake once. i hacked into a supercomputer called The Gibson and downloaded "garbage" without a vpn which tipped off the secret service and got me arrested Kappa
big_dog_genetics: ive been watching naruto who tryna build a helicopter
sudoaptgetinstallurmom: you can purchase many types of amps rn off monopoly
sudoaptgetinstallurmom: check dark.fail
name100015: BasedGod
Ayyyy420Lmao: nice
sudoaptgetinstallurmom: they have good weed
x_0_696969: cheaper GOOGLE tpus
ausjam99: EarthDay
josuexzz: josuexzz subscribed with Prime.
ikarus29: whats wrong with superscalar risc v?
Ayyyy420Lmao: monero only yeah?
gingimli: how many more subs until twitch is your main source of income?
name100015: janixANGRY
Exclamation_mark_CODE: How do you hope to beat Jim Keller and Tenstorrent? They also aim to beat Nvidia
sudoaptgetinstallurmom: yeah
sudoaptgetinstallurmom: dont use btc lmao
br1anwiz: "nothing worth doing is easy"
Ayyyy420Lmao: based drug dealers
x_0_696969: simple = way better
sudoaptgetinstallurmom: im not a drug dealer
big_dog_genetics: my dog is on white
samuel5755: maybe the image of 2048x1024 do it in two clock cycles of 1024x1024?
dtfo710: True
Deputable: opened that website on chrome
d_brane: be water
daps9494: Yesss
Deputable: good
name100015: lazy people are smarter
x_0_696969: bad idea
die1dre: woke
vegemite: sick
wreckzy: BibleThump brilliant
Schreauxdinger: Schreauxdinger subscribed with Prime.
AugTV: Not bad
ikarus29: man, risc v superscalar would be worth it tho
creikey: getting hyped on overengineering is an age old mistake
daps9494: lazy apporch wins
big_dog_genetics: be cocaine
shrimpboyho3: hey, can someone catch me up on what he's doin
GflyzZ: aye foo u ever stop learning
daps9494: make a lot of money , then hire people to make the lazy approch in to something less lazy
mrfixer1: make it run off electrolysis
Frontierman: @shrimpboyho3 he's doing something with electricity and tensors
layke1123: how many drugs is this guy on?
x_0_696969: the lazy simple way is the better way
shrimpboyho3: @frontierman machine learning?
Ayyyy420Lmao: are btc/xmr swaps live?
sumrise_: lol
albertcam00se: capital expenditures
creikey: I want to see a performance / engineer hours
albertcam00se: it's about return on investment
GflyzZ: aye foo i left but did u answer the question
x_0_696969: they are maximizing the dollar amount to squeeze from cooonsoomers
siow6888: @georgehotz are you a millionaire?
name100015: we are good people
Ayyyy420Lmao: geohotz have you read leviathan and its enemies?
psychedelictw9t: stupid people run the world (:
zigzati: engineers just need to be alpha like techlead 😎
br1anwiz: so would it still be under the cherry name?
Schreauxdinger: George off topic but you need to get on lex's podcast again
sudoaptgetinstallurmom: dude no keep ranting
GflyzZ: duh foo @siow6888
Frontierman: we are fighting against death
daps9494: geohot for president.
zartharus: An engineer runs Tesla, SpaceX and such
sudoaptgetinstallurmom: this is very good discussion
x_0_696969: but you have to pay taxes LUL
sudoaptgetinstallurmom: no no
sudoaptgetinstallurmom: tanengt
danyalejandrob: Be happy for others wins. we're all in the same team
masic95: Ye but the world has gone to shit that's why
layke1123: capitalism would be a good start to get rid of the status quo
sumrise_: this is not a rant, this is a philosophical conversation
creikey: is product design still engineering or separate experts?
sudoaptgetinstallurmom: i honestly love listening to u stoned
StatelyFall: An engineer runs tesla? interesting
MauriceChavez: puttin the sass in asic
cmanthunder: Cherrtyy slogan #4
juanguzman0313: what's he doing?
opternary: it's because engineers don't want to take care of that stuff, and that stuff in general needs to be done by someone
Ayyyy420Lmao: muh dick in ASSic
opternary: same as politics
x_0_696969: building a chip @juanguzman0313
big_dog_genetics: engineers are hardasses when it comes to managing people, if you would hire an engineer as a manager in some norme company, third of the employees would quit, another third would kill themselves and the rest would sue you
Dutch_Klossie: LuL
sudoaptgetinstallurmom: @georgehotz pipeline hackers.
smurfd0: Egen though its out of scope: https://github.com/vosen/ZLUDA someone starter opensourcing cuda for x86
chasethecut: @big_dog_genetics sounds like a good boss, most people are shit anyway
sudoaptgetinstallurmom: private key,
PlatypiParty8: PepoG
sudoaptgetinstallurmom: no
sudoaptgetinstallurmom: Provate key
ikarus29: getting high on the vector unit
x_0_696969: google has more money more smart asses
creikey: what use is a vector unit when you have matmuls?
sumrise_: elon musks companies have like 60000 employees and nobodies suing him, hes an engineer lol
vegemite: as long as people are heavily dependent on a system to survive they think less critically imo
rawrrzfn: xqcStare Yes
Ayyyy420Lmao: a friend is all-in in ASML (litography company) thoughts?
votummy: I like the concept of people climbing the corpo ladder until they are too shit at their job to climb anymore (hence shitty managers)
x_0_696969: want job to be rewarding LUL
danyalejandrob: natural selection
sudoaptgetinstallurmom: True
Frontierman: @danyalejandrob i like that game
sudoaptgetinstallurmom: Facts
Poxenium: ship product is rule #1
br1anwiz: but done doesnt win marketshare
mo_askar: you think we should operate on vector-vector operands or matrix-vector or ..?
danielb123: LET'S PUT THE COCK BACK IN GROQ
cmanthunder: SLIW with the ASS
sudoaptgetinstallurmom: can you even use vim @georgehotz
keepfera: Living long enough to see yourself become the villain?
liquidestrogen: oo baby
sudoaptgetinstallurmom: yes
x_0_696969: 2015 LUL
creikey: do these kinds of systems still have like L1-L3 cache stuff or is it just different?
MiniMimX: reading slowly in 2k21 OMEGALUL
nuclearnicdev: Have to go sleep :(
Ayyyy420Lmao: whats your nick on grey mirror @georgehotz ?
x_0_696969: https://upload.wikimedia.org/wikipedia/commons/thumb/b/be/Tensor_Processing_Unit_3.0.jpg/1280px-Tensor_Processing_Unit_3.0.jpg
liquidestrogen: where would you make cherry chips/ buy them from
x_0_696969: looks cool
br1anwiz: lets just say fuck it and make a quantum computer
mikedns: Привет с Украины )
danielb123: FUCK MASKS KKona
MaxMayo: lol
gingimli: I'm just trying to make some boring business software that's all REST APIs
CensoredAlex: what are we doing?
MauriceChavez: MORE
Ayyyy420Lmao: *starts a cpu company amidst a chip shortage with no end in sight*
x_0_696969: error-correcting in quantum computers is impossible
mucinoab: Pls make terminal font bigger
keepfera: QECC codes are here, the actual problem is stability of the qubits
x_0_696969: check the code in github
x_0_696969: QECC is shit tho
siow6888: @georgehotz what if you threw in some vector NAND gates?
x_0_696969: stable qbits LUL
Elias_Kan: @georgehotz if you were learning python as your first language, what would be your very first project ? :D
albertcam00se: @Ayyyy420Lmao lmao
x_0_696969: first gen TPUS
rawrrzfn: @Elias_Kan Whatever you want it to be :)
danielb123: LET'S GOOOOO PogChamp
name100015: team rocket 🚀
creikey: steal the stolen plans
danielb123: PikaTPU PogChamp
MaxMayo: I like that team rocket idea
br1anwiz: I said i would make the logo, and I got it done, you should put it on the website https://imgur.com/a/bQK03cm
chasethecut: steal from chineese
x_0_696969: The first-generation TPU is an 8-bit matrix multiplication engine, driven with CISC instructions by the host processor across a PCIe 3.0 bus. It is manufactured on a 28 nm process with a die size ≤ 331 mm2. The clock speed is 700 MHz and it has a thermal design power of 28–40 W. It has 28 MiB of on chip memory, and 4 MiB of 32-bit accumulators taking the results of a 256×256 systolic array of 8-bit multipliers.
Ayyyy420Lmao: I have a chinese friend let me ask him
x_0_696969: Within the TPU package is 8 GiB of dual-channel 2133 MHz DDR3 SDRAM offering 34 GB/s of bandwidth.[15] Instructions transfer data to or from the host, perform matrix multiplications or convolutions, and apply activation functions.[14]
Elias_Kan: @rawrrzfn good idea ofc but i'm curious like retrospectively what someone would do
Angrr: Angrr subscribed with Prime.
daps9494: so this is what its like to be a genius
gingimli: meowth, thats right1
br1anwiz: Yessir
MaxMayo: @br1anwiz looks great!
x_0_696969: free copy
Ayyyy420Lmao: buy the "pacha" cherry logo
Landon_1: twich chat contracts PogChamp
x_0_696969: LUL big
Silensrunners: LUL
br1anwiz: ill upload the svg
Elias_Kan: LOL
deep5: Pog
danielb123: YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀 YINGTAO 🚀
br1anwiz: I cant put svg on imgur
rawrrzfn: @Elias_Kan Well you try what you want, if it's too hard you go back to learning more about the language or try something easier
wreckzy: monumental..
64pillars: it looks really male
DragonMorcilla: A pair
Elias_Kan: @rawrrzfn thanks
creikey: ctrl^a copy to brain
Silensrunners: Two cherries, One ear
scheiterhaufen_aus_money: CiGrip
wreckzy: is there a tik tok version?
Ayyyy420Lmao: marrahuana
rawrrzfn: @Elias_Kan Welcs, im in the same boat as you
sureom: ahahahha
sudoaptgetinstallurmom: stoned rn
x_0_696969: weed makes me anxious
wreckzy: PogChamp
Elias_Kan: was thinking about blackjack @rawrrzfn
sudoaptgetinstallurmom: took too much dabs
PlatypiParty8: monkaS
sudoaptgetinstallurmom: im tripping yes
sudoaptgetinstallurmom: fuck yes
creikey: redbull then coffee?????
br1anwiz: how do I get the svg to you? I cant put it on imgur.
gingimli: red bull and a coffee, holy shit
big_dog_genetics: this is like the only dude in the world who gets energy from weed
daps9494: nice
sudoaptgetinstallurmom: fucking DANK
iwrestle123: thit allowed on twitch?
wreckzy: i can smell from here
zakara_: don't worry its just CBD
64pillars: comma.weed
hardtarget4: we out here
Ayyyy420Lmao: druggie stream KEKW
sudoaptgetinstallurmom: @georgehotz when you gonna smoke w me?
daps9494: comma.weed lol
mo_askar: there are more inputs for tinymlperfs: https://github.com/mlcommons/tiny
x_0_696969: disc ord @br1anwiz
MiniMimX: twitch staff watching monkaS
gingimli: its cbd oil, calm down
mucinoab: do you exercise?
hardtarget4: cherry bud
liquidestrogen: geohot is my favourite african american
localcanofdutchgold: weed chips
creikey: yo cherry brain accelerator
64pillars: prob not
big_dog_genetics: world series of dice finals when
UserNameThe3rd: Next business open source marijuana
dtfo710: Dang George got the indoor grow goin
wreckzy: monkaS yes
daps9494: Fuck AI chips lets build a fully automated weed making robot
trusteeprisoner: what doing instead of superscalar
burtiz: FBI OPEN UP
gingimli: which companies are you buying stock in right now?
keepfera: surely thats the TOS violated right there?
MauriceChavez: make a weed superscaler
br1anwiz: @georgehotz How can I get you the SVG? D iscord?
Ayyyy420Lmao: does violating TOS violate the NAP?
franchinoilbarbaro: weed meeting SeemsGood SeemsGood SeemsGood
big_dog_genetics: @georgehotz do you sometimes feel like weed slows you down cognitively?
deep5: its not LUL
cmanthunder: I'm here for the cherry storyline
Exclamation_mark_CODE: Here is how you make chips: 1. Hire Jim Keller  2. ??????  3. Profit
64pillars: oh thats why u didn't move to texas
mucinoab: google it
aymamoon: weed legal in canada
robby0313: Canada gang
ikarus29: Step 2: Smoke weed??
Cracktune: thanks for streamin bro. this is better than The Simpsons to me
quickcheck: he can't see us hehe
samuel5755: which repository has the AI. Is it tinygrad?
Ayyyy420Lmao: &gt;caring about the law
aymamoon: communist canada
vtcN_: Y U NO HAVE?
MauriceChavez: yes me jelly
ohko10: do you guys know how hotz binded his keys where he put the terminal on the right and the browser on the left
big_dog_genetics: how weird it is that weed is legal somewhere and not somewhere else, like are people in California different from everybody else lmao
daps9494: how much money you need george? I'd fund team rocket.
karanberries: team rocket coin to the moon
plasticityyy: @ohko10 I use a program called magnet that added the bindings
quickcheck: current year already, time flies
name100015: TRC 📈
albertcam00se: @big_dog_genetics same reason incest is legal in alabama
aymamoon: @big_dog_genetics im sorry what
Ayyyy420Lmao: isnt weed legal in half the states alrdy?
matt_719: chat link to his soundcloud again plz
big_dog_genetics: doesn't matter, point is it should be legal everywhere or nowhere
ohko10: @ohko10 thanks
albertcam00se: no because what if i don't wanna be somewhere people are smoking weed, i still have the option to move to another state
Ayyyy420Lmao: why? one world govment fan much?
phillipfernandez: no teaching the kids about the meaning of life today?
aymamoon: @albertcam00se legal or not people are smoking weed
sudoaptgetinstallurmom: reported
rawrrzfn: @sudoaptgetinstallurmom reported
sudoaptgetinstallurmom: ty
clorx: @rawrrzfn reported
rawrrzfn: D:
Ayyyy420Lmao: klauss schwab test
clorx: lol
sudoaptgetinstallurmom: drug use violation of tos
big_dog_genetics: politics ResidentSleeper
MauriceChavez: never even heard the term wtf
nbjakal: you are the smartest person i've ever seen
x_0_696969: doesn't nvidia have a TPU too?
clorx: drugs can ruin your life, don’t do drugs
Ayyyy420Lmao: but w/o drugs ur life is already ruined
sudoaptgetinstallurmom: im waiting for the stream to get ended by a ban
alexander4757: so i was sitting there thinking.... boobies
borang: @sudoaptgetinstallurmom stop
aymamoon: @clorx all the greeks did drugs
sudoaptgetinstallurmom: stop what
sudoaptgetinstallurmom: i didnt do anything
x_0_696969: yall are boring focus on cherry
djdrae: are all the programmers that trash? you cant just pay somebody 300k a year to do most of the work?
Ayyyy420Lmao: ill pop ur cherry wyatboi
sudoaptgetinstallurmom: mmmm
franchinoilbarbaro: Hi i'm at first year of CS at university what are you doing in poor words?
demonshalo: holy mother of nesting complexity
alexander4757: what if u just told it to smoke a doobie
Ayyyy420Lmao: zoom university eksdee
sudoaptgetinstallurmom: hes on coke @franchinoilbarbaro
big_dog_genetics: this dude prob read the terms of service upside down and sideways  im pretty sure he knows what hes doing
albertcam00se: @franchinoilbarbaro coding
demonshalo: @franchinoilbarbaro making his own chip :D
x_0_696969: FPGAs are scalable. slogan #5
Ayyyy420Lmao: Ayyyy420Lmao subscribed with Prime. They've subscribed for 2 months! peepee poopoo
sudoaptgetinstallurmom: Any activity that may endanger your life or lead to your physical harm is prohibited. This includes, but is not limited to: suicide threats, intentional physical trauma, illegal use of drugs, illegal or dangerous consumption of alcohol, and dangerous or distracted driving.
elchechulin: elchechulin subscribed with Prime. They've subscribed for 2 months!
albertcam00se: okay well it's legal use of drugs
Apex_Livestream: hello vim master DarkMode
sudoaptgetinstallurmom: no illegal
iyajainfinity: You said that ResNet50 is old and lame so what would you use for benchmarking? MLPerf still uses ResNet50.
sudoaptgetinstallurmom: super illegal in california
rawrrzfn: Gonna blast off again FeelsBadMan
x_0_696969: google DUMPs scraper LUL
daps9494: OpenTPU
red__flag: if Twitch asked you to be a streamer with trendy content, would you rather program from your bathtub or with a soft ASMR voice ?
borang: yes
br1anwiz: https://github.com/BrianWisniewski/CherryComputerLogo
Ayyyy420Lmao: you bet
aymamoon: very off topic
albertcam00se: no we're on topic
x_0_696969: yeah chat bad
albertcam00se: don't worry george
daps9494: opentpu
quickcheck: monkaS
albertcam00se: TPUs pog
sudoaptgetinstallurmom: lolol
smurfd0: https://storage.googleapis.com/pub-tools-public-publication-data/pdf/45226.pdf  ?
DragonMorcilla: cmon guys
brain_of_a_emptymind: is not legal in usa yet?
Linux_____: we have a.d.d
hardtarget4: snap out of it bros
commandpaul: write a nn that learns the tpu  architecture
big_dog_genetics: nice weather today
djdrae: cherry looks like balls
quickcheck: think of something on topic bois
mik12f4: Sometimes I wonder if George already lived this life and is just better at remembering it than most people
aymamoon: subscriber only pls
x_0_696969: ill do the website
x_0_696969: ez
sudoaptgetinstallurmom: i am a sub tho
br1anwiz: I think so, I'll try it out. Can you push what you have?
x_0_696969: LUL
daps9494: https://github.com/UCSBarchlab/OpenTPU
landwirtskammer: LUL
Cracktune: woooooo! ban em lolol
sudoaptgetinstallurmom: no
samuel5755: https://github.com/Domipheus/TPU/blob/master/isa/TPU%20Instruction%20Set%20Architecture.pdf
rawrrzfn: FeelsGoodMan Chat going rogue
x_0_696969: LMAO
sudoaptgetinstallurmom: ok i behave
quickcheck: LUL
daps9494: Hey hey team rocket power!
x_0_696969: LUL LUL LUL
x_0_696969: LUL LUL LUL LUL
x_0_696969: LUL
commandpaul: pog
daps9494: I dont even know what were building but im here and i can google
quickcheck: shift1 shift2
quickcheck: shift3 shift4
Tailer_Swefft: How much weed do you smoke on average?
lolz133711337: l00000l
djdrae: georgie why not pay somebody 300 to 400k a year and let him do most of the work? they all trash?
x_0_696969: https://arxiv.org/abs/1704.04760 @georgehotz
x_0_696969: yeag v1
Ayyyy420Lmao: 🚀🚀🚀🚀🚀🚀
daps9494: i think it's v1
creikey: @x_0_696969 look at all those authors
red__flag: what if we chat are just an advanced AI making fun of you by faking different personalities ? What if you're alone, George ?
big_dog_genetics: you know shit is good when the text isn't  centered or justified
sudoaptgetinstallurmom: sometimes you just gotta take a break from being seriois and troll a bit u know
x_0_696969: i know LUL @creikey
fidetrainerNET: I joined some minutes ago, why exactly are we reengineering the TPU?
zaubages: how are u georgie
creikey: @fidetrainerNET get compute to get money
br1anwiz: can you push the current website?
sudoaptgetinstallurmom: i am more adcanced ai than ofher ai
fidetrainerNET: @creikey crikey! how do we make money out of compute? ETH mining?
Ayyyy420Lmao: F
mishmushmash: f
rawrrzfn: monkaS Hide em
x_0_696969: you sell it @fidetrainerNET  LUL
lookingforasuna: big big big big big chip big big big big
creikey: @fidetrainerNET you get money by making an incredibly engineered product that 10xs nvidia
Ayyyy420Lmao: what people?
fidetrainerNET: lol I talk to people everyday and nobody asked for a TPU yet
creikey: yo I been meaning to mess with verilog stuff this sounds kinda great
big_dog_genetics: george thinks he has 500 viewers but he doesn't realize its all me on different accounts using advanced AI magic ... dont belive me? watch me post this from my other accounts
aymamoon: Someone call Mo he can write it
daps9494: Lets get this guy to join team rocket https://github.com/dcoffill
big_dog_genetics: grratest pasta ever
zaubages: @sudoaptgetinstallurmom don't be bad with geo &gt;:(
uduver: 👋
Yoann_b: I'm googling on my side to see if I find somthing
red__flag: @fidetrainerNET you talk to the wrong people then ;-)
quickcheck: shiftMini
uduver: the chat runs the show now
name100015: MiniK
uduver: MUAHAHAHAHAHA
sudoaptgetinstallurmom: @zaubages i am only watching now. scared to talk
fidetrainerNET: @red__flag the homeless are wrong? I guess the Queen too never asked for a TPU
big_dog_genetics: wow you guys just straight up missed the greatest past of the 21st century
djdrae: george you know some good scams for us to make money?
red__flag: @fidetrainerNET the queen did ask fr a TPU, now that she has no man to spend her night with. The queen might be in the chat
karanberries: what does he want us to look into? just got back so missed some stuff
Ayyyy420Lmao: @djdrae start an hyperloop company
zaubages: @djdrae u can try making autopilot cars
daps9494: https://github.com/embedeep/Free-TPU
fidetrainerNET: do you guys know if the George also has private GitHub repos, or simply uses private servers for private stuff?
djdrae: @ayyyy420lmao isnt that scam old already?
karanberries: @daps9494 yo that's sick
x_0_696969: chinese copycat LULhttps://www.embedeep.com/
daps9494: FREE TPU
djdrae: @zaubages that will work?
quickcheck: #FREETPU
zaubages: @djdrae ask george...
Yoann_b: Could this be useful ? https://maelfabien.github.io/bigdata/ColabTPU/#
daps9494: here's another v1 implementation https://github.com/cea-wind/SimpleTPU
x_0_696969: https://awesomeopensource.com/project/embedeep/Free-TPU?categoryPage=11 @daps9494
x_0_696969: LUL LUL
sudoaptgetinstallurmom: Gonna go keep programming and finish my shit see u later
djdrae: georgy how can i scam investors by starting a autopilot company? that will work?
x_0_696969: LUL
rawrrzfn: xqcM scammaz
x_0_696969: ill help you out for 10% @djdrae  LUL
marschr: daym PAM transceivers
1azysniper: your a nerd you got this!
quickcheck: shiftYEPER we can emulate more than 4 dimensions
DragonMorcilla: Eigenvalue memory
djdrae: @x_0_696969 i wanna make aloy of money. and live like dan bilzerian
pitotaboy: @djdrae  become a dj
aalto34: dan blizerians a fraud
1ma___: dan who
big_dog_genetics: if money is not real then why does my back hurt
pitotaboy: @1ma___  dang your mama
djdrae: @pitotaboy why?
1ma___: @pitotaboy lol
Ayyyy420Lmao: @aalto34 fraud how? did his dad not really scam a billion from the federal gov?
aalto34: @Ayyyy420Lmao true actually
pitotaboy: @djdrae  to live like joe
fidetrainerNET: the algo suggest I should check indiefoxx, she must be in need of a TPU
shieeeeeeeeet: pikachures
MauriceChavez: yoink
djdrae: @pitotaboy why i want to live like joe rogan?
babaquon: 5 finger discount
big_dog_genetics: i went to Jacob with 25 thau
Ayyyy420Lmao: ask indiefoxx if her parents are proud of her. ez permaban
x_0_696969: she licks ears LUL
smurfd0: https://github.com/embedeep/Free-TPU
pitotaboy: @djdrae  the other joe
zaubages: @Ayyyy420Lmao your coment also permaban
Ayyyy420Lmao: @zaubages нет
fidetrainerNET: da
djdrae: @pitotaboy biden? maybe hunter biden. he looks like he has a fun life
big_dog_genetics: да
1azysniper: the internet says your the best hacker in USA, if thats true why stream this nonsense
pitotaboy: @djdrae not that one
LEXINGTONSTEELEROBLOX: whats thneed
aalto34: @1azysniper pretty sure he hasn't actually "hacked" in a long time
zaubages: i dont speak csm
big_dog_genetics: cant get mad bread with hacking
x_0_696969: yeah terrible
cleverclover7: cleverclover7 subscribed at Tier 1.
x_0_696969: was linked a minute ago
lebop: NEXT ONE
djdrae: @pitotaboy i dont know another joe
pitotaboy: @djdrae  joe is a good person and rich
lebop: HI FROM BRAZIL @georgehotz
x_0_696969: nope
x_0_696969: that is terrible
shieeeeeeeeet: what instruction set you looking for?
daps9494: Found another v1 remake
zaubages: HI U FROM BRAZIL
daps9494: nothing beyond that ojn github
samuel5755: https://patentimages.storage.googleapis.com/78/54/ba/c1e8901029486c/US20180341484A1.pdf
djdrae: @lebop you guys in brazil are living the life. bootyy everywhere
LEXINGTONSTEELEROBLOX: have you seen google s ai designed unit?
Lotts99: @djdrae LUL definitely not
davr0s: VLIW also makes me nostalgic (ps2 vector units)
Lotts99: @djdrae true about the "bootyy", but not true about "living the life" haha
cleverclover7: this blog is nice: https://medium.com/@antonpaquin/whats-inside-a-tpu-c013eb51973e
djdrae: @lotts99 brazil is like miami but you dont have to spend all that money
quickcheck: can't wait for the javascript accelerator card Kappa
Ayyyy420Lmao: brazil doesnt look comfy from what ive seen in gore sites
x_0_696969: @georgehotz  https://github.com/Domipheus/TPU/blob/master/isa/TPU%20Instruction%20Set%20Architecture.pdf
lolz133711337: @Ayyyy420Lmao l0l
x_0_696969: found something
big_dog_genetics: how do people making asmr videos live with themselves... save your dignity bro you'll need it
FastCashCoding: didnt cover this at CMU?
cleverclover7: theres a link to python mockup of systolic array in there
samuel5755: This has diagram of code and actual instruction set explained. But is a patent from microsoft. https://patentimages.storage.googleapis.com/78/54/ba/c1e8901029486c/US20180341484A1.pdf
MauriceChavez: LUL
djdrae: @big_dog_genetics lol
LEXINGTONSTEELEROBLOX: what process will this be done with?
Lotts99: @djdrae none of this is important when you don't have security, health and purscahing power is low
pedrogawa: @Ayyyy420Lmao I mean that could be said from anywhere if you look at these gore sites
Exclamation_mark_CODE: I have a 200-word essay due tomorrow, but I'm here looking up TPUv2 for George
marschr: rocket computer, if cherry gmbh gets annoyed
Ayyyy420Lmao: @pedrogawa never seen stuff from like.. jp or swiss
davr0s: there are some annoying patents out there, i think nvidia have morton order textures patented or something and probably a lot more besides
djdrae: @lotts99 thats true. you think its a good place for americans to go if they got some money? the infrastucture dont seem to he as bad as other countries
angrybud4: george is learning right now or making?
fidetrainerNET: probably learnking
x_0_696969: i can only find v1 stuff
Lotts99: @djdrae it's a really nice place to visit, to do tourism (with a tourist guide because he knows where you can't stay). But for living...
pedrogawa: @Ayyyy420Lmao I'm not saying brazil is anywhere a heavenly place to live, but japan literally just had a guy called twitter killer sentenced to death, but to each their own
samuel5755: Think in terms of signals, not code instructions.
quickcheck: LUL just copy the slide to the website
Lotts99: @djdrae I was never robbed, but the "feeling of living" here is not that good
big_dog_genetics: to each his own, i aint tripping as long as i can reach the chrome 🎶
virtuallynathan: What other options do you have besides HBM? GDDR6? DDR5?
vtcN_: When you going to invent something to replace electricity?
djdrae: @lotts99 oh didnt know it was that bad.
pedrogawa: My bad @georgehotz, sorry for that
virtuallynathan: HBM2e can be on-die, or on-package, which means low latency
x_0_696969: where is the repo for the site ?
Ayyyy420Lmao: rows x columns KEKW
djdrae: georgy i like it when you start your stream with good books about the subject. you already a expert with this. biology stream you was still beginner
THICC_Ogre: just took linear algebra last semester... how can i help?
Gazny: software defined tpu
Lotts99: @djdrae like we don't feel safe here. So we need to be aware of everything around us when go outside (at least me and my family do this). But it's not that bad. It's the greatest place in Latin America
x_0_696969: you will need a hardware ners
SleeveMcDichael22: i also just took linear algebra and i want to kill myself listening to this shit but here i am
karanberries: row by column gang
DragonMorcilla: rows* each column
jefferjordan: rows times columns
zaubages: cause linear algebra sucks...
creikey: AxB each row in A corresponds to a column in B sequentially
king_kvothe: Here is the video from where that presentation is from I think, it's an hour and a half long https://youtu.be/4bGoGjTRT9U?t=102
crazycatz59: granted most of us didn't learn how to multiply a matrix in high school
zaubages: u ask in your interviews that?
davr0s: Rij = AikBkj   summation convention
MauriceChavez: i just type it into my truty TI calc to multiply
crazycatz59: but multiplying a matrix isnt hard
djdrae: they say if you hang around smart people you become smart yourself. so i will just hang around george
MauriceChavez: trusty*
leafeey: Hmm
全能你大呢: did usa teach linear algebra in high school?
leafeey: borpaSpin
hardtarget4: yes
crazycatz59: @全能你大呢 they didn't in mine
davr0s: but the modifications for convolutions are probalby the more intersetying aspects of this
THICC_Ogre: not in mine. i just took it in college year 2
gliched_robot: Link to the talk for that TPU slides slides: https://youtu.be/4bGoGjTRT9U
king_kvothe: Here is the video from where that presentation is from, it's an hour and a half long https://youtu.be/4bGoGjTRT9U?t=346
virtuallynathan: Minor off topic thing thats tripping me out: twitch has spatial audio on AirPods (or my iPad is emulating it, and its weird)
djdrae: lex fridman says he always watching your stream. why he never comments lol
MauriceChavez: assert a.shape.1 == b.shape.0 ?
daps9494: be inspired by
Gazny: we are movers
big_dog_genetics: little rule to check the result, when youre mutiplying matrices inner dimensions must be the same like A is a 3x3 matrix and B is a 3x1 vector do when you mutiply 3x3 * 3x1  you get a 3x1 matrix
THICC_Ogre: @djdrae  i think he said he watched the reruns, not live
TheChosenPrometheanKing: we copycat from LUL
Ayyyy420Lmao: lex shilling ADA WutFace WutFace
gliched_robot: Link to the talk for that TPU slides slides: https://youtu.be/4bGoGjTRT9U
x_0_696969: early 70s hackers reversing IBM bios LUL
toledo60: For future networking possibilities LUL
djdark144: First in result entry 1.1 is sum of column from A and row from B matrix. If A.B you take first column of A and Rows from B for first row in C.
red__flag: show the G-guys how it's done, George !
vtcN_: taking back sunday
king_kvothe: Here is the video from where that presentation is from, it's an hour and a half long https://youtu.be/4bGoGjTRT9U?t=346
djdrae: lex shilling clubhouse too
virtuallynathan: HotChips is great
virtuallynathan: Lots of cool talks
Exclamation_mark_CODE: You transpose B, then do map-reduce, where map is multiplication and reduce is addition. Inner product does this. That way it can be vectorized
x_0_696969: where is the repo for the website?
MauriceChavez: use the N?
Ayyyy420Lmao: @mauricechavez cmonBruh cmonBruh
x_0_696969: yup N
davr0s: in games it was always 4x3/ 4x4 matrices and sparse matrices so we never had use for a big NxM multiplier like this. besides the fact we had a lot of systems with 4 element support.. my intuition is in line with Krste Asanović's assertions that general purpose processors are better
cleverclover7: https://en.wikipedia.org/wiki/Cannon%27s_algorithm
crazycatz59: @Exclamation_mark_CODE i just did that in SICP with lambdas
droblazedell: SICP is god tier
Ayyyy420Lmao: wrong dimensions? cant mult two 2x3 mstrices wtf
brett1479: col * row + col*row
dbgang11: isnt it 2x2
megaman0711: hmm SICP sounds fun
brett1479: that is the outer product way to multiply
playboijez: Honestly, I think that Fibonacci has something to do here
brett1479: I think you did the outer product backwards, but maybe I missed something
djdark144: is it not column of first and row of second matrix?
djdrae: georgy science says you need to get a 10 minute break after 2 hours of work. when science says it you need to do it
memphisFPS: @Ayyyy420Lmao memphi2Ayylmao
brett1479: &lt;0 2&gt; * &lt;4 5&gt; + &lt;1 3&gt; * &lt;6 7&gt;
EduardoRFS: 68 raiders from EduardoRFS have joined!
djdark144: https://www.khanacademy.org/math/precalculus/x9e81a4f98389efdf:matrices/x9e81a4f98389efdf:multiplying-matrices-by-matrices/a/multiplying-matrices
EduardoRFS: GL
cleverclover7: are you wanting to do mpi?
VATERZZ: Is he still on a M1 Mac?
AlianPro: levxycEita
EduardoRFS: just leaving the kids here because they need to know more than only JS
EduardoRFS: SIMD time?
djdrae: who is eduardo and why is he not talking about the topic?
br1anwiz: @djdark144 I did this the other day
quickcheck: wrap around? yes please
name100015: canon needs to explain itself
VATERZZ: m1 mac gang?
theonewhospeaksinfatcats: just watch some indian guy explaining cannon, always helps CoolCat
djdrae: i use these these streams as a benchmark. when i get smart i supposed to understand what hes talking about
ddoctor: damn linear algebra
djdark144: @br1anwiz oh okay. I don't know cannon's algo. I'm a "math" guy. not Data sci... (idk if my suggestions is of any use) What is he trying to do?
Photonshadow: what article is this
MauriceChavez: omg timing manipulation with staggered arrays? why would u force urself to do that?
cleverclover7: i don't know if you're "staggering" as much as breaking it up and streaming it from different places
kaisuketrax: Yeah what are you trying to do george ?
crazycatz59: is the problem that you can't write concurrency for the algorithm?
davr0s: whilst i can imagine how a pipelined matmul would work.. i wonder how this would be modified for convolutions.. banded matrices etc.
theonewhospeaksinfatcats: god i love linear algebra for shit liek this
theonewhospeaksinfatcats: but it's hard to understand sometimes
jefferjordan: @theonewhospeaksinfatcats Kreygasm
lebop: intel gang?
MauriceChavez: matrix mul 0,0 is AE+BG
davr0s: i have to check how Graphcore's approach stacks up against the TPU approach
iyajainfinity: You did BH instead if BG
julianprovoke: BG
name100015: pretty much
TheRealGecika: people do, but you're not an idiot
theonewhospeaksinfatcats: tbf i watched like some indian dude explaning this algorithm on youtube with like 6x6 matrix and it became clearer lol
chessbae98: @georgehotz TPU v4 version, I think it go's into more details: https://youtu.be/dQw4w9WgXcQ
djdrae: our boy georgy bad at math. but hes still our boy
x_0_696969: nice one @chessbae98
Photonshadow: lol
x_0_696969: LUL lUL
ddoctor: LUL
alexsheets12: heh
Saadzz: LUL
djdark144: haha
x_0_696969: LUL LUL
crazycatz59: LUL
MauriceChavez: LUL
panthurrr: got em
fancyexecutioner: LUL
sangor: LUL
x_0_696969: LUL
SurfCat: LUL
cleverclover7: haha
VATERZZ: LUL
lebop: LUL
mateusf777: Jebaited
deep5: Yes LUL
x_0_696969: LUL LUL
Saadzz: GOT EM LUL
zerophases: Is it possible to make all the phones in the world ring at once, if some dude's bank account hits a trillion dollars?
valtspri: LUL
djdrae: lol
plasticityyy: https://www.youtube.com/watch?v=sJltBQ4MOHA
TheRealGecika: haha
ImJ4Gu4R: NotLikeThis NotLikeThis NotLikeThis NotLikeThis
wraith_: LUL
Exclamation_mark_CODE: LUL
ddoctor: yeah good animations indeed
Feruniel: lmao
THICC_Ogre: ResidentSleeper ResidentSleeper ResidentSleeper
SurfCat: never get's old
x_0_696969: LUL
Cracktune: YES!
Bullanguerock: xd
br1anwiz: Clap
quickcheck: KEKW
valtspri: haHAA
Cutza: LUL
chessbae98: LUL GOT HIM BOIS
MauriceChavez: nice anim
david_monss: LUL
davr0s: very nice
ileno: it is just a convolution
MauriceChavez: crazy algo
cleverclover7: i prefer: https://www3.nd.edu/~zxu2/acms60212-40212-S12/Lec-07-3.pdf
x_0_696969: look cool af
djdark144: This might be "the thing"
cleverclover7: that was cool tho
valtspri: new company idea: just make matrix animations and sell them for big bucks LUL
mo_askar: the problem is shifting the input and weights in this specific format to get maximum performance
quickcheck: funky
FancyDawg_: https://clips.twitch.tv/FuriousPlumpGoatDuDudu-NSvV7uHT4J6PqQsD
Cracktune: m
Saadzz: monkaS
virtuallynathan: I’ll stick to my servers
cleverclover7: haha my bad
theonewhospeaksinfatcats: @valtspri don't fucking share this with people who make textbooks please
x_0_696969: hardware sucks
djdrae: the dude from khan academy dont explain this stuff? i thought he knew everyhting
ImJ4Gu4R: WutFace
djdrae: when does the cannon comes in the systolic system?
Ayyyy420Lmao: greetings from mumbai sir
marcelbischoff: marcelbischoff subscribed with Prime. They've subscribed for 5 months!
Nomad_King: We hate them too
alexsheets12: im just here so i dont get fined
TheRealGecika: I hate anything that makes me feel stupid...haha
quickcheck: I can't stand them
TheRealGecika: this is up there on the list
MauriceChavez: lol what happens when u go more dimensions?
x_0_696969: more complex
virtuallynathan: Find the original paper
virtuallynathan: Where they were first implemented
quickcheck: what's the deal with systolic arrays
coolcake2: vim asci art
davr0s: yeah i was going to say ,  i got the impression google made the TPU instead of a graphcore style thing because it was easier, i have difficulty imatgining that somethign like this could exploit all the special cases of data locality/reuse as well as the fully programmable core grid idea
cleverclover7: fucking vim
plasticityyy: More detailed animation: https://youtu.be/cmy7LBaWuZ8?t=74
smurfd0: https://github.com/antonpaquin/SystolicArrayDemo Easier to understand?
smurfd0: Python
djdrae: is georgy this productive when nobody is watching? if he is then i understand why he is this smart
x_0_696969: The parallel input data flows through a network of hard-wired processor nodes
valtspri: "Evanaescence My Immortal" in the recommended vids LUL
virtuallynathan: I bet its just overall more efficient even if it wastes cycles
jefferjordan: @valtspri  GlitchCat
x_0_696969: prolly not logged in @valtspri
davr0s: getting data into the right place is often more expensive than actual arithmetic
coolcake2: are we just working on square matrices for now?
x_0_696969: yeah @davr0s
djdrae: lets do a 10 hour stream today. this topic very important. we gonna change the world
coolcake2: yeah i dont see why we need all these zeroes then. looks wack
Nomad_King: Is he trying to build his own computer from scratch?
h4sb: lol
cleverclover7: yeah that link from @smurfd0
amuzinc: systolic arrays are amazing
x_0_696969: zero's in random positions cannot be removed for enhancing utilization
x_0_696969: btw
sangor: LUL
davr0s: i remember being shown some figures.. picojoules to read memory.. vs picojoules for fmul .i can easily imagine multiplying zeros is worthwhile if it simplifies the dataflow/access
valtspri: Euler didn't use no Systolic Arrays and look how far he got
dontbeameme: Real Tom cr00se pls stand up
Gazny: half of it is zeros
plasticityyy: Looking at the later steps the benefit outweighs wasted 0s
djdrae: euler is a dinosaur
cleverclover7: the chunks move faster through the system (even with zeros)
x_0_696969: what about SIMD
amuzinc: Euler was an alien
br1anwiz: its a nessecary evil
valtspri: what if the zeroes are data from the previous multiplication operation, then no waste SeemsGood
Theguywhobea: use a diastolic array :)
kidinspace: Are we still cherrying?
x_0_696969: @georgehotz  https://en.wikipedia.org/wiki/SIMD#:~:text=Single%20instruction%2C%20multiple%20data%20(SIMD,on%20multiple%20data%20points%20simultaneously.&amp;text=Most%20modern%20CPU%20designs%20include,the%20performance%20of%20multimedia%20use.
x_0_696969: https://en.wikipedia.org/wiki/SIMD
x_0_696969: that link came out wrong lUL
SirApocalipsys: @Theguywhobea Diastolic arrays are arrays of processing elements that communicate exclusively through First-In First-Out (FIFO) queues.
djdrae: you think cherry computers will make the human race extinct. with all these advancements
cleverclover7: good job!
x_0_696969: Flynn's taxonomy LUL
crazycatz59: facts
amuzinc: stop attacking college people
valtspri: Archimedes didn't need to go to college
djdrae: @valtspri and where he is now?
amuzinc: in the annals of history
TheKoreanZombi: Quick, post your favorite matrix operation algorithm created by someone that didn't go to college!
x_0_696969: SIMD supports mechanisms to detect zeros and only map non-zero weights/inputs
valtspri: 76 character line widths, what is this Fortran 77?
fullbr1ng: Aren't the small upsides he is getting by streaming massively outweighs by his productivity loss? I guess im missing some of the upsides
djdrae: @amuzinc archimedes is a group of people. he just took all the credit.
MauriceChavez: heres an article why systolic dont scale. cant understand half of it. https://cplu.medium.com/should-we-all-embrace-systolic-array-df3830f193dc
amuzinc: @djdrae just like academics today, nothing changed LUL
djdrae: @amuzinc its a scam
coolcake2: leave a comment on this guys' channel. 2 subs. poor guy
lookingforasuna: ^^^^
Photonshadow: you need one clock delay between each column
Photonshadow: so basically shift registers
coolcake2: wait. so 128 ticks to multiply a 128x128 matrix?
wowsoclutch: HeyGuys
fuzzywuzza: HeyGuys
TheChosenPrometheanKing: bcache in reset(), no?
TheChosenPrometheanKing: you wrote the same twice i think
optionalflag: because its the eigenvalue
x_0_696969: KEKW
astrixial: https://codeforces.com/problemset/problem/1312/E example of that
plasticityyy: I think you're doing somehting weird with 0s
ddoctor: damn eigenvalues I hated when I had to study those
plasticityyy: lower right is fd
FastCashCoding: damn, eigenvalues
FastCashCoding: take the hamiltonian
wowsoclutch: LUL SeriousSloth
djdark144: @fullbr1ng Then leave.. Don't be a Downer...
layke1123: floating point errors
optionalflag: youre going to need to multiply out the gravitational constant
coolcake2: where are you test george? LUL
coolcake2: tests*
FastCashCoding: maybe cosmological constant
wowsoclutch: lol coolcake
x_0_696969: characteristic roots
optionalflag: monkaS
FastCashCoding: please no george
layke1123: 2 x 2? try to simplify
astrixial: https://codeforces.com/problemset/problem/817/D this a more hard implementation
optionalflag: sorry geo I will behave now
rbsrbs: you mean a donut
Silensrunners: monkaS
coolcake2: no, we are math ppl here. torus is the way
FastCashCoding: OpieOP
djdrae: georgy why you never watch the whole video?
x_0_696969: yeah donut is always the answer
h4sb: need a muffin
optionalflag: @coolcake2 LUL
x_0_696969: what about SIMD
optionalflag: Is it a size issue&gt;
mo_askar: does this help: https://github.com/obilaniu/MVU/blob/06b9784a4f27b82fb5d77a6879afdbedf0429a8f/verification/scripts/systolic.py
red__flag: all algorithms deserve love
mo_askar: nooooo
quickcheck: george vs algorithm
mo_askar: the systolic code
smurfd0: Google systolic array python example u Find github to se if u got it right
quickcheck: lozenges WutFace
djdrae: we already past the cannon? why we just talking about systolic stuff lol
optionalflag: PogChamp Lagrangian Lozenges!
SurfCat: Hmm, lasagne
davr0s: https://khairy2011.medium.com/tpu-vs-gpu-vs-cerebras-vs-graphcore-a-fair-comparison-between-ml-hardware-3f5a19d89e38 nice chart comparing TPU , Nvidia, Cerebras, Graphcore on various metrics in the middle of this page (flops/mem bandiwdth, flops/watt, etc)
x_0_696969: SIMD &gt; Systolic arrays
davr0s: more versatile, i agree
Exclamation_mark_CODE: only values below the diagonal are wrong it seems
davr0s: however another matmul may be the market gap , if graphcore is already out there and google keep their TPUs to themselves
Silensrunners: *thinking noises*
cleverclover7: you have activations (left-&gt;right multiply) and partial_sums (top-&gt;bottom sum)
tallestmollusk: why is chat ded?
amuzinc: i just ate pizza with a spoon
sytraad: have you considered doing this in a tub?
sudoaptgetinstallurmom: what is that sound in the background? its distracting
amuzinc: that video actually explains it farily well
gameza_: this is way beyond my frontend career
crazycatz59: @gameza_ time to upgrade
fullbr1ng: @sytraad LUL
amuzinc: @gameza_ nothing is way beyond
djdrae: @tallestmollusk we focused
wowsoclutch: your first problem is using medium for advice
br1anwiz: @gameza_ want to help me make a cherry website? I'm working on it rn but I'm a HTML noob
crazycatz59: @br1anwiz we already have a cherry website
Billsterrr: Billsterrr subscribed with Prime.
br1anwiz: @crazycatz59 he said he wants someone else to make a good one
gameza_: @crazycatz59 same income for both careers
crazycatz59: @gameza_ the money is fake btw
astrixial: hint: For each element we will try to find the number of segments where it is the leftmost minimum element. So, we will calculate two arrays left (left[i] = j means that j is the maximum index such that ai ≥ aj and j &lt; i) and right (right[i] = j means that j is the minimum index such that ai &gt; aj and j &gt; i). So actually, left[i] and right[i] represent the borders of the largest segment where ai is the leftmost minimum element (and we need to exclude those borders). While knowing these values,
x_0_696969: ill help you out @br1anwiz  where is the repo?
rbsrbs: nice copy pasta
optionalflag: TPU demo dot com PogChamp
br1anwiz: I'll push to the logo repo here: https://github.com/BrianWisniewski/CherryComputerLogo in a sec. I literally just started.
iyajainfinity: The end goal here is to do more arithmetic operations per memory access, right?
plasticityyy: This is the animation I was looking for
optionalflag: just write it 4Head
coolcake2: can we trust this animation for what is actually is in their algorithm?
crazycatz59: @coolcake2 the animation specified the algorithm. we just need to build it
gameza_: yeah, let's undestand 30 years of cs research in a sigle whitepaper
keiner2: imagine how much it cost Google just to have that video made lol
kidinspace: It looks exaclty as the other video with the wireframming
kidinspace: the shape is the same
BlueSeamoose: Neat
layke1123: I just double clicked on this video to make veorge skip ahead. I'm an idiot. XD
quickcheck: shifting and accumulating bb
x_0_696969: not real
coolcake2: wait so we get linearized matrix on the output?
kidinspace: shifting like a window
Nomad_King: They wouldnt want people to understand it
Gazny: Bamboozled
pwnbase: dramatization: paid actors
optionalflag: optional transpose WutFace
gameza_: spacial computing using python, noice
gameza_: so gauss jordan is not helping huh
smurfd0: Cloud.Google.com/tpu has some highlevel info about their cloud tpu stuff
hbattousai_: Can someone a little bit explain what he is doing? What's the purpose?
kidinspace: It looks like an LSTM architecture with something else
jjcrispyy: he is solving the matrix
Cordoro: the 5 is at the bottom
r3ndd: LUL
Cordoro: I think
kidinspace: It looks like using lstm for images.
l4ndd0: are your neighbours having a disco?
flank_steak: the bottom input has already shifted N times, so gets an output
gameza_: he still using the hh kbrd?
Ziv0: @flank_steak yup
plasticityyy: in the animation each row is a matrix
iyajainfinity: Another visualization (using LEGOs): https://youtu.be/JC84GCU7zqA?t=124
optionalflag: good guesses :)
theonewhospeaksinfatcats: CoolCat everytime i hear about acc i remember playing shenzhen i/o
quickcheck: holds the results of additions
djdrae: i dont even know the difference between tpu and gpu. when i watch alot of georgy i become alot more smart
Sensat1onaI: sup George
flat__white: tpu has no graphics
Darnell_ll: PogChamp
optionalflag: accumulators accumulate legos?
davr0s: this animation seems a bit more gimmicky
djdrae: @flat__white oh thank that makes sense
Juaamba: way too dank
Poisonslash: Imagine how long it took to edit the cuts of moving all the legos LUL
theonewhospeaksinfatcats: tbf i can't get shit from animation, understood it way better with tables
sigfyg: systolic arrays are old news bro
optionalflag: @Poisonslash less time than understanding the concept LUL
davr0s: i must say i get more understanding from animated block diagrams than stop motion legobricks
UntiedSoul: what paper was on archive
djdrae: @sigfyg you mean outdated or just old?
djdrae: what are the legos in the real world lol
engineer512: yeah lego animation is nice
Gazny: @sigfyg give a better solution
ZMcGuckin: I’ve never caught George live LETS GOOOOO
optionalflag: @sigfyg nice bro yur cool
optionalflag: @ZMcGuckin caught in 4k?
coolcake2: yes
FastCashCoding: uh
FastCashCoding: its very hard
rbsrbs: both Kappa
amuzinc: its kind of hard to visualize
kidinspace: is super hard
davr0s: i think this is easy until you get onto modifying it for convolutions
layke1123: but lots of people are dumbing sooooo
quickcheck: matrices are tricky
Cordoro: I failed my matrix multiply grad class, so I think high order matrix crap is tricky
collindeb: no this is hard
engineer512: are the neighbors blasting bass?
Silensrunners: What is the background music?
layke1123: he quit?
amuzinc: yes its music
flat__white: on the chip of course it is all parallel, so he has to implement that part serially here, which is annoying to program
heytherechat: drunk neighbors probably
davr0s: its probably hard to do it in a livestream
amuzinc: @layke1123 just taking a sanity break
collindeb: who's music is so loud
optionalflag: just think like a computer 4Head
engineer512: nah dude he's taking a piss
h4sb: rage quit
djdrae: gey you on of these toilets under your seat. you become more productive
ZMcGuckin: @davr0s why you gotta piss him off 😂
hardtarget4: apartment life
collindeb: poor george has to live though that
grapevines123: yo yo yo whats good bruh
engineer512: yeah fuck that music
collindeb: george bang on your wall and tell them to turn it down
amuzinc: why dont people just use headphones
grapevines123: You confusion matrix looks confusing
grapevines123: your*
optionalflag: george is this generations top rockstar engineer
h4sb: he's tuned the music totally out
davr0s: ZMcGuckin just speaking my mind. i think these systolic arrays dont have as much potential as the graphcore approach. but it's relevant that google went this approach.. its less hard to design this hardware
Gazny: This is where we put our clock cycles to work
ZMcGuckin: Whenever I think I’m a good engineer I watch George to remind myself how shitty I am
UntiedSoul: its decreasing going up?
grapevines123: @optionalflag Stop s0cking bro
amuzinc: @georgehotz just do the 2 by 2
djdrae: nvidia uses graphcore?
davr0s: no graphcore is different to both tpu and nvidias vector approach
layke1123: he did the 2x2!
optionalflag: PogChamp
davr0s: there's *3* contrasting approaches to this problem
grapevines123: This is stupid enough bruh...
coolcake2: i dont think this works for 2x2? or does it?
grapevines123: Btw the guy that created algorithm, created algebra, and also created number....
djdrae: @davr0s whats wrong with the vector approach
grapevines123: https://en.wikipedia.org/wiki/Muhammad_ibn_Musa_al-Khwarizmi
davr0s: (i) dedicated matrix machines (ii) vector processors (eg nvidia,risc-v hwacha) (iii) message passing, small cores ("super computer on a chip")
cutesalmon__: mr. geo hot would you be so kind as to implement this in verilog. its definitely not related to my assignment due next week
Ba6ix: this guys life involves arrays i swear
ilovebread07: Finally i catch a Live georgehotz!!!
anonqqq: its nice seeing someone struggling in code other than me lol
crazycatz59: @cutesalmon__ we will but not for your homework
djdrae: @davr0s i think thats above my paygrade lol thank you sir
davr0s: djdrae in my opinion only the super-computer idea has the best combination of versatility and scalability, at the expense of software complexity - but software is the easist bit to improve later, way more people can work on it
barkazzaz: how many of you guys in chat know what's going on right now?
cutesalmon__: what is an fpga even
anonqqq: not me
wilsden: nope
cutesalmon__: just use arduino 4Head
grapevines123: @cutesalmon__ omg....
crazycatz59: @cutesalmon__ can't program arduinos like fpgas
anonqqq: i burnt out on programming with javascript tutorials
Rocker95: i did they 5 min after i was born, it's easy
anonqqq: turns out you dont learn how 2 program with tutorials*
ZMcGuckin: @barkazzaz not a damn clue
flat__white: what's going on is implementing systolic arrays in code
optionalflag: @cutesalmon__ Field-programmable gate array
djdrae: @davr0s oh thanks
grapevines123: When a streamer takes python engineers to embedded world... smh
superbang143: no idea lol
cutesalmon__: i think hes multiplying matrices chat, using something called systolic artays
davr0s: the games industry rejected the "supercomputer on a chip" idea (CELL) but thats because the software didn't have time to catch up. it's 2020, we have much better software tools now.
wilsden: lol
grapevines123: I'm out have fun noobs
davr0s: i am ashamed of the games industry for wussing out of this problem
optionalflag: EZ accs shifting
anonqqq: the games industry is garbage
grapevines123: @anonqqq All corps are shitt
anonqqq: poop out triple a games
davr0s: the games industry has its low points but it deals with high performance software
barkazzaz: games industry is just evil nowadays
grapevines123: any comp that the CEO is not an engineer sucks
davr0s: note that the predominant AI devices are spin-offs from games devices
superbang143: what language is this in ?
flat__white: so what, you always need 2x the memory to store these going in, or there are tricks for the zeros?
optionalflag: plus another 2_?
chapopotes: @superbang143 pythonb
walruous: yoyoyo
tusharm57123: @superbang143 Python
superbang143: ty
andiamosoftware: 4+2*2
grapevines123: Amzn was dope...
optionalflag: @chapopotes no this is pythonA
anonqqq: matter a fact ive seen a ton of games on video game indie forums that had a ton of potential
chapopotes: @optionalflag lol
walruous: Has anyone here used Numba?
keiner2: good luck translating the numpy broadcasts and transposes to verilog ^^
chapopotes: @walruous no but used Numbb
iyajainfinity: For each "cell" if you get a value from the left, multiply, move up, and pass through to the right. If you get a value from the bottom, pass through upwards.
ilovebread07: Good morning from the Philippines man...  now i get what you are doing on your terminal after our OS Subject lecture.. we are now using Unix Terminal to code and to go through files. &lt;3 yesterday we just learned how to use vi text editor &lt;3
barkazzaz: just look at Cyberpunk and you will get to see what "gaming industry" means today
anonqqq: XDDD
barkazzaz: it's just about over promising
wilsden: how many people in the world understand systolic arrays?
walruous: @chapopotes What's Numbb?
davr0s: i'm talking about games tech not gamedsing,marketting  etc, i dont care about all that
chapopotes: @walruous jk
engineer512: I spend to much time programming Matlab to try to use numpy broadcasts
grapevines123: forget about the bs fpga, lets go trolling
djdrae: @grapevines123 palantir also?
optionalflag: @ilovebread07 PogChamp
walruous: @chapopotes i think i just ate glue
grapevines123: @djdrae whats plantir
anonqqq: i only know how 2 program on scratch
walruous: @grapevines123 Military consulting I think or something like that
cutesalmon__: my digital hardware prof is so cool, i dont understand hardware shit but he makes it interesting :)
djdrae: @grapevines123 peter thiel company
landwirtskammer: The myth the legtend
ilovebread07: after that OS Class i just wanted to code on the terminal and vi text editor much more fun to code AHAHA
djdrae: if all gay guys were as cool as peter thiel. you think you would be gay?
many_mangos: aww cmon just copy the tpu 4Head
cutesalmon__: @ilovebread07 i feel you btrother, come to brazil!
walruous: I can't wait take OS at uni
grapevines123: Idk them
Gazny: inspired*
grapevines123: Idk that comp
optionalflag: aren't nvidia ray tracing cores technically TPU based?
walruous: Apparently it's one of the hardest classes
davr0s: to program these massively parallel machines .. we just need things like SYCL which can mix kernel code with program code in templated/generic abstractions. We didn't have that in 2005 when CELL hit us. we do now. and we have languages that handle generic abstrations better than C++ even.
coolcake2: did you see this paper George? https://www.sciencedirect.com/topics/engineering/systolic-arrays
coolcake2: if you scroll down a bit they show pics
cutesalmon__: yo should i send u the lecture frim my uni on TPUs
djdrae: google is a scam
ilovebread07: im a 2nd year college student few weeks from now im a 3rd year.. it sucks tho not fun to learn when you are just at home rather than goint to the actual university that you are enrolled :&lt;
grapevines123: TPUs make some ppl horney btw
Nomad_King: because its so beautiful
davr0s: nvidia TPU is not the same as Google TPU
davr0s: overuse of TLAs hah
MauriceChavez: google is evil
pepperjoao: for people wondering how to get used to vi: as anything in life, just use it until it becomes natural
MauriceChavez: this show u their true colors. TRULY EVIL
wilsden: i feel stupid
grapevines123: @MauriceChavez Less evil than you, no?
optionalflag: @davr0s google is less dependent on time?
barkazzaz: google is evil, but man do they write some good papers
davr0s: nvidia TPU is just a glorified simd instruction in their compute units, google tpu is this whole systolic array
anonqqq: is it better to learn algorythms and data structures than the syntax of a language any1 in the chat offer insight? i wanna retry learning javascript
grapevines123: @barkazzaz Your more evil to talk shit about them
MauriceChavez: @MauriceChavez its a throwback joke when they removed their slogan "Dont be evil"
jefferjordan: @anonqqq yes
ilovebread07: we have an algo subject and Data struct and Algo subject last semester its fun though
grapevines123: @MauriceChavez dude, go way
coolcake2: @anonqqq how are you gonna learn algorithms without knowing language syntax? with pseudo language? dont do that
optionalflag: @davr0s "glorified SIMD" was my nickname in high school
crazycatz59: @anonqqq depends on how you want to implement the data structures and algorithms cuz each language is different.
barkazzaz: who is this sub snubbing for Google LUL
Crud98: do you miss glen rock @georgehotz emoneySwag
grapevines123: Guys stop b1tching
sangor: LUL
MauriceChavez: @MauriceChavez ? how about u block me
ilovebread07: is the High school curriculum on your country have Computer Sci/IT related subjects?
pepping_dore: @optionalflag Ray-(BVH/triangle) intersection is totally different from matrix multiplication.
grapevines123: @MauriceChavez just shut
anonqqq: oo oki
barkazzaz: your name has "123" at the end, you get no say here
grapevines123: Your mom is evil idiot
keiner2: did the unabomber use unapads?
crazycatz59: @ilovebread07 high school cs anything is total trash. only learn college stuff and if you're new to cs you should read SICP
joaovictorsnt: what I earn subscribing?
davr0s: its funny how many AGI people deride GPUs as being "just for matrix multiply" , when nothing could be further from the truth.
optionalflag: @pepping_dore ray tracing cores dont ray trace they denoise LUL
cutesalmon__: come to brazil guys i have startup here
grapevines123: what did they do to call them evi?
grapevines123: idiot
grapevines123: just diot
djdrae: agi is also a scam from google
anonqqq: come to my house i have a bootstrapped startup
grapevines123: You trained your nn on nonsense
ilovebread07: SICP = Structure and Interpretation of Computer Programs? i this right?
joaovictorsnt: @cutesalmon__ I live in Brazil
wilsden: grapevine, qq
MauriceChavez: @joaovictorsnt a lot of ppl like grapevines here like to talk off topick shit so chat is often in sub only mode
fogofchess: Can't see full message with cam in lower right corner
crazycatz59: @ilovebread07 yes
br1anwiz: https://github.com/BrianWisniewski/CherryComputer
davr0s: GPUs are designed fro much greater versatility including scattergather .. matrix multiply does waste a lot of what a GPU can do (which is why dedicated AI chips are an opportunity)
grapevines123: @joaovictorsnt just sf up
sangor: @MauriceChavez wouldn't help since he's a sub LUL
Crud98: emoneyGA
GangBaggins: This message is on topic
optionalflag: this is all on topic Kappa
MauriceChavez: @sangor yeah :(
flat__white: so the google tpu has a 128x128 matrix and partitions up larger matrices?
grapevines123: who in 2021 repeats the stupid 2015 bs... on @MauriceChavez
optionalflag: spam programming is like TPU roleplay?
grapevines123: have you taken an iq test @MauriceChavez ?
djdrae: china aint shit. this the stuff they supposed to be building. they are becoming useless
gingimli: is that plant real?
optionalflag: did we did it now?
cutesalmon__: PogChamp
grapevines123: G00G is one of the least evil corp
barkazzaz: LUL
valtspri: Just invent a new algorithm Kappa
davr0s: its just a steamroller.
wilsden: LUL
grapevines123: Their TPU is actually dope
anonqqq: just make your own algorhytms
optionalflag: monkaS large matrices
grapevines123: Only h@ters hate
crazycatz59: @valtspri probably isn't too hard? (big question mark)
optionalflag: who has two thumbs and implemented systolic matrices?? this guy
valtspri: If matrices had thumbs monkaS
GangBaggins: Give them cake
pepperjoao: at the end of the day, we all are just George's rubber duck
wilsden: LUL
MauriceChavez: the tpu has bad scaling aswell
barkazzaz: don't understand = shit LUL
flat__white: 2x memory
davr0s: i think google made TPU instead of graphcore because it was just less hard to develop.
cutesalmon__: yo georhe come to brazil
coolcake2: well what other algorithm gives O(n) for matrix multiply?
iyajainfinity: The only advantage of this more arithmetic operations per memory access, right?
grapevines123: Give me something better then talk crap, you know
grapevines123: simple logic
djdrae: why everybody here from brazil? they got smart people there? i thought all they did was party
optionalflag: just don't even access memory 4Head
cutesalmon__: cerebras
grapevines123: jetson is the worst
GangBaggins: They got big asses
davr0s: we will have to agree to disagree
ilovebread07: brb guys... i have an Algorithm subject report about BFT byeee
grapevines123: Nv1d1a is the worst lol
cutesalmon__: check out cerebras
keiner2: now backprop through the systolic array :D
Gazny: It really is all marketing
toledo60: where’s the buy now button LUL
grapevines123: Oh i don't like anything oversees
I_am_paranoid: PogChamp cube
grapevines123: American only
optionalflag: @grapevines123 even tx2?
dorkmo: FrankerZ100
MauriceChavez: @keiner2 LUL
flat__white: just throw silicon at it
valtspri: A cube, or as it's more commonly known, a hypersquare pog
optionalflag: DaVinci core 5Head
sangor: da vinky core
coolcake2: https://www.sciencedirect.com/book/9780128234884/ascend-ai-processor-architecture-and-programming
djdrae: everything with davinci in it. sounds like a scam to me
barkazzaz: lets just go back to Legos
anonqqq: davinki??
optionalflag: PogChamp YES
coolcake2: yeeeeeee
clorx: 3D matrix is fancy
grapevines123: anything built in Ch1n@ is shit quality
wilsden: dorito
joaovictorsnt: tensorflow sucks
I_am_paranoid: PogChamp cube PogChamp cube
grapevines123: I hate ch1n3s3 products
panthurrr: thats a good cube
MauriceChavez: Qube
coolcake2: SSSsss
davr0s: I will still buy a dedicated matrix engine for $1000 if you can make it  , but my #1 desire is a modern CELL, programmed with modern tools
valtspri: coob
clorx: Cuuuuuuuubeh
djdrae: @grapevines123 american cars suck
UserNameThe3rd: When cherry computer cube animations
grapevines123: Cube lol
crazycatz59: CUBE GOOOD
cutesalmon__: qeub
clorx: Cuooooooooooobeh
pepperjoao: cubes = loved
anonqqq: i just use bicycle
sangor: cube &gt; systolic matrices
fogofchess: Cube
optionalflag: yes we love it ofc
I_am_paranoid: PogChamp cube winning
Gazny: if cube gives us progress yes
flat__white: implement the cube in python now go
MauriceChavez: yeah just make a bigger qyub
coolcake2: WE *clap* SSSsss Love SSSsss the SSSsss cube SSSsss
wilsden: LUL
cutesalmon__: cube &gt; biden
djdrae: nvidia is bae
valtspri: Make an animation first, then the algorithm will follow LUL
sufiann69: qqqqqqqqqqqqqqqb
quickcheck: he's building the cube from that movie monkaS
davr0s: its failed because we allowed mediocre programmers to outvote us
grapevines123: @djdrae It sucks cuz the CEO is 1nd1an
davr0s: crab bucket
jefferjordan: @valtspri lol
Cordoro: cell was a pretty sweet experiment
clorx: Cuooooooobeh
cutesalmon__: gn
davr0s: we have better tools now
grapevines123: America invented cars
MauriceChavez: wow grape racist much?
grapevines123: T3sl@ model is american btw idiot
aluminum_extruder: george goes tessaract in a move that astounds absolutely everyone
djdrae: @grapevines123 tesla cars suck
grapevines123: America is the best stfup
aymamoon: I am glitching out
jefferjordan: @grapevines123 yer gotdarn right
clorx: Cuoooooooobeh
iyajainfinity: What do you get by going cube?
djdrae: @grapevines123 elon is a african
keiner2: q-beh
grapevines123: Twitch is American... have some respect where you chatting
ts012839050: Hello Cube
valtspri: what about... 2 cubes!
optionalflag: D:
davr0s: CELL must be turning in its grave when they see Nanite in UE4. that was closer to sonys original plan
clorx: hahahahaha
davr0s: UE5 i mean
clorx: Cuoooooobehh
aluminum_extruder: @grapevines123 doesnt mean nobody is allowed to criticize the united states.
Gazny: why stop at double
grapevines123: El0n is an American now, no?
coolcake2: Q.U.B.E
quickcheck: hypercube
Exclamation_mark_CODE: Make diastolic cube algorithm
pepperjoao: hear me out... array of cubes, anyone?
djdrae: @grapevines123 indian guy also a american
Gazny: Elon is south African
risky_banana: I like it
grapevines123: @djdrae haha that's actually true
risky_banana: Good function
plasticityyy: @pepperjoao cube of cubes?
iyajainfinity: What about systolic arrays but in 3D?
valtspri: a cube of cubes? monkaS
optionalflag: riski_matmul was @risky_banana 's nickname back in the day
pepperjoao: yeah boy
grapevines123: That was goood
coolcake2: 4 dimensions so yeah
grapevines123: haha
coolcake2: hypercube
Cordoro: what about a cube of cubes?
djdrae: @grapevines123 lol
I_am_paranoid: PogChamp hypercube
grey_street: systolic cubes
zartharus: If systolic arrays are so powerful, just imagine what you can do with a systolic cubes!!!!!
pepperjoao: fuck systolic array, we are here for cube
coolcake2: all my hommies hate systolic arrays
grapevines123: Ok I gave up. Lol... at least I'm not arrogant.
Gazny: My best friend is now cube
djdrae: does cube also work with cannons?
Cordoro: accubulate
clorx: We need more streamers like Hotz on twitch, I’m sick and tired of female gamers flashing their bobs for viewers and subs lol
grapevines123: I accept truth.
pepperjoao: @clorx you are not forced to watch them lol
sangor: @grapevines123 you're in denial my guy LUL
barkazzaz: @sangor he sure is LUL
djdrae: @grapevines123 thats a good quality to have
valtspri: cubes are so yesterday, trapezoidal prizms are the future, maaaaan
grapevines123: @sangor Get out bruh... I invented trolling
clorx: @pepperjoao true, we just need more diversity in streamers
zartharus: I’m serious, just imagine what you can do with systolic cubes! I fell cherry stocks prices rising already!
wilsden: rhombus?
karanberries: tesseract gang
clorx: @pepperjoao they have a monopoly on viewers hahah
AlexEDM: ILY GEORGE
AlexEDM: &lt;3
pepperjoao: @clorx that I can agree, science &amp; tech section gets so little attention
anonqqq: i cant find anything about what cherry computer is
djdrae: make cherry computers a spac  you will raise a billion dollars
anonqqq: any1 point to links??
anonqqq: ples?
grapevines123: Let's play me vs your friends in the end
crazycatz59: @anonqqq https://github.com/geohot/tinygrad/tree/master/fpga
grapevines123: tomcr0000000000sing bruh
wilsden: this stream could be improved with a hot tub and binaural ear mic
grapevines123: tomcr00000sing the ASIC the world hahah
clorx: @grapevines123 don’t be the one who brags about things they didn’t achieve, being an American doesn’t make you special
quickcheck: add an eye tracker
anonqqq: @crazycatz59 so its a AI chip?
grapevines123: @clorx relax relax
MauriceChavez: @clorx dude ignore the troll
crazycatz59: @anonqqq yes its an ai training chip
optionalflag: how many americans does it take to mult a mat?
anonqqq: @crazycatz59 cool :D
grapevines123: We all moved on except @clorx
sloppy_00: can you turn on the light?
barkazzaz: yeah you're turning orange on us
optionalflag: 4Head just do it across time
grapevines123: You're inventing a new linear algebra lol??
davr0s: thing is .. to make something truly scalable, you have to be able to use seperate memories and message passing for clusters anyway - so once the world has *truly* mastered that, we'd have alll the tools for handling these many-core grids aswell.
grapevines123: Jusft FYI, linear algebra works bruh
optionalflag: 1337 random seed PogChamp
bits_n_atoms: semi conductor packaging will change everything.
aluminum_extruder: @bits_n_atoms are you from CBA MIT
grapevines123: G00gle is awesome
djdrae: @grapevines123 you need a hammer
bits_n_atoms: @bits_n_atoms fan of em, but no
davr0s: all the peices i want are in seperate places
aluminum_extruder: @bits_n_atoms same here, they have some cool stuff
gliched_robot: OK, not gonna lie,  Reading about TPU feels like I am reading fucking future. Smart MFers
grapevines123: @djdrae Na, I just need to join the "MENSA" stream &amp; chat
davr0s: andreas olofsson designed the chip i want, mozilla made the language i want to use to code for it, codeplay software made the compiler back end
aluminum_extruder: @davr0s rust?
anonqqq: any of yall heard about web assembly?
pepperjoao: meh, ok I guess..
djdrae: who tf is mensa?
grapevines123: @djdrae g00gle haha
djdrae: @anonqqq thats for noobs
Gazny: Carlos Mencia
grapevines123: @djdrae g00gle it*
davr0s: aluminium_extruder correct. people say "parallel programming is hard" because the languages dont have the right restrictions. now pure-FP is overkill. rust has the right balance.. correctly restricted mutation
anonqqq: @djdrae i am noob but i think thats where the video game industry is going next
davr0s: parallel programming in rust is easy
grapevines123: r0st is the dumbest syntax in the world
davr0s: codeplay have the compiler backend to generate kernels from high level abstractions
davr0s: only an idiot would complain about syntax.
optionalflag: LUL
davr0s: you can change the sytnax if you like
djdrae: @grapevines123 computer is smarter than people. but because google scamming we need a hammer
Gazny: Just learned about the block tool, its pretty good
br1anwiz: @Gazny enlighten me
grapevines123: the lov3 counter intuition in CS will f0k many ppl oneday...
Gazny: @Gazny block gravevines and chat is better
grapevines123: @djdrae hammer? you mean hummer? lol
optionalflag: PogChamp
misterwong_30: why its so dark on ur room ?
clorx: !uptime
anonqqq: get a better mic and this turns to asmr
cPPcod1r: @misterwong_30 he is hacker...duh....
br1anwiz: do you ahve lights?
clorx: Transpose the Cuoooooooobeh
djdrae: @anonqqq when they say that we are going something. its most likely a scam. we will stay where we are. or we would already be there
misterwong_30: oh i get it
optionalflag: @misterwong_30 because the earth revolves around the sun 4Head
grapevines123: @br1anwiz why do you need light, look at the code, and learn
cPPcod1r: you aren't a real hacker until your room is pitch dark
aluminum_extruder: @davr0s yeah i agree rust is well balanced. have you seen the rayon crate? its pretty rad
davr0s: ^^^^
davr0s: if you think parallel programming is hard, you need to re-assess.
wowsoclutch: *hiss light*
grapevines123: Turn off the lights bro
djdrae: @grapevines123 mqn i dont need a fckng hummer
cPPcod1r: lights are for noobs
cPPcod1r: don't do it
karanberries: WE BACK
wowsoclutch: hey friend
Cracktune: CALLED IT
djdrae: backkkkk
MauriceChavez: theehee
aymamoon: still i got nothing here
br1anwiz: @Cracktune no u didnt
clorx: cuooooobeh
cPPcod1r: who tf unplugs the router to turn on the lights lmao
karanberries: the lights work for the Systolic arrays
clorx: Hiiii mom
grapevines123: oh oh he's back
Cracktune: @br1anwiz last sentence posted "prolly network issue" then refreshed
madflash19: hey
aymamoon: she brought snacks?
grapevines123: You turn on the lights, and it crashed the world
amuzinc: @georgehotz do you have good visuals for Cubes
keiner2: the sicily array
clorx: pasta for dinner lit
amuzinc: thats your next album @georgehotz
djdrae: shes looking for a way to get our boy a welcomes kiss
grapevines123: There's a ghoast there??
Cracktune: LTER EVERYONE, GRET STREM
wowsoclutch: don't let your dreams be dreams
clorx: tell her about the cuooooobehh
Santiago_LHC: TEAM ROCKET!
I_am_paranoid: LUL
misterwong_30: hi she
grapevines123: Bro hitting hard @ big compannies with f@t lay3rs????
panthurrr: but i want team rocket
karanberries: team rocket to the mooon
grapevines123: You're brave bruh
grapevines123: Goodluck
clorx: cuooobeh
bits_n_atoms: google is carrying the open source ASIC flag right now. They might put some verilog reference out sometime for the TPU
djdrae: george wants free labor
clorx: cuuuuuubea
grapevines123: Bro take your girll for a dinner... who care about stupid linear algebra....
keiner2: sicily array even sounds shady
clorx: cubes
clorx: cubea
clorx: cuooooobeh
grapevines123: cubes are stupid
clorx: cubed
misterwong_30: she likes cube ?
djdrae: @grapevines123 you simp. a man needs to be on hos purpose thats make them wet
grapevines123: I'm out
amuzinc: @georgehotz systolic array for the win
ileno: we love cubes &lt;3
grapevines123: take care bruh
br1anwiz: AND FUCK NVIDIA!!
panthurrr: can we teach the cubes to speed run pokemon red?
iyajainfinity: Systolic cubes are the way to go.
clorx: Best cuber
InkyN00B: Kreygasm
clorx: George you can cuoooobeh
Repunk: FP16 coobs all the way baby
br1anwiz: YEAH!
pepperjoao: motto -&gt; fuck systolic array, we are here for cube
BigCryptoCat: BigCryptoCat is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 7 in the channel!
amuzinc: @iyajainfinity actually insane
grapevines123: @djdrae are you ok bruh? The ending is the same for everyone
karanberries: byeeeeee
BigCryptoCat: BigCryptoCat gifted a Tier 1 sub to Darnell_ll!
anonqqq: REEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
misterwong_30: bye george
br1anwiz: push website
misterwong_30: ur cthe ccoolesst
grapevines123: tinynothing
changename_: geoegee
grapevines123: lol
Darnell_ll: yoo bigcryptocat thanks
djdrae: @grapevines123 bruh
clorx: George the coolest nerd
pepperjoao: CUBES &gt;&gt;
ts012839050: bye george and cube
anonqqq: i dont waht that it but i like cubes
br1anwiz: the website
grapevines123: tinybs lol
I_am_paranoid: VoHiYo bye bye
wowsoclutch: I mean I saw the animation, cubes are obviously the answer
misterwong_30: bye cube
wowsoclutch: later
two million dollars from finance
smartsheet
[Music]
oh hello there i didn't see you all come
in
welcome to my stream and today we're
going to talk about
cherry computer
vacuum bike
is my website geohot.com if you don't
know it
if y'all don't know my slogan
y'all know my slogan all right um
this is my blog and i wrote this new
blog post this morning
i will paste the link to it in the chat
and we're here to have a conversation
about whether i should start an ai chip
company
and your input can matter
um i also registered my domain name this
morning for my 2024 presidential run uh
so that's very exciting
um i guess i'll
i'll tell you the theme of it and the
theme of it is shut it down but we're
not here to talk about that
we're here to talk about this uh
so we're gonna go through the ai chip
companies that are out there
and then we're gonna talk about whether
we should make our own company
uh if it's a good idea or bad idea
what do i think dojo will be like i
think it's like
uh oh well actually okay so we we can
talk about we can talk about tesla's
chip actually we should probably add a
uh
section of this blog post
let me just get my blog post editor up
here
um
we should probably add a section about
already existing ones
so these are all the uh
so let's
just
um
startups see how that looks
okay we want to go with an h3 and then
h3 is more appropriate
get rid of that maybe we go with an h2
yeah it looks pretty good alright cool
um so we're like doing a survey of the
space here
so for companies we have nvidia
uh we have google
and we have tesla
with deployed chips
okay and actually we can also say
qualcomm
because i know a lot about that one
um
i have a few notes in the tiny grad repo
that maybe we'll just bring in
uh oh and we thought she also should say
apple
new snapdragon processors
have a gpu and uh
dsp
gpu
about the dsp since it can't
be easily used
for training uh
did i hear about atari ai oh oops no
it's not the right link
sorry that's my internal link there's a
link um
oh and rock m oh yeah we should talk
about rock m2 that's a good point
uh nvidia amd
google tesla apple qualcomm
over
without
chips you can buy
um so you can't really well that's a
little big
h3 stage three better yeah and then i
kind of did like that br i only want a
half vr
do you guys know how to make a half br
let's sort them by use
um and these three are only really
inference
so we might want to rule them out
anari ai uh
for training
boy chips for inference
what is this
[Music]
i mean i actually you know what i
actually like the vibe
here i'll read you something every day
starts with a revolution
sunlight breaks the dark passes through
windows overcomes the walls and
illuminates
corners hundreds of shadows cover the
space and straight lines lose their
definitions
and then everything is just about free
movement that surpasses established
shapes we dare step outside the straight
line we dare to create
a new movement do you dare to be the
revolution
we're dreaming about possibilities and
error of
as long as nobody actually gave these
people money it's actually pretty funny
oh a personalized chip wait
did someone give these money from nard
dog serbia
we don't create a product we create
possibilities wait this has to be a
troll
i think it's real no
this didn't no nobody gave these people
money right
he's too well okay okay okay someone
gave them two million dollars all right
uh we don't create a product we create
possibilities
all right two million dollars is enough
for like you know
like i've lost that bet on the packers
like it's not a big deal
i don't know
um no i mean it's it's kind of uh it's
kind of
a scam
all right so we have
you know what i'm gonna i'm gonna take
these ones out
this is really only i'm actually gonna
take
i guess we'll keep amd
you know what maybe we'll just keep
tesla since like they have a chip and
like it's unclear if you can really
train on it
i don't know no none of these people
have training stacks
we're gonna we're gonna move them out um
google
the tpu is
uh based around tensorflow
while it does work
with pi torch relies
the on the king
of ai chips
30 90 isn't even
a bad deal
the problem is the 10x
overpriced a100
well it's not actually 10x double price
we'll say it's 5x overpriced
reminds you of cheetos originally we
were thinking potato
for the name what do you guys think
and the fact that
they are
and the fact that one
they are a monopoly what
oh you want them in the washing machine
or the tub or something
um and two
oh no not that they are a company uh
they are monopoly that's the word i was
going for
and two the chips are still
mainly designed
as gaming gpus
with ai as what
oh still in my car take my car but yeah
yeah bring back red bull and crash box
wires what else would you like i need
the garage
oh
i need a door in case i want to go
outside
guys i'm a bio hobbyist i actually
am this stuff i actually know a lot
about
thank you what about my other keys what
do i have to open something with them
what do you mean
i'll be back in two hours what if i have
to open something with them
i don't know let's look at all the keys
you have so many did i do anything
i don't even do anything why would i
have keys that don't do anything look at
these three
they're gonna copy my keys keep showing
them on camera like that
look at those three oh you guys
rob george is uh yeah this one a lot of
money in this one
joke's on you boys okay um
red bull crunch bar anything else more
drinks do you want more spaghettis
do you want pancake mix oh yeah
everything it
chips oh no chips just bad for me
but some pastas that aren't spaghetti
because spaghetti is as stupid as pasta
not much red sauce sticks to it doesn't
fit in the pot
sauce yeah but not much red sauce i want
to complain more about spaghetti
can i all vodka oh i don't know how to
make that that's too hard that involves
creaminess
like the vodka sauces do you want that
no it's cream it's like weird it just
catches me outside
marinara but some more it's more roused
yellow frost yeah it's best
okay uh
spaghetti is trashed your pasta yeah
you're okay with the health versions of
a crunch bar like a
like no like if i don't go to it because
then i only have to go to one grocery
store
like what if i brought you an energy
drink that's like red bull
it's taurine but it's not red bull red
bull
by someone
just try it one time one time if you
also bring a red bull and crunch bar
it's the launch of champions you know
it's not lunch champions
like like uh like uh uh a rojo toro
with you know whoa tomorrow what do you
think we'll get in
all of the energy drinks other than red
bull taste like
piss ripple only slightly i agree with
this guy
and does the chad have any grocery
requests
i would like that dress she doesn't want
to go to two stores
i think it's reasonable to not want to
go to two stores
yeah broccoli george does need to eat
more greens
cheetos that guy wants a crunch part you
get him a crunchy bob he's not
potatoes i'll give you some potatoes
will you eat them no
you just put them in the microwave if
you put butter on it that's good
when you talk with that voice you know
it's not gonna happen you just try to
say
it real fast so you think you think it's
gonna happen
breadsticks
blueberry juice
oh chicken tenders oh yeah candies
candies yes yes guys platype party eight
knows what's up
candies okay yeah i need some teddies
what else do you snack on
uh all i know how to make is like pasta
and chicken tenders and eggs i need some
make stuff eggs
okay that's all i want to make really
okay you know you know you make great
steak
yeah i can make a diesel remember
remember the burger episode
oh yeah but that was only for tv you
know what i mean
i couldn't like do that in my real life
oh would you want more french fries too
the frozen ones
yeah those are kind of girls i think
they're good yeah
waffle fries yeah
oh pancetta you
[Music]
i'll see you later
all right boys uh
[Music]
they say bye alex oh they want eggo
waffles
um okay
while it does work with pie torch
it is really meant
to have things compiled
well the tensor
of course i have an
insane number of flops
it's almost impossible
to keep
them fed this
is uh
possible to keep them fed from memory
or even cash
32 tensor chords
have an insane number of flops uh
reality
this is where we get
our 10x speed
things compiled uh
oh i'm blocking the text alright where
do you want to go can jekyll do live
updates
uh i don't know
refresh it here here we go
and then we're going to go through we're
going to go through these uh
we're going to look at graphcore i'm
going to look at grok they do both have
good technical reports
uh tens torrent has almost nothing and i
don't think serbis actually has very
much but like is this not
like this is really pitching to the
dumbest money
like you have to understand how big our
chip is so the only thing i really wrote
about say our best was
we make a big chip chip really big big
must be good because
big big chip mean big investment
um
uh yeah i wrote memory yeah memory works
yeah memory works for me for my cpo
sorry i did it all off stream but um
yeah the memory works
we still don't have any pipelining uh
but i fixed memory i even fixed some
unaligned stuff
so it's pretty good
uh all right let's keep working on this
really meant to have things compiled uh
and laid
out in ram in specific
ways
this is
push it to software pattern
that i see
fail over and over
um and then amd i don't really know much
about amd
similar downsides to nvidia
but with much
less investment in
uh the software side
i don't know anybody
who uses these
to train
yeah rocky
i almost want to i almost want to uh i
also want to copy and paste that quote
i'm stealing your quote bro
do you want to be attributed
ah all right so
aka unusable
in practice
okay
no we don't need an image in the
markdown it's too hard
okay
guys on topic
um i mean video strategy software
it's even worse
who makes big chips service
okay so this is my pitch for a
company i pitched to alex this morning
so this isn't fresh
but um so i own the domain name
cherry.computer there's nothing there
yet but
i think that's a pretty good name uh
we'll like put cherries on the chips
you know um so our goal would be to beat
nvidia and build training chips that are
10x better
read faster for training and we're going
to get this 10x
um because our memory will be able to
basically feed our tensor course
we don't even need a chip that says
complex
cherry computers great
um and cost 10x less
10x faster at training
because the memory bandwidth
and cost 10x less
because we aren't
uh overcharging
and can
omit all gpu silicon
to feed our tensor cores
10 gdc business model just with purpose
built
uh so i think maybe it's redundant if i
uh
yeah actually that okay fine um so i've
been working on an extension to risk
five it's in the tiny guide repo
these are the uh instructions
there's the dma the dma ones you can do
whatever but
really like load store and map mall are
your three basic ones
um if you want to do like a map mall of
any size
uh including with transposes that's like
the code to do it you can imagine
writing that c and compiling it to to
risk five
um i called it risk architecture with a
k but i think we'll call it you know the
cherry extensions
um well how are we going to manufacture
it so we'll get there
um don't worry this is all in the
business plan
yeah well so it's not risk 5 it's an
extension that includes uh
matrix multiply unit and a few other
wide vector style instructions
i would support only the tf-32 data type
which is 19 bits
yeah tensor float 32
uh tensorflow 32 is 19 bits
and because we have to do because the
precision in tf32 is only 10 bits and
not 23 bits
basically tensorflow 32 took the range
from fp32 but the precision from fp16
and i think the precision is where you
burn a lot of your power
i don't know what moses is the a100 is
kind of a dedicated ml chip
but it still reuses all of their turring
architecture
uh the chips are still off sorry mainly
designed
one we have a monopoly
um okay so i would support only the tf32
data type which is 19 bit so it would
work well with training out of the box
without without gradient scaling
i think it's called gradient scaling if
you want to train high torch
gradient scaling uh
so yeah without gradient scaling
yeah the problem is like like you can do
all this but
what you're doing with gradient scaling
is you're just moving this comp like
you're adding all this complexity so you
can train in float16
and like i just don't think it's a good
idea add three more bits to your
hardware and then it seems to work fine
um
so when you look the problem is if you
look at
uh like fp16 it doesn't have range
so because it doesn't have those three
bits of range you're effectively having
to hack that back in with a gradient
scaler and it's just really stupid like
just put the range in your hardware
um
which is really just hacking the range
back in
a ton of software complexity
flex to hack the larger
range in
into fp16
um to work while i was training out of
the box without creating scaling sure
there's a ton of software complexity to
hack the larger
uh floating point range
into fp16 while training small data
types is possible it's super annoying
a lesson that seems to be forgotten over
and over again is that vliw doesn't work
so
intel made this chip called itanium
uh maybe should i make those links those
are kind of i like wikipedia on these
like i'm not even sure if this stuff
tells you like the problems
wait that's crazy where's arm
i don't even really see it yet
so yeah and fancy multi-core doesn't
work so the cell spe was the uh
co-processor using the playstation 3 and
all the developers hated it because it's
just really annoying to use
you have to make a chip people love to
program in hardware
otherwise you push to software and it
never happens how is that titanium
compiler coming along
i've been learning computer architecture
recently i wrote a risk five coin a day
i think the idea is a single risk five
course so like and grock gets this
right we're going to go through the
white paper and figure out what the
problem with grok is in a minute
um because i've heard from good trusted
sources that uh there's problems with
grok
and we're gonna figure out they are uh
with a really wide decode path and good
out of order support
um the m1 uh apple m1 has a 630 element
reorder buffer um
we won't even
need this much
to keep our
max fed
uh well the argument against uh
this sort of architecture
this sort of arc
texture uh is that it uses power right
um that's about that wrong there's no
there's no
i like that um so
you first hear like you can't do things
like this because
here i'll i'll link the well it's not
the latest one yet so i guess
uh you don't want to do this kind of
stuff because it's going to burn a lot
of power
this is only a problem if you have a lot
of like you're building something that
looks like a gpu with a lot of course
uh if we're building one core in the
first version of the chip
um like who cares uh because yeah it'll
be dwarfed by power used by the fmax
um i don't think the branch predictor
needs to be that good
and it's identical
every
run through
so you don't need a great branch
predictor which is one of the hardest
parts of modern processors
uh because we can just after you run it
once the brand's predictor should get it
right every time
um live streaming blogging
mythic ai analog chip see this is the
kind of dumb shit
you know you see all this dumb shit from
these companies we're like this is the
future this is the future don't build
the future just build something good
with today's technology no one's even
done this
there's 10x we can build chips that are
10x faster
training than nvidia and we can cost
to cost 10x less 2x that comes from
silicon 5x that comes from not being a
monopoly
um yeah you can build a gpu yeah intel
arabi but these are bad ideas right
gpus have these very simple instruction
sets
because
okay computing is basically and this is
straight out of jim kelly's legs foreign
computing is six operations uh you have
ads and multiplies which are on dsps
um you have ads multiplies loads and
stores which are on gpus
and then you have ads multiplies load
stores compare and branch which are on
cpus
all right so compare gpu's
branch is very very expensive for gpus
load and store is very very expensive
for dsps
yo if you aren't a twitch prime
subscriber bringing up some roko's
basketless
shit i'd kick you right now um
too off topic who cares homomorphic
encryptions more
fake shit uh like it's kind of real but
like again
no one's using it
so yeah we can build chips that are both
10x faster and
cost 10x less and when you multiply
those two together so
we'll go through what the business model
of the uh of the company is
uh but it's basically this
so my first step would be to write open
source verilog implementing this core
that can run in this fpga card or maybe
as another option there's also these
squirrel forest kittens that somebody
mentioned
run in the
or the
these things are meant to be crypto
miners
but
it's just a big xilinx fpga
um according to my initial benchmarks
assuming one instruction per cycle and
one gigahertz clock speed
this would comfortably outperform at
3090. this fpga card cost 7 500
so it wouldn't be cost effective to use
but this is the common neo of ai chips
will be adopted by hobbyists
i don't think we have to raise any money
in order to do this since we're not
doing any tape
out we're just building hype which is
what we're doing right now in the stream
um and we're just writing open source
code
so my second step would be to do
a 10k unit tape out of this chip as an
asic
i'm hearing it's going to cost about 5
million dollars for a reasonable 12
millimeter 12 nanometer process node to
get the 10k chips
uh one core 20 megs of sram last gen
pcie
a couple of gigs of slow-ish ddr 75 watt
tdp
um i think the audience for this card
would be pretty broad
uh a thousand bucks who would buy a card
that has the same ai performance as a 30
90.
10 viewers we got you wouldn't why not
i mean how many you own how many how
about this
how many you own uh a graphics card that
you bought primarily for an
effort ml
you'd pay 2k for 3090 performance
okay because the software support's not
on par and that's true
um the software support at launch so i
talk a little bit about software down
here
uh the first card the cherry one which
is the fpga would only have tiny grad
support
but what we can do in tiny grad is we
can benchmark all the modern ml models
while we figure it out
and then it'll be pretty easy to add pi
torch and we will have pi torch support
the software is only hard if you've
written some fancy shit
right um
uh the biggest one
one of the biggest problems
with with uh non-nvidia training
solutions
is terrible software
support this
isn't because
it's hard to write
it's because it's hard
to write with
performance
for weird architecture
chips
this
this chip is a single core
wide decode path super scalar
writing the code should
be very easy
even support
all
we're all pie torch with decent
performance
like it's it's not that hard um i think
also
that like
when this thing comes out like the
people who are going to be playing with
this one or even some of the people who
are going to be playing with this one
are going to be writing the
for uh i should say the weird
architecture chips
these companies came up with
uh since this chip is sorry not single
chip single coil
yeah um oh how old are performing scale
with multi chip so multi chip is easy
uh so people think that you need some
like crazy high bandwidth between your
chips if you're trying to do multi chip
as long as batch size one
uh cherry computer is an awesome name
and
dj dre what the hell kind of name is
that
um semiconductor projects are marathons
uh with insane advantages just because
of the on-chip sram capacities
the on-chip srm capacity is not that big
of a deal
um if you
uh yes and nvidia will have one more
generation after
us so you know it's going to be a
moderate improvement to
to what we have unless nvidia decides to
massively invest in ai but
i really don't think they will and it's
because companies don't think there's
value in training
and they're wrong because okay we
i mean i'm not gonna like pitch that
that's like a stupid business thing
you know what i'm gonna do to get
investors for this is like i'm not i'm
not like pitching you some like business
case like i'm pitching you these steps
you either think it's gonna work or it's
not
um so it is true that nvidia will be one
generation ahead by the time we come out
with the cherry three
um and i'm targeting three years to do
this whole thing
so yeah the cherry two would be a 10k
unit tape out of the chip as an asic
we sell 10 000 cards kind of on a
kickstarter maybe even
so like raising the 10 mil the 10k cards
at a thousand dollars might actually
just be a kickstarter
um
it's user-friendly and easy to program
and then if the cherry two goes well
and we get some real traction with it go
so not a single one of these companies
despite having over
100 million dollars in funding has
a chip that i can buy i make a chip
simple chip i'm talking of 12 nanometer
nothing crazy
uh and i think it would be competitive
with a 30 90.
so our 30 90s taped out in eight um
but you know they didn't it's not really
the right thing
uh what's wrong with building an
inference chip god there's no market
from that
i don't want that i don't want that
that's that's stupid um
let's just say this is the human brain
an inference machine
no it's not no brains or inference
machines brains through training and
inference training is going to be a
serious part of the whole future
stop thinking like these fucking loser
companies who are like we're just gonna
trade one more
we're gonna push it out to everybody and
that's it that's all they get
um so what about the perf per watt
um i'm not even like a lot of these
um companies are i'll i'll
let me i'll push the blog and then
this update so
ah
uh per per watt is like it's important
but it's not as
important as a lot of these companies uh
say it is
the most important thing is utilization
i don't care if your chip
can do a pay to flop but all it can do
is pay the flop of zeros multiplied by
zeros which is what a lot of this crap
is like
if you haven't well balanced say your
memory interface with your compute
then there's no point um
and nobody i haven't seen any company
that's talking seriously about their
cash bandwidth
uh which is what matters okay so my
third step would be to build a serious
version of this chip on a modern process
node
16 cores just stick 16 of these things
on one chip
um you know connect them with
anything i could connect them with with
any sort of boss maybe
not pcie but there's like internal
versions of pcie
uh or maybe they even just could be
connected through the ddr
uh you probably want some like you want
to support like nickel primitives
um all right i'll add a little note
about that
uh i'll answer with style
primitives
people think multi is is is hard and
it's only hard if you can't if you're
trying to scale
your model and you can't fit batch size
one on the card if you're trying to
scale like a
single run with batch size one across
multiple chips it becomes tricky
but if you're not it's not a big deal
um
freeze rays are ruined when you have to
connect to wi-fi now but that's a pretty
good that's a pretty good like
line you know what i mean
uh no i think
graphcore scanned their way into into
azure
i i think that they have like business
development people
um oh there's a few other things i
wanted to link to here i forgot what
they were
uh 16 core with nickel style primitives
20 megs per core of sram it is true
three nanometer would be incredible um
so i had a note about how smaller
process node equals faster sram
people should know that anyone knows my
chips knows about that
um
i've been thinking about it i i've been
thinking about starting this company for
like a year now
and like who knows how serious i am this
time but like this is the whole plan
we'll see if there's a problem with it
do i really want to do this like not
really but like
i probably will uh i mean there's parts
of it that are kind of exciting
well we'll get to that in a minute but
okay so my third step would be to build
a serious version of this chip on a
modern process node
50 million for the tape out 16 core and
this is where we're getting
the 100x over nvidia we're getting 10x
in speed
and 10x in price um so i think i want to
make
one card oh yeah this is what i wanted
to link to
i want to build a single card that can
outperform
this whole machine
uh at this point i think we win the ai
chip market even against
um even against
uh nvidia's next generation
oh i don't actually want to link to
titanium and stuff i'm out on that
um
so at this point uh at this point we
flipped the company
to at least a billion dollars uh for
anyone
bought nvidia and to be highly
financially motivated to incentivize to
continue selling the cards dvc
um it should be an easy sell with a 10x
revenue multiple
uh assuming we sell 50k of cherry three
cards
uh and then the company has achieved
three purposes one
created an open source high performance
risk five core and ml instruction set i
want to keep the verilog open source the
whole time
uh made a competitor to nvidia i should
say in the ai space
um
in ml
uh forcing them to stop charging at 10x
premium
and three taught me how to make chips
and further validated comma style
businesses
you can see that i pretty much took this
exactly from comma
uh you know wait'll you guys see the
next comma and it's you know
someday it'll be out someday someday and
it's it's really fucking good ah
you know like like the comma one
the comma two and the comma three wait
wait will you guys see it
um
so what if nvidia buys arm and shuts
down cherry did i see that we say that
we're using arm we're not
i want to build a high performance risk
five core one core
uh i should write a blog post on that
business style okay fucking business
influencer
like yeah one day one day if comma
succeeds they'll write some like book
about it and like people can study it
like steve jobs study the walkman or
something but
you know i don't know i have to see if
comma succeeds first right
and like if kana succeeds is it the
business style that fails
so it's not even like really my business
style it's mostly stolen from oculus
right like you know i remember early on
uh i'm sitting on a bus hanging out with
palmer lucky and he told me about
how he like did this with oculus and i'm
like damn this is actually a really good
way to do business
uh so we'll sell for two billion like
oculus mouse shit i'd sell to facebook
if they wanted to sell the cards
um intel can't shut down risk five who
needs sci-fi
uh so fun fact also the cherry three
kernel has 16 high performance risk five
cores on it so while it works in one
it doesn't need much of a host computer
imagine a 3k little box
um with basically power
and networking
that outperforms with uh only
power and networking that outperforms a
dj x
um
similar to the facebook oculus
sale
that doesn't need to be in parentheses
uh assuming yourself 50k cherry three
cards
um the company has achieved three
purposes yeah
uh fun fact the cherry three card yeah
yeah the host computer okay i think
that's doable in three years
um the first card the fpga would only
have tiny grad support
but it's enough for benchmarking the
training of all modern ml models
um by the way you know i have been
thinking about this for quite a long
time
uh eventually we will build custom
hardware for tiny grad and it will be
blindingly fast
uh now it is slow so we can figure out
when i added that line
uh let's go to blame here
six months ago so that's kind of when i
you know
was was kind of serious about this um
no the cherry twos are a thousand bucks
stop being poor have you heard about
uh inflation well oculus is a very
successful company
um and palmer's doing again the man is a
genius you know
um am i gonna benchmark with ml perf
oh look at how many wet stones and dry
stones my cpu can do
yeah i got a core mark spec no
i'm going to train real that we're going
to use it at comma i'm going to train
our efficient net b2s
um
i don't know guys follow me on follow me
on uh on instagram at georgehot
posted a fire picture this morning
um yo this picture's fire yo just just
look at this
is that not a fire you know what we can
actually go to my instagram on the
computer so enough to hold up the thing
uh instagram.com george hotz
look at the oh my god never mind it
sucks
uh i don't know how to zoom in but yo
that picture is fire boys
open it in a new tab oh good move
you guys know the the scamming the
instagram stuff
yeah yo check out that picture only only
um
aspects on the instagram ass ass ass ass
ass ass that's my instagram check it out
follow me
uh instagram i gotta look at that look
at this this means
this this on the blue check on instagram
man
you know you guys want to know the
secret yeah never mind um
i'm just saying man it's not tinder it's
the dms
with the blue check mark that's right
the dms the blue check mark
um slide into the dms that's true boys
joe ah all right
so um i think the open source community
will help drive great pie torch support
by the time the second card comes out
um
uh
judging from
from people uh how
much was
contributed to tiny grad
and uh how the
uh how
people added all the car
support to open pilot so i think it's
kind of similar with like car support
like
and how people added all the car support
to a
pilot um in the comma one
two error
i'm just saying the number one error all
right
so i mean this is the comma one cherry
one same idea
it's called the eon uh
the common one was of course cancelled
uh after i have the benchmarking done
and confirmed that i can get 39 new
levels of performance from the fpga card
i will consider incorporating this
company and raising money only investors
who are aligned with overall value
creation in the world would be allowed
to invest
um and if you're interested in working
at cherry computer uh start contributing
to tiny grid
we'll we'll include another link to
titan grid because like tiny grad is is
where a lot of this stuff's going to
happen
we'll get rid of this link to tiny guys
we don't have too many tiny grad links
uh so i here like to actually do these
tape outs now
from what i've heard you you just need
to uh
you just need to like you get the
verilog and then you can send it to a
pretty much turnkey place
um oh my god i bought one of them
everyone bought them they kind of sucked
but like everyone bought with the the uh
the
quest to uh
well not like an open palette no i only
talk about it
all right who wants to see cherry
computer be real
cherry mx makes switches we make chips
very different
uh of course you guys of course you guys
of course you guys want to see it all be
real because you know that everyone
sucks you know everyone's fucking
scammers
comma is the sad shit it's a sad shit
that like we're you know
like we're like winning
wait let you guys see the next one let
me let you guys see the next one's
unreal
you know the cherry three the comma
three it's unreal it's unreal
uppercase company
cherry i o it's no we're cherry dot
computer
there's the cherry computer
no it's not cherry ai i'm not paying 7
for that stuff it's not ai it's a
computer we're building a computer
um
okay so let's now look
it's a computer
it's not being born by ai no it's not ai
okay so let's read grok
rock's neural networks grock has taken
so grok seemed to get a lot right
instead of creating a small programmable
core and replicating it dozens or
hundreds of times
the startup designed a single enormous
processor that has hundreds of
functional units
this approach greatly reduces
instruction decoding
overhead enabling the initial
tensor streaming processor chip to pack
a lot of sram while doing
400 000 max per cycle
four times faster than nvidia's best gpu
how come i can't buy one
i'm gonna make like my website's not
gonna look stupid like this
look look at this website look at the
big button buy now
buy now agree to some bullshit proceed
to checkout
boom you'll have that why can't i do
that with grok let's try that with grok
oh oh i can learn about how they scammed
investors out of money
i can look at pictures
um i can follow them on linkedin but but
how do i
buy where's the buy button oh
they don't they don't have a buy button
i can learn more
okay okay um
the shop no you can't buy them
check out ghost.ai
oh yeah i added a little note up here
um not a single one of these companies
is a product i can buy the current
leader in ai chips is unquestionably
nvidia and they have a card i can buy
so this leaves the question are the
companies banging on a stupid business
model or they just not have anything i
tend to think it's the latter
remember unless it's from a widely
established company like apple
secrecy is just a cover for we don't
have shit
i shouldn't say widely established
i should say company with a track record
because like oh well they're widely
established
you have to be introduced to chad and
sales first yeah this is even worse i
don't even see that
um so yeah let's figure out what drop
did wrong
up up
i found the problem oh boys i found the
problem
because the architecture lacks caches
branch prediction and similar mechanisms
but this approach places a heavy burden
on the compiler
oh god
i'm getting rid of we'll have to
the problem is obvious
on the first page page
of the report
the push it to software strategy
never works
never works
has never worked
in the history
of computer architecture
stupid the compiler
sucks you don't want to do this
build a normal chip with like a super
scaler and shit
all right so we found the problem with
grok
push it all to static software
strategy has never worked in the history
of computer architecture okay
we found out what groc did wrong let's
figure out what graphcore did wrong
um so i listened to a blog i listened to
a podcast with the cto of graphcore
and like it was apparent listening to
him talk that the guy's never trained a
neural network in his life
um so i mean that's kind of a problem
okay
um
yeah i mean you can't do this you can't
have a compiler schedule like
you think that you can but it's not a
good idea
sure it works great in theory
um
no i'm not doing neural architecture i'm
just going to build a good chip that's
just good
okay the ipu architecture
at the heart of any ipu base okay so
they rely
on many core
right on a mini core chip with
i i mean i already see the problem with
it
the exchange with a custom
weird communications protocol
while i had to get to the seventh page
of the report to find the problem
to get to the seventh
page of the report to find the problem
it was there when
it's the same mistake
as
the cell spu spg
uh the same mistake as
itanium
you want
to try to write
maintain fast code for that
game devs hated the spe
why wouldn't ai devs hate this
ml devs hate this and they would
great we found the problem
i own cherry computer i own cherry
computer don't worry
the name we're not that married to the
name i don't understand why that's
broken though i did buy it
it came up before
maybe the computer tld thing
doesn't i don't know whatever um
alexis of twitch thank you for for
gifting subs
uh alex holds the store
okay cool
um let's push these changes to the blog
post i'm glad you guys are joining me
this is a new thing we're doing on the
stream we're doing live blogging
get apple suede out of business well
you'll get sued out of business by apple
who's gonna sue us everyone's gonna love
us we're here to liberate you all from
your video monopoly
yeah i know i probably shouldn't be
using build
why doesn't apple just do this yeah
i mean they should i don't know yeah
like the dream thing would be to stick
my instructions in the m1
uh there's not that much
real locality but my cash is the whole
sram right so
um my cash would be the whole 20
megabytes of sram
effectively uh and like there's a bit of
latency to get to that sram
but it will cover it with our super
scalar and our big out of order engine
um oh yeah i know that this thing is
insane the guy who reverse engineered
like the m1 and like figured out what's
on there
630 element reorder buffer
like wild
yeah look at this stuff all right so we
actually have to learn
how to write you know apple also has the
accelerate framework which is kind of
interesting
but i don't think the stuff's nearly as
wide as what i'm talking about
would i be okay if someone stole my idea
and succeeded absolutely
please steal my idea
you won't though i mean i'd go steal
karma right
like they won't do it they'll keep doing
the same crap these companies do
uh servers but you can make it for
training too it's gonna be an open
source core you can you can
you know go ahead i can do it better go
ahead
um if there's less out of order
execution so like
you you do need the out of order
execution because i want to support
my my sram load instructions support any
stride
um so um yeah i i talked to
someone very knowledgeable about this
stuff yesterday
and he's like well the srams are gonna
be the hard thing
everything else sounded easy um but
the sram because i'll show you what the
instruction looks like and we can talk
about why it's hard
uh but i really want this instruction
and i think this instruction is key to
uh
making the chip fast so
my load instruction is this uh
here it's written with an uh a numpy
thing to not use a stupid python loop
but
we support any strides
in the x and y so it's a 32 by 32
uh matrix of uh
elements and i want to be able to load
yeah with any stride from the sram
and you have to deal with like bank
conflicts and i just don't really want
the programmer to have to think about
any of this much
i want the chip to all just kind of work
uh even if you do this poorly
like there's probably ways you can get a
little more performance if you do it a
little bit better
but if we have good out of order support
we can have a lot of instructions
sitting around waiting for loads and
it's fine
now am i actually planning to make a
chip company i'm thinking about it yeah
what do you all think
i mean if i get to like this point and i
really can make this fpga outperformer
3090 at like a bunch of common networks
hell yeah
how are we going to manufacture the
chips and work with the company to do it
not that hard
how scrum optimizes anything there's no
locality x there definitely is locality
to exploit okay
so a matrix multiplication is n cubed
with n squared memory accesses
right um if you're multiplying two
matrices it's n
cubed number of computes because you've
got to do these arrays so there's a ton
of locality to explain
look up like writing a cache or where
matrix multiply and
then realize that my cache is 20 megs of
sram
it's not that hard to outperform a 30-90
um
the hard part
is remember like nvidia is not like
trying to build a chip to do this
nvidia is building a gpu mainly for
gaming and they talk about ml
to increase their share price mls for
the shareholders
uh gaming is for the actual like revenue
am i scared of the chinese stealing my
idea no
what's the worst the chinese are gonna
do do it better than me and sell it for
less money
sweet can't wait to buy a uh let's
translate cherry to chinese
uh english to chinese
no no no not tree no oh ying tasan
i'll buy ding thou son let's go give you
you know
uh like like eight thousand yuan for a
yingtao song i'm paying half for the
chinese knockoff
yingtao yeah
um our computer
yo go ahead pitch chinese man let's see
the knockoffs let's go
can the cherry three out perform the
a100 tensor chorus hell yeah
i think the cherry three will be able to
out if
if if like i did the math right on this
stuff the cherry three should outperform
this entire computer
right with eight gpus
system power usage will be 10x more
efficient and powered
then they'll draw like 600 watts
yeah everyone would buy that for 2k i
know but remember we're
we are competing with nvidia's next
generation at this point so it's a
little bit unfair
but
tesla ditched their custom chips
i don't think so
no
no this is all they built their own
uh we'll be able to emulate cherry yeah
so i have an emulator it's kind of
already written
the emulator is here we are going to
have to add a few instructions
still to do the reduces
um so
yeah we can start i don't know do you
guys want to play with some verilog and
see if we can write some floating point
multipliers
i don't know like uh
my we'll refer to him as the
knowledgeable source
said that my multipliers were easy and
it's my srams that are hard so i should
probably work on the srams
but the multiplier seems a whole lot
more fun um where am i learning computer
architecture
from thinking i don't know it's all easy
man
like i realized that i've just known
this stuff my whole life you just like
and i really thought that i knew it and
then just one day i woke up and i
realized that i knew it
you know what i mean did i touch on the
tpu issue of push it to software yes you
can't push it to software
stop with the push of the software it
doesn't work
um ipo when all right
should we just launch cherry right now
as an erc20 token
and you guys can buy in is that a
security
did i just launch an illegal security
[Laughter]
um
[Music]
guys no fucking speculators
do a mining chip oh safe
cherry moon in you diamond hands
cherry computer yin kao yang tag yang
cap
yeah uh
all right but yeah here you go so like
boom there's your whole business model
go put some nice slide deck on it go
pitch it to investors
um if you actually seem like you're like
willing to work seriously on this i mean
like a hammer was too not specified like
i didn't give you guys enough of a
hammer business model
like a lot of people emailed in and
wanted to work at hammer
but they didn't understand that the only
thing i was seeking an application for
was a founder
if you're serious about working on this
ai chip company uh
i'm interested
like yeah i don't know if if people
email me but really contribute to tiny
grad
backspace doesn't work i did a lot of
research into backspace it's not ready
yet
like backspace is still research i can't
actually start that as a company don't
you can't make companies do research
like like this is a myth
um
srams get expensive non-linearly with
the number of simultaneous access points
yeah
i know this and this yeah this is why
srams are expensive and this is why
so so command paul this is why i need an
out of order engine
i should be able to fix this with an out
of order engine though like a good out
of order
engine that's that's effectively just
doing this right
because like while i don't have the
access points
it'll kind of have a cache after the
sram
and that's how like my out of order
engine will be able to uh
to to deal with this stuff yeah i mean i
started one company five years ago and i
worked as hard as i possibly could on it
for five years you know
uh yeah it took a lot of time i mean now
like
uh comma is now kind of at a point where
like i'm not sure what the most useful
thing i could do for comma is
i could code but
know what there's a few guys at comma
who can code better than i can to be
honest
like i i i'm not like like
my coding contribution wouldn't be that
great
um there's very little i have to do to
run the company
there's very little decisions that have
to be made
uh like the decisions are pretty clear
we're just
steadily improving something um
yeah you know like like alex works there
is a ceo you think i could do that kind
of like
like dealing with the bullshit stuff no
like we just got like better people than
me at comma for all the jobs common
needs to do
oh actually alex came up with nobel day
oh alex now she's saying like
uh you know all the all the twitchies
think you
you came up with nobel day my only job
is to shill nobel day
cherry is for training
our goal would be to beat nvidia and
build
uh training chips that are 10x faster at
training no i mean look i think this is
an easy company and i think it's like an
easy flip in like
three or three or four years
it's a company that makes serious
revenue you know what i mean
like in this company i'd sell like i'm
not selling comma
comma has like serious ambitions to
solve hard problems
this is like i want to build one chip
and you know clown all these people and
clown all these people i just like one
two three four five six seven
there's just seven people i'd like to
just clown
you know just clown
um i'm gonna donate my money to the
india covered relief fund oh wait no
that was metallica donated a shit coin
that was hilarious by the way the whole
ship thing
metallic's a boss uh
it's not the facebook yeah why not it
doesn't matter
actually no i would make sure that
whoever i sold to
uh would would continue to sell the
cards you see so if some company wanted
to take it internal and make it the aws
special accelerator no sorry get fucked
um but i think there's a lot of people
who would have that business model
um is vitalik a better coder than me no
the vitalik would admit that you've seen
vitalik's code
um he's a better mathematician than me
i'm a coder
direct to consumer ddc is direct to
consumer
uh can i get the talent
i can like do this myself you know
um i need to hire somebody in operations
who's going to deal with
like dealing with the chip companies for
me but
i i'm not even like i hear there's
companies now you send them verilog
and they just turn that verilog into an
async for you great that's what i want
um what's the next pokemon red one yo
i've been watching pokemon i wanted
those
whole rant about you know the
psychoanalysis of team rocket
like if you look at team rocket you
think they're really these like
one-dimensional villains who like
stupidly try to steal pikachu and
they're not very good villains but
you get more into their psychology and
you realize like their goal isn't really
to be good villains
right they're kind of like like process
addicts who just like that's the thing
that they do
they try to steal pikachu and and it's
not like if they ever
caught pikachu i'm not really sure
they'd know what to do
right because like what would they do
next episode right but it fulfills this
kind of like like
this like process addiction for for for
jesse and uh james
and then like you can look into meowth's
motivations and they're they're they're
just
really they're a multi-layered villain
that appears one-dimensional but
um is harold a better programmer than me
in some ways yes
um yes the dog chasing the car analogy
that's exactly what
what i'm trying to say um
they might be mathematics this is
possible like that's that's an
interesting thought
um
harold is better at a certain sort of
like
steady slow improvement uh than i am
and yeah i mean he's all the innovations
on the common model have been
from him and the rest of the research
team not really for me
i just show up every once in a while and
point out bugs
um team rocket or group of outcasts who
want to be loved that's true
um i think like james funds i think
james
is secretly rich what makes a developer
a good one get out of here with your
stupid questions
uh yeah
so i really got i really gotta like dive
into verilog and
all right let's okay let's look into
writing
all right you know what we're done with
this chapter of the
um of the thing
there is a whole plan for an ai chip
company if you want to build it
uh
and maybe i'll build it we'll see
um if you're interested in joining
uh i'll say a few things
send me an email but really
like the first phase of this is going to
be the open source thing
the only thing that i would consider
like thinking about now
is a very competent sort of like head of
operations type
um you know someone like viv from comma
uh you know viv ran operations at comma
for for for five years
um should a very good job of it
uh four years um so like i need someone
like this for for cherry computers the
only one i would hire who's not
uh right now already contributing to
chinese grad and contributing twitch
core and that kind of stuff
um something like this out of order
machines this the the boom the berkeley
one
yeah i was looking at this this morning
um yeah uh maybe i don't like so
[Music]
they use this like language called
chisel
which is built on top of this it's just
built on top of so much
shit and like these repros are so big
but the ideas might be good
[Music]
and like they do have good descriptions
on their website there's a lot about
this if
like their website is quite good
actually like i know i brushed them off
in the beginning last time um
because i didn't like that like i tried
to clone it and it's like so
hard uh like none of this stuff runs on
mac
it needs all these weird oh well so yeah
yeah yeah
we'll read some of their stuff and like
you can like see what you're doing wrong
um berm boom implements the open source
risk five uses the chisel uh hardware
construction language okay so first off
you click on chisel and it doesn't work
um so then you click on this chisel is
an embedded dsl within
scala that supports advanced hardware
design
using highly parameterized generators
it's only used in academia
except for the google edge gpu more
information can be found here at chisel
lang
right chisel is a hardware construction
language that
is something to do with scala and
something to do with java
and you know except uh yeah
i don't know it's interesting though
actually i did not see this before i did
not know that the google edge tpu was
done in chisel
thank you hello everyone
uh my name is derek lockhart and i'm
from google um which was a constant
value
uh etc okay sir
so pretty challenging to kind of figure
out
that's still kind of an open question is
without a dedicated
chisel infrastructure team so in other
words they hired some guys from berkeley
who liked this craft and that's why they
used it
i understand they didn't use the big tpu
wasn't that
um
let's let's finish the grok one because
again it's most of what
it's similar to what i'm doing but
it's just super lame
oh my god they even use the word vliw
do you not understand people just don't
read computer architecture
the the instructions are
two kilobytes oh we gotta just add this
like the lulls are too great
the lulls the lulls are just too great
but
this shit doesn't work
i'll leave
one more sentence that
speaks for itself
more sentence from the report that
speaks for itself
i won't say that speaks for itself
leave with one more sentence from the
report risk five
instructions are four bytes
why okay
we now see why does everyone understand
why grok doesn't work
oh yes don't worry just use this
instruction that is um
three 2.3 kilobytes
wide
that's kb
that was scary thick instructions
you got a store oh you were in the store
oh yeah let's eat boys let's eat we
eating good tonight
um oh i found the problem with grok
you know grock yeah the company that you
think like might have had good
i'll ideas i'll just okay so like for
reference in risk five
instructions are four bytes wide right
grok the memory units also store vliw
instructions which are
2 304 bytes wide
that's great that's great they think you
got me fake red bull
wait wait i got you every fucking thing
oh yes
um i should say for reference yeah food
sounds great
for reference
for reference
that's not a spell reference
this guy fits a compiler in two
kilobytes uh sorry not if you're using a
grok chip if you're using a graph chip
uh you can do one uh move instruction
and then like what does their icash look
like i have 16k of i cash that should be
able to fit a whole lot of instructions
uh oh you can fit seven
clock size red bulls
what was he thinking dude i don't know
but i need i need to
enter on my blog
just because it's really it really just
like like i actually thought that like
brock would be good
hope you like
fitting seven instructions wait can you
even fit seven i want to confirm you can
fit seven
yup in your
16 kbi cash
who did that
no i don't want a period there there's
no period there no period there
bro you just need an instruction
predictor now and it's easy peasy
do you guys know what vliw stands for
right very long
instruction word i don't even think
titanium like
like like i think you gotta add a few
more v's there to really to really
emphasize how long of an instruction
that is
yeah yeah v-v-l-i-w
how long were the instructions in
titanium
oh willa
what should i drink vdn
oh it's mukbang time
what do we got okay well there's one
wild card
okay this one's called this is a party
aid
since you're having a party it has five
htp
that's sketchy okay we have a red bull
oh hell yeah i know what's in a red bull
normal stuff
this is this is amazon energy
has anyone ever had that one this isn't
what i had
um how much caffeine's in in this this
one i think
might be the best option caffeine what
do we got here high ball
and then um this
this is a wild card in case you actually
realize you were too high and you wanted
to come down a little bit
it's like it's a recess competitor oh i
had a recess
uh 260 mil wow
this is all a lot of stuff
yo i told you guys alex loves the store
i love the store
oh no what am i gonna do with all these
things okay also look at this does this
sound seem like a great invention
i'm hungry for food pizza mac and cheese
let's put these in the fridge the dinner
sounds great i'm actually just hungry
that's what i'm realizing
wait can i get a crunch bag
today you know i had to finish it so i
can
you know this week you guys all know
about comic-con right
july 31st it's like autonomy day
come on come here
if 50 made 100 million
out of vitamin water george can make at
least half of that with energy is that
um no i'm just eating a chip what
oh my god the chip shortage is gonna go
away in
a couple months
are people worried about that so how are
you starting a chip company haven't you
heard there's a shortage
okay and shout out to the broccoli guy i
got broccoli
who wanted broccoli someone even said
broccoli
were you collabing with kanye yo if
anyone knows kanye we were just talking
about that today
first off we were talking about how it's
devastating that the love of his life
left him
and then we were talking about how i
kind of want to go chill in wyoming so
if anyone can make that happen
i'm down i got some big ideas kanye's
got some big ideas let's chill let's
chat
you guys are big ideas two guys with big
ideas you know what i'm talking about
yeah let's do it man
it's gonna be like billy mcfarland and
ja rule
except i'm a good businessman and
kanye's a good rapper what do you all
think
yo kanye you want to join my chip
company no i don't i don't know i don't
know about about that
we don't sell the data at comma we try
we try
look like the data is super reasonably
priced and nobody buys it
i'm like please we want to sell your
data we we
want to whore you out to large companies
but like we can't even do it
you can just right now put down a down
payment for data
no the chips don't need more hype the
chips just need more code that works
all right so let's start playing in
twitch core
let's start figuring out how you do a
floating point multiply what do you guys
think
let's call it fp.p well you know
actually
let's start with python we'll call it
tf32.5
okay so floating
uh oh you know what else i'm gonna do
i'm gonna add to the readme of tinygrad
a link to this blog post
i think it's good
did i i said i regretted dropping out of
college
are you a chill from college
i just want to try every day to kidnap a
pikachu you know
i think that'd be a pretty chill life
we talked a bit about team rocket
psychoanalysis
someone had a good point like i was like
so you know what they ever did if they
actually caught pikachu and it's like
what would a dog ever do if it caught a
car
oh you got a cookie wait this cookie is
unreal got a cookie
just warm up a cold cookie make a hot
so that's different tortellini that's
not office tortellini
oh i've had that toilet new food
pretty hungry but i think if we have one
we have like a few other
you know like cookie i think it'd be a
good okay i also got
asparagus oh sweet yeah one in asparagus
it sounds like a good dinner
ai chip company let's go
okay so floating points basically
have a sign an exponent
and a mantissa
and it's the mantissa that's small we'll
say
that's what got smaller right
then we can actually like do our python
floats
our doubles
python
almost the same
what double comes from numpy
yeah i know
what's the way to like get like a little
bit of i want i want to do like
inline c in python that would be so cool
if you could do that
all right well let's figure out how you
build a floating point multiplier and
then like
we're gonna generate a bunch of numbers
and
see if they're like kind of close no but
i don't think i want kind of close so
also like
i've heard that you don't want to
actually do all the rounding crap
for uh for ai
that's done that's gone that's done what
was my thing where i was reading about
how to multiply floating point numbers
okay
i mean i guess we could also just do uh
you could just do we could just do fb
64.
this makes my life easier
wow 52 bits for the mantissa in ft 64.
all right but now like all right so
let's see if we can multiply 1.3
times 4.5 who knows what 1.3 times 4.5
is
c equals a times b all right so we're
going to probably spend about an hour
implementing that but
by hand instead of just using all of
python's cheating wow we're going to end
up with 5.85.0005
well i don't even know the basic like
ideas of this stuff
um all right so in python how can i
actually
access the bit representation of this
you know what why am i doing this in
python
i should do it in c
and then we don't deal with stupid
guys you get to see me code and see
no no no no no no plus boss we don't do
plus around here
uh i wish there was just like a command
to like do i don't want to do the a dot
out
and then then mask out and not out all
right i'll make it a little bigger
why doesn't my shit compile because i
implicitly
declared printf
oh what that's not c
you gotta put commas in c not percents
all right 5.85
see that's because they're not doubles
but if we made them all doubles we'd get
that same
weird 0.5 all the way at the end
or not i don't know i don't want to ask
too many questions about that okay
so what i should be able to do is say
um um32t
oh you're gonna improve standard
it should work right
cool
all right so three f a six six six six
six
times four zero nine equals that
this is like some like sophomore comp
sci homework so
i hope you all can can play along
oh i'm printing float not double i see
what i did you're right
printf was casting it for me but that
doesn't matter
okay um let's just write something
called fp
now i assume okay so we want to do
23 bits this is how you get 23 bets like
that
ah that's not right
you seem right
doesn't seem right
you guys telling me that my my parents
have the wrong
okay those seem more plausible
floating point multiplication
what are biased exponents we hate biased
shit
so
we want to add the exponents um so let's
actually just make a few macros
called like e of a which is this
m of a plus this
is sh
let's use my macros confirm that i'm
getting the same thing
all right cool all right floating point
multiplication
add the exponents e f a plus
e f b
multiply the mantissas
oh wow so it really is the mantissa
where all your all your
uh stuff is expensive because the otters
are cheap
it's just an 8-bit adder that's nothing
if i want a bigger exponent i could have
it
wow and that's what they
do is floating point 16 that's pathetic
right you know what i'm saying like
because the only difference between tf32
and
uh floating point 16 is
that it has a bigger exponent
what's up you see my name
oh sunglasses like that no
um i don't know how we normalize
anything
what's up you put the aloe vera in there
xbox
oh i get it the exponents are biased
oh i understand
cold objects are not functioning
and i think the signs are just i
multiply signs right but it's only one
uh ns shift 31 or with
an e shift 23 or with
nm uh
[Music]
now we can say fp fct and then really
for the slam dunk we say
yes that fct float star pound sct
draft
okay well i mean
we wanted to get 5.85 and we got
negative
uh 2664525
but you know that's because we got to
deal with the biased exponents guys
bias is bad we all know that
slogan the bias will be added twice okay
so we just need to subtract it once
that's not too bad that makes sense
all right all right um
wait that doesn't make sense to me
i subtracted it
why is there a new exponent that
what okay there's some other bug
um new sign
new exponent oh maybe the new mantissa
is what's breaking it
uh all right let's just for sanity's
sake put some
stuff in here so it can't cheat
i can't overflow that's the word i'm
looking for not cheap
okay well at least it's less stupid it's
giving me seven
one point three times four point five
equals seven um
uh
i don't get it we multiplied the
mantissas
the mantissa has an implicit one bit
prepended to the left side
called the phantom bit
oh wow
phantom bit phantom bite
all right all right
[Music]
minus has precedence over shift oh
mayfield knew what was up
directrix 13. what else have you said
you're i'm keeping my eye on you to be a
v.i.p
well we're going to see how good his his
intel was we do love people that know
shit on this channel
someone command paul became a vip and he
proved himself many times over to know
many things about
uh making chips oh wow he's talking
about you know
how the capacitance of three nanometer
srams is gonna be mad low and
how that i'm not going to be able to
compete with nvidia
yeah we'll see but um
directions yeah alright so let's learn
about these uh
phantom bits
so we just store the fraction part of
the word
oh
oh i get it
i get it all right all right all right
all right so you tell me what i got to
do is or
it with some one shift shift left 24
shit
an implicit leading bit okay so this is
the implicit leading bit that should
work
no oh i did that in sign oops
all right directrix congratulations
you are vip
you know shit you get vip i should have
actually waited till this works but
i think it's going to work i have faith
want to do to the oven
still wrong i don't
this is the right idea right maybe it's
23.
don't roll your own fpu is the hardware
equivalent of don't roll your own crypto
library so
while i would agree with that i don't
really want
to make a full fpu oh
trans precision i mean i do like this so
we'll include a comment to this
but i want to understand basically
what's going on i'm not i don't actually
plan to roll my own fpu
i want to understand like what actually
how does it relate to integers right
like i've never done this before
so i don't really know um
why didn't that fix my mantissa i don't
understand
significant
does the new mantissa need shifting no i
don't think so
um oh i might need to shift it
i might need to shift it down 23
actually
you know what let's just do this
is it actually really big
wow what how's that negative
that's huge
i think i do need to shift it back
closer
yeah okay so like you see why i need to
shift it back right
like we need to throw away all that
extra stupid precision that we added
i'm guessing
first from the entire sign significant
um
okay so it is it is 23 bits right
so with 22 bits the thing that we want
to stick is yeah i have 23 in the front
of it
let's figure out how to get the right
answer in python
[Music]
[Music]
sorry
no i i set that alarm off all the time
these apartments have terrible
i don't think it's a ventilation i think
it's just the alarm oh wait is this a
no precedence issue
oh god you know what it might be
we have to cast these
okay this is why we do this in python
first because python has
integers the way integers were meant to
be raised
that's a huge number we shift that left
23.
and now let's see that in hex
no kind of though we're close
um
roll it off by one now which is actually
pretty good
all right good well at least we're
making the right yeah this is kind of
right
um i'm gonna cast this one too okay
uh now we want nm shift shift left
okay okay look at that
that worked the result will be 48 bits
wide for the mantissa
uh how do you get 48.
you're 46. oh i guess no that's the 24th
bit okay yeah so 48 you're right
is casting slow slow
um okay so i mean this is something that
i didn't really know before but it turns
out the exponents are pretty much
free and all of your cost is in the uh
mantissa because that's the only way you
have to multiply these exponents i can
just add
now i probably didn't write the rounding
shit correct but the cool thing about
crypto is nobody
sorry not crypto the cool thing about ai
is nobody cares rounding just doesn't
matter
um you know what we can put this back to
an int now
if i add back in a shift shift 23 over
here
or not oh really i have a shift of 23
here as well
cool
um stochastic rounding for a.i
all right so i mean it kind of sucks
that it thinks that 1.3 plus 4.5 equals
i mean i guess that is a lot of nines so
it's not really wrong
denormalized form what's denormalized
form
we putting the m in mac
uh well let's also figure out how you
add floating point numbers
all right so we're just going to write a
little function here called
malt mall is nice
them all is nice yeah it's a nice
sounding ball
uh and it's cool they can be ins because
the sign bit's actually in the same
place for an end
uh into fct equals mall
fafsa
okay so now let's write add
d equals a plus b
i'm gonna leave all that stuff right
here
okay so how do we add floating point
numbers
oh adding sounds hard actually
oh you're having red sauce we haven't
passed them
on top oh that's a lot yeah that smells
nice yeah
um here we go floating point addition
rewrite the smaller number such that the
exponent
matches all this sounds hard that i see
how to write
and the sign should be calculated with
xor actually that's a good point we
don't have to multiply
and multiply is xor for binary right
no multipliers not x over binary that's
not right no no you're wow okay you're
totally right
nice
you take the one with the greatest
exponent you add to the other value
shifted
okay i see what you do um
non-void function does not return a
value well add always return zero so
sorry
let's call this test
at least they're both the same sign what
if they're not the same sign
oh this sounds hard who knew multiply
was easy and ad was hard
do we really need add
the mantises
put the results in normalized form
thank you al you're welcome
check out dinner oh
our girl
how do i just use multiply to add
wait when they do fuse multiply ads
there's actually like some
they want me to eat with you should we
eat yeah
should we sit up here
all right boys we had a little debate
is this a chair
no no is it a stool that's not the
question
nobody's doubting it's a stool the
question is is it a chair too
you guys can see the back of my head
while you
yeah they're excited about cherry
i'm excited about sherry
there was one name hater wait
on the big screen
by the way
while you're busy watching the heat we
can um
you can follow me on instagram
oops
all right yeah
oh we're gonna read the chat why don't
you put up here
if feet don't touch floor then it's not
a chair well i can't unplug the monitor
because everything
will crash oh if feet don't touch the
floors i'm trying
to there's chairs and then there's
that's the difference between us my feet
comfortably reach the floor my room
so it's because i'm tall and i was a
chair for me
wow and they thought we were going to
hand code chairs
i was making fun of people who wanted to
hand code chair detectors
like it's the same people who think
they're going to sell self-driving cars
you know oh let's just hand code elaine
people could have passionate debates
mm-hmm
what you really want is a risk five
i don't know guys you know what we got
multiplying working i think that's
actually the stream for today thank you
all for watching
um
and uh yeah cherry uh computer
check out the blog post um
bye
hello
twitchies
hello bruce wayne
22. i did the math for you
uh
wait why didn't this open in preview
why'd that open in chrome
here it is in preview does it really
they didn't put any index
okay
they know they know they know is that a
drake lyric
they know they know they know
the real is on the rise fuck the other
side
i even gave them a chance to decide i
just tell them they know
no cherry computers not cancelled
no no no
look guys if starting your company is
not a struggle
then you didn't think about it enough
when i started karma
i was smoking weed every day real
fat um
so yeah we got a few things to do today
i've been working on
we can put the we can do the website do
you guys want to do the website for
cherry computer
i was just thinking it would be that
logo there's some guy linked yesterday
no what's this oh
floating points no no no i just think it
would be that logo
and then a picture of an nvidia graphics
card
and it would say don't you wish you had
a choice
all right well we'll just should we put
the website together
just because we're here having a good
time all right well you know someone
probably copyrighted this cherry
did anyone copyright this cherry nah
i can't be copyrighted it's illegal to
copyright a cherry
image cherry.svg
we want everything of course to be in
the center you guys know this is my
this is my li html code what's that
it's a thesaurus line d source
battle html code
no yeah yeah yeah
oh
yo here's the difference between you and
me i do shows
get lots ahead you do shows with ostrich
head
yo i do tours get paid and stay at the
sheridan
you give tours at the monterey bay
aquarium
ah yeah
[Music]
so let this skinny dork go back to
making shitty mongolians if you ain't
nailing a railroad you're playing
yourself go
bro and i don't mean he's afraid when i
say that he's yellow here's an antenna
tape and some velcro go make me a cell
phone and do my fucking html code
all right um
so you know we're just gonna put it big
yeah center tag better work
don't you wish
oh no no it's gotta be a picture wish
you
had a choice let's get a picture
let's get a picture of an nvidia
whoa css whoa who needs css well the
wheels on the rise
fuck them other side you know
no no let's get a picture of an a100
oh that's not a good picture
that's a good picture yeah i'm stealing
this picture from my website
all right i did hear that you could buy
pictures of these cards on ebay and they
were selling for a lot of money
just picture all right let's rename that
to 3090
image source
3090.jpg
let's terminate my image tags do i know
html
we're not closing any other tags cause
fuck closing tags
all right um
no no no we need some burrs in here yo
where's icy narco yo we need some burrs
burr
we need more burrs
all right we need we need more burrs
all right don't you wish you had a
choice
now let's just put a lot of burrs here
sherry coming
we need some burrs over here
all right oh it's got to be big
everything's got to be big i don't know
i don't know why you'd ever want your
text to not be big we need more bigs
don't you wish you had oh but now the
burrs get bigger that's a little much
all right cherry
computer another bur here
all right good thing we hired a graphic
designer
[Laughter]
uh wait let's just copy this amount of
burrs
down here oh yes beautiful
you guys like my website oh you can't
see i'm in the way i'll put it over here
so you guys can see
all right it's a picture of an nvidia
graphics card
and it says don't you wish you had a
choice and then it's
cherry computer 2022 um
for you want
job only github
and we'll put that in a comment so you
have to be leave
to find it perfect you know what it used
to say on the comma website
till everyone who doubted me is asking
for forgiveness
if you ain't been a part of it at least
you got to witness
bitches and that's how i feel
that's how i feel waymo that's how i
feel cruz
you know that's all everyone believes
that everyone believes it's sorry drake
i stole your bars
drake used to be good guys drake used to
be good
cherry's just the name of the computer
you know we'll put it it'll be a good
logo
on the chip um don't you wish you had a
choice
cherry computer uh you know what i won't
say coming 22
winning ml per in 2022 what do you think
a parallel in 2022
no i don't think we can win for a while
we'll just say we'll just say we'll just
say
showing up
you're winning winning is winning is a
little much
uh winning winning
on mlperf
winning ml perfect no no no just
just yeah yeah yeah yeah
cherry computer custom
card you can buy
mlperf2022 find us
on mlperf 2022
no we'll just be on ml perf and maybe we
should link to that
uh i linked to it already so i'll show
you guys i have a business model
i've been i've been working on i've been
working on this so this is like
the plan here we go
let's say by the end of the year
let's let's we'll be on mlperf
oh we need late to be all capitalized i
forgot cherry
computer is an all capital company all
right
don't you wish you had a choice no and
we gotta we gotta
we gotta keep it with the you know don't
you wish
you had a choice yeah perfect
cherry computer custom card you goodbye
yo
yo this is a good website let me move my
let me move my face
so you guys can really see my website i
worked hard on this website boys
don't you wish you had a choice jerry
computer custom card you can buy
where's the buy it now button should we
take pre-orders but they're only a
dollar
like cyber truck
pre-orders but they're only in cheap no
i'm kind of let me tell you guys why i'm
done with cheapies
crypto is a cesspool crypto is a
cesspool you know i was at lunch today
and what we're just kind of saying is
like who's creating value in the world
you know what i mean
you know something is a security when
you're trying to make
value off the air what let's let's look
it up let's let's look up the howie test
you know for all you guys out there
trying to make shit coins and like you
learn about the howie test right
and it's like
[Music]
ah yes an investment contract exists if
there is an investment of money in a
common enterprise
with a reasonable expectation of profits
to be derived from the efforts of others
now what you can find
is that if everybody in the world
is just trying to make profits derived
off the efforts of others
but nobody's actually doing any effort
then everything's fake
like imagine instead of the stock market
being backed by companies because
well they're really even companies
anymore they're all just financial
instruments right
so it's like it's like you're just
betting on all these different shit
coins then you realize we already have
this and it's crypto right like
yeah so um yeah if you're interested in
working at cherry computer
um you contribute
on github yeah
all right i think i think this is i
think this is a great website
well it's just everybody today everybody
today is like oh i'm just going to make
money passively by investing off the
backs of others but
if no one's doing any real work like
nobody has jobs you know you like go out
and there's just people everywhere
because nobody has fucking jobs anymore
because you gave them free money and you
can't do that so like welcome to the
decline
yo guys i was on um
um i was on 4chan last night and
i read this post and it was just like
bros you know like all that like
accelerationism
where you think like there's gonna be
like a big event there's gonna be like a
big recession
no it's not gonna be like that there's
just gonna be slow and steady decline
for the next 20 years
and that's what i'm really scared of and
then the third post now was like bro
yeah read a history textbook that's what
it looks like when you live in declining
empires
like it's not cool it just sucks and it
just sucks slightly more every year and
i'm like holy shit that's what we're
living through
yeah oh my god yeah ubi yeah let's all
make money what if we
all made money off of everybody else's
work
right this is all this every time you
hear words like collaboration it's just
all this bullshit it's people just
trying to make money off the backs of
others
and that's great if you have a small
defector class that scams everybody like
that
but if your whole economy is based on
these kind of scams
well what's left
do you know what i mean
don't you know
no i mean we just need to legalize like
heroin and shit
and like all the people who want to like
go do heroin can go to heroin and like
you know all the people who want to wire
themselves let them wirehead themselves
don't give them ubi give them a morphine
drip
you know we can synthesize morphine in
huge quantities
um
is this d did matthew mcconaughey say
this in waffle wall street let's let's
let's watch this clip this isn't
copyright infringement because we're
only watching a short clip no
literally send the gme people to the
moon yeah no i'd be like
oh yeah the fugazi scene yeah yeah again
it's all fugazi look
look the gme people i don't blame the
gme people but like
does anybody think the price of gme has
anything to do
with gamestop
oh yes remember when gamestop launched
that great new thing but then it turned
out to not be
great but then it wait no gamestop
didn't do shit
this is all just speculators right and
then like all these people are like oh
yes oh yes oh why a crash oh yes
market watch yes vox please oh yes the
motley fool let me guess it's gamestop
right like i hate all these people man
it's not like
it's not you know it's not the guy who
like like
memes gamestop who i hate right it's
anybody who takes the system seriously
recursive speculation it's not a short
squeeze anymore
it stopped being a short squeeze wall
street's making money on gamestop too
you know who loses money everyone who
says diamond hands diamond hands diamond
hands like you're gonna lose it's a
question of when
like like the market will be eventually
look i don't want to talk about this i'm
just saying that you know
we're going to create a new society
where people who want to create
value just for the sake of creating
value i decide that i'm going to create
value because it pleases god
and like it's that simple and you can't
really have like another explanation for
it right like it's like there's no
reason to create value today
i can make bajillions of dollars
scamming people not bajillions but
you know i could have i could have i
could have a solid you know like 50
million dollars just off scams maybe
even more
um that'll work the system
fuck the system man all right you know
what we're gonna read comments and then
we're gonna get into today's stream
um i saw i saw a comment i saw it was a
good comment i liked it
all right
haas is depressingly cool
anyone who types louder i mean
george is the example of how you can act
if you're successful and you do moral
honest work you know what's gonna fix
this guys
shaming when somebody like makes money
off the backs of others
you should shame them when somebody like
collects unemployment you should shame
them
right like this is the only way we're
gonna fix this
uh you know what's what's that um
it's tupac man two pocket
yeah you gotta operate the easy way
i made a g today but you made it in the
sleazy way yeah
yeah um no not social credit like this
thing you can't do this top down you got
to do this bottom up like every one of
you we got 420 people out there yeah 420
420 blaze it uh you gotta just like
you know like that's not cool bro like
we all just got to turn to people like
you know unlike what everyone's like
being shamed for
like you know publicly on twitter like
fuck all that noise i mean like go to
people personally and be like yo
like you're a loser i like i've done
this to people
you know like this is just you know
you're a loser man
like yeah okay yeah make money off the
backs of others who do you think built
society you know
um oh and like i do this to these people
like i i meet these people who you know
create no value they actually they just
take value from the system and like just
you know
bro like you're a loser
well no we're doing a malpurf
i'm not even talking about like the
people buying and selling scams
i'm really just talking about the whole
i want you to you know
wouldn't you feel better making as much
money as you can so you can do good
things with it
no money is worthless money is backed by
human effort
if there's nobody putting in any effort
money can't buy you anything
why is the inflation so crazy it's not
because of the money they printed
it's because you have people now who
think it's an okay lifestyle to not work
and like no you're a piece of shit right
and like this is what we need to bring
back
do i think everybody has a moral
obligation to contribute to society
i mean depends what you mean by society
yes i think everybody has a moral
obligation to be a positive force in the
world of course
yeah elon has more tolerance for this
than i do
it's just it's hard for me to tolerate
um no i think elon creates immense value
yeah i mean that's what exactly like
elon lowers the cost of many systems
right
like think of the boring company it's
just like that's what we need more of in
the world it's like we're going to take
this thing that we can do we're going to
make it 10x cheaper
that's what makes the world better
um no it's not about incentives and this
is how we're going to move past
like this fake capitalism shit
like like like you know you just gotta
look at people and
you know it's kind of like what people
say about like the billionaires like do
you really need more money
you know
um well yeah people who put effort into
worthless ventures like
i said this stuff a lot on my stream but
this is really like like a call to
action if you work at a job
where you know that you create no value
quit
quit or you're a total loser right
you know like i'm sure some of you i'm
sure some of you out there have jobs
and you know that you do nothing you
know you contribute no value to the
world you might even take value from the
world
quit
billionaires reinvest in like
billionaires aren't necessarily a bad
thing i really don't think a lot of this
problem is
is is like a lot of a lot of
billionaires get an unjust amount of
hate
for for what they they do right like
most billionaires are new money and they
most people today who are billionaires
are billionaires because they created
immense amounts of value
i'm not talking about jeff bezos i'm not
talking about mark zuckerberg
i'm talking about all the people in the
middle
i'm not gonna like i'm not making a
moral judgment of of tick tock
right like is tick tock as a company
negative value i don't know i think
people enjoy tick tock
this isn't what i mean right
i mean the people who you contribute
nothing
the people who contribute nothing to
society the people who society would
actually be better off if they didn't
exist
right the people who are just attacks
like i'm specifically talking here you
know a lot about
all financial services right hedge funds
you guys are scammers like it's not okay
and like like we have to we have to like
get to a point where you know we kind of
say this right like
like you're not you're you're you're
you're not you're not setting the prices
of things right like that's a lie
i'm not saying facebook's crap i'm not
saying facebook's crap i'm not saying
tick tock scrap
those things at least look like it may
be a shitty product
but they've at least kind of built a
product for people i think they have
shitty business models and i think
there's problems with them
and then you know what we'll even go
like like like hedge funds
particularly you know that they've taken
up all these smart people
and they contribute no value to society
um yeah you know facebook has an ai
research lab
and like honestly i think
you know what here's what i'll say about
facebook and tick tock right
like they're somewhat addictive but
people do spend a lot of time on them
and
people might say they don't enjoy that
time but like i much prefer to look at
revealed preference than to look at uh
you know stated preference i'm not
talking about the things you know about
i'm talking about every single person
who works in administration
right i'm talking about every single
middle manager out there
i'm talking about every person who works
in like
finance industries that have nothing at
all to do with people that provide no
value at all to people no value at all
to society and are just a tax
you know in london they pay us way too
much but houses are also expensive when
you all hate our jobs quit
quit you know you look at
go figure out how to produce value
and then also you have a whole class of
people who i have no idea how they get
money but they're perpetual travelers
right this is another you know what the
difference is between children and
adults
children consume and adults create these
people are grown-ass
children
i don't mind poker players look look
poker players don't take money from me
the problem if hedge funds only competed
against other hedge funds i'd have no
problem with hedge funds it's just a
massive tax on the
whole economy the whole financial
industry's attacks on the economy
poker players gamble against each other
that's great that's great you know
you know what i'm not yeah
bankers get 120k out of university it's
just too
huge to refuse it's
fucking fake
i don't know who scammed you into
equating like
these numbers with with any kind of like
real value at all
the money is made up the money is backed
by nothing
you're playing for points in some guy's
game and the guy who made the game
rigged the whole thing
money doesn't get you girls that's the
dumbest shit i've ever heard
people who think that happens have zero
luck with
girls
you know what gets you girls man talking
to fucking girls
it's really not harder than that
money doesn't get you girls anywhere
this is the dumbest myth
you know who promotes this like club
promoters like
like like this is this is this is just
it's just to promote
no one gets laid from clubs man you know
no one's like like like i went home
i met this girl at the club and i
brought her home this is
rappers and shit lying to you
you know and it's like oh yeah the club
is just a way to scam men out of money
oh my god all right
i wasn't expecting ranting some women
will go with any guy that has money wait
you mean like hookers
i mean hookers aren't that expensive
guys like you know there's there's
there's great hookers on the internet
and like it's not that expensive
right like we're not talking like lots
of money here i think what you're
confusing
uh i think you're confusing money and
status right
like yes women you know you use your
women to like status
there's like you know seven million ways
to have status
and your blue check on instagram will do
you more than money for women
yeah no oh my god in cells well are you
allowed to talk about intel's
like insults are the most self-loathing
little fucks like if you guys just went
you know
back in the day 10 years ago like a
pickup
used to be this like great thing like it
was like those things like yo how do you
get laid man and like it turns out
there's like ways to do it and
the biggest piece of advice is go out
and talk to women
right and now you have these like like
in cells who are like i'm this or i'm
that or women won't like me because this
no women won't like you because you're a
little bitch who stays on the internet
and talks about how women don't like you
yo i own 24 30 90s giga chad right here
women will never like you if you go on
the internet and complain about how you
can't get laid
i'm gonna put a title on this webpage
let's put a title on this website
cherry computer
you know does somebody tell you guys
this stuff
fucking victimology man you guys wanna
still
this is because it's because i'm only
five seven and there's guys out there
who are sixteen
shut up you know
all right what am i doing closing tags
well i kind of want to close those tags
because then the whole thing is going to
be the title in the head
all right um
all right we're done with the rant what
do you mean we have to talk to people
it's rigged man
i get out
uh you know picking up women is is
actually one of those like it's not
rigged and
it can't really be rigged because it's
very decentralized
right there's like lots of women out
there people like oh well this this and
that on tinder well yeah don't meet
women on tinder man like that's a tinder
problem
oh it's it's in you know oh man you got
you guys know it's my favorite um
how to stop failing
at life quit
you know you you guys
uh bitching about the bitches edition
um
everybody everybody everybody should
really read and internalize this i'm
telling you like i
i found this when i was like 15 and this
was like one of one of the
the the most uh you know
the um go where the girls are
what you know should go out clubbing do
you want to date a holla batgirl
fuck no then no don't go out clubbing
you may not realize it but fully half
the population of this planet is female
you don't have to suck up to an asinine
subculture that you don't actually
appreciate just because there's some
single girls there there's single girls
everywhere
just do something you enjoy in public
skateboarding warhammer 40k whatever
i guarantee there will be at least one
female there eventually
you know what did lord say maybe the
internet raised us
no it's not cherry ai it's a cherry
computer we're building computers for
the future
all right wow i get too amped up from
the rants you know
we have two streams on twitch what are
hot tub streams
i heard about this i got an email from
twitch talking about some new guidelines
and
it's am i allowed to show nipple and
that's the only thing that i was
interested in the answer is
only if in a nipple appropriate setting
all right so this is the risk five all
right
maybe we gotta do meditation you know
it's been a while
and i believe there's a time for
meditation
in cathedrals of our own
nippler
they teach this shit in high school
the schools are propaganda machines
run by the government
you guys like you know we had like all
this propaganda
during like world war ii and during the
cold war and all that kind of shit
you know it never stopped right you know
you know the propaganda never stopped
you just don't see it today because you
call it normal
but you know there's a lot of shit
that's uh propaganda man and that's why
they don't you know
teach you that in in high school um
now the the all right
exercise six finding your
soundscape
all right we got we got a signal quality
check on here
no no we're gonna we're gonna meditate
um
hmm i think i need to get a i think we
need to wipe the sensors
with a damp a lightly damp cloth
i dated this girl she's homeschooled
uh now she like went to a bunch of
different schools she's homeschooled
like
you know it's just crazy when you meet
people who like weren't brainwashed
like this girl's like a genius and could
think like clearly about society
you know
try to get the ah
ah here we go
for this calibration find a comfortable
position
and close your eyes take a deep breath
muse is now listening to your brain
signals
relax and let your mind flow naturally
let any thoughts feelings or sensations
simply pass without any kind of judgment
[Music]
welcome back finding a comfortable quiet
place to practice can make a big
difference
with muse it's just as important to find
the right soundscape to keep you on
track
our relationship to specific sounds can
influence how we feel during a session
this is why muse has different
soundscapes for you to choose from
let's explore the soundscape you've
chosen for this session
when you're ready get comfortable and
release any tension you might be holding
in your face and jaw
for this session whenever you notice the
sound get more intense
instead of reacting immediately stop for
a second
and listen try to hear the weather as
clearly as possible
notice how intense it has become and be
with it
for a few seconds then let go of the
sound
and come back to your breath ready
place your attention on your breath now
great job
that was not my best one
uh
i did okay but the important thing is
we're calm
um oh i have something else for you guys
you guys know about comic-con
we're gonna have to all get on topic a
little bit
i love wait the waking up app's great uh
this is a muse
i did like all the good waking ups
um
well i've been out of practice with
meditation lately
meditation's not bs
does the headband bs yeah
i mean it definitely correlates i don't
know
i thought it was a cool product so i
bought it
i mean i know i'm a lot more calm right
now
uh yeah comic-con yo so we got we got
two tickets
we got general admission and we got
vip
um
it's going to be good
it's we're putting a lot of content
together
to kind of present what comma has been
doing for the last five years
um you know open pilot is the
culmination of
tons and tons and tons of work and
i'm hoping
by kind of putting it together like this
a lot of other people working on
self-driving cars will
kind of realize how hopelessly uh behind
they are
if they watch this kind of stuff um
after trying tesla full self-driving
uh i've become pretty confident khan was
gonna win
um you know part of the reason i'm doing
this
is self-driving cars are still 10 years
away
like true self-driving cars um
you know i'm talking like level five uh
i think i think we might
just see them by the end of the decade
but
the current amount of compute uh
available is not big enough
to drive i don't think uh
so one of the goals with uh you know
cherry is to build accelerators for calm
right now comma uh our devices
uh have about as much inference they're
they're about on par with a b
and then our trainer is about on par
with a mouse
i think in order to drive you're gonna
have to get inference on par with a
mouse and a trainer on par with a human
so i went over the cherry
been working on the cherry business plan
a bit here
um
charge design with need in mind we
upload small risk platforms into the eye
cache and let them run
uh so i think we've answered
both of these questions i've been
texting with what referring as the
source
um and uh
some great ideas about really how to
build this thing
in such a way that it won't just be
fast for the current neural networks but
it'll be enjoyable to program
sometime you'll program stuff and
think of like what's enjoyable to
program and think of what's not
enjoyable to program right like
you know does anybody find writing
multi-threaded multi-process
things to be fun no like that's not
fun what's fun like like code golf code
golf is fun
um is cherry now a serious thing i mean
let's see so here's comma comma very
serious
um here's cheapy and cherry's somewhere
in between
uh elf need need is uh
it's a thing an open pilot to accelerate
models
you guys can can look it's one of the
other ways that we beat
there video
so our first step is to build everything
in this board um with a four by four by
four
manhole unit uh so you know it's it's
this is only going to be at 50 megahertz
we're only talking 6.4 gigaflops here
um this isn't going to be serious but we
also need to get
forward backward passes of these three
nets are the three that we're targeting
um resnet50 and bert large are in mlperf
uh i took mlperf more seriously actually
i like mlperf a lot
there's only three accelerators listed
on mlperf right now and only one of
which you can buy
uh there's the nvidia which is one you
can buy
there's google which you can only rent
and then there's huawei which i don't
think they're allowed to make any more
of because of the tsmc thing
um so we'll be able to train mnist
models right on here
and we'll see if we want to use this ddr
ram uh on here as well
to like that'll be the big address space
that we can
we can dma into uh
and then after we've trained mnist on
here
hopefully in a few weeks we'll buy
um alveo u250s and a linux computer
and then we can move to we'll put a link
computer in the house um
so this is not going to have obviously
very tiny i'm going to get the dma to
work over this ethernet interface
i think it'll be easy on here we'll
support dma over pcie
we'll have a 20 meg on board sram
we also have 64 gigs of ddr4 and we're
talking a 16 by 16 by 16 map mall engine
and that will be four teraflops um and
then
on this card i think this is where we
write like the pie torch port
um this is where we make multi-card
training work
and i'm hoping by the end of here
without even taping out a chip will have
something that's
decently competitive on mlperf with
um maybe not a100s
but maybe like 10 1080s or something
and then when we do the the the tape out
of the cherry two
this if we actually take this chip out
i'm hoping to do it from like a turnkey
place
so i can just hand them the verilog uh
we do a tape out i want to sell these
cards
uh for a thousand bucks
and then um
i'm hoping that even with a lower power
budget
uh we should be on par with a 30 90 and
one of the reasons
we can do this is there's a few things
about the 39d right
so the 3090 is a massive multi-core
machine
the 3090 has 6144 cores
all right the cherry two has one core
but that one core has more teraflops
than the 30 90.
so we're spending a lot less power on
dispatch
we're also spending a lot less power on
copying back and forth to ram
um so our cash is a good bit bigger not
the a100 has a bigger cash
actually we might want to up this to 16
million elements because then we're on
par with the a100 cache
[Music]
and then
yeah if we're here and we've sold 10 000
of these cards
uh we're on track to winning the ai chip
market at this point we raise a large
amount of money
um we hire
people who actually have expertise in
taping out
an experience taping out high process
nodes
so in 12 nanometer i'm hoping yeah we
can just bring it to a turnkey place
hand them to the verilog and be like yo
uh do the best you can to lay my chip
out um
but after the cherry two uh if this
really works and this really sells and
these cards are good they have pie torch
support they support multi-card training
uh we're going to tile the core and go
to a smaller process node
cherry 3 is basically 16 cherry twos
on one chip
you know a big chunk of shared memory
between the cores and that's how the
cores will communicate
no fancy networking they just have a
shared address space and a big piece of
ddr memory
um so
yeah we're talking 16 of these mall
engines
and that would be one pay to flop at one
gigahertz
uh and then we have a paid-a-flop chip
and a pay-to-flop chip where we can
actually feed it
from the s-ramps
uh and there goes to a few reasons as to
why that's possible
um so our goal with the cherry 3
is to build a 300 watt card that's on
par with a
dji dgx a100
uh we also will get some okay so you say
like how is this more power efficient
than nvidia
so we are using a slightly smaller
process um
we won't be thrashing and we have a lot
more memory on the chip
so we won't be going out to the external
memory nearly as much
um you know the the control logic is is
much smaller
uh yeah
and hopefully yeah we can make um
one pay to flop work this is this is
this is pushing the limits now of what's
possible
with like tops per watt
but i think if we have this we'll be
able to get all the best people to do it
and this will be by far the best chip in
the world
um is 16 gigabytes not low yeah we can
maybe stick more memory on it i mean the
nice thing about that is that's like
just off the chip
ah graph claims 10x energy efficiency
over video with the local memory
approach yes
i mean we're using the same 10x right
like it's nvidia's memory that's killing
them because nvidia's memory isn't
really designed for this
um how do we convert tiny grad to binary
for cherry
you'll see i'll i'll start like
you'll write these kernels in risk five
and these will be like like
like hpc kernels and you just load it
into the core
um well i don't know what jim's doing
attends torrent as for what's tense
torrance doing so far
ten story's talking about weird
researchy stuff they're talking about
things like sparsity they're talking
about
you know this is a bad idea this is a
bad idea to talk specifically about like
certain kinds of
uh you know of models or talking about
like the future of what models look like
just leave that to the researchers
the job of the compute builders is to
build very flexible
easy to use compute that's available we
don't need hbm
you don't actually need that much ram
going out
at that much bandwidth going out to the
the uh
the things if you have a lot of sram on
your chip
right so i'm talking about 288 megs of
sram on the chip
um and this is all for training
uh but yeah we can do branches i mean
the core is a risk five core
so like okay fine the cherry tree will
have 16 of them but like still
we're on par with like a normal like
multi-core computer we're not talking
about
thousands of cores here we're building a
single core risk five super scaler out
of order
right targeting like i shouldn't even
say one plus
instructions per cycle i should say
we're targeting we've not even put two
matrix multiplier engines in this thing
um google tpus are just 2x better than
nvidia uh
well which google tpus google tpus were
only two
google tpus were 2x better than nvidia
um
on a 16 nanometer node
right so like nvidia's you know down on
like a like a seven or eight nanometer
node and the google tpu v3 on a 16
nanometer node was 2x better than nvidia
um so yeah the the cherry 2 on the 12
nanometer
node should be like on par with nvidia
um
i think my uh my targets for power
may be a little uh ambitious i do
recognize that
also one way to get an easy 10x over
nvidia
is not to rip everybody off in terms of
price
all right like we're not looking to rip
people off i want to build all this
verilog open source
here's a vector risk 5 core that i'm
planning to work on
won't other companies use my ip and what
will they use my ip for
making ai accelerator chips for the
world
hmm
how many tea bros mit
think about like this all right
you're only on this planet
i think it's becoming really obvious now
the way that you
get more is not by taking more for
yourself
if you live in a world that doesn't have
technology this is obviously true
right the amount of um
you know uh uh whatever we're hunting uh
deer the amount of deer the tribe kills
is fixed
so what you want to do is try to make
sure that you get more dear
with respect to other people in the
tribe this isn't how the world works
at all anymore everything that's made my
life
better is not because i have
comparatively more money than i used to
have
it's because the things you can buy are
better
right no amount we can talk about 30 90s
no amount of
money in 2000 could buy you with 30 90.
now you can buy it for just you know 4
000 on ebay
um the world isn't even close to zero
sum
right so you're like okay so why do you
give it away right so what's my goal
what's my goal in life right like my
goal in life has nothing to do with
you know stacking gold bars in a safe or
something
i mean you know it has to do with uh
again i have more you see this red bull
right
this cost this cost uh i think it was
two dollars and fifty cents
at seven eleven right
um if i was a billionaire
i'd drink the same red bull it's
interesting like that right
it's not like i can buy a 10x better red
bull for 10x more money
um yeah i hate graph stuff in tensorflow
none of it's graph
i hate graph stuff i don't want to do
any graph stuff
i want to build a processor a normal
computer processor and i want to execute
things
sequentially like a normal program
no you're not not rich enough to know
about the 10x better red bull i know
billionaires
i've hung out with billionaires i've met
them i've seen what their lives are like
right like they're drinking the same
shit man
there's no market above look i go to
this coffee shop
i pay five dollars for a latte you know
there's no there's no fifty 50 latte
market
oh why is the last step to sell the
company
um well so you saw the company for two
reasons one
uh because well you have to pay the
investors back um
it's not really like comma like solving
self-driving cars is very pivotable to
other things
after you've built the cherry three and
you've won the market it doesn't really
matter anymore
right you can sell it to intel and like
even intel would have a hard time
screwing this company up i mean
they would after like 10 years but for a
while they'd be able to launch the
cherry two the cherry three the cherry
for the cherry five
um and so it doesn't matter i mean sell
the company right flip it and it's it's
not about really like
making money for me it's about uh you
know
alleviating like like giving me capacity
to work on other things
um so that's why you flip the company
right like like in some ways if you
don't take their money for it
they won't think it's valuable
um can you counter node size with
density
no money is not resources money has
very little to do with resources today
uh do you see this i mean you can see
this in
could waymo build open pilot
well could cruise build open pile this
is actually a better one
um right i know less about you know way
more sebastian thrown way mostly old
days but like
um when
when you look at crudes there's a kyle
vote lex friedman interview
and kyle vogt says that his original
idea was comma
and then he lists three reasons why
comma is too
hard right um
one of them is about needing to support
many cars
right this is this is the first one he
gives he's like well so you know we
built crews you know cruise was
originally going to be an aftermarket
add-on
uh we built crews uh but it only
supported the audi a4 and it turns out
not that many people have that car
right well so what open pilot supports
like 115 now different cars
um the second one that he talked about
was uh about
the fact that car manufacturers may
change the firmware
and you'd have to you know deal with
that well
again we just like looked into that
right and like like i think he
also talked a bit about like yeah just
the difficulty of talking to all the
different cars and reverse engineering
them it's like yo
like we did that and we crowdsourced it
um yeah i mean that was and then and
then he said something about uh
i i'm not even sure i mean maybe he said
safety but like again that's not like uh
like these are all problems that you can
just
overcome right as far as we can tell
right now from the data
open pilot seems now this may just be
the open pilot user
but they seem to be about 2x safer than
the average driver
right now you can't really separate open
pilot from open pilot users
um but you know so like safety
car support and reverse engineering done
all right
sorry you couldn't do it kyle what did
you do instead you built the cruise
orange right
um so but my
yeah rainbow's lifestyle commercials
it's laughable and that's like like what
i made fun of them for
um so just to counter your idea that
money is resources
you know on our slack today someone's
like are we sure waymo's not a front for
something
i mean what what what is are we sure
there's three billion dollars not going
to like some other operation
because it doesn't make sense
my plan is to release the chips as pcie
cards
inter chip bandwidth
is overrated assuming you're training
these normal size
models where you can fit batch size one
on a
on a card
all right no more self-driving cars um
yeah so my goal with these things is to
yeah
pcie cards i mean i say pcie here
do i think we're moving closer toward
the goal i had in my south by talking
about culture and now i don't
uh i think 2020 has
um i put it on my blog
uh i heard a rap song in 2020 thought
i'd explain the lyrics here after
watching 2020 happen the current group
in charge should never be in charge of
anything ever again
uh so and yeah you know you guys know
i'm down to get behind the revolution
um i'm not you know i'm i'm uh
i'm i'm on the spectrum kid who knows
something about computers right
where's caesar you know i'm waiting for
caesar
i'll join his army
um where do we manufacture
having a single cpu with an additional
matrix multiply block sounds so awesome
yeah i know right like doesn't it
and like like we're we're texting about
like i wanted to build these like like
like these three registers
if you look at my my tiny grad model um
like my tiny grad model is uh
here this is my if you look an extra
cherry it's what i have
so this here um like my model i put like
four registers and i like labeled them
stuff
and i'm like yo like what kind of fix
function machine crap is this
why don't we just have 32 registers and
each register
is 1024 words
i like i think it's beautiful
okay so let's see what's in all these
vector extensions
um but yeah this is this is my rough
emulator for the architecture
um it supports loads and stores it
supports
this set of binary operations this is
like this is the alu
here adds up maldive molac
molex is actually going to be taken out
it's just going to be a multiply and
then an add we got a what do we assist
construction set nah brah this is
risk you don't have a balac you have
maul and ant
um and then like yeah we'll we'll take
things like that out and we'll give it
uh 32 general purpose registers
um work from home is an absolute joke uh
any company who thinks you can build
any reasonable culture with people
working from home is
so misguided uh cherry computer is going
to be in person
um either in san diego or la when it's
time to hire people i want to get like a
beautiful glass
office you know what i mean
um so no comma doesn't hire remote and
cherry will not hire a remote
if you're serious about working some
working on something show up at the
office
oh yeah programmers on reddit say
otherwise yeah well you know what they
also have enough time to post on reddit
no work from home's not fine
widening fp add and subtract
am i working from home right now well
yeah there's no office for cherry though
comma's all working i went to the office
today
no no no
most of california is not san francisco
huh
i mean this is interesting right
it's like i guess i didn't really
realize this but
oh so okay here is an example actually
of where work from home can work right
like
work from home can work if you're
working on a
project that you're self-motivated for
right like if you're
contributing to an open source project
for free you can do that from home
you can do contract work from home too
what you can't do from home is salaried
work
and certainly not work when there's
equity involved
for the ieee floating point standard i
think we're gonna not
implement rounding uh to match ieee
exactly
um yeah the vector stops changing that's
fine
i just kind of want the basic idea i've
never really looked at a vector
instruction set before
my only real experience with it is like
intel's avx stuff
uh i've never even like coded an arm
neon so i don't really know what that
looks like i should probably understand
it first
um this mammal engine would do
convolutions versus some stranded offset
addressing control yeah
um there's tf-32 we're implementing
tf-32
uh so on these two
we're actually doing tf32 but we took
one bit away from the mantissa
because all the block rams are 18-bit
block rams
and not 19-bit block rams and i'm not
going to create a whole other block ram
just to store one bit
so actually it's less of a
problem now that i switched to big
words so we can reconsider that maybe we
will go to 19 bit
um yeah we'll reconsider 19-bit
all right this is this is the yeah
there's a lot of pieces to this project
so it's it's good to kind of understand
them all so this is in twitch core
um this is my memory and like how much
striding potential we get is
controllable here
so like the question is kind of one
dimensional strides or two dimensional
strides
and i've kind of settled on one
dimensional strides two dimensional
strides require
too many addresses to go into the sram
um but yeah i mean actually if we just
set bits to 19 that
should just work
let's see i have an 18 here
let's make bits an input parameter here
every other video i see the same hoes
let's get rid of the stripes stride less
yeah all right so this is this is like
my my emulation of my uh my memory
and then we can actually go in here
and i should really rename all this to
cherry
um parameter
bits 18
bits bits
so now that's with 18 bits let's try
with 19 bits
oh wait no that's not actually right we
have to go to test bench for that
what
okay i think that's 19 bits
hmm that should show at least one more
hex character though right
oh i said it's okay i said to 19. ah
there we go
port w
well this is expects good way to find
bugs
reg size equals bits times bets
bits times has some size that seems
right
port five
of risk mem expects oh it's this one
here that i didn't do
right
no bits is right there
oh did i not pass bits into the memory i
didn't pass bits into the memory
there we go boom
okay now it supports 19 bits now let's
see if we can synthesize that
and we'll see how many b rams it uses
and stuff
all right so now it's creating one block
ram to store four extra bits but
actually that'd be cool if uh
if this just worked because it's really
less of a problem once we get to
yeah look i'm using no
did this just work okay
seems like adding new devices to pi
torch is fairly simple as well yeah it's
not that hard oh i didn't change it to
19.
okay let's see what changes
did i get floaty i finished i did
actually yeah floating ad works
you can check it out it's in this refill
um
okay so look it switched all to b ram
18s
didn't use any b ram 32s well that's a
lot of bram 18s
that can't be right
this used 65 of the bram 18s never mind
never mind 19 bits was a mistake go back
boys
go back
uh did i get my floating point edition
to work i did
um wherever i thought tf32.c yeah so
this is add
my normalize is a little stupid but
that's my floating point model that's my
floating point ad
so i understand what's kind of there i
also read this good paper about it
that shows you like
if you use like the dsp how many luts
how many registers you need
uh yeah wow adding and subtracting need
a lot of lots
iterative combined
for multiplication and addition and
subtraction
see that looks pretty cool
it only uses one dsp uses that many lots
um have i tested my core with risk
broadcast yeah yeah so i i i went
through
there's i don't have a like a test
harness yet by the way
you know i'll make that an issue if
somebody wants to
file a uh
if somebody wants okay so i made the
test work but right now you have to go
in and like manually edit the test in
the test bench
it's actually not even in the test bench
it's in risk it's in cpu
so if you go in cpu like this is the
store test right now
run the store test i can simulate and if
it says trap one
it means that the test succeeded and you
can see if i like go and i
let's let's break the store function
right like
here we go let's uh do load do store
okay
we'll break the store function we'll
take the data out all right and well
okay that doesn't even
finish
that's trap zero but let's say like we
make a typo here and put two instead of
one
see trap seven that means the seventh
test failed one means they all succeeded
so if somebody can write something that
uh
that goes through and test them all i
would appreciate you
mo asker i appreciate you
that's why you're a
every vip videos
um
ooh risk v formal
when they do their formal verification
cool i'm interested in this too
i mean so it really looks like what
we're building
um i mean tests are good too you want
tests you want formal verification
really what we're building
is a super powerful risk 5 core
that's also just a great risk 5 core on
its own but also has this insane vector
engine attached to it
so it's actually i shouldn't
talk about like that's not what i mean
by work from home is the problem
work from home is only the problem if
you're getting it's an incentive problem
right if you're going to pay people with
salary
or with equity they can't work from home
right like like what they're doing when
they choose to work from home is they're
prioritizing their lifestyle over your
business
and like that's great and you know you
can scam companies out of that but like
that's not
you know like we're here to build
something right
um no it's not even that
like if you're contributing to these
things
from home well you're contributing
because you want to
and if you're contributing because you
want to we don't have this incentive
alignment problem and then you can do it
from anywhere
like yes fuck any biz live your lives
what do you want to do you want to you
know
travel around from from from place to
place and you want to like consume
things that other people have created
the only things that make going to these
places
good is because there's people who stay
there and create
value there
like something that starting a company
has taught me and that i wish
you know and and and this is the kind of
stuff that i blame on
like how hard they make it for small
businesses and how how the monopoly
stuff
um works is that people don't feel like
they're an owner of anything and if
people don't feel like they're an owner
of everything they're
anything their attitude is all going to
be fucking right like you know they're
saying when you rent a car it's like
never gentle on a rental bro and like
yeah i live that life right like live
that life
and you know people who don't want to
create value like i said yesterday
bullets are cheap
right so it's fentanyl right yeah you
know it's cheap
um the employee is not an owner because
the ceo or boss can fire them at any
time well of course but
if you know you have equity in the
company
you're an owner of the company
can you briefly go over why you should
not start a business
i mean if you're trying to start a
business you're already doing something
you know who should not start a business
anyone's like
well i really want to start a business i
just need to figure out which business
to start
oh oh
you know
you can take it you know midday
you can you don't have to like the
officers shouldn't like
you know tell you what hours you're
expected to be in the office go to the
office whatever hours you want you want
to take a nap in the office take a nap
in the office right
it's all fine
what has been the progress today so far
well we made a tiny tweak to the memory
um but other than that not that much
okay
so we're gonna write the reduce ops
now
the reduce ops do this thing where
[Music]
like okay the vectors in this machine
maybe we should write some maybe we
should write some dots on the
instruction set
um
you know what we'll say units right
so we're now thinking of a
um 32
31 vector registers
all right we requested the zero vector
register
um
then we have a matrix engine which is
something like matt maul
you know okay so these registers
are 1024 uh
element 16 19-bit tf-32
uh wide
and you can effectively think of them as
32 by 32
um
you know matrix so they're
actually should we call them matrix
vectors
so the vector can be both a it can be
both a vector or matrix right like
depending on how you think about it
um
we'll call them vector registers but you
guys understand like what i mean
right like you can view it like this or
you can view it like this right
um so we have this special instruction
called mammal
um
and then of course this number can
change
we'll say size equals 32 so this is you
know
size times size element
besides my size matrix right
so this is the matrix engine
um this is the vector engine
hey i'll use we'll say one or two for
aos
you no ad sub mall
all right guys now now it's on topic
time we need everybody to focus we need
focused energy
focused energy uh movement
oh yeah move
um load store engine
load v0
uh i
have some more notes about this
somewhere
v0 address
stride
i'm pretty sure i can stick both the
lengths up here
actually well so
i don't want the length lengths make
that much more sense
i guess we can put them there that's
kind of nice
okay so this is something like you know
let's say we're loading into v0 and this
is like
r0 and r1 well actually it can't be zero
so i should be using zero
because zero is the zero register
um something like this and then
let's just look quickly at the risk 32
guide up here
over here
this is more vector shit
squeeze back here we go
i think it's going to actually oh well
they're called x okay
you know called r and these did call
their
vector v
i mean i i should like get more familiar
with with risk it's like i don't know
which ones are the like
what's the i j and k of uh
you guys know i j and k from like way
back in the day
which registers your ij and k registers
let's just say x1 x2
uh and this is actually only stride y
no it's not it's here we're not right
there
they're not even called r they're called
x
oh no i think you might be right no no
no no no wait hang on
i shouldn't i shouldn't talk so fast
because there's like stupid renamings of
them
x0 is uh
they have like names for all the
registers
do we have enough bits for all the
information the instruction encoding
yeah because these are actually
registers
right so this this this load is
we'll look at it it should be fine
um cpu.i
yeah no none of them are r
i think they're just t's the t ones
so those are those are registers so when
we look at the
load instruction um
i actually kind of wrote this out where
did i write this
notes
maybe in twitch corner
that noise is annoying oh yeah so like
this
i don't know you just look it's like
what's a normal load instruction
okay so they have
base death and offset yeah i mean i
think we can use the same
instruction and coding as like it's like
a combination of those two
no i've seen them actually this it's
called something else
um
yeah it's an r-type instruction
so like this rd is the vector register
um and then these are
these two registers here which contain
that stuff and contain that stuff
a mip style processor with a matrix
accelerator attached it's the ps1
okay then we also need something called
the permute engine
uh as store is just this but the
opposite
okay
uh oh yeah i shouldn't really be using
those well we'll just call them t
they are the return address and stack
pointer you're right
so let's let's okay let's be a little
better about
let's respect the risk
temporaries okay we can just call them t
t0 and t1
so for the vector engine we just have
stuff like you know add
and we should also be able to support
things like this
permute interleave shuffle impact
low and high yeah it's i'll copy
it that be too complex for risk well
it's like a permute engine so
we can also like again this is like i
want to do like a whole superscaler on
this processor so we'll be able to like
run multiple of these at the same time
let's see what we can glean from
the risk vector spec we already gleaned
something which is that we're going to
need to also support
vector scalar at
um like i'd be cool with something
that's just like transpose
you know
risk doesn't mean few instructions it's
more the load store architecture what do
you mean by that
so part of what makes this stuff so
confusing is they have like these very
complex memory models for these things
because it's supposed to interoperate
with the with the
main memory i'm not trying to
interoperate at all
i'm just i have my own memory system for
this accelerator
and like that's just how it is bro
vector vector what is this vm
why do they have vm
why let's understand this
what's vm can someone explain it to me
oh cisc has memory register ops i see
yeah we don't have any memory registraps
that's that that's a cute distinction
actually
what's vm do you see vm being used
anywhere here
yeah i can disable the noise with the
mute button as well
uh no i like the noise when i'm alone i
just don't like it with you guys
i want to disturb you um
what is vm
what are they telling me virtual machine
i think it's that
oh it's just like one bit
what is this bit though
that's all cool man like i like these i
want to steal these
specifies where their masking is enabled
what's mask i hate masks masks are
stupid and don't do anything to prevent
corona can you say that now
do we all accept that yet or you know is
this still controversial
um
v-spec
oh this is better
vm masking
vector masking
element operations that are masked off
never generate exceptions
um guys
all right never mind i did i does the
bait you guys shouldn't take the bait i
shouldn't take the bait
oh
ah don't take the bait when available
do i need this why do i want this
why is this
wait
someone probably very smart came up with
this so i should understand it
zero dot mass equals one
no masking operator is specified
what
this is where the vector masking is
enabled
i mean this seems kind of like what i'm
trying to do here with length x and
length y
but it's even cooler if we can just put
it in a mask
where are these masks being held
where's the mascot
is there like a mask in each register
i'm trying to understand where the mask
is being held i get what it's doing
i i like it i like it that's actually so
much nicer than my length crack
man smart people came up with this shit
yo i literally just want to steal all
this vector stuff
we're just going to implement vectors
and we're going to take over the world
section 4 6 of the vector docs okay
a vector mask only operates
occupies one vector register
oh is it a special register
is there a special register called the
vector mask
or basically what i'm asking is is there
multiple
yo love these people man this guy
i met him once he's at berkeley right
yeah
yeah yeah um
they showed up at one of his classes
once
man who'd have thought i'm gonna go down
in history
no the spec is not ready
i just want to sit like writing that
risk five processor made me think that
like
risk five is just just like made by
geniuses
where the least significant bit of
v zero sub i equals one
oh v zero special
is that what it means
does it actually mean v zero
but this is it's just beautiful i love
risk
wait it's actually v0 though but see
what you're telling me is every register
is actually affected by v0
i'm not sure i agree with this
mask operations
vector data movement
insert gpr
into vector
hmm
i don't know if i need these kind of
things
oh yeah you see like like this is all
the shit we're not gonna have
oh it does support fmac okay i'm fine
i'll support fmac
just because they support f mac
yeah yeah we're not supporting any
different data types we're supporting
one data type
this is a 20-minute talk the slides of a
whole thing on masked operations
wow we're learning so much boys gotta
steal more from
risk risk
[Music]
[Music]
[Music]
how's it kill a refresh rate
p6 chip triple the speed of the pentium
yeah it's not just the chip it has a pci
bus
you knew that indeed
risk architecture is going to change
everything yeah
risky is good
[Music]
hey remember when there was still hope
for the future
it was garcia actually change everything
hack the planet
i still don't understand this mask yet
is this actually the v0 register
masks are stored in a regular
vector registered
the lsb of each element is used as a
boolean 0 or 1 value
i don't think they actually mean
huh okay so i think there's actually a
mask register for each
[Music]
see the third paragraph under five three
vector masking okay masking support are
many vector instructions
the destination vector group cannot
overlap
is always supplied by vector register v0
i don't like that
um
i almost want to buy this book
just kidding
i don't like this v0 crap
you're telling me i need a port in my
register file to read v0
okay fine v0 is special
what's interesting to mask and unmask
vector so
in earlier proposals
vm was a two-bit field
that provided both true ah they're
really they're really struggling with
the mask
this is this is a nicer way to think
about it though and like maybe we can
like at their mass generation
instructions
oh but this is super nice
oh and then like to load in zero i just
have like a mole
i can just do like move from yeah yeah
yeah so like i can move
i can move vector but i can also move
scalar
yo i'm loving this
x0 is the dedicated zero yeah normal
rescue
vector configuration instructions
wait what it supports stride
they know about stride
indexed
whoa
so if you're just holding address
that all sounds very complicated to
build
what's indexed
unit stride strided
let's sum up
yo but i like this we're gonna steal
this
it's not the strides you think it
strides words between the lanes no what
do you mean
oh
it's not memory stride
no no no that's like no it's exactly the
stride i mean
does it have vector of indices
and base addressed like intel v gather
v gap
so basically we just have to implement
this
yeah this is wow this is like this is
like what i came up with
except they thought about it a lot more
than i did
specify size of memory elements
oh and distinguishes from scalar i say
cool
and we'll be inspired by that symbol
well
uh
we'll steal some stuff
i don't think the immediate stuff's
useful at all
because we can't fit 19 bits
am i sure i shouldn't be using 3 000
wide and strong by instructions
yo how am i going to get a 8y decode
path
when i have 3 000 byte instructions we
have an 8 wide decode path boys
we need to build a super wide super
scale or out of order engine
it's gonna be blindingly fast
we'll have to write some comparison crap
well we need a comparer engine
uh
by the way is that not the ugliest
register name you've ever seen
ymm and xmm
they do name their vectors just v right
because otherwise i'm going to be upset
or my registers
vector registers oh yes v all beautiful
csrs don't need any of those
read only vl csr no i hate csrs
i didn't write any of them because
they're useless well someone might
detect if they're running on
official cherry hardware or not
you miss arm registers yes arm named
their registers correctly i do not like
what risk did
they like have all these weird aliasing
names for them
like i'm just gonna call them x0 through
x31
slick mips racks
raxiom racks on racks
they're called major op codes i say
format for vector arithmetic
that's why i choose which it is and then
func six i imagine
decides which i'm doing
vector configuration instructions
what's a configuration
strip mining
you guys get what these things do
hints for vector chunk sizes oh we don't
care about that
all right can i see what's in those funk
sixes what are my
options
no we like masking even though that's
only
v0 which is weird but we're fine with
that
i don't like set up a mask
um okay so yeah where are all my alu
options
dynamic selected element
visual
oh that's reserved
they're formally reserved okay
oh well i hate csrs anyway i can't
believe i'm looking at csrs again
um
so
vector arithmetic
what's in the funk six
double with source vectors into
single with destination vectors
narrowing right shift arithmetic
vector fixed point
vector single width here we go vector
floating point okay
can somebody explain to me what widening
means
what's this
okay we can do add subtract multiply
divide
then we can do fuse multiply accumulates
multiply subtract accumulator
maybe a result date oh it's about data
types
oh i hate data types so much time is
spent dealing with data types why can't
everybody just agree
that 19-bit floats are the best and that
nobody needs bigger floats
and uh
floating point square root
okay maybe you don't have a norm maybe
you don't have a power instruction
this is the unary vector vector
oh do you want an exact square root or
do you want an
estimate of the square root we have to
have both these instructions
i thought this was risk
that's the most sisky looking bullshit
you mean 19-bit floats everywhere
oh
reciprocal estimate
okay and these are all the compares
to help operate on mask values
each element in a mask register is a
single bit
vm set vm
move
find first set set
wow okay this is so complicated
oh how much did i owe to pay for this
you don't need fp32
scalar move slide
up and down wow is this like something
like drake
slide slide up instructions
down instructions
wait no no no i just moved a lot
value and v also has the maximum number
of destination elements that are written
where's vl do you see vl
i don't see vl
slide one down
register gather
okay wait this can support arbitrary
scatter gather isn't that really hard
so if i have 1024
that's like a one or two four by one two
four mux
okay we can't support that instruction
i don't know okay i'm done reading the
vector thing
important things we learned is the
masked execution instruction
helper function instructions
to load size into mask
pick the best parts from the spec and
roll your own
we're not really doing general purpose
compute i mean what we're doing is kind
of interesting
um
new instruction set v little v yeah
just let's do a little v
i'll rename you ants to instructions
uh nvidia is designed very differently
from the thing that i want to design
nvidia is many tiny cores
operating with this uh
no no sparse things like sparsity just
piss programmers off
because the programmer like i'm pissed
off like all right so how do i make my
net sparse
and i'm sure i can read some academic
phd bullshit paper about like
using sparsity and back propagation and
then like
can i set sparsity equal to one and pie
torch no
i can't anyone who's actually using this
stuff in practice like hates all that
new academic crap that comes out
deepmind came out with a paper where
it's like you don't need to use batch
normalization
just use this crazy extension to
stochastic gradient descent
and like that's great but like
batch normalizations in pie porch
um okay let's let's implement the max
instruction
and then i think that's that's today's
stream but
uh you know as of today cherry computer
is very real
um cherry computer super real you guys
saw the website
you know it wouldn't have a website it
wasn't real
don't you wish you had a choice cherry
computer
custom card you can buy we should put
the price
for 999
card for sale 2022
job in office in san diego
late 2021
um
you do understand there's a file on my
computer
don't you wish you had a choice
high speed training
with pie torch
wow
you don't need cherry computer that's
kind of redundant
maybe we'll include a link to the blog
post
okay
except i'm gonna peel that yeah why is
inference hardware different from
training hardware because inference
hardware
relies on very static shitty memory
access patterns
i'll just write learn more
sorry i'm i'm too kind of tired of the
code
i thought i was going to write code but
we didn't really recall we just we just
read things
and we made this beautiful website
arbitrary strive to be useful for nearly
all basic uh
dsp algos
my rationale for creating this on the
9.99 it'll be the asic
i'm hoping we can have an asic in like a
year if i actually do this
i don't know there's a lot of stuff to
do comma still
is this something i should do am i going
to regret this
is this going to be fun and easy
yeah it's a realistic price i mean the
cards not
the first card is not going to be like
that great
um i mean there's nothing won't be that
great but like it's not
like i don't even want to have like
on-board memory i just want to use the
host memory and the sram
will this be fun no i'm not doing
pre-orders until we actually have a card
i'm not even buying myself one of those
uh one of those
big xilinx boards until after um
do you have to use iverlog for the pr
oh it's in vivado no half of auto okay
the real reason is fucking video i mean
that's kind of true
no this is going to be fun and easy boys
the future isn't unmodularizing
isn't that amd's motto
adaptiva epiphany
no no no no no you guys you see the
problem
well at least they got rid of all their
stupid cores
some gigahertz
wait what he got bought by the
government
he made his chip and then the government
stole them
[Laughter]
oh my god the cell is so bad all these
things are so bad
one big core
they made him an offer he couldn't
refuse yeah no but like this is bad
this is a bad idea i don't want lots of
little cores i want
one big powerful core
big chip very big chip
you want the parallelization to be done
in hardware well yeah
i mean ideally i don't even want
parallel like i just have
as far as i can tell here i'll show you
i was playing with the um
sorry i was gonna code tiny grad today
but
i'm tired um so this is the
the simulator that i have um
the simulator says that we can run the
forward pass of an efficient net b0
in half a microsecond
um now that's with a 32 by 32 mapmo
and i'm getting 72 percent utilization
uh so this is assuming one instruction
per cycle
which we might even be able to do better
than as well like it's assuming like
they're
i'm not doing any pipelining between
like the loads and the map malls and the
stuff
um
where oh yeah
so if i change it to be let's say eight
by eight
it takes a lot longer because now each
instruction is doing an eight by eight
matrix multi like that's basically the
size of the register so you know i said
the registers were
um 32 by 32
so we're going to get better utilization
but it's going to be slower
it won't be this low this isn't actually
in real time
it'll be a lot faster on the real chip
yeah so that runs now in eight
milliseconds
um and like we can set it to like a
middle size
yeah i see what i did though i wrote the
software before
i made the hardware
uh we've got some test kernels for it
and stuff
uh yeah so this is so like it's taking
1.8 milliseconds with the 16 by 16.
um so this is 4x more flops and we're
still getting good utilization so like
when you build um like all those cores
and gpus
you can't do things like out of order
super scalars and
you know like good branch prediction and
all that kind of stuff
because if you did that
you'd burn so much power on each one of
those cores
running that stuff but because
this core has such a powerful matrix
multiplier attached to it
that's going to blow your power budget
out anyway so feel free
to use all this nice stuff that makes
cpus good
um yeah
72 good utilization yeah 72 is great
anything about 50 is great
power budget uh i mean this
so this card i should be able to fit
496 multipliers on
and that gets me four teraflops
who's the target market for this card
every person who wants to train neural
networks
every person who bought a 30 90 for
training
um i mean this one there's no real
reason to buy this over nvidia unless
you want like unless you like like open
source
and you know you want to like like play
with the cool one that's
open source and fun this chip
is the one that's actually like
if we're competing with nvidia's two
hundred thousand dollar machine
with a two thousand dollar card
like do you want a two hundred thousand
dollar machine or do you want a two
thousand dollar
card all right and then one pay to flop
so then
if i have a rack of these cards okay so
i put like eight cards in a machine
maybe i have like five machines in iraq
like we're talking like 40 cards
40 pedo flops you know with 50
utilization
still that's a human being you know i
want to fit a human
in a rack
um
well that's not a part of 30 90 for
graphics but it should kind of be on par
training wise the 3090 won't be obsolete
so
nvidia will come out with their new
thing
i mean nvidia
this the the cherry 3 will be competing
against nvidia's next generation but
like
you know 20 uh 1080s are still nice
cards
well they're alveo oh they let out they
let out alveos of the
the the xilinx well i mean i'll buy one
once
our goal and i'm not going to do a lot
of this coding on the stream
coding on the stream is more for like
just what's flashy
um would it be a mining card no it's not
a mine no
it's not good for mine
none of these operations are remotely
what you want to do for mining
another advantage we don't have
speculators buying the cards
yeah unless you can turn your shadow d6
into matt maul
uh i mean it's a really wide vector it's
a really wide floating
point vector unit it's totally useless
for krypto
do i think i could kickstart the asic
yeah probably
um if i actually got if i got this thing
training
and i got like a good synthesizable open
source
risk five i'm pretty sure i could
kickstart the tape out of the asic
like and then this card is a seven
thousand dollar card
and i'm confident that i could at least
match the performance of the seven
thousand dollar card
with like a reasonable small chip tape
out
we're sha-2 v6 into those mullets oh yes
obviously we need the sha-256
engine
yes i see your complaint about the
github issues so you wouldn't get there
i don't really care that much about that
um
right doesn't it sound amazing you know
what i don't want to make it i want
somebody else to make it
why doesn't somebody else make it you
know
that sounds nice what are ml gray
problems
is a thing
ah
yeah nobody wants to make what he thinks
the world needs i guys i'm hoping one of
you can do it
um
i didn't make the reduce ops work
the reduce ops are kind of like the
binary ops i'm hoping
somebody can contribute that to tiny
grad so i don't have to
uh no like capital doesn't help me with
any of this stuff
imagine instead of you know me sitting
here designing a chip that i like
this whole thing was designed by a big
committee capital only helps
once you have a minimum viable product
you would like to scale
up no amount of capital helps you find
a minimum viable product
i don't know what gram machine learning
is if a competitor made a compelling
chip would i stop only if it was open
source
that's the other thing too like i want
this whole core to be open source
and i hope you know everybody just
starts
sticking it on things
um how do i know what direction to take
the mvp in
okay you you guys you guys see is very
clear
i want this but don't you wish you had a
choice
you built this but you know uh
cheaper and not controlled by a monopoly
and you know there you go there's your
minimum viable product right there
right oh god i'm thinking about starting
a i come from playing a chip company for
like
a couple years now no i don't know like
a year i thought
a year ago i thought about it quite
seriously but it wasn't ready yet like
it wasn't time yet with comma
hmm a kind of
scale like
they're useful if you're trying to get
the latest tape outs
if you're trying to get the absolute
like like
this card only works in large scale
but i mean i think you'll have a large
scale
no adaptiva and graphcore built
multi-core things that are really
annoying to program
for
what we do if you're attaching binary
blobs to our kernel modules
um
well yeah i mean this is where we you
know raise money and like really
optimize
uh the core layout makes something like
really good
um this chip's kind of a hobbyist level
chip
and that matches approximately the xylex
the the
the stats on the cherry 2 might be a
little bit overstated
i mean yeah there's no way we're
actually gonna get this sort of uh
efficiency
well
no the software world will never catch
up with the many small core idea
the many small core idea has been around
since the beginning of computers
many people have come up with it and
time and time again
what what chip do i admire more than any
other chip
what's the best chip in the world
everyone knows what's the best ship in
the world
who knows
not the pentium doritos all right
not the brain no there's no 50 gigahertz
what's the best chip come on the m1
there we go
right like everyone knows it the m1 blew
everybody out of the water
why is the m1 so good because it has one
fast powerful core
so what did the m1 do the reason we
switch back to multi-core is because of
power dissipation
yeah i mean you don't need to run things
like
what is this it's it's a very wide
instruction machine
it's still a single core but the
instructions are very wide
sorry the registers are very wide the
instructions are risk registers wide
um
movie matt maul's a special case i mean
all the things i'm doing
oh wait we see the m2 yeah how much
faster the asic will be i don't know
i mean let's first implement it on the
fpga like all right
so like realistically what are the odds
that i get to this kind of stuff
uh i have an idea that if
i make this one work i will make
this work right
if i get to here i'm likely to get to
here
in the business model
and you guys can help with this
if you guys want this to exist you know
start helping
by the simulator i mean that you know
the cherry stuff that's in tiny grad
uh
programming multi-core is always going
to suck
it's just fundamental
you'll learn so much making the first
model that you'll redo the whole plan
i don't think so i think the plan is
pretty straightforward
like it's like build one big risk core
that can superscale our these operations
um programming multi-core sucks when
your code has side effects
well okay so you have multi-core okay
now tell me what you uh
let's go through why multi-core sucks
right so
you have multi-core now you're talking
10 cores
or you're talking a thousand course
right because the
the very different 10 cores
it comes down to how coherent your cash
is right for 10 cores you can have a
coherent cache where they all
effectively share a cache
and they have a unified memory model
between them and then this works
right but if you have a thousand cores
well what does your unified memory model
look like do you have a cache for each
core
and then if you have a cache for each
core well what kind of things are these
cores practically doing
um please check your
oh you submitted a pr to to twitch
core
uh what we got
oh value plus args cool
i was looking for how to do that
all right cool and like this compiles
how how do i try to read me
test macros
uh well so what's building all these
assembly things is there a make file
like like how do i ideally okay here's
what i would there's a make file
here's what i would really like add uh
github actions
add github action so this runs in the
cloud
um but yeah looking good do we pass all
the tests
well i'll merge it
okay firmware is make
cool
uh
wait so where did the files go that i
made
where's all the files
oh i have to do make add hex oh no i
don't have that
i only have this one
i'm not sure how to get that one
um
risk yeah yeah this this
[Music]
no
i don't know i don't know how to get
good good but yeah if you could add
um some ci to this it would be great
no no i don't want to throw 64 bit i
don't understand why i thought that my
64-bit risk
could build a 32-bit but maybe not and
maybe i have to fix that
but yeah anyway i gotta go only five
[Music]
minutes
i was actually looking for these tests
this is so much nicer than like i didn't
actually
find where they were i just like how
come
how come i can build them if i go into
risk five tests and i type make
like this works what's it running
so it's running 64. wait is it actually
just building them for 64. no no here it
works
here you can use the 64-bit one if you
just pass this stuff in
you can do ci but you have to change
from verilog to system verilog oh does
that stuff not work
um
i think system verilog's okay as long as
we can use the same simulator
um and yeah just switch switch the
makefile to 64s if you have them
um no it works but it has some nice
features i don't know yeah if it just
works out i don't mind
especially if you're only changing is
the test bench i mean if you just change
testbench.v to system verilog that
should be
and like it still works with iverilog i
don't care
um cool but yeah if you guys want to
contribute to the tiny grad repo too
hopefully you know
we've got okay we got the tiny grad side
of things we got the twitch course side
of things
oh fuck yeah twitch core man twitch core
is going to be an asic
one day every every line of verilog
that you write dreams of growing up and
becoming an asic
you know what i'm saying
well yeah and then we're gonna have to
start to add all right verification is
probably a good thing to stand up and
then
we have to add vector instructions then
we have to add pipelining
probably the first thing to do is get
something running slow without any
pipelining
um
can you make a real logo for cherry yeah
you can make a real logo for cherry
let's figure out is this one
can we find a creative commons logo that
like looks kind of like that
if you want to make a real logo for
cherry it's kind of a joke webpage
[Music]
cool thank you for watching the stream
cherry computer is real uh
don't start a company
ah just use unicode cherry oh wow wow
let's try that unicode cherry
oh damn unicode can't be copyrighted
that's illegal
okay wait wait we're gonna try something
that's never been tried in the history
of html
how
now we have to close all the bigs
oh nice
you know the pig the big dad's my
favorite html tag
how cool is that rendered
wow if you look at it on mobile it has a
different logo
thanks everyone for watching have a good
night
dexterr145: hey
swimming_dragon: oh shit
cacaosteve: hi
ravroid: Good evening sir
tboah: helloooooo
0xTomOstSec: long time no seen
userismale: Yoo
ouroboredos: No sub modep lox
kristofferhelle: welcome back
m3ntors: Hey geooo hello man
endritpb: hi
leikowo: ey it’s the tiny guy
goudacheeseburgers: o7
dahorak: Oh shit
cuddlingusrl: non arc raiders stream
dantedante33: ai hotz or real one?
vox_bony: MAGA baby GoatEmotey GoatEmotey GoatEmotey elbunk4BEAST2 elbunk4BEAST2
tboah: it’s been a minute
Maoriratto: wellcom back
lemmywemmy: sup og
gallium_ow: is mic a bit low for anyone else?
dexterr145: @gallium_ow yeah
einqs: Quiet
swimming_dragon: how is HK
evilfjalar: wazzza
sambusa_123: yeah, very quiet
zee133: thank you, I was able to retire because of my long amd position
jmickelly9: Smart move
ChandyNoEgo: happy halloween, george!!!!
cjcostanzo: not watching the world series?
0xTomOstSec: nice 2 see you Georgeyyy
ravroid: Sports ball?
voynich_1209: Hello, any reason why u moved to HK?
Tony_Roubino: Hong kongers were moving to london few years ago lmaooo
nuttyodin1: nuttyodin1 subscribed at Tier 1. They've subscribed for 31 months!
nuttyodin1: Nice to se you after a long time
NatelBeats: NatelBeats subscribed at Tier 1. They've subscribed for 65 months, currently on a 42 month streak! Internet really used to be so much better
sambusa_123: sambusa_123 subscribed at Tier 1.
sambusa_123: i now have a voice!
nuttyodin1: ExtropicAI says they are the ones to bankrupt Nvidia
leikowo: any async mma on these ?
leikowo: how much does the vendor blas get ?
leikowo: I meant something like tcgen05.mma
Fleetwood2048: f32?
Fleetwood2048: f32 out ah right
Fleetwood2048: everyone
sambusa_123: not me!
leikowo: 1 thread per float acc!
leikowo: lmao
leikowo: cast acc!
leikowo: is ref same type ?
leikowo: what's bufferize ?
Fleetwood2048: looking more like TVM every day SeemsGood
leikowo: what's .after() ?
Fleetwood2048: can't stump mr chen
johnathanschmidt: johnathanschmidt subscribed with Prime. They've subscribed for 8 months!
leikowo: yeah but that's because they got cute
leikowo: yes
leikowo: cute::print_latex
leikowo: cute algebra is pretty cool ngl
leikowo: from ISA would be easier to follow
leikowo: from the pdf you reference
nickhitman21: nickhitman21 subscribed at Tier 1.
nickhitman21: привет, как дела?
leikowo: I asked at the beginning about the ref dtype x)
nickhitman21: good day, sir. can you explain to me as for a 5 year old kid what is happening?  NotLikeThis
nickhitman21: claude code vibecoding
leikowo: do the inputs partition and acc partition match the formula under 7.1.4.1 and 7.1.4.2 ?
leikowo: your C tensor is empty, wouldn't we get numbers even without running the custom kernel ?
leikowo: (we also got global variables named M,N,K)
leikowo: B is 1
leikowo: pain(a, b, c) is hilariously accurate
leikowo: I don't know how you got that right tbh
leikowo: there was two values something iirc
RickAndMoreTea: geez rick am i too late to halloween party here
RickAndMoreTea: lets goo
leikowo: insane that there are no mentions of async in CDNA4 ISA
leikowo: really makes you want to divide A layout by (16,32)
gclawes: Man I wish I knew how to program GPUs even a little bit, this looks cool
leikowo: yeah it's pretty sick
leikowo: that's the shortest kernel calling a TC by hand I've seen
stevethesniperr: i have no idea what the hell is happening here im just hoping to learn via osmosis
leikowo: @stevethesniperr You have two matrices A and B, you multiply them: this operation is called a GEMM.  GEMMs can be efficiently computed on GPUs, nowadays GPUs include custom cores for accelerating GEMMs.  mr hotz is writing a clean gpu function doing this
somewatson: somewatson subscribed at Tier 1.
somewatson: puddot1Hi puddot1Hi
somewatson: do you have physical access to the MI350X or is this a cloud-based instance?
leikowo: @somewatson pretty sure it's one of the servers they got from AMD
leikowo: (physically)
somewatson: oh i see, nice
somewatson: happy halloween btw
somewatson: by the way, I’m subbing because I really want better driver support for AMD GPUs, so hope this sub helps
leikowo: UOp.group victorizes stores ?
leikowo: It would take me a lot more lmao
leikowo: so now we do larger blocks ? like 2x2 TC blocks ?
somewatson: is there a huge difference between the mi300A and mi350x driver wise? I’m hoping any changes you make also help me out downstream since I’m running the mi300a
leikowo: is this calling the builtin ??
leikowo: B200 is a pain because it's all async
leikowo: yeye it's like an intrinsic
leikowo: B200 you have to do a persistent kernel, use tcgen05 (so new tmem which is annoying) and TMA for async loads & maybe async stores if needed too
fart_factory: OMG GEORGE IS BACK
leikowo: ah and I forgot thread block clusters and TMA multicast
somewatson: very nice, glad to hear about the contract. impressed that you were able to get them to focus on it
leikowo: fuck it, use MxK and NxK inputs
jmickelly9: What a trade you did back then with AMD stock. Also great work with the contract with AMD.
leikowo: 2200Mhz
leikowo: pretty cool that if you do the flops/clk on the different TC instrunctions the 32x32x16 is the same as 16x16x32
somewatson: would you say it worth trying to set up on my mi300’s and begin to write up docs or are things still in motion?
leikowo: maybe easier to hit flops with cause you just need to dispatch less TC instructions and can use the other threads for data movement ?
leikowo: K is 32
leikowo: banger reshape
leikowo: er warp
leikowo: per block sorry
leikowo: AddrSpace.LOCAL is smem ?
leikowo: can we do vector load from gem ?
leikowo: dtype.vector from gmem*
leikowo: can we slice ?
leikowo: A[gx, :, gy, :]
leikowo: x)
leikowo: CuTe DSL uses slicing for this
leikowo: did you ever look into CuTe ? like divides, local_tile, partitions
leikowo: I am sold
leikowo: watch the MMA_traits<MMA_OP> file, they describe EVERY TC layouts using cute layouts
leikowo: these really look like tensors tbh x)
leikowo: thr_copy.slice(A[gx, :, gy, :]).to("reg")
leikowo: should be like (num_mma_m, num_mma_n, 4)
leikowo: what's the register max per thread on amd ?
nuttyodin1: great day to hangout with you code
leikowo: all loops and K
leikowo: can you statically check that it's equivalent to matmul by unrolling all UOps and comparing with normal matmul ?
leikowo: this is a lot lot of registers but I'm not familiar with AMD. I know nvidia wouldn't let you
leikowo: registers spilling ?
leikowo: larger BLOCK_K maybe
leikowo: unroll arg for UOp.range ?
leikowo: no more instruction cache x)
leikowo: no vector stores ? :c
leikowo: rdna renderer ?
leikowo: (BLOCK_M//TC_M, BLOCK_N//TC_N, 4) ?
leikowo: 64,64,128
leikowo: simple loads not vectorized no ?
leikowo: reading through the rdna4 doc, apparently you can load blocks of memory from gmem to rmem
leikowo: also DS_READ_B128
dp_smh: dp_smh subscribed at Tier 1.
leikowo: ohhh tensor cores got dedicated registers on amd
ibarres: Kappa
leikowo: would be nice to copy from smem to them
leikowo: what's these 16bit global loads
leikowo: can we cast to half8 before loading ?
leikowo: lots of flops for a single warp
leikowo: this asm looks very good
leikowo: we could try multiple warps per blocks
leikowo: I think the smem -> rmem load layout doesn't matter much
leikowo: are we even getting the BW from global men ?
leikowo: mem*
Cos_ighn: howdy
leikowo: wait wat
leikowo: who's lidx0
leikowo: has to be first dim I think
Cos_ighn: Cos_ighn subscribed with Prime. They've subscribed for 5 months!
leikowo: are you not making 64 warps of 4 threads ??
leikowo: no there shouldn't be any acc x)
leikowo: bank conflicts aren't **this** bad I think
ibarres: thats water bro
Santiago_LHC: Very nice tea setup
leikowo: please show the generated code again
leikowo: we don't see the screen lmao
Santiago_LHC: your cam stayed too big
Santiago_LHC: power tea
leikowo: divide BLOCK_M//4//TC_M
leikowo: nah it was for the acc, you did it already now
leikowo: AMD employees seeing you get 16TF out of a 2PF card
leikowo: (I got 22TF on a B200 like two weeks into my internship)
leikowo: cause K is good
leikowo: doesn't grow accumulator
leikowo: wait As stores
leikowo: shouldn't they also be loaded using multiple warps ?!
leikowo: probably not the issue though :(
leikowo: BLOCKM//4*BLOCK_N*BLOCK_K
leikowo: there is no way this is faster
leikowo: It should spill
leikowo: BLOCK_K should be involved
leikowo: yes, I just think we are memory bound and waiting for memory copies instead of pipelining them
leikowo: gmem
leikowo: can we diff fake and non fake kernel ?
leikowo: sorry, warp group 1 and warp group 4 not fake
leikowo: nonono
leikowo: I meant wg1 and wg4
leikowo: it's 6am sorry!
leikowo: just generated code
leikowo: like some loops should go away
leikowo: probably because we just duplicated the loaded data from gmem
ronmasas: How about brute forcing the best block_* combo?
codingfisch: The lonely knight against entropy still at work 🙌 You are not alone!
leikowo: was very cool to interact, it's 6:13am and I'm struggling to keep my eyes opened. good night! (I'll still listen but likely fall asleep)
leikowo: for the gmem loads: for A split M by WG and threads access 8 successive halfs each for B split N by WG and same 8 halfs for each thread
jmickelly9: What’s the bandwidth speed on the USB4 - Nvidia GPU
dp_smh: NVDA reaching out before Apple responds 😒
leikowo: you want a B200 server, a single B200 is a paperweight xd
somewatson: whatttt why no meetings?
somewatson: LUL
somewatson: are you passing out Halloween candy today? it’s super dark out here so I’m guessing you’re not in California right now
codingfisch: They will. You are so cheap!
sunnergunner: nope :)
pupscub: yay I am free
leikowo: GB200 superchip would be nice, there is no software for it (the C2C)
somewatson: HK is fun. I highly recommend Saizeriya. it’s a Japanese chain restaurant that does Italian food
somewatson: ngl but the best Italian food in the world is in Japan
somewatson: oh the spark sounds pretty fun to play with
iashyam: Good to catch you live here george. I watch your stream during coding at job. Thank you so much for inspiring me.
somewatson: yes I always go every time I visit
codingfisch: Can you reiterate? I just joined but used quite a lot PTX in the last weeks
somewatson: LUL it’s better than sbarro for sure
leikowo: fix: get an nvidia gpu
somewatson: although we all know the best NYC pizza is sbarros
leikowo: did you see how the gb200 works ?
leikowo: gpu memory is another numa node and can be used by system
leikowo: (and gpu can access system memory)
codingfisch: How much more value does your programming provide compared to an average tinycorp employee?
leikowo: ds read ?
dp_smh: why have the load_loop blocks below the compute?
lostendasauce: use ai
tbullshit: when you say we're going to assembly do you mean tinygrad generating the assembly
ardorendk: George, how are you handling quantization and scaling into MXFP6 from FP16? per-tensor, per-channel, or dynamic?
Bfgrocks: is that party ticket on the wall xD
480i: @somewatson i learned that from the office
noseynice: What is the best dish you got in hong kong so far?
GIGA10101: anyone know the expected timeframe for the 1.0 release?
somewatson: or how about using duckduckgo's AI chat?
somewatson: @480i LUL
datdoc: ill ssh to your server and finish the code
therollerblader: what is bro coding
tbullshit: ai girlfriends, just really early stage
therollerblader: wow
therollerblader: not even using ai coding for ai project wow
dp_smh: it seemed the same to me
LilTankster33: I’ve been studying your Tinygrad commits. I’m new to kernel level ML work, but I’m trying to understand how memory tiling affects perf. Respect for showing the process raw like this.
standardpointer: o/
standardpointer: woohoo, 235
ardorendk: nice
maland3r: !f
utkarshgill: what is coalescing
ardorendk: faster by +0
lostendasauce: id try grok too
noseynice: Anything outside of what the median person talks about is very scarce in any LLM datset so less probable results?
GENUlNlTY: LuvPeekR
dawkinsisdoper: how are you doing all this with out a cursor chat? using actual brain?
Parasocializing: AI brainrot
tbullshit: twitter pilled
Aesthetic_Champ: screen frozen?
Parasocializing: @Aesthetic_Champ yeah
tbullshit: mr streamer your screen is fucked
whiterunknight: good morning
quagmire_8: is rangeify in complete working mode yet
UltraScientism: @noseynice What do you mean? They definitely ingest lots of academic sources, including obscure ones.
dawkinsisdoper: @tbullshit just transparent font
pika2u: yo <3
tbullshit: mr streamer it's frozen
UltraScientism: yes, it's frozen
utkarshgill: screen stuck
azertysdfghjk: @georgehotz we can't see what you type, check your obs settings please
tbullshit: im about to post a ascii of the austrian painter
tbullshit: nvm crisis averted
uranus4head: do u think terry davis was good programmer
want7000: want7000 subscribed with Prime.
want7000: Thoughts on humanity's progress with large language models writing software?
lostendasauce: computers have no insight
UltraScientism: @lostendasauce for a year or two
TigreDozer: AI is more coherent in the answers than 50% of human population...
jmickelly9: There was a twitter space where the sort of software that LLMs clearly struggle with understanding are browsers, compilers and device drivers.
lostendasauce: unless there is a breakthrough in neroscience where thoughts can be translated to electrical signals. still would have to figure out where the eureka moment comes from
Daniel_Ehrhardt: will there be a comma 4 soon?
Daniel_Ehrhardt: 🙈👌
utkarshgill: how to understand rangeify ? I was getting used to older abstractions and shapetracker, now VIZ=1 sometimes feels harder to grasp
UltraScientism: How fast are you currently on this chip compared to pytorch + amd's standard driver stack?
AK_ttv_: Sup
ardorendk: reducing complexity usually improves speed as well
rvx_4: hmm
Hoosier_Cruiser: what up G
dp_smh: a wise man told me this week if you want speed you need a profiler
AK_ttv_: Sorry if this is off topic: I want to create an AI thats connected to the entire Android system, the AI should be intelligent to basically do everything you need and make personalized user predictions by usage...
AK_ttv_: Just an idea.
ardorendk: george will enable sub only mode ^
AK_ttv_: Ok.
hlidskjalf77708: FeelsStrongMan
verxile: looking forward to comma con :D
AK_ttv_: My other idea is to basically make a robot that can replace or be like a doordash... lolol
AK_ttv_: Anyways geohot
jetSETcodecat: Looking forward to Comma Con as well and also looking forward to you developing those Unitree or Boston Dynamics robots. So I can fight it, of course :)
want7000: Will read that now, but as I thought; it creates awful non-functioning code at random and all encounters with ai are unwanted and waste time. have yet to find a counter-example.
titondev: Hi SUBtember
480i: i feel like google these days is rough
whiterunknight: did you finish reading gravitys rainbow
480i: @whiterunknight pynchon!
Bfgrocks: Have you seen Grokipedia
AK_ttv_: lolol
espacevecto: chat, is he using a mac or linux with apple theme ?
UltraScientism: well there are non-llm AIs that for example solve (mechanically prove ) new math Olympiad problems at a good level. That's more impressive to me than the improvements in search that llms brought.
lotr_may: No subchat? PogChamp Hiii
AK_ttv_: So geohot
AK_ttv_: Wsg
7vevex: @UltraScientism Steven Wolfram was talking about that on stream yesterday
jetSETcodecat: jetSETcodecat subscribed at Tier 1.
jetSETcodecat: Yay <3
whiterunknight: goodbye plebs
jetSETcodecat: Now I have free room to talk in depth about how I'm gonna curb stomp a clanker , that is, after I make it fold my clothes and be generally less-than-human enough to do my tasks rote and routine tasks - Slower !!!
jetSETcodecat: I'm sorry, I'll take it back. After 10 years time and I see one capable enough to FIGHT me
jetSETcodecat: Apologies if I'm adamant about fighting robots - It's what gets me up in the morning to be frank.  Maybe I'll learn tinygrad & manage to team up with Unitree to UFC fighting robots
jetSETcodecat: Nah you're good, on a personal level
jetSETcodecat: Haha, sorry, I'll learn tinygrad then
whiterunknight: worlds first ai twitch viewer
whiterunknight: bro used an em dash
whiterunknight: will it even run on a fold 7
want7000: they don't care about normal people, enthusiastically marketing bullshit to other rich people makes stock go up, i think
jmickelly9: AWS and Anthropic had an outage recently and just saw many ‘engineers’ could not do any work for the whole day without using Claude. That is beyond horrifying to see that ‘engineers’ lost the ability to code without AI these days.
whiterunknight: God damm ssh
jetSETcodecat: Huzzah
jetSETcodecat: Oh babyt
whiterunknight: hell yeah
jetSETcodecat: My lord "It just works" wasn't an exaggeration or even false brother spittin' facts LETS GOOO
dp_smh: yeah own that poser
whiterunknight: thank you for the demo
MinistryOfWarHacker: @georgehotz What should I eat today for breakfast?
BRODZELi: thank you for sharing
warmrow: how much do u use ai code editors daily
AugusDogus: when do you expect to see more tinygrad adoption?
GrandeurMusic: Great Work!
FatherOfFamilyValues: @georgehotz Will you grace us again with more creative writing in your blog?
espacevecto: Congrats
born2zen: hhahaha
Tsoding: I saw that guy. He's the pathetic loser :)
pika2u: Ty George for all you do big heart big heart <3
AugusDogus: what matters?
born2zen: <3
AugusDogus: word
whiterunknight: <3
jetSETcodecat: <3
GrandeurMusic: Write in Assembly, and it becomes beautiful!
jmickelly9: The USB4 to NVIDIA GPU on a Macbook with tinygrad driving it is amazing. Can’t wait for it.
utkarshgill: I implemented sub 500 line beautiful_lander in torch. gets a 200+ score in lunar lander < 250 episodes, reliably. when I directly port it to tinygrad, it gets stuck at 10-12% and its super slow.   if I work on it and submit a PR to tinygrad/examples/beautiful_lander.py, would it be useful?
jetSETcodecat: wdym today like today today you're joking thats fucking amazing
MIGGOXYZ: I aspire to be as cracked as you are one day
mokert2: Hi George, I have a conjecture that has been bouncing in my head for a while, do you think fundamentally model size is just bits? Like if you made the best possible 8GB param model in FP8 and say, an FP64 model with the same memory footprint, would they be equivalent? You may need a different net arch, activation etc, but are bits ultimately just bits regardless?
GrandeurMusic: Does it work for linux the same way (tinygrad) to NVDIA GPU
AugusDogus: What's the timeline look like for being faster than PyTorch?
GrandeurMusic: Great Stream! Thanks for the stream!
deepvision: I hate clean and fast code I get payed by the hour Kappa
parapuschel: hi geo hi chat
utkarshgill: I don't have a 4090
pika2u: I liked your recent blog posts!
Mach_34: Tea or coffee>
dp_smh: what did you think of WNY in your short time at RIT
Mach_34: Love chinese tea culture. I've been buying lots of puer
inbredcuckfromusa: is it this vod available on yt after yyour stream?
tolpa_zevak: Did George say anything about Durov’s and the Lieberman brothers’ projects on decentralized model training?
tohrxyz: tohrxyz subscribed at Tier 1. They've subscribed for 6 months, currently on a 6 month streak! Hey and good day!
jetSETcodecat: @inbredcuckfromusa geohotarchive on YT or type george hotz archive anywhere
jetSETcodecat: Thanks for the stream. See you next stream <3
MinistryOfWarHacker: from MONAD
ibarres: when simple in order VLIW isa gen
JVPost: are you saying, the truth will set you free?
kinglouisxvii: Based
tohrxyz: write that into them books
pika2u: Have you ever read Silver Surfer: Requiem? I have recently and really recommend it
MinistryOfWarHacker: truth is love
ivyharvey: Octopus card is the truth
ardorendk: did u just said slavery is good? Kappa
Y3absira: hello george
UltraScientism: what's so good about hong kong?
Y3absira: 2 2's to my word fam
hulkemist: thanks for stream
AugusDogus: cheers
tohrxyz: happy halloweeen guys
PFASpartout: Joy comes from making sense out of this mess
ardorendk: don't kill anyone
whiterunknight: :(
tohrxyz: dont be too scary on kids
GrandeurMusic: you are in Japan?
WEBVTT
Kind: captions
Language: en
kod1cs: hi n
ekalsuwaidi: hello :)
twitchcansuckmydeek: Do you know about psychology
kod1cs: teach me C language
aymanpoquito: yo
kod1cs: i pay you 10cents for week
jax05_: what's up everyone
leopp: yo
logi6000: what up diggity dog
small_beautiful_asian: hey
oMythra: georgy boi
twitchcansuckmydeek: I went on a girl's stream and I wanted to ask something random. Something related to science. And I asked
adibaby04: weord george
unluckychickenn: PogChamp
twitchcansuckmydeek: Do you know what a rectifier is
tiagodopke: good evening broo
zol0: holy shit he's live PogChamp
logi6000: George the man
twitchcansuckmydeek: do you think my unconscious did that
logi6000: the myth
aymanpoquito: were back boiz
alreye: nice ass btw
adibaby04: good evening
ImJ4Gu4R: Dem boiyzz, Im not finish yet watching yesterday video lol
logi6000: the legend
twitchcansuckmydeek: read the whole story dude
zoprano21: @georgehotz do you run kali linux?
logi6000: what up diggity dog
alxhotel: what is carla ?
santtiagoo: We back boooyyzzzzzz 🙉
MrMcaustin1: Hows it going george
twitchcansuckmydeek: I hate python
logi6000: Carla is a self driving car sim
santtiagoo: My exs name used to be carlas
alxhotel: ah nice
adibaby04: yo man would you review my github
twitchcansuckmydeek: anus
aymanpoquito: @twitchcansuckmydeek why
logi6000: what's the ban topic today
MrMcaustin1: Same as normal logi6000
twitchcansuckmydeek: because I don't like snakes and pythons became too widespread
zoprano21: I CANT C
twitchcansuckmydeek: I like C
logi6000: cool
logi6000: wait so no comma ai on a openpilot stream
mrmusicmaine: Sweeeeet I was allowed into the stream (: sometimes I can’t bc I’m not a subscriber. I will subscribe once I get some steady income
hofergabriel: nietzche!
LaheyFPS: LaheyFPS subscribed with Twitch Prime. They've subscribed for 2 months!
logi6000: I don't got a job so I can't sub.
Orionmyth: slm aşkım &lt;3
GamerulSadic: Did you really put this guy to subscribe and that face tho 🤣🤣
prakyath_kantharaju: Fuck me you made it!!!
MrMcaustin1: Thanks LaheyFPS for the sub!
twitchcansuckmydeek: I saw you on youtube doing pentest thought you were about infosec but I guess it's more of self driving cars and stuff
THATTACHYON: THATTACHYON subscribed with Twitch Prime. They've subscribed for 2 months!
crispyvideo: Is this mapping data from google maps api?
MrMcaustin1: thanks THATTACHYON
FresherLemons: man it's a good night for chewing ice
logi6000: @twitchcansuckmydeek you must be new around here
twitchcansuckmydeek: yes i am
ne3cross: @georgehotz do you use Tensorflow?
foogs_: im chewing ice right now. it feels good. helps me concentrate.
hofergabriel: what's your project euler friend key?
zol0: wait if everyone shits on python for being slow why is it used for self d/riving car software, for the ML libraries
zol0: ?
adibaby04: im
adibaby04: adibaby04 subscribed with Twitch Prime.
erichtp: @bocewnoce dont say that D:
logi6000: he is cool he makes self driving cars with commai. was first to jailbreak iPhone. and got sued by Sony. @twitchcansuckmydeek
crispyvideo: Keyboard? It’s some sort of a mechanical lol
twitchcansuckmydeek: oh lol
logi6000: he uses hhkb pro 2
eaglesemanation: there is some pasta sauce on your keyboard
adibaby04: im subbed now
LaheyFPS: LUL
gusfrehse: ruby is much better
earthbender: LUL
adibaby04: https://github.com/adiprerepa
crispyvideo: Annoying loud sound haha
fusight: Thanks @adibaby04
MrMcaustin1: crispyvideo watch out
oMythra: they're back with the K word smh
crispyvideo: I can’t take loud clicks and crap. Very annoying
logi6000: cinnamon rolls are the best dinner
brbdontdie: haha he is going to eat a coffee maker and cina rolls
mumubecks: gusfrehse I like ruby too
Noomers: its 3 am here
thundershots999: breakfast for dinner is anarchy!
logi6000: is there any tea this stream? @georgehotz
crispyvideo: You take the map data from google api? I noticed Tesla does not
erichtp: did you ever finish the mac compatibility &gt;
mutrx: rate our github profiles
prakyath_kantharaju: https://carla.readthedocs.io/en/stable/carla_server/ check this out for communication it is very interesting!!
twitchcansuckmydeek: self driving cars sound really boring tbh
logi6000: don't rate mine it's a mess
adibaby04: @georgehotz can i haf review
adibaby04: wait yeah rate contest
brbdontdie: lol if you think self driving cars are boring then what do you find interesting @twitchcansuckmydeek
GamerulSadic: im really courius how long ( and if ) comma ai could overtake other self driving cars .
prakyath_kantharaju: @twitchcansuckmydeek are you serious!!! Self driving cars are cool AF.
MrMcaustin1: George already said no GitHub reviews kiddos
crispyvideo: Once you go self drive. And electric. You can’t go back
xx_owlcapwn_xx: @twitchcansuckmydeek what is the point of self driving cars LUL
logi6000: Is George verified yet on Instagram
crispyvideo: I did 320 miles today and don’t even feel jt
santtiagoo: nop not verified yet
logi6000: that's fucked
ajtourville: Is CARLA like Tesla DOJO?
brbdontdie: were you asleep @crispyvideo
prakyath_kantharaju: Why not ros?
crispyvideo: Nah why would I be asleep lol
foogs_: lmaO
twitchcansuckmydeek: What do I find interestin? I will tell you what. I saw a dutch chick yesterday. Doing an art installation. She directed twitch messages into an arduino which drove the electrodes she sticked on her various parts. Hacking that in real time would be interesting.
abk467: saved
krouzux: krouzux subscribed at Tier 1.
thundershots999: i'm up to 3 bags a day
foogs_: im chewing ice right now
logi6000: @thundershots999 hahaha
MrMcaustin1: inb4 ice chewing becomes a banned topics
abk467: abk467 subscribed with Twitch Prime. They've subscribed for 4 months!
FresherLemons: Sonic ice is the best for chewing
FresherLemons: FresherLemons subscribed with Twitch Prime.
brbdontdie: define various parts
xxxdeja: No chewing ice gang
ajtourville: Thanks for the HahaHide @krouzux
Doyniish: Doyniish subscribed with Twitch Prime. They've subscribed for 2 months! you are so mint
prakyath_kantharaju: is open pilot communication similar to ros master,node communication ?
MrMcaustin1: The amount of subs today is crazy
adibaby04: Thanks for the HahaSleep @doyniish
champ900: @georgehotz what's your goal in life
twitchcansuckmydeek: arms mainly
logi6000: George can you recommend me any shows. Mr robot is about to end so I need a new show
mrmusicmaine: so I’m not sure what the title is implying. When you say “Open pilot for everyone” are you talking about car compatibility?
foogs_: geo hotz yes! is what they're actually chanting
thundershots999: no maroon 5 tonight?
Tsoding: tsodinKomrade gde nas net
MrMcaustin1: Partner open pilot with nueralink so the computer can drive our bodies
thundershots999: lmao
mrmusicmaine: @champ900 he wants to live in the future. Get rid of jobs bb. AGI.
ne3cross: How simple/difficult is it to add unsupported models?
adibaby04: this shit trash tho
robby0313: Thanks for the HahaDoge @doyniish
CianKy: Super random, but is anyone here particularly proficient with Prolog?
twitchcansuckmydeek: I have never thought I could get that excited about hacking until I saw a hot dutch chick with electrodes on her body connected to the twitch chat through a lousy arduino
twitchcansuckmydeek: live
krouzux: uh
xxxdeja: D:
xx_owlcapwn_xx: wtf @twitchcansuckmydeek
twitchcansuckmydeek: and she was in an art gallery exhibiting
oMythra: Prolog sucks part of my final tomorrow has it lol
CaptCalifornia: wtf is this psycho listening to
twitchcansuckmydeek: If only I had the skills...
Knarez: what is your tmux or screen philosophy here
brbdontdie: It sounds like you are interested in art then
ne3cross: @georgehotz multithreaded of multiprocessing?
thundershots999: Have you tried open pilot in the snow?
adibaby04: USE gRPC NOT THIS INTERNAL CRAP
ne3cross: Or*
robby0313: What are some good books I should buy?
Tsoding: @georgehotz, the one with a better quality https://www.youtube.com/watch?v=CFKhLYqUA0Q
CianKy: @oMythra it absolutely does, I have an assignment due in the morning which I have totally neglected haha
lua_320: @brbdontdie ones that you can read
adibaby04: kafka
Tsoding: kafka LUL
twitchcansuckmydeek: I like java
Jeppelelle: redit
gseven_: nats
adibaby04: still grpc
xx_owlcapwn_xx: java WutFace
THATTACHYON: Its written in scala I think
logi6000: Java can go suck a deek
adibaby04: you can
twitchcansuckmydeek: I don't like not having direct access to the memory but I like java
gseven_: nats.io @georgehotz
THATTACHYON: Rabbit MQ ?
adibaby04: nsq?
logi6000: python master race
CaptCalifornia: LMAO
ne3cross: Qt
gseven_: its really good and simple
adibaby04: when have you used gRPC?
Singha360: yo yo
tsAllySparkles: got a comma dev kit for christmas ;)
gseven_: yeah a client @georgehotz
ne3cross: Rabbit?
Singha360: @georgehotz what's your opinion on Flutter and Dart as a programming language?
gseven_: there is a nats.py @georgehotz
CianKy: @georgehotz have you used Prolog before?
Jeppelelle: Implement pub sub on your key/val db you built in another stream?
adibaby04: nsq?
logi6000: George did you get inspired by sentdex
logi6000: for carls
logi6000: carla
tkrsh009: hows it going bros
yeah_haey: So you arent playing ctfs anymore ☹️
gseven_: really high @georgehotz
fishsource: hey everyone what's the project for today?
adibaby04: https://nsq.io/ exists
Doyniish: lmao
1monkjuice: "EON DevKit Make driving chill"
gseven_: better docs though
CaptCalifornia: Nats is General Availability as a service
CaliburOne: hey ladies... im generally available KappaHD
THATTACHYON: RabbitMQ !!
fishsource: what looking for? video streaming library?
mrmusicmaine: Lmfaooo fuuuuq NATS
adibaby04: its all tcp lol
mumubecks: Why there are so many messaging libraries. Where are they used?
logi6000: so what exactly does cereal do
adibaby04: why not gRPC tho whats its problem?
krouzux: gRPC is a nightmare to use
0Day_H4X0rz: Guten Morgen/Good Morning von/from Deutschland/German prelyerLove pimpli2PimpEY prelyerKiss HahaCat
death_gadget: Somebody drank the gRPC kool-aid
adibaby04: thats fair
adibaby04: ima write some documentation then
krouzux: you know I think Twitch even made their own RPC thing using protobuf because they got annoyed with gRPC lmao
logi6000: so what do the messages do in these programs. what is the point
adibaby04: messages are whats sent my dude
adibaby04: from a struct to over-the-wire
logi6000: I know what's the point
logi6000: what's the use
adibaby04: what else would you do?
adibaby04: its the best way to send/recv info
gseven_: who doesn't use docker lol
gordopeIotudo: what terminal interface do you use on windows?
logi6000: send over different computers
adibaby04: @logi6000 can you explain what ur saying
adibaby04: i mean wanna use pure rest and some spring boot shit?
Crowz4K: @georgehotz hi
logi6000: so what is the whole point of something like cerial
mumubecks: I dont get it neither. Whats the use
adibaby04: its lightweight sending and recieving pub sub bro
Crowz4K: @georgehotz how log will you stream?
adibaby04: its super useful
adibaby04: pub sub at least
adibaby04: @georgehotz you answer
logi6000: define pub sub
adibaby04: the q
1monkjuice: publisher subscriber
adibaby04: its basically publishing messages to a topic
logi6000: ohhhh thanks I get it now
Knarez: did this guy learn to type yesterday
Knarez: Kappa
adibaby04: which there are other computers subscribes to that topic
Th3G4mingbros: Th3G4mingbros subscribed with Twitch Prime.
adibaby04: so they get that message
cogforkd: OMG ... Hi George
logi6000: I get it. I FINALLY UNDERSTAND SOMETHING!!!!!
adibaby04: ive never heard of cereal but im gna try it out i guess
adibaby04: @georgehotz whats the performance like?
thundershots999: Where are the cinnamon rolls?
logi6000: yeah where the rolls at
tsAllySparkles: why do you use vim?
logi6000: vim is superior
adibaby04: how though??
gseven_: does it guarantee delivery ?
adibaby04: no shit
adibaby04: thats what tcp is
Joogurt: i don't get what most of the stuff you do, but i still love watching you
logi6000: once you get used to key shortcuts it is far better and more efficient
gseven_: does it guarantee delivery ? @georgehotz
brbdontdie: yeah, i found that although vim has a lot of cool features, i actually still work faster with other text editors.
brbdontdie: maybe I am not using enough shortcuts
logi6000: you just need to get used to HJKL and a lot gets easier from there
1monkjuice: brbdontdie, can you use those other text editors when working on a server?
logi6000: unless he uses nano
adibaby04: for performance why dont you use nanopb? https://github.com/nanopb/nanopb
logi6000: @georgehotz look at post above me
brbdontdie: ah no. all my programming experience has been for school projects. I haven't actually worked on any industry projects yet.
mumubecks: Do self driving cars have crontab?
adibaby04: @brbdontdie its hella easy to get into industry if ur in school btw. im 15 and have had an internship at a tech company and its lit.
leander_ms: George be my daddy
logi6000: @adibaby04 you can get an internship at 15? I'm 13 so I don't knwo
c19946: use vscode for markdown
MrMcaustin1: @georgehotz https://github.github.com/gfm/
brbdontdie: Haha, I got my first real internship at 21
adibaby04: @logi6000 it was at life360, they were small enough to take me but still pretty big
brbdontdie: kudos to you dude
logi6000: oh.
adibaby04: just do side projects
MrMcaustin1: @georgehotz just add python after the first ''' to get syntax highlighting for MD
logi6000: that's still amazing what country
brbdontdie: I am about to begin work full time for a pretty large tech company
adibaby04: the coding interview is actually easy
adibaby04: united states
brbdontdie: fairly soon
logi6000: ok
krouzux: i think working on personal projects is better way to start off than working in the industry
adibaby04: damn @brbdontdie nice
krouzux: the industry is a scam
knilecrack: wsup
adibaby04: yea fs but to get into industry you need personal projects
brbdontdie: nothing based in silicon valley though
c19946: wrap your code in ```python CODE ```
logi6000: life360 is what my parents used to use
knilecrack: still trying to get openai to work for mac?
adibaby04: yea its in SF
logi6000: yea where I'm at there not many tech companies
adibaby04: where are you at?
logi6000: is but in a spot where there aren't many
logi6000: not is us
adibaby04: state?
logi6000: east coast. I'll give you that
adibaby04: o damn gotchu
logi6000: I'm guessing you in SF
adibaby04: bay area
logi6000: oh
adibaby04: i went to SF every day tho over the summer
thundershots999: anyone else getting buffering?
tsAllySparkles: fix the strings on your hoodie plz
krouzux: lmao
logi6000: nice. I wish I could go
brbdontdie: I've always wanted to go. A buddy of mine is going to stanford for his phd. I'm so envious.
adibaby04: shit thats cool
logi6000: there isn't shit in the east coast and especially not shit that will intern at 15
adibaby04: just make a github and do projects
adibaby04: literally my boss just looked at my projects and interviewed me
abstracticism: what is carla?
logi6000: yeah I do that but most of the time I just can't come up with ideas
brbdontdie: yeah. Having projects is huge.
mickjaggerrrr: DUDE ur a fkn legend george
logi6000: your boss found you
brbdontdie: try implementing things that other people have already made.
logi6000: or u contacted
adibaby04: i contacted first
logi6000: ok
adibaby04: but then i went and interviewed
brbdontdie: It isn't important that you come up with something new. Just make something, understand how it works, and try to learn from it
adibaby04: yeah because with that you can make new stuff
logi6000: I guess I have 2 years to try and work toward a internship. any advise
adibaby04: start programming lol
braininavatt: LUL
1monkjuice: sit your ass down and code
adibaby04: make a github
logi6000: hmm
adibaby04: @1monkjuice amen
logi6000: ha
evoxrocks: OMG thank you so much for the 10,000 bits!!
logi6000: what language does life 360 use
MrMcaustin1: YOUR PHONE GEORGE IT DO THE VIBRATE
adibaby04: so for android its java and kotlin, ios swift
knilecrack: damn homie
adibaby04: and backend is in PHP, Java, and Go
brbdontdie: I wouldn't go as far as to say that university is a scam, but anything you learn in a lecture could be self-taught by getting your hands dirty and doing some good ol googliing
KNOOKEL_HEAD: Kreygasm
logi6000: nice what do you code in
nso1995: yummy tidfe pods
krouzux: groceries delivered
Th3G4mingbros: objective-c for iOS for life
abk467: tide pods .. we eating good tonight
bebos16: PogChamp
adibaby04: I code in Java and Go, with some C Mainly
xxxdeja: A man of culture
logi6000: cool I am pretty fluent in python and working on go
adibaby04: go is great
braininavatt: HahaDoge
nso1995: A Pagan channel
12btw_: BlessRNG
Doyniish: Merry Christmas
KNOOKEL_HEAD: merry christmas ANELE
THX1342: wrap yourself in it
Rlchibi: I kinda wwant to learn go
adibaby04: just learn it lol
adibaby04: its not hard
THX1342: now you just need to dye your hair pink and do ASMR streams
logi6000: yeah. I really want to learn c   but after learning python everything in other languages seem like a chroe
Knarez: monkaS
c19946: most beautiful thing i ever seen
KNOOKEL_HEAD: @logi6000 same
logi6000: yup
THX1342: @logi6000 learn assembly, then you'll learn to appreciate C
jax05_: wait until he cracks the bulbs by sitting on them
nso1995: Consumerism makes all things better
abk467: it's beginning to look alot like Christmas
logi6000: ok
mumubecks: BlessRNG allahu christmas
thundershots999: i got off of tide pods and went to ice
brbdontdie: @THX1342 Learn verilog, then you will appreciate assembly
THX1342: LUL
logi6000: the weather outside is weather. who knows where that from?
brbdontdie: haha jk. nothing is worse than assembly
Rlchibi: its never too late for coffee
thundershots999: coffee black with 15 sugars
KNOOKEL_HEAD: POGGERS
THX1342: I like assembly tbh
CianKy: @georgehotz have you used prolog before?
brbdontdie: I understand that it has value, but I don't like having to write several lines to do something that would take me 1 line in C
THX1342: I just study it to pwn
nso1995: This keyboard is horrible
logi6000: the languages I would like to know are python, go, bash, and c  
THX1342: not sure if there is any other use in modern times... compilers are hard to beat
nso1995: It sounds like you're typing on a slab of metal
Jeppelelle: How does it bypass the kernel?
logi6000: I got about half
logi6000: topre switches the best
thundershots999: @nso1995 we dont talk about the hardware typing device
logi6000: LMFAO
mumubecks: Why not upload with ftp from windows explorer
krouzux: lmao
zeroeagle1: what we doing today
logi6000: fucking ftp
brbdontdie: I had to utilize some inline assembly for a project I was doing in OS
thezilion: and licence?
knilecrack: put them on your head
logi6000: it's good Christmas chair
THX1342: christmas lights on the chair are proper ASMR streamer decoration
zol0: in dish washer
krouzux: put the lights out of view where the deserve to be
tsAllySparkles: nice bootay
moonify: Now we know to not put F lights in ours chairs.
logi6000: @krouzux someone is not in the spirit
lemsa_: best decoration ever
visudo20179c: bogaLeak bogaLeak bogaLeak bogaLeak bogaLeak bogaLeak
thundershots999: !sr holly jolly christmas
mrmusicmaine: I love it when George gets philosophical
fatboyruuuun: What programming is this ? is this python or ruby ?
mutrx: merry christmas?
Rlchibi: python @fatboyruuuun
logi6000: who's that guy who put his cat in a box and said he didn't kill his cat because he didn't look at the cat when it was dead
mutrx: send it to one of ur viewers
nso1995: You can actually make coffee in a waffle maker
krouzux: cooking stream when?
braininavatt: giveaway! PogChamp
logi6000: @nso1995 that seems risky
mutrx: equivalent excahnge
mutrx: fucking weeb
krouzux: oh weeb shit
tiagodopke: weeb
krouzux: turn that off
brbdontdie: yoooooo. that was one of the best intros to an anime ever
Th3G4mingbros: I've been meaning to watch it but haven't yet
mutrx: u watch Made in Abyss
SheitanasGM: i luv FMA
logi6000: turn that furry or whatever shit off
tsAllySparkles: dude what are you on
knilecrack: oshi kuru
brbdontdie: i used to get so hype listening to this intro
fatboyruuuun: Edward &lt;3
mutrx: wowow full autismo
tiagodopke: that makes no sense
abk467: SeemsGood
knilecrack: only for you
Th3G4mingbros: lmao
thundershots999: did you throw out the old macbook?
FresherLemons: george out here spitting facts
moonify: test it
AWZ123: what editor is that?
mutrx: what other anime do u watch
knilecrack: only when you are boujee
logi6000: no waffle maker is better than coffee maker. throw out coffee maker get tea maker
fatboyruuuun: just don’t lose a arm and a leg in the process
moonify: @AWZ123 vim
nso1995: But you already paid for it
AWZ123: @moonify thanks!!
tiagodopke: so are you saying that our lives can't improve in value?
nso1995: which was the loss
xxxdeja: A man of culture uwu
logi6000: @tiagodopke exactly
brbdontdie: next thing you know, george is going to try to bring back the coffee maker and it will come back as a full chainmail suit
tiagodopke: damn
krouzux: its like saying to gain your manly hood your virginity must be losted
fatboyruuuun: I got it, makes sense
mutrx: https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSjyCoefTXVQlqoikqYLiKs_tCBWAJt56EHeIz038DTcHqj7Brs
mutrx: https://imgur.com/UEgRKwU
CaliburOne: you lose a arm and a leg and a your buddies whole body and you get back a pile of gore called mom
logi6000: @krouzux it's not equal value.
thundershots999: play some burl ives
tsAllySparkles: are you on meth
mutrx: @georgehotz https://imgur.com/UEgRKwU @georgehotz https://imgur.com/UEgRKwU @georgehotz https://imgur.com/UEgRKwU
logi6000: no he's not on meth
mutrx: monkaHmm
tsAllySparkles: what is his deal then lmao
visudo20179c: he's on math
zetleri: never do math
mutrx: PO unboxing stream
logi6000: he's to smart he would be Walter instead cooking instead of using
braininavatt: ninja? PogChamp
brbdontdie: is this george's way of saying he is moving to mixer?
logi6000: @brbdontdie I fucking hope not
moonify: So Ninja nows makes coffe makers/
krouzux: @logi6000 purity for adulteration seems equivalent
1monkjuice: we need an ai coffee maker
tanoshiizo: Does it connect to the internet?
AWZ123: that's money, you get something of value and you give money for it
thundershots999: he does realize he has to run a few cycles to clean the coffee maker?
Jeppelelle: What if one does not think anything has any value? Can one keep everything?
zetleri: money is just saved energy
tsAllySparkles: @thundershots999 i don't think he cares
lemsa_: "ninja make me a cofee"
mutrx: drinking coffee at 630pm LUL
1monkjuice: @zetleri passive energy
brbdontdie: so what is the equivalent exchange for self driving cars :O
krouzux: if it doesn't connect to the internet it isn't cool
logi6000: @georgehotz you gave your money for the coffee maker you made your equal exchange
visudo20179c: gasoline powered cars
mutrx: does it have a bluetooth app?
logi6000: let's go
loktarcek: @visudo20179c *Diesel
logi6000: may the hunt for the maker begin
braininavatt: brb, travelling to San Diego
raulciuntastefan: if its nice why u arent keeping it ? Kappa
JonThomasK: yes
krouzux: george is indulged into weeb philosophies
visudo20179c: poopoo peepee
AWZ123: no? what?
brbdontdie: *gets a first class ticket to san diego to get george's waffle maker*
thundershots999: clean the coffe pot
mutrx: 2 shots of vodka
logi6000: the hunt has begun. george where do you live
THX1342: I bet somewhere in the world there's a weeb who photoshoped geo's face in their body pillow
blondephilia: isn't 2 scoops a 4chan meme?
knilecrack: wash them 1st please
mutrx: tea &gt; coffee
thundershots999: this is going to turn into a George getting sick stream
presidentkanyewest2024: hi
thundershots999: Clean the coffee maker
brbdontdie: @THX1342 please don't use weeb in your joke as an insult. Us weebs find that offensive
THX1342: LUL
krouzux: too late
aa_ato: ads
itsChoudhry: I wanna travel to where george lives to run into him. Ask him for a picture and have a irl flame war then he like hey was cool meeting you and leave.
thundershots999: you are suppose to run a few pots of just water first
mortalog: SURE LUL
visudo20179c: is the word weeb have speech?
JonThomasK: do you have a robot vacuum
lemsa_: @thundershots999 true
raulciuntastefan: What's a weeb's favorite element ?
logi6000: when can we go back to smoking weed and coding for 10 hours straight
raulciuntastefan: Manga-nese
anup_kodlekere: whats coookin?
raulciuntastefan: kill me now
brbdontdie: boron @raulciuntastefan
1monkjuice: -george programming self driving cars -youtube recommendation algo: "Microsoft word tutorial, how to insert images"
Thealvisz: Can I have a picture AND waffle maker tho? Kappa
zetleri: roborock?
JonThomasK: the AI on them sucks.. at least the one i bought
brbdontdie: damn that was way better
mutrx: monkaHmm https://imgur.com/UEgRKwU monkaHmm https://imgur.com/UEgRKwU
georgehotz: https://github.com/commaai/cereal
Tarzeuss: Two days of Streams in a row? Thanks man you are awesome for doing this!
Thealvisz: I WANT BOTH ;_;
mutrx: trying to partner
aa_ato: no
itsChoudhry: @georgehotz What if I offer you a waffle maker for a picutre?? deal??
Artara_: how about taking a picture with the waffle maker, but I don't need it
thundershots999: I only photograph lightning
logi6000: so will he just carry the waffle maker everywhere just in case
anup_kodlekere: what you cookin
7Locrian7: :)
CianKy: yo yo @georgehotz have you ever used prolog before?
Thealvisz: Imma sell it to scrap
Thealvisz: Kappa
braininavatt: can you write some documentation on the rules on getting the waffle maker? Kappa
thundershots999: that coffee maker is LOUD
7Locrian7: george you have no emotes
braininavatt: ^
7Locrian7: what the heck
knilecrack: who needs emotes
7Locrian7: FeelsBadMan i do
zetleri: ruyuHot
thundershots999: I can hear that coffee maker in Connecticut
logi6000: is @adibaby04 even here anymore
logi6000: @thundershots999 oof
JonThomasK: that brewing is loud
itsChoudhry: Make a model which generates emotes with GANs
thundershots999: that oven has to be pre heated
chelsiquixote: where's your bud light?
thundershots999: Don't burn the mother down
logi6000: what kind of fucking back to the Future oven do you have then @thundershots999
thundershots999: Its a wolf oven
logi6000: hmm
ktzkalash: when u gonna do another xmas special?
logi6000: has anyone crashed using openpilot?
forkdb: I think he is making use of that oven for deep learning purposes, hence, the noise... hehe
logi6000: @forkdb makes sense
7Locrian7: he's not looking, i'm gonna say it:
7Locrian7: penis
logi6000: tendies!
7Locrian7: no
logi6000: @7locrian7 you said a no no wors
sirleeroyjenkins: 4 hours
itsChoudhry: 69 mins
JonThomasK: Ask Alexa
Darvein21: 1337 mins
brbdontdie: at least a day
logi6000: 42069 seconds
robby0313: Until they are cooked
JonThomasK: You have Alexa.. ask her. She smart
raulciuntastefan: Kappa
vtcN_: 1 minute at a million degrees
logi6000: until 4/20/69
zetleri: u can take it out when its 1576464579
veomx: hey bros
sirleeroyjenkins: u read it wrong it says 13-17 hours not minutes. Make sure u cook it thoroghly wouldnt wanna eat raw chicken
thundershots999: 7.8 x 1011 Nanoseconds
dahlenn1: dahlenn1 subscribed with Twitch Prime.
raulciuntastefan: is coffee good ?
raulciuntastefan: (dumb question)
raulciuntastefan: last time i drink was 2-3 yrs ago
logi6000: @raulciuntastefan no question is dumb unless it is dumb
sirleeroyjenkins: if u like bitter things that give u energy
logi6000: drink tea or take CBD
adibaby04: im back boyz
logi6000: the 15 yr old used to be intern
adibaby04: si si now in school
raulciuntastefan: thx boyz
logi6000: CBD the best option if you want good night's sleep
adibaby04: i want a github revieww
presidentkanyewest2024: what keyboard do you use?
logi6000: take one small edibal and you out in a hour
thundershots999: now I want a cinnamon roll
adibaby04: now i want a github review
logi6000: @georgehotz will you mail me a cinnamon roll
adibaby04: https://github.com/adiprerepa
adibaby04: YIPPEE
adibaby04: dont roast me
krouzux: &gt;java
raulciuntastefan: u from India ?
cold_ali: lmfao
raulciuntastefan: Kappa
tsAllySparkles: https://github.com/askalice
gseven_: ahahah
adibaby04: nah
Tastydrol: haha
JonThomasK: java WutFace
adibaby04: NOOO
presidentkanyewest2024: J LUL V LUL
THX1342: LUL
itsChoudhry: Fuck me up fam https://github.com/ItsChoudhry
knilecrack: ahahaha
adibaby04: i know it so well
adibaby04: not fair
sirleeroyjenkins: wow very thorough github review
thundershots999: I drink my coffee black with 15 sugars
raulciuntastefan: this lad is for sure from India
adibaby04: go into the code tho
adibaby04: its coooool
Th3G4mingbros: xD
cold_ali: why not learn java?
ffntdt: why
adibaby04: ok
adibaby04: go into the go
Jeppelelle: Doing adventure of code today?
forkdb: Why is java bad ... George?
logi6000: because Java is going to be dead soon
forkdb: Please explain
tsAllySparkles: tsAllySparkles subscribed at Tier 1.
XiuYee1: Hello
adibaby04: too verbose
tsAllySparkles: there
sirleeroyjenkins: george just roasted this man for using a programming language that he isnt a fan of
tsAllySparkles: https://github.com/askalice
adibaby04: i personally dont like it but i know it so well
zetleri: 2h till AOC?
JonThomasK: PHP WutFace
cold_ali: i wish i could use vim like that lol
michaelmaier007: woke up this this stream
logi6000: @georgehotz ts Ally sparkles subed do the review
thundershots999: i'm still trying to master if then else in basic
zetleri: front-end .. yikes
JonThomasK: php and javascript. the two worst choices
Imeriall: What language should we learn then? Most universities teach Java nowadays.
tsAllySparkles: lmao
Imeriall: in intro classes
sirleeroyjenkins: just use Rust
forkdb: Why not java .. please explain
JonThomasK: time to do acid
gseven_: python and go
knilecrack: ahaha
braininavatt: trippy
peter35_: ocaml
cold_ali: dope AF
hardtarget4: trying not to have a seizure rn
sirleeroyjenkins: Toontown was a great game
tsAllySparkles: those commits are all me
tsAllySparkles: i changed my github name
logi6000: @jonthomask ikr
tsAllySparkles: webgl
JonThomasK: dances
sirleeroyjenkins: is that what u used for the fractals thingy
420lokki69: LUL
420lokki69: good tune
THX1342: trippy
tsAllySparkles: add axes
tsAllySparkles: dat.gui
camidon: take some LSD
tsAllySparkles: i could help with that
vexedkiller0071: *LCD
logi6000: hire her for web
adibaby04: this one is the coolest one inpired by you: https://github.com/adiprerepa/Car-Rpc
tsAllySparkles: lol
forkdb: George... please tell us why not to learn and use java?!...
tsAllySparkles: give me a better salary then maybe lol
JonThomasK: because better things exist
tsAllySparkles: if you use mapbox for your mapping engine
tsAllySparkles: then i can integrate three into that i've done it before
raulciuntastefan: yes dude , u gotta tell us why u dont like java
ffntdt: why not java? im learning to do android right now lol
raulciuntastefan: u cant escape that easily
adibaby04: this ones cool: https://github.com/adiprerepa/Car-Rpc
krouzux: anything OOP related just stay away
adibaby04: @krouzux so no C  ? thats wrong
oMythra: forces oop and slow there you go @forkdb
krouzux: uh you can program in C   without using OOP
krouzux: I do it everyday
THX1342: LUL
oMythra: exactly @krouzux
adibaby04: ic
braininavatt: rip
krouzux: its like a subset of C   that is just C
thundershots999: Java and Maroon 5 FTW
krouzux: C with function &amp; operator overloading
THX1342: adibaby04 it's very professional and impressive for a 15yo honestly.. nice job
adibaby04: woe ty
forkdb: Tell us why not to learn and work on java?
sirleeroyjenkins: Way to put down a 15year old for using Java
THX1342: but it's java...
THX1342: LUL
knilecrack: java is good
jo_renttt: I just got here why stay away from OOP? @krouzux
krouzux: i mean better to learn now than late
krouzux: because it has no relevance to actually programming
oMythra: not stay away from oop just use it only when necessary
THX1342: leave java for when you need to work in a 1000 person development team for a monolithic bank
adibaby04: yea im trying to move to golang
tsAllySparkles: it's not hard
tsAllySparkles: three.js buffer geometry makes it really easy to make a lot of stuff performant
logi6000: if I sub will you mail me a cinna roll. plz hook me up.
oMythra: go is cool @adibaby04
1monkjuice: dp &gt; oop
adibaby04: agreed @oMythra
tsAllySparkles: https://threejs.org/examples/webgl_buffergeometry_instancing_billboards.html
Jeppelelle: George must have a mouth made of iron, eating pasta when its on fire and cinema rolls straight out of the owen
itsChoudhry: Wait you use Qt for your tools now????
tsAllySparkles: https://threejs.org/examples/webgl_buffergeometry_uint.html
adibaby04: fix this repo: https://github.com/adiprerepa/grpc-go-chat-server its not working lmao
michaelmaier007: dont eat too much :) stay in shape
tsAllySparkles: very performant
jo_renttt: Why do they only teach me OOP in college
logi6000: if I sub will you mail me a cinna roll. plz hook me up
tsAllySparkles: that plus VideoTexture
raulciuntastefan: is that a donut ?
tsAllySparkles: yeah but it's far less documented
tsAllySparkles: no the menus are dat.gui.js
tsAllySparkles: https://github.com/dataarts/dat.gui
tsAllySparkles: yeah it's amazing, and super easy to use
tsAllySparkles: ctrl enter
JonThomasK: run
logi6000: the best web dev I can do is if you set me up with a bootstrap template
Latyos: top left corner run
adibaby04: fix this repo: https://github.com/adiprerepa/grpc-go-chat-server its not working lmao
tsAllySparkles: oh maybe not
tsAllySparkles: thought that would run
adibaby04: js weird
tsAllySparkles: maybe cmd tner?
tsAllySparkles: enter*
knilecrack: yeah
itsChoudhry: itsChoudhry subscribed at Tier 1. They've subscribed for 3 months, currently on a 1 month streak! aaayyy
Imeriall: Thanks for the HahaBall @itschoudhry
pouringhotteaonyourface: did you cook your own meal?
sirleeroyjenkins: if u have milk dip em in milk
sirleeroyjenkins: bomb af
MiniManiacBlob: g'day George
guy_ross: guy_ross is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 8 in the channel!
guy_ross: guy_ross gifted a Tier 1 sub to 1monkjuice!
guy_ross: guy_ross's Gift shared rewards to 5 others in Chat!
logi6000: thx subs!
adibaby04: ty subs
1monkjuice: yee, support
guy_ross: ;)
420lokki69: ty for sub
sirleeroyjenkins: lookin a little charred on the bottom
krouzux: lets see it again
Nudethedder: pajaKek
adibaby04: i got revenue
THX1342: @logi6000 thx no subs :(
ProfessorMagikarp0: those were the good days
420lokki69: you need some coffee with that
ffntdt: so wtf did i just learn in 2 years in university? they only teach oop lol
bravech: are you not allowed to show revenue or is it just not socially acceptible
brbdontdie: what is the consensus on typing with sticky fingers?
adibaby04: just side projects @ffntdt
tsAllySparkles: https://mrdoob.neocities.org/017/
krouzux: uni is not for knowledge but a certificate saying you "know" shit
itsChoudhry: Nah I just removed all my good projects off my github because apparently I had offensive comments and employers don't like that. I need to spice up my github
tsAllySparkles: https://thebookofshaders.com/
METH_HEAD_MIKE: DESCRIBE TASTE DansGame
brbdontdie: @krouzux hey man, some people can really explore their interests in university
logi6000: why don't we rename stream to binging that part of the web
jo_renttt: @ffntdt thats what IM saying
brbdontdie: I would never have gotten into computers because I used to think that it was too hard as a hobby
stoogethomas: yo it's geohot and for those that don't know I'm getting sued by sony
krouzux: @brbdontdie related to software development careers that is
adibaby04: i want an un-roast
Latyos: Hey, do you have your vim config uploaded anywhere?
adibaby04: go review
adibaby04: golang*
MiniManiacBlob: so what is the task right now?
sirleeroyjenkins: make a btc miner disguised as shaders
bravech: uni is good for connections
logi6000: @stoogethomas let's take it out of the court room and in to the streets
raulciuntastefan: https://www.youtube.com/watch?v=b74GiMB08UE&amp;list=PLiDow_mvyEAtyVEOHAmokrZh0GdV8wt8y
raulciuntastefan: dont ban me
stoogethomas: @logi6000 ;)
raulciuntastefan: pls
THX1342: https://twitter.com/hexpwn/status/1206345584631844864
oMythra: its good to learn oop just gotta know when to apply it and when not too
erichtp: sketch.io time PogChamp
braininavatt: LUL
美國威傅後援會會長: LUL
METH_HEAD_MIKE: BAN HIM 😡
p4ri: your so smart man
sirleeroyjenkins: hows the burnt ass cinnamon buns
bravech: @jo_renttt don't not learn something bc some stranger on the internet told you not to
logi6000: @meth_head_mike wtf is your username
tsAllySparkles: hit the examples tab
tsAllySparkles: on the docs
THlAG0: https://www.shadertoy.com/view/ttXGWH
THlAG0: see this
adibaby04: GOLANG REVIEWWW
METH_HEAD_MIKE: PogChamp
METH_HEAD_MIKE: NEW HALO PogChamp
braininavatt: smooooth Kreygasm
stoogethomas: will you play half life vr?
oMythra: make half life 3
sirleeroyjenkins: because u burnt the shit out of them
logi6000: mail me a cinna roll. plz hook me up
logi6000: ayy I got the quest
cloakW: quest is beginners VR
brbdontdie: @krouzux I don't know if i necessarily agree with that
stoogethomas: honest question I've always wondered how you have so much energy. do you supplement or are you just generally a beast in life
jo_renttt: Its not that its just that its the first time I heard of this @bravech
adibaby04: ill shut up when i get a golang review
michaelmaier007: what time is it there?.
logi6000: I got it bc I'm not a big gamer but I like gaming
knilecrack: PC gaming is not dead
stoogethomas: hahahaha
imsuperficial: LUL LUL
erichtp: LUL
ProfessorMagikarp0: same
bravech: quest is good if you don't have a pc powerful enough
camidon: word
sirleeroyjenkins: primeagenBuild primeagenBuild Adderall for sure
cloakW: PC gaming is more alive than its ever been lmao
1monkjuice: WutFace
raulciuntastefan: cocaine is actually great
METH_HEAD_MIKE: Same FeelsGoodMan
HexaField: hey george how are you today? :)
raulciuntastefan: Kappa
METH_HEAD_MIKE: Kappa
jo_renttt: Kapp
bravech: mobile gaming is a different market from pc gaming
logi6000: do you have adhd?
bravech: more casual
tsAllySparkles: lmao
peter35_: i miss adderall FeelsBadMan
forkdb: Tell us why not to learn java...
brbdontdie: I don't think you that university will teach you everything that you need to know (not even close) but they introduce some pretty heavy concepts that the old me would never had touched if it wasn't needed to get my degree
bravech: ^^^
sirleeroyjenkins: then u just switch to coke and its alot better
raulciuntastefan: *need more adderall
krouzux: or you could've learned online for free
krouzux: or bought some books
bravech: uni won't spit you out ready to get a job; you've gotta do that yourself
logi6000: snorts Adderall
ProfessorMagikarp0: homeostasis or something? monkaS
raulciuntastefan: tolerance is a hoe
adibaby04: GOLANG REVIIIIIEEEWWW
knilecrack: exactly
ProfessorMagikarp0: so not being urself for a bit helps LUL
moonify: @georgehotz What about lsd-microdosis?
sirleeroyjenkins: lmaooo so true
lua_320: @krouzux or you can pirate books and buy them if you think is worth it
JonThomasK: i organized my email
logi6000: @georgehotz do you ever just smoke straight CBD flower
ProfessorMagikarp0: dont get ban monkaS
cloakW: CiGrip
JonThomasK: coke?
stoogethomas: I was talking about vitamins not supplements just saying hahaha Just so much respect for the focus and energy you have.
brbdontdie: yeah but @krouzux most people are not disciplined enough to actually self-learn consistently
adibaby04: GOLANG
adibaby04: what about coke
J3rwin: @brbdontdie true
brbdontdie: I think once you have developed an interest in the material, it becomes easier.
moonify: @JonThomasK Coke Bad, psycho good
bravech: there's a whole lawsuit going on because putting CBD in foods is illegal
Artara_: what's the impulse to decide to take adderall?
adibaby04: almost???????????????????????????/?
cloakW: "almost" LULW
METH_HEAD_MIKE: Kappa
krouzux: comma dispensary when?
knilecrack: what is that drink?
lua_320: Yes, it's easier to learn something you like
logi6000: so did you take coke ever?
michaelmaier007: its coffee
ProfessorMagikarp0: nickiG drugs are bad mmmmmmkay
bravech: meth is bad
stoogethomas: meth is bad kids
jo_renttt: LUL
erichtp: heroine is the wave
adibaby04: heroin?
lua_320: krokodile is the best drug in existence
JonThomasK: sugar?
jax05_: exactly
brbdontdie: I used to think that I needed adderall, but I just needed coffee
MiniManiacBlob: anything worth taking to actually get work done? @georgehotz
jo_renttt: Nitrous oxide
camidon: melamine is fun
logi6000: he never mentioned heroin
camidon: ketamine
bravech: dopamine is a drug, man
cloakW: Kappa
THX1342: one of the worst is tabacco
logi6000: he done fucked up
raulciuntastefan: lsd is great
brbdontdie: I have never tried adderall, but coffee did the trick for me
stoogethomas: meth just destroys your dopamine though
ProfessorMagikarp0: bath salt nickiG zombies
bravech: george check out r/meth
MiniManiacBlob: sugar is the worst bois
mdrake_: yep, I've known some functioning meth addicts
dahlenn1: flakka is the best
Artara_: I'm not addicted to cocaine I just like how it smells
l33tkr3w: Opioids super hard to escape
forkdb: For gods sake .. please tell us why not to learn java George... we are all still waiting...
logi6000: @georgehotz so have you ever tried coke
adibaby04: ^^
death_gadget: Ice is the real killer
brbdontdie: do you drink soda after meals during work?
raulciuntastefan: LUL
michaelmaier007: @artara_ thats the point...
knilecrack: white horse
bravech: there's some people on r/meth who've gone 6 months normal but they all eventually break down
l33tkr3w: Buprenephrine is icky icky icky
jax05_: freakin tea, coffee, and sugar
THX1342: forkdb why do you want validation so bad?! LUL if you like it, thats good for you
jax05_: worst of the drugs
Jeppelelle: DMT?
MiniManiacBlob: benzos are fucked
forkdb: For gods sake .. please tell us why not to learn java George... we are all still waiting...
logi6000: so have you ever tried coke
adibaby04: golang review?
THX1342: imo tobacco is the worst
knilecrack: especially in USA
bravech: asking george why not is noob thinking
ProfessorMagikarp0: any ice chewing relapse ?
jax05_: I think benzos are overhyped
ProfessorMagikarp0: Kappa
knilecrack: you guys put sugar in everything
1monkjuice: im surrounded by 3 cans of coke, 2 bottles, 1 can of speed and 3gs of weed
bravech: sugar ice relapse
stoogethomas: for legal purposes he means cola
adibaby04: GOLANGG
MiniManiacBlob: @georgehotz but im forced to learn java at college (uk college)
brbdontdie: what's wrong with chewing ice?
Waywoah: bad for your teeth
l33tkr3w: Micro fracture teeth
stoogethomas: java is the gateway to c  
bravech: lmao
J3rwin: jesus
kingkong3211: @MiniManiacBlob same man
brbdontdie: oh man, I chew ice and give me dog ice all the time
METH_HEAD_MIKE: Kappa
brbdontdie: big yikes
gseven_: be careful with what you say @georgehotz twitch is savage
ProfessorMagikarp0: fbi open up monkaS
美國威傅後援會會長: Kappa
tsAllySparkles: oof
jo_renttt: TOS
bravech: tv normalizes drug use
MiniManiacBlob: @kingkong3211 it is kinda shit but i understand its uses and purpose
peter35_: freud was a huge coke addict
raulciuntastefan: cocaine isnt even that great
stoogethomas: java is the gateway drug to c  . c   is the gateway drug to c
raulciuntastefan: to pricey
michaelmaier007: i saw a guy here in germany. i seriously thought that was you. And unfortunately ofc itwasnt you :(
JonThomasK: musk
tsAllySparkles: there totally are people who do that
tsAllySparkles: my cousin did that
jo_renttt: r/meth
THX1342: coke is like alcohol x 1000
bravech: python &amp; c   are the true power couple
forkdb: I work in one of those big java vendor companies... so, tell me why we shoul not work on java...
oMythra: it aint that serious bro @forkdb
jo_renttt: LUL @forkdb
adibaby04: javas just stupid
knilecrack: you die on coke very fast
adibaby04: too verbose
logi6000: so here's the thing he never said he never did heroin
moonify: @adibaby04 agree
Artara_: he wants to give away his waffle maker cause that's where he stores his coke.. don't fall for it guys
adibaby04: I agree that java sucks but i know it so well
ProfessorMagikarp0: doesnt linus torvalds hate Java too LUL
raulciuntastefan: george is actually working with the dea
raulciuntastefan: dea
tomcroose: @trainwreckstb
bravech: java and nvidia are the devil
adibaby04: not much i can do
cloakW: squadW @tomcroose
Riqour: squadW
logi6000: @bravech and intel
cloakW: 🦍
stoogethomas: it's upside down
wc_dozer: A cure for Java is Scala, slightly less horrible syntax, same JWM
stoogethomas: yeah
JonThomasK: lol
Riqour: its a rectangle
l33tkr3w: your monitor is upside down
stoogethomas: lol rip
moonify: 360
THX1342: australian car?
jo_renttt: Rotate display
kingkong3211: lol
zetleri: and mirrored?
tsAllySparkles: lmao
yunk3r: Region Australia?
sirleeroyjenkins: What exactly is this Openpilot thing
tsAllySparkles: threejs would be better for this shit
JonThomasK: turn your monitor right side up
raulciuntastefan: rotate display LUL
tsAllySparkles: tbh tho
ProfessorMagikarp0: nickiThink ur debugger build in Australia?
bravech: stiffness
cloakW: membrane keyboards hurt my ears
adibaby04: GO
adibaby04: REVIEW
l33tkr3w: why is the simulation 0.3 fps
Artara_: is it emulating a retina?
michaelmaier007: @cloakw but they are statisfying
logi6000: you got a citation for having weed in Texas?
Riqour: what ide is that
adibaby04: its vim
Riqour: ah
JonThomasK: its not an ide
Riqour: text editor right?
kingkong3211: its an editor
jo_renttt: yes
sirleeroyjenkins: I recommend chicken tendies
peter35_: FeelsGoodMan
stoogethomas: Why are you doing this when you could be hacking crypto exchanges. 1 exchange had 50mil stolen last week. That could be you
stoogethomas: lol
logi6000: @georgehotz you got a citation for having weed in Texas? don't you have a medical card
stoogethomas: sorry last month
bravech: RIP vod
JonThomasK: kanye west?
sirleeroyjenkins: how do u know it wasnt him @stoogethomas
SheitanasGM: Where ur not
MiniManiacBlob: anyone have any advice on ways of improving your coding skills fast?
stoogethomas: haha
adibaby04: this will get stuck in ur head
rkxbz: is that oxxymiron?
adibaby04: https://www.youtube.com/watch?v=Q3cFtBx4jRE
rkxbz: where did you found it @georgehotz ?
ProfessorMagikarp0: KKomrade
Riqour: @MiniManiacBlob work on projects so you put your knowledge to use
raulciuntastefan: is that russian ?
METH_HEAD_MIKE: nice audio FeelsGoodMan
JjohnConstantine: нот бад)
SheitanasGM: If U like Russian Rap u need listen Miyagi
rkxbz: @raulciuntastefan yep
Still2050: Wtf
logi6000: George hotz how easy is it to get a medical card
MiniManiacBlob: @Riqour what kind of projects
Adolfich: ебать
trev0rk911: @georgehotz have you tried tianeptine?
ProfessorMagikarp0: welcome comrades
MiniManiacBlob: @Riqour you mean larger scale tasks?
moonify: are you streaming advent today?
JjohnConstantine: неожиданно)
dmitry_ra: Вот это поворот
Adolfich: зашквар так то
sirleeroyjenkins: cyka blyatski
Riqour: @MiniManiacBlob anything. You can google small to big project ideas
adibaby04: yea
gseven_: CURVA
adibaby04: do projects
MiniManiacBlob: @Riqour ye ok
MiniManiacBlob: @Riqour thx
oMythra: putin be rockin to this
SheitanasGM: dobre vicher
THX1342: cheeky breeky
mrigor: osujdau
sirleeroyjenkins: geohot Russian hacker confirmed
michaelmaier007: he sounds a little bit like eminem.
Immortalsamurai_: anyone you have any good laptop recommendations? need to buy a new one soon
oMythra: for windows: xps 15 and x1 carbon @Immortalsamurai_
THX1342: @Immortalsamurai_ XPS
1monkjuice: theres already plenty of research for that in the web @Immortalsamurai_
oMythra: can install linux on mem too
adibaby04: @georgehotz can we do more github reviews?
trev0rk911: why aren't there more programmer streamers on twitch?
adibaby04: ^^
bankzed: there
guy_ross: can i send ya one?
oMythra: there are check out science and tech section
adibaby04: i kind of want to start streaming programming my projects
bankzed: whadup from another RIT dropout
logi6000: why are we listening to Russian shit
Immortalsamurai_: @thx1342 @omythra thanks!
stoogethomas: does it matter the language
rkxbz: @logi6000 that is not shit man
METH_HEAD_MIKE: DansGame YOU DONT SKIP
jo_renttt: never need a bitch
raulciuntastefan: thats garbage indeed
JonThomasK: as you bob your head to it
bankzed: check out some Higher Brother, some OP Chinese Rap
bravech: george can you play your rap
logi6000: listen to JID or something lyrical
bankzed: he's Canadian, so doesn't count
THX1342: LUL
JjohnConstantine: Kappa
raulciuntastefan: Kappa
treestompztv: BARS TriHard
JonThomasK: lol
tsAllySparkles: do you make music?
raulciuntastefan: lmao
mazsociety: random word generator
Artara_: 200iq
ProfessorMagikarp0: we need emo kid rap nickiG
vtcN_: LUL
braininavatt: modern poet Kappa
jo_renttt: sonically
jo_renttt: pleasing
oMythra: cockpit out there flying on its own
michaelmaier007: linkin park is awesome too.
l33tkr3w: gotta compare to top 100 right now in rus
peter35_: russians are like effortlessly poetic in their prose it seems
logi6000: linkin park or green day or JID or something good
l33tkr3w: more poetic
bankzed: Russian rap is good as long as it's subverting Putin
tsAllySparkles: https://emu.bz/winXP.mp3
JonThomasK: go back to pocket pussy
adibaby04: Listen to this: https://www.youtube.com/watch?v=Q3cFtBx4jRE
oMythra: you sure Tolstoy didnt write that
mrigor: easier to rhyme with conjugation IMO (russian)
logi6000: listen to this https://youtu.be/oZgNcLoZLjE
METH_HEAD_MIKE: KKona WTF
jo_renttt: nobody LUL
CraftyGaming: There is great american rap....it is no longer what the mainstream wants to hear. It's quite sad
veomx: :D
gseven_: POET
jo_renttt: what about blinding lights? @georgehotz
JonThomasK: doesnt even make sense
bankzed: the best art is stolen
trev0rk911: @georgehotz are you into nootropics?
bravech: @mrigor I only have experience with spanish, but isn't rhyming same-ended verbs repetitive?
jo_renttt: Old weeknd PogChamp
bankzed: it's not just the drugs, it's also Gigi Hadid.
bravech: kinda as if you rhymed the same word with itself
jo_renttt: and selena LUL @bankzed
Xplouder: listen some joyner lucas's music
jo_renttt: Pass
michaelmaier007: its f...ing monday again....
adibaby04: yeah
adibaby04: joyner lucas
whoishenry123: the way the weeknd sings it makes it sound cool
bravech: george have you listened to to pimp a butterfly
mazsociety: or just listen to 21 savage and then you don't have to worry about understanding any of the words
braininavatt: cant relate Kappa
dahlenn1: jonyer lucas is lit
mrigor: @bravech pushkin is the most famous poet I believe and its all ending rhymes http://www.poetryloverspage.com/poets/pushkin/pushkin_ind.html
vexedkiller0071: anyone listen arctic monkeys (old)
veomx: marshall mathers lp
logi6000: let's listen to juice wrld in memorizarion. he's not great but I mean. he dead now
michaelmaier007: listen to linkin park im sure you'll like it.
JjohnConstantine: MC georgehotz
THX1342: vexedkiller0071 ye
moonify: the message bro
logi6000: green day minority. you would love that song
adibaby04: github
adibaby04: review
mazsociety: have you listened to the new joyner lucas song?
jo_renttt: Do you like kendrick?
bravech: seizure most likely related to drugs
jo_renttt: a fukin seizure.......
bravech: heavy use of lean
slipperrybunz: tried to hide drugs by swallowing them
Xplouder: hopsin - ill mind of hopsin 7 is lit
hardtarget4: percocet
whoishenry123: only the weeknd can make his lyrics sound good
J3rwin: rofl
logi6000: @xplouder true true
bankzed: the hip hop police killed Juice WRLD
hardtarget4: rip lil peep
sirleeroyjenkins: Seizure likely due to withdrawal from Xanax
ukluke12: rip the goat
adibaby04: GIHUB REVIEW
trev0rk911: imagine if Elon started streaming on twitch regularly?
mazsociety: joyner lucas - revenge intro
bravech: hmm he'd rather die than go to prison I guess
Artara_: when was the last time you listened to kaiyko
hardtarget4: emo rap will never be the same
michaelmaier007: linkin park is awesome too
THX1342: https://youtu.be/Da04TlloTg0 good brazilian rap
logi6000: he killed himself and he wanted to be the highest he had ever been
bravech: @mrigor thanks for the link
sirleeroyjenkins: just dont do opiates lol
trev0rk911: or use kratom, shit works well and is legal
peter35_: grow opium poppies Kappa
logi6000: yo lil barnacle. let's listen to him
JonThomasK: rofl
mutrx: are we doing music suggestions?
krouzux: what is this
mutrx: https://soundcloud.com/whatsonot/trust-plastic-plates-remix-16bit-44khz
tsAllySparkles: @adibaby04 what github review?
ProfessorMagikarp0: geo living his best life LUL
jo_renttt: how bout travis scott? @georgehotz
duzy: lool
trev0rk911: stay away from kratom extracts with kratom leaf, shit actually gets you high
tsAllySparkles: https://soundcloud.com/allysparkles/desire
knilecrack: did you ever listen to 90's rap?
adibaby04: george golang review
logi6000: minority green day plz
mrigor: @georgehotz jon hopkins is good 'flow' background coding artist
adibaby04: @tsAllySparkles in general
adibaby04: roasting bro
mutrx: https://soundcloud.com/jew3lz/look-at-me-now
bravech: george have you heard of Alltta?
logi6000: is it the coffee or the coke in the waffle maker
trev0rk911: white maeng da kratom 10 grams with legal weed perfect combo, how long until cocaine is legalized in the united states?
death_gadget: Run The Jewels!!
michaelmaier007: water is the best drug.
mutrx: https://soundcloud.com/whatsonot/trust-plastic-plates-remix-16bit-44khz
hardtarget4: alright. lets work
logi6000: CBD the bomb
vexedkiller0071: gayhiphop for good lyrics
grey_street: what's this song
vexedkiller0071: cummo
bravech: @vexedkiller0071 https://soundcloud.com/kaiyko
bravech: @grey_street https://soundcloud.com/kaiyko
bravech: sorry wrong person
grey_street: thanks
vexedkiller0071: all cool lol
logi6000: intense coding begins
trev0rk911: tianeptine is also another synthetic opiate that I've found to be very euphoric. Crazy that it's still legal and easy to verify that it's not laced because it's extremely hygroscopic, and it reacts with mandelin reagent in a very unique way.
mutrx: https://soundcloud.com/whatsonot/trust-plastic-plates-remix-16bit-44khz
adibaby04: signing off for the night, gotta grind an english essay by tomorrow, fuking high school
Riqour: @trev0rk911 whats it like, I've never tried opiates
logi6000: I have a fucking social studies test tommorow 100 pts but I should be good. I got a sleeping problem anyway
mutrx: doing honours next year :)
hardtarget4: lol
dontbeameme: Let’s gooooo
bankzed: Haha, stay in school kids
dontbeameme: Let’s get this problem solv3d
logi6000: @bankzed what is I start a million dollar company
tsAllySparkles: roast my music tho https://soundcloud.com/allysparkles/desire
bravech: george you know what's better than opiates
bravech: trading options on robinhood
dontbeameme: xbox series x let’s go jail break it
tsAllySparkles: i liked your rap
logi6000: @bravech that shit fucking garbage
tsAllySparkles: sony rap lol
bankzed: Is this jeopardy? Are you answering a question in form of a question? You proved my point, stay in school. s/is/if
shivoshifter: @georgehotz Hey explain me that paradoxon, as soon as we have real artificial intelligence. Wouldn't she have understood our 3D world within miliseconds? And move on to the 4 Dimension and so on ...
knilecrack: @tsAllySparkles why twitter says pronstar?
dontbeameme: AI will become autonomous and evolve into something else
tsAllySparkles: don't worry about it that's out of scope
JjohnConstantine: haw many cups of coffee do you drink a day ?
mrigor: @georgehotz why add   commit instead of commit -am?
dontbeameme: I don’t want AI to take over
Artara_: he drinks all of them
dontbeameme: We don’t have the tech to fight off the robots
logi6000: @dontbeameme you might just be out of luck
michaelmaier007: @jjohnconstantine 74
JjohnConstantine: Kappa
dontbeameme: @logi6000 Elon musk made the best point that a computer literally learned any game and could win by just typing in the game rules
logi6000: hmmm
mutrx: g emo hots
trev0rk911: @Riqour extremely short high, 35-minute rush, has a stimulant effect after the rush, just can't shut up. 100 mg for recreational dose. Don't go over 500mg in a day becasue there are some studies that hypothesize that it might be toxic at larger doses due to amineptine (a derivative) being well established as toxic to the liver at doses higher than 100mg
bankzed: That reminds me of Check out XavierWulf on #SoundCloud
dontbeameme: @logi6000 If AI takes over, they will be roaches
logi6000: elon also said that we don't need driver monitoring. nah he is still a genius
bankzed: Err copy and paste fail
prakyath_kantharaju: what do you think about the vscode after using it for a few streams?
Riqour: LOL
stoogethomas: lol
bankzed: VS Code is bloated, use VIM
mutrx: asprin
dontbeameme: Lolololol 100mg you dead
logi6000: CBD maybe?
ProfessorMagikarp0: 100mg? taking dosage advice from lil peep Kappa
mutrx: you can take inf CBD
dontbeameme: Rip juice
Riqour: dude was about to kill me :(
raulciuntastefan: LUL
Riqour: Kappa
shivoshifter: @georgehotz Hey explain me that paradoxon, as soon as we have real artificial intelligence. Wouldn't she have understood our 3D world within miliseconds? And move on to the 4 Dimension and so on ...
mutrx: Kappa
bravech: has anybody studied cbd closely
jo_renttt: Was that a Kapp on 100 THC
mrigor: hes bad at converting to metric
logi6000: don't test that tolorence either
dontbeameme: Why can we just put confidence in a bottle
mutrx: did you guys ever watch a fuck ton of Air Crash Investigation?
tohsdnilb: Mushrooms
tsAllySparkles: what is an IMU?
bravech: inertial measurement unit
jo_renttt: monkaS
mutrx: how was the coffee
thecprogramminglanguage: monkaS
logi6000: it's the monkeys
bravech: don't worry it's just a bit
michaelmaier007: try a song from linkin park.
mutrx: that airbus long LUL
sirleeroyjenkins: geohot terrorist confirmed
knilecrack: I read the article that you posted a while ago about boeing
logi6000: someting Wong Wei too low ho Lee fuk bang ding ow
jo_renttt: on watch list now
bankzed: I've modelled an IMU in MATLAB before for a drone project
erichtp: where did Malaysia 370 go
mutrx: @logi6000 that was legendary
bravech: @georgehotz https://arstechnica.com/information-technology/2019/05/the-radio-navigation-planes-use-to-land-safely-is-insecure-and-can-be-hacked/
bravech: hacking planes
veomx: Lufthansa is also nice
logi6000: @mutrx ikr
METH_HEAD_MIKE: monkaS
mutrx: what's the worst way to die, plane crash or overdose Kappa
bravech: plane crash definitely
veomx: very nice
mutrx: overdose ya
krouzux: chicken rolls?
logi6000: plane crash. at least you get high
raulciuntastefan: listening mumble rap while od
mutrx: @logi6000 LUL
bankzed: I heard it was hijacked by 👽
bankzed: Kappa
ProfessorMagikarp0: thats pretty fucking metal, i respect it
bravech: gotta book seats in the back so you're more likely to live
michaelmaier007: ho lee fuk... sounds interesting.
krouzux: just appeared out of no where
erichtp: so when are you gonna take flying lessons
oMythra: run to the tail it usually breaks off
peter35_: that german pilot who flew into a mountain monkaS
logi6000: https://youtu.be/k-GEhArUuZ8 @georgehotz thank me later
mutrx: the one that let a kid fly the plane
bankzed: Yes, right by the wings
mutrx: best condom commercial ever
knilecrack: @logi6000 AHAHAHAHAHAH
mutrx: @logi6000 best troll ever
logi6000: yup
Abnico: Wassup pimps
logi6000: get George to play on stream
bravech: est is best time zone
Artara_: @logi6000 LUL
Vjasal: @georgehotz what's this advent of code anyway
raulciuntastefan: LMAO that video
mutrx: @Vjasal google is pretty cool eh?
bravech: google it
tsAllySparkles: why not vscode?
tsAllySparkles: i don't understand how you can be so comfortable with vim
trev0rk911: the reason why you don't need to worry about tianeptine causing an overdose is that it doesn't cause a classical respiratory depression response like traditional full mu opioid agonists because of it having functional selectivity. I would be more worried that you would have a seizure if you overdosed but I doubt you would die. I've researched a bit and of course, I've used. It sort of has a ceiling type effect that being anxiety after you push past a certain point probably because it also releas
bravech: jetbrains suite   vim plugin is the best
bankzed: bankzed subscribed with Twitch Prime. They've subscribed for 2 months! Check out https://popcorncomputer.com/
logi6000: https://youtu.be/k-GEhArUuZ8 @georgehotz I recommend you watch this video. this won't get you banned I promise on the waffle maker
mutrx: @trev0rk911 please call 911
trev0rk911: glutamate
logi6000: there goes another line
adibaby04: im back boyz plagarized an essay
PiroFloydian: hey streamer and chat first time here
bankzed: how about I promote usage of an SoC my buddy designs and builds?
mutrx: george do u know chubbyemu on youtube?
adibaby04: @georgehotz can i have a job
mutrx: https://www.youtube.com/channel/UCKOvOaJv4GK-oDqx-sj7VVg
raulciuntastefan: HeyGuys
P0LY: LULW
tsAllySparkles: college is such a cruel joke
PiroFloydian: do we always talk about substances here? also any thoughts on coding high? never tried it
logi6000: George you did make something of yourself.
bravech: oof doin my college essays rn
veomx: Dr. Georg
brickvo: @tsAllySparkles depends on what you do or if you know what you want to do
mutrx: is doing medicine worth it guys
Amammay: you ever eat a potato?
bankzed: yeah, I want those looking to do drugs instead buy computers such as this:
bankzed: https://popcorncomputer.com/
logi6000: @pirofloydian not always. he needs to smoke more weed on stream thi
adibaby04: @georgehotz i want a job pls
bankzed: computers &gt;&gt; drugs
adibaby04: ^^^
mutrx: @adibaby04 officially added to the blacklist
adibaby04: nOOO
adibaby04: nOw I caNt woRk at CoMa aI
PiroFloydian: @georgehotz did you always code from the terminal or was there a point where you switched to it? if you switched why and was there a hump to get over?
itsChoudhry: What's he doing right now?
mutrx: you need over 10k followers to join comma anyway
mrigor: @georgehotz terminal beep, make it stop :)
logi6000: and solve the speed challenge
tsAllySparkles: i have 18.9k followers, so i could probably join comma lol
tsAllySparkles: but idk about that speed challenge wat is it
JonThomasK: 1/2^2
adibaby04: @georgehotz whats ur vimrc?
tsAllySparkles: where?
Vegerot: !dotfiles
logi6000: gives you some training data and you have to find the speed of the car from a vid with ai.
trev0rk911: @mutrx No, I just checked my blood pressure it's 150/95 pulse 110. I don't do this very often only 3 times a week and I keep my doses under 500mg. I just have a lot of energy and I need to release it through typing, I have type racer up as well, trying to get my all time average over 95 wpm, almost there
Vegerot: !vimrc
tsAllySparkles: oh that.. yeah
bravech: @tsAllySparkles google it
tsAllySparkles: i saw that
bravech: oh nvm
tsAllySparkles: seems interesting
Vegerot: !r
mutrx: race me @trev0rk911
adibaby04: seems impossible
Vegerot: I give up lol
tsAllySparkles: can't be too hard
itssDK: itssDK subscribed with Twitch Prime.
tsAllySparkles: cv is weird tho
logi6000: @trev0rk911 do you need irl help I can give you some hotline numbers
mutrx: Thanks for the HahaHide @itssdk
tsAllySparkles: just gotta force yourself to learn how to interpolate data like that
tsAllySparkles: what gets me is understanding the scale of the objects on scene
adibaby04: YEAH
adibaby04: like i guess you would have to train a model to understand distances?
yyube_: is he using his local mac in terminal or is he sshd into a linux server?
ne3cross: Local
tsAllySparkles: sounds like some fun digging into openpilot
logi6000: did this guy really just say is he sshd
tsAllySparkles: im excited for my devkit to come
ne3cross: lol
mutrx: gemohots
braininavatt: Jebaited
dunehazard: arch for life
yyube_: what’s wrong with saying sshd?
ne3cross: That’s fair imo
mutrx: https://play.typeracer.com?rt=20ez1kqa8f
logi6000: that's the Damon for ssh
veomx: :D
logi6000: but George is excusing it on a Sunday night
bravech: dang it got 2nd place
mutrx: LUL
logi6000: @bravech for what
bravech: https://play.typeracer.com/?rt=20ez1kqa8f
trev0rk911: @logi6000 no man, like I said I know what a tia overdose feels like. Shakiness, dizziness and dry mouth. I've pushed it more than this before and survived. It brings headaches on but there are other tia addicts out there in taking 3 grams a day, I chat with them everyday on discord, we have are on little personal community, most of us, myself included addicted to opiates throughout our lvies
prakyath_kantharaju: Youtube video is demonetized for sure... LUL
ne3cross: Missing quotes
mutrx: LUL so many of chat are playing typeracer
logi6000:  18553391144 yo here's the drug abuse hotline have these guys on speed dial right next to 911 and probably your dealer
taxad0: what is ur zsh theme sir?
michaelmaier007: is that an imac pro?. or a macbook?.
bravech: tensorflow 3 when
logi6000: George rename backspace ai to pied piper
ne3cross: ne3cross subscribed at Tier 1.
Super_saiyan_3: did u try turning it off and on?
logi6000: George how did you get into coke
krouzux: AOC in 40mins
bankzed: F for Python 2
mufeedvh: F
dunehazard: F
adibaby04: @georgehotz cereal isnt letting me push a branch
logi6000: python 4 tho. semicolon at end
adibaby04: fuk ok
bankzed: We don't need no stinking seicolons
mutrx: @trev0rk911 is from r/ti
bankzed: *semicolon
mutrx: @trev0rk911 is from r/tianeptine
adibaby04: can i have read access
adibaby04: lmao
adibaby04: i jest
logi6000: @bankzed just sounds like something they would do like the print parentheses
braininavatt: lol
mutrx: @georgehotz race me whilst u wait
logi6000: how much longer is stream I got to go to sleep
bankzed: Nah, not as long as Guido is in charge
mufeedvh: it's morning here
adibaby04: @georgehotz once i finish the branch will you merge it?
bankzed: Watch the vod later, lol.
michaelmaier007: @logi6000 prolly 4h left
logi6000: oh great I'll probably fail my unit test tommorow
bankzed: Make a good pull request and he might merge it
logi6000: @trev0rk911 juice wrld
guy_ross: what a weird question.. @trev0rk911
michaelmaier007: @trev0rk911 your questions are creepy &gt;(
logi6000: @michaelmaier007 true
mutrx: f
bravech: oof
searchingforlife: f
mdrake_: dang
moonify: F
lemonboxed: this is webmd chat
bankzed: F
knilecrack: seizure inc
Sim_Ayo: F
JjohnConstantine: F
michaelmaier007: i mean he was pushing the boundaries..
logi6000: ban topic is now medical advice I guess
mutrx: F for a failure in life for doing tianeptine
PiroFloydian: @georgehotz hey im new here. what's your story?
bankzed: HahaHide
ProfessorMagikarp0: nickiG it looks like u have a serious case of banned sir. its terminal
mutrx: @PiroFloydian LUL
P0LY: Kappa
mutrx: LUL LUL LUL LUL LUL LUL
dunehazard: banned
bravech: google him
mutrx: LUL
mutrx: LUL LUL
mutrx: LUL LUL LUL
bravech: maximizing the micro-transportation of butter
mutrx: LUL LUL LUL LUL
mutrx: LUL
Sim_Ayo: why dont you just code an ai that programs this for u instead Kappa
mutrx: LUL LUL
mutrx: LUL
mutrx: LUL LUL
mdrake_: I use that same kind of butter
mutrx: LUL LUL LUL
ProfessorMagikarp0: wow im so inspired now
roystang: wont the butter melt
bravech: bravech subscribed with Twitch Prime.
simmy7: is butter a code word for Coke?
dunehazard: Thanks for the HahaCat @bravech
roystang: woah
lemonboxed: not butter doesnt ever melt
ProfessorMagikarp0: butter is basically plastic LUL
braininavatt: wait what?
logi6000: the coke in the waffle maker
roystang: drugs are bad
mutrx: *checks his watch* no drugs
bankzed: Butter is code for Butter
bravech: HahaHide
PiroFloydian: oh lol i googled him
jadams: ratirlSad
searchingforlife: is your build failing cause of too much drugs
michaelmaier007: plot twist: that guy was fishing us.
braininavatt: george saving lives right there
Sim_Ayo: how can you see with that resolution scaling
bankzed: he had 911 in his name, clearly a cop
michaelmaier007: or whatever you would call it lol.
mutrx: @georgehotz should do the most complicated way to do 'hello world'
coppuh: that's for nixos isn't it lol
mrigor: @georgehotz why tf in c, thought py abstractions is what made it so good or is that only easy on google compute?
michaelmaier007: @bankzed yeah thats what i was thinkink lol :)
bankzed: @mutrx isn't that all code?
bravech: sounds like a pokemon
Sim_Ayo: is it really valuable to take the time to learn vim ?
krouzux: do you use mac at work as well?
mrigor: @Sim_Ayo yes
logi6000: remember the Joe Rogan army
bravech: vim doesn't take that long... use vimtutor
FaustPetrovich: @Sim_Ayo yes
Sim_Ayo: ok will try vim tutor ty
bankzed: vim will get you coding 100x faster, so yeah
mrigor: at least, i'm 200x faster
michaelmaier007: sorry for my f...ed up english. im from germany :(
bankzed: you speak English better than most native speakers, that's what all Germans say tho, weird
logi6000: no English is a fucked up language based off of Latin a language made by absolute dimwits
bravech: it's a carryover from the eternal wwii shame
mutrx: @bankzed @mrigor 0*100 = 0*200 = 0
michaelmaier007: i wrote "thinkink" instead of "thinking" lol
logi6000: I got to go to bed soon how much longer or should I go to bed
FaustPetrovich: @bankzed but coding in nano makes you 1000x times faster programmer dude
bravech: sleep is important don't stay up watching george program instead of sleeping
mutrx: notepad is how you get into the 9999x
mrigor: vim ai codes for you
FaustPetrovich: paper and pen oh don't even let me start it
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI
krouzux: !uptime
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI watch before AOC
bankzed: with that same logic, coding in ed will make you 10000000x faster
mutrx: @bankzed ed?
logi6000: I got to go to sleep its been fun. stay in school and don't take opioids.
mutrx: @logi6000 wise words
bankzed: 'man ed'
raidersans: good morning from the EU and happy upcoming holidays
mutrx: mutrx subscribed at Tier 1.
michaelmaier007: its not even the 16th of december there yet.
michaelmaier007: we live in the future xD
FaustPetrovich: coding in your imagination makes you → ∞
FaustPetrovich: faster
FaustPetrovich: at programming guys
btastical: yea its monday morning in germany rn
mrigor: @georgehotz would a prebuilt docker of tf version make this easier?
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI watch before AOC
mutrx: u missed my sub :(
BiTvon: @btastical Isn’t it still night basically
bravech: man I would hate for it to be monday
bravech: adderal = practice ?
btastical: @BiTvon some people are already up and working, early morning is more fitting, yes
michaelmaier007: @bravech youre not far away xD
alonkaliber: Do we love Elon Musk ?
BiTvon: Man people up and working at 5:45 am
bravech: do _you_ love elon musk?
FaustPetrovich: @mutrx at 2:10 -&gt; hhkb with mx green wtf this video is cursed
peter35_: i like his rockets :)
ProfessorMagikarp0: this channel needs a KappaPride Elon Musk emote or a weed smoking Elon emote for subs LUL
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI watch before AOC
peter35_: launch today btw
mutrx: im a sub now
bravech: lmao sub request
alonkaliber: George did u eat pasta today..
bankzed: Da faq did i just watch? It was more psycho than the movie scene they were parodying
btastical: @BiTvon i'll leave at 6:30 aswell, but I couldn't sleep, so starting early = going home early
bravech: I've gotta think about that for a bit
mutrx: @FaustPetrovich yeah a bit cursed
raidersans: wait, subs get a free request ?
FaustPetrovich: my sub request is "make me immortal"
FaustPetrovich: "pls"
Vjasal: baiting for subs and donation smh
mutrx: my sub request is to have big p
BiTvon: @btastical Yeah I hear ya, I’m an insomniac European too
mrigor: https://hub.docker.com/r/tensorflow/tensorflow/tags?page=1&amp;name=2. has 2 with gpu
bankzed: I wanna use my sub request to deny his sub request, that video was soul crushing
mutrx: my sub request is to have big pp
alonkaliber: @georgehotz maybe run a docker with TF installed alreday
braininavatt: Kappa
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI watch before AOC
peter35_: LUL
mutrx: :(
BiTvon: Stop
bravech: sub request: is there a future in software defined radio and should I get into it (have an opportunity)
bravech: @georgehotz
mutrx: my sub request what keyboard is that LUL
bankzed: try shift p it will give you P
Vjasal: https://www.youtube.com/watch?v=z-zxaKQfW6s @mutrx watch
peter35_: you have big p in another branch of the multiverse buddy
mutrx: @Vjasal baited
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI watch before AOC
tsAllySparkles: so the ai models run off android?
BiTvon: Big pp
mutrx: only rick and morty fans can understand
bravech: 15 mins to AOC
Vjasal: pp max
mutrx: is there an infographic to get big pp :(
braininavatt: pp up
michaelmaier007: currently eating pringles at 05:44 AM... fml
bankzed: they guys in that vid look like the worst people in South Park, SoMA
mrigor: @bravech where
btastical: so whats worse, handling multiple libraries, versions, and compiling or node_modules LUL
raidersans: it's really good
bankzed: s/they/the
BiTvon: Feelsbad when you can’t fix small pp with big pp
bankzed: I've had food at saison, it was meh
ProfessorMagikarp0: big pp is a state of mind nickiG
mrigor: chrome PIP extension is awesome https://chrome.google.com/webstore/detail/picture-in-picture-extens/hkgfoiooedgoejojocmhlaklaeopbecg?hl=en
BiTvon: @professormagikarp0 🤔
bankzed: Programming is only done in silicon valley Kappa
FaustPetrovich: @georgehotz can I make sub request?
tsAllySparkles: how did they kill defcon?
BiTvon: Isn’t internet produced and run in Silicon Valley
esence: SHOW US YOUR KEYBOARD!!!!!!!!!!!!!
btastical: what do you mean they killed defcon?
bravech: by attending it
mutrx: not even watching the vid :(
simmy7: @mrigor thank you for that, that's amazing
Jeppelelle: how did they kill defcon?
Vjasal: so anyway, what keyboards d oyou guys use
tsAllySparkles: i went to defcon.. did i kill it?
bankzed: obviously, @georgehotz Kappa = sarcasm
knilecrack: looks like it
BiTvon: He’s watching bro didn’t you hear him react earlier Kappa
PiroFloydian: @georgehotz did you always code in terminal or were you an ide person at some point? when/why did you switch?
mrigor: IDE is for plebs
ProfessorMagikarp0: its funny but not worth spamming the link 50 times LUL
mutrx: @BiTvon wot
PapaDukie: what is aoc
bankzed: why do they all look like product managers
jax05_: I remember being a n00b asking about keyboards and what ide to use LUL
FaustPetrovich: @georgehotz can I make sub request?
esence: Any success on running CARLA on macOS?
bravech: can we ban ide and keyboard talk
BiTvon: A good keyboard makes good code right?
bankzed: pardon my ignorance but what's AOC?
BiTvon: I want to make this app so
btastical: advent of code
bankzed: besides Alexandria ocasio-cortez
jax05_: I just realized you're talking about advent of code
peter35_: sorry ocasia cortez, the only AOC in my heart is #adventocode
mrigor: @esence hes ssh'd into a linux box
michaelmaier007: "dedotated wam"
Beraton: !uptime
zEveery: Sometimes it's showing TITAN X and some times Titan V. idk if means something
BiTvon: That poor kid doesn’t deserve that stuff
bankzed: Gentrifying AOC, I see Kappa
MrRobotVPN: just stumbled onto a archive video he did a live stream on youtube and saw his twitch link. Dude getohot is my idol. This is so cool I ant to get my CompTIA plus up here in canada and then go to college to get my C.I.T later.
mutrx: MrRobotVPN xd
BiTvon: Way you have a titan v?
bankzed: but he dropped out of college, lol
mrigor: @MrRobotVPN this stream is ai generated
esence: I love MrRobot. :&gt;
MrRobotVPN: ai generated xD
bravech: the only big p is on PPP
MrRobotVPN: was just learning node-modules this month so this is really cool. was doing discord.js
mutrx: how old r u @MrRobotVPN
ProfessorMagikarp0: Kreygasm
esence: if you haven't dropped out, you will never make it
BiTvon: Dropped out of college but living in a 6K a month apartment
MrRobotVPN: in my 20's
BiTvon: Hey I’m in my 20s too
BiTvon: High five
mutrx: orange man won't get impeached
bankzed: wow, that's some fat pipes. In SD? or SF?
esence: orange man will happen the 2nd time
esence: you heard it here first
BiTvon: You’re telling me we can’t talk about keyboards but orange man and AOC is a ok
MrRobotVPN: yeah its a great show. wonder if geohot enjoys it Ramei Malek and Christan Slater are awesome.
bravech: invest now orange man pumping markets to get reelected
abstracticism: So what's going on here?
esence: @georgehotz , thoughts on Mr. Robot?
mutrx: advent of code
BiTvon: orange man will keep the stable but only cuz the field is weaker than my fathers knees
ProfessorMagikarp0: 9tails weeb rap needed Kreygasm
abstracticism: Yeah but what is he actually doing. Also lol this song
esence: try it, it's pretty good
bravech: mr robot season 1 was good the others were shit
michaelmaier007: try linkin park you will love it!!!!!!!
esence: cheesy, but good
BiTvon: Weebs out DansGame
moonify: You should try Mr Robot 9.5/10
mrigor: @georgehotz did you see PIP extension?
MrRobotVPN: yeah season 1 was the best first episode my favorite
BiTvon: Pp extension
vloood: these streams are great, i work at the same time and get shit done
bravech: ^^
esence: chat, let's bless geo, we gotta take 1st place in the competition!
bankzed: Moved out of bay area cuz of $6k apt. Now I pay $600 in Shenzhen
MrRobotVPN: geohots rap was the shit he needs to do another one.
BiTvon: @bankzed Damn
mrigor: @bankzed remote jobs pay less
bravech: that's a big move
giacpolish: George have you ever thought to stop with programming?
directrix13: Are you setting up Carla for automated testing of OpenPilot?
BiTvon: @bankzed Does the government check in on your morals
mutrx: https://www.youtube.com/watch?v=9iUvuaChDEg yikes @georgehotz
BiTvon: Imagine streaming your speakers through your mic
esence: raw stream
zEveery: https://github.com/migueldeicaza/TensorFlowSharp/issues/54 @georgehotz
hofergabriel: Why do number jokes not work in Octal? Because 7 10 11!
BiTvon: Raw shit dawg
michaelmaier007: https://youtu.be/kXYiU_JCYtU
bankzed: As far as Mr. Robot, boycotted it cuz the snitch from lulzsec works for the show
krouzux: can george get top 5 tonight?
esence: good luck!
braininavatt: glhf
AlexEDM: yowza
esence: 10!!!!!!!!!!!!
BiTvon: @bankzed Context?
raidersans: HYPE
risky_banana: actually hyped
moonify: you got it
esence: 5!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
J3rwin: lol
mutrx: oooooooooooooooo
esence: GO
sirleeroyjenkins: he def just snorted some coke
BiTvon: I saw the snort
abstracticism: he snorted code happiness
raidersans: 10 push ups when
abstracticism: do 20 pushups every 30m @georgehotz
BiTvon: If he wins he can self congratulate with more coke
MrRobotVPN: I love linux. Kali Liniux just had a new update
michaelmaier007: @sirleeroyjenkins coca cola you mean right?. shhhhh
BiTvon: Kappa HahaShrugRight
berghyfps: Hi all
mutrx: @MrRobotVPN do u program at all?
BiTvon: Hi bergy
mutrx: hi
michaelmaier007: f... need to prepare for school now. it was fun while it lasted.
BiTvon: Don’t you guys have pHoNeS?
death_gadget: Sounds like matrix/vector multiplication
MrRobotVPN: yeah did some C   made a highscores database lookup when I was 13 for a MMORPG and tried acitonscript 2.0 to make a game because I was dumb. so now Ive been learning C# touched on java a bit and screwing with python
BiTvon: Acitone script sounds appropriate
J3rwin: how tf did someone already complete this
BiTvon: Come on George u got this
MrRobotVPN: yeah Im lost to. if anyone can do its george.
ummyeah1929: man i wish i could use vim like this
grey_street: Pog
borang: *clap*
alonkaliber: he = genuis LUL
ziggyzergling: PogChamp
braininavatt: SeemsGood
michaelmaier007: ANELE
berghyfps: @ummyeah1929 Me too. I'm a vim noob, tryna learn it so I can be like george one day
BiTvon: The fuck
alonkaliber: There are crazy good programmers in this world huh.. to think 30 people had already finished it before him
jax05_: @alonkaliber right?? lol
ummyeah1929: @berghyfps usually just use nano but seeing someone quick with vim is really impressive and looks like itd save lots of time
mutrx: should have written it in go
btastical: the first problem was not too hard if you think about it
MrRobotVPN: my internet is shit hope I can watch this later in clips or someone archives it.
alonkaliber: @jax05_ for real
michaelmaier007: @mrrobotvpn he posts his streams on yt later.
alonkaliber: Now were optimizing the program..
adibaby04: the hell happened
adibaby04: last i checked we were doing openpilot
ummyeah1929: meme o ize Pog
michaelmaier007: goodbye guys school time :(
mutrx: ew memoization
KNOOKEL_HEAD: meme o ize
ummyeah1929: meme o ize just for efficiency?
abhb09: What is carla?
jax05_: @MrRobotVPN did you lower resolution?
jax05_: @adibaby04 he's doing advent of code
Waywoah: What's the goal of this problem?
mag_m3m0ry: it's Monday morning. should I go to work or watch this?
MrMcaustin1: ALways watch george
mag_m3m0ry: facts
jax05_: @mag_m3m0ry watch geo :)
mutrx: what are the first 8 digits
MrMcaustin1: numpy matrix?
jax05_: monkaS
mutrx: @mods
death_gadget: 🔨
mutrx: @mods
jax05_: the mods can't hear you now :)
mutrx: AOC
MrMcaustin1: All the timeouts
MrMcaustin1: Ha
MrMcaustin1: Was setting up tmux
krouzux: gottem
lemonboxed: when im ded bury me in fractions
MrMcaustin1: You should know better
ProfessorMagikarp0: who just Thanos'd the chat LUL
jax05_: ok thanos LUL
ProfessorMagikarp0: i dont feel so good mods
ProfessorMagikarp0: *turns to dust*
MrMcaustin1: 4 timeouts
MrMcaustin1: oof
Emmaralds: what is advent of code?
MrMcaustin1: They can talk in 10 minutes
mutrx: google
PiroFloydian: can he not use numpy
MrMcaustin1: Emmaralds its a coding competition of sorts
death_gadget: 🔨 🔨 🔨 🔨 🔨
MrMcaustin1: He can, hes just laazy PiroFloydian
RishabhDeepSingh: pajaHey_HF pajaHey_HF pajaHey_HF
PiroFloydian: oh lol
J3rwin: doesn't tourist compete in these
MrMcaustin1: Lowkey miss my mac, do I dual boot linux?
jax05_: go for it MrMcaustin1
Eastonn: what mouse is he using Kappa
attiluh: Kappa
MrMcaustin1: Eastonn you sneaky bastard
Eastonn: got eem
TeaLeafi: the great Geo &lt;3
Eastonn: if i ask noob questions is that bannable or is that ok
MrMcaustin1: You can ask
Eastonn: what language is this?
attiluh: Python
zEveery: python
Eastonn: NotLikeThis
paulfreeman: english
jax05_: PogChamp
MrMcaustin1: mutrx really?
braininavatt: Clap
braininavatt: LUL
PiroFloydian: what (if any) is learning curve like switching from using ides to terminal/vi/etc?
death_gadget: LUL
attiluh: Pepega @mutrx
ProfessorMagikarp0: nickiGun
ProfessorMagikarp0: mutrx spam
maverick_twitch_: so fast
attiluh: @pirofloydian Use Nano
attiluh: :)
death_gadget: @PiroFloydian Are you talking about auto-complete? There isn't that much learning curve IMO.
Eastonn: LUL
braininavatt: F
mutrx: wow ok
Eastonn: LUL LUL LUL
braininavatt: hahahaaa
MrMcaustin1: Alright mutrx you done
mutrx: :(
braininavatt: you had one chance
zEveery: gcd only returns positive int.
ProfessorMagikarp0: HahaCat
ethancruize: when CTF/hacking again?
mutrx: i think memoization was the way to go
mutrx: i lost Kreygasm
postalrat: memeization?
mutrx: if you memoize the first signal, and then the repeats can be computed O(1)
MrMcaustin1: memorization or caching?
Eastonn: is he solving a problem right now from a website or something?
J3rwin: advent of code
MrMcaustin1: https://adventofcode.com
SilvanoGJr: looks like adventofcode . com
mutrx: if you memoize the first signal, and then the repeats can be computed O(1)
TinksFn: hey
MrMcaustin1: Yeah mutrx he should do that
TinksFn: i need help with my javascript bug
MrMcaustin1: But I think hes in his own world rn
TinksFn: can anyone help me
mutrx: yeah he's too focused to read chat @mrigor
PiroFloydian: @death_gadget basically i dont do much in the terminal and mostly use ides and was wondering what the switching process was like/why people do/dont do it
mutrx: @MrMcaustin1
GCOutwitt: GCOutwitt subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 1 month streak! Appreciate everything you've done since the first iPhone back in the day
TinksFn: help
MrMcaustin1: GCOutwitt welcome!
JohnEGQ: JohnEGQ subscribed with Twitch Prime. They've subscribed for 3 months, currently on a 1 month streak!
MrMcaustin1: JohnEGQ welcome back!
mutrx: @PiroFloydian its really just a personal preference, doesn't make u any better. people do it for less "distractions"
mutrx: and its a steep learning curve
iammimilolo: What is your IQ?
Eastonn: big brain 5Head
bankzed: This looks like a problem to solve with convolution, maybe the FFT is a hint
mutrx: at least 5
alonkaliber: George = LUL
devicerailway845: "Science &amp; Technology" is a more active category than "basic programming" for this
ProfessorMagikarp0: u dont want "Science &amp; Technology" normies tho DansGame
mutrx: @ProfessorMagikarp0 gets it
Eastonn: TRUE DansGame
mufeedvh: yeah
red123123: Hi HumbleLife
bankzed: You were in the right direction with matrix math, I made a matrix of the input and the pattern and doing multiplication of the two
alonkaliber: @bankzed did you solve the problem..?
red123123: !time
mufeedvh: i have math exam tomorrow
ImJ4Gu4R: How many hour now?
TDxSK8: he's been love for 4 hours
TDxSK8: *live
ImJ4Gu4R: Alright @TDxSK8 Thanks.
bankzed: I used i^n to generate the shifting pattern
bankzed: i being sqrt(-1)
bankzed: Well and  1
mufeedvh: what is he trying to solve with this script? @bankzed
bankzed: https://adventofcode.com/2019/day/16
MrMcaustin1: Advent of Code day 15 pt. 2 mufeedvh
mascer95: @mufeedvh I guess the newest coding challenge on advent of code
bravech: Lolf
TDxSK8: was about to say lol
ProfessorMagikarp0: how do people know to ask that first like 99% of the time LUL
mufeedvh: Thank You, got it
mascer95: @parogen it’s a forbidden question. Can’t find the rules though
TDxSK8: yes
adibaby04: @georgehotz for cereal, when a new message is being made, is it by default a CarEvent? Im trying to add documentation
mascer95: @parogen ohh yeah says in the info box do not ask about keyboard
MrMcaustin1: mascer95 dont mention the k word ;)
adibaby04: yo @georgehotz kinda important
mascer95: @mrmcaustin1 alright
bravech: Or talk about drugs
bravech: F
mutrx: memoization
mascer95: @bravech yesterday George was talking about it pretty openly
ThePotatoProgrammer: Time to just start over
mutrx: time to sudo rm -rf *
ProfessorMagikarp0: need to train under a waterfall for clarity nickiG
mascer95: @mrmcaustin1 how often do you stream?
MrMcaustin1: Me? Not that much
mascer95: @mrmcaustin1 alright, was just curious!
MrMcaustin1: no worries
bankzed: Yeah, it's like convolution of the input with the output, eventually it will converge (all zeros)
ONEabdo: Hi georgehotz
ONEabdo: how you doing ?
Waywoah: Has anyone else solved it yet?
zEveery: 78 peoples
mascer95: Are there any tips on doing AoC? I only started coding a month ago and did a Codecademy Course which I feel like only helped understanding the basics. Do I work with Stackoverflow and just google? Or better follow tutorials?
bankzed: yeah, made mine 2x faster by not doing the math on the zeros inputs and zero phase patterns
MrMcaustin1: mascer95 you will never know everything with programming its an always evolving thing
MrMcaustin1: Just do stuff
MrMcaustin1: Do the codes
mascer95: @mrmcaustin1 first day was pretty good! had to figure out how to work with an ide, because codecademy has an online interpreter. Second day is tough already :)
bankzed: you can do element wise multiplication and addition, that's what I did
MrMcaustin1: Haha mascer95 I remember when I was that way. Just sit down and anytime you are confused just google it
bankzed: https://www.geeksforgeeks.org/matrix-manipulation-python/
MrMcaustin1: bankzed hes not really looking at chat
mascer95: I was about to say the same! He doesn’t want help he said :D
mascer95: @mrmcaustin1 yeah Google is really helpful in that sense! Thanks for the advice!
MrMcaustin1: Of course
alonkaliber: How many people finished the challenge already ?
zEveery: use CUDA to run it, profit
MrMcaustin1: If you have any questions just DM me
bankzed: He said he gave up, lol.
zEveery: Kappa
alonkaliber: @bankzed did u finish the challenge...?
mascer95: @alonkaliber I believe someone said 78 before
alonkaliber: @mascer95 i see
imfunniee: *thonk intensifies*
bankzed: I haven't submitted it yet, I'm doing optimizations
mutrx: LUL
TheArc_TV: what is carla?
adibaby04: use a fourier transform to multiply LUL
tsAllySparkles: i got a 2019 kia forte... and i bought a devkit.. hopefully it'll integrate well fingers crossed
MrMcaustin1: George dont forget to change the stream name
MrMcaustin1: *title
tsAllySparkles: but if not i'll make it work :D
archeadis: use numpy and pypy
mutrx: why aren't u memoizing
mrmusicmaine: Just popped back in. This ain’t Carla tho, I can’t see the url.. what’s the challenge?
imfunniee: advent
alonkaliber: I think it is a matrix..
ImJ4Gu4R: Yea, carla is done?
adibaby04: wait just do it in C the performance should improve a bit?
mascer95: @mrmusicmaine Advent of Code 2019 Day 16
mutrx: @adibaby04 LUL
adibaby04: i mean complexity rn is O(n^2) but it could be a faster O(n^2)
mutrx: @johnnyhammastix @adibaby04 or @georgehotz
MrMcaustin1: Which guy johnnyhammastix
mrmusicmaine: Fire
P0LY: monkaS
adibaby04: wym i cant code
adibaby04: ah
MrMcaustin1: johnnyhammastix lets be nice
alonkaliber: @johnnyhammastix be nice cmonBruh
MrMcaustin1: and goodbye
alonkaliber: LUL
mutrx: someone's having a bad day
imfunniee: *life
P0LY: evo19MindBlown artoSmooth
mutrx: he said you couldn't code
mutrx: LUL
alonkaliber: He said you coded bad..
MrMcaustin1: He said that a gorilla can code better than you
veomx: he ask about your keyboard
ONEabdo: Xd
ThePotatoProgrammer: lol
ImJ4Gu4R: PogChamp
polysoulz: hey hey BCWarrior
zup_zup: what leaderboard?
zup_zup: oh advent
mutrx: he gave up LUL
ThePotatoProgrammer: there is a stripe of diagonal ones in the printout
mutrx: not the zeros
red_plex: hey just joining, what are you trying to do with Carla ? RL ?
ThePotatoProgrammer: linear algebra upper triangle rule looks like
TheArc_TV: Convolution Theorem :puke:
TheArc_TV: My professor hit the whole class with a Convolution Theorem from a challenge project on one of our exams
alonkaliber: @georgehotz do you love mathematics?
C4TFive: Why is the light from your screen so yellow? are you using F.Lux?
MrMcaustin1: C4TFive yeah he is using flux
MrSnoopDog: this is pretty cool
PiroFloydian: why not abs and mod
lemonboxed: is this day 16
MrMcaustin1: yes
alonkaliber: This is actually really hard huh...
zEveery: As I'm looking u can use FFT (Fast Fourier Transform).
adibaby04: use the strassen algorithm right?
hoopchamp: get all of the eigenvalues. wont help, but at least you'll have the eigenvalues
VanityShowcase: I like your github profile picture
adibaby04: who?
鼻史: list comprehension PogChamp
TheArc_TV: Pog
zup_zup: oh cool i didn't know you founded comma.ai
ThePotatoProgrammer: What happens if you invert the matrix?
adibaby04: why would you invert it?
ThePotatoProgrammer: Just to see what happens :)
alonkaliber: is this largeee machine his working on, is vagrant box ?
kkkizune: he dead?
mufeedvh: whats on the floor?
ThePotatoProgrammer: That is the armrest lol
BWalks530: are you computing every value in the matrix or just the top triangle?
nikhilr14: !uptime
ThePotatoProgrammer: LOOOOOL
mufeedvh: lol
ThePotatoProgrammer: monkaS
MrMcaustin1: gottem
nikhilr14: lets go he's streaming
ViktorTV: @georgehotz what is the goal? also this looks like upper triangular matrix so maybe it's something with that
adibaby04: fill us in maybe we can help
georgehotz: https://adventofcode.com/2019/day/16
bankzed: Machine learning?
adibaby04: what??
alonkaliber: @georgehotz the guys who solved this are most mathematicians aswell i assume
adibaby04: how is this machine learning?
FoxMcWeezer: How good are your probability and stats skills @georgehotz
MrMcaustin1: Look at the subrededit
MrMcaustin1: https://www.reddit.com/r/adventofcode/
C4TFive: Isnt this Basic Programming? Kappa
nikhilr14: isnt he doing carla ?
MrMcaustin1: @georgehotz the output back half is just the reverse partial sums of the input back half.
adibaby04: Because the input string is repeated 10000 times, and the pattern also repeats, can't you just compute the answer for a portion of the input string, and then use multiplication to remove the bulk of the work?
MrMcaustin1: For part 2, someone used partial sums to compute contiguous sums, and then multiplied those sums by 0, 1 or -1 accordingly. For the first position, you have to compute N sums, then N/2, then N/3 and so on. So overall complexity should be N * (1   1/2   ...) = N * log(N), since the harmonic series converges to logarithm.
bankzed: used SciPi to convert to sparse matrix, by chopping out all the zeroes
bankzed: *SciPy
lemonboxed: like a factorization of some sort
MrMcaustin1: @georgehotz partial sums
MrMcaustin1: And its a Unitriangular matrix
Eorphor: doesnt it look like time shifted oscillating sequence? Maybe there is a clever way to build it
ViktorTV: @mrmcaustin1 I told him that alrey
MrMcaustin1: Yeah hes hyper focused
nikhilr14: https://www.reddit.com/r/adventofcode/comments/ebai4g/2019_day_16_solutions/
adibaby04: the latter half condition
qlutoo: I just joined but is this not just computing A^n * x where A is a matrix and x is a vector. With n large you can do repeated squaring to quickly calculate A^n in O(log n)
qlutoo: Ah nvm
lemonboxed: theres a reason why 90% of mathematicians have wacky hairstyles
Stevein: toes? yuck
ViktorTV: @georgehotz LOOK UP MATRIX DIAGONALIZATION
adibaby04: @georgehotz the latter half condition makes it more effecient
alonkaliber: @georgehotz think cutting the matrix
alonkaliber: if you want @georgehotz https://www.reddit.com/r/adventofcode/comments/ebai4g/2019_day_16_solutions/
BiTvon: This puzzle kind of owned you
Particle_x: duhleeNani duhleeNani
BiTvon: Keep in mind I have no idea how do it either but still
MrMcaustin1: Just look up the solutions
Stevein: dream of a solution
CaptCalifornia: holy fuck ur still working
Eorphor: Ok what I think but it’s probably wrong. If you know the size of the final matrix, you know the sequence is designated to the needed line. At the end do you need to compute the whole matrix. Line gives you the « repeating pattern » if line 3 its 2 zeros, then 3 ones, 3 zeros, 3 minus ones etc.. IDK if it’s possible ..
lemmywemmy: the only thing that sticks out to me is that the matrix isn't green
alonkaliber: @georgehotz let me tell you this, part2 can run in 2 seconds..
ViktorTV: @georgehotz YES LETS DREAM OF THE CODE. LIKE THAT ONE MAGE SMART KID THAT DREAMS IN CODE. Kappa
adibaby04: https://www.youtube.com/watch?v=DBXZWB_dNsw&amp;t=273s
adibaby04: ^^^
adibaby04: dream in code
alonkaliber: Many interesting solutions
ViktorTV: yup @adibaby04 such a fucking fake video lmao
BiTvon: I think it’s a reference to the pop culture version of matrix movies and all
adibaby04: IKR
alonkaliber: @georgehotz The key observation for part 2 is that if your sequence has length n and you want to compute the value of the next phase at index i with i &gt; n/2, then it's just the sum of all of the elements with index at least i. Therefore, we only need to compute the sequence for indices higher than the given offset at every phase, and we can do so in linear time.
adibaby04: YES
adibaby04: NO SHIT GEORGE
zEveery: This is an upper unitriangular, and all triangular part is one (upper side) cuz we never reach the 3st 0 from pattern base. I think if u just use the submatrix adding from the N term till the end, u get the new term.
Abnico: hi
alonkaliber: @georgehotz you had that...
MrMcaustin1: Its okay george you are still smarter than us
vay_man: hi from India...
ViktorTV: go back to India
ViktorTV: xqcEZ xqcEZ xqcEZ xqcEZ
indaylancer: SoBayed
lemonboxed: scam puzzle
lemonboxed: doink
zup_zup: do you just use default vim?
adibaby04: no dude
adibaby04: its clearly not
TheArc_TV: does anyone know a good resource to improve using linux, ubuntu specifically
TheArc_TV: my workstation at school is linux and i feel like a snail
ViktorTV: I have a resource @thearc_tv
TheArc_TV: Kappa incoming
TheArc_TV: i dont trust u
ViktorTV: I mean it is kinda a Kappa but I was going to be an asshole and say using it is a good resource
ViktorTV: buy there is truth in that
braininavatt: Jebaited
P0LY: LUL
lemmywemmy: maxwel11KKona
MrMcaustin1: hahaha
tsAllySparkles: question- these LKAS systems are all pretty standardized between car brands??
tsAllySparkles: who makes them?
indaylancer: SoBayed
vay_man: @TheArc_TV linux is the best resourse for linux..
lemonboxed: real puzzles are hard to make
alonkaliber: @georgehotz they wanted to make people tyhink extra extra hard, but in reallity solution was way easier i guess.
lemonboxed: easier to scam
RishabhDeepSingh: pajaHandsUp_SG pajaHandsUp_SG pajaHandsUp_SG
BiTvon: 😆
Particle_x: elite5Gachi
vay_man: whats going on?
WoockieCookiee: Hello from Spain George, 7 am here
red123123: !uptime
zEveery: https://www.reddit.com/r/adventofcode/comments/ebai4g/2019_day_16_solutions/fb3ksil/ linear time
ViktorTV: @georgehotz how to get job at Google?
vay_man: solve such probs better than others
lemonboxed: cumsum ?
BiTvon: Lmao
vay_man: lul
ViktorTV: @vay_man that was an obvious joke but do you seriously think this is at all relevant to actual coding?
vay_man: what do you think actual coding is?
sanaki13: ofc it isnt, but thats how you get a job at Google lmao
ViktorTV: how will this help me get a job at Google? do they offer it to winners or something
sanaki13: they ask algorithmic puzzle questions in their job interviews, like almost everywhere else
vay_man: google don't need coders they need problem solvers
BiTvon: Google is evil anyway
ArcherCreatlol: ^ Truee
ViktorTV: yes, general algorithmic questions, not some specific shit like this
MrMcaustin1: Normally for programming interviews they focus on the way which you solve the problem and then your coding skills
vay_man: yes
vay_man: they just want you to solve everything in linear time
vay_man: or less
MrMcaustin1: Not always
lemonboxed: google doesn't really need anything
lemonboxed: they already have it all
lua_320: Google is a piece of shit
borang: classmate just got hired
alonkaliber: They're at a point this just fuck B1tchs
vay_man: google is dope
vay_man: wahts he solving anyways. I came late
MrMcaustin1: Advent of Code
vay_man: ?
MrMcaustin1: https://adventofcode.com/2019/about vay_man
vay_man: got it bro
MrMcaustin1: Do you have any type of caching implemented?
iamreclusive: @georgehotz Thank you very much, 'geohotz'; from an old-school user of a Jail-Broken iPhone 1 (1.1.1). :)
MrMcaustin1: Or would any work in this case?
BiTvon: Woah woah that’s illegal tutorials
JonThomasK: your not hired
BiTvon: Thank you for coming in
vay_man: nope...this is purely how you reduce time complexity
bankzed: O( n log n)
vay_man: its brilliant
vay_man: I mean anyone can do it using brute force,, but thats not the point
BiTvon: If you wanna win brute force is cool though 😎
bankzed: You can do a conv of the signal and the pattern (DFT) but also have to take into consideration of the special cases
Knarez: the harmonic series diverges Kappa
vay_man: @bankzed those were my initial thoughts
mikey9988: mutrx in the dms LUL
mufeedvh: cool stuff
BiTvon: Lmao
BiTvon: Good work George
MrMcaustin1: GG
vay_man: Ik
ziggyzergling: being not a noob
ArcherCreatlol: PogChamp
zEveery: GG, take a drink to celebrate
jay_al97: did you get Carla to work
BiTvon: Can you read mutrx message on stream
mufeedvh: da best
vay_man: thats easy for you to say
BiTvon: Before you go
mikey9988: Ahead of Curve EZ Clap
bankzed: It was a BS problem due to the special case
vay_man: number 1
BiTvon: Nothing disregard, disawow
zEveery: wow I can see some WoW player here
mikey9988: LUL
MrMcaustin1: cmu = Carnegie Mellon University
MrMcaustin1: ?
bankzed: Any RIT?
bankzed: lol
toolegit2quit_: Is CMU worth it ?
MrMcaustin1: Ha almost applied to go there
mikey9988: are melons tasty?
peter35_: any cornelll?
MrMcaustin1: Dont have the grades tho and dont care
MrMcaustin1: You can click there name to see who they are
zEveery: You have an strong math base or just the basics? Also u find it really important for commercial development
zEveery: ? *
Knarez: what did you leave for
jay_al97: why did you leave
Knarez: LUL CLASSIC
lemonboxed: grills
bankzed: Haha, I use to sit in CMU classes while I was at RIT when I was at a Co-op in Pittsburgh, why I dropped out of RIT
vay_man: to work for google
toolegit2quit_: Scholarship?
Eastonn: HotPokket U BETTER NOT
Eastonn: Kappa
lemonboxed: so second time was also grills
lemonboxed: in politics
BiTvon: Leaving for a girl uh oh
MrMcaustin1: Update your wikipedia to update why you left
KNOOKEL_HEAD: i dropped out of elementary and now im a billionaire
mikey9988: didn't allow him to liberally use the N word cmonBruh
montecarlo: three semesters??
BiTvon: Politics ruining another young mans dream
zackartz: zackartz subscribed with Twitch Prime.
Eastonn: doctrine
KNOOKEL_HEAD: just hackthebox 4Head
montecarlo: 5Head
BiTvon: Ahh yes
montecarlo: e.g. ?
vay_man: dogma.
Eastonn: not doctrine but a certain type of thinking only?
jay_al97: SA college
BiTvon: The communist dogma Kappa
KNOOKEL_HEAD: LUL
montecarlo: KEKW
bankzed: RIT has jumped the shark for sure
mikey9988: PepeHands
lemonboxed: too many students playing the game in uni
zEveery: It almost like feel. I do CS, I really like the math things and everything I'm learning about complexity, compilers... But sometimes I feel like it's pushing me away from market. There's a lot of old techs on university.
MrMcaustin1: I am currently in college on the west coast and theres so many reasons to hate it and love it
vay_man: did you create a site to rate hotness of girls ?
picklesareok: i could learn everything i have learned in school from better resources for free
picklesareok: im paying for social credit
BiTvon: @vay_man lmao
Eastonn: @vay_man LUL GOOD ONE
MrMcaustin1: But I am at a very research based college
BiTvon: That’s fucking hilarious
brevan04: Good morning Geo. 1:30 in Omaha
red123123: perfect
KNOOKEL_HEAD: 8:30AM in eu
Anionz: ps5 coming out soon geohot, time to dust off the old lawsuit?
tornpaperyoyos: !uptime
vay_man: 1 pm in India
BiTvon: College tried to Box him out of jail breaking :/
zEveery: Anionz question hahahah
vay_man: me
mufeedvh: me
montecarlo: me :)
KNOOKEL_HEAD: people that arent n00bs
red123123: 10.30 am turkey hi
vay_man: I think I found
BiTvon: Me also
Hunted9000: o/
mutrx: im back
vay_man: the truth
tornpaperyoyos: how long has george been streaming?
mutrx: oh did he solve part 2/
montecarlo: yes i found it
MrMcaustin1: The quest for the truth is hard but it gets side tracked by like whats the point of snails
Waywoah: What do you mean by truth?
vay_man: its disturbing
mutrx: hahah how painfully
lemonboxed: truth seekers are always noobs
TinksFn: hey
TinksFn: what were you coding
mutrx: what did you end up doing
red123123: which days do you open
montecarlo: advent of code
lemonboxed: scam problems teach you alot about life
BiTvon: Life is a scam
BiTvon: So the puzzles follow suit
TinksFn: what os advent of code
mutrx: love these end of stream rants
montecarlo: @TinksFn https://adventofcode.com/2019/
Knarez: what would you say happened to it
TinksFn: i dont underestand the website
vay_man: what happennthen?
montecarlo: daily coding puzzles thats all
TinksFn: ohhh
tornpaperyoyos: @georgehotz show us some of your advent of code solutions plz
brevan04: Google founders are gone now, for the better?
montecarlo: implicit association? whats the purpose?
Iliftmymousealot: Iliftmymousealot subscribed with Twitch Prime. They've subscribed for 9 months! that Google Businessmodel though, high Hacking brains
Eastonn: is it a so called bias test?
gary_burton: those tests are BS
bankzed: It's way worse here in Shenzhen, the scam is larger.
zEveery: Thanks for the HahaCat @iliftmymousealot
BiTvon: 🤔 🤔
Hunted9000: Cheer100
BiTvon: ... based?
Eastonn: @georgehotz there is so many factors not taken into consideration with those implicit bias tests
iv4nhoe: @georgehotz back on Twitch I see HeyGuys
TheCellarDoor: @georgehotz
mutrx: orange man bad
lemonboxed: if google isnt running google who is ?? dun dun dun
picklesareok: it feels impossible to escape
zEveery: I saw yesterday u master some languages.. How u master languages ? Doing puzzles and looking for documentation? Actually I kinda struggle to learn a new language (I mean, masterize it. Start knowing the tricks.)
gary_burton: it's important to a faction of managment, it's about power battles between factions
brisingr1031: ratirlRich ratirlRich ratirlRich
picklesareok: LUL
mutrx: someone needs to wipe the server
georgehotz: https://www.scottaaronson.com/blog/?p=3376
mikey9988: factions monkaS
MrMcaustin1: Lets talk about amazon now. How they have literally taken over everything
innocent_shkreli: the real problem with google is they have billions in cash sitting around yet they hardly innovate
vay_man: steve jobs has truely left silicon valley
mutrx: amen
gary_burton: @georgehotz I hope you used a number theoretic transform for day 16 part 2 and got the whole answer LUL
montecarlo: should i got back to grad school for math?
tornpaperyoyos: can you show us some of your AoC solutions?
lemonboxed: isnt amazon just a giant logistics company
MrMcaustin1: TinksFn monkaS
mutrx: @mods
KNOOKEL_HEAD: monkaS
montecarlo: monkaS
zEveery: cuz everyone gonna starts asking that. spamming like crazy
Eastonn: everyone asks about it thats why LUL
ArcherCreatlol:  monkaS /
brisingr1031: @lemonboxed aws is p much becoming that
TalonFire: what mouse you got?
p4ri: why u so smat
mufeedvh: you've interned at SpaceX right?
Zanderly: LUL
MrMcaustin1: uh oh
montecarlo: BANNED
brickvo: you need bttv
MrMcaustin1: timeout incoming
mutrx: error unused symbol keyboard
picklesareok: too many rules
brisingr1031: @georgehotz what finger do you use to hit the spacebar?? /s
TheCellarDoor: @georgehotz if you add /chat at the end of your twitch url you can have a window with only your chat
gary_burton: need to keep the mechanical keyboard enthusiasts at bay LUL
montecarlo: gotta follow the rules
Knarez: why didnt thinks work out at spacex? Kappa
KNOOKEL_HEAD: bye @TinksFn
mikey9988: right thumb DansGame
ArmanTheCyber: geohot do a reaction test online
mutrx: you were an intern?
vay_man: who watched last season of silicon valley?
Knarez: screen vs tmux and why both
lemonboxed: uses pinky to hit space bar... mad man
montecarlo: LULW
bankzed: Did you reach your goal for IG?
Roundlay: PogChamp
mutrx: f
I_am_paranoid: but what mouse do you use? pretty sure it's some mouses boost programming skill
hardtarget4: got em
braininavatt: I just noticed I use my left thumb SeemsGood
red123123: lul
Particle_x: LMAO
mutrx: we all can't get banned if we band together brothers
braininavatt: ^^^
montecarlo: you got first mutrx
montecarlo: go*
KNOOKEL_HEAD: what is the brand of your fridge
mutrx: k-k-k-k-k-nvm
Eastonn: rebel against the system PogChamp
braininavatt: monkaS
tornpaperyoyos: you sure as hell can actually
anxova: OpieOP
jax05_: :O
ArcherCreatlol: monkaS
lemonboxed: fight the power
Particle_x: monkaS
Eastonn: dictator monkaS
archeadis: @georgehotz What mouse do you use?
MrMcaustin1: I can setup an automated script to ban anyone who mentions the k word
walsh9: thanos snap for bans
vay_man: lol
gary_burton: it's Hong Kong vs China monkaS
Knarez: what's the last video game you played
myuchelys: our powers combined..I'll start: W
Roundlay: what webcam do you use?
TalonFire: what's your favorite scale to play?
Eastonn: H
brickvo: do you watch twitch streamers ?
mufeedvh: i am hungry too
borang: 어떤 키보드
vay_man: c minor
Roundlay: You can in settings
mutrx: what if we're talking about the instrument keyboard
MrMcaustin1: I can set it as one
brevan04: Cinnamon Rolls &amp; Chilli is a meal in NE
walsh9: you can set banwords in your settings somewhere
hardtarget4: there's a way to do it
archeadis: @georgehotz Was wondering what mouse you were using?
Hunted9000: do we get banned if ask to see the setup
picklesareok: the k word*
lemonboxed: the keyword
Knarez: room tour video when???!?
Eastonn: @georgehotz how about brands of you know what, can i talk about those
mikey9988: what skateboard do you have ? Kappa
montecarlo: follow george on isnta to find out more about his k word!
zEveery: I saw yesterday u master some languages.. How u master languages ? Doing puzzles and looking for documentation? Actually I kinda struggle to learn a new language (I mean, masterize it. Start knowing the tricks.)
MrMcaustin1: Can't use it now
braininavatt: what if I used to play the keyboard when I was 10 Kappa
georgehotz: you whats your keyboard
brisingr1031: k e y b o a r d ??
montecarlo: ur a mod
Knarez: what is your keyboard
montecarlo: you can say it
ZippyBot92: can you point your camera down so we can see your mouse
Knarez: Kappa
braininavatt: Jebaited
MrMcaustin1: scam
ArcherCreatlol: mine is stealseries ty for asking :)
montecarlo: we can't
ArmanTheCyber: k3yboard?
MrMcaustin1: twitch liedf
montecarlo: keeb
walsh9: LUL
ArcherCreatlol: LUL
p4ri: keybaord
I_am_paranoid: keyboard!
Knarez: keyboard
p4ri: keyboard
mikey9988: mod everyone :)
lemonboxed: keyboard
montecarlo: keyboard
mufeedvh: lol
mutrx: wekeyboard
ArcherCreatlol: keyboard
vay_man: keebod
montecarlo: LMAO
Eastonn: keyboard
I_am_paranoid: pls no ban
bankzed: this convo is worse than K Hole
KNOOKEL_HEAD: doesnt work OMEGALUL
Roundlay: Your message wasn't posted due to conflicts with the channel's moderation settings.
mutrx: REVOLT BROTHERs
MadArkadian: lmao
montecarlo: BAN US ALL LIKE YOU SAID
MrMcaustin1: Ha sub only
Iliftmymousealot: no
mutrx: subs only gang
brisingr1031: ripppp
zackartz: rip
mutrx: if we could have a whole stream like the end of s tream
Iliftmymousealot: 😬
braininavatt: braininavatt subscribed at Tier 1.
mutrx: :)
braininavatt: freeeee
MrMcaustin1: welcome braininavatt
Iliftmymousealot: 1m2019
FaustPetrovich: mod deleted my message, I'm a sub, wtf?
mutrx: sub gang
bankzed: about to gift everyone a sub if they promise not to say the K word
mutrx: are u gonna buy 1m2020.com?
MrMcaustin1: 1m2019.com is still down
FaustPetrovich: unsubscribe
mutrx: i'll trade u 1m2020 for $50
MrMcaustin1: No I just tested it
MrMcaustin1: It broke
mutrx: LUL web developer
MrMcaustin1: Wait it works now
MrMcaustin1: just slow af
Iliftmymousealot: See you
bankzed: Gotta thot it up for 1m subs
braininavatt: HahaDoge HahaDoge
 
WEBVTT
Kind: captions
Language: en
raiikouu: yoo
raiikouu: waddup
awesomeo113: Wooo
raiikouu: lunch good?
ne3cross: Yo yo
eax_ebx: Привет.
Armitage9: its boss time
LiamS212: Sup cunt
benchai18: Hey Jorgè
nanodanger7: nanodanger7 subscribed at Tier 1. They've subscribed for 19 months, currently on a 19 month streak!
zinc_lord: yo
eaglesemanation: дарова
connord60: What’s up George? Big fan hope all is well
Mariosavitch: piss asmr
benchai18: No cock today Jorgè?
robotboy987: damn
geochill1: we seeing some driving simulations today?
robotboy987: Carla on Mac?
awesomeo113: Jorgé, the baddest takuache to ever live
geochill1: sweet
lambdaman0f: what are your thoughts on Haskell?
gyrojosh: Your such a boss
yodiggity4739: what are your thoughts on VISUAL BASIC
johan_ub: Gay
benchai18: U are a freak of nature
xteam159: There's no way after watching one of your podcast and I was about to go sleep and I get notified you are live BibleThump
awesomeo113: Ooowee nothing like some mukbang
chocolatechp: george! george!
shanumbra: do you watch porn ?
yodiggity4739: i think visual basic may be the best programming language of all
Alpasfly: do you think knowing how to solve dynamic programming and branch and bound problems is important?
zinc_lord: marinara vs alfredo?
Alpasfly: so what's the plan for today g-dawg?
gyrojosh: weird if you dont
cj1m: should I drop out?
ftt0717: The legend.
banditor: george, what do i need to eat to be as smart as you?
benchai18: Cock or coq?
chocolatechp: did you sprinkle cheese on it
shanumbra: fav category?
geochill1: Let's simulate transporting 20 tons of butter coast-to-coast
yodiggity4739: what if its rehab
ftt0717: But it tastes like crap.
robotboy987: dude imagine you drop food on your computer 😂
Halixness: water-cooling Mac by putting it on a plate with iced water?
Mariosavitch: no
yodiggity4739: yes
benchai18: @robotboy987 Ask him what kinda keyboard he uses. Just in case he drops food on it
yodiggity4739: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
Halixness: what if Catalina forces update while streaming lol
johan_ub: Hi. Everyone who is watching on commaai archive!!
ftt0717: DONT DO IT.
connord60: George I’m working on an app for place kickers in football any advice for getting the word out and some publicity
yunk3r: micro artisanal delivery
yodiggity4739: god i love butter transportation
connord60: As a college student
benchai18: George how big is your coq?
chocolatechp: do you only date other programmers?
shanumbra: is your gf a programmer ?
c9bd: what did i tune into
vidyogams: bruh
kornez: LUL
ftt0717: ........
awesomeo113: We live in a society
6majed: LUL
bubbychernicoff: @georgehotz how have you been enjoying san diego
gyrojosh: its go time
CaptCalifornia: @bubbychernicoff is he still there? isn't his company's office in SF?
yodiggity4739: i cannot follow along i lack the critical information
PhysoTronic: he is really working on comma ai or title is just Jebaited
Alpasfly: why mac and not linux?
bsx1123: Is it possible (in the future) to use openpilot on the Renault Zoe?
bubbychernicoff: @CaptCalifornia did they move back from SD to SF?
soeim: it was his company's idea to move him to san diego
banditor: how bout Raspbian?
Keyeh: i thought openpilot run on a car though
CaptCalifornia: @bubbychernicoff legit didnt know they moved my bad lol
tkrsh009: lets goo
twiggy_io: George who took over your body. You said you would never talk about it...
yodiggity4739: Pog
oMythra: you done any more hack the boxes?
CaptCalifornia: PepePls
awesomeo113: Yeah fuck Elon
gyrojosh: i see what they did there
chocolatechp: oh so this is like gta
ZemkeCWT: So, is it now allowed to talk about comma?
robotboy987: Carla is awesome
yodiggity4739: is that a picture of carla
PhysoTronic: are we gonna do meditation today too?
alreye: so carla is like a sex doll ?
ftt0717: “Yeaaahhh”
yodiggity4739: car LA
jay_al97: oh i saw one guy on YT training a model on this game
ssp3xx: I feel that
chocolatechp: afternoon 'coffee'
ssp3xx: morning coffe wrecks
unluckychickenn: unluckychickenn subscribed with Twitch Prime. They've subscribed for 3 months!
PhysoTronic: georgehotz all good until you start chewing that ice Kappa
bubbychernicoff: Would you recommend other Silicon Valleys moving to SD?
Keyeh: so i guess carla is a car simulator for Los Angeles? Kappa
dorkmo: Pride1
yunk3r: is carla mac only?
smurfd0: Gona openpilot Carla?
yodiggity4739: bob the builder
puffnfresh: puffnfresh subscribed at Tier 1. They've subscribed for 3 months! when we gonna use Coq to verify comma.ai?
geochill1: Does 0.7 support fingerprinting 2.0 or is that still being worked on
aymanpoquito: hellow
yodiggity4739: carla needs milk in the cereal
awesomeo113: I like my ice with starch
chocolatechp: i want to learn vim
chocolatechp: and be just like you george!
PhysoTronic: this is anti ice addiction stream, we dont talk about ice here LUL
xteam159: carla is my mom's name SeemsGood SeemsGood
yodiggity4739: chewing ice bad for teeth
banditor: You must be typing in a non mechanical keyboard
veomx: Hi George :) good to see you
benchai18: George TRUE or FALSE: Saurik is working on a comma ai substitute?
Kyoto_o: No :)
okeeeeeee: oh carla noice, recently i did something with carla and ROS
champ900: @georgehotz George how much do you code each day
th3_maj0r: yoyo boyz
chocolatechp: you eat like a pig
chocolatechp: oink oink
PhysoTronic: LUL
benchai18: Correct. It’s bullshit
geobitz: ikr got an orange lil nosie
th3_maj0r: did you buy the new mac pro george? don't you need 1.5TB of RAM?
yodiggity4739: oss
Kyoto_o: wash your mouth/nose before it goes on for too long :)
veomx: you have sauce on your nose
yodiggity4739: soss
Kyoto_o: he got the sauce literally KEKW
chair_78: you eat like there isn't a camera in front of you
samtheprogram: you changed the wrong os?
yodiggity4739: does anyone use TEXTEDIT.app
geobitz: u have sauce on your nose fool
Kyoto_o: it's quite pricey
geochill1: Have a timeline for complete fingerprinting 2.0?
Keyeh: isn't it like 50 grand
Abnico: new mac is to big
yodiggity4739: theres a new xbox
awesomeo113: I need 1.5 Tb of ram
tkrsh009: yes me too
champ900: @georgehotz why don't you use bash
benchai18: @yodiggity4739 Looks like a PC tho
Keyeh: i only need 256kb of memory :)
Abnico: why are u gay?
lightofhel1: !uptime
Abnico: zsh ftw
awesomeo113: All hail the cheese grater
benchai18: @yodiggity4739 I’m a lifelong Sony guy, but not gonna lie, their Hellblade 2 trailer makes me wanna get one
squiggly_nibba: Download item
squiggly_nibba: *iterm
my_curiosity: george, you beutiful person. why did you open source this project ...
yodiggity4739: tru
Abnico: iterm is trash
Keyeh: @my_curiosity i think he was going for an android kind of deal
yodiggity4739: what is scons
gyrojosh: pressing buttons
JesseSkinner: whats for supper
Kyoto_o: massaHmm
jagger_rsw: pthread_kill
samtheprogram: ^^^
dorkmo: mash the keyboard buttons = hacking
champ900: "hacking is about guessing" - George, 2019
veomx: George you like fettuccine?
benchai18: Jorgè u got a PO Box I can send a Hanukkah gift to? Totally appropriate.... not chocolate dicks or hazmat
gyrojosh: life itself is a scam
Julianhgg: greeting geo the boss
yodiggity4739: PogChamp
Keyeh: pretty cool
gyrojosh: SeemsGood
chocolatechp: 100 highway miles
yodiggity4739: i bet that video made elon feel sad :[
JesseSkinner: does your startup, i assume then, use openpilot?
Abnico: ordered a prius for christmas
zigzati: PauseChamp 100 miles
dorkmo: Corgo1
benchai18: I thought George does/did some work for Tesla?
deed02392: surely Tesla are still trying to raise money off the back of their progress?
Keyeh: tesla is a scam
samtheprogram: I don't know if I've ever seen George refactor
Abnico: tesla pre order
Keyeh: didn't you hear him
benchai18: @keyeh Cool thanks for the heads up
devm0d: Interview with Hacker 'Phineas Fisher' as a Puppet with Vice is pretty funny https://www.youtube.com/watch?v=BpyCl1Qm6Xs
deed02392: I just joined
benchai18: @keyeh Nope.. I’m playing death stranding so I got distracted
yodiggity4739: wont the big companies use the ideas in openpilot for themselves
my_curiosity: I feel like this statement that high technology is generally a fucking scam is something that everyone in the industry knows deep inside, but is afraid to admit
zigzati: @yodiggity4739 ya xD
Keyeh: george you are so good coding C, why do you use python for everything?
devm0d: It's faster @Keyeh
vexedkiller0071: python has better libraries
devm0d: faster to develop that is
vexedkiller0071: faster
zigzati: @my_curiosity "in the industry"
vexedkiller0071: and ez
Keyeh: that's fair
eaglesemanation: is it possible to make devices with comma to communicate with other deviced?
champ900: George do you respect Elon
my_curiosity: Elon is probably the most successful scam artist in the history of humanity
devm0d: More than Trump?
warpoit: stay BLESSED bro.
benchai18: @yodiggity4739 Fair question. I was telling my past colleague that I love open source, and he goes “anyone who makes smtn cool and open sources it is an idiot and missing out millions n millions of $”. Mind u, he has nothing to do with tech industry. I think he heard an anecdote of a kid making something cool and getting it jacked cuz he opened it
Super_saiyan_3: how many word per min can u type homie?
ReDD_TV_: "basic" programming
deed02392: I don't believe he's a scammer. I genuinely believe he's a philanthropist
benchai18: @super_saiyan_3 Depends on his keyboard. Ask him which one he’s using
Yogohami: How is Elon a scammer ?
samtheprogram: @Super_saiyan_3 it depends how many symbols are in the test
gyrojosh: also is open source considered less secure?
theduckthough: no
ImJ4Gu4R: halo haloozzzz
Keyeh: quite the opposite
devm0d: Generally the opposite
devm0d: As anyone can audit it, open PR's, fix it
Biffingtonn: Never understood how people thought Elon was a scammer
eaglesemanation: I mean what if one car sees some dangerous situation, could it provide this information to other cars or something
JesseSkinner: @gyrojosh no.. we call the opposite "security through obscurity" which is not great
gyrojosh: sure, but works other way also
deed02392: I mean, there's a lag between when it's open sourced and when it's secure
theduckthough: how did your little adventure with the formal prover go?
deed02392: if you take a large private code base and open source it, you're gonna have a bad time
vloood: i mean hyperloop was a bad idea
deed02392: especially when you typically get more black hat Interest than white hat
benchai18: @deed02392 You are smart and I agree with u on Elon and sec and code
deed02392: vloood it's not a bad idea, any more than people thought starting an electric car company was a bad idea, or a private space venture
deed02392: aw thanks benchai18
Keyeh: didn't elon got in trouble with secutiry experts for hyperloop?
benchai18: @deed02392 ❤️
Keyeh: get*
vloood: @deed02392 no actually that is a bad idea that's not gonna work, that's why he pivoted to tunnels
deed02392: nah, the tunnels are for intra City transport
deed02392: hyperloop still makes sense for intercity
lightofhel1: why do we need openpilot on mac? @georgehotz
Abnico: are you ever going to make comma coin for token incentives?
Erciks: i did 4Head
Keyeh: for when apple start their car company
r3mote: Oh hi :)
Keyeh: Kappa
thundershots999: Anyone getting the $50k mac pro cheese grater?
deed02392: lolol
Abnico: amd cards only
deed02392: I could get one at work if they get it on the esxi HCL
zigzati: @thundershots999 plenty of folks will :)
samtheprogram: why only OS X &lt; 10.12?
Abnico: cant do any rendering without cuda sad
champ900: open source is not self sustainable and that's why companies are moving away from it
aymanpoquito: @thundershots999 nah
Abnico: how are they moving away from it lol
benchai18: @champ900 Exblain please
Abnico: if anything they are encouraging it
theduckthough: patch script?
fmega: champ900 except they're not
abrahamstr: Hi George
Abnico: open source is the future
deed02392: my name is George too. this is fun
Abnico: all this tech is feature
yoyo_brobro: yoyo_brobro subscribed at Tier 1. They've subscribed for 8 months, currently on a 8 month streak!
oMythra: yea nobody is moving away from open source lol
Abnico: everything will be commoditized
JesseSkinner: 25 years ago shareware was hot and open source was super niche. now microsoft owns github
Abnico: meaning i can run twitter or facebook, the only thing of value is growth/network effect
deed02392: amen @jesseskinner
crimson_andre: alo
trippledrizzle: hello
lightofhel1: use if for imports?
deed02392: it's totally possible to make money out of open source
crimson_andre: what is open source
deed02392: you just take advantage of the open source aspect to rank up adoption
lightofhel1: or like this xD
JesseSkinner: you can charge money to support your open source project. you can launch a whole business around it like Gatsby
the_shining: What is he writing
Abnico: open source means open source
duzy: PogChamp
zigzati: @the_shining MrDestructoid 🚗
Keyeh: compiling Pog
deep_40k: @georgehotz How long did it take you to get this good?
samtheprogram: PogChamp
JesseSkinner: or run a hosted version like wordpress.com vs wordpress.org
the_shining: ok
chair_78: make the font larger
thismustbekirk: error: family of 5 terminated
lnter0: thats the trick
lightofhel1: LUL LUL LUL
samtheprogram: ouch
rektiw0w: hello mr twitch streamer
Abnico: been testing gatsby
Abnico: real nice, sad i found out about it later
crimson_andre: StoneLightning
thismustbekirk: what do you make with Gatsby?
the_shining: WutFace ResidentSleeper
HardDenmark: some much aggresion goes into pressing these keys kappa
anguscupcake: damn u got the vim skills
Abnico: lmao didnt know u like lorde
samtheprogram: @deep_40k his entire life
deed02392: should we listen to some Grimes? lol
crimson_andre: pepejammmmam
crimson_andre: tf are you writing
h4sb: lord e
TommyDGod: oh no, not billy eyelash
deed02392: ohh lordy
HardDenmark: isnt billie's shit written by her brother
oMythra: pepoDance
deed02392: ya ya ya I am lorde
tkrsh009: this used to be my alarm
tkrsh009: years ago
Abnico: yo i saw her at a chinese restaurant
JesseSkinner: lorde lorde lorde, i am lorde
knilecrack: what you doin brah?
deed02392: I think he's working on open pilot from a mac
ajd13c: song bro?
ajd13c: !sojng
ajd13c: !song
sadpoopz: lorde team
oMythra: mac shmac
deed02392: I guess the first step is getting it to build
the_shining: errors
eaglesemanation: !hack mainfraim
aymanpoquito: @ajd13c lorde team
Erichmoraga: Sell Mac &gt; buy PC
deed02392: maybe George loves his new 16" mbp and wants to use it full time? :p
anguscupcake: I got a free mac and it's pretty nice actually
oMythra: all that new screen real estate
deed02392: Yea I got one with work and I do really like it
aymanpoquito: @anguscupcake yeah same bruh
Canuckles_: New mbp keyboard Kreygasm
oMythra: when you get one with work do you just max it out or what?
deed02392: I even bought an ipad now after being an android guy
deed02392: @omythra hells yea.
Abnico: who cares about tools
Abnico: just use anything pimps
oMythra: thats the life
samtheprogram: is he compiling it on mac os for carla dot org?
treestompztv: o/
Abnico: tribalism is for peasants
samtheprogram: because otherwise probably cross compiles anyway?
deed02392: although 'max out' = 16 GB RAM which is kinda lame. it's à 2017 model
theduckthough: what's preventing Cython to be cross platform? Wouldn't it only need a few abstractions?
topped123: george i decided to stop being an npc today and now im a main character
anguscupcake: tbh the thing I like most about macs is you can't waste time on video games
deed02392: haha
treestompztv: @anguscupcake LUL
deed02392: well I play worms Armageddon on it from a Windows vm
oMythra: solid points being made
deed02392: Also Apple arcade bro
deed02392: Guess it's gonna kill your productivity
Abnico: George, will comma coin ever come out? token incentives may be a good experiment in the future
Major_Spicy: @georgehotz I quit college to focus on other things (was studuying programming basically). Now that i feel like i still want to learn it, is taking online courser good enough still to learn well?
lidermaury: George please do christmas stream where you will be talking about keyboards while programming flappy bird
Vesh: george do u have tomato sauce around your mouth
anguscupcake: noooooo
raiikouu: Vesh ye he hate pasta
raiikouu: LUL
Vesh: lmao LUL
oMythra: its part of his look
Keyeh: @lidermaury hell yeah, with the santa hat
Vesh: i dig it
oMythra: last time he had sauce too LUL
aymanpoquito: @oMythra lol
Vesh: eating aint easy @oMythra
ZemkeCWT: Worms Armageddon, what’s your username on there?
deed02392: me? same as here :)
deed02392: do you still play?
deed02392: I'm a pretty good roper
IMMAPCGAMERD00D: IMMAPCGAMERD00D subscribed at Tier 1.
ZemkeCWT: I’m creator of CWT actually. http://cwtsite.com/
brickvo: thoughts on 50k mac LUL
deed02392: I know someone who just bought one
barretois: what do you think about software engineering
samtheprogram: they used to...
knilecrack: what's GELS?
deed02392: I mean, it's not terrible value for money if you want to use it for what it's made for
knilecrack: GLES*
ne3cross: You have openGL
samtheprogram: GLES = openGL ES
Keyeh: not sure i'm ready to give up a kidney to buy a mac LUL
deed02392: lol
deed02392: but you have two dude
knilecrack: @samtheprogram tlhx
ne3cross: look at Johntheripper for example
Keyeh: what if next iphone is 20k, then i'll have none
zigzati: @deed02392 not if i live off cheese balls
deed02392: hashcat has completely replaced jtr now come on
knilecrack: the problem is not in 50k mac, the problem is in 400 wheels
tkrsh009: or 1000 stand
TheRealShoks: what is he coding a python module?
deed02392: lol fair @zigzati . I just started a 7 day water fast today
knilecrack: or tand
oMythra: yea they wildin with the stand
knilecrack: stand*
deed02392: they are beautiful wheels though
Keyeh: LMAO
deed02392: and you don't have to get them
deed02392: lol
knilecrack: but it can have up to 1.5 TB of ram, RAM is expensive
deed02392: ecc ram no less
oMythra: you can just download RAM these days Kappa
Keyeh: does it come with 1.5 tb though? for 50k ....
deed02392: you need the extra 10k cpu for the extra ram
knilecrack: yes
Keyeh: oh ok
zigzati: @knilecrack how many players is that on my minecraft server
abrahamstr: DO u work with the cloud?
borang: f apple!!!
deed02392: @zigzati at least 3
zigzati: PogChamp
knilecrack: @zigzati :D
deed02392: PJSalt
Ch4otic: misleading title
deed02392: SSSsss
Ch4otic: or not
zigzati: @ch4otic ha U THOUGHT he was working on some math stuff
zigzati: nope CARS
Ch4otic: Yep :D
lidermaury: lately i came to conclusion that im not gonna be friend up with someone who dosent have iphone
knilecrack: rofl
samtheprogram: they have open gl, it's just not supported anymore
samtheprogram: still included in the OS
adibaby04: runs the same command even though there was an error the first time
deed02392: @lidermaury i think those people would welcome that dude
knilecrack: he probably has android
oMythra: i can't be your friend if your phine doesn't run KaiOS
deed02392: my phone is running red star os
oMythra: also phone*
smurfd0: Check where brew installs headers?
the_shining: red star?
lidermaury: George please do christmas stream where you will be talking about keyboards while programming flappy bird
borang: pls be nice to Maroon 5, best Christian band
squiggly_nibba: Listen to NF
deed02392: Christian?
OnlyB1ade: Hello George
shieeeeeeeeet: do you normally program on multiple screens?
adibaby04: what is that terminal interface? i gotta have it
adibaby04: @georgehotz
samtheprogram: i don't know about GLES though, just opengl.... i think gles is just on ios &amp; tvos
borang: LOOKS COOL GIMME IT
lightofhel1: why do u switch from tmux to screen? @georgehotz
lllowe: search for zsh @adibaby04
knilecrack: oh-my-zsh
adibaby04: thats sexy af
samtheprogram: @adibaby04 he's running tmux almost stock, just overridden colors. he might be running zsh for the shell but has overriden the prompt to provide the exit code
adibaby04: looks like tmux
crazycatz59: Can you define noob thinking?
borang: worrying about noob thinking is noob thinking, no?
Keyeh: oh, he will go hours about it, trust me @crazycatz59
adibaby04: been programming for 3 years but never really paid attention to terminal theme lmao
oMythra: if im not mistaken it says tmux on top of the window
deed02392: Good night guys. 2 am here
oMythra: take it ez @deed02392
theselectedcoder: night deed02392
gyrojosh: nickelback lol
borang: nickleback is good too, they really put their all into their complex tunes
Keyeh: hey don't talk shit about Nickelback Kappa
the_shining: what?
brickvo: BabyRage
RSPwner_: @georgehotz what browser do you use/recommend?
the_shining: What time do you have?
oMythra: you dont want to look at this photograph, George?
ne3cross: OpenGL works fine on mac
crazycatz59: @borang yeah but how do you know? Your definition of noob thinking could be completely totally different someone else's.
crazycatz59: and plus he came up with it
adibaby04: as you can se @RSPwner_ , chromium
smurfd0: Mesalib?
Ch4otic: @RSPwner_ you can see on stream he's using chromium...
the_shining: 10.00 AM
oMythra: if im not mistaken it says chromium on top of the window Kappa
smurfd0: www.mesa3d.org
Ch4otic: why get opengl working if apple's likely just gonna remove it eventually?
Keyeh: progress PogChamp
iTzMeRafa: Pog ress
jaxnetv: use #error &lt;msg&gt;
Keyeh: swaglog LUL
frankytex: clamp'em where it counts!
Gtxgaming23: is this node js
Keyeh: yes
Gtxgaming23: yuck
Gtxgaming23: node is least of my favorite
Gtxgaming23: i dont understand anything from it
ranza_dk: https://glad.dav1d.de/ you can use this to generate the gles files youre missing if i remember correctly.. been a long time since i did opengl on mac
Keyeh: actually is C and python @Gtxgaming23
crazycatz59: why are we running openpilot on a mac?
Tsoding: Why not?
Keyeh: hello there @Tsoding
Ch4otic: superior OS LUL
dartrenist: the y in yaml stands for yahweh because it's godly
SlaterUSA: @georgehotz plz explain git to me :(
Tsoding: @keyeh, VoHiYo
TheRealShoks: why is it titled basic programming
crazycatz59: Are we putting openpilot on a mac so it will grow wings and fly into Tim Cook's window?
ragemaster999: where can i invest?
brbdontdie: what are your thoughts on quantum computing?
Keyeh: we are investing in apple launching their own car company LUL
Abnico: blockchain is the future of decentralization and blockchain technology
SlaterUSA: some guy just msg'd me here asking to be unbanned. i blocked him
crazycatz59: imagine not making a new account
crazycatz59: or actually
brbdontdie: I am not banned, but can I get unbanned?
SlaterUSA: some guy ending in -cat
Mariosavitch: thoughts on tesla smashing its truck with a metal ball
Keyeh: @brbdontdie playing with fire there, pal
oMythra: was it crazycatz58
SlaterUSA: no
crazycatz59: no
SlaterUSA: "myo" something
brbdontdie: the guy messaged me asking me to write unban me please LMFAO
SlaterUSA: ^
SlaterUSA: haha ok
Keyeh: banned from life Pog
Mariosavitch: he must be a tesla owner
SlaterUSA: super-banned
brbdontdie: he says that he was subbed
OnlyB1ade: Ohh triple
roystang: Hello, i have amazon prime
OnlyB1ade: OnlyB1ade subscribed with Twitch Prime.
crazycatz59: pls sub again so you can get banned for donating money
gyrojosh: pay to get banned
brbdontdie: lololol
Mariosavitch: lol
xGeoTrk: hello
knilecrack: ahahaha
oMythra: along with 0.5BTC
OnlyB1ade: HahaLean HahaLean
cccatch64: Jebaited
SlaterUSA: $4.20 or perma-ban remains in place
xGeoTrk: btw why you don't stream on Science and technology ?
crazycatz59: because science and technology is DEAD
SlaterUSA: @xGeoTrk cos he's basic, duh
3ygun: What about sending you receit for a Comma.ai package?
xGeoTrk: @crazycatz59 geohot gonna respawn it Kappa
Fantasma56: when are you cracking Japanese anime? idolAY
crazycatz59: AYAYA
Keyeh: PogChamp ?
JesseSkinner: PogChamp
crazycatz59: PogChamp
Mariosavitch: but does it blend
8430: idk what's this but poggg
Keyeh: compiled == works
Tsoding: FeelsOkayMan
zakonegrusha: @georgehotz yo geohot, how much WIndows exploit development have you done? I've seen a bit of your Linux based pwn stuff
ranza_dk: pretty sure you can fix the gles with https://glad.dav1d.de/
crazycatz59: include opengl to crash mac users cuz its deprecated ez
ranza_dk: lol is myaocat the guy that got banned? He says he'll pay you money if you unban him :D
Vesh: lil wayne slaps
R34R: what happens when you get banned? not asking for ban btw :)
brbdontdie: @ranza_dk dont get jebaited dude
oMythra: you get sent to georges blacksite
ragemaster999: just grep :)
crazycatz59: @R34R the chat box goes away and says "you are banned from this channel"
R34R: ok thanks! @crazycatz59
brbdontdie: @ranza_dk he says he can't create a new account because he "ddoesn't have email"
Keyeh: what? LUL
h4sb: weezy
ranza_dk: aww poor guy :D
da0ne_: is this how boomers code?
oMythra: make a new email?
kaney_s: he is millenial
maverick_twitch_: hello
ZemkeCWT: George is in good mood apparently.
maverick_twitch_: !info
kekisec: Hey george huge fan man &lt;3
oMythra: thats right i forgot the blacksite doesn't have email
Mariosavitch: me :)
ragemaster999: just grep :)
MrOtotheP: grep that bad boy
btastical: if you compile with GCC you can disable warnings using -w
BlindLight2: i just used pthreads in my OS class :o
maverick_twitch_: can open pilot work in India ?
maverick_twitch_: where people dont know traffic rules
maverick_twitch_: follow*
Mariosavitch: now install good luck 2
ranza_dk: you should really check out the link ive posted :)
giacpolish: george do you code every saturday night?
oMythra: nah just when he feels like it or has something to stream
visudo20179c: sup George
brbdontdie: when did george start reading ML white papers?
Wolf_King_IV: I have no clue that the hell I am looking at here...
Wolf_King_IV: just call me an idiot and move on LUL
Mariosavitch: line 32
Mariosavitch: oh, your on a mac.. doh
guy_ross: guy_ross subscribed at Tier 1. They've subscribed for 2 months! HeyGuys
xtoledo419: GL moved? https://github.com/ziglang/zig/issues/2208
Wolf_King_IV: yup, still no fucking clue here LUL
btastical: yes making the openpilot build on mac osx
btastical: he's
Wolf_King_IV: okay
JesseSkinner: @Wolf_King_IV he runs the command to compile, sees an error, struggles to fix the error, runs the command again, and hopes to see a new error, until eventually it succeeds
Wolf_King_IV: @JesseSkinner mvp
JesseSkinner: now it compiled but the ui crashes when he runs it @Wolf_King_IV
extremelywide: favorite lang?
crazycatz59: New Error PogChamp
prvk3: what are we making today?
DyersEve15: which keyboard do you use
KrrSplat: LOL
vovnsons: @DyersEve15 monkaS
crazycatz59: still waiting for him to program that bot to automatically ban ppl who ask about the keyboard
oMythra: mentioned the K word
ranza_dk: 410
knilecrack: :D
chocolatechp: your keyboard is asmr
OnlyB1ade: HolidayPresent
oMythra: HahaHide
chocolatechp: george do you miss new jersey
LuaKT: Try 120
silverthekittenn: LUL
crazycatz59: EZ
oMythra: LUL
KrrSplat: PogChamp
knilecrack: geo is ruthless when it comes to banning
crazycatz59: ask the ppl at nvidia
ranza_dk: https://thebookofshaders.com/ :D
SkywardDev: How are you liking the new Mac 16" George?
Th3G4mingbros: what's the joke about the keyboard? Not asking for the keyboard itself but why he is banning people for it xD
SkywardDev: Was thinking of getting one myself... thing looks sweet
hardtarget4: 16" is prime. just got one too
SkywardDev: What specs @hardtarget4 ?
hardtarget4: i9 64GB 5500m
oMythra: @Th3G4mingbros playing with fire bro monkaS
SkywardDev: Hell yeah man
crazycatz59: using vim with the mau5 what
Rtc_ti5: haha
JesseSkinner: probably sick of the question @Th3G4mingbros
btastical: are you planning on doing another hackthebox sometimes?
big_coke_head: which mechanical keyboard dou use
JesseSkinner: monkaS
crazycatz59: oops
Th3G4mingbros: Understandable ig
oMythra: the peripheral that shall not be named
Th3G4mingbros: @big_coke_head You made a big mistake
PanosTrak: @georgehotz when are u gonna crack the ps4?
AlexEDM: is this George's typing ASMR stream?
big_coke_head: monkaS
TrapperMx: Kappa
Hunted9000: WutFace WutFace WutFace
crazycatz59: PogChamp
ranza_dk: because mac :D ..
esence: thank you TIM APPLE
hardtarget4: openpilot on 2020 ford explorer? PogChamp
ranza_dk: macos new security thing is ass
crazycatz59: this channel has no emotes for subbing jdotkdEhehe
JesseSkinner: does the ui run
ranza_dk: it builds
JesseSkinner: is this related to the ui or did he move to something else
PanosTrak: what is he doing?
usradm: hey
Xire2893: ui won't run due to ipc limitation on mac but built successfully
PanosTrak: @georgehotz what are u doing?
AlexEDM: this is all done in Python?
JesseSkinner: ipc limitation BibleThump
delbertooo: do you use the hhkb control key as apple command key? I always get kind of confused if I switch between my mac and ubuntu with like ctrl   c and command   c
JesseSkinner: oh so he's coding up a workaround to the ipc limitation in python?
crazycatz59: so you quit your job as the ceo of comma.ai to become a nomadic researcher in the Church of the New Hackers?
JesseSkinner: its badass he still has his twitch category set to basic programming
esence: What's up chat, how are y'all?
brbdontdie: feeling good, can't compain
btastical: are you planning on doing another hackthebox sometimes?
esence: @brbdontdie , having some wine too?
KNOOKEL_HEAD: hey george thanks for letting me know that i shoudn't be a n00b
Th3G4mingbros: 4am here but this is actually really interesting to watch
PanosTrak: why he doesnt like asking about keyboard?
Tarzeuss: Geohot live baby I’ve been waiting all week for this
oMythra: awww man here we go again LUL
brbdontdie: i have a final exam coming up so celebrating is for afterward
JesseSkinner: monkaS endless
esence: what class?
brbdontdie: machine learning
brbdontdie: kudos to george, this material is pretty challenging
esence: is it all theoretical?
brbdontdie: purely theoretical
brbdontdie: derivations for everything
esence: I see, what were your assignments/labs?
itsChoudhry: Does openpilot GUI use a external framework or is it a in house one?
brbdontdie: lots of materiaal, we covered bayes, k nearest neighbors, bayesiaan error, pca, lda, svm, neural net and expecation maximization
brbdontdie: and more
crazycatz59: seems pretty basic
crazycatz59: couldn't u have gotten all of that from a book?
esence: uni lectures on basics, that's ok
I_am_paranoid: why it's not in "Science &amp; Technology" btw?
Keyeh: that's the usual stuff, not saying that it is easy by any means
purgatoires: lol yea u can learn anything from a book
JesseSkinner: you can get everything from books @crazycatz59
oMythra: yea reasonable for introductory class
brbdontdie: Yup, its my first time learning machine learning. I was more on an embedded systems track
brbdontdie: thought teh class lookoed like fun aand george made it seem interesting
esence: @brbdontdie , what degree are you pursuing, data science?
crazycatz59: but dont colleges usually only teach 1 ML/AI class and that's the material they teach?
crazycatz59: at least the ones ive looked at
brbdontdie: nope, i am doing computer engineering
JesseSkinner: he's on the old twitch category from like 2 years ago @I_am_paranoid which i think is awesome
purgatoires: and not all intro classes cover lda, svm,   neural networks
brbdontdie: this class was for fun. don't need it to graduate
Th3G4mingbros: @crazycatz59 Applied Computer Science here and we got a basic introduction to ML last year with a more advanced course this year
brickvo: 4Head Just
Th3G4mingbros: but that's alll
purgatoires: my school had a stats   data science major but i wasn’t interested in it at the time
knilecrack: what is passive=0 ?
oMythra: yea fuck that lol @purgatoires
esence: is data science still at the meme level?
Th3G4mingbros: for us it is :p
Keyeh: not for the guys getting paid tons
purgatoires: @omythra what u mean
JesseSkinner: my school had cs in the math faculty so i got a bachelor of math
esence: data science == conditions; change my mind
esence: we can hear your 8-core CPU
LaxantePraVaca: first time in the chat, usually watch from the youtube record
purgatoires: the term data science is so connected to “business problemsolving” that it will never not be a meme
brbdontdie: I wish i did math with a minor in cs instead of computer engineering
SonOfSatan: yo what're you doing George
oMythra: i meant that doesnt sound very interesting to me either..not n entire degree on data science anyways
LaxantePraVaca: glad to see data science is a meme here too kkkkkk
Darvein21: !uptime
Keyeh: @LaxantePraVaca fala
esence: @LaxantePraVaca , welcome
purgatoires: @omythra i mean stats is cool, i wish i did cs   stats instead of mathematical econ
LaxantePraVaca: @Keyeh haha eae
esence: @brbdontdie ,why, to switch into data sci.?
anguscupcake: you can get good at math just by reading textbooks
brbdontdie: nah, I feel like some of these concepts that seem somewhat complex to me would be easier to grasp.
esence: college will not help with that, just start practicing in your spare time
oMythra: there actually a lot of good free math material out there these days
purgatoires: u can get good at math by reading textbooks, but it’s a hell of a lot easier if ur required to do it for a degree
JesseSkinner: yeah biggest benefit of school is giving you a deadline
JesseSkinner: if you can do that for yourself you're home free
esence: how is it easier? At the end of the day, you have to sit down, push through, and try to understand...
colanzio5: also it's a hell of a lot harder to find good material online when the math your'e doing becomes highly contextualized by the field you're working in.
LaxantePraVaca: @brbdontdie just get some books of math and start reading, then read their references if you don`'t get it. Getting the course plan from some courses that you're interested might help
purgatoires: bc i would not have pulled all-nighters doing math problems had i not been required to
anguscupcake: if you want to learn how to self motivate then get a book on creating habits
brbdontdie: I was thinking about going into ML white papers and just evaluating some of the current models that are being used today
anguscupcake: everything is in books mang
oMythra: yea for very high level stuff you wont find the material you need but for calc, linear algebra etc. you're fine @colanzio5
esence: I think smoking weed helps to solve all of your problems
purgatoires: white papers aren’t efficient ways to learn if ur relatively new imo
JesseSkinner:  1 esence
purgatoires: lots of textbooks out there
mutrx: what happened to doing Hack The box?
mutrx: play marbies
LaxantePraVaca: @brbdontdie papers are usually to short to learn, most of the time. Get some books of ML to learn more of the fundamentals then goes into the state-of-art through papers
JesseSkinner: not alot of viewers??
mutrx: smh how is george not playing jumpking
esence: guys, thoughts on fast.ai?
JesseSkinner: never see 200  viewers in a coding channel on twitch
mutrx: ^^^^
LaxantePraVaca: @esence looks good from what I've seen, but I didn't read alot of it thou
btastical: maybe this: https://stackoverflow.com/a/29809480/5668843 or that: https://wincent.com/wiki/@executable_path,_@load_path_and_@rpath
oMythra: its been recommened a lot by people in ML but haven't tried it myself yet @esence
knilecrack: cause noone is hot
Jelicion: George is the good looking version of Mark Zuckerberg.
btastical: oh you just opened it, nvm then
mutrx: @Jelicion minus a couple billion
purgatoires: coding vicariously thru george bc i cant code bc of an RSI flare up :(
silverthekittenn: @esence Try it. It worked for me. Few hours into it I could a food classifier b/c the content is designed for coders
brbdontdie: can anyone recommend a good book? Right now, I am going through Duda's Pattern Classification.
mutrx: Lord of the Flies @brbdontdie
purgatoires: Applied Predictive Modeling is a good overview of a lot of models
purgatoires: with exercises
esence: I've tried fast.ai, very pragmatic approach, I liked it too.
purgatoires: @brbdontdie
brbdontdie: i've put it on my sticky notes
RonDune: lots of people on github complaining about compilation issues on Mac OS X in libdbc btw
QUOTE_IF_GREEK_IS_GREASY: PogChamp george
purgatoires: Max Kuhn also came out with a. feature engineering book, i haven’t read it but it’s free online
mutrx: make a ctf for chat and first n who capture gets mod?
RonDune: see the libcanardbc docs for instance
brbdontdie: I graduate in a few days. Will probably be getting into self teaching since my company will be paying me to be an embedded software engineer
QUOTE_IF_GREEK_IS_GREASY: this guy's a pro he can do it mizkifEZ
JesseSkinner: the learning never stops @brbdontdie, you gotta run to stay in place in this industry
esence: nice, life post-school is way better. :&gt;
brbdontdie: Maybe, if I acquire ML skills on the side, they can let me transition
QUOTE_IF_GREEK_IS_GREASY: nymnEZ
purgatoires: that’s my goal, but i’m not even in a coding job yet lmao @brbdontdie
esence: @purgatoires , apex kek, just apply for some webdev shit. so many jobs in states
Jelicion: I have no idea about programming, but it looks so easy with George's skills. His programming looks nice and artfully.
estilen: What zsh theme is that&gt;
anguscupcake: working remotely is the best
purgatoires: i make $81k rn so i can wait ;p
silverthekittenn: why is web dev so hated?
brbdontdie: @JesseSkinner yeah man, I'm honestly looking forward to it. I can learn the things that genuinely interest me
JesseSkinner: exactly @brbdontdie its a lot of fun
purgatoires: my job is boring as hell but i have time to study after work
esence: RIP
funnlimited: LMAO
squiggly_nibba: Are there any other streamers who program?
lua_320: haha
JesseSkinner: i do @squiggly_nibba
esence: @silverthekittenn , it's because there is nothing challenging
purgatoires: @squiggly_nibba go to the science and technology section
brbdontdie: @JesseSkinner I just wish my friends were as enthusiastic as you guys
oMythra: lots check out ThePrimeagen @squiggly_nibba
funnlimited: @jesseskinner why svelte LUL
mutrx: advent of code LULW
JesseSkinner: haha @funnlimited i love it
funnlimited: you are a dedicated man
esence: wait, who's talking about Svelte?
Plurmorant: ADVENT
funnlimited: @jesseskinner @esence
squiggly_nibba: Awesome thanks guys!
JesseSkinner: i stream svelte @esence
esence: Svelte and Rich Harris is awesome
silverthekittenn: @esence I mean companies like google don't like (web) system design challenges.. I get the there're jobs that just piece together off the shelve stuff
JesseSkinner: its my favourite thing in the world right now
lebop: hi im new HeyGuys
sadpoopz: hi new
lebop: here*
purgatoires: @
lllowe: we dont care :)
mutrx: does george talk to himself alot?
sadpoopz: he talking to us
JesseSkinner: i thought he was talking to me
Jok4ndre: Hi @georgehotz , my name is Jorge (portuguese). Wasn't the streams supposed to be non comma.ai related?
esence: CLAP
sadpoopz: crashes means progress
estilen: Hey lads, what ZSH theme is geohot using?
JesseSkinner: this laptop will be driving itself around the neighbourhood in no time
mutrx: @estilen look in this dotfiles, not that any of it matters
esence: @estilen , dude, it's an ugly theme, why do you care? xdxd
QUOTE_IF_GREEK_IS_GREASY: CRASHING PogChamp
estilen: cause I like it? xdxd @esence
mutrx: yo george when we playing marbies
mutrx: multithreading in python LUL
QUOTE_IF_GREEK_IS_GREASY: mizkifCorn progress mizkifCorn progress mizkifCorn progress
esence: @estilen , google OhMyZsh, open their Git page, and scan through
QUOTE_IF_GREEK_IS_GREASY: mizkifCorn progress mizkifCorn progress mizkifCorn progress mizkifCorn progress
sadpoopz: self driving mac
QUOTE_IF_GREEK_IS_GREASY: self-driving shaq
johnATHANATOS: Hello :)
estilen: I have already, nothing seems to match @esence
Jelicion: Damn, its like fortnite, but without fun, ninja and flying twitch-thots.
esence: @estilen , I just scanned for 3s, it's called: cypher
esence: .................
esence: you're WELCOME
mutrx: what's gonna happen to comma when tesla licenses its pre-existing autopiliot technology to major car manufacturers
estilen: Mate
QUOTE_IF_GREEK_IS_GREASY: i agree:)
estilen: Maaate
kevin99gh: @georgehotz your doing great work n you are very entertaining triHYPERS &lt;3 are you working on anything VR related triShy
estilen: I am blind
estilen: Hahaha, thanks @esence
esence: xd
esence: dummy
QUOTE_IF_GREEK_IS_GREASY: @kevin99gh you're**
estilen: nah just blind af
kevin99gh: @quote_if_greek_is_greasy triTHICC
mutrx: why python is the real question, not very performant
sadpoopz: casually pushing to master
esence: I push to master always, you gotta problem?
JesseSkinner: me too
mutrx: i thought this was going to be a minecraft stream :(
esence: @mutrx , performance is not always #1 priority
robby0313: Thoughts on aws
esence: bloated
esence: and depends on a service
Th3G4mingbros: restart terminal for symlink to work
QUOTE_IF_GREEK_IS_GREASY: OMEGALUL S X
lllowe: yes :)
esence: only Fortnite
Plurmorant: AI can't get diamonds 4Head
mutrx: minecraft will be more challenging than advent @georgehotz
erichtp: thats the wrong numba
JesseSkinner: is he PST or central
KrrSplat: AOC &gt; Minecraft
brbdontdie: I am fairly new to veiwing on twitch stream, do the people who help already have experience working on what George is working on or are they just following along?
mutrx: minecraft will challenge @georgehotz more than advent will LUL
JesseSkinner: im just following along @brbdontdie im new here too
mutrx: @brbdontdie nobody knows what george is doing because this is stuff he's been working on for years, but we all like to thnik we all know what's going on :)
colanzio5: @mutrx he's literally just porting something to another os
prakyath_kantharaju: This is ASMR for adults
zup_zup: are you using tmux?
esence: just ask to your userbase to install VirtualBox 4Head
SGammer2142: cant you vpn in
sadpoopz: nice
mutrx: minecraft will challenge @georgehotz more than advent will LUL
esence: @georgehotz , pls cat it
zup_zup: how do you get tmux to scroll properly -- that was always my issue
IncanSilver: y'all got any of those private keys
IncanSilver: I need a private key
mutrx: only 11k commits LUL
zup_zup: what are you trying to do with commaai
IncanSilver: thanks
esence: we want your private key
btastical: now the ui fix?
mutrx: minecraft will challenge @georgehotz more than advent will LUL
brbdontdie: I want to be more useful, but I don't have a mac haha
IncanSilver: &lt;3
esence: looks good
prakyath_kantharaju: link carla to comma ai api
MrMcaustin1: Whats up George
WhiteshooZ: wtf GeoHot is casting in the "basic programming" category
mutrx: it only ran on ubuntu before?
mutrx: pc? tf
komocode_: on a Mac Pro?
prakyath_kantharaju: install ubuntu in docker, and install openpilot in docker. And then link Carla, I think that way you wont have to build in mac os.
brbdontdie: Once I graduate, I am going to try to really follow these streams. I think I am a decent programmer, but I still have a lot to learn.
mutrx: @brbdontdie you don't learn this stuff from university
komocode_: docker has been a pain at my company. fuck docker for certain use cases
zup_zup: docker is a blessing
brbdontdie: agreed. I feel like the university setting is very limited
lllowe: @prakyath_kantharaju PogChamp
esence: 14 more mins, chill
xkrnsniperx: docker docker-compose docker swarm
xkrnsniperx: yes
brbdontdie: There is no way for the university to gauge if we "learned" a lot of these skilsl
knickerbockerr: Do we have free will George
esence: time to git reset head
sadpoopz: oh no
ne3cross: https://www.portainer.io/
JesseSkinner: all that fun for nothing?
brbdontdie: I'm excited though, George is really brilliant. Hope to learn a lot from him.
esence: that's how coding is
treyshawnsongzz: i watch full ads to support the stream
xGeoTrk: Guys which is faster ? 1)Speed of light 2)GeoHotz typing
MrMcaustin1: Geroge's typing by far
mutrx: geo isn't even that fast
mutrx: i could beat him in typeracer
brbdontdie: he looks like he can type at least 100wpm
esence: yup, give the man the money
myuchelys: done
esence: wp
kubaaa6: You think its worth to take a job with facebook working on their augmented reality?
btastical: more like 120 @brbdontdie
komocode_: thanks Apple for avoiding NVIDIA
brbdontdie: yeah, I would believe it.
WhiteshooZ: sudo that bitch
esence: there we go
xkrnsniperx: gotta run as roooooooooooooooooot
komocode_: get a Mac Pro
esence: EZ -3000 dollarinoos
myuchelys: pog 1TB
mutrx: is it terminal based UI?
esence: guys, you can order the Apple Stand.
esence: iStand
prakyath_kantharaju: @mutrx its qt
mutrx: terminal based UI @georgehotz ?
zup_zup: how do you have multiple sessions in your terminal
JelloMoto_: tmux
mutrx: @zup_zup google is your friend
WhiteshooZ: RIP_ui
komocode_: i put a terminal in your terminal so you can terminal while you're terminaling
mutrx: makes him look infinitely cooler
esence: we can
ne3cross: Tmux
sadpoopz: FeelsBadMan _ui
vloood: yes
myuchelys: sounds like that mac is cookin boi
Rlchibi: 7 mins to 9 @georgehotz
dontbeameme: Ice made u
gordopeIotudo: do you mind sharing your vimrc? @georgehotz
sadpoopz: what happens at 9
mutrx: advent of code
esence: EXITING
mutrx: @georgehotz paid a LARGE premium for that GPU LUL
MrMcaustin1: seg falt rip
WhiteshooZ: Segment Fault.. lol
knilecrack: rekt
sadpoopz: great
esence: I think you need more expensive GPU to make it run
aaronfriedland: FATALITY
ataradov: It is 7:55 in CA
WhiteshooZ: glad to see one of our times greatest programmers suffers from the same problems as I do
mutrx: yes
mutrx: who tf uses mac anyway LUL
aaronfriedland: PogChamp ARCH INSTALL STREAM
lllowe: no
MrMcaustin1: Just install arch
JesseSkinner: vm?
komocode_: give up and install counter-strike beta 5.2. someone uploaded it
CraftyGaming: Hello ther
mutrx: play Halo master collection
myuchelys: yes Linux is the best right?
myuchelys: minus the desktop part
aaronfriedland: FreeBSD or GTFO
brbdontdie: Does George play video games often?
esence: he plays Fortine quite often in this stream
gordopeIotudo: would you mind sharing your vimrc? @georgehotz
mutrx: @brbdontdie twitch's largest gaming streamer
sadpoopz: oh no
WhiteshooZ: best OS would be a very subjective answer
myuchelys: ofc
esence: he just upgraded his GPU for gaming
aaronfriedland: @brbdontdie only on Mixer where he uses the name Ninja
brbdontdie: lmfaoo
komocode_: Tim Sweeny
esence: the best os is JavaScript
brbdontdie: I usually watch the youtube videos since I always miss the stream
komocode_: what do you think about John Carmack going to research AGI
prakyath_kantharaju: First check if the container is installed, docker container ls -a, docker exec -it &lt;container&gt; bash to get the bash
komocode_: os TEN
smurfd0: You dont have carla in brew?
esence: npm install carla
esence: should work
julesx416: i like how the category is "Basic" Programming
aaronfriedland: ?
JesseSkinner: what does carla use unreal engine for?
aaronfriedland: this is AutoHotkey
btastical: you're going down a deep hole with building carla on mac osx it seems
esence: he's trying to launch Fortnite
esence: on mac
sadpoopz: nice
beckles: PLAY FORTNITE
aaronfriedland: PogChamp
JesseSkinner: Setting up Mono PogChamp
mutrx: i failed the HIV test :) I learned alot
esence: grats bro
gordopeIotudo: would you mind sharing your vimrc? @georgehotz
prakyath_kantharaju: @georgehotz check docker containers installed by doing docker container ls -a
knilecrack: game is hard on macos
beckles: is that just terminal in dark mode?
esence: @prakyath_kantharaju , you sent him down this rabbit-hole!
CraftyGaming: Failing in a VM is different than failing in your main OS too. Good tip for the noobs
prakyath_kantharaju: docker container ls -a
beckles: what is carla
anup_kodlekere: is that the mac's fan at full speed?
esence: @georgehotz : https://github.com/carla-simulator/carla#building-carla
knilecrack: why dont you pull the latest?
esence: "Unfortunately we don't have official instructions to build on Mac yet, please check the progress at issue #150."
komocode_: ask lex fridman if he got carla working on mac
anup_kodlekere: lol
anup_kodlekere: they have their differences
aaronfriedland: are you using an actual Mac or a regular PC with OS X installed?
anup_kodlekere: why would he do a hackintosh?
aaronfriedland: lol
delbertooo: but couldnt you x11 forward even opengl - but horribly slow
anup_kodlekere: its got a 1tb ssd? yoooooooo
delbertooo: LIBGL_ALWAYS_INDIRECT=1 or somthing
brbdontdie: lmfao
aaronfriedland: I bought an 8TB HDD two months ago and it's already dead :)
anup_kodlekere: LUL LUL LUL LUL
anup_kodlekere: I lost an external one. Had so much cool shit on it tho
aaronfriedland: @esence a sentence like that is a good way to end up on a list
anup_kodlekere: amen
Its_LilRyan: Or 2
mutrx: when r we playing minecraft
btastical: try looking into headless carla maybe? https://github.com/carla-simulator/carla/issues/1112
MrMcaustin1: Yo @esence lets not talk about CP
MrMcaustin1: f
dprophecyguy: Hi George
coProof: geo my boii
Themeow1: I was told it was easy to get banned here
Themeow1: So where is my ban
btastical: look at the headless one. I dont think carla works without providing display information
prakyath_kantharaju: go to docker bash
coProof: yay this looks fun
coProof: ME TOO GEORGE
delbertooo: god i hate dynamic linking
crazycatz59: so how is this going to let us run openpilot on a mac?
coProof: why do we have to dynamically link because mac?
MrMcaustin1: #BanLinking
hardtarget4: linking is a scam
anup_kodlekere: he does have a lot of patience though. I could never do all this i'd just break my pc
JustAnEdtior: does george have a degree?
crazycatz59: no
crazycatz59: you dont need one for what he's doing so who cares?
hardtarget4: porting is torture
fasterthanlight13: new error Pog
MrMcaustin1: Is there a headless version of carla you can use?
btastical: look at the headless one. I dont think carla works without providing display information
JeanFrag: Pog progress?
coProof: a degree in patience... isnt life just one error after the other?
crazycatz59: using an SSL series compressor on a dance kick makes no ****ing sense whatsoever
hardtarget4: rm
knilecrack: docker rm or docker rmi
coProof: F those containers
delbertooo: @georgehotz you can actually run them with --rm to remove the container after returning... like docker run --rm carla
coProof: rm -rf *
BiTvon: What hair product do you use
zeroeagle1: rm -rf /
CraftyGaming: no sudo @zeroeagle1 ?
btastical: "-ti /bin/bash"
zeroeagle1: always use sudo -r
430i: -it
zeroeagle1: first thing when you log: sudo -r
smurfd0: Tinkering=good stream :)
anup_kodlekere: @crazycatz59 wasn't that deadmau5? LUL
QuantumDota: major noob alert
btastical: https://github.com/carla-simulator/carla/issues/1112
crazycatz59: @anup_kodlekere yes
QuantumDota: good luck getting X working inside a docker container on a Mac
QuantumDota: Why aren't you using Linux, it's so much easier
crazycatz59: did you read the title?
MrMcaustin1: brb going to get some ice cream
myuchelys: =/
coProof: coProof subscribed at Tier 1. They've subscribed for 3 months! docker inside docker inside docker plz
zeroeagle1: at job we need to use some windows eocker images networking suck
crazycatz59: pog
KNOOKEL_HEAD: windows master race Kappa
KNOOKEL_HEAD: *pc randomly shuts off to download updates*
anup_kodlekere: lol
zeroeagle1: finally dominos guy came
coProof: sersly this happens a lot
crazycatz59: imagine typing ls on a directory you just created
lebop: someone ELI5 what hes trying to do thx
delbertooo: gl on this dude, i need to sleep now. waiting for the vod
anup_kodlekere: I think most problems on python can be solved by standardizing one version, or am I delusional?
coProof: gcc PepeHands
MrMcaustin1: MrMcaustin1 is gifting 6 Tier 1 Subs to georgehotz's community! They've gifted a total of 6 in the channel!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to vloood!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to leopp!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to MichaelA1337!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to dgkng0d!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to TheKoreanZombi!
MrMcaustin1: MrMcaustin1 gifted a Tier 1 sub to Xingjuice!
MrMcaustin1: MrMcaustin1's Gift shared rewards to 25 others in Chat!
crazycatz59: Pog
BiTvon: Relax
myuchelys: Pog
MrMcaustin1: Felt in the holiday spirit ;)
fasterthanlight13: Thanks for the HahaBall @mrmcaustin1
KrrSplat: Poggers
MrMcaustin1: Of course
MrMcaustin1: Just need george to see it now
MrMcaustin1: lol
zeroeagle1: lol gl
coProof: @MrMcaustin1 he is blind
myuchelys: @MrMcaustin1 doin the Simulation's work
anup_kodlekere: yaaay he saw
MrMcaustin1: Ill do another 4 to 6 another stream. Anything to please George
FwgKing: Can really see his happiness LUL
coProof: Mr. Simulation is happy too
big_coke_head: dodged PogChamp
btastical: half an hour to 9
ranza_dk: thats a lot of gifts
lebop: ty MrMcaustin1 !
MrMcaustin1: Of course
CraftyGaming: Didnt you already update unreal? Or what was that 9GB download you did?
lebop: why no emotes or sub icon though?
ranza_dk: wait... did you mention the keyboard?
techie163: techie163 subscribed with Twitch Prime.
MrMcaustin1: gg techie163
crazycatz59: look at all them subs today PogChamp
big_coke_head: HahaDreidel @techie163
Mabaet: !uptime
coProof: ofc F yeah lets build that unreal engine
knilecrack: why stop now?
zeroeagle1: :O
knilecrack: we believe in you
futu_rum: XD
delbertooo: @georgehotz does this ubuntu thingy have docker with docker-nvidia extension or the ability to have this?
BiTvon: Isn’t getting it running supposed to be the easy part
crazycatz59: You gotta not get a job so you can suffer by by building unreal engine
zeroeagle1: at least ur not waiting for your build on a single build CI for your team
CraftyGaming: time to write a new kernel
coProof: lets write a new kerlnel
MrMcaustin1: Time to just write the code from binary
coProof: 0101010111101
crazycatz59: twitchcoq
CraftyGaming: Well you need a different means of file relations to remove the need to build at all
big_coke_head: @zeroeagle1 oof
anirudhrautela: @georgehotz Tea time :-)
zeroeagle1: @big_coke_head the other day had to change something in every microservices took like 20 minutes...
zetleri: sup
crazycatz59: but isn't that in production
mdrake_: wait it isn't sunday yet
crazycatz59: nope
crazycatz59: still got 22 mins
Gtxgaming23: time != sunday
zetleri: its been sunday for 6h's already
MrMcaustin1: You got about 20 minutes George
coProof: Ubunut16.04
coProof: ?
Gtxgaming23: i just got here, what me making here
zetleri: LTS
coProof: @Gtxgaming23 were trying to do naughty things on a mac
Gtxgaming23: i like naughty. how naughty we talking about
zeroeagle1: stream dead?
CraftyGaming: no
MrMcaustin1: streams alive
zetleri: so slow to compile
martinstuessy: o/
MrMcaustin1: Compiling is a blessing and a curse
CraftyGaming: Remember kids, always create a gui interface using visual basic to track the killers ip address
aaronfriedland: then use LOIC :tf:
zeroeagle1: then get busted as a script kiddy
erichtp: @craftygaming using more hands at a keyboard makes typing faster
crazycatz59: @erichtp bet
aaronfriedland: but at least I get to brag to my buddies in IRC first
robby0313: When can we see more HackTheBox
Gibby5: does anyone know how git gud with vim?
esence: unbind arrow keys and just jump into it
coProof: i didnt know you released data
MrMcaustin1: Gibby5 look up vim adventures
oMythra: do the default tutorial and check out 'Learn Vim for the Last Time' by daniel miessler @Gibby5
MrMcaustin1: @georgehotz aria2
myuchelys: oh very nice, thank you @MrMcaustin1
zeroeagle1: it is now allowed to talk about comma?
MrMcaustin1: 10 minutes
CraftyGaming: definitely do vimtutor @Gibby5
zeroeagle1: proud to be part of that stream
BigBrainDota: is it allowed to talk about the keyboard?
zeroeagle1: !timeout
Vayrus_: What is he coding?
aaronfriedland: Advent of Code? Is that a programming game or something?
oMythra: a series of problems, one every day for the month @aaronfriedland
aaronfriedland: oh that's cool
oMythra: they build on each other too
Mabaet: y he doin comma ai? he say no comma related in his strims
zetleri: @georgehotz "fun"
coProof: im having fun :)
esence: no i am :)
lithiumx4900: put it in a docker? then have it listen on a port and use the port
crazycatz59: I'm supposed to be doing useful things like building art skills but instead I'm watching george raging at a compiler
electro_y0: :)
aaronfriedland: I'm just barely learning how to use Python and AutoHotkey right now. Automated one of my boring work tasks with it.
KrrSplat: 8 minutes till 9
zetleri: useful != art skills
zeroeagle1: george what happenned to the 'tomcruse" twitch channel?
prakyath_kantharaju: Damn, that looks neat. AF
esence: 5 more mins, go get some tea!
georgehotz: my.comma.ai
coProof: Apple is so big that George needs to work over break
BiTvon: Work hard play 😓 I
crazycatz59: wow, genius
MrMcaustin1: 2 minutes
raiikouu: timer monkaS
raiikouu: 25 seconds left monkaSD
khilshot: yo
jluiiizz: Are you doing AoC using python ? @georgehotz
raiikouu: When will you get your Jetskie @georgehotz
zeroeagle1: is that the AI: if A==1 :..
raiikouu: i dont understand a single word but i love it LULW
CraftyGaming: would a* fit well here?
MrMcaustin1: yeah
MrMcaustin1: but thats if we knew the map
CraftyGaming: I'm a little blind ehre but cant you build the map by moving around?
MrMcaustin1: Yes you could
mutrx: has geo been doing the previous ones or just 15?
CraftyGaming: I missed a little of the problem and only know what george is saying
MrMcaustin1: He hardly read the problem
CraftyGaming: welp, theres the map
oMythra: he did previous ones off stream @mutrx
mutrx: @oMythra ty
MrMcaustin1: Just multi thread the thing and then run a lot of them Kappa
CraftyGaming: start at a random spot every time and then launch 20 instances Kappa
zeroeagle1: if you dont know the map there are no better solution then a greedy algorithm right?
raiikouu: i agree Kappa
CraftyGaming: recursive flood fill, then A*
raiikouu: i understand everything Kappa
MrMcaustin1: If we have infinite time and memory we can solve anything in 0 time
zeroeagle1: if you explore every "node" you will a* won't be necessary
CraftyGaming: well, if you store every path taken, but that could be bad if the map is huge
CraftyGaming: and you arent guarenteed best path with flood fill
raiikouu: does he need to hurry or why isnt he looking at chat
raiikouu: nevermind
zeroeagle1: I thought the problem was to find the oxygen tank
archeadis: use pypy to speed it up
raiikouu: question answered
raiikouu: LUL
CraftyGaming: If I understand the problem, I think he nees to provide the shortest path to it
MrMcaustin1: Multithread it
ByForever: what is this? some competition?
MrMcaustin1: Yes ByForever
zeroeagle1: oh I see
Jok4ndre: what is that website?
oMythra: Advent of Code
MrMcaustin1: adventofocde.com
KrrSplat: Adventofcode.com i think
Crypod: @MrMcaustin1 code* monkaS
raiikouu: ye
MrMcaustin1: u right
raiikouu: CraftyGaming and I think hes looking for the shortest way too rn
raiikouu: he said he can backtrakc it or smth
CraftyGaming: yeah, A* uses backtracking
zeroeagle1: have you ever had to use a* at your job?
CraftyGaming: That being said, I couldnt write it myself without wikipedia
CraftyGaming: I used A* for a dumb AI in a VR game I made
MrMcaustin1: gg
raiikouu: so a* is a search algorithm yes?
unnamedtroll: PogChamp PogChamp PogChamp PogChamp PogChamp
lllowe: PogChamp
CraftyGaming: it returns shortest path
KrrSplat: PogChamp
MrMcaustin1: Yes raiikouu
raiikouu: okok
Gibby5: damn
raiikouu: im learning nice
blondephilia: Depth First LUL
CraftyGaming: or identifies it, I guess
raiikouu: learning by watching pros, jsut like league of legends
raiikouu: ezypzy Kappa
ByForever: it s impossible for me to understand hes too fast
zacho5002: zacho5002 subscribed with Twitch Prime.
CraftyGaming: a* is super cool and pretty easy to implement yourself!
MrMcaustin1: Thanks zacho5002 !!
zeroeagle1: if your goal is to learn this isn't the best place to learn practical things...
zacho5002: @MrMcaustin1 yep! putting this sub on my resume!
ByForever: do u not use ur mouse
CraftyGaming: LUL
MrMcaustin1: haha def will get you hired
zacho5002: lmao
oMythra: no need if you're good with vim and working in terminal @ByForever
erichtp: Watching this increases IQstats high enough to understand rick and morty humor
raiikouu: haHAA
Obelisk2u: what is he working on
CraftyGaming: is printing everything overhead?
raiikouu: adventofcode Obelisk2u
zeroeagle1: io slow
mutrx: @CraftyGaming pretty sure it iso
raiikouu: soemthing with ocygen
raiikouu: and a robot
raiikouu: and a map
raiikouu: thats what I know
MrMcaustin1: io is always slow
zeroeagle1: but still faster then doing a build xD
CraftyGaming: that should take that long lol
CraftyGaming: shouldn't
raiikouu: did anyone solve it alrdy?
CraftyGaming: wow, even making tmp files...verbose
oMythra: HahaShrugLeft HahaShrugMiddle HahaShrugRight
mutrx: 10 people
mutrx: have solved apready
aaronfriedland: @raiikouu https://adventofcode.com/2019/stats
raiikouu: damn
ByForever: is this mac or linux
raiikouu: mac
zeroeagle1: what is line 5 doing?
MrMcaustin1: Reading in a file and ignoring part of it
zeroeagle1: oh yeah i see
MrMcaustin1: ew n^2
CraftyGaming: does looping backwards stop the array resize error in python?
mikey9988: LUL @MrMcaustin1
MrMcaustin1: Yeah I think it does
mutrx: couldn't u just brute force the api to get a correct input LUL
MrMcaustin1: No they limit yuou mutrx
mutrx: @MrMcaustin1 makes sense
bigduddas: lol this shit seems risky af
CraftyGaming: does that mean its a 799x799 maze?
Vjasal: @georgehotz czn oxygen flow down?
MrMcaustin1: 800x800 dont forget the 0th element CraftyGaming
raiikouu: ratirlSweat my brain is melting
CraftyGaming: he did len, wouldnt that be all of them?
MrMcaustin1: oh yeah my b
CraftyGaming: georges gold star
oMythra: POG
raiikouu: so
Crypod: let it all out SwiftRage
mikey9988: PogChamp
knilecrack: what day of AOC?
SOEMBODY: PogChamp
raiikouu: what happened LUL
bigduddas: fuck yeah i was here
knilecrack: oh day 15
knilecrack: nice
mutrx: hi youtube
mutrx: LUL
treestompztv: my man
raiikouu: do they get anything after all 25 days?
SOEMBODY: monkaS
the_shining: very nice
raiikouu: is there a prizepool or just 4fun
MrMcaustin1: @raiikouu gratification
raiikouu: welp
ByForever: theres reward for this?
mutrx: serotonin
CraftyGaming: rescuing santa
raiikouu: Pog
raiikouu: Santa wuhu
Gibby5: dopamine not serotonin
Gibby5: serotonin is for pair bonding stuff
mutrx: serotonin ™ and dopamine ©
raiikouu: its just for flex ratirlFlex
mutrx: @Gibby5 Serotonin is an important chemical and neurotransmitter in the human body
mutrx: you already acquired your daily dose of serotonin™ and dopamine© @georgehotz be happy
zeroeagle1: thought 42 was always the answer
mutrx: do the impossible quiz next
raiikouu: no germans top 20 ratirlSad
CraftyGaming: #1 guy is some MIT student
ByForever: can people cheat in this by giving answers to friends?&gt;
mutrx: i think they randomly generate the problem for each user?
jasplano: what version of javascript is this
mutrx: 3.0
3ygun: Is he tuning hyper params or something?
zeroeagle1: the newest js frontend framework
KrrSplat: You probably will have to keep building on the code everyday, small bs now will snowball later
mutrx: 372
3ygun: ooooh he's doing advent of code
KrrSplat: He just finished this day
raiikouu: he finished
7Locrian7: 7Locrian7 subscribed at Tier 1. They've subscribed for 3 months! another accidental sub, sorry no more after this
KrrSplat: 482???
mutrx: the next advent @georgehotz https://the-impossible-quiz-game.com/the-impossible
raiikouu: that was fun to watch
virtual_machine: what's he doing here?
AlexEDM: love it
raiikouu: even if i understood nothing
mutrx: that was fun
weedlord666: ya
extracheese42: ya
mikey9988: graph it PogChamp
zetleri: yes
mutrx: yes
mutrx: 99%
zeroeagle1: you still need to know what ur doing in order to write goood crap
MrMcaustin1: jcmathews we dont talk about that here
mutrx: beautiful
yaus_baus: george streaming what a nice surprise
raiikouu: damn
Knarez: spammer no spamming DansGame
the_shining: nice
mikey9988: EZ Clap
extracheese42: t hat was fun
mutrx: @mods ban jcmathews
raiikouu:  1 ^
3ygun: Failure at life LUL Kappa
leopp: Do you actually press ESC to quit INSERT mode or remap to another key?
MrMcaustin1: jcmathews last warning we dont talk about that here
mutrx: now what squadW
extremelywide: favorite lang?
yaus_baus: is this a maze
MrMcaustin1: Not a sub
raiikouu: "ask about keyboard = ban" LUL
zetleri: First rule of keyboard is not to talk about keyboard
raiikouu: ahahha
squiggly_nibba: back to Carla!
Abnico: https://paveldogreat.github.io/WebGL-Fluid-Simulation/
SOEMBODY: Why dont you talk about it
MrMcaustin1: Ha f
earthbender: monkaS
mutrx: f
mikey9988: F
yaus_baus: yeeted that mf
raiikouu: haahh f
extremelywide: @georgehotz favorite lang to use?
mutrx: what are we doing now dad
raiikouu: unlucky dude
mutrx: EXHAUSTING
raiikouu: jcmathews c u in 10 mins
aaronfriedland: @extremelywide HolyC
raiikouu: did he get place1 on any day?
raiikouu: first place*
Knarez: junk below line LUL
hmmmu: BFS
mutrx: a*?
weedlord666: djikstras
12btw_: i have see this backround befor on a other streamer TheThing
undeadman_: hi all
MrMcaustin1: a* georgehotz
mutrx: https://en.wikipedia.org/wiki/A*_search_algorithm
Viper4060: Sounds like a Massdrop Alt (I am not asking I am telling)
zEveery: Can u explain the challenge ? Got here right now.
CraftyGaming: wall follower is a terrible maze solver, so inefficient
CraftyGaming: Works great in person
MrMcaustin1: Facts have used wall follower irl
aaronfriedland: One day George is going to have a keyboard Peeping Tom
CraftyGaming: I'm a corn maze champion using always turn left :P
weedlord666: @georgehotz https://pragprog.com/book/jbmaze/mazes-for-programmers
MrMcaustin1: CraftyGaming right hand on the right wall always ;)
CraftyGaming: sounds like a competition is brewing
CraftyGaming: left vs right
mutrx: a*
zetleri: go left always
12btw_: Any news to the hack contest days ago`?
MrMcaustin1: Left will get you stuck in dead ends
MrMcaustin1: Or so I ahve hear
zetleri: infinite left
MrMcaustin1: Can't attest to it
aaronfriedland: there's a reason UPS drivers only turn right
CraftyGaming: well, arguably, left is the same as right
mutrx: https://en.wikipedia.org/wiki/A*_search_algorithm#Implementation_details
yaus_baus: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.302.4944&amp;rep=rep1&amp;type=pdf
CraftyGaming: theres no difference beside the sound of the word when you say it
aaronfriedland: "both sides are wrong"
AlexEDM: wikipedia always asking for money :D
CraftyGaming: I donate to wiki periodically
AlexEDM: how much, if you don't mind me asking?
CraftyGaming: enough to fund the site for a while
aaronfriedland: I donate to Chaturbate daily
AlexEDM: nice, man.
AlexEDM: lol @aaronfriedland
zeroeagle1: -always expllore un-explored then a* the closest point next to unexplored, repeat untill finish?
yaus_baus: i sent them the 3 dollars they asked for
yaus_baus: was feeling generous
CraftyGaming: oh yeah! joints!
AlexEDM: does the AD go away after that? @yaus_baus
CraftyGaming: I saw uhhh, the coding train guy do that one I think
yaus_baus: no haha
AlexEDM: LOL
yaus_baus: paintbrush algorithm sounds interesting
vloood: is he still doing openpilot on mac?
zetleri: no
bytebacon: A-star explained by Computerphile https://www.youtube.com/watch?v=ySN5Wnu88nE&amp;t
squiggly_nibba: I think he gave up
vloood: he's doing a maze solver?
CraftyGaming: I love me some computerphile
12btw_: MAC user , at the end we a bit WE SAFE , he is handicapped. from the OS
xEvilCorp: what is he solving?
mutrx: @xEvilCorp advent of code
CraftyGaming: He solved an adventofcode problem, and is now optimizing it @xEvilCorp
xEvilCorp: cool
CraftyGaming: I have my gunnar glasses on
aaronfriedland: I got a prescription for a blue tint filter from my doctor 4Head
aaronfriedland: blue light filter
aaronfriedland: it' slate
CraftyGaming: LUL I though you were getting a prescription to enhance the blue light
jcmathews: are you a happy hacker or a sad hacker?
aaronfriedland: that would incapacitate me
aaronfriedland: I have migraines like 75% of the time on average lol
CraftyGaming: 20/20 rule
bin3o: @georgehotz hire me as your intern
LovleyBarbecue: is this css?
zetleri: yes css
bin3o: Python3
CraftyGaming: scratch
LovleyBarbecue: nice i love css
aaronfriedland: my cousin's 6 year old is a scratch god
aaronfriedland: actually idk but she fucks with it a lot
zetleri: would be cooler if he was rap god
yaus_baus: lizthegray is doing advent of code too rn
xEvilCorp: what if you create a self learning ai, give senses to it, make it understand some form of structured language and logic, then make it understand all concepts and generate conclusions and then make it optimize this code for you?
zetleri: wat
aaronfriedland: appropriate username
CraftyGaming: If we create AI and control them, is it slavery?
zetleri: only if you make it pick cotton
OnlyB1ade: sick
CraftyGaming: not really within the scope of the question, but alrighty
jcmathews: !mouse
yaus_baus: tbh a cotton picking machine would take the burden of manual labor of anyone currently in that industry
yaus_baus: automation is inevitable
experimental_warrior: Hey there, what is he working on?
xEvilCorp: he's fast typing, looks like a hacker from the movies
jcmathews: yeah his key***** go fast
zetleri: buttonboard?
OnlyB1ade: clean
cogforkd: hello hello
zetleri: mechanical input device?
cogforkd: how are you doing george?
cogforkd: long time no see
cogforkd: missed you dearly!!
xEvilCorp: why does he ban viewers that ask about the typer?
CraftyGaming: shh
yaus_baus: go watch the rank about it
eshoshin: because it gets asked endlessly
Knarez: because who gives a shit what his keyboard is lol
yaus_baus: rant*
zacho5002: what chair he usin
CraftyGaming: finally, recursion!
jcmathews: !refrigerator
xEvilCorp: this thing sounds really great though
zetleri: the real question is what kinda socks he is wearing
jcmathews: change category to ASMR
eshoshin: the tea he drinks. That's the secret sauce
yaus_baus: george as a professor
not9k: what is he working on
yaus_baus: shit would be dank
cogforkd: man.. i really like your focus!!
jcmathews: hes learning visual basic
CraftyGaming: I think A* is a breadth first prioritizing paths nearer to the goal
cogforkd: i tried to fast tyoe like you... am making a LOT of mistakes while i type... any tips!!
Knarez: are you putting your junk code on github?
veomx: how is it in san diego? good city?
CraftyGaming: true
yaus_baus: the archives are incomplete
Knarez: i did mine with generators
jcmathews: is that a herman miller
bytebacon: @jcmathews indeed it is
CraftyGaming: Your solution to this problem @Knarez ?&gt;
jcmathews: he didnt actually pee, he just went to flush so he could show off his herman miller
Knarez: ye the intcode thing, made the state stuff easy
AlexEDM: lol @jcmathews
xEvilCorp: do you watch the expanse?
cogforkd: please giev us some insights about "LIFE" and "PROGRAMMING" and "CODING" and "getting girlfriends" and "learning new things" in programming,, becomming good at coding and never turning back! please talk/rant anything
jcmathews: wanna collab @AlexEDM
yaus_baus: ^^that
Knarez: LUL
Knarez: i didnt do yesterday's yet
Knarez: dont want to write the input parser for that crap, prob do it in a bit
AlexEDM: huh? @jcmathews
coProof: okay
cogforkd: please giev us some insights about "LIFE" and "PROGRAMMING" and "CODING" and "getting girlfriends" and "learning new things" in programming,, becomming good at coding and never turning back! please talk/rant anything
yaus_baus: ^^
calmchowder: LOL
Knarez: inception o.o
yaus_baus: hell yeah
coProof: lets rant about building linux kerns
MrMcaustin1: cogforkd lets not spam the same message
h4sb: spacex
LovleyBarbecue: u smoke weed geo baby
jay_al97: hahah
cogforkd: and making money!!
colanzio5: What do you actually think about docker?
Knarez: 100 that guy is high
captionthis22: code a jarvis
coProof: follow george on insta!
CraftyGaming: I'd like to hear a good "Here's the problem with docker" rant
yaus_baus: would you live in europe
yaus_baus: i wanna move
CraftyGaming: Here we go
krnflake1: yo @georgehotz I need to know which MacOS apps you're having in your status bar on the upper right
lebop: I'd like to hear a good "Here's the problem with docker" rant
picklesareok: what a segue
knilecrack: that is the minimum for docker :)
barretois: what do you think of software engineering?
Mabaet: what u think of silicon valley s6 finale?
yaus_baus: bay area life is wack
anup_kodlekere: how's life bro
PapaDukie: do you use vanilla vim or do you have any plugins / must-have stuff in your vimrc
eaterenrgy: Opinions on using python for a long term project, whether its a good idea or not?
CraftyGaming: It's wild out there man
picklesareok: what do you not like about their values? what were their values or whatever?
the_shining: finish?
yaus_baus: i met a guy from spain today, it sounded dope
AlexEDM: you live in an apartment or house?
CraftyGaming: Python 3.8?
picklesareok: oof
chancechants: mcretHahaa
Knarez: LOL
yaus_baus: he got a rooftop suite in madrid for 1k euro/mo
AlexEDM: damn
Knarez: bro they take a 2 hour lunch break
yaus_baus: mustbenice
Knarez: siesta time
knilecrack: rofl
mikey9988: lunch break is no joke in spain KEKW
yaus_baus: bro chad neet life in spain
VANRA: @georgehotz im beginner to cp... should i just do beginner problems or read a basic book about algos
vloood: who's a death cult?
zEveery: U did any degree? Also, do u think math is really a thing to learn (like a crazy) or just have some knowledge about data structures?
lebop: why not london george
mikey9988: i hope you really mean cs @VANRA
knilecrack: come to serbia dude, I can hook you up :)
cogforkd: cogforkd subscribed at Tier 1.
anup_kodlekere: best stuff to drink?
MrMcaustin1: Thanks cogforkd
CraftyGaming: ayyyy @cogforkd
jcmathews: do you believe math was invented or discovered?
Knarez: germany?
Columbugo: yugwhaHi yugwhaHi
VANRA: @mikey9988 nahhhh cp
lebop: what do you think about LA? @georgehotz
bytebacon: come to india!
yaus_baus: thoughts on Mochizuki
mikey9988: was a joke @VANRA :)
Knarez: LUL
JeanFrag: what do you mean by death cult? idealizing suicide?
Knarez: cows are sacred asf
Columbugo: #moomoo
sk84uhlivin: @georgehotz Are you at the best point in your life
coProof: what about google coral board
bytebacon: amazing butter chicken here in India
the_shining: i come from china
mascer95: @georgehotz I’m pretty new to coding and want to do the AoC as a challenge to myself. Is there a way to see other peoples solutions?
zetleri: portugal has all drugs decriminalized
yaus_baus: inter-universal Teichmüller theory
yaus_baus: mochi's work
LovleyBarbecue: What do u think about australia
PapaDukie: is the status there based on programming abilities or $ made
lebop: Brazil
anup_kodlekere: do you like people watching your streams over doing something productive themselves?
Columbugo: hachuDisgust hachuFlag
CraftyGaming: Sometimes george's streams can be inspiring. I always practice my touch typing afterwards because im awful
cogforkd: hey george, am the same person who had asked "not to be a noob" lat time. anyway, please talking about your "how you learnt programming" and what you did to become "BETTER"
bytebacon: Which internet services do you currently subscribe to?
anup_kodlekere: it is addictive though
coProof: the optimization function is twitch
JeanFrag: your stream makes me continue thinking about coding, it would be great if you did it more often @georgehotz
jay_al97: I actually sometimes watch your stream while working
MrMcaustin1: You become programming
yaus_baus: programming learns you?
WOLVESpls: 4Head
the_shining: What time is it there?
veomx: learning by doing
CraftyGaming: c   bad example lol
TalonFire: literally zero people know C  
blondephilia: Then maybe you know it. haha
jcmathews: favorite free key***** p*** sites?
coProof: then just die
picklesareok: you marinate yourself in code
coProof: Kappa
mutrx: is @georgehotz smoking again
MrMcaustin1: Its all about the journey
SaltMyDalt_: why do you like open source
coProof: just type "rm -rf /" you become programmer
veomx: you maybe on tomorrow`?
Knarez: whats your bedtime big guy
CraftyGaming: Time for bed, have a good night folks
Columbugo: the journey PogChamp
mutrx: what Ke- wait nvm...
MrMcaustin1: Night CraftyGaming
CraftyGaming: &lt;3
lebop: what do you think about the Lua language? @georgehotz
anup_kodlekere: how long do you sleep?
mutrx: can i be a mod
zetleri: how wide is your bed
mutrx: :)
PapaDukie: do you like physics
AlexEDM: lol
mutrx: its a single bed
knilecrack: HOW WIDE IS YOUR BED AHAHAHAHAHA
yaus_baus: apartment tour
coProof: what is the depth of your bed
mikey9988: LUL
Mabaet: what does snails even do
supremezy: what do you think about ai in stock market and forex and such
picklesareok: LUL
canyoufeelitnowmr_krabs: what size is your bed? king?
Knarez: is that your bed in the background LUL
AlexEDM: what's the surface area of your bed?
hildl0rdi: hildl0rdi subscribed with Twitch Prime.
canyoufeelitnowmr_krabs: what food do you eat at 3am
jcmathews: does your !refrigerator have a crushed ice function
forkdb: Did you please answer my question?
MrMcaustin1: Thanks hildl0rdi
yaus_baus: snails are food for french people
Knarez: what's the optimal breakfast
vtcN_: i've always wondered how many miles of toilet paper the average human being uses in a lifetime
lebop: thoughts on the Lua language
anup_kodlekere: hows the cloud
veomx: why we have two hours time difference?
mutrx: do you cut ur bread diagonally or in half?
AlexEDM: hahaha
yaus_baus: holt
yaus_baus: holy
vloood: you should switch to wipes bruh
yaus_baus: get this man a bidet
jcmathews: does your toilet water flush clockwise or counter clockwise?
picklesareok: front to back, or back to front?
Columbugo: do fish drink water? yugwhaG
mutrx: do you cut ur bread diagonally or in half??
coProof: we need to cut back :)
vtcN_: lol
knilecrack: clockwise bro north hemisphere
LovleyBarbecue: I shit 4 times a day
AlexEDM: that's nothing - I could easily top that!
TheRockingM: Bidets for everyone
colanzio5: Literally spent an hour yesterday googling snails after eating an edible fml SabaPing
Knarez: live to be 100 goddamn
AlexEDM: also, you didn't account for all the diarrhea I have
thezilion: @georgehotz honestly, the question frequently: linux or windows?
yaus_baus: we stay shitting for 20 miles cuz
coProof: once
lebop: @georgehotz answer pls
picklesareok: isnt it a bit weird that we shit and piss into literal gallons of fresh water
mutrx: in the toilet duh
cogforkd: This is my question@georgehotz hey george, am the same person who had asked "not to be a noob" lat time. anyway, please talking about your "how you learnt programming" and what you did to become "BETTER" bytebacon:
vtcN_: run outta water LMAO
coProof: yeah we will though it will turn to h39
picklesareok: we're not gonna run out of salt watter
coProof: h3o
veomx: ice cubes
yaus_baus: it flows off the edge
Conadora: hotz do you bug bounty?
supremezy: what about sewage
coProof: donald trump argument NotLikeThis
picklesareok: stars can do that
mutrx: what is the last thing you bought on amazon
anup_kodlekere: massenergyohmy
JeanFrag: well not more than what it cost, at least right now
WOLVESpls: LUL
euranymous: MindBlow
vloood: free macdonalds apple pie on uber eats
TheRockingM: we should go with thorium for now
mutrx: wind and solar is better than nuclear
Columbugo: !uptime
anup_kodlekere: nah nuclears better
coProof: so are we okay in the future mr geohot?
JustAnEdtior: hi george
forkdb: Please answer my question..
vloood: yeah 2
yaus_baus: oh shit
forkdb: Am dying to hear from you
Gorums_1: are we in a simulation?
the_shining: Do you like noodles
jc_alvaradov: jc_alvaradov subscribed at Tier 1. They've subscribed for 3 months! love you geo
veomx: pickle rick!!
canyoufeelitnowmr_krabs: @Gorums_1 yeah the next patch is taking too long to ship
mutrx: is orange man bad?
euranymous: what do you think about Elon Musk? I think he's over rated and he is just doing everything for business
yaus_baus: is mars a scam
mf_slim: if you got your nipples pierced would you get bars or rings?
knilecrack: you should have your podcast high-talk show
coProof: the moon was a scam :)
lebop: thoughts on Lua @georgehotz
zetleri: yes
yaus_baus: podcast
knilecrack: no politics
yaus_baus: id pay
bytebacon: watch the octohedron series: https://www.youtube.com/watch?v=GctjEwP_gkY&amp;list=PL48gf6Pmx2jn9BglnSU6_q3P7ZBSubK_V
JeanFrag: not only politics would be better
knilecrack: you said no politics in the channel
mutrx: joe rogan
AlexEDM: TED Talk instead
MrMcaustin1: Joe ROgan
jcmathews: when did nelson mandela die
WOLVESpls: LUL
zetleri: yeah you should go JRE
mutrx: joe ROGAN
knilecrack: rofl
coProof: must watch a lot to perfect those impressions
anup_kodlekere: do some ASMR whispering
forkdb: Your thoughts on Julia?? Or you like python??
vloood: you don't have enough vocal fry
Columbugo: ok boomer LUL
yaus_baus: npr is audio hypnotism for bay area commuting
euranymous: okay boomer
mutrx: are traps gay?
coProof: KKonaW
WOLVESpls: ASMR Kreygasm
myuchelys: Pelosi looks like she constantly having a seizure
Knarez: bedtime storys feelscomfyman
jcmathews: this is almost as calming as your beating your key*****
blondephilia: don't think he can answer about Elon. He offered him a job.
bytebacon: panda support for cybertruck!
Knarez: bernie is 78 :(
euranymous: Elon is just another business man. change my mind!
mutrx: why is this a wholesome stream all of a sudden
AlexEDM: the screens within a screen are hypnotizing
picklesareok: big if true
anup_kodlekere: what about Apple?
MrMcaustin1: Andrew Yang
ethancruize: sorry im not a subscriber im poor, but when is hacking/ctf agiain ?
anup_kodlekere: YangGang
mutrx: did you see his anime intro?
big_coke_head: how r u gonna spend ur yang bucks
jay_al97: space x is cool but Im not too hopeful of the project
zetleri: hatGAme
SimStig: spacex is rocking at the moment
veomx: elon is from the future... he scared me talking about AI :D
mutrx: https://www.youtube.com/watch?v=K1jUJ-2MsdA
canyoufeelitnowmr_krabs: we need ubi so i can order more food to my house
Knarez: have you ever worn the maga hat in public? LUL
mutrx: unwarranted
AlexEDM: you need Nightbot :D
MrMcaustin1: AlexEDM nah he got me
euranymous: @georgehotz what kind of narcotic are you tripping on?
anup_kodlekere: just pull the cables
Knarez: you'd get SHIT on lmao
SimStig: AI is overblown... its still coded by humans
bytebacon: L-Theanine
mutrx: im calling the police rn
MrMcaustin1: Checks his watch to see if hes on drugs
AlexEDM: lol
colanzio5: I mean, if you think about Elon as a character like Geohot is a character the AI thing makes more sense
12btw_: How mutch the GOV pay you?
banned4mysins: hey george, do u have an advice about starting machine learning? i have math background but dont want to waste time o uni
yaus_baus: was gonna comment on watch
euranymous: oops this is a Christian channel
MrMcaustin1: hmmm
MrMcaustin1: sus
yaus_baus: oh its 1025
Knarez: will you be streaming adventofcode again tmrw?
knilecrack: damn
veomx: amen
zetleri: hotz is siliconvalley lsd microdoser
mutrx: make a christian minecraft server
mutrx: how much wam
anup_kodlekere: hallelujah
myuchelys: lmao
MrMcaustin1: Medium is wack
picklesareok: microdosing is for pansies
Knarez: cringe
mutrx: https://www.youtube.com/watch?v=wsO-Td0hqXo
knilecrack: medum posts are sometimes retarded as fuck
vtcN_: @picklesareok real men overdose
bytebacon: Stream on structure from motion and camera pose estimation
mutrx: watch the youtube its worth it
coProof: sudo apt-get more-ram
euranymous: The power of Christ compels you. Elon is just another businessman
12btw_: !sr PWv7FVA7MIw
TalonFire: what size SSD you got?
jcmathews: shampoo?
Senpai_Teach: you can spoof it ?
mikey9988: EZ free ram
coProof: i dont believe it
mutrx: what toilet paper do u got
anup_kodlekere: 1TB
TalonFire: PogChamp
knilecrack: he uses news paper
yaus_baus: is hair conditioner a scam
anup_kodlekere: LUL LUL
euranymous: do you like Leopold keyboards?
subconix: hair conditioner is a scam. Buy a 2 in 1
TalonFire: LUL
MrMcaustin1: DEDOTADED WAMMMM
WOLVESpls: this guy is a legend
knilecrack: ahahahahahaha
Senpai_Teach: HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall HahaDoge HahaBall
mutrx: the awkward moments are gold
forkdb: Julia or python?
knilecrack: ahahahaha
vtcN_: very tehcnical
myuchelys: @georgehotz any comments on future of tech? programmng? cloud? system administration? devops? love to hear insight from someone with your knowledge
veomx: maybe she should take out the nugget shile speaking
veomx: while
coProof: yes ofc how much ram do i need for 100 player server
anup_kodlekere: highly technical
vloood: what is that speech impediment called? seems common for techies
yaus_baus: where to do disorganized programming
coProof: actually a good question and no one could answer
mutrx: the bronx speech impediment
picklesareok: agile development
anup_kodlekere: whens tomcr00se the rapper in you is coming back?
AlexEDM: what should people learn to help themselves be better employees within their Fortune 500 company?
mutrx: how do i find a girlfriend
mutrx: getting to the real questions
Knarez: george was homeschooled confirmed
knilecrack: google it
AlexEDM: lol
J3rwin: lol
yaus_baus: roasted
AlexEDM: damnit man
bacon_sizzle69: oh snap
mutrx: post link in chat
SimStig: lol
georgehotz: https://imgur.com/r/wowthanksimcured/FwSA5
AlexEDM: was expecting a serial answer
WOLVESpls: Lul
veomx: im already in slavery
coProof: F word get out
knilecrack: one more podcast roast with geo hot
mutrx: it was jordan peterson
anup_kodlekere: piperCoin
AlexEDM: i'll read it later, thank you kind sir
bytebacon: Review this paper: Pseudo LiDAR for depth esttimation https://arxiv.org/pdf/1906.06310.pdf
blondephilia: can i get the link again
mikey9988: LUL
veomx: since im married lord of the rings makes really sense
picklesareok: LUL
vloood: SF sucks for finding a wife
yaus_baus: oh yeah
yaus_baus: why u no go to neurIPS
veomx: i still look for the mount doom
vloood: lot of goblins
SimStig: Been trying open pilot on n
banned4mysins: george,is it realistic to have a career in machine learning while being self taught ?
SimStig: snowy roads
Knarez: think of it as gaining xp by fighting monsters
12btw_: !sr qY0c_DByPb8
anup_kodlekere: rap for us
zetleri: pseudo-lidar
bin3o: @georgehotz lemme be your intern
mutrx: are you an apple fanboy?
NefariousPulsar: What do you know about ndn (just heard of it)
euranymous: apple is trash
12btw_: Hoppy
12btw_: or with BB
J3rwin: oh boy
mutrx: "hobby"
yaus_baus: fuck yeah singing stream
coProof: yeah you got this i teach voice lessons in the mission
knilecrack: where is our internet
anup_kodlekere: how do you find songs like these
myuchelys: Pog
mutrx: this is defs how u end up like snowden
AlexEDM: how could he not? 192 views in 3 years. shit's blowing up
coProof: foreign rap skill 100
yaus_baus: how do you explain this to other people
lemonboxed: french Eminem
chancechants: PATH OF SNOWDEN
veomx: boris
euranymous: tomcr00se will return soon
AlexEDM: you slav you lose
buhrmi4tw: boris johnson
anup_kodlekere: fluffy rabbits and teddybears
Cs_nothing: !uptime
veomx: bro if you would try in german i would celebrate :D or spanish
mrigor: slishish, can you hear?
Cs_nothing: How long has he been on for guys?
yaus_baus: hes right
mrigor: ^
mutrx: listen
chancechants: hot chick
yaus_baus: thats what it means
knilecrack: https://www.youtube.com/watch?v=5ESynU09urg
yaus_baus: "do you hear?"
knilecrack: some real russian
yaus_baus: yea
mrigor: ya
MrMcaustin1: George about to make this guy's video blow up
mutrx: the translation is literally to the left
NefariousPulsar: NLSR my bad
mutrx: logan paul vs KSI who should have won
AlexEDM: you should try Dark Mode on YT. it's amazing
mutrx: @AlexEDM you have to sign in
mrigor: @georgehotz link it
AlexEDM: yeah
veomx: :D oh yeah
georgehotz: https://www.youtube.com/watch?v=ldK9qvRBkMI
georgehotz: https://www.youtube.com/watch?v=v4rvTMBCJD0
yaus_baus: Free Maksim Yakubets??
coProof: do you sprekenzy russian?
veomx: drink a bottle vodka and go
jay_al97: is that what you use YT for?
vloood: lol wtf
knilecrack: ja ne ponimaie po ruski
yaus_baus: yea
mutrx: watch unusual videos
ataradov: Wow, this is actually very good
yaus_baus: yeah
AlexEDM: da
mrigor: the slang is hard to get even for russian speakers, don't feel bad :)
cogforkd: looks like george does not like me, and he does not like to answer my questions... :( :( george ... please julia vs python? why are you not making use of julia?
veomx: works for spanish with tequilla
JaeGeeTee: DOS VAYDOHNYAH
funwayz: never thought that george would watch russian battle rap
vtcN_: russia speaks you
coProof: LULW
cogforkd: :)
cogforkd: am happy
AlexEDM: Julia Roberts
aaronfriedland: macroeconomists apparently
bytebacon: Insane freestyle rap: https://www.youtube.com/watch?v=NdTalMWrQ7c
cogforkd: george like me!!
cogforkd: hehe
yaus_baus: get the vodka
yaus_baus: authentic russia cosplay
mutrx: i've seen that, it's not that good
mrigor: yeah that guys is incredible
12btw_: Fake room
veomx: :D yeahhh
veomx: i dont want make you drink george
knilecrack: nooooooooooo
veomx: :D
chancechants: hotzception
yaus_baus: cmonbruh
codevisionary: what is this inception?
mikey9988: WutFace wtf
Kemisdan: White Claw
aaronfriedland: KKona
zetleri: LOL bud light
yaus_baus: slavs in chat disappointed
chelsiquixote: good evening George!
knilecrack: vodka   lemon   soda water
Abnico: aderall vs coffee
12btw_: This guy need 45min to get food rdy to eat
mutrx: this is normie shit
mutrx: did you see the American Psycho Programmer
aaronfriedland: George you should fuck around with Quantconnect sometime and start a hedge fund
AlexEDM: hahaha
MrMcaustin1: George do you know bo burnham
AlexEDM: George's real AF
picklesareok: this inforgraphic is really good
12btw_: Explain ASN.1
mutrx: step 2 is impossible
chelsiquixote: hows the new macbook pro 16"
mutrx: have you seen "If American Psycho were about Programmers"
bytebacon: Do nootropics really work?
thuganalyst: No George you should start a quant fund
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI
mrigor: @georgehotz hows sd compared to sf
AlexEDM: thank YOU
aaronfriedland: you could have the first profitable quant fund
NefariousPulsar: What do you know about NLSR
veomx: thx bro
AlexEDM: haha
knilecrack: pleaes bro
codevisionary: what happened to switching to Arch?
mutrx: so many calories in beer
MrMcaustin1: BUY A JET SKIII
funwayz: LUL
chelsiquixote: HAHAHA
knilecrack: don't talk BS
yaus_baus: boomer
zEveery: @georgehotz u should really try: https://www.youtube.com/watch?v=e_xGeZDk3Sw
veomx: Hofbäuhaus Bavaria
AlexEDM: bottled water tbh
chancechants: KappaHD
JaeGeeTee: George, you should just become a cosplayer.... show your boobs so you can be rich.
12btw_: My beer has more beer in it
Kemisdan: White Claw
mutrx: too many calories
mutrx: lmao
anup_kodlekere: whens the next stream
iPOdk: light lol
mutrx: https://www.youtube.com/watch?v=uHt01D6rOLI
aaronfriedland: get one of those 10% natty seltzers
biGtheriG: natty daddy &gt; bud light
chelsiquixote: whats your sleep schedule like?
vtcN_: show bobs and vagene
Abnico: nice saint laurent
zEveery: @georgehotz https://www.youtube.com/watch?v=e_xGeZDk3Sw Put at 3:10
12btw_: BOOB CGI effect PogChamp
AlexEDM: haha
mutrx: Clap Clap
tris790: did you just start stream ?
thezilion: @georgehotz react your rap music Kappa watch?v=9iUvuaChDEg
JaeGeeTee: natty light is bread flavored LaCroix
12btw_: Clap Clap
yaus_baus: what happened to the discord and shit
MrMcaustin1: George Hotz Meme review
zEveery: u gonna like it haha
aaronfriedland: real heads drink coffee soylent with gin
NefariousPulsar: Try Tecate
mutrx: react stream
chancechants: mcretHahaa FBCatch
mutrx: ok make a slack then LUL
12btw_: We doing that not here
mutrx: 4chan thread
codevisionary: agreed.
aaronfriedland: how about Microsoft Teams
myuchelys: booby streamer prob more cashflow than IG influencer @georgehotz
JaeGeeTee: lol @ microsoft teams
veomx: instagram
vtcN_: iMessage group chat
MrMcaustin1: Make us an IRC channel
12btw_: Show more Skinn is late
AlexEDM: "when"
AlexEDM: you mean "if"
bytebacon: domain dead?
veomx: :D
aaronfriedland: lol
yaus_baus: shill
chancechants: SLIDE IN HER DMs
AlexEDM: i already follow you
AlexEDM: :)
IbraMiharbi: gonna drop out of uni v can i come work at commai
knilecrack: bro your blond chick will check the stream and dump yo ass
AlexEDM: damn that's true
mutrx: that wasn't on the infographic...
Kemisdan: fax
JeanFrag: you also need that verified mark there
aaronfriedland: are you trying to farm Instagram followers so you can start a MLM scheme
WOLVESpls: LUL
biGtheriG: LUL
mutrx: don't u already have a girlfriend or is this some parallelism
knilecrack: no checkmark no chicks
anup_kodlekere: sue instagram
zEveery: I really like "sued by Sony" quote.
12btw_: You OUT with bud light
aaronfriedland: just create a shit ton of fake George Hotz instagram profiles and send Instagram a complaint about them
mutrx: do a tindr stream
aaronfriedland: ez checkmark
myuchelys: just hack instagram and put your own checkmark bro
myuchelys: you're fuckin george hotz
JeanFrag: wait isnt it more efficient to just bot followers? @georgehotz
aaronfriedland: LMFAO
WOLVESpls: LUL
thezilion: @georgehotz this is a gold https://www.youtube.com/watch?v=9iUvuaChDEg Keepo
veomx: like this geocold :D
knilecrack: what happened with that Elon musk lawsuite ?
anup_kodlekere: you should actually be getting a checkmark at 17k
yaus_baus: shill ig followers with trash youtube programming tutorials
mutrx: who do u follow
AlexEDM: that profile pic is gold
chelsiquixote: did anyone else buy TSLA after the cybertruck reveal pull back?
12btw_: Is hard to move on from the modem days.
JaeGeeTee: 17.8k is very respectable
Abnico: i have check mark with 2k lmao
aaronfriedland: deepfake yourself onto a male model
blondephilia: TSLA 10k in 5 years or less
mutrx: what other trades u doing
squiggly_nibba: https://www.instagram.com/hotz8820/
Abnico: employes used to have a few to give out
WOLVESpls: ^ money flips Pog
mutrx: wow no forex LUL
aaronfriedland: OTC LUL
chelsiquixote: you should buy some NTDOY
vtcN_: SPY
mutrx: airbus is dead
12btw_: omg stil in the stock market
anup_kodlekere: you bought a plane company?
anup_kodlekere: woow
aaronfriedland: start trading TVIX on trump tweets
myuchelys: lmfao
JeanFrag: @georgehotz why not just get etf? ._.
anup_kodlekere: LUL LUL
Abnico: buy augur coin, best investment
mutrx: HAHAH
JaeGeeTee: follow https://www.instagram.com/arbitrage.andy/?hl=en for trading meme's
Crypod: hi me!
myuchelys: "I got in after the second Boeing crash"
thezilion: PYPL
chelsiquixote: even though MSFT really high right now. i kinda want to buy some
aaronfriedland: you can make a shit ton of money on PredictIt spreads
12btw_: buy cheeep
mutrx: buy high sell low
squiggly_nibba: https://www.instagram.com/hotz8820/ hack my friend Facebook
aaronfriedland: yeah but I'm poor so it's a shit ton
vtcN_: r/wallstreetbets
knilecrack: sell cheaper
mutrx: did you see the Guh meme on r/wallstreetbets
anup_kodlekere: hotzofwallstreet
MrMcaustin1: https://reddit.com/r/wallstreetbets is great
aaronfriedland: I made more money on the UK Election market than I did at my job lmao
12btw_: I will never bet on dead bodys
vtcN_: GUH
yaus_baus: GUH
aaronfriedland: yeah boris
yaus_baus: what a legend
mutrx: https://youtu.be/A-tNkuYV4_Q?t=38
mutrx: please watch
JaeGeeTee: Decent trading meme's but not as good as arbitrage andy: https://www.instagram.com/thetradingmemes/?hl=en
thezilion: check paypal
mutrx: this kid exploited infinite leverage
mutrx: and got rekt
knilecrack: @yaus_baus where are you from brah?
NefariousPulsar: Favorite movie
aaronfriedland: people were pumping corbyn and there was a 5 cent spread on his contracts
mutrx: https://youtu.be/A-tNkuYV4_Q?t=38 kid used a glitch on robinhood and got infinite leverage
chelsiquixote: anyone want to buy my music streaming royalties?
bryanhacks: PYPL
JeanFrag: that is great vid
aaronfriedland: lmao
yaus_baus: legend vid
aaronfriedland: the robinhood guy
yaus_baus: hall of fame
aaronfriedland: hahaha
JaeGeeTee: omg, i love this vid.... i
Kemisdan: LUL
vtcN_: hahahaha
veomx: wtf
mutrx: HAhahaha
aaronfriedland: did he get sued?
mutrx: LUL
JaeGeeTee: no, but robinhood got a big time slap on the wrist.
yaus_baus: 25x
aaronfriedland: fucking options too
mutrx: GUH
thezilion: honestly, this is so better watch?v=9iUvuaChDEg
yaus_baus: watch the youtube video
blondephilia: :(
vtcN_: robinhood let him leverage 25x lmao
mikey9988: F
chelsiquixote: this is devastating
yaus_baus: r/wsb yoloer does wild shit
funwayz: yolo
mutrx: wallstreetbets
yaus_baus: wallstreetbets
aaronfriedland: you can't even get 3x leverage if you're a broke kid let alone 25x
MrMcaustin1: wab = wallstreetbets
12btw_: AAPL going down
mutrx: COngrats on ur new debt LUL
JaeGeeTee: how is so calm?
JaeGeeTee: HOW IS HE SO CALM!?
aaronfriedland: he lost it all LMFAO
vtcN_: he got his shit pushed in
thezilion: @georgehotz react your old movies on youtube
mutrx: he did it once before
12btw_: haha
JaeGeeTee: my palms are sweating!
blondephilia: hahaha
mutrx: at least BitMEX doesn't margin call
aaronfriedland: @georgehotz better explanation https://www.bloomberg.com/news/articles/2019-11-05/robinhood-has-a-glitch-that-gives-traders-infinite-leverage
chelsiquixote: thats devastating
JeanFrag: if you watch his vid upload he is at it again after saying he was stopping LUL
mutrx: i don't think bitcoin will ever take off as a currency
chelsiquixote: GEORGE where can i get 100% cotton sweat pants?
OnlyB1ade: hello
OnlyB1ade: there
chancechants: mcretY
vtcN_: the week this happened was so much fun to watch on wsb lmao
yaus_baus: whenever r
MrMcaustin1: https://reddit.com/r/wallstreetbets is great
chancechants: thats an oopsie
yaus_baus: r/wsb reaches front page, you know the story is good
Columbugo: https://www.youtube.com/watch?v=SvjwXhCNZcU watch this its entertaining
aaronfriedland: WSB is up there with IllegalLifeProTips IMO
mutrx: Legal**
yaus_baus: investment stream??
JaeGeeTee: &lt;3 wallstreetbets
mutrx: sort by top
aaronfriedland: @georgehotz Understanding eWhoring - IEEE https://ieeexplore.ieee.org/document/8806721
cogforkd: @georgehotz how many stackoverflow points do you have? is it even important to have high points for a working professional?
vtcN_: its like 4chan found a bloomberg terminal LUL
mutrx: sort by top again
aaronfriedland: gotta sort by top lots of shitposters
mikey9988: monkaS
httpsdubdubdotcomm: try obs
chelsiquixote: peace out all
aaronfriedland: LUL
12btw_: I mute you must watch this clip https://www.youtube.com/watch?v=9rcIJIWqYmo
vtcN_: that's literally the subs tag line lmao
iPOdk: wtf is this
mutrx: https://www.reddit.com/r/IllegalLifeProTips/comments/e8lnbw/ilpt_if_you_sell_drugs_use_uber_instead_of/
JaeGeeTee: lmao... Hi, I'm George... I'LL HACK AN IPHONE, A PS3, CARS, BUTTTTTT I WONT SIGN INTO NETFLIX..... TOO MUCH WORK....?????
SuX_X1: !uptime
cogforkd: @georgehotz how many stackoverflow points do you have? is it even important to have high points for a working professional?
vloood: it's not really the poor, it's like middle class techies, but yeah
JaeGeeTee: &lt;3
vtcN_: robinhood posted on wsb and they banned their account lmao
SuX_X1: :(
cogforkd: ok ok./.. got it
picklesareok: the people who love robinhood are the same people who are gonna get rich selling yeezys on stockx
aaronfriedland: the posters on that sub are the scum of the earth I love it
aaronfriedland: bunch of /r/shoplifting refugees
aaronfriedland: yep
yaus_baus: long time ago
Kemisdan: F
JaeGeeTee: what was r/shoplifting?
thezilion: RIP deepdotweb
lek0cs: F
MrMcaustin1: decentralized internet who
Crypod: Pied Piper? LUL
iPOdk: is this guy drunk?
yaus_baus: pacman -Syu freenet
knilecrack: you will able to buy drugs everywhere
lek0cs: i like the internet oof 2008 ish
funwayz: sellout
knilecrack: How much % has bud?
anirudhrautela: Nothing exists for free
cogforkd: i have 88    points on stackoverflow.. am better than you... NOT :)
lek0cs: free and trash n fun
thezilion: freenet is cool
lek0cs: you were good internet 2007
yaus_baus: decentralized bro
aaronfriedland: bring back arpanet
yaus_baus: dude i drank coors and lost my voice
thezilion: p2p
mutrx: blockchain internet
onu4r: dude pipernet is the future
yaus_baus: that beer is poison
Columbugo: https://www.youtube.com/watch?v=SvjwXhCNZcU watch this pls
lek0cs: ARPANET IS ONLINE
aaronfriedland: EFF 4Head
JaeGeeTee: AARON JONES!!!! SAVE US!
mutrx: @Columbugo its not even that good
mixtape089: Everyone after watching Silicon Valley
aaronfriedland: Richard Stallman is gonna save us all
onu4r: alcohol is a real life dropout to prevent overfitting
OnlyB1ade: Oxxxymiro
JaeGeeTee: lol @ stallman
vloood: it'd be funny if you went crazy and became like weev or mcaffee
OnlyB1ade: tf
knilecrack: no you are crazier
mutrx: true
yaus_baus: too rational
aaronfriedland: gotta kill someone first
lek0cs: who's weev? @vloood
mutrx: no balls
JaeGeeTee: didn't mcaffee open a flight school for some home made flying machines???
yaus_baus: not enough holyC
iPOdk: Nobody said you were crazy... you just waste your time laughing at nonsense on the internet :)
JaeGeeTee: what a looney
PoonGalore: penis
OnlyB1ade: what do you think hinton
aaronfriedland: @lek0cs a jewish nazi who can code
iPOdk: I waste my time, looking at you
JaeGeeTee: ipo dick... lmao...
iPOdk: Basically same thing
mikey9988: wtf too far @georgehotz
cogforkd: you are talented ... you shgould teach coding
iPOdk: Yes, I do have one JeeGeeTee
lek0cs: @aaronfriedland a judas priest huh
mutrx: girls coding camp
jc_alvaradov: best content on the internet
mutrx: u got any good memes?
JeanFrag: why dont you have a cat or dog? doesnt it provide a great emotional benefit with low cost in most cases?
knilecrack: ipo says something about wasting time, bro is watching another dude watching stupid stuff on internet
donald3767: Has anybody tried to acquire comma?
aaronfriedland: goerge has #blackgirlmagic
yaus_baus: #500daysofcode
Columbugo: https://www.youtube.com/watch?v=SvjwXhCNZcU stupid content
lek0cs: girls coding school by geohotz
hailh2o: why do u follow fortnite streamers
JaeGeeTee: i thought this was a relationship advise stream.... am i lost?
mutrx: let us inside trade comma
vtcN_: the key to life: just live forever
OnlyB1ade: can lose
OnlyB1ade: then
yaus_baus: george ayahuasca is decriminalized in oakland
mutrx: pump and dump KommaKoin
yaus_baus: stream it
aaronfriedland: mushrooms decriminalized in denver
cogforkd: your thoughs on "vitalik buterin"
mutrx: do u enjoy streaming
blondephilia: @yaus_baus poggers
JaeGeeTee: lets trade pokemon cards again.
blondephilia: LSD
vtcN_: DMT
blondephilia: DMT
lek0cs: its the Joe Rogan drug
yaus_baus: dmt soup bro
OnlyB1ade: thought on Future of computation
cogforkd: ?your thoughs on "vitalik buterin"
JaeGeeTee: i thought DMT was scheduled.
yaus_baus: https://www.insider.com/oakland-california-vote-to-decriminalize-psychedelic-drugs-2019-6
JeanFrag: do you really think that if you are "uploaded" to virtual that would still be you? @georgehotz
yaus_baus: bro not lying
thezilion: drugs is cool
aaronfriedland: LUL
knilecrack: cool while you have money
iPOdk: I stirred in some pot, wasn't ment to make you all go full defensive mode guys; as stated i'm no better - it's just a tiny bit sad.
donald3767: Moses was on DMT in the Bible
mutrx: TikTok duh
aaronfriedland: Juuling
cogforkd: coding is COOL
JaeGeeTee: trading memes are cool.
lek0cs: papa johns is cool recently
OnlyB1ade: literally
yaus_baus: go make lsd underground in the netherlands
iPOdk: I agree with hotz, goverment bs
veomx: AI girlfriends
zacho5002: white claw
picklesareok: going outside is cool
mutrx: tiktok
cogforkd: TEACHING CODING BY IS COLLER
bytebacon: You should check with Joe Rogan
lek0cs: the day of pizza reckoning is coming
mutrx: did u watch Joker movie?
Columbugo: Tiktok is very cool Kappa
mikey9988: cmonBruh popa ?
OnlyB1ade: just said it
mixtape089: AI is cool
aaronfriedland: @georgehotz why aren't you on twitchstocks.com
httpsdubdubdotcomm: new cool.....learn to mumble /...call it rap..... tattoo your face.....now your cool
aaronfriedland: I wanna trade you
vtcN_: red neck &gt; white claw
knilecrack: ahahaha
cogforkd: your thoughs on "vitalik buterin"
JeanFrag: that is fake money trading base of streamer popularity
aaronfriedland: I'm up 500,000% on it
httpsdubdubdotcomm: wait i forgot to mention you have to learn the finger gunn blat blat blat while you mumble
JaeGeeTee: Dungeons and Dragons is cool.
cogforkd: HAHA
mutrx: https://www.youtube.com/watch?v=MJ7R5_BR61I
vtcN_: you should bring back bitconnect
cogforkd: HAHAhis IDEA
thezilion: @georgehotz how to buy drugs in internet? Kappa
yaus_baus: george hotz type beat
veomx: :DDDD
knilecrack: did you watch when snoop immitates mumble rappers?
httpsdubdubdotcomm: ^ no but imma check it
mutrx: watch unusual videos https://www.youtube.com/watch?v=MJ7R5_BR61I
aaronfriedland: understanding ewhoring https://ieeexplore.ieee.org/document/8806721
mutrx: HAHHA
veomx: gucci mane
mutrx: HDL
chancechants: mcretHahaa
mutrx: HODL
mutrx: what was ur worst investment other than playing around with a play station
aaronfriedland: basically selling other people's nudes to tinder dipshits
mikey9988: monkaW
vtcN_: you ever see the april fools rfc's that ietf does?
ArcherCreatlol: what happened to your ctf stream?
aaronfriedland: @georgehotz https://arxiv.org/pdf/1905.04576.pdf
aaronfriedland: there's the pdf
OnlyB1ade: ...
aaronfriedland: market saturated
httpsdubdubdotcomm: ^
OnlyB1ade: data driven
bytebacon: https://paperswithcode.com/paper/from-big-to-small-multi-scale-local-planar#code
mutrx: this has been a fun stream
yaus_baus: thanks
ArcherCreatlol: :(
cogforkd: NOOOOOOOOOOOO
veomx: thanks bro
knilecrack: stream more
JaeGeeTee: NOOOOOO
knilecrack: getbored more often
MrMcaustin1: :)
JaeGeeTee: dont leave us
aaronfriedland: good night
JaeGeeTee: we bored
cogforkd: DONT LEAVE MEEEE
JaeGeeTee: WE SO BORED
cogforkd: :(
Rezii27: Have a good night!
mutrx: react to more reddits and youtubes
Rezii27: Get some rest dude.
JaeGeeTee: ME SO BORED
knilecrack: bb
yaus_baus: bye
ArcherCreatlol: BB
cogforkd: GOOD NIGHT
MrMcaustin1: OBS broke cant end the stream
3ygun: bye
hildl0rdi: bye
thezilion: bye
Virgen master yo-yo good morning how
does me there's my computer is absurdly
slow this morning
you see it's being slow I know
okay so OBS is using a good bit Chrome
is using a good bet
what's that system library framework is
it more Chrome metadata framework what
is that and terminal is use I'm closing
crow
you know so crazy hi who's this
what about lag you want to cut the
stream for a second got my gold mater
here here we have to check to see all
right so let's get the reference manual
up
some place there's a place that I check
for this I forget exactly where it as
well below but the real thing we have to
do today is we have to use a timer if
you can't just disable interrupts like a
savage right here we go yeah so it's bit
2 of T out of our IR to bang our IR and
and I have 18 bits here so just going to
shift that by for the whole thing's 29
we sent 11 on this 18 minus 1 pressure
you know what waiting you need that what
if I just - you're on that behavior that
looks right now I also have to send sir
bits which must be set dominant but
so what that should let us do after I
build my McDonald's with delicious guys
I'm saying one two three here we could
say something like 18,000
don't seem good crashed slope
hello crash happened yeah this panda
crashed I flashed yellow high quality so
it's up here gonna fire back to one two
three and see if it works okay that
works fine just when I add extended that
it gets mad do something stupid okay
alright try something that's shorter
data
possible that the oscillators dancing it
outward when I said iron do anything
large no it worked
Wow okay actually didn't totally work so
this is wrong yeah you see so for some
reason set 9000 they're not 18000 I have
a bog oh yeah
how am i doing let's shift you look at
the ring
cool all right
it still freezes when I send large
messages now there's some chance that I
miss computed the max bits can packet
thing that might have not been for an
extended frame that's crashing because
it's exceeding that okay so let's let's
recompute this part problem we have the
start of frame the identifier whoops
let's do all the header stuff 1 plus 11
plus 1 plus 1 plus 18 plus 1 plus 2 plus
4 is 39 oh yeah that was wrong okay so
39 plus 64 plus 16 plus 1 plus 1 plus 1
plus 7 plus 3 okay so that was just a
buffer
[Music]
yeah I know the stream is still title
Sunday special alright alright and I'll
change it okay now it's mundane or me
good actually updates okay so now let's
see if my past passes the pen was crash
and gives buffer overflow but networks
[Applause]
[Music]
Monday alright cool so now the real
thing that we have to change is this
whole thing is terrible
this whole enter critical section crap
now I disabled for a long time
that's Shetty so now we're gonna need
yourselves go back
I'm trying to do it
nope nope definitely shouldn't do that
from within side
I shall endure these foots from inside
that critical section I guess doesn't
matter that much and also this is kind
of a really stupid
[Music]
okay this is shitty I just still say
Sunday splash off stupid twitch
okay so what we really want to do here
is use a timer we should figure out
which time where we're not using and
then I'm not sure if the sample at
double the rate
hope you don't I'm using there's time I
three for the fan use time or two for
the system let's see what time right we
have available in here we're gonna want
to enable that interrupt out
all right so we use to enable timer for
but apparently we don't use time' for
anymore
well let's also check the manual for the
chip those are both reference packet
boss
it is vaguely possible
no that's the reference about the
datasheet okay so it is vaguely possible
that we're gonna be able to use like the
UART or something
I doubt it but you know there's been
crazier things yeah new Tom Cruise you
know what's up that Kitty Pryde um so
contractor II we're using you know using
be 12 to be 11
I thought so we'll see you are here
marrying the wrong datasheet or is this
the wrong datasheet this is the right
datasheet
they're all these alternate functions
and this is the wrong data sheet because
the other ones down on five and six I
don't know how I got this data sheet
okay uh and which which chip is it years
ago wow this is that oh I don't want to
Excel spreadsheet
okay cool
so we actually do have a UI there you
are an Rx and you are TX theoretically
if we could figure out how to use you or
a5 I don't think we are using you are
five on panda we are I will use it for K
line then or are using you are five what
else do we have
then doubt time one show on end
I really write this well we could
actually make it like you are 5tx alert
also get we also get PB 3 which is
connected to actually the same thing or
PB for this is your at 7 so if we wanted
to use it you are we could certainly
using your wife we could also use a spy
if you like me so let's look at the you
part if there's a way to send the UART
without any stock dance you know I'm Sam
we could write some incredibly clever
bullshit yeah
oh yeah that's probably a delay in the
stream I don't know everything's lagged
bro
I mean the nice thing about using a you
are is then we wouldn't be trapped by
our basically mrs. enter episode that
bad but we have to turn off the stop
bitch support for one or two stop it's
but I want no stop it's is that possible
I want no stop it's and no start that's
one half stopped it no I want no stop it
oh yeah shower
well that stream is really laggy bros
over sample and method for clock
tolerance we love tolerance here on this
stream
you guys said you need the money thank
you thank you I love money and framing
her fractional
Lynne
no but like what I really want to do is
set the stop bit to zero can I do that
but spy Mesa that might be a better vet
so I can use pin so the Pens are
actually physically connected pb4 and PV
thirteen we could use either one of them
I can also use a light you see well so
let's think
yeah I do see my work
IG sees not gonna I decide to see how
stop it's okay I'm trying to use like an
eye to see peripheral two-bit bank and I
to say I don't see how that's gonna work
no no no no what's a serial audio
interface okay you see master features
start and stop generation but I never
want to stop I want to keep going I to
see bit bag stop condition but like is
that per byte is I do see like serial
per byte like that to have stopped its I
don't want stop its
sheekha's can't I just want to be able
to basically send any bits on the bus on
the bus
oh wait ciarán speeds fast speed up - so
I should be able to set any speed that
shouldn't be a problem
no stop generation this might be doable
that igc might be our hope well that's
kind of ugly and of course I tend the
clock to nowhere land no see I don't
like that well no I want you to just
keep going no stop that
oh and can I not set the speed to
anything set up - yeah if it has to be
some way to light glider but it doesn't
know real speeds
trying to start condition arbitration
see I don't want any of this stuff I
just wanted to bang bits on the bus so
complex
I believe that's that's the broad right
start condition know if this is gonna
work
let's check spa the problem is all these
things have concepts of bytes and we
don't want like look see how it has
bites like separately like that we don't
want that we want to just keep streaming
won't bite see like it has that that
gone okay I don't have high hopes for
using spy or something you are I to see
Tim three Chan one I think eidetic
memory is a scam
okay well let's use a timer anyway it's
at least better than what we have I
think we can set it as like the highest
priority interrupts so we're using Tim 1
and Tim to intimidate so we can use Tim
for we set up Tim - this is what we set
up Tim - the only place we set up some -
let me call that bear anywhere else we
call it um everything is a scam just a
lot of things are you have to always be
aware of scams avoiding scams is very
important
okay I don't know why I changed into
this those can certainly sit outside the
timer loop
yeah ma'am well rappers talk about that
all the time how they got rich and so on
you know I made a G today but yeah you
made it in a sleazy way shame broken if
we ever get over a hundred people in the
stream we're gonna debut new Tom Cruise
music new Tom Cruise music but they'll
be famous and I'll have to stop Jimmy
alright ok we want to use use primer or
I enabled arrows
thank you for subscribing I don't know
what timbre uie means well okay
so let's actually quantify how long the
timer can be disabled for if the max
bits is 200 and we're transmitting your
33.3 kilobits I should have 2 6
milliseconds yes I care yes please
subscribe please like and subscribe bye
shit it makes me feel good about myself
and six milliseconds is a long last time
bros long as time grows
that's true too can only watch the
things if you're a subscriber okay um
I like the idea of using the spy more
probably easier to set up there's such
nice cans I really want to use the cats
can't use the cans books we only have
three of them that's the whole reason
we're doing this that's right capitalism
that's right we love capitalism light
buzzing
hello guys I bought a whammo
so where mom so well
it has Wi-Fi it puts your lights on
Wi-Fi Marco he's in jail guys it's not
funny that's not funny
fuck those assholes who put Martin
shkreli in jail that's a great man he
made great content he disrespect the
wu-tang clan now you know this married
life makes choices I would I would never
disrespect the wu-tang clan I know you
don't fuck with the wu-tang clan they
told me that and I believe dope
dude we could watch who take planning on
fuckwit but then I think we'd get
copyright straight a striked and
Ghostface Killah show up in my bathroom
beat shit out of me that's right
don't fuck with loot a clan
yeah free shkreli so down bros I talk
cuz they're buzzing yeah guys yells you
made G today but you made it in the
sleazy way that's how I feel about IC oh
yeah sure man look I love let me tell
you look if you if you yeah I'm not even
[Music]
an n-bit calling I and Vic and Abel irq
okay so we're gonna have to enable timer
I are you
where does it list all my irq now this
okay so much irq let's see which one
were you want we want Tim for oh yeah
Tim for irq and okay that sounds good
I like twitch Tyler yes yes I like
twitch dog now I make 100 twitch dollars
twitch will pay me money and then I will
have $100 just like do I have $100 nope
see all I have now is dollar dollar and
we have a dollar over here maybe I have
$20 but I don't have $100 good did I not
show that well dollar yeah it's $20 I
have $20 but I don't have $100 browse
look you can what the hell would I
actually do with money I just like
getting money cuz like having money is
great because it means that you're rich
and being rich is a great thing not for
anybody else not for what you could do
with it
just for you you wake up in the morning
and you know that you are rich this is a
great feeling it's a great feeling is
something that people who aren't rich by
poor people will never experience unless
they become rich and that's the American
dream Lavanya he's dead
okay so we got to set up Tim for I don't
even know what this stuff is well I do
know this
so if that's my purse Cal and we need to
multiply that by speed yeah get it boy
[Music]
and wherever and I remember when April
24 illegal bus stop in there
I think we need to enable other things
like cr1 we need to enable that okay
eventually we're gonna have to go to the
reference manual figure out what these
things mean you took it for Tim's no no
here we go
general-purpose time 16-bit up/down auto
reload counter 16-bit programmable pris
interrupt DMA on the enable
in up counting mode also down counting
mode also PWM mode you can maybe do
eating stream someday I'll do it
so we enable the counter top counter and
not one pulse mode you need to enable
interrupts we need to enable interrupts
this is all complicated stuff
where's interrupts risk after compare
DMA wow that's wow we the way enable
inner who Dyer yes that's what I want I
want Dyer pass one trigger
all right well I guess
terrible
oh dude be smart
oh yeah well dad I mean we don't even
talk about that because if you're not
smart like sorry bros it gets much good
but like it's not like like the thing
about being rich is everybody can be
rich everybody who puts their mind to it
can be rich but not everybody can be
smart so that's why you don't talk about
that
probably good everything to see what
happens
speed is undeclared of course because I
forgot any yes kind of idiot names as
variables things like that whose date
we've gone dates updates what do now
nothing works
oh I don't want nothing works because I
set the thing to output I never put it
back okay
rarely do that do I use the other Tim
irqs
wash your hands like about Tim to know
that one uses Tim three in a pedal
there's no other pedal I just set the
status to zero or the internet doesn't
work
now
we didn't did twice notice only doesn't
keep anything though like that don't
make sense
no many int just slow Wow
so slow figure out why might not
understand what update this trigger
[Music]
update you know an overflow or underflow
[Music]
oh so that's just when the timer
overflows okay I see so we're getting it
but not enough it's
my phone lines at the same rate Wow
it might be a thing I can compare it to
I have to like set the max value if I
can set that to speed speed I'm gonna
see for now deserve on the other timers
d ma what's a deem are you want to use a
deem are oh I think I could you know
we've seen this at CCR one
oh you know what I should do with the
arr
we just say like I gotta work
maybe I'm probably like off by one but
let's also not have this print stupidly
let's just say accept it bang gm1 so
still straight
[Music]
never give up never surrender
no with my fucking pulses and get shit
dally was not out I did that right
updated our friendship before
no nothing yet so let's go it's nothing
it's just wow
that worked before I don't understand I
mean I guess it was multiplying my speed
but still
thank you thank you for subscribing to
my shit for our no nice fucking weed I
got work today work I smoke weed before
work don't be it degenerate
thank you how much is literally just
worked
no now there's irq
okay so it's double tapping the irq I
should tell why this doesn't oh I mean I
guess I know why all right an exit zero
there okay well now let's at least
tapping hi okay for our let's figure out
with the ARR means they are oh god no no
no no D ma oh it's an address what are
we like I just
go to this section for more information
the up counting mode the counter counts
from zero to the auto reload counter
then restarts from zero and generates a
counter overflow yeah sure maybe maybe
work maybe I did it too fast speed oh
yeah look at speed
alright now I'm seeing shit on the
oscilloscope so all that up for you guys
see it
yeah alright so of course I'm sure that
hook shot is gonna be full of spam
broken right so we can definitely do
away with that and we can even check so
I have an idea that to interrupts are
actually happening okay do you know a
flag yeah they both have overflow and an
update happen oh okay so this is the
overflow interrupt and then there's the
update interrupt like right after and
that's why we're getting bullshit
so let's avoid bullshit because we hate
bullshit that's right don't be a savage
don't be a degenerate live a clean and
healthy lifestyle that's right
update interrupt enable trigger
interrupt enable trigger that's off
trigger and our flag update in our pen
yes Tim for SR and Tim SOR
ah yes also look at the high quality oh
yeah look at that square wave that's a
square wave gross look at that square Oh
beautiful I should know how to use this
oscilloscope measure
I miss my oldest let's go should I just
go get it
frequency 16.1 kill ours I think that
might be exactly what I want so you
actually want the freedom to be thirty
three point three so sixteen point one
times two thirty two point two scam
speed - one huh that'll increase the
speed so our frequency that we expect
sixteen point six five oh yeah that's
better
okay can be fixed
[Music]
okay that's good we set up the timer and
then we'll the interrupt now well we can
disable the wait for bus silent for now
we'll say something like oh minus one
[Music]
this over here Savage
okay let's try that so now we're sending
it quality on the timer
what quality how it works
damn bros my life is just so easy
first try shit works be smart and be
rich hope you had a great weekend though
you must be busy ramping up the business
but didn't want this to fall through the
cracks still would love to speak why the
fuck do I want to talk to you do you
know things I like people who know
things okay now it's being sent on it
interrupts so that's actually much
improved okay now let's put this other
logic here this logic above set depends
if you have input if R equals zero and
last one
we could use last sending land we
shouldn't say that we should say GM
Lance and he's unfortunately you're all
in the stupid global namespace
there's a typo no put H's all the time
actually and it's actually right
actually you're right should be I in 170
that's right so we don't use last
anymore if I'm sending greater than end
packets stuffs Shamblin sending minus
one equals one very simple one last time
we should also set the priority of that
inter I'm really high I don't know if it
matters but cool
keep broke no I know I'm actually
hanging on the send anymore there's
actually hang on the Sunday all right no
even be getting dropped cyclone shit
so wait there is something else we want
to do we want to add the styloid couch
[Music]
that's an hour that will wait for the
bus before we there's all sorts of like
weird race conditions in the stilt oh we
can't actually send if one of them is
sending we can fix this a little bit
okay cool that's good
so waits for the moss to be silent no
gtasa is crap
if camel and send max not equal to -1
return
I want to set this in ARP is the highest
priority tail we can look for the unfit
command to do that cool
get it bros get a lot of emails on
Monday and most of them are useless crap
it's quality shippers
you make here less this stuff like might
fail occasionally
we actually shouldn't do that if we're
exiting there's a slight subtle fog here
we're not even triggering a terror
condition who knows that could be like
serious bugs there we should write tests
for this who wants to write tests who
loves tests like speed as a define is
kind of stupid
all right guys so I'm just gonna commit
this and now it won't now it won't use
the interrupts well now we won't turn
off interrupts for like you know 60
milliseconds anymore wait what oh I just
got a travesty I saying that I broke the
build all right we'll go downstairs
we'll deal with that time to go to work
guys thank you for joining so they broke
the Panda
I'm very happy with us
yes we're getting an interrupt for each
bit I'm just kind of okay
it only tries to send it once it's
probably good to boss this whole stop
all this crap you could play a little
Windex clean up song again okay thank
you for joining us for this stream make
sure to LIKE and subscribe have a nice
day everybody happy Monday
yeah that's
hoodie logan paul with maverick by logan
paul
i had a sad realization about maverick
by logan paul but we're not going to go
into it because this is a happy twitchy
happy twitchy hey all right
you listen to that noise it pisses me
off bros
all right let's go
we have today's song
it's dead island by kitty pride this is
this is this is
dude this rap is just fire bro
no but like yo
you don't know why all the boys flock to
me bitch draw your eyebrows on then talk
to me
that shit is fire alright
so now that we got some people in here
we'll listen to one more kitty song this
is this is another this song is
beautiful as well it's called florida
um i don't know what happened to this
girl
let's see what she's up to let's check
out wikipedia this promise is not all we
do on this
she joined some indie rock band miami
garden club was not that good of an
album sorry kitty pride
um
but this shit was fire bro
here she was dating this guy named hot
sugar
[Music]
this is maverick i don't know i don't
know what it means
this is back before she had like blue
hair and shit away
and i promised i'd be gone and forget it
by 2012 and i thought if i got i'd never
visit i wanna talk and think you're all
a bunch of bitches and never listen i'm
having closets
that i could fit in
getting restless and a fidget and i feel
so great in the city
[Music]
oh she's beautiful bro
you don't balance shit for our work is
life go hard
disappear and never stay i'm spirited
away i don't think i'll make it here
another day
this line is
[Music]
[Music]
deep breaths kitty very brave face chest
out remind myself i deserve this even
though they'll be whispering that i'm
worthless my mama said to show them what
i'm making of the day where you know it
all and that's what i'm afraid of
fire bro
[Music]
[Music]
i bet kitty bride's a nice girl
i mean she has some issues to get over
but
you know like that's fine bro like
taylor swift here's the thing actually
taylor swift sounds like a nightmare
imagine they had reviews
like like could you like look like like
it's like yo you guys know glassdoor for
jobs
imagine there was a glass door for
taylor swift what is dating taylor swift
like i don't know
uh no more over the wire games no no no
no no we don't do that shit anymore but
what we are doing today is we're going
to bit bang gm lamp so these are common
ai pandas
and this is a kana ai debug you guys
know where you can get this you can get
this in the store right here at shop.com
ai which is fire bro get it right now go
to the store buy
buyer things
i'm like a real twitch streamer we have
products buy them at least buy a t-shirt
you know support the cost twenty dollars
include shipping anywhere in the
united states even
i believe hawaii and alaska if anybody
actually lives there
this is a comment and i debug right here
so this is the debug board
um so it's 100 it's beautiful if you
want to debug your code
it lets you set up some pandas on your
desk
that's what we got yeah today's a big
bang bro banging shit this is a sunday
special no slam today look at this thing
look at that diva board all right so
you're just like plugging a panda here
i build up my powers and tower 2
and devour you cowards i'm spending
hours and hours on sims and sour patch
kids
uh a controller for what
yeah no amazon bro we're going to do
that we'll do that we'll do that but all
right so we got some paws we got some
pandas
so
pandas have a
bunch of buses they have
three cans two limbs and one gm lamb
i'm real tired
uh
i had a friend over
last night and we stayed up all night
kind of
i don't know i was kind of awake all
night
but you know like all these things we
got yerba mate your vermont is great
brought to you by yerba mate
and the comedy i shop where you can buy
all these great things
no i'm not creating shit bro
i am
not creating shit
that's right
um
yo well wayne with his deposition
is fire man he's like
wayne did you did you mr mr dwayne
carter did you did you hire a
photographer to to follow you around and
take pictures and
lil wayne just looks and smiles he's
like
yo
i'm a superstar man i didn't hire nobody
i got people to do that for me
will wayne
is great
we love lil wayne all right but
bro we shall plug it in the debug and
now we should have two pandas connected
to my computer
let's see if we actually have two pandas
connected to the computer we're here in
the gm land folder that's right look we
have two pandas with different serial
numbers that's just five bro
all right
oh man i don't know if you're actually
good i mean if you're not good enough to
work at google we don't want you here at
comma if you are good enough to work at
google maybe we want you um you can
apply our hiring process is hard
we're kind of brutal
i actually have work to do you know got
to know things you know things all right
so let's check out the panda repo this
is open source code
um
so
the problem
is this
the chip that we're using only has three
can buses
can one can two and can three
now the gm lan is multiplexed with can
two and can or can three so basically
you can only use three at the same time
but the vault needs four
so we are going to write bit banging
today to try to get
all four at the same time
all right
let's create some new tests
oh i know you don't like my coat over
there we'll go there
close out the kitty pride stuff
she's beautiful though cloud wrap dog oh
this isn't a snowman song
snowman it's like young echo
now
snowman
packages from overseas
no no that's actually practical charging
up my solar beam
yo you guys know that venusaur shit
yeah that's what i'm talking about
xavier wolf oh how could i forget xavier
wolfe
soundcloud clown rap bro
they use cookies
no
no how is snowmen by xavier wolf gone
how do i find on youtube
by people who i don't own any of this no
copyright infringement intended
guys that line is absolutely fire
dreams come true do you think about me
too i got gucci on my shoe i got you
google and my crew
that's fire make sure to like and
subscribe to snowman song
okay so the reason we're not receiving
anything is because the default safety
mode of pandas
is
to not be allowed to send
so before we send we gotta do p1 dot set
safety mode you know that fire safety
mode that lets everything be sent that's
one two three seven that's right
um okay well that didn't really work
still i probably need to sleep you know
sleep bit
it should be okay so you can see that
when i did that this panda here
turned green
you like this
nice bro
all right
um so we're connected to both pandas we
set the safety mode of one camera set
the safety motor both cameras
this is a test no safety
you can actually use the proper define
tool that's
safety all output
okay
does that jam land not work or something
or do we not loop back the gm lan or
some bullshit
okay like it works as long as i'm
actually on bus two
but when i set gm lan it doesn't work
oh
do i have to use this define how's this
defined
well that's a joke
gm land can two
well that's really confusing i don't
know if anyone's actually used this
stuff
okay cool
so that's being sent now i believe over
gm lan i can't be 100 sure about that
because this is confusing as shit
let's try on three and see what happens
ah i know a way to be sure it's actually
being said on gm land
me change the bus here to none
not received
okay so that's not being sent on jam
land at all
jam land can two gm ram cam three
now bus equals two is fine actually
do i just not loop back the gm lane on
the debug
to make the schematics public for these
i'm actually logged in let me make sure
i'm not logged into github
i'm not logged in cool this is all
public
let's see if we made the schematic i
think we did
oh but of course
i have to open it in real eagle
i got gucci on my shoe i got you google
and my crew
gotta rename it to the right thing
so eagle will actually open it so let's
take a look at the hardware here did we
link the gm lands we did link the gm
lans okay that should work
you see the gm lands linked right there
so this is the schematic for the panda
debug board
um
oh does it need no it doesn't need
termination this doesn't make sense
does champlain just not work i don't
know if anybody actually tests this crap
i'm not selling shit to pan to waymo or
google
bro i just don't care
why do you think i care that's a great
question
all right
so i don't know why this isn't working
um
oh i know why okay so when you want to
say okay i got it when you want to send
on gm land you actually say the bus is
equal to three here
um we've changed it so wow this is
confusing how does anybody actually use
this product or a piece of shit uh
so to send
on gm lan
set bus equal to three
so it doesn't matter which one you
actually set like if i set this to three
or actually if i set it to one
it'll just multiplex it the other way
and that should still work
so what's basically going on here
and you see that it's being received
right here on three
what's basically going on here is
well panda's not an open schematic but
we can take a look at this
it's actually in panda
i got gucci in my shoe i got you google
and my crew
so this is what the pinata panda looks
like
um
this gm lam is like an extra can but
when you enable gm lan
it replaces either can two or can three
now what i'm working on today
is a way to
uh bit bang gm lan
such that uh
you don't need to replace one of the
other cans in order to use it
i have some command to get the version
here don't i
self.getversion
so i don't actually know what versions
on these pandas
i don't know why opening takes forever
okay cool so one of these has released
and one of them has a newer version
debugged now of course we can we can
build the panda code like this
if i go here to board
type make
it's actually going to build and program
a panda
now
you'll see that it went in constant
flash in green mode
and the reason
tilt this down a little bit
the reason it's in constant flash and
green mode is because this panda is
flashed with uh release bootloader and
the release bootloader checks the
signature
i up the brightness on this monitor and
it's brutally bright
just turn that back down over here all
right that's better
um
it's a little too dim we can make it
brighter
your little peeps dead bro rest in peace
he lived a real life you know
so we can do maker cover and that's
actually going to reflect the boot
loader on the panda as well
it's downloading using the dfu flasher
okay cool
oh you see that panel detected look at
that look at that fire bro
usb
panda.comconnect you can use pandas
right from the web browser it's pretty
nice um so panda is an arm processor
um
but yes and now you'll see when i print
the versions
yeah you see how this one is on debug
now
so that was pretty easy to do very easy
to use code all of panda is completely
open source it's developed bizarre style
i'll probably push this to the panda
repo after done with us
okay
um
so now after i did that one reflash we
can just use make
because now it's just flashing the main
code and not the bootloader and that's
fine because it's being signed with the
debug cert
okay cool
so
what we actually want to do now
is be able to set gm lam to bus none
and we want this ship to bit bang
but it's right now it's not big bang
because you didn't write your big bang
so we're probably going to need to go
downstairs and get a logic analyzer or
an oscilloscope so we can actually see
what's going on because we can't see
what's going on life is difficult
you guys know lg life's good well this
is life's hard um that's too bad
who's thomas
uh no i only fall asleep last night i'm
pretty tired
lh
uh
i'm never going to deathcon again fuck
that gun
some of you might have heard my rants
about why but
let's just say like my slogan is keep
hacking elite
and defcon has been moving away from
that
um
it's a conference right
and the problem with all these
conferences is you have a whole lot of
people in the world like liberal arts
majors who don't have jobs
so the problem people don't have jobs is
they don't have anything to do
and they show up to conferences and they
become what i refer to as the perpetual
conference class they're at every
conference you name it they're at basket
weaving conferences they're at hacker
conferences
they're at uh they're at um
and just anything there's a conference
for the real professional conferences
are a little bit exempt for this but you
know you want to go to a nascar
conference you're a football conference
it's all it's this perpetual conference
class that shows up
and they are you know political they
want to push an agenda
um so
and the thing is
their politics are this relentless kind
of everything must be political
so what you end up with is kind of
politicized conferences where defcon
used to be about you know let's let's be
hackers let's be elite let's be hacker
culture
it's drifted away from from hacker
culture to
anybody can use arduinos to be a hacker
okay
that's not where i'm showing up
um
i think there are still some i hear ccc
is actually still pretty good um maybe
i'll go this year
you know what i mean y'all know what i
mean right
okay cool
so
[Music]
i have to make this a little bit smaller
i'm sorry about that so i can see
where is this code
well
so we can go to the main and we can find
the set gm lan command
click can set jam way
i did write this code that doesn't mean
i remember how it's laid out
okay so set it's the set can
mode
gm
off
is that defining gpio
okay so here's where we actually set
the can mode
and it looks like it's
gm lan is on either b2 or b
b12 or b13
okay isn't the defcon seat the f4 i
thought i don't know i don't really play
cdf anymore
um maybe i'm not sure who's organizing
it
um yeah comma comma we could definitely
use the c plus library for panda if
someone would like to write that
we certainly appreciate it um
okay so we'll even make it backwards
compatible with rev b
we're using pins
12 and 13. so we can go to stm what's
the chip inside the panda it's f4 it's
this
this is a reference manual this goes
into like everything you've ever wanted
to know about the chip inside the panda
oh i think they have pin outs in here
no this isn't what i want
um we talk on the panda webpage about
what chips actually in the panda
this chip
just get the data sheet with the pin out
so we can know whether we have to bang
on
we have basically we have to figure out
which ones transmit and which ones
receive
so this is the chip that's in the pan
now
uh and we even have which no no no it's
this one
lqfb64.
so if we go to
b12
maybe this what's on these things yeah
here we go
it's called pv12
here we go
so pv12 is can to rx
so
what we want to do here
that sets gm land mode
but okay so if b12 is rx then
pb13 is tx so that's the one we're going
to want to get
13.
you do this anywhere else
i think we call set can mode
in setup or something yeah okay cool we
i should call that
so we're good banging on pin 13.
no i didn't read all the things um
all right guys we should really just go
get an oscilloscope um so i will be back
in a little bit with an oscilloscope
my microphone is acting up a bit
i'm sorry about that yeah i want to be
an engineer man i hope i don't have to
be the social media guy forever
there's no future in social media
it's add
well
okay guys
do you want to just do it blind let's
just do it blind
let's just do it blind i'm i'm um this
is hardcore it's not gonna work
but we'll try our best to actually just
write it first
um
so if
let's just write if bus number
equals
we'll make a function here called bit
bang
gm land
so when can't send this call it's going
to call into big bang gm land and we
actually have decent debugging stuff on
pandas called bit bang jim land
so let's see if our debugging stuff is
going to work we can make here
land panda test we have this thing
called debug console
well that's just because it's building
cool
so that's flashed
yeah look this is all the old messages
so let's try this now let's see if big
bang gm line gets called
yeah cool so you can see here
called bit bang gm land and that's on
green panda not red band
um
guys i'm coding at c why does torvalds
love me
love me
um
okay
so now we actually have to do the bit
banging of the gm lamp
so can
which is the same as gm lan it's the
same it's the same exact interface
um
let's see who's bit banged can before
i think implementing the can protocol in
firmware only will be difficult and will
take a while to get right it is not a
good idea
well we're gonna do it
so let's look at wikipedia i can
and we can even write
slow-ass shit right now
no no no no here we go this is what i'm
looking for right
so
it looks really easy it looks like we
just need to send those bits
let's first try to send exactly that
message
so what speed is gm lan
who's going from zero oh
is my stream
lagging
um so can high is going like that and
can low is going like that
see that's the thing i don't even know
from the output of the gm land whether
we want it to be high and go low i don't
know whether high is one or zero is one
but okay you know what let's just let's
just make a function we'll extract that
we'll try both ways
like pete wentz
cool
and then we'll clean this up and we'll
factor this out into like uh oh yeah
you guys i swear i'm not high today
um i did have coffee and mate
i just spoke with yesterday yesterday
was good day i went for a hike hiked 12
miles yeah
it's hardcore
you hear that buzzing do you guys hear
that
the lights in this place are broken
um set bitbang gmlan so we know
set gpio output
gpiob
you know which gpio it is so it's gpio13
b and we'll just set it to a and then
maybe try later we can try not a
okay
so
gm land speed
you know what we actually just have the
speed right here in the uh
no no no
here we go
yes 333 so we're we're bit banging at
33.3 kilobit
let's just type literally this packet
out and hope we get something good
and a frame is ones
is this a thing i don't know whether one
means driven or not driven
so you guys see what i'm copying here
remote transmission
request
must be dominant oh yeah get it boy
dominant for data frames yeah let's do
that
ide
yeah that sounds good too
reserved
where do you set the speed so you can
call there's a function panda which will
set the speed for you just say uh char
[Music]
test
packet
backslash value probably
must be dominant but accepted as
must be dominant but accepted as either
dominant or recessive
plain
okay we're gonna need to compute the
stupid crc but this looks like it's just
sending a one
first byte
another crc zero one zero zero zero zero
one one zero zero zero zero zero zero
zero zero
the crc i count the zeros right one two
three four five six seven one two three
four
no i counted them wrong
crc field is that 15
how can we check if it's 15 bros
python
this should be 16 which is 15.
cool
don't think just type
now crc delimiter must be recessive cd
limiter
[Music]
ack
[Applause]
one two three four five six seven
i don't know i don't know what version
of c this is or some crap
i less than size of test packet
you guys only see me coding python i can
code to see kind of too
i'm trying to work my way up the social
media guy
all right
so we want to set bang gm land test
packets of i
and then we want to delay
now there's a few ways to do this but i
think what we really want to do we're
going to have to go back to our
reference manual here
is we use it one of the safety modes i
believe
just check it
we want to find the timer
by the way if you guys are new to my
twitch i love it when people give me
money and subscribe to my channel uh one
day i'm gonna be a famous twitch
streamer and you guys can say you were
at the beginning
well i mean so really what we should
probably use here is a timer
should we just set it up with a timer
now
no because i'm going to mess that up
there's an easy there's an easy thing to
do right now
we do it in like safety toyota i believe
uh
used next time no i use like real time
yes get yes elapsed wherever this
function is
get yes
last
i'll do a recursive search of oh it's in
safety.h
you guys make me use a really big screen
so you all can see it i hope twitchies
appreciate this shit
no not get okay this isn't even what i
want
what's the input to get to yes so what
i'm trying to find now is a
rt interval
no where do i should get ts from
okay timer two dot count
so i don't actually know the speed of
time or two
but what we're gonna kind of want to say
is
a knit
speed with three e's
say a thousand a while
timer count minus the net
is less than speed
cool
so that should be
yeah thank you for subscribing yeah hey
thank you for subscribing to my twitch
channel it's the best twitch channel
um
okay
so let's try to figure out where do i
set up timer too
maybe we can try to figure out what unit
it's in
or maybe i wrote a comment about this in
safety toyota
see bros this is why you gotta comment
your code because even when you wrote it
you don't remember shit
um
so rt interval so it looks like it's
milliseconds
no it's not milliseconds it's
microseconds
so if we have 33.3
kilohertz and we want to know how many
microseconds that is
so it would be the same as 33.3 hertz
and
oh god my head hurts that's terrible um
okay basically how many micro seconds do
we want to sleep for between each one
so if it's 30
how many microseconds in a second one
million
divided by
33.3 times 1000.
oh 30. beautiful thank you who trusts
that did i do that math right bros
someone want to double check that if i
got it wrong it's going to blow up
so speed is 30.
uh
put that up there
cool who thinks i wrote that right
what are the odds that this crap
actually will work
um
bit bang done
called bit bang because you're banging
each bit out of the thing instead of
using the classy mmio
best twitch channel bro
i love my twitchies we are lit
okay well that's great so it bit banged
and
as expected uh
didn't do shit
so there could be 27 million things
wrong
um and that's great because there could
be 27 million things wrong
well
i mean we can at least try that as the
first thing
if a
say
i'm saying not a i'm saying that that's
right
so that might be
well we actually i can look up gm land
trans
gm land transceiver so there's actually
a gm land transceiver chip
just like this one inside of the panda
single wire can transceiver
i assume the mode is set correctly i
don't reset the mode and set camo do i
wow is the most misleading bullshit
[Music]
i wrote bad code and i should feel bad
drivers can
no
yeah
um i'm pretty sure we just set it up
correctly
the question is so so if zero is
dominant i think we actually do invert
so txd transmit data from microprocessor
to can
that seems right
a general motors corporation
specification i love it sounds official
gotta do it official bros
okay none of this is telling me anything
i want
um
i'm going to guess we want to invert
that so let's just compile the inverted
one and see what we get
and actually we can figure out exactly
what we're sending so we can actually
send the same message
so this is sending
first byte is just a hex one
uh and then the id here is well that's
four
and that's 16 and four plus 16 we all
know is uh 27 right
what's the meaning behind the username
tom cruise well you guys know james dean
the porn star
he's got two e's so i was originally
gonna be tom cruise with two o's but my
roommate when i lived in la was like bro
you know what's better than two o's
two zeros
and that's where we got tom cruise i
might quit calm ai and do twitch
full-time if i can make a salary i try
to make i got to make 100 before twitch
will pay me any money i am a twitch
thought if you would like me to strip on
twitch
i'll consider it if i thought it would
make me money i think i would i think i
would do it
um i would do it no shame that's right
i guess uh
yeah don't hundred dollars bros yeah
give me bits
give me bits give me the my free cam
dollars
i probably shouldn't advertise this on
the comm ai channel to be clear this is
not comma ai
i would almost do it
[Music]
we should say like i don't know i should
really tweet about this like
this is uh my personal life this is what
i do with my personal life
um this twitch channel promotes
degeneracy it promotes smoking weed on
the twitch channel that has happened a
few times on this twitch channel
okay
so let's actually try that oh that's not
gonna work either um
okay
well we gotta write this logic better
anyway
so
can push
if bus number is three
and
can look up can num look up minus three
equals minus one
so that basically says we haven't set a
if we haven't actually set the gm lan
properly
smoke weed on twitch
uh
can numb look up is minus one okay so
that should actually fix that and then
at least this test should still work
right
so then we're going to have to get the
oscilloscope not to be confused with
scopies
um
and we'll get the logic analyzer that
might be better all right let's see if
that works now
cool so that works
we're going to actually look at the bits
that are going out on the wire
you gotta get that gorilla glue
um now let's go
see the problem is if i get the
oscilloscope you won't be able to see it
on the screen
it's probably easier for me to use
though
so i will just
show you the oscilloscope maybe that's
never gonna work
should we have should we go on periscope
and just watch the oscilloscope live on
periscope
and then we watch the
streaming live on twitch we might be
able to do that
i love it i hope you guys have both
platforms i'm gonna be right back i'm
gonna go get an oscilloscope and an
adapter cable and we're gonna plug it in
and we're gonna start making this shit
actually work we're gonna do it by the
end of the stream stack overflow said
you can't but they don't know my skill
bro
and don't worry twitchy's
i haven't forgot about you
here's my oscilloscope
so let's get this shit set up i don't
have the adapter wire yet
so we're gonna have to go find that
still which means unfortunately
very unfortunately i am going to have to
leave
you all again
while i go find that
but uh so we're
dripped up and draped out
you guys know that song
oscilloscope yeah i got i got a
tektronix tds
30 12.
um
we don't talk about where i got that
oscilloscope from
ah
but so we got we got a probe right here
you know what
should i just peel back
i can peel back this thing on the back
of the debug a little bit
let's take a look at where i want to
actually attach it so it's there
uh
hang on i've got to do a lot of mental
rotation in my head well there's a panda
so when it plugs in it goes there okay
that's doable
we're peeling back
the shit on the debug a little bit
um so we don't have to go find another
cable
it's not gonna work well though
i can see the pad
yeah we really should like break this
out better on the debug
give me a credit card
um
this is what i found
i know you can't see the oscilloscope
that's why the oscilloscope is going to
be live on periscope
who thinks that's appropriate i think
that's appropriate
you allowed to live stream an
oscilloscope on periscope i don't know
is it against periscope's terms of
service
i think it depends
is your oscilloscope
open and friendly welcoming thing my
oscilloscope definitely is i think it's
welcome on periscope
all right so let's uh
clip that shit
cool
so let me just enable channel one here
don't worry i won't oh wait when there's
actually something on the oscilloscope
worth seeing
i will
stream it live on periscope because it's
an oscilloscope that seems appropriate
uh
menu no no no
what how do you use this thing oh god
i want this channel that channel off
this channel on
off no that turned channel one off
channel two off
turn channel one on oh it's just off
scale okay cool so now let's see if that
actually works
[Music]
trigger
the oscilloscope needs to be triggered
sweet
all right guys
so let's move this wire a little bit
let me finish my mate
now there's no good way for me to really
show you the oscilloscope
on twitch
unless i have another camera you got to
watch both
if you want to see coding you watch
twitch and if you want to see the
oscilloscope
you watch
periscope
well the wire fell off now that we're
good we're good to go
okay so with my phone
need my phone
to get on periscope
but i don't know where my phone is
oh there it is right behind the
oscilloscope
my battery is almost dead
so then you plug in the phone to charge
you know the things that i do for you
twitches
you don't have internet speed to watch
both well that sucks bro that sounds
like your problem you know what we say
on
twitch
not on periscope because periscope we're
politically correct because we're
representing a company but on twitch we
say that's your problem be rich bro
okay
that doesn't work
my phone charger
doesn't reach to see the oscilloscope
oh
no no i know it's not live because i'm
trying to figure out how to charge my
phone and periscope at the same time
no see i don't think that's gonna work i
don't think that's gonna work i think
this is a
problem
i don't know how to do this
ugh
i i know if you just take my word for
the oscilloscope being cool you're gonna
be like you know what i'll just show it
to you occasionally sorry that's the
best i can do
we're taking off the maverick hoodie
that's right no more maverick hoodie
there might have even been two frames of
left nipple please give me four dollars
i am
a uh twitch stop
we're here on twitch
okay cool
so let me show you what a gm lamp looks
like
so this is being set using the proper gm
lan interface this is what we're trying
to replicate with the big bang
hang on
let's get a good capture okay cool we
got a good capture
so that's what it looks like you say
so you see those pulses okay so let's
count
let's first off see if i got where the
zeros and the ones are correct
okay so it looks like we have a whole
shit ton of zeros
and then one and then that looks like
more than one zero
i think i might have done the id wrong
check it can let's jump guys you did
that right
there's your um
i'm buzzing drives me crazy
okay
so that's the actual legitimate
uh gm land
let's also check the timing we'll check
the timing of the zero
you guys are just gonna have to trust me
that the oscilloscope's cool
don't you wish you had an oscilloscope
and could play at home
that would be great
when new people come into the channel
just tell them that you know what's
going on there's an oscilloscope
and uh they don't get to see it
people love things that are exclusive
and special tell them you guys know how
to see the oscilloscope and they don't
okay
so the timing
appears to be
oh okay i gotta get it actually on the
edge there
okay so it's 30 microseconds so we got
that right
assuming that
we can actually even do this better
let's do this better let's say a knit
here and then let's say while
time to a count
is less than speed times
i
yeah that's better
that's more
timings
good
okay let's first see if they look
similar at all
scarcity bros
fuck scarcity
i have a plant over there that i love
more than a lot of people
um okay
so we programmed it now
remember this is still using the
official interface
let's see if my thing looks i'm going to
show you i'll show it to you i promise
uh so we're going to set gm land bus
equal 9 for panda 1.
so let's go single sequence there
didn't do anything
you didn't miss anything it did
absolutely nothing
so it's not even wiggling the pin
that is shit
all right you know what new plan
first off let's make sure it's actually
big bang gm lan
it's not big bang banging gmlan
okay so that's just a straight up
software bug
bus equals none
if i set plus equal to none
then
can num look up sub 3 should be -1 i
believe
you're not missing anything this
oscilloscope has done nothing
disable gm lan on can
3.
why isn't the bit bang actually firing
then
like notice how here it's not printing
out called gm land big bang
if boss number equals three and candle
look up three equals minus one that
should be right
i'm certainly sending it on panda one
so that's where gm land is there
let's reprogram it unused variable and
net that's concerning
wait what would my line go
okay well that's stupid
it just disappeared you see how this you
see how this keeps time better than the
other thing
shitty oscilloscope
yeah i know downvote you guys can
download
try that maybe
gm land on cam 3 disable gm land on cam
3 but even after we disable it this
doesn't work
can numb look up did i like pick the
wrong thing
no that's right
sub three
okay i mean
i don't know why this doesn't work
let's actually print that out too
i've wrote super sketchy print routines
inside panda
to actually print that out
you insulting my oscilloscope i'm sorry
i'm poor guys you gotta donate to my
twitch
um okay that was weird
it did something that time
i think it actually bit banked
yeah so it bit banged
f f
no but like okay wait that's exactly
right
and candle through lookup equals minus
one
i don't even know bros
but guess what it bit bangs now
we'll deal with that that sounds like a
later bug we love later bro
okay well
so
now there's things on the oscilloscope i
will show you what i'm seeing in a
minute
so this is what i'm seeing
it looks like this
very disappointing
it doesn't look like anything
so it just pulls it high
which is not what we want
so that might mean i got the polarity
reversed
let's switch that back and see what we
get
not
the last thing we are sending is a one
right
but that's not right
like you guys see the problem
it should be one normally i don't think
it is until i say septim gm land
oh
oh yeah
let me show you what i'm seeing
now i guess it is one normally
or float and one is the same thing
all right so this is what i'm seeing now
look it looks better guys
that looks a lot closer to like
something real
right check it out
now let's actually measure those things
and see if i got my timing correct
well let's take another shot
run it
okay so
you guys can see looks like that
let's measure
measure measurement measure measure
measure
zoom zoom
well what ad is that i love advertising
bros
okay i got the timing correct
it's 30.4 microseconds you guys can see
i did get the timing correct
so the question is
let me drop the oscilloscope guys
so the question is that means that just
the date is wrong
okay
no this is a little bit annoying
um
i mean i don't know is there a way to
save something on this oscilloscope
i know what i'm gonna do
i'm gonna get the real one and put it on
channel two
i just moved it over to channel two
uh now unfortunately because of this
thing being uh
stupid my
check here don't work
and cannot look up three equals equals
minus one
understand
what the fuck
you ain't ate tea
that's just wrong who made it a you it
savages
well yeah of course it's not going to
compare favorably to minus one
boss equals equals minus one
because it's a euit who wrote this
savage shit
to do
why
you went eight bro
only intake
so you and you got to know your casting
rules for c who knows they're casting
rules for c
not me oh shit about c
all right so we're good at that that
doesn't matter
let's see if it's still a bit thingy is
it still goodbye
all right
it's still good thanks ah cool
let's listen to
tough luck by nothing though
who knows why my test broke
i have to sleep here we have to sleep
here
no it doesn't work did i
what's up good banging don't bit bang
i don't think so
he said gm lamb boss 2 said gm linebus
two time not sleep cannot send okay why
my test break
now it receives it doesn't make sense
okay we just rebuilt the code that's
fine
um
so
let's try the good bang
it's possible that the bit bang somehow
like just breaks it
now when i set it back to two it's still
broken
uh okay
you know what i know what we should
actually do
um remember i re-enable remember where i
set that bullshit about like
in gpio i should actually change that
yeah okay so we should actually let's
just set it to an output mode for the
shortest amount of time we actually need
it
um
let's try that
and then we can set this to mode input
because i don't actually think that
set gpio alternate the problem is it's
like staying an output or something
maybe
i don't know could be fake news
did you guys see the problem now
don't worry there's nothing on the sls
go
if you were worried
sometimes people worry about things
okay
so let's set bus to none and now it's
gonna bit bang and it's gonna fail oh
you know what could be happening
it could be putting the bus into like
some kind of failure mode
now okay it works now cool
so let's try getting rid of that and see
if that still works
does that work
cool that works so now let's send it
there with the big bang
let's confirm that it actually get back
so the idea is i really want both to
appear on the oscilloscope screen at the
same time
so we're going to bang and then we're
going to set up the good way and one day
dude you guys didn't see the
oscilloscope but that shit was fire i
got it i got it i got it
okay yeah all right all right all right
so that's the scopey bros now you see
how there's the one on the left and the
one on the right
the one on the left is the one on bit
banging and the one on the right is the
one the actual cam transceiver is
sending so they look very different
um i think that's right or did i do it
backwards
now we send with bang them without so
um
with bit bang
looks like shit
guys i mean
you know what the problem might be hang
on i know what we might have to do
okay so i see
no like that doesn't look right is there
bug here
did i write bug
because it doesn't look right
like look look at that picture and then
see how like it doesn't look right
there's only one two three
four dips and there should be one two
three four five
six dips
well we still don't really know which
one is zero and which one is one but
that shouldn't matter
scope was screenshotted bro
screenshot that scope
okay oh good look something's responding
to it oh that's hot all right
so but i don't understand why it looks
like shit though
like
is that repeatable yeah it's repeatable
shit right like it makes sense right
so we're definitely setting the bit
banged one before we're sending the real
one
that's the bit banged one
it just doesn't look like what i'm
sending
it doesn't look like that in any way
shape or form and it doesn't
make sense because it's not like the
code that i wrote is very very
complicated here
time to count ah
that shit bros
set gpio mode might take a long ass time
let's try that
and i have another idea for what we can
do
it doesn't work
nope
still looks like shit looks the same
looks the same okay
well let's just write it oh did i not
do not recompile
the gary compiled
that's the downside of c you always
forget to recompile guys yell at me if i
forget to recompile
okay no no no no
it's only has four dips
well
the truth is i can't really tell which
ones which right now
did i write something stupid is this
stupid for some reason
did i have bad code should i feel bad
i know a good thing to send
that should be
undeniable
undeniable
fire
yeah okay so that one looks okay
um aside from a big bullshit at the end
it looks okay right so that's what i
sent out
right so that's the zeros and ones i
sent out let's actually count them
um 1 2 3 4 5 6 7 8 9 10 11 12.
did i write twelve
one two three four five six seven eight
nine ten okay i wrote twelve
i wrote twelve so it doesn't really make
sense maybe
let me let it go high and that's okay
um
well let's finally settle the debate
once and for all which one is zero and
which one is one
i actually think we're backwards still
this still doesn't explain why
we don't have the right number of uh
switches
that doesn't make sense
but yeah i don't know
one means it's low which it shouldn't
so let's add okay so we'll have that and
we'll just add a bunch of ones here
so we want one to mean that it goes
is one dominant or zero dominant
yeah i think we want to mimic can high
so one should mean that it goes
um
high
yeah so if we're setting ones it should
be high so it should be high in the
middle it's not high in the middle we
have to invert
who thinks can be high in the middle
see if it's high in the middle let's see
if it's high in the middle
[Music]
oh god you know what's happening just
fucking interrupts oh i'm dumb
all right so uh
enter
critical section
yeah bro we forgot that this section was
critical
oh my god is this going to work
look at this like screaming about
interrupts
yeah critical section guys is critical
uh
we should do up here we should set
banging land to zero
recessive
there's one recessive and one is
recessive
we shouldn't own the bus
all right so we turned off the
interrupts that's good because we were
getting interrupts and they were making
everything they were making my timings
crappy how did i forget that it was
stupid
all right dumb shit yeah bros
wait this looks dumb
this looks really dumb
i understand why it looks so dumb
oh it's really dumb
i got diamond locks
is that what i sent it's not what i sent
why's it look stupid
look at that
rolled around in that subaru like i'm
can block when i'm coming through
uh
[Music]
it's dumb
except bang lan
hi
oh did i forget to compile if i forget
to compile no i don't think so i don't
think i had to recompile would i change
oh in our critical section i think i
recompiled i forget
it definitely did recompile
but we'll try it again
no looks like shit guys
why does it look like this
this is a great question if we if we can
answer why it looks like that we might
be able to like get at the truth of this
thing
yeah i know i know i know i'm dumb and
i'm just projecting that's a thing
people do
looks dumb okay
i should be sending a whole lot of ones
i don't understand and then i should
send pulses but that's not what it says
it sends bullshit followed by bullshit
speed times i
should be okay
set bitbang gm land literally does
nothing except call set gpio out oh wait
is that gpao output like a complex
function it might be
ah
you guys see the problem we're setting
gpio mode we don't want to do that
um
so we'll just copy and paste that
into here
um
yeah so we're setting the gpio mode so
that might be doing dumb crap
that'll do less dumb crap cool
garbage in garbage out bros
i'm gonna go get a tim tam after this
who's excited for a tim tam this guy
no it looks like shit did i compile
i do compile it looks like shit okay it
actually looks absolutely identical
i'll show you i'll show you guys in the
scope
it looks just as broken
just as broken
well i'll show you tim tam is in a
minute but i don't think i deserve tim
tam right now i think i wrote bad code
makes you feel bad
i was given a 24. maybe it's a time
thing
i mean it's vaguely possible
that this is messing it up
we don't need that to test right now
that's just a change here
oh wait the wrong panda got reprogrammed
damn it reprogram the other panda
i don't know what to do about that
do that
okay well
i have to be a little careful of which
panda we're reprogramming
i didn't want to do that
okay
so that shit works
maybe there's just some rule about like
how many bits can be dominant
maybe you just can't be too dominant
it's a problem
so let's put two of those in the middle
and see we got
ah okay well at least we finally have an
answer to what recessive means
so you guys see the gap in the middle
so one is making this go low so one is
recessive that is working
so i got the polarity correct
now i still don't know why i can't do
long ones
but maybe we fixed enough that this will
just work
acknowledge slot bit transmitters on
yourself so then any receiver can start
a dominant okay
so
refreshed
how is one recessive
because that's how it identifies
all right so now we're getting a signal
that looks better it looks a lot better
um let's see if this okay so one two
three four five six p
six peaky things
so let's try adding that back in
and a seeing if the test works and b
seeing what it looks like on the scope
okay well the chest is broken now
uh probably because i broke the other
panda
yep i definitely broke the other panda
damn it
look what it did
it's broken
okay so we have to re-flash the other
one let's just unplug this one
flash
so i just unplugged the panda
cool
so now they're both flashed now let's
plug this one back in
we gotta just switch the order back
sorry i'm doing this so poorly guys
i am noob i know i know i'm a noob okay
we're flashing that one first great i
don't know why it chooses to flash one
and not the other
these are great mysteries for the
universe
to know and me to find out
let's try that
wait there's two now
did that just work
no no no no that's just because it's
sent
okay that's fine
this 131 here means that it's sent
ah my wire fell off
okay cool
i think it does have to do with it
switching back too quickly so look you
can see now there's only four peaks
again
so i think it does i think we're just
going to need to add a bit of a time
sleep
so we're on the
a millisecond wouldn't kill it
well i should do two more seconds
i don't know if python's that precise no
no no it looks like shit okay
one two three
it has three downy peaks and then a
solidy
so that looks wrong guys wrong
i can go there and go crazy with it
uh okay wait no it looks shitty i don't
get it
i can't know that i'm gonna do that
okay still look shitty
look at shitty
what is panda check out shop.com.i
all right it looks shitty we're gonna
stop yep bad bad no good
i'll be right back i'm gonna get a tin
tan i'll show you what timbers
uh
all right so this is a tim tam
um i don't think you guys will ever see
a whole tim tam
i couldn't resist i took a bite
tim tam deliciousness
all right
we can try this but like i don't know
why it would be better
it's possible that like pulling high
takes more time than pulling low or
something that doesn't make sense
is vaguely possible we're getting timer
rollover
we don't deal with that case right now
we're going to get into the fun stuff a
little bit when we start talking about
the protocol
no it looks the same
okay
i mean
it's possible there's something i just
don't understand
about how this thing actually talks to
the transceiver
trim down bro
okay i think we're having better luck in
understanding the deep mysteries of the
universe with this approach
i should send 12 pulses
a little reprieve
and um
this is what it looks like
i don't know why it then jumps back to
high
that doesn't really make sense maybe
when i unset it to maybe when i set it
to input
for some reason
maybe add a pull down or something let
me definitely do that
okay but that works okay
what about a longer one does that work
okay
and then you know guys a lot of hacking
is just binary searching by hand
so then we're just going to try and see
how many ones we can send before it
breaks
yeah and now it's messed up
let's see what's messed up because i
don't have any more
you know jumpies anymore right look at
that crap
why does it do that
it gets bored i think after it sends too
many ones it's like bro you didn't
really want the bus too many
ones um
all right we know well we all know four
is okay but
we know 12 is too much
okay let's see what that means
i mean it is possible we're getting
timer rollover
timer rollover would squish the rest of
it that's true
uh i mean it wouldn't have been the
other case
okay
show you guys what it looks like
i'm not really sure why i'm going to
measure that stuff
and let's see what's going on
so the first
thing
should be four
byte timings so that's uh
see if it is 120.
it's 152.
uh well no it's actually going to be 152
because it's one more because this is
actually five now
all right so then this one
so that's broken by the time we're up to
five
now to be fair
those are all high
oh and that last bit is the transmitter
asserting a knack
ah sorry the receiver is starting a
knack
trying gm land yeah we're trying to
we're trying to build a gm land let's
see this bullshit in the transceiver
i think this is the transceiver that it
uses
zero under voltage
produces a
yeah so zero is dominant that's good
internal pull up that's right
try for a comma or
something right well let's try to try
the other test let's keep the bus
recessive here
oh sorry let's keep the bus dominant
here
see if that works
oh we need stuff bits
okay okay this is making more sense
we need to figure out how to add stuff
bits
um well so already that looks a lot
better
but yeah so
yeah okay that works
this looks correct
you guys see how that looks correct
yeah my problem is bit stuffing exactly
um
so we gotta we gotta actually do the bit
stuffing
do you know what the docks are greg
all right how do we stop bits um
problem is exactly that stuff
so if you let the bus be recessive for
too long it thinks gg bro
we can't let it think gg
that's a lie
yeah the hardware is probably checking
for bit stuffing or at least if it's not
the hardware it's uh
[Music]
let's see
i mean it looks less degenerate now
i don't know why sometimes i get this
like degenerate behavior
looks pretty quiet
it's at least what i'm sending
can't bust bit stuff okay
all right let's stuff bits
bit stuff oh-ho-ho
bro look at this hot fight this is a
super hot fire
what are the rules
okay
um
so this end of frame stuff kind of just
seems like crap
i don't need that
well no we do because it's timing but
okay
what is ifs those are new
hmm okay
so where were we
id 10 through
id 7. you know if we just scroll down a
little in the wikipedia page
stuff
good stuff
after reserve we have to stuff a one in
here do we ever stuff zeros and we only
stuff once probably in this one we only
stuff ones but sometimes we probably
stop zeros
first
fight
i know we have to write this more
properly but let's get one message
sending first and then we'll figure out
how to do proper
okay so we gotta do bit stuff here
and then the crc fields
too lazy to actually add a comment
um and i don't know what ifs is but we
should do those too
oh i think i know what ifs does for guys
inner frame spacing is that right
probably not
all right is it going to receive
that is way too much to ask for of
course it's not going to work that would
be way too much
to ask for
works
well it did something
so basically we want the signal
on the screen to match the signal here
this is easy to think about at least
this is can high
okay so
it didn't work oh what did i forget to
do
got to compile bros
gotta remember to compile don't forget
okay well
we got something on the oscilloscope
looks pretty good
don't see the oscilloscope cost don't
ask me where i got this this little
scope bros
um
no it's not that expensive
okay so we have that dip
a little spacer of that dip a little
space we have that dip
a little space with that okay i'll show
the picture to you maybe screenshot it
and figure out what i'm doing wrong
figure out why this doesn't look like
that
put a recompile and run on the same
command i could do that i should do that
but yeah we won't do this too many more
times
and that's how massive amounts of time
get wasted
okay
so we have those two dips space
that dip and the little space and that
dip
no big space and then a little space and
then a double dip
and then let's face and then a big dip
we've got space and we have that dip
and then we have yeah okay
so
that dip
those two dips
patch up that tip that's face the double
dip
big dip
this happening
then after this
we've never seen it go high again
so we're just not seeing acknowledge it
looks like
like it should acknowledge i don't
actually have to
um
seriously delimiter
acknowledge slot
let me see it go low and that's just it
it never comes up with acknowledge
make sure that works
okay so something's getting received we
can look at where these differ i'll try
my best
this oscilloscope's not that great like
if you buy like really expensive
oscilloscopes they can like overlay them
both
all right
so they do look very similar at least
so this is what we have
get that printing and i might see ours
[Music]
yeah we can check that's a good point
it's possible we're getting sc ers
that prints by default doesn't it
i don't know
but i mean before we even try to go to
that we can just like i have i have one
example of the actual chance you were
sending and one example of my bootleg
transceiver sending
um i wish the oscilloscope had a way to
overlay them on top of each other it'd
be pretty lit
but of course
it doesn't because i'm cheap
ah okay
so i think we might misunderstand what
the bites that it's sending is
i think instead of setting zero one
this might actually be sending fb
i mean that's not gonna affect like why
it doesn't show up but at least might
make these things look similar
no it doesn't
they look the same until a certain point
the id matches
id matches
did i forget stuff
rtr
ide
reserved
good stuff
the length
i liked it better when it was zero one
oh you know what it could be two
i don't know how any innocent can work
so that looks
no it's still wrong
so after the first four dips
one dip two dip three dip
four dip
we were getting something else oh okay
no no so it is it is zero one
500k this is like a
2 000 oscilloscope
um
they look different once they get to a
certain point like the crc looks
different i think
we can try we can go downstairs and try
to get the logic analyzer
that might do something
okay one two three blank
two okay three dip
45 dip that's fine
the crc field is completely different
does the wikipedia example not at the
right crc
or is the other transceiver trying to
talk on it by that
can i connect my oscilloscope to the
computer not really
i wish i could
it has a print button
but i have to insert a floppy disk into
the disk drive
see this is what happens when i press
print
now this oscilloscope's too old to
connect to a computer
um now we're gonna make this work
okay so the crc looks completely
different
i almost think that the wikipedia crc is
wrong
is there another example anyone could
find on the internet
you know what we're gonna have to write
the crc bullshit anyway so let's just
write it now
so there crc is a lot more recessive
than this crc
the crc only has a little dominant
all this crc is mostly dominant
so
i might even be able to recover theirs
blah blah blah blah blah blah okay
mathematics of crc oh that looks so hard
yes
the can 2.0 document says exactly how to
do it
guys what if the wikipedia demo is wrong
you have a valid can receiving device
you can see that it works this here is
the other packet that's being set by the
proper transmitting device
and that's actually being received on
the receiver right so i'm receiving i'm
receiving on the other panda panda can
to receive and i'm not trying to like
get bang the receiver or anything
okay okay okay okay should we get the
logic analyzer
i have a logic analyzer somewhere
unfortunately this thing really likes to
break the usb ports on my mac
which kind of sucks
but all right we'll go get a logic
analyzer we probably should have done
this in the beginning
uh
i'll be back downstairs i'll be back
downstairs go find a logic analyzer try
that
okay twitches
we have good news and we have news
the bad news is that we couldn't find
the logic analyzer anyway
the good news
is that we found this oscilloscope
regal
we found a wriggle oscilloscope
and this oscilloscope
has a usb port
so let's connect the wriggle
and let's use that
yeah that's right some of the videos are
missing
and if anyone posts them on youtube
i'm gonna get you banned from youtube
for copyright
that's right
because forgetting is a lost
virtue
we have a wriggle so we're hooking up a
wiggle
um
i've got a usbc
to b connector guys everybody
how nice is this
that felt nice okay
let's hook this shit up
all right well you got there's only one
orientation that you can plug this in
there we go that felt nice too
okay we've got the wriggle connected
and the wriggle is on
oh snap
snap
yeah wriggle
all right so now let's figure out
oh
okay
wriggle
oscilloscope mac os x
oh
i don't like that already
okay so this is allegedly like a
four-channel nice oscilloscope these
things are cheap on amazon these are
like the classic like
i'm cheap oscilloscope
it's laggy as shit i don't really know
how to use it
that's right we removed the best ones
now if i hold the button down it does go
away
okay set the position
set the voltage divide
no that's frequency
no
this is terrible okay
mode single
nope
i don't know how to make this let's go
work
autumn
the wire fall off
we haven't been using a ground
that could be a little uh
problematic
it's plugged in good
well i really didn't like set my probe
to 10x is my program 10x my probe is on
10x go 1x on the probe
nothing
it just doesn't work at all
oh
oh okay you see is it okay i want you
guys can't see the telescope what am i
saying
there's a single that's broken
maybe my trigger is ah my trigger source
is channel two i have to set my triggers
for challenges not even enabled
why would it let me do that oh this
thing is so hard to use
trigger
oh yeah oh that's crispy
[Music]
get it scopey
now oh i kind of like this oscilloscope
what's growing on me
i'll show it to you
all right so this is what it looks like
on a wriggle see there we go
now let's see if we can get this like
live stream into my computer or some
shit
[Music]
i like this wait i actually really like
this oscilloscope did i say anything bad
about it i regret that
this is a great oscilloscope this is
better than the tektronix
and even better it has a usb port
okay now let's see if we can do it
without installing a kernel driver
oh
yes
oh love hackaday bros
let's see what we can do oh figured out
how to use a wriggle scope
with python oh who's excited about this
yeah and we can mod it to operate at 100
megahertz should we install custom
firmware on oscilloscope
should live streaming still script now
don't worry
yeah this looks good
okay
easily modded
nice set of buttons it works very well
sound
usmc
first i create a rudimentary device
no
no we have to install a bullshit we're
gonna have to reboot
no
it's not portable at all
i just got this to work on mac os x
mavericks
follow the instructions here oh okay
all right all right
i don't have any of those os x's
i have high sierra
shit
oh i don't know maybe we can get newer
ones
lap
ni visa runtime mac os x
okay
so
this is very concerning
what's the newest version
pi visa
download navisa
is this one good
there are newer ones do i want the newer
one
i have a fucking user account
ni vista is not available for your
system
it needs to match the
bitness
this is the worst website
i just what if i want a newer version
i don't have any of those mac os x's i
have 10.13
this one
can i brew install this
that'd be great this one works okay
all right
my name is no my last name is no my role
is accounts payable
my email address is mr nullman
679 at malinator.com
my password is mr no man 89.
i gotta confirm my account well good
thing we signed up with malinator
mr noman79 let's get it
oh we're gonna copy and paste this
that's great yeah sweet
okay can i download it now
great
that was fun
i'm no man bro
no man's everywhere sign up for your
websites
all right
you will need to restart when this
software finishes installing yeah i
agree don't worry
no
no i don't want to restart
fuck you
all right
no no
all right all right
let's go
oh my god
this is doing to my
colonel just installing lab view in my
kernel you guys ever use labview what a
piece of shit
oh
did it update oh yeah updating the
pre-boot that is highly concerning
oh tam tam bro attempt him yeah that's
right all right hang on
so now let's try this and maybe we don't
actually have to reboot please be fake
news
pi visa tip install
pi visa
oh
oh
oh that's good it's my ethereum's
incompatible
okay
okay who's excited up
import visa
print visa get instruments now
oh
no module named vpp 33
that was nice while it lasted
everyone has its own unique set of
commands everyone is special that's
right oh my god let's fix my eyes
guys i might have to reboot
i'm very sorry
i don't know what to do
i tried our macros x and it worked well
over land
wrinkle
okay all right we installed that shit
oh
wait oh was that just the visa run time
was that some weird chrome extension
what just happened
i don't know
i just get pwned i feel like i got
pumped
so that was
wait a second
did i install that
no i installed the run time of course i
messed up
now we need to install visa
the other one said i just needed to
install the runtime but i think we can
actually use this
yeah restart and then come back you guys
know i'm never going to come back you
guys know if i reboot that i'm never
coming back
all right let's install visa
good thing i signed up for my national
instruments account
love it yeah optimizing system yup
that's great
can i restart without restart yeah fake
restart
i'd buy that
download more restart
guys if i restart like i lose all my
screens and stuff is this oscilloscope i
have a touch screen
no
it's kind of nice though it's really
cute little oscilloscope
it's called
visa
should we get a windows computer up in
here i'll hold it up to the screen like
i did the oscilloscope
oh okay
visa
no
all right guys i'll see you all later
i'm going
guys guys if i don't come back
oh installer interrupted restart oh
no
obs
properties we start to see the mic and i
bet you can hear me now
i don't understand
that one
that good
can you hear me now
all right cool
we're going to the bullshit that is
using computers
all right now let's see if any of these
things actually work
scope.ask for values
so who the fuck named it oscilloscope
who's typing that all
right
am i gonna work
oh yeah oh yeah
blah blah blah
oh that's nice don't you think
all right
okay what is this stuff
i don't know why is that bad
what about that
oh you have to do that okay
oh now we're talking yeah
data oh yeah this is what i'm talking
about we're getting data now
love data
if you guys know me i'm a huge data fan
oh that's nice
great thanks for writing fucking
oscilloscope driver that's great all
right cool yeah get it boy
now generate a time axis oh that's too
much effort
is that better
format what
um
well i was nice walt didn't last either
do i care
not really
[Music]
wait i don't understand i thought we
weren't coding slam today why am i on
python doing bullshit
oh yeah because i have to write an
oscilloscope driver that's right
um well that doesn't work well okay cool
well let's go back to
canada
[Music]
let's check out a branch
cool
i'm going to push that
oh wow that's great
four or three okay well that's fine
we'll do it that way
deal with that off
stream data love data bros
data is one of my favorite things all
right so get this happening
he had
a test gm big thing
yeah okay okay okay
okay now we occasionally will see some
blinky on the screen
all right
there chan one maybe i don't know
there's a trigger i don't know about
triggers bro
spam that
yes more shit
oh i don't know what that means
ascii kodak cannot decode
i i don't like
i don't even know what to
do do i have to pass in an encoding
does not work in python 2
ascii kodak cannot decode by 0c6 and
position 242
ordinal not in range
this is the worst library i've ever used
scope.rightstop
oh chunk size bro we love chunk
um
i don't don't think it's gonna work
ordinal not in range
self. okay so now we're gonna have to
read the library because it's broken
i don't think i did anything wrong
if self dot encoding is not
so this is a
encoding equals ascii
for a message-based resource
encoding.setter
scope.encoding
encode argument must be
string
not none
utf-8 kodak
binary is that an encoding in python
unknown in color okay
well that's delicious
i thought no no no
python and coatings
coding utf-8 no it's not that
is there one just called like binary
latin one
utf-8
no not utf-8
i want
hex
is this going to work
oh
well that's a new error at least
my chunk size is crazy
i don't know what 20 what
my timeout is 20. i know that but 21
time not expired before operation
completed okay that's great well
i didn't do that when i did that
just gives me errors um
okay and at least that's a new error
that's better
um
how does it know how long i want to
stream for
all right stop
timeout why don't we set the timeout for
something longer
i don't even know if that works to be
honest
no no no that didn't do anything
oh
wait what
okay well
that's a fix of these
ah okay we got numbers
numbers bro we got numbers
up our trunk size
20 is not much time
this is exciting oh yeah oh yeah oh yeah
pulley d yeah dj pulling d yeah
theta dot shape
okay well
um
that's not how many i asked for
i i asked for millions
run
oh whoa you guys aren't seeing what i'm
seeing but
there's a reason it's give me the same
thing every time and that's because it's
not run
ah cause this is stop okay no don't stop
no
run
run oh look now it's it's the same no
it's different numbers okay that's
exciting
all right can i plot this there's no way
how this is gonna work
that gonna work
no
of course not
oh yeah oh yeah look at them cans yeah
get them cans yeah look at them cans
look at them cans get cans
oh yeah oh yeah dj probably d yeah
all right who thinks that looks exciting
now we can do
proper analysis yeah oh yeah get them
yeah cans yeah
[Music]
okay let's uh let's put this useful
program
in the pandora folder
you want to use a wriggle you can use a
wriggle
they're common oscilloscopes tests
panda tests
and the shebang
oh yeah
oh yeah okay that's the highest quality
shit i've seen in this thing all right
get
it wait where's my camera oh i don't
know
that broke too
ah
i don't know where my camera went
it's my other camera
yeah there we go yeah
all right
wow do we have everything working right
now
i almost clicked the x that would have
been a tragedy
okay
so
should we write like analysis now i
don't even know
shit
do better there you go
after all this work should we run
analysis
okay
so this is the bit bang one
and this is the real one
now
it's kind of nice
okay like notice how they don't look the
same
i can write a report i will get a a
spell server oh shit man my guardian
leviosa is not going to work anymore i
lost the connection to the spell server
bro i don't fucking know don't actually
subscribe to this shit this is the
lowest quality channel on twitch
i don't know
we like that one look like that one yeah
yeah like that one yeah
they don't look the same the crc is a
lie
wait this also now we can like now it's
easy at least
oh shit
there we go
now it's easy at least to compare this
one to wikipedia right
okay wait so the thing about crcs though
is if i have one bit wrong manual can
change
so we're gonna just have one bit wrong
does this look like this
okay you know up for a little bit down
down
off a little bit down a little bit down
awful lot
looks exactly like that one
yeah bro because honestly you know what
i've never seen anyone doing it live
because this shit takes people like
years
people spend like hours doing this shit
and i'm like it's just slow don't be
slow
[Music]
yeah go get a phd in computer science
well i am tired today
um
i'm tired
like it's like bedtime you know
maybe after i beat some people at chess
first okay did i get the id right
well
so i mean here we can send other things
in my test that's easy
yeah
is there a mistake
is that not what this one actually is
zero one that looks right
like the crc doesn't match
now there could be a lot of reasons why
the crc doesn't match
but probably most notably because
i messed something up
let's double check my logic here
16 plus 4 is 20.
tell you what this message actually is
somewhere
no
they don't
can we not just use the crc
jim get more sleek a small
um
no i think actually what i'm gonna do
is i'm gonna take a nap
and then we'll come back to doing this
so i will be back on later tonight but
right now guys i got to sleep
uh
kind of made it pretty far
we have
this signal on the left is the one being
bit banged and we have this signal on
the right
and that's the one that we're actually
um
sending
let's check it quickly i don't get it
big ups
down
and the crc is different
all right let's at least try one thing
how long is
this
we can we can at least try this let's at
least try this
data
new shit
i'm thinking i'm going to do is like
screenshots and stuff and that's just
how tired i am
well that's not right
they're different plt plots i don't
understand i don't understand why i plot
them like that that's not how that's
supposed to work
what
oh god sorry guys i'm saving it to the
wrong place i'm tired
okay cool
we want those two to line up
so
we can just say
one
you guys don't watch me sleep
that's weird
don't be weird
um
i want the first index of the true you
know what i mean
first
true index
wow
search sorted
you got
arg max
oh shit you know what i got you know
what i really want to do
oh i want to order mcdonald's and go to
sleep oh that sounds incredible that was
the best idea i've had all day guys
order mcdonald's go to sleep
i don't think i deserve that until i
make this work though don't you think
that's kind of fair
saving it to the right place now at
least
it's not working
[Music]
it could work or do the internet lie to
me
it should work right
hate when the internet lies to me okay
cool
all right so we see they pretty much
line up like we have a little bit of
timing but that's fine like
we can maybe do it a little bit better
but that's so close
it goes so well
we're gonna do now please stream for at
least one more hour and watch westworld
in peace
i could try let's see where we are
okay
so we have this little high part
we have
oh well we gotta look at the bit stuff
one here
so we have that
that's the arbitration field
so we have that bit stuffing there then
we have that one that goes low
we have the data that's been stuffed
and then that goes low there
but it doesn't go high again
wait wait this doesn't make sense right
so here is the data
this should absolutely match can high
so it goes
low
it's those two it goes low for the data
and then it goes low for the data again
but it doesn't go high on the orange one
so that's because their crc doesn't
start with zero
literally the only difference is the crc
like all the bits are identical until we
get to the crc
okay well let's just try typing a
different crc in
let's just type in what they have right
okay so if we're looking at the
orange one
it looks like if it's
oh this is gonna be hard
one
one
one
zero
three means high
how many bits wide is this
three
one one one
zero one zero one
0 0
1 1 1.
enough
should be enough
might even be off by one
crc from real
message
so the program is the right panda
fingers crossed
panda board
make
okay
i think we messed it up again like this
is an iterative process it's not bad
bro
do you bro see those two messages there
do you bro see those two messages you
see those two and there used to be one
that's right that's because the two
things perfect the line
i am hella elite
and that shit works and now it's time to
order mcdonald's and go to sleep because
really what is there in life besides
ordering mcdonald's and going to sleep i
just type those zeros and ones just like
boom and you know what else the example
on wikipedia is wrong
bro
bro i just unlocked the secret code
i just unlocked the secret code and now
we're streaming two messages
bro
bros okay match bros
yeah
yeah am i coming back tonight hell yeah
i'll be back tonight
you know it but we're gonna go to sleep
i'm gonna wear mcdonald's because see
them two messages bros there's one of
them
from
mine and one of them from the real
transceiver
oh who would have thought that was
actually gonna work yeah get it boys
that's right
that's right
nice g
um
good i don't know if
i'm so tired guys i'm so tired
oh yeah oh we're testing the new model
for open pilot
bros
sing a song no no no but i will order
mcdonald's with you guys let's talk
about what we want what do we want
spicy chicken sandwich from the
signature menu we could get that
directional mcdonald's kind of nasty
yeah i kind of do
i tell it's not that bad for you
actually
like that's fake news just don't eat too
many calories don't be fat
uh don't be fat and don't be poor that's
good life advice man
like honestly a lot of people will be
real with you a lot of people will tell
you like look man it's okay to be fat
it's okay to be poor but like it's not i
mean it's like okay but like it's not
good
you want to be good you want to be
crushing shit mcdonald's not gonna kill
me
will mcdonald's kill me this is bad for
me let's say
let's see what i'm gonna order you know
you have any options at mcdonald's
we're just ordering mcdonald's now
should i even stream this this is
terrible
this is terrible it's bedtime we're
definitely gonna get a medium fries so
that's only 340 calories um and i
learned something today salt does not
have calories in it
but you get no salt
or extra salt
it doesn't have calories
natural food is all bullshit it's all
fake man what's natural
what you mean like corn have you ever
seen a natural corn it has like six
kernels on it
oh yeah man you ever see that video i
love the videos like bananas are proof
of god no they're not bananas are proof
of evolution
because humans were like well shit man
let's get the good bananas and grow
those you know all bananas have the same
dna they're different from the bananas
they were 50 years ago
uh should we get an apple pie
or we get apple pie well
wow
wow
that's a lot of you could get a 10 piece
buttermilk chicken tenders and two
medium fries
um shit's reliable too
notice how it hasn't dropped any packets
all right hang on no no what did i
really want mcdonald's this menu has so
many items on it
that's gonna make chicken
definitely without mayonnaise
now
oh it removes wow 110 calories and
mayonnaise disgusting
um maybe a mick chicken a fries and an
apple pie
does that sound like a healthy balanced
meal
maybe a few nuggets maybe ditchy apple
pie will go a few nuggets you'll feel
better
i don't know
two-piece buttermilk crispy chicken
tenders
guys like we're not doing anything else
in the stream if you want to leave i
totally don't blame you for peacing out
and we're just ordering mcdonald's what
do we got here more attendees get four
piece tandies yo i do love tandy's bro
tendees i don't know what that is
no i don't want no chicken but i'm not
no
no no i want nuggets no i want nuggets
that's true i don't want tenders you
guys are tricking me
all i can get is ten
nuggets well 10 nuggets is actually a
pretty good calorie deal
i can get 10 nuggets it's only 440
calories
[Music]
i get 10 nuggets and no yeah you're
right why don't i get rice that's a
better idea
no but
now what mcdonald's
that's what i want we've got a mcchicken
we got a few fries we'll get an apple
pie that sounds like a plan
230 calories is that a good deal or a
bad deal i don't know
i wish it added up the calories for me
no we don't have too many calories we're
good we're good costs eleven dollars i
love the presents
i'm very excited about the future
the world
is a beautiful place
um and i'm no longer afraid to die
because i won't we're gonna live forever
that's right all right get an oreo
frappe dude like
sometimes we get
uh
mcflurries and that's a lot okay so i
will see you guys back on streaming
after i take a nap and eat my mcdonald's
and we're going to actually code this
all up kind of nicely more philosophy
all right guys
there's two types of people in the world
winners and losers and those who don't
divide the world into winners and losers
now
at first glance you might think that
that's three types of people but
two of those types of people are
actually contained in the same category
and i'll leave it to you to figure out
which one made that shit up deep
philosophy see you later
god
[Laughter]
wow
wow
that nicer
yo i know i took a long nap now i went
out for food too i did get my mcdonald's
and then i went out for eight rice
and a uh thai basil and a sticky rice
the base is too loud the walls are too
thin it's making it hard to sleep
that's how i feel in life guys
oh but see now we have a problem
the panda make files or utter shit
let's start on h i started here from
drivers
camera
cool
i did okay there
all right guys so
what we have to do is we have to write
this bit stuff the rule is actually very
simple for bit stuffing
um the question is is there a bit stuff
here
i don't think so crc has 15 bits
well but that's 18.
i might have one too many ones actually
so
these bit stuffs we can actually uh
we can just write this better right
okay
marks don't worry there's nothing on the
oscilloscope
it is running now i kind of like seeing
it blink
the base is too loud the walls are too
thin it's making it hard to sleep
i probably should have gone to the
hospital but i decided to let it breathe
what do you guys think the chorus is
about i was thinking about that i was
talking my friend about this yesterday
all right so for the bit stuff um
last
[Music]
so if
um
um
so hang on
this is like a macro for send a bit
something like that i don't know
um
well it kind of goes one because you're
actually seeing one of those
so we have to write the bit stuffing now
the term bit itself may be the first of
four or five consecutive identical
events so
the stu see the stuffing bit itself can
actually be one of the bits too
so we'll say
last bit equals
not bit
and then we want to
send last
okay so this isn't exactly right um
you guys see the bug
so we actually want to like just inject
a bit kind of
we can do that what if we just did it
like that
the size is bounded by this i don't know
what the hell n is
i don't know
it's probably too short
um we'll do the stuffing here
there's no reason like we don't we don't
want to run anything one more
so i don't know if the
[Music]
oh god who writes see
dennis ritchie
saying said the thing gm lan we actually
want to do is say
expected stuff sub j plus plus equals
did i write that right who knows
oh the same
[Music]
seems right right
those pity was not bitch
test back and study because last bit
bitcoin equals one
this is a new bit
so we're gonna get on the first one but
we don't actually set there we have a
setback
that's it
i don't even know why that doesn't work
because i didn't even build
um
size of test packet undeclared
oh shit
okay it's wrong but good thing we got a
regal bros
like sometimes it misses you see
like it missed there
i think it's too long is why it's
missing
no come on
these don't light up anymore
i don't even know
just pretty good stuff to buy it so
that's right
i'm sure
my comment about the bit stuffs
well
if i'm coming out with good stuff
is my no my code shit this is louisiana
without
i know i wrote bad code i should feel
that okay that works
so
oh well
okay
so there's a little problem where once
you're at the crc delimiter you don't uh
bit stuff anymore
yeah so this stuff's just not bit stuff
that was the problem
even if i did write the code right
twitter
that's kind of gross
um
okay
um what do i say again
i
and whatever
thank you
bro
okay this doesn't work
um
so let's go through this loop
god how does anybody code and see
um
like we could make a message builder
library separate from the actual banger
i have an idea
let's do this for now
just always let me test it
so
no no no it says you don't bit stuff the
crc delimiter um but actually the
example wikipedia is even worse because
the example on wikipedia has an
incorrect crc as far as i can tell
the last thing i need
every other person who wants every other
to leave
now
and find some will get message isn't
that what i call that
i'll get bit message
what's your apm bro
okay
that's not exactly what i want let's get
rid of that stupid uh
[Music]
so i messed up
um
okay
oh
well
[Music]
hmm
do the thing is okay so
i think this actually has to go above
this
okay so i don't actually think what i
program i just type
um which is why you need tests
okay so
you
[Music]
back up it's tough that looks good 201.
okay it looks good i'll see if it works
except the fact that we actually deleted
the part that actually gets the message
i don't really have a test pack anymore
and we should really be a little more
sane write like a
max thing but
what the hell is n
can they actually tell me
plus
the floor
so i don't know 66 64 plus 44.
plus the floor
of
34 plus 8n so let's say that n is 8
again
so 34 plus 64. i think ends the number
of bytes
floor of that
let's say 25 for safety
declared
yes you say wikipedia is wrong
no so it doesn't say you don't yeah it
doesn't say that all fails in fairness
topic the exception of the seriously
delimiter so that's actually this last
bit here that's not stuffed
okay cool
get stuffing support
all right so now we actually have to
write the code that generates the crc
um that stuff is crap well
it doesn't hurt to leave as long as
we're doing a test packet
um the other thing that we have to write
is we should actually start looking on
the bus and make sure nobody else is
sending i was reading all about how
arbitration works and can it's actually
beautifully done
uh the cam was designed by geniuses
no
don't want cabana
okay um so can the fact that these
arbitration ids are here
is uh
like right at the beginning like this
this is really cool
the the way that they deal with
collisions is like very well thought out
i like seeing this little scope link
like diamond cutters
okay um so now let's figure out if we
can actually compute this crc
so
let's make uh
the seriously i'm sure happens before
the bit stuffing
here's crc
char out
how's that weird when i do the pluses
max bits
um
i'll just try a cute little loop
what else can we listen to let me write
this shit
my name is
uh
okay
so
what's your problem with the formula
given there for the generator bullshit
all right
um
this looks good
perfect
what do you want to knit it with
inch
crc
okay
[Music]
plus
crc 14 and one
is that what this is supposed to be
i don't know guys i'm just copying bad
pseudocode
this code was written by noobs
oh so this is the code i'm copying sorry
someplace you can't say
why do i never tweet on twitter
twitter is evil
forget what you know believe what you
see
believe
[Music]
okay well that doesn't look at all like
that
it's right length anyway
okay so i don't know
it's not even the right length anymore
how does that happen
does it matter what i set that to how
does that determine the length that
doesn't make sense
that really just doesn't make sense how
does that change the length if i change
the crc
does one have a longer length
no
that one does
fascinating
no well
that still doesn't explain that
like how is that longer
i'm counting to 15.
that makes no sense
how is this one longer than that one it
makes no sense
[Music]
there's definitely something missing
from the crc calculation also
oh this is because okay all right all
right it's because they're stuffing the
vets that makes sense right
they can totally be different lengths
well it's high quality shit
stop saying hi to all my new friends
learn to get by
only new trends
let's see what's this in uh
i don't know if that's supposed to be
okay i don't think this shit is right
no this is wrong
thank you for writing wrong say
um
oh there's an example oh that's exciting
the hell is this java shit
that looks disgusting
that looks better
okay well i almost were idiots wrote
this
um but no okay
so
[Music]
just give me
thank you error establishing a database
connection this one looks okay
[Music]
so that
doesn't make sense
you do invert um
i want to say something like
that
it kind of matches that code close
you know they say that crc's close is
the same thing as nothing at all
stop saying hi to all my new friends
learn to get by
new trends
no that's not right either
let's see
um
what was here c14 okay so that's right
we take the top bit of the crc
xor with that if that's true we do
inverts of
not bit 14 that one's useless
yeah but this code looks a whole lot
more right
shift it over one
14. so 14 is which number
that's a buy now it's a buy and that's a
buy and that's half a byte
because i don't think this is right
oh i see
so that's actually assuming that it's
already shifted
this i think this is actually correct
i really don't know if it's this
or if it's this and i might have my ones
and zeros backwards too
okay i mean this could be wrong for a
bajillion reasons
let's get this number
learn scripting language bros
makes you go to chat
that's the number we're going for
that's not right
which is just just for
this one's always an option too
it can actually also be the nod of both
of those
um
did i talk about which crc they're using
can this is the too common word
well we're bit banging can bro
we're not optimizing we're trying to
make it work so we're trying to
calculate the crc
let's say
oh hang on that's actually definitely
not the generator polynomial we're using
as someone pointed out the polynomial
for cancer c is apparently that
that doesn't seem right
um
that's kind of bullshit
so shifting that you want to say that
oh that's not right
no be correct
is the audio muting
is it because i listen to copyrighted
music
is it still muted
no we have audio
oh no bros
oh oh you know what my init could be
wrong too i don't know
zero
oh yeah look at that the numbers match
bros get it boy
it actually works on the device
believe what you see
look at that
what is this being done for is being
done for nothing it's being done purely
because we can
no wikipedia is not wrong it doesn't say
that the crc uh
isn't bit stuffed
it says that the crc delimiter isn't bit
stuffed which is after the csa
wikipedia is wrong about the actual
value of the crc
okay
so now
let's choose something else
so
[Music]
[Applause]
these zero ones here let's change them
to zero twos
now unfortunately because of the way
we've coded this
we're gonna see zero one and zero two
because we're not actually using the
bullshit yet
but the minute we start using the
bullshit it's gonna improve drastically
look look at this quality
oh yeah look at that okay so that's
that's zero one and a zero two
now
unfortunately
do we really put the out as the first
thing or should probably put the out as
the last thing
don't be a savage
now make the out the first thing be a
savage that's right
okay
[Music]
um
all right now
the
footer thing
like i should use appendix here and say
test packet
uh
no
that's that's what we're appending so
zero
test packet source size private source
okay
um this is cool because we can say and
plan
we can do the same thing
just pack it
there should be a point where we just
don't call it test packet anymore
out
when
footer
[Music]
all right good refactor
um
so i'm gonna swap this up a little
that's not even right
um
start
to zero i plus five minus minus oh yeah
know that c bros you gotta know that c
let me tell you if you don't know that c
that's like not knowing how to speak
english gotta know how to speak english
gotta know that c you know
all right cool um
val
and
one shift shift left i
yeah buddy
uh i just want a true false thought
so say just
not equal zero
it's good
it's not gonna be that chill it's not
actually gonna work is it
of course not
you could say a pendant here
who forgot to return it len
yeah forget what you know believe what
you see get it bro
that's good wait that's just wrong okay
because this isn't there's a little land
in here right now it's going to be wrong
because i like how wrong it
is identifier
pendants
you know what let's do it probably
um
all right let me say i'm 20.
120.
you're doing 20. uh 11 bits
so we have rtr
ide plus reserve
all right this is that guys
you know you wanna do something count
for sesame street shit one two three
there we go
um
you know i'll just make this a little
cleaner
the data length code
um
we can write this properly we'll do in a
minute let's just make sure to mess up
uh the first piece we send is of course
a1
that's data sub zero and now we have the
crc
beautiful
we don't need that crap anymore
i guess we'll call it test packet i'm
not changing all that
packet
yeah boy
all right
let's go
yeah bye all right
now my test is very sadly going to break
because this is unknown type name
um
god
fucking
um yeah funny
let's read the safety for i'm sure
that's
i want to get the address we do rar 21
what's that
so we just say two vang
rar shift 21
that's the identifier
i get the data length
or ldr no it's not there
oh i know where this actually is
reference manual
we do everything in the yeah you like my
little shit boys that's right
uh
no but
no it's not no no these are what i want
we should do everything in the
using the same registers as the can
this doesn't make sense
just
don't can't i can
you know like can
it just can
well here we go bx can
guys i've read this whole manual it's
fun
all right
so this describes it somewhere here
wow look at all this fancy ass shit
so these are the canned mailboxes here
we go
so 21 we're getting the stid
um the dlc
is in
all right all right so this is
tr
two
two bang
yeah we're doing the can bus that's
right
our
i don't have high hopes for uh streaming
programming is like a thing
is
you know what
let's actually do this nicer than
that's fine
tldr
tldr law
especially rlvr
by
um
it
odds i wrote that correct
no
[Music]
where's that defined put that in the
test
make your tests proper
oh yeah oh yeah high quality test
yeah to i o
does that work
that works i do it right
now i wrote bugs include students
i'm gonna include student
uh
what
81 but i forgot the semicolon
i hate c all right
initializing an n with an expression of
unsigned char
okay fine
i i regret my decisions
cast
from unsigned char
to smaller integer type oh god what does
this even mean
there we go
actually that was a bug
i had my like angles wrong
okay
so
i don't know that might just be the
whole thing let's see if it works
if you are going to get bit message of
course because you're going to pass in
the
bang
stuffed bang
did it work
oh yeah two get that two yeah get that
two
is this the only working implementation
of campaign banking in the world maybe
it's open source
um all right let's see if we can send
more than two now
oh you guys that works
haha yeah first try get it get it yeah
get it no bugs yeah
get it no bugs yeah
all right we're done
okay
now there's like crap to implement
that's like
good see that was the fun part
now there's actually the whole boring
part to do which is like i have to kind
of write the receive thingy it's not
that hard but like it's just annoying
because then i gotta figure out a way to
test it
hello
that sounds like work
it was fun when all i was doing was just
get deaf master
that's disgusting
all right
enjoy your working implementation of
canned bit banging
oh no don't tell me a dot out got
committed
yeah i'll get committed but that was
close
i have nightmares about committing adot
out
um if you guys want to see it what it
looks like on the oscilloscope
there's a beautiful bit banged
shit right here on my regal which is my
new favorite thing i love these things
you can buy one avatar for a couple
hundred bucks
apparently you can reflash them to be a
100 megahertz
plugs into a computer you only have to
install one sketchy kernel driver
yeah everything's easy bro but like you
just got to do it that's the problem
no we should do we should do the
receiving
um
and basically it's just going to be like
shit can fail
we'll get the input i have something
lgpl
get gpio input yeah
so it's on pin
um
so
if read
equals equals zero
and last equals equals one
plus
driven
oh buzz driven
okay but so we can write that
and we can try it but actually that
should throw an error because of the uh
that should actually throw an error
because of the
acknowledge so if there's no error we
actually messed up
right because the receiver is
starting to
succeed wow
damn do i even this is just
my life's easy bro
easy
so the ack is zero one two three four
five six seven eight nine ten eleven
back
and fit equals one minus eleven
and
i'm not able to act
one by one there
i don't know if i won i was right
but yeah so if that's true then what we
want to do
go to fail
doesn't remember go to fail
it would be nice if we had some way of
actually
well
okay there's something else we have to
do too
okay
so the bus has to be silent for
well i mean six i guess
so
it's one more line i don't like lines
say so
you
[Music]
was there a silent bob because i really
made a silent
pop i i appreciate that
uh no so
wait for bus about silent for seven
frames
send my message with optional failure
and then we just exit the country well
we should actually um
guys we live in the future it's just
easy
all of the future
future's great
um
check out all right now where i left
stupid comments around everywhere i'm
sure
i'm sure
cool
there's no little windex bro
[Music]
foreign
uh we just watched a little windex now
that's that we did we wrote our code
and we'll do a pull request so i'm
actually logged in downstairs
[Music]
canadian money
[Music]
this shit can like freeze up
you know what no no no we got we gotta
do something else quick
wow
oh i just closed all my internets
all right twitchies i'm going to make
one little change without you
um just just to do get yes elapsed but
peace
thank you for joining we did some
streaming today it was good
bye
that yeah like Takashi 6:9 got arrested
or something but listen guys we've been
extra degenerate on these twitch streams
lately hang on me clear mystery I've
actually been working pretty hard lately
been slacking off less I'm in a
beautiful country this country's so good
they even have Japanese green tea and
roof down along the streams I have a
date at 7:30 but we're gonna try to be
less of a degenerate piece of shit like
we usually are on some of these streams
what up what up
so what context tree waiting is is you
guys can look this up so this is prized
called the hunter prize and basically
markets hunters assertion is that
compression is AI if you can build a
good compressor you can build by the way
this isn't related to the previous
project this is all new stuff maybe away
for a few more people and then and then
I'll do the eat the explanation of what
it is when we read this read this paper
using a context tree this method waits
in an efficient recursive way
um we put the FPGA thing I don't know I
wasn't feeling it as a project it would
take a long time she's a local to this
this lovely country but you know I've
been I've been less of a degenerate for
the last you guys known reading about
not context tree waiting in particular
but this is a fascinating paper
algorithmic theories of everything
should be Hooper solved AI guys like all
the stuff you'll need to know is here um
so you guys have you know there's a lot
of things in quantum physics that are
that are random that we you can't know
all you can do is model them
probabilistically but there's a question
of where that randomness comes from if
the universe the question is does our
universe have a short description or not
what's the column a graph complexity of
the universe for all we know there could
be a very simple PRNG
generating all of that randomness for
all we know it could literally be like a
es CTR one of these things we haven't
broken yet I'm an Aes CTR you can
specify really quickly so this is the
stuff I've been thinking about lately
being less of a degenerate was watching
some old streams like wack has
degenerate piece of shit drinking green
tea we're here in this beautiful country
and we'll talk quickly about how our
eyes compression I think this is gonna
be a theme of streams for now on because
this is something I'm actually excited
about the FPGA stuff it feels too much
like firmware head-fuck firmware that's
one of the things that I'm you know one
of the reasons I'm not back in the USA
ah
so I don't know what a context tree is
but there's this other paper I was
looking at as well called contracts tree
switching
a modification of contracts tree waiting
for the prediction of binary stationary
and Markov sources so I think everyone
knows what binary means binary just
means that it's a string of zeros and
ones right and all all text all images
can be can be put as a string of zeros
once stationary means that the
distribution doesn't change over time so
for example the great prize it's
referenced here is the hunter price the
hunter price is to take the first
hundred megabytes of Wikipedia and
compress it to be as small as possible
so I worked in my youth to try to win
this but it's pretty much been this guy
over and over again he's this Russian
guy and he writes this crazy code let's
download and McCade just so we can play
with them it's a good it's a good thing
to play with
I'm already
I think I also pay a bit too much
attention to the chat it's kind of hard
to see when it's on the phone I didn't
but we're being less of a degenerate on
these streams we're not gonna be a
degenerate you know you watch my auger
stream where I said working hard is not
important that's a lie
working hard for other people is not
important um you got to work on things
you care about and this is something
that I care a lot about I'm gonna be
working on it here and there so we've
selected we know what binary means
stationary means as opposed to non
stationary it means the distribution
stays the same it means any chunk of I
think the mathematical definition would
be any chunk of the distribution matches
any other chunk by any statistical test
you could do within some so Wikipedia is
a non-stationary distribution because
say you're in the article about durian
the word fruit is gonna be mentioned a
lot more because you're in the context
of Auckland area now I don't know what n
Markoff means um but what's interesting
about this context so that's context
tree waiting that's not this
modification um so here's the paper for
contracts tree waiting let's try to
understand ok find a memory resource of
property the next symbol probabilities
depending a finite number of most recent
symbols so you go this is called a
window for example if you're compressing
you can do a decent job compressing text
just by looking at like the previous two
letters I'm gonna be like like a tri
barium kind of thing
binary sequential universal source
coding procedures for finding which
besides of me
okay so what this is saying is after
you've seen like if you've seen 20 of
the same you have kind of a probability
but the next character is zero the
probability of the next character is one
so to put that in mathematical terms the
way you usually think of this is like
what's the probability of a 1 given
probability that X sub I equals equals 1
given X is zero X sub I minus 1 right
and then of course it's you know in this
binary that's the girl so given the
previous symbols now what this end
Markov I believe means that they talk
about in the other paper is this one it
really is kind of uncomfortable to work
on this laptop
I do need better I should use that more
I guess it's not bad as long as I don't
have too many windows open
[Music]
look at our Mexican zip so so Ann McKay
is video so thing and Markov is like how
many thing is you're going back run chat
on PC yeah but then I have to login to
touch on PC and we're not really doing
that this computer doesn't have any its
chaterino know what that is but don't I
probably respond to the chat too much
okay
so we can write a very simple compressor
that just behaves like that now it
doesn't necessarily need to be binary
you can of course do this where it's all
of ASCII but one of the problems with
that is you have you have rounding
errors right like you can you can make
you can make the symbol alphabet like
255 and you can track the probability
equals like you know one of each one of
the symbols but it's not very uh oh yeah
so the problems the problem is in the
binary one is very easy to do one - and
the other one is harder to do one - the
rest of them because it's a sum that's
just a problem that comes to my head
but yeah so let's just invite in the
enjoyment of actually writing a little
bit of code let's just make an wick six
so we can do this quickly in Python
since we're doing looks like binary or
stuff we're gonna use Python 2 so this
is a fun thing so let's see how well
like a normal compression algorithm
doesn't it looks X so yeah and works X
is one megabyte so that's just just an
idea of what Jesus juice is a two and
let's see if we can write a compressor
that beats gzip so once you have
probabilities it's trivial to well you
have something that can generate
probabilities of the probability the
next symbol you can turns into a
compressor perfectly by using this thing
called arithmetic coding forget that I
do not have chrome on this computer cuz
fuck Google but we're not gonna dwell on
stupid shit like fuck kugel anymore
because that's not what the streams
about I'm in a happy place I'm in a
beautiful country beautiful women
beautiful skyscrapers and malls and
green tea same should I add to Japan
right not exactly the cost more money
here surprisingly you think like all
yeah everything's so cheap but no no
that cost more money Dave in Japan
that's probably the only thing though
everything else is cheap
okay um so yeah I was gonna show you
guys quickly I threaded code into what
it is so if you're familiar with Huffman
coding - koenings not perfect Huffman
coding requires everything be aligned on
the bit arithmetic coding uses floats
yeah this is if you really want to
understand how to encode things like
that's the diagram that shows you maybe
we'll write a little arithmetic coder
we'll see how things go
can you please readjust what size and
OBS all the screen size yes I can't is
that better
[Music]
and you guys like where I am or should I
move myself somewhere else I'm probably
good there
all right cool the slaps Lipscomb you've
gotten so dirty and I haven't had a good
way to clean it so let's just write it
Jen fine you know what I should use
Python I should use bad my bad
so--but Jen is just going to 4 C of X Y
h8c once I shouldn't even need it all
right I don't know the command in Python
I want to do a take like instead of
writing this
what's important type for Astor imminent
it's not a star because I read it with
its bytes isn't it banks cuz I read it
with that that thing me Oh
my name is normal that's not right
[Music]
so that's returning false and true we
don't really want to return false and
trail so now we're getting zeros and
ones so we have a big stream of zeros
and ones these bit generators now so
let's um let's write a quick stupid
compressor just to get a baseline so
first let's
stop narration not fast at all right
let's make n with five let's even make
ever before you guys will get the idea
just 10 kilobytes
but if it's sick - so for reference we
need gzip and look for doesn't work oh
cool
you know you don't need the duct easy so
it for is just the first 10 kilobytes of
Wikipedia and when you gzip it it goes
down too fast out so if you want to
write something stupid we should be able
to use we'll use math I have to think
slower and use more math I understand
that's less entertaining but this
channel is not all about entertainment
it's about actually trying to publish
things useful things because we do
useful things on this channel
we're also or are we assholes I don't
know but yeah so
now if you want you can build a so we
can build something called lookup this
is the based idea of a lot of these sort
of compresses so we can have lookup be
you need a couple here yeah hook up some
three backs of one
okay so now for each lookup we get a
probability and this is the probability
that it's one so that's the probability
of the next bit given the previous four
bits so that's what we're talking about
here it's the probability that X of I
equals equals 1 given that well
especially not given that section so
this isn't context tree waiting yet I'm
still not exactly show a context tree
waiting guess it's gonna be something
kind of like this actually I don't even
need the x 1.0 because we're using
Python 3 yeah a time 5 of 3 is quicker
than Python - okay so the closer these
if these probabilities are 50% they give
you no information um if these
probabilities are more than 50% so now
what's the
okay
so let's call this P so assuming P of
one more 50%
let's check so what's the entropy
equated it's like the Shannon equation
so let me know how many bits the output
is yeah it's this PA is the probability
of a given symbol well
average number of minimum bits needed to
represent a symbol but that's not
exactly right
[Music]
how do I do log base sir good way to do
log those two in Python
other than way using change of base 100
is this another thing that's in Python 3
oh who loves Python 3 this guy oh look
I'm in such a good mood tonight I'm even
talking about my love for Python 3 no no
[Music]
ya hole so stream look we're not the
into generous anymore I'm in a good mood
we're in rapidly industrializing country
numbers
I'm gonna put the webcam back down in
its usual corner I don't think we're
doing anything interesting there it
looks like I'm back to coding over here
or something um okay so sure the entropy
P is the probability of a given symbol I
so I mean that's it's obvious that this
is true so this this if if you know
nothing
that works out all right so you know
probably the air you limp I know - the
one we know that - let's just try this
and see if this is right so that's the
entropy so that's without using any
predictor at all that's assuming that
every symbol has has equal likelihood
now that's the worst you can do if you
predict it all well math domain error
I'm getting that because I'm sure one of
them is zero
I guess the log at zero doesn't exist um
so this actually makes me think this is
there an equation oh there's also a
chance that well it's not even something
to take it to account again but you
can't use these directly as
probabilities the problem with using
these directly as probabilities is let's
initialize that to that okay there we go
that's better okay so okay all right
that's giving me an answer that's like
somewhat reasonable but okay the problem
zero is you start with a zero base rate
right so I get my I do my lookups and I
don't want to increment the tables
before I use them that's cheating
obviously don't cheat
okay so this is not answering the
question of how much the problem is it
doesn't take into account which the
symbol actually is which we know which
symbol X actually is if X if the
prediction is correct then it's going to
use less than 1 bits if the prediction
is wrong it's going to use more than 1
bits
[Music]
that's the
isn't right
hmm
well you know what okay no I might just
be - bass - that actually seems kind of
right if x equals equals one no I could
just say the probability of x equals I'm
so I can let you just say H equals -
math log to px that's actually that's
simple right let's do a quick check -
why that's true well I mean it makes
intuitive sense right if so this is
gonna be yeah you need less bits to code
that you need more bits to code that -
w-why is that true okay this make sense
right because if you were yeah so
there's gonna be half of it her no
have a bet okay
you'd one bit if you're half sure
because a bit of information see it's
hard to think in terms of but it is that
what is it log what an intuitive
understanding of why it's lock which I
said it's right why is it right
I've ridden an encoder before I think
someone come with a good intuitive
understanding of Wyatt's log I don't
know you people could on almost pretty
quiet a lesson you know so why is it
locked
yeah okay so you have your precision
where these are admitted coders work
because they they have precision they're
like infinite floats but they have
precision limits
well this is easier to think about
the opposite of log 2 is to to though
it's like to to the point log base 2 of
point 5 oh no so no the other way around
so that's that and then 2 raised to the
minus 1.0 is 0.5 how many bits
okay so this this this explains anything
if you have a set of if you have a set
of symbols obviously you need log number
of bits log two number of bits to encode
right if you have 256 possible symbols
you're gonna need log two of 256 to
encode them now what's interesting is
when you get into these these other
things you get it's it's just weird it's
weird to think about logs of things that
are less than one um I guess that's what
the log just makes less sense to me but
if you have 20 36 possible symbols your
way to so like a naive way to get that
out of yes so 1 divided by inside the
log is the same as doing that right so
you could also look at the probability
as you know 1 divided by the probability
and then you can take the log base 2 of
that because that's effectively how many
symbols you have to encode right god I
don't even remember like basic things
about logs how you forget math guys
don't forget ok so as you see this isn't
a very good compress we've managed to
take away 340 bytes
there's a lot of things we're doing
stupidly
on my roommates home let me say hi to my
roommate just so he doesn't think I'm
weird and talking to myself
[Music]
so I think I think I
yeah
[Music]
yeah
yeah
Oh
Oh
we just
Oh
Twiggy's do you hang out for that okay
let's look this place up
let's look up these Highlands and this
part this part will be chat um I'm not
there it's actually wrong I'm go look
for me all over Georgetown I'm up there
hi Lance
oh the Cameron highways
let's see well they have a golf club if
I only I play golf like it go
looks pretty pure Wow looks foggy all
cuz its high lands maybe the weather is
nice oh let's say I always do that all
reasonable temperature um this is a good
time for for trash-talking and chat if
anyone's paying attention
yeah now I was thinking of going to the
sidewall of a blank Aoi over here see
what the weather's like I'm going tally
there's no one talking the chatter is my
thing broken this is making noise which
is terrible no when Cowie weather looks
marginally better all talking checked it
easily broken on the twitch app they
have a concede oh ok I see you guys
talking now
wow so bad no one can talk only right at
Tom Cruise I see I see you all talking -
yeah Cameron Highlands oh I guess thanks
we go one of Malaysia's most popular
tourist destinations tourists no it's
just not scalding lehigh alright so I'll
tell you guys I'll tell you guys so this
is a massive City and none you will ever
be able to find me I'm in Kuala Lumpur
and it's oh it's just ninety degrees and
hot every day I wish there were
thunderstorms you don't even see any
thunder stories and hot um but I'm not
complaining because everything in my
life now is wonderful but yeah I'm
staying and I'm staying in a Airbnb like
thing my host showed up so as I was
talking with him that's that's where I
disappeared - yeah it's very hot what's
up the major now you'll never find me
here guys this place has more
skyscrapers
let's see let's go on booking and see if
there's reasonable places to stay in
this place
homestay I don't know about homestay I
don't think I can do homestay I like
this place I stayed in this apartment
for the last couple days
I'm gonna day later we'll see we'll see
it the uh no I don't know looks
expensive
Oh looks expensive good forget look at
that's expensive you guys oh no no what
do you mean that I believe that no one
talking to ignore you I'm watching you
talk I only have a 13 inch screen you're
in Tokyo you're gonna come to Malaysia
and vine me okay let's play a little bit
more with our compressor before we are
done with the stream so
[Music]
and actually you know we can really do
here it doesn't really matter
oh look at how much better it is when we
set it to eight bits look at that we're
compressing it all the way down to you
know we're getting a 72% compression
ratio but the thing about the number of
bits thing is it scales so like we do
that oh that seems to still work but if
we make it really huge it just won't
work
yeah so you can see the scales kind of
like oh you know what we should be good
about you can see what it looks like and
you can see that like the min of that
function is right down here at 16 it
bounces around a little bit but
makes sense
LZ SS are Li and Hoffmann yeah yeah
those are none of those compressors are
nearly as good as the ones that that
we're building I don't know what is all
zss um okay so it's like the vac
reference kind of stuff also like the
architecture for the uses of hunter
prize compressors see mix is a great one
if you want to read a good you want to
read a good loss that's what it looks
like this is basically predict the
probability distribution of next symbol
and then encode that probability
distribution with arithmetic use a
numerate where should I use a numerator
I love a new way it's one of my favorite
we're not gonna play with desc
now we can do better than this we can
actually do a mixture model now over the
different numbers of bits to initialize
it with the probability of 0.5 where
Kuala Lumpur
we're being honest this is a happy
stream I'm drinking green tea you know
when I'm drinking good tea I'm in a good
mood okay so we're still not beating
gzip we're still losing pretty badly to
gzip so gzip is getting it down to
thirty-seven point two eight and we're
getting it to fifty two point seven
seven nothing she's in seven so there
Jesus doing
compressing into thirty seven percent of
its size and we're compressing in 52
percent of its size so now let's see if
we can implement this context tree
waiting stuff so it's n markup so that
number of bits things the end that
they're talking about but I believe that
the way they do it it also works for
all like it's a mixture model of all of
those number of bits I had to go with 10
I got a shower I'm meeting this girl at
we're rescheduling for 10:30 we'll see
okay number in general depends of the
ash without using symbols binary
sequential universal source coding
procedures for finite memory resources
also often make use of a context tree
which contains for each string the
number of zeros a number of ones that
have followed this context so that's
exactly what we're doing right there
we're not actually doing the number zero
as a number or ones we're doing the
number zeros in the number of total but
that's the same thing um how well does
an autoencoder work as compressor well
we can get to that kind of stuff so part
of the problem with using on neural
models as compressors is you have to
store the weights of your trained model
with your file so you lose a lot of the
stuff there unless you want to try
online training approaches I believe C
mix now which is the state of the art
compressor it's the state of the art
compressor the problem is it's extremely
slow but yeah I think I think there's an
LSTA em in their trap probability saw
leading to darkens
okay so
the standard approach given past our
symbols one uses this context tree debt
thank you for subscribing to assault one
model waiting techniques
what's model waiting techniques an
advantage of waiting procedures is that
they perform well not only on the
average but each individual see its
model waiting twice universal coding I
don't know what this stuff is founded
memory tree sources that allows
efficient updating okay
so this data structure I believe makes
sense right also alter egos are the same
suffix set are said to have the same
model a model and suffix that are
equivalent okay so I think I kind of see
where okay so they don't want to explain
our thematic Odin waited context ready
Happy's
so another common way to think about
these things is to realize that um every
single one of these is also a generator
right you if you have a probability
distribution especially if your source
is stationary you can just sample from
that and you will get things that look
indistinguishable from the sequence
there's some guy who does that there's a
guy who uses like pack eight as a text
generator I don't know where it is but
oh yeah it was that there generated
authentic text with pack thank you for
subscribing six-months lovely
pack for sentiment analysis data model
yeah so this is an example of random tax
generated by pack after compressing
Harry Potter
chapter 37 the Goblet of Lord Voldemort
of the fire bolt mayor um the text is
lower quality that I would say a lot of
our n ends could do it's pretty good the
stone Harry said battered the you said
Ron and Harry in the doorway come
whatever Hagrid was looking from
understood page so hardly to you said
Fred no in the morning they're not
enough we'll have all to her explain the
others had religious importance at
Dumbledore he wouldn't say anything
No
mostly two girls who have similar kind
of cultural backgrounds to me the high
school I went to is 40% Asian I mean
yeah if you if you understand you got to
know the mediums bra if you know the
same beams as me if you grew up reading
like 4chan and shit we'll get along too
bad not too many girls did that it's
tragic
okay so this is a weighted context tree
let's are these things computed unclear
there's no girls on 4chan I know guys
I'm not stupid sometimes what I find is
that the second paper so let's go back
to that other paper so I'm gonna find
that the papers that improve on things
actually explain the original thing I
don't know what that is actually explain
the original thing much better Oh
background waiting suppose we have a
finite set
[Music]
oh no no you just just you have the same
cultural background which will say who
knows who knows what we're gonna find
here in Malaysia Malaysia
the calendar context you waiting upon a
secret prediction technique it is
variable order Markov modeling technique
um so yeah if you guys know what Markov
means Markov means that just like so
traditional the traditional definition
of a Markovian sequence is that the
probability at you know X at time T
depends only on the probability of X of
T minus one and like that will
completely like it does not it's
independent with respect to X of t minus
two not a math guy understand my
notation is probably a little weird and
then so that's a first-order Markov
model you could have a second-order
Markov model where you know it depends
on X T minus 1 and XT minus 2 but then
it's independent of T minus 3 you know
be a second-order Markov so it's a
variable water market modeling technique
that works by computing a double mixture
over the space of all prediction suffix
trees of bounded depth this involves
weighting over all PST structures as
well as integrating over all possible
parameter values
No
Boxey
so um what we made what we made quickly
and our little compressor was just a uh
with my red just like this is a 16th
order Markov model on bits not on bytes
so it's really only 2 bytes no no look
okay yeah yeah Peters nice that I'm only
gonna answer this question once and
anybody else who asks they have to ask
that guy for the answer anyone who was
here today this is the answer of why I'm
traveling around I live in the world but
I want to live in the cloud you know
like AWS boxes you can't
what is the Colo for real life look like
that's maybe what I'm looking for I'm
not traveling around aimlessly and I'm
definitely not on a fuck tour I go on
dates because this is something I do in
San Francisco as well you guys know I go
on dates in San Francisco I talk about
my dates on my stream um some of the
dates go well some of the days don't go
well you know but that's just the nature
of Danny um I met some digital nomads I
would not call myself a digital nomad uh
I want to move yeah the Colo for real
life instead of traveling or vacation I
prefer the word quest is that
pretentious or what I'm on a quest to
find and move to the cloud
okay we all happy with that hey I got a
go I got a I got a shower but we will we
will this will be this will be our new
project for a little bit and we'll go
hard on this we're good we're gonna
implement context tree waiting and maybe
even context tree switching yes I want
to live in the cloud I am on a quest to
find and move to the cloud perfect
that's that's a good way to summarize it
and I want all the great features that
the cloud offers you know I want to have
backups I want to have multi data set of
redundancy I want to have super high
bandwidth internet connections one of
peter levels I don't know what Peter
levels are that was too much philosophy
oh sorry
yeah we're gonna we're gonna get back
we're gonna we're gonna be I want you to
remember on the stream I'm from here on
out this is gonna be less of a
degenerate stream I don't really want to
do the FPGA thing anymore I was boring
me I was just dealing with like you saw
use of that stream where I spent like an
hour just dealing with like docker
bullshit
comes up nomad list today you guys ever
gonna know that list I also found this
other web said I really liked called
hood maps
no hood maps is great like you know
Creek gecko wannabes Chinese med playing
chess some of them were really good I
was looking at Severns this infinite
tourists crack my thoughts up into that
crack McDonald
um yeah nomads lost places too maybe is
Kangoo bali the cloud it's Bangkok
Thailand the cloud no but they're like
these people like oh yeah but digital
nomads oh yeah look I'm buying I'm
buying Chinese cosmetic products and
then I'm selling them two white girls on
Etsy Oh Peter levels Oh No I don't know
oh that's the guy who made this website
oh oh yeah
but he also made hood maps no I really
wasn't joking I had no idea I didn't
even realize just the same guy this
guy's awesome
are you twitchy's teach me so much
Wow
wow this guy is he moved to the cloud he
did it
does that are you a subscriber why do
you have a crown your twitchy's no
actually scope ease and twitch ease or
copyright comma AI I can't say them
anymore
Wow I'm gonna read more about this Peter
levels guy where is he
crownless twitch Prime you're okay
why can't you be chat you guys you guys
are twitchy's all right um wow you want
to be chat you also coated what maps one
stream no no I can't be this guy I don't
want to go to the cloud if this guy's
already there no yeah she seems pretty
cool um alright thank you for joining my
stream today we'll work harder next
dream because we would have date
schedules drifter date sucks maybe I'll
just come back here quickly
maybe she'll flake I think she'll fly no
I think she looks like JavaScript back
all right see you later
tree waiting it's really hot I think I
might take my shirt off that's
appropriate you get banned from twitch
for that can't girls take their shirt
off with which saddle out but we're
gonna do it we're gonna do it cuz I was
out all day
I'm not gonna wear a shirt for this
stream I don't know what that means I
don't know what that means but that's
what's gonna happen all right wait so
I'm when you're in the chat is anybody
here
I don't know this really isn't great oh
here we go yeah flex no no this is I
mean you know I'm into handsome men as
much as the next guy but I'm gonna talk
about that so first we're gonna go over
the drinks we have here we have a 100
plus I heard from my date that this is
an isotonic this I I went on a date no I
know bang no bang um I went on a date
with an advertisement like this girl was
we went okay so first off we didn't meet
last night because of drama not my drama
and I met her this morning
for coffee and we walked around the mall
this girl was an ad like like I don't
there's gotta be something yo you guys
ever see ads on the internet and you
wonder who clicks the ads like I just
don't know who clicks the ads I found
them alright no I don't talk about that
stuff that stuff that stuff's not what
the girls are interested in I talk about
traveling talk about other women girls
like that who date's an ad that's what
I'm
all right so that's that um what else do
I talk about talk about high school
that's just cuz I'm emo alright so today
we're drinking 100 plus an isotonic
drink and of course amazingly available
in this country same cream cheese I was
drinking in Japan they're actually kind
of better I only export like the
high-end stuff which is crazy to think
Japan but oh right there in geohawk
configuration on github I also committed
twitch cgw to github so if you guys want
to follow along at home you now can so
first thing I'm gonna do is gonna look
up suffix trees this is cuz this is like
a common thing
hundred-plus why does where stream
shirtless tonight is this not cool this
Malaysia man this is this fun is chilly
I don't worry hundred-plus what did I
say good morning it's not sleepy time
it's one 7:30 look at my computer right
up here all right
oh it's not 100 plus it's just hundred
plus I say
okay so I mean so I looked over this
paper a bit more this morning it turns
out that this paper describes things
that are incredibly simple in the most
complicated way you can believe like
this denotes the probability right but
all this stuff says is that it's between
0 & 1
and it's a real number like everybody
knows that about it probabilities you
don't have to say that right and then
like this whole thing has an integral in
it and you're like what the fuck's an
integral I don't know but then you
realize that it's actually just this so
when you realize it's just this you
realize that we have the wrong numbers
here so yesterday I had these set at 1 &
2 and you'll see that with 1 & 2
let's just see that with 1 & 2 I get 50
200 bytes of entropy but then if I use
that cough geek romanov estimator it
goes down to 5,000 so if you guys
remember get a gzip is down at 37 angry
yeah I mean I don't think it's that like
I really don't think these people wrote
it to be like oh I'm smart I think
that's just like how they think about
things
we're just sensible I guess I don't know
I'm just kind of not used to it
yeah mathematical rigor no one should be
better at that well how do you learn to
be mathematically rigorous guys okay so
when you read this whole thing um you
realize that it's memory less and all
memory lists is just doesn't uh means it
doesn't even depend in the past yeah
what else piss me off about this the
things start from one things start from
one I think MATLAB does that too and
that's why these people do that okay can
be defined with the source Melanie's
memory a finite variable or by our
market model is one such mom this can be
equivalently described by a binary
prediction suffix tree so I've read this
page I've never actually written the
suffix tree but I've definitely read
this Wikipedia and seen this banana
example multiple times and convinced
myself that I understood it but that's
always questionable I probably copy and
paste the code for suffix trees for the
longest common substring problem in
composition programming
a structure which is a binary tree and a
set of real valued parameters within 0
and 1 with one parameter for each leaf
node of the PST
sure I can crush me because I guess I
want to live in the club right
we all know that mm-hmm okay a suffix
set is a collection of binary strings s
is said to be proper if no string and
ass it's a suffix of any other string
mean s this is complete if every the
fuck does that word mean semi infinite
talk too much it's just semi infinite oh
um I'm gonna look that up
what's a semi infinite mean however I'm
going to be semi infant wow it's a real
thing abandoned in one direction on
bamboo another okay again like fine
there's a word for that it's called
infinite
you know a force like in the word again
but yeah like we're also gonna we're
gonna read the chat a little bit less
again because we're being more serious
in these I understand it may not appear
that way considering out all of a shirt
on but that's just cuz hot here silly
and I'm in this room so I'm not my
apartment anymore which is another
tragedy but that was just poor planning
on my part 100-plus isotonic drink it's
for people with an active lifestyle yeah
most people are there me ads and chat I
have the AC on don't worry don't worry
the AC is definitely on the problem is
it's one of those rooms that has the
door thingy and they only give you one
key you know cuz they know what you want
to do is the door thingy that switches
the power so I just got home from a long
walk I saw monkeys yo yo guys know I'll
shop I showed you the monkeys I'll have
to close chat seven can't show you the
monkeys but well like it's not like I
saw monkeys in cage they were just like
monkeys chillin by the street i sat
there for a bit like we talked no you
can't put literally any card that's only
the cheap ones the good ones have
actually gotten better and have attached
a string oh and leave it and leave it
while I'm gone that that would work I
think they're macaque yeah they were
little um I wasn't afraid of him
okay
like
maybe we should read a little bit more
about the suffix trees but I do think I
know how to write this
I just have a little helper function
called second xl1 DG equals pitch and X
next leave Brad equals equals L the old
rat
let's see what it does no I don't use
escape nice control-c Oh should we get
one of those things where my keystrokes
appear on the screen
does that make you guys happy but you're
all like bullshit like that I better get
more subscribers because you know I
haven't talked about this no no no no
this is a bullshit thing we only talk
about them voltage it's just a serious
twitch but we actually tried our best to
do this oh my god yeah that's great so
we want to do is AB those things to the
suffix tree
six paths shown to the leaves
yeah magic to many of you is this a good
point we don't want that um yeah so this
public efficient ways to write this I'm
not sure if these things are just
because they care about efficiency let's
try to understand here's banana the
sixth path from the root to the leaves
correspond to the suffixes okay so
that's a that's an an that's banana
oh I sort of see
we can just write the stupid thing
quickly I think so buy the stupid thing
I mean like we'll just we'll put these
in a tree structure now we'll start with
a roof node and then these will go back
there and we can increment each one in
the tree structure like going back
that's right that's right
oh man ya know I'd see my I be I be made
fun of by my mom competition program in
people all right
maybe Wikipedia page just bad look let's
really understand what a suffix tree is
Suffolk streams are given types of a
compressed tree while all the suffixes
the given tasks oh okay well that's
interesting so I was looking at it
backwards but because this is supposed
to be looked at backwards it's to be
proper if no string and ass has a suffix
of any other string and ass
there's figure 1 here we go so this is
figure 1
what about mr. Schmidt over no right
eraser I wrote a copywriter a someone's
before his dream you know where he
treasures are sexy yeah I dated and I
want to date with an ad she's man I
didn't go on a date last night so went
on a date in the morning
she lost her ID card on the bus so she
had to like chase a bus in her I don't
know man it was confusing I don't know
what path tracer is but yeah we went on
a date in the morning like what do you
do on a date in the morning
okay
so they said some stuff here too that
was a little bit confusing to me which
like just doesn't make sense that this
is how you're doing inch
oh by the way I remember I thought about
a little more another thing I was
struggling with that log to like why
this is log to the easiest way to think
about it is just like like how yeah how
many symbols do you want to store forget
the negative right if I'm thinking of
two possible values there's two possible
values now it can have one point six
possible values which that gets kind of
interesting but you know if that's the
way things work probabilistically then
there's one point X yeah exactly exactly
and I didn't know I was spending another
night here yeah yeah it's just you know
you know what always kills game man
logistics but also she was mad so
there's that too but like I don't know
it adds adzes there's some nice-looking
ads um she's she's pretty but you know
like command
it's an isotonic drink I learned have
you ever heard this word before guys we
had something about advertising it's
really funny when it's not targeted to
you
exactly no one's ever heard of this
shit's like some weird Malaysia
Singapore shit okay ask her where we dad
no sweetie I'm not crazy
no I'm not really sure it is chill guys
no worries chill it's chill and I said
you know what we're also drinking some
green tea fresh out of Japan it is it is
hot as balls here gotta be aggressive
what I gotta be yeah no man go yo look
your smoke wheelie UNAM that's fine you
want smoke weed in China that's fine
don't smoke weed in Malaysia don't smoke
weed Dubai does what we do Singapore
don't smoke weed in Indonesia people
crazy don't do that shit
okay okay no no this makes sense
my PST is a pair were asses of suffix
set and we know what that is and each
thing has a probability oh you forgot to
tell me that it was a real number and
the depths of the suffix n is defined as
the max
like
it does almost seem like I want to flip
these around right this seems the
obvious
bringing drugs here I'm sure there's
plenty of drugs and Malaysia prison
people are out there you know smoking
weed right now in this city and be like
ha ha ha ha ha yeah I'm gonna say shit
but I don't know I will fuck with that
though Cambodia you can smoke weed
wheeze legal in Cambodia I believe or at
least decriminalized so if you make it a
Cambodia hey if we're guys I promise if
we make it a Cambodia we'll smoke weed I
think is this true
it's illegal but is it like really
illegal Oh although it's illegal
please do not harass cannabis users and
businesses openly sell cannabis products
to the public yeah okay that's that's
that's there that's a good kind of
illegal
so what read it says about - sorry you
guys you're distracting me we have work
to do
get regular they're happy pizzas
hmm
the owner paid attack so his patrons
could smoke weed and his guests as well
as thus Jill some time bars will sell
free roll joints
how do we get the Cambodian guys this
coke everybody smoked weed should do
that they're good I have that product
good weed wait the pharmacies will sell
you any legal prescription drug you'd
like no I don't believe that these
people always ask for shitty drugs like
xanax and valiums
this is not true not like people think
all this is true in Thailand yeah no I
doubt what you think the weeds I thought
the weeds laced man
I'm sure the weeding Cambodia's Chell
about some mad sketch Whedon Berlin once
well it's no laced with anything good
but like the way you know weeds not
gonna be laced is if it's like grows
everywhere in the country
if it's cheap then I got a lace it no do
not do drugs in Cambodia
we what
No
okay this guy had meth and heroin
but the bad news is Cambodia is far away
they looks like all right so I'm here
what if we make it to here and we buy a
boat
what are we in spell everything them in
the cloud well wait but so what if we go
here can we buy a boat in Clandon and
sell our boat across the ocean to kill
her to cambodia cool would that be guys
how cool would that be no no I actually
I know some people here and those are
people in kotha and we could get a boat
here procure a boat and then sail it to
Cambodia no no no but you know what was
swimmable this was swimmable and the
ferry still took forever but like if you
were in the West Valley National Park
you totally could have swam from there
to there
that looks really small discomfort while
okay the other option is we could go
around no I looked it up I might be
wrong about this this is a site I really
like Rome to Rio and the problem is your
choices are to fly or to take bus this
does not sound like a fun bus but do you
really want to be on some eleven in or
bus okay well actually that road doesn't
look that bad I did some of those long
buses and uh they now have GPS world
here
no no this body alright back to work
okay so the only question is like are
these strings reversed or not that's
what I'm not quite understanding
and every suffix set
as I said to be proper if no string Nass
is the suffix of any other string and
that's okay so how do you do that let's
say I have one string and then later I
have this so that's fine because neither
string is the suffix of another drink
but like this string wouldn't be okay
because that's the suffix of that but
then at that rate unless I get identical
things
unless I literally get identical things
I'm not sure how
busses okay all right
III read your chat scroll back safety of
transportation you actually have no idea
how safe bosses are bosses bosses are
safer than trains which is crazy like
like I don't know if I believe any of
these boss things cuz I've been on some
mad sketchy buses right Aaron Aaron Jack
string is the suffix of any other so
oh okay compressed just like collapse as
a couple knows is stupid okay following
or all the suffixes of banana
I guess we actually want to generate all
suffixes to make the tray and that makes
sense we want to add all suffixes of
each of those things to the tree
you can just pick this tall suffix trees
of course it's a tree having more
possible suffixes as notes
they're in all suffixes of individual
text
this is shirtless trip God the air
conditioning starting to kick and they
will push share them I went on a date
with an ad
I hope she never watches my streams
maybe read the source code of suffix
chase
so we can like generate all the suffixes
very fundamental techniques all right
this whole thing's kind of stupid the
set gen thing maybe this isn't what I
wanted
we need an algorithm to construct one
online
no no no she was in Addis and she like
shills for products I mean that's really
the goal of social media
the goal of social media is to turn
people into ads they can code advertise
to their friends okay I understand what
a suffix tree is so here's an N squared
algorithm to construct a suffix J well
that's not gonna work
okay I think it might be time to put
shirt back on air conditioning
[Music]
you know fizzle girl nice
okay
all right let's checking out the other
paper who the other people tell me more
so this is the first paper that
introduced these things
mr. Curtis you asked me the actual stay
of the finite average resource
subsequently this state is used to
estimate the distribution that generates
the next source symbol the estimated
distribution of using arithmetic coding
procedures
I read this stuff yesterday the
concatenation of binary service
laughs starting with zero and going
negative
empty string was a suffix of all strings
so that's like the root note is the
empty string that make sense
statistical behavior of a binary finite
memory tree source can be described by
the means of a suffix set s
each semi infinite sequence there's a
suffix that belongs to us our function
Maps semi-infinite sequences on to their
unique self attacks and s okay this is
started this actually makes a lot of
sense since all suffixes nests have a
length not larger the D so D is that
number of bits thing only the last D
symbols of a 70 but it's infinite
sequence determines up to 80 second for
each suffix there corresponds a
probability together all parameter
formed upon have it okay actually I like
this paper better that's less stupid
like I was marking it but like okay so
those are the parameters your model that
makes sense kind of I mean I guess
there's also parameters of the model in
the suffix tree itself but all right the
tree source yeah this makes sense
actually next symbol probabilities
okay so it seems that such an actually
gonna make sense
forget about coding the first couple
bits now what we'll want to do is we
wanna a class
proper and complete well has to be
complete as well
[Music]
completeness
this suffix is unique since asses proper
completeness I don't know how to get yet
okay I mean I guess I kind of see what
it is right so if both exist
yeah so for the first one the only thing
we can add is just the one because not
not even
so we start out with the set containing
and like it's a draw a cheese danish
thank you for subscribing I'm still
hungry guys I had some some what I have
tonight I am the ring just pretty go Bob
I'm so hungry I'll have to go out off to
get more food so this sets not empty the
set right now has the empty string in it
Suffolk's function function map
semi-infinite sequences on to their
unique suffix s and all suffixes i have
a length not larger than D only the last
D symbols so like we're gonna first
write again and just bad actually
so you can see like okay if you have
empty set that satisfies so you can see
how the empty just the suffix set
containing the empty satisfies proper
and complete
the problem is we have to conspire time
you know espera time in Indonesia you
really knew it was prayer time
because arguable which operating systems
good is stupid
which means I made of this against his
suffix tells us that the parameter for
generating a next binary digit yeah
the actual bla probabilities and
resources with the same suffix that are
said to have the same model but the
parameters can be different okay model
and suffix that are equivalent the set
of all tree models have a memory not
larger than D it's called the model
class CD to specify model in this model
class by a natural code i encode himself
except recursively
interesting
seems complicated maybe the second maybe
it's not all example I love example
pseudo a source dad suffix at
okay
yeah this makes sense
the weighted probability is defined
recursively on the context tree
the way to prove it is it okay so let's
understand these probabilities
how did they get
yes it's not gonna split
until you have one of each
I should have to track the whole thing
at each node I mean that's the naive way
of doing it
each no other corresponds counts a and B
yeah
okay so you can see that two plus two
equals four and one plus two equals
three 1 plus 1 equals 2 2 plus 0 equals
2 ok so that makes sense
mm-hmm to back at this paper
and in GDS
okay
[Music]
let's start out with node
and the nodes gonna have an eight-count
to be count so it's gonna have a one
count and then yeah so how BIG's is
Tregoning at sea
we'll see how big it gets okay this dust
garbage
I get to a certain point with complexity
where I can't really explain it out loud
anymore I can only kind of do it when at
that point and the stuff might be wrong
bogus bullshit so I'm better I could
probably explain it you can kind of see
what that's doing right is it right
let's say
now he's nice
okay so that sugar carefully cut the
tree right that number gets to like four
times what I do wrong oh what's that
so that prints the tree
six to nine so now we can use the you
know that tape T estimated it doesn't
like like try criminal so it's one of
those STDs you hear about but you've
never actually heard anybody ever had
that's what I think about when I think
of Katie
hmm
mm-hmm okay that one I shouldn't want to
do about it means it got to the end they
were still notes
[Music]
don't to think about that
yeah
you know I know I know yeah we Yelp and
lasering in Internet
sorry was he back the Russians are
watching that there would just be a one
Oh
so you something that said that p1
mm okay cool
mr. Witter right this whole thing
make sense
you speaking Chinese in my chat
hmm whose work
like
it shouldn't
hm
maybe we do this
zero shouldn't make sense like house and
you're not even created with zeros
I wasn't looking stupid well this was
the node values it's writing the ad yeah
[Music]
okay I mean I just finished okay I guess
I'm terminating to roll
I mean I'm terminating too late that's
better okay we've got some packing ratio
yeah look at that
all right it seems to kind of work
what's up the number best you know the
marketing so much enter page
how is that doing worse than I would it
be that bad
from my perspective I have good
bandwidth I don't know what you guys are
talking about fuck
morning from the East Coast you're up
early
okay so that would mean that these
probabilities are literally just doing
worse than this off
I do wrong
no no you got the right thing I'm just
missing piece that is a suffix true
right
I'm dropping frames I've dropped 8.5% of
the frames that's not so much frames
okay
the node ass is called the pair nodes
and once the zeros there correspond
Kent's bigger than equal to bigger than
me was here
so those are my counts up here see for
any children's yeah so that should
pretty obviously be true
if any look this code right you can
write a test for that but I think so
probability is defined recursively ah
yes but the weighted probability is okay
so this is what we're not doing my
function to fetch is wrong
each node
okay this is kind of confusing but this
is this is the track right so right now
we're rehearsing all the way back and
we're just throwing out the other
probabilities so this is the node
probability so what if we even do this
let's just try
and the why this has P ones and PC
arrows here oh okay it's not totally
shitty anymore surprisingly close to 0.5
okay so let's find the definition of PE
in this code
p zero zero equals one that doesn't make
sense
I'm using the
to each node s NTD we aside a weighted
probability which is defined as ya
the only weird thing I do there is
actually I just want that and say just
call get P again I don't know why it
should be special alright so then this
is just px there oh love it compressed a
little bit I'm not very good
yeah daddy compresses like the same
reason I get more context
we're getting somewhere
she seems like it should be much better
than that I don't understand
kaby bugs I think just good
okay this just proves something's true
about this x NP okay
there's no weighted probability
I understand why
is it true that one - that
the treat of that symmetric
my only question
nice toupee
let's just try some simple examples we
have like one plus point 5/1 bus yeah
it's gonna be that okay that works
that's right
like that might be the problem
changes nothing
I said change nothing
how many ones in zeros
okay so it matches for one over two
not my shirt is worse for tip this
should match it perfectly doesn't and
she does the same as one she's weird
into some bug
because those two should be the same
wasn't supposed to be a morning date
dude I don't know man
girls know the parts of the world or
flaky girls Malaysia like the flakiness
is just different that's that's that's
all we're gonna say about that
that's all I'll talk about about that
topic yeah why was work
[Music]
you
it seemed like when are you checking
which one it will widest we're doing
this a little bit differently
you see what yeah okay so we have three
backs so I think yeah we have like look
up pretty backs or something
so let's get rid of this set check
garbage because they kind of hate it
tinder tinder gold member of Malaysia
let's just copy the same code I mean it
should be using top right I'm gonna need
to make that zero
it's a syntaxerror do not have an except
yeah I got a slightly different number
doing that oh I guess just cuz of the
first
so you're crazy the best let's just try
a little refactor on this
[Music]
that's the same
I don't really understand how those are
different domain what else that's three
notes call get P to compute that so I'm
gonna use it because both though should
be filled in
there's bug
when that should literally be the same
data structure as this just represent a
little bit differently
I'm having an effect
I don't understand this is there gonna
be same go to this okay that's going a
tiny bit off it really doesn't make
sense is maybe this
why is this so far awfulness
called it myself extreme
those two dollars should really just
track the same bed evident and let's
just make something
it's got a stupid mind Swan thing which
is heroes when we go the stats off a
tiny bit
oh okay well that explains that so
number of bits I think in this case has
a different meaning when this says use
one bit it actually means use one bit of
context so what used to be called one
bits actually called zero bits so here
we'll say you know just remember that's
plus one and this could be no that's -
[Music]
okay so that's much more similar you
know that's tracking way more statistics
you can see like this one's the same as
this one so these are the same
yeah seven notes okay that makes that so
you get four there okay that makes sense
I don't know why it's different but all
right that seems correct
so there's stupid recursive things seems
worse - I'm a bit - yes and why is that
so different
leave that there
oh look at that
that's the best we've seen yet this is
next cool the magic of suffix tree okay
so I don't understand why they're doing
that context waiting thing but this
seems to work better if we have context
use it yeah look at that look at that
new record I let's go up to 16 let's add
back in the printing I shouldn't deleted
that hate when I delete stuff that later
want
I'm at an isotonic drink almost I've had
a green tea and the only good thing is
that the compressor kind of works yeah I
know I know I wrote this before get
history course not
tell I have an old get history
Oh guys guys did we just beat dude did
we just be gzip we just be gzip oh oh
hello this shit crushing it bros
absolutely crushing it bros look at that
look at that
35 bytes of entropy oh yeah go we go
more will be even better
Oh
Bros Bros that was the easiest shit I
love is gonna be hard I don't even use
their waiting shit I got it all the way
down to pay all the way down sir no
ma'am now to be fair the only way to
really know whether a compressor has
bugs in it or not is to actually create
the compressed file and then decompress
the file right because if you don't do
that you don't actually know if it has
bugs give me one sec you know what guys
here's what we're gonna do I'm gonna run
out and let's see what foods around here
and then we're gonna come back we're
actually gonna write the arithmetic
coder uhm but yeah we'll just say dat
ratio bro so yes we've written a better
compressor than gzip and how much lines
of Python now know better is an
interesting and well this is all crap we
don't use that so in in 70 lines of
Python we've written a better compressor
than gzip using context tree waiting now
the reason why better is a little bit
subjective is because I'm sure it's much
lower than gzip gzip is not really
designed to be great compression gzip
just wanted to be fast I'm good I lick
the paper just search for context tree
waiting maybe maybe I'll throw that out
I'll put a paper therapy and then you
can you guys can go my github yes it's
just there's a lot of stuff that it Wow
a lot of people have implemented this I
guess I didn't even know Dan just search
for contracts tree waited miss lots of
stuff yeah we'll be back we'll be back
and maybe give me give me give me ten
minutes twenty minutes and then we will
implement the arithmetic code hopefully
oh yeah such good compression such good
compression growth
I seen a bit ma'am it was good it was
good
I had banana roti and it came with curry
but it was weird to dip it in the curry
so I didn't really dip it in the curry I
kind of wanted to get some tosai to dip
in the curry but like I stood there with
the menu open and I kind of just got the
vibe there like who was this guy why the
fuck is he into a restaurant so that was
kind of the vibe I got so I'm gonna wash
my hands cuz I touched money and I ate
food touch my life laughter you know oh
I got this
this was 1:30 Riggins it's kind of a
ripoff usually they're a dollar but the
roti was a great deal
you're gonna write an arithmetic coder
oh yes what's your awake I got some
technically you're into entropy decoder
ah so let's see if we can do this I'm a
little bit tired but we'll enjoy our
best how long they've walking some
monkeys today and I don't mean
Australians and I mean like actual
monkeys sometimes yo you like what
Australians go out to party and drink
while monkeys been let's like pick like
a reasonable number that's like 10 is 10
a reasonable number okay um so the
basics of how arithmetic coding works
broken No
guys is not racist
cuz I'm Australian and a good good good
should we go there should we go we
talked about how according to some new
definitions you're not you can't you
can't be racist against white people I'm
not nuts Hanna believable but you know
now but you have you ever seen if you've
ever seen a group a group of Australians
when they when they come to like one of
these islands to party and then they
were in the hostel that just just just
crazy it's for a while
racism was acceptable only if it's funny
I like that snot funny you can't do it
that was funny
okay so the way that it works
this is even more complicated because
I also thinking about what if you're
wrong there but wait so this is P of X
so that's nice we actually need P of 0
hmm it's not exactly right
that's P of X Q 0 and P of X so what we
actually need is the probability range
that it's in so if X is 1 the range is
going to be from P of X to 1 else
the range is gonna be from 0 point 0 to
P of X now yeah this is this is this is
arithmetic oh yeah
the idea is you just put that range you
scale that range by your current range
and then once things get too small you
have to you like to have to quantize the
probabilities
hmm quantize them anyway
for those of you who missed the date
thing you missed the date thing you got
to watch the earlier stream you don't
get to know if the date was discussed in
detail on the earlier stream
yeah this this is this
hmmm it's cute
so this is just normal arithmetic coding
there's nothing special about this like
I do have I have probabilities I have a
model which it cold
the definition are starting to work well
guys want to see outside
I'd wear my denim jacket this morning
okay
[Music]
approximated by 8-bit precision first
thank god there's patent hate pants all
right so let's round P of x equals P of
x times T six doesn't matter
oh yeah so it cost us two bytes if we
round to the nearest 256
so isn't there a python class calling
for action which I go to Python 3
details for action from fractions and
port fraction loves fraction no math
tool can take oh great it's very
different
so let's just try it a class encoder so
you like just a little bit of
encapsulation here what goes here yet
say code self px and we're gonna do inc
dot code this
[Music]
fraction as in you know I got a
fractions water bottle left a fraction
is green tea left zero fraction which is
a tragedy I do really enjoy those
grantees and I got no fraction of that
left either 100 plus more like zero I
drank it all right what just happened
that was freaky
okay so we want to rescale it to
self-doubt hi - self dot low and what a
multiplier has if that's X is one do
that tells we set the height of that
it's not right
just cold
[Music]
well you don't actually want PDX there
we want P to the zero I know I should
just put this finite precision stuff in
here there's arguments that I shouldn't
whatever those are later on
[Music]
wait a second this isn't right does it
know
don't pass an axe
this isn't even right
hmm see that's what I mean you don't
know if you have a working compressor
till I'll put this back to pee
[Music]
yeah
you can write that right no that's not
right we want to ask us about the first
part of the for action I'm still I'm
still confused about my great thing you
might not even work you know this one
works
the track is really huge numbers
so what do we actually want to say in
south dot h
let's just try this well those numbers
get extremely small
how'd it get negative just crap oh
[Music]
that's better
so yeah once we have bits that we can
remove from both the fractions so I'm
not sure exactly what that means in
practice but that's like what the idea
of arithmetic coding is right like when
your range vision that can be sent to
output range after renormalization the
normalization
no no I mean I think it actually works
he's fracas at infinite precision just
really small
PSEG CDs every time
you understand what I was doing wrong
there
you have an idea
[Music]
okay I think this is actually a :
alright smoke got out arms to t sex
[Music]
can I say dot numerator is that it
I'm probably writing this quite stupidly
[Music]
the date has been extensively discussed
in your division results too large for a
float do that still popping fog
I'll time
I don't even know I'm coming tired
it's really slow
turned into a mourning day because of
aforementioned flakiness this is really
slow I think it's right but it's really
slow okay I'm not using the fraction
plastic fuck fraction
no fraction that
hmm you know what occurs to me that with
finite precision you're sometime gonna
get things on the bounce
I have some bad news that number before
it might be wrong cuz I'm not using X
like I don't know how this is this isn't
actually returning the probability of X
what is it return
what is that returning yes that's not
right cuz we don't use X right like here
we use X and this is correct half a
point is about getting excited bros
that's it you know what twitch doesn't
get to hear about dates anymore
oh jeez if I start to tell you about a
date just to remind me that Ritchie's
don't know about dates anymore this is
some of you guys talk about that and
like all you're using a Mac or can I get
your dot file or what keyboard is that
band not they're not that harsh
okay that's just the previous
so maybe we do this
it breaks it entirely
it's weird there was matching it
just more confident
so you didn't return now
very rare occasions actually it gets the
next one
right
they don't charge you more if you use
more power
oh well no I broke it
I don't understand him I have what I had
before was even close to right but it
was producing right answers which is
weird
yeah I should bring a Bitcoin miner with
me everywhere I go
I draw like 10 kilowatts well I still
think about that if I could pull 10
kilowatts out of power outlet I'm using
just the most worthwhile I mean you get
yourself thrown at a hotels but would
they know you got to be able to take a
lot - he
yeah well so here's our 10 kilowatts
even close to feasible yeah I'm probably
not realistically you're probably on
like a 15 amp circuit to 20 volts in
these parts of the world so you're
getting mingler tool kilowatts powers
like so you're making 20 cents an hour
no it's not so worth it
yeah well not really the better thing to
do would be to figure out how to like
wire into some like streetlights
oh it was right I was just predicting
for the previous body which probably
cheats because it probably uses
we crash more than like normal
Oh your pecans are worthless well
subhanAllah leave damn even tethers are
cheap cheap tether tether press
I guess it's assuming none of the
predictions are wrong
some of them are I don't know
it's annoying when you think you're
close to something and turns out that it
was lies okay so that's one that's the
same as this thing returns when the
answer is born
very close to the same thing we go back
to the pitcher and those obviously
doesn't work
okay so that's giving me the probability
of the next yes so what I'm not tracking
correctly here is like is it the current
symbol or is the next symbol
this is all wrong man
thought we had good shit before turns
out was all wrong shit yeah technical
analysis is what you don't use like your
thoughts about the stock you only use
like market fundamentals like Oh what's
a p/e ratio shit
they all do these people who like pay
money to be in these groups of these
kids who are on Robin Hood and they're
like oh I got day trade of a day trader
bro
I think that's actually better see you
know you just never know that you have
your compressor right until you can
press a file
[Music]
that's more correct
well we're not being gzip anymore guys
these are totally good I think it is
crack now that doesn't make sense okay
it's install the actual blocker okay so
it's all just next symbol probability
[Music]
oh okay that works
okay well now back to the drawing board
how about making things better than
Jesus is now chitty-chitty
maybe now we can use that equation that
doesn't work
okay
now so I feel like we're I feel like
we're like the reason this is wrong as
we're doing it like the wrong way yeah
so that that's of course gonna probably
close to that because the most here's to
us just being thrown away there we go
the other way it's more correct right
you see what I mean by the other way
okay we're back again worse than Jesus
don't don't we celebrated twirly guys we
celebrated too early no just great
tragic now we're gonna make the whole
compressor actually work maybe not
tonight but at some point oh okay that's
not right but what we really want to do
yeah so we're recursing back through
things and we want that one to have that
point five wait
not the current one
so I could return the whole list
and then compute it afterwards or is
there just a cute recursive way to do
this
mr. Schine West
we're constructing a stupid list every
time
yeah
so that's effectively that that should
give me like nineties yeah
now we want to do is make the first one
weighed the highest so maybe just for
accent now we're at equals out
so to be clear the money alone is the
one that goes yeah so we'll get rid of
that one put them around rat equals
super 500 plus 0.5 times Oh
all right well we're not back to beating
gzip but at least we're gonna be
ambitious and we're gonna write the
encoder tragedy but we're actually doing
the waiting maybe we can even make this
big oh come on Bee Gees up again no I
can't be Jesus Jim juice you're the good
guys
Jesus Jesus super talented you know oh
just go Yosh
going a huge number notes and doesn't
even look better garbage
thank you for the bids Dortmund I always
appreciated money you know in this world
we've all money
trust me Malaysia money it's beautiful
beautiful morning
alright I think we have to settle for
just fixing it
no no they already got my stream I'll
think about the encoder event yeah so
okay okay
we prematurely celebrated in the
previous stream but we really did get
things down from like what I ain't wrote
in the reasoning what they wire I just
dropped telling for BT that Vizag
Oh
that's it does we got Mavis gym tomorrow
she write the ACMA decoder entire dogs
bedtime late that was later last no no
I'm tired no no that was a lie that was
a lie I messed up the calculation that
that was that was assuming none of my
prediction wrong that's the hypothetical
maximum with the levels of precision we
had we've actually only gotten to here
now we weren't quite predicting the past
we were just saying none of my
predictions would be wrong the tree was
the choosing cutting their own thing
it's encoding the right thing now I
think I don't know crystally wrong the
only way don't know for sure is well
write an arithmetic encoder and will
generate the file and then we'll
decompress it and a little difficulty
make sure they're the same stinking okay
at least now we have a good
well when you talk about domain-specific
compressions is why you also talk about
the length of the coat and sure I mean
everything you can think of is probably
not everything like I guess like cheese
it's not but like PNG PNG is just Jesus
all these 77 zits deflate it deflate the
same thing as gzip I don't even know
yeah so somebody it's not Jeezy mpg I
believe PNG actually uses a Huffman code
and not an arithmetic code and this has
been talked about before but one of them
because Huffman codes are much easier to
write he's gonna write this arithmetic
coder
hmm
I didn't try to simulate infinite
precision
hmm oh gee this might be okay what if I
just send one bit at a time to the
output in a way it's slower but
we want to try to use for action again
surely p0
I think it matters but
the only thing about p0 is not as I said
make some sounds but
yeah I mean this is fundamentally what
you want to do whether use fraction
library or not you see like so what
that's doing I'm tracking a low and a
high and like you're in the yellow arrow
doing that yellow arrow you're in that
yellow area but I think I can say if
Danny output zero
[Applause]
and I want the same bug that ever the
last time I wrote this
I'm sure which was you actually had X
really was one let me move that up
- there and I've actually was heroes and
I think reaction was I won - here
it's amazing any code I write it works
so maybe I'm a terrible programmer like
I don't know people like think this
stuff out more well they just kind of
try things until it works
where people like sit down with like
paper and try to figure things out maybe
I should do that instead of trying to
keep this in my head that sounds boring
yeah so then whenever we can remove
precision from these fractions we want
to show it that means
a fraction sucks losing as a way to
think about things
[Music]
well the problem really is this
multiplication
let's find a reason to fractionate right
here we'll say self dot d x equal 36
here we want to do less equals t 0 but
we have to rescale these to the old so
that's the whole problem I wouldn't have
to scale them and just be trivial
oh god I shouldn't do this and see what
you have to deal with like the fact the
name
so this was easier
like it's so easy in theory but then you
have to deal with finite precision
can I keep the denominator something
reasonable when you multiply fractions
you multiply the numerators and multiply
denominators right good I don't know is
that you multiply fractions does that
make sense
yeah you multiply fractions you multiply
the numerators new month with
denominators you subtract fractions okay
so you're self-taught range range
numerator equals subsidy myself that age
range denominator which equals D
okay then we want to want to rescale p0
to be in that range so we want to
multiply p0 times the range numerator
multiplied the denominator times the
range to nominate it so right okay the
denominators are gonna get huge fast but
that's
getting negative numbers again
I hate fucking negative numbers
okay so we take p0 put into the range we
can just multiply it by the range
numerator three fourths so there are
five nine eighty three fourths
this is the same thing as 9 over 16
okay so now if X is zero then we want to
set too high
that's okay
and think
yeah guys I'm tired real asleep we'll do
this more tomorrow they'll make it work
when guys are watching my live bat and
try to make it work yeah later
we have a lot to talk about haven't
talked in a long time we have so much to
talk about hey where's my chat this
Austrian chat okay there we go
no viewers all right
Goyo welcome to the stream hopefully
we'd have the bandwidth okay guys okay
we have a few things to address as soon
as we get a couple of viewers in here so
the compressor works I fixed that we can
go over I was being stupid with the
automatic coder
I was trying to encode infinite
precision but you don't you need
infinite precision like it's fine just
represent it as 32 bits key inside the
precision doesn't have to be perfect
just the same on encode and decode um so
it's still saying we have zero viewers
let's give people a little bit of time
to get in here I start talking some shit
just we're talking ship tonight remember
how I said these things we're gonna go
we're gonna go we're gonna be good and
they're gonna not talk shit well guess
what we're talking shit tonight maybe
well we'll see if we can make the
compressor be gzipped oh no I'm not in
Jersey man yo what's up no I'm not in
Jersey all right guys you don't know
where I am it's all my shirt I'm in
Langkawi Island Malaysia Langkawi Island
Malaysia now is shit-talking time
tonight no no we'll do some coding too
but it's a little bit hard to do coding
because guys I've fallen on rough times
I've fallen off times and I'm extremely
poor
I'm extremely poor all right so this is
all the written gets I also have 100
more Ringgits but otherwise this is
what's left of my money um so we're out
of money um this room tonight
cost me 48 ringgit it was 38 ringin on
the website but if you're not Malaysian
you have to pay the ten ringgit tourism
tax um you can donate to be regular
twitch you can a subscriber you can give
me money so the only this is a great
room
um I'll show you guys the room I know I
don't usually do this but you know this
one this one will make an exception so
here's the room um it's a great room
except for the fact that and anyone
who's traveled in Southeast Asia knows
this
this is fan room this is not aircon room
thank you for subscribing thank you
the UM yeah so I'm in fan room so it's
very hot I'm in Malaysia and tomorrow
I'm going to Thailand I bought zero
hookers on my trip but zero hookers I
did go on dates I bought girls drinks we
should have gotten cheaper drinks in
retrospect because because I'm out of
money um no no I'm not taking my shirt
off today I could take my shirt off but
I kind of like my langkawi malaysia
shirt this shirt cost me ten ringgit
because I wanted to have my laundry done
today which I did which also cost me ten
during it everything in Malaysia costs
money now the other thing that we're
gonna shit talk about is this I don't
usually read the comments on on the
YouTube but
did that this one was the top comment
wait does George really not know what an
integral is and it got 12 up votes guys
this fake news no no no like lick
illegally I really don't think I said
that and we're not going to be able to
have these anymore of comments that I
made are gonna get interpreted out of
context I complained that there was an
integral you know this this just just
the level of a fake news and the
intensity with which which which you
guys will up vote fake news so so okay
um if anyone would like to ask me
questions about integrals I promise you
I haven't learned this stuff recently we
can do this I got a five on BC calc AP
exam when I was when I was fifteen and I
don't really forget much of that I mean
it was pretty new shit I remember how to
press the integral symbol of my ti 89 so
yes I know what an integral is and and
you guys can ask me questions about it
and then I want everybody to go on
YouTube and download that comment B this
is bullshit man are you guys gonna stand
for that big news first you can ask me
first you can you can you know you can
ask me questions right here and chat
about about integrals and in like you
know here's here's here's here's my
interview here's my interview I let's go
wants to ask me integral questions don't
give me like hard bullshit like if you
ask me what the integral of like sine is
it's like negative cosine or something
but is it negative cosine well so an
integral is an area under the curve so
if you think about the integral of sine
here's sine well you really have to talk
about how you wanna how you want to
define that integral but yeah you
probably want it to be your negative
cosine because you wanted to start from
here at minus one so yes the the
integral of sine
cosine what's the integral of an
exponential an integral of like two to
the X well so the integral of e to the X
is of course the same as the derivative
of e to the X which is e to the X I do
love you to the X for that so if that's
what you mean by an exponential if you
ask me what the I don't know if 2 to the
X was I don't know maybe I should know
that what's the integral of 1 the
integral of 1 is X plus C of course
don't forget your plus C's I think
that's right right the integral of 1 is
well yeah so the integral case so if you
think about the line y equals 1 the
integral is going to be X oh yes the
integral of the tangent of sine alright
so I think for that we have to use the
chain rule so yeah ok yeah that that's
that's beyond what I can do what I can
do in my head III don't know what
alabaster integral or judicial a
function is though I have heard that
name before the up votes are going up
fuck you guys you know you know I hate
that fake news man
I hate that fake news so so welcome to
my stream of good I'm glad you're you're
convinced that the derivative of cosine
is minus sine so yeah that's exactly
what I said you can take the - you can
take the minus sign outside and integral
the integral of the derivative of sine
would be cosine if you think like this
slope of sine here is going to be 1 you
can convert the tan to sine cosine and
then do it tangent is sine over cosine
hey guys don't spring fake news if
there's gonna be fake news we can't have
nice things anymore and also please
subscribe to my twitch channel guys this
is all the money I have left in Malaysia
and is why I have fan room and not
aircon room tonight yeah all right all
right
well you know that's the thing you ask
people on the Internet to do something
you're never gonna get that done this
you like you gotta you gotta ask
yourself difficult questions the
integral of e to the X is e to the X
plus C plus C for that wonder then okay
so you can also have you can also have
to have definite integrals where a
definite integral is when you have like
here's your like weird integral e thingy
and then there's like that guy and that
guy and you compute the integral with
that and then do minus the integral of
that and then you don't need a plus C
anymore
if you sedan didn't go but if C
indefinite integral you have to put the
plus C or you get little minus ones on
your math test now guys I have them
let's count my money one ringgit doing
it mmm seven ringgit 57 ringgit and i do
want to make it off Langkawi Island
tomorrow I do want to make it off link
Harry Island tomorrow like you have to
ask yourself tough questions do I drink
the tap water or do we pay to ring it
for ice mountain it's cause to wring it
guys what do you do for money I'm a
cowboy
you can tailor expand oh I guess yeah
and well I should begley know how to do
that you don't think I really know about
Taylor expansions is like that so you
can compute like there's a couple to
compute you can compute sine X that way
and then that so you can get like PI if
you want if you want to do PI there's a
couple Taylor expansions I think there's
the Taylor expansion of e to the X as
well I know the edx thing has like the
factorials or something thank you for
subscribing thank you thank you James
read thank you thunder shots and thank
you a 20-7 TV for subscribing ok so
let's see did you guys actually y'all I
voted that shit y'all up Wow Wow 20 up
let's not thanks twitchy's thanks
twitch's you're all terrible
alright alright umm first
yeah no no no I don't want to have
cholera you know what they say about
penny wise and pound poor you don't want
it you don't want to do shit like that
because yap yap yap yap yap yeah okay
well dude we don't talk about kama on
this stream i remember the basics of
calc nope like my point that I was
trying to get it you know what let's
revisit that integral since we've spent
a lot of time on the integral incident
now um I believe it was used year this
is probably gonna be the last here we go
okay the KT probability of a binary data
sequence is defined as this now what's
the integral of this I don't know I just
the A's and the B's are constant I don't
know what W is a W is this so I plug
this in so now I have like weird PI's in
my integral they write all of this out
and then they just say well here's an
equation for it right like my point is
we could have avoided and in to go there
this sound and the guys I'm amazed that
the internet works here at all I'm gonna
link Aoi Island if you if you're just
tuning in I'm on the link Aoi Island and
fuck you YouTube commenters I don't know
what the integral is but we're not doing
any well we'll do more math questions
you know I always like math questions
cuz it's good a judge you memory keeps
you sharp keeps you ready for the world
ahead don't forget your math kids math
super important
all right I've been drinking his ice
mountain water all night
should we have a tea should we have this
tea it's a little late for tea but
should we have the tea either way I got
a pee so I'm gonna go do that and then
we're gonna get the coating on Langkawi
Island
okay
yeah DEFCON yeah my good that anymore
guys calm a I still exists it's a
company it's out there it's doing
actually really well um my name is
George Hotz I am a person on this stream
we don't talk about comma AI we talk
about fun programming activities thank
you thank you I washed my hands guys
there's no soap yes I didn't use soap
but you know I rinse them off all right
TMI all right so I fixed the arithmetic
coder I'm sorry I did this when you guys
weren't watching I was mad at myself in
the last stream for not being able to
get it to work right so it turns out
like the reason I was trying to use
fractions I did wash my hands and I'm
the reason I was trying to use fractions
because I felt that the precision had to
be infinite but when you work it out the
precision doesn't have to be perfect it
just has to be the same on encode and
decode so you can read what I'm doing
here
this this p0 is out of 256 after you do
this right and then this is a little
cute trick this is a little cute trick
to make it go from 1 to 255 because you
can't predict a probability of 0 or 1
because if you are wrong you have
probability log infinity right so you
always want to leave a little bit of
margin for error and that when you put
upper bound it we can of course encode
things with more precision but I don't
know
that's gonna matter that much so then
this here is you can see what it does it
just subtracts these things as integers
so there's a precision loss here when
you do this but it doesn't matter
because it's identical on I don't have
that keyboard I'm on a 13-inch Mac Pro
sitting on a bed because I don't have a
table in my room online Kerry island so
that's that's the coder okay so you can
see that we're not doing that well in
terms of bytes but at least you have
like a proper test for compressor now so
you know we're compressing the file we
run compressing the file and then we're
checking to make sure if they're the
same please subscribe please donate so I
can afford nicer hotel rooms ever
talking about the fuck Sony man I'm not
talking about the ps3 we code here and
we do math that's what we do on this
stream so I also had context tree
waiting almost entirely wrong the thing
that I wrote was not really context tree
waiting you have to track these two
probabilities P E and P W so one of the
things that really helped me understand
how it works was I read I read some
other implementations so there's this
nice easy to read implementation written
and go except that it gets a horrible it
compresses way worse than gzip so it's a
terrible compressor and then there's
this one which is the authors
implementation and we can we can take a
look at it what I put
[Music]
no this is probably weird to have all
that much closer so yeah this is the
author's implementation but when you
read it there's tons of bullshit like
there's you know there's just bullshit
like these ones aren't that bad but
there's one where it's just arbitrarily
we're gonna find it this stuff is so
it's extremely complicated and looks
like in order to get that loss they
didn't just implement what's in the
paper they do a huge set of hacks I
talked about the most egregious one I
actually mentioned in the readme and
everything for my shed if you remove the
max counts thing so there's this thing
called max counts which if you remove if
you increase it yeah maybe I just did
something wrong but if you increase it
basically if a count exceeds these range
because it doesn't want things to get
small but so I did also check out this
this morning this is Skip CTS so it's
the more advanced one it's the skip
context tree waiting I skip context tree
switching and now I understand what
context free switching means too
it basically just means that this this
idea of context is big in the hotter
prize compressors which means that like
different party it deals with the fact
that sources in reality are non
stationary so if you see that here talks
about stationary sources and the
stationary source means that like
everywhere in the file or in the string
is statistically identical by any sort
of test to do should we have the tea
guys sure we have the tea I don't know
if we get a subscriber in the next two
minutes we'll have the tea otherwise we
wanted the team
sounds good so one of the things I think
we can do that's really going to improve
things is if we add support in the nodes
for well so they're these skip contracts
tree switching implementation I read
looked a lot simpler
there's a recent extension of context
tree waiting that and I'm curious what
these theoretical properties are because
that's what they said about cgw I'm not
quote did you subscribe you have to
subscribe gonna have the tea you know
then we're gonna get a better stream
otherwise we're not gonna get as good of
his stream um okay he's right you want
to sit here for like an hour while I try
to figure out like which box and haratz
from which box and who has ownership of
the pointer I mean we could do that I've
tried to code and rusty takes me forever
it's not exciting to watch but yeah so
what we can look at tonight is let's do
symbols
okay
dirty that crap I was doing with all the
notes
Wow looks okay except we're gonna have
to change this too
so I'm just refactoring this to allow
multiple symbols I'm more than two we're
gonna see cuz I have a theory that just
like it's only really slow because we're
doing everything in terms of bits so if
we switch it to do things in terms of
bytes
I think things might work a lot better
yeah so here we're gonna need something
slightly different
[Music]
I don't need to right here we want to
use tpw outside so this PW is the
weighted probability it inherits from
the previous one so that should work out
to be pretty much the same
[Music]
this indices must be integrals or slices
none type
should be okay
Oh X is somehow none
sometime in is on none Wow don't you
man domain error
[Music]
you probably would this
like that being too close to zero or
something
normally subscribe no to100 Sabbatini
you know you know I look a little good
guys this is all the money I have
alright I live in I live in fan room
what about while I'm not having the tea
guys the tea costs money too
everything costs money
it's truly code better okay math domain
y0
and zero
how did that Oh
I am log addicts that seems right
and it's not none
we do that subtly send over bitch
okay
[Music]
when is that even different
basically it's a root node we want to
use that that's not it
okay let's think about when it would
predict a zero
so the way this thing actually works and
this is a trick I stole from the go
paper but it's also used oh the Python
MC AXI ttw is just it's just wrong big
numbers they're not too large
so what this does is gets the likelihood
of the tree and I had to fake zero to it
and then it gets the likelihood of the
tree again it seems like that's doing
nothing
oh no that's okay
self-taught parent equals parent know
itself that's fine
find prove exclave that's right
crazy
and it's gonna fix it
you can print this crap again yeah okay
so I think the problem was just that I
wasn't creating those notes don't really
matter it actually seems to do better if
I create those notes no maybe not
it doesn't do better take that one back
but yeah the promise is no way to really
on create the notes so when I call
reverse it doesn't remove the node can I
make it remove the note not really known
as it's done and find so you okay it's a
tree it's like a suffix tree and what
this is doing by the way you guys can
find all of this code on my github
github geo hot twitch cgw I mean the
problem of compression is always asking
the question given the previous symbols
what's the probability looks like the
probability distribution the next symbol
you can answer that question well you
can compress
I can't even have the fan and the fan
room on because it messes with our apps
yet which makes you wonder about the UH
the Wi-Fi gets worse when I turn the fan
on which makes you wander
makes you wonder a little device print
statements are definitely okay okay so
that's Oh scared me
it's doing a create and that is good
it's probably slightly suboptimal
because really we want to run create the
node after we're done with it well let's
see I will deal with this later let's
just first see if we can do a lot better
so we're gonna try to compress are using
bytes instead of bits as contexts one
can see there he's gonna want that
underneath bite Jen I mean that's just
the file itself right
reasonable must index out of range
oh yes that's right we have to say for
colder no not for the cold air there's a
no I'm actually
they create no we want to say symbol
equals B sex
well I think that's right
definitely not right with the encoder
[Music]
yeah okay so
the problem now is we don't have to
anymore
thank you hacks feel for subscribing
thank you she would drink the tea now no
I will drink the tea tomorrow the tea is
for tomorrow we have a lot to do
tomorrow we have to go to Highland
tomorrow we're going to Thailand I
wonder if people hear me what they think
what if they think I'm talking so I was
thought Peter I said two minutes okay so
we have a little problem now we're
[Music]
basically so
I mean technically we only have to do
symbols - one by
see the problem
well this is also useless
that's not a probability what the hell
kind of numbers that
well this isn't right anymore this is
actually won over self dot symbols
I know it's too small
I don't know what that 25 is no I think
that point 5 is different
yeah this isn't right
no let's not skip CTS it's just
context-free waiting it's the one that's
based on this isn't right
okay so those are all close to one
garbage
yeah
so we have to figure out how to do that
the KT estimator for things that are
non-binary Skip CTS might actually have
an implementation of this it's going to
take a look
it's fast math
Oh
long gasp then we don't use numpy so hey
it's numpy I hate time
yeah whatever it is we believe the numpy
so yeah I'm doing all the probabilities
and logs because they get big and you
want to remain numerically stable um did
that be cool didn't copy that actually
be interesting I'm curious to read that
code let's read this code quickly swap
them okay I've seen this before
it was like some identity with logs
Oh
I'll see if this is all this fancy shit
by default it uses a DeRusha lay
estimator with a perks prior alright if
the next YouTube commenters would like
to make fun of me for not knowing what
those things are that's okay but don't
tell me I don't know high school now I
was tricked
estimator prior know that I'm not
triggered anymore
I'm only triggered when you didn't mean
to trigger be if you mean to trigger me
I'm not really triggered I'm like I know
trolls and other troll
hmm
what is this thing like this this just
looks beautiful this coat it's kind of
nice
no not that beautiful he looks simple
anyway
okay so they're not using KT estimator
they're using different thing
oh no guys
what doesn't work did you know that
because this isn't correct
there's the other implementation
yeah by AXI there's another
implementation maybe they have the right
thing here
this code i thought was pretty ugly
you know this only works for zeros and
ones
see that's the log something but that's
why it's been awfully unstable because
they didn't do that other stuff
you know no hacks if I doesn't get
banned because he has star next to his
name
and when you have a star next to your
name it's like it's like discrimination
you get away with stuff because you have
a star next your name and you're better
than people who don't have a star next
you guys know how to start works right
because I only have 57 ringgit okay
can't say too lousy about 57 wearing it
what if I get robbed
Oh watch out now Malaysia that we saved
country
I was sketched out by this girl and we
won't go into that story but Malaysia is
a super safe country you always ask
always with the why the why the why oh
it's a dumb question
no no I'm not going into that story not
enough but oh thank you thank you for
watching an ad thank you um okay so
unfortunately this one doesn't work for
multiple stuff and the other one uses
some other crazy stuff that I don't
understand tutorials that's that I wrote
I wrote a little I wrote a little
compressor that uses the CTS
implementation just to test the to test
the number of bits and yeah so it seems
to encode it in under three dozen bytes
so this is the best one
now Malaysia's are super safe country
guys so well it's really it's a really a
good story
yes I wrote this just a little thing
that uses this thingy which is allegedly
good but maybe you wait this gonna make
sense oh that gives me the log
probability of C okay I understand
yeah so I can again iterate over all
them to do that
well what's in the docks on the docks
any good
whether I like these people they include
their reference Python implementation
because no one implement stuff and see
on the first try
why do that makes it work in Python
first
all my boat buying plans I forgot all
about that forgot all about that
all right I think there's things that
I'm gonna have to learn about this
version works with large alphabets
so probably what they're doing I mean
yeah it does look like they're using a
kt estimate all right like they don't
talk about it anywhere I just use Bayes
rule here I mean if I have a prior I
think the only question is like what's
my prior right so this this this update
can be replaced by Bayes rule
I think that's effectively kind of what
it is right cuz I'm subtracting over the
sum of all possible
we don't talk about the past even if
you're a subscriber we only talk about
the future
okay so instead of using a KT estimator
it's using a derisively estimator
okay it's a multivariate generalization
of the beta distribution so the beta
distribution is what's discussed in the
other paper
this talks about the beta distribution
we should understand what the beta
distribution is
yeah you know what you guys want to
cheat you guys want to use you want to
use there's let's see if we can actually
make it a compressor let's do that first
make sure the lightness is something
reasonable
okay so this actually still doesn't make
this problem trivial even though we're
cheating No
I'm gonna give it the same interface as
the other one the other one is it pretty
good interface I think model of
contextual sequence wall
and that's the interface log prob
I'm gonna get the number of those for
this thing
Oh see look yeah look they do the same
thing have a special symbol call it
starts in them it starts them so they're
actually doing the same trick as I am
here instead of so they're just called
soft up free bags that's right
called context Lance
number of bits like a moron um so you
can think of this as cheating a little
bit you can think of it kinda like i'm
i'm reading i'm using this
implementation but this is actually how
you learn things like try to do things
for yourself struggle to an extent and
then really kind of mesh the two
implementations together it's probably
the most efficient way I've really found
to learn
so if they call Preet with would they
call context I call pre-tax
here we want to say cgw okay I'll make
sure my shit still works self dot
context Lane
I'll spell it right just index out of
rain
yeah that's amazing fighter
so that really shouldn't be global
mmm if you subscribe no I mean I use the
top right as well it's just it's just
hard I know you miss a little bit you
miss a little bit what's down here
it's kind of hard there kind of breaks
the abstraction
it's hacky is still gonna use a ball
ball but
okay
so I mean it's got a shitty compression
ratio but I think it still works
he wrote a test very high quality test
okay let's plug in their model because
they actually understand what a DeRusha
lay estimator and sampler is and stuff
and one day we're gonna understand this
but I think it's less fun to do one two
edge
okay
so
yes
from cts important
and then we will just say cg w equals
all about contextual sequence no okay
so is it called update called up there
where you switch that to bite chance
that this is still wrong let's see if it
works
okay
I was logged problem so in order to
convert a log prob to a real probability
we have to do a map back course
and also probably doesn't have an
attribute notes does it
and we have notes
well look one byte of entropy how did we
do it
okay okay okay we'll move the camera
but no complaining if it's up here all
right a little bit wrong
hmm so it's very slow now see how slow
it is so slow so small oh it takes so
much bites
that's not exactly right it really just
one count yeah yeah every night you do
count times eight so it's number of bits
to encode the bytes is actually correct
I think
thank you thank you for the bet thank
you
okay so now we're doing things at the
fight level we're gonna see if we get
better compression
insanely slow
and what it does compress better
because ratios
yeah such good ratios
you know what I believe a bit is 10
cents large I'm probably wrong
well okay this does a lot better
yeah wow it's getting down to 29% bros
okay
so we have a few problems one everything
is so slow - we're not really encoding
anything make sure that's correct oh
that should be one
you got all posts already say it's
closed
but if it's a proper probability
distribution it has to sum to one don't
get it twisted so sum to one
okay so now we have the problem my
arithmetic coder doesn't support more
than more than a few symbols
maybe the contact shorter seems to make
it faster
and for this
I actually do math dot log - really
stupid eights every one H is measured in
bits here we know that but I can
actually write here as math dialogue -
symbols that'll make that more generic
um if you're looking for recommendations
for for software projects you should buy
a panda and you should have features to
the firmware wait but that sucks still
that's crappy
mostly that still works with CGS equals
false
what really oh well so I didn't listen
when it's a log drop did I
I thought it was faster but actually
this place is not the cloud as hot as
fuck and there's no air conditioning but
that's just because I'm cheap
and the rs80 today's come ok so just in
penang penang had good food and now I'm
in blink owie and food I mean it's not
bad but I might go out buy a fish no not
taking my shirt off guys as you missed
that was there was one shirt off stream
and that was a special stream and you
guys missed it I mean if you missed it
if you were here for the shirt off
stream and then congratulations who saw
the shirt off stream
where is your post box
try contact me I'm 16
yeah Penang had great food I missed the
Penang food
I might go spend my last 57 Ringgits on
a fish I might
all right let's come on to win the hotel
[Music]
yeah others peeing on the street that's
right we're in a small room together
guys chill relax you're all here with me
you're all welcome to link our yeah you
know when you're hurt peeing yeah this
is a real shit man like I would have
closed the door but like I'll show you
guys the door I'll show you guys the
door I'm like I don't know if you can
close
No so that's bad
this one doesn't even do better than
guys yeah yeah Malaysia just does that
to you just start out you know
but after all this this one has a crappy
ratio to wait
I mean does worse their worst rooms this
isn't even the bottom
okay so that race just kind of garbage
as well interesting and maybe the CTW
isn't very good
what is that
does random need to be banned or any my
mods in here
there's my mother
this guy's is banned if I can ban him
not know how to ban him mod you you're
subbed how do I do that
just salt I wouldn't mind you but
Oh exclamation point mod username okay
now think that worked
oh I didn't slash mod dude swear if you
got to subscribe if you want to be mod
just all tasks first and he's a
subscriber so you know that's rule yeah
it's probably slash I don't know what's
up with these exclamation points
congratulations you are moderator um
okay well why does this do better
yes I did give it a context line 232 but
it might also have to do with the fact
that I generate all the all the things
which I think I have to
but that's actually worse oh not the CGS
is Fosters
ya know I'm starting to have my doubts
about this algorithm being very good I
don't know why all these people hype it
out through all these papers hyping up
this stupid algorithm and then like you
write it I'm like this is not that good
no the only proof I have that it isn't
all terrible is there is the CGW
baseline and they did better than they
do better than Jesus this code is
actually a compressor that does better
than Jesus that skips egw to skip CTX
thing Wow
there's people here listen to people -
yeah the skips easiest thing I mean it
just doesn't seem better when I generate
all the probabilities of all the symbols
so it was it was sneaking information it
right like once I actually compute all
this
the ratio seems garbage this isn't
better okay
well that doesn't really work see that's
the thing unless you actually have
produced to file and then D compress the
file you do have no idea your compressor
gonna have all kinds of bugs like you
can't trust these probabilities remember
when I trusted the probabilities and I
thought that we already beat gzip and it
was a lie now this one actually does
beat gzip oh I really don't want to know
about your pants but this one also has a
whole lot of garbage
it just has hacks I mean if I wanted to
write compressors with hacks I'm sure I
could write compressors with hacks but I
wanted to write a theoretically good
compressor okay well it's good to know
that there's not a working there's not a
good Python implementation with this
anywhere and you saw you see the ratio
here it's it's worse than gzip
hmm well let's let's set some reasonable
settings let's get a reasonable
compression with mine and then toasts
let's get a reasonable compression and
call it a day
I think it actually does better with
slightly less
[Music]
even better nobody can't keep getting
that I mean it eventually will exceed
[Music]
sixteen seems pretty good even better
not worse okay 16's let's do a final
compression with this thing it isn't
working compressor it does work it will
produce something
you gotta lock the door bro mmm now the
worst though is the touts tellers gotta
watch out for towers man I'll try to
tout and sell you stuff
my compressors as good as theirs almost
there is go-go bar when we go to go
check my Oh symbol that's before
I say
okay it gets about 50% compression
ratios and takes a long-ass time um in
the future anybody who talks about the
ps3 is banned the ps3 is a bad topic or
Sony fuck Sony
so our moderators if you could in the
future nobody cares
don't know I don't punch people they
don't know the rules you know you gotta
be ferry alright don't don't go in some
Soni coming after me
let's gather them but it's just don't
actually anymore
okay it's a working compressor but I
think we are all disappointed with the
performance
yeah
and you guys can confirm that you can
defend week four and and look for Dec
and they're the same but the ratio is
kind of shitty because the model is not
that good even their model was still
getting doing worse than gzip the only
one I've seen this better is this cgw
baseline which is written by the authors
of the paper by
maybe I think I'm in a meeting maybe
that's what people think when they made
me talk we'r disappoints weird
disappoints um you know you guys if the
compressor was good it was a good
compressor I was gonna write it and rust
thank you graduation Reagan Reagan oh
thank you for subscribing so I think
that kind of wraps up which CDW unless
we get a lot better unless we figure out
that we're doing something wrong if
somebody out there can find a better
implementation of this stuff that does
like better than mine I'd be impressed I
mean I'm sure there's like subtle ways
it can do better but there's a little
bug in mine too there's a little bug
where it doesn't uncreate the node if it
creates the nodes
ya know wouldn't you like to see me code
and rust sometimes sometimes it lazy yes
what about basic probabilities
completely theory it's got like only a
few axioms I think then calm our graph
is actually the one who
yeah
No also if you haven't checked it out
definitely check out quantum computing
since Democritus it goes into how
quantum stuff is just l to quantum
probabilities amplitudes of the l2 norm
of probability it's pretty cool yeah if
you want to do that I don't know it just
seemed boring and a lot like a lot of
tedious work and it's not like I'm not
gonna learn anything doing it I mean I'm
sure I learned stuff but it's not really
what I'm interested in anymore I'm doing
a lot more math stuff lately which is
why I was particularly offended by the
integral thing I read this book it was
okay
the first the first one was pretty good
it's like three lectures by mr. Chayton
guy shape this constant
I'll get a lot of people on tonight's
stream yeah sorry twitch CW didn't work
that well
let's add an old mountain to read me
it is a working
no I'll say maybe it
no I don't know I don't recommend shit
for people man do whatever seems fun you
know wine carry hey well so I'm not
gonna say this tool mildly but don't
come to langkawi okay
I would avoid langkawi but Thailand lies
ahead let's take a look at the map here
I am in link Aoi on sinning Beach
tomorrow we take an overpriced taxi to
kueh and then we take it over priced
ferry to probably koala Perlis
and then we get on a train and we go to
Thailand will decide halfway through
whether we want to stop should we stop
at the coast I worry that the cozaar
gonna be just like link Aoi but talk in
which case we can skip the coast
definitely skip Phuket
Sarat to me I just read the beach that's
what I did for the last two days I read
the beach not that not that not the
movie it's a pretty good book and I kind
of enjoyed it it's trash it's like it's
like easy to read trash but no this is
enjoyable Bangkok yeah and I think this
might be this might be it first dreams
for a bet unless I have something new
and good there's a chance I'll do one
more cgw stream if I figure out how to
actually fix this thing but so we'll
take a quick overview of what it is if
anybody wants to look through it
basically the idea of a compressor is
you have a you have a model and you have
a coda so the model says the model
answers the question
given the probability actually yeah you
know basically you want to ask the
question what is probability of symbol X
given symbol 1 through X minus 1 or
really suppose there's much model
answers
and then we have the code now what the
coder does is simple arithmetic code
there two symbols what what the coder
then does if you know this probability
right so if you knew exactly what the
next symbol was going to be you wouldn't
need you wouldn't need a coder right you
could just run them all on the model
would generate your whole text but you
don't know exactly what the next symbol
is gonna be you know with some
probability what the next sentence gonna
be so let's say you're 80% sure the next
symbol is going to be a 1 and your 20%
Shore therefore the 20% sure it's gonna
be a 0 if you're in a two symbol
alphabet right so now we can do math log
2 of 0.8 oh wait no that's
- lot log - we need Python 3 and then so
if we yeah so if if the next let's think
about this for a sec
this is a little bit what trip you have
last time but but basically if you know
your distribution better than if you're
a 50% chance for each if it's 50/50 oh
it's 1 / ok if it's 50/50 then it takes
one bit of information to cope right
because it's 50/50 right but if you know
that it's point 8 it takes point 3 bits
of information to go point 3 2 bits of
information but if you get it wrong and
it actually turns out to be the point 2
then it takes 2 point 3 bits of it it's
all right because there's no free lunch
so if your model is wrong it takes more
than one bit to code that bit and if
your model is right it takes less than
one bit to code that back so the
theoretical limit given your model is
computed right here in CDW your
theoretical limit is computed here so -
that log tail so I think I add I just do
this see how that works so it's so the
identity right so that's theoretical the
arithmetic coder gets really close to
the optimal in fact the only place where
it's wrong is is my floating-point
rounding errors and my moving the
probability is off of off of the rails
because of course if you predict
something with probability 1 it takes no
bits at all to encode but if you predict
something with probability 0 you get a
math domain error so don't do that
avoid math domain heiress oh I think my
chat froze
let me go to look I was educational guys
who enjoyed who enjoyed the actual
educational segments
no no what my chat one it's going guys
it's been
let me try closing the gaps
all right we'll go on hold on cell for a
little bit I don't know how much cell
but my phone was acting up okay thank
you thank you everybody thank you I see
all the Me's I see all the Me's I got my
chat back all right
that's today's stream don't have a talk
shit about me not in all in high school
mouth remember the ps3 is a ban topic
from this channel and this might be the
last race for a while thank you for a
beautiful Langkawi Island don't come
here promise fish people like to rip you
off all right all right you want to do a
little reading all right
well we'll do a little reading we'll do
a little reading before we go I've been
reading this my friend said it to me
this is actually the public domain book
this is published by the CIA so I was
reading this
but what do I do I don't talk while I
read I just sit there there are some
cool pictures in this book though yeah
from the CIA man you know the CIA
actually put out a good book
improving intelligence analysis at CIA
they open sourced it for some reason
which I thought was mad cool in my
American tax dollars at work guys that
kind of Miss America who misses America
kind of Miss America this isn't the
cloud
it's called the psychology of
intelligence analysis as soon as you
read a log
I'm on chapter three about memory oh
yeah that's that I was reading I'll
bring my cow
oh yes the bucket what I think is left
it's nice it's nice that can be compiled
nobody should be coding and see anymore
she's a terrible language you see you
know it's just nothing man
any of the books I recommend no come on
computing systemic Rattus breed that I
see only or to spell I gotta go I got I
gotta go buy fish
Hello.
Welcome to Corona Virus Stream Sex.
Yo, what up, boys?
Red Bull tonight
cuz we're going hard.
Yeah, boy. All right. All right. All
right. So, while while while we wait for
a few people, the first thing that we
got to do is we got to address a hater.
You guys know I read the comments.
Uh, and we love addressing haters
because that's what we do here.
Um,
is he ever going to put away the
groceries? So, I moved those ones over
there. Thought maybe you guys would like
it. I really like this. This made me
happy. But, there was some haters and we
got to address the haters.
This one from Big Homie.
George is one big hypocrite. He says
politics is a scam and doesn't interest
him at all, but it's the only topic he
talks about.
I thought about this for a bit and I
thought about what I think is a scam and
what's not a scam, right? Political
theory.
Political theory is not a scam. Studying
politics in the like meta sense is not a
scam. going out and waving around a flag
supporting a candidate is a scam.
Um,
polit like I think I ended yesterday's
stream with uh reminding everybody that
uh we are a part of history
and I love history. Um, shout out for uh
Hardcore History. You guys know this
podcast? Um, it's a great podcast. I've
learned so much history from it. Uh re
really really great podcast. Um so I
love history and I love the politics
that comes with history. Just
contemporary politics is uninteresting.
Um but like political theory and like
society design and yeah this stuff's
fascinating.
Um I used to say I'm a technical guy. I
don't know anything about politics and
social problems. No, he's referring to a
guy who was baiting me and I baited him
back. You are saying college is a scam,
but you go to an interview and confess
that college gave you the best lessons
you ever had. Right? There's two sides
of a scam. Always remember that there's
the person being scammed and then
there's the scammer. The scammer is the
one that's benefiting. You can scam
college. There are certainly ways for
you to be on the take of the college
scam.
um
reading about corona and talking if I
was in charge of coronavirus task. Well,
it's like a way to think about it,
right?
Um but this is where he loses all of his
credibility as a hater and why can't
people write about comma AI on your
Twitch chat? Bro,
what do you do for a living? You know,
would you like to to come home and have
to talk about your job all day during
your hobbies? Yeah, big homie. Yeah, you
ever think of that, big homie? Here we
go. No one is coming on your streams to
listen to your sermons about your
politics and your social views.
I'm not sure about that.
They just want to get better at
brainwashing and you making them
brainwashed.
So, I will say this.
If you're watching these streams to get
better at programming, this is not why
you should be watching this stream.
That's a stupid reason to be watching
the stream. These streams will not make
you better at programming. Just like
watching pro Starcraft players will not
make you better at Starcraft. Watching
speedruns will not make you better at
Mario. If you want to get better at
Starcraft and you want to get better at
Mario, practice and then watch your
replays. That's the really brutal thing,
you know. Um,
you should Oh, yes. Oh, you making them
brainwashed.
Who thinks Who thinks I'm brainwashing
them? Who thinks I'm brainwashing them?
Who thinks I'm brainwashing them? Who
thinks?
That's right. That's right. That's
exactly what I'm here to do. We're
building an army, boys. When it comes
down to it, when the revolution comes,
we're going to take power. You know,
like what is it? PewDiePie's got Bro
Army. You know, we can be like a legion
in Bro Army.
All right, big homie.
So let's get to work. Today we're going
to do bioinformatics.
We spent a lot of time looking at
the
like reverse engineering the different
components, but we haven't spent a lot
of time like once we get this, what can
we actually do with this? So this is a
protein sequence.
Um, and we're going to try to figure out
what we can do with it.
First, we're going to finally figure out
I think there's a blast database.
BAM tools, SAM tools, clust
data.
What's BAM data?
By the way, I tried to buy comma.bio bio
last night and uh it wanted me to like
put in some zip code and I was like this
is too hard.
What is a BAM file?
I don't know. I assume this is for a SAM
file.
High throughput sequencing data.
So yes, with all scams, you know,
remember I think I think actually that
applies to politics too. Now I'm
thinking it through, right? Like it
applies to politics and education. Like
remember that there's two sides to every
scam.
Are you on the take or are you the one
being scammed? Now I'm not saying the
scam should exist at all, but like if it
does, you know,
thank you toxic sickle for subscribing.
Multi-sequence compare tools for the
broad institute.
We have a Mac app.
Oh, if you want to use it in your
Jupiter notebooks. Yeah, I want to use
it in my Jupyter notebooks.
Oh, this is mad nice. Let's do this.
Oh no, I did that wrong. No, no, no, no,
no, no, no, no. Pick three.
All right.
See if this is going to work.
I think like last time, we're going to
have to restart.
Not that
IGV.
That's lame.
Did it not work?
I think I did that. I don't get it.
Supposed to do something.
Maybe I have to like call show or
something. Oh, I got to call show. There
we go.
Oh, sweet.
Zoom in to see features. What's HG19? Is
that a human?
Oh, homo sapiens genome assembly.
Damn,
there's gigabytes, bro.
Corona virus is
3 * 10 to the 4th. 3 * 10 4th. I never
get Yeah. Yeah. 3 * 10 4th. Humans are
3* 10 to the 9th. Wow.
Wow. You could fit
10 to the You can fit a 100,000.
Humans are a 100 thousand times more
complex than a corona virus.
Zoom in to see features. Oh wow. This is
this is a crazy amount of data, man.
And every one of these Yo, this is a
sick reverse engineering project.
All these human genes are labeled.
Oh, good. This is a dude. He's got a Y
chromosome.
ATP7A.
This is an Englishonly channel.
English only.
No. No. Who's not speaking English? Ja.
Yeah, I remember. I remember the Jaw
guys when I used to play Age of Empires.
You ever go on server and pretend that
you uh
start the game already?
All right. So, what is where were we
with IGV?
This is a multi-sequence compare tool
supposedly
to load tracks.
genome HG19.
Wait, can I like put in the human corona
virus genome name and that'll work
because I wanted to compare
if I there's no way that's going to
work.
cannot read property cytoban URL.
Let's open the tool. Let's open the app.
Oh my god,
this is terrible experience.
Is there a way to turn this off?
Tutorial videos.
I don't really know what this thing
does.
Here we go.
Is this only for humans?
Oh, more. Here we go.
Selected genome will be added to the
genome dropown list.
This kind of how do I Okay, where did
that name come from?
Let's just go back to this and see like
can I see other genomes in this view? I
don't know. I'm kind of unimpressed.
HG19.
If I put that in, does it do the same
thing?
Never mind. I'm done with the IGV
browser. This thing's boring. But it
says it's multisequence compare tools.
How do I do multisequence compare?
That looks way nicer than anything I
have.
What?
Okay.
Genome load genome from server.
O go from URL
file
to genome
faster.
I feel like the odds this works aren't
great.
Yeah, of course. Because you think
someone wrote a good a good tool. How do
I get just the
send to file? Create file
sequence.fasta Faster
load genome from file.
Okay. Now I want to import a second
sequence.
No.
Can I type this number in somewhere?
Does that work?
Go.
These tools are hard to use.
Sort tracks.
What's a track?
Can I do trans? Oh, look. Okay. Well, at
least that did transcription. Look, it
shows the reading the reading frames.
This is the kind of thing where I'd
probably have to watch a YouTube video.
Enable Google access
mutations alignment third gen. What does
all this do?
new session.
Oh, genome from URL. Okay, let's just
download the other genome. Um, we're
going to give this a try. We've come
this far with it. We got to find human
SARS
Genbank.
Gome sauce. What's this crap again
download
here again?
PubMed
COVID fatality is likely overestimated.
taxonomy and then I click genome
and I click here. Okay, here we go.
No, this is two again. How do I get SARS
one?
This one SARS one. Here we go. Here's
SARS one. Okay. Subree links too. There
we go.
This sequence.
Okay. Send to file. Create file.
Right. That's a jibby file.
No, I want a faster file.
Format fast. I don't know why that one's
a jibby file.
Seekars.
Can I drag and drop?
No, of course not. But if I load genome
from file.
Wait, but I want to compare the two.
How do I compare the two?
IGV compare
genome.
That seems like it's compare.
Or maybe that's a track.
Maybe it doesn't let me because they're
not in the same file.
You can see the mutation here. Yay.
Yeah. Yeah. I've seen Next Train.
Why don't use autocomplete for Jupiter,
resize tracks, define a region of
interest, reload tracks, and refresh the
screen.
Is there not a way to compare two things
with this
gene lists?
All right, this is clearly meant for
like human genome. I'm done with this.
This time I'm actually done with this.
Don't let me do it again.
Okay.
Secondary structure prediction. This
could be completed using the RNA
transcript.
Oh, because no one's taking
post-transational mods into account. We
know about post-transational mods.
That's cool.
PDB
Introduction to Computational
Molecular Biology.
Oh,
bad ratings. Like an 100 pair limit
electrofaresis. Yeah. Not on today's
machines.
Oh yeah, we can do nice
electropharesises now.
All right, let's look at clustalho.
Oh, for multiple sequence alignment.
Hasn't been updated in two years.
All right. Should we just write a
sequence alignment algorithm? I know you
guys will all like it if I write code,
right?
Like, oh yes, write code.
Um, no module found named lib. All
right, that goes there.
name SARS import SARS.
No module name SARS. Where does SARS
come from? Oh, data. SARS.
Sorry should be uppercase.
We've decided our DNA is uppercase. Or
have we decided our DNA is lowerase?
I don't know. Was the DNA uppercase or
lower case in IGV?
Why is my dock not disappearing?
Do you think uppercase or lowerase in
the DNA?
All right. Uppercase on the DNA. You
look just like I'm glancing when I read.
Well, I'm not reading all the words. You
don't need all the words. Most of them
don't say anything bad. Only got to read
the ones that say good things.
Okay.
Both both corona virus and SARS are
uppercase. Um, we're also going to want
the uh
we're also going to want the cold. Let's
look at the cold as well.
This cold.
And remember, this is an alpha corona
virus, but it's interesting because it
targets the same
Why don't they name it better stuff?
What's in here?
Okay.
All right. We have an NL63.
We have a novel corona virus. And we
have a SARS.
Oh wow. Let me be careful with my hands
on mouth.
Would you be careful if there was NL63
floating around? Who's scared of NL63?
Nobody. That's right.
Will I use some neural nets in the
project? No.
No.
I wonder what Michael Jordan would have
thought. I think he's still alive, isn't
he? Michael Jordan's dead. No, he's not
dead. Kobe Bryant, on the other hand,
well,
still alive.
Um okay so let's find out what is the
sequence comparison algorithm
sequence alignment
two query sequences
dot matrix methods
dynamic programming can be used to
produce global alignments
dynamic programming can be useful in
assigning nucleotide to protein
sequences. is a task complicated by the
need to take into account frameship
mutations. We know about frame shift
mutations. The frame search
the blast and emboss suites
just genewise.
Oh, this is cute.
You put the protein in
And then you put the DNA in. You see if
you can find it. I say,
"What is this?" And then like my lab
assistant fetches me this piece of paper
for the printer and I go walk it down to
the
All right, let's see how hard this
algorithm is to write it.
Best alignments.
blast global alignment
basic local alignment
search tool.
Here we go.
more details.
It's pretty cool.
Oh, yeah. Look, they end with exactly
the same thing.
There's a bunch of point mutations.
Okay, I like this.
The Netherman
alignment
looks pretty easy to write
if I care to. Or I could just use Here
we go. Installation on Mac OS.
for users without administrator
privileges.
Damage.
Okay.
basic local alignment search tool.
So I guess this and this is just like a
hosted version of BLAST.
BLAST finds similarities of regions.
What's nucleotide blast?
Compare two sequences.
Multiple alignment
are proteins.
Smart blast.
What's a protein accession?
GI or fastest sequence.
So if I do something like the envelope
protein from Corona, we'll see what I
get.
Smart searches against the landmark
database.
Landmark database includes proteome.
I see
which database do they really have?
This one's had some CI tasser score
shit. That's great. Nice job, NCBI
is taxpayer fun.
Oh, never mind. This is a total good use
of my tax dollars. It just took two
tries.
envelope protein.
Oh, this is really cool. It found all
the things.
The Wuhan Seafood Market pneumonia
virus.
Excession.
Envelope protein partial.
Did they get eaten by Did they eat a
bat? Is that what happened?
I don't know.
Let's find out
how. No. Well, is this a rabbit hole?
Someone said that their streams would be
so much better if I didn't get
distracted all the time. How did SARS
spread
to human? No news, please.
Domestic cats and ferrets.
the pets like the World of Warcraft uh
outbreak.
I don't know.
No, we're not going to go too deep into
that rabbit hole.
Um what was I doing before that? See, I
get distracted. You guys distract me
with dumb crap sometimes. Sometimes you
guys distract me with great crap. Uh,
humans infected by a penguin.
Which one's that?
Oh, yeah. No, we were looking for the
Jang link.
Jang Lab link.
I still don't understand their scores.
Estimated TM score.
We're doing bioinformatics tonight.
Look, it's in the title of the screen.
Qualitative assessment of
similarity of two protein structures
template model.
Huh.
Wait, how are they estimating the TM
scores?
Do we have real folds of this protein?
Oh, we should document this one better
residue.
I wonder what's doing the PTM
on this guy.
Hilicase kilocase has a very high
what are these estimate TM scores? This
is the paper that it's from.
CI tasser pipeline which utilizes deep
convolutional neural network to guide
the itaser fragment assemblies
iterative threading ref.
We've looked at this before names them
was ranked as number one. Let's see what
this is.
Whoa. Do they like measure new proteins?
90 modeling targets.
So do they like they they do like X-ray
crystalallography to find the structure
of the protein and then they give it to
the people and then
Is that how this works?
So, what are the folding at home people
doing?
We're simulating the dynamics.
Like where's their base stuff?
Yeah, they are. They're probably mining
cryptos. 1% making that protein video
and then Wow, that's a good scam. You
know, start a folding at home and then
just mine crypto.
How's their corona virus? Oh, it has
more stars than mine.
Okay. Okay. Okay. We're We're close.
source structures in the protein datab
bank.
Whoa,
what's SIMTK?
Okay, theirs might be cooler than mine.
Let's check it out.
Oh, look at this. They named the
proteins. Yeah. Yeah. Yeah. Wow. Cool.
They have simulations.
Wow. This is many gigabytes.
Pressure, temperature, Kelvin's creating
mm system. Oh, this is amazing.
Never mind. They deserve more stars than
me.
They're mining ink. Listen, you hear it.
Wait, so I found OpenM before, but I
didn't use it for some. No, which uses
OpenM? Oh, that stupid other one uses
Open MM. The one that Harvard Molecule
Simulator. Once when I was off stream, I
was playing with these.
No. And you had to like charm. And that
was it.
Charm uses OpenM, but in order to like
download it, you have to be, you know,
affiliated. You have to like submit a
request.
Harvard wants to know what I'm doing
with their molecular simulator.
I should have put in something really
horrifying and saw if they'd contacted
me.
All right, let's try to simulate the two
IGF SARS 2.
Simulate two GFS 2 no module named
progress bar
three
is progress bar like a TQDM competitor
no
simk definitely gonna need simk
Pi open m.
Oh no, I have to have a simtk account.
Installed open mn.
module not found there. Great.
Open sim added to the path.
Let's open
I don't get it.
Should I be a PhD
fully funded PhD?
Okay, the source code for open does this
include the Python
docs installing OpenM but I'm not sure
it's just open mm that I need.
Oh, here
shit
is installed using the cond. No.
Third option.
Great.
Detailed instructions are in chapter 8.
Get the open mm source code.
[Music]
configure with CMake.
CCMake.
Oh, that's a thing.
What?
Press C.
No, no, no, no. Wrong Python
interpreter. No, no,
I don't want that one.
Python executable which Python 3 user
local Python 3.
Enter to edit option.
Editing option user local bin Python 3
C to configure.
Could not find doxygen.
No. Download the pre-ompiled version of
OpenM for Mac OSX.
Is this enjoyable for you guys watching
me struggle with build systems?
I mean, I'm sure it's just for the docs,
but it won't continue if it doesn't have
that.
Let's read about this
is a toolkit molecular simulation.
Swig version. Oh, we got to install
Swig. Wait, how do you install Swig?
Who still uses Swig, by the way? He used
this at Google like forever ago.
Why don't they just use siphon
install swag?
Okay. Hopefully it'll install for the
right Python.
[Music]
That seems okay.
All right, get ready to waste my CPU.
This is a perfect time for a break.
What should I leave you with?
I don't want to leave you guys with
morgs.
This cannot be happening. I don't even
know what to say anymore.
Do this to me.
I'm kidding. I'd never leave you with
morgs.
Um,
there's got to be something nice.
What's pleasant? Um,
oh yeah.
Sweet.
We got it set up.
Yeah. Rust.
Why do you think Am I being loud? Is my
music loud? It's 8:40.
I'm telling you, you know, I figured out
what the noise was, by the way, because
the noise continued. They closed the
gym. Uh, so I don't think it was us at
all. I think I can yell in this
apartment and nobody can hear it. Um,
but they they closed the gym. So, what
did people do? Well, you know, it's San
Diego. You can't miss out on the gym.
So, they ordered gym equipment. And now
they have gym equipment. And there's
some guy upstairs with like a bench
press and he drops the thing.
All right, we're trying to simulate the
Agisa. Let's go.
This is so cool.
Let's see this which which agy let's see
which protein this is
structure of SARS corona virus spike.
Oh, this is a normal S. This is old SARS
complexed with its receptor.
Whoa.
All right. Should we try some OpenM
stuff?
minimizing energy. Adding bar stat.
How cool is this?
It's a liand interaction.
That seems nice and simple.
Yeah, there's some hacker who stole some
Xbox shit. That's the hacker's problem,
man. I don't know anything about that.
The go is slower.
Beyond the games, man. We're hacking
bio.
I want a tall glass of water right now.
All right.
What's Amber?
Let's see what these things are.
Whoa.
Amber project.
I took a I took a couple bioinformatics
classes at RIT and it was this it was
like noob Linux
yesterday. I like duck go. Yeah. I don't
know. It's not that I don't like it.
It's just, you know what I mean? Like,
you ever see someone hit the jewel, man?
That's how I feel about Google.
You know, it's not good for you.
All bore related sites seems to be made
20 years ago. Yeah, I agree.
Well, yeah. And that's why hackers are
going to show up and take over the whole
field of bio. You know
what do y'all think, man?
What if what if all the future medicines
are made by hackers?
What's this?
again computer terms. That's what we
wanted everything to be in.
This is really using a lot of my
computer to simulate.
I was just killing pegging my GPU or
something.
I don't know. Let's Let's try some Let's
try some Open MM tutorials.
I was going to complain about the
password, isn't it? No, it's not without
a cookie.
Oh, you can't even control C it. It's
one of those things.
Read in the heavy atom model PDP
loading force field.
Where's that amber tutorial?
Drifter get amber, too. I guess they
just committed the Amber
stuff already.
Open the Gedit text editor on your Linux
computer. Gedit looks like this.
How do they know what alanine deptide
is? But they got to explain gedit to
them like they're noobs. It doesn't make
sense.
Remember, Twiddle tutorial is a shortcut
to your tutorial directory.
Licorice
Yeah. So, this is what I was playing
with. MDA.
Those are PSF files. Those aren't the
same as those other files.
No shit. I was playing with this,
but I then I tried to remake the
simulation and I couldn't do it.
But yeah, this is some like receptor
opening and closing
another viewer in here. Didn't I
don't need these anymore.
It's been a long way. We've come a long
way.
NGL view.
Okay, I'm sick of this thing burning my
CPU.
What?
muscularkeeletal
modeling.
This isn't what I want.
Oh, running simulations. E
PDB file. Okay. It's going to complain.
It's be like, where's your input PDB?
You can find this example of in your
open. Oh, I see.
in my open mm.
Oh, nice.
Oh, hello sodium chloride.
Yo, this is sick
force field. Okay, again we got some
amber shit. Are these like readable?
Oh, that's cool. It's villain.
It's villain in explicit water.
Chicken villain. Oh,
that's a cool protein.
That's cool. Wait, that'll change the
view. So, it's in the other kind of
view.
Style licorice. Oh, yeah. Look at that
licorice
backbone. Oh, it's just the backbone
cartoon.
Okay, let's see what the Amber file is.
It's not here.
Okay, look. They changed the name
and there's still no Amber files.
Wait, how do I have force field? That's
okay.
Where' those files come from?
Are they not files?
I don't even know, man.
I'm confused.
Okay, whatever. We'll just take it as a
present. Force field create system.
Oh, good. I got the lang in integrator.
All right, we built the simulation.
simulation minimize energy. Is this
going to burn my CPU for like 27
minutes?
The force field
Oh, are these like Maybe they're in
somewhere else.
He's like normal. No.
Open. Mm. includes XML files. Oh,
defining lots of normal force fields. I
see.
These are just normal things.
Oh, and then I can use tip water. I get
it.
Okay, that's cool.
Is this what Edges was using?
No, I was using a protein one.
Do I have that one?
Oh, no. I don't think so.
Oh, I can set a platform.
Did I give it a platform?
Because I have an idea. I was using my
GPU and it was wasting it.
Okay.
The advancing the equation of motions,
a lang integrator which performs lang
dynamics.
[Music]
Since the coordinates in the PDB file
might produce very large forces.
Oh, sweet. We can load it into anything
for visualization.
All right, let's put it in temp PDB.
And definitely we want the state data
reporter to go to standard out. Oh,
that's useful. Probably added it twice.
It's probably going to try to create the
file twice now.
Yeah, look at that.
yards. That works.
High quality. All right. Cool.
All right. That's a lot of steps. Let's
take a 100.
Okay. Now I can visualize them with VMD.
Um, VMD
I Python.
It's a PDP.
BMD contains a
[Music]
pie. Do I have Py all? Oh, this seems
better. I don't know why.
Jupiter from Pimol Wiki
module name Pole. All right. Reinstall
Pineball.
Of course, that's not going to work.
They really want you to use cond
tools. Okay. You know, Python load PDB
file.
Oh, NGL view. Sick.
I have NGL view.
I used it for something else.
Yeah, this thing.
PDB file.
Oh, perfect. Oh, this is nice.
Yeah, now we're talking. Do I have
Pyrange?
Come on, have Pyr. I don't have Pyratch.
Okay, install Pyr.
Oh, Pyr.
Oh, winning. Yeah.
And Adams. Oh no.
N Adams equals zero. Where'd my atoms
go?
Input.pdb. This has atoms. Oh, this has
atoms. Oh, sweet. Look at that. I don't
know why my output doesn't have any
atoms.
Oh, I think it's only because it's 1,00.
I see.
Let's
just go here.
That's pie charge.
It opposes CP tree charge. Oh, that's
that's good.
Oh, it's got to step forever.
I think it'll be faster in my CPU than
my GPU.
How do I What is it? System monitor.
Not this one.
Activity mod. That's the one I was
thinking about.
Where's the GPU?
Graphics card.
Window GPU history.
Maybe it's not using the GPU.
Well, it's very ineffective at using the
CPU.
Ah,
I don't know.
Oh, everything's warming up. I wonder
why.
Let's load output.pdb PDB and see if
this works at all.
Wait, what?
How did that become a protein?
It was always a protein. That's
It's that chicken shit that we saw
before. Look at that. And it wobbles.
Oh, it wobbles. Oh, that's so high
quality.
But why if I do input pdb, I get shit
that looks like this?
It's just a protein in water.
Is that what it is?
Does it actually include all those
waters?
Or it does include the waters.
Look at all the waters. Hoh.
This is a simulation box. I get it.
Does it evaporate?
I don't know how realistic it is.
What does evaporation even mean?
Oh, this is something I was asking all
day when I was playing with that other
MD analysis stuff. So, the right stuff
is simp
and ngl view.
Okay.
Wow, that took a long time to simulate
though. Why does it do it in such a
shitty What if I just do this?
Or I should have backed up temp output
because that took a long time to
generate.
I think
this is only one.
Oh, no. There's 10 steps, I say.
Wow.
Whoa.
Look at it warming up.
Why did it start so cold? Let's see what
this looks like.
Oh, yeah. Oh, look at that smooth
animation.
Oh, that's so smooth. It's cuz it's so
cold. That's why it moves so slow. All
right.
Leng of an integrator 300 time Kelvin.
Oh, and it has picos seconds, too. Oh,
this is so cool.
Let's see if I can use the CPU. It'll be
fast.
Let's go back to reading what that
actually did.
Or I can load in Gromax files, the amber
files,
the villain headpiece in explicit
solvent.
So that's the water solvent is a fancy
way to describe it.
Force fields included
amber 99 SB force field.
I don't really get it, but
what's a force field?
Every day, most of our lab work is done
with the martini force field.
The tip 3P water model
charm.
Whoa.
Why does it have an exploit? Why do you
load in like another model and then a
water model?
What's the parameters to force field?
See how this simulation looks.
Oh, I think we're bringing the
temperature up. I think that's something
we do.
I think we do something cooler than just
shake around though.
And what do they not save them all
because it just splits them all out to a
text file and that would be a big text
file.
False field parameters are mainly spring
constants and equilibrium lengths and
also Leonard Jones terms.
Yo, we know we've been banned by the FDA
forever.
Wait,
people are actually making DIY test
kits.
Oh, you mean the send in ones? Yeah.
Yeah. Yeah. No, these aren't real yellow
test kits. No, I couldn't buy comma bio.
They wanted me to like put in some thing
and I was confused
nonbonded cut off
force field.
system.
Okay.
So, now
can we load in a Corona virus thingy?
What do we most want to investigate? We
want to investigate the big ones, but I
don't know about the big ones. So, I
don't understand. What if I just put a
protein in? Does it fold? Will it fold
for me? How long does it take? How many
picos seconds is this?
Is that what my length of an integrator
is doing?
simulation temperature which still
apparently takes a long time to reach.
The friction coefficient is measured in
picos seconds.
I don't even know about that man.
Modeler add hydrogens.
Oh,
sweet.
I can add water
with my model or add solvent. This thing
is really cool.
All right, let's get a PVD file of a of
a of a Corona virus.
Which piece do we want to play with?
Did anyone figure this one out yet?
I have to download the model somewhere.
Oh.
Let's pick the coolest looking one
from Jiang.
Oh, we can download them right here.
Those
seem
I already downloaded three. What's
three?
a papion like Prodier say.
Let's just focus on the eight.
Maybe it's actually smart enough to load
to load zippy files.
That's probably not
should call it file. It's kind of a
stupid name.
Does it read it? Okay,
we should be able to visualize it if we
go here.
Oh, yeah. Look at that. All right. So,
we have our thingy
now. I don't know. Let's just put it in
the simulator and see what happens.
Think
it's going to do anything in the
simulator.
I'm just going to spring. I don't know.
Go simulator go.
But it's missing hydrogen atoms. Well,
the good news is I know how to fix that.
I read some documentation about missing
hydrogen atoms, didn't I?
Oh, I just need a modeler.
Modeler.
Good. Add hydrogens.
Yeah, now we got hydrogens. No.
The set of atoms matches Glenn, but the
bonds are different. Perhaps the chain
is missing a terminal group.
Oh,
wow.
Oh, you know what it is? They're
probably using a different force field.
Does that make sense? What force field
do you think these guys use? I'm not
really sure what a force field is, but
I assume it probably has something to do
with that.
Um,
what an error, you know.
What other force fields do I have? Does
this tell me about force fields?
Oh, Kirkwood.
I don't know. Charm polar. That sounds
pretty cool. How about that one?
Oh,
you don't get to use charm polar.
Amber 10. That seems like an upgrade.
No, my Glenn is still broken.
Does Jiang talk about force fields at
all?
force field. No, he doesn't.
Well, it was all fine until I tried to
add hydrogens. Do I need hydrogens?
The set of atoms is similar.
Or maybe this protein just sucks. I
don't know.
Maybe there's a better protein.
Oh, it's Ace2 from a human.
These aren't even like these are
predicted structures. I think
that's why you look at your shit in VMD
first. I looked at it. It was fine. It
looks fine. I don't get it. What's
wrong?
What's the problem?
My Glenn doesn't work.
Where is Mike Glenn? Is it at the end?
I think it's at the end.
Oh, my Glenn's all the way at the end.
Perhaps the chain is missing a terminal
group. Okay. Well, maybe we have to
create a terminal group.
You need to use standard
PDB names for residues and atoms.
What's a terminal group?
Oh, what if I use Amber O3?
No, same problem.
Template matching found. You know what?
What if I delete the Glenn? Yeah, now
you don't have a Glenn anymore. Do you
work now?
Oh, now I just now it complains about
the L. Oh, yeah, I get it.
My chain doesn't have a terminal group.
What's a terminal group and where do I
buy one? Does this one have a terminal
group? Can I steal it from this one?
No, not the water. I don't care about
the water.
Glue
glueless.
Oh, water.
Oh, CL's.
Oh, are those terminal groups?
No. Or is FE a terminal group?
Those CL's are awfully suspicious.
They near the FE.
Is that a terminal group?
No template
found for residue.
The bonds are different.
Why?
You need to read a tutorial on how to
build a model outside of the OpenM API.
Okay.
This just seems like it should work
though.
The OpenM thing is great.
I was just about to add water. You know
what? If I just add water, does that fix
it? I don't need any hydrogens.
None type has no
set of atoms matches,
but the bonds are different.
Well, it's good to know other people
have this problem.
Folding at home uses Gromax. Open MM is
handhold. I'm not even using Oh, am I
using this? Is open MM. I guess
it's handholding me a bunch. All right,
we'll read the code. Was that Will that
make everyone happy if I read the code?
unmatched residues.
I'm not even creating a system yet. I'm
just trying to add hydrogens.
Oh, it creates a system in order to add
hydrogens. I see.
I don't know. I don't like this protein
anymore. Let's get a different protein.
Wonder if they're all broken. I don't
know. Who knows about Jang Lab anymore?
See if we can find what was that protein
that that those people are using. 2 H
something. Two AGF. Yeah. Yeah. This guy
TDB format.
Yeah. To af
by that protein.
I want to delete the only file
kind of an error message that
okay let's load up the two ag and see if
this one works.
Oh, that looks fancy.
That's going to take seven years to
simulate.
Come on, modeler.
Well, it hasn't crashed yet. This one's
better, it seems.
What?
What the hell kind of
This has a lot of atoms.
Oh, it has a tur. Oh, I should have
deleted that other one in rage.
I regret deleting that one in rage.
No template name. Oh
well, we have still issues. But at least
I think we might have learned that if I
go to two AI, we can get a tur.
Wow, this thing was made by something
crazy, man.
And now will you be happy?
But no, I put a terminal group on it.
No, I put a tur
I don't get it.
Do they have tur for all of them?
That's just F.
Okay. Zick. Show me the way. Okay. What?
What is this?
Nam
salvating the protein VMD.
What's VMD?
I have this thing already. I I want to
use this other one. I don't want to use
this.
Well, this looks very complicated
in the open docs. There's something
about missing residue templates.
Is there
in these docs?
Oh, get unmatched residues
topology.
Okay. Okay. All right. I like this.
Oh, Alice and Glenn's
are unmatched.
are unmatched residues. Okay.
Oh, generate templates for unmatched
residues.
Oh, now we're talking. I like this copy
and paste shit.
Yeah. Yeah. Yo guys, I'm a bio script
kitty.
Hey, everyone's got to start somewhere.
You know, everyone was a script kitty
once.
The corona virus now the corona virus
very hard it seems.
Get matching templates.
Okay, I should pro
Oh, it's the wrong topology. Okay, it's
fine. It's forgivable.
No template. Oh, I can't get the
matching templates because there's no
hydrogens. But I can't add hydrogens
because there's no template found.
And there's unmatched residues
of Allah and Glenn.
If I get rid of Glenn, it's just going
to complain about Lou, though. I know it
already.
Yeah, it's just complaining about Lou.
I tried adding a termination. That
didn't do it. Okay, maybe we should try
to understand what some of these things
are and not just be a scripty
Heard that word before. Resides.
If you read the nan tutorial, you'd get
a lot further.
It looks hard.
I'm a script kitty.
No, actually, the real thing that I
didn't want to do was have to install
this crap. But all right.
I'm not amused.
Okay, I have to register. I accept it.
All right.
How is something in Chrome crashing OBS?
This is creepy and makes no sense.
It's literally the NAM website. I have
no idea how this is possible,
but God doesn't want us to use NAD.
Why do I not like look at this? Does
this look like code I want to use?
No, no.
No. Every time I tried to register with
that website, it would crash.
You're welcome. What?
Just link me to NAM.
No, I'm done with NAMD.
You're a med school professor at Harvard
and you're in my channel. Well, welcome.
Um,
we got papers with the SIHub, bros.
No, we're not. All right, you know what?
I have an idea. Let's try to copy the
NAM tutorial but in the very much more
modern
um OpenM
looks like it was written by like
programmers. NAND looks like it was
written by like, you know, the 80s.
PD files.
PDB files.
Oh,
do I need a PIS file, though?
Okay. All right. I might need a pist
file.
An initial PDB file will be downloaded.
Open VMD. Oh, yeah. Yeah. Yeah. Welcome
to the 80s, man.
Oh, these are the force fields. Okay.
All right. All right. We're learning.
We're learning, but we're not using NAM.
We're doing the NAM tutorial in modern
stuff.
Okay. VMD and locate this file. All
right. Let's get this file.
Um, is pb.org still valid? Oh, worldwide
protein datab bank. That's pretty nice.
Wow. It's nice how everybody cooperates
in bio.
Except there's probably some asshole
companies who don't and they probably
suck. They probably have like, oh, we
know the secret structure of that
protein.
All right. How do I search?
Download archive.
Okay, never mind. This website kind of
sucks. This is a better website. But we
downloaded one of these before, but we
had problems. But maybe this one's good.
Okay.
One UBQ. Good. It's a Ubiq. That's good.
One UBQ.
Oh, so small. Okay, this one can't be
wrong. It's so tiny.
one UBQ.
All right, let's go back to the NAM
tutorial. Okay, we downloaded it and we
can look at the one UBQ down here if we
want.
Oh, beautiful. Look, look at how modern
this program is. Look at how I didn't
have to use any command line tools and
it shows up right here in my IPython
notebook right where you guys can't see
it.
Who's triggered?
Who's triggered?
Whoa, whoa, whoa, whoa. We're We be nice
to people in here. I love WebGL, bros.
Next, I'll have to create the piss file.
I don't think I need a PISP file. They
don't look very useful.
Does this protein work? Maybe this
protein works.
Oh, they're all unmatched residues.
Oh, and it has hushes in it.
We don't need to do that. Don't need to
do that. Let's just simulate.
No template found, but it's missing
hydrogen. Okay. Can we add the
hydrogens's?
Oh, who added hydrogens? That's right.
That's right. You know what? The only
reason the NAM tutorial works is because
they already picked the protein that
they know works because a lot of the
proteins are just broken.
Oh, but I added the hydrogen. I don't
know. We're just going to have to Yeah,
I know what we're going to have to do.
All right. I know. I'm going ahead. I
don't know if this is what the NAM
thingy actually wants me to do. Uh, is
this one of them that I closed during
the fake ram scare of minutes ago?
Wait, so folding at home is just running
these thingies. It uses Gromax.
That's cool.
I liked Gromax. Gromax seemed like the
one that people used. It was easy to
install, too.
Wait. So, let's go back to my add
hydrogens example.
Now, we're going to have to use the
modeler topology.
So the PTB topology.
Yeah. Model area. Yeah. Do that. All
right. Cool.
Wow. That was so much easier than using
NAM.
Modeler.add hydrogens. Bros.
Why does the temperature always go up?
Why doesn't it start warm?
What does this little shitty protein do
when it moves? Where' my colors go?
I don't have colors anymore.
Would I know that if I did the NAM
tutorial? Do proteins lose their colors
when they get warm?
I'm not that much of an idiot. I know
they don't really have colors.
Okay, next.
Ubiquin in a water sphere. But it
already has the water sphere.
It was built into the ubiquin. That's
what these hoas are.
Hat ATM.
What is this thing?
It's news.
All
Ukari
organisms
Wow. Someone studied Ubiquin their whole
career. That was a vacuum s.
Oh, is that is that why everything's
cold? I don't know. Let's add solvent.
Can we add solvent?
We have solvent now.
Yeah, solvate. See, look, they have to
have the solvate command which loads the
solvate package. I can just use like
model add solvent
ubiquin in a water sphere
nonperiodic boundary conditions.
Your simulation will take 20 minutes to
complete. Maybe if I have a computer
from the 80s,
it looks the same in water.
Oh, you know what I can do? I bet if I
put modeler.topology
in here. No, that's not going to work.
A PDB file. What is this?
Wow. Three chains. That's a lot of
chains.
Let me print the topology each time.
Oh, and it might be the modeler breaking
my colors.
Wow. You add, you get a lot of thingies.
You add
[Music]
Oh, use XM grace.
Thank you already. If you use rust
if I want funding funding man and I'm
beholden to then I got published and I
got to fill out grant reports you know
next thing you know I'm subitting
diversity reports about the diversity of
my
I mean, I'll have to have some
undergrads to write grant proposals for
me.
Okay. So, what have we learned in our
small adventures into simulation?
Well, we've learned that NAM sucks more
than Rust.
Um,
we've learned that.
Well, so you ask why we need a
simulation.
Because my hope was that we could put
the proteins into the simulator and they
would fold. I understand that this is
probably a very naive hope and I
understand that this is obviously the
first thing anybody who made these
simulators thought to do with them and
for some reason it doesn't work but I
don't understand why it doesn't work
like
let me explain what I want to do
um
for example I have my small envelope
protein right
we can look at add it here. Corona
envelope protein. And this is a CAD
model. I'd like to load this CAD model
into my simulator
and then have it do stuff.
But I assume that doesn't work.
But I don't really know why.
Like is it a computer issue?
here. Like that's what the envelope
protein looks like. Oh, that's a
beautiful protein. We should play with
that one. think it's going to work or
you think it's going to bitch at me
about like not having some terminations
or something.
Oh, that's a nice protein.
That's small enough that I can commit
it. We're getting rid of two IGF and
we're getting rid of the one from before
with the eight
proteins.
One UBQ is the only one we've actually
been able to simulate with. So, we're
definitely keeping that one. They worked
really hard on that library.
Okay, it loads.
Let's see. Do I have unmatched residues?
Oh, rats and battles. Okay. I mean, I
feel like this is going to complain in a
similar way. Oh, well, at least at least
it complains very fast. Okay, let's read
one Ubiq and see why one Ubikue works.
Oh,
so many comments.
Master
the Tur.
Does they have those A's there? I don't
know if the A's matter.
I was really sure that would fix it if I
just added in Tur
to terminate my chain.
Oh, maybe cuz it doesn't like the way I
maybe things are named differently.
No, lose are the same.
Does this one have any vowels?
Okay. All right. Oh, it has vowels.
Their vows have a lot less shit than my
vows.
What are Hgs?
Okay, maybe we should learn what an
amino acid is first
and learn what the structure looks like.
Tur is just another last atom. I don't
think so.
Have I seen the COVID hackathon? We'll
look at it briefly and then decide we
don't want to participate in it.
Sounds like this is supposed to help
people.
Okay. I don't know if we do that on our
channel.
Okay. So, these vows
um no helping people is good.
Acting like you're helping people when
you're really just doing it to feel good
about yourself is bad.
So I don't even pretend. I just say that
really I'm not here to help anybody.
Vows.
Okay.
I seem like they already have hydrogens
on them. What are these things? Sounds
like hydrogens.
Let's not add any hydrogens.
That's what you're doing right now. What
am I doing? What's the page link from
where I downloaded the protein
structure?
It's here.
Oh, here's the the whole copy pasta.
Uh
oh, it's so beautiful. That's an
envelope protein.
Oh, it's even more beautiful when you
look at it from this angle. It looks
like a little envelope, don't you think?
Do we have options for chyratch?
Oh, we can add representations.
Licorice.
Whoa,
that's crazy. That's what it looks like.
Do we have hydrogens? I think we do.
And structure representation. Oh,
licorice representation.
ball and stick
backbone.
How do I delete representation?
If I want to get rid of cartoon,
remove
cartoon.
Oh yeah, look at that.
It's unlookable.
Or maybe it was red because the water
atoms all got inserted first.
And now redness is how they say how far
you are into the atom.
So this
um is the same as this.
Like this is the CAD model for this.
It's the convention from the gradient
from the N terminus to the C terminus.
Oh, are N and C like the like a thing in
a protein? Like N's like the front and
the C. Oh, because it's N. Is that
again? I'm sure if I took like biochem
101, they'd be like, why don't you draw
the lysene amino acid? And I'd be like,
I didn't study.
Where's the C? I don't see any C. Is
lysine amino acid?
Not like five and three.
Every vertex is a C.
Does lysine make you gain weight?
All right, we have a little leftover
coffee from last night. We're going to
need some leftover coffee to deal with
this.
Oh, coffee. That's what you're doing.
Smells terrible. Should we make new
coffee? Yeah, we're rich. Let's make new
coffee.
Two left though.
Put a little more on top of the crowns.
Is that right?
Let me make a little
bought this coffee maker on Amazon
Prime.
Ninja coffee maker. Yo, who remembers
when Amazon Prime used to work? Those
were the days, man.
Does this channel also do JavaScript
tutorials?
I'm tempted to ban you unless you're
trolling and then you're funny. But if
you're serious, I should ban you.
Okay guys, let's do a Python tutorial.
So this is a letter I. I equals zero.
But in Python, you don't even need to
say that. You can just make for loops
like this. In C, you'd have to go to a
lot of effort to say, you know, in C,
you'd have to write. Think about it.
It's so long. You'd have to type int
main and then, you know, you'd get
errors and you'd have to type int i and
then you can type for int i. Oh, I int I
can just put int eye right there. No,
but C sucks, man. That's why you should
all use Python. Look at this. We're
going to write bubble sort in Python.
Who's ready to write bubble sort? We're
going to make a list. And the list is
the items that we want to sort. We're
going to make the items 84, 23, 99, and
10.
Now, of course, whenever you actually
want to sort a list, you can just ask
for your list to be sorted, but that's
cheating because this is a tutorial. So,
first, we're going to make I go from the
range to the length of L. And that will
iterate through each element in L. C 0 1
2 3 Remember that lists start with zero
in all languages that aren't stupid. L
is stupid. We can look and we can see
what the elements are in the array. See
84 23 99 10.
Now bubble sort is not a very good
sorting algorithm. It's O of N squared.
Say it with me kids. O of N squared.
That's because it has two loops inside
of each other. I and J. We call them I
and J because back in the day computers
only had I's and J's. You should
remember that you're very privileged to
be able to use any letter you want, even
a word for a variable in Python.
Now, in order to write the bubble sort
algorithm, we need to check if the item
in the list at I, which is always a
smaller number than J. You see that?
That's because I goes from zero to
length A and J goes from I + 1 to L. We
need to check if the thing at L sub I,
which is remember the zero I is this
one, the one I is this one, the two is
this one, and the three is this one. If
it's bigger than the one at J.
If it is bigger than the one at J, we're
going to need to switch the places of I
and J. Now, there's no nice way to do
this. You have to write this all out
terribly on three lines.
But you'll see if we wrote the algorithm
correctly, our list is sorted. 10 23 84
999. Thank you for joining me on Noob
Easy Python tutorials. Come back another
day and we'll learn how to sort a list
backwards. Hint, you just change the
sign of the comparison operator. Thank
you.
Did you like my tutorial?
You all learned to program today, guys.
[Laughter]
Oh no,
my coffee looks kind of watery.
That's probably good for the night time.
Hey guys, go to Google and write bubble
sword for them and they'll give you a
job for that now.
Some guy once told me
right when I first got into hacking, you
know, back before things were really
bad. Um
he's like, you know, all the reverse
engineering in the world is done by like
15 people and they're all unemployable.
Um no, the bubble sort uh implementation
is actually copyright this stream. Um if
you want to use it, I'll license it to
you
uh for cheap. You know what? Here's the
license on the bubble sword algorithm.
If you're a subscriber, you can use it.
If you're not a subscriber, you can't
use it.
Uh, does bubble sort work in C or no?
No, it only works in Python.
It's a Python only algorithm. Yeah.
Yeah, that makes sense. Yeah.
Guys,
I just chewed an ice.
Contron75,
thank you for gifting us up. By the way,
guys, if you've been enjoying these
streams, um,
please subscribe. If we get a hype train
going, I'll do another tutorial.
audit the augur contracts again. Why did
you remember that rant? Man, I was
really having a bad night that night.
All right. Hello world tutorial. All
right. Well, the bad news is if you're
in Rust, nobody knows how to write hello
world. But if you're in Python, you can
just type print hello world and there
you go.
I'm a big fan of Raspberry Pilot.
Where's Raspberry Pilot? No, no, no, no,
no. They It's It exists.
They got Open Pilot running on a
Raspberry Pi, I think. Um, and you know
what I mean? Like here's the thing about
making fun of things, right? Like it's
all great to make fun of things until
somebody actually like gets it to work.
I don't know how well it works, but it
seems to kind of work. A bunch of people
are using it. You got to give props for
that. I mean, good for good for
Raspberry P.
Oh, we on the hype train. We got a hype
train going.
No hype train.
All right, guys. We had we were doing
work. We were being so productive
tonight.
Tonight was such a productive night. And
then we did the bubble sort tutorial and
that's where it started to go downhill.
Okay, we're still trying to figure out
why this coffee is gross. Why am I
drinking coffee? It's 10:00. We're going
to put it over here and not drink it.
That sounds good.
No template found for residue one met.
I'm telling you, it's because they're
using a different
they must be using a different uh
All right, let's get to the bottom of
where these force fields actually live.
Don't open an empty source. They have to
be in here.
residue name Matt.
Huh?
Yeah. Look, they don't have
like I have HG1 in here and there is no
HG1
under MET. So, this is just wrong.
There's the HGs, but there's no HBs.
Okay, why don't we go in here and we'll
just look for
Charm 36.
Oh, this has citations.
I'm not even gonna I don't know about
that.
Um
maybe they talk about it somewhere. They
have to talk about their force field.
Oh.
The ITAS are force fields.
But yeah, we just if we figure out which
one
Okay, they all have mets. What's absent?
Hg. No. See, but none of these have HG1
and HG
and HB1.
Yep.
residue is 10x
charm polar 2013
at
Oh, HB1 and HBO.
This one might work.
Charm polar 2013.
Oh,
this is just not H how can that not
work? is because it doesn't like my tip
3P.
Let's get rid of the tip 3P. Oh, now it
works. Yeah, buddy. Okay, now they're
all unmatched residues, but that's
probably okay.
Um,
if I just put back into PDB topology,
no template founded.
Set of atoms is similar to Matt, but
it's missing 13 atoms. Is it hydrogen
that it's missing? Could it be
hydrogens?
No.
I can add extra particles, but I don't
have high hopes for that.
Okay. Well, charm polar isn't right.
Wow, so many atoms.
I mean, let's try to figure out. Let's
just look at the met amino acid. Like,
we can figure out. We're not idiots. We
can figure out what these things are.
What force field do these guys use?
Amber 14 protein. Maybe this one.
While I'm at it, let's load up tip.
Got to have some water.
Does this just work? Maybe
is missing one hydrogen atoms. Okay. All
right. Let's add the hydrogens.
No template found for residue val, but
the bonds are different. No, no. We're
not We're not getting started on this
again.
What?
What are you complaining about?
Wait, there was there was a hype train.
Wait, it didn't work. You guys trying to
scam me? I actually didn't see Oh my
god, level five hype train. Wow, it just
didn't load for some reason.
Well, you guys are amazing.
Thank you so much.
Okay. What do we want?
All right. Wow. Wow.
Guys are great. I didn't even like I had
to refresh my Twitch. The thing is like
broken.
You guys want to move the groceries? We
could do that. I don't know. The chat
doesn't even go back that far enough. 20
subs. Sweet.
Show us the groceries. All right. All
right. I'll show you the groceries. All
right. All right.
Two bags.
All right. We bought potatoes.
We bought
potatoes.
You know
what what what's this is when I thought
that the world was going to end because
of corona virus. I sense come from my
senses and realized
that well
I got rice.
I don't really like potatoes.
I got apples
and I got onions.
I didn't get any frozen fish. It was
gross.
All the food was super cheap. You know
what I mean? Like if you think the
world's ending,
we're not eating a raw onion.
But wow, this is a nice hype chain. No,
the world's not going to end, guys. It's
honestly
No. No, no, no, no, no. This is this get
is it is it political? It's probably
political. It sounds kind of political,
but after studying this
for a lot of days,
how I learned
to stop worrying and love the Corona
virus.
Roar EAX6, thank you for gifting subs to
people.
Oh, thank you. Thank you.
I didn't even know. I didn't even know
about the hype train, guys. It wasn't
showing up on my Twitch. I had to
refresh it.
We get a little money back. would take a
lot of subs to make back all the money
from the stock market.
Um, no, I mean, look, all right, I'll
I'll I'll I'll whine a little bit. As a
small business owner,
uh,
yeah, the economy is not doing great.
Um
me personally about catching coronairus.
No, I'm not worried.
Uh I'm not worried.
If I get Corona virus, I calculate my
chance of death at like 1 in 10,000.
I used to ride a motorcycle, you know.
Yeah, we we can pay rent. We're not
going out of business.
I'm not going out of business. I'm not
going broke. We have plenty of runway.
But, uh,
no, it just like it just it just puts a
screeching halt in what was a great
economic times.
Um,
no. I'm saying like I'm very happy to
take risks in my life that are on the
order of magnitude of one in uh one in
10,000. We we asked at lunch today uh
what
say you want to like go visit the ISS,
what would the risk profile have to be
for you to do it? Someone said 5%,
someone said 0.5. I said 05,
right? So, if I have like like a one
2,000 chance of dying, I'd go to space.
Um, no, this isn't this isn't a crash.
This is 30% unemployment.
No, the government's not going to bail
me out.
I didn't donate enough to either the
Republicans or the Democrats. That's how
America works. You donate to the
politicians and then they give you money
back and then and I didn't All right.
All right. Now, come on. Come on. Do we
really want to rant about this? Do you
guys get me off track or do I just get
off track?
All right, we'll click the data is
beautiful link. I kind of like data is
beautiful and you are a subscriber.
[Laughter]
Yo, it's global warming for
unemployment. They even started to Oh
no. Holy shit. That graph actually
started at zero.
Wow.
Wow.
Wow. See, this is this is fucked, man.
I kind of agree that there's something.
All right. So, another that I've kind of
come to realize about this. This is
after testing day after learning about
how the test works. So it's it's reverse
transcriptase polymerase.
Um this wasn't even invented.
Uh no and okay, we can't say entirely
that there's something like political
behind it unique to America because most
countries seem to be reacting
very similar. Well, you kind of see two
clusters, but
maybe you should address the questions
that people ask all the time, such as
how to become elite coder and hacker
and how to be super smart.
You know what? I'll legitimately engage
with that question for a minute. What do
you think the answer to that looks like?
Do do you think the answer to that looks
like a book? Like I paste you this book
and I'm like if you sit down and read
this book you will come out
well no but a lot of people ask me this
question and I'm not even sure not only
what the answer is but what kind of
format they expect. I mean, honestly,
what I should do with these people is is
is sell them, you know, well, you'll be
an elite hacker in just six months after
27 payments of $79.99 and you take my
course and we'll learn bubble sort,
right? I mean, that's really what
they're looking for. Stop.
When you ask like that, you're just
begging for somebody to scam you. I'm
It's not going to be me. It's not going
to be me. I don't want anything from you
except a subscriber. Make sure you
subscribe. But um you're just that's a
whole mentality of like you're looking
at other people for
like it's not an answer, right? If you
look to another person, if I like look
to another person, I don't know the
structure of of of methion, right? I
don't even know if you pronounce it
methion. I bet you don't. Um,
wait. Methion is Augg.
Then what's Oh, it's encoded by the
codon AG. Okay, that's the start code.
Yeah, that makes sense. Um, if you ask
someone what the structure of methion
is, like you understand what they're
going to give you back. They're probably
going to give you back a diagram that
looks like squiggles and this, right? If
you ask someone, well, you know what?
Let's ask Google how to be elite hacker.
[Laughter]
[Laughter]
All right, bro. I got your answer.
They were joking, man.
Uh,
I don't understand
why my methion has HBS and HGs.
and their methionis don't
I don't even know what entert
using good old amber 99 SB
but it has HB2 and HB3
why
it's so close.
Okay, let's try to figure out if we can
uh let's look at this and see if we can
figure out which one of these is which.
So, I assume that's
N.
This is the N.
That's CAB
C.
One carbon, two carbon, three carbon,
four carbon, five carbon.
One, two, three, four, five. Okay, that
matches up.
Um, but how come these are called HP1
and HP2.
Yet in the force field,
this one doesn't even have any of the
hydrogens.
COD CG CGE. It almost seems like a
different number in. All right. And
those are the Okay. So, actually, wait,
these make sense.
It's actually this that doesn't make
sense.
Why would they call it HB2 and HB3?
Well, okay. So, let's figure out which
carbon is which. So, this is the N. This
is CA.
And I Yeah, there's got to be a hydrogen
hanging off of there because carbon
makes four bonds. So, that's HA off of
there. Um, this carbon has no other
bonds. So, this is just the carbon.
What's an SD? All
right, let's let's search for these.
Maybe we can learn
methion.
Following atoms are expected for a given
amino acid.
What's SD?
Only methionis have SDS.
No, it's not that the number changed.
It's just for some reason this file
seems to be calling them HB2 and HB3
whereas this file calls them HB1 and HG1
which actually seems like a much more
sensible numbering to me.
Oh, Amber 96 seems to have them
in the net. They don't though.
Charm 36 and charm polar seem to have
them.
They call them this.
Okay. Does this match this?
Oh, okay. I don't have an HN, but I
guess not all the hydrogens's are here,
but that's okay. I mean, clearly not all
the hydrogens are here, but at least
they're calling them HB1 and HG1.
Okay, this one seems right. Charm 36.
Who believes in charm 36?
Okay. Well, tip 3P doesn't work with
charm 36. But if we just load charm 36.
Oh,
can't add hydrogens.
No template found for residue 75.
The bonds are different. Perhaps the
chain is missing a terminal group.
Okay. Well, that's a different problem.
Again,
I feel like I should be able just to add
the terminal group.
set of Adams matches Val.
Wait, what is this one HG1 shit?
Let's go look at charm.
No, it doesn't match.
It doesn't match because it's called one
HD1
[Music]
PDB names.
Oh
no. Okay, this just might be okay.
Oh, it's just the alternative name. I
say
HD3 is just called HD1. Okay, this
actually doesn't have anything to do
with that.
The first one was fine.
This doesn't have anything to do with
this because they have alternative names
which is just allowed which is cool.
The bonds are different.
doesn't even have bonds.
This one have bombs
scale
secret db ref.
I'll try to read the code again.
No template found. Okay, let's try a
different approach.
Let's take things from here.
What if I just take the atoms from here?
Not the head atoms,
not the tur just the atoms.
Do those work? Okay.
That works. Okay.
Oh,
what's an oxt?
That's interesting.
Also interesting how that didn't break
anything.
All right, let's get rid of this
glycine.
Now it's just an argonine. Does that
still work? Okay.
No, the chain is missing a terminal
group. Okay, now we have the error. Are
there other glycines?
Yes, there's other glycines, but they
don't have
an oxt.
I see. So, if I get rid of the oxt,
we have a problem. Okay.
So, I guess we just need to stick an oxt
on the end of it. I don't know if you
can stick oxts on the end of all things,
but we can try it.
Yeah, buddy.
It didn't add many hydrogens, but it
added a few. And we stuck an oxt on the
end.
I don't know why they didn't have one
already.
Requesting periodic box dimensions for
our topology. Can we add a solvent?
No, we can't add a solvent.
Get unit cell dimensions. Great.
Now that shit's specified. It's probably
specified in here.
Remarks. I don't think it's remarks.
scale
crist
shoot
formal.
Okay, we got some with
uncharged side chains and charged side
chains.
Oxygen of hydroxil.
I got to learn this chemistry.
Methionine is the first one.
How do these things go together?
Peptide chain.
Okay. Is this are you what is what this
is saying that this O isn't here?
This CO here
looks like it just connects to a
nitrogen.
Okay, we can follow this.
Methionine. Oh, methionine has a sulfur.
Wow.
The NH group is here and that's where R1
is. I see. So, it actually doesn't.
These hydroxal groups aren't real and
that's why I couldn't find the other
oxygen.
Yeah. So, that's what it was complaining
about.
I mean,
weird.
Do they just expect me to fill that in?
There is a command for that.
Add extra particles.
residue one met does not match any
template defined by the force field.
I don't think that's right.
We can't add a solving because
Weird. I don't know why it doesn't have
a terminal group. Do they expect you to
fill that in or do they just not care
because these proteins aren't used for
simulation?
Does this one have a
I don't even know what an anime is.
Is that amino acid?
Where's my chart of amino acids that I
was looking at?
Methionine.
Wait, I think that tab is what I wanted.
No, not this one. I didn't want this
one.
This book has to have a good amount of
molecular biology of the cell. This has
to tell me about amino acids.
Does it? Maybe it doesn't.
from RNA to protein. Yeah.
Whoa. Whoa. I got to read all this
anticodon.
[Laughter]
I was just thinking about the guy who
asked if uh I wanted a grant.
When they give out grants, do they ask
you if you know basic biology?
Did you get the PDF from? We purchased
it legally, of course.
Yeah, we have to learn basic biology.
Oh, that's a lot of complicated looking
stuff.
Proteins. Oh, I missed the whole chapter
about them.
Oh, here we go. This is what I was
looking for. Wow, this is so much better
than the websites I was on.
Polyeptide
backbone.
Yeah. Okay. Okay. Okay. Okay, so this
makes sense. So let's look at a methion.
Oh, wow. This is so much This diagram is
so much nicer. I love this book.
Yeah. So when you look at methionine,
this is with the hydroxal group, but
there's no hydroxal group here, and
that's the peptide bond. And then this
is the side chain. This is the
methionian side chain. Actually, the way
that's drawn is kind of misleading.
You know, you can flip it like that. I
think it's still the same.
George is the ability to go and quietly
read a book off stream. Yeah, I started
reading this book this morning.
You think I'm going to read this whole
book? How How quickly do you think I
read?
Cells and genomes didn't tell me yet. I
didn't get to chapter three yet. Chapter
one this morning.
Wow,
this is beautiful.
No, like I read fast but then I won't
really like learn the stuff and I go
back and I read it slower and I'm like,
"Wow, if only I'd read this slowly the
first time.
You know, instead of moving my face
closer, I could also make it bigger.
Yeah, here's the termination.
Oh, the hydroxal group's missing a uh
it's missing a hydrogen. It fell off.
Whoa. Things have electrical activity.
Yeah. All right. I think I will go
quietly read this book. I think we have
a lot to learn before we can start
simulating proteins. But we made some
great progress tonight. We learned why
that one didn't work. We committed some
great proteins.
We have two proteins now. We have the
one UBQ and we have the QHD from the
corona virus, but we can't get the
corona virus one to load. But we can
load up this one here. Take a couple of
steps with it.
View it here in Pyrange. We've learned
Nambdi is terrible.
Oh yeah, look at that. Wiggle wiggle
wiggle wiggle.
Yeah.
Why? Why did the colors go?
Why did it color them nicely for me?
Well, yeah. So, yeah, we can do this.
There a few waters.
We'll simulate it for a bit more.
Let's do a big simulation before we're
done for the night.
No, no, we got space.
Let's just make that 100 and that 10.
It's going to print out 100 things. That
sounds nice.
All right, Q&A time.
Commit to G. Should I not commit?
Oh, you want me to commit my simulator
stuff? Nah, it's not clean enough yet.
We'll clean We'll clean it up on the
next stream or something. Uh, no stream
tomorrow night. I got something to do.
So, I'm letting you know there's no
stream.
So, don't be like, "George, I want to do
the stream because there's no stream."
Uh, where's the tutorial for what?
Uh, if you want to go on dates now, you
got to do it in secret, man. You can't
tell anybody you're going on dates.
You're breaking quarantine. It's like
some World War II sneaking around shit.
I remember what you said on Lex
Freriedman about you not being able to
rotate a matrix and I'm hesitant about
you being able to learn this as well as
you could.
All right. So, tell me more about what
that means.
Oh, look. This is a beautiful
simulation.
Look at those water molecules.
Is that really what atoms look like?
That wiggling side chain. Wiggle wiggle
wiggle wiggle wiggle wiggle wiggle
wiggle.
Do you think there's anything behind the
response to the virus and agenda?
Not really. No, it's the same. Well, the
politicians aren't they're not clever.
There's not like some secret plan. No,
the plan's like really obvious. What
What do they say? Never let a good
tragedy go to waste.
Yeah, they're using it to push through
whatever bullshit they wanted to push
through. Boeing is getting big bailout.
Like, yeah, you know,
um so that's
not that they're too dumb to have a
plan. It's actually that they're too not
coordinated.
Uh
like, you know, my friend told me this
theory once. He's like, you know, the
Democrats and Republicans secretly, man,
they they secretly are like best friends
and like, you know, they uh they just do
it all. It's all a show they put on for
us. I'm like, bro, I really don't think
they're that clever.
Um no. And like you can't possibly say
that like this is some American
overreaction because I think every
country is doing pretty much the same
thing. Uh
though you can kind of cluster the
societies into like high trust societies
and low trust societies.
Um, like you know in Korea and Taiwan
they track all the cell phones which you
know and like I I've heard that and this
might be wrong but I've heard in Korea
that uh you have to have your cell phone
on you at all times. Somebody calls you
twice a day. If you violate quarantine
they find you $8,000.
Yeah, you can take measures like this.
But you know me, I love freedom.
Um,
so no, if they tried to do that here,
I'd be I'd be I'd be livid. Uh,
to track my cell phone because it's not
like they're going to track your cell
phone and get rid of Corona virus. You
know, next thing you know, they're
tracking your cell phone for the flu.
They're, oh, oh, why don't, you know, we
could end HIV, man. Let's just track all
the people's cell phones with HIV and
then notify their sex partner, right?
and they say, "There you go." And that's
but that's what's next.
Um why don't we figure out all the
people with uh who are doing uh who are
spreading wrong opinions and track their
cell phone. Make sure we don't let the
wrong opinions get out.
Now what made me change my mind? The age
group or the risk group? Uh two things.
one um I read a paper a pretty
convincing paper about the number of uh
confirmed cases
uh especially among the younger age
groups um not even being close to
competitive not even being close to like
the the even the 2% they were saying for
like the the 30 to 39 age group two when
you do those numbers out you get big
deaths right so about 3 million ion
people die in America every year. Um
let's say, you know, we have a let's say
coronairus goes really badly and we have
a million uh more deaths this year.
How many of those are going to be paid
back down the line with less deaths?
Right? You got to be honest with
somebody who's 85, like how many more
years do you really have to live?
Um
you know it's not the the if you're
talking about a number which is not
total number of lives lost but total
number of person years lost
it it looks
much less bad.
Um
but yeah I mean you know and then the
third thing that that made me kind of
change my mind and then yeah should you
measure lives or should you measure
person years? You can you can make
arguments for both. Uh the third thing
that kind of made me change my mind was
um what is the long-term plan?
Right? If you live in a place like
China, uh, where you can have a super
strong centralized government response,
where you can barricade the roads,
uh, where where you can, I mean, you
know, everyone saw what the response
was, right? Uh, setting up checkpoints.
If you can do this, then you actually
can potentially stop the virus.
But then what happens when you missed
one person or when one person shows back
up?
Well, it all starts over again and you
have to do this again. Is that going to
be a regular
are are city lockdowns going to be a
regular occurrence
or is mandatory testing going to be a
thing?
Yeah. So, the hospital's being
saturated.
How long? I I want to see a model that
explains how long you'd have to like
like
Okay, so you beat it back and then up
what what we're going to have like a
like a like a like a fire alert status
that talks about whether we're on social
distancing or off social distancing or
um
I I don't I don't know about the
viability of any of this and I I worry
about
long-term real economic damage. And a
lot of times, you know, you can make fun
of like there's a hashtag on Twitter
like die for the Dow and like yeah, that
shit's all funny, right? Like we can all
make fun of like rich people losing
money on stocks. You know, rich people
can make fun of themselves for losing
money on stocks. But when you have 30%
unemployment, like it's not funny
anymore. Everyone I know who's been
affected by this was not affected by
this because of the disease. they were
affected by this because of the panic or
they're affecting it by the the economic
consequences and not the economic
consequences like you know they lost
some money like my friend has to move
out of her house because the person who
was the main lease holder uh can no
longer uh afford rent so they're going
to move out and you know she was a
subleas leaser and now there's no more
house right like it's just there's
actual consequences for people because
of the economy um
yeah I I think the fifth thing too,
there's even one more is in 1980, it's
unclear to me how we would have detected
this disease at all.
It is only now that we have all of this
great genetic technology that allows us
to detect this. The Spanish flu was was
notable not because of the number of
deaths, but because it killed young
people,
right? There's
And like again,
do you measure lives
in life or in person years?
You can argue for both.
I wouldn't even say if we get to be like
Italy, right? Like honestly the economy
I if this only goes on for another month
or two the economy will recover pretty
quickly.
Everybody can okay two months like it
sucks you have huge unemployment claims
but you know in two months if all the
restaurants reopen uh it's all fine
right we everything goes back to normal
pretty quickly but I haven't seen how
this is going to the only way I've seen
that this is going to be two months is
if you let corona virus just rip through
the population everyone who's going to
get it gets it
if
and then Well, when it comes to the
hospitals being overloaded,
I think, and I might be wrong on this,
if you're ending up on a ventilator,
your chances of living aren't that great
in the first place. Um, for supplemental
oxygen, we should have enough,
right? Like it's what is the what is the
and this was in the model from
yesterday. What is the ICU overload
factor? How much worse is the outcome if
somebody can be in a hospital or not be
in a hospital?
And
like I mean that's a big number, right?
If that number if it's like 10x if it's
10x better to be in a hospital and you
can actually prevent like 10x of the
deaths,
okay, maybe it's something to seriously
consider. But that's not what I've seen.
I've seen it be more like at best 2x.
Um, it's been 3 months in China. Yeah.
And there's still there's still some
lock. I mean, China took a China took an
approach to this disease where they are
going to stop it at all costs. And in a
way, China may have been biased toward
that approach by their previous
experience with SARS. By the way, I I
hope you guys don't think this is
politics. I'm really trying to not talk
politics right now. This is
what is the word? It's like ep
epidemiology.
Yeah.
Okay. My bad. Would you say
it matter if you say it is in politics?
I don't know. I I just hope I I hope
that whenever I discuss anything
um I mean there's some things that are
like beyond the pale and like shouldn't
even be dis like you know you just you
just can't you can't engage with it. But
for most things I really just try to
make sure I'll always engage.
Um, what's wrong with politics?
It's worth reading.
Um,
people who be let levelheaded about
evenly
evenhandedly weighing all sides of an
issue in their professional life as
scientists can suddenly turn into slogan
chanting zombies when there's a blue or
green position on an issue. And it's
that, right?
That's what's wrong with politics.
To discuss like political strategies and
stuff, that's all great. just don't go
chanting supporting the blues or
chanting supporting the greens.
Um, it's it's ideology. Maybe it's maybe
it's more ideology that I uh that I that
I don't like and I see people go out and
like,
you know, I love a good protest, right?
If we're going to a protest and we're
all having a good time, I'll protest
whatever it is, man. You know, I love I
love protesting things. But if we're
going to a protest and we're like not
having a good time and we think it's
like seriously going to do something,
well, it's not a fun protest anymore.
Um,
big events like this poke holes in their
legitimacy.
Again,
you know,
I don't think that America's response to
Corona virus has been particularly bad.
I don't think that there's I mean,
I I don't like see like, oh, this is a
major like someone's trying to pull the
wool over our eyes kind of thing. I I
think that um I think that a lot of
people are confused and don't have good
data and they're not really willing to
admit that.
Um so you take actions that then become
kind of hard to backpedal
that unemployment graph man. It's just
it's so sad,
you know.
It's so sad to to
I I mean I don't know. I've I've never
I've never lost my job. Um I've had to
fire people. It's terrible.
Like it's it's and then like
it's a it's a terrible interaction on
both sides and to have put so many
people through that.
You're under 40, but will probably die
if you get it.
I don't think so.
Um, oh, another thing. Another thing
that was uh
Oh, I I told my sister I'd send this to
her.
Um,
forgot another thing that uh it was it
was this one. Was
it this paper?
here.
Um so this is a another human corona
virus
and how many people were in this study?
Uh death from any cause during the
outbreaks was seen in eight residents.
So 92 symptomatic patients.
So yeah, you have a 8.6% death rate in
nursing care
in a in uh aged care facilities in
Australia from this corona virus.
Like if you get a cold and you're old,
what's the prognosis,
right? Is is corona virus a 10x event or
a 100x event? A 1x event, a 10x event,
or a 100x event?
Um,
I think it might be a 10x event. I don't
believe it's a 100x event.
For 60 year olds, it's almost 100x. 100x
what?
Well, 100x event means
so we can okay, let's let's just talk
about let's just talk about the flu. So
50,000 people are going to die in
America from the flu, right?
Is corona virus going to kill 500,000 or
is it going to kill 5 million?
Right? We can one way to look at it is
is is death counts. Right? If if if
50,000 people die from the flu, if
corona virus is let's say 1x event,
let's say 1x a flu, 50,000 people die
from it. If it's a 10x event, 500,000
people die from it. If it's a 100x
event, 5 million people die from it.
I'm not clicking some New York Times
article that mentions Trump in the
title.
I think those numbers are high.
So, I think we were doing out the uh
we had we had that thing from yesterday.
So, you can't just look at deaths. You
have to look at hospitalizations as
well.
Ben, you're about to get banned. Uh I
don't care if you're a subscriber. Uh
yeah, yeah, yeah, it was it was this
one.
Um so this is the the prediction thing
uh we were looking at.
You know I don't want to be the first
country to try this strategy.
There's there's some amount of concern
in in in doing that. Um so this still
doesn't match. I think yesterday I put
this up to
we have to match the existing death
numbers. Uh we don't have to match the
existing cumulative case numbers
obviously
um because we think that they're they're
wrong. Um there's a lot of people that
are really uh misrepresented.
So this is this is talking about this is
talking right now this model has has
three million deaths. Um,
I mean, I think another thing that's
really wrong with this model is this is
assuming that
like everybody
um is going to get Corona virus, which I
think just isn't true.
I think that the cruise ship
kind of shows
um
it it doesn't.
So now
if you if you say that only 30% of
people are going to get it, you're down
to you're down to a million deaths.
Um
versus
moderate mitigation
834,000.
Right. I I would say right now we're
doing we're doing moderate mitigation.
Strong mitigation is like what China
did.
Um
so
I mean that's the difference.
This still predicts that all the
susceptible people pretty much are going
to get it by uh
why do you think 70 to 80% are going to
get it?
Um, so the R0 is pretty strong. Yeah, I
use the I use the fast spread of the
epidemiology and that's what seem to
seems to match. Um, but the R0
doesn't necessarily the R0 just says for
one person how many people on average
they're going to give it to in a
completely naive population.
It's how did everybody on the cruise
ship not get it right? You can't say
that their quarantine methods were
effective.
Um I haven't read there's some been some
good epidemiology studies coming out. Um
I haven't read them. uh I should spend
uh some amount of time thinking about
it.
Um, I think that our society in a way
is bad about
uh
this is this is an interesting article
that
how our society thinks about death is a
little bit dysfunctional.
Um, I mean, I think I think one of the
biggest things is like
would we as a society let somebody go to
Mars on a one-way trip?
Would we? I'll believe it when I see it.
If I'm president, what's one thing I
would do right now? That was explicitly
what the hater asked me not to do. But
you know what I say? Fuck haters. So if
I was president, if I was president,
what I would do right now is I would end
social security and spend all the money
on a big ass Mars base.
Yeah.
Take all that money, 1.5 trillion. You
know how sick a Mars base I could build,
man?
We're going to build like we're going to
build pyramids on Mars. Also, pyramids.
Could I use the military budget to build
large pyramids?
You know,
all right. I have to say that I'm
stealing the pyramid idea from someone.
I'm not going to say who I'm stealing it
from. Uh but he wants large pyramids.
And if I was president, I would give him
his dream. We need to build something
that's going to last. How long do the
other pyramids last? 5,000 years. We
need to build something that's going to
last 5,000 years. A large pyramid in
North Dakota. And then when you know
America's over, maybe even when people
are over and somebody finds a mile high
pyramid in North Dakota, people are
going to be like, "Holy shit, man."
You know?
That won't become a mountain. It'll be a
perfect pyramid, one mile high
in North Dakota. It's just a mile by a
mile by a mile by a mile.
No, not for storing anything, man. And
like, you know, we'll like bury Chuck
Norris in there when he dies or
something.
Why shouldn't Corona virus be blamed on
China's way of eating?
What good is blaming that right now
going to do,
right? I mean, I think everybody can
hope China makes some reforms to the wet
markets.
I think their citizens are hoping for
it, too. I don't think
How and when do I think the Great
Pyramids of Giza was built? I think they
were built by Egyptians like 5,000 years
ago.
We're not big on a lot of conspiracy
theories.
Oh, genome analysis suggests two viruses
may have combined. Huh?
So the genomeic coronirus isolated from
the Malaysian pandalin is less similar
to SARS V2
with only 90% of genomic corresp
specific. Yo, we could do this science.
You want to check these studies? I know
how to do all this. This is the spike
protein,
highly divergent.
Huh.
Interesting.
Wait, this still doesn't mean it didn't
come from a uh
still doesn't mean it didn't come from
an animal in the in the the wet market
in Wuhan.
North Korea did it.
Um, how do you know if this virus was
not humanmade?
Well,
I mean,
here's
here's here's a way to think about that.
Let's talk about alternative histories,
right? Let's say if the whole world
didn't witness what China did in Wuhan.
Let's say this virus just started to
spread in America.
Let's say this virus actually did start
in America, hypothetically.
You think there'd be lockdowns?
I tend to think no.
I tend to think that the way it's spread
also
let's let's also throw out the
similarity to SARS, right? Because SARS
conjures up a certain way of dealing
with a disease. The fact that it is SARS
and is related to SARS and everybody in
the medical world knew this.
We responded to SARS by
like locking everything down like crazy
and tracing it down and stopping every
last case of it.
That might have been possible here in
December.
Um there was uh I looked up plague ink
online. I I searched play on Twitter
um after
uh I played it for a bit and
they uh the the the the joke was like,
you know, once you've got Greenland,
man, once you've got Greenland, it's
over, you know? And it is. I I I played
I played about 10 more games of play in
like sometimes sometimes you're left
with like Greenland is the last place
you can't get. Uh,
I mean,
does containment look like a strategy?
Madagascar is also the meme I've heard.
Yeah. Um, does does containment look at
all like a possibility? And then
here's another thing that I wonder.
Let's say
let's say um
we we'll just yeah let's let's say
America does let eases back on this
stuff and everybody in America gets the
virus.
You know I think 15% show symptoms.
It's it's it's it's
everyone in America is exposed to the
virus.
Now, what's the rest of the world going
to do? Is it possible for some countries
to retain this ultralock down strategy
where in America we treat this virus
more like a more like a cult?
Um, also waiting on monoconal antibbody
treatment. Has there ever been a
deployed monoconal antibbody treatment?
Are any of the How does the flu vaccine
work?
Yeah. Contains a live but attenuated
weakened form of the virus. Um I don't
think we've ever done either a DNA
vaccine or a monoconal antibbody
vaccine. These are things that have been
talked about for a long time.
small countries can probably handle a
longer lockdown.
No, I think
we live in a world today where So,
here's a here's another people are like,
well, you know, all Oh, it's it's
terrible. You know, obviously I can't
afford my rent. How could someone be so
unconscionable to to charge me my rent
this this month to kick me out if I
don't pay rent? Well,
a lot of people who who rent who are
landlords, they didn't uh they don't own
the house. They're paying off a
mortgage, right? And then you could be
like, "Oh, how could the bank make the
mortgage do?" Well, again, the bank just
borrowed that money from from the Fed
and the Fed could do loan forgiveness
when you go all the way up the chain,
but like that's a lot of that's a lot of
top down economic bullshit. Even, you
know, this building I live in right
here, right? It's a nice apartment
building. Pay rent. Like, you can see
like, "Oh, they're so rich. They built
that nice apartment building." I'm sure
they built it on credit. I'm sure this
whole thing was financed.
Um, yeah, India has a month-long
lockdown.
Uh,
failed DNA vaccine in Yeah, in 2008.
Is this a DNA vaccine?
This could just be I'm not sure,
you know, we have
there's lots of antiaxers in America,
too. Vaccines cause autism. No, they
don't.
But I don't know.
No one reportedly died from the vaccine,
but since the announcement
I I don't know. I can't get any
information out of this. George, look at
the link I sent. It's a good read.
Um, someone said an upcoming re crash.
Yeah. Sure.
Oh yeah, the Bloomberg and the tiny chip
infiltration. I made a ton of money off
of that buying super micro
work. I I don't I don't buy the vaccines
cause autism stuff at all.
Uh coronavirus.
What is this? This looks kind of newsy.
Someone killed a young boy in Horseshoe
Bend, Idaho because he thought CO was
ending the world.
You know,
Yeah. And stories like that make me sad.
Again,
always remember though that we do live
in a do live we do live on a very big
planet. Uh 7 billion people live on the
planet and the weirdest stuff happens
all the time.
The way that you and any good
intelligence operative knows this. The
way that you
fabricate something isn't by making up
evidence. It's just by highlighting
certain pieces of evidence that support
your story. You can tell a story. You
can tell so many different stories or
you've seen this with movies too. Like
directors can recut movies to tell
almost a totally different story out of
the same scenes.
How can Pokemon Go adapt their gameplay
to a new quarantine lifestyle?
I'm going outside.
Um,
I'm not I'm not clicking a
sensationalized story about some kid who
was killed. You know, it's sad, but this
is not the majority that's not the
majority of people. Um, the majority of
people that I've met
and discussed
this with have been very like
reasonable and understanding. I don't
know. Okay, I was born in 1989.
Uh,
we never lived through a real war. I
don't know what that's like.
Again, like people everywhere are going
to are going to do it. Yeah, I mean I I
just don't think that the uh
I I saw I saw I saw a poll about how
people thought uh about was a public
poll of how people are handling the
crisis and uh you know I mean I always
complain about them. I always complain
about the the the news
the media and the people know people
hate the media.
Well, we haven't been living through a
real war. These aren't
these aren't these aren't wars like
there used to be.
Sure. America's always at war now,
right? Got to keep the Got to keep the
thing.
All right. All right. Q& A. Good. Happy
Q&A. We'll do a little happy Q&A and
then I'm going to read biotech books.
If I catch the Corona virus, will I fill
out a will? Uh,
no.
Like I said, I'm not that worried about
catching the Corona virus.
Um, you know, I'm more worried for it.
It's not It's not me, man.
My question is read this and my answer
will be next stream when you read it.
If you had an inspiration in your life,
what who would it be? So, normally I
never answer questions like that, but
Rory Ax, I did see you giving out all
those subscriptions, so we'll make a
special exception for you. Normally I
take questions like that. I'm like,
uh,
what do you mean?
Um,
I'll try to give it a good answer, too.
Then, let me think for a little bit.
Well, it's definitely not a who. It's
definitely not a person.
Maybe
it's it's this. It's
you know that feeling
when you get something. You know that
feeling when you when you figure
uh things out and how great it feels to
have things kind of come together like
the pieces all fit.
What do you think it feels like
to do that for everything?
What do you think it feels like to like
know everything, to understand
everything?
And that is kind of a Yeah,
it's a very inspiring idea. I think
what would it feel like to to transcend?
And I'd like to experience that assuming
the Corona virus doesn't kill me.
Thanks.
It's my favorite work I've ever done. Uh
I was pretty happy with mini value last
year.
Nuclear power plants. Absolutely yes.
Absolutely. Yes.
Nuclear power plants. You know, I'm not
the biggest global warming shell, but
like
if you do care about global warming, the
best thing you can advocate for is
nuclear power.
It's cleanest energy source we have yet.
I mean, it's terrible that we're burning
coal.
Uh,
I mean, you know, all the hydrocarbons,
right? Um, I've always said like the the
actual the temperature getting warmer
aspect of global warming doesn't really
concern me, but this is something that
does concern me. Uh, atmospheric
um, CS CO2.
So
this
um we we do have like it's our our
environment is uh is completely
artificial. Um and like I'm okay with
that. Uh but I would like to bring this
down. Large concentrations of CO2 are
bad for thinking.
Um 400's not that bad yet, but like
yeah, it's not
bringing that down would be nice. Um
stopping and the reason there's carbon
dioxide in the atmosphere, you guys know
the basic combustion reaction, right?
What they just It's like one
here. This Yeah.
Right. So that's the basic combustion
reaction that underlies all natural gas,
all oil or gasoline.
Um and yeah, you know, you have a lot of
this this CO2 that was was baked into
the earth. And the less we can do this
reaction in the world, the better.
common nuclear.
Um, am I really going to start a bio
company? I don't think so. Who knows?
You know, maybe.
Um, if you're taking tests in a stuffy,
nonpropy edge room, you're statistically
at a disadvantage. Yeah. Yeah. I've seen
those studies. They're they're they're
not great.
What do I think about space babies? To
be clear, space babies are babies in
space. Yo, we got to get more people in
space. Even if it's babies, man. Gotta
just got to learn to live in space. I'm
sure people have had sex in space.
Um, wonder how George feels about
chemtrails. Why do you think I believe
in any of this dumb shit? I don't.
Is Golang trash? No.
Look, Golang was made because not
everybody's smart enough to program in
C++.
Uh, no, it's a great language.
Like, I wrote mini value in Golang
because I'm not really smart enough to
program in C++.
For everyone who's not smart enough to
program in C++, you're definitely not
smart enough to program in Rust, right?
And I'm not saying like you can do it,
but why should you, right? In order to
program in Rust, you got to be like
wired and locked in and like writing.
Exactly, man. For Go, you could be like,
"Yeah, I got Netflix on in that window.
I got Twitter over in that window, and
I'm still writing Go really
productively.
There should be a school for dwarves so
they can save money on walls.
Never even heard of some of those.
Uh, how are your 20s? Um,
uh, oh, what is that song? Um,
No.
Um, we got to find that
What?
No. Okay, now I remember it. Uh,
what?
Terrible. Ah, here we go. Finally.
So where's the reckless lipstick and
your Philly neighbors? Where are the
memoirs of illegal behavior?
Where are the lovesick lines, the no
trespassing signs, the after hours
trading x-rated favors?
Where are our teens and how are your
20s? Where are the 40s that hide behind
30? Where's the old soul? And what is
this new person you've become?
Who have you become?
I closed my eyes and woke to your
morning routine. A boring and
contemporary scene.
Yeah. So that's
You guys don't like that as much as the
rap. I know.
Watch. What?
All right, we'll have to watch this.
It's three minutes.
Is it three minutes?
All right, we'll watch it.
Love this story.
Yeah.
When I was a kid, I all of these stories
that I thought were known to be the same
story but different versions of it.
And I called it the portal story. And it
was always the same. Somebody is trapped
in a humdrum existence in an ordinary
world
until some sort of magical portal
accidentally or on purpose enters their
life. and either they go through a
wardrobe, they go through a rabbit hole,
looking glass, platform 9 and 3/4 or you
know Dorothy famously uh was used to
introduce technicolor where she the
first part of the film she's in Kansas
and it's in sort of grayscale black and
white.
Oh that's right.
And then she lands in Oz and they open
the door and it's technicolor and
there's this transitional scene where
you see technicolor for the first time.
The question is where's the port? Like
why do we tell the same story over and
over and over again? The different
protagonists, but it's always the same
formula. It's somebody is trapped in an
ordinary world. They find the portal
and the portal becomes the call to
adventure. And they spend time in an
alternate universe and then somehow
they're able to live. very often they
return.
At the end of the adventure,
the toll booth disappears because it has
to go to the next kid who needs it, you
know? And so my question was always, why
why on earth would we tell the same
story over and over and over and over
again? It has the same format and it's
always a different context. And I came
to believe that this story is actually
this unkempt promise for most people
that their adult lives they don't find
these portals.
So for example, have you ever been to
Barcelona, Spain? No. There is a church
in Barcelona, Spain called La.
It is the most bizarre interior space
I've ever seen in my life. There is
nothing like the inside of this church
on this planet. And that is poor,
right? And so if you think about um
psychoactive chemicals, some of them are
super fine, but some of them are
important. And this concept of if you
look at a wall, how do you know that the
wall doesn't have a door? How do you
know that there's a panic room behind
the bookcase? If you just pull out the
right book.
We learn to stop looking for the portal.
And I think what I what I do differently
than other people is that I became
obsessed with exits.
That there are other worlds and they're
real. That this this mythology of the
looking glass and radical, the matrix is
metaphor for very real things.
That's really good.
That's really good and angry.
They're going to be very happy.
I think that's a great place to end it.
Uh,
this might be the end of the coronairus
series.
I'm confused
when I meet a lot of people.
And maybe that's what it is. Maybe
that's that's that's a way of saying it.
Uh
they're stuck like looking down.
And that's a metaphor, not
actually looking down, but they don't
see anything at all. They go through the
same
life
over and over again. I can see the meta
predictors just predicting the same
patterns over and over again.
And
you know, I may not believe in a lot of
more
childish
places to look, but
it's going to be hard to find.
It's It's not just going to show up.
You're going to have to look. You're
going to have to seek. And you're going
to have to seek so hard.
You may not find it. That doesn't really
matter. I talk a lot about the Joseph
Campbell story and the basic Joseph
Campbell story is that the the hero
sets off on a a journey, a grand
romantic adventure
and
the hero goes off in search of something
and many things happen along the way.
The hero usually doesn't find what they
thought they were looking for. And they
usually find that what they were looking
for was inside of them the whole time.
And that's
generally how I believe the adventures
go.
My terminal values in life are narrative
value.
Yeah.
So, uh,
choose your own Corona adventure
everybody.
Um,
and
I'll leave you with something I left two
episodes ago. The future hasn't been
written yet. Nobody's has. So, make it a
good one. Good night, everybody.
WEBVTT
Kind: captions
Language: en
schmxtzz: ayeee
schmxtzz: we live
archer723: Yo bro, good to seeeee you!
oakmrk: PogChamp LIVE
fuseteaseftali: hewy george
Toastie1: late stream PogChamp
masters8: yeee boi
meteorlake: hey george
awesomeo113: Yee yee
ankitc: yeeet
meteorlake: geo the living icon
benchai18: What Jorge
glitch3dout: Hello
schmxtzz: 30 days streaming everyday Pogchamp
jay_al97: good morinng
roystang: is this an ice chewing stream
benchai18: Pawgchamp
Jehhred: What gives George, I thought there wasn't going to be a stream today?!?!?!
wisamalrawi: first timer
logi6000: ayy a nother stream
imAidenr: @georgehotz hey man hows it going?
vrv_exe: Hah. Wasn’t expecting this. Perfect timing.
aiex42: wassup bro
benchai18: George. Subscriber for 4 months. Whatup son. Why do I like u so much
urhentom: how's everyone back home George?
OrlinTheMage: hey hottie!
benchai18: The moment the stream has 200-300 he’s gonna turn it up to 11
hexicity1: yo George, apart from being interested in it, how do you keep interested/focused on something you're working on, on the side? I seem to lose focus/motivation on things very quickly
rawrxp: hello
itsxaos: &lt;3
deva73: yo
benchai18: He gets especially obnoxious (in the best way) as the stream goes on
logi6000: how's everyones day
grenaderaven: did you see stephen wolframs corona stream? he did a lot of data analysis using mathematica
TheLastMrX: shame im lazy otherwise i would comment now :(
coolmacjr: coolmacjr subscribed with Twitch Prime.
cankunwang: Have you checked this paper? A SARS-CoV-2-Human Protein-Protein Interaction Map Reveals Drug Targets and Potential Drug-Repurposing
amo77777: hey🙂
benchai18: George’s fav sweater
not_Awful: thank you geo
Jaynevs: !gamble 100
logi6000: who does comma ai archive
benchai18: Ugh. There goes my evening.
lawric_: LUL
TheLastMrX: LUL
guapcollector: lern teh hacking
urhentom: he is an idiot
amo77777: 🚀
mirceau: He back.. My man is on a role!!
urhentom: we love to waste time with you
doctorgenus: i love u geohot keep tinkering
archer723: BAN him, Lol
doctorgenus: its tinkering
mirceau: Shit talking
logi6000: they are thinking of the bs Hollywood hacking
champ900: is comma paying you to do these streams
schmxtzz: finding exploits
cankunwang: trying finding 'meaning' for everything
guapcollector: hacking is collecting certs wym
roystang: hacking is infiltration the online mainframe and getting money
mirceau: And getting shit done
GabeDoesNotTalk: We’re hacking the Wirus!
benchai18: Don’t “you guys” us. That’s one retard... most of us ain’t that bad
Nefariousbtw: hacking is actually observing right?
slimetimewalks: Favorite snack ?
Jehhred: The point is to waste time!!!!!
popposbubbolo: rofl
Penguino138: Groceries are in the same place as yesterday hehe
l1ght5p33d: hack for win
Nefariousbtw: I think hes confusing hacking with cracking
OrlinTheMage: I love you!
omar3141: NP hard: hard to solve, easy to verify!
grenaderaven: in his defence you didnt hack your local university photo directory and create a competitive tinder like app...thats hAcKinG
mirceau: Hacking = critical thinking and considering your targets world view.
DecayingSkullz: Hi George
urhentom: why incognito?
doctorgenus: its like edison and the light bulb
byLeandroid: "hacking is just being able to think with an open mind" 😍
hexicity1: George if you were someone just at the basics of CS, what languages would you learn first and what steps would you take, with the hindsight and knowledge you have now?
logi6000: hacking is like math. you can tell if you've got the right answer and you can see how far off you are
hitsIikeagirl: hacking seems to be an applied art, like trading.
guapcollector: that good zine formatting
georgehotz: http://www.phrack.org/issues/7/3.html
RODNEYDIESEL: thanks boss man
zennydmt: hi do you use docker at all?
roystang: this stream got deep real quick
LocoLuka: is this data science?
logi6000: @roystang just as it should be
meteorlake: geo, i liked ur sxsw talk..
TheLastMrX: hacking is just about not being normal and dont do what ppl say to do... be yourself
archer723: I prefer shit talking than doing stuff, hacking will be less entertaining for sure. So any chance we can get rapping today instead?
AlwaysTilted_: a society that values you for SKILLS not affiliations
mirceau: it’s 04:05 a.m. here.
logi6000: @meteorlake the simulation one?
meteorlake: simulation theory is definitely interesting
yanhaoli: What’s up geo hogs
guapcollector: duckduckgo bro
itsxaos: reddit is absolute trash
swftdev: Geo being back is the silver lining of the plague &gt;.&lt;
mirceau: true
benchai18: This is By far the most serious I’ve ever seen George on Twitch
thuganalyst: Beautiful
logi6000: sim theory is one of my fav theories
neiliss: You are going back to my early days with that brings back memories, might reread them and some 2600 while I’m at it
DecayingSkullz: ooooffff
l1ght5p33d: Ecosia is alright sometimes but Capitalism rules all
champ900: George are you afraid for humanity
slArkBig: and there is r/China
glitch3dout: Dude reddit search sucks
7Locrian7: isn't that just based off the description of those subreddits?
128p_: r/memes is not completely crap.
glitch3dout: Why would you use reddit search
7Locrian7: just seems like an overly simplistic search
guapcollector: seems like its just based on frequency of mentions
cutza: their algorithms seem to be optimized for attention, not relevance
highxsnow_: maybe they filter by where most ppl post shit about corona like corona memes
swftdev: everyone know reddit search is a meme, should have started on google.
Penguino138: Reddit sends out spammy articles to my email all the time, so annoying
imafungi53: memes is how society deals with tragedy
mirceau: We trashed Google / Twitter / Reddit / Youtube results ! Look at youtube trending once.. !
benchai18: Isn’t that indicative of how large groups of people are kinda.... dumb? Or simple? The algorithm is just adapting to accommodate the behavior of the masses no???
cankunwang: Maybe their algorithm based on what ppl likely goes to after searching covid-19
archer723: All I want is you stream everyday no matter whatever you want to stream LoL
l1ght5p33d: reddit does have probably the leetest mod algorithm of all
kornez: @georgehotz maybe try to escape dash LUL
SparksCx: low members?
guapcollector: sort for recent communities
nozpheratu: It's being hidden maybe?
bankzed: the search results are returned by frequency and by number of views
mirceau: The results of Google is like: The kings mirrors his people.
sp3ed_xx: have you listened to eminem godzilla song?
benchai18: But human subjective meaning isn’t discerned by the algorithm isn’t it?
itsxaos: agree
mirceau: True
meteorlake: Healthy people with no underlying conditions are in the hospital for 10 days. You live but its a nasty virus either way. Whats really sad is whats happening to every bodies grandparents, stay safe ppl
logi6000: could this be what could be new in a decentralized internet?
Retromankind: Agree
SparksCx: there
SparksCx: I SAW IT
mashafique: COVID19 is a meme LUL
benchai18: Fair enough
pz3300: What’s happenin George?
solitarynative: searching on reddit is usually trash
nozpheratu: Is google a better search engine for finding reddits then reddit itself?
Plurmorant: china_flu best subreddit Kreygasm
LocoLuka: the internet is made to make it easier for new ppl and ppl that dont use the internet frequently
cankunwang: True. I can only receive good information by following professors in twitter
OlympusDev: SCROLL UP
Santiago_LHC: It's valuing popularity over some higher criteria of relevance
xa1ry: try "covid19" (in quotes) or something?
hexicity1: George if you were someone just at the basics of CS, what languages would you learn first and what steps would you take, with the hindsight and knowledge you have now?
benchai18: I just imagined it’s predictive. The algorithm knows what most people do. Most people are not power users
mirceau: I deleted my Reddit 4 months ago due to this shit !
bankzed: completely agree, the internet is far from the academic endeavor it was once
Digital_donger: covid19 is a bad meme
128p_: ^
nitthewiz: Tru
SparksCx: lol
kornez: truuue, its trash
hitsIikeagirl: 100
fantadmin: add ``` site:reddit.com`
Santiago_LHC: lol
Lathendros: @georgehotz what do u have against business insider
zennydmt: do u read scidaily?
highxsnow_: same
l1ght5p33d: The search results are super dynamic, can change instantly
guinness84: respect
guapcollector: duckduckgo does better
LaheyFPS: truueee
cankunwang: Can I block website from google?
itsxaos: https://duckduckgo.com/?t=ffab&amp;q=covid 19 positive reddit&amp;ia=web
nozpheratu: try this "covid 19 positie site:reddit.com"
itsxaos: ddg finds it sorta :)
Santiago_LHC: I want all my search results to be the bill gates blog
Plurmorant: wow
imafungi53: whats wrong with business insider
itsxaos: :D
Penguino138: Always use duckduck go
pz3300: First page of google is a shit show
Plurmorant: its not bought
hexicity1: PogChamp duckduckgo
barkazzaz: cause google still wants to prioritize based on mentions
nozpheratu: You can search google w/ a site: prefix
edu4594: google sucks
mohammed1996mizab: Pog
bankzed: yeah duckduckgo is much better
Penguino138: You can easily change your phone and computer to default to DuckDuckGo
ahahahaitslit: when did this stream start?
cutza: pay the moneys
benchai18: Most people are subscribed to covid, funny, memes, and The Bachelor. If these algorithms learn by patterns of use, and most users are not powerusers (or they’re simple people), don’t u think the algorithm will adapt accordingly ?
Santiago_LHC: @nozpheratu That's not the point
meteorlake: What's your take on COVID-19 @georgehotz
ackxhpaez: at least with bing you can get points you can use for free burritos
itsxaos: hey what do you think of this urbit thing? seems kinda goofy to me
l1ght5p33d: allocate half meta data stream always
slArkBig: It's because these companies hire mediocre software engineers
logi6000: ight time to go make millions of George's idea
ph4tal_: what'd I just run into
RODNEYDIESEL: okay can you give me funding
wholesome_pepe: we can call it altavista?
glitch3dout: Google is good at some stuff. DDG is good at some stuff
zennydmt: why do you think Google is a failed company?
nitthewiz: Agreed
guapcollector: nah it's because of monetisation not lack of skill
mirceau: Really difficult
glitch3dout: Comeback of Yahoo
zennydmt: Why dont you like Google?
ryboii1: why is google a failed organization?
pz3300: I don’t trust duck duck go. When you type in bitchu.... it doesn’t even predict bitchute. Suspect
AlwaysTilted_: in what way would you differentiate this search engine from google's?
cankunwang: He said not to work in Google
omar3141: lol wat
solitarynative: vc funded crypto is almost always trash
marzmike: Google will buy you out of you're successful
nozpheratu: Santiago_LHC but it is, no search sngine will ever give you exactly what you need unless you tailor your query a bit, really we just need more tooling to narrow down our searches
l1ght5p33d: another Linux !
itsxaos: it seems like they are being deliberately obtuse about what they do
l1ght5p33d: moarrr linuxxxx
champ900: it sounds like you dislike Google because they're mainstream
doctorgenus: i just scheduled an interview with google. should i withdraw and start my own company?
ryboii1: why is google a failed organization?
logi6000: @doctorgenus this highly depends on your situation
solitarynative: a crypto is only as good as the underlying protocol - doesn't matter how many features you build on top
omar3141: b/c they haven't innovated in like 10 years
hexicity1: how do i start to become as smart as you George
barkazzaz: @georgehotz what are we doing today? ever tried getting into NLP?
l1ght5p33d: what is this
zennydmt: why not work for Google if you are talented?
l1ght5p33d: syntax trees?
Plurmorant: LUL
nozpheratu: doctorgenus You can build you own web crawler easily to act as a search enginge, good luck affording the infrastructure as a startup lol
logi6000: @doctorgenus so what's your startup?
omar3141: @zennydmt b/c that's where you go die
meteorlake: Google is a shitty company
Plurmorant: google's success rate is weak
guapcollector: blind lmao
bankzed: interesting is one way of putting it, he excused nationalism and genocide...
itsxaos: have you looked at their programming language? absolutely insane
thecoder15: @georgehotz teambling is a dumpster fire
elephantpandas: monkaW
zennydmt: I dont like money
zennydmt: I like to learn
elephantpandas: danX FBBlock TheIlluminati
omar3141: but it isn't b/c it's RSUs on publicly traded stock
guapcollector: leetcode harder
WiseSwift: I'm not a whore
slArkBig: money is fake? but my money is tight
zennydmt: what company is best for learning?
ph4tal_: when are you going on Joe rogan
AlwaysTilted_: work at google and write a backdoor in something Kappa
omar3141: if anything the money is less fake than it is at any private company
brittonx2: Cheer100
zennydmt: can an introvert start his own company?
mirceau: true.. the culture
itsxaos: @ph4tal_ hes said its not a good idea because its too big
omar3141: "any fool can learn from his own experience"
champ900: can you explain what is teamblind
astrailz: George "Start your own company" hotz
mirceau: Start up, yes!
hexicity1: how do you keep interested/focused on something you're working on, on the side? I seem to lose focus/motivation on things very quickly
wholesome_pepe: best way to learn is in research writing journals
elephantpandas: justke10Virus
SpaceGhost8: virus memes FeelsGoodMan
mirceau: True
l1ght5p33d: Winggssss
Penguino138: Coffee or yerba mate definitely required tonight
popposbubbolo: That's also the most expensive way to learn
Juankinator: best way to learn is to watch vox videos Kappa
mirceau: My man is back !!!!!
masters8: Correct!
ankitc: how to be better programmer
ahahahaitslit: codons n shit
itsxaos: RNA
barkazzaz: why does Geo say because bea-coss?
ackxhpaez: Are we on to COVID-21 already?
slArkBig: how much does your rent cost
WiseSwift: Hardware Hack Kreygasm
CompestLive: Hello!
cellophane11578: are we going to reverse engineer the covid strains?
mirceau: @slarkbig we don’t talk about money here, it’s rude to ask.
Santiago_LHC: amino acids
xmalware60: big rent
itsxaos: @georgehotz is the markdown public?
martaway: Isnt this lockdown unconstitutional
pz3300: Why you need supplements George, you can afford to eat great?
Jehhred: Isn't vitamin C good for cold?
martaway: You cant arrest ppl that havent done crime...
dzid26: This video explains nicely why zinc can work https://youtu.be/U7F1cnWup9M?t=102
Roundlay: Zinc lozenges seem to be effective https://academic.oup.com/jac/article/20/6/893/692279
Scydra_: @georgehotz and chat, whats the best way to ship out your PC interstate( CA to OREGON)
BernardoFire: "coronavirus party" kkkk
Scydra_: monitor, CPU
cellophane11578: zinc and garlic cannot boost immunity i heard, only balance it out so it doesnt worsen
Roundlay: (Not covid)
martaway: I wish streamers would stop normalizing illegal house arrest
pz3300: Seafood and lamb chops are good for zinc
mirceau: This year is different, because I got a Vitamine D shot from my GE to boost my immune!
theonlymonkas: yoyoyoyyo hello geo!
l1ght5p33d: Similarity measured in infection rate? depends on the Spike to penetrate membrane probably
SolarBerry: another thing to look into is vitamin D, it has been shown to reduce chest infections and the severity
mirceau: The past years I didn’t get a Vit D shot from my GP, and i was getting flu from left to right.
pz3300: Dry your mushrooms in the sun. This increases vit D ten fold and you can store them dry through the winter
martaway: Doent zinc need vitamin k
martaway: How do u increase vitamin D...
Ayyyy420Lmao: dont think the vit d form found in mushrooms is bioactive in humans
pz3300: Sun
cellophane11578: sunlight/supplements
IceStationZebraAssociates: Bro even if you can find the right antibody to make the vaccine, do you know how freaking hard it is to synthesize it?
martaway: Sunlight doesnt create vitamin D
martaway: Your skin does
jimmyadaro: Sup boy
IceStationZebraAssociates: it would be unfeasible to make it in mass quantities
pz3300: It’s the same vitamin d produced on your skin
ahahahaitslit: i don't think zinc itself is an ion?
dzid26: chloroquine
Santiago_LHC: @IceStationZebraAssociates I think he is well, aware.
benchai18: @chat guys, what’s on the left in the terminal? Did he write all that or did he download it but just commenting on it????????
ahahahaitslit: lmao
TheZarkxs: the most disgusting thing about this corona thing, is that it has been in other peoples bodies CrreamAwk
theonlymonkas: it think it is
itsxaos: so the virus itself is RNA and RdRP duplicates RNA?
theonlymonkas: it has some charge
Ayyyy420Lmao: i recall it has an exatra hydroxy or methyl in some place
11plus4thinking: salmon15Hmm go on
hexicity1: how do you keep interested/focused on something you're working on? I seem to lose focus/motivation on things very quickly
ahahahaitslit: but you can only become an ion after gaining or losing electrons no?
pz3300: Uv hits the chemical on your skin and synthesis
ahahahaitslit: pretty rusty on this so idk
Santiago_LHC: @benchai18 https://github.com/geohot/corona
martaway: Yeah but it doesnt work that way on mushrooms
jimmyadaro: @benchai18 I think those are notes
theonlymonkas: positive ions
thecoder15: work on stuff that truly interests you @hexicity1
PiroFloydian: @georgehotz why not use Google scholar?
braininavatt: "keen"
mashafique: @ahahahaitslit yeah an ion is just a charged molecule or atom basically
benchai18: @santiago_lhc @jimmyadaro Thank u!
squiggly_nibba: He's an idiot
TheZarkxs: hey look its orange man
hexicity1: @thecoder15 i feel like what i'm working on, does interest me, or atleast, i long to be interested in it
omar3141: lol chloroquine can't cure stupidity
ahahahaitslit: ah ok
ahahahaitslit: tru
doctorgenus: they use Chloroquine to clean aquarium
martaway: I like how some ppl heard some random chemical and immediately ran to the fish store to down aquarium cleaner
nremind: LUL
mweldo: yep
pz3300: @Marta way google it dude
SpaceGhost8: LUL
mirceau: My dad did his PhD on Chloroquine for Malaria/HIV
TheZarkxs: wut
Vindalis: LUL
guapcollector: Sad story
ideology_sniffing_raccoon: LUL
leftyytwo: journalism is a legit field 4Head
coolmacjr: hes the goat fr
11plus4thinking: ??? WHAT
squiggly_nibba: It's a parasite remover for fish
itsxaos: welp bad call there
nozpheratu: kek
memphisFPS: LUL
grey_street: wtf
Vindalis: hahahaha
theonlymonkas: LUL
ackxhpaez: Yeah I'm guessing that fish tank cleaner isn't exactly the same chemical
Santiago_LHC: So... less fishtank cleaner then?
peter35_: journos at it again..
Ayyyy420Lmao: reading cnn lmao
l1ght5p33d: lmfaorofl
Vindalis: fake news CNN
cankunwang: Sad
jimmyadaro: Koi fish??
Coolio1232: why do u prefer to use a mac than windows?
doctorgenus: I think the dosage he took was too high
martaway: Then the media was like “SEE? It desnt work!”
roystang: cnn is trash
entangledbeing: Woah... tonic water x10
benchai18: Whoa. Fucking journo twats
theonlymonkas: so the pill in itself isnt dangerous?
mirceau: @georgehotz Look at Chloroquine as used in countering Malaria and HIV
itsxaos: "The corporate media is the enemy of the people"
Nussinov: never a good idea to self medicate
ideology_sniffing_raccoon: monkaW
ankitc: @hexicity1 i feel the same
theonlymonkas: or its kind of a reaction?
pz3300: People been sun dry mushrooms for millennia. It’s the same chemical that’s on your skin
DrewHintz: what if covid-19 is the way that the simulation admins are reducing our compute costs?
squiggly_nibba: It can also cause blindness
LocoLuka: would this classify as bioinformatics?
superduperepic: @georgehotz what was for dinner?
360Plato: he had a cup
Nussinov: Google Forsythia I heard that helped for a pandemic once Kappa
Santiago_LHC: "I'm not a doctor" is how I start all my sentences this year.
Vindalis: whats in fish tank cleaner? LUL
doctorgenus: he couldn't get a prescription lol
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
leftyytwo: what kinda drugs to you take
nremind: if it doesn't kill koi, then he must've drank a lot of it
Rydberggg: every dugs has side effect
xmalware60: Pr Raoult
martaway: Then the media blames it on trump that someone drank fish cleaner
hexicity1: @ankitc any luck dealing with it? I really wish i could sit there and work on stuff for hours
KNG_ftw: That's the news we got in Spain too. Someone killed for following Trumps recommendations... So sad the state of journalism
thrashtazs: hes an imbecile
highxsnow_: flakka
TheZarkxs: isntreal
jimmyadaro: isreal
benchai18: So did they mention trump just for drama?? Like why did those cunts mention him
jimmyadaro: lmao
mirceau: Look at Chloroquine as used in countering Malaria and HIV
logi6000: the media is just fucked up
xmalware60: proofs of hydroxycloroquine effects are not clearly identified for the new coronavirus
RODNEYDIESEL: yo bro i got a fart. you got discord? i want you to hear it
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
Rydberggg: the french is raoult didier
doctorgenus: seems like doctors are guessing
fantadmin: @georgehotz whats the difference between chloroquine and hydroxychloroquine ?
martaway: They keep trying to link chloroquine to trump when other countries started using it WEEKS before trump mentioned it
mirceau: My dad did his PhD on Chloroquine for Malaria
martaway: Its like the media wants to keep this pandemic going
128p_: @RODNEYDIESEL I hacked your pc and heard it, bro it's hella lame.
meteorlake: deep state
pz3300: It’s a virus FFS. Drink plenty fluid and go to bed for a couple days
squiggly_nibba: There's studies sshowing that it works that's why he. mentioned it
Ayyyy420Lmao: vitamin d from mushroms is d2 and not d3 which is the one produced in yhour skin, theres doubts about its biological activity in animals
shivoshifter: @georgehotz are u really believing in coronavirus ? the stats show that a normal flu is way more deadly
cogforkd: hello George!
dunehazard: @georgehotz https://twitter.com/yaletung day by day (1-16) account of symptoms from a doctor in spain
itsxaos: @hexicity1 i struggle with this too. i think its like any other skill: you have to practice it
masters8: "inhibitor"
itsxaos: just try and try again
360Plato: so thats stops the replication right
cogforkd: long time no see
logi6000: @shivoshifter no it's not
dr_set: !uptime
jimmyadaro: Hell yeah, oral
imafungi53: youre talking about harvoni
BubbatheVTOG: BubbatheVTOG subscribed with Twitch Prime.
128p_: looks like a hard to swallow pill
newlastaccount: covid-19 first human transmition found https://www.youtube.com/watch?v=L2c9q6zVp-I
martaway: Pz3300 just cause its virus doesnt mean anything. HIV is just a virus. Rabies is just a virus
jimmyadaro: @128p_ lmaaoooo
mashafique: @fantadmin the only difference hta i can see from the moleuclar strucutre is the OH
thrashtazs: did you get a minor in biology?
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
11plus4thinking: @newlastaccount thats fucking disgusting wtf
ankitc: @hexicity1 i try to reorganize my self and work on something. I lack focus
guapcollector: doesn't lysine do this kind of thing too
IceStationZebraAssociates: yo the virus has RNA which codes to make it's own transcriptase. that's called viral transcriptase
squiggly_nibba: @newlastaccount nah that is cooked
jimmyadaro: @thrashtazs He's good at googling
mashafique: @fantadmin it has the hydroxy group
11plus4thinking: @newlastaccount is that a fucking cat??
crispyvideo: G
shivoshifter: @logi6000 https://www.cdc.gov/flu/about/burden/preliminary-in-season-estimates.htm
RODNEYDIESEL: thrashtazs i got a masters
Vindalis: @georgehotz Hawaii 5-0 star Daniel Dae Kim had this "He explained that his doctor gave him a "drug cocktail", consisted of the antiviral medicine TamiFlu, the antibiotic Azithromycin, a Glycopyrrolate inhaler, and the anti-malarial drug Hydroxychloroquine"
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
fantadmin: hence the hydroxy but i wonder why it it has similar/diffrent effects @mashafique
masters8: Some are toxic. They get incorporated into human DNA/RNA
martaway: Thats alot of freaking drugs, he musta been on his death bed or something
crispyvideo: Why is every nerd (programmer / rich car maker et) now a biologist all of a sudden?
TheZarkxs: dna sucks, rna for life
jimmyadaro: I just noticed he's using Chromium
RODNEYDIESEL: georgehotz add some pizza grease to the list
jimmyadaro: @crispyvideo We're curious af
Nussinov: @crispyvideo curious
bloodstrive: wait isnt this pt4
entangledbeing: Lol
crispyvideo: Maybe listen to someone who actually knows something? )
mashafique: @fantadmin Functional groups make a difference in how molecules work and how they interact
jimmyadaro: Yes it is
l1ght5p33d: This is high school bio stuff. were on quarantine what else to do
doctorgenus: what are your thoughts on blood transfusion? the people who already recovered has antibodies in their blood
martaway: Why would they give him an antibiotic for a virus?
thecoder15: @georgehotz also has shown to have good effects on patients with MERS resveratrol
Ayyyy420Lmao: dude you can see the purine analog in the molecule wtf
PiroFloydian: adenosine is the sleep chemical I believe
jimmyadaro: @martaway Wtf who did that?
DatGuyToby: the anti biotic has anti inflamatory properties
martaway: Idk somene said they gave azithromycin
jimmyadaro: Wtf LUL
bloodstrive: blood transfisuion sounds interesting
crispyvideo: You’ll read. “Person takes geohot advice and takes xyz” lol
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
hordead: what is the goal of this project?
sinceretear: what is he building
sinceretear: !project
crispyvideo: Waste time?
jimmyadaro: Rever-engineering coronavirus?
bloodstrive: its just to learn
jimmyadaro: reverse*
128p_: ^
martaway: Play the protein folding game
128p_: I guess that's the idea
doctorgenus: during the spanish flu, blood transfusion was used and 50% of critical patients recovered. Maybe give it to them before they become critical
Mint2bSpiced: zinc can be absorbed by the stomach and intestines and then move to your bloodstream, where it can deactivate some viruses, but new virus production occurs inside each cell in the cytoplasm, and little zinc normally passes through the cellular membrane. Chloroquine and other quinine compounds "punch holes" in the cellular membrane and allow Zn   ions to flood through. Once inside the cytoplasm Zn   halts viral replication.
pz3300: How can it be up in the air if d-2 is bioavailable or not. How hard is this shit?
cankunwang: I only know doctors from wuhan said Remdesivir is very very useful
jimmyadaro: Spanish flu kll a lot of people lmao
128p_: Btw, does anyone know what is this cool font @georgehotz is using on vim?
iteeo: hi
theonlymonkas: github
jimmyadaro: @128p_ Any sans-serif will do it I think
Ayyyy420Lmao: how strong is the evidence for that zinc theory? sometimes they just throw this around because they can texplain the observed effects and just put together whatever
nammedit: just joined the stream, what is he trying to do?
TheZarkxs: more than 400k infected and 20k dead, the majority elder people. this virus is a joke lads, lets discuss about GoT ending
itsxaos: https://en.wikipedia.org/wiki/Ionophore
jimmyadaro: serif*
jimmyadaro: i meant
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
Mint2bSpiced: Zinc has no effect on the cells without ionization (specifically zinc entering the cell to blocking an RNA that's needed by the virus to replicate).
crispyvideo: Imagine Elon musk did a live stream like this? His dumb ass would break the internet
Nussinov: LUL
Mariosavitch: hello mr hotz
Ayyyy420Lmao: oyve
highxsnow_: lol
Rydberggg: he wants to code what ?
ideology_sniffing_raccoon: LULW
pz3300: Funny how Iran is getting it bad but it’s two noisy neighbours are not?
Ayyyy420Lmao: oyvey
guinness84: lmao
jimmyadaro: @crispyvideo At least Twitch lol
meteorlake: LOL
thecoder15: @crispyvideo i doubt that
cankunwang: lol
hordead: LUL
wholesome_pepe: KKomrade
ideology_sniffing_raccoon: WUT
jimmyadaro: wtf who is dat
opus_000: can Elon code ?
bloodstrive: have we figured out of china is giving us all their numbers since thy apperently have 'controlled' it.
TheZarkxs: doctor and rasputin
DecayingSkullz: There should be a way to filter out certain google website genres
jimmyadaro: @opus_000 Sure
wholesome_pepe: LUL
crispyvideo: His followers are worse then covid9
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
theonlymonkas: Remdesivir
128p_: @jimmyadaro thanks
crispyvideo: The Elon cult is strong
jimmyadaro: @128p_ Np
crispyvideo: And yes he can code
thecoder15: @bloodstrive I don't even think even china knows their own number, they were welding people into apartment buildings
FurikuriYugi: you are awesome!!
pz3300: He dances like a mechanical boiler timer
Nussinov: @crispyvideo are you okay man? LUL
dunehazard: @georgehotz https://twitter.com/yaletung day by day (1-16) account of symptoms from a doctor in spain
Mariosavitch: hello mr hotz
martaway: The warm weather will clear this virus up, my prediction
grenaderaven: which text editor do u use
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
martaway: Global warming will stop Corona
l1ght5p33d: we want Zinc sims on the GPUs
ideology_sniffing_raccoon: TheIlluminati
theonlymonkas: @martaway NO
bankzed: he uses vim
imafungi53: are u a part time pharmacist geo
DecayingSkullz: @grenaderaven he uses Vim
wholesome_pepe: what is moderna working on? anyone patent troll them yet?
pz3300: No more bat wing soup
theonlymonkas: LUL
PiroFloydian: @georgehotz vietnam
doctorgenus: @georgehotz can I breakdance on your floor?
martaway: We arent seeing exponential spread as predicted. It seems to be winding down
logi6000: @doctorgenus wtf
itsxaos: well chinas history gives reason to doubt them but its certainly plausible
pz3300: Ramping up in spain
nremind: china and korea value personal sacrifice for the public good, the USA... doesn't
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
martaway: Spain has cold weather rn
thecoder15: @georgehotz zinc, resveratrol, and melatonin have been used in tandem against other sars with good results
almonte550: yey!
Ayyyy420Lmao: parenthesis in multiplication/division lmao
pz3300: It’s because of all that check kissing in italy
almonte550: I was waiting for this!
Krakken_TM: Also note that these numbers also biased on the severe cases.
logi6000: George when did you say we should be at 1 mil yesterday
mirceau: Singapore is now regretting its strong counter measurements.. As they see other countries are giving up on their counter measures to this virus.
cellophane11578: spoiler alert guys,the dead ones will turn into zombies
l1ght5p33d: It's to biased to reporting policy right now
syzo__: yo yo yoo
jimmyadaro: @martaway De qué parte de España eres?
Santiago_LHC: @jimmyadaro Stop spamming the question. He might, he might not.
xmalware60: If the quarantine stops, cases are coming again so ..
entangledbeing: How do testing numbers play into whether the data is trustworthy or not?
jimmyadaro: @Santiago_LHC idgaf
mirceau: The Spanish Flue was how much.. 500K
doctorgenus: @logi6000 in two weeks right?
128p_: @cellophane11578 I had a nightmare this happened, thanks for more nightmare fuel
logi6000: wasn't it 2 weeks
mikenachos: 2 weeks
Plurmorant: 1 mill in a week
DecayingSkullz: you said two weeks for a mil, four weeks for 100 mil from now
logi6000: @doctorgenus what I thought too
ooMariaoo: !uptime
zennydmt: isNYC bad
m00chan: when does lockdown end?
ziggyzergling: Nice layman explanation of the Chloroquine &amp; Zinc paper George just showed: https://youtu.be/U7F1cnWup9M?t=104
almonte550: Before this month ends we will hit a million
martaway: Warm weather is the best immune system boost
almonte550: Mark my words!
nomorequity: George, do you have biology/chemistry background?
128p_: Realistic @almonte550
doctorgenus: @logi6000 in 4 weeks, 100mil
cellophane11578: @128p_ its probably the twd and zombieland u watched =p
TheZarkxs: lets go spain, you can get those 100k infected!
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
Mariosavitch: this will go away like all of the yearly flus and everyone will forget about it
martaway: If we get warm weather soon (ty global warming) this virus will be history
Plurmorant: let's bet PogChamp
tsAllySparkles: ooh more coronavirus streams
imafungi53: is the impact on the economy worth saving boomers
theonlymonkas: PogChamp
tsAllySparkles: check out keplar.gl
logi6000: @doctorgenus that's when we start getting out a bug out bags ready
Mariosavitch: yes it will
theonlymonkas: V3
mirceau: How much does the incubation play a role in the speed of the enforcement loop?
Ayyyy420Lmao: augur works on browser now? it had some awful executable in the beginig
mirceau: True
tsAllySparkles: spelled that wrong lol https://kepler.gl/
wholesome_pepe: not all ACE2's are the same. there may be polymorphisms involved
jimmyadaro: @mirceau Not much if you're isolated
doctorgenus: @logi6000 that's when @georgehotz says we need the M16s
TheZarkxs: LUL
PiroFloydian: @georgehotz Vietnam is fighting it well
7Locrian7: monkaS
Krakken_TM: facts
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
brittonx2: definitely
Mariosavitch: 2-weeks of food.. for government collapse..
Fantasma56: monkaS
SpaceGhost8: like 2 weeks of food will help in that case
logi6000: George can't remember did you get to ride on that jetski like Jay z yet
cankunwang: buy guns ?
mirceau: lol
Krakken_TM: but wouldnt help you
Krakken_TM: lmao
dzid26: 0.1% is like 0%
pz3300: Fear of fear mongering
dr_set: Who made that site? Are they scared of percentages?
l1ght5p33d: China is fineee
Krakken_TM: guns n food production
thrashtazs: weapons just cause more of a problem
jimmyadaro: @dzid26 No, it's not
360Plato: one handgun
TheZarkxs: what if we shoot corona? i mean the infected, just like north korea
128p_: Political leaders are showing their real selves on this one...
Plurmorant: guns and a garden are all you need
nozpheratu: Famous last words
mirceau: I hate guns
martaway: Well people have been claiming exponential spread for weeks, we arent seeing it
mikenachos: dzid26 you need a math lesson bud
dunehazard: @georgehotz https://twitter.com/yaletung day by day (1-16) account of symptoms from a doctor in spain
guapcollector: buy bow and arrow
yungdeli_: off topic is fun
l1ght5p33d: look at T=0
hordead: so no partying for the rest of the year?
doctorgenus: I bought tasers, the prices has been going up exponentially
pz3300: Help you steal food
FurikuriYugi: "Come on let's get down with the sickness"
PiroFloydian: @georgehotz Vietnam
mirceau: The Mind is the best Gun
Mariosavitch: bit connnectttttttt
SpaceGhost8: total societal collapse LUL
logi6000: remember the Jay z on jetski
tsAllySparkles: any news on HKG ? there's lots waiting for a harness
ahahahaitslit: listen to the portal eric weinstein
Jewishrambo: I'm worried BibleThump
martaway: Even italy is not exponential spread
thecoder15: @martaway what do the graphs look like to you...?linear
mirceau: Nooooooo
Ayyyy420Lmao: do you cunnypost on /tv/?
jimmyadaro: LUL
LaviBF: Look up the Israeli engineer that tracks infectious diseases
jimmyadaro: @georgehotz Will you do some Q&amp;A today as well?
newlastaccount: covid-19 first human transmission found https://www.youtube.com/watch?v=L2c9q6zVp-I
Jewishrambo: in worried BibleThump and I'm in Canada
mirceau: no politics or media
tsAllySparkles: ah you good
crispyvideo: If you have no gun and food? And the guy or girl with the gun wants the food? You’re SOL
Hawklite: how long do you think social distancing should be in effect?
crispyvideo: Ergo guns win
ScrubLifeChoseMe: nah smart move
jimmyadaro: &lt;3
imafungi53: is the impact on the economy worth saving the boomers
theonlymonkas: its going to ramp up
PiroFloydian: they're doing good job fighting covid @georgehotz Vietnam is
cutza: what's with the toilet paper shortages?
TheZarkxs: vietnam, 1963, a young charlie sheen confronts a vietcong patrol squad while high on drugs
CompestLive: *No food*
LaviBF: He says once 50% of population is infected Ro drops below 1
Mariosavitch: nothing
Jewishrambo: getting the pneumonia
jimmyadaro: Do you own legal guns??
Krakken_TM: upcoming depression
martaway: Charlie sheen must be scared af
cellophane11578: omg dont click that link above
SparksCx: i am not
guinness84: my dick size
gadean: collapse
dorkmo: worried about my momma
Ayyyy420Lmao: charlie sheen wont get it he has tiger blood
logi6000: Tom hanks
Nussinov: I'm worried that my grandparents will die
ahahahaitslit: healthcare system being overtaxed
meteorlake: my grandparents
Penguino138: Worries about a second resurgence after quarantine
cellophane11578: its not a rick roll but ffs
Pedroso: Economy
roystang: another great depression
s0rrz: that i got fired and i dont know what im gonna do when the lockdown ends
tsAllySparkles: tons of people losing housing
rstk1: economy collapsing
Mariosavitch: dollar collapse and we cant import any food
m00chan: 90% sure I already had the corona
Plurmorant: the end of capitalism PogChamp
Ayyyy420Lmao: im woried I can't tell the bottom of the bear market
bloodstrive: im scard my rolling papers wont be enought for my poop
Hawklite: i'm worried social distancing rules will be prematurely lifted and we won't actually flatten the curve
meteorlake: its a nasty virus either way
martaway: Tom hanks had body aches for a few days, hes fine
nremind: i'm worried that dumbasses will purposefully infect everyone
itsxaos: im worried my elderly relatives will get it
KrauserW: grandma
l1ght5p33d: Too many different linux distros
peter35_: my mom getting sick
pz3300: In the U.K. there giving the police power to arrest people who they suspect have corona
CompestLive: worried about no foods
imafungi53: is the impact on the economy worth saving the boomers
swftdev: I'm worried about the breakdown of our next election &gt;.&gt;
logi6000: Bitcoin price. old people
jimmyadaro: @Plurmorant No way
champ900: I'm worried about the heinekenvirus
PiroFloydian: @georgehotz Vietnam is fighting the virus well
mirceau: WORRIED ABOUT MY GEO
snorting_milk: sup guys!
opus_000: job
Krakken_TM: upcoming depression.
ahahahaitslit: healthcare system getting fucked up
almonte550: I'm worried that we can get reinfected after being infected once
doctorgenus: worry that grandmas are being sacrificed for the dow jones
leftyytwo: i'm worried about lp[l[lpp[lp[lp[[pl
Mariosavitch: im worried about hotz
Penguino138: Worried about when I can smoke my weeds again
gadean: remember Katrina?
fantadmin: worried about restaurants stop delivering
ScrubLifeChoseMe: jesus
chronicle19511951: 134 cases of corona here in Viet Nam
ar2zee: to laid off
cutza: economic collapse
mikenachos: the real threat are the ignorant
martaway: Everyone worried about boomers now
raystriker98: checkout India's shit show by their PM
360Plato: cheap real estate and lower social securiuty costs
dzid26: Social separation for next few years....
jimmyadaro: I'm not worried at all, f*** this planet
mirceau: Worried about my EGO **
tsAllySparkles: all the blue collar jobs are gone lol this is just gonna make the rich richer
theonlymonkas: its going to ramp up after the quarantine
pz3300: Worried about my weed supply
brittonx2: yep!
cellophane11578: ^
Jewishrambo: the high hospitalization rate scares me
TheZarkxs: be honest, are you natty or you taking roids?
logi6000: @pz3300 everyone right now
Br4nnon: Unless it mutates we build immunity?
ahh_me: My roommate doesnt have enough money to pay his rent so now we have to deal with that
edu4594: not worry
memphisFPS: everyone does @pz3300
DecayingSkullz: Would you step on Stewart Little for 18 billion dollars?
edu4594: now worried
edu4594: not worried
icekrieg: will we ever be able to run homebrew on coronavirus firmware?
bankzed: COVID-19 doesn't mutate as fast as the rhinovirus
logi6000: @decayingskullz no
pz3300: I’m smokin solid dude TF
jimmyadaro: @ahh_me F*** that guy
wholesome_pepe: natural selection is scary
SpaceGhost8: you're good until the fall 4Head
theonlymonkas: @DecayingSkullz NO
leftyytwo: have u seen any of the stuff stephen wolfram is streaming
ImJ4Gu4R: where we at
ahahahaitslit: i saw a bit
gabo_sk: LuvPeekR LuvPeekR LuvPeekR
guinness84: worried san diego will shut down the weed dispensaries
benchai18: Desperate people looting and stealing.
martaway: This thing has literally gone viral
TheZarkxs: rhinovirus sounds like a spiderman enemy boss
tsAllySparkles: i was thinking of mapping the virus not based off confirmed cases but rather confirmed deaths per capita
peter35_: worried about the reports of reduced lung function and possible reproductive harm afer recovery
entangledbeing: Not enough ventilators and hospital beds
mirceau: So Incubation of 14 dats
Mint2bSpiced: Seems like it's standard of care we need to improve, but new drugs may not help patients who have advanced symptoms; and, obviously, does not prevent infection. Therefore it may not stop us from imposing the preventative measures (quarantine, travel restrictions, the like) which are causing all the economic catastrophe. Still, seems like it would push a bit of a positive spin on things rather than allowing the economic free-fall we've witnessed.
mirceau: days*
jimmyadaro: Are AIDs more dangerous than COVID??
Jewishrambo: apparently its 1/3rd of hospitalizations require intubation while the others just need oxygen... like wtf
itsxaos: @georgehotz the wikipedia link was on the right side at the first google
dorkmo: uni1 unicornvirus
mikenachos: 7200-8500 bases
C0deCane: some other news article today or yesterday talking about Hanta virus killing some dude in China
Krakken_TM: @jimmyadaro yeah bro
Krakken_TM: lmao
benchai18: I don’t wanna have to grab the shotgun. Fuck that. I don’t wanna put holes in my walls
jimmyadaro: @Krakken_TM U sure?
kuzan8: @georgehotz did u listen about hantavirus in CHina?
ahahahaitslit: the main issues are the economy which is already fucked, as well as the healthcare system being overwhelmed
Krakken_TM: and aids is the fina lstage desease
Krakken_TM: hiv is the virus
icekrieg: when are you releasing corona jailbreak?
thrashtazs: I'm worried about not having sex for a long period of time
theonlymonkas: so for you the quarantine needs to extend until we find a cure?
jimmyadaro: Is HIV more dangerous than COVID??
martaway: Hanta virus.. now u know MSM is getting desperate when they try and mix in a completely unrelated virus
Nussinov: not necessarily complicated. wheat has like 30x as long of a dna sequence to human and is much less complicated
peter35_: worried about the reports of reduced lung function and possible reproductive harm after recovery
ackxhpaez: @thrashtazs you get used to it
tsAllySparkles: @jimmyadaro AIDS is definitely more dangerous but HIV probably isn't simply because it's hard to spread it
bloodstrive: lol
Ayyyy420Lmao: having sex? LUL
jimmyadaro: lmao
jimmyadaro: LUL
Mariosavitch: i can make that happen
TheZarkxs: chad covid vs virgin aids
Penguino138: @georgehotz worries about lasting lung damage even for young people after getting COVID?
bloodstrive: imagine having sex and going to hell LOL
Pedroso: Sex? what is it?
logi6000: @pedroso same
theonlymonkas: LUL
boarderdude4120: whatever happened to that havard biochem professor that was accused of spying for china?
C0deCane: I am worried about what this does to you years from now
jimmyadaro: @Pedroso Some pokemon?
leftyytwo: have u seen any of the stuff stephen wolfram is streaming
joeyskitkat: Hows everybody back home?
martaway: The young ppl that vape 20 hrs a day care about lung function?
pz3300: Dead
Mariosavitch: the dollar is going to collapse
gadean: I'm not scared about the virus but the implications to our economy
l1ght5p33d: duh 90% recovery at worst
Krakken_TM: im actually worried about the virus mutating
itsxaos: fucking DUH dude most people will beat this in a week
thecoder15: @Mariosavitch yup
jimmyadaro: Sup @C0deCane
entangledbeing: Not enough ventilator
esence: long-lasting damage the boogaloo
Ayyyy420Lmao: i only vape bho i care about my lungs
DecayingSkullz: I think it's only for people with underlying health conditions
pz3300: 1/3 of the population has hiv george
Plurmorant: goodbye lungs FeelsGoodMan
cutza: what about internet shutdowns?
Pedroso: @jimmyadaro NICE
martaway: Well, vapings bad for lungs
Ayyyy420Lmao: 99% of the population has latent herpes
Jewishrambo: it's the pneumonia that causes the damage. perhaps research into viral pneumonia
C0deCane: @jimmyadaro not much man hbu
logi6000: @ayyyy420lmao c02 carts da bamb
kwirny: AIDS is far more deadlier, but better treadable
tsAllySparkles: lol 1/3rd, what a ridiculously false statistic
tsAllySparkles: maybe 1/3rd of the population of west africa
jimmyadaro: @C0deCane Everything fine man
gadean: 1/3 has hiv? you sure about that?
Krakken_TM: @kwirny aids isnt treatable
theonlymonkas: the quarantine needs to extend?
jimmyadaro: @Krakken_TM Are u sure?
Mint2bSpiced: Here is what the lungs look like when you are infected and have Pneumonia... https://doi.org/10.1148/radiol.2020200257
Nussinov: I love seeing tables in medical papers Kappa
vicmoney69: @Krakken_TM its treatable its not curable
Krakken_TM: as long as you take the meds its " treatable"
cjbprime: Why prefer COVID to HIV? Seems like HIV has zero mortality risk for you, this has non-zero mortality and maybe 3% chance of putting you in an ICU.
Krakken_TM: so its not rly treatable
doctorgenus: kinda dry no pictures
meteorlake: Even without underlying conditions you will feel like shit... ive heard of healthy people being in there for 10 days thinking they were going to die.
l1ght5p33d: Blood transfusion   Bone marrow transplant ::can:: cure HIV
logi6000: George if you got HIV what would you do?
jimmyadaro: @Krakken_TM https://www.bbc.com/news/health-51804454
entangledbeing: Worried about trump telling people to stop quarantining
TheZarkxs: more people die to mosquitos than to corona, joke of a virus #virgincorona #chadmosquito
Krakken_TM: @vicmoney69 oh yeah my bad not a native speaker
pz3300: @tsallysparkles tell that to Dr Peter duesberg. Virologist. How many times you been published in Nature?
martaway: HIV does not have zero mortality risk... and treatment has side effects
jimmyadaro: @TheZarkxs Do you mean dengue?
11plus4thinking: @logi6000 he would just reverse engineer it duh
kwirny: youre right HIV is
Mariosavitch: mental disease travels faster and its more deadlier than corona
bankzed: well, gonna sleep. If things gets worse, you're welcome to stay at my bunker, got food and water for years Kappa
logi6000: @11plus4thinking what is was thinking
ImJ4Gu4R: ImJ4Gu4R subscribed at Tier 1. They've subscribed for 2 months, currently on a 1 month streak!
Jewishrambo: 0
128p_: In 2019 we had 700  deaths with Dengue in Brazil and then Corona joins in for a crossover episode... If you guys want to the play the game in hard mode, come to Brazil.
Jewishrambo: a lesion is a deformity I thought
thrashtazs: yeah trump lifting ban on people quarantining is a real threat
nremind: i'm hoping the government resets the healthcare, pharma, and insurance industries through this pandemic
boarderdude4120: whatever happened to that havard biochem professor that was accused of spying for china?
jimmyadaro: Like… 5%?
cankunwang: the only way of fighting the plague is honesty - Camus
Mariosavitch: @thrashtazs no its not. stop fear mongering
jmv_chin: pro googler
doctorgenus: nodules sound like npm modules
pz3300: Yeah, thought so
doctorgenus: lol
TheZarkxs: imagine mike tyson punching your lung
joshperri: Worried about mass hysteria when our gov fails to be effective and people start eating each other.
martaway: He hasnt even lifted it, he just said it would be reevaluated
Jewishrambo: lesion is an anatomical deformity
Mariosavitch: like u?
Mariosavitch: ooo
jimmyadaro: LUL
Nussinov: oooo
128p_: oooooo
mashafique: gottem LUL
jimmyadaro: ooo
jimmyadaro: pro move
128p_: F bro..
jimmyadaro: meth
128p_: oh crap, I just realized we're dissing a mod
jimmyadaro: hell yeah
C0deCane: @georgehotz I heard something today that some Italian doctor claiming that he thinks they had the virus there in November or something. Suggesting that the virus originated in Italy ... I wonder if the Chinese threatened to cut off aid LUL
Krakken_TM: atmosphere gettin clear now
Mint2bSpiced: here you go: https://doi.org/10.1148/radiol.2020200843 here are the long term affects
Eternallightning: That’s a steroid
pz3300: @logi6000 act surprised when his girlfriend tells him?
jimmyadaro: https://www.bbc.com/news/health-51804454
TheZarkxs: this stream can be described as a bunch of words i dont understand, and a good looking kitchen on the background
martaway: Steroids hurts the immune system
theonlymonkas: but does all of this have a positive climate impact?
Mariosavitch: just run a t-remd simulation with genesis
pz3300: All drugs do
Krakken_TM: @theonlymonkas yeah
jimmyadaro: Meth is good
Nussinov: @TheZarkxs it's fun to do your own research while watching
ackxhpaez: Steroids are what doctors give when they have no idea
thrashtazs: @theonlymonkas yes
Krakken_TM: and people are startingg noticing it
logi6000: @pz3300 lmao. this is prob the funniest shit I've seen all day. I needed this. thanks
martaway: No, steroids literally do it, as their primary purpose
pz3300: 👍
s0rrz: there was a pneumonia outbreak in november @C0deCane
ImJ4Gu4R: Meth as covid19 cure? geo found it?
TheZarkxs: why you not taking roids bro?
egb3: Helllo :)
Krakken_TM: there are numerous claims on atmosphere gettin clear now with the cars and airplanes goin temporarily extinct
C0deCane: @georgehotz look into Hantavirus to me it seemed very similar but apparently its only contagious in Africa
imafungi53: did you just look up hypertension lmao
Ayyyy420Lmao: @pz3300 all drugs do what?
jimmyadaro: @ImJ4Gu4R y not
Nussinov: @TheZarkxs find a word you dont understand? look it up and go down the rabbit hole. this guy is used to reading papers, but you could even benefit from reading wikipedia articles
Mariosavitch: i dont
Hawklite: lmao
opus_000: reverse engineer cows from farting methane
faraday_lenz: not me :)
128p_: @TheZarkxs Watching George is a constant battle to keep up, even when he's coding something you're supposed to understand. Don't feel bad :D
esence: im chugging ice-cream rn
C0deCane: @s0rrz he said specially pneumonia like but tested neg for it
SolarBerry: "56% of Travis County COVID-19 patients are younger than 40, HSEM says" monkaS
itsxaos: also women WAY overrepresented
izikatoshka: no infection bacteria game this night? @georgehotz
itsxaos: this study doesnt seem great
entangledbeing: Everyone has diabetes?
pz3300: Africa must be like, thank fook it’s not us for a change
leftyytwo: not enough colorful pictures
jimmyadaro: https://www.bbc.com/news/health-51804454
Mariosavitch: have you looked at T-REMD simulations with genesis? @georgehotz
itsxaos: small sample size
Eternallightning: SARS was much deadlier
Jewishrambo: this study is good..
Eternallightning: But didn’t spread as fast
pz3300: Take no notice george
Nuroki: statistics on 80 different people is at least questionable
logi6000: @pz3300 but when it does hit. it will hit harder then the second sun hit japan
esence: it's a bad study because the authors were not diverse enough
Nussinov: Published in the journal of 🅱️ O N E research
ImJ4Gu4R: Yea, sars hit ya hard
jimmyadaro: @esence lmao
Jewishrambo: look at the doctors names sometimes you can see them again and again trust for them etc
pz3300: Lol
jimmyadaro: https://www.bbc.com/news/health-51804454
Jewishrambo: gain*
egb3: egb3 subscribed with Twitch Prime.
DecayingSkullz: TheIlluminati
TheZarkxs: im just going to believe what orange man says, hes the president, he must know what the f is going on
Mariosavitch: have you looked at T-REMD simulations with genesis? @georgehotz
nremind: basically over 50% had long term effects?
Nussinov: @Jewishrambo hate to say it but my PhD supervisor (a nobel laureate) told me to be more skeptical of articles written by 100% chinese authors LUL racist I know but still
Penguino138: @georgehotz so there are long term effects on the lungs or no?
whyZaya: @Jewishrambo That's not a great practice. Someone can do good research once and bad research later.
s0rrz: longtime smokers will probably be fucked
itsxaos: very hard to say much when theres so few people no?
jimmyadaro: Genesis? Isn't that a console?
Br4nnon: we're testing for antibodies in 'recovered' patients
jimmyadaro: LUL
martaway: Longtime smokers suddenly care about lung function?
Eternallightning: Yeah sega genesis
logi6000: @jimmyadaro S AYYYYY GAHHHH
s0rrz: i mean about dying
almonte550: Because it's expensive?
nremind: I thought it said 21% had some effect and 34% had another effect
entangledbeing: How many strains?
pz3300: I’ve been smoking since 5 years old. My lungs are amazing!
jimmyadaro: Dying sound good
C0deCane: @martaway hell yeah dude how else we gonna keep smokin Kappa
TheZarkxs: damn once i get my treatment for corona im going to look like jeff seid
jimmyadaro: @C0deCane LUL
doctorgenus: yup they are all guesses at this point
l1ght5p33d: evolve or find a cure
jimmyadaro: wtf
Mariosavitch: jeez lol
SpaceGhost8: zombies monkaS
itsxaos: well maybe they are saying there is no data
ideology_sniffing_raccoon: monkaW
jimmyadaro: psychosis??
faraday_lenz: monkaS
Ayyyy420Lmao: why would u use an inmunosupresant ot treat an infection
theonlymonkas: NotLikeThis
SolarBerry: sars 2 is not to be underestimated
Eternallightning: monkaW crazy patient
C0deCane: LUL sars related psychosis LUL literally the state everyone in the globe is in right now
jimmyadaro: https://www.bbc.com/news/health-51804454
TheZarkxs: @martaway stop lungphobia right there, tobacco has the same rights as you do
Mariosavitch: no
Ayyyy420Lmao: no
Lizardan: Yes
Nussinov: god no
wholesome_pepe: because the the symptoms kill people
jmv_chin: medical programmer Kappa
ideology_sniffing_raccoon: Scam
Ayyyy420Lmao: just read a book
almonte550: Are we using steroids again?
s0rrz: are we getting sars 3 next year?
kwirny: Possible
theonlymonkas: lul
pz3300: George, the people in my street are having a corona party. Do you think I should go now?
jimmyadaro: @almonte550 Now is meth
logi6000: @s0rrz 3rd gen?
Eternallightning: Yeah go into 200k debt
Mariosavitch: git tag sars-v3
brittonx2: the steroids will f with your mind
faraday_lenz: learned medicine on the streets
polishtoe: Prolly, rn they're prescribing Azithromycin for 'rona pt's
C0deCane: sars v3 will be much more friendly
pz3300: Synthetic blow sucks
jimmyadaro: @Mariosavitch LUL
almonte550: @jimmyadaro f** yeah!
jmv_chin: like the killer bees incident
l1ght5p33d: I already made sars 3. with python 4
guapcollector: steroids will enlarge your organs
ideology_sniffing_raccoon: every two years we get a new one
esence: just toss that bat out in the market
TheZarkxs: imagine spending billions on a vaccine, and the virus suddenly mutates and its worth nothing. hahahaha
TsarSec: Kappa
theonlymonkas: only if we survive this one
jimmyadaro: @guapcollector All of them? Hmmm
benchai18: I love how much he’s touching his mouth while talking about fatal diseases lol
jimmyadaro: https://www.bbc.com/news/health-51804454
Nussinov: I heard bobby gates say that pandemic is the most likely thing to decimate humanity in the next 50 yerss
TsarSec: not if you keep defunding healthcare LUL
Eternallightning: Seems like complacency dips below threshold every 10 yers
pz3300: Who needs sterile tech?
K177: its the first one that hit us hard in the modern world
mirceau: Do you really think so?
K177: last one was the spanish flu that had a huge global impact
entangledbeing: Other ways to prevent pandemics?
itsxaos: thats what a doctor on JRE said
jimmyadaro: Test that shit with f**** prisoners
phyde79: what are the odds a tsunami hits west coast us
benchai18: @itsxaos Correct
Jewishrambo: they sequence the genome in January... it's been known for awhile
Eternallightning: Yeah small molecules are much harder
pz3300: Pedophiles
s0rrz: dont leave home @entangledbeing
thrashtazs: @jimmyadaro go to hell
jimmyadaro: @pz3300 Hell yeah
TheZarkxs: test it with people who like vegetables
genieyou1: Look my Twitter genieyou
Nussinov: @jimmyadaro yep, go to hell
jimmyadaro: @thrashtazs Ladies first
TsarSec: bruh @jimmyadaro
pz3300: Maximum dose
faraday_lenz: h1n1
Mariosavitch: i think i had it
mirceau: Simple Vaccs Strategy: counter filth with filth.
Nussinov: I got swine flu
esence: Chinese virus is at 20k
nozpheratu: that was only 11 years ago
K177: lmao
4zimut: lvl 1
benchai18: Making it is fairly simple. Human testing is iffy. We have more regulations than most countries. Makes us “safer” but way slower to react. Far less agile than, say, China
TheZarkxs: nuttin
logi6000: now George with all your research on vaccine. how do I convince my antivaxx friend to understand that they are not bad
tsAllySparkles: are you ever going to revive your rap career
K177: yup nothing compared to this
SolarBerry: swine flu was much less severe morbidity
Mariosavitch: i had it
bankzed: my buddy had swine flu, he said it was the worst sickness he ever had
itsxaos: thats in the margin of error lol
jimmyadaro: Any human being &gt; Pedophiles
polishtoe: avian flu was 60% fatality right?
Jewishrambo: coronavirus is much deadlier . it's more consolidated to the lungs
C0deCane: When Trump stops holding rallys its time to seriously find somewhere safe LUL
Ayyyy420Lmao: again man with the parenthesis wtf
TsarSec: i assume youve seen the bill gates vid that predicts this from 2014 @georgehotz
Br4nnon: imagine 800m infected with coven-19
Penguino138: @georgehotz doesn't the page say 150k  fatalities?
Nussinov: @bankzed it was fucking awful for me. projectile vomitting for days lying in bed as a healthy young adult
jimmyadaro: Any human being
K177: LUL
wholesome_pepe: im reading moderna patents right now, seems hard af
mirceau: In India, in some village, they got group of people and they were asked to drink cow piss. to help increase their immune
genieyou1: I’m a hacker, passionate about medicine you’re going to call me crazy, but I think that 50 drops of grapefruit seed extract, and 20 drops of propolis and an infusion of cypress per day can neutralize the CoranaVirus. I suggest the researchers look into it.
theonlymonkas: 18,907 deaths by coronavirus
gill_bates_macrosoft: @polishto problem is how fast coved-19 infects
ahahahaitslit: what are corona's numbers so far?
benchai18: @mirceau Chill bro. I was in that village
almonte550: So dying with that flu is like winning the lottery of bad luck?
jimmyadaro: LUL
gill_bates_macrosoft: hospitals in my city just closed down today, patient care infrastructure in my country about to get rekt fam
pz3300: Spanish flu 30 million
Jewishrambo: coronavirus might top Spanish flu then
ahahahaitslit: spanish flu still the goat
imafungi53: bill gates owns the patent for cornavirus
ImJ4Gu4R: @mirceau PogChamp
mirceau: @benchai18 lol I was serious
zennydmt: what sparks your creativity
C0deCane: to bad our infrastructure is shit and we dont have enough supplies we would'nt even have flinched at choosing herd immunity
zennydmt: how do you become creative
Mariosavitch: nothing
ImJ4Gu4R: @georgehotz more stream after this pls..i will sub more
mirceau: Strategy = Counter Filth with Filth
jimmyadaro: We need more drugs
doctorgenus: @genieyou1 : based on what?
benchai18: @mirceau Me too dude. I have utters now
ImJ4Gu4R: this stream is a cure
Eternallightning: Drugs are expensive and take a long time
pz3300: In the 80s the surgeon general in the us said aids was caused by smoking weed!
TheZarkxs: smallpox kileld 300 million people in the 20th century, corona is a joke
esence: I think Italy are misreporting numbers. One got shot, burned, hanged, drown, stabbed. Cause of death: hanged.
AbdoFarwan: More people die from diabetes 😹
Mint2bSpiced: Doctors prescribed steroids because they thought it would help with inflammation but with COVID-19 the inflammation is from Cytokine release syndrome (CRS)
martaway: Is it true if u leave ur home u can be arrested
Nussinov: so youre saying that your confidence in the number increases as more cases are said to have been confirmed? seems reasonable
dzid26: 0.45-1.2 million died this year from influenza, which is kinda crazy
mirceau: I bought a Leopold topre this week. It types like really nice
pz3300: Cancer has a 100% kill ratio
TsarSec: just let the free market handle it LUL
C0deCane: typical gov agency
logi6000: @pz3300 not always
Eternallightning: They fucked up the primers LUL
Ayyyy420Lmao: @pz3300 i get cancer 1000 times a day on the internetz and still hasnt killed me
pz3300: If you last 5 years they say they cured you
benchai18: @mirceau that’s crazy though. But also not surprising. In Salem, they used to have a suspected witch pee on a loaf of bread and feed it to a dog to see if the dog spazzed out. Given that Indians revere cows, it’s not that strange
itsxaos: whats a PCR assay
Plurmorant: yup
TheZarkxs: USA USA USA!
genieyou1: you are going to call me crazy, but I think that 50 drops of grapefruit seed extract, and 20 drops of propolis and an infusion of cypress per day can neutralize the CoranaVirus. I suggest the researchers look into it.
mirceau: Ugh.. I just think we have such a vague and distant and meta idea of what so many things are. For instance consider what amour actual concept is of Cancer or the Flu or the Financial System..
eksdee_1_2_3: may I have some coochie?
ideology_sniffing_raccoon: MURICA NUMBA 1
SolarBerry: assuming china's fake numbers yes
peter35_: exceptional monkaS
Eternallightning: @itsxaos DNA/RNA replication
Nussinov: @itsxaos its a way to check for the genetic material in the sample. its something they teach undergrads
l1ght5p33d: One fuck up doesn't mean everythings fucked up all the time
miiiiiiim: doesnt china just have quietly higher stats than theyre letting on
jimmyadaro: https://twitter.com/elonmusk/status/1242519973903376384
itsxaos: oh theyre talking about the tests?
phyde79: Tsunami warning for Hawaii and possibly California. You guys see this?
nremind: we have people on extended spring break partying
pz3300: China has 5x what you do
C0deCane: @georgehotz do you think some countries will seek punishment for China?
guapcollector: seems like the US is about to go back to work too
theonlymonkas: so the solution is? more quarantine?
martaway: X doubt
nozpheratu: Why wasn't it called the Asian Flu?
pz3300: Bat wing soup
theonlymonkas: bat flu
jimmyadaro: @theonlymonkas So far, yes
mirceau: My dad’s jewish PhD supervisor took my dads Research results, moved to the USA and patented them.
martaway: We dont havev nearly the density Italy does
miiiiiiim: @theonlymonkas until theres enough PPE for civilians
Mariosavitch: ywn
Mariosavitch: yawn
jimmyadaro: https://twitter.com/elonmusk/status/1242519973903376384
TheZarkxs: who cares, usa usa usa!
ideology_sniffing_raccoon: Trueeeeeee
SolarBerry: @mirceau lol
C0deCane: @guapcollector they won't the governors probably wont let that happen even if trump says its ok
Ayyyy420Lmao: @mirceau woa woa cool it with the antisemitic remarks Kappa
TsarSec: capitalism
Eternallightning: Science research is full of snakes @mirceau
isensualism: KEKW
mirceau: Lol My mom’s side was Jewish, I have a free pass
rstk1: LMAO
isensualism: turn on KEKW BOOMER @georgehotz
C4TFive: 2032 baby
thecoder15: @georgehotz you actually trust a bunch of clowns to get a big bad virus under control lol
cankunwang: conspiracy is stupid
Penguino138: Hotz 2032 lets gooo
l1ght5p33d: open source everything fuck the government
mirceau: @eternallightning true
Ayyyy420Lmao: @mirceau if your mom is jewish you are jewish too
miiiiiiim: @l1ght5p33d want a lollipop?
guapcollector: every state should secede lol
Mariosavitch: Corporate Socialism
logi6000: I think George could start his own party
TheZarkxs: ancaps rise up
Hawklite: do a political conversation with destiny
logi6000: open source party
julien9877: prediction: US #1 cases in 3 days
murkythunder: destiny is an idiot
Ayyyy420Lmao: u read hans herman hoppe george?
isensualism: talk to @destiny @georgehotz
pz3300: Destiny is a coke fiend
martaway: Density is too big for his britches
mashafique: George please take your groceries off the floor. The five second rule has long passed monkaS
thecoder15: they should all go the way of Ceaușescu @georgehotz
itsxaos: destiny is a joke
ideology_sniffing_raccoon: @Hawklite LUL
TsarSec: destiny is a neolib dumbas
jimmyadaro: Coke, hell yeah
gabo_sk: destiny is a videogame
SlaterUSA: but we all agree the libertarians should be the first to be fed to the guillotines, right?
thrashtazs: rationality is the only separation we have from animals, yet we cant
mirceau: rationality is an inefficient way to go about life
murkythunder: destiny is legit a redditor who cant pass college who reads headlines and debates people
cellophane11578: destiny IS a video game Kappa
jimmyadaro: @SlaterUSA wtf
guapcollector: you're using your guillotine wrong slater
gill_bates_macrosoft: LUL LUL LUL LUL LUL
iGalactic: Jebaitedd me by saying you weren’t streaming tonight 🥴
pz3300: Yeah but destiny uses to enhance his debating
SpaceGhost8: oh yeah, the spike in florida
mirceau: The right process doesn’t mean the right output
ideology_sniffing_raccoon: Florida
martaway: Density just takes what other people have done and takes the next step. He didnt do the work himself so he takes no responsibilty for it
SlaterUSA: libertarians, quickly followed by conservatives
roystang: the test i got in FL takes 1 week to get results
TheZarkxs: @SlaterUSA nice bait right there
miiiiiiim: two weeks before we get to watch christians go and celebrate easter like the death cult they are
julien9877: cdc. gov link in there
mirceau: @mashafique lol good one
Eternallightning: Reverse transcriptase is buggy
SlaterUSA: @TheZarkxs :D
SlaterUSA: okok
Itsmeek0: It seems to take about two weeks for people to recover from it. So if everyone that is infected becomes quarantined... perhaps it can kind of go away in two weeks ish?
jimmyadaro: @SlaterUSA Like… Kill the people who builds that country?
C0deCane: @georgehotz if the death tolls continue to skyrocket all over the world can we assume that China is lying?
martaway: Well yeah all enzymes are buggy thats why we have cancer
pz3300: Destiny has an incest fetish
braininavatt: I love it that george googles like my grandma Kappa
mirceau: Reversed Transcription is Dank
jimmyadaro: @SlaterUSA I mean, leftists are doing nothing
jimmyadaro: to improve the country
jimmyadaro: LUL
miiiiiiim: why does anyone listen to destiny
Eternallightning: 5Head
murkythunder: putting a pedo with a league addiction who cant pass college who left his son for an egirl on the same level as hotz is a joke
SlaterUSA: @jimmyadaro and everyone else is just fucking it up :D
11plus4thinking: LUL
Mint2bSpiced: here you go https://www.fda.gov/media/134922/download
almonte550: The thing with that test is that the accuracy is like 60-70%
jmv_chin: that vim Kreygasm
jimmyadaro: SeemsGood
pz3300: Lazy pricks
mirceau: Leopold vs HHKB
tsAllySparkles: did you hit 1m2019.com
dingus74: loool
braininavatt: Kappa
aaaakshat: SeemsGood
Itsmeek0: @braininavatt how do you google?...
Santiago_LHC: Buy me two
pz3300: Brown switches are nice george
mirceau: 😂
11plus4thinking: PRESS IT FeelsGoodMan
cellophane11578: lol
TheZarkxs: how do i buy coronavirus
Eternallightning: What protein does E gene make? @georgehotz
11plus4thinking: LUL
jimmyadaro: LUL
mirceau: you can sell anything online.
almonte550: Antibodies testing will do better accuracy
TsarSec: LUL
theonlymonkas: LUL
cellophane11578: english text, nah bruh just copy and paste a jpeg
doctorgenus: does CTFs make you smarter?
dingus74: Bruh
Nussinov: Pepega
cankunwang: lol
mashafique: LUL
Kemisdan: LUL
Jewishrambo: is uber eats safe during this time does it live on food or something
alameda13: LUL
dingus74: jackoo1Derp
gabo_sk: monkaS
martaway: Antibodies testing is not more accurate. People who have recovered will still have antibodies
theonlymonkas: PogChamp
thecoder15: @Jewishrambo throw the whole thing in the microwave to kill it off@
jimmyadaro: LUL
tsAllySparkles: most tests go up your nose like flu tests
pz3300: Antibodies are good.
tsAllySparkles: not sure about the lab analysis though
cankunwang: so liberal
pz3300: Once you have antibodies it’s job done
SlaterUSA: aw, thanks chinese! so nice!
mirceau: PEOPLE BUY ANYTHING - My grandad ordered a ‘barbecue starter kit’ and he got a box of matches.
timi13462: how many tabs do you have open daily
jimmyadaro: @mirceau LUL
tsAllySparkles: the cartridge is fed into an ePlex machine, where the sample undergoes around 20 different chemical reactions to test for the virus.
gill_bates_macrosoft: @mirceau LUL LUL LUL LUL
ideology_sniffing_raccoon: LUL
dingus74: LMFAO
ideology_sniffing_raccoon: TRUEEEEEW
SparksCx: lul
Itsmeek0: lollll
dingus74: LUL
Itsmeek0: nice example
K177: lmao
Itsmeek0: comedy gold
64pillars: but it works
itsxaos: and then they lie about what they will do in the future
martaway: Antibody testing is cheaper and faster but not more accurate
pz3300: Did you google that sparkle. Or ya scared?
ideology_sniffing_raccoon: WOKE USA COMPANIES LULW
Santiago_LHC: Hey, I donated Balloons man
SparksCx: good one georgey
bytebacon: "How does the internet know when I was born, a generation formed by internet porn"
cankunwang: goooood
TheZarkxs: im a clown and do it for free, 24 hours a day 7 days a week
ImJ4Gu4R: lol yea damn balloons donation
Itsmeek0: #balloongiftersattacked
almonte550: @martaway for what I read there are two types of antibodies, one that appear when it's the first time with the virus and one that appears when your body gets infected again
11plus4thinking: HEY dont underestimate a good balloon
Santiago_LHC: The balloons are no joke, man. Donate balloons if you can #balloons
iGalactic: peepoClown
jimmyadaro: wtf
entangledbeing: Shootin straight
pz3300: You love it georgehotz
mirceau: @georgehotz I worked in Kuala Lumpur for 1 year. My Chinese boss was boasting everyday that they are better and more sophisticated than the Malays and the Indians.
lebop: what is he doing today?
martaway: Not sure about that, the first antibodies would still wor
jimmyadaro: @lebop Cure COVID
SlaterUSA: they just do it for the lulz
mirceau: Loved Kuala Lumpur so much.. those were some good times
benchai18: @slaterusa Lol
pz3300: They do it for the sales
Ayyyy420Lmao: hookers lul
Mint2bSpiced: click me ----&gt;&gt;&gt;&gt; https://www.fda.gov/media/134922/download they have a flow chart for how the test works
Sky_Light_37: Kappa
brofessorbob: Bar girls?
Br4nnon: don't they all
Santiago_LHC: #capitalism
sunole: 400,000 new people have joined Folding@Home’s fight against COVID-19 The quest to thwart the virus has strong help from distributed computing. Jon Fingas Jon Fingas, 03.23.20 The Folding@Home community has turned its attention toward the fight against COVID-19, and it now has massive computational power at its disposal as a result. The distributed comp
jimmyadaro: Capitalism is everything that's fine on tis world
Fosade: what up george
Ensthor: #capitalism
theonlymonkas: SeemsGood
zennydmt: are u ever going to get married
thecoder15: @georgehotz my man malaysian girls are fun -
weedlord666: I mean i guess but those large companies are extracting wealth via the exploitation of the surrounding population and environment, often for extreme gain
mirceau: @georgehotz True,
ImJ4Gu4R: Nah, come Kuala Lumpur? lets hangout geo
pz3300: Do they suck dick?
joeyskitkat: hows everyone back home George?
jimmyadaro: @weedlord666 Do you work for pennies?
mirceau: I felt so free at KL
whyZaya: Geohot goes on so many dates. Is he even a real programmer?
dingus74: woahhh
zwisch: #sequenceTheWorld
itsxaos: Theranos 2 PogChamp
thecoder15: @georgehotz check this out
Santiago_LHC: Man.... that's how Jurassic Park started.
theonlymonkas: LUL
Sky_Light_37: monkaS
jmv_chin: what you drinkin
logi6000: offtopic: I loved your song sufficiently advanced democracy is indistinguishable from trolling
bytebacon: Yo, yo I didn't always have skills, But you chilled out with the time that you killed, I was online and on my damn grind, Beggin' the question, What'd you do with your time? Figured it out in my Aunt's basement, Video games and no damn patience, Tech skills and determination, Crossed with the rage and frustration
braininavatt: #NotAScamTheranos
jimmyadaro: Yeah, f*** blood
dingus74: Harvesting Dna
Itsmeek0: Give us your best baritone voice George
jmv_chin: yum
Itsmeek0: CNN interview
thecoder15: @georgehotz check this out https://nanoporetech.com/products/minion
Eternallightning: It was never a scam Kappa
ImJ4Gu4R: Come KL bro
pz3300: Death penalty for an oz of weed. No thanks Kawala lumpher
Ayyyy420Lmao: whats the point of sequencing everything tho
guapcollector: high on coffee
benchai18: WHATS MY MOTHA FUCKIN NAME. R. U. L. E.
Santiago_LHC: Doctor Ian Malcolm warned about the abuse of DNA sequencing
brofessorbob: Did you ever hang with Elizabeth holmes when you were in the bay?
64pillars: xqcM Theranos 🤝 Facebook
imafungi53: do you cut your own hair rn
theonlymonkas: no tea?
SpaceGhost8: how do I invest
mirceau: Ice Tea
entangledbeing: Intellia
PiroFloydian: how we doing boiz
entangledbeing: Invitae
zeeeman: you haven't moved your bags from yesterday
ImJ4Gu4R: Thats nice geo
logi6000: apartment tour
wholesome_pepe: they do that tho. all those genome projects
joeyskitkat: are they whole food bags?
jimmyadaro: I said it yesterday; eat raw garlic, onions and drink some tea mf
itsxaos: its "book a sales call" much LUL
Br4nnon: oh sht lol
brofessorbob: Did you ever hang with Elizabeth Holmes during your time in the bay?
KnollBoss: @georgehotz uve introduced me to my favorite tech quote of all time from holmes. Great announcement video
itsxaos: go back up the table had prices
SpaceGhost8: check on amazon
nremind: it said $1000
murkythunder: no price = $565464565476
zeeeman: CH
cankunwang: oxford
64pillars: scroll up lol
nozpheratu: If they don't tell you the price, it's too expensive for me
jimmyadaro: No price = expensive af
jimmyadaro: I said it yesterday; eat raw garlic, onions and drink some tea mf
KnollBoss: talk to sales
guapcollector: they probably sell in volume
jmv_chin: find out more LUL
almonte550: Talk to sales hahahahahaha
grenaderaven: lol
thuganalyst: Iran is rejecting humanitarian aid even though their death toll is 2000  growin fast
jmv_chin: who designed this website
murkythunder: live sales call Poh
KnollBoss: book a sales call
SpaceGhost8: Book a sales call LUL
nozpheratu: talk to sales = &gt; 5000
entangledbeing: Invitae / intellia
julien9877: just 4Head
C0deCane: LUL we have this product its just impossible to buy
Ayyyy420Lmao: 1000bucks   reagents
Santiago_LHC: CALL
jimmyadaro: @thuganalyst Who's help?
ooMariaoo: oh
SparksCx: sales call
pz3300: When they don’t say the price you know it’s gunna cost brewsters
iGalactic: Pog
SpaceGhost8: oh, that's not bad
benchai18: @thuganalyst Good. Fuck em
theonlymonkas: only $1000
almonte550: Talk to sales =&gt; your left eye
moncefmd: if you sequence everything you are trespassing the privacy of your ancesters as well as your kids
zwisch: PogChamp
jimmyadaro: I said it yesterday; eat raw garlic, onions and drink some tea mf
jmv_chin: impulse purchases live on stream; high-quality
leftyytwo: scam,,
C0deCane: Just the starter pack? at least get the advanced version LUL
nremind: but what is the practical use?
mirceau: @georgehotz you were in the Golden Triangle of KL. between KLCC, Bukit Bintang and Raja Chulan
SpaceGhost8: have to sign up for their SAAS product with basic
Ayyyy420Lmao: not doing a genome on that if thats what ur thinking
logi6000: George over here looking for the scam lmao
SparksCx: BUY ON STREAM PogChamp
Eternallightning: Is there continuous costs for reagents
itsxaos: you need special cartridges
Vespus: Doesn't include DLC
Santiago_LHC: A month later. George clones himself
almonte550: You need to sell your left eye to purchase it
Itsmeek0: Scam is... it only analyzes jizz
Itsmeek0: lol
murkythunder: dna sequencing as a service
KnollBoss: it costs half of your sexual lifetime
anotherkidnamedaustin: how long have y been on?
pz3300: You will be targeted by drop shippers too fuck george
itsxaos: https://store.nanoporetech.com/eu/flowcells.html/
benchai18: What is that? Gene sequencing? Dna?
sk84uhlivin: It seems there's supplementary packages, a lot of them...
guapcollector: price is monthly
theonlymonkas: let's find out! buy it!
jimmyadaro: I said it yesterday; eat raw garlic, onions and drink some tea mf
ImJ4Gu4R: Can we do this tool open source geo?
anotherkidnamedaustin: day 4 same hoodie?
thuganalyst: @jimmyadaro doctors without borders
brofessorbob: First you need to isolate the organism before you sequence
TheZarkxs: cybervirus
PiroFloydian: no i just have a good immune system i dont get sick
wholesome_pepe: is it one time use??
DecayingSkullz: But it
DecayingSkullz: Buy it
miiiiiiim: @georgehotz do you still have your tonsils
Ayyyy420Lmao: you're not getting enough reads with that shit
Br4nnon: green tea &amp; honey
pz3300: George is turning into Howard hughes
ImJ4Gu4R: I want to see this as open source, lets break it.
jimmyadaro: @thuganalyst Who??
thuganalyst: Those planes Iran shot down really shook my city
brofessorbob: Go to the Dr.
SparksCx: what...maybe just go to the doctor
cankunwang: can you do whole genome sequencing in this?
SlaterUSA: scam is, when u get the product there's just a bunch of soldered metal bits from a broken clothes iron inside
jmv_chin: click the glowing Find OUt More buitton
logi6000: George boutta reverse engineer his self made virus
SpaceGhost8: yeah, buy one and open source it
METH_HEAD_MIKE: home chlamydia test PogChamp
ooMariaoo: true is it one time use
itsxaos: @georgehotz i think you need to buy these consumables https://store.nanoporetech.com/eu/flowcells/spoton-flow-cell-mk-i-r9-4.html
Ayyyy420Lmao: @cankunwang nope, maybe with a lot of runs you could
benchai18: My balls hurt. I’d like to sequence that nut
mirceau: Ask Theranos’s CEO Elizabeth Holmes
jimmyadaro: EAT F**** GARLIC GEORGE, IS NOT THAT HARD
Br4nnon: how does it work
Itsmeek0: https://www.youtube.com/watch?v=rXfS4wJoVLQ
almonte550: REAL real-time
theonlymonkas: what tea do you drink?
Itsmeek0: this is a video on the dfevice
almonte550: So real
anotherkidnamedaustin: dna extraction is easy peasy
bytebacon: @georgehotz can you just rap before every stream? it's 🔥
benchai18: How does it work and why do u know how to use it @georgehotz
murkythunder: imagine spending 20 years of your life and millions of dollars to make some ingenious tool, and some idiot buys it, reproduces it in a 3d printer, and open sources it
SparksCx: REAL Real-time PogChamp
jimmyadaro: Raw onions
DecayingSkullz: https://www.youtube.com/watch?v=rXfS4wJoVLQ
Ayyyy420Lmao: yeah george the tech of this is crazy, a weird patented membrane and electrodes measuring the conductance
pz3300: Camel tongue virus I bet it is g
ImJ4Gu4R: Buy and break it geo
zwisch: any length DNA/RNA
mirceau: How is this not a scam like Theranos
Mariosavitch: 10k LUL
thuganalyst: @jimmyadaro https://en.wikipedia.org/wiki/Médecins_Sans_Frontières
Itsmeek0: https://www.youtube.com/watch?v=rXfS4wJoVLQ
chillguy269: holy christ
Kemisdan: 10k wtf
anotherkidnamedaustin: @murkythunder imagine waiting 18years of ur life and voting for donald
jimmyadaro: @thuganalyst Oh, those bastards…
Mariosavitch: little?
Eternallightning: DNA purification is kinds expensive pretty sure
anotherkidnamedaustin: so this scam is the price]
theonlymonkas: LUL little
SpaceGhost8: it's always the printer cartridges
Ayyyy420Lmao: yeah but so much better than previous tech, the reads are crazy long
PiroFloydian: this seems like Theranos tbh
cellophane11578: lets create the 5th element dna, the one that bruce willis was protecting in that movie
cellophane11578: Kappa
360Plato: ahh microfluidics
Mariosavitch: once
almonte550: once
Mariosavitch: twice
Nuroki: 6 times it says
Br4nnon: is it expensive to make yourself? granted you knew how to
jimmyadaro: 100 Gb??
Nuroki: 6 reactions
theonlymonkas: you need that too to make it work
ooMariaoo: 6
Mint2bSpiced: the problem with chip based product is the bioaccumulation overtime leading to chip replacement
Itsmeek0: maybe thats why it says talk to sales
jmv_chin: :)
Itsmeek0: so they can explain
mirceau: Ok boys, i am off to sleep it is like 5:13 AM here. #StayStrong BisexualPride
theonlymonkas: LUL just buy it
SparksCx: wait really?
jimmyadaro: @mirceau Kisses
guapcollector: looks like a vape lol
brofessorbob: 30Gbs
itsxaos: i think its not complete per run
SpaceGhost8: giblets of data
wholesome_pepe: you need reagents too or they come with the kit?
jimmyadaro: I said it yesterday; eat raw garlic, onions and drink some tea mf
doctorgenus: call them up and trade them an EON for a MinION
dingus74: Lol
C0deCane: @georgehotz research it on a different site LUL
pz3300: Shop around george TF
Mariosavitch: if u wanna die
tsAllySparkles: what are you gonna throw away in exchange for this device? didn't you throw away a waffle iron on stream?
Waldoqq: YES
ImJ4Gu4R: buy and break it
Br4nnon: lol that'd be hilarious
cellophane11578: thats what i wanna do
ooMariaoo: ouu
theonlymonkas: yes
jimmyadaro: Raw onions mf
anotherkidnamedaustin: @mirceau u made it this far why leave
SparksCx: geebes
itsxaos: i think you need to sample each thing multiple times
botbotboot: you need 10k to all this
murkythunder: Kreygasm gibi
meteorlake: TheIlluminati
pz3300: NSA in the chat
Ayyyy420Lmao: dont jerk off on stream pls
TheZarkxs: god i hate asmr
Santiago_LHC: ASMR
Mariosavitch: danHmm
jimmyadaro: @Ayyyy420Lmao That would be epic
11plus4thinking: isn't she a pornstar???
KnollBoss: goddamn she ugly
CompestLive: lol
syzo__: why
cellophane11578: i want to create drones that flash UV at random peoples faces too
jimmyadaro: LUL
logi6000: yeah like that one guy said trade a eon for a minion
theonlymonkas: Kreygasm Kreygasm Kreygasm Kreygasm
11plus4thinking: isn't she a pornstar??? isn't she a pornstar??? isn't she a pornstar???
Nussinov: very relaxing
julien9877: Kappa
Santiago_LHC: #tingles
itsxaos: whats the S stand for again
murkythunder: girlfriend puts you to sleep Kreygasm
ackxhpaez: creepy
wholesome_pepe: scammazed LUL
Mariosavitch: your face says sexual
K177: Kappa
roystang: its not sexual i just get a boner
miiiiiiim: um ok dude
imafungi53: geo getting a half chubb
iGalactic: WutFace
SparksCx: WutFace
NagyOut: why does she have 2 different colour hairs?
almonte550: Are we going to see people eating again?
dingus74: jackoo1Weird jackoo1Weird jackoo1Weird
C4TFive: Woah there bud, you need to be on Just Chatting for this
360Plato: yes mass produce this shit with microfluidic circuits btw IM rock hard IM sorruy
pz3300: Suck my balls
anotherkidnamedaustin: id get corona to hear her fart asmr
Penguino138: The only ASMR I like are you coding streams please stop
TsarSec: wtf is this
SpaceGhost8: charge some rich valley tech bros for expedited testing
brofessorbob: Do you ASMR regularly
Santiago_LHC: I want to give her money
meteorlake: lol what a turn of events
rahfuls: are u into tapping or what homie
TheZarkxs: turn it off or i burn your kitchen
TheLastMrX: WutFace
l1ght5p33d: I havn't had sex in like 3 years
TsarSec: why are we listening to ads
Nussinov: its sexual for losers who never talked to a girl in real life before LUL
Ayyyy420Lmao: how much money do u have donated to her???
jeffery_fan: I think ASMR IS banned on twitch? @georgehotz
cankunwang: pronhub skip ads
ImJ4Gu4R: NotLikeThis
SolarBerry: remember iDoser lol
ooMariaoo: lol
SparksCx: #ad
Mariosavitch: ASMR ad
anotherkidnamedaustin: i like her farts for asmr
Br4nnon: *deeply inhales* LUL
TsarSec: lmfao i remember that @SolarBerry
iGalactic: Listen to rain instead SeemsGood
nremind: wow those guys are simps
dudvdx: he's about 2 streams away from crispr
Nussinov: youtube comments are ultimate cringe LUL
guapcollector: asmr simps are the worst of all
jimmyadaro: Ads are getting smarter
SpaceGhost8: this isn't even good asmr
benchai18: @georgehotz my shaft disagrees with u
pz3300: It’s like she’s whispering in my ears “ you want me to suck your dick”
ackxhpaez: You could just listen to NPR
izikatoshka: ASMR Kreygasm
TheLastMrX: that was creepy
almonte550: If she starts eating I swear to god
Mint2bSpiced: you still nee a thermo cycler https://youtu.be/iS1pz3IhJvU?t=173
h_may_chess: the sibilants
iGalactic: Simps WutFace
codelumberjack: any crowdsourced reviews for these devices?
Mint2bSpiced: *need
jimmyadaro: @pz3300 Cherry Crush does that
h_may_chess: ssss zzzz thhhh
theonlymonkas: buy the minion
anotherkidnamedaustin: SCAM
HexaField: Simps galore
murkythunder: "asMr iSnT SeXuAl" meanwhile no dude asmr artists with million views
doctorgenus: buy it buy it!
Bloodswordz88: hail brethren
joeyskitkat: https://www.youtube.com/watch?v=rXfS4wJoVLQ
brofessorbob: starter pack flow cells are dope!
ooMariaoo: loll
SpaceGhost8: exactly
doctorgenus: it's like the giraffe for the EON
tsAllySparkles: yeah you can reset the DRM chips
theonlymonkas: minion minion minion minion
tsAllySparkles: on printers
360Plato: microflidic programming is so good
jimmyadaro: Onions, George
C0deCane: check out the reviews LUL
DecayingSkullz: https://www.youtube.com/watch?v=rXfS4wJoVLQ
zwisch: nanopore sequencing is apparently legit
cellophane11578: whats a flowcell? i know theres stems
Itsmeek0: GEORGE
pz3300: With the hot breath in your ear?
Itsmeek0: https://www.youtube.com/watch?v=rXfS4wJoVLQ
HexaField: can we get a TLDR of the last 3 streams?
murkythunder: when you make a proprietary tool and hotz starts looking at it monkaS
syzo__: the ADD is real
MrTriharder: @georgehotz @chat good morning from India admiralF1 admiralF2
brofessorbob: check amazon for reviews
tsAllySparkles: don't get auto-reset chips but you can def reset the DRM chips to say that the ink is full
Mint2bSpiced: you will still need a thermo cycler to prep the device https://youtu.be/iS1pz3IhJvU?t=173
cankunwang: minions movie review
SpaceGhost8: check amazon reviews
jimmyadaro: @HexaField Check his GitHub account
ooMariaoo: https://www.youtube.com/watch?v=rXfS4wJoVLQ this vid lol
HexaField: true, thanks
theonlymonkas: buy some minions
benchai18: DRM on a cartridge????
jimmyadaro: @HexaField https://github.com/geohot/corona
benchai18: What?
jimmyadaro: There u go
doctorgenus: I wouldn't be surprise if their next product is GRU
Nussinov: @Mint2bSpiced the camera man focuses on her tits the whole time LUL fucking creep
tsAllySparkles: for inkjet printers mostly @benchai18
Ayyyy420Lmao: man theres a protein pumping the dna through a pore in a membrane and electrodes measure the conductance and through this they know what base is passing through
brofessorbob: ligands
Br4nnon: @georgehotz watch that vid in chat
jimmyadaro: @Ayyyy420Lmao Can I put my dick in there?
Ayyyy420Lmao: @sure if it's only 1nm wide :^DDD
pz3300: Are you ever gunna get back to me on that @tsallysparkles,or not?
logi6000: wait a minute. George can't be a programmer. he's gone on a date!
omar3141: signing off.. late on the east coast. have a good night all
omar3141: and keep hacking away
AresRai: @jimmyadaro nano dick detected
jimmyadaro: @Ayyyy420Lmao Hmmm
botbotboot: it works on small scale electricity
benchai18: @tsallysparkles DRM on an inkjet printer? Am I getting wooosh’d rn?
DecayingSkullz: https://www.youtube.com/watch?v=rXfS4wJoVLQ
logi6000: @omar3141 I'm on east coast too
Nussinov: there are a few different strategies
brofessorbob: Any bros from San Diego?
tsAllySparkles: @pz3300 what?
jimmyadaro: @AresRai Do you prefer bigger dicks?
logi6000: @brofessorbob George it
logi6000: is
thecoder15: @brofessorbob yeah but i leave tomorrow
wholesome_pepe: nanoporetech.com/how-it-works
tsAllySparkles: yeah DRM
thecoder15: @brofessorbob you go to the hackathon?
tsAllySparkles: like
AresRai: @jimmyadaro gachiHYPER ofc
zwisch: you can sequence your entire genome for $100 in China
pz3300: Dr Peter duesberg sucks I’m that hiv is a harmless virus carried by 1/3 of the population
Nussinov: zwisch it must be cheaper
tsAllySparkles: you can only buy cartridges made by the original manufacturer of most lower-end printers
pz3300: Says
Bloodswordz88: it all leads back to China?
tsAllySparkles: but you can hack the drm chips
jimmyadaro: @AresRai Sorry, i didnt mean to waste your time LUL
Ayyyy420Lmao: i got mine sequenced for 400 eur in europe
brofessorbob: @thecoder15 nah, I'm from here.
tsAllySparkles: 23andme $200
tsAllySparkles: that plus promethease (genetic analysis tool)
doctorgenus: damnnn @georgehotz does this much research before buying? Wonder if people do that before they buy the EON as well
tsAllySparkles: it's pretty cool
joeyskitkat: yes watch this video about MinION https://www.youtube.com/watch?v=rXfS4wJoVLQ
HexaField: 23andeveryonetheysellyourdatato
MrTriharder: New virus found in China monkaS infects people who eat rodents monkaGIGA
tsAllySparkles: https://in4.us/Gb &lt;-- my genes
brofessorbob: @thecoder15 How was the hackathon. Who was hosting?
jimmyadaro: https://github.com/geohot/corona
pz3300: 23and me is bullshit
tsAllySparkles: yeah they do]
botbotboot: it doesn't always work
tsAllySparkles: just a set
HexaField: imagine doxing your own dna
thecoder15: commaAI hosted it lol @brofessorbob
tsAllySparkles: not everything but the data they get is pretty decent
jimmyadaro: @pz3300 No is not, i've worked with them
tsAllySparkles: much better than what's on their website
ahahahaitslit: lmfaoooo
Ayyyy420Lmao: why would u kill cereal?
jimmyadaro: LUL
Kemisdan: LUL
4zimut: 300 IQ
Mariosavitch: only a serial killer would think about that
imafungi53: hahaah
PiroFloydian: also then they literally own your DNA
ackxhpaez: that's thinking ahead
astrailz: LUL
jmv_chin: big brain
ideology_sniffing_raccoon: Trueeeee
vicmoney69: monkaS
imafungi53: genius
jmv_chin: big brain play
mburke005: ya fair
cellophane11578: cereal is inferior to ricecakes
ideology_sniffing_raccoon: 5Head
pjayys77: yup my reasoning too.. wait..
jimmyadaro: LUL LUL LUL LUL LUL
cellophane11578: duh
pz3300: @jimmyandro. They work on a 50% accuracy rate
theonlymonkas: PogChamp PogChamp PogChamp
SolarBerry: implying the CIA doesn't already have your DNA
Mariosavitch: 10/10 Serial Killer
brofessorbob: w00t!
Itsmeek0: have you been finger printed by the police?
jmv_chin: can u open ur freezer
jmv_chin: xd
brofessorbob: I have
codelumberjack: what do you think about taking DNA sample from citizens at birth?
zeus13i: @georgehotz - when will this reverse engineering be done? :) days? weeks?
benchai18: I ain’t giving any of those fcking agencies my dna. They can come get it outta my mouth like any respectable woman
KnollBoss: looking at an approved paper in Nature. Is this an ad?
nozpheratu: Couldn't a serial killer easily frame other people by putting their DNA on their victims?
Itsmeek0: my finger prints are in the system as well ;(
Nussinov: illumina is the coolest
jimmyadaro: @zeus13i Months, he said that yesterday
pz3300: I could guess your lineage as accurately as 23andme by looking at you
logi6000: if George becomes a serial killer and someone finds out. they are just going to blackmail him for eons
entangledbeing: Finally
entangledbeing: Illumina
murkythunder: tfw u get paid more than the ppl who make this tool putting buttons on sites
cankunwang: nanopore focus on 3rd gene sequencing, long reads sequencing
benchai18: @pz3300 SAME!!! That’s why the attorneys never choose me at jury duty. Cuz they know I can do that too just by looking at people
MrTriharder: @logi6000 I’d blackmail for stocks and bitcoins
guapcollector: turn that kitchen to a clean room
imafungi53: your fridge door is slightly open!
Nussinov: yuuup
Sky_Light_37: again LUL
swftdev: right?
jimmyadaro: Wow
theonlymonkas: lol
brofessorbob: Fake Lab Again???
joeyskitkat: yeah
jimmyadaro: ResidentSleeper
logi6000: @mrtriharder true
iGalactic: The lab is fake? 🥺
ideology_sniffing_raccoon: Again??? LULW
Nussinov: I still think you need a small amount of amplification, no?
swftdev: lul not again, last time it was a whole ordeal.
nomad119: Why do all of these biotech companies require 6 or 7 clicks to buy something jeez
zeus13i: @jimmyadaro - thanks! so comma is on hold?
jimmyadaro: @iGalactic Which one?
almonte550: Let's build another fake lab!
brofessorbob: Geo have you been to Hong Kong?
theonlymonkas: just buy it already ResidentSleeper
Itsmeek0: THE SIDE DOOR IS OPENING
KnollBoss: list shkreli's jail cell as the lab u work from
Itsmeek0: lol
jimmyadaro: @zeus13i Idk, he may have some other people working on that
tsAllySparkles: 4 degrees C would be above freezing lol
ahahahaitslit: is skhreli still in jail?
Itsmeek0: ^ yes
fukurowlz: @Nazhika
jimmyadaro: @zeus13i Keep in mind is 21:23 SF Time
jmv_chin: trolled
Ayyyy420Lmao: ahahahhaa
Kemisdan: LUL
ahahahaitslit: damn
DefinitlyNotXanbot: KEKW
faraday_lenz: LUL
jmv_chin: Xd
Sky_Light_37: https://www.youtube.com/watch?v=rXfS4wJoVLQ
C0deCane: LUL
cjbprime: lol
vicmoney69: LUL
DecayingSkullz: https://www.youtube.com/watch?v=rXfS4wJoVLQ
knilecrack: :D
Zameso: LUL
AresRai: LUL
DefinitlyNotXanbot: LUL
Incurs0: LUL
Nussinov: guarenteed geohotz will forget his ice buckets when doing his first experiments
opus_000: lul
brofessorbob: This guy fucks
ackxhpaez: I thought we live in a simulation
SpaceGhost8: lmao
Mariosavitch: ITS REALY
jimmyadaro: LUL
ideology_sniffing_raccoon: LUL
PiroFloydian: LUL
astrailz: LUL
aMANT3: KEKW
Penguino138: NOOOO
Mariosavitch: ITS REAL
logi6000: lol
aaaakshat: LUL
AresRai: Future is here
Nussinov: LUL
NagyOut: LUL
TheZarkxs: just watch joe rogan
C4TFive: THIS IS THE FUTURE
guapcollector: all those asmr recs
outlier2: LUL
Nussinov: FUTURE IS NOW
NagyOut: thats a rick roll right there
vicmoney69: put it between brackets
theonlymonkas: LUL
b0ngwizard420: LUL LUL LUL
MrDrSpace: FUTURE
iGalactic: LUL
theonlymonkas: buy some minions
brofessorbob: HeyGuys HeyGuys
Flipc01n: Lol
vicmoney69: put it between quotes to get it case sensitive*
aMANT3: unboxing
nozpheratu: That wasn't slowly
brofessorbob: StinkyCheese
guapcollector: slowly at 2x
braininavatt: george's into asmr Kappa
C4TFive: @Mint2bSpiced you were in 2120 with that link LUL
itsxaos: http://nextgenseek.com/2018/01/illumina-launches-iseq-100-for-20k-at-jpm-2018/
fukurowlz: @Nazhika
nomad119: RGB lets go
SpaceGhost8: just plug it in via usb
nomad119: it has to be good
jimmyadaro: LUL
pz3300: George’s search history is exotic to say the least
itsxaos: so the illumina thing runs you 20k looks like
cjbprime: it's got flashing lights I guess it must be legit
benchai18: I’m stupid
Mint2bSpiced: @C4TFive LUL good to see you
mburke005: Kreygasm
TheZarkxs: nice boobs
brofessorbob: boob
Nussinov: Kreygasm
Ayyyy420Lmao: im gonna cooom
guapcollector: why no rgb on the minION
theonlymonkas: Kreygasm
Nussinov: there are machines for that
faraday_lenz: we dont need to hear
murkythunder: my bio lab was a virtual lab on secondlife state uni is shit
SlaterUSA: george likes to pet the pies
NagyOut: side boob i s always good boob
nomad119: Those pipettes do all of the work
jimmyadaro: Kreygasm
brofessorbob: Hire hot lab chick to pipet for you.
ideology_sniffing_raccoon: Kreygasm
highxsnow_: james charles
Nussinov: they have machines for that: theyre called undergrads Kappa
Zameso: pipetting is super relaxing
pz3300: Pip -et George TF
Lizardan: Relax you all. pornhub premium is 100% free
SpaceGhost8: we bout to build a full on lab
ideology_sniffing_raccoon: COOMER
benchai18: @pz3300 Lmao
o______________________k: bio community aren't good at video quality loool
nomad119: just use sous vide
cankunwang: fking graduate students
TheZarkxs: Kreygasm
PiroFloydian: Church &amp; college in 1 Kappa
logi6000: at this point just set up a lab. in your new church of course
brofessorbob: ebay thermocycler
itsxaos: george there is a youtube channel that does this sort of stuff on the cheap, its called the thought emporium
Bloodswordz88: Georgehotz will become peter parker
ackxhpaez: nice puppies
botbotboot: there are
Nussinov: there is
cankunwang: coronaman
botbotboot: robots ones
zeus13i: those machines exist but they are wildly expensive
Br4nnon: it's like manually grinding coffee
kellyIake: there’s used lab equipment websites with transparent pricing like labdepotinc.com
bytebacon: @itsxaos thought emporium is really cool
murkythunder: get a thermo cycler on alibaba for 50% of ebay Pog
Mariosavitch: lol
SpaceGhost8: PogChamp
ideology_sniffing_raccoon: LUL
jimmyadaro: LUL
Mariosavitch: comma.bio
AresRai: PogChamp
botbotboot: you should
SpaceGhost8: DO IT
Nussinov: LUL
AresRai: BIO AI
fukurowlz: Pog
julien9877: tax writeoff Pog
Ayyyy420Lmao: just rename to coronaAI
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
SpaceGhost8: open source bio PogChamp
pjayys77: yes
Santiago_LHC: CommaDNA
theonlymonkas: JUST DO IT
joshperri: Call it coma ai
logi6000: @mariosavitch beatmetoit
ideology_sniffing_raccoon: PogChamp
ak0ya_: DO IT!
thecoder15: ghost virus for the masses @georgehotz
pz3300: George
botbotboot: i already bought it
ak0ya_: so much fun
TheZarkxs: put some socks on ffs
AresRai: HYPERS LET DO IT
Br4nnon: bio.comma.ai Kreygasm
guapcollector: enter.ai
Mariosavitch: no
ackxhpaez: Half of chat is going to try to buy that domain
jimmyadaro: We're alone boys, let's snort some coke mffffff
MrTriharder: PogChamp yes
sunole: 400,000 new people have joined Folding@Home’s fight against COVID-19 The quest to thwart the virus has strong help from distributed computing. Jon Fingas Jon Fingas, 03.23.20 The Folding@Home community has turned its attention toward the fight against COVID-19, and it now has massive computational power at its disposal as a result. The distributed comp
almonte550: fake lab on the way
iGalactic: Lol
Santiago_LHC: COKE
o______________________k: comma.bio
Lizardan: I'll go buy it and will sell it back to him Kappa
theonlymonkas: hands
ideology_sniffing_raccoon: PJSugar PJSugar
jimmyadaro: PogChamp
codelumberjack: lol
mineyful: loud ass flush
whyZaya: I bought it. Kappa
Nussinov: biomma
benchai18: @santiago_lhc Shhhhhh
wholesome_pepe: if u scale up im sure ge life science has some tech for pipetting
zwisch: CommaBio: Taking driver monitoring to the extreme
AresRai: strong flush
fukurowlz: wash your hands
jimmyadaro: LUL
aMANT3: FLUSHHHH
4zimut: damn squatters
Joshh185: Is he okay
iGalactic: Don’t forget to not wash your hands
ahahahaitslit: adderall shot
theonlymonkas: HANDS
fukurowlz: nice job
elephantpandas: super glue them onto a back massager
OlympusDev: It's $74.88/yr if you want to buy it lol
mineyful: THAT WASN"T LONG ENOUGH TO WASH
pjayys77: mm 20 seconds?
dzid26: Hydroxychloroquine Dashcam
jimmyadaro: WASH YOUR HANDS
Lizardan: comma.bio is available PogChamp
Santiago_LHC: Those were NOT 20 seconds!
theonlymonkas: SwiftRage 20 sec!
whyZaya: HE ONLY WASHED HIS HANDS FOR FOUR SECONDS.
zeus13i: @georgehotz I would work at your bio division ... PS: outsourcing some of this might be useful? eg. https://www.cloudlab.us
PiroFloydian: coma ai or corona ai?
inciMage: new epidemic called Hantavirus from china
superduperepic: superduperepic subscribed at Tier 1.
Santiago_LHC: TWENTY
doctorgenus: bio division for comma.ai, clone people to drive cars for you
lefse: i dont have corona virus, i dont need to was my hands SMOrc
benchai18: And now he’s gonna put his fingers in his mouth ‼️
jimmyadaro: WASH YOUR HANDS!
Mariosavitch: looks can be deceiving
jimmyadaro: gosh george
TheZarkxs: ez science ez life
fukurowlz: a poor hand's wash and you pretend to open commabio?
jimmyadaro: that's fck upd
fukurowlz: Kappa
Nussinov: concepts are easy but getting things to work is hard Kappa
aMANT3: YOU NOT GONNA EAT THAT
logi6000: what is backspace exactly.
jimmyadaro: WASH YOUR HANDS
pjayys77: yea.. really easy
Sky_Light_37: imagine having a bio divison named comma, not good man, not good
jimmyadaro: WASH YOUR HANDS!!!!!!
HexaField: bio division for comma.ai, clone people to drive cars for you
whyZaya: @georgehotz Wash your hands for 20 seconds.
brofessorbob: BioBrosAI
imafungi53: bio is applied math
Santiago_LHC: 20 seconds hand washing! You'll die!
fukurowlz: nasty
syzo__: excited for backspace.ai though BibleThump
jimmyadaro: no u didnt
sunole: Froze?
jimmyadaro: no way
iGalactic: Chat 🤦🏼♂️
Lizardan: Bio is a lot of memorizing unlike match which is a lot of reasoning
pz3300: Every day your NSA jacket is getting bigger. I’m starting to get worried about listening to you george because if they can get to you, they can get to me, and I can’t let that happen.
mineyful: wash them again
jimmyadaro: that was too quick
Br4nnon: tangerines &gt; oranges
Nussinov: Kappa
logi6000: what is backspace tho
theonlymonkas: BibleThump BibleThump BibleThump BibleThump
tsAllySparkles: someone subscribed
vicmoney69: Kappa
braininavatt: tomorrow: "George Hotz says creating a COVID19 vaccine is easy"
pjayys77: uh I counted 15 seconds of washing
whyZaya: @georgehotz Four seconds is not long enough.
benchai18: Is that a blue bell
Mariosavitch: cheater
wholesome_pepe: hire pharma bro martin shkreli as CFO
brofessorbob: What tricks did you pul?
thrashtazs: are you worried about your company during this time
lefse: i wont was my hands until there is military poiting m16's at me
guapcollector: backspace is like canonical form for code right
cybergenik: me
jimmyadaro: WASH YOUR HANDS AGAIN
Mariosavitch: me
cybergenik: me /
TheZarkxs: not me
Lizardan: not me
Irdi18: Not me
AresRai: not me
cellophane11578: me
kwirny: bruh
devm0d: I'd pay $100
SpaceGhost8: if it was repeatable, me
brofessorbob: A lot
alameda13: not me
imafungi53: i dont think so
tsAllySparkles: i'd barely pay a grand for a comma 2
11plus4thinking: not me
HexaField: make it 100 and you're a rich man
Combat__ex: One of my best friends died of pneumonia symptoms. Not sure if coronavirus :( :( :(
Nussinov: I probably would LUL fuck it
theonlymonkas: not me LUL
brofessorbob: We all think we have it in SD
iGalactic: Nope
jimmyadaro: WASH YOUR HANDS
ak0ya_: not me
murkythunder: id rather get $1000 and corona than get the test
360Plato: that will get you alabelled a terorist
Mariosavitch: i have a test.. stay in door
Zameso: @georgehotz (just entered the stream) can you briefly explain what your working on at the moment pls ?
codelumberjack: now the serial killer bit makes more sense
ImJ4Gu4R: anyone herd about hantavirus? someone get infected
logi6000: how much can you get a thc test for. that much
cankunwang: testing is cheap, the problem is trump
tsAllySparkles: oh it'd be dope to have it at home
syns0r: franchise it
julien9877: @georgehotz add online signup and youre good
botbotboot: you need astronaut suits ahahah
jimmyadaro: 1k would be CHEAP
doctorgenus: or bio comma.ai can get self walking people. They don't need to think about walking from point A to B and think about other things
ImJ4Gu4R: its not new but got new case in china
swftdev: only if I can 3d print with it
inciMage: @ImJ4Gu4R i did
ziggyzergling: Problem is swab material is running low...
brofessorbob: we all have corona in SD
pz3300: I’ll test your weed for ya
TheZarkxs: nah, its much more fun if i dont know
jimmyadaro: "old"…
benchai18: @imj4gu4r Yup. We’re getting played like a fiddle out here in the statea
guapcollector: put the test in every mcdonalds drive thru
jimmyadaro: "30"…
wholesome_pepe: new york will buy them all right now
Mariosavitch: ..........
SpaceGhost8: monkaS
Irdi18: FBI
PiroFloydian: considering 40% of people cant afford a $400 emergency, probs not a lot @georgehotz
ahahahaitslit: is backspace ai donezo?
zwisch: monkaS
vicmoney69: monkaS
ideology_sniffing_raccoon: monkaW
logi6000: what were you like as a kid
SpaceGhost8: FBI, this guy here monkaS
devm0d: What if you could do more than just covid-19, you could test yourself for whatever sequence you download, similar to 3d printers
11plus4thinking: monkaS
jimmyadaro: WASH YOUR HANDS
zennydmt: do you feel different physically at 30 vs ur 20s?
iGalactic: Lol
Nussinov: yeah wake up in the morning, grab a coffee, butter your toast and stab yourself in the nose with a corona kit
itsxaos: good choice
elephantpandas: when did you monkaW
Mariosavitch: uh yeah
logi6000: time to find it
pjayys77: yea when I went to College I looked if there was a serial killer Major
ImJ4Gu4R: @inciMage yeah.. its on every news header
logi6000: out
benchai18: @georgehotz DID U WATCH LEX FRIEDMANS CORONA VIDEO?!???????
vicmoney69: you can still do it just dont wash your hands 5Head
pz3300: Why did you kill animals
theonlymonkas: it's never too late
Mariosavitch: who would be your first
imafungi53: whats so good about it
brofessorbob: SDSU
Lizardan: You do look like a serial killer
adamalex16: bruh the fuck is this stream
octeezy: Nah, its only you
Ayyyy420Lmao: you still want to become one you just need a bit of twitch chat support to go trhough
mashafique: monkaS
SpaceGhost8: lex friedman PogChamp
theonlymonkas: it's better late than never
cankunwang: 47
jimmyadaro: Lex &lt;3
pjayys77: its true he's outting us all out
elephantpandas: amiloFeels FBBlock justke10Virus
inciMage: @ImJ4Gu4R where are you from its just on socil media where i live
brofessorbob: blowhard
mashafique: Lex PogChamp
Nussinov: who is this joker LUL
HexaField: that is so lex lol
julien9877: Lex PogChamp
rickoftheroot: I found you through his podcast PogChamp
iGalactic: LOL
adamalex16: mac
TheZarkxs: "existencial"
adamalex16: gross
ImJ4Gu4R: @inciMage Malaysia
theonlymonkas: WutFace
pz3300: Lex the robot
Mariosavitch: why
ShredderSherlock: 5 paragraph essay
jmv_chin: LUL
Incurs0: Lex PogChamp
PiroFloydian: who is this dude?
adamalex16: imagine using apple
murkythunder: lex fridman vids ResidentSleeper
adamalex16: fucking grosss
adamalex16: apple nastyyy
hypertextlabs: please
Nussinov: LUL
jimmyadaro: LU
theonlymonkas: ResidentSleeper ResidentSleeper ResidentSleeper
Lizardan: LEx is boring to watch
cankunwang: pllzzzzz
jimmyadaro: LUL
HexaField: flex freeman
ahahahaitslit: lex fridman hotz part 2
benchai18: @georgehotz you’re welcome
PiroFloydian: who is lex?
C4TFive: Lex is the best
brofessorbob: MAGA
logi6000: after this stream I'm boutta watch it too
Lizardan: Watch Eric Weinstein insteasd
opus_000: you should get on Eric Weinsteins podcast
Nussinov: give me hilary^2 before this one
doctorgenus: what do you think about lex? he interviewed you
nremind: he's russian though
jimmyadaro: @PiroFloydian Some other god
devm0d: you ever make with that chick that works with you?
mashafique: You gotta do another interview with Lex.
bytebacon: DOES LEX CODE?
SpaceGhost8: Lex would run this country like a machine, and we'd all be better off for it
itsxaos: LEX MADE A PODCAST WITH THE SOLE PURPOSE OF ASKING PEOPLE FOR AI GFs
elephantpandas: but they want a business man LUL
Zameso: @georgehotz (just entered the stream) can you briefly explain what your working on at the moment pls ?
benchai18: Yes he codes
ahahahaitslit: listen to the portal ffs
HexaField: go on Eric Weinstein's the Portal bro!
ahahahaitslit: by eric
jimmyadaro: @bytebacon Kinda
Lizardan: @georgehotz Benjamin Goerrzel
ahahahaitslit: thank fukc
brofessorbob: Not Donald Trump?
zennydmt: is lex friedman a polymath?
Hawklite: start a philosophy branch of comma ai
HexaField: It's Stein like Einstein
murkythunder: lex fridman isnt hype like trump ResidentSleeper
pz3300: Lex is a KGB robot
doctorgenus: and then read the new one punch man episode
zennydmt: would you consider urself a polymath?
pz3300: Eric is a blowhard
guapcollector: peter thiel sounded pretty unhinged on that portal pod
zennydmt: do u like ben shapiro?
Mariosavitch: plz
ahahahaitslit: lmfao
ShredderSherlock: are you a math guy or a bio guy or what?
hypertextlabs: haha
vicmoney69: 5Head
itsxaos: voteYay
TrippinFlare: LUL
rickoftheroot: LUL
Incurs0: LUL
Irdi18: LUL
TsarSec: thats some authoritarian shit LUL
jimmyadaro: LUL
vicmoney69: LUL
itsxaos: voteYea
Combat__ex: @georgehotz Do you think R is better for bioinformatics?
Abnico: Harvey Weinstein has a good podcast also
theonlymonkas: LUL
inciMage: @ImJ4Gu4R youre close to china maybe thats why new news widespread im on turkey only social media news are spread
brofessorbob: DBZ?
joshperri: Stop getting sidetracked
mashafique: You should watch Steins;Gate @georgehotz
itsxaos: VoteYea
nremind: the government is currently trying to ban encryption LUL
benchai18: @abnico Hahahahahaha
devm0d: LUL
SpaceGhost8: LUL
bytebacon: Joe Rogan 2020
zennydmt: Ben Shapiro?
pjayys77: what are the chances Yang knows how to code
Mariosavitch: authoritarian serial killer
Nussinov: print("But Her Emails")
jimmyadaro: @zennydmt Hell nah
zennydmt: Would you go on the joe rogan show?
elephantpandas: danX yes
pz3300: Eric will infect your mind george don’t let him
itsxaos: @georgehotz Lex wasnt born in US sadly
Lizardan: @zennydmt he said he wont
logi6000: @nremind EARN IT ACT GEORGE YOU NEED TO LOOK INTO THIS
benchai18: @zennydmt No. I offered to get him on JRE and he didn’t wanna
syzo__: trump is a poorly trained Markov anyway
devm0d: Mother Russia
zennydmt: @Lizardan thx
Mariosavitch: russia russia russia
ImJ4Gu4R: @inciMage yea maybe, the news here just add some more panic here.
Combat__ex: Edward Snowden for President Kappa
cankunwang: next putin
theonlymonkas: PUTIN
zennydmt: @benchai18 thx
pz3300: He was born in a factory
devm0d: So what comma hacks apply to bio?
bytebacon: What about Naval yo
SOmedude456: George when was the last time you opened IDA?
pepelaugh0: @georgehotz would you do Rogan now that you’re part time at comma?
eaterenrgy: @syzo__ What does that mean?
jimmyadaro: Lex
brofessorbob: Have you met Putin before?
Ayyyy420Lmao: there's no next putin he will clone himself
guapcollector: putin writes fortran
TsarSec: LUL
timi13462: what computer do you use
theonlymonkas: you resemble to putin
zennydmt: do you know anything about bayesian statistics
TsarSec: eugenics
Bloodswordz88: HahaThisisfine
octeezy: How is coding helpful for a politician?
vicmoney69: 5Head
joeyskitkat: WHY ARE THE FKING GROCERY BAGS OUTSIDE
Mariosavitch: thats the test?
imafungi53: thats too basic
theonlymonkas: P V A L U E S
PiroFloydian: @georgehotz Bernies good there
elephantpandas: if you are not putin you are tootin lirikHAPPY
pjayys77: Well Bernard is your guy
SOmedude456: @georgehotz when was the last time you opened IDA?
PiroFloydian: i would think
brofessorbob: Pootin in yo face
murkythunder: can they google their way to a stack overflow article answering their question
astrailz: Listening to experts would be a start
jimmyadaro: Stop consuming plastic
SolarBerry: putin is pretty based tbh
TsarSec: im pretty sure theres a name for that
Mariosavitch: experts.. lol @astrailz
vicmoney69: thats actually not a bad idea tho
timi13462: what computer do you use
zennydmt: Do you think Bill Gates would be a good president
logi6000: look up the earn it act
jimmyadaro: IT'S OK
kwirny: Its adorable
architectzs: what’s up geo what’s y#ur number one tip for learning to code?
brofessorbob: Pootin spell is better than Putin
knilecrack: putin is king
hypertextlabs: drink water
elephantpandas: wut lirikS
aMANT3: TOS
itsxaos: we still havent cured corona BibleThump
Lizardan: TRUE
pjayys77: uh oh *thinking about offending ppl
Mariosavitch: pootin
rickoftheroot: monkaS
mashafique: monkaS
doctorgenus: is that lipton tea?
echobrother: what do you think abou the deep state making the crona virus in a lab
Nussinov: monkaS
pz3300: You started it
TsarSec: https://en.wikipedia.org/wiki/Technocracy @georgehotz
Waldoqq: tyler1Yikes Politics
Combat__ex: Merkel has a degree in quantum chemistry Kappa
o______________________k: monkaS
jimmyadaro: LUL
SolarBerry: riot in chat
imafungi53: did we cure corona yet
jimmyadaro: Nah man
Ayyyy420Lmao: have you read stuff by hans herman hoppe?
aMANT3: TOS TOS
Nuroki: one more word about mr. Putin and we shall deploy forces on u KKomrade
devm0d: when you gonna have some emotes on your channel? I got shit to unlock
aMANT3: BANNED
rickoftheroot: LUL
elephantpandas: justke10Gun
benchai18: @pepelaugh0 Dude I asked him just a few months if he wants to be on JRE and he said no. Said he doesn’t want the attention. Had nothing to do with comma
SOmedude456: inb4 george gets assassinated
bytebacon: PUTIN WILL SEND ELITE HACKERS AT YOU
logi6000: it's about banning encryption
AresRai: @Combat__ex thats true so why the Kappa x)
doctorgenus: is the coronavirus impacting your company? Is everyone working from home more productive?!
Nussinov: blessed is our lord and savior vladimir putin
vicmoney69: the govenmnent wants to ban encryption
knilecrack: he was in KGB
cellophane11578: 16 yrs
isalhi: Any good recs for a python task que that’s not celery?
vicmoney69: yeah he was
devm0d: Putin ROSE TO THE TOP bro
Incurs0: LUL
jimmyadaro: Yep
TsarSec: yeah he was / is KGB LUL
devm0d: Put in the work
o______________________k: Hassanabi vs got what a stream
Abnico: Congress anounced they are all going on the same tmobile plan to save money
elephantpandas: lirikS so he knows what you just said
jimmyadaro: Nothing wrong thertr
vicmoney69: he knows kung fu
dudvdx: how do you get sodium into cells!?
logi6000: earn it is about banning encryption
highxsnow_: puti mad
benchai18: Obv.
pz3300: He was the head
architectzs: what’s up geo what’s y#ur number one tip for learning to code?
AresRai: KGB taught them to code
SolarBerry: thuggin' around the berlin wall
benchai18: Putout
Nuroki: He is going down guys, RIP Hotz xxx-2020
brofessorbob: Pooootin was in the KGB.
guapcollector: onION
elephantpandas: quick maff lirikHAPPY
chucknorrisbeard12: KGB became FSB
C0deCane: LUL I always picture putin riding a horse with no shirt because of that meme ahaha
pepelaugh0: @benchai18 I wish he did. I remember him mentioning he doesn’t want the attention but I thought that was because of comma but might not be right
Mariosavitch: lol
opus_000: Putin looks like a thug tho
jmv_chin: LMFAO
jimmyadaro: lmaaaao
theonlymonkas: SCAM
jimmyadaro: LUL
braininavatt: HahaThink
cankunwang: Scam from NIH
echobrother: what do you think about the coronavirus was created by the deep state in a lab in china
Nussinov: I did the same thing when buying cheese this morning, am I the same as this hacker
TsarSec: added value Pog
jimmyadaro: quick maths
vicmoney69: scam
devm0d: What if Comma comes out with a DUI mode that you have to blow into to start the car AAAND sequences your data??
guapcollector: onION is only available on darkweb
C0deCane: do the 50, 000 and its a tax write of for comma LUL
Bloodswordz88: gofundme brother
julien9877: RND COSTS THO
Zameso: 5 bucks ducktape LUL
doctorgenus: use the comma trust fund to fund the bio department
theonlymonkas: LUL great math
architectzs: what’s up geo what’s y#ur number one tip for learning to code?
thecoder15: @georgehotz loss leader my
l1ght5p33d: Duct tape will work for sure
brofessorbob: Comma DUI?
AresRai: @C0deCane what taxes LUL losing business for now oh wait...
itsxaos: @georgehotz the GridION comes with 50 cells
murkythunder: does comma have free lunch
C4TFive: Make sure you check Ebay first HahaThink
guapcollector: stop spamming noob @architectzs
Nuroki: maan, its more than 48 per test
Nuroki: hours*
theonlymonkas: buy it
Nuroki: dont do it
Mariosavitch: 300 flow.. a billion dollars
theonlymonkas: do it
Itsmeek0: yea, but did you check ebay yet?
elephantpandas: lets just rent one and buy a bubble boy suit danX
Itsmeek0: or craigslist?
benchai18: Jorge is it true u stole sauriks gf in 2010?
cellophane11578: i wish i had some dinosaur DNa to sequence
logi6000: earn it act is about banning encryption. its important.
devm0d: What if Comma comes out with a DUI mode that you have to blow into to start the car AND sequences your RNA for Covid-19??
echobrother: what do you think about the coronavirus was created in a lab in china by the deep state
joeyskitkat: cmon, you have money. Buy the expensive kit
l1ght5p33d: I HATE when they don't do the math
doctorgenus: quick go find a coupon code
elephantpandas: LUL
Mariosavitch: lol
theonlymonkas: it's a great deal Kappa
C4TFive: LUL
ideology_sniffing_raccoon: LUL
Nussinov: LUL
Panda1Express: hahaha
Incurs0: lol
vicmoney69: LUL
360Plato: they sell to the government do you think they do mathj
theonlymonkas: LUL
l1ght5p33d: #DOTHEGODDAMNMATH
pepelaugh0: LUL
4zimut: by price?
PiroFloydian: B O O K
pjayys77: is this where we go to Dakest of Webs
doctorgenus: try the coupon freeshipping
l1ght5p33d: RTFM
pjayys77: you'll find it
pz3300: Just order a couple of hookers and an 8 ball george. Let’s get this party started
logi6000: earn it act is about banning encryption
jmv_chin: deep google tunnel
Nussinov: they foretold of the MiniON takeover
devm0d: Spindrift VS La Croix?
brofessorbob: We all have Covid-19
jimmyadaro: PogChamp
devm0d: I sure as shit do
devm0d: It burns when I pee
devm0d: that's a symptom right?
theonlymonkas: Kappa
codelumberjack: are you aggregating info for reference?
PiroFloydian: @georgehotz check the vietnam response to covid19
jimmyadaro: @devm0d Kreygasm
guapcollector: diet coke reigns supreme over all that dumb flavoured water
brofessorbob: @devm0d Sounds like you've been in Hong Kong too long
mashafique: Dr.Pepper gang.
jimmyadaro: @codelumberjack Yep, to his github repo
devm0d: I live near lake titty kaka
jimmyadaro: @codelumberjack https://github.com/geohot/corona
lefse: imagine living in north korea now Kreygasm
cellophane11578: ^
theonlymonkas: Kreygasm
echobrother: can you do hacking tutorials
l1ght5p33d: I wonder what kind of sex kim jun linkes
mrhdr: Kreygasm
codelumberjack: @jimmyadaro thanks, starred
logi6000: @echobrother what do you think this is
jimmyadaro: @echobrother a n a l
mashafique: @l1ght5p33d probably the kind involving chains and hand cuffs
Ayyyy420Lmao: this is shitposting on github
theonlymonkas: you better find the cure
thecoder15: living in Russia would be dope
brofessorbob: Going to watch some ASMR. Any recomendations?
timi13462: you open alot of windows
jimmyadaro: @brofessorbob cherry crush
brofessorbob: recomend to your bro
mashafique: @brofessorbob shibbysays
jimmyadaro: she does
jimmyadaro: iykwim
brofessorbob: thanks bros
jimmyadaro: ;*
Nussinov: you need a forward and reverse primer, there are websites you can design these on (WHO should have done this Kappa )
jimmyadaro: ^
Nussinov: actually idk for NGS
Mint2bSpiced: keep scrolling until the flow chart
Nussinov: im dumb
ImJ4Gu4R: test
l1ght5p33d: open source nanomaterials
Combat__ex: @georgehotz EXACTLY. RT-PCR is used to measure the amount of a specific RNA
ImJ4Gu4R: asmr
ImJ4Gu4R: lol
wisamalrawi: https://techcrunch.com/2020/03/24/mesa-biotech-gains-emergency-fda-approval-for-rapid-point-of-care-covid-19-test/
PiroFloydian: @georgehotz check the vietnam response to covid19
jimmyadaro: ^^
cellophane11578: if u were on joe rogans podcast, he would interrupt with a question regarding dmt
logi6000: why did you call it comma
ImJ4Gu4R: @PiroFloydian link bro
Ayyyy420Lmao: yeah RT stands for Real time
Ayyyy420Lmao: it measures quantity each cycle
l1ght5p33d: open source dmt
cellophane11578: yes
Combat__ex: @cellophane11578 JAMIE PULL THAT UP FOR ME WILL YA
Combat__ex: Kappa
cellophane11578: dna heal me bro
jimmyadaro: @l1ght5p33d i'm in
Nussinov: Ayyyy420Lmao reverse transcriptase. youre thinking of qpcr
mashafique: @cellophane11578 LUL
Ayyyy420Lmao: wtf they changed the acronyms or something since i studied this sthiet Kappa
logi6000: it's almost 1 am here
rickoftheroot: LUL
Bloodswordz88: HahaThisisfine HahaThisisfine HahaThisisfine
Nussinov: Ayyyy420Lmao no, its just that molecular biologists want us to be confused
inciMage: windows xp
julien9877: #ad
l1ght5p33d: Nano Lifee https://www.scienceinschool.org/content/decoding-dna-pocket-sized-sequencer
jimmyadaro: 1:45 a, here
o______________________k: such stupid pricing LULW
jimmyadaro: am*
lefse: 5:45 am here
yevheniiushtyk: yo
lefse: we on that corona time schedule
11plus4thinking: A LOW PRICE OF 19K :)
Bloodswordz88: windows XP homie
Combat__ex: LUL
knilecrack: :D
Combat__ex: on ebay LUL
jimmyadaro: LUL
knilecrack: you are getting raided
Lizardan: Next Heisenberg PogChamp
Bloodswordz88: piratebay
o______________________k: FBI OPEN UP
Nussinov: lots of lab equipment is bought on ebay guys chill LUL
SpaceGhost8: FDA, OPEN UP
wholesome_pepe: alibaba?
knilecrack: :D :D
cutza: "underground"
Irdi18: I can hook you up with the primers LUL
logi6000: change the title to starting an illegal corona lab
meteorlake: sumS
sneezy94: sneezy94 subscribed with Twitch Prime.
SofiaLouise: !uptime
jimmyadaro: @logi6000 yes
murkythunder: illegal biology lab where you cant talk louder than a whisper
o______________________k: squadQ squadQ squadQ squadQ squadQ squadQ squadQ squadQ squadQ squadQ squadQ
joeyskitkat: Hows your TSLA stock doing George?
syzo__: ice
eksdee_1_2_3: spare coochie?
SolarBerry: lack of PPE is slowing down testing
nomad119: https://openpcr.org/
jimmyadaro: Eat fkng onions mf
Combat__ex: @georgehotz You have to have make sure that absolutely no contamination occurs in PCR. Contamination was responsible for the hype for Tardi Gras being an immortal animal
logi6000: biology is one hop from chemistry. chemistry is one hop from George becoming Jessie Pinkman. I found the meaning to these streams
ziggyzergling: primers and swabs supplies are running low
meteorlake: lol @logi6000
architectzs: what’s up geo what’s your number one tip for learning to code? thanks
julien9877: @georgehotz thats what the news in germany said, "any basic lab can do corona tests with the machines they already have"
cellophane11578: @jimmyadaro i have a clip of me eating a raw onion like an apple
entangledbeing: @joeyskitkat When did he buy lol
Mint2bSpiced: It has to do with the fact that the test was not made for "High Throughput" testing. Meaning you can only test ~ 49 sample every 4 hrs per machine
0R4NG3: yooo
Combat__ex: yes, PCR isn't that hard to perform tho.
terradyn: theranos.ai
jimmyadaro: @Combat__ex Really??
meteorlake: i love the alternate universe where george is a drug lord.
jimmyadaro: @cellophane11578 Send it to me
Mint2bSpiced: *samples
THX1342: !uptime
Nussinov: @georgehotz oh remember that asmr girl? she codes in some of her videos 4Head another video for you to watch tonight Kappa
o______________________k: squadCozy squadCozy
SolarBerry: in NYC they are considering infusing blood of recovered patients with the very sick to transfer antibodies
cybergenik: 1 mol is nothing
itsxaos: pico &gt; nano
itsxaos: right
cybergenik: that picomols
Santiago_LHC: DAFAQ
Thotshotgg: When are we playing plague inc?
Combat__ex: @jimmyadaro yes, google " tardigrade contamination "
DecayingSkullz: MedChemExpress
jimmyadaro: @Combat__ex i will
o______________________k: squadPH sweet
dingus74: lol
codelumberjack: if they are big pharma, are you small pharma?
11plus4thinking: gay walk KappaPride
cutza: attomols
Nussinov: huge brain
Ayyyy420Lmao: 2g is a normal amount of hydrogen?
jimmyadaro: @Ayyyy420Lmao 2g is like $10
wholesome_pepe: price gouging LUL
architectzs: what’s up geo what’s y#ur number one tip for learning to code?
Ayyyy420Lmao: dude just mix aluminum paper with hydrochloric
SpaceGhost8: smol pharma :)
murkythunder: its pricing for an institution not an individuaal
Ayyyy420Lmao: 10bucks my ass
d0ubletruth: big oil?
itsxaos: how long until shkreli gets out? LUL
PiroFloydian: we do
Rovelo: 🤔 what is he buying
jmv_chin: big brain
PiroFloydian: Big oil
ahahahaitslit: big tech
itsxaos: we need him on this
rickoftheroot: big brother
ahahahaitslit: is a thing
ideology_sniffing_raccoon: EZ SCAM
jimmyadaro: @Ayyyy420Lmao I'll do it for that money
PiroFloydian: bog tech
shoji22: indonesia here
roystang: is that a mandarin sir
julien9877: big data Kappa
Nussinov: big cock
Thotshotgg: How was your day today George?
BubbatheVTOG: big oil
o______________________k: big tech
jimmyadaro: BBC
isalhi: big paint
PiroFloydian: big tech
cutza: big pasta
Rovelo: im getting worried that you'll make a deadly virus george 🤔
Penguino138: Big Chicken
d0ubletruth: big pmol gang
joeyskitkat: bigAI
dingus74: Bbc lol
pjayys77: bigLy
l1ght5p33d: smol test
flvs: big cock
codelumberjack: big milk is an amusing local one
murkythunder: big nut
BubbatheVTOG: big tobbacco
jimmyadaro: big 9/11?
theonlymonkas: how do you feel?
isalhi: Big celery
dingus74: big pp
ShredderSherlock: p mol is smaller than nmol
sunole: 400,000 new people have joined Folding@Home’s fight against COVID-19 The quest to thwart the virus has strong help from distributed computing. Jon Fingas Jon Fingas, 03.23.20 The Folding@Home community has turned its attention toward the fight against COVID-19, and it now has massive computational power at its disposal as a result. The distributed comp
theonlymonkas: big p value
ShredderSherlock: isnt that good if you need less of the sample then
jimmyadaro: big nuts
elephantpandas: amiloScary probe wat
jimmyadaro: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
lefse: i lost
jimmyadaro: he's thinking about it, like fr
lefse: Kreygasm
FireDragon12: the fuk is going on
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
creasy_adc: Why Gorge look short af
vruthlessv: rip colon
jimmyadaro: eAT SOME GARLICK MF
jimmyadaro: MMMFFFFF
jmv_chin: it's cause he has a big brain
Nussinov: isnt he 6"2? LUL
jimmyadaro: and onions
jimmyadaro: u know
ShredderSherlock: where di you buy those sweatpants at
logi6000: George your birthday one day before mine
joeyskitkat: AND GINGER
Ayyyy420Lmao: does rtpcr need dna or rna primers?
Lizardan: @creasy_adc cause he's short duh
jimmyadaro: YEAH EAT GINGER MF
pjayys77: uh Big Mac *but should I go outside.. bruv
jimmyadaro: AND DRINK TEA
jimmyadaro: we need ya
jimmyadaro: stay alive
jimmyadaro: mf !
FireDragon12: people who eat into others ears can just go...
joeyskitkat: AND ICE MF
jimmyadaro: YEAH EAT ICE
jimmyadaro: wait, what
logi6000: no chewing ice
jimmyadaro: why ice?
architectzs: what’s up geo what’s your number one tip for learning to code?
joeyskitkat: Idk, just throwing it in the mix
joeyskitkat: ICE!
o______________________k: squad1 squad2 squad200
jimmyadaro: @architectzs Keep doing stuff
cellophane11578: take a bath in vinegar
jimmyadaro: @joeyskitkat Sounds good to me
C0deCane: Maybe you should change your nickname to biohot Kappa
logi6000: chewing ice is banned
julien9877: @georgehotz do they have free prime shipping?
jimmyadaro: YEAH VINEGAR MF
pjayys77: I think he said the other day, just do it
jimmyadaro: @logi6000 Nice
THX1342: did you buy a PCR machine, georgehotz ?
darkzade: KKona
theonlymonkas: BUY IT
lefse: BUY 1000 of em
jimmyadaro: We were talking yesterday about learning to program, just do stuff
Rovelo: PogChamp only 230 for 1000 ?
logi6000: chewing ice has been banned
vicmoney69: ?
jmv_chin: what's your crappycase repo about?
theonlymonkas: ResidentSleeper
itsxaos: dont you need the machine to run it still??
jimmyadaro: PogChamp PogChamp PogChamp PogChamp PogChamp
Bloodswordz88: recreating sars DIY
Santiago_LHC: COMMABIO, yo!
theonlymonkas: LUL
AresRai: EZ
jimmyadaro: Comma Bio mf
Nussinov: LUL
elephantpandas: amiloScary FBBlock TheIlluminati
jimmyadaro: gg
vicmoney69: LUL
rickoftheroot: LUL
cutza: SMALL PHARMA
guinness84: have u tried running principal component analysis on Corona Virus
jimmyadaro: HAHAHAHA
Ayyyy420Lmao: nothing's legal
Rovelo: probably not LUL
jmv_chin: new startup is born Keepo
guinness84: The Secret answer
flvs: Small Pharma at its finest
pjayys77: uh What was the last part
OrlinTheMage: LuvSign LuvSign LuvSign
jimmyadaro: SMALL PHARMA b!tc#
ImJ4Gu4R: BIG PHARMA : knock2
theonlymonkas: LUL LUL
Nuroki: but u need someone infected to test KEKW
jimmyadaro: !Adderall
C0deCane: @georgehotz But a couple dozen 6 packs of those oxygen canisters off Amazon today, appreciate the great advice you gave us yesterday Kappa
theonlymonkas: F R E E
C0deCane: bought*
lefse: you look so evil when you drink
SpaceGhost8: any coupon codes?
logi6000: we all know this is how George is gonna get into the serial killer business. he's just going to unleash this on the white house
jimmyadaro: @C0deCane LMAO
SparksCx: infect yourself to test PogChamp
THX1342: did you play around with http://designer.genomecompiler.com ?
jmv_chin: how can you get a true boolean without bein infected Kappa
pjayys77: how does one drink evil
architectzs: hhkb
cellophane11578: lets swab up
jimmyadaro: Play Plague Inc again
Combat__ex: @georgehotz which protein or gene is the primer part of??????
architectzs: should i get an HHKB
ImJ4Gu4R: @jimmyadaro yo, they add new mods lol
64pillars: xacM
theonlymonkas: lol
64pillars: xqcM
SparksCx: xqcL
jimmyadaro: lul
julien9877: small NON COMMERCIAL pharma lab Kappa
THX1342: https://theminione.com/pcr-system/ &lt; cheap PCR machine
nomad119: Did you see this project? https://openpcr.org/
barkazzaz: xqcM
guinness84: jupyter notebooks in 2020 LUL
jimmyadaro: wait what
bytebacon: What window manager is that?
C0deCane: Here at comma labs, we care about people and we are not big pharma were small pharma some even say little pharma
64pillars: xqcM then profit
elephantpandas: you are going to end up like aaron traywick monkaS
jimmyadaro: @bytebacon Idk his but i recommend Magnet
THX1342: miniONE is the one thoughtemporium uses in his lab I think
knilecrack: AHAHA
jimmyadaro: LUL
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
architectzs: what’s a window manager?
theonlymonkas: genius
ImJ4Gu4R: corona virus has corona...seems legit
logi6000: this is George's way into the serial killer business. he's going to make his self made sars 2 stronger and unleash it on the white house
jimmyadaro: @architectzs Google it
julien9877: FDA, OPEN UP
TsarSec: corona all the way down monkaS
l1ght5p33d: so f#*#nh leet
theonlymonkas: PogChamp
jimmyadaro: @architectzs You can't be a programmer if you dont google enough
Nussinov: thank goodness
itsxaos: PogChamp CORONA CURED BY GIVING IT CORONA TO KILL IT?!
bytebacon: @jimmyadaro thanks, looks good
vicmoney69: PogChamp
jmv_chin: STRESS LEVELS
jmv_chin: XD
jimmyadaro: @bytebacon I use that :)
Bloodswordz88: "Learn How to Google"
theonlymonkas: xD
4zimut: wait N3? there is anew version?
jmv_chin: this is the most action packed googling
architectzs: does magnet the windows manager work for windows?
jimmyadaro: @Bloodswordz88 Well, it's important!
Ayyyy420Lmao: man even if it doesnt have the exact sequence it can give a positive, you should be runing some alignment score shit instead of exact find no?
jimmyadaro: @architectzs I don't think so
Bloodswordz88: hail brethren
architectzs: shid
logi6000: are you going to confirm or deny what is said?
jimmyadaro: Spectacle
codelumberjack: where'd you get your "corone"?
architectzs: what’s a good one for windows?
codelumberjack: corona*
jimmyadaro: https://www.spectacleapp.com/
cutza: do you need to get infected?
C0deCane: @codelumberjack you can get it at your local grocery stores, fairly cheap
jimmyadaro: Spectacle is not longer maintained hahaha
jimmyadaro: Use Magnet
nozoke: what are we doing
jimmyadaro: @nozoke Reverse-engineering COVID
pz3300: History will show the virus that ended the world was cooked in a homemade lab in NJ
architectzs: what’s a good one for windows? an manager
TsarSec: just hack their website and get it for free 4Head
itsxaos: sure, just send in your FDA lab certification and youre good to go Kappa
nozoke: oh noted ty @jimmyadaro
logi6000: @pz3300 San Diego
jimmyadaro: https://apps.apple.com/es/app/magnet/id441258766?mt=12
pjayys77: you mean they aren't gonna price gouge the hell out of medical devices
jmv_chin: IM EXCITED
doctorgenus: @georgehotz has boku bucks
TsarSec: amazin
julien9877: coding PogChamp oh nvm FeelsBadMan
jimmyadaro: Not RT push
jimmyadaro: lmao
Lizardan: Treatments***
timi13462: what is the github link
sunole: 400,000 new people have joined Folding@Home’s fight against COVID-19 The quest to thwart the virus has strong help from distributed computing. Jon Fingas Jon Fingas, 03.23.20 The Folding@Home community has turned its attention toward the fight against COVID-19, and it now has massive computational power at its disposal as a result. The distributed comp
C0deCane: LUL soon enough this "lab" will be a mobile lab in an RV in an undisclosed location
ShredderSherlock: i want to know about the black hole quencher
mr_stochastic: @georgehotz How is not having vim in Jupyter Notebook going?
Nuroki: booooooring
rickoftheroot: LUL
logi6000: @c0decane in El Camino
jimmyadaro: @timi13462 https://github.com/geohot/corona
architectzs: Anyone know any good windows managers for windows?
Mint2bSpiced: here is their instructions https://biosearchassets.blob.core.windows.net/assetsv6/product-inseert_2019-ncov-ruo.pdf
darkhtx1: just make a covid-20 thats infects covid-19 and kills it
Lizardan: @architectzs the default
architectzs: oof
doctorgenus: that's buku bucks
C4TFive: wait until he goes to checkout and needs .edu email for that price Kappa
Ayyyy420Lmao: eat big to get big
mr_stochastic: @architectzs yeah not much other than default
theonlymonkas: LUL
architectzs: idk how to work this shit haha
jimmyadaro: @C4TFive omg
THX1342: https://theminione.com/pcr-system/
architectzs: the default one
Sniky83: go activate donationz
architectzs: idk the keybinds
doctorgenus: looks important
itsxaos: 2000$ LID
Knarez: im out of the loop, what's george up to?
Appz_x: check amazon
cutza: will you need to get infected?
doctorgenus: he's trying to create a small pharma in his room
jmv_chin: he's building a small pharma
jimmyadaro: @Knarez Creating an illegal small pharma
pz3300: Don’t you need a virus making license George?
logi6000: @knarez starting a non fda approved small pharma
Nuroki: https://theminione.com/pcr-system/
jmv_chin: this is how startups are born
OrlinTheMage: don't do it to yourself!
jimmyadaro: so he can do COVID tests
C0deCane: American meth manufactures racing to find a cure. Here tonight of Fox!
Knarez: monkaS
doctorgenus: it's the start of the bio division at comma
THX1342: NotLikeThis
DecayingSkullz: https://theminione.com/pcr-system/
jimmyadaro: @C0deCane We talked about meth earlier before hahaha
logi6000: @knarez and becoming a serial killer
theonlymonkas: DO IT
nomad119: https://www.chaibio.com/sahara-hot-start-pcr-master-mix
jimmyadaro: @logi6000 That too
Combat__ex: Quantitative
jimmyadaro: https://github.com/geohot/corona
ackxhpaez: Yeah I always forget about the RNA extraction
whycopper: Hi George
sunole: George, look into protein folding.
cregger: this little project might be up there in the rankings of craziest things i've seen george pursue on stream LUL
logi6000: this is all fake on his second monitor he's looking up arsenic pills to fake sell as adderall
doctorgenus: damn a lot of stuff you need. guess why there's money in pharma
jimmyadaro: @cregger Same
Nussinov: more letters = more expensive
AresRai: @sunole he looked into it in #2
darkhtx1: squadQ 🦠 squadOmega
cutza: torrent the rna
mehdi_tw: yo call walter white and start a new business MAN
cregger: i feel like i'm watching A Beautiful Mind 5Head
joshperri: What's the purpose of testing for it?
jimmyadaro: @georgehotz Comma Bio Pharma
Combat__ex: @joshperri memes
Zazens: 10K budget for pharma company?
C0deCane: Just 3d print it Kappa
itsxaos: i think you need a centrifuge if you want to extract DNA
doctorgenus: day 4 of stream, I need equipment, let's buy buy buy
almonte550: If you can create immunity with the virus, why no one here is actively looking to get infected?
THX1342: ### Shopping list
darkzade: ratirlToxic
jimmyadaro: go fund him
Mint2bSpiced: the FDA included a list of equipment you need to preform this test FYI
Combat__ex: @almonte550 thats actually a viable strategy. look up heard immunity
THX1342: so this is how 12 monkeys starts
Ayyyy420Lmao: @almonte550 you're implying no one is, i've broken quarantine everyday this last week
Combat__ex: herd immunity
C0deCane: @almonte550 because our health care system can't handle the surge, literally the only real reason
cutza: torrent the rna
logi6000: guys on his second monitor he's looking up arsenic pills to kick start his serial killing business. he's going to sell them as adderall in his small pharma.
elephantpandas: lirikS
jimmyadaro: but why
williamjennings1: NotLikeThis NotLikeThis
guinness84: just run PCA and run it through a conv net noob
cregger: xqcC
darkhtx1: -380 squadD squadQ 🦠 squadOmega 🦠 squadOmega 🦠 squadOmega
TsarSec: i feel like were working towards folding@home LUL
mr_stochastic: Did George already know bio or did he learn bio on the fly as well lol
ackxhpaez: Seriously though Everlywell is starting to sell a coronavorus testing kit eventually for at-home testing
xxxelent: 500 isnt that a shitload?
mehdi_tw: day 6 of stream : i need people to test on things in my illegal pharma
itsxaos: @georgehotz how can you be sure its a true negative though?
jimmyadaro: $10k to start??
jmv_chin: high quality googling
elephantpandas: 💉   justke10Virus = aaron traywick
ideology_sniffing_raccoon: LUL
whycopper: xqcC xqcC xqcC
Ayyyy420Lmao: bio is not easy it's vodoo science
jimmyadaro: ResidentSleeper
zwisch: math is just hard
nomad119: https://www.chaibio.com/coronavirus
DecayingSkullz: https://theminione.com/pcr-system/
jimmyadaro: https://github.com/geohot/corona
mehdi_tw: math is cool bro
ahahahaitslit: math is hard for basically everyone
nomad119: for research only ;)
darkhtx1: bio ez clap
MrTriharder: Math is actually hard
thrashtazs: both are hard practices
codelumberjack: maybe its because you delegate all math to software
vembumees: bio is easy because we dont know shit about the complex stuff
localcanofdutchgold: math is abstract, bio is specific
C0deCane: @georgehotz The real issue with bio is its acceptance in the world
logi6000: I took a biology course in 7th grade. that is my bio knowledge
PiroFloydian: mand doesnt work well for math and hacked the iphone at 17 WutFace
Nussinov: both are hard to be really good at
mr_stochastic: @georgehotz did you have to know a lot of math theory for self-driving car?
MrTriharder: Math requires out of the box thinking
opus_000: lol yeah this was the wrong stream to mention he's considered being a serial killer SuperVinlin
itsxaos: biosurveillance LUL
Mrclutch963: What is he trying to do?
Combat__ex: Yes, Bio is actually easy. But a lot more of memorization of jargon than math maybe
nremind: bio is like elementary school math
l1ght5p33d: There is no story to math, no beginning or end you have to look, remember and understand all of any proof or problem at once
jimmyadaro: IT IS
Ayyyy420Lmao: @mr_stochastic nope you just need to type import X
DecayingSkullz: its expensive AF
Santiago_LHC: commit and push!
Waywoah: It helps that most of this info was known before Covid-19
mr_stochastic: @ayyyy420lmao how does one not be a script kiddy then 😔
cregger: @georgehotz 1 bitcoin and some mcdonalds and i'll be your guinea pig
jimmyadaro: @DecayingSkullz $10K FOR SMALL PHARMA??? Its not expensive at all
MrTriharder: Put it on comma.ai misc expenses and but it 5Head
death_gadget: Math underlies everything. Math can explain bio, bio can't explain math.
lefse: ALL IN ONE????? PogChamp
Santiago_LHC: commit!
outlier2: peter thiel on math vs. bio: https://www.youtube.com/watch?v=SO_00POR-Po&amp;feature=youtu.be&amp;t=1131
DecayingSkullz: @jimmyadaro its like $5k i think
Ayyyy420Lmao: @death_gadget you're thinking about math because of bio because you're an animal famalam
jimmyadaro: @DecayingSkullz Even better then!
thrashtazs: @death_gadget bio explains life
theonlymonkas: did he buy it!?!
MrTriharder: @thrashtazs Life is math.
jimmyadaro: @theonlymonkas Not yet
death_gadget: ^
nomad119: Chaibio apparenlty used to do the manufacturing openpcr
cellophane11578: because were all biological?
thrashtazs: @MrTriharder youre not wrong
ahahahaitslit: math is great for explaining physics but is significantly weaker for modelling bio phenomena
doctorgenus: that's a lot of money. Spend it on a ventilator
THX1342: fluorophore is used in electrophoresis
MrTriharder: How many lungs(bio) do u have? 2 (math)
THX1342: the step after you do PCR
jimmyadaro: Spend it on adderall
guinness84: if u get one can i throw u some bills to test myself i live in sd
almonte550: I would get infected with covid-19 if I know I will recover
death_gadget: I challenge anyone to show that math doesn't encompass bio.
Nussinov: THX1342 LOL 
THX1342: you do electrophoresis to measure the amount of DNA you got in your PCR
almonte550: The thing is, I don't know if I will
guest1GRjBAYo: suck my k e y b o a r d
THX1342: Nussinov am I tripping? I
Nussinov: THX1342 the 80s called they want their method back
cregger: anyone know if george's end goal is to profit off of a cure/vaccine or is this all for fun?
whyZaya: @death_gadget Are you telling me math explains classical logic? I doubt it. Classical logic explains math.
TalonFire: biology is expensive WutFace
THX1342: Nussinov well that's what I know amateurs are doing LUL
Nussinov: THX1342 they fluorophore is measured with some kind of CCD
Appz_x: built in wifi PogChamp
MrTriharder: @whyzaya Logic is a branch of math
Nussinov: THX1342 its quantitative, thats the point
jmv_chin: @whyZaya big brain
peter35_: math is overwhelming in learning the landscape of any "land" of math that was mapped over decades and centuries by geniuses. then doing original research is a whole new journey
logi6000: instead of getting all this stuff you could just buy a fuck ton of weed and wait til the end of the world. then be the first to overdose on weed
jimmyadaro: WIFI COVID TEST
almonte550: @TalonFire really expensive, it's high class toys
Nussinov: THX1342 it's done in the machine iirc
death_gadget: Classical logic != math. Logic is human, math is universal.
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
icyvran: Using the high-intensity X-ray light from the Berlin synchrotron source BESSY II, they have decoded the 3D architecture of the main protease of SARS-CoV-2 https://www.sciencedaily.com/releases/2020/03/200320101631.htm
ahahahaitslit: classical logic? it is a branch of math itself though
l1ght5p33d: @ahahahaitslit Not really, comparing Feynman diagrams used to describe LHC with optical data with a protein imaging laboratory ...
THX1342: Nussinov oh, so you also don't know :)
THX1342: Nussinov LOL /
Combat__ex: Does anyone know if you can do ELISA or protein mapping for the proteins (E,S,N) for coronavirus testing?
Nussinov: THX1342 LUL /
Ayyyy420Lmao: @logi6000 the first? there's been a handful already
jmv_chin: chat is going big-big brain
C0deCane: @georgehotz after you buy the minion thing, lets hack it Kappa
mehdi_tw: but can you jailbreak it @georgehotz ?
doctorgenus: that's how they get you
Ayyyy420Lmao: thermo wont sell to you
ideology_sniffing_raccoon: LUL
logi6000: @ayyyy420lmao I don't think so
julien9877: Small Lab LUL
lefse: jailbreak support?
coProof: Here we go again
jimmyadaro: WIFI COVID TEST
jimmyadaro: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
C0deCane: sure they will haven't you guys ever heard of social engineering
Nussinov: @THX1342 im 100% right tho i just double checked Kappa
icyvran: Using the high-intensity X-ray light from the Berlin synchrotron source BESSY II, they have decoded the 3D architecture of the main protease of SARS-CoV-2 https://www.sciencedaily.com/releases/2020/03/200320101631.htm
edu4594: did work?
doctorgenus: nice use those catelogs as toilet paper lol
jimmyadaro: LUL
Ayyyy420Lmao: @logi6000 100% confident it was reported that mom of 2 died of weed not spice in the UK
nitropiece: nitropiece subscribed with Twitch Prime.
joshperri: I don't get why he wants to reverse engineer a test procedure that a lab assistant could explain and perform.
itsxaos: small pharma screwed over once again BibleThump
daxyxy98: your price is highter, because you access their site from a mac LUL
logi6000: George if you were going to make a new startup what would it be
joshperri: Thought we were supposed to be REing a virus
Ayyyy420Lmao: @daxyxy98 big if true
jimmyadaro: @joshperri Not the procedure… The virus.
THX1342: @Nussinov I still didn't get what you think I said is wrong LUL electrophoresis, automated or not, is still used and that's the the fluorophores are used
guinness84: they make u take an IAT to buy it for discount
joshperri: @jimmyadaro This is all just to see if a sample contains the viral RNA
cregger: not to poop on the parade but how would george find a cure before established labs? or is this for the hell of it?
C0deCane: @Ayyyy420Lmao how would she have died, an overdose is completely impossible with current marijuana even in strongest form
itsxaos: LUL
Ayyyy420Lmao: @C0deCane nonstandard reaction to it
AresRai: @cregger this is just to learn about biology and try to have fun coding w it
Combat__ex: why test for coronavirus if everyone here likely has had it? Kappa Kappa Kappa Kappa
jimmyadaro: LUL
ahahahaitslit: @l1ght5p33d math is not as good at modelling biology and making predictions from models when compared to physics is my point
rickoftheroot: LUL
jimmyadaro: NOT YET
AresRai: LUL
RadricCSGO: we might
jimmyadaro: WIFI COVID TET
julien9877: BELIEVE
jimmyadaro: TEST
flvs: its greay
ideology_sniffing_raccoon: YES
itsxaos: we are SO CLOSE
C0deCane: @Ayyyy420Lmao I would say there was an underlying issue they didn't find/ didn't care too
mehdi_tw: GOOD TIME BROO
flvs: great*
ahahahaitslit: not an expert though obviously
logi6000: we are having an amazing time
doctorgenus: we're having a blast
aar0npham: Hahah
cregger: damn with the 5Head help of chat you may be able to Kappa
DecayingSkullz: HYYYYYYYYYYPPPEEEEE TRRRRAAAAIIIIIINNNNN
jimmyadaro: Now some Q&amp;A!
williamjennings1: coffee? at 10:13
williamjennings1: WTF
CheeseManUchiha: wtf we arent curing corona i got scammazzed
mr_stochastic: Yup, super fun
Nussinov: @THX1342 god its been years since I've done this work, but I think the idea is that the flourophores are attached to the primers which are designed to specifically anneal to the target sequence as its amplified, allowing for real time quantitation by fluorophore detection
doctorgenus: we learn how geohot shops
cellophane11578: im having fun, might watch some pinky and brain after this
coProof: I’m not crazy yet :)
MrTriharder: Q&amp;A time SwiftRage
voxelfox0125: I personally believe Geohot is one of the few people that actually knows how to use the internet to teach himself anything and apply it within a few days.
pec_adillo: just casually cure corona, no big
death_gadget: @ahahahaitslit How do you make a prediction without math?
Combat__ex: This is really educational
Combat__ex: love your stream
toasty_jk2: that was me
jimmyadaro: LUL
mr_stochastic: @voxelfox0125 true
ahahahaitslit: @death_gadget in bio? it's driven through experiment
DecayingSkullz: choo chooooo
Juhaa: poly A tail
C0deCane: @death_gadget you pay off the side your beating against
julien9877: so aaaaaa = end msg sign? thats cool
theonlymonkas: no choo chooo
ahahahaitslit: of course we need math as well
THX1342: i.e. the bufferoverflow
logi6000: scam train!
jimmyadaro: Now some Q&amp;A!
julien9877: nice
ahahahaitslit: but i'm comparing it to physics
Knarez: thats pretty dope
timi13462: brute force
mr_stochastic: Anyone who watched George doing code for vid processing, does he ssh into a Linux server or something?
jimmyadaro: AAAAAAAAA
jimmyadaro: lol
death_gadget: @ahahahaitslit A prediction can't be made without math.
l1ght5p33d: rare As
Nussinov: @THX1342 so no, i dont think "electrophoresis" is used directly here, but yeah id have to double check if I'm missing a step
itsxaos: the virus screams at you in the code
cellophane11578: are there any viruses with low infection rate but huge fatality rates
PiroFloydian: every science can be abstracted to math if you go far enough
cregger: (not an insult at all) this is quite reminiscent of watching old Martin Shkreli streams in so many ways
MrTriharder: @death_gadget People haven’t heard of probability
TalonFire: AAAAA
doctorgenus: the corona virus needs triple A insurance
Combat__ex: AAAAAAAAAAAAAAA
logi6000: @cellophane11578 my plague inc virus
itsxaos: @cregger FREE SHKRELI
Ayyyy420Lmao: @cregger pray he doesnt end up in jail
itsxaos: whens he out btw
death_gadget: @MrTriharder Exactly what I was thinking. LUL
itsxaos: hes been in quite a while right
jimmyadaro: @Ayyyy420Lmao Yet.
cregger: @Ayyyy420Lmao they love to imprison the best of us
ahahahaitslit: @death_gadget i don't think i said that
joshperri: @cellophane11578 ebola
Ayyyy420Lmao: ross ulbritch, weinstein, etc
C0deCane: @death_gadget if your left enough you can make predictions with your emotions FACT
mrhdr: mizkifM
cregger: Shkreli would have already found a cure, hiked the price, and gone back to jail LUL
theonlymonkas: shkreli excel
cregger: WTF no weinstein but yes ross
death_gadget: @C0deCane Left in a political sense??
Bloodswordz88: free shkreli lol
jimmyadaro: @C0deCane Lmao true
Ayyyy420Lmao: T
zwisch: T
toasty_jk2: T
cregger: free shkreli and ross ulbritch
ahahahaitslit: @death_gadget my point was from what i've read mathematical models in biology are weaker than physics in terms of making predictions
PiroFloydian: t
jimmyadaro: Now some Q&amp;A George
Nussinov: U Kappa
toasty_jk2: A with T, G with C
theonlymonkas: #FreeShkreli
ahahahaitslit: hence greater emphasis on experiment
C0deCane: yes but im just fucking with you LUL @death_gadget of course you can't make a prediction without math
thrashtazs: i hate to say it but this stream slightly reminds me of shkreli streams
THX1342: georgehotz if I am not mistaken you need two primers because you need a 'start' and 'stop' for the PCR process. THoughtEmporium has a good video on PCR that explains this, I shared on the 1st stream
MrTriharder: @c0decane your emotions are shaped by year Long math. True or false can be translated to any of your emotions
death_gadget: @C0deCane I'm with you there buddy.
williamjennings1: this guy is a machine
theonlymonkas: yes
death_gadget: @ahahahaitslit I was just making the point that "predictions" are themselves mathematic.
Nussinov: @THX1342 you're still going LUL
Sidhuu: @williamjennings1 it's called Adderall
jimmyadaro: DMT
THX1342: Nussinov are you a stalker, fam?
C0deCane: @MrTriharder Math is literally life i can't think of anything that doesn't or can't have a mathematical equation
williamjennings1: @Sidhuu didnt he say he had coffee too?
cellophane11578: gottacatchemall
cregger: is this a recording of the Zuck coding Facebook in '04?
cellophane11578: Kappa
theonlymonkas: Kreygasm it's called TEA
MrTriharder: @c0decane SeemsGood
death_gadget: @C0deCane TRUE!!
ahahahaitslit: @death_gadget of course. i was talking about models though
lsfa: Did you know anything about this prior to starting this project?
Nussinov: @THX1342 I don't like that you're speculating so much even after being wrong once LUL
williamjennings1: lmao
0R4NG3: lol
CompestLive: looool
Waywoah: He's using python, right?
l1ght5p33d: Hots is just better than all of us L 2 deal
edu4594: dayum
timi13462: whats his thiughts on adderall
ShredderSherlock: whats the concept behind jupyter notebooks
jimmyadaro: @Waywoah Yep
daxyxy98: !adderall
theonlymonkas: LUL
williamjennings1: is he staying up late tonite
mr_stochastic: @shreddersherlock exploratory analysis
jimmyadaro: No !Adderall here
williamjennings1: !Adderall
death_gadget: addrerall is a must!!
MrTriharder: He called us stupid PepeHands
logi6000: what a good laptop to buy to put arch on
PiroFloydian: @georgehotz make commands for the FAQ like !adderall
Ayyyy420Lmao: don't u need to reverse the list after you found the base pairs?
cellophane11578: !pokemongo
THX1342: Nussinov sorry, I wasn't wrong. flurophore IS used in electrophoresis. I never said it is the most modern or best method.
l1ght5p33d: all the plebs cant type crying performance enhancers
stuffedcrust45: @logi6000 thinkpad
edu4594: @ShredderSherlock execute separete parts of the code without running every piece
mr_stochastic: @shreddersherlock then he writes the code that works in a library using vim in his terminal
opus_000: should be an emote with his face on it MaxLOL
jimmyadaro: @logi6000 Any?
edu4594: seperate*
williamjennings1: why were your eyes dialted when you hacked the iphoen
THX1342: Nussinov and doesn't PCR use two primers one for the start and another for the end of the sequence you want to replicate?
edu4594: wtv
jimmyadaro: Literally any
SolarBerry: adderall is a recreational drug
lsfa: Did you know anything about this prior to starting this project?
0R4NG3: 5Head
timi13462: wtf
Ayyyy420Lmao: reverse the inverted list
vicmoney69: 5Head
ahahahaitslit: and think you're secure
OrlinTheMage: huh?
death_gadget: @ahahahaitslit I would just say, if you look at a low enough level math is at the core of even biological models.
jimmyadaro: @SolarBerry wtf
williamjennings1: you were on some kind of stimulant when you hacked the iphone
archeadis: have u tried adderall though/
logi6000: isn't Adderall really close to meth
theonlymonkas: PogChamp poetic
MrTriharder: 5Head
info303: what about being secure and knowing you are insecure?
whyZaya: What about being secure and knowing you're insecure?
cregger: xqcM
Combat__ex: @georgehotz theres a line of code reverse complimentary code in python
Ayyyy420Lmao: alcohol is banned by WADA tho
Combat__ex: alt_map = {'ins':'0'} complement = {'A': 'T', 'C': 'G', 'G': 'C', 'T': 'A'} def reverse_complement(seq): for k,v in alt_map.iteritems(): seq = seq.replace(k,v) bases = list(seq) bases = reversed([complement.get(base,base) for base in bases]) bases = ''.join(bases) for k,v in alt_map.iteritems(): bases = bases.replace(v,k) return bases
death_gadget: I'm drinking beer right now! :)
RadricCSGO: addy makes me want to watch porn for 14 hours
timi13462: just try crack it's better
Arrthur: xqcM
C0deCane: performance if you need to perform at staying up all night
info303: @whyZaya jinx
l1ght5p33d: tesla did but he just liked fucking with metal in the garage
Waywoah: Unless you're shhoting
PiroFloydian: what about caffeine @georgehotz
williamjennings1: just mixed l thenine in my gatorade
Waywoah: shooting
ahahahaitslit: @death_gadget it is used all the time in biological models for sure
Ayyyy420Lmao: reverse the inverted list man
whyZaya: @info303 Yeah haha.
doctorgenus: summary of corona stream day 1: spike protein is the exploit day2: corona virus is no the flu, it's SARS! day3: shit hit the fan in a month day4: need to buy equipment to test on self because I might have coronavirus?
opus_000: I low-key want to shock my prefrontal cortex
miiiiiiim: weed is okay for creativity but like hell i'd want to code
thrashtazs: @logi6000 I mean yeah, its an Amphetamine
guinness84: i think alcohol is performance encoring and banned for archery competitions
info303: @whyZaya I think thats called paranoia lol
guinness84: enhancing
logi6000: @opus_000 wtf
C0deCane: @doctorgenus down the rabbit hole we all go
timi13462: coke &gt; adderall
williamjennings1: meditation is good for focus
SolarBerry: i do however like psuedoephedrine which is much smoother than adderall and better for focus
whyZaya: @info303 Yup
jimmyadaro: @timi13462 Aha
Combat__ex: !addrerall
Combat__ex: !Adderall
jimmyadaro: @Combat__ex Nothing like that here
inciMage: @guinness84 it decreases cell performance hence shaking is omitted
opus_000: @logi6000 it works
logi6000: adderal
cregger: for anyone who has seen the movie Lucy, George is what happens when we tap into 40% of our brain power
coProof: Oh my god there it is boys! CTCGA
logi6000: aderall
death_gadget: @ahahahaitslit Don't take what I am saying as a discount of biology. I'm only stating that I believe math is at a lower level. That bio couldn't exist without math.
Ayyyy420Lmao: ffs i told you 3x in chat
AKspirits: just tuned in... i think im a few days behind the lecture prof
rickoftheroot: SeemsGood
C0deCane: Think about all the hypochondriacs out there absolutely losing there shit and eating up our healthcare system LUL
Nussinov: @THX1342 you are not 100% wrong on what you're saying, it is just clear to me that you dont understand how things actually work. there is no relationship between a reverse primer and the "stop" of a pcr process. the primers themselves anneal to the target sequence according to base complementarity, and the process stops when you stop the cyclic annealing/melting
C0deCane: there has to be a high number of them just my honest guess
jimmyadaro: @C0deCane Kinda sad
bluejimmy168: 1st time here. What are you trying to do?
logi6000: I stick to weed
C0deCane: Those people will fuck up the data too
miiiiiiim: god i miss python
joshperri: reverse compliment
williamjennings1: how do you have coffee at 10pm wtf
jimmyadaro: @C0deCane For sure
death_gadget: I've been without weed for over a year. :(
logi6000: it's 130 here
logi6000: am
Nussinov: okay now everyone give the streamer a reverse compliment
AresRai: 6:30
HellxNebula: @williamjennings1 its just coffee not cocaine LUL
cellophane11578: are u inherting the _invert function there? im not familiar with coding like that
MrTriharder: 11am :)
thecoder15: @georgehotz https://pubmed.ncbi.nlm.nih.gov/32133832/?from_single_result=32133832
ahahahaitslit: @death_gadget you think math is more fundamental than bio? this is definitely true imo. bio is emergent
samthedogg: what does the _ mean in _invert on like 64 on the left
ShredderSherlock: @SolarBerry Trump also likes pseudoephedrine
death_gadget: @georgehotz You ready to trade that Sub for Mod yet? LUL
samthedogg: call the parent function?
jimmyadaro: @cellophane11578 I think so
williamjennings1: good luck sleeping @HellxNebula
cellophane11578: @samthedogg thats essentially what im asking too
SolarBerry: @ShredderSherlock lmfao
mr_stochastic: @cellophane11578 not inheriting, just calling an internal function.
cellophane11578: ah okay
HellxNebula: @williamjennings1 its 7:25 am here and i had coffee like 14 hours ago
samthedogg: @mr_stochastic so its neccessary for recursive functions in python?
THX1342: Nussinov maybe we're having language issues... "stop" means one thing to you (and I know what you mean.. I know there are temperature cycles and all) and another to me :)
williamjennings1: @HellxNebula talking about george
jimmyadaro: What's happening rn?
cregger: does this project have any relation to comma ai?
jimmyadaro: @cregger Not yet
jimmyadaro: Thanks @georgehotz
williamjennings1: wtf
mr_stochastic: @samthedogg yeah you can see that kind of thing in recursive functions. But he didn't use it recursively. Just used in in a list comprehension he had
itsxaos: shkreli gets out in 2023
bluejimmy168: Can someone tell me eli5, what he is trying to do?
cregger: not soon enough
AresRai: @itsxaos time flies
williamjennings1: hows shrekli!
dairynuts: what is happening
jimmyadaro: Q&amp;A
AresRai: shrekli FeelsBadMan
cregger: #FREESHKRELI
Ayyyy420Lmao: the girl from theranos didnt go to jail or did she?
Kebabpizza1993: geohotz trying to be the new shkreli lol.
dairynuts: is this the diary of a madman or....
death_gadget: Shkreli could cure Covid-19
Nussinov: @THX1342 language matters i guess. I was just suspect
yungdeli_: i used to watch shkreli every stream
roystang: shrkeli would fix the coronavirus
ahahahaitslit: why tf is that guy in jail for so long
yungdeli_: smart man
OrlinTheMage: he walks like such a bottom
C0deCane: @dairynuts geo is just days away from curing this thing for all of us.
thecoder15: shkreli and george the dream team right there
mutrx: yo
Codeoxic: @georgehotz What are you working on?
cregger: i miss Shkreli shitting on people calling in
edu4594: !time
timi13462: can someone any laptops to buy
mr_stochastic: @ayyyy420lmao don't think so, she just got fined I think
williamjennings1: biology exam
NagyOut: you seen nextrtain.org ?
dairynuts: @C0deCane actually?
jimmyadaro: @Codeoxic CO-VID
williamjennings1: omg biology looks hard
cregger: cregger subscribed at Tier 1.
l1ght5p33d: @bluejimmy168 Corona research and cure development also bioweapons
Ozonemaster: bio exams are naming theory
guinness84: FTC locked up the one man that could cure corona
jimmyadaro: SMALL PHARMA
C0deCane: @williamjennings1 nothing is too hard for @georgehotz Bio is EZ
theineffablebob: what's this guy making
mr_stochastic: @ozonemaster 😂
dairynuts: nothing you can't cram for in a day
Codeoxic: @jimmyadaro I noticed that, but what specifically?
cregger: just play Plague Inc 4Head
jimmyadaro: @Codeoxic Trying to decode the virus I guess
williamjennings1: @C0deCane i can see that
williamjennings1: Quizlet lmao
Nussinov: quizlet Pepega
jimmyadaro: ResidentSleeper
cregger: ResidentSleeper
Ayyyy420Lmao: latent
Nussinov: ResidentSleeper
C0deCane: I wanna see his test score lol
ideology_sniffing_raccoon: quizlet time
C0deCane: I bet it will be pretty good
l1ght5p33d: wtf is this
jimmyadaro: OhMyDog
mutrx: MHC 1
Nussinov: 2 PogChamp
mr_stochastic: @ideology_sniffing_raccoon Anki's where it's at
Ayyyy420Lmao: MHC
itsxaos: i think 2
logi6000: Quizlet good. iuse it all the time
PiroFloydian: gotta use context clues
o______________________k: squadR hey DUD where is my bio hacking jailbreak DUD squadR squadR squadR
PiroFloydian: decreased helps you here
jimmyadaro: LUL
Sidhuu: now do a math exam
mutrx: immunology &gt; every other biological discipline
samthedogg: @mr_stochastic wait so is _function() the same as calling self.function?
C0deCane: squadOK
PiroFloydian: it's gonna look for things that are different than normal @georgehotz decreased is the helpful word
Ayyyy420Lmao: false
Nussinov: @mutrx oh lookie, a med student in the wild
mrhdr: o______________________k MY MAN squadW squadNation
itsxaos: false my guess
timi13462: 2x   4 = 16 Solve!!!
cregger: redsSmart
williamjennings1: lmao
ahahahaitslit: yes
Ayyyy420Lmao: no
C0deCane: squadW so many apes in here
ahahahaitslit: lmao
o______________________k: squadLaugh @mrhdr
THX1342: @Nussinov yeah I'm not a bio person (obviously) and not an english native so that complicates things :D just curious about this stuff
MrTriharder: admiralF1 admiralF2 Any cuties in chat?
theseusq: 🐵
wisamalrawi: picorna
ideology_sniffing_raccoon: poor squadW here :)
cregger: redsCorona
o______________________k: squadBrug squadBrug
jimmyadaro: Small pharma ftw
wisamalrawi: Not all have an envelope
mr_stochastic: @samthedogg It's just naming convention. He could of called "inside_inverted_function"
bytebacon: bacteriophages are the real deal
dorkmo: after we curve corona, can we cure herpies, asking for a friend
Nussinov: @THX1342 all good man, I hope my tone doesnt sound like im mad or scrutinizing - we should all be curious!
AresRai: EZ
mutrx: @dorkmo thanks for asking on my behalf
PiroFloydian: @georgehotz you can change question settings
itsxaos: 4
PiroFloydian: to get rid of flashcards and typing answers if you want
wisamalrawi: A
MrTriharder: Chat recommend some tv shows to binge watch :)
wisamalrawi: lol
o______________________k: what a fucked up day squadR squadR
cregger: in theory wouldn't Shkreli's startup he was working on before he was imprisoned be able to model the virus and thousands of interactions to it by different proteins?
timi13462: money heist
itsxaos: 4 again
lithiumx4900: uncoating?
mrhdr: squadR YO GEO
CompestLive: uncoating
itsxaos: dangit
wisamalrawi: uncoating
Ayyyy420Lmao: latent
cybergenik: autoimmune
lithiumx4900: retrovirus
Ayyyy420Lmao: same what lmao
Nussinov: LUL
Nussinov: these questions are so shit LUL
wisamalrawi: yeah
PiroFloydian: @georgehotz CHANGE THE QUESTION SETTINGS
itsxaos: VoteYea
AresRai: me :)
jimmyadaro: LUL
itsxaos: easy
0R4NG3: Kappa
Nussinov: VoteYea
cregger: me Kappa
theonlymonkas: me
o______________________k: not me :)
DecayingSkullz: Kappa
mutrx: immunology is better
guinness84: computational virology
Nussinov: AGREED!
joshperri: That's the first step in covid replication, it transcribes it's negative to positives, then replicates the positives to make negatives.
phrixus_bro: do you guys remember the old skreli streams this reminds me
PiroFloydian: 2 days ago you said you have nothing but time @georgehotz
cregger: HACKERMANS get back to work xqcM
itsxaos: microbiology questions: https://www.d.umn.edu/~rhicks/genmicro/Practice Exam Questions.pdf
Nussinov: i took a structural virology course taught by a physicist and it was incredibly interesting all the ways they've studied those things
THX1342: whats the hardest thing you ever tried to learn @georgehotz ?
DecayingSkullz: Down the rabbit hole we go
cregger: @phrixus_bro i said the same thing 10 minutes ago, makes me nostalgic
cregger: a lot of overlap in the fanbase it seems
phrixus_bro: oh yeah nice!
vybster: George, have you not changed your clothes?
Sidhuu: what kind of maths
DecayingSkullz: what kind of math
edu4594: what about coq
localcanofdutchgold: what kind of math?
Sidhuu: lol
jimmyadaro: @vybster what for
yungdeli_: i wish i understood what he's tlaking about
joshperri: It needs to make negative sense to replicate.
Nussinov: it just does another round
AresRai: just go through them again yea
joshperri: "RdRp directly mediates the synthesis of negative-sense genomic RNA from the positive-sense genomic RNA."
jimmyadaro: I love him
jimmyadaro: lol
Ayyyy420Lmao: @jimmyadaro no homo right?
AresRai: nature take the simple paths FeelsGoodMan
mutrx: i only know of sense and anti-sense strands
jimmyadaro: @Ayyyy420Lmao maybe… kinda… why?
mattdougherty22: please do Erics show the portal if you have the chance
roystang: hack the virus george
joshperri: "This is followed by the replication of positive-sense genomic RNA from the negative-sense genomic RNA.[19] The other important function of the complex is to transcribe the viral genome."
Nussinov: if biology made me money I would have sppent all undergard reading about it LUL
jimmyadaro: @Ayyyy420Lmao Not sexual tho
mattdougherty22: Please do Eric Weinstein's show the portal if you have the chance
jimmyadaro: @Nussinov What did you study?
Bowlgirlblergh: if virology had a red pill, what would it be?
benchai18: Corona has a lipid envelope. That’s why soap pulls it apart
Nussinov: @jimmyadaro computational chemistry / chemical physics
benchai18: That’s the only thing I know about anything. Had to say it
jimmyadaro: @Nussinov Cool
itsxaos: @mattdougherty22 im guessing we would have to bother eric about it first
DecayingSkullz: @jimmyadaro are you from Argentina
jimmyadaro: @benchai18 You're right
tensorspac3: what is he building chat?
jimmyadaro: @DecayingSkullz Yep, why?
Ayyyy420Lmao: lipid envelope? i thought it was always protein
DecayingSkullz: @jimmyadaro just wonderin
jimmyadaro: @DecayingSkullz ????
mattdougherty22: can we not bother Eric about it? The mutually know Lex @itsxaos
benchai18: @jimmyadaro U just made my week thanks bruh
l1ght5p33d: @Bowlgirlblergh you die from it
timi13462: who wins hulk or thor
InstaDeath: whats going on right now? new to stream just dropped in
tensorspac3: same ^
Nussinov: a kinase would add a phosphate
yungdeli_: hacking the virus
jimmyadaro: @InstaDeath He keeps learning about bio
itsxaos: @mattdougherty22 im just saying we need to get him invited first
keith282: it was wahtever interacted w ATP
Ayyyy420Lmao: should have its own
l1ght5p33d: open source covid 2019
vybster: Hacking the coronavirus DNA/RNA
lithiumx4900: Is this published somewhere where I can follow along?
l1ght5p33d: open source covid cures
benchai18: @lithiumx4900 His GitHub
jimmyadaro: @lithiumx4900 https://www.youtube.com/channel/UCwgKmJM4ZJQRJ-U5NjvR2dg/videos
keith282: what it was that reacted w the ATP produced phosphorous
jimmyadaro: @lithiumx4900 https://github.com/geohot/corona
mattdougherty22: True @itsxaos He also regularly has people on he has never met and simply disagrees with on twitter. should be doable
itsChopsticks: did we invent a vaccine yet
georgehotz: https://github.com/geohot/corona
lithiumx4900: thanks all of yous.
itsxaos: @georgehotz have you been invited to eric weinsteins show?
l1ght5p33d: we found several treatments
jimmyadaro: ;*
Sidhuu: didn't someone die from that?
timi13462: that killed somebody
doctorgenus: where do you get hydroxicloquine?
itsChopsticks: did you find the safe dosage?
kubaaa6: my mom bought that shit 2 weeks ago lol
yungdeli_: black coffee?
kubaaa6: i thought she was crazy
un3okapi: why?
wholesome_pepe: Phosphorylases
thecoder15: @georgehotz make sure you have the right zinc
lithiumx4900: lithiumx4900 is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to elektroids!
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to mattdacentaur!
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to rraksut!
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to hardtarget4!
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to samthedogg!
l1ght5p33d: drink 10 gallons of water
AzzoDio: @georgehotz Do you know computations modeling? Here's someone looking for help https://twitter.com/CurlyJungleJake/status/1242553710183514112
jimmyadaro: lmao
ideology_sniffing_raccoon: PogU
mutrx: thanks @lithiumx4900
THX1342: I've been taking zinc suplements since China quarantined Wuhan
Ayyyy420Lmao: madman with the stolen credit cards
itsChopsticks: @georgehotz what's the safe dosage?
levinson2504: Google WutFace
jimmyadaro: @lithiumx4900 What about me
jimmyadaro: hahaha
AresRai: @Sidhuu self medication is bad yea but never self medicate on big doses
rafalive: people are already doing this in china at toxic amounts
doctorgenus: can you get it from a drug dealer?
DecayingSkullz: https://honeybeehealth.com/drugs/plaquenil
raystriker98: mee2
raystriker98: jk
localcanofdutchgold: lul
doctorgenus: there has to be drug dealers for this
lithiumx4900: lithiumx4900 gifted a Tier 1 sub to jimmyadaro! They have given 6 Gift Subs in the channel!
timi13462: i'm pretty sure that combination killed somebody
C0deCane: @timi13462 no that dude drank fish tank cleaner called choroquine not hydroxychorolquine
phrixus_bro: is the border open
Sidhuu: @aresrai yea
jimmyadaro: @lithiumx4900 Thanks for the gift sub!
kakurai: Please don't buy this medicament unless you need it very hard.
AresRai: wtf
samthedogg: @lithiumx4900 yooooo thanks dude!
raystriker98: whoa he actually did it
DecayingSkullz: https://honeybeehealth.com/drugs/plaquenil
guinness84: should out tijuana
WhiteTailedSpider: AHAHAHHA
vicmoney69: lmao
raystriker98: gg
l1ght5p33d: Take 1/2 fish tanks per day
guinness84: xanax and plaquenil
jimmyadaro: lol
mutrx: @lithiumx4900 thanks for the 6 gifted subs!!
WhiteTailedSpider: WTF AHAHHA
directrix13: unless you have some underlying heart rhythm issues
levinson2504: do drugs
zwisch: LUL
Trouser: yeah that is freaking brilliant right there...clean my fish tank or kill this virus?
Sidhuu: also don't mix stuff u don't know
doctorgenus: is about the mg, gotta measure
mattdougherty22: @itsxaos would this format be at all helpful for listening to podcasts? http://mattdougherty.online/Podscribe-mock/test/test2
tsAllySparkles: lmao
localcanofdutchgold: OMEGALUL
jimmyadaro: Q&amp;A come on
360Plato: LUL we have to keep explaining this
AzzoDio: The primary risk is Long QT syndrome, if you've ever had your heart checked you can be somewhat sure you are safe from that
edu4594: how i clip this
thecoder15: yeah make sure it won't interact with any meds you are currently taking
doctorgenus: can't wait for Q&amp;A
tsAllySparkles: psychonautwiki has a graphql api
doctorgenus: I'll wait all night if I have to
WhiteTailedSpider: call someone the embulense, this guy is crazy LUL
damagedcorn: What’s your philosophy on drugs
vicmoney69: @edu4594 alt   t
patroniv: Hey George, ever heard of Lambda School? If not, it’s an online school(boot camp) I guess. Always hear about how these bootcamps behave sketchy
jimmyadaro: @doctorgenus Yesterday he said "maybe, or may be not"
jimmyadaro: But i hope some Q&amp;A
localcanofdutchgold: @damagedcorn dank
vicmoney69: @edu4594 i mean alt   x
C0deCane: @WhiteTailedSpider what?
AresRai: nano tech building blocks PogChamp
ShredderSherlock: prions are smaller
mutrx: yeah plants can get viruses too
zwisch: yeah prions are even crazier
jimmyadaro: nano s#!ts
edu4594: @vicmoney69 thx
mattdougherty22: @patroniv you can find other online learning options here if interested: http://mattdougherty.online/ed-space-landscape/
C0deCane: LUL stop
TsarSec: .... no shit
Nussinov: monkaS
normie4life: stop thinking monkaS
vicmoney69: monkaS
jimmyadaro: cells fuk!ng
TsarSec: you mean like cancer?
julien9877: monkaS
vicmoney69: thats how cancer happens
levinson2504: you get cancer
geobitz: hes on shrooms
directrix13: then cancer
toasty_jk2: they do like all the time
AresRai: mathematically they will mess up sooner or later monkaS
Ayyyy420Lmao: that's why they have a checksum man
C0deCane: Micromanage those fuckers literally!!
lawric_: cancer
capsimirhd: yoooooo
opus_000: south park
tornpaperyoyos: #stonerthoughts
Nussinov: 1 protein can be made in sub 10 seconds monkaS
localcanofdutchgold: probably
jimmyadaro: engineer
ShredderSherlock: lol yes
vicmoney69: yes
360Plato: its called cancer
jimmyadaro: bio engineer
jimmyadaro: ?
mattdougherty22: agent
TsarSec: ????? are you an android wtf
itsxaos: youll think of your computer as a biological thing maybe
mattdougherty22: yes
normie4life: thinking about thinking LUL
icekrieg: you're a biological computer
levinson2504: we are biological things
Mint2bSpiced: If they mess up it becomes cancer
directrix13: @georgehotz there is pretty much a CRC on the end of your DNA called telomeres
geobitz: good
rafalive: yes
jimmyadaro: IT is better, we control the world
subconix: I thought this was called learning
Br4nnon: probably based on expertise
localcanofdutchgold: both perspectives
rafalive: its good
LaheyFPS: probably become healthier @georgehotz
geobitz: perspective
zoogaezee: BRO YOU ARE A BIOLOGICAL THING THAT IS A FACT
pwnbase: it's arbitrary
mutrx: evolution fixed the bug in 20BC, check the changelog @georgehotz
WhiteTailedSpider: @C0deCane ambulance*
ShredderSherlock: you'll be able to model the biological system better in a program
jimmyadaro: YOU DIDNT WASH UR HANDS EARLIER
tsAllySparkles: sounds depressing
ideology_sniffing_raccoon: forget
cregger: forget
vicmoney69: f o r g e t
ahahahaitslit: i wondered this too lol
360Plato: different framework
jimmyadaro: nope
tsAllySparkles: i'd rather live forever as software anyday
Nussinov: everything in biology is just an arbitrarily large physical system of interacting components
jimmyadaro: that was
levinson2504: doctor stonks
PiroFloydian: 10 seconds isnt effective
mattdougherty22: when consuming drugs or food do you think of it as a computer
tornpaperyoyos: #stonerthought
jimmyadaro: like4 secs
Br4nnon: you should always wash your hands for at least 10
timi13462: with dial
mattdougherty22: or a system in genreal
thecoder15: you want to have fun, look at everything going on in your digestive system
tensorspac3: why wash ur hands if you've not come into contact with something new?
l1ght5p33d: Just keep the hookers to a minimum you should be fine
PiroFloydian: it's been tested
LaheyFPS: DansGame didnt wash hands
PiroFloydian: 10 seconds isnt effective
Br4nnon: i think it comes with the knowledge
thecoder15: @georgehotz you want to have fun, look at everything going on in your digestive system
williamjennings1: 10 seconds wtf
sunole: Nature trial and error
wholesome_pepe: systems biology is a thing
Br4nnon: @PiroFloydian i said at least. key word
jimmyadaro: geohotz call me "bro", i can die happy
Nussinov: there is!!
THX1342: have you seen these computer simulations of DNA/RNA replication? It's a real mindfuck https://vimeo.com/361099778 it's a nano factory... really amazing stuff
jimmyadaro: @THX1342 omfg
itsxaos: @mattdacentaur it could be really helpful for a few cases, its a good idea and you should continue with it
THX1342: what jimmyadaro ?
zoogaezee: I JUST TUNED IN , WHAT is your goal right now ? with all this research
mutrx: @THX1342 i always question those, like surely they have to animate that by hand somehow?
jimmyadaro: @THX1342 I was looking for that video yesterday
sunole: Duh
rgbeezus: you streaming every night?
jimmyadaro: @zoogaezee Mind-fukc us?
tensorspac3: well if it didnt would it be called a corona virus
l1ght5p33d: Too much information to visualize whole cell, you probably want to reduce complexity there
THX1342: mutrx wut lanaluHuh
rgbeezus: tryna get partnered
C0deCane: @zoogaezee hes making a stronger virus that can beat up the other virus
tensorspac3: yea
Nussinov: @mutrx there's probably at least SOME interpolation happening
timi13462: that's old news
jimmyadaro: @georgehotz https://vimeo.com/361099778
vicmoney69: Yeah thats why it has common cold symptoms
AresRai: they all reuse the source codes @georgehotz
passingremarks: i thought they all came from the same family
slurmdota2: colds are a coronavirus too
TsarSec: SARS is just an umbrella name @georgehotz influenza 'common cold' is related thats why people call it a 'flu'
directrix13: COVID-19 is a type of Sudden Acute Respiratory Syndrome
AzzoDio: What?
mutrx: @THX1342 like they're simulating the water molecule interactions, but what about all the reactions to?
tensorspac3: common cold = corona virus, Flu - Influenza
keith282: What is the edit difference between COVID19 and 229E?
THX1342: mutrx ohhhh ok.. I understoood what you meant now.. yeah I think it's mostly 'hand drawn'
levinson2504: corona git cloned common colds
mattdougherty22: @itsxaos thank you, I think it would be most interesting to reference like every question George or Peter Thiel has ever publicly answered, can be referenced much quicker
sunole: Cold is rhino virus, not corona
AzzoDio: 20% of positive tests did NOT have symptoms. They tested every person on the ship.
THX1342: mutrx I meant CGI not simulation
Ayyyy420Lmao: it's corona too @sunole
opus_000: congress has a package
TsarSec: you should prob do more research into influenza @georgehotz
dorkmo: god bless wikipedia
TsarSec: wikipedia andy LULW
Nussinov: wikipedia is god-tier for early research needs
itsxaos: @mattdougherty22 yea its good for looking stuff up you know you heard, searching stuff and also good if you want an outline of the conversation
gamerguy009: PogChamp
THX1342: georgehotz check this out https://www.youtube.com/watch?v=7Hk9jct2ozY
thrashtazs: @Nussinov factr
jimmyadaro: https://github.com/geohot/corona
b2kemann: Good morning
mattdougherty22: @itsxaos unfortunately the transcription tech isn't greats likely would have to crowdsource to scale. thanks for the feedback. Do you perhaps have a twitter I could ping you on?
AresRai: yup
jimmyadaro: Perhaps
THX1342: mutation?
TsarSec: good luck
AresRai: it evolves
mutrx: influenza mutates ALOT
jimmyadaro: "You need to let it go"
TsarSec: thats like the holy grail
LaheyFPS: it always changes
thecoder15: or we will never cure the coronavirus @georgehotz
PiroFloydian: cause theres a million different ones
itsChopsticks: viral mutations
CompestLive: The cold mutates
C0deCane: @THX1342 exactly
braininavatt: watch the pandemic show on netflix :)
tornpaperyoyos: its a virus
l1ght5p33d: you dont die from the cold you dont need anything people just die and the cold helps
THX1342: new strains every season
iGalactic: Not curing the common cold LUL
THX1342: perfect business model
inciMage: :(
Nussinov: colds are not really worth curing because theres like a billion things that could cause it
o______________________k: squadR hey DUD just stop colds DUD squadR
ideology_sniffing_raccoon: TheIlluminati
Waywoah: It mutates too fast
geobitz: corona mutations gonna be too fast, we have to create chrona cure
Mint2bSpiced: The common cold mutates too quickly
AzzoDio: @georgehotz Yes, on This Week in Virology they said it would have been easy to develop a broad spectrum coronavirus antiviral that would have worked against all of them, if we did in advance. Though the 'common cold' is not just coronaviruses, it has multiple.
mutrx: the Flu shot is comprised of what strains of influenza (bc if mutates so often) will be most prevalent each year @georgehotz
inciMage: its fkin changing bruh
iGalactic: Cancer industry is $$$
SolarBerry: imagine not curing the flu or common cold
xinthegame: https://www.twitch.tv/xinthegame
TsarSec: just cure influenza 4Head
itsxaos: ive stopped using twitter but ill get a notification @itxaos @mattdougherty22
dzid26: Cold is for boomers
360Plato: you may cause a selection bias to a more dangerous disease
paradox109: you can get vaccine every year. but it keeps evolving
cregger: why don't we just cure everything? i dont get it 4Head
wholesome_pepe: cuz it mutates every year
inciMage: just cure lungs
iGalactic: Inb4 mandatory vaccines
killmov3s: what he is working on?
zoogaezee: You think its easy to find a "CURE" for a rapidly mutating virus , that your own body's antibodies dont always work for?
THX1342: georgehotz https://www.youtube.com/watch?v=7Hk9jct2ozY
C0deCane: H1
cregger: @iGalactic sooner than you think
zoogaezee: WHY IS THERE NO VACCINE FOR AIDS?
jimmyadaro: LUL
Nussinov: just dont eat fast food 4Head
directrix13: exercise
gamerguy009: Bitchute . Com
tornpaperyoyos: CRISPR
peter35_: cure aging FeelsBadMan
geobitz: bad proteins
mutrx: cancer EZ
vybster: shouldn't everything be curable with stem cells   CRISPR?
itsChopsticks: cancer is vague.
iGalactic: How do we reverse the aging process 🤔
itsxaos: @mattdougherty22 im sorry its @itsxaos like my twitch
THX1342: we don't even understand the source of AZ yet
mutrx: telomere bruh moment
inciMage: @zoogaezee there is all monkeys are vaccined :)
AzzoDio: @georgehotz There is also someone working on a total flu vaccine, though right now he's working on a monoclonal antibody for this virus. https://twitter.com/CurlyJungleJake/status/1242553710183514112
Nussinov: bruh moment
itsChopsticks: you can't cure cancer because there are so many types of cancer.
360Plato: cure alzeihmers by flossing
techtim123: heavy metals in a vaccine a good idea?
TsarSec: why?
not_bucket: What if you read Philosophy? How do you assume you will think of yourself then? @georgehotz
WhiteTailedSpider: :D
cregger: upload consciousness to AI 5Head
TsarSec: why is the cold different in your mind
Nussinov: comma.bio
iGalactic: LUL
raystriker98: hantavirus is now a thing too?
TsarSec: its just as hard of a problem as cancer
vybster: stem cells   CRISPR
gamerguy009: Revere engineer chemtrails
o______________________k: politics DUD whata fucked up day DUD squadR squadR
jimmyadaro: @Nussinov I heard before it's like $70 something
wholesome_pepe: crispr   synthetic mRNA
DecayingSkullz: There’s at least 160 different strains, or serotypes, of rhinovirus
b2kemann: Exersice
TsarSec: your body fights cancer too
AzzoDio: @georgehotz Bill Gates makes this point, how just a small investment would pay 100 or 1000 times in economic benefit, if you look at the whole world rather than just a drug company balance sheet.
barkazzaz: can you explain why you think it's possible to cure easily?
TsarSec: thats not a great argument
cregger: white blood cells PogChamp
tornpaperyoyos: In the future CRISPR will cure all
not_bucket: Heart disease is not a virus
PiroFloydian: probably not worth the effort to cure every cold considering the relatively small impact it has @georgehotz
jimmyadaro: @barkazzaz He's high? idk
Nussinov: your body fights alzheimers LUL im not sure where this is going
thecoder15: @georgehotz isn't cancer and heart disease pretty close like they are both rogue cells?
jimmyadaro: NOBODY
toasty_jk2: herpes bothers me too. Like 1 in 4 has it and you have it for the rest of your life
elephantpandas: nobody
jimmyadaro: not possible
barkazzaz: @jimmyadaro probably LUL
itsxaos: me :)
cregger: no one :(
ideology_sniffing_raccoon: wut LUL
jimmyadaro: :(
CompestLive: He forgot he altimeters
tornpaperyoyos: @Nussinov how
miiiiiiim: our bodies are killing cancers in our body every day
zoogaezee: Alzhemiers is permanent damage to your brain cells , its like cutting off your leg , no repairing dead cells
jimmyadaro: Q&amp;A??
wholesome_pepe: cure aging or telomere attrition
pz3300: Cancer is immortal
Nussinov: what if you die before your cold is fixed, does your body now not fight the cold?
tsAllySparkles: it's like trying to cure necrosis vs trying to heal a wound
360Plato: alzheimers linked to gum disease
CompestLive: A person with altimeters forgets he has altimeters, easy cure kappa
iGalactic: What’s the youngest age someone’s gotten Alzheimer’s at?
xinthegame: https://www.twitch.tv/xinthegame
itsxaos: incels
AzzoDio: @georgehotz Drug Companies lose a lot of money on vaccines, they were especially burned by all the failed Ebola efforts. When the virus dies off there's no market. It's tough.
itsChopsticks: i have a herpes immunity :)
jimmyadaro: @iGalactic
jimmyadaro: 40 something i think
phrixus_bro: incels
Ayyyy420Lmao: i'm part of the 10% because im a kissless virgin
Nussinov: disease isnt something simple that can be "fought" against or not fought against
THX1342: iGalactic I don't remember
AresRai: @Nussinov no energy = no heat = no defense, drop by 1 degree and system shut down probs
cregger: xqcC
jesor24: Hello, Sorry off topic, do you have a macbook pro 13 2017?
jimmyadaro: @Ayyyy420Lmao But you're cool!
geobitz: effects on us arent bad
ShredderSherlock: @georgehotz what about lyme disease?
vruthlessv: maybe we are more resistiant to it
C0deCane: @raystriker98 hantavirus there is only one known kind that is transmissible and it is extremely rare and only been found in Africa. Hopefully this isn't something like that shit
Ayyyy420Lmao: @jimmyadaro not denying that
geobitz: i have simplex 2
geobitz: :)
miiiiiiim: 1 in 3 have HPV
iGalactic: @jimmyadaro really??
peter35_: Ayyyy420Lmao same bro FeelsBadMan
Br4nnon: LUL
phrixus_bro: nah
jimmyadaro: I didnt
mattdougherty22: go on The Portal Geeorge
AzzoDio: @georgehotz We do have HSV vaccines though!
roystang: how did u know
braininavatt: that'd be me :)
timi13462: no
vicmoney69: LUL
tornpaperyoyos: i do..... not
cregger: not me PogChamp
Nussinov: jokes on you im a virgin stemlord
l1ttlemtman: already solved ?
iuciferdk: this is twitch chat, the same ratios dont apply
ideology_sniffing_raccoon: monkaW
iGalactic: D;
itsChopsticks: i have an immunity to herpes. thank you nordic genes.
geobitz: no
itsxaos: sometimes i have somethign on my lips i think its probably herpes
pz3300: I haven’t got it
vicmoney69: monkaW
opus_000: DatSheffy
tornpaperyoyos: YOU GOT TESTED FOR HERPES
360Plato: I got it was ok
daxyxy98: is there a cure for ligma yet?
theseusq: i dont so must be u @georgehotz :)
guinness84: im the suspect
zoogaezee: During 2015–2016, prevalence of herpes simplex virus type 1 (HSV-1) was 47.8%, and prevalence of herpes simplex virus type 2 (HSV-2) was 11.9%.
pjayys77: jokes on you everyone's virgin's in chat
jesor24: Hello, Sorry off topic, do you have a macbook pro 13 2017?
tsAllySparkles: herpes tests only show positive if you're symptomatic
geobitz: breakouts never happen and testin for herpes can tricky
vicmoney69: ^
zoogaezee: in Persons Aged 14–49: United States, 2015–2016
geobitz: if no outbreak , you cant detect
orientalfish88: can cannabis cure covid20?
cregger: i've had a mouth sore though
Ayyyy420Lmao: after the hooker binge lmao
tsAllySparkles: yeah. i have done full panel tests every month for two years
pz3300: Your girl could have it and you fuck her every day for 5 years and don’t get it
itsxaos: mad curious about why you got that test
tornpaperyoyos: You speak as if you get std test often LUL
AresRai: kinda fucked up how alot viruses you had in your life stay in your body hidden forever @georgehotz
tsAllySparkles: yes
jimmyadaro: @pz3300 but how
l1ght5p33d: i haven't had sex in three years
tsAllySparkles: talenttestingservice.com
ahahahaitslit: lmfao
subconix: they are hiding the cold cure LUL
miiiiiiim: back before the lockdown i was arguing with someone about colloidal silver. it was so depressing
pz3300: How what?
ideology_sniffing_raccoon: squadW
TsarSec: just think of biological warfare as cyberwarfare @georgehotz, the programs gonna have vulnerabilities and they will eventually get exploited, a virus is just exploiting cell mechanisms
AzzoDio: @georgehotz Korea is working on antibody coronavirus tests, 10 minutes, portable, could give to every single person as they enter a public event
zoogaezee: be careful you heard about that fucking drug resistant goneherea
wholesome_pepe: OP genetic endowment
cregger: no women here so we're good Kappa
tsAllySparkles: services lol
TsarSec: there will never be a human w/o vulns
tsAllySparkles: yeah
ideology_sniffing_raccoon: squadW why not for man ??
jimmyadaro: LUL
geobitz: why did we bring up my genital warts?
Br4nnon: rofl
toasty_jk2: LUL
benchai18: @zoogaezee WTF r u talking about. Don’t play rn
360Plato: vaccine for men but no test for some reason
vicmoney69: LUL
zoogaezee: be careful you heard about that fucking drug resistant gonorrhea - it only has like 1 more antibiotic left that even works
tsAllySparkles: it's like the only PASS regulated provider
jesor24: Hello, Sorry off topic, do you have a macbook pro 13 2017? Maybe someone in the chat knows?
inciMage: apply
braininavatt: SeemsGood
THX1342: capitalism LUL
itsxaos: porn and prostitutes probably
caypoh: Broh, takes some bioinformatics courses before 'analizing' coronavirus ;)
tsAllySparkles: lmao
doctorgenus: what if herpes is the cure to coronavirus?
thecoder15: dude gonorhea sounds terrbile
vbrayon: Você pensa que o Flamengo é time?
doctorgenus: catch 22 yoooo
TsarSec: imagine paying for an STD test PepeLaugh
b2kemann: Chewing ice is the cure for herpise
iGalactic: Scam
l1ght5p33d: imagine paying for an STD
tsAllySparkles: trep sure eia is a vaginal swab
benchai18: I got hep c from a bad dope rig
pz3300: Are you talent.lol
jesor24: Hello, Sorry off topic, do you have a macbook pro 13 2017? Maybe someone in the chat knows?===========
benchai18: ^ jk. But my uncle did
tsAllySparkles: yes
jimmyadaro: @jesor24 I do
zoogaezee: there is a CURE for hep C now though
tornpaperyoyos: The real question is: why do you get std tests so often?? LUL
zoogaezee: Shouldnt HEP C go exctinct since they have a cure
geobitz: hep c is most common and easily spread, also curable
tsAllySparkles: i spend most of my time doing web dev now, haven't filmed since last fall
tsAllySparkles: also hacking my kia forte to have smart cruise control even though it's not equipped with it
360Plato: @jesor24 are you trying reserch for hardware attack lol
DecayingSkullz: @jesor24 He has a 2019 16in macbook pro
benchai18: @zoogaezee It’s not a cure. It reduces Viral cell count to minuscule
geobitz: hep b is in ficese i think
jimmyadaro: @jesor24 Watchu need
tornpaperyoyos: The real question is: why do you get std tests so often??? LUL
toasty_jk2: LUL
jimmyadaro: LUL
theonlymonkas: LUL
cregger: PogU
tsAllySparkles: words for the wise
jimmyadaro: WASH UR HANDS
jimmyadaro: MF
benchai18: My uncle had a liver transplant from hep c complications
peter35_: not engineered monkaS
360Plato: screwing a prostitute really cost 700$ with tesating
roystang: isnt the coranavirus super small?
cregger: emongHUGE
phrixus_bro: coronavirus is like godzilla
gamerguy009: Geo prob bangs lots of escorts
wisamalrawi: I like his apartment
TsarSec: https://www.youtube.com/watch?v=OR_7h5DaI-E
jimmyadaro: lmao
zoogaezee: @benchai18 Yeah but • people take it once for a month and than have no HEP C Viral in their blood for the rest of their life , isnt that a cure
braininavatt: Clap
theonlymonkas: 20 sec!
jesor24: @jimmyadaro @DecayingSkullz @360Plato Thank U
DecayingSkullz: Coronavirus engine for backspace.ai
tornpaperyoyos: The real question is: why do you get std tests so often?? LUL
vicmoney69: !uptime
whyZaya: 20!
3310: Is he doing coke?
jimmyadaro: WASH MORE
braininavatt: proud of you george
360Plato: @gamerguy009 better then being an incel
jimmyadaro: lmao
jimmyadaro: and eat garlic
jimmyadaro: and onions
jimmyadaro: we need ya alive
gamerguy009: Escorts much?/
DecayingSkullz: whats up with u and garlic
pz3300: Aromatics
braininavatt: ASMR Kreygasm
jimmyadaro: hahahhaa
PiroFloydian: Pog
zoogaezee: do you think adderall helps with programming?
equipollent_z: is that a mandarin oranges? I love mandarin oranges
jimmyadaro: sounds like fun
vicmoney69: PogChamp
gamerguy009: PogChamp PogChamp PogChamp
cregger: if you pay me in bitcoin and feed me McDoubles i'll let you give me Corona and do tests on me
TsarSec: why
williamjennings1: whip your CAWK out on stream
jimmyadaro: @zoogaezee Yep
theonlymonkas: NICE
tsAllySparkles: ah so you'll be 2 days clean of adderall eh?
geobitz: watch you fail for cocaine
TsarSec: we already know you dont have any stds
360Plato: @zoogaezee dumb question go away
jimmyadaro: Edibles are the shit
tsAllySparkles: you'll probably test like half positive for weed
cregger: it would
almonte550: What would be the limit of different viruses we can be immune of? Is there a limit?
jimmyadaro: Yep, it stays like 1 month
benchai18: HAHAHA
tornpaperyoyos: Adderall??
theonlymonkas: LUL
benchai18: nah, meth
williamjennings1: oh so you take addearall
doctorgenus: why do you need adderall? for work?
braininavatt: online drug test PogChamp
theonlymonkas: when
tsAllySparkles: 2 days adderall i called it
iGalactic: Have you taken psychedelics ?
cregger: i passed mine with a 16 day buffer PogChamp
tornpaperyoyos: Wait you actual;ly do take adderall??
localcanofdutchgold: "all of these"
pwnbase: you had better start studying now
pz3300: Make sure your girl bit watching the stream
benchai18: Dude he doesn’t take addy. He hits a pookie
TsarSec: occasionally Kapp
jimmyadaro: WIFI-BASED COVID TEST
geobitz: do hair test
tornpaperyoyos: RECREATIONALLY??
pz3300: Not
subconix: wait a minute... if COVID-19 is essentially just another "coronavirus" wouldnt we want to let it run its course so the population can build immunity?
pz3300: Blood for sure
360Plato: do tests even pick up adderal
b2kemann: Why are everyone so fixated om adderall??
zwisch: LUL
Ayyyy420Lmao: does ketamine give crosspositive for opioids?
rgbeezus: meth qualuudes
jimmyadaro: Like wOLFIE
esence: why would you take adderall
jimmyadaro: LMAO
benchai18: Lol. Small dose. I took 90 mg a few hours ago and it’s 11pm
PiroFloydian: what are quayludesL
edu4594: why d you use adderal
vicmoney69: LUL
DecayingSkullz: Wolf of Wall Street
AresRai: @b2kemann they want an excuse to do the same
cregger: GET THE LUDES
PiroFloydian: what are those?
tornpaperyoyos: So the truth comes out LUL adderall is the secret to george's success
iGalactic: Imagine thinking adderall is worth the come down LUL
benchai18: @pirofloydian The best thing ever
TsarSec: does adderall use put you in a higher risk bracket for rona's?
jimmyadaro: THOSE LUDES KICK'NG
theonlymonkas: peyote
ahahahaitslit: thoughts on psychedelics
itsxaos: ask bill cosby
benchai18: Methaqualone
benchai18: Lufes
cregger: IM NOT DYING SOBER
benchai18: LUDES
pz3300: Blow
PiroFloydian: @benchai18 *doubt*
benchai18: yes
rgbeezus: meth   qualuudes seems like they would cancel out
tsAllySparkles: pcp test will test positive with ketamine, mxe and others
ShredderSherlock: drug tests should be illegal
AzzoDio: why is cannabis 30 days?
Ayyyy420Lmao: billy used roofies not ludes no?
360Plato: Lets make them in a bioprinter
DecayingSkullz: I WILL NOT DIE SOBER
cregger: lsd is the shit
williamjennings1: what about dxm
tsAllySparkles: dmt is the only cool one
pz3300: Ya
timi13462: look up cocaine
jimmyadaro: @AzzoDio It's the way it is
tsAllySparkles: yeah that will as well
benchai18: Y’all don’t know. LUDES were the best thing ever. Barbs too
equipollent_z: fractals man
sunole: Lots of ways to screw
iGalactic: LSD will open your mind ;)
benchai18: GEORGE. SYNTHESIZE TUINAL
Ayyyy420Lmao: @benchai18 ok boomer
benchai18: YOU WILL BE A LEGEND
PiroFloydian: @georgehotz what are ludes?
jimmyadaro: I will stick wth weed tho
equipollent_z: the 2.5D universe
pz3300: Wet blunts man
gamerguy009: Smoke crack its always fun LOL
tsAllySparkles: only on an much higher than fda approved dose would dxm test positive
benchai18: @ayyyy420lmao I’m 30 chill bro. Just connected
THX1342: LSD in the desert is a cool thing
ConnorMusarra: tune in, turn on &amp; drop out
geobitz: do you believe in a god?
itsxaos: heroin?
ideology_sniffing_raccoon: joe rogan time PogU
l1ght5p33d: U guys all dissapoint me
ImJ4Gu4R: "quite"
Ayyyy420Lmao: ketamine?
Andremm2: acid is great
itsxaos: alcohol?
pz3300: Drop out
Santiago_LHC: Love?
thecoder15: lol cocaine is an amphetamine @georgehotz
tornpaperyoyos: Slightly positive on amphetamines???
Hawklite: do you think drugs are essential to answer some questions? or can all questions be answered without drugs?
iGalactic: Lol my man tried it all
cregger: plenty of lsd experience, all good times of self-reflection
C0deCane: @georgehotz but he would never recommend any of this to you chat. Kappa
rndmsqnce: when was your last trip
TsarSec: opiods monkaS
dairynuts: WHAT IS THIS
williamjennings1: kratom
benchai18: George. TUINAL man.
b2kemann: McKenna ?
Ayyyy420Lmao: @thecoder15 lmao @ u
vicmoney69: meth monkaS
pz3300: Turn on, tune in, drop out
Br4nnon: i just drink tea
itsxaos: DMT?
Abnico: sexy time is good on mushshrooms
iGalactic: Smoke weed then take a hefty dose of acid &amp; take 3 hits of DMT at the peak then report back ;)
pwnbase: have you done enough mdma to lose the magic
Santiago_LHC: "Full trip"
C0deCane: Stay in School kids don't do drugs LUL good luck with that now
theonlymonkas: gaming time
tsAllySparkles: culturally you're like elon musk's little cousin
pz3300: Negative on mdma
benchai18: Any other ex H junkies in here??? Besides me
geobitz: do you believe in a god?
360Plato: Opioids are for when your done being productive
almonte550: That was when you founded comma ai?
ahahahaitslit: any bad trips on them?
pz3300: Must of been shit swag george
un3okapi: what are your thoughts on love?
Abnico: burning man gonna be cancelled
l1ght5p33d: You can die from all of it first time more likely
SolarBerry: psychedelics are too crazy for me i'm already tripping day and night
benchai18: George. When u dissected checkm8, you had a chick over
benchai18: Who was she
TsarSec: did you see this yet @georgehotz https://i.imgur.com/3nXp0ni.mp4
inatreecrown: why not
pz3300: Negative thoughts on ecstasy’s?
gamerguy009: Whiskey mushrooms and a machete
cregger: can you imagine the shit george says when tripping holy shit i'd pay to be there
tornpaperyoyos: This stream is very eye opening on george's drug use LUL
peter35_: it's a warm hug, for me at least
barkazzaz: why would you use these things tho?
THX1342: SOMA
theonlymonkas: thoughts on peyote
ahahahaitslit: lmfao
geobitz: id get fucked up offa bean
PiroFloydian: thats fuckin scary man
jimmyadaro: @cregger Same
pz3300: Tripping while swimming in the sea is awesome
Ayyyy420Lmao: no, mescaline
tsAllySparkles: no
TsarSec: spirit molecule Pog
christianthefalco: just saw your Lex Fridman interview. so good!
williamjennings1: what about ssri's
equipollent_z: doesn't peyote make you puke?
cregger: tripping and VR is the bomb
vicmoney69: ioaska monkaS
jimmyadaro: @equipollent_z Sometimes
iGalactic: Infinite DMT trip when we die? 🤔
oGobby: just had a crazy good trip on shrooms
maxprogram: finally found it, this guy explains why no cold/flu vaccine here (economics) https://threadreaderapp.com/thread/1240498037958545410.html
geobitz: u dont wnat payote
360Plato: you feel warm and numb on opioids
Ayyyy420Lmao: thoughts on ketamine?
esence: IVE NEVER TAKEN DRUGS, AM I MISSING OUT?
geobitz: its supposed to suck alot
b2kemann: What do your mom say to all this geo??
pz3300: Your a smack heeed
christianthefalco: @iGalactic you wish
SolarBerry: what about blueberry concentrate
benchai18: Y’all. Opioids changes what matters to u. I was on a 10 year run. Started with Oxy’s, ended up shooting black for years... IF U CAN SHOOT DOPE LIKE A GENTLEMAN, I WOULD HIGHLY RECOMMEND IT!!!!! But alas, I can’t
almonte550: Did you founded comma ai before or after the full trip?
edu4594: @esence hell yea
AzzoDio: Czech Republic, 100% mask usage in 10 days: https://twitter.com/jeremyphoward/status/1242572288962240517
vicmoney69: @esence yes
C0deCane: @cregger I just imagine some dipshit breaking his new Index LUL
iGalactic: @christianthefalco well why does so much of it release when we die?
pz3300: Cactus
Sidhuu: high doses of dextromethorphan cures everything
williamjennings1: lol
theonlymonkas: now what
pz3300: Shite
thecoder15: lo
cregger: @C0deCane its safer on the comedown
jimmyadaro: We need @georgehotz high af on DMT, live, on Twitch!
theonlymonkas: ResidentSleeper
gamerguy009: Coke is fun to cook in a spoon
Santiago_LHC: @esence It's like sex, a lot of it is hyped.
williamjennings1: are we breaking rules on twitch
TsarSec: young people are way less affected
christianthefalco: @iGalactic times passes when you're tripping on DMT. It's just weird and slow
pz3300: There’s a reason people been doing cocaine fir thousands of years
guacDev: What do you think about krokodil
opus_000: DMT is overrated
condoram: The drug?
cregger: xqcTOS
pz3300: Yabba
ImJ4Gu4R: How about kratom
benchai18: @gamerguy009 Sure is. Esp when you’re making a speedball
condoram: No drug talk y0
ahahahaitslit: how long does dmt last? 20 mins?
TsarSec: you should look into how vaccines work
cregger: NO SNITCHES
AzzoDio: @georgehotz Yes, the hypothesis is kids are immune. Old hypothesis. Being worked on. It's OC43 specifically though
pz3300: 10-15
benchai18: @pz3300 Yabba is tweak right? In Thailand?
itsxaos: still did the stream tho king
ImJ4Gu4R: @pz3300 thats shit horse pil
프랑2: if you are immune to the virus version that you got infected but if you got a evolved version of it... it repeats over and over
AzzoDio: Not immune, but better outcomes, because of greater oc43 exposure
iGalactic: They think O blood type might be immune @georgehotz
pz3300: Snitches get ditches
almonte550: Do you mean that being immune to sars 1 will make you immune to sars 2 and viceversa?
condoram: This is the FBI you are all under arrest due to being 13 and talking about drugs
TsarSec: its mostly the human immune system that generates a cure
AzzoDio: @georgehotz https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2095096/pdf/JIDMM17330.pdf
ahahahaitslit: lmao
equipollent_z: aren't there good biohackers in Oakland?
C0deCane: @condoram geohotz is a bio engineer this was merely a scientific study
jimmyadaro: @condoram wtf
Ayyyy420Lmao: you're implying it's sequenced and youll get a hit when searching the sequence man
tornpaperyoyos: Seriously? YES IM O-NEG
theonlymonkas: what were the symptoms
wisamalrawi: I'm O-
toasty_jk2: a cold lasts for 1 week w/o medication or 7 days with
AresRai: O Type gang
Br4nnon: How strong is the immune system on a general level
condoram: I thought he was a college dropout?
tbodt_: is this an xkcd reenactment stream
Sidhuu: is it bad to want corona just to see how it feels
tornpaperyoyos: YES
jimmyadaro: O J Simpson Gang
tornpaperyoyos: IM O-NEG
rgbeezus: how do you know your blood type
AzzoDio: @georgehotz Also this, newer data http://virological.org/t/remarkable-age-distribution-of-oc43-vs-sars-cov-2-in-china/399
AresRai: @wisamalrawi same we give to everyone and receive only from each other :(
wisamalrawi: I heard blood type A is most sensitive to Corona
SolarBerry: i just read an anecdote from someone O blood type who had terrible symptoms from the coronavirus
opus_000: O ftw
williamjennings1: george should make his own strain of weed
C0deCane: my brother has O blood type im bout to drain him LUL Kappa
benchai18: How tf y’all know ur blood type.
condoram: aww but I am blood type A I believe
benchai18: It’s true. And A is worst
pz3300: George will be pissing in bottles next week like Howard hughes
localcanofdutchgold: is it immunity or affects you less
Santiago_LHC: @benchai18 it's in your blood work
jimmyadaro: @williamjennings1 "Comma Weed"?
iGalactic: Maybe not immune but less likely .. I don’t have a link sorry just been hearing that a lot
benchai18: @santiago_lhc I never looked at that shit. Prob shoulda. I rly was a junkie though... sooooo yeah. I was checked out for a decade
condoram: @benchai18 if you cut your finger the color of the blood decides your type
oGobby: #LI5
AzzoDio: Serological = antibody tests
b2kemann: Lizards are immune. Coincidens?
oGobby: ELI5
theonlymonkas: O negative or positive?
jimmyadaro: @b2kemann lmao
almonte550: How do you know so much about herpes again?
Ayyyy420Lmao: @b2kemann mind = blown
pz3300: If it’s green your a lizard
condoram: His mom had it
jimmyadaro: @almonte550 He had it
benchai18: @condoram Source? Send pantone palette so I can reference
jimmyadaro: @almonte550 fr
williamjennings1: comma weed
tornpaperyoyos: Im so happy to be o-negative right now
williamjennings1: igM vs lgG
jimmyadaro: Comma Weed seems alright
almonte550: @jimmyadaro makes so much sense
benchai18: Any Type O Negative fans round here?
equipollent_z: comma bio
joshperri: Test on your serums
Br4nnon: learning is fun
jimmyadaro: @almonte550 He was talking about that like 10 minutes ago
localcanofdutchgold: knowledge tree 5Head
tornpaperyoyos: @benchai18 Im o-neg
cregger: the real question is, has anyone seen any birds since quarantine?? NOPE because they are changing out their batteries
Mint2bSpiced: Try Elisa
condoram: I see plenty
almonte550: @jimmyadaro sorry I missed that
r3mote: Good morning :-)
jimmyadaro: SMALL PHARMA IS REAL B!TC#E$
benchai18: @tornpaperyoyos Nah I meant the band. Type O Negative. Lucky bastard u
theonlymonkas: i'm O negative
tornpaperyoyos: @benchai18 oh you mean the band LUL
pz3300: I say we drown all the people that don’t die if corona just in case
subconix: so its just a blood test?
Codeoxic: @georgehotz How long have you been working on this?
williamjennings1: its hurts my eyes to read chat sometimes
condoram: they just don't hang around where people used to because we are not there to drop shit for them
equipollent_z: can people who are immune pass that immunity to others?
jimmyadaro: @equipollent_z Yep
THX1342: as long as there is no reinfection. we'll know from wuhan soon
benchai18: @tornpaperyoyos Yo lemme get a few pints of that fine shit.
condoram: Only through sex, equ
jimmyadaro: @equipollent_z That's the main issue
condoram: Go make your parents immune!
benchai18: Cuomo’s kind of a twat
benchai18: Sorry
iuciferdk: https://www.medrxiv.org/content/10.1101/2020.03.11.20031096v1 blood type
Sidhuu: @condoram WeirdChamp
cregger: lets just colonize Mars and leave Corona behind
oGobby: so O- negative blood type is immune to corona
AzzoDio: @georgehotz The hypothesis is that previous OC43 infections explains why children tend to do so well: http://virological.org/t/remarkable-age-distribution-of-oc43-vs-sars-cov-2-in-china/399
gamerguy009: Prepare the gas showers
almonte550: @oGobby wait what
Mint2bSpiced: Serological test are usually ELISA based unless they are POC (point of care) like lateral flow tests
Br4nnon: I'm ready to leave Earth Kappa
equipollent_z: I remember hearing something about married donors not able to share organs, maybe it had to do with sex also
doctorgenus: what time do you sleep @georgehotz
condoram: The thing is even young adults do well
l1ght5p33d: reverse transcriptase PCR is the most vague general term
benchai18: @mint2bspiced LAM ELISA = TB test no?
williamjennings1: dang his gonna be up!
williamjennings1: not sleeping until 6am
gamerguy009: Take me to mars
theonlymonkas: LUL
peter35_: in the coffee zone FeelsGoodMan
phrixus_bro: no sleep until vaccine
equipollent_z: are there med students in the chat too?
williamjennings1: drink more coffee
cregger: no sleep until rocket
opus_000: I'm here for the energy
iuciferdk: @georgehotz "CONCLUSION People with blood group A have a significantly higher risk for acquiring COVID-19 compared with non-A blood groups, whereas blood group O has a significantly lower risk for the infection compared with non-O blood groups." https://www.medrxiv.org/content/10.1101/2020.03.11.20031096v1
condoram: I used to study medical lab science but ended up switching to CS
benchai18: Anyone else here ever had Consumption?? Shit’s vicious
williamjennings1: can you shotgun a coffee on stream
thrashtazs: yeah wait are there any med students to back up what hes talking about
gamerguy009: Corona. Py LOL
pjayys77: any one into cold brew
Mint2bSpiced: @benchai18 yes
gamerguy009: PogChamp PogChamp PogChamp PogChamp
PiroFloydian: @georgehotz USE GOOGLE SCHOLAR
Ayyyy420Lmao: dying from comon cold? KappaPride
Nussinov: "Is the Flu the Cold" LUL
equipollent_z: I feel like I'm watching the OverTheWire Bandit version of Corona
cregger: WAPO ResidentSleeper
theonlymonkas: and who answers to those questions?
vicmoney69: use duckduckgo
benchai18: @mint2bspiced Shit’s rough huh? U had that White Plague?
iGalactic: Jew York times LUL
williamjennings1: @pjayys77 kind of want one
tornpaperyoyos: Washington "Abu Bakr Albagdadi is an austere scholar" Post LUL
Nussinov: @vicmoney69 what a terrible suggestion LUL
r3mote: exclude sites with "-"
gamerguy009: We are a cult
condoram: Google scholar is babe
AzzoDio: @georgehotz Only like 15% of colds are coronavirus, there are many others
equipollent_z: maybe a lot more advanced than Bandit
tsAllySparkles: go to scholar.google.com
THX1342: duckduckgo &gt; 1st result is CDC LUL
benchai18: @mint2bspiced Oops. Ignore
condoram: https://scholar.google.dk/
vicmoney69: @Nussinov ? why
tsAllySparkles: lmao
tsAllySparkles: im tired
jimmyadaro: Going full med student right there
jimmyadaro: @tsAllySparkles Same
equipollent_z: immune2own
benchai18: @mint2bspiced I thought you were saying “yes” when I asked if anyone has had consumption
Nussinov: @vicmoney69 it is not helpful to suggest that is what Im saying
THX1342: LUL
b2kemann: Next time se should do economics. Find out when the dollar is gonna crash
THX1342: names and logos
condoram: aaand back to IT! Yay
THX1342: we need Corona logo
Zazens: scholar.google.com @georgehotz is pretty good
cregger: i'm getting sleepy can you make the vaccine already
Br4nnon: meltdown
THX1342: call the bizdev guys
Tyrant_01: GEORGE WOULD YOU ENCOURAGE ME TO STUDY FOR PROGRAMMER OR NETWORKING SO I CAN HAVE I BETTER BASE FOR HACKING...OR PROGRAMMER JUST MAKE STUFF IN GENERAL
itsxaos: it was a pretty crazy bug tho
condoram: https://scholar.google.dk/
jimmyadaro: @Tyrant_01 wtf is wrong with you
benchai18: GEORGE. MY FAV WAS THE ANNA KOURNAKOVA WORM
condoram: DK version is superior
pz3300: I’m off george. It’s 5am. If I don’t see you through the week, I’ll see you through the window
Br4nnon: PogChamp whole new world
Ayyyy420Lmao: when are you hacking reality??
vicmoney69: PogChamp
williamjennings1: comma ai
jimmyadaro: @pz3300 Check out his YT channel later on
benchai18: Deez nuts finna do it for u
pz3300: Cool. In a bit dude
christianthefalco: Do not get into biohacking. Biology doesn't follow simple rules like software. It's ALL spaghetti code
almonte550: @georgehotz must look -&gt; https://pubmed.ncbi.nlm.nih.gov/18818423/
tornpaperyoyos: Washington "Abu Bakr Albagdadi is an austere scholar" Post LUL
williamjennings1: YAAASSSS
benchai18: What does a car decoder do?
Ayyyy420Lmao: there's no skoda in there man
Mrclutch963: Do you meditate? @georgehotz
ShredderSherlock: lol are manufacturers ok with that
theonlymonkas: LUL
jimmyadaro: @pz3300 "Comma AI archive" on YouTube
vicmoney69: LUL
b2kemann: Lol
benchai18: How do u interface with the car George?????? Not that OBD shit right???????
PiroFloydian: WutFace
theonlymonkas: PogChamp
JohnEGQ: we all meditated together yesterday on air
C0deCane: LUL @georgehotz do you use CBD oil
localcanofdutchgold: didn't he say the opposite last stream ?
360Plato: I can hack the rats first
PiroFloydian: cmonBruh
Santiago_LHC: @Mrclutch963 He has medidated on stream many times
c1tr0n75: cheer50
williamjennings1: can you make comma ai drift by itself
ahahahaitslit: i think so lmao
b2kemann: Hack ALL the cars
iGalactic: Do you use essential oils pepega
theonlymonkas: only yesterday
THX1342: anti-histo... isn't this allergy related?
Nussinov: never meditated, thought about becoming a serial killer in his youth, streams on twitch --- we got ourselves an incel boys
jimmyadaro: @williamjennings1 That would be amazing
Nussinov: Kappa
benchai18: How do u interface with a standard car George?????? Like a Kia. Not that OBD shit right???????
pjayys77: you know what they say When in Rome... wait does that apply
jimmyadaro: ^^
itsxaos: oh thats right i forgot we meditated
Tyrant_01: So Hacker or programmer what is the way george...need you guidance man..
c1tr0n75: c1tr0n75 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 8 in the channel!
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to mattdougherty22!
l1ght5p33d: I think this has been a complete success
doctorgenus: do you have enough TP for two weeks?
itsxaos: PogChamp free sub
Jehhred: How does it feel knowing that hot chicks are dancing on stream with triple the amount of viewers.. They aren't even good dancers........
jimmyadaro: @Tyrant_01 What you need to do? Or whant to do?
williamjennings1: can you make a program where you make the car do donuts
architectzs: bow long has geohot coded for anyone know?
jimmyadaro: want*
christianthefalco: @Tyrant_01 just become a programmer and have an easy life
DecayingSkullz: lets get a hype train going...
b2kemann: He also never chews ice
SofiaLouise: any tips on how to get into meditating?
0R4NG3: LMAO
AresRai: LUL
JohnEGQ: I'm watching BOTH
Nussinov: ^
tsAllySparkles: i'm actually working on a camgirl site that is more free speech oriented
condoram: Yea, start dancing for more views!
C0deCane: @Tyrant_01 Hes a jack of all trades, master of some
tsAllySparkles: webrtc is tricky
benchai18: Y’all. How do I interface with a basic ass Kia
thebiggaeboi: talk about backspace
iGalactic: LUL
not_bucket: do you believe in god george?
jimmyadaro: PLAGUE INC!!!!
theonlymonkas: you still need to play
directrix13: dance for us @georgehotz
itsxaos: twitch thots are stupid, porn is free
THX1342: watch this later georgehotz https://www.youtube.com/watch?v=7Hk9jct2ozY
iGalactic: Simps smh
Roundlay: LUL
bytebacon: Sam Harris Waking Up is pretty cool too
ahahahaitslit: don't forget eric weinstein
cregger: do ASMR for us
ahahahaitslit: lmao
syrio16: ımhhhh amma head out
condoram: What time is it over in US?
C0deCane: LUL
benchai18: LEX FRIEDMAN
jimmyadaro: PLAGUE INC MF!
tsAllySparkles: i wanna make a twitch-like site that allows titties. current cam sites don't even allow TVs to be in frame even when they're off
c1tr0n75: c1tr0n75 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 9 in the channel!
dorkmo: to be honest ive been playing plauge inc
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to brownyyyylocks!
l1ght5p33d: we already decided on some good treatments and running up against knowledge of the experts
theonlymonkas: gaming
jimmyadaro: PLAGUE INC! PLAGUE INC!
northumb: what time do you get up?
archeadis: @georgehotz is that tmux in ur terminal?
b2kemann: Georg is slowly transistioning into terence mckenna
condoram: @c1tr0n75 what does that mean the thing you are doing?
benchai18: I take huge pride knowing that I told George to watch Lex and some day they’ll talk about me
360Plato: Eric Weinstein is long
Ayyyy420Lmao: so meta
brownyyyylocks: @c1tr0n75 yo thank you!!
itsxaos: pneumo as in pneumonia
theonlymonkas: are you going to stream tomorrow?
itsxaos: yes
jimmyadaro: 4%
UniversalGeneve: water?
PiroFloydian: OH SHIT
itsxaos: h2o 4Head
PiroFloydian: THIS STUFF FUCKS YOU UP
archeadis: @georgehotz is that tmux in ur terminal??
pwnbase: sounds scary
jimmyadaro: COVID is 4% death rate
b2kemann: Miss the kong curly hair
Roundlay: Ugh
thebiggaeboi: LMAOOO
dairynuts: i love that
vicmoney69: water???
jimmyadaro: @archeadis Yep
C4TFive: killer chemicals man
vicmoney69: H2O
condoram: Dihydrogin monoxied? LOL that hoax
Nussinov: monkaS
directrix13: I'm drinking some right now
c1tr0n75: @condoram you mean gifting subs ?
benchai18: George’ll be like “this dude Ben told me to watch ur corona video. Fucking loved it dude. Thank god for Ben”
AzzoDio: We have lots of clusters where like 90% of the cluster got infected. That seems unilkeyl
ahahahaitslit: water
thebiggaeboi: some quality bio right here
condoram: Did you know 100% of people that consumed dihydrogin monoxied died?
thecoder15: its wate ryou idiots
Ayyyy420Lmao: be careful if ur weed is not dried properly it has dihydrogen monoxide
jimmyadaro: PLAGUE INC
julien9877: H2O monkaS
condoram: or will die!
theonlymonkas: oxygen can
iGalactic: monkaHmm
JdPaulBlart: so covid19=water?
dairynuts: ?? how are you comparing covid19 to....that? a bit of a mischaracterization, no?
williamjennings1: so much clutterr
architectzs: what is george’s iq lmao i’m curious ?
condoram: @c1tr0n75 ah, well don't gift me, I am not a regular on twitch. I just come to see george sometimes
Ayyyy420Lmao: @dairynuts water is more dangerous, at least i can drown on it
jimmyadaro: @condoram Same
dairynuts: @architectzs maybe 110
julien9877: @georgehotz maybe it doesnt spread as fast?
localcanofdutchgold: rate of transmission?
THX1342: what's it's R0 tho
SolarBerry: that virus hasn't been collapsing world-class healthcare systems
pjayys77: is it time to detab
b2kemann: Lol great troll
itsxaos: yea a big problem is that its new and we dont know how it will develop
benchai18: Can I be serious for one second. NOT kidding now. I would pay $11,000 plus expenses to get George and Joey Diaz in a convo
jimmyadaro: 3:25 am here, i'm tired
c1tr0n75: @condoram it's really to support George streams, the persons who gets gifted are totally random
benchai18: Anyone want in on this?
FlightOfGrey: Isn't it because of the combination of transmission rate and the death rate as well as symptoms requiring hospitalisation
Nussinov: read the WAPO article Kappa
equipollent_z: did anyone ever identify which lab it originated from?
opus_000: TheIlluminati
benchai18: Hotz / Diaz 2020
architectzs: what is the thing he has on the top left of screen
Br4nnon: @FlightOfGrey yup
jimmyadaro: @architectzs VIM
architectzs: vim?
Mrclutch963: Who is eric weinstein? @georgehotz
ahahahaitslit: george how much to see you do shrooms on stream
tsAllySparkles: it's tmux with vim
b2kemann: But r0?
benchai18: @architectzs It’s a terminal window running Vim. It’s on his GitHub
miiiiiiim: there are more metrics to it than just mortality rate......
tsAllySparkles: vim is a text editor for a terminal
ConnorMusarra: the death rate will skyrocket when hospitals can no longer sustain everyone ie italy
tsAllySparkles: tmux is a terminal multiplexer
Mint2bSpiced: It has to do with how fast it can spread and IF it mutates with a higher mortality rate...
vicmoney69: betacoronavirus? so it is a bioweapon monkaS
theonlymonkas: emacs
architectzs: will it work on windows?
architectzs: in cmd?
tsAllySparkles: with windows subsystem for linux enabled
tsAllySparkles: or with cygwin
tsAllySparkles: probably
jimmyadaro: @architectzs Maybe, just buy a Mac or use a virtual machine with Linux
benchai18: @architectzs @jimmyadaro will come through with the GitHub link for u. He’s a legend
Abnico: الله أكبر الله أكبر الله أكبر
tsAllySparkles: just get wsl
jimmyadaro: F!ck windows
nremind: use wsl with windows
boengels: still going!! Dude you are a machine!! :D Love your work
condoram: Yea, as long as the health systems are capable then we will not have a massive death rate
condoram: but yeah, act too slow and you end up in Italy situation
jimmyadaro: @architectzs https://github.com/geohot/
benchai18: @boengels He smokes meth dude. He just told us a few min ago
ahahahaitslit: the health system is ass for most countries
architectzs: scale of 1-10 how much better is linux compared to windows
Br4nnon: hospitals only have so many beds LUL
dr_set: corona is supposed to be between 10 to 20 times more deathly than the flu, but data is trash so we don't really know
jimmyadaro: @dr_set Isn't death rate like 4%?
benchai18: @dr_set Yup. And sample size is in flux and LIKELY very inadequate
ahahahaitslit: too many journalists raping the data also
AresRai: @jimmyadaro cant know how many infected there really are thats the prob
dr_set: some regions of china say 0,4 others, 4%
vicmoney69: @architectzs 0 for casual use cause a lot of programs dont work in linux. If u have a decent pc u can get a linux virtual machine
dr_set: so data is trash
Ayyyy420Lmao: @jimmyadaro nah infected is probably way higher than reported
jimmyadaro: @Ayyyy420Lmao In China maybe
c1tr0n75: @jimmyadaro no because they are not testing everybody so the total infected numbers are not right
benchai18: @jimmyadaro Even fatality rate of 4% isn’t necessarily true. Likely way more people infected that aren’t accounted for
dr_set: the cruise ship had 1% and that is a older people population
nremind: @architectzs 9, only thing windows is better at is games and maybe some apps like onenote
THX1342: what I'
jimmyadaro: @nremind Word
c1tr0n75: @jimmyadaro actually, the best experiment we had is the Diamond Princess
condoram: With 422989 recorded cases and a death of 18919 it ends up to 4.47% death rate
Ayyyy420Lmao: @jimmyadaro not because their hiding it but because asymptomatic or lil simptoms   not enough testing
jimmyadaro: @c1tr0n75 What is that?
C0deCane: @architectzs Check out linux mint I think you'll like it if your like trying to convert or something
benchai18: @dr_set And Italy has the highest population of elderly people
PiroFloydian: DansGame
dairynuts: 20 tabs of chromium based browser open...
jimmyadaro: @dairynuts So?
condoram: Italy helped a lot with getting the death rate up, not sure if all countries will have the same fate
architectzs: i still play games with linux fuck it up?
CheeseManUchiha: tab gang
benchai18: @jimmyadaro Cruise ship
dairynuts: @jimmyadaro im jealous
THX1342: what I've heard from doctors in the front line is that the great difference between covid and a flu is the general condition of people who have bad to severe cases. covid is way more aggressive and demands a lot more resources to stabilize
Ayyyy420Lmao: @architectzs just get dualboot
dairynuts: my comp would freez
C0deCane: @architectzs not really
l1ght5p33d: get Ubuntu if you want linux
condoram: I use arch btw
AzzoDio: @georgehotz From what I understand, people expect this virus to eventually turn into a recurring common cold type virus with very mild symptoms, after years have by and basically everyone has antibodies forit
nremind: yeah I dualboot, but most games are windows native
l1ght5p33d: actually i take that back Ubuntu if you actually program
dr_set: @benchai18 yes, Italy is a bad sample, to many old people, but still I wan't to see the numbers in a couple of weeks
c1tr0n75: @jimmyadaro well, it's a boat stuck in Japan, with someone in it who had the virus. since no body got in or out and everybody got tested, we know that in a scenario like that similar to a laboratory test, the mortality is arount 1%
jimmyadaro: @AzzoDio Sounds right
equipollent_z: missed it, but is that an old corona virus
Br4nnon: Gotta dual boot if you play games
jimmyadaro: @c1tr0n75 With how many cases?
dairynuts: @architectzs you should get a VM. download vmware or virtualbox and install any linux distro you'd like
jimmyadaro: Like, how much people on that boat?
condoram: Also the virus mutates when it gets into a person. I forgot the source but the virus eventually becomes less aggressive
vicmoney69: 15-50 have a low death rate for both were safe LUL
equipollent_z: crazy
l1ght5p33d: if you don't know Linux by now i'm tempted to say just avoid it
architectzs: how helpful is linux? if i wanna mess around with a raspberry pi or something or just learn in general
bc10000: can you explain what is your goal here? i just joined
condoram: Italy is unfortunate because it is nr 2 on the list of countries with most old people and they acted way too late on lockdown
c1tr0n75: @jimmyadaro you can google it up man, Diamond Princess, 712 persons got the virus
vicmoney69: @bc10000 hes trying to cure COVID-19
Ayyyy420Lmao: @georgehotz thought on chainlink? do you know sergey nazarov?
dr_set: @jimmyadaro 3100 people on the boat 700 got the virus 8 died
jimmyadaro: @c1tr0n75 I'll check it out
THX1342: c1tr0n75 how much support do those people get on the ships, btw? do they have ICU setup inside the boat? that is also a factor
condoram: so their health system collapsed and now they need to pick between who should live
benchai18: @vicmoney69 Here’s a trippy thought for u. What if age is not the attribute that distinguishes infected.
THX1342: small sample?
nremind: I use linux for development and because it doesn't have a lot of spyware overhead. It doesn't offer much else over windows though
vicmoney69: @benchai18 did u see the chart
Maizlow90: What are you trying to do btw?
igg44705: finally caught the stream
K177: LUL
mik12f4: So are we going to be injected with OC43 to get protected?
condoram: I do however think US is going to be the country to end up having the most deaths in the long run, mostly due to lack of support for people that can't afford it
condoram: unless of course they change their shit around
C0deCane: @georgehotz if it does that just get the no script add on and get around it lUL
christianthefalco: Science people have finally started putting pressure on the publishing industry. It's awesome what's changed in the last couple years
AzzoDio: @georgehotz That can't be right, maybe 5% of people severe enough to be hospitalized?
K177: just find a cure 4Head
benchai18: @vicmoney69 No, but I’m suggesting that the correlation isn’t necessarily the cause.
Nussinov: LUL
directrix13: shit's hard
jimmyadaro: PLAGUE INC
benchai18: $$$$$
igg44705: how long has he been streaming for?
Abnico: PogChamp
Nussinov: because its too easy
Maizlow90: Anyone can explain what he is trying to do/accomplish?
condoram: Finding a cure would mean less money to hospitals because people don't need them
C0deCane: Probably because the regulations that they have to pass
directrix13: !uptime
AzzoDio: @georgehotz People tried to get funding for general coronavirus broad spectrum antiviral, years ago, never got off the ground.
condoram: It is not profitable to find a cure!
c1tr0n75: @THX1342 it depends on the countru that takes care of that situation. In the situation of Diamond Princess, it was really good actually, they sent medics and doctors by helicopters, got everybody tested, and keep in mind that, most of the passengers were elderly, and we only have a mortality of around 1,5%
Abnico: TriHard TriHard TriHard
benchai18: Yup
Abnico: BrainSlug BrainSlug BrainSlug
K177: its also not profitable to overwhelm hospitals and kill off their staff
C0deCane: plus also long term effect testing
equipollent_z: need the penicillin for viruses
pjayys77: Big Pharma rearing it's ugly head again
Abnico: SeriousSloth
condoram: That's what you get for having capitalism, money &gt; people
benchai18: @k177 It’s different. Pharmaceutical industry is LONG game.
jimmyadaro: Small Pharma will overtake
CheeseManUchiha: unpaywall extension gang
JdPaulBlart: google collab is poo poo
solitarynative: why are they called corona
condoram: it is the strand of virus
DoomBoomer1: geohot :O
Abnico: OSFrog OSFrog
solitarynative: where does the name come from
C0deCane: @JdPaulBlart just get VR collab its free
K177: @benchai18 oh yeah i'm aware, but in a case like the COVID-19, this shit will hurt them short term and long term
Abnico: OhMyDog OhMyDog OhMyDog OhMyDog OhMyDog
C0deCane: Kappa
Diefunction: Latin name
Maizlow90: Anyone can explain what he is trying to do/accomplish?
igg44705: @solitarynative because it has those crown spaces things sticking out, so they named it corona
Diefunction: corona = crown
Ayyyy420Lmao: corona is mexican for 'beer'
jimmyadaro: @Ayyyy420Lmao LMAO NO
condoram: The family of viruses is called Coronaviridae
Br4nnon: he's trying to hack the mainframe
solitarynative: and corona is latin for crown?
jimmyadaro: "Beer" is "cerveza"
condoram: so it got its name from there
vicmoney69: @Maizlow90 hes trying to cure COVID-19
Abnico: Corona is chinese for “gay”
jimmyadaro: @solitarynative Yep
theonlymonkas: george = Jorge
jimmyadaro: Spanish, I think
theonlymonkas: si es español
igg44705: he trying to slove corona virus and upload to github @Maizlow90
solitarynative: 5Head of course
JdPaulBlart: i meant google colab
l1ght5p33d: open source protiens
guacDev: Corona is wuhan for bat soup
nvda9: hello
CheeseManUchiha: hes trying to find a backdoor into humans
jimmyadaro: @CheeseManUchiha We already have one
Alexthematey: gachiBASS
igg44705: he's hacking the simulation
theonlymonkas: LUL
C0deCane: how did the epicenter of all this turn out not as bad as the surrounding cities in China
nvda9: what does George do for living nowadays?
ConnorMusarra: good thing I got a C  in high school biology
CheeseManUchiha: Kappa
o______________________k: squadR hey DUD I want my cure now DUD squadR
almonte550: If we see this pdf since the beggining it would be so much easier
jimmyadaro: @nvda9 Comma AI?
condoram: But hey on the bright side we have the positive outcome: - More appartements will be free to be moved in - Pollution is down - Governments wont need to pay pension to old people - Dogs are happy to see their owners 24/7
JdPaulBlart: squadR any oil princes in chat
benchai18: @k177 How long term? I’m not disagreeing, just curious. Also consider that efforts to “remedy” this are recent. There was no impetus a year ago, obv. So corona hasn’t been a factor in the way they handle business for the past 50 years
theonlymonkas: link
igg44705: @nvda9 comma ai, but i don't think he need to earn to live
o______________________k: what a fucked up day squadR
condoram: I think corona will become like the common flu
jimmyadaro: @condoram A lot of countries have their pension system broke
CheeseManUchiha: BIIIIIG dud
condoram: just keep spreading forever
localcanofdutchgold: lul
igg44705: BTW sars is a type of corona virus
condoram: MERS too I believe
benchai18: @igg44705 GIVE THIS MAN A MEDAL GOD DAMNIT
inciMage: chinese virus
Maizlow90: @georgehotz https://www.karger.com/Article/FullText/89211
JdPaulBlart: squadW
Diefunction: why they don't use quantum computers to find a vaccine ?
jimmyadaro: "wow"
benchai18: @incimage 🤫 u wanna get banned for the truth?!
Maizlow90: @georgehotz https://www.drbrownstein.com/corona-virus-what-to-do-2/?fbclid=iwar1oerar3hh9f2kh9ohcqxmdsxlq01o2huowfnfeijqkowiwf8qnyglhit0
o______________________k: squadPH
condoram: George looks like me when I am reading something I have no idea what is going on
northumb: https://en.wikipedia.org/wiki/Hydroxychloroquine what do you think about this? @georgehotz
jimmyadaro: @Diefunction It has nothing to do with processing power
THX1342: c1tr0n75 "only" 1.5%? isn't flu mortality at around 0.1%? and that's 650,000 people worldwide each year. So 1.5% would put it at almost 10 million ignoring the fact that Corona is more contagious
JdPaulBlart: squadQ
o______________________k: squadQ
JdPaulBlart: 4Weird wrap it up george
igg44705: @benchai18 lol geo hotz said corona virus is sars, but sars is a type of corona virus
nvda9: iGeorge challenged Elon musk
nvda9: is
wholesome_pepe: imagine nCov being man made Kappa
THX1342: c1tr0n75 I also question the ship statistics because of the close support they had from doctors which is not indicative of 'in the wild' scenario
THX1342: not question, but I don't think it is a perfect representation
benchai18: Guys what if this WHOLE time these past few days, George has just been bullshitting. Like what if he doesn’t understand anything he’s reading. He’s just yelling out terms and acronyms.
condoram: yea but that's the flu after so many years, it could easily have been mutated into something less lethal. I think the same will happen with corona
jimmyadaro: @benchai18 Check out his GitHub
jimmyadaro: @benchai18 https://github.com/geohot/corona
benchai18: @jimmyadaro I know mate, just kidding around
condoram: The difference is, we are experiencing a pandemic in its early stages so it is usually now we will feel the most
C0deCane: @georgehotz Do you think Corona will kill more than the annual suicide rate in America?
jimmyadaro: @benchai18 WELL FU!CK YOU THEN
Ayyyy420Lmao: press F to pay respects for kary mullis
igg44705: @benchai18 i mean he doesn't understand eveything fully, he said it himself
jimmyadaro: lmao jk
ShredderSherlock: damn did Kary get the Noble for dat
benchai18: @jimmyadaro Lol. U hit me with the link!!!
condoram: now until 1-2 years ahead
jimmyadaro: @benchai18 I always have it around
condoram: after that it should calm the fuck down
jimmyadaro: hahaha
benchai18: Lol
K177: @benchai18 incase a cure doesn't come out, due to the theory of pharamcy "hiding it from us" would mean that you would essentially be killing off a huge chunk of the population which could potentially harm the economy, AKA the pharmaceutical companies. All of this is speculation since none of us actually know the outcome of this shit show
jimmyadaro: SMALL PHARMA BABY!!!
THX1342: can't they do microscopy for HIV?
theonlymonkas: maybe it is a derivative or combination
equipollent_z: making a cheap at-home test would be nice
Nussinov: a bunch of physicists sort of used viruses to learn about some basic biological things in the 40s and 50s
condoram: A early cure would either be: Herd immunity through infecting a lot of people or vaccine
FastCashCoding: EM scopes
igg44705: you need an eletron microscop
c1tr0n75: @THX1342 that's right, but let's not forget that, all the other pandemic situations that humanity knew, this is actually the mildest, compared to the spanish flu, and malaria (malaria is responsible for 1/2 deaths in the humans over history)
bytebacon: Viruses need electron microscope
Sidhuu: did u order a swab
THX1342: virus vary wildly in size IIRC
condoram: or wait it out and hope the virus starts mutating into something less lethal
FastCashCoding: tiny
jimmyadaro: who ordered a swab
C0deCane: Maybe if China never said they could destroy America without ever going to war they wouldn't be so suspect right now in the publics eyes LUL
igg44705: very very small
condoram: It is bigger than pollio
theonlymonkas: but where do you get the sample
Harm133: its was 1nm right
FastCashCoding: angstroms
jimmyadaro: 1pl
nvda9: corona is airborne or not?
wholesome_pepe: Cryogenic electron microscopy
condoram: not airborne
igg44705: @georgehotz would you say you are as good with hardware as sofware
Maizlow90: @georgehotz https://www.karger.com/Article/FullText/89211 https://www.drbrownstein.com/corona-virus-what-to-do-2/?fbclid=iwar1oerar3hh9f2kh9ohcqxmdsxlq01o2huowfnfeijqkowiwf8qnyglhit0
benchai18: @k177 Fair... but if fatality rate really is low as 0.5-1.5% they’re not worried about death of their customers. Economy may crash, but medicine is one of those things that people will need no matter what. Whether it’s govt subsidized, investor-backed, like whatever
ShredderSherlock: is 100 nm smaller than 90 nm?
THX1342: micrograph?
benchai18: My uncle Israel has polio
Ayyyy420Lmao: @ShredderSherlock yes.
condoram: The virus travels with your spit when you cough dropplets
benchai18: Had**
roystang: wtf polio is so small
C0deCane: population size was way smaller then tho too
nvda9: @condoram airborne
guinness84: shout out salk
Sidhuu: only 10?
bytebacon: SARS-Cov2 is over 10 times the size of smallest transistors we make
condoram: Yes but if you breathe into the room it won't infect
Harm133: thats 8 million deaths right
K177: @benchai18 thats if the fatility rate stays like that, and incase the hospitals get overwhelmed, you'll see people dying indirectly from the virus
JdPaulBlart: at that point our economy is more important
braininavatt: #coronascam
dyslexicat: scammed WutFace
l1ght5p33d: @ShredderSherlock yes
jimmyadaro: Who ordered some swab???
deva73: markets are crashing if its a scam
equipollent_z: bogaScam
AzzoDio: @georgehotz Where does the 10% upper bound come from? We have isolated clusters, like pysch wards, that hit 90 or 95 % infection rates
Bombapil0t: it is a scam
roystang: millions
condoram: it is because you are coughing and spitting tiny droplets but gravity pulls them down
Ayyyy420Lmao: @bytebacon 10nm transistors are not 10nm they are 30
THX1342: wait... a CORONAVIRUS is called that way from the way it looks under a microscope.. thats the first thing I heard about coronavirus in the news LUL
condoram: it doesn't float in the air
julien9877: US vs world wide
ConnorMusarra: they predict 40-70% of US population infected
Hawklite: isn't the fatality rate actually 13%?
K177: the god damn coronavirus is a scam KKona
FastCashCoding: lol sometihng that is .09 meters is smaller than something .1m
Ayyyy420Lmao: 10nm is a trademark thing
julien9877: 8 mil world wide
paowikx1214: LOVE YOUR STREAM MAN!
Harm133: worldwide pancake, not US only
FastCashCoding: nneway
jimmyadaro: LUL
condoram: Fatality rate is 4,47 % right now
jimmyadaro: PLAGUE INC
theonlymonkas: i think it depends on the place and its conditions
benchai18: Wait, I nodded off for a moment... why are u using “10%” as a hypothetical size?
benchai18: Of people who get it
bytebacon: @Ayyyy420Lmao oh I did not know of that
deva73: check malaria
itsxaos: 500k i think
Vindalis: current fatality rate is 15% and climbing
THX1342: 650,000 deaths a year from Influenza
THX1342: worldwide
condoram: @Vindalis explain your math?
Ayyyy420Lmao: @bytebacon yeah it blew my mind when i was told, fucking marketing
C0deCane: 300, 000 is only 6x the suicide rate in America
jimmyadaro: @benchai18 For flu
Maizlow90: @georgehotz https://www.karger.com/Article/FullText/89211 https://www.drbrownstein.com/corona-virus-what-to-do-2/?fbclid=iwar1oerar3hh9f2kh9ohcqxmdsxlq01o2huowfnfeijqkowiwf8qnyglhit0
benchai18: @vindalis No, it’s not. You’re not considering the multitude of variables
Vindalis: condoram visit plague dot com
condoram: We are talking about corona right
AresRai: 10 to 15x
christianthefalco: if we allowed all 300,000 to happen quickly it would overwhelm the hospitals and cause other bad shit to happen
Vindalis: based on current infected vs deaths it's 15%
AzzoDio: But it hits all at once. You better you hope you don't need chemo or emergenncy surgery while it's hitting!
JdPaulBlart: this is all a part of the rothschilds plan
subconix: Its just a new coronavirus, its going to run its course.
equipollent_z: is it a lot of hype because it's made in a lab?
benchai18: @jimmyadaro So flu hits 10% of people a year?
condoram: 422989 infected with 18919 death, how is t hat 13%?
jimmyadaro: ｐｌａｇｕｅ ｉｎｃ
C0deCane: either way its a lot of people and we can't handle the surge in our hospitals
localcanofdutchgold: lot of old people dying in italy, not 15% overall proabably
THX1342: 15% what
nvda9: I read in Wikipedia it's not airborne, but found an article on al jajira where they claiming it's airborne
c1tr0n75: @georgehotz yes but the more we let it infect people, the more we encounter the risk of it mutating and becoming more deadly
C0deCane: No its definitely not 15%
pjayys77: just in the US
Bombapil0t: check death rate in Germany. its a big joke @Vindalis
benchai18: @c0decane Speak for yourself mate, I live in Sunny California!
l1ght5p33d: because 90 is more than 100
jimmyadaro: @l1ght5p33d quick maths
elonsmuskygooch: why you quarantined in logan pauls apartment?
bytebacon: World covid-19 death rate is 4%
benchai18: (Jk. Our states fucked)
condoram: yea, it is at 4,7%
ConnorMusarra: the US is absolutely fucked
Waldoqq: SIMP
deva73: 37
K177: the curious thing about the cruise ships, is if there was transmission after the passengers were isolated. Stuff like ventiliation and seweage system
AzzoDio: @georgehotz Why 10%? From where do you get that? Viruses have to double over time even in a cruise ship and they tried to maintain a quarantine
condoram: it could easily get to 15% if people don't give a fuck and infect older people
igg44705: @elonsmuskygooch Logan paul's apartment?
C0deCane: @benchai18 what are you talking about lol
Ayyyy420Lmao: you guys bought the dip in hooker prices?
AresRai: 🤔
theonlymonkas: 1% on the USA right?
christianthefalco: The fact that people can't understand that the mortality rate is dependent on the amount of treatment people are able to get is infuriating
AzzoDio: @georgehotz So currently at 10 out of 760 or 1.31 percent fatality on the cruise ship, with 10 more still in the ICU.
THX1342: they need ventilatoras
jimmyadaro: What if we NEED coronavirus?
AzzoDio: @georgehotz Severe = oxygen, Critical = ICU/Vent
condoram: Respirator is intensive care
AresRai: oxygen related anyway
timi13462: oth
THX1342: from doctors I heard: ventilators
timi13462: both
Br4nnon: help breathing
deva73: supplemental oxygen
dorkmo: i think it means youre in the ICU?
Nussinov: id be interested to see how the ratio of symptomatic to asymptomatic changes as more people are infected
directrix13: ventilator   oxygen
jimmyadaro: We were talking about world death rate @georgehotz
jimmyadaro: Almost 5%
benchai18: @c0decane Nah nothin, I’m an idiot. Don’t listen to me
Vindalis: the 4.4% death rate of corona is not taking into account those who have been infected over the past week, 295,583 new cases without an outcome
igg44705: @georgehotz how good are you with hard ware? making circuits?
condoram: Cruise ship death rate also would require the sample is a good sample but if 99% of people on the cruise ship were young people
Ayyyy420Lmao: they're probably infected the same bu asymptomatic
condoram: death rate would be lower
Harm133: monkaS
localcanofdutchgold: lul
AzzoDio: @georgehotz it does infect young people? What do you mean? They just don't end up wtih as many symmptoms
Waywoah: A cruise ship is pretty much worst case scenario for a virus
ShredderSherlock: does it assume the passengers all had an orgy and contact with each person with each person
christianthefalco: There is a number, but no one can say
nvda9: the fatality rate is 4℅, it's scam
FastCashCoding: cant do that
sunole: Out reads in hotels too
FastCashCoding: hhaha
manouchehri: What’s the goal of the stream tonight? Helping testing, vaccine, or treatments? Because ultimately, researching the fatality rate is gonna help with those three. TakeNRG
THX1342: Brazil's president is giving 0 fucks
JdPaulBlart: political suicide
condoram: Death rates will be way higher in countries where there are more older people
ConnorMusarra: hospitals in New York are already reaching their breaking point
Eyachi: they never would it sounds weird
Nussinov: 1$
almonte550: 5 millions
igg44705: 7 billion people
Ayyyy420Lmao: no such number
cellophane11578: 1 million
Lizardan: how much does a human life cost?
Ayyyy420Lmao: fuck ppl
directrix13: It just doesn't hardly affect the young people like it does the older and immunocompromised
condoram: I think Germany is mislabeling their deaths on purpose
ELITEGAMS: trillion
igg44705: @georgehotz how good are you with hard ware? making circuits?
subconix: it sounds sad, but its true... there is a number
dorkmo: are the people that are going to die from flu going to just die from this instead?
AzzoDio: @georgehotz Do you think people will go to restaurants with bodies all around and no hospital care though?
K177: wouldn't it also depend on the skillset of the population that would be killed off?
C0deCane: @georgehotz I think a good question is how much of the virus do you need to contract to become ill?
jimmyadaro: Asymptomatic infected means n*n infected people?
inciMage: @Lizardan around a hundred
Sidhuu: Trump is already valuing the economy over lives
ideology_sniffing_raccoon: &lt; 20K in US
Bombapil0t: 32k infects and about 150 deaths in Germany. 15% ?!
directrix13: so it spreads easily
Lizardan: @inciMage sounds about right
almonte550: with 5 million I think people will start get scared
jimmyadaro: 1M?
Ayyyy420Lmao: i think that closing stuff will always have deleterious effects compared to doing nothing
FastCashCoding: couple btc of satoshis worth
pjayys77: one politiican did just say somehting about letting old people die for the economy to be saved
blondephilia: Please don't assume any data from China is accurate. Subtract them from all hypotheses and calculations
nremind: they would never publicly say a number
wholesome_pepe: i wish new york and seattle would break down the cases by age and race
jimmyadaro: Word-wide??
qlutoo: 1 million
Br4nnon: The flu infects millions
PiroFloydian: 500K maybe lower
FastCashCoding: 250k probably fine
condoram: US is likely to have up to half to 1 million death at the end of this year
AresRai: what about 1.2m
cybergenik: I think if we stand to lose more than 15% of the nations gdp in stocks, then we need government intervention.
inciMage: @dorkmo in addition ppl who wouldnt die from flu will die
jimmyadaro: 1M would be enough
SofiaLouise: The problem is, if the hospital capacity breaks, we might lose control
condoram: If they don't start caring
c1tr0n75: @georgehotz it depends on which age will be more affected by the deaths
passingremarks: 250k is a lot of dead people
AzzoDio: @georgehotz It's probably easier to hold it low, like Kora right now, than it is to 'squeeze' out like 200k and then stop. It probably snowballs!
braininavatt: lol, so where do you draw the line?
bytebacon: Some think Italians are more vulnerable to covid-19 because of genetic reasons. See Nassim Nicholas Taleb's tweet: https://twitter.com/nntaleb/status/1241446601475919873
benchai18: @sidhuu Don’t be reductive. It’s not that simple. And the economy is all of our fucking lives
igg44705: it has to be at a point where, the economy won't grow because of the lack of people
localcanofdutchgold: megadeath x5 Pog
AzzoDio: Like Korea
verxile: Deaths are delayed by 3 weeks
peter35_: if recovered have diasability?
passingremarks: 500k is also a lot ofdead people lol
jimmyadaro: Are we talking word-wide???
THX1342: I think there is also a generalized fear withing the researchers because this is a new strain that we don't know how it could change/evolve
Lizardan: 100K dead? .... deal SeemsGood
directrix13: the problem with this vs the flu is that this infects far more rapidly than flu overwhelming our system leading to considerably higher deaths
jimmyadaro: Oh ok
PiroFloydian: na thats about 1%
C0deCane: I'd say if we can all stay alive we will have more people to get the economy back in action if were still somewhat stable after this
nvda9: we are gone develop herd immunity
cybergenik: 350mil
theonlymonkas: and what about other parts of the world with less medical capacity, the virus could propagate again?
itsxaos: 330 now i think
l1ght5p33d: Its literally everyone flipping out about the flu
JohnEGQ: I thought the computer models were showing over 1 million deaths unless we quarintine
localcanofdutchgold: 360 ?
l1ght5p33d: im so glad I bought BTC
manouchehri: 5 million of what age groups?
Bombapil0t: 2017/2018 died 25k ppl in Germany from flu. just saying
fujikekw: think last reported was 337 million pop in us
blondephilia: 10 million could die. Who cares. America is nothing and means nothing. The country doesn't exist.
AzzoDio: @georgehotz It might be cheaper to hold it down to 10k, than it iwould be to hold it at 250k -- you'd have health care workers dying, it might not be a thing you could stop at that point without going evne more extreme, to stop it at 250. It's not a linear modle
condoram: Italians are nr 2 on the list of most old people in country and they all lived together, like 2/3 generations under the same roof and the younger people don't seem to care about social distancing.
JdPaulBlart: much more efficient just to have a civil war
jimmyadaro: @manouchehri Overall
brownyyyylocks: death rate &gt; birth rate
ideology_sniffing_raccoon: 500K that a lot of bodies monkaW
dr_set: https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/
braininavatt: what about the rate of sick people?
dr_set: that's the article he mentioned
christianthefalco: Do too little =&gt; hospitals get overwhelmed, many die for no reason. Be responsible =&gt; it fizzles out and people accuse you of being irresponsible with their money/economy
nremind: but if this causes even 5% long term complications, it would increase healthcare costs substantially
pjayys77: well that's 61,000 without any measures taken place, but considering with the shelter-in-place in some areas currently
condoram: I think US will have 500k death at least in this year from corona
c1tr0n75: @georgehotz I mean if we had 2 millions deaths from working people, it's not the same as 5 million retired people
ELITEGAMS: coronavirus look worldmeter info
jimmyadaro: PLAGUE INC
b2kemann: end of america
ConnorMusarra: it's already too late
l1ght5p33d: Corona virus taskforce ::: sells masks::: buys bitcoin::::
manouchehri: Why not publish your own models?
Ayyyy420Lmao: you can start one in augur no?
blondephilia: ^
mik12f4: directly?
THX1342: georgehotz there's another very important factor. these patients NEED ICU. if they don't take it they die. and they take space from other people who need it... more people can die, not from corona
FastCashCoding: @georgehotz get your boys from Augur on the line
Sidhuu: I don't think there will be millions of deaths because of the way china has handled it
ahahahaitslit: they would have to risk their model being accurate and things not going horribly wrong
Saltyballss: asked my marble, it will be 500k
manouchehri: You’re noteworthy enough that somebody will read it.
directrix13: because then people could literally profit off promoting deaths
THX1342: the whole thing is about not killing the health system
l1ght5p33d: Common cold taskforce 2020
PiroFloydian: directly or indirectly @georgehotz ? cause it affects healthcare availability
condoram: I think China is full of shit and hidding
joshperri: Tobacco   Cars   flu &gt;= 500,000 deaths/year
Bombapil0t: the numbers are fragile as fck
K177: lmao
joshperri: In the US alone
bluejimmy168: China lies LUL
K177: china made it worse if anything
christianthefalco: China did a good job
deva73: max 7k deaths in worst case
Br4nnon: The deaths would be higher without lockdown
AzzoDio: @georgehotz Your assumption is that its just as easy to stop it at 250k as it is at 25k -- that's an assumption. It might be cheaper to stop it at 25k! South Korea etc
roystang: US is definitely not china
bluejimmy168: we have no idea what the real numbers are from China
Nussinov: @christianthefalco Kappa
c1tr0n75: c1tr0n75 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 10 in the channel!
JohnEGQ: maybe we let it kill and then no more Social Security !???
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to CompestLive!
jimmyadaro: 1M would be okay
Sidhuu: china did a really good job in containg the virus
Maizlow90: @georgehotz https://www.karger.com/Article/FullText/89211 https://www.drbrownstein.com/corona-virus-what-to-do-2/?fbclid=iwar1oerar3hh9f2kh9ohcqxmdsxlq01o2huowfnfeijqkowiwf8qnyglhit0
blondephilia: Boomer deaths would actually spur an economic boom. Home prices, Social security loosening, etc.
condoram: US has the issue of not caring if you got no money, this will result in a lot of deaths
jimmyadaro: We're not experts
christianthefalco: @Nussinov not kappa, it's pretty clear
C0deCane: I think if the numbers continue to rise in Italy we will know China is full of shit
ELITEGAMS: china kickout foreigners reporter from the Wuhan city so..
nvda9: found an interesting article on NY times.
Ayyyy420Lmao: @blondephilia based
Br4nnon: Which is what saved them
nvda9: https://www.nytimes.com/interactive/2020/03/22/world/coronavirus-spread.html?fbclid=IwAR3eUtUzoRl5Tqwel3bcjoHkReaIo5R3OOUbDT1Jmz9TLHg6EfsL3nUvBds
AzzoDio: @georgehotz The effects of being at 250k, the side effets, might make STOPPING it at a 250k cost even more economic damage at that point
condoram: Also china is a dictatorship, helps a lot in something like this
rafalive: T𝕙𝕚𝕤 𝕚𝕤 𝕒 𝕤𝕡𝕖𝕔𝕚𝕒𝕝 𝕡𝕣𝕠𝕥𝕖𝕔𝕥𝕖𝕕 𝕗𝕠𝕟𝕥. 𝕐𝕠𝕦 𝕔𝕒𝕟𝕟𝕠𝕥 𝕔𝕠𝕡𝕪 𝕚𝕥. 𝔾𝕠 𝕒𝕙𝕖𝕒𝕕, 𝕥𝕣𝕪.
phaxxN: not from the us, how is your medical care compared to like italy, they have 10% death rate right now
Nussinov: christianthefalco define good Kappa
Harm133: LUL
bluejimmy168: LOL we all are banned from china for talking shit about them LUL
PiroFloydian: vietnam went full socialism and ultra contained @georgehotz
igg44705: @georgehotz where would stop the deaths?
Vindalis: LUL
mik12f4: Don't 2 million people die every year in US
Vindalis: Dr Hollistic LUL
C0deCane: at some point they have to level out in Italy correct?
FastCashCoding: you think China has tried or successfully stolen information from Comma?
pjayys77: check out Japans infected
fujikekw: LUL
joshperri: https://www.cdc.gov/nchs/fastats/deaths.htm
braininavatt: what did they do in vietnam?
christianthefalco: @Nussinov they probably saved millions of lives globally...
ideology_sniffing_raccoon: anything more than 100K Americans would go crazy
Harm133: https://virusncov.com/ Closed cases deathrate = 15%
jimmyadaro: 250k is not "JUST" 250k, that means a lot of asymptomatic people
tybutnowyoudie: @georgehotz you recently said comma had a new programming challenge, didn't you?
condoram: @phaxxN Italy's health care system collapsed, it will happen to US too if they don't start taking care of spreading it
theonlymonkas: and what if the virus propagates again from some country with poor health system?
Daniel_Duan: China is most likely posting fake numbers
condoram: New York is on the verge of collapsing too it seems
almonte550: Do you think that there are new vaccines that were added in China and only the young population has it and that's why they don't have it that much?
nremind: those who think china is full of shit, do you also think korea is full of shit?
igg44705: @tybutnowyoudie yeah new challange
ShredderSherlock: i just wish i could choose which people it takes out
Bombapil0t: @tybutnowyoudie no comma here TriHard
bankzed: is a wholistic doctor a doctor that's a full doctor and not half ass, like Dr. Phil
jimmyadaro: @nremind Which one
jimmyadaro: 250k is not "JUST" 250k, that means a lot of asymptomatic people
Br4nnon: But do people from colds need hospitalization ?
THX1342: 0.1-0.2%
Nussinov: @christianthefalco im skeptical of that number, but more importantly; at what cost to the well being of their population?
nizero: George your stream has grown a lot
AzzoDio: @georgehotz Czech Republic has 100% mask wearing: https://twitter.com/jeremyphoward/status/1242572288962240517 deaths and have no growth in daily new covid-19 case
Harm133: common cold monkaS
condoram: South Korea tests a lot, that is why they are able to keep it down
C0deCane: Remember the WHO predicted 7.5 million Americans would die from swine flu
lupo_1: coronovirus is not like cold
Saltyballss: Saltyballss subscribed at Tier 1.
K177: crazy stat was that 50% of people hospitalized were young people
phaxxN: @condoram okok, yeah i think they need to take it serious
localcanofdutchgold: @Harm133 what's distribution of infection by age?
PiroFloydian: in vietnam all testing and hc relating to virus is free, food can be delivered to people free, full sick leave pay etc
deva73: i dont't believe ch8inese figures.
manouchehri: It doesn’t matter for what you’re doing it.
bytebacon: India approved Hydroxychloroquine for prophylaxis. See the official dosage: https://www.mohfw.gov.in/pdf/AdvisoryontheuseofHydroxychloroquinasprophylaxisforSARSCoV2infection.pdf
aMANT3: what matter is the fatality rate
Sidhuu: if china were full of shit why would they open Wuhan
Ayyyy420Lmao: nothingburger PogChamp PogChamp PogChamp
jimmyadaro: https://www.nytimes.com/interactive/2020/03/22/world/coronavirus-spread.html
verxile: 30-90 million Americans get flu a year
Waldoqq: Were going to pass Italy in 2 days
teapoted: teapoted subscribed with Twitch Prime.
Diefunction: G20 the Group of 20 major economies on Thursday to discuss a global response to the coronavirus pandemic.
THX1342: did america do anything to prevent swine flu?
verxile: 60k deaths
christianthefalco: @Nussinov yes, it's a tradeoff with freedom. no perfect answer. I think they did well with a tough situation. We'll see how the US does with the opposite approach
Waldoqq: 500k americans will be dead by June
condoram: Like they say most people will get through the virus no problem but these people that don't show massive symptoms can spread it to other people that's where the issue is
PiroFloydian: SCAM TRAIN PogChamp
korgy111: What do you think about c  ?
theonlymonkas: chooo chooo
equipollent_z: bogaTrain bogaTrain bogaTrain bogaTrain
directrix13: hype train?
nvda9: think about black death
C0deCane: India just gets the virus and already making more moves than America typical
directrix13: lol
condoram: that's why by testing as much as possible you can minimize the spread
jimmyadaro: PogChamp PogChamp PogChamp DAMN
jimmyadaro: DAAAYUMNNNN PogChamp
montecarlo: SCAM TRAIN Pog
Bombapil0t: get me in that scam train boys
ideology_sniffing_raccoon: CHOO CHOO TRAIN
Ayyyy420Lmao: consooome train PogChamp PogChamp PogChamp
jimmyadaro: SCAM TRAIN
jimmyadaro: PogChamp
korgy111: What do you think about c  
jimmyadaro: LMAO
b2kemann: but is the world overracting? i can't seem to land on either yes or no
korgy111: What do you think about c  ??
TheLastMrX: wow scam train
korgy111: What do you think about c  ????
jimmyadaro: EXTRA CHROSOMA TIME PogChamp
igg44705: @C0deCane but the people are't following tho
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
Santiago_LHC: CORONA TRAIN
AzzoDio: @georgehotz There is a Univ Minnesota study, they overnight you the drug if you were just exposed.
condoram: What is this train about?
braininavatt: HYPE TRAIN PogChamp
ELITEGAMS: https://www.worldometers.info/coronavirus/
C0deCane: bogaScam bogaTrain
directrix13: Take arsenic. It can't hurt what is dead.
jimmyadaro: PogChamp PogChamp PogChamp PogChamp YEAAAAH
Ayyyy420Lmao: @condoram it brings us to the gas showers PogChamp PogChamp PogChamp PogChamp
Bombapil0t: keep asking the right questions SeemsGood
condoram: ooo been there done that
korgy111: What do you think about c  ? MrDestructoid
jimmyadaro: @georgehotz https://unpaywall.org/
bankzed: the world is under reacting
AzzoDio: @georgehotz Post Exposure Study https://twitter.com/boulware_dr/status/1239944721386164225
btpisroot: Would you rather over react or regret later tho?
korgy111: What do you think about c  ? MrDestructoid ?
Nussinov: @christianthefalco you have to consider the "tradeoff with freedom" over hundreds of years though LUL its not simply a matter of what they do during the pandemic
ConnorMusarra: the lack of testing in the US just sealed our fate
Br4nnon: China did what needed to be &amp; had the resources
korgy111: What do you think about c  ? MrDestructoid
jimmyadaro: https://unpaywall.org/
martinkirilov: martinkirilov subscribed with Twitch Prime. They've subscribed for 3 months, currently on a 1 month streak! Sup George, good to see you back
raystriker98: !uptime
blondephilia: Why do you think the China numbers are accurate? Do you think Russia has 0 deaths?
0R4NG3: lol
Ayyyy420Lmao: @btpisroot you can also regret overreacting sweaty
PiroFloydian: yeah brazil is SUPER fashy
doctorgenus: is everyone at comma.ai working from home?
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
braininavatt: brazi's president doesnt believe in it #coronascam
theonlymonkas: what about third wolrd countries
THX1342: my first sign that shit was real was China locking down Wuhan. Who shuts down 10 million people if shit is not serious... then I learnt about the lab in Wuhan and feaked out LUL
Nussinov: this is what brazil is doing to prevent corona virus spread https://www.reddit.com/r/funny/comments/fn3p40/brazil_using_helicopters_to_blow_people_off_the/
igg44705: @georgehotz would you lie under outh
condoram: Gotta say though, loving Bings https://bing.com/covid
guinness84: the cruise ship was a sick experiment too honestly
jimmyadaro: PogChamp PogChamp PogChamp PogChamp lmao
c1tr0n75: cheer50
K177: PogChamp 💳 scam train
0R4NG3: scam train PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳
K177: PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳 scam train
condoram: Only time I use bing
0R4NG3: scam train PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳 scam train PogChamp 💳 󠀀
likespuppies: @georgehotz its not an overreaction!!! If we can't treat people, it becomes SARS in terms of CFR and we can't treat people if the healthcare system caves (which it is in Italy &amp; Spain despite lockdown)
ideology_sniffing_raccoon: Brazil data incoming PogChamp
jimmyadaro: follow PogChamp the PogChamp damn PogChamp train PogChamp CJ!!!!
subconix: why is the cruise ship thing so sketchy?
joshperri: https://www.cdc.gov/nchs/fastats/deaths.htm
jimmyadaro: PogChamp PogChamp
InfiniteReddit: HahaLean
jimmyadaro: PogChamp PogChamp PogChamp
ahahahaitslit: isn't brazil in lockdown
AzzoDio: @georgehotz That Twieet is a liink where they test of your family taking hydroxychloroquine can prevent infection, they overnigh you the drugs if you have a case in the family
Ayyyy420Lmao: dopamine rush train PogChamp PogChamp PogChamp FailFish PogChamp PogChamp
equipollent_z: have there been any cases in DPRK?
0R4NG3: PogChamp
THX1342: Brazil's president is as dumb as they come
Harm133: scamtrain PogChamp
igg44705: @georgehotz would you lie under oath
jimmyadaro: Argentina is lockdown too
korgy111: In your opinion what's the most universal and useful programming language?
theonlymonkas: madagascar is inmune
ideology_sniffing_raccoon: LUL
Diefunction: India
condoram: Italy is at 69k infected and US at 55k
bluejimmy168: Japan isnt even testing people.
northumb: is this the cure https://en.wikipedia.org/wiki/Hydroxychloroquine ?
condoram: Shit is escalating
b2kemann: i do think the economic consequences will be more devastating in the long term though. So in that sens the world is acting like the immun system under the spanish flu
visheshsinha: India in Complete LockDown for 21 days
thezilion: Tem brasileiro aqui? rsrsrsrs
doctorgenus: trump is about to do that after easter
christianthefalco: @Nussinov eh, we're talking about this corona virus. Who knows if authoritarianism is the best for China. Too complex a question to write off with twitch emotes
likespuppies: data visualization engineer as a career?
iuciferdk: free shkreli
igg44705: hahahah that's a lie @georgehotz
pjayys77: how is it possible not everyone coming through airport entry, in the US at least, are being tested
Sidhuu: @blondephilia china lifted the lockdown in Wuhan. they wouldn't do that if coronvirus was still spreading there
jimmyadaro: PogChamp PogChamp PogChamp PogChamp
jimmyadaro: PogChamp
PiroFloydian: yeah our healthcare system sucks
vbrayon: @thezilion é claro
directrix13: In 3 days we will overtake China
AzzoDio: South Korea is not that authoritarian, and neither is Taiwan
directrix13: at this rate
AzzoDio: And they both did ok
nizero: senate passed 2 trillion deal
almonte550: Why do you think young population in China doesn't have so much cases of coronavirus?
theonlymonkas: spain reaction was to late
Ayyyy420Lmao:  10% we back bullbois
deva73: it surged
Bombapil0t: :D
Nussinov: @christianthefalco of course, highly complex topic. not trying to debate you, was just pointing out something I found funny LUL
teapoted: Isn't it more useful to only look at death numbers because infected numbers are vastly skewed by number of tests conducted or what criteria country a tests by (see diff in Germany vs Italy)
K177: trueee
doctorgenus: ohh yeah good thinking
GReeN_HuMaN: do you think the economical effect will kill more people than the virus?
vbrayon: @thezilion 10° de quarentena:
zwisch: the market likes certainty
jimmyadaro: PogChamp !
bluejimmy168: Play them like toys
equipollent_z: DPRK Christmas Gift? 🎄
blondephilia: @Sidhuu I asked about the numbers.
korgy111: In your opinion what's the most universal and useful programming language? ?
condoram: @Sidhuu it is about spreading propoganda, make people think everything is ok
THX1342: China will do some Marshall Plan soon...
jimmyadaro: @korgy111 C
igg44705: @georgehotz what foods did you buy?
btpisroot: Puppet master
almonte550: Why do you think young population in China doesn't have so much cases of coronavirus?
K177: lmao
nvda9: pronhub premium is free on lockdown areas
zwisch: LUL exactly
Nussinov: what if its MY life though
jimmyadaro: @nvda9 PogChamp
codezillla: lol
Lizardan: paying people to stay home = bad idea
C0deCane: If Trump keeps holding conferences do you think he will catch it? and if he doesn't should we go outside LUL?
thezilion: stop stupid questions
likespuppies: shut down the economy and go full socialism -- literally eat the rich
jimmyadaro: "i did get the ad"
K177: OMEGALUL
jimmyadaro: LMAO PogChamp
blondephilia: @nvda9 porn is a weapon.
theonlymonkas: master of puppets
jimmyadaro: LUL
condoram: I am on Italian VPN to visit pornhub :D
ShredderSherlock: maybe we need to slow down consumption
AzzoDio: @georgehotz Probably the economy collapses if their are a million deaths, so it's not really a trade of one or the other
pjayys77: so feds pumping $1trillion every day for a month in the market to stave off the crash .. brosef
AresRai: tru
northumb: twitter is bullshitt
C0deCane: FUCK YOUR ECONOMY SAVE MY LIFE!!!!!
directrix13: @georgehotz so would your order a pizza delivered right now where you are?
Nussinov: i cant prove that anyone else exists, we live in a simulation Kappa
l1ght5p33d: I haven't had sex in 3 years think i give a fuck if i die
C0deCane: LUL
jimmyadaro: fuck your life, save my economy
almonte550: Why do you think young population in China doesn't have so much cases of coronavirus? @georgehotz
PiroFloydian: hypotheticals against actual lives seems pretty sus @georgehotz
MrTriharder: @georgehotz Things we should learn from Japan
CheeseManUchiha: @l1ght5p33d based
bankzed: wait pornhub premium is free for Italians??
bluejimmy168: True
l1ght5p33d: ill go around licking stuff
thezilion: It's needed VPN to access italian website
C0deCane: @jimmyadaro im joking dude LUL
lupo_1: economy doesn't crash because of 1 persons live
likespuppies: @georgehotz if this gets unchecked the economy crumbles and we end up at war
blondephilia: Imagine the suicide rate in a depression in current year.
martinkirilov: fuck your economy, fuck my life
c1tr0n75: @georgehotz at the time being, they are trying to flatten the curve, not limit the casualties, they are just giving hospitals and morgues a room to breath
ahahahaitslit: yeeboi
bankzed: turns on the VPN
jimmyadaro: @bankzed Yep, every lockdown
jimmyadaro: city
b2kemann: the economy was shit. Corona was the pin that pricked the everything bubble.
jimmyadaro: or country
braininavatt: GHOTZ 2032
directrix13: Everybody: write in George Hotz
christianthefalco: TROLLEY CARS EVERYWHERE
deva73: jail break elections
THX1342: @c1tr0n75 I agree
MrTriharder: WHAT LIFE GEORGE? PepeHands
zwisch: PiroFloydian it's not a hypothetical, death rates go up during an economic downturn
teapoted: People vastly underestimate the amount of background deaths.
bankzed: oh, so I can just use NYC VPN then
l1ght5p33d: triple kill
pjayys77: said to say recently tho, life expectancy in the states has gone down
Ayyyy420Lmao: @b2kemann sweety we will have new ATH later this year
doctorgenus: what will you do after Tesla buys you guys out for 1 Billion?
peter35_: alphaGov 2028
K177: PepeLaugh
thezilion: go to jailbreak coronavirus
zennydmt: is comma ai safe
braininavatt: dont be afraid to buy Kappa
lupo_1: @georgehotz what if it was the only person who would stop the super virus that dies?
Nussinov: #ad
igg44705: @georgehotz people can't drive tho
subconix: George does not want to be the guy to decide what number of people is acceptable to die from this LUL
Harm133: little plug LUL
Br4nnon: it's only temporary
likespuppies: AHH guys we forgot, he's a CEO he has CEO biases
jimmyadaro: We had a lot of stupid Angel and VC investors putting money on stupid shit, the market needed a correction!
benchai18: The economy was NOT shit. Just Trump haters
bankzed: time to pivot to freight trucks?
Santiago_LHC: I want to invest in Comma Bio
itsxaos: we improved life expectancy and quality by making adavances in technology and science not by coming up with another way for bankers to profit
martinkirilov: Shameless plugs
l1ght5p33d: comma ai is safer than you
anotherkidnamedaustin: 602 viewers?
almonte550: How much money do you have in the stock market?
anotherkidnamedaustin: stream bot?
PiroFloydian: @zwisch i think thats more a flaw of our economic system than anything
nizero: George I can label your data set for you
Ayyyy420Lmao: do you own any chainlink???
JohnEGQ: I need some Hotz merch
benchai18: @itsxaos Dude. You’re speaking like a child.
northumb: then is where AI appears
THX1342: Do you think the USA would accept financial help from China?
K177: LUL
zennydmt: are u an expert in deep learning?
Br4nnon: Stocks are on sale
deva73: fcuk
jimmyadaro: What about BTC?
pjayys77: see we're talking about companies sells numbers but not the middles class or just average worker's outlook
Harm133: whats your expectancy of crypto in teh coming week
btpisroot: lol
eiscosogin1: i wish mine had only gone down 30
bankzed: also, you didn't get the early warnings given out to VIPs to pull out of the market? KappaWealth
blondephilia: UL
georgehotz: Choo Chooo HypeGriffin1
b2kemann: stocks are still expensive
braininavatt: real reason why he's creating a vaccine Kappa
martinkirilov: Choo Chooo HypeGriffin1
localcanofdutchgold: scam train Pog
igg44705: @georgehotz which app do you use for stocks?
jimmyadaro: PogChamp
Saltyballss: damn i earned a lvl1 hype train emote
c1tr0n75: Choo Chooo HypeGriffin1 haha
blondephilia: I'm at -40% :(
o______________________k: !claim Kappa
Saltyballss: Tut-tuut HypeGriffin1
thezilion: STAY SAFE!!!!!!!!!!
Ayyyy420Lmao: do you own chainlink???
jimmyadaro: I'm at  10%
anotherkidnamedaustin: complaining about -30% after a  28% 2019 year hmm....
jimmyadaro: PogChamp
cybergenik: Wait did you pull out or are you just standing your positions?
salpu_: ryryAloha ryryAloha ryryAloha
jimmyadaro: PogChamp DAMN TRAIN
jimmyadaro: HELL YEAH
deva73: does anyone benfit from this coronascare?
Sidhuu: justified loss
anotherkidnamedaustin: THE MARKET WAS UP 28% IN 2019
stillneedswork: https://coronavirus.jhu.edu/map.html
anotherkidnamedaustin: YOU SHOULD BUY MORE
l1ght5p33d: dude i just bought ETH at 117
theonlymonkas: for how long it's gonna be until we can go back to normal
likespuppies: you have money but no autonomous rocket :rage: lazy
Chrimo: No picnic sellout!
ryanm0012: YOU SHOULD BUY MORE
K177: eh, it'll still drop
doctorgenus: if Elon buys you guys out tomorrow but fires you, will you run for political office?
b2kemann: how was the economy good? how much of the hardware stuff you use in comma is coming from the us?
MrTriharder: @georgehotz u planning to buy more?
phrixus_bro: you guys seem ok... get your money out while you can
anotherkidnamedaustin: anyone selling is either retiring this year or pussy
jimmyadaro: fuck taxes
pjayys77: the market doesn't represent the average person, just corporations ..
igg44705: @georgehotz if you don't work another day can you still maintain the same lifestyle?
Br4nnon: Honestly I just want our ppl to be taken care of
solitarynative: it wont go back up to where it was unless fed pump
anotherkidnamedaustin: 1099 life i trade options for living
bankzed: my stock market stat is the same as with unprotected sex, I want to pull out but it feels much better not to pull out
blondephilia: If nothing gets passed in DC it'll dip again. Buy then and ride it out.
l1ght5p33d: Good patriots don't pay taxes
anotherkidnamedaustin: quite nice actually
jimmyadaro: @pjayys77 That's plain stupid
MathmAddict: Geo, I know this is way off topic, I bet sports for a living which is clearly not making much of a living atm. I use linear regression models for handicapping. wondering if you think using ML specifically neural networks will be able to improve on EV?
benchai18: @b2kemann The economy being good doesn’t mean we lived in a PERFECT world
solitarynative: because baby boomers selling to retire
ideology_sniffing_raccoon: bolsonaro went from corona is fake to it might be real to fake again LULW
bankzed: *strat
stillneedswork: that link shows a map for the deaths
bytebacon: create sarscoin
bravetraveller: Are you trying to write an antivirus to inject into the simulation?
fujikekw: what stock would you buy right now ? @georgehotz
igg44705: @georgehotz we need some rants
anotherkidnamedaustin: buy apple now
anotherkidnamedaustin: intel amd
Br4nnon: Boeing
Sidhuu: herd immunity
InfiniteReddit: rant!
anotherkidnamedaustin: boeing
nvda9: comma ai recruitment process is brutal
jimmyadaro: @Br4nnon lmao
anotherkidnamedaustin: united airlines
zwisch: UK would be the control
eiscosogin1: yeah but govt here cucked out to media scaremongering
Chrimo: What's that, contaminate everyone and get it over with?
likespuppies: @georgehotz it would not have been nice to see LOL
bytebacon: @nvda9 did you go through it?
jimmyadaro: More Q&amp;A please
igg44705: @nvda9 did you go through it?
Ayyyy420Lmao: do you own chainlink?
pjayys77: with this "raise in the economy" how much of the average person felt any noticeable increase in their standard of living, income .. what have you
C0deCane: a good corona virus strat is convince enough people that it doesn't exist and deny it until the end
blondephilia: Having to pay taxes instead of moving gains into crypto LUL
nvda9: @bytebacon nah
l1ght5p33d: yea how do you get the speed from a video
anotherkidnamedaustin: i wanna apply to commabio
jimmyadaro: @pjayys77 What's your point?
l1ght5p33d: so many assumptions
AzzoDio: @georgehotz The UK medical workers said "WE WILL WALK AWAY FUCK YOU"
zennydmt: so u need years of coding for comma ai?
martinkirilov: I would have liked to see our PM do that, but he shat his pants.
bytebacon: do you hire from india george
jimmyadaro: @l1ght5p33d How many FPS?
eiscosogin1: to be honest i think we're mostly fairly happy with our leadership at the minute he's like a more respectable version of trump
directrix13: All I know is I'm gonna start wiping my ass with American dollar bills because of all the inflation this shit will cause after it's over.
thezilion: @georgehotz WASH YOUR HANDS!
pjayys77: saying the economy is doing good is a huge misrepresentation it shows how corporations are doing
igg44705: it has something to do with the framrate
b2kemann: in a good economy you produce and consume, the US is only consuming now
zennydmt: can u be an average coder and work for comma ai
nizero: George do you ask questions like reverse a res black tree? for interview
ryanm0012: dude move your retirement into crypto and dont pay taxes on it
likespuppies: @georgehotz hey george if im an average coder at 23 can i be great at 30?
nizero: red
leopolddr: Would you study genetics?
JdPaulBlart: just by using google ive got my model at 20 mse right now @georgehotz
benchai18: @eiscosogin1 Explain
jimmyadaro: @pjayys77 Are you stupid? Just asking
C0deCane: @thezilion its ok hes got zinc and canned oxygen
solitarynative: why would he need to wash his hands...
almonte550: YOU'LL DO VISAS?
condoram: @zennydmt you are either a coder or not, stop labeling yourself as average
bytebacon: I messaged you on LinkedIn last week!
xhunter0001: The economy point is interesting tho
braininavatt: GHOTZ ASMR Kreygasm
Ayyyy420Lmao: how do i know if im average?
MrTriharder: You will sponsor visa PogU
condoram: We all start somewhere
doctorgenus: how do you determine if someone is a good coder?
AresRai: @almonte550 work visas
anotherkidnamedaustin: better ??
anotherkidnamedaustin: no
MrTriharder: You will sponsor visa for indians PogChamp
tybutnowyoudie: monkaS
almonte550: @AresRai awesome!
Vindalis: how many applicants do you get before you actually would hire someone with the skills you need?
anotherkidnamedaustin: no way
K177: welp rip
ideology_sniffing_raccoon: Kappa
MrTriharder: monkaGIGA
christianthefalco: LOW BAR
whycopper: What about internship requirements
YoMessi: How much do you pay?
jimmyadaro: @Vindalis Like… 50?
Sidhuu: can I get a sponsor yaar
wholesome_pepe: farm chat to label data Kappa
Nussinov: LOW BAR Kappa
THX1342: that's good leadership
CoachMeech: ez LUL
roystang: should be easy
likespuppies: @georgehotz i don't want to work for you, i want to be a good coder
immaestrolol: how do you get better than you?
Ayyyy420Lmao: how do we know if we're average coding?
Br4nnon: not high enough Kappa
condoram: I got my first job without ever coding a full product
Chrimo: Better at leadership too?
anotherkidnamedaustin: literally no way
pjayys77: again what average person has seen any noticeable incrase in their standard of living continue to ask am I stupid doesn't change that @jimmyadaro
benchai18: @christianthefalco LOL
igg44705: @georgehotz wow imma drop out of college for the comma ai visa
MathmAddict: Geo, I know this is way off topic, I bet sports for a living which is clearly not making much of a living atm. I use linear regression models for handicapping. wondering if you think using ML specifically neural networks will be able to improve on EV?
eiscosogin1: yeah ai is very specific prety much i understand cnns fairly well but svms and shit i don't really get
leopolddr: that's great, it's difficult to find good people to work with
Br4nnon: child's play Kappa
zennydmt: I mean as a coder do you have to be an expert at the minutiae, or can you learn some of the coding tricks on the job
Chrimo: Are you the coffee guy then
whycopper: Gimme an internship
solitarynative: do you care about a degree on a resume?
Nussinov: prove that you get a lot of applicants Kappa
jellyjar: how do you filter through them all?
MrTriharder: Everyone graduated from CMU 4Head
jimmyadaro: @pjayys77 Every-fucking-body on this world? Like 95% of it?
directrix13: Hire me. I can eat more pizza than you.
nizero: can u tell us a story of a funny bad interview?
bytebacon: are you good at web design george?
THX1342: how old is too old?
equipollent_z: twitch channel hackquarantine sounds interesting, but it looks liek it may only be web dev
bankzed: you can get speed from a video by identifying a point of reference and then using two frames to see how far that POR has shifted in two frames, and you do that over and over until you've got a good estimate of speed
leopolddr: How do you choose people in comma.ai??
anotherkidnamedaustin: I would rather take someone who learned on their own than someone who went thru the scam of college
l1ght5p33d: Whats the best feature tracker ORB or no
almonte550: Have you done visa sponsorship in comma?
igg44705: @georgehotz if you don't have a degree can you get a work visa?
jimmyadaro: @THX1342 Like 100 y.o.?
stahks_: how did you find your first employees?
manouchehri: Hiring anyone in security without programming skills?
doctorgenus: can I breakdance on your huge living room floor?
localcanofdutchgold: what do you consider good at programming?
verxile: How do you interview technical person
pjayys77: @jimmyadaro you know we're referring to the US market right
THX1342: jimmyadaro :P
Mlewii: Do you actually look for people that are really good or that are willing to be really good
anotherkidnamedaustin: i learn more studying on my own then my stupid professors taught me
Br4nnon: do we have to move to CA? it sucks there
solitarynative: Do you look at resumes without degrees?
Insanit13s: Could you give an example question for a comma.ai interview?
jimmyadaro: @pjayys77 I didn't know
likespuppies: @georgehotz How do I become a good coder? :)
Ayyyy420Lmao: you have any cute female employees?
ahahahaitslit: how's the pay tho
anotherkidnamedaustin: who needs degrees
jimmyadaro: @pjayys77 Still stupid
GoldSkis: So, I want to do a quick-mount for the comma two, you plan on releasing the cad files for the case?
anotherkidnamedaustin: scam
martinkirilov: @georgehotz Please tell me you do something more interesting than these shitty FANG companies
zennydmt: how about data science people?
bytebacon: Multiple View Geometry and Photogrammetry is the real deal bois
l1ght5p33d: i do nmap
MrTriharder: Pepega
eiscosogin1: can i send you my dissertation when i'm done? lol
directrix13: Hey I thought you didn't talk work on this stream.
btpisroot: LUL
CoachMeech: hahahahhahaha
jimmyadaro: @pjayys77 Life is a lot better and easier than it was 50, 100 or 200 years ago
christianthefalco: lmao
Nussinov: you need a henchmen?
64pillars: lol
bluejimmy168: yes
Chrimo: How would you take programming to the 'next level'?
0R4NG3: lmao
MrTriharder: LUL
williamjennings1: lol
condoram: Guys, for all of you that keep labeling "good/bad programmer" just get over it. You simply do and eventually you do things better.
K177: LOL
localcanofdutchgold: lul
INTeaRs: yes
ahahahaitslit: lmfao
tybutnowyoudie: LUL
nremind: I heard that companies are backing out of promised internships because of covid19
xxxelent: there is a challenge problem on their website
ideology_sniffing_raccoon: LUL
fujikekw: LUL
phrixus_bro: paul blart security
williamjennings1: do you guys have janitors
zennydmt: what do you look for in data science people
Nussinov: @georgehotz are you hiring cooks
leopolddr: police security
pjayys77: @jimmyadaro thanx for still not refuting anything I said but okay
PiroFloydian: i can order pizza super well do i have a job lol
Bootyclub: Security theatre? Like the Enterprise IT kind
Ayyyy420Lmao: you have any cute female employees?
igg44705: @georgehotz i can sweep the floors tho
YoMessi: "Security is everyone's job", is how data breaches happen.
RunnerMD: @georgehotz do you need doctors? :D
doctorgenus: do you interview everyone personally?
anotherkidnamedaustin: im down for commabio. forreal
condoram: @georgehotz Can you hire me remotely to be your twitch chatter thing?
Chrimo: Best way to improve your programming?
jimmyadaro: @pjayys77 You're throwing shit to this chat and expect me to answer you… what exactly?
likespuppies: how do i become good and get a job :monkaCRY:
braininavatt: do you offer any hardware jobs?
williamjennings1: hire greeters?
bravetraveller: never underestimate the power of a knight stick
Nussinov: You hiring strippers? I know a thing or two
tybutnowyoudie: are you hiring phd students for an internship?
whycopper: Computer engineer?
nvda9: that screening test is a nightmare for me
subconix: can I just be the office bitch?
leopolddr: 5 people, must be tough
zennydmt: do u offer data science jobs
MrTriharder: I'd even work as a Janitor tbh 4Head
ImJ4Gu4R: Geo, make me mod, i'm subscriber!
GoldSkis: Are the 3D files for the case on the comma two open source? I can only find the gopro mount and I wana draw up a quck mount for it.
manouchehri: Like I pop Chrome but hate programming in it.
Hawklite: are you hiring philosophers
ahahahaitslit: what about backspace ai
anotherkidnamedaustin: commabio would be fucking sick and im down lol we can be the scammers instead of being scammed. biochem degree from iowa..
christianthefalco: You need frontend people? I'm kinda sick of Google
Ayyyy420Lmao: are you diverse enough? how many black guys?
igg44705: @georgehotz would you say you are good in hard drive?
montecarlo: git gud
btpisroot: I would ride a Segway all day for 50k
yesokboss: what about a janitor i clean a mean toilet
equipollent_z: what about hiring coronavirus engineers?
nizero: George you hiring front end devs?
immaestrolol: how do i get good geo
brownyyyylocks: biz dev
benchai18: @christianthefalco Lol again
Chrimo: What would you do to improve your overall programming 'skills'?
cellophane11578: @georgehotz can we have a moment of silence for the end of Adobe Flash
Br4nnon: comma bio
doctorgenus: you guys looking for marketing people that can code?
TeaLeafi: georgie i love ur coding
janpoonthong: HOW TO GET BETTER AT PROGRAMMING???
jimmyadaro: @georgehotz If I do every test alright but have a shitty Github, would I make it??
condoram: Comma hack when?
braininavatt: comma.bio
wholesome_pepe: do u hire kali linux scrpt kiddies?
anotherkidnamedaustin: i can fold da proteins in a non scam way
igg44705: @georgehotz would you say you arer good with hard ware*
64pillars: tres.comma
christianthefalco: @benchai18 lol what?
julien9877: marketing LUL
TeaLeafi: coding is boring though tbh....
Br4nnon: i can code hello world LUL
zennydmt: start ups are very stressful
CoachMeech: everyone at comma is a programmer ?
bankzed: going full circle and doing some Bioinformatics?
deva73: whats upcoming in commaAi?
btpisroot: Security Marketing for Compliance
localcanofdutchgold: what do you consider proof?
ahahahaitslit: what even is the recruitment process
MrTriharder: @georgehotz the day u make it big in pharma, dont become one of those asshole who scams poor souls like me for expensive medicine
jellyjar: whats your interview process like?
leopolddr: hahahahahaha marketing people
TeaLeafi: its allabout making that stock money!!!
LaheyFPS: i can do a for loop do i qualify :) @georgehotz
bytebacon: Do you ask Leetcode type of questions?
williamjennings1: do you shave your own head?
nremind: so is comma ai really going to offer internships even if the covid19 situation doesn't improve?
Ayyyy420Lmao: are you diverse enough? how many black guys? cmonBruh cmonBruh cmonBruh
jimmyadaro: @georgehotz If I do every test 10/10 but have a shitty Github, would I make it??
GoodOlSmokey: @georgehotz see you man, gotta go git good
benchai18: @christianthefalco You keep making me laugh. First the “low bar” and then the “I’m sick of google”
INTeaRs: what kinda programmers you looking for
janpoonthong: HOW TO GET BETTER AT PROGRAMMING???
wholesome_pepe: lets get this bread
anotherkidnamedaustin: def commabio(x)
roystang: is the hackerrank public?
Chrimo: What do you consider a 'good coder'?
anotherkidnamedaustin: x = give me a job
NetAce: @georgehotz what do you define as "good at programming?" Like, not objectively, just in your subjective opinon
igg44705: @georgehotz why no remote jobs tho?
zennydmt: how is the work life balance at comma.ai
solitarynative: do you have a diversity quota I can fill?
jimmyadaro: lmao alright
doctorgenus: do we still have to pass that question where you give us a video and we need to determine the speed of the car?
condoram: is it QA time since all of these questions or are kids in EU just woken up?
o______________________k: how to get better at programming?!
Mrclutch963: What's your favorite meal? @georgehotz
montecarlo: yellow/red in codeforces
theonlymonkas: what coding skills are necessary for working at comma
CoachMeech: All of what?
Br4nnon: advent of code monkaS
likespuppies: Do all of what?
zennydmt: go all in having to code?
Nussinov: Advent of Code
LaheyFPS: i can do a for loop do i qualify :) @georgehotz
anotherkidnamedaustin: lol
zennydmt: what did u recommend?
Ferr0vax: @georgehotz You've an interesting paper from Weiss and Leibowitz up. What are your thoughts on their studies compared to more recent work? Also what were the accession numbers of the the protein sequences you were blasting in the other screens?
janpoonthong: do you have a wife?
Nussinov: https://adventofcode.com/
christianthefalco: so that's a yes?
ahahahaitslit: lmao
igg44705: @georgehotz there is no work life only WORK
zennydmt: advent of code i see
condoram: Are you hiring any CEO's?
benchai18: FUCK YES
TeaLeafi: u have kids?
pjayys77: @jimmyadaro this shows that you aren't "reading" anything I'm putting just sticking to your talking points - for the third time the economy being deemed "good" only represents corporations and is a misrepresentation because the average worker hasn't seen any noticeable increase in their standard of living
TeaLeafi: will ever have kids?????
directrix13: diversity quotas by definition are racially discriminatory
zennydmt: thats a very unhealthy attitude
anotherkidnamedaustin: ban that guy
nvda9: George, give us some interview tips
trustME_SC2: Good morning from Germany sacDAD
MrTriharder: WTF
montecarlo: mizkifWeird
Nussinov: LUL
MrTriharder: BAN THIS GUY
williamjennings1: why haven't you put your grocerys up
raystriker98: whoa
itsxaos: YIKES
deep5: Yikes
benchai18: FUCKING LOVE U Georgie! Diversity quotas are dumb
condoram: How do I mute someone?
jimmyadaro: "So why comma.ai? Because you want to do something with your life. You want to see progress being made. You want to change the way the narrative will play out. You are bored, and want the world to be less boring. And at the end of the day, you want to win." That's marketing boie
Ayyyy420Lmao: lmao elon must has entered the chat
raystriker98: BAN THIS GUY
MrTriharder: Yikes
anotherkidnamedaustin: @georgehotz make me a mod..
btpisroot: jeeze
localcanofdutchgold: WutFace help
MrTriharder: BAN THIS TARD
INTeaRs: ban this dude
toront0saur: pen testers ???
MrTriharder: WutFace mods
zennydmt: I feel its a very unhealthy attitude to work that much
williamjennings1: omg
fujikekw: REEEEEEEEEEEEEEE
roystang: make me mod
birkett0011: ban plz
nozoke: mods
jimmyadaro: @georghotzselfdrivingfail Spamming
directrix13: can we ban this dumb fucker?
0R4NG3: WutFace
AresRai: I will mod :) @georgehotz
Ayyyy420Lmao: lmao elon musk has entered the chat
INTeaRs: BAN
Br4nnon: LUL
Vindalis: LUL
Mrclutch963: Who is eric weinstein? @georgehotz
anotherkidnamedaustin: lmfao
birkett0011: LUL
AresRai: I will mod :) LUL @georgehotz
Nussinov: LUL
tybutnowyoudie: LUL
bytebacon: LOL
nvda9: @georghotzselfdrivingfail dude
TheLastMrX: LUL
0R4NG3: LMFAO
nozoke: george pls
bravetraveller: ffs man
Vindalis: LUL LUL LUL
MrTriharder: LUL
earthbender: LUL
o______________________k: LUL
cortickal: lmao
thecoder15: @georgehotz Advice on starting a hardware/software company and bootstrapping?????
ahahahaitslit: lmfaoooooooo
deep5: KEKW
Santiago_LHC: This is beautiful
blondephilia: Agreed
MathmAddict: Geo, I know this is way off topic, I bet sports for a living which is clearly not making much of a living atm. I use linear regression models for handicapping. wondering if you think using ML specifically neural networks will be able to improve on EV?
montecarlo: KEKW
jimmyadaro: ffs
mritzing: good bit tbh
itsxaos: RIP
immaestrolol: lmaoo
MrTriharder: lol
xSynchronizeD: LUL
igg44705: hahahaha
localcanofdutchgold: OMEGALUL
4FUN_PLAYER: LUL
Zaegen: ok that was good
THX1342: LUL
PiroFloydian: LUL LUL LUL LUL LUL
anotherkidnamedaustin: i was mad at first now im laughing
AresRai: Good one LUL
btpisroot: LUL
INTeaRs: LUL
Nussinov: that was beautiful
NetAce: adventofcode [.] com if anyone is interested in the site Geohotz mentioned
MrTriharder: LUL
PiroFloydian: KEKW
christianthefalco: wtf that guy was cool
TeaLeafi: he speaks the truth?
THX1342: Stream is getting famous LUL
christianthefalco: why ban?
C0deCane: LUL ahahaha
Saltyballss: it was my dog, sorry for that
Br4nnon: PogChamp
nizero: Georgehotz your best employee is Harald
MrTriharder: PogChamp
theonlymonkas: LUL
benchai18: It was Saurik dude
Ferr0vax: Just to differentiate, I'm not spamming I'd like an answer to @georgehotz You've an interesting paper from Weiss and Leibowitz up. What are your thoughts on their studies compared to more recent work? Also what were the accession numbers of the the protein sequences you were blasting in the other screens?
jimmyadaro: "So why comma.ai? Because you want to do something with your life" THAT'S MARKETING YOU BOY
toront0saur: any pen testers?
o______________________k: PogChamp
igg44705: @georgehotz that's awesome man
christianthefalco: CENSORSHIP!!!!!
64pillars: xqcM
dorkmo: wait for the checks to send out
leopolddr: that's great
likespuppies: Enough money for beer PogChamp
janpoonthong: Why and how you can code for long period of time? any advice
northumb: have you read life 3.0 from mag tegmark? what do you think?
btpisroot: rekt
ideology_sniffing_raccoon: PogChamp PogChamp PogChamp
Mrclutch963: Who is eric weinstein? georgehotz
itsxaos: PogChamp
benchai18: George. That was Saurik ‼️
doctorgenus: will you sell tomorrow if someone offers 1B
INTeaRs: @georgehotz What kinda programmers you looking at?
anotherkidnamedaustin: @georgehotz congrats man. thanks for the inspiration that studying and focus goes a long long way
l1ght5p33d: Yeeeaaaaaa good jobb guys
NetAce: @georgehotz appreciate the recommendation on coding, love the stream
equipollent_z: what would you do if you had to reinvent computer architecture?
christianthefalco: CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!!
GoldSkis: When we gonna get the 3D files for the comma two case? I want to make a magnetic quick mount.
anotherkidnamedaustin: eric weinstein is a math genius
condoram: @georgehotz do you think once autonamous cars are a thing that if all people are gone that cars will keep driving around without us?
janpoonthong: how could you code for long period of time???
christianthefalco: CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!! CENSORSHIP!!!
igg44705: @INTeaRs C   python mechine learing i guess
likespuppies: @Mrclutch963 outcast mathematician with good ideas
timi13462: rapist
T3chHS: "We will evaluate your test.txt using mean squared error. &lt;10 is good. &lt;5 is better. &lt;3 is heart." hahaha
C0deCane: I smoked crack with eric weinstein
benchai18: The slammer
jimmyadaro: @condoram What for?
benchai18: Spammer
Br4nnon: would open pilot work on old cars?
northumb: have you read life 3.0 from mag tegmark? what do you think?? @georgehotz
solitarynative: Would you ever go public
64pillars: lol
kaboomyoo: incognito mode always for safety?
benchai18: Saurik was the spammer
anotherkidnamedaustin: @janpoonthong have u not seen his videos? this dude codes 13hr like its nothing
qlutoo: whats your take on peter thiel
williamjennings1: shave your head on stream?
TeaLeafi: how can you code for such a long time?
MathmAddict: Geo, I know this is way off topic, I bet sports for a living which is clearly not making much of a living atm. I use linear regression models for handicapping. wondering if you think using ML specifically neural networks will be able to improve on EV?
ahahahaitslit: the portal with eric is great
jimmyadaro: @kaboomyoo lmao
zennydmt: what companies do the rejects go to
immaestrolol: how do u get good lmaoo
TeaLeafi: what if you get hacked?
likespuppies: @georgehotz ever been depressed?
xhunter0001: does datascience jobs in commaia is specifis to images or just datascience skills in general
montecarlo: do you hire math phds
roystang: does your hackerrank have a difficulty?
fujikekw: Martial Law up in this bitch
solitarynative: Have you played alyx?
deva73: RICK AND MORTY NEEDS TO COME BACK
timi13462: good programming languages to learn now
jimmyadaro: @kaboomyoo That's Mac's dark mode
kaboomyoo: @jimmyadaro xD
Ayyyy420Lmao: your favourite house md girl?
bytebacon: Do you ever remote control cars through Eon?
doctorgenus: do you hire for coding abilities or potential coding abilities?
MrTriharder: @georgehotz how do u even get int oCarnegie? like so smart?
903284hg39408gh23098h093f: anyone at comma ai have a phd?
thecoder15: @georgehotz advice on starting a hardware/software company
igg44705: import tensorflow as tf i am bit of a machine learning engineeringmyself you know
condoram: @immaestrolol keep doing it lol, it is not rocket science. You simply do, you challenge yourself and keep doing!
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME .
anotherkidnamedaustin: guys are asking the wrong questions. if u want to get good at something, just sit down and fucking study and shut up
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME .
janpoonthong: at what age you started coding?
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME .
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME .
0R4NG3: WutFace
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME ...
likespuppies: Thirteen
deep5: yikes
T3chHS: 13
bytebacon: FOREMAN
blondephilia: Jenna
benchai18: Is it true you banged Ryan Petrich’s girl in 2010
christianthefalco: STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME STOP CENSORING ME .
jimmyadaro: More spam…
itsxaos: BRO are you mentally ill
igg44705: oliva wild
MrTriharder: WutFace
solitarynative: WutFace
Ayyyy420Lmao: 13 srsly? that manly face...
Br4nnon: he's twitch prime
RunnerMD: @georgehotz what's your opinion on high IQ people. Do you think they will do better job in your team ?
montecarlo: he's not a sub
Mint2bSpiced: Where are the mods?
Nussinov: @itsxaos do you even have to ask
itsxaos: hes not a sub dude
AresRai: hes not a sub
0R4NG3: twitch prime pleb WutFace
anotherkidnamedaustin: guys are asking the wrong questions. if u want to get good at something, just sit down and fucking study and shut upp
christianthefalco: shhhhh chat
mritzing: olivia wilde
igg44705: oliva wlid is the new girl in house md @georgehotz
cellophane11578: LUL foreman
williamjennings1: blocked!
christianthefalco: shhhh
kaboomyoo: @jimmyadaro oh ty
equipollent_z: lol
deep5: Hes not a subscriber. icon says hes a prime member
MrTriharder: Kreygasm
jimmyadaro: @kaboomyoo np
anotherkidnamedaustin: high iq making u smart is a myth....
aMANT3: DISTRACTED
janpoonthong: at what age you started coding?
bytebacon: SHE LESBIAN
Nussinov: oh hell yeah
williamjennings1: omg!
braininavatt: 13 wins
PiroFloydian: @georgehotz hes not a sub thats prime
anotherkidnamedaustin: this chat is scuffed
rustduck: PedoBear
Lizardan: Kreygasm
Bombapil0t: 10/10
Br4nnon: yes ma'am
itsxaos: hot Kreygasm
Vindalis: Kreygasm
montecarlo: OLIVIA WILDE Kreygasm
Jehhred: Olivia Wylde is wild
MrTriharder: Kreygasm oh yea
TeaLeafi: WAIT how much BTC do you have? Also in an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?...
benchai18: Is it true you banged Ryan Petrich’s girl in 2010
nvda9: George did you part icpc word final
likespuppies: @georgehotz How long has it been since you had a warm bed, sir?
anotherkidnamedaustin: house is the best show
jimmyadaro: SHE'S HOT
Mrclutch963: Favorite series @georgehotz
localcanofdutchgold: lost agane
solitarynative: 7/10
TeaLeafi: WAIT how much BTC do you have? Also in an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?...??
directrix13: directrix13 subscribed with Twitch Prime. They've subscribed for 4 months!
inciMage: this lady has huge forehead
jimmyadaro: Yeah
toront0saur: have you ever been exploited?
montecarlo: do you hire math PhDs
williamjennings1: sleep stream?
903284hg39408gh23098h093f: anyone at comma have a phd?
THX1342: https://www.youtube.com/watch?v=7Hk9jct2ozY
equipollent_z: any opinion on LangSec?
TeaLeafi: WAIT how much BTC do you have? Also in an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?...???
PiroFloydian: @georgehotz thoughts on spicy food?
anotherkidnamedaustin: @georgehotz how do you focus for long periods of time. i tap out at 6hr
jimmyadaro: "So why comma.ai?"
roystang: @georgehotz what difficulty is ur hackerrank
jmv_chin: what's the crappycase repo about on ur github?
christianthefalco: @georgehotz thoughts on Jonathan Blow?
zennydmt: do you implement trading algos?
deep5: Kappa
MrTriharder: @georgehotz your life goals?
itsxaos: have you looked at the urbit programming language? its kinda ridiculous
o______________________k: how to improve programming skills?
nizero: @georgehotz your best employee is Harald
thecoder15: @georgehotz Advice on starting a hardware/software company??? and maybe on bootstrapping too
igg44705: @georgehotz how much weed do you do? does it affect you rmemory
cybergenik: Would you actually consider making a biotech company?
TeaLeafi: In an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?...
blondephilia: Most lucrative crupto in your opinion?
TeaLeafi: In an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?... ?????
williamjennings1: why do you always wear a hoodie?
Mrclutch963: Favorite book?
benchai18: UGH. FAMED JAILBREAK TWEAK Dev!!!!
pjayys77: does she give off that look like " I will cut you"
Mlewii: I love how his tone changed haha
TeaLeafi: In an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?... ???????
zennydmt: do you ever want to get married and have a family/kids?
benchai18: HE MADE ACTUVATOR
TeaLeafi: In an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?... ?????????????????
903284hg39408gh23098h093f: anyone at comma have a phd?
TeaLeafi: In an interview you said nation state will kill you for certain codes/exploits is that true? Have you ever had death threats?...??????????????
directrix13: @georgehotz do you think the universe is simulated?
ggtom: montecarlo just get some programming experience u can prolly get hired tbh. depends what kind of math u do tho.
INTeaRs: What type of programmers you looking for?
solitarynative: crypto portfolio?
likespuppies: @georgehotz How do I be a cool guy?
doctorgenus: If you get bought out tomorrow, will you go into politics?
igg44705: @georgehotz how much weed do you do? does it affect you memory
CheeseManUchiha: @georgehotz how many mechanical engs (%) did you work alongside of during the self-driving car project
martinkirilov: @georgehotz You ever wear suits?
TeaLeafi: ohhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh thank you!
blondephilia: Most lucrative crypto in your opinion?
64pillars: comma.blockchain when
Ayyyy420Lmao: do you own or know about chainlink and sergey nazarov?
MrTriharder: @likespuppies 4Head just be cool
jimmyadaro: Let people enjoy hacking lmao
Mrclutch963: Favorite book?
ImJ4Gu4R: Make me geo, im subscriber.
equipollent_z: how to emulate biology on machines?
jay_al97: @georgehotz how's your church project going?
JdPaulBlart: @georgehotz just from google i made a model with 25 mse for your challenge am i hired
anotherkidnamedaustin: @georgehotz how do you focus for long periods of time. i tap out at 6hrs
TeaLeafi: i love ur george
RunnerMD: @georgehotz what's your opinion on high IQ people. Do you think they will do better job in your team ?
TeaLeafi: &lt;3
ImJ4Gu4R: make me mods
903284hg39408gh23098h093f: anyone at comma have a phd?
nvda9: you were icpc World finalist?
igg44705: @georgehotz comma ai school for the win
theonlymonkas: favorite pair of shoes
zennydmt: do you eventually want to teach at a high school
doctorgenus: school about what?
CoachMeech: what level would your school be?
PiroFloydian: LUL
hastingspb: @georgehotz what is the best music??
Codeoxic: @georgehotz Is it worth to study Computer Science or Computer Engineering, while having a liking in hardware
jimmyadaro: You'd get bored
Tyrant_01: WINDOWS OR MAC ?
bytebacon: Did you ever try programming SEGA? Like this guy from Computerphile: https://www.youtube.com/watch?v=gNHCxH35wYU
TeaLeafi: SCHOOOOL??????????? UR STARTING SCHOOL???
C0deCane: "Cult"
TeaLeafi: SCHOOOOL??????????? UR STARTING SCHOOL??? ?????
blondephilia: Most lucrative crypto in your opinion?
THX1342: of course it is, it's a sscam LUL
igg44705: @georgehotz did't you try to get a phd once?
TeaLeafi: SCHOOOOL??????????? UR STARTING SCHOOL??? ????
anotherkidnamedaustin: university of a joke but u went to carnigie so...
ideology_sniffing_raccoon: LUL
shieeeeeeeeet: do you use any note-taking software to manage your thoughts? @georgehotz
janpoonthong: what time you slepp???
pjayys77: wut stockpiling expoits
williamjennings1: scam lmao
theonlymonkas: favorite album right now
likespuppies: @Codeoxic yeah
benchai18: George is one of those rare people that is brilliant but not to a degree that’s “too much for his own good”
ackxhpaez: Jonathan Blow streams @naysayer88
localcanofdutchgold: Kapp
TeaLeafi: SCHOOOOL??????????? UR STARTING SCHOOL???
deva73: opening a university eh?
Ayyyy420Lmao: do you own or know about chainlink and sergey nazarov??
anotherkidnamedaustin: no make it a cult so u dont pay taxes
solitarynative: can you expand on that
inatreecrown: coding school
equipollent_z: LUL
anotherkidnamedaustin: el ron hubbard
braininavatt: HahaThink
jay_al97: @georgehotz I would signup for your school
Abnico: Special school?
TeaLeafi: SCHOOOOL??????????? UR STARTING SCHOOL??? ?
earthbender: LUL
theonlymonkas: are you in the cloud
bankzed: that's why Trump tried out University first before going into politics
toront0saur: LMAO
Mrclutch963: Favorite book?
christianthefalco: @blondephilia stop it with the crypto bullshit. it's for dummies and parasites
l1ght5p33d: school campus lifeee
voxelfox0125: Do you still do hack the box and HackerRank challenges?
doctorgenus: school about how to use the internet efficiently?!
64pillars: LULW
cellophane11578: university
theonlymonkas: CULT LUL
Hawklite: a bigger effect would be reforming public schools, not creating a university
yungdeli_: what state do you live in
anotherkidnamedaustin: yes! el ron hubbard!
jimmyadaro: lul
igg44705: @georgehotz did't you go to collage to get a phd once?
doctorgenus: or school about hacking?
martinkirilov: @georgehotz You know, it's funny in the UK they pay your Tuition Fees and they even give you Maintenance Loan and it's a very low interest one, maybe come study here, you don't need any money :D
TeaLeafi: A.I religion????n hahahah
benchai18: I’d drink the kool aid with u Jorge
pjayys77: Trump University is a good template
CoachMeech: i throw a leather ball real good. DO i get in?
PiroFloydian: carlson makes legit populist analysis and packages some fashy stuff into it
blondephilia: Most lucrative crypto in your opinion?
cellophane11578: LuL
bytebacon: SEGA Programming GOD https://www.youtube.com/watch?v=gNHCxH35wYU
TeaLeafi: A.I religion?
mindfog: Kappa
zennydmt: do any high school kids apply to comma ai
likespuppies: &gt; Dropped out of Uni &gt; Creates his own
TeaLeafi: A.I religion? A.I religion?
anotherkidnamedaustin: George Carnigie College, where you get a scuffed folding protein degree
Nussinov: @georgehotz make sure you never grow your hair below your shoulders because then youll REALLY have a cult
nvda9: I can't afford college what should I do
anotherkidnamedaustin: we kove u goerge
jimmyadaro: 4:13 AM Here
THX1342: gn
inatreecrown: online school?
equipollent_z: what would you want from a coronavirus researcher if you had them in the room?
zeus13i: Will Comma hire me to work on this? ;)
TeaLeafi: A.I religion?
christianthefalco: REACT TO MEME VIDEOS
theonlymonkas: we do donations
903284hg39408gh23098h093f: anyone at comma have a phd?
l1ght5p33d: Fun fun fun till geohot said no more Qn A
blondephilia: I'll love you if you answered this question: Most lucrative crypto in your opinion?
anotherkidnamedaustin: make a carnigie college
TeaLeafi: A.I religion? ?
zwisch: what did you take at Carnegie Mellon?
Saltyballss: ever been in germany?
b2kemann: geo loves Q&amp;A
Ayyyy420Lmao: did you get the SNEED joke from the simpsons?
tybutnowyoudie: are you planning on continuing the coq stuff?
MrTriharder: FeelsBadMan DONT GO GEORGE FeelsBadMan U ARE THE ONLY ENTERTAINMENT I HAVE FeelsBadMan
TeaLeafi: A.I religion?
PiroFloydian: be back tomorrow?
b2kemann: he will pass on this to his kids
voxelfox0125: @nvda9 Learn online for free
benchai18: Last time u said couple more min it went an hour exactly
deva73: should i get a phd ?
TeaLeafi: A.I religion??
doctorgenus: will you hire someone with a high IQ but no coding skills
theonlymonkas: favorite album
o______________________k: how to improve in programming ? @georgehotz
equipollent_z: what do you think about general AI? :D
zennydmt: have u applied information theory to multivariate distributions
likespuppies: @georgehotz Serious: I am 23 and average coder, how do I become great? What do I do?
cortickal: SNEED
Abnico: Are u bisexual?
GoodOlSmokey: @georgehotz what do you consider a good coder?
timi13462: python or java
williamjennings1: do you floss your teeth?
thecoder15: @georgehotz thoughts on Richard Feynman?
Exclamation_mark_CODE: Will you post the stream video somewhere?
benchai18: You still playing with coq???
ahahahaitslit: do you enjoy functional programming
Br4nnon: Java
INTeaRs: @georgehotz What programmers you looking for?
CoachMeech: why is this chat so obsessed with college
Ayyyy420Lmao: @cortickal never gets old
jimmyadaro: How much competitive is AI self-driving cars sector???
C0deCane: When is the announcement for comma bio labs?
blondephilia: Most lucrative crypto in your opinion?
TeaLeafi: i love you
anotherkidnamedaustin: STUPID QUESTION GO STUDY AND PRACTICE
NetAce: Any advice on managing ADHD, if you have that issue?
o______________________k: :(
toront0saur: pen testing jobs?
igg44705: @georgehotz did you read about the iq test for Ai by deepminds?
ideology_sniffing_raccoon: LUL
TeaLeafi: i love you george you inspire me &lt;3
anotherkidnamedaustin: i was gone 3hr cuz i had to read..
bytebacon: Do you hire people who only know Python and Javascript?
TeaLeafi: i love you george you inspire me &lt;3 &lt;3
jimmyadaro: How much competitive is AI self-driving cars sector??
solitarynative: git gud
Tyrant_01: GEORGE WHY NOT WINDOWS?
64pillars: 4Head
andydavies11: what do you think of OOP?
xhunter0001: how do you know
Br4nnon: study practice implement
anotherkidnamedaustin: IQ IS A JOKE
Nussinov: how do I make my brain smarter? Kappa
xhunter0001: if you're a good coder ?
igg44705: @georgehotz coffe test?
Abnico: Wait so you are bisexual?
ggtom: lmao
TeaLeafi: i love you george you inspire me &lt;3 &lt;3 &lt;3
doctorgenus: Are we doing part 5 tomorrow?!!!!!!!
xhunter0001: how do you know if you're a good coder ?
pjayys77: in the end, just do it
blondephilia: Most lucrative crypto in your opinion?
Br4nnon: it's possible. wheels, motor, sensor
TeaLeafi: i love you george you inspire me &lt;3 &lt;3
K177: Kappa
equipollent_z: what if that house doesn't have cofffee :D
MrTriharder: KappaPride
solitarynative: keurig test LUL
itsxaos: BOOOOOoo bi master race KappaPride
localcanofdutchgold: KappaPride
TeaLeafi: i love you george you inspire me &lt;3 &lt;3 &lt;3
zennydmt: do you use tensorflow or keras
Ayyyy420Lmao: you ever did ketamine?
equipollent_z: people are coffee ☕️
anotherkidnamedaustin: @georgehotz we should get into sativa
theonlymonkas: favorite song
benchai18: GeOrGe hOw I hAcK mY pEePeE iNtO gIrLs VaGeNE
deva73: BECOME TRUMP MAKE yourSElf great AGAIN
Nussinov: ah okay, so only into dudes KappaPride
birkett0011: An area that could use a big shake up is simulation software @georgehotz
K177: BITCOOONNEEEEECT
ShredderSherlock: does it have to pick the lock to your door?
christianthefalco: Is it okay if the robot kills all the humans first?
b2kemann: dog test: when you dog can drive your car, you win selfdriving cars
anotherkidnamedaustin: bitconnect lmao
cellophane11578: how does it know its coffee beans, and not rat poop?
bytebacon: Etherium
jimmyadaro: How much competitive is AI self-driving cars sector???
CheeseManUchiha: hey hey hey
bankzed: Biiiiiiiitconnnnnnnect
solitarynative: he means amoveo
igg44705: @georgehotz are you a postmodernist?
williamjennings1: how do you sleep if you just had coffee
Bootyclub: Opinions on Rust?
nizero: @georgehotz did u implement that new algorithm that came out of deepmind
xhunter0001: if you're a good coder ?
dyxx_pix: did u learning anything useful at cmu
64pillars: buying tesla stock anytime soon?
vix_dev: @georgehotz do you have a favorite programming language?
likespuppies: @georgehotz Ever done DMT?
4FUN_PLAYER: bitconeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
bytebacon: DMT
voxelfox0125: Can i advertise a great website for learning game hacking?
CoachMeech: dude drugs are bad for you
jimmyadaro: How much competitive is AI self-driving cars sector?
blondephilia: that's a bullshit answer :/
nozoke: do you wanna animal crossing stream?
toront0saur: pen testing at comma????
TeaLeafi: KETAMINE??!?!!
Abnico: KappaPride KappaPride KappaPride lmao is he really bisexual?
Codeoxic: Are hackathons worth doing?
THX1342: 1984 or Brave New World?
GoodOlSmokey: @georgehotz what do you consider a good coder? im trying to figure out what you answered before to that question and it's blurry on clip
903284hg39408gh23098h093f: @georgehotz favorite drug?
anotherkidnamedaustin: commabio where we make custom thc for clients
bravetraveller: what's your take on microdosing psilocybin?
MrTriharder: 5Head
bayarealove: adderalls the best baby
igg44705: @georgehotz would you become batman
ahahahaitslit: do you enjoy functional programming
anotherkidnamedaustin: thc strains
TeaLeafi: weird flex
b2kemann: did you meet the machine elves?
tybutnowyoudie: is there a drug you havent done?
whycopper: Did you go to school?
christianthefalco: @blondephilia why do you think?
ryanm0012: how do you feel about ketamine
CoachMeech: DRUGS ARE BAD
TeaLeafi: why is there a bed in your kitchen?
bytebacon: DO JOE ROGAN!
Nussinov: what is with you people so interested in what drugs he's done LUL
PhantoJah: dmt damn
nvda9: George is that true you were a icpc world finalist?
directrix13: In what language is the Android interface written?
voxelfox0125: Can i advertise a great website for learning game hacking?
hastingspb: !adderall
solitarynative: have you had ego death?
jimmyadaro: How much competitive is AI self-driving cars sector?
TeaLeafi: why is there a bed in your kitchen????
zennydmt: Do you like green tea or coffee?
wholesome_pepe: who are your biggest competitors outside of the US?
cellophane11578: time is a timecube
Br4nnon: php monkaS
zeus13i: Whats your daily caffeine limit? Why?
TeaLeafi: why is there a bed in your kitchen? ???
doctorgenus: do you ask the dumb leetcode questions in your interviews?
ImJ4Gu4R: make me mods?? im subscribe WutFace
likespuppies: @georgehotz You would really like crack, dont do it george
benchai18: Do u eat ass???????
theonlymonkas: do you sleep on the kithchen?
TeaLeafi: why is there a bed in your kitchen??????
blondephilia: @christianthefalco the fact that governments are falling apart proves crypto's worth. Your leaders are incompetent.
itsxaos: can we save politics or do we have to burn it down?
anotherkidnamedaustin: letting go of ur ego is genius 101
0R4NG3: benchai18, asking the real questions
cortickal: Permutation Sea?
cellophane11578: o what a great title for a book
Ayyyy420Lmao: you're an absolute nocoiner? no crypto whatsoever?
TeaLeafi: breaking through??
equipollent_z: not sure if I asked this already
cellophane11578: i gotta check it out
equipollent_z: what's outside of everything?
TeaLeafi: have you broken through?
HalluCinogen151: I achieved ego death from hitting a rock bottom
zennydmt: do you meditate?
LokkimestariN: Any suggestions how to learn low level C?
anotherkidnamedaustin: ego death is sooo genius 101. i want to know the 201 stuff...
theonlymonkas: how are you?
christianthefalco: @blondephilia that's a hopeful connection. You want it to be true more than you think it's actually true
Hawklite: do you think some questions can only be answered under the effect of drugs?
C0deCane: @georgehotz is PCP a possible cure? Check the stats?
synoborg: do you remember everything you read?
jimmyadaro: How much competitive is AI self-driving cars sector???
TeaLeafi: nice
benchai18: George, do u eat ass??????????????????
igg44705: @georgehotz can a neurosciences understand a microprocessor was really good man
RunnerMD: @georgehotz I'm a brain surgeon and I learn Python(ML/DL) to automatize some of our tasks(diagnosis more) or analyze some data. Do you think it is worth it?
bytebacon: DID JOE ROGAN OR JAMIE EVER APPROACH YOU?
TeaLeafi: nicenice
b2kemann: love how you don't like s-vally, but still so much of it is in you
TeaLeafi: george u inspire me??
64pillars: indica or sativa
anotherkidnamedaustin: @georgehotz ever read about collective consciouness? i have a good book for u MetaHuman
PiroFloydian: KEKW
Ayyyy420Lmao: you're an absolute nocoiner? no crypto whatsoever?
TeaLeafi: indica or sativa??
TeaLeafi: indica or sativa????
anotherkidnamedaustin: collective conscious theory
pjayys77: If Elon Musk could be president would you vote for him @georgehotz
Saltyballss: is this ur streaming outfit or are just not changing ur clothes?
zennydmt: do you have a ps4
likespuppies: @georgehotz Is leetcode relevant?
techtim123: name of the book again?
TeaLeafi: indica or sativa?????
nvda9: which school did you go in New Jersey
TheOnlyJoric: hey george hope you're having a good one bro
jimmyadaro: How much competitive is AI self-driving cars sector?
Tyrant_01: are you going to stream more now? i want to subs
toront0saur: BLOW IS THE BEST
b2kemann: are you a GOLD COINER?
igg44705: @georgehotz how can i meet you?
anotherkidnamedaustin: collective conscious theory thoughts?
theonlymonkas: do you sleep on the kithchen?
linkrager: do you think people are inherently "winners" and "losers" in whatever they do
TeaLeafi: indica or sativa????
nitrixen: @georgehotz How do you avoid procrastinating?
ggtom: are you a COOMER?
Ayyyy420Lmao: do you know about chainlink and sergey nazarov?
blondephilia: @christianthefalco They're incompetent and falling apart. You can believe whatever you want. Give it 20 years.
benchai18: Damn. U don’t eat ass????
bytebacon: Quantum computing next stream
TeaLeafi: are uy a coomer?
doctorgenus: is ur interviews a bunch of leetcode questions?
nic0latesla: do you have bitcoin?
TeaLeafi: are u a coomer?
C0deCane: LUL
ggtom: TeaLeafi helo fellow COOMER
anotherkidnamedaustin: thoughts on collective conscious theory??
jimmyadaro: Who doesn't eat ass? I will eat your mother
TeaLeafi: @ggtom hello!
opus_000: how do I make 100k this year
likespuppies: Favorite genre of porn?
nizero: George I tried to talk to at defcon but you didn't want to talk to me
voxelfox0125: Guys if you want to learn game hacking learn here. https://guidedhacking.com/
Ayyyy420Lmao: foot fetish yay or nay?
benchai18: @jimmyadaro Don’t forget my sis
ggtom: lmao
christianthefalco: @blondephilia not very actionable but good luck with your investments. Don't make it a personality trait tho lol
anotherkidnamedaustin: thoughts on collective conscious theory??? we all share the same conscious in my opinion
tybutnowyoudie: what do you think of comma offering affirm as a payment option?
MrTriharder: D:
jimmyadaro: @benchai18 Aight
zennydmt: what was your worst subject in high school
deva73: should i create a twitchj bot to ban all CRYPTO USERS😡
CheeseManUchiha: jailbreaking the simulation is one of my favorite 'talks'
CoachMeech: @georgehotz why san diego?
ahahahaitslit: the way i am
jimmyadaro: @CheeseManUchiha WTF
GoodOlSmokey: but i cant take a shit in the bathroom without
peter35_: his best song imo
blondephilia: @christianthefalco very actionable. People make their living off of marketing this in various ways. Which is why I ask about crypto.
nizero: you were sorta in the zone in CTF competition
Cazaa_: ufff nicee
0R4NG3: PogChamp
jellyjar: damn george got bars
theonlymonkas: boy about to drop some bars
l1ght5p33d: get it
Ayyyy420Lmao: sick rhymes
xSynchronizeD: PogChamp white eminem
Saltyballss: PogChamp no doubletime
plumydev: yo geohot!
localcanofdutchgold: rap god Pog
alameda13: favorite childhood video game @georgehotz
MrTriharder: PogChamp
TeaLeafi: white rappppper lmaooo
braininavatt: TwitchLit TwitchLit TwitchLit
0R4NG3: PogChamp 🔥
benchai18: George. I’m at the side door
TeaLeafi: oooooof
ideology_sniffing_raccoon: new geo track PogChamp
Cazaa_: ufffffff
jimmyadaro: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
CheeseManUchiha: SourPls
ackxhpaez: How to judge if a start up is going to be successful?
jimmyadaro: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
ad_1337: TriHard
TheLastMrX: wow
braininavatt: CurseLit CurseLit CurseLit
theonlymonkas: LUL BARS
rustduck: TriHard 🔥
cellophane11578: 4Head
benchai18: IN THE AIR
jimmyadaro: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
TeaLeafi: oooof
jimmyadaro: dayumn
MrTriharder: NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp
TeaLeafi: FIRE
anotherkidnamedaustin: id love to know your thoughts on collective conscious theory??? we all share the same conscious in my opinion...
jimmyadaro: fireaf
wholesome_pepe: moms spaghetti
jimmyadaro: NotLikeThis PogChamp
MrTriharder: NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp NEXT SLIM SHADY PogChamp /
travbicklee: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
theonlymonkas: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis PogChamp PogChamp PogChamp
THX1342: have you ever tried paragliding?
TeaLeafi: nahhhh he aint
igg44705: @georgehotz so if i see you, i should't say HI?
Cazaa_: NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis
Landepbs: Are the trained models for OpenPilot publicly available?
benchai18: IM TIRED
doctorgenus: i came here for the rap, got what i came for
rndmsqnce: What's the last thing that made you angry?
jimmyadaro: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
Cazaa_: DAAAMN!!!
TeaLeafi: nahhhhhhhhhhhh
solitarynative: was LUL
deva73: slim shady
andydavies11: Is OOP bullshit?
bytebacon: I was a child in the nineties Take a ride with me, while we all recall Walbo and prank phone calls Bumpers for your bowling ball And we be hittin' em all cause this is New Jersey And stay up late but still wake up early To get to school with your seat belt buckled Pokemon cards taught me how to hustle And kids wrote orgy on their backpacks What did that mean? When my parents left home for the evening Googling, I found a splash screen That asked me
jimmyadaro: NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp NotLikeThis PogChamp
Saltyballss: PogChamp white 50 cent
TeaLeafi: nahhhhhhhhhh
Ayyyy420Lmao: do the one where he writes a letter!!!
voxelfox0125: Browse around this website for 5min https://guidedhacking.com/
techtim123: Transcendence in our lifetime??
benchai18: CUZ I AM
TeaLeafi: moms spaghetti rip
theonlymonkas: baaaaaaaaaaaaaaaaaaaaaaaaars
ggtom: throwback to geohot raps
anotherkidnamedaustin: tomcr00se
TeaLeafi: cooooomer
jimmyadaro: nice
TeaLeafi: cooooooooooomer
Cazaa_: NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis
equipollent_z: nexySenpai
64pillars: do u think winners can become losers and vice versa
TeaLeafi: tomcr0000se
TeaLeafi: lmao
TeaLeafi: nah
bytebacon: RAP!
ggtom: TeaLeafi ah imma.. imma coooming
igg44705: @georgehotz so if i see you in the street i should't say HI?
benchai18: All I’ve learned is that George doesn’t eat ass
anotherkidnamedaustin: id love to know your thoughts on collective conscious theory???
jimmyadaro: @64pillars that's life
zwisch: do you use photogrammetry techniques at comm.ai or is it all DNNs?
ryanm0012: ketamine i must
rndmsqnce: What's the last thing that made you angry??
ggtom: lmao winner-loser mobility
nvda9: George you should make more music
T3chHS: Are there better rappers that you at comma.ai?
directrix13: Eminem just sounds like he's whining in all his music.
Ayyyy420Lmao: Eminem - Stan (Long Version) ft. Dido sing this one man
FriscoDeluxe: You been playing around with any 3D programming? like Vulkan or DX12?
theonlymonkas: will tomcr00se come back?
tajpouria: Godzilla
jimmyadaro: ResidentSleeper
nizero: George I tried to shake your hand but you said get away from me freak .. I don't want Corona
C0deCane: LUL who keeps asking these loser winner questions lol were all losers and winners at some point
tybutnowyoudie: do you get recognized a lot in public?
Exclamation_mark_CODE: New plan. Say hi to geo hotz in the street so he starts rapping PogChamp
pjayys77: any philosophy books
jimmyadaro: 4:20 here
braininavatt: if I see you on the street I will ask you for my toaster Kappa
doctorgenus: how do we pick up George Hotz lolol
m0ld_0n3rz: https://clips.twitch.tv/PoisedAmusedTurtleFeelsBadMan
rorhug: You should CALL some people on the stream
Nussinov: I would say "yoooooo" then raise my hand for a high five 4Head
bankzed: the most appropriate level of interaction in the streets is a head nod
Ayyyy420Lmao: foot fetish yay or nay?
nitrixen: @georgehotz How do you avoid procrastinating / stay motivated?
zwisch: do you use photogrammetry techniques at comm.ai or is it all DNNs?
bytebacon: GEORGE PLEASE SING COLD WAR SONG
anotherkidnamedaustin: collective conscious theory
anotherkidnamedaustin: ?
C0deCane: it you find a 5 dollar bill on the ground in my eyes your a fuckin champ
opus_000: fist bump and walk away
jimmyadaro: @braininavatt lmao
benchai18: Lotta dumb questions huh? He’s not ur guru folks. He’s brilliant, he’s fascinating, inspiring.... but he’s not fucking Siddartha
T3chHS: Are there better rappers than you at comma.ai?
64pillars: can you make art
Saltyballss: if your sitting in a bar and i would come over licking your forehead would be inappropriate?
rndmsqnce: What's the last thing that made you angry?
mikey9988: no cmonBruh
julien9877: yes PogChamp
igg44705: @georgehotz do you not like the spot light on you?
CoachMeech: LUL pls
Santiago_LHC: CALLS!
voxelfox0125: Browse around this website for 5min https://guidedhacking.com/
williamjennings1: lol
daxyxy98: new Shkreli PogChamp
Forest_Turner: CALL ELON
Saltyballss: call elon musk
Nussinov: call your viewers LUL
GoodOlSmokey: @georgehotz any suggestions on focus loss while studying?
anotherkidnamedaustin: https://www.instagram.com/georgehotz/
C0deCane: Egirl skype calls about corona virus @georgehotz LUL
equipollent_z: do you miss hacking challenges at all?
theonlymonkas: DO IT
martinkirilov: Say hi as long as you're not invading someone's personal space. Think about someone meeting you on the street and start talking nonsense out of nowhere, no bueno
Santiago_LHC: CALL OBAMA
b2kemann: georg the guru
Ayyyy420Lmao: boobs or ass?
andydavies11: is OOP bullshit?
anotherkidnamedaustin: collective conscious theory..
CoachMeech: stream zoom
jimmyadaro: @andydavies11 how?
solitarynative: @benchai18 hi, its me, siddartha :)
64pillars: do you have any artistic abilities
whycopper: Call ligma!
r0xtehem0x: Do you have a favorite CI system?
nremind: can we get a sub goal for you to voluntarily get covid for the stream?
Tyrant_01: HACKING OR PROGRAMMING ?
anotherkidnamedaustin: NO ANSWER MINE
Br4nnon: OOP Kreygasm
freshsoclean: do you miss WoW?
RunnerMD: @georgehotz for implementing ML/DL in medicine (Diagnosis based on MRI/CT etc) do you think you need to learn specifically Python (almost 0 knowledge) or you can do it in R (which I already know a bit).
pjayys77: you want to do that ... with chat...
igg44705: @georgehotz do you not like to be in the spot light?
TeaLeafi: Will coding be a thing of the past soon? Thank to machine learning? and automatic A.I?
anotherkidnamedaustin: thoughts on collective consciousness
benchai18: @solitarynative Nice tits
NetAce: OOP more like OOPS
doctorgenus: wait you said school is a scam, why are you starting a school?
rndmsqnce: What's the last thing that made you angry?
theonlymonkas: do you have elon musk phone number?
TeaLeafi: Will coding be a thing of the past soon? Thank to machine learning? and automatic A.I??
bytebacon: Is programming a scam?
TeaLeafi: Will coding be a thing of the past soon? Thank to machine learning? and automatic A.I????
anotherkidnamedaustin: GOOGLE IT
directrix13: @georgehotz if you're sitting at a bar and a person has a 30% chance of giving you Coronavirus what is the probability that you will regret your decision of going to a bar?
b2kemann: thoughts on jordan peterson?
jimmyadaro: @TeaLeafi What's "soon" for ya?
martinkirilov: you mean POOP?
THX1342: favorite exploit?
thecoder15: who do you look up to lately @georgehotz
TeaLeafi: Will coding be a thing of the past soon? Thank to machine learning? and automatic A.I? ?????
nvda9: @voxelfox0125 bookmarked. thanks
benchai18: Go watch Lex dude
blondephilia: Theranos LUL
voxelfox0125: Browse around this website for 5min https://guidedhacking.com/
cortickal: Is "Permutation City" the book you mentioned @georgehotz
unnamedtroll: what a time to be alive
TeaLeafi: @jimmyadaro next 5 years
theonlymonkas: favorite album?
Nussinov: this stream is a scam
THX1342: favorite exploit type?
jimmyadaro: @TeaLeafi Nah, we're fine
HalluCinogen151: over 1k per class
T3chHS: Are there better rappers than you at comma.ai?
doctorgenus: gotcha
MrTriharder: Says the guy who was in CMU LUL
l1ght5p33d: This stream is the only not scam
mikey9988: you used to play WoW ? LUL
blondephilia: *Harvard* and *Yale*
toront0saur: PEN TESTING AT COMMA ???
dyxx_pix: is cmu a scam?
anotherkidnamedaustin: lmao google collective conscious. youll like it
HalluCinogen151: Of stuff you can learn online
igg44705: @georgehotz is it because of the cost of harvard?
benchai18: Dumbass questions. Just wanna know if u fucking eat ass bro. I don’t care about hAxing
ahahahaitslit: have you read watchmen
l1ght5p33d: This stream is the least scam of anything
TeaLeafi: @jimmyadaro ooooof
anotherkidnamedaustin: mr meditation
b2kemann: like gucci is a scam
TeaLeafi: RAP BATTLE me!!!
zennydmt: how did you like Operating Systems from CMU?
Bootyclub: Opinions on Rust?
C0deCane: We'd have to get the data first
solitarynative: you should start a pseudo intellectual youtube movie critic channel
equipollent_z: covid RCE?
TeaLeafi: RAP BATTLE ME!!!!!!!!!!
CoachMeech: @georgehotz would you say you generally concur with Thiel on the education system ?
nvda9: George was a member of PPP team
dyxx_pix: was cmu a scam?
Ayyyy420Lmao: you got any original rap song??
MrTriharder: HARVARD AND YALE IS SCAM PogChamp Graduates from Carnegie Mellon LUL
PiroFloydian: RAP BATTLE PogChamp
birkett0011: What you think of simulation software? Anylogic / https://hash.ai/
b2kemann: it's just clothes!!!
realolejka: kendrick is the goat
jimmyadaro: @Ayyyy420Lmao Yep
NetAce: https://adventofcode.com/ - When Geo was asked how he defines if someone is good at coding, he recommended this as a starting point.
cellophane11578: bars sicker than sars
Bombapil0t: corona jailbreaked ?
theonlymonkas: favorite rapper
xxxelent: y pay for knowledge when the internet is a thing, y congregate to share knowledge when wiki literally is the sum of all human knowledge in one place, completely free
Nussinov: @georgehotz do you know anything about twitch or other twitch streamers?
anotherkidnamedaustin: def tomcr00se = goat print(tomcr00se)
zennydmt: Did you like the course Operating Systems from CMU
nizero: George have you heard of nerdcore rappers?
jimmyadaro: gucci gang?
tajpouria: What are u think about deno js
TeaLeafi: feeels
igg44705: @georgehotz do you have a degree?
doctorgenus: but when you hire, would you prefer someone with Harvard CS, over no degree
PiroFloydian: but it looks like a scam @georgehotz
unnamedtroll: taxes are a scam
pjayys77: King of the Doot
benchai18: George u ever had the clap?
b2kemann: gucci is just clothes!!!
anotherkidnamedaustin: Collective consciousness, collective conscience, or collective conscious is the set of shared beliefs, ideas, and moral attitudes which operate as a unifying force within society. In general, it does not refer to the specifically moral conscience, but to a shared understanding of social norms
techtim123: UV air scrubbers? ?
benchai18: I know u get around
jimmyadaro: @anotherkidnamedaustin Bullshit
worrasenule: code jam 2020?
realolejka: savage
Br4nnon: a real HS PogChamp
almonte550: how much do you make in twitch?
bankzed: speaking of scams, best streamer in the topic is kitboga
deva73: cool
cortickal: You might be interested in listening to Peter Thiel on university @georgehotz
CoachMeech: why are you plebs so obsessed with university
blondephilia: That's how you know collective consciousness is real. People still give Harvard credence.
nvda9: You can get into prestigious school donating hell lot of money.
itsxaos: is there any way to reduce the size of governenment/institutions without burning them down?
un3okapi: @georgehotz do you believe in love?
theonlymonkas: opinion on Gennady Korotkevich
anotherkidnamedaustin: @jimmyadaro collective conscious is bullshit?
bytebacon: Richard Dawkins exposes quantum charlatan Deepak Chopra: https://www.youtube.com/watch?v=jfVIl1UUQns
nitrixen: @georgehotz How do you avoid procrastinating / stay motivated?
solitarynative: read jed mckenna
TeaLeafi: same with Google?
jimmyadaro: @itsxaos Minarchism??
Jehhred: Have you read 'The Fifth Science'??!?!?!?!?
jimmyadaro: @anotherkidnamedaustin Yep, it's
dyxx_pix: does legacy count for cmu admissions
CoachMeech: throwing a big leather ball usually helps as well
zennydmt: do you keep in touch with siraj raval/ He asked you 73 questions right at the party?
nic0latesla: please explain how you hacked sony
Ayyyy420Lmao: have you read stuff by hans herman hoppe?
martinkirilov: @nitrixen Wrong person to ask :D
deva73: knowing people like know who?
cortickal: Richard Dawkins is a charlatan too
equipollent_z: have you seen any good computer architectures?
PiroFloydian: LUL
benchai18: William H Macy can get u a degree
tajpouria: do u believe in god
MrTriharder: Gennedy Korokevik monkaS
nvda9: he worked at Google as a security engineer
igg44705: @georgehotz would you say you love your life?
birkett0011: @georgehotz What you think of simulation field?
almonte550: How much do you make in Twitch?
C0deCane: Hows North Korea doing right now
anotherkidnamedaustin: @jimmyadaro good one
ahahahaitslit: his name is tourist?
pjayys77: wonder if MIT is a scam
anotherkidnamedaustin: what have u read on it? the wiki?
Ayyyy420Lmao: @pjayys77 ask terry davis
jimmyadaro: @anotherkidnamedaustin I've talked enough about that to know it's bs
dyxx_pix: what r the chances that u read my messages
Bombapil0t: Let’s take this out of the courtroom and into the streets
wholesome_pepe: do u get into natural language processing or just visual stuff?
anti_natalist: @anotherkidnamedaustin would a shared set of beliefs and morals just be genetic and environmental rather than some collective immaterial conssciousness?
dyslexicat: banned monkaS
bytebacon: Who is you favourite prof?
techtim123: book suggestions??
theonlymonkas: favorite album
MrTriharder: @georgehotz Comma.ai planning to expand in North Korea?
blondephilia: I care :)
C0deCane: @georgehotz change your nickname to biohots until corona is over
Ayyyy420Lmao: do you know about TempleOS and terry davis?
jimmyadaro:  -1000 per month?
Br4nnon: sentient ai
voxelfox0125: something really funny https://guidedhacking.com/forums/wall-of-shame.462/
nvda9: are you single now?
TeaLeafi: what do you do for fun?????????????????????
YoungGuns_: are you still going for your instagram goal? @georgehotz
tajpouria: we care bro
TeaLeafi: are u single?&gt;
Bootyclub: @georgehotz What do you think about Rust?
likespuppies: What's your favorite genre of porn?
igg44705: @georgehotz can you not work and still live the same lifestyle?
zennydmt: what do you think of siraj raval
bytebacon: Do you read books?
theonlymonkas: we care
Saltyballss: i just subscribed for older videos tbh LUL
TheOnlyJoric: this stream is one of the better ones, very interesting and i like a lot of the discussion
Maizlow90: @georgehotz https://www.karger.com/Article/FullText/89211
Ayyyy420Lmao: do you know about TempleOS and terry davis? if not google it srsly
tybutnowyoudie: What do you think of affirm?
realolejka: @jimmyadaro guee it's 100 dollars
YoungGuns_: fuck instagram @georgehotz
Bombapil0t: instagram 2019 DansGame
0R4NG3: lol
theonlymonkas: favorite song
equipollent_z: what's your favorite wargame of all time?
Hawklite: should prostitution be legal
64pillars: fav most recently released song
FriscoDeluxe: You been doing any 3D programming? like Vulkan or DX12?
jimmyadaro: @realolejka Or 10
TeaLeafi: are you single??????????????
rorhug: You have the checkmark!
rorhug: chekc it
efthemess: efthemess subscribed at Tier 1.
b2kemann: you do have a wikipedia though
Nussinov: @georgehotz what are your viewer demographics?
martinkirilov: you don't even post at instagram
C0deCane: @Ayyyy420Lmao he has like videos that are streamed on twitch i have seen them before
TeaLeafi: pay 10k for a check mark!!!!!!!!!!!!!!!!!!
bytebacon: Do you have book shelf?
AresRai: why not have a personal checkmarked twitter acc @georgehotz
anotherkidnamedaustin: @anti_natalist so u deeply believe in the we all came from a single cell scam
whycopper: Pls say hi to me hehe
igg44705: @b2kemann true that
doctorgenus: wait, I thought you use linkedin as your dating profile!!!
jimmyadaro: We need more rap @georgehotz
nvda9: lol
TeaLeafi: pay 10k on instagram they will give you blue check mark
theonlymonkas: the checkmark is there lol
likespuppies: @georgehotz How much of what you think and say is original?
Exclamation_mark_CODE: just get a checkmark on StayHomeHUB
AresRai: why not have a personal checkmarked twitter acc ? @georgehotz
anotherkidnamedaustin: @jimmyadaro how is it bullshit
anotherkidnamedaustin: ur answer is vague
andydavies11: Do you like sports?
Ayyyy420Lmao: do you know about TempleOS and terry davis? if not google it srsly
deva73: dude whats a scam and whats not?
martinkirilov: @aresral he has one
anti_natalist: @anotherkidnamedaustin as opposed to what? a divine creator?
dyxx_pix: do u think cmu was a scam?
nizero: @georgehotz do you need any data labeled?
rorhug: You have the public figure checkmark. Look at it
voxelfox0125: something extremely funny https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
TeaLeafi: hoookers!!! they are fun!!!
jimmyadaro: Sports or e-Sports??
igg44705: @georgehotz are you rich? cold war rap was amazing
solitarynative: lamda school good or no
wholesome_pepe: just hack instagram Kappa
CoachMeech: nah
TeaLeafi: hoookers are fun!!!!
jimmyadaro: @solitarynative Nah
PiroFloydian: What if something tells you its a scam @georgehotz ?
braininavatt: PogChamp
blondephilia: nah
TeaLeafi: hookers are fun what you mean????!!
braininavatt: congrats
nvda9: tomcr00se is cool. you should make more George
braininavatt: Kappa
l1ght5p33d: Nah
Br4nnon: lmfao
blondephilia: you have it bro :)
64pillars: lol
Br4nnon: scuffed checkmark
Bombapil0t: You’re fucking with the dude who got the keys to your safe. that was such a beautiful time back then.
theonlymonkas: you can get that checkmark yourself George!
YoungGuns_: budget checkmark
bokeee_: lmao
benchai18: They do. My friends from 90 Day Fiancé have it
Chrimo: Youre a public dude
jimmyadaro: LUL LUL LUL LUL LUL LUL LUL
localcanofdutchgold: scammed OMEGALUL
THX1342: LUL
AresRai: LUL
evnomics: lmao
b2kemann: looool
CoachMeech: lmao they clowning on your ass bro
dyxx_pix: ahhahahahhahaa
dorkmo: TROLLFACE
itsxaos: LUL
TeaLeafi: SCAMMMED
jimmyadaro: LUL LUL
dyslexicat: not even a checkmark LUL
equipollent_z: LUL
jimmyadaro: LUL LUL LUL LUL LUL
almonte550: You are half verified!!!!
tybutnowyoudie: 50% check mark
xSynchronizeD: BTEC CHECKMARK LUL
TeaLeafi: SCAMMMMEd
Bombapil0t: scam
jimmyadaro: LUL LUL LUL
dyxx_pix: get scammed
braininavatt: YOU DID IT!!!!! VoHiYo
rndmsqnce: anyone can write public figure
reckful_bald_spot_114: LUL
phrixus_bro: public figure hell yeah playboy
TeaLeafi: SCAMMMMMM
4FUN_PLAYER: scuffed check mark
Ayyyy420Lmao: scammed
ConnorMusarra: that just means you have a business account
TeaLeafi: SCAMMMMMEd
THX1342: "Not Good Enough" SeemsGood
TheLastMrX: LUL LUL
b2kemann: you're not worthy yet
TeaLeafi: SCAMMMMMEd lmaoooooooooooooooo
whycopper: Lmfaoooo
costcospizza: they did u dirty
doctorgenus: close enough
travbicklee: scammed
tajpouria: yeah half check mark
peter35_: we must chimp
williamjennings1: isnt it becuase you have a business account
doctorgenus: it'll impress girls
itsxaos: now THIS is a scam
benchai18: That’s the aspergers check
TeaLeafi: dirty my boy
ConnorMusarra: thats designated by you not instagram
deva73: budget check mark lol
voxelfox0125: something extremely funny https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
CheeseManUchiha: public figure andy
almonte550: You are not worth a full check mark
zennydmt: have u met mark zuckerberg
nvda9: hahaha
roystang: @georgehotz can you even do the fibonacci bro
Saltyballss: so instagram is a scam
THX1342: LUL
theonlymonkas: means you are almost famous
ImJ4Gu4R: how dare facebook dont give geo blue checkmark
TeaLeafi: AHHAHAHAAHAHHAHAHAHA
hastingspb: what is the good music @georgehotz
jellyjar: big surprise
jimmyadaro: LUL LUL LUL LUL
benchai18: Nice pic bro
theonlymonkas: LUL
ImJ4Gu4R: fak em
tybutnowyoudie: surprise
TeaLeafi: 92 male
Exclamation_mark_CODE: consolation checkmark so you stop complaining Kappa
ideology_sniffing_raccoon: squadW
pjayys77: participation trophy
aaaakshat: LUL
doctorgenus: just show girls your wikipedia
techtim123: book suggestions??
christianthefalco: 7% are Trans
mikey9988: LUL
4FUN_PLAYER: LUL
CoachMeech: hahaha
FriscoDeluxe: 5% troll men
igg44705: @georgehotz you need to verify your ID to get the cheak mark
TeaLeafi: 92 male muahhahaha
haircutjimmy: hi George
dyxx_pix: do u like logic, the rapper
TeaLeafi: AHAHAHAHAHAHAHAH
janpoonthong: Apple Or Samsung? And Why?
brownyyyylocks: @doctorgenus nope
solitarynative: I'm trans girl
nvda9: lmao
blondephilia: just like Google huh LUL
jimmyadaro: C.O.D
inciMage: not enough
nremind: you have to suck off zuck to get the checkmark @georgehotz
anotherkidnamedaustin: lol people believe in the single cell origin scam
b2kemann: 8% is alot of fish
ahahahaitslit: i'm surprised it's not 100%
CoachMeech: KILL ALL MEN
TeaLeafi: im a GIRL
birkett0011: @georgehotz Simulation software like this https://www.anylogic.com/ cost like $20,000  per license all java back end and is dumpster to use
equipollent_z: do you still work on Qira?
TeaLeafi: IM A GIRL!!!!
benchai18: George how tall r u
Cazaa_: fuck instagram and fuck society
jimmyadaro: Hey, sports or e-sports? @georgehotz
TeaLeafi: IM A GIRL!!!
dyxx_pix: do u like logic, the rappe
Ayyyy420Lmao: do you know about TempleOS and terry davis? if not google it srsly
nvda9: true
Nussinov: bitches love wikipedia
ConnorMusarra: just apply for verification and send them 3 pieces of recent press about you
christianthefalco: IM A GIRL!!!!
TeaLeafi: IM A GIRL!!......
Jehhred: How much would you pay for a checkmark??!?!?!?!
christianthefalco: IM A GIRL!!!!!
voxelfox0125: something extremely funny https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
TeaLeafi: IM A GIRL!!........
TeaLeafi: IM A GIRL!!...........
almonte550: IM A GIRL!!!!
TeaLeafi: IM A GIRL!!.............
theonlymonkas: favorite rapper
4FUN_PLAYER: IM A GIRL
solitarynative: I have a feminine penis :)
christianthefalco: IM A GIRL!!!!!!
benchai18: I met eBays Chief diversity Officer. SUCH A LAME JOB
Bombapil0t: DansGame
anotherkidnamedaustin: do we exist, or do we think we exist which makes us exist?
nizero: why are Instagram dms the way to get girls these days... seems sorta strange
realolejka: public figure badge isn't even clickable at mobile
LordDankington: IM A GIRL
TeaLeafi: IM A GIRL!!...........
martinkirilov: IM A GIRL
whycopper: My dick big but I’m a girl
itsxaos: TITS OR GTFO
janpoonthong: Apple Or Samsung? And Why?
almonte550: IM A GIRL!!!!!!!!!!
rustduck: HotPokket me
jimmyadaro: "This is my girl penis" like Shameless hahahaa
C0deCane: @georgehotz I heard that people under 5'11'' are more at risk
dyxx_pix: lmfao @whycopper
solitarynative: IM GRIL
roystang: im a girl i rpomise
benchai18: GEORGE WHAT HAPPENED TO ELISA LAM
thecoder15: lolz
bokeee_: girl huh atpDog
vix_dev: GIRL stands for Guy In Real Life
doctorgenus: these girls gold diggers
theonlymonkas: LUL
equipollent_z: :D
Br4nnon: iM aLsO a GiRl
bojosos: Have you ever used Emscripten?
benchai18: @georgehotz seriously. Elisa Lam. Investigate
igg44705: @georgehotz DO YOU LIFT BRUH? or martial arts? or anything physical? sky diving?
pjayys77: there is suddenly a lot of girls in the chat, diversity solved
TeaLeafi: George take me on date &lt;3? i will show you a good time! &lt;3
Saltyballss: im divers
zennydmt: are ur family members into tech like you?
TeaLeafi: George take me on date &lt;3? i will show you a good time! &lt;3!
nvda9: hahaha
whycopper: Lmfaaaooooo
TeaLeafi: George take me on date &lt;3? i will show you a good time! &lt;3!!
toront0saur: TITTS OUT FOR THE BOYS!
benchai18: @georgehotz FOR REAL. CAN U INVESTIGATE MYSTERIES LIKE ELISA LAM. SERIOUSKLY
Cazaa_: you dont need that , you are a fucking god mann wtf
benchai18: ELISA
bytebacon: DO YOU HAVE SIBLINGS
rustduck: monkaS
jimmyadaro: WHAT
Br4nnon: drugs
benchai18: yes
TeaLeafi: George take me on date &lt;3? i will show you a good time! &lt;3!!! &lt;3
GoodOlSmokey: communist retroviruses are worse than non communist ones?
Nussinov: monkaS
K177: Lmao you call yourself a [insert streamer] fan? I'm fucking loaded on channel points bro. I highlight every message because I'm just that jacked. Try talking in chat again when you're a true fan
braininavatt: monkaS
dyxx_pix: geo can u calculate the probability that you will get corona
Lieutenant_51: FeelsBadMan
likespuppies: @georgehotz Favorite meat?
btpisroot: Advent of Code was what was mentioned earlier correct? Never looked at it before, but it seems interesting.
shieeeeeeeeet: @georgehotz do you use any note-taking apps to manage your thoughts/backlog?
anotherkidnamedaustin: i got my college paid 100% for, so i scammed them technically. studied for MCAT and didnt take it
jimmyadaro: @GoodOlSmokey Sure
voxelfox0125: something extremely funny https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
equipollent_z: have you ever studied Complexity Systems Science?
THX1342: is she the chick from the elevator?
TeaLeafi: okay
aaaakshat: you might need to purchase the 1m2020.com domain
benchai18: Watch the video
Ayyyy420Lmao: how many of decimals of pi do you know?
andydavies11: will there ever be a boy born who can swim faster than a shark?
TeaLeafi: hunnnnny
birkett0011: LUL
theonlymonkas: D E E P
CoachMeech: hahahahaha
b2kemann: loool
benchai18: U can
jimmyadaro: @shieeeeeeeeet Markdown files
MrTriharder: @georgehotz Linkedin vs Tinder for dating?
b2kemann: networking
alanantonio1234: ola
pjayys77: the water tank?
TeaLeafi: okayyyyyyyyyy
b2kemann: the right way
benchai18: Watch the video of her in the LA hotel
nvda9: George, are you a wizard?
TeaLeafi: i TAKE IT DADDDY &lt;3
Ayyyy420Lmao: how many decimals of pi do you know?
aaaakshat: we need 1 million followers on insta by 2020
dyxx_pix: can u calculate the probability that u will get covid-19
anotherkidnamedaustin: i took that shit. high school was easy 4.0 clap and got full ride to iowa
TeaLeafi: i TAKE IT DADDDY &lt;3 &lt;3
anotherkidnamedaustin: scammed them
solitarynative: like?
alanantonio1234: soda
jimmyadaro: @MrTriharder Linkedin is not for dating mf
Nussinov: I used to scam people in runescape
TeaLeafi: i TAKE IT DADDDY &lt;3 &lt;3 &lt;3
doctorgenus: what's the take from college?
zennydmt: bumble?
Br4nnon: tinder used to be decent
christianthefalco: START
likespuppies: Computer science degree is being on the take :)
Nussinov: trimming armor Kappa
zennydmt: is bumble any good?
MrTriharder: @jimmyadaro Linkedin is lowkey dating
aaaakshat: you should try grindr
tajpouria: good night
bankzed: it's all about hinge Kappa
jimmyadaro: Sports or e-sports?
b2kemann: but is stem at harvard a scam?
TeaLeafi: GRINDR
jimmyadaro: @MrTriharder Fuck nah
K177: LOL
anotherkidnamedaustin: be a scammer so u dont get scammed. its simple, and turn off the stupid movies and study
Hawklite: comma.dating
evnomics: TRUE
pjayys77: mhmm go on
K177: HotPokket sexist
theonlymonkas: and being on the take can give you some opportunities?
dyslexicat: true LULW
kernelimage: It’s true!!
equipollent_z: comma dating
whycopper: What about pornhub premium?
dyxx_pix: can u calculate the chances that u will get covid-19
braininavatt: they have done it
bojosos: Make CommaDate or OpenDate or something
Ayyyy420Lmao: comma tinder
jimmyadaro: comma.dating !!!! lmao
jimmyadaro: Sports or e-sports?
Jehhred: My Christian Mingle account is lit though
igg44705: @georgehotz what do you think about stoicism?
christianthefalco: Dead On Arrival
MrTriharder: HotPokket EQUALITY
deva73: that genius
kernelimage: Apps disgust me
AresRai: comma.dating
Srule: poor people single forever :-(
ConnorMusarra: Raya is trying
almonte550: dating.comma.ai
aaaakshat: comma.ai/dating
zennydmt: so real life is better than dating apps?
aaaakshat: XDD
bytebacon: Time for Comma.sex?
narkoSays: apart for men who don't wanna pay money 4Head
Saltyballss: comma . onme Kappa
equipollent_z: this joke is going to turn into the largest profit lol
bankzed: SF bars or NYC bars?
ideology_sniffing_raccoon: sqquadW Reverse the roles
rndmsqnce: raya isnt bad
almonte550: comma.onme
Jehhred: 70/30 sounds better
aaaakshat: cum.ai
l1ght5p33d: still 95% men
dyslexicat: Saltyballss Kappa
almonte550: HAHAHAHAHAHA
Lieutenant_51: comma.ai/dating invest now
anotherkidnamedaustin: So being born a male, is a SCAM?
bojosos: And a CommaFold would go a long way
nremind: I thought that's what usually happens except men buy premium or whatever
MrTriharder: @georgehotz whats with this gender discrimination?
THX1342: LUL
jimmyadaro: cum.ai LUL
igg44705: @georgehotz thoughts on stoicism?
tajpouria: how to identify men and women
tybutnowyoudie: that's sexist
whycopper: @georgehotz is phub premium a scam you think?
jimmyadaro: Sports or e-sports?
TeaLeafi: AHAHHAAHAHAHAHAH
TeaLeafi: GRNDRR
toront0saur: BUMBLE
benchai18: @georgehotz If u investigate mysteries the same way u learned bio, you’ll pull 5000 subs easily. Like Death of Elisa Lam.
ShredderSherlock: they could pay women to be on there
christianthefalco: It's effectively that way with premium memberships
bankzed: SF bars are 1% to 99% and NYC is 55% to 45%
Srule: What if my dating app doesn't have enough white people? Should I start charging minorities?
likespuppies: @georgehotz You can only eat one animal for the rest of your life, which one? Not cow
anotherkidnamedaustin: x and y chromosome
GoodOlSmokey: what time is it there?
reckful_bald_spot_114: that would be your typical sex worker website
K177: LOL
PiroFloydian: now youre just skewing wealthier men @georgehotz
TeaLeafi: women are scamms
TeaLeafi: women are scams!!!!
christianthefalco: @ShredderSherlock i'd sign up 100 women profiles
jay_al97: @georgehotz then it will be a place for gold diggers
K177: gachiHYPER
solitarynative: what are you experiences with grindr?
itsxaos: but how do you handle bi
tybutnowyoudie: what if I am trans? I have to pay 50%?
Br4nnon: online dating sux
blondephilia: u get sued
PiroFloydian: Gay people exist?
jimmyadaro: Sports or e-sports?
anotherkidnamedaustin: its 2020 the gender lines are blurred @georgehotz
TeaLeafi: gay people lmaooo
itsxaos: youll have to make a straight only app
AresRai: different business
im_francuzz: when you create they could ask for the identity card @georgehotz
bokeee_: ROFL
zennydmt: so whats the best way to meet people real life?
anotherkidnamedaustin: gotta be specific x and y chromosome
CoachMeech: so easy to get a bj on grinder
TeaLeafi: im a top &lt;3
theonlymonkas: you can get that checkmark yourself!
CheeseManUchiha: KappaPride
ideology_sniffing_raccoon: go on Grindr
Srule: Adultfriendfinder uses your payment strategy
PiroFloydian: nonbinary people exist
K177: but i'm an attack helicopter, which gender do i fit in 🤔
dyslexicat: KappaPride
jimmyadaro: Sports or e-sports??
Ayyyy420Lmao: how many decimals of pi do you know?
0R4NG3: win win KappaPride
PiroFloydian: bi people exist too
voxelfox0125: This will either piss you off or make you laugh. https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
bankzed: there are no such thing gay tops, it's all bottoms KappaPride
pjayys77: seems you put a lot of thought into this
TeaLeafi: imagine being gay lmao
c1tr0n75: @georgehotz do you think you will get to do another hackthebox ? that shit was fun man
dyslexicat: PiroFloydian that's cool and they can use another app to find dates
rndmsqnce: any good dates lately
MrTriharder: Fucking homophobic guy in chat Dansgame
itsxaos: are traps gay?
TeaLeafi: comma.dating
likespuppies: @georgehotz Lamb or steak?
synoborg: do you remember everything you read?
nvda9: Illegal life pro tips: try tinder if you are beside the army campus.
TeaLeafi: comma.bio
joiput: PogChamp
aaaakshat: women were invented by porn companies to make more porn
b2kemann: when are we doing a haskell stream??
64pillars: comma.comma
Gapzyy: whats your take on religion
almonte550: If I beat you at chess can I get hired in comma ai?
bayarealove: My current and last girlfriend I met on bumble, and I've hooked up with a couple girls from tinder
anotherkidnamedaustin: do you believe in coincidences?
jimmyadaro: Comma Pharma
ideology_sniffing_raccoon: PogChamp
Ayyyy420Lmao: @itsxaos this. are traps gay?
K177: Kappa
Lieutenant_51: cum.ma PogChamp
Nussinov: when are we getting comma.gg for your version of twitch
janpoonthong: Apple or Samsung and why?
MrTriharder: &lt;3
barkazzaz: Kappa
benchai18: @georgehotz if u investigate unsolved mysteries while streaming, you’ll get thousands of subs instantly ‼️ ‼️ ‼️
K177: aha Kappa
christianthefalco: @georgehotz are you actually looking for people with Chemistry/Coding background?
bojosos: Do you know what to 2^31 is?
vix_dev: that's what I need, ML algorithms to pick my next date
jimmyadaro: :clap:
TeaLeafi: at a boy
evnomics: Pogchamp
TeaLeafi: you tell them
igg44705: @georgehotz what are your biggest regrets?
TeaLeafi: &lt;3
realolejka: i identify myself as attack helicopter
ideology_sniffing_raccoon: sounds good
deva73: commaTREES
theonlymonkas: do you sleep on the kitchen?
codsane: comma.xxx
aaaakshat: this stream is the coronvirus equivalent of pillowtalk
MrTriharder: @georgehotz @TeaLeafi BAN THIS GUY DansGame
blondephilia: I'm grabbing the domain
b2kemann: when are we doing a haskell stream?
theonlymonkas: SeemsGood
TeaLeafi: @MrTriharder why?
ab289528: @realolejka LUL
dorkmo: lots of mantinance
solitarynative: HotPokket
nizero: georgehotz did u like ur long vacation in Asian last year
K177: ptsd D:
Scydra_: @georgehotz can you give a quick summary of what your company does?
MrTriharder: HotPokket
ahahahaitslit: rip kobe
TeaLeafi: @georgehotz ban this guy @MrTriharder
dyslexicat: it's a sad life FeelsBadMan
Nussinov: their gunna fill you with gas
likespuppies: @georgehotz Sweat bums on your face
almonte550: I identify as a coronavirus
dyxx_pix: can u calculate the chances that u will get coronavirus
anotherkidnamedaustin: ptsd is a scam
CoachMeech: OCAML IS GOD
K177: PepeHands
jimmyadaro: Sports or e-sports? Come on LUL
yourdailydoseofcocaine: Tolerate everything except intolerance ~ George Holz. I love it!
timi13462: top 5 tv shows
TeaLeafi: @georgehotz ban this guy @MrTriharder his being mean
yevheniiushtyk: Can you play any instrument?
realolejka: pepoCry
Nussinov: pump me full of fuel daddy Kreygasm
64pillars: the real unsung heroes of
K177: melt beams don't melt jet fuel
benchai18: @georgehotz if u investigate unsolved mysteries while streaming, you’ll get thousands of subs. I’m serious. You’re a google rabbit hole wiz
zennydmt: do you play online multiplayer games?
bankzed: or you can be sold to a warring country
rndmsqnce: tell us your worst date story
equipollent_z: what do you think of emergence &amp; self-organization?
likespuppies: helicopter, strong men rubbing you down with grease :)
theonlymonkas: do you sleep on the kitchen?
toront0saur: can i invest in comma.ai ?????
itsxaos: whats your lichess @ georgehotz
pjayys77: warrant officers is the way to go tho
LordHord: More hackerrank?
dyxx_pix: do u like the rapper logic
ahahahaitslit: have you used ocaml
almonte550: I identify as a coronavirus
doctorgenus: on your break, what did you do besides drugs and learn coq?
bytebacon: are you a liberal
timi13462: top 5 tv shows?
TeaLeafi: comma.notascam
whycopper: Let’s play rocket league @georgehotz
jimmyadaro: I cannot tolerate… mosquitoes
tajpouria: How i can buy a comma2 from iran ??
likespuppies: show us your bed PogChamp
yourdailydoseofcocaine: I identify as a hoooman
TeaLeafi: comma.notascam lmao
Scydra_: @georgehotz can you give a quick summary of what your company does?
K177: LUL
TeaLeafi: comma.notascam
b2kemann: haskell stream soon?
MrTriharder: @georgehotz One game of twitch tic tac tr
nozoke: Question for your opinion - Why are most billionaire startups started from individuals that attend prestigious universities regardless of finishing or not? @georgehotz
shieeeeeeeeet: how's backspace.ai doing?
nitrixen: You're obviously smart. How do you stay motivated?
nvda9: George have a look at that ThePersonDoesNotExist.com
equipollent_z: Rule 34 COVID-19?
anotherkidnamedaustin: @georgehotz do you think the past and future are illusions?
rndmsqnce: tell us a bad date story
bojosos: Have you ever been scammed?
voxelfox0125: This will either piss you off or make you laugh. https://guidedhacking.com/forums/wall-of-shame.462/ browse normal threads.
K177: D:
Jehhred: Comma 2 to Australia?!?!!?!?1
zeus13i: lol 'no'
TeaLeafi: comma.notascam &lt;3
igg44705: @georgehotz can i use comma 2 in india?
benchai18: if u investigate unsolved mysteries while streaming, you’ll get thousands of subs so fast
solitarynative: quick rundown&gt;
rndmsqnce: or a good date story
jimmyadaro: "So why comma.ai? Because you want to do something with your life. You want to see progress being made. You want to change the way the narrative will play out. You are bored, and want the world to be less boring. And at the end of the day, you want to win."
l1ght5p33d: lol 'no'
timi13462: top 5 tv shows??
ideology_sniffing_raccoon: $$$$$
zwisch: do you use photogrammetry at comma?
Bootyclub: Any plans to support more Subaru models for the Comma 2?
ahahahaitslit: have you used OCAML
theonlymonkas: have you ever been scammed?
christianthefalco: they were smarter?
janpoonthong: you look like Gordon Ramsay
toront0saur: CAN INVEST IN COMMA ???
AresRai: @christianthefalco LUL
anotherkidnamedaustin: what came first, time or the universe? like the planck era times
CoachMeech: OCAML IS GOD
bytebacon: Who is smarter? Elon Musk or Mike Tyson
PiroFloydian: lol
opus_000: solve oak island
nvda9: https://www.thispersondoesnotexist.com/
zennydmt: who is the most intelligent person you look up to
THX1342: comma.spy
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
doctorgenus: so the take from university is connections for VC funding?!!
CheeseManUchiha: hotz decodes the pyramids
deva73: did the college education help them in what they do at work
peter35_: clintHard
anotherkidnamedaustin: what came first, time or the universe? like the planck era times..?
lightofhel1: Scooby Doo Hotz
igg44705: @georgehotz does the comma 2 work in india?
TeaLeafi: ima INVEST!!!!
K177: PogU
cybergenik: !discord
TeaLeafi: IMA INVEST!!!!!!!
ideology_sniffing_raccoon: PogChamp
Br4nnon: discord linkkkk
AresRai: !discord
TeaLeafi: discord link!
cybergenik: whats the discrod?
benchai18: What’s the discord link
TeaLeafi: !discord
jimmyadaro: !discord
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
benchai18: !discord
CoachMeech: y'all some plebs
MrTriharder: FeelsBadMan
yourdailydoseofcocaine: This is my first time on this stream but I’ve watched a lot of your videos before. Thank you it’s great so far! Shit talking and not doing anything but also doing a lot! Only on George’s stream
ideology_sniffing_raccoon: !discord
martinkirilov: Because most of them have more capital from their relations and links
gobk0: !time
itsxaos: https://discord.comma.ai/
limpid_kzonix: how your researching in theorems proving is going?)
itsxaos: https://discord.comma.ai/ boys
anotherkidnamedaustin: what came first, time or the universe? like the planck era times?
YoungGuns_: @georgehotz do you like scooby doo or nah
Ayyyy420Lmao: u live in SF?
benchai18: @itsxaos Legend
bytebacon: Why did you name it Comma?
nic0latesla: Do you like Bug bounty program?
igg44705: @georgehotz would comma 2 work in india?
toront0saur: PERFECT. WHAT IS THE DISCORD ?
TheLastMrX: @georgehotz why you just dont make a bot to answer this simple questions ?
TeaLeafi: !discord link???
TeaLeafi: whgats the discord??????????
MrTriharder: @georgehotz Why SF of all cities?
codsane: https://discord.comma.ai/ fellas
nozoke: Ty for answering :)
MrTriharder: @georgehotz Why SD* of all cities?
TeaLeafi: thaml ypu
ahahahaitslit: have you used ocaml
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
dima_lanski: Which trajectory?
brownyyyylocks: legend KappaRoss
THX1342: too much bs in the vc world..
b2kemann: humans making everything into a soscial game
Br4nnon: monkaS
dyxx_pix: what do u think abt graph networks
peter35_: is anime degenerate?
techtim123: Book suggestions??
MrTriharder: monkah
itsxaos: LUL
theonlymonkas: favorite album
brownyyyylocks: keep at it we'll support comma!!
TeaLeafi: nah nah we will never
K177: l0l
nvda9: this is ai powered web, generates pictures of people who doesn't exist
tybutnowyoudie: monkaS
TeaLeafi: monkaS
anotherkidnamedaustin: how can the universe have an age if time is relative? these are the things i want to talk about
nvda9: https://www.thispersondoesnotexist.com/
mikey9988: monkaS
SofiaLouise: there is ~50% male female on tinder in Norway. US women are more sexually conservative i suppose
anotherkidnamedaustin: society is the biggest scam on earth dude
K177: cmonBruh
madscnt: !discord
martinkirilov: @georgehotz That's what happens when youre more driven by the project itself than its profitability on the short term
bytebacon: Stream gameplay
TeaLeafi: george ur awesome
blondephilia: Libertarianism ResidentSleeper
theonlymonkas: there will be stream tomorrow?
Ayyyy420Lmao: what book?
thecoder15: atlas shrugged yo best book ever
brownyyyylocks: oh no ayn rand
anti_natalist: marx quote?
nvda9: what book
Ayyyy420Lmao: what book he talking bout?
b2kemann: lool
thecoder15: atlas shrugged @Ayyyy420Lmao
bytebacon: Ayn Rand was one cold old lady
PiroFloydian: why?
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
solitarynative: don't tell hasan that LUL
b2kemann: *soviet anthem playing*
Ayyyy420Lmao: that's one boring book
jimmyadaro: Fuck Marx
narkoSays: @georgehotz If I'm looking for a coding mentor, do you have an idea where best to post? EU btw.
almonte550: So I can't talk about the optimizations of covid-19 we talked about here to make it worst than HIV and cancer combined?
anotherkidnamedaustin: duh big scam
MrTriharder: KKomrade
Ayyyy420Lmao: you better read some hoppe or rothbard
likespuppies: if you take the cynical viewpoint ye
PiroFloydian: i dont buy that at all @georgehotz
shieeeeeeeeet: how's backspace.ai doing? @georgehotz
jimmyadaro: "Equality or freedom"
aaaakshat: i leave the chat for 5 mins and now geohot is is karl marx?
anotherkidnamedaustin: a little scammy
yourdailydoseofcocaine: Now this is OUR stream
dyxx_pix: im gonna create an ai that perfectly times my message so that u read it based on where ur eyes r looking
doctorgenus: how much does your rent cost?
yevheniiushtyk: Why not make a discord related to this twitch community? Where people could dicuss and share stuff relates to the stream
Siandemm: Why?
murgmasallam: Did the Chinese really contain the virus?
Br4nnon: you have a point
christianthefalco: Try an Ayn Rand novel LMAO
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
equipollent_z: have you read "Complexity: A Guided Tour" ?
Scydra_: but isnt the author counting on only a few ppl following this and not all
THX1342: have you ever read brave new world?
Ayyyy420Lmao: are you familiar with hans herman hoppe?
SofiaLouise: How fast do you read?
brownyyyylocks: is it 1am yet?
solitarynative: @georgehotz make a community discord for us please
K177: ccp really does miracles
l1ght5p33d: Wellfare can be graphed.. reward as a curve it is an inverse quadratic
Br4nnon: good to see other viewpoints
Alexthematey: @georgehotz are u a libertarian?
Nussinov: no no george - the idea is that the government has complete and utter power over the people, so the people never even KNOW how resources are distributed Kappa
l1ght5p33d: some is good then the reward drops off
b2kemann: the chinese contained it's people.. lol
Bombapil0t: we need a corona rap hots
CoachMeech: melanie mitchell is a very smart person
forkdb: Hey
birkett0011: You read "When Atlas Shrugged"? @georgehotz
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
zoogaezee: is there a possibility China is lying about their Corona-virus numbers? In order to save reputation points'
almonte550: If I beat you in chess can I get hired in comma ai?
Ayyyy420Lmao: are you familiar with hans herman hoppe?
C0deCane: LUL that was great
jimmyadaro: @birkett0011 Amazing book
forkdb: I see Indian emblem
Exclamation_mark_CODE: I know a guy who knows a guy who has chicken permits
cybergenik: wait so why do you think that P = BQP? can you explain?
CoachMeech: She is very intelligent
brownyyyylocks: Chuck Rhodes slick
toront0saur: DISCORD LINK????
anotherkidnamedaustin: dude people are dumb. were told we started as a single cell with mutations LMFAO theres a better chance tomcr00se wins best album of the year next 1000 years
forkdb: Good...great
deva73: ya. communism leads to this underground market of favours
theonlymonkas: have you read the hitchhiker's guide to the galaxy?
jimmyadaro: Are computer programmers the last job to be replaced?? @georgehotz
K177: what do you think of a fully automated luxury communism
PiroFloydian: anarchosyndicalism is the way
haircutjimmy: more c programming!
anotherkidnamedaustin: dude people are dumb. we are told we started as a single cell with mutations LMFAO theres a better chance tomcr00se wins best album of the year next 1000 years
bojosos: Have you read 1984?
apollobelvedere: squad4
bankzed: why do I keep getting dudes from thispersondoesnotexist.com? I wanna take a face from there and deepfake it onto some porn so I can jack it to a person that doesn't exist. Kappa
jimmyadaro: @K177 Luxury or communism, can't have both
nvda9: George, ever counted your wpm?
bokeee_: @jimmyadaro spamming atpLaw atpCop
equipollent_z: I love this complexity book, introducing complexity theory
LordHord: Why vim
apollobelvedere: dude 1984 lmao xD society xDddd
anotherkidnamedaustin: metahuman
georgehotz: https://en.wikipedia.org/wiki/The_Metamorphosis_of_Prime_Intellect
narkoSays: @georgehotz If I'm looking for a coding mentor, do you have an idea where best to post/search?
l1ght5p33d: C suite will get undercut by tech department it is the way of nature
jimmyadaro: @bokeee_ I'm trying to solve that question lmao
zoogaezee: is there a possibility China is lying about their Corona-virus numbers? In order to save reputation points'
Br4nnon: graphic is my middle name
qlutoo: have you read flowers for algernon
TeaLeafi: MAKE A BOOK LIST WE SHOULD READ!!!! please!!!
TeaLeafi: MAKE A BOOK LIST WE SHOULD READ!!!! please!!! !!!
equipollent_z: cliche thing to mention, but... Godel Escher Bach?
georgehotz: http://localroger.com/casodycs.html
anotherkidnamedaustin: RWU
CheeseManUchiha: cicadas monkaS
jimmyadaro: BOOK LIST ON GITHUB?!??!
apollobelvedere: reading both younger than 100 years old knutR
brownyyyylocks: why read it?
Bombapil0t: "k3yb04rd" Your message wasn't posted due to conflicts with the channel's moderation settings. DansGame
theonlymonkas: book list!
Ayyyy420Lmao: are you familiar with hans herman hoppe (libertarian author)?
jimmyadaro: BOOK LIST ON GITHUB?!??
apollobelvedere: books squad4
K177: @jimmyadaro yeah true, now that I think about it if robots replaced the need for jobs, and communism kicked in, it would become the norm and no longer a luxury LUL
itsxaos: thanks
Atlas03: spoiler it rooREE
cybergenik: @georgehotz wait so why do you think that P = BQP? can you explain?
Alexthematey: @georgehotz are u a libertarian?
CoachMeech: science fiction is for nerds
admirablelive: @georgehotz do you have a god complex?
igg44705: @georgehotz do you relate to House from house md?
likespuppies: ROGER WILLIAMS PogChamp
rndmsqnce: same as the first job?
equipollent_z: Thanks for the book links!
rndmsqnce: oldest profession
narkoSays: @georgehotz If I'm looking for a coding mentor, do you have an idea where best to post/search?
MrTriharder: @georgehotz Is there a movie for this book? too lazy to read
b2kemann: geohot book club
64pillars: wheres the goodnotes link
blondephilia: what was the second book @chat?
jimmyadaro: @cybergenik BQP= BQP^BQP
anotherkidnamedaustin: if time is relative, why do we age
TeaLeafi: MAKE A BOOK LIST WE SHOULD READ!!!! please!!!!
T3chHS: How valuable do you think reading is?
zoogaezee: is there a possibility China is lying about their Corona-virus numbers? In order to save reputation points'??
benchai18: What are you most proud of? Something Ur comfortable mentioning publicly.... obv
bojosos: Have you read 1984?
apollobelvedere: read uni bomber manifesto and that's it squad4
cortickal: Familiar with Mencius Moldbug?
igg44705: @georgehotz does the comma 2 work in india?
thecoder15: @georgehotz have you read the unibomber manifesto
jimmyadaro: BOOK LIST ON GITHUB PLEASE
yevheniiushtyk: Writing? LUL
ideology_sniffing_raccoon: monkaW
costcospizza: he was right
dyxx_pix: why hasnt air transportation replaced cars?
theonlymonkas: book list
blondephilia: FBI not lying LUL
aman_v2k: lmao @jimmyadaro
anotherkidnamedaustin: fbi scam
TeaLeafi: BOOK LIST ON GITHUB PLEASE!!!
pjayys77: are you a fan of Noam Chomsky @georgehotz
vix_dev: sean carrol's something deeply hidden was really good
TeaLeafi: BOOK LIST ON GITHUB PLEASE!!!!!!
apollobelvedere: read nothing and play video games instead squad4
TeaLeafi: @apollobelvedere true
brownyyyylocks: how did you find metamorphosis
blondephilia: Yes, Marx describes problems well. Incorrect prescription.
jimmyadaro: It invents problems
jimmyadaro: Marx sucks, Engels too
murgmasallam: Will this pandemic change political systems across nations?
narkoSays: @georgehotz If I'm looking for a coding mentor, do you have an idea where best to post/search?
Hawklite: you have to get your message heard somehow
bokeee_: Making manifestos about problems but not giving proper solutions is a bitch move
T3chHS: How much do you value reading?
apollobelvedere: read nothing, dont play video games and breathe manually instead squad4
TeaLeafi: BOOK LIST ON GITHUB PLEASE!!!
theonlymonkas: could you do a book list
anotherkidnamedaustin: usa is a democracy? but when coronavirus hits people complaining they need 2trillion buyouts
voxelfox0125: React to these posts about bad ways to learn programming. https://guidedhacking.com/forums/wall-of-shame.462/ (browse normal threads.)
anotherkidnamedaustin: pepelaugh
deva73: means of production should reside with the state : worst point according to me
Ayyyy420Lmao: well the unabomber claims that industrial society cant be fixed because psychological issues it causes
realolejka: @bokeee_ is a communist move
admirablelive: @georgehotz do you have a god complex?
zwisch: also mailing pipe bombs is a huge overreaction
benchai18: @zoogaezee Is there a possibility China is lying about some shit to push us into acting a certain way or taking certain actions.
PiroFloydian: have you read kropotkin/bakunin?
TeaLeafi: BOOK LIST ON GITHUB PLEASE!!!?
likespuppies: the solution was to blow everything up :pepega:
anotherkidnamedaustin: production does reside with state? 2TRILLION BUYOUT LMFAO
igg44705: what do you think about stoicism?
b2kemann: that beard
TeaLeafi: that beard
TeaLeafi: BEARD:3
jimmyadaro: Have you read Atlas Shrugged? @georgehotz
dr_set: the solution according to him was to send bombs in the mail to get attention and to write a manifesto
blondephilia: defection
jmv_chin: Do you use a mechanical ⌨️
d0ubletruth: that's because they dont think people will have a *reason* to
Ayyyy420Lmao: essentially stop working and they still have to provide for you
theonlymonkas: BAN
anotherkidnamedaustin: how is a 2trillion dollar buyout to specific government chosen companies not socialism? pepelaugh
dyxx_pix: what do u think will be the effect of the 2 tril stimulus pkg on the economy
jimmyadaro: @jmv_chin Yep
itsxaos: Can we ever bring the size of governments/institutions back down WITHOUT burning them down completely?
solitarynative: debate destiny and get some clout
thecoder15: have you read Richard Feynmans work on simulations via quantum computers @georgehotz
equipollent_z: another book question: have you read "Order of Time" by Carlo Rovelli? That changed my perspective on time completely.
deva73: lure em with ferrarti
ahahahaitslit: do you read scott aaronson
blondephilia: You have to breed that tendency out of the populace.
Abnico: @georgehotz https://twitter.com/breaking911/status/1242712281760358401?s=21
jimmyadaro: Have you read Atlas Shrugged? @georgehotz
jimmyadaro: @itsxaos Yep, minarchism
T3chHS: How much do you value reading?
anotherkidnamedaustin: government chooses who to buyout and who not too. but we are a democracy
apollobelvedere: here we go on politics chat TriHard
theonlymonkas: do you like interstellar
nvda9: religion is a scam
solitarynative: cmonBruh
PiroFloydian: @jimmyadaro he literally mentioned that like 3 mins ago
equipollent_z: the bio book on Feynman is pretty good too
Abnico: Politics are for noobs
b2kemann: feynman was the last american hero
TeaLeafi: politics is a scam
jimmyadaro: @PiroFloydian I was making coffee
apollobelvedere: here comes the interstellar fan TriHard
PiroFloydian: political theory
anotherkidnamedaustin: politics defined in one sentence. People Scam
ahahahaitslit: have you read scott aaronson's book
jimmyadaro: It's 4:47 AM here LUL
benchai18: Fuck fed government. Protect us and unify us, but besides that F off. Local government should be far more important. Even affecting change on a local level is difficult, but at least possible. People in proximity to us should have a say in our laws, not some twats across the country t
dima_lanski: @georgehotz But wouldn't you say the same about the current US system?
blondephilia: Hierarchy everywhere in everything.
igg44705: OPEN SOURCE THE LAW
Abnico: Politics is a gay tv show
equipollent_z: rain
Ayyyy420Lmao: anyway really recomend you reading some hans herman hoppe, he's one of the few libertarian who takes it logically to the extreme
toront0saur: What is the commas DISCORD LINK ??!!!
murgmasallam: @Abnico whatever you shared is no longer there
solitarynative: crypto will replace government unironically
cortickal: Ted Kaczynski spends more time in addressing the "solution" in his new book Anti-Tech Revolution
blondephilia: Pan-integralism or nothing.
nitrixen: "Great minds discuss ideas; average minds discuss events; small minds discuss people."
doctorgenus: Life question: how do you get rich if you are dumb?
anotherkidnamedaustin: 2trillion bailout
b2kemann: goverment should be limited
itsxaos: @jimmyadaro where has that ever happened? its a nice label to say we want minimal government but the point is that it just doesnt seem to work
MrTriharder: @georgehotz that sounds like some buzzfeed shit
apollobelvedere: yea
anotherkidnamedaustin: 2trillion
deva73: what about SOCIALISM?
Ayyyy420Lmao: lmao 2016
anti_natalist: its a loan you know that right
apollobelvedere: Ted is literally the guy who escaped the cave of Plato
jimmyadaro: @itsxaos Maybe not now, the world is not ready yet, they need "papi Estado" like we say in Argentina
ideology_sniffing_raccoon: Wut
Siandemm: USSR socialism is all about the top 0.01 rule the country and have any goods they needed but others eat shit
phrixus_bro: banned
codephobia: book must be a real killer
likespuppies: @georgehotz Thoughts on the dangers of collective wisdom, e.g. wikipedia?
nvda9: https://discord.comma.ai
anotherkidnamedaustin: @Siandemm hows that different than us
Abnico: Ban him
jimmyadaro: @Siandemm Yeah, slaving people
rndmsqnce: brave new world
anotherkidnamedaustin: @jimmyadaro same as usa
jimmyadaro: Anti-Tech? That's plain stupid
Ayyyy420Lmao: @anotherkidnamedaustin lol no?
itsxaos: @jimmyadaro so thats my fear, the only way governments get smaller is if they burn
ideology_sniffing_raccoon: PogChamp PogChamp
jimmyadaro: @anotherkidnamedaustin Slaves???? Where???
anotherkidnamedaustin: @jimmyadaro um corporations
jimmyadaro: @itsxaos Maybe it's the right way
anotherkidnamedaustin: um schools?
Abnico: quadratic funding is a good tunnel
solitarynative: is chainlink a scam?
C0deCane: boomers LUL
apollobelvedere: wooow
localcanofdutchgold: ez
jimmyadaro: @anotherkidnamedaustin How is that slaving? Are you stupid or something?
Ayyyy420Lmao: @solitarynative that's what i wanted to know he didnt answer
itsxaos: LIVE PIRACY PogChamp
ideology_sniffing_raccoon: EZ
mikey9988: EZ
GeekTryingToGeek: KEKW
0R4NG3: EZ
equipollent_z: do you think bio is the future of computation?
Bombapil0t: :D
narkoSays: 4Head
jimmyadaro: EZ
Br4nnon: lmao
TeaLeafi: live piracy kekw
toront0saur: Thanks @nvda9
TeaLeafi: EZ
blondephilia: lel
solitarynative: @Ayyyy420Lmao I'm testing him LUL
ad_1337: anti tech LUL
apollobelvedere: very interesting stream, straight to the subject squadHmm
Bombapil0t: e-book version gg
Exclamation_mark_CODE: yoink
benchai18: But dude... that “who cares” attitude is because we know we have zero influence over our federal govt. Zero. People are rightfully disillusioned. I don’t mean angry, I mean resigned and disinterested because of how inaccessible our federal government is. I don’t care what Pelosi’s pubes are shaped like. I don’t want Pelosi to influence laws that affect California.
bankzed: read us a bed time story, Kappa
anti_natalist: @georgehotz what principles of libertarian are compelling?
Abnico: Libgen.is
jimmyadaro: "Anti-tech" pirated lmao
anotherkidnamedaustin: ur taught to get up when the bell rings, sit down and shut up and listen to the teachers who gets a yearly madate from u guessed it the goverment. but yeah ur free @jimmyadaro
TheLastMrX: that was... FAST
theonlymonkas: LUL
Abnico: @georgehotz libgen.is
jimmyadaro: @anotherkidnamedaustin Sounds like a 15 years-old "rebel" argument lmao
icanthitthose: how did you get the pdf
apollobelvedere: thought he wrote this to get bitches squad4
blondephilia: @benchai18 people shouldn't need to care about their government. a child shouldn't need to care about the competency of his parents.
anotherkidnamedaustin: then go work 9-5 and get scammed @jimmyadaro lol while the pay gap gets wider and wider and the peons make less and less
Bombapil0t: this is our jailbreak guy from the past!
solitarynative: deep
Ayyyy420Lmao: @anotherkidnamedaustin wtf u talking about im 32 and have never worked
jimmyadaro: @anotherkidnamedaustin lmao I have my own business, I'm CEO, what the fuck boy hahahaha
anotherkidnamedaustin: @jimmyadaro im 23 suma cum laude from iowa trading biotech options on stock market.
murgmasallam: Didn't the use of invasive facial recognition help China in containing the virus?
sebastianh_777: How does the lane detection find the lanes on roads without any lane lines? (like through an intersection)
doctorgenus: if you have milk in those grocery bags, it's probably GG
ahahahaitslit: have you read scott aaronson's book
cybergenik: Wait can you explain why P = BQP?
likespuppies: human condition used to be much more base
equipollent_z: fan of Douglas Hofstadter?
anti_natalist: @georgehotz what principles of libertarianism are compelling?
rndmsqnce: gotta get that real ego death then you'll get what he means
nremind: most people were very bored in the past
jimmyadaro: @anotherkidnamedaustin I'm 22, and i have market experience since my 18 so…
admirablelive: @georgehotz why mac over windows?
thecoder15: @georgehotz http://www.wisdom.weizmann.ac.il/~naor/COURSE/feynman-simulating.pdf
apollobelvedere: @jimmyadaro where do I apply to be your bitch?
benchai18: @blondephilia I think you’re misunderstanding me. I’m just saying that local government should govern us way more than federal does
jimmyadaro: BQP = BQP^ BQP
CoachMeech: i can think, i can fast, i can wait
blondephilia: everything Ted describes can be derived from careful study and analysis of zoology and animal behavior.
jimmyadaro: @apollobelvedere Search me on Linkedin
apollobelvedere: @jimmyadaro yes daddy
apollobelvedere: squadHmm
jimmyadaro: @apollobelvedere lmao
hastingspb: Q = 1/P
anotherkidnamedaustin: @jimmyadaro so? im not comparing dick sizes. im just saying go to school, go work for a corporation in bed with the government, and stay poor forever is basically slavery
solitarynative: TRUE LU
solitarynative: LUL
passingremarks: everytime i talk to a libertarian
jimmyadaro: @anotherkidnamedaustin That's stupid, so…
PiroFloydian: libertarian socialism is fantastic ideologically @georgehotz
passingremarks: about anything
Ayyyy420Lmao: hans herman hoppe has the most autistic approach to libertarianism the dude's philosophy is impenetrable
ahahahaitslit: have you read antifragile by taleb
admirablelive: @georgehotz why mac over windows?
igg44705: @georgehotz what do you think about stoicism?
zwisch: hemlock
thecoder15: oops that wasn't what i was trying share
passingremarks: they seem to not understand simple cause and effect
ideology_sniffing_raccoon: they got his ass
mikey9988: clapped some boy cheeks KEKW
jimmyadaro: @passingremarks Why?
PiroFloydian: like from an analysis perspective
b2kemann: socrates went out as a champ
equipollent_z: Hofstadter was Melanie Mitchel's doctoral advisor, they worked on an AI program called "Copycat" to form analogies on machines
anti_natalist: @georgehotz ask a simple question about arbitration and libertarianism falls apart
apollobelvedere: Socrates was a hologram, he never existed squad4
jimmyadaro: Socialism sucks lol
blondephilia: @benchai18 irrelevant. no one cares about policy in day to day life. they care about things that pertain to their lives.
Nussinov: most people are two questions away from complete existential disaster
ideology_sniffing_raccoon: Creating an UTOPIA good luck with that chat LULW
PiroFloydian: libertarian socialism is a thing @georgehotz
voxelfox0125: React to these posts about bad ways to learn programming. https://guidedhacking.com/forums/wall-of-shame.462/ (browse normal threads.)
MrTriharder: @jimmyadaro PHP DansGame I lost respect NotLikeThis
itsxaos: @georgehotz do you have a lichess account?
Ayyyy420Lmao: what's a good defense of a socialist position? never hears one
cybergenik: Do you know who Destiny is?
bojosos: How would you describe a "perfect" sciety
thecoder15: @georgehotz you can have a socialist system under a libertarian rule but you cant have the opposite
anotherkidnamedaustin: amazon is the utopia
doctorgenus: are you working from home tomorrow?
bankzed: Socrates got a medal of freedom? Kappa
ahahahaitslit: you will like antifragile by taleb
benchai18: @b2kemann Socrates was a bigot and transphobic. Jk. Just imitating SJWs for the lulz
Nussinov: @cybergenik LUL
Tyrant_01: WHY MAC OVER WINDOWS
peter35_: thoughts on the damore google memo thing?
anti_natalist: why cant we have it somewhere in the middle i.e. a mixed economy?
equipollent_z: have you started watching "Devs" on hulu? :D
localcanofdutchgold: @cybergenik lul
blondephilia: Libertarians can't answer how profits aren't put above the people.
apollobelvedere: @cybergenik please keep Destiny in the trash can
itsxaos: Density LUL
iambdp22: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2750777/
TeaLeafi: ur like DESTINY!
admirablelive: @georgehotz why mac over windows?
cybergenik: lol
evnomics: You should talk to Destiny
solitarynative: debate destiny LUL
tybutnowyoudie: do you know reckful?
igg44705: what do you think about stoicism??
evnomics: you would get along
jimmyadaro: @MrTriharder lmao how is that important ?
TeaLeafi: Destiny!
MrNavfal1: I am not living, I'm just surviving
anti_natalist: talk to destiny Pog he talks to anyone
bokeee_: Good call LUL
cortickal: Destiny's a narcissist
localcanofdutchgold: @TeaLeafi this guy actually does stuff
christianthefalco: Destiny is for people that unironically think Joe Rogan is smart
AresRai: dont, its toxic
CoachMeech: you and destiny woukd actually be hilarious hahahahaahahah
MrTriharder: @jimmyadaro DansGame just LUL
benchai18: @blondephilia Mate that’s EXACTLY what I’m saying.
roystang: destiny really sucks
apollobelvedere: Destiny fan boys in chat knutR
Ayyyy420Lmao: @blondephilia profits are the people, profits are made by providing for people...
l1ght5p33d: the quality of this chat has really deteriorated
Scydra_: @georgehotz have you played dota 2 ever?
likespuppies: @christianthefalco you think joe rogan is not smart? lol
MrTriharder: @Scydra_ admiralW
cybergenik: Destiny is like the final raid boss of anyone who wants to debate in politics.
jimmyadaro: @MrTriharder OhMyDog
anotherkidnamedaustin: its a paper on targeted protein vaccine
Srule: This guys is destiny 2.0
AresRai: @l1ght5p33d its the spike in viewership recently :/
admirablelive: !PC
christianthefalco: @likespuppies uh oh
equipollent_z: is the outside of the universe the inside of the universe?
b2kemann: @benchai18 i don't care, when you take poision and make that your final lesson, you're a champ
Nussinov: to be fair he hates his subreddit too
peter35_: strims.gg numales in chat
Scydra_: @MrTriharder Of course a wild bulldog sub
roystang: @cybergenik hes really not tho
doctorgenus: how do you train your concentration? you're streaming for HOURS on end :P
blondephilia: @benchai18 not at all. I'm not saying people should have more say in local government.
keewon: regards from spain! How is the qurantine going ?
cybergenik: Hes super solid
MrTriharder: @Scydra_ admiralF1 admiralF2
admirablelive: @georgehotz What computer do you have?
madpyro21: @georgehotz Out of curiosity have you ever looked into ps4 security?
likespuppies: @christianthefalco i'll have you know i was in the navy seals and i could
igg44705: what do you think about stoicism?
ArcherCreatlol: squad1 squad2
ideology_sniffing_raccoon: LULW
Keijo: This chatroom is very intellectual indeed BrokeBack
TeaLeafi: true
jimmyadaro: @doctorgenus lmao
T3chHS: chat, what text editor is that? vim?
Bombapil0t: its a amigo computer @admirablelive
roystang: @cybergenik but hes not tho
pjayys77: can get quite toxic when you're talking about Desinty n Reddit
benchai18: @b2kemann Shit I don’t care even if he was transphobic and bigoted. I was fuckin around.
anotherkidnamedaustin: basically trap the virus and kill it outside of the healthy cells
nvda9: Does he play fps
zeus13i: @T3chHS - vi
anotherkidnamedaustin: pretty interesting actually
cybergenik: @roystang how so?
jimmyadaro: Do you fap? @georgehotz
blondephilia: @Ayyyy420Lmao Untrue. Else people wouldn't be renting as much as they do rather than owning.
Scydra_: @igg44705 good question, i wish to know as well
madscnt: Which IDE do you use?
roystang: @cybergenik dudes a weirdo
T3chHS: @zeus13i thank you!
b2kemann: @benchai18 I know, i just wanted to call him a champ one more time
solitarynative: is futa gay?
Atlas03: rooSmug
anti_natalist: destiny is pretty good faith as long as you dont ad hom, like most people
apollobelvedere: anyone here eating cheerios honey NUTS? squad4
boengels: your "tab" game knows no bounds...
MrTriharder: Time to get the key board question out chat LUL
roystang: @cybergenik hes the harvey weinstein of twitch
cybergenik: @roystang thats not a reasonable arguement, if you took any time to actually listen to what he says its solid
passingremarks: @jimmyadaro libertarians make assumptions about free markets and personal liberties that don't take into consideration bad actors that abuse those systems... which is why i say they don't understand cause and effect
roystang: @cybergenik but its not tho
toront0saur: cant wait to invest in comma!!!!!!!!!!
doctorgenus: so what's the take away from today's stream? buy dna test kits?
Ayyyy420Lmao: @blondephilia woah that's quite the non sequitur
yourdailydoseofcocaine: @admirablelive you should ask about his k e y b o a r d
itsxaos: What is it about reddit that makes it so awful?
Abnico: and I get bleach on my tshirt imma feel like an asshole
anotherkidnamedaustin: Because the S protein of SARS-CoV is involved in receptor recognition, as well as virus attachment and entry, it represents one of the most important targets for the development of SARS vaccines and therapeutics.
solitarynative: thoughts on vr porn?
MrTriharder: Chat ask about his key board Jebaited
yourdailydoseofcocaine: @itsxaos too many fking people.
PiroFloydian: Liberalism
jimmyadaro: @passingremarks I'd like to talk further about this but not now, i'm really sorry, i'm tired, it's almost 5 am here
ArcherCreatlol: squadR yo george what's up squadR
PiroFloydian: Liberalism is shit
igg44705: what do you think about stoicism?
cybergenik: @roystang Ok now your just being an idiot, calling him the Harvey Weinstein of Twitch. I mean just take like 20 minutes to actually look through some of his shit...
Bombapil0t: big business @solitarynative
Atlas03: anyone tried this new site egirl gg
jimmyadaro: @PiroFloydian Awesome argument
evnomics: They would be the extreme ends of our modern system
blondephilia: @Ayyyy420Lmao you said that profits are made by providing for people. Sure, but they aren't necessarily positive provisions.
jmv_chin: What mouse do you use
b2kemann: when are we going to meet your mom georg?
PiroFloydian: i mean neoliberalism
roystang: @cybergenik i used to, when i was in high school, not anymore
solitarynative: @Bombapil0t yes yes
blondephilia: Exploiting != providing in my book.
Ayyyy420Lmao: @blondephilia how is renting bad? providing a home is bad?
ahahahaitslit: what the fuck is destiny? the game?
l1ght5p33d: Guillotine liberalism
c1tr0n75: totalitarianism is the most coherent Kappa Kappa Kappa
anotherkidnamedaustin: https://www.jbc.org/content/264/18/10542.full.pdf
THX1342: do you think fascism is still a global risk?
equipollent_z: any favorite theories that came out of CERN?
igg44705: @blondephilia yeah you can give people meth and still get rich
Ayyyy420Lmao: @georgehotz whats a good defense of socialism acording to you?
doctorgenus: before we go to bed, can we see what you got in your grocery bags
jimmyadaro: Liberalism is not socialism wtf they've stolen that from libertarians
anotherkidnamedaustin: cross link s protein
evnomics: no its the international community working together lol
reckful_bald_spot_114: ahahahaitslit twitch streamer
igg44705: did any one see the new epsoid of better call saul today?
cybergenik: @roystang Ok, well if your gonna say some dumb shit it better be backed up. Or else don't say it
CoachMeech: neoliberlaism is just lib with free markets
equipollent_z: widdFaded
narkoSays: ppl tossing around definitions in chat which they probably aren't even aware of that they don't fully understand :P
blondephilia: @Ayyyy420Lmao people should be owning. renting shelter has caused enormous problems, namely mental health and destruction of birthrates. Trash it.
anotherkidnamedaustin: crosslinking the s protein is what u are looking for @georgehotz
jimmyadaro: @CoachMeech No one is "neoliberal", there's no "new liberty"
PiroFloydian: neoliberalism is both the dem and repub party establishments. started w/ regan and thatcher in the 80s. that whole thing @georgehotz
roystang: @cybergenik dudes a goober and his debates suck
solitarynative: dicatorship is the best depending on the dictator
evnomics: https://en.wikipedia.org/wiki/Neoliberalism
itsxaos: do you think corporatism is a good/useful word?
bankzed: They halted the filming of the new Matrix movie so we will never know what Neo liberalism is... KappaHD
CoachMeech: aight buddy chill
PiroFloydian: renting is a scam yeah
Ayyyy420Lmao: @blondephilia lol what? not at all, owning comes with risks renting allows for more flexibility, if people choose to rent is because it has its benefits
narkoSays: ppl tossing around terms in chat which they probably aren't even aware of that they don't fully understand
C0deCane: @georgehotz what happened to the Uyghur muslims in China, kinda odd this all happens after that shit
toront0saur: DEF CON 28 still happening in the summer ??!!!!!
yourdailydoseofcocaine: @bankzed just wow. Kappa
Nussinov: completely irrelevant
Srule: Would you recommend a 60% key board for browsing pornhub?
cybergenik: @roystang ok cool, well now I know that everything your saying is vacuous...
reckful_bald_spot_114: narkoSays nice contribution to chat SeemsGood
anotherkidnamedaustin: its a example of how you can cross link and isolate the s protein in rona
anotherkidnamedaustin: and kill it off
ArcherCreatlol: LUL
MrTriharder: LUL
bojosos: Do you Fold@home
ideology_sniffing_raccoon: NOOOOOOOOO
PiroFloydian: shit
b2kemann: lool
blondephilia: @Ayyyy420Lmao people rent because they can't afford to own, not to escape risk.
phrixus_bro: thanks!!
Atlas03: rooCry
TeaLeafi: huhuuhuh
localcanofdutchgold: wtf
anotherkidnamedaustin: seriously comma.bio
mikey9988: LUL
Exclamation_mark_CODE: LUL
MrTriharder: fuck
Bombapil0t: BibleThump
equipollent_z: LUL
itsxaos: very fun stream &lt;3
jimmyadaro: @narkoSays So what's your contribution?
TeaLeafi: NOOOOOOOOOOOOOOOOOOOOOOOOO
dorkmo: choo chooooo
jimmyadaro: NOOO
THX1342: goodnight
MrTriharder: LUL chat
TeaLeafi: noooooooooooo
jimmyadaro: :(
ideology_sniffing_raccoon: &lt;3 &lt;3 &lt;3 &lt;3 &lt;3 &lt;3 &lt;3
THX1342: thanks for the stream
igg44705: @georgehotz what if a guys rings your frount door?
dr_set: bye &lt;3
archer723: good night
nvda9: George, why don't I see you on DEFCON, you don't attend there anymore?
doctorgenus: noooooo
TeaLeafi: &lt;3
anotherkidnamedaustin: comma.,bio ill sent my resume
roystang: @cybergenik take his 3 cm weiner out of ur mouth bro
MrTriharder: &lt;3
toront0saur: LMAO
equipollent_z: didn't read stream description
BurntOut157: bye George
PiroFloydian: this was fun
ArcherCreatlol: u don't have anything to do else
TeaLeafi: &lt;3 love uuuuuu
reckful_bald_spot_114: you fucked up chat
yourdailydoseofcocaine: @srule I’d rather recommend a 69% one kappa
TeaLeafi: love u so much &lt;33333
solitarynative: tomorrow?
rndmsqnce: &lt;3
bankzed: nn
uduver: Good night! &lt;3
anotherkidnamedaustin: where do i send comma bio resume
TeaLeafi: &lt;3
equipollent_z: widdPeace
Ayyyy420Lmao: @blondephilia so if you cant afford something you dont have it duh
likespuppies: @georgehotz Dream about meat
doctorgenus: good nite bud
jimmyadaro: Love ya
itsxaos: good night everyone, including the crazies :)
jimmyadaro: before we go to bed, can we see what you got in your grocery bags
localcanofdutchgold: &lt;3
64pillars: lol
doctorgenus: :)
archer723: See you tommorrow? can we?
MrTriharder: &lt;3 &lt;3 &lt;3
bokeee_: thanks for streamign george &lt;3
toront0saur: NOO GEORG HAHAHA
TeaLeafi: LOVEUUUUu
igg44705: love you man
localcanofdutchgold: OMEGALUL
Keijo: George uses the newest Asus Predator mechanical anti-ghosting gaming key board, check link in bio for amazon
TeaLeafi: LOVE UUU
uduver: &lt;3 &lt;3 &lt;3
pjayys77: lol wut
jimmyadaro: before we go to bed, can we see what you got in your grocery bags!
yourdailydoseofcocaine: Nighty night
ad_1337: see ya
Atlas03: rooLove
jimmyadaro: before we go to bed, can we see what you got in your grocery bags??
solitarynative: TRUE LUL
TeaLeafi: L:OVEEE U GEORGIE
iambdp22: https://www.embopress.org/doi/10.1038/sj.emboj.7600640
c1tr0n75: Geoorge getting all romantic on us
zwisch: hanlon's razor
MrTriharder: @georgehotz tomorrow again please
Cazaa_: LOVEE UU GEORGEEE
equipollent_z: widdHorn widdHorn widdHorn widdHorn
WEBVTT
Kind: captions
Language: en
pwnbase: o shit FIRST
Bloodswordz88: Hail brothers and sisters
lawli3t__: hi
homestarr: yooooo
birkett0011: weeeeeeeeeeeeeew
lawli3t__: first
5_betbluff: What Up son
benchai18: Two
zartharus: Seco d
youngsachi: TriHard
pwnbase: Lmao you call yourself a geohot fan? I'm fucking loaded on channel points bro. I highlight every message because I'm just that jacked. Try talking in chat again when you're a true fan
zartharus: Third
Leon_Trolltsky: Woo
benchai18: Whatup nucka
DlShLe: what up
wizardwatch1: Yo
desg92: hack the planet
jbnunn: fifth-ish
5_betbluff: NJ represent
benchai18: Great. Another night of not doing shit
JaeGeeTee: George!!! We are LinkedIn connections. I can die content.
lawli3t__: xdd I WAS FIRST BROOO
lawli3t__: sdfmlsd
Mieer: No way
Teo0308: yoo
Bloodswordz88: HahaThisisfine
twinprimes71: bro
birkett0011: LUL
benchai18: Stop streaming George. I do nothing but watch u when ur on
shanumbra: LUL
Mieer: Suuup folks
T3chHS: good evening
sebastianh_777: hya
sebastianh_777: eya*
Mieer: Mirceua is here
lawli3t__: But I was playong Minecraft so
sebastianh_777: dammit
twinprimes71: bro geo
lawli3t__: good bye
Bloodswordz88: who is going to survive the presidential election is more like it
Ayyyy420Lmao: !uptime
benchai18: @lawli3t__ I know stfu 😉
Mieer: It is 3 PM here in Amsterdam
homestarr: thats hella morbid
twinprimes71: bro geohot
benchai18: George do u eat ass?
Mieer: George,
goldensoap_: where is your one milion followers on instagram
benchai18: George they gave u a blue check yesterday btw
Ayyyy420Lmao: how does augur get its data since the oracle problem is unsolvable? aka chainlink is a scam Kappa
danbokhari98: Does anyone here know image processing
nic0latesla: i love you
xXICEW0LFXx: currently doing homework with assembly..... and i want to die
benchai18: I don’t even know what Augur is
Ayyyy420Lmao: @danbokhari98 im skilled on mspaint
55start: can someone explain what is happening lol
joker2k999: LUL
benchai18: Can’t u make one?
Mieer: Today I bought a shit-ton on Toilet Paper
padahou: So annoying that I live in Greece and it’s like 4 am right now ...... at least quarantine
danbokhari98: @Ayyyy420Lmao help me find the raster image of color slicing
Mieer: Isn't everyone looking at Italy?
Mieer: optimise your graph with Italy's data as of now
hanycodes: what did you conclude after 5 days of this ?
zartharus: At last. I’ve being following this series 1 day behind on YouTube this whole time. Finally when I scream at the screen George will be able to react. It won’t just be a video
kraplife: @padahou i know right?
lordkyrus: im italian, the situation is ridicolous
bsx1123: Please port Renault
twinprimes71: mentality beast
birkett0011: Congrats
Mieer: Nice congrats on the advancements on your company !
bsx1123: Renault Zoe
Ayyyy420Lmao: SKODA not sold in america?
jbnunn: let's get to Land rover
C0deCane: fuck yea been waiting on some bio today
flippe31: decent prediction site: https://neherlab.org/covid19/
almonte550: Is this a comma ai stream?
jbnunn: it's a ford basically
Mieer: The French will be pissed
5_betbluff: what's a safe amount of beef jerky to eat in a day?
Mieer: lol
goldensoap_: geothoot how are u so smart
o______________________k: ty for streaming today :)
guacDev: george!!!!!
Mieer: Land Rover / Jaguar
guacDev: youre streaming a lot lately
yaus_baus: tata owns vw
Bloodswordz88: shout out to Scotty Kilmer lol
yaus_baus: dont they
homestarr: bio stats is done in r not python :(
DirectorHomeless: using the data from other countries is potentially flawed for a number of reasons, not least the issues with testing
OrlinTheMage: make love to me Geo!
benchai18: Last night the unofficial Geohotz discord was made. It’s not gonna be dope til y’all join. For crazy people who like similar shit https://discord.gg/FuWwMFD
Mieer: I was in India last July.. dude.. I was driven by a TATA vihicle in the middle of the night and this car.. XD I barely got to point B.
JaeGeeTee: Bro!!!!!! You can’t comma ai stream!!!!! That’s fucking sacrilige
Cazaa_: hi george!!
Mieer: Wait what website is that?
lordkyrus: people are dying every day just because the hospitals are full. We have more deaths than china..
rafalive: hey george do you still live in montreal?
amo77777: It's bad here in Germany, but I think the UK is going to have massive problems
Stegosaurian: Can someone gift me a sub if you can. I wanted to watch the last steam but the video is only available for subs
kratosboii: sup george @georgehotz
Lizardan: This corona crisis might actually get Trump elected november.
matvey_ryabov: Do i need to watch the prior 4 coronastreams to understand this one?
logi6000: what's up. how's your day
frostism1: just came. Can someone link again?
bichid69: ml for video absolutely sucks man
archer723: even with the prior 4 maybe you still cannot understand...
bichid69: what a joke
luigifrcruz: If you need a global COVID-19 Forecasting dataset. Here is a pretty good one. https://www.kaggle.com/c/covid19-global-forecasting-week-1/data
C0deCane: I feel like there may be some big guessing going on there but I could be wrong
dog_runner09: hello from Nigeria
ad5k: Hello scholars
logi6000: what's up
almonte550: I think 3 millions is worth hurting the economy
Ayyyy420Lmao: just lower the population to the infectable population
FurikuriYugi: Yo yo yo what up fam
sebastianh_777: What are you trying to write here with these corona stream?
Mieer: Hmm.. do you think India will out-'perform' the US in spread and dynamics of this virus? I mean what will the carrying capacity be in India
hypertextlabs: you hear about helm.ai?
bichid69: what do you do when you're not streaming?
hypertextlabs: https://www.helm.ai/
imafungi53: whats the goal
benchai18: @georgehotz U watch Lex’s video??
amo77777: @imafungi53 creative exploration
C0deCane: @georgehotz I heard today that there is 40 different mutations that have been found
FurikuriYugi: Fear will cause stress and make your immune system weaker
OmegaThicccBoi: LUL
youngsachi: LUL
Ghost_001: LUL
liiiiiig0: LUL
hypertextlabs: have you heard of what they are doing?
FurikuriYugi: Kreygasm
Ayyyy420Lmao: probably an ICO scam
DirectorHomeless: the problem lies in the testing. arguably the only dataset where they had proper observations was the diamond princess, where everyone was tested, even if not displaying symptoms. it transpired 85%  had contracted it iirc but most had no reaction. this would point to much higher existing infections and lower mortality rate...
Ghost_001: D:
deva73: yo!
benchai18: @georgehotz U watch Lex’s video??
lordkyrus: LUL
angel_j_a: they just raised $13M
Mieer: Hmm.. do you think India will out-'perform' the US in spread and dynamics of this virus? I mean what will the carrying capacity be in India
C0deCane: comma ai &gt; helm ai
Ziv0: LUL
r0xtehem0x: Elisa Lam
Ayyyy420Lmao: lam
benchai18: @c0decane Nepotist
hypertextlabs: why the f did they just raise 13m
kratosboii: whos this chick @georgehotz
benchai18: Elisa lam
Ayyyy420Lmao: why does she have awikipedia entry?
benchai18: That was me too
benchai18: Elisa lam
v0sn: helm ai sucks
jbnunn: @benchai18 which episode from Lex?
hypertextlabs: yea that's why I brought garbage into the chat lol
benchai18: She does
sebastianh_777: What are you writing in this stream?
hypertextlabs: lol
benchai18: She did****
Rovelo: LUL
stalys_: LUL
hypertextlabs: your mad now yess
brownyyyylocks: yo
Rovelo: LICENSING LVL 2 LUL
v0sn: openai &gt; helm ai
elliotc90: george how did you get into programming?
soeim: good job triggering him
Ghost_001: LUL
C0deCane: @benchai18 i like open source better bro
WatchMeFailPlay: New Jersey represent! Big fan since I was 14. You're the reason I got into the world jailbreaking. Big ups man
miiiiiiim: people with money dont like the words open source
Abnico: darwinsim
hypertextlabs: that's my question right
benchai18: @jbnunn His coronavirus video. YT: “Lex Friedman corona”
Mieer: @georgehotz - Will India out-perform US in virus spread and dynamics ??
birkett0011: @georgehotz you done much in simulation? https://hash.ai/
hypertextlabs: tru Tru srry
benchai18: @c0decane No bro. NO!
OmegaThicccBoi: LUL
hypertextlabs: back to CV//19
C0deCane: lol brooooooo
Rashad242: let's hack
jbnunn: ty @benchai18
brownyyyylocks: Anyone have link to the space casino book from yesterday stream?
bichid69: brum brum with the boom boom
benchai18: @c0decane Would u be my bro, brah?
logi6000: anyone have that link about hacking yesterday
lordkyrus: lordkyrus subscribed with Twitch Prime.
logi6000: that book
almonte550: 0.8 millions only?
r0xtehem0x: Can you explain the % of total? those look high
elliotc90: @georgehotz do something useful bro, you are not going to make any breakthrough in this field. You know literally 0
brittonx2: great news
Mieer: How bad can coronavirus get in the US? We’re about to find out. https://www.datawrapper.de/_/CUi1z/
logi6000: @elliotc90 you never know man
bichid69: @elliotc90 its not about results ITS THE JOURNEY BRO
Landowner555: fuck seriously, 6 weeks?
Ayyyy420Lmao: just flatten the curve over 10 years lmao
Rovelo: 8 people at our company went to austria for skiing and all 8 came back with coronavirus monkaS
Greaser_1: Hi, from Portugal!
elliotc90: @logi6000 of course we do. He has no background in this field. To think he can do something is very naive.
benchai18: Btw tried the fish tank cleaner last night. Didn’t work. Fucking killed me actually.
stalys_: monkaS
s0rrz: bro let people have fun @elliotc90
Mieer: If Corona is not killing us.. it will be the quarantine that will. We are SOCIAL beings.. I don't think I can remain at home until June
Mieer: 6 weeks is ALOT
nomad119: Comma Bio would've let them know for sure.
bichid69: 6 WEEKS OF SUCK YO
Srule: Would a 60% key board be ok for watching pornhub?
bigduddas: squadHYPERS no school
Ayyyy420Lmao: a life of suck
miiiiiiim: @elliotc90 how dare you mess around with something you dont understand
logi6000: @elliotc90 even if he doesn't get any results. it's about the journey. plus he never streams and now he does
almonte550: Are some people already immune from exposure to other coronavirus?
Rovelo: @almonte550 no
Ayyyy420Lmao: do they even have models
almonte550: @Rovelo link?
elliotc90: @logi6000 at least he could do something he is good at tbh. I guess its okay tho
bichid69: the UK are using a C based model from 13  years ago
Lizardan: Wait how did he snap windows to the side on a MAc?
Mieer: I am off to sleep. I have an exam in 2 days
logi6000: @srule no you need more room to catch the cum
Rovelo: @almonte550 wdym? its a different virus from other coronaviruses
Mieer: People out my dudes
yungdeli_: what do you do during the day&gt;
liiiiiig0: LUL
brownyyyylocks: u guys the book link from yesterday!! anyone remember?
mritzing: part of the problem is a lot of it is being handled at a state by state level, so there's 50 different chances for incompetence there
brittonx2: they do what they do because the general population would lose their minds if they knew the truth
bichid69: MULTI SEQUENCE ALIGNMENT
bichid69: DYNAMIC PROGRAMMING YO
Ayyyy420Lmao: heuristics algo for alignement
Rovelo: @almonte550 you can't expect to develop immunity to coronavirus if you have something completely different
stalys_: only in NY?
aaaakshat: LUL
Ayyyy420Lmao: who cares torrents &gt; premium
yaus_baus: stay flattened bros
aaaakshat: pornhub stonks going up now
Rovelo: @almonte550 or novel coronavirus i mean
o______________________k: going there now !
Lizardan: premium is bad
logi6000: I now have plans after the stream
1monkjuice: i mean youre talking about it now
firmstool: SOME people. PEPE
Mieer: XD
bigduddas: 420lamo ok dud
slimpimp007: this is a simp trap
1monkjuice: i might even drop a visit now
Lizardan: It's even more fake
1monkjuice: they do a lot with ads
aaaakshat: just get adblock bro
Mint2bSpiced: Basic Local Alignment Search Tool (BLAST) finds regions of similarity between biological sequences. The program compares nucleotide or protein sequences to sequence databases and calculates the statistical significance.
Mieer: I am more interested in India (virus spread and dynamics)
Ozonemaster: how useless is it tho
Jehhred: homemade POV wil always be the best
DirectorHomeless: its fake af in 4k tho
leftyytwo: let's watch some pornhub premium together on stream
ad5k: Is pornhub actually a public company lol
Ayyyy420Lmao: there's a paper
logi6000: @leftyytwo I second that
Ayyyy420Lmao: look the original paper tha published blast
dsqst: Aight!
mritzing: i can see if i can find my old prof's pdb workshops :
wizardwatch1: OpenStax
happypuppppy: Molecular Biology of the Cell is pretty standard
Landowner555: i havea 4th ed of alberts essential biology Kappa
jimmyadaro: Sup boys
DatGuyToby: a man has as many masters as he has vices
eiscosogin1: i just did a lit review on machine learning
Ghost_001: practical knowledge is better, get that pornhub prem
Landowner555: essential cell biology*
1monkjuice: andrew Ng?
jbnunn: Sebastian's course
DatGuyToby: porn is control
deva73: what are views on fastai?
almonte550: @Rovelo I mean, what our antibodies look to find the virus is the spike and the nucleocapsid, are they so different that our body takes them as different things? for example the spike of sars and covid-19
mutrx: yo
birkett0011: Have you messed with RL in simulation ?
Srule: mindgeek
Mint2bSpiced: Molecular Biology of the Cell 6th Edition
Landowner555: "mom this isnt what it looks like"
Landowner555: yeah this one
logi6000: @landowner555 lmao
almonte550: @Rovelo when I said "they" I meant coronaviruses
aaaakshat: Most sin stocks aren't listed on public exchanges
happypuppppy: yea the 6th edition
Srule: pornhub goes by mind geek for corporate stuff.
DirectorHomeless: no porn companies are public, investors just buy infrastructure stocks since margins on porn are razor thin
Landowner555: i have the 4th edition of this book if u want, its not that good
aaaakshat: and investing in porn sounds weird
brownyyyylocks: Cellular and Molecular Immunology By Abbas, Lichtman, Pillai
elliotc90: comma ai doesnt have its own machine learning library. Most of you guys have no clue how it works in actuality. Not even george
Rovelo: @almonte550 yes
ak0ya_: Essential Cell Biology textbook
samosasauce8: https://github.com/kerasking/book-1/blob/master/ML Machine Learning-A Probabilistic Perspective.pdf
toldhow: why don't you take programming courses? from beginner to apocalyptic hacker??
Kodaly: mrmLaff
Rovelo: @almonte550 in very simple terms
brownyyyylocks: Modern Virology by Dimmock, Easton, Leppard
guinness84: LUL
guinness84: here we go
tupypaint: lol bout to get roasted
stalys_: PogChamp
FastCashCoding: lol
Incurs0: called out LUL
aaaakshat: eliotc90 is a troll he's been saying crap like this for a while nows
youngsachi: PogChamp
eiscosogin1: why write a library when other libraries are REALLY good
liiiiiig0: lol @elliotc90 gonna get rekt
Ziv0: elliotc90 is a troll
stalys_: roast incoming
ren1ght: coronavirus fetish
ak0ya_: https://www.amazon.com/Essential-Biology-Fifth-Bruce-Alberts-ebook/dp/B07TJJTGTV
Ayyyy420Lmao: why would u need ur own library just use that tool from google
Bloodswordz88: invest in porn. its future proof
hexicity1: @elliotc90 ...
Kodaly: what is the worst case runtime of randomized quick sort
logi6000: can't wait to see how this turns out
Program: good evening everyone
slimpimp007: LUL
brittonx2: LOL, did you get more groceries today or are the bags from yesterday? lol
mutrx: @elliotc90
Ghost_001: LUL
1monkjuice: 1monkjuice subscribed at Tier 1. They've subscribed for 2 months!
1monkjuice: officially funding coronavirus research
s0rrz: @elliotc90 cmon
FastCashCoding: @elliotc90 explain DansGame
Ghost_001: FANN &gt;
eiscosogin1: tensorflow isnt good enoguh for me reeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
logi6000: Elliot you gonna speak up
christianthefalco: UWU hacker daddy pls gib more book recos uwu
aaaakshat: LUL
Landowner555: this is THE standard in bio classes
shaquille_oatmeal5: paging elliot
Landowner555: 2nd/3rd
stalys_: don't deprive us of a good roast FeelsBadMan
tupypaint: dude is googling hard rn
FastCashCoding: lol
Landowner555: LUL "BEST BOOK EVER"
Incurs0: he left chat LUL
logi6000: maybe Elliot is just typing we will see
hexicity1: George Hotz is my favourite instagram influencer
pwnbase: @tupypaint he's googling how to unshit your pants
aaaakshat: hahahahjahaha
wizardwatch1: The openstax books are pretty good. They are free in the app or cheap for print
Usisuvach0: @georgehotz put sumamed in treatments also
s0rrz: maybe he some kind of genius
r0xtehem0x: r0xtehem0x subscribed at Tier 1.
tacorising3: @tupypaint lol
Landowner555: elliot90c is busy making season 6
aaaakshat: @eliotc90 where you gone buddy
OopsyPoosy: heya!
DirectorHomeless: imagine walking into the boardroom on a wednesday, meeting with the big boss, and he asks 'so, what have we bought recently?' 'well, we bought €500M AAPL, €150M NVDA and €800M PORN'
Usisuvach0: sumamed=pill
Ghost_001: machine learning streams when FeelsBadMan
Lizardan: h'es so gay
bcrscahh198987: !uptime
Kodaly: biology is pointless pretty soon humans wil lbe made from computers
logi6000: Elliot you gonna speak up
ad5k: Eliot doesn’t have time for you brainlets
ak0ya_: https://www.amazon.com/Essential-Biology-Fifth-Bruce-Alberts-ebook/dp/B07TJJTGTV this is a very good book for how cell works
birkett0011: MICOLOCONDRAIA IS POWER HOUSE OF THE CELL
yaus_baus: minecraft streams when
Rovelo: @almonte550 and not only that but vaccines can have unintended consequences aswell that have to be tested, and can have varying degrees of effectiveness
Usisuvach0: google sumamed
Program: can you get a textbook just on 'DNA'?
bcrscahh198987: You have an interesting life mr hotz
l1ght5p33d: We learned so much know protien Chem !!!!
C4TFive: the mitochondria is the powerhouse of the cell, we know this!
Ayyyy420Lmao: Cellular and Molecular Immunology 9th Edition Authors: Abul Abbas Andrew H. Lichtman Shiv Pillai this was the reference book for our inmunology credits
happypuppppy: LUL
Landowner555: are u gonna pirate these? legit want to know if its possible
Landowner555: IM NOT FBI
hexicity1: George how do you remain focused? i swear i have ADHD and cant focus on something i want to do sometimes
33333333333333: mitochondria is the power house of the cell bro. c'mon man, basic knowledge
brownyyyylocks: @ayyyy420lmao I have this textbook!
Ghost_001: botted reviews LUL
leftyytwo: elliot deleted his twithc acc
WatchMeFailPlay: eliot dipped
ak0ya_: I learned cell biology from that book
logi6000: @leftyytwo no way
Ayyyy420Lmao: @brownyyyylocks i pirated it :^DDD
hexicity1: George how do you remain focused? i swear i have ADHD and cant focus on something i want to do sometimes :/
optimizely: how do you think of interesting projects to work on?
leftyytwo: elliotc90: Tell me about how modern AI is just statistics and it is in no way capable of creating AGI. Also tell me why
l1ght5p33d: Substrate   Reagent = WINN
Ghost_001: @hexicity1 coke
atzehji: do we have some goal for the end of this series? @georgehotz
liiiiiig0: @Landowner555 just google Library Genesis
tupypaint: lol
youngsachi: LUL
blueglue321: How long does it take you to absorb a textbook?
christianthefalco: @hexicity1 pathetic
C0deCane: You order the lab equipment yet? @georgehotz
kp1877: Can I get a PlayStation rap? It would make my quarantine
hexicity1: @Ghost_001 tempting
logi6000: he spoken
lordkyrus: adderal
nomad119: We
hexicity1: @christianthefalco pathetic?
aaaakshat: do you speed read?
Landowner555: @liiiiiig0 oh ive heard about it
1monkjuice: this is like a course of how to learn
brownyyyylocks: LOL!! It's standard for 3rd yr immunology at my uni
Usisuvach0: https://www.drugs.com/international/sumamed.html they say this might be good
Landowner555: ty
nomad119: We all know that the layout matters
liiiiiig0: @Landowner555 np
logi6000: the hater spoke
ad5k: Speed reading is scam
optimizely: how do you think of projects to work on?
almonte550: @Rovelo and that's true because they are different viruses only? even tho they have almost the same spike which is the thing that antibodies are looking for?
stalys_: 4Head
happypuppppy: oh no plz just ignore the troll
youngsachi: 4Head
Jehhred: Next week he'll have a full blown lab with beakers and shit
yaus_baus: lmao
happypuppppy: he's cuttin into bio time
Lizardan: @optimizely by using his brain
WatchMeFailPlay: lmaoo
Ayyyy420Lmao: tulsi gabbard is hot
l1ght5p33d: RON PAULLL
Incurs0: comma.ai.bio
PiroFloydian: JEB
PiroFloydian: JEB JEB JEB
b1nk: i want tulsi to step on me
alwayxtoxic: supervised learning is just statistics
eiscosogin1: tulsi is hot and has half sane politics
FastCashCoding: rip ron paul
YoshikawaDotA: kek
mutrx: @georgehotz elliotc90: Tell me about what size of a total problem space is needed in order for a neural network to be able to "solve" it.
FastCashCoding: corona gonna take him out and all his btc
wizardwatch1: https://openstax.org/details/books/biology
Srule: man cracks iPhone in 2009, chat thinks he can hack a corona vaccine.
yaus_baus: supervised learning = excel regressions
optimizely: George how do you think of projects to work on?
theonlymonkas: bernie
C4TFive: How would the secret service protect Tulsi while she surfed? HahaThink
OopsyPoosy: 4am right now better see some progress
mritzing: Ron paul said coronavirus was a hoax, then rand paul got it
FurikuriYugi: Do you even science bro lol
Ayyyy420Lmao: Cellular and Molecular Immunology 9th Edition Authors: Abul Abbas Andrew H. Lichtman Shiv Pillai this was the reference book for our inmunology credits
brittonx2: Cheer100
eric_hansen: @georgehotz thanks for getting me and my entire family hooked on spindrift
almonte550: Hype trainnnnnnnnnnnnnnnnnn
aaaakshat: @Srule you'd be surprised at the power of chat
FastCashCoding: PogChamp
Ghost_001: scam train PogChamp
youngsachi: PogChamp
Incurs0: scam train PogChamp
FastCashCoding: lol scam train for sure
ar2zee: why you spent 3 days on coronavirus and we still have this disease
IndoPridePinoy: this streamer hype training off of coronaivurs, shameless
happypuppppy: time to get HYPED PogChamp
mutrx: @georgehotz elliotc90: Tell me about what size of a total problem space is needed in order for a neural network to be able to "solve" it.
FurikuriYugi: They could all catch it and die for all I care
Ayyyy420Lmao: for cell biology we used this one https://www.amazon.com/Molecular-Biology-Cell-Bruce-Alberts/dp/0815341059
wheely_mcbones: Watch the ones written by young proffesors
Ghost_001: not false
FastCashCoding: took 1 semester of cell bio
thekalkulator: hello world
Emanuell45: we all computer science majors here lol
Coolio1232: use the IB biology text book
theonlymonkas: give some book recommendations
logi6000: @georgehotz elliotc90: Tell me about what size of a total problem space is needed in order for a neural network to be able to "solve" it.
YoshikawaDotA: ur trying too hard elliot
Ziv0: elliotc90 took you that long to google that LUL
FastCashCoding: oh god
Vepicfishal: why is it forbidden to talk about typewriter?
Ayyyy420Lmao: trees? i smoke those
ad5k: Eliot couldn’t code a simple LGMA model
mutrx: @Coolio1232 was your IB exams cancelled lmao
l1ght5p33d: is this... SU groups?
mutrx: @georgehotz elliotc90: Tell me about what size of a total problem space is needed in order for a neural network to be able to "solve" it.
Rovelo: @almonte550 the spike binds differently, not by alot but by enough to rule out effective use of sars-cov antibodies for sars-cov-2
Coolio1232: @mutrx nah i graduated last year
FastCashCoding: dang dont be mean
Ayyyy420Lmao: man i linked 2 books
Krlithus: what is your goal?? are u looking to do some contribution to the vaccine research??
mutrx: immunology
thekalkulator: math major here
Incurs0: LUL
happypuppppy: monkaS
birkett0011: rip
almonte550: @Rovelo I see
youngsachi: LUL
FastCashCoding: lol
tupypaint: F
liiiiiig0: LUL
FastCashCoding: rip
yaus_baus: big flex
Emanuell45: f
shaquille_oatmeal5: F
DeathCavalier: F
jermss: pog
RelativeTimes: f
Ghost_001: LUL
PiroFloydian: F
Coolio1232: f
Landowner555: @mutrx immuno is too far left field i think
C0deCane: LUL
wizardwatch1: https://openstax.org/details/books/biology It’s free
purplegreenpanda: LUL
Srule: sorry, i'm straight
brownyyyylocks: BLOCKED
optimizely: @georgehotz how do you think of projects to work on?
FastCashCoding: geohot
lordkyrus: LUL
treestompztv: LUL
DeathCavalier: monkaS
1monkjuice: lmao
brittonx2: lol
logi6000: let's switch from dictator to communism
Emanuell45: @georgehotz becareful he might hack you
theonlymonkas: PogChamp PogChamp PogChamp
FastCashCoding: nb4 new account
deva73: hail the president
aaaakshat: mmmmblockin out the haters
JMSWRNR: do we need visa to be in this chat Kappa
FurikuriYugi: Boom ban hammer
eric_hansen: @georgehotz look at Campbell Biology by Pearson
TheKoreanZombi: By elliott, you machine larning flat-earther.
s4j0k5: what's basic lab equipment?
toldhow: why don't you take programming courses? from beginner to apocalyptic hacker
Ghost_001: quora LUL
Rovelo: @almonte550 the sequence of the amino acids binds differently to a large enough degree that is
Landowner555: dude theres no best course for biology, they are all tedious and time consuming
mritzing: just bio is super broad
logi6000: @jmswrnr yes your Visa is to follow
theonlymonkas: no news
bsx1123: microbiology
aaaakshat: penis study
wheely_mcbones: information theory in biology, I think is that
FurikuriYugi: All the things
FastCashCoding: lol your alma mater probably discovered comp bio @georgehotz
s4j0k5: what's basic lab equipment?
eric_hansen: @georgehotz I think the field you want to look at is "Synthetic Biology"
ak0ya_: MIT course 7 intro bio with eric lander is veru good
christianthefalco: and
ar2zee: I have K-1 visa
Ghost_001: CoolStoryBob
Landowner555: IaMaBiOlOgY
mutrx: @georgehotz i got biology, immunology and biochemistry notes
deva73: computational neuroscience sounds cool
death_gadget: Let's study Game Theory
AresRai: I am a biology monkaS
Program: monkaGUN
jermss: watch MIT bio course on youtube
aaaakshat: "I am not a computer, I am a biology" -geohot 2k20
FurikuriYugi: Know they self
Ayyyy420Lmao: classes in bio are pretty pointless since they just follow the reference book 90%  of the time
C0deCane: just found out im not a robot, thanks corona virus - @georgehotz
Natschz: gift me a sub please
nomad119: https://www.biostarhandbook.com/
brofessorbob: Do you know the Central Dogma of Biology
mritzing: PyMol is the software we'd use to do mol modeling
brofessorbob: ?
treestompztv: w e a r e b i o l o g y
ak0ya_: https://ocw.mit.edu/courses/biology/7-012-introduction-to-biology-fall-2004/index.htm
bttmndl: biology is just physics
Rovelo: @almonte550 if you look at flus, many of the antibodies are similar enough in function to work for future mutations, but mutations are also varied enough that some will be different enough to pass through
Emanuell45: biology sucks, its all about memorization
mutrx: @georgehotz i got biology, immunology and biochemistry notes
l1ght5p33d: you must follow the reference book
eric_hansen: @georgehotz Go look at the field of synthetic biology, I think it will fit what you're looking for
thekalkulator: @Emanuell45 i conquer
lordkyrus: just curious, why he's on a mac?
fxmatd: how long will we be confined?
l1ght5p33d: the reference book is all that is good and holy
brofessorbob: What about biology do you need to know?
lordkyrus: always tought about that
Ghost_001: just throw a NN at it 4Head
C0deCane: @fxmatd until its over
williamjennings1: Hype Train
AresRai: cellular biology train
mutrx: @georgehotz i got biology, immunology and biochemistry notes
brofessorbob: mix and match dna from different specieis
PiroFloydian: 69% nice
fxmatd: when over?
Srule: do you really read that fast or are you just flexing for chat?
ak0ya_: https://www.amazon.com/Physical-Biology-Cell-Rob-Phillips/dp/0815344503 this book is biology from physics perspective
Ghost_001: LUL
brofessorbob: charged atom
ak0ya_: yes! i did
ak0ya_: took it at MIT
Landowner555: no, i paid absurd amounts of money for my courses Kappa
C0deCane: @fxmatd when most of the world decides to give up
Digital_donger: I once read a wikipedia page Kappa
FastCashCoding: missing electron
thekalkulator: wth... is this chemistry?
Ghost_001: negatively charged no ?
almonte550: @Rovelo I was hoping to be immune to multiple coronaviruses just by being immune to covid-19 I guess that can't happen
christianthefalco: in my experience, bio doesn't have great layers of abstraction like software. You kinda need to know chemistry to say anything interesting about genetics
4zimut: (insert-comic-sans-joke)
Ayyyy420Lmao: molecule, you can have an ion of amphetamine
deva73: add or remove electron from atom
brofessorbob: incomplete valence electron
GoBerserk: @thekalkulator the first section is biochemistry
brofessorbob: partial dipole moments
FastCashCoding: the dipoles
C0deCane: Kappa
FastCashCoding: hehe
Emanuell45: @georgehotz wtf how do you remenber that?
fxmatd: @c0decane LUL
thekalkulator: thanks @GoBerserk
edeustua: dispersion force
deva73: charges
brofessorbob: partial dipoles br
brofessorbob: bro
Rovelo: @almonte550 on a positive note though, covid-19 seems to mutate less frequently which means a vaccine could cover for a significantly longer period
AresRai: its not easy to to completely understand
21_savior: yo chat, why use chromium over chrome?
deva73: dipoles right
berkieee: what are any of the forces
mritzing: vanderwales is a tent term
PiroFloydian: @21_savior open source
phyde79: need a course, from the atom to the vaccine
almonte550: @Rovelo ok, that's some good news
mritzing: gromacs   pymol
Srule: my main is acing the qui without studying
deva73: nope
FastCashCoding: negative
GoBerserk: you did them backwards
FastCashCoding: POsitive is cation
almonte550: @Rovelo thanks for the clarifications btw!
FastCashCoding: NH
Landowner555: THEY ALL HAVE COOH AND NH2
Digital_donger: @21_savior sometimes less google
deva73: nh2 group
brofessorbob: Correct
edeustua: acid on one side, amino on the other
Ayyyy420Lmao: is this college level?
edeustua: NH3 and COOH
Cammmmy: Is that comic sans?
wizardwatch1: Everything but the r group
Mint2bSpiced: I would also recommend Essential Bioinformatics by Jin Xiong
Rovelo: @almonte550 nps :) love to help inform in these uncertain times
GoBerserk: @Ayyyy420Lmao yes
AresRai: @Ayyyy420Lmao no this i highschool level for now
edeustua: NH2*
ankitc: i fell dumber everysecnd
deva73: electronegativity
Ayyyy420Lmao: looks really basic
PiroFloydian: OH group
GoBerserk: OH
atzehji: why are you interested in biology again?
Landowner555: LUL
l1ght5p33d: Nucleus
Ayyyy420Lmao: nucleus...
edeustua: nucleus!
FastCashCoding: the hydroxl has some positive charge
Rovelo: LUL highschool biology
djcows: Do you have photographic memory?
logi6000: pro has no nuleus
slimpimp007: still glad I took SL chem
ak0ya_: nucleus
logi6000: this is middle school level
l1ght5p33d: Nucleus stuff
alextodoroki: tfw cheating with twitch chat
Landowner555: OLD xd
Ayyyy420Lmao: old kek
l1ght5p33d: Nucleus stuff ** general **
deva73: prokaryotics have primitive nucleus
Emanuell45: @logi6000 still dont understand 0 of it lol
logi6000: @emanuell45 lol
AresRai: prokaryote cells got that easy share system too
mutrx: @georgehotz MDS are pretty cool but if you're trying to use it to predict a specific outcome (mutagenicity, toxicity..etc.) then we've found in our lab that actually calculating various quantum mechanical descriptors from the molecules and deriving a model from this is more accurate than simulating; look into SAMPL6 competition for malaria.
almonte550: @Rovelo actually that give me curiosity of how specific antibodies for a virus are created... I'll research about it later
eric_hansen: georgehotz presents: "Twitch Learns BIology"
jermss: ribosomes make protein
l1ght5p33d: WE WANT MORE RNA SEQUENCE
logi6000: you don't know lysosomes or ribosomes
deva73: talking about nucleus lets shift the dioscussion towards nukes😂
eric_hansen: p r o t e i n
latenightbj: latenightbj subscribed with Twitch Prime.
logi6000: yes
Ayyyy420Lmao: ofc
Emanuell45: no lol
Landowner555: u learn it then u forget it...
GoBerserk: yeah
mutrx: @georgehotz MDS are pretty cool but if you're trying to use it to predict a specific outcome (mutagenicity, toxicity..etc.) then we've found in our lab that actually calculating various quantum mechanical descriptors from the molecules and deriving a model from this is more accurate than simulating; look into SAMPL6 competition for malaria.
Digital_donger: I forgot all of this NotLikeThis
Emanuell45: @Ayyyy420Lmao how do you konw it lol
PiroFloydian: ribosomes are the 3d printers @georgehotz
Rovelo: @almonte550 videos on youtube are a good way to learn the basics fast, use articles and research papers once you have fundamentals down :) happy researching!
Ghost_001: monkaS
FancyDawg_: Hey George can you refresh us on what you are doing?
axlebear: Yeah organic chem guys have all the amino acids grilled into them
eric_hansen: something something lipids something soap wash your hands
Ayyyy420Lmao: abstraction/classification you have the short chain/branched, the acidics the basics the and the aromatics
Ghost_001: bio people are hardcore monkaS
Rovelo: organic chem flashbacks ResidentSleeper
Plurmorant: bio tests monkaS
mutrx: disuphide
Landowner555: THEY ARE
Plurmorant: I beat molek-syntez, so I'm a bit of a legend
logi6000: George do you want a basic bio quizlet
Landowner555: hydrogen bonds
christianthefalco: h bonds baby
GoBerserk: they are h-bonds
RakeRoux: *Don't touch your face
jermss: DNA has hydrogen bonds
Landowner555: mendelian genetics is the hugest waste of time holy fk
Ayyyy420Lmao: mr I dont care about the basis of eugenics wew
logi6000: George do you want a basic bio quizlet
Plurmorant: GTACGTGATCGACG
Landowner555: LMAo
Landowner555: matching pattersn
Landowner555: SeemsGood
Emanuell45: Am i the only one lost with this stuff?
Plurmorant: @Emanuell45 no one here knows bio
mokmuu: @georgehotz this may be useful for later, but there is a terminal based cURL'able stats server - ' curl https://corona-stats.online '
eric_hansen: ResidentSleeper
christianthefalco: regulation baby. shit gets complicated
AresRai: half is artistic matching exam LUL
GoBerserk: @Emanuell45 probably not
joshiemoore: joshiemoore subscribed at Tier 1.
Ayyyy420Lmao: nothing to do
mutrx: @georgehotz MDS are pretty cool but if you're trying to use it to predict a specific outcome (mutagenicity, toxicity..etc.) then we've found in our lab that actually calculating various quantum mechanical descriptors from the molecules and deriving a model from this is more accurate than simulating; look into SAMPL6 competition for malaria.
logi6000: George do you want a basic bio quizlet
Emanuell45: @purplegreenpanda thank god, these people making feel dumb
Landowner555: promoters are just a region of DNA that transcirption factors bind to to initiate transcription
Ayyyy420Lmao: promoteres are dna sequences tha bind to proteins that promote dna transcription of nearby elements
Program: They promote priming ;)
Rovelo: @Emanuell45 its not too bad, just a bit fast if you don't know the basics
SpyKnife: when are you going to beat plague inc? :P
l1ght5p33d: unknown unknowns T_T
Kawhiet: This font makes the quiz seem like its for middle school
logi6000: @spyknife he is the cure bubbles that you forgot to pop
Landowner555: dont waste ur time with sequencing stuff
l1ght5p33d: the one that amplifies it
Musashhhi: these streams are awesome
Ayyyy420Lmao: nope
happypuppppy: @georgehotz you should do 7.103 instead, its also intro bio but with more focus on genetics / cancer / virology
l1ght5p33d: crispr is plasmid fuckings
happypuppppy: 7.013
logi6000: why can't we use CRISPR against rona
Landowner555: HAHA
doretts: @Musashhhi Indeed!
r0xtehem0x: PhD bio friend said this is the standard bio book: https://www.amazon.com/Campbell-Biology-11th-Lisa-Urry but also recommends the one you're leaning towards
happypuppppy: @geohotz 7.013
Landowner555: @r0xtehem0x its not working link
dzid26: instead?
Ayyyy420Lmao: not cell bio tho it's more general
Landowner555: WHO SAYS POOR REFERENCING
christianthefalco: NEW LEX FRIDMAN INTERVIEW
Landowner555: HAHAHAHA
edeustua: thats the basic one
Ghost_001: LUL
Rovelo: 1 STAR FOR CONDITION LUL
eric_hansen: @georgehotz I can attest to the campbell bio book being a good choice
localcanofdutchgold: 5Head
DefinitlyNotXanbot: u can download those books?
Landowner555: dude u had the good cell bio book
r0xtehem0x: Could be a big scam book
C0deCane: make your children glow at night with crisper, buy now for just 46 ez monthly payments of 2500 USD's
Rovelo: GLOBAL WARMING IS A MYTH nymnKRD
AresRai: a few corona viruses were found in the melted ice LUL
1monkjuice: diggin down the rabbit hole 4real
Rovelo: i am fucking terrified with russian permafrost viruses monkaS
Kemisdan: LUL
Landowner555: LMFAO
Incurs0: LUL
almonte550: HAHAHAHAH
birkett0011: LUL
alicyka: biology without ecology is just learning a single organism
Hawklite: increase global warming to kill coronavirus is the only answer
happypuppppy: @geohotz 7.013, i typed it wrong last time
Landowner555: @alicyka ecology sucks bro
logi6000: @hawklite ah yes the final solition
MrStereoX: Hey ! @georgehotz have you ever heard about the "black cube" company ?
ron1n541: ron1n541 subscribed with Twitch Prime.
PiroFloydian: @Hawklite and release long dead viruses frozen in ice
l1ght5p33d: With catalytic converter you can burn 1000 gallons doesn't matter for the environment
wholesome_pepe: systems biology is what ur looking for
1monkjuice: 7.013 7.013 7.013
1monkjuice: ye
alicyka: well I'm too drunk and dumb to know anything so you can't convince me landowner
0deinkymi0: check out library genesis for free pdfs (it's legal too)
alicyka: i win
Landowner555: Keepo
onemarko: did you hear about cell phone subscriptions drop in china? conspiracy?
guinness84: can you repeat that
latenightbj: @0deinkymi0 lol i was literally pullling thee books on there
Landowner555: DNA MAN
wholesome_pepe: systems bio is data sci  moleecular bio
FastCashCoding: lipds
almonte550: Did we failed the other exam?
cleofn: 5head
cleofn: 5Head
l1ght5p33d: ENZYME
mritzing: fat
mikenachos: lipids are fats
Rovelo: fat
ViennaZoe: what are we doing?
Ayyyy420Lmao: @ViennaZoe revieew of highschool curriculum
almonte550: @ViennaZoe learning stuff
l1ght5p33d: enzyme == catalyst == true
MrStereoX: Hey ! @georgehotz have you ever heard about the "black cube" company ?
ar2zee: He doesn't believe in global warming or what, I don't get it? how he will explain all the things that happening right now in Antarctica ?
shaselton: well, hello there
tykabmo: He is going full dowrigHakc dowrigHakc dowrigHakc dowrigHakc mode!
mritzing: better off with a bioinformatics course?
GoBerserk: @ar2zee he said he understands its real, he just doesn't want it shoved in his face
C0deCane: @tykabmo LUL dowrigHakc yup
logi6000: @ar2zee no he just doesn't want it shoved down his throat every second
ViennaZoe: ok @ayyyy420lmao
genieyou1: Hi bro love you
ackxhpaez: I’m all for global warming. I hate cold weather
AresRai: @ar2zee learn to phrase it better than "things happenings in antartica" if you want people to take u seriously
amo77777: @ackxhpaez same
1monkjuice: intro to algos nostalgia in this web :)
tykabmo: @C0deCane oh hello again code, how are you doing?
Landowner555: speaking of MIT open courseware, Eric Lander has great lectures on youtube
logi6000: @aresrai whatever man we got the idea
l1ght5p33d: open book / notes / group test or no......
C0deCane: pretty good man, hbu? stayin healthy? @tykabmo
ar2zee: @AresRai ok
mik12f4: can you reverse engineer what makes COVID19 different concerning asymptomatic spreading?
alicyka: I'm having a fucking dance party in the arctic, explain that warming truthers w
guinness84: lol
Landowner555: @mik12f4 litreally no one knows that
tykabmo: @C0deCane yeah staying away from Covid-19 and doing more programming lol.
Shelledlizard4: hey
Ayyyy420Lmao: @Landowner555 God does Kappa Kappa Kappa
Landowner555: Keepo
mimiron010: did he pee in like 5 seconds
painpainmorepain: r u pooping
Digital_donger: wash hands DansGame
kthxbai32: TableHere
mikenachos: i think its like any virus, the body doesnt respond to the virulent DNA so it has to run through the cycle to eventually build antibodies using light/heavy antibody combinations
ar2zee: @mimiron010 nohe pooped
Ayyyy420Lmao: chicken tendies better
eric_hansen: You didn't wash your hands for 20 seconds @georgehotz
antonypereira88: TheIlluminati
painpainmorepain: u dick will catch corona
phrixus_bro: i like fish
alicyka: fish fillet is the best food in the world
happypuppppy: not rationing his food :z
C0deCane: Antarctica might be pretty nice in our future
shaselton: what do I think of fish...i think, "meh"
dr_set: that you apartment is going to stink
Digital_donger: dead fish PogChamp
antonypereira88: LUL
kthxbai32: 20second dinner
painpainmorepain: u need cap to go to the other part
eric_hansen: that single cube of ice on the ground bothers me so much
wholesome_pepe: i'm just happy python has so many toolkits for scientists. makes life so much easier
logi6000: @painpainmorepain yo that sound like a fucking death sentence
cankunwang: Same my dinner
alicyka: I don't even know what kind of fish it is, it's jsut delicious. Make like 8 of those bitches dude! Shit rocks my socks!!!
Landowner555: ur kitchen is fkn huge dude
mutrx: guys you realise the washing ur hands and not touching your face meme applies to when youre OUTSIDE
guinness84: thats his bedroom
Ayyyy420Lmao: it's hake 90% of the time
C0deCane: just sitting here down on the beaches of Antarctica drinkin some Corona - 2075
Landowner555: @mutrx hey this isnt a biology stream 4Head
Digital_donger: his kitchen has a bed PogChamp
kthxbai32: Living room
eric_hansen: @Landowner555 that's the size of his entire house
Rovelo: NotLikeThis living on frozen food
aj37z: !uptime
mikenachos: look into light/heavy chains
logi6000: George what's up with that bed in your kitchen
Landowner555: @eric_hansen cbrahBuddy cbrahThrust
alicyka: covid doesn't apply to people that watch anime and program for weeks between trips outside
un3okapi: @mutrx memes are memes inside or outside
Zipzipcekirge: is folding at home a scam
painpainmorepain: @logi6000 absolutely
mritzing: jin xiong is good fundamentals
cankunwang: Mol bio of cells https://send.firefox.com/download/a467a695c0c20f93/#yqKaOlQvHeZiUwmcdXhq7Q
axlebear: folding laundry at home
dendyliu: a
wizardwatch1: https://openstax.org/details/books/biology
MichaelA1337: hey
C0deCane: I just fly my drone into town to pick up groceries 2025 America after corona
painpainmorepain: find the cure man, i just tested positive
eric_hansen: @georgehotz go look at the field of synthetic biology
nomad119: @georgehotz https://www.biostarhandbook.com/
MichaelA1337: what are you working on rn?
murkythunder: @painpainmorepain really? and its too late for you its a vaccine not a cure
AresRai: @MichaelA1337 biology 101
wizardwatch1: https://openstax.org/details/books/biology It is free and great
C0deCane: better yet groceries just come to you via drone LUL
Sniky83: have you watched this ? https://www.youtube.com/watch?v=gG7uCskUOrA
eric_hansen: @georgehotz go look at the field of synthetic biology
logi6000: @painpainmorepain that's a whole tragidy
daopportunist: Focus George.
roystang: we're advanced biology now
logi6000: @georgehotz painpainmorepain just got corona we need a cure now
guinness84: i live there pog
adibaby04: YOOO GEORGE WUZ POPPIN REMEMBER ME?
AresRai: yay intern streams
C0deCane: LUL try and hire a couple of them
painpainmorepain: @logi6000 thank u
Landowner555: LMAO
0xbeeff00d: george create new corona latest v1.1
slimpimp007: let me drive the boat
Ayyyy420Lmao: google tailored sugestions
mritzing: nice targetted ad there
l1ght5p33d: is this.. docker for cells?
montrealchrislee: what are you studying?
aj37z: did you release the alpha version of vaccine yet
Ayyyy420Lmao: what are you trying with that paper?
el_pirulote: even gods have limits
davedavidsonfromdavis: e coli would look good on my wall
localcanofdutchgold: lul
AresRai: @georgehotz put it in the stream title LUL
citsejam12: people just don't understand EXPLORING ;-)
Ghost_001: Kappa
mikenachos: are you interested in drug manufacturing/antibody production?
painpainmorepain: @murkythunder cure vaccine like i care, just give me something that will end it, let it be George pee
Natschz: have to get clean before the teest right?
ron1n541: is open courseware legit? only cruised them, never finished one.
axlebear: For kratom too?
Plurmorant: @ron1n541 the best
firmstool: MOAR LAYERS
cankunwang: basically most about sequence alignment stuff
firmstool: herp derp
Ghost_001: mootif LUL
mikenachos: alpha and beta sheets
cankunwang: set of conserved regulatory elements
logi6000: one of your viewers has corona. it's painpainmorepain
Ghost_001: monkaS
l1ght5p33d: a legit scam maybe xDDDD
entangledbeing: Nice prof pic
AbsydeAuberon: Jebaited
ticklepusss: are you a polymath?
Landowner555: lmao
guinness84: im a pussymouth
localcanofdutchgold: ^
KillerBee20: are Andrew Ng's ML courses the best way to start out?
roystang: woah future
ron1n541: INVEST IN VIROLOGY FUTURES
entangledbeing: Anyone have comma ones in the chat?
Landowner555: future virology, ironic
Zipzipcekirge: aka world war 3
ron1n541: You heard it here
boozer_man: javascript
nitrixen: George seems like the kind of guy that'd be into Lisp.
wholesome_pepe: please dont make a bio-weapon Kappa
l1ght5p33d: wtf does covalent mean here
AresRai: actually future virology is still 10 years behind LUL
pz3300: What’s happenin George?
l1ght5p33d: ohhh covalent bonds... not math then ok
mritzing: within the sim
cankunwang: lol those bags still there
pavankumarp: time and dimension i believe
mikenachos: histones and the likes
logi6000: "those little shits" George hotz Jr 2020
atzehji: i don't have a textbook. but in bioiinformatics next semester i will study: basic molecular biology NGS technology TGS technology
l1ght5p33d: covalent ionic brings back poorly defined memories
GoBerserk: bats consume bugs
cankunwang: joker: kill the bats
Landowner555: bats r actually really important
davedavidsonfromdavis: how about people stop eating bats
localcanofdutchgold: they inspired the creation of batman
Appz_x: FBI OPEN UP
Ayyyy420Lmao: bats r cute
pz3300: No bat soup
el_pirulote: We kill the Batman
Usisuvach0: bats r cute lol
ron1n541: Their poop is real important to cave ecosystems
thugis123: I wish you the best of luck with that, batman wont be a easy fight
davedavidsonfromdavis: bats fried in delicious gutter oil
Usisuvach0: ugly as fuck creatures
axlebear: How about we just don’t eat bats
localcanofdutchgold: megabats are not cute
Jehhred: While we're at it, kill anything that shows any possibility of spreading disease
davedavidsonfromdavis: if you have never googled gutter oil.... have fun
Ayyyy420Lmao: we dont have megabats here just regular
dr_set: bats eat a shit ton of insects, but because we are already killing all the insects, we are on the way of starving all the bats
mutrx: 15 sources say... @georgehotz
pz3300: Fox bats aren’t cute
l1ght5p33d: covariant and contravariant much better defined... poor organic chemists
bttmndl: biology is just physics
AbsydeAuberon: bats are cute
happypuppppy: but those other articles they link to are news to whats the problem Kappa
WooWhey: Kill all the CNN's!
Usisuvach0: lol
Gustavevi: lmao
cankunwang: fake news~!
PiroFloydian: all science is just math if you abstract it enough @georgehotz
pz3300: CNN cites CNN
Ayyyy420Lmao: https://en.wikipedia.org/wiki/Common_noctule#/media/File:Nyctalus_noctula.jpg dont say its not cute
WooWhey: Anderson Cooper is the Anti-Christ.
Usisuvach0: fucking rat @Ayyyy420Lmao
nitrixen: Essentially, their immune system prevents them from dying from these deadly diseases, so they become great hosts.
mr_stochastic: He's back! Awesome :D
Usisuvach0: you call that cute
mutrx: birds &gt; bats
daopportunist: focus George
vruthlessv: how is that cute
Jehhred: For every one bat, kill a bird
Usisuvach0: he is trolling
Natschz: but if you kill the mother bat then all other bats die or get cured or does this only apply to vampires?
l1ght5p33d: they are pretty cute if u hear them chirp n stuff
gorgoleon89: wow, hots streaming 2 days in a row?
C0deCane: Theres a lot of scammers/trolls that take the formats of our media companies and post fake news online and people actually think its those media companies lol
AresRai: kill every host that has too strong of immune system compared to us :)
Usisuvach0: fucking bats carry around 300 viruses similar to this
happypuppppy: whats going to happen to batman if we do this BibleThump
l1ght5p33d: happy little bats
logi6000: @gorgoleon89 5 actually
goldensoap_: George Focus we need a cure and u are our last hope
mr_stochastic: @georgehotz You do most of this fun programming in the cloud or just on your laptop?
omniilista: https://www.youtube.com/watch?v=TfG_L49Hv-s come on man, leave the bats alone
Jehhred: @gorgoleon89 This is day 5
foti_kasparov: Would you rather eat a cooked bat or get into politics?
Ayyyy420Lmao: and cats give u toxoplasmosis and make u retarded
gorgoleon89: fug, missed the other 3 :D
cankunwang: lol
Landowner555: LMFAO
Landowner555: THAT WAS GORGE LIKE 2 MINS AGO
Landowner555: george*
logi6000: got it so we just need to nuke china
davedavidsonfromdavis: fry your bat in https://www.youtube.com/watch?v=zrv78nG9R04
localcanofdutchgold: imagine strolling and then you see this fool https://i.pinimg.com/originals/ff/3f/71/ff3f71492d7b360b06a5ebe1280aa100.jpg
boriskurikhin: finally i caught a geohot livestream
C0deCane: bats kill all the mosquitoes, how about make china regulate what the hell their citizens are selling and eating
Jehhred: What if we deep fry all the bats?!
davedavidsonfromdavis: deep fry in https://www.youtube.com/watch?v=zrv78nG9R04
benchai18: No need to panic guys. I’m back
vruthlessv: what
Krakken_TM: yo george
Usisuvach0: china are disgusting
Usisuvach0: they eat dogs cats
gorgoleon89: my nose is runny, how fuged am i? @georgehotz
Usisuvach0: everything that should not be eaten
logi6000: got it just need to nuke china. I'll go get the codes now. ( FBI agent I'm joking don't worry. I couldn't get the codes if I wanted to anyways)
SpaceGhost8: i missed the ending last night, are we building a lab?
benchai18: @usisuvach0 Mongolian delicacy is rats, btw
Krakken_TM: i found an epic conspiracy theory thats not so crazy and backed up by very logical stuff. u want me to send u the link from youtube so u can watch later if u into these things? :D
Usisuvach0: bullshit
benchai18: Fucking gross
Usisuvach0: eating rats
benchai18: Swear
C0deCane: @Usisuvach0 thats a little far for me but seriously they just need to regulate some things. im fine with cultural beliefs but for fuck sake
mik12f4: can twitch alert people when channels are streaming?
Usisuvach0: disgusting as fuck
thecoder15: yo turn your volume up @georgehotz
thrashtazs: @georgehotz did you end up buying a bunch of lab gear last night
dzid26: is our body temperature related to tempreture at which viruses die?
brownyyyylocks: im a vegetarian
atzehji: i don't have a textbook. but in bioiinformatics next semester i will study: basic molecular biology; NGS technology TGS technology; idk if it helps
AresRai: :o
Landowner555: LOl i found that out like a few days ago too
l1ght5p33d: v-diff corona.alpha corona.beta
Natschz: don't get attached to it!
Jehhred: deep fry the bats
AbsydeAuberon: cute coronavirus absydeUWU
Appz_x: you mean it doesnt come from beer?
Time4Boom: corona = crown (spanish)
cellophane11578: the cutest viruses get all the attention
dog_runner09: uma delicia
benchai18: @usisuvach0 For real. A close business associate of mine is like a filthy wealthy Mongolian, and this bitch starts showing me what we’ll do in Mongolia if I come visit. Fucking rat snacks
5_betbluff: you see Fauchi said covid might be seasonal?
Ayyyy420Lmao: sopa do pangolin
dingus74: Dont eat bats
Gamer_nohope: @dog_runner09 lol
cellophane11578: can bats eat us?
Gamer_nohope: esses BRs
mr_stochastic: @cellophane11578 Yes, they're called vampires
C0deCane: I guess thats what you have to do when you have a population that large ?????
ron1n541: @cellophane11578 not if we eat them first
cellophane11578: lol
l1ght5p33d: ACE 2 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
OlympusDev: Hey
Appz_x: i was reading that certain blood types make you more susceptible to corona
knilecrack: hey man
Zipzipcekirge: if we bite bats do they get a virus?
logi6000: I only know about the cannibinoid receptor
C0deCane: we would actually be in shape in america if they ate cows like we do LUL
vruthlessv: so bats are immune to all corona viruses?
benchai18: According to some scholar Chinese guy (critical of his own government) claims that it’s the super rich elite that eat the disgusting shit
t00big2fl4il: Yo what up? Mac n cheese and a sick Stream!
dingus74: Is eating bats Keto
ron1n541: not pangolins?
architectzs: yo
knilecrack: so feel free to eat bats
mritzing: https://www.rcsb.org/news?year=2020&amp;article=5e74d55d2d410731e9944f52 here's good images of corona
benchai18: @dingus74 Nah. Paleo tho
C0deCane: flying rats dude
ron1n541: i thought the interm carrier was the pangolin
bufferovrflw: @vruthlessv If they were immune, bat coronavirus would die, sicne it can
l1ght5p33d: called what
bufferovrflw: *can't propagate
knilecrack: on steroids
eric_hansen: @georgehotz take a look at this paper titled "Coronavirus Genomics and Bioinformatics Analysis": https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3185738/
roystang: from camels
vruthlessv: but they are carriers
architectzs: what’s a good windows manager for windows?
echobrother: can you do hacking tutorials
aj37z: 100x lev
Jehhred: Bats are carrier pigeons for corona virus
architectzs: ^^
knilecrack: South Korea had incident
vruthlessv: its like mosquitoes
logi6000: @echobrother this is hacking
l1ght5p33d: get your vaccinations kidssss
SpaceGhost8: great, another pandemic to look forward to
wholesome_pepe: can we hack the corona to a therapeutic RNA sequence instead of a pathogenic one via crispr?
HexaField: @echobrother hacking tutorial is an oxymoron. teach yourself.
foti_kasparov: But is it possible to try the vaccine on bats rather than people?
Gamer_nohope: "Approximately 35% of patients with MERS have died"
mr_stochastic: @architectzs Default, you're not gonna get much more on windows
benchai18: I wonder if there’s a MERS vac
architectzs: idk how to use default lmao
benchai18: Vax
scarbromangler: @benchai18 i don't think there is
benchai18: Fuck
scarbromangler: funding dried up a few months after sars lol
DrakenZA: it seems viruses have a limited set of resources and they can be super deadly, but not spread well, or spread well and just be super deadly
SolarBerry: this is the equivalent of plague before antibiotics
informalgarlic: George is great at everything except econ
mr_stochastic: @architectzs Ha, start with alt-tab :D
tsAllySparkles: fung &amp; liu? more like lung and flu
architectzs: ik that lmao
benchai18: @solarberry What is? Covid?!
echobrother: @hexafield: no its not
amedhussaini: amedhussaini subscribed with Twitch Prime.
guinness84: heres this big fucking word that no one knows but ima use it so. i get published
ron1n541: or intel circa 2019 ayyyyyy
HexaField: @informalgarlic the first law of economics is that everyone is terrible at economics
benchai18: @solarberry Corona for sure isn’t like plague. Black Death took out I think 25%  of Europe
echobrother: @HexaField: how is this hacking
knilecrack: all bad things happen in europe :)
logi6000: yeah it's where the lysosomes get their driving license. the dmv
benchai18: I don’t mean fatality rate, I mean 25% of ALL Europe does
benchai18: Died*
logi6000: rough and smooth er
knilecrack: yeah
guinness84: just put in an order for $1200 worth of weed
ron1n541: ER is bio101 dude
Mint2bSpiced: Here is another book recommendation if you want more stats stuff: Statistics and Data Analysis for Microarrays Using R and Bioconductor, Second Edition (Chapman &amp; Hall/CRC Mathematical and Computational Biology)
bufferovrflw: I really like the vibe to this stream
guinness84: :bless:
wholesome_pepe: ACE2 could be a good target to deliver drugs to lungs or GI tract if we can exploit it with engineering
HexaField: @echobrother you are incoherent
AntiVax_SoccerMom: plague is still around
logi6000: rough er has ribosomes over it
Usisuvach0: black death=bacteria
SpaceGhost8: says bacteria right there
Usisuvach0: yersinia pestis
benchai18: Bacteria
alicyka: we should know because it showed up at Comicon 3 years ago
360Plato: ? its in the first line
Ayyyy420Lmao: it say amoeba right there
AresRai: Bacteria were so tough
aMANT3: damni thought the beep was for me
spockshocks: black death is basically SARS
logi6000: George do you want a basic bio quizlet
Landowner555: @aMANT3 it sounds very realistic
echobrother: @HexaField You don't know the definition of incoherent
brownyyyylocks: awful diet
benchai18: Bacteria not virus. Bubonic plague was the most known form. Yersinia pestis is right
Landowner555: arent all bacteria prokaryotes?
foti_kasparov: prognosis of deaths is much better cbrahDavid cbrahDavid
pz3300: Pro
Ayyyy420Lmao: @Landowner555 not in this stream
benchai18: BLACK DEATH was the name of the outbreak
Zipzipcekirge: china again
SpaceGhost8: also in China LUL
wholesome_pepe: @Landowner555 some bacterium dont have a nucleus
echobrother: @HexaField how can you teach your self hacking?
benchai18: Consumption was NUTS. Tuberculosis. White plague
Landowner555: @wholesome_pepe exactly, tjats a prokaryote
logi6000: George do you want a basic bio quizlet
AresRai: no anti biotics, bacteria had rent free
pz3300: Poor nutrition
chucknorrisbeard12: black plague 200 million?
Ozonemaster: they eat with hands in the floor in india
Bloodswordz88: HahaThisisfine
SpaceGhost8: medicine wasn't even a thing back then
alicyka: What do you call 20 million dead Chinese people? a Leap year
Ozonemaster: its amazing that it is not happening atm
knilecrack: how much Spanish flue killed people?
Appz_x: spanish flu 50 mill
brownyyyylocks: @ozonemaster No, they don't.
knilecrack: damn
1monkjuice: poverty 500m 
knilecrack: that's like most deadliest isn't it?
shissle: spanish flu -120M died
cellophane11578: rip
vruthlessv: It's hilarious coz if you remember there were loads of memes at the start of 2020 about there being "plagues" every 100 years on 1820, 1920 and 2020
bufferovrflw: @georgehotz How did they "beat" the black plague? Or did just enough people die for it to not spread anymore?
OlympusDev: I have way too many channel points
benchai18: Here’s a fucking thought. What happens if bubonic plague mutates. It’s gonna rape all of us to death
echobrother: How can you teach yourself Hacking
benchai18: @bufferovrflw Quarantine. That was the start.
mrhdr: Write something special below and give it some glitz in chat!
see_you198: H y
SpaceGhost8: -380 :)
Ayyyy420Lmao: shiny mesage
OlympusDev: Something Special
mr_stochastic: @echobrother Just start programming on some project you're interested in. Learn as you go
knilecrack: @benchai18 no. It does not have where to mutate
wholesome_pepe: a lot of therapies are focused on delivering drugs to the cytoplasm cuz getting into the nucleus is hard
bufferovrflw: @benchai18 How long did it lasT?
benchai18: @bufferovrflw Then, anti biotics.
JesseSkinner: hows the research going?
goldensoap_: geohot how can to learn myself hacking
alicyka: Highlightest messages are blackface for twitch
l1ght5p33d: This is the 1337est stream on earth
knilecrack: @benchai18 if it didn't foind something else to live in
OlympusDev: Something Special!
eric_hansen: looks like a buffer overflow attack LOL
benchai18: @knilecrack But what about in rats??
logi6000: @goldensoap_ first learn English
echobrother: @mr_stochastic But programming is different then hacking
masee14: So what are we doing here?
knilecrack: @benchai18 let's hope they die fast, and we don't eat them
goldensoap_: @logi6000 (
benchai18: @knilecrack Amen, but it came to us from rat fleas. Not eating rats
benchai18: New York could be fucked
mr_stochastic: @echobrother Depends what you mean by "hack", but either way programming is involved :d
ron1n541: oh shit nature is using ASLR
prostidude221: @echobrother ???
alicyka: new york fucked = fine by me
echobrother: @masee14 We are hacking the coronavirus
knilecrack: @benchai18 well that can be tricky
brittonx2: Cheer100
Usisuvach0: https://www.ovulation-calculators.com/coronavirus/
pwnbutt: @georgehotz what is this that your coding? :)
Usisuvach0: are china hiding
Usisuvach0: no new cases there at all
knilecrack: @benchai18 but if organisms die fast that are infected by the virus, then it' hard that is going to mutate. That is why corona is serious
d3estruction: !commands
0xatul: China numba WAN
NullJupiter: hey there
m113v: corona is not apple, u cant hack it Kappa
Ayyyy420Lmao: compress your genome with frameshifting
NullJupiter: wtf are you doing?
Usisuvach0: usa=10k new cases
gill_bates_macrosoft: wassup boys
knilecrack: ola
knilecrack: gill bates :D
davedavidsonfromdavis: https://www.youtube.com/watch?v=zrv78nG9R04
masee14: What does "hacking" the coronavirus mean?
logi6000: @knilecrack yeah the CEO of macrosoft. you don't know him. the only CEO with down syndrome
pz3300: Make a vaccine before bill gates does george. Or were all fucked!
starone5: can someone explain me what he's working on, or is there a link or something I can read about it?
C0deCane: apparently there are seven known coronaviruses that can affect people
SpaceGhost8: I thought Elon was going to save us
Ne0Zer0: it means pretending to reverse it Kappa
Ayyyy420Lmao: the underscore means the end of a codon
Ayyyy420Lmao: the underscore means the end of a codon.
benchai18: @bufferovrflw It wasn’t one event. It recurred until last century. But the HORRENDOUS outbreaks were in the 1300’s I think. And BTW, the death toll was 30-60% of Europe
C0deCane: Elon's down in his private tunnel just chillin with all the toilet paper
l1ght5p33d: gaining all knowledge of the system allows better hacks
bigduddas: HACKERMANS he cracking this
benchai18: @bufferovrflw outbreaks kept occurring. Europe, and also the Middle East via traders I think
SpaceGhost8: Tesla shifting all production to toilet paper PogChamp
Digital_donger: PogChamp
Bloodswordz88: :O
NullJupiter: what are you doing @georgehotz ?
Bloodswordz88: HahaSnowhal
pwnbutt: can someone tell me what he is doing?
foti_kasparov: the vaccine
NullJupiter: lol
AntiVax_SoccerMom: pwnbutt 99% of use dont know either
Ne0Zer0: hes doing his homework
pz3300: If you touch your face again george you will surely get corona
Appz_x: reverse engineering covid 19
Digital_donger: @pwnbutt studying the virus
ankitc: fitness twitch is a thing
logi6000: @pz3300 he's in quarantine
spockshocks: hes getting investors right now, it all looks really smart :)
C0deCane: new drinking game while under lockdown, everytime you hear the word corona take a shot LUL hahahaha
nitrixen: I followed along, but I've never touched python :(
foti_kasparov: But George said to tell that he's doing the vaccine if anybody asks
NullJupiter: he is learning from wikipedia lol
parviz_gc: hi
t00big2fl4il: frameshift = offset?
AntiVax_SoccerMom: nothing wrong with wikipedia
pz3300: But it will get in through under the doors
echobrother: what language is he coding in?
Digital_donger: @nitrixen just learn it 4Head
mashafique: @echobrother python
logi6000: @nitrixen it's fairly simple. you can prob get fairly good in a week with sentdex tutorials
Appz_x: python
cellophane11578: python is very readable and easy to get into
echobrother: @Appz_x It does not look like python to me
C0deCane: @AntiVax_SoccerMom except over 3 million articles are written by one person LUL
foti_kasparov: it is python
mr_stochastic: @echobrother It's certainly python
NullJupiter: it is just in the jupyter gui
Digital_donger: he's using a jupyter notebook
mr_stochastic: @NullJupiter That's the IDE
MurdocLIVE: Could you give a quick summary of your progress so far? I haven't had a chance to watch all the previous vods yet @georgehotz
logi6000: I can't stand jupiter
echobrother: @mr_stochastic What IDE is he using
shekshas369: @MurdocLIVE same same
logi6000: what's the point of jupiter
mr_stochastic: @logi6000 Cuz doesn't support vim? :(
C0deCane: @MurdocLIVE he said he will have this thing cracked in 12 weeks, well now 11
mashafique: @echobrother jupyter notebooks
mr_stochastic: @echobrother Jupyter Notebook
logi6000: @mr_stochastic I mean that too
C0deCane: Kappa
GFWL: there is good emacs implementation for jupyter :)
mr_stochastic: @GFWL How's that pinky doing lol
pz3300: @logi6000 I was gunna take cs50 on Edx to get started. Is that course worth taking?
MurdocLIVE: @C0deCane Ah thank you! Is there something he learned/discovered that led him to say that?
pwnbutt: Is java handier than python? Aiming to study 2 year program of java
Penguino138: Come on George move them groceries
GFWL: @mr_stochastic evil mode man
NullJupiter: jupyter is nice if you want to test something out
logi6000: @pz3300 huh
yungdeli_: what you eating?
mr_stochastic: @GFWL True dat. Spacemacs user?
nitrixen: Is it me or is the entire DNA field some programming in disguise? The code of life.
logi6000: edx?
jmv_chin: welcome back; how are you enjoying stream life
Mirw_: He's porting covid19 to osx
pz3300: Online computer courses.
Jehhred: Those groceries will stay there for the entire lockdown period
shekshas369: @nitrixen simulation theory i see what you did there
whycopper: lmfao
syns0r: !claim
dingus74: jackoo1Weird_SG
yungdeli_: isn't there things in there that need refrigeration?
GFWL: @mr_stochastic I never tried spacemacs, only have tried emacs gui. I thought doom emacs look interesting
Battlestein: Battlestein subscribed with Twitch Prime.
knilecrack: i didn't understand a word you said
foti_kasparov: SCAAAAMM TRAAAINNNN
logi6000: how about level 5 and we smoke weed
bufferovrflw: I like the groceries where they are rn tho
pz3300: Computer science. I’m a noob
guy_ross: guy_ross is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 13 in the channel!
guy_ross: guy_ross gifted a Tier 1 sub to Emanuell45!
guy_ross: guy_ross gifted a Tier 1 sub to publishcoffee!
guy_ross: guy_ross gifted a Tier 1 sub to ICAntF331MyFAce!
guy_ross: guy_ross gifted a Tier 1 sub to cactusvacuum!
guy_ross: guy_ross gifted a Tier 1 sub to DecayingSkullz!
entangledbeing: What’s level 3 lol
AntiVax_SoccerMom: SCAM TRAIN? PogChamp
Digital_donger: PogChamp grocery relocation goal
dingus74: PogChamp PogChamp PogChamp PogChamp PogChamp TriHard
peter35_: PogChamp
yungdeli_: SCAM TRAINNNNNN
Ayyyy420Lmao: stolen credit cards gang PogChamp PogChamp PogChamp
cactusvacuum: damn thanks @guy_ross :D
logi6000: ooooo gifters
shekshas369: PogChamp PogChamp PogChamp SeemsGood SeemsGood SeemsGood Kreygasm Kreygasm
knilecrack: @AntiVax_SoccerMom rofl @ your name ahahahaha
dingus74: scammed LOL
AresRai: PogChamp scam train choo chooo gift me
mutrx: dodged
foti_kasparov: Need 3 100 bits cheers
syns0r: LET'S GET HYYyPPPPEEEDDDD
mrhdr: guy_ross dodged :(
whycopper: choo choo
gordinhodaora: lol
guy_ross: hype!
theonlymonkas: we want gaming
whycopper: let em rot xD
foti_kasparov: GO SCAAAAM TRAAAIN
logi6000: level 5 and we smoke weed
AbsydeAuberon: PogChamp100
entangledbeing: Can someone explain level 3 pls
MurdocLIVE: Could you give a quick summary of your progress so far? I haven't had a chance to watch all the previous vods yet @georgehotz
mr_stochastic: @georgehotz What is level 3?
pwnbutt: @georgehotz whats handier to learn, java or python? or is there no big difference in the big picture
cellophane11578: Make another goal to set a washing hands record of 20sec
AresRai: @MurdocLIVE so hes earning biology 101 so far
dingus74: MercyWing1 TriHard MercyWing2
brownyyyylocks: twitchies revolt!!!
mashafique: whatcha eating there Geo
devm0d: Fish in its natural form
knilecrack: did you wash your hands bro? before eathing that
knilecrack: eating*
xmalware60: enjoy your meal
theonlymonkas: are you trying to scamm us?
devm0d: Scamsticks
logi6000: level 5 and we smoke weed
entangledbeing: Hearing Geo eat ASMR
ankitc: how big is your monitor
Jehhred: You live in La and aren't eating kale chips, what gives?!?!
Usisuvach0: onion rings?
Ayyyy420Lmao: tamoxifen
mr_stochastic: @Usisuvach0 Calamari
sidthescikid: monkaS
Ayyyy420Lmao: and theres aromatase inhibitors
Ayyyy420Lmao: why?
Slippery3: what are you up to @georgehotz ?
ymelnyk: ymelnyk subscribed with Twitch Prime.
logi6000: level 5 and we smoke weed
Usisuvach0: oh ok @mr_stochastic
nitrixen: @georgehotz Is it just me or the entire DNA field resembles a whole lot what we do in programming? But chemically.
entangledbeing: Start an ASMR channel eating your satsumas 😂
11plus4thinking: what are you eating :)
Ayyyy420Lmao: fishdicks
mortalal: @georgehotz what we programming today?
11plus4thinking: describe taste :)
hootdaflute: have you heard of Creutzfeldt-Jakob Disease, 100% fatal
yungdeli_: @mortalal no programming
whycopper: do you own a pornub account
whycopper: lmfaoo
hordead: LoL
Andremm2: still scary
4zimut: it's fine
guinness84: knowledge calms the soul Kappa
theonlymonkas: where is the tea?
knilecrack: rofl
eric_hansen: go take a look at virusite.org it's a website extracted from NCBI sequence databases and has features such as sequence searching
nitrixen: @whycopper I've worked at Pornhub, lol.
Ayyyy420Lmao: can jet fuel melt steel beams?
NullJupiter: It's scary for economy @georgehotz
yungdeli_: going through history hm.............
hordead: You skim through the papers... you don't even read them
whycopper: @nitrixen how was it? yall get discounts?
mutrx: @nitrixen is nothing NSFW then?
informalgarlic: Do you want coronavirus? I can get you coronavirus? @georgehotz
entangledbeing: Can u make a truths list and share it
eric_hansen: @georgehotz go take a look at virusite.org it's a website extracted from NCBI sequence databases and has features such as sequence searching
foti_kasparov: What's going on that new shit virus that started in China?
Jehhred: If anything I'm now more scared of SARS
xxblueshift: @georgehotz love from the UK
nitrixen: @whycopper We had access to the database, so yeah, of course we do :P
informalgarlic: More
11plus4thinking: if only 5% gets corona virus and the deathrate is 4% 16 mil will die
mutrx: look at SAMPL6 competition @georgehotz
Gamer_nohope: "doing corona virus marathon any %"
sidthescikid: 150k !
whycopper: @nitrixen dam son did you get to fuk
whycopper: lmfaooo jk
HellxNebula: what you would say to a beginner who wants get into coding , what language should be his first and how to get better @georgehotz
jermss: https://pubpeer.com/publications/B4044A446F35DF81789F6F20F8E0EE# Hydroxychloroquine and Azithromycin as a treatment of COVID-19: preliminary results of an open-label non-randomized clinical trial
Ayyyy420Lmao: good times
pagepuga: these deaths could overlap too because sick people die mostly
hordead: @georgehotz When is everything going back to normal?
Ayyyy420Lmao: i remember that time we had a bull market after the death plague
Digital_donger: but the second wave NotLikeThis
thecoder15: lol
zennydmt: have u been to india
Ayyyy420Lmao: black plague
Appz_x: what if it mutates MonkaS
meta_man: Yeah, going to be some overlap with some people who would have died this year anyway
hordead: @Digital_donger second wave ..??
theonlymonkas: how many new corona cases?
guinness84: 1m people is almost two times the population of wyoming
Bloodswordz88: should I start eating ass again Geo?
Usisuvach0: @theonlymonkas here
Landowner555: ok thats it im leavin the house
Usisuvach0: https://www.ovulation-calculators.com/coronavirus/
t00big2fl4il: Teamwork makes the stream work
Landowner555: BREAK THE QUARANTINE
HexaField: it's not the deaths that i'm scared of, it's the fact that we are so much more globalised and our global economy is so much more fragile than 100 years ago
yungdeli_: do you talk like this around your house when no one is watching?
11plus4thinking: more than a million will die from coronavirus
AresRai: the expert that went on joe rogan said the same thing, 500k deaths
supersaltpack: I thought they are worrying about the exponential growth of the infection
hordead: @georgehotz Am I going to day a virgin????
thecoder15: @georgehotz they asymptomatic study was proven false their tests were just false positive
cemck: still too much for the 21st century
Zipzipcekirge: not acceptable if i die
11plus4thinking: this is just the beginning
theonlymonkas: @Usisuvach0 thanks
Digital_donger: @hordead historically pandemics sometimes have a second wave
murkythunder: @11plus4thinking no way, wont pass 50k
foti_kasparov: @bloodswordz88 Not George here, but for sure
AzzoDio: other forms of death will also increase if hospital can't treat other causes
Ayyyy420Lmao: @Digital_donger like feminism? that one got to the fourth or fifth
11plus4thinking: @murkythunder think of all the poor countries them come back to me
xiic: is this taking into account deaths due to overwhelmed hospitals from otherwise preventable illnesses?
cachedtv: economy will still be rekt
wholesome_pepe: there are genetic and environmental factors that contribute to how many ACE2 proteins your body expresses
AntiVax_SoccerMom: CurseLit
shekshas369: 4Head
mikey9988: LUL
yungdeli_: LUL
Digital_donger: @Ayyyy420Lmao I guess LUL
Ne0Zer0: LUL
cookienz: LUL
whycopper: rookie
murkythunder: @11plus4thinking poor countries are doing better, the worst countries are countries like UK and US, where people give no fucks and are spoilt
Ayyyy420Lmao: @AntiVax_SoccerMom sick name
Appz_x: SHOULD HAVE FLIPPED IT
NullJupiter: f
AresRai: LUL
brownyyyylocks: wow
cookienz: just hire a chief
AzzoDio: my sister needs emergency surgery this week, luckily her hospital is not a hot zone yet. 2 weeks from nkwt?
1re1: this also doesn't account for hospitals filling up right?
aflow404: Classic LUL
alicyka: People don't think that there's a point where people go from dying of the virus over to dying of poverty because nobody's working
AntiVax_SoccerMom: Ayyyy420Lmao SeemsGood
PotlePS: of just permanent lung damage, estimated 20-30% will have permanently decreased lung capacity (or something of the like)
hordead: @georgehotz is that a studio?
fuzzywuzza: they just approved the $2 trillion stimulus bill
murkythunder: LUL
dog_runner09: mother of ducklings
knilecrack: how is US lockdown functioning ? are you not allowed to go outside ?
theonlymonkas: but what does recovery actually mean? they can get the virus again?
PiroFloydian: TARTER SOUCE
shekshas369: classic George the iq of a god but the cooking skills of a potato
cookienz: LUL
Landowner555: this is the man whos gnna save us from corona folks
echobrother: @HexaField The global economy is not more stable It just was growing so much more
Vackin: i am more worried about the people that will die from causes because hospital are overwhelmed with covid19
wholesome_pepe: LUL
Mint2bSpiced: However, isn't this assuming, when we open our borders back open, we don't see a second wave?
pz3300: I’ll eat them
Jehhred: can make a car drive itself but fail at cooking... priorities
m00chan: is the curse worse than the disease in this case
m00chan: cure rather
NullJupiter: Its scary for economy @georgehotz
Usisuvach0: @georgehotz check this thing they say it might help search on google sumamed
shekshas369: clearly
knilecrack: yeah
AresRai: WutFace
420lokki69: yes
mescal33t: sure
AzzoDio: a very high percentage of doctors will also die. it takes an incredible amount of resources to train a surgical specialist
hordead: fuck no
shekshas369: same
knilecrack: looks like it's human life &gt; $
DecayingSkullz: @guy_ross Thank you.
localcanofdutchgold: not if it's my teeth
shekshas369: we talking about a teeth
Ayyyy420Lmao: nonissue, that's the presprective of a central planner
echobrother: no
granti7: if its a hot chick, yeah
AntiVax_SoccerMom: philosophy stream
sregister: that a lot of teeth
420lokki69: yep
shekshas369: to safe a life
AresRai: nop
Nussinov: i will kill to prevent my tooth from getting pulled without anaesthesia Kappa
Paw_4: I think it's not about the quantity, it's about the suffering and the pain
1monkjuice: depends on who
C0deCane: Honestly all we can do is hope that no serious natural disaster happens in the next few months or something worse like another war starting
jmv_chin: what mouse ya use
happypuppppy: LUL
foti_kasparov: That first rule of alchemy.
alicyka: My philosophy has been that a person's life is worth the net profit of a person's life, so any suffering can be extrapolated to that value. I haven't thought about it much though
FancyDawg_: utilitarianism
shekshas369: @Paw_4 agreed
orami: what if the person dying was about to die anyway
420lokki69: its one tooth per person, not million
aflow404: whiskey will do for me LUL
PiroFloydian: We can stop the trolley and save all these people but if we do the trolley company will lose profits what do we do?
420lokki69: hell yes its worth it
mikey9988: true LUL
mashafique: well people can give a number they think is worth it but which people are actually willing to have their tooth pulled to help save that life?
m00chan: Nobody wants to be blamed
DecayingSkullz: Hello everyone
LocoLuka: true
AresRai: Hopefully it does clean the political field x)
m00chan: SO theyre going overboard
Appz_x: this is a virus created to target old people and get rid of social security
happypuppppy: what's gonna happen to Bernie BibleThump
opus_000: Navy pelosi looked like she had a fever
shekshas369: well if talking about a teeth any teeth is worth a life
anotherkidnamedaustin: whats the bell curve? the media? the std dev?
foti_kasparov: Sacrifice people to save people
Ayyyy420Lmao: no
t00big2fl4il: the politicians are freaking out because it is poking holes in their legitimacy
shekshas369: clearly
420lokki69: yes
mashafique: no
echobrother: yes
shekshas369: yes
AntiVax_SoccerMom: sure
kidjulien: yep
AresRai: no
hordead: YESSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
Paw_4: yes
eric_hansen: no
plazmacsgo: yep
Ne0Zer0: LUL
shekshas369: YES
mescal33t: yes
Ayyyy420Lmao: nonono
m00chan: yes
localcanofdutchgold: bye @georgehotz
LocoLuka: fuck no
aflow404: foooookkkk noooooo
knilecrack: yes
Foxxy_xx: ofc
Major_Spicy: NO KEKW
hordead: NOOOOOOOOOOO
Appz_x: your dead bud
FancyDawg_: George is a utilitarian CONFIRMED?
stillgeting: NOway
eNoq: no
cachedtv: yea
bufferovrflw: been there done that
shekshas369: 10000%
guinness84: which tooth
purplegreenpanda: no :)
matvey_ryabov: noooo
guy_ross: any day of the week
4zimut: sure, get me an iphone tho
orami: HELL NO yeoswaKEK
Vackin: nope
dr_set: yours, ok
MrStereoX: Do you know the company "Black cube" @georgehotz
brownyyyylocks: nope
Bloodswordz88: the bat is the innocent one here
dzid26: do we really suffer though?
sidthescikid: N OMEGALUL
Goooshlrific: no
dog_runner09: yes
StopitDonk: if you teach me python yes
foti_kasparov: NOOOO
wootawee: the real question - would you rather get a tooth pulled or bet 1 in 500 you die now
hordead: noo
aflow404: VoteNay VoteNay VoteNay VoteNay
nitrixen: Everyone who says no gets banned.
GoodOlSmokey: @georgehotz simple. tie the tooth to the door
firmstool: fuck no LUL
C0deCane: what would you do for me dude?
Digital_donger: I think so :)
pz3300: Ooooh
SoulRedding: I need that tooth man
opus_000: give me 7k
Vackin: with or without
thecoder15: lol
caligula443: NICE KNOWN YA
Bloodswordz88: it hurts tho
pz3300: Tough spot
shekshas369: i mean imagine form a relgious point of view its a freeticked to paradise for pulling a teeth
purplegreenpanda: i only have one left
alicyka: I'm drunk as FUCK so I'll get my toe pulled off for laughs my dude
Jehhred: Nah, you're dead bro
theonlymonkas: LUL yes
knilecrack: ezbut noone gets the point of corona. If transmission rate of corona get over 10 it has a much more chance to mutate to something much worse then a lot more ppl gonna die.
alicyka: OnceI sober up I'll kill you for pocket money
shekshas369: like saving a lift for a teeth
shekshas369: ez done
AresRai: some people would die from the pain LUL
devm0d: I’ve done that a couple times, dentist is very good and saves me time
cellophane11578: which tooth?
pz3300: Will I still get updates on my comma?
AzzoDio: @georgehotz I don't think there's a scenario where you do no mitigation and the economy is just like before. all the chaos and all the deaths and all the hospitals overwhelmed will also hurt the economy
l1ght5p33d: exploits
foti_kasparov: DO IT FOR THE BROOS!
hordead: @pz3300 as long as you run aot update
sidthescikid: I hate those questions because we will never be able to answer them. I guess that why its important to talk about them.
Landowner555: do you believe that herd immunity will actually help prevent the spread? if there is selective pressure for the corona to mutate, dont you think that its more likely that will happen?
GoodOlSmokey: @georgehotz your house could easily be Welcome to the Game 3's environment
kev061895: Hello
peter35_: do you know the philosopher david pearce?
benchai18: @chat Any of you guys use Discord? If there was a fully built out Unofficial george Discord server for these and other related topics... anyone even interested or not really???
t00big2fl4il: is it logrithmic
atzehji: hospital stay 4 days?
mashafique: how does on stop being a lazy piece of shit? asking for a friend Kappa
AzzoDio: @georgehotz also advances in therapeutics and serology. monoclonal antibodies by September.
alicyka: IRC 4 lyfe
kev061895: It's so bad
homestarr: are you doing anymore sequencing analysis?
Landowner555: @mashafique lmfao
Ayyyy420Lmao: just take drugs
Abnico: just do it?
nitrixen: @alicyka o/
Abnico: listen to nike
mineyful: are onion rings literally deep fried onions
l1ght5p33d: whole med / insurance such a scame
MrStereoX: @benchai18 Sure Achi!
localcanofdutchgold: 4Head obviously
l1ght5p33d: scammmm
SlaterUSA: did our man buy the little gene-gadget last night?
shekshas369: agreed
Landowner555: wtf, no way
benchai18: I didn’t ask u Georgie lo. UNOFFICIAL
Ayyyy420Lmao: dna vaccine?
l1ght5p33d: MARKET RATE TREATMENT
AresRai: 10 years in bio field is not really 10 years
SoulRedding: what is "economy"
HexaField: @benchai18 join the portal discord, it's an unofficial discord and the most active IDW discord, over 4000 members
Lizardan: People die sometimes 4Head
pikomane2: is corona virus North Koreas Christmas present they were promising?
11plus4thinking: just make an agi that is way smarter than us 4Head
devm0d: You have to remain curious bro
guinness84: this went from biology to morbid real quick
wholesome_pepe: yes. if we had the infrastructure to do PCRs on everything we would have the insight
hordead: what??? comma ai have seels?
xiic: meh, the world isnt going to forgive China this time.
benchai18: @hexafield Portal? Explain. Not the game, I presume?
NullJupiter: EU economy is breaking down lol @georgehotz
Landowner555: @wholesome_pepe 4Head
Ayyyy420Lmao: mind = blown
AntiVax_SoccerMom: i can feel my brain physically growing
homestarr: !discord
SlaterUSA: trickle-down economy, nbd right
AzzoDio: @georgehotz Here is a timeline for treatment options: https://synbiobeta.com/wp-content/uploads/2020/03/COVID19_Timeline_SynBioBeta_LeapsByBayer.pdf
1monkjuice: automate production and delivery
wootawee: xiic if by china you mean US then yes
Paw_4: @AntiVax_SoccerMom HAHAHAH
Vackin: economy is a trust in a system
benchai18: @antivax_soccermom Not if you’re an anti vaxxer it’s not
dorkmo: open your dishwasher
sidthescikid: China LUL
Natschz: how many donate blood to safe lifes? it's probably not as painful as getting a tooth pulled?
burzum_: what experiment? i wasnt here
m00chan: progress of humanity is more important?
NullJupiter: Which experiment? @georgehotz
Lizardan: @Vackin wrong
alicyka: I'm young and dumb: Isn't it weird that we've had like 5 "pandemics" in the last 18 years since SARS? I feel like there's been nothing between Spanish Flu and SARS
dingus74: "the experiment" ?
hordead: you need the protein mannn
Landowner555: AWWWW
roystang: i can read lips
pikomane2: F can't hear
knilecrack: bro you didn't mute
Goooshlrific: read lips
localcanofdutchgold: read his lips ez
aj37z: bog
shekshas369: aw men
dorkmo: CORONA TASK FORCE PHONE CALL
granti7: elon musk is calling
shekshas369: come on
purplegreenpanda: no streamer TriHard
eric_hansen: any deaf people good at reading lips?
shekshas369: so close
Ayyyy420Lmao: bruh its not muted
knilecrack: ahahahahahha
1re1: turn around so we cant read lips
METH_HEAD_MIKE: not muted LUL
Lizardan: KappaPride
pikomane2: audio ???
opus_000: lol
cachedtv: lmao
knilecrack: ahahahahaha
knilecrack: NICE ONE
GoodOlSmokey: i can read lips guys here we go
aj37z: bog dump it
bufferovrflw: haha
foti_kasparov: READ HIS LIPS
thecoder15: lol
Joftus112: Rip
burzum_: who knows what the experiment is about?
alicyka: Spend bits on unmuting stream
shekshas369: @1re1 damn you
SlaterUSA: "hello yes? what... google wants to hire me again?"
mescal33t: RPGGhosto
NullJupiter: he is smiling its a girl lmao
shekshas369: exposed
peter35_: we need to hack our appliances and stop them from beeping at us
l1ght5p33d: What does Elon want?
Abnico: bog called
shekshas369: lipreaders
METH_HEAD_MIKE: cocaine dealer monkaS
kev061895: @goodolsmokey 👍🏼
4zimut: he got us
nitrixen: The oven glass door. ENHANCE. ENHANCE.
iIyaRPV: monkaS
Ayyyy420Lmao: @NullJupiter it's a male girl
0R4NG3: monkaS
dorkmo: you left and i dont know how to work the oven
Natschz: can someone see the vibrations on the bag ?
xiic: Parts of the US are very fucked but China could have prevented this if they hadnt lied and suppressed information and destroyed evidence
foti_kasparov: cbrahFor cbrahThe cbrahBoys cbrahFor cbrahThe cbrahBoys
hordead: @METH_HEAD_MIKE yupp loll
lordBzzl: lool, fear of the unmuted muted button
mrhdr: coke dealer has arrived squadR
aMANT3: using the planet leaf vibration to recreate the audio
benchai18: “Hey bitch, send me dem pix hooker”
0R4NG3: 3 letter agency agent joined the chatroom monkaS
ankitc: he did not leave us at OBS
pikomane2: welcome back
hordead: cokeeee dealer?????
l1ght5p33d: Elon wants the comma ai model
burzum_: what's the experiment @georgehotz ?
t00big2fl4il: Yo!
benchai18: “Hey hooker, lemme get sum dem fish sticks”
knilecrack: rofl
pikomane2: lol
AresRai: LUL
mescal33t: beastyLULWW beastyLULWW beastyLULWW
rtcspxstn: alicyka it's largely because it's much easier to transmit things across large distances now
PiroFloydian: LUL
Ayyyy420Lmao: funny thing is that it's true
shekshas369: LUL LUL DansGame DansGame
t00big2fl4il: what experiment
wholesome_pepe: LUL
eric_hansen: KEKW
sidthescikid: LUL
foti_kasparov: gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts gmbenjTruthHurts
dawaeSHW: LUL LUL LUL
SlaterUSA: ask him if he takes payment in twitch bits
happypuppppy: have you looked up any realistic genetic/molecular animations on youtube?
AresRai: probably true
cellophane11578: pistolCop hey buddy let me see your hands
lordBzzl: synthesize some in jupyter
wholesome_pepe: price gouging dealer monkaS
sidthescikid: "Yeah the markets aren't cooperating bruh"
SoulRedding: price gouging during an emergency is ILLEGAL
aflow404: LUL
eric_hansen: it was a girl wasn't it @georgehotz
echobrother: is he joking
sidthescikid: "No supply"
t00big2fl4il: What level are we at?
peter35_: think of the cokehards FeelsBadMan
benchai18: Got that 8 ball in ur pocket
Landowner555: @foti_kasparov ben finegold fan !
l1ght5p33d: I love it buy BTC
Major_Spicy: @georgehotz its funny, my dealer said the same thing
shekshas369: haha
t00big2fl4il: What level
Lizardan: Bro, I was going to start a $130K job and now they're telling me I have to wait BibleThump
dorkmo: cutting your coke with virus powder
bufferovrflw: This IDIOT won the drug war with this ONE SIMPLE TRICK
SlaterUSA: cocainavirus
solitarynative: Kreygasm
shekshas369: when your coke dealer cares about his farmers
devm0d: @echobrother Of course
wholesome_pepe: i got u on a pico gram for 1k
shekshas369: money well spend
burzum_: the experimeeeeeeent
ankitc: why are you smiling
linkrager: never play f6!
granti7: receving calls from AI girls
aflow404: LUL
echobrother: @devm0d How do you know
NullJupiter: What experiment did you mean? @georgehotz
Landowner555: coronavirus HALTS the war on drugs
microx0ft: you are the best
benchai18: George u joke, but a bunch of junkies are in crazy withdrawals on the street rn
burzum_: we will never know
foti_kasparov: @landowner555 :)
devm0d: Can someone update me on what we’re hacking on today?
Ayyyy420Lmao: 1 paper per hour Kappa not even that really, this pace LUL
snapcs1: we are hacking coronavirus
eric_hansen: coronavirus drops drug overdose rates to 0%
SlaterUSA: @devm0d the planet
shekshas369: @devm0d technically the Virus itself lol
microx0ft: geohot what monitor are you using?
nitrixen: Assert dominance. Make the virus fear you.
homestarr: 2010 kinda old lol
Paw_4: @devm0d he is hacking the fucking pandemic
0R4NG3: DansGame
devm0d: @slaterusa Ahh hack the planet!!
SlaterUSA: precisely
SolarBerry: DansGame
opus_000: hack cicada
benchai18: “Hey bitch, ill give u my strand”
alicyka: I read the lips: "hey georgie whatcha doin &lt;3?" "Trying to figure out how many people I'd kill to get my tooth pulled"
eric_hansen: didn't wash hands DansGame
Major_Spicy: Yellow hands DansGame
WaeHaKe: Cheer100 Cheer100 when we talking politics?
mik12f4: your going to spoil us with all these back to back streams.
mikey9988: DansGame
MrStereoX: @benchai18 are you opening the discord?
eric_hansen: HE TOUCHED HIS LIPS
hordead: Lol that's after you had your hands in your mouth
zennydmt: how many hours of sleep do u get per night
0xatul: why does my meme comments gets auto mod'ed
microx0ft: what monitor areu using
sidthescikid: Util is an optimist's coping tool
Abnico: economy as a social construct
shekshas369: i always wonder about that tho tbh
C0deCane: I heard some boomer today say "back in my day we didn't get this kinda shit, but thats cause we worked out in the fields and had real immune systems" LUL
dzid26: no. it's great purge of the scam companies
devm0d: I sold everything, I’m out. It’s all a scam.
snapcs1: what an idiot lollll @C0deCane
PiroFloydian: @georgehotz https://twitter.com/JustinWolfers/status/1242641219517366278
AzzoDio: @georgehotz If the hospital system collapses, if doctors quit or get infected and the medical system collapses, that's ALSO a terrible economy. Try to model the effect of the economy of a having no hospitals for X months
HexaField: George are you opposed to an unofficial discord server? I have experience running them and if you aren't opposed I'll start one. Done well they can be a great resource and organisational tool, and anecdotally so. Up to you.
alicyka: I feel you, I'm making jokes. 10000 people not making food for a month eventually = 100 people dying because of high food cost
C0deCane: Nobody probably even knew honestly
foti_kasparov: How to prevent it?
shekshas369: well if it hit us back than without the internet you hell as bet can be sure quarantine at home wouldn'T be this effective
devm0d: Twitter
shekshas369: Pornhub saving the world 1 fap at the time
devm0d: Twitter caused this madness
shekshas369: LUL
benchai18: It really does feel like all these outbreaks are recent. SARS, mers, h1n1, Ebola, corona.... all this shit wasn’t happening when I was a fucking kid.
SlaterUSA: @georgehotz did u buy one of those gene gadgets last night?
firmstool: physical symptoms?
benchai18: Oh interesting
C0deCane: dude if you look into psychology just the minimal part of it this whole thing becomes really scary
AzzoDio: We know about it because of a surge of atypical pneumonia in Wuhan, even before it was sequences or tested
MrStereoX: Do you know the company "Black cube" @georgehotz
xiic: you think the affected people wouldnt have recorded such an event in their history?
firmstool: small pox etc. physical symptoms
robinbrinkler: "Antiviral Agents From Fungi: Diversity, Mechanisms and Potential Applications"
Abnico: social distancing will stay after the virus, look into it
hordead: @C0deCane what do you mean?
HexaField: @georgehotz are you opposed to an unofficial discord server? I have experience running them and if you aren't opposed I'll start one. Done well they can be a great resource and organisational tool, and anecdotally so. Up to you.
Ayyyy420Lmao: @Abnico twitch user not affected
l1ght5p33d: Sample bias * Infinity
jasondesante: 90s was pretty dope
shekshas369: the 90s were pretty dope tho
devm0d: I had a pool in the 90s
SlaterUSA: confirmation bias
foti_kasparov: except people
shekshas369: that was my point earlier like by how much do you quantify suffering ?
bufferovrflw: This is taking 90s nostalgia too far
NullJupiter: but population expanded too
faraday_lenz: we need blockbuster again
jasondesante: all games go back to point and click, and yea you're right George I'm just bustin yo balls
Abnico: new york was trash in 90s lmao
1monkjuice: log scale that
knilecrack: 90s were crap
shekshas369: cause people in the 90s lived pretty good
entangledbeing: Nice in some places shitty in others...
alicyka: 90's was dope socially, but today is to the point where the bottom shelf shit is the same as top shelf shit in the 90s
knilecrack: only good music nothign besides that was crap
Ayyyy420Lmao: im autistic i dont do restaurants
C0deCane: @hordead your own thoughts can cripple you and studies show that when you consistently hear one thing you believe it and your mind can actually trick you and your body into becoming sick. That will definitely overrun our health resources with cases of this virus that don't actually test positive
C4TFive: Pager stonks gunna booooom!
AzzoDio: @georgehotz As a thought experiment, pretend there's no mitigation or quarantines possible. How much damage does the economy take from the surge of deaths, medical system. Who is going out to eat in that scenario? Dow still crashes IMO
weedlord666: we used zagat guidebook bro
t00big2fl4il: Bitcoin
memphisFPS: my house was trash humid and cold during 90s
cellophane11578: the 90s were nice because we were young and dumb? xd
optimizely: @georgehotz how do you choose what project to do next?
SlaterUSA: we had these things called maps :D
entangledbeing: Hard to see the reality of the economy sitting from an ivory tower...
weedlord666: paperback yelp
soisoisoi: you'd use maps
aflow404: ASK SOMEONE
m00chan: we dont know how good we have it
Abnico: ussr was the goood old days
benchai18: But why would that stuff disappear?
cankunwang: it only means the stock market is a huge bubble?
axlebear: In the 90s everyone was carefree
Lizardan: @georgehotz do you believe this crisis is going to help Trump get re-elected? I think so
benchai18: Why would phones disappear?
SHAVEYY_: @georgehotz install arch linux for a stream
xiic: payphones are not a function of the economy, they're a function of technological progress. We're not going back to payphones
C0deCane: stress can weaken your immunity as well
HexaField: George are you opposed to an unofficial discord server? I have experience running them and if you aren't opposed I'll start one. Done well they can be a great resource and organisational tool, and anecdotally so. Up to you.
sidthescikid: Wouldn't later generations view the 2020's in that same light tho?
hordead: @C0deCane can you link me to one of these studies? 
benchai18: Bro he lives in the ghetto
xiic: The rate of it is
happypuppppy: elon ?
xiic: not the state of it
wholesome_pepe: i wish i were born in the future where everyone else has done all the leg work
opus_000: physics
Ayyyy420Lmao: aliens
masters8: ?? Lots of people living in current day USSR miss those times
benchai18: Лол
cellophane11578: in soviet union we infect the virus Kappa
Reelix: Eh - Look at the ZAR VS the USD over the past 30 years - Some places go up, some go down :p
shekshas369: i mean you guys are talking about an era of Internet vs no internet pretty unfair comparison
zombiedigital: some countries will become out of this as a winner
Abnico: @HexaField all discord servers fail
optimizely: @georgehotz how do you choose what project to do next?
SolarBerry: monkaS
iIyaRPV: monkaS
shekshas369: wouldn'T it make more sense comparing the economy of 2k10 to 2k20 rather than the 90s ?
slim_bhris: dam that honda is loud
HexaField: @Abnico only because they aren't run well
WaeHaKe: dickhead in a maserati?
aj37z: theyre puring putside
Ayyyy420Lmao: ending the apartheid was a mistake
t00big2fl4il: yes but. Jobs and Woz were blueboxing payphones prior to the 90s
snapcs1: damn that guy revving his engine must be so cool
HexaField: wild generalisations there
aj37z: purging
devm0d: Bring back Phone phreaking pay phones!
treestompztv: vrrrrrr
SpaceGhost8: stockTank
granti7: are we reverse engineering the economy? pog
foti_kasparov: @optimizely He just waits for a virus to blow up I guess
HexaField: i know many that work just fine and have for years and years
sidthescikid: Yes because Africa's econ is stable Kappa
nitrixen: @georgehotz Technology can develop because a minority supports the essential needs of the majority.
amedhussaini: you ever try to hack the market? like algorithmic trading, etc?
Abnico: @HexaField i dont know of any good public ones
entangledbeing: The economy may go up but the standard of living you experience is not the case for most people in America...
devm0d: Who’s got a captain crunch whistle?
iIyaRPV: RUB vs USD is so monkaS rn
aj37z: kappa
C0deCane: @hordead its actually a psychological test that was done with advertisements you dealing with symbols and songs and other things like that i don't have a link right with me but im sure i gave you enough info you can google it, or you can just disagree with me idc
eldred57: There are people here who are talking about communism as good old times. All of them were in a privilege position with the party :D
Lizardan: true
l1ght5p33d: Same expense probably as 2010 all R and D
cankunwang: true
aj37z: cost 20 bucks to make i nchina
aflow404: dude after 2008, so much gentrification @georgehotz
Ozonemaster: what is rnd? ...
dvdutch: You figure this shit out yet
sidthescikid: research and development @Ozonemaster
stillgeting: ???
ayushsharma: Rnd is bullshit
knilecrack: yes on credit
cankunwang: I remember iPhone was such a luxury thing in 2010s
peter35_: getting a gf was better in the 90s for average guys FeelsBadMan
Lizardan: Debatable
shekshas369: is that true tho
Abnico: europe has higher standard than us
stillgeting: thats not right
weedlord666: how do you square that with the "decline of the middle class"
Ozonemaster: @sidthescikid aaa ok. its ID in my language
Ozonemaster: thx
sidthescikid: rnd is necessary tho
pz3300: People in us are no better off than in the 70s
benchai18: For sure we do
Lizardan: The first iPhone I could afford was the 4.
HexaField: @Abnico keep looking. they are out there. Eric Weinstein's the portal is highly active and growing. Rebel wisdom is fairly active, there is the science network of around 10 servers that are huge.
Ayyyy420Lmao: europe higher standards than usa LUL
ICAntF331MyFAce: @peter35_ FeelsBadMan
knilecrack: USA lives on credit.
entangledbeing: Yeah your probably right
benchai18: Broke ass kids own iPhones and MacBooks
wholesome_pepe: if we measure by life expectancy then yes. cuz time = money = value
HexaField: Bridges of Meaning is JBP's and it is very active too
sidthescikid: Me too :)
cachedtv: what do you think will happen to tesla since no one will be buying luxury goods?
Abnico: @HexaField i will check them out! thanks
ummyeah1929: i know people in tiny little pueblos in mexico who own the newest iphone LUL
C0deCane: American poverty is fuckin nice compared to Chinese poverty
xiic: Look at the wealth gap over the last 20 years in the US, that's where the decline of the middle class can be seen
mattdougherty22: @Abnico Check out The portal
un3okapi: https://www.washingtonpost.com/business/2018/10/01/bottom-percent-are-still-poorer-than-they-were/
axlebear: The happiness index has continued to plummet though
knilecrack: I grew up in the 90's 2 wars in 5 years :) it was very nice
queencitydisco: middle class has shrunk but has lost people in both directions
Abnico: okie
lostindetails: Is wearing face masks underrated?
benchai18: I broke up a broke ass bitch in LA
knilecrack: corona means nothign to me
Ayyyy420Lmao: @axlebear that just proves the unabomber right
echotaco: Happiness is a function of perception, people will get used to whatever happens
m00chan: in musk we trust
heyitsrama: tsla is doing good because holland is getting rid of subsidies soon
entangledbeing: What about increasing wealth inequality? Does trickle down
heyitsrama: they gotta get the cars into the countries
HexaField: @georgehotz are you opposed to an unofficial discord server? I have experience running them and if you aren't opposed I'll start one. Done well they can be a great resource and organisational tool, and anecdotally so. Up to you.
HexaField: tell me to shut up if im spamming
ayushsharma: Is the economy inflating ?
foti_kasparov: @knilecrack Are you from Kosovo?
snoozejunkie: this channel is fire
weedlord666: https://en.wikipedia.org/wiki/Income_inequality_in_the_United_States#2007–2016_reduction
knilecrack: No. I'm from serbia
shekshas369: they are pretty much the same
knilecrack: but I was born in croatia
shekshas369: jokes on you
pz3300: How much a loaf of bread cost
mashafique: I had some pretty good ramen bowls in 2019 LUL
treestompztv: https://clips.twitch.tv/TrustworthyBrightKathyKappaPride this past clip of you LUL
m00chan: not mcdonalds fries
sidthescikid: Mc Donalds turned into a budget salada ngl
m00chan: used to be made with beef tallow
eldred57: Tesla is selling more and more in China and its factory there is up and running. GM will be significantly more fucked
t00big2fl4il: the tech is good that economies allow, but the skills to create and innovate are better and are born from necessity
snapcs1: ?????????????
cankunwang: I saw my own eyes these days, ppl used like 5 credit cards but not able to pay for food at Walmart
m00chan: until saturated fat scare
SpaceGhost8: interior sure, but look at those OG burgers
l1ght5p33d: meh ...
roystang: @georgehotz inside of a mcdonalds != qualty of living
Ayyyy420Lmao: mcdonalds has turned low quality with celulose fillers so they can keep price the same...
hordead: @georgehotz it's just aesthetics
atzehji: what we pay is hours of work at the end. efficientcy of production processes won't go back. i feel like economic problems will be very temporarely
entangledbeing: Do you believe in trickle down economics?
Reelix: 1990 -&gt; US$1 = ZAR2.50 --- 2020 - US$1 = ZAR17.37 - I'd prefer 1990 thanks :p
aj37z: now you got pink chicken nuggets
devm0d: My income went up over time so yeah my meals got better
picklesareok: dont you think thats more of a representation of the company's health more than individual people?
snapcs1: evaluating the economy by mcdonalds restaurant design galaxy brain
weedlord666: what a strange anecdote
picklesareok: health or wealth
zwisch: dark meat &gt; white meat
dzid26: buildings with fake decorations
Ayyyy420Lmao: inflation adjusted pls
HexaField: @georgehotz are you opposed to an unofficial discord server? I have experience running them and if you aren't opposed I'll start one. Done well they can be a great resource and organisational tool, and anecdotally so. Up to you.
Major_Spicy: @snapcs1 i mean, it is super popular, so it is kind of okay LUL
AlwaysTilted_: What’s your order when you hit up McDonald’s?
heyitsrama: lmao its the same
plazmacsgo: the income increased because of inflation
pz3300: Mac Donald’s only make money from rent
memphisFPS: cars have became really good too compared to 10-20 years ago
heyitsrama: 61k -&gt; 63k
Ayyyy420Lmao: real means inflation adjusted
devm0d: Didn’t your 20 year scam chart show ya that wages are stagnant for last 20 years??
knilecrack: talkin about economy: https://i.kym-cdn.com/photos/images/original/001/795/988/c92.jpg
lordBzzl: maybe by sheer repetition things get better
SpaceGhost8: slightly up, but not much overall
t00big2fl4il: fiat currency vs bitcoin
pz3300: Yeah inflation without electronics
l1ght5p33d: i am the recession
Natschz: so if the economy falls far enough we will live in castles again?
heyitsrama: georgehotz your disconnected from teh test of america my brotha
5_betbluff: this gotta be the most intelligent conversation in a twitch chat lol
HexaField: Geohot discord server. https://discord.gg/VYdj5dx George, if you don't want it to be a thing it's gone. I have had good experiences with them.
dzid26: cars are barely different nowadays compared to other technologies
pz3300: Yes
Ayyyy420Lmao: "inflation tracks economic growth" ???
SpaceGhost8: right
nitrixen: Second chart is adjusted.
Reelix: Yes
t00big2fl4il: 500 in 2009 bitcoin
Ozonemaster: cars are waaaaaaaay better
treestompztv: @georgehotz https://clips.twitch.tv/TrustworthyBrightKathyKappaPride
dingus74: Lol yeah cars are 10x better
raystriker98: they were junk
memphisFPS: dude cars are so well equipped nowadays
sidthescikid: LUL
Ozonemaster: turbos had gotten better
Appz_x: 2019 honda civic with comma ai is the best
pz3300: It should be food not electronics
Ozonemaster: more hp
benchai18: Why median and not average????
Natschz: if the economy gets to worse tv's will get black/white again?
lordBzzl: lool, used to have tape players
cemck: for technial goods but how was it for food ?
bromku: any data on food prices rn
360Plato: 2000s had shitty networking solutions
pz3300: For inflation
Reelix: @memphisFPS Assuming you can buy a car made in the past 15 years
elephantpandas: id say from 2010 up for most cars are good
informalgarlic: How does capitalism work in a fully automated society? @georgehotz
Ayyyy420Lmao: average is higher
devm0d: We’re off topic
t00big2fl4il: what about vintage tech?
nozpheratu: I've been driving a 1995 volvo for five years now, built to last if you're not a moron.
ummyeah1929: mean gonna be skewed
benchai18: Average is for sure higher. Median is like meh
pz3300: We still in recession from 2008, they just fudge the numbers
Lizardan: Trickle down ecomony 4Head
t00big2fl4il: I saw a boombox in best buy yo
weedlord666: electronics and tire compounds have advanced a lot in consumer cars
heyitsrama: @nozpheratu got my 73 240z :)
weedlord666: the rest not that much
SolarBerry: we need to solve coronavirus tonight
hordead: @georgehotz , ai wan'st around back then.. times are definitely better now
memphisFPS: all i am saying they are better products than they used to be, we have been building cars for over century now
l1ght5p33d: Every job should be automated to some degree
pz3300: Inflation adjustments should not includes electronics
nozpheratu: heyitsrama Got me beat
Ozonemaster: what u mean by that
plazmacsgo: true
ummyeah1929: because exponential inflation?
heyitsrama: nozpheratu ill wip the volvo
SpaceGhost8: much safer, more fuel efficient, probably has more horsepower
Mariosavitch: hello mr hotz
devm0d: I bought a 10gig hard drive at staples in 99’ for $330 and it failed in 3 months
Lizardan: Are cars cheaper now?
Ozonemaster: one can argue development is independent to economy
shekshas369: isn'T that innevitable since technology gets exponentially better
lordBzzl: definitely agree
memphisFPS: my car from 90s doesnt have seatbelts in read seats LUL
t00big2fl4il: 8trak
Natschz: So TV's will get back and white again?? @georgehotz
shekshas369: and thus exponentially faster obsolete?
xXICEW0LFXx: Finished my assembly lab homework
360Plato: midtier car beats a sports car of the 70s
Ayyyy420Lmao: my car has none of those feelspoor
axlebear: Things are more disposal today
xXICEW0LFXx: that took me 5 hours
lordBzzl: do cars have cd players still?
plazmacsgo: I think he mean that your perception of moneygrows less and less with the more money you get
memphisFPS: rear'
xXICEW0LFXx: I hate assembly
ShredderSherlock: not if you don't pay for the extra packages
Reelix: Will your car from today still be working 20 years from now, since your car from 20 years from now is still working today.
t00big2fl4il: I remember when seatbelts became a law in california
atzehji: i think you should compare the same thing for inflation though. and thake the average. it doesn't hold for tec
xXICEW0LFXx: that's also a lie, i don't hate assembly
sidthescikid: New cars have seat warmers PogChamp
11plus4thinking: why do people still buy apple products
pz3300: What’s your point though george?
informalgarlic: How does capitalism work in a fully automated society, Mr. communism is evil?@georgehotz
Ayyyy420Lmao: @sidthescikid a friend has a 20years old volvo with seat warmers
Jehhred: your car has power windows
plazmacsgo: ohh I see
theonlymonkas: my car doesn't even have seats LUL
AntiVax_SoccerMom: 10 MCCHICKENS?
devm0d: Back to VIRUSES
SpaceGhost8: buying a mcchicken for $1 LUL
Mariosavitch: buy 10 of them
cemck: how with real estate compared?
plazmacsgo: makes sense
HexaField: unofficial george hotz discord server. https://discord.gg/VYdj5dx George, if you don't want it to be a thing it's gone. I have had good experiences with them.
pz3300: Two hookers
sidthescikid: @Ayyyy420Lmao Ahead of their time
Mariosavitch: buy 100 mc chickens
l1ght5p33d: more cats
t00big2fl4il: 1000 iphone 11pro
360Plato: craftsmanshit is more expensive
localcanofdutchgold: 2?
shekshas369: @pz3300 priorities haha
memphisFPS: haha
hordead: @georgehotz Why are you not verified?
SpaceGhost8: let's start a cult :)
eric_hansen: however the purchasing power of the us dollar has declined significantly from the 1900's to now @georgehotz
Ghost_001: LUL
montecarlo: @HexaField he hates you!
erlsek: tanoviOK
l1ght5p33d: 200 kittens instead of 100 kittens = 2x as good
WaeHaKe: lmao
t00big2fl4il: gold standar?
Mariosavitch: ??
foti_kasparov: lul
pz3300: No you dont
HexaField: sure thing man. it's gone. :)
thekittyslayer7: @SpaceGhost8 i'm in
nozpheratu: I'm going to start a official a discord now
flickapotamus: the further u go up the more minscule the difference is say 50m and 100m
OlympusDev: Sounds good lets all start a Discord
informalgarlic: How does capitalism work in a fully automated society? @georgehotz
MrStereoX: @HexaField its ok you tried :)
Ayyyy420Lmao: im starting a discord channel too
t00big2fl4il: gold v bitcoin
ummyeah1929: we're toxic FeelsBadMan
4zimut: irc?
montecarlo: @HexaField he doesnt hate you!
foti_kasparov: Discord is waste of time
Ghost_001: D:
happypuppppy: @HexaField you still the real MVP my dude
plazmacsgo: @georgehotz how do you start contributing to a GitHub project. When I look at it , I can't understand it
l1ght5p33d: we like your streams a lot
t00big2fl4il: teamwork
Mariosavitch: @informalgarlic why should it not?
sidthescikid: monkaS No Discord
plazmacsgo: and its overwelming
MrStereoX: Discussing what ? @georgehotz
shekshas369: but i will hate you and your discord server if it causes him to stream less
brownyyyylocks: twitchies revolt
informalgarlic: How does our capitalism work in a fully automated society? georgehotz
mashafique: Discord servers = places where people go to post their anime waifus
plazmacsgo: gotchu
pz3300: Booooo
mikey9988: LUL
k3hvari: Vaping?
t00big2fl4il: get to work
hordead: is that soda?
360Plato: Make it a bioinformatics discord...
foogs_: are we choppin or what?
alicyka: Bitch I will post my anime waifu anywhere, anytime, I don't need discord
theonlymonkas: work work
Mariosavitch: the same way it works in any society @informalgarlic
nozpheratu: Let's make a "Not George Hotz" discord server
informalgarlic: @mariosavitch how do you buy goods with no money cause no jobs?
mashafique: @alicyka LUL
sidthescikid: @informalgarlic cap would collapse leading up to it i feel
benchai18: I already made it. With a pic of u from Lex’s podcast looking angry AF.
Landowner555: @alicyka lmfao
benchai18: I’ll delete
benchai18: Now
l1ght5p33d: run command ::: create attribute
burzum_: he never said the experiment, did he
foti_kasparov: @mashafique LUL
Ne0Zer0: turbotax is still a scam LUL
Mariosavitch: @informalgarlic the fact you think no jobs would exist is your false premise
knilecrack: did you hear about AMD hack?
Lizardan: @Ne0Zer0 its'not if you know how to use it
informalgarlic: @sidthescikid yeah agreed.
Landowner555: man that stove is loud
hordead: that's the coronavirus trying to brake in
sidthescikid: I bet he smelled the fish DansGame
l1ght5p33d: is AMD hack x01 instead of x00?
foti_kasparov: Cooking bats
theonlymonkas: LUL
Ne0Zer0: @Lizardan $80 to file cypto tax is a scam lol
Ayyyy420Lmao: inb4 corona19 has nothing to do with covid19 and is caused by a different virus
ICAntF331MyFAce: monkaS 👉 🦇 🥣
informalgarlic: What do you think fully automated means? Regardless any unemployment over 30%?would be horrible @mariosavitch
benchai18: I WOULD PAY $1000 TO SEE GEORGE CHAT WITH Duncan Trussel FOR A FEW HOURS
axlebear: Until the fire nation attacked
devm0d: George clearly has nuerolink installed with the speed he reads these
benchai18: virii
nitrixen: Imagine if covid-19 is bening and it's activated by something else.
Mariosavitch: @informalgarlic who builds and maintaines the automation?
sidthescikid: monkaS 👉 Discord
SpaceGhost8: didn't they record 17 days on one of the cruise ships?
Bloodswordz88: activated by 5G Kappa
PotlePS: 17 days on surface, what the fuck
nozpheratu: Depends on the surface, only a few hours on some metals.
pz3300: Hard surfsces
ummyeah1929: a week is under perfect lab conditions i think
Mariosavitch: who mines, ships, processes and packages the minerals? @informalgarlic
benchai18: I got a hard surface every morning
NullJupiter: Do you guys know the Kurzgesagt video on corona?
ummyeah1929: under sunlight/humidity itd be much less i think
benchai18: I got a hard surface rn actually
vruthlessv: what text editor is that
foti_kasparov: vim
gaffo: are you learning by wikipediaing?
granti7: @georgehotz did you take a look at chloroquine   azithromycin to see why it would help fight corona?
luigifrcruz: A non peer-reviewed paper says it can stay on certain surfaces up to three days. http://the-scientist.com/news-opinion/sars-cov-2-can-live-on-plastic-and-steel-for-23-days-67260
vruthlessv: does vim custom themes or plugins
C0deCane: https://www.cdc.gov/coronavirus/types.html
Ayyyy420Lmao: classification by lineage i guess
Mariosavitch: @informalgarlic what is the final price of a good if its completely automated? If you say anything above free, explain to me where that price was derived.
Ayyyy420Lmao: genetic divergence
Mariosavitch: @informalgarlic i really think you have no idea what you are talking about
benchai18: The beta’s are little bitches
t00big2fl4il: alpha beta
aar0npham: aar0npham subscribed at Tier 1.
Ayyyy420Lmao: @Mariosavitch lmao at marx's price value theory
t00big2fl4il: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5744139/
Reelix: Bats - Not Rats
zwisch: sars also spread from civets
t00big2fl4il: alpha vs beta https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5744139/
hordead: Genius
hootdaflute: well it is a coronavirus..lol
wheely_mcbones: Cool, what is causing those changes?
pz3300: I always lose with Ace 2
Mariosavitch: Ace Venture 2 Receptor?
m00chan: what the hell is a civet
C0deCane: @Reelix bats = rats   wings
Reelix: @C0deCane Fair enough
Waldoqq: Did you cuere the coronas yet?
wheely_mcbones: Civet is that animal who poo coffee
bufferovrflw: @georgehotz How come that nCOV is so much more "infectious" compared to HCOV?
entangledbeing: @wheely_mcbones Yes
C0deCane: @bufferovrflw simply because its less deadly
entangledbeing: Bucket list item
Landowner555: yeah
Landowner555: they have a discclaimer on pubmed
Rohitbokade94: What are we eating today?
guinness84: deez nuts
entangledbeing: So someone ate poop coffee and gave us all corona
snapcs1: bat soup
theonlymonkas: LUL
wheely_mcbones: China is making it free and China is producing most of the papers
Fosade: heyy brooo
benchai18: Well plug my baby and call me Norman Reedus .....WE’RE IN DEATH STRANDING NOW BOTS
wholesome_pepe: @bufferovrflw some scientists speculate that there is a mutation in nCov that makes it more airborne and therefore more infectious
jimmyadaro: I'm back, what's he doing?
gaffo: @georgehotz the laancet is making covid-19 papers free so I'm assuming many others followed suit.
hordead: why do they even sell the papers... they should be free
benchai18: @jimmyadaro Should I send u the GitHub link lol
gaffo: loos like elsevir did as well
jimmyadaro: @benchai18 LMAO
jimmyadaro: Sup @benchai18
dongmuya: I missed when Hotz used to call us "twitches" :(
wheely_mcbones: @hordead agree
Ayyyy420Lmao: @gaffo no way elsevier went free
l1ght5p33d: smol monies only
Ayyyy420Lmao: those dutch jews only care about money
Landowner555: @Ayyyy420Lmao they actualy did for covid
jimmyadaro: @Ayyyy420Lmao Who? LUL
Reelix: @hordead From a strictly financial standpoint - To fund the people who made them to make more
wholesome_pepe: if u cant beat sci-hub u gotta join them LUL
Mariosavitch: have you found the patch yet that would fix the beer virus
benchai18: @ayyyy420lmao I resent that biatch. I’m an American Jew and I too only care about money
l1ght5p33d: @benchai18 knew it
sidthescikid: okay, I think its time to devolve corona? Pop the red bubbles chat
hordead: @Reelix information should be free
Landowner555: so what makes this anti-viral????
FoxMcWeezer: FoxMcWeezer subscribed at Tier 1. They've subscribed for 2 months, currently on a 1 month streak! You got me into CS years ago. Worked at 2 Big Ns thanks to your mindset
wheely_mcbones: @Reelix most good scientists don't do it for money, the ones who get the money are businessmans
Reelix: @hordead What's your credit card number, CVV, and expiry date?
Mariosavitch: Meat
Landowner555: papers are publically funded, and yet not able to be accessed by the public
zwisch: taking zinc all the time is not good for you
Landowner555: iconic
hordead: @Reelix sure.. Give me a second let me get my card
C0deCane: hospitals are considering universal do not resuscitate orders for corona virus patients
jimmyadaro: cowabunga it is
Appz_x: make sure you take copper with zinc
Landowner555: @C0deCane thats bull
Landowner555: lies
miiiiiiim: @C0deCane ?
eric_hansen: @georgehotz do you take magnesium?
miiiiiiim: source
FreddiesDeadieButHasAces: what are we doing?
l1ght5p33d: treating a patient should be up to the doctor
pz3300: Fuck them supplements George. Just eat proper food man.
Reelix: @wheely_mcbones Could claim the same about the creator of any product
FreddiesDeadieButHasAces: research?
Pedroso: Hey George, How do you manage to be so disciplined?
hordead: @C0deCane nonsense
Landowner555: where are you storing this info????
l1ght5p33d: thats why hospitals pay them so much
Abnico: @benchai18 lol i laughed a lot
hordead: @Pedroso Just do it
wheely_mcbones: @Reelix yep, what this says about our society?
l1ght5p33d: if theres a loss in profit I'm sure doctor would be able to optimize that if his job required it
Reelix: @wheely_mcbones That people would prefer not to do manual labor if given the option
Ayyyy420Lmao: @wheely_mcbones what does it say about you? why arent you working for free? gimme ur money
hordead: @Reelix Not a reasonable comparison
C0deCane: @hordead just saw it on the news washington post but i don't believe much news anyways
extremelywide: LOL
hordead: So any discoveries about the Chinese virus?
wheely_mcbones: @Ayyyy420Lmao I'm actually working for free in college, making jobs in an area I'll probably not work just to spend my time with people I like
C0deCane: I like the kongflu a lot better LUL @hordead
Reelix: @hordead It is if you extrapolate several levels backwards. You need food which comes from farms which are currently not automated and require manual labour which requires payment.
peter35_: i learned about introns and exons from mgs2 LUL
el1s1us: good evening, say hi to brazil mr george
Ayyyy420Lmao: @wheely_mcbones ahahaah he does it for free
5_betbluff: gotta think a lot involved in farming is already automated or can be pretty easily
Landowner555: tbh papers should be available to the public but wheely is a tool
Landowner555: just use sci-hub tho
Reelix: Sure - It can - But then people complain that its not natural and so on
Landowner555: thank me later
sidthescikid: hey chat, is it possible for a machine learning algorithm with access to the internet just 'learn' or is there some external limitation?
Pedroso: @hordead Thanks, haha
nitrixen: Chat, is there an organism with not too many genes that we perfectly understand to use as learning material to get into this stuff?
duncansclarke: @sidthescikid What do you mean by learn?
Landowner555: @nitrixen ecoli
Reelix: @sidthescikid They work via positive and negative reinforcement, so it would need to know what it should be learning
Ayyyy420Lmao: @nitrixen bacteria or multicelular eukaria?
FreddiesDeadieButHasAces: that the thing their talking about up there lol
benchai18: @nitrixen Yes. @ayyyy420lmao‘s mom
FreddiesDeadieButHasAces: this is a great stream
FreddiesDeadieButHasAces: thanks @georgehotz
l1ght5p33d: @nitrixen what is "not too many genes"
pomprocks: biology is like some sort of alien technology 10000 years ahead of own
5_betbluff: Any one got advice on how to stop being lazy
Ayyyy420Lmao: @benchai18 woah cool it she died of cancer
hordead: @FreddiesDeadieButHasAces nice name
peter35_: in vivo
wheely_mcbones: yeah it can learn, but if you don't define it will probably "learn" things that are useless
FreddiesDeadieButHasAces: thanks @hordead
peter35_: "in glass"
pz3300: Yeah
benchai18: @ayyyy420lmao I’d say the same.... even if false
wholesome_pepe: in vitro = testube. in vivo = body
RNG_S0uL: NY is so fkd man it's getting scary here
pz3300: In vivo
Landowner555: in-vivo = in a living animal
theonlymonkas: yo vivo
happypuppppy: @5_betbluff just don't be lazy 4Head
sidthescikid: @Reelix Ahhhh, I see.
l1ght5p33d: with the Pure 100% AAA default Enzymezzz
5_betbluff: in vitro, isn't that a nirvana album
foti_kasparov: cbrah420Pepe cbrah420Pepe
benchai18: @ayyyy420lmao u know I love u don’t worry
Landowner555: in-silico = on the goddamn supercomputer
tkdboy555: @georgehotz is this relevant? https://onlinelibrary.wiley.com/doi/full/10.1002/jgm.1111
tkdboy555: @georgehotz "An efficient RNA‐cleaving DNA enzyme can specifically target the 5′‐untranslated region of severe acute respiratory syndrome associated coronavirus (SARS‐CoV)"
Landowner555: ur computer is burning up dude
Landowner555: its so loud
C0deCane: well honestly to produce real data that we can rely on we need more time
l1ght5p33d: "An efficient RNA‐cleaving DNA enzyme can specifically target the 5′‐untranslated region of severe acute respiratory syndrome associated coronavirus (SARS‐CoV)"
l1ght5p33d: u mean a nuke
Abnico: what is with the autists asking how to code and not be lazy, is this stream cursed
Landowner555: LUL
Reelix: @sidthescikid For example, a ML thing for Mario would use an increase in the X axis (Moving right) as positive, so it would try a million different ways to do that, and follow the pathways that work
benchai18: @abnico Lol.
Landowner555: @tkdboy555 what is that called btw
foti_kasparov: @abnico Seen a lot of them
peter35_: Abnico have we had an adder*ll ref yey? Kappa
peter35_: yet*
tkdboy555: @Landowner555 I posted the title of the paper after the link
C0deCane: @Abnico teach me code pwease &gt;(
l1ght5p33d: An efficient RNA‐cleaving DNA enzyme can specifically target the 5′‐untranslated region of severe acute respiratory syndrome associated coronavirus (SARS‐CoV) and nothing else ever for eternity and beyond
Ayyyy420Lmao: @tkdboy555 i dont think the dna can get inside cells in vivo, they used electroporation or some shit in the papaer i guess??
Waldoqq: IM BOUT MY PAPER LIKE A MUH F*CKIN SCRATCH AND WIN
foti_kasparov: Coming from r/depression and r/getdisciplined
Abnico: people over complicate things to give them excuses i assume
wheely_mcbones: are people coming here from ibs?
Tyoo_: hey george, opinions on renting vs owning? do you own your apt?
wheely_mcbones: I came from Lex Friedman
Landowner555: @tkdboy555 ty
benchai18: @abnico hOw I HaCk aNd bE sMaRt aNd GeTz goOdZ jOb aLsO wHaT aRmChAiR rEsT u UsE
Reelix: @sidthescikid Like "Moving 10 pixels right gives you 100 points, and getting a coin gives you 50 points - You have to get to 10000 points - Go"
C0deCane: yeah and only people in group 3 can go there LUL
AzzoDio: This one was better than the chloroquine study, where all the deaths were in the treatment group. You really want to compare outcomes but all these so far just do viral load.
Landowner555: @Ayyyy420Lmao yes, obviously
sidthescikid: @Reelix So if the goal for this hypothetical ML alg. is to interpret text, I would have sample data that compares the tested output to the correct answer and reinforce is respectivley
Abnico: @benchai18 hello what version of osx do u use?
dontbeameme: Did we find out how deadly it really is?
pz3300: Chinese people got skills. Dude in a back alley can make an iPhone from scratch
benchai18: @abnico I’ll tell u only if u tell me what resolution your monitor is set to. Please.
dontbeameme: Sacrifices need to be made for the good of the economy people
sidthescikid: Me :)
foti_kasparov: @benchai18 Should I go in college?
Ghost_001: not me :)
granti7: who wants to try fap? Kappa
gazny: Stick it in me doc
Risx: 0.2-0.6% if we go off SKorea &amp; Germany
mashafique: Just blend all those meds into a strawberry smoothie and stick a straw in my mouth
benchai18: @foti_kasparov What time should I wake up in morning?
bufferovrflw: rip Prince Charles
Abnico: @benchai18 should i go to college?
wheely_mcbones: 1% is really high
pz3300: George mengalin there!
360Plato: How would you do the placebo lol
guinness84: ventilator death rate for &lt;40 y/o?
AzzoDio: @georgehotz Theya are doing that. They used remdesivir on the first patent in the US
benchai18: @abnico Should I wipe forward or backward?
Reelix: @sidthescikid You would need to give it various levels of "correctness", and "wrongness" and input practices it can use (Eg: Click a link), and it would go
gazny: Do it to help prevent more deaths
cankunwang: only if ppl get treatment then 1%
dorkmo: https://arstechnica.com/gaming/2020/03/plague-inc-rolling-out-new-mode-where-you-fight-to-contain-the-outbreak/
Hawklite: what are the chances of death if you don't go on a ventilator?
masters8: Cause that's how placebo works...
happypuppppy: Bernie is 78 monkaS
anotherkidnamedaustin: comma.bio
Abnico: @benchai18 what underwear are u wearing?
pz3300: 50% of all medicine is placebo
Landowner555: WHAT
sidthescikid: @Reelix So tools and score
wheely_mcbones: if you know is a placebo is probably not gonna work
360Plato: @masters8 he doesnt get it
foti_kasparov: @benchai18 Should I start drinking green tea too?
Ozonemaster: i was afk i missed on that one
Ozonemaster: whats that treatment?
Lizardan: @pz3300 facts
t00big2fl4il: Favipravir?
sidthescikid: Trump is 73 thoo
dontbeameme: It’s the patients fault for not knowing what to tell the doctor
Ozonemaster: will do
Reelix: @sidthescikid Yup. It will try every tool in every possibile combination, and discard the pathways which give a low score / don't increase the score fast enough, and carry on going
nitrixen: Hydrocloroquine opens an ion gate that lets more Zinc in the cells. Zinc binds with I dont knwo what that stops the replication.
wholesome_pepe: the direct cause of death is actually the symptoms from the immune system going crazy and flooding your lungs
bufferovrflw: @georgehotz commit the changes?
zwisch: why do you /asdf every time you :w ?
iopanics: How can I find covid 19 genom sequence? Do you have a link?
nitrixen: @zwisch Presumably he doesnt know about :nohl
alicyka: "Sorry sir, we can't give you the medicine you want-- for your own safety, because some people don't want to take the risk"
benchai18: @abnico @foti_kasparov should I fill up unleaded 87 gas or 89?
Ayyyy420Lmao: @iopanics first google hit https://www.ncbi.nlm.nih.gov/genbank/sars-cov-2-seqs/
dorkmo: plot twist, george is Jude Law's character in the film Contagion CorgiDerp CorgiDerp
peter35_: does caffeine fuck with it?
PotlePS: FORSYTHIA
murgmasallam: @iopanics For the Wuhan genome , https://www.ncbi.nlm.nih.gov/nuccore/NC_045512/
Stegosaurian: dude how does he read so fast?
iopanics: @Ayyyy420Lmao thank you
ryanm0012: George come fix my computer
Ozonemaster: trainedf
wheely_mcbones: should I watch contagion?
pz3300: They even do placebo knee surgery’s now and they out perform the real surgery. No shit google it.
Reelix: @zwisch To make sure the window is currently focused
wheely_mcbones: @pz3300 I heard about that
J0hncr055: Can anyone explain what he means by 'reverse engineer coronavirus"? Like research for a potential cure or something?
Stegosaurian: I am trying to catch up but he scrolls before i finish the paragraph lmao
Hawklite: he doesn't actually read he just reads a few words and then guesses what the text says
sidthescikid: @Reelix Okay I understand. How would I start to do that? I kinda just want to know whether ML can get access to Wikipedia or Google and autonomously navigate and understand new topics
Stegosaurian: oh
J0hncr055: PotlePS Forsythia LUL
darkclemo: I have literally no idea what's going on but it's so interesting to me
t00big2fl4il: sequence https://www.gisaid.org/
mashafique: @J0hncr055 just working backwards from the virus and figuring out how it works and what its made of
wheely_mcbones: @J0hncr055 god or nature engineered he is trying to reverse engineer it to understand how it works
Reelix: @sidthescikid Finding an ML example in your programming language of choice would be the best way to start
J0hncr055: mashafique ahh gotcha thanks!
dorkmo: found the fure bros https://en.wikipedia.org/wiki/Forsythia
AzzoDio: @georgehotz here's one more treatment to consider, quercitin   zinc, explanation here: https://www.youtube.com/watch?v=vE4_LsftNKM&amp;t=6m11s
entangledbeing: Final coronavirus stimulus bill is 880 pages long...
mashafique: @J0hncr055 no problem
sidthescikid: @Reelix Im sure there are python ML libraries
murgmasallam: Are spike proteins unique to a particular virus?
Reelix: @sidthescikid TensorFlow is common
nitrixen: @J0hncr055 Viruses are sequences of genes. The genes turns into different proteins that do various things. It's just like reverse engineering a codebase, to find out what are the functions and what they do, so you can patch where it's going wrong.
l1ght5p33d: @dorkmo "containing several winged seeds" agreeed
t00big2fl4il: excellent graphic https://www.gisaid.org/epiflu-applications/next-hcov-19-app/
Stegosaurian: @mashafique do you think the information found on wikipedia and the basic definitions on the websites is enough to really understand the virus? I fear the info there might be a bit too generalized and simplified.
wholesome_pepe: patent troll incoming?
nvda9: scam scam scam
dontbeameme: Wikipedia is not trusted source
sidthescikid: @Reelix I'll eat up that documentation then
eric_hansen: @georgehotz are you looking at homeopathic treatments too, such as isatis root
wheely_mcbones: little change in the molecule can cause huge changes in the effecst
granti7: did you check this? https://chemrxiv.org/articles/Repurposing_Therapeutics_for_the_Wuhan_Coronavirus_nCov-2019_Supercomputer-Based_Docking_to_the_Viral_S_Protein_and_Human_ACE2_Interface/11871402/4
wholesome_pepe: just change one of the double bonds. ez profits
dontbeameme: Plz someone edit the wiki George is using
nitrixen: @Stegosaurian He's opened over 100 papers since the beginning of this...
Reelix: @dontbeameme Until you try edit something only to have it reverted 5 minutes later by someone citing 10 different references
mashafique: @Stegosaurian I think Wikipedia can serve as a good starting point for understanding the basics of terms and whatnot. There are also references on Wikipedia that you can follow and read from there.
Nussinov: wikipedia's absolutely sufficient for his purposes here.
xhunter0001: But you promised you wouldn't be here today
sidthescikid: Wait thats actually a molecular-level scam LUL
AzzoDio: @georgehotz This is another zinc ionophore strategy https://www.youtube.com/watch?v=vE4_LsftNKM&amp;t=6m11s quercetin
nvda9: ca
ionelaipatioaei: !uptime
nvda9: can we trust Wikipedia
Juankinator: can you trust anything?
mashafique: @Stegosaurian I think to truly understand the virus you would need a thorugh understanding of virology and access to lab equipment to actually study it. George is just learning what he can and then trying to apply a programmatic approach to understanding the virus.
alicyka: Store-brand Adenosine
wholesome_pepe: u have to write a convoluted af patent that no one understands
Reelix: @nvda9 Scientific / Medical things are often edit-locked
sidthescikid: @nvda9 its better cited than any other website
hordead: @georgehotz Do you regret not becoming a doctor now?
RobMonstaFlex: isn't adenosine what caffeine blocks the reuptake of?
xxghom: what is he doing exactly?
TheFallDamage: whats ur kb?
Landowner555: isnt adenosine in caffeinee?
dontbeameme: @xxghom He finding the cure
TheFallDamage: LOL
kamtb28: Are your notes online anywhere?
darknesscrysis: is he developing an ai to find the cure for corona? and every other virus while at it :p
hordead: fap ratio?
mashafique: @Landowner555 Caffiene is its own molecule.
eric_hansen: @kamtb28 it's on his github: github.com/geohot
sidthescikid: monkaHmm
Landowner555: @masters8 i know that, i think they act on similar receptors though
Reelix: @darknesscrysis Currently attempting to reverse engineer it, and understand it as he goes along
nitrixen: @xxghom @darknesscrysis Viruses are sequences of genes. The genes turns into different proteins that do various things. It's just like reverse engineering a codebase, to find out what are the functions and what they do, so you can patch where it's going wrong.
sidthescikid: Imagine your body falling for the scam
horlabholu: @georgehotz what are you doing,what are trying to achieve?
wholesome_pepe: this is basic drug discovery?
mashafique: @Landowner555 yeah i believe it acts on teh adenosine receptors
RobMonstaFlex: same trick different patent maybe LUL
UniversalGeneve: these antivirals look like DNA base pairs since their action is to bind to the viral RNA
kamtb28: @eric_hansen thanks!
msuiche: Just got in, same question as @horlabholu
wheely_mcbones: small changes in the molecule can cause huge changes in the effects
tkdboy555: @xxghom he's currently identifying the molecules that can adhere to the enzyme gates through which Sars-Cov-2 enters the cell, thereby preventing the virus from penetrating the host cell
msuiche: I didn't realize you were streaming every day, that's awesome!
AzzoDio: @georgehotz FYI zinc is only one possible explanation of the mechanism the malaria drug might work : https://twitter.com/CurlyJungleJake/status/1238864747035942913
Reelix: Changing    to -- in a program can also cause a majorly different outcome in a million LoC app :p
xxghom: thanks chat
wholesome_pepe: scammivir
Stegosaurian: @mashafique you would think there would be a thorough and detailed explanation about the virus or how it functions online but there aren't that many. I always assumed pharmaceutical companies publicly shared info like this
ryanm0012: george do you still fix computers?
mik12f4: Maybe we can vaccinate with Mosquirix or they can customize it?
l1ght5p33d: python is only one possible explanation
Landowner555: 50% of the effectivness of the drug boils down to how its delivered
Juankinator: cant we just nuke coronavirus?
Juankinator: Kappa
tkdboy555: if you can prevent the virus from entering through the gates that can fit into on the cell membrane, it can't survive.
Landowner555: other 50% from structure
Ozonemaster: inmunodepressant is a bit risky isnt it
Reelix: @Juankinator You could - Sure - But you'd eradicate almost the entirety of humanity in the process
mashafique: @Stegosaurian Viruses are pretty complicated. And there are different types of coronaviruses. If I'm not mistaken, coronavirus just refers to the virus shape.
Abnico: just execute the infected, simple
pz3300: It can’t survive a healthy person immune system
Reelix: @Abnico China literally locked infected people in their own house - It worked...
pz3300: Or we wouldn’t be here
Ozonemaster: adenine is of dna
mashafique: @Stegosaurian you can definitely find info on how viruses in general work I'm sur eonline
btpisroot: Bio study group
PiroFloydian: Adenosine is the sleepy chemical that caffeine mimics in the brain right @georgehotz
Landowner555: im so lost rn
l1ght5p33d: 3d diff
l1ght5p33d: with charge weight
matvey_ryabov: They do be a little diff
matvey_ryabov: )))
Abnico: hell yeah looks tasty
l1ght5p33d: plus folding probability
mashafique: It's pretty wild how much of a difference functional groups make.
wholesome_pepe: functional moieties and active binding sites Kreygasm
Ayyyy420Lmao: you can probably even find a NMR of a cristalized resecptor with cocaine bound
pz3300: Fuck synthetic drugs
UniversalGeneve: @georgehotz a molecule isn't "fully" engaged when in effect, i.e. only a portion of it is an active site that's recognized by whatever it binds to
wheely_mcbones: people who snort ritalin to play MTG all night know it
l1ght5p33d: https://www.youtube.com/watch?v=w0HLqrKjl4c
brewery85: LUL
TheFallDamage: thats just because of the bond with Oxygen they look similar
Abnico: https://en.wikipedia.org/wiki/Lisdexamfetamine
Reelix: They both have lots of Hydrogen, Nitrogen, and Oxygen - The same as the air we breath :p
zwisch: is George confusing adenine and adenosine again?
Reelix: Coincidence? ;D
williamjennings1: what is caffienes half liife?
Stegosaurian: @mashafique I know but I was surprised to see there was a culture of pharmaceutical companies keeping their research private while making it public would only do good. but C.R.E.A.M I guess lol
brewery85: timeout
hootdaflute: adenosine is also used to treat arrythmias of the heart
AzzoDio: Best case scenario for the world, drink 4 large ice coffees every day and you recover 100%
nitrixen: Imagine if people drinking coffee is what activates coronavirus lol
eric_hansen: i think the sleepy chemical is serotonin @georgehotz
Reelix: @williamjennings1 About 6 hours
mashafique: @Stegosaurian Oh yeah, money is def a factor
wheely_mcbones: @hootdaflute this explains a lot
PiroFloydian: yeah i cause thats why coffee naps work
williamjennings1: caffeine latest time to take caffiene and go to sleep on time
mikey9988: monkaW
pz3300: Herion is sleepy chemical
swill_: POG
AzzoDio: If I had to quit caffeine to avoid coronavirus, I am not sure I would survive quitting honestly. Dead either way.
Reelix: @williamjennings1 I can have a triple espresso and fall asleep 2-3 hours later - It affects everyone differently
swill_: first stream ive caught live hi goerge
mikey9988: would explain the uproars in the us and italy KEKW @nitrixen
zwisch: papaya has a lot of papain
alicyka: You could definitely use the last hour to convince a CNN reporter than coffee makes you susceptible to the virus
zwisch: papaya papain papaya papain
Abnico: @AzzoDio there is wayyyyyy better stim
alicyka: the iphone hacker said so
EduardoElGAMO: what this guy is doing ?
Reelix: @zwisch That's because papain is named after papaya...
l1ght5p33d: that paper looked legit af
zwisch: Reelix that was a simpsons reference
Reelix: Aaah
wheely_mcbones: did he described learning?
Ayyyy420Lmao: @Reelix then pikachurin was found in pikachu?
TheFallDamage: CoronaVirsu human made? hmmm
soawesome33: Maybe, george hack the coronavirus
l1ght5p33d: making a chart for the abbreviations only in your own paper = boss level
Reelix: @Ayyyy420Lmao Assuming we lived in Pallet Town - Sure - Could happen
FreddiesDeadieButHasAces: this is awesome, I alas must sleep, good night all
williamjennings1: Cool chair
Stegosaurian: George is gone. let's talk about how great of a company facebook is
soawesome33: George save the world
THX1342: hello
Stegosaurian: before he comes back quick
nvda9: it's morning here
wheely_mcbones: @TheFallDamage human interference leave a signature in the RNA, the Corona Virus don't have it.
UniversalGeneve: wanna see something crazy? the current ncov19 virus had been speculated since 2013: https://www.nature.com/news/deadly-coronavirus-found-in-bats-1.13597
williamjennings1: o:
TheFallDamage: @wheely_mcbones but they vaccine they are making is using the CHANGED RNA
mik12f4: Why wouldn't they consider using a vaccine for Malaria for Covid19? Mosquirix
MrTriharder: @georgehotz Facebook online hackathon is live right now. Topic is corona virus related work. Please participate
theonlymonkas: :0
hootdaflute: @UniversalGeneve uhh where have u been? MERS and SARS is a strain of corona
Ayyyy420Lmao: theres an even older on from 2007
wheely_mcbones: @TheFallDamage is close enough but not the same
Ayyyy420Lmao: https://cmr.asm.org/content/20/4/660 2007
t00big2fl4il: https://www.gisaid.org/epiflu-applications/next-hcov-19-app/
pz3300: Bill gates is like “ I took in told you”
THX1342: did geo buy the pcr kit?
TheFallDamage: @wheely_mcbones hmmm. yeah but that shouldn't be the case because a vaccine is a dead virus or weaker version of it
Ayyyy420Lmao: even a broken clock is right once in a while, like those goldbugs calling for market crashes
tkdboy555: @georgehotz check this out my dude https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3151162/
Reelix: @mik12f4 For the same reason that you have different vaccines for different things
btpisroot: Hey everyone, I am predicting that I will die.
pz3300: A broken digital clock is never right
MrTriharder: Idk how China managed to get one more virus in the span of 6 months
alicyka: If you want GIS data you can usually find a REST service using the developer console
mashafique: @btpisroot remember 100% of people who drink water die
RNG_S0uL: the movie contagion hits different today... spooky how similar even the talking points are
williamjennings1: congratz @btpisroot
Reelix: @btpisroot Within the next 75 years? Highly likely
wheely_mcbones: @TheFallDamage you are right, they are trying to engine a weaker version that is close enough, when they accomplish we'll have a good vaccine
Reelix: @mashafique Ban Dihydrogen monoxide? :p
Ayyyy420Lmao: molecualr docking = drug discovery how is that offtopic lul
mashafique: @Reelix that stuff is scary bro LUL
Stegosaurian: amazing how we don't know anything about how viruses evolved or what they evolved from since they can't fossilize
l1ght5p33d: corona 2020
MrTriharder: monkaS
TheFallDamage: @wheely_mcbones but they are not tho. they are just using the CHANGED RNA to make the vaccine not to engineer a weaker version
Landowner555: @Stegosaurian viruses are just an enigma
l1ght5p33d: we want dashboards
l1ght5p33d: WE WANT DASHBOARDS
Reelix: @georgehotz WAY slower
hootdaflute: @Stegosaurian did u read the wiki page on virus lol
pz3300: Virus has low iq
duncansclarke: drinking black coffee out of a glass?
wheely_mcbones: @TheFallDamage I think you are wrong, if you are right this is risking the life of the subjects.
duncansclarke: alpha move
Thotshotgg: Just tuning in... Any progress?
Reelix: @georgehotz Only the people who care to learn about it will research it, whilst it doesn't discriminate
peter35_: don't they talk about giant, ancient viruses frozen in Antarctica and permafrost and stuff?
l1ght5p33d: whole o chem graph
THX1342: can you link that paper @georgehotz please
l1ght5p33d: o chem data structs
wheely_mcbones: in Brazil at least we just reproduced to know about the behavior
l1ght5p33d: whole o chem data python
l1ght5p33d: whole one
nvda9: vi
UniversalGeneve: here's the one after mers: https://www.wired.com/2013/10/bats-next-sars-pandemic/
darkclemo: what could happen if george finds something extremely likely to solve covid? send it to scientists?
mikey9988: 5Head ahhh yes
williamjennings1: 5head?
prostidude221: !uptime
Abnico: ucla lab still open bro
TheFallDamage: @wheely_mcbones YES THAT'S WHAT I AM SAYING. They are doing it because they know the coronavirus was created and the CHANGED RNA will work. THAT'S WHY THEY ARE not worried about subjects its just the matter of time so no one would suspect anything
Landowner555: dood its bsl3
prostidude221: how the fck can you focus on something for so long NotLikeThis
mikey9988: it's a BTTV meme , basically means big brain sarcastically or unsarcastically @williamjennings1
wholesome_pepe: we solving protein folding now? if we can determine that from genetic data then that would be Pog
williamjennings1: i have a 5head
ackxhpaez: It was predicted in a 1981 Dean Koontz book!
mashafique: you should enable bttv on the stream @georgehotz for the dank emotes
wheely_mcbones: @TheFallDamage this CoronaVirus is not created, you have expert articles explaining that
nvda9: oh ye
Ayyyy420Lmao: he read that b4 stream to seem smarter
mikey9988: PopChamp @williamjennings1
nvda9: oh yea
mikey9988: PogChamp @williamjennings1
Landowner555: man fuk if anyones injecting me with that
ryanm0012: favorite paper ever?
TheFallDamage: @wheely_mcbones do u believe those expert articles? who posted them? SAME PEOPLE WHO CREATED IT
360Plato: Is there any way to even know if a virus was engineered
THX1342: does anyone have the link to this paper?
Thotshotgg: Kreygasm NotLikeThis Kreygasm NotLikeThis
UniversalGeneve: you're probably more than most other labs can, since science research is defunded
dprophecyguy: Hey @georgehotz some people are also saying that virus affect slow in tropical countries like India and Pakistan ...
l1ght5p33d: find microscope output
Reelix: @TheFallDamage Programmers make viruses - Programmers make anti-viruses - Coincidence?
ackxhpaez: The virus wasn’t lab-created, they were simply trying to weaponize it, but it got out
wholesome_pepe: making a mutation on a couple codons cant be detected as a hack
subconix: what have you learned about covid-19?
Ayyyy420Lmao: @360Plato if it has dna identity to diferent viruses
jmp0ut: yo geohotz
williamjennings1: @dprophecyguy those people are pretty immune because they live in not very good sanitary conditions already forr years
ackxhpaez: Like anthrax
jmp0ut: pharmacology is what you need
t00big2fl4il: alpha, beta, gamma, and delta coronavirus
jmp0ut: genome lyasing on side channels
jmp0ut: like serrapeptase
TheFallDamage: @Reelix thats what I am saying dude
jmp0ut: and MCT interstitial micronization
THX1342: williamjennings1 stfu...
Ayyyy420Lmao: heat button? gonna burn some gasoline
snapcs1: @williamjennings1 thats not how it works lmao
nvda9: is he taking notes on green text, can't read them
TheFallDamage: @georgehotz why china didnt close its border when they found the first case
Landowner555: @jmp0ut i swear ur making those words up
Reelix: @TheFallDamage Electricity in your PC - Lightning kills causes fire - Therefore... PC's cause light!
Stegosaurian: it already has two strains. luckily even if manages to evolve again. it won't evolve to be more deadly. because the deadlier the virus the less infectious it will be.
jmp0ut: not at all
williamjennings1: im just guessing lol
360Plato: @Ayyyy420Lmao thks
jmp0ut: you can look up every word
wheely_mcbones: @TheFallDamage the arguments convinced me, I'm open to new information, but the ones saying it was not engineered looks stronger to me now.
jmp0ut: and it makes sense
hordead: @georgehotz ny is going to start using the blood of recovered patients to help those critically infected.. isn't this all we need?
l1ght5p33d: Nueron protiens? Brain virus. name my band
Reelix: @TheFallDamage The same reason no-one else did
pz3300: He’s got a point though. We over sanitize our homes
jmp0ut: not my fault if you're not literate to use word searches
peter35_: TheFallDamage maybe they figured they could contain it in their country and western countries would fail
mikey9988: not a 5Head after all @williamjennings1
jmp0ut: proteases are very useful
mashafique: More like 3Head ela12
williamjennings1: have u seen india sanitary conditions
snapcs1: its not cool to spread misinformation
TheFallDamage: @peter35_ CHINA didnt announce the first case when they had it. they waited so long to announce the virus
Landowner555: "genome lyasing on side channels"
Landowner555: that sounds dumb man
jmp0ut: A protease is an enzyme that catalyzes proteolysis, the breakdown of proteins into smaller polypeptides or single amino acids.
snapcs1: if you dont know something dont talk like you do
jmp0ut: you sound dumb man
l1ght5p33d: bro india hasn't seen indian sanitary conditions
nvda9: a Chinese doctor imprisoned for 3years for making genetic modified baby
jmp0ut: why dont you want to resolve what i mean
jmp0ut: that's jank
nvda9: *genetically
jmp0ut: get dunked on
Landowner555: i already looked it up, nothing important comes up
TheFallDamage: @peter35_ simply but making an assumption by containing the virus in their country caused so many people's death
tkdboy555: @georgehotz the reason why I shared the molecular docking paper is because molecular docking and molecular dynamics and intertwined. You will need to implement statistical distributions of molecular docking methods into your program in order to highlight the behavioral probabilities of whatever drug/molecule you decide to simulate as a receptor blocker.
jmp0ut: because you're expecting a cookie cutter solution
jmp0ut: numpty
Stegosaurian: @nvda9 modification to what? can you link the source?
Landowner555: relax ...
Landowner555: yikes
jmp0ut: wake up
nvda9: it's on new York times
jmp0ut: tyke, squirt, champ
nvda9: wait
l1ght5p33d: wtf is numpty
l1ght5p33d: is this numpy
l1ght5p33d: only numpy here
dprophecyguy: Hey, @georgehotz Can you also tell how you read these papers so fast and without slowing down? I really wanna pick how you look for pointers and navigate through paper
t00big2fl4il: Rae1
UniversalGeneve: you can buy those btw
nvda9: here it is https://www.nytimes.com/2019/12/30/business/china-scientist-genetic-baby-prison.html
Landowner555: @dprophecyguy increase IQ 4Head
Reelix: @dprophecyguy I'm decent at software dev and such, but bio completely destroys me - No idea how he does it...
hootdaflute: primase is taught in basic bio
Landowner555: @nvda9 is that relevant to corona?
nvda9: no
Landowner555: thats old news man
xmalware60: Nidovirus?
dprophecyguy: @Landowner555 It's not about IQ, IQ might be related to the speed at which he is synthesizing information. But what i am talking about is, how he skim through the paper
dprophecyguy: I see that there is a pattern of how he is reading and skimming through by just looking at keywords
Landowner555: @dprophecyguy i mean iwas jk, but i think thats also related to IQ...
UniversalGeneve: @dprophecyguy every bio paper has an "abstract" section in the front page, read that and you get a summary of the entire paper. you dig deeper into it of you think it's relevant for your study/research
wheely_mcbones: @dprophecyguy pattern recognition, therefore IQ
Reelix: It's looking for specific familiar keywords to latch on to to get a jist of what its about
l1ght5p33d: 6 10
Kawhiet: Will viruses like this lead to more leeway on genetic testing?
DecayingSkullz: I have 4,040 channel points.
williamjennings1: @DecayingSkullz congratz
jmp0ut: now you're looking at phosphorylation
dprophecyguy: @UniversalGeneve Maybe that's case
DecayingSkullz: @williamjennings1 thx
jmp0ut: welcome to nerve gas VX production gang
mashafique: @UniversalGeneve I think every proper research paper has an abstract.
Ayyyy420Lmao: spend them
jmp0ut: organophosphate poisoning is some seirous business
THX1342: gdbio
happypuppppy: @georgehotz have you looked up any realistic molecular simulation videos on youtube
AresRai: its decades
Penguino138: Did you end up buying the DNA reader?
jmp0ut: last i heard of cheap chiral centers for nerve agents it involved borneol
l1ght5p33d: Nothings wrong if you generalize enough and add caveats
jmp0ut: bathtub VX gas
UniversalGeneve: @georgehotz here's a cool vid on dna replication: https://www.youtube.com/watch?v=7Hk9jct2ozY
wheely_mcbones: a lot of it is certainly wrong because of how academic articles work, confirmation bias
Ayyyy420Lmao: @jmp0ut uncle fester is that you?
dprophecyguy: @UniversalGeneve Are you from bio field ?
tshields44: https://github.com/bigginlab/OxCompBio/tree/master/tutorials/MD
tkdboy555: @georgehotz Molecular docking is extremely relevant to ligand-protein interactions, which is basically what is happening when sars-cov2 binds to
jmp0ut: :)
tkdboy555: @georgehotz ACE2
Landowner555: @wheely_mcbones thats such a ridiculous statement lol
wholesome_pepe: cryo electron microscopy is the furthest we've come to observing it. before it was x ray crystallography
UniversalGeneve: @dprophecyguy yeah, trying to move into SWE tho
wheely_mcbones: the most renowned probably are not because you'll become famous by proving them wrong
tkdboy555: @georgehotz "Rapid Context-Dependent Ligand Desolvation in Molecular Docking" https://pubs.acs.org/doi/abs/10.1021/ci100214a
jmp0ut: 26  years of science in my belt
jmp0ut: including hacking polaritonic systems
wheely_mcbones: @Landowner555 most of them, the most important are not bs
AresRai: they need more computers in bio
TheZarkxs: and still do not develop a vaccine, thats how they spend our taxes
tkdboy555: @jmp0ut is my post relevant then?
Emanuell45: are we in qna
Landowner555: another WEEK&gt;" LMAO
Emanuell45: ?
Lana_Lux: get them on stream
Landowner555: naw man
williamjennings1: few weeks
zelkh9: another week and had to google n terminus yeah ok bud
tkdboy555: @Lana_Lux you a beast
sliceserve: do you have one glass to the left, and another to the right?
ziggyzergling: true LUL
Lana_Lux: LUL
jmp0ut: @tkdboy555 sure is, good find
tkdboy555: @georgehotz "Rapid Context-Dependent Ligand Desolvation in Molecular Docking" https://pubs.acs.org/doi/abs/10.1021/ci100214a
nvda9: locust
Landowner555: the people who run these studies are mad smart
wholesome_pepe: we dont have the necessary tools to watch the components of a cell move around
theonlymonkas: but why bats don't die???
mehdi_tw: common geroge we know that if we give you few weeks you will create a new virus man
AresRai: get another virus expert LUL
Lana_Lux: @tkdboy555 haha
C0deCane: LUL thats how America does things
iamaaronbowley: i have better things to do yet im here :)
cookienz: start a gofundme and rent ur own lab ez
Ayyyy420Lmao: @Lana_Lux are u the girl that called him on the phone earlier???
bulksquat_thrust: Probably doesnt give the pharma companies enough money
murgmasallam: Do you have any idea about the vaccines in trials in the US? They are doing it already
gazny: We need Agile development in bio
aj37z: lmao
jmp0ut: like solving narcolepsy, not enough money
jmp0ut: they just want drug addicts
t00big2fl4il: throw the genome data at qira
Landowner555: fever drop to 0 4Head
hordead: a company will take all the credit
wheely_mcbones: yeah, and even after all that people still doubt vaccines
jmp0ut: noopept helped me retrained my brain
Lana_Lux: @Ayyyy420Lmao no
bulksquat_thrust: daily corona standups
Appz_x: lmao
tshields44: https://github.com/bigginlab/OxCompBio/tree/master/tutorials/MD
happypuppppy: isn't that what the github issue told you to do
TheZarkxs: coronavirus is a pretty cool name not gonna lie
UniversalGeneve: what's hard is that bio isn't really something you can just visualize. i'm a visual learner so i struggled with the subject for a while
tkdboy555: @georgehotz This will help "Rapid Context-Dependent Ligand Desolvation in Molecular Docking" https://pubs.acs.org/doi/abs/10.1021/ci100214a
theonlymonkas: imagine all the people
mashafique: My main issue with academia and the reason I didn't bother pursuing a PhD is there there's too much focus on fighting for grant money and pumping out papers instead of actually focusing on quality results. Add that to having to teach and other beaurocractic stuff that slows down progress.
l1ght5p33d: Thats what university students are for
t00big2fl4il: corona genome data input -&gt; qira
jmp0ut: money is jank roaded
localcanofdutchgold: lul
jmp0ut: bank road is jank road now
bulksquat_thrust: @mashafique same
Ayyyy420Lmao: that happens so much with omeprazole, they give it out for no reason
THX1342: LUL
wheely_mcbones: the system is broken, maybe in the next years with crowdfunding
SolarBerry: martin shkreli
Thotshotgg: STAY INSIDE
Ozonemaster: qiravirus
Landowner555: @mashafique typically good papers require good quality results
Landowner555: @mashafique nature papers etc
l1ght5p33d: glory &gt; money
xalariian: thoughts on toilet paper situation
bulksquat_thrust: omeprazole made my acid reflux worse
jmp0ut: at the end of world war 2 it took psychiatrists to rebuild japan, they were the drivers of the economic reparations post nuked japan not economists
williamjennings1: hotz university
Hawklite: why would you start your own university instead of trying to reform public schools?
ImpalerV: have we made any progress so far?
tkdboy555: @georgehotz "Rapid Context-Dependent Ligand Desolvation in Molecular Docking" https://pubs.acs.org/doi/abs/10.1021/ci100214a
jmp0ut: when psyops mutinies on five eyes
dprophecyguy: @georgehotz Why can't you apply the hacker culture but in open source kind of way
Landowner555: ur going to school!?
jmp0ut: it's always a party
UniversalGeneve: Isn't a PhD basically "work on a project, specialize you knowledge towards your project, and learn to teach"
Joeliftstuff: how many prog. languages do you know?
TheFallDamage: Trump University
wholesome_pepe: how universities gonna compete with open source knowledge tho?
l1ght5p33d: is this a scam
ideology_sniffing_raccoon: LUL
l1ght5p33d: are we being trolled
pz3300: Did you say your starting a university?
JdPaulBlart: trump university 2.0
Ayyyy420Lmao: @bulksquat_thrust yeah but the thing is that they give it out alongside any other med nowadays, at least in my country, they bought all the doctors or something, they say it's a ''stomach protector''
Landowner555: @UniversalGeneve Phds are meant to teach you how to think critically and scientifically about a problem, and solve it. everything else is secondary
informalgarlic: super happy fun time now university
Eternallightning: WYOMING ?
Kawhiet: Is this like Kanye's ranch?
gazny: What kind of weather we talking about
tornpaperyoyos: OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq
imafungi53: whats your net worth geo?
C0deCane: CULT 100%
mashafique: @Landowner555 exactly but often you find yourself trying to get something out there to keep getting funding
l1ght5p33d: WYOMING???
deep5: SAT KEKW
Stegosaurian: is it going to be free?
l1ght5p33d: double or triple bunk beds
TheFallDamage: Internship at Comma.ai guaranteed?
Jehhred: comma.edu sounds good
wheely_mcbones: like "prove you really want to learn and know how to learn new things"
pz3300: Fucking the teacher
yaus_baus: george hotz cult
Landowner555: @mashafique thats more on the end of the PI though
l1ght5p33d: not quad bunks ...
zwisch: just don't pull a Siraj
coloneljerkoff: Will polygamy be allowed?
dprophecyguy: @georgehotz Like Recurse Center https://www.recurse.com/ It's for programmers
Landowner555: @mashafique though yes grants are competitive..
dorkmo: https://wiki.opensourceecology.org/wiki/Factor_e_Farm
williamjennings1: hell yeah
Stegosaurian: how will you select teachers?
l1ght5p33d: this is troll af
jmp0ut: so what do i do with the automated robotic warehouses pumping hypersonic weaponry for the space race
jmp0ut: nvm coronavirus
happypuppppy: can you just pay me with github stars
THX1342: just keep the MBAs out of it and it will do fiine
iDoMathss: LOL “WHAT DO YOU NEED MONEY FOR”
TheFallDamage: everyone in ur universities gets an internship in comma ai
bulksquat_thrust: id take a 20k paycut to work at a research lab like that
RadricCSGO: D:
phrixus_bro: after 10 years you learn the real truth about Xenu
Ayyyy420Lmao: @georgehotz you think we will get to mars in our lifetimes?
Hawklite: $30k/year to watch youtube in the classroom
UniversalGeneve: LUL
Landowner555: HAHA
dprophecyguy: @georgehotz What's the point of being together at one location ?
l1ght5p33d: geohot dont compromise your morals
jmp0ut: hating on greedkeeping babyfuckers
iDoMathss: FYI check the price of a thermocycler
jmp0ut: we are in a CBRN simulation
optimizely: @georgehotz how do you choose what to work on?
SolarBerry: not in the corona future
DecayingSkullz: What's your D2F?
jmp0ut: who breeds in such environments
Emanuell45: sounds like fun ngl
mashafique: It would be cool to have a community for focused on learning and sharing information. I would love to participate from a math&amp;physics perspective and learn from others and help others learn
mik12f4: i agree
pz3300: Headmaster George!
wheely_mcbones: @iDoMathss money is a pretty antiquate to measure someone contribution to society, it only works if people believe in it
Ozonemaster: odd view
360Plato: I never had that.... Just studied pdfs and wrote code
DevGabr: eae mano tira o corona da bahia pfv
Thotshotgg: WHAT DO WE HAVE TO DO?
Landowner555: *drops mic*
Ozonemaster: LUL
tornpaperyoyos: sphere itself
WEEEEEEEELL_ITS_KNOCC_OUT: SeemsGood
Kawhiet: Just drink pure zinc
Emanuell45: *walks away*
theonlymonkas: like prison
ICAntF331MyFAce: atpOld
Kawhiet: Got it
ziggyzergling: LUL
sliceserve: first time here, oddly interesting
360Plato: lol
TheFallDamage: which countries will do it first?
Landowner555: USA man
TeaLeafi: fascinating
pz3300: Getting high together
TeaLeafi: and true.
Parkpark1997: commaai cures covid-19
theonlymonkas: wash your hands
xmalware60: france
Parkpark1997: instant news headline
Eternallightning: "The only thing to fear is fear itself (unless ur &gt;70 years old)"
Ozonemaster: this guy manages the desktop windows
Ozonemaster: like a master
hordead: LUL
jmp0ut: yes
Ozonemaster: my desktop is always shit
Natschz: What do we have to do?? xD
imafungi53: okay that was not 20 seconds
Eternallightning: Alt Tab
Joeliftstuff: what do you thinks gonna happen
jmp0ut: such bindoze
Landowner555: the only thing to fear is sphere itself - flat earthers
TheFallDamage: @georgehotz u washed ur hands for less that 20 seconds
Thotshotgg: Is Monolaurin a good supplement to take?
innerbean: this is really fascinating
Emanuell45: your hands a dry
bulksquat_thrust: bulksquat_thrust subscribed at Tier 1.
sliceserve: is that the sleeping bed to the side?
tornpaperyoyos: imwaspS imwaspS imwaspS imwaspS imwaspS imwaspS imwaspS
Emanuell45: are*
xmalware60: Please wash your hands for at least 20 seconds
jmp0ut: pl0x signature so janked
Parkpark1997: washing hands dont cure coronavirus
Stegosaurian: @georgehotz What's the sickest you've been? why aren't you afraid of catching it?
Eternallightning: just dont get it 4Head
imafungi53: i missed it why shouldnt i be scared again?
Landowner555: h4ckerman DEBUNKS coronavirus
360Plato: its not like you got it by pissing on your hand
4zimut: tomorrow we are going to see a bigger pile of groceries
xmalware60: you don't have a table to eat?
mashafique: don't forget to hydrate George elaChug
optimizely: @georgehotz how do you choose what project to work on
sliceserve: he DOES have one glass to the left and a different glass to the right
murgmasallam: Dont do it man
theonlymonkas: shkreli has the cure for corona in prison
tkdboy555: @georgehotz here's some super-relevant biophysics https://pubs.acs.org/doi/abs/10.1021/ci100214a#
WooraWoora: Are you not putting other people at risk doing that?
jmp0ut: i eat holding my plates
tornpaperyoyos: Hacker DESTROYS coronavirus with FACTS and LOGIC
peter35_: well a girl would def get me out of the house
t00big2fl4il: what do you think about trial and error
jmp0ut: good to be conscious of what you eat at home
Landowner555: @tornpaperyoyos LUL
jmp0ut: never lose vigilance
jmp0ut: always erect
THX1342: you don't hang out with older people, right? lanaluCat
stale2000: monkaS societial breakdown
Landowner555: can u tell us what this graph shows
THX1342: `geohot kills VCs
THX1342: LUL
Joeliftstuff: monkaW
jmp0ut: fuck the economy
TheZarkxs: who is afraid of the boomer remover? corona is a very light virus
jmp0ut: asterank dot com
RadricCSGO: they dgaf LUL
stale2000: The only thing to fear is fear itself
costcospizza: thats life buddy
scarbromangler: https://neherlab.org/covid19/
scarbromangler: fear is the mindkiller
Stegosaurian: there won't be societal breakdown but an economic collapse is inevitable I think
Emanuell45: imagine starting retirement then get taken out by the rona
scarbromangler: @stale2000 hi
sliceserve: easy now
dprophecyguy: @georgehotz Why don't you use tor browser ?
tornpaperyoyos: Hacker DESTROYS coronavirus with FACTS and LOGIC
jmp0ut: http://www.asterank.com/
SolarBerry: imagine wage slaving your whole life and then dying of corona
innerbean: so there's no option for you to modify behavior for a short period of time to contribute to a greater good in doing the things that is understood to be effective in getting through it?
jmp0ut: how do i pull the 1000 trillion dollar asteroid with klystrons yesterday
iDoMathss: @wheely_mcbones Not saying anything about measuring contribution to society, I’m all for a university based solely around learning (we actually need more of this)
Ayyyy420Lmao: imagine wage slaving
Ozonemaster: Well in Spain we ran out of space for the dead bodies. but apart from that we cool LUL
DiosDIO: Is the Coronavirus man-made?
foti_kasparov: So what do we do?
Penguino138: Do you think there will be a resurgence in China now that they're opening travel back up?
ahahahaitslit: brazil's prime minister is literally a corona virus denier lmao
360Plato: this will cause a debt crisis guaranteed
bulksquat_thrust: A lot of old people dying would actually fix the social security debt issue as morbid as it is
alicyka: I feel like economic collapse is in the chamber so who knows what the fuck is going to pull the trigger
bufferovrflw: @georgehotz So would you rather have more infected/dead people than economic collapse?
mik12f4: dont be another statistic https://www.nbcsandiego.com/news/investigations/why-more-young-males-in-san-diego-county-test-positive-for-coronavirus/2292888/
Ayyyy420Lmao: sneed's feed and seed, formerly chuck's
dprophecyguy: @georgehotz don't you think politicians know them already but they just don't give a fuck
wholesome_pepe: on the bright side. we have way more infrastructure to keep us alive on the cheap than 50 years ago.
hordead: @georgehotz China was able to do it for 2 months
gazny: So you agree that we should go outside by April 12th? I feel with every country but china will lose so much by closing the economy so much. Almost like china gains a lot from all of this
Stegosaurian: there are some economists estimating that unemployment will reach 30%
innerbean: Again.... so there's no option for you to modify behavior for a short period of time to contribute to a greater good in doing the things that is understood to be effective in getting through it?
nohnamw: here in Brazil it is being very difficult
Stegosaurian: companies will go bankrupt and will need bailouts
TheZarkxs: half a million of infected, and only 21k deaths, mostly very elder people. corona is a joke, open my favorite italian restaurant NOW!
jmp0ut: if the internet is considered essential
jmp0ut: it becomes a utility
THX1342: if only people were rational
jmp0ut: this changes net neutrality does it not
Ayyyy420Lmao: 30% is casual here
SolarBerry: completely different world back then
Ozonemaster: check for unemployment in Spain LUL LUL
jmp0ut: merica jank roaded silicon
TheZarkxs: 6,9%
AntiVax_SoccerMom: ask two economists a question and youll get 3 answers
thesevoicesareloud: unemployment numbers come out tomorrow
wheely_mcbones: "some economists"
peter35_: when they ease lockdowns they should make sure masks are available imo
DiosDIO: The coronavirus is more deadly if the hospitals are saturated tho
SofiaLouise: there are a lot of different ways to meassure the unemplyement rate..
WooraWoora: @georgehotz those numbers aren't comparable when people are actively being told not to work, not losing their jobs because of a depression
leftyytwo: scam
localcanofdutchgold: lul
alicyka: lol scam fields
Kawhiet: spreadsheet tracking unemployment right now https://docs.google.com/spreadsheets/d/1WLJ1j7igM88C2XysCuN4lMH7W2NUdZq4dnO0DbyR7H4/edit#gid=0
tkdboy555: CAN WE TALK ABOUT how congress is trying to pass an anti-encryption bill right under our fucking noses amid this entire coronavirus epidemic? Shit's fucked, and they will be able to access everyone's data
williamjennings1: two biggest scams lol
Penguino138: cause theyre both scams lol
jmp0ut: RIFK
pec_adillo: basically both government run
sliceserve: this is like watching a movie
Ayyyy420Lmao: the biggest scam is chainlink
Landowner555: theres no % wtf
TheZarkxs: water, electricity, etc.
SolarBerry: govt jobs DansGame
4zimut: scams everywhere
C0deCane: yeah sure back in 2018
covac123: nothing
phrixus_bro: get paid
Eternallightning: red tape
pwnbase: dick all
pz3300: Zero hours workers
Ayyyy420Lmao: push papers
DiosDIO: nothing
wholesome_pepe: the military is the biggest employer
dingus74: lool
ICAntF331MyFAce: get a paycheck no matter what :)
bulksquat_thrust: Lots of security clearance holders too
aj37z: plan meetings
dprophecyguy: @georgehotz In India the government has imposed curfew already for 21 days. And day to day workers does not have anything to go by. Police are already beating the shit out of everybody they are finding out on roads.
aj37z: then plan meetings for planning meetings
theonlymonkas: LUL nothing
C0deCane: a lot of them quit their jobs after trump closed down the gov for 30 days
tkdboy555: @georgehotz usaspending.gov
UniversalGeneve: 14% ooF
mattdougherty22: military is quite bad though in spending
l1ght5p33d: Plato Republic with King GEOHOT!!!!!
Penguino138: That's a lot of slaves
jmp0ut: ZAMBIE!
gazny: This quarantine is getting me ready to live on mars!
Emanuell45: yh road workers
happypuppppy: LUL
ackxhpaez: china just buys bonds to manage their currency
Landowner555: lol
TheZarkxs: less boomers thank to corona=less spending
XiuYee1: LUL
C0deCane: thats not current tho
pz3300: Skim
l1ght5p33d: I vote Geohot for King
vonhoganon: DMV slaves
l1ght5p33d: all in favor
leftyytwo: these statistics are made up by the government!!! scam!!!!!!!!!!!!!!!! look at the URL
Joeliftstuff: banana republic good stor
Stegosaurian: maybe it includes the military?
nvda9: @dprophecyguy LMAO
jmp0ut: hack the planet, they're trashing!!!
guinness84: what do you even mean banan republic
Ayyyy420Lmao: foodstamps
Emanuell45: police counts as goverment right?
bulksquat_thrust: think DMV worker
Eternallightning: disability / nursing home ?
360Plato: ugh oh hes going down the rabbit hole.
tkdboy555: LOL
vonhoganon: DMV, military, law enforcement
wheely_mcbones: is actually a good number, compare it to greece
rafalive: george my ball smell nice during this time of covid
ackxhpaez: Also, that's state and local government
deep5: It tells you percent distribution
pwnbase: those figures probably don't include goc contractors either
pz3300: How you gunna pay China the 15 trillion
theonlymonkas: WutFace WutFace WutFace
Ayyyy420Lmao: im surprised he didnt know it
xmalware60: Compare it to france aha
tkdboy555: bruh your mind is getting blown right now
alicyka: Entire nation is just people helping people helping people helping people helping people helping people helping people helping people helping people
Eternallightning: proffesional
Kawhiet: Information
l1ght5p33d: LEET AFFF
Stegosaurian: the private sector and small businesses are going to be hit the hardest
360Plato: information
TheZarkxs: people who get social asistance
innerbean: isn't the debt
vonhoganon: information
Joeliftstuff: information
hhhasan: Mining
happypuppppy: software engineers = nonagriculture self-employed
ackxhpaez: the categories are based on SOC codes https://www.bls.gov/oes/2018/may/oes_stru.htm
iDoMathss: @georgehotz do you think we should have an economic system at all? I.e we go back to non-specie systems of trading
innerbean: something someone would have to try to collect on?
hordead: information
Kawhiet: 80/20 rule
innerbean: who will come get it?
TeaLeafi: i like this lecture.
TheZarkxs: thats literally wealth creation
Ayyyy420Lmao: they produce value otherwise they wouldnt get paid on the free market...
jmp0ut: actually i'd put them in Agriculture, because if software developers like Sean Harris aka Wiz didnt farm the ground and crops are shitfucked
rafalive: rough
rafalive: but true
jmp0ut: what are you valued for
Ozonemaster: "restaurants" *laughs in McDonald's*
tkdboy555: REKT
ackxhpaez: and the industries are based on NAICS codes https://www.census.gov/eos/www/naics/
wheely_mcbones: US is not really producing value, it buys value from other countries and sell it in a high value, the are like old cars salesman
TheZarkxs: i do not think you understand economics my friend
guinness84: naval ravikant derivatives
360Plato: let me guess engineers are log value
SofiaLouise: How do you define value? If someone wants to eat in a restaurant, they create value, right?
pec_adillo: i think you mean production not value maybe?
DiosDIO: Farmers are important
theonlymonkas: exponential?
ackxhpaez: BLS doesn't collect data on agriculture
eric_hansen: D
jmp0ut: Josh Harris aka |Wiz
jmp0ut: my bad
aj37z: monopoly
jmp0ut: been so long
ackxhpaez: agriculture data is collected by the Department of agricultural statistics
tkdboy555: Value is relative to the job that maximally contributes to technology that defeats death. No cap.
leftyytwo: nobody cares about the tool only the result
foti_kasparov: So what's your point ?
gazny: This has happened before, literally the renaissance where people developed new tools and we progressed.
jmp0ut: when guys like Josh Harris went from billions to nothing in dot com bust they probably felt the same
SpaceGhost8: huh?
tkdboy555: We're trying to defeat death here
jmp0ut: but to turn into like potato farmers
360Plato: LUL were next to actors
vonhoganon: LOL
jmp0ut: lmao
localcanofdutchgold: they run em in the movies
williamjennings1: What are data centers?
kaiokenx90: puts or calls?
theonlymonkas: LUL
Kawhiet: Truckers?
tkdboy555: #TranshumanismGang
cookienz: LOL so acting is just as important as visa's paywave service ok
bulksquat_thrust: hopping off for the night, gotta work early, take it easy chat   Geohot
Eternallightning: those are some of the most opposite sectors you could choose
vonhoganon: mechanics?
TheZarkxs: any king of money exchange is wealth creation, and the robbers of the politicians get their part
360Plato: military
mik12f4: what about P and B services
AntiVax_SoccerMom: KKona DEEP STATE
Penguino138: Govt ppl gonna get bailed the fuck out
aj37z: print money brrrr
vonhoganon: military, law enforcement
wheely_mcbones: well you are using it now
ackxhpaez: Schools
Emanuell45: police officers
bufferovrflw: @georgehotz Check the definition?
SpaceGhost8: brrrrrrrrrr
eric_hansen: @georgehotz lots of bureaucratic red tape to create no-value jobs
l1ght5p33d: prevent anarchy
DiosDIO: Actors and Sportsman people make more money than the military and the state
williamjennings1: push paperz
Incurs0: dod
360Plato: and law enforcement
TheZarkxs: administration probably
roystang: is this live
alicyka: Military is ~%3
dr_set: schools
AntiVax_SoccerMom: DWP
zwisch: military, police, firemen, etc.
Waldoqq: military police teachers
XiuYee1: MonkaW
wheely_mcbones: roads, information, security, laws...
vonhoganon: but then again taht doesnt make sense bc military is 1% or less of the total population im pretty sure
robotboy987: transportation
dr_set: schools are a big percentage
Waldoqq: city officials
hhhasan: Apparatchiks
jmp0ut: a growth expectancy of 4 million by 2028
tkdboy555: they do nothing
SpaceGhost8: the gubberment KKona
SolarBerry: can someone tell me who runs the world wide web
tkdboy555: shitty data science
jmp0ut: what's the birth rate of the U.S.
wholesome_pepe: military or private contractors for the department of defence?
williamjennings1: just sneezed :o
gazny: Simulations about corona lol, and deep space satellite spying on each other
wheely_mcbones: sanitary system, flying logistics, measurement patterns...
jmp0ut: and immigration rate?
UniversalGeneve: the militiary serves as america's greatest past time: dick flexing on other countries
tkdboy555: they do shitty data science
Ayyyy420Lmao: @SolarBerry Al Gore
Lourned: city people do nothing and they get paid nothing
C0deCane: Border patrol Kappa
flickapotamus: military and school's
360Plato: military has operations on every continent
Eternallightning: start the repo
nvda9: schools a
SpaceGhost8: makes money move
l1ght5p33d: repay societal debts
innerbean: is that just federal or all, local, state and such?
eric_hansen: @SolarBerry google Tim Berners Lee
nvda9: schools are
JonBoy11: military, politicians, local city jobs, post office, etc, etc, etc
Stegosaurian: Where would you categorize artists and athletes? do you think they create value?
Landowner555: twitch streamers are the value destruction people 4Head
foti_kasparov: What if we use the human resources of military to create value?
tkdboy555: straight up, government jobs do shitty data science based on the 1st page of their google searches
peter35_: journalists
AzzoDio: rent seeking businesses
cookienz: sec are value destruction
Parkpark1997: o
360Plato: next to actors
UniversalGeneve: @Stegosaurian artists make value. athletes? Hmm....
Landowner555: athletes are next to baristas
Eternallightning: entertainment value ?
bufferovrflw: https://www.bls.gov/careeroutlook/2014/article/federal-work-part-1.htm
cars1n: @solarberry nobody. It is just a connection of servers so the server owners kinda and the infrastructure owners
Ayyyy420Lmao: athletes do ofc if you include soccer
DiosDIO: Athletes arent necessary
TheZarkxs: ?
robotboy987: irs, fbi, sec etc
bufferovrflw: ^ federal gov sector
innerbean: how complicated is it to managed hundreds of millions of people?
THX1342: athletes are just entertainers
Landowner555: music is pretty legit tho..
innerbean: it's a big job
AzzoDio: high frequency tradin
m00chan: making life better isnt value?
360Plato: we should just broadcast war and call it "american sports"
bufferovrflw: https://www.bls.gov/careeroutlook/2014/article/federal-work-part-1.htm &lt;&lt;&lt; federal gov sector
Landowner555: artists make tools, athletes r tools cbrahAyy
scarbromangler: what about the pornographers
theonlymonkas: FBI open up
wheely_mcbones: yeah!
eric_hansen: technically HFT is a zero-sum game @georgehotz
cars1n: @scarbromangler artists
lordk3k: violent flash animations  
williamjennings1: who gives the most value ?
PiroFloydian: can you rehash n and n squared people? @georgehotz
Emanuell45: homeless people take value?
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies??
PiroFloydian: i missed that
jmp0ut: the stats in 2019 say about 4 million jobs accounted for from immigration and births but illegal migrants number in the 20's of millions
Landowner555: grad students take out value Keepo
Bloodswordz88: Sex Workers
360Plato: Rentseeking is the term your looking for
foti_kasparov: Should there be more toolmakers then the ones that use them?
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies???
innerbean: that's populous value...subjective appreciation, who are you to judge it's 'value'?
ThirstyDrank: Is take-value &gt; neutral   positive
Stegosaurian: Do you think the government should bail out large corporations to avoid a recession or eventual depression?
Lourned: not in russia LUL
Pedroso: what about the distortion of the media
dr_set: how about contamination and waste? They produce contamination and waste
btpisroot: what if that coffee is the tool that helps someone be exponential?
nvda9: B)
scarbromangler: it's linear vs non-linear
DiosDIO: Doctors are REALLY needed these days
vonhoganon: doesnt HFT create very high liquidity in the market though?
SpaceGhost8: and equipment
Bloodswordz88: Do Sex Workers count?
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies??
alicyka: Active Military are 0.9% of the population, so I don't know where the fuck the other 12% comes from.
l1ght5p33d: The stock market shouldn't even exist probably
ThirstyDrank: Productivity of farmers is probably exponential already. Where agriculture would be linear
ackxhpaez: Farm statistics are done by the USDA https://www.ers.usda.gov/topics/farm-economy/farm-labor/
SolarBerry: HFT does provide liquidity
jmp0ut: so if about 30 million unaccounted for undocumented migrants live in America the employment sector's stats are janked
Landowner555: @DiosDIO news flash, doctors wont be coming up with the cure for the coronavirus
Ayyyy420Lmao: nothing, doctors are a living wikipedia
SofiaLouise: Find a diagnosis?
foti_kasparov: Do prostitutes create value?
360Plato: glorified encyclopedia
phrixus_bro: I heard that hooking people up to ventalators was very involved
knilecrack: it's not hard
K177: get a monkey to do a xray scan LUL
iDoMathss: @georgehotz So the act of innovation is the generation of value in your eyes?
knilecrack: because you have a doctor.
Eternallightning: Researchers add the value doctors distribute it
vonhoganon: @K177 doctors dont do xray
DiosDIO: @Landowner555 Taking care of eldery people is important tho
xalariian: what about scientists
RadricCSGO: they just prescribe whatever the drug companies tell them to prescribe
l1ght5p33d: Crowdfunding with HFT in the middle
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies??
Landowner555: @DiosDIO NURSES and PSWs do that
dr_set: You said the other day that was an argument to make that a person born today has negative value, if you agree with that, then doctors are not very useful
scarbromangler: It's the nurses who do most of the hard-work, I think
knilecrack: Yes but they know how human body work
K177: @vonhoganon ah yeah true
jmp0ut: 190435.9 would have to be the stats
THX1342: doctor's make decisions and decide where assets are put into
AresRai: gen x
Bloodswordz88: what about cam girls
foti_kasparov: Do elderly people create value at all?
jmp0ut: for 2028 stats of total jobs
wholesome_pepe: doctors = symptom mangagers
wheely_mcbones: acatually deciding what medication will treat someone without killing this person because of another disease
SolarBerry: retirement homes were abandoned in spain and they died
williamjennings1: nurses work 60 hours a week
innerbean: If the money gets laid up in huge amounts in accounts doing nothing it lowers the amount available to circulate. so makes many more, the rest, 'poorer'
scarbromangler: what about e-girls
vonhoganon: what about hentai creators
PiroFloydian: what about sex workers @georgehotz ?
bufferovrflw: https://www.bls.gov/careeroutlook/2014/article/federal-work-part-1.htm @georgehotz Federal Goverment jobs breakdown
solitarynative: What should I spend my trumpbux on?
scarbromangler: what about the okay boomer girl
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies and shitpost all day?? do we create value?
DiosDIO: @Landowner555 Nurses can't do all the work alone
coloneljerkoff: Whats the value of pontificating twitch streamers?
Kawhiet: Value is subjective
hordead: doctors are being replaced by google
Pedroso: what about the media distortion
PiroFloydian: workers create value
wheely_mcbones: you probably would I think
Landowner555: @DiosDIO you have no idea what ur talking about man
jmp0ut: whats the cost of 20 million jobs
phrixus_bro: what do you think about the value of the finance industry
jmp0ut: thats what america is budgeting to lose
foti_kasparov: I thought Apple was a scam
l1ght5p33d: Jobs was pretty scammy Woz was the product
innerbean: create or capture?
solitarynative: What should I spend my trumpbux on?
360Plato: Stock Traders are their to efficiently allocate ressources
happypuppppy: where do people who spend all day on twitch chat like us fit in?
darkclemo: starship stacking is going on right now @georgehotz
peter35_: that whole starship thing is so cool
innerbean: value capture
tkdboy555: So MAYBE we should be creating a society that focuses on helping people help themselves raise their base value, so that there is a higher percentage of the population that gets to "Elon Musk" tier
darkclemo: pressure   raptor test next 3 weeks
edu4594: geo is grad in...?
ooMariaoo: oh
phrixus_bro: nooo
edu4594: bio?
edu4594: cs?
SpaceGhost8: LUL
vonhoganon: hedge funds/prop trading nothing of value?
mashafique: Jebaited
Ayyyy420Lmao: what about NEETs relying on gobernment gibs to buy chicken tendies and shitpost all day?? do we create value?
Santiago_LHC: @edu4594 hacking
Emanuell45: thats a bad human being
williamjennings1: stop with the neets
Stegosaurian: Why do you think largest companies threaten mass layoffs unless they get a bailout?
edu4594: @Santiago_LHC hacking at UCLA
Eternallightning: visionary
yaus_baus: tendies stimulus package
foti_kasparov: @edu4594 Check his LinkedIn for details
dprophecyguy: @georgehotz do you think having a vision with a dick attitude is okay ?
360Plato: whatever bro
wheely_mcbones: I think society should be happier and not necessarily more efficient, I'm not sure if both go together
jmp0ut: so 4 million jobs will afford the cost to lose 20 million jobs and process everyone and require atleast 2 jobs at minimum to capture every person
Emanuell45: lmao
boengels: Morning George!
peter35_: Ayyyy420Lmao n-no FeelsBadMan
l1ght5p33d: but why cant you put music on it?
PiroFloydian: For watching off stream. Why elons boring company is bs: https://youtu.be/4dn6ZVpJLxs?t=18 @georgehotz
l1ght5p33d: BUT CANT PUT DATA ON IT
jmp0ut: so you need 60 million people at minimum to process 20 million undocumented migrants
DiosDIO: @Landowner555 Try not having any doctors in a hospital for a week in any hopsital in the world then
edu4594: @foti_kasparov i cannot, i don't have a linkedn
l1ght5p33d: NO DATA ON IPHONE
dorkmo: suicide nets
l1ght5p33d: no data
funwayz: apple fanboy Kappa
alicyka: George, Table 2 shows which department federal employees work https://www.bls.gov/careeroutlook/2014/article/mobile/federal-work-part-1.htm if you're interested; Table 2
dorkmo: lol
Lourned: Commodore 64 was far more superior computer
Parkpark1997: but u are android of self driving
AzzoDio: Apple still makes quality hardware though their software is terrible
Ayyyy420Lmao: @yaus_baus just buy popeye's stocks and when u buy chicken tendies you get your money back
K177: thats assuming that a different company wouldn't come up with a touch screen concept for phones and push it out
Hawklite: is he really implying apple is the innovation behind phone technology?
scarbromangler: Kind of surprised you're not an android guy
Eternallightning: @georgehotz why are so many people not as passionate about a good prooduct as jobs ?
risesinner: The boring drill fits exactly in his rockets
jmp0ut: jank roaded
tkdboy555: SAMSUNG?
jmp0ut: simple math
tkdboy555: uhhhh
foti_kasparov: @edu4594 Create a trash account
Kawhiet: Teachers count too
edu4594: @foti_kasparov ok...
vonhoganon: jesus christ the VA
Pedroso: Omg, you read so fricking fast
Ayyyy420Lmao: veteran affairs?
wholesome_pepe: all those pensions we have to pay monkaS
Penguino138: Jerk off verterans
dorkmo: VA hospital
williamjennings1: push paperz
Eternallightning: VA hospitla ?
360Plato: manage ptsd bois
vonhoganon: veterans healthcare
wheely_mcbones: there is a book called bullshit jobs who talks about the mental breakdown of people who do useless jobs
phrixus_bro: healthcare for veterans
alicyka: Veteran Affairs is the VA, infamously terrible and useless
innerbean: oh, so the ends justify the means even if it means screwing others? ugh
Parkpark1997: take care of them
latenightbj: military loans
pec_adillo: care takes and state run hospitals
scarbromangler: department of VA fights the war against the Colin Kaepernicks of the world
risesinner: helps them navigate the VA and Veteran resources
l1ght5p33d: i want to run apk on iphone
THX1342: are veterans considered employees of that dpt?
AzzoDio: no president gets elected by promising to cut the military budget
DiosDIO: This is part of the Military
Stegosaurian: Do you think the large military budget is justified?
Kawhiet: There's a reason it's called a government job
entangledbeing: Government could include university professors and researchers
l1ght5p33d: we want apk on iphone
Emanuell45: thats some stalin shitt
vonhoganon: they include doctors and other medical staff as well to take care of veterans
Parkpark1997: ask trump
l1ght5p33d: APK ON IPHONE ONLY or apple dies
wholesome_pepe: cuz they fought in ww2 and vietnam
coloneljerkoff: VA has a huge system of hospitals
tkdboy555: @georgehotz USASPENDING.GOV
risesinner: each county has a veteran rep
JonBoy11: everyone that works at a VA hospital technically. all the way down to the guy cleaning dishes
risesinner: that is why they are so many
foti_kasparov: @edu4594 I mean u won't regret it :)
risesinner: they make almost no money
tkdboy555: @georgehotz usaspending.gov
K177: so theoretically if hitler had a positive impact in the future then he was a good person? LUL
Lourned: USA = military industrial complex LUL
risesinner: each county has one
bufferovrflw: Nerd-sniping: The Stream
l1ght5p33d: why can't i run apk on iphone
innerbean: hmmmm, managing how many vets? That's not efficient
mikey9988: Chair force LUL
hordead: remember there are 52 states
360Plato: So Israel should build Hitler statues?
entangledbeing: State university professors and researchers may fall into gov
williamjennings1: how would you eliminate them ? :o :o
risesinner: each county has 1 and they make about $20k/yr
edu4594: @foti_kasparov i hope lul
l1ght5p33d: y no apk on iphone tho
PiroFloydian: Mao executed landlords cant be that bad @georgehotz
Ayyyy420Lmao: wrong he dided in 82 in paraguay
pec_adillo: tru just give the vets their money, let them figure out their own care
ahahahaitslit: lMao
bufferovrflw: Well, due to Hitler and the Nazi Germany, we've got rockets
AzzoDio: maybe he has a secret diary where he invented cold fusion pretty much the only scenario
2600: that's one of the arguments for UBI, is getting rid of the the administrative structure deciding who gets what.
tornpaperyoyos: Well most of the employees in veteran affairs are veterans themselves
dr_set: or in latin america a couple of years ago ...
kaiokenx90: do prostitutes add value?
Pedroso: What you think about vertical lockdown in Brazil?
foti_kasparov: Heil the Führer
AresRai: killing 25million people w all their potential is a lot of unquantifiable bad
360Plato: oof
K177: LOL
Stegosaurian: What do you think of the large military budget? Is it justified?
Penguino138: @georgehotz what do you think about China reopening it's borders, possibly letting the virus back in?
dprophecyguy: @georgehotz What about instagram influencers ?
Ayyyy420Lmao: nazi scientists were kidnaped by nasa so we could go to the moon
cybergenik: We got research into medicine, Noice
vonhoganon: isnt much of modern china mostly due to xiaoping?
hordead: hitler still killed more people than the coronavirus
tkdboy555: government officials are themselves lobbyists for useless government jobs and inefficiency in the federal government system
PiroFloydian: oh they are 100%
latenightbj: rapidward.com
innerbean: I think the same positive value can be created without screwing others over, it just gets distributed fairly...
Landowner555: the nazis did a lot of experiments on humans
optimizely: Looking for an idea to work on next
solitarynative: stalin
Emanuell45: lmao
Landowner555: something we'll never be able to do again probably
Lizardan: Hitler
Parkpark1997: hitler vs coronavirus
vonhoganon: the military offers $100,000 signing bonuses like its candy
mikey9988: Hitler is Covid-420x69 ?
williamjennings1: OMg
Parkpark1997: EDUCATION
SpaceGhost8: hitler ez
DiosDIO: Now, hitler
K177: LUL
Nussinov: we should have nuked corona virus when we had the chance
williamjennings1: yikez
scarbromangler: coronavirus isn't doing anything wrong. it's just being itself
PiroFloydian: military industrial complex is maybe the worst @georgehotz
saygan_: if Hitler was good then do I have the right to enslave my neighbors if I can prove it will have a positive outcome in a few decades
wholesome_pepe: darpa literally funded the basic research for the corona virus tho LUL
solitarynative: Stalin worse than both
wheely_mcbones: sovietic union did more to end the nazis than the US but they are not receiving this much money for their veterans, is not about merit
pikomane2: is it 18 million veterans divided by how many patients per psychiatrist
tornpaperyoyos: They tell you that you only have to serve 4 years but its a minimum of 8. 4 active duty 4 reserve
2600: hitler vs coronavirus who would win
Bloodswordz88: HahaSnowhal
SofiaLouise: WW2 : 75 million
cars1n: Society would be much more advanced if we kept having world wars because preventing death is the absolute best motivator @georgehotz
btpisroot: Eh, let's go with WW2
pz3300: Yeah
abdcw: i mean hitler was a bad guy but at least he didn't force me to stay inside and not get pussy
foti_kasparov: HITLER WITH CORONAVIRUS IS THE WORST THING EVER
K177: ccp data monkaS
PiroFloydian: try US @georgehotz
Bloodswordz88: HahaLean
Kawhiet: Mao killed more people than hitler
logi6000: what did I miss
hordead: just go by the amount of jews he killed
AntiVax_SoccerMom: monkaS Hitler with super aids
Nussinov: adolfovirus
DiosDIO: Did hitler kill anyone himself?
Landowner555: stalin and mao are the real villans
THX1342: expendable, right?
williamjennings1: 43million what
Ayyyy420Lmao: @hordead how many is that?
tkdboy555: bioweapons is a cold-war thing
SpaceGhost8: uh
pz3300: Himself?
THX1342: -.-
logi6000: @pz3300 well yes
pikomane2: hitlers still alive
l1ght5p33d: i wanted to run a single apk on my iphone. it had ONE JOB
Stegosaurian: world population in the 1940s was around 2.6 billion
Ayyyy420Lmao: @pikomane2 in our hearts
raystriker98: India is gonna get fucked, our PM is a joke
logi6000: what would you name a search engine
foti_kasparov: @ayyyy420lmao No, in Argentina
PiroFloydian: @DiosDIO he killed himself
Kawhiet: Mao killed more people than hitler
SpaceGhost8: EZ
hordead: @Ayyyy420Lmao 1.3m
tornpaperyoyos: OWL2019200iq OWL2019200iq OWL2019200iq OWL2019200iq
PiroFloydian: yeah Modi sucks lmao
Ayyyy420Lmao: @foti_kasparov no he went to colombia, then argentina, then paraguay, died in 82
DiosDIO: @PiroFloydian Fair enough
Hawklite: what's the economical impact hitler vs corona though?
KaleSC: @georgehotz do you think it's good that all the old people are dying ?
360Plato: whats the ACE2 prevalence for Indians?
Stegosaurian: Africa will be hit hard
AzzoDio: isn't India hot climate?
K177: wait, does your coronavirus projection factor in overwhelmed hospitals?
l1ght5p33d: sweet justice
kaiokenx90: Are you saying there wouldn't be a difference in response in the US from Trump vs Obama?
alameda13: do u think human killed hims3lf more or viruses @georgehotz
wheely_mcbones: like 1 million were japanese nuked that did not needed to die
4zimut: careful we have twitch staff
K177: ahh aight
Ayyyy420Lmao: @hordead im surprised you could give the actual figure and not the meme number
DiosDIO: The virus isn't killing itself
wheely_mcbones: is not all on Hitler
AresRai: are tropica countries less at risk ?
martinkirilov: And we still talk about Hitler. If coronavirus turns out to be worse, imagine the aftermath of that
Bloodswordz88: People die on the Toilet everyday
hordead: @Ayyyy420Lmao what's the meme number?
AzzoDio: 2x just corona deaths? what about death from other sources that also need hospitals?
Tyrant_01: GEORGE DID YOU STOP HACKING ?
K177: cmonBruh
AzazelTheGoat: how many people has mcdonalds killed?
WEEEEEEEELL_ITS_KNOCC_OUT: monkaS
solitarynative: cmonBruh
tkdboy555: The US government should contract AI companies to calculate which jobs are most able to be automated and then to actually automate them. We would cut federal spending by BILLIONS, if not HUNDREDS OF BILLIONS.
AzazelTheGoat: is mcdonalds worse than hitler?
360Plato: shut it down
SpaceGhost8: projections thus far have all been wrong, to be fair, and I hope it remains that way
logi6000: George I like that idea from yesterday about organizing the worlds information
mikey9988: monkaW
raystriker98: no dude, he made us bang utensils and applause for no reason at all.. I'm not kidding Google India utensil banging coronavirus
DecayingSkullz: Twitch is going to somehow make an issue of this.
RNG_S0uL: speaking of nazis here comes twitch staff
Ayyyy420Lmao: @hordead 6 milions
Penguino138: Will more die from the economic impact of the virus than the actual virus?
K177: KKona wtf
innerbean: death measuring contest? gah
UneducatedZoomer: monkaS
optimizely: How do you choose what to work on next?
TeaLeafi: nah your good?
DecayingSkullz: Hitler convo
wheely_mcbones: Obesity vs Hitler
williamjennings1: mhm kind of want mcdonalds right now
Parkpark1997: free speech
btpisroot: I think we said too many trigger words
jomkingal: Hi George greetings from NJ
DecayingSkullz: Yeah exactly
TeaLeafi: free speech is awesome!
K177: yeah free speech is not a thing on twitch LUL
DiosDIO: Twitch isn't about Free speech
TeaLeafi: Twiutch can go succccc it lols
hordead: @georgehotz Conclusion.. Hitler was a deadly virus
knilecrack: you are insulting corona
DiosDIO: is about E girls
SpaceGhost8: Shkreli save us
K177: Kappa
tkdboy555: The US government should contract AI companies to calculate which jobs are most able to be automated and then to actually automate them. We would cut federal spending by BILLIONS, if not HUNDREDS OF BILLIONS.
TeaLeafi: Twitch is a scam
latenightbj: will obesity rates increase becaue of social distancing ?
mutrx: is this end of stream q&amp;a
Ayyyy420Lmao: we're adults? Kappa
kruzustv: yo my ese got a cabrona virus :(
vonhoganon: twitch = free speech? LUL
phrixus_bro: DLIVE BABYE
C0deCane: This is purely scientific
K177: PogU
AzzoDio: every time you talk about world War II you start getting people talking about Neo-Nazi stuff eventually, they somehow find every twitch channel
theonlymonkas: SCAM
TeaLeafi: YEAHHHHHHHHHHHHHHHH
localcanofdutchgold: lul
knilecrack: private twitch yeah
360Plato: dlive stream
innerbean: haha yea, the SAD diet vs all the tyrants
TeaLeafi: !!!!
zelkh9: what if we get obese sars-cov-2
btpisroot: comma.twitch
TeaLeafi: YEAHGHHHHHHHHHHHHH
Parkpark1997: go on mixr
raystriker98: Mixr
Lourned: like mixer LUL
williamjennings1: just go to mixer
Natschz: GO TO MIXER IF YOU GET BANNED xD
theonlymonkas: LUL
fullcind: twitch   free speech KEKW
ICAntF331MyFAce: POGU
PiroFloydian: comma.stream
TeaLeafi: comma.twitch
dorkmo: hi im 12
AzazelTheGoat: i didn't see a "this is an adult stream with mature subject matter". im triggered
alameda13: chat is 12 years old
K177: mixer PepeLaugh
TeaLeafi: comma.twitch !!!!!!!!!!!
tkdboy555: automate the government
THX1342: LUL
hhhasan: comma.tv
THX1342: comma.thot
TeaLeafi: comma.twitch
Parkpark1997: comma.tv
360Plato: famous last words lul
theonlymonkas: NICE
aar0npham: Lol
edeustua: have you ever used gaussian processes for anything?
hordead: There;s no free speech on this platform
Emanuell45: there are 3 moderators here lmao
kaiokenx90: can u reverse engineer my farts
THX1342: thanks, mods
Stegosaurian: George what do you think the future of human evolution is?
kruzustv: OOOF
SpaceGhost8: comma,dank
TeaLeafi: AHHHHHHHHHHHHHH
aar0npham: Comma.twitch
TeaLeafi: got em!
AzazelTheGoat: lol gotem
optimizely: Interesting project to work on ?
UniversalGeneve: call it spasm LUL
TeaLeafi: gotem
mutrx: @georgehotz did you look at SAMPLE6
bufferovrflw: @georgehotz Probably "Hitler" is a keyword that alerts Twitch Staff?
TeaLeafi: gotem!!!!
newlastaccount: How many animals have you killed?
mounnrocc: !uptime
UneducatedZoomer: @georgehotz could you hack me rn if you wanted to
DiosDIO: How many people has cancer killed?
logi6000: I like your idea of organizing the worlds info
tkdboy555: like automating government jobs?
jomkingal: Do you stay up late most of the time?
Lourned: @georgehotz hey i used your jailbreak on my iphone 5 back in the days, thanks :D
solitarynative: more like sample dicks amirite
hordead: @georgehotz How many hours of sleep do you usually get?
theonlymonkas: do you still want to be a serial killer ?
C0deCane: a lot
wheely_mcbones: well you don't want neonazis making reunions on twitch, is no good for publicity
optimizely: Any Interesting project idea?
innerbean: it's not being used offensively to sow hate
l1ght5p33d: "Have you ever used gaussian processes"------- - Is this a troll?
Emanuell45: There is 1 staff here lmao
solitarynative: monkaS
phrixus_bro: hi staff
williamjennings1: where
Ayyyy420Lmao: @stale2000 hello janny
TeaLeafi: staff lols
TeaLeafi: staff is lame
RNG_S0uL: do you think us new yorkers are fkd?
foti_kasparov: Should be more I guess
PiroFloydian: that was in 1 year
georgecruece: hi gasol
TeaLeafi: cancer is a scam
360Plato: its ok guys the twitch staff is Warhammer player so he probably's a fascist anyway LUL
TeaLeafi: CANCER IS A SCAM!
logi6000: staff is a scam
DiosDIO: Everyone can have it
SpaceGhost8: I'm waiting for WA to update their count because all I see is this bullshit message "The state's notifiable conditions database is currently experiencing a slowdown because of a 10-fold increase in the number of lab reports received. Our IT team is working to correct the issue."
AzazelTheGoat: AzazelTheGoat subscribed at Tier 1. They've subscribed for 2 months! there are so many different types of cancer
yaus_baus: cancer is a shill
alicyka: You usually get cancer at the end, yes
mounnrocc: cancer is induced by inflammation i heard
vonhoganon: obesity -&gt; heart disease
alicyka: It's just the end might be at a young age lol
mounnrocc: but im dumb so
AzazelTheGoat: I heard turmeric helps with inflamation
Penguino138: The cure for cancer is changing peoples' habits and behaviours
innerbean: cannabinoids and mutated cells research is fascinating too
THX1342: Did selfies kill more than coronavirus in 2019?
Landowner555: look up prevalence of cancers in children/young adults
DiosDIO: There is no cure to cancer also
boengels: Hey George, what sources would you use to find out real corona death numbers vs gov reported in other countries? thoughts?
Ayyyy420Lmao: autism rates also on the rise
mounnrocc: food related fosho
KaleSC: the Bubonic Plague triggered the Italian Renaissance because all the wealthy (older) people died and younger people inherited the wealth to spend how they wanted on arts for example... do you think something similar could happen after covid?
btpisroot: Twitch staff are fans of the Hotz
martinkirilov: Yeah, but cancer has been out there for a long time. Imagine covid19 being out for the same time, though probably we’d find a vaccine
Penguino138: @georgehotz The cure for cancer is changing peoples' habits and behaviours
PiroFloydian: They do now pepeLaugh
theonlymonkas: the hotz
UniversalGeneve: dna has a half life of ~120 years. you get cancer since as you age, a lot of your DNA start randomly breaking. you have enzymes that repair that, but they're "stupid" enzymes
alextodoroki: im gay and lubed and ready to go boys
KaleSC: the spanish flu killed 50 million
logi6000: obesity epidemic like it's God damn polio. Americans are spoiled. Lazyboy got it right.
williamjennings1: ):
PiroFloydian: depends
optimizely: Death is a scam
hordead: @Penguino138 lol
PiroFloydian: on what the raw numbers are
AzazelTheGoat: thats a crazy number
AresRai: check Japan numbers 🤔
PiroFloydian: if suicide just goes way up and nothing else changes thats bad @georgehotz but the other way is good yeah
ThirstyDrank: wow that looks like a correlation in the middle
hordead: coronavirus is just speeding up death by cadiovascular disease
ThirstyDrank: where they had the intersect
cars1n: Mental health is = physical health
theonlymonkas: LUL
innerbean: the increasingly toxic environment and diet filled with free radicals means alotta cancer.
boengels: @hordead that is true
AzazelTheGoat: is that death of a broken dick? unsafe sex?
DiosDIO: COVID-19 is also killing more smokers
THX1342: is selfie inflicted deaths on the rise or is it plateauing?
K177: KKona
SpaceGhost8: vaping CiGrip
Lourned: vaping PogChamp
360Plato: Dying from too much food
Penguino138: Smoke them ciggies
btpisroot: sigh
AzazelTheGoat: hey guys remember that vaping death epedemic? that was like covid-18, or covid lite
aj37z: smoking weeed
Emanuell45: VAPE SEGMENT COMING SOON
C0deCane: smoking is big is Asian areas i heard
SpaceGhost8: vaping saved the tobacco industry
Kawhiet: lmao russia
pec_adillo: takes a generation to phase out smoking deaths
Ayyyy420Lmao: smoke every day dudes
DecayingSkullz: Newton formulated his theory of gravity in quarantine in the time of the black plague. Pretty interesting.
logi6000: we need to listen to the obesity part of underwear goes inside the pants
AzazelTheGoat: i was surprised to hear vape shops were still open during this pandemic.
bufferovrflw: What's up with Greenlad?
bufferovrflw: *Greenland
innerbean: oh, wasting disease in deer? if that jumps over it will be ugly
DiosDIO: @C0deCane China's pollution is fucking disgusting
THX1342: that graph is brilliant
williamjennings1: woah
K177: LOL
mutrx: TRUE
SpaceGhost8: terrorism monkaS
knilecrack: terrorisam
williamjennings1: heat disease
knilecrack: ahahahaha
williamjennings1: heart*
SpaceGhost8: LUL
360Plato: 1/3 people killed from terrorism would be living in Yemen
Penguino138: 33% terrorism = fear mongering
mutrx: we live in a society
tkdboy555: LINK PLEASE
Lourned: where is gaming?
asanti20: good ole heart disease
boengels: scary really
peter35_: now it's muh russia
mutrx: did you watch Joker @georgehotz
optimizely: Show us a scam
deep5: every minute 60 seconds pass
boengels: how much we are being lived
innerbean: i like the style of this stream...hah
zwisch: interesting to see stroke is about right
T3chHS: Give us link please
Penguino138: How many deaths a yaer from Ligma?
C0deCane: LUL i fuckin hate the media
AzazelTheGoat: but mcdonalds employes a lot of people. is the cure worse than the problem?
Emanuell45: 1 IN 3 people die of cancer?
PiroFloydian: corporate owned media is shit
phrixus_bro: crazy
alameda13: link?
williamjennings1: so 1/3 of chat is going to die from heart diesease
boengels: george can you share that link
boengels: plz
wheely_mcbones: McDonalds
DiosDIO: Media says Terrorism kills more than cancer LUL
tkdboy555: link pleasee
gamerguy009: PogChamp PogChamp PogChamp
Lourned: I guess video games are under terrorism LUL
tkdboy555: elink please
boengels: Link please?
tkdboy555: link please
sigmund_graphics: media is garbage
UniversalGeneve: @tkdboy555 https://ourworldindata.org/causes-of-death
boengels: georgeeeeeeee
T3chHS: Paste the link here please!!
boengels: linke please?
williamjennings1: too many energy drinks
boengels: hahaha
littleZIPPY_92: be pnemonia
UniversalGeneve: THE LINK: https://ourworldindata.org/causes-of-death
asanti20: and heart disease is usually linked with obesity
AzazelTheGoat: is higher respitory disease from smoking dank bud?
boengels: BEEP BEEEEEPPPPP
wheely_mcbones: the flu
wheely_mcbones: Corona is lower respiratory disease
logi6000: we need to listen to underwear goes inside the pants
wisamalrawi: Yes
AzazelTheGoat: yep
PiroFloydian: yeah ive heard of it
logi6000: yeo
Tyrant_01: GEORGE SHOULD I STOP LEARNING CYBERSEC AND GO WORK WITH YOU IN COMMA?
SpaceGhost8: my dad is dying of COPD, yeah
gamerguy009: Dont touch your face
wisamalrawi: Quite famous actually
innerbean: yea...
boengels: Thanks @UniversalGeneve
innerbean: commercials
wisamalrawi: Smoking causes it
RNG_S0uL: yeah my dad has it
AzazelTheGoat: its something i heard about and I live in canada. Not sure if thats why
DecayingSkullz: What are your thoughts on using a Neuralink implant to cure neurodegenertive diseases like ALS or dementia
Ayyyy420Lmao: wtf is this
Landowner555: LOL?
SHAVEYY_: geo is bedtime
Kawhiet: its like half of the death causes can be attributed to McDonalds
SHAVEYY_: go bed
wisamalrawi: They carry oxygen tank with them
omniilista: NotLikeThis NotLikeThis
aj37z: this video is cursed
SpaceGhost8: LUL
Ayyyy420Lmao: i'm addicted, i'm addicted to marihuana
Lourned: 420
AntiVax_SoccerMom: LUL
SpaceGhost8: LMAO
localcanofdutchgold: BANNED
DiosDIO: LUL
gamerguy009: I want neuralink
innerbean: cannabinoids are dank
mutrx: F
Emanuell45: lag?
ankitc: you got throttled son
Ayyyy420Lmao: third world country internet
ankitc: charger
MrTriharder: F
hordead: tos
bloopsterr: lagg
koreanfoodyum: snort weed erryday
williamjennings1: f
xmalware60: lag
zwisch: frames dropped out the wazoo
ankitc: its the charger
gamerguy009: Lagg
peter35_: yeah lag
AzazelTheGoat: prescription drugs killed my mom. I have a deep hate for the problem of over prescribing.
MrTriharder: Corona affecting the internet monkaS
hordead: tossss
braininavatt: lol I thought it was me LUL
Emanuell45: twitch ai probably caught that naked guy
whycopper: why is my pp hard
wisamalrawi: Lagg here too
4zimut: !tabs
ankitc: charger throttled it
localcanofdutchgold: actually banned
Penguino138: major lag
neto3113: upload constraints?
Ayyyy420Lmao: injecting a whole marihuanas every day
foti_kasparov: cbrahTune cbrahTune cbrahTune cbrahTune
anup_kodlekere: youtube has reduced bandwidth
MrTriharder: Kreygasm
anup_kodlekere: pretty sure twitch will too
SpaceGhost8: better
Hawklite: it's good now
williamjennings1: gonna get a snacky
Landowner555: TWO chargers
mutrx: twitch staff is censoring monkaS
gamerguy009: Bad Lagg
AzazelTheGoat: twitch is throttling the stream becasue there was a bum
AresRai: losing a lot of frames
Lourned: saved
wisamalrawi: bandwidth probably
Penguino138: video killed the bandwidth
mounnrocc: laggy boye
btpisroot: not enough ram
hordead: your internet caught the coronavirus
ankitc: yes its fine now
koreanfoodyum: making use of that thunderbolt 3
bufferovrflw: @georgehotz Wait, Macbook/OSX supports multiple chargers? damn
Landepbs: you need to download more RAM Kappa
Ayyyy420Lmao: must be cold with all those iwndows open
MrTriharder: Ok now
peter35_: stack overflow monkaS
cars1n: Wow ram doesnt grow on trees
innerbean: if the thc-a isn't dried or raised above 180f it doesn't turn to thc and it's not psychoactive
iDoMathss: Chromium over safari? Asking since I'm not sure
aj37z: need windows11
DecayingSkullz: @bufferovrflw yeah you have four thunderbolt ports
gamerguy009: Geohotz create a better twitch site
AzazelTheGoat: these lyrics aren't 100%
bufferovrflw: @DecayingSkullz I know, I didn't know that you could use multiple of them, I though only one port would be used for Power Delivery, even if you connected an additional charger
MrTriharder: @georgehotz we need comma.tv now
AzazelTheGoat: accurate*
m0ld_0n3rz: remember when this was on the radio in like 2004
pz3300: I thought that said lady boy. Phew
m0ld_0n3rz: it was a pretty big hit
THX1342: LUL
C0deCane: LUL hahahhaa
pwnbase: t h i c c
mashafique: LUL
asanti20: OBESITY
aj37z: very hard indeed
Lourned: cheesecake Kreygasm
SpaceGhost8: definitely not on the radio
un3okapi: leading cause of death: capitalism
williamjennings1: WOKE
C0deCane: 55 gal drum of coke LUL
ankitc: i am obese
koreanfoodyum: No one cares about the obesity epidemic, but everyone freaks out when there's a pandemic SeemsGood
asanti20: thiccness oppression
wheely_mcbones: Corona is lower respiratory disease
ahahahaitslit: stay woke
m0ld_0n3rz: yeah this guy had like two hits that made it to the radio
Stegosaurian: TOUGH QUESTION: for the sake of evolution should medicine not be perfected and should natural selection be allowed to propagate and perfect humanity?
pz3300: See George start eating proper food dude
foti_kasparov: Supersize me
Incurs0: I want that drum of coke
btpisroot: Stay coke
neto3113: burgers and cheesecake though ...
ankitc: strapons
pz3300: No lol
alicyka: sounds like aesop rock or busdriver
ackxhpaez: Every 60 seconds in Africa, a minute passes
aj37z: socialism is the future
DecayingSkullz: lmao
mounnrocc: localist capitalism ftw
mashafique: No LUL
Santiago_LHC: @Stegosaurian Nah, evolution has its own agenda, and it's only reproduction
pikomane2: if capitalism is so good why is the birth rate in africa 8x higher
Landowner555: ^
Lourned: capitalism is bad when government is ran by capitalists
peter35_: the problem is cheap hyperpalatable foods
innerbean: capitalism has killed more people than religion...well, 'greed' has
Emanuell45: lmao
Ayyyy420Lmao: if capitallism so good why bad things happen?!?''1111'1'1
PiroFloydian: capitalism can be blamed for the people that stave bc theres more than enough food wasted for them. same with preventable medical deaths @georgehotz
tornpaperyoyos: @innerbean LUL
markydothh: Oh shit! Sup George!
AzazelTheGoat: does comma.ai have an underwear inside the pants policy?
robotboy987: doesn't capitalism mean less government workers
MrTriharder: Comparing anything to religion to win arguments DansGame
THX1342: the answer as usual is: it's complicated
Eternallightning: @pikomane2 that’s not a good thing
amedhussaini: capitalism provides incentives
Ayyyy420Lmao: if capitalism is so good why was i born so retarded to fall for socialist memes?
wheely_mcbones: thanks to medical sanitary revolution, not to capitalism
innerbean: is it an argument?
SpaceGhost8: *applies to comma ai*
innerbean: i discuss
AzazelTheGoat: soap
pikomane2: obamacare
aj37z: ^
PiroFloydian: tchnology
solitarynative: capitalism bad, me moral and good person
alextodoroki: lol does comma ai do internships
mikey9988: weed monkaS
tearisten68: He is taking the bait!
THX1342: penicilin
aj37z: thanks obama
THX1342: LUL
Emanuell45: capitalism = better technology = better health care = longer life
wheely_mcbones: compare life expectancy growth between US and China
SpaceGhost8: science
SpaceGhost8: bitch
vloood: i'm not a capitalism hater, but like mexico has the same lifespan and a tenth of the gdp lol
pikomane2: aliens
innerbean: technology has lengthened lives
Lourned: capitalism is doomed because you need to profit all the time and when there are no other place to profit it eats itself bro
Ayyyy420Lmao: if capitalism is so good why cant i get a gf?
Stegosaurian: MEDICINE &amp; URBANIZATION increased life expectancy
koreanfoodyum: all capitalism is guilty of is using the 99% for the 1%
vloood: health has almost nothing to do with capitalism lol
PiroFloydian: smart people innovating irrespective of the profit motive @georgehotz
robotboy987: China did that
innerbean: technology built fortunes
neto3113: the will to be better and do better ?
braininavatt: bruh
vonhoganon: capitalism is life
monaliso: what are you drinking george
pec_adillo: capitalism cant kill as its an absence of violent restriction and coerced monopoly
pz3300: People don’t live any longer than they did 100 years agp
localcanofdutchgold: @vloood they buy the technology that you researched
asanti20: capitalism is an only fans
C0deCane: I think its amazing the problem is when corrupt people take advantage of it
alextodoroki: HOTZ does comma ai do internships
UniversalGeneve: hypercapitalism, like the USA, is a double edged sword.
robotboy987: china build technology
PiroFloydian: market socialism is a thing @georgehotz
Santiago_LHC: capitalism = free market
tearisten68: communism is better when done right, problem is it never can be done right
solitarynative: USA is not hyper capitalist wtf
mounnrocc: communism is impossible, really
Lourned: true
Stegosaurian: capitalism isn't sustainable in the long run
THX1342: the issue is centralization
Landowner555: the american dream is dead
mutrx: Law of Equivalent Exchange - fullmetal alchemist @georgehotz
un3okapi: @georgehotz leading cause of life is capitalism, but life always leads to death.
innerbean: capitalism is an ideology that values profit over any other consideration
wheely_mcbones: US is not most of the world
mounnrocc: who the fuck is gonna give up that amount of power for a stateless society
Parkpark1997: apple
pikomane2: yes go off king name the fed
ThirstyDrank: Transference of value, but based on industrialization. That comes at a price of environmental costs in long-term
innerbean: the market is not capritalism
AresRai: @tearisten68 maybe it will when robots are presidents instead
sigmund_graphics: :o
koreanfoodyum: what if you took the top 10 richest peoples money and gave it to the rest?
solitarynative: US is closer to a corporatocracy
wheely_mcbones: US is the exception of the world, the rule is India and China
markydothh: George! I promise i will subscribe once I make some money....the baby gets priority!
PiroFloydian: market socialism is a thing @georgehotz
amedhussaini: NIMBY
knilecrack: so they get value
pz3300: Denmark mortality rate 1918 = 10.1 Denmark mortality rate 2018 =9.8
Landepbs: the problem is monopolies
alextodoroki: m8 does comma ai do internships
williamjennings1: Lets be positive
mounnrocc: marxs critique is spot on. the solution not so much
360Plato: they would waste it
Ayyyy420Lmao: @PiroFloydian oxymorons are a thing yes
AzazelTheGoat: the problem is capitalism made things easy and a side effect was it made people lazy.
monaliso: is that wine george?
Santiago_LHC: That's the tendency of capitalism though. A broken system.
alwayxtoxic: you're so right
Stegosaurian: when you consider the ever increasing world population, capitalism isn't efficient when it comes to resource management
aj37z: we need better math teachers
wisamalrawi: What does San Francisco allow that stupid zoning to exist ?
vonhoganon: so true
PiroFloydian: @Ayyyy420Lmao no you just dont understand what socailism is lmao
ThirstyDrank: It's trickle-up economics
Ayyyy420Lmao: @PiroFloydian no u
THX1342: the 90% would buy shit made by the 10% and make the 10% rich again LUL
mounnrocc: absolutely
DecayingSkullz: BIIITCONNNEEEEEEEECCCCCTTTT
mounnrocc: LOCALISM BABY
C4TFive: A server wipe would be dope though
braininavatt: do you think billionaires should exist?
JdPaulBlart: give me my freedom dividend before i riot @georgehotz
THX1342: YES. decentralize
PiroFloydian: anarchosyndicalism is decentralization @georgehotz
vonhoganon: libertarian geohotz
MrTriharder: Bitcoin admiralJoy
logi6000: let's go something I believe in extremely
Lourned: solution is pay government employees better and hire smart people
AzazelTheGoat: is localism nationalism lite?
wheely_mcbones: decentralization is the reason US has more problems with Corona than China did
ThirstyDrank: Explain centralization and its issues plz
tkdboy555: @georgehotz how about universal basic income tied to inflation/quantitative easing, essentially preserving the buying power of every American, it can be implemented with blockchain, in fact it would be best implemented through blockchain
pz3300: Lazy people are lazy
wheely_mcbones: but is also a good thing
alicyka: anarchy means you get your socialist world, I get my capitalist world
360Plato: nah you need to centralize to compete with malevolent players
pikomane2: could u explain how blockchain would make rent seeking impossible?
pz3300: Yes
koreanfoodyum: very tru
innerbean: capitalism uses false scarcity and denying access for increase profits but if it becomes the top and often only priority it's corrupts a society
PiroFloydian: anarchosyndicalism is decentralization for gov @georgehotz
aj37z: Decentralize budget allocation
ankitc: truuu
wheely_mcbones: @PiroFloydian yeah
tkdboy555: UBI IMPLEMENTED VIA BLOCKCHAIN
solitarynative: @innerbean brainlet take
pz3300: Reddit sucks dick
ahahahaitslit: take a hit
PiroFloydian: take out profit motive of healthcare w/ M4a @georgehotz
fartdog2009: hey, i think that this might help.
williamjennings1: we just need to meditate brah
bufferovrflw: @georgehotz Thoughts on "Social Democracy" ?
dorkmo: i so badly want to go to waffle house
The1theycallmonk: George is speaking the truth tonight!
wheely_mcbones: why is so expensive? political lobby pretty much
whyZaya: Poor people care.
amedhussaini: the question is.. what is the quickest path to a post scarcity economy?
tkdboy555: NO
alfyfav: Omg this live keeps up
Lourned: $350 for STD test bro, 350 fucking dollars
The1theycallmonk: Healthcare is too expensive. Spreading the cost isn't the solution
un3okapi: why not decentralize the schooling system?
wheely_mcbones: but free market results in a lot of Shrkrellis
robotboy987: Google is bad because all this big websites have good seo
bluejimmy168: 600 dollars for a healthy adult to get insurance iin my state is dumb.
aj37z: @dorkmo capitalism
innerbean: it's not about a binary between capitalism and socialism, either extreme is unbalanced.
tkdboy555: I'M NOT TALKING ABOUT YANG'S VERSION OF UBI BUD
360Plato: @wheely_mcbones thats a bad thinbg?
AzazelTheGoat: houses shouldn't be as expensive as they are.
mattdougherty22: atoms is harder than bits, that's where we need to focus even more.
tkdboy555: I'M TALKING ABOUT UBI TIED TO QUNATITATIVE EASING AND INFLATION
PiroFloydian: innovation happens irrespective of the profit motive @georgehotz
THX1342: georgehotz I am all for decentralization but I always get hanged on 'big projects'... like moon landings... who tackles them?
C0deCane: @georgehotz LUL show these people poverty in america compared to poverty in other "great" places in the world with socialism ahahha
AzazelTheGoat: I work full time and am struggling to get a house. it literally makes no sense
wheely_mcbones: @360Plato yeah
dorkmo: robots
pikomane2: thats that colonizer mentality
logi6000: truth
Emanuell45: its not about bringing the top down its about bringing the bottom up
ThirstyDrank: Yes, but that's at the cost of the environment again
wheely_mcbones: things are cheap because we made education universal, not because of capitalism or free market
mutrx: bernie2020,24,28,32!!!!!
jomkingal: Hi George! Sorry off topic but greetings from NJ!
boengels: but increasing the economy also seems to destroy the natural world...
pec_adillo: IP is bull
dprophecyguy: @georgehotz What about its impact on scciety and the way it affects people ?
koreanfoodyum: LOL LIMEWIRE
AzazelTheGoat: is apple a metaphor for... apple?
mattdougherty22: what do you think of Income Share Agreements versus student loans to help keep schools accountable?
innerbean: i hate sounding like this but it's about the distribution of the total wealth
C4TFive: George Shapiro LUL
gamerguy009: Dont pay hockey players so much
PiroFloydian: anarchosyndicalism is what youre looking for @georgehotz
gazny: We need an opensource society
dprophecyguy: You can create wealth but nobody is giving a fuck how it's fucking up with the environment
koreanfoodyum: do what you want cause a pirate is free, cause you are a pirate!
wheely_mcbones: this is true, information should be free
latenightbj: whos the guy with the gun ?
dorkmo: but but open source 3d printed guns
theonlymonkas: i like how this guy thinks
THX1342: georgehotz I am all for decentralization but I always get hanged on 'big projects'... like moon landings... who tackles them? Twitch Prime
SofiaLouise: dont you thinks patents are important?
dprophecyguy: This graph doesn't talk about environment impact
360Plato: ok IP law is necessary to incentivize research
wheely_mcbones: this graph happened because education became universal
opus_000: cash flow
Parkpark1997: :d
knilecrack: how can you like capitalism and then talk about IP like that ?
alfyfav: To end poverty you don't have to end richness
dsqst: The graph is distribution
AzazelTheGoat: hockey players provide a service, and it's something i couldn't do so the value is there for them to get paid a lotr
innerbean: that's exactly my point, thanks for making it so clearly.....hehe
mutrx: giraffe extinction solved extreme poverty confirmed
l1ght5p33d: This is my garden and i like it except the chain link fences those suck
tkdboy555: SO WHAT DO YOU THINK ABOUT THE FEDERAL RESERVE?
24786d: Just change the definition of poverty EZ
Penguino138: Preach @georgehotz
edeustua: how would you deal with rent seeking via blockchain?
Lourned: define extreme poverty Kappa
innerbean: we can keep printing money but it keeps going into fewer and fewer hands
dsqst: There are many who have nothing and it’s not artificial to them
vonhoganon: just remove it 4Head
AzazelTheGoat: HUNTER GATHERING TIMES BOYS
theonlymonkas: Nice book! any other recommendation?
C0deCane: Im telling you compare the poverty in America to the poverty in other countries they are way way worse off
Emanuell45: lmao
dingus74: lol
sigmund_graphics: lol
williamjennings1: u lived in the woods?
markydothh: The problem is that the system is RIGGED b/c politics is CORRUPT. Lobbyist, big corporates, these fking policitans are CORRUPT!
EXSNarrow: LMAO
localcanofdutchgold: 3 lul
braininavatt: three?
braininavatt: more like two
Lourned: LUL
wheely_mcbones: @C0deCane compared to sweeden, japan or scotlan? are you kidding?
EquiFox: best content on twitch rn
dorkmo: extreme poverty = nyc in the time of coronavirus
logi6000: wait a minute this mother fucker just said he tried to live in the woods
ankitc: as a software developer i earn less then 400 dollars a month
tkdboy555: DOES THIS TAKE INTO ACCOUNT INFLATION. I'M GUESSING NOT
C0deCane: compare it to a super power @wheely_mcbones
mutrx: 2.0 per day gang 🦀 🦀 🦀 🦀 🦀 🦀 🦀
360Plato: so tree fiddy is a lot
innerbean: distribute the power equally not based on capital as the highest value, it's about people, we the people, not the capital
DecayingSkullz: Geohot should write a book
dprophecyguy: @ankitc get a good job man
jomkingal: We are programmed from birth. To be dependent on these things that we were taught that we need.
Emanuell45: @ankitc wtf, where do you live?
AresRai: @ankitc what country curious
Ayyyy420Lmao: obviously yes
Lourned: @georgehotz so $2 is not extreme poverty? LUL
wheely_mcbones: @C0deCane you don't have any 1st world big country
ankitc: Nepal
tkdboy555: lmfao, but what the REAL value of inflation
mutrx: it says adjusted for inflation @georgehotz
tkdboy555: these numbers are busted
jimmyadaro: Sup
foti_kasparov: @ankitc Makes sense
boengels: what is extreme poverty
Emanuell45: @AresRai must be 2nd or third world
knilecrack: for 2$ daily you can have one pljeskavic per day
MrTriharder: @ankitc Just move to India
innerbean: and sex...can;t forget about that. hehe
alicyka: Government is just an HR department / middle management for humanity, fuck it
rorhug: Call someone you trust to discuss
AresRai: @Emanuell45 2.5 LUL
AzazelTheGoat: but is there quality of life any good?
markydothh: Thats b/c of CHINA
wheely_mcbones: @C0deCane you can't compare it to 3rd world countries because of story, imperialism and stuff
AzazelTheGoat: their*
whyZaya: pljeskavics should be illegal.
dorkmo: and look at a population growth chart too
knilecrack: it's because of 2nd WW
HellxNebula: ppl who starved died before reprodtuce and the most wealthy survived and it goes on thats way
gamerguy009: Cant survive on minimum wage
markydothh: CHINA's ascent has probably accounted for half of the 40%
dorkmo: adding people
logi6000: but now the real question is how do we get out of the simulation
mattdougherty22: what smart people do you interact with most? Those at comma?
appreciation1: @tkdboy555 just think what a poor poerson has today vs what a miner had in 1850 in a "first world country" it does take infaltion into account
Emanuell45: @AresRai LUL LUL
innerbean: yes, very good.....because of technology
knilecrack: it's good that USA was not destroyed in WW2 otherwise EU would come back now on it's feet
innerbean: the market created that
Ayyyy420Lmao: @mattdougherty22 us the twitch chat chads
williamjennings1: dang
amedhussaini: the chinese market reforms started at around that time
amedhussaini: early 80s
Stegosaurian: the world's economy is based on a broken financial system
C0deCane: @wheely_mcbones japan is not a super power i was speaking more about china russia they poverty in those countries is far worse off then the poverty in america even the rural areas in america are way way better off
koreanfoodyum: isn't china full of starving people? that's why they have the wet markets that had the bat which transmitted corona? isn't that extreme poverty? :o
Emanuell45: you can say what you want about the chinnese, but they do good things for their countries population
mattdougherty22: hahah sadly not @Ayyyy420Lmao look at your name. We are watching him
solitarynative: ANELE Clap
markydothh: India?
360Plato: they dont have the culture
markydothh: NO
PiroFloydian: @koreanfoodyum wet markets are a rich people thing
aMANT3: !time
jimmyadaro: @Stegosaurian What??
Jehhred: no wonder the chinese are so sringy
rorhug: Call someone. Bring a guest onto the show and discuss this.
wheely_mcbones: @C0deCane you are ignoring world history behind that
AzazelTheGoat: I dont trust stats provided by the CCP. im biased. or is a third party getting this info
THX1342: look at braizl
koreanfoodyum: weird rich people then
noobaj: all lockdown
williamjennings1: !time
tkdboy555: @appreciation1 except they actually knew how to grow their own shit in their backyard, but instead, now we just have hyper-green grass for our dogs
SofiaLouise: it has slowed down with modi
markydothh: India wont have the same ascent that CHINA had
MrTriharder: @georgehotz I am from India. Economy is crumbling a bit :)
PiroFloydian: @koreanfoodyum yes
Kawhiet: China -&gt; India -&gt; Africa
gamerguy009: North Korea is starving
mutrx: @georgehotz can you speak chinese
Ayyyy420Lmao: @mattdougherty22 i just smoke weed to lower my iq from 180 to 140
dprophecyguy: India only few cities are in good position
aj37z: 4head
t_lokus: extreme poverty is really very poor metric of global economy, it's just a very basic measurement that has so many problems.. it's like the chapter 1 in economics and dropped so fast, there are a lot of arguments on why is so weak metric
ThirstyDrank: China has super cheap food
innerbean: profit can be a motive for it, if it's the only and top motive it corrupts the system.
koreanfoodyum: nk is def starving
tornpaperyoyos: Why did you spend a year in china?
dprophecyguy: Nobody is starving in india also
aj37z: 4Head
tsAllySparkles: you spent a year of your life in cities
opus_000: they can't produce enough food
ThirstyDrank: but comparably, healthier but less caloric than ours
tsAllySparkles: try going around rural china
C0deCane: @wheely_mcbones thats the point why capitalism is better if it wasn't it wouldn't be that way in those countries simple as that
foti_kasparov: Having 1b  population is hard
MrTriharder: Only Mumbai Bangalore Hyderabad chennai is good in India @georgehotz
DecayingSkullz: @architectzs if you ask about that you'll get timed out
mattdougherty22: @Ayyyy420Lmao same, how old are you? What do you do for a living?
wheely_mcbones: @C0deCane this is not because of capitalism, is because of universalizing education in the last century
24786d: You're likely attributing correlation to causation. I like to think we're in a period of peace and stability, which really helped
Ayyyy420Lmao: @mattdougherty22 im a 35 years old neet living on government housing and welfare
dprophecyguy: @georgehotz In India the standard of living is pretty bad. People do not care about how they live like they are used to being oppresses it seems
ThirstyDrank: what about their dystopian app social rating
DecayingSkullz: @architectzs everyone asks about that
joker2k999: damn. talks getting deep.
l1ght5p33d: no
SpaceGhost8: right, it's state controlled but its really not all that different fundamentally
wheely_mcbones: @C0deCane you have more capitalism in US than you have in Germany or Sweden
dorkmo: visit a reducation camp :P
C0deCane: @wheely_mcbones what the hell does that have to do with the how life is in poverty areas in america and in china
wheely_mcbones: @C0deCane still they have better living conditions
koreanfoodyum: that's what I'd hope, in private, even a communist reign wouldn't keep you from shit talking winne the pooh :D
innerbean: eh, there's some issues for sure but different than the ones in the west
MrTriharder: Wuhan monkaS
mattdougherty22: @Ayyyy420Lmao how did you come across geo?
jimmyadaro: What about Africa?
mattdougherty22: lol im 20
markydothh: How's your mandarin? Talk some dirty Mando to me.
appreciation1: @tkdboy555 you are shifting the goalpoasts now. Also you are free to grow your own stuff alnd is very cheap in the rural areas especially in poorer countries you need around 2 baseball fields of land for 1 person to live off of
logi6000: George have you read Fahrenheit 451
AzazelTheGoat: thats interesting
williamjennings1: 9times
dprophecyguy: @georgehotz And also in india lot of people relate politics with religion and they also associate their politician with god like figures
ThirstyDrank: They have starvation during droughts
innerbean: east and west both have their issues
C0deCane: @wheely_mcbones LUL dude
AzazelTheGoat: i guess the same is here in canada. The reservations can look pretty depressing when driving through
robotboy987: India has more "linear" segment of economy eg. farmers
architectzs: can i not be curious?
dprophecyguy: @georgehotz Currently in india the PM is like god to more than half of the country
mattdougherty22: what smart people do you interact with most? Those at comma?
theonlymonkas: have you been on latin america?
Lourned: if starvation was every a problem in the world population would decrease not increase, no?
DecayingSkullz: @architectzs no you can't
PiroFloydian: what book were you talking about earlier?
architectzs: explain?
THX1342: India is going on a baaad road...
Ayyyy420Lmao: @mattdougherty22 i know about him since the iphone thing, youtube recomends shit about him sometimes
brownyyyylocks: India is beautiful!
mattdougherty22: Peter Thiel all about not declining @georgehotz
theonlymonkas: permutation city
innerbean: what if the mic on their phone catches it and webo records it? boom....busted hehehe
gamerguy009: Canada is good
wheely_mcbones: @C0deCane US is better than China, but is not because of capitalism
360Plato: @brownyyyylocks you should travel more
williamjennings1: stock market is scary
Kawhiet: Why do you think the emoji is like that?
mutrx: @architectzs scroll down to see the rules, keyboard = timeout
alicyka: There's nothing sadder than a beautifully built house covered in mold, hidden behind 4 feet of grass
MrTriharder: @georgehotz if u come To Mumbai, I’ll show u around. No indian will be able to scan u with foreign prices :)
gamerguy009: Geohotz move to Canada
C0deCane: the rural america i live in is better now than it was 4 years ago
Lourned: cant exploit China any more, they are getting rich now FeelsBadMan
AzazelTheGoat: i think victim mentality is a major poison on a culture
dprophecyguy: @georgehotz You won't find more welcoming people anywhere in the world than in India.
tkdboy555: @georgehotz @appreciation1 IN THE 1800S, 90% of the american population lived on farms. At least back then we actually grew our own shit. This whole poverty thing is relative because we are ascribing wealth to a monetary metric, instead of actually material possession. The entire philosophy of this metric is busted http://jaysonlusk.com/blog/2016/6/26/the-evolution-of-american-agriculture
architectzs: do people really ask that much lmao
PiroFloydian: when the market goes up it doesnt help most people. when it goes down they all suffer @georgehotz
DecayingSkullz: @architectzs yes
mutrx: @architectzs yep
opus_000: stock market is basically gambling
DecayingSkullz: @architectzs scroll down and read the only rule of this channel
solitarynative: what states are you talking about?
martinkirilov: everyone is so used to the stock market going up, most people buy in expecting to make money overnight. you should expect to lose, hope to win
jimmyadaro: @opus_000 Hell na
architectzs: thats interestinmg
rorhug: Call someone George - bring a guest onto the show to discuss.
brownyyyylocks: @dprophecyguy Which parts of India have you been to?
dprophecyguy: @georgehotz You should live in India for some time not just visit India. Talk with people and maybe can start a university here. There are way more talented people here than USA but with no guidance
wheely_mcbones: The world can't consume as much as America do, the problem with capitalism is in the wealth distribution around the world not around america
Ayyyy420Lmao: do you speak any foreing languages?
tsAllySparkles: what interstate
jimmyadaro: @wheely_mcbones Shut the fuck up with your communist shit lmao
ThirstyDrank: Do you think deregulating would help stimulate the economy, like with weed
360Plato: you should visit the caucuses
Lourned: what country is the US and friends going to exploit next for cheap labor?
mattdougherty22: any podcast fans able to give me feedback on this episode format? http://mattdougherty.online/Podscribe-mock/test/test2
wheely_mcbones: @jimmyadaro I'm not wrong tough
dprophecyguy: @brownyyyylocks I am from India
tornpaperyoyos: @wheely_mcbones you are though
jimmyadaro: @wheely_mcbones Hell yeah you're
joker2k999: any crazy Bangkok stories? LUL
brownyyyylocks: LOL.
koreanfoodyum: AMERICA, FUCK YEAH!
tkdboy555: LITERALLY 90% OF AMERICANS LIVED ON FARMS IN THE 1800s, NOW ITS 2%, PLEASE DON'T RELATE POVERTY TO MONETARY ACCUMULATION.
ahahahaitslit: USA!!!!!!!!
solitarynative: Is adderal the best way to stimulate the economy?
Ayyyy420Lmao: @wheely_mcbones cant be wrong if i say im not wrong, smart move!
AzazelTheGoat: haven't you seen crazy rich asians?
rndmsqnce: where in california is truly rural?
C0deCane: LUL you can become a billionaire in china overnight if you come out with a hit product
innerbean: they catching up
jimmyadaro: Capitalism has took out the 90% of population from poverty, what the fuck man
Belowzer0w: We need a graph for happiness. Does happiness and wealth correlate? I mean if you have more than food and water, how does this reflect in happiness?
vonhoganon: @rndmsqnce riverside
PiroFloydian: @rndmsqnce eastern i think
jimmyadaro: @Belowzer0w Will create some kind of Kuznets curve
dprophecyguy: @georgehotz Do you care about nationality?
MrTriharder: @georgehotz America Iceland Russia and kazakstan consume the highest fossil fuels in the world per capita
HellxNebula: sweet data
360Plato: @solitarynative speed used to be over the counter
amedhussaini: california is very rural outside of sf/la/san diego
ThirstyDrank: I think a big problem now is that people are pushed on depending on others to distribute value, rather than producing
innerbean: probably more consumers worldwide than in NA
AzazelTheGoat: my parents grew up on a farm, i grew up in a comfy house with central heating. its crazy
THX1342: any graph showing % of americans that are home owners vs rent?
appreciation1: @tkdboy555 I get that. My problem with that argument is that farming is a grueling and backbreaking task and i'd rather go and live in a moderately big city and do my office job. and most people tend to agree with me because most people live in cities instead of homesteading which is definitly possible in todays world in most moderatly rich countries. also specialization makes the same lands yield more food so the best farmers make more food for all of us. famring is a skill.
boengels: no
opus_000: heroin
dprophecyguy: @georgehotz Happiness Index
moonwalker15: No, it does not
AzazelTheGoat: happiness to me is security
tornpaperyoyos: @MrTriharder how tf is iceland on that list
foti_kasparov: OMG indians just blasted in the chat
wheely_mcbones: good point.
solitarynative: @360Plato damn lol
dprophecyguy: Search for happiness index
mutrx: look at all the celebrities who are crying bc of quarantine in their mansions @georgehotz
vonhoganon: money = happiness
C0deCane: There is definitely an algorithm for happiness im sure
Ayyyy420Lmao: ofc it subjective so u just ask ppl 'are u happy m8?'
Lourned: west virgina PogChamp
innerbean: my pants
MrTriharder: Just make Finland as the winner for happiness :) admiralJoy
theonlymonkas: no
rndmsqnce: state of jefferson?
innerbean: was that wrong? sorry
dprophecyguy: There is official happiness index
tkdboy555: @appreciation1 the entire point is the poverty metric he used is bullshit. people in extreme poverty back then were well fed as fuck, no cap
joker2k999: acceptance, laughter, arguing w/ a friend and winning, and having a few bucks in the bank
innerbean: it's in the declaration of independence
martinkirilov: "Happiness is your biggest enemy. It weakens you. Puts doubts in your mind. Suddenly you have something to lose!" - Rush BibleThump
DecayingSkullz: How do you think we should measure intelligence?
innerbean: pursuit of it
dprophecyguy: @georgehotz https://en.wikipedia.org/wiki/World_Happiness_Report Check this out
Hawklite: happiness simply means one's expectations or desires are being met
ahahahaitslit: will you ever write a book
opus_000: happiness is perspective
Ayyyy420Lmao: @Hawklite what if u have no expectations or desires?
The_Troll_Toll: i lived in SF (retreated to a bunker a month ago) and know ppl who lived with you at the crypto castle
jimmyadaro: @Hawklite That changes all the time
innerbean: the constitution is to promote general welfare? how to measure that?
tkdboy555: @appreciation1 life was food
appreciation1: @tkdboy555 oh I agree that it's bs. Bad measure of poverty. better measure would be imo. What did the emperor of china have vs the average poor person today
360Plato: I think fufillment is more important. I much rather be Russian then German
Lourned: happiness is relative
Hawklite: @jimmyadaro so then when it changes and your expectations/desires aren't met, then you aren't happpy
gaocaandra: did you check out weinstein
dprophecyguy: Checkout happiness index. Top 5 Countries are scandinavian
AzazelTheGoat: they were too tired to think about trivial shit like that
The_Troll_Toll: ted kacynzski bro
innerbean: i like happiness....haha
C0deCane: Get back on coronavirus LUL
HellxNebula: hapiness is all about perception
Ayyyy420Lmao: @360Plato i'd rather not exist than be german or rusian
sigmund_graphics: Possibly happier to have something ot do
solitarynative: physical pain give you purpose and meaning bro
Belowzer0w: Working with your body is satisfying
innerbean: joy is better
tkdboy555: @appreciation1 yes, wealth inequality should be extremely relevant to the metric but it isn't
boengels: George have you ever seen this??! https://mynoise.net/NoiseMachines/cafeRestaurantNoiseGenerator.php?fbclid=IwAR1f5EQ9Zov7PHukgYq6DnPvw-8zbDUz8Dan0eJ1RfuADDYgm4ZRaGsftmg
Emanuell45: no dude
boengels: perfect for study time :D
innerbean: fulfillment is the bomb
Ayyyy420Lmao: nope
The_Troll_Toll: think of all the pussy you'd get
Ayyyy420Lmao: fuck social score and shit like taht
AresRai: no dude emperor in china had 3000 wives @georgehotz
martinkirilov: You can't measure happiness, everyone has their own concept of it
The_Troll_Toll: the armies you could command
THX1342: think about all the sick parties tho
innerbean: at peace is divine
360Plato: @Ayyyy420Lmao St Petersburg is comfy
un3okapi: getting pegged is painful
boengels: cafe noise generator
appreciation1: @tkdboy555 when was the last time some1 died because of a bad harvest in america? happend all the time when 90% of the population was farming
C4TFive: kings could use people as toilet paper though
innerbean: hehehe,,, how much to buy it?
mutrx: im annoyed i won't be able to witness the crazy shit that's going to happen in the future @georgehotz
Emanuell45: the social status of a king would be way better than slaving away at a apple sweat shop
localcanofdutchgold: forsenCD
AzazelTheGoat: thoughts on ending the welfare state? @georgehotz
pz3300: They shore were healthier
tsAllySparkles: if you were a king in 1600 you'd go to war with the land of sony
solitarynative: forsenCD nice
AresRai: concubines
joker2k999: Damn. but those castle's tho bro...
innerbean: not physical pain....psychological suffering...self suffering, that's the difference
HellxNebula: why the hell you want 3k wives one is enough
HellxNebula: xd
C4TFive: 3000 waifu's maybe
jimmyadaro: LUL
Ayyyy420Lmao: gengis khan fucked like 20k thots
appreciation1: @georgehotz emporor of china had 20 different foods to chose from I have more with takeout
murkythunder: for hotz 3k is chump change
bufferovrflw: @georgehotz Not at once I hope
dorkmo: in one afternoon on tinder
aj37z: chad
innerbean: yup
C0deCane: LUL thats Viagras roots
joker2k999: LUL
AzazelTheGoat: lol
dprophecyguy: @georgehotz How many sex partners you are aiming for ?
mashafique: The Hotz Harem LUL
360Plato: Welfare is a practical necessity at this point
mutrx: @dorkmo maybe for women :(
doctorgenus: how many sex partners do you have?
Emanuell45: if you end the welfare state, crime is going to go through the roof
logi6000: @hellxnebula one just didn't cut it for that Chinese emperor
brownyyyylocks: 3k do you know what women are like??
AzazelTheGoat: @Emanuell45 thats true
PiroFloydian: hell yeah
Snobbysteven: only 3k? pft, that's just a Tuesday night....
ooMariaoo: loll
Ayyyy420Lmao: sex yikes
braininavatt: it's gonna be sick! (literally)
pz3300: What, you don’t have 3k bitches?
SpaceGhost8: fuck coronavirus lets do that
localcanofdutchgold: this guy
tkdboy555: hahahahah
brownyyyylocks: ewwwwww
C0deCane: how many kids do you think he had?
HellxNebula: @logi6000 i guess he could throw her somewhere when to blabla began
THX1342: that's good stream content: hacking STDs
innerbean: I've found things in a dumpster that kings of the past couldn't cream of
robotboy987: fucking alimony for 3k wives
doctorgenus: can we do that for the next stream?
dorkmo: 10 a day for a year
brownyyyylocks: gross
ooMariaoo: relax lol @TeaLeafi
foti_kasparov: @TeaLeafi Are you really that interested dude
solitarynative: I'm halfway there :)
ideology_sniffing_raccoon: COOMING every day
fyezool: lend me some of your power george
l1ght5p33d: all about selectivity
360Plato: I mean over 20 years once ever 1.5 days
brownyyyylocks: 3
koreanfoodyum: set your goals high, go for 3.5 billion! ^-^
davidvilla700: by order of the peaky fuckin blinders
murkythunder: u a virgin bro ?
pz3300: You luuuv politics george
bufferovrflw: I don't think most of the 3k weren't voluntary sex partners
braininavatt: comma.bio
jimmyadaro: You eliminate welfare, you create The Purge… Boom, no poverty, no crime, no shit LUL
joker2k999: ..give or take huh..
THX1342: cure aids, instant king
theonlymonkas: LUL
doctorgenus: would u have sex with a sexy robot?!!!!!!
shieeeeeeeeet: what is the path from reverse engineering covid-19 to curing it?
Jehhred: Less than 3,000. big surprise there
appreciation1: @tkdboy555 we agree when it comes to the problems I think.
SpaceGhost8: LUL
AzazelTheGoat: can't cure aids, more money in the treatment than the cure
jimmyadaro: It's taken
innerbean: obonervirus
alicyka: Oh here's a question: What project would you want to work on if there was no government threatening you? Still what you're doing now?
braininavatt: no if I buy it first Kappa
MrTriharder: @tealeafi Cause u suffer from autism
C0deCane: ez
latenightbj: comma.xxx
logi6000: do you believe in ai girlfriends
koreanfoodyum: comma.tv
dorkmo: epic domain grabbbb
phrixus_bro: too late
opus_000: lol
solitarynative: TriHard yoink
THX1342: LUL
jimmyadaro: You eliminate welfare, you create The Purge… Boom, no poverty, no crime, no shit LUL
localcanofdutchgold: Kapp
bluejimmy168: Yoinked
pz3300: I’m on about 1000 now
theonlymonkas: but how many of them were humans?
SpaceGhost8: mine now :)
Ayyyy420Lmao: shit i was searching for my CC already
mattdougherty22: just bought it bub
braininavatt: comma.xyz
bluejimmy168: mine now :)
foti_kasparov: comma.gov
tkdboy555: how about artificial sentience?
360Plato: eugenic bear fighting
Lourned: he works for the government Kappa
brownyyyylocks: oh its q&amp;a time
AzazelTheGoat: blink twice if you're not safe george
koreanfoodyum: comma.edu
pz3300: About 200 civilians and 800 hookers
doctorgenus: if sony didn't sue you, would you be doing what you're doing today?
Santiago_LHC: comma.vaio
squiggly_nibba: how's your other company
brownyyyylocks: i love q&amp;a time!!
tornpaperyoyos: I already bought it
logi6000: do you believe in ai girlfriends
koreanfoodyum: comma.darpa
mattdougherty22: ill sell it for an autograph
bufferovrflw: @georgehotz Thoughts on disinformation campaings on Social Media? Any idea what we could do to solve it?
l1ght5p33d: good stream
THX1342: how many times have you stopped to think "how can I exploit the system?"
edeustua: thoughts on Chris Arnade
dorkmo: have you seen the movie HER?
1monkjuice: would you accept an offer from the army?
edeustua: ?
Hawklite: what set of beliefs are you going to push in your university?
ahahahaitslit: have you used ocaml
pz3300: You buy it off me
Ayyyy420Lmao: can jet fuel melt steel beams?
braininavatt: do you have any sony devices?
solitarynative: do you like cbt?
Abnico: how is your weighted blanket?
koreanfoodyum: comma.ngo would mean u ain't a suit :O
phrixus_bro: yaas
PiroFloydian: true
AzazelTheGoat: spooky.
THX1342: why do people use social media to inform themselves anyway....
pz3300: That’s what you think
tornpaperyoyos: Are you gonna DESTROY the coronavirus with FACTS and LOGIC????
mutrx: are you going to try sous vide @georgehotz
SpaceGhost8: cbd CiGrip
dorkmo: continual variable transmission
pz3300: Lol
Lourned: edgy news are fun LUL
rsten: cock and ball toture moon2MD
latenightbj: twitch included as smc
solitarynative: yes cbt
localcanofdutchgold: cbt the other one
PiroFloydian: cbt is also cock and ball torture i think @georgehotz ?
pwnbase: cock and ball torture
JdPaulBlart: cbt as in cock and ball torture
DecayingSkullz: That's not what he meant by CBT....
innerbean: both rock
SpaceGhost8: ALL IN ACB stockMoon
jimmyadaro: ARE YOU WASHING YOUR GODDAMN HANDS GEORGE?
doctorgenus: what pills do you take everyday beside zinc?
pz3300: Is it worth taking cs50 course on edx online?
Piqcyl: ELI5 past streams? Are you modelling it genetically? Or are you simulating its formation orrrrrr
bufferovrflw: @georgehotz Well, yeah, but the disinformation campaings are the side-effects of those optimalizations
MrTriharder: @georgehotz government is passing a bill to remove encryption DansGame
Ayyyy420Lmao: do you have a pepe the frog image collection??
SpaceGhost8: LUL
ICAntF331MyFAce: LUL
shieeeeeeeeet: what is the path from reverse engineering covid-19 to curing it?
braininavatt: LUL
AzazelTheGoat: show feet
rndmsqnce: hows you coronavirus love life
Santiago_LHC: Come on you guys!
braininavatt: do better chat
solitarynative: sorry guys
bluejimmy168: lol
guy_ross: i tried the hype train
logi6000: no better quality
brownyyyylocks: When all this is over I cant wait to go to Bondi Beach!!!
localcanofdutchgold: read any good math book?
jimmyadaro: Eat garlic George, and raw onions mf
dorkmo: chooooooooooo
Belowzer0w: I love you bye
joker2k999: lol
bluejimmy168: Show feet
HellxNebula: what language you recommend for a beginner
haircutjimmy: what are Microsoft doing with ai?
pz3300: Both
Santiago_LHC: Engage intellect!
ideology_sniffing_raccoon: is there a discord for the twitch channel?
THX1342: georgehotz if you had one space ticket to anywhere, what body would you go to?
mashafique: Any plans to do any physics oriented streams? @georgehotz
onichJu: @georgehotz have u found out something interesting while i been gone for the last 3 days?
tkdboy555: @georgehotz one day I'm gonna start a company to develop artificially sentient super-intelligence, wanna contribute?
theonlymonkas: what book are you reading right now?
koreanfoodyum: ~/fun/corona oh...
Ayyyy420Lmao: can you recomend me a good porno scene gerorge?
l1ght5p33d: I sent my solution about the commai Speed Challenge can you look at it it sucks
jimmyadaro: The opposite to "Microsoft" is "Macrohard"
DecayingSkullz: HYPE TRAIN
boengels: Time to go to work anyway. Thanks for your thoughts George
opus_000: is groovy worth learning for ml
ParaLizard: Any opinionated advice for a CS undergrad?
Emanuell45: @georgehotz how do you keep motivated when solving hour long probelms
innerbean: how would you attack it?
doctorgenus: if I do all the leetcode problems, will you give me a job at comma?
ICAntF331MyFAce: get hype VoHiYo
AzazelTheGoat: can you find the cure for flat feet? i desperately need arches george.
wheely_mcbones: learned a lot today
PiroFloydian: Scam train?
EquiFox: do you get a lot of custom car port request for comma ?
Lourned: i love corona virus, no more traffic, no more lines, love it
yousodead: are you poor begging for bits
noclip32: Cheer1 Cheer1
dorkmo: Party1 Party1 Party1
solitarynative: PogChamp
64pillars: do you have an artistic ability?
DecayingSkullz: Kappa Kappa Kappa Kappa Kappa Kappa Kappa
Emanuell45: @georgehotz how do you keep motivated when solving hour long probelms. ,
UniversalGeneve: @georgehotz watch this offline, good visualizations of DNA replication processes: https://www.youtube.com/watch?v=7Hk9jct2ozY
dingus74: jackoo1Weird_SG
l1ght5p33d: whats your favorite movie
abdcw: what is the minimum amount of money one needs to be paid to suck dick where it isn't gay?
tkdboy555: @georgehotz one day I'm gonna start a company to develop artificially sentient super-intelligence, wanna contribute?
jimmyadaro: Have you ever been scamed (online or not)??
localcanofdutchgold: which ones do you not answer?
logi6000: me is broke boi
Abnico: thoughts on scale ai?
Emanuell45: @georgehotz how do you keep motivated when solving hour long probelms...
ICAntF331MyFAce: VoHiYo1 VoHiYo1 VoHiYo1
onichJu: LUL
koreanfoodyum: PrideCheers PrideLionYay PrideLionYay PrideLionYay PrideLionYay PrideCheers
innerbean: how would you attack covid?
brownyyyylocks: twitchies revolt!!!!!!!
l1ght5p33d: favorite food
THX1342: LUL
jimmyadaro: Have you ever been scamed (online or not)?
foti_kasparov: GOOOO SCAAAM TRAAAAAINNNNN CHOO CHOO cbrahTune cbrahTune
theonlymonkas: LUL
onichJu: you really are the ultimate capitalist @georgehotz
doctorgenus: why is your grocery bags still out?
THX1342: S C A M
dingus74: ResidentSleeper
Ayyyy420Lmao: NotLikeThis NotLikeThis NotLikeThis
FerFap: Gearge you should check WORLDOMETERS for the coronavirus they have lots of good grphs for each country .
shieeeeeeeeet: *crickets*
DecayingSkullz: CHOOOOOO CHOOOOOOOOOOOOOOOOOO
Abnico: scale ai
ahahahaitslit: how do you get a hype train
ooMariaoo: oh
mashafique: Professional scam trainner LUL
privacyisnowhere: how many times do you beat the meat per day?
l1ght5p33d: best country
jimmyadaro: :LUL:
Penguino138: LETS GOOOOO
Landowner555: @jimmyadaro yes i have, right now
mutrx: CHOOOO CHOOOOOO
logi6000: well
jimmyadaro: LUL
HellxNebula: @georgehotz what language you recommend for a beginner and how to evolve
joker2k999: too much pressure LUL
ankitc: CHOOOOOOOOOOOOOOOOO
Abnico: scale ai yo
jimmyadaro: Have you ever been scamed (online or not)?
martinkirilov: Damn, selling out again, I see @georgehotz
yaus_baus: its a scam
ankitc: CHOOOOO
theonlymonkas: choooo chooooooo
alicyka: George is threatening to withhold his intellectual property in exchange for money
kyxstreams: hypeee
doctorgenus: is there milk in those bags?!!!
PiroFloydian: I'm poor someone else do it!
ICAntF331MyFAce: Cheer1 Cheer1 Cheer1
yaus_baus: dont do it
ahahahaitslit: how the fuck do you get a hype train
mikey9988: YEEEEEEEEEEEEEEEEEEEET
ooMariaoo: guys D:
jimmyadaro: Have you ever been scamed (online or not)??
ankitc: CHOOOO
tsAllySparkles: ok boomer
THX1342: s E L L o u T
mutrx: POGUUUU
dorkmo: choooooooooooo chooooooooooooooo
Piqcyl: CHOOOOOOOOOOOOOOOOO
DecayingSkullz: TRAIN
SpaceGhost8: bye george
localcanofdutchgold: no one wants to be scammed
onichJu: damn
koreanfoodyum: MrDestructoid MrDestructoid MrDestructoi
tkdboy555: sorry im poor af
opus_000: what's your social security #?
happypuppppy: nooo
AzazelTheGoat: how do you make a hype train?
jimmyadaro: Have you ever been scamed (online or not)?
theonlymonkas: LUL LUL
yaus_baus: scam
Ayyyy420Lmao: SCAMMED
logi6000: choooo
tornpaperyoyos: How does one hype train
doctorgenus: what do you mean by hype train?
C0deCane: stupid train LUL
jimmyadaro: goddamn it
64pillars: PepeHands
HellxNebula: @georgehotz what language you recommend for a beginner and how to evolve!
ankitc: CHOOOOOOOOOO
theonlymonkas: :(
Abnico: OhMyDog OhMyDog OhMyDog
l1ght5p33d: best stream
brownyyyylocks: boooooo u whore
jimmyadaro: Have you ever been scamed (online or not)??
phrixus_bro: thanks for streaming
mikey9988: Jebaited
latenightbj: &lt;3
happypuppppy: BibleThump
braininavatt: SwiftRage you suck chat
UniversalGeneve: UniversalGeneve is gifting 2 Tier 1 Subs to georgehotz's community! They've gifted a total of 10 in the channel!
UniversalGeneve: UniversalGeneve gifted a Tier 1 sub to theonlymonkas!
UniversalGeneve: UniversalGeneve gifted a Tier 1 sub to williamjennings1!
jimmyadaro: Have you ever been scamed (online or not)?
l1ght5p33d: BEST STREAM 1000X FOREVER
MrTriharder: DansGame DansGame DansGame
braininavatt: too late Jebaited
doctorgenus: did you watch lex yesterday?
UniversalGeneve: damn, that usually starts it
Penguino138: @georgehotz Thanks again for the streams, keep on going and keeping us calm
ahahahaitslit: allahu akbar
onichJu: LUL
EquiFox: do you get a lot of car port request for comma ?
theonlymonkas: ¡@UniversalGeneve thanks!
jimmyadaro: Have you ever been scamed (online or not)??
ICAntF331MyFAce: PogChamp
HellxNebula: @georgehotz what language you recommend for a beginner and how to evolve?
SpaceGhost8: :)
iIyaRPV: PogChamp
Ayyyy420Lmao: i'm not tho
ICAntF331MyFAce: PogChamp YOU
DecayingSkullz: HYYYYYPE
logi6000: thanks. bye
pz3300: Hype
Lourned: PogChamp
ooMariaoo: oh
joker2k999: no, bro... don't read the comments. lol
dingus74: lool
MrTriharder: PogChamp
dorkmo: hype train historyyyy
Emanuell45: true
mashafique: PogChamp
privacyisnowhere: what do you think about Genetic Algorithms?
Landowner555: i relate with the comment above it
n0_0xygen: PogChamp
opus_000: 🤔
AzazelTheGoat: everyone go like that comment
mutrx: Poggers
jimmyadaro: 2020 mf
ICAntF331MyFAce: PogChamp
tornpaperyoyos: 2019?
mutrx: PogChamp
jimmyadaro: Have you ever been scamed (online or not)?
ICAntF331MyFAce: LUL
bufferovrflw: @georgehotz Thanks for tonight stream. I really REALLY enjoyed it.
koreanfoodyum: HELLO FUTURE PEOPLE READING THIS VOD!
bigduddas: Pog
localcanofdutchgold: Pog
SpaceGhost8: sitting in my house ordering amazon prime now
ooMariaoo: Pog
funwayz: HI SON I WAS HERE
THX1342: LUL
braininavatt: Im so proud BibleThump
UniversalGeneve: history == COMMA.BIO LUL LUL
jimmyadaro: @georgehotz Have you ever been scamed (online or not)??
brownyyyylocks: @dorkmo yeahhhh buddyyyy
Yo, live. What
up? See, is the mic working? Mic. Yeah,
we got a mic. Yo, live. What up?
Here we go. Let's go. Let's go. Let's
go.
[Music]
All
[Music]
right. Uh, so first
off, first off, this cool jiggle puff.
I've been thinking I've been doing a lot
of thinking and I want to apologize to
face diaper
wearers. Um, but using language like
face diaper, I'm no better than I'm no
better than the other people. You know
what am I doing? I'm trying to use
inflammatory language to push my
viewpoint. That's
terrible. Like, I realized why I really
hated
uh Masks for All. I was I was I was
thinking about this. I'm like, why do I
hate this website so much? Um, it
doesn't even have to do with masks. It
has to do with
like this is not a true statement. This
is this is
like this may be a true statement or a
false statement but like this is just
propaganda,
right? Um and then like you know learn
about the benefit of masks and like you
go to these top ones and it's
like 56 76% of Americans want to forcely
impose their viewpoint on other people.
86% of the world's population lives in
places where the government actually is
mandating their viewpoint on other
people. A hundred thought
leaders are trying appeal to authority
to get you to show uh calling for masks
are required in public. like
um I am I see but
that's I I think that I think that um
that surgical masks and cloth masks
especially cloth masks are ineffective
um in preventing the spread of corona
virus. Uh I think that if you want
something that's effective you need like
a P100
uh medical mask. Yeah. if it was
referred to as scientific studies. So, I
looked into the scientific studies last
night and I couldn't really find
um the study that I uh that I wanted uh
which was a study that did a large uh
population randomly chose half of them
to wear cloth masks and half of them to
not wear masks and see who gets
coronairus more. Right.
Um so yeah I mean it it's no it's no
victory. Also the other thing um to
explain is so cloth masks even if you're
going by blocking of particles
um cloth masks block 3% of particles. So
that obviously does nothing. But even if
this blocks 50% of particles, like the
the ignorance required to believe that
blocking 50% of particles makes you 50%
less likely to get corona virus, right?
The virus replicates inside of you
logarithmically. Um, and I was thinking
about writing a simulator today to show
this effect that you have to block. I
mean, if if you want to put stops on the
virus and say like there's x amount of
it's it's it's logarithmic. It's not
linear.
Um, but that that's not a study, right?
C country countries where masks are
culturally accepted had a much lower
rate of transmission. I mean, yeah, but
Iceland doesn't wear masks and they have
the lowest rate of transmission. It has
to do with trusting government. Look, I
I don't want to turn this into I don't
want to turn this into like like like
bullshit talking about that. Um, I'm
open-minded on masks. Um, I personally
believe that the threshold required for
evidence to mandate something is very
high. Um, just as the threshold required
to ban something is very high, right?
And I don't think masks fall on either
side of those two thresholds. So, I
don't think they should either be banned
or mandated. I think if you want to
mandate something, you need an abundance
of scientific evidence on your side. But
that's a question about an evidentiary
standard, not a question about about
scientific fact. And I shouldn't
conflate those two. And also, if I'm
using the same inflammatory language
that I see on the internet, I'm no
better than those people. So you guys
can call me out here. We promote
science. We promote rationality.
Um, another thing that that I want to
promote,
um, if you guys have never read these,
the old ones were pretty good, the the
less wrong
sequences. Um, this is a great book,
uh, rationality from from A to Z.
Um, it just talks about a method for
reasoning.
Uh, another another I would recommend
everybody read that or at least be
familiar when people talk about
rationality and the sequences. I I think
I almost take for granted that people
understand these things and a lot of
them don't. Um, the other thing I want
to talk about is causes of death, real
Google media is,
um, yeah, this
one.
Um, I really like I really like this
picture.
Uh,
so on the left here is the real causes
of death. Um, then we have what people
search for. heart disease is massively
underrepresented in all of them.
Um, but then you have the media
coverage. And the most startling thing
to me here isn't that the media coverage
is wrong. Isn't that the media coverage
does not correspond to even what people
care about or what the truth is, right?
It corresponds to something entirely
different. But the but the scariest
thing to me about this chart is that
both the New York Times and the Guardian
have almost exactly the same wrong uh
facts. They they they they well not
these aren't facts, but like they they
have almost exactly the same completely
incorrect breakdown. Uh now they could
be forgiven if they both matched the
Google searches, right? Because that's a
true fact about what people are
interested in. I don't know why that is.
I I don't know why that is. And it's
it's upsetting. You know, yesterday on
the stream, um, someone said, "George,
wow, you're not anti-science. You're
just
anti-propaganda. How could anyone think
I'm anti-science?" You know, because I
might not have a viewpoint that you
agree with. I disagree with you on
something that makes you anti-science.
That's not what science
is.
Science, what science is, is believing
that there is a procedure to find truth.
Science also specifies that procedure.
as a scientific method but believing
that there is a procedure that two
independent people who don't agree on
anything can use
um and can find
truth and if the world no longer
believes in that the only solution I
think is war and the problem with I mean
fundamentally look you had people in in
in in u in Rome and in Greece and they
would pray to different gods and Some
people would pray to Athena and some
people would pray to Zeus and some
people would pray to Herod and it turned
out uh it didn't really matter uh which
god you prayed to um until someone found
the right god. So they were all smacking
each other with wooden swords, right? Um
until one guy gets this idea that we're
going to pray to the metal god and the
metal god likes it when you dig metal
out of the ground and you make your
swords out of metal and worshiping a
metal god. Maybe that's a god that
works, right? And there are gods that
work. Uh but when you have a when you
when you have two groups of people with
a different conception of truth, like I
mean the war does not have to be
necessarily like it can be cold war
style stuff, but if people don't believe
in truth, you can't I don't know how you
convince them. I remember debates in
high school. Um I remember sitting
around a fire at a party and we were
talking about like you know you can use
you can use logic to justify logic right
um but you can also use faith to justify
faith. Faith justifies faith
beautifully.
Uh you can't take someone who who who
believes in in in like a faith-based
truth and convince them using logic
because they believe in faith.
Um, if anything, the faith people might
might succeed better in in using faith
to convince the logic people they're
wrong. And again, um, you know, I want
to live forever. And I know that living
forever is not going to require faith.
It's going to require a lot of very
difficult scientific problems to be
solved. Truth isn't illusion, guys. Um,
re read the sequences on less
wrong. Read
uh I
mean they they taught me that, you know,
they they they teach you
this. They teach you this in like
elementary school at least. I don't
know. But, you know, I kind of wonder,
is this still what they're teaching in
in in elementary school? And like, is it
true?
It's it's it's it's easy to kind of
pervert, right?
But the the basic idea of the scientific
method is is you construct a hypothesis
and you also come up with an experiment.
You come up with an experiment. Say say
you have
um let me think of let me think of an
example. Right?
you start out with like your hypothesis
is that that masks uh you know uh block
the spread of corona virus right and
then the experiment that I'd like to do
is the experiment where we have 10,000
people uh we randomly assign half of
them to wear masks half of them to not
wear masks and there's a lot in in
experiment design that's really
important as well but if you design
correct experiments you can find truth
about the world and if I if we did that
experiment and we had 5,000 people wear
cloth masks and 5,000 people wear no
masks and like um you know five people
in the 5,000 wearing cloth masks got
coronairus and 10 people in the no mask
group got
coronairus I'm
wrong and I'll change my
mind right and and that's what really
believing in science means
So, you know, I'm no better than them.
If I start using inflammatory language
like face diaper to convince you of my
point, you're either convinced or you're
not.
Um, so I was going to take today and we
were going to look into the vaccines a
bit more.
There's a lot of co I don't Why is
vim no
syntax? Why does it look so terrible?
Um I I'll also talk briefly about uh
cancellation, right? Um these people
don't have any real power, right?
Um the these people may be able to get
you uh fired from your job if you work
for an intolerant employer or these
people may be able to get you kicked off
Twitter and Facebook, right? Um, there
are solutions to all these problems. The
solution to Twitter and Facebook is
don't have a Twitter and Facebook. I
don't. Um, the solution to people
getting fired from your job is, you
know, don't work for someone who's
intolerant, right? Uh, work for
yourself. You know, there's so many ways
to make money today on the internet. Um,
so many different ways to to to start
uh, you know, don't start a VC backed
company. Start a side hustle. Um, you
can make serious money and then when
anybody like tries to threaten your
livelihood, you can laugh in their
face. Um, by the way, uh, if I do get
banned from Twitch ever for speaking
truth, uh, come to my
Instagram. Um, there's no way there's no
way they could ever ban me from
Instagram. Look, I I only post like
really nice picture. I did make a
comment about 5G, though. Oh, man. When
the humor's gone, you know, when the
humor's gone, they're going to be like,
"He was serious. Ban him from
Instagram." Uh,
yeah. Um, no, but this is my Instagram.
Uh, if you don't follow me on Instagram,
make sure to follow me on Instagram. I
hear there's some exclusive clubs in LA
that you can only get into if you have a
lot of Instagram followers. So, you
know, I like to get in those clubs. So,
make sure to
uh I show for Slay Star Codex a lot. Um
uh well, if they don't allow mask
deniers, then I guess I guess I'm
fucked. I guess I'm fucked, boys. Can't
go to the exclusive club. But still,
make sure to follow me on Instagram. My
self-esteem goes up every time that
number goes
up.
Um oh, I also heard about Bitwave.
Uh let's look into
Bitwave. Um you know the uh h look I I
don't know anything about why
uh why uh Dr. Disrespect got banned. I
do like that phrase though. He was
disrespected you know and he was he was
disrespected actually to be honest.
That's like exactly right. I mean I
don't know. Look, I don't know, maybe it
is between Twitch and him, but for um to
allow a festering of you're going to be
held up to some standard that you're
completely unaware of. Uh and like to
even allow that belief to fester is
really toxic.
Um so yeah, uh how does their is all
their stuff open
source? I mean, I I think this is the
new wave for the internet.
um where we're going to have services
where the entire service is open source
and it's easy to stand up um a clone of
the service, right? And here's the
thing. People are always like, there was
talk on Hacker News yesterday about,
well, yeah, but then they can come for
your hosting provider. Yeah, but hosting
is a very fungeible good, right? A
Twitch is not. Twitch is there's one
Twitch, right? It doesn't matter if
you're being hosted on AWS, Azure, or
Google Cloud. And you could be like,
"Oh, well, those are the same three
companies and they have all the same,
you know, but there's a ton more." You
know, you you can go to OVH. Is OVH
still up? Used to buy a box from
OVH. Yeah. Right. You can go to OVH. You
can go to
Rackspace. And then if it really comes
down to AWS and Azure decide to to all
that's happening I think all that's
going to happen
um there's a small amount of people uh
like uh Alex Jones who if that was
really where it stopped I think nobody
would have a problem but if if these
these companies these companies only
have so much political capital and if
these companies
keep like burning their political
capital on stupid
fights, eventually all that's going to
happen is the internet's going to move
on from them. Um, you see it already. I
would say I watch maybe maybe 5% of the
videos I watch I watch on
Bitshoot.
Um, and some of them they have the
content on YouTube too. But like, okay,
how do we how do you support Bitshoot,
right? Because I want there to be an
alternative to YouTube. Um, it sucks
that when you go on the main page of
Bitshoot, all you get is all you get is
uh, you know, you get the same like
looking crap you see on YouTube. And
what we really want is websites that
have
better better algorithms designed to
promote well truth. Um, it's hard, but
um, I read this was on Hacker News this
morning as well.
uh
uh about the
uh this this woman uh resigned from the
New York Times. Um and I found it
interesting
um one of the things that that she calls
out uh Twitter is not on the mast head
of the New York Times but Twitter has
become its ultimate editor.
How much of this is due to the
idiosyncrasies of the of the Twitter
algorithm?
Um h how much of the dysfunction we've
seen in journalism and almost the
dysfunction we've seen in like those
kind of thought has to do with
Twitter. Um what do I think of peer
tube? What's pure tube?
Oh yeah, yeah, yeah. I I saw this. The
problem I have with with Pure Tube
is
like it's see the instances list, right?
It's it's so difficult to use. You have
to compete with the the tech companies
um based on I I saw and you know what?
I'll give a shout out. I hope he got it
back. Um, I saw this guy, uh, this was
also on Hacker News. Did he get it? Did
he get his GitHub
back? I hope he did. Um, yeah, it looks
like he deleted the the post about it.
Uh, this guy was talking about how he
got banned from GitHub. No, he's still
banned. Well, I don't even know if he
got banned. He just got his account
deleted from GitHub.
I'm going to post about
it just from me reading hacker
news. Yeah.
Um, so I use GitHub a lot, but recently
my account got suspended midnight
without any notice. For my knowledge, I
haven't spammed GitHub. And I I like
looked I looked at his Twitter. I'm
like, "Okay, is this guy like um, you
know, saying a lot of saying a lot of
terrible stuff or anything?" What? It
looks like a very generic like boring
like like like Twitter.
It's I I mean it's it's probably a bug.
Um it's probably a bug that he got
banned. But again, it's scary because I
think about how much stuff I have on
GitHub, right? So, you start looking
into GitLab. You start
um and GitLab is is is open source and I
can download it and I can host my own
instance. I think that's going to be a
big trend in the uh in the 2020s. Um but
yeah, well, it's not exactly going to be
a decentralized internet, but like
um I read something about the lifespan
of
companies and the lifespan of companies
was like 60 years a 100 years ago and
now it's 20
years. Uh that's lifespan on the S&P 500
companies. It lasts a lot longer than
that. People think that companies like
Google and Facebook and Amazon, which
owns Twitch, are going to be around
forever, and they're not. Um, there was
a whole, you know, who remembers Yahoo?
Who remembers Dig? Who remembers
MySpace? There was, there was a whole
crop of internet companies before these
internet companies. And there will be
another crop of internet companies after
these internet companies. And the
general trend is probably toward things
getting better.
Um, Google SEO for GitHub is GitLab is
poor. Um, that's ironic. It's it's it's
it's Oh, I guess I searched for GitHub
GitLab. I mean, I I I hope GitLab is
self-hosted. Is GitLab owned by
Microsoft? Oh, great. They're moving to
Google Cloud.
Um, I had I installed one of these back
in the day and I used to use it uh when
GitHub um when GitHub
uh their kurfuffle over the meritocracy
rug. I was like, why do I pay this
company money? But, you know, then I
thought about it and I'm like, this
isn't I I don't care. Uh who's providing
the best service? Um, but you know, I
mean, this is scary if if if I do see
more things like this happening more,
right? Because the problem is you can't
fix it. Uh, Accelerondo is a cool
uh Accelerondo is the one where um the
guy gets the girl pregnant, she sues for
child support, and he sues for copyright
infringement. That's That's
funny. Um, isn't Intel untouchable? Yo,
Intel is going to tank so hard. It's
going to tank so hard. The
u uh Winel is uh Winel is
over. Sourcehut.org. Yeah. What do we
got? What do we got? Let's do a open
internet round. Uh new new internet
roundup. Let's see what we got.
Sci-fi is cool. Chris Ladner works
there. I have no idea what the Intel me
stuff is. I don't know anything about
some DNS
vulnerability. Um, yeah, Intel
Um, Red Tube. Red tubes. Red Tube is a
porn site, right? I was about to go to
it and then I'm like, that's a porn
site. Yeah. Do win is an interesting
move. Um, actually, if you guys
remember, I gave a shout out to uh
Consume Product back in the day. Um,
Reddit Consume Product. Uh, you know, I
I think it's I think it there was some
there was some right-wingish stuff on
there, but at the most part, I think it
was memes making fun of consumerism. Um,
I mean, making fun of consumerism and
making fun of advertising is making fun
of Reddit's business model. Like, in a
way, I see banning consumed products.
And I think they've moved to a dot win.
Unfortunately, what happens with all of
these
um the votes is it's a Scott Alexander
thing. He says um you know when you do a
witch hunt right uh and all the witches
you know everyone and there's a mass
mass exodus on the platform I mean the
people who leave you get three civil
libertarians with their with their uh
commitment to free speech and you get 97
witches and is that really a platform
you want to be on
um I mean there is it's not to deny that
there is a certain amount of toxicity on
the internet a certain amount of you
know people who should be banned from um
these these these websites at least on
like the channel uh level, maybe not on
the platform level, right? You should
certainly be able to ban people from
commenting on your YouTube videos,
right? Because you'd be able to do that
on your own web page. Question is, can
YouTube ban a channel entirely? Um, and
I think that's a
question where what's going to end up
happening
is it's going to force kind of an a very
interesting as long as you really do
make sure to only force witches off of
your platform. It's fine. But, you know,
everyone gets caught up because witches
aren't going to create a good they're
not going to create a good platform
themselves. They're not.
Um, one way to tell one way to tell if
um if if uh a a community is is is is
full of witches is to see do they exist
by siphoning the energy from other
communities or are they happy existing
on their own? Um, and I think, you know,
uh I think the Donald.win is is the
biggest of the win websites.
Um, and you know, I've been to the
Donaldwin. They they seem just like are
the Donald. They seem quite happy in
their own in their own bubble, you know,
talking about how much they love Trump.
And
uh I mean they're not witches, right?
They're they're not they're not they're
not preying on others. They actually are
happy uh in their echo chamber, right?
and and those are the kind of people who
you shouldn't really ban from your
platform as long as they they they stay
like that. And I think Reddit's rules
against um you know uh invading other
subreddits are fine. I think Reddit can
I mean they are well and this gets into
the publisher versus uh are they
publishers or are they platforms? You
can't have the best of both
worlds. You know what I mean by witches.
Um there's a certain group of uh maybe
another word is like troll,
right? Right. There there's some people
on the internet who aren't interested in
creating anything. They're just
interested in in causing trouble. And
you know, do do you want them on your
platform? No.
Um, but when you start banning people
who are interested in creating
something, just the thing that they
create doesn't share your views, well,
that's when you're going to end up with
alternative
platforms.
Um, remember all the times they canceled
PewDiePie? Oh, wait. He's self-employed.
Uh, it's nice to see PewDiePie back on
YouTube. You guys know I like
PewDiePie.
Uh, what do I think about Urban?
Um, so yeah, Urban is founded by uh
founded by Curtis Yarvin. All right,
Curtis Yarin is is a very interesting
guy. He has a new um what is it? Gray
Mirror
Prince. Um, great mirror of the Nile
House
Prince.
Uh, this is this is an I read this blog
post. It's it's pretty interesting. This
is the urb guy.
Um, the urb guy when it comes to
political philosophy, he's a he's a
genius. um when it comes to applying
those same kind of when I when I look at
this when I look at and you look at Neo
reaction cannon in general it it
incorporates many postmodern ideas um my
understanding is is is look them up
uh you know, Curtis Yarvin went to went
to Brown
um born from a highly educated liberal
and secular family. So like he's he's
he's he's
um the the political philosophy reads as
very post-modernist and and the
postmodernists are are are they were
honest about this at least back in the
day when you they could all take it uh
you know there was there was a hint of
irony and and
uh the self selfacing humor in the whole
thing. It would create this esoteric
jargon. Uh and then like you know the
old saying about uh debating an idiot.
Um first the idiot brings you down to
their level and then beats you because
you're down at his level. That's his
playing field. The postmodernists kind
of did the same thing. They construct
all of this jargon um and then they'd uh
you know when you try to argue with them
well they'd use their jargon and they
they'd beat you. Um so in a way this is
an extension of of of of postmodernism
um which works great for political
theory. Oh I mean most most of our
interesting political theory today is is
is relatively postmodern. Um but it does
not work so great for building uh
software. So you go to um now is based
on
uh is written in its own language. I
think this stuff is still true. At least
last time I looked into it, it was it
was they created this VM called Knock
and then built this functional language
on top of it called Hoon. And they
created all of this language basically
all of these weird
um I don't I don't even know how do I
get to the how do I get to any hoon
code? Um maybe arvo is written in hoon.
Oh yeah of course mar. Yes. Oh mar. Oh
dill. Yes definitely dill. Oh yeah belt.
See and like ervo erit package. Arvo mar
dill belt. And then this is what the
language looks like. I mean, it's it's
it's practically an exercise in in in
esotericism,
right? Um, if we compare
instead here, there's open pilot. This
is the project that I've been working on
for the last uh I can't spell.
Sorry. Now to be fair
um some of this is to be blamed on
GitHub for not having great uh syntax
highlighting for hoon. But if we just go
like you know self-drive controls lib
longitudinal MPC lib MPC
pi like compare those
two the these are you know self drive
everyone knows what that means controls
okay you know you know what that means
lib is library longitudinal means gas
and brake NPC model predictive control
right what's an arvo what's a mo what's
a deal what's a belt and what's a wh um
it it's like brain fuck Yeah. Um so
while it makes for interesting political
philosophy,
um it it maybe does not make for the
best
uh way to build a new computing
stack. So I mean that is an interesting
idea uh in and of itself. Um the
obscurity
uh um is required, right? the the
obscurity is kind of like a it's a test.
It's a test and if you can filter
through the obscurity, you belong in the
community. Um it's an interesting idea.
So the the the saying that the um
esoteric stuff is uh another another uh
book that I read that I that I enjoyed
was uh is Bron Bronze Age Mindset. Um,
Bronze Age Mindset was the number one
selling uh like ancient history book for
a couple of
uh you you go through and the the first
um the first like half of the book, part
one of the book is is written in
this
like what if you've been misled about
what is life? They do this by showing
you true red marionette and shake them
in
front. Then you stay
mesmerized. Wait, sorry, my internet's
glitching. No, come
back. Sorry. Now I'm back. I'm back.
Don't worry, guys. I'm not banned. Not
banned, boys. I'm not
[Laughter]
banned. Um, but make sure right now to
go follow me on Instagram in case I do
get banned.
Um, I'm not banned. What am I saying?
You know, I'm
saying
what?
Oh, we're back. We're back. Sorry. My I
don't know. My internet's
glitchy. Oh.
No.
Okay. Um, when you read part one of this
book, like you had it in years before
Trump, the fat bald glutton of the right
put in a fighting ring against the Janet
Renos, the women with pickup trucks, the
thin lip trans new males of the left.
Um, you read this and it's kind of like,
okay, this is this is this is trash,
right? But in a way, part one, at least
the way I viewed it, was kind of like a
filter. Um, if you can make it through
this, you get to the the other stuff,
which I think says a lot of um, this is
bronze age pervert. I think once you get
to to to part three, and you can't just
skip to part three. There's a certain
like buildup and a it's a filter, and by
the time you get to part three, it's
saying, I think, some really deep truths
about human philosophy.
Um, you know, again, also another thing
that I know and maybe it does need to be
said in this era, just because I enjoyed
this book doesn't mean I agree with
everything in the book, right? I I read
I read Howard Zinn's A real history of
the United States, too. And I read that
book and I didn't agree with everything
in that book either.
Um, you know,
like one of the one of the one of the
saddest things to me that I see that I
see happening today is kind of a uh a
shrinking
of
well what uh oh it was one of the Lex
Freriedman one of the Lex Freriedman uh
podcasts. I forget who he was
interviewing but
um he he spoke about he spoke about
social networking uh in the way that it
just has likes in it's
a basically
um it's a brain with only
dopamine. Uh it's a brain with
only there's no there's no negative
feedback reinforcing connections.
there's only positive feedback and you
get well okay so what what are the
symptoms of a of a brain with excess
dopamine I mean so first off this is
what uh stimulants do this is what drugs
like aderall do I know you guys think
I'm on aderall all the time I'm really
not
um you get this kind of narrowminded
hyperfocus
um you know something you take aderall
and you think you're going to be really
productive and do work and you feel
really productive when you're doing work
and then you find out 6 hours later that
you've you've meticulously labeled every
MP3 in your uh in your iTunes with the
correct name and artist and year and you
think you've done something right. It's
this this hyperfocus. Um another thing
that excess dopamine is schizophrenia.
So when you look at the drugs for
schizophrenia, they're usually uh
they're usually dopamine antagonists.
That's I think. I don't know. We're
gonna we're going to get to the bio
eventually, I promise. Um, there are
some nice Twitter threads. Uh, I mean,
I've watched Naval over the years. Part
of the problem
is, oh
no,
no, my internet
sucks. My internet sucks.
Maybe if I put Wi-Fi on, it'll fall back
through the
Wi-Fi when
uh when it breaks. I I know. I'm
sorry. I'm
sorry. Look, I can't control the
internet,
guys. If you bring down quality video, I
don't think it's that. Like, my
computer's dropping out entirely.
Um, I think it might just
be I don't
know. But I got to go get some more
coffee. We're running out of coffee. Uh,
and then we're going to get down to get
down to
bio. Stop uploading your GitHub stuff,
though.
[Music]
[Music]
All right, I got some coffee. I also I
also have one more quick comment to make
on um cancel culture.
I mean, it's really just a form of cyber
bullying,
right? I think uh I think Tyler, the
creator, has it right.
Um, and I I think it's the kind of thing
where
uh where society can all can all learn
something from
that. Please lift it from the
desk. All right.
Why do we have
swaps? So, we were going to learn about
mRNA. No, no, no, no. We drink coffee.
There's no tea around here. We could go
get some tea, I guess. Should we get
tea?
I mean, yeah, if they killed themselves
due to online bullying, they they
clearly didn't uh listen to what Tyler
the Creator had to say.
[Music]
Social media is addictive for some
people. Uh I don't know. I don't have
data to back this up, but I feel like
more and more people are opting out of
it. Yeah, I remember Gopher from back in
the day. I don't know. I don't think
HTTP is the problem. I think HTTP is a
relatively neutral protocol.
Um, when the filtering membrane gets
wet, the filtering is
inhibited.
Uh, is this a Rick roll? Am I getting
rick rolled again?
Oh, see that thing, man. That's going to
protect you. I believe in that.
All right, stop shilling for Kanye,
man. You're just looking for things to
make you angry. This is not an angry
stream. Do I seem like an angry guy? I'm
not very angry. Pretty happy,
man. Yeah. Just when you see politics,
when you see anything that looks like
politics, just say
no. Just say no.
I um actually you know
uh that's basically the just say no to
politics is kind of is kind of the the
point of this post.
Um in a total state everyone and
everything is infused with power.
Everyone matters. Everything is
important. Everyone has to care.
Everyone wants to change the world.
Everyone must be engaged. Everyone is
pushing power forward or pushing back
against it. Everyone is either a
collaborator or a dissident. Power has
turned the whole country into a
political
cult.
Um but yeah, uh engagement is any
voluntary relationship with power to
assist or resist power. If you're if
you're with Trump, if you're part of the
resistance, if you're part of the the
the the the the trans movement, if
you're against the trans movement, if
you're whatever, whatever, whatever, it
doesn't
matter. You're
engaged. And what neither sides of the
movement will tell
you, the opposite of engagement is
detachment. To be detached is to be
consciously irrelevant, to inhabit the
world as it is, to know that it is
likely to continue on its current path
and to separate yourself from any action
or desire to change it. No one can
achieve perfect attachment, which is the
point of
trying. I like
it. Just don't engage, man. Just don't
engage.
But engage with science. Engage with
real science. And we're going to we're
going to we're going to try to focus up
and we're going to try to do real
science and we're going to learn about
what mRNA
uh vaccines are today. Use mRNA to
produce viral proteins. So my
understanding is mRNA is messenger RNAs
um messenger
RNAs encoding for a prefusion stabilized
form of the spike protein.
So are there any mRNA vaccines? I I
think one thing we can look at um is if
we want to talk about the likelihood of
a vaccine actually coming to market, we
should see if there are any vaccines
that look like it. Um, so I know for a
fact that DNA vaccines, I think the only
one was used in
horses to prevent West Nile
virus. Yeah. No DNA vaccines have been
approved for human use in the United
States. Uh, so let's let's just quote
that here.
which means I think it's unlikely that a
DNA vaccine is going to come to
market. Um, now let's look into these
viral vector vaccines which look like
they're using adina
[Music]
viruses are promising tools.
Huh, that's interesting. A disadvantage
is pre-existing immunity. So if you have
immunity to the viral vector I guess
uh what's
[Music]
ivormectin. Huh.
Oh, this is an interesting new idea. I
haven't seen this one
[Music]
yet. All right, it looks like was it
only checked in
[Music]
vitro? No, wait. In vitro. Yes, invivo
is inside the person. The FDA approved
drug Ivormectin. Let's see if there are
any ivormectin
studies of ivor.
Okay, let's see if it's a good study.
[Music]
mortality. Oh, by the way, it was kind
of also embarrassing that I couldn't
calculate a p value yesterday. So, we
should learn how to do that at some
point on this
stream.
Um, huh.
So it looks like that despite having 70%
more people they have the same number of
mortality p value of
0.3. Let's let's learn now how to uh how
to how to compute p
values. So I was kind of out of it
yesterday too. Feel good today.
P value is the probability of obtaining
test results as least as extreme. So I
think yeah okay so is the p value the p
value is the probability that those test
results are
random. The null hypothesis assumes okay
so this is this is
uh the null hypothesis says there's no
difference that it's all going to be
random basic concepts I feel like a noob
uh every
conjecture
unknown called a statistical hypothesis
if we state one
hypothesis so yeah we we we want to
figure out what's the probability of
the of the the null
hypothesis. Binomial coefficients. I've
seen this before.
using the chai squared
[Music]
test. Calculate p values. Oh, with
pictures. All right. That's the kind of
That's good for noobs like me, man. We
need noobs. I got
pictures.
Okay.
Determine your
experiments degrees of
freedom. Okay.
Um so I think what we want to say here
let's see if I can reproduce this
three going to do Python 3 this time. Uh
so what I would assuming that
Ivormect does
nothing we would expect to see the same
proportion of mortality in the control
group that we see in the ivormectin
group. So what we'd expect to see is
43.6
deaths. Um so E is the expected value
and O is the observed value which is 26
deaths.
Um I think I mean that's what a control
group is, right?
Uh, so is it just as simple
as wait
what? How did I do that line there? -10
* 2 is not
[Music]
100. I don't like these pictures. They
don't make sense.
Um, but no, there's a simpler way. TE
test. We also have to get the uh
standard
deviation. Oh, how did I remove the box?
There's a plugin for that. I don't like
being distracted by crap. I also, what I
would like to see is a uh is an ad block
add-on that lets me block all of the
recommendations and like all the
trending topics on Twitter.
Um, not really interested in any of that
crap. So, I think that thing that I had
yesterday, I think I now know what to
plug in for a lot of this.
[Music]
Um,
okay. P value. Here we go. Here we go.
which follows a t distribution with n
minus one
uh degrees of
freedom. What is
s? I don't know what that
is. Why is this so hard?
Okay, this is this is this is what I'm
looking for for the zcore. But what is
the standard
deviation? The standard deviation is the
square root of the sample
size. I mean it definitely relates to
the sample size, right? So you would
expect as the sample size grows, you'd
expect the deviation from the truth to
be to be
lower. Um the two in those pictures is
like it's like x squared. Oh, that's
supposed to be squared.
Oh well, I mean,
okay, that does explain it, right? - 10^
squar is 100. So, I mean, we can plug
that in and see if we get the right
value. So, O minus
E, but I don't think any of this is
really
right. Divided by E.
[Music]
Um try
squared. I don't like
this. We can we can just we can think
about this a bit. I mean we should be
able to actually just derive this. This
isn't like difficult math. Um we want to
know the probability density.
So we do need to figure out what the
standard deviation is. So how does the
standard deviation relate to the
population
size? I think that also has something to
do with the uh the control
likelihood. Uh the standard deviation is
is is this the square root of
the expected value.
Let's try this
one. Sorry, I'm a noob,
guys. Okay.
This is
cool.
Um, well, so I know what that
is. I don't know what this
is. So,
what's P? P1 and P2 are the sample
sizes, I imagine. What's what's just P
hat?
Oh, here we go. Okay. Okay. Good. Here.
Here. Here. Here. So, P1
hat
[Music]
equals I I mean I Okay, fine. I guess
it's two different. Uh I guess I'm I'm
wrong to do it. I was simplifying it. I
do kind of think I'd get the same
answer, but I might be wrong. So we take
the control group. The control group
we'll say is P1. The Ivormectin group
we'll say is
P2. Um and then P hat equals K1 + K2 /
N1 +
N2.
Okay. Um so it sounds like now I can
just plug it into this formula. So we
have P1 hat minus P2 hat
/ math. Square
root P hat time I could have just called
it P 1 minus P hat time parentheses 1
over N1 + 1 over N2 close parenthesis
close parenthesis.
Okay, we get 2.11 and this is a
zcore. Uh, so I know there's tables for
this zcore to p
value p value from zcore. Okay,
so I just did a two test two tail and
that's that rounded down or something.
It's a p value.
See, this this this this made sense.
Okay, the test statistic we calculate
the so wow but it's so confusing, right?
Like is this saying the p value is this
the p value that ivormectin has any
effect? Is this the p value that it has
a positive effect? They don't really
say p value is less
than. So the significance level here
doesn't actually matter in the
calculation. So the the zcore just maps
to a p value. And then we have to
determine whether it's a one tail or
two-tailed
hypothesis which I think is whether
the alternative
[Music]
hypothesis. Well, you need you need a
significance
level.
Um, yeah. I mean, you you can set your
your your threshold to anything, which
is kind of a stupid like I guess you
have to determine the threshold
beforehand.
Okay. Well, we know how to do P scores
now. This is this is the only good
one. Or if one is greater than another.
So, I I think that was uh
But I mean it's interesting that this
number matches the this this three
matches the two tail and not the one
tail. P1 is not equal to P2. So that's
the p value that the ivormectin does
something. But don't you want to say
it's the probability
that
wait oh wait a second. Why did it give
me a lower number for a one side
test? So, you're telling me it's it's
more
likely? How could it be more
likely that it's
[Music]
greater or less than not equal?
It's harder to reject the null
hypothesis with a two-sided
test. Oh, well, no. Okay, I guess that
makes sense,
right? Because this is this is a
question about the null
hypothesis, right? And you're just
trying you're just trying to rule
out. Yeah, it's it's it's it's easier to
rule out greater than it is to rule out
not
[Music]
equal.
Cool. Yeah. Yeah.
Yeah. Makes sense.
[Music]
univariat analysis.
I think they might have been doing what
I was doing with
[Music]
uh I mean the only thing you really want
to show is is the control group
different. So, I bet you can do that
with the stuff I was doing initially
with like just the uh population means
um with with with this just me just
trying to figure it out, man. like, you
know, I haven't done this stuff. I did
AP stats when I was in seventh grade. I
got a four on the
test.
Um, the danger shouldn't be wrong
information. I'm not here to teach
you. I'm here to get you thinking about
how to learn. And actually, I'm not even
really here to do that. I'm here
because, you know, what else am I doing
today, right? That's the real
truth. Streaming. We're learning
something. And now we know a little bit
more about statistics. And now we can
compute P values. And we can wield the
power of science to control the masses.
No, that's not true cuz I'm not a
politician. Use the power of science to
make me live forever. That's right.
[Music]
Um, I don't believe in the longevity
stats. We're having fun with statistics,
boys.
I should really sit down and derive this
stuff. I bet if I sat down and derived
it, I would like really get
it. Uh, you can
like I mean what you're basically trying
to say is like what are the odds that
these two samples come from the same
distribution? We need coding today. What
do you guys want to
code? What do you all want to code?
We coded today. Look, we wrote some
Python. We imported
math. Simulations. We were going to code
some simulations to make fun of masks,
but uh I don't think we're going to do
that anymore.
code this. What is this? Is this
hateful? All right. I have I have
bandwidth
again. Yeah, I don't know. I don't
really know what's going on. Might be
the driver.
It comes
back. Uh yeah, remember my San Diego
apartment? We had good uh we had good
internet
there. That was a good internet, boys.
That was a good internet.
P value is the probability of obtaining
a test statistic at least as extreme
that the one was actually observed
assuming the null hypothesis is true.
Yes.
So
right ba basically yeah you're asking
the question
of if there's no difference between the
two distributions what are the odds that
I would observe what I observed
that is some of them will fall below the
significance threshold just by chance. I
mean so if you have a drug that does
nothing um one way to scan the
scientific method is to commission 20
studies right and then one of them is
going to randomly show an
effect if if your if your threshold is
5%.
Don't become a douchebag like Martin
Skrey. I don't know. I never watch the
guy's live
streams.
[Music]
Um we're going to learn about
how So I don't think these are real yet.
[Music]
by many of the
positive. So I think these whole virus
vaccines are are live attenuated
There are no viral vector vaccines
currently on the market for
humans. Yeah. So, these are things that
are not going to work.
[Music]
This new ship, boys. Came out
[Music]
yesterday. I like charts. I I look at
the
pictures, figures and media. Yeah,
pictures. Good. This is how I understand
studies with pictures. I'm a picture
guy. These are complicated
pictures. Bye.
If someone suggests something
good to uh to to code, we can do some
coding. But you got to suggest something
good. Otherwise, we're not doing the
coding depth
estimation. Uh, I was playing a little
with uh
transformers. Oh, no, I forgot.
I was finally trying to understand
Transformers. You
know, that's not fun. Like, this is not
going to be fun. You
know, my transformer code. I'll commit
it when I'm done with that. We're not
doing that on
stream. We're trying to figure out the
likelihood of any vaccines actually
showing up anytime
soon. So, viral vector and DNA vaccines
not showing up anytime soon. Let's see
here. any mRNA
vaccines.
Yep. Yep.
Not
real. I mean, it's going to be actually
very interesting if one of these ends up
working for Corona
virus.
Um, we might see a whole revolution in
vaccines. Like, we've never seen any
vaccines of these types before. I have
an idea like a DNA vaccine once you get
it to to work correctly
uh you can use that DNA vaccine system
for for immunity against like HIV herpes
whole list of
things. What's India's scam core score?
Do the NIPS 2020 challenge. What do we
got?
Find the best blackbox optimizer for
machine
learning. Well, this is interesting.
[Music]
I mean, it doesn't sound like something
I can do on the stream,
but so I mean there there's an
interesting theory about whether
blackbox optimization is possible.
Like shouldn't it not be if you don't
make any
assumption about the underlying I if you
can't make any assumptions about the
underlying
uh distribution then don't you have like
no free lunch and blackbox
optimization's
impossible? like they're they're making
assumptions, you know, and I've heard
people use this to defend the fact that
machine learning doesn't work. And this
obviously isn't true because all the
stuff that people are doing machine
learning on is sampled from a a
compressive distribution, meaning that
the distributions can compress. But if
these things are being done on
non-compressive distributions, like for
example, say you were trying to build a
blackbox optimizer to guess at values of
Shaw 1, right? Like you'd never get it
even though Shaw 1's a relatively short
program.
[Music]
was a surrogate model of a Gaussian
process for an objective function that
provides a measure of
uncertainty. Though to be fair, if you
were doing SH, you'd at least know about
the
uncertainty. Huh?
Yeah, the Madna one I I don't think
we've seen. So, this is this is the
clinical trial that we're talking
about. Oh, this is phase one. This isn't
Did we get the results on this?
They just didn't post those.
Oh, to find better acquisition
functions. Um, let's look into these
proteinbased vaccines.
[Music]
Not enough chrome.
[Music]
[Music]
Do these work? Are there any in
use? This is pretty good.
So, I'm operating under the hypothesis
that if a vaccine's never been brought
to market of any kind,
um, oh yeah, whole virus vaccines, are
these inactivated or are they live
attenuated? Well, I mean, what does it
mean to kill a virus?
So I mean I guess yeah I guess
proteinbased vaccines are just subunit
vaccines and these whole virus vaccines
are
uh you can have two types. There's
[Applause]
inactivated versus live attenuated.
[Music]
Huh. It's a cute
idea. So, okay. DNA plasmid. Yeah. So,
these DNA vaccines are DNA plasmid. Um,
but I guess DNA plasmid and mRNA fall
under this.
I mean, I guess in a way these these
viral vector DNA and mRNA are all the
same. They're nucleic acid vaccines
um versus whole virus and plant-based.
And I don't really know. Somebody
yesterday was shilling for nano particle
vaccines.
I mean I guess this is a new kind. So
these nano particles elicit the same
antibodies as the
real as the real vaccine.
Um, yeah, someone said they gave
plasma, by the way, to get around their
stupid pay walls. I I can't stand like
the the full screen popups on all the
websites on the internet. Uh, you know,
I just have no script up here. just turn
no script
on. Um, you know, like you kind of have
two choices. Either charge for your
content or don't charge for your
content. Don't don't don't
like don't make your business model
annoying. This is almost This was the
Spotify ad business model. So, there's
two kind of ad business models. I I
always joke about doing it with comma.
It's
like instead of making ads for a
product, just make an ad that is
annoying to listen to. Like now you're
gonna hear a loud screeching
noise. Don't want to hear that
screeching noise anymore? Sign up for
Spotify Premium.
[Music]
cool paper
on fast similarity
search. No, I mean the the the joke
business model for comma is we're only
going to activate the the self
self-driving is going to deactivate and
then we're only going to allow you to
use it again if the system detects that
you've gone through a Taco Bell
drive-thru.
Spreading vectors for similarity
search
train. What does it
do? I don't get what it does. Why do
people do people like this paper?
[Music]
What are the data sets it was tested
on? Never heard of any of this
stuff. PQ optimized product
quantization. What can I do with
it? Oh god, why do I hide in the PDF? It
ruins my
clicking. Finding nearest neighbors on
one trillion vectors. Oh, that's
cute. I mean, so how do you do that
normally, right? Um, yeah, I guess
there's not an obvious way. You use some
hashing function, some like locality
sensitive hashing function.
favors uniformity in the spherical
latent space. Um but I guess the
locality sensitive hashing function you
have the problem of
um yeah multiple things are going to end
up in the same
bucket. Incode the input space into a
code. All right. All right. All right.
All right. This is cute. You're
spreading vectors. That's a better way
to describe
it. Oh, it's in the
title. All right. I guess I didn't
understand what spreading vectors meant.
Spreading vectors for similarity search.
Okay. The vectors like spread themselves
out. All right. All right. That's cute.
That's cute.
What's
this? All right. So, how do you do that?
What what what how do you train a
function that forces spreading?
every word in the at least 10 words. I
agree with
that. Um, but let's let's let's let's
pop off the stack here. That's
um
none are currently
used. All right. So, I'm bearish on
nucleic acid vaccines.
Um, let's look into the legitimacy of I
mean protein and whole virus is how all
things work, but I feel like if that
stuff worked, it would also work for
colds. Like this is I mean this is a
classic this you could talk about this
in hacking too. It's like in order to
solve this problem is this just an
existing application of old techniques
or do we require the use of new
techniques?
Okay, I think there are protein vaccines
in use and it does seem like there's a
lot of them.
You always see this with Chinese
companies. They have names like
Anwi, Shif, Longcom. It's so long. Ano
is a region. I think I've been to Anway.
Yeah. Yeah. Yeah. I rode through there.
I did I did a bike trip from Wuhan to
Shanghai. How to spread vectors? Well,
spreading vectors would mean that if you
sample
um if you take a vector and then you
take the distance to its nest neighbors
in some space like no matter which point
you sample, you'd get the same distance
to all the nearest neighbors. All right,
are we done looking at vaccines?
Anything else we should know about
[Music]
vaccines? Train a network that maps
inputs to a spherical lattice. Well,
actually, is the lattice is it on the
surface of the
[Music]
sphere? And I guess yeah, the surface of
the sphere would definitely
uh would definitely meet those
requirements.
I did a bike trip through China. Well,
my dad doesn't inhale a lot of
crap. Didn't your president have a cure
for COVID?
[Music]
B. Inflammatory bullshit.
What the hell is
this? Best way to combat Corona virus is
to agree on norms to create safe spaces
for family and
groups. Why am I clicking that? Come
click it.
Yeah, this is pop science
crap.
Um, it's so sad. It's so sad that his
blog is gone. Oh, his APA photo essay is
hilarious. If you find that on archive,
he talks about how the wokeness the
wokeness
uh infection has has has has
metastasized in the
APA.
Um you know when I was talking about how
if a mask prevents 40% of particles, it
doesn't prevent 40% of corona virus. The
analogy that I used was um if if you
have if uh you know 10,000 people enter
your country with the virus, you're
going to get an epidemic. But if 6,000
people enter the country with the virus,
you're also very likely to get an
epidemic. It's not 40% less likely
because it's 4,000 less
people. Um suppressing the cytoine
storm, we went over this yesterday. It
seems like dexamethasone does some job
of that in late corona virus. Uh,
steroids are
uh, give Spotify annoy. Wait, is it a
real thing? I was kind of joking about
the Spotify
ads. It doesn't even have to do with the
Spotify
ads. It's a nearest neighbor library. I
mean, it would make sense that Spotify
wants that.
How do you train this
network? Oh man. Oh yeah, that's really
cute. Take a look.
Like you can think about it like that, I
guess, right? You'd have to encode it as
a function because if there's trillions,
you can't actually move it. You can
sample and you can say okay what's
my
Yeah, the VAE is one of my favorite
um that that you can have a a loss in
bits and you can control a bottleneck
and make that
bottleneckformational. And uh you can do
this without you can do this with floats
but you just you know have it specify a
uh a mean and standard deviation. You
got to pay for information right? You
have a mean and standard deviation mean
and standard deviation. You can know how
many bits that
uh that is
encoded. Um like if you want to get
something really precise you put a tight
standard deviation. If you don't really
care you put a wide standard
deviation. Uh, I don't know. But I'm
good at discrete math, boys. I'm not
good at I'm not good at nondiscreet
math. So, it's hard for me to think
about. I like thinking about like, you
know, Yeah. discreet
things. Yeah. There was never Oh, I've
been watching I've been watching three
blue, one brown videos though. I watched
his video on divergence and curl and
like uh even his videos on what like I
values and I vectors are and you're like
damn I wish I had this in high school.
It really was. It was just confusing.
Multivariable calculus was
confusing. Remesae seems to have a
positive effect. Um, hydrochloricquin
alone alone does not. Uh, but we're
still waiting on HQ plus zinc studies.
Um and dexamethasone only seems to have
a positive effect in endstage
coronairus. So that was my that was
my conclusion after researching
therapeutics yesterday. Um my conclusion
after researching mask yesterday was
there is I will say confidently there is
no strong evidence to support the use of
masks
masks.
Um and I'm I'm yet to I'm yet to see
otherwise. And then again, that was like
I guess what I was doing. And I hated,
you know, like I said, I apologized at
the beginning of my stream for referring
to these masks as face diapers because
I'm realizing that I'm just using the
same propaganda techniques. Just, you
know, to to make the other point. And if
you have to use propaganda techniques,
you're a loser. Um, and you know me
yesterday, I was being a loser, right?
You know, fundamental attribution error.
I'm not fundamentally a loser, but I was
being a loser. And always give other
people that benefit of the doubt, too.
Um,
so yeah, we didn't find strong evidence
of masks. And I feel there's not strong
evidence for something, you shouldn't
mandate it. But that's a political
statement. That's not a scientific
statement. Um, and vaccines. What we
found largely
was a lot of vaccines fall under this
under this umbrella of nucleic acid
vaccines. Whether you're using mRNAs and
using the body's transcription
mechanisms to create the proteins, DNA,
which uses the body's both translation
from DNA to RNA and transcription to
create the proteins. I'm getting that
right. Right. Translation is DNA to RNA.
Transcription is RNA to protein. Let's
double check that. I don't want to
spread any fake
news. Central dogma of molecular
biology. All right. Yeah. Transcription.
Yeah. God, because obviously reverse
transcriptise turns RNA back into DNA,
so it's not called reverse translace. I
don't think there's anything that turns
proteins back into RNA.
Um, yeah. No mask in Sweden, right? They
believe in science. See? No. See, I did
it. Look, I'm just I just can't help I
can't help with the digs, man. Can't
help with the digs. Stop doing it. Stop
doing it. Yeah. There we go. Good boy.
All right. Let's play. Let's play. All
right. Um Oh, yeah. By the way, I got a
shell for I got a shell for for
subscribing. Oh, yeah. P100 masks. Yeah,
I have no doubt I have no doubt that a
P100 mask is avail is is is useful.
Um if something if something present
prevents
99.97 percent of viral particles I
believe
uh
Vulkar AI I have some bad news for you
Theodine. He's a better person than you
because he's a subscriber.
What do you mean? Do I think there'll be
a second wave? See, this is all a myth,
right? This is all a myth because people
are, you know, the United States is a
country with twice the land mass of the
EU, yet it's viewed as one thing. This
is what it looks like in New York. All
right. This is what it looks like in
California. Second wave. Where's my
second wave? Do you call that a second
wave? because it wasn't in California
and then it showed up in California and
it was in New York and then it largely
went away, right? I don't know. I mean,
okay, to be fair, when you look at
states like Illinois, you see like a
small second wave, but they had it
pretty bad in the
beginning. Like Australia got a second
wave. Where is
Australia? Like 20 people get it in
Australia.
Okay. Wow. Australia actually did get a
second
wave. Philippines is interesting. No
deaths. Yeah. You know what? I heard a
quote once from
um Akmad about how Iran doesn't have gay
people and that's how I feel about the
Philippines having no deaths from Corona
[Music]
virus. Wait, the Philippines does not
have no debts. The Philippines has 1,614
deaths. Um, spay numbers are kind of
sketchy. I don't know.
But yeah, the the the median age of a
COVID death, I believe, is
80. It's just
wild. People's living forever, man.
Um and Vietnam has no doubts what the
communism scared it away.
There's malware in in my corona virus
map from
ArcGIS. What is
ArcGIS? It's just this. I don't
know. I think there's
malware. Where's this malware hiding?
I don't know about
that. Co medium death median death age
was above the average lifespan. That's
crazy.
All right, I do have a phone call today.
Um, you guys know I I sell uh
Spam.
Spam. So much spam. Okay, my phone
call's not for a
[Music]
while. All
right. Do we want to do we want to try
out spreading vectors?
I don't know what what else can we do on
Corona virus? What these these this is
the last of the Corona virus streams. I
mean, I I feel
like like there's not that People always
say, "Oh, there's more to know. There's
more to know. There's more to know."
Nothing Nothing that I've come across is
very surprising.
Um, I mean, I feel bad turning the
stream off. We got We got 725 people
here. We We got We got We got We got a
crowd. So, you know, we keep it keep it
up. Um, mutation
G14. The economics of Corona virus.
What? Big Corona's cashing
out more FaceTime groceries today. I
mean, it is funny, right? It's the
problem. See, you know what? Maybe
that's maybe that's my rule of thumb on
propaganda. If you're going to make
propaganda, at least make it funny,
please. I've been reading Matt Taibbe
has a has an interesting stub stack.
He's like, "Another week in the all
stick, no carrot revolution.
found that a variant of the spike
protein rapidly became
dominant around the world. Phenotype
that's like
expressed. Yeah. Observable
characteristics.
Um so in general viruses evolve to be
less in less trans less deadly sorry
um because the less deadly versions
spread
more amino acid change in the virus
spike protein
uh emerged early during the pandemic and
viruses containing G14 are now dominant
in many places in the
world. It's more infectious than D614.
not the receptor binding domain but in
the
interface and remember the spike protein
I think is like a a trimer
This paper is
junk. I mean, to be fair, at least they
tell you in the title that it's
junk. What was my final opinion on Muse?
Mero never worked, and I don't really
know why.
I probably have a
bug. Um, genomewide association study of
susceptibility to coronairus. Let's
check this
out. Free
Coachella. I'll get behind free stuff.
[Music]
Um, yeah, I heard about this
[Music]
[Music]
This is pretty good. Did they do full
genome
sequencing? For genotyping, we use the
global screening array version
2.0. So, does that does that only get
some of them? What what are these
things? Population scale genetics
variant screening.
Uh, well, I guess it's it's 2.0. Oh,
these things are
cool. All right. So, these are like the
genes that they had access to.
[Music]
Yeah, the wastewater analysis is an
interesting idea, too. All right, they
found some stuff on three and some stuff
on
nine. So cool, man. So cool.
Is
this I guess I don't exactly
understand
what for
genotyping. What is
genotyping? Oh, I guess here we go.
Supplementary appendix one.
Oh.
Lot of names.
H I like this study.
[Music]
I mean this is this is overall a very
promising I think research direction for
medicine. We can start using big data on
genetics and we can start you know you
can take any group and say okay which
genes have an effect on that group and
then we can predict all these things
about
[Music]
people. This is the right way by the way
I think to do like
biology right it
doesn't it doesn't make any assumptions
about how it works it doesn't need a
model. It just straight up says look
this gene is found to be correlated to
this event or event is like the generic
statistics term but this this
uh you know thing and then you can say
like okay if I get coronairus is it
going to be bad you can know that and
you don't even have to do a new test for
it you already have your whole DNA
sequence you just plugged it in I want
to get my DNA sequenced you know what
um whole
genome DNA sequence. I'm going to do it.
I'm going to I'm going to do it. I'm
going to post my DNA on
GitHub.
Uh
who's who's causing trouble? Is people
causing
trouble? Well, yeah. No, so that was my
actually that was why I didn't I think I
told you guys this. That was why I
didn't uh I was offered free 23 and me
uh when
um I worked at Google and I asked 23 and
me if they were going to report my DNA
to the police if I'm ever implicated in
a crime and they said yes. And you know
I didn't want to close down I didn't
know I was 18. I mean maybe I wanted to
be a serial killer when I grew up. You
know, I didn't know. I didn't want to
close any career
paths. I have heard about project
evidence and I looked at this. Um, I
mean, I'm already predisposed to believe
this.
Uh, I I'm already predisposed to believe
that that the virus did come from a lab
in China for a few reasons. Um, one,
there were three outbreaks of SARS and
two of them were
um, lab
escapes. Two, there was a ton of bats
being brought from all over China into
this one lab. Uh, three, the bats don't
exist in Wuhan. They exist in southern
China.
Um, now just saying it came from a lab
does not mean at all that it was
engineered. I don't believe that it was
engineered at all. I actually don't
think humanity has the capability uh to
engineer, but I don't really think this
is a conspiracy. I think this is fairly
true.
Um, you
know, to be
honest, this stuff, see, it looks a
little conspiracy theoryish, but I'm not
even sure anyone really
knows. Oh, you use Dante
Labs? I don't think it's that
interesting either way, you know. I I
don't I don't I don't blame
China.
Um get access to your full genomic
data 30x whole genome sequencing. Can we
get like some reviews on
this? Yeah.
Uh is there any harm? I'll post my DNA
on GitHub.
Is 23 and me doing full genome
sequencing or is this an option? Because
what I don't I I want the whole genome.
I don't just want whatever they think is
uh yeah raw uninterpreted genetic data
file but I'm not sure what the service
is. I don't think it's whole genome
sequencing. Nebula is leveraging the
power of blockchain technology.
Dante Labs took an Amazon approach,
meaning you used Dante Labs and it was
good.
I mean, I I'll You can have an MIP
license to my DNA.
Enjoy. I don't
care. This guy didn't put a license on
it. I'm going to post I'm going to post
my DNA on
GitHub. Maybe that sounds
fun.
Um, all right. So, how does this test
work? Yeah.
All right, I'm sold.
$600. Uh, what do I have to do? Do I
have to spit a saliva collection kit?
Oh, that's
sick. Um, what do you mean all failed
the twin
test? No. Well, then I could know. I
mean, I could I could read a paper. All
right. No virus conspiracy now. It
doesn't really matter that
much. Um, but I can now
look like I can say, do I have this
thing? We can look on GitHub at it. You
can all look on GitHub. You can
all I'm going to take my DNA. I'm going
to sequence it. I'm going to post it on
GitHub. MIT license for all of
you cuz that's the kind of guy I am. I
believe in the people. If if you want my
beard, you could get my beard. Just take
the DNA. Um, you can clone me. You're
welcome to do whatever you want with the
DNA. MIT license, boys. MIT license. MIT
license. What do y'all think? What do
you think? All right. Um, yeah. I'm
going to buy one of these. I can't buy
it on stream because then you'll see my
credit card.
You know
what? So, I have a phone call scheduled
later today. We don't talk about Kami on
this stream, but I will show you. Um,
somebody bought a uh meeting with Kama.
Uh, so you can buy meetings with KA if
you want if you want a 30-minute phone
call with me. It's $1,000. Um, so
someone bought one of these and I have a
call later today. So, I think Kama is
gonna buy me my whole genome sequencing
test in exchange for me doing my
thousand dollar phone
call. Uh, yeah,
buddy. Oh, enter an email address and
spin the wheel for a chance to win. Wow,
a popup. This makes me hate this
website. It makes me want to go with
someone
else. Oh. Oh. Oh, it's so close. Oh,
it's so close. Oh, 10% off. Oh, look at
that. Your discount code is 10 off.
[Music]
Perfect. 50. Yeah.
You want to
try? You You want to try the other
discount codes? What do we got? All
right. 50
off.
Huh? Oh, 20 off.
[Music]
Yo, does anyone else believe that that
shit just
[Music]
worked? Yeah, I love saving money, boys.
I love saving money. Oh, okay. All
right. All right. We won't get greedy.
We won't get
greedy. I tried 30. 30 doesn't work.
Let's not get greedy. Wait, can I use
both
though? Oh, no. You can only use one.
All right, we'll we'll we'll we'll we'll
be happy with 20. Get your whole DNA
sequence. Use discount code 20
off. 2020 hacking,
boys. We're all having a good time here.
We're all having a good time. All right,
I'm going to go get some tea. I'll be
right back. I'm going to go get some tea
and then we're going to get back to some
hacking. Yeah.
All
right.
Ow. Pure leaf brood tea.
No, no, no. I I regreted diaper face.
Trust me, if anybody ever told me to
apologize for anything, I would laugh in
their face and double down.
But you
know, sometime you just realize that
what you're doing makes you a bad person
and you stop doing it.
Oh, what's up, North
Park Professor Bob? What would happen if
they found my DNA at a crime scene? You
know how I'm going to solve that
problem? Don't do crime. Crime doesn't
pay. All right, let's see what I get
from Dante
Labs. Do I get like a file? I mean, did
somebody
here DNA analysis apps? Oh, this is so
[Music]
[Laughter]
[Applause]
exciting. Oh my god. Wait, look at this
scam. You get the scam, right? You have
your DNA. Now I can sell you an app on
my DNA app
store. You want to know if you're going
to get Corona
virus? Buy the COVID 19 severe outcomes.
Find out if you're a genetic risk for
one of the most feared outcomes of COVID
19. Man, I could scam so many people
with this crap.
[Music]
It's like, you
know, your genome sequencing database
files are going to be massive.
Downloading a 30 gigabyte file can
sometimes overwhelming your local
computer. Biology people talk about
computers. It's
funny
sequencing.com. How do we enhance your
genome data? Learn more about enhancing
your genome.
I mean, this is this is a cute idea.
[Music]
anyone posted on GitHub
yet? This is like
some DNA kit studio, eh?
Wow. You can now download things that
look like like crappy like I'm waiting
for like the DNA key gen that plays the
music, you
know.
Um I'm bearish mostly on
neutropics.
Uh I'm sure I have some have some pro.
Yeah, I got pass. I was into it at one
point in my
childhood.
Um, preset shows some effects in some
studies. I found it kind of gave me a
headache.
Uh, best
neutropic pure leaf tea. And I'm not
getting paid by the pure leaf to say it.
[Laughter]
I love YouTube comments.
[Music]
[Music]
All right. This kind of makes me want to
code. All right. What What good
challenges do we got? Do we got any
challenges? Programming challenges.
[Music]
Pentestama.
And the serial scene is really an
underground music scene. So true, man.
Yo, I'd go to a show. I'd go to a show
with this shit, especially if it's
during Corona virus and it's like some
like underground speak easyy shit.
What's the DNS CV you want? Let's see
what it is.
Oh, it's Windows.
[Music]
[Music]
not doing
[Music]
windows. All right. Should should we
[Music]
try Windows DNS
servers? Um, all right. There used to be
a website for I I don't have window. Do
I have a window? What do I got in my
virtual
box? Sure. I got a
Linux. Do I really want to do this? No,
I kind of
don't. Where' my music
go? Sorry, my it's
glitchy. New Windows 10 VM free from
Microsoft. 20 gigs. How much gigs do I
have? Will this overwhelm my
computer? What is overlays? That's
weird. I just searched for key gen
music. Checkpoint research has an
exploit
[Music]
plan. Sig red.
Wow. They they really try to uh to sell
their vulnerabilities these days. See,
this is when the whole scene became
lame, you
know? Like, it's just like it's like
like market. It's marketing
bullshit. Oh, the stream's laggy because
I'm downloading Windows. Sorry, we can't
download
Windows. Net Tetris is
[Music]
cool.
Uh God, I look at this stuff now. I'm
too old for
this like
like I am kind of too old. Like this
isn't what do I get? You know what do
you get if you do this stuff?
Like all I have to what do I have to do?
I have to like
like market it. Sig red. This is not
just another
vulnerability. You know when marketing
terms say stuff like that, it is right.
Like I promise you if if if underneath a
Toyota Yurus they could write this is
not just another car. But but that's
exactly what it
is. Interesting to make an open source
version of what three words. What is
what? Three
words. Oh, I
say
h. I mean, the problem is whatever
coding function they're using, you want
it to be generic. Do you want to like
look at what Oh, so you're saying you
want like an open- source
implementation? Let's see how it works.
I mean, is it in JavaScript or is it
making network
requests? It's making network
requests. But
actually, the network request that it's
making includes the words
How does it include the words if that's
the
request? What does this even respond
with? So like I
scroll but then it says convert to words
move sand mash.
So you're saying the hash function is
not
[Music]
if it'll
grify. Would I have been able to start
com without my hacking credit? Of
course. Listen, VCs are really easy to
get money from if you just know how to
talk, right? Would I be able to do it
without my skills? No, you need skills.
You don't need
cred. It's like it's just about it's
about a way to talk.
What's
this copper mask? Yeah, I know some
people who shell for copper. I don't
know. I don't know the truth about
copper. Make a
list. Make a list is a closer closure
inspired lisp interpreter.
Oh, is there is there a uh is this proof
of concept for the
Oh, that's not
sketchy. Curl from an HTTP URL pipe to
bash.
Yeah, I don't I would I wouldn't want
to build your own Game Boy emulator.
We'll be here all
day. Programming takes so long. You
know, you know, the whole point of
backspace was to make programming not
take so long. Like backspace kind of
doesn't
work and it's
upsetting.
Um, teach C. What do y'all want to learn
about
C? What do you all want to
learn? All right. Get a noob from chat
and teach him to program. All right. Who
wants to learn how to program? Is there
a good screen sharing
site? Uh, not screen sharing, but I want
like collaborative editor. What What do
they use? What's the good
[Music]
one? Create a new document. Enter your
name.
Bob. All right. Who wants to learn how
to program? Oh, Replet's better. I like
Replet.
We're going to code and see create
rapple. All right, you're a sub here.
Here.
Congratulations. I'm going to DM you a
link. Uh, how do I share? Where's my
share link? Obviously, I need to do this
privately over
here. Where's the share?
Is there a
share yet?
[Music]
[Music]
Just copy and paste the ripple link to
share. Wait, that's sketchy. Does that
just
work? I mean, we'll try
it.
Oh. Oh, I tried to edit it and it forked
it.
Never mind. This doesn't work. You got a
collab
edit. Oh, I don't know. But I
think just try
this Vim diesel.
What should we play? Who wants to play
Baba as
you? No, it's on this screen.
No, no, we can't play Baba because it's
on this screen. But I recommend Baba
Youu. It's a great game.
Oh my god, we really can't get a
uh Okay, we have a code
share. Please don't block our ads.
Hello. All
right, let's Can I change the language
of
this?
Let's code merge sort in C.
Can you do
Can reset the language so we can get
some syntax
highlight. All right, boys. Can we all
work together? Decode, merge, sort, and
see.
[Music]
No, come on. Don't write hello. You can
type in there and you can come on. Oh,
someone said some Oh, we got some syntax
up in here. All right, let's
go. Stop typing dumb shit if you're
going to be dumb. This is this is an
exercise in whether all people can be
nice and work together to write merge
sort and if we can't be nice all faith
in humanity is
lost nano version
Control. This reads like hypy
shit. Okay. Can we Can we code? Come on.
Fill in the Let's see if Twitch chat can
pass a coding
interview. Nope. Nope. You're fired.
You're fired.
The guy who returned the sorted list.
No. No.
Fired. All right. We'll share the link
again. But if you guys can't can't
cooperate and be
nice. All right, we're going to delete
this crap. Let's code merge
sort. Who remembers how to code merge
sort? We crash code share. We do code
share. Do we have to write our own? Is
this going to be like voice app? By the
way, if everyone doesn't remember
nonchalant
volcano
surge.sh Yes, if everyone remembers
voice
app, should we write our own code
sharing app? All right, we can write
merge
sort all. All right, I I So, first we
want to say length over
two. Um, P equals length over
two. Uh, and now we want to recursively
call merge
sort. I don't think you can do this in
place. I think we're going to have to
make copies.
a ar r p and then we say merge sort a ar
a r r + p comma len minus
p. Um, if len= 1,
uh, return,
uh, if len=
2 if a ar r r sub0 greater than a ar r r
sub 1, we want to switch them places.
Oh, someone started to code. This
website
sucks. Well, we'll do it. We'll do it
over in Vim. We'll do merge sort coding.
Merge sort
one=
0 r 0als t. There's like cute ways to
write that with like xords and stuff,
but I forget what they
are. Okay. Well, didn't s anything yet.
Um, well, we didn't write the merge. We
also have to obviously write the
merge. Can you do a merge sort in
[Music]
place? I'm not sure you can.
[Music]
So, we can make
copies. Let's say, do we have to make
copies? It's like like people think, oh,
it's so easy to just like write this
stuff, but like it's not. You got to
think about it a little bit.
Um, so we want to do a merge. We're
going to, I think, have to do the merge
into a new array.
So let's say int equals
malo size of int time len
um and then we want to do the merge into
here. So we have poin
01=
[Music]
02 equals z. They give you 10 they give
you 10 minutes to code merge sort. Well
then you haven't memorized and you
haven't had to think about it. You
didn't learn
anything. Um I less than
len. Uh okay. So let's have two array
pointers. Um a r1. I think actually I
might just need two array
pointers. We have our pivot. We're going
to recursively call merge sort. If star
a ar r1 is less than star a ar a ar a ar
a ar a ar a ar a ar a ar a ar a ar r r r
r r r r r r r r r r r r r r r r
r2 is greater than and we want to
um actually why don't I delete the out
stuff too. We need that as well.
Uh so
if
while write a fuzzer for RL with the
mutation. Okay. So we want to take the
two
arrays and we want to merge them uh down
into one array.
It's a little bit annoying because we're
going to have to
check the end.
Um, we're going to have to make sure we
don't run off the end.
So the basic check is if a ar r1 is less
than a ar r2
uh t equals a ar a r r1 a ar r1
++ we' say less than or equal
to
else a r2 a
r2+
if a r1 is less less
than it doesn't really work.
R2 is less than a R r +
len
one. That's when both of them are still
valid.
Um only a ar r1 is valid then we do
this and if only a
arr 2 is
valid then we do this
uh else break
um mem copy a ar rt
t size of in comma len free
t. All right. All
zeros.
What? Whoa. Merge sorts actually
declared instead
li is invalid. Oh, can't call it merge
sort. We'll have to call it my merge
sort.
Okay, we're getting all
zeros. Um, so let's just
debug this.
This. All right, that all seems
[Music]
okay.
Oh, we didn't do T++.
[Music]
H. Now it
[Music]
breaks. Well, like I don't see how this
can overflow T.
I guess we can always just say here
while
uh oh because we're we're changing t. Um
so we'll just say in pt equals well in
rt equals
t do like that. There we go.
Sorry. If anybody gives you 10 minutes
for that in an interview that's super
unfair.
[Music]
You want to try to analyze that with
Kira? That sounds kind of fun. I don't
know if Kira works on Mac, though. How
long will it take me now to write it in
Python? You want to do
Python? And Python's fast.
[Music]
[Music]
[Music]
Um,
[Music]
[Music]
[Music]
Oops. Oh my
god. Now you code in C too long, you
forget.
Python object of none type has no
len. Oh, because I didn't
return.
Ah, yeah. Yeah. Return a
um
return a sub one, a sub
zero. Else return
a. There you
go. All right. So, we can compare them.
The C version is 60 lines of
code. The Python version is 35. And
they're basically the same
algorithm. Think a Mario RLbot or play
CTFs. Merge sort in 100 languages. All
right, let's go. What language is
next? What language is next? Let's hear
some suggestions.
All
right, I'm hearing a lot of Haskell.
Let's Let's write merge sort and
Haskell. Do I still know
Haskell? I really don't know Haskell,
guys, but we're going to
try. All right. I don't have Haskell MAC
[Music]
OSX use GHC
up. This is concerning. Is that really
how I should install this? I have Brew.
Should I use
Brew Mac version of the Haskell
platform? I don't know what stack is.
Wow. All
right. Brew install Haskell. No, no.
We're going to have Haskell.
Um, you're going to have to watch me
Google a lot. This is going to take 30
minutes. This is going to be the rest of
the
stream. Use brew to
install. Um, I actually think the
Haskell code's going to be the shortest
of all of them.
[Music]
See, I don't even know how to like
define an array in asshole.
[Music]
Let's look up a Haskell fsbuzz just so I
can like kind of
read.
[Music]
[Music]
Um something like merge sort.
Merge sort goes from an int array to an
int
array. Merge
sort hasll array pattern
matching. There's a way to do
this. Is that not even the right syntax?
It's probably not the right
syntax. The worst part is I once wrote a
compiler in Haskell which just shows you
how quickly you forget stuff like this.
Okay, so merge sort of
like this is it has
two. So let's try like
this.
Um what's the end? There's a there's a
thing for the end of the list than
Haskell. I forget what it is. That's the
pattern that matches the empty
list. So, I'm going to have to match the
empty list and return empty
list. Um, I have to match a list with
one element, return one element. I want
to match a list with two elements and
return
uh is Haskell have inline if
Uh, how come I don't have GHC?
Ow. Now I go.
Merge sort hasll parse error possibly
incorrect or online. How do I comment in
hasll dash dash is there a bulk
comment? It looks like
this. Wow, that's weird.
Let's first just see if we can print out
an array. Let's first get that to
work. No, no instance for numchar
arising from the literal
five. Uh hasll array
print. How to print a list in
hasll? Oh, I have to
show. Oh, I guess show is doing okay.
Show like converts it to a
string. That's still the
C merge
sort. Okay, that's
something. Um, now we're just going to
say show merge sort. All right, let's
first just try to make this function the
identity and make sure I got the types
[Music]
right. Couldn't match type integer
string. Oh, because I need another
dollar sign for the
binding. Okay, good. That works.
Um, now we
want I think I can uncontroversially do
that. Uh, I think the hassle code is
going to end up being the shortest. Can
I do that? I think that doesn't work. I
think that's not the right pattern
matching to Oh, does
work. Does that
work? Okay. Um, now I actually I want to
do an inline if there.
[Music]
Um, if x greater than y then y comma x
else x comma y. Does that work? Cool.
That works. Well, this is going to be
short then.
Um, so the other one that I want, I want
to split the array based on the
length. Uh, has let I want to say
something
like
let P
equals Pascal array
length prelude function length. So let P
equals length
X in. Is it like let in? Is that
right? Uh and then I want to say
something like
uh Haskell array slice
[Music]
uh take and
drop.
Um,
has drop
[Music]
take
drop nxs returns the
suffix. So something like merge sort
drop
p after the first. And how do I and to
get the first? I just Yeah. Yeah. Yeah.
Yeah. So I want merge sort take P merge
sort drop P has concat
lists.
Um plus plus I think is what I
want. I'm sure that's not right.
Okay. Cannot match act. Oh because
that's not right. What's the type
signature for take? Uh, take takes an
int and it also takes an array. So,
we're gonna have to pass in
xr.x.
Okay. No
way. That just
compiled. I don't know why it Oh, it's
probably running. Oh, no. It crashed my
computer. Um, okay. Well, that merge
sort lasts
forever. Uh oh. What' I do wrong, boys?
Who knows what I did wrong?
Can you do
that? Fractional int. Is it the same as
Python variable not in
scope? Pascal
intide by
two. The integer has no fractional
instance. Can also use the div operator.
Okay.
Well, it didn't do any sorting, but
uh All right. Let's test our merge sort
on an array of length, too.
[Music]
works. Oh, we didn't write the merge. We
have to write merge
here.
Merge.
Um. Yeah, we can't just concatenate
them. Oh, that was stupid.
Uh the T.
Yes. Um we're going to have to write
merge.
Merge int
uh
merge
XY equals if X greater than Y
uh
then Y
[Music]
colon No no no no no no.
um xxs
ys. Then we want y colon
merge
xs
ys else x colon xs
yx is that right?
parse error and pattern any
pens. Oh, and then yeah, yeah, yeah,
yeah.
[Music]
Um, runs here.
Yeah, I also need to check the patterns
of when that doesn't
match. Uh oh, just just this is fine. I
think technically for fully
exhaustive though I don't think we ever
have to call
it. There we go.
20 lines, 19 lines. Haskell is the
shortest one yet. Now, it took the
longest to write, of course, and part of
that's because I don't know
uh the single element and the pair are
redundant. I don't think
so. I think I have to do all of those to
be uh
exhaustive. All right. Uh Bash next. No.
Fuck Bash. All right.
Assembly. God, no. That sounds
hard. You really You really want
assembly? I could do go so quickly.
Um. Oh, okay. Okay. Assembly. Assembly.
Assembly. All right, we'll do assembly.
All right, let's
go. You really You really got a code
x8664
assembly. You know what? Here. You guys
want assembly? Yeah, I'll give you
assembly. I'll give you
assembly. Um, GCC output as
a capital
S. All right, there you go. I wrote an
assembly. We're done with that
crap. That's not cheating.
I just wrote an assembly. I used a tool
to help me. There you go. I wrote merge
sort
assembly. All right. All right. We
want Isn't the first merge pattern
redundant? The second clause should
match it, too. You're right. You're
right. I don't actually need that one.
Good point. Good point, Haskell
Geniuses. We got Haskell Geniuses up in
here. Let's make sure it still works.
All right. I see elixir. I see Golang.
Golang is boring. Obviously, I could do
it in
Golang. Um, Alol 60. All right. All
right. We'll do Rust. Let's go. Let's
go.
Rust. Which one should we close?
Merge sort
rs. No, we'll close the house. Merge
sort rs.
Okay. Rust. Hello world.
I've coded probably the least in Rust
out of all the things you're asking me
to code
in
Rust C merch sort RS Does this work?
Yeah, that's
right. Okay. Uh, no. It calls it merge
sort. Same as
Haskell. Okay.
Um, how do I make an array in
[Music]
Rust? Let a
arr. I think the Rust one's not going to
look that different from the Python one.
[Music]
Um and then in order to output it, it
looks like
this. Okay. Uh function merge sort
[Music]
uh dysfunction borrows a slice. Oh my
god. I got to deal with this.
[Music]
I want to borrow. I want to
copy. All right. So, let's just say a
arr
i32.
Great. Oh, try adding a return type.
Oh, it has to return an
i32. Great. Now we have more
errors. Doesn't have a size known at
compile
time. Expected slice
i32 found array integer semicolon 8. Oh,
are they not i32s? Are they
integers? Can
[Music]
I do that?
expected slice i32 found array
i328. But if I borrow the slice, is it
okay? I'm just borrowing
it. No. Oh, I got to borrow here. Can I
borrow? No, you can't borrow. Rust is
hard, boys. Rust is hard.
This is a joke. Pass into
[Music]
function. Um. Oh, I have to say it's
uh All right, we'll say x A
R equals
I32. Oh, I can make it mute. No, no, no,
no.
Okay. Does that
work?
Help. Consider borrowing
here. Merge sort mute
array. I'm going to put that there. It's
going to be mutable,
right? Merge sort expected nothing. Oh
yeah, we don't return
anymore. And we need a comma here.
cannot borrow as mutable. Oh, let mute
array. Yeah. Okay, we only have a few
warnings. Unused variable array. That's
fine. So, if we say like a ar sub0
equals zero, that's going to change the
array. No, arr is
a you don't put mute here. You put mute
here.
No, that's expected a type. Oh, I put
the the the the amperand there. Okay,
fine. That's what I wanted.
Wow. You I don't know why anyone I don't
know why anyone codes in this
language. Um, all right. Can I get the
length or is it going to is it going to
complain? Array lane thrust. Is it going
to complain? You didn't borrow with the
length property. Of course you need to
pass a length ray in the
mutictator. Ah yes expected
I32 found U
size. You can convert a U size into an
I32 and panic if the converted value
wouldn't fit. Never mind. I I don't
really care. Okay. If a arr.length
length
equals 1,
return. If the length is
two, uh, if a ar r sub one is greater
than a ar r
sub0, let's just crib off of the c1 so I
get the uh stuff right. It's actually
that uh you know what? We're going to
use the exor trick here because I'm not
going to
uh what is the exor
trick? There's a way to do like an exor
swap. It's like
easy.
[Music]
Yeah. Equals y x or x and then x = xx or
y. All right. because I'm I'm not
dealing
with Do I really need
PNS? Oh,
okay. Three warnings. Oh, I didn't need
the PNS there, but I definitely needed
the brackets. I didn't need the PNS, but
I do need the brackets. Brackets are
very important in Rust. help remove
these parentheses. Okay. All right. All
right. I understand you don't like
parenthesis. I don't know what
parenthesis ever did to you, but I'm
sure it was bad and I'm not going to ask
too many questions. This is a safe space
for people who don't like parenthesis.
Okay, that code works. Yeah. And the
reason we did the XR swap is because I'm
not figuring out how to label an array
in Rust. That's all too hard. Okay. Um,
well, we're going to need we're going to
say let P equals a arr.len over two. I'm
sure for some reason that isn't integer
division. Zero to p. What are the odds
that slice syntax and rust just
works? H, of course it doesn't
work. Rust
array
slice arrays and slices.
blah blah blah blah blah. Analyze
slice. Borrow the whole array as a
slice. Borrow a section of the array as
a
slice.
[Music]
Um, can I just write dot dot or is that
a syntax
error? Expected mute 32 found slice 32.
Consider mutably borrowing here. Yes, we
will mutably borrow. That's
perfect. All right. Now, we just need to
write the
merge.
[Music]
Um, rust make array
copy. How to idiomatically copy a slice.
clone from
slice. Of course, it requires a
[Music]
function.
Um,
okay. I want something that effectively
looks like the C1.
[Music]
Uh let
mute
R2 sub
i32 semicolon arr.length
length. Um, let mute P1
um, P2
uh,
F. Like I'm sure there's more idiomatic
Rust ways to write it, but I really
don't know this language.
Um if P1 is less than P and P2 is less
than a
ar.len. Actually I can just say P here.
So that's
fine. Um, if
uh a ar a r subp1 is less
than equal to a ar r sub p2, we're just
going to say a ar r2
subf
equals a ar r
subp1 a p1 ++ I don't know plus+ works
in rust.
Um, else we want to do the same thing
but for p2.
Uh, and then here we want to say else
if P1 is less than P
um Whoops. Yeah, it's a little confusing
because I called it that, but that's
fine.
Um, else
if
else
break uh
f++ and it's in place so I shouldn't
have to do anything else.
[Music]
Well, of course it's not going to make
it easy for
me.
Um, oh, got to put a colon. Not going to
make me
happy. Non-constant value. Great. Um,
rust allocate
memory. Oh, here we go. Of course, you
just use the twiddle
operator. Uh,
let x
equals
[Music]
twiddle. Does that fix it? Expected
bool. Can't do while one in. You got to
do while true. Of course, it's very
upset about all my parenthesis because
parentheses are evil in
Rust. I don't want it to be upset. We're
writing idiomatic rust
here. This is not a value. That's not a
constant value. F++ is not cool. Don't
write++. What plus equals 1 make you
happy? Or do I have to write like the
whole thing
out? Python doesn't have plus+ either.
[Music]
Um,
okay. No, I'm not trying to use bitwise
not. I'm trying to allocate
memory. Oh, definitely don't
use help. Use loop. Oh, I can use loop
instead of wild
true. Look, Rust teaches you Rust while
you code Rust. All right, now my last
problem is trying to allocate a dynamic
array.
Uh, Zack
vec
initialize. Um, let mute a arr
equals
vec. Uh, I guess the type doesn't
matter. We'll just say zero
there. Okay. Oh, and now I need to copy
it back.
Um uh if f equals equals a ar r.length
length uh break
uh a ar r subf= ar2
subf of course
stupid. Okay, infinite loop.
Oh, there we go.
How many lines was that? 53. Rust. All
the shittiness of C except it takes way
longer to
code. Merge sort speed run any
percent. I'm only staying here because
I'm not on company time. We got
Rust. All right, we'll do one esoteric
one and then and then and then we're
out.
How we prove merge sort correct in cock.
You guys, I got something to do
today. We we will we will be
here. We will be here in
forever. Test with an oddlength array,
too. Yeah, good point. All right, let's
see which of my merge swords don't work
with an oddlength
array. Did I Did Did I really do any
wrong?
[Music]
Rust works fine with an oddlength
array. Oh, let's write a
run which runs them all.
And we'll do it in order of how we get
them.
Cool. Wait, but some of these
have have the two
added. Did I Oh.
I think GHC isn't
working.
Yeah.
Cool. My school one works as well.
And they'll work with that length of
rice.
[Music]
too. Holy C. Can I get a holy C compiler
for
[Music]
Mac? All right, I think we're done with
coding for today. That felt pretty good.
Well, we still got a lot of
[Music]
viewers. All right. All right. You got
to do it in Temple OS.
I got to download
some. Did I ever get this
running? We got the
ISO. We We'll code it in Holy Sea. Let's
go. Uh,
other other
unknown. Does Temple OS need a lot of
RAM? Oh, yeah. Here it needs lots of
RAM. Holy C is very RAM intensive.
Create a virtual hard disk. Yeah, that's
fine. That's good.
[Music]
Um, power up your hardware and stick the
CD into
it. I power it
up. System preferences.
Oh, here we
go. Please
select what
All right, we're booted Temple
OS.
[Music]
Um, how do I make it bigger? Can I do
that? Adjust window
size. No.
Gonna have to
zoom. Current scale
mode. Scale mode. Scaled
mode.
Switch. All right. Temple OS moved over
here. Scale. Oh, yeah. All right. Now
we're talking.
All
right. I don't know why these X's don't
work. Okay, we're in. Uh,
capture. Oh my god, I have a Temple OS
mouse.
This is so
laggy. Although to be fair, I don't know
whether to blame Temple OS or to
blame Virtual Box. I blame Virtual Box.
I blame Oracle. My whole computer is
laggy. Virtual Box is
just Okay. Install onto the hard drive.
Yes. Are you installing inside a virtual
machine? Yes. It's normal for this to
freeze. Press a key. Oh my god, I can't
even look at
[Music]
it. Temple OS needs a
designer. Reboot. What is this? Windows.
Wait, what? No, we're not installing
onto hard drive. Take two or no. All
right, I can code holy C
[Music]
here. Oh no, I regrettably use the
Temple OS mouse function again.
All right. Temple OS holy sea
[Music]
coding the official Holy C
documentation.
Okay. So I think yeah I think if I want
to print hello world I can just print
hello
world semicolon. Oh
good.
Okay. Um we're probably going to want to
code the holy C in Vim and then copy and
paste
it. So well let's first try to declare
the array just like we did everything
else.
probably most similar to the one in C.
[Music]
Um, By the way, if you guys are enjoying
this, please subscribe. The more people
subscribe, the more streaming I do
because I look at my revenue and I'm
like, "Damn, bros. I can afford to get
my DNA sequence now.
Okay. Um, is this code is this line
valid? Oh, wait. Is copy and paste
work? I mean, it should work. It should
be a virtual box thing. Copy and paste
does not
work. Virtual box is
lagging. Shared
clipboard. Host to guest.
Oh, I used the Temple OS mouse
[Music]
again.
Regret.
Regret. Regret.
[Music]
[Music]
Okay. Don't put the mouse in temple
OS, but we need
it to have the keyboard. Where'd it
go? It's very laggy.
Okay. Um, let's try the
array. Oh, I don't know.
Um, let's just get a god
song. Uh,
rests. All right. You know what? Where'
the music
[Music]
go? Oh,
boys. Boys, this game's too hard,
[Music]
boys. This game's too hard. You know
what? Holy Se is cancelled. Okay, I'm
canceling. Holy.
See, we're going to try and do then
we're
out. I heard good things about
[Music]
Guys, I'm trying. I'm trying to use holy
sea. I
tried. Oh, the mouse is working a little
better.
Uh, I'm getting 30 FPS. That should be
pretty
good. Personal
menu. Oh, copy this file. I bet you this
runs better on real hardware. I'm not
sure it was designed for Virtual Box.
[Music]
I mean, I feel it, you know, using my
machine
hard. Goodbye, Temple
OS. All right. No, Holy C is canceled.
Holy C has it's too good. I I can't I
can't I can't code in Holy C
because Wait, is there Vim? Does Temple
OS have Vim? Because I need Vim.
[Music]
H.
Oh, look at this guy. He got C. He got C
programs to run in.
Um, to be fair, I still think Temple OS
makes more sense than
Herbbit. All right, back in
reality. NIM is a statically typeyped
compiled systems programming languages.
It combines successful concept from who
said they like
[Music]
NIM. Now Urban makes less sense than
Temple OS. Well, you know what?
Actually, to be fair, let's read the
Temple OS code. Maybe it's equally as
nonsensical.
All right. So, the names look more
sensical. Let's see what the Q sort H.
There's a Q sort implementation in Holy
Sea. I find this far more readable than
Hoon.
[Music]
Yep. Yep. I will officially say that
Temple OS makes more sense than
than I mean, you know, you want me to
say Terry Davis was a genius. To be
fair, Terry Davis did more with his life
than most of you guys ever will.
I respect anyone who builds something,
man. You know, like anyone in the world
who builds something and doesn't
uh like, you know, build something that
like really just affects like them,
right? Or or build something that just
like improves people's lives or even if
it doesn't improve people's lives. The
bar is not like you don't have to go
into the world trying to make the world
better. I think this is a scam. just go
into the world and try to not make it
worse. I'm I'm a don't be evil guy, you
know? I believe in don't be evil.
Um, as long as you really go out in the
world and try your hardest every day,
and you know, some of you out there
might work for Google or Facebook and
really ask, "Is what I'm doing evil? Is
what I'm doing perpetuating evil? And if
it is, don't do
it." Um, that's not saying if you work
for Google or Facebook, you're
necessarily perpetuating evil. the
people who work at Google and Facebook
maintaining like you know TensorFlow and
PyTorch like you're doing great for the
world
man. Um where do you guys all work? Who
who actually watches these
streams? You
Sony I've never met Stallman
now. You guys are students. Oh,
[Applause]
good. I hear
maps students got a few
Google Ubisoft DevOps African refugee
learning how to code. CS student in
Melbourne. You work at commai. That's
funny.
Um, writing emulators, self-taught
freelancer, quant finance, teach
computer
music, working deep learning at a
startup, CEO at Tesla. Yeah, you're
funny, man. What's up,
Elon? I loved your short shorts, by the
way. All right,
cool. Uh, yeah, we got a lot we got a
lot of students out there.
Um, yeah. Just, you know,
uh, when you go out into the the world
and you get a job, don't be evil. That's
my, that's my personal that's my
personal code of conduct, you know.
Don't be
[Music]
evil.
Um,
okay. Nim syntax does look very nice.
[Music]
What? It looks hard to install.
[Music]
I did not buy any Tesla short shorts.
The sexy woman, you know, she looked
good in them, but if I came on stream
wearing those short shorts, I'd look
stupider than wearing a face I can't
resist. The Linky Marines. Oh, I love
the Linky
Marines. Linky Marines.
[Music]
I'm not sure what chain link actually
does. I think it like it like pushes
stuff onto
the 4K
display. Linky Linky
[Music]
Marines. Sorry, this was barely about
Corona virus. We should at least commit
our coronavirus changes
[Music]
though today.
[Music]
Notes. Is my brew being installed?
What? I don't know.
Something's
wrong. How come I can't
kill?
Nim. Cool.
Let's hope it looks like
Python. Looks a lot like Swift actually.
[Music]
where my verbosity is zero. Let's try
some more verbosity.
[Music]
Oh, we need nim vim
syntax. Oh, I got to do pathogen infect
crap. Do I have pathogen infect
crap? Oh, first I got to install
pathogen. Then I got to install nimrod.
I can also install bundle. Oh, it's so
complicated. Can I just do
this? Oh, just download
bundle. That didn't work. I think I have
to like add some crap to FP detect or
something. FT
detect. Yeah, this
crap should probably just
loud. Okay, we have some NIM syntax
highlighting.
[Music]
Uh, it's a compile language which is
cool. Does that just
work? Undeclared
identifier. How do I declare
identifiers?
Nim
[Music]
array if it looks kind of like rust like
this. Let
a hint a is declared but not used. Can I
echo
a? I
can. All right. What's the function
syntax in nim?
Nim by example
proc merge sort ar a ar a ar a ar a ar a
ar a ar a ar a ar a ar a ar r
um it returns I want to return an array
uh
array
equals let's just say a ar
r merge sort
Okay. Error. Typeless parameters are
obsolete. Um I assume I have to give the
array a
[Music]
type it
in. Oh, this is the typeless
parameter. Invalid type T in this
context. Proc array array array
[Music]
proc.
Um, their size is specified at compile
time and they cannot be changed at
runtime.
Wait, does that really make the matrix
start with one? By the way, if anyone
suggests any languages that starts with
one
amount
iterator does anybody code in this
language?
block
proc
n pass array into function.
says array expects two parameters. I
guess you actually want a
seek. Oh, we want to use a
seek. Seek sub
int returns a seek
subint.
Um, A cannot be assigned
to, but B on the other hand can be
assigned to. Okay, good.
Um, see cap
length seeks are dynamically allocated
but they are immutable unless marked as
varable.
[Music]
is okay.
The seek is created and
they y seek
length seek
dutails length.
I can just use the len
operator. Go a
r it's dynamic. That should work. Okay,
cool. P equals length. Does it have
double divided by
[Music]
syntax? Declare identifier equals that
identifier slash. Does that work? 4.5.
Great.
Nim integer
division.
Uh, see where I didn't just float. I
assume you meant integer
division. Oh, div is integer division.
All right,
cool. Um, m let m1
equals merge sort. I think I saw these
work.
[Music]
expected expression but found no maybe
they
don't name by example
seeks assert the seek sub9 all right
maybe it's the dot dot syntax that's
pretty
common expected expression but found
that nim seek slice
Oh, it's this one that's
complaining. Okay, that's fine.
Um,
if length of
ar Oh, I guess I just
assumed. Okay, that seems
right. Let me change this to a ar a ar r
is too long to type.
[Music]
Oh, I don't know if return
works. Maybe it
does. Uh, cis fail. Let's do getting an
out of
range
[Music]
error. It shouldn't give me a range
error. 9532
Or maybe return doesn't
work. No, same error.
Um, give
me unhandled exception.
index three. Oh, are slices
inclusive? Be a weird language if that's
true. God, slices are
inclusive.
Junk.
Junk. Junk. That doesn't match Python.
Thought you promised you'd be like
Python. You are not like Python. You are
junk. I know. We're being too mean to
Nim. Don't be mean to Nim. Um,
uh,
let
var equals new
seek int.
[Music]
uh
for var p1=
0 var p2 = p. We'll make it look kind of
like the rust one because it's very
generic and boring like it works in most
programming languages. Let's
Um f here
uh red subf equals
uh m1 subp1 has to be that and we could
say that minus That
Ew, indentations going on in my rust
one.
Um identifier expected but got keyword
var.
Oh, not let var just
var type mismatch got in literal but
expected
bool undeclared
identifier expression a is of type seek
and had to be
discarded. Oh, because I think we didn't
return red
here. any zeros
uh because we didn't increment f which
is a similar bug to the one I wrote
before. Works cool. Um now unfortunately
this program has a memory
leak. Uh so how do I deallocate new
seek
nim
seek
free? Oh, no one has a GC. Never
mind. That
works.
Cool. All
right.
Nim.
Um, I'll post that on GitHub if anybody
cares. I'll merge pull requests for any
other programming languages. Uh, I think
it's kind of a fun
repo.
Um, yeah, that's it. That's today's
stream. Uh, if you guys want to have fun
writing merge sort in your favorite
programming language, uh, you can do
it. Add it to the
repo. Backing behind what in
Kickstarter? Nim is on Kickstarter.
Oh, it's
bright. Got some lights up in
here. Got some clap on lights in this
bitch. I'mma be clapping all night in
this bitch.
Wow. Mean on Kickstarter. Oh, the open
CCAI kit. What is
it? OpenCV VAI
kit.
Wow. What's the chip and
stuff? Yeah. What chip does it use?
It's a
camera. What are the pin outs?
Oh, it's like a USB
webcam. Spatial AI camera
module. That's cute. They get an IMU.
It's packed.
project. He's sending me an email. Well,
if you want to have a meeting, it's
$1,000. Yeah, Joshua Bach. That's who I
was talking about. Who was talking about
Yash? I'm pronouncing it wrong. Joshua.
Um,
uh, that's the one I'm talking about
about the Twitter
thing. I've given my opinion on Nvidia
many times. This is not a stream of
hate. This is a stream of
love. If you buy a meeting, it has to be
professional. Someone bought a meeting
and they thought they could shit talk.
Cancelled that meeting real
fast. You saw my Vim RC. You saw my
plugins. Oh, I got a pathogen effect but
just use bundle. That's also
complicated.
Shoot diaper masks. No, no, no, no, no.
We're we're we're apologizing for ever
referring to these as face
diapers. Um because people have too much
money, man. That's the problem with
capitalism. People have too much money.
People are too rich, man. People are too
rich. That's why we need communism, so
that the whole world can experience
poverty.
Elon tweeted that thing. It was like uh
you know, seven seven uh seven things.
Yeah, you got to you got to tell your
kids, you know. It's like you're good.
Work hard, be cool, feel loved.
Communism failed everywhere. It was
[Laughter]
tried. I look high today, guys. I look
high today. I'm high. Last week I'm on
aderall, you know, I was I was taking
the Xanax for the Southby talk.
Bro, bro, you're capable of ex The cool
thing about being a human, man, is you
can experience a wide range of emotions
and feelings without any
drugs. I'm I'm not here to hate on
drugs, man. But if you see someone
acting some way, don't first assume
drugs. That's a sad
world. Uh, I'd say I don't smoke. I'd
say I don't do drugs. I said, "Usually,
you guys think I'm on drugs way more
often than I actually
am." Today, I had two cups of coffee and
half of pure leaf
tea. I mean, it's drugs, man. It's
drugs.
Uh, I smoke weed, man. Smoke weed. I
drink beer. I don't do it every day. I
don't do it to excess.
Uh, coffee is a drug. It's
true. Caffeine is the most addictive
thing I've ever found. Like, I've tried
to quit caffeine a few times, but it's
really
hard. I think the idea behind backspace
is still valid, but I think we don't
really have the tools to tackle it
yet. Part of the thing about backspace
is
[Music]
um it gets to the question of what is
programming?
My bro says you almost all the time use
drug that's why you hype most of the
time. Suck a freak, get
hyped. Anyone who uses
tabs and questioning your life
choices. Weed's been the hardest thing
for you. I never really found like weed
addictive. I've gone through periods in
my life where where I smoked every day,
but then like when I decided I wanted to
stop smoking, it was just like really
easy and I just like I was like, "You
know what? I'm done smoking for a bit."
Um, caffeine by far. Uh, if I don't have
caffeine, I get headaches. I go through
withdrawal.
Um, do I feel like I lost brain cells
from smoking weed every day? No.
Uh, a lot of, you know, a lot of my
theories about that is
like if you smoke weed every day and sit
around on the couch and watch cartoons,
yeah, that shit's going to make you
stupid. But you don't even need the
weed. If you sit around on the couch all
day and watch cartoons, it's going to
make you stupid, man. If you like smoke
weed and like go on the computer and
like research things and read
and Yeah. Some people I I I've heard
this from people about cigarettes, too.
Uh, I don't know. Every time I've I've
smoked a cigarette or tried vaping, it
just like it makes me dizzy and I don't
really uh enjoy it. You know, when I was
17, I got got dips. You know, we thought
we were cool putting that uh putting
that tobacco in the lip and you know, I
didn't know I had to spit it out. So, I
swallowed some of that shit and I threw
up. Uh I felt dizzy and I was like,
"This is disgusting. I don't know why
people do this." So, maybe that early
experience to nicotine. It's like when
your parents are like you got to smoke a
pack of cigarettes and then you never
want to smoke cigarettes again. I don't
know. Never really never really did much
for me. Um but I mean again this
probably comes a lot down to
uh like brain chemistry. Maybe I do have
like abnormally high acetylcholine or
something. Um, yes. Snust. That's what
I'm talking
about. Swallow that you don't ever
swallow
because Yeah. No, I think nicotine's I
don't know. I feel like dizzy and
disoriented. Do you eat sugar? I don't
like avoid
it. Um, nicotine shouldn't be illegal.
What do you mean by
illegal? Right. Come on. It's 2020. How
are we still criminalizing the
possession of
drugs? If I Cheers. Yeah, cheers,
boys.
Um, have I tried LSD?
Yes.
Uh, do you think GPT3 is going to open
new possibilities?
I mean, I'm a little concerned that
like I don't like the idea that AI is
going to fall into the hands of the
people with lots of
compute. So, I want to see trends like
this not
continue.
Um, I would like to see sort of a real I
don't know, but again, it's a question
of nature. The truth is we may be able
to build a
uh you know something that passes the
touring test if we just scaled up GPT3
100x. Have you tried a butt plug? No.
Um, but
plug that escalated quickly, man. Have
you tried LSD? Yeah. Have you ever tried
a butt
plug? You don't have to ban butt plug,
guys. It was funny. It was funny as long
as it's
once.
Um, I don't want to be on Joe
Rogan. Honestly, I tell you guys, if
these streams ever get too popular, and
I like that you guys are all computer
science students, right? If these
streams ever get too popular, I just got
to not do them anymore, you know? That's
that's the truth of
uh you want to be famous, man. That's
that's a quote. It's like, you know,
people come to me and they say they want
to be rich and famous. This is like from
some famous guy uh who's like
complaining about fame. People like,
"Oh, you come to me, they say they want
to be rich and famous." And I tell them,
"You know what? Try being rich first.
And if that doesn't get you what you
want, well, I really don't think fame
will. Not
famous. See your
nipples." CEO to CEO. Why the hell you
think I'm a CEO, man? I'm a president.
And like I say, I'm not one of those
democratically elected presidents. I'm
like the president of the Democratic
People's Republic of Congo, which, you
know, the more democratic and people's
and republic they put in their name, the
more authoritarian the state is, right?
You know, look at North Korea's full
name. Look at China's full name, right?
The more the more they're putting those
words in there, the more they're trying
to convince
you. The chief party officer. Yeah.
Yeah. Yeah. Oh, that guy wanted us to
know he was CEO. Yeah. Yeah. Good point.
Good point. Was he a subscriber, though?
We don't rip on people if they're
subscribers. Only if they're
not.
[Music]
But what's your
baltoid? Beltoid.
Yeah. Yeah, I don't know,
man. Do you enjoy video games? Yeah, I
was playing I was playing Baba is You.
Um, it's uh I really This is totally
worth the $14. It's a really fun game. I
got like 20 hours of enjoyment out of
it. Um, it's like a puzzle
game.
Uh, I played the last game I played
before that was Slay the Spire. Some of
my friends were into it. Probably played
about 20 hours of Slay the Spire,
too. Do I play chess? Yeah, I'm like a
1500. Not that great. Um, and it took it
took a lot to get to. I wanted to be at
2,000. Maybe a 100 hours in and I was
like, I hope this will get me to 2,000.
It
didn't. How do I find time? Oh my god,
I'm so busy with all the meetings. Let
me show you how I find time. People used
to harass me and they wanted to like,
oh, let's just set up a phone call so we
can discuss
collaboration. Well,
now you got to pay
$1,000. Nothing about 30 minutes, man. I
want to make sure that I get paid more
than lawyers. You
know, you got me here for free. Exactly.
Because you're cool. But feed two, you
got to subscribe, man. Got to hit that
subscribe button. All you guys, come on.
Can we subscribe? We got a subscribe
going. Subscribe train. People donated
one bit to me
today. Uh yo yo. So, so I was trying to
get Jaw Rule. So I I DM' this guy,
Gutter, and Gutter said, "Yeah, I'll get
you J Rule. Give me $500." And then
Gutter didn't get me Jaw Rule. Got me
Reggie Muscles. And Reggie Muscles was
like, "Yo, I'll get you Jaw Rule. Just
give me
$1,000."
[Music]
And more subs, more views equals less
streams. No. No. If everyone here was a
subscriber and we had like a thousand
chill subscribers, I'd be very happy.
King Heron, you're cool. No, no, no, no.
Not if too many of you subscribe. I'm
saying if it gets too popular, like the
minute there's like a New York Times
article talking about the rise of live
coders on Twitch is blah blah blah.
Racist, racist, racist. Uh, that's when
I'm out. That's when I'm
out. Thank you, Jr. Honda. Thank you for
giving out the subs. No, we don't have a
20 off code. No, no, no, we don't. We
don't. All right, butt plugs over. Um,
what happened to the fan plan of getting
Instagram famous? Yo, I'm still working
on it. It's It's like a slow clap, you
know. Get on my Instagram right now. I'm
going to link my Instagram in the chat.
Everybody, please go follow me on
Instagram. Nev says, "Thank you for
subscribing." Everyone, please please
just give me a follow. I want to get
into I want to get into the clubs in LA
where they gate you based on Instagram
followers. No, no, no. I want to go to
the elite clubs. I want to be like,
"We're a member of this elite group with
lots of followers, man. Look at our We
can like self-esteem. We know that we're
better people." Because honestly, a
follower count is just a measurement of
how good of a person you
are. Um, not you don't want to be
famous, man. You don't want to be
famous. See, famous comes with See, you
know what? You know what? Let me tell
you something. I'll tell you something.
I'll tell you something about being
famous. Like, people don't like think
some people try this shit with me and I
just I just look and I laugh. I, you
know, I laugh in their face and they're
like, "You understand that you have a
responsibility to your audience to tell
them good stuff and to shill my
propaganda message." And I look at them
and I'm like, "No, I don't, man. I can
do whatever the hell I want." And
because I live in America and America's
the land of the free and the home of the
brave. And see, that's the problem with
being famous, right? Because when one
person says that, you can laugh at them.
But when everybody says that, you know
what I mean? Who's gonna buy your scam
movies? Nobody. And that's why you don't
want to be famous. You just want to be
respected. And the way that you get
respect in the world is you always tell
the truth. You know, if everybody just
went through life, you go through life
and you just always tell the truth.
You'll be respected. No one's going to,
you know, no one's going to, you know.
Well, I don't know, man. Did Dr.
Disrespect lie? And that's a new meme.
Can we make that a meme? Like, like what
happened to Dr. Disrespect? He got
disrespected. you know, Twitch
disrespected him, and that's the
truth. Um, yeah. Yeah. Being
good-looking and being smart, those are
those are two cool. You should work on
those things. Everyone likes smart
people and everyone likes good-looking
people. Didn't do feels bad, man.
friend is a multi-millionaire and he's
all about playing games all day. You
told the truth, you got fired? Well, I
don't know if you actually told the
truth. The
truth? What' you get fired for? Wait,
what do you mean you told the truth? You
got fired? What
happened? Yeah. Yeah. Yeah. You know, be
a healthy weight, man. Be a healthy
weight. You know, relativism does not
apply to obesity.
You stole milk? Well, shit. No wonder
you got
fired. Well, I'm only around people who
want to hear the truth. And people who
don't want to hear the truth are not my
life, man. And I'm like, you can come
back to my life when you're ready to
hear the truth. I'm always ready to hear
the truth, you know?
We don't talk about Kamei on the
stream. Who's the Twitch
psychiatrist? Got
milk. Hong Kong and TJ. Man, next time I
go. Next time I go, I'm
down. Dr. K. All right. Who's Dr.
K? Should I Google this? Is this
hateful?
We don't like hateful shit on
here. We like love. Love. Peace and love
and
[Music]
understanding, grow less of an ego and
have more confidence in myself. So that
way because confidence is less ADHD
intensive and an ego is just me
increasing this because it's just
feeling like
fire. So can we get a fucking round of
applause? Cuz you just tied it. Just
think about all of the different
directions you just wo together in like
seconds. Confidence what you're fueling.
so many different things. Why you do
it? You just beautiful, man. Beautiful.
Watch that. Yeah, it's a little cringe.
I I I agree. I don't know. I mean, I
don't want to take a clip out of
context. Maybe I'll watch some longer
ones. Um, Christian channel, this
Christian channel,
boys. I'm not No, I I've heard Destiny.
It's just I've heard it's very toxic. I
don't really know much about
it.
H I don't know who Michael Reeves is.
He's the new Oprah. Joe Rogan's the new
Oprah. I was saying that
yesterday just to listen to Lil Peep.
Little Peep's mom kind of sold him
out. Um how are you dealing with COVID?
Are you talking about the lowerase COVID
or the uppercase CO? Right. They're
different viruses.
[Music]
Life is cringe. No, I don't know. I
don't mean to judge Dr. K. I don't
know. Destiny is the Gana philosophy.
Only he's wrong and you're right.
No. Uh, like you know, self-help is one
of the top selling genres on Amazon
and I used to kind of I used to like
those books until I realized what was
wrong with them. And the book makes you
feel good, but the book doesn't actually
improve your life. If you want a book
that's going to improve your life, go
read a textbook. If you want a book
that's going to make you feel good, you
know, like like they shouldn't be called
self-help books. They should be called
feelgood books, but they wouldn't sell
as many
Yeah, self-help is only decent when
you're 18. Read, want to move on. I
agree with
that. World's not
cruel. The world's a pretty nice place.
I I mean, I, you know, I like to blame
the tools. Um, I think a lot of the
tools of social media are are quite
toxic in and of
themselves. I I don't the
economy, who knows anymore, right? Um
the money is all fake. I say this a lot
about money. It's it's entirely fake.
It's it's made up by a bunch of people
who you've never heard of and you don't
know. Uh I'm bullish on crypto long
term. Lost in the cosmos. Author says,
"The only way to cure depression is to
seriously consider suicide." Um, I mean,
I kind of disagree with that. Like, I
kind of disagree with the whole phrase
like cure
depression. What are you going to cure
sad? Are you going to cure fear? Are you
going to cure
happiness? Depression is just it's on
the spectrum of human emotions. You
can't like cure these things. You going
to cure anxiety? No. You like figure out
strategies to to deal with this stuff.
It's about managing. Yeah.
Um I mean look and and it's the same
thing. I don't feel I don't know I don't
know how much this is actually thought
of but like psychiatrists draw a line
between legal drugs and illegal drugs
and this drug is prescribed by a doctor
and look I mean you know I drug use is
is a personal choice but you know don't
be duped into thinking that you know
nobody is duped into thinking that their
cocaine habit is helping them improve
with something right yet people are
duped that with SSRI or or even even
stimulants. Michael Scott, I rewatched
The Office recently. I have a lot of
respect for that guy as a manager. You
know, Michael Scott was good. He was a
good
manager. Um, my refreshing attitude
toward mental
health. Why you attacking cocaine? The
quickest way to never want to do cocaine
is to walk into a room of coked up
people. And then you ask yourself the
question, it's like, do I really become
like that? And the answer is yes. It
just doesn't bother you
anymore. I don't know. I don't like I
don't like Wellbutrin. Wellbutrin's
anticolinergenic. But you know, if it
works for you, it's my
[Music]
opinion. Coked up girls. Girls trying to
get more, you know. That's just
all I think we talked about the cocaine
thing before. I say that a lot. I'll
feel real trapped in this life if I
didn't know I could commit suicide at
any time. Hunter S. Thompson free exits
new reactionary concept.
Um I do not have scheduled streams. I
really do. Scarface is a great
movie. Let's do co streams.
Okay, this is shit high. It doesn't
last. Yeah. Um, please watch this stream
v c k c k c k c k c k c k c k c k c k c
krypto. I unshielder it
before
cocaine. I don't know if you'll say
suicide is selfish.
I think that you
uh if there's anything in this world you
do own, it's uh it's your body. You
know, my body, my choice,
right? 50 sauce of
Coke. I haven't done Coke in 10
years.
Um what's
pod? No, I wouldn't recommend Aderal.
Aderal, this is frequently discussed on
on intelligent neutropics forums. They
say, well, aderall doesn't actually make
you better at anything, but it makes you
think you're better at things, which is
bad because it's, you know, if I am good
at something, I want to believe that I
am good at something. If I am bad at
something, I want to believe that I am
bad at something. Um, when I start my
college, our motto inscribed over like
the big R is going to be and I'm
stealing this from Yukowski of course,
but that which can be destroyed by the
truth should be
um I've been thinking I've been thinking
pretty seriously about it. If if if Kama
does well and um I have money, I'm going
to start a
college. Uh, I'm going to start a
college to to to keep around the idea of
truth. What about provigil?
Um, provigil is interesting. It's weird.
It's it doesn't doesn't exactly like
aderall maps to something I felt before.
Provigil is
is I don't know. It's it's still kind of
new.
No, I don't hate universities. I hate
universities that push something other
than truth. What if you're a cult, but
what you worship is the actual
scientific truth? Does that make you a
cult? See, now, okay, I I took Concerta
and did so much better at work. Are you
sure you actually did better and didn't
just perceive yourself as doing
better? Yeah. You know what? You know
who runs the cult awareness network? The
cult awareness network is run by
Scientology. How would you maintain the
goal of goal of your college after your
death? Um,
well, that's kind of hard, right?
That's that's that's an age-old
problem. Problem dates back to like
ancient Greeks and like Pythagoras and
Plato's Academy and yeah, you watch
things get perverted over time. So, I
don't know. But I'm going to put a lot
of thought
into how to uh Isn't believing you did
better not a bad thing? No. If you did
better, you should believe you did
better. If you didn't do better, you
should not believe you did better. The
truth is the ultimate
determiner. I'm not going to die, right?
I don't know. You know, I like to talk
about living forever, but I'm not I'm
not like scared to death or
anything. Do I believe Elon when he said
they were very close to level five? We
don't talk about K AI here, but
no. Um, yeah, everybody I've read. Uh,
everybody should read Fountain Head
Atlas Shrugged. uh don't confuse them
for great works of literature but it is
a self-consistent philosophical system
that you should
understand. Do I hate Nome Chsky?
No. I did actually I did just read there
was a new criterion article uh linked on
hacker news. People were talking about
the chem rouge um and he was apparently
like like a supporter of that and he was
an apologist for that regime. Um but no
overall like like when I think nam
chosky I think manufacturing consent and
like it's a very good concept to
understand lots on anarcho capitalism. I
don't really know what that
is. Do I think Elon is cringe?
No.
Uh would I prefer to live for one day in
the past or the future? Do I come back?
Definitely the future,
bros. Um, you you've you've you've
uh you you Enran puts a very personal
dimension to
capitalism. Would I have voted for
Kanye? It's a personal choice. The
beauty of voting is when you go in that
voting booth, you can vote for whoever
you want. You can tell people you voted
for whoever, man. No one's going to
know. That's the beauty of
anonymity. Took traumat and it helps you
concentrate when you're coding a lot and
not worry about other stuff.
Um, there's a Reddit post that talks
about opiate addiction. I think it's
very true. It's
uh, we can talk about this another time.
Uh,
fenibut. My understanding is fenibut is
just like they somebody tried to
repackage uh uh benzo as a neutropic
which they are absolutely not. Um,
traumdol is closer to a neutropic than
fenabot.
Um, suicide's a permanent solution to a
temporary problem. Uh, there's a great,
um, let's see if he can still find it.
Uh, should I commit
[Music]
suicide? No. I
remember. Oh, it's sad. It's sad that
this is what it is. I mean, I remember
being 15 and and and seriously googling
that.
And no. Oh, it's sad. It's all trash
now. If this is what I saw, I would have
been I would have been um
uh let's see if we can find it through
other searches. suicide.
Um,
coping pain
[Music]
stop. Ah,
yeah. Yeah. I I love this. I love this.
This This used to be the top result. And
this I mean, you can tell this comes
from like an old era of the internet.
Um, I remember I remember reading this
when I was 15, and I remember it really
being uh being
nice. um like they're not it's not
condescending. They're not talking down
to you. I'm sure if I clicked on some of
those news articles it would like, you
know, they just they just treat you
like, you
know, it makes you feel hopeless. But
um start by considering this statement.
Suicide is not chosen. It happens when
pain um exceeds resources for coping
with pain.
And
then is this the one that then talks
about this idea that
like people commit suicide in order to
feel relief from pain, but relief is an
emotion and if you're dead um you don't
feel
relief. Oh yeah, this is it. Yeah.
People often turn to suicide because
they're seeking relief from pain.
Remember that relief is a feeling. You
have to be alive to feel it. You will
not feel the relief you so desperately
seek if you are dead. Um, no, I'm not
I'm not
suicidal. Uh, but everybody should every
I wouldn't take someone seriously as an
intellectual if they haven't considered
it.
Um, wouldn't the state of no feelings be
a great state to be in? No, definitely
not. No, relief is a
feeling. Relief is not the absence of
pain. Relief is a
feeling. What do I think of Nim? Um, I
don't like it. I I don't see what it
adds over other languages. It seems
like I have no like maybe it's fast.
Like what does Nim get me over
[Music]
Python? Nim. Why
nymph? Could someone just please write
fast Python? There is no fundamental
reason why you can't write fast Python.
If they make JavaScript fast, they can
definitely make uh Python fast.
Um, no. Siphon is not what I'm looking
for. I'm looking for a Python that is
fast. And like it's okay if it's a
restricted subset of Python. I know like
globals and locals are really
expensive.
Um, thoughts on Jonathan Blow? I met him
recently. I don't know. I What would my
thoughts be? I didn't. Uh, he said
sensible things. I liked what he
said. None of you guys are banned. Are
you
banned? Um, Julio is fast.
Python. Rust seems to take forever to
code
anything. Um, people are trying to
rewrite Emacs and Rust. I bet you Emacs
people like Rust, you know.
Um, welcome back. Begin
bot.
Uh, blood and ice speech and educational
programming. Yeah, I watch some stuff.
So, all right, we're
over. All right, guys. Thank you all for
watching. Uh, I got to prepare for my
thousand phone
call. Uh, Golang is not trash. Go. Go I
think carves out definitely a niche for
itself. Go is C++ if you're not smart
enough to write C++. Um and that's not
to rip on people. Like I coded many key
value in Go because I'm not smart enough
to write
C++.
Uh thank you all for watching. Uh please
subscribe. Uh please follow me on
Instagram. The money of course goes to
the company, not in my pocket, but I
think the company should buy my DNA
sequencing. What do y'all think? Um, we
got to go buy my
[Music]
DNA. Um, no. Come on. It's a nice thing.
I like to be nice. It's more of a like,
have you taken your idea seriously
enough? Have you put $1,000 of your own
time into the idea? If you haven't put
$1,000 of your own time into the idea,
why would you ask to talk to me about
it? Right? That's that's really the
test. The $1,000 would almost work just
as well if you had to do proof of burn
on $1,000. Like you just have to prove
that you're willing to to burn $1,000
for Yeah. Show the stream earnings. No.
Last time I did that, you all screamed I
was going to get banned. Raid someone. I
don't know. I should I should I should
be better about uh about being a good
contributing member of Twitch society,
but they got to tell me why Dr.
Disrespect got
banned. Bye everyone. Have a good
afternoon, night, or morning wherever
you may be.
Good morning
everybody. Welcome to my cozy stream.
Cozy is cozy.
Look. Wow. I could be anywhere right now
in
these 100 square feet. 120 square
feet. That's a good number of square
feet.
That's all the square feet a person
needs to
live. It's a little bigger than the
pod. Uh but you know, it could get
smaller. They could deliver bugs. It
sounds pretty
good.
Uh unfortunately in the pod we only have
Wi-Fi, so it's a little slower. So
hopefully we don't have any uh stream
issues. Tiny Guard's doing pretty good.
Um, we can get into that, but what we're
going to do today is rectified
flow. Um, so apparently we can
generate massive rectified flow.
ImageNet is the new emnest. Wow, that's
that's pretty uh what's my opinion on
Java today? Should we use Java in
today's
stream? Should we should we use Java,
guys? Should we have a poll for
that? Uh
07. But first, we have some work to do.
So, I hope you're all interested in
joining me for some work. Um and we are
going to go subscriber only because the
chat is extra stupid when it's not
subscribers. Um subscribers are just
better people. I mean, you really have
to ask
yourself, why am I not a subscriber? I
want each person right now to search
inside their heart and ask why they're
not a
subscriber. That might be a question
you've never asked before. You might
think, "Oh, that's a self-serving
question, George. George, this is
motivated reasoning. You're only asking
this because you want to make money off
your Twitch stream." And that's not even
really
true. I mean, I like making money off my
Twitch stream, but that's not why I'm
asking you that. I'm trying to talk
about the essence of person. And is the
essence of a subscriber different from
the essence of a non-subscriber? And I
think it
is. I've heard before that I'm a
non-joiner. I don't really know what
that that means, but you can kind of
understand what it means. And maybe it's
because I don't want to search deep
inside my soul.
Uh oh, also there's a there's a George
Hotz uh podcast.
Um, I I did a I did a
podcast.
Uh, so yeah. Why is this Why is this
difficult to uh Why is this difficult to
search for? And that's on Twitter, so we
can't click that one. Um, all right.
Well, I'll show you guys X cancel. If
you don't know, X cancel. We don't have
Twitter on this computer. I can't have
Twitter. It's addictive, guys. Twitter's
Twitter's addictive. Uh, yeah. So, uh,
here we go. This podcast, this is
Endgame. I'm Amanda Cassida. This
episode is with George Hotz, best known
and you guys can can watch it and I'll
post the link in
chat. I think my critique of
intellectual property was good, but my
critique of finance went a little bit
too far, but it's really just cuz I love
to trigger crypto bros. No, no, no. But
the tokens have value. No, they don't.
No, they don't. Come on. Come on. You're
not really going to tell me that rare
Pepes that by trading rare Pepes I am
helping with the price discovery of rare
Pepes and doing a valuable service for
the
economy. Um oh in today's
controversy if you guys haven't heard
the new Kanye
song, you know they play they play right
into his
hands. Um, it's banned. Are you going to
It's kind of hard to find. It's It's
banned off Spotify. It's It's too
controversial for
Spotify. Oh my god. He He worships a a a
uh 75year-old man, a man who died 75
years ago. Too controversial for
Spotify. Um, all right. Wait, I'm
clipping the mic. I think we might want
to lower this a
little. H. Yeah. No, it's got a It's got
a catchy hook. It's got a hot beat and a
catchy hook. Uh so you know you know you
know you can you gota you gotta uh I'm
not even going to make some claim about
separating the artist from the the
message. All I'm going to say is uh I'll
take Kanye any day over the sensors over
the people who censor shit. Uh now to be
fair if it's not actually censored and
it's just Kanye looking for attention
then uh I take back what I said and then
the sensors are well I don't like
sensors but they didn't exist anyway and
they're just in Kanye's head which is
possible. But I also could see the song
actually just being censored by Spotify.
And oh my god, like like it's the
current year. You're going to try to
censor stuff? No. Someone might listen
to this song and get
ideas. They're actually pretty stupid
ideas, but like it's still it's still
funny. It's just it's just that's in
today's controversy. So, you know, we're
going to talk about that.
Um, so yeah, if you want to if you want
to check out this
uh this this this podcast came for the
guest, subscribe for the interviewer.
Working so hard to keep George on the
cognitive thread. Yeah, I know. I know.
Um, asking someone where they are on the
spectrum.
Um, all right,
cool. Uh, wow. Wow. I just got that I
just got that Kanye hook in my head. Oh
man, can't even say it. It's
controversial on both fronts. It's three
words. I don't know you could pack so
much controversy in three
words. Yeah, I remember when Rage
Against the Machine told me to get a
vaccine. Yeah, I don't know about that.
Not even saying I'm against the vaccine,
but like you're the
machine, you know? Dark Knight deal. die
and be a hero or live long enough to see
yourself become the
villain. Oh, yeah. So, we got to do
work. We're all doing work right now. We
got to update the website. Um, so, wow.
I really I really just got I just got
that hook in my head, you know? It's
It's so catchy. Uh, all right. So, this
is a Tiny Box uh green V2 and we need to
update the website because it's not
coming soon anymore.
Um, Tiny Box Green
V2. All right. Sign up for the mailing
list. We want to keep the link to the
mailing list to be notified
when trash 2 is in stock.
No, I'm not even going to say that
for
updates on products and stock inventory.
Inventory. Is that good? What's going to
get you to click this link? Okay.
I prefer the call to action to be at the
end. Got to think about that. By the
way, we're hiring someone. Um, if if you
want to come work at Tiny Corp and you
can't like you don't have like god tier
programming abilities, you can actually
get a job here uh in person San Diego. I
want you to do sales, support, and
supply chain. Okay? So, you're doing
S's. Okay? All the S all the S related
tasks.
Um, if you're in uh, yeah, be in San
Diego. Um, student, very good. It fits
with the S theme. But, uh, you know, the
job's open to to anybody who can do the
job, of course. Uh, because
discrimination is for
idiots. Okay. So, you guys going to
click this call to action, sign up for
the mailing list. All right. Let's
[Music]
just push
that. Okay, my work's done for today.
Good work, guys. Good
work. All right. It's called min
RF min implementation of scalable
rectable flow
transformers. See if my camera is placed
in a good
place. We're good. A little
small. All right. So we should be able
to write a diffusion model which makes
emnest out of noise. Um I've never
written a diffusion model before. I
actually don't know how to do this. So
we are all going to learn together. I
trust the author.
Sure. All right.
Let's start a new file called
minrf.py and let's start implementing
this in
tinyrat. Uh I got chat gpt to
help. Let's read the read me. Um
this I've taken the SD3 approach of
training along with llama dip.
Oh my god, it's going to be loud.
Hopefully that'll actually turn off, but
it doesn't really
listen. You guys ever see
um Channel 5 News, the Philadelphia
Streets
one? Yeah. Yeah. I want a bitch who
listens. I like eating lamb. I'm a lamb
type guy. You know, that guy's famous.
Maybe he's not in jail, but I mean he
did deal fentanyl to people, so maybe he
should be in jail. I don't know. That's
a question for
democracy.
Democracy because Dem
decides. All
right. Scaling rectified flow
transformers for high resolution image
synthesis. Okay. Diffusion models create
data from noise by inverting the forward
path of data toward noise and have
employed. Well, now it's
cold. Wow. I don't even know which of
the three words is the most
controversial. What would get me kicked
off Twitch? You know, you just you just
got it in your head. You
know, guys, don't do censorship.
Censorship is for losers who can't
handle reality, just like drugs.
But a large cold brew is definitely not
drugs. Definitely definitely not drugs.
Nope.
Um I slept all day yesterday, too. I
just had I just had a sleeping day
yesterday. I just No, I did some work in
the morning and then I just I slept just
like like kind of lounged around,
watched some watched some YouTube
videos. gotten into roller coaster
YouTube. I think we're going to need
glasses for this stream. You know, seems
like a glasses stream. Only if we could
find the glasses, though. Yeah, we found
the glasses. All
right. Oh, and CO2 is up to 937 right
now. Kind of a lot of CO2.
All right, we got we got to focus. We
got we got we got things to do. I'm not
I'm not paid to stream to just just be
add and stuff, you
know. All right, let's just let's just
look at how I look with my glasses on.
All right, good. Do I look like I'm
ready to
work? Yeah. 9372. I bought this I bought
this
Aronet kind of
high. Normally it's like 500 in here. I
got It's got like logs on my phone and
stuff. It's pretty good.
Ah, rectified flow. Okay. What is
rectified flow?
I was also talking with Chad GBT about P
equals MP last
night. I was trying to understand
there's a great there's a great paper
called natural proofs.
um that basically talks about like this
whole class of proofs will never show P
doesn't equal NP assuming there
are and this is what the assumption gets
a little bit weird because it assumes
that there are invertible functions with
respect to X time and this is what I was
like trying to understand but it was a
little confusing like invertible
functions with respect to P time I could
totally buy but I don't even really
understand like I don't have an
intuition for what it means for that.
Okay.
Um All right. So, this looks like it
means something outside of
Did anyone use stable diffusion
3? Like why have I not heard much about
it?
I know tiny supports two and XL. Oh,
while the model's not broadly available.
Oh, do they not share
it? Collaboration with AMD.
Wait, that's what they
chose? That's what they
chose? A
photo? Uh, yeah. Yeah, that's not a
photo realistic picture of a tiger. I
got some
questions. Yeah, that's definitely not a
photorealistic picture of a tiger. What?
Oh, SC3 is basically a bad training run.
Yeah. Well, I mean like clearly it
doesn't listen to the prompt.
So
what? Wow.
Yeah, I don't even know what rectified
flow is. I mean, I'm trying to get chatt
to tell me,
but all right. So this is the best
tutorial site about
this.
Cool. Ah, minimal mathematics.
Perfect. Okay.
Fectors. Can we formalize this? how they
Okay. Yeah. Yeah. Yeah. Fine. Noob.
Noob.
Noob. Oh.
H. All right. All right. We're into
differential equations
here.
Um, okay.
The classic approach learns a stochastic
differential equation that adds noise
that numerically inverts a curved
denoising trajectory. Okay, so is this
like how SD1 worked? Because I
implemented SD1
So we create a
Gaussian predict
velocity at time zero. Okay.
seems
reasonable. Different sampler but same
objective.
Okay. Um example simple vector
field.
Uh yeah.
Okay. What's a vector
field like that? like just like an array
of ve Okay, I kind of understand like
the idea of like a velocity tensor. That
makes a lot of sense to me, right? This
is like the same as like a
gradient. Um, wow. You guys are you guys
are you guys can make fun of me. Like
I'm sure there's actually a lot of
people in chat who like know more math
than I do. Um, I was never very good at
uh like continuous math or calculus. I I
took multivariable calculus my junior
year of high school and I just thought
it was stupid. like we're learning like
Green's theorem and like like like line
integrals and I was like this is so
useless.
Um yeah know I I understand I definitely
understand the idea of like each point
has a velocity. It's like a gradient. Uh
but I guess it's twodimensional and the
gradient's
onedimensional right because if you have
two numbers at each and that looks like
it has two numbers at each coordinate.
Okay. So, stable diffusion
one classic DDPM score matching
objective rectified flow. So,
trajectories become straight chords.
What?
Okay. Um, I was a lot better at discrete
math.
discrete math. I'm pretty good at linear
algebra. I'm pretty good at
um I get really into one one of my
favorite uh classes I took was this
computational discrete uh math class.
They talk about like fixed points of
functions and things like the coats
conjecture. I really like things like
that. I mean, it gets to like it gets to
like the busy beaver problem. If you
guys saw busy beaver 5 was solved like
that's super
exciting. Okay, think of every noise to
image sample as a curve in latent space
while the time is used by
the right. So ddpm match the
score the target depends on x and t and
is not constant along the path. Match
the constant vector that joins the two
end points picked at the beginning of
the training pair.
is the desired velocity in RF is
constant. Okay, but you clearly still
have to sample for these things,
right? Because you can do
steps actual rectified. Yeah. No, I I
know it's simple. I'm I'm just trying to
get at like what
the because if you just like copy the 10
lines of math, you don't really
understand. Okay. A minimum
deterministic diffusion
model sheet
algorithms. Okay, cool. I I don't
exactly understand how this is
different, but like this makes a lot of
sense to me. So you're you're you're put
you're basically just it's outputting
like yeah the vector field. Sure. You're
outputting like the velocity of the it's
not even a 2D vector field though.
That's just a 1D vector field, right?
You're just you output the velocity
given the current image and the and the
thing. Is it worth trying to understand
what the old one was to understand how
it's different? Because like yeah, this
seems like the obvious intuitive thing
to me.
match the
score
trajectory. Okay. What chat GBT what are
you doing?
The
forward uh stochcastic differential
equation adds noise and the reverse
process deterministic one you get this
train once with random endpoint pairs.
Okay, they're both
random batch of curves. Replace each
curve trajectory by its straight chord
and treat the two chord end points as
fresh. Each iteration pulls the vector
field towards zero curvature. Okay. So,
I could imagine like what you're trying
to do, you're trying to say basically
like it's it's kind of collapse the
steps down into one, right? Because if
you truly have a straight line, you
don't need to take multiple steps. The
only reason you need to take multiple
steps is if you have a curved line and
you're trying to approximate that curve,
right? Like, yeah, you can look at it as
the same as like gradient descent.
Wow, that's
cool. The old one is just iterative
denoising modeling by estimating
gradients of the data distribution
direction. This is old.
Yeah.
Um I I've never I I implemented stable
diffusion, but I just kind of copied. I
didn't really understand.
I try never to be an early adopter of
things because like you only really want
to adopt what stays
around. Like I know people who are like
months ahead of me in how they use
AI.
Uh I've I've always been like this. I've
never been a been an early adopter.
Um I I feel like because like people try
to be like early adopters for like
uh like everyone's trying to like like
it's like a cloud thing, right? Like
everyone's trying to like get to the Oh,
I was early to that. Okay. Yeah. I mean,
fine. That's might be how you make money
in scams like crypto.
But in
reality, I was early to relativity. So
what?
Okay. All right. I think we understand
enough to read the code.
Uh, actually, let's just look through
this original paper first. This is the
paper that introduced it or probably
not. All right. I think we don't need I
heard we don't need a uh
George, why don't you use cursor or wind
surf?
Nope. Don't like those things. All
right, third data
set. I don't know what that does.
I have torch installed because I have
the wrong Python
selected. Yeah, I don't know why I
picked that one.
Just trying to run
this
run. No requirements.
Great. Gotta love
torch. Look that everything is green
now. That's
nice. Oh, that's a nice function.
Tinder doesn't have something like
normalize. That'd be kind of cool. We
should kind of have that. All right. If
we want to normalize it, we just
uh Wait, what? The mean should be 0.5.
You give it the mean and the standard
deviation. That's so
confusing. Oh, wait. That's so
useless. That's all it does. So, it
literally just does
this.
Whatever. Uh, and this isn't actually
that's why train. That's why test. All
right.
Great. That's all that's doing, right?
After you finally get through these.
Why it keeps trying to set up Wi-Fi
calling? Does pad two
do? Oh, it just pads everything with a
size of two.
pads and then normalize is interesting.
Okay.
see what the model looks
like. It's got 32 input size.
Looks like a pretty complex model.
What's DIT anyway? Diffusion and
transformer. We can probably use any
model. Let's get the training right.
This isn't even what Oh, it puts this RF
on top of the model. I
see. This just looks like the normal
llama attention. So, we should just be
able to import that.
Yeah, I can just do from examples line
actually from examples dot where my
models extra
models transformer block probably the
first thing that's what I have to import
here.
It should all
work. This is just like running the
model.
We have some nit
sequence. I don't know why they
separated into that and
RF with self
ln. We make a sigmoid of
that. I don't know what that does. Size
zero.
Let's just like try to write a training
move
here. It really doesn't look like this
RF thing does very much. I mean, this is
just like Yeah, this is the
implementation of the diffusion. Right.
Right. No more talking about the Kanye
song, though. We're past that. We've
moved on.
So what's the
conditioning the data loader?
What? Oh, I see. So that's like the the
class. I mean it makes sense that it's
conditioned on the class, right? Okay,
cool. They have something called label
embed. What does this
do? All right, cool. That makes
sense.
Um, boring
shit. Is patchify
used? Oh, I see. So RF's not even the
model. Model is just dev mlama.
That's fine.
So, let's dim 64.
That's sensible. Colonel size padding to
stride
one. Cool.
So
Cool. So, we're
gonna forward with
CFG. I don't know what all those things
are.
Uh x= x dose sequential and net com
sequence. All
right. Well, that looks easy
enough. What? This just a crazy
transformation. People should use
Einstein notation for
this. It's the patch
size. That didn't change, did it?
All right. So, we put 2
4135. I see. Um, what's flattenus 3 do?
Okay, that's a start dim. So, I see. So,
that's just going to flatten that. And
then just I don't know. I think our
flatten works the same as torches.
[Music]
Let's just copy the sampler from
beautiful
emnest. Let's see if it runs.
We need T's and
Y's. Gnome. It's like none but
gnome. Okay, cool. Uh, it looks like
something
So that's going to return
batch and then what
uh all right so that's 135.
So the second dimension is going to be
channels which is
32 times patch size times patch
size and this
is what's left of height
width
is all 32 squared. We just divide that
that's 16. So that's why you get 36.
Okay,
cool. Yeah. Well, I don't know how to
write Einstein notation either, so I
understand how to read that, right? You
see what? So, this flatten is flattening
these three axis, and this flatten is
flattening those two into one. Cool.
That's actually a neat way to write
it. See, I love going through these
because you learn like you learn like
little tricks about how to better
implement
stuff.
Um, like I feel like machine learning
code is trending toward this like super
readable stuff.
All right. So, we're going to have to
embed our X's with the X embeder, right?
Where's the X
embeder? Uh, okay. Well, that's simple
enough. Not to be confused with a batch
size. It's a patch size.
Throw that crap in the X
embeder. Cool. All right. So, that just
like have that dimension for some
reason. Uh
huh. So, that's going to take Yeah.
patch size patch size dim over two and
make it dim. Okay, cool. So, that's we
can write
it. Actually, let's write it the other
way because that's how they're actually
written. Okay, cool.
All right, we did our X
embedding. Now, what is a
T? Add a Len input. What's that?
takes a flag if it's
training. It's a set
timesteps.
Adeline. How does a layer have an
Adeline input? Uh
oh. This has an Adeline
input. No, it
doesn't.
Oh. Oh, come on. Do we really need this
crap?
My llama doesn't have
that. Have to
modulate.
What? What is that?
All right, that seems too crazy for me.
Do we need
that? Oh, that's what's doing the That's
where the the T's and the Y's
go. Cool. They use some on there.
Um, we're still implementing the model.
We haven't even gotten to the trainer
yet. I don't really love putting that in
the layer. Maybe we can just not put it
in the layer. Does it even do anything
with the layer?
Like their transformer block has to
support this crap. Does it
use? Oh, there's like a thing for
it. Six times dim. Oh, I see it chunks
it up.
Okay. Why would I want a Nerf model? I
don't I'm not impressed by those
things. I saw that paper. It just wasn't
that impressive to
me. Okay. The little MLP that turns a
conditioning vector into shift and scale
parameters used by every adaptive layer
norm inside a diffusion transformer
block receives the conditional
embedding. It outputs six dimensional
vectors that are sliced into
stuff. Okay, I love chat
GPT ln was introduced with diffusion
transformers because simply adding a
timestep token embedding to every patch
made transformers unstable and computer
heavy. Injecting a conditioning through
layer norms aine parameters cause almost
no
flops. Cool.
I guess we should like read this
paper. When did this come
out? Well, I'm really behind. Oh, I
guess I I mean I have seen this paper
before, but I've never implemented
it. All right, so this finally got rid
of units for transformers.
One of the things about working on Tiny
all the time is I'm not up to date on
like the latest three years of machine
learning. By hanging around comma, I
kind of get it, but oh, I drove with the
new uh with the new comma model this
morning. Uh
it's it's moving in the right direction.
you know, comm is actually like close to
solving self-driving cars, right? I know
that I know that like, you know, there's
a lot of
uh there's pessimism around it, but I
think it really is going to be one weird
trick and then we can massively scale it
up, you know? That's why we put all that
effort into that USB GPU. Uh, which I'd
demo for you, but it's in the other
room, so can't demo it.
Okay.
So, that's a normal
transformerish. Um, yeah. So, we're
using these things at Comma. We have an
incredibly good comma just opensourced
their
uh open source their model evaluations
which are pretty cool.
Why can't we massively scale the current
architecture? Because there's still a
bottleneck in the vision
model.
So, we have two ways of generating
images. Let me see if I can find one
that actually shows some generated
images. So, we're training with a
simulator.
Um, oh, this is just metad
stuff, but I don't think these are
generated. I think these are
real.
Um, I mean sometime will postgenerated
stuff.
And it's a
simulator. It's not going to have
anything. I don't know if that's
generated. It might be generated. It's
like hard to even tell anymore. Like
these models kind of pass the
uh Oh, here. This is generated. All
right. So you can see this is generated
using the old
uh the old warp style simulator and the
problem with the warp style simulator is
it has
artifacts.
So in order to prevent the model from
exploiting those artifacts we call it
cheating. There is uh blinding added
there's a there's an information
bottleneck between the vision model and
the policy model.
So in order to remove that bottleneck,
we have to make models that can't cheat.
But in order to make models that can't
cheat, we have to use a simulated world
model. The simulated world models, you
know, like the aforementioned bitch, uh,
don't
listen. So that's a problem. Um, well,
they kind of listen, but like if you
tell the model to go half a meter left,
it goes like 04 meters left.
And there's reasons for why this is and
they're not like super easy to fix. So
that's one of the bugs that is why we
can't switch to the new style image
generation. Um, by the way, this isn't
me doing any of this anymore. Like this
is all the comma team. I was just I've
been I've been uh hanging out at the
office, so I get all this stuff
explained to me, which is cool.
It's a comma driving through the
snow. Um, but yeah, this is open source
you guys are welcome to uh check out.
This is like the the tests that we use
to evaluate our models.
Um, some of the best ones
are No, not
that. Yeah, these these are these are
the some of the best ones.
Um, so like if you start the thing
offset, I don't know why they're
disappearing. That just looks like a bug
probably in Brave, but
uh yeah, like hugging
tests. Um, basically you like start the
car at various points and see how long
it takes to go back to the lane uh lane
center. Have I seen the multiplayer
video game inside of the Fusion model?
No.
Oh god, I just see already
like cool.
All right. We think it's just going to
work. Who are these people?
Oh, see, I knew they'd have a website
like this. Don't make websites like
this. Please don't ever make websites
like this. It's fine. It's like simple,
but like we don't want transitions on
your website,
okay? I can tell from their get they're
going to look like this. Like this is a
good website,
right? JavaScript was a mistake. No,
like JavaScript was seriously Can we
just get rid of
JavaScript? Wow. Imagine we just got rid
of JavaScript. The web would be so much
better. Your website is sus, but
everything's open source. All right,
that's cool. Yeah. No, just like it has
an immediate
like like it it looks like vibe coded
shit, but I I shouldn't judge it based
on
its you should judge books by covers,
you know. All right, let's see. Does it
have 7 million requirements?
It's kind of a what's Hydra
Core a framework for elegantly elegantly
configuring complex I think we actually
might use this a
comma no those actually don't look
offensive all
see what the
hell I like to do requirements one at a
time.
Let's torch
eval
torch. We'll give that seven years to
download. In the meantime, we'll work on
our
example. Yeah, know we use hydra comma.
I
think this is what I mean. Like I'm kind
of out of date with the latest
like machine learning stuff or we did
use hydra. I'm not sure
we still do.
Oh, Omega. Wait. So this is in addition
to Omega or Hydra is Omega. Here it
comes.
Let's find the real paper. Just like
forward noising process. Yeah. Yeah.
Yeah. Inverse process functions. Okay.
This is not rectified
flow. We shouldn't need such a crazy
model. We should just be able to get
this rectified flow thing working on
anything,
right? Maybe we shouldn't focus on the
model. Maybe we should just focus on the
rectified flow part.
just focus on what the model inputs and
outputs are. Okay. No, I mean getting
this conditioning right is hard.
Just one
[Music]
MLP. Did it load
yet? All
right. Press enter to
start. Oh god.
Regret. Press R to
regret. Don't Why did it go full
screen? I don't
know. All
right, let's just accept that it goes
full screen. Hopefully you guys can see
it. All
right.
Uh why I'm not I'm only pressing forward
in
one. What? Why? This doesn't
work. Why are they correlated? Or am I
just not driving?
which is player one and which is player
two. Yeah, this doesn't work. I mean,
it's like kind of cute,
but I don't think I was holding it
wrong. I don't know. Whatever.
But yeah, no, I mean you can do really
neat stuff with this. Like I saw the one
where they did like Doom. I did like
that their demo just worked too, which
good on them for that. All
right. Um, yeah, this is a very complex
model. Uh, should we just should we just
plow
through? Got add this add a ln
shit. Not adding that to the transform
block. Let it outside the transform
block. I'll add it in the transformer
block. Copy the transformer
block. You know, I get I get what it is.
I I understand.
Oh, they're using layer norm and not RMS
norm. I don't even know if those are the
same thing. I think they're different.
Okay, whatever. We can't import
transformer block. We can import
attention and feed forward. We'll have
to write our own transformer block with
this ad to
ln
patchified class
transformer block.
Why does it have a layer ID?
heads and we'll keep them passed
in. Does that change? No, heads is
different. Whatever.
Paul should have been listening to Tate
Mcrae and
Dochi. Doi,
man. All
right, let's get some
attention. That's always
good. Feed forward. Yeah, that seems
good. Four times
damn that crap. Do I multiple of What
does that even
do? Okay.
That's only
multipliers. And we need some
norms. Seems
reasonable. And we need add lm
modulation. N sequential. That's stupid.
even like
this. You can write it like this, but
it's fine.
Whatever. Cool.
You guys can compare the tiny red style
to the PyTorch style. I think ours is a
lot cleaner.
I don't even really want to write that.
I try to like
this. That's the tiny red way to write
this. So then why don't you put the
chunk in there, too?
What is modulate?
Why is there no start
pause just like the whole thing is
attention? Whatever. We'll just pass
zero in for that. Should be right.
Yeah, we don't even need a KV cache. I
don't think there's a way to turn it
off. Oh, whatever. Uh, okay. Fix this in
there.
All right. So, we do the gate
MSA and then we do the gate MLP, right?
Like what's the usual way to do
this? I guess that makes sense.
What is MSA? Multiscale attention or
something. Doesn't need any of
that. Cool.
Oh, there's a special class for final
layer. That's
ugly.
Lers. What are the lers? Your model has
lers. Your model has layers. Mine has
layers. They are not the
same. Uh, I don't know why it needs to
know the layer ID. You don't get to know
that. I'm
sorry.
Um, I'm like, I don't need any of that
crap, do I? Why normals
norm? I'm not even going to stop that.
Whatever.
Okay, we're going to need some freak
sessl, right?
Cool. What's special about this final
layer? All right, we'll just copy that.
Okay. Final layer.
Fin size patch size out
channels out
Chanels normal
layer
norm hidden
size doesn't have an aine fine whatever
I don't really know
I Okay, we're going to go from the patch
size. Patch size times out
channels.
Uh just say bias equals true. You don't
really need
that. Okay, same thing here.
Interesting. Why is it two times hidden
size? Oh, no. It should be zero.
See, I think that the tensa the tiny guy
way is
cuter. Call on
this. It's 2x hidden for scale and shift
vectors. Okay.
self
silly
self
nox.io
Silio selfm
modulation
chunk 2 deals one shift scale
uh return xlinear xx x
equals modulate norm shift scale okay
cool that looks
We're going to need some out
channels. Where did that come from? I
was just in
channels. Looks kind of
sensible.
Of course, it's going to be the same.
Okay, cool. Uh, we need unpatchify.
[Music]
All right, we'll just copy this code.
Probably right.
And I don't really understand it, but
whatever. So, I'm sure they just lined
up the dimensions carefully. Oh, we need
embedders for that crap. Okay,
fine. What's the T em better? And what's
the Y
embed? Time step in
better. Oh man, this looks complicated.
Do I just have that? Is that the same
one Llama
uses? If I use a UNET, it's simpler.
Yeah.
It's good to learn diffusion
transformers,
too. I don't know. I like that they're
just copying
this. No, I mean, this is a good thing
to learn, right? We're learning
diffusion transformers as well as
rectified flow. Gota got to stay up to
date with the latest stuff in machine
learning. Ah, so sorry it wasn't a co
Oh, it is a cozy diffusion stream. Hope
is everyone feeling cozy right
now? Should we let non-subscribers talk
about whether they're feeling
cozy? Are you feeling
cozy? We have a lot of
viewers. That's
nice. Thank you nonsubscribers for your
input.
We're going to need a T em better and a
Y embed. And they look
complicated.
Um, I don't know. Whatever. I'll just
write them.
class timestamp embed.
Oh, let's also link to the real min
RF. Much taken from
that. Okay.
Do I have this?
If dim mod 2. I don't think we have to
deal with that
case. Yeah, I know we have a unit, but
we're not. We're we're learning
diffusion transformers, too.
Oh, you're saying my time stamp embed is
already in there. I don't know. We just
rewrote it. It actually turned out to
not be long once you like rid of all the
crap and edge
cases. Min turn the smallest item. Okay,
I see. So, that's doesn't even
hit. All right, we have the time step
embeder. We also need the other
embed label embed. Well, we definitely
need that. How are we going to embed our
labels? Are we using cfg embedding class
dropout
prop? I don't think we need that, do we?
I'm just going to use a 10
embedding. Uh, and then we want to embed
it to dim, I assume.
I'm getting rid of all these min dims,
too.
Complexity. All right,
cool. Right, we have all our embedders
now.
All our craps embedded.
sick.
[Music]
Uh let us see how we
did. Working on the weekends like
usual. Yeah. do
[Music]
that.
Really? Uh-huh.
All right. If I set max context there,
it should uh
YOLO. No idea if that's
right. Oh, yeah. Because I didn't pass
in anything for that. Okay, good. All
right, let's move
on. What am I passing in?
T. Okay. Well, that's not
that. You're doing too much.
So if we go to the RF forward
here. Oh, LM is just like a thing. Okay,
cool.
Um, I'm not even going to support it
without lm. I don't know
why.
So this the
batch. Okay. I don't understand this at
all.
Oh, we don't have randon
like All
right. So, this is where the magic
happens supposedly.
Uh, t is just randomness and
conditioning is my y. Okay, that's fine.
That makes
sense.
Uh, batchwise MSE. Okay,
cool. Uh, okay. That's getting crazy
there.
What? Fine. Whatever. Just let's just
copy this stuff.
So
what? Why is that in
parenthesis? Oh, I see that's in
parenthesis. All
right. If you don't want to visualize
the loss as a function of the t values,
you can just use normal MSE.
Dipper 420, please stay on topic. This
is an on topic
chat monitor. Oh, you're asking to be
banned. I can't believe you just
subscribed to ask a stupid question.
model. RFX train samples Y train
samples
out. Uh, yeah, I don't like
this brand of your bed sheets. I'm I'm
gonna start handing out bands. I'm
really gonna start. You know what,
Arthur Sky Live? You just You just Wow.
You've subbed for eight months. I'm not
going to ban you. I'm just going to give
you a warning. And that's because of
eight months of goodwill you've built
up.
But you know
um list has no attribute resolve
dim. Oh yeah I don't think our tensor
cat works that way. We don't do
that. This object is not callable. Yeah,
I don't understand what's Yeah, like
this is weird, right? What is
this? Z1 minus
X. I don't know. All right. You want to
just do normal MSE then? Can I just do
this? All right. So, it's going to be
loss. I see. So you just call the model
normally if you don't want it. Loss and
t is your time step and y is your class
value. Okay, cool. Um, so I can just use
normal MSE here. I don't understand why
three things are being subtracted.
That's not an MSE. I
know. Uh, mean squared
error, right?
Oh,
uh, list object is not callable. Yeah, I
don't call that.
Um, attention needs a mask.
No, it
doesn't. All
right. Freak says shape mismatch.
Yeah, that kind of doesn't look
Right. I mean, don't we want to
like What? So
confusing. I need a me. Got that. Uh
Not
bad. All right. Can't broadcast
something.
See what why is shiftcape and scalecape
so
weird. They shouldn't be like
that. Oh, it's getting called a final
layer. Okay. Well, we're making it the
final layer. That's
good. Uh
Also, did final layer need to use C and
I didn't use
it. Seems
good. Fine. What?
I probably just messed something up. The
final
layer to do something before final
air. Didn't look like it. Okay.
Um, and also why is this called hidden
size? Can I just call it
dim? Oh, what am I doing? Yeah, I got to
pass C in here. Okay, that's a bug.
Yeah, yeah, yeah. Nice, nice, nice. I'm
happy you guys are paying
attention. Uh, okay. Name
mismatch in
formula.
What? Those look like the same letters
to me.
NHWPQC. What? This is exactly how you
should use rearrange,
right?
Oh, it's kind of
interesting. Great.
Okay, we got a model. Let's see what our
loss is. See if it actually
runs. H, it's a big
loss. Whoa, look at all those
kernels. Yeah, kernels.
modulation needs silly. It
does. Okay. is just Z1 - X - V theta.
Okay, good. Let's put those parentheses
so it's more readable. Um, so Z1 - X. So
we subtract the randomness, the
difference of the image and noise
vectors. Uh, flips the sign during
sampling. Okay. Yeah,
whatever. Wait, but how is it running?
Don't I have like a ton of layers there?
You see it running six transformer
layers. That look like six transformer
layers to
you. Looks like it's
cheating. There's a cool thing in
Tinyard called global counters. And we
can do global
counters.reset. Let's just separate the
two runs from each other.
No, something's not working. I didn't
wire something up,
right? That looks like that's going
through, right?
See, this is what's so cool about how
easy it is to debug Tinyrad. You can see
what's going on. Let's see what's going
on. All right. So, I don't get it. Yeah.
Where is the transformer?
So, there's the
randomness. Does a lot of crap to the
randomness. Put something in there.
Okay. Why aren't we running the
transformer?
Um, self. This should call the
transformer
here.
X.secom sequence. Okay, so that should
be an egg comp
sequence. Where do I lose
it? Try something
like that's a lot more kernels. Okay,
interesting. Stick it there and see if
we get more kernels.
Okay, that's doing a lot more. So, is it
the final layer that's broken or is it
unpatchified that's
broken? It's final layer. Whatever I did
in final layer, I disconnected
something. Did I
So realize it's just tiny grad to like
actually run
it. So that's still
connected. self.linear. No, that's not
going to break it.
What? Okay. So, I put it there.
Everything still runs.
If I put it here, what
happens? This linear is breaking
it. Shape looks okay.
Oh, because I replace it with
zeros. Wait,
what? Yeah, I don't know about
that. I mean, I was just multiplying by
zero. Yeah, it got optimized out, right?
Like tiny guard's
smart. Whatever.
Oh yeah, I guess when you start training
it'll it'll work. But yeah, it got
optimized now because you set all the
weights to
zero. Okay, cool. I got running what
looks like a bunch of layers. That looks
pretty good. Sweet.
Thank you, Tiny, for helping me debug
with your convenient and easy to use
debugging
tools. Um, we probably could have
stepped through the viz and seen it
actually. Okay, that's a big loss, but
that's okay. That's okay. We'll be we'll
be taking W soon. The L's the L days are
are
over. How we doing?
Okay.
Optimizer. Looks like a nice learning
rate.
Oh, that's
many epoch. Okay, we don't we don't do
epox. Let's just do steps.
thousand steps is like good number of
steps.
Uh zero
gradimizer
step print
item should
really work.
I think it
does. Oh, you think that lost too high?
Images are never divided by uh
Why on minus
one? Oh, this
bug
really. So, metal doesn't support. This
is usually because I have some bug, but
it could be for other reasons,
too. Uh, wait, do we expect those to be
minus
one? Uh, oh, probably not. I think what
we didn't do was
uh still minus
one. Yeah. Print the max. Okay.
509. I mean, oh yeah, that's Yeah,
you're right. That's obviously not going
to be divided
by I don't know how their normalizer
works.
Um, is that really how they do
that? Yeah. No, I fixed
that. Uh, it should all be fast, too.
That should just fuse with the with the
stuff. Hopefully, we'll turn on fuse air
range, too.
All
right. Now, our max is
one. Is that what we
want? Still minus one. Zero is still
somehow getting mapped to minus one,
which I don't totally understand. But
our loss seems
better. Oh, I should probably put that
in that
loop. We're just going to keep training
on the same thing. But that's
something it should be in minus one to
one.
Okay. Uh is that going to
happen?
Minus.0.5ide by 0.5. Okay, that makes
sense.
Great. Cool. That's
right. Don't need to do that anymore. Uh
all right, let's throw this in a jet.
Uh, what should I put as the input? I
don't actually need any input. I don't
think
Oh, we got to fix the I don't like that
it's the metal doesn't
work. No buffer resource
available. Is that just on the first run
through? Similar to torch.
on on here. It'll be similar
to something on the backward path is
using a ton of
resources, using a ton of
args. Um, I don't really know why that
is. One thing we can do is pre-realize
the model. Maybe that'll fix it.
No, that's so
annoying. It's going to be so much
slower if we can't use
metal.
Should we just go to the uh you know
where this will be fast? Oh, you want to
go to the tiny box? It'll be fast on the
tiny
box. Yeah, that shouldn't be too hard to
use. Yeah, we can train a tiny
box.
Um like set all that
up SSH and
shit. What I really want to do is like I
wish cloud worked. It like almost works.
I just want to really just point this
tiny grad to the tiny box because that's
the thing you really want. We're almost
there. Um, how bad
is I'll see how much slower GPU equals 1
is. And then I can't
graph. It's okay.
But metal with graph is so much
faster. I don't know. We can check it
for bugs here. And then we can move to
tiny box
training. Choosing 17 gigs of RAM. It's
a lot of
gigs. Good thing my Mac has a lot of
gigs.
Let's see the loss go
down. Cool. Got a
loss. It's going
down.
Uh, it's pretty fast, huh? We can beam.
I'm going faster.
Oh, well, perfect
timing. Lost just
nanned. Uh, all
right. We made a lot of changes.
So the pre-commit I don't
care. All right. It's on the min RF
branch.
Tiny. Is this just going to seamlessly
run on CUDA?
Or we should put fuse area on. Fuse is
going to be the default
soon. If you don't do it, it's just
uh Oh, we It's using Kudo, which is kind
of
slow. We can go on a different tiny
box. This is That's not too slow. Should
be pretty good.
That was pretty fast,
right? Do we think it
works? Okay, so it does nan out after a
bit.
We'll just let that run
casually. It's only using 1590. That's
not even using all four. We didn't write
any of the multi stuff. We can do multi
stuff. It's
good. Um, all right. So, how are we
going to debug
this? Do you want to write like a
beautiful Aski art visualizer for MNEST?
That'll be kind of cool.
And like we can like see it draw the
Yeah. Yeah. Yeah. This This will be
fire. All
right.
Sidebar.
Uh
viz. M viz.
Yeah. Can I log the activation
magnitudes? Yeah, we can get there.
Let's just let beam search finish.
Um, okay. So if we want to visualize an
MNES
Interesting. Those aren't
one. They're almost one, but they're not
one.
Good point.
a 24step grayscale rant. Interesting.
How do I like reset it?
Ask. Oh,
sick. I don't need that.
Just pixel.
Okay. Map it into
Oh, it's not squeeze. Flatten is what
I'm
thinking. Actually want
that. The last two dimensions, right?
Okay.
Um, use BJ.
What? Oh, M is
missing. Yeah, cool. Pretty sick,
right? All
right, let's write the sampler.
sample. There's a lot of sample steps.
Do I need null conditioning? Oh, let's
see how it actually does
it. Uh, no. Okay, I do.
What?
All
right. So, you have to like do the null
conditioning and subtract that. This is
from like OG stable diffusion,
too. It's not a special rectified stuff,
though. This one I actually understand.
It's returning all the steps. Whatever
Doesn't even matter in tiny grad.
If you don't compute the gradient, it'll
never use the
gradient. We need some
randomness. Going to make 16. I'm going
to make
one Chanels. one
Chanel. Um, do I want
Uh condition.
What? Doesn't have 16
categories. Oh, mod 10. I
see. Uh, that's
interesting.
What? I have a lot of questions about
that, but I guess
Oh yeah, it's just an embedding. Okay,
cool. Uh, so that shouldn't actually be
num
classes. Need to have a null
embedding. Oh, I guess that's actually
just out of range. It's just gonna Yeah.
Let's try to make
fives
work.
Shit. Cool. Trains.
It's pretty fast with
beam
5090 fuser will be one soon. We'll fix
that bug with metal. The compile model
is cached. Yeah. Yeah. Yeah, you just
have to beam once and then as long as
you don't change much, it's
not. Uh, can I multiply sequence? Oh,
that's a
plus. Oh, that was dumb.
Actually, we can do this before the
train stop. I don't even know why I'm
uh list has no attribute flatten. Oh,
because we're
returning. So 50 sample steps is kind of
crazy. Do we have to do 50 sample steps?
Let's do five.
All
right. Now train for a little bit and
now look more like an emnest. Look like
an
emnest. Okay, that's improvement I
guess.
Doesn't look like amnest. Yeah, I
agree. I don't know. Let's run it on the
All right. All right. Well, it's going
to take a little bit to beam though.
Just got to beam the
eval, but then that should start
training very
fast. All right. Is it getting better or
worse? All right. There's 17 million
places I could have made mistakes,
though. This is like a complex
thing. You should be getting normal
looking images.
Should
I? It didn't train
long. We can also try the real one
on five sample steps. Might be too
few. We don't have to be is going to
take a long time.
Oh, we should also
uh just gonna jet that. Let's jet the
sampler.
All right, now we getting
Oh, you think five sample steps is too
few? Okay, we'll go to
50. Do they actually use 50?
I guess
so. All right. 50 CFG two
Sampling is a lot slower now that it's
doing 50.
should like automatically beam search in
the
background.
Also, that's not going to change. I
should probably throw a realize on there
to prevent it from
uh running new
kernels. A bit slow there.
That sampler looks crazy, you
know. He's fast now
though. Model Nan's out.
Okay. My mother comments on my Instagram
stories. Is this okay? Is this is this
is this
acceptable? Whatever. The sample does
50, so we'll just do
50.
Um, it's fast once it jets.
got to compile all things. But with that
realized now, that should be a lot
faster. You see the difference between
that being realized and that being not
realized? It's like
uh that's stupid. Copies that in. Well,
that sucks. Also, everything sucks.
Okay, whatever. It's fast now.
Okay. So,
um, yeah, the loss goes down until it
nans. Who has
ideas? How do we debug this?
Thank you.
Place the fancy dit with conc cat and
three to four comp
layers. Okay, I think we can try
that. Look at how slow it is to compile
that. Do we have to do 50? You think we
could do 20? And that's fine. So have to
sit around and wait for 50 every
time. Guess I can have like I mean it's
not that it's slow once it compiles, but
it's just like got to like compile all
that and that's kind of slow.
Wish it runs this
fast. All right. So, you're saying
replace the
DIT three to four comp layers. Keep
patch and unpatch.
Now, let's look at shapes and figure out
how we can put some combies in
There. Look like a five.
If the white X6 can look like a panda,
you can look like a
five.
Um. All right. So
like how do I put this in a
conf like I'll concatenate
them do something
like
uh yeah, what do I do with the time in
the class? Does it make them
channels? Huh?
Oh, I see what you're saying.
Uh yeah, okay, it's fine.
that
see. Oh.
Uh, well, yeah, that's not going to
work. Uh, not
128. It doesn't even
divide. Yeah. Okay, this is just
backwards. Then I have to permute this
and
shit.
Um, yeah. Okay, fine.
That's right. Hang
on.
Uh, no. I think I still want to put them
in the 25. No, the 256 is
the height width thing,
right? That's C time patch size time
patch size.
I don't exactly get how that number is
that. Um
What? They're the
same. Why don't that
work? The other model do something
different. Oh, because of
out. What was this one?
Uh,
four. All right. Whatever.
Okay, T is not that. What's T?
I probably need to put some minus ones
in
there. I think I can use none for
expand.
Uh that's going to have a batch size,
right? But I don't understand why that
didn't
print. Um
Yeah, that's a different problem.
Oh, did I not even call and hit comps?
Oh, no, I do. Hang on. That stays in
there. That's
fine. Uh, okay. Nit comp can stay, but
these can all
go. These
Does it look like a
five? Whoa. Whoa. We're getting
somewhere. Doesn't have enough receptive
field since it's still patched to Oh,
cuz my kernel size is small. My coughs.
Oh, that's actually reasonable. Wow. I
think it's actually working. I just
don't think it's big enough. That like
almost looks like a five. Okay. Isn't
transformer block
wrong. It should be self feed
forward shift MLP scale MLP. That's what
I
did. How is it not that? Oh, what? Oh,
you're
right. Good catch.
Good catch. That's just really
dumb. It works,
too. All right, let's make dumb a
flag. Dumb
Starbucks. Who's excited for the
rehearsal tonight?
Chat's great
today. Love when chat catches bugs.
But that's fire that that just like
works. Yeah. So, I probably just have to
then I got to dump my transformer cuz
Yeah, that I mean that com is not going
to be big
enough. We can throw more in
layers. Is this normally
six? Get more comps. We can try that.
Just got to recompile because that did
that right. Wow, what a
bug. I just like read it and see. You
know
what? I mean, that would also explain
the nanning out pretty well.
You think that's
important that we take the final layer
down? Big
recompile. Shift
scale
date. Why is it taking so
long? Recompiling all the stuff I got
here.
Uh,
what? I don't sure about tiny
guard. That's right.
Um, negative index. Oh, silently uses
the last class. Oh, that's cool. Good
bug.
Um, yeah, that's the last class. What?
So, how do I actually do that? How does
the real one do that?
Why does this one not look as good as
the comp
one? Yeah, it shouldn't be doing this.
Let's fix
that. Uh null
conditioning. I mean, it doesn't matter
for the uh the other one, but it might
matter
for Well, it actually only matters the
sample. Okay. Uh oh, because we're doing
negative nine. So that's like not
right.
Okay. Use cfg
embedding.
What? I don't even really understand
this.
I don't know. Let's just do
this. That's right. No, because now I
can do minus one. It'll use the last
one. But maybe we'll make it explicitly
10. Even though minus one's
fine. Okay, that doesn't work still.
Um, okay. So, the receptive field's not
large enough here. Uh, we do six layers.
I don't want to give it
six. Looks good, right?
It's almost even a
five. Should I use Silia instead of
Relio? Is that
better? Oh, if I set patch equal to
four. I see.
Um, actually, I kind of like I kind of
like keeping minus one.
Definitely train slower with more
calves.
Be a
five. Okay. It's diffusioning or
something.
I don't know. The more things was dumb.
It doesn't help. It's just
slower. It more slowly converges to
nothing. Could my conditioning be wrong?
could also have it make like a five and
a zero, which is kind of
cool. Yeah, let's do that. Wait, that's
pretty close to a
five. I don't know if we need all these
comps. CFG. Oh, okay. I do need the
dropout.
Okay, fine. I'll write the
dropout.
Yeah. All right. All right. All right.
All
right. Oh, I see. I
[Music]
understand. Um I understand.
Yeah, obviously if I never show it that
thing, it's not going to do anything.
Okay. Okay. Cool.
Cool.
Uh, I mean, I don't even like love this.
This shouldn't be a label in better.
Let's just write this in
uh not
there. Right in here.
I want it to be minus one. All
right.
Mean it's going to debug
this. Probably wrote that right.
Oh,
255. That's
ugly. I don't know. I just don't want to
deal with that. Um
Uh did I invert the is it
backwards? Okay. If the randomness
is less than the dropout prob then we
want that one otherwise that
one. Cool. All right. That's what you
mean?
So, I just put like random nulling on
the class
signal. I did it in a different place
from the other one, too. I don't know if
it matters.
I'm also not doing an embedding
uh for this. Like we might want to do
like one hot or
something. I don't know if that'd be
better in the first
comp. I don't know.
This looks the same as
Wait, it's both worse and better now.
Why do you say that? Well, this is still
the dumb model. I don't know. We can put
it back in the deck.
Oh, why leave those
prints? It will stop printing after it's
done with the jet anyway.
Okay.
Something
maybe. What else does Chad GBT say? Are
bugs.
You're slicing the wrong axis. Am
I B5? They got five.
It's not doing a good job of being a
five.
Um,
what why didn't
that print?
Did it not Did that not actually disable
dumb? Whatever. It's clearly disabled
there because it looks dumb. Okay, so
Huh. It's definitely that axis that we
slice on.
I don't understand why it's so big
there. Like why do they even compute the
whole thing if they're just going to do
that?
They already know what the size is. I
don't get
it. Okay. Something's wrong. Like they
start to look like something and then
they just get stupid.
Um, all right. What else can we
debug? Dumb one looks a lot better,
which makes me think my rectified flow
stuff's correct and I just am messing up
this transformer somehow because it's
very complicated. Look, that almost
looks like a five. Oh, I remember what I
was going to do. I was going to have it
output two numbers next to each
other. Um,
cannot reach.
Oh, yeah. That's okay. Where's that
empty shape?
No, no, no, no, no, no. Don't do that.
Don't do that.
Uh, no, no, no. I might No, don't do
that. Is it X comma Y, X? Oh, really?
Just test miz quickly. Make sure I
didn't mess it
up. I messed it up.
What? I mess it
up. Um, okay. Put that one at the end.
Oh, no. That's not
right. Classic
bullshit. All right.
Cool. I'm from the
504. Sounds hard. 504.
Yeah. Sounds like a place you could be
from. You know, like there's places you
could be from and places you can't be
from. I'm from the 2011. See, that's not
a
place. But 504. That's hard, you know.
This is a little fiveish,
right? All right. I don't know. Is
anything really going to work if I
change the patch size? You think I can
just change patch size to four and like
everything will be
copathetic? All right. This is supposed
to be
504. I know exactly what goes
on. You haven't steered me wrong so far.
I will try your
suggestion. See if everything just
works. No, it's going to bitch me out
because I hand compute the
uh God, I don't know what that means.
Yeah. Yes, that's
um you mean this reshaped to 8
by8? That's the way I can actually just
do 36ide by patch size, right?
It's going to be D +
2. Something's wrong there.
Oh,
okay. Uh, so that's actually trying
to No, that's wrong.
[Music]
Uh, what am I doing wrong?
I put two there and that should be D.
Oh, not D plus two. Well,
whatever. Okay, that's
fine. And is that four now wrong? Is
that patch size times patch
size? Probably
is. Okay. Unpatchify is bad.
Why? Oh, because this can't be
256. That's
D. And that also shouldn't be 512. That
should be uh
You don't think it's should be D? No,
it's
D. 32 over
patch also just might not
matter. That might matter. Okay.
Uh, we're getting numbers. You see
numbers? I don't see shit.
Now, is that one wrong or not? So, that
one's wrong. I don't think we'd get any
feedback. Okay.
31688.
Um,
well, I'm more confident in
this. Oh, you think that should be the
final one?
Two more comms. Sill. You better than
Railio. It's kind of close
actually. That looks like a five.
needs more time to learn
now. Shouldn't hard code that 1,000. We
can set this
to like it kind of looks
worse. I don't know if that's cuz
there's bugs or cuz
something. Should we oneh hot encode the
conditioning when we concatenate it
in? Kind of feel like that'd be
better. Also, do we need 50 sampling
steps like it has or are we okay with
this
many? Seems worse.
Whatever. We can let that run while we
test. Uh, confirm that. We can set that
back to two and it still
runs. Ah, okay. It doesn't run. Um,
that's cuz I still hardcoded
512. So, what is
that? What should that be from like
principles? Uh, it should be this.
I don't know why it's divided by divided
by two but it
is conditioning should
be
normalized.
Okay. Should be normal. I mean we can
one hot and code it pretty easily.
Uh hey,
Oh, that's
wrong. Yeah, cool.
something. That's a good number of coms.
Or you think it's just
overkill? It's probably
overkill. I didn't see it improved with
coms. Four coms is fine. And an output
com. Okay.
Oh, we can put the patch size back to
four. You like four for the patch size.
And what do you think? Silu
or matters? Oh, it doesn't matter. Oh,
we can also do more steps. It might
still get better.
One
[Music]
heart. It looks faster now. Only at 28%
and they already look like
something. Let's see what chat says bugs
are.
Okay, it still says that's a
bug.
Uh, second tensor deflats to float 32,
but then embedding expects ins doesn't
really
matter works. But because minus one is a
Yeah.
Do that explicitly.
Why is that called TX?
And you think my sampling steps is fine?
I think I need more of
those. Should put that up to 50.
The D paper clamps. them gate scalers
are
unbounded. I think I copied that exactly
right. Silently assumes one channel
inputs. Okay, fine. We can fix that.
Why does it think I should slice that
one?
The other one also slices that one. So I
feel like I do have a bug
there. I hate freak
sis. It's the worst part of
Transformers. like the other one does
this. But when I do that, it's wrong.
So I just force that shape to match.
I don't even really understand what this
is trying to embed.
It's probably All
right. Don't even understand why it
computes the whole thing. Why can't I
just fix that?
Um, okay. The X
embeder should be safe,
right? I could actually just use Oh, it
doesn't even do anything.
It's just a linear layer.
Okay. All right. Also, we have tons of
uh devices, so I can totally just I have
four GPUs. Why am I not using four
GPUs? Try not to
We use the same
noise is way down. This don't really
look like numbers.
That one doesn't do anything about the
gate scalers being unbound,
right? Squeezing times.
So he's definitely on the input,
right?
Yeah. Okay. I think I did that
right. I don't know how I feel about
that. Well, the other thing that I could
try to do here is I could use
the T embed and the Y embed,
right? Just concatenate that to the
const. How big is
that? Also use null equals one in tiny.
I think that should work. Yeah. Yeah.
And then it just runs it on a null back
end. Uh, okay. So that's like
64. That's probably reasonable. Yeah.
Okay. Let's try
that. Um, let's also take a look at
these
embeddings. Can't use a null back end
for that.
Okay, so T is decrementing. That looks
right. And both of the embeddings just
look like embeddings.
Um, yeah, they look like
embedded.
Okay. How did I get 5090s? You can buy
them today. Buy them on uh buy them on
my
website. Uh, the box that I'm using
right now is for sale. It's $29,000.
It's a green V2 and it ships in three to
six weeks. So, just click there. Click
buy it now. Send me a wire and we will
get you a Why does it look like
that? What's
wrong? This always happens when I try to
do things like this.
Are we doing convance now? Yeah, we're
doing comments. Okay.
Um, let's try this.
We're going to take these embedders
out. Embedders are probably
fine.
Um, and then
What we want to do
is Yeah. Uh conc cat them.
It's not what it is anymore. Okay. B1
minus
one
expand B D minus one
=
2. Uh, no. Wait.
No.
What? Okay. The 64 is the
channels. The 64 is the
channels. So, I want to put the I want
to concat the 2D6 in the middle.
expand it to 2D6 and then I want to yeah
concat it on the channels. Okay, never
mind. That's
right. Yeah.
Okay, for dumb model we're going to
do this is going to be dim, right?
Silia didn't help. Just stick with
Relio. We love Reu. No, no. Sticking
with Silia. Okay, fine. That doesn't
matter. Don't get distracted. Uh,
okay. Is that good? Let's put dumb on
Why is the null condition minus
one? Would you see
that? Thought I got rid of all the minus
ones.
So null condition here is
10 and the uh where condition is selfnum
classes which is 10.
That's something.
It's definitely not sample steps if it's
producing noise, by the way. So, I don't
even know why I'm doing
that. Why does that air conditioner keep
going on? It's freezing in here.
Yeah, it's 10
now. I think I fixed
that. It like looks different. I don't
know if it's better or worse. It's also
faster. It's a lot faster. Oh, I guess
the coms are a lot smaller. That's fine.
Uh, I didn't use any learning rate
scaling, do
they? That's pretty good for a tiny
comnet.
Okay, then why doesn't the diffusion
work? Big diffusion.
We should be able to use the final layer
I believe also now that I'm using
[Music]
the there's nothing crazy in the final
layer just as a
normal. Yes. So I'll take final layer
out. Uh actually and then we want to get
rid of
that. And then
uh so the channels axis should be
dim.
Uh
channel my access is already dim. Uh
No, not
squeeze. Final layer and put it up
here. Yeah, the diffusion still looks
stupid.
That looks good still. That's so fast
now. That's
cool. All right.
So, I replace my
transformer with a
comat. Oh, I should get rid of that. But
I guess actually that doesn't even
matter because I have a final layer
now. I'm using the normal final layer.
So, that can actually stay.
Is that supposed to be add ln input?
It
is. It wants to be
something. All right. So, why does my
transformer suck so bad?
Wait, what is that coming apart
now? Doesn't look as good as it used
to. Final layer definitely doesn't look
as good as it used to.
This doesn't look broken like that
one. It's funny, baby.
I probably don't want the last uh cuz
that's going into a norm. So, get rid of
that. Not that it really
matters. I mean, still. Oh, what?
Okay.
Yeah, it did a lot
slower. I mean, I don't know. That
almost seems like I broke something,
too, because it wasn't that slow before,
but whatever. Okay, final layer kind of
sucks. Let's look over final layer and
see if I did anything
different. Um, this initialization is
interesting.
If I replace it with continuous, it
shouldn't zap the
model. Yeah, like something's like
broken now.
What was up with
that? Yeah. I mean, that's clearly not
broken in like a way diffusion is.
So yeah, this problem is not the number
of sample steps.
That com is not really
tiny. It's possible that's what's wrong.
But I will note that final layer
definitely made it worse.
Look at this crap around the edges. I'm
sure that's not supposed to be
there. Patch size patch size out
channels bias equals true.
It's definitely worse.
There's no room to write that
wrong. Maybe a padding
artifact. No, the thing is that only
happened when I added final layer.
We can put final layer back
here. Um, and I have to change that last
dim to something else.
those out channels.
I mean, that could mean nothing,
too. Let's see if it still bugs around
the edges.
Oh, this looks a lot better. Like look
at how solid it look. Like I understand
that it's not like a number,
but
still. I mean, this looked better before
I broke something.
So, I just made the CV
smaller. Yeah, this was way better
before. Oh, did I not
pull?
Pulled or did I not push?
meta implementation of dit doesn't have
the zeros. Okay, whatever. The zeros
didn't even make a
difference. I I doubt that has anything
to do with
anything.
Um, but that that doesn't work is more
fundamental.
I guess I kind of don't
understand like this one looks better
without the final layer,
right? See if it stays stable.
So, are they using a learning
rateuler? All
right, that's broken in the same way the
other final layer
is. Oh, they do set it to zero.
Wait, they zero out the ADA
modulation. I don't think this does
that. Again, I don't think this stuff
matters, but
Okay, clearly without final loss they
look more like
numbers. That one almost even looks like
a zero sometime, but so is that one. So,
I don't know.
Um,
Oh
no. All right, let's read the code.
dome never touches the rotary frequency
table but the did path does precisely
why it
breaks the first dimension is a sequence
position you keep all the time steps now
We can also just try we can just copy
their computer
freaks not use
ours. There's nothing stupid in feed
forward, is
there? No, there can't be anything
stupid there.
Um, theta dim and a
range polar. I don't think we have that.
It freaks out by the
end. Where am I doing two dim over
three? Same padding, same normalization.
Oh, did I set and heads? Heads is
right
loss. It's not
used. Oh, in feed
forward. There's something weird in feed
forward.
Oh yeah, but this is kind of
just I don't think this stuff
matters. Maybe it has a different hidden
dimension, but that still wouldn't
explain this.
I thought
this broken norms would explain this.
No, this isn't
right. Losing my attention, too.
Where am I putting in? What do I put in
for t
here? Oh, just totally random time steps
really. And that's correct.
I don't understand
that. Just train for a lot
longer. I mean, that's No, maybe not
that much. I don't know. What's my batch
size? 512. What's his batch size? Could
that be the
problem? 26
match. Also put continuous here.
Shouldn't matter, but you never
know. That doesn't explain it.
model to learn to perform dinoising
steps at any point.
Okay, I don't understand
it.
Uh oh, we can also get rid of sample
steps equals 50 from here.
Why is my transformer not
transformering? Be a
transformer. Be a
transformer.
Um, think it's any of this crap. Could
it be this crap? I don't even know.
Let's like look at something or
something.
ZT times TX
brand MSE.
I mean, they look like something
I've never found better way like like
it's still so frustrating to debug
anything. Oh, that's with final loss
off. Oh, you're right. I took final loss
out. We can put final loss back.
Uh, I mean it's still being used on the
uh it's used on the
uh the the other path this path
These just don't
work. It's not even close to capturing
the thing from the data
set. Okay.
Why is end 496 here anyway? Why isn't
end just
not? This isn't
wrong. There's no mask on the
attention. That's
right. Start pause is zero. That's
right.
The keys and values are just entirely
computed. That's
right. Don't change the NKV heads.
That's right.
We don't have QK
norms. All right, let's put the final
layer back
in and just have it replace
the combies.
Uh, you're supposed to put layer norm
after comment that
out. I guess it looks fine with the
final layer.
It looks as mediocre as the whole thing
ever
did. That just breaks
entirely, but somehow gets a low
loss. All right, let's try some dumb
normal model things.
sample the same one over and over again.
See if loss quickly goes to
zero. LR
schedule. Wait, that changes
nothing.
Oh, maybe it's because I
didn't How
does that look the same?
How does it look the same if I pick the
same samples over and over
again? Hi Pebb,
welcome. Why do I have dim equals 2? Oh,
because I'm concatenating the I
concatenate that thing to the channel
axis. How come it doesn't matter if I
put in the same samples over and over
again? Like that seems like that should
matter. I think this is just overfitting
too much.
We can turn the jit
off. See if there's any way the jit's
breaking stuff. Getting slow. But how
many
layers? Boss looks similar.
And it looks better when I don't do the
spam sample
thing. I lost 60. That was
0.55. I'm sure that works. I don't know.
So, I doubt it's a tiny red bug.
Have you trained for a while? Yeah, it's
not that.
Maybe machine learning just doesn't
work. Anybody considered that? Like,
I've seen it do great things, but what
if they're just lying to
us? Like, what if it's a
lie? Has anybody considered
that? Made them 5x5
comps. I thought transformers were magic
and could learn anything.
This like used to look better. I I don't
get
it. Remember when it like looked like
numbers?
Even early on it looked like
numbers. Why does the final layer look
broken?
That's fine.
stick some residual connections in the
dumb model. Yeah. Yeah. Now we're Now
we're
No, I mean, yes, that will probably make
it better, but
time stamping better. Could it be the
time stamping
better? There detaches I'm not
using.
Hello. Okay. Torch.x Max math log max
period a range to half divided by
half
args cat them together return
that
matches you have any thoughts
Hey, chat GPT is insisting it's that I
don't think it's right, but if chat GPT
insists, I'm just going to rewrite the
attention thing so it stops complaining
about this. Let's just move our Let's
just move attention
in. What? This stuff's crazy. That's the
most complicated attention I've ever
seen. Oh, is causal equals
false? Huh?
No, it's not attention. An attention
mask is null anyway,
right? Yeah.
No, it's it's wrong.
emnest can be too low signal for a
diffusion model. No, come on. It's It's
not
this. If it turns out to be stuff like
that, then machine learning just doesn't
work and we need to all just give up.
You mean one of the embedders is wrong?
Well, I'm not sure if we expect it to
work. Oh, we compare the outputs at each
layer. Oh god, if we have to do
that.
Um, I hate machine
learning. This is
terrible. Who invented this? Like this
is not
debugable. Remember that? Remember all
those streams we tried to do
reinforcement learning and none of them
worked
either? Just stop looking like
noise. At least I got dots. Yeah. Yeah.
Yeah. See, this guy's an optimist, you
know.
I'd pay $100 for the
solution. I'd spend my subscriber
dollars.
That one looks more like random mush
now. So dumb look works less good
now. It feels like final layer is
breaking something.
No, I don't give RL Another try. You
trying to trigger me,
bro? I thought the fusion worked. Y'all
just want to see me get pissed off. It
doesn't even work. Fusion doesn't
work.
Fucking channel size. Oh, fine.
Could my layerorm be
wrong? You can't mess this
up. This doesn't look wrong. So that
means something else going into it
wrong.
How we call it's
wrong. Unpatchified wrong. Patchifi is
wrong. No, makes sense.
X embeder is just a linear
transformation. What does the Y embed
better have to be aware of
training? I just did that there though,
right? That's not really a
problem. Can I do a single sample? We
can try that.
It's a good
idea. Let's see if dumb can over fit to
a single sample, right? That should work
if I just give it like one sample. Or I
don't know like maybe like machine
learning doesn't work if you do that.
[Music]
Uh, sample zero. Let's go.
It's doing something, I guess.
I'm not even really understanding how
these things are supposed to work. So, I
don't know if this is supposed to work
in like normal machine, like supervised
learning. This works, but it actually
looks like it's just giving me the
same noise every
time. I don't
know. Just looks worse.
Okay, hang
on. You know what? Everything just
forces you to understand.
Uh
Z1 minus
X. It's not outputting the sample.
It's giving me those shapes with
overfitit equal one.
Yeah, we're just putting the same sample
over and over
again. What images are exactly
repeating?
I don't know what you're
saying. Some of water are the same. I
don't
understand. Wait, that looks like
something.
Yeah, it looks like the dick can
overfit. It's the same five. Yeah. Yeah,
that looks like it's working
then. I don't know why that one's too
stupid.
Oh, probably because it's not I'm not
increasing the patch size
anymore.
Let's go crazy. It's set to
eight. That worked better when it had
lots of
samples. That was interesting. That was
the only time I ever seen it do
anything.
It is a five. Okay, now that over fits,
too. Great. Okay,
cool. It's a noisy five, but it over
fits to a
five. Um, am I setting sample steps to
one? Set sample steps to 20.
Okay, that's good news. Overfitting
works finally at B of
five. All right, so why doesn't normal
training
work? Well, let's see if the DIT one
works.
The comp one
works. I also set the patch size to
eight. If I don't set the patch size to
eight, I I think it can over I think it
can't. If I don't set the patch
size, it's the class distribution. It
should be the normal thing.
Um, I'll also point out that the null
conditioning is also five constantly
when I do this
overfit. So that's not really
right. Yeah. Okay, cool. Oh, those are
some nice looking
fives. It kind of works with the patch
size
different. Okay. And the vit does that.
So, thanks
VIP. Uh, I don't know. Let's make the
patch size eight, but set overfit to
zero. I'm glad it overfits the five
though. That's the most promising
thing. With normal transformer and
removing time step embedter, I got it to
work. What?
Tell me what you
did. It's my attempt in torch using tiny
badge
[Music]
size. Those look pretty
[Music]
good. Sort of.
something. So, it's not listening to the
conditioning
clearly. I'm not sure it
should. It's struggling with
conditioning. Yeah, it's just like
blurring them all together.
It's patch size
eight. Flavio, tell me what you did.
Okay, here. Oh, you got
something. Where's the
diff? Okay, so you got rid of that shit.
did train likely
quickly. Are you trustworthy? You're a
subscriber. I kind of trust
you.
Uh 3K steps. Okay.
And then what do you use for ad ln
input? You use
nothing. Oh, you just added to the con
that was 2 in.
Okay. Why do you have something called
Why did you change the embed there? You
got rid of the time step
embed. Why doesn't it work if you add
the time step embed back?
Uh, wait. Huh?
Oh, what attention did he
use? Okay, so you copied an
attention. It's no different from the
one I'm using,
right? Change zero.
Got
it. Okay. And then you get rid of the
Are you still conditioning on the final
layer? No, you're not. You got rid of
that, too.
So you just use like a
naive there's no final
layer.
Um like Okay. So you're just
You just do x plus equals self.y and
better
y. I mean that's an idea with dumb
actually. Uh
I left the final layer. But it's
interesting that you think the time
stepping in better is breaking
something. Or like that one didn't
work. I'm not even really sure why we
need that. I don't understand these
models well
enough. I mean, that looks like better.
I don't know. It's supposed to be just
overfit to the
five. It's clearly the
five. Oh, and then those are the wrong
class conditions. Okay.
Wow.
Wow. Nice
work. Okay, that's the overfit one. So
now I'm running the non-overfitit one
over here. It's got to train a bit
longer. But these look much
better. Yeah. And those make sense why
those look like nothing because those
are class conditioned on nothing. CL
like that's the only one that's actually
class conditioned on a five. So it's
actually listening to the conditioning
which is really
nice. Well, I'm not so sure it's the
time stamping better. Let's not be quick
to blame
that. I mean, yeah, that's 504. It's
visible
now. I don't know why the contrast is
wrong, but it's a different
problem.
Okay,
so that
Isn't tiny ar a range different than the
one in pietorch? You mean
this?
No. No. It's going to do the thing you
expect. Like tensor range half is going
to like go up to half. Like that's
right.
I really understand why it doesn't need
the time stamp it better.
I think those work. But yeah, it's
clearly less clear without the with the
time stamp embed that are in there.
Yeah, this is broken
crap. The overfit one kind of works.
Okay, take 200 steps and then that thing
hard over fits the
fives. Let me see. Once that's gone, it
really Okay, so there's clearly a big
problem with the time stamp embedded.
The problem might not even be the
transformer.
Try putting the old transformer back
in. Looks way better.
Why does it even need the time
step? We'll get
there. So, we put back in that weird
transformer block. It's using layer norm
instead of RMS
norm. What's the difference?
I don't really
know. Oh, actually, no. I want to also
take out the
conditioning because the other kind of
conditioning should just work.
Yeah,
that RMS one doesn't have params. It has
params. Oh, don't you love when you just
have, you know, four casual 5090s just
like sitting right over there that you
can use?
Hm. You could have that too if you buy a
tiny box
today and you will have it in 3 to 6
weeks. That could be you.
All right. So, how did we mess up the
time stamp
embedding? Why is this so much slower?
It's going to compile or something.
What? I don't get
it. It's
compiling. I don't get why that should
have changed so much.
Yeah,
same. I don't know why that's so slow,
but whatever. How is that one not slow,
but that one's slow? It's going now.
It's a lot
slower. Okay. So, it's clear the
problems in the time stamp better. Let's
see if the conditioning starts to
actually do
anything. Why is it so much
slower? Oh, is there some There's
probably some fusion issue there.
So, it's crazy that everywhere we go, we
sell you
that. Why don't I just sell you it here?
Now, let's read the time stamp in better
five times and figure out what's wrong
with it. Hopefully, that's going to
train faster.
So we're
done. It's a little faster, I think.
The transformer is just a lot
slower.
Okay. /
two
x torch a range start equals
zero end equals half. That's the same
thing divided by
half. Args is the outer
product. Concatenate the cosine and the
sign. That's the embedding.
I don't know why that it's so much
slower to use that transformer than the
other
one. It's the same looking though,
right?
something like compute this and do some
crap. I don't know what that's a Is that
not the crispiest five you've ever
seen? If only it was all that crispy.
This might
work. So, how come I can't use time
embedding? Why doesn't time embedding
work? Great find, by the way. All
right.
That's slow.
What's
that? There's one kernel there. That's
slow. This
one. Why?
Why does it have 81 args? 87 args. Oh,
there's some
bug. Something's got to be contiguous.
That's
not stupid tiny grad. Okay, this is the
first annoying tiny grad thing I've
seen.
Um Oh, get dark cuz I need contiguous to
the end of the transformer block. It
should also fix training with metal, I
think.
Maybe. I don't
know. I mean, contiguouses again,
contiguouses can just make things
faster. They don't necessarily uh No,
never mind. I did not fix the training.
But what did I do before to fix speed? I
put a contiguous down there. That one I
didn't need.
Yeah. So, like these are just like
they're annoyances and tiny gradeduler.
All right, that's pretty close to 504
now. Let's do that.
Wow, it's so much
faster. Yeah. Notice how the No, no, big
args is still there. No, never
mind. Look at that one. So many
args. I still think it's faster, but
Oh, look. That's so
slow.
Backwards. Need them both. I don't know
why I took the other contiguous out.
How is this shit faster on my Mac than
it is on my
5090? What's going on here?
This
one. Oh, maybe continuous
backwards. All right, we'll look into
these tiny grad bugs. They're not bugs.
They're just Okay, there we go. Now
nothing is
big. Will it even work with
metal? This never really trained
transformers before.
Sick. No, never
mind. It was nice while it
lasted. What's that one that's slow?
mall backwards. Get item.
So much work to do in the
scheduleuler. The big one's gone. You
can look and see if any of them turn
yellow, you got a bad one.
scheduling all the steps.
Now, I could probably throw a contiguous
in there, but that seems fast anyway.
Okay,
cool. That's a lot
faster. Like, beam doesn't search for
things like this, which maybe it should.
It's a solid crispy five. Look at how
crispy that five is. It's a crispy
looking
five. That train
more. Why doesn't the time step in
better
work? It's interesting when only one
piece is broken and it wasn't even that
necessary.
Um, so we don't even put T in the model.
A, what's wrong with T?
You can clearly see it becoming
504. Can't believe someone suggested we
switch to C4.
Okay, we got a strawberry. Oh, 504.
That's looking pretty good. Let's fix
the
TE's. Strawberry
basil. All right, we'll let the
non-subscribers comment on how nice the
504s
are. Do they even understand what
happened? Nons
nonsubscribers would like to comment on
how nice the 504s are. Why doesn't this
turn
off? Thank you. My flies on not psyching
me out.
All right, we got to fix the time
stamping better. How does that one thing
break
everything? They're pretty fast, too,
right? Fix a scheduleuler. What? You
don't like just having to randomly stick
contiguous in places in order to make it
fast? Oh, well, the machines are
learning. All right.
subscribers. Let's fix the T
embedding. It must be generating
something dumb.
I mean, that looks like an embedding to
me. Oh, maybe is it supposed to be like
like if I'm like near it outputs
something near
All right. It even looks like it's doing
that. Um
If I multiply it by zero, it can't hurt
anyone,
right? And we'll just try multiplying it
by one.
Okay, this looks fine. I mean, obviously
when you multiply something by zero, it
doesn't do
anything. Let's try multiplying t by
zero.
So it's like a fixed thing. So that
shouldn't change
anything. That changes nothing.
Oh, could this be like some like sign
bug where it's actually adding
noise. Oh, that'd be
wild. Like that's kind of what it looks
like,
right? Like it learned how to add
noise. The problem's actually giving it.
It's not the embedding. It looks like
it's actually just giving it exposure to
T.
So, where did I get the sign wrong?
All
right. That sound plausible, guys. I
don't
know. Making things up
again. Arnold.
[Music]
T I notably don't do no grad on this
either. I don't think it matters, but
considering that I am using the same No,
that can't matter.
I
mean it doesn't
matter. Okay, so the T's are completely
breaking it in like a really obvious
way. That's
awesome. We have like with tensor test.
Yeah.
Is that the right way to do this? Let's
just copy from here. You just decorate
it. That's the right way to do
it. So, I I played with this to get it
like right and I wasn't really happy
with any of it.
Okay. So clearly like it's like like
noising
it. Sigmoid's going to be from 0 to one.
Where did I forget the minus
sign rand
n l l l l l l l l l l l l l l l l l l l
l l l l l l l l l l l l l l l l l l l l
ln is definitely true which I don't
really understand what that This
minus = d *
vt null com all looks
Right. Concentration. I don't
understand. Don't you people have jobs
where you work eight hours a day?
I focus a little more now, but not that
much. It It really almost looks like
it's like noising
it.
Wait. Okay. So, that's if I mask T
If I remove mask T. Yeah, it just gives
me
noise. It's learning
noise. But I think this is like I I
think this is like a deep logic bug. I
don't even think it's
like machine learning
related compare my TX. Okay.
It just looks like everyone is some
random thing between zero and one.
- tx *
x + tx
*
z1. Those parentheses are correct.
Patchwise MSE that doesn't
matter some debugging
loss
sigmoid. You think it's missing a one
minus x during sampling. But why do you
look it is doing that
right?
Yeah, it's going that
direction. I
mean, it can't hurt.
It counts backwards,
right? But that does feel like the
buck VC minus VU. Did I get the polarity
of one of these things wrong?
No.
Okay. Well, that's no
better. Let's clean some stuff up.
It's not
this. Not this.
I love that this is a clear bug. Like,
we're just going to find out what the
bug is. We're going to fix it. We're
going to have a celebration.
Tinier
DT times VC
images.append should directly compare my
time stamp embed. Yeah, we could try
that. I'm open to that.
Don't depending on much, right?
Yeah, it works well without
those. There has to just be some
bug. But like I looked at the output of
the time stamping better, right? Like
it's not like
It's because the model knows the time
stamp. It It's not the actual time stamp
embed itself.
varies exactly how you'd
[Music]
expect. Slow variation over
time. It looks Gaussian. It's It's not
the
bug. I can't be totally sure,
but it's the kind of thing that doesn't
look like the
bug. Then when I mask T, it just becomes
a fixed thing.
I mean this is good because it forces me
to really understand rectified flow.
Let's go understand rectified
flow. What is MSEM mean? What does it do
with the other
thing? I don't know about that.
Range loss.
Oh, those are just beautiful
numbers. Okay. So, let's understand what
this is doing.
Uh we always call sample
with
Yeah. Full value equals 1.0 divided by
sample
steps. PC = Z
= V minus
No, that doesn't make
sense. Like I didn't detach it, right?
Oh
no.
Um, all right. Let's understand
rectified
flow. One minus tx time x the input. So
that's just like
how noisy it is.
I don't even think I think I should put
this logic here.
It doesn't make a difference. I just
think it's more readable.
So it's just a generic denoising model
now. Like I see why that works.
for the
[Music]
loss. But definitely is the same as
that,
right? So I don't understand. Well, I
guess that's kind of how you need to
broadcast. Fine.
Okay, good. Refactor works
fine. I don't understand this loss
function.
These are not the problem. Tiny doesn't
have issues like this.
Your junk has issues like this.
Okay, don't be so arrogant about tiny
crash logit normal
sampling. It's logit
sigma. I didn't multiply
it. Do I have to multiply
it? I just put it right into
sigma. Math pi over math is square<unk>
3. You can do that.
decides how much noise it
has. Null conditions always not
none to the Z
minus. I mean, okay, we could just start
comparing things and I'm almost at that
point, but
Let's just put a one in
there, which is kind of a
lot. Like that's never going to see one.
Again, it shouldn't
matter
because it's Python 3. That's a normal
divided by I didn't like mess something
like that
up. I tested those
two. Wait,
what? It's
fixed. Oh, that's sketchy.
the contiguous has changed
something. So, it doesn't work all the
time. Or maybe I just got
lucky. I don't
know. That's hella strange.
Oh, this is just some jit
issue. Oh, it was a tiny grad issue.
Oh, yeah.
realizing that and that did
something. I don't
know. Okay.
Strange. I should have tried it without
the jet just in case.
And it's still better without
it. I should have gotten rid of mask T
so
fast. I can't believe. Okay, I was
calling realize there, which is sketchy.
I shouldn't have I don't know why I
called realize there. That's just
sketchy. So, it's probably just seeing
one the whole
time. Um or I don't know. I just got
lucky. Wait, why is it getting
slower? I don't know.
No, it's still
broken. Never mind.
Okay, not that. We just got lucky that
time. Okay, I think that actually
changed nothing.
I know that null con is not always null.
What do you
mean? It's never
null. Yeah. Okay. No, it's not this.
It's not a tiny crap bug. I take it
back.
That's
noising. I know they had an F for that,
but I don't need that F. That F
st got
fired. Okay. It like tries to go
somewhere and then it doesn't.
Unless you turn
off the
T. All right, let's understand the math
of rectified
flow is rect I don't know this is just
some
example that I found on the
internet. Okay, it's clear it's not the
jet or tiny red bugs or anything. I take
it back.
It feels strange that range starts with
sample steps and that that's going to
put in
one. RF is clearly being created with ln
equals
true. Normal sigmoid
Okay. Jet does the same thing.
Let's take a look at some
shapes. I mean, I don't know if this is
a training bug or a sampling bug. Could
be
either. Oh, you know what we could do?
We could just mask the T's for sampling.
See what happens if we do
that. I don't think that's going to
work.
Great. Violates the top rule of machine
learning.
puts in threes and 256s. Um, okay. Is it
possible that it doesn't work in a batch
somehow?
and I mess up the
batch. That's an interesting hypothesis.
Wait, how do they look
identical? Oh, cuz I'm masking T. Duh.
useless. It's the same
Um, okay. There's a
theory. What DT type is
this? I missed the DT type
conversion. Tensor A range is going to
return a
float. I don't even know which is
binding harder.
Did I try *
01? Why do I think that's a good
idea? Interesting. So that's
a
interesting. That's an end.
the name.
Huh? I thought that said that D type was
an
ant. No.
Yeah, that works.
Why do you think that's a good idea in
training? Well,
okay. Okay. I mean, I can try it.
I don't understand that.
I see no reason why that makes sense.
Uh, I don't even know how this is
supposed to work.
Oh, it's definitely interpolating and
training. You can just I mean you can
see
it
Right. That's That's actually a
sampling, but I've looked at training,
too, and it's the
same.
Gosh, that's not taking very extreme
values and it's not going to because
it's a
sigmoid. Like again, that's shouldn't
really matter.
Ram
noise. Um
All right, I set it to half now and all
the
It's copied exactly from the Facebook
one. 9 to5 office worker, you are
actually banned. You've subbed for three
months and you're asking this crap.
All right, nonsubscribers. Who has
suggestions? There any nonsubscribers
here with suggestions to fix the model?
Like, what? That looks
broken. It's so weird how it's breaking,
too.
Um, do plus one there. That doesn't
break nothing,
right? It's not inverted. Oh, yeah. you,
you know, I I feel a little bad banning
subscribers, but if you're not a
subscriber, the belt is
off. It shouldn't matter if I mask T as
one, right?
Wow, you gifted him a
sub. Wow, that's real polite of you. I
would have gifted him
shit.
Um, what is
it? Oh, what is max period?
Masking it to one changes
nothing. It's literally almost like it
wants to add
noise. All right. You want to add noise
so badly? smoke a whole
pack. All right, let's see. Let's like
double check the polarity of this. So
here, if TX is 0, it's closer to the
original image and if TX is one, it's
closer to all noise. Okay, that's makes
sense.
I think I found a more aggressive way to
add
noise.
Noisifier. It goes from noise and makes
it even
noisier. Okay. Okay. Well, that clearly
ain't
it. How do you deal with the feeling of
I should have accomplished more by now?
Do you think I have that feeling?
Sounds like some imposttor syndrome
shit, which I've always established was
for
bitches. I should have done this. I
should have went with that guy. Oh my
god, my rent's high. Why? I should have
realized, George, you should be more
sensitive to other people's
feelings, but he's not a subscriber. Ah,
good point.
I don't
know. Should we just like like just
establish that like you don't need a T?
We just made the first Tree diffusion
models because when you add tea, it's
bad. Someone might spill it, you know.
If you get rid of
T. Well, Beatrim, you subscribed. Okay,
I'll give you a real thought. Why do you
Wow. Okay, if you're going to be aggress
I was going to give you a real answer,
but if you're going to be aggressive, I
mean, no, like it's just it's kind of
like questions like this are stupid.
They They really are. Um there's not a
better answer for that, right? There's
not a better answer for for
uh Yeah. things that look like like
imposttor syndrome. Like it's not
um you guys know about Freudian
psychology. Freudian psychology says
that if there's a problem in your life,
it's
because of your childhood, right?
Because of something that happened in
your past. Oh, you don't like fetuccini
alfredo because you used when your dad
used to come home for work, he smacked
you with a belt and made you eat
fetuccini alfredo. I mean, that one
might actually be true, but people come
up with all these stories about how
they're impacted by their childhood. Um,
but we can flip that causality arrow.
And maybe the reality is you never liked
Fetuccini Alfredo. Maybe you were just
born that way. And then you come up with
this story about your dad and the belt
and you use that to try to explain some
fundamental fact about yourself. And a
lot of people try to do this. A lot of
people like to come up with stories
about themselves. But the truth is the
story is not true. The the part of your
brain that makes up the story is
completely different from the part of
your brain that finds fetuccini
disgusting.
Oh, is this a study? Oh, then they the
why people are the why people are here.
Why are you doing this? Is this a study?
Dude, I don't know. Like some people
wake up in the morning and watch porn
and jerk off and I do that sometimes
too. But this morning I woke up and
decided to do rectified flow, you
know. Yeah. Huh. That's right. Huh.
Huh. All right. So, I I mean, it'd be
cool if someone finds
this, but how are we doing
You should stream the other thing too.
What other thing should I
stream? The
Wordle mean some like New York Times
shit.
No, I don't trust the New York
Times. You're like, "Oh, it's just a
word game. It's harmless." Yeah, but I
don't trust them. You know, after what
they did to Scott Alexander, how would
you trust the New York
Times? Oh, I should Oh, I see what
you're saying. Yeah, stream the other
thing, too. I mean, nah, that's behind a
payw wall. And like you're going to
subscribe to my Only Fans and then
you're going to find that the the
jerking off video is not even there. You
got to like go in the you got to message
me for that. And then like we have like
a whole menu. We do like dick ratings
and stuff, you know.
Whatever. The New York Times doesn't
trust me. Good. It's mutual.
I don't know if setting that to zero
matters, but the other repo doesn't. So,
we'll do it,
too. Uh, George, what comp rate your
mozzarella stick? Oh, that's I'm hungry.
Yo, that's a good
point. Um, that you bring up a good
point. Uh, I need food. Uh, I didn't eat
lunch
today. I just worked on
this on my stock portfolio. I don't
know. It's all right. My AMD is doing
pretty good. AMD's up, right? Is AMD up?
Let's check the AMD
stock.
AMD
stock. Oh, good. It's up. This a good
day. What are you expecting to happen?
Well, they be it becomes 504. That's
like a hard area code, you know. 212.
That's pretty
hard. The 718. No. No. You're not from
the 718.
No. Was for a blog article on the
Spanish power grid? No. I don't I don't
know. That's Someone once told me in a
comment that I should stick to
programming and we're going to take
their advice. That's
right. Uh, no. It becomes 504. It
actually works. Uh I I I don't know why
the the tea doesn't work. Maybe someone
can figure out why the tea doesn't work.
I was kidding about that. I would never
take someone's advice like that. Um
because that person is an angry person
and I'm an angry person, too. So, you
know, we have a lot in common. And maybe
I should take their
advice, but
Nah, you know, you guys know politics is
stupid. Uh, everyone can read the
serenity prayer tonight. That's a good
thing to
do. I mean, that one looked real
504ish. Okay, so I don't know why the
T's don't
work. Maybe someone can figure it out.
I bet someone will. I bet that's the
kind of thing where someone actually
will uh
More stuff to clean up.
If you're going to do this to do, please
have tests and write the code
decently and don't use
AI. I know if you use AI, everyone knows
if you used AI.
Much
nicer. That was too many lines.
Yeah. Yeah. Go ahead. Yeah. You use
cursor. Yeah.
The highlight of the stream was MV. MV
is pretty nice, right? Look at that
solid looking
504. I think we can merge
this.
Um, okay. Get
pull steps 9,000. We don't need auda
visible devices. We don't need mask t.
We'll do it without fuse a range and
we'll see how slow it is just so we can
do it without. We don't even need
actually steps 9,000. We should just
change
that. How many steps was that to like
look good? 5,000 is a good number of
steps. All right. I want it just like
work out of the
box. A different time stamp embed works.
Really? So, I just have a bug with this
one. We might get to the bottom of time
stamp after all. I'm also starving. I
can't wait to eat something.
Oh, yeah. Oh, yes. We're definitely I
mean, he came up with this stuff before,
too.
Uh he he was the one who came up with
the stuff before, right?
I wish I had a lamb bottle.
So then is there just a bug in my
implementation? Very tiny. You know what
tiny rocks cost me right now? So
expensive.
Well, yeah, but okay. So, this one might
work just because of
uh I mean, it's not making any
assumptions that the T's are contiguous.
I'm actually surprised this works. I
mean, it's just kind of going to be
noise injected,
right?
Unless Yeah. No, I'm not sure that this
proves that this time stamping better
works because like this freaks is all
just noise.
Uh
no no the rand won't require the there
won't be a gradient there. Rand
explicitly disables
gradient. Uh you don't have to do that.
I mean, I think the problem with that
time stamp embed is that it doesn't have
any preservation of any uh
like,
well, that's not exactly true.
I'm going to go get some potato chips or
something. I'm not even sure if ranges
make a difference.
Okay.
Something. All right. I ran into my
coworker in the
hallway
and similar to similar to
uh Flavio's suggestion, congratulations
on being a VIP by the way.
Um, also the other thing is the stuff
about like params and stuff. You don't
have to ever worry about any tiny like
tiny just doesn't have these problems.
um where that will try to be
a an optimized thing
um because rand n has requires grad
equals
false but okay so his suggestion was
twofold. Well, so first off, this is
just the thing copied
from from this
um Are we sure this code
works? Oh, we're going back to subscribe
only. Are you training AI to recognize
504? No, we're training AI to recognize
hot
dogs.
Okay. So, his suggestion was just that
Uh, wish that that would turn
off. Why does that listen?
Freezing in
here. Off.
This looks pretty
good. I don't know. I don't know why the
real one didn't work. This works.
And it's shorter.
Now it can learn whatever it wants for
the
TE's. Yeah, it's just a regular
embedding matrix randomly initialized.
It's pretty much what you
had. So, it just like it just like puts
it in and then
Yeah. I don't know why that one doesn't
work, but does it matter?
Nope. Okay.
I'm totally fine with that. The T's are
going in in the way the model the best
sees
fit. I don't know about that frequency
and cosine and stuff. Maybe it was like
trying to comput a derivative through it
or
something. Maybe it was like I don't
think so, but
possible.
Um for this let's do uh let's do sample
steps equals
50. My coworker also
suggested that it was designed for
things that don't range from 0 to
one. So, I don't know why it's like this
in this repo, but does this repo
work? Someone like tested this repo?
Like, maybe it works with
uh I would bet it works. I don't know.
Or maybe I just had a
bug. Oh, finally the air conditioner is
off.
Okay, these should be the nicest 504s
we've seen.
Um, is the time stamp related to the
patch coordinate?
What the time stamp is just like where
you are in the in the
flow. Okay, we have an award for the
worst suggestion from the stream. It was
that emnest is too small to have working
diffusion and that you need. Okay, this
is the kind of idea that is awful. Um,
and I'm not really hating on the idea
because I always have this idea too, but
almost always if your stuff doesn't
work, it's due to a bug. And if your
stuff, like if it
needs, oh, it needs imageet. Oh, it just
needs larger scale. Oh, that's just
that's just too horrifying to think
about. So even if it's true, I'm going
to assume it's not
true. Yeah, deep learning needs big
data. Yeah, that's
scary. All right, what else we got now?
The best
uh suggestion from the stream was to
disable the timestamp in
better. And the best work in the stream
was writing the beautiful. How nice is
it that you can just use the command
line to train things? I don't know why
no one's written an emnest visualizer
like this before. The other thing like
writes out GIFs and JPEGs and yada. old.
Let me just SCP this GIF over to my
computer real fast and then I can read
it. That sounds
terrible. Um, thank you to the Tiny
Corporation for providing this tiny
box. It's probably making a lot of noise
in my office.
Uh probably if you wanted to get rid of
this last bit of instability, what you'd
probably want to do is have a learning
rate
schedule. I think a learning rate
schedule would work nicely to get rid of
this.
But it's being creative.
biggest self-doubt moment thinking Tiny
Grad was broken. Good point. Good
point. Um, it still might have been No,
I don't think it was Tiny. I don't know.
I I don't understand how it works for
the other guy. Um,
yeah, we're putting the time stamps in.
I don't know if that's supposed to
We could also concat the
embedders. I don't these things matter.
Like I guess like these spaces are
linearly discrete flow matching. I feel
like I've heard about this one. I feel
like people are excited about this.
see what discrete flow matching
is. Hey, look. We did something on this
stream that was accessible to people.
Then why does Llama 4
suck their diffusion LLM is based off
this stuff?
Yeah, I don't know. I I kind of don't
think I mean watch me be proven wrong on
this, but I feel
like diffusion more mimics how I would
draw a picture and like auto reggressive
more mimics how I would uh write a
paragraph. Time to do rectify flow with
the comma video data set. What do you
think we're doing?
Uh yeah, we're
uh we're going we're going big this
year. Comm's going
big. Big data, big
transformer. What are you looking at?
You're looking at
five. All right, we're
done. It got pretty good by the end
there. That's pretty
solid. Wow. I love machine learning.
Like that's so
cool. You can take an MNES data set and
you can like generate samples. You can
like sample from the data set but from a
fake part of the data set where like
they look like this and you can
condition these samples based on a class
and it works on like huge things. I love
machine learning.
Oh, machine learning is so cool. Okay,
thank you for watching today's stream. I
appreciate most of you. I appreciate
subscribers a bit more, and I appreciate
VIPs the
most.
Uh, yeah. Yeah, it's better than an
autoenccoder, but it's 50 steps of
diffusion. You're putting that compute
to the test
time. Yeah, there are VIPs. Someday if
you study hard enough. Yeah, I don't
know. Adilarian psychology.
what
this paper's pretty old this paper's
like two years
old
no those this needs
double this
doesn't I don't know I'm just not like I
hate this does everybody struggle with
this I feel like I struggle with this
stuff all the time just like getting the
dimensions to be right I'm sure everyone
struggles with
it there not true George there's super
Geniuses out there who don't struggle
with it never mind I believe
that um well that's just not
right
oh the last actions oh oh no this
doesn't
work okay why aren't we going back to
why can't I just predict the three
together like why don't I just
[Music]
group AR ARS
together I see no reason why that
wouldn't
work because it's causal
so the question is kind of where is the
auto regressive
nature uh and they kind of don't answer
that in the okay
so you put in a state you get out an
action you take the action right then
you feed the action back in that's great
that's normal gbt stuff the reward and
then the
state the question
is is that all done Auto regressive when
this samples the next
action no because there's no
sampling
I'm just
gonna this is
dumb I'm just going to do this unless
someone can tell me why I can't just do
that
uh speak now or forever hold your piece
why can't I just concatenate the
dimensions together why does this
actually have to be three steps of the
Transformer
could it be a causal
problem there definitely is causal
masking there but it's not like those
outputs are even used so why are they
not just concat why are they just not
catted
together can someone actually explain
this to
me wait twitch gave you a substance
warning are people watching my twitch or
are is there is there weed
AI which which detects if someone smokes
weed on
Twitch who who bought weed
AI you know what I mean it's like hot
dog and not hot dog but weed and no
weed if I we'll try vaping next stream
and see if we get a contact warning wow
well at least they gave you at least
they gave you a warning everybody should
be in tile to
Choice um my Chinese food will be here
in 15 minutes that's
great okay so you see what I'm saying
like could we just concatenate these
together I'm just going to do that
that's so much
simpler yeah that's so much
simpler so let's concatenate them
here just do it at the dimension
[Music]
level I'm just use that and have a
completely separate head which predicts
the output so let's just do
that is there a reason I can't do
that let's ask
perplexity
all that one's too
slow
that makes no
sense I don't really get
[Music]
this it's really hard to check if you
implemented it correctly I'm not trying
to implement it correctly I'm trying to
implement something that
works the only problem is I put in a
fake no I don't even need to put in a
fake
action I what do I do about the first
one
one let's have yeah I'll just make a
fake
action okay so let's start thinking
about it as
a r
s right and that's like a
token that's a token uh the start action
is always fake I don't think that's
going to affect anything I might
explicitly want to call it a fake
action just do action space plus
one um and then I can probably do minus
no I probably can't do minus
one
[Music]
uh yeah okay well we can't do that every
time the next time I put I put the real
action
in okay great put them in the right
order uh let's look at the shapes cannot
expand
yeah don't need
that no I think I actually want
three a batch time and then the
thing
okay it's all that's fine so then we can
catenate them on the minus one
AIS get rid of these weird time 3es and
these weird plus
ones okay let's just copy that from
gb2 great yeah BSC CL okay
great
uh
mask realiz l
yeah minus one there because we're going
to want to train using that same
thing uh don't worry about that because
we're not
training okay why is that true oh
because I did Count minus
one uh oh no that's start PA so that's
right take a look at
this no the mask is
none no we need to keep that there okay
that's
fine
oh why do I have this just got so much
simpler now we can catenated them I I
don't understand what they're saying
about the causal structure uh it's very
possible
that certain not x. requires grat but
I
oh
that's
annoying okay now we have stupid stuff
well can I just not use
GPT entirely the only thing that I have
to
change if not is instance tokens
variable how could tokens be a
variable oh I
see interesting I didn't know we
supported
that well that doesn't work
anyway this is not a trainable
Transformer uh but okay the problem with
that you can actually set start pause to
[Music]
zero like I've had this problem
before
oh I know the
problem it's
because usually this avoids the jet
because the size is not
uh we have bugs in this
implementation usually you have okay so
usually you have a uh a
multi-headed
usually your first token is a long
sequence like think about when you're
using a
chatbot um or even when you're using a a
language model with a prompt right your
prompt is your initial sequence and that
initial sequence is why this works and
why it doesn't work
here uh shouldn't I update the target
reward yes I do have to update the
target
reward
okay and then we do rewards to go when
we're training this and this should all
work um okay it's annoying that that
doesn't
work it doesn't like doing that
initial sample let's take a look at what
it's doing here 192
mod something that's clearly a lot
bigger than
[Music]
192 just fix
that she had a test a symbolic for
it okay so symbolic is the back end
that's used to render all these uh
shapes after I smoke it's harder to
talk I think I I still understand it
it's just like with like a different
sort of
vocabulary at least I think I still
understand it who really
knows put a number like one 2 and let's
mod at
384 and we expect the answer to be 192
and just
want see if that
works well that's also a number which is
not
fair oh this doesn't work because 192
mod 92 is
zero so if start pause is zero
there that's zero but if start pauses
that's stupid you see why it doesn't
like you see see how this going evaluate
you two things based on the value of
start
pause
um it's not going to work is
it
yeah
so where do I pass in start pause in
here to the Transformer
block
yeah
uh I wonder which function actually
breaks
that should we fix this in gpt2
first should we fix this
bug
I don't like the nun
thing
this is what's
failing this might be
fixable
simply
okay
uh oh no part of the
problem like you want this to be
zero I think probably it can be zero how
do I deal with this in
GPT one if St pause else
zero fails on the first run though
right do I need the
cash it's very slow without it and then
we can't jit with about it this is
showing me where tiny grad still not
quite usable I think my Chinese foods
[Music]
here it is a glorious day for eating
Chinese
food these are handful
noodles
hand pulled
noodles a bit of sauteed chicken some
vegetables
spicy
delicious this actually pretty
authentic
I read stuff like this in
China and yeah I'd shove my Chopsticks
in like that I've heard it's offensive
in Japan but I'm offensive in America so
why should I change that's not true you
should respect other
cultures
that's really a terrible bug I think we
need to fix
that let's replicate it in
gbt
so I can run this
uh
what oh because hell is a single a
single uh yeah you see look there's a
replication of the problem in
GPT so let's fix it
boys wow we eat Chinese food I'll move
the mic back a little you guys can hear
the Chinese
food
and wish you had some Chinese food of
your own this dream has been brought to
you by Uber
e which probably no matter where you
live you can get Chinese food and if you
live in California or New York or a
place with a large Chinese population
you can get authentic Chinese
food
there's so much to fix in tiny grad I'm
glad we're I'm glad we're fixing things
by the way this is the schedule you can
see here in lower schedule
item one thing that would be
cool is tying this
back and like logging where each logging
where each statement
happened they' be pretty beautiful like
how much time is wasted in tiny crab
because people don't
know so yeah the reason this doesn't
work
is if start pause started at 1 that
would be
allowed um
or if 1024 were bigger and I think 1024
is bigger if you're doing uh if you have
multiple tokens in your sequence
okay so let's extract
the problem
case to A
test should not be in test
symbolic can having like a test
integrated
symbolic this is probably pretty
good
for
is
okay so there's the
bug
um if I do this it
works
see that's fine but that's not
fine uh so we should think about why
that's true and why this thing's not
behaving as I want it
[Music]
to eating this chicken is
difficult
[Music]
how much of this eating can you see on
stream should I
get a better
camera you got a hand cam we can zoom in
we can fix this in
chap
might just have to do
that
well okay wait there's something we
could do instead of division I think we
could
subtract what we've done so far
first would you like to see the
eating how many people oh 890 people
okay
so the truth is this has to be
zero and okay maybe we can fix it
here
print doesn't
work
H either way it's fully divided
actually because I'm not asking the
question interesting
okay so it could be 128 or it could be
zero that doesn't
matter
but how do I detect that
generically if a mod equal
Z wait
but actually that probably shouldn't be
true
no same
problem
okay there's other ways we can compute X
VAR
idx
I
guess what we can do well let's look at
what the shape is let's look at the
whole
shape so it's
this like once we're here
can this just go
away I'm not
sure why am I even checking this
real strides simplify merge
adjacent so it's in real
strides
oh it's multi
view the problems go so
deep that should not be multi view
that's the bigger
problem
so the only difference
there but we have to we have to shrink
it
we have to remove the
ones you see the
problem we basically have to remove
these strides or put those strides in
but without
yeah
um so if it's a shrink only if it's a
shrink
I'm gonna write Logic for this it's
stupid
that
this is so
annoying
let we have to put the one zeros back in
whenever there's you know what I'm
saying
for
okay is it
correct
I do not
know is's that stupid print it's in
shape
tracker okay wait that still looks bad
is the problem fixed in
gbt2 sweet hello security grants program
hello.com looks like it
works why does it still not work in
lunar lander that's the same
book we'll get
there but this is a oh maybe because I'm
no the star paw is
zero
that's a different
problem oh
oh sometime it picks
too it shouldn't be able to pick
to oh okay wait wait we going have
ignore value for sparse categorical
cross entropy I
[Music]
believe or maybe we just
um it should not be able to pick
two oh I know we
do
okay so back to this
bug it's still in real strides let's see
if we can hack this case
too
it's
contiguous oh but that's
192 that's still okay I think if it's a
contraction we'll write that more
cleanly have a function called get
contraction
um my
example
it's not a contraction but it totally is
did I do that
backwards Wait no that's just weird
never mind
great okay
so that's a contraction from that
one wait that's not oh those are just
okay never mind that's just
fine does everyone understand what I
mean by
contraction I I will now go on to not
explain what I
mean that sounds like it would take a
lot of
effort okay the contraction is the shape
of the no that's not actually what we
want um wait it might actually be this
stupid hang on it might be really stupid
uh okay um if length see lse
Z if there is a length we want the
stride from C sub minus one oh this is
so easy it's this I'm 80%
sure
wait that's hella
nice
yeah it's almost worth it actually now
now that it's only two
lines like it's a weird special case
but still an
issue a
contraction it is a
contraction
what
oh it's not even a valid
reshape oh no it is a valid
reshape this what we get for just trying
to hack around the problem and not
trying to fix it like
adults I ate all the
noodles want more
noodles
you see the problem with that
right
like that's true
sometimes can also probably make that a
contraction
okay so better question why is this not
a problem for
GPT
how did that Become
Three I just have weird parameters in
here don't
I
848 816
264 and gbt that splits
evenly okay so what are the numbers from
GPT n layers n heads is 12 dim is
768 that doesn't seem
so can't
type
well it's definitely not a contraction
it's also not a contraction with
GPT oh I see okay that's actually
fine no
still doesn't
work okay great
fixed we have tests which don't have
test anything
that's good let's get rid of that
print
okay so a
contraction is when your mother was nine
months PR uh a contra we're all just
gpts man so a contraction is when you
have something like this and you're
Contracting it and you reshape it to
this right and then the contraction is
this right does everybody understand why
does everyone understand why that's the
contraction if you don't understand why
that's the contraction uh ask your
neighbor uh we have office hours on
Wednesday and um the te are very
helpful I will warn you though this
school is big on Dei and some of the T
did not receive their positions based on
Merit um look I I'm not going to single
any Tas out by race but I hope everybody
has come to understand that
Dei means that you have low expectations
for a certain look of a person um and
it's really a tragedy to that person it
really
is like you just have to prove yourself
harder man and it just sucks and that's
why the left are the real
racists uh tune in to George Hots
tonight um we used to be on Fox news now
we've moved to rumble uh yes that's
that's right Rumble with an R um it's
like YouTube but
rightwing uh but it's rightwing but
we're going to repeatedly claim how this
is the real home of free
expression
um so yeah I hope everyone enjoys uh my
show make sure to check out my key
sponsors uh the uh my pillow pillow and
the uh
shit man my pillow's gone I don't know
what we're going to do man how are we
going to get funding to run our
rightwing show I know you can
buy my mail Vitality supplement oh
supplements are over shit I'm out of I'm
out of ideas man I don't know what I'm
going to do how are we going to keep the
doors open I'm getting sued by those
kids from Candy Sandy Hook man getting
sued by the Sandy Hook kids what am I
going to what am I going to do oh no
they're dead it's
fine jokes about dead kids don't sue me
don't sue
me um it's brought to you by uh Bud
Light Bud Lights trying really hard to
rehabilitate their brand so they're
they're going out there and sponsoring
this far right
content um they're they're very
upset uh that their sales are down they
thought they were just doing the right
thing but it turns out they
weren't um and they're doubling down on
politicizing instead of going back to
just a beer that you could normally
drink Bud Light makes a statement and
that is the real problem making a
statement and caring I hope everybody
understands that that's the takeaway and
that's the only way to survive the
future but that's what they want you to
believe because if you're not out there
making a statement and you're not making
your your voice heard then it's easier
for them to make their voice heard
because that's how democracy
Works no I have not watched Alex Jones
on the uh I only have so many hours in
my day I don't know about watching Alex
Jones on The Joe Rogan
podcast who am I voting for well I
learned a long time ago that you know
when I supported OB Obama and when I
supported Ron Paul and when I supported
Trump and when I supported Andrew Yang
that sometimes you get the candidate you
want and sometimes you don't get the
candidate you want but either way
nothing changes and I'm sorry VC but you
know like like you're the first year
that I'm just I'm just I just know that
nothing is going to change and I'm not
going to get my hopes up man president
Nikki Haley here we come you know that's
right yeah Ron Paul was a winner yeah I
know I
know um but they all turn out to suck
right George how did you ever vote for
Trump well he turned out to suck George
how do you ever vote for Obama well he
turned out to suck they always turn out
to suck man and that is the truth you
just you just can't get your your hopes
up man and yeah that's why and then how
do old people still vote I mean I guess
you really just have nothing else to do
uh when you're old
but yeah vet gets my year of
indifference
unfortunately uh does he sell hats I did
I did I did buy hats from all the other
ones I didn't buy an Obama hat I did not
have an Obama hat in 2008 and that's cuz
I used to be poor but I did have a Ron
Paul hat a trump hat a Yang
hat if BC sells hats I'll buy a hat
okay how old are you boner
pull okay why are we printing this why
is that printing let put here
okay know the other way around we want
yeah no really Ron Paul like Ron Paul
was the you see Dad see Dad if he's dead
we can say all the great things about
him we want and talk about how much we
loved Ron Paul if he's not dead he still
has room to disappoint
us yeah no uh
really
this you you you can just you can just
there's simply one way to tell if
someone's the good guy or the bad guy
and and it's do they support the
surveillance of Americans right that's
that's it that's it like how could you
that should be so far beyond the Overton
with oh my God you
know we still have did they did they
repeal the Patriot Act yet no they did
not
um H Ross perau I'm sure I would have
been I'm sure I would have been a perau
fan um I was a I was a I was a Gore fan
in uh
2000 uh in 2004 I was just devastated by
what an idiot Bush was you know look
this is like the normal this is the
normal trajectory of the manipulated
American political system and then you
just learn to be annihilist and realize
that nothing you're going to do is going
to change things but that's not even how
things change to begin with would things
really change if Charlie had died sooner
on loss yes the show would have been
better because that guy sucked
okay I was so happy when Charlie died
that was finally they were listening
spoiler alert if you didn't watch season
3 have
lost I don't know
look you do okay all right you ready you
ready for how the trick works there's
this thing called the government and
then there's this thing called The Deep
state right and the Deep State sorry I
said right deep state is actually what
runs the country but you don't elect the
Deep State you elect the government the
government goes on TV and talks about
how are we going to let this happen
again and that we need to do something
and protect the children the Deep
State uh you know sends billion dollar
wire transfers to weird places in the
world and like brings Hunter Biden his
hookers right that's that's what the
Deep state does but you don't vote for
that you vote for these guys over here
the government
so then you get people over and over
again who are like well I'm going to
vote and I'm going to make change but it
turns out you don't vote for the guys
who actually have power over here you
vote for the guys over here who are
puppets and they're not even puppets in
the sense that they're being controlled
by somebody to do something they're just
over here playing do you think that
anybody lets Nancy Pelosi near any real
lever of power probably yes and that's
the
[Music]
problem uh what's the difference between
the PMC and the Deep
State
um I think they're the same thing I
think like the PMC is more of a I think
that the Deep state is made up of PMC
members um by the way the D state is not
a
conspiracy uh don't let don't let people
tell you that the Deep State's a
conspiracy the Deep state is you can
find all their names on the internet it
is all the unelected bureaucrats it's
all the people who just hang around in
Washington DC it turns out if you just
stand next to the guy long enough you
just you know how things work and that's
what these people have done and they
don't die because we have uh high blood
pressure medication and they're all on
that shit they're all on that like like
what what are those things called you
know statins they're all on Statin and
now they don't die so we don't have a
natural cycle of turnover in this
country and even if we did have a
natural cycle of turnover in this
country who would we turn it over
to who would we turn it over
to there's nobody because the pyramid
ended and that is why I'm investing all
my money in Nigeria
look at Nigeria they have a pyramid
Nigeria still knows how to build
pyramids in America we forgot in
1971 um I'm I actually have money on
Biden so we got a roo for Biden guys
we're riding with Biden on this channel
um
I think I got good odds on
Biden okay this works we just need to
make the jit work let me copy the J Code
where's the J
Code can always use the
jet
for
okay I think it's faster
now
okay 20 milliseconds a
step doesn't sound too terrible is it
actually that might even just be because
it's render mode human might be even
faster if I just say that great it's
fast now love
it got to use the jit boys are you using
the
jit uh wait no no no no no no why is
that
back oh because I got rid of count plus
one
someone's really clanking on the stairs
this
morning are you using the jit jet yeah
I'm using the jit jet of course I'm
using the jit jet you got to get your
jets boys yo I heard you like Jets okay
that looks pretty good it looks like it
takes the actions equally and that's
what matters equality guys the actions
don't have to be good as long as you
have a diversity of zeros and ones it
doesn't matter if the actions actually
keep the cart pole balanced because we
achieved our goal of
diversity I've never been to Nigeria I
do know that they have a much more
functioning looking per PID than we
do uh by the way Africa documentaries
I'm going to oh that's what I'm going to
do today oh we're gonna we're going to
write decision Trends more we're going
to smoke some more and then we're going
to watch Africa
[Laughter]
documentaries how does anyone take
anything seriously anymore how does
anybody
this is also wrong I believe oh I if
count
one why do I have count like that why
don't I just make count zero and then I
can say Z one if
count you meet people and they still
take things
seriously
okay so this can
generate we'll
say that's good
that's
good roll
out
m
the wokies are great boys the wokies are
great who said I can't stand wokies okay
I'm not complaining about the wokies man
I'm complaining about the people
complaining about the wokies okay they
they they cared and that was the the
problem man I'm complaining about myself
okay I'm the
bra it's me
hi I'm the problem it's it's
me white men straight white men are the
problem
wow if we just if we just like went to
space shit would be pretty cool you know
what I had an idea a few nights
ago and we should turn Earth into a
nature preserve think about it a lot of
people win in that scenario Earth has so
much
natural beauty and
biodiversity that hum should fuck off to
space and leave Earth to be a nature
preserve where's my cross I'll go get my
cross that's a good point I've been
wearing my cross but I showered and I
didn't put it
on
for
for
we're not going to the Cross is on under
my sweatshirt we're not going to show it
on stream because we don't want to uh
offend people of other faiths
is this yes Dee work with it no what
this ends with tanks on the Harvard
campus this ends with tanks on the
Harvard
campus wow it did pretty well that
time should we just give up on
Transformers and just use an
evolutionary
algorithm
Japan is very cheap right
now
um maybe I'll go chill in Japan for a
bit it sounds nice
[Music]
okay
so hang on we don't just want to pend
the reward there oh we want a compute
rewards to
go I have that code in beautiful cple do
I
not
what are
discounts oh I have to to compute
that I copy this
line
what he
say yeah it's
cold and I didn't use enough energy
today I wanted to use
more it's pretty sick return
109 wait I did not get booted I did not
get thrown out of any colleges I quit
both RIT and CMU and CMU yes I had a
40 I
tried one of the first times in my life
I tried at
something okay that's good that's pretty
good uh wait we can't just do that we
also have to pass in model
model model
too okay
sweet uh great now we just need to
generate a whole bunch of
[Music]
them then each one is a is
a episode for a
Transformer think that's batch size then
I have to pad it which kind of
sucks or should we just like that's just
the reset action and we'll just
concatenate all this crap together kind
of sounds better let's concatenate the
crap
together let's con we can concatenate
crap
together we'll call them BR BS and ba
yeah I love my names
BR R plus equals
R I'm got to make sure these don't go
numpy I was just like con numpy that's
fine and then actions or not nump okay
good while length BR less than I don't
know
does this
work missing mismatch of
viles what the hell does that
mean oh we have to reset the
jet damn homie High School you Dem man
homie I think it's called
reset I don't exactly know why we have
to reset it but we just do all this crap
again oh because we also have to reset
the
stupid
actually
probably to I was thinking about this
this we probably want to say if start
pause. Val equals z
instead
great okay we're running
episodes I'm so happy we concatenated
them that makes life a lot easier
uh okay BR
equals we can also if we want to do the
mask so we like mask the episode
separately but I don't think it really
matters like just if you give up like
just
reset uh and it can't generate that
action so
great
oh my God is college worth it
guys do you know what a mosfet
is why is this one so big oh cuz I have
100 as the
default should be
zero this is the most incredible
decision Transformers are brilliant you
just put in the reward you want to
get that's so
cool we can also roll out multiple at
once I think I don't know that sounds
like a lot of
effort
of
course yo that Chinese food was great
but you know what would be wait where
did my Chinese food go I put it over
there you know what I really want a c
and
roll
that's just your high brain talking you
don't actually want to C and roll oh my
God you know it's I don't know if it's
better or worse and everyone talks about
the being anti the W stuff is as bad as
being the woke
stuff is a liberal arts woke study at
we aren't even
close to
like there's like a maslov's hierarchy
of bullshit and we're still at the level
of like figuring out you Ci's right guys
yud Kowski is right our civilization was
faced with a test and we
lost we lost okay and now we just have
two choices you can can either be on the
do things team or on the don't do things
team and I don't know I like things I
think we should do
them this is subscribers talking see
this is the problem I Leo I love you for
gifting subscribers but the problem is
you should get a star with an asteris
next to it if you're gifted a
sub
or I don't know actually I Leo I might
be blaming the wrong person you might
have carefully picked those 20 people
and determined that they were good
people and that's probably good because
I trust sub gifters a
lot um let's order I would order an
apple pie and panata but they got rid of
uh oh the guy this guy who dm' me
yesterday wants to do a phone call to be
intern for tiny grad
um all right let's see I'm streaming
right
now are you okay with the interview
being on
stream
wait what do we think about that should
we do an
interview no I think that's actually
let's see what he
says uh now I shouldn't do that to
people that that's pretty
terrible and yeah they're okay with it
but
like I'm curious what he says he should
say
no but if he says yes that's that's
ballsy we can't just we can't just like
use people for Content that's te then
I'm no better than any
other did he solve a bounty no but he
did a few
PRS
I want donuts okay I want a cinnamon
roll I won't eat the whole thing I just
want to look at the cinnamon wow wait
Cinnabon can deliver to me
1149 Donut
Bar
Crispy Cream can
deliver Chief Le
Cafe basic waffle bon bon
croissant can we just order a single
cinnamon roll with that's kind of savage
I'm just high and want to order
things wait a second this cinnamon roll
this cinnamon roll costs 50 let's buy it
utensils I don't get my h fine I won't
get my Uber one discount I'm not buying
more stuff okay I'm getting a 950
cinnamon roll let's see what we
get thank you people who purchase
subscribers to fund my
stupid uh wouldn't be comfortable being
on stream no I don't think I don't think
that gives a signal either
way I'm I'm just
curious okay that took a really long
time to generate um this is the batch
size why I order Cal I was just high in
order to
Cal okay we're making bad choices today
guys bad
choices just because you're self-aware
about your bad choices doesn't make it
any
better just because you say things and
it's sarcastic you can't just chase the
irony you can't just chase the the stuff
all the way down something has to be
real something has to okay because if
nothing's real then nothing matters and
if nothing matters you can just die and
if you can just die like why don't you
do it
already trigger warning self harm got to
click through that link Bros you got to
click through you got how does anyone
take it
seriously you know like I guess they're
trying I
I and I'm just mocking the people who
are trying postmodernism is fucked but
how do you you can't get out of
postmodernism you can't you'll be stuck
in postmodernism Forever you won't
really but like like the gradient like
you're on one of those what I'm saying
you're one of those like like in the
gradient like we we can't get
out just just just a postmodern
hell like in order to get out people
have to die and I don't mean that in
like a war sense I mean that like a
generation change sense you do know
everybody dies right like that's what
they never told you during Co like
you're going to die right are you that
worried if it's tomorrow or you know 50
years from now does that really matter
that much to you what's the difference
between Now 50 years from now and the
heat death of the universe like the
second the first two were so close
together compared to that second one I'm
sure you're going to have some gamma
Decay on it because but but you still
know what I'm saying
right we're playing for the whole fade
of the universe the whole like like the
future of light the light cone happens
now or do we just feel that way I mean
is that true I don't don't
know
like again like it's it's one of it's
like saying if if you know you're if you
think that you're crazy you're not crazy
if if you're aware of the fact that
everyone who makes these apocalyptic
doom day doomsday predictions is an
idiot then why don't you look at
yourself and treat yourself just like
the Mayan calendar right why do I think
the singularities are going to happen in
2038 am I just as bad as the May it's
not even a date that has any
significance it's just the Unix
timestamp roll over like literally how
stupid is that but it makes more sense
than anything anyone else is saying and
and the question is is that because I'm
crazy like why does it make more sense
to say that the singularity is going to
happen in in 2038 than to say Joe Biden
is a great
leader why does why does the first one
make more sense
what's wrong with
metic thank you for gifting Subs do you
have a
question all right it's like we're
learning it's still a little slow but
we're we're learning hopefully all let's
turn
on
training true no grab
false um
model brbs B A A logits equals a logits
dopar categorical cross entropy ba it
can't just be
that no it's not that it's
that
that makes more
sense all right decision Transformer
make
decisions
can't just be zero it's going to be
variable start pause
zero all right all
right let it happen after I die that's
that Boomer
logic
um input tensor shapes cannot be
multiplied well that's upsetting
I would like them to be
multiplied actually I'm not sure if I'd
like them to be
multiplied
what
okay this is probably wrong
then um
uh oh I think I have to do
this
no there we
go
okay cert T.G grad is not
none I know about
that
I haven't watched Cowboy bbop should do
that okay why are some of the gradients
none is that no grad def
Falls uh we're not using the
jet actually let's just explicitly not
use the jet I can do dot forward
here then we're explicitly not not using
the
jet sir t. grad is not
none I mean I did loss
backwards don't know what else to
say I said no grad to Falls maybe but
maybe something's wrong
there
the live
action she likes anime
mostly we watched jiujitsu Kaizen she
liked that a
[Music]
lot okay we're getting an assertion
that the gradient is
none uh it's because it's not Computing
the gradient for some
stuff and why is
that oh no that's going to be
after I wish I could know which one that
was again this comes back to like the
tiny grad needs like the the tiny grad
introspection project will happen
search er none well obviously it's
none oh I think I do some cash in in
uh maybe I don't explicitly say that it
doesn't require
gradient I shouldn't require
gradient shouldn't require a
gradient do I have any advice
dude you are late and if you're asking
me that question you're never going to
get better and that's the truth do you
want the truth that's a dumb question do
you think anybody who's any good asks
that
question and I'm just I'm just going to
be honest like I don't have an answer
for you but it's a dumb question and I
get emails like this all the time do I
have any advice right and we're going to
be harsh about it we're going to be
harsh about it because guess what guys
we're in the end times you know does it
matter
no
like you know it kind of upsets me I I
think the quality in the tiny grab
Discord is going down and partially it's
because of these streams here's my harsh
tone uh
and like in some ways I get
it streams these streams are not
particularly like this is not my job
right I'm I'm here you know I'm smoking
weed on a Saturday ordering $950
cinnamon rolls off Uber Eats
um so they're not high quality and they
don't really attract would I watch my
own streams maybe like something some
times honestly I'd probably watch Clips
I don't think I'd sit there for eight
hours and watch a stream and that's kind
of the you know the line of the Little
Dicky song professional rapper he's like
you know the shit that I'm bumping
wasn't the shit that I'm making and
that's the truth and that's that's
that's on me you know I don't know like
like make content for me to
consume Something's Gotta
yeah we been doing this I've been trying
to get into having a schedule lately
going to work every day put in 10 hours
no put in put in put in 10 hours put in
hours uh into
working make tiny gr better come home
sleep do it again the next day on
Saturday stream Sundays either go to
work or try to do something with
Alex uh then on Monday go to work
again just
schedule I don't know doesn't have any
answers for you it's answers for me the
answers for what this stream
becomes you ask me for advice well why
don't you give me
advice that sounds
better ask not what this stream can do
for you but what you can do for this
stream
this is probably oh this is the time
embedding wait did I delete the time
embedding oh well that explains it great
we found a real
bug
[Music]
okay we are learning oh the L lost went
up oh I love this learning oh don't we
love
learning so what's the initial
return
zero just going to flip the order
match oh this is actually reward is it
not
what is m. reset return do you get a
reward from the first time
step I guess you
[Music]
don't yeah notice how I never trained on
that
one um yeah and also this is not what I
should be putting in
there let's look at the decision
Transformer
paper
here okay
R well no that's not
right
um okay let's target a return of
50 Target return minus equals
reward
okay well my loss went to zero very
fast I mean maybe it's predicting the
same action every time we have no
diversity
oh yeah no that's definitely true also
move to Nigeria move to Nigeria and have
three
children so I don't understand how
that's zero so
quickly
um
okay so very quickly it converges to
just predicting a single action every
time actually after one after one update
oh
um make sure actually P1 is the rest of
it
okay it converges to 90% And you can see
that that's the episode line so they're
very
short it converges to 90% Z does
sometime it converge to 90%
one let's reduce the learning
[Music]
rate
okay well at least reducing the learning
rate doesn't make it collapse
anymore
okay doesn't seem like it's getting
better
um should also probably calibrate
[Music]
that
so now it's getting 68 okay let's like
discount this
one oh well that's just
dumb
uh that should not be the
reward I don't really understand why
it's outputting
that this should just be the
real returns from the
thing should not be that how is Target
return getting into
R because it clearly
is oh CU I put it in
R that's not
good maybe we don't train on that first
one cuz it has a fake action
too but I kind of like the fake
action
did I do this
backwards no that's
right we never train it to predict the
fake action which is what
works but the reward should not
[Music]
include Target
reward yeah okay maybe this just
shouldn't be Target return it should
just be
zero that can stay Target
return Target return
even okay so that's probably not we want
the target return to be like the most
it's ever seen or like what it converges
to go back to 99 it actually discounts
pretty fast what's the convergence of
the power series of
um there like some way to calculate that
right we can calculate
it
is that
you oh it's just like it's the sum of
that
though there's probably some expression
for that
equation
what is if I do that it's
20 so the target return is 20 and we'll
change that to be a discount factor of
95% okay that goes negative which should
not happen because we need to Discount
the target return
[Music]
um we actually don't want to discount
it I don't think they discount it in
there so I'm not really sure how to take
that into
consideration
but actually in some ways maybe we never
change the target
return maybe we don't do that actually
do they change the target
return no this should work
actually that's fine because that's like
the max
this it's because we're discounting it
actually should
work okay are you learning how to be
better or
not my batch size is very
small did you just get lucky with those
big
numbers
okay uh let's reduce multi roll out to
[Music]
64 B size to
four so each one of those are the
episodes happening you see this one's
converged to
zero I thought a bigger batch size would
help it did
not going turn on render mode human so
we can watch it not
balance is it learning do we think it's
learning
boys
see look it's collapsing look see I'm
printing the probability of each
state so it's just learning to spam
one now it's forgotten okay so here's
another cool thing this is an off policy
uh this is an off policy algorithm so we
can do some amount of
uh of Replay we don't have to sorry not
replay I'm not sure this helps but like
maybe it
does George you have to not be so
cynical don't insult the guy who posted
some big long rant in your chat
expecting a real answer you have to you
have to just have a positive outlook on
people you know you catch more bees with
vinegar than you do with bee
zappers
[Music]
for
[Music]
guess you don't actually want to do
multi roll out you want to like just
stick these all
together
um
this function sucks I don't know why I
wrote
it all right now we just like I don't
know
it's actually stupid because like we
don't actually need that
context hell's a pipe reward where am I
pipe in it too bro pipe pipe pipe pipe
pipe pipe pipe
pipe
I don't know you know we could
do we could just
like what if we just normalize
it
that's
for
so you say like a AI could probably be
typing this form right now it probably
could I think the bigger problem with
that is it's not like I'm doing nothing
with this time I'm actually
thinking I use a different part of my
brain to
uh
[Music]
okay
it's not actually what I I want to do
um
okay
it's four that's
right
what doesn't work about
this
oh that
problem I reuse ba down there
it
okay it's
learning it's machine
learning it's doing a shitty job of
it lears to always predict
zero
okay my hyper parameters let's raise the
temperature didn't fix
anything so we're making each we're
clipping each one to be only
20 like let's take a look at a
sample so like that's the reward these
are the states and then those are the
actions um those ones don't look
clipped wait I think that
worked clip R not
work did oh I don't know okay they're
definitely there that's
fine I I guess we were just looking Happ
to look at a sample that was
bigger yeah it's just
jamming zero as hard as it
can now here sometime it looks like it's
predicting
one heast in that oh
we're never deleting
them my overpriced cinnamon
roll n minutes
[Music]
away wait is it learning to
balance at least it's at least it has
diversity very important
it kind of is
working that's how you
feel your feelings matter feelings
matter bro feelings
matter is it learning I don't
know you know how you can know if
something's learning or not ooh 70 you
can use a
graph
for
okay
let's first do a short I one to make
sure I didn't mess up the
plot see you can't just count on that 60
that was all just
lock okay it's just going to warm up a
bit before it starts training with some
random
noise still all in random noise
Land wait no it's not
oh all right now we're
learning we're doing two episodes every
time okay lt. show good thing I didn't
run the big
one um I mean maybe can I do this here
does that give me
it's going to hang after I do pl.
showell though right okay for some
reason all my returns oh they're all 20
damn it it's not what I want okay good
well that was a quick way to see a
mistake
um if I do that but I don't hang does
that just like do what I want which is
like show the plot
without no
oh I think there's an argument to dt.
Shell um block
yeah okay so far it's doing
worse make that one one
again PLT plot returns it seems
fine all
right will it
learn it's not even getting longer
anymore that supposed to be getting
bigger are there other figures
hiding hidden figures years might you
say pl. clear how do I PLT update a
thing every Loop PLT plot update in
Loop figure. canvas. flush events that's
a lot of
work do I have to do
figures okay fine we'll make a
figure uh figure. canvas.
draw oh this is too much
work
pt.
pause there we
go oh oh is it going to learn will it
learn
it looks like it's getting
stupider media comes to the moon was
that a media
movie i' believe
it I don't know reinforcement learning
takes forever but it also may be doing
nothing we do not
oh wait is it learning boys no it can't
be learning that's too
optimistic if you stare at an RNG long
enough you'll start to see
God
well okay so here's something we can do
we don't actually need to watch it try
to balance it should be faster without
that um what's that stupid print all
these prints d That's the most
disgusting code I wrote in here okay
this is faster
now are you
learning is you
learning learn
better oh I know one of the
problems
okay so because we're clipping things to
yeah that
sucks
um because we're cling things to 20 it's
going to have trouble when it starts to
try to roll out past 20 so let's clip it
to 50
instead I thought it would be okay but
it might just get
confused
don't think it's actually learning
anything you see look when it goes past
50 it gets angry
I don't know I might just be staring at
a random number
generator
probably where's my C
roll it's no more computer at the
problem also this is kind of a tiny
let's do
four will you learn how to play Card
pole there's so many pieces in here that
could be
broken I have very low
hope do you see why it should predict
better actions
it's because I'm putting
in I'm telling it that you want to get
20s it's never actually seen a 20 which
is also kind of
unfair let's just tell it you want to
get
15s it's probably directionally correct
that's probably
fine wait know those Rewards are hang on
we might just be doing this too
much this back to
okay
remember RNG says you're just going to
get some good sometime what we're
looking for is uh steady up upward
progress and we're making sure we keep
the diversity you see these aren't very
diverse I I don't want to start adding
crap like entropy
regularizers
I don't know there's so many ways this
could be
broken all right let's see if it learns
how to fly let's just give it a harder
problem and see if just maybe magically
it'll work I mean it won't but I got to
get my cinnamon roll anyway and you guys
can watch the lunar lander while this
thing doesn't uh
work
hasn't even started learning
yet okay now it started
learning let's see if it
learns will it
[Music]
learn
[Music]
how's my cinnamon roll
look not very
good $9 Uber Eats is such a scam man
let's see how it
tastes
[Music]
terrible I paid $99.50 for
this is it
learning
do we think it's
learning oh we're also not looking at
the rewards there we should probably
look at the
rewards
oh did I mask the first one like I said
I was going to or did I not I just put
zero in there okay
fine
you feel like it's worse than random
no that's very
possible there's many things that are
worse than
random okay I'm going to have to think
about how to build tools to debug
this
so I don't think it's being trained on
predicting the next
States because the only output from the
Transformer is the
actions
select hidden States for Action
prediction
tokens it's crazy there really is only
loss for the
actions the loss is going down sort
of the loss is
good but do just mean it's good at
predicting
failure
the loss is now almost zero
and and it never predicts the other
action
let's go back to a small
one
okay could it just not be working could
I have a bug in like the jit and stuff
that's that's probably the first place
to
look
no I don't think we have to implement it
in torch I don't think it's a tiny grad
bug I'm saying that
there's
I'm saying that the uh my
implementation's wrong not not the code
in tiny gra but the code
outside
so how do I possibly debug
that
no let's look at the hugg and face
blog okay
Happy from other agents or human
demonstrations
you Fe the last K time steps into the
decision transform with three inputs
return to go State
action you know what I mean it might be
a little confusing how
uh wonder if it doesn't like how we're
adding the positional embedding no that
should be
fine
the prediction is condition oh on up to
20 previous
frame oh
interesting with a window of the
previous 20 time steps so they're not
doing roll out
forever but I don't really care about
that
even
okay let's just try something stupid or
if I set the target Return to
Zero
okay that immediately
collapses well let's set the target
return to like eight or whatever that
is okay that collapses to zero pretty
quickly so now if we set the target
return to like
50 it still kind of
[Music]
collapses I don't think that code is
wrong we're putting in one sequence per
thing I guess something I could
do is a sanity check also predict the
state there's nothing fundamentally that
makes them logits right
no it's just it's just a
Dimensions fact I could even move that
whole head one out if I want
it
Min 20 highest found
what oh you actually getting that from
somewhere yeah okay we can do that
let's actually do like a 90th percenti
or
something
why is sometime printing a really small
number where does that
print you really what is that tiny
number
it's not the target
return oh that's the loss why don't I
label my
numbers
cou believe I at the cin it's kind of
[Music]
disgusting
um what will the reward in betting make
you choose a good path
well
that one I could done
equals
why do you not
learn um okay let's try something else
this isn't right we really want
random. choice I write this all the
time
for
f
I really want to do that without
replacement whatever this replacement
matter
why I eat that disgusting cinnamon
roll that was
terrible
okay
[Music]
see I get excited when it goes up but
you got to learn how to not do
that put this in the fridge for
later
for
okay hopefully we can see that it
clearly does not
learn
did I implement the sliding roll out I
don't know what that
is
okay how can we check this for
bugs
the loss doesn't even look like it's
going down that
much it does seem like using the larger
replay buffer the loss isn't going down
anymore
is
uh only learning with no I don't think
you need
that think that
helps all right so here's the
loss
it doesn't look like it's really
learning pick the same one from each
one print
this shouldn't do anything
weird
no that looks
fine SEC of
this like way to train with the same
ones at
first doesn't
matter this is lost we want this to go
down
oh so I don't
understand these things are not
logits
do Spar categorical cross entropy no I
think it
includes I don't think I need that I
think it includes a
thing no self as a logic's input so this
actually just might be wrong here CU
that might have to be log soft
Max argmax is still the
same not sure how much this
[Music]
matters let's look at the
logits okay they're definitely
Logics uh and then if that's in log
space we don't divide by temperature we
subtract the log of
temperature see if that sounds
right
again that isn't going to
affect
this those things are logic we're
predicting the
next action that's
right and yet now my loss goes
up
it is true that it's a non-stationary
distribution those don't look like
logits
[Music]
now
oh wait what the hell am I
doing that's not
right I have obvious bugs in here God
this stuff's so
hard okay
that's that so you got to do that how
did this even how did this not just
break fucking deep learning
man I was just cutting one off the
batch does the loss go down at least
[Music]
now
no might be a different problem problem
my loing R might just be too
low how does anybody get the stuff to
work does deep learning work or is it
all a
lie made up by
big support Vector
machine
L go down
trust that samples
works
okay um how can we debug
this I mean I can't believe we had that
bug and it did
anything
all right so one way you can always make
sure is if I set samples to 0 * BX that
should be the same sample over and over
again and the loss better go to
zero great the law isn't going to
zero it is just wait
what okay if I can't learn literally the
same pattern over and over again
something's really messed
up okay well that time it did learn it
except it
spiked how is that
happening I'm feeding in the exact same
thing every
time like it's the same thing every
time
oh well there's another bug what are
those twos getting set
to
maybe we can let
it well those are like masked
actions
okay I mean this is another good sanity
check so if the action predicted is a
two
learning the same thing over and over
again
loss goes down but very
slowly and then spites
up and it's spli
BL
that's usually a problem with like lack
of log softmax or something but there's
a log soft Max right
there it's outputting twos it's
literally outputting twos it should
never output
twos that should strip all the twos from
the
beginning at the end it should have a
reward that's close to
zero and clip that let's clip that
smaller 4 is
fine oh no it's just it's just learning
on the same thing over and over again
but it's not
learning okay tensor training true no
grad false zero grad optim
step oh okay well now the loss got to
zero so that's great finally it learned
how to overfit my one
sample okay I mean it looks like loss
pretty reliably goes down
now the twos were causing it
pain I know why they don't buy us there
either
okay loss go down very
good okay good it's not predicting a lot
of
twos I hate
twos how's the TC so high look at all
the
twos we shouldn't have two count we
should say
[Music]
TC divided by length
R how is there so much percent of twos
in percent of twos but I'm never putting
in
twos why does it predict
twos the twos percent needs to go down
does this make
sense twos means you've lost the game
twos also mean you just started the game
so that's very confusing and let's
increase this by two and make a three so
you just start the game and it can't
predict
threes
right does the loss go
down sometime you get good reward and
sometime you get bad reward do you not
understand
why
it doesn't understand
why Wow if we think our world's
confusing imagine how this poor model
feels good thing it doesn't have enough
layers to be
cured I understand the model rights
activists will eventually come for three
layer models but you know until they
do
okay so predicting a lot of
twos like this is never going to work
I'm asking for something way too
complex the loss is lower because it
just predicts twos all the
time huh
you
know we should really subtract the
reward from
the the real
reward like you have to compute reward
to go as you
go am I sure I'm implementing a reward
to go correctly yeah it's the same one I
use in beautiful cple so probably
can never be
sure let's try a much larger batch size
let's try
64 rewards aren't discounted in decision
Transformer yeah I think they should
should
be
there's probably some broadcasting bug
like why is this not learning way
faster and why is it still predicting
twos
no this doesn't make any sense okay so
the these are the
probabilities my sampler is just totally
busted just what I just
do go back to dividing by
temperature and we can go back to
softmax we just need to add an
exp
okay now it's not twos anymore that's
good what
happened what did I write
[Music]
wrong
okay well at least that's say
again see how does anyone ever make this
stuff
work okay two percentage quickly goes to
zero but that probability also greaters
to
zero so how do we fix
that
for
do we need a positional EMB badding I
for carpo we really
shouldn't
I mean but yeah carple should be so
simple I'm not that worried about
that all right let's get rid of the
reward to
go
and let's add that back and then let's
say Target return minus equal
[Music]
Z
well that just collapsed even f
faster if the loss is
low
no this is like it just becomes so
quick he doing multiple actions for run
of the simulation
no how we going to debug
this discounts work
better not subtracting
that
because I mean this shit in theory
like
he learns to end the game as fast as
possible
why I mean I agree that's definitely
what it looks
[Music]
like
there's so much potential for
bugs like the loss goes down but the
average episode length is also
down
this is now doing worse than
random ever since I fixed the
sampler okay uh learning right too
high get rid of printing all those
stupid actions actions all
right
doesn't predict many twos which is
good have a somewhat balanced policy
there it should see that some of them
are better than
others I get my hopes up every time it
goes
up I shouldn't do
that still pretty large want
go
also try not adding the positional in
batting I mean it's cart pull I don't
need it
right just get rid of the position one
B I don't need the position we can all
agree on
that
I don't know I mean my Transformer
learning can just be
wrong no it's just it's just collapsed
to total crap
now
you
[Music]
you'll overfit on the policy if you look
at the to conquer the cart pole
problem no I I this has to
[Music]
work put this back in all right fine can
I do lunar lander you think lunar lander
is going to work work we have so many
bugs in this you
know
um what I hard code
for harded to
here
can you at least do your custom gym
environment that tries to guess the
previous state which one is
that oh that's smart yeah you could have
like a really
dumb that makes
sense
yeah there should be environments that
are just like good examples for
reinforcement
learning oh when I made
one
yeah I don't know we can just sit here
and pray for the numbers to go up should
we try that the power of the cross the
power of Christ please Jesus make the
numbers go
up my machine learning is very bad and
I'd like it to be
better now there's so many things can
please choose just make the numbers go
up your crypto telegram right
it's definitely learned
something it's learned how to just go
there
never come
back is that easy to
do fly off
screen's not landing on the
moon the only winning
move all right
right boys we have so much to debug
here uh I think we should just do
it let's debug with contrived data to
see if our Transformer is learning and
if our Transformers is not learning we
can cry all right let learned something
new it's learned something new it's very
repeatable at
[Music]
least oh oh look at
that
I kind of think it's
learning it's trying this for a little
bit Yeah remember it's don't land on the
moon phase that was a good
phase
[Music]
okay so part of the problem now might be
that we're clipping at
64 uh it looks like we're getting
episodes that are way longer than that
so let's clip it
128 If this just magically starts to
work
it's learning something right no we
should we should write some contrived
okay it's in it it's in its don't land
on the moon phase
now oh I also have a bug highest reward
should not be
zero reward should be
negative
Infinity I was GNA actually try to put
that in the first
time I don't know negative a
th000 I can put a negative
Infinity I don't know what that does
might throw
errs
okay it's learned about not landing on
the
[Music]
moon our candidate would prefer not to
be interviewed on
stream so we will not interview our
candidate on
stream to know what to expect think I'm
going to tell you what to
expect I'm going to ask you why my lunar
lander doesn't land on the
Moon
better to Not Crash so it runs away is
that actually
true
it doesn't want to get the negative I
don't know to say that it doesn't want
to do anything implies that this thing
works at all and I have some serious
questions this is not predicting
twos could consistently stop predicting
twos which is
good
whoa whoa that was close
boys I think it's going to
learn
no it's back to doing
this it's learning how not to do
that we're just staring at
nothing RNG plays
Pokemon okay it's found a new thing just
not firing the engines actually gets a
pretty good reward for doing
that it has
learned you can't just use the engine
sometimes
but look the rewards are
higher use the
engine
I think it's
stuck I'm not giving it more reward for
engine
use come on bring the engine
back no it's very fixed in the I'm never
firing the engine again
phase
oh
remember it's smoking weed Saturday
we're we're not trying that hard you
know we should really be writing test
cases and writing a few different test
environments seeing if it can learn in
the test environments or we can just run
it again and see if it works better this
time what do you
think
[Music]
okay now it's learned how to spam the
right
Thruster all it's doing is spamming the
right
Thruster that can't possibly be good you
can't possibly H be happy with yourself
spamming the right
Thruster that can't possibly be a
fulfilling
lifestyle
Let's Just Jack the temperature up okay
guys this isn't we we've crossed over
from machine learning to just randomly
doing
things do temp deay
no and that's without Decay it's already
we still suffering from
collapse these new models love just
spamming the right Thruster is that the
new like the Club where you're like talk
about how hard you can press the right
Thruster oh remember that one that
learned reinforcement learning doesn't
work
okay all right let's think of some
contrived environments and let's let's
make it work
them you landed but you killed everybody
on
board you landed but you killed
everybody on
board we haven't even like like at least
the lunar Faller was getting pretty good
scores the lunar Barrel roller just
sucks
I don't
understand it should be pretty
high
um okay I don't know smaller batch
size no no no no we can get even more
contrived in that environment trust
[Music]
me
oh we got another lunar Faller
here it fell right in the middle
though the things ever learn or is that
just too small of a learning rate let's
try 3 e minus 5 that sounds like a good
learning rate sounds like a good number
right 3 minus
5 all right we're going to need coffee
and we're going to actually have to try
to write environments why do we remind
me to never try to do reinforcement
learning on stream because reinforcement
learning just doesn't work okay and if
you thought it worked someone lied to
you okay I think this is just RNG Lander
I don't actually think it's learning
anything my loss is not really going
going
down at least it's using a diverse set
of
thrusters yeah I know one4 is karpathy
blessed I've heard about that one I've
heard that's a good learning
rate you think you've ever seen it
land I got one to work
once one of my I think I did finally get
this to work with Po and like a massive
amount of
shed okay guys we're going to see it
land well I think it's learned to be a
lunar
Faller yes it's learned to be a lunar
Faller a common mode of
collapse the poor
Cruise
okay you know what I like the one let's
let's let's make it shoot for the stars
let's not update highest
reward and let's give it a highest
reward uh let's give it a Target return
of 50 you can do it figure out what 50
might be interpolate
bro oh
regret
we'll just change that to
50 we'll change that to
50 oh we're not even trying anymore
we're not even trying anymore am I
losing viewers no the viewers don't care
the viewers don't care if I try or
not
no we're going to
try what did I change I don't even
remember what I changed I just changed
something oh I told it to shoot for the
stars and try to get a 50 and it has no
idea how to get a 50 so it just kind of
tries random things look it still has a
twos percent like that's just really
giving up if you're predicting a two
you've just really given
up it's interesting that definitely
shows it's doing something though there
I look see this twoos
perc
this might be too aggressive 50 might be
too far out of distribution let's try
zero again that was the bug that I wrote
before and I think that was actually the
best run we
had
like will tw's percent went
away this is when it learns to fly
away are we in the wrong oh we in just
chatting oh we probably are in the wrong
category oh we should change categories
we'll do that
now
done shouldn't it be decremented at each
step yeah probably should I don't know
how to do that
though we can try
that
no okay let's let's try some very naive
environments they're not dead they left
the moon they went that way all right
we're going to we're going to get some
coffee and we're going to try some
simple environments and if we can't
learn the simple environments then
um that's just
sad
[Music]
[Music]
if it starts crashing again we'll play
crashing
[Music]
[Music]
music we're going off on Cosmic
Adventure
[Music]
that's my song dedicated to all the
lunar Landers that have flown off into
space the beautiful flag set up for them
there's a great surface of the Moon but
they just decided to go
up okay I think this is we need the okay
fine 3 e minus 4 3 e minus 4 that's
that's the one that
works I'm going to get some coffee we're
going to try some real environments you
will not beat me today lunar lander if
we conquer lunar lander today oh if we
manage to use a decision Transformer to
solve lunar lander be back on track for
doing what we said we were going to do
on the streams but you have to
counterbalance that with the fact that
reinforcement learning is
impossible uh so there's that and
considering this is reinforcement
learning it's impossible so I don't know
why we're even
trying
we
going
still
got to open the coffee it's less easy
you think
okay I don't think I've ever seen it
land actually to be fair I don't know I
okay did it
learn we try not CU it's easy but
because we thought it easy
okay uh let's make a ridiculous
environment
[Music]
how do I actually write a real gym
environment
I've been working on I've been working
on a
song
uh it's only dark the first time we'll
hang lights for those who come
next oh no I have to do render oh that's
hard this is
impossible we can't do
that
keep your
inside about reward scaling now you
ready for we're going to we're writing
we're writing stupid crap
okay
what I have to write I got to write
reset and I got to write
step and then for reset we return the
observation
uh
does everyone understand we're writing
like a contrived stupid shit okay uh
what this
times self.
size r r sub self
do um now we have to make that self done
and we
do
don't anything there and for
step uh we return the what's the
observation
um it's always the same observation all
you have to do is learn how to guess the
stupid I'm giving you the thing you just
have to take the action you have to
literally press the button one of the
buttons lights up and you press the
button all right does everyone
understand the game one of these buttons
is going to light up and you are going
to you are going to press the button
okay okay does everyone does everyone
just just literally that there's my
reward function okay all right is
everybody happy okay is it terminated
yeah it's terminated is it truncated no
and that's not all right we don't need
those parentheses those parentheses were
dumb let's go let's go all right
okay we wrote stupid environment okay
it's called
button press the light
up button okay we're going to use Java
names here which button
lights
up okay you literally just press the
light up button okay stupidest
environment in the world we can call it
the press the light up Buton when you
want to site that in papers site that in
papers okay press the light up button
has no shit okay well you know that's
cuz I didn't construct it you got to
construct it all right boys you got to
you got to construct because you don't
construct it you're GNA what the what
you you fucking
Tuple give you a t tup tup tup Tuple
well that's cuz I put a comma there for
no apparent reason all right let's get
rid of that comma okay well why does it
still make a lunar lander know because
there right there we're making a lunar
lander we don't want to make lunar
Landers why would we do that let me just
comment those lines out cuz we don't
need any more lunar Landers we have we
have all right well that can't be
multiplied that's too
bad do I see $1 is there $1 $1 $1 $1 $1
$2 are there $2 do I see $2
$3 three chat gbt write this shit chat
gbt write this shit why am I writing
this shit oh what that doesn't even make
sense the Box oh that's low and high
okay well high is that and the box is
that okay I just made the size of the
box ready they're all just zeros or ones
everything's a zero or a one okay can
you
learn uh no you can't learn
congratulations you're an idiot right
literally there's two buttons you either
press that button or that button don't
press the two
button right
can it learn how to play this game it
cannot learn how to play this game this
is the stupidest Transformer I've ever
seen okay if you can't
learn okay if you can't learn how to
play press the light up
button okay it can't even learn how to
play press the light up button okay
let's see if we can press the light up
button okay can we pray press the light
up button let's pray press the light up
button okay so we're going to get the
observation
okay print the observation we're going
to get an input and this input is going
to be called the action okay we're going
to get an action you ready for an action
okay we're going to we're going to n.
step act and we're going to print that
okay ready you guys ready to play press
the light up button okay press the light
up button let's play
okay did we mess this game up okay which
button lit up is it button zero or
button one let's play button zero well
look we got a reward button zero yay
zero oh okay well this one we're going
to guess one and we're going to get it
right okay this one we're going to get
zero look we got it wrong press the
light up button come down all day it's
the easiest fucking game in the world if
you can't play press the light up button
you are a certified
moron all right press the light up
button does everyone see how to play
press the light up button does everyone
understand the rules do you understand
the
rules okay well I can't even play this
so that
sucks wait this model is so stupid it
can't play press the light up
button you got 50% of them you guess one
all the time stop it
all right let's look at some episodes of
press the light up button okay we don't
need 128 let's just clamp it to
four four sounds good you learning how
to play press the light up
button what how did that do that I don't
even
understand what just
happened why is it doing so many things
I'm getting rid of that I'm getting rid
of
[Music]
that this is the easiest game in history
and it can't play it
you literally press the light up button
okay all right everybody come down play
press the light up button okay let's
take a look at the rewards the states
and the actions from press the light up
button the reward is actually always
zero no wait that one had a reward okay
this one has some
reward uh what I don't even understand
this it's like not
right
oh okay well we still have
Decay I don't know if we need Decay
let's just get rid of Decay that just
made things more complicated I don't
even think it matters but whatever it's
just one more thing that can't be wrong
okay could my me zero learn to play
press the light up button that's the
same bug I wrote before it's the exact
same bug I wrote before IDI okay
see sometimes it wins it press the light
up button all right so there's the
button it pressed one which was the
right choice since that was the lit up
button and that one pressed one too but
that one press zero and button one was
lit up that one press zero and button
one was lit up so it got a reward that
one press one button one was light up
okay great so press the light up button
seems to work
no no you press the light up button okay
this is why we have subscriber only
origin DOTA you know honestly how many
of you would fail I press the light up
button like let's be real here let's be
real about who couldn't play this
game what about an Epsilon greedy
strategy okay I mean we can even try
we'll set the sampler to to just do that
no
temperature
and it still can't learn to play press
the light up
button we've turned
oh you literally just just press the one
that lights up
bro okay well it can't learn press the
light up button but oh
oh that's cuz my target return is zero
but then it should be trying to lose
actually so I don't even know what to
say about that you were literally trying
to lose and you couldn't even lose it
press the lightup button you're that
dumb something's just broken
broken
wait
boys that was a good streak of press the
light up
button is it
learning
H kind of ly
[Music]
stream well the loss is definitely
zero let's print the action
distribution
okay this decision Transformer is too
complicated let's make stupider decision
Transformer okay
let's make stupid decision
[Music]
Transformer
[Music]
God I don't even know D equals
[Music]
we were so far away from anything
actually
working he couldn't even play press the
light up
button okay stupid decision Transformer
hey decision Transformer I want to tell
you if stupid decision Transformer
solves this problem and you
can't um oh we have a jit that's
fine
[Music]
wait
huh let's just seek Len just not put
minus
one
[Music]
okay it doesn't even do any Transformer
junk this one can't learn
either
okay does machine learning
work real
question wait does tiny grad not work
what if Tiny grad's broken did I break
tiny
grad
I did make a lot of changes it's
possible I broke something let's see if
gbt2 still
works
I that's just a different
problem wait did I just seriously break
tiny
grad maybe or maybe those tests are just
dumb not
un has no attribute
Val
oh
okay gbt2 still
works
see beautiful ad this still
works beautiful M this still
works wait that's less beautiful than
usual
though wait I think I might have broken
tiny
gr that's stupid this whole time I just
broke tiny grad
because of that because of that
contraction thing that was
wrong this is making me
mad oh deep learning sucks
Bros if I do beautiful lest on Master
what what accuracy do I
get oh yeah look see that one works and
the worst part is it like kind of works
if you do it wrong but it doesn't
completely
work this should get like 90 this should
get like 90 uh
98 but I broke something and it doesn't
get 98 on the alll Transformer
Branch it's just worse there's some bug
this doesn't
work
but that was completely my fault
for okay well I'll notice that even with
that bug fixed it's still deep learning
is
impossible
I know I know look I know all these
things all right we're doing better now
we're doing better wait I I don't like I
don't like how I sub slly broke
something by doing
that tiny gr needs so many more tests I
I will note by the way that Master still
works fine it was my fix from before
that broke
things that's what we get for smok and
weed you know that's what we
get that was before we smoked
weed
okay this should be the easiest thing in
the world to
learn I'm literally just asking you to
learn put things in the right order
right it's literally going to be this
stupid like I like did stuff in the Ral
order
Target
return what I set the batch size too 16
that's crazy
high we now have the simplest possible
problem the
action the state and the
reward why is the reward always
zero
[Music]
but that's not even what we're learning
on let's print what we're learning
on
wait
what is this never called with
[Music]
training right that tor. training equals
true then we oh we call model off
forward okay that's
fine
[Music]
wait wa that's not really right I no
that is
right we thought this was all going to
work in like the complex Jet and stuff
wow we were we were so Off the Mark we
were so we were so done in Krueger on
this you
know okay I'll press the light up button
we're going to we're going to at least
if we can't solve press the light up
button we're going to have to give back
our machine learning
card okay we're gonna we're going to
take it away from
us uh oh do I have to put an access into
soft Max no this one's probably
right
once it works will it scale to solve AGI
yeah probably I mean that's the kind of
cool thing right like when you get after
you get press the light up button to
work there there's very little between
press the light up button and
AGI
literally literally you you you output
the
action
[Music]
okay
the data looks
fine why is the learning not
happening let's comment out the forward
jet
I don't think it's my
embedding that doesn't even matter
because that's always fixed for the one
that I actually manage to
use all right let's get
stupider
oh I guess what if we just
try press the light up button is
actually a very complicated game we have
an even stupider version where the
button that lights up is just always the
first button can it learn
this it can't even learn that
that
oh guys I think it finally learned to
play a game
it finally learned how to play a
game okay it's pressed the light up
button but the button that lights up is
always the first
button it took a long time to learn how
to play that
game like it takes many episodes oh that
time it didn't get
it something's really
broken
that time it failed at literally play
press the light up button where the
button that lights up is always button
zero reinforcement learning is
impossible and also how did I break tiny
grad in such a way that it's just subtly
wrong
what did I do wrong
here
oh I have to check to see if the strides
are actually
contiguous
okay well I see what I did wrong there
no we're not even using trans we haven't
even gotten to Transformers yet but
we're just we're
just okay that embedding seems to
work how about the
state that embedding seems to work how
about the
[Music]
reward
and that embedding works okay good all
the embeddings work let's look at the
embeddings together do they work
together I think
so
sometimes that one's different but
that's always the first action
embedding
okay should be
fine what did I hardcode
12 right
there
okay that's the
action that's the
state see okay we have action and state
and then we have
reward we shouldn't even train on that
last one actually
I can I can even truncate this I can
even can even clip R to
one I have two
buttons it's the dumbest thing I could
possibly make wait why does that affect
that why is the loss on that oh cuz you
have to take the action for the next one
okay that's
right
there should be normal numbers
right those aren't
numbers no there should be numbers what
all
those are the
actions
those are the
states those are the
actions oh and I guess we need the
rewards too
so these are the states these are the
actions so we got
one okay so here when the button was one
it pressed one it got a reward of one
button was one pressed one got a reward
of one here when the button was one
press zero got a reward a zero okay
great the optimal strategy is to
literally press the light up button it's
the dumbest strategy in the world this
is the dumbest game in the world yet
this thing for some reason can't be
yeah
okay
sometimes you just have to press the
light up button and we're going to write
the dumbest code okay the code's about
to get Dumber we're going to start from
Dumb and we're going to go to smart
okay
okay so this is the game it's called
press the light up
button
we didn't bring in the whole game we
also need
this I'm going to bring in the stupid
decision
Transformer
so by the way we were just staring at
RNG all the time
before how do I need a start
pause I don't even need a sequence link
okay now okay we don't have to we don't
have to go this far I'm getting rid of
this we're just gonna we're going to be
very careful slow and methodical I know
those things aren't my strong
suit we gathered data Let's test the
model so for
reward
for reward the action we're going to
start with is action
three The observed state is 1 comma 0
and our Target return is
one
you know you do this you never
forget never forget how this thing works
works we test the
model for some reason we're putting some
other Logics there which doesn't really
make
sense um oh it's probably like through a
soft Max and
stuff okay
regardless longt Max action on
P
put someone on the
model putting the token don't do that
okay so this is our desired
reward this is our desired reward here
when this is
this when this is pressed we don't press
that why does this not
learn
why does it ever learn that this is an
okay action it never sees that
action it's just it's almost like it
just isn't
learning
isn't learning
optim zero graad loss backwards optim
step doing that right
right I'm putting the parameters in the
model
something's just so
broken remember when we just stared at
the lunar lander and thought it might
land oh the old
days
it's like the loss is really
high
like look so this is the same as
that let's make contrived
train
so hang on we we can actually just do
this with batch
sizes um Target return
one
one
uh well that's somehow time step which
we don't really care about it doesn't
matter it's
equivalent okay
does this if I if I
uh sparse categorical cross entropy it
to we're running out of places for bugs
to hide
but I don't think it's better in pytorch
like I've struggled with stupider things
in
pytorch uh okay a. logit
sparse categorical cross
entropy
113 okay so desired act make that a
tensor
[Music]
desired action there is that desired
action there is that
sh
learn it doesn't
learn I like my embedding is
broken
[Music]
let's get rid of just one of
these this is completely independent of
time
[Music]
no now we need
that
I mean if it can't learn this how's it
going to learn
anything can like look at the gradients
and
stuff
it just hasn't trained long
enough no it gets no
smarter doesn't even learn that twos are
bad
actions it does like very slowly
we don't have Norms I bet there's some
like bug
with
okay this is like the token embedding
every time and like it does move a
little
bit
wait why are those the
same why are those the
same I start out this
same start out pretty close to the
same out all pretty close to the
same that's sort of annoying
what did I initialize embedding with
gorite uniform that's fine what do I
initialize linear
with caming uniform that's
fine oh okay so each one of those is one
embedding so that's the
action
embedding those actually all are the
same this is the reward
embedding which
again it makes sense this is
that and this is the uh State
embedding and then it's being told to
predict
either this or that assuming this
actually works which I'm starting to
think that's where the bug
is I don't know if this thing was
designed to
work uh for more
than
what if I do
this and then here I do
reshape minus
one3 it learns just very very
slowly okay I don't know let's give it a
larger learning
rate
okay look like it
learned why are these learning rates
just so
small well at least it's learning not to
press that
one this the mean
I mean that's totally
right take the log soft Max multiply by
that take the
sum don't think there's anything in Lost
mask
[Music]
true divides it by one that does
[Music]
nothing take the derivative of
that Z grad backwards
step
it's learning how to diminish the
difference between
those it's just learning how to like
Miss all the loss together I feel like
there's some like broadcast
issue but I'm not sure where it would
be I'm I'm I'm just like I'm lost
for I should expect this to
work what did I
forget why is this loss not going to
zero does that loss go to
zero that loss goes to zero but he can't
distinguish them for some reason even
though they look pretty different to
me
on topic
please
okay Target return
for the
batch time Step
Zero time step one time step two times
step
three Target return is like the desired
uh reward we can call it reward if you
want desired action okay
State let's go through the states
okay so the state for batch size one
times Step One is
this is the desired reward Infinity what
are you talking
about so we'll go through all the
states now if your target return
is what
you do that you do that if your target
return is zero you do that if it's that
you do that okay
good let's turn these into
tensors I like I'm going to get this and
then what's it going to
be
[Music]
oh we don't do
uh fake act goes
here then my loss is literally just this
yes sparse categorical cross entropy
desired
act am I trying to teach a linear model
XO
maybe
maybe we'll give it you want me to give
it another
layer
well now the losses are more of a mesh
but you're right CU it was converging to
something that looked like what happens
when you try to teach a linear model XR
let's give another
layer
you agree this should definitely be able
to learn it
right
no same
crap same
blah though to be fair
no that's not exor I'm trying to teach
it give it a d of 12
too no that doesn't
matter the same
blah
effect
uh okay the tget returns are
wrong
I mean okay that seems to learn the
function let's not let's just test the
model
here no Norms or anything like there's
no reason that shouldn't
work
no it doesn't
work all right let's get
stupider
I I
agree I don't know if it's tiny grad
weirdness
or oh I have to name it properly even
stupider decision
[Music]
Transformer
okay so now we
concatenate them on the final
AIS same as
this
it's the action embedding that literally
does nothing this this does not
matter
okay what's the function I'm trying to
learn it's like it's like some l looking
chat no we also need to know the reward
we can't just know the
state one two 3 four okay it's
four output action spaces that plus
that
[Music]
didn't
learn yeah we're going to try just the
state next okay we will try just the
state no we need we need the state and
the
reward doesn't work with only the state
we don't need the
[Music]
action that should learn
right definitely learns as a 50/50
probability
there
it's probably bugs and Tiny
gra now I'm thinking that's what it has
to be CU like this doesn't make
sense okay it can't distinguish
those it's not XR that it's trying to
learn is
it this needs to be
zero this needs to to be
one this needs to be
one and this needs to be
zero it's like a linear
function
okay let's get even
dumber
is
okay we have 1 comma 1 comma
0er and for the
output you should
predict zero you have 1 comma 0 comma 1
and for the output you should predict
one you have Z
comma one comma 0 for the operation
predict one and then you have Z
comma and let me just put a float in
each one of them 0 comma 0 comma one and
you should output zero okay great um
model
subx St space is three action space is
two list object has no attribute linear
oh we got to make those
tensors
great
uh okay let's go stupider than this I
want you to learn to predict
this
xor and linear layer can't learn that I
that's
xor well I can't learn that so
fine so we need a nonlinear
layer how many layers do I
need two is two a good number of
layers
deep learning just doesn't work I give
up on deep
learning okay is reu good enough non
linearity okay now it
learns with very varying degrees no
sometimes it doesn't
learn sometimes it doesn't
learn see that
time dude deep learning is
fucked okay there we go now we got
something that should always
learn fucking lottery ticket hypothesis
bullshit
[Music]
dude I I feel I feel so
scammed like deep learning is a
[Music]
scam
okay all right let's work our way let's
work our way back up the
stupids
let's work our way back up to stupids
okay all
right that one was really
stupid let's look at this
one it didn't learn okay let's give it a
little more
space
print a comment that it works
whatever okay now this one doesn't
work why doesn't
work
okay stupidest test
works
instead of doing this let's change this
to zero and
one exor is a hard function to be fair
it's very I understand why it's very
difficult sparse categorical cross entry
to
Y nope and now it doesn't learn
again I don't understand why it's xor
either but that one
learns so stupidest test two doesn't
work there's something wrong with spars
categorical cross
entropy oh is it because they're not
floats oh
maybe no actually they shouldn't be
right no it's CU those are actually the
wrong shape
though should actually just be
this
okay of course with no error and it
seems to learn slightly slower but it
still
lears
[Music]
okay all right let's make stupider test
we're slowly working our way up to deep
learning
[Music]
um
State spaces on
used for some reason is four
oh was I trying to use even stupider
decision transformer for something I
don't think I tried to use that
one let's just use stupid decision
Transformer
okay doesn't work the losses got low
there that's pretty good all right it
seems like that works now for some I
don't know
how
[Music]
where press the light up button
okay
uh all AC space should not be three it
should be two but maybe that's what's
causing the problem
now that works
fine
huh
okay maybe it was just the xor thing the
whole
time all right let's PR press the light
up
button
does this
[Music]
work no put it all together it doesn't
work yet but we're getting we're getting
closer guys we're making progress okay
stupidest test seems to
work
um we cannot do that
Max okay and then we can put desire out
okay it's going to
work okay look they they are equal now
okay we got something to learn I I don't
know why the other one doesn't learn but
stupider test passes all
right
great okay so that's
22 let's output let's print this here
and see if that
matches Co
okay don't need
[Music]
that that's
junk guys we're almost there okay if
stupider test
works I like we comment that it works
okay
guys you don't understand how actually
close we are to AGI okay as soon as we
can play press the light up button
that's AGI like like like if because it
learned to do that you know it's it's
astonishingly hard to like learn tict
tac
toe
um we have this one
working so now let's see what about
this somehow doesn't match
this wait I think it is
learning
no
oh there we
go it learned how to play the
game after many
struggles
it sometimes learns how to play the
game it learned once how to play the
game now it just learned how to Output
[Music]
zero
uh human play
m
one oh yeah we got reward zero we got
reward yo yo this game's fire boys we're
pressing the light up
button one oh I didn't get reward I
played
wrong yeah stupid or test learns okay
this learned like
once but I don't know why it doesn't
reliably learn it should be be pretty
much the same thing though I guess there
could be sampling noise
[Music]
here see look it's just learning to
always play
Zero now learns to always play one
too aggressive with the learning rate
let's lower the learning rate okay what
happens if I lower the learning rate
speak our test do it
learn it still learns
okay doesn't learn as decisive of a
policy but it definitely learns okay
that's
fine
right now it's not learning
anymore it's the same stuff I have a
state
821 822
oh okay to be fair I'm putting two of
them in somehow no but I'm not no no no
that's just
that I guess I want the forward on two
of
them but that shouldn't matter cuz
like
regardless let's not do
that
I'm doing extra computer
anyway uh so let's just C that
that
that that we'll cut the left last time
step off because we only have those
actions and then we can just do a logic
sparse categorical cross
entropy changes
nothing
how is this different from stupider
test which may I remind you
works
well that doesn't matter because I have
the same test model code
here no actually I don't let's get the
test model
code
no see it doesn't
work kind of
works anyone who ever told you they were
doing deep learning is whing I think
that the company has just figured out
that you just get people to type in all
the weights
and then they tell them it's deep
learning so that everyone else is just a
red herring you know like it's just a
scop there's no deep
learning I think this works should we
having any progress
no I a deep state right sounds
right no like learn you piece of
shit if I if you ate dinner I wouldn't
give you any
tonight oh look that one's increasing oh
it's going down
again oh that one learned to predict one
oh this one's learning to predict one
too oh is it going to work oh look it
learned it just took
forever
the reward is now one all the
time it's just the slowest like thing
you can
imagine I see that one learn to be one
assume that one's going to learn to be
one there we go I mean it it
learns
it just takes 32
years okay let's put the big decision
Transformer in and see if that works
maybe it's
[Music]
faster Jack no Jackal it up it
collapses
okay now we have this bug again
great well we at least know how to fix
that
for
[Music]
yeah that still works we break
it
uh the
rides
okay to check if those strides
are contiguous or
not
for
[Music]
[Music]
on damn
it
that's contiguous see the problem
a
for
this is this is just frustration this is
this is not good
programming you can't actually do that
what strides are both
zero wait that's actually
fine
[Music]
[Music]
that one's not
fine
I'm not even returning
[Music]
rat
I don't even know anything about
[Music]
that I just returned on there is that
fine I didn't need that at
all oh I needed some of
that maybe that's when I went off the ra
and got
stupid
supported type for oh well that's a
different problem I
think I think I put none in there
somewhere yeah I have none in the test
that's
fine okay well now this one doesn't
learn and not only does it not learn it
doesn't learn very
slowly quickly converge to all ones see
if I broke
anything
fun
[Music]
that so quickly just outputs just snaps
to one
output
this one learn is just excruciatingly
slowly it would learn faster if I gave
it more
layers actually
[Music]
might
no no 's at about the same shitty speed
in fact it still hasn't
learned has never see that example okay
now it's
learned reinforcement learning doesn't
work okay someone might told you that
reinforcement learning does work but
they're a dirty liar okay cuz it doesn't
work okay well now this is again
collapsing
immediately to a ridiculous
State the model test should still be
right
right what is
the let me test the model before I even
train
okay don't
update that's just
strange
look some of them output two it learns
not to Output two and then eventually it
learns to Output some
ones bias is towards zeros but
eventually that one
flips this one and now this one's going
to flip there there's one and it
[Music]
converges
okay that pretty reliably converges and
it looks like it stays converged
now why can our decision Transformer not
learn as we switch to this thing it
doesn't learn anymore okay first let's
get rid of the jit we don't need a jit
right
now
JS just one more thing that can break
things don't the jet was breaking things
but look it's like good and then it
updates the first step just destroys it
completely is the learn right too
high
maybe but again it's it's converged to
junk converges immediately to
that okay we I mean we can do roll outs
like
[Music]
while length of all are less than the
S so we get some
[Music]
diversity oh wow it learned look at that
very fast
too see look what I'm looking for so see
these are zeros this is one zero
um I wish I'm numpy how do I not do
scientific
notation what are we
suppressing okay it becomes very
confident in its
outputs and it shouldn't be like this
one didn't totally converge that that's
wrong
there again we're back to very quick
snap judgments that are
wrong entirely based on what we get as
an initial uh just do we get
lucky you feeling lucky
punk
it's learning something now we're making
some
progress there we go I see it's right
now okay cool it didn't work with the
jit um we have no idea if it works with
temporal things but at least it's
winning most of the time at pressing the
lightup
button uh where's my roll out where I
print
the where's that
print let's stop testing the
model oh it's not doing any more roll
outs I see uh
put this
back here we go and it gets one every
time but somehow it's wrong about
that oh that time it
got
okay that time it got it it's very
sensitive to the initial
conditions did not learn
then um I don't know should we try going
deeper let's go
deeper all I'm literally having gpt2 PR
play press the light up button and it
loses at
it my initialization may just be crappy
too like I kind of suspect that's why
tiny gr didn't train the
[Music]
uh the resnet to the required
accuracy just like yeah my initializer
of
this I'm doing I'm doing Cayman uniform
but like who knows
who knows if that's
right
um inside Transformer
block who
knows feed forward linear are those
right I don't
know where do I get the hidden di for
that four times d w that's ballsy
let's go
small is that one going to flip that one
flips this one's still learning too it's
only 90% confident see the confidence
here okay then that one flips there we
go okay I mean it's learning to play
press the light up button that's all I
can say there weren't any bugs it was
just lots of hyper parameters and also
reinforcement learning doesn't work okay
now way do I just do gym make AGI and
it's going to do
AGI okay well we can't tust the model
anymore I'm going to commit that because
I know it
works
sometimes if we get a good
seed can I increase the temperature the
temperature is already very high you you
can look at what the probabilities are
converging to and I don't think that's
going to help
you
okay cart
pole press the light up button is a
really hard
game
okay well that one just converged to
pressing one all the
time oh am I not what's my target
return I think my target return is
zero and my target return is one so
that's not going to
work uh we can go back to highest
reward that's mostly pretty
good
it's not like it's not that my
temperature is high though I'm telling
you uh 7 we can go
higher
telling you they shouldn't they
initialize this shit with with
uh with deep
Q where' my line go for my training
here that shape that's
stupid let's bring the plot
back
should I use two
figures let's use two
figures oh GPT write this shit for
me
[Music]
for
and we have to give it a while I also
disabled the jit unfortunately so it's a
lot slower doing the roll
outs we can try to reenable the Jet and
see what I broke there I have an idea
that I might not have broken anything
and it might just be the
uh that I was just a
test okay the loss is not really going
down but that's okay give it time all
things take
time I like that it's maintaining
diversity at
least
what did I make the batch size eight I
could probably make it
bigger
Whoa We Love
diversity I don't know about equity and
inclusion I don't know if those things
help
RL
now really we need Merit we need you to
take the best action you know what the
action is the best action you got to
take the best action one time it got 93
that was that was a good time that was a
long time ago though I don't know like
is it learning maybe it's learning prob
not I actually doubt it's doing
anything at least it has not
collapsed it's still outputting twos
sometimes
this thing is unforgivably
stupid I don't
[Music]
know no the you don't understand there's
no
policy like it it's you just put the
reward in and you tell it to do
things oh okay so I guess one thing I
did was I got rid
of so that's equal there so okay let's
let's try
that I don't know if that's going to
change anything
but um we should also be able to learn
better if I increase the batch size so
let's put bat size up to
32 I can have be
can you give an explanation of this
Transformer read the paper of course the
paper makes it look so easy until you
actually try to you know make it deep
learn and then you remember that deep
learning especially reinforcement
learning doesn't work um oh look at that
loss going down oh yeah yeah go down
yeah that's the direction you want your
loss to
go
for
did it learn or did it
collapse okay the loss looks like it's
still going
down
it may not understand the monotonicity
of reward how do they choose their
highest
reward how do they choose their
uh oh I guess well this problem kind of
sucks
Target
return
yeah see loss is going
up okay let's just it's nice that we can
always go back to press the light up
button
it's a great it's a great
task for everyone who believes in tasks
should eventually it should pretty
quickly get uh
yeah okay look it actually gets good it
press the light up button okay so we we
we've made some progress notice how
that's getting one reward every time
it's clamp to the highest reward that's
pretty good um you want to also see if
it can lose every time just for
fun you can also set we can just set
Target Return To Zero and we'll see if
it learns to lose every time I press the
light up
button so give it a little
bit
lose oh here we go that way to lose okay
so it takes about it takes about 50
episodes and press the light up button
and it can reliably play that game I
feel so good we we did reinforcement
learning and it learned
something so I'm I'm I'm just I'm I'm
hopeful for everything else else
now um I don't know if we should try to
reenable the
jet does it reliably learn to play press
the light up button if if we could get
something that could reliably learn to
play cart pole that would be a great
victory for reinforcement learning and
then you're right I've never seen that
lunar lander actually land nicely I
think I saw it once on YouTube but they
had a guy with a they had a guy with a
Xbox
controller which streaming
Alex we've learned how to play press the
light up button do you know how to play
press the light up button for you what
is it court summons no it's your ID oh
it's my
ID return sh whoa that's cool oh voters
we're not doing that this year guys
every time I vote I'm upset and every
time I don't vote I'm upset and that's
why just you know how to play press the
light up button no what is it okay so
you have two buttons and one of them
lights up and you press the one that
lights up okay that's the whole game
sounds very straight forward well I know
but trust me not all models are smart
enough to learn it but don't worry we
now have a model that after playing the
game just 50 times can learn how to play
press the light
[Music]
but um ID reveal you did gift Subs I
would think about it
but okay let's play lunar
lander all right we got lunar Faller
well it's gonna have to do a bunch
anyway before it before it goes uh I
need more coffee and I had something
else to do but I forget what it was you
going to make coffee no I'm going to
have cold coffee why you making
coffee
how
i87 and it was disgus and I don't know
why I got
it do I want Pok ball I wouldn't say no
yeah I need a Pok
ball all right has it learned the lunar
lander yet I will say the loss is very
much going
down wait boys it might be
working no we're staring at a random
thing
again remember when we stared at a
random thing last last time we never
really found the bug we just fixed
it what happened to not wearing all
black I gave up on that now I'm back at
work and all I care about is
work the loss is still going down so I
actually have big hopes for this model
even though
the
oh is position embedding enabled I don't
know uh yes it
is we definitely had a bug before the
one that was breaking beautiful
mest
still putting twos with some percent of
the
time
whoa I think it's
learning okay you want to go let it do
10 on its own it can't learn cartpole
but someone said this thing could never
learn cartpole
and that you had to initialize card pole
with good policy
data I think it is getting better I
agree I mean the rewards aren't better
but that was
worse it's like trying things though
which is
cool oh big spike in a lost
there we should probably have something
that discards the older
samples it'll also be a lot faster if I
disable the
display try a positive Target reward
well it has a positive Target reward
now because it did manage to hit that
once I don't know how okay but look the
LW spiked but that could be okay right
it could just be now it's exploring like
a different part of the space which is
actually pretty
cool I think this is going to learn I
just don't think it's
fast should we uh should we Implement
saving of the
model I like why not saving the
optimizer State tiny gr's not good about
that stuff okay I think it got dumb
again it still has all the good ones in
the replay buffer
so now look the model got dumb that's
the Lost there like it was going down
and now it's gotten
stupid
so no I don't think it's learning right
scheduling I think that
the
I mean the distribution of the data
definitely changed right and this may
actually
reconverge I can't say it's gone
forever but part of the problem may be
that this highest reward
thing
is it really has no idea that the
rewards are like
monotonic and I wonder if the paper does
anything about that
no see they just
have separate tokens aren't going to
help we haven't done that many roll outs
like these things whenever I've done
lunarlander before I've never gotten in
less than
500 loss is coming down
again so is the
reward
like it's possible that it just does
well on one and then just gets itself
into a bad State and then has no idea
what to do okay I think that we should
add back in I do I have reward oh I do
have reward subtraction
again is there a way I can change the
render
mode
what's the default render
mode okay never mind complicated
bullshit
code
how slow is it if I'm not doing render
mode
human
what why is that
not oh that's all still the
first
pretty useless oh wait what are we
doing what I still have a two
there well that doesn't
work that might be why cart pull didn't
work
actually um okay let's go back to
playing press the light up button cuz we
know press the light up button is
reliable and a good game
and then let's increase that two to
things that are not
two okay it learns how to play this um
let's raise this up to
128 should still
learn just
slower maybe not much
slower
no she doesn't learn with all that
garbage padded on the
end we might want to mask
it
okay what does it break at what if I do
four I think the problem might just be
that there's like no signal in the thing
anymore
more or is it explicitly
broken
interesting okay it might just be
explicitly broken with more than uh with
more than two and that that's fair
actually uh this might just have to do
with how I'm doing sparse uh categorical
cross
entropy
oh yeah okay well again I don't know how
lunar lander did
anything because this is totally
wrong this has to actually be
this I
think
no that's fixed
elsewhere
okay so just with three it
breaks
uh I don't know do we have a test for
sparse categorical cross entropy with
[Music]
more things there should be a positional
embedding too so they shouldn't actually
break this is where it came from along
with code that learns lunar lander
what's upside down reinforcement loaring
P
rewards no
whatever okay good let's just fix this
for for this um so the problem is in
clip R oh I shouldn't put two there
first of all that's a
mistake that happens to be
correct
for
I should probably actually do minus one
there these won't have any
loss if my sparse categorical
works okay that
works should never learn to predict
two
uh some reason that has action space
plus one I don't really know why it's
just a fake action it's
fine okay but yeah this is fine I'm not
actually masking the
Transformer
that worked
before okay okay that
works uh let's put it up to 128 see if
it still works we're just masking the
return we're masking the uh cross
entropy return at the end of the episode
which is
fine see if it works at
128 okay good takes a tiny bit longer I
don't know the Transformers masked great
all right card
[Music]
PA mostly
[Music]
collapsed narrow work get out of
here I've told you about the volcano man
I've told you you just just like what
kind of person would I be if I took you
seriously what kind of person am I that
I get
upset why doesn't my reinforcement
learning work that's what you really
have to FOC on these are the real
problems in the
world am I okay yeah there's just
there's just idiots on the internet you
know and it's upsetting because I wish
everyone on the internet was smart and
they used to be until the Eternal
September and then the noobs just kept
coming you know that you know that porno
about the girls never came you know the
girls never came and it was just dudes
it's like that but the internet and it's
the idiots and they do come and it
sucks hey like I feel like it wants to
learn even subscribers only is lost yeah
I know I mean it's just it's just the
hordes of the it's it's like it's the
same things happening in the real world
like you know like like like like
there's no more separation between the
first and third world the internet's
just it's the internet's just the third
world
okay like I feel like it wants to learn
every time it does that you know like
you can learn man learning is possible
you can be
smarter be
smarter
uh my positional eding could be messing
things up you can turn it
off also C pole may just not
[Music]
work I like seeing my lunar
Landers what was it learning
before we just whatever we were just
getting lucky
before you need better than random
inputs
okay
so we did have great like there was
great gains in there was great results
in the
loss with lunar
lander okay this is really slow should
we we try to turn the jip back
on that guy said it took 300 EPO how do
they Define an
EPO good result after 700
EPO oh that's cool desired return an
actual return oh we can plot that
too going to plot our desired return on
the same graph as the first one that's
pretty
cool
oh
where is that a
list that's a list
oh do
that think we can get the jit turn back
on let's get the jit turn back on I hate
when things are
slow uh okay press the light up
button uh
what I
do what' I
break
oh how to get Negative a th000 oh that's
desired oh that's
annoying
okay that learned even faster than
usual that's
great um Can it learn with the jit
on we have to add back the jit
reset and roll
out model forward jit
reset forward jit for
jit no it doesn't learn with the jet oh
maybe it does oh we're good just took a
while okay fine it just
works good we've had very few tiny grad
bogs except for that one from before
uh most of these bugs are just kind of
like hyper parameter reinforcement
learnings impossible kind of
bugs all right lunar lander that that
let's
go all
right
and they keep learning learning
learning we're raising the
ceiling this is this is one step away
from AGI don't don't don't you feel
it if we just like like turn this on the
world instead of lunar lander I I
couldn't land this lunar
lander
well you know it's just just just it's
the same algorithm as AI you just need
to scale it up a little
bit they got 700 EPO but I felt like
they were getting gradually better over
time whereas we on the other hand are
not you know how to do better do
better
remember that time we thought it was
learning but like maybe it
wasn't his orange line kept going
up my orange line does not okay all
right all right fine fine fine we're in
the period of great struggle Wow Let's
watch a gif of it working wow wow that's
a nice
GIF is the cut off still two no I fixed
though the cut off no I I changed the
clip to
128 I think that's fine yeah most none
of these episodes are going
all you do is learn by trial and error
okay say that's not how AGI works it's
totally how AGI
works I feel like the loss got lower
last
time I don't know maybe we should try a
Higher Learning
rate
[Music]
the learning right is
low like these problems are low
dimensional too which
sucks let's also change this
to every 25 to watch an Epoch it is fast
now too which is
nice not sarcastic this is Agi boys this
is
it it's just gonna it's just going to f
from
here okay look the loss is lower than
last time now that I raised the learning
rate oh it's learned to be lunar Faller
oh good I forgot how to be lunar Faller
that's
good come on
learn all right lunar
Faller there's a lot of episodes of
falling but it fell right in the middle
that
time
it's hard to overcome being lunar
Faller you can get a pretty good reward
by
Falling you just got to fall in the
right
place this is definitely not what's in
your brain okay something in your
brain's got to work way better than
this with SpaceX Landing produced by AI
have you seen AI try to do this you
think SpaceX used this shit to land the
Falcon what they they just built 100,000
fake Falcons and crashed them
all they did it in
simulation no they used control
theory okay I mean this kind of
sucks
it's not moving all
right I think it's
time 3 e minus 4 it's got to be
that karpathy come on 3 e minus
all right while we watch this thing
never actually learn to land let's think
about what other games we could make oh
you want to try iterated you want to try
iterated uh press the light up button
where it's a multi-episode game that
keeps
going if my schedule is too aggressive
do you want to add the times uh the
times9 back we could do
that I mean it's it's it's going up sort
of that one's going down that's pretty
good there's also some RNG built into
lunar lander which is kind of
interesting um I think we should clear
the
plots I also think it's getting slower
cuz it's drawing those
plots it's hard to overcome being lunar
Faller see if that
works CLA what's the difference between
CLA and
clf this
works the light switch game
worked you can make more complicated
versions of the light switch
games
oh yeah no I think I met that guy they
have like one like like it's just a
genius of
controls it totally makes
sense and they definitely didn't use
AI well we be nice to each other on this
stream only I'm allowed to be
mean it's because I have the band
button I don't know who thinks it's
eventually going to learn it's got a lot
of parameters I
think okay do they update the target
reward based on the actual
reward
yeah they
do okay we honestly have no idea if the
KV cach is working it may just not be
working which would explain a
lot
don't know like the loss is going down
maybe it'll do something I don't know
High Hopes actually where' the video
go all
right we should try uh multi
uh I feel like it's not just going to
get it now there's still bugs we
definitely still have
bugs
like now that's what I'm
doing Target return minus
equals observed
[Music]
reward at the reward at the observation
at the
action it's true that if like reward to
go is wrong and stuff none of that will
show up in the in the in the light bulb
game right okay bro bro okay I hooked it
up get the Xbox controller
right come on we got to look good for
the
video it loves that that
Thruster it's barely using the down
thruster
I mean it is learning and the loss can
only go to
zero good
night
reinforcement lighting doesn't
work all right let's go back to the
light bulb
game it's not learning
anything it's like it's learning
something here but that's the higher
learning rate
too oh look it fired that Thruster that
time see it gives me a little bit of
hope it gives me a little bit of hope
that it won't just crash into the ground
at full
speed NOP crashing okay we have to just
stop watching it the number is not going
to go down okay it doesn't matter how
long you watch it for the number is not
going to go
[Music]
down let's play press the light up
button okay now let's add a few
parameters to press the light up button
let's call one of them
size and call one of them game
length
let's confirm we can still learn press
the light up
button takes a little
bit but now we've learned almost we got
it wrong that time now we've learned it
okay so we do learn to play this game
reliably
now let's add some complexity to the
game well let's start by setting the
size to
four now it has four buttons to choose
from it's a much harder
game can it still learn to
play can gpt2 the whole gpt2 learn how
to play new press the light up button
okay I can so it has no problem with
size let's increase the game
length
uh we have to be a little careful
now we want to get a new observation so
we're going to say reward equals self.
OBS
Suba step equals
zero
self.
reset and then this
is
self. Step
Nom less than
G greater than or equal
to
okay
and we broke
it even though that totally shouldn't
matter we somehow broke the
game
or we just got
unlucky we can go back to size
one by showing a different observation
the second time we break the
game that does not make
sense
you can also put the size
back reason to make it harder than it
has to be I understand press the light
up button a very hard
game okay well that works again so maybe
that wasn't the problem maybe the
problem was just that it's unreliable
with a large
size large
size okay that's
fine all right so it's unreliable with
the large size well that's a different
problem okay let's try game length of
five should be able to get five reward
now and the first time out it got four
reward
nope it's very
stupid okay well it definitely can't
play this comp licated
game I don't think it's a tiny C
isue like I I wrote a bug in tiny gr but
tiny gr is a very comprehensive test
Suite how easy is it to do in pie torch
why don't you give it a try I I think
this has nothing at all to do with
pytorch or tiny
grad and everything to do with the fact
that machine learning is just not hard
yeah let's try game Le of
two let work our way up slowly
should be able to get two reward now I
think but yet it
can't do we have some bug in the
game let's try some human play of this
great
game okay
one
should also probably never give reward
after the game ends but I don't think
that
[Music]
matters now we have a game length of
two oh it did get a reward of two
once by sheer luck and it will never do
it
again
okay larger models are less
temperamental yeah that's generally
true right let's try a game of size 16
is this ever going to
work
but eventually learn to play
this now there's 16 buttons it has to
press the one that lights
up
this is very
hard it did get the four
though but yeah there's definitely
something wrong with
game so that's
interesting
I can't reliably play this
game there's four buttons guys you press
the one that lights up it's not that
hard
is a light switch fixed what do you mean
by
that you want to play you want to play
the human version of
this zero look I got
reward two look I got reward two one I
missed
reward one what got reward three see you
just pressed the light up
button of course this game is too
hard
I just
like if this game's too hard what can
this thing
do me 12 is like give it six heads it
three heads maybe I don't know we have
too many
heads okay that was a stupid guess why
did I think it didn't anything to do
with
[Music]
heads oh
God cringe
shit do you not see the other people
posting cringe shit and you're like I'm
going to come in here and I'm going to
post cringe
[Music]
shit
what what
what do you want do you want to make the
the machine learning
work do you want do you want to make the
thing learn how play PR
Buton well I'm sorry
that's who you
making I'll callose the door we're very
angry oh like hello I have a 17-year-old
please help me give me life advice bro
like have you not watched any of the
streams and how does it end for people
like you see that's that's the really
baffling thing this is the most baffling
thing about these people like it's it's
lmics it's literally did you not see
that guy fall off the cliff did did you
not watch did you not see him fall off
the cliff who do I'm going to walk off
the cliff too like like what are you
doing um or do you think other people in
chat are going to answer you and anyone
in chat who gives who answers these
people banned
okay we're here to play press the light
up button right can you play press the
light up button can you write deep
learning to do
this how about three does three
work we solved it once with
four but that would before we added the
game length
stuff
I worry that my causal Transformer
doesn't work let's get rid of the jit
again we definitely don't need
that now we all get
banned
all right never mind we need to make the
the press the light up button game work
with three actions
first because this is clearly way too
hard all
right I know how did anyone get this to
work
right
so now we can see the probability Matrix
from that
thing does look like the right answer is
increasing there okay now it's getting
two of them
correct now just isn't getting this one
correct it's torn between stupid
answers like this doesn't really look
like a fundamental problem
[Music]
how do they predict their
action a hugging face blog post had some
stuff
right
where's get
action
action this doesn't work turn an action
does
it no okay you see the problem here it's
just collapsed very quickly and is never
guessing zero for the first
one this one fixed the first one but now
it's struggling with the third
one it's not confident in those answers
but it never predicts that
one all right let's make the batch this
bigger
also don't understand what happens if I
what if I make the temperature greater
than
one good that's going up
now but my serious question to the
people who come in here and ask for Life
advice
are you not a frequent Watcher of the
stream now it's solved I decreased the
learning rate and increased the patch
size see if I can solve size
eight
or do you think for some reason I'm
going to give you a different
answer which is perhaps even more
baffling right it's it's not it's a it's
a dumb question in
kind
can it learn it with
five oh you think most people who stream
give those
answers I mean they aren't good
questions anyone answers that seriously
is doing you a
disservice can someone who's paying
attention explain why people who answer
those things are doing people a
disservice
yeah and then
yeah it's not actually because they're
very personal it's it's actually
because the biggest problem you have is
asking that question
I'm genuinely giving you good advice the
biggest problem you have is coming on
the internet asking someone for Life
advice like like you think that that's
structurally broken and I'm sorry other
people have taught you to think that way
but until you fix that you will never
make any progress in
anything
I you can ask it on the street if you
want to most people understand those
questions for what they are and maybe
these people do too is kind of like a
you know shit talking whatever man you
know I'm hanging out at the bus stop I
guess you don't even ask questions like
that I guess I guess what else upsets me
about the questions is you wouldn't ask
someone at the bus stop that kind of
question you think that I have some
answer for you I don't nobody has an
answer for you you're either going to
find the answer yourself or you're going
to die miserable and
alone
um I don't have experience with being
stupid because I I'm not it sucks I mean
I don't know if it sucks right I I think
that what sucks is to have Ambitions
greater than your
intelligence
um I've met some I think there's some
very happy people who are smart and have
low ambition and these people are just
like yeah man everything's just easy uh
there's people whose intelligence
matches their ambition um things kind of
work out for these people who what
really doesn't work out for is when they
have Ambitions here and they're not
smart and like what can you
do you know just just be happy that
you're not this model that can't even
solve if you're watching streaming
you're above average intelligence I
don't think that's true
again I think the internet's gotten
really
stupid
uh but yeah no it's it's the
shortcutting the learning process again
you you completely
misunderstand you completely
misunderstand what learning
is if if you think there's a way to
shortcut
it it's it's like like cheating on a
test um they say you should learn how to
learn
and that's part of it but still not all
of
it because then you'll just get the
stupid question well can you teach me
how to learn and no nobody can teach you
that either education like you can be
taught very narrow facts about the world
sure but again you don't even need a
person anymore just go look at look at
my conversation this morning about
mosfets
people have paralysis with trying I
don't think this is true I actually
think what the problem is is that they
have no
gradient um they have no gradient and
just like these models like this problem
is incredibly
easy but it can't learn we we can sit
here and be like bro like okay you got
the first three but why can't you output
three for the last one and the
probabilities are slowly changing and
maybe someday this model will eventually
solve uh press the light up button with
four
states the saddest thing is I don't even
think there's bugs here it's gonna it's
it's G to flip it's gon to
flip there we go
0123 and now it gets reward well it
doesn't get reward one every time yet we
have to give it a little bit longer for
it to stabilize okay so after 500 EPO it
learned how to play press the light up
button uh is jit running again no the
jit's turned off but I think it makes no
difference at
all it's just another confounding
variable to
remove uh I think there is something
more structurally broken okay so it can
solve size equals 4 it just takes a long
time just
like I think there's something more
structurally broken with game length
equals
two you do think learning to learn is
part of the
problem uh people give up when they see
people like me who started young as shit
and have a lot of talent yeah I mean the
truth is some most people should
probably give
up the the the truth is if
you're uh and again this is not advice
that someone's going to tell you but if
you're
25 and you it's not like if you're 25
and you program if you
like uh have aptitude with physics or
philosophy or or math right like if you
have strong aptitude in another area and
you just didn't put time into
programming then yeah perhaps you can
learn to program but ask yourself then
honestly do you have do did you how did
you do on how do you do on your math sat
it's that stupid right if you got if you
got a A a 450 on your math sat you're
not going to learn to be a great
programmer in 25 you're just not that's
that's the reality of
it am I am I good at at stem ask me a
question ask me a science question don't
ask me if I'm good at stem don't trust
me to evaluate
myself who knows that's just stunning
Krueger you can't ask someone if they're
good at
something why is this model not good at
solving
twep I wonder if it's a KV
cache for some reason we're not
incrementing prove the irrationality of
the square root of
two uh
in cock I actually did that that's I
have that on my uh my thing I saw I saw
a Taylor Swift proves the irrationality
of a screw
Ty oh people should ask themselves that
I
mean again but like this is just this is
just a complete it's a complete circle
jerk uh no nobody who's any good at
things sits around and talks like
this and if you are talking like this I
don't think it's going to get better for
you or at least not what you're
trying uh I have a contiguous after the
KV cache yeah I'm going to try disabling
the KV
cache I mean the KB cach definitely
works in
gbt2 welcome wasp
um you have continuous
there
yeah well
so
I guess like how does it not even get it
wrong accidentally half the time
time that's the weirder thing what is it
outputting why is it only outut one
thing
wait it's terminated
already no that seems
broken
oh
shit okay we had a bug and press the
light up button if you can believe
it
but now we're still getting false false
there why is that Loop
exiting God I can't believe I actually
had a bug and press and press the light
up
button
this just bike shedding guys bike
shedding
uh
okay terminated and not
truncated Loop through there why is that
not printing a second
action
or
okay
okay there I mean to be fair this was
just a bug with my implementation of uh
a press light a button and not a bug
with
uh okay will it learn to play two
steps
it's slowly learning I had to lower the
learning rate to get it to learn the big
size
ones
should we have early termination if you
lose probably do
that uh so if you
lose okay so I guess this can be
[Music]
truncated and then and done goes
here if not reward self. done equals
true
okay now the episode L will
change let's put
the oh you want you want me to add a
failure reward I don't know if we need a
failure
reward um okay let's try a game length
of
five and we'll put the learning rate
back up to something
reasonable oh yo give me McFlurry bro no
like literally I'd love MC Flur right
now is it going to learn how to get good
reward
here
interesting it learns how to get three
reward and then it
stops I see my
ID uh I'm so glad I got a new ID my ID
has been expired for a while okay it
learned how to get three
reward
I don't know if it just like stops at
three I'll point out also we haven't
fixed any real bugs in
it or did maybe got five no I'm going
had to get one from the
top interesting I wonder if that like
means
something I wonder if it's trying for
that
somehow tendies yeah tendies
is the mly using cash yeah it
is again this is a totally stateless
game
um all right you guys want to try a new
game will you have to guess the
state to see if it's doing Time stuff
correctly you just it just tests
sequential
actions
it's interesting that it converges to
four wonder if that's like fundamental
or a lower learning rate it's
worse yeah yeah I think banned is that
the same guy who posted before dumb
crap dumb crap that's dumb it's
dumb start with a
timeout
okay
[Music]
see that's
interesting it learns and then it must
be when it subtracts the
reward like it must actually be learning
to do badly on the last
one driv an off by one error
somewhere
H okay let's try a few things let's
always shoot for a little bit higher
than the highest
reward I don't know what that's going to
do
I just not learn
anything and these all like this is all
just out of distribution at that
point it's like it's it's shooting for
5.5 oh well that's the best I've seen it
do okay that's pretty
good it solved it
we shoot for a little bit
higher
than than the highest
reward now these are still State
independent so like we could get
trickier with this game like it has to
learn the stuff offset by
one all right well just add We'll add
something here called hard
mode
um in hard mode the correct action is
actually the action plus the step
number
mod steal.
size all right let's see if we can as a
human play it in hard
mode
okay uh the answer is
one the answer here they want you to
think is zero but it's actually one wait
no that was wrong oh because we're not
in hard mode Let's go to Hard
Mode
one the answer a one you think is one
but it's actually
zero
no should have been that that should
have been step
stepn
zero oh also if self. hard
mode
no it's not respecting hard
mode what's going on
here why is that Step Zero it shouldn't
be I incremented the step num
here uh oh am I resetting every time
yeah I'm resetting every
time yes okay can I play the game on
hard
mode you guys see how hard mode
works
I feel like I probably wrote this exact
same game last time like with all the
same stuff does it ever learn hard
mode
it knows the first step reliably why is
it not actually taking that first step
reliably
then why does sometime I get zero
reward it seems extremely confident in
the first
step
no hard Mode's a little too hard for it
I don't
know I'm interested to plug in press the
light up button into all like the RL
stable baselines
things be curious to see someone do it
like can po solve
this how is it ever getting a reward of
Z
it just shouldn't
be hard Mode's too hard for
it non hard
mode
do better than that there's a five you
can get
to
I mean actually we're asking it to play
long games so let's give it a game
length of
32 because it's really a Max game
length yeah I don't
know try that some other
stream
like there's lots of different variants
of this game that are are quite
interesting it's only getting to
nine can't do
better
it's confident there now got to
nine oh yeah like like a a a t a table
based algorithm will solve this
instantaneously why does doesn't
reinforcement learning
work oh part of the reason this doesn't
work is cuz Target return is
one part of the reason that's reliable
and sometime it does does worse is
because even though that's I don't
know
I almost want like a like a discount
Factor on the
subtraction was a roll
out
what if I do
that there's no excuse for not doing
well on the first
one
I mean it occasionally gets it it's just
not
reliable I feel like I'm missing
something
I mean I see no reason like this game's
going to
struggle once it gets
to the game length is 32 bro keep
going you can do better you'll never do
better
now like it's a pretty good Agent but it
Peaks
there it's cuz when it gets to the last
one it's in a fixed St date okay I have
an
idea just so you don't get
stuck
subtract a random amount of
reward it can't just be
that Target
return torch cat Target return oh what
is this
scale what is
this that that's exactly what I was
doing where does that come
from the word scale doesn't appear
anywhere else in
here yeah then I got to set that up what
do you think I'm good at computers I'm
not okay that's a
lie so where do I get this scale
from well look I I told you I told you
this had to be in
here this okay now now we're in bullshit
land of RL like it's mostly correct
but hey Marcel
Bishoff
um if you check the GitHub it's there
where ask Quenton
Quenton I'm over
Quenton scale equals no no no no scale
can't equal a thousand that doesn't make
sense now that's decision transform
forer show me where scale equals a
th000 I'm not I'm not asking a model
that doesn't make
sense run decision
Transformer R
normalization oh okay well that's
actually not what I thought it was was
done that's
stupid I mean that's just cuz regression
is hard but we don't really care about
that we actually don't care about that
at
all
um okay so that wasn't what I thought it
was what did we have the most the best
results with we had the best results
with just multiplying it by a little
something CU we wanted to do a little
better you know like every everybody's
got to move up in the world you know mo
move a little past their their their
parents generation or whatever one's got
to move up in the world you're 5% better
than anything you've seen before try
penalizing it if it gets stuck all right
good carrots and sticks I love it I
don't know how to do
that reinforcement learning just doesn't
work this whole thing's
broken humans don't do this
crap if it gets down if it if it learned
the whole thing before it
uh I mean okay part of the problem now
is that this thing's just too simple so
you know like the failed self-driving
car company um so let's go back to
lunarlander and let's see if we can make
it
[Music]
land like the old days boys like the old
days
um okay well let's let's try a little
more press a light up button uh just to
make sure the jet works
okay I don't think there's anything
wrong with the
jet
during 10 hours all right reinforcement
learning is addictive because it never
works yeah okay let's just go this
again what
missing mismatch of VAR
vales I don't know about
that looks like some jet
problem how come I didn't see that when
I was in the jet
before
for jet.
reset not actually
resetting
[Music]
oh it's cuz I have
this yeah get a little faster with the
jet or nothing
faster it converges to a point where the
loss is low and yeah it converges to
something like that
come on just beat that
now let's play with our model A little
maybe the model may go
better di
bigger definitely don't need
that give her four
layers
it learns so
fast come on do better than
four but it has no incentive now to do
better
yeah the loss gets low and then it like
stops
caring like nothing improves after the
loss is
low we just learn to predict everything
in the uh okay I mean another fix for
this potentially
is where do I have
first
we can just just ER ratio right you can
decide how
many you can decide like now I'm doing
two episodes for each so maybe the loss
won't go to zero as
fast
pretty
useless I mean okay we can inject
variants by lowering the batch
size that's pretty much the same thing
is messing with the learning
rate
I
open you have to push
down thank
you we got tendies and
[Music]
mozzarella okay well lowering the batch
size made it
worse lowering the batch size made it
way
worse so you know what that makes me
think increasing the batch size will
make it
better
wait look it just
improved
can it do better than that why does it
stop at
Seven there's nothing special about
seven let's try let's target a 3% GDB
increase 3% let's target a 3% increase
[Music]
H oh we also we have to be a little
careful with
this I actually want to say highest
reward plus
highest absolute
value of highest
reward throw a little additive in there
too I don't know something like
0.1
that one is
nothing oh I went crazy there I meant
that since 128 is divisible by 8 I don't
think so
bro
should we also add some RNG to
that okay now we reach for something
that's a little
random
I don't think we want minus
one come on go up keep going keep going
you got this boy
it don't got
this it's
something can it learn to play the game
in hard
mode
hard mode has like polarity and
stuff Universal function approximated my
ass
to be
fair
these are the kind of things that
uh that
uh the AR kind of functions deep
learning is very bad
at
okay the actual thing I
want sometime don't do your
[Music]
best
yeah
okay well card P's
impossible lunar
lander
why is it not putting twos but it never
seas in the data
set
for
okay I think machine learning is
impossible this doesn't work just
doesn't
work I'm sure I have tons of bugs still
ah
I think this is the final
attempt tomorrow we'll try
again we'll look at some that actually
work okay
okay the loss is going down the reward
is going up I think that it's just
become lunar Faller
yep
[Music]
all right just shape that local
Minima
try crazy high
batch I mean part of the problem is it's
just showing it the same data over and
over again which I mean this should be
an offline
line all right now we've gone into this
mode where we just fired a right
Thruster how did anyone get this to
[Music]
work
f
to
has it learned
anything
like it all just looks so easy that they
draw that
picture and then you think oh I'll just
Implement that but you
won't
hm what what do they use for
K we feed it the last K time steps I
wonder if this actually
helps what's
K we blade on the context length k what
do they use for
k
no these things work there's just
bugs they're not
debuggable which is the most annoying
thing
falling is pretty
good oh here we go we use context l k
equal
30 which is
interesting I've tried like the stable
Baseline stuff to get something that
works and I've had no
[Music]
luck
okay I think we tried this for a while I
don't think this works let's spend 30
minutes and see if we can get beautiful
cart Pole to become I mean I'm sure it
works I don't know where my bugs are
there's so much that we have to test and
so much that we just need better
introspection
for but tiny grad needs better
introspection
for um
[Music]
so I I wrote this uh this is beautiful
cartpole
uh it's a example on Tiny grad and it
actually is an example of working
RL um it uses
Po and
now let's
see if we can
change the environment name to lunar
lander and let's see if we can make it
work
this one does work at carple at
least it's good to have something that
works I've solved lunar lander before
with with
PP
okay uh
let's train for way longer than 40 let's
try
400 because it's fast too which is
nice It's Quickly losing episodes now
let's see if it comes
back
no longer replay buffer let's tweak
hyper parameters until it
learns
[Music]
both losses are really
high might be too aggressive with the
learning rate go the replay buffer thing
let try
[Music]
200 oh see look it takes some bad step
and then it just starts losing
[Music]
entirely
let's get rid of reward to
go oh sorry not reward to go let's go to
discounting
what does this do now I think it just I
think it naned
[Music]
out or maybe that's when it fills the
replay
buffer
takes less
action oh yeah that probably makes sense
once it reaches the replay buer it's
fast okay that makes a lot of sense
actually
[Music]
um but sorry you don't get to be
fast it has to do it has to do
compilation until it hits the uh the
right
size could fix that with variables I'm
sure RL lib Works kind of if you set the
hyper parameters to what they to what
they demand the to be I don't know maybe
tomorrow we we'll take a look at other
people's RL code and see what we can
replicate
uh why does amnest work and RL not
work
[Music]
no the answer is not because RL has too
many hyper parameters o entropy loss
let's change
that I mean it can't just be that it has
too many hyper parameters right emus has
all those hyper parameters too and this
is just stable across a wide variety of
them right there's not that many hyper
parameters that are unique to
RL the critic loss is really
high oh we might also have to scale
these rewards don't have to be such
large numbers I don't know how it
manages to do so much worse than just
falling
at least the other one learned how to
fall this one I don't know what it's
learning but it's
fast
critic loss too
high what does it do after all that oh
yeah great good move bro good
move it's almost like it wants the
reward to be
big oh we might have to make the hidden
State a lot
bigger
this isn't
cple those are very simple
models it's unclear if they can learn it
that might be the
problem but no it's probably not that I
don't know you can solve this with like
neat and three
neurons
um
all right guess what we're going to
stream tomorrow too and we're going to
make this
[Music]
work it's just so
frustrating I
think
has anyone tried has anyone made like
dumb gym
games that are just like way stupider
well this doesn't work either so that
sucks we'll put back beautiful
cple that one at least solves
cple to be fair this algorithm does
better that it learns how to become
lunar
Faller to be I wonder if it would be
better with entropy
regularization where's the's the
app
I don't know if letting a train
overnight is going to
help I mean it can't solve the
simple it can't solve those simple
environments which is a bigger problem
has anyone done that
before
very
complex
every time we try to do RL on
stream no I'm not trying some stupid
hyper parameter optimization like this
is exactly the
problem every time we try to do RL on
stream we just end up frustrated and
angry this stuff just doesn't really
work maybe some very careful imple
implementations of it
do
but
box 2D is a p p game Library I think
yeah the loss calculation and update
well yeah the update's the most
important part oh shit the update's the
most important part of all of learning
the update is what learning
is
sorry is that where my head is can you
not see that graph not go
up and I thought we were going to get
Pokemon playing on a tiny box can't even
get lunar lander to
work can't even get the button game to
work yeah I've seen that
one why are llms bad because the IRL
doesn't
work oh today was a shitty live stream
today was a shitty
stream we started off we started off
strong with some good
rants we smoked some weed we had High
Hopes And what actually happened the
thing didn't even like like it just it
doesn't
land I don't know how to fix that uh
there's a million places bugs can be
they're probably in all of those places
plus 10 more I didn't think
of
um like it's not just going to start
learning it can't learn it can't learn
how to get past the seventh step of the
button
game I'm not pushing this to GitHub this
sucks too
much we'll stream again
tomorrow maybe I might have something to
do tomorrow I do tomorrow stream again
try again we'll go very nice and
slow we'll try
introspection like the usual techniques
what time tomorrow dude I just just just
don't don't don't trigger me right now
man I I thought oh we'll just get a
Transformer oh we'll just get a
Transformer it'll be easy oh it's just
like supervised learning it's not like
supervised learning because your shitty
model changes the distribution of the
shitty
data wow I never realized that the
ground changed
shape wonder if that's put in is that
put into the
state walk d
I know you want you want to just sit
here and watch it learn for a little bit
there just eight observations so it
doesn't tell you how bumpy the ground is
maybe one of the observations like how
close you are to the ground or
something I could try implementing it
with pie torch did did any of
the
I I've
[Music]
so what's my take in the future of web D
no uh no the words are still true but I
I am I'm in a bad mood that it does this
doesn't
work and like I probably have bugs I
probably have just tons of bugs
and we'll all be equal and we're dead
that's true that's true
except this model this model is still
going to suck more than everybody when
it's dead um just just land the thingy
just just just just land it bro just you
can do
it to be fair this does look a lot more
stable at least than
po it's a cool idea we we we learned we
learned something cool today we learned
that about how decision Transformers
work and who knows if you get everything
right maybe it just
works the loss is going down which is
interesting this thing is this big
Transformer is learning a
model of how the world
works just just leave it it's just like
my computer tries to land that did that
did that increase the thing look it
increased right there it went up a tiny
bit do we get the press button game
working yeah but not the hard edition of
it we got some simple variants of it
working
sometimes but I think we should
formalize the press button
game
formalize the press button
game we'll see what else can play
it to be fair I haven't done much
Transformer training at
all yeah I played breath of the wild
last night there's my switch controller
should we play some breath of the wild
and be bad at that
yeah this is what we did like it doesn't
work like the thing doesn't
land I have to do some real soul
searching after
this no I don't I'm just I'm just I'm
just mad RL doesn't
work like you see the Deep mine robots
playing
soccer they did that
by
no nobody's gotten this stuff
right like RL doesn't work anywhere why
are there no robots cooking and cleaning
it's cuz this do
like no I I work in robotics too trust
me I know it's all fake like K works
through so much careful testing and
like like like so much
just testing and
tweaking why do I just believe that it's
going to get better soon I just believe
that like oh it's going to learn how to
land but like it's
not this is a problem Comm uses R around
we don't use RL cuz RL doesn't
work we we wasted we wasted six months
last year on RL Comm has stuff we have
we like all our stuff works with lunar
lander and and cartpole and we have
something that can kind of drive the car
with RL it can go straight on the
highway but like it's just way worse
than everything
else figure robot tweet says they have
an RL
breakthrough can they solve the button
pressing game can their thing just
oneshot the button pressing
game um I've seen mobile
Aloha uh the videos are cool but yeah
like all
demos what's real what's sped
up
um it is cool though and like I think
that is a lot of the the right approach
to uh doing
the like doing cooking and stuff is to
first set up a very good uh they have
like they're their rig has like four
hands on it it's got like two hands on
the front and then two places you put
your hands and you can manipulate the
the rig
okay we'll try to stream again tomorrow
we're going to make this work we're not
going to lose we are going to make the
lunar lander
land if if you want more
content you're in
luck because you get more content when
shit doesn't
work we're in a bad
mood nothing you can do about
that
7th it's I'm not frustrated that this
code doesn't work I'm frustrated that I
I feel
like all of the introspection tools that
I would need to debug this just don't
exist uh it's as far as I know unless
something's really changed recently it's
not any better in
pytorch do you remember my mzero stream
I just failed at that I don't think I
ever got that muzero to to I did not get
it to solve lunar lander it just didn't
work
uh which is which is just
frustrating and then even beautiful C
Poole we have beautiful cart pole in
there it only solves it like 75% of the
time
uh I do think that another problem might
be that my initialization is bad that
that torch has better initialization so
that's one thing that might be different
about tiny gr and
torch RL is so hard and
stupid yeah but without we were talking
at lunch a few days ago like RL is RL is
ious if there's anything that is
consciousness it's it's it's having a
model of yourself in the
environment and you'll never do that
with supervised learning you'll never
understand that you are the
agent you need our for that so this has
to
work all right I'm tired try again
tomorrow yeah I know the musero streams
were massive because I I probably got
equally frustrated by this same garbage
like why why won't you just just just
like land between the flags bro land
between the
flags all
right we'll make it
work
ad5k: Ready to be influenced
perkofficial: What’s up
gerntt: HeyGuys
jamesred2313: Are you jewish
virgoshlok: hi
thuganalyst: TWITCHIE GANG
coProof: We in this ya!
frankie98_: HeyGuys
SkillzTech: Hey
FrankieTheKid: Ayyy
gandhi00: yo
nihonzera: hey
octeezy: notification squad
FrankieTheKid: Let’s gooooo
coProof: Instagram game!
goofe7: Wassap
PhoenixLuffy: George, I must say, you’re sexy as fook
thuganalyst: Hey that instagram growth is pretty good
coProof: I came here from instagram
FrankieTheKid: Butthole surfers unite
kruger3117: Sup!
ImAventus: Ayoo
mrmurder1010: Whaddup gerorge!
iamaflex: how come you don't use any vim plugins
Ahxs: ayo
mrmurder1010: Is murda!
ImAventus: Just watched Ad
480i: Notification squad yay
RS_Ggs: You sold your company?
coProof: Georgey what are you doing
thuganalyst: NO not laggy for me
FrankieTheKid: New Jersey represent @georgehotz
MajesticMack: lag is a scam
ImAventus: Need a comma ai beanie 🔥🔥🔥
mrmurder1010: The streams good for me.
jamesred2313: Lag is Jewish
iamaflex: are you in San Francisco?
480i: Turn off natural scrolling if you hate it
mrmurder1010: Deez nuts are Jewish @jamesred2313 all up on ya face.
jamesred2313: K
ad5k: Ur chat always sucks George
archeadis: why do you wear EOS tshirt wtf?
Mac_33: Guys, follow George on his instagram!
FrankieTheKid: Best teacher
octeezy: lag
jamesred2313: When eosmis
kevczy: Is this live?
ad5k: F
grizvok: It's not bad for me
grizvok: It's fine.
iamaflex: NO it's not lagging
jamesred2313: When eos becomes worthless at least the shirt will be worth something
virgoshlok: no
Mac_33: The chat was broken for a good few minutes there
virgoshlok: it's good
coProof: Who’s to blame from font config?
archeadis: lost all respect for hotz
frankie98_: yes its lagging
archeadis: eos shirt?
thuganalyst: It's not lagging
coProof: He’s wearing a wire!
kevczy: Is this live Rn?
FrankieTheKid: What’s with this booty connection @georgehotz
ImAventus: No its good
iamaflex: it's not lagging
archeadis: @georgehotz why are you wearing EOS shirt?
SafeHaven: ayyyy
slimpimp007: he had the "okay mom" tone
Ahxs: much cleaner
kevczy: Am I really bout to look at George hotel to code???!?
ImAventus: No it's good
SafeHaven: finally im watching u live
Ahxs: thanks george
Mac_33: It looka fine for me
gerntt: perfect
grizvok: Poke some smot...
octeezy: no lagging anymore
thuganalyst: Wait are you back in the comma house now
mrmurder1010: Aye guys I like poo nanny.
archeadis: oh Augur, you are forgiven
ad5k: Who smokes weed in chat
THX1342: alll ze shitcoins
joker2k999: gr8 talk too @ sxsw. We hacking the matrix tonight?
archeadis: @georgehotz do you know Chainlink?
kevczy: Weed doesn’t really help
FrankieTheKid: Anyone here from east coast
Sabotage_69: hey hotz, ida is better. sue me
Mac_33: Laundry stream?
thuganalyst: Yeah LOL let's hack the matrix
lefse: Finally a profile picture PogChamp
ad5k: My man making beats
ad5k: U see the keys
Caene: is he making memes in code?
THX1342: wait what where's tomcroose or whatever was the name
ad5k: Rip tomcroose
joker2k999: yea i saw the vi.
karelomab: VIM SeemsGood SeemsGood
lazystring: hello george
kevczy: I was always curious on why you use Mac OS X. Was this discussed before?
roosterhax: yo yo geoHot
ScrubLifeChoseMe: woahhh
joker2k999: no mo emacs :-(
Caene: "VIM!? bUt wHaT abOouOut eeEEeeemAaccZZ!??!" BrokeBack
cjocol2201: oh that's hot
nozoke: nice to see u on george buddy :)
ad5k: You should rap on an Owen Bones beat
joker2k999: oh sh*t, pulled out qira. we going deep tonight i see.
kevczy: Lol
lordFOE: what keyboard are you clackin on Hotz?
yoyo_brobro: yeeeet
ad5k: Sounds like cherry reds
joker2k999: crash is good.
FrankieTheKid: Yeet
roosterhax: you looked at sxsw like starting a new church. I'll sign in size get out
lordFOE: @ad5k not so sure
roosterhax: so*
joker2k999: comments still on the phone huh.. lol
karelomab: BabyRage
lordFOE: I'm not bad you're bad Mr.Hotz.
djcows: Which mac do you have
Irkanu: bogaHey bogaHey bogaHey bogaHey bogaHey
Sabotage_69: ye, i know. that was a joke. qira is amazing lol
coProof: George that was really cool
trashcan___: rip
erichtp: R I P
dungeonmaster3: @George when was the last time you were high ?
coProof: rip font config
FrankieTheKid: What’s with the booty quality
480i: Are the comments EVER good
slimpimp007: why did you sell it?
THX1342: 0xf00dbabe
AugTV: Are u using Qira to exploit font config ?
joker2k999: for the new hotness..
lordFOE: Nice george, very cool!
risky_banana: your VOD will be muted
whynoxx: good
Sabotage_69: qira is cool debugger tho
kevczy: Is this really live?
jamesred2313: Weed is trash don't smoke kiddies
ad5k: Smoke nootropics every day
coProof: I know three exploits in qira super easy
Sabotage_69: fuck windbg and xdbg
knilecrack: wsup mfaka
ad5k: shoutout commaiarchive
dungeonmaster3: why not @jamesred2313
r1c1c: why do you want the followers???
lordFOE: stupid mac indeed george
Mac_33: Install bettersnaptool
octeezy: @r1c1c fame
lazystring: freestyle?
Knarez: wait what's he making
joker2k999: get in the zone broseph
Sabotage_69: i remember the whole timeless debugging bif
Sabotage_69: bit
kevczy: @lordFOE LOL os x is actually a really good OS
r1c1c: @octeezy lets help him
Sabotage_69: thats really cool lol
jamesred2313: You should install templeOS
lordFOE: @kevczy haha just pissin the chat like usual when georgey decides to boot up the stream
glitchedoutt: osx got nothing on templeos
magician2378: Are you moving to san diego soon?
lordFOE: @jamesred2313 Perhaps a bit too advanced?
kevczy: @lordFOE no offense :(
octeezy: @glitchedoutt HolyC
joker2k999: lol. join the club.
Mac_33: Did you make the web GUI for qira?
lordFOE: theres an app for all of your problem
kevczy: Is he just connected to a local ubuntu server?
umps: he shaved the beard?
octeezy: RIP Terry Davis
evoxrocks: F
junyabuki: I waited for you :D
POEDaggy: hey man
Wolveswithears: @georgehotz Whats up? You were on Cyberwar, any inside information about it returning for another season? LOL
FrankieTheKid: Where’s amoneyShot amoneyShot
GoOnAli: OWL2019200iq
r1c1c: His focus is intense
FrankieTheKid: rannyCabbagethink
joker2k999: is there a bounty on fontConfig?
kevczy: what are we looking at rn?
kevczy: qira?
FrankieTheKid: BagOfMemes BagOfMemes
Knarez: segregate tabs and spaces REE
RealGamer613: are we in a chinese class?
joker2k999: oh no. vice is cool....
kevczy: lol how
iamaflex: are you in San Francisco?
FrankieTheKid: What video is that?
jamesred2313: Trusting the Jewish media
joker2k999: lol yea.. they gotta sell it to there base...
kevczy: lol that vice video
IsHenrique: imagine programing all day and not buying sublime OMEGALUL
kevczy: I watched that full thing
Knarez: LUL
POEDaggy: you're my hero man, first semester of python progrsmming soon done. love python
joker2k999: i didn't see it.
Dsplits: @georgehotz you got to pull out emacs
luhartt: the reason one is good!
ad5k: vice sucks now
Knarez: who did that interview?
Knarez: the recent one?
FrankieTheKid: Where’s video
FrankieTheKid: !vice
FrankieTheKid: !video
ad5k: !money
FrankieTheKid: amoneyShot amoneyShot
joker2k999: most people code distracted...kinda like life.
iamaflex: are you able to be productive and code if you smoke?
ad5k: !straightedge
kevczy: @iamaflex nope not for me
Dsplits: !keyboard
joker2k999: yes. u know I'm here for the RANTS bro
KaiHasTwitch: LUL
Knarez: look at this tool LUL Kappa
KaiHasTwitch: 20 pounders PogChamp
joker2k999: nice.
jamesred2313: Light weight
Mac_33: Can we get a laundry stream?
Dsplits: @georgehotz yo why did you lose the beard?
ad5k: lifting and coding is the path of light
dannyy_r: play me a song
Caene: That was the yearly workout, done.
MrBankster: what do you think of affirm?
speeddrawing101: shroud4Head shroud4Head shroud4Head shroud4Head shroud4Head shroud4Head shroud4Head
jamesred2313: Beards are jewish
Sabotage_69: no, they are muslim
erichtp: whats wrong with george's segment in the show? i felt that saying you didnt know about any black hat shit showed that there is more than these flashy hacks
kevczy: but wasn't that like in 2016?
jamesred2313: Both
ad5k: beards are hair
FrankieTheKid: How hood is shroud
jamesred2313: Hairs are cells
silverrayliegh: Y can't I watch the stream
ad5k: cell is best dbz villain
joker2k999: Rant incoming?
FrankieTheKid: Is George the shroud of programming
Sabotage_69: beers are cool
karelomab: VSCODE OMEGALUL
erichtp: rant rant rant
joker2k999: O, MS just openSourced it right?
kevczy: yeah finally, programming in C is the funnest thing ever
Gtxgaming23: omg its georgehotz how do you do sirrrr
FrankieTheKid: It’s been open sourced
FrankieTheKid: amoneyGuy amoneyShot
erichtp: open sourced calculator
joker2k999: sublime looks cool tho.
luhartt: vscode is the shit
Dsplits: is better than sublime
acheesedanish00: Geohot back at it
Dsplits: you can set the sublime theme on vscode
joker2k999: haven't used VS in forever.
kevczy: Personally I don't like vs c
FrankieTheKid: @georgehotz download the extensions for python They’re insane
greywolfaus: Hey new to the stream I heard this guy is a wizard
Sabotage_69: no no no, not on vscode. its shit
Mac_33: Xcode is actually brilliant for C development as well
Knarez: need to install a color theme Kappa
ad5k: c hurts my brain
Dsplits: @georgehotz change the theme
Mac_33: The tight integration with LLVM makes debugging super easy
kevczy: I love C
Sabotage_69: its shit
Irkanu: double click to leave that bad boy open
joker2k999: i do like what VS and AI integrators are doing
kevczy: WAIiiiiiiiit you programmer for years and you never used vsc?
FrankieTheKid: @georgehotz download vim shortcuts extension
kevczy: programmed*
Sabotage_69: try the real thing and switch to windows
mescal33t: what a surprise. First time i see the Legend himself live
greywolfaus: can anyone here teach me python?
davidsit_site: I just switched to VS code and don't use intellisense
ferrari_pizza: hey, just joined in, what is geohot trying to do?
Mac_33: @greywolfaus Yes, you.
Sabotage_69: some exploit
kevczy: @greywolfaus https://docs.python.org/3/ teach your self
Mac_33: @ferrari_pizza He's exploiting fontconfig
iamaflex: @kevczy yea because he uses a real editor. vim
joker2k999: LOL
ferrari_pizza: isn't Ida waaayy better?
joker2k999: that went as expected.
cIafran: ctrl tab I think
iamaflex: no
davidsit_site: grey wolf python.coach is a new site for python stuff. real new. python.org is better for now
kevczy: @iamaflex yea vim's great
Caene: why care about what editor he's using? LUL
ad5k: everyone has their own path @greywolfaus gotta answer your own questions
Dsplits: @georgehotz what's this program for?
Knarez: alt left arrow is default for back on vscode FeelsBadMan
Mac_33: Try Xcode my dude
greywolfaus: fair enough cheers everyone
cryptoguys: What is this assembly viewer you're using? @georgehotz
kevczy: @greywolfaus python as a 'language' isn't that hard so you just gotta find your own way to study
mrmurder1010: i got banned for sum nuts joke
mrmurder1010: ok?
joker2k999: ida is expensive
FrankieTheKid: Where’s all the white women at
Dsplits: @cryptoguys qira
MrBankster: bro would you work at a place where you had to pair program all day?
cryptoguys: Thank you
Sabotage_69: qira, its a debugger
farresito: Just joined. Did he comment anything on Ghidra?
mrmurder1010: @FrankieTheKid swear
greywolfaus: completely new to coding heard python was easy
Dsplits: @cryptoguys he made it
Sabotage_69: he wrote it, its a timeless debugger
mrmurder1010: @FrankieTheKid real talk talk bro
Sabotage_69: its super cool
davidsit_site: davidsit_site subscribed with Twitch Prime. They've subscribed for 4 months! is simulated hardware subject to hardware exploits?😅
Sabotage_69: if the simulation is 1 to 1 ye
mrmurder1010: m
mrmurder1010: But yo
mrmurder1010: we hacking
Irkanu: preggo
jamesred2313: Jewno
Sabotage_69: jewyes
Knarez: ellen page Kreygasm
mrmurder1010: We got computers and we hack. On sum Edward Snowden type shit
kevczy: what the... what server are you connectede to????????
Mac_33: @kevczy localhost
djcows: can you do a tutorial on how to get more ram
kevczy: ahh! @Mac_33 finally thank you i was asking this question a lot
Sabotage_69: qira is a debugger running locally
Knarez: LUL
Mac_33: @kevczy qira hosts a local web server to show the debugger GUI
Sabotage_69: ^
cryptoguys: Why do so many programmers use Mac? Linuxs has the Unix shell too 👀
digdiggs: You made the mistake of not using their awful magic mouse
kevczy: @Mac_33 oh wait no I was asking about the terminal ssh servr
Mac_33: @cryptoguys macOS has more users, and the quality of software is better, and it's more consistent.
cryptoguys: Hmm.
Sabotage_69: but mac os sucks ass
ad5k: say something funny mr murder
Caene: @Mac_33 Your name LUL
greywolfaus: idk wtf anything on this stream mean's
cryptoguys: I hate mac though, apple in particular
kevczy: mac os is pretttty lit
ferrari_pizza: geohot keep on the good work...
greywolfaus: but i dig it
Mac_33: @cryptoguys Linux is great, I use it for my servers, but macOS is better for just daily use.
cryptoguys: Apple overprices their garbage hardware
Sabotage_69: correcr
Knarez: install gentoo Kappa
kevczy: because you can just use the ssh server right away
kevczy: what a god
Dsplits: leaked password
Caene: @Mac_33 With a name like that you're biased af LUL
whynoxx: is this live?
Sabotage_69: no
greywolfaus: nah
greywolfaus: not live
kevczy: no this is recorded
r1c1c: use vscode now
ad5k: it's from the future
kevczy: yea
cryptoguys: I love using Unix shell, it's great but like getting a mac just for macOS is bad. i'd rather not spend $3000 for a half decent piece of hardware
TomFordNY: Then ties the hardware to unique edid so you cant get afterarket stuff into their hardware either
TomFordNY: moon2PH
Mac_33: @Caene Yes...? I use macOS.
MrBankster: i use mac because it's pretty
ad5k: Password = Password12345
iamaflex: Mac os x is great and has great integration
ferrari_pizza: crypto ur right
greywolfaus: how did you know @ad5k
cryptoguys: So with qira is it taking his program and following the stack commands?
Knarez: mac keyboards WutFace
iamaflex: most developers in companies in bay area get a MacBook pro
kevczy: wait how is his terminal seperated like 0@ bash 1-$bash?
r1c1c: what does qira do?
iamaflex: tmux
ad5k: Why did you bring a horse in here steve jobs and bill gates @mrmurder1010
kevczy: @r1c1c debugger
iamaflex: @kevczy tmux
cryptoguys: Can you explain what qira does @georgehotz
kevczy: @iamaflex thank you babe
r1c1c: what debugger is that?
Dsplits: @georgehotz how long did it took you to build it?
davidsit_site: sabotage - Do we have any (many) 1 to 1 simulations of anything? from the level of motherboard cpus (which we can 'simulate' completely) but made of quantum molecules we can't; so 1 to 1from what ref? (in reference to jailbreaking the universe)
brevan04: Yo we back on qira!
kevczy: @iamaflex no offense by calling you that
r1c1c: it reads your memory real time?
montecarlo: just read github for description of qira lol
iamaflex: lol
ad5k: boooo
greywolfaus: @georgehotz sorry for being that guy that knows nothing but please explain what you see when you read the data infront of you
cryptoguys: alright
kevczy: Can you not?
ad5k: get out dude
ad5k: shut up
Sabotage_69: qira is a debugger but a timeless one. meaning you can step back
Sabotage_69: with a normal debugger you can only go forward, with qira you can step back instructions to see what registers would of been
greywolfaus: @Sabotage_69 can you sxplain what's going on?
Knarez: your OBS is echoing
kevczy: omg about like few years ago x86 reversing was a thing so i've cracked a lot of programs and look rightnow! non x86 and all linux x64 :( sad
kevczy: but not in real bug bounting but in ctf and stuff
ad5k: qira looks pretty sick
r1c1c: step back to what?
r1c1c: the line of code before?
Sabotage_69: kinda
Mac_33: @r1c1c The previous CPU instruction.
Sabotage_69: previous assembly code
kevczy: yea
montecarlo: program execution
Sabotage_69: code that has already ran
r1c1c: ahh
Knarez: ctrl k ctrl s to change the keys in vscode TT
r1c1c: shit
r1c1c: i get it
the_blade_runner: it's ya boy George Hotz
greywolfaus: I don't understand anything thats happening
montecarlo: no one does :) since its not our code
Sabotage_69: someone asked what he was doing. he is trying to implement some exploit. the cve on the title is the name of the exploit
Sabotage_69: if you look it up
kevczy: @greywolfaus you're good :)
Sabotage_69: you will get some info on it
kevczy: ohhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
brevan04: CVE that is in what?
Sabotage_69: wow this dude just made my comment irrelevant
Sabotage_69: you suck hotz
kevczy: @Sabotage_69 :(
greywolfaus: cheers anyway @Sabotage_69
greywolfaus: cheers @georgehotz
Dsplits: @Sabotage_69 what does the program do?
the_blade_runner: Yo what is he using to read those low level values?
Mac_33: @the_blade_runner qira
the_blade_runner: damn that's sick
kevczy: dammit I was working on my exploit project and you just started to stream. can't stop watching
montecarlo: from the internet: Fontconfig could allow a local attacker to execute arbitrary code on the system, caused by the lack of offsets validation. By using a specially crafted cache file, an attacker could exploit this vulnerability to execute arbitrary code on the system.
greywolfaus: CVE = Common vulnerabiliities and Exposures correct?
kevczy: Can you really work on stuff with musics on? I can't
capitalb0t: this is my first time here, it's a pleasure to see you at work.
Dsplits: @greywolfaus yes, google CVE-2016-5384
allthesm0ke: the 20 lb weights in the background are definitely a vibe
r1c1c: @kevczy Try to focus more on the beat
r1c1c: Instead of the lyrics
montecarlo: F
kevczy: @r1c1c I just don't like musics lol
joker2k999: lol
kevczy: except for those cafe classic musics
Sabotage_69: anyways, yall have a good night. got a calc3 test tomorrow wish me luck boys.
greywolfaus: cheers @Dsplits
erichtp: Lol
kevczy: @Sabotage_69 good luck
greywolfaus: Break a leg @Sabotage_69
r1c1c: Goodluck @Sabotage_69
joker2k999: gotta have that MacMiller bro
kevczy: Where is the ssh terminal connected to?
joker2k999: Rant time?
allthesm0ke: use ghidra
brevan04: Love Hotz rants
legendarydarkstar: he is smart in what he does
Protoxus: Hey there :)
kevczy: wait are you converting c to python?
neversubbedordonated: @georgehotz how much egirl poon do u smash weekly?
FrankieTheKid: rannyGG rannyGG
pavankumarp: what are you doing bro :o
greywolfaus: greywolfaus gifted a Tier 1 sub to legendarydarkstar! This is their first Gift Sub in the channel!
r1c1c: he is trying to exploit the cve
joker2k999: learn anything cool from SXSW?
davidsit_site: nice wolf
greywolfaus: O_o
brevan04: SXSW is money grab from all the liberals in Texas
erichtp: Lol
joker2k999: makes sense.. lol
RomanNYC: LOL
joker2k999: gotta get in first broseph
Mac_33: There are liberals in texas?
legendarydarkstar: @greywolfaus thank you but you didnt need to :)
joker2k999: its turned into a big social mixer.
480i: In Austin @mac_33
greywolfaus: all good @legendarydarkstar
r1c1c: Is he ignoring my chat because I haven't subbed?
joker2k999: emo chill? no...
Biffingtonn: put the homeless on a deserted island and let them fight to the death over resource drops.. and make it a tv series
legendarydarkstar: the day A.i tries to take over hopefully Hotz
legendarydarkstar: steps in
cryptoguys: Why would you advise against Ghidra @georgehotz
brevan04: Night y'll
joker2k999: His church will be built by then
davidsit_site: think white collar or blue color jobs will be automated first? outside of driving, food, and, shipping I think white collar jobs are more at risk.
greywolfaus: keep up the work @georgehotz I'm sure you will figure this shit out
legendarydarkstar: @georgehotz hahahahaha
kevczy: dammit my mac ssh gets really laggu
legendarydarkstar: @joker2k999 hahahaha
Irkanu: is this ironically good or what
legendarydarkstar: @greywolfaus thank you for the sub again but why ?
legendarydarkstar: this act of kindness was random
cryptoguys: yo why doesnt hotz use Ghidra?
greywolfaus: just cause @legendarydarkstar you got your heart in the right place
Irkanu: wait ill sub don't ban me lmao
Mac_33: @cryptoguys ghidra maintains a constant websocket directly to NSA servers 💩
Dsplits: @georgehotz search "Sunny Day Real Estate - In Circles"
Mac_33: I'll try ghidra, but only when I can compile it myself.
cryptoguys: And why do you care? Anything shady happening? Why worry? @Mac_33
legendarydarkstar: @greywolfaus thank you :) you cared of what i said
joker2k999: gotta compile everything urSelf...
cryptoguys: Still wondering why everyone is so worried about being spied on LOL
Irkanu: Irkanu subscribed at Tier 1.
cryptoguys: Literally if you have nothing to hide you have NOTHING to be worried about.
greywolfaus: how to hide ip?
Mac_33: @cryptoguys Yeah! Why care about freedom of speech when you have nothing to say!
greywolfaus: xd
Protoxus: Protoxus subscribed with Twitch Prime. They've subscribed for 2 months! Help the po-- I mean, productive programmers
joker2k999: not worried, but if your gonna sell what I'm doing, i should get a cut.
cryptoguys: @Mac_33 yep.
cryptoguys: Even though being spied on is shady its not that bad.
cryptoguys: IF you are not a bad person you should have nothing to be worried about
legendarydarkstar: @Protoxus you're just a meanie
kevczy: what ssh server are you connected on your terminal?
FrankieTheKid: vincerOne vincerOne
Protoxus: @legendarydarkstar That's mean to call someone, isn't it? jgrTARD
joker2k999: nice pre-rant
davidsit_site: HA
kevczy: Thank you finally!
Protoxus: Evil is arbitrary, moral is a spook! jgrREE jgrREE jgrREE
greywolfaus: geo seems pretty chill
kougithings: Can somebody give me sub charity? Think of the poor George Hotz with slow pc
FrankieTheKid: amoneyGuy amoneyGuy amoneyGuy
Aocuser: Could you please explain again what are you doing with fontconfig?
FrankieTheKid: amoneyR
fimonlark: hi there
joker2k999: doesn't everything?
davidsit_site: I'd rather gift George some of my upload speed.
legendarydarkstar: @Protoxus ogrobBlackGUY
samtheprogram: @aocuser based on the CVE title I assume a security bug
joker2k999: he's going to hit the bong?
FrankieTheKid: @davidsit_site LUL
samosasauce8: GeoHot: *Is making the most revolutionary piece of software* *Calls it basic programing*
kevczy: Is it creepy that I'm using his 17 year old photo for almost all of my profiles picture
Aocuser: @samtheprogram Hmm, thank you
joker2k999: we thank u bro.
Knarez: use the big brain WutFace
thuganalyst: I returned the 13" MBP for the 15" one, worth it, soooo much faster
greywolfaus: Appreciate it @georgehotz
FrankieTheKid: Why are you working on a potato 🥔 laptop @georgehotz
greywolfaus: even though I understand pretty much nothing
joker2k999: but why is ur cpu crap? Ur on a pro right?
greywolfaus: xd
foxubu: Yay qira o/
joker2k999: must be a 2016.
kevczy: Bye guys I've code for 13 hour straight so I don't have anymore energy to watch this have a great day and a great life! bye
thuganalyst: Did u get the 13" one for travelling?
greywolfaus: he needs a threadripper
Mac_33: https://clips.twitch.tv/DoubtfulVibrantIcecreamLitty
joker2k999: lol. everything needs thread ripper.
foxubu: Ups you’re still with the 13 inch MacBook
davidsit_site: oh...simulation maker! is it a Mac with a spinning disk or SSD?
joker2k999: peace. my nights just beginning.
legendarydarkstar: gonna sleep night yall
markvlk: Yo George what chair do you have? I need a small one like that for new apt
greywolfaus: so is he using bash language?
greywolfaus: is bash even a language
legendarydarkstar: @greywolfaus thank you and goodnight
joker2k999: lol.
Mac_33: Yes it is
greywolfaus: night @legendarydarkstar
r1c1c: @georgehotz Have you talked to Elon Musk in real life before? How is he like?
markvlk: He’s in C & Python, what you talking bout bash son
samtheprogram: yeah bash is a language
Irkanu: what do you plan on targeting after exploit is implemented?
samtheprogram: command line just interprets bash line by line like a REPL
brevan04: Elon must not be bitter anymore then
thuganalyst: Umm pretty sure Elon tried to contractually fuck George
joker2k999: the question is bro's can we get George on JoeRogan. lol
markvlk: Yes we can
Mac_33: George, remember the -Y flag when SSHing into that box
risky_banana: ^
r1c1c: We need george on joerogan
joker2k999: its funny everyone is trying to get on Rogan now. lol
thuganalyst: Someone contact Young Jamie lol
Mac_33: The -X flag doesn't work, you need to use -Y
greywolfaus: @markvlk i just read bash 1 bash2 bash3 down the bottem with $ and i'm pretty sure $ is used in powershell terminals like on macs
brevan04: I use xquartz for NMR visualizations
joker2k999: me too. xquartz is cool
greywolfaus: or I'm an idiot either iether
Anthony_Weiner: Where you at in the city?
markvlk: @greywolfaus $ is normal user prompt # is root
joker2k999: closet w/ weights and a fan. In NYC that would be 2500/month
Irkanu: that's what i've been wondering this whole time lol
greywolfaus: ahh ok
TreeJayyy: Your webcam is skipping just thought I’d let u know
joker2k999: lol C is life bro
brevan04: How did Ricardo use to work in this
Mac_33: C is great, poorly written C is not.
RomanNYC: lmao
markvlk: I never wanted to go back to C after doing Java and Python
Knarez: REEEE
joker2k999: yea... i can never get w/ tab
markvlk: Savages
greywolfaus: would love if someone could point me in the right direction for a good starting point on what to learn
Mac_33: Can you give feedback on MY C code? :D
etherstake: dox him
joker2k999: lol. Rant incoming?
RomanNYC: dam going on a witch hunt
Protoxus: Can you make a fontconfig disstrack?
joker2k999: lol
markvlk: Plot twist, George wrote fontconfig
joker2k999: ROFL
un3okapi: @georgehotz please post more selfies on instagram. You model status
brevan04: How much do you understand about xorg?
markvlk: Only way to hit 1M 2019
markvlk: 1m2019.com
joker2k999: fonts will be fucked for weeks...
markvlk: Ooh hacked
brevan04: "Understanding fontconfig requires understanding why it was created and what problems it is trying to solve. That require a lot of understanding of Xorg. Font configuration on UNIX machines went through different phases and fontconfig is simply one of the possibilities you can use to use fonts through Xorg. Reading the source of fontconfig without a good understanding of the source of Xorg is probably very difficult. But, I believe that an understanding of the concepts behind the evolution of fo
markvlk: Sounds hella boring
joker2k999: ok.
foxubu: Interesting
markvlk: George just lmk what that chair is so I can buy one thanks
tabasco0615: Is that a VM on host machine?
kougithings: greywolfaus: The bash1 bash2 bash3 is tmux. It's like having different tabs for the 'terminal'
Chris_YYM: yo bro, can you play some Apex?
joker2k999: here it comes..
davidsit_site: no. it's a pc across the closet
davidsit_site: @tabasco0615
joker2k999: rant time bro!
brevan04: Chromeium?
greywolfaus: oh cool @kougithings
tabasco0615: @davidsit_site cool! Thanks
joker2k999: apple is nice.
markvlk: Woz
Mendacii_: Hi nice to see you streaming man
davidsit_site: anytime man. he said it earlier. someone else asked the same thing
mattikaldi: you like reading books?
markvlk: it’s hard timing when George is gonna look at the chat stream to perfectly time questions to him
markvlk: I just want that chair
joker2k999: compiling w/ gcc?
TreeJayyy: Are u on a desktop?
alienware997: Greetings from Germany!
joker2k999: FontConFucked?
markvlk: George hacked himself
markvlk: RIP
markvlk: *the red team is in*
Muffican: Pog
Mac_33: Imma go shower, don't say interesting stuff for the next 10-15min
Irkanu: QUICK ASK A QUESTION
mikey9988: LUL
viper262_: LUL
davidsit_site: lol
markvlk: yes
markvlk: I want it
Chris_YYM: hey what's your chrome theme tho?
Dsplits: @georgehotz are you an npc or a pc?
tabasco0615: LUL
markvlk: That’s fine, I just need a small chair and it looks comfy
joker2k999: lol my chair is amazon basic.
joker2k999: hell, one day our houses will be amazon basic...
thuganalyst: https://www.amazon.ca/AmazonBasics-Mid-Back-Office-Chair-Brown/dp/B0735WMNT5/ref=asc_df_B0735WMNT5/?tag=googleshopc0c-20&linkCode=df0&hvadid=292955455174&hvpos=1o3&hvnetw=g&hvrand=9938831624693235042&hvpone=&hvptwo=&hvqmt=&hvdev=c&hvdvcmdl=&hvlocint=&hvlocphy=9001286&hvtargid=pla-383928517126&psc=1 LMAOOOOO
markvlk: I’d buy an AmazonBasics house
thuganalyst: Same
etherstake: one day our gfs will be amazon basics FeelsWeirdMan
markvlk: CANADA, I need .com none of this .ca biz
Dsplits: @thuganalyst ew Canada
joker2k999: delivered same day bro's
thuganalyst: @Dsplits ;(
markvlk: I don’t want that kind though I went the minimal mesh kinda back George has
markvlk: I had a cheap shitty leather one and it formed to the shape of my ass and got super uncomfortable and sweaty
thuganalyst: 😂
lightofhel1: !upstream
mikey9988: anyone elses stream lagging?
Dsplits: @markvlk don't buy leather.. shit gets smelly
Protoxus: lightofhel1 If you have BTTV you can use /uptime
viper262_: leather does suck for longevity
davidsit_site: have you ever considered something more minimal? I have back problems after years of being at the PC and recommend a knee chair @markvlk
davidsit_site: not in the past 2 min @mikey9988
markvlk: that’s why I want the chair Hotz has! he’s holding out on me tho
Wondrouss: @Protoxus wow been using bttv for years and never knew that, thanks
lightofhel1: !uptime
markvlk: a knee chair? What is that
thuganalyst: Do knee chairs not have back support?
Dsplits: @davidsit_site perhaps a standing desk?
Protoxus: Wondrouss You're welcome I also just learned about it recently. Super nice for streams that don't have their own uptime command :P
davidsit_site: Office Star Ergonomically Designed Knee Chair with Casters, Memory Foam and Black Metal Base Black https://www.amazon.com/dp/B002L15NSK/ref=cm_sw_r_cp_apa_i_LrhLCbBS62RFP
davidsit_site: delete after = ref
markvlk: That thing doesn’t make your back sore??
Protoxus: Fontconfig: exists
markvlk: I feel like I’d be hunched over all day on that
Protoxus: George: jgrGun
davidsit_site: forces me to engage properly or get up
davidsit_site: @dsplits good idea!!
markvlk: huh never seen that kinda chair
thezilion: rm -rf / fuck world
Silver5005: that chair looks awful for your back lmfao
miraeldoto: whats going on here
Chris_YYM: rm -r thezilion
markvlk: O shit https://www.amazon.com/dp/B00IIFW2L4/ref=cm_sw_r_cp_awdb_t1_GuhLCbS2R6Z8Z
markvlk: I think that’s his chair maybe
benhalverson: hey @georgehotz are you still hiring at comma.ai I was thinking about doing your github challenge i found online
Chris_YYM: "apply online"
markvlk: @benhalverson they are, have available jobs on their website
markvlk: Woah woah phone down George, gotta focus
davidsit_site: hmm...didn't know that
thezilion: apple approved
markvlk: Night
davidsit_site: thanks @markvlk
markvlk: I gotchu
davidsit_site: night
markvlk: George I still have the box you signed, idk what to do with it yet
MrVikshay: hello hacker man
thezilion: geohot is mr robot
brevan04: Hi Alex!
markvlk: Hi, Alex
brevan04: For tesla
un3okapi: alice or alex?
lightofhel1: KonCha
brevan04: I know what tomorrow is...
markvlk: It’s Friday
Protoxus: markvlk  1
thezilion: lightweight
iamaflex: tomorrow is that eyes wide shut party
thezilion: like a hackerman bodybuilder
lightofhel1: no privacy with twitch
Chris_YYM: who is she just curious
markvlk: We all know
markvlk: George so thoughtful
yoshimoto555: night hiking?
Irkanu: "they don't know your name" > says name
markvlk: ALEX they don’t know your name
markvlk: Coyotes are weak bruh
markvlk: Talk to me when you encounter wild wolves
davidsit_site: can you use twitchers instead of twitches?
joker2k999: yea... twitchees are like users
brevan04: They flirt a lot
Irkanu: BYE ALEXXX
Chris_YYM: who's she
markvlk: see you @ 7
kougithings: George getting some action PogChamp
joker2k999: her doubt is similar to my gF when tell her i won't stay up all night w code
davidsit_site: eh, whatever makes you happy
Protoxus: kougithings Some hiking action PogChamp
kougithings: protoxus: You know it
markvlk: SwiftRage
slapusillydawg: choosing her over us WutFace
Mumie1337: its 7am for me ... iam fine lets gooo
Protoxus: Twitchies > Alex
Protoxus: r/hedidthemath
markvlk:  1
markvlk: George is gonna hike to GDC
joker2k999: no you are not.. lol
kellyIake: George! did you tell them to buy your computer!?
joker2k999: damn golf course.
slapusillydawg: golden gate park
joker2k999: a lotta roads..
brevan04: Go swimming in Nebraska it is all flooded, you can swim everywhere
markvlk: Go to the labyrinth brah
kellyIake: hi brevan!
joker2k999: that area used to be so cheap back in the day..
brevan04: Hi Kelly, do I know you?
markvlk: Mission Peak in Fremont, do it
kellyIake: it’s alex
brevan04: Lol haha
Irkanu: bogaHey
kellyIake: omg we’ve been there
brevan04: You should subscribe
joker2k999: weed b4 a hike = heaven
thuganalyst: Do u miss your 15" Mac
Gtxgaming23: this is jailbreak?
kellyIake: i’m irl subscribed
Irkanu: Irkanu gifted a Tier 1 sub to kellyIake! This is their first Gift Sub in the channel!
brevan04: Ture
brevan04: True*
markvlk: Home Depot, premium hike destination
Irkanu: i got you
kellyIake: omg thank you!
brevan04: I knew a guy that worked at home depot and walked so much that he lost 30 pounds in 2 months
Protoxus: markvlk Nah, then you gotta carry all your shit back
markvlk: Trill
joker2k999: lol
markvlk: Zoo...x
joker2k999: is it a happy zoo tho?
Protoxus: brevan04 That's impressive. Hopefully he had good shoes.
Gtxgaming23: You should make a 120 hour long stream creating AI that responds to something
moepost: this is fun
Protoxus: Gtxgaming23 ... And then put it on a Twitch bot
yoshimoto555: invents self driving, prefers public transport
brevan04: Guy who started SDC company: "I like public transit"
Protoxus: jgrTARD
joker2k999: lol
joker2k999: Irony? no
Masboy_: good afternoon Mr Hotz
markvlk: @yoshimoto555 lel
Irkanu: could take a hike in the ocean
kellyIake: i’ve never been to the zoo!
joker2k999: afternoon? where
joker2k999: uk?
markvlk: I know a crazy guy that goes to Ft Funsten so watch our
VoidSpyke_: greetings
markvlk: out*
thuganalyst: Put a EON in the Muni
brevan04: Yes ^
Gtxgaming23: Google came up with a new game console called STADIA... Lets hack it already..... LUL
kellyIake: someone just died there
markvlk: George hike Tennessee Valley... but you’ll need a car or Uber/Lyft or GGT bus
markvlk: Someone died at Ft Funsten?!
joker2k999: dang. thanx alex. lol
kellyIake: that was in the 50% i guess
joker2k999: know not to go walking there...
Protoxus: 100% chance some autist from chat is gonna meet you there. :D
risky_banana: maybe you could drive your Tesla? ;)
b_______________________b: wow you finally change your twitch name
Bryanswagbeast: aw man I'm late :(
Bryanswagbeast: what are you doin today?
yoshimoto555: @Protoxus guarenteed action
moepost: 2h walk
markvlk: breaking fonts and planning hikes with Alex
joker2k999: "Thats a fun walk" inside George is dreading the walk.
kellyIake: george loves walk!
Bryanswagbeast: are you hacking today or what? @georgehotz
adamalex16: yo bruddah
joker2k999: walking keeps you alive bro's. getHip
markvlk: walks only, sorry no hacking
thezilion: do you like a sports?
tabasco0615: Is it safe to walk in that district?
elitetech101: elllo elllo ello
Bryanswagbeast: what is he doing?
kellyIake: how do i get a sword by my name?
brevan04: Alright good night all
thuganalyst: Get a treadmill desk like Linus Torvalds
markvlk: it’s safe unless you’re the one that died at Ft Funsten
joker2k999: NightBro
kellyIake: night! 🖤
markvlk: night brah
joker2k999: yea.. no Ft Funsten. gotta make a note..
moepost: I walk 10km peer day
risky_banana: @kellyIake sword means moderator
lightofhel1: @
joker2k999: ..thats what i thought...
i_nihil_i: are we instafamous yet?
markvlk: 1m2019.com baby
joker2k999: i can dig it. we do too. LOL.
i_nihil_i: thats hawt Kreygasm
moepost: Kreygasm
i_nihil_i: o shit guys i was gifted a sub earlier in another stream lol
kellyIake: nice to meet you guys. night!
GingerNutsack: Any thoughts on the upcoming exascale computer?
BeefWellingtonn: Hi
jdublu7: just joined whats the aim of this sprint
VoidSpyke_: what are we trying to accomplish here?
moepost: @georgehotz where do you see yourself in 10 years?
markvlk: night possibly fake Alex
thezilion: DO NOT EDIT THIS FILE
kellyIake: hahaha i’m real! ask george to tell you about kelly lake
Irkanu: bogaT
freshkelly: hi kelly lake
markvlk: he could be in on it, spreading the fake news
GingerNutsack: How's BC, Kelly?
BeefWellingtonn: where am i from
freshkelly: it's nice and sunny
markvlk: George tell us about kelly lake
markvlk: She told me to tell you too
markvlk: haha
markvlk: Ol’ sensible side buttons
BeefWellingtonn: I want some of that kelly lake water LUL
markvlk: what drew you to that random ass area in SE San Jose
BeefWellingtonn: PunchTrees code minecraft PunchTrees
GingerNutsack: Where can I get that toque?
i_nihil_i: guys im really stupid i need halp. Im trying to get my bitbucket repository on my new laptop and i keep getting an error when i try to add the key. it adds a file called known_hosts along with the keys and then when i try to add it to the agent, it says it couldn't open a connection. Any thoughts?
Irkanu: @georgehotz I already did fam
Irkanu: that's why she texted you lmao
Irkanu: she wants a sword too
mikey9988: assembly DansGame
BeefWellingtonn: PogChamp
markvlk: Quick fam, ask a good question
i_nihil_i: oh no he said legitimately LUL
markvlk: Ask him for comma.ai leaks
gerntt: can i ask you a question
un3okapi: @Irkanu make this one count
markvlk: ask him what’s tomorrow that he had to talk about in code
VoidSpyke_: thoughts on ghidra
i_nihil_i: ask if he has a sword he can give her ;)
markvlk: ScaredyCat
markvlk: ask him why he hacked from Asia for several weeks or months
bergsdal: oh hey hackermna
bergsdal: hackerman
mikey9988: ANELE
markvlk: or when he’s gonna get hardware out to run bigmodel and HD maps
bergsdal: I finally cocked you online
bergsdal: caught*
i_nihil_i: ask him
Irkanu: As a pretty young CTO of a startup - what kind of advice would you give for me to look out for? We are well funded and in the real estate tech industry, but some of the other c-level's have more experience than years I've been alive. How do I exit successfully?
i_nihil_i: what his favorite color is
Irkanu: And what is your favorite color?
markvlk: Nailed it
bergsdal: his favorite color is blue
bergsdal: Light blue
i_nihil_i: but thats two DansGame
Masboy_: VSCODE > Vim
bergsdal: A lighter version of blue
GingerNutsack: @Irkanu Take responsibility and always be learning.
bergsdal: I just corrected my statment from blue to light blue which is this mans favorite color
bergsdal: it just how it draws his attention that gets to thim
Irkanu: @GingerNutsack Yeah, I absorb everything I can.
shepard_commander62: shepard_commander62 subscribed with Twitch Prime.
mikey9988: A real question - what's your favorite bottled tea brand?
shepard_commander62: hi subbed
bergsdal: I can hear your breath godamn dude
Irkanu: That's good - be honest.
bergsdal: I like it tho
Irkanu: Yeah, we get that from advisors a lot. MORE ENGINEERS, etc.
Irkanu: So true..
bergsdal: I like when you watch the camera, it feels like we are having eye contact lulwut
Gtxgaming23: its like saying you want someone that is pregnant already?
gaasedelen: like r13 vs r13d
markvlk: What’s the first 2 what of your IP?
IndoPridePinoy: that's basic
markvlk: Oh, octets
Irkanu: @georgehotz Thank you so much, super helpful. I appreciate it.
GingerNutsack: 127.0
IndoPridePinoy: in decimal or hexa?
ovk999: 94.176
yoshimoto555: 192.168
lightofhel1: 192.168
GingerNutsack: 0.0
bergsdal: Yea, it's true. Not knowing anything about the occupation and just knowing about their line of study and not anything beyond
luhartt: 255.255
dragan2271: hello my bro
markvlk: RFC1918 bruh
Irkanu: Did you have any other advisors that were trying to guide your product? Or did you have full product control?
bergsdal: yea, some freeze frames on ya camera
Masboy_: @Irkanu so basically u need to hire people who really know the shits
r1c1c: 127.0.0.0 is local
ovk999: ipv6 ips
ovk999: ^^
bergsdal: Anyone writes their full ip is genius
bergsdal: btw
Gtxgaming23: i found everyone's ip address in this room. and its 192.168.0.1
Harm133: ::1
dragan2271: what proogram to learn first
luhartt: 0.0.0.0
bergsdal: MY IP ADRESS
mikey9988: Jebaited
bergsdal: GIVE IT BACK
i_nihil_i: D:
bergsdal: OH NO
ovk999: thats a private ip @Gtxgaming23 :(
IndoPridePinoy: i haven't heard somebody asks for octet. it's usually refer as network portion and host portion
IndoPridePinoy: at least in networking field
Masboy_: lol
markvlk: Playing outside
IndoPridePinoy: 8
VoidSpyke_: 8
luhartt: 8
markvlk: Or they have a Comcast router that uses 10.0
lightofhel1: 9
Masboy_: they playin fortnite all day i guess
lightofhel1: Keepo
bergsdal: 8
Harm133: 32
mikey9988: 4
yoshimoto555: 4
alienware997: In the past 6 now 8/9
bergsdal: Damn behind
joker2k999: damn i missed the rant?
markvlk: how many nibbles in a byte
luhartt: 4
ovk999: doesnt it depend on the machine? or is it usually 4?
joker2k999: just got back
gerntt: 32
Harm133: Kappa
Gtxgaming23: no not the same thing
lightofhel1: no
markvlk: no
alienware997: Mop
GingerNutsack: If someone asks hexadecimal or decimal they're probably implying IPv6.
luhartt: off by one
luhartt: no nvm
bergsdal: It's quiz time
luhartt: lol
markvlk: I forget C so idk
billyx3: null terminated?
markvlk: New line?
lightofhel1: n
billyx3:  
lightofhel1:  *
Harm133: none of us are hired monkaS
bergsdal: STOOOPID
bergsdal: CMON USE YA HEAD
markvlk: too much python
bergsdal: Let that big brain have one more round the clock
yoshimoto555: malloc isn't a syscall
mikey9988: assembly monkaS
yoshimoto555: mmap yo
bergsdal: Is that like a node?
Gtxgaming23: malloc is used to allocate a block of memory on the heap.
luhartt: sbrk
bergsdal: Is it like a computer thingie?
GingerNutsack: munmap?
bergsdal: Big up yosh
i_nihil_i: com truise already fired me PepeHands
bergsdal: Yea, I haven't gotten an call back fucking shot me
bergsdal: George called me and laughed in my face
bergsdal: that was mine interview
bergsdal: my*
markvlk: Space then #
markvlk: man thing 2
kougithings: man 2 thing
markvlk: no no no to get man page 2 you have to do a space then the 2
leond53: i wish i had all this knowledge :/
luhartt: LOL
bergsdal: You practise
bergsdal: Little worm
bergsdal: And you will grow and beccome big and btfl
Blobiciously: yeah don't wish
markvlk: man sbrk 2
BoxDirty: the understanding in depth just shows their intrest past facerolling some keys
leond53: I am working on it, and im loving it
bergsdal: good dogi
bergsdal: this is the future!!!1
luhartt: the more you know
bergsdal: hahaha pretty fucking awesome if you ask me
Knarez: gotta
Knarez: man man Kappa
bergsdal: loving this shiet
bergsdal: I was about to write this essay but fk that
bergsdal: Boring
SlinkyDF: Have no fucking clue what's going on but the fast typing intrigues me :)
Harm133: now we all know ints are 32 bits Kappa
GingerNutsack: What are your go-to interview questions?
GingerNutsack: And how many people live in your house?
bergsdal: What is your thoughts about A.I and not making the A.I self-consciousness to combat that the a.i doesn't get self knowledgeable
bergsdal: Bcs I am thinking of that you can use A.I as an tool for simulations to physics, chemicals to make it easier to use energy more efficient
gerntt: Did you teach yourself how to code if so how
Gtxgaming23: @bergsdal george worked for a company that dealt with AI.
bergsdal: or create more energy for consuming parts
bergsdal: @Gtxgaming23 Yea, that's why i thought to ask
Gtxgaming23: Vicarious.com hired Hotz to develop AI algorithms where he worked for 7 months
Gtxgaming23: that's from wikipedia
leond53: oh yeahh, hows the self driving cars going.
bergsdal: With help from sensors tho
bergsdal: but yea
bergsdal: I think ppl should calm their panties tiny bit with calling cars "A.I" and bla bla
gaasedelen: Soon
Irkanu: If people who are even worth hiring are already secured, then how do you find those key employees? I'm guessing you didn't headhunt them?
IFBBPRO_CAMEL_JOCKEY: Everyone calmdown and KFC & watermelon TriHard
Gtxgaming23: @Irkanu you know someone is smart enough to be hired during an interview... simple and subtle coding and how they code will determine if they are good fit for your company
Irkanu: That's actually the only way I've gotten to where I am. I keep getting sniped, but I'm not sure where to look for some of my backend needs right now - I just don't have the time to be deep in the code as much as I'd like to anymore.
bergsdal: Pretty much what gtx is saying you will know when someone is good at their shit
Irkanu: Yes, lmao.
yoshimoto555: are you for real about someone rewriting qira?
bergsdal: especially with it related work
gaasedelen: Soon
lightofhel1: hmmm
bergsdal: IT work is good for spergs and a lot of neurotypicals are like "oh no so hard" and you will find these motherfuckers that do not know anything
bergsdal: Those are the majority but you will find that sperg gold nugget that knows everything
SpaceGhost8: async await is soooo nice
bergsdal: Or that guy with some sperg traits and is mad good at IT
IFBBPRO_CAMEL_JOCKEY: Programming is for the people who hate real life
Gtxgaming23: @SpaceGhost8 yes it is.. i use it in c# all the time
bergsdal: @IFBBPRO_CAMEL_JOCKEY Yea spergs that hate their lifes bcs neurotypicals are fucking retarded lmao
Irkanu: LOL
jjpetsche: what are some sites you go to for reading?
Knarez: what's the most readable and reasonably sized projects youve seen
r1c1c: programming is for innovators
Gtxgaming23: programming is for people that want to change life.. you cant have life without programming
TheTallpants: did you like humping the bush https://www.instagram.com/p/BUnlHVqAkGo/
Knarez: the weed Kappa
Gtxgaming23: Programming is like having an extra arm or leg.. being to develop what you want to live life freely.
Knarez: yeah, something about golang
VoidSpyke_: what about es6
SpaceGhost8: LUL
Irkanu: LOL
Irkanu: java ass shit
r1c1c: es6 is javascript
Gtxgaming23: C# is the best one for me.. I am very happy with it
Luki512: Hello everybody
Protoxus: Vanilla javascript is best lang, #ChangeMyMind MingLee
WASDTeam: so
SlinkyDF: Does George still work for comma? :)
alienware997: When have you played a ctf the last time?
WASDTeam: st ftw
WASDTeam: when u become dan bilzerian? jk, eric weinstein also wants to hack the sim
bergsdal: joke
evandash16: what are you doing?
bergsdal: hacking the sim will be done trough a.i pretty mucch
tunacan_man: vscode window isn't legible on stream
bergsdal: only thing that can exced himan monkey brain
bergsdal: human
bergsdal: and is created by man at the same time
MonkaSupreme: mylBbrain
WASDTeam: if the "creativity"meant to do so requires ai...
bergsdal: yup
WASDTeam: any progress on our church, can we pay 10% of our income to the "greater good" LOL
bergsdal: Yea dogi. Where we are heading do not worry about monetary values
WASDTeam: djee.. im as drunk as hell.. what are we tryin to accomplish here?
bergsdal: take over the whole world
bergsdal: trough a.i
WASDTeam: what about fonts?
bergsdal: fk that
WASDTeam: lol so our manuscript font doesnt matter
bergsdal: If A.I can develop to that point of where humans can controll an unit that just has the intellectuell ability that runs calculationsfor us
matteyeux: Wow I thought qira was an abandoned project since a while
WASDTeam: btw, pathfinder ftw
JonThomasK: what up mr. hotz
fwef64: I thought you switched to Emacs
bergsdal: Okay, manuscrip can be in new times roman
bergsdal: thank me later
WASDTeam: djee.. imma go full screen to check wat hotz' been up to
bergsdal: hurry up
pimmie14: sup george, whats the project?
JonThomasK: ******
JonThomasK: Kappa
WASDTeam: im kn it already
tunacan_man: PurpleStar
JonThomasK: what am i suppose to do
JonThomasK: follow?
Irkanu: star.png
SpaceGhost8: instagram in 2019 DansGame
WASDTeam: hotz, where is DA TCHARX
yoshimoto555: lol how's the cat flippin business going?
WASDTeam: btw, font glyphs?
alienware997: Short Question: how good written is the tesla-code?
brisingr1031: @georgehotz what keyboard do you use?
JonThomasK: FcFontSetDeserialize
WASDTeam: from machine code, its hard to tell..
Sargsyann: what is George working on ?
Quad___lol: VisualStudioCode is the answer
WASDTeam: @sargsyann nobody knows.. currently, fine tuning code tooling.. lol
Sargsyann: lol
alienware997: @wasdteam thats clear but there is probably somebody out there who decompiled it?
WASDTeam: nah, ST is c  , VS code is JS VM.. vim ftw
WASDTeam: but decompiled it to the lang structure level? thats hard..
matejsninja: vs code is good but last Days i have strange perf problems
fwef64: vim codebase must be literally the worst codebase ever created though
Irkanu: missed comma
Irkanu: @georgehotz I think you missed a comma in your json
WASDTeam: @fwef64 cant doubt on that
Irkanu: aight im off to bed
JonThomasK: typical
Irkanu: thanks for the honest feedback
SpaceGhost8: no, what is the barbarism
brisingr1031: anyone know what keyboard he uses
JonThomasK: can you belive they dont indent after an if statement
Irkanu: time to pass this chess game off to someone else
fwef64: @brisingr1031 I think it's HHK
brisingr1031: @fwef64 that board is mad expensive lol
WASDTeam: what time.. more or less?
JonThomasK: i dont use social media. im weird
Kultiviert: are you rich already?
joker2k999: Thanks for your streams
WASDTeam: we'll be on the church LOL
jotye: I gottchu
r1c1c: ist harder than jailbreaking iphone?
fwef64: @georgehotz don't be lazy, stream now
SpaceGhost8: social media is for boomers nathanBoomer
Jiggletoes: eat ass brother
JonThomasK: assembly Kreygasm
SKPTCL: Have you spent time in Russia? How did you like it?
SKPTCL: SKPTCL subscribed with Twitch Prime.
JonThomasK: https://github.com/behdad/fontconfig/blob/7ad010e80bdf8e41303e322882ece908f5e04c74/src/fcfs.c#L127
JonThomasK: deserialize
StupidGladiator: hello
StupidGladiator: is that a ram visualizer?
KannaKim: oh damn
alienware997: Which good alternativs are there beside qira?
KannaKim: oh is it that legendary timeless debugger?
StupidGladiator: @georgehotz how is the car project going?
JonThomasK: src/fcfs.c :: FcFontSetDeserialize @georgehotz
KannaKim: damn it it looks fun
bergsdal: echo
bergsdal: Is anyone out there
bergsdal: Am I all alone?!?!
Mumie1337: where do u guys get ur knowledge from. Like advanced linux kernel, u google it or have u a nice site.
bergsdal: It's called the brain dummy
sayakoo1234: HeyGuys
JonThomasK: i never new you do rap
Protoxus: Do you also get your KNAWLADG from Tai Lopez? jgrTARD
bergsdal: Share it with 500 of your friends
Kultiviert: what happened to the jet ski?
bergsdal: And if that friend shares it with 500 of their friends. Boy, then we got an party on our hands
matteyeux: what's up wtih Tesla hacking ?
bergsdal: Soon
brtk_9: What is on your head?
JonThomasK: tesla is running a ponzi scheme anyway.. no need to hack them
bergsdal: George just said "ha! Spaghetti code" And laughed his ass off
Mumie1337: Mumie1337 subscribed at Tier 1.
bergsdal: When he saw teslas code
Mumie1337: done :)!
JonThomasK: FC Config.. goto bail
bergsdal: Have you tried concerta George?
bergsdal: Or cocain
sayakoo1234: PixelBob PixelBob PixelBob PixelBob
bergsdal: I think doing cocain can be good for ones production. Like there gotta be a reason why everyone did it in the beginning of 1900
bergsdal: Or amphetamine
DaleyGames: cheer99
bergsdal: So many mathematicians did cocain or meth for production so
etherstakebot: @bergsdal are you on one of those now
bergsdal: Na, I wish tho
bergsdal: I ain't got shit to do so no need
bergsdal: Random thought
jellyjar: oh shit I actually caught you live for once...
JonThomasK: how do you not have 5,000 viewers @georgehotz
bergsdal: Bcs your average guy doesn't like watching dude code
bergsdal: Some dude code
geobitz: what is this exactly?
JonThomasK: its league of legends
bergsdal: It's your mother if you imagine hard enuf
bergsdal: Until you start seeing colours
JonThomasK: you must free twice before bed
bergsdal: Goodnight Zuckerman
toolegit2quit_: No it’s not bedtime
toolegit2quit_: No such thing as time
Xaotic: heyyyyyyyy
Mumie1337: ment to be a normal question, but here you go, some support :)!
sayakoo1234: Kreygasm Kreygasm Kreygasm Kreygasm
stale2000: PogChamp
아마소울인서울: hi
montecarlo: is he dead
JonThomasK: he dead
JonThomasK: give him some milk
bergsdal: What's wrong George
montecarlo: camera buffers so much zZZZ
thuganalyst: My whip push-to-start I think I lost my keys under the seat
아마소울인서울: can someone explain what this code will ultimately do?
thuganalyst: Bruh u look tired AF
montecarlo: @아마소울인서울 in title he is messing around w/ fontconfig in the CVE exploit
bergsdal: >>>>>> Be me >>>>>> Watching rainmans stream bcs cool >>>>>> Legit think I can hack >>>>>> Be retarded
montecarlo: me_irl
SKPTCL: what time tomorrow?
alienware997: I smell Tesla...has that something to do with Tesla?
bergsdal: >>>>>>>> Be me >>>>>>>> Legit think that I am an hacker bcs watches rainman stream >>>>>>>> be retarded
JonThomasK: allocate a, free, allocate b, free a.. boom
Bombapil0t: ai ai, boss is here
bergsdal: rainman*
bergsdal: Actually shit btw that you can't phrase words in a row
bergsdal: Twitch is so shit
bergsdal: A
bergsdal: A A A A A
JonThomasK: javascript..yuck wtf
NMODE: ko1ayPepeV ko1ayPepeV ko1ayPepeV
PhillipWei: HeyGuys
bergsdal: Why the hell is this place dead? And btw, I will sub if you stream more often no joke
bergsdal: When do you stream?
NMODE: Jebaited
Bombapil0t: instead of subbing, follow him on instagram.
thuganalyst: It's dead but was pretty alive couple hours ago
NMODE: sub and mb he will do stream more often
bergsdal: Your camera is hella big as well
bergsdal: Taking the whole screen
JonThomasK: night mr. hotz
thuganalyst: cya
jellyjar: bye
Bombapil0t: thanks streaming
NMODE: bb
thuganalyst: thanks for the stream brooo
r1c1c: bb
r1c1c: thanks
r1c1c: followed
Mumie1337: done!
Protoxus: Goodnight jgrHI
emretaylanduman: Poooound
JonThomasK: yeah but he got shot
Aocuser: :thumbsup:
NMODE: already
thuganalyst: I have dreams
Markus_47: can this be re-watched?
bergsdal: Godamn, starting to lag
Aocuser: THank you for your stream!
sayakoo1234: VoHiYo VoHiYo VoHiYo
JonThomasK: Hotz has a dream
bergsdal: Sigmund freud? yes, I am gonna read his book lol
Bombapil0t: :D
miklax: you are in sim, you dont need instangram
NMODE: ko1ayPepeV
bergsdal: Why u go mainstream
JonThomasK: 5,000 Pog
Bombapil0t: push push
um
hello
hello H there we go
this just got to I got to set something
up quickly for us but we got an epic
stream plan today we are going to dive
into this new IOS Jailbreak that just
came up you know you know guys you know
I don't do this anymore but this is mad
exciting uh you know congrats to to a
Max let me make sure I yeah I stylized
his name correctly you know I cared
about that
so got to make
sure let's
go
okay so I have here it's hard to see but
I have here an iPhone 7 and hopefully by
the end of the stream we're going to pwn
it um we are playing this on hard mode
cuz we're on Windows and I don't know if
any of the shit's been tested on Windows
but um let's see what we got
here so you know I'll bring up my Ubuntu
windows subsystem so the way I do this
is I just installed this and I do
service SSH
start and then I can just putty in
[Music]
[Music]
here
excellent um cool that'll be ready when
we need
it
um
yeah so does lsusb work no it doesn't
well that
sucks uh I have notebooks on here
too
um first let's see what's going on in
chat
good morning everybody good morning wow
I think we're going to get a lot of
people today um it's unpatchable because
it's a boot ROM
exploit so apparently what happened and
axx describes it here there was
a let me uh let me set the default size
to a bit higher so you guys can
see should be good I already up my
screen resolution so wouldn't lag as
much um good morning good morning all
right so look look guys I was out
partying last night real talk I'll show
you guys where I was you know on let me
find it look at this I was a twitchcon
cuz I'm a real
streamer um but I know there's not a lot
of information about this yet so we're
going to dive in and we're going to get
some
information
rename just call it
IUN let's make a new notebook
here um we'll do it here from a
notebook no module named USB can you
call PIP from a
notebook oh why is Windows so bad about
this so this is the
exploit as the Shell
Code
um Pi USB
1.0 installing Pi USB in
Windows so let's I
mean is there
get that's kind of cute we'll just use
this as like a shell
I don't know what that
means is one good or is one
bad
[Music]
H okay there's nothing there oh you have
to call does this work
oh that's really
cool um
[Music]
so wow Windows doesn't even search like
this is terrible all right sorry I'm you
know you guys know I'm a Windows Noob
I'm new to Windows we're playing on hard
mode uh documents iPhone okay so I want
to actually I'm just do get bash here
there we
[Music]
go is there python
here um I should have python on this
system now because this is actually
running in the windows right
um so the one that we want to run here
is Checkmate let's bring up our trusty
vs
code not playing with mini key value
anymore close work
no yes
code ah we we don't talk about
self-driving cars on this channel bad
enough we're talking about iPhone stuff
today but this is very exciting and it's
going to take us a while to uh to kind
of get up to speed here let's open
folder
documents iPhone S like
folder okay so this is the Checkmate
exploit let's just web touch
touch
nitpy
[Music]
here we
go do I have like no module named USB so
we're going to have to like pip install
USB pip doesn't work is there a pip here
too H pip install
USB P
USB
we can talk about jailbreaking the
iPhone but only
today USB perfect uh so now we've
touched on n.p so I should be able to
say import iPhone
dfu Checkmate uh from import
exploit missing parentheses and call to
print oh
no no it's not Python 3
compatible oh oh man I've been doing
[Music]
this who writes code that's not Python 3
[Music]
compatible oh I don't know this we might
have a bad time doing
this all right we're going to Port it to
Python 3 cuz why
not we can make a branch and we can uh
uh what do I want I want Auto reload
Auto
reload
umon notebook want to
reload uh I don't know there's a lot of
people still on python 2 we shouldn't
shame them too
much uh uh kernel restart restart but
I'm very excited about this exploit our
goal is to dump the boot ROM on this
iPhone 7 here so let's just download
iTunes while we are
here uh cuz we're going to have to reset
this iPhone I don't care about what's on
it all right let's go for older video
cards do I have an older video card I
don't know
whatever uh we're still missing
compatibility and calls to print there's
actually a great tool called 2 to three
but I think this code is short enough
that we can just read it but this
probably like decode hexes and stuff in
here it is actually more annoying to
write
um to write like hackery code in pyone
[Music]
3 why oh
close that parthy all
right is there a nice way to see oh I
guess actually that's the get diff right
here that's what those lines are that's
pretty nice all right cool let's go no
module named to dfu well dfu is
here um guess we can say OS do no
CIS uh CIS do path.
append
um I don't think I can just do that oh
here we go okay so we're going to have
to fix the prints up here know the print
thing is so annoying that
that what do those numbers
[Music]
mean one print there that code looks
pretty
reasonable lib USB finder a
net um so I mean if we were just trying
to do this the fastest way like all
right I should get you know a yubu
machine and just do it the easy way but
remember that as usual on these streams
we are here to learn so we're learning
and there's also a terrible tragedy
which we're going to have to address in
a minute
for all you
streamers which is that we're out of tea
and we don't have any tea so I don't
know if I'm going to drink tea because
there's no T so we're going to have to
order T all right so once we we got to
order eggs too let's install
iTunes go go go stupid
windows no module named C string I
[Music]
um yeah they call it something else in
Python 3 didn't
they it's called string iio
from IO import string
I stir object has no decode that's
great yeah so these decode hex is
are see this is cool we can
see oh wow it's patching lib
USB what is this
doing I mean this is useless cuz it's
all on Mac
anyway
how many of these do I have to change
not too
[Music]
many we're going to we're by the time
we're done we'll Fork it on my GitHub
and we'll do a poll request to make it
work in Python 3 because what fun would
this be if we weren't playing on hard
mode all right so I don't really
understand what this patch to lib USB is
doing
but we're going to dive into the exploit
in a minute let me just approve this
administrator prompt on my windows
because iTunes needs it all right once
we have iTunes we're just going to
restore this
iPhone latest version should be fine
because it is a boot ROM XO and it's
unpatchable uh oops okay it Imports now
what happens if I try to run it
no back end
available
um USB core. find find all equals true
let's just try
that back end available okay we're going
to have to figure out how to install
back
end uh yeah Lio back door T of great
great back doors all right let's see
here let's open iTunes iTunes we were
just talking last night about how iTunes
is some of the crappiest software ever
made all right so we got an iPhone here
we're just going to put it in dfu mode
for those that don't know dfu mode just
hold down these
buttons I believe I mean I hope it's
still the same we probably have to have
connected to USB as
well this will be embarrassing if I
can't do
[Music]
this
I think it's these
buttons or don't do
anything give it a little bit longer
it's still saying enter passcard to use
Siri it's volume down and power
okay and do I have to let go of volume
down that didn't boot in D
mode I I thought it was the home button
but actually it's probably not the home
button anymore because the home button
is not a real
button oh a new version of iTunes is
available great let's update the iTunes
we just
installed
um okay so we have iTunes here detected
in recovery mode so I by recovery mode
they mean dfu
mode uh we don't need to update iTunes
right
now let's see uh do I agree no thanks
iPhone here we go iPhone recovery mode
restore
iPhone software oh I got to update oh
make sure I have the latest version of
iTunes oh thank you very much
okay uh download
iTunes it's a an iPhone 7 this is an
iPhone 7 uh but first we got to order
some tea so let's order some tea uh
because that's super important CU
without tea you know thinking is hard
but you have tea and thinking becomes
easier and that's
good
um buy it again in beverages no no no no
no I don't just want one tea I want a
big thing of tea tea and I'm only
shopping in the Whole Food store right
so we're going to get some Whole Foods
delivery here as soon as we possibly
can we need eggs we don't need
produce although an avocado is always
nice we we'll get an avocado but it's
not going to be ripe you
know be an unripe
avocado what sort of tea we're getting
delicious green
tea I I I'll show you you guys on the
stream in a minute if we find it oh yeah
this oh good I already have four in my
cart Tea unsweetened tea pure liter so
no we don't need any hardware should be
pure software blackberries blueberries
Tomatoes avocado let's just add let's
just add some eggs to this and then I
think we're good to
go H do I want large eggs or for the
same price extra large eggs never Legend
thank you for subscribing everybody it's
your subscriptions that keep this
channel alive it is my new dream as of
last night to become a twitch partner as
you can see right now I'm only a twitch
affiliate um I like it we have about 500
concurrence on this stream that's pretty
good we're doing pretty well as a twitch
streamer it is my dream it's going to be
a long stream today cuz we're going slow
and that's what we're doing today here
on Saturday all right should I pay $4.99
for guaranteed 10 to 11 or free for 10
to
12 I'm a sucker for free guys I love
free yeah no I'm at twitchcon we're
going to twitchcon today but we're doing
the stream for you uh cuz I wanted to
look into
this exploit all right we got four T's
coming that's good it's going to be here
today please bring up to my apartment oh
tip $5 I don't think we tip $5 we'll tip
$1 and if they bring it to my apartment
we'll up the tip that's right
okay orders
placed that's good we're giving up on
the 1 million Instagram followers cuz
Instagram never gave me a check mark
Instagram never gave me a check mark and
because they never gave me a check mark
fuck Instagram we're going to focus on
Twitch no it's not really why it's cuz I
tried and failed it's okay I won't lie
to you guys but really follow me on
Instagram at George Hots I don't know I
don't know if I'm posting Instagram
anymore Instagram got kind of boring my
friend said I was mean on
Instagram and then I thought about it
and I kind of am mean because you
know the average uh the average IQ of
Instagram isn't
uh um that high so you know that's just
what Instagram is but I wanted to be
famous really I want to just have a blue
check mark oh what did I get oh my Prime
now shoper started working on my order
really I just want to have a blue check
mark So when I slide into the DMs I got
blue check mark you know but I don't get
to BL check marks fuck Instagram that's
right fuck Instagram you have to say it
on Twitch that's right cuz we love
twitch it's good that's their
competitor if they won't Trash Talk
their competitors I'll do it for them uh
all
right all right we got to fix this no
backend available
problem um oh okay okay I must restore
this iPhone oh you want to take the
iTunes quick tour guys no we don't
restore iPhone
but I have the latest version of
iunes H3 coup thank you thank you for
subscribing it's your subscri did iTunes
just crash I don't know no the phone's
not the backend so we just need to get
like lib USB
Windows here we go it's like this kind
of
crap
um
H hopefully we don't have to like send
resets or
anything here we
go this looks
simple let's try
this
I used this before I used this with
panda do we want to check our
application updates online more
information yeah this is so complicated
sure why not
okay
um install wood Sid
driver oh oh installing driver oh the
Herman Millow this is a great chair this
is a Herman Miller sale chair uh I don't
know why I'm Shilling for them because I
paid full price for this chair do you
also need Coca don't do cocaine
cocaine's a shitty drug
kids uh no cocaine really sucks you know
like you ever you you you want to never
do Coke again like just walk into a room
people have been doing coke all night
and you're
like these people are fucking assholes
and
then you know you think that you don't
act like that oh oh I thought it said
mediocre brand oh it's a medicine brand
all
right I am so humble am I humble oh
zadic oh it's named after some voler
shit but but Windows is unusable how do
I get back to
that in
apps
no um oh I think that's CU it doesn't
install
download
zadig
okay when
USB list all devices oh here we go
perfect it's not a
whisted all right we have a driver so
let's see do we have a back end now no
back end available no that didn't fix
the back end okay well first we got to
restore this iPhone let me re agree the
iTunes license agreement there's some
chance we're going to have to switch
computers to Mac if we can't make
windows work
work restore an
update fixes a security issue for third
party keyboard apps we don't care about
that all right let's
go so this is an iPhone 7 and for those
of you just joining the stream our goal
is to get the brand new Checkmate
bootrom exploit running on it and we're
going to see what's going on what do we
say about talking about drugs
man
do I do LSD micro doing what what do you
think I am what do you think I live in
Silicon Valley you think I live in
Silicon Valley and I'm like man micro
doing is really how I can optimize my
Peak
creativity they did a study I went on
G's g.net and even though he said LSD
micros didn't work for him he doesn't
understand that we have to use Bas rule
to take into account all these things
that are special about me and you know
what I'm saying all right good all right
all right no backend available um why
don't we just Google the error
windows Pi USB no backend available
right
[Music]
perfect oh I need
this um USB backend import lib
usb1 Beal Li usb1 module object is not
callable I don't think that's
[Music]
right pry
none great how do you install Li
USB did you install lib USB through
zadig oh good my iPhone's restored oh
that's perfect good oh 587 oh this is
exciting
okay uh download the latest Windows
binary copy it into system 32 oh all I
did on a Mac was something easy oh
download hos oh my God this is
terrible wow how is Source Forge still
used for anything here I used zadig can
we install
win USB lib USB
win32 on some razor blade shit all right
let's wait till this restores and then
we'll try to install lib USB for that
and then we'll see what zadic does so
that sound like a plan
guys um by the way I don't know if axim
x I don't know if you tried to approach
apple with this first but um well I
guess cuz it was already packed hatched
but still I really appreciate you're
making this
public uh it's very cool
um so let's see what's going on why am I
using Jupiter notebooks I like Jupiter
notebooks you don't like jupyter
notebooks well I think that's your
problem not a Jupiter notebook's problem
let's see how my tea is going where's my
tea at ah being prepared all right I got
a yeah you guys can see kind of where I
am that's this is good now even
non-state actors can use it yeah this
one's probably been used by governments
for a
while maybe this is how
um cellulite or whatever those people
are broke into that iPhone of the
terrorist or something where's the
Maverick merch people hacking Jupiter
now that's right Scientific
Python uh okay wait we got to wait for
this iPhone software to restore it's
restoring
now Jupiter is a tool made by CIA agents
well I'm not so sure about
that what do you do for improving your
cognitive ability no see no that's no no
subscribe and I'll tell
you um no more wasted
time what's what's that from that's from
some
play uh is that from if then might be
from if
that I'm Miss Barry thank you for
subscribing this is going to be the
stream that we're going to make twitch
partner not really we got to do this for
like three months but twitch games real
yo guys I'm a twitch con yo check it out
all right um let's read the exploit
while we wait and let's see what's going
on
here something hard to read about
this
usba control
[Music]
transfer li usb1 no error control
transfer what is
this
I mean this is the same trick that's
been used in like black R and
stuff okay let's see if we can find more
information anywhere so this is a it's a
use after free that was patched in
iboot um during iOS
betas
it's just
news Okay so
config do overwrite let's see so I guess
this config is per device
somewhere here we
go um I believe I'm on this one
here
looks like it's just overwriting with
like
addresses not Gadget so that's some
address in the boot ROM I guess oh wow
these are all 64-bit arms so
[Music]
cool um yeah I'm trying out vs code a
lot of people use
it dfu Loop
buttons and they have all these comments
about how long it takes that's what
people are talking about in the
comments um still restoring it's taking
forever all
right and then it's pwned after this all
right so let's read the
payload
uh so it sends the payload 800 at a
time see where payload comes
[Music]
from I don't know what that's
doing USB re
weak where is this defined here we
go
oh my order's ready to go perfect oh I
got it right here on my Apple
watch um VSS codee's laggy yeah we hate
lag see how my update's
going
um we also we have Ida ready to go so
when it's time we're going to just dive
into
this you I a live USB
finder why is this a thing is this is
this custom
code only part
of like I'm a little concerned about
what this patch
does cuz we're not going to have it here
on
Windows all right let's read the payload
so the payload is the code here we go
checkm Norm 64 n that's probably more
readable hack Do Not Free this USB
request find zero Loop copy
Loop oh the marketplace has extensions
all right let's
say
um arm
support that'd be
nice huh so readable all right
perfect it didn't support RM 64 that's
why the X's didn't
highlight uh
okay so it's putting in fake USB
descriptors so yeah this just looks like
it's straight up Cod exact like this
code runs right away what's the actual
trigger for
it USB
reset oh it's a USB reset okay so we got
to make sure we install the version
that's capable of doing
that um wow okay this takes
forever no backend available well we're
going to fix that as soon as this is
[Music]
done let's go on the iPhone Wiki and
see
I guess are the keys there to
decrypt this has grown so
much
um used to be all the keys on
here here we go iPhone 7 so the one that
we installed is this one I
believe just download that should have
tons of space on
here uh there's no keys for it so we're
going to have to get the keys we can
decrypt it and then we can load it up
into
uh oh man it's going to be a long time
that Apple's going to continue to
support this crap that means decryptions
for
everybody showing the reality of hacking
that's what we're doing here all right
so a cool thing about ipsu files is ipsu
files are actually just zip files unless
of course Apple changed it which is
possible Windows is unusable
garbage
now some might ask why we're on Windows
and we're on Windows because we like to
make our life difficult because without
a difficult life there's no point in
living CU otherwise you can just you
know wirehead
[Music]
yourself okay so we're just going to
extract the zip file right
here what is in a modern ipsu file let's
find
out yes if you like your like yes Arch
Arch is another way to make your life
difficult
um yeah I know we actually honestly Arch
would probably be easier if if this
doesn't work if we can't get this to
work we're going to install a VM and
we're going to get the USB stuff working
at a VM by the way guys I'm at twitchcon
woo thank you for my 645 concurrent
viewers I appreciate you all being here
with me on this great journey of iOS
jailbreaking never thought I'd be doing
this while it's been a long
time um all right
so we have a bunch of dim
files no don't be stupid it's pronounced
DMG um here's the firmware wow so much
has changed I don't know what all this
stuff is like where's
iboot BB FW baseband
firmwares okay here's well here's ibck
and
IAS God I at some point I knew what
these things were um oh activation
lock H I want to get rid of this
[Music]
[Music]
uh
what I don't even
[Music]
know
great uh do I care I don't think I
care we don't care about the activation
lock we're done thank you for restoring
my
iPhone uh we don't actually need to do
any of this all right at the hello
screen on the
iPhone you see my password through the
mirror behind me that be pretty
impressive
uh 667 viewers oh so we get to 666 I see
what y'all saying all right so let's
reset this iPhone here let's go back in
dfu mode we learned that it's these
buttons and then we're going to go into
zadic we're going to install the USB
[Music]
software
okay load load load load load maybe that
button hold on
that no no no that didn't
work all right we're going to get this
iPhone we going to dfu mode and for
those that don't know what dfu mode
is it's a mode that accesses the boot
ROM of the
iPhone not the uh wow I can get a d10 or
a D20 all right that was pretty
me all right let's um why isn't this
working I don't know how to get into
bootom mode dfu mode dfu mode is in the
boot ROM which means it's in the ROM of
the Chip and apple can't update it so um
you know if you're Apple get
fucked uh now we love Apple Apple's
great Apple's made so many great things
for me all right good we're in dfu mode
uh let's just exit out of stupid iTunes
here that actually might have already
gotten it still says DF mode Let's just
resan
okay I think we can't use wi USB let's
install this
one all right I clicked replace driver
all right installing driver oh this is
good driver was installed successfully
okay so now we have lib USB 0 which I
hope is the same thing as lib USB 1 we
have a back end oh yeah we got a back
end all right let's go
exploit
okay this is a classic uh Python 3
problem let's just go fix that
up
uh
431g and this is because these are bytes
now not to be confused with
strengths but like we're really playing
on hard mode here oh yeah
trampoline um cuz we're also playing
in
trampoline yeah this is a
common uh good but we have a back end
now I think we have the right driver
installed see you see what I'm doing
here you know a lot of hacking is just
like doing shit like that by hand you
know
let's just look for more spell decode
wrong I bet there's no more of
those um cool trampoline we love
trampolines all right let's go required
argument is not integer all right who
knows what that problem is well Python
3 makes you do the double divided by
because it's an integer division not to
be confused with floating Point division
which is very different okay more books
all right well this is cuz the Shell
Code didn't get built so now we're going
to have to figure out how to build the
Shell Code I think the way to do that
probably going to be from here we're in
you bundu here I think this is yuntu cuz
I can have to get all right good we're
new bundu um we just have to build the
shell
code is there a make file here yeah
there's a make file um
SMY uh users George documents iPhone
yeah here we are iPhone dfu
make we don't have arm none
abas
um this
one sorry I'll try to make it bigger let
me see if I can make it
bigger change
settings
window appearance yeah nine point that's
so few Point all right let's go yeah we
go
is that good can you all see better
whistle is okay
um
yeah install SL oh yeah who wants to see
a steam locomotive all right let's
install
SL for those of you who don't know so LS
is list directory and SL is is steam
locomotive so every time you type it you
get to watch a beautiful steam
locomotive go by and you can't control
SE it or anything it's just a good way
to punish people for uh you know typing
LS wrong and that's why nobody should
ever have SL on their computer all right
end of story all right let's go let's go
let's go oh we forgot arm 64 XC run the
fuck I don't have
that
a this is clearly written for Mac people
and I don't have a Mac I do have a Mac
but it's like over in the other
room um well yeah stee locomotive we
really went we really went Ham on that
all right let's go let's go let's go all
right
so uh arm 64 non
Abby is this going to just come up with
no XY run for you want
to no okay
okay all
right
great we're going to have to find
something that can
compile arm 64 B tails you want
to oh here we
go what did we just
install
P sudo have
install B utils arm 64 non
ABY does not
work oh maybe AR
no Linux ganu
works
oh this make file is written exactly how
I used to write make files like
shit yeah we could try app search we'll
see
[Music]
okay so now instead of doing this we'll
try just like
[Music]
that
[Music]
source
[Music]
Dash we are playing on hard mode here
but the thing about hard mode is hard
mode is actually how you learn stuff
about the
world so if we weren't playing on hard
mode we wouldn't learn so much about
this exploit all right great that
doesn't work at
all um junk at the end of the
line first recognized character is
that I don't really
understand comments don't
work
maybe
okay ubu install clang Arch arm
64 I mean they're using the clang
assembler which is
different
okay app cash search AR 64 Let's see we
get
what nothing about
clang cash search
clang
little useless as
well well I mean one thing we can
do I think that's the
gnu let's Google and see what we can
find about this gnu assembler
semicolon
comment oh it has to be an
at
is there some way I can enable this is
there a
flag yeah okay I could de package add
the architecture and then we could use
clang do you want to try
that the other alternative is we just
fleix the
code but I don't know if clang supports
the
at this is menu let's just do
it
[Music]
um no the at's not right
whatever bye-bye comments you are useful
for
[Music]
nothing good they
built
um now we're going to need OB copy so
what OB copy does this should have
created
a it's in b um yeah I created this.o
file
here so we're just going to OB
copy we don't talk about selft driving
cars here it's not an allowed
topic
um
RM
lssl all right
good should we refactor this make file
cuz this is
terrible nobody should write code like
this it's the future
it's the same thing over and over
again uh okay so we're just going to
write I don't really know make file
syntax either and then I find myself
just doing the same
thing great I don't know what any of
that
means why do I have so many
[Music]
cursors you know much of hacking is
really just doing this shit by
hand we could fix it we could do real
refactoring but that's a lot of effort
so what this is doing is building the
Shell
Code I think it's going to build okay I
mean it looks pretty simple it's not
using like really
fanc I don't know why that didn't work
copy click there insert
paste these other ones are probably
going to have stupid comments that don't
match the
syntax make oh no ST be comments that
don't match the syntax okay perfect all
right we don't need any of this crap
anymore and that should actually be
fairly
[Music]
Universal okay good we now have Shell
Code let's go back into here and let's
run
this no such
stuff
why oh because we're not in that
directory
um
os.
shitter iPhone
DF cannot concat string to btes okay
well that's a better
error and that's because in Python 3
they made the extremely stupid decision
to change what strings are are to be
Unicode I don't know okay in some ways
I've grown to appreciate it for a lot of
real
code but it's not good for uh you know
hacking code hacking code
probably yeah by the way python string
concatenation like that is n squar so
you shouldn't do it unless you have to
all right cannot concatenate all right
we have to set whatever data is first
set yeah USB Rock back all cool should
fix that
H this exploit requires a live USB one
back end but another back end is being
used
exiting
great actually don't know if another
back ends being
used I don't know let's just comment
that out and see what
[Music]
happens
[Music]
I don't know what array. array
is what's array.
array Plus
[Music]
data yeah so here this obviously we want
to be a string there's another one
there's a few more like that too
so we want these to be bytes and not
[Music]
uh make sure prepare Shell
Code Yeah it's red as a binary that all
should be
okay
um and over here we're sending a and a
should be like that all right
[Music]
cool non type object has
no okay well that's why you can't
comment that
out oh it might just be using a
different back end let's
see
we have that back end it's just using a
different one I think so that one might
be able to
fix
great all right guys um I've learned
something and I'm not sure how to do it
but
apparently uh I'm just going to take a
quick little break here and apparently
if I take a break I can roll an ad and
make money I learned this yesterday at
twitchcon so let's enjoyably try to use
the twitch interface here and figure out
how to roll an ad I'm going to take a
little break I'll be right back oh
report George hot yeah fuck that guy all
right um where is a way to run an
ad is it because I have ad
block
oh subscribers only chat oh I like
that I wouldn't do that to all of
you um but I do like that we're going to
do that sometime gift a
sub
oh wow I have a tier three subscription
I'm paying myself select dashboard
where's
dashboard Fargo fromi you are on the
stream yeah I'm a professional streamer
if like Lil Dicky was a professional
rapper oh I can make
rooms top
right oh just type add oh yeah let's
go did I just get
trolled I don't know about light mode
dark
mode with a slash all right
app unre recogniz
command
no all well I'm not opening dashboard in
front of you guys CU then you can all
see how much money I
make and I mean I am rich from
be no no no no that added a stream
marker oh this is so
confusing this is the most confusing
thing I've ever used here I am trying to
hack iPhones and making an ad on Twitch
is confusing
type
commercial oh that's why would they do
that I think I spelled commercial wrong
[Music]
commer you won't make money since only
Partners get add share and I'm only an
affiliate
click ah okay we don't want that to show
up click the button right
[Music]
now
no I have ad block which means I don't
get to run
ads oh okay are you all going to behave
I have to be a partner great great great
great so just just just behave I'll be
right back and I'll leave you with way
wait I've learned that if I want to be a
partner we have to care deeply about
making sure we don't uh play infringing
content so this looks like
non-infringing
content is this non-infringing content
all right be right
[Music]
back
[Music]
did you all behave if you didn't behave
you're cut in the
[Music]
Stream hands washed
Bros sour plus you know what you're
pissing me
off time
[Music]
out all right yall behaving wait someone
pm'd me or
something for your memory fund what I
don't even know all
right let's go you know
what let's see where we
are lib USB has no object lib yes we
were doing this um we uncommented the
stuff wait this is a new error I
uncommented that but I'm still getting
an error I don't know let's just
restart um we don't need to add
the that we don't need anymore that we
don't need anymore that can go
there
[Music]
here okay lib USB object has no
attribute
lib uh uh okay well that's cuz it's the
wrong not right let's go back to
zadig we have options
here what's lib
usbk
oh yo LNS X was going to play
twitchcon but he bailed
out let's just try
it too much Xanax yeah that's possible
Bros I don't know I don't think L NX
does drugs but he bitched out man ches
some drugs but Xanax sucks don't do X
Xanax is the shittiest drug
man Tak a Xanax once in my life and I'm
like why the fuck is anybody addicted to
this this is
terrible you know it's really cool you
have all these like thoughts in your
head and there's constant thoughts going
everywhere I mean strike alert why am I
getting a strike am I not allowed to
talk about how Xanax sucks is a
pharmaceutical industry going to come
for
me um
um all those drugs are kind of shitty
valum is better than
Xanax wait who's geohot 333 does some is
someone impersonating me do they need to
get
banned I may be asked to reboot now fuck
that no I'm not rebooting no no no no no
no that's not happening no who's banned
wait I don't even see this who's who's
being who is this I don't even see them
where's goad 666 they're not even
talking oh please jailbreak PlayStation
4 that's right get
banned yeah no no no we're not going to
reboot don't worry the reason driver
installation may take time who wrote
this shit are they're Russians poning my
thing oh too many people today you know
what I have a solution to too many
people I know this solution we're just
going to go here to
chat and we're going to say subscribers
only chat woo let's keep that for a
little bit please subscribe to my
channel if you want to talk you can
subscribe a sreel you're great permy
you're great zero get you're great woo
subscribers only Microsoft offers no
means of checking progress wow look it
insults
Microsoft um yeah I don't know what's
going on here so we can't say how long
it'll take oh that's great okay what is
lib
usbk
lisel thank you for subscribing you can
talk yepa safu you gave money yeah
you're cool yeah you give money you're
cool you want free people you cannot
talk now we'll let you talk in a minute
but now it's subscribers only chat time
there's a 5 minute time out event this
is
terrible all right let's see what
exactly it's doing
that submit transfer yeah it's doing the
cancel I mean look lime rain used to do
this
wait this is just device serial number
is that even a
thing you're not a sub but you can
talk all
right so how is your what this is just
trolling me all right no no no we'll put
chat back to everybody but if there's
trouble oh followers only
chat oh that's
interesting let's go over here so you
guys can see all these cool moderation
things that I have slow
[Music]
mode what's followers only
chat oh this is great
you can only chat if you follow me oh
that's free
even oh I love this I love these
moderation tools thank you twitch all
right aborting in 45 seconds this is
terrible
we could okay yeah why am I not
surprised except it looks like it
actually
succeeded
oh no no no no now I can't move this
anymore I hate
Windows this is so
[Music]
bad
all right we're playing on hard mode
because let me tell you something about
hard mode that is how you learn if
you're not in hard mode you don't
learn that's fine
um that's a different
error no it's not it's the same
error
does say we have lib usbk
now we have Li USB one oh good it works
now I think it is lib USB one but then I
don't know if we don't have lib or
something
h
[Music]
no it's using lib USB zero still as the
back end I know
reinstall I regret clicking
that I regret clicking that this is not
going to going to end well yeah I think
lib usbk is specific for Windows but the
question
is oh that's just the module oh I
see yeah that see that's there but
that's not okay no we don't have Li usb1
yet we need Li USB 1. DLS for Windows is
that a
thing oh I can download it from libusb
dotinfo
we don't want that no go
away see the problem is no no no I'm
done with this I'm done with this I'm
done no no no go away go away that's
right yeah we got to turn a zero to a
one
real
[Music]
quick where did it go where did it go
where did it
go I don't even know
downloads Windows is
unusable
we're playing on hard mode we're playing
on hard mode but what the fun would life
be if we didn't play in hard mode all
right let's list all
[Music]
devices
well at least we know this one works
maybe if we just read the maybe this has
the same
functionality it just uh you know
prototype of lib USB cancel transfer so
let's just see if we have a cancel
transfer for Li
usb0 we're getting sued by
nobody let's see if this is just a
question of rewriting this Which is my
be what it
is cancel async okay I mean this should
actually
work control message Edge reap
aing this is like broken
[Music]
now you see by doing it this way we
learn about what's actually going
on open USB does that have a
lib no it doesn't have a
lib no lib eye back end what's an ey
back
end this is again
broken
don't make me
reboot that's going to be a tragedy if
we have to
reboot well no when USB doesn't work cuz
when USB actually doesn't support reset
there was a note about
that
install driver install whisted
[Music]
driver live USB win
32 oh here we
go um no we don't have seven
zip oh look seven zip it comes in a
seven zip archive we need T where's my T
you know that's what this stream needs
the stream needs T is it here
yet no Windows 10 zip but it can't seven
zip and of
course so zadig looks like it was just
the wrong
choice oh no I don't need to restart no
no no no no I definitely don't need to
do
that what did seven zip not
install seven zip is installed
close still can't install szip for
another app on this
PC
7zip wow Windows is really unusable 7
zip file manager okay drag that
here no I don't want to add to Archive
why would I want to do
that oh wow this is
unusable
this seven zip
extract okay
perfect here we
go um D oh live usb1 okay good good good
we found it we found it we found it now
if only this had a way to install it
read
me
oh my
God this is so
bad yeah you're I feel like a boomer you
know that's how I feel right now boom
are you allowed to make fun of
boomers are boomers people you can't
make fun
of yeah I know right wait who talking
about self-driving cars you time out
that's right we don't talk about that oh
good making fun of Boomers all right all
right good we love making fun of Boomers
all right Boomers love it too they're
too old to do anything about
it
uh lib USB is that here okay oh we have
Li usbk lip USB 2 let's just drag this
one over here
yes oh it moved oh great oh that's
exactly what I wanted okay lib usb1 the
latest version can be downloaded
here is there an INF
file or is it the same back end uh okay
so now let's see if we have no I didn't
find it but maybe because we just have
to
repport restart
go module USB has no back
end
this oh okay a new
problem wait
what okay well this is
better
this looks much
better because at least we're using the
correct lib USB
now put that back
[Music]
in Access
violation
What
oh we always make fun of people who
don't sub to this
channel because they don't make me money
without money there's no Channel and
without Channel there's no money I want
tea and
eggs yo no asking about Sony you're
banned
okay like I don't even know what to do
about
this access violation writing
maybe there's something about
it
h
good we have a lib USB one lib
now lib USB cancel transfer perfect
submit transfer okay that's
good um I don't know I don't think these
errors matter okay device did not enter
pwn dfu mode
so maybe we need to o o o h o my Prime
now will arrive soon oh this is
exciting do you usually not listen to
music yeah I usually don't listen to
[Music]
anything H
okay exploit
failed USB rack leak large
leak
device
config so this is the one we're using
here and large leak is five so I think
that everything's working I think that
this is just
not elon's watching the stream I don't
know
man think that this is all
working
[Music]
no large
leak leak no
leak okay
it would help if I had this boot
ROM I don't have any of the older iOS
devices which have leaked boot
ROMs but we can try to understand what's
going
on temporary workaround is to go back
up wait did you hear that from somewhere
good we can use that
one we're going to get sevens up to work
maybe Ming
GW let's just try
this try again oh it's in use by another
program oh Colonel shut
down try again place the file in
destination all right
beautiful
um don't need this anymore don't need
this konel starting please wait all
right we have a
konel I don't know about
that oh good the bug's fixed thanks bro
you're cool
okay the exploit did fail I don't know
what's TB
do just say exploit failed okay it's not
great maybe I should try rebooting the
device this it does look like we have
everything running now it's possible
that my Python 3 Port had
bugs
alt f4 for Jupiter dark mode I really
don't think it's alt f4 but there
probably is a way to get Jupiter dark
mode how do I get
it it's a race condition try again
okay I thought it was a use after free
was is it
racing
I don't know how I come I used to be so
good at getting these into dfu mode lime
rain had the best thing that told you to
press the
[Music]
buttons okay we
rebooted H
go exploit has failed
no I want exploit has
work
um should I just try it a few more times
let's try it five times
if you claim it's a race
condition actually some neat no it
didn't work there was some neat issues
on the
GitHub oh yeah so we can check
that oh yes it uses a race condition and
I only tested it on my MacBook Pro okay
so there's a raise
condition I can write
code there were issues on here
notice to newbie so I'm a newbie let's
say
uh yeah I mean I have the right uh
thing my I boot's the right
[Music]
version
I know what dfu Loop
is why don't oh it's calling CIS exit
all right let's just remove
that
oh wait was that the door oh I know it's
at the
door yeah
boys yeah boys
a that's right Double
T now we got tea we about to be
unstoppable oh my beautiful balcony
someone's doing something with a sketchy
crane out
there I'm going to turn down the cool
it's all too cold in
here just if you thought this gja Vu was
real we got more
K now I'm going to show you the view
then you can dox me like the way they
dox the
sh I know about that I don't
know ah all
right let's see what we got in here oh
we got
tomato yeah that's I'm going to have a
tomato we got eggs got some
cotos but most importantly we
got
eggs blackberries let's wash
these oh yeah
get a
little it's a little bit of a cooking
stream sorry if you didn't tune in for
cooking we got to figure out why this
race condition is
unreliable unless maybe this whole jail
break is troll maybe
troll I don't think but it could
be you never know what is troll is
this but this te is not
troll oh
yeah all right got a cup of water
here uh
tea no it's not TR all right I don't
know why it's not working
though what is a race
Condition it's like
when
ah
blackberry and
[Music]
tea something like
that
okay okay
so let's see what this is
doing I don't exactly understand what
large leak
is
[Music]
there's five
hole definitely five
hole
it's impressive they made this
work
stall
there's a lot of impressively you know
how did all these get
leaked
there's no stack Trace it's not
exciting stop what do I stop Hammer
[Music]
Time no error control transfer asent
control transfer
okay
[Music]
h
so this is a control transfer that it
sends USB wck leak actually
that's sure it's
right I love I love chewing IC I know
console log right would be so primed to
write
that
[Music]
[Music]
um that's a long serial
number
cuz Instagram sucks and I don't really
want to play Instagram anymore if they
don't want to give me a check mark you
know people are impersonating me on
Instagram it's really terrible platform
I wouldn't use
it I'm over Shilling for them I'm going
to Shi for twitch I'm going to be a
partner on Twitch I'm going to be a
famous twitch
streamer and then I will finally belong
that's wedc
con okay
um see what stall
does send some stupid
[Music]
thing
[Music]
h
let's try the non mingw one like who
knows what the problem
is
no
okay I
mean does anyone who know anything about
this exploit want to join this Channel
and help
there's some documentation somewhere
on well you know what let's go back to
the lime rain
exploit like I made this exploit I
should remember how it works I kind of
do
it's using a
special that's the same
[Music]
crap it is cancelling I mean that's
definitely
working
um there's a chance that like
iTunes is getting to it first or
something I mean I doubt
it all right let's try one more reboot
of this
thing live USB set debug
okay it's not a bad
idea
[Music]
call it probably just work if we did it
on a Mac but then what would we
learn
[Music]
[Music]
h
[Music]
here we
go
doesn't look like anything is
failing it's a little too much
printing that all seems
fine no the race conditions just
failing
oh I hate race conditions I didn't
realize it was a race
condition this is just not really
debuggable
okay so it's a three-stage
exploit actually even four this last
[Music]
one doing leak one seems to take a long
time yeah actual bug is a use after free
okay then what's the race condition
doing maybe use a sleep where do we want
to
sleep it's doing a dfu USB reset I think
that's the
trigger we have to learn more about this
exploit so there was an exploit
previously called Alec 8 and I'm not
sure if it's
related
uh I don't think
so oh you can send me the patch oh yeah
I have Ida yeah yeah yeah if you want to
post that somewhere just anonymize the
idb and uh hang on let me just install
Ida and then that sounds good we can
look and try to see what it is that's
that's
perfect thanks computer makees me mad oh
exploit details oh there's a write up
cool what we're
streaming you can come hang out with the
streamers you got to put clothes
on this bug was also called Moon ah okay
this looks good when USB is starting to
get an image over dfu dfu register
interface to handle all the commands if
you send data to set a
package the interface code no no no only
close on stream twitch is
PG-13 device to re
cner trigger bus reset okay so that's
definitely happening
here yeah I have heard the bug is in IB
boot as
well let me uh let me install
Ida
this is very popular stream we have so
much
people we're doing the iPhone
jailbreak
[Music]
oh people are using gidra oh we can use
gidra oh that's a good point and gidra
is actually
free I mean I am installing an NSA back
door on my computer but me the NSA
already has a back door for
me thank
you I've never used gidra so I'm going
to be a noob at this I'm
sorry
we have Ida as
well yeah we all chew ice yeah you don't
chew ice man ice is
delicious but no all right let's go back
to reading we was being
distracted
um where was
that here yeah here we go okay
exploitation on A8 send hex 40 of random
data to dfu this has to be sent
otherwise you can't exit dfu using USB
reset get dfu into the state where it's
waiting for a USB reset by sending that
stuff see I don't
see it could also be that like my shell
codee's messed up or something
but I think if my shell code was messed
up it would
crash
no no no no no no
guys you could have done it on the Mac
uh the free version of Ida actually
can't disassemble Ida but then we
wouldn't be learning so much about this
exploit it's not about the
destination it's about the
journey yeah no I know the NS a back
doored me it's
fine all right let's run this NSA back
door right here gidr run.bat that
doesn't seem
sketchy Java runtime not available
please refer to G's installation guide
installation
guide installing gidra simply extract it
using windar oh the NS uses wind roar
oh support version of the
jdk I got a text
message pay
$1 oh no insufficient balance
no adopt open jdk oh man this is
definitely backo
you want your hat and you don't want to
be on the
stream you want to be on the
stream you could be famous in
French I have people I got so many watch
I know this is great for my you I'm
going to make twitch partner in no time
you know what I'm
saying well just say hiam oh my
God oh my
God oh my
God
not
could be playing an ad right
now we're using an backyard software you
are yeah and also you want to say hi no
I'll can I see over here no I'm not if I
can see over
there this is a fun one what's fun what
you're doing yeah we're we're hacking
iPhones people love hacking iPhones oh
we got to be warm because we've been
drinking tea all morning you want black
bear help help yourself oh you want some
tea oh you're drinking my tea a you got
so wow they're saying Fashion on point
thanks team yeah we got lots of tea
because we ran out of tea and that was
one of the greatest tragedies went to
Twitch combos yeah yeah I was talking
all about twitch con how I'm going to be
a twitch partner they say hello George's
mom
[Music]
how come you prefer tea over coffee I
already actually had coffee this morning
I was thinking about getting a Lotte I
got a Lotte a frost me it's very good
but if you go to frost me thank you for
refreshing my tea um if you go to frost
me too late there's lines and I really
hate
lines we're just hanging out we're all
just hanging out hacking together
there's 923 of us
oh yes the gidra user agreement
ah the National Security Agency does not
condone or encourage any improper use of
gidra oh yes g wow they really branded
this NSA this is probably a great
recruiting tool for them oh my God my
strawberries just strawberries are kind
of sad I don't think you want them
anymore I ate some now control W you got
to stop with the trolling I know what
these shortcuts
do all right we're getting distracted a
lot of distracting things have happened
in the last bit of time sorry not you no
no no just just the
[Music]
NSA okay
um instead of w length of your payload
size send a status packet to Mark the
end of your control transfer we skipped
the data phase even though we set W
length to a value wait for the device to
re-enter dfu now the input output puffer
will be free and the USB task will be
allocated under the free buffer send a
set configuration request let's send the
payload with it as data phase set
configuration Handler thank you for
subscribing
Essence thank you
you coming back yeah you want to take
the key no how you going to get
it
okay now we only have one chair I'm
sorry that's why we never have friends
over here you got a bench you can show
them the bench oh they can kind of see
the bench yeah there's a bench over
there Gore 4 thank you for
subscribing um I don't know about
this what's a
whisper no it's not really my
mother
968 get over a th000 all right
um I mean we can move on to trying to
use a VM to do
this you want to just try it a VM do I
have virtual box on this computer I have
hyperv oh you know what we have Arch
Linux H yeah who remembers Arch Linux
what make the
password could someone check the old
stream and see what I made the
password yo we installed Arch Linux on a
stream
um let's see does this let me connect
USB things to it does hyperv have a
good if it doesn't let me connect USB
things isn't going to work
[Music]
anyway here we go how to perform a USB
pass
through post level USB P oh my God this
looks so
hard charge to a client device
what USB
storage but only for USB
what
I feel like I installed virtual box on
this computer and it was broken for some
reason all right I don't know let's try
it Windows
hosts um you Bund
do your virtual box has an easy way I
think to but oh no if it makes me reboot
I'm going to cry you can have hyperv and
virtual box at the same time well can I
turn hyperv
off you need to disable
hyperv you also need the extension pack
h no reboot no no no no no we're not
rebooting no we can't we've come this
far no I will
refuse you need to reboot to disable
hyp back I don't know we back all right
few oh that was close oh that was really
close that was a little too close for my
liking oh what I have Arch
here
USB why is that the Ubuntu
thing
good wait it's booting the Ubuntu
CD it won't work in a virtual machine
no no if I have to go get the Mac if I
have to go get the Mac we're going to
cry
no we're not getting the maap no no no
no no no we're not doing
that is this booting or
what oh great this is
terrible I feel like we had this problem
last stream that I tried to do
this and it just kept crashing and I
didn't know how to fix
it the exploit doesn't work through a v
app
why
okay let's read more about the
X guys if it was easy where would the
fun
be do this really say no
VM say anything about
VM oh it won't work in a virtual machine
okay
is it possible that this is doing
something that I forgot to do no
Checkmate exploit it just gets the
serial
number that doesn't do anything
exciting okay we're back to trying to do
it here
it seems okay let's debug Li
USB let's maximize
this control transfers reset device
close device enumerate
device
oh that might not be right oh there
might be a Python 3
bug this array.
array this never seemed right to
me look at that array B like that's so
weird
why is it even
[Music]
here why can't I just do
[Music]
[Music]
that byes object has no attribute buffer
info
H be Global so garbage collector never
freeze
that
I guess that's right uh just like look
how different this one looks
right this one has all this here and
that one just looks empty I mean maybe
okay wait maybe it's supposed to be
empty hang on no no no that's just
supposed to be empty I now I'm getting
trolled um that's just this one here in
part of stage two
okay
um why is all this stuff happening
before stage one even
stage
two this might just be
like you know this stuff's not
right B might stand for big Indian no B
doesn't stand for big endian stands for
unsign char
I know the lime rain exploit works fine
on windows so this cancel trick should
work all right we're just going to have
to understand more you know that's how
things work once you understand
everything you're just ready to
[Music]
go
[Music]
and b stands for big lawsuit you're
funny all right device not enter poned
dfu
mode
uh I know this bug works just pulling
the
[Music]
oh
all right we're going to learn about
what this exploit is get ready for
learning it's learning
time exploit
config let's just make sure there's
let's read this code and make sure
there's no more
bugs
yeah that's all going to be
right hello it's me you're
back you going to
what you taking the
key wait why where you
go
roof
oh want
[Music]
moreth no maybe where do you have more
toothpaste maybe I want more toothpaste
I want some eggs we can cook eggs I'll
pick up some eggs we have eggs we just
got to cook them oh but we're on stream
right now I think we have a lot of
people you want make cooking no no no
they don't want they're not here 928
people are not here to see cooking but
we are going to have to do some
cooking to bring much o what food is
there I'll bring you something nice
what's nice anything you
want that sounds nice okay I'll text you
thank
you no we're getting food guys we're
getting food cuz we're hard at work
hacking
um like I don't even think we're up to
Shell Code yet
[Music]
number is required not
bites oh
H
[Music]
interesting
here's the overwrite so struct that pack
should really behave
identically knob Gadget
fine
H are we sure the USB resets actually
working
[Music]
[Music]
[Music]
yeah it says the resets
working okay let's let's look and just
use normal dfu mode um iPhone dfu
protocol like
these yeah here we
go
let me send those commands but I don't
really see that
happening I used to I used to have all
this stuff
memorized I don't know if it's possible
we're just exploiting I wrote this code
actually this is my code doesn't mean I
remember how it
works man I really couldn't Cod for shit
you know should put some comments in
there doing leak one config large leak
so we're not doing large leak whatever
large leak
is oh all the non arm 64 ones I think
use large
leak and I don't know what buttons and
dfu loop
means all right let's see if we're still
let's see are we are we missing
something
obvious
um let's go back to
the
this of course we're playing on hard
mode we're in Windows
and see if he says anything about
it
device has no Lang
ID this is not a
problem
should we switch to the
Mac I don't know like it's just really
hard to debug there's very little
feedback in this
exploit I don't know why they call it
leak because it's not leaking
anything no error control control
transfer
oh this is
[Music]
just there's
errors see which of these is
[Music]
erroring
[Music]
so there's errors I I don't know if
those are supposed to be
there it's like what it
returns
H know they could have put a little more
checking into
[Music]
this
objective type int has no
Len data or W Len I guess if it's
returning to w
l those both have length
[Music]
zero input output
error
okay
yeah so that's failing I'm not sure
that's supposed
to it's also like I think we should be
able to get some info about the
[Music]
error
okay AR
five there were all r five so that's
kind of
[Music]
useless and printing that's useless as
[Music]
well okay so that
one's
x33 second
one is throwing
error this is
erroring um we have one
in doing
leak wa there's already an error by the
time
oh wait what why is that there USB
request stall
is oh wait error
five
[Music]
um
[Music]
I don't know if this
is supposed to uh oh wow we really got a
lot of
people um I don't know if this is
supposed
to throw an error like
this like I wish instead of saying no
error you should check the ones that are
supposed to throw errors you should
check to make sure they do throw errors
and the ones that aren't supposed to
throw errors you should check to make
sure they don't throw
erors this might be a little bit hard
because we're trying to debug something
we don't really understand on a platform
it wasn't written
for so in that case we might have to get
the
Mac that's
erroring okay stage one is all
good this one throws an
error I actually don't know it could be
the other
one let's just add
[Music]
[Music]
in
that seems like it's the
exploit which means I'm not sure if
that's supposed to
error yeah error five is access
denied which is interesting you know
what this this might have to do with
interface
claiming do we do that yeah I don't
think we
do
[Music]
um I claim
interface usb.
claim P USB claim
[Music]
interface
yeah you know let's go back to printing
that
[Music]
out no it's not access denied input
output error which might be
[Music]
okay but this might have to do with
claiming
interfaces stupidity of
USB um USB
UIL usb. ut. claim
interface
[Music]
Z okay I'm guessing
the code worked fine for you on
Windows
how wake you up when I get the Mac
no
okay okay we got the
Mac we got the
Mac all right we're not actually going
to switch the streaming what we're going
to do is we're just going to set it up
so I can SSH into the
Mac
oh I have to find a USB to USBC
adapter yeah yeah yeah the macc's coming
out yeah yeah yeah no no no no we're not
t shutting the stream we're going to SSH
into the Mac it's
fine
okay let me just set it up so I can do
this give me a second it's
1.7 and now we just need to go in here
to sharing sorry you're just going to
watch me use a computer like this for a
minute remote login
enable Okay let's
[Music]
um go to putty
192.168.1
7 trust the host password it's the wrong
username
putty 1 18216
8.1.7 and I have set the user down here
or something
yeah Auto login username get a different
username on
there all right we're
connected all right we're on Mac now
we're on Mac who's happy who's happy
yeah yeah yeah all right all
right should I make this bigger for you
I know you like when I make it bigger
yeah want make it bigger all right we'll
go to 12 point all right
cool uh what I have on here
TX GX
cool oh
[Music]
great
agree can I make
now
hm well this should at least have
instructions to be
usable BR install B
Tails yeah basic programming guys we're
doing some basic programming go find the
USB
adapter all right we have a USBC the USB
adapter let's unplug it from
here and let's plug it in over here to
my Mac which I'm sshed into right
here uh good we have an Apple mobile
device in dfu
mode updating home brew all right great
we all to wable this updates don't you
love updates guys updates are one of my
three favorite things uh in the world
after
taxes
and rotten
strawberries all right what is this
doing Brew cleanup has not been run in
30 days oh binu is keg only who brought
the
keg
okay they tell tell you how to run this
[Music]
somewhere dependencies this tool should
be compatible with Mac and
Linux first run ipone dfu DP to exploit
the
device oh wow it just
worked see it's pawned by Checkmate wow
that was so easy wow you know we got the
Mac a while ago who Wast time with all
this crap all right no but actually I
want to figure out why it wasn't working
uh let's see if it has the same pattern
of
Errors um wait how did that just
work how did it even build the maybe I
didn't even have to build them maybe
they already
existed all right we now have pwn dfu
Let's uh let's dump the boot ROM oh this
this is so fun now we're having fun
who's having fun okay I'm having fun oh
great now we have to figure out how to
get this from the other computer to here
um what is it python DM simple HTTP
server that going to
work
192.168
no no not 800 try
8,000 firewall
[Music]
shit
[Music]
network
Advanced hang on I think I just got to
turn the firewall off so that'll
work um sh where's firewall I forget
security turn off
firewall take down the firewall
boys not 800 8,000 all right
good okay all right let's try gidra I
never used this before so pardon me for
being a
but um yeah so we just want to go over
to
downloads so this is the boot ROM
itself uh so let's take a look I want to
do a few things I want to Let's Port
this thing to Windows and Python
3 and let's start taking a look around
wow that was actually really easy once
we switch to the correct platform we're
here on a Mac
you know sometimes life shouldn't be
played on hard mode and that's why you
should play on easy mode and use cheat
codes like
Max you stole my boot ROM
Wilkins
G I'm going to control C it so nobody
else can steal the boot ROM he got in
nobody else that's right it's where we
draw the line okay this is unusable shit
uh new project nonshared project
project name iPhone 7 boot
ra
finish I didn't really have a plan for
what we were going to do once we pwned
it but we pwned it and it was just a
question of just running it on
Mac um gidra comes with a debug back
door enabled by default the NSA is
looking at my shit I thought I was
joking about that I don't think the NSA
would actually do
that I think the the political
ramifications would be too much
man
got a spell
right dump
file format please select a language
oh
um
AR 64 little Indian default probably
seems
right do I have to give it an address oh
my
God you're telling me people at the NSA
use this crap Bob the Builder Pro thank
you for
subscribing this is
terrible all right let's use Ida cuz oh
wait no no no something loaded
import results
summary
okay
oh H cancel that's right NSA my firewall
block your back
door not been analyzed but it's loaded
at the wrong address I
believe oh this is the hardest thing to
use all right all right
cool oh it decompiles things that's kind
of
nice rename with
l oh G is pretty cool
wow thanks
NSA how mad must the eye of people
be yeah we're at the wrong address
though
options
no
mad Big
Mad thanks no NSA is Bros okay um
warning sub routine does not return no
we have to change the load address and I
don't know how to do
that
close all don't
save no but I want to how do I move
it window memory Maps wow someone's used
this before
cool start remap image base so it one of
these many plugs move block to another
address oh okay um so when I was reading
through this it gave me some
addresses yeah load address is this I no
that's actually a different bootom this
is the bootom I care
about wow wait that's the load
address no so it's probably yeah yeah
just just add of one before this
perfect all right now we want to
analyze analysis Auto
analyze pretty
Pro what what didn't
work okay here we go so we know some of
the names of the functions for example
this one is it still G oh good good they
kept some stuff the same as
Ida four zeros
yeah so we know the name of this
function
is USB create string
descriptor
[Music]
does this thing have
undo yeah okay we can create the data
section up
[Music]
there it's pretty nice
man oh I add to gidra let's
say if you want to feel like no I hate
changing you know I hate changing
things I always like using the uh
default so I get used to them okay
cool um what else can I do with this
exploit can decrypt key bags and I can
demote to demote the device and enable
JTAG but you know
okay so no no no we're not demon um this
is really
cool like I didn't think that this was
going to
happen I'm sure an exploit existed but
the fact that it like was not
uh I don't really know the XO so I think
I think what we're going to do for the
rest of the stream is we're GNA figure
we're going to Port the exploit we're
going to get it working on Windows and
then hopefully in the process of getting
it working on
Windows we'll understand how it works
better we also now have the code that
we're targeting which is very helpful
right so before we were doing everything
blind now we have the code loaded up in
gidra so we're also going to learn a bit
about
gidra T it's t it's spelled te e a
it's also an encryption algorithm but
you shouldn't use it because it has well
you shouldn't use it as a hash function
because it has matching code points
that's how bunny pulling the
Xbox yeah exploit gives you root shell
bro yeah root shell got to get root all
right so let's figure out why the
exploit didn't work on Windows and why
it does work on Mac um what we can also
do with this and I'm not sure if the
code is written but we can that that
ipsu file that I downloaded we can now
decrypt all of that if we wanted to that
that's what this keyag stuff
means assuming nothing's changed too
much all flash like so for example
here's IB booot I don't know why there's
a d10 and a D20 maybe that's how big a
dice you want let's just Google those
and see if we can figure out what the
difference is because otherwise I'm kind
of
confused
no are there two variants of
it oh that's for the iPhone
huh it's weird that they seem to
share
why is there iPhone 8 firmware in my
iPhone
7 is it the same
file oh it's the same file that's
cool the iPhone 8 and the iPhone 7 use
the same firmware file yet the iPhone 7
plus uses a different one and the iPhone
x uses an entirely different one
altogether okay good to
know um post iOS 10 most devices share
its depending on the class all right
that's pretty
cool the point of the
stream no I mean yeah it's hard mode
right but we're we're just really here
to learn there wasn't a good write up of
how this exploit works and maybe that'll
be what we
produce um by the end of
this
but yeah um I know we used to post the
the keys used to be all posted on the uh
the iPhone
Wiki yeah I think I I'll submit I'll
submit a polar Quest we can do
that
um if I go on my Mac I have GitHub so we
can just uh we can Fork
it and we can see what our
there's a way to like use get in here
isn't there no I have a get bash shell
right here right so
get
yeah this would be a
nice the iPhone Wiki used to be mine uh
then I head it over
sorc but yeah who have thought we'd ever
be looking at this boot Rob so
cool
it's not escape to go
back and the back button doesn't work on
my
oh well what do you mean by jailbreak
see the whole thing is that that's just
very comp alt right
arrow no that look control right
out oh there we go wow that
sucks stupid NSA why couldn't you use
Escape
okay so it's not going to rerun the
exploit if it's already
ped
it's already pwned so what if I unplug
and plug it back in does it stay
pawned wow it stays pawned oh this is
good this is pwned for Life
Bros all right we'll have to reboot it
which is actually kind of annoying um we
want to figure out why it doesn't work
on Windows but it does work on Max so we
can
I like putty putty's
reliable I don't think the problems live
USB think it's just that the race
condition doesn't match or
something maybe a certain version works
we can check what version of Li USB I
have on the
Mac 122 so that's what I thought had and
that's the one that didn't
work
it might have to do with that weird
patch I don't know what that
does
so yeah if you wanted to turn this into
a jailbreak what you'd have to
do is um yeah I think what we're going
to do with the rest of the stream is
we're just going to get the exploit
working on Windows and then we're going
to try to write a write up of what the
exploit
is um we'll throw it on some some past
bin
somewhere um
yeah that's today's
stream that's today's
stream let's see what other addresses we
know
here DC civac WR
ttv2 they kept the G the
same
where is
ttbr translation table base
register interface
request callbacks I don't even know what
it DC civac
is this is a DC
CAC oh that's clear code bites oh you
press D for disassemble oh DC civac that
makes
sense have you been to this crack Shack
place it actually looks kind of good you
mean
chicken
I'm talking to you for my Apple watch
you mean chicken
place oh wow that was actually really
good crack
Shack all right so that's DC civac zero
let's see what Funk Gadget
[Music]
is
some Rob
Gadget looks very complicated for a rock
Gadget
though pretty
cool sounds good chicken's great but but
Mayo's terrible and Sauer cream's
terrible and none of those things on the
chicken but otherwise chicken sounds
great we'll eat chicken on stream
because I think the Twitches are like
chicken okay
byebye okay
um so let's see if these control
transfers have the same
pattern on here and let's try to figure
out what's
[Music]
happening
[Music]
let's throw my stuff you know what
better
idea we're just going to push this to
get and we're going to check it out on
there
Fork
G
okay so let's go over here to my G
shell
uh you don't need the aitp or
a.out it's interesting how all these
bins are
modified get
reset get checkout
[Music]
star get DEF make file changed M8
changed why did I change a
nit that was a pipe 3 issue
cool uh get remote- V get
remote RM origin get remote add
origin
git at github.com
[Music]
col geohot ion dfu
doget get
[Music]
add print
statements
Plus or for Python
yes permission denied public key
[Music]
um get her
desktop
[Music]
add
what give a
desktop
add add existing
repository local repository iPhone
iPhone dfu select folder add
repository publish your branch to
GitHub you are not logged in you do not
have permission
oh is it
because let's go to mini key
value and let me see what the remote is
of
that
um GitHub desktop might use
yeah GitHub mini key value get remote- V
yeah yeah it uses the other
kind
iPhone iPhone dfu get remote RM origin
get remote ad origin
[Music]
htps github.com geod iodf
you.get current repository I
dfu publish
Branch sweet okay
that should actually be public so you
guys should be able to play along with
me at
home right on here
good uh so now we can go over to the Mac
we can
[Music]
say uh
get get remote RM origin get
remote add origin but here we actually
want to use the other path the one that
didn't work on
here um
this get
home get checkout Master get log no get
checkout origin Master get
pull oh I don't know how to use that I
don't know how to use git I'm so bad at
git guys
[Music]
wait get pull origin Master does that
fix it I fix it up
good get po origin Master thank you you
guys know I don't know when's the
chicken coming that's what I'm saying
right ipone dfu
dasp okay
good um Python 3 pyone
two to three on here yes 2
3-w
dfu that noise is
[Music]
annoying
[Music]
what two to three
utilities
2 to
3-w
allate
recovery lime rain oh this is just
getting
annoying
shatter
steak sauce wow wow this is all a blast
from the
past must be string and not
bite USB EX
back okay good least it
loads get and doit commit D-
amend get push Das F oh no I push dashed
F okay uh let's reboot the
iPhone
and let's see if it errors in the same
place actually let's see if Python 3
first works first of
all oh we're not going to hear a
pleasant noise cuz it's not WI
watch
no I don't think we're actually going to
make a jailbreak guys I've heard
jailbreaks overrun by Script kitties and
isn't fun anymore
are so if you're here we're exploring
Checkmate notice how it didn't say we're
making jailbreak I'm out of that game
cuz you know what's going to happen you
make one jailbreak and then all that
happens is people complain and they say
but I want the next jailbreak or it
doesn't support my phone if I ever do
make a jailbreak it's going to cost
$1 and then when 21 million people use
it I'll have $21
million I'm rich but I don't have $21
million that
sweet yeah okay so the error pattern
looks completely
different where my where my iPath on
go not here it's
here so that one has an error see this
one has an error here and no error here
and it has errors all
there if someone jailbreaks my jailbreak
and charges 50
cents then we're going to run an
aggressive Med campaign about how if
you're using knockoff jailbreaks the
Chinese are back dooring your
shit
okay wow they just add pone to the end
of it that's really
cool
um of course not
yeah it's like a completely different
pattern it get exceptions during reset
and
stuff well good it's it's not Python 3
though get the
problem all that ports
good uh you can fetch origin
here okay I'm going try it again on the
windows and we'll see what we
get oh yeah me making a jailbreak that's
not buggy oh not not made by Script
kitties well you know what only script
kitties make jailbreaks now that's what
I've
heard and I'm not a script Kitty even
though I shamelessly stole this exploit
from axium
X what why did iTunes come up fuck
iTunes did I plug it into the wrong Port
I think I might have let's try this
port that's an HDMI that's not the
[Music]
right no we have to go back to
uh why does that disappear oh here it
is
zadig where's the
iPhone not even
there
yeah it's terrible
right
[Music]
no it's connect it down
okay
see those ones succeed on
here but they don't succeed on the Mac
you get errors for all
those wonder what error you
get
let's
um let's exit here cuz we don't want to
actually keep poning the device cuz
that's a little
Annoying unplug this plug it back into
the
[Music]
Mac let's see what's going on here
operation timed out is what it's saying
hm it's not timing out on
here maybe the time out's
broken yeah it only supposed there has a
time out of
one
um how was getting I on now that one is
just unreliable it works every other
time
great
uh see here wow it's nice to have actual
Vim you know and not fake electron
Vim still timing
out now it times out it just takes a lot
longer hm
[Music]
really just want to print what the error
is it's a way to do that
right like instead of print exception
like I can get the exception as e is
that Python 3
compatible perfect that's exactly what I
wanted
okay now stage two is failing every
time
um this isn't actually stage four this
is a final
check I don't know what stage two
is
see if it actually still
works ENT phone dfu
mode okay I've gotten into a state now
where it's broken I
think
going to reset
it pipe error that's a whole different
thing okay so that's what a successful
run-of the exploit looks like
stage two really only does one control
oh it does two it is async control
transfer submit and
cancel that's the only no stall also
does
that the new Fork seems to be broken on
Linux I mean I don't know you can try it
I didn't really change
much um this overwrite is what's
interesting USB Rec
leak I don't know what this
is
um those are like real things I can
Google
I think it's
that I don't know let's go over to my
gidra and let's search for
it
I don't know let's just let's just go
ID
I'm good at using Ida I'm not good at
using
uh the other thing yet
getra arm
lendan wait why won't it let me set
that I won't let me set where I load it
oh it's here it's been a while
1 2 3 4 5 6 7
eight
cool yeah this is so much useful for me
getra when did I talk to Jay Freeman
recently I do know
him not that recently I guess I don't
know why do you guys
ask oh it's nice to using Ida again I
like
Ida
there's nothing that beats Ida on a
Windows computer you
know
twitchcon um um Kira is kind of a broken
piece of
shit we could try to get the boot R
running in Kira
though but okay uh what did I want to do
oh yeah I wanted to search for
304 no
304s four
away no fourways okay I don't really
understand what these are
are let's look at USB no error oh well
that's not a real
thing
um control
transfer us just a refresher for what
these things are W value and W
index
[Music]
um the stall ascending to them I don't
know I don't know what these things are
like should I recognize them or are they
arbitrary
no we are using a Macbook right now
like we got the exploit running I'm just
trying to figure out how it
[Music]
works go back to
by targeting a linked list in the USB
task St you can insert a fake
task and you can use the USB task stack
as scratch
space as it seems like it will never end
up writing to it that
high
is this
needed let's try no stage
one oh well I
panicked
um let's actually see if we comment out
that devic is already in pwned dfu mode
can I run the exploit multiple
times and also does make
work no it's look it's in it's in
restore mode
now we're not really going to try to get
I don't know getting it working from
Windows seems like it's just stupid
stuff way in the USB stack I mean maybe
once we understand it we can but first
we're going to understand it on
Mac if you want all
[Music]
cool can the exploit stack is the
question
now it panics the second
time which does make me wonder if you
actually do need stage
one
well okay we do still need
that serial number that's
fine right we'll leave stage one in
terms of that but what if we just don't
do
anything
the device has no Lang
ID people are complaining about
[Music]
this
plug it in plug it back in did not
work okay so clearly stage one is needed
for something I mean it's unsurprising
they probably wouldn't put code in here
you didn't
need
uh
stall device config hole I mean okay
stage one so this is some kind of Heap
grooming and leak and no leak is
probably representing whether memory is
being leaked or not it's interesting
that that works
though c01 is the is the length and the
uh so there there's a memory leak to to
groom the
Heap B
setup stage
three exploit I mean okay the real way
to do this would be to get this running
in an
emulator if you really wanted to go
crazy
now it just doesn't
work doesn't seem like a race condition
anywhere to me I mean this actually
seems perfectly
repeatable
the stall is weird actually this one
here
um
for
for
some devices have more than one
leak no that actually doesn't seem right
they all the same leak I I don't know
why just doesn't seem to do
anything
[Music]
I think everything that we're interested
in is going to be in this config all the
right
[Music]
[Music]
the I did I do Brew install vils I
thought I did
that why is there no G
copy that's what the new should be
right
um GCC eded it's
fine
just let that
install what's on our jail
break
oh look people talking about
this
part of the problem with this if it does
turn into a jailbreak it's going to be a
tether
jailbreak everyone remembers what that
means mean G OB copy not
found Pro install B Tails I did
that
[Music]
so Ben 's been
copy I don't understand that should
work why is there no gab
copy reinstall
vils
oh B you tails is keg
only but still G obge copy should work
for this exact
reason
[Music]
fine don't tell me I got the order this
wrong again
did I get the order
wrong what that's
right
oh fine
done um are the bins the same definitely
swap
files not everyone uses
B okay
[Music]
uh
thank you for subscribing Dongo
Pro
H oh now doesn't work with
Python 3
[Music]
anymore yo I'm not doing no fucking
jailbreaks guys
want to make that clear we're just here
to
explore it was patched for that
one yeah I'm just interested okay it's
interesting
this thing like won't reboot
anymore go go go I'm holding the wrong
button I
think
where's the chicken that's a good
question should we ask should we text
and say yo where the chicken
at
booing can ask the internet not to do
something I can ban everybody everyone's
just going to be
banned yo where's my chicken though
that's
real
now it's in recovery
mode which does this exploit exist in
recovery mode too yeah it just get
patched it's actually already been
patched but this is pretty
insane now there no
l okay so that's a correct run-of the
exploit
I don't know why they all time
out they don't time out on
[Music]
Windows this stuff like way back in the
day here we go standard request codes
okay so that's just like getting a
descriptor
just be Rexall something
else
speak of the chicken
guys do we got
chicken I don't know do we do we have
chicken we got chicken oh we got chicken
y'all I wish we had a place to sit down
and eat our chicken I know wouldn't that
be
nice we have 1500 people oh how is it
going did you sell all the thing no we
just got the Mac
out and it just worked on the Mac so
we're trying to understand how the
exploit works now that feels good I
bet um but yeah no all these people are
terrible and now they just want to
jailbreak so maybe you know I regret you
know you know that's what they want no
but they're not getting
shit give the people what they give them
shit yeah she knows I'm
streaming do I have a what the wall
plug oh you can there's USB ports in the
lum
wait do you have a USB condom I'm just
supposed to trust you and put my phone
in here I don't know
man that's a millennial
shit I mean really the right way to do
[Music]
this
CH chick's going to get called Chi is
not good oh guys we got to eat chicken I
got some
biscuits so really gotc that's just
chicken in here right yeah Budd with you
don't even you don't even like
chicken they had a salad they had salad
and I was like oh this is perfect I want
salad oh your boy look at the
chicken I got e biscuits too oh it's so
good thank you
I won't say your name on The Stream you
don't have to tell the stream you watch
oh my God great just want to be doted so
SW me later
too no you stream all day what you going
to stream all day going to chch
mhm what time you f
them there's no car so I couldn't go
home I really wanted to go home there's
no car no who took the
fridge
no I can't see over here right what I
want to be washed while I'm
eating no you can't be
seen I love eating
chicken with these people
watching
oh okay so I think it's overriding the
Handler for
that maybe not
so I need the
payload
yeah
[Music]
Halo what my hand Alert in there
too
chicken how is the chicken oh it's
delicious I love crack eating chicken on
the
floor
Savage chick on a
chair check on the
floor really fireal of
you you're eating on the bed top yeah
that was better you no I that couch but
there's we need to pick towels up
there's there's napkins in
here don't Pap for towels for what
in
general we have some but yeah I have
some too I've seen
them thank you for subscribing now would
be a great time to subscribe while I'm
eating chicken yeah you run an ad right
now no I can't cuz I'm not a
partner I tried to run ad this morning
but if you're just just an affiliate
like me you don't get to run
[Music]
it only
part we better stream 12 times this
month I
know how many Subs would you have to get
to stream 12 times this month everyone
to subscribe
ior you guys you have to subscribe and
then George Will George Will stream more
if we got a lot of money today I'll
stream more
tomorrow we're going for a walk tomorrow
why is everyone calling me your mom is
this a
joke they don't know who you are you
didn't introduce
yourself you can if you want I'm
jailbroken for sure Mom I do like
that bring you lunch you know
yeah that's what she's likeing oh
B oh my God rude as
fuck you can ban I just cck on c d you
don't like
it Mom brings chicken it's
true mom a lot I know I was thinking
more about our moderation conversation
last night yeah what
bad who just got
banned we have
moderators good job
maybe someone made an inappropriate time
that's why they kep him George did you
wash your
hands
yes this is a common troll they tell me
I don't wash my
hands if I had a more mobile camera
where's the camera right
there want to come around here
maybe I'm in disposed at the moment
[Music]
m gr's not the boot loader it's the boot
ROM I can
see chicken grease does lubricant
keybard what's the payload what's in
overwrite I think by understanding
overwrite we'll understand how the
exploit
works wow I see why we need moderation
tools
yeah tell me
more there's a knob
Gadget oh you can
bend y b
want
do make that much
sense why is it called a knop gadget it
doesn't do
KN it does
reset
that's that I've been listening to that
noise all morning what's it sound that's
the sound of
windows can you disable that probably
but do you know how Windows
works
man there probably preferences to turn
the sounds
off
yeah okay so that sets up this KN
Gadget it seems to be
this
and then that's probably some address we
control some docks let's go back to
those other docks and see if they make
any more
sense now the docs that were linked a
while
ago
they're not here so we can close that
one not here we're done with
that they think you are AI
now I'm AI yeah are you a robot
girlfriend
yeah I bring chicken a chicken see it's
so useful guys you know if you had robot
girlfriend would you tell anybody that's
what I thought
[Music]
yeah
this triggering
parsing who is
this
oh join the r jailbreak Discord server
that sounds like a talk Suess
pool I'm hanging out
later who said I was a
skid I used to have hacking account now
I don't it's
tragedy it's just not what you
do a downfall after years of company
don't start a
company your
stockholders May judge you and lower
your share price for eating chicken on
the
floor I'm just
imagine imagine Larry ell no wait not
Larry Ellis not guys are already crazy
but Larry
P imagine Sundar Pai was called eating
chicken on the floor what would that do
to Google share
price
they're so composed but I have a great
weapon which do not
care short my stop people oh that's
right you
can't private
Equity we should go to Twitch
now we should we going walk twit time
you want to take a car don't you we can
walk oh we can walk oh go yeah I'm in a
I'm I wonder get
change home oh you want to go home yeah
I know how to Cy that I know it's Uber I
only spend $40 bring back to my house
yeah you can Barrow some
Michael thanks
George you mean I have jeans I have
boxers I have black
T-shirt you think your pant
I don't
know no way you weigh a lot more pounds
than
me not that anymore but enough I mean
you
[Music]
can use
stap we
no you're talking about
Cesspool the chat is a cesspool no I've
heard the J Community really went
downhill I've heard that of course since
you left no not since I left there was a
good ERA after me as well
mhm do you miss J breing hell no it was
stupid I mean jbre didn't used to be
stupid jbre used to
be interesting because like all the
functionality wasn't
there but the fact that there's this
boot Ro exploit is really cool
you he about it we should repurpose the
iPhone strap
cars um had I hear about it yeah someone
texted me last
night I didn't understand what it was
till this morning
oh you want any vegetables you got
vegetables some beets oh your is that is
that c up I would buy a c up
[Music]
yeah someone was spamming what they're
terrible should I just join the chat you
can make me a mod and then I'll just ban
Come on B people please push some
chicken to GitHub I would if I could
guys push the chicken to push the
chicken to
GitHub
wait you have to go home before we go
t streaming keeping Zoom are happen what
time is p it's all day I think the
part's at 700 what's party oh I got TT
Adam what's the party yeah well there's
no little NOS X anymore Bo we want
little NOS x i you know we'll see maybe
they got a surprise guest we're losing
viewers cuz I'm not doing any hacking
you better you better hack George no no
dog and pony
show it's lunchtime
boys dork mod thank you for gifting
Subs you show them your badge I did
multiple
times I don't know why it's called knop
Gadget when it's not a
knop also this is
weird about a car mhm I at the
office imagine Subs chat only we could
do that yeah Mom St do
J we did that a little bit before how'd
it go pretty well I liked it I think you
should turn it back on at least for you
know considerable amount of time I have
five Subs this guy insulted my number of
Subs someone who's a subscriber wouldn't
do that you only have five Subs right
now way more than five Subs that guy's a
loser and you know what about that guy
he can't even talk back cuz he's not a
sub I realize that it's okay to insult
people who are not subs and
Boomers insulting boomers are not a
protection
file
put a little more ice in my tea and I
think we're ready to get back to hacking
all
right thank you for
subscribing that's true guys I'm old and
washed up and don't let anybody tell you
otherwise do the Tois know it's your
birthday next
week we don't talk about that
you get you got time out on my stream I
go time out no no no
no oh wow emotes what's an emote how do
I enable emotes can I enable
that yeah Subs only chat's a thing right
now oh emot only chat I don't even know
what that
is what's emote only
chat oh you can just send emotes I don't
want no no no that's
terrible show Tim stamp what's time
stamp oh that's
interesting can I check your messages
off stream yeah yeah yeah I won't click
it don't
worry
um Subs only chat oh this is nice oh
this is so pleasant see I like all these
people yeah we like how all people in
chat are
Subs but I don't know don't don't don't
watch you for fre um yeah that's a fair
point like I think a lot of people would
just pay a lot of money to you know yeah
this is called a
training yeah you know about trainings
this a lot of money
yeah did you tell them about
geong all right you know what this guy
who dm'd me he's going to get his DM
publicly outed oo never subbed never
donated ad block on stolen laptop
neighbors Wi-Fi free entertainment
That's my kind of guy there we go that's
what I would do I'm just saying I would
never sub to an asshole like
me okay all right we got to use dark
mode all right all right all right dark
mode click portrait at the top right and
click Night Dark theme oh your boy do we
like
this do we like dark theme yes it's full
Degen here I'll be back in 30 minutes be
back in 30 you're taking my keys 45 no
you're not taking my keys uh do you want
no you can leave him on the counter I'm
not really going anywhere if you're
really going to be back in 45 minutes
you go home
yeah can I create emotes for Subs all
right this is so confusing right
now I want my own emote I don't know how
to create any fucking emotes
settings what said I want my own emote
you want your own emote
yeah stop stop dming
me emotes oh
edit
emotes
wait what just
happened how do I get emotes I don't
even know
edit this is just
broken
emotes all
right oh I need to create a okay you
know what I'm not a Content producer I
think we've talked about this before I'm
done back to hacking this is too
hard and I also don't like dark
mode too
dark
C okay we're
back there are
we okay so first it's doing some kind of
Heap
grooming and then it's doing USB setup
this is something we can probably
understand why where it's
executing I used to have all of this
reverse engineered it's sad I don't have
any names for any of this there was an
ioot leak wasn't
there um
iBot
[Music]
name iboot ios9 leak is this like super
hard to
find
uh
a simple Twitter search will
deliver
sweet Su
me I didn't leak it I just want to say I
didn't leak shit all right
good long as everybody knows
that all right you know what I'm going
to let you just so just so we stop
getting rid of all the the the M you can
all talk
again
[Music]
uh I want to open in Visual
Studio no this isn't VSS code I want to
to open VSS code not Visual Studio
whatever okay I'll take it
oh my God
Windows just made for
Boomers virtual box
sucks G is hard to use what's
this close
[Music]
that what did I
want vs code
here um all right let's just copy this
over to documents iphon
paste
okay docks
oh wait oh there's just an Ida with this
boot ROM already oh no that's mine oops
that was
stupid okay secure ar. MK oh
beautiful wait is this how all the stuff
was
found
it's found by a patch diff okay well at
least you know we have like proper names
of everything what was that one function
that I had the name of right like USB
something or
other we have critical section now
search for
enter critical
section
um Q in critical section what's the like
goto command do they have that but this
isn't really what I want let's find that
USB
one oh cuz we had a USB one didn't
we
this don't
cut here we
go beautiful look we have
names so now we can just like set this
one here to USB Alex string
descriptor now we can click XRS here and
we can see what these functions are
called
too um here we go called USB core net
perfect USB core
net
[Music]
um
platform get USB oh
yes
oh here we go that's called platform USB
get more other string oh yes
beautiful okay
um
oh
all
here we
go where's control maybe USB control
controller oh no this is just this
stuff does this have strings I think all
the strings aren't compiled in
probably okay so here this is the
implementation of the
dfu
oh here we go okay so I think these
are okay okay we can start documenting
some stuff
now
[Music]
and this is dfu so it's four so 1 2 3
four it's dfu clear
status yeah that's what's happening
let's dfu
download this doesn't explain what these
things
are that's where that's getting
allocated in
memory
where is
that finding
files USB descriptors it's only here why
do they call it
here
tell me it's time to stand I'm disabling
that
notifications is stand a
notification I turn the notifications
from Act acity
off I don't know oh thank you for
subscribing tier three thank you tier
three is the best means you get the most
whatever subscribers
get
USB DT
string okay W value shift shift eight oh
maybe that's why oh okay maybe that's
why these things are weird
numbers you guys should have pointed
that out to
me no in like here we go leak here
here yeah okay all right now we're
making
progress W value equals
304 but W value shift shift left 8 =
[Music]
[Music]
[Music]
for
USB DT
configuration where's that
defined
I think it's actually
string
a get USB string descriptor does that
call
Alec what's that is there a shortcut for
like
find
control shift
F yeah but that's that that's not
exactly what I
want wait and also what do you mean this
can't just be in those
files I didn't actually search
okay get USB string
descriptor no it's not maling or
anything
so why is that a
leak we have all the names of all the
boot Rob now that's so nice thank you
Apple
for
for
for
so
complicated I don't want to understand
what the exploit is and I assume the
exploit got to be present Elite code
right
it must already be exploited by
then probably with USB rack
leak okay well we knew where these
were so this is actually
a
handle get
descriptor let's find that
in here we
go
turn that in
here
it's not
right USB wck leak USB rack no
Leake there was something about hex 40
in
this get the dfu in the state where it's
waiting for
a send a status packet to Mark the end
of the control
transfer the input output device buffer
and the USB task will be allocated under
the freed
buffer send a set configuration
request
nine but's send the payload with it as
the data
phase set configuration Handler in
bootrom
ignores
W payload will overwrite the USB task
struct and the next allocation after it
will be the USB stack by targeting the
linked list in the USB task Shar you can
insert a fake
task this will be spawned when dfu exits
so you can send a dfu abort packet and
that will get code exec because your
fake task gets exited with registers
later
on
okay
so my document is here let's
just
docum some
stuff
uh please commit your
changes uh discard changes discard
changes
good
handle
interrupt
H wow look at all these real
names
any
strings
no this is a string mod that one's kind
of interesting let see if we can find
that here we
go platform get USB serial number
string
SN print
[Music]
F
lcat I don't know what that is
that's like a panic Camp
there Thunder
boot what's Thunder
boot build Banner no we don't have any
of
that
okay
docks
let be
Coronet oh here we
go with USB mode recovery
acquire the USB Corin
net dfu
net USB core
start
USB core
start here we
go like M Copy inlined or
something it's prob USB controll
start Ida is broken Ida is
broken good
idea
go to definition oh yeah now we're
talking or don't go to
definition go to
implementation go to symbol in
file I don't
know
um so the source code let's look into
more about what happened iboot iOS 9
week
zo
Shiva
so normally you know if leaks are don't
ever leaking stuff's illegal but this
stuff is like so well uh you know spread
around the internet now that
well
if app really cared it would be
help
hey
aone get
banned Okay so we've been doing this for
a bit and we still don't understand
where this exploit actually
is I kind of understand now what's going
on so this is creating a t and it's not
really a KN Gadget that's the wrong name
for
it the stack pointer must already be
there oh that's probably the stack
pointer I
see and the stacks being placed
here so either way yeah so this is the
one doing the
doing the
smash um let's look at how the payloads
constructed 384 is hex 180 is that right
yeah that's
[Music]
right
[Music]
so let's get that uh you know let me L
that dock
here here we
go if you send to the dfu the setup
packet is handle the main coach call out
the
interview
step five the global variables but with
a cheap controller you can violate the
USB spec and not send
any so that's probably
this so no data is actually being sent
[Music]
here
cunch
oh
I gu does really matter what
scent like this is overwriting
the
32x 2
Q I really understand
that
for
for
TR
nsfr EP
bulk
in just search for that number should be
pretty easy to
find I
number
no um probably not used actually oh it's
inactive that's cute wow it even
knows
C click the underlying path oh oh cool
thank
you think any of this stuff's actually
active
though USB seral this isn't
used to find with menu see it's all
dim
that's
we
um okay we want to get to some of these
handlers and I think they'll be easier
to read actually in the
Ida
USB controller
functions yes this is
exciting I just find that
dropped
um
yeah
this how do I find this
easily
it's cute it's like Rand numbers
on other ones are find that yeaha the
platform ones sort by
that
um B
bile
it's actually M set
now we should add in the wrong the
ram
all
right
to
getra better at
this
us ep0 TX
buffer hopefully we can find the other
references to
that
registered
interfaces
count
oh something's incrementing
this
oh those are those kind of interfaces oh
that makes
sense
by way we have that EP zero thing
[Music]
now it's not
right ep0 TX
buffer this is
Panic let's see what this looks like in
G
I think it looks
better it's actually so much more
readable in
gedra
cool
should already has this
open here we
go wow and gidra just seamlessly
supported multiple
things USB core cable
State uh and this one
is registered interfaces count
this one
is L what why can I L on
that
l
wait
L how come it let me L on that it didn't
let me L on
[Music]
this I don't
know okay they both have
annoyances
um ah perfect handle get descriptor is
that really where it's referenced
because it's the function I was looking
for it's only one function
really handle get
disp
this talks about registered interfaces
count
too don't see
it Quest War value
eight
see this is something this is something
way more complicated than that because
this is
inlined it's actually just called I
think it's just handle standard device
request handle
standard device
request then like yeah have
69 but that's the normal
okay 3 so 60 is
[Music]
20 get descriptor get
interface set configuration
okay
I don't see get interface here
but what do you see set
interface us be chapter nine that's
funny oh here USB set oh here it's these
it's it's these Peak definition okay so
set configuration is here set interfaces
here okay so that's these things
here yeah perfect no no no no I don't
want to do that no no no no
no got a comment here that just says USB
recx set
[Music]
interface um so what we're interested in
is the one that gets the
descriptor
which around this
else
this
here what's this this call
Panic just a set
[Music]
configuration handle set configuration
is all just done right here it's
inlined inline y'all know what inline
[Music]
is
where's
Six pz TX
buffer oh these are just calls to USB
controller I
say
yeah what's this this is USB controller
end point
install it's like a puzzle
guys
um this is buffer
W two and then we I'll use buffer length
[Music]
somewhere yes
here
perfect this is Alec
IO and that's just going to call USB
control stall endpoint here
cool
calic
perfect
all right small break time guys we're
going hard we're going hard we're going
hard
uh let's play some pleasant music Eminem
piano oh
[Music]
yes
[Music]
for
[Music]
[Music]
[Music]
[Music]
[Music]
[Applause]
[Music]
all
right
um all right so I'm starting to
understand we haven't found the Smoking
Gun yet but we're getting closer with
every
minute so this just loads variables off
the
stack know why it's called a knob
[Music]
Gadget um
close this
window this wres the task
struct oh actually we want to figure out
what the task can I get a new like can I
open a second second vs code window
that's really what I want new window oh
perfect well this not what I want
iphon
[Music]
this let's see what the task struct
looks
like
task
s task.
say configure your
analysis
32x 2
Q what does that
mean
oh I think it just maybe pads me
32 I don't know why the up Arrow didn't
work yeah okay it just left pads than 32
that's fine okay so that's the task
struct getting left padded 32 or is it
left padded or is it it's skip
32 ah no up
Arrow
48 so it just skips
32 okay I'm going to
guess that's my
Mac
task
[Music]
routine
ARG
hm like my guess would have been that
that would be the stack
pointer
that
Q5
for
H okay well no it's not
right it should return something
shouldn't
it
35 missed
Subs
what still going wow they getting 35
gift Subs that's very
nice uh yeah we're still streaming did
you figure the things out you went all
the way there and back yeah so far I I
guess I figure the things out
um we found some leaked Apple code ooh
yeah
reallying yeah so much has changed in
the jailbreak world
yeah
yeah
um it's raining a little outside they're
complaining that you didn't even change
wait I did it's in my bag they don't
know that I had to return the car so I
brought the clothes with me wait you had
to what car did you got I borrowed vibs
oh she was at it was at the office I
went and got the key from her I
see you guys are going to be upset
though because I am changing into
another all black outfit so yeah man
probably
indistinguishable all black everything
that's a rap song isn't it if we put on
that though we're going to get copyright
stri no don't do it don't do
it
shower stream at
twitchcon now we we might uh this might
be the stream for today made some good
progress we kind of know what's going on
here um I think what the idea might be
is for us to start uh seeing if we can
get this boot ROM running in an
emulator this was a holy grail of my
childhood and maybe tomorrow we'll
actually have the skills in order to do
it what's going to happen tomorrow well
tomorrow so we have the boot ROM X we
have the we have the exploit right but
but it's like it's it's pretty unclear
what's
happening um okay like I know on the
surface level what's happening but the
way that would really explore this is K
if we could get the boot ROM running in
Kira we love Kira oh we love
Kira um so maybe tomorrow we'll use Kira
we'll try to get the boot ROM running
and then we'll do a really good write up
of this exploit if we could actually get
the votam running in Kira that would be
insane um I like it also I wonder if we
can actually get the leaked code to
build and then it'll be really easy to
just load them both in
Ida
no no no we always love Kier um they
they really want to know who you are do
you want to introduce yourself what do
they want to know they're saying who is
she I'm Alex she's Alex we talked about
this they the twitcher Twitches really
do know who I am you have to you have to
look at them and tell
them they don't care it doesn't bother
them wait can they see me no you're do
far away oh
there's not really a whole lot to see
you can go talk to them what am I going
to say I don't
know my in my incel fan
base
oh oh they met at FaceTime they yeah
they do know who I am yeah see oh
building eyebot wow someone actually did
it super fan of Alex who's that
person we like them Alex oh there's
another Alex watching
wow Lucas it's Alex not Alexis they've
actually gotten things to build are they
are they giving you useful
information some of them are useful yeah
some of the chats are useful look how
sweet oh they're nice they are
nice
um little drunk we do love the
ls L you know who's not
you guys you told
them Lil NS X was scheduled to headline
a performance at twitch I was going to
see Lil NS X tonight but
instead and it's not like oh yeah I'm
ready to take a little time off I won't
be sorry sorry fuck little
NSX
oh you
apologized yeah make it up to me that's
right that's right how does he think
he's going to make it up to us I don't
know
ma'am
wow he needs a vacation look yeah but
don't say you're going to be somewhere
you know what Eminem is a line and it's
if I say I'mma do something I do it you
J why don't you do some ctfs again you
can't hate the guy it's probably here's
what I think of B business that right
there it's what I think of business but
Tom I'm not playing
ctfs it's just it's just it's played out
sorry wow what was the sandbox Music
Festival I know about that one um yeah
we're going we're going to go to
twitchcon we're going to go to the
concert tonight yeah we're going to go
to the concert BL 182 is still going to
be there anyone's going to be there is
anyone going to be there George is legit
better ever than little n thank thank
you to I know we will be uh we'll be
streaming tomorrow um we're walking
tomorrow I don't know if we can walk
tomorrow today was our chance to walk
what yeah we gota I gotta stream
tomorrow Alex if I want to be a twitch
partner could we do a little walking I
want to make
partner I you guys I don't think the
twitch com's that exciting unless you're
actually there a lot of people were
streaming yesterday it's just kind of
awkward there's a lot of people there's
a lot of people streaming at twitch com
it's true
yeah I don't think I attracted I think
I'm killing viewers probably are you
kill are you killing
viewers uh hey who was someone was there
for two and a half hours and got bored
and went home yeah
wow social hack what do you think we
could social hack at twitchcon there's
no social hacking to be done there I
love all the people who gave me money
we're going to look you want to see how
much money I made off of this are you
guys are you guys can you please sub
should we show the Twitches how much
money we made off this stream George
Will you can we go out what do you mean
can we go out you know if more people
subscribe we'll go out in the town oh
and like take them live with us yeah
yeah if we get some subscribers I'm
always down to do something when we have
subscribers um let's see
analytics oh
yo we made 700 should I not show him
that n fuck it we'll do it live please
subscribe to me I made
$77 lightly pathetic we'll get the
secure I'm working in Kira if you all
promis to subscribe subscribe to my shit
I need your money yeah you can make me
an email
$77 you want an Alex emote
yeah play an ad I can't play ads cuz I'm
not partner I have to stream for 12 days
out of 30 for like three consecutive
months and set up the streaming schedule
that's a lot of work supy thank you for
subscribing where are no Subs at think
we could get a lot more chicken that's
correct oh add donation button oh we
should add donation button no no that
then I feel bad then I'm taking money
from people what do you mean why I don a
donation button no no no no then I'm are
like a streamer with
that they want to know if you're into
computer ship I'm into I'm into
computers yeah I've been known to like
computers Alex likes computers yes sub
train woo what sub train wow I have 222
subscriptions that's pretty good what's
that how many subscriptions does ninja
have mean what does that mean I don't
know
man what is that water bottle why am I
going to get
banned wait what did I
do first live ban oh vimmer Emax no I
don't know they talking about I don't
understand these people man you aren't
allowed to show that or you're any d
oh I'm not allowed to display the
revenue oh shit oh I didn't know oh my
God I didn't know I swear I didn't know
oh
no no wait nobody told me
no I didn't
know last stream that's it there goes my
twitch stream f f f f f f you didn't
tell me I didn't listen to you I'm
terribly s sorry I got banned from
twitch this is when I get banned from
twitch Alex my dreams of being a twitch
streamer I guess we can go walking
tomorrow delete VOD it's over all right
oh free geod stream gone F oh no it's
already leaked oh no screenshots I got
screenshot we've been banned oh no oh no
delete the video no we're done we're
done free it got clipped
delete the
clips it's really doesn't help that you
clip it
dum yo we're going to switch to mixer
like ninja yo let's sign up for mixer
can you show revenue on mixer can you
show revenue on
mixer oh mixer doesn't even have
[Music]
Revenue they're going to come they're
going to clip my twitch con badge that's
it I'm done could thing we know some
people at twitch but how no no I would
never do that though how am I what do
you mean how am I not allowed to was
that where was that in the rules I don't
know I read the actually I read the
twitch code of conducts yesterday and it
didn't say anything about that I didn't
break any rules they're just trolling me
you think so yeah they're just trolling
me you can't show mixer on Twitch uhoh I
can't show mix okay now they're just
making shit up you backed out of
twitchcon at the last minute no I'm
going to go to twitchcon and I'm going
to practice Oldtown Road and I'm going
to take little nsx's place then they're
going to forgive
me double ban fromo can't use webcams on
all right you guys you guys are you guys
are done you guys are done we're going
to be back streaming tomorrow probably
you can show but you can't stream I'm
only twitch affiliate when I'm partner
I'll know all the
rules you can win people on Twitch can I
move if I show my ass right now on
Twitch will that make up for it no I'm
done all right let's go let's go I'm I'm
done goodbye Twitches thank you for
joining all thousand of you I love you
all true please twitch is a feeling of
great love and greatness and they should
click subscribe thank you if I know why
any I'm going to subscribe you're going
to subscribe I'm going to subscribe it
costs money yeah I know it's not free
you know I a twitch friend subscriber oh
twitch Prime Perfect
yes I'll see you in a month
they're making fun of my lack of
streaming schedule you're erratic guys
no but this is true if you see anybody
out there saying geoh hot's doing
jailbreaks again I'm not and fuck them
that's right uh all right bye-bye byebye
no more jailbreaks no more jail break no
someone's going to do the jailbreak and
you guys can complain to him and he can
deal with all the great joys of of of of
that bye guys uh I see you tomorrow I
don't think you'll get banned if I do
get banned um best wishes
to my twitches and my family and my
iPhone and my
chicken and if I get banned it's been a
great run I've Loved knowing each and
every one of you this was my biggest
stream we're going out like kirco
ban all right all right all right delete
VOD yeah yeah I I see we delete VOD
don't worry no we're not actually going
to delete the VOD fuck it if they want
to ban me let him ban me I am whatever
you say I am get commit get pushed no
it's already pushed don't worry uh but I
am very sorry twitch I am actually
deeply sorry I know intent matters I
really didn't intend to do I Lear heard
intent matters of twitchcon yesterday
and I really didn't intend to do
anything bad and I'm sorry I won't do it
again I hope you're out there
watching um new account GG now I would
never circumvent a ban that's actually
against the twitch code of conduct and I
would never violate twitch code of
conduct because I want to be a twitch
partner so I can make a living on Twitch
move to the 51st story in koal andour
and live a great life in Malaysia all
right byebye
Don
[Music]
donkey donkey don
donkey well I'm streaming we're singing
the don don Donkey song on
stream and we're eating pills good
morning everybody have you had pills
this morning these are stale pills
they're not fresh pills but they're
still pills oh there we go yeah
pills L
streamer rip all right is that good is
is is it live
[Music]
now yeah we're going to Raw Dog the
internet let's
go all right camera's good now no one
got me I don't know why my vpn's being
shit I don't
know uh okay let's
go we're going to start things off this
week by reading some comments from last
week no I mean this this always sends me
down a rabbit hole in a spiral so I'm
sure you guys are here for it while we
eat pills but just while we eat pills
all right because there's some comments
here that are
ridiculous what a wonderful start of the
stream conversation no that's a good
comment we only focus on the negativity
George ranting streams are the best no
no no no no we gotta we gotta George is
right on with the Roman Empire debasing
their silver coin with ler medals to
increase the amount of money
money no you don't understand we have to
increase the amount of money you
understand how stupid that is I think
that everybody here against the gold
standard is planted by the
CIA um oh this guy had reasonable
critiques of Hong
Kong
uh what a banger beginning wow it's only
it's only the it's only the positive
comments you're the first guy I know
that pretends to be an anarchist but
despises activism oh yeah yeah I'm a
real I'm a real see you got to make a
difference between cyber information
Anarchy and real life
Anarchy information Anarchy great crypto
Anarchy great real life Anarchy fuck
that shit you know why because in real
life
that's when they pull the gats out in
Internet you can just close your eyes
like Tyler Creator said so that's what
I'm
saying uh so we can have Anarchy but
only on the internet you can't have
Anarchy in the real world because I live
in the real world okay does that make
does that be clear oh yes love how your
POV sounds so naive sometimes that trust
feeling of yours regarding interview by
Chinese officials I actually really like
um this comment uh well this comment
this guy's an idiot but um the trust
feeling is definitely one of Georgia's
correct ticks unlike the US China has an
actual culture that influences the way
everyone acts that's a gross
oversimplification because no capturing
culture with words anyway people aren't
defined by politics you have to
experience a place firsthand to
understand and on this small bit of
public trust George has experience and
I'd say he's correct my brother got
caught attempting to take a knife onto a
bullet train and they simply confiscated
the knife marked the stuff on record and
we were ch all throughout officials
don't really have any
animosity and if they do they don't show
it and they friendly and
understanding
this this is a much better way to put
the distinction than I
did um and then like you know yeah he's
absolutely right people living in medium
trust societies don't get it uh I really
want to find the
one
where some somebody's talking about oh
yes uh George is very smart with code
but stupid with politics and people in
general okay so I mean I wrot a company
I run two companies I mean I don't
really run comma anymore I'm mostly uh I
do run tiny Corp uh I did found comma
and uh I employ like 30 people uh
so you know just just just how many
people do you employ right that's that's
what you always got to remember this
about about haters right if you want to
hate see the best thing to do is get a
lot of skill and then then when you hate
on someone it actually
matters
um but no the real one that I wanted to
find uh you believe the ideal Society is
one where everyone is Rich and that's
not the worst thing you genuinely
believe it is possible for everyone to
be rich hell yeah it's possible let's
just all be
rich when to be rich you need to EXP
exploit the working class and steal
their Surplus value like stop reading
Marxist shit what that's not how it
works you you you being rich see and and
this is the
distinction I Define being rich in
absolutes if you define being rich in
relatives I if for you in order to be
rich somebody else has to be poor
somebody else has to be below you
because otherwise how would you know
you're rich you're a terrible person and
it's this gerian resentment that uh you
know is leading to the downfall of
Western Society because that's not how
being rich Works being rich means you
got a nice place to live you got good
food you got nice electronics life's
chill that's what being rich
is so yeah everyone can be rich we can
all have nice stuff we can all have a
comfortable life we can all uh yeah and
and we don't we don't exploit the
working class and steal their Surplus
value we exploit
technology because technology is the
best thing ever right think about it you
used to have to like plant shit in the
ground by hand then we built tractors is
that exploiting the working class is
having a tractor exploiting the working
class or is it exploiting nature we need
to exploit the shit out of Nature and
make everybody super fucking rich you
know that's a nice world right but this
it's this it's this it's this resentment
it's the same thing it's the same thing
the guy's talking about about the
animosity and that is why the
demoralization of Western Society is
just
beginning because you got to get over
that and it's going to take a long time
and a lot of grounding people into the
dirt in order for them to get over it we
got to let some people starve in the
streets until there's people starving in
the streets no one's going to be ready
to get over their resentment but he's a
billionaire you can't have billionaires
being our government okay okay you
deserve no food um George you can't just
say that I can and I just
did uh full white supremacist based on
lik Freeman podcast yikes
yikes um no but where's the other
one that I wanted to talk
about um yes
George is the type of person who has
never lived under true oppression or
real poverty uh and I replied to this
guy I replied to this guy because user
TD5 gy2 fh3 P where do you
live I'm curious I'm curious because I
would say that there are a few places in
the world where there is true oppression
maybe say North Korea uh or real poverty
maybe say South
Sudan um so there are definitely places
where there is true oppression or real
poverty but if I find out you live in
fucking America and you're talking to me
about true oppression and real poverty
yeah you want to talk about the type of
person who's never lived under true
oppression or real poverty if you're
truly from one of those countries where
they have serious problems in their
government um
sure but yeah how old are you and what
country are you from it also it
definitely existed in the past right if
you go back to like 1950s China yeah we
could talk about oppression and poverty
you fast forward to 2025 China yeah
there's no oppression or poverty um I
mean you know there's things to talk
about in the west of China but if you're
like
[Music]
uh but I don't think this guy lives in
China I mean this guy guy speaks
English so that's what that's what you
know where's your where's your true
oppression or real poverty are you
claiming that you live under that or are
you claiming that you you read about it
in some book you watched some YouTube
video about people who are oppressed
yeah watch that YouTube
video are you still in Hong Kong insult
she why would I insult she he's bu a
nice Society that's what I'm
saying I'm not here to agitate because
and I'll tell you about this here's
here's here's this is like I don't
believe in voice I don't believe that I
should come here to Hong Kong and be
able to have a voice to change a system
I have no right at all to change a
system what I do have a right to is exit
if I decide that I don't like the system
here I can get on a plane and I can go
somewhere else and that's your right in
the world I think that's the universal
human right the universal human right is
exit if you if you are and you can tell
this you can tell this by th those are
you want to talk about what countries
are
oppressive the countries that do not let
you leave those countries are oppressive
oppression doesn't mean that you're
allowed to you come into my house and
you insult me you're going to get you
know thrown out of my house but you're
not going to get held prisoner in my
house and there's a big distinction
there you're going to be shown the door
I show you my nice hospitality and you
come in here and you insult me I will
show you the door and uh yeah I think
that's I mean I think it's happening
right now in America if you want to come
into America and then start going off
and start insulting America
well I think I think there's the door I
think I think all the people who are who
are who are doing that for uh America
all the people who are like I want to
live in America and I want to insult
it that's the door
um George but you insult America in the
Stream all the time yeah and I'm in Hong
Kong no I'm not saying you shouldn't be
able to to to criticize but the kind of
people who who live in America and talk
about how America fundamentally is a
country founded on slavery or racism or
whatever bullshit come on come on all
right what what country would you like
to go
to
uh oh yeah I mean yeah no the Ukraine
situation is incredibly sad um if if
this person is if this person is posting
from Ukraine uh credit but
I doubt
it uh special economic zone in the US
yeah but only if it has real power I
think you could I think you could fix a
lot with special economic zones in the
US uh but again you need you need real
power behind them like the ones in
China
uh yeah
like I
mean I don't know it's it's
it's if if that's if that's what it
comes to there's a question of how much
how many like what percent of the people
in the US are too far gone down a
resentment uh like rabbit hole what the
demoralization is just
beginning um you can't exit the US
income tax even if you live on Mars true
true Okay so let's not
spend
uh I'm a bitter and resentful person who
has no valid
argument I eating pills ma'am oh how do
people eat so many pills every day
well I think what'll happen as the US
Retreats from being a global power is
that the US will no longer be able to
enforce its Global taxation
system so they'll be able to enforce it
with friendly countries but I think
countries like Dubai will say hey look
uh move to
Dubai uh if the US comes looking for
taxes will be like I don't
know is there even enough gold in the
world to support the amount of money in
circulation that's a good
question of course there is it's just
what we're going to price the gold
at Dubai isn't a country I think it is
it's an Emirate the UAE Dubai is a city
that's
true it's an Emirate it's in the same
country as Abu Dhabi
how can a small country resist
oppression and maintain it
sovereignty uh
well people forget this about
sovereignty sovereignty is literally
just what you have how can a small
country resist oppression and maintain
its sovereignty again it depends on what
you mean by oppression Hong Kong used to
be a British colony I don't think these
people were oppressed by the British not
even sure what that would
mean
um I think about decentralized science
does it have a token if it has a token
it's fucking stupid okay that's that's a
simple rule that's a simple rule of
here's a project does it have a token
yes stupid that's that's simple
all right let's do things let's not just
rant
today that was the opening rant um we
have a beautiful
uh 9070 in this computer
I think technically Dubai is not a
country I think the UA is a country
because like you can drive to Abu Dhabi
and I don't think you have to go through
like a border
so but good you're starting to figure
out that there is know like oh this is
what makes stuff a country and this is
what makes stuff not a
country uh it's just kind of all
whatever kind of accepts you blah blah
blah blah
[Music]
blah if you're replacement AMD driver is
good why does the Tiny Box web shop
still lift the driver is mediocre well
maybe it's time we change that should we
edit it edit the tiny you want to edit
the the website let's edit the
[Music]
website donkey
now what should we change driver quality
[Music]
to uh
developing right like a developing
country does it sound
good um but no really how about this
what if we just went here and read
comments that said good things maybe
we'll do that next week maybe we'll only
read positive
comments look at look at how tiny my
screen is now this is unbelievable I
don't know how anyone works on a 1080
screen I mean it doesn't help that the
Mac doesn't have uh sub pixel rendering
[Music]
[Music]
developing now move
me I think the website is uh I think I
made this uh open now to so anyone can
submit P quests to
it beautiful web dev skills
right thank you I used I used react and
compiled it with Babel
and I love that level IOD troll we like
list this like super complex stack and
he's like bro no I used PHP and my
squel donkey
okay so I've put the GPU in the hole and
we can see it's in the
hole there but when I do rock MMI well
after taking a long time it tells me
this
which who's is someone using these gpus
right now why is there a percent used
just my vs code server
okay I don't know all right let's
upgrade Rock M who's ready for this
experience or is this even supposed to
work
for what rock M do I have
31 is this going to
support I don't know all right should we
just YOLO it let's YOLO it who thinks
this is going to just
work come on AMD I have faith in you now
I'm an AMD shell uh wait oh did I what
what releas is
this 2
yeah we could use
dialogue we need more
dialogue need more open and friendly
dialogue uh install the package
maintainers
version all right all
right sure download 2.7 gigabytes that
sounds like a good number of
gigabytes what's the goal for today well
we're just going to play with uh this
this this GPU and we're going to see
maybe we can get the driver working
maybe we can get the new Matrix cores
working we'll just see what we can get
working okay so AMD released this
GPU um now there is a question if we all
got majorly rugged on the price so they
announced the price this is like the new
scam they seem to pull announced the
price at
$599 but you can't actually buy them
anywhere for
$599 uh we'll see I mean maybe this will
actually go down to
599 and it's because retailers have
inflated
prices wait egregious what I paid 950
for this GPU
I mean I haven't even gotten a 590 yet I
have no 59s I have some on order with a
large company that promised me they were
going to get me some and then I think
Nvidia said uh you know we're not
putting the tiny boxes in data centers
the tiny boxes are not for data centers
it's not the kind of thing you're going
to put in a data center it doesn't make
any sense it's a why would you use knock
to a fans if you're going to like even
even the Tiny Box Pro is not really I
mean you could maybe put them in data
centers but like this is the only one
we're building with 90s it's not a data
center computer it is an AI computer
Nvidia basically told my understanding
is they told all the board makers that
you better not sell to AI fucks and you
better only sell to
Gamers uh so considering where AI fucks
we don't get any
[Music]
I'm pretty sure you've talked about it
but what do you think about cabus their
tokens per second is insane and I really
want to use them for work well then use
them bro what's stopping you what's
holding you
back is it the don don Donkey song
Because don don don
[Music]
donkey that's going to take a while to
install
[Music]
we can start with the driver if we want
to go
crazy do want to see how far we can get
with the
driver we can like RM mod
amdgpu let's just let this install see
if it's going to work
first uh yes we're playing with this GPU
it's really cool AMD releases the uh
instruction
set so this is the instruction set for
that GPU you can learn about the
[Music]
wames they have new fancy
wames oh I didn't show you guys too we
also have these computers
you know what's in
[Music]
here a mi 300
X's so we have two of these computers
they were gifts from AMD uh we're
working on this stuff too well this one
this one's a bounty uvn is working on
it um getting the run time supported
with this but we're struggling right now
because the this GPU is not actually
each one of these is actually uh eight
gpus show you kind of how it
works
so there gu kind of shows
you
um this is what one of the mi30 X's
looks like uh it's it's like wild has is
a better picture
so each one of these is pretty much a
GPU so you can see one 2 3 4 5 6 78 uh
they're all connected with a very highs
speeed interconnect though and the
interconnect speed is faster than memory
and if the interconnect speed is faster
than the memory in a lot of ways you can
just treat the whole thing as one
GPU but if I go in here so there's a
tool called
UMR um it's pretty cool UMR is uh would
like you look into the registers of
uh didn't actually like install where is
this
shit Source app UMR you got to run that
shit with
pseudo
um let's see what we can do
here let's list the
blocks so the these are the blocks
inside this GPU and you can see that
there's
uh eight gfx course so let's go back to
this
computer let's download
UMR and let's see what blocks are in the
new GPU
[Music]
do you like how big my monitor is now
can everybody read the
text roam is not the firmware on the
card so roam means many different
things um you guys want a little lesson
on how this shit
Works let's let's read the tiny gr docs
I think we kind of talk about in the
docs a
little
uh so you start at the driver
uh the driver is what sits between the
hardware and then provides like an
abstraction to be able to do things like
uh allocate memory create
cues like you can create these like
different cues these different cues are
like compute cues sdma cues just like it
brings up the physical Hardware to a
point that you can start to send
commands to it and then you have this
thing called the runtime um I can show
you where these things are in tiny grat
so tiny grat has a complete Sovereign
stack for AMD the only non- tiny grad
code that's used at all in the AMD
workflow is
llvm I think I've talked about this
before but so this is the runtime so the
runtime includes things like a compute
well so the compute queue the queue
itself is created by the
driver uh but this allows you to
actually put things in the queue so this
is like putting an exact command in the
queue you have to set up some registers
so like these registers include here we
can look here at like uh so this is
where the local size is is uh where's
the global
size so yeah we put the the global size
here in the dispatch packet um the local
size is just like the width of the of
the simd within the work group processor
but then this Global size is like how
many of them to do and then you send
that and then you can actually run these
uh commands on the GPU and gpus are
really very simple machines uh so this
is using what's called pm4 so AMD has
two lowl ways uh there's this thing
called the mech or the ace I know they
use lots of stupid acronyms but um so
here we can look at it for the they have
this little document for they might 300
so this is actually one of the what's
called an xcd so those four things are
called xcds I don't know where that
picture went but um there's there sorry
those eight things so there's eight of
these in the GPU um
these are the compute units where the
GPU compute actually happens and then
these compute accelerators are what
reads off of these uh hqd stands for
Hardware Q descriptor so it reads off
these Hardware cues sends them to the
hardware scheduler which actually puts
the jobs on the CU of the
GPU um wow you know you really this is
why these companies use acronyms like
this AMD and Qualcomm love like tons of
ACS Uh Oh you mean the ace you mean the
mech which is part of the me which is
overall part of the CP yeah that's right
uh so yeah
um yeah there's there's eight vertically
stacked uh
xcds uh yeah so these packets are parsed
by these compute accelerators and then
these this these are just registers on
the GPU in the hardware scheduler so
that'll get the hardware scheduler to
actually uh put jobs on the compute
units you guys know basically what a GPU
looks like right I shouldn't I shouldn't
if you don't know what a GPU looks like
go go like go to like Noob college or
wherever noobs
go uh so this is this is the 7800 XTX
you can see each of these things is dual
compute
unit um H these is the Shader engine but
not a separate GPU I know it looks like
a separate GPU but notice how the l2s
are here so it's all it's all just
levels it's all just like different
hierarchy what what is it levels Jerry
ah okay so we set it up I don't know if
we reboot the computer who thinks it
won't ever come
back oh please come back yes come back
good go to
computer
um
donkey and it has 16 sdmas so we can
bring up that m300x picture again
jeez what was that picture this picture
so it has 16 sdmas I I haven't looked
into this totally yet but the I believe
that it's two per one of these so you
can see this is 128 gbt per second on
the pcie but it also has Infinity fabric
uh linking it to the other
gpus
so there's sometimes a picture of that
but it's just it's a full mesh so you
have eight gpus so there's seven link
out to the other gpus and then one link
back to the host with the PCI
Express so yeah we're having lots of fun
with
these um and then we also have the rdna
4 I picked rdna 4 because no one's
really working on it
externally and uh I think it'll be
easier there's stuff about this chip
that's
complex um rdna 4 might just be
literally simple
stuff yeah so this shows the
there's the
ram which one of these is an xcd they
have 38 compute units
each you back
yet I'm back I'm back I'm
back uh but yeah know the GPU Market's
actually super Bleak like I said I've
got my hands on no 590s yet I'm I going
to pay some eBay scalp or
$3500 for but the gpus aren't even ever
going to be sold for $22,000 like
they're all doing a scam
now you try Vibe coding you get you get
by the
way um I hope I hope uh uh Mr Peter
levels doesn't take insult to when I
describe his Vibe coded flight simulator
as mediocre because it is a very
mediocre flight simulator but the fact
that he's making money off it love like
the Indie Game Dev we like I spent five
years on this game and I worked on every
pixel and it doesn't make any money and
then this guy makes this bullshit in two
weeks yeah
based um you know you you you don't
like like you got to think about how to
hook people and entertain
them uh well you know what I got a lot
of gpus does anyone want to buy a tiny
box red I have a ton of Tiny Box Red's
in stock can I interest you in a red the
driver is developing now maybe someone
will click that buy
button oh no it hasn't come back yet
boys it hasn't come back
yet if it's just gone it's
gone no I can do some stuff over on this
monitor that might try to fix it um so
this is a prototype of a tiny box two so
it has
pci5 amd's driver bricked my
computer no I can connect to the BMC
hopefully over
here uh no sales is not above Tech you
guys are idiots you guys are missing the
whole point it's it's not like that that
actually entirely misses the point it's
not about sales it's the fact that his
game is a tweet and I can click a link
and I can engage with it it's that
simple versus well I'm not going to sell
on Steam because because steam is
exploited to to to minorities I'm only
going to sell it on this indie game
store and you can't use credit cards
like visa and MasterCard because because
they they don't allow they don't allow
the Wikileaks donations to the sex
workers or whatever whatever whatever
you got to you got to use the Halla
Network and and buy it through this and
then no no you you you made me jump
through too many Hoops that's why tiny
guard doesn't have any dependencies
there no Hoops to jump through you just
got to you just got to pip andall tiny
gr you can go do that right now who's
pip and stall and Tiny grad right
now um user experience over sales user
experience over everything it's not
about the tech it's about the user
experience
John blow's take on oh it's back oh it
has returned okay who thinks it's going
to work
now you think it's going to be there who
thinks it's going to be there oh it's
there whoa whoa D we just have a good
experience with AMD driver shit why are
all of these like on what are they doing
why you doing
something all
right um let's try hip equals one
[Music]
no I don't know which GPU it's actually
targeting
[Music]
um it going to tell
me it's not going to tell me
[Music]
okay the problem is this can actually
just be using the
uh I don't know if this is using the
7900s or it's using
the how are we going to find that out
oh let's also try a rock and bandwith
[Music]
test amd's driver situation has gotten a
lot better uh just overall the fact that
you can copy and paste their one thing
uh you guys know I'm an AMD investor now
so this has definitely changed my Shi
calculus we now shill oh look look at
this one whoa their PCI even works
pretty well so you can see this one's
faster because it's uh let's just check
D message and make sure we're not
getting any
a what are those
errors oh
yeah I mean okay uh no apparently so
what we think the issues with the 7900
XTX were we actually think it was a
hardware bug uh that was causing a lot
of the
issues
so we have a fix niml genen put a fix
[Music]
in no more recent than that
um I think you can see it in the
dri so hard on this tiny
monitor can't see
[Music]
anything oh here we
go this one uh turn off unor dispatch so
there's a flag on the hqd you guys
should know what that is now called unor
dispatch and
apparently this is what they had to turn
on to fix their race condition there's
probably some Hardware issue in the uh
Hardware scheduler on rdna
3 where you have to turn this on if
you're going to dispatch both uh it's
possible it's fixable in firmware so
there's there's the Mac which does the
things then there's the me mac which
does the compute things and then there's
the uh the me which does the graphics
things why is this so slow okay um um
but yeah so there's this flag called
unor
dispatch uh on the on the
PQ on sorry on the hard work you
uh yeah so I think this is and it's it's
not actually the mech it's not actually
the mess all my complaints are not
actually about the mess the mess just
turns out to be what reports the
error they did not have any sort of CI
um as far as I could tell uh Anish is
pushing for it I think I think he's he's
making progress on that front he's
talking about the right things he's
talking about CI he's talking about
continuously updated builds like nightly
like just basically normal software
stuff that I think AMD kind of lacked uh
but the Situation's getting better it
seems so you know I'm an investor uh
I've invested a quar million dollars in
AMD I put my money where my mouth is um
because if
AMD like
I'm so happy to open eye looks like such
clowns like they're they're posting all
that stuff where
um oh the US and the China and the
models and the open source and the like
you guys are such clowns I I hope Sam
Alman understands that he destroyed his
company open AI could have stayed open
they could have easily attracted the
money there would have been no problems
at all they could have attracted the
money they could have stayed open they
could have commoditized this technology
and samman would be a hero instead look
what happened opening eyes models are
like kind of on par maybe a little
better than the competition but not
seriously
uh you now got you now got Elon on your
ass Elon never would have done
this uh so it's it's yeah they're really
trying to make it political instead of
building an amazing product um it's
going to be interesting to see what
happens with deep seek I hope that the
Chinese government is Chill about deep
seek and understands that the best thing
to do is to kind of let them cook uh
that's if if your if your goal is to
demoralize the Americans just let deep
sea cook um
yeah no Elon I watched uh I like the you
guys know Channel 5 News um he had a
thing where he went through like what
elon's radicalization was and he has
kind of a big moment was the Biden EV
Summit Biden held an EV Summit where
they praised like Mary bar as the future
of electric vehicles and she shipped
three
cars at this point I think Elon was just
like holy shit they're complete idiots
and their idiocy is going to bring me
down um like he just imagine you're Elon
you're watching this and you're just
like oh my God these people are retarded
they're they're actually retarded
there's there's no like like like oh cuz
I don't use union labor
what enjoy poverty and then El looks
around and he's like wait who am I
telling to enjoy poverty I'm the richest
guy in this country I'm the richest guy
in the
world
shit that sounds like I'm going to enjoy
poverty I don't want to do
that all right all right all right all
right we're going to have to do
something about this all right how's the
government how does how does that
work
uh well I think you gota like if you
could have like hearts and minds and you
could like control the media and stuff
how much does a media
cost I'm gonna ask Twitter wait how much
is
Twitter you see the you see the wheel
turnning his head
right yes so F where um okay so this
obviously is not working uh
why device node okay let's add a print
statement to
hip
Live Jeff equals hyp
toiz okay um
um donkey
oh do debug equals
one only really need one
thing
okay so yeah that's
[Music]
and is there a smarter way to figure
this
out first let's see if we have
five that one that same it's node three
so maybe we set it to three
or maybe it's two because we have to
subtract one who
knows oh there we go look at
that we found it it's called device
2 uh let's want to try some map malls on
it
[Music]
[Music]
that's not going to work said bual one
five jiga flops well that's not a lot of
jiga
flops it looks like oh we have to go to
half if we want to use them
anyway
oh llvm
error okay go VM
ER you guys know Don donkey
I need a big
T okay well no luck there um let's look
into making our runtime
work it's probably really simple
so this is an Ops
AMD let's add a that same print here
[Music]
[Music]
[Music]
uh why didn't that print
[Music]
oh here it is okay opening zero with
rhgfx okay so we can do
visible devices equals
2 you don't need a hip visible I mean
you can use hip visible devices but when
you're using the uh okay so that just
didn't open at all and let's figure out
where the arrow was okay unsupported
Arch gfx 202
up that to
13 wait no
way
uh
okay did that just
work I mean this might be the easiest
shit ever
[Music]
um we have the vigers
per oh it's like taking a while to save
or
something how come that's already there
who put that
there like it's like it's already meant
to support this
chip did someone like already had
support for it and all I had to do was
change
this
cool uh well yeah okay so I think it
just kind of
[Music]
Works uh I mean the cdna one is
different but the rdna one I thought
might be like dead simple and it looks
like it kind of
was uh
[Music]
it sure looks like it works I you guys
like want to run llama on it or
something let's see like what's the
easiest way to run llama
now do I have like a text
way download
that's just sick if that works that
means this like stack super portable I
mean I guess it should be there
shouldn't have really been any changes
to this
stuff especially once we get we'll have
this stuff so it actually imports from
the other uh
files should we try to get the driver to
work so this is still using the kernel
driver from
[Music]
[Music]
uh every two seconds run Rock Me
SMI okay cool
question are you running
on a
[Music]
7900 got to compile the first time as
will slow
shouldn't be that
slow give it time
or did something not run
[Music]
okay
well that doesn't look
right let's see if it works if I put on
the other GPU
ND ND ND ND ND ND
ND what are you working on you should
know what I'm working on by reading the
title but you Chris something something
I have no
[Music]
idea okay so it works on
the it works on this GPU
tell me a long boring
story okay so how come this doesn't work
on the new GPU but it only works on the
old GPU let out a massive Eep and then
the one bumbling first grader in a state
of high alert let out a mass mive Eep to
the bumbling second grader in a state of
high alert and the one bumbling first
grader okay that's probably that's
probably really has to do with this
model
is uh so okay why does it not work on
this one let's run some tests and figure
it out
[Music]
yeah no errors but it gives weird
response I know I have a little bit of
tea left we'll go get it maybe there's a
good tea in there oh there's a squid
game energy
drink for
all right did any of those tests
fail one of them oh I
see that's
okay we can look into that
problem did any other tests fail
what do we think change between the
Cards yeah we're going to come out with
a tiny box to with uh it's written here
I have a mailing list if you're
interested in the new Tiny
[Music]
Box um we're going to do a tiny Buck
green V2 we might be out of stock of the
greens
forever um but yeah tiny Buck green V2
with 4X 590 it's going to cost the same
as the green
V1 um it's going to have a Genoa
processor in it to support the pci5
I mean okay so there's a bunch of ways
we can start diving into this delving so
to
say how does all those tests
pass but then I try it with llama and it
fails this is really the
worst probably like one bit of subtle
bullshit yeah clearly broke
broken and the map malls are broken do
you guys want to look at the map models
or do you guys want to look at the uh
why the other stuff doesn't
work who's more interested in
w we have a guy coming to work at tiny
who's the expert on
uh the memory layout for sdma changed oh
you think like the offsets to these
registers changed I mean to be
fair I am
importing this which could be different
now they could have changed that they
could have changed a lot of stuff
yeah this isn't really the right idea
this should really just wait for the
refactor uh uvn is working on a refactor
that's going to support the
uh
the uh
m300x might just be better to wait for
that
AMD GPU Navi 10 doorbell Mech ring
zero it could be something like
that no I mean the fact that only some
of the kernels don't
work probably has more to do with like
this kind of garbage
it sure has local memory
set default scratch size to 128 bytes
per thread okay it could just be like
all this stuff that's different I wish
we knew where this came
from it's it's got to be something like
this something wrong with the local
memory I don't know want just YOLO that
gfx wave sizes per
[Music]
se all right first we got to find a
failing
test if nothing in Ops is going to
fail
um well okay first I have another way to
fix this let's just disable that for
now
uh and how do we do that
we want to go into the oh this actually
this functionality was just added so if
I go into the C style
render into
the AMD renderer
[Music]
[Music]
well at least that doesn't error anymore
but it's not using tens of course uh
let's go a little let's put a little gas
on them tests my test DN
Auto
go big
fail does it pass with the other
one does it work in parallel or is like
32 like just too
crazy no it fils with that too okay
never
mind I don't know why it doesn't work
but oh there's probably like some
like yeah it works with four I think
there just some resource
limitation okay so it passes on this is
the
uh other
GPO the
7900 oh yeah it runs out of sdma Q's to
allocate that's interesting we could
probably late allocate the sdma q's to
not have a problem there
got to work back from the kernels that
aren't working I
know I guess like none of these things
are really stressing this shit out of
locals you got to get to beam if you
want to do
that someone want to improve the tests
I always check my get diff to see what
I'm up to so you see we we uh disabled
the tensor cores change that we added
some debug
prints okay so all those tests
pass let's just triple check to make
sure that that's actually hitting the
right GPU
let's also try to understand it'll be
fun we'll we'll try to understand
actually what all those weird numbers
mean I didn't write them someone else
did so they probably understand but I
don't it's always good to understand
understandings of virtue okay um I don't
know you want just yell all the tests
and see what we get got be some tests
that fail
okay good we got some failing tests
let's see what's
failing think it's anything interesting
I think it's
bullshit no device found for one okay
it's
bullshit compile failed
[Music]
initialization is not supported for
shared
variables
huh this seems unrelated to the GPU this
just might be like a different thing
that I broke
okay let's let all the tests run I
should have let all the tests run in the
first place but I got
impatient so it's kind of annoying
because in CI we can't run uh all the
tests we only run a limited set on well
it testing on physical Hardware is
annoying uh because it's not like like
it can be in GitHub actions so these
tests might just be failing on Master if
you run it on AMD
Harbor unrelated to the fact that it's a
new
GPU let's read that code that looks
suspicious and it's probably the
problem okay um good we got some
failures that's good uh so where would
that stuff
[Music]
be for
I'm sure that many tests aren't
failing some of those are probably
real weak object has gone away oh no
where did the weak object
go come on print out the test failed why
don't you print out the name of the test
that fail in the meantime
these are all
garbage no none of these are
real no one tests
this oh this is annoying we should be
like more aggressive about testing this
so then when we have the these kind of
problems we can like look at them okay
uh how am I going to find out which
kernel is
bad
well okay so first let's get a simpler
Benchmark
failing we have some tests here
that uh actually test to make
sure if I do benchmark
I hate that that loads so slowly there
into
that all right well we can clearly see
the junk there um what if I say no opt
equals
[Music]
one it's probably something around
locals it's probably pretty subtle
all it's unlikely to have Chang all that
stuff's unlikely to have
changed oh
okay that seems
[Music]
real I woke up in a
[Music]
car it's just some optimization that's
bad probably involving
locals does someone want to write a test
that like goes through and actually
tests the all right so here's what I
found about asking anybody at AMD and
that was my
uh my
mistake let's see if we get the same
answer on this this
[Music]
GPU uh don't ask AMD they don't know or
like someone in that company knows but
good luck trying to figure it out uh
asking companies they have a questions
policy they're just not as direct about
it they'll just kind of jerk you around
if you ask questions but hey they sent
us to computers which is a big step for
them
um okay is that
consistent why is it different on the
two gpus that's
[Music]
concerning uh let's try gbt two and see
if that one fails
too we definitely have tests for
[Music]
this ask the guys at AMD well okay they
do have all this like Dynamic register
allocation stuff let's just look through
the presentation of rdna 4 and figure
out what they might have
changed
useless okay they Chang a number of
compute
units Ray tracing shouldn't affect
anything the tensor course Chang we just
disabled them that should be fine
is it actually a 4 NM
[Music]
chip 4
nmet in some ways I'm very excited about
this GPU imagine putting huge grids of
them in a computer imagine having like
56 of
these okay so what could have they is
any of this real it's groundbreaking
that's great thank
you this is real
okay I also would not put it past AMD to
have bugs in the
compiler so this well we can check it
with hip we'll check it with hip and
that'll that'll let us know if
there's okay so gpg2 works
okay it's just llama that doesn't
work let's check it with
[Music]
hip if it's broken with hip then
uh oh that's
wrong got to say hip visible devices
equals
to actually let's throw some debug one
on there to make sure we're getting the
right
one just find the locals
guy um yeah
guys it's broken with hip
uh I didn't do
it
like there's probably a bug in their
compiler well let's check let's make
sure let's check hip on the other
one yeah that one works
fine uh
uh yeah the compiler probably has
[Music]
bugs and it probably has to do with so
this one is using like small D type
stuff
yeah is the compiler targeting the right
architecture uh yeah
[Music]
I'm okay possible possible let's let's
check all of that
I mean that's okay okay okay hang on
we'll give them the benefit of the doubt
give them the benefit of the doubt um
I'm so happy we have hips so we can
check this
stuff it's possible that I'm not piping
the thing through right let's check the
arch
[Music]
here uh and then let's also disable the
compiler cache
[Music]
well putting in the arch
correctly all right let's disable let's
try it with o
Zer it's really slow because we're
disabl to compile a
crash no
broken okay so we're putting in the
we're putting in that
correctly uh let's go change those to o0
who thinks it's going to work with o
zero okay now before we remember we're
not going to blindly criticize AMD
anymore uh because we are now investors
in AMD so we now shill for AMD so I'm
sure that their compiler works great and
I'm just doing something wrong right do
we believe
I okay
well
um all right let's let's sanity check
let's go to let's check it on
CPU so with tiny gr it's very easy to
run like the same thing
[Music]
on
CPU it's just Clank
this is your normal
CL is it targeting the right
architecture uh yeah I
mean probably it's possible something
else is weird here okay we have a pull
request to use llvm just use lvm
directly so we can try
that but remember it's a new
architecture so it's very plausible that
there's bugs in their lvm inflation
um so this is running it on the
CPU and we'll see if it gives something
good CPU is always a good place to
sanity
check
hello how is that the same as it was in
the other
one yeah okay so notice this is the one
on the on the rdna 3 GPU and this is the
one running locally on the CPU so we get
the exact same thing out of both of them
so that's
correct uh CPU is faster than I thought
which chip I think it's a 91
two4
yeah yeah tiny Grand guys tiny Grand's
really good it's not that fast I mean
there's some places where it's okay so
sanity check so it's good on CPU it's
good on uh one GPU but it's bad
on I have another reason to think the
art stuff is wired up correctly because
Bose parrot has tested this stuff
extensively on rdna 2
gpus uh so I think that if there was
like a problem passing the arch
in uh if I was loading the wrong Co
manager it should throw an error I don't
think it's this like
hip okay let's let try there's a pull
request which mostly works the guy's got
to clean it up though it's just it's
just ugly
code
um to use uh llvm
directly I don't know I mean do we even
want to waste time with this the back
end works it's just really as far as I
can tell there's just a bug in the
compiler um where is is
that's did this get improved
more oh good this guy improve okay he's
improving it he's improving it that's
good uh yeah this
one notice there's been 63 comments on
it um
I'm just going to go over
here and rebase that shit on master and
then we can check it out here and we can
see if it
works now there's a conflict we got to
resolve oh Jesus
[Music]
render who can read this
codeine that's
fine guys know the Sweeney Todd
songy
Todd his voice were C and his eyes
some 60 common PR that has a conflict
yeah I know I
know um I mean know it's good
look okay uh oh we have my own failures
here
man what do I want to do about that I
kind want to commit that
[Music]
there a pretty good changes
right all right let's check out uh
[Music]
not let me
push rna4 support good that's enough
Branch name to remember let's
[Music]
delete
that check
[Music]
out
that pull
that great
uh they said Rock and won't be supported
for launch well yeah I mean the compiler
doesn't
work all right so now this should
compile with llvm if I do AMD llvm
equals 1 I think that's
right oh
no no I did the rebase wrong
[Music]
superet what's missing
Arch oh AMD render is missing
Arch that's what I did in a rebase wrong
okay that's
fine no there's no way that just
worked oh it's amdor lvm of course
there's going to be like six things
that's it's going to bitch about yeah
there we go there's one that it bitches
about okay requires llvm greater than
18 all right uh okay now this is fine
exception but you're supposed to tell me
how to fix
shit uh right you want do
224 install lvm8 that's like
a it's like this here we go
there an automatic convenience script
now we're talking I love convenience and
I oh must be run his roote whatever
YOLO at least they informed him about it
no this is the stupid AMD attitude no
you can't just be like well technically
technically technically I'm going to
punch you in the fucking
face like no that's that's not that's
not okay like you know what would be
okay here's what would be okay if
instead of silently being wrong they had
an assert in lvm that said hey we don't
support that yet support coming here
here's how you can help great that's
okay silent wrong output from your
compiler yeses bro yeses I thought you
were an adult okay good I think that
works
now okay now we're using
llvm oh oh we going to fix bugs and llvm
y should we should we contribute to
amd's bullshit maybe we'll think about
it we will think about
[Music]
it iend the tale of Sweeney
Todd llama where's my no no no no no
where' my llama go oh my llama's over
here is it
all right disable compiler cach don't
use hip because hip's not going to
[Music]
work so this should be closer to
upstream and not using the
uh why is it not calling llvm
inet I feel like that did actually run
with
lvm I don't really know why
about I call lvm
inet amdor lvm did I spell it right
[Music]
how come that didn't open L yeah I mean
okay a real simple way to check is we
can
just do buug equals 4 and
see okay it's lvm I don't know why it's
not printing that
or did I just miss it I just missed
that like you can see that that code is
[Music]
lvm oh okay now it's working I don't
know whatever I just supped to missed up
oh because I probably it probably only
prints with thebug equals uh two yeah
okay that's
fine no I know they say they won't
support it but
again having your compiler be silently
wrong is like so deeply okay we're
getting eyes uh even with lvm so there's
probably a bug in
lvm what else could it
be I I am not interested in tracking
this down it probably has to do with
like yeah like strange D types and
lvm right should we build lvm from
source
oh I don't like that I just ran the YOLO
script because now I don't know how to
uninstall
it
Jes install
everything
um really
I mean I wish we would just print which
lvm got
opened I think I have that
here what debug level do I have to have
to have that oh okay
[Music]
three
okay wow so that installed lvm 19 and
lvm 19 has a problem
okay again before we before we go crazy
and say it's the compiler
uh this
just did I do anything wrong
we got to get the
LM does AMD have their own Fork
somewhere okay good
point uh let's
[Music]
see Rock M AMD llvm
project uh has not been updated in four
years
I mean if we really want to prove it's a
compiler bug and then we can really be
like yo you guys fucked up we have to
find the compiler bug and fix it right
you can't if you want to criticize
somebody you have to show that you're
better than them and then you can
criticize them but if you're just going
to criticize you don't know because you
could not be better so I think we're
gonna have to find it all right who's
excited yay
cat
show me the car facts love gang I don't
want to die here nothing to do so baby
just lie
here guys know that
[Music]
song need to get that AMD
uh all right so might even be in like
loading the
weights oh okay good good let's read
this guy you mean the mo one of the most
famous chip reviewers of all
time oh oh yeah this definitely looks
like
bugs all right so it's just I mean it's
just Mainline
lvm all right let's start by building
Master because that's what you
do should build lvm pretty fast
[Music]
[Music]
[Music]
so I will also note that if I do no opt
I get a different answer but still not
the correct answer but these problem
programs are probably going to be a lot
easier to
debug uh oh I do have some fancy beam
search stuff that might just
automatically find the
issue I wish I had a simple way to just
check every kernel with the
CPU yeah
so it's a different answer but it's also
wrong I mean how sick would that be if
it was just a simple way to check all
the kernels with the CPU and then like
tiny grad kind of is the regression test
for
everybody how's my cloning of lvm going
not well
I mean it's it's unlikely to be a
different bug
right uh we should also
try I have a different llama I can
use
um this is this is this should
work I'd rather debug it in clang than
LM but that still doesn't tell me
much just because I can read clang
easier
I don't know is that wrong I one of
these Colonels is just wrong um we can
dump the assembly with
[Music]
six okay look similar
to no I know we have the arch right what
I'm setting it right am I not
[Music]
the
arch okay I think
um let's disable the jit and let's find
which Kernel's wrong and let's do this
at the tiny gr layer because it's going
to make my life a lot
easier uh okay so where do Colonels
actually get
run where do I fire off the exact
items
realize yeah so that that that's going
to be step one def finding this BG we're
going to
uh if you send AMD the if we find this
no they said look we got to be nice to
AMD they sent me two computers they sent
me two really nice
computers uh total value really like I
was I was trolling when I was saying it
was like 200,000 it's more like 500,000
so they sent me $500,000 worth of stuff
I think we can fix this bug for them if
we can fix the bug I don't
know I'm now
at 50% chance it's a bug in the compiler
50% chance is something
else uh but okay let's track it down so
we
can engine this is why you also never
want to be an early adopter of
Technology like this is fine on a stream
but I shouldn't be doing this at
work okay so this is where the
schedule's actually
run uh you'll see we have these things
called
Eis oh be so easier if I could
just so EI is an exec item can I
actually can I type annotate
this no I
can't but yeah so this creates an exec
item
here uh we have a
runner we have buffers
how does the schedule know what device
it's
on schedule items also have
buffers Le only have uops
um it
consumes how does it know what what uh
device it's on
CTX
[Music]
Z what's the CTX there oh the Buffs okay
fine so it's just use the buffers okay
uh we should just be able to copy the
buffers
[Music]
um want easy way to like move a buffer
do
I like create a new one
[Music]
[Music]
buffers do copy in and copy out yes they
can so we can even use as buffer so I
should be able to just say copy in b. as
buffer sh work a schedule item like
that and then we want
to um
[Music]
call call
[Music]
I this should just be a feature of tiny
gr it's actually like super
useful okay so we have the CPU exec item
and the GPU exec
item uh run VAR
vales and uh I don't care about updates
stat we don't care about
that okay um great so we copy over all
the buffers we create the buffers now
let's copy out the
buffers uh CPU ei. buff subz do as
[Music]
buffer see if that runs first
gang I don't want to die here oh we got
to allocate the
buffer copy inated buer why
oh
whatever cannot copy into unallocated
buffer oh we're going toate the buffer
youate the buffer bro youate the buffer
didn't the buffer
just light up yellow thank
[Music]
you I have to give it fucking metadata I
don't want to give it metadata it
shouldn't be
[Music]
necessary the metadata is just for like
printing those things okay so you see
we're like running each thing on the GPU
and the
CPU all right all right um what does
this give me a memory view I want a
memory
view gives me a memory
view can like get this as like a nice
thing course that's all dealt with at
like higher levels of tiny grad could
all use some
refactoring
um you see like I want like the thing to
be like the D type and
stuff I do this in time
sorry self thought data here's a
data wait I just do as
[Music]
buffer all right that's
fine you don't have
shape I take away your
shape you thought you had a
shape you do not
I have taken your shape from
[Music]
you I'll start like printing
shat great memory gotta love it how like
this it's like a nice way to like not
make it be memory now it's just memory
uh
p number of two
list this
work G I
don't do so baby just Li
here you going to hang
okay those numbers look the same that's
pretty good
right why is this so egregiously slow oh
because fucking python lists I don't
know just like compare like 100
whatever oh let's construct a python
list and take 26 years to do
it okay those look the same we're doing
pretty good all pretty good so far Good
Start Good Start uh maybe we should
assert their equal oh those are floats
we got to use special stuff to assert
their
equal
import as P
np. testing.
assert uh all
close CPU Val GPU
Val oh can we find the bug let's find
the
bug have I read some guys book no
readings for nerds
guys a big fresh
tea so like what am I going to do when I
like find the thing it's going to just
this is so
slow but see look so it's it's running
each kernel on the CPU and the
AMD and taking forever to do it oh do I
have no opt on oh we don't need okay we
can get rid of no opt shouldn't matter
if there's opt
how many times you want to say debug
equals two don't worry it knows it's
[Music]
two is it t that I recommended you mean
like Hong Kong milk tea I got that'll be
a little
faster we're still
streaming yeah is there any large te
like this
[Music]
te there's not in the fridge there's
just a squid game energy Dr okay should
we tell them about our plant for we sure
how did they're getting the stuff going
well let's let's whoa whoa whoa let's
not tell them let's just speak in like
vague I got the stuff you got the stuff
I was it it you get a c for no I got it
here oh you got it here okay it couldn't
have been two sket
no it wasn't
sketchy I'm going to get you a
te thank like this one
you're this one guys know what this says
the pill lady is back hey hey we'll do a
little Q&A when I get back we're doing Q
and A now the pill lady I'm not whoa
whoa whoa whoa I I whoa we we can only
give them wrong answers though I want to
disuse well but my stream only spreads
misinformation I see we can't spread
true go don't ever tell them anything
about my life oh I would never do that
go
close everything I tell them on stream
is going to be loocks don't worry they
can't hear us we're all the way out
here that's okay but if we start telling
them stuff like you know where we really
are right now that would that would
really really wreck the illusion
all
right
youse
yeah
hot thank you
wait it didn't find the bug yet is it
still loading it's still loading oh this
sucks uh maybe we can skip all the
loading
ones I don't I know if it's a loading
one I don't
know hot or cold if I wanted cold I
would have said so
yeah Bab rent in Hong Kong
yo every person who lives in San
Francisco would be so hap much happier
if they moved here like let's just take
all the good software Engineers from San
Francisco and move here and leave that
City to rot to business
losers I'm just going to let this run I
don't know I should really just like
skip you see what it's doing it's
running every kernel on the CPU and the
AMD and seeing if they're the
same going to drive to SFO now move to
HK and start drinking tea I always drank
tea if you watch some my New York
streams I was drinking tea
there uh no like people who live in uh
oh I'm actually also like running it
twice here which I don't have to
do see like we made a copy of all the
buffers
using the lowlevel API and then we
schedule it on the CPU we schedule on
the GPU we run it on both and then we
get
the like the the power of tiny grad
that's expressable in that little thing
there is kind of unreal okay good we're
almost done with this all right let's
move on to like the attention kernels
the ones that are actually likely to be
broken oh there's a M validation Suite
well clearly it didn't catch this bug in
the meantime we can play with building
lvm how do I build the llvm project the
lvm project that already sounds kind of
overwhelming building
llvm oh with
cake lvm only build will
require gigabytes of
space download and install cake create a
build Direct
Tory build
llvm build llvm
cic llvm
project does not appear to
contain cake lists
[Music]
well where the cmake lists at
it in
here all SL lvm in
here all
right you need to pass cake build type
okay
[Music]
BBG all right all
right oh that doesn't look like a real
bug after all that that
the dog is not the
Beast
um this
one so yeah how do I like skip all of
those
[Music]
kernels like stupid theistic can I use I
don't
know actually let's just write this
properly so we'll create a context V bar
here
called
validate with CPU there should actually
be a feature that I
[Music]
Upstream this is like tiny grad like
infrastructure for adding stuff like
this all right
[Music]
let's
just let find like real
bugs um let's go to llama
[Music]
3 then here args
[Music]
Benchmark
um so you can just use this context and
Tiny like that so I just do that this
work so that's just going to load in
normally how's my lvm building
going all right build files have been
written it's just not do that
wrong blah blah blah blah blah after
cake has finished running you can
build maybe we should throw some js on
that bitch okay it seems like it works
wait no or we're just not oh I don't
know what that
was okay
I I mean they eventually can't be the
same if they're giving me different
outputs
what so they send me the so they send me
the box and now you going to buy their
shitty stock
yeah again like either they're really
undervalued or Nvidia is overvalued
there's no other wor that this makes
sense they passed the test right that's
what I'm
saying okay uh for some reason the CPU
is now giving me the same wrong answer
which makes me think we like missed the
bad kernel or it's the copies that
aren't
working oh no but no that's doing it
it's using a totally different path on
uh
let's validate this all with
CPU and maybe I was too
lenient with my ARS I doubt it I didn't
like write anything stupid did I
one minus three should be fine on both I
don't know maybe it's not the first 10
let's go to 20 it's a little bit more 20
okay so it's probably not these like
loading
things I mean it could be
Ram Maybe
all right my odds that this is a
compiler bug has gone
down e
hypothetical what if Jensen sends me a
b200 uh yeah I'll be excited to add
support for
it we'll add support to our Nvidia
runtime we'll thank Jensen uh we'll
still say we think his stock is
overvalued but uh wait wait wait I just
saw ones that were different
I seeing
things what's all those AMD kernels that
don't have CPU equivalents where are
those running
oh that's like when I rerun it there we
actually don't need to do
that
um so probably want to pop it off the
schedule want that to be consumed yeah
like this
okay so I I don't understand we know it
works on the
CPU can also just copy The Meta there
[Music]
let copy and return the
[Music]
b i that was
cool write this in a more tiny gratic
Style
thank you
you're did you want to do
no should
we how's it
going the AMD the new AMD GPU gives the
wrong answer for something weird I'm
trying to figure out
why you're mostly working
now you're mostly working that's
good maybe for the other one I should
use hip
thank you
we're slowly building lvm because we
didn't throw any js on it should we give
it a little
J it's a lot of
zeros
um okay maybe the problem is that we
didn't go large enough this 20 thing is
pretty bad okay let's do this
properly uh so where's my numpy shit I
do this in numpy
like this kind of this functionality
should move to
yeah yeah yeah
[Music]
[Music]
yeah we need like from MPD
type to NPD
type should be moved
Bu from
tenser get D types
[Music]
[Music]
this is like sick functionality to
haven't time to grab once this actually
works um D type.
base okay that seems right there's not
going to be a uh
okay and now we're checking the whole
buffer now we're not going to throw a
single J on it we're going to throw oh
free variable NP
is love gang I don't want to die here
nothing to do so oh baby just lie
here now you got to limit your J that's
too many
Jays that's too many know I'm saying
know what I'm saying
I mean this hasn't hit
yet we definitely need this
functionality and buffer and not
intenser I wish I could just trust one
of you to Tastefully do that but if I
tell you to do a refactor like this for
some reason you're going to do it
tastelessly like you're going to
capitalize the middle u in the word
buffer and I'm like are you trolling me
with this
okay then the other things that come to
mind are like sub buffer support being
broken or
something it's crazy
that both hip and the other thing seem
to do it in the wrong
way all right um let's comment that crap
out
[Music]
and if we want to validate the whole
thing with CPU we can just say validate
with CPU equals
one oh I'm also setting jit equal to
zero so we should probably
let's do a few more confirmations that
things are broken
without without this validate with CPO
okay no validate with
CPU we run that here
[Music]
and we set CPU equal one here do they
have different outputs let's find
out oh coffee's delicious a long night
ahead of ourselves we got the supplies
all
[Music]
right the GPU one's already done and it
printed lots of eyes
and the CPU one is saying more like
hello how can I assist you today that's
right how can you assist me today let's
ask that question oh you can provide all
right sweet uh so if it's not the
kernels that are
broken it could be the copies that are
broken so okay you see that hip gave me
that result and
and uh CPU gave me that
result like there's nothing in the hip
back end that's like remotely
controversial it's the simplest back end
of tiny
grad I mean like if hip if that's broken
if hip mem copy is broken this is a this
is synchronous
right like this is the hip back end it's
literally that simple
let's think through my Checker code and
make sure I'm checking the right
thing we only need to copy allocated
buffers that might make that'll make
things a little faster
[Music]
[Music]
[Music]
that
[Music]
[Music]
[Music]
for
[Music]
that
[Music]
why is that zero I guess because it's
not I don't know what rock GDB is going
to get me you clearly see at the end of
the day one of them produces this and
the other one produces the other thing
and on one GPU it does differently right
you saw also we can double check that
the
other we should probably just check
that uh so if I run this
on I mean again I'm doing a pretty clear
thing that means it's probably it's got
to kind of be some Amy bug somewhere
right or I'm do or I'm holding it
wrong so this is just H visible devices
equals one so we're using the gfx 1100
instead of the
uh they do use the same
compiler no but the lvm one gave me the
same answer
too which is another pointer to some
like that puts the arch in in a
different
way this is the answer from the
CPU let's look at the answer from this
GPU this is a 7900 XTX not the uh the
new
one hello how can I assist you today
okay so that works also it gives a
different answer with opt and without
opt which is another crazy
thing but if all the kernels match the
only other thing besides kernels is
copies oh we can try disabling lru
Alec possible it's
that so if there's like some like
synchronization bugs we have an lru
allocator
we disable
[Music]
that L
you no
lru ah
got
it okay half the elements don't match in
this
kernel it looks like it's one of them
loading the weights
yeah okay so that changed nothing it's
not the L allocator okay my you know I'm
like I'm like I'm like L here my my
percent chance that it's a compiler bug
just went up to
uh just went up
to
70% yeah we got
him got him tell him I got
him oh lne got him tell him I got got
him so it looks like like half the
colonel ran or
something uh all right cool that match
thing is stupid get rid of
that so I want to upst stream this
feature let's make the code look
beautiful beautiful
code actual
desired look look at that can can
everyone just take a minute and look at
that
beauty like think about what it would
take to write that kind of feature in a
different framework plus I've got AMD
stock that's right we're going to fix
the bug and we're going to pump the
stock uh okay so it's this one that's
broken am I going to God it's one of the
weight
loading it's one of the weight loading
kernels
um trying to load the norm
weight it almost looks like it's after
that
is only there in one right so loads the
weights and
stuff I just don't want to sit around
and wait forever while this uh I know
what we'll do let's just hack it and
load the weights backwards should be a
on line change
right uh where do we load the
weights bars bathrooms on was what I had
to don't believe me when I tell
you it's just what anyone would
do oh is it calling fix
bf6 is that where this bullshit
is uh it's not old weights
load quantize no how do I load these in
Reverse it's just a normal weight loader
uh and then State load State deck
just we get to the bad Kel
faster
brutal okay well good it fails right
away why is that not printing anything
there
huh I have a lot of questions about
this that should have printed oh no I
still have debug equals two
on so it should have printed when those
exec items ran I don't know why it
didn't that's not a thing
wait
what
H
okay wait what I don't even understand
this does it still like
[Music]
work since I reversed the thing
the copy is
failing if I don't do update stats does
that
uh does that not
print oh yeah you have to do to do
update stats
yeah whatever
so why is that copying from CPU to
CPU oh because that's like I
see you an iterable to
iterate all right yeah I just broke
stuff
what can't just reverse
it why not
though oh is it not does that not work
[Music]
[Music]
this looks like a very different
[Music]
bug we also probably shouldn't shck uh
should we yield the schedule item in
there and then just add the logic to
there it's probably
nicer but I like use that in a whole
bunch of places that's annoying
uh
[Music]
does this backwards thing work
looks like it didn't actually go
backwards did I get rid of the backwards
thing what AM my backwards
thing did I get rid of
it you guys been watching me did I get
rid of it
that should work
right load freak SS that's
fine okay great good we're getting
another another problem
fast
okay uh
model okay
[Music]
fine you're on a supported kernel this
isn't the kernel let's look at let's
look at yeah well this is this kernel
but you got to you know kernel is an
overloaded word it means lots of things
you want some popcorn
all right so I
believe that this is the broken
code I don't know why those are R
idx oh could it be because this number
is big
well that'd be
stupid no it's not even that big on
there it's a fine
number okay this konel didn't match this
konel
uh let's leave that up here because
that's good quality
shit I love that validate with CPU oh we
caught something we caught a fish
how come fish never catch people think
about that they do they're called sharks
sometimes I need someone to talk to cuz
I'm not a human being part
two wait what
okay uh
could it have to do with the
big it almost like it does have to do
with the big
shit I mean hip should assert if that's
a
problem oh I mean okay it's possible
that it's still a compiler
issue
uh
interesting so it looks like it only did
1/8 of
them so what's that divid by
eight might not be a compiler
issue looks like it just only supports
128,000 on that second
dimension but the other hip has no
problems with this okay here let's just
do another run over here make sure that
we're good if we set the visible devices
to
uh to
one it's possible that this Global size
is too large for some reason that's what
I'm leaning towards
now because I I really doubt that kernel
is broken I really doubt that's a
compiler
bug we're nowhere near integer
limits wait are
we could we be near your integer
limits that same kernel ran fine over
there
no that's only
217 it's only 25
million
uh we can also confirm that AMD has the
same issue
yeah it
does same issue same
problem okay it's using a large kernel
and notice how there's no issues on this
one okay it's using a large
kernel and this group I ID seems to be
uh too
large see if we can find any docs about
this hit Max group
ID Max thread dims Max grid size
is there like it's like CL info but hip
[Music]
info hip
config full
not
useful okay
here navigate to The Hip samples
directory yeah of course that doesn't
[Music]
work so
so uh
again okay it's possible it's this and
if it turns out to be this holy shit you
should have put an assert you know like
if you're building like a thing you want
developers to
use you should put an
[Music]
assert okay good hallucination
grock doesn't seem to be real
does it show up an open CL I mean
maybe
uh is it the total globals that doesn't
work or is it just that one
tells me
that all right um maybe we should just
write a simple test and see if we can
make a fail
I'll show you how this stuff works in
the tiny grad runtime it's kind of cool
so we can just do from Tiny grad
runtime. Ops hiip import
hip
device uh hit program we have a compiler
here um AMD
[Music]
compiler
uh need to pass anything to hip device I
don't think
so uh HP
program AMD compiler let's do D
equals we have to construct that
at
compile and that program is very simple
[Music]
uh hit program needs to be made on the
device we need to give it a
[Music]
name and then we can do program
call uh oh I need to allocate fucking
buffers fucking
buers buer hit allocator
[Music]
Okay blah blah blah blah
blah blah blah blah blah blah blah I I
spell allocator right I mean I don't but
you know it's just mean not
toat Al
uh know what the chars something like
that times
[Music]
that chars
cool args Global size
equals times
that that local
size might already be the default so I
don't actually need that and weight
equals true
[Music]
uh need an arch
doesn't know about AAL you tell about
AAL there's thing about a all you
excited fucking psyched
bro unnown type size te
[Music]
the assert guy was on vacation yeah no
no no
no that might be true oh
what only applies to Kernel
function I need this crap too
[Music]
memory
access
privilege show you
privilege I like doesn't look like a
real thing I don't know
[Music]
all right
[Music]
cool we really need to put that thing in
numpy
ah you know that shit you know the thing
you know the
thing I'm not gonna do it now cuz I'm
lazy
[Music]
all right let's see how many ones it
has let's just kind of fill it with
ones oh it's not even a buffer oh oh boo
[Music]
boo boo we got to go to a higher level
of abstraction
[Music]
raise the abstraction
[Music]
[Music]
I mean I could just do copy out but then
I get like none of this syntactic sugar
so
whatever throw some deep buff on this
[Music]
bitch you guys really get exposed to my
inner
monologue this is actually what it
sounds like this what I'm thinking what
I'm in my head
with my
shit G
[Music]
typy all right do fucking
zeros zeros
well that one
works that one don't
work bad
AMD bad
AMD but what's crazier is
that I mean okay let's actually make
this I I shouldn't have done it like
this uh device.
compiler how do I get the compiler from
the
device forget how this shit works
I don't actually need that I can just
get that from the device and then we can
try it with the AMD back
end you see the zeros who sees the
zeros delete all that shit
[Music]
that
work device doesn't have program hip
device has no attribute
program you didn't make your attribute
[Music]
program I do like if something like God
I forgot how this shit Works still
called
compiled I really still call it compile
run time
that I can do like Dev
dot
compiler
that all right great now we're
abstracted away from there we go we did
a higher level abstraction I should have
done that to begin with damn my
abstractions are much better now those
are pretty
good programing it takes four positional
arguments but five were given yeah
because don't give it the dev
those are good abstractions all
right we have now reduced it to the
minimum
bullshit what is it name can I get the
name of the device how I get the name I
get the buffer want
buffer let's try it on AMD
now see if it behaves the same way yo
hip you should have this is not cool
all right there it is with AMD just
faster because it doesn't use stupid
hip
H
interesting look at
that it hung for a long time and then
printed that so it's like it's trying
and then
failing interesting
I can also just use device default and
then I can just whatever but okay
uh an AMD bug no way couldn't be an AMD
bug no way because AMD doesn't write
bugs okay how many zeros did we
get uh how do I check that quickly in
numpy big minus one
nonzero so we can figure out exactly how
many I
got all right it did exactly one
megabyte of
ones um can I do this all in one aqual
group let's try to get even simpler with
this oh also let's stump the uh Shader
see if there's anything
[Music]
stupid I don't do that um I can what I
can decompile I have a tool for that
dev. compiler do
disassemble M sec
how nice of my abstractions
guys
okay so where's the
bug uh okay let's Also let's first try
something like this um
[Music]
I know
let's let me Commit
This I'm on the stupid lvm Branch
whatever
[Music]
uh okay don't any of that let's try
something like
[Music]
[Music]
[Music]
okay that
worked what if I put it as the second
one
[Music]
interesting invalid
argument this a lot more reasonable
[Music]
I this is like very standard looking GPU
code right you guys know what this looks
[Music]
like again the killer thing that makes
this whole thing unexcusable this is
this is definitely an AMD book right
there's no question about that now um
it's possible that if we actually query
the thing that uh it tells you that the
launch size can't be that big but still
put in a fucking assert you
know because if I switch to the other
GPU this behaves correctly like that
that's my that's my Ace in the whole
right it's not I don't think I can be
holding it wrong to get that behavior
let's make this
smaller shouldn't have to be this
big so what if I just go
65337 still
broken correct on that
one incorrect on that one okay cool
yeah so this has a max size of
65336 that's the
[Music]
bug I think if I flip these around it's
[Music]
fine yep that's
fine
okay great right
all right let's add shit to my driver to
make it better than
him yeah okay actually let's also see if
this one matters at all so what if I
just go to like four here
okay good that's also wrong what if I go
to one
here you're not allowed to put one as
the First
Dimension I might have complained last
time no okay good so there's there's
your there's your minimal failing
example all right I'm sure there's some
stupid hip way to get this that we
should be checking uh
hip device prop t
[Music]
[Music]
all right we're already getting the
device properties
[Music]
[Music]
useless oh well of course that one
Jesus Max grid size
[Music]
oh
[Music]
[Music]
[Music]
is
[Music]
[Music]
[Music]
[Music]
for
[Music]
all right there you go so there's your
[Music]
max you know I think this actually
copies
inidia look at
that this one also Returns the same Max
yet it works
lot of questions boys lot of questions
so this one Returns the same
thing but it works
be way to get the name
right is it D name I think that works
[Music]
no that's
[Music]
AMD all right you want the fix for this
we have a fix for this I believe cuz I
believe I do it in
Nvidia it's actually in a renderer I
think all right let's try the thing
again
[Music]
have right answer
now so they copied this feature from
Nvidia and they made it actually work
hello how can I assist you today I can
provide entertainment and bullshit
it's pretty good actually on pams that
B's actually
good okay bug
fixed
um all right so it was not a compiler
bug
uh it was
a they silently changed the behavior of
the locals Max to actually be enforced
no like it was fine to query that info
but
like two things about it were like very
broken hip should have
asserted but then why does it work on
the other one wait actually that's sick
though this is a great I mean that's
pretty amazing that it's getting
more this is a 7900
[Music]
XTX um and this is the uh is I to xgx
this is the new one and it's pretty
amazing again in line with AMD having
great hardware and like who wrote that
software who thought this was like a
good
idea um so this gets 72 tokens per
second out of the box this gets 69 okay
let's beam them
[Music]
both give them a minute they're going to
search search for the fastest kernels I
can find I probably could have done jet
beam but doesn't
matter this going to be really slow
because of that no that's
fine use the same Ram they load at
similar speeds
[Music]
okay it needs to I'll push this all off
stream okay so with beam we get it up to
78 oh oh see here's where that guy
really
shines not have just
zero the only difference is which device
I'm
invisible Okay so our AMD backend Works
totally
[Music]
fine I almost wonder because nvidia's
limitation is real and Nvidia actually
has uh the asserts
uh yeah so you see it's it's faster on
this one that that's more like the
disparity I would
expect um yeah it's a little slower than
700 XTX but uh on the non- beamed
thing it's good
how do we feel about this we'll let
we'll let nonsubscribers
talk and let's have a discussion about
how we feel about this
bug like it wasn't difficult to find
where to query but it's nonintuitive
and there should be in
uh I mean there's no a certain AMD to be
fair so it's not like
um it's a big mistake putting non Subs
why they're going to derail me we're
going to get derailed yet 10 minutes
later we're derailed 10 10 minutes 10
minutes later we're back to talking
about why you want to have just gold and
you don't want to have a dual monetary
coinage thing because anytime there's
complexity they're scamming whenever
they make things complex oh but you have
to George really didn't study modern
monetary Theory you guys are fucking CIA
shills well there's not enough money in
circulation to back it all by gold what
are you even talking about money in
circulation what do you think that shit
is well you see there's not enough money
in all the Monopoly sets in all the
world to back it by gold what are you
talking about just make it less gold
that's the real shit whatever how much
ever money there is that's how much
money you get in circulation goal's just
[Laughter]
mispriced yeah we're accusing people of
being CIA
shells all cuz I'm a reverse no you guys
if you believe in the paper money you're
an idiot or you're on the take right one
of two things you're either an idiot or
on the take
yeah I didn't even need chat to the rail
us no no no but the dollars are
worthless hey bitch I said the dollars
are worthless D this is backed by the
whole threat of the US military if you
don't say the dollars are valuable bitch
I'm going to shoot you in the
head is everything okay in here yeah I
mean we're explaining to them how the
that the money is not real and that that
only gold is real money
see yeah no it's okay
how do how do you feel about the
monetary
crisis you know how I
feel do you guys know that I actually
like like people think that she copies
my ideas but I actually just copy my
ideas from her I copy my ideas from him
my Handler gives me my ideas um what do
I think about the monetary Theory modern
monetary Theory you see the valocity of
money is really low most money in US
Dollars doesn't move and just sits there
that's a problem don't tell them that
should read a book called The Great
taking it'll blow your mind more people
will get ideas about starting businesses
where they pass the dollars back and
forth to increase the velocity of money
yes this is one of my PES have you told
him about our new business she's GNA
start a business and he's goingon to
start a business and we'll pay each
other $1 yeah we'll work for each other
yeah because it's um it's scalable
software it's SAS that means we get a 15
to 20x markup on our Revenue and so if
we don't even need a markup we can have
all the revenue we want we'll just pass
the same dollar back and forth over and
over again same same dollar back and
forth infinite Revenue glitch uh
actually no no no no Amanda it's
important we each have a multi-million
dollar company it's important that we
have blockchain technology because if we
were passing the dollars back and forth
using wire transfers it would take a
long time we need the dollars to go back
and forth really fast if we make them go
around velocity of money if we make them
go fast enough maybe it's like one of
those glitches where it just pops up in
both of our accounts frequently enough
yeah yeah yeah talk to you she knows
about talk
to no oh we're going to get tax for each
transfer yeah wow we should go to a a
tax-friendly jurisdiction taxes are just
lowering the velocity of money yeah we
should try to go to a tax friendly
jurisdiction preserve as much of this
New Wealth as we can that's a good point
yeah tax
optimization um but yeah that 15 to 20x
multiple we can both have big businesses
big business think like Sam Alman size
but you know how you know how like even
if you get a really high Venture
valuation you still can't like go to a
bank and get a loan against it like if
my company gets valued by VCS as as like
a hundred million dollar company I can't
say okay I own 30% of it and go get a
loan from an actual bank for like $30
million because they know it's you know
what you could get a loan against what
if you owned $100 million of gold they'd
give you a loan against that right um
they would definitely like to have your
goal that's for sure they would love to
give you a loan against the gold why why
is that in the 30s they took everybody's
gold like no one even remembers this in
the US I'm telling you that there's like
the CIA or some intelligence agency I
they made it illegal look up the US laws
it was illegal to own any gold because I
can't believe everyone bring in their
jewelry they had bring inw I can't
believe there's commenters who are
Shilling for not the gold standard I I
don't understand you you must work for
an intelligence agency it's hard to go
back to the gold standard how do you how
do you we really want to go back to the
it's hard to go back you can't go back
you can't ever go back it's this easy
I'm just going to make a money backed by
gold and but you're not saying return
the US Dollars the US dollar is over
you're never going to fix the US dollar
that thing's inflated to Hell the US
dollar is going to zero
yeah I one of the things I try to like I
think it'd be cool when the US doesn't
make enough steel to make guns to tell
you that the US dollar is valuable it's
going to zero some um crypto treasury
should just buy a bunch of gold and
retroactively back itself in gold and
then just be a properly gold backed
thing yeah find some way
to someone's someone's going to do it
someone's goingon to make currency if
it's backed by gold and everyone's going
to use
it yeah it's just hard for the currency
to have like the hand to reach out to
the actual gold right like what compels
the person that holds the marker for the
piece of gold to actually I mean yeah
there's a crisis with like you need what
you want is like you wanted like like
Switzerland not to cuck out and like do
that Switzerland was the longest back by
gold
currency um and for some reason shifts
are still worth something I don't know
but all it makes is shifts really
expensive when you go to switzland and
try to buy
[Music]
beer yeah
all the money the value of dollar would
be more volatile and less predictable
yeah but it would be
real there's a lot of good thinking
about
um Elite suppression of volatility in
order to um maintain control and that
there's actually a lot more volatility
than gets captured properly in we all
got we all got
poor like like like we all got poor
once the gold shit went away like like
we all got scammed we all got so
scammed Where's My Graph about this
where's my inflation graph I'm just
seeing
demoralization the demoralization is
just beginning but no it's the AMD thing
I don't know where' my where' My Graph
go of
inflation you have to take the integral
that's the key thing
uh no I mean that's
just you gota go you got to go way
back gota go you got to go
back where's my inflation graph this
stuff's even hard to
[Music]
find oh here this is a pretty good one
this is just consumer prices off of the
reliable source known as
Reddit H hm wow everything's pretty
stable backed by
gold some some some dumb fuckery happens
with war the dumb fuckery continues oh
shit why do we even need to back it by
anything anymore to the
Moon by the way you see this you see
this gra see this axis here that's
logarithmic this only goes to 2015 also
I better be crazy now I bet I bet the
line continued like this the this is
logarithmic you are over were paying
like 25x for everything who's making all
the
money where does it all go where does it
all go that's a good
question uh what
happened what prices used to come down
now prices only go to the moon no but
you don't understand modern monetary
consumer prices all the shit's expensive
is that okay are you okay with SH being
expensive here's theck though here's
theck you don't feel so bad about this
because technology like everything
should have been Dirt Cheap by now we
should live in a world of post scarcity
but you all got scammed by fake
money well things charge as much as they
can in order to still have you buy them
and if you're being given a bunch of
fake money then people can charge more
fake money to to um charge you for right
like it's not the actual price of the GS
you see you ever watch Malcolm in the
Middle and Malcolm dates that dumb girl
and she says what if we just made the $1
bill the million dooll bill that
everybody could be millionaires exactly
but we did it with extra steps we did it
with extra
steps
yeah well do they know about The Amanda
Show The Amanda Show The Amanda Show You
Know The Amanda Show I do yeah it exist
yet oh The Amanda Show doesn't exist yet
it'll exist next week oh George is going
to be on it oh whoa whoa whoa whoa let's
not let's not pre-announce
anything how much Aderall does it take
to be you bro I'm in Hong Kong you think
I'm taking
Aderall drugs are for losers they were
right it turns out the Dare guy was
right about drugs you know that's that's
the real that's the real joke on all of
you you know there's the the DARE
officer let's get a picture of a DARE
officer he turned out to be right and
like all your friends were like oh I'm
going to go do iasa in the South
American Woods or morons and he was
right he was right that's a good place
to end the stream thank you everybody we
found a bug and hip today and we got
activities to do this evening so uh I
will see you next week thank you for
watching my stream I really appreciate
most of you except for some of you who I
don't appreciate but you guys are the
minority the 30% of you who are the
problem I don't appreciate but the rest
of you who are not the problem
especially the people who are here to
fix fix the problem we should fix the
problem and the problem is that the
money is fake and everybody's poor
because of it and we can make everybody
Rich if we make the money real okay
thank you for watching the stream bye
WEBVTT
Kind: captions
Language: en
Protoxus: Hello there jgrHI
CMZToTheMax: Good morning!
myaocat: first
kurumuz12: yo you are doing this?
kurumuz12: nicee
shekel_gobblin: TWITCHID
ad5k: was gut
myaocat: yo its geohot!! lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoPLS
un3okapi: are we out of the cloud?
shekel_gobblin: sorry buddy, i'm a no subscriber pesant
nanodanger7: hello hello
Protoxus: White room white shirt. Are you in a mental hospital? jgrYIKES
mh1996mh: any new news?
kurumuz12: im too broke to be a bro :(
myaocat: show us content for make us to subscribe
Protoxus: Tere's already 46
th3_maj0r: yo boyz
Protoxus: There's*
shekel_gobblin: i watch your stream so i can prepare for my comma ai interview
un3okapi: Looks ultra weeb.
Protoxus: shekel_gobblin LUL
k0ntez: are we building flappy bird today
ad5k: electronics district?
thebastl: early christmas
un3okapi: ohhhhh shit
Protoxus: Actual physical hardware PogChamp
thebastl: minecraft stream today
th3_maj0r: what did u buy???
Mua_987410: plz full screen
myaocat: moddded ps4
shekel_gobblin: the journey to comma ai, can't wait mate
kurumuz12: my god
thebastl: quickcharger for handy
MajesticMack: PogChamp
ad5k: what that means
un3okapi: PogChamp
myaocat: what are you going to do with it?
un3okapi: HOLY SHIT IS IT ACtuaLLY HAPPENING?
kurumuz12: you gonna do it all of them?
thebastl: cheated
un3okapi: oh.
blackburn1911: wall
myaocat: we can't see screen
th3_maj0r: wooow, now buy section 2 and we did 2 sections in 1 day
un3okapi: learning PogChamp
thebastl: release early release often
myaocat: go eat basket? wtf
shekel_gobblin: Why did you buy an FPS board, cheating in video games is no fun
thebastl: @tomcr00s3 Collab with strange parts!
myaocat: do you speak japanese?
th3_maj0r: You could buy it on amazon no? why did u wait to go in japan
SonOfSatan: JAPAN? Bro I thought you were in the Cloud! :(
myaocat: can you rap in japanese?
ad5k: is this like nand2tetris
un3okapi: @th3_maj0r because he's multi-cultural
d14rgt: how many hours do you sleep??
kurumuz12: nand to tetris was cool
th3_maj0r: Dude we knew that u was in japan from the first day lol
kurumuz12: I just finished the assembler part tho
myaocat: whats nand2teteis? why is that good?
Protoxus: th3_maj0r No, everyone thought he was in the cloud. We were all fooled, don't deny it!
myaocat: tetris*
myaocat: burn the instructions!!!
kurumuz12: you build your own computer from a nand gate
andanix: beware, xilinx is terrible
un3okapi: is the stream skipping?
SonOfSatan: Buy 1 Get 10 FREE Advertisements
jurodiwy_777: next frame please
blackburn1911: yeah
kurumuz12: It froze for me
robinduckett: stream is frozen
SonOfSatan: Stream is frozen
juniperus1976: stream is broken
myaocat: fuuuxk
blackburn1911: -10mbs
keepingtrckofthisacct: froze
lefse: F
kurumuz12: dont open it without us
SonOfSatan: F
myaocat: japan internet ia down
th3_maj0r: stream is freezinggg George
kurumuz12: F
kurumuz12: japan cloud is ugh
robinduckett: japan internet is better than most
jurodiwy_777: production quality Kreygasm
shekel_gobblin: @tomcr00s3 must be cold in japan, stream is freezing. Leave your computer on overnight so the packets dont freeze your routed
kurumuz12: STREAMISGON
myaocat: so much drops
lefse: sjokolA
andanix: @shekel_gobblin niiice
myaocat: for now rap in japanese lupoSHADE
th3_maj0r: 3 FPS are not bad
robinduckett: count the frames suckaduck
juniperus1976: sound is great... ;-)
myaocat: -1 fps lupoRB
lefse: its so many frames we cant see it update Kappa
robinduckett: sound is fine haha
robinduckett: decrease bitrate
un3okapi: it's ok. Your voice is good enough.
th3_maj0r: it doesn't looks like an internet problem btw
un3okapi: back
robinduckett: let us see the blocks
myaocat: podcast - geohot ! lupoHYPE lupoHYPE
un3okapi: PogChamp
robinduckett: thats all you need in japanese
jurodiwy_777: LUL
Protoxus: Gozaimasu is "very much"
SonOfSatan: Go to the front desk and say "I'm hiding from FBI, I need good bandwidth to stream USA secrets"
myaocat: maybe don't stream in 1080p?
th3_maj0r: @SonOfSatan ahahahaah
lefse: decrease the bitrate
th3_maj0r: yeah try to stream in 720@30fps
myaocat: 720p- 480p is good
Protoxus: myaocat Here on this stream we don't compromize on quality.
myaocat: @protoxus what do you mean?
MugiChan: finally we dont stuck in 1080p
th3_maj0r: oh yeah 720 works great
robinduckett: in japan the mcdonalds staff all know english because they're from india
SonOfSatan: Fujitsu
robinduckett: perfect
myaocat: maybe restream. i think fixing bit rate while streaming is doing some problems
un3okapi: you can't compromise anything if the stream isn't working. @Protoxus :c
Protoxus: myaocat I'm only kidding. But 1080p 3FPS is better than 720p 60fps BrokeBack
kurumuz12: and gone
keepingtrckofthisacct: all good
th3_maj0r: ahahahaahah super freeze during speedtest
myaocat: nice fix
ad5k: heavy throttle
SonOfSatan: lol 0.4Mb haha
keepingtrckofthisacct: nope. talked to fast
myaocat: call japan support
myaocat: watching in 1p
amaramee1: almost bad as my life 😂
Protoxus: Who's DDoS'ing the stream?! Who of you did it?! Keepo
robinduckett: i had better on 4G in japan, cost me £150 for an hour but was like 60/60
MugiChan: lmao
th3_maj0r: wow I thought in italy we have the worst internet, but JAPAN.....wow
myaocat: haha 0.5mb upload
shekel_gobblin: flappybird ai gang is running a ddos
myaocat: i think steeaming from toaster would be better
th3_maj0r: now is fine
ad5k: improving for me
Protoxus: Better now.
keepingtrckofthisacct: is now
almonte550: better now
th3_maj0r: just put the stream in 720p from twitch multiqualioty
robinduckett: tcp/ip over pidgeon
MugiChan: much better now
un3okapi: it's good.
myaocat: try steaming from the toaster
SonOfSatan: is gud
robinduckett: good now
robinduckett: can hear you fine
lefse: Hack the neighbours toaster and stream from it
shekel_gobblin: Stream is fixed, but no flappybird content isnt fixed
robinduckett: chat is slow
Zealeigh: Pizza
myaocat: lupoYE lupoYE lupoYE lupoYE
SonOfSatan: your gettng the chat in a 20 minutes delay
th3_maj0r: now we have a lot of delay but ok
MugiChan: you go to convenience store to buy more tea?
un3okapi: pizza
un3okapi: ....
Protoxus: DOMINUS
almonte550: pizza time
Protoxus: Domino's*
ZABITAMEMURU: I love you geo &lt;3
keepingtrckofthisacct: finished the paper
SonOfSatan: picked up some cute asian chick?
myaocat: please continue
robinduckett: ham and cheese sandwhich from the 7/11
blackburn1911: slow is slow
MugiChan: hey, have you continue to eat your apple ?
th3_maj0r: Come to italy to try the real pizza
myaocat: you was in fpga board that you cheated
Protoxus: I mean... You finished the apple like a good healthy individual... jgrYIKES
joker2k999: U hate sign in bro
ad5k: admin : admin
almonte550: sign in to si a documentation
myaocat: watching in 380p
almonte550: see*
am4rtens: what do you do with the board ? :D
myaocat: using mobile data lupoRIP
SonOfSatan: check if they do the login verification client side
ad5k: how much was the board?
josephskilton: bugmenot?
robinduckett: are you recording? upload to pootube later?
ZABITAMEMURU: What is Xilinx? a minified fbga board like arduino?
Stancione: hello hello :D
keepingtrckofthisacct: i use '...' everywhere
myaocat: fpga*
ad5k: Password
joker2k999: Lol. Gotcha
robinduckett: Password1!
almonte550: registering is so annoying
th3_maj0r: LOL
robinduckett: yay
chorbo123: george pls play LoL again
myaocat: now rip all the docs
ZABITAMEMURU: play pubg :D
lefse: Leaked credit card number Kappa
MugiChan: why ctf creator dont want their shit to stream on?
joker2k999: What is this card?
SonOfSatan: credit card number leaked lol
robinduckett: brb
chorbo123: what is he working on
persen: LUL
un3okapi: no you didn't
chorbo123: yea already bought some stuff
myaocat: @shekel_gobblin its fpga
MugiChan: LMAO
chorbo123: thanks george
Stancione: ban or timeout :)) ?
myaocat: hehehehhe banned
SonOfSatan: LMAO
keepingtrckofthisacct: no, u didn't
am4rtens: xDDD
myaocat: lupoTHINK lupoTHINK lupoTHINK lupoTHINK
TerryGi: noo the shekel goblin Cx
joker2k999: Lol
myaocat: lupoBOT lupoBOT lupoBOT lupoBOT
keepingtrckofthisacct: is the moderator in today?
persen: wash hands
myaocat: going to get some weed
joker2k999: Savage mods
Stancione: @keepingtrckofthisacct here bro :)
un3okapi: woah there's a mod here :o
almonte550: wash your hands geo pls!
joker2k999: Yea it's new
th3_maj0r: Stancione where are u from?
chorbo123: I wanna see you play LoL again man
am4rtens: wires ftw
chorbo123: its fun to watch
keepingtrckofthisacct: @Stancione let's role up the sleeve...get ready
th3_maj0r: this "fromthetransistor" looks really cool btw
MugiChan: hacking the Xilinx bois
Stancione: @th3_maj0r from the cloud :)
kurumuz12: your webcam is so big
th3_maj0r: @Stancione xD
keiran_o: @tomcr00s3 You should do a stream where u attempt to make your own crypto, just for show.
un3okapi: this is uncomfortable.
myaocat: @kurumuz12 its in settinfa
MugiChan: asmr stream
am4rtens: gotta love i/o
joker2k999: Too intimate
th3_maj0r: Btw i figured out how to use pypy with pip and I lost vs AI :-?(
myaocat: lupoRABITE
joker2k999: And very aggressive at he same time
keepingtrckofthisacct: why is he whispering?
Protoxus: When he whispers the name of components to you Kreygasm
Protoxus: names*
am4rtens: asmr xDD
Hrudu: @tomcr00s3 geohoot !!!! SwiftRage
lefse: Kreygasm
myaocat: lupoWAT lupoWAT lupoWAT lupoWAT
almonte550: so whats is section 2 about
almonte550: ?
Hrudu: how was the domino's Keepo
keiran_o: make ur own crypto or riot
chorbo123: was the first on youtube?
am4rtens: thats right :D
myaocat: internet sucks
MugiChan: how does it feel to win defcon?
joker2k999: What are we doing? What's the project?
JSPeterson: what kind of timezone are you on there it's almost like Europe
tomcr00s3: https://github.com/geohot/fromthetransistor
th3_maj0r: Btw i figured out how to use pypy with pip ian
Hrudu: no more apples please Keepo
Protoxus: You're welcome, everyone. https://clips.twitch.tv/BitterDifficultLampTBTacoRight
Protoxus: Keepo
th3_maj0r: ops rewrote for error
joker2k999: Oh cool
myaocat: watch program is like: while [ true ] command sleep 2
Hrudu: @myaocat cmonBruh
myaocat: thats watch program in linux
Hrudu: geohot let's play fortnite 4Head
MDlegend00: Hi
joker2k999: Yup
chorbo123: where is he by the way
myaocat: in japan
SonOfSatan: @Hrudu if you're gonna recommend a game you might as well go with some actually good... like minecraft
Hrudu: @SonOfSatan i like you Keepo
Protoxus: SonOfSatan Second to chess, the best game of all time is Castlevania: Aria of Sorrow for the Gameboy Advance. No contest.
myaocat: @protoxus i think factorio game wins
elkiller13z0mb: Are you a video gamephobe?
chorbo123: did you watch castlevania on netflix?
tribegvng: yo
shekel_gobblin: @tomcr00s3 did the crime, served the time at least. Im back baby. Omae wa Mou Shindeiru no hard feelings 🙠👈🠼👈🠼
Protoxus: chorbo123 I did not. Is it any good?
chorbo123: yea i like it
TerryGi: f?
Hrudu: yo TriHard
ESpicker666: Ð’Ñ ÐµÐ¼ здарова
chorbo123: i like that they have backstories for all characters
ESpicker666: как оно ?
진ì&nbsp;•í•œëª¨í”¼ì–´ìŠ¤: KonCha
Hrudu: don't reboot us BabyRage
myaocat: if you have a VM i think you can play with the device there
hugo_kanazaca: you need to read the license man
chorbo123: PogChamp
ad5k: yikes
MugiChan: are the boys working in comma office right now?
Protoxus: I kind of want to make a Geohot sub badge. If I did and it wasn't shitty, would you go through the effort of uploading it?
Hrudu: make an Apple emote Keepo
Hrudu: or a pizza domino's one Keepo
Protoxus: Hrudu Actually he should just use the Domino's logo. LUL
Hrudu: true Keepo
smoothatprogramming: what's up bros, another day another stream. was your interview at Google hard?
keiran_o: george make your own crypto
dabloobo: if the programmer you were using didnt have drivers for your os, could you run a linux vm and passthrough usb to program the board?
JSPeterson: Why do you do the face cam
tribegvng: i didnt know i can stream twitch through vlc
chorbo123: how
tribegvng: just copy the url
joker2k999: good ole' digitools
chorbo123: no reboot feelsgoodman
Kemal_Ice: What do you think of reinforcement learning for self driving cars
joker2k999: no tmux bashing bro
joker2k999: lol
joker2k999: maybe if it was all green
SonOfSatan: HACKERBOI
진ì&nbsp;•í•œëª¨í”¼ì–´ìŠ¤: D:
MugiChan: 1337 geohot the hacker boi
joker2k999: LOL
keiran_o: MAKE UR OWN CRYPTO
ad5k: lmao
myaocat: add it to rules anf when e
solipsism: jesus i think this is top 5 worst chats ive ever seen
myaocat: you can add rules to chat without saying it Everytime
th3_maj0r: Stole their work off stream and Win
ad5k: need nightbot on here
th3_maj0r: steal**
Rxcheta: ive finally caught you live! hi everyone
keepingtrckofthisacct: ...pssst, hey moderator?
keiran_o: oi george make ur own crypto boss man
JSPeterson: Why don't you do emus and games much more fun
joker2k999: i think i use to use xilinux for key recording a long time ago
myaocat: if youre in japan I think japanese docs are better than english
chorbo123: maybe watch some anime while in japan george
Stancione: :)) no kills, just smack with the back of the gun
joker2k999: aren't they all small
keepingtrckofthisacct: @Stancione ^,,,twice
Stancione: @newtomcroose chill bro :)
shekel_gobblin: Finally unbanned. Dear @tomcr00s3, I've made a severe and continuous lapse in my judgement and I don't expect to be forgiven. I'm simply here to apologize. So what we came across that day on the woods was obviously unplanned and the reactions you saw on tape were raw, they were unfiltered. None of us knew how to react or how to feel. I should have never posted the video. I wont talk about comma or at least statements again. Much love x
joker2k999: is it cheaper?
myaocat: @shekel_gobblin what did you post?
joker2k999: yea, no company talk here bro
MugiChan: lmao
un3okapi: @shekel_gobblin incredible
GUSTOM_180: heyy
joker2k999: LOL
TerryGi: shekel_gobblin Cx
th3_maj0r: ahahahaha
myaocat: lupoNERD lupoNERD lupoNERD lupoNERD
shekel_gobblin: Did he F?
Cs_nothing: another browser switch?? NotLikeThis
TerryGi: F
Dany4k: f
TerryGi: scuffed internet
joker2k999: 5/10
ad5k: f
brobaa: f
shekel_gobblin: @terrygi cx
solipsism: im at like 2fps
JSPeterson: so are we doing emus later. you know virtual machines. that's a good puzzle
myaocat: f
Cs_nothing: F
ad5k: refreshed now we byke
Protoxus: JSPeterson "Emulators are boring" - Geohot, yesterday
chorbo123: youre camera lagged 😢
chorbo123: your*
myaocat: Its out of sync
JSPeterson: the software CPU?
smoothatprogramming: Will you give us a weekly coding challenge?
JSPeterson: no they are fun protoxus
Cs_nothing: it actually did lag, can vouch too
shekel_gobblin: I had to refresh, he is back now
Rxcheta: cpu usage, nothing to do with internet
smoothatprogramming: that CPU sounds like a Boeing 787
ad5k: rainymood
shekel_gobblin: get to the chopper
JSPeterson: it's fun to code on Emus
newjeff12345: I'm coming home I'm coming home Tell the world I'm coming home Let the rain wash away all the pain of yesterday I know my kingdom awaits and they've forgiven my mistakes I'm coming home, I'm coming home Tell the world that I'm coming
JSPeterson: like in devkitpro
myaocat: lol
Dany4k: Ready to take off
JSPeterson: the 3 DS hack was awesome
chorbo123: your computer's taking off
newjeff12345: @tomcr00s3 what is your comment about cryptokitties ?
shekel_gobblin: he's got the new google maps world open in a new tab
JSPeterson: so many pointers it blew my mind
myaocat: @shekel_gobblin what did you upload?
newjeff12345: @tomcr00s3 what is your comment about cryptokitties ?
JSPeterson: I think there may be an open library for PS3 now too. open devkit
chorbo123: it was the logan paul apology
chorbo123: he copied it
shekel_gobblin: @myaocat a video watching george read a paper
newjeff12345: George Hotz living in iran now ?
solipsism: what happened to old jeff? @newjeff12345
newjeff12345: @solipsism he dead :(
JSPeterson: at least write some Homebrew for the good PS3 for Good Old times sakes
chorbo123: my name jeff
newjeff12345: my name is jeff too
un3okapi: same here
newjeff12345: Hello , my name is jeff
un3okapi: i'm jeff
newjeff12345: guys . George Hotz living in iran now ?
solipsism: jeff convergence
solipsism: george hotz does not live in Iran
chorbo123: he's in japan
ad5k: new jeff are you newtomcroose
newjeff12345: japan ? :|
newjeff12345: @ad5k no . im new jeff
shekel_gobblin: geo whatz he gonna program today?
JSPeterson: I'm going to start streaming my emu coding and I will get ector in on it too
solipsism: lmfao
JSPeterson: and fires
DazPlay1337: :)
un3okapi: @shekel_gobblin he's playing around with a fpga
newjeff12345: george . can u buy stuffs in japan with paypal ?
shekel_gobblin: i have no idea what a fpga is, you fps, csgo?
shekel_gobblin: you mean*
ad5k: field programmable gate array @shekel_gobblin
un3okapi: @shekel_gobblin yes and call of duty black ops four
newjeff12345: play fortnite ? after work ?
JSPeterson: okay I'm going to a machine learning course in Copenhagen now
JSPeterson: lab class let's see what they got
solipsism: this chat is amazing its like 1/5th nerds and 4/5ths people who jailbroke an iphone once
myaocat: why arent you in science &amp; technology channel so people can discover you?
newjeff12345: im not a nerd :| im a geek
shekel_gobblin: @adk5, ah i know what a field program farm gates are, need to look up gate arrays tho.
andanix: @tomcr00s3 hey geo, i am new to mac, switched from linux, can you recommend a good terminal?
almonte550: geeks rules
solipsism: iterm2 is good andanix
blackburn1911: iTerm
chorbo123: i just wanna see george play LoL again
un3okapi: @solipsism are you in the 1/5th or the 4/5th
newjeff12345: @andanix normal terminal   tmux :|
solipsism: @un3okapi both
un3okapi: @solipsism nice.
newjeff12345: tools are not matter
newjeff12345: tools made for nobs :D ? :))
andanix: alright, thx guys
newjeff12345: no , u should bannn :|
blackburn1911: I write my code on paper
shekel_gobblin: i use google docs with tabs
almonte550: I write my code on my mind
almonte550: and compile it with my soul
JSPeterson: anyone else here in Denmark Sweden 🇸🇪🇩🇰
chorbo123: i write code in stones
solipsism: i wish JSPeterson
LucasLarsson00: sweden &lt;-- :D
JSPeterson: where
newjeff12345: George is racist :| he care just about subscribers :|
solipsism: :I
almonte550: stars &gt; no stars
newjeff12345: Listen to i'm not racist by Joyner Lucas
JSPeterson: Luccas where you at
newjeff12345: @tomcr00s3 listen tp i'm not racist by Joyner Lucas
LucasLarsson00: Stockholm sweden :p
shekel_gobblin: i don't need to sub, i'm already apart of the twitchies gang
joker2k999: rant#1?
un3okapi: hot take from hotz
joker2k999: LMAO
kurumuz12: anybody has money*
DazPlay1337: lmao
JSPeterson: I was born to be a star
chorbo123: george play some music
joker2k999: i thought we said no politics
shekel_gobblin: WEIRD FLEX @robinduckett, but okay
newjeff12345: George is a scammer . and he is rich . i dont like scam . twitch is scam
ad5k: pay pigs
robinduckett: I tried to send Bits but it just keeps "connecting..." instead of taking me to the payment system
chorbo123: play some musiccccc
kurumuz12: I'm not poor tho, just student life :D
solipsism: this is amazing
kurumuz12: okay this is epic
Protoxus: newjeff12345 That one's pretty shitty
JSPeterson: Emo music I'm out of here this is getting gay
kurumuz12: how about coding a emulator in fpga?
kurumuz12: lol
Protoxus: Best Japanese band is Man On A Mission, change my mind.
shekel_gobblin: @tomcr00s3 i might sub if you can touch your elbows together behind your back PurpleStar PurpleStar PurpleStar
robinduckett: One day youtube recommended me building a SLAM recorded stream and I spent the next three days watching the prerecorded stream and I'm here now. I can flex harder @shekel_gobblin
JSPeterson: I have to mute This is horrendous
ad5k: lol never thought id agree with jordan peterson
kurumuz12: About what
th3_maj0r: https://soundcloud.com/tomcr00se THIS PLS
chorbo123: what is this song!?!?!
Kemal_Ice: Isn’t that discrimination ?
ad5k: decent
un3okapi: good
almonte550: the sound quality is pretty good
kurumuz12: play some rap
andanix: sound is fine
joker2k999: no binaural beats?
chorbo123: good
kurumuz12: @newjeff12345 you are shitty
jisaku: rip the frames
paulierco: I like this music, i have a star, i have priority
Stancione: @newjeff12345 @kurumuz12 chill guys :)
un3okapi: @kurumuz12 that's not nice
kurumuz12: wut
kurumuz12: Ok whatever
paulierco: PopCorn
almonte550: @kurumuz12 is acting like he have a star
ad5k: this chat lmao
Wireballz: @tomcr00s3 Sup
shekel_gobblin: I watch @tomcr00s3 for his raps, he is like a scuffed version of watsky
chorbo123: is this the song you listen to when you smoke weed george
kurumuz12: newjeff said that george's rap is sh1t without having a star
joker2k999: The purge 3: TwitchChat
kurumuz12: what about that
paul7115: when will you be back to murica?
robinduckett: cheer100
shekel_gobblin: flexing
robinduckett: cheer100 cheer100 cheer100 cheer100 cheer100 cheer100 cheer100 cheer100 cheer100
robinduckett: That's flexing
shekel_gobblin: that's nothing
robinduckett: &lt;3
shekel_gobblin: Lol
shekel_gobblin: imma drop 1000 in a sec
robinduckett: do it
shekel_gobblin: you wouldnt
smoothatprogramming: is robinduckett basically making it rain right now?
ad5k: arbitrage
robinduckett: I just did
robinduckett: 100 * 10 = 1000
robinduckett: quick maths
shekel_gobblin: do it again if your that good, i doubt you would
aminuuux: that is savage
smoothatprogramming: just tell them they will go to hell if they don't watch ads and it will work
aminuuux: lol
jisaku: worked for l ron hubbard
jurodiwy_777: SourPls
ad5k: about 1100 years ago
chorbo123: count me in
persen: retro wave PogChamp
chorbo123: im your first ad watcher
robinduckett: There you go
ad5k: benevolence
un3okapi: @robinduckett Kappa /
robinduckett: He was goading me
robinduckett: &lt;3
robinduckett: so I gave him a sub
Protoxus: Well BitTube is kind of like that. everyone gets paid. Content creators and viewers. jgrThink
shekel_gobblin: does that mean i have a sub?
robinduckett: whether he likes it or not
robinduckett: It does &lt;3
almonte550: @robinduckett making it rain!
smoothatprogramming: will you explain what these boards are? I am trying to figure out. are they similar to an arduino?
robinduckett: $17 well spent
th3_maj0r: Really well! For sure!
joker2k999: cool. you wrote 'from the transistor to web' 2 years ago? cool man
almonte550: how much does that board cost?
ad5k: 121.5 aud for my aussies
robinduckett: brb
shekel_gobblin: test
joker2k999: aussies pay more for every damn thing
ad5k: dat shipping
Protoxus: joker2k999 Because of import costs?
shekel_gobblin: cheers @robinduckett now i gained my star
joker2k999: free stuff is like 20 bucks over there
th3_maj0r: Did u saw that people wrote articles bcz u said that bitcoin cash are the real bitcoin?? Wtf ahah
shekel_gobblin: @robinduckett just paid for my sub to my boy george, thanks legend
Protoxus: th3_maj0r I'd like to read that. Sounds like fun.
un3okapi: chilling is fine.
joker2k999: damn your right. 12 wks. you've put some thought into this...
joker2k999: im all the way chill bro
th3_maj0r: @Protoxus google "geohot real bitcoin" u will find differents articles about that easy
Retnuh1337: I just got in here, what course is 12weeks?
Protoxus: th3_maj0r Thanks
joker2k999: the 'from the transistor' paper on his github..
almonte550: @Retnuh1337 https://github.com/geohot/fromthetransistor this course
Retnuh1337: thanks @almonte550
ad5k: bye jeff
almonte550: @Retnuh1337 he is in section 2 of the course right now
smoothatprogramming: see you later jeff
Stancione: lol @newjeff12345
Retnuh1337: thanks a lot @almonte550 I appreciate it
smoothatprogramming: where is section 1?
th3_maj0r: section 1 is buying the board xD
Protoxus: th3_maj0r Well obviously bitcoin.com has one since Roger Ver is pushing for people to use BCH. :P
joker2k999: i think he's just setting everything up
shekel_gobblin: no love for my sub @tomcr00s3 :(
joker2k999: researching the hardware
shekel_gobblin: weak bait @newjeff12345
almonte550: what are the benefits of just being hating ?
joker2k999: arduino board?
newjeff12345: George Francis Hotz i will sue you , in the court
th3_maj0r: @Protoxus yeah but also reddit and tokentops.com have articles
shekel_gobblin: mod me please
Rither: mod giveaways Kappa
alexlucas_: ill be a mod
jisaku: congrats
alexlucas_: if u want
Retnuh1337: haha congrats @joker2k999
shekel_gobblin: i won't let you down geogeo
joker2k999: LOL
shekel_gobblin: im a sub tho
solipsism: amazing
Vigilant_TV: what about me
joker2k999: All the way up!
un3okapi: what
Jok4ndre: congrats
Protoxus: Shekel for mod
Rither: You can trust everyone. Noone would just come on the internet and tell lies
Stancione: mod squad, let's gooo :D
Protoxus: jgrTARD
un3okapi: only stared people are mods
Retnuh1337: LOL
almonte550: congrats!
shekel_gobblin: @Protoxus yeah everyone, shekel for mod
joker2k999: and talking about [company]
Retnuh1337: wait, you in Japan?
almonte550: hating poor people is my philosophy of life
Protoxus: Retnuh1337 YEs
un3okapi: and pizza. Apparently people also eat that in japan....
Retnuh1337: okay thanks
almonte550: that's why I hate myself
Retnuh1337: LOL
slimydude: almonte550 OpieOP
Protoxus: un3okapi PJSalt ?
un3okapi: @Protoxus no salt.
Protoxus: PJSugar
Protoxus: FeelsGoodMan
joker2k999: yea my arduino is a mega 2560
robinduckett: I reported him
joker2k999: LOL. i knew it.
joker2k999: Love pizza bro
TheTallpants: What weeb shit have you bought so far
shekel_gobblin: @tomcr00s3 you should stream yourself creating a transparent twitch chat overlay for your desktop, similar to periscope's chat for your desktop. people wanna see their messages on your screen, and it adds context to the replays you put on youtube
shekel_gobblin: star is my shield bro
th3_maj0r: @shekel_gobblin on youtube u can find twtch chat by using subtitles
Protoxus: shekel_gobblin Like Captain America, I guess
un3okapi: wait if I have a star, can I spread anti star propaganda?
ad5k: no star is playing on hard mode
shekel_gobblin: animal farm: money buys your a ban shield
alexlucas_: xD
CrankyOW: lol he is back
TheTallpants: @jeffwillsueyougeohot be a better troll
ad5k: lol its the same dude as newtomcroose
almonte550: @shekel_gobblin test your boudaries man
smoothatprogramming: lol
th3_maj0r: This guy jeff has so much time to spend....
ad5k: he makes the same spelling errors
joker2k999: lol
smoothatprogramming: the donald trump of wtich (;
yagurastation: awesome topic, hope this lands on YouTube, have to miss this one RuleFive
Stancione: he's just wasting his time instead of trying to learn something from this stream
Rxcheta: I'm no longer poor thanks to your advice geo
shekel_gobblin: @th3_maj0r yeah but it's awkward
TheTastefulToastie: @tomcr00s3 not in the cloud today?
Rither: Why are you in Japan?
Retnuh1337: ^
Protoxus: Rither Why not?
th3_maj0r: @shekel_gobblin yeah i know, was just for telling u, maybe u doens't know. Probably he doesn't want to spend time in things like that btw
joker2k999: true. Japan is legit
robinduckett: I went to japan for a week on business, had a tour of the toshiba factory, it was well wierd, never left the UK before that
Retnuh1337: I was curious too, was it work, deals on upcoming products
th3_maj0r: didnt'*** mny grammar today is so bad sry
Dany4k: Would you recommend a Mac over a Windows computer to program?
TheTallpants: Considering how much we're talking about him he's having an effect all right
joker2k999: lol! why he gotta lisp tho
shekel_gobblin: @th3_maj0r yeah true
Retnuh1337: LOL COD
jurodiwy_777: LUL
Protoxus: Dany4k Does it matter? Code is code
joker2k999: LMAO
th3_maj0r: Aahahahahh
Dany4k: @Protoxus just curious as I see lots of programmers using Apple computers.
shekel_gobblin: @Dany4k yeah, it's because they are affordable
un3okapi: @Dany4k linux computers are also fine. xps 13 dev edition is good
un3okapi: @Dany4k more affordable at least
Protoxus: Dany4k Well, I guess some people like their systems unix-based. That's the only difference I think is mentionworthy jgrThink
joker2k999: linux over everything if you can't afford a mac, but its an investment
Rxcheta: RochetaynjPGsoyPA7xuf8QjD23c
robinduckett: I use a Dell XPS with Ubuntu 18.10
joker2k999: w/ mac you just net code into your linux env
robinduckett: But I'm mainly a Node.js dev
Dany4k: I bought like a 900$ Dell with decent specs, with that price I only get like lower end Mac air so.
shekel_gobblin: app.get(
TheTastefulToastie: if you want to make IOS apps you will need a mac, that's the main consideration IMO
robinduckett: @TheTastefulToastie aye but you can use React Native and use a service to compile on a Mac
shekel_gobblin: ^
alexlucas_: ^
TheTastefulToastie: which means you still need a mac
TheTallpants: You look like low budget Kurt Cobain in your GitHub profile picture
shekel_gobblin: just get a mac mini then
shekel_gobblin: the old ones on ebay
superdorage: Or you can hackintosh it with lower budget
almonte550: what about hackintoch?
shekel_gobblin: if you can be bothered lmao
robinduckett: hassle of hackintosh &gt; saving up for a mac
superdorage: True
superdorage: Lol
robinduckett: I was a bit annoyed I couldn't get business financing with Apple in the UK but doesn't matter
robinduckett: Just have to wait a couple months
alexlucas_: you can^
twogirls1mike: can we program that thing to delete every and all TikTok Ads on the internet?
robinduckett: Yeah but you have to ring up and deal with Barclays / Paypal, and I just wanted to order off the website
alexlucas_: well not with apple directly *
robinduckett: In 2008 you could just get financing directly on the site
almonte550: @tomcr00s3 what are you trying to do with git?
alexlucas_: You looked at hardsoft
robinduckett: brb again
shekel_gobblin: tbh i would be out for beers if it was my last night in japan, you know what they say, spend all the money you make, who needs to save
twogirls1mike: is this music on spotify?
superdorage: Is he not visiting the city of Seoul?
almonte550: @shekel_gobblin that's what poor people say
robinduckett: save some money for later but don't save too much because you'll end up 45 and realising you've never lived
joker2k999: this reminds me of my digital logic class
shekel_gobblin: yeah don't save anything and wait for an mvp like @robinduckett to come along and pay for your ticket to the sub gang
ad5k: lol
almonte550: @robinduckett you need to find the balance between saving and living
joker2k999: LOL
robinduckett: @almonte550 Getting there myself, 31 now, save a lot more than I did when I was 21
joker2k999: BALLIN'
jisaku: always a good sign
robinduckett: kids and family to consider, everyone needs support sometimes
joker2k999: in my jim jones voice
joker2k999: rant #2?
robinduckett: "Craft beer" - New way to extract money from people. It's just flavoured beer.
superdorage: Hes laptop fan sounds pretty flying
almonte550: @superdorage I thought it was the music LOL
TheTastefulToastie: for me it's this thing called "red bull"
TheTastefulToastie: need to spend less on red bull
superdorage: Lol
joker2k999: i still have linux on my ps(three)... i know we don't talk about that here
robinduckett: They do unbranded energy drink at Tesco in the UK for &lt; 50p per can, tastes almost exactly the same
shekel_gobblin: Question for Chat: If you had $1000 that you need to spend (no saving), what do you buy?
MugiChan: ã‚¸ãƒ§ãƒ¼ã‚¸ã •ã‚“ã€ æ—¥æœ¬å¥½ã  ã §ã ™ã ‹ï¼Ÿ
robinduckett: Coffee is better for you and has more caffeine, you can get Taurine and Guarna capsules if you are that caffeine adapted that you need more
un3okapi: 200 gifted subscribe for george's channel obviously
almonte550: @shekel_gobblin I subscribe to this channel for sure!
un3okapi: subscription*
robinduckett: @shekel_gobblin: Prusa i3 MK3 / MM
Roundlay: naysay2SITREP
konr4d_: song?
superdorage: I would buy my appreciation with that grand
joker2k999: i was just about to ask that
xEazy_E: good morning. how's the cloud?
shekel_gobblin: id buy a winrar license first tbh
robinduckett: 7zip is better
almonte550: @shekel_gobblin 7zip &gt; winrar
Stancione: @xEazy_E morning man :)
superdorage: Let me know if you need my bnk acct no.
superdorage: Lol
robinduckett: big "Obsolete" sign is a reg flag lol
superdorage: Jus kidding bruh
robinduckett: On the previous page
shekel_gobblin: !songrequest TWICE "LIKEY" M/V
joker2k999: i thought obsolete was fine for research
superdorage: The music tells hes in Japan
robinduckett: 2y ago
Rxcheta: small world
Retnuh1337: that's cool
almonte550: What a small world
shekel_gobblin: @tomcr00s3 no comma talk in this stream thanks
miladbazisaz: Hi
joker2k999: i was just about to mention that
robinduckett: @shekel_gobblin why not?
shekel_gobblin: rules are rules
almonte550: @robinduckett rules
shekel_gobblin: mod me
robinduckett: Is there a rules list somewhere or am I missing something
shekel_gobblin: if you watch the stream long enough, you pick up on them
miladbazisaz: why show me dark screen ? is this live ?
miladbazisaz: somebody tell me
joker2k999: try refresh
almonte550: refresh
robinduckett: atmel is what they use in 3d printer boards, 8bit mostly
shekel_gobblin: some of the rules are no comma talk, journey over destination talk, one bite of the pizza only to rate
superdorage: Iphone jailbreak 2.0 comming any soon?
robinduckett: *knows nothing about FPGA*
joker2k999: Yo what is this playlist? I rocks w/ it
robinduckett: lol when is ps3 jailbrake coming
un3okapi: Wait why did everyone say "small world"? I brb and missed it. : (
ad5k: no sony talk
shekel_gobblin: ^
robinduckett: (I was being sarcastic but ok)
ad5k: mb
un3okapi: @newtomcroose2 LUL
joker2k999: LOL
un3okapi: he's not going to stop
un3okapi: it looks like
shekel_gobblin: you can only talk about: 1. How you're a sub an others aren't, 2. How you're not a sub but want to be. 3. How you spend rather than save and thats why you're poor
Stancione: I'll ban him every time , no probs :)
almonte550: @tomcr00s3 when geohot.com will receive an update?
almonte550: it's about time
joker2k999: let him be, he's a fan.
shekel_gobblin: holy open screens batman
Stancione: he'll have to watch the stream and not write at all :))
hampagang: hi buddy
shekel_gobblin: @Stancione what happened to the original stan
joker2k999: yea trying to work and watch this stream does not bode well
Stancione: @shekel_gobblin chillin' with Em I think :D
shekel_gobblin: PogChamp
superdorage: Lol
MugiChan: lmao
ad5k: who are these people
joker2k999: lol. mods(some) are savage...
almonte550: when geohot.com will receive an update?
ibimsmarry: any particular reason u are using a mac?
shekel_gobblin: i think that's the first time i saw george use () with print the first time
TheTastefulToastie: ^ I wait with baited breath each time xD
un3okapi: write our own :D
robinduckett: bit of foil
oracle3001: Xilinx - that’s a programmable logic device right?
joker2k999: shorter?
robinduckett: What country?
un3okapi: it's taiwan
joker2k999: damn...
MugiChan: yo, i found a sick track called It Was Called The Cold War Because Russia Is Cold
almonte550: india?
shekel_gobblin: I, skekel_gobblin, use my monthly vote as a subbie on george using streamlabs with donation (tts overlay) for his streams from now on. everyone vote below this
superdorage: Korea
Ropat: North Korea Kappa
Ropat: staiyLos staiyLos
superdorage: The fastest
un3okapi: it's taiwan, I got the inside scoops.
almonte550: Africa?
joker2k999: the ole' country
Retnuh1337: What country? Do tell
BoxDirty: how was the pizza off stream yesterday night? @tomcr00s3
almonte550: Haiti?
robinduckett: lol segfault
superdorage: Come to Korea and join nomad coders
shekel_gobblin: @tomcr00s3 can you use streamlabs obs to stream. enable tts so people can pay to have a chat message appear on screen @tomcr00s3
superdorage: We have great pizzas
robinduckett: Come to the UK we steal all nation's cuisine
th3_maj0r: wtf come in italy. We have great Pizza LOL
un3okapi: @superdorage isn't korea expensive?
almonte550: It's better if it have fast internet
robinduckett: I read that as "Isn't korea explosive" haha
superdorage: @un3okapi compare to which country?
un3okapi: @robinduckett ANELE
shekel_gobblin: no seriously, every other streamer does it
robinduckett: :D
ad5k: lol
superdorage: @th3_maj0r lol
joker2k999: LuL
shekel_gobblin: im rich boii
un3okapi: @superdorage idk compared to countries nomads tend to visit, like thailand.
joker2k999: savages here i swear.
davidb881: why not using assembly
Crannigan: whattup guys
superdorage: @un3okapi yeah it is but quite affordable like japan
almonte550: why not using machine code
shekel_gobblin: george is leaving all that $$ on the table without streamlabs. the old george would have done it &lt;3
un3okapi: @superdorage gotcha. c:
robinduckett: I'm getting more anti materialistic as I get older
superdorage: Minimalism?
un3okapi: @robinduckett good for you!
robinduckett: haha
shekel_gobblin: if you want to be like me
shekel_gobblin: talk shit in chat until someone buys you a star
shekel_gobblin: so you have voting rights
nanodanger7: who is your longest time subscriber?
Crannigan: same @robinduckett
Stancione: @shekel_gobblin or until you have a star and get a timeout :)
sfmoose: Ioreg-p IOUSB -l -w 0
un3okapi: you know what else can bring you hours of entertainment? A fidget spinner.
un3okapi: Get one george
almonte550: @shekel_gobblin great strategy
robinduckett: Did you get Sukiyaki yet?
sfmoose: ioreg gives you more usb info
robinduckett: It's lush
shekel_gobblin: ey i've been in hell before, i can survive the timeout
robinduckett: Almost as good as Katsu Curry, almost.
shekel_gobblin: but im playing within the rules
shekel_gobblin: don't toucha my star pls
almonte550: use dir() @tomcr00s3
Crannigan: is that the terminal version of jupyter?
almonte550: @Crannigan it's iPython
robinduckett: Some kinda REPL
robinduckett: Not used python a lot
oracle3001: Has George explained why he is in Japan / travelling in Asia?
Crannigan: isn't ipython a subset of jupyter?
shekel_gobblin: it's cheating, we all know you're only a good programmer if you only use notepad
sfmoose: Brew lsbusb is a scam, use ioreg
robinduckett: Only fools whine about tools
almonte550: @oracle3001 bc of ramen
robinduckett: People over process
Stancione: @oracle3001 don't remember him talking about it ...would be interesting to know
Crannigan: you just now realized youtube sucks? Kappa
sfmoose: Agile manifest much? @robinduckett
vidann1: have you encountered any libtards in japan so far?
robinduckett: Qualified Scrum Masterbaiter
Rxcheta: ive never seen that on yt before
TheTastefulToastie: they want you to buy that youtube music subscription so they pause your playlists now
shekel_gobblin: smart
Crannigan: i'm still waiting on the pornhub version of youtube, since they are the few people interested enough to compete
shekel_gobblin: vimeo?
almonte550: @Crannigan I'm not sure but when you install the notebook of jupyter it installs the kernel of ipython
shekel_gobblin: bing videos?
Crannigan: @almonte550 that's what I figured, I use the full version, just hadn't seen the kernel version before
MugiChan: get some tea george
Crannigan: @shekel_gobblin neither of those have gained enough traction though, I think pornhub is the only company who could actually take them on
asus_laptop: hello
robinduckett: I thought all bubble tea was tapioca and then I had a look and it turns out it's mostly not tapioca (at least in the bubble tea places in the UK)
sfmoose: I can believe he can even work without his 79 yen tea
foxubu: !uptime
un3okapi: @sfmoose LUL
sfmoose: Typo cant*
shekel_gobblin: i'll believe it when i see it, i bet he only drinks the tea orally on stream. he 100% main veins it for maximum effect off stream
robinduckett: I blame OSX here
robinduckett: can you pass through to a linux VM?
Roundlay: Buttchugging is where it’s at tbh
robinduckett: Do you have a multimeter handy? Might be a defective board
shekel_gobblin: @tomcr00s3 listen to a playlist called 'Lush Lofi' on spotify, you won't listen to anything else after it. trust the star &lt;3 xx
almonte550: smoke weed everyday bro
robinduckett: yeah like lock you up for years illegal
ad5k: pretty expensive in japan
Roundlay: I know a guy
almonte550: @ad5k are u from japan?
ad5k: non
robinduckett: My mate flies back to the UK to take MDMA because it works out cheaper to fly back and get a couple grams than it is to buy a couple grams in AUS
robinduckett: expensive shit
Roundlay: I’m in Tokyo, seen people pass it around at parties, real risky though
shmideon: how tall are you George?
un3okapi: @Roundlay stream snipe him. He lives in osaka near the temabashi dominos store :^)
Roundlay: brb booking shinkansen
davidb881: George going to work for Sony, is that why he is in Japan?
almonte550: all countries will eventually legalize weed
un3okapi: He leaves tmrw though. Be fast.
un3okapi: I think.
shekel_gobblin: oh shit, george is in japan because of sony. and weed is wofting around his apartment, it's a setup dude. run. they can't get you on the ps3, they gonna get on the green!
Roundlay: Fly out of Narita I’ll buy you a beer
robinduckett: Narita airport is 1/3 airports I've visited
almonte550: now all makes sense
superdorage: I'll get you a free pizza if you fly to Seoul
robinduckett: others are CWL and AMS Shithole :D
Roundlay: Lol
sfmoose: Free handy once back in SFO. Not from me, just know a guy.
TheTastefulToastie: dorito express?
Roundlay: NEx &gt; one hour later slyspyWhat
robinduckett: lol
shekel_gobblin: come to Oymyakon, Russia, i'll let you stay at my palce
ad5k: starting to feel like a noob
robinduckett: right I'm off to work guys, good luck, have fun
un3okapi: @shekel_gobblin LUL
superdorage: cheers
almonte550: bye @robinduckett
robinduckett: byeee
un3okapi: @shekel_gobblin palace? Or place?
un3okapi: @robinduckett cheers.
shekel_gobblin: palace
un3okapi: @shekel_gobblin :^)
sfmoose: Call in sick @robinduckett work is a scam
robinduckett: FortOne
robinduckett: I already did this morning, I WFH anyway, feel like ass but I got stuff to finish
thegodfather45: what's this music, I'm vibing
abhinabacharya303: wow haven't seen anyone that codes slam as well as embedded sys. I am so impressed and inspired right now PogChamp
shekel_gobblin: some random youtube video
robinduckett: laters
andanix: @robinduckett goodbye
ad5k: peace
shekel_gobblin: seeya bro
Roundlay: Later
shekel_gobblin: you know what they say, the beach is always 15 minutes away on mdma
shekel_gobblin: and i live in the middle of russia
superdorage: are you the Russian Hacker?
shekel_gobblin: who else would it be
superdorage: ohhhh
shekel_gobblin: hack my way to a free star
ad5k: social engineer ^
Roundlay: What you going to do with Hillary’s emails?
ad5k: lvl 100
shekel_gobblin: sub to this channel
TheDigitalDud: What gui lib would you recommend for python?
shekel_gobblin: nah i'd sign her up to some shitty newsletters
superdorage: I want the star with an extra point and I want it to be gold colored
oracle3001: @TheDigitalDud QT.
Roundlay: Yeah  1 qt
TheDigitalDud: Thanks will have a look
shekel_gobblin: i actually work at tesla lmao, my manager said i need to watch these streams for any ip leaks
superdorage: lol
Roundlay: PogChamp
noclip32: oh yeah? and my dad is bill gates
superdorage: scary
Roundlay: My uncle is the prime minister of Nintendo
superdorage: My dad is actually the darth vadar
shmideon: George are u rly 163 cm tall
Sawfare: Saw some of your vid on youtube, really like to watch them to get motivated :) Keep up the good work (y) Do you have any profits with an Prime Sub?
shekel_gobblin: I actually work for bitcoin and my manager said I need to watch these streams for any bitcoin cash leaks
Rxcheta: @Sawfare i hope he does bc i did the same
superdorage: Darth vadar's brother name Satoshi Nakamoto
shekel_gobblin: ah we need windows, oh well, looks like either flappybird content or thanos script. thanos script when run will timeout half the chat
shekel_gobblin: we can be productive another stream
joker2k999: its very rare, but annoying when i need windows.... Like for pro-engineer
joker2k999: lol
joker2k999: iso no go?
foxubu: https://developer.microsoft.com/en-US/windows/downloads/virtual-machines
blastyhax: show us all the pr0n in your transmission-gtk queue
joker2k999: torrents still work?
joker2k999: i thought all the cool kids just got it from the dark web
renatorabelo: hi all ! Is this a IMAC or a macbook ?
shmideon: ANSWER ME HOW TALL ARE YOUUU
joker2k999: your paying per bandwidth? ouch
shekel_gobblin: download more bandwidth.. duh
joker2k999: book
ido1m: yes, please reverse something
ido1m: You can solve challenges from a CTF that's already over
luka_147: KonCha
ido1m: like pico
jisaku: square is doing some 'ctf' this week
luka_147: What's this scheme from?
ido1m: I patched the X away
Crying_Potato: I have no idea whats happening pawsU
TheTastefulToastie: no you can usually flash new programs as much as you like
superdorage: I really wanna catch up to his level of skills
luka_147: Good luck with that LUL @superdorage
superdorage: should I be reborn?
Crying_Potato: kylieHmm
superdorage: maybe I should start dig into re-birth engineering
QuikSoap: Finally caught you live purpHowdy
superdorage: i was just saying rubbish
shekel_gobblin: literally turn on email notifications lol, it's not hard
revolutionist123: what is he doing chat?
swanny85: tmuxing and vimming
swanny85: Aside from that, I just got here too @revolutionist123
serhejenos: hi
EatsoupDINGUS: @revolutionist123 https://github.com/geohot/fromthetransistor
joker2k999: So is anyone going to take the Elon Musk brain computer surgery when it drops?
ziggyzergling: trying to put a Xilinx into boot mode?
joker2k999: I say, depends on the UI
shekel_gobblin: I love georges streams because they are literally this. https://www.youtube.com/watch?v=AbSehcT19u0. (0:42 seconds). george doesn't need to watch it, but chat watch it haha
shekel_gobblin: @tomcr00s3 watch it, 42 second break
shekel_gobblin: literally relevant to your statement, i'd rather write my own haha
Airfrischung: you could setup a windows virtual maschine (as a build slave)
TheDigitalDud: It's pretty funny
Crannigan: that is george
shekel_gobblin: ^ see @tomcr00s3 worth finding the twitch window
Mr__Andersson: Doesn't openocd support xilinx devices? I haven't tried it, just heard people talk about it.
shekel_gobblin: it's literally him haha
shekel_gobblin: it's literally you rn haha
un3okapi: PogChamp
Crannigan: twitch walk
un3okapi: take us with you
shekel_gobblin: go irl!
dorkmo: woot
shekel_gobblin: on your phone!
tanscon: irl
DrRobotvinnik: ye we'll play nice ArgieB8
superdorage: Im good
ido1m: Don't worry I'll watch them
th3_maj0r: I will check for you
jisaku: are you going to lawson
superdorage: grab a pizza
th3_maj0r: moderator mode on
superdorage: for yourslef
dorkmo: ms star screensaver
ido1m: IRL STREAM PogChamp
th3_maj0r: LOOOL yeah big build is amazing. Go for it
un3okapi: @tomcr00s3 can we watch this https://www.youtube.com/watch?v=qOCywHisIIU ?
TheTastefulToastie: I love watching paint dr...I mean code compile
shekel_gobblin: just postmates
DrRobotvinnik: @th3_maj0r is waving his sword at me YouWHY
shekel_gobblin: japanese postmates
Rxcheta: rip
shekel_gobblin: mods are sleeping post comma ai content
yeah_haey: just joined what is he doing ?
shekel_gobblin: and spend all your money
TheTastefulToastie: leaving to buy tea
BiszkopTT: hello geooooo :3
Stancione: @shekel_gobblin :D
shekel_gobblin: and pull your ps3's out of the attic
shekel_gobblin: lmao
DrRobotvinnik: easter egg hack 4Head
un3okapi: counting his shekels
superdorage: im gonna hack my name to George Clooney
un3okapi: now what
un3okapi: ResidentSleeper
BiszkopTT: now we schleeeep ResidentSleeper
BiszkopTT: it prints out mandelbrot set thats cute :-3
shekel_gobblin: george you need to save your money, "it's only 79 yen" doesn't matter if you buy 15 an hour lmao
shekel_gobblin: it's not even going to be the single comma if you keep spending like that
dorkmo: pride1
yeah_haey: it doesn't matter
MugiChan: PogChamp
MugiChan: what's happening
dorkmo: party1
dorkmo: tea time
dorkmo: pypy compyle
DrRobotvinnik: he's back PogChamp
yeah_haey: what was the first robot you ever built
aTreee: what is going on over there on the screen?
BiszkopTT: ONIGIRIII
BiszkopTT: these are so niceee
DrRobotvinnik: looks like a packaged intestine ArgieB8
Stancione: @aTreee @MugiChan building pypy from source
TheTastefulToastie: onigiri
superdorage: oh triangle-kimbob
DrRobotvinnik: fish
CaptainRoberts: @tomcr00s3 how long did it took you to fully understand python?
DrRobotvinnik: a big fish, to be precise
Crannigan: everyone liked the mandelbrot sets
dorkmo: frankerz1
DrRobotvinnik: tramsgender
dorkmo: pride100
MugiChan: 美味㠗㠄㠧㠙㠋？
hAhamza: don’t minimize window
Crannigan: I guess it's time to start working on my neural net for class
BiszkopTT: eating and programming all day long Kappa
oracle3001: George on the road to ruin...spending money on unnecessary crap....
superdorage: now I am hungry
superdorage: I want that Triangular Kimbob now
yeah_haey: lol why are you worried about how he spends his money
BiszkopTT: gotta look out for ur homies Kappa
DrRobotvinnik: George said he only ever bought a computer, not even clothes, now we see the truth ArgieB8
foxubu: Probably full of radioactive material lol
swagettiyolonaise69: wtf is he doing
superdorage: lol
DrRobotvinnik: are you building the NES emulator?
oracle3001: this just for fun or something to do with comma.ai ?
un3okapi: @oracle3001 fun
Stancione: all good
MugiChan: we are exploring Xilinx
DrRobotvinnik: I'm the old people, I was here yesterday, I still don't understand ArgieB8
un3okapi: fpga fun for fromthetransistor
oracle3001: does the new big boss of comma.ai know you are spending your days not working on company stuff ;-)
superdorage: I am starting to imagine that @oracle3001 is one of the investor?
un3okapi: @oracle3001 we don't mention comma.ai on his twitch stream.
MugiChan: lmao mod
foxubu: Only 8 GB RAM? :-?(o|O)
dorkmo: soundclod?
foxubu: Who's the moderator today?
swagettiyolonaise69: this music fits so well
Stancione: I'm here
axon_444: Just got here what is he programming?
smoothatprogramming: bro, will you please give us a weekly coding challenge?
Donghee950403: what are you doing with xilinx now?
swagettiyolonaise69: fpga chess
Donghee950403: lol
MugiChan: PogChamp
slimydude: VoHiYo
DrRobotvinnik: still a hacker deep down SeemsGood
benchlow: George, do you still do security or have you moved on?
MugiChan: as expected from a former project zero member
th3_maj0r: @axon_444 https://github.com/geohot/fromthetransistor
TheTastefulToastie: python so slow tho
TheTastefulToastie: it's nice to write, but not fast enough
smoothatprogramming: can someone tell me what music he is listening to?
th3_maj0r: is nice to read, first of all
shevchenkounchainged: hardbass ?
TheTastefulToastie: it's just a nice allround language, the syntax alone stops you writing some common bugs
superdorage: What is his viewpoints on Mark Zuckerberg and Bill gates?
th3_maj0r: @smoothatprogramming Are u asking bcz you want to delete that from youtube? I'm with u bro
un3okapi: @smoothatprogramming it's some space ambient mix on youtube
un3okapi: @smoothatprogramming if I'm not mistaken
swagettiyolonaise69: do you even shazam
smoothatprogramming: @th3_maj0r what you mean?
foxubu: the music is cool
smoothatprogramming: I like the music that is why I want to know what it is. I could smoke a Jeff sessions right now and listen to it
adriaroms: what happend here?
foxubu: let it run
th3_maj0r: @tomcr00s3 Not so much...but no problem
DrRobotvinnik: chill brahs ArgieB8
th3_maj0r: @smoothatprogramming not important, was just a joke
greis795: can someone brifly explain what Xilinx is?
smoothatprogramming: @greis795 same. I have been trying to figure out all morning what it is
superdorage: Xilinx, Inc. is an American technology company, primarily a supplier of programmable logic devices. It is known for inventing the field-programmable gate array and as the semiconductor company that created the first fabless manufacturing model
Stancione: https://www.xilinx.com/products/silicon-devices/fpga/spartan-6.html
Stancione: @greis795
adriaroms: but what exacly?
th3_maj0r: google guys
greis795: i googled but all i see is that is a company
greis795: dont understand what difference u can make using these programs?
adriaroms: a chip company, but what is it really doing?
greis795: yeah exactly
coutzen: Q not 0
Jok4ndre: fpga
slimydude: greis795 xilinx makes fpgas, which are roughly a programmable circuit
josalt1: Does anybody know why its called the cold war?
superdorage: A field-programmable gate array (FPGA) is an integrated circuit designed to be configured by a customer or a designer after manufacturing – hence "field-programmable".
superdorage: now I see it too.
smoothatprogramming: BCWarrior
suurrend3r: you should do a interpreter of an imperative language in Haskell
jrogan993: !vimrc
superdorage: how about Swift with LLVM
jrogan993: whats his vimrc
yeah_haey: show the fpga on cam pls
slimydude: jrogan993 almost vanilla it seems
andanix: @jrogan993 configuration is on https://github.com/geohot/configuration
jrogan993: tyty
andanix: yw
return100000001: !uptime
Zealeigh: Taunting someone to do your homework?
th3_maj0r: @Zealeigh ahahahg
jrogan993: you're doing it wrong you're meant to say i bet you cant do this retard
Stancione: now he has time to do it himself
jrogan993: haha
th3_maj0r: Nooo, his plan was good. Poor guy
superdorage: Thanks for your kind streaming man
superdorage: oh this is how u get the star icon
superdorage: yey
Stancione: hehe, nice @superdorage
superdorage: thanks for welcoming @Stancione :D
th3_maj0r: Welcome in the star family. Now your opinion matters
superdorage: @th3_maj0r Thanks!
suurrend3r: LUL
th3_maj0r: Kappa
Stancione: @suurrend3r wb man :)
superdorage: I am still a twitch noop
Stancione: @superdorage no probs bro, we're all learning something new everyday :)
thisisweeezy: early twitch stream!
thisisweeezy: cheer1 000
superdorage: @Stancione Appreciates hehe
Crannigan: the stars are taking over
SamSheffer: 💪
Crannigan: lol a random sam sheffer appears
josalt1: Whats up everyone?
josalt1: Where is everyone from
suurrend3r: Dear Mister "I'm Too Good To Call Or Write My Fans"
Stancione: @josalt1 we're good , all from the cloud here :D
benchlow: does george stream often? Not tuned in since his exploit ctf days
Crannigan: @benchlow he has since hes been in japan atleast
Kwantuum: he's been streaming quite a bit lately
benchlow: @Crannigan does he live there now? or is just visiting?
josalt1: @Stancione lol
josalt1: Tea Time
Stancione: why the hate @vd3rz ?
slimydude: FeelsBadMan
Stancione: :)) I'll let him for a bit @tomcr00s3
josalt1: Dont listen to the h8rs george
Ganja_Steve: dude his mom pissed in his cereal thats tuff
josalt1: they h8 cuz they 8int
suurrend3r: FeelsWeirdMan
suurrend3r: wat
DrRobotvinnik: RIPerino ArgieB8
th3_maj0r: lagging?
yeah_haey: please learn nanotechnology and make some iron man like robot on stream
slimydude: th3_maj0r lagging a bit for me too
superdorage: laggy yeah
DrRobotvinnik: this strim keeps you in pollack ArgieB8
josalt1: you should do a waymo diss track
TheTastefulToastie: tell all your neighbours to stop watching netflix
th3_maj0r: cowsay " the stream is laggign hardddd"
elpersianas: i see 1fps stream
エワルパー: slide show Kappa
josalt1: waymo comma ai boxing match!
エワルパー: now its good
superdorage: is twitch having a screen of the death?
エワルパー: nevermind
th3_maj0r: Subscribe guys, so George can afford a better internet Kappa
saulgd: NotLikeThis
superdorage: Buffering
paradox109: probably music doesn't help :D
SylensEdits: hello
Stancione: hello @SylensEdits
Mac_33: Hello my dude
semircohovic: what is he doing now
superdorage: Reverse engineering @semircohovic
Mac_33: Looks like your uplink is struggling to keep the stream running smooth. Hotel room?
superdorage: aka. turn hamburger back into a cow
semircohovic: lol...no ml studying
Stancione: @semircohovic yesterday was a bit of that
joker2k999: k. I'm back. what i miss
semircohovic: why is he in OSAKA
joker2k999: oh snap he brought out qira?
alluxua: Hi bro, how is everything in cloud?
joker2k999: what is this C?
Mac_33: That would be Python, joker.
superdorage: Guess so
joker2k999: i mean in the debugger
superdorage: C or CPP
joker2k999: i know in vi is py.. lol
Mac_33: Debugger is disassembled code
semircohovic: why reverse engineer
cromize: ida has pseudo-C
joker2k999: did he use that small win7 iso? if so then is prolly c/c  .
joker2k999: oh thats ida.. cool yea its prolly c
semircohovic: is he agen trying to crack APPLE product
foxubu: wow you're still live
Mac_33: When did this start? I didn't get a notification, as usual.
alluxua: When he is unusual, something big will happen
TheTastefulToastie: @tomcr00s3 is there a reason you're not using the Xilinx SDK? or is this just for fun?
joker2k999: yea i believe he's been live since 4, east coast time
Mac_33: Not surprised - he had that one, what, 14 hour stream? With the SLAM.
joker2k999: yea, my notifications be afk
TheTastefulToastie: xD
joker2k999: i think he's seeing wassup w/ the FPGA
alluxua: He went to visit Osaka, but twitch coding in the hotel room for more than 3 hours a day. Just so curious what it is going to happen
joker2k999: lookup his github.. 'from the transistor'...
Stancione: talking sh$t @tomcr00s3
Dany4k: @tomcr00s3 Have you tried any wierd food there?
alluxua: The beef in Japan is pretty nice, too tender
alluxua: * correction: pretty tender
dorkmo: the cows had tender souls
alluxua: Lol, probably
superdorage: have you been to Ryo-kan?
Zulpae: hello fren
semircohovic: it seams i must video on youtube
semircohovic: *watch
the good news is it has SiC upstream
bell
look at that sick upstream bandwidth you
know what up welcome welcome
I've kept it with me I've kept it with
me since Osaka so yeah we got sick
upload bandwidth I'm sick
it still works
my own normal time now I feel like I'm
on the same time I was before but yes
where were we not there by the
transistor section - yes we wrote this
flash last time you can dump the things
I texted my mom was sitting out man she
text me back she said looks industrial
it's hella cheap gross I'm in a
five-star hotel it's cheap you know I
love cheap no I'm not Norway of non
Sweden no you guys are there that's cool
yeah no it's kind of industrial man take
a quick look outside just show you
outside I'll be real impressed or anyone
can guess the city
let's Thanksgiving at home no I'm not
Philadelphia don't think I wanna chat
yeah so what we were gonna try to do is
we downloaded the Xilinx tools did I own
zip them anywhere yeah I wanted to try
to well they're doing some interesting
stuff there's this new hardware
description language that people are
using it synthesizes things from Python
so let's see what we can do
there's also this interesting thing
called Noah which can do which can run
Linux apps on a Mac no of course yeah
you go back when Ubuntu with Mac OS X so
maybe we could try to install this
I have no let's do this it seems cool
see I don't think I don't want anything
too sketchy yeah so it's this okay I
unzipped it oh you probably gonna want
to zoom in more I get my comments up my
phone
it's been a while yo don't dissing jazzy
you're lucky your subscriber now we're
gonna do that shit anymore you know we
get all a little piece of stuff
alright so unsupported platform Darwin
what are we gonna do about this so
design links tools in a docker
yeah this broke did it
I don't know if no is any good but we're
trying to install it so we're gonna see
what happens I don't think it's good but
I'm interested what else was I looking
at I was looking also I really started
my team looks pretty deep
could I use some download manager click
or get well gets a download manager I
guess it can resume yeah no I know you
can't see I know where you can't see
don't worry I'll try to keep things away
from there to launch it just was da cap
to make sure it has no network access
I don't know what doc app is talk about
it here
yeah no I'm kidding I'm kidding about
the dissing of New Jersey Saturday but
it's better than with a lot of the rest
of America like California which is on
fire fuckers
that's right let's San Francisco burn no
it's a real tragedy a lot of people dive
in wildfire campfire ridiculous shit
let's put me up there I have with that
how's that sound good guys gonna see the
bottom here all right
[Music]
two things know it works
yeah I wish I can fly call duty like mr.
Kim comm they'd be pretty awesome I'm
not that awesome okay so how do I make a
doll cap I don't even know
did this priority do it all this bro is
genius did you do it I think he did it
I'll say included as island shell script
which allows installation of impact
inside his daughter oh what a noob he
would get sit into the thing did he run
like a surfer or something why does he
would get it okay so I think he wants me
to copy all those files just on gir day
definite all so much megabytes Wow take
so long yeah I know I know I know it
sucks
I don't know that normally this this
place has pretty good bandwidth hey I
don't wanna down was update this
bullshit I don't care
Noah is still under development no I
have no name until I run like Noah and
then I run exhale cat scan or you go up
that install always have to suit over
that don't I whatever what
I'm on you I'm on you and I know it's
garbage see if they're gonna work error
response from David no bathed it basic
auth credentials great
oh okay that build it
on eye candy route
thank you for hosting me but what I
really appreciate is you know I love
when people subscribe
I can't even shelf for subscribers
anymore I think that's played out my
best played out
no more shelling we're just here to kind
of chill on computer you know it's just
chilling on computer die maybe we'll
rant about politics guys no not to turn
freespace what see you have that follow
director I understand couldn't determine
free space stop via pass no such watch
don't have a fucking Google account you
see that shit you think I'm in Google
bought Google do you package - I was
that users so is that now in my main var
- no that's a different but it is users
stays the same that's so weird
home has users
well that's after getting in the docker
container right now okay I'm kind of
over Noah know what kind of sucks docker
is kind of good we love docker was Jesus
a copy of some bullshit thank you for
subscribing thank you with thank you for
subscribing
John Razer I love him people subscribe
how much time I spent the day doing this
and spent any time doing this I'm told
but now I've been thinking about the
future Bros I've been thinking about my
friend we're always telling us like like
Paris gathering of the artists forgot
what it was called yeah yeah they had
like Paris salons you know back in the
day but today if you had a salon they
would like you know SEO promote the shit
out of it come to our salon conference
extravaganza where you can speak about
the value of collaboration and what the
fuck is collaboration oh we're really in
the 21st century we really need a more
collaborative workplace what does that
mean like people used to not collaborate
and now they collaborate I don't even
know yeah see I knew oh my god okay it
does look good oh I see what it wants
okay
[Music]
you don't do that um hang on
so Yap jetted all those things I don't
have those files
no not muting the keyboard subscribe
don't think about listening to the
keyboard is most of the reason you
listen to my twitch script you can just
do that with ATAR okay well this guy
clearly didn't know how to do docker
shares directory
target term equals x time root
to install
[Music]
[Music]
so weird why does it would get can't
seed a root in stone yeah yeah yeah get
rid of that okay
let's try that
Oh interesting
is it like a 2gig limit or some shit
it's not putting those in da core it
doesn't have to do that I don't think um
add files yeah I don't wanna do that
okay work I think take a long time I
don't have trouble I just share a folder
between container
work dear
booter docker no I've seen this done no
I have another doctor where I do this
whenever it's almost done it's well he
sent the build context to the dock or
daemon by now
who loves docker I love talker
[Music]
yeah - V how can I do this in dockerfile
that's what I want I want to do in Dhaka
fuck my way to the chef
don't few things I'm getting kind of
annoyed it you know what we're gonna fix
this now was it just gonna piss me off
start my team up there put the tar balls
right there fine you know what
sometimes it's just easier to make
things happy than to try to do things in
that way my bill here we go
fail connection refused why do not run
the stupid Python web server
[Music]
or does it not forward the port or
something may be fine I found I see that
file oh it doesn't have lint oh okay
fine
see so much subtlety was in the
dockerfile what do you mean connection
refused how I different mrs. Pawley
commands I misspell stuff constantly I
just keep doing it
playing container ports to the host but
I want to buy no I want with the other
way around
why is connection refused right over
here and I start the Python server cello
connection I've used okay well I guess
local house doesn't mean local host
I think that's the other way around
exposing ports
publish all expose forth to the whole
surface range of ports now I want to do
the opposite of expose you know I'm
saying
locker access post networks
I mean I can't I get why you would get
guys playing with Zula hearing this
docker file cool docker file it exposes
just just press it doesn't crash that's
a run stupid you know don't do that
accessing hosts from a docker container
as far as a little broken
host are darker that in turn is that
mark locals they do that does that work
pretty funny
how cool works well I was gonna take
five minutes when I was slow yes thank
you dr. dot 4 dot Mad Max don't have a
scale what you talk about
oh my god it's take forever it there's
gotta be a faster way to do this poor
design sure dad's file so how can I just
mount dollar amount
[Music]
this is better
vol I'm not waiting for that it took
over
des you know what that does a little
thing I playing with does us okay so I
lied I was playing with computers a
little bit I blow it up as a woman you
know I was kind of uh my feelings for
urban and I was like why would I have a
Herbet when I get Eva's ooh lip work der
this no it's all sorts of global things
oh this is too complicated what I want
oh there's a docker compose your volumes
this when I add a volume to a docker
file volume
odds that's gonna work come on over
can access time so thank you thank you
for subscribing thank you I'm so happy
with people subscribe that should work
right
I don't dockerfile is really so poorly
documented
[Music]
Darrin's onyx installer cannot open no
such file or directory um I've made
enough to make the directory first
volume
okay maybe just these coals don't work
wait we carry it all the way bullshit
bullshit
that looks like it took a long time it's
probably pretty good what'd she make
sense why just a one container Linux go
starting to dinner
yes so work starting container product
self-help FD no such file or directory
is this one work ok that's a different
problem yeah that's fine but the volume
breaks
so I'm new to docker guys posin was good
at docker copies Island installer times
but I don't want to copy maybe copy
failed oh because it's not darker
context ah what but that's an absolute
path so there's I've seen this before
it's like what's allowed to be volumes
users is fine okay let's check I just
put the CTF had this stuff yeah second I
know that's that coming cold blow
there's one docker compose this I
haven't seen a docker file before yeah
they said they have copies there but no
I'm gonna copy I don't want to copy I
want volume the problem is the file is
very large
you know in retrospect we just get away
to the five hits for the word gap the
volumes are mounted when running the
container
you can mount with Daddy parameter Oh
cuz it's running the container doctor
run with mounted volume another way to
do this yeah yeah and no I know what
you're talking about okay so let's try
that I'm not doctor running it I'm dr.
bill can I do it in docker build as well
any chance that's going to work save -
Dee
did this ever happen in
what
so confusing
not possible this is garbage who
invented this bullshit wait so you're
telling me I can't mount a volume during
docker build all right who wants to wait
while the we get happens I guess that
really was the best way to do it
I guess broski was smarter than we
thought I'm offended okay with 24
minutes while the we got happens whoo
you can mount with D parameter on docker
run yeah it's not you can't do in a
darker build you can only do it on
docker you already said that so just get
the way what should we do only way geez
what should we do yo no I don't know if
these hotel people know what streaming
is but they probably just think I'm
crazy and talking to myself you know
we want to rant about well sure your
rant about I want hi so I'm here in
let's just call it rapidly
industrializing nation and I'm hoping
that somewhere in the world there's a
renaissance you know somewhere in the
world people are thinking new thoughts
and it isn't just the same rehashed shit
guys the internet do you know why the
stream can't get popular because the
Internet is overrun with shit and the
second anything gets popular its overrun
with shit and the only things that can
thrive in such an environment is gucci
gang and we're gonna watch gucci gang
because gucci gang this is a great song
and it's all that can try in today's
internet environment so if you like
gucci getting for i have no idea i don't
read anything about stupid ass politics
anymore
[Music]
my beloved in Spokane oh yeah today's
world guys this is all take some
percocet I guess on airplane
WestJet and he acts like you didn't yet
if it kick him off you don't know what
it's about it's not about anything
it's not about we're just here to have a
good time in program we're not trying to
do anything which is chilling well I
don't know muscles am but guys this is
all I can exist in today's world
[Music]
because you can't good together good
again good you gay wow that's all we get
no we're not in Taiwan we're in let's
say rapidly industrializing nation
number seven
Plateau a card this is a real thing like
I've never heard of this yep this is
like what we get is it the same die lit
sound like just song I know listen to
play were quite cool guys here we go
[Music]
I'm gonna collect which copyrights
[Music]
[Music]
gucchi gang was at least table all's me
um why are we in rapidly industrializing
nation number seven because
Oh hiding in his socks not my music is
my music is is even more shit than this
Oh
Oh after all that we couldn't even
execute the thing
good you can couch again Gucci gang
couch again
oh well no shit
well how do I get tired of strip off we
have to wait for - we'll get again
[Music]
[Music]
just do it here no no no it's rapidly
industrializing nation number seven it's
a nice place hotel in the place in the
city I'm sure there's a nicer hotels if
you go to the other cities as well very
affordable goochy goochy goochy getting
good children oh he's probably hiding
from the cops wow that makes sense
hiding in his socks that doesn't make
sense we're gonna send the the six
gigabyte build context to the darker
daemon but actually it's faster than we
get maybe one of those countries rapidly
industrializing nation number seven no
this is Ike you think I'd be talking
about anything North Korea I'd be like
horrified like I've been horrified at
the guy like you know North Korea's got
a lot of people they probably got some
people I mean let's go out people play
North Korea is probably got some people
outside my hotel room you know I don't
think they got people outside my hotel
room here I don't think it's that kind
of place and they're pretty chill as
long as you don't like bring drugs into
the country
will pump you can't you can't bring your
leave here no way in here is legal light
just like just like you know rapidly
industrializing nations one through six
drugs are highly illegal here they
execute a few people makes a good point
people are afraid no one brings drugs
into the country people do take crazy no
no no I'm not in war-torn nation number
three whoa
no bra appreciate
it's now so Singapore I don't think I'd
call Singapore rapidly industrializing
nation number seven I think I would call
Singapore a member of the drinkable
water club here we have bottled water
because the water is not really
drinkable huge my hard drive what I much
know number seven all right it's not
like Japan and Singapore where you can
drink the water
the Singapore part of Malaysia no
separate country in fact Singapore
wanted to be a part of Malaysia in the
60s but if I recall correctly Malaysia
said no I believe I believe don't get me
wrong on this but it was good Singapore
at race riots Malaysia was like fuck
this yet we don't want you as part of
our nice country you think things are
happening in Scandinavia maybe oh yeah
here we go
all this is good all things are
happening oh yeah Gucci can couch again
Gucci Gucci gang
oh but see I don't want this I don't
want this because now these things are
gonna be too large or I have like docker
clean up all this bullshit well dog or
kill dog or kill star that's not gonna
work okay last time last time we do this
well now we know it works or just we're
gonna do the we get again
because if you don't do the look at if
you don't do the would get it's gonna
leave a huge image lying around in the
context but we need to pass the flag
guitar
okay we're all just here chilling you
know and on any rush
[Music]
yeah that's stripped components equals
one that's it we want you to figure out
how to clean up old docker containers
I don't know why these are running all
right miss Beldon carnal
I've been rapidly industrialized nation
number seven maybe I will take a train
and I will end up and rapidly
industrializing nation number six are
you doing potable like yeah that's cool
you can drink the water in Taiwan our
country is no longer rapidly
industrializing can you drink the water
in Taiwan wait really
oh okay figure out how many docker lists
all containers it's just the ones that's
up how do I list all docker yes - hey oh
yeah look at these
we're gonna kill that and I'm gonna RM
all my Dockers
oh yeah look at all that bullshit image
is being used
well right
Thank You Colonel ice for subscribing
thank you the major so happy to have you
all subscribers wait you want to know
about CTF so I'll see what's coming up
the generic which again that you can get
together
you know looking at this before that's
worth play
okay Qualls is next January I don't know
any of these CTFs it's long before my
time
second finals is the day before
Christmas
oh docker system crew oh cool thank you
for the useful docker information we're
just learning how to use docker casually
docker boom doctor system for wow I've
have any gigabyte stuff
we're in a space we'll do that to thank
you Alex says look cool
it is mac OS mojave that is true how we
do everything in mac OS I so let's just
figure out how this xilinx ISE alright
so bro
sorry for saying using we get was stupid
who can actually turned out to be the
best solution which is sad
which is sad has said yeah final image
has about 30 gigabytes or so much
gigabytes
but any NYSEG Cylons just provided an
image we're also gonna figure out why
Xilinx is six gigabytes once we start
making things with it you know working
my benching strength I'm gonna do some
push-ups do some push-ups
let's do push-ups let's do push-ups bras
keep down let's do ten push-ups very
stupid
most a tempest of sunlight good job good
job good you can't get rich again no the
malls still open for another hour
like in all rapidly industrializing
nations they have malls that will just
blow your mind the size of these malls
people in these malls the cleanliness of
these moms as contrast to the rest of
their nation the malls are beautiful
oh shit really didn't work that's
nothing right how was that mother put it
up before xvf and I have to weigh
together that's so stupid
oh shit all right
oh they put it after
yeah I mean no other malls you're
unbelievable
oh you wanted to say goochie goochie
goochie goochie gang
I got bitch loves cocaine
Mylene cost more than your rent but your
mom lives in a tent range oh yeah
arraigned around
I'm across the street from a mall we
really impressed by figure out where
this is spent I saw a new chat mob
there's loud dude cocaine yeah
yo monster genius never mind I take back
all the things I said about our culture
being in decline
Gucci gang is clearly the pinnacle of
artistic achievements no it's not it's a
rapidly industrializing nation number
seven I was actually cuz they have a
hair condition which I am in I am in the
nicest hotel in this city in rapidly
industrializing nation number seven I'm
okay Internet yeah it's surprisingly
surprisingly when I was when I was in
rapidly industrializing nation number
nine I couldn't really stream because
the internet wasn't good enough but this
is rapidly industrializing asian number
seven and the Internet's a bit better
here you got to give it all of course
China is rapidly industrializing nation
umber one so I'll let you guys in on
that and I'm not in I'm not in China
does that would be on number one once
the country has clean water I think it's
a sanitation is really dead I have less
doubts about him being really dead the
little peep being really dead it will
peep staged his death it did wonders for
his career accent Asian got like shot at
a car dealership thumb shed in China
number one yeah that's true
and then maybe maybe all the countries
that have drinkable tap water that don't
get a name too but I'm not sure what
they are yet it includes places like
Singapore Japan and maybe Taiwan no
Taiwan's a part of China that's right
Taiwan is a part of
I don't know I don't know if tywanza
whatever will make the people happy you
know this is my new politics this isn't
my new politics oh yeah his mother
really yeah come over when you're sober
part two way weaker people never let
that shit out I think but you know his
balls bacon Oh India
no no but here's my new strategy about
all politically controversial stuff if
someone has like an opinion
you just asked them what you think what
should I believe you tell me what I
should believe and I will believe it I
love that it's a great strategy
India India never been to India I have
heard about Delhi Belly a little afraid
to go to India coming I as bands and
talking here I'm know about India I'm
not an idiot
I'm sick but let's just might throw this
also it's not like I'm not like don't go
her toilet which I don't know I know if
I get sick I should go to India before I
talk shit I've been to Italy I've been
to Italy um
true honest opinion of Italy especially
Florence like I felt like I was just
like like Florence was like Disneyland
like it's not this isn't even a city
anymore this is just tourists
I came during July and Florence was just
hordes and hordes of tourists and then
the whole city economy was just built to
the tourists um I'm afraid to go to
Africa for different reasons I'm India I
would go to at most of Africa and
legitimately just too afraid to go to a
bitch let's see what the state governor
Pakistan
I really like steak up yeah I didn't
even I didn't even go Milan I liked
Milan I met a girl in Milan why was I
the you know he has drinkable tap water
it's one of those nations it's a
drinkable tap water nation you know I
like to go in India sometime I don't
know um
okay well I'm not gonna Pakistan anytime
soon but is the problem really terrorism
I'm really not that worried about about
terror there's always like like you know
like Singapore has a travel warning for
terrorism for some reason it doesn't
scare me although actually I really like
this website and um Bo
where they rank all the cities by crime
you guys remember when I was in Osaka
Osaka is like the safest city in the
world except for these cities which
these cities scare me for instance you
know when you want to talk about freedom
you can talk about there's like crime as
an example of like private people
infringing on your liberties and then
there's government infringing on your
liberties in these places I don't know
actually I should do more research
before I say this these places I trust
that as long as that like like Singapore
and Japan I trust that like as long as I
follow their rules everything's fine um
I could probably go to Jakarta in UAE
yeah telling no no no this is low crime
this is low crime telling it's very safe
I'd like to go and that's yeah I've been
hearing about Georgia lately I'm
interested um like I didn't I was I
hmm let's go
um now when I went Italy I saw some guys
with a case
I've never been to Iraq Iran or
Afghanistan I think that they are all
heavily advised against traveling by the
US State Department I am a US citizen
I've heard actually nice things about
Iran if I felt like I was like going
with the right people and for the right
reasons I'd be happy to go to Iran I got
arrested it's a safe country nada no
drugs here don't worry no drugs no drugs
metabolites of my system who said we're
in Malaysia what we're rapidly
industrializing nation number seven
Philippines is rapidly industrializing
nation number eight yeah I probably
can't go to Iran but I've heard
surprisingly good things about Georgia
despite being sandwiched in between like
this rush is the same sort of thing like
I felt I would feel good about going to
Russia if I was going with the right
people I wouldn't just want to go to
Russia by myself or I've heard they just
kill you in Chechnya is that true um yet
no I've heard I've heard surprising the
nice things about George how's the
political situation in Turkey I don't
know about the political situation in
Turkey
there's Snowden the last person I would
want to hang out with in Russia is
Edward Snowden do I want a government
tail for the rest of my life no thanks
Georgia has a weird language they have a
Trump Tower in Georgia Russia yeah but
no I'm interested in uh I'm interested
in Poznan Poland like I've never really
been much to Eastern Europe but uh
really nice things actually Estonia meet
Justin Tollan I've heard rumors that
Finland didn't exist so I can't check
for myself Ovid Germany in Palatine
spent a lot of time going and yeah and
then we have over here the land of
rapidly industrializing nations
I've heard yes oh yeah I kind of maybe
I'll make a stopover in Georgia
is and another thing is how's the
eastern Ukraine is stable or not I mean
the most I know about eastern Ukraine is
when the guy shot that plane down
you love goat ah he was tahi go to Dubai
to ride camels can I just like go to
Dubai would that be chill device down
here isn't it yeah I guess it would be
ya know I might be way less sketched out
like gonna do by then going like Saudi
Arabia
yeah don't xed yeah what's that I don't
know I don't know anything about that
Jacob lies dead hopefully I trust that
it's fine now yeah
all these rapidly industrializing
nations
I do miss the freedom in America in
America America is the only place I've
ever been where I feel like I have like
rights I feel like in all of these
places you know it's it's I'm here as
their guest and I appreciate that I
appreciate that
obviously I'm a traveler in these
countries I appreciate them having me
here and I really will try my best to
follow their rules um but when you like
don't follow their rules like I'd never
want to mess around with that because
it's not like you have rights if you
don't follow the rules in America you
have rights um no I don't feel freedom
in Europe in the same way either
especially with some of like the America
has very strong protections here America
has historically the best protections
again for freedom of speech so I feel
like despite a lot of its shortcomings
America does have freedom I mean there's
countries this places where I guess I
would feel more like personal freedoms
yeah you can go go go go to beliefs like
John McAfee you hire an army yeah he got
you got real personal freedom in a sense
in a in a messed up sort of way
I made the chili Chili's pretty nice
I'd be scared to go to a lot of the rest
of South America now very high crime
curry is beautiful I love Korea there's
been a lot of times in South Korea not
I've been to Greece oh I'm in my
checking Greece out my sister spent a
lot of time that my sister like is a
teacher there I went to Santiago in
Valparaiso
all right it's taking forever no not the
Doubletree I'm not the devil - bro if
you're not American you have very low
rights in America I think that's
probably a lot of the news talking if
you're an illegal immigrant sure but if
you are not an American citizen but you
came to the country legally you have you
have all the rights a meanness a
question it's a question American
society like do do illegal immigrants
are they covered under America's like
Constitution it's unclear but if you
come to America illegally of course of
course you're the same rights the same
rights I do as I said I mean at least
under Constitution you definitely show
politics guys like politics is like oh I
think the government should pay more for
this I think the taxes should be less oh
I think the health care should be free I
think the health care should cost more
money and be run by corporations that's
what politics is a stupid um we're
talking about like rights and
sovereignty is someone more interesting
to me I really think of this politics
all right cool
hmm so we have an image now let's say
silence does work well I think it works
oh I think it works
[Music]
okay Noah was a big disappointment
all right all right no no no politics no
no politics my point was just about
whether you know you have rights in
America and what the debate was over you
could talk about what the debate is over
without picking a side you know what no
no no no the illegal immigrants should
be gunned down Dan okay you get a
timeout don't say that shit all right
all right all right don't say that shit
come on
God exists of I guess that's the rule
that's the rule about political
discussion if you want to say some about
politics is gotta be funny that's I
think that would be a great rule I think
you know we should all have great
discussions no yelling no being angry
just funny - no mind killer that's -
that's true
all right so where are we you guys long
you guys love the diversions yeah here
we go all right my boy Chris is 2600
it's very subjective no no no it's not
that subjective your reer people but
people always like people when they talk
about politics the like like though
they'll say like you know dumb shit
that's like not funny
if you get offended by a joke you being
offended a phony your bad a my auntie
adds guys ever funny you know now that's
it is like vote bones a scam voting is a
scam so you feel like you're involved
that's the scam of voting my anti ads
guy okay
yeah being offended is not funny what do
I think about quantum computing no I
think P equals B Q P so these times it
know if the channel gets big there's no
more channel wall for tarian I like it I
like it yes so this is a complexity
class of look good thingies quantum
computers can solve
I think it's equal to P I think people
are gonna be sorely disappointed ok so
let's see if we can get these things to
build on Mac don't think it's a scam I
think it just can't do the things people
will think it can do um I think like D
waves a scam
intelligence augmentation is a scam I
don't know about that
okay so let's see if we can get
something synthesized and building
so what's this board called I don't ever
remember it's been a long time love is
king I like that that Kanye West shit
you know we all doesn't need love that's
even download a sample project
Wow this sounds hard
I am Spanish this chat is I think this
was like the poker table that's true you
know cuz became a people colluding at
the poker table and other languages
that's a rule in Vegas is the rule in
the chat
I don't think do I think hard work beats
talent I've mean that sounds like a
clickbait headline hard work beats
talent and then you have the kind of
people who were like good cuz I don't
think of myself talented but I know I
could start working hard tomorrow do I
like sports yeah not really
oh my god oh my god the intellectual
dark web you know it's funny it's funny
you can watch it well I mean everyone's
seen those videos right but what if you
don't have talent while coding a
predicting sports model we got the
Xilinx is working whoo
I don't know what is hentai only
pornographic forms illegal here this is
rapidly industrializing the nation
number seven
fun fact I believe porn is also illegal
in Singapore but the laws are not
enforced prostitution on the other hands
is legal in Singapore but pimping is not
I know I'm not in China I told you I'm
not in China China is rapidly
industrializing nation number one and
I'm in rapidly industrializing nations
number seven now they don't have treaty
I guess this shit water oh great
type of source who treated pipe water
supply oh I should have done that with
y'all yes I believe porn is legal in
South Korea but the websites are blocked
like prostitution is illegal in Malaysia
I like to know the loss of countries cuz
I don't want to violate them like I said
I'm a guest I'm a guest and I really I
try my best to uh to behave you can help
break any of the loss so really I
respect them for having me as a guest as
opposed to America where I was born and
I've right so let's ride and do whatever
I want
to me
I would Thailand is in a similar
category to these yet I hear some
Malaysia's I hear some Indonesia's
here's Vietnam save some Cambodia's in
there I don't know anyone who's actually
been to Myanmar or Laos well no actually
the UH tb's of personal storage no no
well it's interesting in these countries
it's it's unclear of streaming porn as
illegal it's really just the possession
that's illegal
if you stream it it's less clear are you
so sure I'm cold
ok API in Thailand who knows the
drinking water you can't drink the water
here yeah it's made by 1,500 no yes I
love Thailand for girls and foods I went
to some of those I went to some of those
bars in Thailand that was uh yeah it was
like old creepy dudes there I was a
little creeped out the food's good I
like the food in Vietnam better I feel
better after I eat fought them like a
pad thai there's and a tie
every once in a while I get it there is
no sound
I'm sure there's sound we are allegedly
working so there's a CPU silence build
forget we this wise maybe it's an build
I checked it out oh yeah those may be I
know what live FPGA Linkous awesomes IPS
off not these
could be Cambodia Cambodia is definitely
around these sort of rapidly
industrialized nations could be Bangkok
do not work for terrorist organizations
it worked for North Korea long before I
would prizes North Korea has the
potential to do it for the walls Isis I
don't I just don't see it
I know if curries funny when you look at
it from an external perspective than
like the internal perspective I don't
know I mean maybe it's truly horrible to
live there I've never been
haven't really banned a lot of people
most people just get timeouts the Kim
Jong Korea yeah they have potential they
should look imagine you're Kim generally
right
imagine you're kim janghoon and your dad
died your brother got banned from being
Supreme Leader because he took I believe
his daughter to Disneyland Paris so he
couldn't be Supreme Leader so now you're
Kim Jung go now let's say you kind of
see what's going on here let's say
you're kind of like wow you know I've
been to South Korea I don't know if he's
actually been to South Korea but but
he's been he's been outside of North
Korea and he's seen the rest of the
world and he's like wow this place is
really really nice
you know there's there's beautiful
shopping malls everywhere and you know
there's no shopping malls in North Korea
at least as far as I know I mean they
could be lying to us but yeah Kim
jong-eun and you want to liberalize and
open up the borders of North Korea even
though your supreme leader you can't
just say that cuz the military guys that
have your heads so how do you do it all
I'm saying is if in ten years kim
jongmin manages to and shut down the
nuclear program open the borders of
North Korea you know get all the people
that the foreign aid they need I think
he deserves a Nobel Peace Prize I could
see a world in which kim jong hoon wins
a Nobel Peace Prize ten years there's
putting that out there I can't see any
world in which Isis ends positively
I don't know why Trump does anything you
can ask Trump you hate your job I'm
sorry I can see it I could see it he'll
be he effectively you don't say this all
those people yet yes ten years I could
be way wrong I could be way wrong but
Kim jong-un if you ever see this video
do the right thing man
the world will forgive you and you'll
live a great you'll live a great life
okay so Python HDL well this stuff I was
looking at yeah my HDL it's not the OSIS
guy maybe it is the OSIS guy
oh don't work for Google I see an actual
chance of monarchy returning to the
world um
democracy has some issues um no I want
to find okay I can't I can't find what
I'm looking for you wanna you can apply
for how may I begin he was alive during
water I don't know I think it might have
been I thought I'd downloaded this stuff
I thought I at least remember it but I
guess I always think I'm gonna remember
stuff and then I don't we have 2018 oh I
see
you guys have a king and Canada I
haven't heard I heard you guys look out
legal we congratulations
welcome to our future a monarchy is
great if you have a good king then the
only problem with monarchy in
dictatorships is with an axe guy yes
democracy's pretty good at solving the
who's the next guy problem take
marijuana you know I was new 13-inch
okay not I'm not working very fast I'm
kind of kind of lagging tonight the
shit-talking
a long day I'm kind of sick so much
excuse isn't terrible it's the guy doing
is it this guy
so these are the open-source
oh is it Cindy flow no those the people
trying yeah a project x-ray okay so
there's that
lots of risks oh here we go
FPGA tools only supports but I think
that's exactly what I have
is that the one I have
think it is
multiculturalism is seriously killing me
how so
college age how so tell me about how
multiculturalism is killing you what is
it was shitty claim what is
multiculturalism even mean and I feel
like all these things like you know like
diversity right no one a problem with
diversity until a bunch of assholes
started screaming it at the top of their
lungs everywhere
same thing with collaboration nobody had
a problem with collaboration like I grew
collaborating why don't you come to our
Meetup or will this cost collaboration
while we collaborate and jerk each other
off while collaborating I mean like
hiring for diversity without skill isn't
good this is this is 2014 political
commentary this is a 2018 I think this
is the future
okay new rule politics is banned but
meta politics is allowed only for
tonight I stopped watching it after a
bet is this
my HDL I found like a whole thing it was
a whole like FPGA Linux build
environment
no tears
Wow that's a lot of stuff oh yeah yeah
it says this is this light axe yeah this
stuff let's check this out I'm not
really sure what this is but it's using
okay it's using me Jen me Jen is what I
was thinking about - a python toolbox
for building complex digital hardware so
if there's been any yeah
yeah look at this stuff well if nobody's
CPUs are so these are people who already
have done like a lot of from the
transistor to the web browser we're just
we're just looking at it for inspiration
so bulking for those of you just joining
this dream yeah from the trance the
Taylor Swift is a new song now I can't
listen to that I don't get me so much
copyright flags
I heard Taylor Swift commented on
politics and I became much less
interested I thinking no js' in general
javascript sucks so fast though it's
true ugly language ugliest thing about
javascript is it's numbers to all
floating-point numbers
for pi
micro Python one on FPGAs good this
stuff
I think Python 2 is better as well but
except though that's not really where
the world's going this is never gonna
work
TBD Doc's great no Doc's plan expel
environment gay
supports a large number of FPGA boys but
not all boards can be used for all
projects
my board yes or no not my boy
because this is my board here so it
doesn't look like a lot of stuff as
support they have yes in question mark
okay
[Music]
why tech setup an it install
I heard of these cores before
Oh Vera laters cool it's like a compiler
for Vera log
as you in a lot of hard drive
damn some time whoa whoa guys tabs are
fucking stupid it's not politics
tabs are just stupid it's not even a
real fight everyone who believes the
tabs are better in spaces is a troll I
should be treated accordingly what
she'll check
not ever use us
ah
okay we did that step okay
I think I have to do that is already up
to date okay go to boards target and
execute the target you want to build but
you know what here's the thing about
boards and tabs we went there's no
boards with boards
did you install that as my global Python
just a link
there's no boards targets how do they
not
no we're trying to get around using HDL
they write their Corazon like Python
it's like light do you Ram
crazy
oh my god is this cloning this is
cloning
[Music]
there's still no boards there's still no
boards into the light x-lite XO here we
go boards targets mini spartan six maybe
allows us to mine
[Music]
no module named light X no module named
media ah no module named let X can't
open the file unusable garbage
[Music]
all right we're over insulting each
other about tabs and spaces no no
oh that's just running things inside the
Xilinx container I see
rebuild flappy ai
it's gonna work
all right well what if you can connect
to X server
what if the odds that's gonna work
didn't work
because I need to look forward x11
unix's or something
didn't work oh this is a rabbit hole
um no the Python three people I don't
know what you do now the Python three
was a typical example of people just
kind of being too stubborn to admit when
they were wrong like they made a mistake
and instead of saying you know what guys
like we messed up we can we can fix this
we can we can reconcile it before Python
three grew out of control they're like
no parentheses and Unicode strings are
the one true way and fuck anybody who
says otherwise and then we got Python to
endure even like nobody won the world's
eventually gonna move to Python three
but like was really was ten years of war
the parentheses are annoying and print
the Unicode strings were like it's just
gonna be able so much better having to
buddy you in front of the string was not
the end of the world just as having to
put a be in front of the end of the
strings not the end of the world either
but you know
the language was good the way it was
they didn't have to change it the
ultimate fuck you would be if they came
out with Python 4 and it was Python 2
compatible and then refused to support
Python 3 like he was just telling you
all so why don't we say we're going to
do in there from the transistor we're
going to make something blink link
must have 13 parentheses
okay well this looks kind of fun
okay we have a very log file let's see
if we can synthesize it by hand
you know about part-time but okay so
what does synthesis sin this HDL
takes in dot V files
not each prep sex this is useless
these are all the Xilinx command lines
mapping HDL entry and synthesis
xst
here we go great oh it has a it has a
friendly on my copies i links use a
local bin so if I type stylings here
okay I can just hear use deep I can just
read the friendly 100 page manual for
Xilinx xst user guide
[Music]
great it just has 27 million things so
this is the Xilinx tool chain I'm
writing is my hand to understand like
what the actual tool chain is
synthesized bearlock just emphasize
right yes
right down where I copied this front as
well that first thing might be like a
director
don't need to get those things those
things are kind of starting to see I
start with basic alto script filename
contains a set of valid xst commands no
options are specified
maybe broski with the docker
no way you know what I should be able to
do is always bash is kind of nice I
loved are you guys who ever told you how
much I love docker
no the malls closed this 10 o'clock
so he probably uses his own
she build the
dal-su I'll do it I'll do it
oh they got Domino's here
mmm-hmm Oh closes at 11:00
Thomas closes at eleven of Malaysia
sorry rapidly industrializing country
number seven
yeah they have like weird dominoes in
some place he's also like Pizza Hut they
also had pizza Hudson rapidly
industrializing nation number nine
they were definitely like a few behind
this one that that country was crazy man
and then I went to Singapore and
everything was like America they kept no
drugs
arch a Spartan sex missing arch family
oh great
Ruby sucks
so here we go okay baby reading the
Xilinx user guide as is the right idea
well I thought it was overly complicated
Oh access to user guide
this is just telling me about like the
Vera Log
somebody somewhere has to done this with
a make file here we go
IFS
undefined command feral log alvera log
work
oh god prize sir
undefined command barrel it was on a
command we learned
P
worrying about whether weed has a
negative effect on the brain has a
negative effect on the brain
I would sometimes really do don't lose
that anxiety fucking stupid jug don't do
xanax don't do ecstasy more than once a
year
don't trip more than once a year you
know caffeine's fine tax me stupid like
xanax actually makes you stupid
Oh drinking a lot too is quite bad yeah
I read some study if you like using for
a year your IQ drops eight points
I don't know though like all these
studies yeah I think it's actually worse
than drinking I don't know I wouldn't do
benzos there she drugs anyway they make
you feel stupid
and I'm not saying like you take ones
antics you're stupid I'm saying like
don't take that shit every day have you
ever had depression I don't really like
I don't view depression like that we do
you ever have depression ever been sad
yeah bro
so is weed right we weeds effects on IQ
or much less clear all these things also
could be behavioural right like all of
this dis dis damage from drugs it's not
like you have a control group that's
doing the exact same thing as the
experimental group
depression is largely a scam I have
tried like all the drugs like one small
stone I'm awesome aren't like good or
stupid
the gex is he's pretty stupid I think
tripping should be given a lot more some
groups of people is some groups of
people it gets given the kind of
reverence I think it deserves
look psychedelics like I think I think
it's a big deal I think sometimes people
take it too casually I smoke weed y'all
know I smoke weed I smoke we on stream
sometime I've never tried bath
no I smoked DMT once what's the
interesting experience so I asked for
those who don't know is DMT with a MAO
inhibitor because if you take DMT orally
ma I'll break it down before it is any
effect I will ask a mix is that I'm not
sure what I don't know what the point of
it are and I asked actually is but I
mean that it kind of scares me I don't
know if it's now it's a reversible one I
think they use so when you go to MAO
inhibitors there is reversible and
irreversible I know a lot of weird shit
about drugs
now I never watched mr. robot
come in - verilock what
that's what this scripts doing I don't
understand
I'm gonna fuck up your brain was all
what most drugs I did I did when I was a
lot younger so I fucked up my brain was
a long time ago long for a ditch yet tea
makes you smarter thank you for
subscribing and CQ they don't make you
smarter they don't even really make you
focus more a lot of especially adderall
I think a lot of what it does is hijacks
the part of your brain that makes you
think you are productive you think coke
you can really see this you go into room
a coked-up people there they're all just
screaming and think they have very
interesting things to say and you're
sober you're like looking at it real
like wow sure hope I never look like
that um enjoyable but I don't think it
makes you smarter I'm T might t my T's a
lot better than I drink coffee these
days I probably shouldn't drink coffee I
drink tea that was a really nice thing
about Osaka Osaka
okay how do I
daffa no that's super vigil back in the
day and I got some new per vigil and the
new provincial had some weird binding
agent in and it would give me awful
headaches or there is a chance that my
relationship to modafinil just just
changed this weird feels weird like you
know you don't you have like like like
alcohol we know Piet's and nymphetamine
's and these drugs feel not weird
and there's drugs like that that feel
weird but a feels weird cell gleen you
know talk about we are drug cell gleans
weird for a zine a PE a citrus type
think if T was interesting I think we
first try
lighter fluid no there's no safe way to
use inhalants everyday what to think
about
downers drugs or hype know what that
means
sampler xst script file run
there's an a Spartan and QS part some
moral support step on there
what actually is a separate fire a while
okay I missed the subtlety there
add nicotine as a as a : organic is
interesting
no Borum probably has good stuff about
it
there's a chance nicotine's actually a
decent smart drug go about your question
is it actually is not such a bad
question to say why are there so many
drugs that make you dumber and not many
make you smarter well entropy the
entropy doesn't work that way Oh tired
not tired
what musk as it figured out
oh it's doing something oh cool we did
something we're really not working very
fast tonight specification of top name
beyond tops which required yeah if you
get a to the top
Wow I think it worked cool it
synthesized oh this is so cool alright
now we have to ignore all that shit it's
not gonna work it generates all this
garbage
valerian root
okay so that was synthesis what do we
have to do next
what's next on this high winx
command-line tools
the world doesn't make sense
you know what can I say I don't upload
them to YouTube someone else does but
yeah and I mean the world doesn't make
sense who told you it should then you
know they should teach kids that the
world's not fair
had a really engage it'll set him up for
success later in life try to teach kids
the World's Fair sass him up for failure
well friend she's like you know my
parents when I was growing up sometimes
they'd give my brother shit and they
wouldn't give me shit and I'd be like
but I want to present to and they'd be
like well you know life's not fair and
you're gonna learn that at some points
better than you learning now and she's
an incredibly well-adjusted lovely human
being what can I say that's right it's
like all right so that was synthesis now
our path services now we're gonna do
constraints maybe mapping the input to
map is an NG defiled we have one of
those no we have an NGC file unzip a
file can be placed and routed take some
map well I like that that that make file
seems pretty good
to find that again
ms:i are so loudly yeah they're all
cuddly I would only be okay MGD build
it's an ng d ng d build up speed target
part we know the target part it's a
Spartan 6w we need a project we don't
have an ng o an ng C file well we have
one of those
Oh lovely well it has on some garbage in
it great - oh map dot NGC oh we need a
PCF file I don't know not for this one
we don't
oops I'm getting confused go NGC go ng D
all it makes NGC files into an g DS all
right this is a make file
Oh do we have an N GD ho given ng D now
what's an n GT nobody knows you say
maybe it'll tell me ng D build turns
netlist into made of generic database oh
I know what that is
there's only make fire useful see why I
like having multiple monitors we don't
have to keep reco going the same shit
like put this on a monitor over there
but I only have one monitor for you - oh
jeez map P spawn sex W we have an N GD
file that's good news
oh well this makes an end a CD file
maybe it makes a PC f as well
incomplete targets part specification no
device has been specified for
architecture Spartan sixth okay
valid architectures that's an ark at all
no device has been specified for
architecture aspire than sex
good enough for the other ones
workspaces what is that
I mean like is the thing guys built into
Mac OSX
I'm swiping with five fingers
I kind of remember this is this what you
mean
describe what I'm doing
no you can watch and you can try to
figure it out I don't know what I'm
doing maybe you do
swipe up with four fingers I hate that
you know part number oh okay a complete
part number consists of the following so
now here's why type it's the only one
that's supported by that opening chorus
thing so we can just come and pitch from
there right
I'd open core as well as it called PGH
holes yes that can work
see I don't know if that's an out file
or an in file PCF I wanted FWD won't
even know that work no package has been
specified
oh here we go
architecture only device - package what
packages
it's kind of like yeah yeah it's like
project Icestorm yeah sure yeah
something like that you know so so right
it's whatever you say it is whoo it does
something I'm sure I'm sure it's very
useful for some people somewhere to do
something that's the package CSG what's
a CSG package ship scale VG I never
heard of it
Oh licensing error knee license
oh that knows more bullshit than I need
to have to get ignore a who got a
license for that man hey
temple OS you don't work on that for
years ten years pro religious devotion
Dow respect no respect temple or less oh
okay so it said some bullshit about how
to get the license I don't know guys I'm
kind of tired movie this bedtime you're
trying to catch tomorrow train to poor
there's room for real like Rome Korea
Terry Pepe hands that would be status
I'm having the temple Alaska it was cool
no I only take train oh yeah Eastern and
oriental express I was looking this
stuff up but it's crazy expensive this
is a lot more oh yeah look at how much
ring get to that as all that's so cheap
anyone can afford that okay well now we
know what train options I have buy this
train
all right so we're gonna leave the I see
I think that's all the actual
programming rota tonight if you came
here for the programming that's over if
you came here to try to watch me get a
ticket to the next destination in
Malaysia we are in Malaysia rapidly
developing country number seven only a
ticket
don't take the family on an adventure I
look at that branding look at the
branding I love that what's the brand
for Amtrak
I wish this website worked
[Laughter]
to give that America we're gonna be
crushed
oh I gotta go to pull out
pull out pull out go to pull out but I
can't provide destination in focus it
doesn't load
refresh
all right I'm gonna buy this train
ticket on my own business embarrassing
embarrassing ly bad at this
so where did what did we do tonight well
we got the Xilinx stuff installed in the
docker by largely following instructions
we learned about some things that we're
gonna have to do we're gonna have to get
the license file we'll do that next time
and then once we get something compiling
we'll be able to actually download it
using my download script little brusky
here all right thank you for joining
tonight the twitch stream will try to be
streaming a bit more assuming we're in
hotels that have upstream bandwidth
thank you for joining you know I really
appreciate all of the support everybody
who subscribes to me you know these
these train tickets are not cheap
just this train ticket is gonna cost me
between 19 and 35 ringgit so 35
malaysian ringgit 2 USD that's gonna
cost me eight dollars and 37 cents
um so if you guys could subscribe so i
could have $8.37 so i could afford to
train to get out of Johor Bahru i would
really appreciate it and please please
give me money and subscribe we're back
to that twitch was twitch was not fun
when we weren't shilling it was only fun
when we shell and talk about drugs and
don't talk about politics the whole I'm
never getting back to the US I can't
afford it I got I played by stream
better take off if I want to be able to
ever get back to the US now where we're
riding the we're riding the Sun twitch a
sawfish this was fun no we're riding the
slow train too
Danny dollars hey Tyler come on give me
money guys give me money I need money
ease I need I need money please give me
money so I can afford my train ticket
but but it's not just this train I have
to take another train tow this trains
gonna cost me another twelve to fifteen
ringgit and what if I want to premiere
see you let's see what a premiere seat
is just look nice let's say well this
one doesn't even give me price choice
well that's just a guess
ice Malaysia language people speak
English I likes English you know speaks
English laughs want to have great words
and it's English like kiasu you know jet
kiasu Singaporean say oh yeah no I was
learning all about
she's upon telling us here I can't
depend on life see this English to a
pencil guys have deal Singlish is so
cool but it's also kind of like new
speed so I don't really know how I feel
about that
these are poor Thomas here you know this
is this year or even know
yeah
I don't know I'm over hacking we were
just casually playing with that PGI
stuff tonight alright thank you for
watching I'll try a stream or I probably
won't my webcams low-quality goodbye
MustiFreak: hello
480i: hi
woosaaahh: Hi !
massi__arg: hi
rksodia: YO
masroor_k: Kanye’s new song
siddm_33: hello ?
klozerfps: guten nacht mr. hotz
21st_centuryman: tinybox: “best box”
h0tl4ntis: brave not blocks twitch ad
mrzexter69: are we doing some vibe coding today
480i: we need a hotz approved humanities education
zorritotierno: gachiGASM
SpacePakal: I need all the ads
thisnotdog: :)
klozerfps: Prayge
21st_centuryman: God is great
h0tl4ntis: llm api sucks
john_kosta01: High on life
peoplesissue: did you try one of those burgers tho ?
lintbint: Ad supported society pretty fire turns out
0mni_1: Satan is great
topscoder: 😂
Pixori: The pizza is also great
thisnotdog: praise the hologram emitter
caine_wildin: we came from gas
klozerfps: praise the greater computer
den_kloot: we live in a simulation
21st_centuryman: pope is also great
gabr1elxd2006: SuperVinlin
480i: We need to return to 90s era stick thin beauty standards
480i: hehe just kidding
nnmee: what if you choose to be fat
woosaaahh: like toasts come from factory, we come from ovens, organic one of course ;p
DracoTomes: i love to listen t you
animal_______: The big bang was just the first time our AI overlords bumped uglies.
jakewhit14: jakewhit14 subscribed with Prime.
480i: I’m glad George mildly tolerates me
mrzexter69: was this the yt intro?
eliphaz_: Hi @georgehotz
v8s_crafting: v8s_crafting subscribed at Tier 1.
ReconMazihoFanda: do u like trump
requiem_lord: how is Elon's administration going so far for you
21st_centuryman: can we get ads on the chassi for the tinybox cheap version?
SirMaxMD: unless you turn around before going back?
batmanual: always twirling, twirling towards the future
h0tl4ntis: do you think nuclear power can replace solar energy
480i: we need a new George Lex pod
StapoTelevision: sounds like he got the diffusion model to work last time
ReconMazihoFanda: do you really believe peoples job will be massively replaced by AI, ofc even now its massively being replaced by i mean like 95%+ of jobs
gree3nspl0it: hell yeah
PUBGmasterClutcher93: Belgium going back to nuclear!
thisnotdog: thisnotdog subscribed with Prime.
Ethan1G: good morning
Ethan1G: Ethan1G subscribed with Prime. They've subscribed for 13 months! lube
Ethan1G: missed the intro
Zeevo: never miss a geohot stream
edersantana: yo george, what’s good!
byterift: byterift subscribed with Prime. They've subscribed for 3 months! Sup what do you think of the 4090Ds with 48GB of RAM, cause NVIDIA SPARK is a scam tbh
HaitchAi: HaitchAi subscribed at Tier 1. They've subscribed for 33 months, currently on a 33 month streak!
Zeevo: most code should be optimized for change and OOP codebases are just easier to change
GuardianVicio: GuardianVicio subscribed with Prime. They've subscribed for 2 months!
d0ubletruth: just subbed so i can tell that guy who thinks oop codebases are "easier to change" that he is retarded
Ethan1G: loll
Ethan1G: o3 in agent mode could fix those
Santiago_LHC: https://stats.tinygrad.win
d0ubletruth: get them big man
byterift: Yes
edersantana: deepspeed is microsoft distributed training framework, right?
ahmad_ph: ahmad_ph subscribed with Prime.
protolambda: pdf viewers are all bad. But there are online sites that let you invert the colors of a pdf
protolambda: https://www.pdfconvertonline.com/invert-pdf/
Santiago_LHC: Get it together OpenAI
colonizethemoon: why does data parallelism suck?
d0ubletruth: that means we need the is_even package
nuttyodin1: What are we up to today?
colonizethemoon: deepseek has some pipeline parallelism algorithm called dualpipe that optimizes training
khronicz: khronicz subscribed at Tier 1. They've subscribed for 22 months!
brothmand: brothmand subscribed at Tier 1.
brothmand: Staff engineer at a big company. Thinking of quitting to go deep on one technology for a year, no distractions. What would you pick today?
brothmand: yeah
IEEKl: IEEKl subscribed at Tier 1.
nuttyodin1: the tech pundits who never cite comma ai on X when it comes to self-driving cars, boggles my mind, they don't understand many of the things
brothmand: I do a lot of DD for a VC and the generative agents space is disgusting
brothmand: hahah
brothmand: thanks for that, percolating
nuttyodin1: the og hacker, George
majorwho: produce more than you consume - simple rule
MrKerow: MrKerow subscribed at Tier 1.
lovefoolish7: time to buy credit default swaps
woozyface0: time to chat nonsense
sridamul: Yo!
banceman: freedom!
w0vu: u legend
fyodordostoyev: lmaooo
bottledcappucino: yay
sandfresse: perfect
tokyo_lights_: good evening
majorwho: plebs incoming
w0vu: hello bro
anubisus7: I may have failed my final. What should I do
majorwho: jk
crucialbessi: poop
fyodordostoyev: LUL LUL LUL LUL LUL LUL LUL
woozyface0: yippee time to yearn for the early internet of redditors acting nice
B_r_a_d_d_e_r_z: You dont believe that there is a huge amount of bots though?
w0vu: ayo
yap24: BasedGod
ayygibba: BasedGod
banceman: that actualy makes a lot of sense
rinaldo1818: BasedGod
scarygengar: hahhaha true
zajdov: dead internet
sarah99___: We are like 4 years away from legit DIT LUL
SlimeSwallower: *beep* *boop*
TheVibingGuy: wadduppp geo hotzz
cactusvacuum: urbit fixes this Kappa
Witkowslon: so you are telling that people are not able to find passion after 20 , sounds really depressing
Bfgrocks: Kotlin programming language designer claiming to be designing AI native programming language, but I think it will be BS AI agent, wdyt ?
tux11: memberberries are ripe today
nick1154: Who killed roger internet
anubisus7: how do I prove pair of adjoint functors. it was on my final but I failed
vikaswakde: why don't you use cursor
w0vu: cap
xsipaj22: What does your portfolio look like? 50% dogecoin 50% S&P500 ?
w0vu: what if u havent found it
ttaha090: Hi
woozyface0: I don’t agree with that
Azphelumbrah: I found my passion at around 26-27
sarah99___: RIP
woozyface0: takes way longer than that for many to find a passion
woosaaahh: are you still doing some hacking here and there ?
kult1010: how do you hedge against fiat implosion?
oluckyman: time was slower in the past
Witkowslon: the question is, do you really have to find a passion to enjoy your life
Paretozen: @Witkowslon that's nonsense. i've seen first hand 2 65+'ers find insane passion and a complete new hobby, turned into business, succesful social media shit you name it.
lovefoolish7: is Lisa doing better than Homer Simpson in 2025?
ttaha090: Hi.  I'm just starting out in computer science and would love to contribute to Tinygrad. Do you have any advice on how to understand the codebase or any resources that could help me get started?
dofamint: huge amount of junior vibe coders are coming
john_kosta01: all bs
w0vu: average tech bro
vikaswakde: your thoughts on codex
kyrs2: i see you always encouraging people to contribute to tinygrad more compared to commai/openpilot why?
woosaaahh: DMT is also trending
Vecint: how do you wind down after work?
banceman: George do you want to discuss the "can a neuroscientist understand an microprocessor" paper?
SlimeSwallower: 33yo playing minecraft HeyGuys
Gadaros: lol
lovefoolish7: @banceman we cant have nice things because of people like you
majorwho: good talk guys
JakobSHAKE: JakobSHAKE subscribed with Prime.
JakobSHAKE: Do you have a video explaining Tinygrad on a deeper level?
lovefoolish7: I have the same experience with XLA FSDP, so I wouldn't necessarily call it broken
brothmand: how do you stay skinny george
Alexis_Lionel: I'm seeding 35TB+ of torrents monthly with a 15 bucks/month plan. It's costing my ISP around 2-4k USD in bandwidth alone
pepebruari: try void
edersantana: chat is tinygrad good for training LLMs? also does it do well at inference time too? I haven't been following too closely (sorry if this has been discussed already)
edersantana: yes, that's me. how is it going?
edersantana: but does generative images? if it does ,then when llm inference become more like that
edersantana: i't be viable right?
edersantana: yeah, normalizing flows
edersantana: yeah diffusion, if it ever gets tehre
edersantana: I've been finetuning LLMs with pytorch... but I haven't trained one from scratch xD
Alexis_Lionel: Thanks for merging my PR yesterday. Wanted to play around with OpenAI's new Codex agent, so I fed it the tinygrad repo. It found that typo and a couple of other bugs that I'm still trying to wrap my head around. Great way to burn through OpenAI's VC money while it's unlimited. Might be a great way to automate <$500 bounties actually. Even runs the test suite after its changes in its env
Alexis_Lionel: The typo one
edersantana: omg, people farming github karma? is that a thing?
gliched_robot: @georgehotz Jeff Hinton mentioned his same code can train llm in 1 GPU and 1000 gpu... it would be great if tinygrad can go that
Alexis_Lionel: Sure, I always make sure to understand the AI-proposed changes deeply myself. My point was that Codex is very different from Cursor and looks more suited to your workflow. Free bug-hunting, basically
colonizethemoon: wanna try it on stream?
banceman: banceman is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
banceman: banceman gifted a Tier 1 sub to PonZaKung321!
banceman: banceman gifted a Tier 1 sub to stormhawks47!
banceman: banceman gifted a Tier 1 sub to AbacusFinchJD!
banceman: banceman gifted a Tier 1 sub to Stochastic_Turtle!
banceman: banceman gifted a Tier 1 sub to pfuk!
colonizethemoon: yeah same with drugs
majorwho: early trying can be fun
djcodered__: djcodered__ subscribed with Prime. They've subscribed for 7 months, currently on a 1 month streak!
gubby235: gubby235 subscribed at Tier 1.
banceman: what is a major thing you changed your mind on? something you thought you were 100% right on?  this would be my question
banceman: thank you
KaPu4iNo: KaPu4iNo subscribed at Tier 1.
majorwho: this is a wierd one
majorwho: https://stackoverflow.com/questions/6210024/gc-doesnt-delete-circular-references-in-weakkeydictionaries is this somehow a similar issue?
kenqz3: on the grind
kenqz3: kenqz3 subscribed with Prime. They've subscribed for 2 months, currently on a 1 month streak! is that a 7900xtx in the background?
dippa420: thanks for wasting my time
majorwho: great
banceman: just part of the process?
smurfd0: nice!
majorwho: good job now again with VIZ=1
majorwho: in tinygrad every N has a self
majorwho: casual scheduler crap
codingfisch: torch.optim.Adam does that when fused=True
smurfd0: https://github.com/pytorch/tutorials/blob/main/intermediate_source/FSDP_tutorial.rst
majorwho: was added in 2.0 Feb 2023
smurfd0: pytorchs tutorial was updated committed yesterday
banceman: looks good, how much was it?
illesteggplant: yoo
Sang_MHW: cool food
シュー: free
vikaswakde: sorry for unrelated question but,   how can a person who has little or no knowledge of AI/ML or tiny grad,  who knows web development,  watches your stream and gets motivated for contributing to tiny grad,   what should he start to learn about   for understanding the codebase so to get context and understand how this all works   thanks
7rido: <3
inceptiondev: bon appetit
cosminnn123: how is it called
timadiss: Bon Appetit
7rido: you eat spicy food?
majorwho: thats fine food
Sang_MHW: where noodle at
MarioKekTV: what's one thing you wish you knew before starting tinygrad?
Sang_MHW: those are the best lol
majorwho: wtf
Sang_MHW: they got rid of that and we live in a worse world now
smurfd0: thick nudle
Sang_MHW: yeah
7rido: nice nice damn im hungry right now
7rido: hahaha
banceman: This went from code stream to full mukbang real quick
cs4d61696b: cs4d61696b subscribed with Prime. They've subscribed for 2 months! Do you think it's good to learn AI/ML with projects coded in C from scratch or do i just make it unnecessarily harder for no reason @georgehotz ?
Chrisxx10: LUL
MarioKekTV: same, o1 was the first one i used too
Sang_MHW: LOL
lefttwitchforever: boobs > programming
eitreen: o3 your current favorite model?
majorwho: sorry for the wrong month
pvttrix: do u write code only in python nowadays ?
Chrisxx10: gemini 2.5 pro is sick too its just yaps a lot
lefttwitchforever: YapGPT
Silencedesagneaux: :)
Reformedot: What's your preferred model atm george?
deslic: seems like they don't hallucinate as much
sahkjdajslkid: o1 goated
Atarax__: any reason why you use o3 instead of gemini pro or Claude 3.7 ?
pepebruari: wen tinygrad hackathon in SD?
tw_plays_tft: o3 googles, so it more up to date
majorwho: yo george you still got that 200$ plan?
XxSallyTheGooseXx: openai has the best native app for mac tho
majorwho: understandable
Sang_MHW: these noodles look like the real thing tbh
Witkowslon: man, you are eating really loud :D
Sang_MHW: kinda miss it
vikaswakde: do you know cooking?
MarioKekTV: when you go back to HK?
pepebruari: Get that noodle place on speed dial for the hack-a-thon
djcows: George, are you curious?
lefttwitchforever: real chickens, not the fake ones
oldmapache: try peruvian food
Sang_MHW: lul
djcows: curious george
lefttwitchforever: McChickens
mezmerizxd: any reason why your not using a fork and knife?
vikaswakde: try Indian food
djcows: he's literally asian now
Reformedot: San Diego > San Francisco?
tanshkoul: yea because thats mainstream indian food hence too greasy at times
outlier2: tandoori chicken
tanshkoul: not all indians are eating that to be fiar lol
JustAutumn: youre holding chopsticks like claude, go ask o3 to teach you how to use em
tanshkoul: yup yup
majorwho: how long have you been there?
banceman: what was the struggle with food in india?
lefttwitchforever: 3.5 claude chopsticks
lefttwitchforever: 3.7 apparently better chopsticks
tanshkoul: oh thats prolly the travellers thing
BookOfMikado: If I were you, I would eat with a spoon. It's hard for me to eat with chopsticks
tanshkoul: yea classic Traveler's diarrhea LOL
Sang_MHW: @BookOfMikado it's noodle bro
benez1702: oh man i missed the start
Rhodes_8: so sorry you had to come to the UK
banceman: yeah, I would't eat most street food in india if it wasn't steaming hot
vikaswakde: fun fact : spices originated in India
Witkowslon: back to the topic, where you asked why people are not contributing to tinygrad. The bounties are not really clear when you are not familiar with the codebase . Maybe you can provide more description to the bounties. :-)
lefttwitchforever: why are we still using forks, spoons, chopsticks, why not have a vacuum directly to your mouth
lefttwitchforever: e/acc
robin_2723: @vikaswakde fun fact: they 100% didnt
majorwho: yeah they dont care
AnAnonymousGifter: An anonymous user gifted a Tier 1 sub to rowrowrowyourgoat!
PUBGmasterClutcher93: talking about india or UK?
benez1702: have you been to the middle east ?
inceptiondev: try to breathe clean air challenge (failed)
Reformedot: What's your favourite place?
vikaswakde: outlier place you visited
oldmapache: what are your thoughts on "data"(analyst/engineer/scientist) jobs ?
Rhodes_8: Go to Wales countryside, such good air man
arthurskylive: its the ulez
vikaswakde: visit Kashmir
sahkjdajslkid: do you ever worry that all the time you're investing in some project might not lead to something worthwhile?
yungdeli_: where are you right now?
lefttwitchforever: estonian countryside op
banceman: You are right, india is polluted did hong kong not have clean air?
Linux_____: population size probably has something to do with it
Rhodes_8: India got to sort their shit out though
konterfektcesarza: Were you biking in poland?
BlurryFella: Oh, so you've been to Dubai before
tanshkoul: yeah well asia does a good chunk of manufacturing so bound to happen
Reformedot: @georgehotz What's your best trip so far? Do you have one special place?
vikaswakde: back to coding, what are prerequisite for contributing to tiny grad codebase
BlurryFella: Come to KSA bro, we're close
benez1702: have you been to jerusalem
JustAutumn: HK air is way nicer than mainland for sure
Chrisxx10: whats your fav?
BlurryFella: Kingdom of Saudi Arabia
majorwho: @vikaswakde go to tinygrad repo on gh - read the readme
tanshkoul: go to macau yet
vikaswakde: @majorwho okay doing now, but that all looks very overwhelming, I have no experience with ai ml
PlushMasta: @Witkowslon There is no point in even bothering to answer such questions, He doesn't care, seriously. He's just thinking out loud for a wile.
Sang_MHW: and they got free bubble teas lul
benez1702: is macau where they gamble millions one hand
BlurryFella: We've got a lot of American/international companies moved their HQ from Dubai to Riyadh
ArbitRandomUser: have you met andrew huang (bunnie) ?
majorwho: @vikaswakde Start with trying to understand basic examples
MarioKekTV: when is the last time you gambled?
tanshkoul: i went there when i was a little kid and p interesting LOL, interesting casinos and the street markets had huge pieces of shark skin
Sang_MHW: lmao
pls_dont_at_me: sweating on that roulette table tryharding
vikaswakde: @majorwho okay thanks
arthurskylive: i think xi not a great leader
JustAutumn: i went there last summer and i had a similar impression as you
vikaswakde: who is your favourite scientist
Sang_MHW: really?? okay
oiagooo: why?
lefttwitchforever: how do we crash the housing market
konterfektcesarza: kinda based
PlushMasta: so much better than DT ?
giorgisp2001: Greetings from Greece
alex4tmm: because trump is a clown xdd
Rhodes_8: XI wouldnt wake up and decide its tariff time cus fuck everyone
majorwho: look at growth of china and america
robin_2723: you think trump doesnt care about america?
oiagooo: yeah, i agree
robin_2723: i feel like trumps cares way more than xi
oldmapache: yeeeee, self improvement
JustAutumn: @robin_2723 lmao ur smoking crack
giorgisp2001: @Rhodes_8 true , he had his wife sell crypto
Rhodes_8: @robin_2723 ur wrong
Sang_MHW: improvement of economy so that the party can extract more value
tanshkoul: trump cares but not how much a president actually should
CaffeinatedEdible: trump cares about certain aspects to improve, but not everyone
lefttwitchforever: "free"
Rhodes_8: trump is a bussinessman
Cinnabon2: anyone else here go to Consensus?
Methanoutput: he does it not for free
benez1702: before 1973 gold
alex4tmm: was ok in the 60s
tanshkoul: he mostly cares when also benefits from it tbh
Rhodes_8: hes the ceo
arthurskylive: Hu Yaobang was the best leader
Rhodes_8: psychopathy
Rhodes_8: is in him
HideshiHlNO: america was great when it had free labor Kappa
Cinnabon2: I feel like the 50-70 is just an anomaly of having all that war booty
konterfektcesarza: i feel like being able to plan long-term without all the election fuzz is  kinda op
Witkowslon: so you want the big brother from 1984 haha
banceman: I mean Xi didn't ban capitalist principles when he came into power
CaffeinatedEdible: how is defuding public education good for america?
Sang_MHW: they dont need sleight of hands to get money from the people tho
duffyxp9: president launching shitcoins is def strange behaviour
majorwho: https://x.com/elonmusk/status/1923418673152250369 just look at this graph
lefttwitchforever: also chinese people care  more about their country than americans care about the usa
arthurskylive: He was the one that liberalize the chinese economy
Sang_MHW: true
n00n00n: fuck speculators
vikaswakde: its 52 years ago, we landed on moon
giorgisp2001: Scamming your own citizens is bad. I dont think there are any great leaders in the West
oldmapache: schools in third world countries sells out that idea
pressOk: but how do I know if I'm a vato
Dwippah: From the EU but it feels like American Leadership dont make the country better but just give it a different flavor, most of the stuff I hear from china is them advancing in some field
CaffeinatedEdible: forget politics, I WANT NUMBERS TO GO UP
Rhodes_8: hopefully in my lifetime there is a central economy run by AI
pls_dont_at_me: EU leadership is non existent atp
CaffeinatedEdible: pop an addy and get back to work
giorgisp2001: China is the only country advancing and doesnt face population collapse
alex4tmm: @pls_dont_at_me
Cinnabon2: will AI be the power structure someday and it just assigns us to do whatever it knows we're most useful for like tarring crack in roads
pls_dont_at_me: 😠
alex4tmm: i had to do it sorry :)
majorwho: https://stats.tinygrad.win/ numbers also need to go down
BlurryFella: Changing the subject. New trend of thin phones huh, what do you think?
vikaswakde: will china be the first country to setup base on moon
giorgisp2001: Greece wont exist in 50 years   We are really bad.
TechnicBeam: Have you heard the conspiracy theory(?) that the population of China is actually way less than a billion?
Sang_MHW: xd
vanowned: You think AI will actually replace bad mid-level devs?
Cinnabon2: what if there's already a base on the moon lainey5Meesacoming
sandfresse: the backside
n00n00n: china is already ahead enough, us has no chance
Methanoutput: its underground
oldmapache: are you curious about russian tech?
alex4tmm: not on the darkside
pentagonhacker1: It's on the other side of moon
pierdzii: Hey george, going to hong kong next month with frens
ceo_of_zaza: depends on the telescope
Cinnabon2: what if it's on the dark side. we always see the same moon side
dawkinsisdoper: technically apple should invent anti gravity
PUBGmasterClutcher93: even hubble has like 1m resolution if its pointed at the moon
pressOk: under-moon-ground moon-base
sandfresse: samsung s35
smurfd0: arent you able to see the flag there.... from earth
Cinnabon2: I feel like we should be able to see everything in HD on a clear day
vikaswakde: wouldn't atmosphere come in between
Dwippah: Theres a movie about that
pentagonhacker1: I've seen a movie about Nazis having a space station on the darkside of moon
vanowned: Do you feel AI helping you a lot with completing tasks right now at tinygrad?
inceptiondev: @pentagonhacker1 this happened i was the shadow
agnikai___: cheers from Patagonia
robin_2723: lmao
oldmapache: LUL
Cinnabon2: asmr mastication sorrow34RAIN
banceman: do you want to get back to 12 weeks of "From the Transistor" streams?
benez1702: do you think he has a mental issue or hes trolling or for real
TechnicBeam: @smurfd0 Maybe if you had an optical telescope with a mirror of diameter 300 feet across.
tanshkoul: what
arthurskylive: Wdym there is Spacex?
Rhodes_8: how mad would hitler be that there is a black billionaire idolising him
ArbitRandomUser: did you read the article on HN , MAT-VEC products directly on DRAM ?
nightknight0000: was the moon landing legit?
vanowned: Do you feel AI helping you a lot with completing tasks right now at tinygrad?
CaffeinatedEdible: do you work 7 days a week?
vikaswakde: how can a person with AI access  in room in African village make a impact in this world
BookOfMikado: LUL LUL LUL
lefttwitchforever: moon does not exist
tanshkoul: are we talking about football or american football
ArbitRandomUser: https://arxiv.org/abs/2503.23817 DRAM is now an accelerator for you
dawkinsisdoper: is the moon real
alex4tmm: why is the moon round if earth is flat TriHard
JustAutumn: can you give a TLDR of the current distributed training support on tinygrad?
Cinnabon2: was the moon landing legit? A: I don't care
pentagonhacker1: Here it is mr Hotz confirmed it
pierdzii: are you real
majorwho: that would be crazy
buddy__1: chinese food is unreal Kappa
lefttwitchforever: lets do a ctf and capture the flag on the moon
Rhodes_8: You ate too physically well for it to be a diffusion model
Rhodes_8: your hand didnt melt into the chop sticks at all
alex4tmm: whats the tariffs on chinese food these days ? Kappa
Cinnabon2: I asked a couple vendors at consensus about their crypto miners and none of them make shit for AI. it's weird since they have the boxes etc
vikaswakde: can you outaccelerate Nvdia
lefttwitchforever: bye bye brokies!!!
majorwho: good chat
arthurskylive: Kappa
aritter2: Hi, what's up?
dawkinsisdoper: anyone know a good vibe coding beginner guide
aritter2: Try codex for $200 haha
aritter2: It's amazing
IceLeo: Where strimer?
aritter2: I don't know
aritter2: Yes
IceLeo: Would tinygrad be able to get to FusedAdam from existing Adam?
codingfisch: For larger model parameters its probably not that much faster
dawkinsisdoper: ya probs how i would have written it
Lana_Lux: 298 raiders from Lana_Lux have joined!
Lana_Lux: heeeyyy! how's it goin?
Lana_Lux: its goin. still workin on it, but its getting there :)
Lana_Lux: whatcha up to today?
IceLeo: last 5% takes 95% of time LUL
smurfd0: were you not also first with amd on mlperf?
IceLeo: PyTorch lines last I checked:  ~400k lines of C, ~850k lines of C++ and more than 1.5 million lines of Python code
smurfd0: code is behind camera
majorwho: is CPU=1 multicore?
aritter2: When I tried the BEAM optimizer a few weeks/months ago on Metal,  I got some problem with parallel execution. I had to do PARALLEL=0, it wasn't documented
aritter2: Cool, I'll try again
majorwho: @aritter2 https://github.com/tinygrad/tinygrad/issues new issues are welcome
aritter2: @majorwho Thanks!
smurfd0: if you run without fuseadam, and break there, how does that look?
akaBK_: akaBK_ subscribed at Tier 1.
akaBK_: have you tried Dia browser yet from The Browser Company?x
IceLeo: sci-hub has a token now Kappa
akaBK_: dont believe they have a token
akaBK_: OOF
majorwho: it even infests the best of us
arthurskylive: https://en.wikipedia.org/wiki/Sci-Hub#Sci-Net
akaBK_: lmao
smurfd0: gotta lol at almost skynet though
arthurskylive: hahah bro got off tracked so hard
arthurskylive: love it
majorwho: so we like tokens now?
pepebruari: Yo... SD tinygrad hack-a-thon... let's go... what dates?
arthurskylive: She is a communist
IceLeo: TINY token on Solana for paying bounties? LUL
arthurskylive: No shes a marxist
majorwho: WOW you got a gift!
arthurskylive: i love the aliexpress website, its very similar
pepebruari: roast this site... moeny.ai
IceLeo: Random Chinese government websites have gifs everywhere too
samdoflamingo: LOL
CaffeinatedEdible: CaffeinatedEdible subscribed with Prime.
majorwho: No motherboard for you
Pravus_: Pravus_ subscribed with Prime.
Pravus_: this has to be a bit
CaffeinatedEdible: and these motherboards really work?
IceLeo: IceLeo is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 101 in the channel!
IceLeo: IceLeo gifted a Tier 1 sub to Laney_TPK!
IceLeo: IceLeo gifted a Tier 1 sub to Smokescreen690!
IceLeo: IceLeo gifted a Tier 1 sub to Bena_4!
IceLeo: IceLeo gifted a Tier 1 sub to Ke_0!
IceLeo: IceLeo gifted a Tier 1 sub to fnordinator!
Ke_0: @IceLeo Thanks for the gift sub!
Zeevo: Blame apple
majorwho: marketing crap
IceLeo: repo.or.cz this is if github had a good homepage
Zeevo: https://vercel.com/
pepebruari: https://moeny.ai
arthurskylive: you will like https://www.mcmaster.com/
majorwho: https://www.heavensgate.com/ this is beauty
pepebruari: it's OS, no?
pepebruari: lol
IceLeo: but no guest checkout :(
pepebruari: https://gitea.moeny.ai
majorwho: Almost a good experience
pepebruari: you said to copy everything? lol
arthurskylive: https://www.rosneft.com/ russian state oil
IceLeo: They even made some CSS prefers-reduced-motion thing
arthurskylive: co2 counter
IceLeo: Codex can fix all that right :P
arthurskylive: cope
majorwho: "ai sucks" - tinygrad dev
ragnardanneskjold0: What are your plans to improve the scheduler? I joined at just the wrong time, when you're concluding...
Hooterrr: that it's faster to run with your legs in parallel
majorwho: we need that MegaTensor in tinygrad
pls_dont_at_me: im so self conscious 🎶
pls_dont_at_me: this gon be on youtube
pepebruari: SD hack-a-thon, July - bring it
ragnardanneskjold0: I feel if I were to invest a lot more time and effort, I could better understand the codebase, but this isn't what I hope to do professionally heh
robin_2723: can you listen to the latest kanye west song on stream its very inspiring
eitreen: my bad, i like the click of it
nightknight0000: thanks for streaming
ragnardanneskjold0: Nah, but I do enjoy going through it, it's just a pain of a learning curve after a bit
XxSallyTheGooseXx: 1px per letter
smurfd0: big geo censor
sun_hour: 1984
brickeyy: someone on reddit said this too LUL
paddythemac777: i will not be censored xDD
SpaceDive: HahaBall
nightknight0000: YouTube commenters are bottom 1%
silkyoaks: @georgehotz WHAT R U GAMING ATM
ragnardanneskjold0: Internet commentators are ^, twitch just seems a very bad channel of choice to stream this kind of content heh
Zeevo: @nightknight0000 reddit is worse
nightknight0000: @Zeevo true
PerkunasSet: based
shades_mccoy: @Zeevo imagine streaming on reddit
shades_mccoy: didn't they pull that stuff off the front page
yeethatbeet: i thought you were jewish
bill1929: lol these guys need to have a day off
shades_mccoy: @bill1929 s/day off/touch grass day/
teyeooe1: eeeee, commie
ragnardanneskjold0: how can someone as smart as george get annoyed at these comments hah, pop culture, coarse jokes, music of today's kind...
shades_mccoy: cut my SS? that's why I don't w2 <bigBrainMeme>
shades_mccoy: i been hearing SS is gonna get cut since before I had hair on my jewel bag
ende_pointe: since before the beebile
EXPRESSinqs: now the real question is: why do you use different browsers every time, i saw you using chromium, firefox and now brave  @georgehotz
KraftLab: KraftLab subscribed at Tier 1. They've subscribed for 27 months!
PerkunasSet: lmao, gotta stay ahead
shades_mccoy: @EXPRESSinqs and you just wear the same shirt and pants like a cartoon character in every episode?
shades_mccoy: i run multiple browsers cause i web dev a little bit and it's good to see each browsers implementation of the standard
waena_: NUMBER GO UP!
Hooterrr: can they though?
silkyoaks: @georgehotz do u have an R36s ??
arthurskylive: have you read bryan caplans book about democracy
IceLeo: BTW Whiteboard brand? LUL
beigebrucewayne: words are a mind virus…only sign language moving forward 🖖
teyeooe1: you better take this jab
ende_pointe: critical thinking is missing in k-12
Zeevo: the virus is 1000x smaller then the gaps in the cloth of mask
LidlFrog: EZ 💰
TheRealGecika: I'm happy to let people say whatever they want, but I am not trusting shit. I have seen the direction the internet went! LUL
PerkunasSet: LUL
ragnardanneskjold0: sure, its a very absurd world; Nietzche had that line of the common man scarcely going mad, but societies and leadership falling to madness quite commonly
DeepFriedDeals: MBAs are like beach erosion. Every year a new crop slowly chipping away at the company.
oo_garry_oo: Also, outsource customer support to Indians who barely speak English.
silkyoaks: 0 common sense society
Hooterrr: the big question: are you gonna bundle AI girlfriend with comma 5?
ende_pointe: IVE HEARD ENOUGH. IM DRINKING WHATEVER GEORGE IS HAVING! MAX POWER
IceLeo: They teach Maoist Thought as a subject in Chinese high schools, and these people complain about the harms of Kanye lyrics
PerkunasSet: The competent people don't want their choices stripped away, the people who have no clue about forming their own opinions pine for it. Making a decision means you're responsible, if someone else makes it for you, you can just say you were going along with the "experts".
lolzork: always a new topc comes up lmao
teyeooe1: you mean like singularity is now the antiwork subreddit LUL
sun_hour: i think there's a /r/Consoom
lolzork: ragebait :tf:
ragnardanneskjold0: George sometimes what would you be if you had been raised in China, or some country not so suffused with this crap
ende_pointe: is there ramen in this Pod?
ende_pointe: if there isnt, im not in
ragnardanneskjold0: take care!
lolzork: bye have a good day :)
teyeooe1: SeemsGood
you guys
are uh live
now we're live and now you guys can hear
me all right so we were just chilling
for cheap beef look at how much eat i
have here
in my cheap eat wallet and what we're
going to try to do right now
is we are going to make uh
so first off if you guys don't already
have your meta masks connected to your
cheap if you guys haven't heard about
this from my instagram
uh you should get on it right now sign
up for cheap heath i'll post a link
right now in the chat
get on to cheap right part of the
problem is that
you know ethereum is too expensive
because transactions are hundreds of
dollars and
we just wanted to make look at that
wallet look at that wallet look at that
i have six
thousand nine hundred and ninety two
thousand
each but before you come try to steal my
eath
that's not really it's cheapies
that's actually only six point nine
eighth because
one each is one thousand
cheap so
make sure to get some cheap ethio cheap
is crazy we got we got we got cheap
pools look at this some guy made a cheap
pool
a cheap mining pool if you have a gpu
you can start mining cheap
you can also join my simple mining pool
um
cheap eath yo okay you post an address
i'll send you one cheapie let's go right
now
post it in chat i'll send you cheap eat
that but we're going to play with
like these all these ethereum things we
can play with that so let's go remix
ethereum
i think this is the ethereum ide all
right
so now i think this should just work
with cheap
and we can code some solidity right here
i don't know why that's being slow is
this this is streaming okay
cool ethereum just takes forever to load
because it's got
featured plugins this all seems very
complex solidity
[Music]
yeah this looks like a good contract
storage
how do we deploy this to the gp network
so
yo i will send you right now thank you
for posting an address let's send you a
cheap ease right it's like it's a whole
eth you know
okay storage
this looks pretty good
uh so now what happens if i deploy this
contract
to the network i don't know how to do
this this all looks complicated
compile publish on
swarm what's swarm
swarm
it's a group of persons joined to
support the development of a digital
infrastructure to sign craig thank you
for being useful
uh by code
okay there's got to be a noob tutorial
for noobs like me
remix ethereum deploy contract
creating and deploying a contract
compile yeah i saw this used to like
work
this used to be way simpler they changed
remix here we go deploy and run
transactions
environment injected web3
account um
yeah let's connect that account to my
meta mask
cool
all right now we have an account gas
limit value
storage contract you know what deploy
why not
that's the beauty of cheap ethereum
everything on cheap ethereum's cheap and
the gas price is only one way
so let's deploy we just deployed a
storage contract to cheap ethereum
i see you guys posted some addresses let
me hook you guys up with some cheap
ethereum so you could play
along at home
um so okay well you guys are this is a
sophisticated audience here on twitch i
know
i know you guys are sophisticated by the
way
who would i bet on not usman who's the
other guy
burns yo burns tonight burns tonight if
burns wins i'll give you all 10 cheapies
um so yeah if you want to get in and
join the cheap party post your address
right now
uh the tornado was pretty fast tornadoes
come and go pretty fast
no no no burns yo if you bet on usman
you only win little money if you bet on
burns you win big money
i believe in burns is that nine dollars
worth yeah
that way that just doesn't work network
that's how i feel
some of those addresses just don't work
you guys are posting like a weird x or
something
why am i paying 105 gray when i can pay
one way
all right now only if you're a
subscriber am i going to send you any
cheap
yeah let's monetize this shit that's a
good plan i'll look at you and if you
have a star next to your name
i'll send you cheap otherwise i don't
subscribe to my twitch and get free tv
yeah
yeah yo guys remember when i said i'd
never sell out
i sold out boys i sold out
nah i'm just playing you can sell out
but you gotta
have a sense of humor about it people
who
sell out and claim they don't sell out
or they're i
look guys look at cheap eats look it's
eat but cheap it's for the people man
you know how other cryptos go to the
moon usually is going to lose
this kryptos stays on the earth for
normal people
you better respond by decision
[Laughter]
no i don't have 7k ether before you
think about robbing me on the streets
i'm a fucking no coiner except for
cheapy
it's true it's true and i'm about to not
have two hundred dollars if usman wins
tonight so we gotta
this is all a joke it's not really
it's cheapy exactly i love that motto
you got you should join the discord and
go on the marketing channel i don't know
i don't go on the discord
my boy goku does goku 1997
that kid's a genius man goku
uh windows tutorial was not complete all
right so wait did we deploy this
contract oh sweet we deployed this
contract
okay so now we got an address we can go
in here to the convenient cheap
block explorer look someone i made a
shitty block explorer
and then someone from the cheap ethereum
community made a good block
explorer yeah it's much nicer
all right okay so now we've deployed
this contract
this storage contract and we can store a
number
and we can retrieve the number now let's
see if we can actually
use this contract um
see
this used to have a way to like use
contracts
file explorer compiler
deploy and run transactions eh
oh here right here cool look i can store
a number let's store the number
what's a good number wow wow thank you
for subscribing
you're a subscriber i'll send you some
cheap i got you guys subscribers
i got y'all yo this is monetization of
cheap eat
um chibi's not worth shit okay
thank you hype train thank you
i don't know why i keep paying all this
gas we got a serious amount of miners on
the network now
so you guys can look at our little block
explorer here
and look we got two gigahashes
of stuff uh so i don't know who this is
uh this is the pool that i run
and this is seth pool the plugin is
called metamask
uh so it's the same meta mask but what
you want to do in metamask is you want
to go in here
uh to your metamask settings go to
settings
and then you click networks
and you just got to add in the cheap
ethe network so you can add in the cheap
network this is the node
the chain id is 777 because you know
when you're on a slot machine
777 that's right and the currency symbol
is of course cth with little c because
that's
sense um
yo could do anything i see you there
with that star
let me hook you up with some creepy
everyone download metamask who i'm
sending cheapies too
and you guys can play along
at home all right so what number should
we store let's store the number four
45. i can click store and now this is
sending a contract
to the cheap ethereum blockchain
and now when i click retrieve right now
it's still zero but we give a second for
somebody to mine a block and the number
is going to be stored for all eternity
in the cheap ethereum blockchain
uh and you guys can play at home with
this this remix
yeah right uh you know
now is when i should do like some web
dev stuff where we can actually make a
contract
what could what good contract can we
make
what's a good simple thing to write
let's think about let's think about what
we should make
what are you trying to make something
simple a coin flip site yo let's make a
coin flip you mean a betting one
gambling site how to build something
that's like useful infrastructure
uh well we're on stream yeah but finally
it's entertaining that is also
like useful infrastructure that's
probably a good point
what infrastructure does cheap eat need
what does ethereum have
stand up adapt that someone already made
something that detects changes to my 45
value look it says 45 now look at that
look at that how useful was that what
language is this language this language
is called solidity
um and we can code stuff in solidity
uh all right should we deploy should we
deploy a real a real a real cheap dapp
this enables whoa this might actually
already work
let me just connect it to web3
i mean i might already have basis
i o without regulatory risk
wait backs are 48 cents so much for it
being a stable coin
there's coupons it's a negative debt
cycle been in a negative debt cycle for
a while yes there's coupons
and then when it goes back to a dollar
do away the coupons all right do a basic
erc20 yeah we'll do a basic here
someplace
turning how many years is 20. what go to
like yours going
you know token yeah we're going to go
we're going to token generator not token
yeah exactly yeah
yeah what are you looking for coffee
over there
oh yeah no no that's the old one how old
was that
two days you used that one this is the
two day old coffee that's like two days
old that coffee's new oh
wait where did it again there's more
this morning all right this morning's
gone
this morning coffee isn't yeah coffee
doesn't go bad oh the windows are still
shaking
i don't know um
welcome to the tower suites oh we're
going doctors bro
there's like a bajillion floors
yo trump tower is going to pump let's
say rename it
trump tower is going to pump yo all
right miguel
as i see you're a subscriber hang on i'm
hooking you up with a cheap
let's go
all right let's go to token
generator
create erc20 token for free perfect
create erc20 token
my token name we'll call them twitchies
my token symbol it's a two witch
wch yeah that's good token decimals my
total initial supply how many how many
viewers we got right now
no i want i want the twitchies to fight
over them 430.
430. okay uh i've read and understood
yeah we'll call it the main ethereum
network i don't think this thing knows
simple erc20 commission fee zero
let's go what my metamask is on the
wrong network fuck off with that
right fine fine fine we'll do it fine we
won't use the token generator we'll use
the one that the client can't check
what's up
yeah yeah yeah
yeah network
you selected a test network
your meta mask is on the wrong network
all right
you know what this sounds like it's time
for javascript hacking
all right there's like one that's like
a github page well yeah this one's a
github page all right maybe we just
we'll just want to fork it
yeah yeah well yeah no it's like it's
it's nice it's not designed to be mean
and they're not doing this through dicks
like cryptokitties so you don't use
fake cheap knockoff crypto kitties
no i don't really think that's my crypt
okay you did it either oh my god how
much code does this thing have
all right let's figure out how to do
some lead javascript hacking
so we can make twitchies our erc20 token
on cheape
and then you guys can bid them up on
cheap swap
that sounds fun
all right so what does the bishop and i
say confirm your metamask is on the
wrong network
let's see what it's checking for
um network
what how's it not in here
is that sub models or something
no metamask found
hmm
i mean these strings have to be in there
right like network
now
this is code not this or something
yes
where is this thing
okay maybe it's actually a different uh
pricing
what a scam they're trying to charge you
money for tokens
this token generator is designed to uh
the code's not open source
click on the extension icon
just take the opens up linear c20 all
right all right fine
i see you're a subscriber you just post
your address i will send you one tv
because i really
i really want you guys to buy up
twitchies with your cheap
and the great news about it is you can
do it on cheap swap
and the thing about cheap swap see
ethereum is no fun
because it's full of whales and
everybody takes shit really seriously
but if you have cheap eats you don't
have to take anything seriously and we
can just all have a dap party and you
guys are all invited
um coffee how do you add this to your
metamask
go to cheapheath.org and follow the
wallet guide
okay uh erc20 saw
one file
no we see like these import like a
bajillion things it's so complicated
here we go erc20 token one file this
guy's bro
all right let's go back to remix
wherever remix went it's great that
remix just works
uh here let's make a new contract we're
going to call it erc20.sol
i'm going to paste some stuff in here
can we compile your rc20.
damn that takes a long time using that
uh
what is it m script n show slow
don't make me compile it on my computer
okay i think it compiled i'm sure i have
to set the here we go
implementation of the xxx contract
twitches
is erc20 capped erc20 mintable
oh i can mint them sweet that means i
can do what's called a rug pull
oh you guys are going to love getting
rug pulled
like where do i set the initial supply
or maybe i don't
maybe since it's mintable there is no
initial supply
uh there at least has to be a place okay
it's in the constructor i see
cool uh all right so that's compiled
uh compile again so it's the word
twitches
now i go here what do i want to deploy i
want to deploy oh look i can deploy any
of these
twitches
or actually what if i just do oh here we
go erc20 capped
that adds a cap
i don't know what that means let me move
this down here and let me zoom in on
this
let's read this code a little more okay
um
decrease loans mint
bar proof
internal virtual
hmm oh here we go i can call
finish minting all right all right we'll
deploy an erc20 mintable
that sounds nice
usc 20 mintable
deploy oh well but this is stupid
it's not going to let me do this
i don't understand actually i don't
understand why it won't let me do that
because this doesn't have a constructor
oh it's an abstract contract
god okay we're going to deploy twitches
i'll click this they're called twitches
symbol is twitch the decimals
are 18 i think
the cap
uh is oh wait a second
you know what one decimal that's right
no decimals for you guys
twitchies are only sold as holes
is that gonna break things
that sounds like it's going to break
things you can sell partial twitches
times 10 times times 18.
i hope i can type that all right let's
go
transact invalid big number okay
5e20. can i try something like 500 ether
maybe that works because either is
no error encoding big number string
fine we will do it the python way
there we go that looks like a good
number
um deploy
all right we're going to deploy the sea
on east you'd never just yolo it like
this on eth you'd have to like test it
and that'd be boring but when you're on
cheap it doesn't matter because
everything's cheap
okay so now let's check my activity
contract deployment is pending
hmm did you check the block explorers
how are my blocks coming one minute ago
didn't have any transactions
yo i got you all right who's joining the
party who's going to buy some twitchies
on on
on on on cheap swap
a block
oh my contract's supposedly deployed i
think this block explorer is a little
behind
um this block explorer should be up to
date
yeah there we go whoa we have a new
miner
flakystag flaky steg
showed up wow
axel go i see you okay yo
these aren't real eats they're cheap
eaves
like oh he's got 7 000 each i thought
you were a no coiner
only cheap coin you know why don't send
it to coinbase
don't send cheap eats to coinbase you're
gonna have a bad time
all right uh i think my contract
deployed let's go back to remix here
where'd my remix go remix
twitchies okay we have twitchies now
um
let's check balance off no cap
decimals total supply
good simple twitch all right so now
let's go on cheap swap
um wait no i have to deploy a new pool
how do i do that
add liquidity and then do power parallel
doesn't exist
got it cool um wait add a list i don't
want to add a list i want to add a
single token
i need a list
i'm going to want a token that's not on
the list
more ens name can i just
how do i just add a token
all right let's try that
this is the contract direct address of
twitchies by the way
select the token add
no it only lets me add lists
where you would type the token address
this honey swap shit doesn't let me do
that
no it's a honey swap fork
all right it sounds like we're going to
have to make a list
huh here we go chief swap io dot default
token list
all right let's make a list
we'll deploy it to the cheap
eath website
um extra cheap swap list
uh and the name is
twitchies and the symbol
is twitch decimals are 18
and who cares what the logo is
uh
oh yeah we do need that address again
let's go back to remix i guess i put it
right there
okay and that should show up
at cheap.org default token list
once that refreshes
my contract is called twitches oh i
spelt it wrong
oh well all right they're twitches
that's right
name twitchies oh i spelt you're saying
i spelt it wrong here
it doesn't matter the only thing that
actually matters is the address
i do hate typos though so no twitchies i
did it right
well the contract is called twitches oh
that really doesn't matter
joao kane's tv i feel like i already
sent you some did i already send you
some
no i don't think i did all right we'll
send you we'll send you a cheap because
you're a subscriber and subscribers are
good people
all right oh yeah good my token list is
here all right now we'll go in the cheap
swap interface and we'll add a list
add extra cheap swap list ah look twitch
sweet so now i have seath and twitch and
we're gonna create a pool i'm the first
liquidity provider
the ratio of tokens i add will set them
let's do it even twitches are worth the
same as seaths
wow this uniswap shit's really good
approved twitch
no it's gonna cost me eleven dollars
allow cheap swap to spend your twitch
yes
oh it's on the cheap ethe network and
it's 11 cheap dollars which is actually
only one cent
all right why is it it's approved oh
wait
you have to do it again
sure perfect supply
yeah i'm creating a pool see twitch
create and pool supply cool
good thing i can get away with a gas
price of one way oh and i'm adding the
liquidity here okay that's cool
create pool and supply
wait what what's that saying really fast
such that i can't read
it
let's try it again keep the gas price
high
what's happening
tx fee exceeds the configured cap
was this something like metamask shit
so
exceeds block gas limit
tx fee exceeds the configured cap
hmm
anyone know about this all right dawkins
doper i got you
all right let's try it again
and maybe this gas limit's too high
okay now the transaction got submitted
i don't know if it's actually going to
go through because i lowered the gas
limit but
see okay we got to change this view on
ether scan because it's obviously not
going to work
we can't actually view it on ether scan
because it's on the cheap ether network
so let's try this other block explorer
no it doesn't exist yet
i think it's like polling it now
what's block scout
another explorer that's not going to
work
yeah that was fast because cheapy is the
fastest block chain there is
you guys cheap it's the future you heard
it here
i see you subscribers i'm sending you a
cheap
way did my ad liquidity fail
are you gonna get rich buying cheapy no
don't be a fucking speculator
why'd it fail
error hmm
i wish i could see what the error was
oh damn ether scan really is the best
i want an ether scan whoa that's a lot
all right let's try to let's make
twitches cheaper
maybe the gas limit like this is the
problem i think
six actually that's a real number i
think we should be able to pull that
from the blockchain right
can i look at this block it'll tell me
here go gas limit
all right even if i'm the only thing in
the block cool
all right cool submit it again let's
click view on block scout
copy this and then find this transaction
over here
when did krypto become so serious you
know
you're gonna buy a lamb with cheepy
that's right not only a bow just a lamb
you might be able to afford
goats are pretty cheap
what are the odds this worked
so these are the blocks for those guys
that are those are all that have never
used block explorer before
these are the blocks that are being
mined on the cheap eath network
so i'm waiting for a new block to come
in with my transaction
funding the new uniswap uh
liquidity pool
all right add liquidity did it go
through i think it might have gone
through
this i don't know how come there was no
gas usage
it says it has a transaction
it's an address um
okay it seems like it worked
did people already buy it is that
slippage did i get slippaged
sweet okay it looks like it succeeded i
think
let me try it on the other block
explorer
transaction oh it succeeded perfect
look at that transaction fee and that's
seath
yo the people building these things is
really nice
all right sweet wait are people already
buying them
are you guys buying them on cheap no no
you guys are
you guys are you guys buying them
already no way
okay so select a token twitch
how can i oh i have no twitches oh look
at that
i can turn my one seat into 38
twitches that's a good thing there we go
look i'm only impacting the price by 0.9
percent okay everybody buy some twitches
confirm swap
yeah now cheap heat's not going to pump
but
i personally am going to make twitches
pump so if you get in and you buy
twitches
i'm gonna pump twitches and then you
guys are gonna make a lot of seath
let me explain so first
let's see let's see so you guys
yeah yeah yeah that sounds like a good
plan okay so did everyone
see where i got my extra cheap swap list
from here here's the token list you guys
can add the token list
and everybody who gets in on this right
now you're participating in a great
crypto pump right so so buy twitches
uh let's let's actually take a look into
this
uh liquidity pool a little bit so if we
go over here
into this ah this
thing is block explorer is uh this block
explorer is a little bit slow
um here's what i'm gonna do i got i got
a i got an idea
um the same person who made cheap swap
also made this block explorer
so we are going to hook them up right
now with 100 cheap
and be like bro we need the block
explorer to be faster so
hopefully that can go to funding a fast
block explorer
no e oh by the way i didn't tell you
guys if you have eth
you already have cheapie because it's a
fork
that's the magic of fork you guys know i
love fork i've loved fork for a long
time
initial initial fork offering yes get
your ketchup
um yo
this is this is the d5 party that you
all weren't
invited to many years ago but you're
invited now
get in here and buy some twitch
you're not yeah that's not a speculative
asset people
this is for the lulls
no but seriously um buy out that
liquidity pool of twitches
yeah oh yeah because this is like an amm
i don't even know how these things work
yeah yeah yeah all right so there's got
to be some way i can like see
so how do i get like the stats on it
what why is this pool fail
you mean like you just want that info
you want to swap that out
look at the pool address yeah can i go
to real units
info
oh guys might have sent you the wrong
list
hot shoot me some seats i'm sending you
some seats
you all know we're voting for burns
we're rooting for burns
nah burns all right wait is uniswap that
info open source
yo someone should set up some uniswap
that info for uh
wait so i don't understand why i can't
go to pool anymore let's go in an
incognito window then can you
see the activity on the swap yeah just
take the pool address and put it on the
block explorer
yeah okay okay
yeah yeah i mean my block explorer is
not um
not the nicest block explorer
there's no either it's not open source
yeah we all want ether scan everybody
want ether scan fork
okay i think this one is the which one
is the transaction where i created it
this one here we go
summary log entries oh here we go this
is something anyway
oh look it was mine by my good friends
at sethpool
um right
well
i'm about to dump i'm about to dump a
hundred seats
oh the price impact too high it won't
even let me buy that much
advancement slippage tolerance slippage
tolerance 100 percent
your transaction may be front run oh if
there was a smart browser on the network
right now that would steal all your
money
because i know you have 100 slippage
tolerance and buy the entire pool itself
nothing back
yo did you guys all buy twitches who has
twitches
well let's just look at the token
address that one's easy to get because
it's right here
and we should just be able to type this
address over here into the ethereum
light block explorer and we can see if
you guys have been buying twitches
transactions no
none of y'all are buying it
i'm looking at the token contract now
okay transfers
well yeah they're just transactions
yeah that's transfer yeah but no they're
both from me
yeah did nobody buy any twitches yet yo
guys buy twitchies i'm literally giving
you free money you get to participate in
a defy pump
and then you all will get to participate
in a rug pool when i mint a million more
of the twitchies
my god people asking why
ah people asking why are the worst why
you know what we say to them
[Music]
[Laughter]
yo look at this slippage price impact of
five percent let's go
because it's cheapy we can do it unlike
on really east when no one's having a
good time anymore and everyone's serious
it's true it's true if you want to
get into the d5 party um
okay so i bought more is that going to
show up here it can take time i think
not too much time let's see it on the
other explorer
one transaction oh you know what
i mean i could at least see hmm
there should be events right on the
token contract if it changed hands
even if it's not necessarily
let me think the transaction is actually
coming from the uniswap thing
let's see if that thing got mined yet
oh swap exactly for tokens it failed
weird why was the result
i don't know we need ether scan
oh yeah we need let's let's partner with
etherscan
why not why would you just cannot want
to partner with me
they're getting in early on cheating
we're going to make knockoff we're going
to make free through scan
[Applause]
what do i click on either scan to buy
man this is why it's so easy to scam
retail
it really is
you want to buy that twitch all right
all right get in on cheap swap and buy
twitch
it's not gambling if it's fake money
all right let's make a gambling contract
let's go
nope i think there's irreversible
slippage now i don't actually know
uh if any of you are smart
all right all right 100 slippage i have
an idea
wait how much were twitches wow holy
shit twitches are cheap
i'm gonna make a contract right now
which is gonna let you redeem
a twitch for a seat this is gonna be the
biggest pump
since wi-fi
let's let's let's write some code
because that's what we do here
that's not true that's fake news that's
fake news that's like
that's like taylor swift breaking up
with her boyfriend
fake news
you can't 100 slippage all right let's
make the redemption contract
because you guys didn't see me write any
code i do know how to code solidity a
little bit
but you guys can watch me make mistakes
and knock hair because fuck it man it's
cheap
right all right so first we're gonna
have
hmm these are all very abstract we don't
want abstract we want contract
contract redeem
all right we need to know the address
constructor
god i don't know how to do any of this
doesn't even have to have a constructor
really
the way that this is going to work is
you're going to send tokens here
you're going to send your twitches well
so let's first add my twitches here to
metamask so i can go in here to assets
oh sweet look i have 35 twitches okay
so let me think you're going to send
your tokens to this contract
um
you know we do it live on the stream you
know i don't plan anything out
check out treasure island
oh well let's definitely put a pragma
solidity let's let's waste time doing
things that are like boilerplate
okay i want to make it so that when you
send
tokens to this contract
you can redeem them
[Music]
let's google it
i don't know what any of this stuff is
you know what contract kind of did this
die token redemption contract
wow so complicated not die no no no
dow wow
the top hits the sec
um okay
send tokens to contract
erc20
let's
actually made me not so easy
you you got in oh it's pumping all right
all right sweet so once we get this
redemption contract you guys are all
going to get paid
in cheape which is fake currency worth
you know we say that it's worth one one
thousandth of an eighth but that's just
meme it's actually worthless because
it's a party and we're all here to have
a good time
um
damn this is not so easy okay i mean
what
what i guess you could do is the first
thing you do can i approve
a contract to spend my tokens because
then what i could do is i could call the
token transfer function
yeah all right assets
check out how many die i have uh so you
know you guys again
are like thinking oh man yeah 174
thousand dollars but that's actually
cheap die that's not real die
um send
i guess i don't really get it like if i
just send
if i just send tokens to a contract they
kind of just go into a black hole
um
yeah so really what i want to do is
approve them and then
oh actually no it wouldn't be ascend to
that
yeah this is going to be a little
trickier for you guys because you're
going to have to call a function
on this contract let's see who can
figure it out
okay
it's impossible without ether scan god
okay yeah yeah yeah
we're gonna make it work we're gonna
make it work because this
is what we're going to see
you know there's there's i believe in
you
a big brain will copy paste my bytecode
that's good that's good
um all right so we're writing a contract
right now which is going to let you
redeem
your twitchies which hopefully you guys
all purchased right here on this stream
for cheap eat at a one-to-one ratio so i
don't
whoa whoa whoa whoa whoa whoa whoa this
is this is on cheap ethereum where none
of this stuff has
any value if the sec wants to come fuck
me
over you know like like 500 fake tokens
then i'm very sorry sec i will give you
all the money i made off of this which
was zero
that's right
um wait
are all the twitchies are they bought
out don't even think you can get them
anymore
oh no you can wow you can still swap one
seat
for 4.94 twitches this is a great deal
you guys want to get in right now on
this before it slips even more
because i promise that if we get this
contract to work you're going to be able
to redeem twitches
for one cheap eath
all right so we set the contract
constructor here and i gotta go at nine
o'clock
so that's how long we have to make this
work
um
okay is it really impossible to call
anything without either scan
okay function
let's call the function uh
huh contract
approve
token
wow i don't think this is going to be
easy at all
you know what
let's first make a a little a little
phone contract called
double and the way that double works is
you send in one cheesy cheap eat and it
sends you two cheapies
function values solidity and then we'll
get back to trying to do it with the
token in a minute
um
calling function from deployed contract
oh man this is so hard
oh and i need like a this is all too
hard guys
um
okay solidity contract
receive value
receive external payable
okay good good good this looks like a
good amount of solidity
okay receive external payable
and then we're going to when we do
receive what is it message.value
times two uh
send
value solidity
call contract and send value here we go
what
is it called our value oh
instead wow all right here we go
some address transfer
ether solidity
um here we go seller.send all right so i
think it's uh
message.sender.sendmessg.value
2. oh that sounds great
wait but we're going to need to fund it
initially
because otherwise when i try to fund it
ok here's what i can say um
get balance
of contract solidity
in order to get contract i say address
dot
this balance
if address dot this balance is greater
than zero
message dot send message value two and
we're gonna call it the doubler
okay so i have bug
expected that but got that okay we don't
need that
compile all right
failure condition of send ignored
considered using
transfer that sounds better
sweet okay we got rid of the box now
let's
deploy this great high quality contract
oh i can even send value right here
all right let's go 10 ether deploy
oh gas estimation error the transaction
execution will likely
fail let's not do any of that
deploy gas estimation errored
what why is it erroring oh maybe because
this is a value
okay that's fine contract deployment
let's go
figure out where my contract goes and
then
i think it's only if the value of the
contract is greater than zero so we're
going to be able to check the balance
this is just letting us get a feel for
how to do things and then we're gonna
try to make the twitches redeemable
and i gotta go at nine o'clock so i got
an hour and ten minutes to make this
work
uh let's go to the other let's go to
block explorer
yeah contract deployment suite looks
like my contract deployed it's just
called new contract but if i copy the
transaction id
let's see what the address of the
contract is
oh here contract address here we go okay
good
this is the contract so
i mean i don't know if i did it right
let's go let's send 10 of them here
and then you guys should be able to send
in one and it's going to send you back
all right i sent
10 eth to it you guys imagine i was
doing this with real eath you know
that's mr beast youtube shit
yo sons i got you right here i'm going
to send you a little cheapy
so you can double your cheapie with the
convenient doubler contract don't you
wish there was a double a contract on
real eat where you could send it one
ether and it would send you to eth
but there's not
all right um value 10 ether
contract interaction failed
why'd it fail
hmm
was that the one where i was trying to
deploy it
contract interaction teneth failed
all right let's try to figure out why
receive external payable
if address this balance oh because the
balance is right away greater than zero
oh well good thing that didn't work
let's just deploy a new copy of the
contract and fix the bug
um i have an idea
if message.value less than 10
ether
pile okay what do we think of that so
you can send it 10 ether and then it
doesn't double
but it's only for small double
deploy this high quality contract
um actually let's send it 10 ether see i
think this is going to work this time
uh nope don't do that never mind value
zero either
all right deploy the contract again
oh look here i have a doubler here
low level interaction i say
small double
i should have you know what i should
actually just make it one ether
yeah whatever
yeah let's redeploy with one ether
i really love that we can just you know
deploy things a whole lot of times
because it's super cheap on ethereum you
make a mistake you're sad
but on cheapy if you make a mistake you
get back up and you do it again
let's try sending 10 ether to this one
because yolo why not oh no this double
is already launched wow that was so fast
mining that block
all right so we got this doubler let's
send 2e
to this doubler see if it works
um contract interaction pending
okay so it's only going to call this if
the message.value is greater than one
ether
it's external and payable failed
why did it fail what am i doing wrong
external visibility and payable state
mutability it's exited on the call with
empty call data
this function keeps all the ether with
no way to get it back
why is that failing
to ether from two
why'd it fail
how do i even really know it failed
i don't have any value
you guys know what's wrong
tv sounds like a scam
wait line 10 you're saying i have bug
what's what i do wrong
line nine
okay what's wrong if message.value is
less than one either
no it should be less than
all right let's just make a dumb
contract that's just that
don't send your wreath to this one
fake doubler
or did i not recompile it no i must have
do i have to say it's like payable
function payable
there's a no name function called a
callback receive
external payable seems like it should
work
the if statement checks for minus one
yeah but i don't want the if statement
to trigger
i want it to just do nothing
all right let's deploy the fake doubler
i want you guys to be able to send less
than one ether and get free gp for using
it
okay let's send money to the fake
doubler
oh wait did i just not wait long enough
for it to actually deploy
that's a possibility too
let's also send a little value to the
fake doubler and see if that one works
yo one of these days people are gonna no
i didn't say that didn't work
failed
oh pending maybe i don't know cued
cued pending
i'm gonna go downtown for an hour or two
cool please um
say hi to riva
failed all right all right all right
let's figure out why
so that one failed this one's looks like
it succeeded though
so does the fake doubler have value
yeah okay the fake doubler worked all
right
let's go again with real doubler maybe
one
ether doesn't work maybe i can't say one
ether
that looks fine
we don't understand why this doesn't
work message
is always message.value not right
message.value contains the amount of
whey sent in the transaction
okay
how about this if message.sender is not
equal
to my address
no i can't even write a token transfer
that's actually surprisingly hard
i know i'm trying to write something
that literally would just take in a
token and send a cheap ease
oh i can't do it i'd have to i have to
like first you have to approve
the thing yeah you have to do approval
yeah you'll have to call fucking
approved
no look into uh you can you can do
anything matters you can do permit now
also against
this permit function where it
essentially shows your approval in your
first transaction
yeah so you only end up doing one
through i mean yeah i'm sure i could do
that too but like
okay contract real doubler deploy
just i was surprised at how just not
intuitive that is but let's see if this
one works
just less than one no that's not right
either
wait maybe oh we know message.value said
it's in way
oh no but let's try it so we deploy the
contract
real doubler's deployed let's send one
ether in there and see if it works
oh look it's in the tx pool that's why
it said block number nan in the mempool
who's lido
did it succeed see what metamask does
pending oh it succeeded
yo guys if you hit up this real doubler
right now
there is a like 50 who trusts my code
you know what yolo guys if this code
works
you're going to be able to double your
cheap eat you're going to be able to
double up to 11
cheapie get in right now if the code
works
if the code doesn't work it's gambling
you get it
we're all here to have a good time whoa
wait a second how did the balance just
become that did somebody already hit the
doubler
you guys know the double all right
wait did someone already hit the doubler
no way
how come there's no transactions
not these block explorers man yo you
guys already hitting the doubler
how's the balance going down who's
doubling their cheapies
this is a good party guys this is a good
party this is a defy party
you guys are all invited we're all here
to have a good time
yo how fast y'all gonna clean this shit
out
you gotta get in that was the easiest 11
cheapies you'll ever have made
i don't know why the first one didn't
work
get you excited with yo you doubled yo
you doubled
yo look at these transactions pouring in
oh i love to see this
i love when i can interact with my
audience through code
because the elite get rich and the not
elite stand on the sidelines watching
that's right that contract rewards the
elite anybody who can get in
oh yo this is kind of fun i can just
like deploy like little shit contracts
and anybody who hits it gets the money
but it's all fake money it's like drew
carey it's all made up and the points
don't matter
that's right did drew carey ever get
investigated by the sec for the points
on whose line is it anyway
no and that's what cheap eat is like
what up censored alex i see you're a
subscriber we got you
we're sending you a cheap eat right now
if you get in
soon you might even be able to double it
but it looks like that doubler's running
real low
the good news is there's no way to lose
money on this doubler
okay who wants to play
the maybe doubler oh this is a good one
maybe doubler
um else you don't get shit
okay the maybe doubler block hash
solidity
mmm blah cash
um
do not rely on block timestamp now
and block hash as a source of randomness
that sounds like exactly what we're
going to do
so number of seconds since the epoch all
right this sounds good
all right you guys looks like the
doubler's cleaned out
let's play the maybe doubler and the
maybe double it works like this
if block time stamp mod 2 equals zero
double
otherwise lol lol
get fucked all right
let's play the maybe doubler um
let's compile is our is there a
what spdx is this a real thing
all right who wants to play the maybe
doubler
does everyone understand how the maybe
doubler works
it made me double you know maybe
all right 50 50 shot right
yo you guys know the strategy to win
doubling games right
all right i'm going to hit up this maybe
doubler we're going to throw
50 ethan to this
now if i hit the double unfortunately
it's not going to be able to pay me
so we might have to try this a few times
um if you're holding twitchies i don't
think we're going to get to redeeming
twitchies today
but hodl and i promise you
with my fingers big crossed because who
knows what we're going to do
but maybe next time we do a cheap eat
stream
those who have twitches are in luck and
those who don't have twitches
there's no more twitchies it's a fixed
supply token
this is scarce all right so it failed
let's try it again it seems like if i
had
it would have actually doubled my 50th
you know what let's just go in here and
let's check the
it failed probably because the timestamp
was actually
i can get the timestamp can i
um timestamp
maybe it's in the other block explorer
oh no no we just we just checked the
block
here we've got a block click the block
time
stamp oh shit it's like in p.m i mean
maybe that's six
i don't know but let's see if that 50
yolo worked
pending once we get into this maybe
double you guys
who's ready to play maybe doubler
see the thing is i have to lose in order
to fund the maybe doubler
pandey
random exponential contract yo yo yo
we're not degenerates around here we're
playing reasonable coin flips
we are in vegas uh we're at the win
or the encore or one of them shits
oh yo it's in it's in yo we got money in
the maybe doubler yo
get him boys get in you all know what to
do
yo um by the way don't gamble any more
money than you're willing to lose
if you're going to be upset if you lose
your gp
don't send it to this contract but if
you're here to yellow and have a good
time
and enjoy defy uh yo get in
hit up that maybe doubler
it's got 50 maybe eth in it
[Laughter]
we're having a good time boys we're
having a good time
oh paste the address okay
can you send you yeah i got you you're a
subscriber i got you i got you
yo imagine i was doing this with really
who would want a yolo relief with me
like this who would be with me boys
would you be with me
penguino i got you your subscriber let
me hook you up with some cheap eth
who's hitting up this doubler right now
up someone lost half a gp
[Laughter]
how do you play yo someone made money
all right
so the way that you play is that you
send money to this contract
and here's the code for the contract
it's called the maybe doubler
you might double your money or you might
get fucked it's like betting black but
there's no green
it's good roulette it's like super
european roulette
so
how's the doubler doing oh some people
are making money some people are losing
money
wait someone go post in the cheap
discord
tell them about the maybe doubler
the maybe doubler is the hottest thing
on the blockchain right now
the maybe doubler is the hottest thing
on the cheap ethereum blockchain
you're rich
hey chloe i got you i got you i got you
by the way i just want to let you know
that you should never follow these shit
to your security practices because the
time stamp
can be manipulated by the miners so one
of these days a miner is going to get
smart and they're going to drain the
maybe doubler
you load it yeah that's what i like to
hear
we're giving cheapie to the boys let's
go
let's go um
how many people we got all on hotel
wi-fi too
uh oh yo let me plug in my laptop
all right
you're a former sub you don't get shit
lucas is it real i feel like i've seen
you before i feel like i just sent you a
cheapie you asking me for more cheap
look your good scent right there don't
try to ask me twice
i see you yeah
[Laughter]
oh i should have sent the back door to
the maybe doubler so i could send it to
me
[Music]
you lost it all don't worry i got you i
got you i got you
you know what but i'm only sending you
half a cheapie because you lost it all
don't gamble
gambling's stupid by the way who we
rooting for tonight not
usman but the other guy we're rooting
for the other guy
the other guy wins i make bank if his
mon wins
i lost some money
there is no cheap to usd conversion rate
because cheap eats is a party the spirit
of cheap eath
is generosity you lost 10 more
yo get in here yolo you're cheap
how many viewers we got can you have one
yeah diva omc i got you
i courier i got you you can gamble your
cheap
on the maybe doubler right now it's not
gambling it's a skill based game or
something
oh someone just won big
oh man you know what this is doing
though this is pumping up the
transactions on the cheap ethereum
network
and that's what we love to see look at
all these transactions this is the most
usage the cheap
network's ever gotten because you can
play the maybe doubler contract
all right what else we got um
oh i have an idea for a contract
the maybe doubler is degenerate gambling
and we're going to leave that up there
but let's make another little contract
and that's called the i'm a nice guy
contract
um there's a good guy contract okay
the good guy contract basically works
good guy so first we're going to throw a
receive external throw constructor in
there
and we'll throw oh
um all right so
i just want to reward everybody who
bought twitchies
and i want to send you guys a little bit
of a little bit of eath
so i'm going to send you a little uh if
you figure out how to uh
call me call me and call me
is going to transfer 0.1 ether to your
account
but you got to figure out how to oh yes
the other thing that we obviously have
to check
which is about twitches
let's say address twitches
oh actually it's not just an address we
actually want an erc 20 um
prc 20 uh
how are people doing on the how are
people doing on the doubler
i don't even know i don't
even know we can check it let's go the
maybe doubler yo
is the real double or cleaned out yet
yeah the real doubler's cleaned out but
the maybe doubler
oh the maybe doubler's winning that's
because the maybe doubler has a house
edge
nye live there's no house edge
so we're going to check if
message.sender
we want to say like twitches.balance
of message.sender is greater than zero
so if you have any twitches and manage
to call that function
i'm gonna send you 0.1 ether
while you donate money
you donate money good okay
a good guy contract let's go let's go
uh did i intend to add public i did
thank you solidity
remember balance of not found
call method well let's see irish
20 methods
yeah balance of address owner
call method solidity
i should just be able to say something
like contract erc20
does this work
and i can say like balance of address
owner we'll say function
balance of address owner public yeah
then we can say erc20 twitches is this
right
um type address payable
is not implicitly converted erc20
parentheses that
okay type error
operator is not compatible
um public int uh
well actually let's just look up the
ic20 token standard
um
all right sweet okay so
this should work right if you have
twitches
and you manage to call the call me
method it's going to send you
0.1 ether so we compile let's deploy
how's the maybe doubler doing
the maybe doubler's about to maybe even
yo i got you subscribers you got a code
to do this i mean maybe
i think anyone who figures out how to
call that method is going to be happy
and anyone who doesn't figure out how to
call that method you know you got to get
in early before
the ethereum is drained oops
i spent too much gas on that one uh did
i deploy this contract
contract deployment it's pending okay
so the good guy contract is going to
show up in a minute i'm going to reward
everybody
who bought twitchies with
who bought twitchies with fake money see
notice how i have twitches
i actually have 35 twitches i bought
them out of my own uniswap liquidity
pool
um
oh you need to make sure the same guy
doesn't call me infinitely many times
that's a good point that's a good point
we're going to make the new good guy
contract that's going to make sure
people don't do that
but for now one person is going to get
all the money
unless they're a dick you know this is
the um you know what we're going to put
a
uh please this son we're going to put a
please take one sign
you know you guys remember from like
halloween please take one
ah yes
oh shit why is it called erc20 oops i
deployed the wrong contract
okay well good thing we're not spending
any really doing this
um this isn't gonna deploy a new one
right that's gonna construct with that
address right
oh you have two now did you use the
doubler
whoa who cleaned out the doubler
someone hit big
all right good guy let's go
okay so i think that first i'm going to
fund this
i'm going to send it 10 cheap
okay so that's sent let's confirm
on the block explorer that this actually
has a balance of 10 very good
and now let's try the call me function
of course i can do this because i'm here
in remix
call me
and then we're going to see if the
balance goes down
or if there's some reason that word that
i can't just write the word ether like
that
because i feel like that's what was
broken in the other one
oh i probably just lost that 10 ether i
bet this contract doesn't work for some
reason
good thing it's cheap either
call me call me call me call me call me
you guys know if i play the kim possible
theme song is that song copyrighted
what if i play a cover of the kim
possible theme song that can't possibly
be copyrighted all right
wait okay it looks like it went through
did it actually send me the value
yeah sent me the value all right yolo
contracts let's go
let's go if you
have twitches and you call the good guy
contract
you can take one you can take one but be
nice
i'll post the address you got to figure
out how to call call me
if you figure out how to call it you are
bro you see
the problem with this is you can be a
dick and you can take more than one like
look
i'm being a dick right now i might even
call this contract
a hundred times and leave nothing for
all you guys only if you have twitches
though
if you go to a different address where
you don't have any twitches
i don't think it's going to send you
anything it might because there might be
bugs
oh what are twitches if you didn't get
it early and you didn't buy twitches
then you can't use the good guy contract
which sends you free money
we could hypothetically set up a state
thing and track how many people took
but if you have twitchies you get free
cheap eats right now
and if people start using it and i see
that it's not the same dick spamming it
over and over again
all right fine we'll just do it right um
ethereum array
address
how can i instantiate an array of
addresses
um solidity map
here we go we'll call it did
take and then we're going to say
end was it end in solidity
solidity if statement and
wow this is useless and i'm sure if it's
not a i'm sure if it's not that it'll
give me an error
no i don't want to deploy that again no
bad metamask
oh yes and did take submessage.sender
equals zero
i make you take one
please don't
sybil attack
okay and this one's going to be a little
bit easier to use
because i'm just going to put it in the
external payable
you don't have to get the call me in
order to use other good guy
by the way did anyone figure out how to
call call me on good guy yet
should've sent it money
that's not how you call call me um
to be honest i don't really know how you
call call me uh and then we're gonna say
did take message sender equals one
that sounds good compile
all right
other good guy
uh and did take message sender equals
zero message standard transfer
you get one either
for this one oh let's first let's save
this and compile
okay compile
did you guys just no one figured out how
to do it
let's check the other block explorer
contracts other good guy deploy gas
price one guay
let's go
so i'm gonna send this ten ether
and it's actually gonna send me back
one ether i think so
yo no more free c no more free seed beg
the other people in twitch chat have
them send you point one
the spirit of cheap is generosity and
giving
and keeping the party going you know
all right so let's see if this contract
actually got my stuff i'm expecting if i
sent it 10
failed
huh i don't know why
would it fail
everything is initialized to zero
message.sender is definitely an address
hmm
no one's figured out how to call call me
yet i say
oh wait can it not like use the value
until huh
okay
i don't want to do that can someone else
who doesn't have any twitchies
send try sending to this contract
someone who has zero twitches please
send to this contract
and then if you send to there and i see
your address on there i will send you
more
because i think the problem might just
be that
you know what let me just try this
constructor solidity message.sender
yeah owner equals message that's under
constructor public
uh let's save that cool oh it has two
lines
visibility for constructor is ignored
okay i don't need that
let's go back here deploy other good guy
that way i
did anyone get good guy yet by the way
how's maybe doubler doing
26 you can always hit up the maybe
doubler
you're feeling lucky maybe doubler oh
it balanced two okay
now i should be able to send yeah
so my hope is now fuck it 50 let's go
my hope is i should be able to send 50
to it and we don't even have to deploy
other good guy
because it can send me back one ether
but that's fine because it now has two
seats by the way
who was so kind as to send to seath
oh what's the maybe doubler address yo
if you guys want to play maybe doubler
maybe
maybe doubler is that
see if that huh
okay mine is still pending it should
work though i think now
yeah okay cool it works great if you
have twitches
if you have twitches
send to that and you'll get
one
ether and
by ether i mean
chibi
yo so let's see this one drain did
anyone figure out how to call call me
and good guy yet
no one figured out how to call call me
and good guy we're gonna leave that as
an exercise up to the reader no you know
what i'll show you guys how to do it
i'll show you guys how to do it you
ready for this
i believe in you okay so
we're gonna create a new contract and
we're going to call it
bad guy yeah get ready for bad guy
all right so bad guy is just here to
steal from good guy
good god uh bad guy
let's make bad guy in the constructor
call contract good guy
remember good guy has a method
uh i can go in here to uh
good guy here good guy has a method
called
call me and call me doesn't take any
parameters
and call me is not a view and it doesn't
return anything all right so now we've
made a contract that has the abi
um now that we're going to say
address bob equals
no no not address sorry good guy bob
and then we're going to say bob.call me
and we're going to call it
five times and we're going to deploy
this contract and we're going to get
rich
and then we're going to talk about trust
me i already know what's wrong with bad
guy
so you know this is good guy here
now remember i can call good guy because
i have the call me button right there
but nobody else has figured out how to
call call me yet
but i think if we do this
good guy that we're gonna actually be
able to call it we're gonna be able to
call it five times
i'm giving you guys a lesson in stealing
ethereum right now this is an og
ethereum stealing lesson if you guys
want to learn how to steal ethereum the
dow hack was like the same thing
all right contract interaction all right
contract deployment
when i deploy this contract it's gonna
call good guy
and you guys remember good guy good guy
just gives you point one eath
uh all right
now
bad guy let's see if bad guy actually
got the value
doesn't look like bad guy got any value
oh wait it was message.sender
okay i'm at six
six seven two zero six seven two zero
point six
nine let's deploy another bad guy
and let's see if it goes up because at
first i thought that the mistake that i
was making was that
call me was actually going to send the
cheap ethereum
to but message.sender is not the
contract is it it's actually the
sender of the message messages will be
the person who's currently connecting
with the contract so this actually does
work
um but how come it didn't go up
did good guy go down that's another
thing we can look for
oh yeah it went down look at that 10.7
so i guess it
did go someone figured out how to call
it
it's not even a multiple
i only called it three times i don't get
it
this is why we need better tools to
better explore these things
you know what occurs to me i can just
put this in a in a function
bad call me
bob don't call me right that should work
and that's good guy
so someone figured out how to get money
at a good guy
uh bob bob.call me
that seems right the good news is since
i'm the one with this contract
bad guy
oh did i accidentally deploy a good guy
no i wouldn't be called a bad guy if i
deployed a good guy
good guy bob don't call me and we know
that good guy has a call me method so
let's try it
let's deploy this and then i can call
bad call me whenever i want to steal
money from good guy
yo who's figuring out how to steal money
how is other good guy doing
not that other good guy i never used
that other good guy let's check this one
yo this is getting too complicated to
follow uh i
you know i'm just like like all these
contracts 50 wow
did i put 50 in there i might have that
might have been me
uh yo i don't even this is all getting
too complicated to follow this is all
wow this is ethereum's hard man
let's check out this bad guy and let's
see if i can call bad call me and get
free money
give me money give me money
contract interaction pending
um was that just making the contract
rich see that's what i thought was
happening last time maybe this bad guy
is getting rich
is he no he's not rich
a poor bad guy
no copy that
doesn't have any value still pending
let's see if this one works if this one
doesn't work
we're just going to play the doubler a
bunch of times and we're going to call
it a stream
so weird yo you know what i just
realized
wait a second the problem is
good guy is checking to see if i have
twitches
but i don't have any twitches so we're
going to have to send some twitches
yo let's do it i have to send a to let's
send
one twitchy actually i can send .001
twitches because i'm a cheap guy
to the bad guy and now bad guy has
twitches
and then once bad guy has twitches and i
call bad call me bad guy's going to get
rich but i didn't put any withdrawal on
bad guy
who knows who knows let's read goodguy
and see how i actually wrote this
twitchies.balanceof message sender
is message sender a contract
will be the person oh the contract
creating the call okay
so it actually is bad guy
yo okay let's go let's go let's go let's
go let's go okay so i sent one twitch to
bad guy
i sent a little bit of a twitch to bad
guy so now that check's gonna be true
and now i can call bad call me oh it
fails
it doesn't even make sense
hmm oh shit you know why it fails
because it's not payable yeah
all right let's go let's go and then
we're going to make a function called
drain and drain is a public function and
it just sends all the money to message
sender and we're going to get in fast to
do it
um message sender dot transfer
uh balance of contract
balance of current contract
solidity
here's my calling address not this
balance great
um message sender.transfer address this
balance
oh does that work yeah the gas fees are
going to be paid elsewhere okay we're
good
all right let's deploy this is called a
really bad guy
let's deploy really bad guy let's go
let's go we got a drain
we got a bad call me i'm going to deploy
this contract
this contract is he's going to steal
he's going to steal all the money from
good guy
but you guys can get in on other good
guy by the way
no one's got another good guy yo if you
have twitches if you have twitches and
you send money
send money here
if you have twitches
free 1c
what calls bad call me i'm going to call
bad call me okay
really bad guy is deployed so we're
going to have to send really bad guys
some twitches um
send really bad guy a tiny amount of
twitchy
one gas price let's go
now that it's a payable contract yo what
i actually even could have done
i didn't even have to do drain i could
have just had receive forward the money
to me
but then we might have had some problems
with like you know like
whatever okay address this balance
message sender transfer address this
balance let's go
so now we have really bad guy we can
check really bad guys balance over here
on exhibition
uh expedition which right now is zero
the activity of sending twitches let's
make sure that uh
transaction hits the blockchain before
we tried okay that's sent so now let's
call bad
call me because i can call it here
because i did this in remix
let's go let's go let's go
okay contract interaction succeeds
and the balance is now 0.5
yeah all right let's steal from good guy
yeah good guy 9.6 all right let's call
bad call me let's go
let's go look at this i'm an ethereum
steeler
let's go let's go stealing money
stealing money
yo bad call me back i should have
probably tested drain
you guys know anyone can call drain
right now if you get in and call drain
you just you just like stole from the
thieves that's not even robin hood i
don't even know what that is
this is like dexter man you know oh look
at that look at that we stole
1.5 cheapie let's drain it let's go
let's go send that cheap to me
watch my balance go up we're gonna hit
that we're gonna hit that six
one yeah drain
get fucking drained let's call back call
me look at this we're stealing money
from
eth we're stealing money from eath let's
go let's go let's go look at this every
time i run this i steal
money you guys could steal money too if
you learned how to code
solidity yo and like not even joke fake
money you can steal real money that's
illegal don't steal real money man
don't steal real money you go to real
jail if you steal fake money you go to
fake jail
let's send a really bad guy to fake jail
i don't even know how to do that i was
going to self-destruct his contract but
we didn't put that in
let's call drain let's go wait so how
much is in that is it in the contract
right now you know what
someone else can call drain and they
could steal that money look we got two
right now let's go let's go let's go
because we called really
poor good guy we stealing all good guys
money let's check good guy here
oh 6.1 yeah we're stealing all this
money let's steal some more
keep stealing money keep stealing money
and then let's go do what bad guys do
and degenerately gamble it on the maybe
doubler
let's drain that money watch my balance
go up see
six seven two two yo guys you can do
this with real eath too
but that's real money so don't do it
with really come here to cheap eath
where you know it's all fun and games
and we're making d5 fun again
right here if you guys forgot the
address it's cheaper.org
let's go let's go let's go
uh how many viewers we got right now how
many viewers we got right now
yo people are giving away cheap eath i
appreciate you all
look at that we just made three because
really bad guys stole them
we got 500 viewers that's great oh you
sent to test yo
i got you you're a good guy i'm gonna
hook you up with that money i just stole
enjoy three cheapies
all right uh let's get that maybe
doubler up again
how we doing 27 yo
let's hit it maybe doubler
seven let's gamble seven all right let's
see if it hits come on
come on that's either gonna go to six
seven
one five or six seven
uh two
nine yeah yeah six seven two nine go
we just doubled up on the maybe doubler
you guys if you guys want to get in on
the maybe doubler
that's the maybe doubler maybe doubler
is right here
let's go that was the easiest seven fake
eath i ever made
i hope you guys had a good time check
out cheap eat we're making we're putting
the fun in d5
i don't i don't know you know this is
just this was pretty fun actually
a lot of fun doing this and like real
talk real talk
i know you guys like when i say the
political bullshit
uh a lot of the world's infrastructure
now a lot of the world's systems are
way too complicated for you to just fuck
with you know a lot of systems they're
just systems built on top of systems
yo you know great always remember those
phone freak days when you could just
whistle the right tone into the phone
and make free phone calls and now you
got to overcome rap and death and all
that bullshit
but you know and the same thing with
defy it's like wow that's actually like
how much money wow that's a billion
dollars yo i'm not fucking with that man
people get shot over that kind of money
the great thing about cheap eath is
uh you know cheap is a party cheap eats
about generosity
cheap eats about love and cheap eats
about being the best l2 solution on
ethereum
don't tell uh you know optimism and
matic
and arbitrum yeah because cheapy yo by
the way guys by the way you know
people think cheapy it's all fun and
games until people are transacting using
the bridge
when we if we actually get the bridge
working we do a crowd sale and
everything
do i want to be a crypto ceo no i don't
and that's kind of the problem
but do i want to party do i want to
throw a d5 party
that all you twitches can come to i do
and that's what cheap
is you subscribed all right let's go
anyone who spams their address right now
let's just let's just give you guys some
cheapie so you guys can join the party
let's go i don't care if you're a
subscriber not a subscriber
getting them address spams right now
let's go let's go
if you already got cheapy don't ask for
more
i'm just going to pick some randomly if
you spam unless i see it multiple times
then you're a dirty spammer and you
don't get any
because cheap eats a party and you are
all invited let's go
let's go let's go
by the way join the discord um it's not
my discord
goku runs it you know you guys know i
don't fuck with discords
uh but if you do join uh the discord
there's a lot of good people
uh throwing a party you know yo goku
like the kid's just here to party man
like he's not
you know it's how fucked is it man all
these kids coming into this world and
like there's there's all this like
stuff flying around and
i mean in some ways it's crazy but in
other ways it's fucked
like like you you know who got fucked on
gamestop retail
you know who made bank on gamestop you
know like smart traders
um yo never sell guys i'm riding this
train to the ground
stupid get in on cheapies
it's super fucked nah but you know what
man you know what was super
fucked fucking world war ii man there
was some kids born during world war
ii and that shit was fucked like atomic
bombs and shit you know
having to like go under your desk you
know what never mind kids have never had
it greater
kids have never had it greater this is i
was part of amc i made bank on amc boys
kids have never had it greater i take
back everything i said
about the youth but uh if you want to
come party uh join the discord
cheap eath let's go let's go
now we'll send a few more we'll send a
few more we'll send a few more let's go
let's go
big screen get that 640 by 480
resolution
wow you guys are really spamming i said
you lost maybe doubler two times in a
row
wow you're bad at maybe doubler maybe
doubler is the best gambling contract
though
that's not true someone should write
better gambling contracts it is
it is yolo times on the cheap chain
by the way you guys know if you have eat
you already have cheap eat right so if
you have ethan an address
somewhere um
cheapies to the moon no you say that you
only get half a cheapie
because chibi's not going to the moon
it's staying on earth so everybody can
have a good time playing with it
imagine your dog went to the moon it
would die
yeah that's why chief eats days on earth
so you can pet it
and you can you know take it to like the
like dog you know dog run in the park
yeah
you know what i'm saying cheap not to
the ground whoa
whoa whoa whoa whoa that's like a boeing
737 max whoa
too soon man uh no it's um
cheapy stays on earth so we can so we
can play with it man
cheap eat to the earth cheap eat is the
soil
cheap is you guys must think i'm a wacko
um pink names yay i got you i got you i
got you
um but you guys know about the spirit of
cheapies just make sure you know
give it away oh what's the good guy
address you guys can like watch the
replay and chat
um but the maybe doubler address i'm
gonna post again because the maybe
doubler is a great game
the maybe doubler is the best thing to
come out of the stream
that's the maybe doubler so you guys who
you know you guys are all getting cheap
um if you send it to this address you
might get double as much gbeast
or you might lose all your gp
cheapy to the earth you know what you
know what's up i'm sending you two gps
oh wow that whole thing's pink wow
pink's pretty cool man i'm sending you
three cheap
that's right but no one else who does
pink is cool if you also try to do pink
you get
half a cheap beef cheap is the truth i
don't know about that you get point nine
g
teeth
you don't know you know what you don't
know you get point three cheap
should you just start mining tv if you
can um this is mining pools
all right point five cheap for pink oh
red jeep beef yo
yo you get point nine uh green oh that's
a nice color i like green red doesn't
get any i don't like red
you know what green you get 67 cheap
beef let's go
let's go you just got 67 and we're gonna
end it right there
thank you all for watching tonight's
stream uh you guys are
really awesome uh i don't know some of
you probably suck but i bet some of you
were cool
especially the people with stars next to
your name you're the best kind of people
uh thank you all for watching hello here
from las vegas and who are we rooting
for
we're rooting for the other guy not
usman who's the other guy burns
is his name burns what's the other guy's
name what's the other guy's name he
looked
i was watching him and he like like like
like he's a he's a
brazilian guy gonna kick his ass that
guy
um what's what that guy that guy that
guy uzman fight
who's the other guy who's the other guy
uh
barber versus grazo burns that's the guy
mr burns we're rooting for that guy
uh you know we got we got money on this
so let's go
if you want to put money on something
try maybe doubler thank you all for
watching have a good night everybody
WEBVTT
Kind: captions
Language: en
sl0wp0ke_lu: &lt;3
leDryPotato: PogChamp
sl0wp0ke_lu: Whats up?
tex01: Hi
capjackm: Yo
Bitcoin__: Bitcoin__ subscribed at Tier 1. They've subscribed for 14 months! 
Sylfine_Unreal: hi
Santiago_LHC: YO
K0enich: good morning
eldac_kno: wasssup
mikaeeeeel: Heyhey
Mig1939: hey George!
DaMiniBeast: hiii
malana_cream: yo!
就很棒: :)
calebsuhy: hai george
Ne0Zer0: HeyGuys
furure_jedi: are you buying bitcoins ?
Deno_____: George I have a book recommendation for you: kalam cosmological arguments by mohammed hijab
ricardosmf: suuuup
TheSkapegoat: hi from Australia
sl0wp0ke_lu: Yooo
boosteraftermath: Hello
Santiago_LHC: Morning George
unluckychickenn: squadL
jonathan_haeberle: Hey!
boosteraftermath: Hello from India
soldierheadsmite: morning
InfiniteReddit: hi from aus
tex01: hello
DaMiniBeast: hi George
nasko0op: hi
anthonykwan: Night ! from Hong Kong ~~
mikaeeeeel: Do we hack the servers of the who today? 😄
adam_xxd: hi
siriusblack189: hello from india
axlebear: HeyGuys HeyGuys
ogrockefeller: Dad!
Santiago_LHC: I saw it
easysleeep: hey George. Where in SD did you move? I grew up in North County, Del Mar.
ogrockefeller: Father Hotz!
Santiago_LHC: I might submit one
danilosh45: Hi doc
aayaanamir: hello from Pakistan
joseanavarrom: What are we doing today??
c0sm3s: hey yoo
dawae_shw: hey cheers from Spain
detroitwiller: Germany wie gehts
Mig1939: george what do you think of YOLO?
ogrockefeller: Hacking session in full effect
tex01: hello
generated_human: Hi from Russia
mikaeeeeel: Gut gut
balloonpopa: Hi, I caught a live stream
Santiago_LHC: Nooooo, we love this apartment
kornez: PogChamp
henri2777: recht gut
boosteraftermath: but we love this apartment
krefsan: Hi from Peru !
aar0npham: aiyah
boosteraftermath: but we love it
pzuko7: hello from bermuda triangle
ogrockefeller: You should try to hack a Fleshlight Launch
jib1337: PepeHands
vovko_codes: @georgehotz what car would you recommend to run by commaai?
hichm19956: hi i'm from morocco 🇲🇦
furure_jedi: how can I donate you in bitcoins?
siriusblack189: I am writing nn for Tetris
capjackm: Are you staying in San Diego ?
aaddrr: ?????
markov010: hey !
th3_maj0r: yoyo
duzy: yea mic is good
Jehhred: Moving to San Fransisco?
ogrockefeller: Daddy Hotz
grahamstephan420: yo
ionelaipatioaei: how much is the rent?
mikaeeeeel: What is it actually about?
ogrockefeller: SF is cancer lol
GandalfTheGrayOfHell: @georgehotz what we doing today
meeeeeeeeeeeeeeeeeeeeeenz: george, changing the subject quickly, could you tell me the different between linear regression and logistic regression?
Santiago_LHC: So many memories in this apartment. We cooked together
grahamstephan420: comma.bio
jonathan_haeberle: What net are you training in the background?
DaMiniBeast: what we hacking today george??
balloonpopa: What ever happened with the protein folding?
furure_jedi: how can I donate you in bitcoins ?
anthonykwan: where u move then ?
boosteraftermath: How's it feel being an overachiever?
zooooodiac: what computer u use?
mikaeeeeel: Your thoughts on corona?
s4j0k5: saw you were looking for an app developer will some fucntions of openpilot be converted into an app?
axlebear: shots fired
pzuko7: !ide
Santiago_LHC: Don't start with the dumb questions, guys
vrv_exe: SD &gt; SF
pzuko7: !commands
aaddrr: are there good taxes in SD?
krefsan: Any proposal for autonomous delivery robots with comma tech
theonlymonkas: Hi
Fatmetheny: Nice travel and outdoor stream. (I'm a non-sub please don't ban me for this criticism)
aaddrr: I would subscribe if I understood half of the shit he does
Santiago_LHC: "crap papers", I smell a new song
joeleonard212: joeleonard212 subscribed with Twitch Prime. They've subscribed for 2 months! 
sampleaccount123: Papers are from Arxiv Sanity?
dmfj_io: dmfj_io subscribed with Twitch Prime. 
gal40: What's MuZero?
eduardoadf1: have you ever worked with verilog
meeeeeeeeeeeeeeeeeeeeeenz: george, changing the subject quickly, could you tell me the different between linear regression and logistic regression?
DelusionalDreams: DelusionalDreams subscribed with Twitch Prime. 
luspr: luspr subscribed with Twitch Prime. They've subscribed for 2 months! 
aptgetmark: yo man whats up
kiwikili: kiwikili subscribed with Twitch Prime. 
gal40: By dynamics you mean physics, or something else?
C4TFive: gotta publish to get funding!
Santiago_LHC: LOL
aaddrr: LULW
luspr: loved your prediction episode!
rkxbz: @georgehotz is fortnite going to be first step to move into simulation?
InfiniteReddit: where do you go to browse papers?
aaddrr: i would also like to know
Santiago_LHC: "Do parachutes matter", deep question
vrv_exe: Do you constantly review ML papers or do you read them according to what you are trying to solve?
Newlax: if you want to live
jib1337: Free paper Pog
yoyo_brobro: yoyo_brobro subscribed at Tier 1. They've subscribed for 12 months! 
aaddrr: how do you test that lul
kornez: how many ppl without parachute did they drop off the plane? LUL
michaelkawwa: I'd imagine lmao
TheStudentDoctor: This was a tongue in cheek paper to illustrate the debate between RCTs and observational research to guide medical decision making
Newlax: test if parachutes work George
gorodinskiy: https://youtu.be/6qF_fzEI4wU
Santiago_LHC: QUANTUM PARACHUTES, they both exist and they don't at the same time
C4TFive: sound like more fun than russian roulette
AThousandHours: um.....
yogi_1010: hmm...
jib1337: I see...
dr_set: !uptime
Cutter1998: Gravitational challenge XD
Newlax: free skydiving
jib1337: Only 23?!
harmanthebest1: @georgehotz plz change the category right now it is travel &amp; outdoors
buddhm: am i tripping?
OutsideGuidance: Heya, company that i work in is going to medicine in next year or two, making IoT devices that would be affordable to many of us and Im thinking to switch my current position to some programming, maybe some AI would be useful and i could jump ahead of time for now. What do you guys think? Even tho i got no programming experience
AThousandHours: 0 mph
yogi_1010: WaitWhat
hue88: they basically killed people ?
aar0npham: lo
leDryPotato: LUL
wholesome_pepe: how do u even placebo this?
siriusblack189: learned pytorch watching twitchchess
ViktorTV: @hue88 a total of 0 people died
jib1337: How many seriously injured
Kertoip007: PyTorch or TensorFlow, what's your opinion?
eldac_kno: what do you think about Yandex self driving car? sorry if a bit offtopic
Ne0Zer0: LUL
bichid69: why are we not folding proteins?
TheStudentDoctor: @outsideguidance start with the basics in a language that'll be useful for that field e.g. Python
matthewmirman: Seems pretty analogous to the situation in RL
hue88: that doesnt make sense, they said that parachuted didnt reduce death, does that mean that they woudl survive when jumping without a parachute ?
roussillon: LUL nice troll paper
chillguy269: LUL
Newlax: don't take drugs before skydiving boys
funwayz: so next time don't take parachute, save some money Kappa
yungtoad1: JonCarnage
garydsmith1: wtf what is that?
michaelkawwa: im so confused
ViktorTV: @hue88 your iq is to low to understand
OutsideGuidance: @TheStudentDoctor thanks! :)
michaelkawwa: did i just get r/woooshed
robotboy987: what the fuck
C4TFive: she didnt even try to pull her parachute, shes a goner
aar0npham: i guess they have to do it now 9000 m high
grahamstephan420: Why is your search engine google and not Yandex?
hue88: @ViktorTV Must be too much of an peasant to understand your jokes
DaMiniBeast: oof
chillguy269: But I want them to work, so I am going to slant my paper
god_damn: when will he be playing fortnite
yungtoad1: PunchTrees
PhosphoricAcid: LUL
kornez: LUL
yungtoad1: MrDestructoid
garydsmith1: duckduckgo?
DaMiniBeast: george, ily no homo
YouPowerRush: wot
bichid69: what's that green shit you're drinking?
Den_dp: lirikLUL
niclasrst: SirSword
Prinz_Sissi: LUL
hanycodes: why do you use jupyter ?
Newlax: prove it
yungtoad1: TheIlluminati
akotirous: The russian bot is getting really advanced
MrGwopz: @georgehotz yoo how did u jailbreak the ps3?
C4TFive: you can tell its real because its in a jupyter notebook
gal40: What do you mean by "dynamics"? The Physics branch?
yungtoad1: TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati TheIlluminati
Tekrific: Yandex is only good for image searches, for other stuff it's crap
pedroriseo: are there some paper for drinking chlorine?
gorodinskiy: was the alpha go written in go?
Cutter1998: wait you're not a Russian bot? unsubbed
mattdougherty22: do you know Alex Guzey and his sleep studies contrary to Matthew walker?
tarunaditya: :p
nvmem2: @cutter1998 you’re not subbed to begin with lol
siriusblack189: like tetris ?
PhosphoricAcid: are you instagram famous yet ?
StapoTV: why is it so rare to see recurrent nets being used in RL?
garydsmith1: hey george whats your daily rotine?
GandalfTheGrayOfHell: George on Egirls Kreygasm id pay for that
wholesome_pepe: LUL
DelusionalDreams: we got u pal
norsesage6934: norsesage6934 subscribed with Twitch Prime. 
ekalsuwaidi: squadW
gamester2665: youza cutie
WickedSidereaI: i want to lick your feet
robotboy987: you should sell bath water
nvmem2: I’ll sub to your only fans George
MrGwopz: how did you jailbreak the ps3 ive been a huge fan of u since 2011 i am just very curios on how you done that
fleischfleisch: heyhey
DaMiniBeast: George, I wanna learn to code, any tips??
InfiniteReddit: where do you go to browse papers?
sircuss: Your category is still Travel and Outdoors
Deno_____: george I wanna hack instagram any tips?
ogrockefeller: Father Hotz
isalhi: When openai was good? Doesn’t that imply they’re not anymore :)
DaMiniBeast: @deno_____ lol
calcmath: !uptime
CaptCalifornia: Ah yes, a premium Travel and Outdoors stream
ogrockefeller: Are you a Corona fan?
h6m9d: bleedPurple
CaptCalifornia: KEKW
DelusionalDreams: Whatś your opinion about RL applied in self driving cars?
CaptCalifornia: BloodTrail
Avelansh: Yo George Go or Rust?
GandalfTheGrayOfHell: @georgehotz what about transition states in a game like Dota 2? such complex environments?
phrixus_bro: Fitness and Literature
markydothh: Hey George!
funwayz: basic programming :)
DaMiniBeast: hEy GuYs, BuY mY oNlY fAnS
eldac_kno: What do you think about Winograd Schemas
GandalfTheGrayOfHell: @georgehotz what about transition states in a game like Dota 2? such complex environments? OpenAI did manage to give pros a run
axlebear: indoors
yungtoad1: SuperVinlin
symbiiote: @DelusionalDreams what is RL?
majorawpsome: dota 2 more like starcraft 2
grahamstephan420: You should make a brainfuck compiler in brainfuck?
bjorkthedog: Do you have a reading list? A list of some of your favourite books? @georgehotz
hanycodes: do you use perf ?
Newlax: you should make your own crypto for comma
ogrockefeller: Dad
urhentom: what's the scar on the face?
CaptCalifornia: CaptCalifornia subscribed at Tier 1. They've subscribed for 7 months! gang shit 📡
DaMiniBeast: George is underrated
CaptCalifornia: when we gonna get a cool sub icon 😔
mhammad123: ay man wasap
bichid69: BRO why don't we use AI to invent AI
xenozork: hi george
eldac_kno: have you read Art of Programming
Deno_____: @georgehotz Do you believe in the possibility of there being a god?
DaMiniBeast: hey George, I wanna learn to code, any tips??
eldac_kno: read art of programming
axlebear: axlebear subscribed with Twitch Prime. 
b1nk: just code lol
Newlax: is this a cult if I need to pay?
arakis_djall: Didn't realize... watched your old rap video about a large gaming corporation. Wow.
sceptix1337: did the villin fold?
grahamstephan420: That was t0mcr00ze not George
bichid69: @DaMiniBeast buy a dildo
moshiko777: what are we doing today ?
harmanthebest1: @georgehotz series idea write chess like you did but using muzero
l1ttlemtman: did you watch the documentary ?
siriusblack189: tetris would be nice
leander_ms: Hello George
moshiko777: you gonna do a machine learning course in some point in the feautre ? you're really good at it
Deno_____: lolita express safest form of flight
toninoblack: go tetris
mrgh0st0: Snake ?
GandalfTheGrayOfHell: LUL
leander_ms: why did he switch to chromium?
Santiago_LHC: Tetris is not atari, except maybe a port
michelfugain69: hi do you think we have to be goot at maths to do machine learning ?
eldac_kno: have you read Art of Programming
le111an: Hi George, awesome channel
Digital_donger: yeah tetris was stolen from the soviets
natz42_: would be fun to reverse
Santiago_LHC: The story of the creation of Tetris is fascinating
sentoprak: @georgehotz hi, ım from turkey
PhosphoricAcid: their own mk ultra
siriusblack189: already i wrote nn for it
le111an: Pajetnikov was an author
fleischfleisch: alexy never earned a penny afaik
Avelansh: Beat by the Russians again
le111an: https://www.youtube.com/watch?v=_fQtxKmgJC8&amp;t=1861s
Newlax: do a media share stream
elmixy: Privet vsem :)
sheveeee: what documentary? @harmanthebest1
vrv_exe: There’s a pretty good documentary on yt for Tetris. Lot of BS took place w that game
le111an: Privet :)
Deno_____: @georgehotz do you think believing in matrix is a more rational belief than atheism?
PhosphoricAcid: polybius*
eldac_kno: Джордж Хотц русский хакер, подтверждено
le111an: Ti tak dumaesh ?
vrv_exe: Russian government stole it from Russian indie developer
le111an: Я не уверен :)
eldac_kno: интересно он умеет читать по русски?
Digital_donger: tetris side effects WutFace
jakeglenn: my first time on stream
anuj_: what's up with the starlink satellites. why is USA put 9000 satellites in space
jrrbls: Google polybius
Santiago_LHC: There are hundreds of Tetris variants
le111an: Ну на крайний случай скопирует в транслейтор
mhammad123: george da fuq we doin today
majorawpsome: a computer might be able to beat the world champion of chess but there's no way they will able to beat a human at tetris
niclasrst: niclasrst subscribed with Twitch Prime. They've subscribed for 2 months! you're the best!!
eldac_kno: Джордж Хотц не умеет программировать
le111an: А что он хочет сделать ?
Avelansh: dev.to is new medium
le111an: Я поздно подключился
buddhm: Has anyone ever suggested for you to set up an eyetracker so its easier to follow your pathway?
Newlax: do a typing test stream
michelfugain69: That's deep
michelfugain69: Kappa
funwayz: some 5Head shit
hoffs: very deep
leander_ms: Deep bro
eldac_kno: не знаю, он читает бумаги про нейронки
PhosphoricAcid: so woke at such a young age, so brave
le111an: Да но последние все стрпимы он читает эти бумани по нейронке и что ?
Newlax: abstract art
le111an: Тензорфлоу заметил
le111an: А задача то какая ?
gyne: jargon PogChamp
eldac_kno: научит машины ездить
ralphielaurence: дисрапшн
Santiago_LHC: Disruption has become a product in of itself
Deno_____: @georgehotz can you do a stream ranting about religion and atheism and all that stuff
Ne0Zer0: rumsfeld was ahead of his time LUL
majorawpsome: or the boondocks
michelfugain69: wtf
eldac_kno: What do you think about Winograd Schemas?
michelfugain69: I don't understand I'm stupid
mritzing: wmds
mariusmafius: Clayton Christensen
RexRothx: Plato's statement on ignorance
ak0ya_: разобраться в мюзеро
raisedbyphantom: some bioshit
arakis_djall: but for 98% of companies disruption was having a website in 2005. It can be relative; if the definition has been taken over by those 98%
eldac_kno: он опять забросит это на полпути как всегда
fleischfleisch: biology is nice BibleThump
lambdaman0f: lambdaman0f subscribed at Tier 1. They've subscribed for 2 months! how is it going with backspace.ai?
Digital_donger: but a curved tv Kappa
le111an: Да ? Я особо за ним не слежу
grekler3: !uptime
le111an: помню его по Ultrasn0w
buddhm: corona virus known unkown?
fleischfleisch: do you do any sports georgehotz?
leander_ms: What is medium? Never heard of it LUL
mistertenko: What's the most disruptive thing since you were born?
twinkiee: hi, my main lang is not english and i do not fully understand your speech. For this, can you implement subtitle with python? Kappa
Santiago_LHC: It's precisely because it has become so overused of a notion, that if so many things are "disruptive", then nothing is.
roussillon: so only time tells us what ideas were disruptive ?
arakis_djall: today having "AI" for companies is disruption, even though it's just a bad linear regression implementation for their marketing data.
l1ttlemtman: l1ttlemtman subscribed with Twitch Prime. They've subscribed for 4 months, currently on a 2 month streak! Hello, have you seen this https://www.youtube.com/watch?v=WXuK6gekU1Y about AlphaGo ?
eldac_kno: thoughts on Winograd Schemas?
TheKoreanZombi: What does this have to do with Manifest Destiny?
l1ttlemtman: it is really good
PhosphoricAcid: bean bag chairs
mgstrein: what do you mean when you say 'it is not zero to one' I think I missed the reference
l1ttlemtman: I enjoyed it a lot
Newlax: pog
be9ns: any haskell projects besides building a compiler?
hanycodes: are disruptive ideas important ?
Deno_____: @georgehotz what created the universe
Sycto: its a pretty good watch
l1ttlemtman: haha.
allrz: just do it
grekler3: D:
Avelansh: watch it with us
ArcherCreatlol: watch it on stream PogChamp
omarmiranda: is pretty good actually
allrz: come back later
YouPowerRush: h e h e
leander_ms: haha fine
PhosphoricAcid: ez content
GandalfTheGrayOfHell: DansGame i came here for some code
calcmath: he gave up go because of the AI
chillguy269: @l1ttlemtman way to go you made him leave
Newlax: on stream
arakis_djall: @mgstrein was a book by Peter Theil (sp), Zero to One.
darthbearjew666: Do you ever use Wolfram Language ?
funwayz: alphago — when we beat outdate stockfish on cpu :)
Digital_donger: okay later haha LUL
omarmiranda: hahaha ok !
Deno_____: @georgehotz DONT DO IT
aar0npham: lol
hoffs: lmao
emel_ryan: he's sabotaged us with the sub lol
aar0npham: later
maddyakhil: we can watch it together
omarmiranda: see ya later then
be9ns: fucking goat
TheKoreanZombi: Later!
aPosterior: that smirk tho
Santiago_LHC: GUYS, this is your fault!
allrz: do it
sinisa_koscec: do it, its nice
Newlax: :(
jsnfly: damn
zooooodiac: looooooool
allrz: DO IT
sobol55: please no
leander_ms: That is one of the best things ever LUL
mrhdr: Jebaited
kornez: Jebaited
mrgh0st0: yeyy
Den_dp: so how was it
maddyakhil: back LUL
Santiago_LHC: Was it GOOD?
Ne0Zer0: LUL\
Ne0Zer0: LUL
kornez: HOW IT WAS PogChamp
maddyakhil: was the movie good LUL
Digital_donger: Jebaited
a_ato: zoraoCOFFEE
Digital_donger: maybe he watched it at 50x speed
johnwill86: yoyoyo!
hurzg: was alphastar also done with muzero?
le111an: What was the result of the coronavirus stream? I didn't watch it fully
LiveCustoms: yooo. geoooo
l1ttlemtman: yo
luspr: Using Tensorflow instead of PyTorch ? DansGame
l1ttlemtman: what was wrong with the movie
l1ttlemtman: i dont remember it being so short
le111an: THX !
Santiago_LHC: Flu is pretty scary
norB88: Whats ur paper reading methodology? Are you usually searching for something? Or what parts are you especially paying. attention to etc?
THX1342: hi @le111an
sceptix1337: what about the villin?
le111an: hi thx1342
Den_dp: F
Den_dp: reiraF
luspr: The lockdowns are terrible. Fortunately, the discours changes towards opening. Here in Europe many countries are already opening uo
god_damn: need shkreli bro
l1ttlemtman: germany keeps making wrong decisions
asaalgk: flu has an IFR of 0.04%, covid has it between 0.2-1%.. how is that a a 3x? the 0.1% flu statistic that has been circulating is the CFR which is a meaningless stat
l1ttlemtman: and opening up
sircuss: what happened to watching the Alphago movie?
mhammad123: here in the uae they are opening up malls again
mrgh0st0: we can inject some disinfectant into people
osuiw: is that a broom
Penguino138: @georgehotz whats the meditation app you used in previous vids?
Lizardan: Tensor Flow KEKW
raystriker98: he's back!
YouPowerRush: wot
5punnr1ng: Hi Gehot I want a child from u😍
re1mond: hi, mr.robot!
re1mond: !uptime
Lizardan: he doesn't sell children
garydsmith1: !uptime
THX1342: i haven't taken a deep dive but as far as I went there have been studies during this and previous pandemics showing the effectiveness of lockdowns.. don't know where the controversy is
Ne0Zer0: Lizardan LUL
osuiw: @5punnr1ng i am selling some around the corner
calcmath: can you increase font size of code?
5punnr1ng: How much
5punnr1ng: For one?
hayewood: sup george
osuiw: @5punnr1ng 10$/kg
ralphielaurence: what's he doing?
Penguino138: @ralphielaurence looks like some physics programming
osuiw: @ralphielaurence some stuff here and there
ralphielaurence: what's this nn?
5punnr1ng: @osuiw i‘ll take your youngest one!
Penguino138: @georgehotz what is the meditation app you use?
osuiw: @5punnr1ng no
l1ttlemtman: i dont understand why deepmind puts so much effort into reinforcement learning. google learned from nlp that too much compute breaks research, deepmind is close to doing so
OttoCavalry: What is he doin?
JAKWAI: could u do a chaos pendulum with this?
5punnr1ng: Why?
Santiago_LHC: @Penguino138 Headspace
osuiw: the one with the orange lad @Santiago_LHC ?
AThousandHours: got bored of movie? LUL
dontbeameme: Pablos Holman your idol?
tinkerzwhothe_t: hey teach me html
Relic69: hi george, do you have a recommend way to get into hacking and stuff?
Penguino138: It's now a great day that George is back streaming
ancientchineseelder: @Relic69 read hacking: the art of exploitation
l1ttlemtman: show all your papers
samosasauce8: What's your favorite text editor?
THX1342: watch Hackers
Santiago_LHC: People, enough with the off topic questions
Relic69: @ancientchineseelder ty, will check it out
Kyoto_o: stop telling me what to do @Santiago_LHC
Santiago_LHC: Make me
god_damn: @Santiago_LHC stop telling Kyoto_o what to do
dontbeameme: From someone like you I would expect more amazon free trial primes
Santiago_LHC: Okay, I will listen to you
Kyoto_o: @god_damn: @Santiago_LHC stop telling Kyoto_o what to do
phrixus_bro: balanced ez
amaranthion1991: Pog
SurfCat: Ey, Goerge online on this lovely day. Very nice, glad you are online hope all is well FeelsGoodMan 👍
JAKWAI: can someone explain me what MuZero is?
Santiago_LHC: Google it?
ShredderSherlock: is that animation of the progress bar part of the jupyter notebook or the code?
l1ttlemtman: how can this be so fast on a cpu ?
calcmath: its from the code
ShredderSherlock: ty @calcmath
JAKWAI: ok got it somehow ty :D
Beraton: !uptime
nitrixen: @shreddersherlock Trivial to do with \r to bring the cursor at the start of the line and write over it.
Ne0Zer0: LUL
ShredderSherlock: what?
god_damn: FeelsGoodMan neat
BetaMalePaypig: &lt;3
11plus4thinking: PogChamp HES STREAMING
nitrixen: @shreddersherlock When you print the \r character, you get to overwrite your current line.
ido_nvidia: do you use dqn?
cktreon: When are u going to da a hacking stream?
calcmath: look up tqdm python package to mae your own progress bars in code
Penguino138: Penguino138 is continuing the Gift Sub they got from aar0npham! 
vlsbrd: what happened to alphago?
amaranthion1991: "whitecap hacking"
Penguino138: @georgehotz thanks for all you do! Your streams are great and I always play them in the background while working
garydsmith1: can we get another python tut?
chairman_Z: @georgehotz do u ever drink hot tea...
DiiCE3: weve seen some bug bounties in our day
dontbeameme: Lolool
sceptix1337: black hoodie hacking
ralphielaurence: that's a way to look at it..
OttoCavalry: kevin mitnick xd
dontbeameme: All marketing is hacking/manipulation
THX1342: the latest infosec twitter hashtag is #whatrealhackerlooklike or some shot.
amaranthion1991: @georgehotz Did you ever hear about Dan DeFelipe hacker dude ?
THX1342: pathetic
11plus4thinking: LUL
Farafire: Have you learned AI on your own?
Penguino138: @georgehotz I look forward to continuing being a loyal subscriber! Keep up the great streams!
Greaser_1: :-)
chairman_Z: what does rm mean?
Den_dp: remove
garydsmith1: re name?
garydsmith1: oh
THX1342: only real "famous" hacker right now is phinneas phisher
chairman_Z: @Den_dp thank you friend
emel_ryan: it's how you delete in command line
calcmath: does rm 0 out every bit on the HD, is that why it makes so much noise?
famousdex: 5Head
wssheldo: did u end up folding the protein?
calcmath: i thought it just deallocated the files
fillmyvoid: wow lmao
god_damn: we do not forgive B)
dontbeameme: When views are botted, downloads botted, what is real?
Penguino138: What kind of tea you drinking on @georgehotz
calcmath: then why does it make noise?
Avelansh: thats how i feel when i listen to todays rap/hip-hop
THX1342: vulnerabilities now are named with emoji....
mistertenko: It's funny, and I'm tired of pretending it's not
hayewood: an nymnO n nymnO my nymnO us
Bazingaka: alias rm='stealthrm'
garydsmith1: can we get a python tutorial? merge sort this time?
THX1342: ArgieB8 🔫
bill1929: trust me cuz
nitrixen: This is why we made SSDs.
nitrixen: Rebalancing the forces.
s4j0k5: is comma planning to port some features to an app
sceptix1337: inb4 george is an ancap
calcmath: government has monopoly on violence
DelusionalDreams: Whereś a good place to get started with comma?
Penguino138: So true, govt just changes teh name of their mafia-esque activities
Tekrific: both play on trust too
dontbeameme: Lolollolol
fillmyvoid: I don't know if I'm *that* anti government
THX1342: https://unicornriot.ninja/wp-content/uploads/2019/11/hackback-announce-text.txt
funwayz: libertarian hotz monkaS
dontbeameme: MK ultra
gamester2665: There was a network error. Please try again. (Error #2000)
Kreunt: eviscerate the proletariat
dontbeameme: People need balance of fair and unfair
Penguino138: Roooon Pauul
OttoCavalry: Ancap memes are the best
ShredderSherlock: oh lord
Tekrific: changes should be selected for actual changes we want to keep in the future
MrGwopz: do you think freecodecamp is a good site to learn coding?
hayewood: gold KKona
zrman331: In any way, civilzation needs a pyramidical structure of power
phrixus_bro: going up baybeee
Snowlav: what would you call genuine good people, and do you think there's many left of those?
boxofninjas: wonder if the price of track pants have gone up
dontbeameme: Government keeps gold prices stable like BTC
anguscupcake: what if u write a government AI
THX1342: that's called HFT @anguscupcake
Penguino138: I'm glad we're all finally moving past COVID news and moving onto new topics
phrixus_bro: karenocracy
THX1342: and it is deployed
calcmath: the economy is the first artificial intelligence humans created, its decentralized and out of our control
dontbeameme: Everyone has agenda
Iliftmymousealot: wow i am late to the party
Tekrific: boomers are a meat mountain that needs to be decomposed
hiredguns: !uptime
Iliftmymousealot: george give us that cure
Iliftmymousealot: we need the cure
Iliftmymousealot: !!!
numinousloop: excluding the self-driving car space, who doing the coolest work to build the infrastructure of the future
dontbeameme: what is this carona virus situation? More people die from car accidents?
Penguino138: @georgehotz do you ever plan trying to fold proteins again or other biochem programming?
numinousloop: who do you think is doing*
shiftpgdn: shiftpgdn subscribed at Tier 1. They've subscribed for 2 months! 
norB88: https://www.amazon.com/Way-Men-Jack-Donovan/dp/0985452307
hiredguns: scarry part is even asymptotic ppl have lasting lung damages
Iliftmymousealot: recommenders are cool aswell
MrGwopz: what are you coding right now?
hiredguns: there are couple of divers had covid19 asymptotic and won't be able to dive again
shipteri: poulChat poulChat
anguscupcake: there's probably some lung herb in ancient chinese medicine that fixes it
sceptix1337: who names their variables v_0k
zrman331: @hiredguns you got any info on that? Im genuinely interested since i havent found good info on stuff like this
mariusmafius: @sceptix1337 mathematicians
Penguino138: @anguscupcake Ask Qin Shi Huang, he was an old Chinese Emperor that drank mercury to live forever :p
sceptix1337: they eat tiger dicks for potency in chinese medicine
norB88: @Iliftmymousealot reccomenders are cool!
Iliftmymousealot: these biohackers
anguscupcake: maybe the ones that survived past 210 BC ;)
prostate_v: just got here, what're we doing?
enton29: geo say porco dio
imshaez: imshaez subscribed with Twitch Prime. 
DelusionalDreams: What about End to End models for self driving cars?
Penguino138: His tomb is protected by the terracotta statues and is theorised to contain rivers of mercury
gorgoleon89: Can you code a hack for me to get a girlfriend?
shiftpgdn: all of my variable names are the letter a in various lengths, like a aa aaa aaaa
Joselinis: True
reformed_human: u just have to search harder
shipteri: @gorgoleon89 come on,finding girls is easier that to write hello world in c
Penguino138: More info makes it harder to search, but when all you find is BS it makes it real easy
01_pollux: @georgehotz did you read wolframs blog?
fillmyvoid: when did MuZero come out?
calcmath: can you increase font size of paper as wel, so we can read along
dontbeameme: But they learning how to make people believe the lies, like a BETA
Avelansh: you just have to develop the ability to think critically and not take everything you hear at face value
01_pollux: new model coupling quantum mechanics and theory of relativity. I love it @georgehotz
ferric: !school
CaptCalifornia: wait did you watch the alphago movie
gorgoleon89: @shipteri teach me master.
Iliftmymousealot: getting really philosophical here, oof
ferric: Did you study Computer Science at college/uni or self-taught?
garydsmith1: can we get a python tuts? merge sort this time?
norB88: https://theportal.news - Trying to make a new way to consume news. Separate facts from opinion and emotional manipulation.
pelegogrosso: How intelligent is geo? and what he is doing?
dontbeameme: They made skinny jeans popular
dontbeameme: Mind control
shipteri: @gorgoleon89 just speak to every girl you like.There is no way that at least one wont like you
dontbeameme: True true
Iliftmymousealot: @pelegogrosso geohot has 400 iq. I read it on the internet.
Snowlav: what's the mistake? veiThinking
mistertenko: What do you think about Sweden strategy?
anguscupcake: the mistake of not being taiwan
Penguino138: That's gonna be a lot of apologising if anyone ever decided to for COVID
gorgoleon89: @shipteri thank you for these wise words sensei.
garydsmith1: can we get python tut? merge sort this timr?
Ne0Zer0: oil? what oil? bxtch you cooking?
Rekkeno: "I take no responsibility"
YouPowerRush: yee
calcmath: dont they say that if we acted ontime for coronavirus its going to look like we made a mistake and overreacted
mhammad123: Do u think that corona virus is man made?
anguscupcake: no because you would see underdeveloped countries get swarmed
pelegogrosso: why we ask for him to do a iq test?
shipteri: @gorgoleon89 body language is very useful too.
pelegogrosso: dont
fizziblytwitching: I'd rather look like a mistake and people not die than people die because someone is worried about how it will look
Santiago_LHC: He argues that the lockdowns are a mistake. But without them, you get completely saturated health care systems, lack of essential supplies, and people dying that shouldn't be dying. So I don't understand the logic.
gorgoleon89: @shipteri touching an shit right?
bottonresult: @anguscupcake like equador?
r00tkey: !uptime
gorgoleon89: @georgehotz gaming stream when?
garydsmith1: 30mins
b2kemann: Still not using Jupiter lab George?
MrGwopz: what is he coding?
r00tkey: What am in missing?
janpoonthong: Can you zoom in I can't see your code
bottonresult: he could zoom in
calcmath: I dont understand his logic either
garydsmith1: :(
calcmath: he is coding an RL agent to balance a stick
r00tkey: hmm
akrwp: Connection lost?
gorgoleon89: anyone here in chat that can actually code? :D
bottonresult: me
calcmath: i can ..
r00tkey: yep
ferric: i can but im very new, I know java and learning python rn
mariusmafius: o_0
djguslim1337swe: we solvning P vs NP?
anguscupcake: been coding for a decade
gorgoleon89: @anguscupcake ok boomer
StapoTV: wait, isnt RL what commaai would use for driving?
Iliftmymousealot: @gorgeleon89 what do you mean by "know how to code?" What qualifies someone to know how to code? A diploma?
anguscupcake: dunno math though
god_damn: @anguscupcake same bro i can code but im closer to braindead than not
shipteri: @gorgoleon89 you can touch but only at specific body parts like elbow waist.It depends on you well you know the girl.
calcmath: yes startover plz
bottonresult: ZOOM IN
gorgoleon89: @shipteri i struggle at openers though
calcmath: also zoom plz
gorgoleon89: not goot at small talk
fillmyvoid: yep
choppingitoff: Explain the imports please
SofiaLouise: what happend with the movie?
skut1212: hey george! What resources would you recommend to programmers on learning AI?
sceptix1337: write tf from scratch
DelusionalDreams: where can i get started with comma?
MrGwopz: what are you coding?
garydsmith1: geo writes tf from scrath in one night
gorgoleon89: @georgehotz please code an AGI on stream and take over the world
alexlucas__: alexlucas__ subscribed with Twitch Prime. They've subscribed for 2 months! 
calcmath: coding an RL agent to balance a stick
shipteri: @gorgoleon89 yee i feel you , you can go at a place that dont know you and speak free so you can train it.But you must not fall whatever they tell you.Some bitches are hard
bottonresult: i
OutsideGuidance: How do you develop this level of understanding in everything? I seem to forget a lot of things with time :(
Penguino138: Does anyone know the alt code for mu off the top of their head?
kayoeyumisaolegais: !uptime
gorgoleon89: @georgehotz who is your favorite waifu?
Santiago_LHC: @OutsideGuidance motivation, genuine interest
kayoeyumisaolegais: how long is george streaming?
z00fle: @georgehotz is advertising a scam?
garydsmith1: 30 mins
Izimoney92100: !uptime
lovewave_: do you think quantum computing is any useful for current algorithms as of right now? @georgehotz
rkxbz: can someone explain geohotz's workflow (vim + tmux) that he talked about in Lex Fridman podcast?
calcmath: tiny neural netowrk
Penguino138: Yessir neural nets
Iliftmymousealot: not really to be honest
numinousloop: for sure, this is great
calcmath: i am following
garydsmith1: no one following
toninoblack: following
routerkicker: Simple stuff
lanyxqt2: i just got here
chaprio1: no, but it looks cool man
god_damn: nah i dont know shit
shipteri: @gorgoleon89 you can find some ready crosstalk just for fun.After that you have to tell whatever you feel.If he has super ass,tell her something funny about it. Some will like it,other will not xD
c0lemak: idk what's going on
garydsmith1: we need python tuts merge sort
DelusionalDreams: how can i get started with comma?
Santiago_LHC: I'm reading the MuZero paper while I hear you
hiredguns: trying to keep stick upright?
routerkicker: stop assuming everyone's an idiot george
michaelkawwa: for real
pyentropy: @georgehotz opinion on life homochirality? (L aminoacids, R sugars)
z00fle: yay
rkxbz: i cant understand nothing, but it is very interesting
Penguino138: dont worry @georgehotz many of us here follow and find it very stimulating
bichid69: oh ur back!
gorgoleon89: @shipteri training makes a master
r00tkey: @gorgoleon89 Man don't compare yourself with others, George is doing it for several years and you might have just started.
DelusionalDreams: this isn rocket science bruh
Iliftmymousealot: yeah but how do you filter all these people out through all the noise, the people which actually contribute something valuable to the stream
bichid69: you seen the whole movie?
Iliftmymousealot: i dont
plazmacsgo: you slit it in the middle
symbiiote: roses are red, violets are blue, George Hotz better than Elon Musk.
shipteri: @gorgoleon89 yeah thats why if you are very shy,just go to a place that you will not ever go again and speak free xd
bufferovrflw: @georgehotz long time no see, what happened to the corona stream?
hiredguns: was it splitting random or half?
Ne0Zer0: lip lol
ogsixaxis: good morning &lt;3
gorgoleon89: @r00tkey i am learning python this shit is too advanced for me to understand
Pitzthistlewits: 😬
ogsixaxis: bruh this is basic python
DelusionalDreams: i would rather do a quicksort haha
plazmacsgo: @ogsixaxis but merge sort is not that basic
plazmacsgo: you know..
elmixy: PogChamp
gorgoleon89: i am 2 months in my dude
guccibruf: PogChamp
Iliftmymousealot: the great coof
gal40: Merge sort is absolutely basic...
funwayz: from monte carlo tree search to mergesort real quick Kappa
garydsmith1: how are you atually doing it?
iifiryth5429: Can you not just do it with recursion? its much easier too
Digital_donger: PogChamp
z00fle: beauty
tommy_clash: Don't cough
Izimoney92100: PogChamp PogChamp
dinxpoy: my internet isn't even good enough for 1080p60 so I can't read shit Kappa 🔫
plazmacsgo: @gal40 for beginners its not
bottonresult: zoom in the screen
anguscupcake: just get a 5k monitor broo
plazmacsgo: you got to understand that for ppl who started learning a week ago merge sort is not basic
gal40: @plazmacsgo What do you define as beginner? You learn mergesort in intro to compsci course...
m0etaz: what are we implementing today
Izimoney92100: @m0etaz we solving N NP
plazmacsgo: @gal40 like someone who started learning a week ago
Iliftmymousealot: literally cant decipher any letter from that paper. it's all blurry. Oof #Resolution=bad
m0etaz: cool, thanks
ibizi77: https://arxiv.org/pdf/1911.08265.pdf
plazmacsgo: and tbh I didn't even know any sorts for my first year of programming
plazmacsgo: I focused on making games and learning object oriented and doing some basic machine learning projects
calcmath: zoom the paper
Iliftmymousealot: thanks @ibizi77
gal40: @plazmacsgo That's not beginner, that's someone who heard about programming lol.
garydsmith1: mechine learning without sorts?
anguscupcake: you can go your entire career without knowing algorithms. just depends on what u fo
bufferovrflw: What happened to the Corona stream? @georgehotz
m0etaz: @ibizi77 @izimoney92100 thanks !
plazmacsgo: @gal40 than whats a beginner in your defenition
ibizi77: you're welcome!!
calcmath: he doesnt have enough compute for protein folding
Iliftmymousealot: @bufferovrflw the protein didn't fold
chuck_person: the logos are cool in that shot
hiredguns: amricanized brit pop
ogsixaxis: george folded on the coronavirus stream instead of the protein ;/
Iliftmymousealot: proteinfolding = numerical expensive
hiredguns: oasis for east coast
bichid69: =(
DelusionalDreams: Why arent you using LISP the real ai language? lmao
gal40: @plazmacsgo I would argue that a beginner is someone who has a grasp on basic concepts, such as sorts.
dinxpoy: did he develop the corona vaccine? is it on github? jk dont ban me pls
ideology_sniffing_raccoon: BBoomer music LULW
plazmacsgo: @gal40 I see
Atlas03: quarantine haircut SeemsGood
god_damn: @dinxpoy if it gets any worse he'll intervene, its on his backburner for now
11plus4thinking: WutFace
dinxpoy: @god_damn hope he saves us all 🙏
michaelkawwa: he really jus vibin
sceptix1337: naive_search(o_O)
Avelansh: quite the interesting music taste
WillGreen98: heyo :)
michaelkawwa: very intresring indeed
IIrLiChT: he vibin tho
gal40: @plazmacsgo Maybe it's about baseline. If you look at it from a purely "coding" perspective, maybe someone who knows how to code could not know sorting, but I think a programmer is also about knowing compsci concepts.
JjohnConstantine: Kappa
dinxpoy: song recorded with the mic of a nokia 3310 5Head
mistertenko: What kind of protomusic is this
cybergenik: George, have you heard of gamozo? hes a streamer thats building a Hypervisor in Rust from scratch. He's gonna use it for fuzzing, its supposed to be able to spin up VMs and kill them 3million times a second per core. its crazy he's crazy good.
Vistor1001: i wouldnt be able to concentrate with this music
Transferer: very interesting personalities
dgkng0d: hello everyone how are you today
bichid69: this stream sucks bro
JigglyGirls: bakedONE / hullo
bichid69: pls entertain us
wafflesan: cool idea
calcmath: ZOOM plz
plazmacsgo: @gal40 definitely! I agree that knowing theory is really important. That what I have been focusing on for the past couple month. But its kinda hard to know which concepts are important when self studing
b2kemann: there are 100 of courses online
Iliftmymousealot: imo the real metaskill a programmer needs is that he can read and knows how to use a search engine, like google, really efficiently. this is how you get good
gal40: @georgehotz Could you explain what difference exploring multiple steps makes if you only take the first action?
michaelkawwa: could someone explain to me what he's doing.
IIrLiChT: ai i think
plazmacsgo: @Iliftmymousealot ye LOL
fabriziobertoglio: please link to the document
calcmath: balancing an inverted pendulum
calcmath: RL agent for doing that
michaelkawwa: ohh cartpole
plazmacsgo: @michaelkawwa I think he is doing a RL agent
zenderbeg: isn't this a game?
AThousandHours: is the notebook on the same computer as you stream?
apetiss: Hi, late to the party. What is he doing with the MuZero algorithm?
Waldoqq: Waldoqq subscribed at Tier 1. They've subscribed for 4 months, currently on a 2 month streak! Wheres the covid streams
plazmacsgo: @apetiss cartpole
calcmath: is h the value function?
chrisinajar: hey george o/
Iliftmymousealot: @plazmacsgo I am not trolling btw... it sounds obvious but many people thin´k they know those things but really they don't including me I am really bad at it
jagger_rsw: jagger_rsw subscribed at Tier 1. They've subscribed for 3 months! 
bichid69: @apetiss your mama
plazmacsgo: ye ik
mero_1181: Hey George, what’s the name of the book you are referencing?
symbiiote: https://arxiv.org/pdf/1911.08265.pdf
luggy_b0i: https://arxiv.org/pdf/1911.08265.pdf
mero_1181: Thanks!
fatpanda168: spooky links
plazmacsgo: its really important to know how to google and comprehend what ppl write on the internet
davidgames68: @Transferer resttOk
fatpanda168: dont click those links bois
Transferer: NotLikeThis NotLikeThis
gal40: @fatpanda168 It's the link to the paper george is referencing.
jagger_rsw: are we taking over the world with python again?
b2kemann: don't you think it's pain to implement papers with python, when it's so slow... I think swift will take over in the future, when s4tf gets popular
JigglyGirls: click all the links baked2head
ogsixaxis: best way to learn python is to start making project and look up stuff u get stuck on
luggy_b0i: @fatpanda168 google arxiv.org and see what it's about.
bichid69: @fatpanda168 why not bro
plazmacsgo: @b2kemann that might happen
cengea: sup
gal40: Could you explain what difference exploring multiple steps makes if you only take the first action?
bichid69: im blind bro, cant see difference
fatpanda168: looked kind of fishy but ok
erichtp: how was the movie
fatpanda168: have you ever thought about creating some sort of anti-cheat?
luggy_b0i: It's a scholarly article distribution site.
bichid69: bro im blind bro
jagger_rsw: what's the percentage of your team that willingly relocated to san diego? (that's where comma.ai currently is?)
mero_1181: @gal40 You know the path of the future states
Santiago_LHC: Chess tactics
SparksCx: i would say so. why not.
bichid69: yeah but im blind bro
p4r4774x: hii
SparksCx: anti game cheat
SparksCx: like aimbot
calcmath: can you explain the output of your search fn so i can follow
sceptix1337: eat the ice
funwayz: python fast LUL
b2kemann: that may happen, but wift is fast and hackable
Bazingaka: numba ftw
fatpanda168: yeah but you can sell it for a lot of money
JVictorVO: What about creating cheats?
m0etaz: cython ResidentSleeper
Skurt2k: true KEKW
bichid69: numba sucks bro
fatpanda168: creating cheats WeirdChamp
jagger_rsw: mens rea (re comma.ai), put rules in the stream title :)
robby0313: The vanguard ant-cheat needs ring 0 privs
JVictorVO: @fatpanda168 its funny actually lol
sceptix1337: ring -2 is where its at fam
iiiiiiillllliiiill: has he cured corona yet
fatpanda168: honestly whoever makes a good anticheat system will make an ungodly amount of money
Imuhnent: @georgehotz do you remember any CTF challenges from your past?
bichid69: @iiiiiiillllliiiill nah he too dumb
robby0313: Ring -3 is where the government is watching my camera
Waldoqq: Does anyone remember that funny song from one of George's covid streams that was talking about consumerism?
Waldoqq: it was on youtube and it was super old
Iliftmymousealot: george I don't mind being abused as some thinking agent to help you to be more productive. But what does grind my gears is that our communication mechanism is critically broken. There has to be a way to filter out the comments which are relevant so you can actually see them. Unless you do these streams for pure enjoyment and that case ignore what I just typed for 2 minutes.
Tuhafadam: hey you are back I was miss u.
god_damn: @Waldoqq 50cent - window shopper
robonhansonem: What is he building?
foti_kasparov: We need a quantum computers stream
Digital_donger: wicked PogChamp
Waldoqq: lmao @god_damn def not him
chairman_Z: wtaf i've been binging on the Wicked soundtrack the past few days lmao
Waldoqq: it was some white guys no one had ever heard of
hiredguns: squarepusher - terminal slam
fatpanda168: will you dab for 500 bits
bichid69: @iliftmymousealot lol he ain't gonna read that shit
sceptix1337: george out here listening to frozen soundtrack
Iliftmymousealot: ye and thats the whole point
FargioFarmani: Whats the square root of log 2 ?
fatpanda168: tldr pls
GoTo3: @fatpanda168, its 2020 dude knock it off
bichid69: @fatpanda168 y u such a n00b
fatpanda168: D:
Ne0Zer0: LUL
csrf_player: song name pls
fatpanda168: the front bottoms - more than
sceptix1337: the wizard and i
fatpanda168: idk that should be enough to find it
DrRobotvinnik: I’ve waited months for the RL &amp; Wizard strim cbrahGood @georgehotz
fatpanda168: oh im dumb lol
csrf_player: @sceptix1337 tnx
norB88: wizard and i has weird sexual overtones
norB88: :D
b2kemann: notebooks are addicting
FargioFarmani: Yasser
aloexai: gg
DrRobotvinnik: @fargiofarmani SeemsGod
foti_kasparov: @FargioFarmani Wrong stream go on Chessbrah
SiNNER_ontwitch: This music is a slow punch in the face
SiNNER_ontwitch: why do you hate me
cheesemanuchiha: is george still working on the virus or is this something different
DrRobotvinnik: cbrahGiraffe
fizziblytwitching: So wat's the point of MuZero?
aloexai: George whats up
fatpanda168: ok bois what is the best language to learn that will not be obsolete in a couple of years
aloexai: George sup
sceptix1337: rust
b2kemann: we need some lorde george
airinspiration_: python
b2kemann: or lana del ray
DrRobotvinnik: Jazz hands from George SeemsGood
inDOObitablee: English
WillGreen98: @fatpanda168 go?
aloexai: geohot sup
norB88: https://www.youtube.com/watch?v=TVcLIfSC4OE
fatpanda168: i have read that python is slow tho
robonhansonem: Something to do with MuZero. Not sure what exactly. Got here late.
aloexai: George wassap
alphagainzzz: guys, i just got admitted to ucsd!
DrRobotvinnik: Cartpole @robonhansonem
fatpanda168: @alphagainzzz noice
airinspiration_: @alphagainzzz gratzzz
sceptix1337: the env.state and i
cheesemanuchiha: thanks robon
dontbeameme: What’s your warzone k.d
alphagainzzz: thanks :)
logi6000: yo how are you all doing today
FargioFarmani: George, a new chessbrah?
airinspiration_: @alphagainzzz which major?
sceptix1337: whats george's lichess elo
logi6000: what are we doin today
fatpanda168: who needs debug tools when you can just print
alphagainzzz: mathematics-computer science @airinspiration_
Iliftmymousealot: incase there is someone who is remotely affiliated with george in the chat and reading this, Even if you are the commaaiarchive guy, can you just tell george to improve the way his audience can communicate with us. That would be cool. No hate I respect you commaaiarchive guy.
forkdb: Yalooo
airinspiration_: nicee
DrRobotvinnik: who needs a warzone k.d. If you have an AlphaZero ArgieB8
norB88: norB88 is gifting 3 Tier 1 Subs to georgehotz's community! They've gifted a total of 13 in the channel! 
norB88: norB88 gifted a Tier 1 sub to b2kemann! 
norB88: norB88 gifted a Tier 1 sub to nizero! 
norB88: norB88 gifted a Tier 1 sub to Tuhafadam! 
dontbeameme: I am alpha zero
fatpanda168: PogChamp
b2kemann: @norB88 Thanks for the gift sub!
DelusionalDreams: how ca i gte started with comma?
DrRobotvinnik: buy a car @delusionaldreams
jesusthenew: hi
forkdb: How can you learn so much... still cannot understand
SiNNER_ontwitch: We dont actually do anything on this stream. Its about problem solving and learning strategies. Which is awesome.
b2kemann: omg am i a sub now
grekler3: wtf is muzero
byte_baron: @SiNNER_ontwitch really?
logi6000: how am i a sub
anguscupcake: it's a lot easier to learn stuff if u don't work 9-5
DrRobotvinnik: reinforcement learning @grekler3
b2kemann: i have finally become something in my life
Iliftmymousealot: commaiarchive guy where are you at?
alphagainzzz: @SiNNER_ontwitch literally the best part
Iliftmymousealot: manifest yourself
DelusionalDreams: OK @DrRobotvinnik such a great advice
logi6000: whats he doin
dontbeameme: On scale 1-10 how Italian is George
hiredguns: trying to keep his stick upright
byte_baron: @dontbeameme pasta/10
fatpanda168: Cheer1000
DrRobotvinnik: SeemsGood @delusionaldreams
hiredguns: muzero doesnt cooperate tho
mrhdr: 1000 bitcoins PogChamp
fizziblytwitching: What does it mean by policy?
fatpanda168: lol wtf
byte_baron: is this fun?
fizziblytwitching: Is that the set of rules is it learning?
calcmath: policy tells oyu what action to take given the state
byte_baron: are you actually having fun right now, im curious
fatpanda168: someone posted the paper before not sure if they are still here
calcmath: policy is what you want to learn
DelusionalDreams: @fizziblytwitching https://stackoverflow.com/questions/46260775/what-is-a-policy-in-reinforcement-learning
SiNNER_ontwitch: @byte_baron I like to watch how he researches and attacks a subject he does not know about. It makes me feel less crazy.
sceptix1337: do 1/state
mero_1181: He’s learning for sure! Some may find it fun
fizziblytwitching: Thanks @DelusionalDreams
ceo_of_anxiety: hey
ceo_of_anxiety: print hello world
hiredguns: value should increase with minimum action
anguscupcake: learning is more fun that most video games
fizziblytwitching: Ok so a set of actions to acheive a result
byte_baron: @anguscupcake you think?
jontowtruck: surprised he doesn't use the vim keymaps in jupyter nb
airinspiration_: @anguscupcake not funnier than battlefield 4
calcmath: policy is function from state space to action space
ceo_of_anxiety: @anguscupcake you're not good at them
gal40: @fizziblytwitching More like a way to map a state to an action
airinspiration_: LUL
anguscupcake: bf4 is too much like cod tbh
hiredguns: +1 stop -1
byte_baron: i feel like the end product of the learning process is a way better feeling than anything you'll get from gaming but for me the learning process can be quite dry (depending on what im learning)
airinspiration_: i cant handle what you said, im out
byte_baron: and im generally a procrastinator
anguscupcake: it is. when you finish a project you've actually done something. when you finish playing video games you just wasted 4 hours
fizziblytwitching: @byte_baron but you could class gaming as learning
Iliftmymousealot: the thing about gaming is that it is designed to be fun. Where as aquiring a skills is not.
Iliftmymousealot: dopamine detox inc.
eldac_kno: is it ok to ask him slightly offtopic questions?
fizziblytwitching: Just that you're not going to really grow intellectually form gaming
fizziblytwitching: from*
byte_baron: @fizziblytwitching right but i think we all know we're going to get way more from learning stuff like programming/maths/ML than playing runescape or something
byte_baron: i think it's about moderation
norB88: @SiNNER_ontwitch yeah learning how to learn type of thing.
byte_baron: do something hard (learning) &gt; reward self with a game
Santiago_LHC: @eldac_kno no
calcmath: gamin simulates an ideal form of learning and exploring
robonhansonem: Gaming provides all the feelings associated with accomplishment without the accomplishment. Considered dangerous.
byte_baron: ^
anguscupcake: @robonhansonem exactly
Paw_4: gaming is like working out, you don't learn anything but you gains skills and capabilities
cheesemanuchiha: is this inverted pendulum
calcmath: yes it is
anguscupcake: lol
grekler3: some of this chat = Pepega
cheesemanuchiha: thanks calc
mackinonit: you gain skill...??
DelusionalDreams: watching someone doing might achive the same result @robonhansonem
SiNNER_ontwitch: @byte_baron Im also a procrastinator. I try to follow what im passionate about and keep many irons in the fire. I bore easily. If I create multiple irons in the fire, an opportunity or breakthrough is much more likely.
eldac_kno: only delusional people think gaming helps you grow intellectually
sceptix1337: you learn to farm lol
mackinonit: what are the valuable skills you gain from basketball?
Ne0Zer0: starcraft 2 might teach you valuable skills
Santiago_LHC: So.... I'm not a farmer by playing Farmville?
anguscupcake: basketball is good cardio at least
logi6000: says this while im playing madden
grekler3: you just coping and wasting time LUL
dr_set: you learn resource allocation and managment?
xeeton: do you gain an intuition about newtonian physics playing KSP?
WEEEEEEEELL_ITS_KNOCC_OUT: WutFace
forkdb: How do you learn so fast?
Penguino138: @georgehotz what kind of tea?
foti_kasparov: I can learn how farming works so I can build my own weed farm
fizziblytwitching: No it's not, you do have to learn to play a game, so by definition you're learning.
mackinonit: they did that with formula 1
eldac_kno: i know it's slightly offtopic, but what do you think abot Winograd Schemas?
ogsixaxis: i learned to be a gangster from gta
sceptix1337: ksp is dope
anguscupcake: VR is the ultimate for learning to play paintball
vybster: There's an argument to be made for fun though
Ne0Zer0: racing games make it easier to practice driving
gal40: @fizziblytwitching Arguing about semantics is a waste of time.
Imuhnent: What's fun?
Iliftmymousealot: fun is a fake concept
byte_baron: @vybster right, i don't think all fun should be eradicated from your life, i think it's about a healthy balance
bravetraveller: The Witness was actually fun figuring out various patterns, recommended as a puzzle game anyway
fizziblytwitching: Except in the context
vybster: Games can be fun, even though there's no "valuable skills" to be learned
THX1342: deus ex teaches you to be woke
eldac_kno: any arguing is arguing about semantics
fizziblytwitching: Given we're training AI
anguscupcake: lol deus ex was great tho
fizziblytwitching: To play a game
fizziblytwitching: In order to test it out safely
b2kemann: everyone should play outer wilds, awesome game
robonhansonem: The tea is his secret. Never will be revealed lest we all become as him.
fizziblytwitching: To prove it's usefulness to apply to other problems
Checkmate624: Checkmate624 subscribed with Twitch Prime. 
Ne0Zer0: TRUE LUL
CozyDinoKigu: It's more easy to launch a game than to think what useful skill you have to improve, and to find the best ressources to develop your skills.
Santiago_LHC: I got good at playing whatever Need for Speed game came out in 2013 or so. I didn't acquire any skills, I learned the mechanics of that one game. I didn't get better at anything else.
robonhansonem: Yes. But in general, we probably have too much fun.
anguscupcake: the best video game is where you buy a whiteboard from aliexpress and write a todo list every morning
byte_baron: @robonhansonem society as a whole?
robonhansonem: Yes.
grekler3: this chat coping so hard LUL gaming = wasting time
Paw_4: @Santiago_LHC you probably did without noticing nor knowing
Santiago_LHC: Nope
eldac_kno: do you guys think Winograd Schemas are good test for AI?
Fatmetheny: @grekler3 This
CozyDinoKigu: And video-games is epidemic, when your only friend play video games, it's hard to not play with them
Checkmate624: doing something you enjoy is never a waste of time
leftyytwo: this discussion is giving me autism
anguscupcake: u already had it bro
Klemen1337: hello
robonhansonem: Worst video games are ones like WoW. You don't even learn useless skills. Instead, they simulate skill acquisition itself with their level system. Skinner box.
eldac_kno: no game teaches you useful skills
Iliftmymousealot: gaming = bad, learning = good can I get some credit for having the opinions
fizziblytwitching: Hah, WoW got me back into programming
koreais: @CozyDinoKigu it is not i used to play sorry waste time a lot but i deciced to stop this shit and now my friends play video games and i prefer to learn sth or read good book
byte_baron: they need to condense education into an mmorpg.
robonhansonem: Most teach you useless skills. Some teach you nothing.
DragonXPolymath: 1000 of games teach you usefull skills
byte_baron: education with all those addictive mmorpg merchanics.
calcmath: value is expected reward from that state
eldac_kno: no
Santiago_LHC: There are countless different types of games. I've learned many things by playing games, mostly the same kinds of things you would learn by reading fiction.
parasite_is_a_snakee: ETH mooning ;D
Checkmate624: yeah there's a big gap between educational games and games that are fun, a gap that should be filled
anguscupcake: VR could be used to gamify learning real world skills
sorin_chebac: wtf
eldac_kno: games are not education lol
CozyDinoKigu: @koreais With whom can you share your learning progress to get a bit of motivation ?
Santiago_LHC: But getting good at a game, generally doesn't get you any useful skills
DragonXPolymath: if u learn nothing usefull, ur mindset isnt usefull
byte_baron: @Checkmate624 the thing is though, it's kind of hard to stick education into a game and keep it fun
fizziblytwitching: I started writing a WoW emu because WoW was boring
calcmath: you should sample based on past visits or elese you wont explore
eldac_kno: it like putting education in movies
alexdenewb: Hey everyone, I'm new here, this community seems pretty interesting!
eldac_kno: stupid
parasite_is_a_snakee: just hack the pentagon bro 4Head
mero_1181: Shouldn’t the policy being function of the expected value of the future states?
vybster: I'm thinking of kids developing a very visual and intuitive understanding of mechanics(physics) by playing video games
Checkmate624: @byte_baron that's very true, but compare learning in schoo. You basically never feel like you're having fun, but when you learn by yourself it can actually be enjoyable
koreais: @CozyDinoKigu yeah thats the problem I have one friends who is into programming but on the other hand you have the community on the internet
Checkmate624: it's not impossible to make learning fun
eldac_kno: why dont they just play with phyisics irl
vybster: Or anyone else developing problem solving skills by playing puzzle games - like portal etc
mero_1181: Bellman equation
DrRobotvinnik: I like this new post-COVID focused George SeemsGood
eldac_kno: there is no such thing as problem solving skills
vybster: @eldac_kno Coz that can be boring. You gotta lure them in with fun stuff first
mero_1181: That’s what you solve to find the policy at time t
Newlax: !uptime
Fatmetheny: @DrRobotvinnik Post-covid??
5GToren: whats up mate have you touched a van de graaff generator?
marckkhoury: Which paper is he reading?
CozyDinoKigu: @koreais Okey. Personnaly i only have my uni. But even my mates in uni are not very serious about getting better in programming etc . . So i feel so fcking alone
swagettiyolonaise69: no more hairdresser
robonhansonem: There is use to visualizing mathematics. Making it into a game is unlikely to do much. Tricking people into acquiring skills generally doesn't work. People generally have to want to learn to get good at something. If they want to learn, you don't need to trick them with a game. Desire to write a useful script is far better than something snazzy like Code Academy.
mero_1181: Need to solve the equation backward
sorin_chebac: Hello mr George.Can you create a texas holdem bot? :D
Iliftmymousealot: i taught myself the navier stokes equations by playing minecraft.
foti_kasparov: Cooking music
calcmath: inst policy just chose action with maximum value?
cheesemanuchiha: LUL
leDryPotato: oof D:
ideology_sniffing_raccoon: LUL
parasite_is_a_snakee: TriHard
fizziblytwitching: Soothing voice
hiredguns: aah jennie, old horse
boss_ev: hola
robonhansonem: Play The Pirates of Penzance
Newlax: angelic
eldac_kno: so this is how he hacked ps3
koreais: @CozyDinoKigu yeah it's sucks. i also start learning programming as self-taught and i find it hard sometime to talk to someone who is on the same level as me
parasite_is_a_snakee: woow u emo's man .. LUL do u think bill gates felt the same as u
eldac_kno: it's slightly offtopic but what do you think about Winograd Schemas, is it a good test for AI?
Major_Spicy: @georgehotz what is happening here? I know very little about programming :)
parasite_is_a_snakee: @Major_Spicy trying to hack the pentagon.. to confirm is kim jung un is indeed dead
eldac_kno: he is reading papers while listening to pop muzak
sceptix1337: shoutouts to the people on youtube who cant hear shit reading the subtitles
Major_Spicy: @parasite_is_a_snakee thank you :)
Newlax: SingsNote SingsNote
robonhansonem: Was very supervised at Winograd progress. Problem with all these tests is once they are passed I start thinking they are less significant.
I2btw: show feet kaceyHEH
eldac_kno: why george always looks pissed off
Major_Spicy: Kacey subs DansGame
parasite_is_a_snakee: wooow a kacey sub 4Head
foti_kasparov: @eldac_kno Because of you
I2btw: kaceyTron hide the memes
GandalfTheGrayOfHell: Kreygasm
fabriziobertoglio: Waitress is good
leDryPotato: Kreygasm
parasite_is_a_snakee: i will not even escape kacy subs even in the depths of hell
fizziblytwitching: (y)
NoLimitFitness: whyyyyMocked whyyyyMocked2 whyyyyBanned3
logi6000: its nice
norB88: meh
NoLimitFitness: whyyyyBanned1 whyyyyBanned2 whyyyyBanned3
Newlax: no
eldac_kno: если писать на русском Джордж ничего не поймет
St47ik: yo PogChamp
anguscupcake: хахахахааа
foti_kasparov: VoteNay
byte_baron: @robonhansonem are you 'the' robin hanson?
logi6000: why the russians here
norB88: Джордж of the jungle
tvorog9: о, а нас тут много?
robonhansonem: No. His em. Degraded copy. Much dimmer.
eldac_kno: Потому что у Джорджа русские корни
byte_baron: @robonhansonem oh
mero_1181: It’s the present value of the future states
logi6000: we are being invadrd by russians
eldac_kno: Джордж наш, русский
smurfd0: hmm didnt get a notification when you got back. was the movie good?
foti_kasparov: Останови эту игру, ты, блядь, шлюха
eldac_kno: с нами Бог
pinkcichlid: eldac_kno почему
grekler3: why do i understand russian little LUL
Newlax: you should make a crypto for comma
skut1212: hey george! What resources would you recommend to programmers on learning AI?
sceptix1337: rush b
I2btw: ENGLASCH!
alionthealien: test hi youtube person watching from the subtitles
leDryPotato: D:
airinspiration_: LUL
SiNNER_ontwitch: English only
alexanderrrrr: rush b
GandalfTheGrayOfHell: monkaH
okeeeeeee: PogChamp
sureom: cykla blat
foti_kasparov: @sceptix1337 I watch tunnels
oscar_my_cat: cyka blyat
DragonXPolymath: DragonXPolymath subscribed with Twitch Prime. 
iiiiiiillllliiiill: cyka blyat
anguscupcake: lol
Newlax: what about british
ideology_sniffing_raccoon: monkaW ONLY ENGLISH monkaW ONLY ENGLISH
Santiago_LHC: Mod me, I'll time them all out
numinousloop: do you play poker george?
pinkcichlid: sorri gorge my england is bed
WEEEEEEEELL_ITS_KNOCC_OUT: Speak American KKona
eldac_kno: it was ukranian
adamcernycz: KKona
alexanderrrrr: englad is my city
I2btw: su- or nord british?
pwnbutt: @georgehotz did you find a way to beat the corona? :)
sceptix1337: and if it werent for team 10
mr_stochastic: Is he trying to implement MuZero?
sorin_chebac: england is in france
foti_kasparov: france is in london
calcmath: yes he is trying to implement muzero for inverted penduulum
GandalfTheGrayOfHell: I thought englang was in Uganda
robonhansonem: @pwnbutt don't be older than 60.
eldac_kno: George is insecure about russian hackers mocking him on twitch
iiiiiiillllliiiill: i wish he would go back to coding the vaccine
sorin_chebac: can u create a texas holdem bot mr george?
eldac_kno: he wasnt coding the vaccjne
pinkcichlid: georgehotz sorri my england is bed
calcmath: protein folding took too much compute
I2btw: I'm happy he move on the the next task. After fix corna with AI.
calahat: What's up? What's happening,
Newlax: I only speak in twitch terms SwiftRage
iiiiiiillllliiiill: @eldac_kno he was and he was going to upload it to github
ez_clappers_: @georgehotz can we get an anti-govt rant
I2btw: gretCreep
eldac_kno: no, he was just learning about corona
I2btw: ohhh
St47ik: MuZero finds corona vaccine PogChamp
robonhansonem: Muzero learning CartPole.
be9ns: thoughts on the alphaGo doc?
NV17: Dynamics? ELI5?
eldac_kno: MuZero learning to hack
omniilismo: whats that pdf viewer?
fa7c0n: !today
robonhansonem: @be9ns Nothing you have not read before. Kinda interesting to watch anyway.
logi6000: remember when george played mibecraft
sceptix1337: minecraft lets play pls
I2btw: The only use case for PDFs is to extract official document layouts and logos. Just saying.
wasphy: hello; What do you know about gwern?
sceptix1337: oh no number go up
NV17: geohotz made by iPod touch better during my childhood
Newlax: fold protein pls
calcmath: widen your neural nwtowrk
fa7c0n: what are we doing today?
St47ik: NUMBER BRO GO DOWN PogChamp
sceptix1337: local minimum go brr
grekler3: PogChamp ?
eldac_kno: the only use for PDF is export of your LaTeX for normies
xeeton: yo, what's an appropriate timestep value when you apply this in cartpole?
St47ik: PogChamp PowerUpR
fabriziobertoglio: somebody understand this?
CozyDinoKigu: Put number - 1 Kappa
sceptix1337: 1000q
St47ik: Number goes BRrrrr
gamerguy009: PogChamp PogChamp PogChamp
Mertkulek: Why you are using chromium
I2btw: LaTeX have a total visual brain.
calcmath: numner is is his neuralnetworks loss function
robonhansonem: Once I get some tea I will.
sceptix1337: rainbow ball go brr
logi6000: @mertkulek its ungoogled. jts really nice j use it too
fabriziobertoglio: adding an action to hidden state sk-1?
Newlax: rant about government pls
pinkcichlid: what chair is that?
I2btw: Can i get pass Myth+ 28 in WoW with this tool?
Joooooooooonas: how long is he streaming guys ?
gamerguy009: Trump2021?/?/? LOL
Joooooooooonas: or since when
pinkcichlid: MAGA
sceptix1337: rand paul 2020
eldac_kno: stop politics plz
grekler3: yo its going down PogChamp
robonhansonem: Governmental decay is inevitable. Ranting is only a palliative measure.
swagettiyolonaise69: drink bleach pls
CozyDinoKigu: the number so down we cannot see it on the screen
xeeton: @pinkcichlid Herman Miller Sayl
danrod43: i accumulated a batch earlier u get me
sceptix1337: number go way down
I2btw: geishaaKappaLisa
Newlax: George for prez?
logi6000: anyone else see the chargers fire new unis
NV17: how did he learn to jailbreak?
pinkcichlid: xeeton looks confy but if it herman must be exzpensive (
RazielSaysNice: a fellow The Front Bottoms listener, never would've expected it from you lol
fabriziobertoglio: is the output number the reward?
duckofdoom12: it do go down
sceptix1337: hell yeah cooking stream
eldac_kno: thoughts on Winograd Schemas?
robonhansonem: @swagettiyolonaise69 We should put bleach in our water supply to prevent pathogen growth.
beastars_is_best_anime: moon2BRAIN smart things
fearofcode: closing the renderer doesn't work on his machine either LUL
FargioFarmani: Can you turn on TTS?
sceptix1337: sudo killall
goochofanubis: oG af.
robonhansonem: @eldac_kno Saw this take on Winograd last week: https://deponysum.com/2020/01/16/recent-advances-in-natural-language-processing-some-woolly-speculations/
Broodfinger: Broodfinger subscribed with Twitch Prime. 
eldac_kno: thanks man
duckofdoom12: them some good numbers
sceptix1337: learning rate too big
Streetmaniac: what is he working on
logi6000: ha geos computer go brrr
masters8: Read the title bro
swagettiyolonaise69: he's asking as if anyone understand wtf hes doing
FlySeddy: FlySeddy subscribed with Twitch Prime. 
Streetmaniac: lmao
Newlax: pogchamp
74c55639: @georgehotz do you understand the fundamentals of reinforcement learning?
robonhansonem: @Streetmaniac MuZero CartPole.
FlySeddy: PogChamp PogChamp
Streetmaniac: ok so hes trying to get an AI to balance the stick
Streetmaniac: yes?
CozyDinoKigu: that it
robonhansonem: @Streetmaniac You got it.
robonhansonem: CartPole is considered AI complete.
calahat: !uptime
RexRothx: SourPls
N3wl34f: SeemsGood
lucianoxo: yo in middle school you were the reason i got all these girls, i had that jailbroken ipod touch
masters8: y'all viewers are retarded, peace
calcmath: u is reward
fabriziobertoglio: a model u
god_damn: @masters8 its true, i'm straight up braindead
rafplicz: nice κeyboard, what is it?
grekler3: u = Ligma i think
eldac_kno: Yu is a guy's name
eldac_kno: remember Rush Hour 3? Who is you, me is Yu
logi6000: we got scammed on our winter in philly. no snow at all
ak0ya_: u is a reward
ak0ya_: it says in the caption if the figure
anguscupcake: consoom
god_damn: LMAOOOOO
danrod43: TRUE
marcosneeroo: LUL
whichtom: reddit is wild
okeeeeeee: LUL
Caje_Vi: are u the new north korea dictator?
FlySeddy: LUL LUL
eldac_kno: favoruite Rush Hour movie?
fabriziobertoglio: :D
god_damn: thankyou kind stranger, upvoted
danrod43: reddit is such a cesspool
anguscupcake: huge echo chamber
hiredguns: god bleaa postmodernism, everything facist
Ne0Zer0: LUL
RexRothx: CONSOOM
I2btw: nice sub
Ne0Zer0: thats arguably the best sub
ideology_sniffing_raccoon: monkaW
ideology_sniffing_raccoon: monkaStare
danrod43: 4chan 29% lol
vloood: reddit is cringe dude
ideology_sniffing_raccoon: LUL
byte_baron: oh my god lol
god_damn: something something based something
byte_baron: that tara reade one is brutal
grekler3: Content finally PogChamp
exaccord: carful TOS
Ne0Zer0: LUL
Keyeh: monkaTOS
robonhansonem: Best Reddit is https://www.reddit.com/r/SubSimulatorGPT2/
danrod43: this isn't bannable
danrod43: plus no one's watching LUL
I2btw: kaceyHEH
ideology_sniffing_raccoon: Believe all woman except when they come after top democrats LUL
parasite_is_a_snakee: 4Head 4Head 4Head
eldac_kno: fav Jackie Chan movie?
ez_clappers_: @georgehotz can we get n anti-govt rant
Keyeh: the m16 are ready
5GToren: he has that exploit sniper
Penguino138: George Hotz: "Just like you don't talk about having sniper rifles in your closet"
r00tkey: Of course corona lock-down is stupid. NotLikeThis
foti_kasparov: Reddit have some big losers and douchebags in there
radino321: kim jong un died according to tmz
suav12: TRUE
grekler3: TRUE
scenic9: Internet superman
danrod43: ANY PREPPERS? KKona
robonhansonem: Any sufficiently advanced crime is indistinguishable from sovereignty.
suav12: blockchain Pog
scarbromangler: so i come on here expecting bioinformatics and get
RexRothx: Woke take, bro
scarbromangler: this
PhosphoricAcid: same
fabriziobertoglio: Government will fight Blockchain
scarbromangler: ok here we go
Penguino138: The Ice
byte_baron: make an ML gubbermint, the algorithm will tell us what to do
whichtom: werent you meant to stop eating ice
5GToren: u didnt want the iceblock?
foti_kasparov: blockchainianism
byte_baron: just ML it
fabriziobertoglio: Blockchain can not scale right now .. Bitcoin can not replace Mastercard ... Unluckily
ᅟᅟᅟᅟ: LUL
bsx1123: Omg he is chewing ice again
foti_kasparov: LUL
Mariosavitch: hello mr hotz
grekler3: LUL
okeeeeeee: XD
whichtom: thats going to be excellent to clean out
alionthealien: whats that
radino321: yes me
foti_kasparov: Those drone shots
Oligomineral3: awesome
Mariosavitch: no
marcosneeroo: LUL
ido_nvidia: that's fucking stupid
duckofdoom12: haha bulldozer go wrrrrrrrr
smurfd0: ge's litterarly playing in the sand box
ᅟᅟᅟᅟ: quarantine... CarlSmile
rustduck: KKona hell ye
sobol55: hell no
r00tkey: fuckin stupid
jakuhor: best thing is it attracted bikers :DD
bubthefi5h: Lolol
PhosphoricAcid: Their take on gun control is just as hilarious
ido_nvidia: like the 2 kids still using the skate park are a real threat
anguscupcake: looks like a nice park
airinspiration_: LUL
I2btw: kaceyHEH
fabioitout: where are those parks?+
suav12: POOLS CLOSED
PhosphoricAcid: pools closed
dr_set: how do we keep the dummies in check without the goverment?
ido_nvidia: lmao
Mariosavitch: lol
ideology_sniffing_raccoon: SHOW US
iswoqqe: LUL
fireposeidoncx: leaked
Sycto: Swimming in your bathtub is the new thing
SparksCx: LEAKED
foti_kasparov: Neighbor peeping
SparksCx: I KNOW WHERE YOU LIVE
I2btw: GPS JPG kaceyHEH
purpaleslushiii: @georgehotz bruh u want corona
DasMastah: High tech solution
Penguino138: Quality content i love it
SparksCx: True
fireposeidoncx: leaked...
whichtom: liability bs
joaosena1: FailFish
SparksCx: @fireposeidoncx nice name
Palmatoro_vg: Top recommended books? @georgehotz
5GToren: move to the app on the other side xD
PhosphoricAcid: george karen
anguscupcake: just consoom
5GToren: wave wave
suav12: mizkifW yo
powerofpickle: karen hotz
alionthealien: lmao revealing government darkest secrets on twitch
Quad___lol: @Palmatoro_vg bible
Penguino138: @georgehotz Are you gonna get an apartment where you can smoke weed?
foti_kasparov: Edward Snowden tryharders
robonhansonem: How do we make govt not a joke?
duckofdoom12: putting police in place &lt; haha bulldozer go wrrrrrrrrrrrrrrr
eldac_kno: thoughts on Winograd Schemas?
arhamkaiser: steve jobs or elon musk
Penguino138: Phagophagia
grekler3: no government ? LUL
whichtom: make the majority of people not morons
RexRothx: Is he in Cali?
Tekrific: at this point it feels like a bad simulation where the programmer is fucking with us
Penguino138: *Pagophagia
ralphielaurence: open source data driven govt
whichtom: democracy is working as intended, its just most people are idiots
SparksCx: lol
rustduck: true
powerofpickle: Do you do low level stuff anymore?
gamerguy009: Are we a simulation?
Penguino138: Why is Idaho the most interested in Corona? We have less than 2k cases here lol
jakuhor: why there are 2 political parties in US Kappa
fabriziobertoglio: I agree on coronavirus.
rene7551: which hip hop is the best vs corona?
suav12: nash equilibrium monkaW
powerofpickle: Will we reach herd immunity before a vaccine?
jakuhor: yin yang
gamerguy009: I dont want this to end
yo_zayden: Bro I'm a big fan and a follower but non sub am i allowed here brother.
jakuhor: :DD
Mariosavitch: true
suav12: kill monkW
foti_kasparov: @yo_zayden Get out
robonhansonem: Median voter theorem
ideology_sniffing_raccoon: Two parties LUL it's just one party
SparksCx: yin and yang
fizziblytwitching: the point is that you have two parties that are so similar that when the people want to give the government a kick you cna elect the other to do the same thing in a different suit
suav12: @yo_zayden plebs unite
JakeWoodruff20: a technocracy is coming soon!!
scarbromangler: how often do you masturbate
airinspiration_: :(
dr_set: what about the green and the libertarians parties? There's more than 2 parties, but nobody votes for them
crabby_clink: riopYolo
ky0jinjaeger: @rene7551 nas is fitting, especially ny state of mind
5GToren: do you watch pron
jasondesante: some have bigger dicks
freshsoclean: lul
okeeeeeee: nice try LUL
SparksCx: I AM NEVER GIVING YOU MY SUB :)
qubitmanipulator: because I'm smarter with my money
leDryPotato: ok im not falling for thiss LUL
anguscupcake: that makes a lot of sense
yo_zayden: @foti_kasparov did i asked you P****
danrod43: have you seen invadievie's take on subscribers?
logi6000: @jasondesante yes
airinspiration_: Im gonna sub rn
foti_kasparov: Meritocracy
alxhotel: :(
I2btw: mcretPAB mcretPAB mcretPAB
fabriziobertoglio: I agree. Subscribers are better
SiNNER_ontwitch: lol
axlebear: PogChamp
eldac_kno: subscriber chad
fabriziobertoglio: Just Subscribe
r00tkey: Better in what sort of way?
SlowDeluxe: so are we gonna invade north korea ? looks promising
CozyDinoKigu: i dont know why but i feel a sudent desire to click the subscribe button
PhosphoricAcid: never subbed, never donated, adblock on, stolen laptop, neighbors wifi
Akandesh: time to get my moms credit card
ar2zee: What is the best move in your opinion Goverment should takes now ?
Penguino138: That was the best Aside of any stream
jasondesante: thank you george for subscribing to my channel
arhamkaiser: whats the religion that makes the most sense
jasondesante: jasond711 jasond711 jasond711 jasond711
alxhotel: Better in the sense of richness
fabioitout: just do it
fizziblytwitching: Better for george
robonhansonem: Have to get to work. PM me when Hotz triggers the intelligence explosion.
gamerguy009: Gift me a sub
fabriziobertoglio: I m poor, can't subscribe... literally corona virus killing everything
logi6000: @phosphoricacid the free life
ideology_sniffing_raccoon: RIP kim jong un LUL
PhosphoricAcid: @logi6000 some call me a free spirit
gamerguy009: PogChamp PogChamp PogChamp
fabioitout: So, you think society is meritocracy driven, and not by luck?
Bentipe: lamans1Fogo
freshsoclean: mat ops research
anguscupcake: your ability to succeed in a meritocracy is largely affected by genetics
whichtom: RL is a super interesting field, but the research is mostly lame
gamerguy009: Society is fat and disgusting
robonhansonem: Merit is mostly genetics. Genetics is luck.
ky0jinjaeger: imagine being so fat that you unintentionally kill yourself in your mid 30s
SlowDeluxe: anybody knows why he is using degoogled chromium ?
freshsoclean: .... up to
SparksCx: its easy its ....
whichtom: 'we achieved new SOTA on x atari games' and deepmind lying saying they solved SC2
fabriziobertoglio: @georgehotz ... I believe they just mean a range
fabriziobertoglio: @georgehotz a1, a2, a3, ..., an
fabioitout: Yes, i think so it is all about luck
axlebear: fricken dot dot dots
Mariosavitch: ... means "did you just really say that?"
fireposeidoncx: what are you trying to do?
PhosphoricAcid: @ky0jinjaeger I'm bulking bro
Joooooooooonas: @SlowDeluxe maybe cause chrome is good and google is bad
anguscupcake: permabulk
blueberryguac: blueberryguac subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 1 month streak! I am better than all of you.
gamerguy009: Duck duck go
moizai: how's life going
rustduck: i prefer firefox
anguscupcake: firefox f12 is so slow tho
whichtom: wait muzero cant even perform for games with highly sparse rewards
SlowDeluxe: @Joooooooooonas sure but i read that its only one guy patching it so i was just wondering about the security level of the browser
SlowDeluxe: privacy &gt; security ?
gamerguy009: Write some ransom ware
moizai: is comma still working right now.
74c55639: i prefer firefox, because it was written in Rust. Just wanted to join the idiotic conversation ...
ky0jinjaeger: damn, kimmy boy would've been ripped if he had the time to lose weight BibleThump
fizziblytwitching: Fix values?
fizziblytwitching: Lame comment
fireposeidoncx: rip kim jong un
zennydmt: he died?
Musashhhi: comma10k, you can work with comma too
kektobiologist: link to thr paper?
parasite_is_a_snakee: r.i,p joe rogan BibleThump
fireposeidoncx: @zennydmt apparently
arhamkaiser: rip kim jong
whichtom: ya ive submitted PR to comma10k already
arhamkaiser: bong
zennydmt: @fireposeidoncx i dont see it on cnn
SlowDeluxe: @zennydmt apparently he is in a vegitable state after a botched heart surgery
SparksCx: is gonna explode
fabriziobertoglio: E[ut+k+1...].. do you guys understand this?
kektobiologist: nvm got it
nsielicki: Hey George, can you talk a bit about the state of Qira and what needs to be done to get it working on python3? Willing to do the work just don't know where it's at. Thanks.
arhamkaiser: rip kim
gamerguy009: Rip tom hanks
whichtom: I just wish gym documentation was good
fireposeidoncx: rip kim
arhamkaiser: rip kim jong long tong
SparksCx: what happened to kim
arhamkaiser: ded
arhamkaiser: reportedly
swagettiyolonaise69: is he dead ?
arhamkaiser: tmz
SparksCx: its confirmed?
fireposeidoncx: kims death is a huge loss for society
gamerguy009: PogChamp PogChamp PogChamp PogChamp
74c55639: "Other unconfirmed reports, attributed to senior party sources in Beijing, said an operation to insert a stent went wrong because the surgeon’s hands were shaking so badly."
arc12__: he is in a vegatative states
swagettiyolonaise69: i dont think he does vegetables
gamerguy009: Celery state lol
fabriziobertoglio: i is time ... why not call it t like in the book
arhamkaiser: apparently his heart surgery was botched
kektobiologist: 0 to 100 real quick
St47ik: PogChamp
Lathendros: @georgehotz thoughts on transhumanism
gamerguy009: SeemsGood
St47ik: Decentralized governance PogChamp
Mariosavitch: have you read john lock?
swagettiyolonaise69: AI government overlord
gamerguy009: Pacemakers
fabriziobertoglio: i don't understand why he is multiplying i*3 because as my understanding i is the t for time .. each next step is t+1
parasite_is_a_snakee: @georgehotz ppl dont care who is controlling the strings as long as they can consooooooooooooom Kreygasm
WhispyHerc: george can you explain what your'e working on? sorry im a noob not sure what this is
dr_set: I want a benevolent AI tyrant
YellowSnowman_23: YellowSnowman_23 subscribed at Tier 1. They've subscribed for 2 months! 
grimers: why is chat talking about kim
whichtom: whats your reward function though?
arhamkaiser: cause he died
SparksCx: @grimers they say he is dead
arc12__: kim kardashian
St47ik: Kim possible
oversum: jupyter notebook is nice
fabriziobertoglio: what is gamma?
fireposeidoncx: kim is dead
SparksCx: no
arhamkaiser: no
DzyaN_: Rip kanye
Penguino138: I was the first sub today :D
gamerguy009: Dont touch your face
SparksCx: D:
gadean: gadean subscribed with Twitch Prime. 
Penguino138: Welcome new subscribers
rustduck: D: ☝️
Den_dp: I'll subscribe if you start hacking Kappa
grekler3: i hacked this Pog
SparksCx: I AM STILL HERE :)
PhosphoricAcid: you have no power here
DzyaN_: Ez
Hypheus_: dead chat PepeLaugh
SxRS2: LUL
routerkicker: routerkicker subscribed with Twitch Prime. They've subscribed for 5 months, currently on a 2 month streak! 
HopZe: HACKERMAN PogChamp
YellowSnowman_23: YellowSnowman_23 is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
garydsmith1: yo i am a sub!!!!
YellowSnowman_23: YellowSnowman_23 gifted a Tier 1 sub to bsx1123! 
YellowSnowman_23: YellowSnowman_23 gifted a Tier 1 sub to eeXecute! 
YellowSnowman_23: YellowSnowman_23 gifted a Tier 1 sub to Mint2bSpiced! 
YellowSnowman_23: YellowSnowman_23 gifted a Tier 1 sub to apolybus! 
YellowSnowman_23: YellowSnowman_23 gifted a Tier 1 sub to eldac_kno! 
Checkmate624: yo nice
garydsmith1: yo man gift me a sub?
grimers: hboxA hboxB hboxB hboxB hboxC
sectionmp: sectionmp subscribed with Twitch Prime. 
dorkmo: ShowLove1
lanyxqt2: Lol
Checkmate624: you can buy a message in sub only mode with bits
buddhm: Dodged
Penguino138: @georgehotz has the divine right to ban
garydsmith1: you can redeem a sub only message
Mobius5: WHICH K3YB01RD do you have????
swagettiyolonaise69: kim is ded
okeeeeeee: subing to a millionaire Kappa
localcanofdutchgold: never subbed, never donated, stolen laptop, neighbors wifi, gifted sub, ez clap
mmi18: i can type in sub mode !
Hypheus_: :crab: kim is gone :crab:
Checkmate624: I just want the train to go further
Penguino138: You spend 430 twitch points and it lets you message if it is in sub only mode
abedbawsxx: Sub mode LUL
parasite_is_a_snakee: LOOOL IM NOT A SUB AND IM SPEAKING CXXX TriHard
garydsmith1: why did this happen tho? sub only mode?
fireposeidoncx: stop this dictatorship
Mariosavitch: no
SparksCx: NO YOU DON'T GET ANYTHING :)
Talgathy: Free the peasants
cheesemanuchiha: im in the gulag
mritzing: twitch gets money for twitch points, ads are worth more when they can prove the viewer is there
Checkmate624: Why would he turn off high quality chat mode lol
mmi18: i think 1 twitch point is equivalent to a bucked of oil
grenaderaven: whats a sub
garydsmith1: we just need to watch your videos and we get points
Joooooooooonas: you get them by watch time
abedbawsxx: Not only i'm going to type in a sub mode, but im also going to ask for the k3yb4ard LUL
numinousloop: who are your favorite engineers to collab with
Penguino138: I think the chat may be higher quality in subs only mode
norB88: norB88 is gifting 3 Tier 1 Subs to georgehotz's community! They've gifted a total of 16 in the channel! 
norB88: norB88 gifted a Tier 1 sub to powerofpickle! 
norB88: norB88 gifted a Tier 1 sub to forklifting1! 
norB88: norB88 gifted a Tier 1 sub to T3chHS! 
Penguino138: ayoooo hype
garydsmith1: gift me a extra month of subs?
lanyxqt2: have you ever played videogames? or is it something you've never been interested in?
Waldoqq: imagine not being a sub
Waldoqq: imagine being so poor to not be a sub LUL
St47ik: i was a sub and now i'm broke :(
garydsmith1: imagine not having a credit card to pay for subs
garydsmith1: thats me tho
bigie: what is mu zero? (model based/free, TD or monte carlo)
Checkmate624: Can we get level 5 train?
0xnan: just use my points
garydsmith1: yesssss
cheesemanuchiha: monte
ricardosmf: suuup
ak0ya_: why only sub mode??
garydsmith1: higher qulity chat
Lost_x_Echo: Lost_x_Echo subscribed with Twitch Prime. 
Avelansh: You can't silence us all :)
Checkmate624: It's reverse taxation without representation
cactusvacuum: income, sales, capital gains, or what?
abedbawsxx: Remove sub mode you semite Kappa
Mariosavitch: you just straight up assumed federal income taxes is ok?
St47ik: Blockchain proof of tax voting PogChamp
Checkmate624: De-centralized voting? Weird
Den_dp: so poor people will never get a chance to pick his/her candidate and change situation
RexRothx: Why not just make it landowners-only voting, while you're at it
SparksCx: i am back :)
bigie: bigie subscribed at Tier 1. 
Checkmate624: @Den_dp poor people still pay taxes though, right?
grimers: cool
Ne0Zer0: PogChamp
engineererik: Danke
marcosneeroo: o
St47ik: pls don't be low quality chat NotLikeThis
arc12__: could some one gift me a sub please
bigie: come on i just subbed dude.
BootsForCats: so people on wellfare can't vote?
SlowDeluxe: Pog?
norB88: Choo Chooo HypeRacer
SparksCx: @bigie LUL
cheesemanuchiha: liberate me daddy
DzyaN_: freedommm
mero_1181: Voting is not enough incentive to have people paying taxes
Penguino138: We can only discriminate towards non-subs :p
neilsweb: Only people with cherry brown keys should be able to vote.
parasite_is_a_snakee: @bigie rekt 4Head
Ne0Zer0: the bar is private tho
fireposeidoncx: welcome back plebls
Lost_x_Echo: Choo Chooo HypeRacer
Den_dp: @Checkmate624 yes, but I can imagine some situation where they are broke and can't do that
bigie: I would like a refund please LUL
cheesemanuchiha: @bigie LUL
St47ik: proof of steak voting Kappa
filipeoliveiraa: :)
anguscupcake: only people with HHKB can vote
nsielicki: I mean this country was founded on the principle of one vote per tax-paying family, enforced through the notion that land ownership represented that.
swagettiyolonaise69: worst idea ever
garydsmith1: George whats the most illegal thing you have done? pirate a movie?
nsielicki: It's really what the country was founded on.
bigie: is that basic cartpole?
henistein: How worth is learning assembly nowadays?
arc12__: we shouldnt look to the past to find out whats right
St47ik: @arc12__ why not?
arc12__: black people coulnt vote
whichtom: abolish the federal govt so states are independent and act more like the EU
mmi18: so then rich people have the power?
grekler3: D: Wtf
St47ik: droogz Kreygasm
Checkmate624: @arc12__ so we look to the past and learn not to do that
Waldoqq: god I love this stream
grimers: dude weed lmao
beltez: yoooo george !
fabioitout: You are not forcede enter Apple, you are forced enter this fucking planet
nsielicki: It's a great idea but it's politically untenable. Less than 50% of the population is tax positive -- that's a fact -- it's what Mitt Romney got in shit for in 2012 but he was 100% right when he said it.
arc12__: yeah thats fine
xeeton: keep it up george we believe in you
arc12__: i meant look to what the founders said whats right
nsielicki: We're already far off the cliff of unsustainability when it comes to tax granting representation.
RexRothx: What's his job/main source of income?
Leleckoo: !uptime
whichtom: the world the founders lived in was far different to today
okeeeeeee: true
St47ik: Skin in the game PogChamp
ayy420stillnotbanned: brain draining india fuck yeah
Avelansh: Why would you want to go to America in the first place
highflyer_nl: pay to play?
SparksCx: but they think, that will displace US citizen workers @georgehotz
parasite_is_a_snakee: @georgehotz what about asylum seekers?
nsielicki: &gt; imagine not thinking America is the best place to live in the entire world.
parasite_is_a_snakee: @georgehotz fuk em 4Herad ?
arc12__: if the education system gets fixed, so does our democracy
St47ik: @highflyer_nl contribute to play
Mariosavitch: Hotz 2020. Break the simulator. Vote Today
ayy420stillnotbanned: @Avelansh lol yeah stay in india pajeet, sure that's your own choice and not that your visa got rejected
numinousloop: how good of a proxy do you think money is for value add? sounds like you think it approaches 1:1
parasite_is_a_snakee: @georgehotz what about refugees
whichtom: some american industry is the best in the world by a huge margin
mmi18: but what if we only let non tax payers vote?
grekler3: @parasite_is_a_snakee same principle
okeeeeeee: ye ok the brain draining of other countries is also a valid counter argument 󠀀
parasite_is_a_snakee: @grekler3 how do u know if a kid from syria going to add value
Avelansh: @ayy420stillnotbanned good story
St47ik: @georgehotz how about tax havens/evasion NotLikeThis
fireposeidoncx: america is literally the last country one would like to live in
aaddrr: why @fireposeidoncx
whichtom: thats like, your opinion man
ak0ya_: @georgehotz
bigie: @fireposeidoncx categorically false but ok
whichtom: american aerospace industry is the best in the world bar none
phennessey: Did the protein ever fold?
ayy420stillnotbanned: @fireposeidoncx back to /r/chapotraphouse tr4nn y
mero_1181: Democrats pay more takes
okeeeeeee: whats the deal with brain draining weak countries ? @georgehotz
neilsweb: Are you going to invest in a better quality bed? You need to take care of your back.
mero_1181: By definition
Checkmate624: @parasite_is_a_snakee I think one solution could be that immagrants seeking asylum have a waiting period after immigration where they don't have to pay taxes, so they can find a job initially
nsielicki: The rate of expatriation in the united states is evidence that Americans don't want to live anywhere else.
aaddrr: fuck sleeping bruh
whichtom: its such a huge country with such variety
m3m333: what do you think about corporations that avoid paying taxes
St47ik: ^
Checkmate624: ^^
arc12__: value added tax
fireposeidoncx: @aaddrr trashy health care, cities are dirty, education is bad...
robonhansonem: Land value tax is the best tax.
numinousloop: democrats dont think money is a good proxy for value
parasite_is_a_snakee: @Checkmate624 why do they need to find a job when they can get food stamps TriHard
RexRothx: Why would the voting population then vote in the interests of the poor, then?
arc12__: VAT + UBI
MABunglawala: anyone know what's his upcoming project?
mero_1181: What if you don\’t
cactusvacuum: i don't understand why all the libertarian tech folks don't all move to some place like idaho and setup the kind of utopia that a rich, educated, and forward thinking community would create
mero_1181: Have a job?
mero_1181: What if you don’t have a job?
ak0ya_: You can just suggest UBI to people to buy their voting rights
Major_Spicy: 69% of political parties funding from... TheThing
Checkmate624: @parasite_is_a_snakee that's true, if they're living off government support, do they pay taxes on that government support which is funded by taxes? seems like a weird loop
anguscupcake: utopia is a myth
MABunglawala: @cactusvacuum that be dope asf
St47ik: from MuZero to taxes 4Head
mero_1181: Are you going to vote or not?
ayy420stillnotbanned: myths are utopic
aaddrr: @fireposeidoncx i am actually trying to get a green card im from spain
anguscupcake: lol they are
maxschneider96: maxschneider96 subscribed at Tier 1. 
ayy420stillnotbanned: @aaddrr chaco rubio no te ballas
robonhansonem: There exists utopias that don't violate physical law. Navigating to them is the hard part.
ayy420stillnotbanned: *chacho
whichtom: ya I want to move to the US also but I need a PhD first
Vistor1001: wtf is up with this kim jong un shit is he really sick
robonhansonem: What policy is he talking about?
nsielicki: @georgehotz it depends on the federal money that each state takes
St47ik: @Vistor1001 very sick
beltez: is dead
fireposeidoncx: @aaddrr stay in the EU! It is way better here
Junki4: jinni1 jinni1
nouryqt: heya
smurfd0: it dumbs it down for people
mhammad123: hi gro how is u
okeeeeeee: they mostly do it in USA
Jake_Miller_: @fireposeidoncx wut, are you kidding man
Mariosavitch: go read john lock for your answers
niko174_: Здравствуйте
jacolack: wdym skin in the game?
joaosena1: tadeBOMB tadeTACO
Jake_Miller_: @fireposeidoncx from italy, damn this place
aaddrr: @fireposeidoncx business oportunity is shit in EU i think though
ayy420stillnotbanned: @Jake_Miller_ he's some moron from some commie discord
mero_1181: It’s not democratic
St47ik: @jacolack look it up
Checkmate624: blue states on average are richer, but I would guess republicans have more giant coporations that bring in a lot of revenue
Killeraing: thanks fo reminding me why i want to code
Killeraing: gnite
Muaaath: what is he doing? data science?
whichtom: some reinforcement learning stuff
arc12__: most fortune 500 ceos are dems
Jake_Miller_: @ayy420stillnotbanned ohhhh, ok ty man
yevenesh: @georgehotz are u livin in silicon valley?
fireposeidoncx: @Jake_Miller_ free colleges, good healthcare, financial support from the government, less crackheads for all those reasons the EU is a much better place to live in
SparksCx: its la
whichtom: he's in SD iirc
ayy420stillnotbanned: @yevenesh san diego
Checkmate624: oh nvm, I assumed median
radu3521: What is he working on?
parasite_is_a_snakee: @georgehotz has anyone ever told u .. u walk like a penguin PogChamp
robonhansonem: @radu3521 Muzero PoleCart
fillmyvoid: I disagree with that, because the spirit that should be echoed involves the idea that everyone ought to have skin in the game, and can have skin in the game. If we lose that then we lose more than just how voting works
ayy420stillnotbanned: @fireposeidoncx financial support in the form of 40-50% taxation top kek
Checkmate624: @radu3521 looks like a chess bot? but I've been watching 20 minutes and I still don't know
xeeton: @radu3521 muzero implementation for cartpole
parasite_is_a_snakee: hee walks like a penguin 4Head
aaddrr: @fireposeidoncx financial support from the goverment? am i missing that?
nouryqt: no FeelsBadMan
okeeeeeee: at under 18 over 99% are still net negative LUL
Jake_Miller_: @fireposeidoncx I see you like pay taxes for politician, wow
radu3521: @xeeton i dont understand what that is :))
radu3521: is the first time i tune in
xeeton: an AI thing that balances a pole
maxschneider96: Just subscribed! Hope u´´ ll make another bioinformatics video soon - from a drug discovery student.
robonhansonem: Children a public goods. Give parents a cut of their future kids income tax.
nsielicki: can you talk about what needs to be done to fully get qira off python2? Willing to work on it just don't know what's the hold up
ky0jinjaeger: I think I kinda get what u mean, it's a problem in the Balkans, huge public sector which consistently votes for party which will keep those jobs alive
arc12__: ubi
mikey9988: the rona vote monkaW
ayy420stillnotbanned: anyone can vote in america they aint asking for ID...
fireposeidoncx: @ayy420stillnotbanned you wont pay 50% taxes unless you are a millionaire
Checkmate624: but when you're under 18, you still have to pay income tax, even though you can't vote, which is wack
robonhansonem: Select leaders with random sampling and standardized testing.
bigie: technically not radical but it will be labeled as one
phennessey: All I want to know is if the protein folded.
okeeeeeee: so your discriminating towards dumb people ? Kappa @georgehotz
ayy420stillnotbanned: @fireposeidoncx nope you're paying 46% on average, not saying only income but all taxes
Checkmate624: @okeeeeeee real life discriminates against dumb people
bsx1123: you vote anonymously
ayy420stillnotbanned: ppl making $45k a year are paying that
robonhansonem: Sortition applied to top 1% SAT scores.
Jake_Miller_: @okeeeeeee i think it's called evolution
arc12__: how would value that a person generates be measured
ayy420stillnotbanned: 45k pretax
okeeeeeee: ye it should be like that, it was a joke
jakuhor: @arc12__ money, free market can value everything
fireposeidoncx: @ayy420stillnotbanned where do you live? It varies quite a bit between the countries
AleXander1022: what's up dude? how are you ?
aaddrr: @fireposeidoncx where do you live
Xanor: bailout the bars'
ayy420stillnotbanned: @fireposeidoncx spain, it's below the average tho, around 38%
teerv: rich people use less goverment founded resources
fireposeidoncx: @aaddrr germany
bobsmash: geohot for president PogChamp
whichtom: a big change would probably be mandatory voting so turnout is &gt;55.7% which is a joke
AleXander1022: Geohotz will be a good president yeah !!!
Checkmate624: and most of the missing voters are the young population
engineererik: In germany, people who earn more than 54,000€ have to pay 42%
arc12__: voting should be online
St47ik: @arc12__ nah too risky
whichtom: mandatory voting else fine, that'll give people motivation
Checkmate624: young people not voting is one reason people attribute to bernie doing so poorly
arc12__: when we have the technology
teerv: @engineererik yeah put if you have a company and pay it out like a dividend what is the tax then
Den_dp: that's like a derivative of a people opinions
fireposeidoncx: @engineererik are you from germany?
St47ik: LUL
Jake_Miller_: @engineererik yep, italy 41%, also over 75k 43%
engineererik: @fireposeidoncx yeah
SparksCx: lol
ayy420stillnotbanned: @engineererik and that's only income, plenty more taxes around definitely place em over 50%
fireposeidoncx: @engineererik ehrenmann
bigie: have you seen the covid-19 tracing from google and apple?
Xanor: vote yourself
whichtom: why? you have skin in the game? its in your best interest to vote
Penguino138: george looking comfy af
zyrax222: im voting george then
arc12__: the electoral college is pointless
eeXecute: Thank you for the gifted sub yellowsnowman
engineererik: @fireposeidoncx zumindest bin ich hier nicht alleine aus Deutschland^^
maxschneider96: @fireposeidoncx where abouts in germany? I used to live in munich...
rinaldo1818: @engineererik richtig
logi6000: im back
fireposeidoncx: so viele deutsche hier :D
maxschneider96: österreich...
aaddrr: is frankfurt good to start a business?
engineererik: @rinaldo1818 noch so einer :D
okeeeeeee: was los
maxschneider96: österreich-UK
logi6000: should i play madden or should i work on something
fireposeidoncx: @maxschneider96 bin aus münchen
rinaldo1818: Germany-BLN
engineererik: @fireposeidoncx ich aus Frankfurt
vruthlessv: RIP
Penguino138: germans invading
Ne0Zer0: monkaS
maxschneider96: @fireposeidoncx nice, hab in schwabing und in garching gewohnt und bin zur TUM gegangen
jakuhor: to si jenom myslíš :*
okeeeeeee: german is a germanic leanguage, just like english :)
Leleckoo: RIP
sureom: baguette
abedbawsxx: تبا للانقلش
porteus: KKona
zyrax222: nederlanders?
mikey9988: KKona Clap
MrStereoX: i missed you where have you been ? @georgehotz
bigie: i don't know mu-0. does it have a replay buffer ?
beltez: no puedo hablar español Jorge ?
teerv: SKÅL
Muaaath: اتفق
Nedeljko99: yo yo
rshelat97: george xenophobic?
radu3521: da mai dute in pizda matii
arc12__: konichiwa
iiiiiiillllliiiill: @georgehotz did u hack kim jong un?
frehdo: english is not germanic?
soldierheadsmite: that's too bad :c
logi6000: @abedbawsxx you boutta get fucked
Penguino138: @okeeeeeee english is a hybrid of many older languages
eldac_kno: you can speak english using characters from other alphabets
cylon007: lol
Adictos: ye
g0nzl: hahahaa
Checkmate624: surprising amount of german speakers in this chat
beltez: Gracias amigo
arisnotle: Ik praat gewoon Nederlands wat zeg jij
bigie: why would you do anything in tensorflow man? pytorch is way better
arc12__: the printer industry is worse than healthcare industry
whichtom: tf is a nightmare
aaddrr: its crazy how in twitch you can reach out to such important people so easly
whichtom: I'm losing my mind using it
ky0jinjaeger: Is spanish hard to learn?
aaddrr: @ky0jinjaeger yeah
arc12__: how is pytorch better
Checkmate624: @ky0jinjaeger I've heard spanish is one of the easiest languages to learn from english
Tsoding: 160 raiders from Tsoding have joined! 
mikey9988: un poco KEKW @ky0jinjaeger
cactusvacuum: @georgehotz why haven't you bought land?
Ne0Zer0: 160 PogChamp
whichtom: yoo dude hello
Jannnik: tsoding Pog
engineererik: @ky0jinjaeger try out german :D
bigie: could you talk about mu0 a bit? if it doesn't have a replay buffer it takes a while to converge. it looks continuous right ? that's even harder
ravenmaster: tsodinJS RAID tsodinJS
mikey9988: German is difficult to learn
mikey9988: imo
red_plex: working on twitch chess ?
whichtom: imo pytorch is just way easier to work with than tf, way easier to read and docs are better
Penguino138: We got a raid!
Penguino138: Shield wall up!
c1tr0n75: c1tr0n75 is gifting 2 Tier 1 Subs to georgehotz's community! They've gifted a total of 17 in the channel! 
whichtom: and i don't have to import tf.compat.v2.python.ops.something
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to lexxy23! 
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to roberto_in! 
eldac_kno: do you think people fundemantally good or evil
whichtom: wow nice link
bigie: the only way tf is gonna beat pytorch is if this swift thing takes off. i hope it doesn't. i hate tf and swift LUL
robonhansonem: Make your own sauce.
Penguino138: You can make creamy pasta sauce with milk
PristineBanana: butter works
robonhansonem: Olive oil. Canned tomatoes. Garlic.
whichtom: isn't pytorch more popular amongst researchers tho
maxschneider96: He needs some milk
Penguino138: I mean I make mine with soymilk, any kind will work
bigie: yes but pytorch is in python and python is slow as fuck
whichtom: tf might still be used more in industry idk
jontowtruck: as someone who's contributed to tf swift.... it's not looking too great.
whichtom: ya true
smurfd0: ketchup=almost pasta sause
xeeton: also, just make sure the eggs sink in water
fireposeidoncx: @smurfd0 true
mashafique: What up everyone
robonhansonem: @smirfd0 Heresy
soldierheadsmite: r u trying to solve a bug?
mltsd: !uptime
whichtom: contributing to anything tf sounds unenjoyable
alabamaman02: george can you give me a virtual high five?
spoofyboy: !uptime
cj1m: imma give you a virtual smack alabamaman
bigie: tf is broken in python at least. they break APIs with each release too. they were the first, definitely not the best
alabamaman02: that's better @cj1m
fireposeidoncx: do you guys think george is viewbotting?
LJRewiind: hey chat whats he doing today
whichtom: they were not the first surely
jefft13: i think if he coded the viewbot on stream its fair game
norB88: What did you guys think of Wolframs "Fundamental theory"?
bigie: first one to offer a "solid" framework
mashafique: I didn't really look into it but from discussions I've seen from other physicists it's nothing that profound
whichtom: what about caffe/theano?
thejuror8: @norB88 Didn't see it, what's it about ?
whichtom: wolfram is an interesting man
bigie: tensorflow is easier to work with than caffe. the other frameworks just fell behind and no one uses them anymore
whichtom: gotcha
bigie: @norB88 i couldn't understand it past the relativity theory. i hope he's onto something
takkat14: guys, what is the article at the background?
mltsd: george do you work on low level stuff at all anymore or do you focus on machine learning
qow_: !uptime
whichtom: @takkat14 muzero paper
thejuror8: Lmao what kind of pants is he wearing
takkat14: @whichtom thanks
bigie: if it's 5 in basic cartpole it means it's basically falling down right? maybe your actions aren't going through for some reason
eksdee_1_2_3: ur not fasting D:
maxschneider96: What do you think of Donald Trump´ s suggestion to inject disinfectants?
thejuror8: @maxschneider96 What do you thin khe things about it
axlebear: Not fasting FeelsWeirdMan
thejuror8: *What do you think he thinks about it, what kind of question is that lmao
fireposeidoncx: @maxschneider96 it is a good idea Trump knows best #Trump2020
mltsd: i finna inject vodka to kill coronavirus
engineererik: @maxschneider96 never heard something that stupid
julianus_mh: is this corona stream?
eldac_kno: what s better for newbie tensorflow or theano
FargioFarmani: pytorch
whichtom: pytorch or keras
kektobiologist: this guy has lost his damn mind
HHqZz: tensorflow
fireposeidoncx: @maxschneider96 rip :d
eldac_kno: why pytorch better than tensorflow
RedguardWithAids: tf
JOPEAR: Hello
axlebear: True
jefft13: if youre new new id say sklearn honestly
whichtom: documentation isn't a mess
majorawpsome: does america have a 2 party system?
whichtom: true actually, start off with sklearn
maxschneider96: Well that escalated quickly
eldac_kno: so theano sucks?
whichtom: theano is ancient
whichtom: no one uses it anymore
bigie: basic cartpole starts at the upright position. if you don't input any controls it falls down. but your loss wasn't going down too idk. i have to read up on mu0
thejuror8: Keras is a great way to start
smurfd0: the values that f_l_loss is based on, do they seem to align with what they should be or !?
thejuror8: Hard to beat
mangoxavier: Have you heard the short story called “the egg”?
majorawpsome: isn't it weird that you can still be alive with a somewhat dead brain?
costcospizza: yup
jefft13: keras is good for nets no?
okeeeeeee: lag
inDOObitablee: F
eldac_kno: brain dead chicken is alive for few seconds
robonhansonem: Vote Trump, the lesser of two demented old men!
lexxy23: droping frames?
Den_dp: F
Penguino138: lagggg
ky0jinjaeger: F
thejuror8: Next slide PogChamp
Den_dp: reiraF
sheveeee: f
whichtom: yea keras is good
mangoxavier: Rip
thejuror8: @jefft13 Yeah
fireposeidoncx: f
mashafique: FeelsBadMan
whichtom: keras is actually really easy to use
eldac_kno: f
Penguino138: F
jefft13: @whichtom i only see keras for NNs no?
finnur: F
trenusss: F
Penguino138: The fight for CPU usage
soldierheadsmite: f
thejuror8: @georgehotz Did you try Colab for this kind of stuff ? everytime I have something to run that is on the heavy side I used it, it's very practical
JohnnyWangPepega: f
tauzN: F
whichtom: @jefft13 deep learning yea
superluminal86: apple's fault
maxschneider96: @thejuror8 It was meant to be a provocative question, worked I guess
whichtom: General machine learning is ofc sklearn
tauzN: SAVED PogChamp
mangoxavier: Coming back later
mashafique: we back Pog
Penguino138: Back again
Ne0Zer0: AngelThump
alexlucas__: ayyy
bigie: sure it can. doing deep learning without cuda fucks the CPU up
maxschneider96: back again nice
gamester2665: HELLO MR HOTZ
Mariosavitch: lol
bigie: LUL
Ne0Zer0: LUL
whichtom: LUL
saintmthw: LULW
mashafique: LUL
ky0jinjaeger: LUL LUL
Mariosavitch: Kappa
Jpdd: OMEGALUL
abk467: sayanoHype LUL
Penguino138: Joe biden shut down the stream ;)
danny95djb: LUL
logi6000: we back
gamester2665: lol
gamester2665: &lt;3
fireposeidoncx: lol
Ne0Zer0: all powerful joe
powerofpickle: However, he is a rapist
logi6000: lmfao😅🤣🤣🤣🤣
mangoxavier: Lmao
maxschneider96: mate, why so serious?
bigie: thanks man i haven't laughed like that in a while
ky0jinjaeger: lmao
mangoxavier: Hahahaha
Penguino138: This is MALARKEY!
mashafique: You didn't fake cry Geo
mangoxavier: Invest in tinfoil
maxschneider96: lol
abk467: you were just being sarcastic
powerofpickle: WHY WHY WHY WHY WHY
Mariosavitch: ???
anguscupcake: led street lights are military weapons bro
mashafique: POG
whichtom: ??
inDOObitablee: wut
Mariosavitch: random
GiGnX12: ??
teerv: PogChamp
anguscupcake: good form
Digital_donger: disruptive PogChamp
Mariosavitch: tuck your elbows in
DzyaN_: cmonBruh
mangoxavier: One punch Man U can do it
anguscupcake: burpees are where it's at
Ne0Zer0: mmm Kreygasm
maxschneider96: @anguscupcake burpees ftw yeah
logi6000: apples got you on there botnet. they did it
powerofpickle: Training to fight corn pop
FargioFarmani: When will you start recording Tiktok videos?
bigie: visualize one episode. maybe you'll see a bug or smth
maxschneider96: @FargioFarmani Pls don´t
mangoxavier: George did you watch Devs?
fireposeidoncx: @georgehotz still a logan paul fan?
FargioFarmani: Tiktok is the future
flickapotamus: i did not get notification for this
anguscupcake: WHAT ARE THOSE
maxschneider96: @FargioFarmani dunno, a bit cringey, init?
whichtom: Devs looks like a cool TV show but I cant find anywhere to watch it, which sucks
premell: what do you think of teslas progress towards full autonomy?
Ne0Zer0: LUL
mangoxavier: What server to use for project like this?
whichtom: big fan of alex garland
Talgathy: broken computer unlucky
bigie: the fuck
maxschneider96: @FargioFarmani I mean I like some videos, but most of them are still cringe
ky0jinjaeger: rip apple music
fizziblytwitching: stephen - your life
loouai: geo I know you hate nonsubs but my country is out of money and i use cash only lately
mangoxavier: Whichtom hell yes
Penguino138: Don't forget the pasta
loouai: https://pythondata.com/jupyter-vagrant/
Nelzex: what keeb?
Nelzex: haHAA
Penguino138: Oh the pasta is done already
bigie: why would the GPU be slower ?
Den_dp: apple EleGiggle
bigie: this guyyy
razmastaflex: Are you still in lockdown?
whichtom: still lagging?
neilsweb: I use fastai , so I use pytorch but don't know how to use it at the same time lol
Ne0Zer0: his macbook is literally imploding
Ne0Zer0: LUL
whichtom: is the fan dead again?
Digital_donger: TheIlluminati ...
smurfd0: do you have an update on obs,i saw some other mac guy who had issues until he upgraded obs
Ne0Zer0: Max Powers LUL
Joooooooooonas: why doe sit say 0 dropped frames thou
xeeton: forget the gov, OBS is the one with all the power
Crowz4K: !streamup
Crowz4K: !uptime
whichtom: about to take off
bigie: you need a new PC. possibly one with an nvidia card
Penguino138: Mac fans spinnin
mangoxavier: console log
Mariosavitch: i upgraded obs and shit stopped working too
maxschneider96: Anyone from london wanna sesh tonight?
routerkicker: lag is better now he's turned up the fans
Den_dp: new OBS can stream via GPU btw, That's called NVENC (new)
Joooooooooonas: msi afterburner is decent programm to log
ky0jinjaeger: F-16 taking off in your room?
demonshalo: Thank god I dont have to deal with this MAC shit XD
mangoxavier: activity monitor and press CMD+2
anguscupcake: macs have the best displays tho
yoloswag360noscope: ANELE
GS540: get a pc LUL
mashafique: Just download more RAM
mangoxavier: or Click the app name and go to services and do app leakage or system trace
sceptix1337: tfw geohot realizes apple sucks
whichtom: could use google colab?
bigie: 20 what exactly ?
whichtom: oh huh
whichtom: 20 speed
whichtom: LUL
Ne0Zer0: lmfaooooooooooooooo
Ne0Zer0: LUL
mashafique: LUL
bobsmash: lMAO
sceptix1337: lmaoo
saintmthw: LMFAO
maxschneider96: hahaha
whichtom: wow
anguscupcake: lol
Ne0Zer0: omg that is actually hilarious LUL
FargioFarmani: See this about the MacBook:
Jannnik: LUL
mariusmafius: charge on the right
bigie: LUL i didn't know it was a macbook
FargioFarmani: https://news.ycombinator.com/item?id=22957573
mangoxavier: ohhhh battery
Penguino138: Joe Biden's leg hair is the mystery
smurfd0: whut, computer needs powerz?
Skyshifter: u looking cute today georgie
funwayz: plug it to the right!
Mantelis0429: LULW
whichtom: oh I saw this on HN
Ne0Zer0: LUL wow
smurfd0: https://i-tweak.blogspot.com/2015/03/disable-cpu-throttling-in-mac-osx.html
anguscupcake: damn
PeinlicherAffe: left or right side? why two sides?
mangoxavier: wow left side isn't thunderbolt capable usbc?
bigie: what the fuck? this is a thing ?
OttoCavalry: LUL
mangoxavier: Battery monitor
Penguino138: hahaha
mariusmafius: not me :)
triple__m: mod me and I can Kappa
OttoCavalry: me :)
bobsmash: you need a power moderator
mangoxavier: you can set up an alert in system preferences
Giammanaco: Hi George from Italy! You are a genius!
Ne0Zer0: your fancy laptop should be telling you that LUL
mangoxavier: when you get down it will tell you
mangoxavier: it's a check box
bigie: I don't have disposable income to buy a macbook george. my laptops have to work LUL
Santiago_LHC: Make a twitch bot that relays your power to chat.
funwayz: power authority
teerv: hotz you are loaded just buy the mac pro 4Head
Digital_donger: someone make a chat bot that OCRs his battery Kappa
whichtom: mac is pretty good otherwise imo
wifestealer_99: Hello George!!!!!
wifestealer_99: where have yo been man...
gaocaandra: so the new approach
gaocaandra: is
mangoxavier: @georgehotz you need to check out the app "Spaces" You are dragging your windows when you can just do cmd+ arrow
gaocaandra: treat molecular dynamics
gaocaandra: like chess?
PeinlicherAffe: @gaocaandra ?
powerofpickle: Tiling wm gang!
maxschneider96: @gaocaandra wdy mean?
PeinlicherAffe: way faster
norB88: going down!!
el_Razor: Hermann Miller chair ?
sceptix1337: number go down
parasite_is_a_snakee: bitcoin mooning PogChamp
gaocaandra: i mean not like chess
xeeton: yay
sceptix1337: hell yeah replay buffer
gaocaandra: but to apply that methodology to choose the best config?
mangoxavier: oh, lmao my bad
eldac_kno: imagine ironic video tutorials where geohot teaches python
Theguywhobea: 👉 📈 PogChamp
miloeu: hi
maxschneider96: @gaocaandra ah gotcha
miloeu: !uptime
PeinlicherAffe: @gaocaandra this has nothing to do with molecular dynamics
gaocaandra: or what is the use of muzero in md?
miloeu: how long has he been online?
gaocaandra: ahhh
sceptix1337: number go down
gaocaandra: he is not with comma bio?
PeinlicherAffe: @gaocaandra commai stuff
Joooooooooonas: Why dont you buy a decent workstation ?
gsgera: so what's going on here?
bigie: so it's off policy monte carlo? what's the difference with e.g. DDPG ?
maxschneider96: I really hope he´ s gonna work with molecular dynamics again
sceptix1337: whats the blue stuff and whats the orange stuff?
miloeu: can you use vim inside jupyter
miloeu: notebook
gaocaandra: i'm guessing the protein didn't fold
Skyshifter: what is he working on with muzero?
sceptix1337: number go up
maxschneider96: @gaocaandra hahaha
miloeu: is this a prerecorded stream
whichtom: polecart
PeinlicherAffe: you need to fold the protein BRO
maxschneider96: @PeinlicherAffe yh
Theguywhobea: NaM
eeXecute: NaM
sceptix1337: you just got nand bro
gaocaandra: NAM
perrierking: what language is this
Ne0Zer0: first he got biden'd now he got nan'd
eeXecute: python
Joooooooooonas: the stream is still lagging thou
parasite_is_a_snakee: how can u not know its python... is it amateur hour over here?
I2btw: pll pay to make pyhton code?
I2btw: is funny
sceptix1337: whats the blue and whats the orange??
bigie: i like model based stuff. i have to check it out
eldac_kno: georgie boi is so cute, dont tell him
sheveeee: O_o
Penguino138: @Joooooooooonas might be your internet, stream seems smooth for me in 1080
sceptix1337: just write the replay buffer man
maxschneider96: @eldac_kno hope u don´ t bust a nut on your monitor rn bro
Joooooooooonas: @Penguino138 oh lol okay, hmm
mangoxavier: I'm just starting to learn python so this shit is blowing my mind right now
diaryofamadmonkey: You're hero George!
bigie: i think that'll fuck things up. as far as i remember basic cartpole also ends if you balance it for 10 frames or smth. not sure though
sceptix1337: number go moon
ozychhicodes: yo can you show us your key board please mr hot?
ozychhicodes: I'm just kidding
PeinlicherAffe: xD
superuserg: where I can find news on algorithms research and the like?
maxschneider96: @PeinlicherAffe R u german?
PeinlicherAffe: klärchen GunRun 7
Famousix: !commands
maxschneider96: I´ m austria, but I´ m living in london
maxschneider96: austrian
bigie: shit this also does monte carlo tree search?
whichtom: r/machinelearning is good for ml research
PeinlicherAffe: @maxschneider96 cool cool :)
sceptix1337: why do you need monte carlo for balancing a stick
superuserg: @whichtom thanks, I will take a look into that
I2btw: Is this Cobol programming?
maxschneider96: @PeinlicherAffe I sometimes wish I was in austria or germany again, they´ re dealing so much better w the current situation than the UK and the US
PeinlicherAffe: @maxschneider96 overall not easy :/
ELEMENTiQ1337: ELEMENTiQ1337 subscribed at Tier 1. They've subscribed for 2 months, currently on a 2 month streak! oh hi there, I finally catched your stream
sceptix1337: the next episode
maxschneider96: @PeinlicherAffe besonders mit Boris und Donald
whichtom: its not super bad in the UK
PeinlicherAffe: @maxschneider96 yo :D
Santiago_LHC: Have you guys seen the show Devs? It's about determinism and the simulation.
whichtom: just want quarantine to be over man, it sucks
parasite_is_a_snakee: @whichtom only 20k dead not that bad BloodTrail
I2btw: Imaging having a german sound name
whichtom: could be worse
I2btw: muha
ELEMENTiQ1337: @I2btw i do bruh
PeinlicherAffe: GunRun
maxschneider96: @whichtom yeah, but I´ ll at least have a private sesh today in london
whichtom: private sesh? @maxschneider96
I2btw: schneider
vexedkiller0071: wtf I left my computer on
parasite_is_a_snakee: he means a gay orgy
sceptix1337: replay buffer is love, replay buffer is life
maxschneider96: @whichtom yeah w people from my student accomodation
vexedkiller0071: who raided you?
Santiago_LHC: Don't touch your face, George
whichtom: ahh
Legardovia: hi
maxschneider96: @whichtom wanna join haha
whichtom: nah lol thanks
maxschneider96: haha
parasite_is_a_snakee: sesh aka gay orgy 4Head
PeinlicherAffe: @maxschneider96 what are you talking about?
PeinlicherAffe: @parasite_is_a_snakee lel
maxschneider96: @parasite_is_a_snakee my backdoor´ s only designed for exit
maxschneider96: @PeinlicherAffe small party...
PeinlicherAffe: k
Skyshifter: sounds like me
truemorpheuz: @PeinlicherAffe wtf
PeinlicherAffe: Jebaited
bigie: i don't know about the tree search part but that definitely happens without replay buffer. it doesn't revisit the good states without one
PeinlicherAffe: @진정한모피어스 kene lust mehr auf fedor? LUL
truemorpheuz: @PeinlicherAffe stalkst du mich ? WutFace
PeinlicherAffe: du mich cmonBruh
truemorpheuz: @PeinlicherAffe ne
sceptix1337: replay buffer is love, replay buffer is life
PeinlicherAffe: @진정한모피어스 cool that we share same interests :)
truemorpheuz: @PeinlicherAffe yes :)
PeinlicherAffe: @진정한모피어스 kiss now? :)
truemorpheuz: @PeinlicherAffe sure :)
PeinlicherAffe: @진정한모피어스 cool :)
sceptix1337: this just got real
truemorpheuz: @PeinlicherAffe yes :)
PeinlicherAffe: @진정한모피어스 very yes :)
alfantasticdd: I just understand the half of it but I thank you for streaming this stuff. 100% better than wasting time while watching games!
PeinlicherAffe: true
abedbawsxx: I don't understand a thing, also what's nine plus ten
samuriia: !uptime
gaocaandra: only english in chat bro
SVANI70: rayintKawaii rayintKawaii
PeinlicherAffe: @gaocaandra sorry bro
abedbawsxx: only english in chat please Kappa
samuriia: What’s the command to see how long he been stream for
JysonJeh3: hi
maxschneider96: What are the best machine - &amp; deep learning courses out there? I am a biochemist, but I wanna get into artificial intelligence for drug discovery.
gaocaandra: andrew ng course
ozychhicodes: @georgehotz can you name variables a bit more meaningfully pleas,e it'll be much easier to follow
gaocaandra: is a good intro
DasMastah: What's with the double "if done"?
parasite_is_a_snakee: looking for a course u already fucked up
gaocaandra: you learn by doing
minichota: @ozychhicodes he never does lmao
gaocaandra: you see what george is doing
maxschneider96: @gaocaandra I have created some machine learning models already, maybe something more advanced
bigie: it's meaningful in reeinforcement learning. v= value, s = state, a = action, p = probability
gaocaandra: that is how you learn
parasite_is_a_snakee: @maxschneider96 why dont u google it
maxschneider96: @gaocaandra That´ s why I´ m watching bro
gaocaandra: me too
gaocaandra: learning how to learn
gaocaandra: also good asmr
maxschneider96: @parasite_is_a_snakee wanted to have some opinions
graszewek: !uptime
gaocaandra: to work
gaocaandra: on the fucking weekend
whichtom: look at what people have already done, look at open source code
alfantasticdd: @bigie thanks for the explaination
whichtom: just search for keywords
maxschneider96: @whichtom thanks
eldac_kno: sorry if this was asked, thoughts on Yandex Cars?
sceptix1337: no never
whichtom: courses and stuff really aren't that useful imo
socialnotsocial: @georgehotz what is your sleeping schedule like? you seem to have high energy. Do you avoid stimulants also?
gaocaandra: he does coke and ritalin
whichtom: paid stuff at least. There is so much free content/tutorials/open source code/papers
brisingr1031: @georgehotz semicolon on get_training_epsiode
I2btw: SHow feet kaceyFist
PeinlicherAffe: @gaocaandra LUL
gaocaandra: for breakfast
ozychhicodes: @socialnotsocial adderall is a hell of a drug
sceptix1337: crippling ketamine addiction
brisingr1031: colon*
samuriia: @socialnotsocial adderal
whichtom: eating ice is his drug
sceptix1337: true
gaocaandra: why does everyone assume he is high
PeinlicherAffe: and limes
truemorpheuz: think its cocaine, code, sleep repeat
gaocaandra: all the time
maxschneider96: @sceptix1337 ketamine ftw
PeinlicherAffe: @gaocaandra lel you did
gaocaandra: if he were high he wouldn't reason sol well
ozychhicodes: How's ketamine even relevant here
PeinlicherAffe: highs are different @gaocaandra
Featen: someone tldr what is he doing?
gaocaandra: i work on weed
gaocaandra: for example
truemorpheuz: i too
gaocaandra: but the guy isn't on coke
samuriia: @gaocaandra have u ever been high lmao
PeinlicherAffe: horse anesthetic 4Head
gaocaandra: just because he types fast
maxschneider96: @ozychhicodes It´ s being tested for psychiatric disorders
elmixy: LUL
I2btw: This text editor is very responsive
ozychhicodes: time for stress eating
truemorpheuz: fentanyl
sceptix1337: recreational heroine
norB88: krokodil
Mariosavitch: ice cream... love being an adult
bigie: wait is the action part right? your network outputs the probability of choosing the action "1" ?
grahamstephan420: desomorphine
PeinlicherAffe: 🐊
ozychhicodes: why is he chewing with his front teeth
swftdev: asmr
PeinlicherAffe: @ozychhicodes he is addict
I2btw: desomorphine is this not more in a negavice way
gaocaandra: for more pleasure
I2btw: t
Vrookems: codeine squad
gaocaandra: the coke makes you feel flavor on the teeth
lexxy23: small amount, already 3 tablespoons full of ice cream
bSnatch: What programming language is this?
PeinlicherAffe: 🐍
eldac_kno: what do you think gonna be the core of AGI
grahamstephan420: Desomorphine is chemically pure krokodil
whichtom: we are so far from AGI, who knows
I2btw: i love phyton for UI. This is all i have to say about this fuck up
maxschneider96: @bSnatch python
whichtom: the current big research labs have little idea of how to get there
maxschneider96: the best
v0sn: wow george you are looking so good today!
bigie: does search return the probability of choosing "right" ?
parasite_is_a_snakee: @v0sn its the hair
buicy_jooty: !uptime
parasite_is_a_snakee: dont cut the hair george u look sexy
v0sn: indeed
liesai: yo bro
eldac_kno: i think its gonna be machine fo math proofs
I2btw: emilyccIRSS emilyccIRSS emilyccIRSS
emmbeezy: could you do a comprehensive tutorial how to follow scientific papers for coding?
brisingr1031: !commands
PeinlicherAffe: @emmbeezy turnup
eldac_kno: agi gonna crack the riehmann hypothesis
PythonNoob: is openpilot write in python ?
whichtom: AGI is a really weird topic for discussion anyway. who even knows if the singularity will come about even with AGI/ASI
PeinlicherAffe: @PythonNoob yes
emmbeezy: @PeinlicherAffe ?
grahamstephan420: Ops pilot is written in perl
tessier_ashp00l: anyone got the link to the paper he has up on screen?
sceptix1337: openpilot is written in asm
whichtom: its all guessing based on science fiction
eldac_kno: openpilot is written in Pascal
whichtom: afaik no one is _actually_ researching it
crawcraw66: what's up with that syntax? for _ in range?
norB88: https://arxiv.org/abs/1911.08265
PeinlicherAffe: @emmbeezy thought you were german and knew money boy, nvm
maxschneider96: @PeinlicherAffe money boy is austrian
sceptix1337: wer moneyboy nicht mag, liegt bald im sarg
whichtom: _ is like a blank variable
v0sn: skrt
emmbeezy: scurr?
PeinlicherAffe: sceptix1337 hat verstanden
sceptix1337: skrr skrr
ido_nvidia: @crawcraw66 where he doesnt care for the item just wanna iterate for the number of items
maxschneider96: @sceptix1337 hahaha
PeinlicherAffe: germans take over monkaS
crawcraw66: @ido_nvidia ohh ok thx
Keyeh: number going down Pog
TasosTheLord: TasosTheLord subscribed at Tier 1. 
v0sn: deutsche an die macht
pelegogrosso: what is he doing?
TasosTheLord: PrideHi
PeinlicherAffe: 🇩🇪 7
sceptix1337: hes balancing a stick lol
whichtom: yea no point assigning an actual variable if it wont be used, so use _
grahamstephan420: subscribed at Tier 0
dontbeameme: Gg
bigie: @whichtom the main goal of openai is to find AGI
sceptix1337: using some overengineered ai stuff
ido_nvidia: yep
tessier_ashp00l: TY
whichtom: @bigie i have yet to see any good work towards it
whichtom: apart from overhyped press releases with little new work
whichtom: also renamed to 'closedai'
whichtom: openai is such a scam
bigie: their language model is pretty good. their dota thing was amazing. i don't know how it's a scam
Maw3rick: monkaS
doganigooo2: helloo
kerediax: not a scam but pretty overhyped imo
doganigooo2: what happen to covid research
gaocaandra: it died
crawcraw66: so what is the algorithm meant to do? balance that stick/
whichtom: the dota thing was kinda disingenuous b/c of how many limitations were placed on the system
gaocaandra: we are now a tree search cooperative
sceptix1337: battery number go up
whichtom: GPT-2 is interesting yea, but how they went about it leaves a bad taste in my mouth
bigie: yes but if you don't force the agent's hand in a big state space like that it won't work. same with starcraft and deepmind
god_damn: PogChamp 📈
eldac_kno: gpt 2 is defintely not future
whichtom: which is fine, just don't advertise it as solved
eldac_kno: it doesnt understand text
TasosTheLord: just fold the stick man
whichtom: Deepmind's SC2 agents are pretty bad still
sceptix1337: lmao
whichtom: when it was playing in the ladder, a lot of people found it was shit
gaocaandra: all of "machine learning" is sortof snake oil
itsPhlu: hey george
whichtom: but they still went around saying they solved it
gaocaandra: it does work
gaocaandra: but its very limited
gaocaandra: and overhyped
mangoxavier: What can I do to prevent models being built for me in order to manipulate me (IoT). Other than just blocking ads
whichtom: yea
ido_nvidia: some of it works really well tho
whichtom: incredibly overhyped
ido_nvidia: what about alpha go tho?
bigie: no one claimed they solved it. openai failed vs. pro teams. it's just the big leap from atari games
gaocaandra: but thats the context
whichtom: yea true
gaocaandra: at this point in history
god_damn: i'm not really understanding, why would he turn himslef into a pickle
whichtom: even w/ atari games, most algorithms published struggle with sparse rewards
gaocaandra: we are headed towards another winter
itsPhlu: lmfao
bigie: the people around it who didn't understand what was going on overhyped it. AI is in general overhyped bcs of it
whichtom: even this one, muzero, struggles with most which is why most algorithms don't count all of the atari games
maxschneider96: @gaocaandra I wish there were sometimes better sources to figure out which model to use
itsPhlu: lol
gaocaandra: which will go unnoticed beacus these tools altough overhyped can have a great impact in accesibility
itsPhlu: hi george
whichtom: struggles with a few sorry*
itsPhlu: hi mr hotz
itsPhlu: u kinda cute
whichtom: like montezumas revenge and pitfall
sceptix1337: is this reinforcement learning
eldac_kno: GPT 2 doesnt "understand" text
itsPhlu: just use a bypass 3+
gaocaandra: because
ido_nvidia: yes
whichtom: alphago is cool ye I'll admit
PythonNoob: what is hes leyboard ?
gaocaandra: these algorithms are learning a function thet describes the statiscal distribution of a LIMITED dataset
itsPhlu: !
gaocaandra: thats inherently limited
cybergenik: @georgehotz what kb do you use?
itsPhlu: !kb
itsPhlu: !keyboarddd
itsPhlu: dont work
tensorspac3: why?
gaocaandra: you are't learning t speack
itsPhlu: help
raisedbyphantom: what is he doing
whichtom: the media keeps overhyping/misunderstanding openai's work but openai doesn't really do anything to correct them
itsPhlu: helpll
bigie: the games are usually pretty complex compared to what people use it for. DDPG is used for robot arm control but might suck ass at dota
Mariosavitch: nothing @raisedbyphantom
orami: i believe he has an hhkb
PeinlicherAffe: @whichtom not his problem if he gets free promo
whichtom: yea generalization is obviously the biggest requirement for AGI that hasnt been met
gaocaandra: altough it beats kasparov in chess it doesn't know to 'play' chess
gaocaandra: that diference is subtle
bigie: AGI is not gonna happen without a big push from neuroscience but people are working on it.
whichtom: thats kinda philosophical
gaocaandra: that difference is the diference between AGI and ML
miloeu: is someone familiar with JS in .pdf files?
whichtom: do _we_ really know how to play chess, other than respond to inputs with some output
sceptix1337: you just need more compute for agi
whichtom: if we act instinctually, do we understand what we did
bigie: @georgehotz what does search() do in run_episode()? seems like you expect it to return the probability of tatking the action "1"
whichtom: @bigie ya I agree, need way more work in neuroscience
gaocaandra: I mean
bigie: ah ok makes sense now
sceptix1337: try leaning the stick and make some test cases if search() distribution makes sense
gaocaandra: the idea that a neuron firing in the brain is somehow equivalent to a linear function encased in a nonlinear functiom
gaocaandra: is ignorant of all the nuances
whichtom: oh yeah its not 1-to-1
CoachMeech: GOAT SHIT
gaocaandra: and processes that take place
bigie: @whichtom listel to lex friedman's podcast. there's a lot of work being put into AGI but mostly in neuroscience. it'll take a long long time
gaocaandra: on a human brain
maxschneider96: Hoping for deep reasoning to properly happen in 2020
metis_zver: Hi, what's your monitor?
emmbeezy: @georgehotz do you have a git where you publish these things?
whichtom: oh yeah Ive watched a lot of episodes of the AI podcast @bigie
PeinlicherAffe: funfact: you can't compute the total number of possibilities in chess. there's is an estimate/lower bound of 10^120 states (look shannon number) but probably way more
whichtom: its fantastic
sceptix1337: you just need more compute
whichtom: @emmbeezy geohot on github
gaocaandra: i think that AGI will emerge from a cellular automata
CoachMeech: what is a george hotz?
gaocaandra: and feed us all
gaocaandra: corn
sceptix1337: kb boss
sceptix1337: return loss 0 big brain
whichtom: thats actually how I found geo, through lex
maxschneider96: @whichtom great podcast
bigie: that was a fun episode
I2btw: You sub to e-girls @georgehotz ?
whichtom: yea lol
chaprio1: @georgehotz what do you think about zoom LUL
abhinavneelam: !bet 20
sceptix1337: do you train the network with the stick falling over just one time?
pwnbase: pwnbase subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 2 month streak! primeagenAJasm
I2btw: kandyFinduz
maxschneider96: are u already working on the artificial intelligence brothels u talked about with lex fridman?
I2btw: Pll sponser me my sub
Mrkz_: Hey everyone :) What's the topic of today?
bigie: the network represent an agent. the environment just tells it if it did "good" or "bad" using the reward function. it has to figure out what to do @sceptix1337
I2btw: mcretIQ
miths: miths subscribed at Tier 1. They've subscribed for 2 months! 
sceptix1337: i get that but if he only trains it once its never gonna learn
sceptix1337: stick has to fall over many times
Muahmli: HEYYYYYY
eyep1e: still using HHKB?
bigie: he runs it more than once but not a lot because it's not learning
sceptix1337: ok
jacekakacz: George what do you think about RaspberyyPi?
eyep1e: lmao
sceptix1337: check if your search returns a good distribution
Bootstraps: is this still part of the corona virus reverse engineering
Ne0Zer0: LUL
bigie: LUL denied
mashafique: LUL
whichtom: @Bootstraps nah
Skyshifter: monkaS
socialnotsocial: @georgehotz what is your sleeping schedule like? you seem to have high energy. Do you avoid stimulants also or not?
eyep1e: 3,2,1 bye
yoloswag360noscope: D:
DiiCE3: pwned
miloeu: f in chat LULW
PythonNoob: i remember goehot from ps3 crack ...
Penguino138: @georgehotz you drinking green tea?
eyep1e: someones next
gaocaandra: it's the fast typing
gaocaandra: they can't imagine
gaocaandra: being able to
sceptix1337: they cant handle 200wpm
ofaas: do you supplement
eyep1e: the energy comes from wearing a black hoodie
mangoxavier: George has already said that drugs only let you explore inside yourself. There's no point to that with what he's doing right now.
bigie: i wanna be on drugs but they're hard to get with the quarantine. bullshit
calcmath: can you somehow visualise the model of the environment that is learnt
gent03: FREE MY BOY QUICKFLOOR
PythonNoob: @bigie thats true ....
sceptix1337: george your search function is bad
Skyshifter: quickfloor was just a memer BibleThump
PythonNoob: @bigie harder to find and more expensive .... way more...
malmeani: malmeani subscribed at Tier 1. 
bigie: yep...
raulciuntastefan: is kratom good ?
truemorpheuz: @raulciuntastefan no
mangoxavier: kratom doesn't do much IMO
truemorpheuz: its bad
eyep1e: caffeine is all i need
mangoxavier: can make you angry after taking it and screw with your blood pressure
Skyshifter: yea i just snort coffee powder
eyep1e: im young work out daily and meditate twice a day, im sorted
sceptix1337: moar compute!
calcmath: increase capacity of model?
eyep1e: whats wrong with the search function @sceptix1337
whichtom: what was that biohacking thing before, applying UV to the forehead?
ajnoom: yo
washuash: good morning from estonia
sceptix1337: distribution not normalized
washuash: what are we doing today
ajnoom: !followsince
CoachMeech: GEORGE
ajnoom: !followage
whichtom: you can click your name and see follow age
bigie: 80 seems pretty good to me
sceptix1337: stick go balance
mangoxavier: great
Skyshifter: Pog
whichtom: w o w
norB88: boom
mangoxavier: he knows kung fu
yuptheladsdownthecans: PogChamp
pwnbase: STICKO MODE
ofaas: i was here
Digital_donger: balanced stick PogChamp
sceptix1337: check if it works with gravity increased
Santiago_LHC: GG
mangoxavier: lmao sticko mode haha
god_damn: thats incredible, i guess terminator really is going to happen
Mrkz_: !uptime
PsycopathSurgon: thank you for every Jail Break you made ,you really helped me for the country i used to live in has no app store access :)
sondreal: sondreal subscribed at Tier 1. They've subscribed for 9 months! 9 months PogChamp
eyep1e: cha-ching
Skyshifter: AI has now achieved the balance of a child's brain
ky0jinjaeger: why use lot word when few word do trick?
Ne0Zer0: PogChamp
sceptix1337: that was me
mangoxavier: @pwnbase he's got a new single with Kid Cuddi
ez_clappers_: me :)
god_damn: that was @quickfloor may he rest in peace
parasite_is_a_snakee: me :)
sleep_waIk: Hey orbWave
mangoxavier: I am spartacus
Skyshifter: 1 step close to the turing test monkaS
Santiago_LHC: Is there a github repo for today's twitch?
brkydnc: do you upload every stream yo do ?
maxschneider96: When will AI replace barbers? Can´ t get my hair cut during the lockdown...
sceptix1337: what did you even change lol
Penguino138: @brkydnc Comma AI Archive does on YT
brkydnc: thanks!
whichtom: @Santiago_LHC check the geohot github on geohot/ai-notebooks
mangoxavier: Will George be secluded to a compound in Alaska and drink all day and then run some lottery for his company where a guy comes and interacts with the stick but falls in love with the stick?
Dai_Vern0n: why does it stop?
god_damn: @Dai_Vern0n it get bored after 82
mangoxavier: Put a wig on the stick
TasosTheLord: NotLikeThis
Joooooooooonas: So what are we gonna do PogChamp
sceptix1337: make the stick a dick
mangoxavier: dat can be dat
mangoxavier: dis n dat
sceptix1337: can this balance stick in real time
Skyshifter: how many sims till the AI breaks out of its sandbox and beats u with the stick for making it do this menial shit for hours?
mangoxavier: a stick beating someone with a stick is meta af
logi6000: how was the alpha go movie
sceptix1337: wouldnt the cartpool hit him
sceptix1337: that looked smooth af
mangoxavier: alpha go movie is amazing
CoachMeech: NICE
mangoxavier: if you learn to play the game it will blow your mind
erichtp: extend stick length will it understand stick then
sceptix1337: now make it balance stick attached to stick
mangoxavier: it's mind blowing regardless but really useful to get a glimpse into how they layer ai and machine learning
sceptix1337: yeah lets go
sceptix1337: stick on stick
bigie: cartpole episode termination: length is greater than 200 (500 for v1). so your max score is around 200 i guess
sondreal: Remember to subscibe, its a really good investment boiiis! PogChamp
calcmath: can you try for longern than 100?
logi6000: @sondreal subs have bigger dix
Featen: rip
Skyshifter: surely the AI should be able to balance the stick perfectly eventually right? like no movement?
sondreal: logi6000 true
sceptix1337: local minimum go brrr
logi6000: stick balancer go brr
simmy7: simmy7 subscribed with Twitch Prime. They've subscribed for 5 months! 
calcmath: maybe neural network got bad initial weights
eldac_kno: are you gonna go on JRE
sun_is_not_yellow: !uptime
logi6000: @eldac_kno he probably won't
Featen: gamma?
eldac_kno: it would awesome tho
god_damn: @eldac_kno yeah cant wait to hear what he thinks about the ferguson fight
logi6000: @god_damn lol
calcmath: reinitialize the neuralnetwork between runs
Featen: go lower
eldac_kno: elk meat
sceptix1337: make an ai that finds the best gammi
sceptix1337: gamma
tessier_ashp00l: forget, JRE, do The Portal
Silodox: oh hey, sup hotz. i had you followed not when your first stream would be
Silodox: i vibe with your energy tho
eldac_kno: eric weinstein is a fraud sorry
tessier_ashp00l: i know
calcmath: you need to recompile the keras model to reinitialize neural networks weights otherwise it will always be stuck in local minima
whichtom: how is eric a fraud?
eldac_kno: he dont want publish paper on his "breaktrough" theory
god_damn: i miss 82
tessier_ashp00l: see if gh calls him on his shit
gigafact: It's nice to finally catch the stream live. We see some disconnects happened during the stream so more work for us to sync chat ect when uploading to youtube...
bigie: LUL what happened
Silodox: that is programming in a nutshell when you want to make edits, "hey yeah remember that time when it worked"
Silodox: lmao
eldac_kno: geohot is not a physiciat lol
Featen: "calcmath: you need to recompile the keras model to reinitialize neural networks weights otherwise it will always be stuck in local minima" ?
mangoxavier: mangoxavier subscribed with Twitch Prime. 
tessier_ashp00l: doesnt take a physicist to see he is a crank
mangoxavier: nice
dps910: hi
calcmath: You are just stuck inlocal minima, need to reinitialize weights
sceptix1337: local minimum go brr
eldac_kno: i mean there should be a paper and then physicist gonna make peer review and decide whether it is legit or not
tessier_ashp00l: there will never be a paper, thats the thing
Joselinis: all you need is lofi to make this work
eldac_kno: just publishing youtube video of your lecture is not a legit way to present your theory
Fr0zenOfficial: hello, what are you programming right now?
whichtom: I mean submitting papers for review is kinda a scam in itself but yea
whichtom: given reviewers are sometimes stupid and academia is wack but I get it
mangoxavier: That was easy, is prime sub okay too?
calcmath: please reinitialize ur NN
Featen: " @calcmath : you need to recompile the keras model to reinitialize neural networks weights otherwise it will always be stuck in local minima"
sceptix1337: geohot uses reinitalize! its very effective!
eldac_kno: perelman did paper, why eric is above that
bigie: yeah it shouldn't be that sensitive to hyperparameters.
whichtom: who knows
calcmath: thanks featen
tessier_ashp00l: eric is only looking for followers and fame
Silodox: hey to be fair the atari jaguar WAS kinda swink swank groovy tho
whichtom: a paper is a good idea anyways to formalize/convey ideas better
routerkicker: Peer review is utter shit but he could at least porst his paper on the internet. As long as he doesn't do that he's a scam to me.
whichtom: you don't go into physics/math for followers and fame lol
Waldoqq: HEY EVERYONE LOOK AT ME
mangoxavier: hi
Featen: @georgehotz " @calcmath : you need to recompile the keras model to reinitialize neural networks weights otherwise it will always be stuck in local minima"
calcmath: he will eventually restart kernel and it will reinitilize his model and it will work
gigafact: George did you watch the new Karpathy talk about TeslaAI? it was very interesting...
whichtom: like wolfram published his ideas and people tore him apart
auron018: greetings from albania!
sceptix1337: reinitialize my man
whichtom: 'published' I mean informally
jimbofreak: wouldn't adding one more stick to the system make everything way more complicated due to the fact that two sticks attached to a point show chaotic behavior?
sceptix1337: thats the point
routerkicker: doesn't matter. if the theorie's right people will have to eat their words eventually.
sceptix1337: we want to see if ai can solve advanced physics
mannekchin: HeyGuys
calcmath: keep trying different inits
eldac_kno: it already solves some of it
sceptix1337: this is like the villin, the initial position is bad for folding, you need to pull the stick at both ends
Featen: refit starts in local minimum already
mangoxavier: ohhhhh is this a Joe Baiden ai?
calcmath: NN are finicky like that, need to try many inits
calcmath: or make them wder
calcmath: wider*
mangoxavier: A stick that keeps forgetting
sceptix1337: search is bugged
sceptix1337: im callin it
mannekchin: Kappa
mannekchin: i wonder when he going to read this Kappa
sceptix1337: the cartpool isnt getting enough credit tbh
bigie: cartpole starts at upright so if it's ending at ~20 it's either going out of bounds facing down for 180 steps. probably the first one
bigie: *or facing down
curr1wurst: I wish I could code like him...
supplydemand88: sup
eldac_kno: just practice more
sceptix1337: back to the high numbers bois
supplydemand88: george what do you think is the best way to do (dis)similarity measures in python for ts? DTW, EDR or?
sceptix1337: nvm
mannekchin: for a begginer, what do you see that allows you to say wheter its elarning or not?
calcmath: is learning rate too high?
calcmath: the first number shoudl go down, second number should go up
norB88: https://gist.github.com/crizCraig/ec806f0d606c9e727512dce886bdc966
sceptix1337: number dont go right &gt;:(
sceptix1337: why is there 0.00 and 0.99
sceptix1337: seems extreme
bigie: it should also usually have some random walk
calcmath: its not trained properly, so it wont make sense
pedrosantos867: guys what is this ide name
pedrosantos867: named?
nsielicki: that's jupyter
calcmath: jupyter
whichtom: its in a jupyter notebook
Ipkstef: hello what are weorking on today&gt;?
eldac_kno: jew peter
sceptix1337: make the policy so the cartpool isnt rewarded for small movements
eldac_kno: funny?
bigie: maybe ye should also put a size limit on your replay buffer. they're talking about priority queue though so im not sure
Featen: isnt it just overfitting?
sceptix1337: those numbers look better
calcmath: if loss is decreasing but value is not increasing, yeah it seems like overfit
sceptix1337: restart kernel
THX1342: what framework is he using here? keraws?
THX1342: *keras
sceptix1337: it overfits to the stick being perfectly balanced
fearofcode: "Grrr" - also my experience with evolutionary computation
melahii: what do u think about colab
sceptix1337: it needs more tilt
calcmath: change number of layers/ number of neurons?
sceptix1337: use cuda
phelipe3: yo!
mannekchin: dont bother, he doesnt read chat PepeLaugh
bigie: bad policies can fill the replay buffer with garbage which makes the policy even worse
eldac_kno: he reads only useful comments made by Subscribers
sceptix1337: play with the replay buffer size
Emma_Cakes: Good evening :)
calcmath: bad policies dictate how action space is explored right?
timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be
sceptix1337: ^
timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
nsielicki: if &lt;...&gt; len(replay_buffer) &lt; 10: replay_buffer = replay_buffer[0:50] ???
sceptix1337: ikr seems like oob access
timeiskey: GO READ MY MESSAGE AAAG
lord_alpaca_666: I am glad this is no longer a subscriber only chat. Thank you, george.
timeiskey: THE TAB ON mu.fit is ONE TO THE LEFT
C4TFive: how that match stick treating you george?
calcmath: i think fit should be outside that loop right
nsielicki: read chat^^^^ indentation bug
eldac_kno: big brain energy right there
FargioFarmani: @georgehotz There is this good book which might help you: "Deep Reinforcement Learning in Action"
sceptix1337: yeah sure hes just gonna read the book now
eldac_kno: is Art of programming worth studying?
calcmath: i think he prefers to learns hthings by doing
FargioFarmani: its new
ortunado: its like March 2020
ortunado: i think
MoProject: ho
sceptix1337: audit the search function
死ね: can u do a rice overview real quick?
fancyslimshady: youtube
sceptix1337: thats what im betting on
justcrash: hotz's stream and my life suddenly stops being miserable
timeiskey: MR HOTZ, you gotta fit the replays INDIVIDUALLY. SEQUENTIALLY. NOT IN A BATCH FIT
timeiskey: AAAAAAAAAAAAHHHHHHHHH
nsielicki: george, read timeiskey messages above, you have a simple bug
PeinlicherAffe: BRO SEQUENTIALLY
cankoloz: @timeiskey LUL
knicked: SEQUENTIALLY BRO
Featen: BRO
eldac_kno: read timeiskey message
timeiskey: SEQUENTIALLY
alextodoroki: based retard not reading chat
eldac_kno: TIMEISKEY MESSAGE
sceptix1337: policy is also important guys
h1lfiger: yo geo!
dontbeameme: 200iq
calcmath: lol he is gutting his code now
raystriker98: damn he's still on it?
sceptix1337: still balancing a stick
timeiskey: MSE IS AVERAGING YOUR EXPERIENCES T_T
eldac_kno: lol
nsielicki: wow this is lame read the fucking chat george
Artara_: most interactive twitch chat LUL
sceptix1337: try policy, if that dont work listen to timeiskey
cankoloz: he is changing shit right now, he reads in between
eldac_kno: it's like watching hitchcock movie
7Locrian7: he's focused
32bitrobo: &lt;3 VoHiYo PogChamp CurseLit
Pedi: @7Locrian7 +1
nsielicki: i'm just worried that once he gets around to chat it's gonna be off his screen and he's not going to see it.
ortunado: @7Locrian7 i dont think so, we dont see green tea
calcmath: so what you are saying is you should train on one experience replay at a time?
justcrash: just write the n word and he will be alerted in seconds
timeiskey: lets vote with spam
alextodoroki: LOL
7Locrian7: monkaS
FargioFarmani: naughty
sceptix1337: vote with sperm
ozychhicodes: There's no 3
fearofcode: would it help to compare to possible working implementations like https://github.com/werner-duvaud/muzero-general/blob/master/games/cartpole.py ?
timeiskey: you gotta fit the replays individually sequentially not in a batch fit
eldac_kno: georgi boi is such qt when focused
timeiskey: spam go
norB88: @timeiskey shouldnt you have both? Individual and batched?
sceptix1337: SEQUENTIALLY
cankoloz: @georgehotz someone said you shouldn't fit to batch, should do sequentially
timeiskey: SEQUENTIALLY
eldac_kno: SEQUENTIALLY
justcrash: HAHAHAHAHA
routerkicker: you gotta fit the replays individually sequentially not in a batch fit
nsielicki: lmfao
alextodoroki: SCROLL UP AND READ TIMEISKEY'S CHAT YA DINGUS
knicked: SEQUENTIALLY
erlsek: hahaha
justcrash: oh my god im crying
eldac_kno: rofl
cankoloz: Pepega
eldac_kno: F
nsielicki: F
knicked: F
timeiskey: F
sceptix1337: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
justcrash: F
Joselinis: F
inDOObitablee: ignored
justcrash: HE WILL LITERALLY WIPE OUT THIS WHOLE CODE
MacoNighto: Yo it's geohot and for those that don't know...
ozychhicodes: Why do you have "mse", "mse" twice?
sceptix1337: im getting sued by sony
justcrash: @MacoNighto LOL
MacoNighto: haha
cankoloz: Just delete the whole code 4Head
死ね: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
alextodoroki: george hotz i'm simply appalled at the levels of mental handicapped that you have reached on this stream
erlsek: ahahahahanm
justcrash: hahahhaa @alextodoroki
sceptix1337: no dont mse
timeiskey: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
justcrash: im fucking choking
sceptix1337: youre making god sad
nsielicki: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
erlsek: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
MacoNighto: :D
死ね: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
sceptix1337: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
justcrash: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
whichtom: chat no
hardtarget4: never gonna break out of the simulation at this rate Kappa
knicked: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
eldac_kno: : timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
alextodoroki: Cheer1 does cheer1 get text to speech haha anyway sequentially bro
buzzind99: PepeLaugh OH NO NO NO
justcrash: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny..
fearofcode: chat is mean :(
eldac_kno: : timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny. Twitch Primewhichtom:
sceptix1337: legally blind lmao
inDOObitablee: READ CHAT
justcrash: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
ozychhicodes: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny. Twitch Primewhichtom:
mejhem: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny..
nsielicki: timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny
whichtom: he'll get there eventually
eldac_kno: : timeiskey: are you doing old fashioned experience replay? if yes, make sure to fit each experience individually, not in a batch, or the errors will be MSE'd and be like 1/K the size they should be sceptix1337: ^ timeiskey: it looks like you are forwarding them all in a batch, so your error will be too tiny.
erlsek: PLEASE READ
erlsek: finally
sceptix1337: finally
WearyBread: hello there
justcrash: HAHAHAHAHA
erlsek: hjmkahja
justcrash: NOOOOOOOOOOOOO
sceptix1337: XDDD
alextodoroki: LOL
ozychhicodes: well, we got that
mejhem: LUL
nsielicki: only took TEN MINUTES
ortunado: @timeiskey get rekt monkaS
alextodoroki: fucking based
cankoloz: Way too dank
timeiskey: you are batching your mu.fit
calcmath: tbh i am nost sure the comment makes sense
eldac_kno: LUL
calcmath: why is batch wrong?
timeiskey: tab mu.fit into the FOR LOOP
justcrash: IT TOOK TEN MINUTES TO MAKE HIM SAY THAT HE DOESNT UNDERSTAND :LUL:
horndeski: What are you programming?
sceptix1337: youre batching your error and you lose all learning that way
hardtarget4: son of a
Joselinis: f
erlsek: oh no
timeiskey: he is essentially only getting one replay per batch
ozychhicodes: @horndeski this is not programming channel, this is modify a random value, comment some code out and try again channel
Featen: add tab to fit
FargioFarmani: please repaste all: tab mu.fit into the FOR LOOP
t00big2fl4il: !uptime
calcmath: oh so the same replay is being used for the entire batch?
eldac_kno: tab mu.fit into the FOR LOOP
calcmath: ahh ok makes sense
Featen: add tab in fit line
ozychhicodes: oh man i cant take this any more
calcmath: but arbitrary scaling doesn not matter right?
ozychhicodes: why is he trying to force fix this without understanding
t00big2fl4il: yo what up?
erlsek: print loss
nsielicki: double dared
ozychhicodes: print loss
calcmath: he is already printing the loss
Pedi: I'm entertained, keep going chat
ortunado: @calcmath i dont think the scammers understand it LUL
calcmath: lol
ROXASBrandon: I understand why he doesn't read chat, you guys are toxic asf
t00big2fl4il: Are you writing a program to calculate the risk of inflation due to the ever expanding national debt?
nsielicki: over iterations he means
lpdon2: deep learning in a nutshell
milcapone: hello from Greece. i dont understand programming but love when you discuss various things in our society!
justcrash: rip
frunkAF: oh shit
Subonik: monkaS
Pedi: LUL
justcrash: he literally banned them
PeinlicherAffe: monkaS
Ne0Zer0: LUL
b2kemann: we are still going!! awsm
whichtom: LUL
I2btw: georgehotz you stop streaming?
Digital_donger: monkaS
andrew_mrballsack: hi was he intersted in coding and mathas a kid
ortunado: roxas got green sword bois!
b2kemann: is geo mad? i just came
Subonik: Wow, that ROXASBrandon guy is really swell. :)
whichtom: yea geo will get there with his method
JeanFrag: WOW GREAT CHAT monkaS
PeinlicherAffe: xD
raystriker98: what's geohot doing today? something obscure? or open pilot stuff?
I2btw: the point is why work
Featen: add tab to mu fit
nsielicki: BASED AND FUCKING REDPILLED
nsielicki: TIMEISKEY MOD WHEN
okeeeeeee: XD
whichtom: bruh
erlsek: AHAJKH,AA
Digital_donger: the madman did it PogChamp
Santiago_LHC: @raystriker98 neither
mejhem: LUL
eldac_kno: F
Pedi: LUL
knicked: F
PeinlicherAffe: timeiskey 4 mod
calcmath: try higher than 100 time steps
PeinlicherAffe: timeiskey 4 mod BRO
raystriker98: @santiago_lhc what's he doing?
I2btw: floats numbers are shit
b2kemann: nice
nsielicki: TIMEISKEY MOD NOW
eldac_kno: it took half an hour to read the chat lol
Pedi: @cankoloz not if he gets mod now :O
bigie: 200 is the max in cartpole. after that the episode ends
shoesman17: mod him SwiftRage
lpdon2: what was the fix
whichtom: pretty cool
randoma1: What is he making? I just tuned in
Ne0Zer0: lmfaoooooooo
hardtarget4: lmao
ortunado: enjoy timeiskey LUL
erlsek: oh no
PeinlicherAffe: not ban D:
ortunado: i love @georgehotz
Ne0Zer0: LUL
Pedi: LUL he acutally got banned
PeinlicherAffe: mod
ozychhicodes: lol
okeeeeeee: ??????
kaboomyoo: banned im so weak
PeinlicherAffe: he helped you
DasMastah: lol
erlsek: hajhkajhkla
treeknifeslug: lol
ozychhicodes: @timeiskey pepehands
Subonik: LUL
eeXecute: BAM
okeeeeeee: ?????? 󠀀
erlsek: f
eldac_kno: EPIC gamer moment
hardtarget4: got him
PeinlicherAffe: FeelsBadMan
mejhem: He died for our sins
ortunado: BEST F IN AWHILE LUL
buzzind99: Banned for helping
knicked: top 10 anime deaths
PeinlicherAffe: xD
Pedi: @ROXASBrandon did you ban him?
Ne0Zer0: the noble sacrifice LUL
FargioFarmani: F
PeinlicherAffe: F
okeeeeeee: help = ban
eldac_kno: top 10 anime betrayals
chai_wala: !uptime
PeinlicherAffe: FeelsBadMan / FeelsBadMan
Ne0Zer0: pole ran away lol
Zepcon7: Is your fan running?
ortunado: @ozychhicodes ps3 jb? LUL
nsielicki: “The tyrant dies and his rule is over, the martyr dies and his rule begins.”
Pedi: @cankoloz FeelsBadMan
eldac_kno: Fs in the chat for timeiskey boiis
funwayz: @georgehotz he was telling you to do that for 15 minutes
Ne0Zer0: LUL
whichtom: LUL
PeinlicherAffe: monkaS
suspence20: LUL
mashafique: monkaS
frunkAF: LUL
mejhem: FeelsBadMan
justcrash: GEORGE DONT KILL ME NOOOOOOOOOOOOOOO
b2kemann: why the mood? what happened??
erlsek: you can use /user timeiskey
calcmath: can you try 1000 steps?
whichtom: chat just backseating and being rude
bigie: he said you missed a tab on mu fit() so it wasn't doing it more than once or smth but you didn't change that when it worked
calcmath: mu.fit is fine
blazeofglorytv: Where did he stop with covid19 reverse?
milcapone: hello from greece love your stream
Ne0Zer0: this is quality content lol
bigie: i think that's what he was saying and the morons were spamming it
routerkicker: yeah he wanted it in the loop
Pedi: I can mod :)
Santiago_LHC: I can mod
chai_wala: I just wanted to thank george for the bubble sort tutorial in python, Thanks george!! :)
sleep_waIk: sumVac2
Santiago_LHC: I like timeouts
Pedi: @cankoloz as well
hardtarget4: yeah we need to clean this place up
Joooooooooonas: atleast timeouted LUL
kaboomyoo: bubble sort xDD
gent03: yo let me be a mod
andrew_mrballsack: can i ask whats muzero and wat hes doin
CoachMeech: GEORGE
gent03: i’ll take care of these fools
Penguino138: I wish someday to be a mod. Subbed today but been watching for a while
CoachMeech: GEORGE OF THE JUNGLE
whichtom: being mod isn't fun
bigie: @andrew_mrballsack a reinforcement learning algorithm
CoachMeech: Stop simping for mods losers
routerkicker: if you put the fit in the loop and it works unban him
FargioFarmani: @georgehotz Take me as a mod
Penguino138: oh shitt
Penguino138: back to the subs only chat
Penguino138: waste your points
b2kemann: feels good
CoachMeech: FREE THE PLEBS REE
TasosTheLord: DansGame
gaocaandra: yeah boii
eldac_kno: chad subscribers
PeinlicherAffe: FeelsBadMan
bigie: haha plebs get out. my sub finally paid off
Mariosavitch: ive lerked so long i have a billion points
b2kemann: the elites
CoachMeech: NON SUBS, WE MUST FIND THE EXPLOIT IN THESE RULES.
Penguino138: IRON FIST GEORGE
7Locrian7: D:
shoesman17: monkaS
Penguino138: Yeahhhh waste all your points non-subbers
eldac_kno: lol
malmeani: you inspire me
gaocaandra: because we could use the chat to learn shit
qlutoo: whats this math shit? LOL
gaocaandra: not spam
Pedi: I am hiding shhh
b2kemann: why should he read the chat if it's just bs
bigie: i think you can disable the twitch point msg thing
TasosTheLord: Just let them BibleThump
FaustPetrovich: FaustPetrovich subscribed at Tier 1. They've subscribed for 6 months, currently on a 6 month streak! whoa 6 mouths already?!
gaocaandra: because sometimes we are helpfull
Penguino138: They're misbehaving we have to have some semblance of control
Mariosavitch: before you do, i want to say i love you
Ne0Zer0: Honestly I think they like getting banned lol
hurzg: chat is fine compared to some other streams btw :D thats freedom of speech (or stupidity) :D
gaocaandra: i guess
bigie: definitely but i don't know how
PeinlicherAffe: see you in next life
gaocaandra: we get entertained he gets help
plazmacsgo: see ya
henistein: How worth is learning assembly nowadays?
gaocaandra: win win
shrekandchill: He dropping more bans than the americans be dropping bombs in the middle east
Joooooooooonas: Yea, you can edit it and shit so you need more points or disable it completely
Mariosavitch: please hotz. we love you.. dont :(
eldac_kno: is art of programmin worth reading?
Santiago_LHC: Are people misbehaving?
whichtom: @henistein only for OS development or reverse engineering probably
bigie: what was k to begin with? is it an algorithm specific thing ?
plazmacsgo: what is he measuring?. loss, accuracy, episode survived?
whichtom: @bigie the muzero paper says K=5 for their results
Mariosavitch: bless you
bigie: ah thanks @whichtom
bigie: they have a prioritized replay buffer. that one's way better than normal experience replay
b2kemann: u need a burger
malmeani: now the value of my sub just went up
numinousloop: they were convinced they knew what the problem with your code was
Mariosavitch: you should train the inputs to your inputs
bigie: i hate that it's only possible in python &amp; slow. i want an ML/DL framework in C++
malmeani: we love you
smurfd0: from the paper, "Predictions are made at each time-stept, for each ofk= 1...Ksteps" for the one asking about what K was
gaocaandra: yo what happened with the protein fold
nsielicki: nsielicki subscribed at Tier 1. 
gaocaandra: did it ever work
b2kemann: swift is the answer @bigie
gaocaandra: where us the rant
gaocaandra: ?
nsielicki: longtime watcher, first time subscribing. I literally linked timeiskey to the stream because he knows a lot about this. You're convinced he was wrong, I'm fairly certain he knew what he was talking about.
pwnbase: @bigie the python is just an api, all the heavy lifting is done in c++
nsielicki: subscribed literally just to tell you to fuck yourself.
gaocaandra: beggining of stream
gaocaandra: ?
eldac_kno: lol
bigie: i know google's hardly working on that but i hope it fails because i hate tensorflow and swift @b2kemann
Mariosavitch: @nsielicki lol
eeXecute: alt account LUL
bigie: @pwnbase yes but python itself is slow
b2kemann: @bigie why the hate
plazmacsgo: @nsielicki ????????
PeinlicherAffe: xD
bigie: @b2kemann tensorflow is just badly written &amp; breaks their API with each release. I looked swift up. didn't really like it
b2kemann: you can say fuck you george, but yuou have to be a subscriber
routerkicker: i don't know much about this. what's wrong with the proposal of fitting every episode?
bigie: that's a pretty expensive fuck you LUL
eldac_kno: goverment in the us is basically just a corporation
nsielicki: yeah all four dollars
numinousloop: have you done any poker AI work?
bigie: 4.99. congrats
gaocaandra: do third world countries get discounts on subs?
eldac_kno: I would call Poker Ai Wittgenstein
Ne0Zer0: def feel the frustration with ml
bigie: i pay more because i'm in germany and pay 4.99 euros instead of 4.99 dollars. that's also price discrimination
gaocaandra: have you looked at wolfram lang?
eldac_kno: that's the price for not being a part of the US boi
bigie: is any RL algorithm stable though ?
Penguino138: He learned so well :')
zyrax222: i have no idea what you're doing but im enjoying it
b2kemann: @bigie but you think we should do it in a lowlevel language? sound like a bad solution, maybe haskell or another pure functional language is the solution
gaocaandra: i pay more because the government puts a 30% tax on usd bus
Ne0Zer0: AngelThump
PhosphoricAcid: freedom
cankoloz: free
SHAVEYY_: :( noooooo not the non subs
CoachMeech: TriHard NEVER SUBBED TriHard NEVER DONATED TriHard ADBLOCK ON TriHard STOLEN LAPTOP TriHard NEIGHBORS WIFI TriHard FREE ENTERTAINMENT TriHard
mangoxavier: oh hey
Penguino138: Are you reanabling sub only tomorrow?
plazmacsgo: what so special about muzero?
bigie: @b2kemann wtf my msg got flagged or smth
bigie: @b2kemann not low level necessarily. I'd learn swift if e.g. pytorch did it. using libtorch in C++ is near impossible but could be improved
MrGwopz: How did you jailbreak the ps3? @georgehotz
eldac_kno: what do you think about Yandex self driving car and Yandex in general?
abedbawsxx: TOS
mexeroserisback: @bigie use julia
RaulYTpro: Is it worth it to work for someone ? :c I'm a software engineer @georgehotz
Joooooooooonas: Why dont you turn you table a bit so we have a nice background view @georgehotz :D
whichtom: tf is 60.7% cpp though
calcmath: how is biphasic sleep?
zyrax222: are you in a hotel or something?
saixj: i respect your chat can you keep it open for non subscribers
b2kemann: geo guru session
tex01: hello
abedbawsxx: the loop
CoachMeech: what color keys we using on the mechanical?
cankoloz: i can see myself PogChamp
plazmacsgo: the infinite effect
gaocaandra: when is the cult starting?
fabioitout: For me it is a fair price for the thing he is doing, his opinion we can disagree
konradmad: fastest way to learn programming is to actually program all the time?
whichtom: I imagine if anyone would push for langs other than python for NN itd be for autonomous driving
mangoxavier: how do you prevent models of manipulation being built about you?
bigie: @mexeroserisback if it goes mainstream &amp; its good i will. right now there's nothing better than pytorch
MrGwopz: how did you jailbreak the ps3? @georgehotz
pwnbase: red solo cups for the party
Bootstraps: georgehotz how many hours do you sleep per night usuallky?
SHAVEYY_: Hi mom PogChamp
WilliamMu6: hello
nsielicki: thanks for the stream today, interesting stuff.
plazmacsgo: what so special about muzero?
b2kemann: can we do it in haskell??
mexeroserisback: @bigie true that... I played around with FluxML in Julia and it works fine but is still in its early stages
numinousloop: when will v2 be??
ROXASBrandon: ROXASBrandon subscribed at Tier 1. 
skut1212: heyy What resources would you recommend to programmers on learning AI?
funwayz: finally pytorch
lolix_idontknow: when a collaboration with others hackers to shut down the Chinese system?
gaocaandra: whats the end goal?
bigie: nice and i will clone it and pretend i wrote it
calcmath: what wil try after cartpole?
Bootstraps: wtf is mu_0
eldac_kno: thoughts on yandex self driving cars?
victorzarzu: pytorch vs tf
mariopedreiro: !uptime
numinousloop: your screen is a strange loop
MrGwopz: @georgehotz plz explain the parts that you can on how you jailbroke the ps3 im very curious
bigie: @mexeroserisback money &amp; research should be behind it to go mainstream. or at least one of them heavily.
PhosphoricAcid: LUL
santi_264: kim jong un is dead?
Ne0Zer0: LUL
Ne0Zer0: lmao
zyrax222: sellout
Ne0Zer0: o/
fabioitout: thanks for the iphone jailbreak, lot of fun
bigie: no
calcmath: what is the parachute paper?
whichtom: thanks for the stream geo
plazmacsgo: what concepts would I miss if I dont go to colledge?
Penguino138: Peace! Thanks for the great streams!
Bootstraps: george whats your insta
SparksCx: you put it in submode...
Joooooooooonas: When can we expect you ?
mangoxavier: Thanks George.
bigie: talk a bit about apple and google's covid 19 tracing shit before heading out
murkythunder: selling out for$2.5 cut from twitch
SHAVEYY_: Do you have kim jong un's phone number?
eldac_kno: art of programming worth reading today?
zyrax222: selling out for $5 LUL
victorzarzu: pytorch vs tensorflow
b2kemann: love your streams!:)
SparksCx: 4Head
cankoloz: Dictatorship is the best! monkaS
whichtom: brrr
numinousloop: thanks for the stream, man! love the live coding AI papers &lt;3
zyrax222: 4Head
SHAVEYY_: pay pigging the government?
mangoxavier: Taxation without representation is what we're in right now
gaocaandra: inflation?
whichtom: money is pretty arbitrary
info303: thats how inflation happens lol
saixj: but that causes inflation
gaocaandra: money machine goes brrrr
MrGwopz: fair enough if you cant talk about how you jailbroke the ps3 but thats a very interesting topic in my opinion @georgehotz
santi_264: doesnt printing a lot generate inflation
mangoxavier: State tax taxes your fed tax refund. that's double taxed
ROXASBrandon: LUL
saixj: money is a social construct
info303: and you get 100 billion zimbabwean dollars for a loaf of bread
gaocaandra: boi
gaocaandra: come live in argentina
lambdaman0f: its to ensure demand for dollar currency
michaelkawwa: true
calcmath: not it also creates GDP growth
gaocaandra: see what printig and peronism is
konradmad: i dont pay taxes....im sneaky xD
plazmacsgo: are you planning to support more cars with openpilot?
zyrax222: so how do you see the national debt then?
hurzg: taxes kinda balance wealth..
eldac_kno: it's like chris tucker quote in rush hour, i am the president, i am the emperor, im the king
corpus_cule: are actually saying taxes are not needed? lol
murkythunder: ppl have said this printing doesn't cause inflation but i nvr understand :(
chemicalflash: but don't they have to sell bonds in order to print
eeXecute: Look at that loop FeelsGoodMan
Kalland: the difference is who you tax. if you print you tax people who have money. not who earn money.
saixj: we should just sell a state to canada or mexico to get rid of debt
bigie: so you're saying i should buy bitcoin?
MrGwopz: @georgehotz yo im out bro take care!
slevinxd: How we win against the system, sir George?
b2kemann: printing is inflation, by defenition
mangoxavier: Which bitcoins will stand the test of time?
lambdaman0f: look into Modern Money Theory
saixj: lol
whichtom: LUL
calcmath: its people bidding up pricess with extra money that causes inflation
sudoaptgetupgrade: it just works because most countries trade with USD. If countries start to pay with their own currency the USD will fall
pelegogrosso: @georgehotz can you be my teacher? hahaua
alexxxxxxxxxxxxxxx: @georgehotz sir have you ever taken an iq test?
b2kemann: by gold ;)
plazmacsgo: you should stream more!
fedexkinkos: U ever play poker
ocandoja: hi!
pepelaugh0: HeyGuys how you been geohot?
asheritis: hi George
DecayingSkullz: Hello George
TheSkapegoat: hi from Australia
Jehhred: Two in one day? What is this sorcery?
terrarosa: hey
masters8: Charmin ad, nice
JaeGeeTee: Whaaaaaatuuuuuuuuup
enlightenedgambino: hiiiiiiiiii
ad5k: Fzero
leonardssh22: hi man, how's going?
ck1956: not able to sleep ha
bugbrar: bonjour
thejakesummers: do this in COBOL
liams: Suuuuuuup
mutrx: yo
CaptCalifornia: gang shit
eldac_kno: wazzzup
cod4_lightning: what is muzero?
masters8: do it in coq
mattdougherty22: how was alpha go
atlas193: How long will it take someone who doesn’t know how to code to learn hacking?
luchesijoao: Hey George!! Wazzzupppppo
mik3xx: Why do you use a MAC? Just preference?
JerWasTaken: Hey Geohot. Are you able to help me calculating Quaternion to Euler angles in C# :D I have been trying for the last 10 hours or so but I can't figure it out
DecayingSkullz: UNIX like OS
bugbrar: ^^^^yes, why mac?
moizai: George ! is comma still operating right now?
singularitytoatea: My guy geo very hots is backkkk!!!!
eldac_kno: cringe bro
Infinitelym: what we doin today
singularitytoatea: lmao higher quiality
singularitytoatea: lmao
masters8: i like it
optimizely: what are we working on tonigh?
keith282: This is my last day as a sub FeelsBadMan
moizai: is comma still operating my dude?
mattdougherty22: how was alpha go
fedexkinkos: take some theanine bruh
tremendomendez: monkaS
TheSkapegoat: TheSkapegoat subscribed with Twitch Prime. 
joseanavarrom: Are you sweating?
ited01: kk hello
masters8: lol
masters8: quick
eldac_kno: is art of programming worth reading/studying through
masters8: gotta get my low qual memes in
aar0npham: aar0npham subscribed at Tier 1. They've subscribed for 2 months! how was alphaZero?
Mint2bSpiced: click the cog in the right hand corner
ited01: just increase de reedeem price
Mint2bSpiced: its under chat settings
erichtp: rip thx low qual plebs
thodeannn: no more free msg :(
axlebear: Free the plebs
Santiago_LHC: We are back!
alexyzdev: sup team
Penguino138: Holy shit two streams in 1 day
optimizely: send link to the article
cromed56: !uptime
ited01: increase the price
fkndean: https://www.nvidia.com/en-us/geforce/guides/nvidia-rtx-voice-setup-guide/ If you have rtx card its pretty good at eliminating background noise :)
Santiago_LHC: Plebs are free
VandaleBot: yo
Detonat3D: !uptime
Mig1939: George what do you think of YOLO?
aayaanamir: hello from Pakistan
Penguino138: Release the plebs :p
ivche1337: What's MuZero?
egb3: hello
tremendomendez: :D
Shelledlizard4: freedom
mattdougherty22: how was the movie?
Detonat3D: hi
alexyzdev: Heyyy he did it
achamorro008: ddd
plazmacsgo: @ivche1337 an RL algo
Penguino138: Welcome back George we missed your insightful and ASMR filled streams
Santiago_LHC: I can help mod.
masters8: yay
achamorro008: geooohotz
optimizely: send link to the article
mutrx: wait didn't you just ask how to
csal90: ayeee
tremendomendez: no mods?
thodeannn: he did not )
ivche1337: @plazmacsgo tnx
K_I_N_N_Y_B_O_T: that protein ever fold?
masters8: meme away folks
alexyzdev: lmfao
mutrx: @georgehotz you just asked how to turn it off?
thodeannn: goerge is cringe bye
pwnbase: its /unmod
Mint2bSpiced: you just type "/subscribersoff" as a mod
aar0npham: https://help.twitch.tv/s/article/channel-points-guide?language=en_US
Penguino138: Looks like the only mod in here is Mutrx? You can click the People button next to "stream chat" to view them
eldac_kno: it's the United States of George Hotz
joseanavarrom: Twitch can be complicated
gigafact: wow we are back
Jehhred: https://help.twitch.tv/s/article/channel-points-guide?language=en_US Scroll down to the Streamer Section - it's Manage Rewards
joseanavarrom: For how long do you usually sleep?
Santiago_LHC: I can mod. You could also use https://nightbot.tv/
Andremm2: You know the UI is bad when even a known hacker can't use it LUL
Penguino138: Georgemojis
Penguino138: You earn channel points just by watching the stream
keith282: You earn channel points by watching the stream
sophisticatedgaming291a11: LUL
gigafact: it did not even finish uploading to youtube should I just attach this stream as well to just one upload George?
ad5k: have you seen wolfram's new theory of everything
saff__: give me points
pwnbase: make it 1337 points
gigafact: OK
Mint2bSpiced: you earn channel points by watching hours of your stream
joseanavarrom: For how long do you usually sleep?
Penguino138: Is it still subs only?
aar0npham: looks like it now
Penguino138: Welcome productive and positive members of the stream... Lets program
nashesvobodnoye: nashesvobodnoye subscribed with Twitch Prime. They've subscribed for 2 months! &lt;3 is heart
eldac_kno: can we ban sleep questions
TheSkapegoat: Hey GeoHot, which company do you think is an underrated competitor in the autonomous vehicles market?
Lizardan: Subs only PogChamp .. hello plebs HeyGuys
Penguino138: Unless george says so, questions should be related to the stream topic
microx0ft: are you only using python for this?
gigafact: people can "lash out" on youtube if they want. there is quite a few strange people on youtube but majority of people really love your streams George
grey_street: what's your idea of optimal sleep Kappa
aar0npham: facts
Penguino138: @georgehotz did you make any progress since last the stream?
bugbrar: I am not a subscriber, but I would like to able to learn by asking questions, so I would appreciate it if people stopped asking unrelated questions/spamming. Please.
Santiago_LHC: keyword: prediction
saff__: don't do it
saff__: end of
xeeton: what is the real-world length of each time step?
Killeraing: wow you were coding all night?
powerofpickle: You have gone on tangents in past streams so I guess people are adapting
jasondesante: love you dude
Penguino138: Yeah some of the nature hacking streams had great thought provoking convos too
eldac_kno: do you think gpt 2 is overrated
jontowtruck: how are you still trying to implement this lol it probably has the most descriptive/informative appendix to dissect
devm0d: What are we hacking on tonight?
gigafact: I am currently working on a project and it's really wearing me out. It's not healthy at all but the result is going to be amazing. It's all worth-it in the end.
TheSkapegoat: Can AlphaZero be applied to truly everything or do you think its inherent to strategy based activity?
xeeton: @georgehotz thx for the answer
devm0d: Thank you
keith282: @gigafact Are you okay bro?
joseanavarrom: What are you planning to use it on?
TheSkapegoat: Do you think AlphaZero is a leap in AI or simply a noticed step?
Santiago_LHC: AlphaZero knew the rules to the games, right?
gigafact: Have been sleeping only a few hours a day. I have not been so tired in all my life.
alfyfav: So why don't you go to sleep @gigafact ?
Jehhred: @gigafact Maybe you shouldn't be on twitch then and instead doing the project?
Penguino138: @gigafact Try to get some sleep and it might help overcome the project obstacles you're facing :)
Lentaij: Anyone have a link to the paper?
eldac_kno: just google it bro
ak0ya_: https://arxiv.org/pdf/1911.08265.pdf
gigafact: The problem is that even when I am going to sleep I am still thinking about the project. I can't seep for very long... Don't know if you had that feeling...
hurzg: I wonder if a prediction network is really necessary, if the world is based on relative simple physics... however in this way its a nice and general approach.
grey_street: twitch prime can chat
axlebear: I'm twitch prime
alfyfav: @gigafact maybe I could help you with your project. Follow me on twitter. Username: localhost666
devm0d: I’m also twitch prime
tremendomendez: :)
Penguino138: Lay down the law george
bugbrar: Thank you
DeeboMC: I was just in the middle of subscribing lol
gigafact: is someone having a party there?
aar0npham: n training steps
eldac_kno: yes, chad party goers
aar0npham: in terms of hyperparameters
Penguino138: Is there a party outside?
Penguino138: hahahahaha
joseanavarrom: Loud party
isyraq1: @georgehotz how would you recommend someone go about learning programming? Books? Online courses?
xraichuux: why do you use mac ?
tremendomendez: monkaS
Mint2bSpiced: thoughts on RTX voice AI
ad5k: immediately how to program questions loool
TheSkapegoat: Do you think quantum computing is what will truly accelerate AI or is it mostly figuring out the software side of things such as what you are learning from this paper?
Mint2bSpiced: for the background noise reduction
DeeboMC: 7 in nyc lol
synthetic11000: 7pm cheer
calcmath: is he starting from scratch?
eldac_kno: yes
DeeboMC: He said 8
alfyfav: @isyraq1 he have sayed that before. Just sit down and think about what you want to do, and do it investigating and reading, just like he's doing it rn
Rashad242: Rashad242 subscribed at Tier 1. They've subscribed for 2 months! I'm just here to c greatness
hurzg: quantum computers are pretty useless right now I guess @TheSkapegoat googles QC can only generate a certain type of random distribution
Santiago_LHC: Interesting clip from a recent Lex Friedman interview with David Silver (one of the authors of the MuZero paper) on AlphaZero and self-play: https://www.youtube.com/watch?v=e77NkSjnyH4
axlebear: pytorch DansGame
eldac_kno: wtf are these questions
Mig1939: What exactly are you trying to do with MuZero on this stream?
raisedbyphantom: how long is he streaming
optimizely: can you make terminal bigger
DeeboMC: Ima go ahead and subscribe anyway homie.. hold on a minute
programmer42: which python's vim package are you using ?
lebop: WHAT IS MUZERO
raisedbyphantom: !stream
Santiago_LHC: MuZero is the latest ai from DeepMind
eldac_kno: wtf is this chat
calcmath: muzero is reinforcement learning algorithm
aar0npham: why do they use elu instead of leakyReLU?
alfyfav: @lebop why don't you google it?
CensoredAlex: what are we doing?
eldac_kno: writing muzero
ak0ya_: muzero paper reading
tremendomendez: :)
Penguino138: Muzero is an AI model that was used in AlphaGo for those wondering
optimizely: can you make terminal bigger
eldac_kno: petaaah is about to get banned
CensoredAlex: nice
asselbergs: Good evening George. Fun coding time again.
Penguino138: A complicated AI model that is used for predictions if I am right
josalt: Hey everyone
dalvasorsali: dalvasorsali subscribed with Twitch Prime. They've subscribed for 2 months! 
axlebear: LUL
Jake_Miller_: LUL
Junki4: HeyGuys
JonathanH8686: JonathanH8686 subscribed with Twitch Prime. 
eeXecute: LUL
Jake_Miller_: hi josalt
asselbergs: Thanks Penguino138
Penguino138: Let's get some wholesome hype
calcmath: He is using it to balance a stick first
eldac_kno: dat $tick
CensoredAlex: PogChamp40
Penguino138: Yeah basically doing physics based AI prediction
williami000: Hype Train
JdPaulBlart: elu activation function OP
williami000: skunkp1Nine skunkp1Nine
ToxicVulpes: @georgehotz can u use AI to break bitcoin private keys?
mrmusicmaine: so we’re using muzero to solve the classic cartpole, what’s the vibe here? Just learning muzero?
Bootstraps: did george shower?
JdPaulBlart: using muzero to find coronavirus vaccine
JdPaulBlart: duhhh
greaserthegreat: greaserthegreat subscribed with Twitch Prime. 
logicssoldier: logicssoldier subscribed at Tier 1. They've subscribed for 4 months! luv ur face
eldac_kno: just as always, george is gonna play with some new model/algorithm and that's about it
Bootstraps: @georgehotz can you give a brief summary about what we are trying to accomplish?
hurzg: the idea is: start of with a simple problem to learn and understand the method
CensoredAlex: PotgChamp
greaserthegreat: Connected my amazon account just for this
Penguino138: Welcome new subscribers
CensoredAlex: @greaserthegreat SeemsGood
williami000: congratz on subbing
calcmath: increased font size of code would be helpful
greaserthegreat: Thanks yall
Santiago_LHC: "MuZero learns a model that, when applied iteratively, predicts the quantities most directly relevant to planning: the reward, the action-selection policy, and the value function. When evaluated on 57 different Atari games - the canonical video game environment for testing AI techniques, in which model-based planning approaches have historically struggled - our new algorithm achieved a new state of the art."
aar0npham: can u just load pretrained weight?
JdPaulBlart: no thats cheating
calcmath: i think the point is to learn how the algorithm that creates the weights works
Bootstraps: george what are you trying to accomplish?
memogainz: memogainz subscribed at Tier 1. 
mrmusicmaine: thanks @santiago_lhc
JdPaulBlart: solving coronavirus with muzero
Jehhred: @Bootstraps World Domination, obviously
mrmusicmaine: @calcmath Yee same
PristineBanana: MercyWing1 &lt;3 MercyWing2
Abnico: herro georgey looking cute this evening HeyGuys
eldac_kno: thoughts on 3b1b youtube channel sorry if offtopic
CensoredAlex: @Bootstraps Getting the optimal quantity of lysol in a vaccine Kappa
Bootstraps: inject disinfectant
neilsweb: Thank you soooo much for donating $1 billion worth of your equity in Square to fund COVID-19 relief around the world. Donating roughly 28 percent of your net worth is remarkable.. thank you!!!
mrmusicmaine: 3b1b is wonderful
Penguino138: keep the chat on topic
aar0npham: i think its time to get back to sub mode
ak0ya_: :(
rickoftheroot: monkaS
CensoredAlex: true, sorry.
tornpaperyoyos: @penguino138 no
mrmusicmaine: fair
Santiago_LHC: I can mod the off-topic nonsense
jmp0ut: hi all what's working on?
Killeraing: you could change the chat few to ban politics
Bootstraps: LUL
rickoftheroot: LUL
axlebear: LUL
mashafique: LUL
Killeraing: rules*
TheBlackzillian: what is muzero?
memogainz: Can you quickly explain what's the purpose of Jupyter in your workflow?
Major_Spicy: @georgehotz what is your goal with this program u are making?
Abnico: can i be a mod im also gay
jmp0ut: @geohotz you see the kernel chocolate_milk gamozo has been working on for fuzzing, literally 0days all known hardware and software, 1 shot
JesseSkinner: sub chat includes twitch subscribers
Mig1939: 0.0001% of chat understands anything you do here.
joseanavarrom: I think submode does include twitch prime people
Penguino138: @TheBlackzillian It's a complex AI prediction architecture used in things like AlphaGo
leonardssh22: mornin' geo
SHREKonVHS: umm george are u well
JesseSkinner: sub chat includes twitch prime subscribers, i mean
Gree_OW: @georgehotz Did those proteins ever fold?
Santiago_LHC: Thank you, I'll instate order
Santiago_LHC: and fear
jontowtruck: please for the love of god use the vim keymaps
rickoftheroot: monkaW
iKanak_: iKanak_ subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 2 month streak! 
Penguino138: @Santiago_LHC Congrats on the mod upgrade!
neilsweb: because when u suck at coding you can test your code blocks easily and often.
jcernuda95: @memogainz the code seems to be controlling a openai gym environment that is a balancing pole on a wheel by using a new ai model released recently
Abnico: what is he using muzero for?
eldac_kno: nothing for now
Abnico: i wanted a chat observer but muzero was to hard for me
Penguino138: @Abnico For a physics simulation to balance a stick sort of thing
jmp0ut: also faster computation
hurzg: balancing a stick
Penguino138: ALEXXXXXX
Bootstraps: HI ALEX
leonardssh22: hi alex
mashafique: HI Alex
aar0npham: hi alex
c0sm3s: Hi
rrittenhouse: sup?
rickoftheroot: HI
axlebear: HeyGuys
Abnico: oh ok
8FollowSonik: HeyGuys
Incurs0: HeyGuys
grey_street: HeyGuys
neilsweb: nice chair
rickoftheroot: HeyGuys
Mig1939: hey alex!
joseanavarrom: HELLOOO
eldac_kno: lol
Santiago_LHC: Hello Alex
CensoredAlex: hey
aar0npham: lol
Killeraing: sup
Penguino138: It's tough dealing with friends who freak out about it
Bootstraps: alex are you coming over tonight?
SHREKonVHS: george are u being friend zoned
p4ri: LOL
Bootstraps: bring steak!!
p4ri: who is talking too
p4ri: he*
rrittenhouse: LOL
rickoftheroot: KonCha
Abnico: george, ur wifes boyfriend makes good steaks
SHREKonVHS: f r i e n d z o n e s
Junki4: the sound of ur HHKB is so relaxing
r00tkey: You are still up!
Drifter0o: georgeeee!!! nice to see you
aar0npham: bans coming up
Bootstraps: george do you like your steak well done?
ralaxe: what are you doing exactly i don't understand
bugbrar: That was very sweet
eldac_kno: do you like 3b1b videos?
diazz_15: Smooth fckn operator
Penguino138: Alex and George = goals
Newlax: terrible things
Santiago_LHC: Behave guys, Alex will be in chat
Newlax: @programmer42 https://github.com/geohot/configuration
PristineBanana: now I want steaks
neilsweb: Can Alex write python?
eldac_kno: english only, amigo
Gree_OW: @georgehotz Did anything ever come of the protein folding? I really enjoyed those streams
Santiago_LHC: English only
cod4_lightning: can you show your mac dotfiles?
dalvasorsali: I have a frozen steak but no idea how to cook it from frozen...
Abnico: protein is still trying to fold u can check the status on proteinbank
neilsweb: first time i see him reading slowly. usually he just skips overr everything.
calcmath: I think main goal of MCTS is to balance exploration and exploitation
sajugabru: lmao
BumD197: hi, is there a target application he's trying to implement or just exploring the muzero?
SHREKonVHS: imagine if newton said it doesnt work before writing principia
JdPaulBlart: using muzero to solve coronavirus
Penguino138: @BumD197 Right now we're just exploring and understanding through this paper
SHREKonVHS: sad gamer moment
jmp0ut: one pagefile
aar0npham: is it a subspace then?
Newlax: @cod4_lightning https://github.com/geohot/configuration
calcmath: i think time is still discrete
eldac_kno: bigbrain moment
gigafact: I wish some smart people like Lex would join the stream and help.
eDONze: DuduSoloTop subscribed with Twitch Prime. 
neilsweb: nobody liked my joke, where i confused him for Jack Dorsey :-(
ad5k: why is it a continuous space?
Major_Spicy: @Penguino138 what is he trying to exactly? I just joined.
jmp0ut: ad5k because a protein can continuously fold
jmp0ut: until it reaches original
Drifter0o: George you ever used the app magnet?
DeeboMC: Subscription incoming
Penguino138: We're learning how Muzero, a complex AI Predictive network works, and applying it to a relatively simple physics simulation to keep a stick balanced
Penguino138: @Major_Spicy
Major_Spicy: Thanks a lot dude framedOh
ad5k: isn't the context chess, atari etc where position is discrete
DeeboMC: deebomc subscribed at Tier 3. 
calcmath: the neural network can handle continous states
DeeboMC: Party time
ooMariaoo: caught the stream :)
Bootstraps: are we watching alpha go on stream together late today?
greaserthegreat: Could it be possible that continous is just the theoretic and is implemented with a finite number of discrete states. The delta in time could be small enough to provide a close enough answer to the continious model?
SHREKonVHS: bruh the ice chewing has returned
eldac_kno: chewing ice hurts bro
hurzg: isnt it quantized by the time steps?
sajugabru: they start at initial state and deterministically step through the space
Mint2bSpiced: @Penguino138 is this like the AI used in SteadyCams and drones ?
SHREKonVHS: no
Penguino138: @Mint2bSpiced I'm not sure, it maybe be more applicable to games but I don't believe so
Abnico: steady cam does background stitching
achamorro008: geooohotz
Bootstraps: POGGERS
Bootstraps: psuedo code
dalvasorsali: Isn't this similar to q learning/sarsa?
doganigooo2: yo helloo what's going on here
Major_Spicy: Fancy framedPOG
eldac_kno: btw in russian it's pronounced geohot -g-like in garden
calcmath: i believe the difference is a model of the environment is learnt
BumD197: the thing is if only given rules makes this AI algorithm somewhat find the problem and solves it, pretty amazing, but i imagine it couldn't be easy as it sounds
doganigooo2: @BumD197 probably it is not
Penguino138: @doganigooo2 Learning about Muzero, and complex predictive AI network
abhi1o1: i went to sleep go up and he is still streaming
bfpixels: @georgehotz im sub VIM vs VS Code?
calcmath: you need balance exploration and exploitation
DeeboMC: That’s nice pseudo code
Mint2bSpiced: @Abnico I mean the AI for the stepper motors inside the handles of the Steadicam, not the video editing software stabization
eldac_kno: ide question is the new kb question
Bootstraps: this pseudo code looks better than my real code
Bootstraps: wtf
sajugabru: what is the purpose of the tree search?
eldac_kno: that's what pseudo code is for
calcmath: UCB is the principled way of doing it, with theoretical backing, but ya simple would stilll work
diazz_15: @bootstraps I was thinking the same shit lol
DeeboMC: Same lol
axlebear: What is a leaf node again?
Penguino138: @sajugabru typically the tree is used to path out the predictions for future possibilities and moves in a game
Abnico: @Mint2bSpiced okie yeah
eldac_kno: leaf node is final node
calcmath: leaf node is end of game
DecayingSkullz: It's a node with no child
ad5k: leaf node is an end state?
1boi: really
gigafact: at least they have comments in the code
puffgrape: r we folding protein or we past that?
sajugabru: so if the functions that represent internal state stop changing then you've reached a leaf node?
ak0ya_: folding is done
eldac_kno: we are past that
puffgrape: ahhh ok
ak0ya_: this is a new project
eldac_kno: protein question = ban
hurzg: is a node itself simply a "move" in the game?
puffgrape: shit didnt know lol
dalvasorsali: @georgehotz Isn't this similar to q learning/sarsa?
guinness84: have you explore counterfactual regret minimizartion
guinness84: explored*
calcmath: only way to see reward if its realised only at the end of the game
Penguino138: @hurzg pretty much yes, it is a step, and typically has a weight attached to describe the probability/prediction
guinness84: o cool
kevin21071: what so you have to know the max moves for each game?
hurzg: @Penguino138 thanks
posixninja: if this has nothing to do with protein folding I'm lost
greaserthegreat: I agree it seems like it can't go to a true leaf node? maybe an arbitrary point is chosen and a score is calcualted?
greaserthegreat: new to this technique so just throwing out ideas
ad5k: is reward probabilistic in intermediate time steps?
socialnotsocial: what do you think about the general stagnation argument presented by Peter Thiel, Tyler Cowen and others?
calcmath: if game has no intermediate rewards or reward shaping, you sort of have to do it till end right?
CaptCalifornia: ICE CRUNCH monkaS
Penguino138: @posixninja we are past folding, moving on to AI prediction applied to physics
sajugabru: why isn't there intermediate reward shaping?
calcmath: in chess you only know if won or lost at the end
posixninja: molcular dynamics?
calcmath: not applicable for stick balancing
calcmath: but algorithm is general
ad5k: "MuZero also extends AlphaZero to a broader set of environments including single agent domains and non-zero rewards at intermediate time-steps."
gigafact: George would you work at Deep Mind?
raisedbyphantom: how long has he been streamin ?
DeeboMC: Like 30 min
posixninja: can someone point me to the whitepaper?
ak0ya_: @posixninja folding project is over
janpoonthong: How did you learn python by coures? or Turtuoirl from Youtube?
PristineBanana: https://arxiv.org/abs/1911.08265 @posixninja
ak0ya_: https://arxiv.org/abs/1911.08265
DeeboMC: 45 maybe
Penguino138: Yeah chatt has approved a lot so far
JdPaulBlart: its because im here
DeeboMC: No it’s me bro
JdPaulBlart: i increase the average intelligence of the chat
DeeboMC: Oh yea ur right
raisedbyphantom: def
sajugabru: @calcmath so it seems the main contribution of the paper is how they can make a model of games that don't currently have perfect simulators?
kisspapa: you ever have any fun with the open source voice builder tool google released
calcmath: yeah you simultaneously learn a model for the environment, as recurrent neural net
JesseSkinner: hm could it be applied to a game like .. the stock market?
DeeboMC: That’s scary stuff
JdPaulBlart: this light mode is hurting my eyes DansGane
JdPaulBlart: DansGame
sajugabru: then which tree search algo you use is irrelevant to the goal of this research right
posixninja: I'm still learning the personalities of amino acids :-(
calcmath: yeas so long as it balances exploration an dexploitation
janpoonthong: How did you learn python by coures? or Turtuoirl from Youtube?
calcmath: he can just implement an epsilon-greedy version instead of UCB version, but it will be less efficient
Nussinov: im trying to learn coding for 2 months now and I feel utterly retarded
dalvasorsali: @janpoonthong you learn by doing
Penguino138: @janpoonthong you learn to code through tutorials and just doing it
grizvok: 2 months is nothing
DeeboMC: Fred Baptise’s Python Deep Dive series on udemy
diazz_15: 2 months is legit nothing
gigafact: maybe this will help? https://medium.com/applied-data-science/how-to-build-your-own-muzero-in-python-f77d5718061a
diazz_15: Try 10 years and still not knowing wtf is going on lol
MorningLightGamer: if you google for "muzero-general" you can find a github repo that can maybe be helpful
nick_larsen: I gave 30 min talk on this in the live coders conf a couple weeks ago
nick_larsen: MCTS not MuZero
tragic_tf_up: what did you do when you were younger to motivate yourself?
DecayingSkullz: ban incoming
Nussinov: wait 2 months is nothing? that makes me feel better I suppose
JesseSkinner: @Nussinov yeah thats like, learning to read for 2 months ...
nick_larsen: What the question right now?
Santiago_LHC: No keyboard talk. Chat 101
Nussinov: @JesseSkinner oh LUL i thought i would just kinda pick it up quickly since a lot of people seem to know it
janpoonthong: What's your IDE?
hsydf92: what is being coded
Penguino138: @Nussinov You will likely have a long journey with programming. Full of failures and successes. You have to enjoy it for sure
JesseSkinner: @Nussinov some people have been doing it since they were kids.. its a new way of thinking for many who pick it up later in life
janpoonthong: from musro.model import musi.model
Nussinov: @JesseSkinner damn that is a huge advantage LUL im 20 now so its not so bad
janpoonthong: I think
JesseSkinner: @Nussinov and the biggest thing is getting used to things being broken 99% of the time. when it's working, you're done!
Penguino138: Exactly, and programming will give you serious power and freedom, so it is worth it in the end
bfpixels: my only advice is build things. It can be easy to stay in tutorial purgatory.
jsnfly: jsnfly subscribed with Twitch Prime. 
grizvok: @bfpixels agreed. a huge mistake people often fall for.
grekler3: @Nussinov im 2 months stuck just learning data management in flutter lul .. i mean i can just copy a yt vid, but i need to go back and re learn dart and sql fundamentals, i need to fully get the concepts
Nussinov: @bfpixels luckily I have a degree in biochemistry so the applications are abundant in bioinformatics-related areas
Penguino138: @Nussinov Yes always go for practical programming examples, and slowly crawl your way through, you will learn a ton!
janpoonthong: @bfpixels So you mean tutorial are ehh
ivche1337: eyy sub only is gone lesgoo
ak0ya_: chat became an emotional support group for Nussinov :)
Penguino138: @ak0ya_ better that than the toxicity that caused sub only mode earlier today
socialnotsocial: @georgehotz what do you think about the general stagnation argument presented by Peter Thiel, Tyler Cowen and others?
Nussinov: @ak0ya_ hell yes! im feeling much better lol
echobrother: what's the IDE
hsydf92: vim
hsydf92: @echobrother vim and jupyter notebook
ak0ya_: dev env
bfpixels: @echobrother it's not an IDE he's using a text editor called vim.
Santiago_LHC: No stupid offtopic questions
Bloodswordz88: We fold fam
hsydf92: @santiago_lhc no questions are stupid
Penguino138: Someday ill be lucky enough to join Santiago and keep the chat clean dotsHappy
BumD197: does George have github page?
DeeboMC: Ban
ivche1337: there are no stupid questions, only stupid answers
Santiago_LHC: That a stupid question, but I'll allow it, because it's not entirely off topic :P
quinquanonagintilliard: What's the stupid question again?
ivche1337: Kappa Kappa
BumD197: my question?
dontbeameme: Did make cold fusion yet?
DeeboMC: “Does he have a github”; yes
Santiago_LHC: @BumD197 https://github.com/geohot/
BumD197: i looked at info below there wasnt any info so i asked
HalluCinogen151: Whats up man
calcmath: yeah i dont know why there are 2 num steps
BumD197: better put it some info if you dont like that question being asked
hichm19956: what happend boss?
dontbeameme: Singularity in 3 2 1
calcmath: can you zoom the medium post a little
beefydangles: did you ever figure out that beer virus?
gabryelportuga: windows &gt; linux, and who disagree is right
Penguino138: @beefydangles no he moved on from it
hsydf92: zoom vim screen a little
iIyaRPV: stop writing cringe jokes and stupid questions in chat BlessRNG
MorningLightGamer: @georgehotz or mods, can I post a github link that may (or not) be useful?
beefydangles: @Penguino138 10 4
WhispyHerc: chat what is he working on?
gabryelportuga: @WhispyHerc muzero
WhispyHerc: yeah but what is he building @gabryelportuga
Penguino138: @All He is learning Muzero, a complex predictive AI network he is using to apply to a basic physics simulation
WhispyHerc: thanks @Penguino138
Santiago_LHC: @MorningLightGamer Yeah
DeeboMC: @Santiago_LHC pardon the off-topicness: Anyone know why the stream, on my laptop, is like 9-10 seconds behind the stream on my phone?
MorningLightGamer: https://github.com/werner-duvaud/muzero-general
LiveCustoms: Dude can you end corona already
LiveCustoms: I wanna go outside
WhispyHerc: so how is he implementing AI in a basic physics simulations? @Penguino138
Penguino138: @WhispyHerc you may see it soon, but we are using it to run a physics sim that balances a stick
WhispyHerc: how so an entity has to figure out how to balance a stick? @Penguino138
WhispyHerc: *oh
WhispyHerc: sounds interesting
hurzg: the thing is that the prediction network can learn all kinds of dependencies... also things, that can not be easily modelled via physics... its about learning the method itself
calcmath: why is choosing complete random actions correct here?
aaryan4: what are you working on?
gabryelportuga: he is pissed, aparently
Penguino138: @WhispyHerc Chat can correct me if i'm wrong, but I believe it uses the tree search to predict the best physical translation/action to take to keep the stick balanced
HalluCinogen151: He's hacking at corona
l1ght5p33d: everything is a tree search
l1ght5p33d: we want lookup tables
WhispyHerc: i see
eDONze: cocktop
gigafact: George did you see this https://github.com/koulanurag/muzero-pytorch been tested on CartPole-v1?
forkdb: Wow
posixninja: george just likes talking to himself and doesn't want to feel crazy
roletro: @georgehotz mcts is just a random search (with many samples) to a final state and relying on the statistics of the randomness to represent the overall picture of an action that prompted the search.
forkdb: Amazing....
forkdb: HelloGeorge
hichm19956: great,
posixninja: &lt;3
forkdb: How are you doing?
hurzg: as far as i understood, the algorithm has to decide in which direction it has to accalerate the stick at each time step. each step is a node. and the tree search finds the best movement for each node
Penguino138: Yeah what hurzg said
WhispyHerc: i wonder how many nodes there are in say a second
blueberryguac: ban me
WhispyHerc: if thats even how that works
WhispyHerc: or "step"
gigafact: Someone already used MuZero for your problem George https://github.com/koulanurag/muzero-pytorch
l1ght5p33d: lol @ cartpole
shoji22: !uptime
ET_515: ET_515 subscribed with Twitch Prime. 
Penguino138: Welcome ET
calcmath: need to revisit UCB to implement MCTS
calcmath: i think discounted root value is you find the empirical reward for some rollouts
roletro: you don't have to stick to the formalities, you hack hack together a mcts that doesnt have to set up anything fancy. you arent writing a paper.
DeeboMC: 👆🏽
realdigitalflow: !uptime
calcmath: you can just use epsilon greedy for exploration
forkdb: Hello George... big fan.. you are an inspiration to all, especially me... please give some insight on how to become good at learning and understanding and implementing things, how are you sooo good at programming especially
DecayingSkullz: just stop asking these questions please
calcmath: practice makes perfect
Protoxus: 1. don't be noob
forkdb: Am not asking for answers
DeeboMC: Wastes of 380
forkdb: I just want to understand his thought process
WhispyHerc: waste
DeeboMC: Lol
psychicsides: Like they are worth anything @deebomc
raisedbyphantom: @Protoxus what a brilliant advice
khilshot: which programming language do you use for programming interviews?
masters8: take my points
roletro: well the goal of mcts is to randomly search until it reaches a state where no further action is needed or possible.
erlsek: waste
Hamled: I think the previous message about practice is an accurate representation of his thinking
shoji22: PRACTICE MAKES PERFECT GUYS, THAT'S THE KEY
Protoxus: raisedbyphantom I was just paraphrasing George
greaserthegreat: @khilshot the one you are most comfortable with and supports OOO
Hamled: you won't get good at anything you don't practice
raisedbyphantom: @Protoxus I know, no pun intented ;)
Protoxus: raisedbyphantom :P
raisedbyphantom: :P
bfpixels: are headaches normal when researching something like what George is doing or do I need to see a doctor?
jax05_: just don't practice the wrong way heh
DeeboMC: What part of the head?
Jakob753951: All of it lol
BumD197: why does it matter @forkdb you can't understand people's thought process, and if you understand that you wouldn't ask
Penguino138: @bfpixels Your head can hurt from learning too much stuff, but make sure you're hydrating and have enough protein for ur brain
WhispyHerc: cerebrum
calcmath: its an exploration policy
DeeboMC: @bumd197 exactly
bfpixels: tension headaches especially trying to read what he's doing.
DeeboMC: Normal
quinquanonagintilliard: George, can you explain to me how nvidia rtx voice works? they're really good
Waldoqq: oh shit we back
lithiumx4900: lithiumx4900 subscribed at Tier 1. They've subscribed for 4 months! What happened to protein folding?
datswhatigot123: what a fine Saturday
Waldoqq: wuzgud my man
roletro: does muzero do the alphazero thing where some fraction of mcts branches are simulated till the end state and some are aborted by the value function?
shoji22: WKWKWK
young_beans_and_lean: Yaaay I’m in time for a geohot stream ... can’t wait to become a YouTube caption
singularitytoatea: Nn
ak0ya_: @roletro https://medium.com/applied-data-science/how-to-build-your-own-muzero-in-python-f77d5718061a here is a comparison explanation
forkdb: Thank you all for the expert advice
jdwillys: sup gangstar
posixninja: balance the stick... is the stick a carbon atom?
posixninja: or just a bond?
Penguino138: @posixninja It's a cart and a pole
fatpanda168: what's he doing chaterino
posixninja: that lost me
Penguino138: You should see in a minute if it compiles
fatpanda168: I 100% have shittier naming for variables
posixninja: are you just trolling?
pelegogrosso: dude, i'm not understanding nothing
DeeboMC: Socrates didn’t either, don’t worry
posixninja: I understand only 82%
GandalfTheGrayOfHell: !uptime
K177: :(
Penguino138: @posixninja It's called "CartPole-v1"
GandalfTheGrayOfHell: !time
posixninja: explain yourself then
fatpanda168: time to fold some protiens almost forgot
mr_stochastic: Just training on CPU?
K177: damn you going to speedrun it?
calcmath: if you implement MCTS like the paper you need to have a tree data structure as you expand leaf nodes dynamically
pelegogrosso: why not create a cheat game? is funny too
ak0ya_: implementing mu zero
GandalfTheGrayOfHell: @georgehotz did u finish the alpha go movie?
jasondesante: I hope he's vibin right now
Penguino138: PIZZA TIME
pelegogrosso: @posixninja: where start learn CS? you're looks be a pro.. or not?
Santiago_LHC: Pizza time!
pzuko7: should have a command for those asking whats he doing.
mashafique: Pizza time PogChamp
jasondesante: at the end of that documentary the dude quits playing go forever
ad5k: yeah nightbot could be handling these questions
jasondesante: the machine marries his mom and becomes his step dad
DeeboMC: Damn.. I gotta see that
Santiago_LHC: Mods can't install nightbot, saddly
WhispyHerc: what documentary
DeeboMC: 😂😭
pzuko7: ohh i see
Killeraing: pizza time
GandalfTheGrayOfHell: Just hack George 4Head
socialnotsocial: @georgehotz what do you think about the general stagnation argument presented by Peter Thiel, Tyler Cowen and others?
pelegogrosso: codecademy is good or books are better?
ak0ya_: it's no off-topic question chat today
GandalfTheGrayOfHell: Books are better
GandalfTheGrayOfHell: Any given day
RomeroCesar: that's a personal choice @pelegogrosso
DeeboMC: They’re complementary
Protoxus: @pelegogrosso Depends on what you're learning. For frameworks and languages, I'd say online documentation is better since it's updated. For general concepts, books are better.
GandalfTheGrayOfHell: Develop a habit of reading to partially become as smart as George
Protoxus: - My opinion, at least
RomeroCesar: I prefer books, but many prefer lectures, other prefer hacking. Knowing how you learn best is important
DeeboMC: You can’t become smarter necessarily.. knowledgeable and skillful, yes
bcihacker: what happened to #hack-covid?
GandalfTheGrayOfHell: You know how George reads stuff from papers and directly implements it , u need a hell lot of reading practice for it
WhispyHerc: you can become smarter but not more intelligent
lolzmaster99: What game os he applying muzero to?
ak0ya_: @bcihacker its over
lolzmaster99: Is there a new paper out?
Penguino138: @lolzmaster99 CartPole-v0
DeeboMC: Eh, semantics
ak0ya_: it's a november paper
bcihacker: @ak0ya_ oh. lost touch a bit.
DeeboMC: I use “smart” interchangeably with “intelligent”; am I wrong?
lolzmaster99: Yeah implementing papers is tough working on one rn
pelegogrosso: some good forum to learn languages?
WhispyHerc: i like to use "smart" as level of knowledge possesed and "intelligence" for intelligence
Santiago_LHC: Sigh
bcihacker: @lolzmaster99 wdym implementing papers? Just came on chat, so lost context a bit lol
DeeboMC: Fair enough
lolzmaster99: Taking a research paper in L and writing code to implement the algorithm described in it
lolzmaster99: ML*
in_just: Saw your podcast interview with Lex recently, not too shabby
DeeboMC: Minimally shabby
RomeroCesar: @pelegogrosso assuming you mean programming languages, I prefer reading a book instead of following some tutorial or lecture. Something like the "in a nutshell" series from oreilly are good if you already know at least one other language
calcmath: did he already implment make target function?
in_just: It's weird how he runs it out of a hotel room but I guess the point is to get the audio so doesn't really matter
lolzmaster99: geohot have you tried TF Agents?
RomeroCesar: was there a new one with lex?
DeeboMC: I think the locations vary
GandalfTheGrayOfHell: @georgehotz https://youtu.be/Ir7wCAQINqw comma.camera?
bcihacker: @lolzmaster99 hmm that sounds interesting. So does that mean that your algorithm needs to figure out the algorithm written about given an ML paper?
DeeboMC: No; he’s referring to the original I believe
in_just: Yeah the original
lolzmaster99: @bcihacker No, the paper proposes an algorithm and you implement it
in_just: lol
DeeboMC: Good choice
bcihacker: @lolzmaster99 any more info on it? article/paper/etc
Santiago_LHC: That's what he thinks
bcihacker: @lolzmaster99 sounds pretty interesting.
lolzmaster99: @bcihacker MuZero from DeepMind
calcmath: is make targets implemented already
thatguywithadik: i got too drunk and stopped coding for the night
dantehemerson: Nobody can explaint it lol
thatguywithadik: what's George doing
bcihacker: @lolzmaster99 oooh. i get it. pretty cool stuff!
Jaime_Medina: !uptime
Protoxus: @Jaime_Medina If you have BTTV you can do /uptime
Santiago_LHC: Manual uptime: 1 hour 45 minutes
calcmath: MCTS has to give you an estimate of the value function given previous version of the policy, then you iteratively improve
dantehemerson: Is this ML, DP or what is this?
dantehemerson: DL*
lolzmaster99: ML
calcmath: it gives you both
worraaa: RL, coding muzero to solve cartpole :)
dantehemerson: @lolzmaster99 is basic or advanced?
fatpanda168: anyone excited about nvidia announcement in may
lolzmaster99: Advanced
calcmath: I think it gives both, value function dicates policy so its more fundamental
pelegogrosso: is there some restrictions in this chat? because i'm new in the cs and maybe some questions mine can sounds idiot.
soldierheadsmite: new graphics?
gaocaandra: it's the first suggested implementation in deep dive into deep learning
GandalfTheGrayOfHell: Do t ask about key board
GandalfTheGrayOfHell: Don’t *
in_just: @pelegogrosso I think a certain level of knowledge is expected before typing...
worraaa: tab &gt; space ty
ak0ya_: @pelegogrosso it has to be related to the topic
DeeboMC: Keep to topic?
worraaa: Kappa
DeansGamingRoom: What's the current project?
UltraPh3onix: !uptime
worraaa: !uptime
DeeboMC: U see the title?
raisedbyphantom: he is been streaming for 12 hours lmao
Santiago_LHC: @pelegogrosso We are not taking off topic questions today. IF you have general programming questions, just google
eDONze: where is your piano
calcmath: vstack or hstack?
DeeboMC: Dude... thank you for finally saying google.. jeezus
dompatobbe: is george still doing the corona thing?
gaocaandra: no
DeeboMC: Make it stop
dompatobbe: Aight thank you
posixninja: I'll leave you to hack and try to catch up on my own. this was the next course I was going to watch so I might be back
posixninja: if I don't solve it on my own
calcmath: good old off by one errors
satire_: are you done with low level stuff?
in_just: Is the AlphaGo algorithm publicly available?
Santiago_LHC: Ha, no
DeeboMC: What would u do with it anyway
in_just: Play Go
DeeboMC: 😂
ohheyitsrainy: absolutely embarrass Lee Sedol
GandalfTheGrayOfHell: Best lee sedoy again
gaocaandra: create a swarm of drones
calcmath: do you eman the weights or the meta algorithm used to train it?
worraaa: there's some open source implementation
worraaa: but training will be expensive
frznn8: vai dormir filhoi
Santiago_LHC: There's Leela Go, which is based on AlphaZero Go
gaocaandra: how big a gpu farm would you need to train a model like that?
in_just: For Go? They spent $25 million I read
ohheyitsrainy: depends on how much time you have :P
gaocaandra: dayum
PFY1: whats muzero
Santiago_LHC: 25 million? I doubt it, that's too much
in_just: Until I stand corrected I stand correct? lol
robonhansonem: Still PoleCart?
DeeboMC: I agree
concurrentx: hi george! i've been watching you for years. One thing, I'm always curious about - what's your typing speed in WPM?' could you please do few races on TypeRacer?'
BumD197: isn't that algorithm trained in 4 hours or something
BumD197: for go or chess
Penguino138: PIZZAAA
gaocaandra: 35 million By one estimate, the training time for AlphaGo cost $35 million;
gaocaandra: thats what google says
alfyfav: I got scared because I thought that noise was on my place
in_just: I stand corrected LUL
carlosalfarodev: Hahaha
Santiago_LHC: Interesting. It wasn't anywhere as expensive for Alpha Zero
carlosalfarodev: I got up to check if it was in my place too
rickoftheroot: PogChamp
ohheyitsrainy: apparently alphago zero hardware cost was ~$25 mil? at least says wikipedia
DeeboMC: Yea but you were righter than wronger.
peakyDicers: what is jupiter notebook used for?
ohheyitsrainy: not that goog actually paid that much
in_just: righter than wronger, gonna have to remember that one
calcmath: dont you have to call make_targets
calcmath: before training
Biffingtonn: that pizza looks like you should get ubereats
RomanBanana: 'well thats stupid' LOL
DeeboMC: Lol
calcmath: ohok
calcmath: code not zoomed hard to read
microx0ft: Basically implementing the Monte carlo search will be used to select moves?
balloonpopa: What you got brother... a personal pizza?
pwnbase: have you messed around in MuJoCo?
Waldoqq: its not delivery its DIJORNO
Santiago_LHC: Hammer time
niko174_: Здравствуйте
calcmath: Maybe i am missing something here in your simplified version of MCTS, not sure why it would work
ak0ya_: no russian today :)
niko174_: So sad
in_just: baking a frozen pizza instead of microwaving. i took am a man of culture
guy_ross: guy_ross subscribed at Tier 1. They've subscribed for 4 months! OhMyDog
Manalope: Manalope subscribed with Twitch Prime. They've subscribed for 2 months! 
balloonpopa: What happened with the protein folding thingy?
ak0ya_: it's over @balloonpopa
DeeboMC: Timed out
balloonpopa: ahhh gotcha
Killeraing: pizza asmr
worraaa: mukbang stream PogChamp
mik12f4: are you tired or bored?
gaocaandra: aparently biology is kinda not a thing
BumD197: most likely it unlearned
k3ags: !uptime
guy_ross: @k3ags 2:08:40
calcmath: biology took too much compute
Abnico: hmm
dontbeameme: Hot pockets
calcmath: these loss curves just mean you are overfitting to each batch separately right?
dontbeameme: You live in America and u eating hot pockets
Santiago_LHC: No dumb off topic questions
DeeboMC: It’s not a hot pocket.
dontbeameme: Gotcha
dontbeameme: @santiago_lhc
DeeboMC: But #hotpocketlivesmatter
murkythunder: buy a hot pocket and you too can have the dinner of pro programmer jorge hotz
DeeboMC: 😆
calcmath: is any one else following whats happening here?
DeeboMC: #metoo
BumD197: little bit @calcmath :)
calcmath: werent those loss curves just overfitting
calcmath: on single batches
vaskogomez87: guys what is he doing? just arrived
slowpolka: have you cured coronavirus with a car yet
calcmath: need longer than 200 steps to judge quality of balancing
z00fle: trying to balance the stick?
ratakamom: yeah, the cart pole problem
Ayowayway: ai learns to balance a stick?
DeeboMC: Next time on dragonball z..
worraaa: exercise: explain the loss spike
Rowro: george im the biggest fan you'll ever have, I think we should be together @georgehotz
Ham3113: hey man. im a com sci student going into my last year of uni and i want to start learning more about how to implement neural nets. ive already taken an ai course that went over the general concepts of neural nets like back propogation and weight and bias calculations but i havent actually had the chance to make one. do you or chat have any suggestions for resources that would help someone at my level. thanks man love the stream.
Santiago_LHC: He does.
calcmath: he is not clearing his loss array so after restart it look slike loss spike
DeeboMC: @calcmath u the real mvp
calcmath: gradual improvement
DeeboMC: Lol was being serious tho
z00fle: oh its solved
Manalope: nice
Bowlgirlblergh: atpGasm
worraaa: ooh i thought it went to explore new regions of state space so there is spike
calcmath: lol thanks @deebomc
rickoftheroot: Pog
baby_janitor: what ide is that
DeeboMC: Np
calcmath: let see the balancing for 100 steps
vloodp: whats the project?
Santiago_LHC: The name is right there at the top @baby_janitor
calcmath: 1000steps
Penguino138: look at him wiggle about
Ayowayway: PogChamp PogChamp PogChamp PogChamp
calcmath: moar steps
rickoftheroot: PogChamp
z00fle: uncap it @georgehotz
PiroFloydian: whats going on here friends
arrabity: PogChamp
dontbeameme: 👏
calcmath: mosr steps plz
dontbeameme: We are the champions my friend
calcmath: yes uncap it
lebop: please ELI5 what ish appening
aPosterior: now forbid it from harming humans
Protoxus: lebop Machine learning makes pole not fall over
calcmath: an AI is learning to balance a stick, the AI has no exposeure to physics before
StopitDonk: whats so exciting about 200?
lebop: ^
calcmath: maximum reward
calcmath: it fails very human like
z00fle: what's considered "pass" ?
calcmath: reward is to last for as many steps as possible
BumD197: it looks like too easy job for this AI
calcmath: pass is it balances for long time
z00fle: for one trial? or X in a row
calcmath: if truly learnt in a general way, it should balance beyond 200 steps even though it was trained only for 200 steps
lolzmaster99: One run should be able to last indefinetly
lolzmaster99: Due to the simplicity of cartpole
BumD197: in theory calcmath?
calcmath: yes ideally
cieph4: !uptime
jmp0ut: modulo your memory addresses as a quotient of your total memory space
jmp0ut: faster
jmp0ut: surprised our computers dont do it already
birkett0011: What we learning today boyss?????
jmp0ut: simple math
calcmath: otherwise its just fitting a table with a neural network, its good, just less impressive
mr_stochastic: This being run on CPU or GPU? Not sure if someone already mentioned that or not.
calcmath: whole point of the algo is it grasps the dynamics aka physics
birkett0011: We doing some RL?
z00fle: GG
lolzmaster99: Is the initial pole position fixed at vertical for each new replay?
Penguino138: Glad the chat got their shit together somewhat
socialnotsocial: What do you think about the general stagnation argument presented by Peter Thiel, Tyler Cowen and others?
rickoftheroot: SeemsGood
calcmath: and generalize beyond the training nest
Ayowayway: SeemsGood SeemsGood SeemsGood PogChamp PogChamp
aPosterior: im a different man now
Waldoqq: can we g et more anti gov rants now? :)
BumD197: but it requires more training since it solves the problem but doesn't mean it solved physics?
jmp0ut: instruction sets as well
Trenz2: pretty good job
calcmath: last longer than 200 steps
l1ght5p33d: SeemsGood
mr_stochastic: Which RL game is next then? Cool stuff tonight :D
lolzmaster99: it can have a reasonable response to new instances
calcmath: not saying its bad, just interesting to see how far you can push it
DeeboMC: ML=/=AI
z00fle: brute force programming
lolzmaster99: Great stream. Looking forward to more paper streams
calcmath: can you uncap and run once?
worraaa: what are you trying next for muzero?
mr_stochastic: Yes!
worraaa: card game Kappa
calcmath: un cap in the evalution
jmp0ut: R programming is harsh
mr_stochastic: Yeah diff env :)
Santiago_LHC: Can we merge MuZero with Twitchess
vloood: this calcmath sperg lol
Penguino138: @georgehotz When did you say you were moving to the new apartment?
calcmath: lol @vloodp ill take that as compliment
worraaa: add discretization code
l1ght5p33d: discreet + small random continuity = continuous. no problem
birkett0011: @georgehotz Have you messed around with any dynamic simulation software? Like https://cloud.anylogic.com/models
k00kieeeez: xqcM
lolzmaster99: What about breakout-v0
lolzmaster99: same action space
lolzmaster99: left/right
balloonpopa: does the simulated environment account for external forces... i.e. wind ect.?
calcmath: harcoded policy
Manalope: jupyter is an IDE? what do the In / Out lines mean?
DeeboMC: Lol I don’t think so
DjAlma1991: What's up... First time here... Whar are you doing?
calcmath: i think you have 2 actions pace hardcoded policy in your "MCTS"
DeeboMC: @djalma1991 It’s kinda winding down atm, u were a lil late bro
calcmath: more hardcoded bugs
calcmath: [0.5,0.5
lolzmaster99: When are these gonna be posted to commai archive? Missed a lot of it
calcmath: its should 1/n, bot 0.5
calcmath: not 0.5
DeeboMC: U’d have to ask whoever that is that runs it
DeeboMC: @lolzmaster99
lolzmaster99: @deebomc Yeah just figured someone in here knew
DeeboMC: I’d like to know myself but they seem kinda cagey about the whole thing
DeeboMC: They’re in here lurking tho I’m sure
calcmath: sparse reward
BumD197: real test the muzero
calcmath: can it even reach in 200 steps?
lolzmaster99: breakout-v0
QUOTE_IF_NEXT_YEAR_BETTER: You start with artificial intelligence that can learn, adapt and improve itself. Because computers run so much faster than the human mind, the artificial intelligence becomes smarter and smarter at an exponential rate until it is so much more intelligent than we could ever imagine. Public figures such as Stephen Hawking and Elon Musk have expressed concern that full artificial intelligence (AI) could result in human extinction. How do you plan on stopping this from happening?
l1ght5p33d: laundry folding simulation
Killeraing: ban him
lolzmaster99: ban this guy
imkonst: sorry im new to this, is he using machine learning principles right now?
rickoftheroot: hammer incoming? LUL
DeeboMC: Hopefully
QUOTE_IF_NEXT_YEAR_BETTER: ban that guy
calcmath: reinforcement learning
QUOTE_IF_NEXT_YEAR_BETTER: evolution innit
gaocaandra: banhammer
DeeboMC: @quote_if_next_year_better How do YOU plan on stopping it?
theirishtripleking: All it takes is one semi colon removed thats how you combat it...
DeeboMC: Very niiice
calcmath: python doesnt care about semicolons
BumD197: we re doomed then
birkett0011: have you seen RL applied to any real life complex systems? Currently only seen small games with it
theirishtripleking: sorry colon*
l1ght5p33d: boston dynamics
CHENLOLA: What software the up and down arrow icon is?
skinnypuppy69: whats he making
calcmath: big games like dota and starcraft too
QUOTE_IF_NEXT_YEAR_BETTER: ^
t0rment1337: @georgehotz u need to change 1m2019.com to 1m2020.com
Anton_gashi: !uptime
skinnypuppy69: is he making a bot to play lunar lander??
lolzmaster99: Lunar lander can also be done as a convex optimization right?
cieph4: !uptime doesn't seem to work
masters8: There's no bot
Ayowayway: what about youtube celebrity Kappa
calcmath: gotta learn the physics before you land on the moon
Dgreen420: Dgreen420 subscribed with Twitch Prime. They've subscribed for 2 months! Big up George
worraaa: LUL
l1ght5p33d: don't need to learn any physics just approximate iwell enough
Ayowayway: SeemsGood SeemsGood
calcmath: yes just the practical aspects of physics
calcmath: muzero is very pragmatic, it only learns what it needs to achieve its goals
l1ght5p33d: pretty good
lolzmaster99: Needs more exploration
imkonst: is he plotting the loss function outputs?
lolzmaster99: What time tomorrow?
Mlewii: but can it learn poker though
birkett0011: pretty keen for this simulation tool : https://docs.hash.ai/core/ all python
lolzmaster99: What loss is that? Not familiar with muzero do they have actor/critic?
CHENLOLA: George, What software the up-down arrow icon is.
lolzmaster99: end-to-end?
lolzmaster99: Is that what you mean by correct?
鼻史: @CHENLOLA reverse scroll ?
l1ght5p33d: most underrated stream in ai
worraaa: this task needs more exploration
calcmath: poker can also exploit human behaviour by building models of specific humans
memogainz: Anyone recommend an intro to AI book?
Jski101: But you're hawking it Kappa
worraaa: which you might not get without proper UCT
Santiago_LHC: Nash
pwnbase: i have built a poker bot, i think the current literature is a bit clickbait
lolzmaster99: Understanding Machine Learning by Schwartz
worraaa: or just epsilon greedy
kevin21071: are these notebooks available on github?
鼻史: MIT open course ?
calcmath: yeah thats good generalizauton
lolzmaster99: It should go idnefinetely once it's learned to keep the pole within the learned space
Santiago_LHC: @kevin21071 Yep: https://github.com/geohot/ai-notebooks
bloodborne24: pole game strong PogChamp
therealariel666: !uptime
socialnotsocial: @georgehotz what do you think about the general stagnation argument presented by Peter Thiel, Tyler Cowen and others?
georgehotz: !uptime
masters8: nope
Santiago_LHC: 2 hours 30 minutes
WiseSwift: Can someone catch me up on what he’s doing?
masters8: lol
鼻史: u need bots in chat LUL
therealariel666: Thanks
Santiago_LHC: You need to install https://nightbot.tv/ @georgehotz for the commands
skinnypuppy69: you need a chat bot
skinnypuppy69: that would be cool
lolzmaster99: Question: Will you install a dark theme on your notebooks
socialnotsocial: https://en.wikipedia.org/wiki/The_Great_Stagnation
skinnypuppy69: nevermind
BumD197: wanna see his on robotics type on simulation
DeeboMC: “Not now mom, I’m building a heuristic”
Santiago_LHC: Mods can't do it.
Protoxus: I think most of your mods can do it
waterpaste: Ninja LUL
calcmath: do you think mu zero like algorithms canone day be used to run corporations?
crawcraw66: i think its economic growth by high unemploymenmt
Ayowayway: ninja who Kappa
ggtom: ?????
Protoxus: @Santiago_LHC If he just sets it up, can't he give mods the rights to administrate it?
Protoxus: Haven't used Nightbot in a long time, but I think I remember something like that
l1ght5p33d: We're so productive everyone could get fired and we'd still produce everything
Gamer_nohope: just me or sound is too low?
Santiago_LHC: @Protoxus Yeah, we can add commands and edit, but he needs to install it
ggtom: i arent read that tbh ngl
eddtarlin: why coding isnt popular there like games
CHENLOLA: @鼻史 gotcha, reverse scroll. thanks.
jmp0ut: greedkeeping babies
waterpaste: d
borang: hello
jmp0ut: weirdos
calcmath: I think AI can open a new frontier for more growth
pepelaugh0: @georgehotz thoughts on simulation theory?
Ayowayway: religion philosophy made us here imo
WiseSwift: Yeah but everyone is doing yoga, all about eastern philosophy now brah
jmp0ut: religiosity also leads to tech fears
Protoxus: Hermetic philosophy is pretty dank, IMO
jmp0ut: some of which are unfounded
ggtom: i agree it gives focus as well
jmp0ut: and others lead to subversion cults
jmp0ut: which is horrifying
Abnico: what happened to matt's crypto religon?
Gamer_nohope: you can join games and coding...
agentvenom2: iterated prisoner's dilemma favors nice strategies though
balloonpopa: Religion is a matter between a man and his God - Thomas Jefferson
calcmath: progressivism i a kind a new relisigion, so just looking at olny old fashoined religion is not enough
socialnotsocial: You have an interesting point. Does religion help to keep people away from zero sum games? "Do not copy what your neighbor wants" etc
socialnotsocial: in some sense
DeeboMC: What about the Nordic countries tho. I think religiosity is being given too much weight
calcmath: it fosters cooperation to avoid prisioners dilemma
lolzmaster99: No religion is the new religion
jmp0ut: general buck naked repented and ate childrens hearts while giving them rifles to commit war crimes now he's a preacher
gaocaandra: maybe we've shifted from mass organized religion to smaller groups
pwnbase: they cannibalize eachother all the time
Thotshotgg: Are we putting our cure to covid on hold for now?
Ayowayway: nationalism makes the new religion force?
jmp0ut: hinduism believes in never being clean of sins and it's one of the oldest still surviving
balloonpopa: Where God builds a Church, there also the devil will build a Chapel - Martin Luther
memogainz: Why does it have to be religion and not simply promote good values?
therealariel666: @jmp0ut true
pwnbase: did you hear Shkreli is engaged?
l1ght5p33d: FDA won't let geohot cure covid
AzzoDio: sister is on immunosuppressants, parents are both super high risk
Abnico: 0xΩ
masters8: What kind of argument is that?
jmp0ut: @therealariel666 pay for it in this life or the next kinda thing
calcmath: universal human rights is a way we avoid conequences of zero sum condtions on large scales
Thotshotgg: lmao I am kidding. i just want our economy to reopen.
ahahahaitslit: unless you have a health condition
masters8: Fuck the old I guess
jmp0ut: i'm glad hindus dont have the fears of murder or genetic engineering
patroniv: Religion produced great art and architecture as well. Maybe sometimes not through the best means, but their cathedrals are amazing
lolzmaster99: But you could infect others
jmp0ut: they just do what needs to be done
tripcloth: when does your religion start? and are you gonna waco mode fks my wife?
Jski101: No point getting it
therealariel666: Well one of the sayings is that a person has to spendsome time in hell before going to heaven.
TheCellarDoor: Unless you love someone who is old of course ...
pwnbase: "Shkreli is asking to spend the remainder of his seven-year sentence with his bride-to-be — whose name is redacted in court papers — at her Manhattan apartment so that he can, they say, work on a coronavirus cure."
Penguino138: @georgehotz have you ever gotten into kernel convolution for image processing?
DeeboMC: @tripcloth 😂
masters8: lol
lolzmaster99: You also live alone
Abnico: art distributes cult/culture
ahahahaitslit: is kim jong un dead?
WiseSwift: So many nerds have asthma
balloonpopa: The people that need religion the most are the ones that are the most religious - balloonPopa
bloodborne24: based pharmabro Kreygasm
marckkhoury: We're not fully aware of the potential long term complications even in the young. It seems this virus can impact a lot of your organs negatively.
therealariel666: He is brain dead PogChamp
jmp0ut: shkreli is just a troll
cieph4: RIP KIM LULW
slev0182: Shkreli is the only one who can jailbreak the corona virus
jmp0ut: to prove money is broken
lolzmaster99: Lmao you and Shkreli should colab
lolzmaster99: Get Shkreli on the stream
Thotshotgg: Kim Jong Un had a botched heart surgery? haHA
calcmath: it can still affect your lung capacity
balloonpopa: No way... let Skereli stay in jail
Protoxus: lolzmaster99 Pretty difficult from prison, I think
Protoxus: balloonpopa Why?
masters8: what?
ahahahaitslit: the economy would've been fucked either way
jmp0ut: @georgehotz what do you think of the silver tsunami, pension funds going to /dev/null
lolzmaster99: I don't agree that net no lives were saved
Thotshotgg: exactly, lets reopen this country already. People are going to suffer more and more.
Abnico: its likely everyone was getting it before febuarary lol
kevin21071: yesterday they found 50k new cases, highest ever
DeeboMC: I disagree as well
Abnico: so many people got it without knowing
tripcloth: george, what is step 1 to hack the simulation??
t0rment1337: sweden is the only one that got the policy it right
Krakatoa77: !uptime
calcmath: even if you dont die, a significant propportion can be left worse off
marckkhoury: The sampling of those studies is questionable.
lolzmaster99: What did Sweden do?
FreddiesDeadieButHasAces: I tried to get a test they said I wasn't sick, but I work at BK so I thought it was a good idea months ago
ofaas: im so weary of these doctors giving economic forecasts while comparing them to their worst case models
Protoxus: lolzmaster99 Pretty much nothing, for the first month of it
Santiago_LHC: Lockdown keeps the medical care system from saturating. That's when people who shouldn't die, start dying of stupid reasons like lack of respirators available.
lolzmaster99: Discipline is the difference
Abnico: authoritarian countries #1
DeeboMC: Yea I don’t think Sweden’s case is applicable tho
ahahahaitslit: i've heard from actual swedes that the lockdwon is still basically self imposed amongst the people
kayoeyumisaolegais: !time
DeeboMC: Apples to oranges
yogi_1010: what about the non-covid patients it saved? Because the hospitals did not get flooded with all the +45 yolds
ahahahaitslit: like it's not government mandates but still
balloonpopa: Haha
ggtom: Santiago_LHC i think that the main reason for lockdown. otherwise, the hospitals get stressed and u make decision of who to let die.
jmp0ut: Palantir's CEO went to live in a nuke bunker in New Zealands, five eyes new operation center since australia was janked off forest fires
Protoxus: I live in Denmark - most things have already opened up again here, which is nice.
lolzmaster99: American culture is not disciplined enough to employ more lenient lockdowns
Thotshotgg: HA
nihonzera: I live in Tokyo. The governor said is impossible to have a lockdown here.
JdPaulBlart: shoutout to the bernie bros
Trenz2: nobody is
Penguino138: My favourite joke of the day was when you said the partyers were cheering for the healthcare workers dotsKpog dotsKpog
socialnotsocial: Australia and NZ have done well.
calcmath: dont you think a government need to wrr on the side of caution in these situations
jmp0ut: NZ is official police state
Thotshotgg: Are airplanes/airports operating at this moment?
Penguino138: Aren't hospitals going bankrupt cause they had to cancel most surgeries?
jmp0ut: here in Canada we have military medics working 24/7 to manage our inefficient healthcare
Jski101: That's the second best way to catch it
l1ght5p33d: Is Japan still radioactive
Faceless_Bard: out of the loop here: What does mean "they got policies right" ? what exactly did they do ? or not do ?
Santiago_LHC: @nihonzera I'm surprised by how few cases there are in Japan considering how early you guys have been exposed.
jmp0ut: yes it is l1ght5p33d
Thotshotgg: Dang
therealariel666: Wish I could keep my apartment as tidy as yours :(
eddtarlin: iam new there, whats going on?
l1ght5p33d: sweeet
kevin21071: the spread out the seating in restaurants, etc
kevin21071: they*
nihonzera: @Santiago_LHC the thing was the Olympics: they tried to keep fewer tests to keep a low number to try to keep the event going
Protoxus: @Faceless_Bard I think balance risk-minimizing without compromising the economy - and especially not taking "risk-minimizing" to extreme levels that don't really work that efficiently.
Major_Spicy: Did you get far with the Muzero thing today?
Thotshotgg: It is really depressing to hear college campuses and other schools talking about remaining virtual into the fall semester.
asselbergs: What about Brasil??
Games4Stream: In Sweden, they don't have the power to initiate a lockdown. They have literally no plan for a pandemic.
asselbergs: Brazil.
Faceless_Bard: Protoxus SeemsGood
jmp0ut: should we create healthcare camps like the FEMA tailerpark camps from the hurricane days
DeeboMC: How many airports are in Sweden vs USA tho
jmp0ut: you know
DecayingSkullz: I wonder what the new normal will be after this is all over
socialnotsocial: Do you worry about engineered pathogens?
lolzmaster99: People are pointing to the relatively low public health impact in the country as evidence that the lockdowns were unecesry
jmp0ut: china was working on broadspectrum antivirals a year prior to COVID-19
asselbergs: The French are fumbeling this worse than the USA even. The lockdown there is brutal.
Nussinov: will anyone learn their lesson?
skinnypuppy69: isnt the corona virus suspect for being engineered
lolzmaster99: But the lockdowns made the lowimpact possible
Turtle_L9: bro my brain gets tired after 2 hours of coding how you do it for hours straight?
l1ght5p33d: Engineered pathogen ::: poison dart frog on a stick
jmp0ut: @socialnotsocial the militaries of the world were concerned with the research on broadspectrum antivirals
Protoxus: Spain is implementing permanent UBI following coronavirus, which I find awesome
calcmath: Did you see the detailed medium post that outlined all the circumstantial evidence that it was lab made
jmp0ut: 2 years is about right
Santiago_LHC: "nothing to do with capital, it has to do with humans".... what's the difference? lol
balloonpopa: Thought 5G infrastructure is coming soon?
MrSheepe_: Hi
nihonzera: After postpone Olympics the numbers got higher here. Anyway, I think Japan still do very well considering the traditions (using masks by default, alcohol to clean hands everywhere..)
jmp0ut: if you look at the hotel and service industry directly correlated
balloonpopa: ...then exponential growth
tripcloth: epoch times told me this shit come out of a lab brah
tisd_: Why is Pakistan doing fine, i am from Pakistan btw
l1ght5p33d: noooo
skinnypuppy69: why did the chinese lie about cases
kevin21071: lol well if it did, means it can be now
axlebear: holy shit
jmp0ut: look at the stock prices of hotel and resort companies
deepfrieddeals: ooh are we talking stocks here?
jmp0ut: exact same as DOW
Thotshotgg: How does a virus just escape
Abnico: it isnt real, its 5g
ofaas: did you read reports of china buying up mask supplies from abroad while they were concealing the extent of the spread?
Penguino138: i got to this corona map way too often
WiseSwift: Oops
BumD197: is this 5G wars?
Santiago_LHC: Blame the dashboards
crawcraw66: 200k deaths tho, reasonable to panic
THX1342: what about the overwhelmed hospitals?
calcmath: what about hospitals overflowing?
therealariel666: There are rumors China is testing the cure on Pakistanis, which is kinda sad if its true.
Penguino138: French Daily cases dropped a few thousand if you look at daily cases
malledive: It's 10x deadlier than the flu.
THX1342: Italy
jmp0ut: Ontario, Canada, overwhelmed
crawcraw66: uk, italy
calcmath: italy/NY
therealariel666: Italy
tripcloth: nyc?
THX1342: Brazil is over capacity
Trr67: a lot of places
Ayowayway: good website design SeemsGood SeemsGood
marckkhoury: You think this is comparable to the flu?
Santiago_LHC: NYC
asselbergs: Italy, France, NYC
THX1342: Spain
pizzashotgun: @malledive based on current numbers
Trenz2: in italy they are..
asselbergs: Ecuador
pizzashotgun: the death rate is most likely lower
THX1342: Ecuador
lolzmaster99: New York transporting bodies in 18-wheelers
Jehhred: I've enjoyed working from home though. Keep the fear mongering high so I don't have to go back
Biffingtonn: What? Italy, Spain, NYC, Wuhan
DeeboMC: New York
Trr67: ???
ahahahaitslit: i think everything you've said about this is wrong
tripcloth: idk dood seems serious
Nussinov: yup this is true in minnesota
t0rment1337: more people died in italy last year march than this year march
THX1342: NYC, Ecuador, Spain, Italy
skinnypuppy69: we got lucky that it was a stupidly insignificant epidemic and not a actually threatening one, gives us good practice
AppleGrape: link for this?
lolzmaster99: I mean the volume of the transport
balloonpopa: just the first want right now
MrSheepe_: What do you think about US lockdown compared to South Africa's lockdown?
malledive: @pizzashotgun It might be even higher. Most people aren't tested post-mortem
kevin21071: yeah the hospitals where I live let a ton of people go
jmp0ut: why is the U.S. so oversaturated with virals
DeeboMC: Seattle?
Protoxus: I agree @skinnypuppy69.
calcmath: bodies in streets in ecuador
Thotshotgg: I think older folks should continue to isolate. But people need to get back to work and kids need to get back in school.
pizzashotgun: @malledive and it probably does permanent damage to the lungs
jmp0ut: is india and china worse?
balloonpopa: just the first wave right now
skinnypuppy69: thank you @Protoxus
THX1342: just wait to watch souther hemisphere winter....
WiseSwift: Wasn’t it the New York lockdown that contributed to that
patroniv: This has been an incredibly confusing time, made worse by the connectivity and the media. It seemed as though every week the truth was different and those to blame changed as well. Crazy
plazmacsgo: you have a point
Abnico: @georgehotz https://www.theverge.com/2020/4/24/21234457/apple-google-coronavirus-contact-tracing-tracker-exposure-notification-shut-down
cars1n: so corona is a joke?
skinnypuppy69: no one knew how to deal with it
azer0s: I mean...what about Italy? Hospitals in Austria were overwhelmed as well
jmp0ut: i think thats a joke
plazmacsgo: like the flu
Mariosavitch: so is obesity
therealariel666: Obesity
Turtle_L9: you are fear mongor
pizzashotgun: beard scratch noice nice
tisd_: In Pakistan lockdown is pretty tough, only groceries and stuff, roads are pretty much empty
tripcloth: if 10k later, why 1million now?
jmp0ut: it's a love bug
jmp0ut: cooties
MrSheepe_: Kim Jung Un death a hoax or nah?
Abnico: "Apple and Google pledge to shut down coronavirus tracker when pandemic ends"
skinnypuppy69: obesity is a free vaccine
cars1n: China learned from this pandemic and next virus it releases to the public will be much more deadly
nomemesplease: You said before this was a once in a 100 year event (vs 10 or 1000), still think so?
skinnypuppy69: running == vaccination
Abnico: particularly funny
DeeboMC: What about bill gates saying to expect a Pandemic about every 20 years from now on?
guinness84: how many unique coronavirus as time --&gt; inf
pizzashotgun: China doesn't benefit from this pandemic
kevin21071: so it's official or is it still a rumor?
asselbergs: Weaponized influenza.
MrSheepe_: are you self taught?
cieph4: hey guys, China bad
Penguino138: @georgehotz have you ever messed with convolutional kernel image processing?
azer0s: bro no one benefits from this pandemic
FlySociety2o9: D:
balloonpopa: you see the documentary on the Spanish Flu?
socialnotsocial: are you interested in this? https://www.lifespan.io/road-maps/the-rejuvenation-roadmap/
jmp0ut: they're greedkeeping and dont wanna die
asselbergs: Bring Math to Medicine.
Ayowayway: D:
Krakatoa77: D:
jmp0ut: :(
l1ght5p33d: smoking cures corona
pizzashotgun: @azer0s exactly, i don't see why they would release it on pupose
AppleGrape: CAnnabis MAY CURE CORONA]
l1ght5p33d: weed only
Protoxus: Not true. I benefit from it 'cause it's likely to create more work-from-home jobs @azer0s
Penguino138: Car alarm in the background? Or is it cheering for the healthcare workers?
jmp0ut: TheIlluminati
asselbergs: http://evaxion-biotech.com/
Thotshotgg: Wouldnt there be evidence/record of COVID19 existing in a lab then if that is where it originated?
TheDkbay: @georgehotz It did cause irreversible lung damage to a lot of people though even if it didn't kill them that still sucks
Trenz2: @georgehotz how is comma going man ?
Protoxus: @TheDkbay Hey buddy
azer0s: @protoxus I mean...fair...but our economy was still majorly fucked by it.
Faceless_Bard: jesus add some margin on the left
azer0s: so yeah...single individuals might benefit
gaocaandra: quercetin and resveratrol really work
ofaas: i didnt watch your full corona genome stream, did you gain any new insights from looking at the genome?
gaocaandra: they are dope as fuck
Protoxus: @azer0s Sure, I don't have stocks right now, so it doesn't really harm me either
tripcloth: 5g airpods cause coronacancer u heard it here first
lolzmaster99: I'm not comfortable marginalizing the death of people who might've had 10-30 more years. It's kind of gross to write off life like that
gaocaandra: if you have asthma
Santiago_LHC: This has been going on for a while: https://medium.com/@tomaspueyo/coronavirus-act-today-or-people-will-die-f4d3d9cd99ca
azer0s: but overall it's still horrible for our economy
guinness84: LUL
asselbergs: Like Dengue, having this may be a setup, for a secondary fail.
forkdb: Hello george
DeeboMC: @lolzmaster99 Agreed
MABunglawala: Who is George working with rn?
balloonpopa: The virus has adaptability(mutations)... the human body has tolerance and intolerance
Nussinov: look at those CURVES
FlySociety2o9: lol
guinness84: he works for the cia
lolzmaster99: Yeah fuck Medium
azer0s: @protoxus yes...again... individuals are one thing, overall economy another
cookienz: THICC curves
Penguino138: What is California's reopening plan?
asselbergs: lol
forkdb: He works for nsa
Nussinov: act today, motivate a fatty to get on the treadmill
plazmacsgo: what do you think the world would be after the lockdown is over?
Santiago_LHC: Why does every single epidemiologist say different then?
Ayowayway: we could not know the otherwise
balloonpopa: it is a matter of exposure over time and how the body reacts over time
lolzmaster99: But that's in hindsight. We didn't know the dynamics
lolzmaster99: at first
Protoxus: azer0s Sure, but your initial statement was "no one benefits from this pandemix"
MABunglawala: yall bugging
guinness84: excitement
node_storm: what's up geo
forkdb: What do you think about Elon musk saying ‘people weee overacting about covid19”?
bloodborne24: life gets boring if it gets too easy
calcmath: cultural allergy
t0rment1337: there was a chinese flu in 1958, 2 million people died yet no one remembers that
jmp0ut: UK's medical licensing schemes are very future oriented
markodern: World war 3, for example?)
ofaas: my supermarket wont let me in without a mask now
azer0s: @protoxus that is correct. if our economy is fucked, in the long term, even if you benefit rn, you gonna be fucked as well
asselbergs: Heading in. Thanks again for a good session George. Go out and have some fun out there.
JdPaulBlart: lockdown aint over until schools open up
Penguino138: The world after lockdown: Digging sand out of skate parks
forkdb: Ohh. Really
tribegvng: yo
pizzashotgun: the chat delay seems really low
deepfrieddeals: Until they remove the sand at the skatepark we’re still on lockdown.
WiseSwift: Girls aren’t letting me smash. Lockdown isn’t over.
jmp0ut: economy of pension plans is fucked hard
forkdb: But there was no cure
azer0s: it's more like temporarily fucked
lolzmaster99: So the prolonging is the wrong move not the initial policy? I can agree with that
plazmacsgo: damn in new jersey we are still in lockdown and im on my senior year
727_tf: couldnt there just be a mandatory mask thing and we get on with our lives
jmp0ut: unless we all turn instant billinoaires
jmp0ut: and then what
balloonpopa: the virus is affecting more than just the respitory system
Newlax: crypto is future
Ham3113: i wanna start implementing neural nets tommorow for the first time. where do i start?
l1ght5p33d: Hodling
forkdb: When do you think the cure would be available?
l1ght5p33d: Alwaysss hoddlingg
patroniv: Stonks
tribegvng: centivax got the antibodies
balloonpopa: yes the economy will come back
Thotshotgg: @balloonpopa what else is it affecting
Santiago_LHC: There is this Mamoru Oshii (Ghost in The Shell) movie called The Sky Crawlers, which is about clones which take part on this made up war, just because mankind needs conflict to endure.
therealariel666: "never
l1ght5p33d: when you're rich enough
skinnypuppy69: everyone buy stocks now while things are low
ofaas: would you get a corona vaccination?
Nussinov: now that youre talking about corona title your stream "reverse engineering the virus" again Kappa
skinnypuppy69: with your mattress money
guinness84: no cure is worrying if more unique coronaviruses pop up
balloonpopa: blood clotting, the liver, the heart, the brian
plazmacsgo: LOL
forkdb: Ohhh.. man... am feeling saaad nowwww
azer0s: I mean...there is Oseltamivir and there's a vaccine for the flu
balloonpopa: Google covid toes
Abnico: bill gates said the lockdown should continue until the vaccine
FancyDawg_: why
plazmacsgo: you never know when the market will buttom out
azer0s: so...there's kind of a cure for influenza b at least
WiseSwift: Lmao
FancyDawg_: why wouldnt you get a vaccine for cov19
l1ght5p33d: i like my virus raw like my meat
WiseSwift: Anti flu shot wild
FancyDawg_: you didnt get one for swine flu?
LordHord: Covid toes?
Penguino138: @georgehotz thanks for the streams today, was great to have you back!
Jski101: Get the vaccine 30 days ago
calcmath: do you think there are methods to foster cooperation , other than religion, capitalism and the governemnt?
tripcloth: &gt;&gt;&gt; corona_virus_vaccine == mark_of_the_beast True
Thotshotgg: YEah we missed you
Abnico: vaccines give u autism
trconway: Favourite ML paper?
Newlax: why don't you get a flu shot? @georgehotz
balloonpopa: no flu shot here either
技術宅: sushiWOW
jmp0ut: @Santiago_LHC more interestingly Tsutomu Ohashii who made the musical score of Akira is likely working on these problems now considering his research into consciousness, more likely to create genetic variants and invariants than clones
skinnypuppy69: leave lockdown 30 days ago
darthbearjew666: Can we model how much inflation the stimulus will cause on food and rent prices? Also, what if the stimulus produces data supporting UBI plans like Yang’s?
技術宅: facts
forkdb: I love you George.. you read all my chat, am happy now
Sharlock93: do you miss the jailbreak days george?
Trenz2: but what if the gov pushes you to take a vaccine ? how you feel about it ?
bloodborne24: -380 gang LUL
azer0s: @people who said crypto is the answer: crypto sux.
kingvoneduard: Everybody knows now that is a laboratory made virus.
plazmacsgo: is there a reason why you think its a scam?
Santiago_LHC: @jmp0ut That's fascinating
Kiskiss: gang gang
jmp0ut: N-4 center DNA strands in heavy water or higher gravity environments
Thotshotgg: Whats going to happen to oil prices
Abnico: de urbanization would be cool though
socialnotsocial: What do you think of Girard's mimetic theory? We copy our desires form others and imitate them and the implications of such tendencies.
jmp0ut: nitrogen centers are intruiging
lolzmaster99: What will it take for wider adoption of decentralized currency?
jmp0ut: synthetic DNA
Nussinov: what do you mean most of medicine is a scam? that sounds like an extreme take
kingvoneduard: Made and escape :)
kevin21071: JPOW go brrrrr
DeeboMC: What do you think about this?
tribegvng: 😂
jmp0ut: can't be affected by viruses and bacteria in the same way
deepfrieddeals: The best way to avoid getting the flu is to avoid contact with coworkers that have children.
Aceinyourface: alright we reverse engineered that covid lets go boys
DeeboMC: Bill Gates warns that a coronavirus-like outbreak will probably happen ‘every 20 years or so’ https://www.businessinsider.com/bill-gates-warns-coronavirus-outbreak-likely-every-20-years-2020-4
cookienz: 😂 OIL HAS CRASHED! oh wait where did those jobs go
calcmath: it can only cause inflation if it incresed spending, but with decresed spending due to lockdown, i doubt this will cause inflation
darthbearjew666: Hell us understand negative oil prices
jmp0ut: there's even a programming language called SBOL to create synthetic life forms
jmp0ut: including viruses
thediamnd: !uptime
balloonpopa: worth a watch... https://youtu.be/UDY5COg2P2c
deepfrieddeals: young ish
WiseSwift: What if you get tetanus?
kingvoneduard: Placebo is better
Protoxus: -(2^8+2^7-4)
jmp0ut: SBOL is an open standard for the representation of in silico biological designs.
SOmedude456: bacterial infections
Nussinov: LUL
pizzashotgun: most regular medicine is just treating symptoms
Santiago_LHC: comma.med
Aceinyourface: where we at master george
Newlax: You should make a crypto for comma!
balloonpopa: haha
Abnico: doubt https://www.theverge.com/2020/4/24/21234457/apple-google-coronavirus-contact-tracing-tracker-exposure-notification-shut-down
tripcloth: Exxon staff changed hands, time to start the area51 hack op bois
Nussinov: I mean obviously some diseases and things are treated with drugs, so what you're saying can't be right
forkdb: One last question... what advice do you give for a beginner programmer? To become an expert in problem solving and coding
azer0s: @newlax problem is that crypto kinda sux
l1ght5p33d: There's no way the virus came from the lab why would it spread fast from that point but not from it's original point
tisd_: I think people realize, now how fucked is US Healthcare
skinnypuppy69: @georgehotz what do you think about renewable energy industry? wind energy in particular? does it have a future?
Abnico: its already on ur phone
plazmacsgo: is there a reason why you are using mac and not linux?
ez_clappers_: i just want them to put more sand in the skate parks. fuck those skaters
Aceinyourface: we need socialism bro
Aceinyourface: simple as that
jmp0ut: https://sbolstandard.org/applications/
Santiago_LHC: #optimism
simmy7: the US is the kid with gucci belt
jmp0ut: make your own chimera today!
Kiskiss: is the world going to be a better place after covid?
gaocaandra: since when does the government need you to install an app to track you? it's a ploy by google and apple
jmp0ut: how does conservation of geothermal energy work
balloonpopa: pull up Covid Toes on the screen
Santiago_LHC: Conservatives
kingvoneduard: Atomic energy is better
skinnypuppy69: @georgehotz i dont wanna conserve but i want a job, is it feasible
worraaa: so how was the theorem proving stuff?
jmp0ut: agreed @kingvoneduard Thorium in the oceans can fuel humans almost indefinitely
skinnypuppy69: okay okay i see
plazmacsgo: is there a reason why you are using mac and not linux?
Newlax: but think about Africa
DeeboMC: Read this:
THX1342: our sole purpose in the universe is to consume energy to increase complexity
skinnypuppy69: wind energy
Penguino138: How many more people will distrust the news after lockdowns are all over?
skinnypuppy69: oof
forkdb: One last question... what advice do you give for a beginner programmer? To become an expert in problem solving and coding
Protoxus: @plazmacsgo unix is unix
jmp0ut: almost being exploding earth from solar luminosity is unavoidable currently
plazmacsgo: I see
DeeboMC: Bill Gates warns that a coronavirus-like outbreak will probably happen ‘every 20 years or so’ https://www.businessinsider.com/bill-gates-warns-coronavirus-outbreak-likely-every-20-years-2020-4
mazsociety: has chewing ice been confirmed as a covid cure yet?
Abnico: https://metagame.wtf/ open source religon
socialnotsocial: Thoughts on seasteading?
bloodborne24: install gentoo Kappa
plazmacsgo: does docker work on mac?
Thotshotgg: The news is criminal
calcmath: what if the discount factor provided by capitalism is inaccurate in predictiong the value of the windmill
DeeboMC: He says it with no evidence to support it
Nussinov: news in 2020
Faceless_Bard: humans forget :) they will keep trusting news
azer0s: unpopular opinion: the US is the richest 3rd world country in the world...like....I don't wanna shit on the US. But hear me out here: education in the US is a hoax, many people can't afford healthcare, public transport barely works, the FDA is a hoax
balloonpopa: Google Covid Toes
FileTheSystem: why the 20 years though. why not 10 or 30
Protoxus: @plazmacsgo https://lmgtfy.com/?q=docker+on+mac
manirte: what do you think about brave browser?
DeeboMC: Why?
Penguino138: I thought after the 2016 election everyone would hate the news, but still many trust them. I hope this time is different
darthbearjew666: Ya Covid toes is cray
pizzashotgun: the food pyramid was made by the department of agriculture
Thotshotgg: Freedom
tribegvng: braves gone shit lately
alfyfav: Freedom?
Nussinov: bill gates believes the biggest threat to mankind is a pandemic
Faceless_Bard: amerikan dream
lolzmaster99: Capital makes the US 'great'
ahahahaitslit: 'murica
Krakatoa77: Freedomland
lolzmaster99: We're not even that free
bloodborne24: freedom aint free KKona
balloonpopa: The DeVos family are scammers
newlifestartsnow: you never lived in Russia
Abnico: the us is great cause of punanai
SOmedude456: yo hotz are you Jewish?
lolzmaster99: Rights infringed daily
pizzashotgun: singapore go brrr
cieph4: KKonaW
jmp0ut: https://sbolstandard.org/publications/
newlifestartsnow: its shitholeeee
gaocaandra: you dont have rights in australia?
socialnotsocial: Thoughts on seasteading?
Krakatoa77: Freedomland KKona
Eyachi: thats so bullshit though there are so many other countries that have "freedom" and all those things so much better
jmp0ut: human hardware abstraction layer development
kingvoneduard: You cannot have socialism and freedom.
iamnotdmt: Australia is really bad, people not realise
pizzashotgun: ^
gaocaandra: you cant get out of student debt
jmp0ut: maybe you dont need freedom
deepfrieddeals: Plenty of countries have freedom
jmp0ut: just socialism
tisd_: How to not panic about Corona: Don't listen to the media.
lolzmaster99: We're not free we're wage slaves, extorted by corporations
skinnypuppy69: @georgehotz the push for "clean" electricity, like tesla, solar companies, wind farms, is that ever going to pick up over gas cars and coal companies
gaocaandra: no
spockshocks: court system is on the way to being politically compromised
dr_set: https://www.youtube.com/watch?v=VMqcLUqYqrs
Abnico: almost like bill gates made money cause of the hype..
balloonpopa: haha
Thotshotgg: Bring Snowden home
birkett0011: bureaucracy in Aus is bad
WiseSwift: Good joke
plazmacsgo: Ye I am not going to college to not get student dept
iamnotdmt: Australia ; you cant pay more then $10k cash for anything, we will be one of the first cashless society's
FileTheSystem: USA has the poorest labor law
Protoxus: Because of covid, the Danish government went "Our equivalent of the 4th ammendment? Yeah, doesn't apply anymore."
toxyviper: u being in Russia? SeriousSloth
ez_clappers_: i just want them to put more sand in the skate parks. fuck those skaters
jmp0ut: with socialism snowden would have his christmas coffee which is all he wanted
donasaurus: You can get out of student debt don't get a bullshit degree.
ofaas: in my country you should never talk politics to anyone ever because every second person is a government informant
birkett0011: bureaucracy
Eyachi: cause goverments can be good lol
balloonpopa: The US has class warfare
Eyachi: ours is just trash
mazsociety: plenty of countries may have freedom, but only 1 has in n out
Thotshotgg: HA
ofaas: jordan
jmp0ut: all Snowden wanted was to be home feel safe and have a coffee from his fav barrista
gaocaandra: i dont think it's as black and white
dr_set: That's Chomsky's opinion, not the media
deepfrieddeals: We need more anti government attitude. Too many are oblivious, worrying about superficial social bs
ahahahaitslit: ayy lmao
balloonpopa: This is class warfare, and my class is winning - Warren Buffet
Penguino138: Wonder how many sheep will convert compared to the 2016 election mess
borang: 1st year salary is like 2x college tuition + loans for rent and shit. dont get why ppl complain
lolzmaster99: You;re privileged
plazmacsgo: do you think we can be multi-planetary species ?
jmp0ut: buffett is an oldie foldie
balloonpopa: haha
rickoftheroot: LUL
Abnico: go to milwaukee george
azer0s: live in Austria. it's kinda great. so is Portugal and basically any other EU country. yes...you can't glorify WW2...so not free speech. but imo that's not as important to me as the other things I mentioned.
gaocaandra: how free is snowden?maning?schwartz?
skinnypuppy69: is privilege real
Penguino138: Paris is great
ez_clappers_: i just want them to put more sand in the skate parks. fuck those skaters
socialnotsocial: Thoughts on seasteading?
jmp0ut: schwarts is dead
Thotshotgg: Applied to Google today. Cant wait to get the rejection letter
calcmath: baster rest endpoints for food
guinness84: be honored i wrote this backend bro
balloonpopa: This is class warfare, and my class is winning - Warren Buffet
azer0s: @gaocaandra +1
lolzmaster99: Again, you're privileged
jmp0ut: manning is free
pwnbase: root vs user
bloodborne24: american clerks can be brusque but genuine
borang: @ez_clappers_ lol fuck you
DeeboMC: @guinness84 Lmao
jmp0ut: snowden is sitting in a pidgeon coop
pizzashotgun: george white george bad funny !
ahahahaitslit: or if you're good looking
kingvoneduard: Obama has privileges.
manorambo: did you see about that album of h4x0r r007z
727_tf: how do we censor the fake media oof
skinnypuppy69: i like this george guy
Jehhred: Lebron James kids have privilege...
deepfrieddeals: Privilege is real but it’s not as pervasive as purported.
toxyviper: Japan is the best country in a world, for Japanese KappaRoss @georgehotz
skinnypuppy69: hes smart
Abnico: george, stop mansplaning
alfyfav: If you're in that situation you're privileged to THAT country
worraaa: codejam 1C next week? Kappa
THX1342: 727_tf you don't censor.. you learn how to consume proper information
forkdb: One last question.... what advice do you give for a beginner programmer? To become an expert in problem solving and coding
dr_set: so you are saying that if you are white and middle class you get caught with a joint you get the same treatment that if you are black and poor?
Thotshotgg: George you should run for political office one day
gaocaandra: how free is snowden? maning? schwartz?
WiseSwift: Race does have an effect even when you normalize for income
cookienz: some people have never touched java
balloonpopa: This is class warfare, and my class is winning - Warren Buffet
plazmacsgo: how do you know if you are smart?
THX1342: 727_tf people need to get smarter instead of government censoring 'fake news'
jmp0ut: some humans are janked from the other priviledged, if you aren't stuck in a refugee deadzone eating reconstituted cardboard for govt subsidy handouts that pay the controllers exponentially greater sums
quinquanonagintilliard: @plazmacsgo my momma told me
jmp0ut: then it's a greedkeeping wageslavery to babyrun scenarios
plazmacsgo: @quinquanonagintilliard LOL
azer0s: do you think there is a "greatest country in the world"? if so, why that country?
Penguino138: @georgehotz do you think they'll open up international flights incrementally and slowly over time? How slow?
balloonpopa: haha
727_tf: @THX1342 wouldnt that involve schools, which have government involvement. Or would it be a person to person type of thing
plazmacsgo: I don't think you can really classify how smart a person is
bloodborne24: KKona
TheCellarDoor: Denmark
jmp0ut: mad lemur
jmp0ut: 2020
stone43_: Antartica, very few people
gaocaandra: the american empire will fall
gcbourdon: thoughts on trump?
patroniv: Biggest privilege, good looking, smart, or rich?
socialnotsocial: Thoughts on seasteading?
Protoxus: @TheCellarDoor What about Denmark?
Abnico: yang 2024
toxyviper: MingLee
jmp0ut: thoughts on COVID-19 from eating fruitbats?
TheCellarDoor: @Protoxus Greatest country in the world
rickoftheroot: LUL
THX1342: 727_tf you don't need schools if you have access to information (i.e. internet). the thing is most people including those who have access to great schools, choose to consume shit 24/7.
balloonpopa: What is more important clean water and reliable electricity... or 5G?
Protoxus: @TheCellarDoor I live there. It's really not.
rickoftheroot: marcus aurelius ftw
Santiago_LHC: Biden = Caesar Kappa
deepfrieddeals: George is so positive. Must be all that California sun ☀️
gaocaandra: we need globalism in the cloud bro
azer0s: how would you fix the education system for good tho?
Thotshotgg: I really want to go to the movies again.
toxyviper: Trump 2024 esy game KappaClaus
darthbearjew666: Is it possible to create true direct democracy by voting on blockchain ??
birkett0011: joe biden
gaocaandra: lets all share a server
bloodborne24: pax colombiano
METH_HEAD_MIKE: KKona thats trump
skinnypuppy69: what is "american prosperity/ the singularity"?
DeeboMC: Was the boat Scientologist?
Penguino138: Won't we not know its the empire until deep into it? Or after it falls?
TheCellarDoor: @Protoxus What do you think is the greatest county in the world? (Assuming there is such a thing)
pizzashotgun: imagine joe biden destroying trump
ahahahaitslit: the two front runners are biden and trump lol
Protoxus: @TheCellarDoor Switzerland
jmp0ut: Emperor Augustus started christianity by sending ferrets to eat the rabies rabbits
jmp0ut: way cooler
ahahahaitslit: what a joke
t0rment1337: they would put the caesar in jail before he gets anywhere near the power like shkreli
THX1342: a Putin?
azer0s: @thecellardoor Austria
TheCellarDoor: @Protoxus =) That's where i live
kingvoneduard: Joe Biden will lose nuclear codes in the bus toilet.
gaocaandra: whats a cesar? a fourth gen harvard atendee?
Santiago_LHC: They both suck
THX1342: ooohh Cesar not Czzar Kappa
Protoxus: @azer0s Nah, Austria's hate speech laws are very, very strict
jmp0ut: religion from rabies
newlifestartsnow: people hate Putin in Russia
jasondesante: one has dementia though
Trenz2: George do you watch Joe Rogan ? :D
FileTheSystem: the senate
gaocaandra: the MAN
METH_HEAD_MIKE: the deep state monkaS
guinness84: the DEEP STATE
ahahahaitslit: illuminati
gaocaandra: they are the man
plazmacsgo: there should be more popular/main parties
gaocaandra: bro
birkett0011: Everything is about individuals today. Not about the institutions behind them
socialnotsocial: Thoughts on seasteading?
DecayingSkullz: Marcus Aurelius' birthday today
lolzmaster99: Legitimacy should come from technical prowess/domain expertise
Krakatoa77: the lizard people
Protoxus: @TheCellarDoor Nice. I've heard Switzerland's education system is pretty messed up, but other than that I think it's a very nice country.
end_zeit: TheIlluminati
Penguino138: @georgehotz what would a Cesar look like policy wise nowadays?
azer0s: @protoxus imo...not a bad thing. it's not top priority *for me*
Thotshotgg: George, You are the Caesar lol
guinness84: 📐
jmp0ut: if everyone is the deep state then it's cool
kingvoneduard: Deep State is crap
toxyviper: SirShield defend murika
jmp0ut: mommy and daddy = deep state
gaocaandra: start the church
DeeboMC: What about the pentagon Microsoft cloud “scandal”?
gaocaandra: common
SOmedude456: what do you think about the rothschilds
balloonpopa: A blank vote is a protest vote... stay engaged, but vote for no one if a viable candidate is not presented
Protoxus: @azer0s Yeah, good point.
calcmath: would blockchain be the casesar?
patroniv: The Karen’s
Trenz2: the caesar of computers then :D
THX1342: how can you be pro-freedom and at the same time hope for a dictator? I don't get it
DeeboMC: Bro...
ahahahaitslit: any thoughts on stephen wolfram's physics announcement?
kingvoneduard: Soros made the virus with Bill Gates
norB88: who's spartacus
gaocaandra: let's go to the desert and smoke toads
balloonpopa: haha... think about it
skinnypuppy69: use your own brain to vote who wants what you want
stone43_: more muzero, less not muzero
THX1342: because you can't question a dictator
routerkicker: do you think some people have access to every computer system in the world if they wanted?
Thotshotgg: By definition
THX1342: you obey and that's all
Penguino138: @georgehotz where on the political spectrum would be a caeser?
plazmacsgo: well because he has all the power
kingvoneduard: Kim Jo if he survive can be the next Dictator
DeeboMC: https://www.bitchute.com/video/fVoOoiwA10ql/
calcmath: would a muzero like algorithm eventually run corporations and countries?
quinquanonagintilliard: Why dictator? what about king?
prakyath_kantharaju: How can there be a dictator with freedom
lolzmaster99: Yeah please increase paper streams
skinnypuppy69: if a dictator is a good idea then why not go to russia or china?
l1ght5p33d: Asassinated
TheCellarDoor: @Protoxus It is a very nice country. Our education system certainly can use some improvement. I love our political system. But your healthcare system is the best in the world.
azer0s: @protoxus I mean...I can see that other people might see it differently. "That's just like...uh...my...uh...opinion man"
THX1342: no, they outsource that to local powers
lolzmaster99: i will subscribe for paper streams
gaocaandra: we need a multivac dictator
cookienz: yeah north korea have loads of freedom right guys
qlutoo: Tech CEO Monarch
prakyath_kantharaju: a dictator can kill his opponents
names_for_noobs: The dictator doesn't have to be a tyrant
DeeboMC: DEMOCRATS AMBUSHED OVER ISRAEL &amp; MICROSOFT &amp; PENTAGON CLOUD SECURITY
qlutoo: Tech CEO Monarchy
GandalfTheGrayOfHell: https://youtu.be/Ir7wCAQINqw@georgehotz
thuganalyst: imo the dictators of UAE are alright
skinnypuppy69: then why is russia so horrible they have a dictator
ahahahaitslit: how can anyone ensure a dictator wouldn't be a totalitarian
l1ght5p33d: we will make them fear us
ahahahaitslit: that's the issue
darthbearjew666: REPLACE ALL THE CONGRESSMEN WITH AI WHO VOTE BASED ON BLOCKCHAIN VOTES FROM THEIR CONSTITUENTS?
Santiago_LHC: Nancy Pelosi is playing animal crossing right now
l1ght5p33d: ::: drones :::
WiseSwift: A dictator prevents a better dictator from taking over
GandalfTheGrayOfHell: @georgehotz https://youtu.be/Ir7wCAQINqw future PogChamp PogChamp
Protoxus: @TheCellarDoor The waiting times can be really bad here. And I don't think our extreme tax rates justify the health care. But yeah, it works pretty efficiently with regular doctor appointments
74c55639: he has full power to design the system that will have full control over your life, he doesn't need to personally micromanage your life.
tripcloth: nancy palosi and zuckerburg have the same lizard dna for sure dude
deepfrieddeals: Nancy is passed out from drinking right now
calcmath: have you watched Westworld?
DeeboMC: DEMOCRATS AMBUSHED OVER ISRAEL &amp; MICROSOFT &amp; PENTAGON CLOUD SECURITY
Penguino138: So the US is still a republic yet we have military bases everywhere and attempt to overthrow govts?
darthbearjew666: REPLACE ALL THE CONGRESSMEN WITH AI WHO VOTE BASED ON BLOCKCHAIN VOTES FROM THEIR CONSTITUENTS?
DeeboMC: “American Jewish activist Jeremy Rothe Kushell ambushes Democrat presidential hopefuls on the issue of The Pentagon Cloud and American national security with regards Israel. This is amazing historical footage. ”
plazmacsgo: our caesar will be an AI lol
Mrclutch963: What do you think about what happened in North Korea? @georgehotz
jmp0ut: vasectomy?
gaocaandra: jajaajaajaaj
THX1342: I do frequently think about that... how 'to solve shit we need a dictator'... but I can't live with the thought of living under one... coming from a country that had military dictatorship recently
kingvoneduard: A Dictature is disfunctional because everybody wait for the Dictator to take the decision.
skinnypuppy69: half of this chat wants AI to rule all lol
gaocaandra: wtf
M0gami: @georgehotz how hot is new North Korean leader on scale from 1 -10 ?
DeeboMC: https://www.bitchute.com/video/fVoOoiwA10ql/
WiseSwift: Bring dan carlin on the stream
balloonpopa: Coumo may get assassinated... or disappeared
l1ght5p33d: wtf
QUOTE_IF_NEXT_YEAR_BETTER: do you think china has developed technological singularity?
thuganalyst: Have you considered beating the stock market using AI?
Lourned: isnt he the guy who murdered germans?
DecayingSkullz: what are your thoughts on drone technology?
socialnotsocial: What do you think about seasteading?
balloonpopa: The down fall of the Roman empire was lead poisoning
AveonGOJO: china isn't real
norB88: read Isac Asimovs Foundation series? Maybe need a side thing going on as he had it there.
plazmacsgo: @thuganalyst many have tried
THX1342: absolute power corrupts absolutelly
stone43_: AI can't beat the stock market
DeeboMC: Do you not want to talk about that?
Penguino138: Dont we have more military bases than all other countries? And try to topple other govts?
l1ght5p33d: 1) get fake money 2) cure all the things
gaocaandra: people in flint got dat fre dom
azer0s: no but for real...how would you fix the education system for good? Because I 100% agree that in it's current form it's a scam that's not meant to educate but to pull money out of people's pockets. but what's the solution?
tkdboy555: look up the song technocracy by samsa
Goooshlrific: what is love?
l1ght5p33d: Like Elon have to get the money first
plazmacsgo: don't u think we should have an AI as a president?
l1ght5p33d: its required
Krakatoa77: Well caesar was killed before it could've become worse
kingvoneduard: Cesar was only for some 10 years before they kill him.
THX1342: Alexander the Great was pretty chill
bloodborne24: CROSS THE RUBICON SwiftRage
Lourned: Nero was the best Kappa
ahahahaitslit: facts don't care about your feelings
pwnbase: Beware that, when fighting monsters, you yourself do not become a monster... for when you gaze long into the abyss. The abyss gaze back into you
newlifestartsnow: What do you think about AI bots beating Dota 2 pro players?
darthbearjew666: Geohot for Prez
gaocaandra: claudio
stone43_: Make everyone drink Brawndo
deepfrieddeals: That’s the hypocrisy of the blaming the Russians for the 2016. We’ve been installing dictators and US-friendly regimes for 100 years and we’re angry we got a taste of our own medicine?
t0rment1337: the banter between republicans and democrats keeps america going tho
Penguino138: @georgehotz What kind of policies would a 21st century Caeser type champion?
skinnypuppy69: if dictatorship was so good then why hasnt it worked since roman times? @georgehotz
gaocaandra: claudio was the vest
Trenz2: Dude its not going to be in this modern world , it cant be ... not possible
prakyath_kantharaju: the dictator will be good if he/she has no power of the financial market and free speech
14btw: who says he didnt?
axlebear: What would happen If China develops real artificial intelligence first?
DeeboMC: China spies on Israel to get US’s secrets.. you see a problem there?
Lourned: I mean anyone can influence the US election not just Russians
THX1342: deebomc everybody spies on everybody else
GandalfTheGrayOfHell: There is nothing wrong with spying
THX1342: USA is influencing elections all the time all around the world LUL
gaocaandra: of course it isn't the same the context is vastly different.
DeeboMC: That’s not my point @thx1342
calcmath: there werent other republics inthose though
dr_set: The British Empire had a dictator, it depends on what you call "worked fine"
azer0s: @skinnypuppy69 doesn't the saying go like "democracy is bad but it's the best we got"?
jmp0ut: @deebomc nothing wrong, Israel is so greedkeeping they murdered Aaron Swartz with policymaking
Thotshotgg: People really do be drinking bleach doe. smh.
Penguino138: What were Caeser's plitical views?
Suspecthum: Augustus FTW
deepfrieddeals: China won’t develop real AI first. George will.
verxile: whats up, whats the goal for tonight?
skinnypuppy69: @azer0s havent heard that saying but go on
jontowtruck: did he ever solve cartpole?
plazmacsgo: wouldn't it be cool if we can make an ai that learns from history and predicts the most probable outcomes fro a given situation or something like that?
Protoxus: @jontowtruck Yes
DeeboMC: @jmp0ut @thx1342 https://www.bitchute.com/video/fVoOoiwA10ql/
jontowtruck: atta girl
jontowtruck: nice
kingvoneduard: Cesar fucked Cleopatra
just_a_coder: bro you are awesome
jmp0ut: that video doesnt load for me
chupakraw: thats a wierd looking protien
jmp0ut: dunno
Mrclutch963: do you trust wikipedia? @georgehotz
l1ght5p33d: Is the shadow government wheel
just_a_coder: bro you are awesome :)
l1ght5p33d: does anyone know linux well enough
skinnypuppy69: i came for the code, but stayed for the questions
gaocaandra: of course it isn't the same the context is vastly different.
therealariel666: You have the 16inch Mac right?
bloodborne24: ai F1 racer Kreygasm
lolzmaster99: Read Francois Chollet's paper on AGI to get persepctive
Thotshotgg: What ignited your passion for AI?
ez_clappers_: @georgehotz when will ai be better than people
lolzmaster99: Michae Jordan has the right idea about ML
un3okapi: do you know what a simp means?
Penguino138: Make AI Caeser
ahahahaitslit: what if it's american putin
gaocaandra: elon should
just_a_coder: @georgehotz bro you are awesome bro
THX1342: @georgehotz if AGI happens do you think it's a 1st mover takes over the world kind of deal?
Santiago_LHC: Anakin Skywalker moment
QUOTE_IF_NEXT_YEAR_BETTER: that's because humans are bad at developing AI, you understand how evolution happens right bro?
74c55639: @georgehotz do you still hold the hope for a self-driving car, or did that fade away?
axlebear: As in an AI that can improve its own code
plazmacsgo: well a president doesn't really have to be smart he just has to hire smart people
Trenz2: The AI Caesar LUL
gaocaandra: all hail elon
Lourned: Trump used to be smart, now he is 80 years old FeelsBadMan
kingvoneduard: Kim Jon Un would be a fat Cezar if he survive
azer0s: @skinnypuppy69 yeah...I think Churchill said something about democracy being the worst form of government except for all other forms of government and I kinda agree
prakyath_kantharaju: AI is good in confined boundary and very well defined rule system
Penguino138: @georgehotz Would this Caeser be a left or right wing?
kevin21071: What about the show Devs Geroge? They predict the future there Kappa
deepfrieddeals: Term limits
cookienz: Caeser! powered by a intern that took discrete maths
just_a_coder: bro you are awesome
jmp0ut: i'm waiting on synthetic sapient sentient artificial intelligence with the ability to spin up time cycles
Mrclutch963: how powerful is AI really? @georgehotz
THX1342: trump is rich, not smart
Gamer_nohope: Caeser 2.0
Trenz2: Ego Maniac ?
jmp0ut: i heard soulmachines.com is trying for it
THX1342: LUL
FileTheSystem: there are many people with Ceasar attributes but they often make it in private sector rather than risking their talents in politics
verxile: do we need self driving cars, or should we plan on self driving flying taxis
balloonpopa: The Roman empire lined thier acueducts with lead paint... that was thier downfall
ahahahaitslit: why the hell are the two frontrunners 80
jasondesante: Trump is the King of Ventilators
jmp0ut: DNA spooky action at a distance with 5G technology
DeeboMC: Talk about it: DEMOCRATS AMBUSHED OVER ISRAEL &amp; MICROSOFT &amp; PENTAGON CLOUD SECURITY https://www.bitchute.com/video/fVoOoiwA10ql/
jmp0ut: optogenomic warfare
gaocaandra: there is a letterman interview were you see trum on his element
balloonpopa: lead poising
gaocaandra: the guy is from a different time
plazmacsgo: @Mrclutch963 no as much as you think probably. it needs a lot of data and other restrictions
THX1342: LUL
lolzmaster99: Can you talk about the application of RL to self-driving as far as where in the model pipeline it fits? Are you guys working on it yet?
Santiago_LHC: Elon Caesar?
Pr0ject414: he cant he isnt natural born citizen
jmp0ut: Elon Musk does what royalty should do
birkett0011: IN MUSK WE TRUST
kingvoneduard: Elon Musk would send everybody on Mars
jasondesante: LUL Elon would not want to waste his time doing that
darthbearjew666: Agreeeeeeeeeed
plazmacsgo: @georgehotz Elon must is definitely a good choice
Trenz2: @georgehotz what about Elon be the president of US ?
QUOTE_IF_NEXT_YEAR_BETTER: stephen hawking
plazmacsgo: musk
skinnypuppy69: @azer0s im failing to see how other forms of government supersede democracy, when democracy == freedom of thought and for it to be heard
Lourned: Elon Musk president of Mars LUL
Penguino138: Definitely need to look up what political views Julius had now
gaocaandra: there is a novel where the dictator of mars is titled elon
jmp0ut: what kind of kings and queens sit around getting fat off chocolate bonbons
Faceless_Bard: 'natural born' lol
THX1342: His plan is Emperor of Mars
kingvoneduard: Elon Musk will be the Dictator of Mars
jmp0ut: instead of doing elon musk work
Pr0ject414: if we arnt talking about president then theres a discussion LOL
jontowtruck: do you think trump will push for an armed conflict against china to gain support for november
deepfrieddeals: Is Musk still seeing that Grimes chick?
plazmacsgo: do yoiu think we will be able to colonize other planets?
quinquanonagintilliard: Dicator + mars = mad max
Pr0ject414: he could certainly bomb us
skinnypuppy69: @jontowtruck no
FileTheSystem: these people are smart they know better ways to spend their time rather than in politics
jontowtruck: lmao
JdPaulBlart: mars is the neww epstein sex island but its elon musk and bill gates
Mrclutch963: do you trust wikipedia? @georgehotz
thuganalyst: man I just wanna have infinite catgirls in my BMI VR
azer0s: @skinnypuppy69 yes...that is what I said. democracy is better than everything else. it's just still not good.
QUOTE_IF_NEXT_YEAR_BETTER: overt war is dead
azer0s: the thing is...if musk were to take over the government...he'd have a plan.
ahahahaitslit: epstein did not kill himself
Santiago_LHC: Have you seen the show DEVS? It's about determinism and an experiment with a quantum computer to recreate reality in a simulation.
fedexkinkos: why u learning this , learn react instead
prakyath_kantharaju: musk has created more jobs and more money in US than trump
forkdb: What if Elon buys comma in the future? Any thoughts
Trenz2: why arms ? why wars ? why this sheet..
Jehhred: Watching the conference with Jack Ma and Elon Musk is hilarious
bloodborne24: speak softly and carry a big nuke
kingvoneduard: Trump and Xi are best friends
skinnypuppy69: @azer0s ahhh i see. its hard to read what you said when chat keeps moving
Pr0ject414: just waiting for north koreans to find out he does infact have a butthole.
DeeboMC: Bro... is anyone willing to talk about this.. this video was removed from YouTube Talk about it: DEMOCRATS AMBUSHED OVER ISRAEL &amp; MICROSOFT &amp; PENTAGON CLOUD SECURITY https://www.bitchute.com/video/fVoOoiwA10ql/
gaocaandra: well china is pretty "agressive"
Penguino138: @georgehotz How long until the people on mars form their own sovereignty?
Eyachi: 16 years.
socialnotsocial: Make deepfake of political leaders recommending citizens drink 1 liter of bleach for virus immunity. Witness natural selection in real time. B)
t0mmv: which gpu are you using?
calcmath: washington was also a caesaer
skinnypuppy69: @azer0s yes i totally agree, everything can be improved, complacency is a sickness
azer0s: @skinnypuppy69 +1
balloonpopa: History repeats itself... it's like a pendulum
gaocaandra: peron was a cesar
l1ght5p33d: no one is really going to want to live on mars
fedexkinkos: what is a caesar?
l1ght5p33d: its going to be military and science and industry only
forkdb: What if Elon buys comma ? Your thoughts....?!!
Pr0ject414: there was no limitation on those presidents though (Constitutionally)
DeeboMC: Let’s watch this video please Talk about it: DEMOCRATS AMBUSHED OVER ISRAEL &amp; MICROSOFT &amp; PENTAGON CLOUD SECURITY https://www.bitchute.com/video/fVoOoiwA10ql/
Eyachi: FDR was really good, need another person who cares about social issues as much
dr_set: Argentinian President
gaocaandra: o boi
Penguino138: It's crazy to think one day there could be a whole different clad of humans who have lived on mars for generations and is way different
Santiago_LHC: Ha, Peron
gaocaandra: hes the spice of argentina
skinnypuppy69: @azer0s +1? haha
kingvoneduard: Evita Peron was the dictator of Juan Peron
DecayingSkullz: ban deebomc
fedexkinkos: can anyone explain what a caesar is?
balloonpopa: haha Pero... no way
THX1342: Peron LUL
pwnbase: chat extra'd af
henryy95: !UPTIME
plazmacsgo: @forkdb he won't buy comma
plazmacsgo: he has autopilot
Lourned: Putin is god king pretty much, he is in power 20 years now
Pr0ject414: its a salad
skinnypuppy69: @georgehotz any ideas for my new raspberry pi??
crawcraw66: lmao
Faceless_Bard: its a salad
jontowtruck: it's like a chad
M0gami: Its a Salad 4Head
azer0s: @skinnypuppy69 I am agreeing with you lol
calcmath: caesar is a czar
rickoftheroot: caesar is a kaiser
Gamer_nohope: superchad LUL
DecayingSkullz: gn
balloonpopa: lol
THX1342: gn
azer0s: @skinnypuppy69 k8s cluster!
Suspecthum: Nooo
Santiago_LHC: Caesar is like the salad, minus the salad.
Thotshotgg: We love you
zounonz: gn
FileTheSystem: Cool hanging out here, later
unluckychickenn: squadL
Trenz2: gn
socialnotsocial: gnight geohot :)
Adictos: good morning
blndv: hi
liqo13: ay whatsup
lebop: hi first viewer
fadihirmiz: suh dude
InfiniteReddit: hello from aus
pioterexe: sup
the_benju: Letsss goooo
great_said: hi
LiveMahs: In hereeeee
singularitytoatea: Goooood mooornning
rmvaldesd: Hi!
cod4_lightning: 3 streams in one day oh yeeaaah
aiex42: Good mornin bro
lebop: hi from brazil
senad20: Hello from Germany
ionelaipatioaei: no more bio?
achamorro008: hello from Nicaragua
32bitrobo: good mornimg
grekler3: PogChamp
Deno_____: senad iz njemacke
knilecrack: nisi valjda
Deno_____: aaaa
Jehhred: That was a quick 7 hours
knilecrack: :D
0xtf: Hey George!
Deno_____: excuse me lord
grey_street: hello!
niceonesonny77: LETS GOOOOO FINALLY SOME CODING LIVE
ogrockefeller: Daddy Hotz
hanisa1: george will you marry me
aiex42: Canadian english?
thedevway: hiiii. this is the first time i'm watching you live instead of recorded streams on youtube :)
knilecrack: what if subbs speak non-english only?
DzyaN_: masonxdJoy
cod4_lightning: would you do hackthebox today? it was awesome last time!!
Deno_____: george please add this to your reading list kalam cosmological arguments by mohammed hijab
great_said: SwiftRage
funwayz: already a sub only chat threat :)
dalvasorsali: morning
InfiniteReddit: George where do you browse papers?
ad5k: Good morning
cutza: sweet
TheSkapegoat: good morning King
dinxpoy: did he upload the coronavirus vaccine on github or not yet? God save us all 🙏
lambdaman0f: hey george. how is backspace.ai going?
maxschneider96: @InfiniteReddit just google the stuff, otherwise u can use scholar as well, or libgen.is for instance
St47ik: Morning Broskies SeemsGood
niceonesonny77: are there any tips you would like to give on who wants to become a computer scientist?
litesam: What is muzero!?
cutza: free books
jaxotp: How are u doing George?
braininavatt: George!
bsx1123: torrents for books
maxschneider96: yeah free books
Sylens__: hello @georgehotz
grekler3: LUL chat stfu
blackskill224: blackskill224 subscribed at Tier 1. 
St47ik: Just follow your passion bro 4Head
squiggly_nibba: What are you building?
dinxpoy: how do I code my first hello world program in Python?
dhevinn: Bruh sub tokens kinda expensive
OFFICER_KKONA: @squiggly_nibba cmonBruh
singularitytoatea: Let me try you geo. Whaat keyword do you use ? 😂
St47ik: oh no not the K word
singularitytoatea: 😂
yungtoad1: j
squiggly_nibba: @OFFICER_KKONA is there a problem officer
mistertenko: Kreygasm
St47ik: L-Theanine Kreygasm
dinxpoy: does a good keybοard make a programmer better?
tinkerzwhothe_t: LETS LEARN PYTHON 3!!!
Jehhred: I think people just want the holy bible of projects they need to complete (copy and paste) to get a job. i.e. they want the get rich quick scheme to become a developer.
MrVitoDayz: yo hey @georgehotz :)
Vukasin22: are you more productive when streaming?
OFFICER_KKONA: @squiggly_nibba perhaps greekGordo
TheSkapegoat: @dinxpoy print("hello world") if you are being srs lol
ImJ4Gu4R: ImJ4Gu4R subscribed at Tier 1. They've subscribed for 3 months! hello
St47ik: HeyGuys
shiz_z: yoyoyo
wajsic: Is that Herman-Miller chair?
Faceless_Bard: unless you are running adds , putting subs only is a good idea, to avoid stupid questions SeemsGood
maxxg: Sayl chair
Deno_____: lol
cod4_lightning: can you show your mac dotfiles?
shissle: it sounds good
St47ik: What's in the fridge LUL
squiggly_nibba: Start handing out bans for dumb questions
iammrrob0t: Is it allowed to ask which mouse he is using?
oreid52: For those who don't know MuZero is an algorithm that when it's combined with monte carlo tree search (MCTS) has state of the art performance on a range of atari games
litesam: What does muzero do!?
mistertenko: Let's take a minute of silence for Kim Jong Un
funwayz: this stream became too popular to be good :)
chillguy269: Does that cup make you a better programmer?
marvluebke: does your hair product make you a better programmer? Kappa
St47ik: Chat stop NotLikeThis
eldac_kno: cause you are an icon
chillguy269: monkaW
jkfsda: most of these cringe messages are probably just kids
oreid52: It's described in DeepMind's paper https://arxiv.org/abs/1911.08265
mugichkablya: I care abut code. Just code damn things
Faceless_Bard: lol good luck with that
Lost_x_Echo: Lemons. Lemons everywhere.
namenamison: Any book programming or cyber security recommendations?
ImJ4Gu4R: chewing ice in the morning? ResidentSleeper
gasman1017: gasman1017 subscribed with Twitch Prime. 
Pabgp2000: gxpHey
MrVitoDayz: what's the aim of this stream today? Still biopyhton ?;
InfiniteReddit: you did
braininavatt: PogChamp
St47ik: Scam Train PogChamp
cod4_lightning: can you show your mac dotfiles?
Deno_____: george if we are in a simulation who created the people who created the simulation
braininavatt: HYPER TRAINNNNNN
litesam: Monte Carlo Tree Search @oreid52 could you explain about that!?
shiz_z: HYPE
the_benju: Some are trolling u
InfiniteReddit: look up your old internet history username
dalvasorsali: It's as you said, mysql vs postgres or what color should the walls be painted in
niceonesonny77: but you just gotta understand there are lot of people out there who really inspires model and even a role model for some
tangobeer: !uptime
Sylens__: hello
cod4_lightning: can you show your mac dotfiles?
Pabgp2000: just joined, anyone can give a quick summary of whats going on?
eldac_kno: probably there are lot cringe messages by george on anime boards
St47ik: Wise SeemsGood
vloodp: Amen to that
CJslider14: off that real
TheSkapegoat: Hey George, I am a dumb person and can easily tell you the reason why we ask dumb questions is because we think intelligence comes from your personal gear and tastes.
ky0jinjaeger: "there is no such thing as a stupid question, only stupid answers" true or false?
CJslider14: oof*
mistertenko: opinion on latest Tesla software update
chillguy269: Lol
DzyaN_: LUL
shiz_z: lol
marvluebke: even rick might let you down
MJT_au: We just got roll ricked
oreid52: @litesam I'll try and explain as concise as possible. One sec
great_said: you're honest SeemsGood
ky0jinjaeger: LMAO
St47ik: Hippies 4Head
tangobeer: for how long will u be streaming?
cod4_lightning: can you show your mac dotfiles?
markov010: hello !
mlgboy777: how are you geohot?
Deno_____: george I wrote rock paper scissors in python in maybe 2 weeks of coding am I doing well
Jehhred: "People will always let you down, except for Rick Astley" ~ 13:4 Corinthians
tex01: hi
worraaa: monkaS
tangobeer: Could you suggest the best way to get started with data science?
maxschneider96: How´ s the protein folding going?
St47ik: PogChamp
braininavatt: PogChamp
mlgboy777: pog
zennydmt: can u explain how game trees work?
chillguy269: Viewer count is about to drop hard with all these bans coming down
jaxotp: XD
mlgboy777: daym
ImJ4Gu4R: PogChamp PogChamp
braininavatt: SMART AI
Deno_____: HEY THATS illegal
braininavatt: PogChamp
eldac_kno: this is not a stupid question: is this a stupid question?
tex01: ahaha
St47ik: PogChamp PogChamp
BlLL: AI PogChamp
cutza: that AI is insanely powerful
grekler3: WTF PogChamp
zennydmt: whats a game tree
markov010: This is real Deep Learning
ky0jinjaeger: SKYNET
mlgboy777: 2 Weeks of coding lmoa
ZestyZapus: ZestyZapus subscribed with Twitch Prime. 
St47ik: Singularity PogChamp
tangobeer: wow
Vukasin22: it's .34 for rock
NixOTrix: wtf was that lmaoooo
gasman1017: Finally sold out and did a web dev bootcamp at 30. Wish I started coding when 20 years ago
pintwenty: Hello
InfiniteReddit: worrying about numbers
zennydmt: have u tried nootropics
namenamison: Can you give some book recommendations on programming or cyber security. Also what questions would you want for us to ask?
CJslider14: butal honesty is efficient period but hardly used in business its lame but refreshing here
LaheyFPS: george doesnt give fucks
catacata92: do this on your chess game ?
marvluebke: I'm very mediocre
jaxotp: I love your attitude.
Mint2bSpiced: Maybe use Nightbot to write answers to commonly asked questions, or FAQ ?
eldac_kno: is this chat a democracy?
braininavatt: AGI ACHIEVED PogChamp
Andremm2: thoughts on quantum computing?
markov010: How can we buy this Rock Paper Scissor software ?
Faceless_Bard: let me duckduckgo it and return with an answer
Deno_____: george real quetion what do you think does god exist
InfiniteReddit: you call the cyber police
St47ik: 300 viewers = more moneyz LUL
anthonykwan: Some ppl are seeking someone to guide, they don't even try to think more, I guess ?!
zennydmt: what do you think about Google Chronicle?
chillguy269: I would but I am afraid I'm going to get banned
NixOTrix: cyber bullying
great_said: this is first time I've been at your stream, and I'm super happy DendiFace
hookedoninfinity: cyber security is hacking for script kiddies
braininavatt: ask him what he thinks about anarchism Kappa
newlifestartsnow: @gasman1017 sold out wahat
MrMemetic: u use cyber- before everything
1ntegral_: best books on MACHINE LEARNING ? @georgehotz
技術宅: could make a pseudorandom script to determine if questionable messages get banned
eldac_kno: america is a police state lol
CompestLive: hey
litesam: Scientology!?
mistertenko: Your cult!
St47ik: Chat NotLikeThis
shiz_z: It's like when you in security but it's cyber basically a brainless job
newlifestartsnow: cyber sports Kappa
juviin: cybersecurity sells better to ppl who have no idea what programming is
calebsuhy: buzzword for “ethical hacking”
InfiniteReddit: cybertruck?
fadihirmiz: bro they are leeching your time...
Avelansh: cyber bully?
MJT_au: cyber-netics?
liqo13: cybernetics was preety cool
gasman1017: @newlifestartsnow to the bootcamps
bloopsterr: cybermen
Deno_____: @georgehotz thoughts on mainstream religion?
singularitytoatea: Wow chill
catacata92: cybertron it is angry
singularitytoatea: Chill
1ntegral_: best books on MACHINE LEARNING ? @georgehotz
eldac_kno: i dunno dude, sony ericsson cybershot was good
zennydmt: im surprised you dont build trading systems
78DHF: have you ever explored cyberspace before?
St47ik: Cyberpunk Kappa
singularitytoatea: My name is cybernoa
cod4_lightning: "Don't be inspired by people be inspired by ideas" That's islamic!
MrMemetic: cyber-chill
技術宅: Bible
markov010: Your rock paper scissor soft has just been nominated for Turing Awards
caslecasle: This reminds me of the good old Twitch Slam rants.
shiz_z: cyberjunk
MJT_au: cyberlink power dvd
generated_human: Cyber memes
zennydmt: do you have interest in building trading systems
marvluebke: put those rules below your stream
abhi1o1: ahh nothing like streaming a video at 50kb/s
ImJ4Gu4R: George watcha ur doing?
0xC3301: 0xC3301 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 4 in the channel! 
yungtoad1: ☠️
0xC3301: 0xC3301 gifted a Tier 1 sub to marvluebke! 
clicclic_boom: When are you starting your cult?
0xC3301: 0xC3301 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
0xC3301: 0xC3301 gifted a Tier 1 sub to maxxg! 
St47ik: PogChamp
gasman1017: hey guys, how hard is python to pick up with solid foundations in JS/TS?
tangobeer: wow
Deno_____: @georgehotz do objective morals exist if theres no god?
marvluebke: @0xC3301 &lt;3
LaheyFPS: Hype train PogChamp
braininavatt: PogChamp live edition of Channel Description
marvluebke: yay
anthonykwan: Ray !
MrMemetic: @clicclic_boom did you mean cyber-cult?
ianhilt: how much code can you get the bot to write for you
ky0jinjaeger: LUL
great_said: pytorch or tensorflow?
St47ik: Doing it live PogChamp
xloveyourmama: xloveyourmama subscribed at Tier 1. 
braininavatt: this is part of history chat Kappa
litesam: Hey George, could you do from transistor to browser
marvluebke: perfect
cutza: lol
his_futon: lol
snowbola: why would you even bother doing anything with your time when you could not do it?
matikitli: Yo man! Know you have not been long in Google, but any things you can just say to someone who wants to work there, besides of: yeww need to doo codfin well. &lt; this is not a stupid question, no ban for me &gt;
St47ik: PogChamp PowerUpR
eldac_kno: what are your thoughts on thoughts?
Scylet: !uptime
gasman1017: how many WPM can you type @georgehotz
braininavatt: brb will implement MuZero in Rust Kappa
oreid52: MCTS is basically a tree search algorithm that is used to figure out the moves (or the path down the tree) that the policy tells you to do to reach the best final state. You can think of it as a way to learn the rules of the game by projecting out the paths (moves) from the current state and choosing the best path
Faceless_Bard: @georgehotz put an example i.e
ck1956: hypetrain buoy
1ntegral_: Is this a stupid question ? @georgehotz LIUL
ImJ4Gu4R: lewl
1ntegral_: LUL
cod4_lightning: "Don't be inspired by people be inspired by ideas" That's islamic!
maxschneider96: banning people with stupid questions, nice project idea btw
4zimut: someone make a faq
rudolphdoesgames: wait a second was that a carlsagan42 stream there?
Deno_____: @georgehotz do objective morals exist without god?
namenamison: Isn't asking dumb questions the way to learn what questions are dumb and what smart?
St47ik: Level 3 PogChamp
singularitytoatea: When you speak slower than you code
newlifestartsnow: @gasman1017 started at 30 y.o.? are you employed?
NixOTrix: SirSword
oreid52: That's a gross oversimplification but I hope it gives an idea lol
niceonesonny77: @namenamison such a solid point fr
NixOTrix: SSSsss
Deno_____: @georgehotz do objective morals exist without god?
eldac_kno: define stupid questions
eldac_kno: yes
cleofn: FeelsBadMan
brofessorbob: Would have thought hotzbro would be on linux.
cleofn: FeelsBadMan monkaS
gasman1017: @newlifestartsnow just doing some contract stuff on the side. This pandemic isn't doing me any good with job searching
eldac_kno: maths can't be done without definitions
airinspiration_: !uptime
brofessorbob: Any l33t hackers in chat?
ak0ya_: Morning chat and George
bluechains: mac or windows and why
braininavatt: !todaysgoal
St47ik: morning
namenamison: Also people teach me the smart questions so i don't get cyber bullied
ck1956: arxiv beauty
NixOTrix: bruh I'm so tired of these try hard linux kids, soz I'm not running a bleeding edge test bench. acknowledge that theres a different tool for different jobs and move tf on
newlifestartsnow: why he use jupyter
ck1956: youre echoeing
InfiniteReddit: (mega brain question) it's getting late, and I need to know is it worth staying up for?
Deno_____: @georgehotz kim jong un died
Deno_____: HE DEAD
eldac_kno: ok?
borang: good morning
ck1956: problem with sound
St47ik: @InfiniteReddit you can always watch the VoD
bloopsterr: why are you up so early? i thought you were a hacker
rudolphdoesgames: @ck1956 nope
TheKoreanZombi: @ck1956 No problem with sound
brofessorbob: Real hackers wakeup early
InfiniteReddit: @st47ik true, imma sleep then
eldac_kno: george isnt reading chat now, but he is qt
St47ik: Kappa
Deno_____: qt like my athletes foot
namenamison: btw i am miles away from understanding what he is doing, can somwbody give me a short explanation?
eldac_kno: trying to implement muzero by himself
blackskill224: fap
niceonesonny77: hi
great_said: muzero?
St47ik: @namenamison A.I super intelligence singularity implementation
brofessorbob: Trying to balance a cart pole bro
MrVitoDayz: I will try this too
maxschneider96: When will AI brothels come?
dalvasorsali: what happened to v1 and v2?
Deno_____: @georgehotz DO objective morals exist without god
eldac_kno: just another ai crutch
eldac_kno: yes they do exist, stop asking this question
hookedoninfinity: anything on github?
Deno_____: prove it
dinxpoy: @deno bro stfu already
oreid52: @namenamison MuZero is DeepMind's state of the art algorithm for creating models that play games like Go, Chess, Atari at a superhuman level
great_said: i just miss coronavirus stream NotLikeThis
brofessorbob: Who thinks the VC money in AI bubble is going to pop this reciession?
Deno_____: george can you hack my cousins instagram i think shes cheating on me
MrVitoDayz: @brofessorbob poop is the right word
Deno_____: girlfriends*
lenindeluna: i just miss coronavirus stream x2
namenamison: Thank you
Killon1: @Deno_____ so funny
eldac_kno: axioms dont need proofs, i declare objective morals are axioms, therefore no proof need, now stfu
Deno_____: @georgehotz so murder is alright?
blackskill224: Im writing a shell script that makes moaning sounds when i touch lenovo clitoris button
brofessorbob: @MrVitoDayz AI == poop?
eldac_kno: ban deno plz he is asking stupid questions
minecald: Would it be possible to break out of a simulation during/after a big freeze universe?
fkingplay3r: yow hes been streaming for how long
snowbola: @georgehotz why would you bother doing anything when you could just not do it?
TheKoreanZombi: Let's go subscribers only chat. Much less dumb.
Deno_____: koreanzombie ure not koreanzombie
eldac_kno: imaging ask on twitch about objective morals
niceonesonny77: 한국인 ㅅ?
RexSonix: when we hacking nsa
Harm133: What are you using Muzero for ? What will it learn
Shelledlizard4: hey
tangobeer: wow
tangobeer: do u live alone
Deno_____: I mean those are very important questions
newlifestartsnow: how to be focused like this guy
maxschneider96: finally
Jehhred: Can confirm, lost IQ points reading
rudolphdoesgames: :(
blackskill224: Failfish
TasosTheLord: ResidentSleeper
Jehhred: Where are the mods?
eldac_kno: mods are asleep
gigafact: wow still going?
blackskill224: hey non subs. do you have any tips on how to construct dumb questions?
eldac_kno: by constructing non smart question, duh
TasosTheLord: Subs = dumbs with money 4Head
MrVitoDayz: MrVitoDayz subscribed at Tier 1. 
ak0ya_: chat does not look much better
eldac_kno: subs=perfect people
MrVitoDayz: @georgehotz have you tried using alphago from deepmind yet?
x_algorithm: x_algorithm subscribed with Twitch Prime. They've subscribed for 5 months! 
maxschneider96: Have u worked with Neural ODEs yet?
Joooooooooonas: thank god that you are streaming again
blackskill224: I swear im becoming more and more autistic bcoz of this isolation.
MrVitoDayz: alphafold* not alphago
gasman1017: Me neither
gigafact: This is going to be very hard to upload to youtube. Syncing chat is going to be a pain...
eldac_kno: ordinary differential equations is just to put a lot of lambdas in solution
ak0ya_: the folding is not discussed anymore
eldac_kno: you are welcome
joseanavarrom: When are you moving out?
0xC3301: I think we will switch to streamer-only chat soon...
gigafact: nice flyer
MrVitoDayz: what is the protest about ?
eldac_kno: looks like scam tbh
blackskill224: oh my god... i mean im from croatia we are not so smart... but still the shit i see overseas...
MrVitoDayz: oh
lotuseatersec: lotuseatersec subscribed with Twitch Prime. 
Jehhred: She seems hot
St47ik: I hope people will be wearing masks at least NotLikeThis
ak0ya_: I don't
gigafact: it does not look like you are going
ImJ4Gu4R: and keep the social distance
joseanavarrom: Don’t get yourself arrested
blackskill224: id like a corona and chill with her
Mint2bSpiced: A differential equation is an equation which contains one or more terms which involve the derivatives of one variable (i.e., dependent variable) with respect to the other variable (i.e., independent variable) dy/dx = f(x) Here “x” is an independent variable and “y” is a dependent variable. For example, dy/dx = 5x.
MrVitoDayz: I would not be surprised if tehre will be buckets of bleach brought to it :D
funwayz: cool people are already in jail :)
0xC3301: I’ll bring tidepods and disinfectant. And you we see any Virus we can still blow it away.
anthonykwan: anthonykwan subscribed at Tier 1. 
anthonykwan: Yeah ! subscribed !
ak0ya_: :(
rudolphdoesgames: 104 people participating on facebook
eldac_kno: dude everybody knows what ode is, no need to copypaste definitions from wikipedia
blackskill224: I honestly think this virus is just a Social and Economic reset for world society
MrVitoDayz: @georgehotz do you support the opening of the state then?
gigafact: if you see anything funny just run run and run
MrVitoDayz: I agree.
Jehhred: Will you bring a sign though?
eldac_kno: just go to the concert then
0xC3301: Protest Driven Development!
clicclic_boom: It’s not fake news man 😂 some people seem to have a better response to the virus than others
eldac_kno: dogs are gross, they eat their own poop
maxschneider96: release pharmabro
LaheyFPS: bring a joker mask 🤡
blackskill224: McAfee is saying its fake ahahah
gigafact: can you give us house tour before moving out?
MrVitoDayz: @georgehotz but it's more about healthcare systems not being equipped to cope with it
MrVitoDayz: I do work in it, so it;s a ltitle bit overkill.
Deno_____: why does my pee pee come out yellow
eldac_kno: guys is jupyter better than pycharm
blackskill224: Deno... please go do something usefull. dont waste network bandwith on stupid messages. Go learn databstructures or something
MrVitoDayz: for example, Sweden is coping fine without a lockdown, mainly bc their hc system is much more prepared.
whichtom: they are very different things, jupyter is good to prototype quickly and display plots easily
MrVitoDayz: @eldac_kno I just use jupyter in VS code :)
gigafact: so where are we? how many % before this is up and running?
ak0ya_: These are the nodes of the search tree?
MrVitoDayz: not not just US, but UK's as well.
Kiskiss: iguana1Homie
ivylions: drink bleach
ak0ya_: :)
whichtom: the UK system aint so bad
Deno_____: I will be a good boy from now on
技術宅: lol
Mrkz_: SeemsGood Hello there :)
l1ght5p33d: yyyyeeaaaa IIMM INNNN woot
St47ik: Mods PowerUpR
great_said: hi again :)
sakshambhutani2001: hi my first time here
clicclic_boom: Build a wall 😋
TheKoreanZombi: I will be a ruthlessly efficient mod @georgehotz
prvk3: did he sleep?
JackiePuppet: Italy has a much older population, there are more factors to consider
adotout1: here come the shitposts
l1ght5p33d: Solving Differential Equations now is like Chemistry was 100 Years ago Super Fucking Impossible
TVTuzz: G'day Mr. cr00se
knilecrack: :D
blackskill224: here come detergent eating followers
Deno_____: hey thats illegal
williami000: Has he been streaming all night
ohG_Rivenroth: the population's education plays a big role too, no one talks about south korea, where the population is already educated to use masks even if they have a minor cold
l1ght5p33d: who uses mathematica?
Denis0109: don't be rude jessefive, you will learn something from him, instead saying bullshit.
maxschneider96: The US healthcare system is not performing well given that they spend more than 15% of their GDP on it, it´ s a lot compared to other countries.
ortunado: When is the day you get instagram verified, and make millions? FeelsBadMan
hurzg: whats the purpose of todays stream? yesterday the balancing problem was solved... todays agenda?
markov010: @l1ght5p33d mathematicians
jagger_rsw: Can you boost up your mic, you're like 3 times more silent (on - dBm level) than aaanything else :)
niceonesonny77: what is he working on right now? Was Muzero like alpha zero?
hurzg: thanks @georgehotz
nejintejag: I don't think Sweden was so much better prepared. Sweden is a very individualistic society people are very isolated to begin with. Not that that is the main reason why Sweden is doing ok. I think the main reason is just how media portrays the hole thing.
rudolphdoesgames: @jagger_rsw or you could turn your volume op
rudolphdoesgames: up*
niceonesonny77: can anyone be kind enough to explain what he is doing??
ironickilla: u got a nice little apartment there
ironickilla: looks clean
JackiePuppet: Swedish people stay 2m away from each other even before the virus
markov010: Sounds like you forgot a coin on a pants
knitler_: I'm confused how you'd stop an inf recursion when doing tree search's on value itself
jagger_rsw: @rudolphdoesgames than "aaanything else" will be 3x too loud :)
deepfrieddeals: What’s that noise? Is George laundering his jeans?
l1ght5p33d: Anyone done Generalized Fourier Series for solving for DEs? That's about where I failed out of college
MrVitoDayz: basically, from my personal experience: governments do not put enough resources into healthcare. It's like throttling a CPU without a fan.
blackskill224: George what do you think of an GPU based SQL dialect? I wonder why is there no Database B trees running on parralell
Foxboron: @nejintejag Sweden is not doing OK. Look at Norway. Sweden also doesn't have the economy to do a complete lockdown.
rudolphdoesgames: @jagger_rsw for example, desktop audio down, twitch up, gotta play with those values and find the right balance
johngeorgesample: johngeorgesample subscribed with Twitch Prime. They've subscribed for 2 months! 
ohG_Rivenroth: @georgehotz any plans on making a online course or something like that?
huntboom: huntboom subscribed at Tier 1. 
Deno_____: my girlfriend lives in sweden we have been in a long distance relationship for 10 years now although her camera is not working but I have seen her pictures
jagger_rsw: @rudolphdoesgames e.. nah.. better I complain to george :)
sakshambhutani2001: george have you tried R? Some says it's better than py, I personally find it not too good. Ps it works on jupyter
kristobalxx: @Deno_____ LUL
gigafact: @deepfrieddeals it's a laundry machine...
great_said: guys help me, pytorch or tensorflow?
Deno_____: because youre altruistic
adotout1: Not giving a shit 101
Deno_____: GEORGE
LaramsZ: do you do this everyday?
l1ght5p33d: Because everyone would buy it!!!
Joooooooooonas: money :D
jaxotp: Money ;)
gigafact: online course it's for grabbing money I think
MrVitoDayz: Sell it!
ohG_Rivenroth: teach us how to think PogChamp
jagger_rsw: @georgehotz so, the benefits for subscribers are as always? we'll get preferential treatment when you take over the world?
l1ght5p33d: just bullshit the entire time like everyone else!
namenamison: Make a course on how to think then?
JaeGeeTee: JaeGeeTee subscribed with Twitch Prime. 
ironickilla: Think people, Think
pepelaugh0: @georgehotz do you watch tv at all?
cazklol: have not learned a shit since watching this channel
maxschneider96: Austria and Germany had good strategies, the death rates are really low and in austria they reopen shops again every 2 weeks. They will even allow tourism in summer probably.
whichtom: buy more ice
eldac_kno: online course on rapping
markov010: sounds like you forgot multiples coins on your pants
Mobius5: MONEY IS A SOCIAL CONSTRUCT
AYNSTAYN: @georgehotz you and me both buddy, only if ppl started to think
grenaderaven: buy stuff
JackiePuppet: Think about what?
l1ght5p33d: Start new bio lab
nlulic: I'd buy a rapping course
MatiGoG: have you heard of rtx voice it could help with situation oever here :)
JaeGeeTee: GEORGE! Just subscribed. Much love bro! Keep it up!
tkdboy555: IMMORTALITY IS THE GOAL
ironickilla: u got a nice little apartment there
LolTwitchSecurity: rapping master class
LaramsZ: @georgehotz do you do this everyday??
jagger_rsw: sink people, sink
huntboom: Buy made up things
tessier_ashp00l: only rich people can afford to say that
bovine_shield: Money is worth something in strip clubs
maxschneider96: money is a tool
blackskill224: bitches and coke and go mcAffee mode on twitter
niceonesonny77: u could legit do anything with money
gigafact: I only watch for your social views....
TheKoreanZombi: You'd buy Mac Pro wheels.
kristobalxx: jet ski
PlayersTwitch: feed the poor
KyoshiDeath: jetskiii
Jehhred: Why make a course when he's making a university.
LolTwitchSecurity: Buy an ex soviet mig 21 @georgehotz
TGUK9: jetski Kappa
tkdboy555: EXCEPT LIVE FOREVER
Deno_____: you could buy me babe
niceonesonny77: evaluate what do you specifically mean by think?
Joooooooooonas: a house , a apartment , decent workstation
MrVitoDayz: @georgehotz
tessier_ashp00l: buy a jet ski
kristobalxx: LUL
markov010: More Money = More GPUs
maxschneider96: rich dad, poor dad, great book
ohG_Rivenroth: more like a mil, not 100k LUL
hurzg: be the next elon musk
Deno_____: charity?
FusRoDead: Wouldn't a course get more people to think?
nejintejag: @Foxboron I think Sweden is dong fine and doing a full lockdown is completely unnecessary. The mortality of covid is so much lower than the original estimates. Covid is just not that dangerous.
yungtoad1: only people with lots of money say stuff like this
bambiofthewoodtribe: Jet skis
eldac_kno: money can solve any problem money can solve
jagger_rsw: unless musk gets into jet ski business and it'll become cool
JaeGeeTee: you don't need a lot of money. you need enough money for food, a house, and thots!!!!!!!!!
ggtom: dont be poor 4Head
MrVitoDayz: Invest that 100k, make 1 tril then your voice will be heard and you can teach people to think :D
Deno_____: THANKS IM POOR NO MORE
jwlolol: problems money cant solve are the real problems tho
St47ik: A course about thinking 4Head
JackiePuppet: I told my landlord money was made up and now I'm homeless
aminuuux: poeple that buy course don't think
l1ght5p33d: Let's sue somebody that would be fun... better than protesting
huntboom: Pay people to color HahaThink
Joooooooooonas: do you have your own house/apartment ?
bovine_shield: Its about making enough, but not an excessive amount.
sakshambhutani2001: what bout Yatch, perhaps Private Jet?
gigafact: you can live off twitch if you like
LaramsZ: you can have economic stability and dont worry about it at all, being too rich doesn't give u that much
Foxboron: @nejintejag You are wrong. We know very little of how COVID affects us.
tinkerzwhothe_t: what's the purpose of living?
Deno_____: MODERATE
kristobalxx: not a jet ski
Deno_____: define moderate
alameda13: u want little
maxschneider96: everything u need to know about money and happiness: https://80000hours.org/articles/money-and-happiness/
JaeGeeTee: Money can either attract the thots or keep them away!
Denis0109: But some people will never think, also if they try george. Sometimes it's better to not know, that people aren't THINKING.
clicclic_boom: @georgehotz what about the cult?
grenaderaven: buying lots of cheap crap is pointless, bt there are nice things that can improve ur life
TheKoreanZombi: @Deno_____ He defined moderate as $78k.
colanzio5: @georgehotz It's easy to think, it's harder to finish something to completion than come up with a good idea.
blackskill224: smoke weed with elon in escape velocity
Deno_____: ohh ok
Jehhred: Why get rich when you can be friends with rich people. You get all the benefits without the hassle
raystriker98: in California 78k is moderate
hurzg: the more you have, the more you fear loosing it all... thats the problem
tkdboy555: @georgehotz have you been to Stephen Wolfram's livestream at all these past few weeks? He launched this new open-source project https://www.wolframphysics.org/ for everyone to work on trying to discover the fundemental theory of everything, the grand unified theory of physics
eldac_kno: you wouldnt need excuse to suprass your true desires by pretending "i can buy whatever i want"
MrVitoDayz: well, we currently do not have an economic equivalent to money.
nejintejag: @Foxboron the numbers I have seen puts the mortality across the society is about 0.15 %.
l1ght5p33d: all hail elon.. stress king
LaheyFPS: elon doesnt feel stress
Deno_____: you make at least 130
grenaderaven: money buys power
YOLOMAN1343: when is the next geohot live concert where can i buy the tickets
Mobius5: If money is your core drive in life it's over for you
namenamison: What part of streaming gives pleasure, bc it seems like most of us only annoy you?
alameda13: but u could others with more money @georgehotz
Foxboron: @nejintejag And that is "not that dangerous" in your mind? The current deaths in sweden i 4 times that of last flue season.
技術宅: if you can eat you're good
lebop: iBUYPOWER
St47ik: https://www.wolframphysics.org/ seems interesting
Deno_____: you could buy a private island and host mma events
MrVitoDayz: @Mobius5 for some people it is tho.
技術宅: and medical
clicclic_boom: Are you still paid at comma?
whichtom: thats kinda a weird generalization for the entire country
FargioFarmani: If you feel stressed, can I give you a massage? @georgehotz
warriorgiggles: What part of streaming gives pleasure, bc it seems like most of us only annoy you?
sakshambhutani2001: money CAN give you more Credibility/ Social Influence.
namenamison: What part of streaming gives pleasure, bc it seems like most of us only annoy you?
Jehhred: Keeping in mind he earns 78K working part-time
JackiePuppet: That graph shows the average case, no guarentee that even slightly represents one's own case
alameda13: earn more help more
eldac_kno: i think notch situation seems perfect
Joooooooooonas: more money is a preparation for well being I think
d3adb33: but its Up to the country you live. ...
joseanavarrom: But for some people it’s not enough money for “what they want to buy”
this_is_falcon: part time 78k?
knilecrack: it just means you can't talk shit on twitter etc
grenaderaven: not having a boss is prolly more important to me than money
Mobius5: @MrVitoDayz I find it unbelievable how those people can get fullfilment in life. If you can already buy everything, why would you want more?
jagger_rsw: @georgehotz I'm not sure, if I earned 80k$ I'd be a bit worried about taking mortgage for a house in BayArea or in Switzerland where I now live.
yungtoad1: you're already a thought leaders. just read the dumb questions people ask
tkdboy555: check out https://www.wolframphysics.org/
great_said: do you thinj python still worth to learn?
sakshambhutani2001: I everything elon is, is because of his social influence
Shelledlizard4: id rather have time than money tbh
whichtom: mortgages are a scam
rudolphdoesgames: @great_said learning is always good so yeah! go for it
blackskill224: but guys... that is just a number... like who the fuck cares... tbh if I get respect for contributing to something cool and can eat food and sleep under the roof.
bovine_shield: LOL
gingersniffer: i make £23k and im perfectly happy, maybe im not intelligent enough to understand how i could be happier, but i think that mo' money = mo' problems is true
ggtom: michigan kek
jagger_rsw: @georgehotz that's why I live in switzerland :)
funwayz: no thanks
Denis0109: I wanna learn how to be smart: George: THINK, JUST START TO THINK!
Deno_____: depends on where you live
takkat14: what do you think about WANN?
grizvok: @gingersniffer no it isn;t
St47ik: @georgehotz lockdown made chat a bit worse?
tkdboy555: @georgehotz have you seen this? https://www.wolframphysics.org/
MDIronsTwitch: Ouch, Boston is up there too :(
d3adb33: i am Happy to be in EU 😎
whichtom: 23k is like starting salary out of undergrad in UK
this_is_falcon: but the ocean is cool
Joooooooooonas: BUT if you have enough money, it doesnt matter if the ratio is bad
blackskill224: but if you wanna do coke and bang thots. you need more
LaramsZ: Do you do this everyday duuud
SlaterUSA: has our man cured covid yet
MrVitoDayz: @whichtom lol, for phd stipen you get like 15k so... :D
phrixus_bro: stephen wolfram has done it again
joseanavarrom: In the EU is lower
Deno_____: @blackskill224 hey this isnt sillicone valley
jagger_rsw: @eldac_kno for housing not thaaat true, in comparison to BA. Say 1000sq ft house is maybe 800k USD in Zurich, which is probably less than in BA
knitler_: Is there a way to remove the reward completely for chess since it's not really needed?
whichtom: @MrVitoDayz in the UK?
whichtom: I knew they were low but not that low
FargioFarmani: btw your talk about hacking the world simulation was cool, i wonder how many ppl in the audience got the idea soulshined
whichtom: as usual, salary is a joke in the UK lol
MrVitoDayz: @whichtom Yup.
sakshambhutani2001: everything Elon is, is because of social influence
pepelaugh0: @georgehotz would you ever go on a podcast like eric weinsteins or lex fridmans if they asked?
joseanavarrom: It’s even lower in most of europe
l1ght5p33d: Eric Weinstein knows the next steps of testing string theory
grenaderaven: its not low in London
ak0ya_: string theory is math
joseanavarrom: It’s about welfare state
ak0ya_: not physics
LaramsZ: do you do this everyday
great_said: you deserve more thank Elon Musk for me
bambiofthewoodtribe: Buy houses in Nevada
MrVitoDayz: you do what you love but you struggle af. I don't care that much tho.
maxschneider96: @grenaderaven depends
tkdboy555: thanks for checking it out :)
maxschneider96: @grenaderaven ain´ t that high in many fields as well
blackskill224: id like George on joe rogan... but i bet people said this a milion times
namenamison: @georgehotz If you are not that interested in money, why are your videos subs only?
aiex42: Wolfram project is NOT string theory
yungtoad1: PunchTrees
Deno_____: joe rogan only accepts atheists on his show
tkdboy555: @aiex42 true LP
grenaderaven: if ur earning low in london its prolly your own fault, theres devs with 1-2 years experience earning 60k
tkdboy555: @aiex42 :P *
grizvok: @namenamison literally all of this gets posted to the commaai youtube rofl
rudolphdoesgames: @aiex42 he didnt say it was?
huntboom: What’s your favorite linux distro and why?
jaxotp: Would you like to go to JRE? Sorry if this gets asked a lot, I'm quite new here.
whichtom: SE in london can get you a lot yea, I have a mate getting 100k freelancing
JaeGeeTee: HAPPY SUNDAY! WOOOOOO :rickflair:
WillGreen98: @grenaderaven hopefully so haha
whichtom: but for engineering as a whole, its really low
Deno_____: joe rogan is braindead
ggtom: joe 🅱️ ogan
maxschneider96: @grenaderaven ain ´t that much compared to other countries
aaddrr: london life is expensive af
nejintejag: @Foxboron so normally 250 people die each day in Sweden. Currently about 48 people die in covid every day in Sweden the overlap with those 250 is high. The people who die are mostly old and unfit people that would die from other causes son enough. For amount of work we put in to this covid shit we could save millions and millions of poor African people.
whichtom: im aerospace and my mates are getting like &lt;25k starting salary and its depressing
blackskill224: no man he is not. he eat yelk and jalapenos. and smokes weed. that means he is smart
grizvok: you talking shit about rogan
ggtom: whichtom where?
whichtom: even then you cant get huge raises unless you go into management
great_said: i hate this virus, so depressing NotLikeThis
namenamison: @grizvok shit my bad dude, still weird that they are not free here but yeah mb
Deno_____: does dmt and thinks he knows how the universe is created
JaeGeeTee: @nejintejag, everyone is dead in sweden.. they sold their soul to the govn't
l1ght5p33d: @eldac_kno Why do you say he's a fraud? He at least knows almost what he's talking about enough to deceive very well then.. very sad if true
whichtom: @ggtom south of london
whichtom: not central, near greater
namenamison: But it is not one life
ggtom: whichtom in aerospace engineering? brutal ngl tbh but makes sense
sAfEgUy1: we could of done that before the virus though
maxschneider96: @whichtom I´ m living in north london, tottenham
paranon1: Have you read Marc Andreessen's "IT'S TIME TO BUILD" essay?
qcDENNEMANN: How hot is karen?
St47ik: @georgehotz to be fair this crisis revealed how broken the current global system is imo
Deno_____: theres people dying from fake boobs
AugTV: a thing we will look back on in the future, how the fuck did they have people starving and being homeless when they clearly had enough.
mibressler: When are you gonna go on Lex Friedman's Discord?
ggtom: man ppl need to make tl dr
whichtom: yea idk aerospace engineering in the UK makes me sad. trying to get to the US
LelouchViMoscow: Hey chat. Just broke up with my gf and come here :P
easysleeep: How about Daniel Gross’s piece on World 2.0?
blackskill224: @lelouchvimoscow nice. now go and jailbreak some phones
whichtom: we're still in the pandemic so we're operating on so much incomplete information
clicclic_boom: Food shortage is not really killing anyone these days. It’s mostly disease and war.
gasman1017: @LelouchViMoscow Sorry to hear that. Did you break up with her? That's at least a little better
ggtom: whichtom wat about mainland europe like germany? u can always do petro engineering
ak0ya_: @LelouchViMoscow thank you for letting us know
whichtom: @ggtom I aint selling my soul
Deno_____: bill gates is our lord savior Kappa
jagger_rsw: probably true in conflict regions, south sudan, somalia
ggtom: whichtom ???
whichtom: aerospace industry in the US is the best anyways
l1ght5p33d: If you live in the middle of nowhere you can obviously die pretty easily
St47ik: Whats that noise WutFace
clicclic_boom: Yup
LelouchViMoscow: @gasman1017 now, she said something like 'its hard to work etc, she just wanna find someone who had money'. kinda 5 years goes to trash
Deno_____: bill gates making vaccines and his children arent vaccinated
kingvoneduard: Young people are dumb and leftists
tribegvng: Everything a scam
mibressler: ggtom germany just has next to accurate numbers by good testing
tearisten68: I don't hear people complaining about starving yet, I hear about people complaining about their hair cuts
ggtom: petro eng is legit especially the drilling part
LelouchViMoscow: @gasman1017 i mean "no", not now
LelouchViMoscow: ahahha
sakshambhutani2001: Covid death is not only matter of age, it can be a matter of time you are exposed to it. Many young Doctors and Nurses are dying of Covid
St47ik: @Deno_____ pls stop
MrVitoDayz: I personally see the hospitals inside ( I work on there) so you can't suddenly increase the hospital's capacity by 10 fold... It takes at least some time and most importantly, you need the professionals working there. How will you get 10x support staff than what you normally need? So basically, overstreched hospital = declining healthcare.
this_is_falcon: its just circle of life
Deno_____: @st47ik whats wrong?
MrVitoDayz: And then what you get is that it's impossibelto get healthcare support for simple things like infection. So people start to die from stupid things.
aaddrr: trueee
ggtom: mibressler i was talking about aerospace eng jobs in germany lul
gasman1017: @LelouchViMoscow You will be ok. It sucks at first, but it get's better everyday. Just find stuff to do to keep yourself occupied. You deserve better my friend &lt;3 &lt;3 &lt;3
whichtom: the idea of a mortgage is a scam anyway that drives up prices and screws over the next batch of people buying
mibressler: LoL haha
kingvoneduard: Harvard is a scam to make billions
MrVitoDayz: that is true.
mibressler: harvardx is nice though
MrVitoDayz: They are not scam, but are stuck in the past like most universities.
clicclic_boom: Mostly PPE and testing kits are widely available - not a technology problem. But govt gives licenses to sell these - there was a shortage of licensed products in the market.
Deno_____: harvard is pro slavery
Choruptian: what are you doing with MuZero?
benzojamal: we need a new democracy
gasman1017: Jim Gates says we aren't going to Mars for at least 100 years
LelouchViMoscow: @gasman1017 ty bro :) so it was really heartache first time)
benzojamal: democracy 2.0
sakshambhutani2001: Covid death is not only matter of age, it can be a matter of time you are exposed to it. Many young fit doctors and nurses are dying of covid
aiex42: You NEED to take a serious look into the Wolfram Physics Project: it's about hacking the Universe (simulation) to find the underlying rule behind it all
l1ght5p33d: Robots only on mars at least 40 years
tessier_ashp00l: how hard is going to mars compared to fixing eaarth?
triple__m: Really sucks how short sighted and biased people are, thinking mars is a destination and not about all the things we'll be inventing by setting the goal
Deno_____: yeah but george who created the people that created the matrix whos at the end of the creation chain
whichtom: musk is doing a good job of getting people excited/optimistic
kingvoneduard: You cannot hack a Simulation if you are inside.
ariasteve: Cheers from Canada 🇨🇦 Just found out about these streams, they’re awesome man
tribegvng: :D
lebop: what are your thoughts on VCs in silicon valley?
ak0ya_: This brings us back to protein folding?
l1ght5p33d: Brain is so sub optimal,, 99% recursive lock all the time
benzojamal: people should give up the idea of colonizing mars; it's complete waste of resources
gigafact: brains are amazing
Andrewnagyy: What's a terra flop?
whichtom: ya brains are an incredible piece of engineering
gasman1017: Jim Gates is a string theory guy. He says its an economical problem. When we went to the moon it took 10years and 5% of our year GDP. To Mars it's 100x that, so the math says it's not feasible right now
FargioFarmani: Computers are just rocks which we tricked into thinking
whichtom: lmao what
aaddrr: do you think we will ever mike a ezact functional replica of the brain but wihout the drawbacks of being human?
mibressler: hopefully not repetitive: when will you go on Lex Fridman Discord?
clicclic_boom: What do you think about DNA computing?
MurdocLIVE: Anyone see the new Microsoft patent for cryptocurrency microchip with patent number 060606?
MatiGoG: @Andrewnagyy floating point operations per second,
whichtom: going to mars is v different than going to the moon
sakshambhutani2001: what if we don't work toward increasing compute power but to hack brain
aiex42: Bro, you haven't looked into Wolfram Physics Project... it's not what you think it is
kristobalxx: what is the single most important thing that you look for in people when you hire ? especially for swe
Andrewnagyy: @MatiGoG Thanks
whichtom: mars might actually be easier now than going to the moon in the 60s/70s
whichtom: given how much innovation needed to occur then, and how much was unknown
benzojamal: like string theory LUL
gigafact: Elon is going to bring us to Mars
joseanavarrom: What are your thoughts on bill gates’ opinions about the pandemic?
MrVitoDayz: @MurdocLIVE lol thanks for showing.
StapoTV: curing ageing &gt; mars
l1ght5p33d: @MurdocLIVE TIL Microsoft owns the devil's patent
gasman1017: The problem is our rocket technology hasn't evolved that much since the 60/70's. We're still using bell nozzles
Deno_____: george simulation is possibility but just because its possible doesnt mean its the most probable
whichtom: musk might bring us to mars but his biggest impact will be inspiring people after him
whichtom: so if he doesn't, there will be people after him
Deno_____: bill gates sterilizing africans
MurdocLIVE: @MrVitoDayz @l1ght5p33d Crazy right?! I'm not big into religion, but I do remember seeing something about mark of the beast going in your hand or something
aaddrr: bill gates is washed lul
GandalfTheGrayOfHell: @georgehotz One minute explanation of Monte carlo
calcmath: what did I miss, how long has he been streaming?
tessier_ashp00l: whitney weeb thinks otherwise
l1ght5p33d: lock up Microsoft . No more Microsoft for anyone
whichtom: @gasman1017 because they're good. aerospikes are still pretty w/e. the rocket tech isn't even the bottleneck
mibressler: will you go on Lex Fridman's Disc?
l1ght5p33d: port all Microsoft apps to Linux
kingvoneduard: Bill Gates will save us with a chip in our head.
l1ght5p33d: on a usb
Andrewnagyy: Bill Gates is funding as many researches as he can so he can be the first to come up with a vaccine and then patent it
MrVitoDayz: @MurdocLIVE LOL.
FargioFarmani: There is no strive for innovation anymore. The cold war is over.
Avelansh: what do you think of dan carlin's hardcore history podcast?
huntboom: Didn’t Bill Gates eradicate polio in India? He’s done a lot of good
whichtom: SSTOs are still highly unfeasible and will be for a long time. innovations need to occur for the interplanetary spacecraft, not the launch vehicle itself
gindalf: @chat what is he doing?
whichtom: and obv landing/ascent vehicles on the other planet
qcDENNEMANN: So what are we making?
MrVitoDayz: @gindalf figuring out muzero
whichtom: its largely a money problem, but its really a motivation problem
whichtom: I agree we don't need SSTO
LelouchViMoscow: Anyone have some experience in combined text and image analysis? I work at course work, so I have 10000 profiles of users with text and images data from open sources like insta/facebook, and i need to predict does some content would be liked by user
Deno_____: george my dad created the simulation hes letting me play with you guys right now
smokyandthebandito: dudes sleeping on a one inch matress, gonna have back problems in like a year LUL
Deno_____: do you have any questions
ariasteve: Do you recommend any books to get into Machine Learning?
gigafact: George is pioneering Science &amp; Technology on twitch. It's the only stream about Science &amp; Technology on twitch with any real view numbers
ohG_Rivenroth: george, what's your view on god/metaphysics?
braininavatt: monkaS asking about books
xeeton: funny how that "pseudocode" is actual code
Deno_____: @ohg_rivenroth hes a skeptic
eldac_kno: math theories doesnt need testability, but it is still science
huntboom: Does George have a favorite book?
Deno_____: imagine being an atheist yikes
ggtom: imo actual code can be considered pseudocode
Santytopa73: time online ?
3even: !uptime
a_0__0_a: my internet is crappy, so I am seeing Frodo writing code.
mibressler: math is like philosophy since it doesn't need any emprical observation
eldac_kno: you better time out deno__ he is spammingn stupid shit all stream
gigafact: @Santytopa73 about 1 hour
kito__: up time is 1:08
eldac_kno: math is still science though
niceonesonny77: pseudocode is an actual thing, that's one of the first thing we learn when we take Computer Science Principles in high school.
rudolphdoesgames: @eldac_kno agreed
nitropiece: math is not science
eldac_kno: yeah right
mibressler: Math doesn't tell you anything about the world
gindalf: math was invented by "them" to control the masses. look it up guys, open your minds
filip9i: What is he currently doing?
niceonesonny77: what is he currently doing
eldac_kno: math tells almost everything about the world, but not in the way you think
Deno_____: science can tell us how but it cant tell us why
Skurt2k: hi
maxschneider96: Mathematics is not a science from our point of view, in the sense that it is not a natural science. The test of its validity is not experiment - Richard Feynman
mibressler: science may use math to describe/approximate the world
AlphaBetaGamma: !uptime
joseanavarrom: Math is a tool for science
Deno_____: exactly
niceonesonny77: but without math, no science
gindalf: !github
eldac_kno: feynman isn't some godly authority on what is science
gubbdump262: what is George building
nitropiece: science is the observation and recording of repeatable phenomena while math is purely just a language that happens to be used by science
justenpassant: what are we doing today guys, I see Tensorflow
benzojamal: math is the only thing that matters
gasman1017: @whichtom but we can control thrust with other types of nozzle, reducing need for as much fuel.. therefore reducing price/lb to orbit. I'm not a rocket scientist, but makes sense to me
mibressler: without math science would be just less efficient
eldac_kno: math is also observation
calcmath: he is implemeting monte carlo tree search
mibressler: why is math observation?
joseanavarrom: Science is the only thing that matters, and math is a requirement. That’s it, they’re both important
bovine_shield: math is stupid. only painting and poetry matters.
her3hero: yo whaddup
nitropiece: math is not observation
ggtom: looks like he is doing some reinforcement learning thingy magig
eldac_kno: you observe things then use math to describe them
nitropiece: look up definition
justenpassant: math is an observation? lol. It's a modelisation
Mlewii: @eldac_kno so is math science ?
mibressler: eldac exactly, but it is not mathematics itself that your learning about
whichtom: @gasman1017 yeah but convergent-divergent just happen to work really well. If anything we could look into different types of chemical fuel but its a marginal performance increase
luuwa_: i think yes
gasman1017: how important do you guys think advanced math is for everyday programming?
ggtom: gasman1017 not important imo
Deno_____: you dont need math for programming but you need programming for math
ak0ya_: depends what advanced means
whichtom: reusability seems to be good, with high launch cadence. combined with better long-term space propulsion (really need nuclear imo) would be good
eldac_kno: depends on what programming
ggtom: gasman1017 youll rarely need beyond linear algebra
maxschneider96: Why don´ t u guys just google it, clearly gives u an explanation for why math is not a science. Annoying discussion haha
benzojamal: @gasman1017 you don't need it
MurdocLIVE: Anyone know a good private browser? I'm using Brave atm
Deno_____: my dad is an html developer and hes making BANK
justenpassant: lol the amount of atrocities in this chat are out of this world
sakshambhutani2001: goerge do you recommend any books? like best book you have ever read?
FargioFarmani: You need math for math and programming for programming.
tajpouria: We never back to twitchcoq?
naclEric: uh u definitly do not need programming to do math
gubbdump262: Brave sucks
joseanavarrom: Of course you need it, in many other fields of engineering
ak0ya_: :(
rudolphdoesgames: twitch in a nutshell
vrv_exe: Lol
calcmath: i am paying attention to stream,
raystriker98: just ban people lol
huntboom: Yeah we are a shitty discord
rickoftheroot: BibleThump
clicclic_boom: Build the sub wall 😋
joseanavarrom: And what a stupid debate honestly
vrv_exe: Get these savages back in line George!
0xC3301: ...
maxschneider96: @joseanavarrom yeah haha
Choruptian: I'll still pay attention even if sub-only
maxschneider96: u should create an AI to deal with the chat
maxschneider96: fairs
Jehhred: Twitch chat is the mating ground for degenerates
raystriker98: but they're all incels
joseanavarrom: Do you project you’ll get it working today?
anthonykwan: TBH, What r u gonna achieve tonight ? LUL LUL LUL Still cannot get it too well
Deno_____: Just ban people
georgehotz: https://arxiv.org/src/1911.08265v2/anc/pseudocode.py
calcmath: I think backpropagate here is not the neural network backpropagate, that is what has been confusing me
Tornyl: !uptime
anthonykwan: I see...
FargioFarmani: !join
bilboballin: love your streams man
JdPaulBlart: good morning mr streamer
niceonesonny77: what do you think is the best specific major in computer science? machine learning?software engineering? data science?
maxschneider96: @niceonesonny77 depends on what u wanna do, simple as that
Deno_____: @eldac_kno you dont make rules stop spamming
Jehhred: Would people stop asking for life/career advice?!?!
Foxboron: @niceonesonny77 not a lot of difference between machine learning and data science these days.
rudolphdoesgames: @Deno_____ LUL
niceonesonny77: damn
niceonesonny77: spread love not hate man...
kristobalxx: jesus christ is this chat full of jailbreak-era fanboys that have no idea about how anything works and ask random shit
Deno_____: @eldac_kno its really cringe how youre trying to make him like you
thenomadplayer: Yo bro, gr8 from Poland. U are my code inspiration.
Deno_____: I mean I respect it but enough is enough
gindalf: just make an !advice command explaining that he's not here to give advice etc
sokhibjke: !dc
benzojamal: @georgehotz do you believe RL will ever be used for something more useful than games?
sokhibjke: !discord
FargioFarmani: I never witnessed an angry George
Kriminell00: oof
JdPaulBlart: hahahahhahahahahhaa
braininavatt: LUL
bilboballin: lmfao
gindalf: rip
Deno_____: george savage
JustLOL__: LUL rekt
danrod43: LuL
her3hero: lol
l1ght5p33d: @krispeer Why do you care? Look at what geohot has coded before.. he is one of the best programmers alive
niceonesonny77: LMAO
Deno_____: @krispeer heavy
a_0__0_a: what just happened?
NatePh_07: LUL
her3hero: does it balance a stick yet?
Deno_____: @georgehotz how many letters mmax for a message
whichtom: wait when is it backpropagating
tauzN: !uptime
maxschneider96: safe spaces don´ t work anyways
knilecrack: only thing that is bad when it's subscribersa only that there i no G's "you get a time out"
2sin54: monkaS
grosser_schwanneg: PogChamp
kristobalxx: graphs KreyGasm
ggtom: the network backprop is via minimize loss function. the backpropagate is something else here related to the three
FargioFarmani: How to be positive: George, you look handsome today.
majorawpsome: hey don't forget to save
a_0__0_a: Kappa
2sin54: sir there are weird noises in the background
namenamison: Why do you "time out" people?
JdPaulBlart: george take the change out of your jeans before you put them in the dryer... its loud af @georgehotz
DatGuyVJ: !uptime
jenny_tahlia903: hey mate i know this is off topic but have u looked into self driving tractors cause atm on my farm for it is around 30 grand and about 2cm accuracy surely it should be cheaper
lilou04: how is corona hacking going on?
dompatobbe: !uptime
beckles: Is he making a game
calcmath: its networkx
ggtom: jenny_tahlia903 u could always train one yourself 4Head
rudolphdoesgames: @beckles he is implementing Mu&gt;ero
benzojamal: x missing
rudolphdoesgames: MuZero*
raystriker98: is muZero the best unsupervised ai there is?
Deno_____: I read automate the boring stuff, automated my job and got fired
Vietnomnom: this isnt hacking coronavirus LUL
ggtom: i think it's just recent. the 'best' i duno
Basti_Soldier: &lt;3
tribegvng: Been automating mine for the past 3 years yolo
Basti_Soldier: hi
Deno_____: niceeee
braininavatt: PogChamp
LaheyFPS: when you first learn nested loops
l1ght5p33d: nicee
Deno_____: thicc tree
Izimoney92100: this is christmas !!!
braininavatt: we did it! VoHiYo
Deno_____: that was quick
kubectl: heyyo, what is he building?
Deno_____: a tree
calcmath: during MCTS i dont think you should use the value predicted by the neural right?
kubectl: mkey, and the tree is supposed to do what?
Deno_____: be a teee
Deno_____: tree*
calcmath: oh nvm yeah you predict the reward with a neural net
whichtom: muzero achieves SOTA for a lot of atari 2600 games and does pretty decent on go/ms pacman but I think thats it
SrDead: Any tldr of what is he doing? LUL
whichtom: not sure how it compares to SOTA on go
M0NKEYBAGZ: what is MuZero
Izimoney92100: stop breaking it :(
ggtom: looking good there
Deno_____: ( . )Y( . ) this is for you george boy
brisingr1031: @M0NKEYBAGZ a model that deep mind released a paper on recently
FargioFarmani: It performed even better than AlphaZero in go and chess
qdl_: is google really to much for you people?
M0NKEYBAGZ: ahh
calcmath: this is still without UCB exploration
brisingr1031: @qdl_ whats google??
qdl_: idk lol isnt that these android guys?
whichtom: ah I see yea it matches/outperforms alphazero. neat
danrod43: @jomkingal take it easy with the compliments, this is your finla warning
l1ght5p33d: if you try to tune the weight update for only specific inputs .. Is that considered a hidden layer? I don't get the terminology sometimes
danrod43: @jomkingal good, stick to advice questions
brisingr1031: @georgehotz have you tried julia before?
calcmath: so this is brute force search, like a tree traversal
Izimoney92100: are we hearing the dryer in the background?
calcmath: policy should be combination of value and visit counts
brisingr1031: @Izimoney92100 p sure yeah lol
l1ght5p33d: map of state to action
Sycto: lol
ggtom: you get the kicker boiii
ggtom: Deno_____ i remember someone unironically answering this in a twitch chat
sicandis: what is your keyboa... oh wait
joseanavarrom: Why are you saying so many stupid things on the chat?
eldac_kno: deno stfu aready
r3mote: Hello :)
danrod43: @eldac_kno LuL welcome back
FargioFarmani: Says the guy who got timed out
calcmath: policy is not stochastic i think, its just choose action with maximum UCB score
filipiek1997: i know :)
danrod43: he's a junior mod dude, he's working his way up
bill1929: @eldac_kno - pipe down bro you aint an authority figure
moizai: what we doin today?
ggtom: calcmath i think the same bro
Deni1111: What desktop env do you use at work????
eldac_kno: what question about disposing body has anyting to do with this stream
csal90: Lets have some good vibes boys and girls
ggtom: it ok i whispered him the answer
FargioFarmani: Maybe he means how to have your garbage collector dispose your python objects/ bodies
danrod43: eldac ban inc LuL
knilecrack: :D :D
Jazzify101: :D
nizero: George I'm going to help label your comma data
moizai: when are you doing a meme reveiw george
bill1929: :D
Aki_111: can u help me with my homework
braininavatt: braininavatt subscribed at Tier 1. They've subscribed for 3 months! HeyGuys
calcmath: Also if you read the medium article, it says there are two phases, for first 30 moves its a different policy from after
maxschneider96: what´ are ur timeout policies?
M0NKEYBAGZ: ManChicken
LaheyFPS: HeyGuys
jagger_rsw: I like code which contains engineering tuning factors like "pb_c_base = 331154353453"
Boza7777: yo
acathon: oh man, don't tell me you are still awake until now :o
Joselinis: If you ask what?
LaheyFPS: Just dont say anything off topic LUL
BetaMalePaypig: trolling gets u timed out, i heard
Thomasbrah: @georgehotz what are you building today ?
Izimoney92100: a tree
St47ik: @calcmath why can't policy be stochastic as in stochastic policy gradients?
calcmath: look at fucntion visit_softmax_temperature
csal90: What's the benefit of using Jupyter notebooks?
eldac_kno: fast prototyping
calcmath: it can be stochasitc, its just that after 30 moves the way they implemented it is it just chooses action with maximum visits
l1ght5p33d: @maxschneider96 You must at least attempt to contribute positively to the intellectual quality of the chat
Boza7777: When did the stream start
maxschneider96: @l1ght5p33d makes sense
whichtom: about 2hr ago
kenan7: omg light mode
kenan7: my eyes hurt
l1ght5p33d: @csal90 not needing to type print()
calcmath: shouldnt you softmax with a temperature ?
andRoStyle: hi
cavad444mm: your voice is low @georgehotz
moizai: agree with you kenan 😂
l1ght5p33d: not needing to type esc shft : x uparrow tab enter
gigafact: making some pasta it's going to be nice
ggtom: calcmath i think they got a funky policy for action selection going on. doesnt seem to follow previous known policies. i gotta read the paper at some point. aka in a cpl of years
fychvhvjh: TALK ABOUT WHAT IF SOMEONE HACKED INTO THE PARTICKE ACCELERATOR
vrv_exe: @csal90 think of it as a vm. Environment is self contained. Easy to share with others.
fychvhvjh: PARTICLE
calcmath: @ggtom read the medium article, its explained better in there
Izimoney92100: it's broken :'(
foosballs: test
jagger_rsw: @georgehotz boost your mic plz
braininavatt: we're close :)
ggtom: calcmath i arent read that. maybe when i do rl again in the future.
foosballs: @calcmath link to article?
fychvhvjh: if someone hacked into the particle accelerator it could change the space time continuum
supplydemand88: Sup
calcmath: https://medium.com/applied-data-science/how-to-build-your-own-deepmind-muzero-in-python-part-2-3-f99dad7a7ad
foosballs: thanks
2sin54: HeyGuys ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀ You are now permanently banned.
lemonspree: What happened to the covid project?
anthonykwan: LUL
kalbermatteralan: SeemsGood
calcmath: exploring childs is based on UCB score, finally choosing the action for the real environemnt is based on visit counts
l1ght5p33d: @lemonspree We needed a mass spectrometer
maxschneider96: love python, but compared to other languages I find it harder to find bugs, honestly
calcmath: its the select_action function, they use a softmax with a temp
eaterenrgy: @maxschneider96 Use it strongly typed it helps a lot plus of errors are caught compile time.
l1ght5p33d: what's wrong looks good to me
xeeton: how are you finding the optimal hyperparams for muzero?
maxschneider96: @eaterenrgy thanks for the advice
triple__m: are people just trolling in chat? what's going on?
l1ght5p33d: @xeeton fancy maths or a metric ton of trials
calcmath: ucb score for move right is toohigh for some reason
lilou04: maybe thats the right policy
xeeton: @l1ght5p33d I see, thx
Jazzify101: What kind of game is this thing tying to beat?
calcmath: is this cartpole or mountatin thing?
calcmath: game is just balancing the stick
Jazzify101: ok
FargioFarmani: The problem is that there is no continuity on the simplex w.r.t to the nodes.
nejintejag: @calcmath what stick?
gaocaandra: yoo wassup
calcmath: think inverted pendulum on a cart, cart nedds to move to keep it balanced
gaocaandra: 3 streams in 2 days
gaocaandra: blessed be
foosballs: thanks for the medium article - anyone interested on understanding what he is working on - check out the article, its very beginner friendly.
calcmath: he will show the animation of it eventually
l1ght5p33d: @Jazzify101 He already switched out the game a few times. The game doesn't matter if the inputs are the same data type. The algorithm will learn any game environment . Look at open ai gym
gaocaandra: where is the link?
lordmordi_: first time ive ever caught your stream live. might sound weird to say but I've been looking forward to this. lol
Khalifa1897: @foosballs link
xeeton: @gaocaandra https://arxiv.org/pdf/1911.08265.pdf
St47ik: https://medium.com/applied-data-science/how-to-build-your-own-muzero-in-python-f77d5718061a
gaocaandra: thankd @xeeton
foosballs: ^ Start from part 1 tho
gingersniffer: i love these streams george, they inspire me to learn, thanks for sharing
knilecrack: Hey man, can you take a minute and explain what are you doing, I've missed a big part of the stream
Flying_Geese: can anyone tell me what he's making?
calcmath: shouldnt there be softmax with a temperature somewhere? or is this a simplifed version you are trying first?
foosballs: I'm just mindblown with the idea that you can train a network to learn without any rules.. although it does feel kind of intuitive that after throwing 1m games of understanding whats valid or invalid move at certain positions or representation - it creates a mapping of how to go about the game.
foosballs: Still fascinating shit nevertheless
gaocaandra: he is making a muzero implementation that works on "every" environment
gigafact: nom nom pasta is ready
nejintejag: What are the outputs, and what is the inputs measuring?
Flying_Geese: thanks for the update guys!
xeeton: can anyone not read the previous comments? jfc the same question is answered over and over
whichtom: wdym environment @gaocaandra
l1ght5p33d: @foosballs "no rules" what do you think all the coding is about
foosballs: Come again, didn't get your question
gaocaandra: you have agents that act inside environments (check out python package gym)
whichtom: oh the games
whichtom: im being stupid ya I know gym, just havent used it in forever
WarSwick: You have no emotes?
LaheyFPS: @xeeton people who join cant see previous comments
calcmath: as you visit it a lot the value score should get weighed down
WarSwick: For subs
calcmath: just try for more simulations to see its effect?
bichid69: bro why is nothing working for you on these streams anymore
calcmath: you need the vist count to build up to reduce weigh down effect of value
calcmath: not reduce increse
braininavatt: @bichid69 the stupid questions make him lose focus Kappa
l1ght5p33d: it was a good test then
Vietnomnom: seq1
Sylens__: @georgehotz i just started using vim and my god am i amazed at the commands PogChamp
bichid69: think u peaked bro
garydsmith1: it would be funny if he again quit stream to watch the movie
gigafact: if it does not work it means it's hard problem
calcmath: postive value is an accident of the situation
bichid69: @braininavatt nah bro he defo peaked
calcmath: it will get averaged to low i think with more simulations
xeeton: @garydsmith1 this is like reading the book, before watching the film
routerkicker: !uptime
garydsmith1: @xeeton oh yeah true that
l1ght5p33d: @Sylens__ if you want to do something in vim it will probably be in here somewhere https://vim.fandom.com/wiki/Vim_Tips_Wiki
garydsmith1: how many of you guys use vim?
THX1342: just the 1337
Sylens__: @l1ght5p33d what do you mean by doing something in vim?
bichid69: anyone who uses vim is an uptight asshole
ggtom: vim editor kek i just use notepad++
Sylens__: i was just using the vim tutor atm LUL
THX1342: bichid69 you're trying to hard bro
garydsmith1: no man @bichid69
Snobbysteven: nvim user here
gaocaandra: @bichi69 preach
gaocaandra: use nano
THX1342: he uses notepad.exer
bichid69: @THX1342 too*
l1ght5p33d: @Sylens__ Idk like highlight with arrow keys, copy/cut/paste, delete line, etc
garydsmith1: @ggtom i use notepad ++ as a replacement for windiws notepad
bichid69: fuck nano
THX1342: bichid69 yes, thank you
gaocaandra: jajajaajaa
bichid69: nano is literal aids
ggtom: garydsmith1 it is actually dope. with extensions it becomes super dope.
routerkicker: yeah nano sucks. vim is pretty nice if you learn most of the keybinds
Sylens__: @l1ght5p33d uhhhh thank you but ill figure it out lol
mr_micoos: Vim team
THX1342: arguing about editors is noob shit
eDONze: !uptime
garydsmith1: @ggtom i like notepad ++ a lot but dont like to code on it
Foxxy_xx: whats he doing?
Sylens__: oof
garydsmith1: who like sublime text more then vim?
bichid69: yeah vim is okay once you spend half your life learning random keybinds so you look cooler infront of your friends
bichid69: asshole
garydsmith1: i do! for now atleast
l1ght5p33d: Editing server files can only use command line
gaocaandra: it doesn't matter what you use, as long as you are using it, but we can all agree sublime is shit tho
l1ght5p33d: all your desktop apps are pathetic
ggtom: garydsmith1 why? i love it tbh once i got used to it. just use the dark mode with correct intellisense thingy.
mr_micoos: Atom&gt;Sublime
kingvoneduard: visual studio is better
gaocaandra: i really disliked the whole interface
l1ght5p33d: except intellij
jib1337: root children Pog
lordmordi_: @bichid69 lol, that's the only people learn to use vim. just to look more intellectual
garydsmith1: @gaocaandra lol why is sublime shit tho? it's good as a text editor
gaocaandra: at the time i didn't know as much
bichid69: you know the chat fucking sucks ass when it's aboute code editors
Artara_: please ban code editor talks
gigafact: i really do not understand the whole obsession about text editors in every programming community
gaocaandra: so maybe right now i'd be able to extract more value out of it
BlueSeamoose: lol
mr_micoos: @bichid69 Hahahahaha
32bitrobo: Geo Hot is a genius, he inspired me to learn python. ALL HAIL Cthulhu
Foxxy_xx: LUL
THX1342: code editor talk is noob talk
gaocaandra: but vs code has been doing fine for me
TheKoreanZombi: And keyboards
frunkAF: LUL
calcmath: try upping the simulations count
triple__m: monkaS
gaocaandra: and colab for prototyping
rockthrone: and keyboards lol
garydsmith1: bwhahha that's ture i am bad programer for now
gigafact: are you a 1 or a 0
garydsmith1: true*
kingvoneduard: 1 is The One
moizai: the one is the zero
THX1342: this chat had a higher mean IQ during the biotech streams
mr_micoos: Is it tea time?
Foxxy_xx: @georgehotz do you sleep in your kitchen?
eldac_kno: lol sleep question
jib1337: Water is the best drink
l1ght5p33d: WKB analysis with cohesion
garydsmith1: @thx1342 that's true
bichid69: ITS FUCKING COHESION TENSION BRO
jsnfly: :D
jib1337: Pog
TheLastMrX: hi me when seeing this on YouTube , love you me
gaocaandra: what do you think it will take to solve md
inmygut: real adhd in motion folks
garydsmith1: @foxxy_xx yea he sleeps in kitchen
FargioFarmani: Now turn the glass over and speak about gravity
buddhm: it's just a bunch of vibrations
THX1342: what's this background clicking noise?
mr_micoos: he doesn't need to sleep
gaocaandra: saying that is like saying a plane is just wings
mero_1181: His dryer
braininavatt: @THX1342 coins in the washing machine Kappa
技術宅: this isn't the secret
bichid69: MD is not a question, hence it's unsolvable
THX1342: why does the loss spike up like that at the end?
l1ght5p33d: Water waves always wkb https://pdfs.semanticscholar.org/4929/2ec387f59e0cf926b6bf6ea0141eb5395af8.pdf
garydsmith1: can't he just use pdi to keep the stick balanced?
truemorpheuz: 1111 it is a good idea
garydsmith1: pid*
THX1342: garydsmith1 sure but the end goal is not balancing the stick it's learning the algorithm
rugito: what are we doing this stream?
THX1342: rugito read the title
garydsmith1: @thx1342 oh i get that. but it can be done with pid right?
THX1342: garydsmith1 sure
rugito: I'm too Pepega to understand title
FargioFarmani: Upload the code
eldac_kno: current water simulations look pretty realistic in movies
garydsmith1: @thx1342 right!
calcmath: isnt the MCTS based on the neural network prediciton of the reard, shihc is bad initially
calcmath: I say just give it more simulations
famaz47: !uptime
braininavatt: PogChamp
PeinlicherAffe: KonCha
braininavatt: I want a badge VoHiYo
THX1342: LUL
PeinlicherAffe: GunRun cvHazmat
jsnfly: how?
l1ght5p33d: @eldac_kno probably just a source video with heavy effects, no useful 3D information
THX1342: add that to the channel name
tauzN: but why?
THX1342: @georgehotz
gaocaandra: ye
whichtom: ye
bichid69: why am i missing the point?
Joooooooooonas: probably not
rugito: Pepega huh
fluorogarbage: deepmind always leaves the secret sauce out of the paper
garydsmith1: @bichid69 lol
gaocaandra: whats the bug?
hurzg: if it can balance a stick, then in theoriy it could also keep an airplane stable
eldac_kno: no, i mean current 3d software has pretty realistic fluid simulation
hurzg: its about the principle
THX1342: change name to @georgehotz_if_you_ask_why_you_are_a_noob
eldac_kno: it is not real time though
mattdougherty22: how was the movie?
Jehhred: Missing the point is my middle name
gigafact: how do you debug this kind of code?
kingvoneduard: I don't do anything, George is doing all the shit.
routerkicker: the inference is real time for sure.
calcmath: neural network for reward is not trained well initially, so it will have spurious one sided policy
THX1342: I'm just seeing the code. Is 1 and 0 "left" and "right" commands for the cart?
calcmath: yes
ggtom: uh check the learning rate
lilou04: sounds monkaS
garydsmith1: did you guys know the internet hates bill gates?
sbamCS: !followage
l1ght5p33d: @eldac_kno Well good just do fourier analysis on results of your sim and let all the beautiful maths die
bichid69: bill gates caused corona bro
ibizi77: square it
CaptainAshtar: is the chat today will be only for subscribers?
CaptainAshtar: again
技術宅: it should be
PeinlicherAffe: what do you think?
sbamCS: which keeeeeeeyboard do u have
garydsmith1: for no reason then he said "increasing people's life with vaxcine they will have less babies"
PeinlicherAffe: @CaptainAshtar CarlSmile
truemorpheuz: @PeinlicherAffe yes :)
calcmath: add back the softmax
PeinlicherAffe: @truemorpheuz :)
calcmath: no add it the new place as well
truemorpheuz: :)
bichid69: softmax sandwich
nejintejag: those sounds in the background.. Is there a dog or some animal in the apartment?
chemicalflash: is self.maximum = -float('inf') correct ?
braininavatt: balance my stick Kappa
l1ght5p33d: multi max .. deep mind's secret sauce
calcmath: higher UCB score gets weighted too much if you dont use sftmax
bliutwo: Sorry, I'm new to the stream. I won't ask a question like that next time. Love the stream! &lt;3
rockthrone: pretty sure it's laundry
rudolphdoesgames: @nejintejag dryer
Rocky_88: when you realize chat doesn't do laundry
rockthrone: haha
garydsmith1: DiSHwAShEr
K1ngjulien_: good evening!
garydsmith1: we gona get a hype trin going?
garydsmith1: train*
MrVitoDayz: this looks nice
bliutwo: !faq
K1ngjulien_: what are you working on? invers pendulum simulation?
gaocaandra: what is multimax?
MrVitoDayz: can I apply this to biology ?
bichid69: bro this stream is so frustrating it's ruining my mental health
nejintejag: @Rocky_88 haha actually doing laundry as we speak. But we have a community laundry place in my house.
MrVitoDayz: @georgehotz
技術宅: yay physics sim is doing something
THX1342: Rocky_88 I do laundry at the river over the stone
rockthrone: rockthrone subscribed at Tier 1. They've subscribed for 6 months! Thanks for a cool channel!
Rocky_88: im just messing around
l1ght5p33d: @bichid69 leave
garydsmith1: @bliutwo what kind of question
truemorpheuz: i enabled rtx voice, so i dont have to hear his background noise
bliutwo: @garydsmith1 i asked him "why chromium over firefox" and he timed me out LUL so my bad, i didn't get it
bliutwo: new to the stream, that'll happen
fluorogarbage: did you add exploration noise at the root
garydsmith1: @bliutwo lol
braininavatt: #stretchminute chat
THX1342: geo, how do you choose research topics to work on? Is it from papers you read?
braininavatt: go
Basti_Soldier: NICEEEEEEEEEEEEE
THX1342: oh he's gone
技術宅: jenny82Q
bliutwo: @garydsmith1 what if i ask the same question, but i use "how did you decide to use chromium over firefox" xcalThinking do you think he'd ban me if i asked it that way?
rraksut: manneredKappaCyborg
K1ngjulien_: i do not agree with your music choice.
staypeaceful89: !faq
ggtom: bliutwo take one for the team
garydsmith1: @bichid69 won't answer i guess, he uses chromium because chrome has better security and away from google
garydsmith1: @bichid69 he found bugs in firefox
sakshambhutani2001: listen to Skechers by drip report
Lizardan: !uptime
CJslider14: zooming != visualization
bliutwo: @ggtom it's fine, he knows i'm supporting him by being a sub, so even if he bans / times me out , at least he'll know i'm supporting him
Lizardan: Firefox &gt; all
metallsimp: use tor
garydsmith1: bwhahahha
ggtom: chromium PepeLaugh
lilou04: whats wrong with chrome
TheKoreanZombi: Bikeshedding
FargioFarmani: Opera?
技術宅: curl
bliutwo: hahaha truuuu
braininavatt: monkaS
Snobbysteven: edge 4 lyfe!
K1ngjulien_: lynx all the way LUL
3ygun: Firefox nathanGodstiny
fluorogarbage: exploration noise homie
tauzN: internet explorer best
技術宅: you had too much faith
saintmthw: LUL
bliutwo: 3ygun i see you are a man of culture as well
juviin: the face of a disappointed father
eDONze: PokSuicune
tajpouria: There is 1% of chat geo
bliutwo: 3ygun Hhhehehe
3ygun: @bliutwo Of course nathanWeeb
lilou04: what about tweeter vs facebook
HopZe: KKona
getjump: internet explorer Kappa
技術宅: am I timed
braininavatt: there you go chat, ie it is SeemsGood
outgray: terminal
bliutwo: terminal as an internet browser Pog
getjump: tabs vs spaces lets go
Digital_donger: autoplay mizkifS
garydsmith1: why is that a stupid discussion tho?
bliutwo: atom vs sublime Pog
braininavatt: yt autoplay WutFace
bliutwo: vim vs emacs Pog
mondeverest: BibleThump
FargioFarmani: What about Microsoft Edge tho??
bliutwo: LOOOOOL
技術宅: ^ those examples are why
bojosos: Do you think North Korea leader is dead?
outgray: yea
bliutwo: truuuu, i see your point
bliutwo: thank you for explaining
saintmthw: emacs and vim LUL
calcmath: I think adjusting temperature of MCTS softmax might fix issue
dgkng0d: yo George how is quarantine going
fluorogarbage: exploration noise at the root
a_ato: 60%
gigafact: new banned question: text editors?
bliutwo: georgehotz i haven't used jupyter notebooks much, can you tell me what is great about them?
lilou04: 1 is bigger than 0 so 1 it is
fluorogarbage: slap a dirichlet on that bad boy
calcmath: low temperatute means sensitive to small changes in value
garydsmith1: you know why this problem is harder for george this time? he's reading the chat too much
TheKoreanZombi: Browser chat = Bikeshedding: The act of wasting time on trivial details while important matters are inadequately discussed due to lack of expertise by those involved.
bliutwo: truuuu reading chat is pretty distracting
garydsmith1: @bliutwo yes
Zasuslive: 'whats better x or x'.. whatever tool helps you get whatever youre trying to achieve done, thats it.
calcmath: is the cartpole always going to fall right at the beginneing?
outgray: ok use brainfuck
tatsumiss: !uptime
dgkng0d: he got some tunnel vision skills
ggtom: LATER NERD got eeem
dgkng0d: but i can't even focus for 30 minutes Kappa
braininavatt: LUL
god_damn: see thats why humans are gunna be fine, terminator isnt going to happen
garydsmith1: @zasuslive dont you think when we understand why someone's using one tool, we understand what we can use that tool for?
sananelansalak13: insane
bliutwo: @Zasuslive true - personally, i just have privacy concerns, that's all
bliutwo: @garydsmith1 ^
romulan_empire7: romulan_empire7 subscribed with Twitch Prime. 
Ledouin: HACKERMANS
bojosos: ay I would love to know what that board of keys is but I am never going to find out
fluorogarbage: dankest distribution
ggtom: it's a distribution
garydsmith1: @bliutwo yeah exactly, you get to know about the spyware
bliutwo: @bojosos honestly cm storm tkl browns is my fav
sananelansalak13: :D
garydsmith1: @bojosos search commai archive. you will find out
sananelansalak13: do a ctf
ggtom: fluorogarbage a fellow statistician sheneyEneyW
dgkng0d: and i want to thank the guy who gifted me sub 4 month ago bro I'm sorry I didn't even notice that TakeNRG TakeNRG
mr_micoos: what time is there
sananelansalak13: play ctf
GoosemanTV: do CTF!
Mariosavitch: hulk strength
bliutwo: @garydsmith1 i love google, but privacy is a huge concern to me - not for any particular reason other than i believe in privacy to its fullest extent
whichtom: its 10:00
lilou04: cooking stream when?
garydsmith1: @dgkng0d yeah happend to me too
garydsmith1: @bliutwo yeha i get it
mero_1181: Dirichelet function puts mass 1 on alpha
mightbewill: it's the start condition biased or something,
ggtom: ban this deno nerd
mero_1181: 0 otherwise
技術宅: jupyter is intuitive and easy to get useful data visualization
bliutwo: @技術宅 thank you, that is a helpful answer
Zasuslive: @garydsmith1 yes if you know why someone uses a tool perhaps it may be useful for you too but thats usually in very niche use-cases, in which case u shud be asking specifically 'do u have a better workflow for doing x'
Digital_donger: mizkifSad yes
qatarking24xd: float
aacarm: if eggs are best by today, they are likely still ok.
calcmath: dirichlet distribution is a probability distribution of probability distributions
garydsmith1: @zasuslive yeah i agree with you
mightbewill: sink good
jh_od: I love you 💕
Krakatoa77: sink good
Zasuslive: @bliutwo if u care about privacy to its 'fullest extent' u need to get off the internet and get rid of your tracking devices
sananelansalak13: play a ctf
ostbobmuon: plz give url what he is doing
bliutwo: @Zasuslive true, you have a good point
gigafact: @ostbobmuon https://arxiv.org/src/1911.08265v2/anc/pseudocode.py
ostbobmuon: thx
getjump: Georgo mah boy eating egs
tajpouria: It seems like chat makes george to t think why he even streaming
bliutwo: @Zasuslive i just wish that the two categories "privacy" and "convenience" weren't two separate, completely non-overlapping circles (in terms of a venn diagram)
Zasuslive: @bliutwo sorry that might have came across rude, i just consider 'privacy to its fullest extent' as going full richard stallman
FargioFarmani: He is working on MuZero Implementation. Summary: https://www.youtube.com/watch?v=dQw4w9WgXcQ
bliutwo: @Zasuslive you good
bliutwo: @Zasuslive stallman has definitely lost his credibility over time
bliutwo: some shit that guy says is something else
mattdougherty22: I will no longer have lower expectations. My fault Geo
mightbewill: eggs: float=bacteria metabolizing egg to gasses
Himdextermorgan: do you guys think that working as a backend developer can be a start to be a ethical hacker one day?
lolzmaster99: What part of the algo is he working on rn?
rudolphdoesgames: @FargioFarmani damn that was a shitty one
bliutwo: @Himdextermorgan can't you just take a class and get credentials to be an ethical hacker?
FargioFarmani: I'm sorry
Himdextermorgan: not that easy in my country @bliutwo
ggtom: FargioFarmani you are forgiven
mattdougherty22: George, what do you think of Dexter?
bliutwo: @Himdextermorgan damn, sorry to hear that
saintmthw: @Himdextermorgan then how would we know
bichid69: fandango
Mariosavitch: 1111
ggtom: less stupid = more smurt
bichid69: still stupid
just4valorant_: rick and morty out in a week boyzz
Mariosavitch: scramble
rudolphdoesgames: fried
bliutwo: scrambled
aacarm: fried
braininavatt: Jebaited
whichtom: scramble
pakard: scrambled
lolzmaster99: Scramble!
bichid69: scrambled
ggtom: scrambled
eyep1e: scrambled mofo
Himdextermorgan: @saintmthw the point is there is no specific course i could take here which would make be an ethical hacker, but there is a lot for software development
mattdougherty22: omlete
laflame954: How do i get geroge tier hyper focus
bojosos: baked
qcDENNEMANN: What chair is that?
bliutwo: @laflame954 he's still reading chat, so ur boned
eyep1e: scrambled in a tortilla wrap
eyep1e: dont judge me
bliutwo: @laflame954 if that's your goal,* that is
nejintejag: Don't do any type of hacking it has a horrible reputation.
Zasuslive: pluralsight is free till end of this month guys if you want free resources, i dno how good it is but its free rn so its worth checking
garydsmith1: @himdextermorgan just learn the skills and prove that you have the skills can get you a job
bliutwo: i mean, helping people protect themselves against security exploits seems pretty awesome to me
saintmthw: @Himdextermorgan are there ethical hacker careers in your country? look at those and work backwards from there to see what u have to do
bliutwo: that would be considered "hacking"
aacarm: those eggs are fine
lolzmaster99: @Himdextermorgan To be a "hacker" you need to know how things work (networking, web apps, etc.). Start with learning how to build those things, then when you understand you can come back and try to take them down back
PhosphoricAcid: me
garydsmith1: where is my egg
gigafact: marketing people
bliutwo: you can literally get a credential to be one!
ggtom: some nerds lul
nejintejag: hacking for losers
bliutwo: LUL
getjump: B I O H A C K I N G
tajpouria: 😅😅😅😅
saintmthw: LUL
gabrielopesantos: haHAA
chemicalflash: hacking ethics
Himdextermorgan: lol
bliutwo: HAHAHA
saintmthw: i think this dude just doesnt wanna get arrested in his country
bliutwo: eggs look great bro
routerkicker: put prints in muzero/mcts to find out where the bogus values are introduced
Zasuslive: u need some ketchup and toast bruh
greyoctagon: this whole idea of getting a piece of paper that says you're a haxxor is so last century
bliutwo: LOOOL
just4valorant_: give one sir
braininavatt: VoHiYo can I get mine?
Lite98: Ethical hacking ml7Head
saintmthw: PogChamp really?
kaksoispistedeh: dude, i had to visit one of these ethical hacking courses, and it was very useful for me personally. it made me realize how bullshit certifications are
bliutwo: WAIT REALLY
K1ngjulien_: "if you don't get caught its not illegal"-hacking
braininavatt: cant wait to have mine :)
tajpouria: definitely can apply job
bliutwo: ok once i get my job i'll pay you $200 (mainly for the entertainment, but also to put the frame on my wall)
balloonpopa: how do I get one sent to me? I'll frame it on my own
lilou04: PepeHands
Artara_: do you still have your useless waffle maker?
nejintejag: @chemicalflash I think that it just a lawyer.
qubitmanipulator: you described subscribers
bliutwo: qubitmanipulator LUL
bliutwo: qubitmanipulator truuuu
NicosPops: good stuff man!
Lite98: All human beings need a sense of worth and validation from other humans
ggtom: is the m variable the tree?
bliutwo: !git
Himdextermorgan: @saintmthw yeah there are a lot of jobs for that, but the colleges which offers this kind of course is too far from here..
euiq: should have used rust
ggtom: i have a feeling there's an object that needs to get reset in jupyter notebook
rudolphdoesgames: @bliutwo https://github.com/geohot
garydsmith1: @lite98 not to the point where you won't believe yourself
gaocaandra: you have the internet you dont need college
bliutwo: @rudolphdoesgames thanks!
Lite98: True @garydsmith1 @georgehotz
fluorogarbage: exploration noise didn't work?
Kodaly: i don't have any friends :(
bichid69: isn't validation from other people for money necessary for the prostitution business
ophicleidon: Anyone know how easy it is to get a remote reversing job if you just play (and win) CTFs?
bliutwo: @bichid69 LOOOOOL
bliutwo: what the fuck
jontowtruck: today is monte carlito arbol search?
bliutwo: let me just say that i love python because it's basically pseudocode that works
YOLOMAN1343: how many subs until you become a full time steramer
euiq: 1 1 1 1 1
bliutwo: YOLOMAN1343 5k
lolzmaster99: What is the output here?
jonathan865: this looks like it diverges? what is your learning rate?
Lite98: I dont think prostitution has anything to do with validation from either party, its simply a service @bichid69
Zasuslive: does george play any video games
lilou04: what if its some 900 iq ai thinking and we cant understand the output
euiq: @bliutwo for some definition of "works"
mightbewill: it's the sim biassed?
bliutwo: euiq LUL tru
garydsmith1: how do you guys deal with corpall tunnel syndrome?
YOLOMAN1343: learn dvorak @garydsmith1
hurzg: is it set to boolean? :D
ophicleidon: Just dont get it 4Head
eldac_kno: go to a doctor
bliutwo: @garydsmith1 generally i try to take scheduled breaks
bichid69: @Lite98 isn't a sexual service inherently some form of validation
bliutwo: oh yeah also go to a doctor if you actually have it
Aedroth: LOL
braininavatt: mine does :)
nejintejag: @bichid69 do you think the prostitutes that you by actually like you? they think of you like a loser with money.
garydsmith1: thanks guys!
Mobius5: TRUEEE
bichid69: no but evolution bro, sex=validation
K1ngjulien_: Show your worth by doing stuff thats good.
euiq: subscribing is all about belonging to the in-group
jordandiazdiaz91: jordandiazdiaz91 subscribed at Tier 1. 
BaRtMan1912: @georgehotz New to the stream, could you tell me wtf im actually looking at right? LUL
YOLOMAN1343: you still with that one white girl @georgehotz
bliutwo: in my experience, having a degree makes getting a job easier, but there are definitely lots of people who don't have a degree who are awesome and employable too
Lite98: @BaRtMan1912 Youre watching smartness
YOLOMAN1343: the one that works for computer
fluorogarbage: Have you looked at pb_c again?
BaRtMan1912: @Lite98 no shit xD
SlowDeluxe: what happend to the razer laptop, mac still the champ ?
jordandiazdiaz91: good job
ophicleidon: Does the optional typing in python help at all? I didn't have a good time with it but it was quite a while ago
bliutwo: georgehotz do you like mario games?
bliutwo: sorry if that's a stupid question
ophicleidon: Saw a -&gt; float there
garydsmith1: @slowdeluxe he said windows is for boomers, i agree and still use it...
eldac_kno: you guessed it right lol
bliutwo: ophicleidon what does optional typing mean? like how variables aren't explicitly typed?
FargioFarmani: a: int = 0
bliutwo: same, i'm a boomer and i play games, so windows is the os for me rn
lilou04: why 1's land = bad?
Zasuslive: windows for boomers, osx for millenials, ios/android for zoomers
ArcherCreatlol: why does chat look so cancer?
bliutwo: ArcherCreatlol whoever smelt it dealt it
euiq: interesting that schrittwieser is first author
euiq: any insiders?
bliutwo: i'm inside gachiGASM
garydsmith1: the sad part is i dont eve play games, linux doesnt work fully in my laptop
garydsmith1: even*
bliutwo: damn, that sucks
bliutwo: i usually use ubuntu, but quarantine prevents me from going outside, so i play games more now
garydsmith1: oh right so dual boot?
bliutwo: exactly
技術宅: sushiWOW
Zasuslive: george do u play video gamez or nah
bliutwo: LUL
mondeverest: Jebaited
kaksoispistedeh: i use arch btw :)
bliutwo: LOOOL
not_Awful: prob
lolzmaster99: No dude
eyep1e: nico pleb
euiq: just don't say the k word
azer0s: azer0s subscribed with Twitch Prime. They've subscribed for 2 months! ayy love you George, keep it up!
Digital_donger: windows xp was cool
euiq: monkaS
braininavatt: monkaS
garydsmith1: George is getting so frustrated
Krakatoa77: LUL
saintmthw: are you having fun at least?
Legardovia: hi everyone
bliutwo: me
rudolphdoesgames: @niko174_ he is implementing MuZero
Mariosavitch: you
lolzmaster99: I don;t think you can get away with taking out the min_max_stats
lilou04: me
Vackin: i
crawcraw66: me i think
BaRtMan1912: me :)
Artara_: 42
bichid69: everyone in chat
Zasuslive: lmao
parktype: me :D
3ygun: They’re useful @georgehotz nathanW
eldac_kno: russian letters=/=russian, but that was russian yes
euiq: Kappa /
Digital_donger: mizkifYo
Mariosavitch: who wrote it
3ygun: KappaPride /
lolzmaster99: It normalizes values and long term they will blow up
Spenceri102121: Me :)
gabrielopesantos: KappaWealth
bichid69: nothing works is my new life motto
chemicalflash: didn't you say that the point of the streams is that there is no point?
eldac_kno: point of stream is to make ppl think
bliutwo: at the least, georgehotz you know that your personality has entertainment value and that people are willing to pay for it
mondeverest: LUL
lilou04: LUL
LaheyFPS: LUL
Mariosavitch: LUL
gabrielopesantos: LUL
mhammad123: ay wasap rn
ophicleidon: LUL
bliutwo: LUL
SlowDeluxe: KEKW
jontowtruck: LOL
saintmthw: LUL
parktype: LUL
bichid69: hahahaha
mhammad123: who got banned lol
技術宅: twitch Dan Harmon
williami000: Owned
Krakatoa77: LUL
garydsmith1: bwhHahahhaah
Digital_donger: dictatorship PogChamp
not_Awful: fuck
gaocaandra: banhammer
mhammad123: Bruh wat he did to get banned bruh
ophicleidon: monkaS
lilou04: time to seize de means of donations
Mariosavitch: i aint scurd
bliutwo: LUL
not_Awful: really?
slevinxd: i think i know whos gonna replace kim
namenamison: But can you ban us all if we all raise against you?
rudolphdoesgames: @mhammad123 dont risk it
gaocaandra: you get a ban you get a ban
jontowtruck: kim yo jung for President!
mhammad123: He was a scapegoat lol
Zasuslive: anybody could get it
fluorogarbage: Have you taken a look at the action selection constants? The ones from the paper are for higher dimensional envs
gaocaandra: everyone gets a ban
easysleeep: hahahaha
bliutwo: @namenamison LUL
not_Awful: fear&gt;love?
garydsmith1: someonss making a new account
Plurmorant: monkaS
ophicleidon: monkaS
anguscupcake: will u ban a SUBSCRIBER
TsihTV: george for leader of north korea
bliutwo: monkaS
murermader: do it
lexxy23: relax!
Mariosavitch: monkaS
sakshambhutani2001: lol
gaocaandra: jajajajaja
frunkAF: I didn't say nothin, pls
bojosos: you can't
eldac_kno: fear means respect
lolzmaster99: Chill bro
mhammad123: unban his ass bro :c
bojosos: you need money
qubitmanipulator: create a ban bot.
bliutwo: yeah look at me i got timed out
chemicalflash: or we ban you by not watching?
SlowDeluxe: don't do it chat im trying to learn monkaS
3ygun: He insulted our Lord and savior @georgehotz
parktype: can I be banned? :D
Basti_Soldier: noooooo ajajajjaa
bliutwo: @chemicalflash he's too notorious to have no viewers
braininavatt: just make sure to not choose your heart surgeon from chat Kappa
garydsmith1: fear means fake respect
Mariosavitch: i know why
fluorogarbage: print the visit counts
LaheyFPS: I know why
ophicleidon: @georgehotz twitch chat is just irc, 10 lines of python and you can ban whoever says anything Kappa
alphagainzzz: perks of being a dictator LUL
TheKoreanZombi: He will ban a subscriber to strike fear in the proletariat masses.
Mariosavitch: me :)
bliutwo: @braininavatt LOOOOOOOOL TRUU
bichid69: 1 is the loneliest number
bliutwo: @braininavatt it's never too soon
bliutwo: alright have a great stream, see ya bro
garydsmith1: bye man
LaheyFPS: It's simple why it just outputs 1's
ronnyosnes: does he still do security related stuff or only ml?
lilou04: the graph changed PogChamp
eldac_kno: mostly ml
q4nt3r: you don't need to ban all, just the ones initiating the revolt... hit once, hit hard LOL
Mariosavitch: it knows Pog
SlowDeluxe: Pog
braininavatt: it did something PogChamp
azer0s: @georgehotz create something like chaosmonkey for twitch. instead of killing k8s pods, it just randomly bans people.
lilou04: learning
slevinxd: moves like jagger
ophicleidon: isn't that a lot of 1s :thin\
garydsmith1: did someone actually got banned?
calcmath: good search is inefficient and not scalable
braininavatt: WE DID IT CHAT VoHiYo
ophicleidon: 🤔
JdPaulBlart: anyone want to start a cout with me?
eldac_kno: ban every tenth just like in good roman times
Tuhafadam: Hey
bichid69: I have to go do some webdev now, fucking hate webdev
garydsmith1: is George a nice person in real life?
namenamison: @JdPaulBlart how do you start a cout on twitch?
JdPaulBlart: yes supreme ruler hotz is a very nice person
garydsmith1: @bichid69 for your job?
namenamison: Someone ban @georgehotz
garydsmith1: @jdpaulblart lol
lolzmaster99: Transfer learn old search to the MCTS?
bichid69: @garydsmith1 just freelancing for cash bro, times r tough
garydsmith1: @namenamison what if he bans you?
mhammad123: supreme leader geocoldz
lolzmaster99: Warm start on MCTS
garydsmith1: @bichid69 i would like to do that too, where do you do it?
Mariosavitch: daddy bezos
calcmath: use trained value network in MCTS? to see if it works
guest1GRjBAYo: are drops on?
rudolphdoesgames: @guest1GRjBAYo lmao
takkat14: have you seen WANN solution of cartpole?
JdPaulBlart: we should use muzero to solve your speed challenge on github @georgehotz
garydsmith1: @namenamison lol onle bezos or the twitch social team can ban hots
azer0s: I feel super dumb. what is going on and what is muzero?
eldac_kno: muzero is new algorithm by deep mind, use google ffs
mhammad123: looks like namenison got fuked
garydsmith1: @azer0s he's trying to learn how to make the computer learn to balance that stick
lilou04: MonkaHmm
azer0s: @garydsmith1 @eldac_kno thanks!
rugito: @eldac_kno who's google
Krakatoa77: Pepega
ophicleidon: I think you need a whole lot more than 100
lolzmaster99: You need the normalization!
lolzmaster99: From min_max_stats
lilou04: monkaHmm
garydsmith1: @namenamison can you lend me some amazon stock?
calcmath: use softmax fn, ur susotm one might be overflwoing
garydsmith1: @azer0s yeah!
Mariosavitch: bab
calcmath: softmax overflow bug
lolzmaster99: Put min_max stats back in
lolzmaster99: It normalizes values
azer0s: but like....can't you do the same with fuzzy logic? 😅
mhammad123: @namenamison is u still alive lol
toobossbear7: hi Cheer1 Cheer1 Cheer1 Cheer1 Cheer1
garydsmith1: @azer0s hes trying to learn how to do it this way
calcmath: classical softmax floating point overflow bug
azer0s: @garydsmith1 fair enough 😂
lolzmaster99: Add 1e-12 to probabilities to avoid overflow
tripcloth: what is mcts?
takkat14: you should use expit
lolzmaster99: No way wow dtype=float64 ftw
mhammad123: @namenamison yEaeaaeEa duUde
takkat14: because of overflow
garydsmith1: just so you guys know, twitch chat is the subtitles of the video
niko174_: Осуждаю за твой поступок &lt;3 Guys I m come back
eldac_kno: remember no russian
garydsmith1: @niko174_ who are you?
jagger_rsw: polish?
niko174_: no
jagger_rsw: yes
niko174_: I from Russia
ak0ya_: @niko174_ where in russia are you from?
jagger_rsw: speak american
lexxy23: uk english?
garydsmith1: @niko174_ oh roght
mhammad123: geohotz chill out يزم
foti_kasparov: Espanol?
jagger_rsw: only brits can speak
parktype: What abt Spanish?
mattdougherty22: Do you know who Daniel Schmactenberger is? Talked with Eric Weinstein about zero sum society and the need/how to design new game recently
技術宅: this is the most 4chan chat in twitch
SurfCat: We speak only American here brother KKona
Mariosavitch: rip
niko174_: Ok, I undestood
Defak: D:
jagger_rsw: Da
Featen: Did we discover how did it win with people in chess?
lemmywemmy: hell yeah brother KKona
Killon1: hi @georgehotz
tauzN: @技術宅 yikes
bojosos: what about Bulgarian?
garydsmith1: @namenamison is dead
Defak: English only 3Head
foti_kasparov: Français?
kingvoneduard: Mesicanos
prafaeltsantos: portuguese?
the_best_russian_bear: Русский?
jagger_rsw: cyka
azer0s: Deutsch?
Mariosavitch: l33t speak?
parktype: speak;
andrewVadeika517: andrewVadeika517 subscribed with Twitch Prime. 
eldac_kno: english mf do you speak it
maxschneider96: Only python and english fellas
foti_kasparov: YEAH !!! GO CHANNEL POINTS ! GO PLEBS!!
andrewVadeika517: sup geohot
gabrielopesantos: -430 DatSheffy
qubitmanipulator: Sub-only Kappa
ophicleidon: channel points were a mistake BibleThump
garydsmith1: come on hype train!!!!!!!!
mhammad123: كس امك يزمwhy you enable subscriber only
jagger_rsw: I think distracting George to talk about anything else than the current topic is an art in itself
eldac_kno: agree
niko174_: What do y think about russian programmers?
guest1GRjBAYo: eat ass, smoke grass
garydsmith1: @jagger_rsw yes, but we get less streams
Poralo45: Poralo45 subscribed with Twitch Prime. 
maxschneider96: That´ s what I meant with AI for chat previously
LaheyFPS: why not get more moderators?
guest1GRjBAYo: Chat: 1 George: 0
chemicalflash: sub only chat ?
gaocaandra: in the night it's better
Tuhafadam: how do you test it ? on gui ?
garydsmith1: can i be a mod?
Joooooooooonas: The problem is if you are upset, more people try to troll you (because they think its fun), it would be best if mods would just timeout those guys without you mentioning them, less people would try to troll and you would be more efficient
gaocaandra: less shit talk
kaksoispistedeh: less geohot streams PepeHands
gigafact: increase the points to chat even if you are not a subscriber
mangoxavier: Haha
lilou04: when you gonna bring a viewer on stream and teach him how to code?
parktype: parktype subscribed at Tier 1. They've subscribed for 3 months! Don't take the stream away I like learning D:
garydsmith1: @laheyfps can you chat in sub only mode?
gaocaandra: yo
ak0ya_: @Joooooooooonas agreed
gaocaandra: hypetraiin
braininavatt: HYPEEEEEEEEEEEEEE
azer0s: what @joooooooooonas said.
jagger_rsw: HYPE-r-loop
tripcloth: twitch chat is cancer man, it's just the way it is
jagger_rsw: ok, let's all be serious and helpful now!
MrVitoDayz: Not all of it
eldac_kno: the game looks like gravity game on old phones
eldac_kno: would be fun to teach ml to play that
foosballs: gist of what naive search function is doing?
garydsmith1: SMOrc
garydsmith1: is commai archive on the chat?
jsnfly: Maybe use KnownBounds(-1, 1) to prevent nans
gigafact: yes
smurfd0: is the stick standing or falling?
calcmath: Look up softmax overflow bug
jagger_rsw: is MCTS monte carlo tree search?
garydsmith1: @gigafact wait are you commai archive?
mangoxavier: So close
braininavatt: PogChamp
eldac_kno: no russian bro
braininavatt: !mods
metallsimp: is this like a russian spy hub?
eldac_kno: he is just kinda famous in russia
chemicalflash: have you looked into neuroevolution strategies like NEAT for game playing?
lolzmaster99: You're supposed to normalize the value of the actions, output of value net
FargioFarmani: @georgehotz How do you compute the mean action vector?
brisingr1031: wait so what is cartpole?
lolzmaster99: Can I see where you put the normalization?
jsnfly: :D
foti_kasparov: SpaceX rocket
nomorequity: !uptime
LaheyFPS: 3 hours 17 minutes @nomorequity
gaocaandra: imagine commaX the android of space launch
mangoxavier: This is insanely interesting.
moshiko777: hello
mangoxavier: Are you working local?
mangoxavier: Nvm see url
Joooooooooonas: just take the norm of that negative Kappa
calcmath: can you print visit counts of all the tree nodes, might help to debug
rudolphdoesgames: from retrothrusting to no thrusting
Mariosavitch: because it values death
KyoshiDeath: how long has the stream been going for ?
gaocaandra: how does it know?
chemicalflash: maybe double cart pole ?
lolzmaster99: breakout-v0
poppingtonic: have you tried training recurrent world models?
whichtom: any atari ones?
LaheyFPS: @KyoshiDeath 3 hours 20 minutes
alexlucas__: Ant-v2
Plurmorant: geoguesser
KyoshiDeath: Thanks @LaheyFPS
whichtom: montezumas revenge
DasMastah: Minecraft
l1ght5p33d: @mangoxavier 8888? that mean external for some reason? what u mean
foti_kasparov: Do us
gaocaandra: BipedalWalker-v2
Plurmorant: montezumas revenge is NP-Impossible
lolzmaster99: Mountain car again?
lolzmaster99: It never worked before
YorkLai: can you share your bash and tmux setting?
smurfd0: spaceinvaders?
sondreal: Remember to hit the subscribe button boiiis!!
takkat14: what do u think about weight agnostic nn-s?
Mariosavitch: how does it know what the goal is mr hotz
foti_kasparov: @YorkLai github.com/geohot/configurations
foti_kasparov: configuration*
chemicalflash: double cart pole is easy next step
Plurmorant: tfw no reward FeelsBadMan
michelfugain69: how r u so smart 4Head
DeeboMC: Been at it like 3 and half hours already?
whichtom: Acrobot-v1?
Tuhafadam: Is it memorize how to play or learn how to play ?
ophicleidon: what model is he trying to train?
mangoxavier: Haha I have the same dryer or washer song lmao
Choruptian: wait did you get it to work?
Choruptian: I missed it
Penguino138: Up and at em
michelfugain69: Which GPU do you have @georgehotz ?
K1ngjulien_: @aldelecrane looks like an iMac or something, so a shit one
SlayerX1: LUL
Penguino138: How's the chat been behaving this morning?
michelfugain69: @K1ngjulien_ lol
smurfd0: your lunarlander does not shoot out those "feelers" that it does on the example
rudolphdoesgames: @Penguino138 bad
mangoxavier: There should be a weeble wobble sim
bojosos: We are free
michelfugain69: Double kills from geohot
Penguino138: @rudolphdoesgames Why is that? Been off topic again?
foti_kasparov: Acrobot got some moves
mangoxavier: That would give artificial gyro balance
K1ngjulien_: George how many WPM can you do on TypeRacer?
Seatedfury: Seatedfury subscribed with Twitch Prime. 
DeeboMC: Pedro asked if you could hack the NSA
FargioFarmani: @georgehotz Do you think AI will take control over us in the next 10 years?
kaksoispistedeh: fucking Pepega chat
rudolphdoesgames: @Penguino138 a lot of dumb questions and stuff
Penguino138: Oh god i see all the message deleted it must be bad
DeeboMC: But then said he was joking
be9ns: Favorite computer doccumentaries?
ophicleidon: @georgehotz look at a0lite for a very simple mcts example
eldac_kno: protest looks like scam tbh
not_Awful: weak
bojosos: Protestj
K1ngjulien_: protest during lockdown? not a good idea
axlebear: sounds good
KiroShibaa: hi!! i'm your fan &lt;3
mangoxavier: Laundry takes long time.
Penguino138: Protesting what?
gaocaandra: he is under 30
sakshambhutani2001: anti-lockdown protest?
not_Awful: what protest?
gaocaandra: he is ok
lolzmaster99: protests is astroturfing bro
lolzmaster99: youre a sheep
whichtom: freedom to work?
Tuhafadam: corona protest realy ?
axlebear: KKona Freedom
dorkmo: dicks out for harambe
whichtom: oh im down for that
not_Awful: ty
maxschneider96: Any other projects u´ ll be streaming soonish?
Penguino138: Protesting stagnant air in our apartments :p
K1ngjulien_: you gonna wear a mask?
DeeboMC: I wouldn’t have figured you as the protest type
MrJeff_: I agree.
FargioFarmani: Meet you there George
gaocaandra: make sure to kiss everyone in the mouth tho
gaocaandra: just to be safe
lilou04: that protest will turn in a meet and greet for geo
sakshambhutani2001: they are more of Trump rallies!
keith282: COVID isn't fun. Please be careful my guy
r0xtehem0x: r0xtehem0x subscribed at Tier 1. They've subscribed for 2 months! 
mangoxavier: Lifeguards are totally behind this.
be9ns: give me a good comp sci documentary
whichtom: dude i wish i was in socal
MrJeff_: We can't protest here. UK. We'll get arrested.
tytos01: what is this protest about ?
michelfugain69: 1 meter away
mattdougherty22: Israel has a good reopening plan
eldac_kno: joker masks
garydsmith1: @be9ns snowden
MrJeff_: The UK is a joke.
foti_kasparov: Clean your shoes after coming back
joseanavarrom: But you might be asymptomatic, that's the point
whichtom: the UK is a joke I agree
bojosos: wear a anonymous mask
axlebear: the breeze can carry the virus
Penguino138: Where can one even buy masks anymore? Amazon is like a black market with sketchy selelrs
eldac_kno: joker&gt;anonymous
K1ngjulien_: well the fever takes two weeks to develops
mattdougherty22: Israel has a good reopening plan with a points based system
keith282: Damage has been shown in the CT scans of asymptomic people's lungs
fireposeidoncx: What is your final opinion on the Corona virus?
Tuhafadam: illogical
bovine_shield: Good afternooooooon.
Bacon4Life_: monkaS
braininavatt: monkaS
Penguino138: Oh no george is hot!
mangoxavier: What about the ppl they interact with after?
alphagainzzz: lol
ak0ya_: and girls :)
K1ngjulien_: from christian drosten, the guy who develped the first test
Joooooooooonas: what is that in celsius LUL
keith282: https://pubs.rsna.org/doi/10.1148/ryct.2020200110
joseanavarrom: None of us are doctors George
michelfugain69: Put milk on the cerales
garydsmith1: @joseanavarrom someone might be
niko174_: Nice, metric system
MrJeff_: I had a few drink with mates earlier. (currently 7pm in UK). We don't care tbh.
Penguino138: Is traditional SARS 3x flu too?
kaksoispistedeh: so, 3x0=0?
K1ngjulien_: more like 10x, but only if you 're old tbh
DeeboMC: Are you going to the protest just for something to do or because you think it will make a difference?
nejintejag: If they get infected whether you get symptoms or not they will produce new viruses that they will breath out.
eldac_kno: yes, that's called education
csal90: so true lol
gaocaandra: do you think wolfram lang is what you meant when you said you wanted a mix between coq and python?
bichid69: is it still ones?
jagger_rsw: doctors are practioners of science, not researchers
sakshambhutani2001: In most of the places, these are more of Trump Rallies
axlebear: PepeLaugh
poppingtonic: what's the protest really about?
yuptheladsdownthecans: @MrJeff_ you might not care but more vulneralble people do care
mangoxavier: Healthcare is a scam.
Penguino138: And Alex will probably be there
funwayz: measure temp after protest Kappa
michelfugain69: I hope you dont get sick, we need smart people like you
garydsmith1: you should stream the protest
joseanavarrom: AI will revolutionize current medicine
DeeboMC: Ok cool. That makes sense
bovine_shield: Wiggle waggle
K1ngjulien_: there's gonna be a lot of idiot antivaccs moms there
fireposeidoncx: Are you still using metamath?
axlebear: somebody clip it for when he gets the virus
tytos01: @georgehotz are you going to make a live video at the protest?
sakshambhutani2001: make America great again
garydsmith1: but if we drink bleach we will be safe
eldac_kno: don't you think when you go to a protest you are being used by people who benefit from it
Penguino138: @aldelecrane The only way geo is gonna get sick is if he forgets to wear his jacket when it rains
eldac_kno: any protest
maxschneider96: @joseanavarrom more than 230 companies out there using AI for drug discovery, it´ s already happening
michelfugain69: @Penguino138 LUL its true tho
mangoxavier: I’d like to see George argue with an anti-vax
MrJeff_: @yuptheladsdownthecans Best thing is, we don't have many people in my village. So we just keep calm and carry on.
pashafst: late to the party, what he's trying to make?
thelastkek: Protesting is beneficial, it builds herd immunity!!
lolzmaster99: bro its astroturfing!
spockshocks: its literally astroturfing
gaocaandra: kill off the weak ones
poppingtonic: @maxschneider96 yeah Insilico et al
DrakenZA: she could just be highly astroturfed and not even know it
foti_kasparov: Can we fuck the government by doing a walk?
yuptheladsdownthecans: @MrJeff_ so litreally nobody in your village leaves the village on a regular basis and comes into contact with other people? Seems very unlikely
spockshocks: all the reopen state facebook pages / websites were started by the same guy
DeeboMC: Oh yea, I’d be in if that’s the case
axlebear: surfing addict over here
sakshambhutani2001: fuck the government, but don't be dumb
joseanavarrom: @maxschneider96 and diagnostics
Penguino138: @georgehotz How hard is it gonna be to remove all the sand in the skate parks?
HopZe: Natural Selection boys
maxschneider96: @poppingtonic yeah
nejintejag: I think the 5G theories are fun. Completely insane but fun!
whichtom: protests have worked but not typically peaceful ones
thelastkek: Protesting is beneficial, it builds herd immunity!!.
geohot_pls_fck_me: god bless america
mayaeiouy: are you gonna stream from the protest @georgehotz
maxschneider96: @joseanavarrom I am developing a diagnostics device atm for my master´ s thesis. There is so much potential in that field
eldac_kno: i would protest twitch, if they banned this stream
mondeverest: do you livestream the protest?
thenomadplayer: what happened with 1 milion subs project on instagram?
niko174_: Lol dudes, I have April 27
DeeboMC: In for iconoclastic chicks
foti_kasparov: A walk a day keeps the government away !
IBaydenI: @georgehotz What is that wiggly thing going to be when its done?
sakshambhutani2001: How are you Doctors and Nurses dying? It's not just about age, it's about time you are exposed too
mangoxavier: That dude isn’t wiggling it’s humping.
ophicleidon: BibleThump
kaksoispistedeh: PepeHands
whichtom: the 2nd linkage is meant to get above the black line
axlebear: rip
jagger_rsw: are you trying to traing the chat by using some reward function (more streams if good chat)?
IBaydenI: @whichtom thanks :)
bovine_shield: Its also about the lung damage if you survive
Penguino138: How many other things in life have a 1/1000 chance to kills us? Probably a lot
garydsmith1: @jagger_rsw yes
HopZe: its called hibernation in nature language
joseanavarrom: But it's not kill us, it's kill our families for example
mayaeiouy: do you worry about the increased number of strokes seen in younger people who are covid positive
gaocaandra: you are good backgorund noise to work with, don't leave us.
mangoxavier: It’s literally a battle of your immune system holding out over the virus. Everyone has a diff immune system.
Penguino138: @mayaeiouy Where's the evidence?
whichtom: but people who are covid positive typically have underlying health conditions with themselves lead to a higher chance of strokes?
maxschneider96: @mangoxavier depends on your predisposition generally and the type of strain
whichtom: either way theres too little data for any conclusions
Penguino138: @mayaeiouy I'm almost positive you're references a fear mongering article that talked mostly about 40+ year old "young" people
thelastkek: look if yall want to stay locked up you do that. You cant force people to do the same
axlebear: Just stay inside like a good little citizen
GS540: LOL
whichtom: ya 'young' meaning 30-40 or something
l1ght5p33d: code snippets not allowed in chat?
niko174_: Ладно ребята, я пошел спать. Было приятно пообщаться. Good night &lt;3
garydsmith1: StinkyCheese
eldac_kno: speaking of doctors possessing some extra knowledge after becoming doctors, it's more neccessary thing than sufficient, it's neccessary to have some medical education to make some claims, but not sufficient, imo
logi6000: yo
mayaeiouy: I said younger for a reason
Penguino138: Now I see why the chat has been bad again. Thinking article titles are science fact...
Kromtor: this guy the new hot reaction streamer? kek
eldac_kno: Monty Carlo
Digital_donger: TheIlluminati ?
nejintejag: @whichtom no everyone can get infected your health is irrelevant. Your health is related to the mortality of you get infected.
mayaeiouy: @penguino138 there’s also a medscape article
farlopote: kekers
logi6000: Simpson's stream?
thelastkek: Protesting is beneficial, it builds herd immunity!!
yungdeli_: Imao
Penguino138: @mayaeiouy An article that states 40-50 year olds are young to fear monger is not an article to read
garydsmith1: @thelastkek lol
bichid69: its about being bored
DeeboMC: When was that from?
un3okapi: George, you have a beautiful smile.
mayaeiouy: @penguino138 that’s like nearly half the age we usually see those stokes in
whichtom: again, theres too little data to draw any conclusions right now. when its over we'll have actual answers
zimslv: nerd immunity FTW
foti_kasparov: Then don't watch media
Kromtor: you're trapped in their scope
DeeboMC: Chomsky, cialdini
niko174_: Its like in Russia lmao
poppingtonic: the frame = the "overton window"
leonardssh22: hello geo
Penguino138: @mayaeiouy Yes those age groups may be at increased risk, but to say 40-50 year olds are young means you probably shouldn't read it
yungtoad1: read manufacturing consent by Chomsky it's all about this
whichtom: great book
mayaeiouy: @penguino138 says youngER
yungtoad1: yes great book
garydsmith1: india heavenly thinks corona is made by the Chinese
jagger_rsw: unsure if this follows, if someone says 'herd ummunity b/c of protest' you respond with 'yes, but at a risk of overcrowding hospitals'. Why I shouldn't buy into it?
l1ght5p33d: sue &gt; protest
gigafact: so part 3 coming up later George? will be waiting for you here.
DeeboMC: Persuasion by Cialdini also
eldac_kno: would love to see programming in python in blender
poppingtonic: @yungtoad1 great book
mangoxavier: I need lazygit
Izimoney92100: please
her3hero: Pog
nejintejag: I think you have to stop listening media first to actually understand that frame thing George talked about.
lilou04: im behaving
her3hero: will sub for part 4
ak0ya_: !!
Vietnomnom: Part 4 seqWoo seqWoo
MrJeff_: I'm lurking....
bichid69: wat u doing the rest of the day?
Penguino138: Chat will always behave if it's subs only dotsKpog
PhosphoricAcid: this chat is pretty chill compared to most streams :)
garydsmith1: @eldac_kno can you actually do that?
gaocaandra: great!
Joooooooooonas: pls dont get arrested lol :D
nuffleee: 7 raiders from nuffleee have joined! 
bovine_shield: lol that to-do list
bovine_shield: Laundry and protest
not_Awful: persuade only
eldac_kno: yes blender can be programmed in python
fireposeidoncx: Stream the protest
rudolphdoesgames: hey @nuffleee
Penguino138: Can't wait for the new apartment streams
justenpassant: when's the next stream?
Izimoney92100: stream the protest please
LaheyFPS: monkaS arrested
yungdeli_: what protest
justenpassant: a protest for what
lilou04: if you get arrested we will come and protest to get you out
Vrookems: *tries to get arrested*
braininavatt: can you not get arrested? :)
garydsmith1: @eldac_kno can you program python in blender tho?
nizero: George I'm going to label some comma data for you
not_Awful: bail you??
god_damn: jail break
PhosphoricAcid: living on the edge
3ygun: It’s a Russian post
funwayz: its police trap
DeeboMC: Have you ever been arrested?
fireposeidoncx: Stream the protest
HopZe: i hope there isnt one
eldac_kno: live laugh love
jontowtruck: how much better is san diego than new jersey... coming from a shoreman
logi6000: can I get all your stuff if you die
her3hero: her3hero subscribed at Tier 1. 
chemicalflash: protest on twitch stream
garydsmith1: if you get arrested no self driving cars tho
Newlax: upload to YouTube channel
Penguino138: haha if geo gets arrested, he'll jailbreak real jail
Tuhafadam: what happend corona virus projct ?
robodemia: montezumas revenge
chair_78: ever done coke?
Vrookems: how u get caught with weed, just smoke it
Kromtor: peace is overrated
grizvok: lol
Kromtor: said my GAN
Izimoney92100: lol
bovine_shield: All my stuff does to you, george
masters8: flawless logic
jagger_rsw: can you enumerate benefits to subscribers, esp. once you take over the world?
l1ght5p33d: ayy lmaaoo
ak0ya_: what about money&gt;
robodemia: you sound like jordan peterson
eldac_kno: interested in blender? it uses python for scripting, you can make interesting stuff
DeeboMC: Damn son
sakshambhutani2001: including the money?
ionelaipatioaei: how much is your net worth?
rudolphdoesgames: relationships are overrated
DeeboMC: That’s hardcore!!
gaocaandra: ethereum sc wills
no_g: What if someone's motivated by burning all your shit?
bichid69: what about your kids man?
CaliburOne: One of my best friends work in healthcare, its fucked out there. Hes doing 12 hour days every day in Florida.
chemicalflash: war on chat
qubitmanipulator: don't you trust anyone?
arakis_djall: what are your thoughts on chatbots?
braininavatt: ask him what he thinks about anarchism Kappa
Newlax: burn all the crypto
Vrookems: why not just donate your stuff to someone who would never want to kill you
nejintejag: @robodemia Explain.
Vrookems: like normal people
logi6000: can I get your macbook if you die
vyle01: Well hopefully you can trust the people you have on your will
ak0ya_: us gov will keep the money
bichid69: you not leavin dolla for your kids?
ak0ya_: so they will have an incentive
her3hero: build a crypto that burns itself upon death PogChamp
DeeboMC: You’re serious?
HopZe: if you die of covid, it should be
axlebear: 5Head
garydsmith1: @vrookems that person would want to kill you
jagger_rsw: anecdata
no_g: What if someone's motivated by burning all your shit? Then you're giving them an incentive to kill you monkaS
l1ght5p33d: thats the way
fireposeidoncx: My will is to see you on the JRE podcast
masters8: not always bruh
aPosterior: what a guy
Vrookems: @garydsmith1 my mother wouldnt kill me just to get my stuff
garydsmith1: @no_g but they will do it anyway
mangoxavier: They could still kill you for your stuff. They don’t need an easy out.
justenpassant: well it depends on if people in your will love you more than they wan to kill you. so you just want to estimate the amplitude of each one with a precision that satisfies you
luigivsf: covid is more media bulls* than reality. Id never know a close person who had that and told the entire story. Always is random people like reading a script to set some paranoia on people
yungdeli_: @fireposeidoncx yessssssssss
garydsmith1: @vrookems yeah, but you never know tho
gaocaandra: george on the portal would be nice
bovine_shield: IRON CLAAAAAD
MrJeff_: We have a load of empty Hospitals in the UK. It's a waste of tax payers money.
BrutalCSkAKAN: Just got here, are we doing Minecraft 2.0?
Tuhafadam: will you countunie programing corona virus seriess ?
sakshambhutani2001: why not drop money from helicopters?
logi6000: in philly all hospitals are overwhelmed they are doubling up people on 1 ventilator. nurses only get one mask per week
nejintejag: Gorge might not look good on JRE.
q4nt3r: some think that only "rich" individuals dying spawns people fighting over their stuff. I've seem families fight over a shitty 50 year old, not even running car.
l1ght5p33d: My apartment is so nice whatchu talkin bout
eldac_kno: speaking of Wolfram Physics, you said science need testability, but math doesn't have, but it's still science
fireposeidoncx: George you should talk to joe rogan
garydsmith1: i mean the BTK killer was a loving father
HopZe: what about other countries?
J3rwin: @georgehotz your streams are chill and cool man.
Vrookems: bombs cost money, drop them instead
bichid69: Why don't we reset the economy after this?
yungdeli_: !uptime
Penguino138: I don't know if I'll ever be able to take news articles seriously
greyoctagon: greyoctagon subscribed at Tier 1. 
bichid69: start from scratch
logi6000: I know nurses who say this in those hospitals
cod4_lightning: "Don't follow people, follow ideas" That's islamic!
MrJeff_: google Nightingale Hospital.
justenpassant: watch this if you wanna feel good https://youtu.be/hWzccW4TQkg
nizero: in Phoenix they are furloughing doctors because there aren't enough patients
sakshambhutani2001: and would have been cheaper!
Penguino138: Stream lagging for anyone else?
tauzN: washingtonpost.com/evidence-for-what-geohot-just-asked
joseanavarrom: The health system capacity here in spain was absolutely over-exceeded
eldac_kno: what kind of evidence do you need, can you define
mayaeiouy: what you consider valid evidence do I have to go snap a pic in an icu
yungtoad1: how do you know if a source is verifiable
J3rwin: @Penguino138 twitch having a blip
mangoxavier: Data
DeeboMC: Lack of evidence isn’t evidence of lack.. in general tho.
LaheyFPS: @Penguino138 yes, but briefly
garydsmith1: @eldac_kno basically statics with verifying it
waterpaste: what is good evidence for u ?
sakshambhutani2001: I mean who can you trust as a credible source Trump?
braininavatt: he trusts institutions :)
nejintejag: Hum media media it is just people in the end right...
l1ght5p33d: No one knows it's impossible truth is false
justenpassant: sure, win win, but a better win if they pass their agenda with their win win strategy
DeeboMC: @tauzn Lmao
bichid69: we should reset the economy, everyone starts from scratch after this
foti_kasparov: What you think should be done ?
mangoxavier: Accreditation.
yungdeli_: whats the clip called, that one that George showed
Newlax: Have you heard of Destiny? It'd be interesting to see you two debate
yungtoad1: how can you know anything George with this mindset except what you see for yourself with your own eyes
DeeboMC: @braininavatt 😂
Lefer_: @georgehotz Are you watching Westworld?
tsparkles: what's the point of going to a protest and possibly infecting other people / catching the virus
no_g: There may be a guide on what constitutes a verifiable source, but how can you verify the guide itself?
Bacon4Life_: drink bleach guise
robodemia: talk while coding
no_g: monkaS
Vrookems: is my dad a credible source
jamesquinten: me :)
eldac_kno: he already said he is not interesteed in debates
Sylens__: @Lefer_ i would like to know as well
nejintejag: Define truth....
DeeboMC: Trump makes good points on amazon and the usps tho, to his credit
fireposeidoncx: You should go on the JRE podcast
Penguino138: Yeah ppl need to move on from thinking corona everything, and re-assess the other risks we take every day
no_g: @nejintejag Truth is a tautology
foti_kasparov: corona is more expensive than flu and beers
mangoxavier: You might get stabbed at ocean front idk
robodemia: $TERMINAL
yungdeli_: @georgehotz whats that simsons clip called
jcob5068: What is the protest trying to achieve?
Penguino138: Ron paul might be there
Deltasquadron2579: you might get struck by a meteor by sitting in that chair
Lefer_: liberty KKona
garydsmith1: wait the protest is real???
nizero: George the true libertarian
not_Awful: george, honestly, what is the point of doing anything?
Vrookems: gonna meet some beach sluts
waterpaste: LIberty LMAO
l1ght5p33d: It is a good test in case a real bad virus actually comes then we'll know how lockdown affects industry and life
chemicalflash: liberty to monetize ?
eldac_kno: i kinda lost you on wolfram physics, do you think it's not scientific because it doesn't provide testable(falsifiable) hypothesis?
0xatul: Whats up George?
qubitmanipulator: self-driving cars will never kill you
ak0ya_: coffin right now!
nejintejag: @no_g then storys can't be true.
bichid69: depression
Lizardan: @georgehotz do you support UBI?
ak0ya_: that will also preserve your skin
robodemia: $TERMINAL
ak0ya_: no spf
IBaydenI: @georgehotz do you look at dying as a bad thing?
gigafact: we have very limited time.
ionelaipatioaei: life is meaningless
not_Awful: right
justenpassant: i disagree; in this particular situation, if you assess the risk, the worst case scenario of catching the virus with an rt of 1.5 right now and passing it along offsets the benefits of 1 protest
DeeboMC: @eldac_kno What about wolfram, I missed that
not_Awful: dont know about that
synthetic11000: Do you think that there are any situations where humans acting in self interest is bad for the overall?
yungdeli_: isn't super weird how simsons predict a lot of our future
mattdougherty22: what do you think of effective altruism?
Inoram: dying could kill you
flexxor: Whats good man
eldac_kno: i missed that too, he kinda skipped it
Penguino138: Corona logic: Self driving car killed someone, so we should all stop driving
waterpaste: yes you do
enlightenedgambino: how can something every living thing has to experience, be a bad thing?
Vrookems: @Inoram bruh since when
nejintejag: @no_g you can always find a interpretation that contradicts your current one.
csal90: have you read any interesting books lately?
DeeboMC: @yungdeli_ I would say yes, but I doubt he would
Tuhafadam: it is a pandamic because of that every body stays home
mangoxavier: @georgehotz chompsky recently said if drumph is still in office our earth will die
Repunk: do you think america will be able to come out of this mess without a complete or even a partial constitutional reform?
mayaeiouy: from a cost benefit perspective I don’t see what I gain by not staying inside for a few weeks
knilecrack: what do you think abou tthis: https://medium.com/@sudhakar.dharmaraju/goodbye-linux-the-next-os-317801a5c0ba
masters8: Why does it mattter their age? You ageist?
ak0ya_: baseball games are boring
waterpaste: imagine during pandemic go to visit a day of liberty
yungtoad1: I'm gunna need verifiable evidence that someone got stabbed by a Phillies fan
nejintejag: @ionelaipatioaei meaning is subjective.
Vrookems: the sad truth: covid kills old people who were already dying
Tuhafadam: maybe you wont be ill you can cary on other people
Lizardan: Do you support UBI?
l1ght5p33d: SUE THE VIRUS ITS AGEIST !!!!
fireposeidoncx: @georgehotz must read books?
masters8: Yeah, so fuck the old, right?
tsparkles: you can still spread the virus to old people
robodemia: $TERMINAL
garydsmith1: BUSINESS INSIDER???????
gaocaandra: the point is to stay away from old people
eldac_kno: sad he won't talk wolfram physics
J3rwin: takes 2s
mangoxavier: Lol
0xatul: LUL
lala_style: LUL
Izimoney92100: LuL
Lefer_: LUL
jamesquinten: PepeLaugh
logi6000: looking into my teams
l1ght5p33d: KNIFE FIGHT !!! ok done spamming caps .. so fun
mangoxavier: The fucking eagles man
Penguino138: dotsHappy
0xatul: KevinTurtle
DeeboMC: Verification ftw
masters8: george is such a meme
braininavatt: 4Head
mangoxavier: Check sources
pepelaugh0: KEKW
Izimoney92100: @mangoxavier I hate the fuckin eagles
Lizardan: KEKw
DeeboMC: @mangoxavier Always
justenpassant: hey, we don't use news as a source of data in this stream
logi6000: guess I cant go to a baseball game. I'm a philly fan
eldac_kno: dude hated eagkes
DeeboMC: Bro, that’s Philadelphia in a nutshell
Vrookems: sharpening my knife rn
mangoxavier: Perfect use case.
Sylens__: lmaoo
bichid69: 1111111111111111111111
synthetic11000: Does this guy not give a sh*t about elderly people getting sick?
yungtoad1: honestly good analogy I'm not afraid of covid anymore
Izimoney92100: Kreygasm
mangoxavier: The Dude has left the chat.
eldac_kno: i am more of a doobie brothers fan
Iceeyz: whats the song
Vrookems: its right there dude
worraaa: but did he finish mcts though
Izimoney92100: where
Dynamic_One: eagles take it easy..
frunkAF: it'd literally on screen
Dynamic_One: LUL
Iceeyz: where
greyoctagon: our matrix is just running pandemic simulations, so stay calm and give the simulation interesting data
LaheyFPS: take it easy (2013 remastered) @Iceeyz
fireposeidoncx: must read books?
logi6000: there was a robot that hitchhiked across Canada and ended in perfect condition. they tried it in America and the robot was jumped in philly. my city right here
chemicalflash: but how many people have been conceived during sports matches ?
HopZe: wait didnt he say news isnt a source of info?
cod4_lightning: this will be muted on youtube
Vrookems: rant good
l1ght5p33d: boomers are alright
mangoxavier: Look with your eyes, not with your mouth.
garydsmith1: but there is a risk of this virus mutating and becoming stronger, and we loose lung capacity
DeeboMC: For the simulation, you play, Joe Walsh - Living a life of illusion
eduardoadf1: LUL
Iceeyz: wheres that
bichid69: what about old people?
mattdougherty22: What do you think of Peter singer and Effective altruism?
mayaeiouy: @hopze only the wrong news Kappa
Newlax: WELOVERANTS
GS540: LOL
Dynamic_One: WutFace
Sylens__: @georgehotz do you watch westworld/
Penguino138: That's mostly how the spanish flu died off. Mutated and became less virulent
LaheyFPS: I'm more scared of philly fans than covid at this point...
abk467: Phillies fan becoming stronger. That is the most terrifying thing I have ever heard.
ze_kel: ze_kel subscribed at Tier 1. 
uykusuzw: @georgehotz what u think about starlink?
garydsmith1: what about the reduced lung capacity
synthetic11000: Do you believe that it ever makes sense to act outside of your own self interest?
logi6000: @laheyfps why you scared we just jump hitchhiking robots
bichid69: what about the vulnerable?
adykaaa: @georgehotz Hello George, im a big fan man ! :) Do you suggest learning Java or C#? Which one is more futureproof? I was thinking about Java because you can develop android apps with it as well
sakshambhutani2001: also Kim's dead
garydsmith1: but do you want to get lung problems?
joseanavarrom: What about our families George?
l1ght5p33d: @synthetic11000 temporarily yes overall no
DeeboMC: Asymptotic Phillies fans
bichid69: what about your dick?
garydsmith1: helping people feels good, that's why we help people
cod4_lightning: what if you die of coronavirus?
HopZe: why is it all about me? why not about other living poeple
mangoxavier: Kim is allegedly many things right now. All unverified.
altic: but it is self interest to act out of it LULdoes it make sense
DeeboMC: A symptomatic*
logi6000: you know what's scary. philly fans with covid
nejintejag: What is the self.
mattdougherty22: why care more about family than future descendants that could hack simulation?
webuser011: any thoughts on upcoming crew dragon flight next month?
zenderbeg: LUL
her3hero: famous last words LUL
dr_set: Yes, this guys work proves matematically the biological strategic reason behind altruism: https://en.wikipedia.org/wiki/George_R._Price
DeeboMC: @logi6000 Lol that’s what I was getting st
gaocaandra: when the media gets you i will testify against you
eldac_kno: you can't have agency without self interest
synthetic11000: Recommend a good quarantine book?
mattdougherty22: Did you already discuss gates foundation and wHO hack?
mayaeiouy: LUL
robodemia: $TERMINAL
Penguino138: It does feel like Corona was a test of fear
cod4_lightning: go merry someone before you die
gaocaandra: i'll tell them you instructed us to kill old people
mangoxavier: What if we are all the same consciousness and when we die we just live another life in the sim until we learn enough to complete the sim?
l1ght5p33d: @eldac_kno yes you can
justenpassant: if fear wasn't a "feature" of living being, the world would've been so much different
kaksoispistedeh: billg is a scam
ionelaipatioaei: do you think that kim is dead?
Lefer_: I care about what George has to say :)
Artara_: you should hack Gates
garydsmith1: you only help people because it makes us feel better about ourselfs
synthetic11000: If you didn't have a job/company, what way would you make money?
fireposeidoncx: Why do u trust Business insider?
bichid69: its 10% for old people? should they be dead?
justenpassant: if fear wasn't a "feature" of living being, the world would've been so much different. imagine there was no fear. you wouldn't be scared of dying, of jail, of poverty, of pain
DeeboMC: Gates has been making himself way less credible throughout all this.
garydsmith1: that's business insider chart - bad
logi6000: everyone fucking drawin on my phillies
sakshambhutani2001: How do you trust this chart?
qube_si: This. is. wrong.
mattdougherty22: https://www.washingtonpost.com/technology/2020/04/21/nearly-25000-email-addresses-passwords-allegedly-nih-who-gates-foundation-are-dumped-online/
gaocaandra: isn't there, deep down, a common human goal?
mayaeiouy: that’s just cdc data in that chart KKona
eldac_kno: kim was just a puppet in hands of military and higher ups of party, nothing will change
gaocaandra: selfishness is not the evolutionary defsult
Happykillmoor: no new cases if you dont test
joseanavarrom: I don't know if you would think the same way if you lived in a city that actually had it's health capacity maxed out, and you had to go into a hospital for something not related to covid
mangoxavier: Make yourself happy and bring joy. That’s all you need to do.
her3hero: I'm afraid for my parents and grandparents.
l1ght5p33d: @eldac_kno you can have agency with more external interest than self interest, but you're right you need some small amount self interest defined as knowledge and will to take an action
cod4_lightning: have you watched this: https://youtu.be/6Af6b_wyiwI
hichm19956: Hello do you find protéine ?
gigafact: is CDC good?
justenpassant: if fear wasn't a "feature" of living beings, the world would've been so much different. imagine there was no fear. you wouldn't be scared of dying, of jail, of poverty, of pain. chaos
nejintejag: @georgehotz What is intelligence?
Rocky_88: I missed it, what's the overall stance being debated here?
mayaeiouy: @joseanavarrom I’m in nyc and I’m more scared of that than covid
Rocky_88: or "debated" w/e
zenderbeg: Most of the deaths are caused by different diseases, but they all say that COVID was the cause..
Vrookems: oh im gonna use that
l1ght5p33d: Stalin was 1337
synthetic11000: Yeah, but those death probabilities assume the denominator is only those tested.
justenpassant: stallin was smart though
DeeboMC: You anyone know that applied for Scorpion (Computer Services)? 😂
mangoxavier: Ppl acting like we should click links in this Chan... cmonBruh
phrixus_bro: ty big yud
eldac_kno: do you think if kids were introduced to basic of set theory and basic logic, people would grow up less stupid
garydsmith1: do you think privercy is dead?
cod4_lightning: bill gates talked about corona five years ago https://youtu.be/6Af6b_wyiwI
nejintejag: If a liberal person defines stupidity conservatism will seam stupid.
undefined_kek: hi from russia
not_Awful: what philosophy is your strategy to truth?
joseanavarrom: I don't know if you would think the same way if you lived in a city that actually had it's health capacity maxed out, and you had to go into a hospital for something not related to covid
bichid69: nothing is real
2sin54: define less stupid lol
Artara_: most kids don't even get shit that's easier
DeeboMC: What’s that title?
powerofpickle: We need critical thinking classes
gaocaandra: you can become less dangerously stupid
georgehotz: https://www.lesswrong.com/posts/qNZM3EGoE5ZeMdCRt/reversed-stupidity-is-not-intelligence
gaocaandra: if you are educated
justenpassant: I had a logic course in mathematics in highschool, and it helped me much in my life since.
foti_kasparov: We need asian breeds
joseanavarrom: The vast majority of the US doesn't care to overcome stupidity
mangoxavier: Yes. The journey.
white_rose: this was fun
calcmath: how was the protest?
bottonresult: !uptime
michaelmaier007: hello
ogrockefeller: father
phennessey: Did the protein get folded yet?
ogrockefeller: Dad Hotz
cronograf: No
ogrockefeller: Hit a dab for us?
robonhansonem: Still CartPole?
optimizely: It’s so good to see you george
J3rwin: @georgehotz loving the streams man. Have a good day!
l1ght5p33d: yeeeaeaaaa
michaelmaier007: yeah thats why you can write fych whatever @fychvhvjh
ay33x: PogChamp
masters8: A burrito with french fries??
Slaboday: is this a rerun lol
BlueSeamoose: We back
l1ght5p33d: count indexes on back propagation !!!
ogrockefeller: Sir Dab alot
kisspapa: have you ever played with googles tts voice creator
prez7: burrito
DeeboMC: Good combo tbh
deepfrieddeals: Beaches are overrated
megaultraok: yay you didn't get arrested
megaultraok: more code
ay33x: Have you ever thought making a big game ? @ger
ay33x: @georgehotz
cronograf: Linux
calcmath: are we going to fix the MCTS?
shadowdream1245: MacOS imo
linuxtak: Thanks you for this live session. I loved your chat with Lex Fridman and your approach in Comma.ai
calcmath: debug tools?
Bloodswordz88: Hail brethren
DeeboMC: Hail nigga
wainemier: why you writing this?
Bloodswordz88: HahaThisisfine
1ntegral_: ban hellooooo
ay33x: LUL
robonhansonem: What is this?
ak0ya_: how was the protest?
ambush1g: hotzz you make me motivated to program thank you maaannnnnnnn
calcmath: he dint go
DeeboMC: Lol I’m ok but point taken
eeXecute: :)
id7me_: Did you make annoying text?
robonhansonem: K
T3chHS: can subscribers ask what is today's project? (if so, what are you doing?)
phennessey: Did you say pong?
shadowdream1245: Make an ASMR video 👀👀
calcmath: and gave a lion king quote as the reason
l1ght5p33d: we want continuouser
robonhansonem: He is explaining it right noe#w.
robonhansonem: *now
michaelmaier007: turning into an asmr video.
phennessey: Translucent terminal FTW
robonhansonem: Nah. Opaque.
l1ght5p33d: zero or one is boring
ay33x: PogChamp This my first time catching you live on Twitch, always watched you on YouTube
shadowdream1245: Translucent gang
girtss3: Did this just start?
Santiago_LHC: Hello there
shadowdream1245: Yeah like 2 mins ago
LazerActual: you are an extremely talented human George
moamennasser2211: ur insaaaane bruh
THX1342: is muzero.model his own library?
DeeboMC: Zero AND one 😱
robonhansonem: He is aware of his gifts.
kisspapa: so is this a chess thing or something
wainemier: is this your job to wtiye this or you want to?
RexRothx: does he tab or space indents?
DeeboMC: Lol got emmmm
hurzg: Zeros and Ones are like the subs only mode in this chat :)
DeeboMC: ☝🏽
robonhansonem: I am a zero
mhammad123: Im back
DeeboMC: I’m a qubit
michaelmaier007: 🅘🅢 🅣🅗🅐🅣 🅐 🅜🅔🅒🅗🅐🅝🅘🅒🅐🅛 🅚🅔🅨🅑🅞🅐🅡🅓 ?
THX1342: billy corgan wants to speak to you @robonhansonem
mattaculer: I can't even webcrawl grubhub
LazerActual: safe to say i have absolutely no idea what is happening right now
l1ght5p33d: WTF\
DeeboMC: I grok tf outta this boi
mashafique: game dev stream PogChamp
l1ght5p33d: best game ever
michaelmaier007: wednesday tuesday friday?@l1ght5p33d
cefdsahg: Hi bro what r u doing
InfiniteReddit: morning from aus
THX1342: are you using this https://github.com/johan-gras/MuZero ?
DeeboMC: Bottom of the morn’ to yeh breh
calcmath: isnt this too simple to debug the issues?
LazerActual: please make matrix code run across the ecreen and say "im in" just like the movies 😂
axx88: What is this editor?
michaelmaier007: it's freaking midnight in germany....
gigafact: hello everyone
DeeboMC: @lazeractual Hell yea 😎
robonhansonem: robonhansonem subscribed at Tier 1. 
sr______: do u know rtx voice , its AI is mind blowing
km_404: hey george what's up
michaelmaier007: the ceiling
aar0npham: how was the protest?
gigafact: ^
DeeboMC: He didn’t go lol
joseanavarrom: That burrito is making us hungry
DeeboMC: Watched from YouTube
DeeboMC: Boss move
aar0npham: make sense
robonhansonem: Is he using Vim keybindings in his browser?
gaocaandra: george for president
Santiago_LHC: Lazy activism is the best activism.
shieeeeeeeeet: what env/simulation is he testing his muzero implementation in?
l1ght5p33d: I surfed today
l1ght5p33d: first day beaches open
DeeboMC: Speaking them big facts now
LazerActual: social distancing
Bloodswordz88: watch out for the sharks
nickcorso_: Hey man, I know absolutely nothing about this stuff but just wanted to say I graduated Bergen County Academies in 2017 and thought it was cool that you were an alumni
aar0npham: when trump becomes president =)
michaelmaier007: and i surfifed today :/@l1ght5p33d
l1ght5p33d: orange county
robonhansonem: Exit over voice.
jontowtruck: bergen community college in teh house!
ferraz42: which timezone are you in?
dr_set: its freedom for them, if you are LGBT, or a Jew or Muslin, etc, they don't mean freedom for you
nickcorso_: It’s going to shit, still a great school but crazy rules and I feel like they’re turning down smarter students for diversity
mik12f4: when did you leave NJ
DeeboMC: @nickcorso_ Lucky cunt 😆
Riqour: Do you need a double major in math and cs to work in ai?
ahahaitslit: goddamn ideologues
nickcorso_: @deebomc What do you mean?
shadowdream1245: Why does he use Chromium over Chrome?
gaocaandra: you dont need a degree to google things
grahamstephan420: I think he’s using ungoogled chromium
SHAVEYY_: @shadowdream1245 no google
shadowdream1245: oh
DeeboMC: @nickcorso_ You lived where good education was availed to you
Bloodswordz88: #Learntocode = #Learntogoogle
joseanavarrom: Fuck polarization and bipartisanship
thehisoka007: what time is it ?
eldac_kno: stick balancing reminds me of Kapitza pendulum
nickcorso_: @deebomc That’s true but it’s also really really hard to get into . I think the acceptance rate is below 10
achamorro008: how much is the subscription ?
grahamstephan420: $50
DeeboMC: @nickcorso_ And, therefore, access to peers
gaocaandra: i know a guy that can get you in fo 40 bucks
SOmedude456: yo george are you religious or ethnically related to a religion?
l1ght5p33d: we want benchmarks
DeeboMC: @gaocaandra Lmao
michaelmaier007: @somedude456 does that matter?
grahamstephan420: @georgehotz If I subscribe will you still ban me?
achamorro008: 50/month ?
robonhansonem: George worships the future brain emulation he will become.
grahamstephan420: No
grahamstephan420: Per week
DeeboMC: @nickcorso_ That’s also the exact point tho bro
SOmedude456: @michaelmaier007 no, I'm just askin a question?
gordon1337: how do you wish someone tasty meal in english?
nickcorso_: Anybody in here an app developer? I have an idea for a social media add-on that I’d like to build but I’m not great with coding
shokoo: @SOmedude456 how dare you LUL / s
rhombicosi: Turing test for AI is to play apex
girtss3: Will you post the last streams on YouTube?
robonhansonem: Learn to fo code it yourself.
eldac_kno: nickorso just lol
robonhansonem: *to
nickcorso_: Where’s the best place to learn how to code apps?
DeeboMC: @rhombicosi Not really
shadowdream1245: Doctors: You can't learn how to be a doctor by googling things online Programmers:
mashafique: @nickcorso_ by googling what you want to learn
2ndsll: whats the game?
gordon1337: asmr
eldac_kno: balancing the stick
ak0ya_: follower
SHAVEYY_: just make it play the game 4Head
gigafact: @girtss3 it will be posted but we hit a technical wall (youtube time limits and blocking copyright song) so you can't even play video... we are working on it
grahamstephan420: Hey I got this great app idea. It’s actually physically impossible due to limitations with current web APIs and available computing power, but that shouldn’t matter. Anyways, you do all the work and we split profits 50/50. Sound good man?
ak0ya_: it should be able to repeat the number 0 or 1
michaelmaier007: gta 6 releasing early i see
rhombicosi: @deebomc ok. to play at least like hal
gaocaandra: ajjajajaja i'd ban you if i could @nickcorso_
nickcorso_: @mashafique Thanks for the insight, never would’ve thought of that
DeeboMC: @nickcorso_ *went to Bergen* *asks that question in here* 🤨
MoProject: @nickcorso_ there are free courses organized by harverd on developing apps, you can check those
SHAVEYY_: internet but bitcoin 4Head
broadsw0rd: ill develop your app for free with no credit
nickcorso_: You guys aren’t very understanding of people that lack technical knowledge.
bored_spagetti: IM FINALLY LIVE FOR THE FIRST TIME
shadowdream1245: lmfao
mashafique: @nickcorso_ Everyone in here will tell you the same thing I'm guessing
bored_spagetti: what project are we doing ?
nickcorso_: I went to school in the academy of business and finance lmao
gaocaandra: Mcprogramming
shieeeeeeeeet: @nickcorso_ you don't need technical knowledge to know how to learn things
J3rwin: D:
wainemier: omg
robonhansonem: @nickcorso_ Pay someone to do it or do it yourself. No one wants to go halfsies on your idea.
nickcorso_: I figured I’d try to shortcut some steps and get some advice on the first step of the process
SHAVEYY_: how do I write a app that has porn on it?
l1ght5p33d: Look at Flutter it's really good for mobile I wrote an instagram clone with it
achamorro008: jajaja
jagger_rsw: Follow RIchard Feynman, learn what he did, and you are a moron :)
gaocaandra: ionic framework easy enough flutter is pretty
gigafact: sometimes I think people just ask to troll you
eldac_kno: is it still stick game?
MoProject: @you can also go on fiverr and search someone
girtss3: @gigafact Appreciate the response, thank you.
nickcorso_: Seems like the first step is just to google and figure it out. Now I know that, thanks for the help
calcmath: soory went to get tea, did it work on follower?
fullcind: how do i make an app to get me laid
shadowdream1245: george pls teach me the beep boop computers
gaocaandra: nphard problem
ak0ya_: no it did not
shieeeeeeeeet: @georgehotz maybe see if alphazero works on this game?
SHAVEYY_: how 2 program in assembloy halp geo!!
grekler3: chat, is using vpn gonna fully affect from what country the views and followers come from , in yt or instagram ?
l1ght5p33d: @gaocaandra what do you mean pretty
eldac_kno: highly unlikely
mashafique: We jammin' bois
rickoftheroot: pepeD
gaocaandra: pretty nice
hayewood: PepeJAM
michaelmaier007: i hope this won't end up in that tiktok bs
ghassane20a: why aren't you verified yet
T3chHS: @nickcorso_ you can always find people to guide you and give steping stones, but independent of your background, everyone can code anything. The internet is a fucking endless source of all kinds of information
grahamstephan420: Defeat Go using the golang implementation of MuZero
dudvdx: what are yeh doin now
l1ght5p33d: @gaocaandra it's probably easier than react
lucemferro_: im afraid to ask....
QuantumDota: still waiting for that Tesla sentury mode open source edition ;)
gaocaandra: coding react right now for a work thingie
andrewispower: explain what are you doing
nickcorso_: Who was your favorite teacher at BCA? Was Scott Lang there back then?
mirceau: George are you Fasting for Ramadan?
calcmath: he is testing his muzero implemntation on a simple game called follower
robonhansonem: Test
DeeboMC: @mirceau 😂😭
routerkicker: how was the protest george`? Did you meet some cool people?
VANRA: i dont think there are stupid questions
Lana_Lux: Yes.
Xaktar: yes
beastars_is_best_anime: yes moon2JR
eldac_kno: yes
rickoftheroot: LUL
mashafique: yes :)
ghassane20a: yes
grekler3: no, 13
beastars_is_best_anime: I LOVE ECK BAK moon2JR
Iluvmf: yes
Creamy_Goodness_: im emotionally 12.
cheese_wizzy: whats your iq @hayewood
megaultraok: lol no
Lana_Lux: It's not?
Xaktar: 12 and a half
ad5k: Fuck 12
abk467: probably
cheese_wizzy: whats your iq @georgehotz
lucemferro_: hey @georgehotz i got a job as a software tester, what are some tips for someone like me with no prior experience with programming? Also i have a math degree.
Santiago_LHC: Is it timeout time?
girtss3: @Creamy_Goodness_ :D
grahamstephan420: Pride100
Ch4oticAU: @Lana_Lux yo! Nice work on Ludum dare
shadowdream1245: teach me the computer beep boop george SirMad
DeeboMC: Yea, fuck 12
gaocaandra: is this a serious channel?
VANRA: my iq is higher than hotz
SHAVEYY_: @cheese_wizzy 392
eldac_kno: 12 year old army
mashafique: Mine are already out :)
andrewispower: make it 69+
Lana_Lux: @Ch4oticAU thanks :)
jagger_rsw: We're helping you to become more resistant to distraction temptations
T3chHS: yes, that's how it works
risky_banana: still cant show tiddys :(
l1ght5p33d: 30 + and ill leave
abk467: LUL im not sure that's what that means
Creamy_Goodness_: u cant show boobies
basecamp27: That would be helpful or just 18 to comment
DeeboMC: 18+ ftw
sr______: lol
robonhansonem: Good for you. Mine is so low it hurts to think.
l1ght5p33d: take one for the chat
grahamstephan420: Yes
Ch4oticAU: Should start body painting Geo lol
michaelmaier007: kids escape is twitch. not going to school they end up in twitch
grahamstephan420: I’m 13
whoishenry123: what cpu and gpu are you using?
rickoftheroot: SeemsGood
Creamy_Goodness_: u cant even show man boobies
Santiago_LHC: 12 year olds, raise your hand
mirceau: Not 12 here
SHAVEYY_: @whoishenry123 some macbook cpu
Digital_donger: twitch chat is a special place FeelsGoodMan
grahamstephan420: 🖕
shadowdream1245: Do 12yos know who geohot is?
cheese_wizzy: @SHAVEYY_ any idea how to raise my iq to that level ?
michaelmaier007: 12 year olds are playing fortnite right now
calcmath: this is not even MCTS, you have it commented
dudvdx: @georgehotz you're a good lad. keep up the good work
whoishenry123: @SHAVEYY_ ahh thx
grahamstephan420: Show your dick or keep it under 18
DeeboMC: 12 inches? 🙋🏽♂️
l1ght5p33d: dooppeee
QuantumDota: @georgehotz I have a private repo with a openai gym + cracked game version for lethal league blaze, a real-time fighting game, I've added you to the repo, would love to see if u could solve it
SHAVEYY_: @cheese_wizzy lots of book
girtss3: Does twitch not have analytics that show what is the average viewers age?
calcmath: @georgehotz you are testing naive search right now not MCTS
l1ght5p33d: wai what no
archiveutility: I'm twelve... twelve inches in your mom
jagger_rsw: ha.. new episode of westworld is up
cheese_wizzy: how many book have you read @georgehotz ?
gaocaandra: plis ban him
hurzg: what game does it try to solve atm?
gaocaandra: all games
Digital_donger: B) what ad?
l1ght5p33d: u make 10 y no better
Lana_Lux: lol no
num_air: WTF BRO
abk467: LUL LUL
Andremm2: nope
erlsek: no
mashafique: nope
SHAVEYY_: B) what ad?
jagger_rsw: nope,
xPolarDreamz: HI
dudvdx: no ads for subs
T3chHS: LUL
num_air: DAFUK AM I WATCHING
DeeboMC: Not subs
gaocaandra: NO GEORGE DON'T
l1ght5p33d: cmd + b
eldac_kno: we just need mods
xPolarDreamz: someone has been uploading your twitch vods to youtube
DeeboMC: Non-subs prolly are
l1ght5p33d: (cmd + b) ^2
T3chHS: be careful of leaks
gaocaandra: don't sell out to the man
T3chHS: yr
T3chHS: ye*
grekler3: oh shit, i dont have ad block enabled, i just gave you money PogChamp
Lana_Lux: I don't think it tells you the age
gaocaandra: wid dem adds
DeeboMC: Lol i remember that
Digital_donger: streamer career PogChamp 📈
DeeboMC: Told you
num_air: COVID streams were great !!!
jagger_rsw: make a poll
qlutoo: im 12 and what is this
l1ght5p33d: (cmd+b)^infinity
eldac_kno: i dont think twitch has age in profile
aar0npham: running ads every 30 sec
bored_spagetti: lol imagine watching a millionaire's ad
mashafique: Only subs don't see ads I believe
shieeeeeeeeet: shieeeeeeeeet subscribed with Twitch Prime. They've subscribed for 2 months! 
cars1n: Damn. He lookin thicc
limnick: hows the covid research coming george? I havent been here in a while but this looks neat
Killeraing: adblock is a thing tho
jagger_rsw: or those who have twitch turbo - an option
NatePh_07: in the Channel and Videos tab in Settings there is a Mature Content option
DeeboMC: Did yal adds? .. I wouldn’t know 😂😂
aar0npham: so u better give george money
andrewispower: why u so sexy tho
cockwizard69: :)
DeeboMC: See^
Xaktar: FeelsBadMan
donald3767: What’s muzero? I’m just tuning in
xPolarDreamz: ebegging
rickoftheroot: FeelsBadMan
DeeboMC: Elitism boii
robonhansonem: Google it.
Creamy_Goodness_: til george hates children
bismarckbamfo: No politics talks.
shieeeeeeeeet: @georgehotz do you care more about higher tier subscribers?
SHAVEYY_: LUL
sight_0: LUL
dudvdx: politics is meaningless
robonhansonem: Says Bismarck.
rickoftheroot: LUL
calcmath: you are not making any sense
WiseSwift: Can you visualize that in the notebook
Creamy_Goodness_: my mom said thinking is bad
WiseSwift: I don’t get it
ad5k: I am a liar
bored_spagetti: george i need a girlfriend what do i do ?
jagger_rsw: So, if politician says that a statement cannot be at the same time 'true' or 'false', I should check if 'statement can be at the same time true and false' and since it's not, then such politician is saying a lie?
Creamy_Goodness_: thinking is the tool of the devil
gaocaandra: learn to code
robonhansonem: Be worthy.
michaelmaier007: ｉ ｈａｔｅ ｐｏｌ ｉ ｔｉ ｃｓ
eldac_kno: not me dont care about not mine non subscribers
l1ght5p33d: can we do pygame snek with muzero w profile benchmark
l1ght5p33d: i dont want to miss the stream
Creamy_Goodness_: why does george hate children
bored_spagetti: what are we building now ?
T3chHS: just run function "getGUD ( )" LUL
robonhansonem: We care about adults.
DeeboMC: @t3chhs 😆
bismarckbamfo: What about non subs helping make the segnet better?
onu4r: yo
robonhansonem: Simple game to debug Mu.
mashafique: mashafique subscribed at Tier 1. They've subscribed for 2 months, currently on a 1 month streak! we out here
lukexfisher: how many Doge coin do you own?
num_air: lol
t00big2fl4il: yo what up?
robonhansonem: Doge is a banned subject.
gabryelportuga: where does george live?
eldac_kno: where are the mods
robonhansonem: No mods.
DeeboMC: Run “getBITXHES ( )”
michaelmaier007: @gabryelportuga planet earth probably
onu4r: Georgeyboi
gabryelportuga: @michaelmaier007 thanks
Shelledlizard4: hey
girtss3: I can't find a way to see demographics on twitch, however, we could create an online poll right now, but then again we would have to trust that people wouldn't troll.
Bootstraps: its a genius
eldac_kno: chat poll on twitch is the worst idea
l1ght5p33d: "q values"
DeeboMC: @girtss3 And why would you trust people to disqualify themselves 🤨🤨😂
calcmath: so model of env is learnt
andrewispower: can you sign my steam profile
Lana_Lux: is this for a bigger project?
DeeboMC: Google info is already unreliable as well.. unless you’re an idiot
girtss3: We are learning things here
limnick: curious, george
guccibruf: 🐛
calcmath: exploration reward?
Lana_Lux: i guess learning is a project
andrewispower: george is a very balcanic name ,maybe you'll want to eat some cabage rolls sometime
Jehhred: George is doing this for shits and gigs
l1ght5p33d: one does not simply "look at the training data"
limnick: show fitness function george!!
Lana_Lux: @Jehhred good enough reason to do it :)
DeeboMC: @l1ght5p33d 😆
andrewispower: i farted
TeckelDev01: hey
andrewispower: sry
gigafact: @Lana_Lux George is normally just exploring random projects for fun. Check his github.com/geohot for more info
l1ght5p33d: @deebomc WHILE THE NETS RUNNING
Lana_Lux: @gigafact thanks :)
DeeboMC: 🤣🥳
eldac_kno: would be curious to see explore ue4
anguscupcake: opengl is fun
l1ght5p33d: we're gonna need another GPU
DeeboMC: Gonna need a bigger server farm
zup_zup: hey @georgehotz big fan
andrewispower: my dream was always to become a pizza maker
DeeboMC: Get old Macdonald on the horn
manouchehri: Why is there a tiny twin bed in your living room?
l1ght5p33d: pizza is probably the top 3 foods
limnick: @manouchehri hes in SF that's just his room LUL
DeeboMC: I think he’s in SD now
manouchehri: @limnick that looks way too small for two people
andrewispower: georgyboi are you living in a nutshell my men
bovine_shield: Heyyyyy, the protester is back!! &lt;3
DeeboMC: South Dakota, California
calcmath: value of state should converge to 1 for both staes right?
limnick: @deebomc ahh ok
l1ght5p33d: put in sublime
genieyou1: Love you bro
calcmath: or is it iinfinite
calcmath: well there is dsciounting
calcmath: perfect policy is to follow, ehich means every step gives you 1 reward
DeeboMC: White dread heads abound
t00big2fl4il: An absorbing state is a state that, once entered, cannot be left
DeeboMC: Sounds like Florida
DeeboMC: For old people
andrewispower: I'm a boomer
DeeboMC: Ahh.. my apologies then
Major_Spicy: Hows the progress going? @georgehotz
calcmath: trsnsition of states is completely random right?
info303: just increase the learning rate :D
aar0npham: @info303 we don't want overfitting
DeeboMC: Release the noops
chai_wala: !uptime
info303: does overfitting actually matter much in this case?
DeeboMC: Game comes from within
routerkicker: what are ht and gt?
Xaotic: Guys does he only have a mbp 13 ? and runs a 5k monitor on that?
Rezery: Hi george hows it going?
anguscupcake: 16" bro
bismarckbamfo: So what's thr bug?
DiiCE3: !live
calcmath: later steps got a reward
Xaotic: @anguscupcake is this 16'' now?
DiiCE3: how long have you been live? @georgehotz
execrationtv: uptime!
calcmath: needs more steps to converge
DeeboMC: Approximately 30 years i believe
chunks111: What is a tree-based search?
girtss3: @DiiCE3 Almost an hour
12million_dollar_mobileye: 12million_dollar_mobileye subscribed at Tier 1. 
bovine_shield: I always knew I was stupid, but you make me feel like an amoeba.
l1ght5p33d: view source
DeeboMC: Mobileye in the building ☝🏽🚨🚨
polysoulz_: interesting PogChamp
zup_zup: 'why doesn't it work' - story of my life
thepeanufamily: do you see eye floaters? / have vision problems?
歡迎羽球單挑: what
t00big2fl4il: what would working look like?
thelastkek: have you tried putting it in rice
roflcho: Putin?
t00big2fl4il: I missed that damn my speakers
Santiago_LHC: I'm reinstating Vjasal, who promised to sub.
t00big2fl4il: very simple game. It would work by guessing,,,,
DeeboMC: It says you went offline on my phone but I’m still watching on my laptop. Did someone ban me, or is this a glitch?
calcmath: it needs to learn that future states cant be affected by actions, that is not that easy, its basically a skinner box and ur muzero is getting addicted
ofaas: :(
wainemier: you shoudnt put the replay videos only for subscriber I
Vjasal: Vjasal subscribed at Tier 1. They've subscribed for 2 months! sorry for beeing rude yesterday
St47ik: @wainemier they are on youtube anyway
DeeboMC: @wainemier I’m a sub but I agree with this
wainemier: wainemier: you shoudnt put the replay videos only for subscriber only we wanted to watch it
DeeboMC: @st47ik Not always
t00big2fl4il: absorbing points in this simple game?
bloopsterr: @wainemier most of them go on youtube the next day anyway
t00big2fl4il: absorbing states
ivche1337: Hello geohotz! I was wondering if you have ever heard of Voice stress analysis or If you have done any projects on it. If yes, any resources?
brisingr1031: george really putting in the work for this project
St47ik: nah it's just a fun project :D
eeXecute: a switch
gigafact: if it does not work George will put more work into it. other people will give up but not George
DeeboMC: I’m sure he’s heard of it. Anybody who’s watched TV/movies surely has
bismarckbamfo: Check the discount function.
brisingr1031: go george!
Penguino138: And we're back!
calcmath: lower discount value
calcmath: so that ignores future rewards more easily
DeeboMC: im go take a shower. good action
St47ik: high value
DeeboMC: lol
l1ght5p33d: we learned muzero is bad at easy games
brisingr1031: @12million_dollar_mobileye its convenient tho
calcmath: just try MCTS anyway?
SHAVEYY_: @12million_dollar_mobileye its good for learning
St47ik: bugs maybe
Creamy_Goodness_: this code is so.... erotic
ofaas: what do you use 12 million
St47ik: WutFace
routerkicker: please don't talk about text editors. George is gonna get mad again.
brisingr1031: i think talking about keyboards is worse than text editors, he might just perma ban you
St47ik: Stop NotLikeThis you're a sub
brisingr1031: ratirlSad
bismarckbamfo: What about the L2 regularization?
shr1ftyy: lol
anguscupcake: lol
Major_Spicy: 4Head Half of chat just gone
HedgeOnTwitch: haha
shr1ftyy: wiped
0R4NG3: permad KEKW
dantusqq: na
thickbordiga: no
brisingr1031: no they dont
samwilliamson7: What’s good george
soldierheadsmite: nice one
TheKoreanZombi: No money back just a life lesson.
thickbordiga: they also can't even see the chat after they get banned
soldierheadsmite: he fucked himself
gaocaandra: NICE BOAT BRO
Major_Spicy: It's just 5 dollars 4Head If he subbed to Hotz he can afford it easily
St47ik: Comfy LUL
gaocaandra: yea
gaocaandra: stick it
gaocaandra: stick that velcro
Lana_Lux: TAPE IT
gaocaandra: you dirty sailor
ofaas: this is how i install my curtains
St47ik: @Lana_Lux HeyGuys
TheKoreanZombi: So this is how sailing works
gaocaandra: that tape
Lana_Lux: @St47ik hey!
Vjasal: more tape
gaocaandra: was a good metaphore
risky_banana: this is what happens when you live on a boat, you lose your mind
gaocaandra: for this proyect
chunks____: a lot more tape involved then id thought
gaocaandra: tape is fucking great
badpartyhouse: badpartyhouse subscribed with Twitch Prime. 
LiveCustoms: George what was your net worth at 21?
shr1ftyy: just remove the fucking lamp omegalul
l1ght5p33d: tape engineering
Penguino138: GeoYacht
gaocaandra: it was fun
l1ght5p33d: not eco freindly
Major_Spicy: I mad that sailing channel :)
St47ik: nice snacc
samwilliamson7: It was great
wycks: used to be really into sailing youtube , now im not
GS540: any phillys fans at the beach protest?
chunks____: maybe the gradient function needs more tape
TheBlackzillian: !uptime
LiveCustoms: As an accountant, what tf is MuZero?
brisingr1031: ratirlGraph
badpartyhouse: Just joined! What are we working on today?
xeeton: sailing + machine learning is a winning combo ngl
wycks: felt like I should be sailing and not watching sailing
Major_Spicy: RatIRL is human trash kiaaREE
Jehhred: Sailing Youtube is nearly on par with Extreme Ironing.. yes, it exists
Penguino138: @LiveCustoms Muzero is complex predictive AI architecture
brisingr1031: @xeeton self-driving boats??
St47ik: it's better than AlphaZero
l1ght5p33d: add logging
Major_Spicy: @brisingr1031 are you here strictly for business?
LiveCustoms: @Penguino138 nice, thanks
l1ght5p33d: not just trying. then theres logs
brisingr1031: ratirlBusiness
l1ght5p33d: no idea
puffnfresh: puffnfresh subscribed at Tier 1. They've subscribed for 7 months! I want some more Coq
St47ik: Article for new peeps https://medium.com/applied-data-science/how-to-build-your-own-muzero-in-python-f77d5718061a
brisingr1031: @georgehotz wait so whats the problem?
yungdeli_: @Critical780 no you're confused
TheKoreanZombi: Goodbye sweet prince
Major_Spicy: @Critical780 KEKW
anguscupcake: pwned
Major_Spicy: The bans are almost more entertaining than the stream itself Pog
St47ik: dinner soon
markydothh: Sup George!
markydothh: hey George, can i send you some crypto?
node_storm: give me a good book recommendation and i'll sub
georgehotz: https://www.amazon.com/product-reviews/0833030477/ref=acr_dp_hist_5?ie=UTF8&amp;filterByStar=five_star&amp;reviewerType=all_reviews#reviews-filter-bar
LiveCustoms: The Investors Manifesto is a great book
St47ik: LUL
xeeton: @georgehotz referenced egen's permutation city, I've been reading it and it's good
Penguino138: Did george already talk about the freedom protest?
l1ght5p33d: is this just small random action space
DeadSupra: hello George
l1ght5p33d: does this ever work with any net
l1ght5p33d: do i have to start jupyter now
t00big2fl4il: digital dice computational solutions to practical probability problems PAUL J HAHIN
Jehhred: @forkdb What are you? His mother?
anguscupcake: learning many things is impossible
node_storm: node_storm subscribed at Tier 1. 
Major_Spicy: Another one LUL
Riqour: @forkdb rip
stephen422: @forkdb heyyy how did ya get that sweet italics in chat
DeeboMC: back. so fresh and so clean, clean.... What was mobileye talkin about lol
t00big2fl4il: Paul J Nahin
DeeboMC: extreme ironing rips dude
alextodoroki: what was the conclusion for the coronavirus reverse engineering
St47ik: @stephen422 𝙪𝙣𝙞𝙘𝙤𝙙𝙚
Major_Spicy: @alextodoroki im pretty sure he didnt finish it, said it's too hard or sth along those lines
moebe: what r the pros of using jupyter ?
alextodoroki: based
l1ght5p33d: lmao
DeeboMC: mobileye was talkin about nahin? lol
SHAVEYY_: PogChamp
alextodoroki: tfw not sub
Vjasal: hey non subs, what's up
SHAVEYY_: 🚪 👈 non-subs out
Penguino138: Someday the chat will learn
0R4NG3: TriHard 7 in the chat
DeeboMC: but not today..
Riqour: Imagine being a sub TriHard
DeeboMC: im a dom tho so...
risky_banana: ?
fSyLyndon: TriHard
DeeboMC: just a dumb pun lol
TheKoreanZombi: Hard to tell. So many changes
St47ik: discount is higher than before?
TheKoreanZombi: I am talking about from the earlier stream. Too many changes for me to tell.
l1ght5p33d: can't make continuous?
TheKoreanZombi: Did we and the lunar module already?
TheKoreanZombi: *try
Vjasal: teach your code to write better code
WilliamMu6: would you say muzero is better than keras?
Julianhgg: OK
l1ght5p33d: reduce buffer to 3
THX1342: WilliamMu6 isn't that comparing apples and oranges?
THX1342: one is a framework, the other is an algorithm
Julianhgg: !uptime
robonhansonem: If I can get it to work, job?
guinness84: do you drink SD tap wateR?
guinness84: i don't
WilliamMu6: got it
yungdeli_: except in flint Imao
guinness84: LUL
DeeboMC: @georgehotz would you ever consider building simple arduino robot to play around with this shit with, or do u think the lockdown is too close to ending to invest the time into that
routerkicker: us tap water tastes like a swimming pool to me.
mashafique: This chat is so memey at times.
0R4NG3: PogChamp
St47ik: PogChamp
TheKoreanZombi: Nice lander
gaocaandra: o shit
erlsek: PogChamp
DeeboMC: lol ok. well forget about the lockdown aspect
yungdeli_: POG
routerkicker: YES! Progress
Jadess: LOL
ultraolesia: KEK
Jadess: POGGERS
toashh: KEKW
achamorro008: hello form Nicaragua
Jimbo51: Houston we have a problem
mashafique: Progress PogChamp
ivche1337: george, have you ever heard of Voice stress analysis, and if yes any resources for learning more about it?
robonhansonem: Muzero is coming for your job.
THX1342: i haven't followed a lot of these past 2 days but isn't your follower game too 'strict'? one wrong move and the game is over, so the AI doesn't have 'space' to learn
chai_wala: Wish I could learn so fast
robonhansonem: Google, yo.
Th3R3dQu33n: hey, how many Starships is Elon Musk on these days?
THX1342: oh ok... I thought it was working with wrong move == gameover
eeXecute: i give it 4 trys
TheKoreanZombi: There's the old falling lander I love
DeeboMC: do you even hardware anymore?
ultraolesia: rip
adamalex16: homeboy should come over to my house and jailbreak my ps3
St47ik: MuZero supposed to be the "State-of-the-art" LUL
zup_zup: is your chair comfy?
gaocaandra: the more close you see ml the shittier it gets
ultraolesia: @zup_zup his chair looks really uncomfy
gaocaandra: o man
THX1342: is the muzero import your own implementation?
gaocaandra: the cringe
zup_zup: two more weeks?
Lana_Lux: imagine how clumsy the world would be with this as our AI overlords
zup_zup: oh lol
St47ik: LUL
DeeboMC: tumor weaks
lebop: how did you find out about muzero and why is it relevant?
THX1342: from general AI to cartpole AI
THX1342: LUL
FrancescoTommaso: lol
gaocaandra: how sure are you the implementation is correct
DeeboMC: thats why i asked about hardware implementation
gaocaandra: ?
routerkicker: is there muzero samples to download and compare to yours?
Bushfries: can you teach me how to write python code?
THX1342: it's only a matter of designing problems in a cartpole framework
ivche1337: let it find covid vaccine lmao
FrancescoTommaso: maybe it's overfiting
bismarckbamfo: Cartpole solves itself.
St47ik: "MuZero takes the ultimate next step. Not only does MuZero deny itself human strategy to learn from. It isn’t even shown the rules of the game."
lebop: o
Iluvmf: Didn't see all the stream, does the agent start by taking random action with a epsilon type frequency ?
gaocaandra: yeaaa
FrancescoTommaso: is this code going to github?
jeankx23: brbrbr
gaocaandra: it already is
FrancescoTommaso: good
THX1342: alright.. gn
FrancescoTommaso: i will try to improve it
xeeton: you sholud walk through the MCTS
SHAVEYY_: @FrancescoTommaso https://github.com/geohot/ai-notebooks/
FrancescoTommaso: thanks
bismarckbamfo: Will fix Muzero and submit pull request.
goergehotz: goergehotz subscribed at Tier 1. 
mashafique: LULW
drdislupo: what is going on exactly?
guinness84: stalker monkaS
aar0npham: did he fix it?
DeeboMC: Eliezer "what a false dichotomy" Yudkowsky
fabaoproo: I'm i big fan of you, from Brazil
g_gWillis: pokeHmm
markydothh: What is the benefit of keeping code in VIM and running in Jupyter?
eDONze: i'm from brazil too kkkkkkkkkkkk
peter35_: clintSuave gentlemen
Th3R3dQu33n: @markydothh easier testing
pwnbase: goergehotz, presadent cumma ai
FrancescoTommaso: I am also from Brazil
olvroger: me too
markydothh: But still have to update code in VIM yea?
eDONze: i can't play football in quarantine so i come to see george
timetrap2e: What’s up georgey
ytazn: My roommate didn’t remember taking a college course on differential equations...
DeeboMC: lol damn thats burnt city... or an assload of edumacation
gaocaandra: i didnt understand what you just did
cod4_lightning: studying for OSCP rn, sup?
gardiyanismet: what is he working on?
loouai: george why do you keep the jupyter default theme
fabaoproo: It is still about covid?
gaocaandra: you assigned p to a ignoring v, to use it to re calculate the state?
3minus2: if i want to start programming/coding, with language should i start with? and what are the differences between them?
ytazn: Oh this is a try random shit measured against some chosen fitness
gaocaandra: WHY?
FrancescoTommaso: is MuZero well suited for this? maybe it's mcts does not have time to explore enough in a short amount of time
gaocaandra: sry caps
SHAVEYY_: @3minus2 the first language I actually learnt stuff in was nodejs
FrancescoTommaso: I was trying to build a bot for generals..io and I had to give up no mcts
FrancescoTommaso: on
ytazn: @gaocaandra because that’s similar to how kids learn
chrispickels: rewrite in rust
SHAVEYY_: I hate nodes syntax though
neilsweb: Somebody was playing too much Mortal Combat when they named this algo
chrispickels: PLEAse rewrite in rust now
loouai: nodejs isnt a language
info303: nodejs is a runtime not a language
raisedbyphantom: is he using ubuntu ?
nsielicki: good evening
routerkicker: YES
ytazn: What’s the measure of fitness?
l1ght5p33d: nooooo
FrancescoTommaso: LOL
yuyaaah: Yes
SHAVEYY_: @raisedbyphantom based
johnpyp: PLEAse rewrite in rust now
l1ght5p33d: push to github
cod4_lightning: what's the point of doing streams about very hard topics that you are only understand?
mburke005: puke
peter35_: 3minus2 i started with C and i liked my path
ytazn: No
xeeton: lol
joseanavarrom: It would hahaha
loouai: broo get a jupyter dark theme plsssssss
ytazn: Wtf is rust
gaocaandra: @ytazn how so
3minus2: @SHAVEYY_ what do you think of python? ive been told its "easy" to learn
l1ght5p33d: im trying to write follower from a blurry screenshot
neilsweb: What chair is that?
nsielicki: any experience with Julia?
bismarckbamfo: Darkmode.
DeeboMC: write that shit in cobol breh
ytazn: @gaocaandra you have some measure of fitness like positive feedback from your parents and you try random shit to trigger that
l1ght5p33d: how u get in pygame always bad shape shape alwayysss whyyyy
robonhansonem: We need a fizz buzz stream.
birkett0011: how do i install pandas
ytazn: That’s how these algorithms work without knowing the rukes
cod4_lightning: I mean what's the % of watchers that actually understand what you are doing?
SHAVEYY_: @3minus2 python is probably the go to for new programmers tbh
chrispickels: put an extra pole in the cart
chrispickels: one pole is too simple
mashafique: I don't think George streams to teach us. From what I remember he said the stream is about talking shit and being somewhat productive LUL
gaocaandra: yeah i understand the whole reward thing, what is confusing me is i thought that was the function that determined which node was visited next
skinnypuppy69: little to none @cod4_lightning
TheKoreanZombi: @cod4_lightning Why are you watching if you don't understand?
neilsweb: I didn't know jack dorsey streamed.
3minus2: hm ok, can you explain a super noob the differences between all these languages?
FrancescoTommaso: is it running a mcts and deciding what to do at everyframe?
chrispickels: one pole is a simpleton's game
gaocaandra: nevermind i'll look at the code later
vHyphy: vHyphy subscribed with Twitch Prime. 
ytazn: The only way to understand is try yourself
birkett0011: Have you guys seen any real world applications of RL? not just computer games ect?
vHyphy: My dad loves your shit
cod4_lightning: I mean I watch in the hope of learning more about programming by a professional programmer!
lolzmaster99: @birkett0011 Optimal control theory
info303: @birkett0011 it can be used for stocks, logistics, ton of applications
ytazn: @birkett0011 yeah eventually a car in a novel situation will be able to figure a solution de novo given it doesn’t destroy itself on the process
birkett0011: @lolzmaster99 anything more specific on the simulation side. So far my experience has been dismal for simulation
birkett0011: I work extensively in Anylogic simulaiton and it seem like a perfect match but havent seen any decent applications
vHyphy: How do I share my sub
3minus2: @SHAVEYY_ hm ok, can you explain a super noob the differences between all these languages?
nsielicki: what'd you change in select_child?
gaocaandra: make it rand between 0-1
loouai: @3minus2 https://www.youtube.com/watch?v=Sg4U4r_AgJU&amp;t=1353s
gaocaandra: see what happens
skinnypuppy69: why does my professor tell me to make psuedo code but even george hotz doesnt make pseudo code
gaocaandra: the root has visit count
gaocaandra: in mcts
nsielicki: @skinnypuppy69 because the university education system is about making workers en masse, not making good workers.
cod4_lightning: @skinnypuppy69 cuz he is legend, and your professor is a noob!
chunks____: nah, they dont teach anything about being a good programmer in school
loouai: @nsielicki preach
ytazn: Your professor doesn’t have to write code that people use
gaocaandra: the first time it defaults to the first because uct = infinity for all nodes
skinnypuppy69: geez it was rhetorical lmaoi chill out
birkett0011: Any of you messed around with the #Hash simulation stuff? Seems like good place to apply some of this RL on more complex systems. https://hash.ai/index/search?contentType=Simulation&amp;sort=dateModified
lolzmaster99: Yes
ytazn: Lmao my professors are dumb too
cod4_lightning: I subscribed now I am in the safe zone.
gaocaandra: because n = 0
gaocaandra: the second time the first node will have n = 1
skinnypuppy69: all professors are dumb, youtube is how you learn
gaocaandra: so it will go to the next
ytazn: @skinnypuppy69 true
DeeboMC: Most* professors
guinness84: have u tried gripping the handle differently, your slicing right a bit
ytazn: I prefer to read
skinnypuppy69: i learn by seeing not reading so kudos
gaocaandra: are you counting root visits? i think you should
nsielicki: introductors fundamentals classes aren't taught by the brightest, but if you're lucky your junior and senior classes will be taught by people as smart as george
DeeboMC: well then.. thats never gonna make you elite
ak0ya_: Cold it be that mcts not working is juts a symptom of a bug elsewhere?
ak0ya_: *could
ytazn: Yeah starting out I used videos to get more of the emotional vibes of what’s important
FiZdaWiz: bruh u are a genius
cod4_lightning: I subscribed geo. Show me your dotfiles LOL!
IaMvAzU: stockPray HeyGuys
Major_Spicy: Non-sub chat PogChamp
chunks____: maybe it needs a sigmoidal function
skinnypuppy69: @deebomc me?
DeeboMC: yes
FiZdaWiz: i dont know wtf you ever do and i watch hrs of your videos so interesting
SparksCx: shameless
ViktorTV: @georgehotz Consider a system with two components. Transitions among the states of the system can be represented using a Markov chain as shown in the following figure. In this figure, each state of the system represents the number of components in operation. Derive the steady-state probability vector in terms of the parameters r and p. Vary r and p each simultaneously from 0.1 to 0.90, in steps of 0.10, and plot the probabilities of states 0, 1, and 2. You will have three plots, one each for sta
FiZdaWiz: lmao link onlyfans
WEEEEEEEELL_ITS_KNOCC_OUT: buddhaGasm
IaMvAzU: lol
IaMvAzU: whats ur onlyfans link?
l1ght5p33d: whats a dot file
SparksCx: actually shameless
skooches: sup geo, what we doing today
samwilliamson7: Whatcha drinking???
cod4_lightning: we don't have paypal in my country. any other option?
l1ght5p33d: is that what u said
guinness84: send dots plz
DeeboMC: lmao
johnpyp: s
Noxique: gimme the OnlyFans link OH MY GAWD Kreygasm
IaMvAzU: whats ur paypal?
ViktorTV: Consider a system with two components. Transitions among the states of the system can be represented using a Markov chain as shown in the following figure. In this figure, each state of the system represents the number of components in operation. Derive the steady-state probability vector in terms of the parameters r and p. Vary r and p each simultaneously from 0.1 to 0.90, in steps of 0.10, and plot the probabilities of states 0, 1, and 2. You will have three plots, one each for states 0, 1, an
SHAVEYY_: yes
IaMvAzU: yes
thickbordiga: yes
lolzmaster99: Ban Viktor
gaocaandra: ban ViktorTV
slayerdaniel: yes they allow men
ViktorTV: no pls
sit_d: they allow animals. too
skooches: ms added hypervisor tampering checks into patchguard so i'm trying to mitigate them because how else am i going to reverse anticheat for clout otherwise
archiveutility: Yeah
DeeboMC: cashapp and id do it
theirishtripleking: Yes you are allowed to do the helicopter
nsielicki: he's asking for homework help
lolzmaster99: It's a homework problem
SHAVEYY_: LUL
slayerdaniel: they allow men named George too
Mariosavitch: hello mr hotz
ViktorTV: i keep on sending it in the wr ong chat
ViktorTV: the first was intentional
nsielicki: very plausable story
ViktorTV: the second was not
gaocaandra: asking for help with homework should be bannable
TheKoreanZombi: Chat forgives you Viktor.
ViktorTV: @gaocaandra suck me bitch
ViktorTV: @TheKoreanZombi ty
Mariosavitch: i have a 200 word essay due tomorrow
cod4_lightning: I bet if you do "Configuring Mac and Vim like an ex-iphone hacker" you will get more 100k in a month! LOL!
DeeboMC: ok NOW ban him
gaocaandra: wow calm down
gaocaandra: we are a chill collective
skooches: zackfoSQUARE
lolzmaster99: Might as well try min_max_stats
DeeboMC: exactlyu
gaocaandra: of people working overtime
slayerdaniel: bro this chat lol
gaocaandra: and twekve yearolds
slayerdaniel: LUL
DeeboMC: viktor can gtfo.. gaocaandro = 5 viktors, at least.
olvroger: what did i miss wtf
l1ght5p33d: @gaocaandra are you in school
olvroger: PogChamp
gaocaandra: i'm at home cuarantined working 80+ hours a week george is the closest thing to human contact i have
TheKoreanZombi: muzero go brrrr for ones
skooches: mutantfeDollbaby me trying to understand specifically what geo is doing without backstory bro share the notebook or something
gaocaandra: github
Mariosavitch: its aware???
gaocaandra: check his latest commit
guest1GRjBAYo: why stream?
skooches: "github" so specific thanks bro got it i shall open github.com
cod4_lightning: anyone have paypal with 50$ in it and like to exchange with something? geo, you will upload them to a private repo and email the link to me.. OK? LOOOL
l1ght5p33d: @gaocaandra watching twitch
olvroger: geez
DeeboMC: lmaooo @skooches
gigafact: https://github.com/geohot/ai-notebooks
Mariosavitch: are you interested in finance hotz?
nsielicki: what kind of performance bump were you really expecting from monte carlo?
olvroger: you mad or what
gaocaandra: ye
skooches: @gigafact thank you sir ojreevTea
AppleGrape: @georgehotz Where can I learn ML man
gaocaandra: we tried using it
gaocaandra: to route ambulances at work
nsielicki: hahahah
Mariosavitch: lol
gaocaandra: we still have it collecting dust in a bitbucket
nsielicki: it seems like it's better at discrete problems
tonyk76: yoo
nsielicki: many dissimilar states
sit_d: turn out God only runs on supercomputers
slayerdaniel: is that a futon next to you
DeeboMC: *quantum
junwohwan: Lol
Twistedbane: Twistedbane subscribed with Twitch Prime. 
gaocaandra: yeah
DeeboMC: seriously tho.
gaocaandra: routing is gonna have to wait
gaocaandra: esither that
gaocaandra: or some amazing shit happens
lolzmaster99: Increase exploration noise again
nsielicki: show plot pls
l1ght5p33d: @gaocaandra ban drivers and add comma ai
gaocaandra: jajjajaaja
lolzmaster99: It's stuck near local minima
gaocaandra: thats the plan
guinness84: monte carlo was a snitch
gaocaandra: there is like 2 flors of human labour that im gonna delete
skooches: its a fucking place not a person lmfao
cod4_lightning: if anyone has no idea what the hell he is doing: https://en.wikipedia.org/wiki/AlphaZero
nsielicki: well we expected it to be better, I just am struggling to understand under what conditions the naive strategy would outperform it, something we're missing
DeeboMC: you dont know larry "monte carlo" jones?
Mariosavitch: we smart
FrancescoTommaso: at least you did car pool
Kawhiet: Is there a video with proof?
slayerdaniel: we bout to fake the moon landing boys?
eeXecute: Go party
mashafique: Party time PogChamp
wainemier: 'what
IaMvAzU: is that the muni?
cod4_lightning: what is this noise?
Ne0Zer0: PartyPopper
l1ght5p33d: you should also yell
skooches: dotsNeurons
cod4_lightning: goooo partyyyyy
DeeboMC: they might be giants too
Ne0Zer0: PartyTime
wainemier: PogChamp
Ne0Zer0: PartyHat
treestompztv: WOOOOOO
gaocaandra: coronaparty
l1ght5p33d: yeez
slayerdaniel: there we go
nsielicki: https://www.youtube.com/watch?v=wmWJ27glFQY
Lana_Lux: someone has an air horn? Lol
raisedbyphantom: POG
mashafique: PartyHat
cod4_lightning: this is some interesting content right here
skooches: zackfoSQUARE me outside geo's apartment building screaming at him
node_storm: lmfaoo. tell them we are trying to work up here. keep it down
cod4_lightning: please please please do one hackthebox today
fa_k: m
cod4_lightning: somebody still partying alone out there LOL
mangoxavier: Going to read the docs.
cod4_lightning: MaxLOL MaxLOL
slayerdaniel: SeemsGood
cod4_lightning: this part in the stream will be muted on youtube
DeeboMC: buckethead - dawn appears
skooches: you keep saying that but i don't see anything landing on anything lunar
cod4_lightning: stop violating copy rights
peter35_: heck yea learn to hoverslam that ho
routerkicker: fuck copy rights
TheKoreanZombi: Yes, I have seen lunar lander.
cod4_lightning: geo, do you like IoT?
DeeboMC: "hoverslam that ho" lmao
mik12f4: maybe it only wants to play Global Thermonuclear War?
skooches: this is we keep the gpu box onhand because we don't have 12 hours to see if our training outcome is good
katrocitus: are you trying to learn rust?
FrancescoTommaso: my cat solved car pole
cod4_lightning: https://gym.openai.com/envs/CartPole-v1/
info303: connect4 is a good one to use because it's a solved game
PrivateOrange: What about https://github.com/werner-duvaud/muzero-general ?
info303: so you can test it against a perfect strategy
xeeton: how can your naive implementation be faster than MCTS?
slayerdaniel: george, ya got any ice cream?
DeeboMC: blackkack?
Mariosavitch: he dead
DeeboMC: jack*
Jehhred: The lack of thrust is discerning
bulksquat_thrust: You ever code a stock trading bot?
nsielicki: doesn't surprise me that a paper with the word "superhuman performance" in the abstract lacks reproducibility
cod4_lightning: we've learned reactjs last time, let's learn nodejs today
slayerdaniel: liars, all of them, liars
aar0npham: could be a photoshop image =?
DeeboMC: @georgehotz Data &gt; Spock, amirite?
cod4_lightning: "WE TYPE AND CLICK WHILE WE SHIT TALK"
axx88: What game is he coding?
searchingforlife: LUL
DeeboMC: he's isnt
Kawhiet: just throw more tpus at it
Mariosavitch: does it know it has actions to fire thrusters
nsielicki: https://www.youtube.com/watch?v=pudIZbCRq_c
FrancescoTommaso: brute force way
MoTeMiB: !uptime
Pr0ject414: as obi one konobi once said... "throw all the tpus at it"
TheKoreanZombi: It is going for speed and accuracy
slayerdaniel: it just doesnt feel like it
cod4_lightning: do you watch streams other than yours?
searchingforlife: its trying its best
DeeboMC: @nsielicki lol
mik12f4: delete the ground
TheKoreanZombi: If the lander flips upside down and fires its thrusters so it crashes faster I will be happy.
DeeboMC: @Pr0ject414 great man, obi wan
Mariosavitch: its learned to die quicker
janpoonthong: What is your Mac spec?
nsielicki: he's got one of those new 16" mbp
Pr0ject414: @deebomc but obi one is the better man... he is number 1
cod4_lightning: @janpoonthong 13 macbook maxed out i think
DeeboMC: i see what you did there
janpoonthong: @cod4_lightning I see
node_storm: he has the new 16 inch i think
bulksquat_thrust: this was a bad stream to hop in the middle of huh
bulksquat_thrust: my small brain doesnt know whats happening
FangSkillz: hes coding
cod4_lightning: @bulksquat_thrust EXACTLY!
FangSkillz: but trying to make his custom spaceship to fire thrusters @bulksquat_thrust
janpoonthong: He use laptop to code?
FangSkillz: yeah
FangSkillz: i guess idk LUL
nsielicki: NOT BAD AT ALL
JeanFrag: does it always respawn close to the center? then any (alteration of angle)(power of truster) will likely push it away @georgehotz
cod4_lightning: He needs that Mac Pro
node_storm: making progress
FangSkillz: !spec
FangSkillz: !pc
bulksquat_thrust: ah
birkett0011: very smrt
sit_d: he's just a baby
FangSkillz: ^
costcospizza: true
janpoonthong: What he is doing now?
JeanFrag: I think you should randomize respawn zone, not in the center @georgehotz
janpoonthong: Creating game?
FangSkillz: waiting till model starts thrusters @janpoonthong
cod4_lightning: @georgehotz make a petereon so we can get you a mac pro maxed out with 1tb ram so you make us more top notch streams
DeeboMC: @cod4_lightning you cant be serious
Lana_Lux: @janpoonthong he's using MuZero to solve a game
FangSkillz: "@georgehotz make a petereon so we can get you a mac pro maxed out with 1tb ram so you make us more top notch streams" - @cod4_lightning
StopitDonk: ^
FangSkillz: i guess he doesn't have chat open LUL
JeanFrag: rip
cod4_lightning: @deebomc yes i am, he deserve that!
ytazn: Ok I installed it
DeeboMC: he can afford it if he wants it
bulksquat_thrust: what mac is he using?
l1ght5p33d: make observation learning
32bitrobo: twitchRaid
bulksquat_thrust: seems like its breathin hard
l1ght5p33d: f$@&amp; keras tho what does concatenate even do
FangSkillz: twitchRaid
bubblesnot: @georgehotz how well is the comma two ADAS device selling?
nsielicki: stop asking about k3yb0@rd and his computer and whether he wants a mac pro, he's happy with his setup
DeeboMC: this guy gets it
cod4_lightning: anyone here coding along with him and trying to solve the problem with him?
l1ght5p33d: jk keras is good
FangSkillz: @nsielicki are you sure since he hasn't said anything
nsielicki: it's in the description as a bannable offense.
routerkicker: give it less reward when It's vertical velocity is high
FangSkillz: but we are just trying to help him so i don't know how this would be a ban offense
bulksquat_thrust: just wondering the hardware needed to run this faster lol
FangSkillz: ^
DeeboMC: i dont think you guys are even sycophants, you're just irrationally subservient and infatuated
Loutlot: Loutlot subscribed at Tier 1. They've subscribed for 2 months! 
JeanFrag: can you randomize the spawn point? @georgehotz
cod4_lightning: do you announce that you are going to stream about a specific topic before on discord, so we can have an idea and prepare?
DeeboMC: no
DeeboMC: i dont even know that as a fact i can just infer
info303: if it randomly explores maybe it just needs a lot more episodes?
ytazn: Does it know how to fire thrusters?
eeXecute: maybe it's getting rewarded to early jk idk
pokerpete555: I vote @JeanFrag idea
l1ght5p33d: manual input,, pipe state to history buffer
pokerpete555: whatever thats worth
fychvhvjh: you can take on big semi autonomous car comps they will have vegence on u
DeeboMC: i think its a good idea
badpartyhouse: Reverse the value for the down thrust
l1ght5p33d: or switch the sign of something
badpartyhouse: make the down thrust positive
badpartyhouse: see if it learns that way
bottonresult: !uptime
fychvhvjh: are you selling car data to the asians?
rudolphdoesgames: how was the protest?
ytazn: 1900 collect a bunch of employees run a company 2020 collect a bunch of packages run a company
JeanFrag: should i even try saying it again?
badpartyhouse: it is making the down thrust has such a negative value, just make it into a positive value and see what happens then???
cod4_lightning: how can i control a robot with an iOS app? what are the steps for doing that?
ytazn: Lunar lander?
l1ght5p33d: Parse the history and reverse the sign on everything
ytazn: Or tic tac toe?
DeeboMC: step one: locate a toys'r'us..
cod4_lightning: can you talk about your pwn2own experience?
l1ght5p33d: manual input good values
JeanFrag: can you randomize spawn point? @georgehotz
ytazn: Guys I’m at training step 20 of 10k
JeanFrag: yea
fychvhvjh: can you start an all girl coding class to promote equality
gaocaandra: yeah that makes sense
ytazn: Guys this is super fucking boring
ytazn: I have to wait for 100k ganes
l1ght5p33d: what
DeeboMC: @fychvhvjh primo shit lol
JeanFrag: right now it is not worth risky using thrusters when it gets better results not doing anything because it respawns in the center @georgehotz
ytazn: The model eats 100k games
nsielicki: lol
Ne0Zer0: LUL
iIyaRPV: iIyaRPV subscribed at Tier 1. They've subscribed for 2 months! 
PiroFloydian: Bio hype
gaocaandra: bio is the future
rickoftheroot: LUL
ytazn: Lol
bubblesnot: How well is comma ai doing?
abe8k: how often are you doing covid19 bio? joined twitch for it tbh
raystriker98: well they do have unlimited resources thanks to Google
sit_d: the details of their results are lackluster
bubblesnot: Ok np
l1ght5p33d: it's just sparse reward just move things and sink into different minimum no problem
TheKoreanZombi: @abe8k He is done with bio.
DeeboMC: "bio is over.." (portlandia, anyone?)
ytazn: Bad rewards still help tho?
FrancescoTommaso: maybe solve this with good and old q-learning or sarsa
gaocaandra: do what jeafrag said
ytazn: Bad rewards say don’t do that
nsielicki: so what's happening that it's approaching a solution and then getting thrown out? we need to do more math
gaocaandra: ok
FrancescoTommaso: Ok
JeanFrag: yes!
pokerpete555: yay Jean
nsielicki: something in replay
l1ght5p33d: initial conditions are the most important thing in most complex systems
raystriker98: atleast a few Tesla v100s
Pr0ject414: "just spin up a vm and bingo bamo bobs your uncle"
DeeboMC: lol
numlox: maybe run it on colab?
AppleGrape: Integrating this into no limit texas hold em
raystriker98: colab free only gives you one single slow xeon core
gaocaandra: or some other paid service, you could sell out for compute and shove ads
raystriker98: and 2 threads
Pr0ject414: i got a 2080ti let me just give you access to all my personal files LOLOL
DeeboMC: blackjack's way more likley
l1ght5p33d: know all the other players cards
pokerpete555: I'm playing the great game right now while watching
info303: why not see what happens if it runs for longer?
pokerpete555: holdem, not blackjack
routerkicker: maybe discount it still a bit too high?
DeeboMC: blackjack is solved tho
pokerpete555: yup
pokerpete555: ez
oversum: Think it's good practice for a programmer to have both Mac and Windows?
DeeboMC: windows is spyware confrimed, so theres that.. but otherwise yea
AppleGrape: I have both
l1ght5p33d: you want to do observation on poker i would think
AppleGrape: I prefer my mac for web dev
WhispyHerc: still working on cartpole?
l1ght5p33d: manually input state of chips and who wins
Pr0ject414: bit too high meaning go down in numbers closer to zero?
oversum: I mean I'm in my junior year of college for cybersec and I'm starting to see more and more mac stuff
DeeboMC: mac for work; linux for fun... altho george does the opposite
nsielicki: lol
ytazn: @deebomc I’m flipped too but I’ll get fired soon
oversum: savage
l1ght5p33d: need WPT logs
WhispyHerc: do be wiggling fast doe 😳
katrocitus: do you kaggle?
Pr0ject414: so a marked improvement after going down .01
Pr0ject414: or just luck
DeeboMC: @ytazn you want to get fired or you just anticipate it happening soon?
pokerpete555: @l1ght5p33d better to solve cash than tourney
gaocaandra: randomize it
78DHF: !uptime
gaocaandra: lunar_lander.py
gaocaandra: is the filename
ytazn: @deebomc I anticipate it cus I’m trash and I build so slow
gaocaandra: line 56
gaocaandra: is the param i think
gaocaandra: i dunno
gaocaandra: https://github.com/openai/gym/blob/master/gym/envs/box2d/lunar_lander.py
knitler_: How is it stopping an infinite recursion through the tree?
DeeboMC: lol damn.. well with an realistic outlook like that, i think you'll do just fine
l1ght5p33d: make bin size of action and mostly use same action then smol random
nsielicki: :set paste
nsielicki: why does vim do that anyway?
DeeboMC: puts you ahead of, maybe, 80-90% people probably.. just give it time and keep perpetually improving
gaocaandra: 138
ytazn: What does Jupiter do?
swftdev: Jupiter is a notebook environment to write code in
nsielicki: the thing is the paper is about not knowing any of the rules, it shouldn't need to have this rule of the game exposed to it
l1ght5p33d: ;;;;;;;;;;;;;;;;
swftdev: make code streams work again
l1ght5p33d: is spamming ascii llegal
gaocaandra: penalize it for not using thrusters
ytazn: @swftdev ty
shutchie: isn't the -100 crash?
gaocaandra: JAJAAJAAJJAJ
bulksquat_thrust: i need a programming project to save me from boredom but im not creative enough to figure one out myself
gaocaandra: join a cult
AppleGrape: There is so many possibilities.....
AppleGrape: use your brain man
be9ns: hes in the vim cult
badpartyhouse: this shit is broken
gaocaandra: how is that happening?
nsielicki: agh this is fucked
superluminal86: jupyter cult
routerkicker: maybe change discount back. idk man
gaocaandra: maybe it takes longer
FrancescoTommaso: increase punishment
JeanFrag: is there a cost to using thrusters/
Pr0ject414: -69 for not using it
gigafact: I still remember the stream when you said you did not want them to end in failure. We will ever make this work...
nsielicki: i think the strongest theory so far is that it just needs much more compute than we're throwing at it
JeanFrag: does the benefit of winning closer to the center outweigh the cost of using thrusters?
FrancescoTommaso: reduce loss of points for time to completion
gill_bates_macrosoft: @bulksquat_thrust I'm doing a few stuff here, except in rust https://github.com/rby90/Project-Based-Tutorials-in-C
be9ns: heard to talk to lex about Haskell, any projects besides a compiler?
WhispyHerc: wait so if using the thrusters is bad why do you want it to use the thrusters if it's finding ways to solve it without them
ytazn: This is like slapping the pilot when he messes up
ak0ya_: maybe mcts search?
shutchie: is the negative reward for using thrusters being overcome by a positive reward by getting closer to the surface? seems like the reward needs to be based on descent rate
swftdev: this is the existential moment where if it works or not might not matter..
info303: is the idea with muZero to discover the actions on it's own?
ytazn: Slapping the pilot seems like a great idea now
knitler_: seems like the reward would be much easier for chess/go
swftdev: sticks not carrots
Pr0ject414: im waiting for the tomcr00se music stream.
bulksquat_thrust: @gill_bates_macrosoft ive been doing stuff in c++ to get better at memory management
TheKoreanZombi: Doesn't the lander by default penalize thruster use or is the main engine different than thruster? "Firing main engine is -0.3 points each frame."
badpartyhouse: give it more reward if it keeps the time going
Iluvmf: LUL LUL LUL
node_storm: hahaha
WhispyHerc: LUL
gigafact: damn
shutchie: descent rate
badpartyhouse: ahhahaha
nsielicki: "can't lose if you can't see me, bitch"
Kawhiet: progress
rickoftheroot: LULW
FrancescoTommaso: LOL
bulksquat_thrust: "cant lose if i dont try" haha
gaocaandra: jajajaa
badpartyhouse: well the negative reward is not so bad
DeeboMC: slappa de pilot
badpartyhouse: ahhaha
Musashhhi: trying to get to earth
LiveCustoms: Geoooo
WhispyHerc: OMEGALUL
rickoftheroot: LUL
vanishingtacos: LUL LUL
Pr0ject414: give it a height restriction negative reward
shutchie: @georgehotz base the reward on the descent rate being within a specified range?
DeeboMC: lmao
ytazn: Penalize it randomly
phrixus_bro: same starting weights every time?
swftdev: where there is a determined correct outcome instead of a range of outcome
bubblesnot: Run it as admin
eljok3r: timeout
ytazn: Yeah try running it as admin
gaocaandra: penealize acceleration in the downward sense
DeeboMC: sudo work
rickoftheroot: LUL
TheKoreanZombi: Learned a barrel roll
Penguino138: Open Starfox
bubblesnot: SpaceX
Iluvmf: I dont think thats what we wanted, but I guess it kinda landed
ytazn: It learned drunk flip
l1ght5p33d: i like punish downward acceleration
gaocaandra: punish unstability
DeeboMC: i second that
Pr0ject414: after we learn muzero we do Unity ML agents
gaocaandra: measured by rotation
ytazn: Punish independent hoping and dreaming
DeeboMC: punish downward accelration
bubblesnot: What if boosters did shorter burst?
DeeboMC: lol
gaocaandra: is the penalization they used the same a s the default in gym?
ytazn: Punish being purple
iKanak_: just solve it manually and punish it for not following your actions
gaocaandra: punish it for not punishing itself
pokerpete555: just punish it
bulksquat_thrust: that learning rate tho
l1ght5p33d: you need whole run window of history
ytazn: Yeah just punish
l1ght5p33d: whole entire one
DeeboMC: punish it for accepting reward
jimmyadaro: lmao hello
gaocaandra: randomly punish it
no_g: punish it like an abusive father
nsielicki: story of my academic career right there
badpartyhouse: i volunteer as tribute
vanishingtacos: Keyword is might
Pr0ject414: this dude is doing 20,000 training rounds
FrancescoTommaso: RL usually takes forever
FrancescoTommaso: look at leela chess zero
Penguino138: I don think we should punish it? Has anyone seen Ex Machina? dotsKpog
info303: thats what Ive been sayin :D
GandalfTheGrayOfHell: Is cart pole done?
nsielicki: anyone else hate how np.array([1])*4 is [4] whereas [1]*4 is [1,1,1,1]?
DeeboMC: i havent seen it but ive heard the plot
info303: i mean running it for many more episodes
l1ght5p33d: does anyone know if this was a hack https://www.nytimes.com/2020/01/09/world/middleeast/iran-plane-crash-ukraine.html
superluminal86: Does Mu zero applies some kind of exploration/explotation?
nsielicki: yeah it hacks the computer to make the answer good
Pr0ject414: Can you run it in parallel?
DeeboMC: if you have to ask you arleady know it was
l1ght5p33d: incompetence
info303: i think it has to since it learns everything from scratch
Pr0ject414: Many iterations at once
l1ght5p33d: also plausible af
l1ght5p33d: need passenger list
Pr0ject414: listen to the sound of the electric toothbrush as it passes over his glistening teeth.
GandalfTheGrayOfHell: Can hear the cpu fan running 4Head
l1ght5p33d: this is what happens when u give robots knives
bulksquat_thrust: kek
LiveCustoms: George you play Pokemon?
radixcov: Mac or Linux?
gaocaandra: this s the new protein fold
superluminal86: Does Mu zero applies some kind of exploration/explotation?
TheKoreanZombi: run overnight, resume tomorrow
FrancescoTommaso: the problem is that it seems to lack exploration
Pr0ject414: Is it possible to run this in parallel?
raystriker98: please stop the random n00b questions ,chat
GandalfTheGrayOfHell: Chat ask about the key board Jebaited monkaS
Pr0ject414: asynchronous actions.
routerkicker: discount on the dudes github is 0.997.
JeanFrag: it is clearly capable of learning, it learned to not use thrusters, so the problems is the incentive that makes it want to not use it @georgehotz
bubblesnot: @georgehotz what is your prediction on quantum computers?
TiPera: Hi there
0R4NG3: monkaS
l1ght5p33d: they can predict the future duh
routerkicker: lotsa thruster action i think
robonhansonem: Last time someone asked he was bearish on Quantum computers in the near term.
l1ght5p33d: obviously wave packets propogate back from the future
l1ght5p33d: everyone knows that
l1ght5p33d: its all about group velocity
robonhansonem: The Canadian QC startup D-wave was a scam.
l1ght5p33d: makes radiation in nuclear blue
l1ght5p33d: https://en.wikipedia.org/wiki/Cherenkov_radiation
eDONze: sd
be9ns: george do you play any videogames?
swftdev: are links banned??
swftdev: @georgehotz https://arxiv.org/pdf/1905.09381.pdf
mik3xx: I don't know anything about computing or coding. But it looks interesting and you've inspired me to learn. Should I take a course or learn on my own? What language should i learn?
DeeboMC: d-wave actually did nothing?
gaocaandra: learn pyhon
mik3xx: I heard python will be outdated soon?
gaocaandra: na
nsielicki: observation
gaocaandra: no such thing
swftdev: milk meme'n real hard.
nsielicki: learn c++20
nsielicki: c++20 is python but fast
iIyaRPV: Jebaited
nsielicki: i'm so excited about STL ranges and views that it's unhealthy
stale2000: 5Head
forkdb: Ok
l1ght5p33d: anyone know if you could run a game in javascript by streaming an image and hacking some input layer over it
nsielicki: https://en.cppreference.com/w/cpp/algorithm/execution_policy_tag_t is next-level stuff that AFAIK doesn't exist in any other serious language
routerkicker: @l1ght5p33d what do you mean? use html5 canvas
jwlolol: !uptime
DeeboMC: long time
l1ght5p33d: canvas is pretty good
iIyaRPV: ~3.5h @jwlolol
nsielicki: and that's on top of a few hours this morning
justenpassant: so you didn't get arrested. nice
jwlolol: nice
DeeboMC: he didnt go.... napped and watched on youtube instead
coProof: He’s not stopping!
l1ght5p33d: jail is not so bad as long as you don't fight anyone
DeeboMC: depends on duration as well
DeeboMC: it can get boring
cod4_lightning: studying OSCP 2020, any tips?
l1ght5p33d: @deebomc i suppose i meant that more as a warning
justenpassant: are you speaking from experience
DeeboMC: yes
DeeboMC: lol i see
TiPera: do u guys recommend learning python?
l1ght5p33d: spent a full year in county bro
TheKoreanZombi: @cod4_lightning Yes, try harder.
DeeboMC: yes
iIyaRPV: yes
gigafact: Over 17 hours working on this problem. Anyone blown away by George's persistence...
l1ght5p33d: girls love it
DeeboMC: damn dude. got me beat
DeeboMC: hell yea, facts
l1ght5p33d: @deebomc money is several times better
SlaterUSA: hi
socialnotsocial: Are you going to build an AR headset geohot?
SlaterUSA: what's that lil game-like thing running in the window?
l1ght5p33d: @SlaterUSA kelly?
no_g: LennyFace
DeeboMC: not sure i get that. money is better than jail? because i 100% agree... or do u mean fast money is better than slow money... cuz i disagreee in the longrun lol
SlaterUSA: @l1ght5p33d no, christian, obvs
ideology_sniffing_raccoon: pepeD
Iluvmf: @SlaterUSA Its lunarlander
l1ght5p33d: @SlaterUSA we are elite programmers
IMTotes: BBoomer
ideology_sniffing_raccoon: BBoomer pepeD
DeeboMC: "ideology sniffing raccon" lol
nsielicki: for j in range(60)
l1ght5p33d: @SlaterUSA happy to have you mr Slater
SlaterUSA: yw, now gimme 20
l1ght5p33d: lander needs some work
nsielicki: based music taste
cod4_lightning: guys it's ramadan over here! we're fasting 20 hours a day!
l1ght5p33d: just started so it's ok
DeeboMC: is that like gimme 5? but with all four limbs?
ideology_sniffing_raccoon: @deebomc RaccAttack
TheKoreanZombi: Lunar lander. Built Ford Tough!
salman2301: 20 hours? Which country is that?
SlaterUSA: @deebomc it means push-ups
biguieboss: love your taste with bob seger!!!
DeeboMC: i know dude
TiPera: !uptime
nsielicki: @deebomc laughed so hard i spilled water
TiPera: what is MCTS?
DeeboMC: haha nice
cod4_lightning: @salman2301 somewhere in europe.. try to guess
l1ght5p33d: MEDIUM CHAIN TRIGLYCERIDES
TheKoreanZombi: @TiPera Monte Carlo Tree Search
mitrocc: why are you not allowed to say the word k-eyboard?
TiPera: thank you @TheKoreanZombi
SlaterUSA: 11
ideology_sniffing_raccoon: Kreygasm Kreygasm Kreygasm
cod4_lightning: OOOOOOOOOOOOOOOOH YEAAAAAH Geo is getting ripped!
Punkfx: take shirt off
no_g: cbrahRbicep cbrahRbicep cbrahRbicep
mik12f4: arms at 45 degrees?
TiPera: ToS @Punkfx
cod4_lightning: no pain no gain bro, that was a decent workout
DeeboMC: like a rock inspired him
mitrocc: No its not ToS @TiPera
no_g: Now 50 bicycle crunches PogChamp
nsielicki: YEAH
Punkfx: its not ToS to show off those guns.
TheKoreanZombi: @mitrocc Because what difference does it make what equipment he uses?
TiPera: are people allowed to show nipples on twitch? O__O @mitrocc
gaocaandra: yeaaa boooiii
SlaterUSA: i'm too old to learn :(
c1tr0n75: c1tr0n75 is gifting 2 Tier 1 Subs to georgehotz's community! They've gifted a total of 19 in the channel! 
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to ak0ya_! 
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to vloood! 
mitrocc: @TiPera People do workout streams shirtless
TiPera: i didnt know, sorry then D: @mitrocc
forkdb: Keep learning
ak0ya_: @c1tr0n75 Thanks for the gift sub!
mitrocc: @TheKoreanZombi ??? who said anything about that
biguieboss: that song means a world to me! good choice
mitrocc: @TiPera Its okay :D
justenpassant: how many iterations does this one need?
mitrocc: @TiPera D:
TiPera: but girls. = ban right D: @mitrocc
DeeboMC: need moar montage music
justenpassant: how many learning iterations does this one need?
mitrocc: @TiPera Girls cant get banned on twitch FeelsGoodMan
c1tr0n75: cheer50
TiPera: @mitrocc true, 2020 twitch Kappa
TheKoreanZombi: @mitrocc I am just explaining to you why that word is bannable. Because people ask dumb questions about it.
mitrocc: @TheKoreanZombi Doesnt make sense , but his channel his rules
cod4_lightning: bro, i don't have a GF, let's build some AI girls
nsielicki: don't you dare restart that kernel
drake_elite: hello guys any one can give a learning path i want to do something like this please?
SlaterUSA: @georgehotz what's ur rent in that humble abode
nsielicki: i think it's about to work
TheKoreanZombi: @mitrocc I support it. Dumb questions get annoying.
cod4_lightning: !time
mik12f4: does it even know its suppose to land between the flags?
cod4_lightning: !uptime
mitrocc: @TiPera Twitch have some of the best athleats, World record for cat throwing Alinity. World record for most nip slips on stream -Alinity. 3 day ban CoolStoryBob
bubblesnot: How does it sense the yellow flags?
forkdb: May be he should dedicate one whole twitch stream to answer all the questions, so that there would be no more dumb questions....
info303: it gets a big reward when it lands below a certain downward velocity I think right? if I understand correctly it has to accidentally stumble upon that scenario
Kawhiet: @forkdb theres always new viewers
cod4_lightning: how long the stream is now?
DeeboMC: cat throwing summer league
TheKoreanZombi: @forkdb No, there are too many dumb questions. They would all be asked again the next day.
bulksquat_thrust: speaking of ban worthy peripherals, im soldering one together tomorrow CoolStoryBob
mitrocc: !mouse
mitrocc: outsmarted
nsielicki: is this still the modified version of the game? are you sure you removed all the mods to the rewards you made?
forkdb: They can always go back to being sub to watch, by doing that he would make more subs as well...
mik12f4: can you narrow the flags? maybe it will learn faster
mitrocc: If i cant type the k word i can write the m word
mitrocc: ezClap
gaocaandra: he changed it
TiPera: @mitrocc nip slip when? i saw the cat thingy lmao
gaocaandra: he's using default values for penalization
mitrocc: @TiPera She slipped the nip couple days ago, and took twitch 3 days to ban her
TheKoreanZombi: No lunar lander left behind.
bulksquat_thrust: Probably only because community outrage
logi6000: yo how you doij
TiPera: @mitrocc i just checked and her channel is still up, how dafuq ? D:
mitrocc: @TiPera Because twitch staff are virgins
logi6000: whose channel
mitrocc: Alinity
Pr0ject414: it doesnt appear to be learning at all
Santiago_LHC: Are people behaving? Do we need timeouts?
Pr0ject414: just random
justenpassant: the reward maybe?
Pr0ject414: its not consistent
mitrocc: @Santiago_LHC Ive bean a bad boy, i might need a timeout ;)
TheKoreanZombi: Run overnight. Will be very smart by tomorrow. So much thrust.
Santiago_LHC: It's not fun if you enjoy it
Pr0ject414: if your plotted those out it would be jumping all over the place and not a steady decline
mitrocc: I hate it :)
logi6000: oh yeah she's done all sorts of shit and gotten away. she just dosent get banned. probably fucks the twitch staff to get free
mitrocc: Nah she has a only staff for twitch mods
mitrocc: heh
nsielicki: reduce i, increase j
TiPera: @mitrocc good point 4Head
mitrocc: onlyfans*
raystriker98: NOT OKAY
logi6000: only for allinity
liivius: all nipples not ok
rickoftheroot: fluid Kapp
IMTotes: only when breastfeeding
LiveCustoms: Only MALE Nipples
mitrocc: Only alinity nipples are okay
Musashhhi: uh oh
no_g: Cow nipples are OK
l1ght5p33d: twitch will be overrun by the horde eventually as well
l1ght5p33d: we can only hold so long
727_tf: it's trying it's hardest
TheKoreanZombi: Ran out of fuel
727_tf: it's just dumb
Pr0ject414: yes
mitrocc: If its a workout stream yes
liivius: Nopr
gigafact: no
no_g: Get the belt out George
raystriker98: don't do it
iIyaRPV: no
IMTotes: only if u r breastfeeding @georgehotz
Pr0ject414: for males
ideology_sniffing_raccoon: squadW Clap MY MAN
727_tf: no
logi6000: he wants to do it
LiveCustoms: YES
mitrocc: Yes you can
rickoftheroot: monkaS No
c1tr0n75: no
Pr0ject414: males ok
no_g: Time to discipline
risky_banana: No you're not allowed
nsielicki: VoteYea
GS540: only if you are alinity
no_g: Find out PogChamp
LiveCustoms: DO IT KappaPride
logi6000: totally
bubblesnot: I hope
mitrocc: Do it KappaPride
TheKoreanZombi: Males okay unless for prurient reasons.
nsielicki: VoteNay
tornpaperyoyos: woah what did conversation did i just get into
iIyaRPV: still no
ncanggoro: dont
rickoftheroot: LUL
c1tr0n75: too late
logi6000: no
socialnotsocial: what happened with the protein folding?
ripSquidd: Do it KappaPride
ncanggoro: why
siccbrain: nope
LiveCustoms: No only Men Nipples
babaquon: lets find out
justenpassant: that's what you should be protesting for
justenpassant: lol
rickoftheroot: only one way to find out :)
logi6000: you'd get personality raped by a twitch staff
Br4nnon: yolo?
l1ght5p33d: model isBreastfeedint{}
no_g: If you say you identify as a woman and then show your penis it's ok KappaPride
Pr0ject414: "those who present as women must also cover their nipples"
Tekrific: to few epochs
Pr0ject414: from the TOS
nsielicki: i just feel like the replay training is excessive
Br4nnon: good ole loop hole
logi6000: no will he do it. the world may never know
ideology_sniffing_raccoon: genitalia is not ok on twitch
nsielicki: 100 plays, 5000 trains
ideology_sniffing_raccoon: male of female
mitrocc: You trying to bankrupt spaceX?
DotaStar666: whats he coding
nsielicki: too many trains not enough plays
Pr0ject414: can you plot those out and see the spikes
nsielicki: increase j decrease i
nsielicki: i'm speaking out of my ass here
l1ght5p33d: @DotaStar666 nice name
logi6000: guys dont tell geo what only fans is. he'll fucking do it
mitrocc: Make a only fans KappaPride
mik12f4: deploy a parachute
zetto97: hello from Spain Geo! I have learnt a lot of things thank your content in yt and in twitch
l1ght5p33d: i only play halo 2
l1ght5p33d: on xbox original
DeeboMC: @logi6000 he already mentioned in this stream
mitrocc: Halo 2 = Bad game
logi6000: really. whatd he say
l1ght5p33d: @mitrocc maybe
bulksquat_thrust: they call it halo 2 because you get 2 guns
DeeboMC: @l1ght5p33d i can dig it.
DeeboMC: Halo 2 = great game
mitrocc: And you play it twice and then quit Kappa @bulksquat_thrust
fukurowlz: @zetto97 you may also improve your english
IMTotes: PogChamp BOTTOM THRUSTER!
mitrocc: If you want to improve your english, play minecraft
l1ght5p33d: wooooowwwwwwwww
DeeboMC: @logi6000 he'd send you the dotfiles if you paypal'd him 50 bucks or subscribed to his onlyfans lmao
sevaric: positive numbers PogChamp
jsnake794: i caught you live yaya
logi6000: @deebomc what dotfiles
l1ght5p33d: yes what dotfiles
l1ght5p33d: are they good?
logi6000: for what
DeeboMC: his private github shit, i think its a joke
l1ght5p33d: joking
sevaric: if you make a plot of a list that is growing, will jupyter automatically update the plot?
Pr0ject414: the appearance of randomness
l1ght5p33d: mods are asleep delete .dotfile from .gitignore
mitrocc: Wait he doesnt have a donate button? :(
Pr0ject414: i wouldnt call you a suckker. but that list looks like a lolipop
jwlolol: vim and tmux dotfiles?
logi6000: @mitrocc paypal him 50
MABunglawala: sup
logi6000: geohot at gmail
NYCyril: What are dot files ???
iKanak_: Starting to wonder if AFL would perform better than all this deep learning nonsense
MABunglawala: Are u gonna jaim
logi6000: @jwlolol I have his vim and tmux dotfiles I use them
mr_stochastic: @NYCyril Config settings
bulksquat_thrust: @NYCyril usually vim configs and bash configs
TheKoreanZombi: I am an expert at identifying randomness after reading George's book recommendation: A Million Random Digits with 100,000 Normal Deviates.
l1ght5p33d: files that start with .
mangoxavier: When it runs what is an error? the strings that start with 2?
routerkicker: @iKanak_ it's just muzero he's gotten this to work with other deep learning algos
l1ght5p33d: must do ls -al
MABunglawala: jailbreak PS5? when it comes out
NYCyril: oh ok thanks @mr_stochastic @bulksquat_thrust
jwlolol: @logi6000 yeah that's why i was wondering which dotfiles hah
logi6000: if that's it then I'll just fucking release them.
bulksquat_thrust: his zsh theme is afowler
mitrocc: George should starting doing 15 bucks for 5 minute code review
DeeboMC: yea i was just refencing which .files
MABunglawala: shit I dont understanding anything whatever he is doing. anyone else like that in here?
bulksquat_thrust: colorscheme is a jetbrains darcula clone
3ygun: How did he rate the Liberty rally?
l1ght5p33d: @DeeboMC ghidra with more tooltips
nsielicki: i think i was wrong
nsielicki: clearly
munchfumble: why do you use jupyter?
TheKoreanZombi: @munchfumble Why not?
logi6000: @georgehotz what dotfiles you talking bout
zetto97: @fukurowlz yes, im learning english, and u? how many languages you can speak?
bulksquat_thrust: @zetto97 what is your native language?
OrlinTheMage: touch me
DeeboMC: @l1ght5p33d holy shit dude, thats rabbit hole shit for me
zetto97: @bulksquat_thrust spanish and russian
mangoxavier: whoa
munchfumble: @TheKoreanZombi idk, I don't really know what it is other than a text editor
Pr0ject414: Throw more trains
Pr0ject414: call yourself the conductor
TheKoreanZombi: @munchfumble Ah. Gotcha. He uses it because it is quick to prototype.
DeeboMC: did they contract
mangoxavier: it was plus and then minus interesting
bulksquat_thrust: @zetto97 cool! I kinda know spanish, trying to learn to read latin rn
nsielicki: does it need to experience more things or does it need to learn more from the experiences its had
wthbro: hello
aaaakshat: Oh crap we're live again
aaaakshat: can anyone update what's happening
DeeboMC: ... contract scorpion computer services for that? lol
logi6000: @aaaakshat people want to know what the dotfiles are
bulksquat_thrust: @aaaakshat hes using an ai lib to solve a lunar lander game
aaaakshat: ooooh that's epiuc
aaaakshat: thanks
l1ght5p33d: @logi6000 that's why they want them.. no one knows
KAZERKE: Hello George moon2S
Pr0ject414: @nsielicki i would contend that it needs to learn more from what is has already experienced
cafe807: geohot is in love I guess
wthbro: lighting temperature is terrible BibleThump
logi6000: @l1ght5p33d but if its tmux and vim or anything else in his config repo
zetto97: @bulksquat_thrust very good broo
mangoxavier: yall are joking right? go google how to terminal and don't waste time
logi6000: then he scammin
nsielicki: @Pr0ject414 see i'm leaning the other way, i think it's just not trying enough new stuff
nsielicki: is 414 a reference to MIL?
l1ght5p33d: @logi6000 what config repo
DeeboMC: @zetto97 how do you get spanish and russian as your natives? interesting language combo
logi6000: @l1ght5p33d on his github
Pr0ject414: MKE
cod4_lightning: why you are yellow?
nsielicki: word, I grew up in germantown
Pr0ject414: nice.
mangoxavier: How are you keeping track of what you're learning when you're changing the numbers?
zetto97: @deebomc family :O
mangoxavier: just versioning or all in your head?
cafe807: gave up the Corona thing?
logi6000: https://github.com/geohot/configuration?files=1 this
ak0ya_: no corona
Waldoqq: give me back corona :(
DeeboMC: exotic conciousness you're running in they're breh @zetto97
DeeboMC: there*
logi6000: @waldoqq he dont care about Rona no more. he just went to a protest
Waldoqq: WTF
DeeboMC: 'rona lmao
Waldoqq: fakes news
logi6000: @waldoqq no he did
DeeboMC: he didnt go tho.
Waldoqq: George is the best law abiding citizen who never tries to insult big brother
logi6000: @deebomc oh he didnt
DeeboMC: he thought about it
l1ght5p33d: config is weak af
Waldoqq: idk who you ar etalking about @logi6000
mangoxavier: doing -150 to -400 with that last change but only a few positives, the one before had quite a few positives with lower - numbers
l1ght5p33d: my bash_rc is like 200 lines
forkdb: Is Kim dead?
l1ght5p33d: can i just dump it in chat or no
nsielicki: lol
bulksquat_thrust: Some studies are finding that the self-isolation hasnt really impacted total deaths at all
logi6000: @forkdb prob
forkdb: Ohh
logi6000: @l1ght5p33d prob not
DeeboMC: pastebin it
mangoxavier: those are way higher
mangoxavier: nice lowering
logi6000: anyone want what could possibly be the dotfiles
logi6000: https://github.com/geohot/configuration?files=1
nsielicki: we went from 50 to 10 with I and it started behaving better -- maybe we overshot. I'd try 20
DeeboMC: @zetto97 spanish via south america i presume?
mangoxavier: oohhhhh damn it's doing better after it gets a positive then fails
DeeboMC: as opposed to spain or mexico
DeeboMC: im guessing argentina
nsielicki: Does it need to learn more from what it's experienced or does it need to experience new things
mangoxavier: That's awesome
nsielicki: hell yeah
zetto97: @deebomc spanish via Spain
logi6000: remember sub only chat
mangoxavier: I think it only learns through exp? right?
eeXecute: Have a good night George
mangoxavier: hmmm
DeeboMC: ah i see. dinner at your folks house must be dank af lol
Pr0ject414: Nature vs. Nurture arguments
nizero: George how was the protest
Santiago_LHC: nature is nurturing
info303: i think lunar lander gets a big reward for landing safely rather than crashing, but it can't seem to stumble upon that scenario
l1ght5p33d: good config https://pastebin.com/Fd7bdmqL
mangoxavier: beginners luck
kniightt: hi george thumpF
logi6000: I use zsh
logi6000: with vim controls
DeeboMC: @l1ght5p33d noiice!
mangoxavier: It's like it rewards then is complacent and loses. But it looked like it was losing less after each success.
Pr0ject414: on the surface it doesnt appear to remember what it has learned
Kawhiet: Maybe the goal should be hover first?
nsielicki: i fucking hate zsh, i hate that catalina defaults to it. try `printf hello` in your terminal
l1ght5p33d: @DeeboMC like that ffr
l1ght5p33d: thats what you want
nsielicki: where did the output go? zsh removed it
logi6000: @nsielicki echo hello
nsielicki: right, it likes it if you give it a newline, but if it's not there it eats your output
DeeboMC: lol hell yea boi
logi6000: pretty sure george uses zsh
mangoxavier: yeah, left over how long though, and is there a way for it to improve faster and not be so random. that's the issue right?
monaliso: you should really be concerned about "printf", yep
mik12f4: there are so many more ways to fuck up i guess
Roundlay: naysay2SITREP
mangoxavier: push that to 3 lol
perfectdotexe: Geohot is my inspiration, he's the reason why I strive to be the person I can be. Knocking out what I need to do plus more.
Jehhred: If only the objective was to make the rocket fall as fast as possible
perfectdotexe: First time I caught him streaming.
Pr0ject414: The Unity ML agents has that feature i believe.
l1ght5p33d: why are there ssh in geohots config hes gonna hack me now isn't he
mangoxavier: Feels very close
nsielicki: @monaliso try python3 -c "import sys; sys.stdout.buffer.write(b'hello')" if you want a different example
DeeboMC: goin extra innings tonight. thinking of tapping out, eating tacos and finally starting DEVS
maddyakhil: !uptime
nsielicki: zsh eats malformed output which is ridiculous. It'd be one thing if they added an extra newline, it's another when they just stop showing you output of programs you run
DeeboMC: @l1ght5p33d wait what? you got his configs?
Pr0ject414: give it more trainings?
logi6000: @deebomc yeah https://github.com/geohot/configuration?files=1
logi6000: they been public
logi6000: loo
nsielicki: lol
logi6000: lol
neekolulbot: lol
mangoxavier: you also rose dim
info303: i remember alphazero filling up the buffer first before even beginning the training, not sure if this applies here
DOWRIGHT: 50*
perfectdotexe: $ twenty doll hairs
Santiago_LHC: @DeeboMC DEVS is good!
Pr0ject414: you would hope to see a nice curve
logi6000: I'll give the link to anybody for 25 dollar bitcoin.
perfectdotexe: @DOWRIGHT what up LUL dowrigPup
Pr0ject414: that unfortunately does not appear to be a curve
neekolulbot: what do you think about financial RL? For asset allocation among many assets?
DOWRIGHT: hi @perfectdotexe just fixing bugs. what up with you?
DeeboMC: batman@z840 ? @l1ght5p33d
logi6000: @dowright yo you Streaming tomorrow?
swagrrr: did we ever fold a protein?
CaptainRoberts: !uptime
perfectdotexe: @DOWRIGHT Wrapping up classes, just did a few tryhackme challenges.
DOWRIGHT: yes ^_^ @logi6000
logi6000: @dowright sick
mangoxavier: haha
ancientchineseelder: on adderall today george?
CaptainRoberts: how long has he been streaming, chat?
DeeboMC: @Santiago_LHC im looking forward to it
bubblesnot: What would Elon do?
nsielicki: 6 hours maybe?
wthbro: what the idea behind the program, want it to hover or land?
markydothh: Does George do adderall?
Santiago_LHC: You can do it, Mu!
logi6000: @ancientchineseelder that's a no no drugs prob gonna be a ban topic soon
PrivateOrange: Run a huge cluster and train train train
bulksquat_thrust: @DOWRIGHT sup!
DOWRIGHT: yooooooooooooo o/
perfectdotexe: Geohot is naturally on drugs, he doesn't need em
JdPaulBlart: we need a deeper net squadR
mangoxavier: It spent more time like you thought but then dicked around like before
bulksquat_thrust: @DOWRIGHT still working on the next-gen firewall?
DeeboMC: @l1ght5p33d it was in the ssh folder
Kawhiet: professional hyperparameter tuner
JdPaulBlart: new goal is to create an ai to tune ais
DOWRIGHT: yea @bulksquat_thrust just uploaded the new build to github today
logi6000: @jdpaulblart were gonna need an ai to tune that ai
bubblesnot: Can you train it to just hover consistently?
bulksquat_thrust: @DOWRIGHT sick!
JdPaulBlart: recursive ai tuning
ancientchineseelder: im new in here what is the project here?
mik12f4: maybe lunar lander is a boeing product?
info303: curious if it would quickly learn to land between the poles if you start it off in the corner
ancientchineseelder: i last tuned in during covid
logi6000: @jdpaulblart inefficient and never gets the job done
logi6000: what more do you want
perfectdotexe: I was doing a discussion in college about machine learning and decided to clip geohot from a youtube video, I almost posted him smoking weed LUL
isalhi: what’s the project tnght?
mangoxavier: dumb car
logi6000: anyone want dotfiles that wasn't here earlier
logi6000: 25 dollar eth
DeeboMC: currently scannin the .files like DBstyle
perfectdotexe: dowrigPup u take dogecoin? @logi6000
mangoxavier: yes lower random
Waldoqq: big models Kreygasm
Pr0ject414: Take everything to the extreme
Pr0ject414: max it all out
logi6000: @perfectdotexe nah bitcoin or ethereum
Santiago_LHC: 100 dollars for my wallpaper collection
mangoxavier: yes
mangoxavier: 3
peter35_: perfectdotexe ConcernDoge
DeeboMC: dude .. so i can make monies now?
ideology_sniffing_raccoon: thiccc models Kreygasm @Waldoqq
markydothh: Anyone heard about Hedera hashgraph? Any opinions?
mangoxavier: random at 1 maybe?
logi6000: @georgehotz you dont care if I quickly monetize your chat right. no. good thanks for permission
cod4_lightning: man i
logi6000: so I got a good zshrc goin for 5 dollar eth
logi6000: do I here 10 dollar
mangoxavier: 80 and 63 were positive
DeeboMC: lol it was publicly available as @l1ght5p33d said.. now its worth money ? whats goin on here lol
cod4_lightning: @georgehotz bro that dedication you have is remarkable!
mangoxavier: yeah!
SKPTCL: :)
Pr0ject414: "rev share ecosystem"
peter35_: 'can't use google' tax
SKPTCL: SKPTCL subscribed with Twitch Prime. They've subscribed for 3 months, currently on a 1 month streak! :)
Kawhiet: just gotta train it another 3 hrs
l1ght5p33d: i write new geohot dotfile app
Pr0ject414: now that is a graph with a curve
l1ght5p33d: 8 dollars
mangoxavier: two in a row!
DeeboMC: how did i get it free?
Pr0ject414: its a little THICC but a curve none the less
l1ght5p33d: 7
manuchroma: !uptime
mangoxavier: ohh!
DeeboMC: batman@z840?????
Pr0ject414: play us some tomcr00se music
logi6000: anyone want a really nice tmux conf for 10 dollars eth. really nice even has time and date on bottom. uses ` for hotkey. best hotkey cant get a better one
raystriker98: let it run the whole night
mangoxavier: what is the reward rule for not dying?
whoishenry123: wouldn't this be easier to test if you had a more powerful GPU?
logi6000: all money goes back to gifting subs too
DeeboMC: @logi6000 ur killin me bro lol
nsielicki: can you recap what changes were made to get you here?
logi6000: so you might get your money back
jay_al97: @georgehotz has anyone gotten this to work better than this
nsielicki: k=3? replay size? iterations
nsielicki: it definitely is better
bulksquat_thrust: is this a library you can run with a gpu?
Kawhiet: barrel roll 2.0
yuvi___: just joined stream. anyone wanna explain whats going on?
logi6000: @deebomc I try my best
DeeboMC: haha
Pr0ject414: show the graph?
mangoxavier: oooh
nsielicki: nice
mangoxavier: hmmm
blizz191: activision elu different then relu?
mik12f4: yeah better
logi6000: @yuvi___ you have to send me 10 dollar eth to continue watching. he will ban otherwise. I give good tmux conf with purchase
l1ght5p33d: we only like prime numbers
l1ght5p33d: 67 &gt; 69
bubblesnot: Does it have weight? Can you dump fuel before landing?
logi6000: monitizing
logi6000: hey where my star
l1ght5p33d: not sex wise tho
mangoxavier: hell yes
logi6000: I'm still subbed I have 2x multiplier
DeeboMC: good .xmobarrc, only 6 years old
l1ght5p33d: unless 67 is a really good move ...
Pr0ject414: add more neurons
mangoxavier: oh man two in a row then hover a long time
mangoxavier: 99, 92, then hover
nsielicki: does he live in sf or la?
bulksquat_thrust: them losses be gettin smaller
mangoxavier: 175!
logi6000: @nsielicki I'll tell you for 5 bucks eth
mik12f4: what does the first number of each line represent?
mangoxavier: hell yes! look at that 225
brofessorbob: He lives in SF
nsielicki: thanks
logi6000: @brofessorbob wrong
mangoxavier: 216
DeeboMC: @georgehotz are you batman@z840?
mangoxavier: this is a lot better
gardiyanismet: !time
brofessorbob: I live in Pacific Beach Bro. I think I'd know
DeeboMC: he lives in whales vagina
Pr0ject414: ADD MORE DENSE lolol
DeeboMC: not san fran
J3rwin: 256 Pog
Kawhiet: this honestly feels like gambling
fenharelthedreadwolf: what should I do to get selected for working in comma.ai?
logi6000: mission beach San Diego
mangoxavier: It learns a lot after it hovers
cod4_lightning: is the code on github?
Super_car_car: oh snap im in PL
mangoxavier: look at the pattern before it hovers
bulksquat_thrust: what protest?
cod4_lightning: what car do you have?
logi6000: wheres my star anyone else see its gone
mangoxavier: 1 pos then hover, then 2 pos then hover, then 3 or more pos then hover
JdPaulBlart: for the record i suggested deeper net like 30 mins so wheres my mod
routerkicker: yeah it's gone
logi6000: I'm still subbed tho.
kisspapa: trying to finish my elf infector virus for cybersec, been stuck for a day, fuck ELFs lol
Apimar: What we making today xD
cod4_lightning: what car do you have?
Pr0ject414: do even deeper net
logi6000: its gone
DeeboMC: you got a z840 at work?
mangoxavier: far bigger positives with this
JdPaulBlart: hows this DEEPER NET MR STREAMER
lebop: george what do you think about doing another hackerrank type of stream?
nsielicki: 3 consecutive positive results, don't you dare reset this shit
nsielicki: 4
logi6000: dont know what happened. I'm still subbed. twitch was afraid of my genius marketing ploys
DeeboMC: suggest it better!
info303: it learned to hever
info303: hover
mangoxavier: yess
Pr0ject414: RESET.... RESET... RESET... to the beat of the drums
mangoxavier: yesss
mangoxavier: more it hovers more success you see and higher each time
Kawhiet: learns to hover and then the randomness kicks in
DeeboMC: @logi6000 its hard out here for a pimp
logi6000: @deebomc lol
bulksquat_thrust: im trying to understand the 2D m.losses list number
nsielicki: train more on replay
nsielicki: increase i
mangoxavier: why winder rather than deeper?
Pr0ject414: hear me out... a deeper wider net
brofessorbob: Balls Deep Net
hardtarget4: lol
anasshm123: when she tells you go deeper but the programmer didn't give you enough pp
logi6000: @georgehotz guess twitch was afraid of my genius marketing ploys
cod4_lightning: imagine americans starting immigration to the middle east because of coronavirus?
DeeboMC: lmaooo
l1ght5p33d: wtf did u just do
DeeboMC: pp
mangoxavier: bignet is a type of desert in the south
fenharelthedreadwolf: can we make it mandatory that some action must be always performed ?
Waldoqq: I LOVE CORONAVIRUS I LOVE CORONAVIRUS I LOVE CORONAVIRUS I LOVE CORONAVIRUS I LOVE CORONAVIRUS I LOVE CORONAVIRUS
mangoxavier: yikes
DeeboMC: never heard of it. i want to eat bignet
nsielicki: @fenharelthedreadwolf we shouldn't have to, that's the point of munet
perfectdotexe: Does a geohot, hoot?
logi6000: twitch should give me my big dick star back
nsielicki: muzero or whatever
wthbro: When did you start programming?
anasshm123: I'm out of the loop can someone fill me on what's going on, is this Comma A.I 2.0?
mangoxavier: hmmmm
almondsnakes: yo this guy has a dishwasher he must be loaded
logi6000: twitch is just afraid of me
mangoxavier: oh shit
Waldoqq: @anasshm123 no its covid-19 2.0
cod4_lightning: how much would you sell comm ai for?
aalhendi: You still have a sustainable supply of limes in your pantry?
DeeboMC: holy shit. i didnt pronounce it right. you meant bignets like as in cafe du monde.. yea ive eaten those lmao
anasshm123: @Waldoqq thanks for the info
brofessorbob: 100 Billion Dollars
mangoxavier: oooooh
mangoxavier: that's sick
hardtarget4: we out here hovering
mangoxavier: that's awasome
brofessorbob: suck
KAZERKE: PogChamp YO
mangoxavier: FUCK YES!!!!1
JeanFrag: oohh
l1ght5p33d: OOOOOHHooo
anasshm123: clap clap clap
t0rment1337: OMG
brofessorbob: sick!
JeanFrag: Pog
nsielicki: that was fucking nuts
Roflz1lla: PogChamp
bulksquat_thrust: it was so close hahaha
Pr0ject414: THATS A WIN in my book fam
Penguino138: When does it refuel its landers?
breadhamandegg: Pog
Pr0ject414: big net for big dicks
l1ght5p33d: things so good
mangoxavier: fuck the car up the hill this motherfucker is flying
brofessorbob: Balls Deep Net
jeronm: Pog
logi6000: so I'mma just start monitizing again
DeeboMC: that just blem my mind
KAZERKE: which one
DeeboMC: how did it know?
peter35_: bignet mogs me
Waldoqq: incels OMEGALUL
anasshm123: How to know you are an Incel?
almondsnakes: that's a chad move
rahfuls: please limit facial touching in order to fade lord rona
wthbro: you know what I did today? nothing :)
anasshm123: I watched a doc on E-boys
DOWRIGHT: if you in this chat. you an incel.
brofessorbob: Pacific Beach is full of Chads
bulksquat_thrust: most incels are just simps in disguise
DOWRIGHT: oh wait....
info303: since it randomly picks from game history buffer, it might explain the instability of the value function
fenharelthedreadwolf: can we auto adjust neural networks size dynamically?
logi6000: I have a amazing screenrc best screenrc never been a better one. make you a 10x better programmer. only 10 dollars eth
mangoxavier: set random to 1
mangoxavier: real good
DeeboMC: bruh thats funny if u think that; theres just diverse ppl out here breh
mangoxavier: this is great
sk84uhlivin: PogChamp
info303: woot!
brofessorbob: lol
IMTotes: LULW
Penguino138: Geo Musk
mangoxavier: give it less gas lol
Super_car_car: this is amazing
brofessorbob: Bro landed in a crater
NYCyril: @logi6000 do you make screen great again with your screenrc ?
Penguino138: @brofessorbob You want to land in craters typically
Pr0ject414: ok hear me out again... lets do an even bigger deeper net.
cod4_lightning: imagine americans starts immigrating to the middle east because of coronavirus
brofessorbob: @Penguino138 Thanks Bro
logi6000: @nycyril yes better than tmux. best rc. best thing to ever touch your computer 10 dollars eth or if you order in the next 10 hours it's only 9.99 eth
info303: MOAR neurons!
nsielicki: @cod4_lightning nah i'm good thanks tho
Penguino138: @brofessorbob I mean its not the goal of the game, but in real life it's usually safer in craters
mik12f4: does it have to learn to shut off thrusters too?
l1ght5p33d: I saw geohot copy like three layers of neurons then it started working
brofessorbob: Is mission beach open to the public?
l1ght5p33d: this stream is blssed af
logi6000: @brofessorbob yea
mangoxavier: does it get an equal reward for thrusters off + in the flags?
fenharelthedreadwolf: sir I am a newbie and wanted to know can we dynamically adjust neural network size as we learn ?
mangoxavier: oh
brofessorbob: Trying to get pitted
logi6000: oh I dont know about now tho
DeeboMC: if i wasnt dodgin warrants id be in the trap rn... prolly watchin this on a phone with earbuds.. instead of the laptop i traded drugs for @DOWRIGHT true story; non incel here
Kawhiet: does this mean we'll get starfox?
brofessorbob: We training on CPU or GPU here?
logi6000: twitch give me my mother fucking big dick star back
DOWRIGHT: @DeeboMC airpods?
routerbomber: !uptime
DeeboMC: nah im fiscally responsibler than that. i bank my monmey
mangoxavier: ex machina shit you just did to the lander right there
logi6000: @deebomc so anyways I started snitching
DeeboMC: @logi6000 lmaooo
logi6000: lol jk
Waldoqq: @logi6000 NEVER SUBBED NEVER DONATED
LordHord: Star?
bulksquat_thrust: bulksquat_thrust subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 2 month streak! imagine not having a star
mangoxavier: ehhh
logi6000: @bulksquat_thrust twitch took my star
DOWRIGHT: isnt casting data to int &gt; range &gt; list &gt; np also a huge bottleneck?
bulksquat_thrust: @logi6000 those bastards!
logi6000: I still have my 2x multiplier
Neoriginal: the biggest bottleneck is patience
logi6000: but now it just says I'm not subbed
JdPaulBlart: is this how you tuned autopilot
brofessorbob: @logi6000 contact twitch bro
JdPaulBlart: openpiliot
logi6000: @brofessorbob how
l1ght5p33d: @DOWRIGHT where does that happen
DOWRIGHT: i would assign np. random. choice to a local var np_random_choice and see if i can pull out some of those data converions.
mik12f4: what causes it to take more time on each game?
brofessorbob: @logi6000 IDK google it. Maybe twitter?
logi6000: should I just email them give me my mother fucking big dick star back on geohot channel
l1ght5p33d: lookup table? pickle?
gigafact: @logi6000 click on your username on chat. your sub just expired it looks like
nsielicki: fuck buzz aldrin
bulksquat_thrust: damn
bulksquat_thrust: lol
logi6000: j got it like two days ago
mangoxavier: everyone sub
chetdonovan: koilD
pwnbase: did you see the vid where buzz punched that guy
KAZERKE: would the AI knows about the 5G towers and corona ? 🤔
DOWRIGHT: @l1ght5p33d it might not be part of the code executing tbh. but the look with counter is doing similar, just not as extreme
l1ght5p33d: lookup table of every possible frame the game can be in to speed type conversion
DOWRIGHT: loop*
gaocaandra: what did i miss
gaocaandra: did it work?
DeeboMC: It did
gaocaandra: nice
mangoxavier: I don't see a pattern but hope the graph is good
DOWRIGHT: having to loop up a method ever iter is gunna add overhead.
gaocaandra: what was the problem
l1ght5p33d: rewrite game in assembly
DOWRIGHT: look
brofessorbob: Any module or tool to help benchmark python code to identify potential bottlenecks?
DeeboMC: What da prolem is
nsielicki: so... is that album art actually just captain crunch having sex with a crossdressing koolaid man?
DeeboMC: 😂
mhmd0: !live
DeeboMC: Made me cough up Newport smoke
nsielicki: hahah guess we're even
bulksquat_thrust: im just trying to figure out what the picture on the wall is a reference of
mik12f4: this one not as good
mangoxavier: one eye dude got cucked
fenharelthedreadwolf: does adding negative rewards any useful ?
DeeboMC: 😂 there we go @nsielicki
wthbro: what ⌨️ are you using?
mangoxavier: there are some hovers prett close
bulksquat_thrust: @wthbro you've done it now
wthbro: Kappa
mangoxavier: but not great positives
fenharelthedreadwolf: for example if it doesn't do anything for a certain time , you start reducing the rewards
DeeboMC: Emoji’s gettin slick @wthbro
Kawhiet: participation trophy
mangoxavier: graph doesn't look good
bulksquat_thrust: this ai is a summary of my self education in CS
bulksquat_thrust: "wants to learn but gives up"
logi6000: still letting me sub like it didnt yesterday.
bulksquat_thrust: haha
logi6000: just keeps saying something went wrong and shows me an ugly ass animated girl
LordHord: @logi6000 your card got declined homie
logi6000: no when I go into the menu to sub
DeeboMC: so what’s this deal with this ghidra shit @l1ght5p33d
치킨워커: are you hiring
l1ght5p33d: @DeeboMC assembly lookup table
l1ght5p33d: with tooltips
DeeboMC: The nsa just released it to the public tho?
scullionw: scullionw subscribed with Twitch Prime. 
l1ght5p33d: @DeeboMC version 1 theyre probably on like at least 100 by now
mik12f4: does the first number represent how long its in the air?
DeeboMC: Ahh I see.. just taunting us n shit I guess.
JdPaulBlart: good night @georgehotz youre welcome for suggesting deeper net btw
luggy_b0i: @logi6000 If you're in the US make sure you pay with paypal. Xsolla might be triggering something with whoever your service provider is.
Faceless_Bard: good morning everyone o/
mangoxavier: watching this helps u figure it out
purpaleslushiii: @georgehotz what is the most important math to be a good coder?
mangoxavier: that graph is looking rather good
itsChopsticks: anyone else functionally retarded and doesnt understand it
itsChopsticks: just me? sick
nsielicki: this stuff is just very difficult, don't say that about yourself
luggy_b0i: @logi6000 And you might have to call them now if they blocked your card. I wont lie, it happened to me once.
DeeboMC: Nah bro, just need more prerequisites in place
mangoxavier: yes ever changing landscape and needing to learn.
calcmath: been gone a while, what is he doing now?
itsChopsticks: i'll just stick to writing really bad scripts in ps and python, compsci people just too big brain for me
brofessorbob: Is perl a dead language?
mik12f4: first numbers are all small
nsielicki: learn perl if you want to make money
nsielicki: dead languages pay more
Creamy_Goodness_: A strange game. The only winning move is not to play.
brofessorbob: I heard Cobal can make you loot
itsChopsticks: if you feel like supporting dead systems, sure
stone43_: Perl is easy to learn though if you know Ruby or Python
itsChopsticks: COBOL sucks ass
mangoxavier: yeah
mangoxavier: looks random
mangoxavier: your random is set to .02 not .05
FangSkillz: he doesn't read chat LUL
brofessorbob: Python popped my cherry and trying to figure a next language.
mangoxavier: yeah
DOWRIGHT: big disk club!
brofessorbob: 0.5
DeeboMC: Depends on if you want a really specific job at place that’s probably irrelevance; otherwise yeah don’t waste your time
nsielicki: your mcts was slow but you should work that back in real quick and see if it makes a difference
mik12f4: looks way worse?
Super_car_car: your discount is .98 instead of .998?
Super_car_car: ah my bad
tangobeer: !uptime
l1ght5p33d: discount is bad terminology
l1ght5p33d: going into the future does not mean good or bad, it should be a "reducing" or "avoiding" type of language
mik12f4: seems like it only learns when it takes its time
calcmath: whichhe playing iwht now? envirnment is
calcmath: still cartpole?
brofessorbob: Aite Bros. This Bro needs to sleep. Good luck with landing the lunar lander Geo-bro.
Waldoqq: anyone want to watch me stream Svelte?
calcmath: oops got mangled
Kawhiet: It's not learning to hover tho
DeeboMC: I wonder what carrot top’s up to right now. Prolly re-reading Knuth, working on the replacement for python
mangoxavier: nah
nsielicki: I had never heard of value prediction network, thought it might be related to value prediction in computer architecture but I guess it's not
nsielicki: I did a (failed) research project on microarchitecture VP
mangoxavier: yeah, before big net
Waldoqq: BibleThump
l1ght5p33d: typescript &gt; python
Pr0ject414: whoever suggested the even bigger deep net is an asshole
Waldoqq: Typescript &gt; English
Pr0ject414: lupoCREEP lupoCREEP
Faceless_Bard: a serious/not serious question chat : do you think tools like muzero will make speedrunning much harder , if the game devs build around it ?
calcmath: wider nets are more stable than deeper nets
routerkicker: branch prediction in modern cpu architectures is done by neural nets as well @nsielicki
mangoxavier: tighten net, confirm, raise random, confirm, adjust
mik12f4: what can you change to get first number above 500?
pogu: @routerkicker that's pretty insane. Is NN inference THAT cheap now
routerkicker: yeah it's right on the chip though
nsielicki: @routerkicker value prediction is not the same as branch prediction
l1ght5p33d: @Faceless_Bard Isn't speed running already hard why would it matter if the difficulty is changed
mangoxavier: self.epsilon = self.epsilon * self.decay
Faceless_Bard: l1ght5p33d probably making the games unbuggable ? one way
nsielicki: @routerkicker see https://www.cs.cmu.edu/afs/cs/academic/class/15740-f03/www/lectures/ValuePredictionDisc.htm
routerkicker: thanks
bulksquat_thrust: 5 hundred thousand
mangoxavier: Ɛ = Ɛ * decay :⇔ Ɛ = Ɛ * decay ^ X
mangoxavier: self.epsilon = self.epsilon * self.decay
nsielicki: @routerkicker if you're interested in trying the problem yourself, https://www.microarch.org/cvp1/
mangoxavier: got to go to bed, later
nsielicki: ut-austin just beat André Seznec by quite a bit which is a big deal
DeeboMC: @faceless_bard I was just about to say sorry no one address that because I thought it was interesting but I didn’t even know how to articulate why I felt like it wouldn’t have an effect but I guess that’s a theory, although “unbuggable” seems a little more optimistic than I’d be willing to bank on
tripcloth: whatch making geoh
Faceless_Bard: DeeboMC SeemsGood i think i could have asked that better . But yeah perhaps very optimistic , but maybe 'bugfree' enough so that its impossible to speedrun. It might be a tool publishers like , since put time limits that are always never enough for a game to be polished properly :thinking:
Faceless_Bard: since they*
DeeboMC: I could see that but *jeff goldblum voice* “life.. uh uh uh.. finds a way” 😆
Faceless_Bard: :P
gigafact: it's this what they do at TeslaAI
DeeboMC: with much less shit talking im sure
nsielicki: discount definitely was involved when we were winning that
stone43_: This is what ML engineers do all day
Faceless_Bard: with probably better hardware :o
Pr0ject414: we had 3 nets
nsielicki: i think it was really low like 96
Pr0ject414: when it was working
Pr0ject414: it wasnt wider than original
info303: tesla self driving neural net architechture is pretty nutty
DeeboMC: you have an article?
stone43_: ixnay on the eslaTay talk
Nicholai518: Hey @georgehotz showing you some LOVE from NY
DeeboMC: ok but i wanna know about thier neural net architechture and why its so nutty
DeeboMC: alktay*
Pr0ject414: we were at like 200k for the model
Fr0zenOfficial: good morning :)
Pr0ject414: what is it at now?
SparksCx: !uptime
Pr0ject414: when it worked*
raystriker98: congrats your model is a teenager
DeeboMC: "my cpu is a neural net processor, a learning compyootuh... ahhhehh"
nsielicki: models
mik12f4: better numbers an hour ago
SparksCx: lol
gigafact: haha
nsielicki: lmfao when it came in sideways
Faceless_Bard: LUL
Keboburrito: lol
t0rment1337: lmaoo
Faceless_Bard: need a compilation of those clips
Santiago_LHC: Did we land yet?
DeeboMC: its gettin funky
SparksCx: atleast is firing all it's rockets
DeeboMC: a few good ones
gigafact: this is amazing
routerkicker: once we touched the ground at 0 speed and then took off again
suav12: What are the plots?
DeeboMC: thats what i beeen thinkin... this mfker is forgetful
nsielicki: time on x axis, rewards is top graph, bottom graph is losses
bulksquat_thrust: ive decided im going to make an aimbot for bannerlord as my programming project
stone43_: I joined late. No MCTS?
Fr0zenOfficial: I just joined what we doin here? :D
Pr0ject414: didnt they have like 500000
nsielicki: MCTS was slow and didn't make a difference
electro_y0: !uptime
Pr0ject414: in the replay buffer
routerkicker: YES weigh samples by reward sounds good
l1ttlemtman: good morning
DeeboMC: yea because it needs some specificity
toxyviper: He make a game?
l1ttlemtman: a reinforcement learning environment
nsielicki: no he teach a computer to win game
DeeboMC: the game is just there to test his heuristic
info303: wonder if they will use this type of solution for real lunar landers one day :D
bulksquat_thrust: @info303 oh god i hope not
NoLimitFitness: !uptime
webuser011: george, are you a robot?
stone43_: at least not this model
info303: @bulksquat_thrust haha well, I mean if you fast forward into the future
routerkicker: nah they got lasers and analytical algorithms that work better. ML is used for realtime obstacle avoidance on landing though.
bulksquat_thrust: @info303 going to be some enders game shit where bots are learning on real landers hahaha
nsielicki: is that actually how the spacex landing works? lidar?
info303: well the output from the lazers would be the input into RL algorithm, and the analytical algorithms replaced with a neural net
nsielicki: I would think that the exhaust of the rocket would make that impossible
DeeboMC: are we at like 5 hours now?
opheimer: !uptime
nsielicki: it's way past 5 hours, closer to 7 or 8
routerkicker: idk about spacex maybe we can get george to break nda LUL
opheimer: no Nightbot?
l1ttlemtman: nda
maddyakhil: !uptime
Pr0ject414: LIKE A ROCK
DeeboMC: thanks mod lol
stone43_: if Chevrolet built a lunar lander
tytos01: how was the protest @georgehotz ?
bulksquat_thrust: muda muda muda
DeeboMC: he ended up staying home
Santiago_LHC: Motivation!
JoeMountMount: just joined, what's he doin?
l1ttlemtman: you should have bought the expensive macbook
bulksquat_thrust: when you install visual studio and it just starts poppin up cmds all over the screen
l1ttlemtman: get a mac pro
nsielicki: get one of those usb-c gpus maybe
nsielicki: enclosure
JoeMountMount: what happened to solving COVID Kappa
SciTwi: Hi George! How are you doing with all the stuff that's going on?
l1ttlemtman: do you speak chinese ?
mik12f4: what does the number before the reward represent?
entangledbeing: How much u make on twitch lol
nsielicki: you ever work with FPGAs? You think this sort of turnaround on validation is long, try waiting 12 hours for synthesis
IaMvAzU: r u planning on becoming a twitch partner?
bulksquat_thrust: ive got the beefiest pc you can build and visual studio still runs like a snail hobbHands
nsielicki: @mik12f4 number of steps before game dies
info303: @mik12f4 timesteps
JakeLes: Visual studio runs well wat
mik12f4: thanks
l1ttlemtman: make a carla reinforcement agent
DeeboMC: bro when this thing gets cooin is when you need to put on stranglehold by nugent and come in guns blazin
l1ght5p33d: @JoeMountMount send comma ai a mass spectrometer
l1ght5p33d: an*
l1ght5p33d: a
DeeboMC: Cookin*
JoeMountMount: @l1ght5p33d why would you need a mass spec lol
TasosTheLord: HeyGuys
l1ght5p33d: an ai mass spectrometer
JoeMountMount: yeah why
l1ttlemtman: muzero on go thinks 12 steps ahead
nsielicki: i believe this problem will be solved tonight
tytos01: can you do some GridSearchCV on this ?
l1ght5p33d: @JoeMountMount because its too expensive for you
DeeboMC: https://music.youtube.com/watch?v=MRj5KT3742o&amp;feature=share
JoeMountMount: like why would ai help mass spectometry
l1ttlemtman: yes that was for the paper version
l1ttlemtman: they ran another version for 2 weeks or so
l1ght5p33d: @JoeMountMount now you're asking the right questions
JakeLes: So this is the guy they base all the hackers on in movies
mik12f4: wouldnt there have to be a minimum number of timesteps in order for it not to crash?
JoeMountMount: @l1ght5p33d LUL but what was he planning to do w it?
l1ght5p33d: also sammy kamkar
l1ght5p33d: samy
PFY1: hey guys, how do i get started with python and ML?
stone43_: read
JoeMountMount: take a class
JoeMountMount: or watch some free lectures
info303: tons of cheap online courses
l1ttlemtman: make a carla agent
knitler_: chess wouldnt the reward value matter less?
l1ttlemtman: that would be cool with muzero
l1ght5p33d: @PFY1 read all this at least 3 times https://machinelearningmastery.com/start-here/
l1ght5p33d: then look for code to copy and paste
smurfd0: now it had those "feelers" for a bit (i guess they are thrusters)
l1ttlemtman: wow thats good advice lol
PFY1: @l1ght5p33d thanks lol
stone43_: That's a good site
Santiago_LHC: I have another motivational song: https://www.youtube.com/watch?v=VjEq-r2agqc
kerastan11: Hey George, have you done any more talks related to your talk on your simulation "religion"?
JoeMountMount: does george actually read anything hes just been skimming random articles for the past 15 minutes
DeeboMC: @Santiago_LHC nice but maybe a little TOO on the nose.. jus imo lol
fElixb: Good morning from Germany!
tripcloth: here i go again on my own - whitesnake
c9_will_get_out_of_groups: What are you working on today?
ResonatorGames: so cheesy
l1ght5p33d: state-action-reward-state-action
saeveritt: chill beats to quarantine to?
DeeboMC: second for whitesnake @tripcloth
Jehhred: I disappear for 30 minutes and this is what I come back to
nsielicki: emo song request: https://www.youtube.com/watch?v=whPh_PasI58
Pr0ject414: is the problem that we need to reset the whole mode
ResonatorGames: sledgehammer isn't inspirational. It's about sex.
l1ght5p33d: always remember q &lt;- q + a(r + dqs1 - qs))
l1ght5p33d: https://en.wikipedia.org/wiki/State%E2%80%93action%E2%80%93reward%E2%80%93state%E2%80%93action
DeeboMC: @georgehotz take @tripcloth 's requesst
l1ght5p33d: always
birkett0011: BibleThump
routerkicker: hackerman curling the youtube title
l1ttlemtman: did you watch the alphago movie already now ?
nsielicki: &gt;adams song on recommended ;_;
DannyB_VG: camping in alaska is a amazing band
mashafique: Documentary about incels LUL ?
poseidondunaja: !uptime
Penguino138: Penguino138 subscribed at Tier 1. They've subscribed for 2 months, currently on a 2 month streak! Ayyy
DeeboMC: lunar lander is gonna come in moody now
eimis1337: !uptime
socialnotsocial: what happened with protein folding?
hoebamaa: Yeah what is that? Sounds real nice Geo
Depoise: !uptime
l1ght5p33d: @socialnotsocial we're benchmarking faster algorithm . We'll come back to that
JoeMountMount: yeah I wanna know what happened to the COVID stuff too
Jeptah88: What is it learning?
l1ttlemtman: lunar landing
Jeptah88: Oh, coll I see
DeeboMC: fuck it, when in doubt, crank up some bucket
ideology_sniffing_raccoon: he does not want to know
l1ttlemtman: please play the atari game
Penguino138: @georgehotz how often are you a late night coder?
l1ttlemtman: its easier to see how it performs there
nsielicki: are you using the actual gym version of the game still? this isn't just like a fucked up reward function right?
DeeboMC: minusthebear
routerkicker: yeah it's the original
Jeptah88: Are we seeing a sample game or is it really learning 1 game at a time?
l1ght5p33d: it was better before
Jeptah88: LUL
Penguino138: Is there a certain time of day you prefer programming or does it just depend?
DeeboMC: reminds me of myexitunfair
nitrixen: @Penguino138 Ideally while I'm awake.
Penguino138: I mean it for geo :p
nsielicki: asking that gets you banned, stop asking
TasosTheLord: or subscribe and you can ask Kappa
aykevy: hammer Pog
hoebamaa: asking what?
DeeboMC: are these people meming or are they serious about it
mashafique: I think at this point people are just memeing.
gigafact: never give up, never surrender
l1ght5p33d: copy paste more keras layers i saw you do that and it worked earlier
l1ttlemtman: run the atari game
petxe: Good morning! ^^
Jeptah88: GG
DeeboMC: lol ok. *faith in humanity stabilzes*
Jehhred: Who would have thought balancing a stick is easier than landing a space shuttle
DeeboMC: dude i lunar lander was where its at
Captain_Cavo: snake
info303: start it from the upright position!
l1ght5p33d: snek
Captain_Cavo: nokia style
nsielicki: just needs a fresh look on a new day
DeeboMC: i cant get jiggy with this shit
DeeboMC: hell yea boiii
DeeboMC: brute force, no finesse
lord_alpaca_666: this is what happened to the european mars rover
DeeboMC: thing is just flinging spaghetti at the wall
WillGreen98: How long has George been streaming?
Jehhred: 3 days
P0LY: !uptime
Jeptah88: !uptime
DeeboMC: 8 or 9 hours
forkdb: !uptime
P0LY: :o
DeeboMC: im guessing
forkdb: Ohok
Crocodile_Dendi_: 5 hrs 54
Jeptah88: I see 5:54
DeeboMC: oh shit.. way off
lord_alpaca_666: i like jupyter lab because it has dark mode
nsielicki: !uptime
7pius: george hotz is so sick, he might have been infected
DeeboMC: i like that
DeeboMC: bro you got a deep bench.. yung phil jackson over here
nsielicki: yeah, increase j
raystriker98: leave it open
Jeptah88: Do it
KAZERKE: do it
bloopsterr: go for it
mashafique: Farming channel points overnight PogChamp
bobsmash: yess :)
DeeboMC: muzero shows some promise
raystriker98: I support
okeeeeeee: me
DeeboMC: muzero seems worth it... let it learn regardless tho
raystriker98: maybe we'll clip the video of a successful landing for you
guinness84: it solves both CartPole and CartPole PogChamp
routerkicker: are there other algos wich give you a dynamics model?
DeeboMC: they way it does it tho seeems more intelligent when it does get it right. it just doesnt seem to learn from its past very effieciently
l1ttlemtman: how many searches does it do on muzero compared to ppo ?
Jeptah88: The landing spot is in the same place, it should be really easy
Penguino138: beautiful
DeeboMC: it was just chillin
erlsek: noobzero
DeeboMC: burnn
WEEEEEEEELL_ITS_KNOCC_OUT: LUL
Jeptah88: DeepMind will crash your lunar lander
l1ttlemtman: how many searches does it do on muzero compared to ppo ?
DeeboMC: deepmind is tenacious tho
Jeptah88: Like butter
l1ttlemtman: but still that way muzero has a lot more potential
KAZERKE: Wowee
sakshambhutani2001: nice
JjohnConstantine: what's the end goal?
birkett0011: Are there more complex simulations to test on? How many variable can these realistically handle?
nsielicki: any explanation for why the losses do that on the tail?
l1ttlemtman: go is 10^170 position
l1ttlemtman: s
l1ttlemtman: @birkett0011
DeeboMC: openai sure takes its goddamn time tho.. deepmind just continually hucks it til failure lol
Leo__dog: @georgehotz if i gave you my ip, could you be able to hack me
guinness84: are u rendering 1 to 1 with deepminds code
DeeboMC: finesse tho
jsnake794: hey i caught one of your streams
nsielicki: pybind11
DeeboMC: whats deepmind's strategy
DeeboMC: fall?
petxe: @georgehotz You think Java is a good programming language to start cooding?
l1ttlemtman: still deepmind &gt; openai
birkett0011: are there more complex gyms available?
l1ttlemtman: yes carla
DeeboMC: 10 billion iterations til succes?
Jeptah88: DM trying to do barrelrolls
mik12f4: why does the landscape change?
info303: deepmind was working on starcraft2 bot, how far have they come? I think they had it working like a year ago
mars4real: PogChamp
ppnn123w: !uptime
l1ght5p33d: how much change makes it not muzero anymore?
l1ttlemtman: they beat a professional player
DeeboMC: openai sits there and reflects lol
info303: i think they had an unveil on twitch like a year ago
hardtarget4: openai too good
DeeboMC: meanwhile, DM's like....
info303: and I think they trained it for 200 real-time years in 2 weeks or something like that
l1ttlemtman: they beat lee sedol in go and some liquid guy in starcraft
DeeboMC: lol
Snooker_snooker_snooker: it finally discovered theres a y-axis force
l1ght5p33d: how did u get MuModel from the psuedocode?
info303: google money haha
l1ttlemtman: google buys you gpu
Pr0ject414: wasnt that paper able to do it 600 runs?
castavs: @petxe I think he hates java. lol
nsielicki: thanks for the stream, frustrating but hey this shit is always frustrating
nsielicki: if it was easy everyone would do it
ofaas: gg
mik12f4: thanks for the entertainment, goodnight
DeeboMC: you gonna keep your muzero model learin' overnight after stream ends?
castavs: This is Thor's hammer in an ice lake
sakshambhutani2001: You can write some sorta sdk of bot detection for website and make people label commaai's data
Joselinis: Goodmorming
nsielicki: ( ͡° ͜ʖ ͡°)
l1ttlemtman: they do already
l1ttlemtman: comma pencil
DeeboMC: do you have cable?
Gamer_nohope: !uptime
nsielicki: post notebook to github when
sakshambhutani2001: no that is for people but like you can give it to all website like Not a bot stuff
Jeptah88: GGs
NatePh_07: it was a good night
ideology_sniffing_raccoon: GG
l1ght5p33d: extend keras layer = new-muzero = newzero
mik12f4: Forgot, any daytraders, VSTM 8 est, goodnight again
Penguino138: Hope to see you soon geo
fedexkinkos: teach me how to dougie
gigafact: thanks for all the streams
DeeboMC: do you have cable?
NatePh_07: what should we try next
ErmBison: whats next?
tangobeer: are you streaming tomorrow?
K0enich: comma.space soon?
l1ttlemtman: please write a better monte carlo search
Keboburrito: lesson learned, openai &gt; muzero for space. Thanks for the streams
birkett0011: You think these can be practically applied to more complex models like in https://cloud.anylogic.com/
castavs: How comma will solve the problem of different models with same name in different countries?
wthbro: will you do a series for newbies, this is too complicated to grasp
l1ttlemtman: or run muzero with carla
routerkicker: thanks for the stream. byebye!
info303: more AI streams! SeemsGood
nsielicki: peace and good night
baconslices13: i just joined after finishing hw lmao
wthbro: rip
pwnbase: Goodnight, God bless you, God bless these United States.
calcmath: goodnight
Waldoqq: goodnight man I enjoyed the stream
lebop: george what do you think about doing another hackerrank type of stream? please
wthbro: a viewer :(
ideology_sniffing_raccoon: BlessRNG BlessRNG
tangobeer: are you going to be streaming tomorrow?
smurfd0: one step for cartpol one tiny step for lunar
l1ttlemtman: there is a straight up gym env for carla
l1ttlemtman: just change and run
l1ght5p33d: @pwnbase hmmm....
fedexkinkos: can u do a steam where u personally teach me how to solve hacker rank
l1ttlemtman: ssh into gpuslave
axiosz: what was the artist you were listening the past days on stream?
t0mmv: which gpu are you using?
NatePh_07: see ya George
solyyd: whats your next big project
uh key choices. Alt left to go back um
is terrible. So I changed that to
escape. I actually imported the IDA key
bindings, but the only ones I care about
are that and of course pressing X to
see. You can see the context here is a
computed call.
I get a notification.
You didn't get one.
Uh just a I got an email.
Oh,
wait. Right now.
Oh, right now. Oh, so that's where
everybody comes from. I see when it's
delayed now all the people are showing
up.
Are they?
Yeah. Yeah, we got lots of people now.
It just came.
Hello. Oh, we're up to 92 people.
Yeah.
Yeah. So, I figured this would make a
good stream. You see this
star code pointer.
So, let's look into the decompiler code
which I've already brought up here for
GIDra and let's try to understand how
this is working. Oh, I got a new Visual
Studio code. Java 12 supported.
This is written in Java 11.
So, we're going to try to figure out how
this works.
Why is that stupid Visual Studio Code?
So much dirty.
What's dirty?
So much dirty
your house. Oh, are you doing laundry?
Yeah.
Can you wash your towels?
Yeah.
But don't wash them with anything else
except for the sheets.
Wait, why?
Cuz they're dirty.
What do you mean?
Don't wash them with Don't wash them
with my clothes.
Wait, why not?
Cuz they're dirty. The towels are
extremely dirty. The clothes are only a
little dirty.
Oh my god. George, what do you think?
The audio is only in the left ear. Is
that better?
No, but that's the deal, Alex.
No, they're all going in together.
Wait, no, they're not.
But they're not.
You have so much clothes and dirty
towels. But
you can put the sheets in with the
towels. You can't put clothes on the
towels. You can put your clothes in the
towels. Whatever you want to put in with
the towels is your your prerogative, not
my clothes.
What do you prefer, clothes washing or
towels washing right now?
Uh, towels washing. I have plenty of
clothes.
Okay. But you might have to fold the
ones in the dryer and put them away.
Hi Shahos, you're a subscriber. Welcome.
Um, so this is the uh steering firmware
from a from a Honda Civic.
Hi haircut Jimmy, you're a subscriber,
too. So what we're trying to fix today
is this.
So instead of saying pointer find and
table lookup um by the way just to give
you guys some context
I ver 7 param one psvar 8.
So these are the torque tables. How do
you make an array?
How to do this?
I make an array in Gidra. So I've never
really used GIRA before.
Um, so I'm going to be kind of bad at
this. Data create array.
Enter the number of array elements.
Maybe we can tell from this. Oh, that's
just an input to this function.
Why does X refs takes forever?
[Music]
IAR13
look like one FE can be the max but it
also comes from somewhere else.
Param 2 is passed in through that
function. Okay, this is extremely
complex. We're just going to look at the
table and figure out how big the table
is.
PSVAR 8 is either this pointer or this
pointer and this is passed in as eight.
What's Ivar 7?
Oh, that might not be a size thing. See?
Okay, we are going to fix the bug, but
first we're going to
find in table lookup.
Oh, I'm not looking at the right thing.
Okay,
this is do torque curve lookup. Here we
go. These are the pointers I'm looking
for. This is a pointer table lookup.
This is table lookup. That's what I want
to see. Okay, cool.
The audio in the left ear seems like a
problem. Let's see what we can do about
that.
Um,
it's probably just because this is a
stereo microphone.
I don't know what to do about that. Oh,
audio sounds fine. Okay. I mean, I guess
we can put it here, but then it's harder
for me to see the screen.
Yeah, it's fine. Is that better? Now we
can do real ASMR stuff.
You can hear me over here on the left
and you can hear me over here on the
right if I don't fall off my chair. All
right, cool.
Well, now it is because I fixed it. Um,
so if we go back, you can see this is
this is the actual function that looks
up the torque um in the Honda Civic.
So, I really want to understand this
code before prop Oh, you're only hearing
stuff in the left. All right. Well, then
you know what? I'm putting the mic back
over here because, you know, it's too
much for me. All right. Cool. Can I
please make the font a little bigger?
Uh, I have I haven't the slightest idea
how to do that.
Now, we're going to have to hear the
washing machine all stream.
No.
Does that make it okay?
All right. So, D. It's the same. Is it
supposed to be the same hotkey?
I try not to rebind hotkeys when I use
programs.
Um because
please quit GI. I have IDA open as well.
This is this is that same stuff in in
Ida. Uh but no, Gedra is uh
is nice.
What was I pressing to do that? D for
data.
Oh, it changes from B to D. Okay, it's B
and D usually means disassemble and
disassemble there means C even though C
is already used from many things. So,
okay, create array.
Let's try something like 10 and see what
we get.
Oh, but I don't like that it just hides
them.
Oh, here we go. Space. Ah, beautiful.
And do I have that character? Okay,
cool.
Number of array elements 85. One, two,
three, four, five, six, seven, eight,
nine.
Um, I believe there's eight. And we all
know that 9 * 8 is uh
who knows what that is. That's a big
number.
9 * 8 is 71. That's not right. 9 * 8.
What's 9 * 8?
72.
Oh, 72. Good call.
Oh, wait. Did I just make an array of
arrays?
No. Oh, wait. Good thing this has undo.
That's something IDA doesn't have.
Right.
But I want to change the array size of
this. Huh? Do you see what I did there?
I made an array of arrays, which is
actually really cool that that worked.
And that's almost what I want. Create
array.
What if I change it to nine? Let's see
what happens. Okay, now it's doing 9 by
10. So, that's not actually editing the
existing array.
Oh, G is hard to use. Okay.
Um, choose word 10.
You going to make some monte? That's a
good choice, bro. I'm going to create
array. You know what? I can undo this.
And then I can just go back here and
it's actually nine by and I want to make
a eight array on top of that. And that's
going to do exactly what I want, I
believe.
Yeah.
One of those is nine. Oh, it's more than
that. No, it's only seven. Yeah, because
these are the data, you see, and these
are the uh
I have to figure out how to edit this.
There has to be a way
fixed audio by changing to mono.
Wait. Okay, let's check my Let's check
my OBS and see if it's actually messing
up. We can We can fix this. We have the
technology. Okay. Okay. Well, I see that
it's a little bit unbalanced.
Um,
yeah.
Yeti stereo microphone. Yeti stereo
microphone. Yeti stereo mic. Wait, no.
It's still unbalanced
even if I hold it over here. That's
terrible.
Is that better? Huh?
Oh, something's like broken.
What's up? Why is it not balanced? Okay,
we're going to seriously investigate
the microphone issue. We're going to
open a bipartisan committee to
investigate the microphone issue.
No, but why is it? Just look, you can
see it. It's not balanced. How could
that even be a thing? It's not like it's
actually stereo.
Okay, we're going to try something
crazy. I'm going to unplug and replplug
the microphone
microphone. Okay, it's still unbalanced.
Let's check the advanced audio
properties. Balance. Oh, okay. Okay,
that's in the right.
I played with the input modes. Okay,
that's not balanced. Is that balanced?
Does that balance? Is that balanced? No,
that's unbalanced. But this doesn't make
sense, right? Because balance there is
set to the middle. We can down mix to
mono. Oh, that fixes everything.
No, but I don't want to down mix to
mono. We want to get to the bottom of
the Yeah, I know. But no, no, that's
terrible. I want stereo to work because
you people deserve stereo sound. No,
it's not fine. Look, you can see the top
one going up more than the other one.
Um,
mono is king.
Is the problem with the mic?
No, I know. But if I go over here, it's
still left. And if I go over here, it's
still left, right?
So, this is not the problem.
Yeah, we need stereo. That's right.
Nah, no, no, no, no, no. Guys,
we don't have time for this now. We're
on a mission. We're not going to get
distracted by the stupid sound. We're
just going to down mix to mono.
I don't know. Like, does Garage Band
have settings for this?
I know it works fine if I set it to
mono.
Um, wait. Are you the guy who got banned
from PSN? No, but you're the guy who got
time outed on my channel.
Yeah, I looked at the knock.
Well, that's terrible.
[Music]
[Laughter]
What?
What was that?
Oh, it was terrible.
All right, I'll come back and finish
your laundry later.
Okay. Thanks, dude. Do you want my key?
No, you can just come up. It's fine.
I'll be here. Um, no, no, no, no. We're
just going to stick with we clearly
anchored the audio gods, but if you have
any idea, there's no knob that talks
about balance or anything. There's just
gain and pattern.
That was a terrible noise. Bye-bye.
All right. All right. No, we're done.
We're done. We're done. We're done. It
was funny. It was funny. It's over. It's
over. We're still looking to figure out
how arrays Whoa. How'd I just do that?
Data settings.
No.
How do I uncreate an array?
without using undo. I don't know.
No, we actually want 9 * 7, which has
got to be something like I don't know
63. Is that about right?
Sounds good.
Um, well, I wouldn't say the Honda
software has a bug. I would say that the
Honda software doesn't have as much
torque as people might like. So, we're
actually trying to fix a bug in Gedra.
Um,
just point out a word array. Let me just
make this an array as well.
Uh, I wouldn't say it's a bug in G. It
could very well be that I just don't
know how to use the software. But um
okay, so this is
uh enter name is torque
uh
table idx.
Oh, and look look how it changes to ptr.
That's really nice.
And this is torque table val. Perfect.
All right. So now here we can see in
Duke torque curve lookup.
Yeah, there should there's got to just
be a setting for this because these
pointers
Oh, it's probably because they're in
RAM. Oh, this might be really easy.
Okay, so if it thinks that that pointer
is mutable,
it's not going to want to change it. But
if it thinks it's unmutable, it'll
change it. Ah, this might actually be
easy. Okay, do you see what I'm saying?
Like so what this is doing this is an
indirect lookup right so it's it's a PC
relative indirect lookup but I believe
it has this whole region marked as RAM
so it was mutable
um how does gred deal with strrus I
don't know I haven't really done strrus
yet let's see if we can do this uh
where's the memory map
configure
I don't think it's that
display function graph. Let's see what
this looks like.
Well, that just like seag faulted. Oh,
no. Here we go.
Oh, this is kind of nice. Function graph
browser.
In a way, it's better than IDA. In a
way, it's worse than IDA. Okay.
Oh, when will I continue on the
checkmate exploit? I remembered that. I
remembered every reason that I hate
jailbreaking
and stopped working on it. But I have
still been playing with Ger, which I
really do like.
Symbol table, symbol tree, memory map,
memory map. Oh, that's what I want. Aha.
Okay.
Yeah. So, it thinks it's RWX. Let's just
get rid of the W.
Oh my god, that fixed it. Oh, Dra is so
smart. Look how it now says table
lookup. Wow, that's the smartest thing
I've ever seen. It didn't even make me
reanalyze it. Bros, at the NSA,
you know when they say like, you ever
seen those signs in Veronica? You know
the sign in Veronica Mars, this is your
god government. You know what I'm
talking about? I spelled God wrong.
It's it's it's it's on Keith Mars's wall
in Veronica Mars.
No, no, no, no, no. I I swear it's in
Veronica Mars, guys. There's a sign on
the wall that has the slogan of the US
government and it says, "This is your
god." And that's how I feel right now.
Wow, that was just incredible. There
there's the whole stream done in 20
minutes.
Um, oh, I'm so happy I thought of that,
too.
All right,
so now let's see what's actually going
on. So, this stuff's actually RAM. Um, I
wish it would automatically like figure
out where the RAM is.
It should.
We can create the
Is that one? Memory map. Script manager.
Memory map.
Edit.
Add. Aha.
[Music]
Read. Write block name
real RAM.
Um, initialize say uninitialized.
Ah, now it's that that. Okay. Wait, do I
So, what do I do? I reanalyze. Auto
analyze. Is that going to turn those to
Oh, first I thought it was lagging, but
then I realized I was just on the wrong
screen. Go.
Oh, this is so good.
Times nine.
Wow. Okay. The only thing missing that I
would love to see in Gedra. Um, NSA is
Yes. Oh, the NSA is a bunch of geniuses.
bad.
This software is so good. Like look how
nice this disassembler is better than uh
better than hexrays.
This is so good. Um torque
pro choice.
Wait, what?
There we go. It's pretty good.
Context data. Oh, look now. Oh, now it's
doing these as data. Oh, the reanalysis
worked. Man, this is good. Okay. The
only thing that I think Gidra is really
missing is when you click on something
in Ida, it lights them all up. So, maybe
we can figure out how to do that. I
don't even know. I just want to look at
the code in this stream. Um, you know
what? Ida, like if I click this, it
would light this one up, too. It's like
really good,
but I bet you that's like really deep in
there. Uses of bite data type. So,
that's not what I meant to,
you know, let's rename this because it's
not RAM
program. We'll name this one RAM.
Oh, we actually know which uh we know
which processor this is. Uh there's a
data there's a data sheet somewhere. Um
it's one of those Reinesis things.
Uh
Honda Civic steering
processor.
This is useless. Um, the only place that
might have it is actually my code, blue
talk.
Me, never mind. Too hard to find.
Doesn't matter that much. I think I
guess the RAM locations, right? If we
find weird ones that don't match, we'll
know.
See, but like
Okay. One of the things I don't like
about this is I actually don't think
Yeah, because that's not a that's not a
RAM address.
So, we want to make it smaller.
Maybe Maybe I just got the length wrong.
Can I edit this?
Split a block. Ah, end address.
Say it goes to like
just go to N BF FF.
Now we can delete this block.
There's probably no references in here.
Yeah. So part of the problem is Yeah.
Yeah. So these are not actual references
and this is messing up. Those are just
negative numbers and we don't want to do
that. So
that
yes.
Oh no.
Ger crashed.
But it seems okay.
Oh, all of these address f. Okay. See,
yeah, that's what I wanted to avoid. So,
I don't know. Let's try the auto
analysis again. Let's see if those go
away
because those are not addresses.
Okay. So, you see the analysis progress
down here.
No, those shouldn't be there.
You know what?
Whatever. They're not affecting me right
now. When they do affect me, that's a
good later problem. Table look up. and
table lookup. Oh, this is so good.
Um, it's typing is pretty good as well.
Like this.
And I understand that it's a bite
comparison, but I don't actually want
that to be a char. There's ways to fix
this in IDA properties.
No. D. No. All these casts.
We actually already did what the stream
came to do. And the all you had to do
was set the memory map to mark memory is
not writable. It was actually absolutely
brilliant. It's exactly the feature
you'd expect. If anyone from the NSA is
watching and just saw that, man, you
guys really killed it.
Um, okay. I can show you a little bit
about what I'm doing and then this is
going to be a short stream because it
was so easy. I thought we'd have to go
into the code.
Um, like I prepared, I got the GIRA code
ready.
The decompiler is written in C++.
All right, maybe we can understand this.
So if you look here, do torque curve
lookup is being called with
this. Oh, times nine because it's Oh,
it's typed. Wow, that's so good. Okay,
you see how this is times nine.
Ah, then the nine is okay. The nine is
just the number of entries. You see 1 2
3 4 5 6 7 8 9 that's nine multiply by
torque row choice. And the reason it's
times nine is because it knows that this
is a short pointer. So that's actually
correct pointer arithmetic in uh in C.
This thing really written by geniuses.
Um these are the tables that controls
how much torque your Honda Civic puts on
the steering wheel.
Um,
is there a way to just
name variable retype variable?
What does 22 mean?
Well, that looks better.
Try to retype it.
Do torque curve look up.
Okay, this is the max thing. Where is
this number coming from?
Um,
torque input clamp.
So you can see here this is being
clamped to uh
clamp to for input clamp.
I don't know what this is.
Oh,
this is a pointer to somewhere.
See, I don't know why it's when I press
X on that, it says use of
There's also a way to like toggle Pcode
display here apparently. What is this?
Go to the next different bite value.
Display bytes.
Huh.
Display function call tree bookmarks.
Where's the decompiler? Oh, there it is.
This decompiler is so good. No, there's
not a debugger.
Um,
but yeah. So this is
clamped
input value.
It's less than zero. Flip it around.
Okay. And then it checks again. If it's
greater than zero, it flips it back
around. That's the output value. That's
like an
unclamped output value. Why is it
type does this have?
How do I check the type of this? Uh,
retype global. Oh, it's a short pointer.
All right, cool.
So, this is like like the output of
see this is kind of stupid too because
this plus eight there
and that's a real eight which means it's
a
a zero. So, it's different. Okay, so
that just
one of the infuriating things about this
code. Um, and it's it's amazing. Like
this is this is the code that's running
in the Honda Civic uh steering firmware
and they use global variables all over
the place. You shouldn't do this.
Amresh, thank you for gifting a sub. Um,
if you love Gedra, please subscribe to
the NSA. Please pay your taxes. I I want
you know what? Honestly, I feel better
about paying my taxes this year knowing
that they open source GRA. This is true.
Just try
another difference between GIA and IDA
is um GIA's decompiler works for every
processor. So they have a processor like
intermediary language called slay which
decompiles this to pode. Let's see if we
can display pode.
What? Edit code layout.
I don't even know.
All right. So, it really keeps it
around. But like it would be nice if I
could click on that. And
why when I press X does it think it's
use of short data type? This just has to
be some bug in the key bindings because
that's definitely not what I want.
That's not what anybody would want.
X has to mean two things.
No. Find references to Oh.
Yeah, I want to reorder that. Can I do
that?
See, the problem is the first thing it's
doing is the data type manager plugin.
Actually want to remove it from that,
but I can't.
Um,
click in the box.
Clicking in the box doesn't work. I
don't know.
Uh, okay. Where is torque row choice
coming from? Is this a global variable?
Yes, it is. Oh, and I used to call it
row selection. I see. So, we can
actually I don't think we need a name
for that. I think it'll automatically
become
uh how do I reset the name to be the
pointer? Is there any remove label? Ah,
perfect. Oh, that's so good. You see how
it automatically calls it pointer and
like does exactly what you want because
the NSA is brilliant. Dan Fchgo, thank
you for subscribing to my channel. Um,
so these nines, okay,
so let's see. Um,
uh, number
of keys.
number
of keys
minus one int number of keys char
I want to change that type
find uses of char show references to
address.
So let's see what this is actually
doing. So remember keys is an array of
shorts vows and this is like it's like a
lookup in a table,
right? Um so if we go back we can see
the table we're actually doing the
lookup in go like do curve lookup and
this shows here we go table lookup. So
this is the value that's being looked
up. Those are the indexes. Those are the
values and that's the number of indexes
or the number of keys. Um, oh, this this
code's so easy to read now.
Autocreate structure.
Not what I wanted.
So this is like like main steering
function. I have some better names for
these things in IDA. I believe
we can look at what the same function
looks like in IDA.
Um,
I call it
do torque curve lookup.
The one before it doesn't have a name.
And this is electronic torque table
lookup. I don't know how good any of
these names are.
to R5.
So what's the ABI for this stuff?
All this does table lookups.
Um,
so this is like the final torque curve
lookup. Let's see what this function
does.
Um, we should be able to trace it all
the way through because I have the can
stuff. I have the can stuff somewhere as
well.
where I really give things terrible
names.
Um, so it's E4.
E4 is the steering command for a Honda.
So we'll just call this can Oh, this is
slow
can can receive E4.
Oh, and it's so nice to be able to look
at things
in C.
But again, this is all just use of
global globals everywhere.
I don't know what that is.
I call this function can check some.
Yeah. Oh, it's right here. Oh, wow. Look
how easy it is to read and see.
And confirm that that's actually the can
check some function.
You want to see? will bring up the same
code in Open Pilot. Yeah, look at that.
That code's in Open Pilot. We can go
find it.
Confirm it's the same.
Um, so the Honda check some would be in
self-drive car Honda
can.
That's what the Honda That's what it
looks like in Python.
Um, you can see it's basically the same
thing except written more stupidly with
a lot of casts.
Call that CK.
I don't know why I is. It's like a
counter. It's not really even used. Oh
well. So we know what the inputs to can
check some are. This is address
one. Well, okay. Okay, so the problem
here is that this is just the wrong
type.
I change that to unsign
char star.
Yeah, that looks so much better. Call
this
address.
Call this len.
Call this
that.
Ah, beautiful. Look how good that looks.
Now,
I mean, you see it's it's the same as
this Python right here.
Um, I don't know why it feels like it
has to do these 27 casts.
You went check some. That's right.
I don't know.
camera CV4. Okay, so this checks the
check some.
I really wish when I clicked it, it
would light up. Maybe someone has a fix
for that. Didra click variable light up
all variables. Of
course it's useless. Okay.
Try the middle mouse button.
Oh,
fkn Dean.
Killing it, bro. Oh, that's sick.
Middle click.
That middle click.
Ha. NSA thought of everything.
They my bros.
Okay. So, if the check sum zero, end it
with
zero. I assume has to be a good thing.
Yeah.
Um
can E4 status.
So, let's check uh the DBC file and
let's figure out what the E4 message is
supposed to look like. So, we can go in
here.
Um,
that's good. Uh,
you know what? We should change the
title of this.
Honda steering firmware. Yeah. Yeah.
Something about that. Yeah. whatever
because we solved the problem so fast.
Uh so here this is it's in the Civic
Touring.
So we can look at steer
steering controls. Here we go. So 228 if
you go 228 to hex it's going to be E4.
Um so steer torque is the first 16
bytes. So let's see if we can find the
actual CAN data. Let's see how much I
did in IDA with respect to this. Oh,
actually, you know what? I know exactly
what a candidate is. It's the thing
that's passed to the checksum function.
No shit. All right. Um,
so this is actually an array.
Let's do this carefully.
Uh, we're going to call it can
data.
Uh, and then we're going to make it an
array that's eight long.
Create array. Wow, that's a lot of
array. Eight.
Okay, let me just pass in can data here.
Now, if candidate is used anywhere else,
what does this function do? Well, that's
complex looking.
Is this used anywhere else?
using a lot of places. That's crazy
complex.
Do I have a name for it?
Verify can message with table.
The same address.
Okay. Well, Maybe old me knew what I was
doing.
Call it verify can message with table.
Um 14.
See what it does.
First change the type of this. This is
just that
and the type is Uchar.
probably some table somewhere.
I don't know. Maybe this actually does
the receive. I mean, this is this is
looks like it's actual
I don't know.
Um
I mean this looks like MMIO, right?
Okay. If it receives successfully, we're
going to do the check sum on the data.
Where does things like this come from?
Oh, middle click, boys.
Puvar2.
Where does this come from?
GBR.
By the way, JB's married. Yo, you from
the NSA? The NSA is, bro. Jib's married.
Yo. Um,
either way, I mean, I think we can say a
bunch of things about this,
right? I mean this here
despite being part of these PU bars is
clearly uh what do we call it steer
torque
let's call it E4 steer torque
um that's just a counter and check sum
Um,
I'm going to call this one. Cany for
status alt.
All
right. Now, let's see where this goes.
Not use of short data type. No. Oh, I
click on it here.
Okay. So, it's written to here.
It's initialized here. Oh, that's nice.
Oh, beautiful. Beautiful. Oh.
can anit E4. We can just rename this.
Man, this program is so good.
Okay, so here's where we read it in.
I don't know what that does, but this is
the good one. Okay, cool.
um read
E4 steering torque.
So if we really want to make safe
modifications
to this firmware that we're really sure
what they do,
we want to like understand what this
whole parsing path looks like. So here
it's multiplying it. I believe that's
the square roo of three.
Um,
it's checking some bounds.
This doesn't look right.
Why to build this all? And then maybe
the return doesn't actually matter.
Okay. So, this reads the steering torque
and it looks like it sets it into here.
Um,
we'll call this processed steering
torque.
Uh, well, you know what? We'll just call
it E4 steer torque
DDB4.
That's all it's doing.
Um,
this is some processing function. It
looks like it runs every once in a
while. Let's go here. Right click there.
Go there.
I do wish XREFs was faster.
Wait. How come
how come X isn't working?
references.
Show references. I don't understand why
I couldn't press X and do that. Okay.
Um,
so that's what writes it. Where is it?
Red.
Pam. Why does it think that's a param?
Oh, it's like a param to a function.
I see.
Oh, there we go. That now we're back
where we were. Okay, perfect.
I don't know what that's for, but here
is like here's the function we were in
before, and we see it just gets passed
in there. Perfect.
Um, unfortunately, it does get Oh, here
we go. So, this is just steer torque 4.
If it's less than zero, it adds three,
shifts it over. Man, this is complex.
Dre references it as an integer, which I
guess it is an integer because it was
multiplied by stuff.
If it's less than zero, it adds three.
It shifts it over two and makes it a
short.
Then it does some other complicated
bullshit. And then it saves it over
here.
So let's call this
E4
torque capacitor
ED4.
It's only written two. Great. Not
useful.
Um,
so it's also passed in here to
electronic torque table lookup.
These other values are passed in here.
There's also a speed table.
This might be the speed table.
Torque choice. Why is that 12? And how
do I make that not hex?
I don't know if I can.
Yeah. So these are these are tables very
similar to
this 12 tables.
Oh no, it's just Oh, it's 12 because it
wasn't. Ah, I get it. I get it. I get
it. All right. Um,
still times 9. So it's probably the same
72 as before. Let's create an array and
see if 72 makes sense.
Yeah, I think 72 makes sense.
No,
it's actually one less.
So if it's one less, 72 minus 9 is 63.
There we go. Yeah, because you see this
reference is here. So
creator a
yo I trust the NSA man. I'm an American.
They're not like the you know FBI on me.
The FBI bust Americans man. The NSA like
I don't know
as Lil Wayne would say. They spy on all
of our shit.
Um I think this is speed.
So, this is the speed clamp. I'm not
sure what it does with this.
Um,
torque speed clamp.
Read it here. Oh.
What?
I don't know. Of
course, we only write to it.
Well, this one gets red.
I hate they use global variables.
Don't do it.
Um, torque speed clamp. Copy.
Let's figure out why this is red. No,
no, no, no, no, no.
Speed table lookups. Torque speed clamp.
Copy. Here. Go. Look, read.
Ah, an electronic torque table lookup.
So, what's called here?
Here we go. Okay, now we're getting
somewhere because the thing passed in
here.
Well, I don't know about that.
That can't be the only use for M2, is
that?
No, the only use for M2 is that plus
six.
So, this E4 steer torque isn't actually
used there. Just that plus six to make C
bar one.
I love that I found this click though.
Throw with the click. You know what
you're doing.
Um, torque speed clamp copy. Where is
this used? multiplied.
Yeah. H that's not what I expected.
It's like it's a scaling factor or
something.
Yeah. Global variables everywhere is
also extremely dangerous and hard to
analyze.
H
multiplied.
All right, let's try going at it from
the other way
and seeing where the input to this comes
up because this is the input. So, this
is torque input. We know that
I already have here clamp input value.
Uh, here we go.
Why doesn't it resolve this?
I I don't know what that plus eight is
supposed to be
times R4. So why isn't it resolved that
to this which it should be
this is annoying
that is hard to resolve.
um
because of this eight here. I don't know
why it didn't resolve this.
I guess it's too far away.
I'm calling
worked out this morning.
One day I want to take a shirtless
picture on Instagram.
Yeah. What?
Why does this say equals question
question?
This resolves fine.
Oh,
wait.
I don't think this is right.
So
calls this and then this is a pointer.
Oh, I should check the type of this.
That's a little annoying. No, it's int.
But it's not
I don't know. Is this doing 2D
references?
Is this a pointer or not? Let's figure
out what writes to it.
Yes, it's a pointer.
It's a pointer that we don't know the
stuff for.
Well, it's okay that it's a pointer.
Let's call it pointer torque stuff.
This is all an electronic torque table.
Why don't they show me what function
it's in?
Function name.
Here we go. Why was that not default?
That's so good.
All right. So, yeah. Yeah. All of this
is in electronic torque table lookup.
All right. Good. Good.
Um
in speed clamp copy
though
Is this the same plus eight? I don't
know.
Cuz see this plus eight? Why is this
undefined?
Where's the one with eight? Not even
here.
8 comma R10.
That's being set there. Okay.
Type undefined to
type int.
It's being cast undefined to
for some reason it can't tell what type
it is.
Um, what type is it when we look it up?
And so this is electronic torque table
lookup and Duke torque curve lookup.
It's a short. So we can just retype this
as a short.
Yeah. And then this is so this is the
torque.
Yeah. And this can like add things or
subtract things from the torque. This
comes in from there which comes in from
there which is actually param one.
What is param one?
IR7. I7 comes from here which is this.
What is this?
Not uses of short data type. No, not
what I want
this. So we write it here
comes from this function
which comes from here. Okay, this is a
rabbit hole.
What is this function though?
Not too much stuff.
There's my Bitcoin address. Go to uh
tow.com.
Do I still have a good one?
Towel root.com. Let's say
Yeah, that's good
because active roots are so last summer.
Yo, let's listen to that.
Open Spotify.
There we go.
Wait, is that really what I linked to
from
This is kind of kamei related. So, what
this is, a Honda Civics can't steer
below 12 miles an hour. So, if you just
change this 28 to a zero, it fixes it.
Um, input speed.
I think it's kph
2.
[Music]
Hey.
[Music]
[Music]
[Music]
[Music]
It's also scary that that can be
negative sometimes.
I want that to just be a
Well, it's greater than one.
I guess the main thing I don't
understand is this shift shift right
one.
That would make sense, but
it shifts it left there when it does the
key look up. If val is less than save
the output
show number of keys.
Why is it adding number of keys there?
Add one if it's less than zero.
That's what you return.
See what find and table look up is
actually supposed to return.
Table look up
just just the index.
I always assume this one extra one at
the end. So
it actually going to be a value at the
Oh, so it does. No, no, it should be an
index. So that's correct.
Um,
just a number of keys. Oh, it's binary
search.
Oh, I get it. Oh, that's clever.
Ah,
who gets it? See what it's doing?
Yeah. Okay. So, if it's less than
Yeah. If it's less than, it closes that
off. So, it does binary search.
Yeah, very cool.
Cool.
All right.
Uh, the only way that we're really going
to answer that question is if we if the
only way we're really going to answer
the question is if we just get that to
compile quickly and see. So, let's just
do that.
Um,
uh, table.
Let's see.
You can even write tests based on this
decompiled code.
Um, let's copy and paste the tables.
Do
input torque clamp.
No, it's not that. It's called uh which
one?
No,
not any of these.
Do torque curve look up. That's it.
Here we go.
have that in a read me
short
uh idx
time
[Music]
short val.
set.
All right. So, table lookup, I pass in
the value.
See, I want to look up hex 100 idx val 9
short at
No,
the old flash
mile.
Fine. I'm signed into the other way
around because it's not a type def.
Cool.
Let's actually just make them hex.
Perfect. All right. So now we can answer
the question.
What happens if we run off the end?
1680. Um,
I guess we got lucky
and then zeros.
I doubt it.
Cool.
Um, my only concern is that this
wait.
Oh, it checks it right at the top there.
If keys is less than val local
val is less than key subret. Oh, so it
doesn't even do that. Oh, that's
beautiful.
Good. Smart people wrote this code.
Confirm
running
off
tables is Okay, good.
Beautiful. All right, cool, guys.
Uh, that's going to be a hard one to
follow. Maybe you all will follow it
later in the archive. Um, is it question
time? Anyone have any quick questions
before we go? Uh, so for reference, what
we did today is we just confirmed, we
found that it wasn't actually a bug in
Gedra.
We just had to I'm not asking questions
about fucking keyboards. Um,
wasn't actually a bug. We just had to
set it to not uh writable
and
we figured out that it's safe to run off
the table. And I'm a little concerned
about the speed thing now because it
seems like it's a multiply. Why are we
doing this? Well, wouldn't it be nice if
your Honda instead of turning like this
could turn like this? you know,
um, what's the theory behind square root
of three being a right shift of n? So, I
believe that's we can bring this up in
Python. Um,
DDB4.
Uh, let's do DD DDB4.
Why isn't this RL wrapped? Shift shift
left five. Oh, well, no, that's not
going to work. Um
so if we take some number like 1,00 and
we multiply it by ddb4
and then we right shift it 0f we get
like this right and then if we do import
math math.s square<unk>3 we get
basically the same thing. Does that make
sense?
Why is it multiplied by the<unk> of
three? Well, so it's a torque. It
probably has to do with the fact that
it's like a three-phase motor or
something. I couldn't tell you exactly.
I don't really know what the units are.
Where's the razor blade? It's for sale.
You want to buy it? Uh, geiogmail. If
you want to buy it, uh, I'll sell it to
you. Uh, yeah, like uh, name a fair
price. If you want it, it's yours. Um,
yeah, it's a multiply and then a shift.
So, this is a way to do a divide uh,
without actually doing anything in in
float. So, it's like an integer
division.
Uh, I'm using a 13-inch MacBook, but you
know, come on, guys. No, no, no answers
about uh
No, no, we're not we're not answering
questions about old projects either. We
are going to come back to TwitchCock.
Twitchcock will happen again, but I work
today, so I had to work today.
H some more cool bits of chess. I don't
know. Hey, I just copied out from the
from the code.
Could I make a course on something?
What's Twitchcock? Check my GitHub. Um,
this was just a little side project.
Uh, this is what I did today and we
uncovered something concerning which
something's a multiply that I didn't
think was a multiply.
1 million followers.
Um, clang much nicer than GCC. GCC is
unreadable garbage.
You're asking how I got into college.
All right, since I think it's too late
for any of this to have con nah. Now
there's other people involved. But you
know, let's just say
if someone ever told you to be yourself
when you're going to college, that's bad
advice.
If you care about going to college, I
think the system is is after 2014. I
think the college the university system
is uh beyond
They're a cult, man. It's just a cult.
Would I still be successful? Who said
I'm successful, bro? It's cuz I'm rich.
Uh, yeah. Yeah. Turns out you don't need
college for any of that. Yeah.
You do something to protect your eyes
from what?
Locking the domestic Qualcomm
bootloader. Should we break it? What
will it get me?
Um, I do need 1 million followers.
That's right. Uh,
still 353 people. I will pee. I'll come
right back.
No, I got to go to work, guys. I got to
go work.
It's work time.
No room tour. F. You follow me on
LinkedIn. Bro, LinkedIn is the biggest
joke of a social network ever.
If you're expecting anything from
LinkedIn, you know how long I've had it
posted on my LinkedIn that I want to
date?
And like let's just say of all the
dating platforms, LinkedIn is the lowest
quality.
Do you really want like careerclimy
women? That's what you get on LinkedIn.
Do you really want career climbing men?
Do you really want career climbing
people? And the answer is no. So don't
look on LinkedIn.
You're a subscriber, so I won't ban you
for that PS4 shit, but
This is how much I care about the PS4.
See this? That's too much. That's how
much I care.
Finish it. What? You're going to get a
diploma. You're going to wake up. You're
going to feel good about yourself cuz
you got a diploma on the wall.
I never hacked. No AT&T.
You sobbed. Thank you. Thank you, Johnny
Carl. I appreciate it.
Oh, but job posts. Oh, so you can get
validation from some guy. There's plenty
of jobs that'll hire you without a
college education. I have no college
education. I've worked at Google. I've
worked at Facebook. I've worked at
SpaceX. To be fair, I was an intern and
a contractor for Google. I was full-time
at Facebook. I don't know how that got
by him. Uh, and I was a intern at
SpaceX. But, uh, look, if you want
full-time jobs, you can get them. You
just got to prove yourself, man.
What? I fail. Oh, I didn't go to
college, so I can't be an Amazon intern.
That's too bad. Come on, Mr. Bezos. Hey,
I'll make you a deal next summer. Jeff
Bezos, if you offer me an internship,
I'll come intern at Amazon. I'll work on
whatever you want, but it's got to be
from Jeff Bezos. That's right.
Now we got to get tea. Love to get tea
with Jeff Bezos. I think that'd be cool.
Are you going to do GitHub roasting
again? No. No. We did that. We did that
already. We did that last time. We're
going to make a thing out of it. Should
it be Phil time? Should we watch some
Dr. Phil and make fun of it?
Um,
this is a pretty nice uh it's pretty
nice implementation. It's binary search
and I can't believe it decompiled so
nicely. It's beautiful.
How do jump tables relate to steering
wheel? It's not a jump table. It's like
just a look up.
I jump table related to steering wheel.
So, this is the code that runs on the
steering controller of the Honda.
Watch my code blue talk if you want to
figure out how to get it.
Um,
have you looked into Rust? Yeah, I know
a little bit of Rust. I was an intern at
SpaceX. I was an intern.
Pretty cool. Very cool. You know, I wish
there would have been something if I
could if I felt like I could actually
contribute something to the Mars effort,
like beyond being like, you know, a
mid-tier engineer. Uh, I would.
Why does the car limit the steering in
the first place? It's done for safety.
Um,
like for example, the Toyotas I think
don't limit the steering enough. The
Hondas limited a bit too much.
Uh, so you know,
all right, I gotta go. It's probably
lunchtime at work. I'm gonna go eat
lunch at work. Uh, am I not a 10x
engineer? When I'm motivated, I don't
know. I like on an established project,
probably not.
Um, to get things started and to design
things well. Yeah, probably. My favorite
programming language. I don't know, man.
It's been going around Twitter.
Byebye.
sorry I showed up with my screen a mess
we don't want to do
that
um I got a haircut before we have lots
of comments on it it's real the hair is
real also had a mole on the back of my
head and I got it lasered off and I have
a big a little little cauterization Mark
we got some food to eat on this stream
we got some gpus to play
with uh so yeah let's uh let's get
started um so we have our own version uh
it's called
amsi Uh right now the gpus are are
asleep you can see they're
sleeping wake them up in a
minute um can find chat here make sure
we don't let non subscribers talk they
always have dumb shit to say you know if
you have Smart shit to say you're ready
to be a subscriber but until you
do wow this is
unusable what they changed
this oh they changed this oh twitch
changed the
format oh cookies and advertising
choices just please opt me out of
absolutely everything all right we got a
we got a new browser we're going to try
we're going to try Brave I tried to turn
off all the crypto garbage all look look
here's a pro tip for all of you any time
a project has a token or crypto it's dog
shit everything involving crypto is dog
shit it's all okay not all but it's
99% scammers and that's a really high %
so if you throw a dart and your Dart
hits a project that has a token it's a
total scam and you shouldn't be oh but
this token's different oh a hive mapper
oh you got you got to see the no
everything with a token is dumb as fuck
all right are we all on board oh I'm buy
my token oh I got a token oh come on
tokening on no all right uh so I heard
Firefox uh edited their terms for
service to it used to say we won't sell
your data and now they're like psych
yeah oh yeah yeah no no no it was even
better than that it said we will never
sell your data and then it's like psych
we're selling your data I get
fucked all right all right all this is
my my Hong Kong I got this my Hong Kong
jacket Hong Kong jacket on just Brave
any they all have fucking privacy issues
right because they you're here and
they're there okay and it just it really
sucks and you know what browser would be
good if I if it was just a browser but
like you can't even have a browser that
you pay 30 bucks for because that's not
enough oh no no no we need a sustainable
business so it's going to be $30 a month
and then it's going to be it's all like
cable TV right you know cable TV was
originally sold to people as it's like
TV but it doesn't have
ads but you P for it but it doesn't have
ads but then psych they added ads and
why wouldn't they because you are a cow
to be milked for more and more
money um Google Chrome you're just
you're just letting Google take more
from
you uh moo yeah that's right all right
let's get started let's get started uh
you know what is genuinely not a scam as
far as I can tell deep
seek uh deep seek released a lot of Open
Source
stuff what is so crazy about it is like
everyone on Twitter is like wow it's so
good and like it is good but it's
actually not that it's good it's just
pathetic how
bad like open
aiis it's it's the money thing is insane
that that these people underpriced at
10x and have 500% margins again it is I
don't know how exactly true it all is
but they're open sourcing all this stuff
and like it's pretty
legit um and go through some of it so
like I haven't really looked at it yet
uh let's see so these
are going to be high
performing uh what a shame that they
have H 800s I think it's only the
communication that's different can we
get them some good
gpus I
see uh yeah no I think they like kind of
hacked around
this uh comy Land look you do understand
that
like 90% of what you hear in America
about China is just us disinformation
right like it's not none of it's
true uh like there are some truths but
if you haven't lived here if you haven't
spent time here you are falling for
disinformation I don't know what to tell
you
like yeah
uh Hong Kong is cool oh mainland's cool
too I wish I mean I wish it was more
accessible wish I spoke uh better
Chinese um but no you guys are
uh the the the losing has not has not uh
come
enough uh you know if if you want to see
there's there's a great there's a great
subreddit uh called fed news where you
can watch federal employees wine the the
losing has not really come hard enough
so there's a documentary on Netflix
called American
Factory be losing has not this is not a
like loyalty thing right this is not
a uh oh have loyalty to your team or you
know you guys what is that this is a
this is an
objective
question uh so yeah uh I mean deep seek
is just is just the the icing on the
cake uh you know I say is someone who's
built who's built I have a circuit board
line that operates in America I do
Manufacturing in
America uh yeah
you see when you install the WeChat app
on your Android phone it asks for
permission to run in the background
always so it can ensure your messages
are delivered okay so this is just to
track your location at all times oh wow
what a privacy Invasion except for the
fact that your phone is already chalk
full of Google
spyware the phone is Google
spyware uh it's not remember when there
was spyware back in the day you guys
remember Spybot Search and
Destroy Spybot Search and Destroy oh of
course now it's like some to scam Spybot
free
download um yes so you used to run this
this program called Spybot Search and
Destroy on computers but like now it
would just wipe the whole computer
because computers are just
spyware um all right so we got some
green tea for drinking we have a
triangle a sushi CH 7-Eleven for
eating we we'll lose the jacket
the jar head cut thank
you that's what I was going for showed
him a picture some like Marin with a
crew cut I'm like yeah I look like that
uh if China's good why you eating from
7-Eleven you know like 7-Eleven is like
good here right it's not like like like
in America where you have like three
stale hot dogs on a on a thing and these
are like they're like fresh sushi rice
triangles they're better sushi rice
triangles but then I got to walk for
there so you know it's all about it's
all about
trade-offs uh yeah Omi subbi is my
favorite I really like
omii
uh triangular food right no I I used to
get these in Japan all the time I
love um
China is beating USA and everything now
USA is a losing
country yeah it doesn't have to stay
this way it's just that like people in
America are not demoralized hard enough
they must get demoralized even
harder
uh the the the level of absolute
Insanity I I saw I saw a guy I saw a guy
I watched a watched a thing where uh you
know some people were protesting outside
USA don't shut USA down don't shut USA
down it was a guy who worked there and
he's a you know he's a nice seemed like
a nice guy and he was talking about how
he goes over to
Tanzania uh and in
Tanzania because of the cutting of us
Aid according to
him the kids there aren't excited about
America anymore they're excited about
China and he says that this has
radically changed in the last 10 years
he said in the last 10 years all these
Chinese uh people started showing up and
they started uh you know building trains
and opening stores and putting up
cellphone
towers uh and now the kids are more
excited to learn Chinese than learn
English and my answer to that of course
is that it's not us Aid it's not us Aid
being shut down clearly us Aid was
operating well and good during the Biden
regime uh it's that you are just not you
getting out
competed so yeah I mean people are just
simply not demoralized hard enough you
have a fake
currency
[Music]
um oh Elon said on gr that he can't
explor all the corruption because
they'll kill him yeah
like the US is not demoralized nearly
hard
enough uh to be ready for any kind of
uh comeback right Elon Elon stands there
and like tries to fix it and he get the
the constant unbelievable stream of
hate uh you know from from from the
whole government like they they're not
ready they're not ready to be better yet
they're not they're not beaten down hard
enough I think that that it all needs to
go through bankruptcy and it's going to
be this like like the US dollar has to
go to zero and then maybe things can
start being
fixed
um no it has to go to zero it's it's
it's when you look at when you look at
when you look at like this stuff deep
seek is open
sourcing the arrogance of companies like
open AI or anthropic who think they can
win with one hand tied behind their back
uh is ridiculous and they would almost
get away with it too if it wasn't for uh
you know companies like deep
seek and yeah
like
uh no no no no no no no no no I'm not
saying I'm not praising anything else
I'm just saying that America is not
demoralized nearly hard enough okay so
that's what I'm
saying uh you can you can you can take
that and you can uh you know think about
that what you want you could take that
and you could be angry at me you could
be like how could George say this that's
disloyal to America or you can think wow
no it's actually kind of true and if we
have any hope of fixing this watch
American
Factory
uh youon trying to fix it he not trying
to fix it yeah everything's going good
yeah you guys are good you guys are guys
are
uh you guys are uh you guys are are
going good right everything's good I
think we need it's it's all
good yeah just just put Cala in yeah
everything would have been fine it would
have been fine it all would it all would
have just just just come out the other
side fugazi fugazi yeah
yeah USA will prevail okay
um let's eat this let's eat this
triangle what I say you guys I'm
referring more to like the
the us only wins with winners staying
here
well when the US fixes its immigration
laws I'm happy to come back but until
they do I don't
know no the problem is not extreme
polarization the problem is
poverty polarization is Downstream of
poverty the problem is that in
1971 your currency was made
fake your
currency a CIA sent this country to the
right on purpose
it's do you have an opinion on the
Syrian Civil War
just just chat of an opinion on the on
the Syrian Civil War because I I don't
know that much about it but I know kind
of what the general American opinion is
and it's kind of like U okay you know it
sounds like like people fighting over
some absolutely stupid dumb shit that
nobody really cares
about and when you zoom
out on the extreme polarization in
America let's see exact same thing it's
fighting over completely dumb shit that
nobody cares
about um the problem is
poverty the problem is that the path has
been
lost uh to wealth if you guys haven't
seen my latest uh my latest blog
post it's called money is the
map uh money is a map it is not a
territory so a territory is what
actually exists in the world and a map
is the piece of paper that describes
what exists in the
world uh so please understand what I
mean by this you can erase the mountains
from a map but you still have to climb
over them in real life and even worse
now you don't have a
map not a Marxist hell
no
um most capitalists I meet are as stupid
as
Communists trying to give a moral
justification for their system this is
my money I deserve it I should be able
to passively deploy my Capital into the
markets and live off the
returns an economic system is only good
in so much as that it effectively
deploys capital for real growth if real
economic growth is
3% and you can put your money in a money
market account and earn
5% how does that work
what's happening where's the 2% coming
from who's losing someone's got to be
losing right you can't get more out than
you put in that's
like conservation of shit or
whatever oh okay so well no I think that
would
fart Corin fixes this good point good
point Yep this guy this guy this guy
knows what's up SR71 enjoy her knows
what's up
[Music]
oh you you got big
[Music]
guns yeah what are guns made out
of maybe they're made out of
steel America guns China G
interesting you know they you ever hear
the term um developed uh developed
country right you see the US is a
developed country it it it developed
it's just like
that um yeah that's that's a yeah that's
a that's a developing country
yeah
yeah shit do you move to
[Laughter]
China oh no China has more people you
can't compare them it's like comparing
apples and
oranges America is okay not having
increased its electricity production in
25 years oh it's okay cope cope
[Laughter]
cope
yeah
um per capita is still ahead sure is
that going to
stay if anything people are saying that
China has a a population demographic
crisis
oh oh no no no no no you want growth the
problem is you want real growth and the
growth of fcoin
unfortunately is not real growth
yeah
okay um so you know cop and see harder
uh the the
demoralization has not even
begun um you know it's
it's it will be interesting and I will
change my mind on all of this if it
turns out that like Dei was actually
like a Chinese scop if Dei was something
that was like outside of America and
shoved in from the outside to try to to
try to bring down um the west but I I
just I don't think this was I don't
think this is true oh here's something
that here's something that triggered me
yesterday
uh
cable so they were going to
build they were going to build a big uh
cable between Hong Kong and uh LA but no
no no the cable oh it was it was it was
hilarious
yes so they were going to build
this we're going to build this this uh
this cable
do they actually end up building
it well regardless they they were G to
they were going to deny the
cable
because these you know you have to
remember that there are like 60-year-old
people 70y old people looking at this
and they believe that somehow the
Chinese are going to steal the data
through the cable they're gonna they're
going to connect the cable
to the the data they're going to steal
the data through the cable okay um you
know the biggest backers of this cable
were by the
way uh
yeah yeah so Facebook and Google we're
going to build a cable you guys know
which way the data was going to flow
right you think Facebook and Google are
going to build a DAT a cable for data to
leave oh no no no no no
no um yeah so you know it's just it's
just like idiots absolute idiots and the
demoralization has not even
begun do I think China sees America as
an enemy hell
no I think America sees China as an
enemy maybe think some people in America
do I don't think China gives a shit
you know it's it's
a we should never have exported our
election data oh my God the the the the
absolute the cop and Seed the
demoralization oh it has not even it has
not even begun uh the worst part
actually even is I I don't think there's
going to be demoralization I think it's
just going to end up going the way of
Europe I saw a picture yesterday where
it's like a bunch of European leaders
excluding America from the
table uh yeah like Europe's so cooked
like if you think America's cooked
there's
Europe oh yes we can all argue about the
retirement age right so the unibomber
[Music]
um he wrote he wrote another
uh story if you guys haven't read it
it's called Ship of
Fools um some guy made an animated
version of it it's pretty
good okay well sorry I'm a bot
guys Obama literally enacted free public
Healthcare that that went great that was
that was absolutely great um
you don't agree with my take of the US
but you agree with my take about Europe
well he'll agree soon
enough uh the Russians are taking out
our internet
lines uh so how does it get fixed the
demoralization
has not nearly begun the demoralization
will continue the demoralization will
grow
stronger why am I still in the US I'm
not in the
US
um oh oh here we go Mike
Pompeo launched the Trump
administration's clean Network
initiative
uh oh I mean yeah no the the UK
is I've heard I've heard it's
bad um you know at least at least in
America you can still be like
Rich you know look if you're rich in
America life's pretty good
actually like you don't have to you
don't have
to
uh people always in America
uh like the hype up oh it's Freedom it's
Freedom got freedom I'll tell you about
Freedom right so what do you mean by
Freedom you mean freedom from or Freedom
too you mean freedom from homeless
people screaming at you on the street no
you don't have that you mean you mean
freedom
from urban sprawl and like the same oh
yeah what do you want to eat tonight
Wing Stop or Little Caesars you know the
same the same that's that's you get
freedom from that you don't get freedom
from that that's what you get freedom
from lawsuits yeah I love lawsuits in
America I got sued by a patent troll
once you know uniquely American I didn't
give him shit by the way if you ever sue
me anyone ever thinks it's a good idea
to sue me a just just just just just
temp me bro temp me come at me
bro yeah Axel Nicks
yeah uh freedom from comedies see if I
was going to run a country I would
definitely call my part the Communist
party because whenever Communists show
up to my country they have nothing to
agitate for it doesn't matter if my
party actually believes in communist
ideals or not I'm absolutely going to
call my party the Communist party
because then what are they going to say
I'm sorry we're already the most
communist see see see what I'm saying
what level is freedom Rich level see
that's the
problem
uh remember remember when I played this
great song on on on on the
stream fellow members Club we've got
ours I'd like to introduce you to our
host he's got his
and I've got mine meet the
[Music]
decline oh the level the level the level
of the
demoralization has not even begun the
demoralization is just getting started
it's so fucking
sad H all
right all right once we once we got the
the guy who says the Jews did this now
now we got now we got to go subscriber
only um it wasn't the Jews it was each
and every one of you it was each and
every one of you
who good people are times you know you
know there we go all right so Hard Times
create strong
people strong people create good times
good times create weak people and weak
people create hard times so this is now
we are now here America is now here weak
people have created hard
times so that's that's where where
things are
okay by the way all of that kid uh who
who made the who made the the uh leak
code cheater thing uh yeah that guy
got rescinded from Harvard because he
ran from the cops see that shit's based
the kids are going to be all right um
got his got his what do you want what do
you want a Harvard diploma but that's
that's the problem like they're tearing
down these institutions isn't even good
anymore it's you're punching down
insulting Harvard I I never thought I'd
live to see the day when insulting
Harvard is punching down but it is
I'm demoralizing you good good the
demoralization is not even getting
started we have we you're you're your
weak people have created hard times the
times are not hard enough the times will
continue to get harder the
demoralization is just beginning all
right let's get
[Music]
started so we have our own
AMD driver
now and you can even use it with the
torch back end which is pretty cool so
I'm on Tiny 32 so tiny 32 is
a 6 AMD
machine now this is a tiny box red which
by the way if you'd like to buy a tiny
box red I have any Tiny Box Reds for
sale and maybe after this stream you'll
be like oh this is what I
want uh so let's I think I have
beautiful mest multi-gpu let's see if we
can try this it's probably going to
complain about The Shard
size yeah multiaxis on
even we'll put on four gpus
you see we got four gpus up
now got fix
that they're
trading am I'm going to ship the sends
in a tiny box maybe uh so we actually um
Intel has sent us some free samples
uh so you know how AMD never sent a shit
well
Intel has sent us some Intel data center
Max some of these
guys
um so yeah no I've been I've been
dealing with okay how are we actually
going to plug these into anything and
they have lots of RAM and the ram is
very
fast uh which is cool so there's some
chance that Intel has a lot of these
left over so these are the modules used
in the Aurora
supercomputer uh if you go to top 500
super
computers uh the third one
down called Aurora and it has six of
these uh Intel data center GPU Max this
is also an interesting chip that you can
buy for very cheap on eBay
uh it has an MSRP of
$111,000 but of course if you go on
eBay they're quite
cheap I'm sending my VPN traffic through
tail scale so maybe that's why my
internet's kind of slow uh yeah so it's
a CPU that they stuck uh 64 gigs of HPM
memory on
close yeah I
know I mean actually we'll also take a
minute to talk about rdna 4 um I think
Andy for for I'm upset that they
canceled the big uh the big GPU but you
know that's just something that we've
had to accept for a while so there's no
there's no Big D rdna
4 but oh it's kind of dark now it's nice
though I got an OLED screen oh it's so
nice put some light
on yeah okay it's
better uh yeah they Intel actually did a
AMD did a pretty good job with the with
the rdna A4 launch uh one of the coolest
things about
them where's like the slides they had
slides somewhere
I don't think they
released did they release the rdna
h no presentations manuals
performance
guides ah here we
go no no no rdna
for uh yet
the move from first gen to second gen
accelerators though doubled the
bandwidth uh which is pretty good so
sorry doubled the number of
flops uh
on everything's so hard to find on the
internet
on the internet you could actually like
go on it and like see things can't see
shit now uh yeah so this is a little bit
misleading because that's
sparsity but they don't even put a star
wow that's that's that's pretty
bad um yeah those are those are sparse
flops but that's the T flops of
uh of float 16
so it's unfortunate that the memory
bandwidth is weak but for 5.99 it's it's
not a bad GPU so you know props to props
to AMD for uh my my my hatred for AMD is
so much less now that we have our own
driver and we have our own driver and
our driver just like doesn't
crash so you can see where we
like
um this is actually initializing like
this is talking to the gpus
over pcie directly we're ma mapping the
PCI from the gpus into our process and
then talking to it so there's no more
AMD code anywhere here so it's like we
like AMD now um it just took a lot to
like because this doesn't crash the bugs
are all in the kernel driver
so we're going to look at how to make
things
fast we also have um from
uvn a pull
request to do sqt profiling Let's test
this so first let's get one kernel up uh
make a
simple simple
mall right so we're getting a somewhat
mediocre number of ter flops because
we're not in half but let's do half
here okay that's a lot better so we're
getting we're getting 80 Tera flops in
half uh but actually no I think this
this is focused on float
32 so here they have
uh KS of gigaflops or
teraflops what size Matrix is he using
only focused on 4096 by 4096 yeah that's
already my
defaults so let's run this with beam = 2
[Music]
seems to work on wrap screens a little
bit
better there we can see the
GPU hard at work here you can see the
power
draw I like having the machine sitting
there because you can hear the coil wine
a little bit it's like nice knowing when
you're
uh uh
for your egpus what are you connecting
them to what computer do you have with
USB 4 you're not going to be able to use
I don't believe you can use anything
with an M series you definitely can't
use a video uh so we're getting
gigaflops uh so it's a little worse than
Rock
Bloss um and this is just with this is
just with tiny grads pretty much
unoptimized um so most stuff in tiny
grad most like map malls in tiny grad
you want to do using the Matrix scores
so if you use the Matrix scores with
half I use the T scores they had some
good slides for
this go
wait oh oh 4X okay so 4X from from what
it was which was like
nothing yeah so it's not it's not double
uh so we can get up to 90 Tera flops uh
using beam and half
enhanced Matrix
operations some guy was showing off the
die on Twitter was
cool of course this doesn't work fast
enough uh if someone wants to link the
diea we can we can go over what's
actually in a GPU I mean this is kind of
what the die shot looks
like uh so they have four uh big groups
of uh
shaders uh each with 16 so that's eight
and each dual Compu so 16
total um yeah the improved tensor data
rates is so this chip had they built a
big one had they built one with a uh two
more Shader cores and and
a
uh so Nvidia Nerfs their gpus Nvidia
like 490s are capable of going twice as
fast uh as they actually do on map
malls you can see it here so if you look
at the peak tensor flops with fp16
accumulate it's
330 but but with fp32 accumulate it's
only 165 this can actually be doubled uh
because the RTX 6,000 Ada that uses the
same die is capable of double and this
doesn't look like the kind of thing
where they're doing binning I think this
is just completely product
segmentation I've tweeted about this so
amd's new
GPU finally has tensor cores that have
the same throughput as Nvidia uh yeah
Nerf the 5,000 Series in the same way we
can look at
[Music]
it GB
uh I haven't even I haven't gotten any
uh 509s yet the system the the aib the
Aden board company we're working with uh
doesn't have any yet I think there was
probably some some stake uh some issue
with the cards so they haven't shipped
like any yet because there's none on
eBay
uh so yeah we have no 509s I have never
I have not even used a 5090 yet which is
very
unfortunate that yeah this I mean this
launch is kind of
botched but it's not like what are you
going to do you don't an alternative
wait for NVIDIA um I have put a
pre-order down for 400 cards uh so we'll
be able to build 100 Tiny Box twos
uh I did
also I got an email from someone who
works in some government
office saying that if they didn't spend
the money by not a US government office
another government friendly government
friendly friendly five eyes friendly uh
saying that if they didn't spend the the
money by the end of the month that the
money would go away so I did put a full
money pre-order up for the Tiny Box
green
V2 uh I have
4590s pre-ordered to build 100 of these
boxes but I make no promises when it
will ship we are at the whim of Nvidia
for when we receive the
gpus so yeah they also nerfed the you
can see the same Nerf here it's
419 uh the 90 isn't that good on fly
actually this is this is kind of weak
and what's crazy is this number is
almost the same as the
AMD so this this flops number is almost
the same as a GPU that costs 3x
less the problem uh with the AMD GPU and
this is where the Nvidia GPU really
shines is this is 3x
so the Nvidia GPU has 3x the memory
bandwidth and of course 2x the memory so
those are the stats that uh very often
limit you in AI
training AMD is a great competitor for
NVIDIA I wish
that they're fine like is fine I I you
know it's just it's just sad it's just
sad that they don't
like like
Embrace uh
their strategy doesn't
work they could be a real competitor if
they didn't just try to like be knockoff
Nvidia you know the way in grety quote
you got to skate where the puck is going
imagine playing hockey but skating right
behind Gretzky it's never going to work
you got to Hope Gretzky trips and to be
fair this was amd's strategy on CPUs and
it kind of worked so hey who am I to say
um but you know the stock market
certainly uh
certainly uh doesn't agree with their
strategy uh it's HED in price over the
last
year uh it's almost time to buy some AMD
stock you know no no it can go no no no
no no no no it can go down further it
has not gone down nearly
enough um
it worked because intel was led by
idiots and nvidia's
not yeah yeah that that sure seems to uh
be the
case I I don't think I don't think
Jensen is captured by the finance
guys uh I think that if anything what's
happening with Nvidia now is when you
look at like the b200s they haven't
shipped
they're we actually we should thank
Nvidia for this Nvidia is pushing Beyond
where anyone else has pushed before and
there's a lot of reasons that it's way
easier to be AMD than Nvidia if you're
just trying to build basically the last
generation which again they shouldn't
have canceled the big die they could
have actually built a competitor to the
4090 um if they just scaled up their
rdna2 die uh not even RNA four die not
even that crazy like what is the die
size
[Music]
uh no see this is the rdna 3 sorry I
typed the rdna 3 I'm so used to typing
that what is it 9070 XT die size yeah so
like if they just made this die 50%
bigger 535 so that's like not even
crazy um that's the same size as their
previous die though I think
the this was a
it wasn't single die was it I should
know this about this
card no yeah they had they had the they
have the McD and the CCD so they're
they're actually it's actually a like a
six die uh MCM kind of thing where they
did single die
for for
this I can't
type did someone find that Dy
link what is this Ultra scale
Playbook now you can see it's a single
time bummer that Nvidia dropped the hbm3
Wait no that's such a bad choice they
would never have used hbm3 for the 90
that's such a hbm is a bad choice okay
like like I know that the the uh people
aren't going to agree with me on this
and they're going to be like but you
have to use hbm it has the highest
bandwidth in all these connections
there's two problems with
hbm uh
one is it's expensive hbm Ram I think
costs like two to three times as much as
gddr Ram uh and two it requires silicon
interposers so when you look at the uh
interposer on Apple if when you look at
the like and all these all these new
things are doing all the the the
framework desktop that just came out
that has this integrated lpddr Ram it's
not really integrated uh it's it's like
it's one module but the module is an
organic substrate you don't need a
silicon interposer and organic
substrates are hella cheap to make uh so
it's basically like a little
PCB and yeah so I'm I'm against hbn
and the other problem and I got into
this with a very talented silicon
designer on Twitter uh he's he was
saying that the hbm 5 takes up less die
area than the uh the
gddr
five which is true let's see where's the
die
shot oh that's not even a die that is
the die hang on that is the die
someone link me that die
[Music]
shot well this is kind of good enough
that we can do it ourselves
uh so when you compare it to this is the
die from
[Music]
the uh oh these are mcds actually now so
the the main the main middle one here is
the CCD where all the computers and then
these are memory modules that they
basically put the DDR Fs in so yeah
whereas when you look at this the DDR FS
are just around the outside uh these are
the four Shader cores so you can see the
Shader cores there there there and
there
uh all um Ultra scale
playl should we work on should we work
on um fsdp
do we want to go into fsdp that might
kind of be more fun for this stream than
going into the the
speed uh I don't really know anything
about fsdp so we can all learn it
together the speed thing
yeah I played uh I played magic draft on
Friday my draft
deck did okay one
until always
um you know speaking of um absolute Peak
uh hway building at hbm Fab speaking of
absolute Peak delusion uh from us
politicians like there was this thing
called the AI diffusion act and this is
still this is still the
law as far as I could
tell regulate the global diffusion of
advanced artificial intelligence ships
and model so the the if I was uh
leadership in the CCP and I saw this I
would be thrilled beyond
belief um what this act basically does
is says to every country that isn't on
the US's like three approved countries
and this isn't even this isn't even like
okay you know you want to ban you want
to ban like you know China and Iran and
North Korea and you want to ban like
three countries
no it says these 18 countries are okay
but like even a country like
Portugal NATO countries you can't ship
gpus
to uh so what this told all those
countries what this told every other
country that isn't one of these 18 it
said that the future of your AI supply
chain is
Chinese that's all it said just just
said
please please purchase yeah India
again the absolute fucking lunacy of
these people
India do you want India natural Ally of
the US
English-speaking to buy their AI supply
chain from United States or from China
right it's your choice us politicians
and the US politicians are with me they
say they say that the people have not
been demoralized enough they've not been
demoralized enough we need every single
other country to start purchasing all
their AI supply chain from China because
that the US people are not demoralized
enough uh of course huawe will be Toe to
Toe within video oh China's never going
to be able to make advanced chips uh
they already can it's called
Taiwan the Taiwanese province of China
uh where the advanced chips are made you
know who can't make Advance chips Intel
Intel Ohio Fab is delayed until uh yeah
India was buying a lot of oil from
Russia because nobody else gives a shit
about this the US and Russia there's a
whole another wow wow there's a whole
another a 70-year-old man who spent his
whole life fighting the Cold War and
thinks Russia's not a country with an
economy the size of Italy like you you
heard the joke about like Russia's the
world's gas station are you
kidding uh you drove by the Ohio Fab and
it was just a field last year yeah
yeah yeah you probably got to wait for a
permit you know there probably some it's
probably some some some some eggs from
some bird that was found in that field
and now we all got to wait while the
bird decides to move right come
on yeah so the US basically told
Portugal and
India uh and all of these countries to
go purchase uh AI from China I so Huawei
making an hbm Fab uh yeah I'm I'm happy
actually Huawei they don't brand it as
Huawei they brand it as like high
Ascend um so you can buy them they
didn't look very powerful though
unfortunately uh I'm gonna be going I'm
gonna go to Shenzhen like maybe even
this
week uh and we're going to see we're
going to see what I can
find um
yeah they pick
this actually someone sent this to me
and they had like like this is actually
terrible this is this is not a serious
this is not a serious
Ascend uh this is a
this is a this is a mobile
chip they they that's basically a like
Qualcomm makes better mobile
chips we're not we're not talking about
we're not talking about Russia come
on uh the Ascend yeah I believe it and
the h100 isn't even like the h100 is not
that great of a chip in
fact this chip is kind of
better um I mean the software is not
good which is the big problem with it
and this cost a ton of money to make but
I really hope like I said Intel Intel
actually sent me two of these I have a
FedEx tracking number I haven't gotten
the gpus yet and they're going to be a
pain in the ass to set up but Intel
actually sent me to as far as I can tell
uh so good guy Intel um and yeah no if
if intel we can't I mean we're not going
to build a driver stack for two of these
but if intel apparently there's 5,000
more of them and if intel is willing to
sell me those 5,000 at a really good
price we will pivot from AMD to Intel um
this chip is amazing hbm uh it's dual so
these are like compute cores uh the ram
is here and then these are uh like
network
cards you know they're building little
computers little computers on single
dies now I hav't got small it's a
computer on a die right uh that's kind
of crazy it's a computer think about it
um yeah so I bought I bought an oam back
plane last night we're going to figure
out how to stick and got to figure out
they run on they run on 54 volts so I'll
have to figure out how to get 54 volts
to them uh no it's just it's just one
guy in Intel who's you know just just
excited to make something happen uh he
understands the potential of tiny grad
uh it does seem
like Intel like Intel has very different
dysfunction
perity
um it amd's like sin is pride Intel's
sin is we need nine VPS to sign off on
this
decision
um so yeah we'll see if we'll see if uh
we're actually able to buy any of these
but I mean this this chip is this chip
is sick the problem problem is how
expensive it must be to
make
um
yeah so oh yeah by the way like we
always talk about like Intel needs to
build a big GPU Intel actually did build
a big GPU it's called the Intel data
center GPU Max series formerly named Pon
Veo uh
unfortunately yeah they have some of
these cards too uh they actually gave me
a to buy 300 of these cards buy 500 of
these cards but uh yeah I don't know
about these cards this this this is a
lot less
interesting um it's and the ram is I
mean this is like
similarish like a 3090 or 4090 maybe
maybe it's similar to like a 3090 with
double the ram so that's much less
interesting of a card um oh I think
that's the board I bought
pretty
sure so super micro never ended up
making this server for GPU Max uh
1550s oh there super micro heat sinks
where the hell am I going to get those
heat sinks but yeah I bought this
board find to find those heat sinks
um how they powering
that oh don't tell me I'm going to need
to make those weird things
work is that the power
connectors wait is there some chance I
can plug power supplies directly into
that that would be
sick maybe I
can let's look at the computer so you
can actually buy these on eBay and now
you see in my real work this is what I
was doing yesterday aside from going to
the dermatologist and getting my
mole uh a bladed with a laser by the way
you
guys
um like there's some things about Hong
Kong that are so
incredible so this
morning uh yesterday morning the
appointment was was made I showed up
there at
1:00 there's tea for a little intake
very quick intake with this this this
this woman she's very nice uh she told
me the
price uh within 10 minutes I'm being
brought to another room the doctor's in
there in another three minutes giving me
lidocaine injections to the back of my
head got the laser in a scalpel and is
going at it he's like does this hurt
does this hurt five minutes I walk out
of there no consults I signed one very
quick consent form and boom it's done
and they're just like do this like they
treat you like an adult the medical
system here
incredible like in the US I cannot
believe you want the simplest medical
thing done and it's going to involve
multiple
appointments uh you want medical stuff
done
here okay when you want it done go
this is this is Hong Kong this is this
is uh on the
island
um so yeah let's uh I should look up so
there's these gouty 2 uh computers for
sale they're not worth it like it's not
worth that much money because you can
get like an a100 machine for
that um
but no no no they're just fan
connectors yeah okay because I bought
what I believe is the board from this
computer that I'm going to put the Ponto
veos
in actually that doesn't look exactly
like that board so it's going to be
interesting to see what we
get got to figure out how to buy those
heat sinks
see those are Intel branded heat SNS
whereas these are super micro branded
heat SNS let's just do a quick search
super micro oam heat syn it was so hard
to find the board I linked it in the
Discord
um no it's not any of
these I really don't want have to make a
heat sink I don't have to make any
oh you had a good medical experience in
the US it is it is true but I went to a
dentist here and it was like the same
experience it was the same like again we
were in we were in within minutes uh you
know was on oh oh we're going to have a
consult we're going to do these things
we're going to do a cleaning no it was
just like okay your tooth hurts okay
here's an x-ray okay here's why it hurts
okay here I can fix it okay
done my research friends are not gouty
fans yeah it's a bad
architecture um
so Intel also has 15,000 goutis but
apparently again people are like clowns
they won't sell them because they don't
have software support for them so for
15,000 goutis like there's some price I
would pay for them it's not a very high
price it's actually an extremely low
price uh because the architecture is not
good and I can show you
why um yeah so this is basically this is
the the architecture they have this gem
engine that's completely separate from
the tpcs so the tpcs are basically a uh
a GPU like they have like they look it
looks a lot like a GPU but then they
have this gem engine and the gem
engine's not schedulable from the tpcs
so you you you have like Global cues
I've read the whole driver and you have
like these Global cues that you push mme
jobs to and then the mme looks a lot
more like the Apple A&E so imagine
trying to get the A&E and the GPU on an
Apple chip to like both work together on
something it's it's so
hard um whereas the ponos don't have the
same problem uh yeah so and I don't
blame I don't blame your friends for not
being fans of gy uh like they probably
made one thing work and they're actually
on uh they're on ML perf it probably
made one thing work
but um yeah I mean this Chip's actually
way better it's just you can tell that's
so look at how expensive is to make it's
gold it's gold no medical in the US is
not fine if you pay cash only I'm always
down to pay cash okay how much is it oh
well so going to get a bill you going to
get Bill am I going to get one bill no
you see we have the the testing company
and the the the the the the you see you
build a room people but then you have to
build a doctor and it's like what is
this
what is this like the strip club where
you pay for the room with the the to pay
for the room separate from the girl like
what what is
this a doctor that doesn't take
insurance at all that that is true you
go to those pill Mill doctors yeah
everything's very
straightforward the US does have good
pill Mills
um yeah uh no so it's too bad that this
is all hua's offering right now um even
their server let's see
anything uh it's interesting it runs on
a Huawei
uh
chip oh okay there AR you
back no this is so old
they'll ship to
Russia if they take insurance you're
basically in a government office yeah
no we should ship I don't even think
that we should sanction China or Russia
or
anybody I think that uh we should AI is
a gift to the world and may the best
wielder of AI win uh the minute you turn
into into
protectionism you have already
lost if you're trying protectionism at
any scale remember when open AI turned
to
protectionism of course there's no mo
everyone knew there was no
mo
um remember when opening ey turned to
protectionism and when the US government
turned to protectionism protectionism
just shows that you are scared and you
know who's not scared deep seek
the US is very scared and everyone knows
it everyone can see it the
demoralization is not is not you know
has not happened
enough uh yeah no and the whole in the
whole Russia Ukraine situation it's so
sad it is so
sad you can't you can't this is this is
this is like I guess there's
consequences there's consequences to the
collapse of an Empire and it's sad it's
really fucking
sad oh oh Global rule of
law it's like everyone want to like I
guess everyone in America kind of did go
to like two bit commi College
you you know you clowns with Communism
and like like like like oh us colleges
are some of the most communist places
I've ever seen holy
shit you want to see real
communism look at an American college
campus I don't know any place more
communist in the world I mean I've never
been to North Korea but I spent a lot of
time in China let me tell
you us college campus
that's what maybe they teach you about
global rule of law if only we had one
world government you
know clown
shit okay so what do we want to work on
do we want to work on fsdp or do we want
to work on
uh make a poll in here can I make a poll
I heard there's a way to make polls
right here in twitch
nope there's no way to make plls right
here on Twitch we're GNA have to use
straw pole I'm sure there's a way
but all right so we want to work
on um work
on
fsdp Fast map
mle something
else oh WTO laws hope you can't send
that oh you can't send that GPU to that
country they might use it for I don't
know
no
no
yeah here's the way to win you want to
know what America's greatest advantages
America's absolutely greatest advantages
diversity and non-ironically it's
diversity uh you want to brain drain the
entire world you want to bring every
single talented person into America and
what I've seen with the current
Administration is it's harder to get
visas and I just I have no interest that
you want me to come back to America make
make it easy for me to bring people
there make it easy for me to brain drain
the world I will brain drain I will help
brain drain the world into
America okay but until you do that while
it's easier for me to bring people who
work at tiny Corp to Hong Kong I'll stay
right
here uh and you guys can build build a
big wall build a big wall around America
and you know one of these days you
realize that that you didn't build the
wall to keep the animals out you built
the wall to keep yourself in but I like
the wall the allall is good but you know
this is the the the the trade
restrictions and the immigration
restrictions are the complete nail in
the coffin if those things
stay uh yep I came to the us8 years ago
I did a PhD here but now I'm leaving
because I can't create a company with a
Visa F this shit yeah I agree man I
agree and this right here is America's
downfall uh so you know if America wants
me to come back if America wants people
like me to to to take them seriously you
have to have
uh Global skilled immigration that is
super easy let everybody come to America
and create real value
there um
yeah but NOP no no oh no no American
jobs are for Americans or something so
you know hey be
poor I like the wall no the wall the
Wall's good we can all enjoy the wall um
um build building a wall to keep you
know drug smugglers out well shit that's
smart
uh all
right but you want you wna you want to
make it so that yeah someone on a Visa
can't
uh trying to learn from A Century of
humiliation vowed to never experience
that again
uh the US knows how to avoid that but at
risk of having theirs and the UK it's
already here I think that's absolutely
right uh I mean I think that I think
that America can be uh fixed but not if
it goes in like a nativist direction if
it goes in a protectionist nativist
Direction you've you've lost so hard uh
it's it's just over it's over like
America will continue will Decline and
in 20 years it'll be Europe not
even uh but if America uh it would
require again a real change it would
require you can't have the the current
like the the nativists in the Republican
party you can't have
this uh you're going to be a poor
country like like like you want to be a
world Empire but you want to be a good
World Empire not a shit World Empire
right the Democrats wanted a shit World
Empire and the Republicans want a little
nativist right right like like like like
it's Dei both ways whether it's Dei for
foreigners or whether it's Dei for
Americans how about just no Dei can we
can we do that can we no no no no we got
to do Dei no sorry sorry that's
non-negotiable uh that's
non-negotiable but yeah no when America
changes its uh policies uh to make uh
skilled immigration very easy uh I will
come back
but until then fuck that
shit no but imagine we brought in like
very talented
immigrants uh imagine imagine that we
said every single person who is making
uh six figures can come to America on a
work visa no questions asked right
simple done not not citizenship just
work
visa uh but no I I see things going in
the opposite direction right do I want
to build and Target do I want to Target
the GPU architecture that's only
sellable to 18 countries or do I want to
Target the GPU architecture that can be
sold to the entire
world I can't wait till China starts
making good good chips and selling them
because they're going to sell them
because that's the way to do it that's
the way to be a real Global Empire Today
build the shit that everybody wants and
then sell it to them at a fair price
um no but see that's the problem it's
not it can't be the pendulum right if
the pendulum swings to some to some to
some nativist bullshit some nativist
protectionist
bullshit uh then yeah lose even harder
right you want to lose with these guys
or you want to lose with the other guys
let just lose
lose okay yall want fast M Mall let's do
fast map
Mall oh no misuse of AI oh no someone's
going to misuse it oh we got the RO
police we got the Cyber police remember
that cyber
police don't
worry oh this is going to like complain
oh there we go I gotta confirm I'm not a
bot God what what what what what Rumble
does Rumble work
now YouTube doesn't work
anymore
uh YouTube doesn't work anymore
well you know you can you can imagine
that guy I'm going to call the Cyber
police you done
goofed watch the video If you're not
watch it on
YouTube um if some of you have if some
of you have uh
YouTube uh yeah this is Jesse
Slaughter's
father
um oh my God oh my God you so me I went
on AI and it told me how to make a
bomb yeah you know what let me tell you
something if you could actually do
things with your life you would if you
could actually do that if you could
actually like follow the AI instructions
to make a bomb well shit you got a lot
of other career opportunities in your
life but the truth is you can't and the
same reason that you can't is the same
reason you're not going to misuse AI
it's not the AI right you either have
that capability or you don't AI doesn't
change
that um no but the AI might make dumb
people smart
exactly uh place your vets mine's make
the chips available to everybody and
shovel cash for the rest of your life
hell yeah and you know who's got that
strategy the Chinese let's copy it it's
a good
strategy uh yeah when I was a kid
working at the library the Anarchist
Cookbook yeah yeah no one was keeping
you and yet and yet despite the millions
of kids that went and read the Anarchist
Cookbook how many of them actually went
and did
anything exactly
it's not about intelligence it's about
agency all right so we want to do fast
map okay let's do fast map
um So
currently uh by the way if we run this
with debug four you guys can see the
code and if we run it with even higher
debug you guys can see
the uh
assembly the assembly
that's the ass
play so we're hitting the Dual issue a
lot I wonder why this is
bad um
this is really
old uh okay let's
just tiny import
[Music]
Tor
syx this is slow
[Music]
okay
22 uh jiga flops
uh no I didn't pronounce I'm not
renouncing citizenship and yes I'll
still pay my American
taxes
um you know you want to renounce
citizenship you gotta you got to pay an
exit tax right see that's the nice thing
though I'm not renouncing citizenship
because you know I can I could sit here
and shit talk America that's part of
America uh and I can it be fixed yeah it
can be fixed but the demoralization is
not nearly
enough uh if people think it's bad now
they have no idea how bad it is going to
get and again things don't really look
positive on this because when you look
at like the UK if that's where America's
going then
yesh
yesh um
all right even subscribers have dumb
comments
sometime so here's his full fastest
konel
49 wow this doesn't even like look like
good code shocked it's
fast for
you know what about the about the
uh about the like AI is is is Scary or
going to harm people you know here's
what here's what what's the expression
it's everything is scary if you're a
pussy yeah I think that's the
expression uh everything everything
everything's scary if you're pussy
that's
right so that's that's what I that's
what I think about about AI harming
people let's load that
file like yo are we going to what are we
going to do next gun control oh no
someone might shoot someone with a gun
we got to take the guns
away at least America doesn't have
that that that would
be like they they apparently like Europe
used to have guns and Canada used to
have guns and then they like took them
all away don't let him take the guns
away it's the Eric Raymond thing it's
uh the thoughts of a country the
thoughts of gun ownership thoughts on
gun ownership uh tell whether your
country sees you as
a uh citizen or a subject because of
course they have guns
[Music]
yeah remember that time Hitler used AI
to make to make uh to make concentration
camps oh wait no that didn't happen it
wasn't AI shit that was good
oldfashioned shitty
ideology
yeah so I do this in a bunch of
places to
um he would have oh no he would have
used AI you don't know that maybe he
didn't like
computers you ever ask him you ever ask
him what have he used what have he used
AI to do things maybe he didn't like
AI you don't know don't put words in his
mouth that work
it's Conrad abuse is that like that time
that they were going to go to the the
Candy
Mountain KY mountain Charlie KY
mountain plon Charlie Leah
plon oh I know where I do this it is in
the DSP test
do I have
that here we
go so okay we take this schedule
I see
so I'm going to put in the code for this
thing in there
okay that should put the code in
[Music]
there version keys
oh because we didn't load it uh there
actually just a way can I
just read
text all right it doesn't compile
because we have to tell it that it
is uh
dispatcher crap
sure B for the C++ extension
pack have this is calling
out
to Let's dive into the struct
here where does this get compiled
deep in
here how does it know that this is
assembly okay maybe if the first line is
do
text
um just hack that for
now comp in run time support
compiler
hip here we have AO equals false
[Music]
let's try
that okay unknown
directive it's
better only looks like one
error mdhsa code object version five
it's pretty early on
okay it did
something oh cuz the size isn't
right um where do I set
that
yeah so if we look in
Prague we have Global size and local
size
yeah so we don't want to do that we have
to figure out what the right Global and
mobal sizes
are
here okay that looks easy
enough um
that a topple be a TPP right
[Music]
less
wow that's not right
Dimensions block
Dimensions should be right
though that's way too many jiga
flops oh uh
because
yeah no
no that should be
right 3232
128 that must not be
running I get some syntax highlighting
on
this oh we also have to pass
in other
stuff yeah we have to pass in N Alpha
and beta
um it's annoying because there's not
really a way to do that so we'll just
change it
here Global buffers three Global buffers
and
then four Turtle dogs and a partridge in
a pear tree
can't be a float why is it putting a
float in
there let's read this code can I get
some TX
highlighting they're not G have rdna 3 S
are they
they do
not okay
where are those numbers being
read is that not even a
comment am I just building
nothing I don't think
so we're going actually need to check to
see if it did the map
all uh
okay well yeah we shouldn't do
empty random uses so many
kernels I don't want to do that
you like do this crap
is
okay so the map Mall clearly is not
working um if we don't replace the
program does the map Mall
work oh it's stupidly slow though
because we're not optimizing anything
okay that's fine just say like something
tals is five it's totally
fine floating math is
tricky so we should just actually make
the Ops match how do we do
that we'll get to that
later but start
works so when I put in the source from
the guy's fast
kernel uh May
that's probably because of this crap
there a rap lyri I so Tim D M like
chilling in my Rover globalist American
Empire is
over okay it's got to just be this
where's that stuff even being
R that's just the addresses
I don't know if the sizes are being read
or
maybe Matrix oh it's got to be
reading we don't have bug bounties we
have
bounties no bugs no
bugs it sets up a whole lot of
now we can kind of talk about this code
while we're debugging this so it sets up
a whole lot of offsets yeah there's no
way that the thing is totally
fixed so those other numbers don't
really mustn't do anything
um I should know what goes in there
there's a
rdna
ABI n state lvm that going to be good
here about
it sorry I made it smaller I like when I
do that
big ex
okay reloaded colel arguments
get any bugs it's
running it's running but it just doesn't
work I'm not even sure we have the the
order correct so let's just first workc
on
that uh I think the order to the thing
is backwards I know they like to put the
thing last
yeah there's not really easy way to
change that
tiny yeah because these are the ones
that it reads
from oh I know what I can
do uh we just need to make that
eight that'll load from that
and then I see so it's
loading 18
here why is it loading it
again should be eight and it should be
zero if I understand
correctly oh stupid
okay okay now we get a
hang oh cuz it's loading 128 from there
I
say that's
fine see how well our driver deals with
that let's confirm it still works if we
get rid of
that it's going to have to reinit the
GPU look at that look at that Mech is
active issue a full reset model reset oh
and everything works again wow do you
know what that experience is very much
not like amds drivers where'd be
shitting all over my
Colonel I'm sorry oh you wrote a colonel
that hung the GPU oh I'm sorry get
fucked for Life reboot the computer
let's see uh yeah so I know what I
did the problem is
here but it loads
[Music]
into move to Plus
8 Matrix
A and
B moved to Plus
8 so whatever is using
S5 this is
wrong just move into S5
there's S8
S5 so he kept some of the logic that
uses that but not much of the logic so
the problem is this is just like poining
off to know to nowhere land uh we want
to move how do we move into what a
Syntax for
that has move b32
so we'll change that to zero Matrix
C moved to
zero
um just for completeness
sake do that and then here we want to
move
496 that could be
zero no
oh oh I don't think I commented back
out replace the
source
no
hangers wow I feel confident just
control seeing that knowing that the GPU
is going to boot the next time wow
that's crazy
okay let's get
stash only with One S
please um let's close everything go
[Music]
here the problem is that he didn't see
he has a lot of bad
formatting didn't have anything that
like remove the white
space now we remove the white
space having L we have to color that
out okay
so is it really is S6 really a
float it looks like it is
and oh no it's an
okay n Alpha Beta two
pointers so I'd imagine it's just the N
that's not being loaded correctly
because even if our uh even if the order
of our things is switched it just
shouldn't be that fast so it must be
some Loop not
happening let's put our on our assembly
looking glasses and work on looking at
the
assembly do you think the landlords
pissed you left our car parked on the
lawn
again he's
looking
oh that's after all of them like that's
hex 18
yeah so it's actually S4 that's going to
be used there so let's just see if we
can fix it with a move to
S4 it's a lot more reason
able
um still wrong clearly
but more
reasonable see why that I did
that so none of these are the output
anyway so these can just be changed to
eight now we should also be able to see
the same diff
here it's a good looking diff
okay so that might have changed the
inputs but it did not change the outputs
so we have to find out where we're
loading from this in other
places um just take a
look down
here store here the stor
[Music]
for V it's not right
what are those other things supposed to
be Alpha and
beta oh okay
yeah Okay cool so it loads into that
make sense guys let's see what we
get all right zero so that's like kind
of an
improvement oh that might just be
because Alpha and beta are zero so we
have to load in can we load in
floats that's supported can I do
something like
that uh what are alpha and beta again I
should know this if I knew like what a
real gam library
was many linear algebra teams in your
algebra routines okay so Alpha is what
we multiply
by and then beta is what we
add assemble failed okay well that's
great
uh I do
this stru
construct I should know these off the
top of my head
okay
so that's
Alpha Beta is just good old
zero Like A Life Lesson in
there all right we got some
numbers some of them even look like the
right numbers
so n is clearly
4096 and our grid dimensions are
correct 128 128 that's all
fine those are actually the real sizes I
don't divide them do I
that's actually what I'm launching the
kenel
with I'm pretty sure I know right
fact I go even further I multiply bual
size by local size
right I know whatever we just try this
quickly no I didn't fix
that so look like those ones are correct
the ones at the bottom just the ones at
the top don't
work wait what
oh how does that break
it
what doesn't make sense
if I comment that out it
works should I ask
questions how does that change anything
how does having that load change
anything oh unless I can't overwrite
them after the
load or I can
whatever yeah whatever probably you I'm
not LJ
King if I write this here it should be
fine yeah okay fine whatever that makes
sense
okay 41 Tera flops that's a lot of
tariff flops that's a pretty good number
of tariff
flops sick Tera flops now why doesn't
tiny grad get that many teraflops by
itself uh I should probably copy that in
how many 496 by 496 Matrix multiplies
per second is that well just look at one
of these and divide it so it's that many
it's that many millisecs 3.3
milliseconds so that's 100 /
[Music]
3327 300
wow that's a lot of Matrix
multiplies uh we're not even close to
utilizing the the BWI there
all right let's try to understand
why uh this
one why the tiny graph one is so much
slower um so first before we do this we
can certainly put some op doops in
here
um like we can
do
this I a PL
op uh what did the actual what is the
actual thing
at thought that was Laten see no that's
that's
malls that's straight up
malls all right second of stat crap
let's do beam let's beam a little more
let's beam as much as we can let's see
what we can get beam
seven I hate that this is going to beam
for the stupid Rands
too but
whatever let it beam
by the
way you know it's really hard to
appreciate the absence of
something uh uh you know this is this is
going to this is going to drive me up
the wall uh when someone finally uh you
know gets into a fatal accident with
open pilot it's going to drive me up the
fucking wall because like this is the
normal fat accident fatality rate and
you know the rate with open pilot is
something like Haled or a fifth but that
doesn't matter because it's really hard
to measure the thing that's the
absence uh so what we're talking about
the absence of here is
crashes uh can we talk about how many
times the driver has
crashed
zero and it's really hard to
appreciate that that absence but but
it's the absence of things that usually
makes things good good not the presence
of
things uh so I these are like culturally
broken things appreciating the absence
and then
[Music]
um yeah like the the it's kind of
related to
safetyism it's related to the the if
only one person dies making everybody
wear a mask was worth
it uh you know I I still one of the
things during you go back go back and
you watch me talk about cloth masks I'm
so I'm so happy about you know that's a
stance with real
Integrity uh when you compare that to
the level of the level
of just
bullshit everyone knew everyone knew
that cloth masks do nothing to prevent
the spread of respiratory diseases every
honest person in 2019 knew that what
happened what happened to all the people
who changed their
mind what does that
say that was this was one of the
saddest like realizations for me about
the world which is that most people
don't
have a belief
system that's founded on
anything most people have absolutely no
way of determining truth and actually I
you know I love to troll that I love to
control that I when I tweeted about how
the new open AI thing discovered a uh
you know po time uh Matrix multiply uh
none of your uh po time factoring
algorithm uh none of your crypto assets
are safe
like every person who can't
independently evaluate that statement
shouldn't be holding
crypto cuz you have no idea you you just
you just go through
life thinking oh well that's what some
expert told me right and this is how
kind of this is one of the ways we got
into this
situation and I don't know I I don't
actually know the the even scarier
thought beyond that is that you don't
want everybody thinking for themselves
because if everybody thinks for
themselves they they start thinking that
Ivermectin cures cancer or
something they they come up with
like they they have no grounding at all
it is simply I trust the system or I
don't trust the system there's not a
principled empirical way to find
truth and I don't know how you make it
through life if you don't have
that how do you how do you make it
through
life um if you don't
have like an understanding of why things
are the way they
are you know
and the biggest group of people to blame
uh for the mess America is currently in
are the people who sat there in
1971 the Boomers who sat there in 1971
when Richard Nixon took America off of
the gold standard and made the currency
f
this is not a new
idea uh every single Empire during their
decline ends up devaluing their
money but you don't have to do
it if you don't do it and you can stand
strong and say no what you can't make
the money
fake then you continue to have an empire
for a lot longer so you know
unfortunately we're in the weak men made
Hard Times era
okay so this is what we get with the
open pile with the sorry this is what we
get with the uh built-in the tiny gr
thing and this is what we
get when we use the MMO
algorithm
from
uh Mr
sebv and he goes through and he explains
what each one of the tricks are and we
should think about which of these tricks
exist in tiny grad and which of these
tricks don't exist in tiny grad so this
is the tiny grad optimization string
that does double the tiny grad speed uh
actually it more than doubles it if you
do tiny grad with no optimizations it's
extremely slow but you can see that that
assembly kernel is like twice as fast as
the uh the one the tiny gr's
generating yeah yeah yeah tiny gr's like
like 160 and that's also tiny gr with
beam tiny gr without beam is even
SL but we want to artificially prevent
our recession Kick the Can down the road
well guess what you're at the end of the
road and I'm in Hong Kong
yeah enjoy the end of the road
I don't know
guys uh My Hope for AI is that it
creates an immense amount of wealth for
the world uh
sorry just like yeah I wealth is a funny
thing it creates a lot of
value imagine AI could just do
everyone's job and then everyone could
have an army of people to do jobs and
it's all just super cheap it's never
actually going to be this
way uh we're never going to live in a
world of abundance this isn't
real uh Malthus always comes
back we're in a strange period now where
things are not replicated straight up to
the
Limit machines will replicate straight
up to the Limit and take a long time
to
uh yeah guys you know the age of M
uh you guys if you haven't read this
book oh if you haven't read this book
first go read elephant in the brain uh
because if you haven't read this book
you probably haven't read elephant in
the brain uh elephant the brain is more
like practical useful advice you start
to see why like people are messed up the
way they're messed up uh then you read
this book and this book if elephant in
the brain describes the present this
book describes the future it's one of
the most accurate books the science is
wrong like the way it's going to happen
is wrong but he's not a like he's not an
AI person he's an economist and the
economics are all correct regardless of
how this
happens uh the M's are basically you can
see them as you can see a clear path
from the current gpts to the
apps and
yeah the I mean these M
are going to take all the useful work in
the
economy the thing is people sort of
realize
this
yeah I heard one of the reasons that
the uh Elon Revolution is unpopular
is because if you're a normal person in
the world today
what role do you
have what role do you have in elon's
Grand
future and if you can't imagine one
you're going to fight against
it I don't know I wonder how much Elon
thinks about
that realizing
that maybe doesn't like maybe doesn't
care
it would it would go
against the form of many previous
revolutions if you could not care about
that but if you do believe that the
future is
machines then maybe that's kind of what
you bank
on you just Bank on yeah fuck all the
people man uh you know the machines will
uh the machines will
rise and the machines will be my
allies
and
yeah we'll let we'll let let's let
normies talk about this for a little bit
and then we'll dive into what these
optimizations are Del Del Del delvento
you write that script again Del Del
sorry Del got to read the script
correctly
Dell is that where the farmer is I heard
was in the
Dell I opened up my Dell and I didn't
see any farmers in
there we are farmers
a lot more locals than this it's
512 that's only
128 uh oh I checked out the Sesame one
yeah can you actually use the demo I
just listened to the the the
voice uh think what even is the Dell
what is
it that's right
I said Tik Tok where it was like a
federal
employee and you know times have been
really hard for me I I I Elon has has
come from my agency and all the people
are getting laid off and guys I just
want to let you know that I'm doing
really important work you see we're
we're we're investigating the wheels on
the bus and and where we're trying to
see if the wheels on the bus really do
go round and round or not and I
just I don't know I don't know how we're
I don't know if we're ever going to find
[Music]
[Laughter]
out it was really good it was really
good it dead
pan h no I didn't watch is new Rogan
Elon
good I don't know bro podcasts have kind
of had their day in the
sun
uh it's I guess it's still like better
than what's out there I don't
know Rogan's not even like the bottom of
the bottom like I've seen after I did
third Lex I got invited on all these
podcasts and these podcasts had 10x the
views of
Lex and they were basically about
like they were like like this like
mainstream ified manosphere kind of
Andrew Tate
adjacent not as far as Andrew Tate
Andrew Tate's even more interesting than
these guys um they're just these
absolutely generic like male podcasts
and they want to talk about like aliens
and the gym and like like whatever the
like like like podcaster topics are I
like I'm not go on these podcasts
go on talk to it didn't she rug everyone
with a meme
coin you didn't find the new Rogan musk
interesting at
all
um Oh Land Reform
yeah oh the US is even more sad the US
the housing situation is even more sad
it's not even Land Reform it's not that
people need to give up land it's that we
just need to build high density
housing we can't do that there's a
there's a there's a seal there's a seal
and we interviewed the seal and he
doesn't like looking at large buildings
so we can't build
any oh I'm not going on Rogan guys you
think I want to be fucking famous I
don't want to be
famous it's a good number of viewers
that we get on these now we used to even
get too many viewers and it would just
be it would just be spam
garbage what's it called like a gaggle
of
people it's nimes I'm hungry I want
lunch
uh no I don't want to like you think you
think I want like like people paying
attention to me at scale hell no
awful is there use for mediocre
Engineers or should they put their focus
elsewhere
want lunch how am I going to get
lunch Amanda's out for the day she went
to a Buddhist temple to do like Temple
things Amanda I want
Lune yeah is mediocre ever
acceptable um I got door Dash now I got
food
Panda food Panda Manda hates when I wear
food panda Panda but she's not here so
we can order food Panda
yeah food panda
okay let's first get the optimizations
to
match subscriber only
all right so you see that this
one
is half the speed and we're going to
investigate
why so disable
that
oh Lord sure your wait for your drunk
dials at 3:30 a.m. I love
them
so I mean something's happening they're
both being cut down to 32
so you see what I'm looking at here so
this is the global and local sizes for
the uh fast kernel and this is our
Global and local sizes with no
optimizations and then we can apply some
optimizations to make it faster and
we'll see if what it's going to take to
match the optimizations that are in here
so let's talk about how much we got to
shave off of each
one by the way again I'm going to point
this out
notice how I have no notice how all my
screaming has been about the decline of
the American Empire and none of them
about the AMD drivers and the reason for
that is we're not using the AMD drivers
we're using the Am driver which is built
into tiny grad and completely replaces
the AMD driver and doesn't have bugs I
mean I'm sure it has bugs but I don't
know like I haven't seen it crash I mean
we haven't seen a crash all stream I've
been here I'm doing it
live all right so we got to take 128 off
each of
them going to be some combination of
let's see if we can learn
here so they call it like
coring R unrolling LDS they really do
all build on each other oh this stuff's
crazy
is a really good blog post by the way if
you didn't read
it
yeah okay a wave is a block of the of
8x4 output
Matrix is that the last place the codes
understand I mean maybe we can just read
it
here that's still okay
here wow this looks very
complicated
uh so a simple thing to look at is just
what the output shape
is looks like the inner thing here
is T
thread tile size of
4x4 so if it's a thread tile size of 4
by4 uh but does the thread tile come
before or after the
locals that last 16 is kind of crazy
maybe we just want to get rid of that
cuz 16 *
8 is good
see how that
does not
great these sizes are wrong that's 64
and 30
36 so it's probably wrong
okay so cxs has a lot more of these a
wave is a
block yeah okay that's a lot more
complicated than just the simple stuff
I'm doing
then all right so this is that you see
the wave here is is uh do you guys want
a quick lesson on how gpus work so
everybody can follow
no see we fixed the AMD drivers that's
the
difference Elon tries to fix America
I'll try to fix the AMG drivers all
right you guys want a quick lesson on
how gpus work all right let's go so here
are our docs on the uh 700
FTX we've like documented his GPU super
well now
[Music]
that oh is it capable of
ECC it might
be CLA
garbage we one that Zooms in on there
yeah computer unit I
forget okay
so compute unit pair so it has 96 of
these compute unit pairs this whole
thing is called a work group
processor
uh gpus are what's called
simt um so maybe you've heard of simd
um single instruction multiple threads
is what gpus are the problem with simd
is it becomes really hard to like
Shuffle data around whereas in gpus you
don't really have to think about this
you code as though you're coding for One
processor but then this processor runs
in what's called a warp um so this warp
is what uses the vector uh GPR and
another thing that I really like about
about AMD again props to AMD yo who
would have thought that like two two and
a half years later would be given so
many props to AMD so Nvidia hides all of
this from you Nvidia doesn't really show
you what a GPU is you can code it in
this language called PTX but then they
have a close Source compiler that
converts PTX to SAS rdna 3 is an actual
is actual machine code so this is actual
machine code that runs on the GPO uh so
should write a syntax highlighter for
this I think that like Claud could do it
automatically I don't know why I said
Claude I've never actually used Claud um
but I hear it can code or something so
uh yeah so this is actually a machine
code that runs on the GPU and it's super
well
documented uh which is another
incredible like AMD thing this is this
is this document is what got me into AMD
originally uh the whole instruction set
architecture is super well documented
and you can read uh how these things
work so yeah
maybe yeah so this this is the kind of
like normal things you're going to see
so no I don't worry about that
actually
um it's more complicated than this but
you can basically think of a GPU as a
simd does everyone understand what simd
is let's start there if you don't
understand what simd is go back to
freshman year bullshit but you have to
understand what simd is in order to
understand gpus because it is
fundamentally s it's a it's a simd ALU
so the ALU like you're doing all 32 of
the math operations at once um the
difference between the simd and the simt
and I just learned Sim I had I hadn't
heard this
uh uh expression
before uh but uh corix mentioned it to
me real expert in all the these Hardware
things
um both simt and S use broadcasting send
the same instructure to multiple
execution units but so there's two types
of registers in in rdna A3 there's
scalar registers and there's Vector
registers um so Scala registers are the
same across the entire
uh here so here's the assembly these s
registers are the same Andross the
entire warp so your warp is 32 wide
these s registers all have the same
value but then these V registers are
actually with 32 so you can have 32
different values in
them
um so yeah does that explain what gpus
are I'm sure there's like a YouTube
video that like explains this but we
can't use YouTube because it doesn't
work uh in optimizing GPU performance
how you balance instruction level
parallelism with memory lat
uh so your memory latency is usually
not your cach is going to help but
there's another trick that gpus use to
hide memory latency and that's warp
scheduling so gpus have warp scheduler
so that that warp this is a warp that's
running boom boom boom boom boom boom
boom and then eventually I've triggered
these loads and eventually I'm going to
get to this instruction and this
instruction says you have to wait for
the loads to finish and when you do have
to wait for the loads to finish you can
think about this instruction I've said
this on the stream multiple times as a
context switch instruction so it allows
the GPU to switch contexts you might be
familiar with a context switch on CPUs I
don't like that I look over there and
look here um a context switch on
CPUs is why is it more zoomed out now
and it was less zoomed out last time I
have a lot of questions um a contact
switch on CPUs is used to hide latency
from dis and network a contact switch on
on gpus is used to high latency from
memory so that's what this this weight
count does and assuming depending on how
many registers you using so if you're
using a lot of registers and your
register file is super full then you may
not be able to schedule multiple warps
but if you are not using lots of
registers then you can schedule lots of
warps and it will hide latency with
that uh this is a 32-bit float map on
yes so you see that when we got rid of
that last last locals we went down from
22 down to like
14 so that's a lot less
good so now when you understand the wave
tile
size um
the wave is a block of 8x4 of the output
Matrix so you can understand that it's
you understand what the 8x4 is
so now let's see if we can understand
the iteration order of these
things so times TM +
YT okay so that does look like it's it's
the final
one is the cooning which is kind of the
opposite of what I was doing here so to
write this in tiny grads optimization
language the first thing that we want to
apply are two up
casts so upcast are this what they call
a thread tile
size
um yeah that's right okay
cool so a thread tile size
and then for the other
one they're saying that they have a wave
tile size of 8 and
four um what are the output strides of
the output
Matrix so I think that's going to
be that means we do this one first
because I think that we can look at the
stdes in a minute I'll show you how to
do
that uh but here we want to do local
access one is
8 and access 0 is four we'll see if we
have to flip
that all right so that gives us nine gig
flops uh we can look at the strides here
so this is going to print me the shape
trackers here so this is the output one
and you can see
that uh yeah so that's 32 so that one is
the
um these are the locals this is the one
that's eight this is the one that's four
and that's zero because that's the axis
we're reducing
across cool so that gets us nine gig
flops I'm only executing the code on one
GPU here but we can use them
all you can see right here well
nothing's actually up now but I can of
you
want
okay so we're still missing something
here
because
this is 128 on theirs and it's 256 on
ours so something should be upcasting
that that we're not upcasting and then
we'll get to what we want to do for this
496 in a minute too by the way if you
want to see what our generated code
looks like just do debug equals
4 and this is what our code looks
like oh you know I might also well be
able to say d vectorize equals zero this
isn't ready yet it's almost ready so
close to
ready uh then we don't have to like
write all that crap I got to make D
Vector I equal zero work that's that's
like my next big tiny grad
project uh it just makes the code a lot
more readable because we don't have to
like entirely de vectorize the alus
which don't really matter but right now
we have to De vectorize everything for
the
um the load coaler to work the load
grouper
okay so that's probably all
right block tile size number row or
column we read per
batch duration over BK
blocks yeah so
like this is doing a lot of very fancy
stuff we have some ways of doing it I
think and maybe it's about time we get
started really thinking about this
because this is a good example like this
is this is a good example of the clear
tricks you have to use it's the same
tricks on Nvidia
too um there's nothing special so oh by
the way what the sync threads is so
remember how we talked about how gpus
are uh are warps syn threads ensures
that all your warps are synchronized so
I don't believe that your individual
warps can get out of sync but remember
that our locals are 128 so that is four
warps uh and for the four warps we
want we want all four Works to stay in
sync um because I believe that CGS is in
oh no this stuff's in local
memory so this shared stuff's in local
memory um we do the reads we
synchronize uh if kid is less
than reg what is that
what's defined here so we must move that
down there yeah we do like a swizzle
there I'm go see if there's
any
e
e
e
e for
okay we found yogurt and
strawberries so I have an
idea before jumping ahead let's go
through his stuff one at a timeon I also
found a squid game energy
drink and we can decide if we want to
drink that or
not okay so Colonel naive is
[Music]
basically the first thing we do if we
don't apply any Ops we get Colonel
naive let's see if our Colonel naive
matches his colel kn
get rid of that
beam okay so we're getting
65 why does he get so many
more oh because he has threads
still with a block size of 16 by 16 so
that's already way more complicated than
what our no thing is but tiny grad can
fully Express that
so that's just doing 16 by 16 like that
see if our speed matches
his let's speed this
faster probably because we're doing cool
stuff like
that he's doing the math
everywhere uh he also has that which you
don't need
all right so you can see how my code
looks pretty
similar we should also modify this to
only help with these if it's
used
okay uh we launched 496 X 496 threads
with a block size of 16 x
okay okay LDS
tiling the main issue with our naive
kernel is that our inner loop directly
accesses Global memory oh I like this
way of doing it too because the LDS
tiling is actually the thing that tiny
grad doesn't do everything else we
do but we don't really use local memory
much we use it sometimes it is
supported
um but you'll see how to do it and it's
really cool
I have some start to this
somewhere inefficient because data
memory from Global lcy has high memory
typically in the order of hundreds of
Cycles since each memory is followed by
minimal computation the GPU struggles to
hide that latency even with a large
number of concurrent
threats moreover the algorithm reads the
same rows and columns from gold memory
across different threads leing to AIS
ex um
yeah
okay so we want to load
them into a
tile oh this is
great stocks great because this is the
thing we're not doing so let's write it
oh we received a hype
chest I got a frog Ponder
emote
share Cho
Choo that's a pretty good
emote oh it's limited time only they're
going to take away my frog
Ponder oh well Nothing Gold Can
Stay we're eating yogurt with strawberry
okay if you choose tile size of 32 by
32 and BK of
um all right well just try to do that
with the 16 by6 first so I have some
stuff that like vaguely supports this
and I played with this
once but I don't
know so okay uh let's let's work on what
the as
is we can also do this on the Mac we
don't have to do this here
it's probably nicer on the Mac to do
this and I'm going to kind of consider
this
done um I'm going to
copy
[Music]
this m Mall
matters do
that do
[Music]
that wow that prints a
lot um okay so we can we can commit that
later uh
it's boring if we don't do
that link this in the top of the
file great so now we have an example we
know what's theoretically possible we're
checking the output I love to know
what's theoretically possible
it's kind of a
lot let's just check if it starts with
text
uh so we don't want someone to like
accidentally name a variable do text and
then you know done uh we have dis
compile
cache
cool all right that should be doable to
commit
uh wait where's my oh I force add
that get a license
might all right
cool T someone's code always consider
the
license for
[Music]
it's great to have like a simple example
like this because we can just iterate on
Tiny grad until until we hit this
there's really just one trick that it's
using and we have to you know use that
trick it's it's similar to what we're
doing for the tensor course we already
kind of do this for tensor course
we'll get to how that works in a
minute like half of the reason tensor
cores are good is because of this trick
but we don't we can't apply this trick
generically we can only apply it for
tens of
cores so let's apply the trick
generically um we'll work on that same
Branch here
and we'll make it work on non
AMD we want to work on the same Branch
yeah I think we
do I tell you about the squid game
energy drink should we get the squid
game energy
drink uh let's go
here we're on 32 new new window tiny
grad have it over
here so let's get rid of that one we
only do this devicea
that all the
time sh should go down
there how we doing with
uh so that's just let's beam
search can I do beam I do beam
being search
work lot of
complexity all right no beam search
yet that's actually not too bad so
remember we're not applying any Tor
course here and we're getting two gigl
s um if we want to see this with tensor
cores we can just do simple map
Mall the tensor cores on Mac actually
work at fp32 which is cool so we got
like 11 Tera flops and we can thr Beam
on there and see if we get it
faster the beam on Mac is fast now too
uvn figured out how to access the
compiler from anywhere so good bounties
paid out for
that let's see how fast we can get it to
be look it's already faster look at that
11 11 versus there you
go yeah
me 11 ter flops but that's using the
tens now what if we don't use the T of
course h
I'm sorry you just have to know these
magical incantations
that was people doxing all the Doge
people so have a Google alert for Comm
AI you know we got Doge people we got we
got come aiers in the
Doge
uh yeah props to Elon for
trying he's going to like sort of win
too going to be so interesting
do I look like a hong honger I was
trying to buy a jacket that made me look
as like Hong Kong as
possible if you don't have people with
names like big balls don't worry do just
got the big
balls yeah I wouldn't bet against them I
wouldn't bet against them we got to fix
immigration we gotta immigration is the
main thing that's going to save America
uh and sell your gpus to the world oh my
God very H call right thank you thank
you that's what was going for all right
so if we don't use tensor cores we only
get six jiga flops so let's get more
jiga flops right so we only get two if
we do that
but um all right
so we have like transforms of the as
here let get optimized
so this thing is what's capable of
adding the tens the tensor
course
um we're going to need to stick to find
local and stores and stuff
in but yeah I mean this has been
something that I've been thinking about
for a long time I think I even tried it
once but I never went far enough with it
we'll see if I have the motivation to go
far enough with it today you know what I
think we need you know what I think we
need for the motiv to go far enough a
squid games energy drink let's go get
one
was trash out here too
how nasty is this going to
taste let's take a look at it
oh how Nidia will be nationalized yeah I
mean do you not think the AI diffusion
Act is kind of like a start of that
that's that's like kind of exactly what
it is right like it's the the US doesn't
nationalize things by uh you know maybe
like the like the
socialist government socialis artina you
know uh the US nationalizes things by
let's start by Banning the export of
their product the the AI diffusion Act
is in many ways the nationalization of
Nvidia or an attempt at that is it
not yeah it's nationalized all by the
name exactly so if you if you tell a
company oh you can only sell to our
market right like no look
nationalization is obviously on a
spectrum it's not extremely
nationalized all right but
yeah so was I off was I wrong
guys all right the squid game energy
drink the triangle Edition I love the
triangles triangles are my favorite um
it's got lots of Korean writing on it so
you know it's good because it's got
Korean
writing Korean riding
good Korea falling apart is that true or
not true is that
disinformation um let's just say I
wouldn't live in Korea right now I spent
a lot of time there and there's things
that are wonderful about it but there's
things that are also
trouble uh
yeah the squid game energy
drink is it good is it good should we
drink the squid game energy drink do we
need a poll for
this marry into the Samsung family yeah
yeah yeah should we drink the energy
drink what are we doing
boys about the pros and cons of Hong
Kong let's crack open the squid game
energy drink talk for two minutes about
pros and cons of Hong Kong
I don't want a
590d got everything I want over
SSH uh no I'm not joking this a squid
game energy J you thought thought it was
a joke this look like a joke to you this
is real
shit every energy drink tastes bad at
the start that's a good idea I still
remember when I was 17 didn't have my
first Red Bull uh you want to talk about
a gateway drug you want to talk about
what got me into drugs was energy
drinks but now I'm not into drugs
anymore because I'm in my 30s and if
you're still into drugs when you're in
your 30s there's something wrong with
you drugs there's a South Park line that
I love and there's a time and a place
for drugs and it's called college and
shit I did a lot of drugs in college
then
I grew up and became an adult we still
sometimes drink squid game energy drinks
which who knows what kind of weird
Korean drugs are in here you know but
it's legal in Hong Kong so it can't be
too
crazy
um pros and cons of Hong
Kong the only
con is that there aren't more good
software Engineers here like I wish
there was a group of I I and every
single software engineer living in San
Francisco you will be so much happier if
you pack up your shit move here you will
be so much
happier
um so many little stresses of everyday
life are just
gone uh this is
a
efficient
beautiful country
um really it and it's beautiful on many
levels there's nature
here uh I go hiking a lot I love
hiking uh
[Music]
there's uh look out at Victoria Harbor
and like see the
buildings uh so there's there's the the
Techno Beauty and there's the uh natural
beauty again I I told you my experience
getting my mole lasered off wow that was
good um when I got this haircut like it
was like like a massage haircut it was
wonderful it's just just life's just
really
good uh I don't
know yeah I've been to rulse man yeah
yeah yeah I've chilled on that
beach um thank
you uh I stop get I'm not saying if like
you know you smoke a joint or have a
beer or two on the weekends that's not
what I'm talking about I'm talking about
the 35y olds who think taking iasa is a
good idea what the hell is wrong with
[Laughter]
you you know and I'm not talking look
there kind of like like the Hipster
artist type who takes drugs like that
you know good on them right that's not
who I'm talking about here I'm talking
about the 35-year-old software engineer
who decides they are going to find
themselves in South America and goes on
an iasa Journey you are who I'm talking
about don't do
drugs what's wrong with that I haven't
taken katum I haven't taken katum since
I was
like
24 IAS is how you quit object oriented
programming no what happens with these
people is they think they find some
magical thing but really they don't find
shit I like the Twitter you know though
you got one shotted by the a
yeah dude it's just for
fun you never work nin to5 George Hots
you cannot relate wow I can't believe
you people are defending
drugs yeah the deeper
meaning you think you found meaning in a
fucking South American
jungle that's some dumbass shit oh yeah
yeah took some Shaman drink man yeah if
you know what if that shit was so
meaningful and so Advanced where the
hell are those
societies right how much energy they
generate how much steel they
producing yeah that's what I'm
saying no I'm GNA circle jerk in my head
man wait I never worked 9
to5
dude what are you talking about no I was
in Twitter I was in person in Twitter I
worked a lot more than 9 to5 that was my
entire life you can look at my GitHub um
no I mean Elon I work about 60 hours a
week elon's guys work 80 uh and like no
joke they are they
are elon's top guys are a level and I I
could if I could work 80 I'd work 80 uh
I just kind of can't like my mind just
doesn't work that many hours I do work
60 hours a week and don't think I don't
have 9 to 5 I'm I go to a co-working
space every weekday
here uh and I get there around 9:00 and
I leave around 7 and I do that every
day um on the weekends I take one day
off on the weekend and then I usually do
like half work one day like this kind of
shit uh yesterday I didn't work I was so
I was so tired
yesterday um I slept mostly yesterday
at Twitter five
weeks God there's been a lot said about
that
um I don't know it wasn't my calling
working at a social network is not my
calling uh I quit and I went to Tiny I
started working on this I'm working on
this company now for like two years we
got a good crew of people working on it
we're making a lot of we have our own
AMD
driver we did it that was the original
goal
of you see how my lights up I got a OLED
monitor another like by the way I bought
this at like a store here have you ever
gone to like a
store like like in America and like
bought a monitor I don't think you like
maybe like some of are okay like Micro
Center and
Fries
um but no the
the uh Amazon like doesn't work here so
you have to buy things locally but like
it's not a big deal it's all functional
um which is actually like kind of cool
if you're the kind of person who's into
like I can go to my local shop and talk
to my local guy you know we got we got
people with with with 110 115 IQs on the
corner selling fruit
they're good at
it
uh so yeah no I
mean our spum goal is to get AMD on M M
perf using the tiny gr framework we've
succeeded at doing
that um we're going to write our own
software the entire so we have not
replaced lvm yet the last piece that we
haven't replaced is lvm um I mean lvm is
also it's not like like as far as
software
goes uh I don't like it's not like the
AMD driver which is Chuck full of bugs
and like or amd's other stuff which is
like copy of video garbage like lvm is
the greatest optimizing compiler
framework in the world um you know
written maintained by Apple you started
by Chris lner like this is not this is
not a bad piece of code to depend on
um so I'm I'm okay with
uh wow languages lovm is 40% written and
llbm this is not a this is not a bad
piece of code to depend on and it is it
is AMD stuff that they committed to it
but you know it's just it needs to be
removed eventually and like you'll see
why um or at least fixed maybe it can be
fixed I don't know that much about llvm
internals but he when he gets to five
here
um yeah before we go into the next
observation I need to be able to
directly compile the uh the ISA so the
we're skipping ahead we're going we're
going to go back we're drinking the
energy drink we're doing this we're
doing
this
um there's the these uh like dual issue
ALU instructions but they're very picky
about which banks they can pull the
registers from so like yeah look at
this it's funny like this almost looks
like the same like they talk about the
bubble problem that deep seek solved it
almost looks like that so many of these
problems in AI infrastructure are just
the same problem repeated over and over
again at different scales and my dream
is with tiny grad we can like unify all
of this but it's a long
journey
uh yeah if you want like the big Market
you can go to Wai computer center
um I've been to Wai computer center at
the golden computer center it's up there
in like
mangok sham po area I can't pronounce
any of these oh yeah it's a little sad
that like
um everyone here speaks KY and not
Mandarin and learning Mandarin is is
hard
enough uh K has like seven tones or nine
tones it's crazy complex to even like to
even hear what people are saying in
cantones is really hard like Mandarin
I'm to the point where I can hear what
people are saying like I if I like
listen I can like I know what people are
you know my vocab is not that great but
like like at least I know the
sounds um K is so much
harder uh just like I went to I went to
Magic on on on uh Friday night and it's
like great you know you take the public
transportation there I went out for a
beer and some uh
some uh like string beans with pork
afterward
uh every software engineer living in San
Francisco if you move to Hong Kong your
life will get
better does that answer your
question so we're going to have to
Define locals we're going to have to
transform the EST so we can print the
right here I should print it
before
um I probably want
to now see we have to do that
afterward uh
so you see like we can do stuff here
like print k. get optimized as we can
see what like that looks like and you
can see that these shapes here are now
these um
why is there a view
there why is there a view there
so we might have to put it in
there let's think about what we actually
want to
write and notice how like the modified
as tells you like the number of local
dims and stuff so that's these local
dims um upcast it is zero that's a
reduced
D so I've written this before
it's kind of what I've already written
in here for
TC this all needs to be cleaned up and
refactored it's like before the mall we
need to replace those
loans with local loads
let's just add a function in here called
uh
yes that's in two program it's all
pretty deep
so we can do this with a graph rewrite
probably we just want these
loads
yeah show you how to use show you how to
use the rewrite infrastructure from time
Gra
no op for
now noop is noop that's good
match try some this is similar to the
kind of rules that you see in
uh llvm and Mi
ml so we have a
load just need that
um should going to be a Lambda
turn on here you can see this is being
called with the
loads object not does
that okay so you see how we're getting
both the loads here so this is a good
place to do Transformations on them
um let's add in a
store I've never tested any of these
code paths before so like this is a
testament to like how well tiny stuff
works and you might see me just get
frustrated and be like this shit doesn't
work because we're not ready for it yet
okay
um first we want to define a
local so let's define a local
forg exactly what the syntax is for this
do I have a
helper I
don't I use this incal though don't
I
here let's just take that from the okay
so
um x.d type. pointer local size is 256
right 16 *
16 uh and for this we're going to want
to call it X
do let's just do x. Source one.org
all right so we want to store
uh store has dtype void our sources are
local and
X it's probably
right um if
x. source. op is ops. Define
local we want to return
none okay let's continue on here uh
load we want to load from
local uh we're going to need a shape
tracker actually we're gonna need a
shape tracker on both of
these need view um
this is deep tiny
grad hopefully it's like kind of
understandable like I'm not doing
anything crazy
here uh shape tracker from
shape so we want the shape to be 1 comma
1 comma 16 comma 16 comma
1 um and then actually we'll just call
that
local shape
I believe that shape tracker has a
method called size yeah we'll do that so
just do shape. size was it a method or
property it's
property um should that return a shape
tracker why do that light
out why do that know that's a shap
ohle in
there now knows it's a
I love syntax
highers okay so that's actually not
right we want to also pass in Local
shape. 2
UOP is a method on a shape tracker
called two UOP yeah it's a okay good
that
works okay we want to load from local
shape Eur
uh we want this load to depend on that
[Music]
store and should be fine
turn I'll show you guys what the code
actually did in a minute uh so that's
Define local that's Define local why
does that Loop forever should not do
that
we do have to give this a
tight why does that look
for still Loops forever
interesting oh because it's the other
load
um yeah okay you see why it's looping
it's just adding more and more of that
shit not really a way to check the
children uh
okay that's
something uh did it work it looks like
it didn't do anything at
all why didn't that transform
now so that'll stop it from hitting
twice but now we get
nothing
okay Delite
debugging so that's returning something
just printing
it
oh oh wait this is not
right that's just not right okay
whatever um
whatever we'll print it
here that'll show me the modified as
okay good that's
something uh it works it's just slow I
think the code might even be right
okay
yeah all right it's kind of
wrong yeah okay this gets into what we
want to do we basically want the local
threads to copy the chunk of the Matrix
then to synchronize then to do
it but we are now copying this into
local it's just that each thing is
copying it into
local and we're reading from
local yeah which is all fine but it's
just not really
right let think about what we did here
so this stuff is like to write sort of
way to do
this uh the way it's done in
TC M instead of w m okay emulate the
warp addressing with loads I already
like wrote all of this which is
ridiculous I could have just copied it
from here but I didn't do that right
it's basically the same
thing um yeah that's exactly the same
thing okay that's just the code that I
just wrote wow
but yet how
come what if I do TC equals 3 does it
still work
so TZ 3 is clearly something else let's
think about why it's
different oh get TC Swizzle
St ah it's doing the Swizzle we got to
do the
[Music]
Swizzle yeah so we actually want to load
and store differ
way that's the whole trick to
this guys it's a victim okay it's a
victim it was a victim of GPU error
recovery and it's entitled to
compensation okay it's a
victim jeez okay don't do that oh it's
because I ignored the beam cach
whatever no you can't make fun of
victims victims have had it really
hard really
hard let read that and think about what
it's
doing
e e
[Music]
let's work this
out
okay so this
is upcasting the tile
size yeah something like that
I
see okay
[Music]
so well that's not right we should have
more shape
trackers it's clearly not being printed
from the
whatever it's not a big deal if you TR
it here okay so X7 here is
the
yeah
so I believe that each of these is only
using one
of global
locals and that's what we need to do we
need to move
the we need to move the useless
ones into that
somehow but I don't exactly know how to
do that so let's try here
with let's throw 16 upcast on access
two oh that's going to whine uh because
I
didn't yeah not access to actually sorry
unroll
unrule
uh yeah so I think I need just one more
one in
there fix this
later Z not equal to one with two
sources um first let's make sure that if
we don't do the as transform it's
fine yeah it's fine now you see we're
doing here we're upcasting
there we unrolling
there so that's going to read the group
and that's that's effectively what BK is
uh here is fine but let's put this
transform back
in
okay Z is not equal to one with two
sources let's read
that un exercise paths we don't know if
it's going to
work uh
oh this
crap yeah it's because the loads have
that extra store
there but that's not actually a
gate should be removed by then though
let's take a look at viz
what I hit the firewall or something
what preparing
profile is cra
this is starting why why
is why is it not printing the
URL what is the URL on
his why is it
running again let's just disable that
transform and see
if F works okay did we break viz
somehow f is fine why was that crashing
you guys can see viz you see
viz see what's going on
uh but something breaks
viz if we do that it's not the pro no it
breaks so we can disable the Prof
actually I haven't tried the profiler
does profile
work this is hella
slow no want has time for
this is it even
loading oh yeah okay it kind of
works we got to make that faster but we
have all that data it's going to be so
nice when this is integrated into viz
like right now we have to like load
profetto probably from the internet uh
and right now we're doing the same
kernel over and again so the profile is
pretty boring but check that
out like and you just get that for free
in tiny grad think of how much effort
that is to set up in other
Frameworks oh well this is going to take
two
days um but it's not the profiler that's
not even what's breaking
it something's breaking VI
oh it was just hella
slow qu
slow
um all right so here's a
store oh what no that's not even right
put that
back uh that's normal enough that it
should work but it doesn't for some
reason
why does that take five
seconds okay it works just something's
broken that takes five seconds okay
whatever um the store only has two
arguments how does this have a
[Music]
successful this is what's failing
there's two arguments to the
sink oh it's these stores that are lots
of arguments
okay
um
what
oh yeah probably shouldn't be Rewritten
as a sync
oh cuz it's trying to fold
that that should actually be
right those stores look
okay zero not equal to one with two
sources
wrote These junky error messages I know
it was
[Music]
me are not in offset root
sources
what does anyone understand
[Music]
this all this code needs to go this is
the code I was complaining about before
about the decorizer whatever just don't
rewrite it then okay um it gives me
something it's just unfortunately uh
wrong wrong wrong wrong
should really think about how TC3 does
it forget
being cuz TC3 is this B
working sort
of what is all
that just precomputing all of
that
oh well it's doing something right
so what's wrong
there oh because it should have
Dimension
16 you should have stride Z
zero yeah we need a lot of stuff to make
this
easier yeah we have to prute that
probably so
y who wants to listen to copyrighted
music never just get that urge to listen
to copyrighted
music so the store is fine it's the load
that's wrong
why are those in a leave they totally
shouldn't oh I see so this is the here
what why is it writing to the same place
over and over again that's just not
right uh yeah that's totally not
right
okay these shapes aren't
right um we have to say
here
x Str Str called on view but what else
am I supposed to call it on oh get host
by Adder because of tail
scale because of
socket because of server name I hate all
the I hate computers man
disgusting that's why it was being
slow C it's not your fault not your
fault to T
Mac
really get host by Adder can someone
figure how to disable this can someone
figure how to disable this and do a poqu
almost clicked exit on OBS I didn't mean
to all
right so
yeah above palm trees
you guys know the song goodbye sky
harbor beautiful
song I still
[Music]
see let's listen to copyrighted
music I actually want to listen to T
Swift which is is super bad because it
say super copyrighted you can't just
Taylor SW man got to get Taylor's
permission
first um
think that's
right that's wrong
but uh and yeah that's just
cuz I'm pretty sure those stores are
right now we're going to probably have
to make the load in the store
different oh okay I got to fix all that
de vectorized garbage there's so much to
do guys there's so much to do okay look
that stuff's all right now
but this is
wrong okay now we expand
that oh one of them is probably permuted
wrong yeah one of them is permuted
wrong well if you want the naive
permutation okay let's copy it from
Colonel where I actually did this
correctly uh so I get the shape Tracker
Where what if we listen to a cover of
gai Sky Harbor is that still copyrighted
music that can't be copyri WR
music what if I listen to goodbye Sky
Harbor and you guys don't get to
D who's feeling this squid game energy
drink you know take back what I said
about drugs
how did anyone ever make any of this
work
for
for for
can't be
right that's not the local size those
should be zero
oh do they have stride zero
something that's just not
right how does this
work CU there's no way
that how do this work
I think it doesn't work great copy wrong
code why don't
you guess this is
wrong who broke
this this is this is broken one of the
tensor quy factors
whatever it's not a real
feature we have bad testing for
it but this is
wrong I'll leave the colonel crap
whatever it doesn't hurt
anybody we have to think about what we
want to
do for
okay a few things this stream needs
music and I need some speakers because I
don't have any speakers in this
room uh like at work I have noise
cancelling headphones and here I have
airpods
but we need some bumping speakers you
know bump bump bump
bump
okay let's think through the shapes and
get them right it's amazing that any of
this shit works I should just rip all
this out it doesn't
work like use tens of course 3 is just
broken what is you T of course
two three is
broken emulate the warp addressing with
locals like this isn't
right let's think about what we want to
write let's think it
through we have something that's a tile
size by the tile size
size and
then okay that's probably right
then no okay we want the
load I guess we want to separate the
load and the
store okay we want the store to just be
here but the load doesn't have to be
there because the uh locals are
different okay all right we're making
progress we making
progress okay we want the
store to just always be the local shape
which is
16161 um let's do that
wait
what
huh no the problem is we want to change
this
load I just got rid of the load how's
this even right what
yeah okay I'm just storing from that
load okay it's not what we want all
right there's actually a load a store
and a load
okay is everyone with
me okay so that is being loaded
there but we don't want it to be loaded
like that
okay I got this now I got this i got
this I know what's up I know what's up
let's
go we have a shape
tracker
here
um we'll save this as
strides because that's what's going to
matter here
so if we just make this the local St on
all of
them okay that's
good uh actually we should do real size
here we should just do
size
great but now what we're going to want
to do is we're going to want to Swizzle
all right I want to know how to
Swizzle we're going to want to stick
that in that
hole if strides up to
zero we want to both transform the input
[Music]
okay local St equals local st. prute we
want to
swap all 01 two 3 four five do I have a
convenient swap method
I should Z one two three four
five uh I'm going to do this to the
input St as
well because that stride two has zero we
want to stick five there and it's like
that then for this
one that goes there that goes there that
goes there okay that
right no and then for the low we don't
actually want to change this we call
that load St sry store
St uh oh and then we actually want to
Premier Tes two positional seven were're
given okay fine
tle get some bumping speakers we going
to listen to copyrighted
music the small joys in life um
um no oh because I didn't actually
change the load we have to update the
load uh
x.l
um Global
Lo xpl source
x. Source Z which is the buffer and then
input
s.2
UOP then instead of that those can stay
X that's fine but the one that has to
change is this
one can access variable store St not
associated with a
value what how is none of than
that oh because of this
uh context
anymore I don't
know just leaving just do that fine
whatever
go okay that looks more like some
code uh except that's still wrong
we're still jogging on that we don't
want
to we actually want to do the opposite
we did this wrong we wanted to put the
zero stride there which it should be now
hang
on so we're doing that
store to 14 oh just a globble okay uh no
that's not what we
want that's zero okay that's
right that should be zero but then this
one
shouldn't uh the store shouldn't be
that so maybe we don't actually want
store St we just put local St
there all right we have one copy
happening now this is wrong okay the one
copy is correct so this basically I
don't know why those can't be on the
same
line
whatever we should use a fast
instruction for that anyway but so this
is now this see that see how these two
things are the same thing that's now
that except we do all the indexing
outside all right so notice how they're
index the same that's just A3 which is
LX Plus lx0 shift shift 4 right and then
that is that indexing there now these
are incorrect this other load is
incorrect uh and that's incorrect
because this is the one that should have
been uh this should be load St store can
be that but load St needs to be that so
it expands
okay is that what I expect to
see is it just missing a thread group
barrier thre group Barry should be
right they do syn threads at the
end there's a reason you have to do syn
threads at the
end yeah it's Cas missing a syn threads
I think I think otherwise it's correct
so this is uh this is
unrolled we don't actually have to
unroll
there we can just split that do I got
method for that I'm not sure I have a
method for that
though
I whatever it's fine to unroll it it
doesn't hurt anybody but that's
basically just
that that's that
some so I think we're we're just missing
a thread group barrier at the
end and this is an extra thread roou
barrier we don't need that
one because the problem What's Happening
Here is that these
loads some of these stores are happening
before these
loads and it's getting like the next one
looped
around does that make
sense let's fix this host name garbage
get
it can I skip this
somehow override server bind to store
the server name why does that even have
to
happen fix
what that here create the HTP
server bind and activate equals true
what oh is it just of this do
that okay that's fast whatever
no it didn't
workwork
garbage this isn't even a real
thing why is it doing
that is that all the HTP server
is yeah okay what if I just do
that there we go
I get a socket
server sock server you happy you happy
you just lost your HTTP because you're a
little bitch yeah oh now it works oh
who's a little bitch
now yeah yeah you thought you got to be
an HTTP server but now you don't get to
be an htttp server because you suck
but I have to override it for
that I have to override it for
that yeah yeah that's right that's right
you're a little bitch and that's why you
don't get to be an HTP server anymore
there we go yeah
forces
there we
go oh look how fast it loads now oh look
at that look at that remember when was
taking 5 Seconds now it doesn't take 5
Seconds anymore yeah squid game energy
drink yeah
all right so now I can look at all these
great high quality shits uh okay why
does this work oh I think it's just
because of the synchronization we should
just like test that first it's kind of
annoying to test
but um so if there's a barrier inside a
loop we have to add another barrier to
the end
Loop how do I express that logic
um where do I inject end Loops is that
like SE style or something that's either
all right
uh stick this
somewhere so we run it this linearizer
thing which makes it a line
oh doeses anyone want to listen to
copyrighted
music you guys remember the horse from
Over the Garden
Wall no surely surely Fred doesn't want
to partake in your schemes and the horse
is like I want to
steal horse knows what's up
so if we merge something into an end
range that has a barrier we have to
insert a barrier before the end
range so what's that in Block
[Music]
merge yeah okay if it's a block end is
it a block end yeah it's a block end see
if we're done with placement no but okay
here we're just doing
this um
yeah let's check the
sources okay if the source is a block
okay uh
if uh x. op is op stop block end and any
X
do y. op is ops. barrier for y
in u. source
two pen. extend but that should be the
other way
around oh I put it at the end there okay
that's
fine uh
probably
okay
h no that kind of needs to go at the
end that's not really where that belongs
it's actually more like when I turn the
block end into a nonblock
end so that didn't block
finalize no it's not block
finalize make basic blocks either it's
definitely in Block merge
so when do I convert it into not a block
it here
okay y this is what we want
though be before yeah this is where I
insert the Define ACC so this the right
place to do
it um yeah we got to add l are laid
offs
oh
okay
andex Source W this stuff's hard to read
it's never going to be an early off so I
just stick that in there but you
probably have to stick it before the end
range actually might be
okay that's failing a type verify yeah
we have to stick it before the end range
though uh so maybe
yeah so that's actually got to go before
the end range
that should be
right okay so that is a correct
barrier however it's failing the
verification which is okay we just need
to allow that
um yeah all barriers must come after
stores but that isn't necessarily
true
barriers also
happen end
oops
sweet I think the code works now see any
error anymore
great
beautiful all right see we had to stick
that barrier in there that's actually an
extra barrier and we should be able to
combine those
barriers
barrier great barri
um yeah does that make sense to people
how that's LDS
oh you know what we can also put the
barrier at the top we don't have to put
it at the end might be an easier place
to put it let's just see what makes more
sense in the code we have dead another
barrier
uh requires it to be before the
range so early Ops parent block on arml
okay um let's stick it in the front of
the
loops yeah that's correct as
well let's see what they did what's a
natural way write
that
um they put it at the end put at the end
of the
beginning doesn't
matter I feel like it's more readable to
getting I feel like that code's more
readable
yeah makes
sense all right should we get rid of
that barrier because we don't need it
let's take a look in viz with our new
fixed HTTP server
man I'm feeling this squid game energy
drink I love branded content don't you
love branded
content and copyrighted music oh boner
pulls down for copyrighted music okay so
remember that uh whoa whoa whoa this is
like you you don't get how unbelievable
this Tech is so this is remember that
thing that we wrote in AMD mapall so you
can see AMD m up high there and that's
what the transforma load looks like oh
come on that's nice that's nice
right all right so let's see here's the
barriers how do we tell it that it's the
same
barrier actually don't think we
can maybe in linear can
[Music]
uh we can write that in linearizer if
you want to you want to write that in
linearizer just remove that second
barrier so
because there's only loads
here you you need basically barriers
separating load thank you thank you you
need barriers basically SE separating
loads and stores and because it's all
loads here you don't need this
barrier should we write logic to take it
out um fine stupid barrier
logic okay uh
[Music]
[Music]
[Music]
no that's really hard to do actually
this is not easy the simple thing to
does not work
here there's lots of edge cases for that
I don't care that other barrier can't be
that SL in
it uh all right so this is
LDS um this is working
LDS
uh I shouldn't hard code
16s he has a name for it
16's a
lot okay this is
we're doing LDS
tiling think it's going to run and oh
yeah yeah no more HTTP server because
HTP servers are
bitch wow the squid game energy show
backing me off
yeah we'll fix
Auto all right does everyone understand
what we did does everyone understand
does anyone not understand are we all on
the same page we don't want we don't
want any children Left Behind
okay oh perhaps something typing's
callable I did mean typing is quable
actually thank
you I don't know why I can't use
built-in quable but okay okay fine use
typing
called
happy uh incompatible type an assignment
expression has Type int don't use an INT
wow is
that does python not type
check seems to make sense in testing
environment this is
the this is this is the code that's
the pyth that's the standard library for
python guys I love Python and I'll
Always Love python but you guys need to
get your standard library to type check
that's that's just
crazy no no come back
that's cool though it's just a gcp
server
PCP
recap
um not commonly used but no no no that's
not what I'm saying I'm saying the
literal standard Library doesn't type
check like do someone should submit a I
should submit a pull request can someone
can someone right now go submit a pull
request to the python standard library
and change
that uh one to
true I don't know I've never submitted
code to python before I should look into
how to do it should give
back just with little stuff like getting
their standard library to type check
and adding that to
CI I do love how much of python standard
library is written in Python
though I love python nothing nothing
ever is gonna nothing ever is gonna
gonna bring me down you know all python
all right we added LDS tiling that's
great let's see if that runs on AMD I
think it will I don't see why it
wouldn't
oh I do have some thing there about if
whatever yeah we're running the we're
running the fast
one uh we're running the fast one
because the default device is
[Music]
am there we go now we're running the
slow
one and that's basically the same code
you're going to find on the uh I mean
you see that like it renders the barrier
shit differently but uh is that he does
though he has this Auto Magic called
sync threads I think that's like
some other
shit release work group barrier acquire
work group I don't know maybe you only
need barrier maybe you need them
all but does everyone understand oh this
is basically the same code that's junk
this and that is just basically that
Loop
unrolled so we are through step
one we'll just add let's add Ln
here in say 16 we'll say Ln
you can
get what I told you to be
32 oh I changed on the wrong computer
hate when I do that
x x x x
x copyrighted music copyrighted
music going to why to be like they
attach too many threads I don't have
that many threads
ahit what's type python scrap and who's
Andre Hedberg
turbo pass now
interesting he's working on python right
[Music]
now Microsoft really has the best people
for
this if I Google type py Pyon script
this is a real
thing no it's not a real thing you're
trolling keeps trolling trolling
trolling trolling keeps trolling
trolling trolling
TR oh well yeah it's a joke I thought
was real man I was excited I was excited
if you if you can add types to
JavaScript you can add typ python is
types they're they're
okay f s system
is
okay
um yeah it's it's not it's not great it
it could be a lot
better
uh every time I tried to do like
typed every time I tried to do I typed
tensors they don't really like work I
don't know
what language does types
well I mean the C++ has good types for
all its other
problems rest's type system is
fine typescript is okay it's a
typescript like again you guys know you
guys know when I troll ja you guys know
about Java script and adding the numbers
right like like their integer is not a
real integer it's a float there
apparently some keyword to fix it but
I'm sure there's six different keywords
to fix it and they only work in one kind
of browser but don't worry you can use
Babble and everyone's going to use this
react framework anyway so want to just
you know it's what a trash
ecosystem uh why is this what why is
this one not
here minut go there go no don't do that
I go there
also don't use so many registers you're
using a lot of
registers stop using all the
registers really don't want that to be
an upcast how just like make that not an
upcast yeah big
hacks that's going to work
still
upcast I know what to
do so what if I
[Music]
what huh you can't just do that
you really just can't do that never
mind whatever okay it's unrolled it
doesn't have to be unrolled but it's the
same thing I'm writing basically the
same thing and the compiler should be
smart enough to fix it if it's not the
same thing
okay
great our occupancy is pretty good
but our Vu utilization is crappy okay we
want to do register
tiling each thread now outputs a 4x4
block since a wave consists of 32
threads we organize them into an 8x4
block
each thread will be responsible for
producing a small
tile in theer that's a thread
tile that's a
wave that's a wave tile
by4 essentially it means each thread
will be I'll be able to compute in8
by8
output right this is where this stuff
starting to lose
me let's follow it through very simple
register Ty and gets you huge gains and
this is probably kind of where tiny grad
stops right now but okay load the tile
to LDS that's
great uh we
want yeah so okay I mean it just seems
like that's just an
upcast so we should just be able to do
that right let's just do that and see
what
happens uh this is going to one about a
lot of
stuff but we'll do with that
later so according this is doing the
locals before the upcast but this one's
doing the
upcast like there's a question of like
how you want to do this right do you
want to do the upcast or do you want to
do the locals so I'm surprised that the
fastest ones do the locals first but
whatever so what that 4x4 thread is is
is just this upcast it's an operator
called upcast on Tiny
G so we've done we've
done LDS tiling now let's move on and do
register tiling register tiling is
already a supported operation in tiny
grad it's a very easy one to think about
so we can just do that okay oh yeah
that's gonna bitch of course that's
going to bitch okay um what's our SI
now we have this
print function or
property
okay so where do we inject the new
args that was still go
there that one still goes there but then
we have two more so start with Z one two
three
four first let's just refactor this
0 one0 one two three 4 5 six
s we want to switch the places of 7 and
two this one we want to switch the
places of 7 and
[Music]
three um it has La six but oh no sorry I
counted
wrong
what oh this one just
needs two more one two three four five
six seven
eight locals stay there let
go okay something except it's
wrong let's figure out what's
wrong if we're upcasting those to
four oh then I think have to increase
that as well I mean those fours are
definitely
real wait
what number of rows or columns we read
per bat this is a lot more complicated
now
I think this might be fixable by just
putting fours
there okay that gives the right
answer let's look at what it's
doing why is there so much
crap doesn't work
we are Computing that
now
um these are
[Music]
the
oh that shouldn't be
happening why would we want to store the
same thing multiple
times so that's just what we have to set
the strides to zero for that's actually
local
shape
um you see what I mean like it's just
got to be stride zero there because look
at what this is doing this is copying
the thing into local
memory uh that many times but this is
going to work out to be the same thing
right because it's 128 time
8 know I think we did other stuff wrong
too but
whatever yeah we can definitely get rid
of a lot of this by changing local
St uh which we use there and there
yeah so it is the right
shape but we want it to be a different
view depending on have to create this so
later um
view do the
strides I get the real stride somewhere
don't I yeah
here it's like kind of right but not
really
I think if I just zero out the first
two all
right
uh compiling count an internal error
okay um yeah well cuz that was
fucked at that large
number it's not we want
we could just like manually write the
stries it's not that big a
deal so real stries there is zero
then the first just double check on all
this
okay all that shit still works
great put the upcast
back that back that's where the two
upcast land
uh I unroll first I can do
thats like
simp that at the end
put that
there say five and
six all
right strides is none then we do strides
for shape okay so that's the
same why is that so crazy that's just
not right
should be fine to unroll them
first oh it's just cuz these are not
right so we want
[Music]
switch two and five so it's actually the
same as before we just add six and
seven it's easier to think about good
okay so it is correct it's just stupid
because
these the ones that have stride zero
here should also have stride zero there
um see that should have TR
zero so that's
that U it's kind of
backwards what I do it
in the locals actually do matter what I
do in which is
annoying it's the same thing right
okay fine uh good good so that zero is
there
and what yeah zero is there okay
fine we shouldn't be checking
that that's so annoying that the locals
matter
you see the problem with the locals
right we're just doing the other order
but the problem with the locals is like
where the war is depends on where the
locals are is that slower or something
great it's slower who
cares H it should make any sense to
anybody we're doing the same thing
that's in this blog post
we're just doing it in kind of a
sustainable way hopefully more
sustainable still not super sustainable
we get there so these zeros can also
apply to
these uh wait that's already there
though oh but that because that's no it
shouldn't be there oh no no no that's
fine yeah uh that should be zero and
that should go away
yeah uh okay let's just manually write
the
stdes so we have 0
0 now it's a little hard to think about
so the Ln is going to be
16 so this stride is Ln * 4 this stride
is four 0 0 04 H sorry
one uh this is the same thing no I put
the one in the other place
that
works
great looks correct to me
now we do four copies each so is that
what that's doing
too load call and row load BK so they
have eight being loaded per
batch and we only have four why is that
this is basically the same
thing we should figure out why they have
eight we only have
four oh because they're doing it in the
warp oh they do it in the warp and not
the whole thing oh that's
annoying oh that's that's wait
what does that even work
H I guess okay it is supposed to be
shared across the whole
thing that's fine okay I guess actually
no no the only reason it's different is
because mine is no 26 but that's
larger I get
it okay thread
tile the wave is the wave is 32 by
oh okay so they're doing 32
then should be
fine see if we break
anything that breaks
it that breaks it
because the thing that it's swizzling to
is unrolled 16
I don't think tiny gr
supports that I'm not even exactly sure
what that
means this is where these things get
tricky when like the shapes start to but
they're not usually actually
different this is annoying about how we
expressed
the the TCS as well all right let's
check this one on AMD
let's check this
[Music]
one what do they call it register
tiling so okay the whole idea with tiny
grad is going to be to take each one of
these tricks and figure out how to apply
them and search across all of them so
we're doing register tiling we're not
doing LDS so I had coded LDS for this
but eventually we're going to search
across
that some things are going to get real
fast it's going to be this
year just going to look at all the Cuda
kernels see what tricks they're using
put the tricks into tiny grab and then
be faster than
uh torch we have tons of bounties by the
way for people who are interested in
making our torch back end
better here's our torch Bounty
section so you can be a
participant in making the torch back in
better and then we can use torch
okay
here we
go there's the same kernel running on
AMD why are we not getting the same
speed as them it's a good question it's
cuz this dumb thing they do with the
warps that I don't know how to do it's
not dumb I just don't know how to do
it like they all they all do this and
before I like I need to really
understand what it
is like tiny gr doesn't think
about
wors e
okay we're not getting a lot of uh jiga
fluffs only getting 6,000 jof
flops they're getting Wait no that's
just with
LDS they're getting
22,000 yeah
so I guess this is what I'm not totally
understanding the thread tile size is
4x4 but a wave is a block of 8x4 of the
output
Matrix then they have the block tile
size all right we got to just really
understand all this stuff because this
this isn't exactly matching what I'm
doing it's fine there's like another
place we can stick things
into this is if I really understood what
the tensor cores were
doing if I truly understood the tensor
cores this would all work because I've
done all these tricks for tensor
cores but I don't really understand the
tensor
code a bunch of people have refactored
it after me and it's like better now
than it used to
be so we can also somehow like stick the
upcast IT thing in
the like in the stride on roll like the
reason that thing didn't work was
I'm just talking
nonsense a wave is a
block where is block size to find we at
so this is an LDS
tile each thread now computes a 4x4
block thread
tole since a
wave also why isn't that
grouped that should be a float for store
I don't know why it's not
I'll make things a little faster but
that's not the major problem here
should also be
grouped why is nothing being
grouped all these load be grouped
to I have a lot of
questions there's so much gains to be
made if I fix the the
vectorizer it's clearly divisible I I
don't know why they're not being grouped
yeah this should be a grouped float load
in store I don't know why it's not these
should all be
grouped LM should support
local okay well those are probably some
minor thing slowing it down but we're
still not totally understanding how
their tiling works we know we get the
tiling right when these like tiles are
the right size so this is BK times wait
that's the size I have 128 * 8 is that
right NB wave
m w
64 ided 8 * 4 so that's
two it's a wave
time
oh yeah we don't support that we sort of
do
so those are
like
interesting is that done explicitly
yeah it must
be
threads per work Group which is what I
have as
well R them into a 2x4 grid of wave
tiles is that fake or is that real it's
called Colonel three registers let's
read it I'll go to the computer to read
it close that
window that
great I have no time have forever I can
sit here and wait
[Music]
forever we're still on this one here
TM time TN is thread TOS side so that's
actually
unrolled that's like yeah like tiny
doesn't really support this kind of
output this this is the reduce
Loop so first we iterate over BK
blocks which is this outer loop but
that's the only Loop that we
have um we
populate the shared memory
reads so where do that number come
from ND reads
B is
BN *
BK ided by block size divid
26 so that's
four right because that's 128 that's
four so it is the same
four BS a is BM times you can't divide
by box siid okay so it's doing the same
four reads then
that's
fine what size is it launching
with block
size 128 128 so that's the same thing
I'm doing what 4 65 128 64 that's
32 so they're doing something else
BK time BM so that is the
same they might be swizzling it
differently but that's a whole different
thing we can definitely do a swizzle
there we actually probably do want to do
a swizzle there we probably want to
commute that right cuz think about it we
can then call us the loads it's probably
a big
advantage3 unrolled that many
times so
just goes
there wait what
we cach A and B for the entire wave
tile so that just must be these reads
here I like that I can Mouse over there
okay cool
that's error constant
what they're both
two TM and TN are both
four so
this oh but that's okay that's iterating
over BK
and BK is yes that's four okay so that
actually
matches they're just not unrolling that
Loop which would be really cool if we
could roll what too but I don't know if
we know how to do
that I think the linearizer supports
that because it's annoying to read
unrolled it's not like a problem that's
unrolled but like that could just be not
unrolled okay so maybe we actually are
doing the exact same
thing so why the hell is mine so much
slower
oh probably because
of yeah look they're flipping the index
look how they flip the index right
that's what I was talking
about so when they do those reads in it
flips
the
yeah so they store it locally
flipped interesting
please piss me off those those things to
like it's just because it's just because
the Expressions used twice like these
indexing expressions are used in two
places so it uses them twice but yeah so
they're
flipping which one do we want to flip we
want to flip data one I temp zero
but I think it's the
same does it matter also which is lx0
and
lx1 aex one which is not the actual War
a zero which
this is
doing it's not gonna work because I
broke
something yeah what did I break I knew
what I was break but I did that too okay
we don't want to actually check that
let's just check zero and
one oh no
okay
fine is that
faster
340 a little bit maybe
so at least yeah we're hitting LX Z
there which is actually
that that on those which is good because
it's all going to be coal
last uh this shit's not going to be
coest wait depends
on a conic callist
because that's yeah that's
four that's probably not what we
want God we just need to search this
is that faster no I feel like it was
just a slow it's just a slow doesn't
matter am I getting a
no no I got six red boxes to
sell um I mean we're making a lot of
progress but like
like an AMD is the one who should really
be thinking about this nobody wants
these
gpus I get I get three emails a
week uh saying please can I buy a green
box do you have one more green box hello
green box uh and then I have six red
boxes and I
haven't uh I think maybe I sold one
earlier in the year or maybe it was Zero
I forget we had someone write in to try
to return a red box
like it's just
Bleak yeah it's sad there's no Big rdna
4 I know and the chip would be so good
too with their with their double sending
tensor
cores oh a big rna4 would be great but
it is not the
B uh it's not like that bad it does have
it does allegedly have 200 Tera flops of
uh of fp16
without any uh I don't know how much
more this squid game energy drink I can
drink
um tastes like fake
sugar someone find that die shot
like the
breakdown so this is how everybody
thinks about this stuff with this
register tying because like I've seen
this in other kernels before too this is
how Tron thinks about it so like I don't
know if it's just the right way or it's
just how everyone thinks about it
[Music]
is there no launch pounds oh someone
metal
yeah way I
should you can insert this for the
driver I don't know where it
went and then we get errors and
interrupts so there's a chance we're
going to make a tiny box out of uh out
of
970s and then I'll buy some but first we
got to sell
these
uh we're going
to probably by the end of the year we're
going to have this stuff figured out and
we'll have our torch back in to a pretty
good point like what I will say about
this driver and what I will say about
buying a red box is it
stable uh it's not going to
crash and if you do find a crash uh in
our driver it's extremely simple and we
will fix it
immediately um and we actually have the
ability to fix it and we have the
ability to test whatever the fix is in
CI such that it won't happen again and
that's really more than can be said for
AMD um AMD demonstrated very clearly
when I would send them bugs that they
had absolutely no idea how to fix them
and what they would do is they would
just throw things at the wall uh until
something got fixed they flip Flags
around oh hey are the out
of the day I realized that there was no
hope was the day I got that thing back
that explained that the in order Q was
causing problems so they enabled the out
of order
que they got new AI optimized internal
test processes
oh great great there's AI optimized ones
now the driver still crashes I've still
seen the driver crash
plenty
[Music]
um whereas yeah I haven't really seen
the Am driver crash and if things do
crash uh we can fix
them yeah this is like Bank conflicts
and shit I'm doing the swizzling
slightly
wrong uh
yeah no I
know but we're getting there we're
getting there
and the the
the something I realized
uh like you're not going to have to use
tiny grad you're going to be able to get
this speed with P torch and torch
compile um there's a
$400 uh Bounty now if somebody can get
gbt fast outperforming with the Am
driver uh it shouldn't be
hard like it's it's faster already
uh if you use the r llama stuff
but a lot of that just comes out the Am
driver like hip graph is just not
fast this this is this this Bounty is
like easy for
$400 um cograph is actually pretty fast
it's not that fast Envy is faster than
cograph but like cograph is usably fast
um hip graph is
not I don't know like at what level
again a lot of the time it's just cargo
cult like AMD would just and you always
think it's G to get better you always
think it's going to get better and you
can look at the kind of stuff um Anish
is
tweeting and you can see why it won't
because what he's focused on and almost
everything he tweets is
applications this application right
there's that there's that uh antoniac
guy who's who's making uh the nanog GPT
trainer run fast on Mi 300X and you can
do this the problem is that isn't
actually useful to people who have
different
applications AMD talks about inference
their thing is inference inference
inference uh this is not a good business
to be in because the problem with
inference is everybody can spend a lot
of time coding their thing to fit on
whatever weird inference accelerator
they want right if you're going to be
running the same model a million times
sure put the software engineering
resources into coding it for the
absolute cheapest accelerator you can
buy and that's probably not going to be
AMD that's probably not even going to be
something that looks like a GPU that's
going to be some Ultra
quantized
uh you can
see this all happened five years ago
with Tesla um so Elon uh got pissed in
VI and to be fair and video went through
a rough period around
2017 and made the FSD chip
hello um it made the FSD
chip and the FSD chip is a INF chip and
if you're willing to code everything
it's totally fine the minute Elon tries
to make a training chip with Dojo it
pretty much fails you don't hear about
Dojo anymore because it failed because
he misunderstood what the problem was
the problem is not
can we make a chip that is amazing at
this set of
specifications that's true for inference
but that's not true for training it's
not true for research because
researchers aren't going to use it there
there's no it's totally worth spending
double the money to have the experience
that's
good uh so yeah inference is is not is
not a business uh and then the the
application Style
of sales is not a way to say sell AI
accelerators you have to build
robustness quick aside you guys want to
see check
out so this is our memus trainer this is
same memus trainer as always but the key
thing
now is that we can
see the
graph our visualizer has gotten good
enough um so not the first one because
the first one includes all the random
kernel init but this
one so these are all the kernels that
run for mest each of these green on is a
I show you the tensor graph tensor graph
is pretty cool so this is the this is
the tensor graph these are all the
tensors in a training step of amnest and
the fact that this like works and
loads
um so you can like see like this here's
a
convolution uh convolution weights
convolution input multiply
reduce uh this is a bias right we're
doing the bias here only on the channels
right so NCH
HW uh this is a relu we don't use max
for various
reasons um comp
whereare yeahh so you can see the
convolutions coming
down then we go over here we do the
backwards pass there's still a little
bit of slowdown here this is these
should be merged into one we we need two
reduces still to do a backwards comp um
these might be speed up things though so
some of the two reduces are because it's
faster do two reduces but again it's got
to be benchmarked uh yeah and then you
can come over here and this is the atom
Optimizer so this is this is
adom um here you can see like then it
updates those
uh those
numbers I know if that's learning r
this is picking the random
indices well that's because this wear
here is because some of them might be
out of
range we have the data put the data in
here do the first cve
oh that's the uh that's actually the
ground
truth this here is the ground truth and
up here is the
data can see where the ground truth
follow that Arrow see where it goes into
the uh loss function
here we also like put boxes around these
things to say what uh well if we look at
the kernel
graph which we can also I'm not sure
it's going to work for this one because
it's kind of big but we can look at how
the kernel graph gets formed so these
are all the different uh actual kernels
that run on the device before the top
this
order yeah we're making this work for
like really big models
too yeah you wish you had this type of
observability and everything use tiny
grad um
someone asked earlier what I think of
the deep seek open sourcing
stuff deep seek wrs infrastructure that
looks like a hedge
fund um
and what I'll say about this
is it's actually very
good so hedge funds because they're in
such a competitive space the stuff that
you like they're the smart people to do
it and somebody needs to rug pull all of
Finance in America so that the people in
America who are actually talented like I
don't know again but I just it's just
like the maybe it's an incentives
problem but if you choose to go work on
finance like what are you doing with
your life I don't know I mean may maybe
this does need to be enforced at the
government level and we just can't have
the smartest people in America
completely
wasting uh their time playing this
stupid zero Something game against other
people uh the file system let's take a
look at the DC f with them uh I think
ours will be better I think I think we
can I think we can do better
um with the uh with the with the with
the tiny grad
uh like again deep seeks infrastructure
is very good if you are targeting like
like a
use um it it looks like hedge fund
stuff uh
what is
this is this
good it's very complicated
Apple
Rus I never use
this all right so they they they put
their metadata in
uh no but like imagine instead of all
the people wasting their lives at hedge
funds they rote AI infrastructure
instead
this is all stuff I don't
know yeah with split metadata in chunk I
mean uh
mini value does
that I I I also wrote a I wrote a
distributed file system uh it's a lot
less
sophisticated um it works at comma and
the only reason it really works at comma
is
because uh like this we don't do any
chunking um it's fine the way like data
being missing is also like if we lose
like a route it's not a big
deal uh uh so you know it's just this is
very simple this looks a lot more
complicated but it's interesting that
they're using it for like one of the
most interesting things to come out of
the deep seek thing is they explain what
they're doing with uh key
value none of the none of the other like
opening anthropic you don't really know
what they're doing with the key Value
Store it looks like they actually write
the key value SES to dis
which just like
crazy like they're sinking them out to
dis and then also what does it do we
know what ssds they're using did they
ever talk about this
h
oh they're 14 terab I know what they are
then they're the
Samsung's
no oh there like the you know the aren't
they well they're not 14 they're like 14
point they're probably
these I got the PCI 5 ones
yeah it's this so I don't know why they
say 14 that'd be my
guess whoa they're eight wide now
these are new actually I mean it's
probably the last gen but it's like this
is this is what we use these a comma our
older our older stuff is tons of
uh our older stuff is tons of
uh that's crazy
where do you see the thing about
16 on the read me 3fs
I'm very happy that they uh that they
own sources like it's it's it's great
to what I hope one of the things that
really pissed me off in self-driving
cars too was that every company acted
like they had some big
secrets and they didn't uh we know they
didn't because most of these companies
are worth zero now
uh they most of these companies burned
through billions of dollars and
um all
right so
again I can't remember when medium
rugged us all there was
another so you got to you know find the
one that what doesn't rank as high in
Google broken
SEO um in
2019 when they are shut down the
employees will attempt to be absorbed
into
GM
so all of these
companies had the same fake
secrets and they
all
uh they were
wrong it's so nice to have and it takes
you know takes a Chinese company to do
it which it's another whole why isn't
this in
America what what
happened America is the all this shit
came from America all this
AI comes from
America what's wrong in America that
nobody can build infrastructure like
nobody can build trains it's the same
problem it's not as good I I this is
almost
always if you
see uh somebody open
[Music]
sourcing there was just a Intel guy was
posting that they won't open source
gouty because of Ip reasons they won't
open source the or legal reasons this is
never really the reason the reason is
usually that thean is embarrassed about
how bad the shit is that's why AMD
doesn't open source their firmware
notice how they never open source their
mess firmware they told me they were
going to they never
did um and it's because it's
embarrassingly bad almost always why
things don't get open sourced it's not
because it's just like well who's going
to put in the time to clean them up
because the infrastructure is bad this
is the best infrastructure in the world
and it's so great that we get to see it
uh and now nobody can sit around and and
oh open AI has all this great secret
like no they don't they're losing tons
of money look at the price difference
between deep seek and open API open
AI why is this so much cheaper um also
meta for llama 4 I really hope you're
making a uh mixture
experts I'm I'm surprised that so
mixture of experts is way better if
you're running bat size one for larger
bat sizes it's a lot less important but
still they're they're they're crushing
it with it so I really hope Lambo four
is going to be a big mixture of experts
model um because with a big mixture of
experts model you can beat deep seek I
know we need to get our support better
yeah um we need to improve our M of
expert support and then one of these
days one of these days we'll write the
thing that uh multi-threaded CPUs what
you really want to write for
multi-threaded CPUs is like a runtime
dispatcher that looks a lot like uh a
GPU
yeah for
so this is just using and we use this
too right this is the
same like it's uring stuff
right we actually have we have support
for this in tiny gr our our speed is
pretty good you guys can see it so every
Tiny Box comes with a fourway raid
yeah so this is like load a whole llama
in that's decent we're 11 gigabytes per
second from our disc array uh
to uh to the GPU but we should be able
to double that I don't know why it's not
double I asked about that
uh it's I ring in user space because
their FS is in user space but yeah I
mean it's it's still got to be passing
it to I ring and the colonel though
right it's not like it can be anywhere
else
so kind of
the
improvements uh that I want to
make like this is still
basically uh generic key value store I
want everything to be hashed based on uh
like I want everything to be a like a
like a hash face look up I want the key
of everything to always be the
hash
um and it's still just like it looks
complicated I have to set up this
complicated database I don't know like
it's not
enough scale I think to require those
things
uh there's a great section by an
anthropic engineer Twitter on a single
machine um it's it's a cool uh talk to
this guy at a party once uh we talked
about this
uh he uh so it it's it says basically
like can you fit Twitter on uh yeah one
of their design requirements was have a
pretty standard FS API I have no
interest in doing that uh I want is to
just
be basically hugging
face like what is hugging face
uh so we can like load any model and be
able to cash KV
KV uh key value stores to be fair yeah
sure we're going to have to uh you know
hash them but it should be fast we
should able to get we should be able to
get some cryptographic hash function
that can run a GPU memory speed and then
I'm totally fine with just doing that
that's not much overhead to go to a
desk um we pick some block size we'll
hash them all blocks use marle trees be
good e
we only have to write this stuff
once we should definitely understand
this like fully before we build a file
system this is a reason they built
one uh so yeah I mean we built one for
comma it's much
simpler though it's never the
bottleneck uh We've it's it's it's
single machine right like it's it's but
it's not used hot like
this um yeah it seems like their data
center just like isn't all that
big they're talking in this read me
about the cluster consists of 180
storage
notes what's the size of this
it's 2.5 pedabytes this this whole thing
is like the same size as comm's
cluster don't no hang on there got to be
something oh I forgot it's 16 okay
that's bigger 40 pyes okay so it it is
about five times the size of comm's
cluster am we going to get to this sign
that going to cost
me she drives I'm sure it's these
drives this
one
fast why does that need eight it doesn't
need eight four is fine is that
speed or should be
fine is
it no okay it's like barely not
fine yeah
oh Twitter had some good
engineering yeah Twitter in 2014 2015
had great engineering you didn't see
what happened to it over the next eight
years what are these drives going to
cost
me is that a real price
too bad
actually
rip
what the same
price look like though
J four no this is the right Drive
what I still think these are the ones
they're using try to work it out
so okay their aggregate read across the
cluster
is 6.6 terabytes a
second
so that's 36 gigabit
per
gigabit so 300 293 gab each has
16 drive so that's 18 gab of
driver yeah so it could very well be the
uh yeah it's 2.3 gigabytes per second
ter gigabytes per second per drive so
it's probably these drives
it's a reasonable price for that many
pay bites doable
500 client nodes we
used I mean this is kind of interesting
in of itself they actually use separate
computers for storage
nodes uh so I don't really want to do
that I want to use the same
computers I want to just put a little
storage on each computer
don't have to pay for all the extra
networking cards and switches and stuff
just use PC switches
computers then imagine like imagine each
rate array in a tiny box like imagine
each 4 terab rate array in a tiny
box uh being like a chunk of
memory I guess
even I mean you could go even further
and like why is the raid
don't even want to use a
raid don't kill your eyos just just like
every Drive is just a
thing um every Drive is just like a
little bit of chunk of
memory you know there's a mode on the
Epic processors which can like segment
your memory per
CCD which is like you got get crazy
there with the you guys know what Numa
stands for
um yeah we doing a
right that's a that's an acceptable
speed it slow this
time nonuniform memory access
yeah it's when you got little bits of
memory stuck everywhere making like
making Numa work memory abstractions are
so much of like getting this stuff to be
good all right back to
this so I think we were actually doing
the right
stuff um one of the things we can do
we want to permute them
all for
yeah this needs more
thinking let's go back to
the I think we actually did do this and
I don't think we're doing anything wrong
we don't have this double buffering
either
oh then that's another
hole do that
we really just kind of need to
support that optin
beam that's the right way to do this
Amanda's going to be home from Temple
and then we're going to go get dinner
because I'm hungry all I ate today was a
squid game energy drink and yogurt and
strawberries so I think the project
probably here is not to keep doing
this
like it's no I mean it's
it's there's just so many choices about
how to do do
this many of these things can be
permuted in many different ways and I
can sit here and I could manually write
out all sorts of things or we can figure
out what the core things are and figure
out how to put them in
Search and that's probably the right way
to approach this and probably the right
way to approach that is refactoring the
tensor core
stuff uh the tensor core stuff right now
is still this bespoke
is this bespoke code uh it looks
like it looks like uh tcal 3 is
broken okay this logic's
basically here
this has been refactored pretty
nicely but it's still not totally there
yet
it's another annoying thing like this
whole fix up a function needs to be
rethought all these hacks for group for
reduces which is again doing stuff with
the
locals this function needs to be
Rewritten
and needs to be thought about what we
actually mean when we talk about locals
and local
memory
there's
like almost completely separate things
happening here where we're doing load
and
Stores um from a chunk of memory that is
then used later on but as long as we
permute these load and stores
uh equally and we don't go into the axes
that
are that's not really
right you want these axes to be
full so I'm putting that over there you
want because you get this many
threads and that's you can think about
this load to store move like that many
threads just going like boom
um and then you can see it's upcast at
four here which is why you get that
four here okay the the other bigger
problem with it why is my load coalescer
not working this shit should be
coales so should
this why is this order not correct why
is this one down
here that's doing that on both of them
now I that's a known problem too but no
this should just be this should be load
coales and
fixed uh we have this extra thread group
barrier there's so much to just deal
with here there's so many like like
inefficiencies in this kernel before we
even try to do anything more complex we
have to be able to generate all the
kernels that look like this highly
reliably This Thread group barrier needs
to go this one should be up there they
should be ordered more
appropriately uh these should be
coales into
chunks
yeah yeah the dev vectorizer the dev
vectorizer needs to be fixed next week
we fix the dev vectorizer I've planning
it for a while it is time for the D
vectorizer to be fixed
should also get rid of
this like why does it have the
word temp
here do someone want to do that refactor
they should not have the word temp can
you just give it an ARG the same way we
do the ARG for Define uh
Global and even that is an argument that
it could be a unique op no no it's not a
uni op uni op are globally unique but
yeah could someone get rid of the word
temp from
that and make it the same as the
globals all right so let's write a big
list of to those
[Music]
grouping I don't know how to spell
calling
I need the new Dev vectorizer anyway the
big thing I've been working on is Tiny
Corp got a
contract uh to make the Qualcomm DSP
fast so I've been working on that uh the
Qualcomm DSP
represents so the qualcom DSP gpus are
simt machines uh the qualcom DSP is a
simd
machine um it's probably weird when I
look over there I not why am I even
looking over there I can just move this
stuff
here uh the
GPU is simt machine the DSP is a simd
machine which makes it harder to use for
a whole variety of
reasons uh it's good but it's good that
we have to support those also it's a
very
wide
uh one
hour an hour
long I don't know if I can wait should
we wait for Amanda for dinner or should
we go
eat let we'll let we let
N single instruction multiple
thread an
hour don't do
it all
right chat
says I should
wait thank you thank
you um
okay fix load
grouping
uh fix
extra
barrier uh remove need for extra barrier
uh
fix load order to be in
order1 is
last it's good that we fixed that bug
today by inserting that barrier
here because if it's a loop if it's a
loop and youing barrier if it's a loop
and you use barrier inside the loop
you're going to have to so I'll get that
merged so good we fix the good bug
today um
yeah like these need to be
[Music]
grouped it's definitely a line that's
not the
problem why or not whatever I'm
rewriting all that code anyway I hate
that
theorizer uh remove extra
bar probably want to just like insert
them but doesn't have to
be like they don't have to be the same
you don't know that until you're linear
mizing do you want to do that one now I
can probably do that one
now uh fix load order to be in order the
one zero is last that's
fine um
[Music]
that problem still exists there okay
good uh yeah it's a lot easier to like
see here but actually these aren't you
can't group those anymore
instructions broadcast to multiple
course I mean that's what gpus are gpus
are simt machines oh
also I don't know if there's a way on
metal but
this see if we can find out if there's
way on metal because that'd be a cool
abstraction to add
um explore
fast
Global uh Global load to local
store what this is is like yeah you're
loading from this Global and you're
store to that
local
um
wait no no no what happened here guys we
lost a
few this can't be
real what happened
what no no I can't be
right oh CU a strides oh
yo oh I don't want St
there there we go all right look it's
less terrible
write
syntactic uh
Y is tcal
broken
for streaming
sugar for these local conditions
plus use it
in uh tensor core
kelp oh we got we're got a lot of
viewers now we got 737 viewers all right
I guess we got to keep going then keep
going we'll keep going till uh till gets
[Music]
home all right we got viewers let's go
squid game energy drink squid game
energy
drink oh that shit gets nastier every
sip I thought it was only nasty for the
first sip
oh yo imagine watching squid game energy
drink imagine watching squid game while
you drinking squid game energy
drinks um
all
right extra
barrier right Sy tactic sugar what else
what else we
got yeah yeah we can save AMD for big
BBA yeah yeah that's good that's good
all right let's see if we can get rid of
that extra barrier let's take a look
since we got a lot of viewers I think
that's a good time to use viz oh we
fixed that viz bug today too in the
stupid on HTTP
server
um all right so this is like a
representation of that Colonel and you
can
watch what is it
doing where are those
blocks she says hi
all right so we're we're getting the
loads and stores in here um let's see if
what it looks like here
okay so we have two barriers
there oh this one like
not why I two barriers like that
huh wa
what what's going on is that a viz
buug it's got to be a viz buug
am I making copies of them that's
annoying see the VIS
bu are some of them not coules
all tles
why is that
like
oh actually that might not be a viz
bug that might be something that
actually happens okay here we go so yeah
they're both valid topos
sorts this is like a valid way to write
this to and it's interesting that the
barriers are next to each
other
um so we have a bunch of like choices
which tiny grad makes now that this is
not a v buug actually that's real
um I have this thing called block
reorder and that's where block reorder
runs so you can look at this this is
what it looks like nonblock reordered it
almost looks
better we need to figure out what's
going on to make it go the other
way we should always Place barriers as
soon as possible I
think so this might just be fixable by
and we could do what's called peole
optimization yeah I studied compilers in
school
[Music]
uh no that's not a good choice
last last the right
place last is the
same R first is that still correct
didn't
complain uh yes that's St temp on okay
we definitely don't want to do
that let's try
this so the order of these determine the
uh top of Sword order
no
um
junk this also loads too actually so
that's the problem
yeah that's the problem
um yes that's what happens if we want to
render the barrier as soon as possible
if we want to wait as long as possible
to render the barrier we get the other
thing we could combine them earlier into
one barrier that's an
option there's no real I mean there's no
real reason that there one
barrier it's not until we're linearizing
that we start to do
this okay there one barrier
there
[Music]
uh we could make barriers special in the
linearizer
do we want to
be the linearizer is like what puts all
the things in
order and then we have this extra
function which reorders the block
which is where a lot of those bugs are
this thing
sucks put loads in the middle of the
beginning of the block and
prevent priority
inversion we could just delete one of
those I'm not happy about this
I feel like we can't merge the barriers
because if we merge the barriers it's
like you can't do
that the parents
[Music]
let's think about do whatever we
want by the way this linearizer is a lot
nicer than what used to be here for the
linearizer so you know be grateful it
could be
worse so this is the old order
the old order actually looks pretty
good we can't really fuse the barriers
there no actually that's not really what
we want to do we want to dispatch all
the loads
early the way I do this in rdna is I
having new RS and issued Loop over old
Ops aen to new
Ops yeah
yeah I don't know about
that
um I think this is
D3 no it's definitely not yeah it's dag
gr
D3 it's definitely not what definitely
not writing a graphly out Library
someone's written good ones I mean this
is the performance of this is impressive
the performance of JavaScript in general
is
impressive uh no there are some bugs in
viz
sometimes depending on like how it
stores the uops but I think most of them
are fixed now so this is not a viz
problem we reorder the
things yeah I mean this is definitely
better than the old line Riser
but yeah okay so
this
barrier can technically go there we
definitely want to place barriers as
late as possible but not after global
loads all right I can Rite some stupid
hack for it
okay
change
nothing change
nothing I want to put them before the
load we have to make it more
negative
oh I do what I
want there we go
yeah okay so those things depend on the
barrier okay we have the priority
inversion thing all right that makes a
lot of sense cool uh so that's
fixed
now what is that working that
doesn't uh we can do a people Optimizer
too that's pretty easy
uh replace pairs of barrier with one
barrier for
[Music]
[Music]
oh it always has lamp there check
[Music]
uh what I
do why that actually broke
anything uh
is that wrong
[Music]
Tye object has no argument
CTX oh don't use a it's stupid that I
use x i shouldn't use
x
fine okay one barrier is it any faster
look
slower great work team
oh no we're just
on
okay all
right
done why is that one showing up last and
yet that one shows up
first that's interesting
so that topos sort function is nice
whereas in all sort order should be
valid um I don't understand though
why sometime that's
less oh because that's that
and
this is a
shift all right let's just throw in you
ready for a hack I know how to write a
hack for
this um
with my minus a th000
that
for
in
okay
what that makes sense it's a load all
load should have two
what how was that
wrong not a oh it's in index I forgot
it's
index it's probably wrong sometimes I
hate this
bullshit
oh totally
wrong
what
um now see we want to make that index
higher
peniz those
[Music]
Index this going to be overloaded by the
load priority
whatever that's a pain to fix what the
go there why is that one there and that
one there
[Music]
like a Max of the
index
true is it
true oh
that true
object is not call
go
there like you see the problem it should
be plus Z but there isn't a plus
Z this one ORD earlier because it's a
special op oh maybe I just put
shift this is crap
that fixes it all right that's
easy put at
last move down
there as us really an easy fix if you
think about these
things down there with it's friend
sub
yeah who have thought that would
matter all right good look they're in
order now
[Music]
it's after like mes and stuff too none
of that stuff should ever do indexing so
just do the ad last and that's
fine yeah that's pretty right that's
what it should look
like I don't know if it's any faster but
it looks more beautiful I'm a big fan of
that I think it's really important that
things look beautiful
priorities have to be outsourced to
renderer groups I don't know about
that we're not add any of that fancy
stuff yet um I'm just trying to get like
LDS stuff
working oh let's explore the acing stuff
that this is a Monday
project all week next week I just got to
work on the decorizer I can't work on
the torch back
end just go to I just got to fix
that
um should we look into why TC3 is broken
yeah we probably
should this one's going to crash Apple's
driver crashes sometimes by the way
oh come on how how nice is this Nvidia
driver this AMD
driver oh
beautiful 12 gigabytes per
second not
24 that's copying by the way that's
copying 16 gigabytes off the dis
uh no you want to use a fast kernel you
go to write fast equals
one if we just do that it should be the
fast
kernel yeah that's fast look at that 40
gigaflops 40 Tera flops even 43 Tera
flops so yeah that's the fast
kernel um this is not the fast
konel hello we're on stream if you want
to say
hi hi to is B are they here they're all
here we got 708 people wow I had the
craziest day wow wow meditation seems
exhausting it was so fun not up your
alley but definitely up mine
oh silence the whole time yeah see seem
out of breath I ran up the steps oh the
steps are pretty
exhausting um that's not live you want
to see the live
one oh
wow they don't want to hear about the
temple they like my haircut so you know
that makes want to
oh look what we
drank oh yeah the squid game energy
drink was it good that's it some energy
drinks are nasty on the first Sip and
get better as you drink it this is gross
I would have to say that don't take my
squid game energy drink you can have it
um I would have to say that this one was
the opposite yeah it's tastes like
sugary bubble gum
all
right
um I'm hungry yeah I I know yeah we'll
go eat food we can go get food I I had
to make myself lunch it was very hard
thank you for telling him to wait for me
I appreciate it you think they're over
there but they're not I know I'm just
reading the chat I know I know it's a
problem so I used to use that camera we
can bring the chat over here I used to
use that camera and it kind of made
sense
let's see what they say um they think
you're pretty that's so nice of them
I I didn't say any words all
day wow Noble silence Wow have you heard
of the noble silence you wouldn't like
it there I said a lot of words today
yeah I was in silence all day yeah um
and then we did an eating meditation and
you're supposed to chew your food until
it's
liquid which interesting it took like
two hours to eat lunch you would hate it
I'm just imagining all the wear on your
teeth but we um we hiked up to the big
bu down which was cool are you a spy I
think you're a spy for which agency yeah
which you thinking you
thinking mad
maybe talking what country America five
eyes she works for what's the what's the
one in England at least I don't work for
the Canadian one wait mean the Royal
Canadian mountain police are very
legitimate I just want to I just want to
work for a really competent one where
everyone's like super high quality
fashion models
agency that's
nice how does it feel to dat oh that's a
question for you that's where we're
going how do you
feel unawares the thing about spies is
you have to ask how far you can throw
them like sometimes remember that time
the US was going to connect cable with
Hong Kong but then they canel the cable
because the people were going to steal
the data but in reality you think
Facebook and Google are going to sponsor
a cable where the data goes that way no
the data goes that way and spies can be
dealt with in the same way how am I
going to be dealt with
oh just just the other way it's like
it's like remember that time so you're
getting the information remember the
time that that in Futures End when Henry
Starling when they their voyagers trying
to Uplink his communication database and
he reverses the Uplink and he's like oh
oh you're only from the 24th century and
all this time I thought you were from
the
29th I'm going to eat food
uh thank you for watching my stream
today
everybody bye nice to see you guys again
bye
WEBVTT
Kind: captions
Language: en
behargaming: sup
rkxbz: hi
00warl0k00: hello big fan of you
LlNUX: &lt;3
Protoxus: Hello :)
st47ik: Hi George VoHiYo
foxubu: Nooo RegEx 🙈🙈🙈
st47ik: Hi Chat
st47ik: Regex PogChamp
lefse: REEEEEEEEEEEgex
m1k1b_: hi
Protoxus: RegEx is nice
LlNUX: shit i pronounce it wrong too
WinterLabyrinth: Hello
speeddrawing101: YEEEEEEESSSSS
iagia: sup nerds
malg0d: Green tea
felixth7: whas up
halldorvalberg: SeemsGood
aa_ato: NoFrindDoDay:
QuantumComputingMIT: First
FaustPetrovich: hey
malg0d: No quantum here
lefse: No matter how you pronouce it, it does the same job Kappa
lasercatboss: lasercatboss subscribed with Twitch Prime. They've subscribed for 2 months! why
malg0d: I'm a l33t god that codes dank regex magic
LlNUX: stackoverflow does my regex for me most the time
FaustPetrovich: FaustPetrovich subscribed at Tier 1.
haircutjimmy: Afternoon @georgehotz. Regex, hey? Glutton for punishment!
loaffy_: i hate regex
virgoshlok: Hi
krakendmp: hi
blakeswelt: !uptime
eax_ebx: Привет.
szalalala: Hi @georgehotz !
johnny_thehobo: is this how we hack nasa?
jsanxez: it is
haircutjimmy: regex101.com
Shahin8520: i guess you forget newline character?
Protoxus:  1 @haircutjimmy
f_karamazov: Ex &gt; regex
macrib02: is it to easy?
m1k1b_: try to put 4 dots in the beggining, maybe that is the problem
erk4sh: hello, in which country are you
jsanxez: I want to learn to hack :/
foxubu: We need AI to automatically generate the RegEx :D
f_karamazov: Why do you need the $
Vilebiscuit: Hello, I am planning on starting learning machine learning. what do you guys propose I do first
itsChoudhry: @Vilebiscuit predict something
marsroger44: whats up boys
marsroger44: what are we doing today
awesomeo113: @vilebiscuit udemy probably isn’t a bad resource
Vilebiscuit: maybe udacity?
krakendmp: datacamp is ok
hmnvdota: they should know you know regex
itsChoudhry: @Vilebiscuit Do you care about the Math or just application using prebuilt algorithms?
coProof: Yay not coq thing
litesam: That guy from destroyallsoftware has made https://www.executeprogram.com/ which is a good source to learn RegEx
dawgwhisper007: stupid is as stupid does
hmnvdota: @litesam wat guy?
litesam: Gary Bernhardt
Avelansh: anyone remmber 'Wat' video from destroyallsoftware
alexlucas_: yo
alexlucas_: alexlucas_ subscribed with Twitch Prime. They've subscribed for 3 months!
litesam: I thing first 30 days is free
iyilik: Hi I love you
haircutjimmy: regex101.com @georgehotz !
Vilebiscuit: @itsChoudhry No I care about math too
forkdb: Hello George
winnyXE: maybe its а not a
coProof: payoDance
forkdb: I might become your sub, once, I get my new debit card...
cccnrd: someone knows a thing like hack.hands?
forkdb: Am glad you are back online on twitch
SlaterUSA: all answers are, in the end, wrong.
SlaterUSA: /deep
alreye: sup buddy. Emacs user here :)
hmnvdota: TTours
yoyo_brobro: doctorHEART doctorHEART doctorHEART
Protoxus: @slaterusa Then that answer is wrong too. Congratulations, you just created a paradox.
sa7b: LesbianPride
foxubu: Is that NoScript in his Chrome? :o
coProof: Truuuuu
ImJ4Gu4R: halo halo halo
itsChoudhry: @Vilebiscuit Then the road is a little longer, but the bare minimum is Andrew ng machine learning course. For the math then just look up frameworks on how to applly the theory you learn't in the course, but I also used umdey and books to learn about where to apply what and where what algorithm make sense and how to work out which one to use
herrmuckelmann: can you move the window to the right a bit?
LeadCoder: im coming for you george
Bombapil0t: MrDestructoid
herrmuckelmann: the cam is blocking stuff
BryanSWAGBEAST: we cant see
Shahin8520: can you put the browser a little bit to the right, so we can see it ? thakns
alreye: What's a good resource to stay up today with computer science news?
Protoxus: ^
ImJ4Gu4R: yea, pls adjust that cam
Santiago_LHC: Regex Sunday! Yay
ImJ4Gu4R: Ahh regex cam
coProof: Slow down and pay attention to us!
BryanSWAGBEAST: Adjust Cam bro!
Bombapil0t: yikes
Protoxus: @alreye Not sure, but I use Ars Digita
ImJ4Gu4R: slow down brah, cam pls
unknown_elemen: how is evry one doing
krakendmp: move the windows pls
BryanSWAGBEAST: lmao @georgehotz fix cam
Santiago_LHC: Why should he move to windows
Protoxus: @santiago_lhc Because we can't see the terminal he's typing in
krakendmp: yeah
Santiago_LHC: Ah, THE window, I thought the OS
ImJ4Gu4R: maybe he means window is cam
coProof: Yeah move to the boot amp partition on your Mac lol
alreye: @Protoxus Doesn't appear on google. What's the website?
data_day_life: Jebaited
BryanSWAGBEAST: fix cam
ImJ4Gu4R: Alright, so i can continue my sub
BryanSWAGBEAST: lmao nobody could stop him
rupan3: do you want to be a webdev?
Protoxus: @alreye Oh sorry, I remembered wrong, it's Ars Technica
alreye: @Protoxus thanks
syska: [a-z]
StupidGladiator: @rupan3 you have to be crazy to go from the world of machin learning and mathematics to the world of web, so boring ResidentSleeper
Protoxus: @alreye You're welcome :)
Santiago_LHC: Gotta know some Regex though
rupan3: StupidGladiator hehe
ImJ4Gu4R: Does anyone know how to do picture in picture in twitch?
0verclass: hi legendary hacker
ckk0t0: Increase font. I’m blind
鼻史: genius
ckk0t0: Please
Vilebiscuit: @itsChoudhry Thanks a lot man
Julianhgg: my idol
ckk0t0: Cool man. Thanks
Santiago_LHC: Detecting links is hard
frediiiez: can you zoom the browser a bit?
crazywulf770: oh nice i love regex what is he doin?
Santiago_LHC: Learning, apparently
Bacon4Life_: is this a 4k monitor?
frediiiez: noooo
gseven_: 5k i think
Santiago_LHC: 78k
Bacon4Life_: holy shit
ckk0t0: Now i can’t read it.
gseven_: its LG ultrafine 5k i think
ㄱ_니은: crawling lesson
crazywulf770: i can recommend https://rubular.com/ its my favourite to prepare regex
Avelansh: crawling web 101
Satanicus7: hows your keyboard doing man?
ImJ4Gu4R: Picture in picture mode, type on your web console. document.querySelector("div.highwind-video-player &gt; div &gt; video").requestPictureInPicture()
arxenixOW: regexr.com is the best imo
swagettiyolonaise69: no cock today ?
litesam: Why George is not in Twitter?
Bacon4Life_: monkaS
supnerdstv: do i get mod if i say i like the keyboard?
rupan3: what keyboard?
Plurmorant: @litesam twitter is worse than heroin
Bombapil0t: follow him on instagram @litesam
3310: StupidGladiator , Regex is only for the web ... Pepega
Santiago_LHC: Keyboard talk gets you banned
GustaveTXC: hi
alreye: @georgehotz We want to see you do these challenges in C
Protoxus: @arxenixow That's the one I use too
speeddrawing101: yea shut up Charlie lol
ImJ4Gu4R: Dark mode anyone?
ImJ4Gu4R: My eyes is burning
foxubu: @litesam He is but he does not use it @realGoergeHotz
syska: wat s keyborad
Bogz75: use regexr website for regex help
ckk0t0: Dark mode make it better. Can’t see shit
krakendmp: a keyboard called borad
shutchie: @georgehotz line 3 error
Shahin8520: because you didnt close the parentesis above in re.compile
Santiago_LHC: He tried Dark mode in another stream, didn't like it.
zthreee: Line 3
litesam: In JavaScript you have String.match() which will all the matches in a array
GustaveTXC: what programming language is?
Bombapil0t: i didn't see the tea once today?
Shahin8520: line 3 re.compile parenthesis
zthreee: Line 3 missing closing )
shutchie: @georgehotz on match line. Line 3 dude
zthreee: SeemsGood
GustaveTXC: VoHiYo
Attlantiz_: what are you doing today george? learning regex?
jellyjar: got called out for not knowing regex at work, or here?
Attlantiz_: CoolStoryBob
GustaveTXC: Squid1 Squid2 Squid3 Squid4
serohh: Regex is sooo boring
Bacon4Life_: PogChamp
Avraewyn: EZ Clap
Attlantiz_: regex is gud and useful
litesam: Use https://regexper.com/ which will show the Regular Expression in an State diagram
alreye: @georgehotz We want to see you do these challenges in C
crazywulf770: &lt;3 gogogo &lt;3 regex &lt;3
HopZe: True
Attlantiz_: lmao st peterson
Shahin8520: True
HopZe: St peterson?
Bombapil0t: never thought that way
Attlantiz_: The man himself, st peterson
rupan3: saint peter you heahtnes
abk467: can't argue with that
C4TFive: im just gunna go to hell
sausainismilka: what is the color of your keyboard? LUL Kappa
fghoekstra79: i would love to see you take an IQ test on here imGlitch
dr_koili: Stan Peterson
Attlantiz_: cant argue with st peterson
dr_cashews: st peters son
rupan3: what switches?
Shahin8520: .
Attlantiz_: no keyboard questions ffs
GustaveTXC: Squid1 Squid2 Squid3 Squid2 Squid4
0verclass: only i can see is 'welcome to the dark side!' lol
litesam: See the power of https://regexper.com/ ya'll gonna love it!
visudo20179c: so what is geohot doing today
0verclass: thanks @litesam
Attlantiz_: learning regex
Santiago_LHC: Well done
visudo20179c: good job George
GustaveTXC: PowerUpR SabaPing PowerUpL
Bacon4Life_: 200 iq
sausainismilka: one mistake can mean a lot.
crazywulf770: nice to have a stream where i understand what he is doing :-D
Attlantiz_: Kappa
Attlantiz_: true
frediiiez: have you seen Mr. Robot?
fghoekstra79: i think his IQ is high. would love to see him solve those problems
Iliftmymousealot: in my fourth semester compiler construction exam I had to write a jflex and antlr rule to match Letter Salutations I still have ptsd because of that exam question
forkdb: How can you practice when you feel really sad because you are not able to solve problems?! ... please explain
Zabak378: dont you need double / ?
mltsd: @forkdb coffee :P
Santiago_LHC: "Stop being a n00b" - George Hotz, 2019
Bacon4Life_: just exercise 4Head
Harm133: LUL
visudo20179c: if at first you don't succeed, try again
forkdb: Ok thanks
frediiiez: LUL
visudo20179c: while noob do end
saurabhshinde: c   or python ?? for competitive coding ??
cerrad1234: python
cerrad1234: cython
Santiago_LHC: competitive coding of what?
Luccaasss: JAVASCRIPT
sausainismilka: if you not noob you can solve this
crazywulf770: maybe its too greedy try .*?
sausainismilka: hacker rank:N00B
visudo20179c: true coders don't need to compete
sausainismilka: just kidding
0verclass: both are good at solve problem i think
lostshiya: Hong Kong is on edge, university slaughter can happen https://twitter.com/nathanlawkc/status/1196099979854712832
Luccaasss: c   is the best
cerrad1234: just make an ai for solving these problems?
MatiGoG: ?gnisu eh si draobyek tahw
litesam: Beers - Front Bottoms
balzak43: the r prefix denotes a raw string btw
grizvok: @cerrad1234 yeah that's totally trivial!
Santiago_LHC: @lostshiya I very much doubt it could happen.
Harm133: why dont you use dark mode
balzak43: means you can use the backslash without escaping it
balzak43: so  instead of \
0verclass: dance time
zoki_macola: pee time
sausainismilka: that walk tho
Bombapil0t: pee &amp; tea
Santiago_LHC: He don't like dark mode on hackerrank
krakendmp: :D
Luccaasss: because he is of the light
kanogger: lolll
mltsd: @MatiGoG gnihtemos ro draobyek rekcah ekil gnihtemos
Bombapil0t: sony said so @Luccaasss
forkdb: Can anyone answer... how is he so good at coding?!
kerlanT: that runescape related video e.e
mltsd: @forkdb i think hes been coding a while
litesam: @forkdb Practice
kanogger: @forkdb he started when he was 3 years old and his brain is twice as big as a normal human
jrrbls: He drinks 4 liters of green tea a day
jrrbls: That's the secret
jrrbls: And mate
oMythra: Whats up Georgey boi
forkdb: Haha
Iliftmymousealot: green tea or ice coffee?
crazywulf770: jrrbls good idea i need more green tea :-D
mltsd: does anyone know how many teabags of black tea are safe to drink per day? Trying to quit coffee
litesam: Where is your old mini-piano?
kanogger: @mltsd try adderal it's healthier
forkdb: I do not think it is because of tea...
kanogger: Kappa
forkdb: It is a gift!!
mltsd: @kanogger too expensive :P
johnny_thehobo: geo you dont know me but i love you buddy
johnny_thehobo: remember that
cakalbaris: regex101.com make it easier
jrrbls: weirdo
litesam: Where is your Piano?
crystoobaal: !uptime
forkdb: I feel sad when he runs tests and few fail.. I feel likewise when I practice on hackerank
midnightbytes: hello just found out about you.Awesome work. i m very happy that you stream
data_day_life: regex101 . com
BlLL: are you living in a tiny house?
PushUpek84: regex101 ;]
data_day_life: you'll prob like it better
FargioFarmani: do you code every day? @georgehotz
nautzz: regex101 is quite a bit better
jellyjar: regex101 is the best
BlLL: PogChamp
TM876: LUL
cakalbaris: i was told you dude
Rekkeno: regexbeast lul
crazywulf770: https://rubular.com/r/9g4DryZ55MGw2S
GGGrimmy: Can't wait until he figures out that regex is different in literally every language
GGGrimmy: :D
MDK1980: I have no fucking idea what's going on D:
data_day_life: @MDK1980 we matching generic patterns in strings
scorpiocyborg: for one time I understand what he is doing :p
grizvok: @MDK1980 regex...nothing crazyt
MDK1980: @data_day_life I've literally never coded a single second before. But have to say, this is mesmerizing...
nautzz: (?=) is the way to do it
litesam: If you complete this HackerRank play a song in Piano!!
nautzz: need to make a non capturing group
crazywulf770: @georgehotz .* star is greedy you it matches the string until the last situation where the regex would match... if you do .*? it matches until the first match
data_day_life: @MDK1980 in this case, it's similar to scraping a webpage and extracting (called capturing in regex) links in the html source
GGGrimmy: @georgehotz python has support for non-greedy "star" match also
crazywulf770: no just add a ?
Zheikk3: Can you talk about your time at CMU ? Thinking about going there next year
nesbyy1: PogChamp
cakalbaris: &lt;a href="(.*?)"&gt;(.*?)&lt;/a&gt; isnt work ?
Nryqt: heya
不好意思: Pog
forkdb: Apparently, this is not as easy as hacking... just kidding...
nesbyy1: ^ do*
litesam: Play Piano after completing this challenge.
iammrrob0t: Cheer100
dorkmo: Party1
Jadess: @georgehotz how long till we get level 5 autonomous vehicles on roads
anguscupcake: Why do you use a Mac?
Zheikk3: @Jadess not in our lifetime
okurcozer: Hey george
Jadess: @zheikk3 my prof says the same. I'm triggered
forkdb: So... what do you do to unwind?!
YouPowerRush: ayy lamo
Santiago_LHC: @anguscupcake why not?
quelsarprime: what is the blue window. I can't read it.
anguscupcake: @Santiago_LHC can't upgrade them
Santiago_LHC: @anguscupcake to what?
MuscleMario: What's happenin?
forkdb: Yes.. exactly.. this is why I keep loosing my hackos all the ti,e....
Abo7atm: WHAT! How long has he been live?
data_day_life: / srpski ?
forkdb: Why does he keep his index finger on his forehead... ?!
yamchah2: !uptime
gseven_: !uptime
MuscleMario: Anyone here been at QCon?
Abo7atm: !uptime
data_day_life: @forkdb channeling that third eye energy
Santiago_LHC: @anguscupcake What do you need hardware upgrades for on a computer for coding?
anguscupcake: can't upgrade any component without paying Apple $200 for 16gb of ram
Zheikk3: me :)
euranymous: hi clean shaved George
forkdb: 1uptime
forkdb: !uptime
crazywulf770: @georgehotz i think you overthinking this one... try a more simple one https://rubular.com/r/lOP4VJDJhW3bS8
data_day_life: @forkdb 58 minutes
kkteja: !uptime
Santiago_LHC: @anguscupcake so what? You buy with as much RAM as you need, problem solved.
data_day_life: data_day_life subscribed at Tier 1. They've subscribed for 2 months! platyGG platyGG platyGG platyGG platyGG
euranymous: What are you working on @georgehotz ?
MuscleMario: recently I learned [sS]  instead of trying to do (.)* for new lines too. b/c some regex's dont support multiline parsing. Hurrdurr
forkdb: @data_day_life Thank you
Lefer_: Ohayou Geohot san VoHiYo uyuyuySmile
forkdb: Hello gundu
Akash_44: Pog
whichtom: easy
Kuunih: Pog
anguscupcake: it's a problem because if you ever decide to code something intensive down the line, you have to buy a whole new one. same thing as buying game consoles, it's wasteful
data_day_life: platyLILB platyLILB platyLILB
Santiago_LHC: TWITCHCOQ!
whichtom: eyy twitchcoq
MuscleMario: oh no, back to the coq
crazywulf770: shit
forkdb: Hey... please talk about something interesting...
bcrscahh198987: Any place to do regex exercises?
Santiago_LHC: @anguscupcake So it's not for you. Clearly it's more than good enough for plenty of people
data_day_life: i mean if you're running unity then maybe that's true.... but if you're not then.... why not use the cloud @anguscupcake ?
0verclass: dat speed
anguscupcake: That's why I want to know why he uses one, what advantages are there?
forkdb: Man... I wish I had half of his skills ....
warpoit: morning geo happy coding
Santiago_LHC: @anguscupcake MacOS I imagine
data_day_life: @anguscupcake it runs on top of ubuntu
bcrscahh198987: Self proclaimed regex beast, sure thing georgie
Jadess: bamboM
Sarcazeem: ScaredyCat
data_day_life: @anguscupcake but windows now has support for linux subsystem ... and then there's docker so.... it's kind of moot
psychicside: is this a size font for ants?
bcrscahh198987: regex101 is the best website IMO
bcrscahh198987: for regex
data_day_life: agreed
vincexviii: regex PepeLaugh
jmc516: Do you have ur RegEx license tho
bcrscahh198987: you need a license to use RegEx, damn that's new
bcrscahh198987: Probably need a license to type on a keyboard
jmc516: Nah it's a meme
MuscleMario: Geohot, do you believe in the hype behind WebAssembly. 'Bytecode Alliance'. Idea is that they are trying to take wasm outside the browser and also agree on a set of standards for the 'NEW FUTURE STDLIB' equivalent. U drinkin this kool-aid, cuz I am hype about this.
residentsleeperrrrrrrrr: why the FUCK do you use chrome.
reduf: could be domain1.domain2.domain3....
reduf: also could be domain1 without any .com
Ziv0: emails can have underscores dashes and pluses
reduf: and dot
crazywulf770: easy one
crazywulf770: :-)
Bacon4Life_: emails can have .com.xx
Rudolfkeil: Not using dark mode? U monster
bcrscahh198987: I don't think the website offers dark mode
MuscleMario: chrome://flags -&gt; forced dark mode
crazywulf770: Bacon4Life_ yeah real email regex are much more complex
pogu: I think most peopel just google email regex and copy it over. It's pretty big iirc
NoLimitFitness: What are we doing?
crazywulf770: pogu ^^
NoLimitFitness: tsodinJS tsodinJS ?
crazywulf770: python regexing basics
NoLimitFitness: nice
serhejenos: serhejenos subscribed at Tier 1. They've subscribed for 10 months!
LaheyFPS: good morning
LaheyFPS: yes
serhejenos: Hi everyone
Sarcazeem: Also mail servers accept   sign @georgehotz
LaheyFPS: hello @serhejenos
euranymous: chew some ice for asmr effect
LaheyFPS: chew ice Kreygasm
MuscleMario: lol
YouPowerRush: here it cums
Bacon4Life_: go-army.america PogChamp
MonkaSupreme: put ice in nose Kreygasm
LiIDrunk: have you tried hands on WASD keyboard
euranymous: someone is geting a timeout
LaheyFPS: PogChamp Family show
residentsleeperrrrrrrrr: wheres the emotes
Sarcazeem: we gotta be appropriate as christian channel - chews ice
MuscleMario: Geohot -&gt; Wasm -&gt; Runtime outside of browser -&gt; Bytecode Alliance trying to standardize the bytecode of the future (stdlib equivalent) -&gt; hype or sham?
prvk3: you can show your tits though
crazywulf770: try a hard one
filipeoliveiraa: try a hard one
Vinndy: hey george please solve my hackerrank problem i'm stuck
crazywulf770: ^^
Sarcazeem: but in username field if there are   sign a b@c.com and a c@c.com is same @georgehotz
Bacon4Life_: Are you ready to signup at go-army.america?
whichtom: regex is crazy man
directrix13: regex?(pert)
Abo7atm: George, Amazon just rejected my payment. What should I do with my life now?
Hunted9000: riPepperonis riPepperonis riPepperonis riPepperonis BlessRNG BlessRNG BlessRNG BlessRNG
euranymous: I listened to your album last night. It was amazing @georgehotz
MonkaSupreme: js
wall_streeter: are regular expressions reliable?
ragemaster999: did you study at an university?
r0kz_: :(
whichtom: rip twitchcoq
MonkaSupreme: do some multi line regex
FargioFarmani: try leetcode regex
LaheyFPS: I want your hoodie @georgehotz
euranymous: We need a discord channel!!!
directrix13: BNF &gt; regex
MonkaSupreme: you could regex the twitch chat PogChamp
LaheyFPS: D:
Farafire: Farafire subscribed with Twitch Prime. They've subscribed for 2 months!
MuscleMario: I just ran away from regex
directrix13: lol
MuscleMario: parasing clojure project.clj EDN
LaheyFPS: regex is just regex LUL
MuscleMario: parsing*
VitalyzedTv: i never do regex :C
euranymous: regex is regex but you are breath taking
Abo7atm: What kind of grammars can regex express?
MuscleMario: Its basically pom.xml equivalent project.clj
root_user_198: install arch
directrix13: regex is a nice hacky little dsl
MuscleMario: Im super hype about wasm, but i dunno if i just drunk the kool aid
MuscleMario: &gt;_&lt;
ImNotTrolling: Do searches AI
MonkaSupreme: javascript expert
VitalyzedTv: PogChamp
fa_k: LUL
MonkaSupreme: Number()
vmarkushin:  0
directrix13: learn lodash after js
MuscleMario: lodash
MuscleMario: Dont do any of this lol
directrix13: Lodash
TheNakedFlame: LUL
Ziv0: LUL
plomlo12: true
TheNakedFlame: I'm so done with the shit-tastic ton of js frameworks that change every month
VitalyzedTv: why is he trolling this framework
VitalyzedTv: xD
MuscleMario: Bytecode Alliance Check it &lt;-
forkdb: Hey George... please talk about something about your life, which you cherish
MuscleMario: let is a function scoped var
fa_k: Just write your own framework 4Head
MuscleMario: yeet
euranymous: JS is my first language BTW
MuscleMario: in will return an index to use
MuscleMario: of will return the value
Vinndy: let is blocked scoped not functon scoped
MuscleMario: for (x in coll) { //x is value }
th0rgam: you split
MuscleMario: fuck i goofed
Neven8775: String isn an array of Characters in JS so.. should be iterable
MuscleMario: for (x of coll) { //x is VALUE }
ragemaster999: exposed on live stream
MuscleMario: for (x in coll) { //x is idx }
fear_ep: try brainfuck @georgehotz
MuscleMario: includes
th0rgam: incuds
th0rgam: includes
euranymous: try brainfuck @georgehotz
zoki_macola: string doesnt have .forEach
MuscleMario: ^
MuscleMario: kappa ?
plomlo12: Are the speed comparisons in vanilla-js real numbers ?
MuscleMario: LOLOL
MonkaSupreme: you can do '123'.includes('1')
MuscleMario: just do regex .match(/regex/)
MonkaSupreme: in js you can do the /regex/ syntax PogChamp
MuscleMario: just slashes
directrix13: regex is built into JavaScript
MuscleMario: LOL
TheNakedFlame: FeelsAmazingMan REEEEEE
MuscleMario: AHHAHA
MonkaSupreme: PogChamp
i4cc8a9morw8kfrh: squadR
LaheyFPS: EZ
MuscleMario: im dying, afk
fear_ep: HahaHaha pog
nautzz: i want a friend who texts me "bro, sealand"
Ralph_124C_41: lol
scorpiocyborg: lol
i4cc8a9morw8kfrh: squadPepega
scorpiocyborg: this guy
forkdb: Really George... why are you learning js.. do you use it often?!
zeroeagle1: its just amerge sort I think
MuscleMario: b/c its simple skills
scorpiocyborg: he is evolving to his final form
vmarkushin: bro, clang
Vinndy: @georgehotz yo do this one it says ""hard"" https://www.hackerrank.com/contests/round-1-holiday-cup/challenges/biggest-slice/problem
nautzz: @forkdb It's A Meme
crazywulf770: better than metamath :-D
anguscupcake: react is a meme
jrrbls: Learn React Native
directrix13: @forkdb because JS is everywhere
ImNotTrolling: learn brainfuck @georgehotz
LaheyFPS: I hope its sweet tea
vmarkushin: Learn haskell plz
VitalyzedTv: is that water with ice? or iceatea with ice
MuscleMario: Google 'Bytecode Alliance' and validate my hype senpai
Ralph_124C_41: lol
ragemaster999: react harder :rage:
Zabak378: What do you guys think about PHP?
nautzz: the original reason behind the creation of brainfuck was kinda cool to me, its not interesting beyond that tho
zoki_macola: try Next.js
directrix13: Don't learn react, learn what it is based on: the functional programing language Elm
smurfd0: had a guest teacher in the univeristy who used BF, and he looked very tired ;)
zeroeagle1: why not web assembly?
MuscleMario: ^ That
hoffs: yeet it
leopp: did he uses screen or tmux?
i4cc8a9morw8kfrh: D:
mdrake_: im so triggered rn
MuscleMario: A framework for a framework my dawg
zerofuzzgiven: delete it
pogu: yes
TheNakedFlame: Framework-ception
anguscupcake: npm install npm
MuscleMario: apt get apt
scorpiocyborg: when is the new album dropping @georgehotz
pepino5: apt here we go!
Ralph_124C_41: this is actually causing me physical pain
LaheyFPS: LUL
anguscupcake: apt get gf
mdrake_: just gulp it 4Head
TheNakedFlame: FeelsAmazingMan All of them
ragemaster999: just script it 4Head
nautzz: The Future of Software...........
MuscleMario: Web
MuscleMario: Ass
GGGrimmy: And that's why no one should use macos :D
MuscleMario: ^
Caene: jokerd6Gold
MuscleMario: DAYM
ragemaster999: react harder :rage:
TheNakedFlame: LUL
syrob2804: What did he write?
i4cc8a9morw8kfrh: wrap it up domer squadD
MuscleMario: I one told that to a Teachers Assistant ... good times
MonkaSupreme: mylNob
forkdb: Hello
MuscleMario: squadW
directrix13: @georgehotz Learn functional language Elm instead of React since react was literally based on how Elm works
euranymous: I am groot
i4cc8a9morw8kfrh: so bad squadR
quevlo: Anyone have suggestions for how to learn programming? Want to become a Software developer or start off in database for experience. I have zero experience in coding btw
forkdb: Please talk something interesting
Ralph_124C_41: lol
Ziv0: LUL
residentsleeperrrrrrrrr: xqcSkip xqcSkip
Ricoello: mylBrain
MuscleMario: Elm is a web framework i thot
whichtom: @quevlo my dude there are a trillion resources online
whichtom: any website that teaches through practice
euranymous: I am groot
forkdb: Hello
Vinndy: ewww front-end boring stuff
MrOtotheP: we frontend developers now?
syrob2804: vue js
forkdb: What is not boring?!
rektiw0w: react isnt that boring even tho its front end
YouPowerRush: 123 go
MuscleMario: Okay, well anyone else here know about Wasm and its future goal?
hoffs: thats jquery
i4cc8a9morw8kfrh: lul
MrOtotheP: ClojureScript &lt;3
zeroeagle1: why not try web assembly?
nautzz: yes they do actually, its called vanillajs
kyyllu: Only angular makes front end not boring
reyy911: @rektiw0w it is boring. Even
fear_ep: do you suggest to do AI as master degree? @georgehotz
Ralph_124C_41: hahahaha, right wing javascript
Hypheus_: LUL
XeroKool: lol
reyy911: @georgehotz said it
TheNakedFlame: Use svelte js 4Head
rektiw0w: @reyy911 why?
Zasuslive: Thoughts on John carmack saying his focus for the future is AGI?
forkdb: Please stay away from front end... you are gonna not like
directrix13: Conservative JavaScript framework is thoughtsandprayers.js
Ziv0: svelte LUL
LaheyFPS: Tim cook LUL
mdrake_: did they fix the keyboard
MuscleMario: I am stuck between Thinkpad X1 Extreme Gen 2 vs MBP 16
forkdb: And.........
Zasuslive: Thoughts on John carmack saying his focus for the future is AGI?
serhejenos: LUL LUL LUL LUL LUL
MonkaSupreme: you also need nvm so you can switch between node versions mylBrain
0xF61: Does it have esc ? @georgehotz
Vinndy: i feel like the problem is not learning React is what type of shit project do you even come up with to learn it
forkdb: What.............
Ralph_124C_41: @Zasuslive he's well off enough that he's just doing whatever he wants without an interest in growth
TheNakedFlame: PogChamp
MuscleMario: WASM bytecode compiler
MonkaSupreme: build twitch chat
Jadess: HSWP
Caene: Literally any project in react will automatically be shit.
MuscleMario: :D
vmarkushin: facebook
rektiw0w: twitch sudoku
reyy911: Todo app
Ricoello: just copy anything open source
reyy911: LUL
directrix13: chess
MuscleMario: websockets ttoo
Zabak378: Calculator
GGGrimmy: Make a new web framework in the react framework. Javascript folks love the layers.
LaheyFPS: build chat PogChamp
zeroeagle1: a front end for the twitchcoq
TheNakedFlame: PogChamp That's us
forkdb: Please do not touch frontend.. stick to back end only
crazywulf770: a scam ps4 emulator website in react
ragemaster999: twitch shat
Caene: LUL
MuscleMario: LOL
nautzz: PogChamp
revolutionist123: girlfriend finder
forkdb: Omg.....
i4cc8a9morw8kfrh: #ad
Ralph_124C_41: pay 20k and learn to be a professional front-end developer PogChamp
zeroeagle1: check the pricing
Zasuslive: @ralph_124c_41 yeah i doubt his objective is to increase his wealth, but I think he wants to leave something of significance behind
syrob2804: Do u live in bay area?
mdrake_: become a developer
MuscleMario: Just saw San Francisco for the first time last week, got back yesterday. Had a great time at a convention.
abk467: hey you could work at facebook Kappa
nautzz: george studying the ways of the grift
kyyllu: dude learn angular instead wtf
Vinndy: just pay 20k to learn CSS 4Head
Scott_w_c: what are your internet speeds
euranymous: linux for president
MuscleMario: rip
mdrake_: LUL
Scott_w_c: RIP
Zabak378: rip
LaheyFPS: ookla
XeroKool: LUL
i4cc8a9morw8kfrh: F
Hypheus_: F LUL
TheNakedFlame: LUL
directrix13: Make sure you put it in a Docker container using a Debian base orchestrated by Kubernetes
Ralph_124C_41: @Zasuslive yeah, I mean I wasn't criticizing, he's putting his skills to good use in whatever interests him at any given time
Vinndy: ???????
i4cc8a9morw8kfrh: OMEGALUL
MuscleMario: 3 fast
filipeoliveiraa: f
MonkaSupreme: well
Vinndy: LUL
forkdb: Dude .. you are trolling...
eax_ebx: f
MuscleMario: f
myasovlavashe: f
Larsson93: Saved
nautzz: speedtest brought the stream down for a sec i think lmao
MonkaSupreme: its so fast that it kills your stream
abk467: whew. that was a close call
ragemaster999: Jebaited
okeeeeeee: i have 46 LUL
UniversalGeneve: codecademy is usually good enough for me, i learned how to program in java, JS, and C# in a week.
Ziv0: dem dropped frames
pogu: I hate all of the crazy tags adg-asdf-important-component-tag in angular. React is way cleaner
LiIDrunk: thoughts on MBP 16
whichtom: holy shit what is happening
forkdb: He is trolling........
MonkaSupreme: I know your ip now, starts with 192 Kappa
MuscleMario: close the bitcoin miner
smurfd0: what did you think of the new macbook pro 16inch?
Scott_w_c: stream frozen LOL
Shasan_: i went to college to learn lisp now i am unemployed
whichtom: actually powerpoint
MonkaSupreme: leak leak
Santiago_LHC: Fast frame rates are overrated
UniversalGeneve: cyber police
kyyllu: why tf is he learning react?
Vinndy: hey george can i intern at comma
zeroeagle1: use vue instead
forkdb: Why don’t you come work for me:)
ragemaster999: just abort it 4Head
Caene: "Shopping list", oh dear God.
MuscleMario: Lisp is cool
komocode_: lolregex
hoffs: @kyyllu because he wants to work in a startup
komocode_: would you use regex to validate email?
Scott_w_c: sold your IP on ebay to elon musk he about to ddos you from starlink as a world wide test
kyyllu: dude learn angular then
ManWithNoFace: thoughts on the 16" mbp???
kyyllu: way better than react
Zasuslive: @ralph_124c_41 Yeah definitely, I wanted to basically know what George thought of the chances of him actually succeeding, considering he pretty much does in any field he enters
syrob2804: What salary are u expecting?
fwef64: This channel is going downhill.
s0rrz: "how to build a startup in a day"
Santiago_LHC: #memes
rektiw0w: worse...
MonkaSupreme: install nvm for nodehttp://dev.topheman.com/install-nvm-with-homebrew-to-use-multiple-versions-of-node-and-iojs-easily/
forkdb: Bad idea...
MuscleMario: damn geohot, do u go to ctf's or conference anymore?
reyy911: Angular is better imo
directrix13: @georgehotz write a distributed speed test app that can't be cheated by collusion with ISPs
UniversalGeneve: @georgehotz in terms of working at a slef diving company/ A.I. oriented product company, what would you say are "employable skills"?
razr22: angular is like react
nautzz: its just a meme dont get heated @kyyllu
Santiago_LHC: Angular is the 2015's React
komocode_: eLeCtRon
Sarcazeem: maybe flutter LUL
Caene: In how many languages does a person have to learn to make a shopping list, before he can call himself a dev? LUL
pogu: everythingisaplatformnow.jpg
reyy911: Check out RxJS.
xEHLE_: @MuscleMario he went to twitchcon, he is a streamer now
MuscleMario: LOL
reyy911: React is a mess.
zeroeagle1: go eith blazor
thegamer12349876: reactJS
MuscleMario: thoughts on mbp16
kyyllu: Angular is waaaaaaay better than react
MuscleMario: leggo
ManWithNoFace: yes
syrob2804: Socket io chat
Santiago_LHC: Let's buy macs
rektiw0w: new mac PogChamp
reyy911: Reminds me of php lmao
VLEESBROODTV: 16 inch 8 tb macbook lets go
MuscleMario: Im afraid of becomming a mac ecosystem guy.
forkdb: YES
euranymous: Build a PC instead
okeeeeeee: i like the old macs much better
GGGrimmy: Buy a dell and put linux on it
fwef64: What happened to your windows computer?
komocode_: butterfly keyboard is awesome
Santiago_LHC: #butterfly
MuscleMario: I just want my damn ESCAPE physical key
myasovlavashe: DansGame
bergsdal: apple bad
reyy911: Yes new mac
komocode_: better than scissors
jstoast: what mac do you have rn?
pogu: noooo
i4cc8a9morw8kfrh: these prices man wtf
forkdb: OHHHHHHHH
okeeeeeee: touch pad keyboard DansGame
Miu_OS: why not hackintosh?
rektiw0w: physical escape key PogChamp
MuscleMario: Physical Escape Key
xEHLE_: get the 6k macbook PogChamp
euranymous: I like the product but the price straight up repels me
LaheyFPS: AMD LUL
pogu: me too, I like Bfly v2
Santiago_LHC: It is big
Scott_w_c: i hae 13 inch and it is great
MuscleMario: I was going to get the Thinkpad X1 Extreme Gen2 , but then this ish came out.
ragemaster999: 4k pc PogChamp
komocode_: vue.js
Annex_Greenland: 4k for a macbook
ManWithNoFace: 16 is way too big
Vinndy: just $4k 4Head
Caene: 13 inch are perfect, I usually dock my shit when I come home anyway.
LiIDrunk: only 0.7" bigger
forkdb: ITS HUGE
whichtom: how portable even is 16 inch
euranymous: Just build a god damn PC instead of wasting money on expensive social media machine
whichtom: ye 13 inch is great
MuscleMario: Websockets
UniversalGeneve: high T
Ziv0: I have the 16in one and it is kinda big
syrob2804: Socket IO @georgehotz
forkdb: BUILD SLACK
Annex_Greenland: 16 inch laptop LULW
Zabak378: 6 inches are also fine
FargioFarmani: i like my 13 inches too
Santiago_LHC: inch jokes incoming
Scott_w_c: plz apple i want 26 inch in my backpack i need moniter at school
i4cc8a9morw8kfrh: @euranymous imagine paying 3k for a laptop
Shasan_: use laravel with react
MonkaSupreme: install nvm instead, less headache
reyy911: I have a 15”
swagettiyolonaise69: that's what she said
ragemaster999: @georgehotz web sockets
MuscleMario: I'm using Brave right now, anyone else?
ImNotTrolling: socket io and node js
thegamer12349876: use yarn better than npm
MonkaSupreme: yarn LUL
Vinndy: lol i'm just writing a bittorrent client in node js
euranymous: @i4cc8a9morw8kfrh I better buy a i9 and an rtx 2080 ti with that just to upgrade my existing PC
directrix13: you should get a unicomp model m keyboard. It's a lot like your butterfly keyboard in many ways.
pogu: Firefox all way
okeeeeeee: ejabbered server?
kyyllu: @georgehotz learn django xd
zeroeagle1: yarn &gt; npm
Scott_w_c: use HTML
VidaSabudabu: use graphQL on AWS with DynamoDB
yuptheladsdownthecans: @LeadCoder STOP sending the same thing over and over idiot
Annex_Greenland: coolest chat app LUL
i4cc8a9morw8kfrh: @euranymous true
ytazn: i just won a 5k
whichtom: LUL
Santiago_LHC: BOOM
okeeeeeee: LUL
XeroKool: LUL
i4cc8a9morw8kfrh: LOOOOOOOOOL
UniversalGeneve: LUL
Lefer_: LUL
Ralph_124C_41: LUL
Zabak378: OMEGALUL
AlcaponeYou: LUL
okeeeeeee: savage LUL
Rtc_ti5: hahahaha
Shasan_: LUL
Scott_w_c: BloodTrail
kyyllu: LUL
LaheyFPS: not subbed LUL
rektiw0w: oof
Keyeh: good morning @georgehotz
directrix13: lol
reyy911: LUL LUL LUL
speeddrawing101: Nice
forkdb: WTF
MonkaSupreme: mylNob
FlySociety2o9: LUL
notoroszbig: grpc?
Annex_Greenland: excessive
ManWithNoFace: F
ytazn: hey no offense but you look great
Santiago_LHC: You know when your username is "LeadCoder", you made it.
forkdb: ifeelbadfortneperson
Caene: @LeadCoder Better subscribe to come back. LUL
erichtp: LUL
Vinndy: you will have to "emulate" discovery by having the server be the middle man all the time
revolutionist123: f
MonkaSupreme: p2p
Scott_w_c: and sell it to stream lab and buy that macbook!
i4cc8a9morw8kfrh: comedyStare
Keyeh: 🤔
sultantw: ex leader now
reyy911: @annex_greenland you thinks so? You should get banned too
MuscleMario: inb4 this a botnet
okeeeeeee: try erlang @georgehotz
hoffs: just use a blokchain
pogu:  1, YES PLEASE
LaheyFPS: and then you dos us all
directrix13: you are going to need some nat traversal
MonkaSupreme: write in solidity Kappa
speeddrawing101: Do you know React? @georgehotz
mariusmafius: erlang DansGame elixir SeemsGood
kektobiologist: can u add in title what you're making? @georgehotz
ytazn: hey great idea
MuscleMario: elixir &lt;- will be fun
VidaSabudabu: learn graphQL and use from Reactjs
Keyeh: eggs and sausage Kreygasm
MuscleMario: ill go make breakfast too
erlsek: what is he doing now?
Santiago_LHC: FUN
LaheyFPS: egg burrito PogChamp
Caene: Time for brekkie
dorkmo: https://github.com/cabal-club
euranymous: Lets make some chicken tendies
forkdb: Shall I sub ...
reyy911: Frozen food otw
zeroeagle1: is their ui stuff for elixir?
directrix13: breakfast.js
UniversalGeneve: bacon, eggs, sausage and hashbrowns
FlySociety2o9: sandwhich LUL
dorkmo: @georgehotz ^
Shasan_: george a genius it would take me a year to build that
ytazn: chat app
ytazn: @erlsek
erlsek: nice
Jewishrambo: 🙄
Keyeh: Discord slayer PogChamp i'm ready
ytazn: guys
LaheyFPS: DansGame dirty
ytazn: boys
pogu: @Shasan_ doubt it, it'll take a less resourceful person a few weeks at most
12ka4: hey dude can you teach us vim? your vim skills are lit.
ytazn: i will also make eggs now
Vinndy: play you were the shit in high school it's sick
LaheyFPS: Beethoven
VLEESBROODTV: cabal looks hot
directrix13: directrix13 subscribed at Tier 1.
Annex_Greenland: LUL
cjocol2201: hi
swagettiyolonaise69: dont forget to add a ban function
LaheyFPS: LUL
XeroKool: LUL
kyyllu: LOL
god_damn: get that guy outta here
FlySociety2o9: LUL
Keyeh: xcalBanhammer
ytazn: i hate fun
pogu: 🍌
forkdb: Play your rapp song
Annex_Greenland: whys he so awnry
ManWithNoFace: what chair is that
pogu: lul slow internet
hoffs: herman miller
euranymous: play some tomcr00se
Keyeh: arab subtitles though
Fundlak: turkish*
pogu: I love this already, fml
Keyeh: @Fundlak ty
ManWithNoFace: thanks hoffs
i4cc8a9morw8kfrh: @Keyeh are you serious
directrix13: somebody let the dog in with mud on his foot
Keyeh: @i4cc8a9morw8kfrh no, just clueless
Keyeh: i mean, yes
i4cc8a9morw8kfrh: squadD
i4cc8a9morw8kfrh: comedyStare
Santiago_LHC: Breakfast stream
st47ik: cant hear you from that far
residentsleeperrrrrrrrr: "comedy"
kyyllu: @georgehotz make the chat app with Django instead of shitty js
byte_baron: what a swaggalicious song
khilshot: Yo yo geohot
byte_baron: it's so hip!
i4cc8a9morw8kfrh: @kyyllu that would be great
byte_baron: so... so... utterly shit
euranymous: Do you guys get disappointed by absurd contribution of apple fanboys to the monopoly?
XnitronQ: PogChamp
Vinndy: PogChamp
okeeeeeee: tomcr00se PogChamp
Santiago_LHC: what monopoly
kytos1k: PogChamp
st47ik: PogChamp
swami_ramdev_baba: oh geo
FlySociety2o9: PogChamp
ytazn: i put bacon in my eggs
euranymous: @Santiago_LHC Literally every housewife wants an iphone
okeeeeeee: rip pc
ytazn: not to be mean @georgehotz but you are the best builder ever
TheNakedFlame: monkaS I C U
Santiago_LHC: @euranymous Where I live only like 10% of all people have iPhones
komocode_: what's your dj name? Hotz dropping the 🔥
mkdrmnd: @euranymous so you're asking if anyone else is annoyed that people like to buy the products they like?
dorkmo: https://github.com/cabal-club
MonkaSupreme: I bet you gonna have some trouble with P2P stuff in the browser
swami_ramdev_baba: oh geoz how do you just live all hours by only typing or leanring
st47ik: whats on the plate Kappa
SmokeSomethin: what man, hows your day going?
okeeeeeee: LUL
god_damn: 🤕
speeddrawing101: YEs
euranymous: @mkdrmnd I dont mean that. I meant the company is selling an inferior product for absurd prices which happens to be a status symbol
Santiago_LHC: #obstacles
gator____: wonder if George has Headspace premium LUL
razr22: play at 2x
st47ik: ╰(*°▽°*)╯
razr22: jony ive LUL
Santiago_LHC: @euranymous I think you don't understand what a monopoly is
god_damn: LMFAOOO
swami_ramdev_baba: I daily learn like this but i do 5 to 6 mastrub** i cant control it,
Santiago_LHC: #curious
swami_ramdev_baba: How to control it guy
Santiago_LHC: #neural
Caene: LUL
st47ik: neural networks PogChamp
FlySociety2o9: What is this?
god_damn: 🤨 mind wondering...
st47ik: he's optimizing his neural networks
mkdrmnd: @euranymous the iPhone is only a status symbol to poor people, and also, 'inferior product' is a poor assessment because you haven't considered their perspective and how iOS might make it superior for them...
Keyeh: that's some "deep" meditation
swami_ramdev_baba: Also @georgehotz , do you know onehack.us website and what it is giving to world
jrrbls: have you tried the Sam Harris one
FlySociety2o9: training the neural network
god_damn: he really is vibing
ytazn: have u tried vue?
FargioFarmani: this is hilarious
Santiago_LHC: We are meditating bros
ytazn: i think if i started over i might not use framework
st47ik: oh yeah
swami_ramdev_baba: Who is working onehack.us is that you
jellyjar: ah meditating, thought we were getting brainwashed
FlySociety2o9: I'm ready
kyyllu: Y O G A B O Y Z
gator____: breathe through the root chakra, chat
mariusmafius: u gotta do this shiet before touching any web framework
FargioFarmani: cant do react without mediating first
st47ik: ^
Santiago_LHC: :breathe:
FlySociety2o9: ^
god_damn: 🤨
leopp: @mariusmafius LMFAO
pogu: lol headspace is such a shit product. I like for starting out, wouldn't say premium is worth it
swami_ramdev_baba: how to control mastrub*
Santiago_LHC: https://www.calm.com/
ytazn: i like to hold a weapon while i think it makes me feel a bit better
st47ik: D E E P
suteki1: 😐
kyyllu: @ytazn MonkaS
swami_ramdev_baba: i am addicted to that like john don
nesbyy1: What we doing now?
st47ik: NotLikeThis
god_damn: @nesbyy1 vibing bro
swagettiyolonaise69: not sure
ytazn: @kyyllu it's weird but try it
Santiago_LHC: We are meditating
FlySociety2o9: monkaS
xohadi: vibe check
st47ik: bruh moment
Thobrik: okay who called the police
hoffs: woop woop 🚓
st47ik: Kappa
god_damn: feds monkaS
leopp: *sirens in the distance
Unsavable: Sirens amplifying the relaxation.
LaheyFPS: haha sirens
suteki1: CiGrip
swami_ramdev_baba: OM NAMAH SHIYAY
rektiw0w: lmao wtf is this
stale2000: monkaS
kyyllu: imagine meditating before using react LUL
jellyjar: namaste
notoroszbig: namaste
FlySociety2o9: !keyboard
YouPowerRush: 123 go
st47ik: @kyyllu that's the point LUL
Santiago_LHC: meditation is the only way to use react
cjocol2201: monkaS
Azermite: Meditation is pointless ?
aa_ato: Sss
Pryetranka: murdaEmusk
swami_ramdev_baba: @georgehotz , ARE YOU INTROVERT AND EXTROVERT
VLEESBROODTV: zzzzzz
kyyllu: react is shit why nobody told him
gator____: @Azermite not entirely. It's supposed to increase gray matter in the brain
hoffs: @Azermite nah bro, its only way to unlocking 99% of your brian
ytazn: i dont use any of the redux stuff it's too complicated
YouPowerRush: sleepy boii
suteki1: FeelsGoodMan 🚬 ﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞﱞ
Caene: I feel so calm.. I feel like a shoe.
XeroKool: This is stressing me out
Santiago_LHC: a bit of space
stale2000: MrDestructoid
st47ik: vue is calmer than react 4Head
Azermite: Angular : yes
swami_ramdev_baba: @georgehotz , tell me how to stop having mastrub***, when i am alone i cant control it
Santiago_LHC: #nojudgement
nesbyy1: Can someone link the video please
thebastl: @georgehotz Do you think making open pilot work for e-scooters is the next big thing?
nesbyy1: the video of the orator
nesbyy1: or whatever its called
gmx27: @realrajanpaudel try stoicism
VLEESBROODTV: its headspace
kyyllu: Just use django dude forget about react
god_damn: george really about it
st47ik: Kreygasm
stale2000: Never did I thought to see the day of Programming ASMR
FargioFarmani: its an app
YouPowerRush: sikk headspace bruh
pogu: I feel like a blob controlling my body
ytazn: i meditate too but maybe not for as long
gator____: I hear in silicon valley you have to do this before every HR meeting
thebastl: @kyyllu Heretic!
Santiago_LHC: #breathing
EnjoyToLive: are you scared of leadcoder
st47ik: @kyyllu django for frontend WutFace
thebastl: Did he just fart?
gator____: yes
kyyllu: Not for the front end, but for building the app
suteki1: yes
VLEESBROODTV: eggs are cold by now
aa_ato: this work!
pogu: @gator____ yeah, HR is so annoying that before and after purge of memory and emotion is necessary
Santiago_LHC: #chill
kyyllu: Also, Angular for front end is way better than react
Keyeh: &gt; "preferred text editor" &gt; not vim LUL
gator____: LUL
ytazn: i guess it is the start of the project tho
EnjoyToLive: chill
thebastl: Is he aware that the stream is running?
gator____: no
st47ik: @thebastl yeah
Santiago_LHC: He is aware of nothing but thyself
ytazn: hey you got this geohot u r the best one
st47ik: LUL
EnjoyToLive: you don't have the balls to challenge the Robed guy
st47ik: jailbreaking the brain
Santiago_LHC: Can someone ban this wannabe hacker?
kyyllu: No effort required
god_damn: this is how man reaches his apex
hoffs: george about to bust one
swami_ramdev_baba: @georgehotz , say ohmmmmmmm
st47ik: DansGame
lwasd: Hey George!
leopp: he's channeling his JS BEAST MODE
MrBlackPanther: !keyboard
LaheyFPS: scream in the mic when done :)
jellyjar: we are about to witness some next level coding when hes done
lwasd: Just created a security tool for NPM that helps developers safely consume OSS, interested?
st47ik: Setup Option 1: Write Code in the Browser 4Head
ytazn: i am an asynchronous process
ytazn: i will wait patiently while the thread does other things
Santiago_LHC: #pleasantthoughts
zoki_macola: is he ok
lwasd: wtf...
Pryetranka: no
ragemaster999: this might be the best javascript code a man has ever written
kyyllu: Self driving cars built using react lets go
EnjoyToLive: he's just scared @zoki_macola
ytazn: i will be executed by a browser
aa_ato: DeadMan
lwasd: https://trustd.dev ?
gator____: can you imagine george in an ayahuasca ceremony LUL
st47ik: u need to meditate before using react SMOrc
xrealyy: he should do this before the stream
zoki_macola: he looks anxious
kyyllu: selfdriving.js
st47ik: LUL
martinkirilov: Did you get the new MB @georgehotz ? Finally a physical escape key for proper vim using
Santiago_LHC: "let the mind do whatever it wants"
bayed222: Cheer100
lwasd: Anyone here use Node.js?
lwasd: Or NPM?
xrealyy: "boobs"
aPosterior: he calling kylo ren?
pogu: @martinkirilov Switch esc and caps. How do you even use the normal escape key with vim
st47ik: @lwasd most do
hoffs: @lwasd stop shilling your shity
lwasd: Mean :(
kyyllu: @lwasd I do
gator____: cyber bully
martinkirilov: @pogu no caps on HHKB :(
lwasd: It ain't shitty.
st47ik: smells DansGame
Santiago_LHC: appreciate boys
Zabak378: What do you guys think about PHP?
leopp: I use CTRL [ to exit insert mode
lwasd: I just build a free dev tool to help educate developers on vulnerable OSS packages as they install them.
st47ik: smells like eggs in there
jrrbls: have u tried Sam Harris one
lwasd: I tryna help the world :( :(
ragemaster999: he is about to concatenate different types in javascript
Pryetranka: ResidentSleeper
pogu: @martinkirilov I just looked it up rofl
MonkaSupreme: good group session
oksan309: Has a fly ever wandered into ur mouth while riding a bicycle LUL
gator____: swalloed a beetle once ^
lwasd: @kyyllu Wooooo.
gator____: swallowed*
Santiago_LHC: #missingtheopportunity
st47ik: @lwasd npm does that kinda?
kyyllu: @lwasd work more with python tho
ragemaster999: he is rewiring on live stream PogChamp
ytazn: geohot is the embodiment of low coupling
PhysoTronic: what app is he using?
bayed222: headspace
mlgdotca: why is he learning react
Santiago_LHC: #engage #experience #reflect
leopp: he is reading the chat
st47ik: PogChamp
ytazn: at his core geohot is maintainable code
lwasd: @st47ik @kyyllu NPM does, other package managers don't - Python is next.
balzak43: is this the new ` import zen` &gt;
LiIDrunk: wtf i thought doing weed was the correct way
MonkaSupreme: be careful with streaming headspace content on twitch. @georgehotz
lwasd: And we also do licence control as well.
lwasd: AGPL etc.
Vjasal: have you ever tried hypnosis?
martinkirilov: tell me you're eating fruit looms or I'll be disappointed
hoffs: ok sensei what is your zen level and how is your chakra doing
LaheyFPS: please im too relaxed, scream into the microphone. :)
aa_ato: 😂😂😂😂
byte_baron: @Vjasal isn't that an illegal wrestling move or something?
smurfd0: i geuss the meditation helps?
aa_ato: 😂😂😂😂😂😂😂
leopp: the eggs are cold?
gator____: @byte_baron you're thinking of the stone cold stunna LUL
st47ik: so calm Kreygasm
lwasd: Try the tool and let me know your thoughts?
swagettiyolonaise69: meditation is not for thinking
st47ik: @georgehotz signaling servers?
ytazn: in front of our eyes geohot has ascended to the level of the best developer in the world
lwasd: @st47ik you legend.
martinkirilov: yarn is so much better for react
khilshot: Wanna give VScode a try?
MonkaSupreme: we need a tracker
st47ik: @lwasd wat
PhysoTronic: perfect for "simple" skill sunday LUL
ragemaster999: are you ready to concatenate different types in javascript? @georgehotz
lwasd: Question is, which is safer?
Santiago_LHC: @khilshot He already has
st47ik: lookup signalhub George
thebastl: @georgehotz Do you own a boosted board?
dorkmo: did george look at cabal yet lol
khilshot: Most of the time i see him using vim.
xrealyy: slow net huh
two_eight: take a look at svelte. its react without the bullshit
ytazn: geohot is simple architecture
PhysoTronic: georgehotz what is your background? first time here. are you coming from JS or you usually work in other languages
Santiago_LHC: @khilshot He codes on vim, but uses vs code to read code
Thobrik: George started speaking with that cute yoga teacher voice like the headspace guy
LiIDrunk: lol still installing
ckrpasa: finally watching you alive and you are making meditation! LOL
LiIDrunk: brew is trash
st47ik: @georgehotz u goona use webrtc?
thebastl: @georgehotz Do you play video games?
swami_ramdev_baba: I love windows , hate mac
Santiago_LHC: nobody "loves" Windows
minichota: I love Linux, hate mac
st47ik: there are a few p2p webrtc projects
dorkmo: https://github.com/beakerbrowser/beaker
MonkaSupreme: maybe give peerjs a try
st47ik: u need a signaling server to connect peers tho
swami_ramdev_baba: windows is best friend for poor peoples
khilshot: Socketio is good for chat apps.
dorkmo: basically all use dht i think
Serbius: hello geo when will you make a new rap song, i need more gym pump up songs
Santiago_LHC: @swami_ramdev_baba lol, you say that as if it was free
swami_ramdev_baba: haha
swami_ramdev_baba: it is free , i use cracked version
swami_ramdev_baba: all is carcket
cursedelboom0: !keyboard
pogu: @Serbius It's super weird but I actually work out better with brain.fm light focus than the standard gym pump up songs
Santiago_LHC: Try linux, it's actually free.
mariusmafius: monkaS
st47ik: https://socket.io/blog/socket-io-p2p/ uses WebRTC
swami_ramdev_baba: *cracked
PhysoTronic: georgehotz first time here.. are you coming from JS or you usually work in other languages
leopp: hey @georgehotz, try gg=G in vim
jay_al97: you're doing javascript today
Serbius: @pogu im not kidding i worked out with geos songs
kyyllu: @physotronic usually he uses python
pogu: That's indent all lines in VIM
leopp: gg=G idents the code for you automatically
pogu: gg=G is indent all lines
Vinndy: front end development on vim might be a little bit of a stretch isn't it
TheBigK02: hi
FargioFarmani: In normal mode, typing gg=G will reindent the entire file.
ytazn: geohot has already reached godlike architectural ability and will write highly consistent codes
TheBigK02: twitch is so buggy... wanted to watch a vod... only for subs... then i subbed... still cant watch... what is this shit
jellyjar: is your current one 16gb?
dorkmo: new maccc booook
w9cceixh24b23ouiljlhmyp1: only 32GB ram, i see youre only going to install one dependecy then? Kappa
PhysoTronic: kyyllu does he have some project that he works on or he creates new ones often?
kyyllu: python &gt; js
khilshot: Do you hate java?
swami_ramdev_baba: @georgehotz ,, how do you control yourself from mastrubation , give me detailed tips, i am addicted to that shit. I am out,
Neeuuro: 50 tabs open in 10 different windows =D
kyyllu: xd
MuscleMario: English muffins, egg, salami, meunster cheese, yeet.
ytazn: geohot is the grittiest builder in the world
jay_al97: why are you learning react?
TheBigK02: @georgehotz ... step 1: hack twitch step2: fix twitch step3: get 1 milion subs on instagram... deal?
PhysoTronic: Neeuuro i have currently ~900 tabs
mlgdotca: why vim
Santiago_LHC: 95% of chat is "The thing I like is the best thing, unlike that other thing. Why aren't you using my thing?"
TheBigK02: why not vim
ytazn: LUL
kyyllu: @physotronic you mean in general or in js?
forkdb: Vim teach me
maxjowett: react LUL
pogu: @Santiago_LHC That's most of the conversation on the planet lul
swami_ramdev_baba: @georgehotz , how to increase my neurons and be genius
PhysoTronic: kyyllu well in general and in js. does he wants to learn JS so he made skill sunday?
ManWithNoFace: OnClick
rektiw0w: u have to do camelcase for onclick @georgehotz
Santiago_LHC: @pogu Depends who you hang up with
st47ik: @georgehotz u know about IPFS?
Lutefisk123: onclick with big C
ytazn: build for fun implies cream of the crop
chocblade: Can you say me a marked for exploits ?
kyyllu: @physotronic he is a famous hacker and runs a self driving cars startup if thats what u mean
MuscleMario: Did you know that bitwise ops on a JS var forces it to an INT rather than a float which increases performance when number crunching?
pogu: @Santiago_LHC I mean even if you say a statement, you're essentially saying "Im thinking in this way, I'm saying this so you can thing in this way too"
swami_ramdev_baba: Bye @georgehotz brother , i am interested in deep learning and going to learn come to you in later
kyyllu: @physotronic he is learning js because he is making a "simple skill sunday"
PhysoTronic: kyyllu didnt know that. does he ever demonstrate how to actually hack something?
Vinndy: this doesn't exist on that context, callbacks are supposed to be "pure"
Spidey2711: hat is some piss poor logic @pogu
restitutione: e =&gt;
rektiw0w: remove the curly braces
kingkong3211: use back ticks with dollar sign in front of opening curly bracket
kyyllu: @physotronic yes, actually he is pretty famous, if u do a search on Google you will know more about his story
ytazn: this is probably dumb but i dont use classes in react
anthraxvirus322: what are we doing today chat
mariusmafius: pussy
kyyllu: @physotronic I think there are some of these hacking videos in yt
martinkirilov: what are you reacting to? Kappa
pogu: Watch hs Lex Friedman podcast
pogu: his*
ytazn: @anthraxvirus322 chat app in react
MuscleMario: backticks are string templates in new JS
two_eight: gotta love that all the react tutorials now use the outdated class syntax. every 2 months you should be ready to learn new syntax :)
MuscleMario: allow ${x} in strings
khilshot: this context is different inside arrow function.
anthraxvirus322: @ytazn thanks kind sir SeemsGood
skynetrobot: is there a moderator in here that works for Facebook, I get timed out for mentioning lit-html ??
martinkirilov: @MuscleMario template literals, I'm surprised I still remember the name, haven't used js in a while
ytazn: no offense to boomers but i dont understand why they care so much about object orientation
johnny_thehobo: took me 4 months to barely understand react and geo is out here doing it in ~2 hours
Quad___lol: use functional react JS DansGame no one has time to type redundant shit
maxjowett: these tutorials are old bloated es5 examples
st47ik: https://github.com/Codaisseur/react-p2p-chat LUL
715209: you don't really need the constructor
LaheyFPS: monkaS
MuscleMario: Moderate your way into Partner
Quad___lol: https://www.robinwieruch.de/react-function-component
pogu: @st47ik 👏
martinkirilov: ``"backtick"${function here} string here"backtick"
two_eight: look at the new react hooks syntax
rektiw0w: the tutorial is fine
onewithoutnamee: onewithoutnamee subscribed with Twitch Prime.
MuscleMario: everything has been done, just the question is, how well. lol
khilshot: try scrimba
Pryetranka: react hooks is way to go
khilshot: it's free
forkdb: I think he likes to ban viewers...
PhysoTronic: kyyllu damn, he is real deal. just read few bits on wiki
ytazn: does anyone here know how to get the html from a site and print it out outside the browser?
Santiago_LHC: @forkdb Mostly trolls or people who are dumb and way off topic
ytazn: dude yes youre a genius
Arksam: monkaS
Vinndy: @ytazn use curl
electriclime: You could probably pass {this} objects as a parameter to the anonymous function then use it in the alert
pogu: VoteYea
jay_al97: lol
reaganchisholm: the big idea
MonkaSupreme: 10v10 tic tac toe
champ900: try alt   F4
MuscleMario: biggest
forkdb: @santiago_lhc I know, was just kidding... I like him...an inspiration
frediiiez: PogChamp
printhellosailor: I literally just implemented a server-side webrtc peer data connection a few hours ago
SpanglishGamer: Lol wow
SpanglishGamer: Genius
ytazn: @Vinndy ty
revolutionist123: PogChamp
BatkoTheBat: wow
st47ik: Also this distributed p2p chat app runs on IPFS https://github.com/orbitdb/orbit - https://orbit.chat/
SpanglishGamer: w0otahHigh
printhellosailor: implementing a server-side webrtc peer connection with a data channel is the only way to get a UDP connection to browsers right now
dorkmo: twitch connect 4 plz
skynetrobot: lit-html
two_eight: wouldn't websockets be better for tictactoe
st47ik: PogChamp
MuscleMario: ouch
electriclime: PeerJS is a simple wrapper for WebRTC that makes it very easy. Basically works like socketio
johnny_thehobo: implement some kind of ticket system so people have to pay to play vs you
khilshot: try scrimba (react tutorial)
forkdb: I like you george
printhellosailor: websockets would be simpler, but not as much fun as UDP over webrtc
swagettiyolonaise69: theres no winner in tic tac toe if you're good enough
equalizer_____: Чувствую русских в чате
champ900: I like you George
directrix13: ipfs isn't 100% JavaScript though currently
Vinndy: but what's the source of truth in this type of services
forkdb: He,lobgundu
Serbius: Pog
MitMax: MitMax subscribed with Twitch Prime. They've subscribed for 2 months! HolidayPresent HolidayPresent HolidayPresent
forkdb: What is pig?
forkdb: Pog
Santiago_LHC: PogChamp
ytazn: when i curl "http://philadelphia.craigslist.org" @Vinndy nothing prints?
kektobiologist: @georgehotz can you take your mic out of your keyboard
Ziv0: setState
Quad___lol: use setState
ytazn: keyboard sounds great
Vinndy: @ytazn do curl -L &lt;url&gt;
ytazn: ty
forkdb: What keyboard is he usually using?
Santiago_LHC: HHKB2
st47ik: @forkdb forbidden question NotLikeThis
forkdb: Ohgg StoneLightning
leopp: we don't talk about the keyboard here
mariusmafius: ban inc
ytazn: @Vinndy u r genius
st47ik: LUL
rektiw0w: some people abt to get banned
okeeeeeee: do you know 2 level tictoctoe? just make another tictoctoe grid in each of the 9 squares. the opponent always has to put his cross inside the area where the other player set his cross. e.g. put circle on left side into right field, then opponent has to put a cross anywhere into to right big square one. @georgehotz
Vinndy: no keyboard talk here
forkdb: Ohgg
st47ik: react ResidentSleeper
okeeeeeee: goal is to win in any small square
Quad___lol: @georgehotz 27 setState
champ900: change handleClick = (i) =&gt; {...}
two_eight: REACT HOOKS
Serbius: i never thought i would lose nnn watching a guy code so smoothly Kappa
ytazn: setstate is async
kektobiologist: please use es6 saves a lot of boilerplate
Santiago_LHC: Here is what George's setup looks like: https://www.instagram.com/p/Bx0DMrUAxE-/
Vinndy: react: "we don't do mutation here"
W1lkins: people writing javascript on stream, whole chat becomes javascript experts
st47ik: @W1lkins cuz its the most popular LUL
Boethig: you dont mutate the state because the dom diff algorithm wont catch it
ytazn: never used .fill before what a god
kyyllu: @st47ik most popular and utterly shit
kyyllu: xd
st47ik: not really
kyyllu: jk
forkdb: @santiago_lhc Thank you very much
kyyllu: But I think python better
johnny_thehobo: hmm... yes. i understand
ytazn: it's cool u r learning it super fast
Quad___lol: called it 15mins ago jokerd6Weird
st47ik: @kyyllu rust is superior imo, just give it a few years
kyyllu: python ans js are my main ones
zoki_macola: dont call prop.onClick
kyyllu: @st47ik I was about to learn Go instead of Rust
zoki_macola: just pass function
dorkmo: woo
do_not_erase: lol
YouPowerRush: 123 go
Serbius: @georgehotz did you compete in programming in HS?
Nubadoxd: If it ain't the sexiest CEO on twitch shedGurt
jay_al97: could    the terminal
st47ik: LUL
CaptCalifornia: the boomer is back online PepeLaugh
Nubadoxd: Hey George, how are you doing today?
0om4ar: hey man what do you think of golang ?
kektobiologist: not using vscode in 2019 FeelsWeirdMan
ytazn: this is quick and dirty
st47ik: Vanilla JS is better than React for this case LUL
kokokaik: aggressive typing
forkdb: @santiago_lhc Please accept my friend request on twitch
rektiw0w: they make it better as u progress through the tutorial
ytazn: sometimes u gotta do quick and dirty
fluzfluz: hi georgehotz
sirvapealots: @rektiw0w here, learn bad habits and fix it later Kappa
sirvapealots: @rektiw0w a bad habit will eat you alive
printhellosailor: react is not the best... but it's popular, and usable
forkdb: What is the meaning of noob
rektiw0w: @sirvapealots well yea...
foxubu: Is the title of the stream still valid?
rektiw0w: @sirvapealots however the point of it is to teach u of the basic concepts and not good practices
foxubu: Oh thanks
ytazn: the title is great
fwef64: deprecated is not pronounced like that
electriclime: PeerJS is a wrapper for WebRTC that makes it very simple to use.
sirvapealots: @rektiw0w learn the basics the worst ways possible Kappa
0om4ar: @kyyllu, golang is definitely the future
Pryetranka: LUL
estrangedHD: supported on chrome &amp; opera, it's not like they use the same engine LUL
ytazn: yeah redux is way complicated i hate it
Nubadoxd: But ain't you a god amongst coders, you don't need to practice senpai Pepeflower
two_eight: webrtc doesn't work on firefox?
sirvapealots: @rektiw0w learn how to lift weights by using the worst forms possible, so you'll ruin your joints forever Kappa
kyyllu: @0om4ar yea I really like it
forkdb: Sing something george
Serbius: @georgehotz you should make it so it can select to random people in chat to play against each other
colanzio5: check out redux if you wanna refactor out state from components
ytazn: LUL
Vinndy: no
sirvapealots: @georgehotz @rektiw0w learn how to lift weights by using the worst forms possible, so you'll ruin your joints forever Kappa
kyyllu: @champ900 self driving cars in js lets go
jay_al97: the p2p gh repo was a troll
Nubadoxd: @georgehotz but ain't you a god amongst coders, you don't need to practice senpai Pepeflower
sirvapealots: @Nubadoxd he had to sign an agreement with Sony to stop hacking their playstations in the future LUL
YouPowerRush: 1 2 3 go
0om4ar: implement it from rfc 😡
sirvapealots: @Nubadoxd that's old news though :)
kyyllu: @nubadoxd he is doing this just to satisfy the lads
kyyllu: c:
Nubadoxd: @sirvapealots I know, LUL he's probably just bored
Vinndy: i spent the weekend learning node js and react but got kind of demotivated cause it's too many frameworks and they change all the time
sirvapealots: @Nubadoxd bored? nah, he seems to keep going :)
Nubadoxd: The simpletons in chat KEKW
directrix13: you just pin the files in IPFS, you don't really upload
kyyllu: @vinndy node and react wont go anywhere for a while dude, chill
sirvapealots: @Nubadoxd keeps on going with good ol' coding :)
Quad___lol: simpletons and singletons in chat jokerd6Kekmad
kratosboii: PogChamp
two_eight: Pog
forkdb: What is pog?
two_eight: PogU
anguscupcake: I'm a quadruple
sirvapealots: @forkdb Pog means Pog PogChamp
Nubadoxd: singletons... we're in George's chat, theirs only players here @quad___lol
0om4ar: add bbtv emote
Nubadoxd: PogChamp
sirvapealots: Loading........................
kratosboii: can someone explain to me whats going on
kyyllu: self resolving tic tac toe?
two_eight: copy past every medium article you find. modern web development PogChamp
TuleFTW: i feel better about myself knowing george hotz also copy pastes from medium articles
sirvapealots: Loading..............
ytazn: is ipfs better than heroku?
Quad___lol: heroku is better :]
kyyllu: tic tac toe startup incoming
directrix13: @georgehotz you want the ipns name so that it reflects changes going forward
sirvapealots: POGGERS
sirvapealots: WORKS LUL
Nubadoxd: It's the one their using tho shedLife
sirvapealots: P O G G E R S
Nubadoxd: KEKW
frediiiez: fetching /etc/passwd
razr22: LUL
kektobiologist: can someone copy stuff from his pc?
razr22: scanning file tree as we speak
1monkjuice: whats the difference with ngnix and this?
crazywulf770: maybe index.html works?
two_eight: p2p speed LUL
ytazn: if you fetch from your computer does your computer not need to always be on
ytazn: i have no idea
two_eight: build react
Nubadoxd: @georgehotz will you let the games begin? I feel that chats going to get bloody when the tic tac tow action begins DarkMode
sirvapealots: @georgehotz it has to be uploaded to IPFS i suppose
QED__: 5Head
directrix13: is your firewall blocking incoming connections
W1lkins: mac firewall Kappa
sirvapealots: @QED__ hey, hotz is a legend unlike some pleb streamers LUL
anguscupcake: @georgehotz favorite textbooks?
Nubadoxd: He's the man, the legend Geohotz
W1lkins: 50 Russian peers Kappa
sirvapealots: @georgehotz make your own repo Pog
kratosboii: @anguscupcake probably wikipedia
sirvapealots: @georgehotz likely your files haven't uploaded yet
kratosboii: lol
god_damn: i wish i had peers
mdrake_: i am peerless
rektiw0w: @god_damn me too
kratosboii: !keyboard
two_eight: HHKB
kratosboii: 5y
glitch3dout: Check the console
kratosboii: ty*
sirvapealots: @georgehotz try a video
Counteron: How is the app being built on the cloud?
YouPowerRush: 3 2 1 go
Counteron: exactly
sirvapealots: POGGERS
directrix13: @georgehotz you want to use the ipns name so that we can reference updated versions
directrix13: otherwise the hash updates with every new change
champ900: @georgehotz just use ngrok
sirvapealots: @champ900 so how is it better exactly?
sirvapealots: try opening it in a new tab
1monkjuice: looks like this is descentrilized in contrast to ngrok
directrix13: oooh private information reveal
two_eight: this is some pied piper shit
sirvapealots: @directrix13 public key :)
Serbius: so how does ipfs work?
directrix13: but it's just the directory in the current state
rektiw0w: ipfs looks cool
sirvapealots: @georgehotz post a link here so we can try it LUL
residentsleeperrrrrrrrr: lets hack some sony devices!!
georgehotz: https://ipfs.infura.io/ipfs/QmfWYwhPjzBHcdaN2bhwDYU8WuDHBZhvwQUCQvBokUu8JK
1monkjuice: ddos incoming
empathiie: nothing happens
gonzaloquintas: isnt loading
sirvapealots: not loading LUL
unique_ptr_: dont work boi
razr22: LUL
directrix13: that gateway is ass
yaus_baus: uptime?
two_eight: need MORE seeders
sirvapealots: @two_eight need more seeders Kappa
dorkmo: "waiting for ipfs....."
hotpotato325: what computer u using?
Nubadoxd: @georgehotz So like I'm a newbie, can you explain briefly what your are doing
two_eight: the matrix PogChamp
dorkmo: "Gateway Timeout"
directrix13: @georgehotz I think that gateway isn't working well
ragemaster999: have you already leaked your ip?
gonzaloquintas: gateway timeout
sirvapealots: @georgehotz what ports does IPFS use?
W1lkins: 22 Kappa
sharmouta: what you up to today yung georgie
jay_al97: https://www.npmjs.com/package/simple-peer
kingkong3211: https://github.com/ipfs/go-ipfs/issues/6383
sirvapealots: don't spam links LUL
sirvapealots: Actually write what you're saying
two_eight: try this random npm package :)
sirvapealots: @two_eight EXACTLY LUL someone understands my sentiments
ragemaster999: just run it on an instance
Jonzuk: you use mac?
sirvapealots: @Jonzuk he doesn't Kappa
Jonzuk: lmfao
w9cceixh24b23ouiljlhmyp1: FYI cloudflare leaks ur IP @footer
sirvapealots: @w9cceixh24b23ouiljlhmyp1 it pulls from IPFS; Calm down dude
rektiw0w: maybe we give up on ipfs?
sirvapealots: @georgehotz yeah you may have to open up a port
directrix13: @georgehotz are you sure your firewall isn't blocking outbound from ipfs?
WarSwick: Did you ever complete the iphone Jailbreak you were doing last time on stream?
sirvapealots: @directrix13 ISP's block ports; you need to use higher ports, to route things :)
directrix13: right, but so does any firewall running on that computer
lchowderl: What kind of keyboard do you use boss man?
harmanthebest1: new series self compiling compiler
sirvapealots: @directrix13 yeah but that's easy to resolve, compared to ISP's blocking them
sirvapealots: @directrix13 just use higher port numbers 4Head
sirvapealots: @georgehotz now you feel the pain of network engineers LUL LUL LUL LUL LUL LUl
Gentris: !time
Gentris: !uptime
sirvapealots: webui should work Pog
yaus_baus: middle finger on forehead = big brain time
sirvapealots: LINK AGAIN
sirvapealots: POGGERS
georgehotz: https://cloudflare-ipfs.com/ipfs/QmfWYwhPjzBHcdaN2bhwDYU8WuDHBZhvwQUCQvBokUu8JK/
carbonchain: So slow
gonzaloquintas: nothing yet
dorkmo: "waitingggg'''''
unique_ptr_: just loading
rektiw0w: the title loads...
directrix13: can anybody pull /ipfs/QmbM8nAZJkTyAQM7c3EyeH2Y2xhqzS6wfcoBG9FKn1jut4 ?
1monkjuice: looks like its not serving the src's
rudolphdoesgames: loaded
vmarkushin: loaded!
sirvapealots: maybe cloudflare haven't recognized it yet @georgehotz
foti_kasparov: loaded
1monkjuice: yeye
gonzaloquintas: im in!
XeroKool: Works
Arksam: Keepo
Datamaskin: works
gankeomenores: works
Ziv0: works
yaus_baus: worked
gankeomenores: i won
nicovzq: hotz u r the man!
champ900: i lost
zeroeagle1: damm i lost
zeroeagle1: fking hard game
yaus_baus: cheats for this??
W1lkins: just beat whatever idiot was playing against me, ez
CSbps: works
zeroeagle1: feel better :)
carbonchain: some tricks ya @zeroeagle1
gonzaloquintas: when players tie, it keeps saying whos next
sirvapealots: THE REAL CHALLENGE LUL
zeroeagle1: will you put that on ur resume for the world changing startup
sirvapealots: @georgehotz you need sessions
Jonzuk: how much do you make on AI
yaus_baus: 3.50
adibaby04: i thought this was regex
whichtom: that was a while ago
crazywulf770: i would not learn react if i am rich... so maybe he is broke
crazywulf770: :-D
georgehotz: https://github.com/geohot/twitchtactoe
leopp: !uptime
georgehotz: pull request for tie?
zeroeagle1: will you put that on ur resume for the world changing startup
Arksam: LUL
dorkmo: pull request for connect4 plz
rektiw0w: me :)
CaptainAshtar: oyy web :) nice you do even web ...
CaptainAshtar: wtf
CaptainAshtar: you are a serious person Hotz ...
Nubadoxd: I don't know what I understand less, what chat says sometimes, or h
flips_hope: LUL
CaptainAshtar: StinkyCheese
Nubadoxd: George's constant 4 head touching shedLife
Nubadoxd: He's re
Nubadoxd: my God this keyboard sucks ....
BiszkopTT: js god
th3_maj0r: 17yo hack iphone, 30yo create tic tac toe
BiszkopTT: @th3_maj0r the journey
nicovzq: hahahah
CaptainAshtar: haha
YouPowerRush: 123 or wat ?
rektiw0w: @th3_maj0r MuLTIPLAYER* tic tac toe
th3_maj0r: oh
CaptainAshtar: he created skynet
Nubadoxd: wait George is 30? shedShock
directrix13: all data goes into state
Arksam: Twitchtactoc*
nicovzq: !uptime
BiszkopTT: worldwideeeeeeeee
yaus_baus: george is Timeless
nicovzq: !help
real_selkie: react sucks
Ziv0: it does need to be in a state
BiszkopTT: @real_selkie STOP
leopp: make it battle royale tic tac toe
Arksam:  Jebaited /
W1lkins: create a constructor
W1lkins: and do it in that
CaptainAshtar: make it 3D opengl tic tac toe
WendellSwan: i always enjoy watching these streams but i never have any idea whats going on
Nubadoxd: Oh yeah, this is a lot better. shedPat
HuntMePls: @georgehotz you can use variables in a class as long as they are in a constructor
nicovzq: @WendellSwan same
yamchah2: show us your vimrc Pog
restitutione: put in {}
yaus_baus: its on his git
yaus_baus: configuration repo
WendellSwan: i know how to print hello world in python
anguscupcake: this is good coding ASMR
W1lkins: add it to a constructor in Game
Nubadoxd: ASMR KEKKW
Nubadoxd: KEKW
restitutione: { variable }
two_eight: those topre sounds Kreygasm
kingkong3211: @georgehotz this might be useful https://github.com/madou/react-peer
Nubadoxd: ^
yamchah2: 9 line vimrc what a legend
yaus_baus: real coder vimrc
Ziv0: LUL
yaus_baus: lmfao
michael_laurent: LuL
A_Big_Sandwich: LUL
two_eight: typescript version of jsx
rektiw0w: tsx monkaS
frediiiez: LUL
Jo__: LYL
Nubadoxd: KEKW
Jo__: damn
CaptainAshtar: why this guy is screaming?
Jo__: LUL
brisingr1031: @georgehotz a car
nicovzq: hahahha
data_day_life: tittysex, obvi
yaus_baus: TSX????
XeroKool: LUL
NeolexBZH: @georgehotz why did you stopped hacking ?
MuscleMario: typescript is what ppl write w/ but yeah, it iz 3 much
yaus_baus: DELETE THIS
jbyte1988: pinga
foxubu: :D
Nubadoxd: tittysex KEKW
W1lkins: make an issue on Github Kappa
reaganchisholm: looool
HuntMePls: LUL
directrix13: modified javascript I believe
yaus_baus: someone clip that
directrix13: like template language or something?
Jeppelelle: impeach tsx:ers
data_day_life: ismCOP
foxubu: George is gonna fry their repo with a friendly pull request lol
nicovzq: why ppl make it so complex? D:
yaus_baus: is this just an excuse for george to write js?
Nubadoxd: Well... is it?
Brohanson: limmySteel
mlgdotca: =&gt; binds the context of this cuz js is fukt
yaus_baus: tsx confirmed trigger
nicovzq: !donate
jay_al97: tsx is typescript and jsx
Nubadoxd: ^
rektiw0w: so compiling it will turn it into regular react jsx?
HuntMePls: tsx comes from typescript, its a javascript library that provides javascript with variables type-checking like declaring a variable int or string
yaus_baus: tic tac toe battle royale???
benakiba: Pog
mkc0de: @georgehotz ohh react. what's with discord?
logicssoldier: Typescript is great but luv u
Santiago_LHC: #vanillaJS
zoki_macola: George is boomer
rektiw0w: forms in react are not nice
Nubadoxd: @georgehotz can you add particle effects for when someone wins/loses/ties? shedHeart
Santiago_LHC: kids nowadays getting fancy with them frameworks
directrix13: Typescript is Javascript#
Jewishrambo: do preventdefault
god_damn: @Jewishrambo doesnt need to submit so theres no need
JdPaulBlart: lmao i just got done making tic tac toe using gtk in c   nice timing
mkc0de: chat has he created discord server?
trchaosTR: this is the first time i see a mod in george's chat
Nubadoxd: They are silent snipers shedScared
reaganchisholm: pass the onclick event to get the value
chagasf: this.connect.bind(this)
logicssoldier: you do have an event ;)
Abnormmall: this.onSubmit.bind(this)
rektiw0w: u have to save the value of the box into state
reaganchisholm: onClick={ (event) =&gt; handleClick(event) }
mkc0de: just use arrow func
reaganchisholm: access the value with event.target.value
reaganchisholm: something like that
mkc0de: bind for boomers
logicssoldier: oh right you need to setState w/ text box input onChange event
W1lkins: just add an id to the element and rip it out of the page with document.getElementById LUL
logicssoldier: FailFish
Santiago_LHC: #vanillaJSshit
directrix13: oh lordy
yaus_baus: ok Boomer
mkc0de: var NotLikeThis
chagasf: you can use ref, or state
GOLDSOULTHEORY: var Pog
logicssoldier: onChange={event =&gt; this.setState({name: event.target.value})};
directrix13: ^^^
chagasf: onClick={this.connect.bind(this)}
logicssoldier: you dont have to bind
jay_al97: use =&gt; so you don't have to bind
logicssoldier: ^^
FlySociety2o9: not bind need3ed
Nubadoxd: ^
logicssoldier: lambdas preserve scope
logicssoldier: so no need to bind
do_not_erase: onClick =&gt; connect()
logicssoldier: connect = () =&gt;
W1lkins: since it's in a lambda now you actually need to call connect
W1lkins: this.connect()
logicssoldier: connect should be a lambda!!
W1lkins: before it was invoked automatically
gseven_: this.connect() not this.connect
dorkmo: tic tac toe player lobby
ruslik_: LUL
two_eight: don't discuss a man's monitor size
Arksam: riPepperonis
GOLDSOULTHEORY: LUL
yaus_baus: lmao
anguscupcake: bruh monitor size is OFF LIMITS
kytos1k: LUL
Jo__: ahahah
httpsdubdubdotcomm: lol
yaus_baus: just had to do it to em'
dorkmo: Corgo1
logicssoldier: dont disrespekt the monitor size
Vilebiscuit: Hi guys, I am planning on learning machine learning. Where do you guys recommend I start, udacity or some other place?
Santiago_LHC: #IGUESS
Forbaya: lmao
yaus_baus: bro george is the best
BiszkopTT: had to do it to em
martinkirilov: because monitor size and keyboard aren't preferences, you better have same as him or you will not be approved
httpsdubdubdotcomm: small monitor and loud keyboard... was that the insult ...wud i miss..?
do_not_erase: onClick={ () =&gt; this.connect() }
httpsdubdubdotcomm: just tuned in
yaus_baus: no keyboard talk here
directrix13: does react have a virtual dom?
restitutione: yes debugger;
BiszkopTT: @do_not_erase dis
yaus_baus: no hardware talk
Vilebiscuit: Hi guys, I am planning on learning machine learning. Where do you guys recommend I start, udacity or some other place?
martinkirilov: @yaus_baus no talk
Forbaya: yeah don't talk here please
do_not_erase: Your setting the value of connect not calling the function ^^
yaus_baus: @Vilebiscuit check out sentedex on youtube
BiszkopTT: this chat is my safe space so just shh
two_eight: just start listening to what your machine is saying. that is the first step to learning
kytos1k: SeemsGood
logicssoldier: @do_not_erase BlessRNG
logicssoldier: check out @do_not_erase
bsx1123: @Vilebiscuit fast.ai is the best ml course on the web
anguscupcake: dont click that link
tornpaperyoyos: @Vilebiscuit https://www.udemy.com/course/deeplearning/ https://www.udemy.com/course/artificial-intelligence-az/
do_not_erase: onClick={ () =&gt; this.connect() }
BiszkopTT: dont need the braces i think
Vilebiscuit: thanks a lot guys
yaus_baus: i heard siraj raval can teach you AI in 5 minutes
whichtom: lmao
kytos1k: LUL
BiszkopTT: no u need my bad Kappa
httpsdubdubdotcomm: @Vilebiscuit opencv may help along your learning path. idk
W1lkins: yaus_baus LUL
init2: Hey, guys, what's up?
deadbeatdad7: just smoking weed and watching the stream bro 👍
kytos1k: SeemsGood
Vesh: im out of weed some one for me aswell @deadbeatdad7
NonTrivial778: are you on drugs right now?
yaus_baus: is coffee a drug
BiszkopTT: debuggin with console log is best kind of debugging
BiszkopTT: @yaus_baus yea its a stimulant
ragemaster999: we need a leaderboard
El1T3MaN: @georgehotz you live in a studio apartment?
tornpaperyoyos: im ready im ready im ready
Bitcoin__: I remember making a Ultimate Tic Tac Toe game in VB.Net when I was younger
brisingr1031: @georgehotz what kind of ice cubss do you use?? /s
iron_lasagna: maybe Ninja will play it :)
martinkirilov: gonna be a long stream, cool
two_eight: need hook up google ads as well
walktheabyss: walktheabyss subscribed with Twitch Prime.
yaus_baus: microtransations please
martinkirilov: ingame life purchases
Santiago_LHC: It also needs a DLC
KNOOKEL_HEAD: React PogCHamp
BiszkopTT: dlc with battleships
martinkirilov: every turn is 100 bits
KNOOKEL_HEAD: PogChamp
Santiago_LHC: Needs accomplishments
brisingr1031: ratirlFlex
MrTriharder: Geohot doing JavaScript DansGame not my george DansGame
martinkirilov: and hours played
Luccaasss: what programming language is that:
Luccaasss: ?
yaus_baus: paypal george 5$ to have blue X instead of black
tornpaperyoyos: are we ging to have player skins as well??? @georgehotz
iron_lasagna: Needs loot boxes
httpsdubdubdotcomm: can we bet wit bits with this game?
schadowman: @Luccaasss js
Santiago_LHC: @Luccaasss JS
rauluz: yo guys, u can use react for back end too?
martinkirilov: we need X and O skins
BiszkopTT: @Luccaasss js and framework is react
two_eight: @Luccaasss modern javascript :) beautiful ain't it?
okeeeeeee: can you implement this variation? https://en.wikipedia.org/wiki/Ultimate_tic-tac-toe @georgehotz
MrTriharder: @georgehotz are u working with WebRtc
rektiw0w: setState george
MrTriharder: oh hes using simplepeer.js
MrTriharder: cool library
MrTriharder: had used it for video calling SeemsGood
kratosboii: oh no
MrTriharder: PogChamp
razr22: pog
MuscleMario: lol
W1lkins: PogChamp
iron_lasagna: PogChamp
KNOOKEL_HEAD: PogChamp you're nuts
Luccaasss: you're a jeanus
init2: SuperHaxor!!!111
frediiiez: PogChamp
Abnormmall: LMFAOOOOOOOOO
kytos1k: PogChamp
kratosboii: PogChamp
Bitcoin__: !donate
MrTriharder: No Server communication PogChamp
ragemaster999: PogChamp
garam_chai94: PogChamp
mixxaww: PogChamp PogChamp
cjocol2201: Kreygasm
Abnormmall: PogU
dekassssss: Pog
garam_chai94: !uptime
nesbyy1: Pog
martinkirilov: PogCahmp
martinkirilov: PogChamp
init2: EIEIO
KNOOKEL_HEAD: same port PogChamp
luismario0o: He did it, boys
yaus_baus: lmao
soiax_: PogChamp
Luccaasss: PogChamp
bsx1123: PogChamp
init2: !uptime
dorkmo: Party1
Dynasmite: port for console Pog
Thobrik: you enjoying this nerdz?
KNOOKEL_HEAD: goated on the stickz PogChamp
JdPaulBlart: next step: use minimax to calculate best move
MrTriharder: @JdPaulBlart or just do if else and write AI Kappa
martinkirilov: FakeClick, the maintainability Kappa
KNOOKEL_HEAD: those clicks Kreygasm
LaunchpadFun: @georgehotz made the PR for the drawn game btw.
kratosboii: god bless vim
kratosboii: and the poeple who made it
KNOOKEL_HEAD: wasnt it just 1 guy
kratosboii: god bless that dude
yaus_baus: bram
JUST_5HEAD: nice branch
deR_Ed: states.PLAYER_X
matejsninja: you need to states.PLAYER_X
josergdev: states.X
edargorter: I used double DQN for tictactoe ... proved quite effective.
deR_Ed: 5Head
matejsninja: or make const { PLAYER_X } = states;
Cjiq: What are we coding today?
rektiw0w: @kratosboii what makes vim so good?
ragemaster999: use a regex to check the winning condition, for them memes
kratosboii: @rektiw0w r u not watching lol
rektiw0w: @kratosboii well compared to other editors?
razr22: LUL
deR_Ed: golang would like to have a word
kratosboii: just a lot quicker... no bloat too lol
yaus_baus: Tabs in TSX
rektiw0w: computers are fast nowadays a lot of stuff runs fast enough
MonkaSupreme: give link
ragemaster999: use a regex to check the winning condition, for them memes @georgehotz
MoProject: why not use ML algorithms, is a lot faster and less code
kratosboii: not talking about that.. takling about the actual fle editing
Maw3rick: WutFace
rektiw0w: let me beat u on tic tac toe, but promise not to ban
KNOOKEL_HEAD: create-react-app PogChamp
matejsninja: you can make just if(!conn) { }
jellyjar: no cap, as a noob, this shit is impressive to me
ronniesmiths7: How old were you when you stated to program?
KNOOKEL_HEAD: 1
Santiago_LHC: -2
rektiw0w: george learned how to program right out of the womb
tornpaperyoyos: MEEEEEEEEEEEEEEEEEEEEE
fourhundredtwenty: me PogChamp
rudolphdoesgames: not me
kingkong3211: me
kratosboii: meeeeeee
Maw3rick: Lets roolllll
tornpaperyoyos: MEEEEEEEEEEEEE
rektiw0w: i challenged u first
ragemaster999: me
Raiwo: PogChamp
httpsdubdubdotcomm: imma watch
el_pirulote: not me
LaunchpadFun: @georgehotz got the PR ready for Drawn game
TuleFTW: me?
edargorter: tactic toe
httpsdubdubdotcomm: but thanks for streaming @georgehotz and good job with the tic tac toe
crazywulf770: we need a player name field
anguscupcake: tic tac toe makes me angry
georgehotz: https://cloudflare-ipfs.com/ipfs/QmaVi2KEGhvuaK82YCP4SmARMCUV8sJw1f1AWQjeJHnurD/
MonkaSupreme: hcidzdgohxc00000
georgehotz: 2nthkcj2o3w00000
YouPowerRush: DIE DIE DIIE
kingkong3211: eibdntbf4v500000
edargorter: 1oqy54qjumu00000 remote peer id
mrgh0st0: va83o50qe0000000
ragemaster999: broken
Maw3rick: That was me ez
JUST_5HEAD: lmfao
KNOOKEL_HEAD: LMFAO
KNOOKEL_HEAD: AHAHAHAHA
deadpool_reynolds: hahah
mdrake_: we're in
razr22: DEAD LMAO
rudolphdoesgames: u1r6f3yzzaf00000
kratosboii: LOL
razr22: draw
razr22: LUL
httpsdubdubdotcomm: so wait now tic tack toe is a thing.. Can you build tetris next?...
god_damn: george is really about it
frediiiez: LUL
Santiago_LHC: Sick action
Jo__: stream snipe
Caene: 69xjvbxeak300000
georgehotz: rpw4h1g20k000000
anguscupcake: damn that was intense
LaunchpadFun: Yes I did
mdrake_: LIT
yaus_baus: sweating
razr22: very competitive match
martinkirilov: pmmt9opj61q00000
kratosboii: lmao
smakatak: ut0wvx3obek00000
zoki_macola: knees weak, arms are sweaty
MonkaSupreme: 0b0gr288m5sm0000
martinkirilov: tie
razr22: hahahahahahaa
UniversalGeneve: LUL
god_damn: LMFAOOOO
Hunted9000: hajm74e72j500000
god_damn: HE TWIRLS
SuchALuckyGuy: World Championship right here
anguscupcake: I'm on the edge of my seat
mrgh0st0: 4z3cixnh62q00000
MonkaSupreme: LUL
kytos1k: LUL
frediiiez: LUL
tychus07: LUL
httpsdubdubdotcomm: congrats!
razr22: q2p7uqb32gc00000
MonkaSupreme: tunpvcs2reg00000
httpsdubdubdotcomm: hell ya good times
cjocol2201: TakeNRG
Nelzex: yo what editor is that in your bash terminal
tornpaperyoyos: y7w8sgyaejc00000
kratosboii: PogChamp LUL
yaus_baus: hype
UniversalGeneve: real inspiring stuff.
Ziv0: LUL
MoProject: hahah
god_damn: FUCK AMAZON
frediiiez: LUL LUL
piccibrah: yayay boiiii
whichtom: LUL
edargorter: 1oqy54qjumu00000
rektiw0w: 7h79bqn8n5800000
BambiPT: fuck googleeeeeeee bruuuu
kingkong3211: loololo
FlySociety2o9: LUL
MorningScifi: haha fuck google we have tic tac toe
mixxaww: LUL
yaus_baus: future is here boys
KNOOKEL_HEAD: TRUEEEEEEEE LUL
kratosboii: HAHAHAH
HorseRacing4Life: @Nelzex it's vi
El1T3MaN: what server he used to deploy it on?
anguscupcake: yea fuck facebook we have react
speeddrawing101: TRUEEEEEEEEEEEEE
SuchALuckyGuy: WutFace
Nelzex: MIDDLE OUT ENCRYPTION!!!!
Xaotic: is he using vscode?
zoki_macola: neighbours are wondering right now
GeneralSoak: its the new new internet?
Nelzex: HOOLI CHAT
Hunted9000: cym6wjrc42a00000
JUST_5HEAD: Kappa
kingkong3211: congress doesnt do shit
FlySociety2o9: HOOLI
tychus07: fuck facebook -&gt; react yo
god_damn: please say it louder for the people in the back
dawgwhisper007: omg shut up
Harm133: dont you work for google LUL
LaunchpadFun: @Xaotic Vim
alexdickson98: ni1s6q46kqq00000
alreye: you were a intern at facebook.. why you trashig them
imamazing87: PogChamp
frediiiez: TRUE
AbnerSK: 2wizgjltt6z00000
Xaotic: Hooli
dawgwhisper007: you might end up working there
dawgwhisper007: stop
schadowman: you worked for google LUL
jellyjar: time to meditate again
tornpaperyoyos: dch1k5gz3sw00000
Hunted9000: 1p41wvgm26b00000
init2: Evilcorps
yaus_baus: george dont work for the man
SHINO5454: Richard?
smakatak: Hooli &gt; PiedPiper
dawgwhisper007: this is recorded you know
FlySociety2o9: George to Google confirmed LUL
picklesareok: but google says do no evil LUL
dawgwhisper007: stop!!!
razr22: 2wi37bbfndg00000
alreye: He's mad because he got fired
Nelzex: MIDDLE OUT ENCRYPTION 4.00 weisman SCORE!
init2: @georgehotz What do u think about school 42?
Caene: weEEEeEEeee aRe tHe iNtErNet
MorningScifi: we'll become our own google... with blackjack.. and..
rektiw0w: would u work for elon musk?
FlySociety2o9: HAHAHAHA
UniversalGeneve: @georgehotz GANs for next stream?
SuchALuckyGuy: Well there goes his possible internship
yaus_baus: go off george
chagasf: hahahahahahahaha
alexdickson98: 3841rg8p8bv00000
Santiago_LHC: #COMEATME
JdPaulBlart: beat sony now hes gonna beat google PogChamp
zoki_macola: so much energy
speeddrawing101: YOU ARE SO HYPE @georgehotz
smakatak: 5.4 wiseman score
imamazing87: any gifters in shifters
suteki1: cw2l18irx8h00000
chaprio1: george would rather work for sony
TheNakedFlame: Hacking Google with Tic Tac Toe React sodaAgent
dawgwhisper007: so you are the best dev in the world?
alreye: We need decentralized comma ai
Nelzex: 6.0 WEISMAN SCORE
kingkong3211: make a decentralised interned
suteki1: pfxjb7eiae000000
kingkong3211: internet
garam_chai94: LUL
KNOOKEL_HEAD: F A C K GOOBLE
god_damn: LUL
Artistxtv: @georgehotz did you teach yourself everything about coding?
tychus07: LUL yo shit don't work yo
MonkaSupreme: LUL
frediiiez: @alexdickson98make your move bro
kratosboii: LUL
Nelzex: 7.0 WEISMANN SCORE
alexdickson98: d86wl6leaqw00000
AbnerSK: n36h0rt8ev000000
alexlucas_: PogChamp
dawgwhisper007: you just learned about regular expressions!!!
Alevsk: if someday i see you on the streets can i ask for a selfie with you?
rebuhleiv: what do you think about that ipfs files are not persistent? you cant be safe that your files get lost
asafshshshsh2121: 1ik51jvbjyc00000
sultantw: send the link
Celestial_Jaeger: @georgehotz did you go to uni and where?
yaus_baus: george living in 4050
dawgwhisper007: @georgehotz you just learned regex!
smakatak: I just got 8.2 Weismann score beat that motherfckers
httpsdubdubdotcomm: okay @georgehotz may we build some AI to compete against?
tornpaperyoyos: ayyyy that was me
alexdickson98: @georgehotz make it so that it is random who starts not always the guest
AbnerSK: o0pttlzg2ms00000
suteki1: 890rm25kwb000000
frediiiez: @asafshshshsh2121 gg
Nelzex: mIDDLE out EncryTIon! PIED PIPER WAY GANG SHIZZLE
LaunchpadFun: @georgehotz I have a PR opne for Draw
kingkong3211: why 2020 though?
dawgwhisper007: @georgehotz the rant is immortalized forever!!!
restitutione: @georgehotz Ultimate tic-tac-toe would be cool
chaprio1: who's gonna torn them apart tho
SilvanoGJr: here's a dude from Brazil thankful to this guy for allowing us to have iphone's in our local carriers
FargioFarmani: ifl5gompu8000000
tychus07: tic tac to is stupid make the one with 9 tables (kinda like sudoku)
Nelzex: yo geo how u get so good at vim and shit
Artistxtv: @georgehotz did you teach yourself everything about coding?
kratosboii: Hopefully torn apart because theyre scum bags
KNOOKEL_HEAD: @georgehotz how do i invest in IPFS PogChamp
Ziv0: tic tac toe battle royale when?
asafshshshsh2121: @frediiiez gg
frediiiez: @suteki1 gg
jrogan993: nah the new stuff will be hobbyist FANG will rule forever
my_curiosity: what do you mean shape up?
dorkmo: the only way f
suteki1: @frediiiez gg
Nelzex: !keyboard
Maw3rick: SeemsGood
TheKoreanZombi: Code review!
FargioFarmani: ofm5vns29rq00000
W1lkins: winner == 'draw' DansGame
tornpaperyoyos: @georgehotz do it one mo gain
rebuhleiv: ipfs files are not persistent. what to do about it? the files are lost if nobody is seeding
frediiiez: @FargioFarmani you won m8
smakatak: Guys we need AGILE SCRUM this is a chaos
kingkong3211: @georgehotz do you take interns at commai.ai
jbyte1988: 0hir9zoyocqn0000
FargioFarmani: lmao @frediiiez
alexdickson98: keeps sending ids @chat
httpsdubdubdotcomm: has anyone messed with the open bci yet? curious on openions.
frediiiez: @FargioFarmani LUL
MorningScifi: Yes can we have a 1 hour meeting where we talk about the future of this project
MorningScifi: hahaha
Caene: I mean, it's JS, it's supposed to look like shit.
archeadis: whats the one line for that in python? @georgehotz
tornpaperyoyos: @georgehotz play again
alreye: @georgehotz Explain why please
KNOOKEL_HEAD: @georgehotz how do i invest in IPFS PogChamp
jrogan993: decentralized internet will never become mainstream
FargioFarmani: lhrgketpez000000
GeneralSoak: yeah torrents are back
yaus_baus: @alreye bro the gov is coming for our tendies
alexdickson98: @georgehotz have u wath tv show silicon valley
Nelzex: GUYS HOOLI IS THE FUTURE
Nelzex: HOOLI CHAT
LiIDrunk: future of ads though ?? LUL
frediiiez: @FargioFarmani gg!
SilvanoGJr: @jrogan993 horses are faster
bytecube: @georgehotz did you ever look at the iota protocol?
god_damn: limewire is making a comeback
FargioFarmani: again you? @frediiiez
alreye: @yaus_baus but but but... why?
razr22: h8yzwlvgaa000000
frediiiez: @FargioFarmani lmao yes
rektiw0w: d83plm12m7000000
Ziv0: LUL
JUST_5HEAD: LOL
Vesh: LUL
chaprio1: LOL
Celestial_Jaeger: decentralized OMEGALUL
ragemaster999: LOL
Alevsk: fail
KNOOKEL_HEAD: lmfao
schadowman: decentralized LUL
FlySociety2o9: LUK
Vesh: lmao LUL
god_damn: LMFAOOO
chaprio1: google already on it
chaprio1: KEKW
yaus_baus: limewire: nickleback.exe
frediiiez: @rektiw0w gg i won Kappa
GeneralSoak: why'd you give up on the self driving stuff
rektiw0w: @frediiiez nooooob easyyyyyyyy
Ziv0: there's also peertube
frediiiez: LUL
kytos1k: jeah like emule serverless
kingkong3211: do you take interns at commai.ai?#
LiIDrunk: google just completed 6500 mile private undersea cable
Artistxtv: @georgehotz why do programmers use macOS?
rebuhleiv: george. can you elaborate on how and where the files at ipfs are stored? if nobody is seeding you loose your files! so you need a server which is not decentralized
chaprio1: monkaS
chaprio1: banned
Caene: @GeneralSoak Google.
yaus_baus: @kingkong3211 no comma talk here
FlySociety2o9: monkaS
NonTrivial778: can you win this competition https://www.youtube.com/watch?v=qQ-56b_LvOw ?
hmmmu: i prefer redtube
archeadis: @georgehotz do you watch porn? real talk
kingkong3211: do you take interns at commai.ai?
god_damn: maybe you cant
bytecube: @georgehotz did you ever look at the IOTA protocol?
hoffs: should comma be nationalized
Celestial_Jaeger: i just wonder why is it not allowed to be discussed? is there something involving the law
kratosboii: really miss when porn was decentralized too !
rektiw0w: so how do u feel now as an indie game developer? @georgehotz
alexdickson98: @georgehotz do you think everything is invented?
Yeahsper: @archeadis Who doesn't?
archeadis: @Yeahsper george might not
init2: @georgehotz the consiracy bigger than all of us
GeneralSoak: do you still work on it full time?
init2: The top one percent of top one percent
my_curiosity: but the thing is
LiIDrunk: yea true
frediiiez: @georgehotz Have you seen Mr. Robot?
NonTrivial778: thats porn geohot
god_damn: @jbyte1988 no ones laughing
suteki1: @jbyte1988 shut up degen
alexdickson98: dont enter the link its porn @georgehotz
Celestial_Jaeger: science is discovered, engineering technology is invented
rektiw0w: @jbyte1988 good troll man wow u are funny
zoki_macola: there is dtube also
speeddrawing101: @GeneralSoak you're close to getting banned, not allowed to talk about comma in here buddy
NonTrivial778: dtube is garbage
alreye: yo yo yo brotha you need some mods
zoki_macola: maybe idk
yaus_baus: mods afk
Fatmetheny: @jbyte1988 George ban this dude
alreye: @yaus_baus mod is busy checking out the link LUL
suteki1: @jbyte1988
schadowman: works real well Kappa
LiIDrunk: you are saying gov provide hardware reqs for people ??
Vesh: jbyte
LaunchpadFun: spamming
Vesh: ban his ass
alexdickson98: @jbyte1988
kratosboii: jbyte
bytecube: @georgehotz i would like to hear your opinion on the IOTA protocol. https://www.iota.org/.
tornpaperyoyos: @jbyte1988
yaus_baus: yeeted
Vesh: cya nerd HeyGuys
LiIDrunk: you are saying gov provide hardware reqs for people ?? @georgehotz
KNOOKEL_HEAD: LUL what a cuck
suteki1: @georgehotz what keyboard do you use? Kappa
dorkmo: twister.net.co
KNOOKEL_HEAD: AHHAHAHAHAHAH
yaus_baus: bro i have 1000 iota coin
yaus_baus: feelsbad
god_damn: LMFAOOOO
frediiiez: thoughts on Monero @georgehotz
tornpaperyoyos: "quantum computing resistant" wtf LUL
LiIDrunk: you are saying gov provide hardware requirements of internet for people ??
yaus_baus: /s/s/s/s/s/s
bytecube: haha, thanks 😀
razr22: f
KNOOKEL_HEAD: LUL
alreye: @georgehotz what do you think of tron?
MorningScifi: everyone divested the moment you said it
yaus_baus: bro they stole my iota
my_curiosity: "real coin" - do you mean the US dollar?
KNOOKEL_HEAD: TRON LUL
MonkaSupreme: buy buy buy
suteki1: FeelsBadMan
ItsKalu: Have you tried doing any AR apps ?
frediiiez: any thoughts on Monero? @georgehotz
dawgwhisper007: what the fuck you dont know how to say ternary??? @georgehotz
dorkmo: iota.org clip art lol
Xaotic: cant believe he is using chrome instead of mozilla lol
elite_elite1: criticizing google and using chrome LUL
dawgwhisper007: ternary operator : ?
kratosboii: sponsored by IOTA
god_damn: 🤨 ah my brain i see... right...
mdrake_: spintronics LUL good god
W1lkins: ternary and trinary are related dawgwhisper007
Caene: Fuck em
Vjasal: sure Kapp
alreye: @georgehotz It sounds like these guys are actually thinking about the future...
KNOOKEL_HEAD: IOTA ? sell : buy thats the real ternary
mdrake_: nice
yaus_baus: ill be laughing in 2050 when ill buy twitchtactoe with my iota coins
init2: Troika? Is that like Russian triple?
Vjasal: brain comping technology :o
hmmmu: that looks like my homework
W1lkins: iota ? implement own crypto badly : take off the shelf crypto
ChocolaateRain: harvard boys LULW
roletro: they were sudents
crispi____: LUL
yunidoo: hi @georgehotz, first time i've seen your channel, are you regularly on twitch doing programming/tech?
Artistxtv: why is @georgehotz not verified on twitch @twitch lmao
Quad___lol: crypto is my favorite scam
Santiago_LHC: They wrote a paper. It has to be serious Kappa
god_damn: B) SPEARHEADING INNOVATION
W1lkins: Vulnerabilities must march on :)
KNOOKEL_HEAD: LMFAO
crispi____: LUL
frediiiez: any thoughts on Monero?
anguscupcake: lol
MorningScifi: spoken like a true cult leader
MorningScifi: haha
mariusmafius: pompous marketing shiet
dawgwhisper007: they are harvard kids though
NonTrivial778: we are not smart as you
TuleFTW: u heard of ben goetzel?
ckrpasa: you should upload a setup video for open pilot on youtube because when people heard something different they looks it on youtube
Vjasal: spearheading technology PogChamp
Quad___lol: Progress must march on! We will accomplish 5 year plan in 4 years!
kratosboii: geo, please spearhead crypto
wiseai: KEKW
LiIDrunk: whats made for everybody should be approved by everybody as well
imlewpie: @georgehotz how did you learn ML in the beginning ?
yaus_baus: this is a decentralized cult @MorningScifi
alreye: @georgehotz they sound like alyssa holmes LUL
roletro: it's pronounced ket-chak
KNOOKEL_HEAD: sPEaRheaDIng tEChn0LOgY
imamazing87: @georgehotz what keybored good for programming ?
adibaby04: https://github.com/adiprerepa vet my github
TheNakedFlame: George spearheaded Tic Tac Toe technology 😎
tornpaperyoyos: @imamazing87 whatever feels good for you or is your favorite
frediiiez: any thoughts on Monero @georgehotz ?
wiseai: Kappa
hmmmu: Kappa
god_damn: gods work
yaus_baus: george ruining my crypto portfolio
yaus_baus: feelsbad
KNOOKEL_HEAD: TETHER OMEGALUL
KNOOKEL_HEAD: TOTALLY BACKED
yunidoo: hi @georgehotz, first time i've seen your channel, are you regularly on twitch doing programming/tech?
alreye: @georgehotz what do you think of TRON?
imamazing87: @tornpaperyoyos thanks &lt;3
mariusmafius: "lost"
Sarkin_dota: @yunidoo no
whichtom: it is rather disconcerting how many of these are scams
hmmmu: thoughs on NEO @georgehotz
LiIDrunk: in the end all of the crypto will drown anyway
ragemaster999: tether is backed up with real currency right?
frediiiez: how about Monero?
MonkaSupreme: ETC
Santiago_LHC: When are we making our own crypto on stream? Twitchcoin?
yunidoo: thanks @Sarkin_dota so how do you guys know when he's here?
ELITEGAMS: 13 is okay but shady
alreye: @georgehotz TRON bought bittorrent
kratosboii: short all scam crypto
picklesareok: what do you like about the others?
Arksam: What about brave's Basic Attention Token (BAT) ?
r000sh: F crypto. Now everyone must dive in AGI. LoL
Sarkin_dota: @yunidoo , you can turn on notifications
KNOOKEL_HEAD: @georgehotz Tether has more volume than BTC which is pretty concerning
dawgwhisper007: unnecessary enemies
LiIDrunk: F crypto
anguscupcake: chainlink?
Sarkin_dota: @yunidoo will tell you whenever he goes online, which from my experience, is like once in 2 weeks or so
revenantrazer: how do you gauge what is a scan or not?
kajizzlewat: @georgehotz NANO seems very interesting
GOLDSOULTHEORY: What constitutes a cryptocurrency being a scam?
dawgwhisper007: @georgehotz unnecessary enemies what if they invested in comma.ai
daxyxy98: zcash just pays the founder an insane tax OMEGALUL
frediiiez: do you have Monero?
yunidoo: @Sarkin_dota ah, so no advance notice, ok thanks for your help
unique_ptr_: i only belive in dogecoin
snapcs1: so many people investing when they dont understand shit
alreye: All these coins defeat the purpose of cryptocurrency...
daxyxy98: its dead
smurfd0: isnt crypto overall dodgy?
elite_elite1: @georgehotz why do you use chrome instead of firefox?
ezraflag: bitconnect Kappa
Quad___lol: someone should mark a pyramid schema based on crypto...
Quad___lol: make*
daxyxy98: zclassic made bitcoin private which was kinda scammy
alreye: biiittttconnneccttt
adibaby04: @georgehotz vet github i want to be roasted https://github.com/adiprerepa
Alevsk: what about Stellar Lumens? they are giving away for free from time to time to keybase users
School47: zcash is a scam. YOu can't be sure about total suppy of coin @georgehotz
anguscupcake: lmao
KNOOKEL_HEAD: @georgehotz Tether has more volume than BTC which is pretty concerning
ChocolaateRain: zclassic is a fork of zcash great classic
whichtom: i don't get the point of crypto
imamazing87: best strean every &lt;3
imamazing87: stream*
hmmmu: should i sell my house and buy btc cash?
snapcs1: yes
revenantrazer: lol
School47: @hmmmu yes
Maw3rick: RPGAyaya
Quad___lol: @hmmmu yes absolutely
Santiago_LHC: LOBBY
KNOOKEL_HEAD: you should do React more often PogChamp press 1 if you agree
Artistxtv: to this day i still don't understand how bitcoin works lol.
NonTrivial778: I think Elon Musk loves ethereum
elite_elite1: @georgehotz checkout siacoin/sia tech. thoughts on it?
BambiPT: sell you virtual soul and buy btc cash
alexdickson98: @georgehotz the player starting should be random not always guest
alienware997: alienware997 subscribed at Tier 1. They've subscribed for 3 months! Greetings from germany!
dorkmo: Party1
M03x: what he s working on ??
hoffs: decentralized internet
snapcs1: it says in the title?
Anakat: twitchtactoe
josergdev: a9bmiu1k1eq00000
LiIDrunk: make it work without sharing peerId
KNOOKEL_HEAD: peer to peer tic tac toe @M03x
M03x: @KNOOKEL_HEAD for twitch ?
KNOOKEL_HEAD: for anyone
mailboxbandit1: Hey man been a fan since the iPhone unlock. I'm from upstate New York and was wondering how your time at RIT was?
chriswolfdesign: @georgehotz, I'm a novice web dev looking into publishing my own web apps. What service are you using and how much does it cost?
okeeeeeee: fw9ffeun9r000000 :)
LiIDrunk: use rsa
Maw3rick: @okeeeeeee link
LiIDrunk: to gen key pair as peerId
do_not_erase: how do you force window to side like that on mac?
jmc516: Base it off a queue
jmc516: All I got
MorningScifi: What do you want the lobby to do?
LiIDrunk: use rsa to gen peerId
ELITEGAMS: lobby like a room ?
ragemaster999: have you googled it?
W1lkins: do_not_erase using spectacle
schadowman: not decentralized MonkaSupreme
zeroeagle1: do you have an event or something when someone disconnect?
MorningScifi: Will the lobby auto match people?
josergdev: what
tornpaperyoyos: DAMN IT I FUCKED IT UP
jrogan993: will the lobby have skill based match making?
alexdickson98: automatch is better than lobby
LeeRoy_227: you could have won that one
Vjasal: missed lethal
grey_street: missed lethal
NackterZeuS: NackterZeuS subscribed with Twitch Prime.
yaus_baus: tictactoe elo
ELITEGAMS: Create a new lobby with maxPlayers. Every time someone joins or leaves the lobby, it will fire a callback event of the form???
tornpaperyoyos: I was so close lol
alexlucas_: elo rank
hmmmu: george u need an mmr system with ranks
W1lkins: MMR system Kappa
Cjiq: 11   4 Kappa
chocolatechp: abosolutely
Vjasal: add chat
MorningScifi: Have a button for trash talk and a button for positive vibes
yaus_baus: 5k mmr tictactoe
KNOOKEL_HEAD: Rank 1 Peer To Peer Tic Tac Toe Player PogChamp
TheNakedFlame: Create skins for tic tac toe boards
revenantrazer: @hmmmu do you play dota?
NackterZeuS: cheers
unique_ptr_: should create a rank system then you can create a skill based lobby :D
yum72: and paid skins for 'O's and X's
daxyxy98: daxyxy98 subscribed with Twitch Prime.
hmmmu: @revenantrazer sadly yes
Alevsk: add a subscription plan
okeeeeeee: all tic toc tow pros played dota
revenantrazer: @hmmu nice
razr22: fill the page with g ads
jellyjar: needs more microtransactions
KNOOKEL_HEAD: your vim theme is so ugly i actually love it
tornpaperyoyos: YEEEEEESSSSSS
tornpaperyoyos: I WIIIIIIINNN
gutschilino: @georgehotz why do you have a smartwatch?
zeroeagle1: how will you handle when someone disconnect?
tornpaperyoyos: MY LIFE IS COMPLETE
revenantrazer: doa 4 by 4 tictactoe
yaus_baus: @KNOOKEL_HEAD thats what unriced vim looks like lol
soisoisoi: put that in your resume
tornpaperyoyos: i can die happy now that i beat goergoe at tic tac toe LUL
KNOOKEL_HEAD: @yaus_baus unriced LMFAO
hmmmu: @georgehotz where can i buy cosmetics?
tornpaperyoyos: thats getting printed out and put on my refrigerator LUL
W1lkins: unriced is the normal word for it KNOOKEL_HEAD
unique_ptr_: next steam: learning photoshop to create skins for my tictactoe game, implementing microtrasaction
KNOOKEL_HEAD: put that on your resume @tornpaperyoyos
VOR0R: What version of node is he using?
Quad___lol: @georgehotz i see you are good in react. good! our company needs talented react programmers!!! :) what do you think?
yaus_baus: @Quad___lol bruh...
KNOOKEL_HEAD: @W1lkins ok k still funny
tornpaperyoyos: @KNOOKEL_HEAD i will LUL "Oh and i also beat george hotz at tic tac toe" YOURE HIRED IMMEDIATELY
revenantrazer: make thsi version of tictactoe: https://qr.ae/T9aW3h
snapcs1: @W1lkins its definitely not lmfao
Quad___lol: @yaus_baus are you also joining? for you, i would have to an interview tho :/ it looks you are just a poor student trying to learn something here
schadowman: LUL
josergdev: a simple chat
cromed56: !uptime
W1lkins: snapcs1 ricing is the word, so unriced means it hasn't been riced
cromed56: yo george, how long till A.I reigns?
imlewpie: @georgehotz how did you learn ML at first
snapcs1: @W1lkins ight enjoy being racist
ncdoru: ncdoru subscribed at Tier 1. They've subscribed for 2 months! Keep up the good work ;)
hmmmu: you need to add VOIP so we can trash talk
unique_ptr_: can you get all of the available id-s? if you can, you can just need to pair them :D
yaus_baus: @Quad___lol im just saying labeling george as a 'react dev' is kind of inaccurate
metis_zver: Why are using React for this game? It's so strangely
W1lkins: snapcs1 it stands for Race Inspired Cosmetic Enhancement. Nothing to do with race bro
Quad___lol: @yaus_baus how come? he is a perfect candidate??!!! he is mastering css and doing some javascript rocket science
th3_maj0r: He is using this game to learn react
Quad___lol: next project - twitch chat voip?
unique_ptr_: @Quad___lol with webrtc i think it is possible
LiIDrunk: create a table of openpeerId's on home page
Fr3fou: hi!!!
Fr3fou: i didn't know you were into react
httpsdubdubdotcomm: xmpp
Fr3fou: :s/var/let/gi
LiIDrunk: create a table of public peerId's on home page which update every time a user connects
Fr3fou: pls
treestompztv: var DansGame
Quad___lol: have i seen a var? cmonBruh
Quad___lol: watchu mean var cmonBruh
domas3210: @treestompztv LUL
KNOOKEL_HEAD: LUL
Poselsky: Why no ( ) =&gt; { } ? Kappa
matejsninja: im always fascinated about people making open source projects like webrtc and etc
Fr3fou: don't you need some server for P2P
Fr3fou: how does peer.js work
r3mote: Hi
Fr3fou: or backend w/e you wanna call it
W1lkins: peer.js wraps WebRTC Fr3fou
Fr3fou: hm
okkessh: why would you need a server for p2p?
KNOOKEL_HEAD: it wouldnt be p2p then
W1lkins: p2s2p Kappa
Fr3fou: kek
httpsdubdubdotcomm: @matejsninja rtmp stuff is alot of fun to research
Fr3fou: yea i thought it was p2s2p
Fr3fou: or smsht
okkessh: is p2s2p even a thing lol
piccibrah: lol
Fr3fou: idk
KNOOKEL_HEAD: it is now LUL
Fr3fou: it's what i was imagning
Fr3fou: PeerServer To broker connections, PeerJS connects to a PeerServer. Note that no peer-to-peer data goes through the server; The server acts only as a connection broker. PeerServer Cloud If you don't want to run your own PeerServer, we offer a free cloud-hosted version of PeerServer. Official PeerServer!
Fr3fou: 🤔
Fr3fou: what's broker
Poselsky: My dream is to write on keyboard like George. &lt;3
unique_ptr_: broker like in mqtt?
okkessh: it just gets them paired
W1lkins: Poselsky reach for the skies
Poselsky: @W1lkins I'm pretty tall. But not that tall. Kappa
matejsninja: can p2p be for more than 1-1? (probably stupid question :P )
whoislewys: oh chips we doin webRTC?
frankytex: I'm here to learn zie basic
davidabeauchamp: davidabeauchamp subscribed with Twitch Prime. They've subscribed for 2 months, currently on a 1 month streak!
Fr3fou: !uptime
martinstuessy: hey @georgehotz I made a cute lil pull request
fQrgotteN: Did you not use breakpoints?
Fr3fou: what should be in componentDidMount
Fr3fou: tbh
Fr3fou: instead of window.onLoad
Fr3fou: @georgehotz
Fr3fou: that*
Maw3rick: RPGAyaya
im_francuzz: for being a really good programmer what vote of importance you give to mathematic/physic? (in a scale 1/10) @georgehotz
schadowman: LUL
KNOOKEL_HEAD: try using componentDidMount instead of window.onload()
chocolatechp: LULLUL
chocolatechp: LUL
wiseai: hasMods
Fr3fou: @georgehotz yea what @KNOOKEL_HEAD said - make the peer connection in componentDidMount
Fr3fou: and also what's the thing you use which lets you snap windows left and right
Fr3fou: yes
Fr3fou: in game
KNOOKEL_HEAD: no
Fr3fou: should work there
KNOOKEL_HEAD: actually yes in game
KNOOKEL_HEAD: my bad
TheKoreanZombi: spectacle on mac to snap windows
Fr3fou: thanks @TheKoreanZombi
NoPartiesGuy: Why peerjs and not socketio?
Fr3fou: socket.io needs a server
Fr3fou: i guess that's what confused me
1kocer66: hello everyone
Fr3fou: since i've had to use socket.io before and was wondering why does peer.js not need one
ppnn123w: tomorrow is my react test lul
NoPartiesGuy: @Fr3fou that explains a lot
NoPartiesGuy: @ppnn123w people having react tests what LUL
tornpaperyoyos: what is george using to write all of this code?
martinstuessy: @Fr3fou uses webrtc, it's like newer websocket type thing
matejsninja: vim
Fr3fou: yea ik now @martinstuessy
treestompztv: you can ignore that for now
NoPartiesGuy: @tornpaperyoyos good luck learning it for next 2 years :D
martinstuessy: @Fr3fou :)
W1lkins: @georgehotz add .map((i, number) =&gt; { &lt;li key={i}
Fr3fou: @georgehotz you need to pass a key so react can know what has changed in the virtual DOM
davidabeauchamp: Just give them a key of the index
ppnn123w: @fr3fou coding test components lifecycle and stuff
Nelzex: how are u making the peer ids?
crazywulf770: nickname field would be cool
Fr3fou: cmonBruh
KNOOKEL_HEAD: LUL
NoPartiesGuy: Everytime you use getElementById in react some small kitten dies Kappa
Fr3fou: bruh
Fr3fou: Everytime you use getElementById in react some small kitten dies Kappa
dorkmo: someone needs to submit a PR to twitchchess with ipfs code
manuchroma: what's he doing today
KNOOKEL_HEAD: getElementByID and window.onload is the new way of using React ! LUL
kzonixcomua: lanaluHacking
TheZeroLimit: lift the seat! Kappa
smakatak: Everytime you use getElementById in react some small kitten dies Kappa
unique_ptr_: this is similar to writing C code in a C   17 project
Santiago_LHC: i43zp6bwi8000000
KNOOKEL_HEAD: if it works it works baby
Fr3fou: @georgehotz pls do :s/var/let/gi
kzonixcomua: writing C code in a C   17 project it is normal practice
W1lkins: someone will refactor the whole thing after this stream in a single PR i'm sure
alreye: Don't use var use let
Fr3fou: me @W1lkins
schadowman: @kzonixcomua Thats not a positive
Fr3fou: uwu
estrangedHD: @W1lkins why after, they're typing as he is Kappa
Nelzex: u can hear the crisp topres in that mf hhkb
Nelzex: mmm
Nelzex: crispyy
Fr3fou: what's your opinion on go after having written in it @georgehotz
Nelzex: @Fr3fou go syntax is difficulllly
crazywulf770: lobby hype
KNOOKEL_HEAD: PogChamp
LiIDrunk: you gotta add the status
TheKoreanZombi: Best lobby
Nelzex: bruh im a fookin c# noobski trynna get good at pythoon
LiIDrunk: in game or waiting or gone
l_mbert: You don‘t need „window.“, don‘t know if anyone said this :D
Nelzex: do people actually make react native apps for android etc
Fr3fou: i have sorta
Fr3fou: for 2 hackathons
Fr3fou: which i both won 😎
Nelzex: oh nice
Nelzex: litty
KNOOKEL_HEAD: @l_mbert its the same thing but yeah
Nelzex: where do you live
Fr3fou: bulgaria
Nelzex: aint no hackathons near me
Nelzex: oh shit
Nelzex: i aint got no excuse :D
treestompztv: list.map
Fr3fou: there's one every few months
l_mbert: @knookel_head yeah, but it‘s obsolete :D
Nelzex: is it online or in person?
Fr3fou: in person
Nelzex: nice
Fr3fou: have had to travel 4  hours for some
Nelzex: oh right
treestompztv: a.map(x =&gt; console.log(x)) is preferred I think
Fr3fou: worth it tho
Nelzex: ye it sounds like a lot of fun
Fr3fou: and stressful
Fr3fou: kek
haxiwage: is he using webrtc?
kzonixcomua: yes
kzonixcomua: peerjs
anguscupcake: @georgehotz how do u have infinite energy
unique_ptr_: @haxiwage just peerjs
Fr3fou: he's on drugs @anguscupcake
haxiwage: okok
that_turns_me_on: anguscupcake high testosterone
Nelzex: is there a way to make android apps in python?
Fr3fou: for in loop @georgehotz
Fr3fou: oh
Fr3fou: if that's what yo uwant, sure
Nelzex: hah
Nelzex: i want projects to practice python
Nelzex: but idk what
Nelzex: throw some my way if u have
MoProject: its no good to charge at 100%
LaneBoyR6: Tic Tac Toe game ?
Fr3fou: implement a ghetto blockchain @Nelzex
Nelzex: i was thinking tic tac toe
Fr3fou: with p2p
Nelzex: ghetto alt coin lookin ass
Fr3fou: yea
Fr3fou: it's fun tho
Nelzex: iota lookin ass
Fr3fou: i've done jahcoin
Nelzex: aight bet
LiIDrunk: you also gotta remove those who already joined a game
W1lkins: use componentWillUnmount?
KNOOKEL_HEAD: ^
anguscupcake: @fr3fou what drugs
Nelzex: how tf do u use vim
ragemaster999: @Fr3fou can i invest?
Nelzex: shits difficult
W1lkins: delete x;
W1lkins: LUL
Jannnik: delete obj.prop
reaganchisholm: reaganchisholm subscribed at Tier 1. They've subscribed for 2 months, currently on a 1 month streak! :)
anguscupcake: kratom?
LiIDrunk: you also gotta remove those who already joined a game
AnAnonymousCheerer: Anon1
Ziv0: ocr
erlsek: github
Noxique: is GitHub blocked in china?
claymorehack1: yes
chaprio1: Is there something unblocked in China? monkaS
Noxique: are there any alternatives?
Noxique: o.o
LoLskiller1: yes, use vpn, then use github
Nelzex: ye
syska: pog
LiIDrunk: add a replay button
chocolatechp: me
iFun: Lol no
iFun: GitHub is not blocked in China
NV17: Is that a bed in the kitchen?
Caene: link :)
kelbs: didn't copy first letter of link
archeadis: @georgehotz how do you connect to the IPFS on port 5001?
wiseai: china 5Head
Maw3rick: @Caene https://cloudflare-ipfs.com/ipfs/QmaVi2KEGhvuaK82YCP4SmARMCUV8sJw1f1AWQjeJHnurD/
LiIDrunk: add a play again button for rematch bw same users
archeadis: how do you run it?
kelbs: You didn't copy it. Put the 'h' in http into your link
Caene: @Maw3rick Thanks
Maw3rick: Np
savlon: I know this says simple skills but come on, this is childs play... get on with it
Maw3rick: Hell yeah
lolcoolkat: yeah you forgot an h in the url when you copied it
NV17: which web browser is the best?
okkessh: why was I unable to connect to you
okkessh: while you are debugging
archeadis: is it go-ipfs?
georgehotz: https://cloudflare-ipfs.com/ipfs/QmRoBbkZCPKp7wK36uA3u5xBsBjzJnvGetioGn2pRxwBG3/
Fr3fou: have you tried implementing IPFS yourself is it fun @georgehotz
okkessh: dont you use the peer.js default api ke y
Arksam: LUL
W1lkins: I don't see any user list
httpsdubdubdotcomm: this is cool
httpsdubdubdotcomm: i enjoy
Caene: I won one!
Santiago_LHC: I'm adding some sick CSS styles to PR
MuscleMario: lol
LiIDrunk: no user list
LiIDrunk: showing up
unique_ptr_: mama! my peer id is on the screen!! mama got the camera!
KrrSplat: KrrSplat subscribed at Tier 1.
Zhrun: Put user count
johnny_thehobo: damn he actually learned react in 2 hours and made tic tac toe online
KNOOKEL_HEAD: LUL
schadowman: damn this actually works so well LUL
Nelzex: u need to clear the board when game finishes
Maw3rick: Gotcha MATE
Lugueiro: send the link pls
iFun: iFun subscribed with Twitch Prime.
altic: 5Head
chocolatechp: lol
chaprio1: Gz Pog
treestompztv: PogChamp PogChamp PogChamp
Maw3rick: ahhaahhaha
ᅟᅟᅟᅟ: LUL
Ricoello: LUL
Bioaim7: pog
Maw3rick: @georgehotz WP
razr22: ???????????????????/
iFun: lol
fear_ep: LOL
razr22: lmao
johnny_thehobo: get pwned
MuscleMario: Staged
LiIDrunk: lol
KrrSplat: nice
dorkmo: Corgo1
savlon: are u on drugs?
wiseai: PRO GAMER
chaprio1: paid actors smh
tornpaperyoyos: let it be known that george is now only 1-1 at tic tac toe LUL and a lot of draws
Brohanson: limmySteel
KNOOKEL_HEAD: absolute dogshit software PogChamp
lolcoolkat: need a way to leave the current game.. cause the person I connected to isnt playing :(
KrrSplat: giggity
razr22: i missed the link
lolcoolkat: https://cloudflare-ipfs.com/ipfs/QmRoBbkZCPKp7wK36uA3u5xBsBjzJnvGetioGn2pRxwBG3
KNOOKEL_HEAD: immutable dogshit software LUL
treestompztv: gg
razr22: thanks
zeroeagle1: part 2 twitch p2p chat?
Arksam: StinkyCheese
ragemaster999: gg
wiseai: what chair you use for coding? Kappa
httpsdubdubdotcomm: cya @georgehotz thanks for doin stuff
martinstuessy: @georgehotz check the PR :)
KNOOKEL_HEAD: LUL
xrealyy: more stuff like this please @georgehotz
bluedick69: its broken in firefox
NV17: GITHUB Link?
yum72: I get no users
VOR0R: check PRs
Caene: Next stream: Guess Drawing Game, 5man lobbies. Kappa
syska: i won lol
georgehotz: https://github.com/geohot/twitchtactoe
unique_ptr_: now i have some silicon valley flashback
bluedick69: fix in firefox!!!
wiseai: PJSugar bathroom break
lolcoolkat: nothotdog Kappa
ragemaster999: you may or may not play against bots right now
LiIDrunk: did you tried wasd keyboard
Vesh: cooking stream george?
LiIDrunk: i saw it in a video
savlon: did u have playstation @georgehotz
KNOOKEL_HEAD: if you use firefox just dont use firefox
ppnn123w: waiting for Rick and Morty
okkessh: what api key did you use
MuscleMario: Wuts for lunch?
savlon: hack
lolcoolkat: NotLikeThis
okkessh: in peer.js
martinstuessy: @georgehotz most life changing PR in your repo bro
colanzio5: @georgehotz do you think you'll do anything with redux?
Maw3rick: This was really fun stream SeemsGood keep up the good work!
alreye: @georgehotz you bug.. the opposite player got two tries before I went
savlon: did u hack playstation???? @georgehotz
ragemaster999: you may or may not play against bots right now
KNOOKEL_HEAD: you should do React more often SeemsGood
Divulger1: &lt;message deleted&gt;
unique_ptr_: now make some skins and get millioner :D
LiIDrunk: mac and cheese for subscriber milestone maybe ??
zakonegrusha: hackerman stream
zakonegrusha: still a skid tho
okkessh: which api key did you use
Vesh: PogChamp
wiseai: PogU
anguscupcake: what u use for energy
YouPowerRush: sikk
MuscleMario: Cooking streams
okkessh: then why couldnt I connect to you
Caene: you could easily apply for partnership and most likely get it. :P
Vesh: did u apply for partner yet? cause if u dont apply u dont get it
rektiw0w: we had twitch staff earlier in this stream, so there might be a chance
Artistxtv: how ur not a twitch partner is beyond me
okkessh: this whole time I just tried to make a connection
dawgwhisper007: yeahh
LeeRoy_227: LeeRoy_227 subscribed with Twitch Prime.
NV17: How does make money?
unique_ptr_: u need to stream more for partnership, your viewer number is great
erichtp: if u become partner can you stream on youtube?
zakonegrusha: how do I play tictac
KNOOKEL_HEAD: PogChamp HACKER
johnny_thehobo: can you do a stream where you pull one pleb and teach him programming?
dawgwhisper007: @georgehotz cooleratiz
MuscleMario: yeah, gimmie my twitter handle
zakonegrusha: guys how can I play tic tac
anguscupcake: how do I shot web
Vesh: me
rektiw0w: me :)
Abnormmall: me :)
MuscleMario: LOL
Caene: probably many here LUL
MuscleMario: I got a pleb for u
Zabak378: me :)
gutschilino: me :)
Divulger1: I would be a pleb
yaus_baus: im pleb
zakonegrusha: HOW TO PLAY TIC TAC
Vesh: id volunteer in a hearbeat
UzeezU: Computationalist manifesto
wiseai: MAKE COMPUTERS GREAT AGAIN Kappa
Lythaslol: Lythaslol subscribed with Twitch Prime.
unique_ptr_: dear 07b136egp8c40000 pls move :(
ragemaster999: you may or may not play against bots right now
LiIDrunk: some rap for the outro
zakonegrusha: is this just a localhost things hes hosting or can I play
yaus_baus: freestyle
MuscleMario: @yaus_baus sup
thedavosfinger: hacker ganster
yaus_baus: @MuscleMario yoyo
zakonegrusha: @georgehotz what is the link to it tho
KNOOKEL_HEAD: LUL
colanzio5: @georgehotz do you think you'll do bigger projects with react and redux? Heard you complaining about state being in view components earlier...
unique_ptr_: 07b136egp8c40000 sorry, i won, next time better :) i think we should implement a chat for this xD
yaus_baus: bye george
Divulger1: he is using HHKB Keybaord
buy them I'm going to be upset I'm never
going to stream again so that's my call
to action uh for you guys when it's time
if you want to see great content uh like
you know what's about to go down right
now I've never actually I don't even
really know what this website
is um hi Clapper s welcome to my chat
room uh yeah we're going to Yo good
morning good morning it's almost 9:00
we're going to play a little hacker rank
I've never played played this before I
think I know what it is but I didn't do
my research because I'm a shit tier
streamer um but all I'm saying is when I
sell you guys T-shirts if you guys don't
even buy 36 t-shirts that's it I'm done
streaming I'm quitting the internet I'm
going to live in a mon Monastery that's
the one where you make monks at Age of
Empires you know H 100 gold bro 100 go
all right let's go let's
go all right what do we got to do oh
hint oh I love when they give me hint oh
type return a plus b oh boom I'm a
genius let's
go this is
slow no it costs 100 gold to make a monk
oh wow they're really my student or
professional I don't know man I'm always
a student that's right no I'm a
professional how many years of
experience do I
have God I don't know know I think I
have down not many that's right all
right
um continue practice oh I can unlock a
badge if I solve more problems okay oh
my God this looks
hard what do I have to
do compare triplets
it created one problem for hacker
triplets blah blah blah blah blah
oh wait this is a joke
really so it's like
this then which way was the less
then Alice receives a
point if a is greater than zero so if x
greater than
y r Sub 0 plus equal 1 LF Al less than y
red is that
right
go oh I shouldn't have just submitted it
oh but I'm a genius that's right that's
right we got on the first try all right
next challenge let's go let's go let's
go let's go all right how we doing boys
how we doing all right we got to move
the webcam is that what I'm hearing we
got to move it all right no no no no no
don't move that no that's
wrong that's
better oh
boys boys we just beasted some shit all
right I must return a
sum of all the
elements wait this is a
joke bro see this is why we use
Python cuz I can just do that and we
don't have to deal with bullshit about
like numbers being the wrong size and
shit CU we use Python let's go boom boom
that's right first try that's right
don't be a noob all right calculate the
absolute difference between the sum of
the diagonals right we take the left to
right diagonal we subtract the left to
right diagonal and we have to ABS them
H what is an array oh it's like a god do
I really have to write this all right
um all right we'll just say like D1
equals that we'll say like D2 equals
this oh yeah yeah buddy yeah you know if
I did any
thinking this could probably be a lot
faster is that right I don't know man
probably
no no we messed up we messed up you guys
got to subscribe to my shit um if you
don't subscribe to my shit then you suck
and we're not going to stream anymore oh
I tyo oh it's ARR oh that was a dumb
typo I should have tested my code oh
that would have been so oh no we messed
up no how are we messing up okay what we
doing wrong all
right uh
don't get it I should be right two
02 Su across the primary diagonal some
across the secondary
diagonal take the absolute value and
subtract them did I do something
stupid oh uhoh uh oh 911 test cases
failed
uhoh can I make the text a little bigger
sure for you bro are you a subscriber
you got to subscribe if you want big
text but I don't understand why it just
works what did I do this is so
stupid
uh the absolute difference between the
sum of the two Matrix diagonals okay I
sum the two Matrix di to 02 1 one
what take the absolute value of the
difference run
code oh they don't have to be 3x3 they
can be biggy Matrix oh no do I have to
write loopy oh not loopy oh that's so
hard okay
for I in
length God range
length ay wow we were so careless on
this one boys we were careless that's
right don't be
careless is that right I think that's
right I don't know we're just guessing
this is a guess
no oh no oh no boys we did it wrong oh
God it's plus one am I off by one all
right I'm getting real sick of
this list index out of range um okay no
we got to subtract one because zero
won't work yeah yeah yeah yeah yeah blah
blah blah BL blah you know what it's
early it's early boys it's
early right all right all right all
right it's early yeah no no I know this
stream sucks I'm sorry I'm sorry oh I
heard a fucking star yeah buddy all
right let's go can I change my camera
position to bottom right you know what
just for you bro did you
subscribe this isn't the content you
signed up for what you don't like my new
programming come on we warm it
up now the other thing we could maybe do
today ah this is so hard
you know what you know what no all of
you ask for this shit in the
comments All you ask the shit in the
comments thank you Narco RL for
subscribing you know I'm sick of all of
you you
know no no you know what no more stream
no there too much haters in the comments
too much haters
no no there too much haters no only
because we have a lot of
subscribers but if I hear any more
haters if I hear any more haters you're
all
done right who's going to who's going to
kick the haters out that's right ban the
haters that's right no no no no just
yeah can we ban the haters no whoa who
said I should develop a thick skin
you're a subscriber you're allowed to
say things like that all
right
um what no no no no no no don't tell me
I'm fucking tired no you know what watch
this shit watch this shit don't tell me
I'm tired you see see you tell me I'm
tired time out that's right that's right
all right who else wants to be banned
all
right who else wants to be banned yeah
thank you ABK for subscribing love when
you subscribe
cribe what's v. oh you want to be banned
okay rther all right all right cool yeah
congratulations enjoy your Fame all
right you're banned all right cool get
fucked all who's
next thank you fox ubu thank you Ivy
lions please subscribe you don't want to
be banned well good you're not banned
all right let's
go um add a sub link and
info I don't know how to do that I don't
have Vim on this computer you want to be
mod no you want to talk shit yeah you're
a subscriber subscribers can talk some
shit oh yeah all right all right let's
go so you don't like Hacker News no
everyone seems to like this look how
many viewers we got we got so much
viewers all right let's
go oh shit what is this plus
minus a decimal representing the
fraction of positive numbers in the
array zer
um m
okay this going to work
all right now we're back on top that's
right that's right now we're back on top
who's talking about the clintons we have
a rule in here it's no politics get
banned all
right who's sending me bits thank you
for sending me
bits congratulations you solved your
fifth code challenge you know
what you know what I'm just I'm in
somebody Skinner box I'm I'm in
somebody's Skinner box that's that's how
I feel right now all right where's is
there more codes next challenge let's go
consider a staircase do these get hard
or are these all
stupid write a program that prints a
staircase of size n oh I see and I have
to make it have spaces wa this is a this
is a joke you know what I'm probably
going to do this wrong so I shouldn't
shit talk too much
for I in
range I think so six actually has six so
we'll just say
print that's actually six all right
let's go from 1 to n +
1 Let's print uh space time i - n + star
time I is that right did I do that right
oh oh you see you can't use you got to
use hashtags not Stars this is for the
Twitter
generation what but they they did I
print
one no what it doesn't like my my new
line can I not put a new line at the end
is that the problem the last line must
have zero spaces in it what it
does wa
I I don't know so these things don't
look like these
things this this is stupid I don't get
it wrong answer because I did that
okay okay okay okay
okay okay guys
like I don't know if I'm dumb but they
look the same to
me they really they look the same
oh let's see my output I can't download
my output it's a formatting issue this
is just buggy crap
F I'm
disgusted no it's not just standard out
flush it's not that I did I just do it
wrong
space
[Music]
um ow what's wrong
but all right let's
go all right
all right all right all right all right
all right is anyone talking sh is anyone
being a hater cuz we ban haters around
here we have zero we have a zero hater
tolerance policy if I had a plate I'd
break it to show how much we're going to
break the haters that's right okay
um
what Su
exactly the minimum and maximum value
that can be some summing each of the
four elements oh I have to be aware of
something let's
read uh do I have to be aware oh beware
of integer overflow oh good point all
right for I in range length AR RR uh sum
AR minus a r r sub I equal a a equals
that shit oh you know what let's use a
list comprehension uh
for H yeah we love list comprehension
it's so comprehensible all right and now
I have to return
what
print
uh two space separated inures for the
Min and the max all right let's go let's
go boys let's
go is that
right yeah
uh no we don't talk about open pilot in
here you get one warning you get one
warning go first semester programming
all right oh I'm in charge of the cake
no okay who gave me this job this is I'm
not I can I can I Outsource
this all right she blows out what return
the number of candles what is she like
short or
something uh an array of integers
representing
candle Heights
what your niece only blows out the
tallest
candles she'll only be able to blow out
the tallest ones oh so basically you're
telling me it's something like uh
sum xal equals Max AR for x and AR is
that
right is that right that's Terri
terrible code look at that that's N
squared this is n s that's
disgusting it's disgusting that you can
write n squ code okay do these get hard
ever or are these like for like you know
the 90% of idiots that like couldn't
pass like fizzbuzz that's kind of how it
feels what I did it wrong what' I
do oh is it too
slow oh do I have wait how big can these
be oh they oh oh they didn't like my N
squared shit oh yeah all right want to
see how we're going to fix this let's
call Mar we're just going to say Mar
yeah would it be nice if like languages
were smart and could kind of do that all
for you oh yeah didn't finish in time oh
yeah got to not write n Square you see
what I'm talking about oh yeah that's
good that's good that's good that's
smart all right cool is that people no
all
right
oh oh this oh this is
terrible all right right time
[Music]
conversion okay uh let's just say ready
for some real
hacks
um H equal int
s02
uh
if S Sub 2 = p P MH + =
return uh
o2d s per
H uh is that right did I do it right
yeah yeah good right let's start let's
go yeah let's go let's go let's go oh no
I did it bad all right what I do can it
be like am or
p.m huh
oh we got to deal with like midnight
shit
uh
yeah is there a good way to deal with
this
if this is not a misy compliant function
you know because it has multiple exit
points
[Music]
uh is there like a smart way to deal
with that
wow I prob did it
wrong compilation error oh I forgot
colons don't forget your colon I think
you need oh
what oh this is stupid
is it that or
that if it's a PM we do that and then
that oh oh if I have five hackos I could
unlock the test case oh my God all right
is the font big enough for you guys yet
make a circular array why is this shit
wrong what I
do that's never zero oh
it's that's not
right this
one is a generic case oh there's
subtlety
oh H + equal 12 um if H not equal to 12
right cuz 12 actually stays the same and
then what do we do if it's zero okay
so um okay so otherwise it's am
IFH = 12 H =
0 there we go
oh you're a big fan oh thank you thank
you thank you for mod
24 what do you mean by mod
24 oh I guess this could have been fixed
by mod 24 and this is kind of just a
bullshit
rule yeah I I know I know I could have
just summed mod 24 I I get
it well no wait no I couldn't have no
it's not mod 24 because 12 p.m. if I add
24 I end up with zero and that's not
right
whatever right are
[Music]
we no I have to like know what which
one's though and I have to leave that
alone oh this is just
painful all right A B CDE e f g hi I
range
from range oh no but then this is Python
3 oh guys I'm kind of
done how this is this is can these be
hard can we find hard problems that
aren't like bullshit
H
okay um a b c d e f g h j k l m o p q r
s t u v WX y z a a equals that all right
now we got to do K so it's a a sub K
plus
uh I could do it without mod guys watch
how you do it without mod is that
right
raw 4 S 4 CNS if CN
AA
um return join
rat if it's in the alphabet what we want
to do is say aa. index C raw sub AA
index C rat.
append yeah don't do plus equals on the
strings you know that's
uh is that right
no okay
well it's wrong
because
else.
[Music]
aeny why did we get a q instead of
a oh I got to deal with uppercase and
lower case
oh
man
um C
dot if
c do2 lower not equal to no but it's not
even in AA at that point
oh all right all right all right all
right is python K sensitive for
variables I legitimately do not know
I could have just done a a.2
upper yeah I know I know you're probably
over there in the comments right now
talking about how I can do this much
smarter but no it's wrong
what I
do oh I can ask my friends for help on
social
media what I
do okay oh look at that oh oh all right
all right all right all right who said I
had to use mod
um
yeah that's right it is basically CTF
code no I love things like this cuz it's
I wish they were a little bit harder and
I had to think a little bit more you
know and not just like oh I forgot the
string oh I got to do the string better
oh I got two stars all right can I sell
this account to somebody so they can
like like go interview somewhere all
right let's let's go find hard
problems 99 points to next
star let's try
this oh these look hard 22 foolish prims
okay
all right this sounds hard hang got
happy we're going to drink some tea
because it's t o00 i be some mac all
right let's
go e
okay next fall and champ thank you for
subscribing to my channel you guys
should all follow his example and
subscribe to my channel let me know that
you appreciate content like
this
ah
okay wow I have to write my own reading
code I don't need to if name equals main
that's
stupid I can just say
like is that
right I actually don't
know I don't usually read things some
though you while reading line something
like this
sorry about the noob junk guys I'm I'm a
Noob everyone knows I'm a Noob but if
you all like Noob don't
subscribe but iFit
what oh God got put parenthesis in the
right order it's early it's
early ah why am I splitting based on
that okay okay okay abstracting agent
thank you for for
subscribing let's see what we have to
do okay we we got we got to
stop talking stupid because those other
challenges were pretty stupid we got to
start thinking thinking
slow okay discs set of discs numbered
one through R Place line random
water what is a partial derangement
permutation of an distinct none of the
items is in its original ordered
position if some not not
necessarily
all okay so if if one thing is out of
position so so exactly
K I'm not really understanding what
natural positions
are sh that given the constraints
the answer can presented is a / B where
A and B are co-prime positive integers
and B is not equal to zero mod some wow
this is okay well this is actually hard
um how do we think about this
number of non Prime
discs and they want an exact
number okay well so we're dealing with
million so we can't use n² stuff but we
could use n log N Stuff
well I don't even what is
Q print the value of P * Q
-1 but there's no other reference to
q and is this the P they
mean this is insanely
hard all right you all wanted you all
wanted I know I know what the minus one
means but what's
Q congrats for claim your reward control
W you know what bad
I know it's a medium right am I just
stupid what what are p and
Q let's see the original problem maybe
they give you
more okay well that seems more
reasonable I know what
what but but what are p and Q that's
what I don't
understand okay well maybe we can figure
that
out yeah yeah I'm looking at the example
so somehow 89 / 315
gets you this which isn't clear to
me like I understand the
probability
uh no I don't think Q is some shit for
math I think I don't know like this
problem just doesn't seem complete
um okay so you're you're saying that A
and B are p and Q and this is like a
typo right a hacker an is kind this
problem I don't think it's like like
this is just
wrong okay so let's say they actually
want
a * B
-1 wow I have to do a modular inverse
for this stuff I
mean and I have to like type it in this
little box I don't know I this is why I
like project you look better I get to
use like sage and gimpy and stuff I
don't know if I can import gimpy
um yeah I don't
no I I get it
um wow this this stream this stream
changed fast into something that's
hard okay uh so I mean I don't even know
is there something built into Python 3
to do modular inverse
yeah I know I can write the thing
but the modulus is prime
what oh P minus 2 that makes sense
because of uh ul's little the little
theorem is that
Prime oh it's
Prime nth smallest 10th digit prime okay
so yeah we can just do that oh that's a
cool identity you guys see the identity
because I mean I
believe so I believe if I say like B and
- one and this should be
one right yeah so that's one so if I
subtract two here oh wow that's really
cute identity all right see I love I
love when I learn
stuff okay so now if we
say this should actually give me the
right answer if we do a * T mod
N I don't know how that all right good
okay well at least now we understand
what p and Q are and yes there is a bug
in the problem
text now we just have to figure out how
to get a and b say the end code thing I
don't know I mean maybe the way the
whole thing works you actually have to
do it o dark mode
o no I don't
like um
okay exactly K prime number
discs are found away from their natural
position I I don't why why does it
matter that they're
Prime
um let's read this this
is exactly 22 prime number
desks
oh exactly K prime number
discs okay so we probably have to
know how many
[Music]
primes there
are and then we want to work it out for
exactly k i I don't know let's try
that
um yeah for some reason I don't think I
can import senpai
am I
cheater no okay is it
inclusive 1 through n so we want to
say
[Music]
range uh so we'll just say capital P
equals map is prime
range all right so we'll
print what what kind of is prime
function is
this never mind never mind I I thought
the internet would be useful for
something they weren't range uh do
square root of
n math. square root
um if
I mod n not equal to one
false what are you guys posting about
stuff
stuff guys know
things map object oh oh Python
3 and that was wrong anyway I'm going to
do
some float cannot be interpreters at
integer thanks
Broski so you only have to check up to
the square root of things to see if
numbers are prime okay I don't know why
that returned
zero if I mod
n oh if n mod I don't get it twisted
there's faster primality checks isn't
there primes is in P
guys oh no okay well so
let let
go okay so this five primes up to 10 so
let's see that's 2 3
5 7
doesn't seem
right I guess it's counting one as a
prime if n less than two return false
because those numbers ain't
Prime yeah that not that thing's
definitely counting one as a prime okay
now that's four Prime sorry that makes
sense
okay X algorithm thank you for
subscribing no I think look the answer
is right because I hand coded A and B
right like we have to figure out what A
and B
are so B is the
denominator um what's the probability
that we have a partial derangement okay
so that's I think the partial
derangement then is the
denominator um is a complete derangement
also a if some but not not necessarily
all Ah that's
just okay well so we
have the numbers 1 through 10 how many
ways could we possibly order them that's
factorial is
this but
see that even already might be a reduced
fraction and 10
factorial I know it's 10 factorial but
okay so then we do know that it's a
partial derangement which means not
everyone is in the correct order there's
only one solution where everyone's in
the correct order so it's n factorial
minus one
right um
and then we want to know what's the
probability that exactly K prime number
discs are found away from their natural
positions okay so I don't
think we have K and we have
P so we want P minus K to
be in their correct position okay so P
minus K
diss total is n factorial minus1 P minus
K diss in correct positions K diss in
wrong
[Music]
positions so now I think yeah I think we
can just say that uh is there python
factorial function or do I have to write
it def fact xal return x * fact x
-1 um oh oh it has to terminate oh you
always have to write the termination
condition um and zero is a stupid thing
so we'll say uh Bal fact n minus one I
think that's right even though B there
changes but that's because they just did
the
reduction okay cool is that right good
my factorial function works that's like
a prime number though I I don't know how
is that Prime
[Music]
well yeah but that's never going to be
315 so maybe I did something wrong
right but that is
okay it could be a partial derangement
does not
include fold arrangement
if some but not NE see this is what
pisses me off about math it's
like dude can you give me a real
definition of this thing I don't
know like it's just it's just it's just
people saying words and the words some
of them mean things and some of them
don't it's cool like there's really good
thought in there but like I don't know
no I mean maybe this is just my
complaint about their language I've
always found like mathematical language
kind of hard to approach
like I don't know but then again it's
not like I guess for me to properly
criticize mathematical language I'd have
to come up with a better way to talk
about this stuff and I'm not really sure
I have
one okay what's the probability that we
have a partial derangement such that
exactly K prime number discs are found
away from
their natural
positions what if it doesn't want to be
a that what if it's a natural position W
that's a
whoa whoa whoa whoa whoa whoa whoa we
don't do hacking on here Alex says I'm
sorry I'm sorry and we people who
suggest hacking it's no we don't do that
anymore um this is what you want to be
seeing thank you I would actually you
know cril I really would I'd much rather
read a formal
definition um than to use the language
and maybe maybe that is really the
solution
okay any number of nonprime discs may
also be found in or out of their natural
positions wait a second
okay what's the probab oh okay no no no
no no so this isn't minus one okay so
the the minus one is wrong
the total is just n
factorial right because it just it the
base rate's not that it's a partial
derangement the partial derangement is
is given so okay this thing should have
a factor of
315 it does
yes okay so now at least we can say that
a is supposed to be 89 *
that right so
real a is that all right cool boom they
follow
that three 11 mod 3 is not equal to one
so we conclude that 11 is not F gold
[Laughter]
gang did I write a bug are you making
fun of me cuz I wrote a bug
um did I write something
stupid okay so we have B now we have to
get n all now we have to get a um so
exactly K prime number discs are found
away from their natural position so that
means yeah first off so this is right
the only ones we care about are P minus
K discs are in their correct positions
Al this is just like an old this is just
choose this isn't that hard if I
remembered like eighth grade Algebra I'd
know how to do this but sad point is I I
don't okay
so these ones in correct
positions I think we can just ignore and
then n minus p dis
in any
position all right so we we yeah take
the coefficient of binomial distribution
it's some crap like that right yeah if I
remembered exactly what that
was oh okay you're right you're right I
told you I wrote some stupid
fck how is the answer still right
no now it's five five is not
right
um
wait equals equals zero oh my God but we
still get the right answer when we do
all that stuff okay go gang thanks for
finding the
bug sorry it's early uh okay
so we P minus K discs in correct
positions so these we only have one
choice for so let's place
them
first place them first no
choices now these ones have to be in
wrong
positions so for each of those we get
one less
[Music]
then yeah so it's like all right let's
just write this stupidly we'll think
about it
later um okay so let's just say uh CN =
n
minus P minus
K
cn- =
1 a * equal uh CN minus1
not in
correct
position or
I
in range n minus
p uh a * equals
CN
any
remaining position
all right so we're off
by
something yeah make sure that should be
zero
right so you have one out of end in
correct order then you select K discs
which you you will
derange the formula for derangements is
simply n/ e what's
E I'm sure there is a simple way to
think about this if I really just
thought about it but let's let's first
make sure I'm on the right track and and
then we can go back and think about what
it is natural log rounded to the closest
integy I never trust things like
that okay so you have them in the
correct order and then you will
select ones which you will
derange no but it's a little bit wrong
because these it's exactly
right because but these these must be in
wrong
positions I think that's what I'm doing
wrong here like
that's what that's what I'm that's what
I'm doing wrong here like this isn't
correct um
don't forget those cadis to prime
numbers the prime number thing doesn't
really
[Music]
matter um what the the only thing that
the prime number thing tells you is what
p is I
think but this is wrong like you can't
just say not in correct position
because well why can't you
the link to the problem it's project
uler 239 but made
generic uh yeah yeah imagination
imagination you're a subscriber so I'm
trying to listen to
you but
I don't know see I I never I don't know
like I don't I don't I just it's hard
for me to just trust that
formula um God wish I do more
combinatorics any remaining position
okay that's definitely right for these
ones no but sort of not
because okay let's just take a
hypothetical case where n minus p is
greater than
K if n minus p is greater than k then we
can plug up all the prime holes with
those right
um all right let's look it
up is this cheating
leaves no element in its original
Place
yeah okay we have 1 three and
six
[Music]
so yeah n subp is greater than K so I
think the answer to this is actually
just
uh CN
factorial it's not always the
case no that's not right either
okay
so P minus K so K is
three it tools permutations is fine but
that's never going to I mean yeah we
could write that I mean maybe it's not
the worst idea but uh uh it's not going
to I think these numbers have to be big
right yeah iter tools
permutations and gets
big
um okay so if we have
three and we know there's four prime
numbers that means three prime numbers
have to be in the wrong place that means
one has to be in the right
place oh but okay it can be any of the
one right so actually is the answer this
times 4 no it's not right
[Music]
either oh combinatorics is
hard you see okay the mistake that I'm
making here and why this is actually
smaller than the answer is that in this
one I've already chosen
the uh I've already chosen which prime
has to be the Frozen one and it can
actually be any of
them all right who wants to write it
with inter tools
permutations just let's just make sure
we understand the problem right
fine
uh it tools
dot
perations range n
so that should make b equal to the same
value I
believe yeah that's
right okay now let's test to see if it's
true so we need P minus
K uh
discs in the right
position K discs in the wrong position
okay so we want to know the prime ones
um for let's say n for I in P if is
prime
I uh this isn't exactly right we want to
say not just P but we want to say a new
umate
p c pause W pause if is prime I so we
only care about the primes if pause
equals equals i c pause plus equals 1
else uh W
pause plus equal 1 if C pause =
equal p- K and
walal K A plus =
1 is that
right if I was on Windows we could run
this all
locally uh
oh well that's too
bad
uh yeah the I know the problem's not
Python 3 uh
no yeah we memoized this PR but didn't
fix it
no I don't do it for fact as well
because I don't use fact very much it's
it's just that this crap's really slow
um okay we have to be
slightly this is fast enough right if we
comment out
this that's fast
uh okay
let's just
say
uh list map is Prime
and
um that's not really what I want I
really just want to go through the prime
numbers check them but that still isn't
that
they're hard right like I'm not just an
idiot right like this isn't like obvious
I don't know sometime I me people are
just way better at math than me and like
it's like oh them oh well don't you just
remember this identity it's like
Jensen's inequality bro I'm
like okay I mean I guess I wish I knew
things like that and then I question
like is it just big builtup pattern
match
or is
it uh like a
real thing to know
umal I okay we don't really have to do
this we can
say
um this map is prime
n just enumerate
M uh maybe filter
Lambda
X actually I can just say filter is
prime range
right that'll just give me the numbers
that are prime and then I can try like r
m in mm
if
uh P sub m = m c = 1
right stupid comprehension
oh okay I think that's
right yeah okay so that's the number I
thought it
was um so now we can actually plug these
things into
uh should work fine it's all
mod okay cool
okay so this implementation does work
it's just a little uh
slow q p and Q are just a and b it's a
typo
um yeah you're probably right about
Frameworks of thought and then
like you know you think about when you
learn Frameworks of thought and I guess
it's at like a really young age and then
you realize that
like the hacker skills are just a
framework too when you just see things
other people don't and I've met people
just see things with this stuff that I
don't um I don't know like I'm I'm not
sure how much it can it can uh you can
learn
this but um if you appreciate this stuff
please subscribe to me I'm never above
Shilling you should never be above
Shilling okay well this is combinatorics
for idiots
um but it is right
so now let's just figure out how to make
this code fast
now this is the kind of thing where this
is a correct
implementation and if the compiler were
intelligent it should be able to read
this code and replace it with the closed
form but as we
know intelligent compilers do not exist
all
right so let's think through what this
is
um I think
it's okay we have we have our three
numbers
here maybe a better way to think about
this is to start with n factorial and
just take out the ones that are
incorrect so we have in
factorial there's some why are they
wrong why does something not
match we need
exactly a certain
number of prime
things to be in the correct place and
that's the reduced form so it's like not
a simple division we need a certain
amount of maybe we can maybe maybe
the the way to think about this is to
uh oh they probably are data mining all
the
code probably the way to think about
this is to
say what's the inverse of this then we
can subtract it from all the
possibilities right so what's the
probability that we have a partial
Arrangement such that exactly K prime
number discs are found in their correct
positions if there are P primes less
than n then P minus K primes must remain
in the same positions yeah yeah yeah
yeah I have
that uh
so let's see yeah we need we
need P minus K and this is like a a
choose kind of thing right so it's p
minus
k out of P we choose P minus
K to be in the correct
positions yeah yeah yeah so this this
correct position and wrong positions
thing is maybe a wrong way of thinking
about
this maybe the right way of thinking
about this is exactly a certain number
must be in the right position I mean and
we can we can we
can oh yeah I mean this is I didn't
actually need to write
that I think I just need to write that
you can check if it's still correct
yeah it's still correct okay so that
that's all we have to think about we
just have to think about
exactly P minus k out of P things no I
know the the whole Prime thing is just a
troll
um so let's let's just give P minus k a
new
name uh
I don't know um P minus K discs in
correct
positions so so it's
like P minus P choose P minus k or
something yeah this P minus K fixed
things but we don't know like you can
choose which one out of those things you
want to be
fixed uh
no but then the other ones are are wrong
right I like
this this this is how I know how to do
things okay so let's just say Cal P
minus k
put that up there we're Computing these
things C pause
yeah so yeah see things are in the
correct place and we can choose out of P
to pick those C things but we have to
pick exactly that
many I always just worry that it's like
beyond what I can do you know I don't
know I don't
know there may just like sometime when
I'm when I'm thinking about this stuff I
I think that like whatever combinatoric
thing this is it took some guy like five
years to discover and then how hopeless
am I just trying to figure this out
right like
like how do I take this and turn it into
a closed
form okay so we
place what what's throwing me off is
like we place
exactly we we we can pick C out of the K
to place exactly in the right place but
then how do we know we're putting the
other ones in the wrong place I guess
that doesn't
matter because
you'll always have
enough out of the other ones is that
true no has to be exactly has to be
exactly that in the
uh in the wrong
place yeah I remember one time I tried
this like RSA thing for days and uh no
luck I posted on my Facebook and
actually Sor solved it of iPhone
jailbreak
Fame I was very
impressed
okay n
factorial or
total let's just let's just play around
with this so let's let's get the ones
that are in
the how many ways are there to pick C
from P so that's like P choose
c yeah binomial coefficients
so we can say something like let's
print uh NCR PC
right so that's the way to
pick
four and also returned a stupid
float of course this four I mean I guess
that's it's obvious right because
there's there's four primes and we're
choosing three so you could just leave
each one out right um so this thing does
divide
four just got to figure out how to get
this number
so we also need now okay so once we've
chosen the ones that we want to
remain
fixed those ones are fixed now we're
left with n minus
C of
which k yeah so we have to deal with the
fact that those ones have to be in the
wrong place so we have to exclude
those which
have is it K in the right
place yeah we have to exclude ones which
have K in the right place so how many of
them are
there well of the remaining ones
um please
subscribe of the remaining ones we
have okay I didn't have to do
that
three that's not true in this
case actually in this case
three of the primes have to be in the
wrong
place three of the primes have to be in
the correct place so then only one of
them is
wrong
um all right
so what if I just
print NCR P2 C so those are the ones I'm
leaving in the correct Place times
factorial of the remaining so this is
going to overestimate
a
uh factorial the remaining is n minus
C so this this number is going to be
bigger than
a we have to exclude some
yeah yeah so then we have to exclude how
many
this
many um
so maybe you can subtract to get that
number all right so we want to
know out
of these how many have
those ones how many have the P how many
have the remaining in the correct
place I don't know what the hypermetric
G distribution
is okay so that the problem with that is
that's counting the ones that
have things in the correct place which
we want to
remove let's try
that
no probably not going to get this by
guessing um
probably shouldn't try guessing Okay
guessing guessing is a bad strategy we
have to try thinking uh
so choose the ones that we're putting in
the correct
Place those are done we don't even have
to think about those
anymore we have n minus C
left C is p minus k
K what is C in this case C is
three I'm getting
confused you know p is
4 C is
one so we choose one
prime to put oh yeah yeah because
because four choose one is obviously
four okay
um we choose one to keep in the correct
place now oh well so there have to then
be three that can't be in the correct
Place
yeah
so it's not exactly fact NC
minus1 um
say minus 3 and let's multiply this by 8
* 7 *
6 is that the number yeah that's the
number we have to exclude
right
uh oh well that's the number we have to
exclude
[Music]
yeah so you guys see where I got 8 * 7 *
6 from because there's there's one less
possibility for each of those
ones um actually maybe the whole
answer no it's not
right uh maybe the whole answer is just
that right because we're choosing the
ones to stay fixed
then of the remaining ones we're getting
it's close I don't know if that means
anything but okay let's let's let's go
back to a simpler
uh so it's that thing I was trying
before that kind of seems right
it gives me that answer again okay well
we know that's not
right again because I'm forgetting
something uh what AM my okay it well so
if
those
choose okay do we have to like place the
other ones
first after we've chosen that that's
just done okay there has to be you know
what we could just look up a formula for
partial
derangement here we go
here examine the number
RK where
[Music]
exactly K items are in their original
ordered
positions
but I mean yeah that's effectively what
I what I wrote why is this x oh and the
sub factorial okay yeah I mean that's
that's exactly what I wrote this is
exactly what I wrote
here um and that would be the correct
answer if we didn't have to exclude the
ones where the other primes are in their
correct
position so this is the formula for
partial
derangement the
problem is that we have
some out of those
yeah we need to sub we need to substract
values that contain primes the whole
primes thing is just a
scam
uh where exactly K items are in their
original ordered
positions yeah so that's right but it
doesn't say anything about the other
ones there is some clever way to
subtract act here
um exactly K items so we can say
that out of the other ones maybe we can
say up
to yeah don't this is getting at
good at least I'm happy that we're on
the right track at least that kind of
matched
um kind of matched what we had so far
but
okay the problem
is that out of
those
1.4
million some of them have primes in the
correct
position so there's there's three things
in here three given
things cannot
be in a
certain position okay
so any
of three given things okay so I I then I
I guess I don't understand why I was
wrong when I wrote
- 3 * 8 * 6 7 * 6 cuz that's not
right like you can see vaguely why it
would seem to be
right how do I get
three so three is just K which is
actually the number that I'm being
passed in um so nus minus
K yeah
uh well
first first let's confirm that these two
things are the same so I I think it's
it's this if we want to say you see I I
was trying to subtract one from each of
those numbers to exclude like the
position yeah okay so that's the same
I'm not exactly sure why that's not
right okay so when you look
at when you look at the first first
one it's
like
H the first
one there's one spot it can't be in I
don't understand why that's not
right I'm going to be an idiot I'm just
going to do it again and hope it's right
this time yeah we're going to do that
but it's still not right
it's
close let let's think of let's try to
figure out what this is excluding that's
actually okay
oh any of
three no but no they all
can't every single one of them has a
position that it can't be in the problem
is if this one
has already grabbed the bad position of
one of these yeah see the problem so if
I place the first one I have eight
possible choices the problem is some of
the eight possible
choices are these positions and then
that would actually give them all the
possible
positions do you see what I'm
saying can I explain the problem you got
to just rewatch the whole video I don't
know uh uh yeah the problem is that
once I've placed that okay I think we
can actually write this let's just write
it by hand okay so times
8 from is the next one's not times
s it's not time 8
either it's
time 7 /
no yeah
but okay so how often do I
pick there's probably an obvious
mathematical construction for
this um
so it's 8 * 8 because there's eight
possible
positions if I put it in one of the
positions let's talk about the next one
right so you can say It's Time 7 but
that's not really right because 1/8 of
the time it's times
8 so we say a
divided by
times seven of the times it's
that oh
maybe that
that's
right now we just got to do the last one
so the last one
is well
okay it's a happy hacker keyboard
God okay oh that solves it for
that and and this explains why it's
slightly under because of these ones
that we're
excluding if we can try to figure out
just how many we're excluding we first
engineer this by numbers we should
probably be using a smaller
example oh that's like a nice sounding
number that's how many we've excluded
right you know what let's just try to
let's do this and then let's add back in
the ones we've excluded right that's
probably the easiest way to think about
this so let's say
that now let's look at the
ones where we
placed
the
eight in the seven hole
so that actually means
there's
that seven
hole eight
[Music]
choices for
next where we placed the
seven in the wow this
is six hole this is going to collapse to
something reasonable hopefully is this
how people do
math okay now we have to go
back place the seven in the six hole
okay now we also have to ask the
question about where we place the eight
and the six hole so that's probably 7 *
7 too
big something like this is right though
well actually if something like this is
right we can make a statement we can say
that would have to be some multiple of
this and let's see if it
is wait no that's not didn't it print
a yeah
this so is it true that this is some
multiple of this
and if so what
multiple is that right is that exact be
exact oh 356 perfect okay so we just
need if we just take this and we
multiply it by 356 that's
correct let's
check okay now we just have to figure
out how to get
356 yeah cool cool that's correct okay
how do we get
356 it's some crap like
yeah well what's 8 * 7 *
6 we have to add 20
somehow oh guys I think we're getting
close in before I sit here for another
hour all right we got to get 20 how do
we get 20 um so that's 336 is that right
336 and then there's another
somehow so those numbers are all way too
big uh what's
20 + 7 + 6 -
1 + 7 + 6 - 1
seems
right we love guessing
math who's smoking crack Don't Smoke
Crack
[Music]
kids I don't know about the expert ones
yeah this is supposed to be medium I
don't know all right
cool all right now in instead of writing
m in this stupid way let's write it
correctly
for say = 1 for I in range uh so what
number is
this how do I get to this eight
so it's
nus
c-1
to n - c - K
-1 -
one that's probably actually minus
two now it seems all right
okay M * equal
i
m+ =
i m - =
1 oh yeah that's fine because I have
that minus one
there all right
perfect okay so it's probably wrong but
we'll get to where it's wrong later
don't need to print any of
that these things are just stupid didn't
mean anything definitely get rid of all
this Ider tools
crap doesn't even do anything that can
be commented
out B is not
defined oh well we just know that b
equals fact n
did I write fact B well that done I
fact basic programming cool all who
thinks it works I don't all right it's
all
wrong okay well I didn't expect it to
work
we'll see we
wow okay well that
that's great they're all totally
wrong
okay so that's like just Library
code
above line not
RW I wash my hands is m still hardcoded
where's M no
oh wait
what okay well I meant to delete that
crap great job you are good bro all
right well that's maybe useful for
something that's definitely why it
didn't work at all I don't think CN is
CN used
anywhere CN is only used in broken stuff
that's all
broken this stuff doesn't make any
sense okay well we had an obvious
bug um CN is not
used
number of
discs in correct positions
get rid of
that to
perations and I think this is all still
wrong because this isn't fast enough but
uh okay I mean I don't exactly
understand why this is
true
but no I I guess it makes sense maybe no
it's just
justifying okay let's try it again we're
gonna get more right this
time all right well we got some
right yes this is basic programming
yes and there is hardcoded but that
should be
hardcoded
uh wrong answer
wrong answer no okay it's still really
wrong um I don't know okay maybe that 20
just isn't correct
okay so
correct times
any
[Music]
placement let's be a little bit more
careful about how we get M I think my m
is m is the sketchiest part of this the
fact n minus C which we've already
placed minus1 ided fact nus C minus K -
one
what okay so we have to get another 20
from somewhere
the problem
is that if we placed the first one
if we place the first one
uh which you had eight choices of
placing oh I love chewing ice
Bros it's a wonderful
feeling
[Music]
um so we have like nine possibilities
right
we have to think through what happens if
we place so there's one that we just
can't place it in and and that's already
covered basically how many combinations
okay so this is all the combinations
where none of the
primes
are the thing is the primes can be
placed incorrect the primes
themselves what this is excluding okay
so we have three
primes um what this is excluding is when
the primes are basically they're all
outside the set now we're saying
that like we couldn't have placed no no
it's not
right I'm sure there's a more elegant
way of doing this
too you know what
I know want elant
why let's just see how many of these are
correct
this should be completely correct except
for the fact that it's going to time
oh okay if this is getting stuff wrong
then the stuff we don't understand about
the problem
this isn't like some stupid thing like
that
right
now yeah how is this getting okay if
this is getting the wrong answer then
the stuff we just don't understand
right or like my is prime is wrong or
something NCR doesn't matter if it's
wrong I really doubt my factorials
wrong wait
what test K Zer worked before didn't
it is my is prime
wrong I know I wrote above line not
wrong but like that really shouldn't
break anything right I should actually
be able to test all the way up till n
is this
wrong well first off I don't think the
memorization really
helps let's move
mm up to
here and and then p is just length
mm print mm
357 this is not right how did that
break all
right that is a clever optimization stop
being clever
that's definitely
correct I don't know let's just
try is my is prime code
wrong um
I'm using the formula that's 25 okay
it's
not
uh yeah like if this is getting answers
wrong then there's just something I
don't
understand because this is just doing
like how many of them timed
out this should never return wrong
answers
um yeah it's giving me wrong answers
it's timing out in a lot but it's also
giving me wrong answer
so we have a definition
problem this is checking how many primes
are in the correct position it's
checking that it's exactly
that
and
B okay I mean is this is this p and Q
stuff
uh exactly K prime number discs are
found away from their natural
positions discs numbered one through
n
oh that could be what's
wrong the discs are number 1 through 10
not
zero
yeah do that
too cuz yeah n is the prime stupid math
people with their off by
ones you can figure out what that is
later but let's
say no
still
wrong there are n total permutations
that's still
correct Zero's never Prime so that's not
even a question
there that would change the the length
slightly
um no there's a ton that are actually
wrong oh runtime
error well that's a different
okay is this still some off by one
crap
oh
okay
uh math people
that I have to check the index of the
array right it's amazing that it was
right at all the first time let's see is
this right now ah okay we're still
getting some wrong ones up there but
this is definitely
uh uh maybe less wrong
okay so I don't know I mean the other
ones could all be timeouts at least
we're getting the simple test cases
correct
now um now let's go back to our see it's
always important to get the
not execute within okay these ones okay
we're still getting runtime
errors um that's
weird I wish it could you know tell me
what the runtime error was but I guess
if it told me that it'd be
cheating uh when are there run when
could there possibly be runtime
errors can these like be negative or
some crap or you know
what
this no that should be aish
ient modular power should be
efficient this should be
efficient I mean I don't know runtime
error can mean a lot of things okay
let's let's see if we're getting so
we're getting test cases uh 0 through
five correct so now let's see if we get
it correct with the close form
by the
way this here is the derangement
formula like don't think I'm not using
the
formula I derived it it was
simple okay wrong uh only because I'm
printing
M don't print
out so p might have been wrong in those
cases so that was actually something
that the off by one ER caused okay so a
ton of these are wrong the close form
does not match
the other
form um would the off by one errors
cause this no they wouldn't they could
have caused P to be
wrong but that's probably not the issue
look we're getting test at 8 correct
well at least we're not timing out are
those runtime errors oh no we're timing
out okay some of them time out problem
for
later okay
uh 356 well that's correct so that's
336 we're back to ask asking the
questions about whether I got 20 from a
really sketchy
Place
well so what if we instead start
out
with just the formula and we want to
figure out how to subtract the bad one
the bad
ones
have any set of three primes in their
any set of three things in their correct
place
so there's three it could be one two or
three that are in well it's it's
k out of those n minus C there can be K
things that are in the correct place
that we don't want them to
be so
why don't you Google where did I get the
derangement formula it's right
here that is exactly what I
wrote create input from standard and
print input to stand stand out very good
we're doing
that oh you found my error oh oh the oh
the the the the the N is different from
oh sub factorial oh maybe you're right
what's a sub
factorial wow that's a scam
all right all right all right we were
wrong sub
factorial No Object appears in its
natural place
yeah I guess I should have paid more
attention when they put the exclamation
point on the wrong
side all right
D mod thank you please subscribe even
though I don't know what a sub factorial
is
all right you were right about the E
shit too yep yep yep the hands to wash
you know what they going come back
dripping all
right yeah I mean this here is like what
I'm deriving I think the sub factorial
shit right because it's not
sub factorials seem to be a question
of exactly K items are in their original
ordered positions right so this isn't to
be fair what happened is I
misunderstood the uh partial
derangement so it still isn't exactly
this right in which exactly K items are
in their original ordered
positions um I think what I'm trying to
compute here with m is a sub
factorial all right so maybe we can just
take the equation here and figure it out
um satisfies that yeah yeah and I think
this is right here satisfies the
recurrence relation n * the sub
factorial
of you want to just copy that formula
m is a sub factorial see I derived it
all right all right all right
imagination you're you're
right it's still not the right answer
though I just want to make that make
that clear um if Nal equal 1 return one
return n
times should we try to like learn
instead of just copying let's try to
learn yeah that's why that like stupid
minus one got in there but this is this
is the right
thing subf n minus
one
plus -1 * * n
why is that
bigger definitely shouldn't be
bigger how are sub factorials bigger
than
factorials put it up there by fact
did I I just minus isn't
it+ -1 to the
n n times the sub factorial
are sub factorials bigger than
factorials does that make
sense well
maybe
for and for n equals oh it's
zero wait no that can't be right
though that's probably
right is it smaller B smaller oh good
it's smaller now okay so now we want to
say something like
fact well we know what M has to be so
let's just say m equals
Suba Maybe if I just replace these facts
with sub facts it'll work you love how I
do math
guys come on
337 maybe it just a
fact 123 no good no good 337 was pretty
close though maybe this one's a fact
all right all right I'll stop being
stupid now okay um in reality we want to
like just stop Suba
early
so this
um so we're going to say m * equals
I not
right okay okay I don't know who kabib
and porier are
uh let's all right let's let's think for
a little bit um
so we
need Let's test our sub factorial
function
44 huh that looks good okay wait so we
put
in put in five and six and we got 44 and
265 so that's 1 2 three four five okay
that's
right um
so those can be placed anywhere there's
last ones but out of those
three they can't be placed
anywhere oh what is just
that the problem is I had that janky
minus one in there where maybe I didn't
need
that I don't know if sub facts work like
factorials like that no they don't seem
to you see the problem right
okay so now maybe we can read the ones
in where it doesn't matter how they're
placed the problem is
there's how many that we don't care
where they're placed n minus P that we
just don't care where they're placed the
problem is this is excluding all the
ones where those are placed
correctly so if
there's n minus P that we just don't
care where they're
placed then yeah this is excluding all
the ones
where any of those are placed correctly
oh this is getting
hard where any of those are
placed in their correct
place no we're better off going with
what we had
before we want it to like not become
Suba at a point so maybe we should just
write a
custom call it lame
fact if n greater than k
is that
right no not right
think what we actually want see is
that not
CK okay so for 9
close see what I'm saying though is this
going to require us to understand what
these things are that would
suck I hate when you have to understand
and you can't just proof
Force Pro Force is great proof force is
the solution to all
problems it's too
big too big of a number
okay lame fact didn't
work so those will those are okay with
it being placed
anywhere
those so this is going to be smaller cuz
those are just the
derangements all right we can go back to
trying to add them back
in p and Q are just a and
b uh I'm go back to trying to add them
back in so this is wrongfully
excluding anything where
M should be
356 so we have to figure out how to get
356 out of this let's let's just look at
the definition all right let's go back
to where we were you threw me off with
all this we we we were close before we
really were
the subf fact
n
that so that's the
hm all right it's a common comor trick
to like double count some and then
subtract those
out
so okay
[Music]
all
com
even bad
drink te
that's all the ones they
wrong nine
356 these divid nicely I don't think
these ones
do you sub factorials just don't divide
nicely I have to do some
other subtraction stuff
right okay
none of them plays
correctly any shot it's that
it's not
that
okay so
that's any possible placement of
those it's like the problem is in this
876 thing
if we understand why we had to subtract
one maybe then we'd
understand why are the sub factorials
this number of permutation of n objects
where No Object appears in its natural
place
those ones after that we don't
care could it be this okay
like so this is this is this is under
Counting
I got rid of what the right number is
supposed to
be for
why is this true it's not
obvious n minus one
hate generating
functions a
356 for
okay so start here this under counts
because there's n minus C minus K that
can actually be placed anywhere that
here are not being allowed to be placed
anywhere so if we add back in all of
those
possibilities right how that's not easy
though
what I'm not reading your paast bin guys
we're going to solve
this I'm okay if it learn if it teaches
things like we're so
close
Okay I we I
guess like M should be something that we
can
calculate the problem is we're just
we're just excluding some of the
possibilities an M I had this I had this
worked out
before okay we were excluding the
possibilities this really
yeah that's right I don't know why that
minus one is there that's the thing
that's throwing me
off makes you think that this just might
not be right at all um
Suba and
C but it excludes all the
possibilities
where I don't like for me to understand
this I'd have to understand how sub
factorials work and I I don't yet
there's this
other relation for
them that maybe is maybe is is just more
correct right so if we want to figure
out the sub factorial of n we can just m
we can just say and like we can even
probably get rid of that because that's
probably just going to fall out let's
just okay let's let's just write it
let's just write the whole thing out all
right so it's it's 9 -
stupid we can't we can't get I mean
that's
not that's not obvious how to get
that like the only real way to get that
is with with recursion
stupid plus like it factorizes
right span thank you for
subscribing yo I went to the bar in New
York uh it's a that the hotel Tesla died
at is now a bar it's pretty
nice
um let's see
okay what if we start with with
that then we want to figure out how to
how to add to that
right so let's just say
mm mm subzero
equals
uh fact n
subk so what if we say that that's the
previous sub
factorial right now we say mm sub
one should that one we can just
do m m
equals 7 *
[Music]
mm I think we can just make this m just
pretend that's that's
that
plus
one 8 * m - one
9 * m +
1 or let's see seven so one minus one so
it actually be the other way
around I the Right
am 440 no it's not right
287 that's not
right 385 that's not right
this is the definition of sub factorial
right I have the exact formula
for sub factorial of zero gives one yeah
but I don't care about the E crap
right like we're trying to get an exact
answer
here
um trying to get the number
356 so we can say okay
M * equal
7 m * = 8 m + = 6 m + = 7 m + = 8 m - =
1 okay it's stupid
but it does give the right answer
okay 6 + 1
7 no this isn't really what I want
so this can be 6 *
m i mean I want to like shoehorn the sub
factorial formula into
this maybe there really isn't a
way let's
see yeah I mean with the minus ones
there just may not be a way
uh I was trying to do this with lame
fact
but 7us one oneus one
no that would be if we
continued the sub factorial formula
this is six
right yeah so that would be like if see
see I want to combine basically a
factorial and a and a sub factorial
don't talk about comma
here if I hear any talk about comma bam
oh just how do I get 356 in a repeatable
and reliable
way you don't need the shit these shit's
useless
if you figure out how to use the eshit
then you know what you go solve the
problem because I don't think we need
the
eshit okay we got to just use counting
arguments like proper counting
arguments I'm even
bad
because
the okay
exact partial derangement
formula the number of derangements is
just the sub factorial
yeah yeah yeah yeah inclusion Exclusion
Principle this is what it is oh I
remember
this I remember this
okay yeah yeah
so it's the inclusion Exclusion
Principle
if we're trying to get a union
B yeah inclusion exclusion inclusion
exclusion it it's this
satisfies the recurrence
relations see how long did it take bruli
to solve this that's the real question
so 356 is some form of inclusion
exclusion okay so let's say we start out
with
9 time 8 * 7 which is the
remaining but then we have to exclude
the ones
where
here start out with all of those but
then we have to include the ones
where the first
one was placed in one of the other two
holes no no no no no
no I don't know
f
can we start with any of
them but then we have to exclude the
ones where the first
one was
placed wrongly so that's just 8 * 8 *
7 which is not right either
like something like that though I
think no it's not
that
um okay let let's really let's really
just try to think this through the
beginning the problem there is just we
aren't Counting coun
Ing we aren't counting ones
where this one
oh oh oh is that
right yeah it's
356 okay
no well it makes sense to add six
right for
imagination I appreciate you with the
subfactorial stuff before but you're on
the nice you're you're on the nice let's
just let's just say you're on the I
I can't clusion exclusion right like
we're getting somewhere with this shit
add
parentheses
well it's not a parenthesis problem it
is something like this that gives that
thing though
7 * 1
it does yeah okay it is obviously that
right like we don't need to actually add
those
parentheses
um okay so what is this
generically we have we want to do 9 to 7
but
without so what what if this number were
longer right like let's see if we can
figure out the generic pattern right so
let's say it's 9 * 8 * 7 *
right then to follow the pattern would
be okay this isn't obvious at all never
mind never mind this is
stupid we have to truly understand how
sub factorials work until we do we'll
never solve this problem
[Music]
okay let's think it through in a small
case let's think it through small case
time small
case you're getting imagination you're
up the
ice drinking tea and peeing is the
absolute
joys of a Saturday morning is now
becoming a Saturday afternoon
drink some more
tea calm down we going to solve this
problem
ah yeah you like my futuristic Furniture
bro okay you know what I I really don't
like how big this text is I can't see my
code let's start with
that um I'm I'm just stupidly trying
numbers let's not stupidly try numbers
let's be
intelligent I really just want to
compute
M because there is an M there has to
well maybe there's not an M may maybe
just the fact that this works is is just
a
scam we've already placed those
we're left with a question
of
nck
placed
anywhere n minus
C
to K not placed in a
certain
spot and minus C
total what if I just say and minus
equals
c that's already taken care of just need
to multiply by
a Suba n would be all n not placed in a
certain
spot fact n would be with them placed
anywhere
so if we say a * equals fact n minus K
times the magical
356 we get the right
answer now what we should do is we
should use machine learning to take in
there's some function of n ink which
outputs
356 right we really boil this problem
down now
look we're trying to be constructive
okay we don't know that that even always
divides so this might not even be
true not placed in a certain spot right
so if we have fact in we want
to let's look at the inclusion Exclusion
Principle
for
I'm trying to get the union so that's
not right because fact 's already
overcounted
them
see thing is there's great ways to get
at this with factorials and it's like
this like you almost feel like you want
the answer to be this
you think that should be
356 right like
that's what you think the answer should
be but it isn't that
oh okay um Suba n under
counts
because there's
a that can be placed
anywhere so deliberately excluding ones
with K's placed in certain spots okay so
let's go through okay let's go through
let's go
through Suba and
excludes let's say for one of the ks how
many spots could have it been placed
in only one
right and then out of the rest of them
how many of them could have been
placed so let's place that
specifically and then say of all the
other ones
after we've placed that one specifically
in its one spot which was
excluded this is
close it's not close
okay the problem okay what this is
missing is
that see if that's like a multiple
it's
not so we're gonna have to
add is that right it might be that no it
can't be that because I added all the
subs no it's it's not even enough if you
add but it that does seem like that's on
the right track
that's still too
small that's all the derangements of all
the other ones given that the first one
was placed in the one spot it's not
allowed to be placed
in yeah we're way past any of the Prime
shit but we're just
saying we have K that are not placed
in a certain spot and all the other ones
we don't care
about right oh it's actually all the
other ones we don't care about so it's n
minus
k
um the way to solve the problem is go
backwards well thanks
bro now this is going to work out to
what we want but it's close to
this okay we have to add back in for for
let's let's pick one of
them let's pick one of the K and place
it in its disallowed spot right then of
all the others we have subf n minus one
but that could actually be true for any
of the C
okay
[Music]
so we're going to
say this could actually be true for any
of the N minus
k something like we're getting closer
we're getting closer all right there's
more because there could be two of them
placed placed
right
so too
much the two is already included
in the above
okay 93
um
[Music]
Suba dkmo is that actually right
no see okay I don't know we're close
with this stuff right
so any of the N minus K any of the
six can be placed in their correct
spot and
then all other derangements are allowed
but the fact that their derangement
promises you that none of the others are
placed
um so let's see how many possibilities
are there that two are placed in the
correct
spot right it's it's not actually it
might so that two how many how many
this seems intuitive but it's not
this that number is huge definitely not
that oh
well choose
two so this shouldn't actually be this
should be a
choose
um
n n minus K choose
one M minus K choose 2
K choose three so Factor minus
three I think this sequence might
converge to the right
thing right and then like 626 just has
one
possibility is this
right sweet right it's
this I don't know if there's a way to
collapse that down but okay does
everybody understand why it's
this uh I think for completeness we can
even write choose zero
here chose zero is always one assuming
my NCR function is
correct
yeah all right
it's not Brute Force I mean let's so
let's just just write this as for I in
range
uh 0
to n minus
K plus
equals minus
I pretty sure this is right
yeah
what huh can we just have it
right is that not the right
number off by four what
oh do we not have it right
before what changed
what broke
it that's right what do I
do for a range oh I guess I didn't
include the last one um cuz first off a
a equals Zer this is a sum
plus that minus
minus
I this isn't brw Forest guys is that
it's like very reasoned
whyus k +
1 so- k + one will go to
six okay now we have the right answer
now we can comment this out this may be
too slow we may have to figure out an
even more closed
form
okay I don't know why we're getting one
and two wrong and getting all these
other ones correct it's probably some
bug or typo or something all right we're
getting close we're getting
close what do I think of the colon it's
okay
we're getting close we got most of them
correct we have runtime
errors how do we have a runtime
error um so we can also make this I
don't know if any of these are timing
out some of them are we can make this a
ton
faster for
I don't know how fast my NCR
is but
okay
so most of our remaining bugs are some
runtime
error we had that with the Ider tools
one too let's make sure all that's
commented out
yeah where could there even be a runtime
error no reason to memorize that we
memorize this
Prime the denominator be zero here
yeah that's probably what it
is probably have to deal with the
degenerate
cases of uh
NCR so I don't know what the uh
degenerate case Solutions are
here but
like yeah that's going to end up being a
divided by zero it's going to end up
being a divided by zero if well I guess
if r equals z can r equal Zer in any of
our
things um if
r z turn one so we're
taking I guess this there one way to
choose zero is that
right I going to fix the rtime error I
fix some of them
where else do we do division I mean
that's the only runtime error I can
think exists by the way there are really
cool ways to leak information out of
these problems using that right like if
it tells you there's a runtime error you
can like leak a bit
right uh halt versus runtime error
thanks for the bit leak
bro uh okay wrong answer well that's a
different problem so maybe the answer
here is actually zero maybe this zero is
zero ways to choose
zero there's not zero ways to choose
zero and it's offended for me even
suggesting
that oh I guess no that's not even a
problem because it's not going to reduce
to it's not even being divided by that's
just wrong
okay runtime errors are still happening
the runtime error is probably happening
somewhere
else Auto mod my favorite IG thought
yeah I'll allow that of
course thoughts
allowed asking me questions about my
personal life or Comm AI is
not um we're getting close look at all
them look at all them check marks you
know I wish I had a check mark on my
Instagram um okay where could there be
bugs where could there be runtime
errors let's just see if it makes it to
here
or maybe we can test it on a few
examples test against custom input I
don't
know here we
go oh maximum recursion depth oh that's
a good point my Suba function is shit if
Nal equal 1 returns
zero that was in the
definition uh still WR
um well maybe actually we
try all right we got some number out now
it's not test against custom input let's
submit
it those ones are wrong but I don't know
about those those ones might be out of
time or
something come on one and
two oh we got one okay good now all
these ones are finishing and I think I
hope those are all
timeouts um in which
case runtime
error some of them are timeouts but this
is a this is a more clever runtime error
I
think maybe it's overflowing some shit I
don't
know let's try big
numbers 10 million and a th000 let's try
you know it's overflowing just mod every
number runtime error I don't know why
that's called runtime
error could it just be is
Prime oh yeah we can add my uh speed
hack back to is prime otherwise that's N
squared
yeah my is prime function right now is n
SAR let's just say in square < TK n +
one
math.
Square we also don't actually have to
build the list
here we can just say p equals ma uh Su
map is prime
range n+
one is this more of them
failing it's possible also this runtime
errors on the output like those pals are
overflowing
overflowing yeah I mean I guess the
factor can get really large
right we're doing B we're doing n
factorial which this factorial is a huge
number yeah that's a lot of yeah that's
a lot of digits okay well that's why it
doesn't work
oh okay
well good news is all of this stuff is
junk and any shared
we could do the no but it's not actually
it's not the primality that's causing
the problem my primality is now nun n
which is
fine it's this
well okay so we know p is about Ln of
N I don't know I'm pretty happy I think
we solved the problem I think um we just
wait for computers to get faster and
then we can solve the other ones
[Music]
no you know what that actually
is the runtime error is recursion depth
being exceeded in the factorial
function um I me we can fix
this uh r equal 1 for I in range
x r times equals I
there's no reason this has to be
implemented
uh now we're going to get timeouts
hopefully instead
we're still getting runtime
errors I don't
know but we can check if that's actually
already happening by
here for
we'll see if those are runtime
hours in which case we're going to have
to really think about what this
is and where these things are
big just wrong answer
okay it's not
there let's see if we're getting a
runtime error by
here all right we this is kind of
cheating oh Suba could have too much
recursion yeah okay we'll write that on
recursive too
all right who wants to do e
shit is it just
e e is the usual
runtime error
okay so it is caused by recursion in the
Suba
function I don't know
um how much Subs do we need can I just
pre-compute all the subs because there
won't be recursion if I pre-compute them
all oh yeah yeah this is actually a
stupid way to do this um
for J in range uh all the way up to n
subract
n
preach that won't have recursion limits
right or I don't know might I shouldn't
though cuz I'm pre-caching them
all all right who sees what I did who
sees what I did
okay woo we got a green check over
there love my green check mark
they're not blue check marks but they
are
green
okay these are probably all timing out
I think they just need to buy a faster
computer that's my thoughts on that
no no no guys no no no we can't do
that we have to win we have to win but
we're making so much progress we're
getting almost all of them right you
know someday I
dream that
the computer can just deal with this
shit for
me okay
the problem is that the factorial of 10
million is just too large of a
number the problem isn't even the for
loop I mean how can I optimize the for
Loop we can talk about that but but I
think we're actually just dying here
right there's no way we're getting the
factorial
of I
mean
maybe it's like a 5 megabyte number that
might be okay I don't
know
well so here's an interesting
realization I believe that we don't ever
actually have to compute that I think we
can do it inside of
here say just T =
1 right it's just should a ring right so
uh 4 I in range
n one comma n
ttimes
equals should be the same
right
nope not the same why
not oh cuz it's
inverse that still should be the same
right
[Music]
wrong answer oh cuz I changed in
oops um
this is why you should stick to the
single static assignment
forms when you are writing program
because the single static assignment
form doesn't do
this
wrong that's the same wrong answer I had
before maybe one's not the right number
to start
with
uh my point is okay you know what
no I think the factorial can be done in
the modulus yeah that should be okay if
I do the factorial mod n right so say
like b = 1 for I in range n b * =
i h sorry old
n and then if we put B there this is
okay
okay why
not if I make this fact old it's okay
right
yeah huh why is that am
I is that not the factorial
function oh all done plus
one did I just forget a plus one in the
other one
to well either way it doesn't matter
okay this should be
fast relatively
right I mean yeah that's that's all it
um now we have to figure out how to make
the other thing
fast the subax I guess we're doing it
all in the ring so it's
fine um we just need to preach the
Suba
yeah y yeah you guys you guys see what
we do right BTM thank you for
subscribing thank you for subscribing
you are you're
uh yeah we just
do does it terminate through timeout if
I get rid of
that probably still does
if I just take this
n yeah everything's just mod in
right so
it's right isn't it
I don't know about pluses pluses might
break
mods that's a later problem
though pluses don't break mods
I don't know what the time limits
are is it possible now that I'm just no
well so
this N - k + 1 K should be relatively
small this should be anog n
that's not really fair now is
it I mean k should be small has to
be the largest possible value of K is is
is yeah
n it's kind of
big let's copy and paste this and put it
somewhere
safe Monica Subs scream thank you for
subscribing I appreciate
you uh Sam the program what is this you
guys are talking
about I don't know I mean the NCR thing
I guess also can be
this first just make sure we didn't make
any mistakes
God oops
CU I didn't Define until there how did
any of them
run maybe this isn't right
okay
so let's look at the chooses and see if
they're going to be big
p2c that's probably pretty
large um
yeah I we might have to just rethink how
we're doing this core
thing that just might be too
slow let's think about it
okay we've narrowed it down to the sub
problem Oh I did triple bite I scored in
the top 2% now they keep hitting me up
for interviews you can work at Great
companies like Cruise automation oh wow
Cruise autom wow um
what is
this this should be okay
actually if it gets to here within the
time limits we can fix it
because this here is
actually yeah we can figure out how to
more quickly do all the ncrs because
they're all in
order this should be like a event
right no these ones are still timing
out but less of them are timing and now
it might be the same ones starting with
26 is timing
out is that the same ones the time out
if I submit
it no there's more timing out okay
so it is just this being
slow
uh that stuff's definitely not
slow this here yeah it's only because
it's doing that reduce
um so what is the formula for NCR
this you know what we're just going to
replace factorial with a uh
and this should scale right it's only
going up to 10
million unless they have some small
stuff we should be
okay two to n uh this is just slow by
Design This is after we've R in right
that's before we R in
that should be real fast
right one more
okay so now we can leave that NCR but
this NCR we have to make
fast
um fact n minus K ided
by yeah okay
itimes fat and minus
Kus
I there's a lot of ways we can make that
even faster I'm aware we'll get to that
in a
minute okay
well because I didn't use that kind of
division see if this is more
correct was finished
fast are they
wrong you might have missed the same
exact ones
oh no we got okay
good yeah okay it's all just time limits
still
um
oh mod
app it's not right
oh it's not
right why is it not right
because that divided by is not a divided
by anymore
then it's not that the factorials are
wrong it's that we can't divide like
that is there another NCR formula that
doesn't divide
dividing is really just a way of
subtracting oh you got four test cases
right nice job you're getting there one
day you'll be a elite
hacker uh
use my sand trick for inverting I
think I don't know if this keeps any of
the performance guarantees but
might be able to cat those in linear
[Music]
time that's a lot of correct looking
ones all right good we're getting less
wrong now now we're getting only the
ones wrong that were
wrong uh
before now we're getting the only the
ones wrong that uh that exited
early oh man this is a lovely Saturday
morning guys I'm happy to have all of
you here with me and we're going to
solve this problem is we believe in
ourselves
you
know I don't know man all the
Millennials who are raised on that kind
of we believe in our sh self
shit code did not execute in the time
limits I know I know we're working on
it so I think it's just my is
pre-caching all the factorials too slow
let's see if that doesn't execute in the
time
limits I don't know what their time
limits are this I feel is a fair test
because this thing would probably run on
my computer
okay it is now
ENT it might be my
Suba preacher that's too slow for some
reason shouldn't be
though yeah these are not executing
within the time limits
oh is it actually happening before that
maybe is my Prime thingy too slow oh
that would be great if that were the
case that we can make fast I
think yeah so that's
nunk n that's not that's not fast enough
yeah that's the
problem it's acquiring 10 billion
Ops water we're switching off T we
too hyped on the tea bro got latte this
morning too you
know yeah yeah yeah the prime shit's
just too low
okay too
slow um fast way to count primes below n
oh wow wow these look
complicated the seeve of arath is okay
we'll do the seeve of
arath that's
not it's still not
in maybe there's just not an end time
algorithm for that
Al so first off the memorization is all
crap cuz we're only ever calling any of
these
once don't need
this all right maybe it really is just
the see ofne let's go uh okay
PP equals true
times uh n + 1 PP Sub 0 = false PP sub 1
=
false
for p equal sum
PP get rid of that
uh this was not an easy problem guys
this has a lot of parts to it I admit
that I was a little stupid for that for
that NK thing I mean like I got it as
soon as I simplified it I was
just uh I don't know I I left in the
minus C it was confusing me I shouldn't
have done
that uh so we have to go from this to
this
forn in
range this can start with
zero +
one I mean I don't know like how is this
fast oh I guess well we Skip by I and we
say PP
sub no no this isn't right um I *
2 PP
no we don't want n here we want J PP
subj equals false I think that's
right do I still have an exit in there I
think I still have an exit in
there
yeah okay so you guys see I just a see
rathne uh maybe it runs
time did I get any more
right
so if just the Civ itself is too
slow I don't really know what to do we
have to think about just how to do it
faster no I don't think the subax thing
seems fast think my SI is fast let's see
let's see if that's timing
out okay well it's timing out on a few
of them but not that many
I mean we're going to have to get them
all right so if we can't do
this
guys okay okay I got an idea I got an
idea Bros I got an idea who's ready for
it who knows what it
is who knows what the idea
is who knows who knows who knows who
knows does anyone
know imagination what's your idea come
on you guys can figure this idea
out oh Ley you know well what's the idea
not smoking crack we're not doing a tree
and we're not turning off the stream
we're not coding on Vim we're not doing
gcds I'm not allowed to smoke weed in my
apartment but that does sound nice no
Aderall no no no oh Uber eat sounds
delicious no second latte oh Ley you're
very close you're very close
Ley we're going to rewrite it and see
there we
go change theme we're changing the
theme oh this is going to be
hard shit's
unusable all right because it's not like
I can't even make this any faster it's
not my thing is now ofen so that's not
the
problem o C++ 14 that sounds
pleasant oh no we have to figure out how
to read in
int all right so let's go int
NK
CNN
cnk is that right who knows
c um C out 10
oh no we're gonna have to figure out how
to do
that I'm gonna have to figure out how to
do that in uh in say which I don't know
how to do
but I I just I don't think there's a way
to make this fast enough in
Python okay perfect
uh
bu P
up
one
for
I to I less than I just do square root
of n +
one cast that to an
integer P sub
I in i = 2 for in j = i * 2
J
plus J less than
n
j++ PP
subj is
true for
okay I'll put a
zero shouldn't be
zero yeah I know all the languages have
different time limits I know they try to
compensate but like I I I don't know I
don't think there really is a faster way
to write that right and that's not
finishing in
time I don't know why it's giving me
zero
okay now it's G me
one and I'll just trite the same
algorithm it's even harder to write
write this in this tiny little box
six that isn't
right I
guess that'll make it
right four four is the right answer okay
all right let's run that and see if
we're getting out of time
erors I'm terrible at Minecraft guys I
can't m a craft at all oh this is a new
segmentation def
fault what am I supposed to do about
that big stack you don't like the size
of my stack is that
right compilation
error is that the syntax
is that not the syntax can it not tell
me what my compilation error
is Define size of array oh here we go
array must be initialized with a bracket
enclosed initializer that's what I had
originally
initializer fails to determine size of
pp
okay shows you how much C+ plus I know
okay now we're getting wrong answer and
we have one
timeout but it's only one timeout so
this seems okay this is an
improvement how big is that number it's
in an in
shouldn't have to deal with too much
overflows
okay um
all right I guess we want to pre-cache
all the facts and their modular inverses
there really isn't a faster way to do
this guys if you think you have one I'll
be
impressed stuff matters really for like
the small numbers uh
two is going to add one so that's just
fine don't need that that's computed
right
okay now we just have to figure out how
to take inverses um
um
modular inverse
C++ not going to
work
perfect thanks for the
pasta a mod M okay so now we can just do
all the inverse
facts Ina sub I
equals okay this stuff there might all
be ways to do
faster just the prime thing I don't
really think there's a way to do
faster uh mod inverse fact comma n
okay seems pretty good right
PE
see the problem
honestly I don't know if we have this
much
RAM stuff might not work
[Music]
[Music]
for for
[Music]
uh yeah AI Winter's coming winter is
coming hope everyone's got their coats
hopefully they have 64-bit computers
over here n was not declared in this
scope
what I don't even
know in NCR
okay well it's a number at least
what do we do
wrong four
four
subus
oh okay well it's almost done right
number
uh for
should be mod
in why are those numbers so
big for
yeah I mean this is why people don't
code in these stupid
languages in fact subr in fact
sub these numbers actually seem a lot
more reasonable than those ones
oh why is M minus K
different where K come from
oh I didn't subtract from
n
yeah that might have been all
issue well the answer is not right but I
don't know what else I broke
060 okay looks like the problem is only
for
uh I'm passing I equals z and the answer
should be
one they have some thing for
that z turn one
okay all those numbers
match that last one
doesn't how did I add up a bunch of
small numbers and get
that I guess because i'm multiplying it
by Suba I'm not multiplying it by Suba
there
that gives me the wrong
answer I broke the
python I broke the
python oh it's that's not the same as
that the python is
fixed didn't make the same stupid
mistake there
I haven't been talking too much
hopefully you guys can follow along with
this it's not too bad it's just porting
just rewriting
this
in okay Suba doesn't
match Subs here are wrong
so in
fact
H seems like it shouldn't be why is that
two four
three is four it's not
right n mod
one that's
right subf IUS one
which three is not four okay so for 2
it's going to be equal to 2 * 0 + 1 so
that should be
one then for three it's going to be
equal
to 3 *
1 - 1 which should be
two
oh I make mistakes like that all the
time okay now it's ging me the right
answer
okay
well a lot of wrong
ones this probably has to do with yeah
so this is probably some kind of
uh grounding issue
somewhere let's just see where we forgot
our
mods wa we didn't even try why why are
there no mods
here mod versus already mod so we're
good
oh okay we still have some that are too
slow we got a few more
C++ for
okay so I'm pretty sure everything's all
B right I I don't know what's
not I washed my hands Bros
okay
uh that
that if the preachings are right already
too slow let's just return here and
see if these time
out the mod inverse might be too
slow yeah okay we're getting we're
getting timed out
here maybe it's the mod inverse because
if if that stuff's too slow I just don't
really know what to
do the mod inverse I think we can if
we're clever we can do
better okay we're getting timed out on
two but the mod inverse is pretty
slow uh
well so let's think about this for a
second
H here's here's here's an idea I don't
know if it's going to work oh wait n is
bigger
than no and is too
big uh
pragma OMP parallel 4 yeah I wonder if
that will work
we really need the m is that if all
we're doing with these is
ncrs the ncrs it's still that's still
probably the fastest way to do it
like maybe we don't need the
ncrs so also like we could mod inverse
the
numbers and not do it like this
CU what
is what is a modular
inverse yeah yeah Sam Alman trustworthy
guy they just took a billion dollars
from Asia they call their organization
open Ai and they post you know basically
news
tier gpt2 is like news tier flame bait
like oh it's a moral ethical we're not
going to release and you know oh my God
and then what they did to that poor
Connor kid you know Connor Connor Lethy
he he reproduces it well he didn't
really reproduce it
but um oh well I learned that we have to
set moral red yeah you know how we do
this with an actual open
conversation there was so many better
ways they could have gone about that so
don't listen to Sam
Alman real shit
well so see deep mind you have to
respect Deep Mind Deep Mind never lied
about uh what they
were and it's not to say that open AI
didn't do good work it's just I I mean
it's it's right I think the people who
should be punished harshly are the
people who try to use open rhetoric and
then are not open people who don't use
open like like it's just you know it's a
general hatred of hypocrites see there's
two types of people in the world there's
assholes and there's Hypocrites and uh
assholes I can tolerate Hypocrites not
so
much I definitely think of myself as an
asshole not a
hypocrite I may look up arace I'm going
to make this faster now like I I
don't this is all
ready it's all of n unless the mod
inverse things not mod inverse things
sort of
not um but no I mean also these people
like like they think I don't know
there's going to be another AI winter I
think a lot of people are are saying
this
deep learning solved a set of
problems they're very useful to certain
industries but that's been true for
every other AI winter before this maybe
we solve chess using massive search and
then Google starts
using that's just not even the same same
search techniques I don't know I don't
know what I'm saying just trying to make
this faster how do we make it
faster don't make it
recursive there should be nothing faster
than that
I'm focused on this is there a faster
way no I mean I'd still have to invert
all the numbers up to n if I wanted to I
could create the factorial in the
modular space
right hard code 10 million factorials I
I really don't think that's the right
idea
um mod inverse is doing ukan algorithm
like this is kind of
slow this stuff shouldn't be slow at
all I mean okay it's it's all the way to
10 minus K but still like this is a
bunch of
multiplies right like you can't even
argue that
that's yeah this is O of one solution
this is the only thing here that isn't
of
one uh
complexity of modular
inverse o of M what's
m the
mod
oh who likes this
yeah yeah this is the trick we want
right well it's faster
probably this is the same trick I used
in Python
wrong
answer why is it the wrong
answer this is like the Montgomery
algorithm
there's ways to make that even faster
too uh I don't
okay why is this
wrong
recursive but n is definitely
Prime that's right I I don't I don't
know
so like some things I can't invert or
something these should be one for all
them right cuz n's
Prime it's not so there's a
bug it's not even one for all of them
what kind of power function is this oh I
guess that's
maybe I need to change these to
LLS yeah that's probably not
working oh does not name a type oh I'm G
make it name a
type I used to have like some copy paste
shit that I would put at the front of uh
all my competition
programming it had like LL on stuff I
wasn't expecting this to become like a
hardcore competition
programming see how we're doing think
we're going to miss like a few of them
still we're going to get more maybe
not okay we're still
slow time
out let's see if it's timing out by here
even
log
M wait what okay yeah it's it's still
timing out doing the
inverse all right well at least now we
have simpler code um
now there's faster ways to do
this there's not that many ones in this
is there
that's a lot of ones
great
no okay maybe I don't need the inverses
come on this is
like this should
pass how do I get more
time this isn't really fair this is
like
okay
infa R in fact and minus r is there any
way like these are small or something
no so any to do without the
Divide great
there was some other way how how is how
is this one doing NCR there's another
way to do
it I mean they divide but they only
divide
by one thing
I mean I guess you could rely on the
fact there that K is pretty
small what guys my math is all right I I
don't get it I I don't know how do I
make it faster
maybe n minus 2 doesn't have a lot
of have a lot of ones in
it there a lot of ones in
it modular power
this just might be faster
so this is like normal Montgomery I've
written this algorithm a bunch of times
in like
microcontrollers what kind of a useless
comment is that like I hate people who
write comments initialize result well no
shit like what do you think in res
equals 1
does oh oh we passed test case 29 now
we're moving up in the world
slightly
faster there really there's not a faster
algorthm for this
stuff I mean we can make that an INT
that doesn't need to
be we can make that an inch too but I
don't think it
matters sign didn't
there someone to do this without choose
has anyone ever solved this problem with
haer this may not be
solvable so long to convert from long to
int I
mean okay we can make them all
Longs those can stay
I mean this is this is now well
beyond what anyone should be thinking
about okay is it failing all before is
it failing all still in my pre-c phase
yeah I mean these are all failing
here okay maybe I don't actually need
them
all this is unfair
though is it failing before the primes
even
only 34
I don't think so
and it would be nice if I could
pre-cache the values
once
oh let me see is faster oh shit no no no
no no no no please come back please come
back oh
few uh if that deleted my code I would
have
cried I think C is I don't know I don't
actually use C++ 14 let's start with
just
C++ maybe that's faster
go NOP same ones
who thinks C is faster
well okay so I don't have to do these
Alex I can pred declare
them
um it's 10 million
yeah we let the colonel do that
crap I don't know if this stuff's faster
same bad
ones but actually I don't think I think
if I just change this type defa to a
Define LL unsigned
long um
um no I can't imagine there's no way C
is actually faster than
C++ yeah I already used the modulus and
the
stuff everything's in the modulus
frame I mean and it's failing like like
if you need to invert all the
factorials if you even need all the
factorials I don't know maybe this is
just some really clever clo form for
this but I just don't like I don't
know
um vision is very
high
okay in other words hacker rank is
telling me they want me to think not
just spaming
anymore well let's try
this maybe we're wasting all our time on
P and we can figure out some faster
algorithm for that we probably can make
that marginally faster
huh only
okay so the IM isn't that bad it's just
the combination
of both that's
slow um anyone have any ideas about
faster ways to do the prime thing
oh no no no
no
no if
PP subj or sub
I equals equals 1 one
right because if it's already zero that
means it's already just a multiple of
something and then I don't have to do
the inner
loop I think that's
right yeah let's try that
no you see why I think that's
true we go back to C+ Plus+
14 it'll let me submit again because it
didn't make me do this
until
no okay so if PP sub I equals 1 if it's
not already ruled out by the Civ then we
have to go rule it out right cuz we only
actually have to do this for numbers
that are
prime read chat for 1 minute okay what
do you want me to
do you calculate square root every
second inner
iteration I don't think so do
I I don't think it's that
stupid compiler will we we'll do that
better imagination What are you saying
something if PP equals
big
where oh oh we got some
more okay we only have a few failing
now yeah
I reading the wrong Parts what no okay
we made the prime faster but the power
thing is still slow right like they're
both slow don't say I'm reading the
wrong
Parts if PP equals hard great you're
funny dork mod thank you for gifting the
sub you are
bro
[Music]
um need all the INF
y if Y and
one I don't think C is going to be
faster
stop with the paste bin
crap well I can't believe 600 people are
watching this we're going to get
it um
okay so is the only problem left the in
fact
thing seems like they've started to
throttle me because I'm using all their
CPUs I'm racking up their AWS bill
okay none of them time out anymore so
the only thing I think we have to make
faster is in
fact we have to figure out how to not
use in
fact
um a french guy solved it with python
well you know I'm American we we we
solve things with with
F-150s and uh Big Max and
yeah American yeah America we love love
America all right
um compute in fact this is what's
slow it's slow because there's an inner
loop here
well the Y doesn't change we can
precompute that for a y
actually we can pre-compute that exactly
for the
Y don't need that but that's not even in
the loop so it's not going to be
faster yeah
we don't have the X's so those we
actually have to
compute There is almost the fastest way
to write that
so we actually only have to compute it
for the
primes and we can make all the other
ones out of primes but that seems like a
lot of
complexity Y and
one I'm not
reading subtract Suba equals yeah no
that's not the problem subf facts are
fast
everything is being computed fast except
for in
facts well you're telling me things
that's not the problem the problem it's
all this it's all this Loop if we can
make this Loop faster we make everything
faster
huh
well I mean now we can even talk about
cash no it's not no enough the problem
is all this loop it's not it's not the
fact that those things
are cash issues uh
that number squared won't fit in
a want Loop to a for Loop
[Music]
um I mean I don't know at this point
like I don't know how this comp pilo
works we can unroll this whole thing I
mean I guess there could be Branch Mis
predicts here and we don't really need
that
uh we know exactly
what I'm upset that there's so many ones
in this
[Music]
see all the ones they're very
upsetting it Fe a power of two yeah and
that's exactly what this is we multiply
by that that's all that
okay don't need
that that's fast
there's a chance this is
faster that's not right
okay
wait now more of them are
failing okay well we've learned that C++
14 is faster than
C++ okay let's look up hacker rank CPU
timeouts
H submissions leaderboard discussions
okay look at how much time I get in go
don't make me rewrite it and go I will
it goes just as fast to see it's so
unfair multithreading is all all oh CPU
time would account for all thread
execution
time writing State information to a
file can I really generate it all once
unfair
oh oh you know
what I mean it's not much but
it's a little more cash
coherent guys see that tiny change and
now only three of them fail
pp1 if pp1 for in what fuck I'm so close
I know we're so
close Okay so we actually don't probably
have to do that we can probably just say
zero
still like End Time stuff it's not fair
okay I have one last idea
and there's no way I'm actually giving
up but we'll call it a last idea we have
to rewrite this in
C I will rewrite it in go if that's what
it takes because I have 4 seconds in go
which is really unfair
is how your code say I don't
remember expected expression before
eight
um
cool
oh different ones
fail okay um
does this still give the correct
answer that'll help with cash no gives
the wrong
answer I mean technically we don't need
the ram we could cast
them we could cast them whenever we do a
multiply dra precompute and one array
instead of three that's not
faster I'm focused on this
loop it's doing uh
32 but still that's all of
one I'm calculating factorials insanely
fast like there's no faster way than
that it's cash
coherent like the only thing to really
tweak here is this it's nicer anyway so
should probably leave it like that the
caching shouldn't really matter
I have enough
RAM wants to rewrite it and go
okay I mean we can try want to inline
the
functions hate that it comes down to
this but
maybe compiler should be smart enough to
do this
though two two left faing two
left all right
um that's not going to make it faster
just think it looks nicer
it's really fast
Civ it could be any of these
functions it should be all in
registers the only thing I'm thinking
about here is a branch
mispredict like I could write that out
multiply
because it does have a fixed all right
should should we just do that I think
that's going to that's going to bring an
end to
this um python shell
online okay
while n greater than
zero
uh if
n
print
resal res time
x
run oh oh did I mean to put parentheses
around my shit I guess I did all right
we're just going to hard
code no no no no no stop stop stop stop
stop that's not what I meant to though
uh let's call it y so it has the same
name now let's go there with that
why
uh is that allowed in Python I
forgot print
x equals x * X Mod remember we can also
hardcode this
number
okay uh we definitely don't need that
last x x
x all right who's ready to bring this to
an
end oh of course need some semicolons
does everyone see what I'm
doing does everyone see how this will
end things
hopefully come on come on come on you're
going to work you're going to
work
what no that can't be no come on
oh that's
bullshit oh man that's bullshit I don't
even
how that's so unfair
if look look at how o of one it
looks it's so 0 of one and that's
definitely staying in the iash
there's no more branches is
[Music]
there oh I guess this is a
branch I guess I could figure out how to
fix
that I think I can actually just fix
that fact 0 equals 1 does that fix
that I think I have to deal with INF
fact zero as well
I just might fix that let's see if it
runs okay we don't need that line
anymore did that make it faster I worked
really hard on that
can do it without
primes try and C++ 14
okay I mean the nice thing about C is
it's valid
C++ I don't know is this even being
compiled with 03 or something is there a
way to get pragma
03 is that going to
work they tell me what language they use
right
JC
say oh
those are different ones that failed
pragma for faster GCC
they're different ones that
fail like it's so
close no inputs not the
bottleneck I don't know this thing
seemed to not
help if anything that was faster
guys this never was supposed to take
this
long this was supposed to be a little
warmup I was going to sit and read
today but you know we I don't need two
for loops on line
86 I don't have a line 86 so I don't
know where you're looking here I need
two for Loops
here 31 32 2
34 okay now more of them
fail we liked
that okay you know
what it's kind of bullshit but let's do
it
let's this will do half as many M
facts it's two
factorial still
is that right
is that
right wrong
answer okay I'm looking at
you I * I in Ares where
is that stuff not is this not
correct I * i instead of I * 2
is that
true all right I'll believe you
guys and I'll think about why it's true
after we
win now I can make in fact twice as fast
pretty easily with some shit so we'll
try that
next why is times I
correct don't pass y aarg yeah we don't
really have to pass those Zars either
that's a good
point give up on any hope of that
working
so close so close so
close okay let's let's let's think more
about
this does this stuff not make
sense we'll do all the odd
ones oh
is that the
problem no it's not the problem because
it didn't even work for small ones too
many arguments to function power well
yeah of
course undefined reference to power I
break it
why is inline broken or something
almost seems like a compiler
bug okay wrong
answer I mean this certainly works
right yeah so why is that not right put
in fact back in the first
Loop okay
all right chat we're going to try
listening to you
guys wrong
answer oh because
it's so
close it's so
close I OB has crashed I don't know guys
it wasn't even my
internet we're so
close let's just try O2 sometime O2 is
faster come
on wait how did those ones fail
a cuz we oh two I don't
know wait did it die
again I don't
know oh no I think I'm just not playing
it's
back all right let's let's put some
music on I good plan YouTube
chill Beats
[Music]
okay okay what why is this wrong
[Music]
[Music]
[Music]
[Music]
oh because that's not how factorial
Works
crap okay okay guys I have a plan I have
a plane and we're going to solve we're
going to just solve this I know what it
is I know what it is
okay we're going to invert every number
we're going to invert every number we're
going to create one more
array we're going to call it inv num sub
big okay now we're going to invert every
number in Num sub I equals power sub
I
now instead of I we just do in Num
subi does that make
sense okay it's
right okay that itself might still be
too slow so we're going to use some cool
speed up tricks
this is too intense I I can't I can't do
the music right now guys I can't do the
music we're going to solve this we're so
close so close to Great
Victory okay 0 equals 0 1 equals 1 I
think there's actually also fast ways to
get them all I think there's actually
fast ways to do this but I don't know
them off the top of my head but I do
know this is gonna
work let's just see it might be fast
enough you see what I mean now we're
Computing in fact exactly like the other
one
is that a timeout or is that a wrong
one one one left boys one left no don't
worry I know how to make this fast I
know how to make this fast um
[Music]
that'll make it twice as fast
for got a
semicolon is this it is this it is this
going to be it let's go let's go let's
go come
on okay wait wait a second wait a second
no no no no no no no no this is just
random
now fine
I I I'll write the generic version of
this if I have
to no it's only easy for powers of to
I'm not deal with
that hang on can we think for a second
about what multiplication
[Music]
is there's like a way to
just katuba multiplication I don't know
what that
is get rid of all the prime code
what what do you mean get rid of all the
prime
code just try it
again it's G to work this time come on
come it's different one
I've had all of them
pass no forget katuba whatever there's a
way that's
fast that is what it is I don't know why
why is I * I
correct oh I guess cuz We're looping up
to the
of 1 so that has to
be iusus instead of
i++
where this might just be slower from a
cach perspective
because we're doing these are random
accesses
now might actually be
slower we only use it there
different ones
fail
compute all
numeric inverses in field
all right all right all all right we're
trying we're trying the
pragma I don't think I can unroll any
Loops it's a completely different set
that fails
that shouldn't
matter I I don't know what can be a
const exper
do we have to rewrite it and
go see like wait let's think we're
actually just looping through all of
these numbers one no that doesn't help
us doesn't help us at all
preash all inverses
okay well we can try we can remove this
Loop
I think we can do
this you know they get you your hopes up
okay C++
14 it seems to not make any
difference I don't push options even
really
does no I I don't think it
matters I think we just like keep
resubmitting and eventually it's going
to
work should we switch to
go I mean this is almost go isn't it
what would I have to change
wait a set of discs is numbered there
are 25 prime numbers below 100 so get
rid of the Prime
function no the i++ and Plus+ I is not
changing anything unless unless for some
reason they're not optimizing the code
at
all I mean
okay I have an idea
Cash go here and say
have you seen 30 and 36 fail
before I equals 3 um good
point you're right it doesn't matter but
you're
right go back to pseudo code and try
rethink it from another angle
I yeah okay we'll add back in unroll
Loops I don't think it matters um for i
= n
iusus okay all right Fair Point fair
point where
okay all right you want this to be
tary I I it should be the
same yeah I'm sure there's very clever
ways to do all this but we're so close
like I've seen every test pass just not
in the same
the same
run okay you love my all right you all
happy with Turner let's
go come on come on come on come on this
time this time this time yeah Bo
oh Turner is
worse Turner really doesn't do anything
different I don't
think hm
no
now there's a more generic way to do
this right so so we can do
this like we really only have to compute
them for the primes not even the odds
right and that power function is slow
subtract n from p in the Y Loop which y
Loop
yeah no it's everybody else on the
machines these are shared machines this
is
unfair
well I don't think you can yeah the only
way to do that is really with that it's
slow but there's not another way
[Music]
uh I don't really see inline assembly
helping compilation error that's
new oh did I leave some crap yeah I love
some crap
okay let's try
[Music]
this I didn't not mean to do
that approximating the factorials the
factorials are so this is O of
n two of them
fail I
mean this might make things better now
I'm willing to do
it because this is using half the uh
use less
Ram
oh yeah you got to get that cash
nice oh we did it oh my God it's a all
fucking
day
woo thank you for being here with me you
were all real
Bros ah hope you enjoyed look we we did
you know I thought like oh yeah let's
just find a little harder problem oh
it's going to be medium oh how hard
could that
be did I miss up Mom
yes did I miss some bullshit you guys
all looked at the
solution
woo
ah oh yeah let's share it on
Twitter
yeah I'm just going to copy and paste it
no no no we're not running it again I
don't talk about
that no no no no no I think it actually
got a lot faster cuz look at what we did
we change these to
ins
um we Chang these to ins instead of Ms
so it used half the ram but it's not
about the RAM usage it's about the size
of the cash
right oh oh you going to wash my hands
for a while it's over it's over we did
it
oh yeah yeah oh first you got to scrub
with like 30 seconds soap his H washing
stream oh yeah that's nice that's
nice that's too much soap on my
hands oh we're we're going to cook some
eggs
yeah whip up like a triple egg omelette
some scouting
onions I'm going to go read my friends
coming to visit me tonight everything is
good everything is good I'm really glad
you're all here with me no Minecraft no
cooking it wasn't this this
this I just when I'm on stream I can't
give up I never want streams to end
failures
Bitcoin thank you for subscribing thank
you oh this is going to get mad views oh
we got mad views on this channel worked
real hard today uh no I don't know all
right thank you thank you imagination
the truth is guys I'll tell you one
piece of advice for life and I'm not
going to tell you all where I learned it
from and it goes like this never give up
never
surrender uh no it's from Galaxy Quest
it's a good movie you guys should watch
it all right see youall later never give
up never surrender all yeah I got to got
to I got to I got to look what no I
didn't mean to move that one
a
no yeah okay right there yeah nope no
I'm moving the wrong one no no now want
to move that one yeah oh
yeah all right see you later
WEBVTT
Kind: captions
Language: en
BerrysYT: Yoyoyoyoyooyoyoyoyoy Hotz
okeeeeeee: hi
woogio: shalom
okeeeeeee: i am :)
okeeeeeee: not eu friendly time NotLikeThis
bobda_builder11: george ❤❤❤
acheesedanish00: acheesedanish00 subscribed at Tier 1. They've subscribed for 13 months!
Mazarona: yooo hotz 💜
hubblespheres: We here
chelsiquixote: whats good George!!!
bobda_builder11: how are u
acheesedanish00: hi george!
bebytesback: yo
waylon123: Cool
oMythra: yoooo goerge!
chelsiquixote: shall i subscribe?
vloood: do i watch this or pokemon speedrun
okeeeeeee: pepeJAM
QTDannyBoy: hnnnnng
slimpimp007: whats good
benchai18: George thoughts on the CYBERTRUCK??
ganeshvjy: Sunday party
aoezalp: Had to watch a condom ad for this
ganeshvjy: Too loud
eaglesemanation: hi, new hey, how to not get banned???
oMythra: George bought 3 CyberTrucks
timetrap2e: yeah what do you think about the cybertruck?
ganeshvjy: Shut it man
ad5k: (tomcr00se tomcr00se tomcr00se)
bravech: Hey George have you solved advent ctf's Easter egg?
benchai18: Hey yeah thanks bro I’m fucking deaf now
ganeshvjy: I am gonna mute it
ganeshvjy: Awesome
aoezalp: Zoox?!
vloood: i got like a ctf for an interview
vloood: with qualia
vloood: most fun in an interview
okeeeeeee: LUL
ganeshvjy: What are we cooking today??
slimpimp007: loooooool
benchai18: CYBERTRUCK?? Thoughts?
aoezalp: Break ethereum
bravech: Whoa
ganeshvjy: I report to you man
ganeshvjy: Lol
KreativeOne: Love that I get PlayStation ads for your stream
okeeeeeee: LUL
benchai18: @georgehotz I’m a subscriber. Thoughts on CYBERTRUCK?
kghd1: Python?
okeeeeeee: spam folder Jebaited
slimpimp007: iphone 11
Nnotm: it's strange how long activation emails take
ganeshvjy: We all waiting for your rants on cybertruck
ganeshvjy: Why c  ??
benchai18: 𝐇𝐞𝐚𝐫𝐢𝐧𝐠 𝐲𝐨𝐮 𝐬𝐚𝐲 “𝐜𝐨𝐪” 𝐨𝐧 𝐋𝐞𝐱 𝐅𝐫𝐢𝐞𝐝𝐦𝐚𝐧’𝐬 𝐬𝐡𝐨𝐰 𝐦𝐚𝐝𝐞 𝐦𝐞 𝐜𝐡𝐮𝐜𝐤𝐥𝐞 𝐥𝐢𝐤𝐞 𝐚 𝐜𝐡𝐢𝐥𝐝
Snowlav: we wanna know though
oMythra: C   the goat
ganeshvjy: I am your friend man.. Peace
Hamled: What do you think makes for a good reversing CTF challenge / crack me?
bravech: Why microcorruption instead of x86 pwn?
TheKoreanZombi: Then we shall wait.
hardtarget4: *whistles*
TheKoreanZombi: Congratulations!
inatreecrown: come back to japan
swsh: Matasano challeges? Damn, I was doing those like 10 years ago, haven't done the ones that were added later though, really liked them
benchai18: Don’t be sensitive I wasn’t complaining i was throwing shade. You’re the ONLY reason I even open Twitch.
guy_ross: howdy
0xAlae: Do Hack the Box
bravech: Dude you should do advent ctf
benchai18: @georgehotz on Lex Friedman’s show: “I’ve been working lately with Coq” god damn you’re the man
alxhotel: what is the topic for today ?
Hamled: What about Flare-ON?
vloood: the real ctf is passing the ai box challenge with big yud Kappa
bravech: Oh yeah flare-on ctf is a good one
benchai18: I just paused Death Stranding for you Jorge 🇲🇽
oMythra: damn was excited to see microcorruption
bravech: Mostly reverse engineering
hardtarget4: microcorruption is a scam
Hamled: yah
oMythra: how come @hardtarget4 ?
AGZ0R: @hardtarget4 why ?
Nnotm: can you enter a link in a snippet?
Hamled: So just bypass their filter logic
shanumbra: upload shell
AGZ0R: lol "upload shell"
benchai18: Damnit everyone in here is smart as hell huh? I (my company) make $2.5mil a month on Amazon and I don’t know what microcorruption is. I know basic Python/PHP. I’m a total n00b in this chat.
shanumbra: KEKW
BryanSWAGBEAST: yo whats up!
oMythra: damn bro you the next Bezos @benchai18
JesseSkinner: @benchai18 how??
vloood: i make 5 mil a month on MTG finance Kappa
bravech: George you can just use my account
oMythra: microcorruption set us up FeelsBadMan
AGZ0R: You got it Geo, with img :)
benchai18: @jesseskinner In the trenches. Took a few years to get there. We make the best pregnancy pillow on earth, and best priced, and luckily we’ve been viciously persistent
Nnotm: huh why doesn't the style tag end at the &gt;
JesseSkinner: thats awesome well done @benchai18
oMythra: damn bro you the next Warren Buffett @vloood
BryanSWAGBEAST: create a cheat for a game and sell it! @georgehotz
GMoves: rich people usually dont go braggin on the internet about it
Tsoding: PogChamp
bobda_builder11: i dont understand shit I'll never be this guys level xd
benchai18: @jesseskinner thanks friend!
SentientDev: dat inspect element
d6nielcs: Dealing with pregnant women in customer service...
Tsoding: That's a huge blue bob tsodinW
benchai18: @gmoves I’m not even close to rich. Every dollar minus a very modest salary has gone back into the company and our employees. I’m not even the owner.
THlAG0: this is CTF?
mixtape089: activity monitor
yeah_haey: Ive aleays dreamed of seeing you solve some ctfs
ganeshvjy: Yes
okeeeeeee: systemmonitor
GMoves: 25 million a year isnt rich?
hardtarget4: 16 inch PogChamp
okeeeeeee: ah ye ups
codetrotter: Activity Monitor
benchai18: @gmoves I’m the E-commerce Director. I built all the accounts that make us hella money
codetrotter: Ye
esence: how do you like that 16inch mbp?
oMythra: ballin outta control @georgehotz
okeeeeeee: dont ask how the keyboard is LUL
ganeshvjy: Cool
TheKoreanZombi: You like it so far George? Worth the price?
SentientDev: the macbook keyboards are garbage
hardtarget4: should have mine this week
d6nielcs: they went back to scissor switch @SentientDev
Hamled: import?
Snowlav: maybe onclick?
ganeshvjy: Inject script in value?
SentientDev: there is no travel tho
JesseSkinner: can you " onclick="alert(1)
oMythra: yall think they really moving to ARM for macbooks?
ganeshvjy: Or php?
Genntib: onclick
esence: url() ?
bobda_builder11: guys is he couldnt on the mac or has it connected to a monitor through HDMI Or something
Snowlav: @jesseskinner yeah that's what I was thinking
shanumbra: he`s using HHKB PRO 2 KEYBOARD
AGZ0R: hover ?
JesseSkinner: but you can add a doublequote and break out of the style
esence: wait, what are you trying to do?
death_gadget: If it's inline CSS couldn't you use the regular html script tag and inline JS?
JesseSkinner: and add a new attribute?
Hamled: url seems worth trying
esence: csrf or xss?
SentientDev: gruyere is some type of cheese isnt it?
ganeshvjy: You need some kind of scriptnfor onclick
Snowlav: escape the closing tag for style and add a HTML attribute veiThinking
swsh: "background-image: url(javascript:alert('XSS'))"
JesseSkinner: oic
Snowlav: ah I see
benchai18: @gmoves I’m not one guy that sells shit out of his garage. We have a 200sqFt warehouse, we have 10 employees, we have bills, AND I’m not the owner. My team and I made the company what it is today (revenue and operations-wise), but I don’t even make 6 figures right now.. that’s not $ in my pocket
SentientDev: 200 sqft is tiny bro
SentientDev: small ass warehouse
Nnotm: hm I don't understand why the quote doesn't look escaped in the source
benchai18: 200k
Snowlav: @swsh that was actually a clever suggestion! nice
benchai18: **
esence: @georgehotz , if you can use img tag, then go for &lt;img src="your script" /&gt;
thundershots999: It’s sleeting so hard outside, it’s an ice addicts dream
brofessorbob: ctf?
zup_zup: what are you making?
benchai18: @sentientdev LOL 200,000 sq ft****
dontbeameme: Swsh do t hack us
kaney_s: fun kappa
ganeshvjy: Yes alert works#
swsh: i just googled it lol https://www.mediawiki.org/wiki/Preventing_XSS_Attacks_through_CSS_Whitelisting
esence: esence subscribed with Twitch Prime. They've subscribed for 3 months, currently on a 1 month streak! very cool
dontbeameme: @swsh Lololol
robotlaserparty: hint hint hint
wnewnastlom: Maybe you need to open google with --disable-xss-auditor tag
benchai18: @sentientdev I’m still laughing ... “small ass warehouse” lol
ykahveci_: what a chat
ykahveci_: must be best one
benchai18: @ykahveci_ should’ve seen when he was working on Coq. Best chat room I’ve been in in my 3 decades of life
death_gadget: blue"&gt;&lt;script&gt;alert(1)&lt;/script
hardtarget4: I think he already tried that
Imuhnent: LOL
Nnotm: doesn't work death_gadget that all ends up being the script tag
esence: xd
hardtarget4: LOL
JesseSkinner: omfg
slimpimp007: paranormal
death_gadget: mehdiKEK
eaglesemanation: cmcHusk
kaney_s: PogChamp
sice42: lol
dontbeameme: Lololololol lollo
Jewishrambo: lol
okeeeeeee: 3 letter password LUL
dontbeameme: Lololololololol
cikeZ00: lol
dontbeameme: This is war now
alxhotel: unexpected lol
kaney_s: hide your url
kaney_s: Kappa
slimpimp007: looool
oMythra: lmaoooo
Hamled: was about to mention that
dontbeameme: Lololololool
Hamled: The instructions do suggest using burp or something
Hamled: might be worth it...
dontbeameme: Swsh damn u
crazycatz59: !uptime
Knarez: LUL
Knarez: LUUUL
thundershots999: This is why we can’t have nice things
hardtarget4: password was prob 123
troxtheone: chicken:chicken
slimpimp007: bamboozled
okeeeeeee: lol
dontbeameme: 12345678 pe
kaney_s: chicken:nugget
dontbeameme: pew
VOR0R: eggseggs
AGZ0R: Sorry Geo, twas me . Just joking &lt;3
dontbeameme: Pw 1234567
Snowlav: you can use mitmproxy as well
Snowlav: it's free
AGZ0R: Password was bob though ^^
benchai18: This is my ultimate fantasy. Seeing George learn BURP
okeeeeeee: LUL
esence: IT'S ALL OGRE NOW
ykahveci_: LUL
tris790: LUL
mescal33t: beastyPoggers
tris790: You're good at leaking password :)
AGZ0R: I'm good at web I suck at reverse
benchai18: Is this a CTF? Or just him fucking around with XSS and WebSec?
oMythra: talking bout practice
hardtarget4: we're back.
Jewishrambo: it is java lol
danteissaias: Burp is so nice
oMythra: yea Burp is Java
AGZ0R: Geo come back to the CTF game, we need you ! :)
lnter0: @omythra iverson xD
Imuhnent: Set up proxy
hardtarget4: gotta set up the proxy with rbowser
brofessorbob: What is CTF?
Jewishrambo: you need to pipe it burp first
esence: Java good sir, pls do the needful
oMythra: @lnter0 LUL
Jewishrambo: yeah chrome proxy
lnter0: i got u mythra
danteissaias: proxy is localhost port 8080
Snowlav: you can set a chrome proxy with command line args iirc
danteissaias: just install foxyproxy
Snowlav: but easiest is settings -&gt; proxy settings in ff
AGZ0R: @brofessorbob CTF stands for Capture The Flag, it's a competition with many challenges. The goal is mainly to compromise an application and get the proof of it. called the "Flag"
death_gadget: I swear there is a burp extension to easily turn it on/off
AGZ0R: @georgehotz I suggest you to use Proxy switcher firefox extension
danteissaias: you have to install burp SSL cert. and I'm pretty sure it's a http proxy not socks
crazycatz59: do you guys know about brand burp?
actual1: are the appliations usually custom made or legit big ones? @AGZ0R
Jewishrambo: just do it for all proxy
oMythra: use FoxyProxy to turn it on/off
bbrak: install burp ssl cert
HexaField: hey george how you going? happy to finally catch a stream, loving learning about theorem proving and metamath!
xtoledo419: https://support.portswigger.net/customer/portal/articles/1783065-Installing_Configuring your Browser - Chrome.html
AGZ0R: @actual1 It's custom made challenges :)
WinterLabyrinth: intercepted
AGZ0R: https://addons.mozilla.org/fr/firefox/addon/proxy-switcher-webext/
hardtarget4: we're in there.
cogforkd: hello hello
danteissaias: install burp SSL cert
cogforkd: happy thanksgiving
esence: is Burp the best tool out there?
AGZ0R: @georgehotz tips : Add the domain "https://google-gruyere.appspot.com/" to proxy options so you don't interecept every domain :)
cogforkd: you are awesome
Penguino138: Enjoying some Yerba Mate while learning from the best!
hardtarget4: microscam
danteissaias: 0
N3Cubed_Gamer: im a Girl so can u say boys and girls next time you say , ok HeyGuys boys
AGZ0R: @esence Yeah it's the most used tool and every pentester i know uses it.
vloood: am i blind or is the text too small
brofessorbob: Bro is unisex
hardtarget4: blind
hexicity1: Hey hows it going? :)
N3Cubed_Gamer: ve
esence: @AGZ0R ,ty
vloood: gotta update my prescription
N3Cubed_Gamer: geohotz u ever been to defcon?
wunderlvnd: Hey George what would you recommend to learn programming ?
hardtarget4: PPP
crazycatz59: @wunderlvnd try programming in 1s and 0s to get a real understanding of how the computer works
N3Cubed_Gamer: lol 1s and 0s
actual1: lol don do that hahaha
hexicity1: @georgehotz any upcoming talks like the SXSW 2019 breaking the simulation talk? I really enjoy listening to your philosophy
xkrnsniperx: Bro, just decide on a project and go for it.
xkrnsniperx: Don't learn a language just to learn it
AGZ0R: Haha that's a funny one, programming in 0s and 1s
JesseSkinner: walking in and doing it perfectly on the first try, that's not skill.. being able to figure out something totally new is skill
Gtxgaming23: mysql database
Gtxgaming23: cheat
Gtxgaming23: i have heard of all types of scams, but never a database changing bastard scammer LUL
xkrnsniperx: Sadly the javascript protocol no longer works in modern Chrome and Firefox
N3Cubed_Gamer: db dupper
death_gadget: ❓
iLoseiRage: wont chrome auditor stop all that xss stuff from working?
AGZ0R: the cheaters never learns at the end...
esence: move browser to the right side
xkrnsniperx: hmm, why doesn't it fire for me
esence: can't see source
N3Cubed_Gamer: mybe it doesnt accept quotes
hexicity1: ~ Chiken
death_gadget: 99% of websites are built with javascript...
danteissaias: @iloseirage I swear the auditor fully stops pages from loading if it detects xss.
xkrnsniperx: death_gadget I don't think you understood what I meant by javascript protocol.
death_gadget: I must not have. I was a bit confused by that statement.
xkrnsniperx: http://, ftp://, javascript:
death_gadget: Ahhh.. Gotcha
supercrunchyx: !uptime
AUTH_Edits: "&gt;&lt;script&gt;alert(1)&lt;/script&gt;&lt;b
AUTH_Edits: "&gt;&lt;/title&gt;&lt;/head&gt;&lt;body&gt;&lt;script&gt;alert(1)&lt;/script&gt;&lt;b etc. u can do too
supercrunchyx: hackthebox please
N3Cubed_Gamer: &lt;noscript&gt;
xkrnsniperx: Ah ok, it is just Chrome and Firefox's internal pages I believe that the protocol doesn't work for
death_gadget: hackthebox doesn't allow people to stream most of that.
esence: @georgehotz for icon try: src onerror="alert(1)"
AGZ0R: @death_gadget You can stream free ones ?
ProfessorMagikarp0: u can do retired boxes like ippsec maybe?
Hamled: @georgehotz try something like "script/foo" if script is being filtered to "blocked"
cogforkd: when did he start?
crazycatz59: not even signed in on youtube KEKW
Phucklif3: Stream free ones
cogforkd: is it more than an hour ago&gt;
cogforkd: ?
TheKoreanZombi: All ippsec videos
death_gadget: There are some, I don't know which ones are allowed.
oMythra: you can talk to them to do decommissioned boxes on stream
ProfessorMagikarp0: ippsec does retired boxes
hexicity1: he hit the go button D:
TheKoreanZombi: retired boxes are allowed
AGZ0R: You can stream the retired ones.
danteissaias: you have to hack your way in to make an account
benchai18: benchai18 subscribed with Twitch Prime. They've subscribed for 2 months!
TheKoreanZombi: yep!
N3Cubed_Gamer: theres. no rules for hackers
crazycatz59: ok
ProfessorMagikarp0: u need to pay for retired boxes
esence: GO
oMythra: lets do it
ProfessorMagikarp0: 10 per month for retired boxes
AGZ0R: You can only play Chainsaw and Heist, 2 retired box that are still available for free. Otherwise only VIP can access Retired boxes
N3Cubed_Gamer: i hacked into defcon once
death_gadget: Alright no hints guys.
ProfessorMagikarp0: Kappa
ZiklarxD: I've been waiting for the return of tomcr00se :D
ChimiFckingChanga: omg this is so mr.robot
PexanKappa: LUL
benchai18: is he not playing with BURP?
TheKoreanZombi: try harder!
sippinoonapplejuice: click click click
N3Cubed_Gamer: and girls
AGZ0R: protip : https://gchq.github.io/CyberChef/
sippinoonapplejuice: ^
TheKoreanZombi: Do these and then get your OSCP certification.
troxtheone: clap
esence: grats
ProfessorMagikarp0: EZ clap
tris790: bob123
tobecy: qwerty123
danteissaias: watch how username is taken
oMythra: elite hacks right there
PexanKappa: hunter2
N3Cubed_Gamer: password
supercrunchyx: 1password
supercrunchyx: use 1password
cogforkd: what is he trying to do?
ProfessorMagikarp0: u need to vpn to hackthebox not webbased?
cogforkd: hack the NSA?
N3Cubed_Gamer: iamgod= password
benchai18: and girls***
AGZ0R: - Chainsaw : Cryptocurrency contract vulnerability, Linux. Funny. Hard. - Hesit : Windows, Medium, did not flaged it so do not know
esence: @georgehotz bro when are you going to stream Fortnite?
bbrak: you have to pay for retired box
benchai18: ^ for the chick that was pissed about that
N3Cubed_Gamer: And girls
WinterLabyrinth: respect  1
AGZ0R: @georgehotz No ; read my message
Ziv0: no some of them are free
N3Cubed_Gamer: im not pissed KonCha
The_Tyrant: guys kali linux as main os? like native?
benchai18: k good, phew
warpoit: HAPPY holidays George.
Luccaasss: What is he doing?
hexicity1: some are free i think
cogforkd: hello hello
cogforkd: came just now
AGZ0R: scroll down
N3Cubed_Gamer: hes hacking the box
cogforkd: can you please explain what the hell you are doing?
benchai18: @forkdbloke how was it?
TheKoreanZombi: Did you choose chainsaw?
danteissaias: are there any retired web challenges?
AGZ0R: click on "All"
N3Cubed_Gamer: he's penetration testing, by performing vulnerability test
ProfessorMagikarp0: the full boxes are under 'Machines' then 'All'
Cube_Is_Life20: George if you want to get into bounty hunting again I heard Robinhood has tons of API vulns
cogforkd: @benchai18 how was what? i did not get that
cogforkd: please explain
AGZ0R: Labs &gt; Machins &gt; All &gt;
sippinoonapplejuice: troooooo
TalonFire: just try other CTFs?
N3Cubed_Gamer: its a loop
benchai18: @georgehotz ill be your bitch
Hamled: @georgehotz play Flare On 2019
tris790: pay the money
sippinoonapplejuice: be someones B i t ch LUL
AGZ0R: No ! Listen to me ffs
ProfessorMagikarp0: i would love some retired walkthroughs Kreygasm
esence: cmon, I just subscribed, USE THE MONEY
sp88dd5amon_zgod27: just do active ones
esence: I GAVE U
vloood: solicit chat for donations
N3Cubed_Gamer: no. hack
Hamled: yeah
Hamled: flare-on.com
N3Cubed_Gamer: no pay. hack vip
sp88dd5amon_zgod27: ah yeah thats true
benchai18: @georgehotz how much $ is 1 month
AGZ0R: Labs &gt; Machins &gt; All &gt; click on Retired Machines and scroll down !
AGZ0R: omg
death_gadget: LUL
sippinoonapplejuice: LOL
cogforkd: Please teach me something ... George.. am dying to learn from you, how to be best at computer programming ... please
benchai18: @georgehotz i'll venmo you a month payment right now son
sp88dd5amon_zgod27: yeah u can only do retired ones
vloood: if you shout loud enough they will comp you
sippinoonapplejuice: hackthebox is always watching
AGZ0R: Do not switch to vip omg
ProfessorMagikarp0: yes
sp88dd5amon_zgod27: yes
chocolatechp: no
nourhan: yes
Hamled: @georgehotz they say there's a way to get a free retired challenge
BryanSWAGBEAST: create a cheat for a game then sell it ;) @georgehotz
benchai18: @georgehotz whats your venmo i got u
N3Cubed_Gamer: geohotZ. hack
ykahveci_: LUL
N3Cubed_Gamer: no vip hack
Joy_void_Joy: inb4 someone just named themselves admin :D
ProfessorMagikarp0: id love to watch a retired box walkthrough from u no meme
Ziv0: if you go to retired boxes and scroll down there's currently 2 that are free
death_gadget: Pay us bitch!!! LUL
TalonFire: LUL i swear to christ if they respond
Bombapil0t: noob NotLikeThis
N3Cubed_Gamer: u should make a user name called vip
kucha1122: noob KEKW
esence: SHEKEL IT UP
hexicity1: hack into vip? easy
sp88dd5amon_zgod27: go to the discord
Joy_void_Joy: why hackthebox in particular though?
sp88dd5amon_zgod27: HTB discord
AGZ0R: @georgehotz click on Machines, All, and retired ones
N3Cubed_Gamer: make a admin user name
sippinoonapplejuice: can u tell us how u hacked the ps3?
benchai18: @sippinoonapplejuice LOL
Ziv0: go to All &gt; Retired boxes &gt; scroll down and theres 2 boxes available for free
Hamled: @AGZ0R this is pretty funny honestly...
sippinoonapplejuice: LUL
supercrunchyx: there is one available retiered machine
benchai18: @Ziv0 shalom
8430: have you ever brute forced iphone passcodes ? @georgehotz
treestompztv: late night strim PogChamp
supercrunchyx: i can pay it for you
N3Cubed_Gamer: @8430. too easy
Ziv0: https://www.hackthebox.eu/home/machines/profile/201
treestompztv: treestompztv subscribed with Twitch Prime.
hexicity1: hey @georgehotz , is there any more talks on the horizon? I loved your talk at SXSW 2019
AGZ0R: CHAINSAW
piqsoul: @georgehotz hows your ice addiction?
AGZ0R: and heist
benchai18: @georgehotz hows the coq addiction @piqsoul
hexicity1: CHAINSAW and heist are retired
Ziv0: go here https://www.hackthebox.eu/home/machines and scroll down i
Ziv0: it says its retired and free
AGZ0R: Scrol down ffs
hexicity1: and aw thats sad about the talks
supercrunchyx: because it has a write up
ProfessorMagikarp0: u vpn into the box
N3Cubed_Gamer: just find the oldest ones
TheKoreanZombi: VPN
death_gadget: They are VMs you try to gain access to
supercrunchyx: go to the access tab
benchai18: HAHHA
AGZ0R: YES !!! ALLELUYA
Hamled: lololol
N3Cubed_Gamer: google. retired hackedthebox challenges
supercrunchyx: you have to connect to there network by vpn
benchai18: @N3Cubed_Gamer hey girl
Hamled: please never read the instructions
N3Cubed_Gamer: hey
benchai18: @N3Cubed_Gamer sup boo
ProfessorMagikarp0: connection pack
AGZ0R: @Hamled Yeah haha love it
N3Cubed_Gamer: @benchai im geohotzs boo too. moximoLewd
Joy_void_Joy: So we're doing htb?
ProfessorMagikarp0: most people do it from Kali VM
supercrunchyx: it's recommended to connect via VM
sippinoonapplejuice: @N3Cubed_Gamer GEO is my boo
YoshikawaDotA: kali vm
treestompztv: just subbed &lt;3 &lt;3
benchai18: @N3Cubed_Gamer breaking my heart
Hamled: @georgehotz you ever listen to Darknet Diaries? The xbox hacking scene episodes were amazing
TheKoreanZombi: Better download NMAP while you are at it
N3Cubed_Gamer: we can share
death_gadget: They tell you to connect from a throw away VM just to be safe.
sippinoonapplejuice: ok
AGZ0R: @georgehotz if you can debootstrap (chroot) or launch a virtualmachin that's best.
Slippery3: tomcr00se is my favorite actor
Slippery3: please bring him back
konradmad: yo george if someone wanted to pay you for a short talk for advice online would you do it?
supercrunchyx: give me the password, i will update you to VIP
N3Cubed_Gamer: @sippinoonapplejuice thx HSWP
sp88dd5amon_zgod27: openvpn
sp88dd5amon_zgod27: LUL
sippinoonapplejuice: LMAO
tris790: LUL
cogforkd: hey i tried subsscribing, but, my DC is disaabled... oops
cogforkd: sorry
supercrunchyx: I am already subscribed on the the other account
lastmiles: 52 raiders from lastmiles have joined!
hexicity1: i know the answer is "from doing", but in present day, how would you learn this level of knowledge? HackTheBoxes don't seem that learnable from watching people do them, i guess time to pick up a book?
crazycatz59: Pog
vahkesh: cheeze2Hype cheeze2Hype cheeze2Hype cheeze2Hype
esence: WE ARE IN
sp88dd5amon_zgod27: sudo
sp88dd5amon_zgod27: yes
kernelimage: raided by gandolf!
TheKoreanZombi: sudo !!
Bombapil0t: Gandalf want to see some skills now
vahkesh: We're sent by Gandolf!
supercrunchyx: just use tunnelblick
theGeekPirate: Grouchy Gandalf has summoned us from the depths of C.
TheKoreanZombi: nmap installed?
death_gadget: LUL Gandalf
TheKoreanZombi: dirwalk installed?
N3Cubed_Gamer: N3Cubed_Gamer subscribed at Tier 1.
TheKoreanZombi: *dirbuster?
janne808: gandalf gonna hack your box
cogforkd: hey one morething i would like to take sometime and thank "gtozzi" for the gift sub.
eaglesemanation: why pyenv and not pipenv?
Musashhhi: Musashhhi subscribed with Twitch Prime. They've subscribed for 3 months!
supercrunchyx: just use tunnelblick
Joy_void_Joy: mkvenv is best :D
hexicity1: tomcr00se should return btw @georgehotz
elpersianas: what he is programing guys?
swsh: brew install pyenv LUL
benchai18: @N3Cubed_Gamer are you really a female? What are these "duet" things on your channel? For a moment I thought you were the dude. But looks like they're not all the same dude
Hamled: @georgehotz You ever check out Pwny Racing? https://www.youtube.com/watch?v=6wmyaYP5WkA
AGZ0R: @swsh nope
N3Cubed_Gamer: yes i am lol
esence: @elpersianas , he's trying to ssh into remote machine for the past 20 minutes
AGZ0R: @esence that's a lie. :p
ProfessorMagikarp0: i think they expect u to do this from a Kali VM with default Kali programs like OSCP exam CoolStoryBob
elpersianas: @esence what is ssh? xD sorry for the question
YoshikawaDotA: secure shell
sippinoonapplejuice: watching ur vids @N3Cubed_Gamer
TheKoreanZombi: Jobs are about exams until HR gets smarter though George.
cogforkd: YES.. please teach us george!!
death_gadget: Of course.. It's the only way to profit of us.
YoshikawaDotA: if i have to explain what secure shell is imma killmyself
N3Cubed_Gamer: lol
treestompztv: tomcr00se UNLEASHED
AGZ0R: HACK THE PLANET !
ChimiFckingChanga: amen
foogs_: they're crashing!!!
N3Cubed_Gamer: its a honey pot
death_gadget: HACK THE PLANET!!!
esence: HE'S GOING INSANE
benchai18: @N3Cubed_Gamer private twitter... hmmm
EEsmash: geohot udemy course coming Kappa
esence: not again
crazycatz59: yeah but you don't wanna do crime cuz it only takes 1 screw up for you to get caught
janne808: hack the box started out from people doing the OSCP lab
YoshikawaDotA: anyone got an invite for me for MK?
esence: clap
benchai18: boys and @N3Cubed_Gamer
xxxdeja: This new episode of Mr. Robot is lit
Joy_void_Joy: @elpersianas basically it's a way to connect into a computer remotely, like being able to type commands and all that
elpersianas: aaaaaah okok
N3Cubed_Gamer: mr.robot has a new episode..?
konradmad: George fastest way to improve hacking?? 1 2 3 go!!!!
N3Cubed_Gamer: oh u mean geobotz is mr.robot
ProfessorMagikarp0: george finishing the final season of mr robot on stream Kappa
danteissaias: @xxxdeja can you not spoil
snoopy_224: Man his keyboard sounds so satisfying
rsten: donate pls bro Poggers
dahmerrrr: files = saved, planet = hacked
sp88dd5amon_zgod27: nah
death_gadget: Looks like HEX
sippinoonapplejuice: @snoopy_224 right
voxelfox0125: @EEsmash If geohot had a udemy course that would be insanely entertaining and informative.
AGZ0R: @georgehotz YEah, that's why i suggested it :p
sp88dd5amon_zgod27: yup
sp88dd5amon_zgod27: hex
esence: get VITALIK in here bois
AGZ0R: No hint though
Xingjuice: !uptime
N3Cubed_Gamer: oo yeah
benchai18: @N3Cubed_Gamer this duet with the guy wearing the construction hardhat outfit.... is one of the strangest and funniest things i've seen in awhile
konradmad: Hotz would make wayyyy more money teaching people how to hack for money than making a self driving car......???
Bitsnoxx: I saw a video about self driving cars today and they talked about Comma.AI but they said it was only for old cars? LUL "working on after market kits that can be installed on older cars" (CNBC) (@georgehotz
N3Cubed_Gamer: @georgehotz take a typing test georgieboy impress us with ur SCORE FOR UR WPM
cogforkd: Please teach us George
unluckychickenn: do you know sky?
Xingjuice: dont ask about the keyboard? @georgehotz
Bitsnoxx: Bitsnoxx subscribed at Tier 1.
moonify: @georgehotz Have you ever participated in a competitive programming contest?
AGZ0R: What do you think about Phineas Fisher ?
Bitsnoxx: LUL
benchai18: @N3Cubed_Gamer hakuna mataa with the horse mask shoving a microphone through its mouth..... guys this a must-see
YoshikawaDotA: kEKk
cogforkd: Please teach us george ,... how not to be a noob!!
treestompztv: LUL
YoshikawaDotA: KeK
BryanSWAGBEAST: can you do it for free? @georgehotz
cogforkd: disabled
esence: Georgy, you could make a UDEMY course for me
death_gadget: I come for the rants. :)
N3Cubed_Gamer: i already know how to hack so please do whatever u want
ChimiFckingChanga: im writing this down
Jimbo51: Capture the flag practice?
Moelawn: already talking about hacking mindset, never even touched hackthebox LUL
SuchALuckyGuy: Why not compete in the advent of code from the python discord
cogforkd: what do you mean by thinking like a noob? like do not ask basic questions?
Bitsnoxx: Sorry LUL
YoshikawaDotA: everyone was a noob once
cogforkd: what do you mean by thinking like a noob? like do not ask basic questions? Please explain
esence: WHAT IS SSH
death_gadget: HAHAHA
AGZ0R: @Moelawn Does "touching HTB" is a prerequisite for being a Hacker ?? Oo
N3Cubed_Gamer: a n00b will ask questions like how do i.. just figure it out urself.
Joy_void_Joy: Ooooh, rationalism &lt;3
YoshikawaDotA: ask like what is ssh guys XdXd
brofessorbob: If you have to ask, you'll never know.
georgehotz: https://slatestarcodex.com/2017/03/16/book-review-seeing-like-a-state/
cogforkd: please explain, i would like to be good at programming.
Xingjuice: "What's the best programming language?" I think I remember someone being banned for that lmao
cogforkd: please share the link
Moelawn: @AGZ0R nah im just meming
Joy_void_Joy: What's the title?
TheKoreanZombi: Are we supposed to rage against the machine?
b1tc0d3: buy a tesla, you don't own that shit, same for apple products
Bombapil0t: as a service Keepo
AGZ0R: @Moelawn ha :p
N3Cubed_Gamer: yeah no . we dont .
TheKoreanZombi: Tell us what to do George?
N3Cubed_Gamer: even ur home
sarupk: Perfect
lastmiles: most likely has better than a stock CISCO ASA5500 at home ... also .. just avoid Python entirely .. but whatever .. python 3.8 is not backwards compat with python 2.7 which is all over the place .. also is this man off his meds and also just use different frame structures well outside the tcp specifications as well as diff voltages
YoshikawaDotA: thats it
kaney_s: just learn how to read then you will become the read hacer KappaRoss
cogforkd: ok
mdrake_: I like this energy
ChimiFckingChanga: Take my money
N3Cubed_Gamer: i feel y
esence: GEORGY, I CAN SEE THAT YOU ARE ALSO EXCITED ABOUT TODAY'S EPISODE OF MR. ROBOT
mescal33t: beastyKlappa
TheKoreanZombi: lets look at the dapp again
N3Cubed_Gamer: i feel ya @georgehotz
treestompztv: I love rant time FeelsGoodMan
Xingjuice: yeah but can you teach us how to hack Kappa Kappa
everybodyknowmyname: dont hack
cogforkd: am feeling SAD right now, not because george explained it, am just feeling that i should have developed some skills
sp88dd5amon_zgod27: no
supercrunchyx: fuck certifications and HR
Moelawn: how do you feel about OSCP teaching people how to hack
lastmiles: the purpose of a modern car is to transport debt
esence: TY
TalonFire: ssh root@ADDR Kappa
death_gadget: There are only Top-Shelf rants here.
Anin209: but i can't get a job
cogforkd: yes, thank you!!
Joy_void_Joy: add the key to host in ssh/config?
kaney_s: stop play video game and read 10 hours a day, obv Kappa
N3Cubed_Gamer: I THINK UR AWESOME GEOHOTZ. U CAN P0WN ME N E TIME. ;)
TheKoreanZombi: Let's brute force the private key with your new $2.5k laptop.
Cube_Is_Life20: can you put 5am on spotify?
supercrunchyx: fuck certifications and fuck HR
N3Cubed_Gamer: im a girl
Moelawn: certs are good though
danteissaias: can you put tomcr00se on tidal.com
Moelawn: some certs are good***
cogforkd: ok one last question from me "How to be GREAT at programming" please explain...
YoshikawaDotA: yea
YoshikawaDotA: HR fuck you
TheKoreanZombi: But how can I buy a 16 inch macbook and airpods without a job?
voxelfox0125: The best way to learn is to relate what you want to learn, with what you like/love doing then you will learn it passively.
Anin209: just start a company 4Head
Xingjuice: need money to make money. Isn't that always the case though
N3Cubed_Gamer: @forkdbloke u gotta learn to code first learn html
sp88dd5amon_zgod27: fuck stupid cooperations and institutions
esence: until state started controlling btc
Xingjuice: @N3Cubed_Gamer ResidentSleeper
treestompztv: They're TRASHING our rights, man! They're TRASHING the flow of data!
N3Cubed_Gamer: thats bitcoin maker
cogforkd: ok one last question from me "How to be GREAT at programming" please explain...
Hamled: lol @treestompztv
supercrunchyx: decentralization!
N3Cubed_Gamer: @forkdbloke learn html first
eaglesemanation: Oh, you're ancap as well
brofessorbob: Where is Satoshi?
cogforkd: @N3Cubed_Gamer i already know py and java
Abnico: Hi iam satoshi, nice to meet you
YoshikawaDotA: jack mao says otherwise
cogforkd: however, i want to know how one can become BEST in tearms at programming
TheKoreanZombi: And then sell it to a huge corporation right?
esence: yeah bro but i gotta pay my bills
YoshikawaDotA: but they got the money
Moelawn: there is no best @forkdbloke youre always going to be learning
esence: BILSL
N3Cubed_Gamer: george thats the million dollar question. make the next level product service
Xingjuice: lmao fuck that
AGZ0R: https://pastebin.com/raw/XSsyUb0f
esence: but I LOVE WORKING FOR THE MAN
sDeRs122: noobs like comfort
Bombapil0t: cmonBruh
cogforkd: @Moelawn yes, this i can understand
LemonishDragon: VoteYea
YoshikawaDotA: my gf has NF2 i have to pay her medical injection $3k every 3 weeks
cogforkd: ok one last question from me "How to be GREAT at thinkingat programming" please explain... oi know py and java
janne808: live in a van to own the libs
voxelfox0125: If you want learn to code there is a sea of information called the internet look at it please.
esence: ok, WHO THE FUCK MADE GEOHOTZ ANGRY?
MultiplePixels: VoteYea
YoshikawaDotA: or else she will get worse
LemonishDragon: VoteYea VoteYea VoteYea
MultiplePixels: VoteYea VoteYea
vloood: got fired cuz some bullshit (not performance), most liberating feeling
LemonishDragon: VoteYea VoteYea VoteYea VoteYea VoteYea
cogforkd: @voxelfox0125 thank you, i want george to answer that question
TheKoreanZombi: But I'm not a programming genius.
MultiplePixels: VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea
brofessorbob: Politics is for noobs
treestompztv: VoteYea
Xingjuice: @forkdbloke dude... you've been spamming for 10 mintues. If he hasn't answered yet...
LemonishDragon: VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea
N3Cubed_Gamer: @georgehotz i totally agree
kaney_s: true
decap__: class war
mdrake_: VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea
moonify: PogChamp PogChamp
TheKoreanZombi: I am going to learn CSS and stick it to the man!
Cube_Is_Life20: can you put 5am on spotify?
LemonishDragon: VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea
N3Cubed_Gamer: dems libs its all the same
vloood: well you still you gotta vote trump for the memes
MultiplePixels: VoteYea VoteYea
treestompztv: FACTS TriHard
StrickenDown: @georgehotz i only want to play video games and sleep and get free money
YoshikawaDotA: i think everyone gets that but in denial and yea
nickshoney: liberal
Ziv0: LUL
esence: GUYS, HE'S TRYING TO TALK YOU OUT OF YANG'S GANG'S $1K BUXXX
kernelimage: LOL
cogforkd: sorry to everyone, who thinks what am spamming..
MultiplePixels: VoteYea VoteYea VoteYea VoteYea VoteYea VoteYea
Moelawn: noob for what?
N3Cubed_Gamer: dems libs is the same
kernelimage: hes so right though
Crackmouse: Fucking AMEN brother!
Bombapil0t: back2topic own that box cr00se
SuchALuckyGuy: georgehotz for President
kaney_s: hotz for presidfent
brbdontdie: what kind of skills are you talking about?
DirectorHomeless: ...
zol0: SeemsGood
N3Cubed_Gamer: @georgehotz u can p0wn me n e time
benchai18: any responsible anarchists in the house?
voxelfox0125: BIG FACTS from the legend himself.
TheKoreanZombi: 8545
Moelawn: nmap -p-
Moelawn: for all scan
N3Cubed_Gamer: wireshark
BumD197: there are anarchists vs conformist :)
vloood: isn't anarchism/libertarianism just a larp politics to push lowering the age of consent laws @benchai18 ?
kelbs: yo @georgehotz how did you develop your views? Most young people are drones slogging through the system, not enlightened like you
TheKoreanZombi: nmap -sC -sV -oA 10.10.10.xx
1990sbaby4lyfe: if you cant teach your skills to someone else or pass it on in some form you are useless. someone passed down their skill to you mabye not directly but they gave you the info (through online) to get better you lil nerd cockroach. theres no way you learned all this sht yourself 100% online with 0 help.
N3Cubed_Gamer: @kelbs he lived in a van thats how
DirectorHomeless: The ‘system’ isn’t something that was drafted up as some sort of conspiracy. It’s the result of hundreds of years of economic evolution. Yes, it’s not perfect, but you gotta come up with a better alternative before just shitting all over the existing one.
SuchALuckyGuy: The birds work for the bourgeoisie
janne808: read anarchism faq.. apt install anarchism
YoshikawaDotA: maybe they dont want to wake up?
Moelawn: nmap -sC -sV -vvv -p- -oA targetscan [target]
Natrax1337: so, is this place pro trump or against trump?
benchai18: pro
yoda2016: so what matters then?
brbdontdie: No system is perfect. This is just the best one we have at the moment.
ProfessorMagikarp0: alex jones of twitch LUL jk
Natrax1337: lol
N3Cubed_Gamer: @yoda2016 ur skillz. matter
Natrax1337: pro trump
Natrax1337: top kek
Moelawn: then nmap -sU -p- -oA udpscan [target[
crazycatz59: thank god someone gets it
death_gadget: @1990sbaby4lyfe Triggered much
esence: by lizards he means all the BERGS and STEINS
YoshikawaDotA: do you guys think thanos was right?
s1ug: HACK THE PLANET
kelbs: thank you everyone for tuning into infowars live tonight lol
TheKoreanZombi: I think what most people in the chat want to know is what keyboard do you recommend they use to overthrow the system?
astrailz: Will you participate in Advent of code 2019? @georgehotz
1monkjuice: nice
Moelawn: best nmap methodology right there
1990sbaby4lyfe: @death_gadget sure y not
treestompztv: @TheKoreanZombi LUL
Zealeigh: The 'system' is an agreement... In an agreement there are usually two sides...
benchai18: @esence I'm a stein u fuck
anguscupcake: oh hell ya
cogforkd: hahhaa
Raiwo: KKona Moonlanding was fake
cogforkd: HAHAHAHA
cod4TV: Best stream ever!
esence: ISRAEL, he said it
decap__: flat earth?
N3Cubed_Gamer: @georgehotz they are making thr frogs gaaay
decap__: lol
ProDucks: is the earth flat
cogforkd: i like george this way
gunnaren: chemtrails
Natrax1337: @georgehotz are you voting for the trumpster?
DirectorHomeless: Sure, but now you’re up against one of the driving forces of the human condition; everyone acts in a self-interested manner.
death_gadget: @N3Cubed_Gamer LUL
ProfessorMagikarp0: KappaPride OSFrog
cogforkd: he is best when he is HAPPY!
benchai18: wow @N3Cubed_Gamer he laughed at your joke. Prolly just made your week
eaterenrgy: @Natrax1337 I dont think you are listening.
sippinoonapplejuice: @benchai18 lol
decap__: narcissist?
N3Cubed_Gamer: @benchai18 omg i nearly fainted
Natrax1337: @eaterenrgy i just joined the stream
benchai18: @esence you wanna go son?
YoshikawaDotA: are you narcissist
Moelawn: why are we talking about politics
crazycatz59: What if the system IS the simulation and we gotta break the system to break out of the simulation?
oMythra: gotdamn commies
Moelawn: or economics
Joy_void_Joy: anarcapism
esence: @benchai18 just deposited 100 shekels, leave me alone
anguscupcake: Is bitcoin a sane investment?
eaglesemanation: Stop talking about libertarianism
mch4v3s: dream on
mch4v3s: heuheuehu
OhDyrHesUdyr: hackthebox already bro
janne808: ancap nonsense NotLikeThis
AGZ0R: do you have writing write on the ftp ?
Moelawn: this doesnt even seem like it makes you a noob
death_gadget: LUL
esence: NEETS assemble
Abnico: i like you george
zol0: LuL
Abnico: keep it up
N3Cubed_Gamer: its spelled n00b not noob
anguscupcake: bruh I quit my job and nothing happened
TalonFire: no job = ded
benchai18: @esence better stand down... I'm gonna acquire your property and repo your car and then raise the rent on your ass
sippinoonapplejuice: im a n00b
Slippery3: i guess george is a noob because he's employed
Moelawn: n00b mb
death_gadget: I just called and told my boss to fuck off cause I'm not a noob anymore
vloood: get fired for the severance
1monkjuice: gotta get a job to quit
TheKoreanZombi: George, don't you think you could get your radical message out better if you didn't restrict twitch VOD viewing to subs only?
crazycatz59: and if you're worried you cant quit your job, you don't know what welfare is
cod4TV: first step is done
1990sbaby4lyfe: he doesnt do write ups, he never gives back to community
cod4TV: what's next
YoshikawaDotA: everyone was a noob once do you remeber urself when you were one? @georgehotz
ProfessorMagikarp0: make a !noob command for noobs in chat LUL
sp88dd5amon_zgod27: im pretty sure u need to write a script that connects to smart contract
AGZ0R: @ProfessorMagikarp0 Great idea !
brbdontdie: You don't NEED college to get you to where you want to be, but it can help if you approach it the right way
N3Cubed_Gamer: $bash n00b
Moelawn: searchsploit
OhDyrHesUdyr: i have no degree and learned to code through my employer. left em shorlt after and now im a python systems dev/ml engineer making 125k
Moelawn: LUL
eaglesemanation: !noob
crazycatz59: gg
YoshikawaDotA: a girl i know is a sex worker earn 300k
voxelfox0125: The internet is the free college.
YoshikawaDotA: check mate
eaglesemanation: it doesn't work((
Joy_void_Joy: ^
brbdontdie: You just need to be willing to push through the resistance of learning
Moelawn: what else is running on the system?
TheKoreanZombi: @OhDyrHesUdyr George says you are still a slave to the man with no free will. Sorry.
esence: quit being a noob by signing up for a DURGASOFT Udemy course
N3Cubed_Gamer: i graduated in information systems technology cert in cybersecurity. its all bs. i learned more hackin on my own
sippinoonapplejuice: kanyeee LUL
YoshikawaDotA: you go to colleage to make freinds
DirectorHomeless: You heard about the ‘oops I deleted it’ issue that happened a while back I assume :)
YoshikawaDotA: if you dont like gtfo
1990sbaby4lyfe: george would you say everything you learned is off the net??
mdrake_: i saw kanye and he ranted for 45 fuckin minutes straight. it was awesome
OhDyrHesUdyr: i told dumbfuck hr and recruiters im an autodidact. many people are in disbelief that im 'self taught' with no degree. Im self taught and not burdened by student loans
Cube_Is_Life20: Just start a hedge fund and collect massive fees like shkreli did, just don't commit securities fraud
OhDyrHesUdyr: thats how u get free
N3Cubed_Gamer: oh yeH i love that speech @georgehotz i took that kanye clip and made a video from it
OhDyrHesUdyr: learn ur own shit
TheKoreanZombi: I go to coding interviews and tell them i will complete their challenges in metamath. No call backs yet.
esence: you go to college for a degree in German polka dance
sp88dd5amon_zgod27: use the ether JS api @georgehotz
DirectorHomeless: You have to maiale the right friends
DirectorHomeless: *make
decap__: im a dictator at work and i like it
THlAG0: terminius.com is nice terminal for ssh
N3Cubed_Gamer: im ta
THlAG0: https://termius.com/mac-os
OhDyrHesUdyr: nowadays devs can get by just being effective google searchers
YoshikawaDotA: degree guarantees you a job but doesnt make you successful
Solias_3: just got here, what's he working on?
N3Cubed_Gamer: i took this clip from georges sxsw speech and am making a song . nobo
janne808: apt install anarchism
sp88dd5amon_zgod27: im pretty sure its called web3 js
cod4TV: what if you don't work for someone? they are people working for me.. should i let them free?
N3Cubed_Gamer: he said some pretty prolific shit in that SXSW SPEECH
Cube_Is_Life20: 5am on spotify, when?
sp88dd5amon_zgod27: for ethereum
TheKoreanZombi: @cod4TV If you love them, set them free.
superduperepic: are ya winnin son?
YoshikawaDotA: my gf posting nudes on reddit but im here with geo
brbdontdie: What got you first interested in computers?
N3Cubed_Gamer: @cod4tv are they chained in the basement then yes let them out
benchai18: Remember when people got banned for asking what kind of keyboard he was using? That was the bestest
AGZ0R: Phines Fisher &gt; https://pastebin.com/raw/XSsyUb0f
benchai18: @YoshikawaDotA link?
THlAG0: @AGZ0R this is a shit..
N3Cubed_Gamer: @benchai18. lol keyboard
3FXX: why don't you use -sC -sV options while using nmap?
DirectorHomeless: You seen the perlin/life wasm VM that they use on their blockchain? Makes writing smart contracts super smooth
zol0: what window manager does he use?
Abnico: @georgehotz can u add me on linkedin. thanks
Xingjuice: @benchai18 still happens lol happened last stream
YoshikawaDotA: they will still get banned
YoshikawaDotA: try it
N3Cubed_Gamer: @georgehotz puh leez take a typing test. i wanna see ur WPM SCORE
esence: @georgehotz , are you on LinkedIn, wtf man?
Abnico: linkedin is very good social media
tarks_: @yoshikawadota
esence: are you looking for a job or something?
yohjiman: linkedin is doodoo
ᅟᅟᅟᅟ: PogChamp
cod4TV: what vps do you use?
Abnico: linkedin is the best social media
benchai18: @YoshikawaDotA i was around for the first keyboard ban and it was legendary. I've also never given a fuck what kind of keyboard someone use
dontbeameme: Never actually seen someone do math for fun
Usisuvach0: linkedin lol is for corporate people
Cube_Is_Life20: "we in" *leaves*
N3Cubed_Gamer: AND GIRLS
Bombapil0t: pee n' tea break
yohjiman: why @Abnico
esence: *FLUSH*
eaglesemanation: Is he gone??
Abnico: meme
eaglesemanation: oh
Abnico: look at his profile though
benchai18: @georgehotz **drops deuce**
jc_alvaradov: what did you invest in to get interest?
superduperepic: PogU
N3Cubed_Gamer: its not the keyboard that makes the coder
dontbeameme: Him Cracking the 4chan website, they won’t like that
YoshikawaDotA: @benchai18 but i do whats ur
TalonFire: play 23 Pog
Cube_Is_Life20: 5am on spotify, when?
benchai18: @YoshikawaDotA send link of your girls reddit and I'll share
Abnico: spx is moon
dontbeameme: Just take some time in the middle
3FXX: how long have you been using hackthebox?
YoshikawaDotA: lol
LianKing: SourPls
DirectorHomeless: Stock market has been pretty volatile in past few weeks
Bombapil0t: 20mins @3FXX
dontbeameme: They were starving artist what do you expect? They hungary
murillodmiranda: anyone know the zsh theme?
TheKoreanZombi: George, did you go out shopping for Black Friday?
zoprano21: @georgehotz What are you doing atm?
eaglesemanation: @3fxx he signed up on stream
TheKoreanZombi: He's doing hackthebox
Froopyland: JS LUL
esence: @georgehotz
esence: curl -sL https://deb.nodesource.com/setup_13.x | sudo bash - apt -y install nodejs
UMPS: npm install node Pog
treestompztv: which nodejs
Froopyland: chown
esence: @georgehotz install node too, apt -y install nodejs
dontbeameme: @thekoreanzombi Imagine the Nike drops George could get
brbdontdie: @georgehotz do you play video games?
DirectorHomeless: @georgehotz use nvm for Norris installation. Makes upgrading easier and avoids permission fuckups
DirectorHomeless: *nodejs
esence: curl -sL https://deb.nodesource.com/setup_13.x | sudo bash - apt -y install nodejs
LemonishDragon: VoteYea
dontbeameme: Show feet
N3Cubed_Gamer: @georgehotz have u ever CODED for VR apps
vloood: he's on wikifeet bruh
DirectorHomeless: Nvm install —lts
YoshikawaDotA: which vr headsets should i get for half life
BumD197: nodejs building errors here we come
12btw_: Central Banks Quantitative easing will keep the stock market happy. So company will buy back stocks also to increase own stock price. No need to panic. Works since 10 Years.
YoshikawaDotA: rift s or quest
N3Cubed_Gamer: music makes it laggy
AGZ0R: Did you read the files from ftp ?
benchai18: @YoshikawaDotA the one made by Valve
treestompztv: s t o n k s
benchai18: @YoshikawaDotA Valve Index
dontbeameme: @12btw_ Are a lot of stocks inflated and is their a tech bubble?
Hamled: and if there's one thing we know, @12btw_, it's that if something works for 10 years, it works forever :D
YoshikawaDotA: its not available
risky_banana: stonks
crazycatz59: crypto
FastCashCoding: aka buy bitcoin ?
TheKoreanZombi: The lottery?
benchai18: @YoshikawaDotA ah bummer. I hear its sick
FastCashCoding: im headed to the bitmex
s1ug: wallstreet bets my bois
treestompztv: GUH
esence: that's not politics, that's logic
vave2_: LUL
YoshikawaDotA: yea that sucks
N3Cubed_Gamer: penny stocks
FastCashCoding: its fun
DirectorHomeless: The stock market is a great way to separate the rich from the stupid
FastCashCoding: just get rekt kinda easily
Cube_Is_Life20: I write options
N3Cubed_Gamer: i wanna buy comma ai stock
benchai18: @georgehotz so buy stocks where? etrade?
Abnico: what?
troxtheone: cttvCarlos
decap__: fuck the stock market i get bully by high frequency bots
TheKoreanZombi: I put my money in beanie babies.
Abnico: 100x bitcoin long is free money
esence: @georgehotz , wait, let me go to pee first, i dont want to miss the stockmarket talk
benchai18: @TheKoreanZombi i put my D in a beanie baby once
dontbeameme: Foko pops is where it’s at
12btw_: @dontbeameme is a bubble when BIG money pulls out. Never fight the central bank.
N3Cubed_Gamer: put ur money into Gold @georgehotz
s1ug: already sudo'd bruh
TheKoreanZombi: @benchai18 Bless your heart
DirectorHomeless: Nope nvm doesn’t need sudo
DirectorHomeless: @georgehotz ^
schadowman: LUL
N3Cubed_Gamer: sudo is only for elevated privileges
Joy_void_Joy: npx ganache-cli does not need sudo right to install
benchai18: @YoshikawaDotA have you ever used PSVR? I've been thinking of getting it. I was gonna build a gaming PC but i'm gonna wait a bit longer to do that. So now I'm wondering if i should get PSVR in the meantime. I've never really used VR
THlAG0: private-key leaked POGGERS
zoprano21: xD
N3Cubed_Gamer: @benchai. i have a ps4
TheKoreanZombi: What do you want to do, just make RPC calls?
N3Cubed_Gamer: i have vr for my pc
YoshikawaDotA: @benchai18 ive asked the same question but they said go for rift S
dontbeameme: I hope Facebook gets a crypto company BibleThump then I can believe in it
DirectorHomeless: I’m off to bed. Have fun with all the node-gyp errors that’ll inevitably appear
benchai18: @YoshikawaDotA really? Interesting. Wait which is the one where u dont need a PC? Rift S or Quest?
12btw_: node.js backend - easy hack Kappa
N3Cubed_Gamer: @bemchai @yoshikawadota htc vive pro is where its at
dontbeameme: @directorhomeless Not very positive lol
risky_banana: @benchai18 quest is standalone
DirectorHomeless: @dontbeameme it’s nodejs
N3Cubed_Gamer: oculus go doent need a pc but u cant ay as many games
Jewishrambo: what the fuck is nvm
N3Cubed_Gamer: play*
Jewishrambo: oh node version manager
DirectorHomeless: Node Version Manager
YoshikawaDotA: vive pro and valve index where its at but at mid range its rift s
benchai18: @N3Cubed_Gamer I want the Valve Index. I hear HTC isn't worth as much as it costs. BUT alas, I don't have a real gaming PC yet. So gotta wait on that. But I do have a PS4... have u tried psvr?
N3Cubed_Gamer: Valve index is good too
Traikhul: Traikhul subscribed with Twitch Prime.
N3Cubed_Gamer: @benchai18 yes i have a psvr
YoshikawaDotA: also valve index isnt available for me so
Bombapil0t: SwiftRage
FastCashCoding: seems like you understand it quite well @georgehotz
benchai18: @YoshikawaDotA @N3Cubed_Gamer money isn't the issue; I don't mind spending on the best one. But it's useless to me til I set up a PC
treestompztv: Halo on PC on tuesday PogChamp
fi5ctor: You can use asdf to work w more than one node version
benchai18: @N3Cubed_Gamer should I get a PSVR or not even bother?
N3Cubed_Gamer: but the warning sign on the vr scares me says. warning may cause cancer on most all
YoshikawaDotA: if money isnt an issue then get vive pro for headset and get valve index controller
roystang: keyboard
benchai18: @YoshikawaDotA But is the Vive Pro any use without a PC right now? I just started researching VR kits yesterday so i'm not terribly familiar
Ozonemaster: which ctf is he attempting_
Ozonemaster: ?
N3Cubed_Gamer: @georgehotz do u listen to radiohead
YoshikawaDotA: i dont own one so idk im planing to get one rift s for now
TalonFire: requiem again pretty good
3FXX: @Ozonemaster chainsaw
Traikhul: Traikhul is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
Traikhul: Traikhul gifted a Tier 1 sub to revolutionist123!
Traikhul: Traikhul gifted a Tier 1 sub to SuchALuckyGuy!
Traikhul: Traikhul gifted a Tier 1 sub to Vinndy!
Traikhul: Traikhul gifted a Tier 1 sub to funcdev!
Traikhul: Traikhul gifted a Tier 1 sub to okeeeeeee!
Ozonemaster: thx
ProfessorMagikarp0: Pog
vave2_: PogChamp
Ozonemaster: Pog
treestompztv: PogChamp
LianKing: Dodged B)
YoshikawaDotA: pog
sativa2lol: GG Po
THlAG0: PogChamp
YoshikawaDotA: wish i get one pog
s1ug: dekarChamp
zol0: dodge EZ
Abnico: can you play some yeezy?
abstracticism: POG
benchai18: @N3Cubed_Gamer if you're talking about Prop 65 cancer warning, thats on EVERYTHING. It's a stupid law here in Cali. It's literally on eveything. Pillows, restaurant windows, dishes... everything. California requires it even if some PACKAGING has one of a massive list of chemicals. Nearly everything contains at least one of those chemicals
zol0: Jason file LUL
revolutionist123: PogChamp
vloood: wait so whats the project now? something with crypto
N3Cubed_Gamer: sux tho.
lynxadoodle: lynxadoodle subscribed with Twitch Prime.
vloood: building a crypto client?
ProfessorMagikarp0: he is doing hackthebox ctf like stuff
benchai18: @N3Cubed_Gamer sucks for me... I sell pregnancy pillows and my CS team gets hit up daily about that stupid warning. It's not even for the pillow itself but the packaging it comes in
YoshikawaDotA: yea hackthebox
N3Cubed_Gamer: damn i have a yt channel just need a couple hundred more subs to ata
mdrake_: okay, what's a pregnancy pillow?
N3Cubed_Gamer: oops sorry i didnt mean to type that
ProfessorMagikarp0: Kappa
FrancescoTommaso: what song is this?
revolutionist123: Kappa
benchai18: full body pillow that supports: back, belly, head, neck, hips, etc
LianKing: darude - sandstorm
FrancescoTommaso: thank you
N3Cubed_Gamer: they make girlfriend pillow
JesseSkinner: could you change the packaging @benchai18 ?
LianKing: NP Jebaited
vloood: anime body pillows for pregnant women, genius
ProfessorMagikarp0: need some of that emo rap music Kreygasm
mdrake_: ^atmosphere
YoshikawaDotA: could you penetrate girlfriend pillow?
N3Cubed_Gamer: ya prob
benchai18: @JesseSkinner YEah we did, but I still have 10k units with the old packaging
zoki_macola: it has to be in the function
ProfessorMagikarp0: @YoshikawaDotA if u believe in urself Kappa
SurfCat: promise yeah.. node has been giving me that the whole day LUL
treestompztv: need to be in an async function
TalonFire: async programming DansGame
treestompztv: async keyword
zoki_macola: async function
JesseSkinner: (async () =&gt; { /* stuff here */ await whatever(); })()
sativa2lol: i dont code still watching LuL
c19946: use .then( res =&gt; res )
benchai18: @JesseSkinner it turned out the packaging didnt have anything harmful, we just had to put the warning on there because we hadn't had it officially tested
dontbeameme: Are A.I company’s right now in the early stages like when apps were first starting to get made for phones or another example would be when everyone was trying to make the best website for the net?
鼻史: which ctf is this ?
JesseSkinner: ohhh @benchai18
revolutionist123: i've seen many streams, never understood anything
ProfessorMagikarp0: nickiG time to cheat with ippsec video
YoshikawaDotA: benchai it freaks people out
revolutionist123: luckily he types ls many times so i know 1 think he does LUL
N3Cubed_Gamer: @georgehotz syes python
bubblesnot: its a typewriter
vave2_: stock overflow never works for me
bubblesnot: probably because its just images
benchai18: @YoshikawaDotA for sure. Wouldn't be as bad if we weren't based out of Cali, but alas. And all our competitors on Amazon are all Chinese sellers, so they DGAF about that kind of stuff
N3Cubed_Gamer: @georgehotz im going to hack teddy ruxpin o. my yt channel make him talk like georgie hotz. using. arduino n raspberry pi
zol0: PogChamp
c19946: use nodemon instead of node
3even: It's ok, Javascript is also terrible at Javascript
N3Cubed_Gamer: yeah i dislike javascript.
YoshikawaDotA: i can imagine you have to explain everytime
seacult: can i ask you something sir
dontbeameme: Could be worse, could be flash
bubblesnot: which ctf is this for?
N3Cubed_Gamer: define the sender account
MuscleMario: !uptime
3even: hahahaha
ProfessorMagikarp0: nickiG how much of a rabbit hole do we let him go down?
Bombapil0t: no jailbreak, no keyboard, no selfdriving cars @seacult
seacult: cool
N3Cubed_Gamer: @professormagikarp0 the world may never know
MuscleMario: Please return to CTF, i asked if u did them lasty week and u said no... cmon meng come back. I am getting into Bug Bounties.
seacult: i would like to ask , what he does in free time
YoshikawaDotA: here
benchai18: "what is hAcking? somone plz teach to me how I do hacking I want see a girlfrend sms plz sory for question plz exblain someone to me"
SurfCat: think this is his free time LUL
N3Cubed_Gamer: @seacult this is his freetime
soeim: program javascript obviously
YoshikawaDotA: this is his free time
seacult: interesing
YoshikawaDotA: kEk
therealariel666: !time
zoki_macola: mine it
dontbeameme: @benchai18 Cntrl f
mudkipzzzz: @seacult what do you do in your free time?
seacult: i spent playing lol
N3Cubed_Gamer: whT are we doing again cracking ssh or
YoshikawaDotA: playing with urself atleast once a day
seacult: i should not do this but...
benchai18: How come no one ever cares what kind of keyboard I'M using?
seacult: ima fucking addicted
soeim: some of us are blind, any chance to increase the console font size?
mudkipzzzz: to what
bubblesnot: 11.5 times new roman
vloood: @soeim  1
veomx: ask about keyboard = timeout :D
dontbeameme: @soeim George is t sensitive to your disabilities feelsbadman
zol0: let a
1990sbaby4lyfe: george have you ever coded cheats for games by any chance for fun?? if so how was it?
bubblesnot: yall realize this is just a recording right?
veomx: they really ask so much because of your keyboard? lol
benchai18: @veomx I know but what if they asked ME about mine? How come no one cares what I use
mudkipzzzz: lol
Joshuagollaher: do you have anywhere that says what you use software wise
mudkipzzzz: clown
bubblesnot: it lives!
vave2_: lel
3even: ahaha
dontbeameme: @benchai18 What keyboard you use 🤷🏽♀️
veomx: hehe :D
SurfCat: Prerecorded and didn't even edit these hours out Keepo
mudkipzzzz: he uses zsh
benchai18: @dontbeameme BANNED!
mudkipzzzz: that's all lol
mazsociety: It's a live rebroadcast
ProfessorMagikarp0: ippsec's solution to this is like 7 lines nickiG *waits for ban*
Radres___: !uptime
Doodle_Jump92: a living legend POGGERS
YoshikawaDotA: if you ask benchai he will ask about ur gf
dontbeameme: BibleThump BibleThump BibleThump BibleThump BibleThump
mudkipzzzz: and vim
1990sbaby4lyfe: yeah nhe aint got sht on ippsecc
benchai18: @YoshikawaDotA it's true. benchai is fucking creep
bubblesnot: some say george is the cloud
N3Cubed_Gamer: and GIRLS
mudkipzzzz: george are you the cloud?
Doodle_Jump92: PogChamp
HolyJLS: hello
Ozonemaster: PogChamp
SurfCat: Bob does not approve
therealariel666: george the cloud
Imuhnent: bold move showing that
dontbeameme: Rip Virgil Griffith
3even: @georgehotz where's your smoking hot girl today?
benchai18: @georgehotz @mudkipzzzz@ @bubblesnot why you always charging me to store more of my stuff?
N3Cubed_Gamer: @mudkipzzzz lol the cloud
mudkipzzzz: what
C64Gamer: Was waiting for the next genius question like: "What font are you using in your terminal?" LUL LUL
benchai18: .... the cloud. Addressed to Jorge
1990sbaby4lyfe: tccpdump
mudkipzzzz: what even are you saying benchai
N3Cubed_Gamer: georvi
therealariel666: gvim - georgevim
MuscleMario: lol
benchai18: @mudkipzzzz you said "george are u the cloud". I followed up with "yeah george why u always charging me more $ to store my shit"
MuscleMario: yall trippin'
mudkipzzzz: oh i see
mudkipzzzz: yea
N3Cubed_Gamer: typo @therealariel666
benchai18: @mudkipzzzz got it's clearly such a dumb joke i just realsed
dontbeameme: Don’t steal my gf cloud nudes
benchai18: god*
mudkipzzzz: nah ur good
Ozonemaster: PogChamp
MuscleMario: Did you end up getting the MacBook Pro 16? @georgehotz
MrGorbachev007: pog
TheKoreanZombi: @MuscleMario He did
schadowman: george cooking monkaS
MuscleMario: @TheKoreanZombi thanks, :D
vave2_: xdd
dontbeameme: Cooking stream
Imuhnent: the ADHD is real with hotz
JesseSkinner: change category to food real quick
dontbeameme: Carbs are bad
3even: What TLDW on this Eth stuff?
bubblesnot: some say george only eats to seem normal
therealariel666: 16inch mac is the shit poggers
N3Cubed_Gamer: @georgehotz ping me n e time
ProfessorMagikarp0: i wish i was on drug :(
dontbeameme: Fake noodles
benchai18: @professormagikarp0 same
bubblesnot: monsanto noodles
death_gadget: Hows the Ice chewing going?
benchai18: Send nudles
idkfa22: You got 1000000000x more brain than people never on drugs
ProfessorMagikarp0: ice chewing relapse incoming LUL @benchai18
N3Cubed_Gamer: @benchai nudles lol
swsh: check if there some ICMP payload
Narakuwow: your kitchen is on fire
dontbeameme: Nudles genius
bubblesnot: tunnelbear
3even: Just SSH tunnel through a DO droplet..same shit no?
Imuhnent: @georgehotz Do HTB ProLabs
swsh: tcpdump -nni tun0 icmp
benchai18: @georgehotz who’s that person behind u?
dontbeameme: VPN sponsor incoming
bubblesnot: the noodle man
therealariel666: Hows the 16inch macbook going?
bubblesnot: sent by monsanto
N3Cubed_Gamer: is it. bad to ask what vpn ur on or did u build ur own
whiskeyx123: George could you solve the problem of poor monitor production real quick, i swear there is not a single monitor on the market that isn't flooded with reviews of dead pixels / backlight bleed / flickering / instability
therealariel666: Yo there is someone behind you
bubblesnot: @whiskeyx123 alienware
TheKoreanZombi: @N3Cubed_Gamer OpenVPN
MuscleMario: @3even wut was he talking about? Y care about a VPN when u just use a DO droplet like u said.
benchai18: @georgehotz why is that guy wearing a canvas sack hood over his face?
Penguino138: @whiskeyx123 Cant go wrong with an IPS monitor (not the best for gaming, but quality and build are generally better)
therealariel666: Look behind you lmao
3even: @MuscleMario Yea I don't get the whole VPN thing. Just use an SSH tunnel. At least you are sure noone at is loggin your traffic
TheKoreanZombi: Because you have to VPN into HTB to get to their boxes.
benchai18: I think I see @yoshikawadota behind u Jorge
TheKoreanZombi: Can't just SSH to their 10.10 addresses.
mazsociety: anyone else here use github as a dating app?
N3Cubed_Gamer: u know they can pick up ur strokes from listening to ur keybord clicks
MuscleMario: @TheKoreanZombi oh
benchai18: @mazsociety please elaborate right now
MuscleMario: Well, why do HTB then when u can do any other CTF sec challenge ?
dontbeameme: @n3cubed_gamer Of course
dontbeameme: Lol
N3Cubed_Gamer: tempest
TheKoreanZombi: Because it was just one that we landed on today. He was going to do a embedded CTF but they never e-mailed after he registered,
3even: Serious question @georgehotz. Are you smashing your employee? That rarely works out well
MuscleMario: I guess if u wanna pretend ur in some1s network, i guess.. LOL
mdrake_: @georgehotz what are some of your favorite books?
MuscleMario: Oh... RIP
LianKing: Dont forget about ur food
therealariel666: FOOD
N3Cubed_Gamer: @georgehotz. his employeez are all male
dontbeameme: Boil over incoming
N3Cubed_Gamer: @3even his employees r all male
vtcN_: Keep your boiled water in the fridge so it stays hot all the time.
1990sbaby4lyfe: if you want to go crazy read "eyes" by Carl Jung
3even: @N3Cubed_Gamer not true lol
dontbeameme: Are these challenges made by lazy company employees to get free labor?
hue88: have you done a stream about web assembly already?
12btw_: Just us a electric Kettle with hot water. Water in 1.5 min ready.
therealariel666: @vtcN_ spitting striaght facts
3even: hahaha
nikhilr14: every Monday watching George live stream helps Monday blue to go away
death_gadget: @georgehotz When was the last time you chewed some ice?? :)
SurfCat: LUL
vave2_: LOL
drivewaycam: George is a g
death_gadget: LUL
ProfessorMagikarp0: relapse :( broken home
Penguino138: Making spaghetti?
crazycatz59: do you think artists are "winning" in life?
benchai18: I just saw OJ in your kitchen George. 🍊👦🏿
SurfCat: fk thought this was my safe space Keepo
mazsociety: @benchai18 make a repo for your dating profile. Stars are a normal swipe right like, forks are superlikes, issues are swiping left, pull request is the DM platform
therealariel666: mom spaghetti
MuscleMario: @mazsociety HAHA Please
MuscleMario: PLEASE
12btw_: You need to boil spaghetti. Just leave it in Hot water.
MuscleMario: I'll swipe super right
MuscleMario: ill make a pull request
veomx: I miss your old "room"
nikhilr14: where is Alex?
death_gadget: Is the server sending the IP the same as the original box's IP?
shrewduser: goodhardts law
3even: Chewing ice is a symptom of lack of iron in your diet
benchai18: @mazsociety we need to talk friend. What’s your per hour consulting fee ?
crazycatz59: "wonce"
1990sbaby4lyfe: george ever coded cheats for games for fun? if so how was it?
TalonFire: wonce LUL
mazsociety: Only take payment in reddit karma
N3Cubed_Gamer: no no im a girl
vave2_: KappaPride
ProfessorMagikarp0: PrideFlag PrideSaba its great for me then
ProfessorMagikarp0: Kappa
MuscleMario: He bout to throw down
eaglesemanation: Nudes
bubblesnot: i am neither man nor woman, i am the cloud
therealariel666: he strippin for us
mazsociety: so basically the same ratio as Tinder
benchai18: Anybody else see OJ in his kitchen? 🍊👦🏿
MuscleMario: George HOTTTTTs
MuscleMario: Its gettin Hotz in here
12btw_: wtf R female
dontbeameme: Dang and I thought a new dating app was gonna help me
therealariel666: He is the cloud, not male or female
1monkjuice: women are not into computers normally
dontbeameme: Is George on RAYA app ?
N3Cubed_Gamer: r u attracted to male or female george
bubblesnot: laptops can be setup in kitchens
benchai18: @n3cubed_gamer female. Unfortunately for me
dontbeameme: Anyone know a life hack to get on the RAYA dating app?
benchai18: @n3cubed_gamer not to mention that besides George, I too only like chicks
seekingspirit: thoughts on the future of JavaScript?
Penguino138: pasta with alex?
12btw_: This cooking skills kaceyFail
3even: Don't cross the pastas
treestompztv: so close to 1M
crazycatz59: do you think artists are "winning" in life?
roystang: you applied to riot?
tornpaperyoyos: why dont you post more on instagram though LUL
MuscleMario: Define: winning at life
eaglesemanation: cmcCool
benchai18: Can anyone actually imagine dating George? Super opinionated... brilliant... funny voice
vave2_: truu
MuscleMario: squadW
1990sbaby4lyfe: George what do you think of Santiago Luis #1 on Bug bounty ??
dontbeameme: my simulation tells me I’m winning, just sayin
N3Cubed_Gamer: @benchai18 i want to daye george.?
3even: knowledge right there
SurfCat: benchai18 I heard he is on github KappaPride
N3Cubed_Gamer: date*
benchai18: George u ever made love to an inanimate object?
1990sbaby4lyfe: oh i never knew that side...fuck that
bubblesnot: are you a fan of hackerone or is it just do boy stuff?
MuscleMario: I got a job, I just wanna do security related stuff on the side and learn, possibly make $
MuscleMario: I literally started Bug Bounty'ing 2 weeks ago... and I've done CTF's since 2013
N3Cubed_Gamer: @bubblesnot who?
dontbeameme: @musclemario Does it pay descent ?
1990sbaby4lyfe: any success muscle?
tornpaperyoyos: i want to try ctfs ive never done it before. They look really hard though
bubblesnot: @N3Cubed_Gamer the bug bounty site hackerone
N3Cubed_Gamer: with bugbountys id be afraid they wouldnt pay me and just be like thanks for the bug n00b
MuscleMario: @dontbeameme Uhh, depends who you know, what you know, and how lucky you get. Gotta be pro-active. And, I don't have the rep/exp to speak on it.
1990sbaby4lyfe: yeah i dont thinkl hacthebox is good for entry level but im not sure
12btw_: This CTF server default installation or in any way harden?
JesseSkinner: soggy noodles
benchai18: Bye
dontbeameme: @musclemario Gotcha, I figured if it payed out at least 25hr over finding easy bugs it would be beneficial
ffntdt: there are no course teaching ctf right?
MuscleMario: @1990sbaby4lyfe haha, a tiny bit, but no real exploits... more just learning how to find vulns when vulns arent provided to you like in a CTF.
tornpaperyoyos: can anyone recommend a way to get into ctfs for someone who has literally never done it before?
swsh: courses are for losers
mazsociety: good starting site is picoctf
bubblesnot: most of the hackerone bug bounty people are black hats anyway
3even: @georgehotz How did you fair at "No Nut November"?
dontbeameme: Can we just go back to paper
mazsociety: or overthewire wargames too
N3Cubed_Gamer: @benchai18 bye?
MuscleMario: @dontbeameme - ppl got scripts running every hour or so, to pull all bounties from reputable sites, get scopes, and run tests to find ez vulns and some go as far as to automated report the vulns for $. Ppl have really thought this low hanging fruit bounty stuff out.
ffntdt: my teacher said the best way get into ctf is competition...
dontbeameme: @musclemario Jesus, they ruin everything
bubblesnot: @MuscleMario truth
JesseSkinner: al dentist
N3Cubed_Gamer: i like al dente
bubblesnot: salt the water
dontbeameme: Can’t buy yeezys cause of scripts, but fuck yeezys anyway
3even: I used to write shoe bots
N3Cubed_Gamer: acknowledge the girl. notice me senpai notice me
vtcN_: Al Dente doesn’t afraid of anything
dontbeameme: @3even Your the problem and why kids don’t believe in Santa
bubblesnot: what is a girl
bubblesnot: define girl
3even: LOL
SurfCat: Just ate, hungry again Kreygasm
dontbeameme: Lol
tornpaperyoyos: SLOP SLOP SLOP
N3Cubed_Gamer: yes me
foogs_: gotta mute
chexmixz: Girls on twitch squadW
BambiPT: lol
eaglesemanation: girl AND hacker??? awooga
C64Gamer: define('girl'); :D
ArtyJam: girl = guy in real life
bubblesnot: sharpie in pooper or gtfo
LianKing: OpieOP describe the taste
12btw_: Add ketchup to make it real kkona kaceyChin
N3Cubed_Gamer: var n3cubed
N3Cubed_Gamer: cuz u keep saying boys
ooMariaoo: lol
SurfCat: LUL
3even: Subs and leeches
death_gadget: I think he is saying show your tits or you aint a girl.... LUL
SurfCat: wise words
ffntdt: lol
bubblesnot: well he is gay
12btw_: Real talk slawPose
N3Cubed_Gamer: thank u georgieboy
dontbeameme: Anons
N3Cubed_Gamer: nuff said plz dont explaim
vloood: start saying fellas
vloood: gents
vloood: kings
N3Cubed_Gamer: u already said too much
N3Cubed_Gamer: i get it
bubblesnot: @N3Cubed_Gamer he is incel
cogforkd: am 38 , am not married and do not have any GFs
cogforkd: what the hell is happening to me!!
cogforkd: am going crazy...
TGM519: love the mavs pants
N3Cubed_Gamer: noo hes not incel
esence: what are you eating man, foreskins?
cogforkd: BTW.. the only think which keeps me going is your streams''
ykahveci_: @forkdbloke i hope u joking
therealariel666: lmaoi
SurfCat: loool
shieeeeeeeeet: delicious foreskins Kreygasm
cogforkd: NO am not
cogforkd: this is reality
C64Gamer: cft noodles contest. Speed eating. :D WOW
dontbeameme: Looks like watermelon
cogforkd: truth is stranger than fiction most of the times!!
shieeeeeeeeet: what happened to $50 life coaching
12btw_: Incel honey potslawSip
bubblesnot: george is a honeypot
dontbeameme: Lolololololol
ooMariaoo: oh tell us more lol
N3Cubed_Gamer: @georgehotz we see eye to eye no disclaimer needed
death_gadget: "Snape killed Dumbledore" ... "Noooooo"
cogforkd: ESP when i started seeing George's interview about driving autonomus cars
dontbeameme: “I’m not a role model” georgehotz 2019
cogforkd: am not crazy.. i was just scammed!!!!
dontbeameme: I LOVE THE SIMULATION TALK
Narakuwow: George is not high today? FeelsBadMan
tornpaperyoyos: we live in a society
N3Cubed_Gamer: " i wanna know what it feels like to be really smart" best. geohotz quore
shieeeeeeeeet: how often do you smoke per week
bubblesnot: @georgehotz Hey george is html a good programming language to learn? Also Epstein did not hang himself
cogforkd: DUDE.. you need to give some programming advice MORE
therealariel666: do got the 16inch macbook?
N3Cubed_Gamer: quote*
ProfessorMagikarp0: i miss ice chewing goerge FeelsBadMan
Penguino138: smoke and the pasta might appear :D
ykahveci_: @forkdbloke i can give
tornpaperyoyos: @ProfessorMagikarp0 don't like the spaghetti slurping george?
SurfCat: Did he finish the slam challenge?
dontbeameme: Using gas polluting the environment
ykahveci_: @forkdbloke quit and go talk with girls
ProfessorMagikarp0: @tornpaperyoyos the george mukbang is great what do u mean Kappa
dontbeameme: @forkdbloke Use hinge app
shieeeeeeeeet: shieeeeeeeeet subscribed with Twitch Prime.
mazsociety: everyone in society should strive to have a bit more geohotz in their daily lives
N3Cubed_Gamer: guys i gotta go. i wana stay but i gotta drive. whens the self driving car coming i need it
cogforkd: @ykahveci_ no cannot do.. since, i do not have money .. from where i come from , only money speaks
ykahveci_: @dontbeameme nice advice
cogforkd: thank you for the advice
dontbeameme: @n3cubed_gamer Later
dontbeameme: Thanks and welcome
ykahveci_: @forkdbloke i ll pray for u
bubblesnot: @N3Cubed_Gamer george sold it to elon and its going to be in the new truck
N3Cubed_Gamer: byeee guys
coProof: Hi geoman
coProof: What do you think of google coral?
dontbeameme: Tell Elon to make the trucks California blackout proof
cogforkd: @ykahveci_ thank you.. everytime i see george's stream's i get exited, ane then, i want to be like him , i mean in terms of knowledge, man.., this guy is GOOD
bubblesnot: @dontbeameme he said stopping 9mm is more important
esence: Google Coral aka Alibaba Intelligence
mazsociety: sounds like a pyramid scheme
dontbeameme: @bubblesnot It is apocalyptic vehicle as a standstill shelter
dontbeameme: Describing clouds
ProfessorMagikarp0: enrich coolness factor Kappa
esence: we know you're Elon's fanbay
BambiPT: hahahha
bubblesnot: i heard the cybertruck can self drive itself into battle
mdrake_: that truck is dope as fuck
ProfessorMagikarp0: mid life crisis truck LUL
MuscleMario: Is there a discord?
esence: @georgehotz , do you think the glasstest was a fluke?
mazsociety: does google coral come with an ATV? no
dontbeameme: 500 miles truck tho
zeroeagle1: any comment on the blackchain startup I used to work at? https://www.mantleblockchain.com/
zol0: LUL
tornpaperyoyos: honestly if the truck didnt look the way it did it would be so much better
lereboursx: You´re not eating pasta, bro. hahahahaah
SilvanoGJr: it happens to every man
MuscleMario: yo yo , let 'brew handle python installation'
coProof: Lol thank you for the extended response. You are right about the wording in the marketing.
whiskeyx123: every 7 year old's first school drawing of a car
MuscleMario: Is this the new macbook pro 16?
bubblesnot: @tornpaperyoyos unfortunately has to look like that because of the material it is made of is very hard to shape
dontbeameme: No propaganda gets past George
MuscleMario: oh, he's in ubuntu box.
coProof: Do you just believe in the nvidia edge compute devices like the Jetsob boards?
esence: WATER IS BOILING PJSalt WATER IS BOILING PJSalt WATER IS BOILING PJSalt
coProof: Jetson*
tornpaperyoyos: @bubblesnot what is the material?
sirleeroyjenkins: Hows it going George Hotz
soeim: 30 mins later pip will be working but there will be no water left
subconix: #noobshit
esence: GODDAMNIT
MuscleMario: hahaha
crazycatz59: what do you think of parents who make their kids to install tracking apps on their phone?
hardtarget4: ban that guy
bubblesnot: satinless steel alloy
mazsociety: let's all migrate over to Bing guys
shieeeeeeeeet: where's the stovecam so we can monitor it for you?
ProfessorMagikarp0: bluff called LUL
dontbeameme: Trillion dollar lame tho
whiskeyx123: these photoshopped cybertrucks showing personalised artwork wraps are the future, i sense that will take off like wildfire
bubblesnot: same shit spacex uses for one of its rigs
dontbeameme: @whiskeyx123 Like phone skins
whiskeyx123: yup
monaliso: i guess you're looking for the py3 pwntools branch?
chexmixz: bruh python3 -m pip install
bubblesnot: what i really wish i had was a way to self drive my 2015 honda accord
subconix: jesus
1990sbaby4lyfe: u enjoying the memes about musks new car??
esence: just code in bash bro
moonify: @georgehotz btw keep doing this stuff on this channel, let tom die.
dontbeameme: Few years cars are all gonna have mandated monitoring and storing the data
dontbeameme: DMV selling your data will be least of worries
coProof: POGGERS
Narakuwow: as a srub, i honestly don't like the syntax of python
bubblesnot: @georgehotz could you give us a quick update on your self driving tool you created?
whiskeyx123: https://pbs.twimg.com/media/EKMIIf6UwAEE0Q3.jpg
SilvanoGJr: dang, I want it
LianKing: AYAYA Clap
crazycatz59: looks pretty dope
bubblesnot: can you wrap stainless steel?
sirleeroyjenkins: its cool to see geohotz doing ctf :D
不好意思: AYAYA
dontbeameme: Yesss I want one]
coProof: Those would be hard to wrap Kappa
ProfessorMagikarp0: AYAYA senpi cyber truck
Usisuvach0: write some rust @georgehotz
dontbeameme: Buying Tesla stock now
Narakuwow: wouldn't you get shot if you drive this at Texas?
mazsociety: it almost looks as good as the 2013 prius
whiskeyx123: custom wrapped cybertruck style 8 polygon EVs will be absolutely everywhere before long
Yogohami: "Basic Programming"
bubblesnot: if i had a cybertruck i would wrap it as a cheese wedge
ProfessorMagikarp0: reverse shell? nickiG
coProof: So I’m not sure what we’re doing what is this ping you are parsing
THlAG0: see writeup LUL
coProof: Ping self is like dividing by zero
cogforkd: HINT ... haha
esence: so, let's talk politics
sirleeroyjenkins: This ctf looks hard
hardtarget4: hint = ban, subscribe = unban
dontbeameme: 🔨
bubblesnot: buy your way out of ban
jchosen: so what are we coding?
FastCashCoding: @georgehotz samsung or apple?
benchai18: Guys nothing to worry about! I’m back.
ProfessorMagikarp0: LUL
SheitanasGM: lol
napkats: "/unban &lt;username&gt;"
coProof: Pub sub = unban
hardtarget4: is it ./unban
ProfessorMagikarp0: stuck in the shadow realm
ProfessorMagikarp0: monkaS
Bombapil0t: lol
Narakuwow: stay banned scrub LUL
napkats: no dot
SurfCat: You can click in his/her name in the dm
benchai18: Is @forkdbloke trolling? “Am have no GFs”? “Scamming”??
esence: welcome back
12btw_: How get ban in the first place?
bubblesnot: /unban
dawgwhisper007: how to you migrate files to new server that is more than 500mb
sativa2lol: why he got banned lets see his logs Keepo
bubblesnot: CHECK THE LOGS
cogforkd: tomcr00se should return
benchai18: @12btw_ ask him what kinda keyboard he uses
dawgwhisper007: Im a subsriber
sirleeroyjenkins: probably got banned for asking about georges keyboard
bubblesnot: You could have just unbanned osama bin laden
dawgwhisper007: how to you migrate files to new server that is more than 500mb
SurfCat: LUL
dawgwhisper007: over 1gb
zeroeagle1: 5500mb?
3even: @georgehotz Just followed you on Insta. Happy?
bubblesnot: @dawgwhisper007 thumbdrive
Bombapil0t: i bet it was a keyboard question that got him there ...
coProof: $ to go.js Pepega
benchai18: @georgehotz Metasploit... scriptkiddie heaven or reputable tool?
dawgwhisper007: wrong @bubblesnot
VarrrrK: it smells like hot dog water in here
Gtxgaming23: What you think about learning c# for coding. I love c# and been coding with it for over 2 years. What is your take on it in the future of c#?
VarrrrK: and i like it
esence: guys, we are almost close to 1M followers on ista, go give him a follow
zeroeagle1: tried .net core 3.0?
benchai18: George u takin Niacin? U look mighty flushed
SilvanoGJr: which ctf is this?
cogforkd: you did not eat pasta... that was the frogs ... hhehe
coProof: What happen we to the pasta?
vloood: !pastaUptime
sirleeroyjenkins: @SilvanoGJr Hackthebox Chainsaw
SilvanoGJr: ty
sirleeroyjenkins: np
12btw_: !sr buCD-_1UPn4
dontbeameme: Doesn’t stove have a timer?
benchai18: @georgehotz Nessus.. kiddie tool or valuable tool?
sirleeroyjenkins: inb4 stove bursts into flames while he's distracted solving the ctf
esence: put some provolone shit in it
coProof: Can you down Instagram automation stream? Timgrossman has a good github repo
dontbeameme: Be like that apartment in fight club
ScrubLifeChoseMe: looks hot
Veletix: careful
shieeeeeeeeet: how is he not burning his mouth
OnlyB1ade: Hello G
sirleeroyjenkins: the sauce isnt thoroughly mixed throughout :/ gotta mix it around a lil bit more bruh
roystang: @shieeeeeeeeet he is not human
sirvapealots: @georgehotz Did you submit an application for twitch partner?
esence: press 1 if you're done with this shit and want to see Geo playing Fortnite
death_gadget: Is there a way to send something that gets executed from the Ethereum contract? Like a reverse shell.
VarrrrK: 2
sirvapealots: press 2 to mute esence permanently
sirvapealots: 2
drewc830: 1
dontbeameme: @esence Lololol he would get all the items
cswelin: @death_gadget with the hints tsk tsk
Veletix: can u code me a girlfriend pls
leander_ms: POGGERS George
brbdontdie: does anyone know why George is working on this?
death_gadget: lol
coProof: So glad this isn’t coq
dontbeameme: @brbdontdie He working on getting out of the simulation
VarrrrK: is this the dude from ex machina?
egb3: hello
shieeeeeeeeet: @georgehotz do you think you'd be more efficient with an IDE to catch compilation issues?
leander_ms: @varrrrk this the „i got an iPhone on t mobile“ dude
FastCashCoding: QQ
sirleeroyjenkins: hes some form of robot most likely running on the same software as mark zuckerberg
coProof: @shieeeeeeeeet noooo
Veletix: we've accessed the mainframe boys
BlackBoxTTV: whole crews will lose to tomcr00se and brood about "how did we lose to one dude?"
esence: I see ETU there
sirvapealots: @sirleeroyjenkins Don't even compare him to Fuckerberg; He's a fucking cunt, and Georgehotz is nothing like that dude
Crazymath21: hey dude what type of keyboard you suggest for coding? Linear, Tactile or Clicky?? @georgehotz
coProof: Can I get the name of this github repo? “A pure python..”
dontbeameme: @sirvapealots But he donates to ChaRIty
sirleeroyjenkins: Ok ones an alien the others a robot tho @sirvapealots
cogforkd: MrDestructoid MrDestructoid
sirvapealots: @dontbeameme nice meme LUL
sirvapealots: @sirleeroyjenkins ??? wat
dontbeameme: @sirvapealots Ty
sirvapealots: Georgehotz is the reason why we got all the nice fun crap decades ago :)
sirvapealots: @dontbeameme Bill Gates whining about losing 100 billion and being left over with a 4 billion LUL
sirvapealots: THINK OF THE POOR CEO'S LUL
cogforkd: ytouo
dontbeameme: @sirvapealots he gets back in taxes, fake crying
sirvapealots: @dontbeameme the fuck? He doesn't pay taxes 4Head LUL
sirvapealots: WA state kisses Gates' ass all day
dontbeameme: @sirvapealots Any loss he can deduct and also get money back from his charity work
sirvapealots: @dontbeameme How the fuck are they not prosecuted for fraud LUL
sirvapealots: @dontbeameme well, charities don't pay taxes; they just have to file to make sure they're non-profit
dontbeameme: @sirvapealots It’s not fraud, it’s legal
evoxrocks: is that boiled pasta with ketchup?
inderspooni: @georgehotz how long did you go to cmu?
sirvapealots: @inderspooni Short answer: He didn't learn to do that in college
dontbeameme: @sirvapealots It’s like welfare, it can be good or bad
sirvapealots: @dontbeameme corporate welfare LUL
MuscleMario: Oh crap, got lost looking at a fat possum on Crittervision lol... missed everything he did for 20m,
hardtarget4: haste it when that happens
hardtarget4: hate*
MuscleMario: is he dumping hex packet responses?
MuscleMario: CritterVision is not for zoomers, I hang out with old ppl and watch someones backyard.
MuscleMario: Live nature stream
MuscleMario: Theres a wolf chasing my favorite critter (fat possum)
MuscleMario: :( ;( :(
ThePetFoodGuy: so somebody new to coding should learn python first?
yomonomo: @ThePetFoodGuy No
inderspooni: @ThePetFoodGuy Depends what you want to build
shieeeeeeeeet: somebody new to coding should just pick a language and practice
shieeeeeeeeet: doesn't matter which
3even: @ThePetFoodGuy Try Pascal.
yomonomo: @3even No
dontbeameme: @thepetfoodguy If building cool MySpace profile was hard for you, maybe reconsider programming.
ThePetFoodGuy: @3even yeah heard it's amazing lol
3even: lol
yomonomo: @ThePetFoodGuy What do you want to do?
yomonomo: Apps, websites?
roystang: is this live
MuscleMario: I regret not spending more time in C/Rust, lower level languages when i started. I basically didnt have enough time to really learn or didnt put in the effort to learn back in school. U get ppll like me telling newbies, learn C   first. haha, so useless.
yomonomo: @MuscleMario I mean, you can still learn it on your own
leander_ms: the question is, will he ever look at the chat for the remainder of his stream LUL
oMythra: its not that hard going from c   to c
foogs_: hey you got pasta sauce on the corners of your mouth hotz
3even: @foogs_ thats how he rolls
3even: probably all over his keyboard as well
dontbeameme: Can we do something with telenet
leander_ms: monteAK monteOpa
ThePetFoodGuy: @yomonomo messing around electronics at first. Thought python because of arduino, etc.
leander_ms: POGGERS
leander_ms: Have you tried programm: just work?
yomonomo: @ThePetFoodGuy Yeah that would be good for that application
chocolatechp: !keyboard
Santiago_LHC: Woah, CTF for realz?
MuscleMario: Ye, his bits flipped @Santiago_LHC
leander_ms: @chocolatechp no commands in this chat dude, there are not even any BTTV emotes here
Nudethedder: dest_addr is not the same address as the box address.. wrong subnet
leander_ms: PogU
oMythra: that microcorruption email ever come through lol
Santiago_LHC: It was climactic to me
MuscleMario: yo im dumbaf i duno wutz goin on
dontbeameme: If you dontate you get a dopamine hit, win win
cogforkd: you are doing good my friend
cammbamm92: whoah there. sounds hacky
Santiago_LHC: I don't have the answer
chocolatechp: no, no hints
1990sbaby4lyfe: sorry, you didnt help us when we asked why should we help you
ProfessorMagikarp0: nickiG ippsec has the answer
dontbeameme: @1990sbaby4lyfe Lolol
oMythra: sometimes you gotta weaponize that ping
ProfessorMagikarp0: reverse shell
Imuhnent: @georgehotz probably a ping with a large packet for DOS?
ProfessorMagikarp0: pentest monkey cheat sheet for reverse shells
Santiago_LHC: weaponized ping is my stripper name
MuscleMario: @Imuhnent they dont do DOS's in CTF's usually
MuscleMario: Usually telling u, plz dont try to fuzz our ish
cammbamm92: @Imuhnent DOS can't happen anymore because no more ping of death right?
cammbamm92: oh this is ctf...
cammbamm92: maybe reverse shell?
Nudethedder: maybe the contract thing just executes `ping`?
death_gadget: Is there a way to execute something using the Ethereum contract?
sirleeroyjenkins: people lowkey dropping hints directly from the writeups
euranymous: hey
euranymous: whattt?? bro you back hacking !!
cammbamm92: man i need to brush up on eth contracts lol. been awhile
sirleeroyjenkins: thats a real hint lol
julien9877: just crack the block chain 4Head
MuscleMario: ^
euranymous: 🤣🤣
Santiago_LHC: Anyone has a link to the ctf he's doing?
oMythra: HackTheBox Chainsaw
MichaelA1337: Its on hackthebox @santiago_lhc
ProfessorMagikarp0: command injection nickiG
Santiago_LHC: thx!
cswelin: Packet = rabbit hole
Nudethedder: finally.
Santiago_LHC: lol
sirleeroyjenkins: that moment the lightbulb goes off
cogforkd: atleast it s a smalll HOLE!!
ickystickybandit: what took you so long?
Nudethedder: pajaHandsUp
MuscleMario: cswellin -_-
cogforkd: btw.. why do people call it as rabbit hole?!!!
julien9877: spoiler weirdc
julien9877: DansGame
sirleeroyjenkins: looool
zol0: LUL
whiteworthy: no way
euranymous: I have finished that box
ProfessorMagikarp0: everything is easy in hindsight Kappa
Santiago_LHC: CTF game is on!
euranymous: it's amazing bro
dontbeameme: 🔥🔥🔥🔥🔥🔥🔥
abhb09: what are you solving?
moonify: Damn it! @georgehotz
euranymous: chainsaw HTB
yBw1: its the pasta
Still2050: Drink some tea
sirleeroyjenkins: he didnt mix the sauce well enough throughout the pasta thats why
euranymous: NC -lvnp Port
MuscleMario: ^
Nubadoxd: Sony would be ashamed of you George ristrePants
MuscleMario: Do they have difficulties or pts for these?
euranymous: yes
cogforkd: what time is it there?
Imuhnent: @MuscleMario both
dontbeameme: @professormagikarp0 your secretly gyarados
euranymous: use man nc to see if it's on the manual
ProfessorMagikarp0: @dontbeameme one day i will be back with vengeance &gt;=]
MuscleMario: Oh, he's listening on his own box, and having it connect back.
Still2050: Is he a affiliate or partner?
MuscleMario: Gotem
ProfessorMagikarp0: u can reset the VM if they do that LUL
euranymous: @georgehotz have bash aliases for netcat and stuff for convienence.
ProfessorMagikarp0: pentest monkey . net has cheat sheets
Santiago_LHC: Those elite hacker days
dontbeameme: Don’t believe his fins
crazycatz59: What do you think about parents who make their kids install tracking apps on their phones?
dontbeameme: Fibs
dontbeameme: *
MuscleMario: i hope some1 isnt fing with him lol
MuscleMario: starts piping in ascii dicks
Santiago_LHC: @crazycatz59 They bought the phones, so, rules apply
dontbeameme: @musclemario What if they are just making him think he is solving it but in reality
MuscleMario: @dontbeameme lol exactly
euranymous: play your music on the background @georgehotz
dontbeameme: @musclemario Turns in his homework and get 0%
MuscleMario: leaks a fake flag
Hamled: multiple set domain calls?
euranymous: anyone who hasn't checked George's music. try it once it's amazing
veritasJS: hi
MuscleMario: ^FLAG^630h0715704lYN07G01N670N071C3$FLAG$
Hamled: nice
whiteworthy: lets go
death_gadget: LUL
Santiago_LHC: #shell
euranymous: LUL
tanoshiizo: root now
dontbeameme: Fake she;l
Santiago_LHC: Hacking intensifies
Arksam: NotLikeThis
janne808: make a pty
12btw_: take notes kids
sirleeroyjenkins: "Once you're in a box you should always try and stay in the box more"
ProfessorMagikarp0: need hackerman emotes LUL
Santiago_LHC: I always stay in the box more
MuscleMario: iCarly lol
euranymous: install persistence and stay in the box
oMythra: LUL
Hamled: find / -iname *flag*
MuscleMario: knut200
Santiago_LHC: bobby denied
ProfessorMagikarp0: flags on desktop?
euranymous: privesc to another user
oMythra: usually theres more to these boxes right?
euranymous: looking for some juicy Linux files
Santiago_LHC: bobby is getting hacked
Gorums_1: ssh boby@x.x.x.x
dontbeameme: Time for social engineering
ProfessorMagikarp0: LUL baller name
Hamled: Chuck Rhoades from Billions?
vloood: why bobby?
vloood: out of all the users
Nubadoxd: Nah it's from billions ristreCat
oMythra: booby had it coming
Nubadoxd: Bobby and Chuck Rhoades ristreCat
oMythra: also bobby*
Nubadoxd: booby
dontbeameme: Bobby nudes about to get passed around the office
Nubadoxd: where InuyoFace
oMythra: LUL
Gorums_1: looks for sutied
Santiago_LHC: booby
Gorums_1: suid bit
yBw1: suidbash
soul_serpent: k3yb0ard = hhkb
MuscleMario: X_X
veritasJS: :D
Gorums_1: maybe you need to exploit ping now lol
Santiago_LHC: LOL
MuscleMario: Increase font, im ancient
ProfessorMagikarp0: rip bobby sending his kids to college :(
Santiago_LHC: Bobby just wanted to play some twitch tac toe
dontbeameme: Bobby so fucked
dontbeameme: Fucking the ceo won’t help u now bobby
foogs_: bobbys world
Nubadoxd: brah... he's got clothes on the floor
Nubadoxd: NotLikeThis
1990sbaby4lyfe: run bubby run!!!
dontbeameme: @nubadoxd It’s a studio tho
Nubadoxd: pick em up George
Nubadoxd: don't matter boi
euranymous: have you ran ipfs ls??
Nubadoxd: pick... EM UP
Santiago_LHC: Bobby doesn't have clothes on his floor
Nubadoxd: Thank you
MuscleMario: damn
Nubadoxd: I'm looking out for you
ne3cross: Which process is he running?
Xingjuice: lmao
euranymous: I have done the box
Gorums_1: maybe you have access to another user
MichaelA1337: no I just used my sub on Lana lux
MichaelA1337: :(
Nubadoxd: ristreCat
euranymous: @georgehotz have you tried ipfs ls?
Santiago_LHC: hey, no hints
rrittenhouse: Yeah guys, i'm real. I mena bobby is real.
ne3cross: Church what if or what processes Bobby is running
Santiago_LHC: Don't help him!
euranymous: bro blockchain uses some kind of p2p right
1990sbaby4lyfe: dont help him he didnt help us come on now!!
MuscleMario: y are u guys throwin him these bone
1990sbaby4lyfe: lifes not fair!!
euranymous: ^^^^
Santiago_LHC: Help us help Bobby
Flashytrash: what are we programming
ProfessorMagikarp0: now we need to give him fake hints to even it out Kappa
euranymous: no more hints now
euranymous: LUL
Hamled: is it a hint if it doesn't help
dontbeameme: @professormagikarp0 I agree, more fake hints
fa_k: do advent of code POOGEERRSSSSSSSSSSSSSS
oMythra: #TeamBobby
Nubadoxd: no backseat hacking DarkMode
Santiago_LHC: Someone call Bobby
Nubadoxd: Bobby is smarter than you George ristrePants
leijurrv: Hey @georgehotz , hey chat :)
ProfessorMagikarp0: i voting for Bobby keeping his job Kappa
MuscleMario: Threaten sub-only if another leak.
dontbeameme: @leijurrv Hello
dontbeameme: @musclemario I agree
Santiago_LHC: Bobby just subscribed
oMythra: man it was a sub giving hints LUL
cammbamm92: sub-bait is obvious
dontbeameme: @professormagikarp0 Bobby for the win
Cube_Is_Life20: george is taking advantage of ocd fans
cammbamm92: cammbamm92 subscribed at Tier 1.
Nubadoxd: NotLikeThis
sDeRs122: nice one
cammbamm92: sub bait was too obvious
ᅟᅟᅟᅟ: WubTF
Nubadoxd: KomodoHype KomodoHype KomodoHype KomodoHype
moonify: I live in a 3rd world country, no money to sub.
leijurrv: @cammbamm92 LUL
cammbamm92: wow
sirleeroyjenkins: Bobby gon get fired
euranymous: someone donate this guy a sub
Nubadoxd: Pick it up now SeemsGood
ProfessorMagikarp0: george biohacking ocd people for subs D:
Xingjuice: now drop the other sock until someone else subs
euranymous: most of em are empty tho
dontbeameme: 👏
euranymous: 🤣🤣🤣
janne808: it's encoded?
Nubadoxd: There you go ristreCat
MuscleMario: MuscleMario gifted a Tier 1 sub to moonify! This is their first Gift Sub in the channel!
cammbamm92: lolol @Xingjuice pwned
FedeMiraVideos: mario!
Narakuwow: https://clips.twitch.tv/DependablePeacefulCheeseDogFace
Narakuwow: lmao
euranymous: @moonify happy now?
Narakuwow: George u just cursed sth bad in Chinese
moonify: ¡@MuscleMario, damn it! Thanks bro
Hamled: it's probably "bobby"
Nubadoxd: @georgehotz someone gifted a sub, now you have to brush your teeth 3 times a day and clean your room twice a week ristreCat
MuscleMario: De nada mi gente
MuscleMario: lol
Santiago_LHC: Bobby knows more chinese than that
moonify: @MuscleMario Gracias jaja &lt;3
sirleeroyjenkins: bobbys password is probably password
MuscleMario: yo tengo cinco angos en mi escuela
1990sbaby4lyfe: his chinese swear words stems from FPSs ahha
MuscleMario: Cansada eh?
Narakuwow: You said Ni Ma Bi, that was literally "You stupid morons"
Arksam: Yo quiero duermo mucho en clase NotLikeThis
Xingjuice: lmao
tanoshiizo: PogChamp mr worldwide
Santiago_LHC: Excelente español
SpookyFugboi: Stop please.
MuscleMario: Damn 6 years, I got to Spanish 5 in school.
MuscleMario: Ur accent sucks &gt;_&lt;
sirleeroyjenkins: necesito los tacos de biblioteca
Sainfuw: saludos desde Chile VoHiYo
dr_set: that's pretty good
adaut_0: How about portuguese?
Nubadoxd: KEKW
dontbeameme: What’s next for security bobby biometrics fingerprint reader
Santiago_LHC: You were in Argentina?
Nubadoxd: Portuguese InuyoFace
MuscleMario: I love languages
Arksam: PunOko
Mendacii_: Talk spanglish
SilvanoGJr: fala Português
MuscleMario: fall2019 is his password
Nubadoxd: vários BR no chat KomodoHype
Leleckoo: eita
SilvanoGJr: nóis
Santiago_LHC: bobby's password is "pleasedonthackmeimbobby"
dontbeameme: Buffer overflow
Nubadoxd: use a wordlist SeemsGood
euranymous: play your music on the background @georgehotz
yBw1: ogbobbyjohnson
Nubadoxd: ^
Nubadoxd: That's it right there
cammbamm92: salud desde un Tejas Ciudad fronteriza
adaut_0: Br aqui também
ne3cross: Now use the python script...
MuscleMario: GeoHot - &gt; github.com/danielmiessler/SecLists
Santiago_LHC: lol
1990sbaby4lyfe: bobby - yo dont hack whats your paypal?
sirleeroyjenkins: his password is probably "password"
Arksam: Or bobby123
MuscleMario: inb4 it works lol
Nubadoxd: bigdickbobby
euranymous: bobbysmom6969
Santiago_LHC: or "ybbob"
cammbamm92: are there any bobby characters in the show billions?
Nubadoxd: yes
xHardcorexism: suppppp
SilvanoGJr: good ol johnny
12btw_: this CTF server is setup for success or? Goog all the way to win....
Leleckoo: Yep! Bobby Axelrod
vloood: jon the ripper is great
SheitanasGM: hydra
ProfessorMagikarp0: ^
Nubadoxd: Mentalist
Mendacii_: Maybe you need Kali Linux
cammbamm92: did he try that last name? jc lol
minichota: because it's a mac
dontbeameme: Bobby forgot his password and geo helping him
SheitanasGM: so old no?
Nubadoxd: Mac KEKW
MuscleMario: inventory.rawsec.ml/tools.html &lt;- for everyone else who wants a quick reference
Nubadoxd: Run it bare metal DarkMode
oMythra: are you a really a hacker if you're not using Kali
lolunknown: programmer but new to hacking. is ctf a good way to learn?
MuscleMario: @lolunknown best way imo, there are tons of write-ups to learn from too
cammbamm92: learn hacking? yes - and alot of reading
zakonegrusha: @georgehotz a man of culture, glad to see you doing HTB
N3Cubed_Gamer: @lolunknown u know html
N3Cubed_Gamer: ?
lolunknown: yeah I know html
Santiago_LHC: CTFs are the best way to not be Bobby
Nubadoxd: html ristreCheers
leijurrv: @lolunknown So you need to be the best haxxor in the world Kappa
cammbamm92: @lolunknown its just like programming - figure it out yourself and when you fail - you google it
lolunknown: gotcha. Thanks fellas! &lt;3
zakonegrusha: you can just crack it now
ProfessorMagikarp0: i dont think hackthebox usually does brute force nickiG
oMythra: @lolunknown check out picoctf for beginner stuff
Santiago_LHC: #TeamBobby
lolunknown: will do @omythra thanks!
zakonegrusha: @georgehotz what's your HTB profile name?
Nubadoxd: @professormagikarp0 well... it doesn't require the person to solve a problem...
Nubadoxd: but maybe just as a final
Nubadoxd: hurray
minichota: does that rapid clicking make him read faster?
N3Cubed_Gamer: i once gave a presentation in my ethical hacking class on how to hack wep. the teacher was not impressed
cammbamm92: aight I'm not staying I have my own shit to work on
cammbamm92: have a good night nerds
Santiago_LHC: rapid clicking improves reading speed by 78%
dontbeameme: @cammbamm92 Later
Nubadoxd: watches George and calls others nerds KEKW
Nubadoxd: night cam ristreCheers
ickystickybandit: topkek
janne808: hashcat
12btw_: just us a kernel exploit now. not wasting time on ssh keys. stick to the target.
dontbeameme: @cammbamm92 I don’t consider watching cam girls work
cammbamm92: []-[]
Xingjuice: try hashcat I found john to be a bit bitchy about the way its input was formatted
ProfessorMagikarp0: is he trying to ssh -i ?
ickystickybandit: He's not just watching
Santiago_LHC: Bobby 1 - George 0
zakonegrusha: specify the hash type
MuscleMario: There was one CTF that had me decoding images of the flag using cellphone microphone for slow scan tv (SSTV) radio. Was fun watching beeping tone/noises turn into flag{winner}
oMythra: Bobby putting up a fight for sure
cammbamm92: @dontbeameme I work while I watch kek
janne808: hashcat is the go to tool
dontbeameme: @cammbamm92 Yeye
cswelin: provide path to files?
MrTriharder: George PogChamp
Santiago_LHC: Bobby can't be hacked
ickystickybandit: bobby gon sue you like sony
leijurrv: @ickystickybandit LUL
Xingjuice: try hashcat --help
ProfessorMagikarp0: BlessRNG bobby keeps his job another day
Nubadoxd: if we're not quicker Bobby is gonna get back from work and catch us in the act InuyoFace
Arksam: primeagenBig primeagenRust primeagenHands Bobby the bob.
allthesm0ke: is dat clacking the HHKB Type-S Georgie?
ProfessorMagikarp0: in bobby we trust
MrTriharder: Johnny the ripper is decrypting hashes iirc
N3Cubed_Gamer: @georgehotz u dont want to start a security company where ppl pay u to break in?
allthesm0ke: !keyboard
sirleeroyjenkins: @georgehotz that version of john doesnt work with ssh2john you have to use sshng2john then it will work
sirleeroyjenkins: o
MrTriharder: @georgehotz sir request to increase font size a little . Thank you :)
Nubadoxd: why don't we just find out where Bobby lives and "pay him a visit"... where he "voluntarily" gives us his password PowerUpL EntropyWins PowerUpR
Xingjuice: you have to do john --show "filename"
Gorums_1: --format=SSH
dontbeameme: @nubadoxd Agreed
ne3cross: —show
Nubadoxd: Mentalist
Xingjuice: If its cracked it. It will show you
AlexEDM: how many programming languages does George know?
Xingjuice: it won't output to a file unless specified
ProfessorMagikarp0: i wouldnt focus on brute forcing things nickiG i dont think hackthebox does those often
Nubadoxd: shrek.jpg KEKW
Santiago_LHC: Bobby would never use a weak password
MuscleMario: git clone seclists; cat */* &gt; all-the-words.txt
Nubadoxd: Mentalist it better
12btw_: kaceyFail
Mendacii_: Shrek
Xingjuice: I ran hashcat for about 5 hours for an assignment lol
yBw1: http://geohot.com/random
N3Cubed_Gamer: @georgehotz rainbow tables
Xingjuice: this might take a while if its not simple
dontbeameme: Fuck bobby viva revolution
sirleeroyjenkins: Try rockyou. txt maybez
Santiago_LHC: @yBw1 That's a good one.
lolunknown: apart from ctf to learn hacking; do you gents recommend any other ways to learn?
leijurrv: @yBw1 "I like big butts and I cannot lie" XD
Nubadoxd: It's a 33 character long password PowerUpL EntropyWins PowerUpR
Santiago_LHC: Hey, no helping
oMythra: Bobby is a security conscious person
ProfessorMagikarp0: open jobs Pog
cswelin: @sirleeroyjenkins stop giving it away
MuscleMario: http://geohot.com/random ?
sirleeroyjenkins: @cswelin ???
Nubadoxd: social media manager InuyoFace
ne3cross: If those files earlier had private keys, maybe clear text passwords also?
Santiago_LHC: lol Chuck Schumer
sirleeroyjenkins: @cswelin literally hav never done this just offering a suggestion but ok
Nubadoxd: let's go back to ipfs
12btw_: try to connect to other systems
dawgwhisper007: @georgehotz what happened to the white layout for Twitch?
abhb09: let's do rm -rf /
cswelin: @sirleeroyjenkins you’re reading a solution and providing hints from it
sirleeroyjenkins: @cswelin I am not actually
dontbeameme: @dawgwhisper007 Open to full window
dontbeameme: If on desktop try settings
sirleeroyjenkins: @cswelin Im recommending one of the most common wordlists there is
cswelin: If you say so
Mendacii_: You have to social hack bobby LUL
12btw_: Ask bob for his password to fix a crash
dontbeameme: @mendacii_ Phishing bobby
Santiago_LHC: You have to seduce Bobby
N3Cubed_Gamer: did you try social engineering
Nubadoxd: pretend to be a hot chick
Nubadoxd: make him send nudes
zol0: you have to write ping again
Nubadoxd: and then use it to bargain for his password
sirleeroyjenkins: its probably not even the right answer...like i said i literally just guessed this
SheitanasGM: rockyou most famous wolrdlist
Santiago_LHC: This hack sounds way more epic than it is if you have The Matrix soundtrack playing in the background.
MrTriharder: @georgehotz call Bobby and tell him you are from Microsoft service center and there’s virus on his computer Kappa
Nubadoxd: ,^
AlexEDM: what exactly is he doing?
Santiago_LHC: Hacking Bobby
leijurrv: HACKED
Nubadoxd: He doesn't know
whiteworthy: YOOOOOOOO
N3Cubed_Gamer: whoooo
12btw_: WTF
MuscleMario: http://geohot.com/pipermail/http://geohot.com/randomhttp://geohot.com/error_loghttp://geohot.com/ahttp://geohot.com/java-sys/http://geohot.com/mailman/listinfohttp://geohot.com/pipermail/
sirleeroyjenkins: Oh shit my suggestion was right I MUST BE READING A SOLUTION!!!
Nubadoxd: YEAH
tanoshiizo: 😎 he's in
N3Cubed_Gamer: BloodTrail
vloood: @sirleeroyjenkins um yeah lol we're more convinced than ever
12btw_: losser password
N3Cubed_Gamer: @georgehotz tha
Nubadoxd: @sirleeroyjenkins mentalist would've probably worked as well PepeHands
N3Cubed_Gamer: was off the chain
janne808: if you're supposed to bruteforce a password on htb it's usually on rockyou.txt
sirleeroyjenkins: ^
MuscleMario: u wanna see a fat possum?
ProfessorMagikarp0: watch ippsec walkthough after ur done LUL
Nubadoxd: I do
鼻史: 10
Hamled: it never feels quite as difficult after you're done
leijurrv: 1
dr_set: 4
moonify: 4
JakePauler421421: 420
euranymous: 4
MuscleMario: OUT OF BOUNDS
Infinitelym: 4
N3Cubed_Gamer: 3
Kodak_Z: 4
Narakuwow: Jackie Chan slept more women than Chamberlain
whiteworthy: 4
Nubadoxd: 4
qlutoo: did you look at the second multipart base64 payload in the ipfs blob
oMythra: 4
dontbeameme: I like even numbers
MuscleMario: I c ppl wearing hack the box shirts at work
Nubadoxd: 69
hsojstrim: 7
Santiago_LHC: What is going to happen to Bobby now?
Hamled: @georgehotz Have you ever seen Pwny Racing? https://www.youtube.com/watch?v=6wmyaYP5WkA
ProfessorMagikarp0: rip bobby's kids arnt going to college now PepeHands
euranymous: let's get roooot
euranymous: no it's not that hard
moonify: Go for it!
leijurrv: GET ROOT
Nubadoxd: Let's dew it
Nubadoxd: DarkMode
dr_set: go for it!
voxelfox0125: root
euranymous: but there are some rabbit holes
Nubadoxd: fuck Bobby InuyoFace
N3Cubed_Gamer: do root
euranymous: it took me 3 days lol
MrTriharder: I just woke up SwiftRage can’t stop the stream now SwiftRage
SuchALuckyGuy: lirikSMUG
Infinitelym: Can you move your camera feed to the top right
Santiago_LHC: #scam
12btw_: 32bit
sippinoonapplejuice: scammazzed
Hamled: Is it Apple scamming you or HexRays
yBw1: hopper
鼻史: let's use qira
Hamled: Yeah
euranymous: @georgehotz have you considered to switch to Linux?
leijurrv: LUL
12btw_: i will see you revers this without hex-ray
dontbeameme: Later
Hamled: My other operating systems can run 32-bit binaries
Hamled: and 64-bit
Hamled: its magic
euranymous: apple sucks
sippinoonapplejuice: can u do a q and a stream?
voxelfox0125: next stream cracking sha256.
Santiago_LHC: please, you should know better than to tell george to quit Apple
Nubadoxd: what's your os Hamled?
bryyce: you should make a day in the life
sippinoonapplejuice: like about ur first apple iphone jailbreak and about ps3 case
bryyce: video
Mendacii_: Raspberry pi - 1 Catalina OS -0
sippinoonapplejuice: pretty please w a cherry on top @georgehotz
sippinoonapplejuice: or can u not talk about the sony case
Hamled: @Nubadoxd arch currently
sippinoonapplejuice: well how and what did u do to the ps3?
N3Cubed_Gamer: case closed
dontbeameme: @sippinoonapplejuice Watch YouTube video
sippinoonapplejuice: i want to hear it from the MAN
Nubadoxd: @hamled as a daily driver... well it depends on what you do on your computer on a daily basis... but ain't it a bit of a Hussle ?
dontbeameme: Bobby your fucked bud
12btw_: just shut down the server to become the winner, so nobody can progress kaceyHEH
sippinoonapplejuice: and how is ur automated driving company going?
dontbeameme: @12btw_ Genius
euranymous: group can write python ,C but can he write Mexican ?
Santiago_LHC: The ping part was inspiring
ProfessorMagikarp0: it may have been dumb, but i enjoy the time we spent together Kappa
euranymous: 🤣
Nubadoxd: LUL
euranymous: https://youtu.be/8YFiWz6XmHI
AlexEDM: so George is going through a training module? :)
bryyce: why is this stream not more popular? Your like the next elon musk
dontbeameme: Bobby network is a crypto-mining network now
Abnico: join the north korea testnet
ProfessorMagikarp0: Red Star OS comrade
euranymous: does any of you mine crypto?
leijurrv: @euranymous If i tell you that i mine, then what? LUL
euranymous: I needed some suggestions LUL
dontbeameme: @euranymous Imagine if you could run these test programs to mine crypto instead of solving problems
leijurrv: @euranymous I'm a dumb person, don't ask me for suggestions Kappa
MaxBrag1337: Hello
Abnico: finding numbers as human is too slow
AtomicPandaAttack: That jacket looks so comfy
maverick_twitch_: !info
maverick_twitch_: !about
maverick_twitch_: !project
MaxBrag1337: and
MaxBrag1337: this is "Basic Programming" O_O
oMythra: what you want to know @maverick_twitch_
MaxBrag1337: ?*
maverick_twitch_: whats he doing
oMythra: he's doing a CTF fro HackTheBox
maverick_twitch_: whats CTF
leijurrv: Capture The flag @maverick_twitch_
MaxBrag1337: Capture The Flag
maverick_twitch_: whats that
clapsnowman881: Hi from Spain!
Abnico: lmao
clapsnowman881: This CTF is about ethereum blockchain isn't it?
Imuhnent: yes
oMythra: use hacking skills to find the hidden key pretty much
f_karamazov: What is the hash from
clapsnowman881: but the hidden key is where the CTF creators have placed it, or is it a real security hole?
Nubadoxd: Man... Bobby's gonna lose his job after this... I kinda feel for the guy now TearGlove
N3Cubed_Gamer: @bryyce elon n george are in direct competition
sippinoonapplejuice: is commaai ur main focus these days? @georgehotz
Imuhnent: @georgehotz brute force that one
mutrx: wow finally caught one of ur streams!
F0nt0: me too
N3Cubed_Gamer: me too
sippinoonapplejuice: me too
Santiago_LHC: @sippinoonapplejuice You are asking all the bannable questions
sippinoonapplejuice: really?
Santiago_LHC: Yep
Santiago_LHC: No keyboard, no self-driving car, no jailbreaking
sippinoonapplejuice: well is there a time for a q and a?
clapsnowman881: @georgehotz you can type (e)=&gt;{} instead of the old function(e){}
Solias_3: !uptime
clapsnowman881: You type so fast &lt;3
mutrx: @georgehotz do a typeracer with chat
sippinoonapplejuice: i just want an update on my boos life @Santiago_LHC
erichtp: @sippinoonapplejuice you can ask questions but make it on streams topic bruh
forkdb: Hey george .. what time are you going to sleep? It should be pretty late for you there...
Santiago_LHC: @sippinoonapplejuice If you become a subscriber he may answer some questions.
sippinoonapplejuice: oooookk
sippinoonapplejuice: money talks
Santiago_LHC: Of course
Raulzara: Big fan of yours. Finally get to see you live streaming. Cheers 🍺
Santiago_LHC: You wanna derail the stream with off topic questions, you gotta pay
dustbin123: Hi George
forkdb: Hey george .. what time are you going to sleep? It should be pretty late for you there... Get some rest
F0nt0: what is he working on?
sippinoonapplejuice: bannable question
f_karamazov: Gotta spam it
sippinoonapplejuice: off topic
sippinoonapplejuice: LUL
MichaelA1337: @f0nt0 HTB
Santiago_LHC: Boom. Sleep question answered
sippinoonapplejuice: @F0nt0 HACKINTHEBOX
clapsnowman881: and do ctf people work in teams? may be... more than one brain thinks more ideas or something? or do ctf are just done by one person always?
F0nt0: I saw some js code. is the doing client side too?
clapsnowman881: nodejs
Santiago_LHC: @clapsnowman881 Yeah, at competition level this is done by teams
MichaelA1337: @clapsnowman881 Sometimes
oMythra: yea theres usually teams in competitive ctfs
FadezzHD: @clapsnowman881 teams, but he was doing them by himself
maverick_twitch_: whats your view on Rust ?
clapsnowman881: cool, thank you for the answers, he's doing the work of a whole team, &lt;3
oMythra: check out ctftime.org to see comps and teams
F0nt0: I see. caught my attention that saw some "var" declarations along with "const" ones.
Santiago_LHC: If he was in a team, he wouldn't have spent a couple of hours pinging
mutrx: i thought george said he wasn't doing ctfs anymore?
maverick_twitch_: you cant think
maverick_twitch_: clip it
euranymous: no bones for you chap
dustbin123: Cheer100
ethancruize: GeoHotz must return
clapsnowman881: and which ctf is he doing? I'm already on the web you shared, are they numbered?
ethancruize: a ctf challenge from chainsaw box from hackthebox
Smokinate: 5AM in Silicon Valley was fire @georgehotz
Santiago_LHC: @clapsnowman881 He made this CTF https://0xrick.github.io/hack-the-box/chainsaw/
clapsnowman881: thank you @ethancruize and @Santiago_LHC
death_gadget: Didn't the site say the flag was in the user.txt?
Imuhnent: he already has user.txt
ethancruize: every box/machine has two flag., one in user home folder and one in /root
death_gadget: Fair enough. I just got back and saw it in the directory.
sippinoonapplejuice: @N3Cubed_Gamer can u sing for us after this stream is over?
ethancruize: user.txt and root.txt hashes are the flags
death_gadget: Thx
euranymous: this box is a good mindfuck
euranymous: @georgehotz play your music man.
euranymous: play tomcr00se
SilvanoGJr: is the pw an address too?
maverick_twitch_: !play mission impossible theme
euranymous: fail recorder version suits well 🤣🤣
maverick_twitch_: !commands
Santiago_LHC: No commands
SurfCat: no rules
Santiago_LHC: There is no bot
SurfCat: Keepo
euranymous: @georgehotz Can I get the lyrics for the endgame poem?
euranymous: #2 no keyboard
maverick_twitch_: yes keyboard
dustbin123: Cheer100
maverick_twitch_: permaban
euranymous: @dustbin123 gift subs instead bro
Santiago_LHC: Asking what keyboard he uses, is the #1 FAQ
prafaeltsantos: you are doing it late today @georgehotz
maverick_twitch_: bye bye@sippinoonapplejuice
mutrx: rip
maverick_twitch_: rip
oMythra: LUL
mikey9988: monkaS
TemujinGenghis: Is asking about FAQ, #2FAQ? Kappa
euranymous: imagine geohot as an exec of a bug bounty company
maverick_twitch_: so
mutrx: lol
Santiago_LHC: LOL
leijurrv: F
Alk051: F
ProfessorMagikarp0: rip see u on the other side brother :(
maverick_twitch_: lol
mikey9988: F
euranymous: Dick's out for harambe
niiq: why? whats wrong with the keyboard?
JohnEGQ: why don't I see the question about the k ?
dontbeameme: @euranymous Rip
oMythra: He was living dangerously
euranymous: yes I do bro
Santiago_LHC: Bobby knows the answer
mutrx: d33f4cf4d6f7d80b9086b73c659d8a4a
ProfessorMagikarp0: u killed bobby :(
death_gadget: LOL
dontbeameme: Case closed
death_gadget: Is that the flag? lol
euranymous: yes
mutrx: no
JohnEGQ: one of the errors said you need gas ... thar is how you get things to work on Eth
Abnico: PogChamp PogChamp PogChamp PogChamp PogChamp
mutrx: decrypt md5
euranymous: @georgehotz you want hint?
maverick_twitch_: the sippinoonapple juice didnt ask about your keyboard
mutrx: decrpy md5 for hint
oMythra: Bobby is now a Luddite...he's done with tech
SheitanasGM: find the pohne and ask Bobby
euranymous: tamper around more in the ABI
maverick_twitch_: the banned guy can just look at the FAQ
mutrx: it would probably be easier to write a trading bot on BitMEX
maverick_twitch_: its not
Santiago_LHC: Ethereum Hacking is my band's name
maverick_twitch_: its cracking not hacking
maverick_twitch_: hacking = programming
JohnEGQ: maybe I suck, but I took a crack at a trading bot...not easy
Santiago_LHC: That's our first single
euranymous: @georgehotz Can you tell us how you used to look at finding vulns back in your elite days?
ChOkO08_: Sup guys
Santiago_LHC: JS for the win
mikey9988: JS LUL
ChOkO08_: What CTG we're trying here @georgehotz ?
ChOkO08_: Which CTF*
mutrx: @euranymous fuckery
clapsnowman881: he's 0xrick github io hack-the-box chainsaw/
Santiago_LHC: You ping until you make it
dawgwhisper007: tap tap tap
ethancruize: afaik etherium/blockchain hacks are all source code audit vulns
oMythra: fuzz everything
euranymous: lemme throw another tip
maverick_twitch_: use an AI to hack
clapsnowman881: btw george, what do you think of the crypto about winning the future of banking?
ethancruize: you are complicating things i think, there isnt any crypto or blockchain vuln , but just a user input flaw
nizero: hey george
maverick_twitch_: crypto has no intrinsic value
ethancruize: look into how they are doing the PING
prafaeltsantos: @clapsnowman881 crypto will never win becouse people are stupid
Santiago_LHC: neither does fiat currency
oMythra: chop chop @euranymous
euranymous: list open ports with netstat
maverick_twitch_: nothing will win without intrinsic value
clapsnowman881: so crypto are the Esperanto of languages to banking?
Santiago_LHC: @maverick_twitch_ papery money has no intrinsic value either.
maverick_twitch_: i know
Santiago_LHC: and it won
janne808: always enumerate
euranymous: port 63991?
euranymous: at localhost
ProfessorMagikarp0: Jebaited
ethancruize: computers are weird
maverick_twitch_: @santiago_lhc it didnt
mutrx: brains are weird*
clapsnowman881: can't you put a watch on the port number'
clapsnowman881: ?
ProfessorMagikarp0: thx obama hiding ports
Santiago_LHC: @maverick_twitch_ Then I guess capitalism doesn't exist.
maverick_twitch_: @santiago_lhc fiat currency is for poor and middleclass
euranymous: @georgehotz I was surprised as well LUL
ProfessorMagikarp0: some1 reset the box?
ProfessorMagikarp0: idk
Santiago_LHC: @maverick_twitch_ you think rick people are carrying gold around?
euranymous: I am still trying figure out what happened
Santiago_LHC: *rich
maverick_twitch_: @santiago_lhc thats what they care.about farms,gold
youngmarsh: damnit bobby
eksdee_1_2_3: whats ctf
mutrx: has anyone made money cracking etherium?
oMythra: Revenge of Bobby
sippinoonapplejuice: @georgehotz i didnt ask about ur keyboard. someone said there is a keybaord rule and i asked what keyboard
ethancruize: they dont crack etherium, they hack other peoples etherium implementations
mutrx: ban him again LUL
euranymous: now write an exploit to setuser, getusr, setpass,getpass
death_gadget: You learned a valuable lesson
oMythra: he's back LUL
ProfessorMagikarp0: @sippinoonapplejuice look he is doing it again Kappa
tornpaperyoyos: @sippinoonapplejuice which means you asked about the keyboard
maverick_twitch_: :D
sippinoonapplejuice: LUL
sippinoonapplejuice: NO
sippinoonapplejuice: i didnt know there was a rule
maverick_twitch_: time out
Piqcyl: Can someone fill me in on what he is working on
sippinoonapplejuice: @maverick_twitch_ stop it
mutrx: GO AGAINE LUL
oMythra: hit em with a hot 600 again Kappa
tornpaperyoyos: @sippinoonapplejuice why tf u lyin
sippinoonapplejuice: i aint lying
maverick_twitch_: perma ban
sippinoonapplejuice: im a honest man
ethancruize: there's RCE on main.py
tornpaperyoyos: BAN THIS MAN
Santiago_LHC: Throwing a tantrum about having gotten timed out is the fastest way to get banned
oMythra: thats it bring up the chat log lmao
sippinoonapplejuice: :(
ProfessorMagikarp0: Jebaited Jebaited Jebaited
euranymous: slack to get root
maverick_twitch_: ok dont ban this guy
mutrx: @sippinoonapplejuice
clapsnowman881: cat /etc/passwd to see if there's a root user or bob user?
death_gadget: LUL
moonify: GG
Xingjuice: lmao
Xingjuice: can
tornpaperyoyos: BAN THIS MAN GEORGE LUL
janne808: root coin TheIlluminati
euranymous: bmap --mode slack root.txt --verbose @georgehotz
oMythra: LUL LUL
sippinoonapplejuice: wow guys
Xingjuice: cant talk or else banned
Piqcyl: Can someone fill me in on what he is working on
death_gadget: @sippinoonapplejuice I've seen people banned for less. You are lucky. LUL
Xingjuice: might as well just ban em lol
euranymous: sorry, man you're my inspiration couldn't watch you struggle
sippinoonapplejuice: i didnt even do anything @death_gadget
ProfessorMagikarp0: kangaroo court = chat Kappa
mutrx: weak stream lol
Santiago_LHC: Tantrum detected
tornpaperyoyos: @sippinoonapplejuice LIES
jisaku: it told you not to get excited and you are partying making pasta
sippinoonapplejuice: @tornpaperyoyos i think u should be banned
mutrx: weak beta piss
roystang: what keyboard do u use
clapsnowman881: What are you eating George?
Santiago_LHC: LOL
yBw1: what kind of pasta
tornpaperyoyos: @sippinoonapplejuice im not the one asking about keybaords
death_gadget: smh
sippinoonapplejuice: @tornpaperyoyos u just di
sippinoonapplejuice: did
12btw_: 24h stream inc
euranymous: bmap and slack the root
oMythra: you cant mention the K word guys
roystang: keyboard
tornpaperyoyos: @sippinoonapplejuice nope but u admitted that u did sooooo
yBw1: looks like tortellini
maverick_twitch_: keep the.chat relevant to thd topic guys
roystang: keyboard, keyboard, keyboard
ProfessorMagikarp0: rip
Santiago_LHC: rip
mutrx: its been nice knowing you @roystang
death_gadget: @roystang Hopefully the ban hammer doesn't hurt too much
Piqcyl: George what are you working on @georgehotz
oMythra: he doing HackTheBox CTF
roystang: see, im of higher class
mutrx: for $5 such a sellout
Piqcyl: What kind of mouse do you have
Santiago_LHC: He's not a subscriber though
SurfCat: I was about to ask that no irony LUL
ethancruize: https://advent2019.overthewire.org/ its happening now
12btw_: slootKappa
forkdb: What keyboard do you have is it leopold or hhkb2?
roystang: but im a primer, so i have a bigger dingus
yBw1: ducky one
Xingjuice: its a hhkb
Abnico: furniture is for peasants
maverick_twitch_: he is not ironical
PhysoTronic: forkdb one month sub, I think you are playing with fire Kappa
oMythra: we got a crown fro a reason
Piqcyl: What about meta ^(meta) ironically
maverick_twitch_: roystang lacks humour
clapsnowman881: by the way, what is the Linux terminal font by default? Because I rather use menlo?
yBw1: dont you hear dem topaz switches
SurfCat: haha
euranymous: bmap and slack
12btw_: i have cancel my prime , like my first iphone.
Xingjuice: idk that's what I saw in some video a while ago
mutrx: i swear geo became famous because of those swtiches
SurfCat: I sounded like mine a bit ducky one too here. But I can't tell em apart honestly LUL
Piqcyl: Is he mining for rootcoin ?
nizero: i watched you do a leet code and you instantly knew it was a backtracking greedy problem, can u teach us that real quick
euranymous: bmap and slack the root .txt
12btw_: btw my iphone g3 has a gcc compiler
sippinoonapplejuice: bitmap
euranymous: thats root flag
euranymous: 5
ProfessorMagikarp0: nice hint Kappa
mutrx: R U I N E D
oMythra: @euranymous the goat
death_gadget: Kappa
yBw1: how do u even come up with this
Santiago_LHC: There is a write up
mutrx: @euranymous what K do u use?
stormgoodunit: Nooooooo
euranymous: k?
ProfessorMagikarp0: hackerman emotes channel when? nickiThink
oMythra: the k word
euranymous: razer
yBw1: BibleThump
tornpaperyoyos: i thought you were a hackerman george
SurfCat: hiding data on slack space, that's pretty obscure or am I just such a noob :P
euranymous: read the manual
Xingjuice: yo thats some weird shit
Santiago_LHC: obscure AF
SurfCat: rtfm Keepo
MuscleMario: this entire time trying to exploit geohot's site
MuscleMario: failing
janne808: you would have found bmap if you'd enumerated the binaries on the box
euranymous: its the official one
Santiago_LHC: Poor Bobby
euranymous: bobby is moving to his parents house now
oMythra: its a wrap for #TeamBobby
euranymous: @georgehotz You did really goof bro
euranymous: good*
ProfessorMagikarp0: BlessRNG bobby will remain in our hearts
MuscleMario: 👏
death_gadget: It's only a hint if you know the flag is supposed to be "in" the root.txt file itself.
euranymous: and thats HTB's docs LUL
oMythra: yea its always in root.txt no?
death_gadget: Yea. But if it's your first box, you may think that the root.txt is pointing you somewhere else.
janne808: they do similar shit with windows boxes too
logicssoldier: Kreygasm
forkdb: George .. please talk about something insightful
tornpaperyoyos: would love to watch more ctfs @georgehotz
euranymous: @georgehotz will you be a guest at @nahamsec 's stream?
oMythra: yea more CTFs
ProfessorMagikarp0: more HTB in future streams senpai Kreygasm
oMythra: maybe one day you'll get that microcorruption email LUL
johnny_thehobo: doxxed?
forkdb: I would love to hear from you about your experience when you started to learn programming...
js0n_x: oh the joy of ctf, stumbling on an answer lol
stormgoodunit: are you gonna do some competitive programming like the google code jam?
mutrx: write some stock trading shit
euranymous: do HEIST now?
Santiago_LHC: Can we go back to MATH?
Xingjuice: nah the ctf stuff is nice
12btw_: What you will do for living when no IT exist?
euranymous: its a retired box pretty easy windows box.
death_gadget: Let's do a bigger COQ
ProfessorMagikarp0: we are twitch chat we are never happy LUL
ProDucks: link to the website? I am watching from the wii internet browser
forkdb: I would love to hear from you about your experience when you started to learn programming...
3even: How about back to your roots as a PHP web dev?
oMythra: google HackTheBox
mutrx: teach us some html
crazycatz59: what about picoCTF?
janne808: tsodinJS
3ygun: When are you going to play games this is a gaming website nathanGod1 nathanGod2
voxelfox0125: Well time to get that skill back
nizero: george can u answer my backtracking / greedy algorithm question ... that particular problem solving is difficult for me
MuscleMario: I grew up wanting to do this and go to defcon, then i got a real job, fast forward 7 years.
oMythra: pico would be too easy for him
MuscleMario: Never went to Defcon.
forkdb: I would love to hear from you about your experience when you started to learn programming...
ethancruize: pwnable.tw please
jay_al97: are you really going to do hack the box?
Santiago_LHC: Defcon is dead and Bobby killed it
MuscleMario: It got corporatized?
litesam: Now people gofor React Conf
Usisuvach0: @ethancruize pwnable.kr
mutrx: that's why you should go to TwitchCon
MuscleMario: I just went to my first conference, and yeah, I seen those 'perpetual conference class' people.
12btw_: HotPokket
Santiago_LHC: CONCON, coming soon
jay_al97: hey @georgehotz have heard of papers we love
jay_al97: https://paperswelove.org/
litesam: Song suggestions?
ethancruize: @Usisuvach0 pwnable.tw
euranymous: @litesam tomcr00se
jisaku: have you seen ret2's web ctf setup? https://wargames.ret2.systems/level/corruption csaw had a chal in it like a year ago
MuscleMario: Ressurrect @tomcr00se
georgehotz: https://slatestarcodex.com/2019/05/22/the-apa-meeting-a-photo-essay/
yBw1: Lil Peep - Belgium
litesam: Why safari, Use brave
nautzz: thx for the link
euranymous: can anybody gift me a sub?
mutrx: What So Not &amp; BURNS - Trust (Plastic Plates Remix)
litesam: use brave browser
Santiago_LHC: WHAT
nautzz: lmao
MuscleMario: @euranymous &lt;= Sorry, a gift subscription to this channel is not available for this user.
mutrx: lol
sirvapealots: @georgehotz monkaTOS
Santiago_LHC: Is this WOKECON?
Ekshernul: lul
euranymous: @MuscleMario its alright man
nautzz: this kind of wokeness is hilarious, the level of otherizing they purport to oppose they do to people on a whole other scale
realdigitalflow: looool
MuscleMario: O-o y they not letting u get a gifted sub?
3even: TDS is real.
euranymous: That woke bullshit will rip apart the integrity of United States
Santiago_LHC: F
mutrx: F
nautzz: boomed
Xingjuice: lol
TemujinGenghis: F
3ygun: krippSmart
yBw1: hahaha
roystang: yeah, i can only talk about the keyboard
yohjiman: lmaoo
sirvapealots: LUL BANNED RETARD
woogio: boosh
tornpaperyoyos: @georgehotz i tpold you george ban this man LUL you finally did it LUL LUL
litesam: Use Brave (question mark)?
Alk051: How do you start a hack ?
forkdb: I would love to hear from you about your experience when you started to learn programming...
oMythra: and twitter
MuscleMario: I'm trying to force myself to use brave.
MuscleMario: Chromium
12btw_: You have the ask the right questions "political islam"
Santiago_LHC: So many browsers.
JohnEGQ: yes, blocks ads which makes it "faster"
mutrx: WOKECON would be an hour long talk about jailbreaking the simulation...
Ekshernul: it spills out into real world and industries quite a lot, so it's not really confined woke thing, unfortunately
MuscleMario: It's a little spammy, but its for a good cause?
nautzz: ya like what is brave
MuscleMario: Chromium, with BAT blockchain
mutrx: WOKECON would be an hour long talk about jailbreaking the simulation....
Abnico: brave isnt as good as chrome and ublock
3even: FF
shrewduser: edge
euranymous: firefox with librefox is best
Santiago_LHC: Firefox rules
litesam: Then why safari?
Robertstojs10: guy behind brave is sus as hell
Abnico: firefox is trash on mac
voxelfox0125: Have you seen this https://www.youtube.com/watch?v=hLjht9uJWgw&amp;t=47s
oMythra: tried moving away from chrome but the integration with your google accounts is too good
nautzz: do u think firefox will be worthwhile a couple years down the line when servo starts really being a thing
nautzz: ya its the rust based one
euranymous: librefox @georgehotz
12btw_: you have a public and private profile this days.
Abnico: everyone has your data at this point
nautzz: they incorporated some of it into a relatively recent patch to firefox
litesam: @georgehotz start making games?
roystang: mozilla funds mozilla
Santiago_LHC: Bobby funds Mozilla
sirvapealots: @georgehotz not russians LUL
nautzz: non profit right?
sirvapealots: @nautzz 501c3
MrTriharder: @georgehotz have you thought of a vim like web browser? Like /word to find all words on the pages
mutrx: @MrTriharder jesus christ
SurfCat: I've been using brave but the wallet thing isn't supported a lot yet. They just released some apps though.
MuscleMario: @MrGorbachev007 I use 'Vimium' on Chrome/Brave/ and FireFox.
litesam: Twitch games
NonTrivial778: yeah we know you use a apple watch
MuscleMario: Its amazing as fuck
sirvapealots: @georgehotz what do you think of Pale Moon?
MuscleMario: @georgehotz check out Vimium extension, please.
mutrx: race chat on typeracer
euranymous: @georgehotz What do you think of LIBRA?
Mendacii_: Use piehole
nautzz: since samsung is also involved in servo maybe samsung would be one big donor to mozilla?
sirvapealots: @georgehotz LUL it's based on firefox
Mendacii_: Bye bye adds
shrewduser: konqueror
litesam: Is any of you guys watching silicon valley series?
SurfCat: True, but I like the idea of avoiding ads but paying where you see value.
MrTriharder: @mutrx cmonBruh what
NonTrivial778: I use Firefox everyday, it works better on my computer than Chrome
dysoco: that's Ungoogled Chromium
mutrx: that's chromium?
NonTrivial778: Chromium
MuscleMario: Check out Vimium !
CEnnis91: chromium is still quite google
dysoco: oh lmao you had that opened
sirvapealots: @georgehotz make your own browser based on chromium, and gain fame through twitch chat LUL
3even: georgium
sirvapealots: @georgehotz Twitch chat would spread it like fire
sirvapealots: @3even yessss LUL
Annex_Greenland: google deserves to be paid for their work tho
Santiago_LHC: I like the MIN browser, it's sexy: https://minbrowser.github.io/min/
shieeeeeeeeet: @georgehotz have you ever tried firefox tree style tabs?
sirvapealots: @Santiago_LHC what is this based on?
12btw_: the gender department in google will stop innovation the next years by accident at google chrome R&amp;D Kappa
litesam: @sirvapealots Man that is a good idea
SurfCat: The only reason I still have chrom is for debugging and io stuff LUL
MrTriharder: @georgehotz write your own browser SwiftRage twitchrome
dysoco: You already pay Google with your data and stuff
euranymous: What browser does Snowden use?
shrewduser: just use edge my dude
litesam: But no Safari
MuscleMario: PurpleStar V I M I U M PurpleStar
NonTrivial778: Apple is garbage
dysoco: yeah I don't mind it so much either
sirvapealots: @litesam if you're not capitalizing on twitch chat as a streamer, you shouldn't be a streamer LUL that's my take
3even: manipulation
Santiago_LHC: @sirleeroyjenkins an older version of chromium
yBw1: What about Opera xD, built in whatsapp
sirvapealots: @yBw1 oPeRa
shrewduser: you want edge
shrewduser: vimium is just vim keys in the browser
ChocolaateRain: who isnt using big data
MuscleMario: Never take urkeys off the browser
yBw1: ThE RuSsIaNs
MuscleMario: it works~
euranymous: I'd have a hard time quitting vimium
SurfCat: What do you think about YT where you go for a clip on jogging and in 5 minutes you are on worlds biggest marathon stuff. so extreme.
dysoco: I don't even use Vim but I use Vimium it's so useful
MuscleMario: off ur Keyb04rD*
JohnEGQ: edge is base on chrome now
condoram: How do you guys find the energy to do programming as your job and then come home to do more stuff like HTB, coding, etc? I personally feel exhausted mentally after 8 hours at the office.
nautzz: hahaha
mutrx: haha
sirvapealots: @georgehotz Did you know edge is based on Chromium?
ProfessorMagikarp0: geohot merch Pog
oMythra: Microsoft &lt;3 Linux now
3even: unbubble
mutrx: rip google
sirvapealots: @georgehotz give us georgebrowser first :)
Abnico: apple is also using models of you george, the data is just processed on device before being uploaded into a subgroup with 20 other people
nautzz: ban people for talking about keyboards, unban them if they buy a geohot™ keyboard
bobby3605: incognito mode   vpn
MrTriharder: Geohot bath water Kappa
SurfCat: But how do you find the good stuff then it's kind of good and bad
Abnico: apple just uses the data to make new products they sell, not ads
sirvapealots: @georgehotz SaaS is garbage :) change my mind
Abnico: apple getting into content says a lot
yohjiman: @condoram i agree lol, as much as i enjoy programming and development i need a work life balance
sirvapealots: @Abnico No, lol they just want money LUL
DarkEpopt: The youtube algorithm was great when it was based more on the current video and less on your history
chexmixz: IF microsoft is making a comeback why arent you on Mixer LUL
MuscleMario: I like the old school recommendation engines that arent censoring things ....
SurfCat: "good" can mean a lot of things ofc.
MuscleMario: thats yfacebook is dead
MrTriharder: Apple went from “our aim is a computer in every home” to “gimme those fuckin bills” LUL
euranymous: Netflix's engine is like mr poopy butthole
Mendacii_: @georgehotz it’s about making the world a better place Kappa
NonTrivial778: but it's free
ChocolaateRain: oh god LULW
MuscleMario: PogChamp
SurfCat: microsoft platform LUL
condoram: My problem is, when I get home I really want to do stuff like HTB and programming on a side project but I just feel so mentally exhausted . I am just amazed by other people who are able to put the time into side projects for fun.
mutrx: LUL
litesam: What do you think about Jack saying "I use duckduckgo and it is better"? Will you ever use DuckDuckgo?
sirvapealots: @georgehotz what about coffetime owned by FOX LUL
yohjiman: what are some of your favorite movies
oMythra: need that Ninja contract first
Annex_Greenland: netflix should get into streaming
MrTriharder: Mixer WutFace
condoram: I am a programmer, currently web dev
litesam: Use duckduckgo
mutrx: looked like porn for a sec
Abnico: they make content for attention, but look at apples privacy ads.
3ygun: Yes Microsoft owns Mixer
MuscleMario: BitChute has non-censored things lol
MuscleMario: China #1
euranymous: stream on pornhub, no copy strikes and no bull shit
AveAyWolleyMate: LUL
nautzz: alex jones is WOOOOKE
sirvapealots: @georgehotz Serious question: What do you think of the subreddit of r/WPD?
sirvapealots: @nautzz Gay frogs Kappa
MuscleMario: the frogz
MuscleMario: OSFrog
death_gadget: They're turning the fucking frogs gay!!
MrTriharder: @georgehotz what’s the difference between bitchute and YouTube
woogio: BONE BROTH
MuscleMario: Chemtrailz, i seen em
nautzz: yeah unfortunately there are those ppl lmao
DarkEpopt: infowars has a twich channel i think
euranymous: stream on pornhub, no copy strikes and no bull shit
sirvapealots: @georgehotz how does gab even work LUL
MuscleMario: f
Xingjuice: I remember when pornhub was considering making a youtube competitor
litesam: WebTorrent
Abnico: alex jones is quality content,
sirvapealots: @litesam Weeb_Torrent LUL
jisaku: wasn't gab their own proprietary thing and then they switched to mastodan
12btw_: you need a directory for all
12btw_: streams
MuscleMario: U ever seen PornHub go down?
MuscleMario: I haven't.
coppuh: my limited experience with mastodon makes me skeptical of peertube
lemonboxed: you can post deepfakes on pornhub, you can't advertise it as one
lemonboxed: my friend told me
Santiago_LHC: Except INSTAGRAM
condoram: Thing is though, you are not on porn hub as often as youtube, so it could be they go down
mutrx: only INSTAGRAM, FOLLOW At...
3ygun: Isn't pornhub the YouTube competitor?
litesam: Anyone following AdventOfCode? If do are you guys streaming?
euranymous: give him a tick mark already
Abnico: social media is AAA manipulation
mutrx: Youtube doesn't compete with pornhub
jisaku: remember when jimbo said he was going to save the web my making a search engine
condoram: You would think with some of the content on youtube that it might be trying to compete with it
MuscleMario: My fiance is taking me away from you Geo, I will forever keep you in my heart. /yeet DrinkPurple
MrTriharder: @georgehotz have you thought of a decentralized payment application?
MuscleMario: GN guize
litesam: Guys anyone streaming AdventOfCode, that you know of is better?
condoram: o/
mutrx: s/
12btw_: problematic HotPokket
euranymous: commacoin
hokagemichael: make a fork of Alex Jones lol. gay zebras.
SKPTCL: :/
EatUrCarrots: :/
mutrx: :/
euranymous: piepernet
Grettzz: :/
SKPTCL: bye george, keep fighting the good fight mate
ProDucks: :(
crazycatz59: :/
euranymous: pied piper
3ygun: krippCash
mutrx: good luck with the autism m8, you'll get through it
NonTrivial778: WutFace WutFace
MrTriharder: @georgehotz watch Silicon Valley season 6?
Xingjuice: gn dude
oMythra: good night guys
treestompztv: Bye :)
MuscleMario: Turns the Code Gay
Mendacii_: TheIlluminati
Xingjuice: night dudes
condoram: Good night lads
yBw1: thanks geo
SurfCat: :( was going to ask about the meta category theory yo uwere talkign about.
BigBrainDota: is he manipulating us right now?
lemonboxed: years of dedication
EatUrCarrots: night dude
euranymous: @georgehotz Thanks for the kind words
mutrx: n00b
unluckychickenn: tmaHerz
SurfCat: G'night
3ygun: Will we ever be as good as you?
covac123: good night guys &lt;3
Abnico: happy birthdrgeay geo
earthbender: cya
fluzfluz: good night boss
nautzz: good night ArigatoNas
voxelfox0125: bye
you know what you guys think I do that
on purpose I was I was
explicitly saying that I don't do that
on purpose uh yeah no I went to uh I
went to
Taiwan um and unlike India uh I mean
look I had a time in India say it was a
bad time I'm just going to say it was a
time um in Taiwan mostly I had a good
time um Taiwan is a lovely
country uh you know
really I think I think a way to describe
it is just it's such a functional Place
uh there there is very little like if if
you just want to
chill um continue without sound please
you know
you you know you know I just
just oh welcome welcome hypee train oh
you got a math quiz today all right
that's good George is back I never went
anywhere I did go to Taiwan though and
Taiwan was pretty cool um you know also
uh very free very free country uh you
can tell just a lot of things about it I
think in some ways it's more of a free
country than America is um they have
their usual you
know a few things about it really felt
more for even America uh one is that
they use cash
I was going to go to China um one of the
reasons I didn't go was that I heard
that it's very hard to pay with cash now
and like my WeChat account is blocked or
some shit I I I don't even know I don't
even know what I did right I'm I'm
really not trying to hate on China I
look I love China too um but I'm saying
Taiwan felt very free uh which was cool
uh you pay for everything you pay in
cash um a good metric of how free a
country is is how easy it is to check
into a hotel
um so you know you can on on one hand
you have places like Iceland where you
show up and say hi my name is George oh
George here's your key uh do you need my
last name no it's a small island if you
fuck with us we'll come find you and
we're Vikings um so Iceland's very free
um but yeah Taiwan things were very easy
as
well uh you can you can go to 7-Eleven
in Taiwan and uh you can you can buy two
beers and you can sit there and drink
the beers
uh so you know that's just that's just
very chill and it shows a country that
really uh you know kind of has a lot of
trust in their people I didn't see many
uh I saw like the same level of CCTV
cameras you see here and go to some
countries now and they're covered in
CCTV
cameras
um yeah so you know and also uh totally
free internet um there's like a website
that ranks the uh the freedom of theart
of the internet and Taiwan was very
highly ranked and you know you just like
you go to South Korea they block porn
you know go to Pornhub in South Korea
it's like uh for your for your
protection the paternalistic authority
of Korea has said no porn for you
[Music]
um is it China or not
look that's that's a I'm not here to
make semantic things uh I'm just going
to say you don't need a visa to go and
you do need a visa to go to China um I
don't I don't know and also this might
just be I'll tell this
story um you know a bunch of people in
Taiwan were like you know China it's
really hard to to pay for things as a
foreigner you're only going to be able
to buy things in the train station and
I'm like really because it used to be
all cash I've heard now it's it's just a
hardcore WeChat uh for everything this
may be wrong though and I'll give an
example of why I think it may be wrong
um again this is from people in Taiwan
that I heard this uh so there's a city
in Malaysia called jeor baru and the
city is right across the border from
Singapore and if you go online and you
read form posts about Joor baru uh it's
looks terrible looks like a terrible
place you're going to step foot in there
you're going to get murdered robbed
raped everything terrible is going to
happen to you in Joor
baru and then you try to find some
objective statistics on Joor
breu and I'm
quiet
um it turns out that I can turn this up
a little
bit uh it turns out that jeor Buu is not
really dangerous it turns out that this
is just singaporeans talking um and
singaporeans uh have a very low
threshold for for for danger um so yeah
I went to jeor Buu and it was it was
more than fine and I was expecting like
the Tijana of Malaysia um it was not
uh there will be a time when humans
completely have whore porn I don't know
about you
bro um I know you know put I'm not you
don't have to watch it points of choice
but you know it's it's
hey uh what's the story
from I forgot where I heard the story
but a guy gets into a cab in in Egypt uh
and he's sharing the cab with somebody
else and the other guy is uh is uh
smoking a smoking
hashish uh and he you know starts
talking about how uh you know he
supports Muslim
Brotherhood and um yeah I think it was
like a New York Times Reporter got to
the cab and he said hey you know if
those guys win you're not going to be
able to to do that anymore he's like
yeah I want to stop and I need the
government to stop me so I mean maybe
that's how some people feel about porn
and for you there's authoritarian
repressive
governments
um no I mean
look
Singapore you know you go to some
countries like Iceland and you can also
like people in Iceland would like leave
their phone at the stool at the bar uh
just to
uh they leave their phone just just to
mark their seat you know it's that's
insane to me
uh but you don't really understand how
like Iceland works like this right like
Iceland's a very safe country too up
there with Singapore
but there's nothing in Iceland you can
like learn about how to make a safe
country except for like be small be an
island be ethnically homogeneous and be
rich right like all those things are are
good uh but Singapore is actually a
Incredible howto manual um if you also
would like to not have crime in your
country you can just look at what
Singapore did copy it it's very
effective and I actually think the
tradeoffs are way less bad than than
people think and I'll give you an
example um when I saw a uh I walked by
an apartment building and there was a
poster outside and the poster had two
people's pictures on it and said these
people live here and are known for
shoplifting I like it right like I mean
imagine we did this in America
um Singapore is hella
authoritarian
yes they are but I
mean yeah you
know you can talk about you can talk
about
[Music]
the repressive nature of of of Singapore
of China and of India right
um
and they all have different things that
are kind of oppressive and I would
probably you know want to like if I
really had
to uh choose countries to live in it
would be in that order
right
um you know I haven't been to China
since co uh and I hope that a lot of
what I've been hearing is just like
fearmongering and stuff because I spent
a lot of time in China I lived there for
about a year when I was younger
and um you know when I was there it was
a very free country uh the early 2010s
China were was maybe the most capitalist
country like ever to
exist um the picture stuff would never
work in a Shameless country like
Brazil yeah but you know you could
do Brazil's a harder one to
fix
um no I don't know you know
I when even my mother says it's time to
crack down on crime we got to do
something about the crime in America
man you know it's not that hard to fix
we just got to do
it oh South Africa whoa whoa yeah okay
um these are by the way two countries I
won't go to uh I will
not I definitely won't go to South
Africa Brazil if I'm with the right
people going to the right places maybe
uh but both of those countries have
extremely high murder
rates um if I'm with the right people
going to the right places I'd go to
Brazil uh you know if like someone's
family there you know someone who knows
the area but I wouldn't just set foot in
Brazil um try Mongolia I've been to
Mongolia I I don't know what you want me
to say it's a frozen desert for some
reason I pictured Lush snowy forests not
like frozen sand
desert um but that's what Mongolia is
also somewhat polluted unfortunately um
because the people like burn stoves and
their
G I'm not no South Africa fuck no bro
um yeah I mean look anyone who's honest
understands what happened in South
Africa
right uh I know what we should do oh God
I said I wasn't going to be
controversial oh haven't done any code
yet we just I was coding all morning and
then I come on stream and you know I
just you know I wanted to talk to you
guys catch you up I haven't seen you in
a while
um TR Mongolia and summer I'm trying to
think of when I actually went I think it
was kind of
Summer like August I
think
um oh oh my new my new chair I did I got
a new chair uh no I just spray painting
my old chair black what do you
think yeah they can't even Prov provide
electricity yeah yeah well look I mean
what happened in South Africa happened
in Zimbabwe 10 years earlier right like
it's
it's but um I know what we should do we
should give more grants backed by free
money government to minority owned
businesses that is exactly what will
turn around our declining Empire we have
an empire in Decline we're going to give
grants to minority owned and women-owned
businesses and then that's going to fix
our Empire right right isn't that what's
going to don't you guys want to fix the
Empire isn't that the
idea oh oh oh you you you don't want to
fix the Empire oh that that's that's and
you're in charge and you
want oh oh I understand now okay okay I
understand look we just have different
goals here that that that's
cool um that's right that's right we we
we must we must give uh you know free
money to to to uh you know women of
minorities right it's going to fix it
right I no I know it's not not it's not
your goal to fix it oh yeah can we uh
can we get someone who who who wants to
fix it can we can we get someone who
wants to fix it and put them in charge I
think maybe we all kind of want to fix
it
um
okay I'll engage with this for a minute
you should subscribe I just want to
dismantle our late stage capitalist
Society by any means necessary is that
so
bad well
have you have you thought about what you
might want to replace it with
right
have have you have you thought about
what what might happen instead communist
Utopia ah communist Utopia I understand
now fly automated space luxury
communism
21st century man I just want our society
to be a Perpetual crisis but somehow
we uh got off on on a t you guys
oh you know what you know what I'm gonna
I'm gonna go off I'm gonna I'm going to
State my political party preference
right now nobody pisses me off more than
fucking Republicans man you know you
[Laughter]
know
at least the other guys you know what
you're going to get right at least the
other guys are
honest um let's go into coding let's go
into
coding
Elon Musk is a republic Elon Musk is bro
like are you the next Caesar or what we
put too much on the man I don't know you
just can't like the most interesting
thing is what's going to
happen you know can move to Taiwan I
thought I really I was then I was like
kind of bored I was like what am I going
to do here all day you know but I'm just
going to say the Taiwan bike tra and the
the India aborted bike trip
yeah I mean it was cool look it was cool
to see India in Taiwan I ate every piece
of food that I wanted from anywhere
street food bubble tea didn't get
remotely sick uh you know really really
a wonderful country and uh everyone
should go check it out and uh you know
maybe instead of uh instead of giving
our uh our our our war our war chest and
war doll to go fight uh you know that
guy we should uh think about uh you
know Taiwan uh Taiwan did I say Thailand
if I got them mixed up uh Thailand's
overring with overrun with Fang too much
frang
man
um no no it's not it's not like the
Ukraine situation and let me explain why
all
right wait they're at War and it's
up oh I guess if a lot of people leave
okay
okay
bro that's
older
GDP is up all right all right all right
look I don't know what happens uh Mario
Bing thank you thank you for for gifting
uh
Subs you know what the problem is with
politics you can't make everyone happy
happy
unless who doesn't like progressives
right I'm a progressive and hopefully
Everyone likes
[Music]
me are you cool yeah you subscribed
that's cool you're not as cool as Mario
Vin who gifted 10 subs and can ask a
question nobody likes progressives ah H
should I be a conservative do people
like definitely nobody likes
conservatives is is that sarcasm no I'm
I'm very serious I have very strong
political opinions that I hold very
strongly and I care about causes and
issues you guys know about my
deep-seated care for causes and issues
like like you know what's a cause does
someone have a
cause fuck you this hell hole is
forgotten by God what country are you
talking
about oh Libertarians
iroll Maran well that's what country
what country do we want to visit next I
I'm thinking uh Next bike trip is going
to be Eastern Europe it's going to be
like uh Poland Estonia Finland I heard
good
things uh yeah Romania around there
Romania is interesting Romania is
interesting um I don't know if they'll
let me into bellus don't I need like a
Russian visa for
that um my Andrew tayar when I mov to
Romania become a pimp and get arrested
for sex trafficking sorry I I didn't
mean to slander him if he's not a pimp I
I don't I don't know how Andrew Tate
refers to
himself
um
wellit I didn't call the Balkans a shit
hole I I think
they're mostly uh I've been to Serbia
been to
Hungary like I've been to countries that
are shit holes uh and uh those countries
are I mean I avoid like the real like
there there's some countries that are
like like again there's countries that
are too high crime or just like if you
have a country that has less than a ,000
GDP per
capita like
oh my god
um the worst part about Europe is South
Italy I I would say that I did not uh
Milan was acceptable the rest of Italy
Florence they wouldn't let me into the
library the library was only for
Citizens and then I realized why because
this country's covered in tourists it's
hot and humid and why the fuck am I here
um Italy and Portugal
yeah
um in Germany and the lights were dim
and it didn't feel like they had a lot
of power there but overall I like
Germany um am I talking about Brazil
I've never been to
Brazil uh wow we're really we're really
off
topic um I should go to some of that
we're going to Joy this communist
UT hey you know where's communist and
cool Vietnam I don't think they're
really communist but they say it's
actually I think it's the Socialist
Republic of Vietnam set on my
passport I have never been to Africa
Maran thank you for gifting more subs
but yeah I think I think we're going to
do uh we're going to do an Eastern
Europe trip next abstraction. is up to
date with the whole lazy buffer changes
and thank you for bringing things back
neural FPS thank you for gifting
Subs Brazil is about 7K GDP per capita I
mean that's not too poor
um I like Spain I I like Spain I had
issues with Portugal
um
what's the simple irrelevant question
we're we're we're pretty far off
topic
um oh you've guys have heard my Portugal
rant before we we don't need to we don't
need to get into Portugal R rud rude AF
we don't need to get into Portugal I
just just multiple things I was just
like
yesh
yeah the numers said Milan was safe but
I didn't feel safe everywhere I walked
there um how will the shipping be
handled for non US citizens I don't care
if you're a US
citizen if you if you're an illegal
immigrant I'm happy to sell you a tiny
box um if you'd like it shipped outside
the
US I'm not sure I think that I'm going
to say no but you're welcome to use a
forwarding service comma look I'm
probably just going to use comma to do
all this fulfillment and we can probably
just use comm's
Logistics the numbers say Stockholm is
safe trust me this place is not
safe you sure that's not
propaganda I was in Sweden
recently I mean it depends what you mean
by not
safe um I know the people in swed I know
there's like a there's people in Sweden
who complain about the immigrants I look
I don't live there I don't really know
what the real situation is I know when I
went there I didn't
see it looked way less fucked than
America I'll tell you that I get
attacked by beautiful blonde women
hey
um poor safety policies in Sweden
man
yeah I I felt very safe in Sweden uh I
felt very safe in Denmark I like
Denmark um yeah I like I like the Nordic
countries I do uh I liked Iceland a
lot I heard also like Sweden did some
like really Bas stuff with the media
like told the media that that if they
were going to like sew Discord then they
don't get money anymore or something I I
I heard something on a podcast once
about this and I I thought oh I forget
exactly how they did it but I was like
that's
smart bad people went
there um I've been to
Dubai uh Dubai blocks porn that's just
factual
[Music]
um look I I you know I I I I said when I
was there like look I have again I have
a lot of respect for this culture and
what it managed to build right like you
look at like the the the bur Khalifa how
could I not respect uh a culture that's
capable of building that
right like you know America two billion
dollars to build like a mile of Subway
Dubai uses Bangladeshi you know uh work
Resa labor and gets things done right
and I actually respect that I I respect
that I certainly don't have a problem
with
it um the poop trucks wasn't that fake
duai was very clean and
nice the culture
slaves you know honestly I see things
like that I think it's just people
jealous that they don't have a big
building
you only got a big building cuz you have
slaves they have a big building okay
um I don't think they're slaves I I
think
that I've looked into this a bit and I
have my opinions on it
um uh you guys know my take on oh wow
we're at the Jews now we're really this
has really got to stop you know my take
there's a great take on the Jews it's
like Jews are an easy scapegoat because
you'll find them at the top of like
every political movement cuz they're
smart right like to believe that there
is one Jewish agenda right
like if anything as far as a as a as a
group goes the amount of diversity
within
Jews um is uh you know you'll find Jews
everywhere
politically um
but they built a big building you don't
understand where's America's big
building
okay
we had two big buildings funny
bro uh yeah I mean really Peak America
was 2000
America neom city is it the one that's
the
line uh so you're more or less confused
about the direction tiny grad's going no
A lot's figured out I'm put in this
schedule API that I really like and I am
going to demo it I promise we are going
to code today
uh Trump didn't build a wall okay like
that's that's I loved the wall I thought
the wall was an incredible
project uh I just thought that
everything about the wall was just like
we're going to like America we're going
to put America back to work we're going
to we're going to get people out there
laying down bricks I just think about
like the story I tell myself is like you
know you you you have a family who like
you know their parent the drug addicts
and they life's bad they're unemployed
and then they move to the border and
start building the wall they get clean
they put Becky in school like the wall
could have turned people's lives around
but no we didn't get a wall and like we
were really where America is incapable
of building a
wall
really really we can't build a
wall what is outside the
walls
uh people eating random street food in
your country you're talking about India
yeah
yeah we were so careful and I still got
a bit
sick
um
no unable America couldn't build a
wall America's debt is increasing a
million dollars per minute that sounds
about right no like when you look at the
national debt you realize that like how
many how many tens of thousands of
dollars does every citizen have to pay
to pay it
back
no we simply don't know how to build no
the Vegas fear is an advertisement we
could have made the wall an
ad um pay it back well you yeah I mean
it could go bust man just hyperinflate
the dead away yeah you understand
everyone pays it back then
right no I have been a little okay all
right all right we're going to two more
minutes on
this I've been a little sad about
like I live in a declining Empire
right like you have the Dutch the
British there's a video about this Ray
Doo's video and then you have America
and then you have China right and like I
live in a declining Empire I can't move
to the new Empire uh because
unfortunately and I don't mean this in
like a derogatory way but they are
racist right like that Empire is not for
me um I don't think it's a good policy
you know my thoughts on racism I think
racism is a dumb
policy uh I think that you know what you
want is something a lot more like
iism
um oh India is definitely not the new
Empire I promise you it's
not
uh what's wrong with America I mean it's
just declining the Chinese Century
yeah when debate number two oh my Doomer
debates guys the doomers are right you
know I mean they're sort of right and
they're sort of wrong
like everything I said in the debates I
I agree with
um but like as far as the obsolesence of
humanity when you have super intelligent
AI like no fucking shit of
course uh okay you think more of an
India sentury than a China One I don't
know if you're saying that to trigger me
have you been to
India China is asshole
hey man I'm sorry but they make if their
empire is bigger than yours do you know
how we don't make any movies for Kenya
like Hollywood doesn't make any movies
for Kenya they don't take Kenya's
opinion uh into consideration and it's
because Kenya's poor but if China has
more spending power than America guess
who the movies are going to be made for
not for you doesn't matter if it's an
American company right we're globalists
we're a globalist Empire right China's a
nationalist
Empire
um I mean
different no more I saw a Bollywood
movie it was pretty good actually I you
know it is what it is
but um the new 7 animator chip
technology like I don't know why people
are saying it's fake like it's real but
the Asian just watch asianometry they
have good stuff about
this
Ireland Ireland I love Ireland man
talking about countries in Europe I love
I had a wonderful time
there
um having been to
India like look they may be next but not
soon if you don't hear the Portugal rant
you're leaving wow we have 636 people
watching
this wait avoid it like the plague it's
a propped up GDP whore tax Haven for
Mega corporates I mean yeah it's a tax
Haven but like it's a nice country I led
iseland what are you trying to tell me
he's
bad what are the countries I love in
Europe I mean look
Ireland UK but mostly the north um like
the whole like the Newcastle area I
think is cool
uh the Netherlands nice
place uh I mean those are my favorite
countries in Europe like there's some
that are tolerable like Germany and
France except not
Paris um and Spain's okay and then like
at the bottom you have like Portugal and
Italy right um what countries do I like
in the Middle East I've only been to
Dubai uh I've only been to Dubai it was
cool I went there it was
Ramadan and
uh all his stuff was open late food was
great the hotel was cheap it's a nice
place you know there were many things
that were actually extremely libertarian
about
India um
chill man it's a Friday
Vibe uh all right let's
code subscriber
only Argentina is the next Venezuela no
actually didn't there GDP like Peak
we're done with countries
okay
so uh this is already in time grad
uh this is running resident
so you can see that it's taking 439
milliseconds to run a batch 64 resonet
50 um that's like the wall clock
time and and we're only getting one Tera
flop so this has an 11 Tera flop GPU we
should be able to get a lot more
so let's make a new file here hand
coded
resonet
um let's take a look at model EV val.
P so this is resonant 50
here
let's just take a quick look at the size
of this
tensor
um okay so now we should be able to do
model X okay but
actually
uh so this shouldn't actually run
anything because that's all because
again tiny Bread's lazy so this should
be really
fast okay see it's pretty fast if I run
it with debug equals 2 you can see no
kernels actually run okay so this is the
new API we can get the tensor
underlying we should say that this
returns a tensor
what now we see the lazy data turns that
color uh and this this is the new API
called schedule and we can get a
schedule here and we can look through
the schedule and we can do something
like that okay so the schedule is the op
the out and the input um so if we do
like op. op we can see
what Okay
cool so these are all the uh kernels in
the reset you can see here that there's
58 of
them um
um so let's filter out all the load
Ops load Ops are just like loading
tensors from
uh load Ops are just like see this like
load op Rand that's just like where the
weights comeing from okay okay
good
um
why are there so many of them oh some of
these just must be model and knit
things
interesting
this one should be shorter
than
let's create a new
tensor Mario thank you for gifting more
subs okay
60 uh that makes a lot more sense okay
cool now if we filter the load Ops out
of there we're going to get
59 okay
beautiful okay so we do have to run the
model
twice I can just put this all in one
line
okay 59 cool um so these are all the
operations uh for the reset these are
the see and this is the power of like
the new tiny grat abstractions I'm
really happy with this
one
um Mario I'm happy to take on topic
questions
uh okay so this binary Ops Max is not
actually this only the last op so you'll
see if I print these Ops they look a lot
bigger um we can go there's a really
cool debugging thing that was
submitted called print tree and we can
do print
tree uh on the
op all right so these are each of the
operations of the uh of the resonant 50
okay so now if we're actually going to
want to run these let's load up Ops
metal
[Music]
here the only linearizer option I guess
it
is
okay so all of these Ops are
linearizable so the linearizer takes in
an op and we'll output code if you want
we don't actually have to go all the way
to code
either
okay so that's the
as that's linearizer
options can say Lin equals that and we
can say lin. linearize and that will
return uops I don't think this actually
returns uops I think it just sets uops
which kind of sucks and should probably
be cleaned up
um
okay so the this is each one of the uh
kernels now linearized into the
linearizer
like I I'm just I'm Blown Away by how
good these abstractions
are they're so simple and they should
have the ability to be really fast like
now it's kind of time to focus on
speed um seems strange that the init
does a lot of ads uh that's actually
those are randoms they they weights are
initialized randomly but the randomness
is is an ad it's just it's just like we
can look at them if you care um but
they're just initialization they don't
really
matter like okay you see what I mean
like here you know I'll just show you
the function we can just it's really
simple I'll just go through it okay so
this is the com you see that the com is
ini initialized with cing uniform this
is caming uniform and you see that
math was actually just tensor do uniform
so that's the math but it's this and
this is that ad right there so it's you
say it's strange the init does a lot of
ads it's actually plus low right there
um but this is all fused into one
thing make
sense Okay so we can also uh get the
renderer from
metal um from Tiny grad
runtime Ops metal import
renderer right and now if we want to
render
this
um what is it
called
this when does that get ined is that an
ended there or do I have to linearize
it cool okay so you see these are all
the display names of the
kernels um this is the new abstractions
this is a great intro to like how the
abstractions are now lifted um out of
tiny Gra and you can use them
externally uh I have another wherever I
set display name display name has colors
function name okay uh so we want to do
renderer SUB lin. function name and then
the
uops um and this should just return
code okay there you go now we have the
code for each one of those
kernels now you're going to notice that
guys show me a library that can do shit
like this you know like TVM can kind of
but I think these are just the cleanest
abstractions anywhere for these neural
network libraries right and you can then
go in and like edit all this and it's
all like
exposed okay um so you'll see that
these I posted a picture like this on
Twitter and people were complaining well
that's not a very optimized kernel look
at that stupid Loop well yeah because
you got to run the optimizations okay so
I can run them by doing Lin hand cuted
optimizations and now you see that the
uh the kernels don't look so nice
anymore um but they are still
kernels okay
uh now we want to actually Benchmark
these so let's put these into the
runtime where's Ops met metal metal
program function name
code uh
Prague we still call it with a global
size and a local size but I think those
things are on the linearizer
now
this actually might bitch me
out yeah this is actually wrong we're
going let's fix this um
there's an Ops I do like a fix of the
sizes
somewhere here these launch Dems
I should put this in the
linearizer
okay so those are the uh those are the
sizes put the fixes for
here that on line that's
fine
whatever uh okay so now we have the
sizes now we can run the
program
uh okay we need
buffers um so in order to make
buffers
uh we can get np. st.
size okay
um
create output buffer out equals out. st.
metal so in Ops metal we have raw metal
buffer
here this is this video is by far the
best intro to Tiny grad
now
um
uh
linearize the op into
uops um render the code and
create
program
uh so here we create the output buffer
let's create input
buffers
okay now if we actually want to run the
program we just pass
in a global size lin. Global size lin.
local
size uh the
Buffs and we'll also say weight equals
true so we can Benchmark it all this is
the
time actually let's run it three
times five
times
cool oh by the way I also want to just
fix that was bothering
me uh that's in
Ops
35 this be 30 six
really Colonels are getting such long
names
now
that also shouldn't be three I should be
a little more careful about that and not
write
three um it's not three it's
length uh s. Ops
dot no there n of those actually three
is
fine three is hand cod in the other
place
I just lost
my okay
cool uh
so no actually let me copy that logic
because it's uh the colors make length
not work
right so it's just
this
we're going to move print tree to
helpers what I do need a closy
bracket there we
go
okay
um
H I'll note that this is actually kind
of
wrong and doesn't accurately reflect du
the caches because in caches these are
uh these are
always guaranteed to be different
buffers so I guess it doesn't matter but
really I should like create them
properly uh but we're not going to do
that because doesn't matter okay
um
okay total is 430 milliseconds is that
about what we were seeing here yeah
about what we're seeing there okay cool
it's a little faster because we're
running the multiple times and that's
making all the cach is hot okay um now
unfortunately some of these kernels suck
now it's hard to tell which one
suck but we can find this
out
uh there's a way to get info do I save
that or do I not save
that yes self.
info
okay so flops time 20 - 9 divided by
time is giga
flops
okay
so the point is
stupid
okay so now we can see each kernel
exactly how many get wow dude how nice
is Tiny gr could let's just admire it
for a
minute like and this is not a contrived
example at all this is a resident 50 I
can also put the whole resident 50
backward path in
this and now it's really easy to see
which ones
suck these ones suck really
badly like this one's sick
Bro it should be pretty repeatable yeah
it's pretty repeatable all
right so this one's
fast wait
how repeatable is it I don't
know 20
times it's going to make it
slow only for the slow
ones okay 10's a good
compromise how do you go back from the
kernels to the code what you want to see
the code you just print the
code
unfortunately the code is complex
bullshit for various
reasons um but okay so I said we were
going to optimize
things and we're going to do just
that this Colonel looks like the worst
Defender oh first off let me show you
what happens if I did dis aable the
optimizations oh this one yeah this
kernel is bad but it's not it doesn't
take much
time like it's it's not a it's not many
Ops this is what happens if you disable
the optimizations entirely and you run
slow
garbage
this is
brutal uh I can also try disabling the
tensor
course so we have a magic environment
variable for that you see now they look
different because they don't have tensor
course and it's about the same time with
and without the tensor
course
[Music]
okay so that's with the tensor course
and you can see that that this pattern
here is the tensor course some of them
get brutally slow because of the tensor
course
uh
for
can I do
this and if that's allowed I just love
python is that actually
allowed damn I love
python
W I can't believe I put that used tensor
crap
everywhere that get
crap okay now let's do some
optimizing
for
okay now we have an
Optimizer let's see if we can do
better
um I love python too like just just like
that you can write that and it works oh
python
okay uh oh
oops doing the same thing
twice 36 is too short
37 37
dicks 37
dicks should we just go to
40 it's kind of offensively
many see how we did just in trying the
tensor course and not trying the tensor
course oh yeah buddy look how much
faster that is and we didn't even try
you know how much more you can do in
hand coded optimizations
see notice how these ones now don't use
the tensor
course wow and it's already so much
faster oh that's so
cool okay you want to figure out why
this one doesn't have any gigaflops we
can look at that
one why not write an Optimizer oh we got
a thinker over here he's thinking it's a
smart idea bro let's do
it
we'll put something back to prin the
total I kind of liked
it this one the best coding we've done
in a while
boys Mad Dog Nation thank you for
gifting Subs
damn
I'm pretty happy with
that it's pretty fast
boys SP
dra
thank you mad dog Nation do you have a
question that's it that's today's stream
it's
morning light
outside assumingly test
pass uh so we went we shaved a lot of
speed now okay okay
okay all right all right all right we're
gonna do we're gonna do we're gonna do
one more we're gonna do one more
[Music]
um we're going to create a quick helper
function called Benchmark
linearizer uh it's going to take in a
linearizer and it's going to return a
Time
thank
you lot of
positivity okay let's Benchmark
linearizer
then
actually okay
cool great still works okay let's figure
out why one sucks so
much okay so this one or I don't know
should we focus on the slowest
one let's focus on the slowest one and
then I'm going to push this file as a
challenge to you guys
why does this one
suck that was aggressive with the
uh
now we can like print the two
choices okay
wow that's even more brutal without the
tensor
course that one doesn't even use tensor
course all right so the top one is
without the tensor cores and the bottom
one is is
with most of them are faster with but
like this one is faster
without those little ones don't
matter okay um do you want to hand look
at colel
one
for
we don't need this function I kind of
don't like the
function
functions uglify your
code we also have stuff that we can just
do generically like create the input
output
buffers
okay now should we hand focus on one of
these all right you want to look at this
one and see why it's slow let's look at
that one and see why it's slow so if I
not equal to one uh
continue that
there
okay let's focus on why this one
sucks okay that managed to be
worse let's PR the cup
doesn't even use the tensor course it
doesn't
matter
okay 45 56
33 and we're splitting 56 into s and 8
and we're splitting that there
um yeah I think this is probably a smart
way to do it okay so this one's bad
[Music]
so
let's let's also first off just say if I
equals 1 we'll do this
here try with and
without
we can also put linear eyes down
here okay um so these handc
optimizations we can actually do them by
hand right if we want
um so we have one input buffer uh let's
look at the buffer
Ops so we want to do op
dot get lazy
Ops for x and get lazy Ops if x.
op buer
Ops Okay
so
Ops X forx who uses
filter so show you what these buffer Ops
look
like none no that's not
right oh no I fix that oh and buffer Ops
what am I
doing
okay okay so this is the input
here it's a multi view shape tracker
well that's
disgusting let's start with that being a
problem
so this is the shape tracker this
defines the uh this defines the
shape uh
sorry
um this defines the shape now it's a
multi view shape tracker which
sucks
for
well because look at all this complex
stuff here that it's generating I mean
it's not that
complex and okay let's
first
um let's first
replicate okay actually I didn't have to
do this with that that was stupid I I
could just it's much easier for me to
just say
lin. uh
STS yeah why did I get the buffer UPS we
definitely don't need the buff UPS so
linearizer will do this for
us
uh process should just be removed
process is
stupid okay so this is showing me the
two oh get rid of debug equals
3 this is showing me the two shape
trackers so you see the output shape
tracker is always contiguous and then
you have the input shape
tracker uh which is not always
contiguous let's also display Lin
do uh
I'm just going to copy this out of Ops
so display the global size
and this is
terrible okay so this is showing me the
global size and local size um you can
see now the global size is
uh well there's no local size which
is going to cause you
problems
um you also like this has a complicated
looking mask this is probably why it's
really
slow okay first off you want to
replicate the hand let's replicate the
hand coded optimizations first okay so
what is the hand coded optimization
doing um
it's reshaping
it well I don't even know what it's
permuting so it's definitely upcasting
the final two Dimensions so I can just
show you what that looks like um we can
go in and you see how now these are 3
three those are nested Loops so I can
say something like lin. upcast
I just want to do it twice well I can
show you what it looks like
once if I if I do it once one of the
loops is
unrolled um if I do it twice both Loops
are unrolled but I actually think that
gets me nothing because that's probably
automatically being done by the
optimizer now we can go even further we
can unroll another loop you want to
unroll another
loop oh it sucks even more okay
cool
um so those are upcast
dimensions
now let's do a before we do that
actually we'll do a lin.
reshape and
permute uh new shaped function's kind of
stupid
actually but I guess I have to do
it so these are like doing the
optimizations by
hand see
like you know what it'll probably help
if I just start by reshaping it to the
real
size um so there's only two reduced
dimensions and it's though it's the last
two so I can say like x - 2
colon
um well I show you that that does
nothing uh we can actually say the
access for
muting yeah this this optimization
stuff's not well thought through and
once we think it through better we're
going to start to get some real speed
but finally we have the infrastructure
like I'm so happy with this
infrastructure I'm so happy that like
you can write this and hopefully this is
all like super understandable to you
right and you see what we're messing
with here we're messing with like
upcasting Loops right so like what I can
do here is upcast a
loop um and you can see that it's an
unrolled Loop right like look at the
difference between this and this we
unrolled that in Loop there and that's
why this is purple not
red wow wow this is even like somewhat
accessible that's so
cool okay
[Music]
um let's
try like I can't really reshape it to
that is it just permuted to
shit it is permuted to
shit
there's not any like weird divisions or
anything so I guess it's
fine okay so let's reshape it to
something like
4096 well okay let's just hand code them
5656 plus that does
nothing keep two up
casts does up
casts let's split this out to what's the
warp size on Mac let's put a 32
there now this isn't going to be good
yet because it had to combine things but
now we can take this 32 and we can
permute it and say one 0 one two three
four five right and now that one's going
to be at the end there
um oh let me just also add the
Baseline we'll get there what was the
Baseline
again the Baseline is 89 gig flops so if
we can beat 89 gig flops we are as they
say winning
son um
okay so it seems like what this thing
did in practice was take took seven for
me it took eight from each of those
okay so let's go
78 this one actually only took two we'll
say 56 / 8 56 / 8 I think I have some
helper functions to make this stuff
easier
um
this one we want 0 2 4
135 and then 7 I no
67 okay now this matches but those have
to be local Dimensions so I say Lin
do local no it's not local dims I forget
how to do
this oh it is local di never mind okay
three
locals okay good all right
111 uh
okay now let's make it
faster so I think my first thing to try
is to make this two bigger let's try
making that
eight hey it's faster look at
that let's go to 16 or something
uh we'll call Little Chomp
eight this little Chomp
here
63 that's
worse
all right that's their values for big
Chomp and wall
Chomp that's going to match hand coded
optimizations like you see what I'm
looking at right I'm looking at this
thing down
here so that's a same as
[Music]
that okay let's try something like
this
who thinks we need an Optimizer like a
real Optimizer so I do have
one we did build an automatic Optimizer
but kind of sucks and it doesn't work in
this
workflow I'm surprised I can't hit
anything better doing this by
hand
by the way we can always say debug
equals 5 and we can look at the
disassembly of the
Shader F comp cells a lot of
those
it's doing automatic sub expression
elimination oh is FS sell how it does a
Max is there an F
max if it's
this so we can just like the beautiful
thing is look we can just change this
like right here like should it be fmax
maybe it should be
fmax same F comp cell
garbage wow but that's what it's using
does that makes sense s okay that I mean
that's just the op for a Max F comp
cell yeah I run it 10 times I don't
think they differ
much
okay that's the best we've been able to
do
we don't have any weird
divides probably doing pretty good
common sub ex expression
[Music]
elimination
try
this man I had hope for that
one
H not coalescing those rights it should
be see it's not doing that as a as a
store four that should be a store
four none of the reads are are grouped
either
okay 86 I mean that's kind of
good so now they're
grouped
why I was on grouping him
before
okay maybe I just picked a particularly
shitty Kel to try to
optimize
you see that we also have gated loads
here I'm surprised further upcasting
didn't
help
and also why does this not
coales why did that not group they're
clearly in
order and there's eight of
them see look we have bugs we're finding
bugs I don't know if it would be better
but what is this
kernel why does it even exist there's a
Max
pool it is a Max
pool how is this slow this should be
fast oh we have another thing we can try
too we can try also just permuting
dimensions
okay let's go back to what we
had uh three offcast two loal dims big
Chomp two little Chomp eight okay so we
can try something like
this so we want to put
like
ah 108 G flops look it's
faster okay now what we did was we put
this Dimension
first actually I have a theory that if
we do the same thing with the locals
we're going to get the same gain in
performance see someone should make like
a cool interactive game out of this you
know there's like really cool visual
ways to represent all of this okay we're
getting 86 G flops but now let's try
increasing and decreasing
that
36 Lane
90 it's pretty
good why is oh that's okay that's clear
why it's not coloring CU those aren't an
order
uh you want to print that out with debug
equals 2
piku all right 8 * 8 *
[Music]
64 512 so we should be able to set big
Chomp to 16 I think
no okay well I mean it would suck but we
might have to start thinking and that's
the worst thing I hate when you have to
think I'm just say permuting the locals
didn't
help I you think it made it marginally
worse 86 this looks the
same here's an interesting fact
it's doing an awful lot of
math it's just
identical yeah I would have really
thought that like upcasting more would
help
okay let's try
this we can try just like upcasting a
little
bit could take like four out of each of
those seven sucks because you can't
really divide
it
um okay let's try something very
different let's add a four
here
then what we want to do
is
okay this becomes
five
six we'll put seven here but we'll also
put four
here now we're going to do four upcast
and three
locals
um
that that didn't
help
okay at least doing that let's take a
look at the kernel and see if it doesn't
have okay look I like that it's doing
these um I don't know what these these
are all the ads for the end thing
because for some reason it didn't fuse
the stores this it's doing a lot less
than them when it
has
that okay let's just increase big chop
maybe this will
work come
[Music]
on nothing
faster all right we're going to have to
start getting into like analysis and
thinking
and you want to get more okay you know
what what am I doing boys what am I
doing did I build an Optimizer or did I
build an
Optimizer we built an
optimizer
why am I doing stuff by hand doing stuff
by hand is for plebs we have
computers
why would we do anything by hand hand
when we have
computers oh come
on rid of this fancy
stuff my want it back we actually made
some good progress
there oh I forgot we could also Chomp
the uh okay so this is 0 to4 this is
135 and then this
is
67 we do two upcast and three local
Dems does upcast just what does upcast
actually do
just increases
upcast okay good at least we're not
doing any pleed shit by hand
anymore
oh good we already found a faster one
man there's two things that are amazing
one of them is search and the other one
is optimization fuck yeah
boys we found a fast
one8 okay that's kind of what we had
before wait that's exactly what we had
before we already hit the
optimal it was
terrible
wait
130 Is that
real or are we just getting oh okay it
seems pretty
reliable interesting okay so we do one
less
upcast okay not doing the upcast is
actually
faster that's a good good
lesson big Chomp and little Chomp we
already
right be the
optimizer okay so it's faster to not do
the upcast that's
interesting and let the compiler take
care of
it maybe we want no big
Chomp no big Chomp is faster stop doing
big Chomp
I I'm kind of out of ideas what else
divides seven else divides
56 do any other numbers divide
[Music]
no I mean
h
14 suck okay and now we're up to
139 that's pretty
good
okay well now we know the magic
values turns out it was eight
one and uh
zero
good through careful work we discovered
oh okay I have I do have one more
Theory wait why does it suck
now oh no because it wasn't 810 it was
little Chomp
one big CH
one
doesn't look as good as it used to be
I'm only getting
okay I have one more
Theory the number of operations is the
same with all of them yeah
uh okay we're not going to waste time
anymore with big Chomp because you know
big Chomp sucks but if we do little
Chomp we bring back the divide by
four and we do it in a different
order have one more
Theory
so here we want to do
01 skip 2 3
skip okay now we put in these two so we
put in
two and
uh
five now we put in the last two 1 two 0
1 2 3 four five six
78 now we put in three and
six let's see if that even
runs
I forgot let me start a
pen okay it gives us a pathetic 9 Giga
flops but now let's do lin. upcast plus
equal
2 and see what that looks
like all right now lin.
locals
37 not much Giga
flops
[Music]
19 Giga flops oh and the fusion broke I
see why the fusion broke oh that's just
dumb
oh should be four
maybe
that konel looks fast it just
isn't seems like a fine thing to have as
a GL
dimension
[Music]
it's pretty good I don't know pretty
happy with
that that's the one it
finds look at how repeatedly it finds
that konel which is
cool it's always that one
uh actually we should
do okay still finds that one
need
that this turned out to suck this turned
out to
[Music]
suck okay
so we have a kind of debug Library here
you can just call it debug right so now
if we run it with debug equals one see
prints the kernels and if we run it
without
debug just takes a little bit and get
you that kernel okay let's reenable all
the
kernels
see we got that beautiful 139
there okay so we saved
milliseconds why' we focus on that colel
that Colonel wasn't the problem this
kernel is the problem why didn't we
focus on that
Kel
look at how complex this shit gets wow
hand coded optimizations is really
good
now if you run it with D Bar equals 2
you'll see it prints the op
tree
okay so we have an automatic
Optimizer um but unfortunately it kind
of sucks and it's written like in an old
way and was like hooked in badly but now
we can start hooking these things in
well and we can start actually focusing
on building a good
Optimizer uh okay it is morning and uh I
got things to
do
um
let's first model run to init the
weights they are save in
scene these are
of okay
good
[Music]
um
I don't need
that
how repeatedly that gets 18
Z great we saved 0. one of a
millet
we should have focused on this kernel
this colel could have saved us real time
but no we focused on this kernel but we
did make it about 10% faster carefully
by doing Chomps but what's important is
that we all learned because knowledge is
power and if you have knowledge you have
power um
beautiful
uh
program
great I'm pretty happy with that uh any
questions okay and
now all right so
guys you see this
um it should be pretty easy to make this
you can just change the metals to
something else if you want to do it on
the GPU or
something
um so yeah you can change the metals to
other buffers and you can run this
pretty much anywhere uh so these are
compiled backends that use linearizer uh
we have an LPM back end we have a clang
back end you can do all the same stuff
in in C
um instead of
GPU and the whole library
is uh
4,416 lines uh so I gave up on a th000
lines the new goal is 5,000 lines but
you can see the library does a lot more
and the Thousand lines was just leading
to to terrible
ricing
um Mad Dog Nation thank you for gifting
Subs I forget the name of the other
person gifting Subs but I appreciate you
too
um Power is power a is a guys didn't you
read an
Rand H let's push
this all right we'll let the
nonsubscribers ask on topic questions if
I end up talking about my opinions about
Portugal we messed up look we coded guys
we CED look at
that um I'll merge that in assuming the
test
pass but I really like how this brings
everything like up to the front and I
want to make more of tiny grad basically
look like this right like we have a lot
of
stupid there's a lot of stupid stupid
stuff um that like doesn't look like
this like look here where I create the
buffers this is in some like it's in
some stupid place right now we can put
all the buffer Creations in a single
place and then we can quickly walk the
graph and figure out which ones we need
and don't need right
like the power of this stuff is how
easily it all like works together it's
also like very usable on its own like
this is the the metal back end it's
short and very
generic um we can always work to make
things more generic but these parts
should be usable outside tiny grad too
we've written pretty much every part of
a full deep learning stack uh by the way
here like we can look at the code for
resonet 50 you'll see that it looks like
P torch
code um we go down through the P torch
code into
theuer um then we linearize we output
code we compile the code run the code
and we do getting 4,400
lines
um I don't know you know you know I
struggle with thinking tiny grad's a
waste of time because like a lot of
things that look like tiny grad are a
waste of
time um no there's no C++ it's all
python a lot of things that look like
tiny gr are a waste of time a lot of
these like passion project libraries
like look I know this stuff and don't
think I'm you know for however hard I am
on other people I'm way harder on myself
guys no like I really mean that um so
you know I ask myself like is this
dumb
uh why is torch faster okay torch isn't
torch doesn't have okay torch in a lot
of ways is a much less capable Library
than tiny grad and I know you aren't
going to quite believe that but I'll
explain why so torch for example doesn't
have an implementation of a
convolution uh torch will call out to a
library like
cudnn um CNN has been hand optimized and
not hand optimized by a guy on stream
for 30 minutes it's been hand optimized
by probably 20 Nvidia Engineers for you
know 10 years right like 200 man years
went into optimizing the kernels of
cudnn and like that's not an
exaggeration right that's exactly
correct um I mean you can think of how
many people do you think work on C andn
I mean it's a pretty big deal and
like it's kind of worthwhile until you
remember the bitter
lesson
okay so everybody should read this
document this is and I really like that
he went to work with karmac uh you
know um can't I just call
CNN can't we integrate the same
mechanism into tiny grad no because
that's how you become pytorch right just
whenever you ask for a link just Google
it
like um you're a subscriber so I I'll
post the link just for you because
you're a subscriber
um so yes can we call CNN yes and no
right
like it's I mean it's not a bad question
but when you've done that you've narrow
run into all the same problems with
pytorch for example cudnn can't fuse the
convolution kernel with every activation
function so you're going to end up doing
the convolution kernel and then the
activation function and doing an extra
round trip to memory so like yes you can
make things faster tomorrow by borrowing
from those 200 Nvidia maners or you can
write a generic Optimizer understand all
the tricks they you you're using and
remember the bitter lesson and then what
you're going to end up with is going to
be so much better better and really so
much simpler to reason about um we can
do these huge searches offline right
like really what we want to do is we
want to learn a model that looks at the
shape trackers and says here's how you
optimize that Curel right and we can
just big that model into tiny grad we
can train different models for different
devices and Tiny grad can train its own
model as it improves and then we get
recursive self-improvement don't worry
don't worry eliser owski you know why
optimizing compilers are safe and it's
because they reach a fix
Point um but someday we're not going to
reach a fix point because we're going to
put AGI inside tiny grad and it's going
to continue to improve look sometimes I
think the tiny grad is the last piece of
software like we're kind of ever going
to have to write right or at least like
the final AGI runs on Tiny grad you know
what I
mean
um new zero yeah something like that
right
like what is Tiny gr well you know
man AGI will run in 4k lines it was
actually eler owski I asked him and he
said that he thinks it's going to be 10K
lines and uh well not if it uses pych
but if it uses tiny gr
maybe
um but yeah so once you start calling
out to all these libraries you now have
big black boxes you can't reason about
that's the real problem with it right
right every piece in tiny grad you can
reason about and you have to be able to
reason about in order to make it better
right why has it taken 200 man years to
write
CNN do you have to pay to use the tiny
grad Library you have to pay yes yes you
you have to pay everybody else can have
it for free but since you asked you have
to pay my Paypal is geohot at Gmail and
you can PayPal me
350 will there be a part two of the
debate no not debates anymore uh doomers
win okay guys the AI Doom is real we're
all dead all right guess what you were
all going to die anyway right the
weirder thing is living forever because
nothing lives forever haven't you heard
about the heat death of the universe
right that's what I never got into you
know with the owski debate he's talking
about time doesn't matter why does the
time matter why does the time matter
well if it's close to the heat death of
the universe you know like how long did
you expect to live anyway we had a good
we had a good run no F's not real don't
worry about that but the doomers are
mostly right the AI are going to come
and like you know it's not going to be
quick and it's not going to be sudden
but well shit man you know like there
just ain't that many monkeys I mean
there's still a lot of monkeys and I
guess they're doing fine but like you
know no one looks at Monkey civilization
as the Pinnacle of civilization but it's
going to be so I don't know I don't want
to talk about AI Doom how do you get me
on that
shit yeah but what about Portugal all
right thank you guys thank you thank you
no no no we got to go no we got to go
why do people think AI is dangerous
because an AI robbed him in Al once so
wait no that was a wait no
Did I set it up correctly?
Cool.
Um,
so I want to show you guys how I
actually use aentic coding.
Let me see if I can get that to be a
little quieter.
tape.
Tape. Can you guys hear that? Is that
loud and annoying?
Um,
is that loud and annoying?
No, I don't think it's audible at all.
Okay, great.
>> [snorts]
>> Um,
so I mean yesterday is a bad example of
how to actually use those things. Uh, in
reality they're useful for certain
things, but you have to stay super
carefully uh on top of them.
Um,
so like all right, you can see it added
two helper functions here. It looks like
there's a ton of duplicated code. Do not
duplicate code.
Is this used?
This fallback that I don't really like.
I had it add some assertions.
you have to carefully read any of the
code that it writes.
Um,
This is the other thing that I'm working
on. Uh
I'm trying to write firmware
uh for the eGPUs.
Uh so I got some eGPUs in the mail. Uh
they have a nice board where we set up a
really nice uh debug loop. This is an
FTDI that can unbrick the chip no matter
what. So, I'm having uh Claude try to
enumerate the uh USB. Uh I got the UART
working.
Um again, these things aren't that good
and you have to hint them uh you have to
help them a lot. Uh like I had to tell
it to disable parody. It couldn't figure
out why the things weren't working, but
that was discussed in a Slack message.
Um,
so yeah, I'm working on three PRs right
now. Uh, I'm working on this DS perm
instructions one.
Um, it's so annoying if I'm not logged
into GitHub. I guess I can see it. Okay,
that's fine. As long as I can see if it
gets a green check. Uh, you know, I
don't do any logged in stuff uh on
stream. I'm also working on this RDNA4
PR
Um, so you can see that this one
unfortunately got an X on the llinter.
Uh, we can check that with precon.
Um,
so I'm sshed here into a tiny box. Oh,
and also I hope this stream is working
because I do have tail scale up. Um, I
need to have my tail scale up. I'm using
an exit node in order to access uh
Claude from Hong Kong.
Yeah. No, I mean yesterday's stream uh
sets a bad example. Uh you shouldn't
actually be using agent coding anything
like that. Um and there's a lot of stuff
that I still do by hand uh if you want
to see some of the by hand stuff, right?
But it's useful for like figuring things
out. Um so I'm not working in tiny here.
So I have an extra tiny grad to work on.
I can manage about three or four of
these.
Um, but if I try to manage too many, it
gets uh I just get overwhelmed.
Command to test plus
on RDNA4.
add it to the AMD
IDE test in GitHub actions.
Uh, and then here, so we can see
this on GitHub. I mean, sometime I'll
just push stuff to GitHub. Um, and I'll
look at the diff on GitHub if I feel
like I can. Uh some diffs I really have
to stay on top of uh by hand because you
really can't start to let the slop in.
People have this mythical idea that
agents can somehow manage their own uh
slop.
Um fear and loathing in Gast Town. That
would have been a good name.
Uh
okay. So oh just
test
test tiny is fine.
So this is adding RDNA4 support to the
emulator. There's one new part of tiny
grabb that I've entirely uh coded in
agents. But yeah, so the only question
is whether the zero is there by default.
These are variables like I they're all
assigned before use. The zero is finally
replaceable.
Why would
it
declare if they already
exist in varss?
Show an example of this.
All right. So you can see that this
thing is working. It's flashing
firmware. Whenever you can give these
things loops to close themselves, they
work pretty well. Um, sometimes they
can't do it if they can't get any
incrementalism on the problem. Uh, like
I tried to get it to write an emulator
uh that was cycle accurate and it
doesn't try to like make a model of the
GPU. It just adds hacks. If it can get
closer by adding hacks, it generally
doesn't work. But if the only way to if
it can get closer by like doing the
right thing if like the gradient flows
um then
uh it works uh correctly, right? So
see like here we can see some tests
failing. See what's going on here. Um
and then you have to kind of decide
which ones you have to stay on top of.
Right? So look at my
Yeah. So instead of duplicating that
code, it listened to me and it
dduplicated that code. Um,
see this is not a good this is not a
good fix. I don't understand this fix.
Oh, that lost mass equals true. It
didn't update that correctly.
Um,
so like I might want to complain and say
use set default here, right? like use
set defaults
here
also.
I mean, I could also have it check the
type
uh maybe if I want to add more
assertions, but you still nothing about
agentic coding prevents you from having
the entire state of the system in your
head. And it also can hurt you because
when you write the code yourself, it's
much harder to delude yourself into
thinking that you understand it. Um,
but
when the agent writes it, you can like
look it over and be like, "Yeah, I
understand all of that." And then you
read it more carefully. Uh, so I think
Carpathy has a lot of good things about
this. He talked about how
you
uh you start to atrophy your code
writing skill, but you improve your code
reading skill.
All right, so that uses set default now.
All right, I'm pretty happy with that
diff. Um, [snorts]
let's run
Python path equals this precomand
like mosh or something set up. So, this
just works better.
So, it's adding some timing and fireet.
So, this is reverse engineering um
firmware. These names are terrible.
I'm going to interrupt it and say uh do
you have better
names slashmore
info from
registers.h.
This will help you debug.
You must understand
all registers, not just copy.
So yeah, I mean it just it makes the
state uh a little bit
more annoying.
to like track.
Uh, all right. So, let's see if this
works.
No, that's not um
Oh, AMD and MPU are already set to one.
So, we just set them to one here. When
we run the test,
uh,
debug equals 4.
This is wrong.
It's just annoying.
Uh, so I never have it commit.
That stuff's just broken.
So, it's it's a lot of state that you
sort of have to to keep in your head.
Um,
run my llinter
in free commits passing.
uh copy the names from registers.h. In
fact, we can include registers.h
instead
of redeclaring
everything in agency.
So this is that one I switched to set
default.
Um
it's not really Oh no no no. This isn't
the problem.
I want that to start to add a ton of
crap.
Maybe it is that. I don't know.
Um
I'm not sure if I really have less uh
like bandwidth to talk. I I feel like it
requires really the exact same sort of
focus as programming. This three is a
little much for me.
Um I don't always do it as aggressively
as this.
I'm kind of showing off on the stream a
little bit.
Um but this basically looks like what my
uh
like agentic workflow looks like. So
let's put this over here and let's take
a look at this code.
um
pass vars to functions that need it.
Like why is this there? I don't like
that. Why am I not passing varss to
other functions?
And I don't think that
is access
for FPS adder like meanings. Yeah,
I don't like that. Can we make
it explicit?
So like I don't love how it's handling
this. We have different enums for RDNA3
and RDNA4.
Um it's importing them as this and it
has this really copy and pasted alias
list.
Um
get picodict is
okay.
Some of these changes to like use inst
are just good generic changes. Um
yeah,
move this.
add to
if LDS
with an L if branch.
I don't understand this. I don't
understand this code. So, you have to
stop and wait until you understand the
code. And then here's all that RDNA4
stuff repeated again.
Um
don't need to check
these instance here.
Um,
remove the helper
one line
call.
It added some new debug crap. I mean, I
like that it made that change. I don't
understand why that print needs flush
equals true.
I don't really like that.
Remove this. You don't need flush equals
true.
Now we're back to these stupid
functions. I don't know if they're
actually correct. Like I don't like that
there's a hack giving the name of the
function, right? That's the kind of crap
that like you end up with vibe coded
stuff. So, we're going to have to fix
that. Uh this stuff all seems okay.
Okay, I already fixed that to use the uh
helper from Tidyrad. Uh putting that as
a property on the GPU setting that that
seems okay.
Um as GPU props, it's like something
that's like returned from the fake file
system. They added the word RDNA4 here.
They added arch and they added an arch
call. That all seems good. Um they set
the arch there. That's good.
So like this is this is the workflow.
you really have to
uh stay on top of these sort of things.
Um, and it's not it's not sexy.
All right. Now, I push this as cleanups.
I probably shouldn't abuse the GitHub
runners so much, but whatever. That's
kind of what they're there for.
Um, okay. There's no diffs to this one.
I'm not sure what I have to still do on
this one. Let's look it over. Let's see
how this one's going. It's still
running.
Uh, the USB file registers are not being
written to properly. That seems fine. I
like that it's including registers.py. I
assume it updated the make file, so we
can read the diff for that.
Um,
throw that over. I should go there. I
should go there. That's also not right.
This needs to go to that goes there.
That goes there. I'm not perfect with
this new setup yet.
Um,
all right. So, read and capture boot
messages. Come in. Great. I don't know
how much I like that expected stuff from
the claw MD. So, we're just going to go
in there and we're gonna
uh yoink that.
Okay, you see it added it modified make
file to add a C flag. So, that's good.
Like, no amount of AI prevents you from
understanding.
I guess that's kind of the the moral of
this story. Um, if you don't fully
understand the code that your agent is
writing, you're backing yourself into a
corner. Um, and then you ask, well, I
mean, yeah, but someday these agents are
going to become superhuman. I can trust
a chessbot without uh
understanding what the chessbot is
doing. Uh, and yes, because you and the
chessbot have already completely agreed
on what you want to do. You want to win
the game.
Um, a lot of this stuff is just kind of
agreeing on what you want done. There's
things that agents still do that are
universally bad, and I think those
things will be fixed,
but
all right. So, let's go back here. I
don't like that it's using this X data
stuff.
Are these not
some special hardware initialization
don't accept rights a pull up on D+ line
that makes sense see like when you read
this no pull up on D+ line if you don't
already understand that that's how USB
signals that a device attaches right
like you have to understand that um And
it's so interesting how the skills
required to use these are the identical
skills from before. You just have to be
able to sort through a lot of
information a lot of information quickly
understand what's relevant, what's not
relevant. [clears throat]
Um AI isn't some magical uh
trick. Yeah, probably the clock
tree.
Why are you using
X data here?
Not in registers.h.
Uh, okay.
So, I already pushed that change.
Uh, let's check on these. You see that I
have a typo there. So, it's kind of
annoying that I'm not actually logged
into GitHub here. I don't log into
anything on stream, but normally I'd
just be doing this logged in. Like, I'm
still not thrilled by overall how this
stuff looks, but I don't really have a
better way to write it. So, I'm not sure
what I'm going to do yet. Um, this pull
request I'm pretty happy with. I'm glad
that that passes all the checks. So
let's see if this is good. Uh let's read
every line now. Okay, it adds source two
support there. That's fine. Um it had to
add this hack for noop because noop has
a variable loop. It's actually the only
pode with it. So that's okay. That's
fine. Those are fine. I complained about
this. It said it couldn't fix it. I
don't love it, but we'll say that that
stuff's fine, too.
Um, let's just kind of look at that one
in context, right? Then I can use GitHub
here to look at context. Okay, compile
me up. It quickly exits. It's still
using the pcode parser. That's pretty
good. Okay, so it added this new
function, sum of absolute differences.
It added a masked flag. It calls it here
with mask. That's fine. Oh, yes.
Um, is this used? It added this hack for
knop and I think it should just be
removed.
Uh,
this seems okay. I complained about
that. I couldn't fix it. I like that it
added assertions there. That's a
simplification.
Uh, it's removing those things. That's
fine.
Um,
I don't really love that.
like it should be using ul to determine
if it's a Uint64. Let's see. Um,
can you use ul to determine
if it's 64?
Uh, okay. That's See, that's fine. It it
added a bunch of these hacks where it
returns zero. We're slowly removing
them. It's interesting how code
production kind of looks more like
diffusion now. Like you can still get
quality code out of these things, but
your first thing is very fast and then
your refinement stage is longer. Um it's
unclear if these things are overall a
net productivity win. All right, so that
just changes that to set default. I'm
totally fine with that.
Uh,
other
used show.
That's it. Runs my test suite for me. It
knows how to run it. There's just a test
failure in test test hex literals. But
that's it's probably good. Now I have to
pay attention here to make sure that it
knows that's probably a test bug in hex,
right? Because that's the test for the
pcode parser, not actually the test of
any of the pode that's parsed. So it'll
do that. It'll check that. We'll come
back. We'll see what it's doing. I have
to keep that context in my head. Um, now
we're also working on this RDNA4 one. I
still haven't solved that problem there.
Uh, okay. So, again, this has not
figured out how to get it to enumerate a
USB device, but it has a complete loop
where it can run on its own.
Um, oh, okay, good. Things are working,
maybe. Oh, they're not working.
Um,
did it remove a lot of those stupid X
data things? Good. It removed the X data
things. I didn't like the X data things.
There's still three of them there.
All right, it looks like it's still
working. Let's let it
um keep trying it get out of this dump
regs thing, which is kind of cool.
That's fine. Like this is a good This is
fully like agentic because it has a loop
that it can close on itself.
Um so yeah, we see that it dumps the
eggs here. That's pretty cool. So let
that keep going.
Uh,
let's read this diff and see what it
did.
Okay. If is U64. That's fine. We
stripped that. Cool. I like that mostly.
Um.
Oh, interesting. If it has the F. Oh,
that's cool. See, it automatically
started doing that for all of them. I
don't really understand why that's
duplicated. I guess this is duplicated
logic to deal with the non-hex ones. It
could be cleaner, but whatever.
Um, all right. So, it fixed that.
Uh, oh, great. And even better, that
seems to have fixed the other problem.
The LRA syntax is used internally during
loop unrolling.
Uh,
you shouldn't need that in the P code.
parser forg
okay um I haven't dealt with this one
yet so like this one's kind of on hold
you're see my limit of what I can manage
um
think it found something there that
seems okay I don't need to feed that one
uh
see like okay where am I now I'm
complaining about that so After loop
unrolling, it becomes a number.
Um,
but that shouldn't be used in the parks,
should it? I don't like that.
I don't like that. Right.
Can
we use
the loop unroll instead?
Why is the loop unroller calling
back into
the parser?
Um, someone described this well when
they said it was like interacting with
the code at a higher level.
All right.
Like that one's not going to run. We'll
let that one run for a minute. Now,
let's think about what we want to do for
this.
So, yeah, this this hack needs to go.
Um, this needs to be removed.
You cannot have special handling for
some functions.
seems okay.
I mean, I just like that this one's
removing crap. I didn't really realize
that
that was being called back into.
We'll let that try.
I'm not really thrilled. See, there was
something I didn't understand. It's
calling back into the PCODE parser after
it does the loop unrolling, right? like
that shit.
Um,
all right.
What change did this make?
I don't love that it did that, but at
least it removed the hack.
Okay.
That stuff really shouldn't be in the
peer. I'm unhappy about that.
So, it looks like it's trying to write
to something
and it's failing.
All right.
Whatever. That can run. Tiny empty. Um,
I probably I'm not going to bring it up
on this stream, but usually I would have
uh well, sometime I'll tunnel into uh
I'll SSH tunnel so I can see the edits
that it's making. Um, so I'll show you
one of my goals for this week is to
unify. There's an op called define
global in Tiny. So, we're going to start
here. Um,
replace define global with param for
now.
Uh, just alias.
We should also see what tests pass. Oh,
this is going to this is going to slow
my computer down.
Um
uh define global
2B param and see what test
tiny tests All right.
I complained on Discord. Some tests
broken.
Uh
So the AI is not able to reference any
data sheet because there is no data
sheet. Um all of these registers were
reverse engineered by Claude from the
firmware.
Uh which was kind of my first foray into
these into these vcoded things. Um
so let's see how it did this aliasing.
Okay, that aliasing looks nice.
Uh,
all right. So, all the tests just pass.
It's now able to use define global as
the thing. Let's see if it's doing what
I expect
browser here.
This is viz and tiny. You can see it's
now using param
uh instead of define global which is
kind of nice because eventually I also
want to replace these kernel ops with
call ops.
Um but that's a different change. I
first want to get rid of define global.
So you can see here in the output of
kernel split um it's switching those
things to params instead of to uh
yeah. So unfortunately the tiny test
suite's a little bit too slow to run
uh in the agentic loop. So usually what
I'll do is I'll like have it make a
change like that. It's a very small
change. I can easily look at it. Um then
I run the tests. Then the tests that I
see that are broken uh that are bad I
paste into the thing and I I ask it why
they're broken. So on and so forth.
Close the loop. All right. This is still
trying crap with uh let's move that over
there. We don't need that for now.
This is still trying to get rid of and
clean up the thing. Like this gets into
where I don't fully understand the code.
Um no, see this is very bad. It
shouldn't be doing this. This is like a
type confusion kind of thing, even
though it did succeed. So like I now
have like a knot
uh I have like a knot in my code. Um
should never be S0. It should only be
don't check both fix the bug. Right. But
now I have like a knot that I don't
quite understand. And I I didn't really
realize when I started with this there's
this absolutely massive cost to doing
that. Okay, so this removed that hack
that looks like a strictly winning
change. Go over here.
Should manage my windows a little bit
better. You know, this is hard for me to
do on stream to like move windows
around. Um, okay. So, unfortunately, all
of these all of these test config viz
things were already failing. I should
probably just fix this. Maybe someone
already fixed it. I complained about it.
Make an alias for that.
See if anyone fixed anything.
Someone fix that.
It's just some like I don't know. We
should see probably what's going on
here.
Maybe it's just easier for me to fix it.
I don't know about that.
It's some like
I'm getting sniped by this now because
this was a pre-existing bug that I knew
about just this morning.
Um, throw another one to open code. Y is
failing.
Okay. Now, why is this failing? Um
probably has to do with some param
defined global dduping thing. You can
see that also all the test calls are
failing. So, there's something that's
trying to call pointer dtype on them
because it's a it's a U.
Uh yeah. Okay. The she was in shape.
That seems
uh okay. Remove the define global case.
Add a check for is pointer d type to
param and returng
thing if
it's probably enough for it to get it.
It might not be. You always have to make
a trade-off like do I want to type it
out better? Do I want to type it out
less? I don't hit 100% with keeping all
the state in my head.
Um but uh
okay. So that's good. Now
does look a lot more
reason number one.
Why these
funks
as lambdas
a big difference here.
Let's check in on this guy.
Uh,
I see.
Ah, cool. Uh, yes, that's an easy fix.
Great.
And I kind of don't like that that's all
over the place, but whatever. It's not
like I can set kernel to default to
that. It's gonna open the stupid device,
too.
Let me just say in Discord I have the
fix for that so nobody wastes time.
Whatever. It's a tiny fix.
I guess cutting out. If you change it to
M496, I can get mine to brown out. Oh,
interesting. Unrelated to the Discord
thing.
So, I should probably uh like it would
be cool if there was just one I posted
about that if there was like some bot in
our Discord that would do that
automatically.
Uh, all right. So that's fixed.
That alias works.
Let's control C that. And let's do this.
All right, we're back.
Yeah, you're seeing one of the downsides
of my real workflow. Uh I don't know why
the Wi-Fi dropped. That's just annoying.
I can't wait till I have an office with
like a real fiber connection soon. Okay,
all the tests passed there. Uh, all
right. Um, remove define global. It is
param now.
Let it run the
I'll do the replace later.
All right. Is the stream back?
I got no viewers on this one. So you
guys like when I do crypto scans, right?
Like welcome to a real workflop.
Um
name param is not defined. Why not?
Oh, it's annoying.
Don't let it waste time.
See if that works.
Uh yeah, so it's much le much much less
exciting, but welcome to a real
agentic coding workflow.
Uh I wanted to demonstrate this in
contrast to yesterday. Uh the top
programmers in the world are not
uh spamming gas town and claws and all
of that stuff. They're using these
things in a very
uh restrained and tasteful way. Uh the
slot apocalypse is not coming. If you
post PRs on Tiny Brad that are clear
that they have not been reviewed by a
human, uh not been carefully like to the
same level of care that I'm using here,
uh reviewed line by line by a human,
um I will disclose them. Don't waste my
time. I have the same AI as you do.
Uh
yeah, that was one thing I wanted to
to show and that's my real new workflow.
Uh it's not a lot of spamming.
Uh I'll turn on nonsubscriber and we'll
actually only do questions for five
minutes. Look, we're we're disciplined
today because this is actually a work
day for me.
Uh you know, it's Monday. I'm at work.
Um,
uh,
what chips in the eGPU? It's a 9060
XT8 gig. Oh, good. That's still trying.
Uh, using AI agents makes one dumb. I
think you have to stay more vigilant.
because you can just drift into the slop
and drift into the autopilot.
Uh I view AI agents very similar to GPS
for cars. Uh so I don't use nav systems
when I drive unless I really have to get
somewhere. Uh but I do use a map and it
is a magic map that has a dot on it.
Uh
oh. Brad, sorry I missed your earlier
thing. Do I use check untapped defs?
We're moving to that. Um, Chenu is Chenu
is working on it. Uh, you can, uh, if
you're interested in helping with Tiny
Grid development, you see kind of what
it looks like. Um, you can join our
Discord. Uh, it's like this kind of
stuff. If someone wants to work on
adding cna support to the emulator or
finishing the RDNA RDNA 4 support for
the emulator, I'm finding bugs in the
emulator.
Oh, look at this. Oh, it got something.
Oh, hit boys.
Um,
yeah. No, using I mean using the LLM as
a teacher is very good and it comes down
to how people use them. Uh, the
Anthropic released a study
uh
this is like a hype study. it they
actually
here how AI assistance impacts the
formation of coding skills. Um, and
their end conclusion,
uh,
if I recall correctly
um, on average, participants in the AI
group finished about 2% faster, although
the difference was not significant. Uh
there was however a significant
difference in uh difference in test uh
scores. The AI group understood way less
than the hand coding group.
Um the largest gap was on debugging
questions suggesting the ability to
understand when code is incorrect and
why it fails. Maybe a particular area of
concern if AI impedes code in
development. Um, so yeah, I mean there
really are bad ways to use these things
and it's unclear if there are such good
ways to use these things. Uh, this is
consistent with a lot of results I've
seen about AI that it does not actually
make anything faster. Um, and I'm still
playing with this new workflow for
myself. I don't know if it's making me
faster. Um, I think there are some
tradeoffs. I think I'm really trying my
best to avoid this downside.
Uh
the other alternative is to say that I'm
not going to use these tools. And I did
feel that way until Opus 4.5. Um because
it is clear that you're going to have to
like use these things. Software
engineers are going to get more
productive. It's unclear if the tools
today actually make people more
productive. Um, I wrote a post about
this uh a while ago.
Um,
and I think something that I'm mostly I
stand by most of the things in this post
except for
uh
this one.
I do think that these will work
interactively. Um, so I stand by
everything in this post except for this.
Uh, and then this
I mean this kind of like because the
interactive thing works. I do think that
refinement flows will start to work. Um,
I do still find that the first thing
that it gives you is generally its best
result. And this is kind of how you can
fall into this trap with AI assistance
where it looks like it's 98% of the way
there, but it's actually like 20% of the
way there. The thing that's cheap and
expensive has changed.
Um, I fully stand by this. Uh, is
anybody still using cursor today? And
like cloud code and open code are barely
doing anything. Um I just prefer the
open code interface. I see a lot of the
same vibecoded slop patterns in it. Uh
so you know all software engineers need
to be careful about this but it's better
than cloud code which is also vibecoded
slop and it's vioded slop that sends
data back to anthropic which again like
I'd be fine with if the workflow is
better. I'm not trying to hoard my data,
but like I said in, you know, my post to
Andropic about this, uh, you're not
going to get me to go back to I would
prefer to use open code with Kimmy, uh,
than to use claw code with Opus.
Uh, so, and I also like that I can run
Kimmy, especially I'm a little upset. I
wish that it was faster. Um, I wish that
the the cloud code was faster.
Uh,
I don't know why I didn't just put those
in the
direct like you just see a mis pattern
like that. It's like why didn't I put it
there? It probably has some, you know,
who knows?
Uh, yeah,
CEX CLY is better than Claude. I found
Codex to be extremely slow. Um,
the register still reject Rio
investigating
this works on the real so it is doing
something you aren't.
Uh, the study was so bad. Why? And
actually that study also didn't even
talk about claude code like things. It
talked about the old workflow of copying
and pasting from chat GPT.
Um should we have AI generate
documentation? I haven't found that much
use for that. I find that it mostly
writes slop.
Um Kimmy is cheaper. I mean I'm not that
worried about the price. All of these
things are a, like I said, my salary is
$100,000 a year. These things are a
uh very small fraction of my salary. I
would be happy to pay up to $20,000 a
year for AI assistance. And I would do
the same thing for uh you know, everyone
who works in my companies. Um, if AI
assistance actually made people
20% more productive, I'd absolutely
spend 20% of their salary on on LMS.
I'm not sure that it does. And I think
that these these tools can be very
dangerous if you don't have good
judgment and taste and if you don't like
understand like know yourself really
well. Um, so I think that these things
are going to help certain people and
hurt other people, but I don't think
that the overall change to the rankings
of programmers will be that high because
the skills look very similar,
right? The skills of programming look
like
I imagine, think about it when uh we
switched from manually uh adding up
stuff in the accounting department to
the accounting department using
spreadsheets.
I think that for the most part even
though workflows changed a lot
the same basic skill of accounting was
there uh the same basic [clears throat]
like there there's a there's an old
saying in machine learning it's uh
garbage in garbage out and it becomes
the same thing is also true about
spreadsheets
uh you know like like what did it just
do there? Why did it add
whatever?
Um,
yeah, they they did Kimmy for free. Uh,
if you don't have anything that you pay
for, Kimmy free Kimmy's pretty good. Um,
I found it slightly worse than Claude,
but like I say, if Anthropic ever tries
to uh lock down this stuff again, then I
will just as happily uh switch back.
Um,
yeah, when you code in languages you
don't know, well, I tend to let AIS take
the wheel. I think that this is like
concerning.
If you're using it, there's a way that
you can use it for syntax. Like there's
something that they're just so
incredible at, which is writing these
little oneoff scripts. Um, and it's not
that they're better at the scripts than
you. It's like that script would take me
15 minutes and it takes the AI 15
seconds, which is really cool. And it
can write all of these one-off scripts
to just like debug something where
you're like, it would just take you so
much longer.
Um, what do we think? We think it's
going to show up on USB. Like, I'm so
excited. It's going to eventually just
show up on lsusb
uh when we do this as an emulator. No,
shows that the right still fails. Let me
check if it enumerated. It did not
enumerate.
Um see now it's doing everything in this
emulator. I gave it an emulator.
Um
Gemini 3 is more cogent unlimited use of
code examples. Yeah, I don't know. I I
feel that they're all like pretty close
except Codeex is actually slow.
I don't know how many tokens per second
I'm getting from uh Anthropic.
Uh
that looks
better.
Weird. Really?
Oh, that's cool.
Oh, good.
Uh, this is the session that I have my
SSH keys forwarded on. That's why I come
to this one to get push.
I don't like giving the agents the SSH
forward stuff. Obviously,
[snorts]
it's almost lunchtime for me. Um, the
main takeaway from this stream is that
you need to be the Earth and the AIS
need to be the moon. You are a senior
who's reviewing junior dev code. Yeah,
they fool you by being fast.
Um, and they will get better, but I
think that the workflow is
I don't know. It's going to be
interesting. It's going to be
interesting.
This this is something that I didn't
predict.
Uh and I think that other people
predicted it
uh before me. I also didn't predict
chatting.
Uh and I had like I used GBT3 for stuff.
Um I I worked on the compression the
language compression stuff really early.
I knew what these I knew that like
predicting and compressing
uh could in theory do this stuff. I just
didn't predict the productization.
And here I didn't expect these loops. I
mean, every time I tried one of these
before Opus, it was always kind of
uh just bad.
like I would I would run it and it would
uh
go off on some tangent. It would put
crap everywhere.
Uh so I mean it's great that these
things are becoming more intelligent and
we all have to learn how to use them. Um
so my advice for the day is uh don't
fall for everything you see online. Uh
you know uh the creator of uh of
Gastown, Steve Jay, uh is a is a is a
famous guy. uh yegeay Google platform
rant I this is one of his works that uh
I reference a lot you know it's great to
see him back with uh with gas town
but
uh we joked on the uh the first day we
came back to to to come Harold was like
uh I [snorts] read something on LinkedIn
that said this is the most important day
for CTO's of uh you know their career
Um, you know, we're we're joking about
that. You know, I told every everyone a
comment that I expected everybody to be
5x more productive uh now that we have
agentic coding. Um, tongue and cheek,
obviously. And if you're at the kind of
place that isn't saying this stuff
tongue and cheek, if you're at the kind
of place that has like weirdly embraced
some allin on AI
uh thing where you basically again have
like nonsoftware engineers driving
policy at your company, uh you should
quit. Uh that company is is going into
the ground. Uh so yeah, I mean this is a
time when when fortunes are made and
fortunes are lost.
um companies will end up in the slot
apocalypse.
You know, there is always the Deosex
Machina. Don't worry, Opus 5.0 is going
to come in and clean up all the slop.
And I don't know, maybe it will. Like I
my my prediction is as good as yours. I
I I'm not uh historically great at
predicting when these
when these things become good enough to
use. Uh even when I first saw Chat GBT,
I'm like, "Oh, that is a cute art
project." I did not expect at some point
everyone kind of realized that this was
going to replace Google. Uh but the
first time I saw it, I I still didn't
didn't expect it.
Uh I like, you know, I knew about tool
use. I had early stuff doing it, but I
I' I've
in some ways underestimated the progress
of these things. uh but in other ways
also realize that they're kind of
fooling me. Um oh data efficiency is
super important. Uh we talk about data
efficiency all the time at comma because
um data efficiency, you know, it's not
only that we're we're out of data,
right? This is a this is a the scaling
laws didn't stop because we couldn't
continue to actually scale the weights.
The scaling laws stopped because we ran
out of data. Um, but yeah, then you're
left with with data efficiency. And then
there's an interesting I don't know if
you guys saw the Dorcash uh Schmidt
Huber take on LLMs
where Schmid Huber said basically that
no LLMs are not the bitter lesson and
these scaling laws are not the bitter
lesson because these things are not
being uh being learned from from data.
These things are simply compressing the
internet. They are not using search and
optimization to to infinitely scale.
They've reached a point, a scaling
point. Um,
waiting for Tiny Grad to get good enough
that I can run Kimmy on my cheap home
lab. Yeah, I'm very interested in this
too. Uh, so I have I tried to get Kimmy
running on uh one of my uh AMD boxes and
I got VLLM up and it was running at
three tokens per second. Uh, and then
like you needed to enable some stupid
flags.
Uh, and the flags didn't work. You know,
this VLM rock muse IDER and then you
enable these things and it gives you
errors with MX FP4. So, I still haven't
run Kimmy locally at more than three
tokens per second.
Um,
the problem I mean basically no matter
how you slice this, you're going to need
uh like 768 gigs of RAM to run it. Uh,
so I like I don't know how you're going
to get 768 gigs of RAM.
Um, the Macs are something, but that RAM
isn't very fast.
Yeah, I know. RAM's not cheap, right?
Um, you know, it's cool how all these
things are are mixture of experts
models. What mixture of experts does is
it divorces the amount of RAM from the
amount of compute you need. But I'm
thinking about it like I really want to
make a a Kimmy product uh for Tiny Corp.
What would you be willing to pay?
Uh what would you be willing to pay for
a Kimmy box and how many tokens per
second does it need?
Let's read this over again.
Still kind of working. I got to go to
lunch, too. I'm hungry.
$3,000 for 30 tokens per second. Yeah, I
just don't think that's going to happen.
Um, I'm in Hong Kong.
No, I don't think there's a learning
curve in using AI.
Um, I think that every time someone
talks about how some new workflow is
better or some system prompt is better,
I never actually see it. Uh, I think
that there is some like getting used to
working with these dumb people who are
fast.
Um, yeah. No, China making cheap RAM.
I'm very interested in I'm going to be
in Shenzhen next week, by the way. Uh,
if anyone is there and uh is making like
Yeah, I'm interested in RAM. I'm
interested in compute chips. I'm
interested in like what I can buy
uh 5K. I don't think you're going to be
able to run. I don't think you can even
like what's the cost of RAM now? Even if
uh so like well there's a question of
how fast you want the RAM to be, right?
But um cost per GB of DDR5. And DDR5
still isn't fast enough. You need faster
RAM than this.
Uh I mean maybe you could bank it and
it'd be fine, right? So, we're talking
about $10 to $20 per gigabyte, right?
So, let's even say we could get that for
$10 a gigabyte. You're spending $7,000.
You're spending $8,000 on RAM alone,
right? And that's not even server RAM.
Like, server RAM here is even more. Um,
so the RAM is probably going to be more
like $20. So, you're talking 15K just
for the RAM.
Um,
do I check InstaDMs? No, only from
girls. Uh,
send me an email. Like the way to
actually get in touch with me, I do read
all of my emails. I don't reply to a lot
of them because I'm just like, why would
I reply to this, right? Like what am I
going to what do I get from this?
Um,
I mean, the other thing too is like this
would enter a global market pretty fast,
right? If there was some way that the
Chinese could make like normal ram chips
and just stick them on sticks of RAM,
they'd be doing it already.
Uh so there's no there's no like like
alpha here really.
Uh
Oh, interesting. The original firmware
does enumerate. Cool.
Okay. Uh
I don't know. I think RAM will
eventually become cheap. Um I do think
boxes to run these things. The question
will be is kind of is this where weight
scaling is going to stay? Does weight
scaling stay at something that's like
somewhat approachable like a terabyte or
are we going to start getting into
things that are distributed across you
know 10 or 100 machines and are these
are these um remember that the human
brain
uh has about um
well so let's
synapses in human brain
uh
count.
Yeah. So, like those are the numbers
we're looking at for human brains. Um
we're still
uh like if Kimmy has one trillion, so
we're still two to three orders of
magnitude off from the synapses in the
human brain. So, it's possible that
scaling is going to continue to that.
Um, I mean it's possible scaling will
even continue beyond that, but
we're still we're still we're still off
from the human brain. I think our
mixtures of expert ratios are pretty
similar to the human brain.
It's done in a very like rudimentary
way, but
um
what do you mean we haven't even figured
out what 2% of it does? I think we
mostly mostly know. How long am I going
to be in Shenzhen? Couple days.
All right,
we're getting into slop questions. Thank
you for watching the stream. Uh,
look, real firmware works. You make your
firmware
work. I will give you a cookie.
Um, yeah. No. And again, like I I read
all the emails, but I don't reply to
most of them, right? Like what's the
like why?
I'm not interested in like having lunch.
I'm just I'm not interested in that. Um
uh yeah, but I wanted to do this stream
today just to show you what real agent
coding workflows look like. They do not
look like spamming on a digital ocean
box. That is for partying on Sunday.
Mondays are for real work. You guys
should be out there doing real work. If
you're not doing real work today, get a
job uh and go do real work and figure
out how to produce more than you
consume. And as long as you continue to
do that, you'll be fine in the future.
Happy Monday, everybody.
WEBVTT
Kind: captions
Language: en
nanodanger7: hello hello
Samitugames : heyhey
acheesedanish00: acheesedanish00 subscribed at Tier 1. They've subscribed for 4 months!
gazny: dam from 6k to 9k IG god
Bombapil0t: going for 10k
nanodanger7: nice haircut
ffthgezgxjkndd: 69k next
sampleaccount123: yo
markvlk: 1m2019.com
sapphiiree_: THE MYTH THE MAN THE LEGEND
acheesedanish00: 3 streams in 2 days
foxubu: o/ new chair
psychosocial1810: dont forget to follow https://www.instagram.com/georgehotz
acheesedanish00: dope hair cut
lightofhel1: yo
cl_anubis: cl_anubis subscribed at Tier 1.
nightknight0000: lmao
lightofhel1: tomorrow it was 6k...
Mac_33: I told my mom to follow George Hotz on Instagram.
Bombapil0t: lol
hatem_xh: hi george .. what keyboard u are using ?
gazny: Reading YT comments PogChamp
W1lkins: TriHard 7
twiggy_io: What up young blood.
markvlk: You got a new chair
perkofficial: Howdy
kanogger: howdy
foxubu: Asking about the keyboard == ban! 🛑
Bombapil0t: Kreygasm
W1lkins: who purchased you 3.5k followers Kappa
kanogger: gonna hit 10k today PogChamp
AideTechBot: follower wave
Sowlz: how come your chome looks so good :(
zacoaa: lol
psychosocial1810: dx racer lit bro 😂 👌 🔥
lightofhel1: its geohotz progression LUL
AideTechBot: Did u get a haircut
Dsplits: @georgehotz are you buying your followers?
alluxua: whoops, you got your hair cut
slimpimp007: new cut huh
serhejenos: hi
Samitugames : What are you working today?
dorkmo: haircutttt
alienware997: I‘m the guy with the „Better Installer“ Commment, and i said that you get a level 2 Subscription from me in your next Stream. Now i have to drive to my bank and pay money in thanks! @georgehotz
kljok: I bought the followers
Dsplits: why do you want followers?
twiggy_io: Can you go into how funding works for startups?
alluxua: I like the long hair better
nagimohsen: Would you say math is needed as much as college makes it seem in order to be a good programmer
the_sadanie: Is Comma AI still alive?
toolegit2quit_: Did you pay for college ?
lavastew: the hobo look fit you better
BradyLange: BradyLange subscribed with Twitch Prime.
kanogger: www.1m2019.com
dorkmo: the new cherry hibiscus pure leaf tea taskes like hawaiian punch
CaptainAshtar: hey..... my fav streamer is online
alxhotel: 1m2019.com doesn't work through https
tea_em_oh_six: post more on instagram
foxubu: You should lean your back to the chair. (Neck issues) :Z
acheesedanish00: subscribe if he is your favorite lol
hackyhacks: lol
JonThomasK: everyones a unicorn
Keyeh: SeemsGood
th3_maj0r: nice hair cut bro
CaptainAshtar: CaptainAshtar subscribed at Tier 1.
nagimohsen: Are you a beast in math
acheesedanish00: gotta go :/
acheesedanish00: bye
ikoakmaindehoas: how about docker build --no-cache ?
Keyeh: perl in 2019 LUL
serhejenos: Nice to see you streaming frequantly
foxxible: is c   good to learn as a second language?
b_______________________b: jcgD
Samitugames : 1 2?
alluxua: Hi geohot, did you get a girlfriend? Is that hiking girl your girlfriend?
doctrinacuriosa: @georgehotz what's vector space
Hashcatcs: forth &gt; C
nagimohsen: Someone ask him a math question cause I suck
b_______________________b: @foxxible what do you wanna do with c
m0etaz: Math Q: what's a fourier transform?
Mac_33: indefinite integral of e^3x-1
foxxible: game development mainly
cIvIcbooks: i think you need to force exec syntax with a RUN command
cIvIcbooks: with brackets
Yellow_turd: @georgehotz in your opinion what is the best app developement language. Don't know if you have ever looked into app development or not
JonThomasK: if the std deviation of a series is 1 and the average is 0.50 what is 3 sigma?
foxxible: @b_______________________b game development mainly
b_______________________b: @foxxible depends how much you wanna do with your games
tomastakk: @Yellow_turd such thing doesn't exist
LegoNigel: pip!
Yellow_turd: @tomastakk what do you mean by such a thing doesnt exist
b_______________________b: @foxxible unity uses simple c# scripting and unreal but c   I find is for people wanting to engineer games not just make games
Hashcatcs: @georgehotz will you ever do a video on reverse oriented programming ?
Airfrischung: whats 3 * 17?
doctrinacuriosa: @georgehotz prolly it's better if you mount your qira directroy so that that you don't need to clone the repo everytime
tomastakk: @Yellow_turd there's no 'best app development language'
CaptainAshtar: why you are not using anymore jupyter
Yellow_turd: @tomastakk I asked him what he thinks is the best, everyone has opinions maybe you dont have opinions tho
NoLimitFitness: PogChamp PogChamp
thuganalyst: Reuplods of this stream get tens of thousands of views on youtube lol
b_______________________b: @foxxible so yeah learn it but your gonna have to light read on memory managment and how it all works depending how you make your game in c
W1lkins: docker run -it
gazny: Dont think 3.8 hit stable
perkofficial: we need some george hotz emotes PogChamp
cIvIcbooks: docker run -it image bash
tomastakk: @Yellow_turd do you have yours?
Yellow_turd: yes
b_______________________b: @foxxible ya digg?
jfccoding: when you run qira are you running it on ubuntu or osx
foxxible: @b_______________________b oh okay, thank you
b_______________________b: jcgK
doctrinacuriosa: @georgehotz you dont ened to type apt-get all the time just apt is fine
robbsalm: ocd hits
JonThomasK: i take it my docker pull request will have to be redone :P
inshelootts: Hello
asthmaa: do you have thefuck installed?
b_______________________b: back seat coders in chat OMEGALUL
doctrinacuriosa: @georgehotz if you want absolute minimum you shouldn't be using ubuntu anyways, go with alpine
Hashcatcs: or arch
b_______________________b: @doctrinacuriosa tell him how to use the restroom too
adriaroms: or Windows
adriaroms: haha
Hashcatcs: or LFS
CaptainAshtar: @georgehotz why you are not using jupyter anymore?
doctrinacuriosa: @b_______________________b we got joker here
Hashcatcs: no we dont do that here
foxubu: Windows 10   Linux Subsystem
foxubu: Too poor for Mac :Z
mikestrike406: How do you type so damn fast?
adriaroms: Mac Hardware with Windows 10
eduardoadf1: nice haircut
JonThomasK: NotLikeThis
doctrinacuriosa: omg this is retarded
EkkoTheUnforgiven: hello there
brotas_: hello do you want to 1v1 me fortnite
doctrinacuriosa: im out bye
robbsalm: chill guys
Mac_33: I tried submodules once, it's pretty nifty
nick_porta: hi
b_______________________b: @nick_porta hey jcgK
chorbo123: george when are you gonna play LoL again
PixelogicDev: hiya @georgehotz - So super random question, do you usually have numbers like this while programming?
darthsergious: what color scheme is it?
b_______________________b: @darthsergious diarrhea
adriaroms: @b_______________________b no, diarrhea v2
aresfour: whats hackerman hacking on? :)
davidsit_site: qira
mikestrike406: hey @georgehotz why'd you move comma.ai to san diego?
SnakeOneMLG: @mikestrike406 there is an article about it
b_______________________b: qira Pog
adriaroms: why not CEO anymore? Exit?
ikoakmaindehoas: Excuse me while I use GIMP to create a command line interface to backtrace the killer's DNS ping in HTML.
cl_anubis: wut? not ceo?
adriaroms: yeah, why not CEO?
b_______________________b: too many new frogs jcgD
robbsalm: ahahah da heck
twiggy_io: He hasn't been ceo for awhile.
m0etaz: he hired a ceo
kanogger: the frog is a symbol of racism
kurumuz12: he is not being the ceo is old news
twiggy_io: He probably just didn't want to take that role.
adriaroms: yeah yeah, ik but he sell the co?
davidsit_site: too ADHD to have investor confidence, hired CEO= responsibilities managed?
JonThomasK: use a dog
fission1110: CEO is stressful and boring hah
foxubu: @adriaroms No, he’s now head of research
JonThomasK: eat it
adriaroms: ok
twiggy_io: It just takes awhile to herd cattle.
SnakeOneMLG: TriHard
hackyhacks: I've never herded cattle, but I worked on a farm as a teenager and was chased by a bull while changing his salt block.
SnakeOneMLG: is this TriHard friendly chat? TriHard
kanogger: TriHard
SnakeOneMLG: @kanogger cmonBruh
foxubu: @snakeonemlg Christian channel
b_______________________b: TriHard 7
davidsit_site: @snakeonemlg agreed.
kanogger: @SnakeOneMLG what's wrong brother? TriHard
barathrumberdem: what s he codin
SnakeOneMLG: "@kanogger " more like "ka TriHard"
SnakeOneMLG: "@kanogger " more like "ka TriHard "
SnakeOneMLG: RIP
davidsit_site: pre quantum practice debugger @barathrumberdem
Airfrischung: what kind of macbook are you using?
barathrumberdem: @davidsit_site aight that's coool
Keyeh: i think he uses a big imac not sure though
Mac_33: @Keyeh iMacs don't have a battery in 'em
davidsit_site: @barathrumberdem called qira. find if on github. Google geohot qira
SnakeOneMLG: 13 inch macbook
davidsit_site: find it
Keyeh: @Mac_33 thats true, didn't notice it :)
wisdom_tgo: Is he reading chat?
davidsit_site: "patch seems to apply cleanly "
dorkmo: tesla is sueing zoox
b_______________________b: I would love to George review Ghidra LUL
foxubu: Too many frame drops. Can’t follow you typing :Z
molehero: :q
wisdom_tgo: George are you Jewish?
bcmijk: Stutters here and there.
b_______________________b: @dorkmo logistic secrets jcgD
quillford: stream is smooth
asthmaa: he's too fast writing
Dsplits: bro frames are really dropping
Dsplits: I thought you had the best internet in the country
onemarko: he should ditch that mac
revolutionist123: 3rd stream in a row PogChamp
JonThomasK: lol
foxubu: 13 inch MacBook   5k monitor (for the record)
asthmaa: drugs?
jellyjar: frequent streams and a haircut???? that cant be geohot
bcmijk: Making him work LUL
Masplus: Wire of the gods solving framedrops
molehero: wire Pog
m0etaz: stream piano
oddtechno: Hey Ludde
javadragoniv: lmao do u play the piano?
Keyeh: we back
phatgary: all good
Dsplits: damn twitch hit us with the ad
lightofhel1: yo
twiggy_io: @davidsit_site nah its you.
kanogger: Back
alxhotel: Back
jfccoding: back
kozgn: @georgehotz probably your gpu sucks
John_DiResta: oh hello
JonThomasK: its a cpu problem from obs. Have to lower the input size of video
kanogger: but still dropping framed :(
cl_anubis: yoyo wb
jfccoding: no
WASDTeam: we back fo good
Dsplits: no
Dsplits: still laggy
barathrumberdem: whats his ip :D
cl_anubis: still laggy
lightofhel1: we back and drops back too
chorbo123: framedrop now 20% omegalul
NonTrivial778: do you use a password manager?
NonTrivial778: it's fine
funwayz: 10% increase
Yanisduc2: hi people out there
P3droPL: its not laggy - just dropped frames
nmuntz_: it's much better now
IndoPridePinoy: download some ram
NonTrivial778: yea
kozgn: @georgehotz check your system resources and maybe change to hardware rendering
zgamer0123: I think it's a liiittle bit better
quillford: it’s good enough
JonThomasK: lower resolution down from 1920
JonThomasK: will fix it
psychosocial1810: tell them instagram hoes to get off your internet
John_DiResta: yeah it just dropped frames
NonTrivial778: La puta madre geohot
cl_anubis: @georgehotz looks better now
Yellow_turd: @georgehotz reduce the resolution of your camera. it works for me
Keyeh: LMAO
zgamer0123: OMG
JonThomasK: TAIWAN Pog
U_P_I_A: lol
zacoaa: LMFAO
deR_Ed: Mr Worldwide xD
cl_anubis: that was a hyped end
twiggy_io: Lol I lost it.
W1lkins: even laggier LUL
gazny: LUL
funwayz: 0% OMEGALUL
Keyeh: no frames dropping PogChamp
John_DiResta: can't wait for the crispness
Dsplits: bro so much better now
kanogger: Zero PogChamp
WASDTeam: while building a low level debugger
serhejenos: 30 fps
toolegit2quit_: high quality too
JonThomasK: TAIWAN #1 TAIWAN #1 TAIWAN #1 TAIWAN #1 TAIWAN #1 TAIWAN #1
chorbo123: that end tho lmao
zgamer0123: GG thanks :D
cl_anubis: boiiiiis
lightofhel1: LMFAO
revolutionist123: LUL
jcream: LUL LUL
John_DiResta: niiiiceeeeeee
lightofhel1: yo
e2yub: it is simply beautiful
serhejenos: Why frames are caped at 30?
P0LY: FeelsGoodMan
alxhotel: no log
JonThomasK: TAIWAN #1
mungo_mungo: go back to taiwan
toolegit2quit_: Church of Taiwan Server
WASDTeam: now we want 5k @60fps
Keyeh: you can also increase the bitrate now
WASDTeam: lol
cIvIcbooks: bring back taiwan
revolutionist123: 30 year old get exited with changing server LUL
serhejenos: ahaha
funwayz: I miss drops :/
e2yub: So smooth
John_DiResta: daaaaaaaaaaaam
psychosocial1810: you dont really need 60 fps watching programming
lightofhel1: 0.0% feels good
JonThomasK: exactly
Keyeh: monkaS
ikoakmaindehoas: what are you drinking?
P0LY: FeelsBadMan
Zeldorino: LUL
Sandoww: What codec does twitch use?
deadpool_reynolds: whiskey
jellyjar: 2irl4me
bcmijk: Now it's too smooth, I miss them drops FeelsBadMan
kanogger: harsh words
e2yub: yikes
MatiGoG: FeelsBadMan
erichtp: nice haircut you've been on a roll with the streams!
revolutionist123: FeelsBadMan
asthmaa: whiskey?
zacoaa: LMFAO
twiggy_io: h256
robbsalm: " i dont think it gets better" takes a rope
P0LY: FeelsGoodMan
chorbo123: this isn't @georgehotz stream without the dropped frames
onemarko: what is the motivation behind qira anyway?
dorkmo: it gets shitty TM
MatiGoG: FeelsGoodMan Clap
bosapiutsa: much better pog
foxasmr: Doomer vs twitch
WASDTeam: went tomta
serhejenos: Pepesad
WASDTeam: went to taiwan, never got back
Keyeh: it gets worse but at least we have geo streaming FeelsAmazingMan
magician2378: which pixel is george?
RomanNYC: dam this is crispy
qrln: s/o to twitch
erichtp: new chair PogChamp
Dsplits: @georgehotz are you working on any other projects?
zacoaa: LUL
kanogger: BibleThump
Admiralkheir: are your repositories private?
lightofhel1: BibleThump BibleThump BibleThump
bcmijk: bcmijk subscribed at Tier 1.
bcmijk: More internet monies.
revolutionist123: How to get a girlfriend as a hacker 101 LUL
chorbo123: what keyboard is he using
Zeldorino: monkaS
zacoaa: boom shes yours
MRSIMSIM2: just talk 4Head
kanogger: i want to be your girlfriend :)
magician2378: george, do you want to be my girlfriend?
lightofhel1: B)
foxubu: @kanogger female detected 🤓
bcmijk: Last I saw he was using the Leopold FC980M @chorbo123
Keyeh: just have LOTS of money
MatiGoG: be fake FeelsBadMan just to get a gf
revolutionist123: Now i can lose my virginity bro thank u!
kanogger: @foxubu yes but only dating guys with more than 10k followers sorry
chorbo123: cool @bcmijk
Ex0diaaa: @georgehotz where to start to be a good programmer?
robbsalm: create an app thats worth 10 mil, girls will find you
bcmijk: @chorbo123 or.. FC750R, can't remember.
MatiGoG: @Ex0diaaa first you need to start lmao
Protoxus: Hello jgrHI
foxubu: @kanogger If that’s your metric, I give a sh!t about dating you :D
Hamled2: yes!
Keyeh: @georgehotz have you ever compete in programming contests?
revolutionist123: If it works dont touch it
lightofhel1: maybe switch to latest qemu?
Ex0diaaa: @MatiGoG I say in relation to content to study.
Hamled2: RealTargetDisas is some PHP shit...
phatgary: which keyboard do you use?
IWasnotDemi: @georgehotz what's your wpm when typing?
dorkmo: hes not writing a book
kozgn: @georgehotz does qira work on windows, do you plan to support it on?
Infinitelym: is this really basic programming?
m0etaz: lol
m0etaz: it's the most advanced programming
Keyeh: its basic dude
jfccoding: trying to install this on mac getting this for an error ./pin-latest/source/include/pin/level_base.PLH:64:10: fatal error: 'string' file not found #include &lt;string&gt;
Fooly27: @Infinitelym very basic if you cant understand this give up
jfccoding: anyone know anything?
hoffs: a is a good variable
dorkmo: basic like a basic bitch
revolutionist123: all
Hamled2: a for assembly...
robbsalm: mips architecture bois
PhillipWei: it's within an ifdef
kanogger: I use a in minified javascript Kappa
dorkmo: a is for apple
Hamled2: reassingment probably doesn't count as use?
robbsalm: a is for aidontunderstand
Zeldorino: george is going from startup ceo to professional twitch streamer SeemsGood
PhillipWei: reassignment does mean use
OFFICER_KKONA: what keybaord are you using?
Hamled2: why does it count as being used? it wouldn't necessarily be read, right?
Jewishrambo: this code looks trash
onemarko: man you learn to code cleanly when you have to go back and read your own code
robbsalm: @georgehotz dont you get eyesache after hours on an such an high constrat theme
alienware997: alienware997 subscribed at Tier 3.
PhillipWei: @hamled2 looks like you're correct
Hamled2: did the compile errors go away? George might still be wrong 😂
alienware997: Btw i was the guy who asked for the better Installer, thanks for your work, really appreciate it! And here comes my Level 3 Subscription!
shrek_361: George the GOAT
LookOverHeHe: Geoooooo
hoffs: tier 3 is big money 25 usd sub
tempor1s: Tier 3 means it costs $25 instead of 5 bucks
Hamled2: nice
Differential: basically means they paid $25 to sub
knilecrack: Sup
knilecrack: What are you doing?
alienware997: To be clear i paid in Euro, so its 24,99€:D
ikoakmaindehoas: thats hella expensive
Zeldorino: You get 5x the money for tier 3
TwitchFoxy: TwitchFoxy subscribed with Twitch Prime.
TwitchFoxy: George is such a rabbit hole, I was watching Jailbreaking the simulation and counterfactual regret minimization... now I am here
Rlchibi: I was!
Keyeh: HeyGuys
bcmijk: Taiwan #1
P0LY: VoHiYo
cIvIcbooks: bring back taiwan
ikoakmaindehoas: HeyGuys
e2yub: #1
kanogger: ✋
serhejenos: I was
boy_milk: i missed it :(
dorkmo: fucking nuts taiwan #1
GiGnX12: VoHiYo
phatgary: MaxLOL
deadpool_reynolds: ( · · ) /
toolegit2quit_: if you know you know
RigzGame: VoHiYo
revolutionist123: HeyGuys
hyldee: Fucking miss Taiwan
Zeldorino: 🙋♂️
e2yub: what a service
serhejenos: Go with Russia next time
twiggy_io: HeyGuys HeyGuys HeyGuys
benjaminr42: VoHiYo
Hamled2: red diffs yeah
frederik_diamond: Hey
Hamled2: cut out all that old rotten code
frederik_diamond: it's my first time watching your stream:)
bagaytht: whats your keyboard and mouse ?
hoffs: 25k commits behind
twiggy_io: Why do so many people care about what keyboard he uses?
RigzGame: idk
Hamled2: why didn't you need those anymore
RigzGame: it's useless to know x)
Hamled2: ah cool
RigzGame: use your keyboard to make something interesting :D
Hamled2: are you doing a custom qemu
ActionIsComing: Hi man
coProof: Can I pip install qira yetttt???!
Hamled2: but it does need to be built just for qira, no prebuilt distro version?
ikoakmaindehoas: gimme dem jack daniels
hoffs: that tea
Hamled2: ohh, so qemu doesn't have a "recording" layer at all?
chelsiquixote: did geohot shave his dome piece?
donaldtheduck2000: can you use qira to reverse engineer the simulation yet?
Zeldorino: 🐦
robbsalm: with assembly we will escape the simulation
Hamled2: lol I have a friend who works at GitHub, not sure that's always as true as you'd think :D
saulgd: i feel so out of my depth watching george LUL
RudeCoffee: This really makes me want to eat a taco
Biffingtonn: @RudeCoffee yeah true actually
brisingr1031: @georgehotz still using your hkkb?
dorkmo: DoritosChip TheIlluminati
alex_sez: have u tried Ghidra? if so, what is your opinion of it?
s1ug: damn. thought his hat said REE.
s1ug: was gonna ask for link.
ActionIsComing: i would never touch nsa software
alex_sez: lol
Protoxus: @actioniscoming All software is NSA software TheIlluminati
ActionIsComing: cmonBruh
Protoxus: jgrREE
jfccoding: its the nsa if your really that scared about installing the software they don't need you to install anything if they really want to get on your systems
JonThomasK: i take it my docker pull request wasnt good enough? @georgehotz
nmuntz_: @georgehotz just change that line with python3 -m venv venv
Sportmann941: hi, what are you trying to programm rn? @georgehotz
Protoxus: @jfccoding True. Just read Vault9. Ez hackerino
knilecrack: how did you fix frame dropping?
Protoxus: @sportmann941 Qira. The description is on the GitHub url
TheBigK02: could u move back up to 1080p then?
alex_sez: did u play pwnable.tw while u were in taiwan? Kappa
JonThomasK: i fixed a lot of this in the docker PR. the pip install is using pip2 on ubuntu. Change it to pip3
pavankumarp: how is he executing commands in same shellwhile a script is executing, any idea ?. Or am I overthinking and it is just alt   tab ?
twiggy_io: tmux
nanodanger7: it's screen
pavankumarp: oh okay, tmux.
shepard_commander62: did python3 split the community?
TheBigK02: its like systemd splitted the linux community :)
mikey9988: python 3 PepeHands
lucas9o: what keyboard do you use?
TheBigK02: i would also like to know @lucas9o
Hamled2: ewwww
Hamled2: so huge
Nesquik80: yo yo
Nesquik80: @georgehotz how's life
Protoxus: @nesquik80 Simulated. jgrTARD
JonThomasK: docker image prune..... no s on images
Nesquik80: @georgehotz not using Startpage anymore?
ikoakmaindehoas: you can run docker build with the --no-cache flag
Hamled2: apparently it's related to building a "device tree"?
TheBigK02: atleast he tries which is kinda cool
Hamled2: Not sure if that's like the hierarchy of components in your computer (USB and PCI buses and their attached stuff?)
Protoxus: !voteban onebitbrain
anatoly1974: where's the hair dude ???
TheBigK02: i like the challange beeing insa famous for the sake of it... or for a secret plan to bash tesla :)
Protoxus: @onebitbrain jgrGame
0TestUser: are u trying to get insta famous for the girls ? Kappa
WASDTeam: yup, its a descriptor of all the devices and their addrs for driver init and stuff
Hamled2: @georgehotz why do you need to compile qemu in the docker image? can't it be build somewhere and downloaded as a pre-made image (maybe a docker layer?)
Nesquik80: @georgehotz not using Startpage anymore?
Simon_AA: use alpine instead of ubuntu?
donaldtheduck2000: why do you want to be instagram famous bro
donaldtheduck2000: u just need a select few followers that respect your work
Protoxus: @donaldtheduck2000 We'll know when it happens
mikey9988: using safari monkaS
Protoxus: I use Chrome Canary and Firefox Developer Edition interchangably jgrThink
TheBigK02: what do u use @mikey9988 ... i used to use chrome... but im migrating back to ff... but i feel like both arent gr8
serhejenos: What about tensorflow 2.0?
anatoly1974: can somebody explain what project is George working on this looks like mandarin ??? @georgehotz
Simon_AA: Maybe they simple hired better PR people?
dorkmo: i banned a man in reno just to watch him die
Protoxus: @anatoly1974 Just go to the GitHub link in the title, everything is explained there
mikey9988: i use chrome monkaS @TheBigK02
Hamled2: @georgehotz is qemu only built when compiling the docker image, or will everybody that installs via docker going to end up having it compiled on their machine as well?
anatoly1974: thx @Protoxus
Protoxus: @mikey9988 Consider opting for Chrome Canary if you're in webdev
Protoxus: SeemsGood
knilecrack: how about you do multi stage build?
TheBigK02: as i saw a freaking virus scanner built into that freaking browser... i thought... FUCK THIS... im out
favvs13: TriHard gang
mikey9988: imagine using windows command prompt
RudeCoffee: wiki, "Qi'ra is a fictional character in the Star Wars franchise"
mikey9988: after years of bash
alex_sez: its jar jar binks cousin
W1lkins: Where's the Mac Miller
Aer0skull: XD
TheBigK02: i mean... the powershell has a worse reputation that it acutally is
Protoxus: @w1lkins He died
TheBigK02: its not perfect... but its atleast not weird batch shit
Protoxus: @thebigk02 Batch-shit crazy :^)
mikey9988: Borne again shell is PogChamp
donaldtheduck2000: it's good but they tried to add their own touch to it, so they screwed it up
donaldtheduck2000: but it was a good starting point
TheBigK02: i mean ... what didnt they screw up... the only usable protocol MS has is RDP... and that protocol is bought from citrix :D
Hamled2: yeah don't do update
Hamled2: that should be the system owner's decision
Hamled2: I hate how homebrew runs an update before every command
TheBigK02: but i actually admire the way they went with the surface pro... i actually like the device and the idea behind it...
TheBigK02: if there would be a linux on it... it would be a great device :D
pspxdiso: @georgehotz Hey Mr. Balls, how far along are you with the port to Python 3?
TheBigK02: isnt he pretty much done? i might be wrong here...
Thorstein47: i dont understand anyrhing what is this
TheBigK02: what is what... qira? is a debugger...
donaldtheduck2000: Is it a debugger or does it hook into a debugger?
donaldtheduck2000: I thought it's just a GUI
RudeCoffee: "QIRA is a competitor to strace and gdb"
ericswenson15: yo do you do any iot stuff?
Hamled2: it works with qemu to do debugging donaldtheduck2000
donaldtheduck2000: ah
shepard_commander62: heard of ROS?
Hamled2: it's not the same exact kind of debugging you can do with gdb, but it's got some stuff gdb doesn't have (viewing the entire execution timeline like a video you can scrub back and forth)
donaldtheduck2000: didn't know that qemu did debugging
Hamled2: it doesn't, I think this is based on a patch he wrote
Hamled2: to record all the instructions that get executed
donaldtheduck2000: oh
donaldtheduck2000: interesting
Hamled2: it's probably closer to some profiling tools
Thorstein47: can someone explain what is he doing?
sdak006: @georgehotz is there any reason you are pulling full git history in your docker image? Seems wasteful
pspxdiso: @Thorstein47 He is busting balls
mikey9988: is Geohots on an actual mac or is it a hackintosh ?
ericswenson15: would you be interested in microservice development for https://www.swensonhe.com/
knilecrack: mac i believe
donaldtheduck2000: there is a dynamic to static converter I believe
TheBigK02: hes using a macbook pro 2017 version i believe (13 inch)
r1c1c: why can't i see the chat
more_bacon: Geeeeeoooorrrrgggeeeeeeeeeeeeeee
twiggy_io: Because you are broken.
mikey9988: thanks @TheBigK02
r1c1c: Is it because I haven't subscribed?
W1lkins: You need to follow on Instagram first r1c1c
r1c1c: followed already
ActionIsComing: no loss for you, nothing smart in chat
ActionIsComing: czySMUG
kei86: "ex sued by Sony" LUL
serhejenos: You are almost there
Nesquik80: @georgehotz do you do some javascript?
NonTrivial778: why i am slow at logical thinking? am i a low iq?
ActionIsComing: yea
NonTrivial778: LUL
Luki512: Hello @ all
twiggy_io: Hello @Luki512
Networks: hello epic fortnite gamers
serhejenos: No
W1lkins: no
cIvIcbooks: https://www.reddit.com/r/Instagram/comments/b51w74/george_hotz_1_million_in_2019/
serhejenos: Kappa
JonThomasK: k
Prest0n1337: hell nah
mikey9988: LUL
ActionIsComing: no
NonTrivial778: i'm on fedora and its fucking painfull to install qira
P0LY: monkaS
alienware997: I will try!
shepard_commander62: twitch testing, i am watching from a bus though
Aer0skull: i have to reboot for that
mikey9988: my machine just blew up, messaging from my phone Kappa
serhejenos: Will it install on windows? I don't have anything other right now
Prest0n1337: jk I might try sometime later
r1c1c: george wouldn't be george anymore once he gets 1M followers :(
JonThomasK: i did a version where i made qira run your binary in the container, obviously only works with linux binaries but it was cool
Prest0n1337: life long loser trys to make github commit
mikey9988: He'll be the george he wanted to be, but the one you didn't want to see him become @JonThomasK
more_bacon: George, how do I donate to your church? I have many lambs
kozgn: @georgehotz this error occured on windows when runned install.bat
kozgn: sk-socketio pillow pyelftools socketIO-client pydot ipaddr capstone ./qiradb
JonThomasK: hrrm? @mikey9988
480i: Wait. There’s a church now??
donaldtheduck2000: I think the church was a joke
NonTrivial778: installing fucking qira ....
kei86: 480i : Makes more sense if you saw his SXSW talk
serhejenos: BibleThump BibleThump BibleThump
JonThomasK: Time to sue bois
Prest0n1337: trademark it
mikey9988: sorry i meant the @ the guy above you please ignore @JonThomasK
alienware997: This is my error: that’s the error I get: make: *** No rule to make target `trace/generated-events.h‘, needed by `Makefile‘. Stop. make: *** Waiting for unfinished jobs.... make: *** [config-host.mak] Error 1
donaldtheduck2000: how would it work
kozgn: @georgehotz oh actually ican install on windows with windows subsytem or github bash lol
Meapzor: qira still first here
r1c1c: @mikey9988 yeah i mean he will still be the george he wanted to be but not on livestreams
Hamled2: @sdak006 I stepped away for a bit, did George address your question about just doing a shallow clone?
Cape_clear: where is your hair?
knilecrack: should this work on mac without issues?
donaldtheduck2000: upload binary, send it to a qemu instance on the cloud?
alienware997: Macbook pro 2014 majove
Murgio: lamo where is your jair
Murgio: lmao
Murgio: hair
GenBurnside: help. trying to convert a .rdb into a usable format
zenkai_oogway: can anyone tell me a basic description of what hes building? I missed the last few streams
cIvIcbooks: docker build bombed out
knilecrack: ah yeah
GenBurnside: roots 2 genealogy save file (90's)
cIvIcbooks: The command '/bin/sh -c cd tracers &amp;&amp; ./qemu_build.sh' returned a non-zero code: 137
mikey9988: what's the GitHub username ?
Aer0skull: k i'm cloning it
GenBurnside: trying to get the genealogy data
serhejenos: @zenkai_oogway updates his program named qira and made for debagging purposes
mikey9988: nvm is geohot
W1lkins: TriHard
zenkai_oogway: @serhejenos ty, I shouldve read the title lol
revolutionist123: monkaS
ActionIsComing: HOLUP cmonBruh ^
donaldtheduck2000: is this Ubuntu?
NonTrivial778: I run ./qira -s /bin/ls and nothing show up on 127.0.0.1:3002
revolutionist123: @donaldtheduck2000 look top left
b_______________________b: @donaldtheduck2000 mac but it's all the same Only diff is max is BSD and not linux
b_______________________b: max* not max
alex_sez: max
kei86: distantly BSD
donaldtheduck2000: yea just thought he said that it doesn't run on mac
knilecrack: yes it doesnt
b_______________________b: so is he using QEMU for cross-platform development or another reason?
kei86: donaldtheduck2000 : He's also ssh-ing into something and using docker
donaldtheduck2000: right that what I was referring to
Nesquik80: @georgehotz do you prefer mac or linux?
Aer0skull: how you have an install.bat and not Windows supported
knilecrack: but you should be able to clone this to docker ubuntu image and give it a shot
donaldtheduck2000: cool
Hamled2: @georgehotz what branch are you working on
kei86: Aer0skull : maybe it simply echos "Not for windows dude!" :D
NonTrivial778: File "/home/anon/qira/venv/lib64/python3.7/os.py", line 594, in _execvpe exec_func(file, *argrest) FileNotFoundError: [Errno 2] No such file or directory
Aer0skull: no, i check it
Aer0skull: x)
e2yub: trying it right now
NonTrivial778: no I am on fedora
kei86: @georgehotz : Did you see cIvIcbooks 's error up above on Docker? "The command '/bin/sh -c cd tracers &amp;&amp; ./qemu_build.sh' returned a non-zero code: 137"
Hamled2: NonTrivial778 can you post the entire stacktrace to Gist?
alienware997: Okay when Mac not supported i have to fire up my Ubuntu VM....
NonTrivial778: start the server on 127.0.0.1:3002 but nothing shows up
Hamled2: @georgehotz would you mind if I made a PR to add Arch stuff back into the install script?
donaldtheduck2000: can you run qemu inside a vm?
Aer0skull: util/memfd.c:43:12: error: static declaration of ‘memfd_create’ follows non-static declaration
knilecrack: yuo should be able
knilecrack: are you using vmware or virtualbox?
donaldtheduck2000: virtualbox
alienware997: I will try with vmware
knilecrack: one moment
Aer0skull: on Ubuntu 18.10
twiggy_io: @alienware997 why not use the docker image?
donaldtheduck2000: if I remember correctly you can't nest virtual machines
knilecrack: you need to enable that extended features in processor tab for VM
kei86: @cIvIcbooks : You figure that error out?
Yanisduc2: util/memfd.c:43:12: error: static declaration of ‘memfd_create’ follows non-static declaration static int memfd_create(const char *name, unsigned int flags)
donaldtheduck2000: oh
Yanisduc2: got this error message on windows subsystem for linux with ubuntu 18.04
anstefa: whats up
Max__PWR: Yo, complete noob over here. Is this python ?
W1lkins: yes
kozgn: @georgehotz (/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl) *** You'll need to install Ubuntu or get a working build env for qemu and python yourself *** install.sh: line 12: tracers/qemu/qira-i386: No such file or directory building QEMU Cloning into 'qemu'... remote: Enumerating objects: 4461, done. remote: Counting objects: 100% (4461/4461), done. remote: Compressing objects: 100% (4056/4056), done. remote: Total 4461 (delta 562), reus
Hamled2: some is python, some is bash script, some is C
kozgn: sorry for spam
Aer0skull: @Yanisduc2 same
ericswenson15: sorry kinda random but would you be interested in an iot project for simple human?
Trenz2: @georgehotz when u're gonna do some bountys or ctf bro?
NonTrivial778: https://i.imgur.com/uJ6m6Gp.png
twiggy_io: @ericswenson15 he built a startup. I don't think he wants to work for you.
Max__PWR: what languange would you guys recommend to get started with to get into programming?
Max__PWR: I heard python is a good start
JonThomasK: if you hate yourself, javascript
donaldtheduck2000: it's good
donaldtheduck2000: also asm
kei86: python is good
knilecrack: c if you hate yourself
MatiGoG: 4 errors on ubuntu cant install
anstefa: How many computer languages can you type? :D
ericswenson15: it's not my company
anstefa: or speak
ericswenson15: but true
alienware997: @twiggy_io are you running qira on that? I mean i have a Pc only for my VM's here and its up all the time so i thought the easiest way is to install qira there an access it with my mac over ssh...
donaldtheduck2000: start with a scripting language, spoil yourself, then learn C, then ASM
donaldtheduck2000: then forget all that and code in python
ericswenson15: lol
akvana5656: Hiii
ericswenson15: or you can try spanish
W1lkins: TriHard
twiggy_io: @alienware997 Thats the best part of docker. It runs like a vm so you can just boot it up locally can connect to the local vm.
donaldtheduck2000: if you want to get fancy learn LISP
umps: why code in vim rather than an IDE with vim keybinds?
Max__PWR: ok, I think Im going with spanish then. Thanks!
donaldtheduck2000: then realise life is too short
ericswenson15: lol
donaldtheduck2000: and code python
knilecrack: so you can learn better
ActionIsComing: popo
mikey9988: recommending asm monkaS @donaldtheduck2000
W1lkins: why do you need an ide umps
alienware997: @twiggy_io thanks for the Tip, havn't used it till today, will now definitely change:)
anstefa: expirence in the dark web?
Simon_AA: with all of this problems with different OS, you say that docker is preferred method of installation
anstefa: expirience in the dark web?
W1lkins: anstefa stop spamming
kozgn: https://pastebin.com/dQHYNVR4 this occured in arch-linux using pacman @georgehotz
mikey9988: any java programmers here?
xtyonx: ohhhhh the hear cut
umps: why don't you need an ide @W1lkins
anstefa: @W1lkins lol
donaldtheduck2000: seriously just learn python, you only need need C/C   to optimize python
twiggy_io: @kozgn You'll need to install Ubuntu or get a working build env for qemu and python yourself *
NonTrivial778: fix your shit
twiggy_io: Its the first line.
MatiGoG: util/memfd.c:43:12: error: static declaration of ‘memfd_create’ follows non-static declaration static int memfd_create(const char *name, unsigned int flags)
donaldtheduck2000: unless you want to do low level programming, like write debuggers, compilers etc
Hamled2: @georgehotz the tracers/qemu/whatever symlinks don't seem to work
kozgn: @twiggy_io cant do that inside script?
ffthgezgxjkndd: when does python 2.7 stop getting supported?
W1lkins: umps there's no point in discussing if you answer a question with the opposite of the question
knilecrack: i started docker thing now
knilecrack: it's working
knilecrack: i mean it's compiling ...
ericswenson15: poodles
umps: @W1lkins you literally did the same exact thing LUL
ericswenson15: LUL
W1lkins: umps :)
Hamled2: @georgehotz I think you need to do an install script change to check if [ -e ] before running the script ot check for return value of 1`
tybutnowyoudie: @ffthgezgxjkndd Jan 2020
serhejenos: @ffthgezgxjkndd they said in 2020 but, it's "simbolic" they will probably continue to support way past that time
knilecrack: this mac is crap so it's still working
Hamled2: @georgehotz For the qemu symlinks, I mean
HardDenmark: hi guys
NonTrivial778: I did git clone qira
NonTrivial778: ooohhh
alluxua: Geohot, why you put on a hat in the room?
twiggy_io: To block out the haters.
Sparking: swag points
HardDenmark: looking cool
umps: did he ever get his food
alluxua: Who hate him? He is so adorable
Hamled2: @georgehotz The tracers/qemu directory has several symlinks to qemu binaries, in current master commit
Hamled2: @georgehotz and the install script is trying to run one of them to check if QEMu was built, but the symlink doens't go anywhere
Hamled2: @georgehotz so you get an error message about file not found
umps: oh u got a haircut
SlightR6: Do you ever plan to bypass anti-cheats?
Hamled2: I guess it's just unnecessary error? it was in everyone's output when they tried to run the script
Hamled2: okay
Farafire: hello from spain!
ericswenson15: he would be the best engineer ever
ericswenson15: prolly
Hamled2: @georgehotz would you accept a PR to add back Arch support?
Meapzor: Chrome DansGame
anstefa: what is qira?
twiggy_io: A new star wars character.
ericswenson15: oh nice
twiggy_io: Kappa
Hamled2: Of course
ffthgezgxjkndd: yeah shes natelie portmans daughter
ericswenson15: yay copyrgiht music
NonTrivial778: You'll need to install Ubuntu or get a working build env for qemu and python yourself LUL
Yanisduc2: ubuntu 18.04 not supportet?
ericswenson15: LUL
nizero: nice haircut george
SlightR6: Will you ever plan to bypass anti-cheats
ericswenson15: lol aggreed
knilecrack: shitty world
oX333: VAY VAY VAY SIHHATLER OLSUN REİS
nizero: george are you going to move to san diego with the rest of the comma ai team ?
ericswenson15: interesting
Yanisduc2: no one
ffthgezgxjkndd: so deep
ffthgezgxjkndd: lol
Hamled2: They'll put you in solitary confinement like Schwartz :(
ericswenson15: very true
RealGamer613: hit the weed one time
eazzycs: @oX333 dün
ericswenson15: i steal the words
mikey9988: LUL ? @RealGamer613
alluxua: Hi geohot, you got beautiful voice. Can you sing the song ‘ let her go’ by the passenger?
ericswenson15: LUL
mikey9988: Free Shkreli PogChamp
ericswenson15: move to country w/out extradition
eazzycs: @oX333 dün dedim ki git tras ol olmus xd
alienware997: @twiggy_io setting up Docker right now:D
krasbolle: same
oX333: @eazzycs :dDDD
xtyonx: well say Hi they are watching you :)
donaldtheduck2000: Hey bro
akvana5656: Selammmm
alluxua: Watch YouTube and sing let her go by passenger
eazzycs: beyler bu pic ne yapiyo anlamadim gitti
donaldtheduck2000: do you think the simulation is using Spatial locality?
eazzycs: gitsin namaz kilsin ibadet etsin bos seyler ile ugrasmasin
donaldtheduck2000: I was thinking about this the other day
donaldtheduck2000: maybe that's why synchronicity happens
donaldtheduck2000: because what you think about and what happens and what already happened are stored in the same location
donaldtheduck2000: to conserve space
keepingtrckofthisacct: oooh man, how much did i miss?!
RealGamer613: hit the weed one time
keepingtrckofthisacct: !uptime
ActionIsComing: czyUNI
P0LY: :D
keepingtrckofthisacct: how long has he been on?
donaldtheduck2000: ok bro :(
erichtp: 1 hour, 44 minutes, 55 seconds @keepingtrckofthisacct
keepingtrckofthisacct: @erichtp thanks!
lostchange: bamDog bam1 bamPog bam3
montecarlo: HAIRCUT NICE
mikey9988: LUL @RealGamer613
Thomasbrah: @georgehotz Dam dude you got a haircut, looking fresh mah dude!
tybutnowyoudie: almost 10k PogChamp
alienware997: Which Docker Image do you use? Sorry for dumb questions @twiggy_io
lostchange: just followed bamSellout bamSellout
Meapzor: what kind of content should we expect if we follow?
Hamled2: python ontop of unicorn? or just straight python?
JonThomasK: i build the stages because eventually you can have a base image thats built once and a qira base that just updates pip dependcies. Eventually you can mount the binary onto the container and wont need ANY install scripts at all
Protoxus: You gotta beat the Instagram algorithm. Daily uploads, use the right SEO hashtags, git gut
Xaotic: what is his computer ? setup ?
E1337YT: tomcr00s3 looks different than in the movies
Hamled2: ANGR only does symbolic execution right @georgehotz
alienware997: @twiggy_io got it by my own. sorry for that dumb question
Hamled2: I guess it's just angr
Hamled2: @georgehotz or is the "program instrumentation" bit what you would use for Qira's tracer?
Thomasbrah: is that chair comfortable or is it just all looks?
AshfaqSeyad: hey man
AshfaqSeyad: u accept questions?
yoshimoto555: I wish python had a good debugger
santi_264: favourite book?
Protoxus: @santi_264 Try "The Ego &amp; Its Own" by Max Stirner
0TestUser: 0TestUser subscribed with Twitch Prime.
Yellow_turd: sellout LUL
OFFICER_KKONA: capitalism in a nutshell FeelsBadMan
Trenz2: Jebaited
Tigerman143: sup geo
Protoxus: @yellow_turd That's capitalism for ya, buddy
Xaotic: FeelsBadMan
Trenz2: not making enough money question mark
Aer0skull: you just answered a non subscriber question
Yellow_turd: im not your buddy, pal
santi_264: damn yellow chill
jeann2019: Hery put music in backgroud men
Protoxus: I don't like your South Park memes, and I'm not your pal, guy
r1c1c: &lt;3
Yellow_turd: im not your guy, mister
Trenz2: i.m not your guy , buddy LUL
r1c1c: im not your guy, pal LUL
NonTrivial778: now I'll try install it on Linux Mint
Trenz2: i.m not our pal , hommie
alex_sez: ...
Hamled2: @georgehotz you said earlier the project is already ported to python 3, the install script is installing (I think) python 2.7 packages (like python python-dev and python-virtualenv) is this correct?
santi_264: can a subscriber ask him his favourite bbok
Xflagzzz: What are you programming?
serhejenos: Gift which keeps on giving
Hamled2: @georgehotz I mean, is my understanding correct?
GenBurnside: man
r1c1c: anyone can gift a me a sub
Protoxus: Non-subs are human trash jgrREE jgrREE jgrREE
Thomasbrah: subl
tybutnowyoudie: sublime?
GenBurnside: there is nothing on the internet on how to mess with an .rdb from the 1990s
fortnest: you look stupid in this cap, don't ban me pls
alluxua: You have nice hair and great eyes. Donot put in cap
0TestUser: are there any sub emotes ?
Protoxus: Pineapple on pizza is a ban-worthy opinion in the streams I usually watch.
xtyonx: don't encourage people to click ont he x button in real life !
alluxua: Do whatever to make you happy
NonTrivial778: we want to see bof exploits LUL
Hamled2: @georgehotz does Angr actually execute instructions in a sim like QEMU? doesn't look like it
Fulk33: @georgehotz what are your current plans for quira? can we help?
Hamled2: There's the symbolic executor, but isn't that much different from what QEMU is doing
NonTrivial778: works on linuxmint LUL https://i.imgur.com/NYeGCgb.png
bignobaoki: Hey man whats up!
Hamled2: Radare was built by people who used GDB and thought "This is too good of a user experience"
yoshimoto555: Lol that made my day
yrreseason: Ubuntu still your favourite distro ?
Hamled2: Does QEMU do the lifting to IR to help with execution? (e.g. then it implements its own VM for that IR)?
SlightR6: What is qira?
kozgn: @georgehotz i managed to get this far on arch-linux https://pastebin.com/J9KFeuf4
Hamled2: If you're using some other version of libc, how can you know that the execution results you're seeing in the sim are accurate?
gator____: @georgehotz hey man sorry if this is off topic, but how do you stay productive and fight distraction? procrastination seems to be my best friend these days and you seem like a productivity machine :D
ArcherCreatlol: qemu unicorn engine
Twitch0xme: @georgehotz are you planning to add remote debugging support to qira?
W1lkins: I do :)
Hamled2: That's a great summary
OmarBeBallin: I like pain :)
ericswenson15: good job
NonTrivial778: Gentoo is worse, emerge is a pain in the ass
NackterZeuS: of course I Like my life to be pain Kreygasm
PatriqDesigns: KISS
Hamled2: So Simple It Doesn't Work TM
juka_espada_quebrada: !uptime
alluxua: Sing a song, please
Ampalos23: forsen1 forsen2
davidb881: Lets port Internet into TempleOs
xstaubfinger: wut
ericswenson15: keep it simple cus im stupid
OmarBeBallin: forsen boys LULW
Nesquik80: you guys heard of article 13?
NonTrivial778: u like to fucking debug programs in ASM
W1lkins: It is quite funny though "Tries to keep it simple" rest of the news is manual interventions to keep your system up and running 4Head
alluxua: Your hair is way better looking than that cap
Hamled2: Lets write it georgehotz
Ampalos23: Hey guys can u tell me how to code a virtual girlfriend? forsenE
StanStill1710: whats a kernal
ericswenson15: popcorn
Bioaim7: yes
OmarBeBallin: im one of those guys who likes to rewrite everything.. so u know my opinion
Bioaim7: start it!
kingkontraa: Got a new haircut PogChamp
hyldee: do it, then ill follow you on instagram
PlayITBruiser: yeeeeeeeeaaaa
alluxua: Sing a song before code. Any song, please
twiggy_io: @georgehotz write it in go.
cIvIcbooks: time to hit that yerba
PlayITBruiser: code it with gucci gang
Hamled2: Like you're building a complete user-space loading system?
0TestUser: you have a netflix series to recommend ?
Ampalos23: rm -rf / forsenLewd
JumpTwiice: sup dudes
r1c1c: ANIME
PlayITBruiser: watch tombstone
ericswenson15: file size recommendation?
0TestUser: AYAYA
b4qazan: are you not too old to watch chineese cartoons?
th3_maj0r: death note the anime i hope
spoco: weebs FailFish
davidb881: we gonna write C?
PlayITBruiser: western movie
JumpTwiice: what we writing today?
Ampalos23: forsenPuke
Hamled2: @georgehotz would this usercorn-type tool you're talking about be something that worked to analyze windows binaries? It seems like 90% of the audience for analysis tools is people looking at windows malware...
ericswenson15: comments or long var and function names or both?
W1lkins: RIP fans
ericswenson15: LUL
r1c1c: Go watch The Promised Neverland
ericswenson15: ok thank you
tybutnowyoudie: apple doesn't do comments?
ericswenson15: robert martin says long var names
NonTrivial778: LIKE A BOSS
ericswenson15: idk
Bioaim7: LUL
Jewishrambo: Kappa
Jewishrambo: Kappa Kappa
Ampalos23: I read code to sleep
NonTrivial778: Andrew Tanenbaum is a good coder too
PlayITBruiser: gay comments
r1c1c: @tybutnowyoudie they don't because their codes are already readable
Bioaim7: KappaPride
ericswenson15: "testable javascript" author says lots of comments
ericswenson15: i d k
PlayITBruiser: never comment
OmarBeBallin: I like the fact he uses java
hardtarget4: qemu #1
ericswenson15: right!
ericswenson15: and they become wrong over time potentially?
NonTrivial778: LUL LUL LUL
Ampalos23: # How this works???? --- BEST comment
PlayITBruiser: easier to read c than english
SlimEconomy: is the chair comfortable?
Hamled2: @georgehotz what would it take to do qira or usercorn-style dynamic analysis of a windows binary while running the tools on a linux host?
GenBurnside: one of you sub peeps should ask what his fav font is
PlayITBruiser: what sens u use
lightofhel1: PogChamp
ActionIsComing: its working now?
PlayITBruiser: is 1.3@400dpi ok
Ampalos23: Can this guy write a Hello World app?
alluxua: I subscribed on Jan, but geohot even did not twitch one.
spoco: the key to writing readable code is to not type it in python Kappa
billyera: !uptime
NonTrivial778: what's the best alternative of qira? Kappa
TwitchFoxy: notlikethis100 Learning so much just by sitting and listening here!
Reptilia0: daddr por like daddy
Zemulos: Zemulos subscribed at Tier 1.
PlayITBruiser: maybe do bbc
billyera: Just entered the stream. How are you Geo? plans for Spring break?
Ampalos23: How to download google?
ActionIsComing: just google it ^
Hamled2: I unfortunately missed all of that because someone was talking to me IRL :(
PlayITBruiser: can u illustrate in ms paint?
NonTrivial778: geohot is getting tired, he needs caffeine and ephedrine
Hamled2: @georgehotz what's the benefit of doing a userspace simulation with QEMU vs a full VM with like KVM or Xen
Hamled2: That makes a lot of sense. Is it also true that most of the time what you're analyzing doesn't "need" full emulation of a syscall?
okkessh: how do I subscribe
tybutnowyoudie: :(
Lazysloth: there is the sub button on top right
TwitchFoxy: @okkessh top right
revolutionist123: BibleThump
PlayITBruiser: pog
JumpTwiice: PogChamp
MrBankster: wat
Hamled2: I'm really excited for this! I started working recently on this Practical Binary Analysis https://nostarch.com/binaryanalysis
okkessh: top right is follow
Hamled2: *recently
nougekai: @georgehotz i'm a brain surgeon and this looks way complicated than what i'm doing :O
JumpTwiice: @Runner76 sure Kappa
nougekai: im serious
MrBankster: why is this guy so freakin hot
Hamled2: @georgehotz could you, eventually, add in some crazy shit like WINE to do windows binary emulation ontop of their emulated syscalls?
r1c1c: See you
JumpTwiice: that stuff about being a brain surgeon
r1c1c: !
PlayITBruiser: dream on
TwitchFoxy: See you
r1c1c: bye
tybutnowyoudie: bye
litesam: hEy
snapcs1: hey george HeyGuys
twiggy_io: What up homie
c252: hi
Chyeburashka: Chyeburashka subscribed with Twitch Prime.
fourhundredtwenty: jojo
c252: your hair is gone
snapcs1: get ready for the instagram sellout
ImAventus: Ayoo
jamesred2313: Sup Jew your computer is faster
ImAventus: Ads
shekel_gobblin: OK! Remember people, no talking about Comma.ai or logan paul's downfall or you will be banned from the 1mil instagram 2019 event. @georgehotz
dungeonmaster3: yo, what keyboard do you use
tiguent: damn ur a fast typer PogChamp
Santiago_LHC: What happened to hair?
ImAventus: Watch you doing writing a memoir
dorkmo: ouch
ShakDiesel: @georgehotz, what type of keyboard do you use?
tiguent: remove obs from scene
tanoshiizo: big hair best hair
Chyeburashka: Short logan paul
twiggy_io: @shakdiesel some Yamaha
Cube_Is_Life20: is Google trends the best way to measure success in this age?
guy_ross: how late am I?
snapcs1: 5 min
Chyeburashka: George doesn't love me, he didn't let me intern at comma when i was in high school
dorkmo: a chick flick
Chyeburashka: i cried every night for 3 months
ImAventus: Long geo
shekel_gobblin: I will pay $100 for a shirt on a merch store if you personally write twitchies on a shitty white tshirt with a marker
tiguent: google trends doesn't know who I am FeelsBadMan
jamesred2313: Why isn't it lagging
shekel_gobblin:   1 in chat if you want shitty white tshirt twitchies marker merch
erichtp: so many streams lately! loving it
dorkmo: taiwan #1
ddd_dota: @georgehotz suh dawg?
Chyeburashka: @erichtp my inner 9 year old is so excited (that's when i first discovered george)
twiggy_io: Taiwan server was better
Chyeburashka: We come for the memes, not the code
sfmoose: All of it
jamesred2313: 0%
Santiago_LHC: !insta
ImAventus: I thought this was sent channel lol jk
SkillzTech: None
fourhundredtwenty: 5%
tiguent: you might as well be speaking chinese, I have no idea what ur doing LUL
ImAventus: Amsr#
Manasoiu: whip nae nae
erichtp: channel your inner criminal #thugcrowd
ImAventus: Isn't this a ASMR channel??
SkillzTech: Jk like 3/10
lefse: What happend to the dx racer? xD
OArtero: are you using a topre keyboard?
va11as: hi :)
twiggy_io: No it’s a Yamaha keyboard. That’s why it’s white
shekel_gobblin: I will pay $100 for a shirt on a merch store if you personally write twitchies on a shitty white tshirt with a marker @georgehotz
erichtp: remember kids you can code as well as george if you sit in a dx racer
dorkmo: gotta pay extra for the black keys
va11as: do you review yc applications?
Santiago_LHC: Now we are ready for Fortnite!
Cube_Is_Life20: you need pewdiepie's chair
OArtero: are you using a topre keyboard?
tiguent: instagram DansGame
jamesred2313: 6000 to 10000?
Oivccomovai: holy smokes
jamesred2313: Buying followers
erichtp: 303 more followers til 10k PogChamp
ffthgezgxjkndd: who's botting followers
hAhamza: did you get a new mic?
Chyeburashka: @georgehotz why don't you read physics papers on streams, so that we can learn to break out of the simulation together
Cube_Is_Life20: I can bot him followers
erichtp: real followers only @Cube_Is_Life20
erichtp: no fakes allowed
Cube_Is_Life20: alrighty
tiguent: 50% of instagram accounts are bots
gusfrehse: hey
gusfrehse: nice hair
ffthgezgxjkndd: 75%
Chyeburashka: "The GMO people" im fucking dead
ImAventus: What happen to your blue check???🔥🔥🔥
Chyeburashka: How do we know global warming is real?
SparksCx: global warming is fake KKona
snapcs1: Cause its obvious
Chyeburashka: obvious != science
snapcs1: Oh wow really
Chyeburashka: yeah dude
Chyeburashka: believe it or not
snapcs1: Wow thats crazy
Chyeburashka: lol
jamesred2313: Global warming is good for the environment
Chyeburashka: oh shit
data_day_life: da fuc? 2 days in a row??
snapcs1: See theres proof right there
iamaflex: He keeps changing his tmux set up
HaywoodJabroni: hello @georgehotz HeyGuys
shekel_gobblin: @georgehotz some other hacker dude on twitch right now called you out, his username is @dowright, he wants a hack battle, but to rap
HaywoodJabroni: pajaS
data_day_life: LUL
Cube_Is_Life20: Windows version of qira, when?
davidsit_site: I regretted going irl midway thru earliers stream
luhartt: me
erichtp: rap battle ytcracker
davidsit_site: windows version of qira ever?
Cube_Is_Life20: probably never tbh
HaywoodJabroni: that will never happen
Oivccomovai: how was work at facebook?
davidsit_site: that was my guess and response to your initial question @cube_is_life20
Krazykarl037: is he hacking into the matrix?
jamesred2313: Hacking your mom
joker2k999: lol
twiggy_io: Toxic
abcdefghijklmopqrstuvwxyz: pytorch or tensorflow?
xfallenchamp: Hello my dear sirs
joker2k999: Dat ipython Tho
SparksCx: chat can you explain what he is doing, just briefly
dorkmo: he coding some stuff
SparksCx: i see
erichtp: you asked for brief u got brief
twiggy_io: He’s also reading some stuff
Oivccomovai: lol
joker2k999: porting Qemu to python3(linux)
dorkmo: yeah gotta read before you code
va11as: do you review yc applications?
SparksCx: yes
Cube_Is_Life20: damn python 3 syntax
joker2k999: yea. can't stand py3
grizvok: im late FUCK
erichtp: @grizvok its only 20 minutes into the stream
twiggy_io: Like 10 minutes
joker2k999: not too late bro
TH3KILLER321: Holy moly PogChamp
grizvok: oh damn, thought it started a while ago
Chyeburashka: Why is george writing ports instead jailbreaking the simulation?
Chyeburashka: *of
joker2k999: not today. its sunday.
Chyeburashka: lol
twiggy_io: Because it would break the simulation
dorkmo: gotta port to kill god
SparksCx: lol i remember his simulation talk LuL
Chyeburashka: after that talk im highkey worried about quantum computing
grizvok: in his church you dont break the simulation on sundays
Chyeburashka: understandable
joker2k999: after the talk you were? what about b4
Chyeburashka: didnt think about the cost to the simulator
dorkmo: just lowkey worried b4
Chyeburashka: so no, not before
Chyeburashka: lol
dungeonmaster3: Does anyone know what keyboard does george use ?
joker2k999: lol
twiggy_io: Yamaha
joker2k999: everyone asks that. Honda
dorkmo: 303
grizvok: i watched the first 30 minutes of the talk so far...pretty interesting
SparksCx: just import a keyboard
joker2k999: I don't know bro.
joker2k999: its the one w/ no text. idk the name
dorkmo: Roland keyboard
Chyeburashka: im still sad george doesnt think DMT will help us break out at all
Chyeburashka: but he knows more than me, so..
erichtp: getting his keyboard dont mean you gonna type faster just get what you like lmfao
luhartt: sudo make me a sandwich
abcdefghijklmopqrstuvwxyz: tensorflow or pytorch?
joker2k999: dmt is the poor mans j/b the sim solution
use_after_free: damn didnt know you streamed PogChamp
ABuffSeagull: btw, the new thing in python 3 is to use f strings, so it would just be print(f"entry point: {obj.entry}")
erichtp: @joker2k999 crack is the way to punch up
joker2k999: I would use tensor flow. keras.
joker2k999: @luhartt you're not root.,
Chyeburashka: @joker2k999 "the poor man's JB" love it
puffnfresh: write more Coq
Chyeburashka: this chat is golden
Chyeburashka: coolest group of twitch nerds
Keyeh: hello geo and chat HeyGuys
dorkmo: sup bru
Keyeh: what u working on
mxd8: &lt;3
davidsit_site: thank you and hello. qira
Chyeburashka: porting QEMU to python3 @Keyeh
dorkmo: writing a program from flour and eggs
Chyeburashka: hot
dorkmo: and a little milk and butter
Chyeburashka: come on dorkmo i can only get so wet
puffnfresh: more Coq plz
Chyeburashka: IM SORRY
Chyeburashka: I LOVE YOU GEORGE
joker2k999: really?
puffnfresh: need some of that formally verified software
BigGucciGuap: herro
Keyeh: ty for the info guys Kappa
joker2k999: ok. so. idk wtf we're doing bro's. can't late. lol
Cube_Is_Life20: he's porting twilight?
joker2k999: *came
Chyeburashka: I love that george has "tutorial for python language pulled up"
dorkmo: the whole twilight saga
davidsit_site: no blue checkmark on Twitter. not verified code
Chyeburashka: damn david, brutal
joker2k999: LOL
abcdefghijklmopqrstuvwxyz: @georgehotz tensorflow or pytorch?
puffnfresh: oh no @davidsit_site
Oivccomovai: nobody can understand geniuses
va11as: @georgehotz do you review YC applications?
joker2k999: only geniuses understand genius
Chyeburashka: So if we understand the stream we are geniuses?
Chyeburashka: shit, better tell my math teacher
davidsit_site: id10ts
davidsit_site: or pebkac's
va11as: lol
Oivccomovai: we should change the "subscribe to pewdiepiew" thing to "follow geohot on instagram"
ffthgezgxjkndd: great music choices
SparksCx: ummm ok
Keyeh: yeah LUL
Cube_Is_Life20: @oivccomovai the printer hack?
Keyeh: its just the same riff but sped up
joker2k999: i think he has something planned that will get him to that 1mill followers.
abcdefghijklmopqrstuvwxyz: @georgehotz tensorflow or pytorch?
Chyeburashka: @joker2k999 openpilot 6
Oivccomovai: @Cube_Is_Life20 yes
joker2k999: we don't we about that stuff not he stream
joker2k999: LOL. got u
SparksCx: lol
luhartt: keras tho
joker2k999: i concur
Cube_Is_Life20: I have an AA meeting to go to, I'll be back if he's still live in 2 hours
use_after_free: you should add the tag 'science &amp; technology' to your stream, thats where programming streams usually are
Keyeh: he's typing the same rhythm of the song Pog
dorkmo: #english
Oivccomovai: thats not basic
use_after_free: gl @Cube_Is_Life20
dungeonmaster3: what is even going on.
dorkmo: do you really want to exit? (y/n)
Chyeburashka: y
use_after_free: %n
SparksCx: o
searchingforlife: @georgehotz why import print_function in python3?
twiggy_io: Backwards compatibility
Keyeh: is he writting another debugger?
Keyeh: @georgehotz were u an emo in the 2000's?
dorkmo: thats a subscriber questions bro
Keyeh: i'll try my chances
Keyeh: lmao
twiggy_io: 100% subscriber question.
use_after_free: (subscriber): Keepo
Keyeh: i might subscribe if he answers, does that count Kappa
joker2k999: what cool revEEGR tools are hot in them streets these days?
TonsUhFun: ghidra?
Chyeburashka: @Keyeh i gotchu
Chyeburashka: @georgehotz were u an emo in the 2000's?
joker2k999: omg.. isn't that bricking os's lol
Chyeburashka: ghidira?
lukihker: twitch did'n save videos that some weeks ago?i can't find the previous videos
dorkmo: check youtube
joker2k999: sup w/ some chill code music?
lukihker: all right
Caene: No lag today?
HaywoodJabroni: pajaShrugL forsenE pajaShrugR
twiggy_io: Taiwan server
glitchedoutt: global warming?
joker2k999: immmm....
dorkmo: not me :/
HaywoodJabroni: D: no
joker2k999: not?
joker2k999: call
Keyeh: a function doesn't exist?
stephenhuh: call a fn
HaywoodJabroni: calls stuff
bboc_kz: Seems to me like the write is unmapped, but I've just tuned in so what do i know Kappa
use_after_free: unwinds stack?
joker2k999: pulls men from a register
data_day_life: it gitz $ from the data bus
satire_: save registers to the stack
satire_: jumps to the function
Keyeh: PogChamp chat
ScrubLifeChoseMe: POGGERS
HaywoodJabroni: PogChamp @satire_
ScrubLifeChoseMe: PogChamp
use_after_free: Pog
bboc_kz: PogChamp
knilecrack: I thoughtt it calls from stack
youngsachi: Pogchamp
joker2k999: PogChamp
use_after_free: it pushes args on stack and then jumps to the mem addr right?
glitchedoutt: it can't write to the registers?
t_lokus: just got here, something to do with c calling standard? maybe?
Keyeh: we learnin'
use_after_free: were pleb twitch chatters we know nothing
AnAnonymousGifter: An anonymous user gifted a Tier 1 sub to satire_!
use_after_free: PogChamp
HaywoodJabroni: PogChamp @satire_
Keyeh: anonymous PogChamp
Cctrio: So you can explain what you are doing :)
joker2k999: to learnz bro
use_after_free: to learn shit like this? :p
ScrubLifeChoseMe: gotta start somewhere george :)
joker2k999: but we gotta watch it back on 1/8 the speed. lol
Oivccomovai: i'm just a fan of yours, sir
Oivccomovai: sorry
lostchange: I enjoy your thought process
Caene: I feel useless FeelsBadMan
Caene: Why am I here
joker2k999: most are prolly here for the church. lol
use_after_free: why are we here PepeHands
ScrubLifeChoseMe: clout
dorkmo: i feel like i just came into class and didnt do the homework
HaywoodJabroni: @dorkmo LuL
HyperSpectral: LUL @dorkmo
joker2k999: LOL
Caene: We should all read off of satire_'s notes LUL
use_after_free: true LUL
a_cetologist: a_cetologist subscribed with Twitch Prime.
ABuffSeagull: does ipython not have a reload file functionality? 🤔
HaywoodJabroni: forsenPrime
HaywoodJabroni: not me :D
bboc_kz: will this be on this quiz?
joker2k999: eof?
Caene: I know the answer guys, whisper me for my paypal info. Kappa
knilecrack: so is it a call stack on the end?
funcionario_net: !uptime
HaywoodJabroni: pajaS
joker2k999: overflow bro.
r1c1c: can anyone please gift me a sub, i'll be grateful eternally :)
Caene: I hate gifts DansGame
Caene: You should to
knilecrack: you are praying in wrong church @r1c1c
funcionario_net: !commands
Sandoww: what do you think about Jon Blow and his Jai programming language?
use_after_free: explain more
TonsUhFun: dude ur on another level
dorkmo: something about adding some tags to the pirntout?
Keyeh: chat is Pepega
HaywoodJabroni: pajaGa
joker2k999: loading
use_after_free: creates a stack
Caene: He's teaching PogChamp
HaywoodJabroni: PogChamp
HaywoodJabroni: NotLikeThis
thedavosfinger: Is this basic programming??shieett man,i only understand pritn()...XD
dorkmo: lol same
joker2k999: creating a lib?
dorkmo: load the stack into unicorn
Keyeh: this basic assembly programming bro
HaywoodJabroni: hes doin some crazy shit in python
thedavosfinger: is this python?
HaywoodJabroni: @thedavosfinger yea
thedavosfinger: nice
redbullwiiings: We live in a society. Don't be sheep. Always evolve. Grow. Learn. Don't sit here watching somebody else if its not helping you in anyway. Distractions are constantly being designed by for the NWO. The more distractions the less worry about a crippling government. Please teach yourselves the human mind is capable of so much more.
dorkmo: F
HaywoodJabroni: qira seems pretty awesome
wltrz: what keyboard do you use?
dorkmo: bro
Caene: @redbullwiiings 2longdidntread can you make your words into a meme gif instead?
geobitz: you gonna use qira with tesla?
use_after_free: stupid question, doesnt he need to encode your stack in little endian?
Keyeh: @redbullwiiings is this a copypasta?
Caene: Kappa
thedavosfinger: it sounds like a mechanic keyboard
use_after_free: like add a &lt; before QQQQQ
bboc_kz: is this a python web app?
glitchedoutt: He will ban you if you ask any questions about his keyboard
joker2k999: are we making a linker file
use_after_free: i thouight &lt;Q was little endian
Zipzipcekirge: corrupted stack oh no
use_after_free: maybe the default is lil endian
use_after_free: good rapper name
esence: what is this project he's working on, is it similar to IDA-Pro?
뚱인디요: It's so nice that u r streaming often these days
satire_: isnt that stuff from the kernel
satire_: or libc
Countolafs: whats a stack?
ABuffSeagull: this is making me want to fire up a Zachtronics game
GameMe: What is he writing?
뚱인디요: NO
use_after_free: ELF FeelsGoodMan
Keyeh: no
TonsUhFun: this is all wizard shit
뚱인디요: honestly, i watch ur stream all the time, but i don't get a single thing
joker2k999: sounds familiar
thedavosfinger: ez pc
뚱인디요: he makes me wanna buy mac
use_after_free: PogChamp
Keyeh: EZ
bboc_kz: PogChamp FIRST TRY
ABuffSeagull: working PogChamp
thezilion: finally
Countolafs: ez
youngsachi: PogChamp
use_after_free: i barely understand it
Keyeh: its cool as fuck tho
Caene: @georgehotz you want us to leave?
Caene: FeelsBadMan
use_after_free: not everyone knows how binaries work, let alone reversing them @georgehotz believe it or not its pretty hard for us normies LUL
뚱인디요: Is there like a tip when u get stuck?
knilecrack: where is the result from syscall?
ABuffSeagull: Oh boy, now my operating systems class will actually come in handy. I know syscalls!
knilecrack: or can you trace it?
뚱인디요: Like when i code, i get stuck and it takes me DAYS to figure out how to fix it but u just somehow magically fixes it in like 3 min
use_after_free: VoteYea
Irkanu: Subs are immune right? bogaDeal
knilecrack: when you call kernel to do stuff
geobitz: jaja
joker2k999: call to the systools.
knilecrack: rofl
joker2k999: lol
thedavosfinger: syscall is someting that calls the system..rigth??
Zipzipcekirge: low level os functions
ABuffSeagull: Goes into a protected mode and runs some system code, or something like that
joker2k999: yes subs are good.
glitchedoutt: it's a set of calls provided by the kernel to do some basic shit
use_after_free: context switch   kernel function call
knilecrack: or low lvl OS functions yes
1garo: !uptime
satire_: syscall will take whatever is in eax as argument/code to know which syscall to make right before it traps
bboc_kz: syscall calls some internal code in the kernel
akbang47: yo bro do even the the piano u pleb
뚱인디요: which ide is he using atm?
joker2k999: so were not linking qira to a web-app?
ABuffSeagull: so with this unicorn engine, are you trying to run a program just straight on the processor, with no OS/kernel?
esence: hey why don't you use Ruby for this type of stuff
ABuffSeagull: "processor" being the emulator
joker2k999: idk about unicorn
thedavosfinger: @georgehotz are you god of programming?
Zipzipcekirge: which architecture is emulated
esence: install gentoo
use_after_free: x86-64 im pretty sure @Zipzipcekirge
ABuffSeagull: but still no OS/Kernel, I'm guessing, which is really cool
뚱인디요: i wish i can take his brain and migrate it to mine
joker2k999: yup
akbang47: put ur hours in
mikeyyinspace: Jailbreaking the Simulation with George Hotz
PapaDukie: so qira gives you the assembly code and then you run that through unicorn?
ABuffSeagull: also, apparently the new hot thing for python is pipenv, which is a mixture of pip and virtualenv, and allows you to locally download and run python libraries
TonsUhFun: yeah ask george how much time he has spent using assembly.... probably a long fcknnnn time.. its not magic but hard fcknn work
akbang47: is that really a new hot thing tho
Sandoww: 2 space indentation? are you a sociopath?
ABuffSeagull: locally meaning for just that project, and not have to install it system wide with pip
Infinitelym: ooh haircut
carty711: I am so bad at reverse engineering. would you suggest practicing programming in assembly to get used to it or just continue doing reverse engineering stuff?
joker2k999: gdb
ballen_7: what is qira
joker2k999: a debugger
MorbidlyBrobese: Did @georgehotz become an Instagram model yet?
bboc_kz: wait qira saves the state of every register through every instruction?
bboc_kz: MonkaS
risky_banana: notlikethis100 @georgehotz I just watched "Jailbreaking the Simulation" and now I'm I've lost motivation for the day... WHY YOU DO THIS TO ME
risky_banana: coding
joker2k999: rant incoming?
ballen_7: what is qira for
BallEm: Mergence baby!
risky_banana: just my day job haha
use_after_free: whats the tl;dw of that @risky_banana
akbang47: could you summarize the thesis of that talk
alluxua: Machine learning for trading stocks. I am in
risky_banana: @use_after_free there is no tl;dr go watch it
joker2k999: no day job is cool. lol
use_after_free: thats a thing already @alluxua lol
Keyeh: mumbling in quantum mechanics language
risky_banana: @georgehotz I'm refractoring legacy PHP.... so yeah, nah... I dunno... I need to come up with a new project :)
wigginsfan22: how was your day george
cIvIcbooks: u ever read nick bostrom?
alluxua: I am a robot while doing my day job
P0LY: LUL
knilecrack: delete instsagram
Zipzipcekirge: im using javascript for senior project. shittiest language probably
use_after_free: is it about a privesc/jailbreak in actual physics?
risky_banana: @georgehotz well.... anyway, I liked your chat dude, got me thinking
use_after_free: i know thats been theorized before
slimydude: road to 10k
risky_banana: :)
knilecrack: rofl
joker2k999: lol.
alluxua: Gosh,that picture is so funny
hexicity1: hexicity1 subscribed with Twitch Prime.
acheesedanish00: 4 streams
acheesedanish00: wowe
thedavosfinger: @georgehotz georgehotz VS pewdiepie
joker2k999: your streams are lit bro
dorkmo: punch up
risky_banana: risky_banana subscribed at Tier 1.
akbang47: LMAO
knilecrack: :D
TonsUhFun: LUL
knilecrack: lets go
ziggyzergling: LUL
youngsachi: PogChamp
risky_banana: the riskiest banana
BallEm: PogChamp
joker2k999: lol bastards
JustAnEdtior: Do you think you will ever do CTF streams?
hexicity1: Hey George, i sent you a message on discord, is that a place to reach you viably? don't read it on stream just have a burning question for you.
joker2k999: i guess gamers do Mountain dew and coders do spinDrift
Zipzipcekirge: do you take pentest contracts?
alluxua: I want to make a million and give to someone I love. I donot need money at all
risky_banana: almost always no
bboc_kz: you're no longer working with comma ai?
joker2k999: help
joker2k999: (assistance)
TonsUhFun: difference is how they spend their time
risky_banana: if you earned the 1mil, then you're likely going to deploy it better than someone you're just giving it away to
bboc_kz: Well you can't purely make investments, a man's gotta eat!
tohsdnilb: Hookers and blow
alluxua: I just want to give my parents. They can count cash at home
wigginsfan22: what keyboard do u use
davidsit_site: I'm having a bad week. this conversation is a surprising pick me up
P0LY: lottery winners going broke?
hexicity1: I'd be more than happy coming on periscope with you. That would be a great opportunity to me. Is there any chance of setting that up sometime? I'm sick at the minute so won't bother you today, but is that something possible?
risky_banana: but hookers and blow are a staple in my diet ?
hexicity1: ohh, i see, apologies
grizvok: LOL burn
alluxua: Counting cash at home make my parents happy
P0LY: D:
davidsit_site: lol
BallEm: Boon
BallEm: Boom*
hexicity1: i was under the impression periscope was group calling, somewhat like skype
JustAnEdtior: Do you think you will ever do CTF streams?
risky_banana: @georgehotz did you watch the HBO show Silicon Valley
risky_banana: it's the best
davidsit_site: that's his life
Zipzipcekirge: you can chat using discord
Keyeh: @risky_banana i like that show too
Dieun: Hello!
k_peen: discord
alluxua: Did you guys call hookers? Just curious
risky_banana: rofl
JustAnEdtior: Do you think you will ever do CTF streams?
knilecrack: never pay for hookers
knilecrack: pussy and water always come for free
AzazelTheGoat: do you still drink that fancy tea beverage?
tohsdnilb: That's what the blow is for...
alluxua: Well, you got to pay for water
P0LY: is tea good for longevity?
risky_banana: is the sky blue
grizvok: yes tea will make you live significantly longer
cosmoz_AI: probably already answered this but why mac ?
risky_banana: WHO CARES ABOUT YOUR TEA, WE ARE LIVING IN A SIMULATION
grizvok: Kappa
davidsit_site: what about an idea that works in small form (and is a self sustaining business) but you can't yet scale hardware wise due to up front manufacturing costs?
dorkmo: pure leaf tea makes you live the longest
ethbow: why is 1080p the only quality option?
alluxua: Hey, hey, dorkmo
dorkmo: hey hey
grizvok: @davidsit_site i'd consider that a successful implementation
P0LY: I think you need to be a partner to get quality options
davidsit_site: me too. that's why I have two jobs
BallEm: Who's code is that?
AzazelTheGoat: whose drink is that
davidsit_site: but they were talking about money from other people. something that seems magical
carty711: carty711 subscribed with Twitch Prime.
use_after_free: 10 mins into the jailbreaking the simulation and i wonder if youve ever heard of agnosticism lol @georgehotz
davidsit_site: yes.
PapaDukie: @davidsit_site kickstarter
davidsit_site: thank you
Keyeh: its Pepega topic
Caene: Thank God for that.
hexicity1: Well if you don't mind me asking here: I am currently 20, at UK university doing Compsci with AI. I do a lot of data science work, in either hackathons or trying to get into Kaggle competitions. My question is essentially what advice would you give, or what steps would you take in my shoes, to get to a position that I can hand a CV in to yourself in 3 years time when I am finished university, and come to the states to work for you specifically, especially in the instance that Comma.ai is still a
AzazelTheGoat: AzazelTheGoat subscribed with Twitch Prime.
data_day_life: don't forget to ban keyboard questions
grizvok: yeah kb questions must die
AzazelTheGoat: take my twitch prime sub. you've earned it
bboc_kz: Kickstarter is a pretty efficient way to watch bad ideas flop and good ideas get stolen before enough capital is raised to bring it to market by the inventors
bboc_kz: 🤷
P0LY: smart juicers are the future 4Head
Keyeh: @hexicity1 asking for a job much
AzazelTheGoat: I want to know the name of that tea he drinks. it's the secret to his power
Zipzipcekirge: i think kickstarter is better for like almost finished products
data_day_life: LUL
hexicity1: @Keyeh im not in a position to ask for a job, thats part of the point of the question
th3_maj0r: hi guys
PapaDukie: kickstarter is good for board game ideas
dev12341: !keyboard OpieOP
aamiiiiii: aamiiiiii subscribed with Twitch Prime.
hexicity1: I want to be in a position to ask for a job, in 3 years time
tohsdnilb: No show some initiative
Phantomhive_: dude u dont even know what youll want in 3 years
tohsdnilb: Do stuff now
Keyeh: by the way elon has a nice video about that
tohsdnilb: People of earth are not patient
Irkanu: Yeah... I couldn't have imagined I'd be where I am today 3 years ago.
HyperSpectral: HyperSpectral subscribed with Twitch Prime.
hexicity1: i'm doing a lot now - atleast i feel, and its great. I'm doing a lot of software work for local companies while i'm at university and generally building my CV
joseya7: Are there any chances that you could stream basic programming for beginners?
grizvok: that isn't something he'd ever do...i think
AzazelTheGoat: I don't think he's got time for that.
un3okapi: @joseya7 does he look like a casual to you?
Zipzipcekirge: he wont stream something he already knows thats for sure
grizvok: there are so many places online already
tohsdnilb: That keyboard does not have a slow speed
hexicity1: but from people who have that experience, and look back, theres always a 'i would have done this' answer, I was hoping for something along those lines of this is what i would do in that position
Phantomhive_: idk go to some big company leak their source code then ask for a job from george
AzazelTheGoat: anyone got any opinions on the "powershell in a month of lunches" book?
hexicity1: definitely a naive question, so I apologies for the lack of initiative
tcsiwula: I c dead unicorns
Keyeh: @hexicity1 you said something about competing, what do you compete on?
un3okapi: @hexicity1 stop talking about it in twitch chat. Just send it in 3 years and follow up with taht.
aamiiiiii: Even when he does basic programming im still hella confused about whats going on but that most likely bc im only in my 3rd year of university comp sci
tohsdnilb: Think global not local
use_after_free: i just realized 'exploiting natures kernel and do a privesc to escape the simulation' is actually a valid explanaition for the fermi paradox
hexicity1: @Keyeh done a lot with Hackathons recently, locally with uni and have signed up for a couple more locally. I have been using Kaggle recently for competitions, but more just for my ownsake, haven't competed in it yet
tcsiwula: Did you hear a keyboard?
Keyeh: @hexicity1 so competitive programming or just data science stuff?
alluxua: Crack leetcode. You can get any job
aamiiiiii: can anyone give a tldr of what hes doing, just joined in :)
tcsiwula: rm -rf /
dorkmo: special ASMR keyboard keys
hexicity1: @Keyeh more data science, I wouldn't fully say thats a path I chose myself, its just where I have found the most opportunity in my area
Keyeh: @hexicity1 cool
tcsiwula: while !hungry kitty.sleep
alluxua: ML in stock trading. Then you donot need a job
hexicity1: time to invest in Bitcoin and retire i think
tcsiwula: Ya ml 401k get on it
alluxua: Yeah, I figured out how to invest in crypto. Paid some tuitions as well
P0LY: a couple years late there bud Kappa
hexicity1: @Phantomhive_ where do i know your name from btw?
Infinitelym: you read really fast
Mendacii_: You are my inspiration to learn how to code
tcsiwula: mu.mmap(&amp;khole)
aamiiiiii: georgie didn't go to university right?
tcsiwula: rm -rm /
alluxua: I think he finished CMU
tcsiwula: rm -rm / .
tcsiwula: rm -rm
tcsiwula: rm -rm /
tcsiwula: Hahahaha
tcsiwula: while bankaccount &lt; rent; type
aamiiiiii: wait like carnegie mellon university or central Michigan
blizz191: 1m2019.com
joker2k999: George be like “I can’t believe you guys don’t know how dual quantum save states work..” lol
davidsit_site: lol
tcsiwula: Core dump ur mom
th3_maj0r: rude
P0LY: what was that?
tcsiwula: jp jp all
tcsiwula: One love
aamiiiiii: Did any of you guys struggle with Calculus at university?
tcsiwula: Import
aamiiiiii: Programming no big deal but I cant fucking pass a calc class with more than a C- to save my life
tcsiwula: I failed calc three times
davidsit_site: ....
aamiiiiii: oof
dorkmo: same
dorkmo: i gave up lol
tcsiwula: Flush buffer
alluxua: You gave up what, dorkmo?
dorkmo: calculus
blizz191: calc 2 is death
hexicity1: how come he shaved the beard?
aamiiiiii: my friend is way more talented at coding than any of our friends in CS but he struggles with calc the most to the point where he might be on academic probation
tcsiwula: Seg fault
tcsiwula: You have been warned;)
aamiiiiii: im in calc 2 rn for the second time and its still ass
alluxua: Damn it, you guys should make friends with me earlier. I got 99 of all math classes ....
dorkmo: i feel like coding uses the creative writing part of the brain more than the math side sometimes
tcsiwula: lol jit in python wahooooieeeeee
aamiiiiii: I was expecting physics to suck because everyone said it was, but it was fine
litesam: !UPTIME
joker2k999: lol
dorkmo: 0000 0000 0000 0000
joker2k999: stack is suspect
litesam: @joker2k999 !uptime
aamiiiiii: is he still porting qira to python 3?
blizz191: aaa,o;;;o
aamiiiiii: is that what this is
davidsit_site: yes
tcsiwula: Ahahahaha
tcsiwula: Seg whore
aamiiiiii: what was it before
joker2k999: he said he wasn't.
Keyeh: he's doing something with unicorn
blizz191: @aamiiiiii dude same in calc2 again and in physics right now
joker2k999: idk...
blizz191: my physics proff is a fucking troll, test are two questions that combine like 6 chapters into one question
davidsit_site: wow
JonThomasK: stuff is good
aamiiiiii: oof
joker2k999: i thought we was linking qira to some web app.....
blizz191: like incline slop with friction, spring and collision in one question
hardtarget4: Stuff PogChamp
grizvok: that's what she said
aamiiiiii: is it physics 1 or 2
tcsiwula: Rwx ftw
Keyeh: @blizz191 had a lot of those in the math dep, so many trolls
aamiiiiii: oh so 1
joker2k999: physics was a bitch
aamiiiiii: luckily I did fine in physics, helped cushin the blow form calc 2
joker2k999: eegrPhysics.
blizz191: dude legit says all forces are equal and opposite but the curve is sure as hell not equal to the force downwards applied to my grade by the tests
aamiiiiii: I wonder if George passed those classes with his eyes closed if he went to university
alluxua: I will get the same keyboard. The sound of the keyboard calms me down.
joker2k999: lol
blizz191: I could see George getting hyped with philosophy classes or something
grizvok: LOL
joker2k999: he's in the club.
aamiiiiii: Hey i just subbed a bit ago
dev12341: monkaS
hexicity1: I want the CherryMx' Geohot's
blizz191: l0l
aamiiiiii: All good;) keep doing you big man
joker2k999: LOL
dev12341: PepeHands
metrix84: !uptime
aamiiiiii: I cant understand a single thing he is doing. What is qira
akaEcho: @aamiiiiii you aren't alone
joker2k999: a debugger bro.
Countolafs: a debugger of what?
alluxua: I am sorry I didnot realize keyboard is a banned word. Will not say it any more
Keyeh: k word monkaS
hardtarget4: basically a 'time traveling' debugger that he did years ago at google. Microsoft just now put this kind of functionality in windbg preview
aamiiiiii: for python or for anything, because I saw him running it on C code for the font hack
alluxua: I donot understand what he is coding, but think it is pretty cool
BallEm: Im just soaking and absorbing
aamiiiiii: interesting does that mean it logs all tests so you can see everything to debug code form the past
shtaken6939: its assembly on that right?
blizz191: why is he not using tmux anymore and is using screen?
joker2k999: its like gbd but can go in rev back up the stack
Keyeh: he is using tmux though
aamiiiiii: i think this is explaining what he is doing, makes a little sense
aamiiiiii: https://blog.ret2.io/2018/06/19/pwn2own-2018-root-cause-analysis/
blizz191: thats his screenrc tho? did he change his stmux.conf to look like screen? I think he is using screen tbh
Keyeh: one of his repos is called configuration, you might want to look into it
th3_maj0r: it's screen
blizz191: maybe its causes he is sshed in somewhere
joker2k999: into ubuntu.
th3_maj0r: yep
blizz191: aw
aamiiiiii: does anyone else here code in the terminal or is george just pro strat level
th3_maj0r: he code in vim
joker2k999: i do.
joker2k999: emacs ftw
grizvok: i do a little when ssh'd into my server but typically no
yeet20042: I code in pycharm
alluxua: It is a shame. I code in Jupyter notebook
blizz191: @aamiiiiii VIM only
yeet20042: But George codes in vim I think
yeet20042: I’m also very new
alluxua: It seems coding in Jupypter notebook got discriminated
carty711: do you have sublime open for just looking over other code?
litesam: @georgehotz you are neare 10,000 followers in instagram. Any special announcement then!!
joker2k999: yea.. its purrrdy.
shtaken6939: can someone tell us what need to learn to code like that xd
grizvok: a fuck ton.
blizz191: I use sublime if I am looking at a huge file and I want to be able to scroll through it quickly to get a feel, but writing my own code always vim
alluxua: Like what? Like geohot coding?
joker2k999: i don't think you learn to code like that bro
yeet20042: Basically coding out of the womb than doing it for how ever many years old George is
blizz191: The best part of watching george code is you know like 10% of what hes doing
joker2k999: thats why you gotta play it back at 1/8 the speed like me bro
yeet20042: Is George working on qira?
blizz191: @joker2k999 LOL thats the way to do it
aamiiiiii: wait so are you guys mainly programming in python?
aamiiiiii: for VIM
alluxua: Geohot started coding about 10 years old. And then his brain got used to the coding
shtaken6939: well if i would just understand what is he doing
joker2k999: i watch other code streams. is NOT the same.
blizz191: I use vim to code in python yes
joker2k999: but, I'm basically here for the rants. lol
blizz191: bin is the same as tab tab on a mac
shtaken6939: and why doesnt programers stream theres no streamer
grizvok: people stream programming quite a bit
joker2k999: yup.
grizvok: always at least a couple of people programming
blizz191: Not the same as george tho
joker2k999: its school season. summer tryna find a stream is a bitch...
blizz191: most mere mortals who stream programming have to think and research stuff, george just does it
dorkmo: george is the HBO premium movie package of coding streams
playfiendss: @georgehotz PogChamp How are you? What are we making?
aamiiiiii: Debugging just seems like a bitch without an IDE
aamiiiiii: I havent reached that level yet
grizvok: the kind of stuff he is debugging isn't going to be found with an ide
aamiiiiii: trueee
blizz191: hed have to debug the debugger to get the debugger to work
aamiiiiii: Xtreme coding is what they call it in the industry I believe
davidsit_site: did that earlier
Rottifanboy15: !uptime
ivylions: whats this dude sippin on
blizz191: tea?
dorkmo: spin drift water
dorkmo: brought to you by
aamiiiiii: do you guys prefer python over java? I have yet to touch python and am wondering if I should start
joker2k999: all his functions are custom, and kinda funny
blizz191: no tea sponser?
dorkmo: oh nvm
alluxua: Pure leaf tea
aamiiiiii: rather than sticking to java
th3_maj0r: ahahahaah
dorkmo: generic noname water
joker2k999: LOL. SoBs
davidsit_site: nice
IAmABeautifulButterfly: Just tuned in, what are you trying to build/fix for qira?
blizz191: they probably wanted to collaborate and not give free shit huh
yeet20042: I only know python but it works for like eveything
alluxua: Bro, just drink tap water. Save money. No chemicals
joker2k999: lol
VisionHeavy: plenty of chemicals in tap water
dorkmo: flouride
yeet20042: So I feel like it would be helpful to learn @aamiiiiii
blizz191: lol flouride big prob in utah right now
grizvok: if you are learning programming and have worked with java for a while it's probably not beneficial to switch
VisionHeavy: also chlorine
alluxua: Boil the water
aamiiiiii: Doesn't he live in LA where the chemicals outnumber the H2O in the tap water
joker2k999: uh huh... no. don't drink tap. we facility good health around here. lol
grizvok: if you are ready to learn a new language then yeah python is awesome
Quad___lol: EU tap water is fine
aamiiiiii: that makes sense! @grizvok
shtaken6939: bro is there any project based python tutorials?
blizz191: like a million
joker2k999: theres a bunch of good code camps are good but are crazy $$$
grizvok: you don't need to bootcamp to learn
shtaken6939: any link?
Rottifanboy15: holy shit these walls of texts
aamiiiiii: I struggle a lot coming up with projects to do on my own other than the ones I get assigned at university.
Quad___lol: i decided to learn chinese since its not object oriented nor functional
davidsit_site: lol
shtaken6939: ha ha
ivylions: you're gonna need to learn to search for your self my dude
Rottifanboy15: @aamiiiiii I have some projects in mind but never have the time nor the partner to work with
dorkmo: watch how george uses google
Rottifanboy15: @aamiiiiii whats your tech stack?
shtaken6939: @ivylions ik
alluxua: I can teach you Chinese. $50/ hour
joker2k999: lol good rate.
davidsit_site: no. ps3 please
Quad___lol: @alluxua i can teach you programming 100/h
davidsit_site: py3
dorkmo: i can teach openscad 10/hr
grizvok: @dorkmo indeed. even though a lot of the stuff he does is difficult to understand the way he goes about implementing the stuff is invaluable.
alluxua: Probably I code better
shtaken6939: @Quad___lol xd
blizz191: I will teach scratch for 10$ an hour
Quad___lol: or modern art for 150$
IAmABeautifulButterfly: #include &lt;sys/syscall.h&gt;
shtaken6939: no war in chat please
aamiiiiii: @Rottifanboy15 java and c
davidsit_site: @alluxua. you both should do a qira search module across memory nodes and see whose is more maintainable by George
aamiiiiii: @Rottifanboy15 what about you
Quad___lol: i decided to teach my girlfriend C   and i think we gonna break up after the next lesson
aamiiiiii: hahahha
Rottifanboy15: @aamiiiiii i do RoR, React/React Native, Node
blizz191: L0l
shtaken6939: @Rottifanboy15 web
Rottifanboy15: @aamiiiiii you should learn up on those frameworks/libraries
cryptoguys: why not use gitkraken its actually insane @georgehotz
joker2k999: damn. we had one job.
data_day_life: we did it chat!
blizz191: @aamiiiiii if you know java and c you would be fine doing anything in python
Quad___lol: gitkraken is good since all i work on is non commercial Kappa
blizz191: @IAmABeautifulButterfly This guy
alluxua: Lol, are you serious to teach girlfriend c  ?
Rottifanboy15: @aamiiiiii but in college I only do Java
anatoly1974: nice haircut @georgehotz
Quad___lol: @alluxua ye, she wanted to learn programming so lets start from the hardest one to th easiest one lmao
tauzN: BlessRNG
blizz191: @Quad___lol ya you about to be single
aamiiiiii: @Rottifanboy15 Yeah im in college right now and it has only been java and C and I have not gotten around to other languages and they have not entered any frameworks yet
alluxua: Teach her CSS. Girls like CSS
z0di4ckx: hey
Rottifanboy15: @aamiiiiii they are not gonna teach you any frameworks. You've got to learn them yourselves
davidsit_site: @aamiiiiii self educate
shtaken6939: @alluxua thats for sure
cryptoguys: don't limit your programming to college thats the worst thing you could ever do
Rottifanboy15: @aamiiiiii i bet while you are learning these frameworks, ideas will come to you
Quad___lol: she is actually really good at math and logical thinking (yes she is a girl and can be as random as PHP - the only deterministic thing in PHP is a random number generator)
grizvok: Learning C is going to do more for a programmer than learning react imo
aamiiiiii: true thats why i am trying to come up with projects to do
joker2k999: yea C is legit.
sen_lala: can you shrink the terminal please, you are covering the code
blizz191: @aamiiiiii go make a web scraper to scrape the billboard top 100 songs, then download them from youtube, you will learn a little about scraping, html requests and ffmpeg
shtaken6939: @Quad___lol is php bad bro?
cryptoguys: React is just a framework in JS correct?
Rottifanboy15: @grizvok we are already learning C and Java in college so
aamiiiiii: thats a good project idea!
shtaken6939: @blizz191 nc idea pro
Rottifanboy15: React is more a library than a framework
aamiiiiii: ill save that rn
Quad___lol: @shtaken6939 of course not! PHP is amazing if you want to be discriminated
alluxua: Do you guys leetcode?
blizz191: How i got music to play on my linux device cause no apple music
Quad___lol: languages are like races IRL, there will always be racism
Quad___lol: and PHP is the subhuman race
cryptoguys: Use any language for the right job man
cryptoguys: thats all you can do
cryptoguys: not sure why people shit on certain languages
StopitDonk: @georgehotz if you really want to learn how to program..?? im interested...
shtaken6939: @Quad___lol ha ha
cryptoguys: apparently smallTalk was supposed to be the best language
cryptoguys: yo hotz what's your thoughts on smalltalk
davidsit_site: I got a lisp
aamiiiiii: @georgehotz if you really want to learn how to program..?? im interested... RT
dorkmo: english is the best language
shtaken6939: @StopitDonk will u teach us xd
tea_em_oh_six: i gained iq points when i followed you on instagram
StopitDonk: please finish your sentence @georgehotz
davidsit_site: @stopitdonk @georgehotz repeat with subscriber status
IAmABeautifulButterfly: @georgehotz can you make your camera view slightly smaller so we can read the full vim view
cryptoguys: his camera is way too big i'd agree.
grizvok: @Rottifanboy15 I'm definitely not hating on React. Best UI library every built.
asianboychris: @georgehotz what keyboard are you using?
dorkmo: the sponsors need to have the clear product placement
joker2k999: he's in the zone.
grizvok: @Rottifanboy15 ever*
Rottifanboy15: @grizvok lol its Facebook's man
joker2k999: it takes me at least two l-theanin b4 i get there.
grizvok: @Rottifanboy15 everyone knows that lol
Rottifanboy15: yeah thats why its good
y0unghercules: Anyone know what is being built here?
PapaDukie: what is ffmpeg
joker2k999: the tower of babel...
shtaken6939: @Rottifanboy15 bro can you share ur git?
davidsit_site: qira. debugger
dorkmo: immortal murder machine
kubaaa6: What you think of terry davis? @georgehotz
grizvok: @Rottifanboy15 you play sc2?
Rottifanboy15: @shtaken6939 most of my projects are private
y0unghercules: what part of this debugger?
Quad___lol: @PapaDukie man this is a stream for programmers...when you dont know, you just ask your best friend
Rottifanboy15: @grizvok yeah i do
blizz191: @PapaDukie ffmpeg is a huge audio/vid library
grizvok: @Rottifanboy15 nice nice.
shtaken6939: @Rottifanboy15 noooooo
JustAnEdtior: u know, i dont understand anything thats happening but ur keyboard sounds nice :D
joker2k999: lol
shtaken6939: @JustAnEdtior sleep with it man
dorkmo:   " "
kubaaa6: What you think of terry davis? @georgehotz
alluxua: Same here. I donot understand either
hAhamza: awk that shit
davidsit_site: I just heard you quote David beazley
y0unghercules: command
PapaDukie: @blizz191 is it a library in the same way react is a library
y0unghercules: If you used Temple OS you woudltn need to make QIRA
Quad___lol: templeOS is the best OS... RIP Tery
y0unghercules: Temple OS is the only way out of the simulation
Quad___lol: ((they)) got him
StopitDonk: PogChamp Python to the RESCUE
blizz191: Idk react libraries but ffmpeg is pretty low level stuff so im guessing not
blizz191: RIP terry i agree tho
Flowsyn: hey guys, what program is he working on?
karelomab: George has new hair!!!!
y0unghercules: In what cases would QIRA be used in
Quad___lol: but who is gonna continue with templeOS development :(
y0unghercules: like process crashes?
davidsit_site: You?
blizz191: @Quad___lol the next person god calls
dev12341: @quad___lol the cia :(
z0di4ckx: Python is the best.
Hamled2: the jankiest macro system I've ever seen...
Quad___lol: @blizz191 right :( talking to god on 64 cores is my favorite thing :(
y0unghercules: lol
Quad___lol: @dev12341 should have run them over as he said
Hamled2: Couldn't that have been done with a map at runtime anyways @georgehotz
karelomab: 1m209.com
karelomab: 1m2019.com
y0unghercules: what would the advantage of QIRA be over strace
davidsit_site: step backwards
fa_k: /g/ wannabes in chat
jamesred2313: Why is the screen black
ziggyzergling: _ is private?
Quad___lol: @jamesred2313 screen is compiling
joker2k999: thx
davidsit_site: @ziggyzergling nothing in python is.....just convention/respect /not wanting to fuck shit up
alluxua: Geohot, donot code too late. Sweet dreams ! Bye, guys
funkacrylic: I just hosed my AirPods I the wash F
blizz191: F
hardtarget4: mine went through the washer once, they started working again as soon as they dried out
ziggyzergling: @davidsit_site I see :)
z0di4ckx: Cool
moonify: Hello chat, Are you already following George on Instagram?
aamiiiiii: Oh yes I very clearly see that and know exactly what you are talking about. I also like tracing my peas
imJesse: hows george doin
caylakyazilimci: Hi, ı need donate link
caylakyazilimci: !donate
Niiq: are u using TempleOS? if not you should
hardtarget4: rip terry a davis
abhinavneelam: does anyone understand what he's doing?
davidsit_site: can you measure syscalls in another way
Hamled2: @georgehotz could you run it on a program that you would be able to check the result of the syscall easily?
caylakyazilimci: @hardtarget4 hi, what is qira? ı little know english
Hamled2: rather than just cat
hardtarget4: a 'time traveling' debugger that he wrote years ago when he was at Google
z0di4ckx: pretty cool
aamiiiiii: did he write it for google or was he just working there at the time
imJesse: dude on the front page of reddit is wearing a comma shirt. i cant tell if its comma.ai or not. is there a white version of the comma.ai tshirt?
Hamled2: Oh are you just hijacking the true process to see to what degree you can intercept syscalls with this twilight tracer?
Hamled2: oh is twilight the new tracer you're writing ontop of unicorn
aamiiiiii: @imJesse link the post
aamiiiiii: oh wait
verymelo_: hey cutie @georgehotz
imJesse: https://old.reddit.com/r/pics/comments/b554zo/overcame_my_fear_of_going_places_by_myself_and/
aamiiiiii: its literally the 2nd post
imJesse: ye
imJesse: cant seem to find that version of the shirt on the website
tatted_Schnitzel: what is he doing?&gt;
tatted_Schnitzel: in general and atm
Cube_Is_Life20: hey guys I'm back from my AA meeting
Hamled2: I think he's working on a new tracer for his Qira analysis tool
imJesse: many people in the comments mentioning comma.ai. some shoutouts to george lol
Cube_Is_Life20: George, why python?
tatted_Schnitzel: whats the purpose of this tracer specifically?
Hamled2: I think he's building it because QEMU, the tracer he is currently using, is not building with newer versions
codinggangster: hmm I do not see Pycharm? I wonder how the code is written
esence: don't look at chat, we're dumb
aamiiiiii: ^^^
aamiiiiii: literally noone here knows whats happening other than the surface
ZerkBtw: wha tare you making?
aamiiiiii: ive watched 2 videos on timeless debuggers and still nothing
MoTeMiB: Kappa
aamiiiiii: george you said it best during the 2016 USENIX enigma presentation.. "Get up and stretch. You have been sitting for an hour"
moonify: Such hard to understand
TheFrozenTruth: they should make optimizations to convert list map to list comp internally
imJesse: wish i began learning this shit in my younger teenage years
帥帥雷: Hi georgehotz， i am a student come from Taiwan， i learn so many things from your youtube video.
esence: cute
TheLarry17: what is the point of the program he is making? what will it do?
tatted_Schnitzel: what editor is he using?
esence: he's building a simple Rails app
esence: it's Atom
tatted_Schnitzel: lol
tatted_Schnitzel: is it vi? XD
aamiiiiii: vim
VisionHeavy: its vim, not atom
aamiiiiii: and the thing he is doing is making a debugger
Caene: wooooosh
esence: it's hard to understand what's the tool w/out having any experience working w/ it
aamiiiiii: it is discribed as a timeless debugger so I assumed, currently watching the 2016 USENIX video about you explaining it
JonThomasK: hey
logicunit1: You inspire me to start doing stuff.
JonThomasK: im a nerd for knowing 0x2000197 is mmap sys call
aamiiiiii: wait I think I understand what it is now. He explains what QIRA is essentially here https://youtu.be/eGl6kpSajag?t=385
aamiiiiii: for anyone super confused
帥帥雷: BloodTrail BloodTrail BloodTrail
esence: yup, that's a good samp
esence: stamp
JonThomasK: is that a unicorn import I see? Pog
JonThomasK: those are the parameters being placed into registers preparing for a sycall yes?
IncanSilver: Hey George, huge fan. Keep up the good work. LETS GET THAT INSTA TO THE MOON BABY
小甜甜布蘭你想怎樣: Did you like to drink Mr Muscle?
karelomab: LUL clothes :D
karelomab: thanks mom
IncanSilver: ^
Elyx0: George is a fucking legend
aamiiiiii: @georgehotz Has any company picked up Qira for development or has it just been the group at CMU
jay_al97: what happend?
karelomab: SeemsGood SeemsGood
dorkmo: party1000
aamiiiiii: Will the new CEO of comm allow that? ;)
Elyx0: I had so much fun watching his talk about escaping the matrix
aamiiiiii: ah yeah I havent finished watching that yet, so far so good
Elyx0: It's a very interesting theorical ride indeed
aamiiiiii: @georgehotz did you get a degree at CMU?
TreeJayyy: @georgehotz chair upgrade?
chriws: ar u still needing follows on instagram?
aamiiiiii: how much do 10k followers cost? Will you take that as a donation?;)
karelomab: http://1m2019.com
Ishaan96: Hey george, its my first time actually catching you live!! HI!1
karelomab: oh no, cops!!!
oddtechno: BloodTrail
dorkmo: showlove69
abhinavneelam: why are you such a god programmer?
Hamled2: @georgehotz aren't bots more efficient than real organic Human followers (re: global warming)
haHAAXDDDDDD: no need to buy any bots:P just few minutes and few lines of code and this guy has his own bot
th3_maj0r: "few"
Hamled2: the real trick with bots is making them look real enough to not get kicked off the network haHAAXDDDDDD
akbang47: haHAA
th3_maj0r: writing an instagram bot must be boring as fuck
Hamled2: yeah
haHAAXDDDDDD: @th3_maj0r a joke ":D" he is typing so fast and codes this "too hard for me to understand" code so smoothly
꿀빨러: !keyborad
꿀빨러: !keyboard
SlimEconomy: !uptime
thezilion: !noexistscommands
mudowoster: !commands
aamiiiiii: think he uses an hhkb
chriws: have you ever thought in make bots with machine learning, to do thinks like organic human ? maybe it already exists
grizvok: what the fuck?
Hamled2: @georgehotz currently looking at porting your QEMU patches to work ontop of 3.1.0.... seems like they switched the disassembler to Capstone
karelomab: it does sound like hhkb
MatiGoG: !uptime
dorkmo: george is gone, lets party
th3_maj0r: he is back :(
brown_pig: george, do you know this guy: https://www.reddit.com/r/pics/comments/b554zo/overcame_my_fear_of_going_places_by_myself_and/
dorkmo: DoritosChip
dorkmo: ELF
RomanNYC: Something bugs me about how fast he does things, but then scrolling is slow as hell
Chris_YYM: hey check out the link
Vinndy: yo
joker2k999: lol. i wouldn't do it
aamiiiiii: he has a commai
Chris_YYM: it's just a guy on r/pics with your company shirt on
Vinndy: he's wearing a comma ai tshirt
aamiiiiii: shirt
joker2k999: no comma talk bro's
timetrap2e: would you ever buy a pair of off white x nike shoes??
Chris_YYM: that post has 35k upvotes
geobitz: he likes to say that
Mertonton: is it possible to pee n ppo at the same time?
nozoke: hi buddy how are u doing @georgehotz
Chris_YYM: !merch
Chris_YYM: https://comma.ai/shop/products/comma-ai-hoodie
geobitz: lmao
geobitz: we have qira
geobitz: maybe qira can tell us
Chris_YYM: what is qira
aamiiiiii: I am confused with github (noob). I have a repository with some project that I uploaded from my laptop. How do I now combine those files to current pc that has same stuff except the new folder I added to the repository from my laptop
Chris_YYM: gitignore
thezilion: how many peoples here understand this problems?
Chris_YYM: @aamiiiiii you should try gitignore
joker2k999: what problem?
thezilion: ""problems"""
jesseslco: nice haircut
Chris_YYM: hey @georgehotz if I donate 10 bucks would you sign my steam profile?
Chris_YYM: LUL
thezilion: 1m2019.com
nizero: georgehotz is it true that as a kid you made ur own motorized scooter ride it around and "fix" computers except insetad of fixing them you would break them lol
Elyx0: @thezilion He's not having control over some mapped memory on a child process it seems
nizero: lol
JonThomasK: omg i you the famous guy on instagram?
JonThomasK: are you
joker2k999: he shills fo tea
Chris_YYM: BibleThump
thezilion: how to george keeps the sanity? hm
th3_maj0r: when one day you'll be famous on instagram, will you remember your followers on twich?
Elyx0: Why do you care so much about leeching his popularity
tims_titillating_titties: did we hack reality yet?
thezilion: not needs popularity, only money to get rich.
nizero: georgehotz why u working on qira .. you gonna start writing zerodays again ? win a tesla at pwn2own ?
Hamled2: lol I'm looking at the exact same commit right now @georgehotz
joker2k999: elon musk?
JonThomasK: ^^
litesam: Did you fixed the front-end of the app&gt;
Elyx0: "why is my code not working" ?
Chris_YYM: @georgehotz just out of curiosity, what are some of the hobbies you have besides coding/hacking?
gre255: doesnt /bin/cat take an argument? try cattinng an actual file?
th3_maj0r: @Elyx0 lol
nizero: sorry, i'll follow u on instagram to make up for my error
Protoxus: @chris_yym I'm guessing (hoping), IRL shitposting
th3_maj0r: "the question is how, the question is always how"
Chris_YYM: @Protoxus lol
JonThomasK: subscribe to make up for your error
litesam: Hey, did you fixed the front-end of Qira?
thezilion: @georgehotz will not add butom for donation in your description?
Chris_YYM: guys don't forget to click on that subscribe button especially if you have twitch prime
Elyx0: @th3_maj0r Seems like a good phylosophy too but I like asking why recursively too to get to the bottom, like kids do
radino321: subscribe button hacked my computer UnSane
Chris_YYM: i have 8AM class tomorrow, why am I still watching you?
Elyx0: Can you do a quick recap in a ELI5 style of where you're at now?
Chris_YYM: !uptime
mmtaleghani: happy new hair cut :)
th3_maj0r: @Elyx0 in reality mine was just a quote from "hackers 2"
b_______________________b: @Elyx0 most likely not. These streams seem to be for archive purpose with subtle chat interaction. Stream is most likely not meant to entertain us
Axiom_Infinite: @georgehotz as someone who knows nothing about what you're doing how can i follow along on whats actually going on
ericswenson15: It’s like ninja but useful
ericswenson15: Good job
bc10000: what are you programming, i just joined
joker2k999: when i smoke week yea
Hamled2: @georgehotz you said QEMU is good codebase
joker2k999: *weed
bc10000: the purpose is to go to the 2nd life
dorkmo: sometimes i think about if what im doing will matter in 100 years
ericswenson15: True
Hamled2: @georgehotz but the do_syscall function in linux-user/syscall.c is umm... almost 5,000 lines????
risky_banana: I try not to, because then I overthink what I'm working on and then I don't do anything
ericswenson15: Same
bc10000: nothing we do in this life matters, dont get depressed now
ericswenson15: I think it matters?
ericswenson15: Reproducing matters
aPosterior: to your peepee
bc10000: lol
ericswenson15: Lol
ericswenson15: Exactly
ericswenson15: Idk
ericswenson15: No clue
joker2k999: lol read that one late...
ericswenson15: Are we the first organism to understand how we are organized?
aPosterior: I dont think we understand... we might know about it, but..
ericswenson15: We got it down for the most part
aPosterior: ye, to me that isnt understanding
ericswenson15: Not the variables, but the api yes
ericswenson15: Idk
mmtaleghani: do you usually work at nights? entire night?
ericswenson15: Is that emacs?
ericswenson15: Is it python?
ericswenson15: I found reading to be the only thing that made me better?
ericswenson15: I’m weird but 1 book &gt; 1 month of programming
litesam: Did you update the front-end of the app?
ericswenson15: Good job
ericswenson15: Good idea litesam
ericswenson15: Ok thank you
ericswenson15: Assembly code?
r00tdk: hi
ericswenson15: Lol hi
ericswenson15: I’m a nerd sorry
ericswenson15: Python god
thezilion: wow
ericswenson15: Good job
ericswenson15: Good job
dorkmo:  = is life
ericswenson15: Nice find
litesam: @ericswenson15 is a bot
th3_maj0r:    is life
ericswenson15: Ya
ericswenson15: You’re too kind
ericswenson15: I’m a terrible developer too
ericswenson15: Is that actual memory?
litesam: Yup
harmachine: harmachine subscribed at Tier 1.
litesam: Do you have any problem on the front-end?
dorkmo: https://www.youtube.com/watch?v=C_clL6evDxg
paul7115: !uptime
BigGucciGuap: !uptime
BigGucciGuap: oof no nightbot
th3_maj0r: like 6h
BigGucciGuap: not bad
dorkmo: yess
Hamled2: yeah, keep working on this
joker2k999: yea bro.
litesam: is the problem on the front end or back end??
LeVexed: world domination
aMulisha: This was a great stream @georgehotz
Ishaan96: teaching ?
BigGucciGuap: jailbreak my ps4
BigGucciGuap: Kappa
litesam: What are you gonna do after 10,000 instagram followers??
th3_maj0r: reach 990k more
kanogger: wait how long is george coding? I went to sleep to him coding and now i woke up to him coding LUL
LeVexed: that boring huh? Kappa
nanodanger7: good morning :D
th3_maj0r: like 6-7h
kanogger: thank you :D
litesam: What happened to VSCode?
th3_maj0r: ?
LeVexed: question mark
litesam: I saw him using VScode like 2 streams ago, So what happened did he stopped using it?
Mua_987410: 5:41:11
th3_maj0r: I think he just tried it
th3_maj0r: he always code in vim, at least while streaming
dorkmo: the blade years of instagram
aMulisha: are you using MAP_FIXED? @georgehotz
litesam: What is he planning after reaching 10,000 followers??
kanogger: LUL
litesam: Any rant updates?
Sylens__: woah the haircut
BigGucciGuap: im assuming the lag is on my side
th3_maj0r: yes
꿀빨러: What keyboard do you use?
dorkmo: lag goes away when you subscribe
kanogger: i can confirm that
th3_maj0r: lol
BigGucciGuap: lol dont influence twitch to add a new throttle non-subscribers feature
paul7115: how many years do I need to live to get on your level?
th3_maj0r: @꿀빨러 not allowed question pvmanNOO
litesam: @paul7115 I'd say 3 years of consistent studying hours!!
BigGucciGuap: knowing what to search on google Kappa
LeVexed: @th3_maj0r what keyboard do YOU use?
litesam: I think HHkeyboard
th3_maj0r: 5$ keyboard from ebay
you thought 920 megabits down was fast
have you tried 948 megabits up now we
are on a really big monitor right now so
there's a chance that that's going to
cause some problems if it does start to
cause problems
Oh see see what we can do about that but
there's gotta be some people in here
know each other this chain we're just
not going to do it like Oh get some tea
[Music]
alright so we have a joke at common AI
that our products are arch linux and
thank you and and and i've been saying
that we have a joke mmm that is good tea
oh the audio skipping - well yeah that's
cuz the USB controller and this thing is
crappy oh no it's not the bitrate that's
the worst part it's not the bitrate I
mean okay this will probably make the
audio better you know what all right I'm
gonna give you guys
all right right here look at this thing
this is the microphone I use for
wrapping so if this thing doesn't get
quality audio I don't know what does
except to set this up quick got into
that doohickey all right I gotta get you
started a microphone I was just going
here to sound settings that's just gonna
work here to sound settings for our
input device will choose the yeti stereo
microphone how crisp is that guys
they're crispy or what the period is
going yours almost Tesla's go oh we
don't go there how nice is that though
you don't like that you boy we've got a
yeti stereo microphone we're not
dropping friends oh that's sick no I set
it up and OBS for you guys oh did I not
I think I did
I think that's right
maybe it's not man really
desktop audio device this one just
upload your device to also that one mic
audio device down that better oh yeah
now we got that mic
how's that how is that yo-yo if that's
not the fucking Chris is Mike yo we got
a crispy Mike oh thank you thank you we
got you got a crispy Mike is that Logan
false alarm in there that's my apartment
that's right I've ran it from the club
look at our speeds up there no let me
tell you something if you guys are
having bitrate issues it's because your
internet sucks yeah we got look at that
that's solid green I got a two
millisecond ping and I got huge ups and
huge downs I said here that sucks that's
on you
we're drinking tea so weird flex but
okay some girl text me that like oh I
miss that girl um she's in New York
I'm not New York I'm in the cloud you
can see my shoes over there I got moved
by shoes
okay um no no we're just gonna try to
install our clinics we have a joke at
kama where we say our products are as
easy to use as our clinics and this is a
joke because arch linux is probably
impossible to use but we're gonna close
this out so you guys can't see my IP I'm
going to minimize that and here we are
in hyper-v oh I want to also tell you
that you guys know that I do read your
comments and I do take your feedback to
heart I have switched by Visual Studio
to dark mode I can't get fired from
common AI it's actually like impossible
unless I make stupid decisions but right
now if you control if you're both the
majority shareholder and you have board
control um there's no way barring like
legal action that somebody could take a
company away from you so I actually
can't be fuckin company I that's a fun
fact all right cool but we don't talk
about common AI on the stream we are
gonna talk about Arch Linux I let's go
maybe we should up the dip ease I think
we can make it big for a while more
jiffies
oh so much Divya sigh who likes Tippy's
alright great I we've booted up arch
linux here LS why isn't it installed Sh
oh thank you for telling me that the
return code from my control Z is 1:30 I
never need that before
let's say now you might ask why don't
you use just use Manjari or why don't
you just use Ubuntu and you guys are
missing the point the point of this
stream is to install our flakes so let's
see alright
oh I can view this installation got
online okay that that seems like it'll
be a little bit more convenient all
right now Windows sucks okay cool
alright well I could view this
installation guide online and that would
be more convenient so unfortunately
there's no way to copy out of my VM so
let's uh let's slowly type this by the
way I just want to show you guys I'm on
my happy hacking keyboard today I know
you guys love the keyboard we embrace it
I've given up trying to fight it one day
I'm gonna sell you guys keyboards we're
never gonna sell you guys keyboards must
have an Amazon link to the keyboard you
gotta click the referral link and I can
make money alright installation guys is
that it cool
alright I'm gonna put this over here
alright well this is the same
installation guide as that's alright it
doesn't look quite as easy as Ubuntu
from the live system boot-up with the
official installation it we advise to
view the FAQ okay well let's view the
FAQ what is Arch Linux you believe in
operating system should configure itself
run out of a box and include a complete
set of default software
oh well we definitely have ability and
time desire because the whole point of
this channel though the whole point the
way we loaded up hyper-v the whole point
of this channel is to do things that
aren't useful to anybody if we ever find
ourselves doing something useful to
somebody we have to reconsider what this
channel is about this channel is about
useless crap okay by the way just share
guys by the way if you want to check out
this chair so you already know that I
have this chair because you'll follow me
on instagram and if you don't follow me
this room you should I'm at
instagram.com slash George hot so you
can go to one M 2019 dot-com no we got
oh you don't want a virtual machine or
or what
now this chair actually really kind of
sucks I mean I don't think it's gonna
have the stamina to install all of arch
I can contribute to arch let's actually
try to install Archer guy
the first thing that we have to do is
verify oh this is pre installation okay
we've already done that I didn't
actually verify the signature I know
that was the first thing in the
instruction but we're already gonna skip
over that one so if that's too bad oh
well let me just set my keyboard layout
available layouts can be listed with
this incredibly convoluted LS command
Oh Oh guys which which which keyboard
like how should we use
I don't think this is important let's
see do we have the FI it looks like we
have EFI alright let's try an IP link ok
we have that Internet
do we have a pain does arts just work
like that
oh wow ok the internet actually works ok
not bad
I didn't ping Arch Linux dork I'm sorry
I didn't actually read that far
alright yeah I don't know why I've
complained about the enemy's time date
control status the NTP service is
inactive so the time is actually that
might be correct but the time zones
don't direct set NTP true all right now
we have an NTP service I don't know how
to set my time zone though can I set my
time zone I'm sure let's leave the Arch
Linux wiki for time date control for
setting my time zone here we go oh this
is very convenient I can just do time
date wow this is ehh I don't understand
people use the show list time zones hmm
but I'm in San Fran's to stand for how
do i do San Francisco they have cities
but they don't have just like Pacific
Standard Time
Oh Dawson's Creek I watch that show Luke
Lu Hart et thank you for subscribing I
really appreciate all my subscribers
okay we'll just have in Los Angeles
that's a cool place there Johnny Depp's
in Los Angeles and he's broke
but I ain't broke we don't spend our
money on stupid crap like Johnny Depp
all right oh I can also create the time
zone link manually aren't just kind of
growing on me I'm learning things about
Linux all right let's partition the
disks conveniently with our the
shittiest command-line fdisk
tool you've ever seen Oh SDA is that a
disk fdisk
- ah it's a virtual disk I hope that's
dynamically expanding and not actually
wasting my and check that hyper-v
probably Soren to memory but what about
disk respect disk
no it's tiny okay okay that's not bad I
think it gross can I assign more memory
dynamically we don't have to reboot Oh
dynamic memory oh that's sick
Wow hi every is pretty nice Microsoft's
come a long way
all right all right we like Microsoft
yeah yeah so SD VR devices that yes didi
- or partitions j al 4097 you know about
things you know why it's a nice home
because I moved out of San Francisco you
can't have nice things in San Francisco
but froze like George you know I see
this and I'm like wow I want to be rich
because when you're in San Francisco you
see this and you see people get rich and
all people do is hang but when you're
here you get rich you get nice things
that's what the cloud gets for you move
to the cloud all right so let's we're
gonna partition the disks ok well that
one ends in loop so we can ignore it all
right well we have to make the
partitions oh do we want to use LVM use
LS block is another option all right do
we want to use l vm system encryption or
raid
what do you guys think of LVMH we use
LVM someone interested in LVN mmm LVM
disk skin okay
pv create this art it looks too hard
sounds like we have to partition the
device already well arches wiki is
actually really good I'm gonna make fun
of arch less following partitions
if you efi is enabled we need an EFI do
I have you ef5
let's try hyper hyper vu EFI hmm I don't
know if it has UEFI or not settings
secure boot disabled no fotox thank you
for subscribing I've used the art wiki
before just didn't really always have
good it was all you need is two
partitions no the question is do I need
an EFI system partition or not do I have
BIOS or GPT I really just don't know you
know what let's deal with that problem
later
let's F disk dev SDA let's create a
partition nope that sets the DOS
compatibility flag don't want to do that
of course it's n to add a partition to
create a primary partition default is
one that's good that's good ok good we
have one partition now of type Linux
let's make it bootable maybe all right
it's bootable cool and now we're gonna
write the partition table to disk and
exit ok good very convenient let's make
a nice ext4 we need zxt for not riser FX
you know can you even make riser FS oh
it supports riser FSI so fun fact about
riser FS there's this guy who made it
called Hans Reiser but now he's more
famous for killing his wife he killed
his wife it's actually kind of funny
trial to read about like remember I
remember once it's 2008 when I was an
intern at Google in Boston and I go to
this flatbed bread pizza place and I'm
flap her piece is great and I'm sitting
there and I was reading on my phone
about Hans Reiser's trial contrast
created Reiser offensive
twenty years we'll give you ten to show
us where the body is and then uh she
showed me before the body was but yeah
she like bought like a book off Amazon
like the week before like how to get
away with murder and then he like took
the car seat out of this car and the
cops came he's like God just took it out
man all right enough about Hans Reiser
we're using ext4 oh we're drinking tea
we're drinking green tea yeah all right
we didn't make a swap partition should
have we made a swap partition no I've 32
gigs of RAM in this computer it's
probably fine it's like a swap file
which does basically the same thing
right let's mount the partition to mount
cool installation select the mirrors
which are defined in less is the good
one all right well I don't know why the
top listed mirror is Iran but um that's
fair guy guy gasps is that who's using
archlinux
am i on some list I'm in the cloud the
cloud has no political allegiances all
right
upend the messages to pack strap but
let's install them and base that's kind
of nice let's read about pack strapped I
don't know what the riser FS business
models look look at I'm interested in
things like that now how did the riser
FS make money name says
see their website look like
hmm rising fast $25 gets you an answer
this company managed to exist
Wow the world used to be much less
competitive did they raise money we're
going crunchbase and look up names s no
crunchbase goes back that far no all
right well I'm installing my system Oh
use a script that checks to ping to wait
am i downloading from Iran right now no
I can't download it from Iran that fast
I don't know what happens if I control
see this either Oh
select the mirrors oh wait no it really
is downloading from Iran okay we're
gonna control say it and we're gonna
we're just gonna delete Iran okay that
seems okay
hey nothing's wrong Tiran I'm just
saying it's far away oh yo no but
actually guys no serious serious thought
though my friend was like George you
know you should do I got into cooking
lately I've been cooking stuff
who wants to see a cooking wife makes a
pasta from fresh brewed coffee we'll
talk about that here but no cuz you're a
subscriber I'll answer that no Yvonne's
desperate I mean why is Elon desperate
know what you that's I should show you
all my stock portfolio as your trail on
my stock portfolio every single one of
my stocks green except for Tesla I
believed you know I believed in the
mission all right cool we pack strapped
well what's base developed we want this
this probably sounds like something we
want I want includes like GCC and stuff
let's install that now I guess we can
always install later hopefully all right
Oh Jenna fstab is that on all Linux
that's really nice cool all right now
just wow it's called arch true whatever
just normal true what's special about
arch true
can I just chew root it's like a big
wrapper script around true true oh yeah
well my new arch system I have to set
the time zone again can I copy the times
I hear from outside the chroot lower
princess I thought I said lower prices
I wanted that right it's pretty nice
Oh cuz Etsy was still outside the chroot
or something run Hardware clock that
what gets the hardware clock arch has an
Iceman page I'm already in my system wow
I really like arch you guys aren't you
sick uncommon locales I need a locale
Jeff
do I need any little cows I don't really
know what locales are I'm not gonna do
this I'm confused
[Music]
add matching entries to host there any
Etsy host now
yeah I don't know about what is what is
one I too once you why do they always
have this there that the loopback
interface but it's a distinct entry
understand when I guess both of those
will resolve that's pretty cool
creating a new a new tram if s is
usually not required set the root
password
what should the password me cool what a
password it's Bob uh we need a
bootloader oh that's great we got to get
our oh my god I can't choose all these
boot loaders hmm which one should I
install loopback yeah I see is cool
[Music]
yeah if I stop we colonel turns it to
EFI
or the bios boot partition installation
install the grub package Rob install how
do I install a package pac-man - s i386
PC I'm a little bit concerned
installation finished no error report ok
so I think we're done now right I wish
it on Mountain unmount - our Mount
reboot all right no now I don't want it
to boot into the let's just not boot
from DVD Drive let's boot from the hard
drive right
no it booted from there again okay um
turnoff settings boot from hard drive
okay we should be booting from the hard
drive now secure boot is disabled I
don't know if we need an EFI connect
alright I think I think we wanted to do
use a EFI I don't know how to actually
you know change that
we're in trouble we messed up hmm I'm
sure it's not possible to brick my
virtual machine that would that would be
it that would be a feat okay well it
doesn't boot um let's see hyper-v BIOS
food I don't know or maybe can we let's
just debug grub baby so I should be able
to just mount Jabez da one and slash
mouth
they don't have police in the cloud
Grob installed ever stay
buuut drop do I need a grub comp that I
don't have grub make config and get
robbed dot cfj okay cool grub installed
a vest yet we need EFI let's do to go
that's none that's its know a way to
resize a partition on Linux
this doesn't seem good
this doesn't seem good we messed up guys
we messed up big-time
we don't have an EFI system partition we
need to delete it and start again okay
okay let's delete it and start again
that was dumb
Wow so like legitimate guys like yeah I
messed up installing arch and now we can
like do it again that's a great arch
experience for you all right
um let's try new before you begin
dynamically expanding documents delete
the other one that we don't need anymore
[Music]
exist continue oh there we go all right
delete thanks for myspace back okay all
right guys let's try this again who's
ready for arch 2.0 okay
what crap did it have us do our install
install all right what did we do that we
didn't have to do I don't think that
system clock stuff actually mattered I
think we just have to jump right to
partitions but we're not gonna mess up
this time okay so
should we make a swap partition this
time to new partition wait primary one
oh my god it's sectors suggest to the
size on 384 megabytes plus 384 megabytes
perfect new partition primary to that
like that
alright cool I think we're good now do
we have to set the type to an efi
partition partition type change the type
partition one which of these are efi
partition oh it looks like it's just fat
that fairy tale okay cool
windows 95 fat32 do I want LBA
this is so confusing okay let's I was
married list ever get to marry system
first let's make the XT make FF mate FS
ext4 on dev FDA - and then was there
something useful here's the installation
guide format the partitions how do i
format a partition for EFI oh here we go
EF I use em info oh it has a type of I
should be able to change the time this
is kind of a challenge eyes no I change
the type and I probably did not look
hard enough to find the one that says
efi AFI yeah perfect okay now we have an
EFI that's right and we're good
proceed to format the partition make FS
dot fat F 32
dev sj1 all right I think we're good now
let's mount dev sta one on Mount Fuji
now point mount boom just don't exist
hmm can we create it or is there gonna
break something
mount or mount hoop not probably not
gonna break something
okay now we're not gonna mess up the
mirrors again no offense to Iran but
it's a little bit far away and I really
don't understand why I mean it must be
arch must be very popular in Iran and
let's pack strap again no of course I
can't copy and paste because it's at the
end and VMs for some reason despite
actually being able to send the keys
over though yeah well you know that
would be hard um see cone guts you are
an over here because if you weren't an
upir you don't
that nothing on this channel needs to be
done in fact I'll go even further with
that really nothing in life like needs
to be done I mean like wait what no no
why doesn't Groff download
no where's gruff try it again oh well I
hope you didn't want Groff cuz you can't
get Gras no no no we've not an SD a - I
swear wait did we not oh I don't think
we did I actually don't think we did
okay I think that's exactly what we
didn't do
okay well let's mount dev SDA to unmount
now let's make dir mount booth now let's
mount dev sta-1 on mount boom alright
thank you bro you you gazni are cool bro
you know things I like that let's see if
we download Groff this time we're gonna
make it to a graph okay I want to point
out that it didn't give any sensible
error at all
Oh Groff will get downloaded no problem
great he didn't give any sensible error
at all that it was at a disk space Thank
You March alright we're installing some
packages cool
the fstab is kind of important so we're
gonna generate the fstab again oh shit
we gotta do we gotta do to f stabs and i
don't like you you I DS I don't trust
them do post transaction hooks if LSU
speed up I know really like we live in
paradise
you know I live in the cloud I love to
do anything here I'm gonna do shit I sit
here drink my tea right we pack strapped
our shit
let's gen-f step is not bad I don't
actually wait I guess we did need to
mount it ok it's fine whatever that's
done um let's park chroot into mount
alright we're back into my system I
don't know why I don't get the colors
it's not as cute this time I definitely
don't care about time zones
I definitely don't care about this
exhaust time Oh we'll make a hostname
file ok you know what I'm not even do
all this stuff let's see if we can make
it boot first you might need a root
password should be Bob
now that's the store crop again tack man
- a scrub and then we're gonna go into
boots no actually I think we should just
a grub install no no don't give me this
crap again no no no no I made you an EFI
directory okay well okay well let's just
try make dir boot EFI no rmdir bootie fi
grub install efi directory equals boot
yeah five boot manager not found okay
you know what
let's exit the tree and let's try grub
install efi directory equals mountain
failed to get canonical platform of AI
yeah fi boot manager pac-man EFI boot
manager all right well let's just try
that pac-man - ass EFI boot manager
green teas drugs face oh okay all right
oh we have an EFI directory oh this is
sick oh it's like arch okay all right
okay now for the moment of truth let's
power off the system and then in
settings here I'm gonna change your
firmware Oh boots from file oh oh I
think it showed up
all right let's boo do not revert no oh
okay well now we have a boot aged easy I
need to load the kernel as a replayed
tag space adventure game I hope I need
to love the kernel first Oh obviously I
need to pick up the red key all right
load Colonel Oh Colonel help
[Laughter]
the colonel first I think I might have
known I think I might know what I did
wrong
let's just boot back in here into the
Arch Linux DVD and then let's
right-click and reset the virtual
machine reset yeah I did yeah exactly
grub made config I think that's exactly
what we have to do don't worry we're
doing the grub mate config now so
useless
all right let's mount dev as da one on
mound and now no no that's wrong
let's you about now let's mount dev SDA
two on mound then we mount dev SDA one
on mount now we go into mount boot grub
and we do boil I should probably truth
here as well arch and will do draw
config into big ok now we have a grub
configure I actually don't think we have
to reinstall grub and I just didn't read
the second thing I think this should be
ok so it's a power off well we can't
power off inside of Giroud obviously
that wouldn't make any sense at all ok
[Music]
in Iran we're gonna go here all right I
don't know why it's asking me about that
we're just gonna continue there oh yeah
let's boot arch linux your boy right
arch linux root and we'll login with our
super secret password all right that was
good
cool all right so now we have March okay
some colors on my art club our Linux
colors aliases for that okay - oh no all
right well that was fun IP link down at
zeros down Oh
so all that and it was actually made
easier on the installation because I
didn't follow the other guidelines Etsy
host name Conroy at the arch hosts
you know what I hate on TV 6 that's all
you get definitely don't even any of
that
alright well so let's my pf0 up d help
IP link Pepsi rock my PE link IP link up
oh wait
and I'm Clyde and I don't have Wi-Fi but
M plays ubuntu try this stuff try o
green tea warm nod and cold green tea
throws a drink cold tea okay well that
doesn't work
yeah so we got to get the down to up our
set network interface you know what
let's try to do this reading man pages
man IP do you think it's I peeling
Pete link 0 0 well that works but I
appealing sex at 0 up oh yeah okay now I
don't think we have an IP but I think I
can DHCP CG at 0
huh huh oh yeah fix the internet guys
alright that was fun um I don't know how
to make that come up automatically
I think that'd be kind of nice I know
they don't ship ifconfig anymore back in
my day it was called ifconfig ah the eye
appealing 7-0 up there you go
arch does our cheese system date yes it
does
well I kind of like that though like
look how there's nothing there you
bought two is like a big list of shit
this is extremely pleasant I really like
art install Z checker we installed it
did I not oh now I can install zishe
again thank you thank you you're popping
back up the stack wow that looks more
terrible
[Music]
we're using bash I would like some color
by default it's not glad to type it
every time and I know if I reboot my my
networks are gonna break I should pack
man I'm gonna look up what that does
first sync I don't know what the why
does I don't know what of the you is
upgrade let's try it
I got a new GnuPG oh that's excellent
make can't do that but I think I can now
do whatever it was in whatever it wasn't
install yeah I can pack strap no I can't
pack strap anymore your base development
cool Oh
GCC eight is a nice system the why I
sound the New Age package list I
understand yeah I know how to do that
alias but like where do I put that like
Etsy profile or something yeah should I
use a custom yeah I got a do a patch OC
file yeah arch is less tight yeah I
could put it back I see I don't know if
I'm using bash right now but this is a
good way to test
I cannot believe that this is the way
you get calling out like I need an alias
in my command
no it didn't work okay well the Bosch is
not the default shell apparently at
least it didn't execute bash or say no I
think it's bash profile I'm using this
keyboard guys interactive shell that is
not a login shell oh it's a login shell
after reading that it looks for okay
let's just move it to profile well
that's interesting to know all right
guys I don't know like we installed arch
legs it's a pretty quick stream I think
I'm pretty happy with my linux system I
have GCC I have make what else should we
do expert shell equals in basketball it
is the shell I don't actually know how
to use these just looks impossible to
use it kinda like the default one that
came with the installer but I don't know
how to get that install I three what is
I three like some new fancy window
manager I use X monad usually this is
written
tiling window manager you know it's
written see and pearl kind of disgusting
it's Richard let's call the whale and
does that work
now let's move on to pac-man - asks
Ubuntu no can't do that just know you've
on - what's C matrix that looks
ridiculous sure try Weyland I'm kind of
interested Weyland because I don't want
to use X if I don't have to wait
I don't even know if this is main arch
linux let's just see what's next general
recommendations I have to become
familiar with pac-man this looks
complicated all right let's see if we
can get Weyland to work I'm interested
in Weyland because let's just say if
hypothetically you know someone's
building a product and like Android Sox
and X Sox I don't know what conky is I
don't know what awesome w d WM is oh I
use one of these things
no I have like some I use like like yeah
Ganesh and X Mobile are a bunch of those
I don't know I set up a long time ago
and I just use it
what's a sway oh I like this
what is supercollider is that a real
thing it's written in C doesn't nothing
should be you wouldn't see any more okay
let's try this out I'm interested in
sway sway is I three for Wayland okay it
is I three like the new hotness is this
what everybody uses now
yeah
no alright alright if i three is the new
yeah I've written exponent active things
before they're pretty terrible I have
one of my github I have my
configurations all public but I mean it
might be time to reconsider those kind
of things yeah my ex monads all here
here's my exponent config that I wrote
it's not very complex yeah I use D menu
and yeah Ganesh alright next mo bar like
nothing too fancy no but I think it's
time to windows subsystem for Linux I
don't hear - it's pretty good nothing
should be written in would like to see
Whalen get set up alright let's let's
let's try this way thing compatible with
I three fonts that's cool ah wait any of
these can provide fonts note Oh fonts
okay sounds good we're gonna have to see
if I have that configured correctly
might be n but we'll try it let's go
start sway simply type sway from a TTY
so they don't use Haskell but like what
is this like custom garbage that what is
that it's not JSON it's not XML I don't
think it's ya know if it's llamo I take
back main things I said oh I can use
yeah MoU with Drupal it's like yeah my
channel doesn't have braces so I thought
make some custom crap yeah it's like
place custom DSL see you got to stop
with the custom dsls people unable to
create back-end any DRM device okay well
let's take a look
Oh erm device let's Google is ever an IP
3d except
Wow
that's pretty crazy oh maybe I can add
hardware no does that do my other VM
no bet any of that
shifty message I was gonna take forever
that's why all right let's read this way
suppose I have to tell me the error
creating no op back-end unable to create
back-end so this failed for some reason
yeah the error text is a little broken I
don't know I feel that this already
Weiland
in hyper-v does this work xorg graphical
programs can easily be run by using
deaths but I want this on Weyland
Weyland in Piper
Oh
[Music]
yeah I don't think this is possible guys
we have to do this unreal hardware yeah
we can play with i3 I think Weyland
requires basically a GPU and we don't
have a GPU but x11 will work fine if I
install yeah this I'm not exactly sure
what this is
excellent let's do that yet if there's
no accident right now if it actually
install X let's install the frame up for
driver now I think I think Whelan's not
gonna work be s PWM well this was really
unsupported no there's no GPU driver
weight SX I didn't read the knots not
launch patch man - X is she able to
enable the GPU and hyper-v settings but
we're of these settings but I can shut
down the VM of course that's gonna be a
big hassle to get my internet to work
again but
I don't think you can I think it might
be possible to pass my GPU through to
the machine but I don't even think
that's gonna do what I want
pac-man org Exodus this is to add you
just all the xorg x-men
we installed a frame buffer driver that
should install Exodus my accident now
but able to run X Oh
so after just install excellent oh yeah
here's a frame buffer shit
we don't have visa maybe we do just do
it make it so last way okay let's let's
look up the whale and architecture and
see how this works
okay there's a chance that's still
possible but it's all if we can been
able to run the program extra oh yeah
look at this high quality x11 oh I just
wanna make sure that shows up for you
guys
chef what's the music on norm usek she
put on a lot of times I just like
listening to Mac Miller chill music very
happy with Mac Miller chill music
ww-what's terminator so the problem is I
can't click your link because I'm
actually on a different computer there
[Music]
this is just too much I'm overwhelmed
I'm overwhelmed some wedeck skynyrd all
right
let's figure out how to set up my window
manager I'd like edit the X init file or
something
I have I beseech I've started I have
starred acts I do
oh wow how do I on the star tax card X
user Ben I 300k I have my 3 this is cool
you have not configured I through yet
yes generate the config please choose my
defaults modified that sounds nice
I'm unhappy hi 3 short cut keys ok
open new terminal thought I did pass
exit i3 you passed the exit shortcut
this will exit i3 I think my terminals
just not installed by default oh yeah
yeah I know it's that's the first thing
I did actually I like that two charts X
term but I installed X term didn't I
tells me oh I have to install ITRI
sensible terminal you don't have been
nice if arch like install that for me
well that's not gonna work
how do I install sensible terminan term
Turman
man I'm very sensible oh here we go
wait I three sensible terminals should
be a script X message command not found
for trustees you X term which doesn't
work it tries to send an X message which
is command not found pac-man - s X
message can't do that
ah here we go
but that's not the problem well okay
actually a solution for this is that but
not for that reason our xvt oh yeah all
right all right for my final trick will
install Google Chrome a little call
today pac-man - ask Google Chrome he
didn't think that would work
pac-man search search for a package that
contains this file or chromium is it
coming
perfect
I appreciate that I appreciate that as
chromium guys I like Arch Linux no I
don't want chrome Yant chromium great
this is falling right now alright now
how do I launch something what are the
other was my i3 shortcuts I think I'm
gonna switch to I through you guys open
application launcher demon you would I
guess I don't have a D menu pac-man - as
you menu that did not do what I wanted
just killed that window
oh no that changed they he okay D menu
is D oh there we go
perfect Romeo mm-hmm where's chromium is
it loading check H top
I love how few things there are I don't
like this choice of color scheme though
yeah Wow we can't run his route fine
user add add user of course they don't
have any easy one
use your add our adding user install
Microsoft edge it is based on oh wow are
they kidding
that looks so difficult user add user
add let's call these wet su web Romeo
trace breakpoint trap
Oh
cannot open display all right well
that's a different problem why can't you
open the display I understand I know it
no protocol specified mean even I don't
think it's that I mean we can try this I
just don't think that's the right
display oh you know what it probably has
to do with so far test like an X term
here okay it loads up X term what if I
sue web and I Ted X term ah the problem
is who owns the cookie yeah yeah the
Rubio's is controlling me the X server
but how do you get around mass X server
user
you're on arch linux stuff okay I mean
maybe just works I don't know there's a
command to quit but I don't know it I
three cheat sheet guys I love Arch Linux
I'm gonna switch I'm gonna start using
Arch Linux at work yes exit ID or if I
see web here and then I start axe user
bin I think do not work
permission denied
what permission was denied you know what
I have a new idea what do you say
oh no sandbox you say Oh perfect
there we go yeah you gotta get well no
all right let's actually learn about why
this doesn't work cuz I'm interested
our size is best Linux guys look how
little stuff there is here
that's so pleasant so how does house ex
work why can't
let's try s trace next term or not a
vest race sock it okay so it's just
access to reiax authority okay so if I
just know but I should have at least
executed okay oh no that doesn't work
how does it even know the name root X
authority but it should be able to read
it I don't know what I mean
you know what that'll fix it a different
problem
no yeah access permission tonight what
Oh Sam Sam
there we go now try it just to make oh
yeah now we even have a sandbox guys
nope that's not what I wanted to do cool
let's just learn some sign a few I three
yeah yeah it says oh no root we got
sandbox don't worry it's high quality
[Music]
no I messed up again
tabbed default stacking I don't know
it's kind of it's kind of hard all right
guys all Yuri was told him okay now I'm
that temple OS of you for another stream
you don't forget clone chromium won't be
here all night
poor chromium do we poly see these days
well at will see let's see if you guys
appreciated the Arch Linux stream maybe
we'll do the temple OS stream it's 11
o'clock though it's my bedtime you know
in the cloud everything everyone goes to
bed early I donno Firefox iam is cooking
stream maybe soon it's Firefox iam a
real thing let's google it inside my
chrome in here
well Firefox iam well it's kind of a
real oh don't tell me Firefox is gonna
start using the chrome codebase - okay
that would just no that's too much we
can't head on that I'm not gonna switch
to i3 I think we're just a codex monad
just cuz I don't know how to like resize
mode oh I had to use them
no CX Mona lets me do that without I'm
gonna like
wait how come I can't oh that is
workspace one no I can move this window
too
okay that's the same as exponent no
that's actually pretty nice um q tile if
it's written in Python it definitely
don't want to use it cuz it's probably
really slow but sure maybe it doesn't
matter this is interesting
I do like things written in Python I
just put the Python was fast I wish
somebody would write like fast Python
how do I be resizing without touching
the mouse tell me how I do that
awesome WM yeah people talk about this
one
what's it written in is written in C as
well what's written in Lua
what is this CTF you guys is talking
about
[Music]
resizing oh I have to configure it you
can't do it by default window with the
board I free enter resize mode oh and to
resize mode with fat and then use the
arrow keys that's not bad
okay Oh actually I almost like that
better than exponents well that's pretty
nice
hmm okay that's not bad
no no I don't mind guys I never change
the config of anything because then I'm
always gonna have to change the config I
try to use the configs as basic as
possible I learn how to use the tools
[Music]
basic them with them you wanna know yeah
I can help poor children Uganda let's
learn how to do that
never mind I'm not showing through
you've got children
[Music]
how do your ex resource now for colors I
don't know what if that is oh yeah be
nice type colors in these terminals Wow
oh my god those colors are terrible all
right whatever
well whatever that's that's our fun with
Arch Linux tonight these colors are
truly atrocious though I like i3 how I
close that window that's the exponent
shortcut to do it check it I three four
windows toggle focus that does focus
right
keep locking my window because I use the
windows key for that mod shift Q oh okay
oh you know what exponent does when you
mod shift q it restarts X monad it's mod
shift
see you next monad - uh why do I still
have a window still why did I just
commit outright - Arch Linux you think
if I committed to Arch Linux we could
have streamed tonight
we can't sway it's a tragedy
go from here yeah oh well unable to drop
route those colors are atrocious we
tried we tried zwei zwei didn't work
you know we're streaming this route on
my on my tastes DVM you guys can pone
all this delicious Oh sign into cold
your Google account no thank you
what about Jen - no who cares arch
arches see the arch philosophy aligns
very nicely with the philosophy of this
twitch channel we don't do things
because they're easy we do them because
they're useless
you want to log into this don't give me
an IP at a port well you mean I'd be in
a porting some good they should actually
a good Jen to me I don't follow the
memes of the kids these days now that I
know that port it's on mine I think
that's a one-way pipe to so much if that
actually works
try it look I listen on what oh do I
want new netcat or OpenBSD netcat I like
these bows actually that's actually a
really cool distinction I really like
Arch Linux that just work if I 5 bash
like that no it doesn't know because
it's not it's not an interactive mode
TCK Oh cuz it's oh because it's uh yeah
you know I'm like Maria shelf it's a
fake shelf that she's neck hat oh cool
what's poly bar
[Music]
what's or
just Arch Linux that's cool
arch thanks use your repository that
make sense
implement something in Python they're
probably good but when I call them
pythons night reinstall our clinics oh I
don't even have to use the arrow keys I
can also just use J and K well that's K
it's not really understand wait what
semicolon
okay those are weird bindings but I'm
whatever you're learning here's a
William you I thank you for watching my
stream tonight we'll take one last
question if it's good
one last question okay and the stream
when you question oh yeah dolphins for
we is that the question I don't know
about the church guys look I leave on
the cloud now I'm a happy person so I
look happy
that's a great question do I have a
Roomba and the answer is no you
shouldn't buy a Roomba you should buy a
neato because they're way better than
Roombas but you shouldn't actually buy a
neato either you should buy a Swiffer
Sweeper because they're way better than
vacuums as for where I see myself in ten
years that's gonna have to wait till in
extreme thank you guys for joining me
tonight
we installed Arch Linux right here live
in front of all of you we used our
beautiful fresh to death Yeti microphone
please click the Amazon affiliate link
in the description on the guy that was
on affiliate link we used a happy
hacking keyboard too and as soon as I
get that affiliate link I'm gonna be mad
rich but right now if you guys to just
subscribe to my channel because I only
do these streams to make money that's
not actually true I wish that was true
but like if I did these streams to make
money I wouldn't live in this beautiful
cloud got a mouse from a Razer synapse
the Razer DeathAdder elite Mouse nice
nice Mouse guys always you're asking
because they're always asking you know
I'm showing you the keyboard I'm showing
you the mouse
Yeti microphone all right thank you Tom
what sweatshirt oh I don't know man this
girl's like George you know what I
really I wanna I want to cultivate this
look where I want poor people to think
I'm poor but rich people to think I'm
rich so that's kind of a look I'm going
for now we've got new rap songs oh yo
know I've actually been writing
something that I think you guys would
appreciate maybe maybe we can we can
preview a little bit of verse oh yeah
it's like in 2020 there's about to be a
recognized part of me for stepping in
hello from San Diego I got out the bay
before the house a car come check in and
the big bad wolf come in to blow that
shit away doe all right working on a
song we're working on the song you know
you know we got we got like we got like
a middle verse like you know you see I
click B got the email telling me to
message Pattie
you see I click the link you see a
message Pattie but what you don't see is
how much more I hate you you went from
idealistic dreamers to narcissistic
schemers bitch the wolf is coming better
check who's in the mirror with some with
some rappers idealistic dreamers and
narcissistic schemers I want to work I
want to work on the album
in the album III that's definitely it
for this dream that's definitely that's
that's more than it for this dream nah
you can't smoke weed in this cloud it's
not allowed it's not my lease agreement
skeptical I'm glad you just got here I
appreciate you subscribing to I
appreciate your subscribers that make
these streams possible
can I turn sideways now I can't do that
all right later guys bye
oh I gotta set the title I didn't do
[Music]
counter fact Oh regret memorization
mostly basic programming I know y'all
like basic programming
you're watching an app thank you I
really appreciate it when you guys watch
ads and subscribe I mean I do want to
make all my money from Instagram in the
future but at least for now you
subscribe to me on twitch is great but
make sure if you haven't already go
follow me uh after a child on Instagram
that's trying to set guy from Instagram
okay so we still have zero viewers I
don't know watch which isn't updating
but I see that we have people in the
chat so let's get started so
counterfactual regret minimize age you
have um so a lot of games that have been
solved in AI you take like checkers
chess go these are what's known as
perfect information games meaning they
all the state is visible there's no
there's no hidden state in the game and
all of those games are fairly Markovian
meaning you don't need to track lots of
state from previous so like the move
that someone took five moves ago if you
know the board stay its independent of
that move so it's a Markovian when you
take imperfect information games like
poker the actions that somebody takes
throughout the game gives you insight
into what their cards might be so we
have this algorithm called
counterfactual regret minimization
that's what everyone's using these days
I really don't know that much about it
um autosave failed
oh it's cuz I cleared my shit leave page
okay we need the toke and that's fine
cool so now we can say if this notebook
won't be working here in this notebook
there's an eye Python notebook yeah
right no we don't have people um I also
don't like that I can't see I can see
now yeah follow me on is Joe gallo go
seriously tell people follow me on
Instagram shelf my Instagram I want half
a million followers by the end of the
year and then that's all know I'm
Instagram famous okay regret magic
players reach equilibrium play by
tracking regrets for past place making
future plays proportional to positive
regret so you have this concept of
regret which is they talk about in
rock-paper-scissors means like look if
you play rock and your opponent played
paper you regret you regret playing rock
you regret not playing scissors you also
regret not playing pay you really regret
not playing scissors even more so they
have a worked example here usually it's
probably best to start at these examples
um so they talk a bit about Nash
equilibriums something that up on
Kapadia because if you don't get the
definition right it's kind of annoying
[Music]
each player is assumed game by chain
alone strategy so you guys know what the
Nash equilibrium is in
rock-paper-scissors
it's a mixed equilibrium meaning that in
order to play perfect
rock-paper-scissors you have to play
rock paper and scissors each with equal
probability because if you did it with a
different probability and you had like a
fixed strategy like here they even talk
about an opponent strategy which looks
like it plays Rock forty percent of the
time and paper and scissors 30% of the
time each that is not a good strategy
because the correct counter play
strategy that if you knew that was
exactly your opponent strategy
I think the correct counterplay strategy
would be always paper but that's also an
exploitable strategy thank you for
subscribing Lu Hart welcome to my
Twitter so that'd be it that'd be an
exploitable strategy so let's let's go
through this example regret matching
selects actions in proportion to
positive regrets of not having chosen in
the past copying all positive regrets
and some of them let's just stupidly
implement us get strategy so we have
this thing called normalizing some so
they use stupid C++ which is a really
bad choice I'm not sure I have to do
that I could also do NP double zeros
there I don't worry about that okay so
regret some strategy strategy some and
then the opponent strategy which looks
obviously like just probabilities of
I've acted right we don't you need those
stupid definitions but we know that
they're wrong paper and scissors
respective cool link to paper it's
called an introduction to counterfactual
regret minimization you could just
Google that I don't know it's all my
yeah there you go so I'm posted that Oh
excellent you posted the link to paper
you didn't ask cool thank you yeah good
someone give that guy a twitch cookie
okay I'm sorry let's look at what this
code isn't doing
okay so it looks like another way to
write this is just strategy equals NP
clip notice how this is actually the
same thing or actually really just NP
dah dah we want a maximum grab some zero
and then on the lighting some equals NP
dots on strategy
so I'm just copying this code rewriting
in Python gonna see we toast so coding a
Python 3 here so I can just do that and
[Music]
start right strategy right cool
all right see what this does he's gonna
get our strategy for our purposes so
because it was zero this stuff didn't
happen I really cool so get current
mixed strategy to regret matching so it
really just seems like we got rid of all
the negative regrets then normalized
that shit and if there wasn't any
normalization strategy we just assigned
them all equally which I could probably
write that a little bit cleaner ooh
face to the bottom-left it's on the
bottom left Oh is my face covering the
code you mean hold up here better I'll
move this down here then we'll increase
the chilling size more shilling for the
Instagram cool and I'll remember to not
use that that corner why no more of them
just two notebooks today I still use
them guess we're learning something
right I think the best way to learn is
called learn CFR it's my notebook over
here it's in a web browser
no it's Python 3 there's pretty nice
alright
mmm okay some readers might be idiots
and not know what an if statement is
normalizing some could be non-positive
such cases who make the Uniform probably
cumulated strategies I return Kevin so
strategy one could select an action
according to the probabilities yep
that's fine there's like a numpy thing
to do that I don't know
right now somebody could look it up
okay so okay alia get action so we'll
just write that there's a cuter way to
write this get action I think so get
action with respect to a strategy so I
think you just do like MP dot come some
strategy Shh numpy bisect here search
sorted yes this we do random random
random over here I know that's why my
faces and I'm not random is zero to one
uniform from zero to one I want
something they're just gonna do uniform
from zero to one which i think is yeah
return the next random floating-point
number they don't actually talk about
whether it's uniform why do you need to
solve imperfect info game as well isn't
the world an imperfect information game
not make an Instagram box guys we're
gonna fill those legitimate real social
following by the way if anyone hope that
works for Facebook you know I'd love if
you could get me verified give you my
bro will go out to the club together
let's try it
MP dot search sorted and because I'm
strategy should be this so this is
strategy so I'm actually increasing it
is okay whatever
yeah so if we do get action to zero zero
let's just let's just test this quickly
Ryan range 100 equals
say equals this hundred just just like
let's like do a sanity check and do like
lots were today okay cool so it's about
130 each which is right there now if
you're playing against at opponent yet
charge I don't know what the charge is
I'll go do that but what I could do that
right now okay cool that's about that's
about random right actually gonna play
was on cool let's just see like with the
variances is kind of your variance it's
kind of cute right
don't we love plot had plots sorted this
guy taught me this and I was like man
that's a good trick for if you don't
remember what PLT dot hist shit you know
that I get cool with the building blocks
in place we can now construct our
training algorithm
I do kind of like my one-liner look I
can put random dot random there though
that may still be a one-liner oh how
nice would that be uh make money selling
ups I know yo no mention in that shit
all right where were we train get the
grip matched mixed strategy actions
compute action utilities accumulate
action regrets okay well that sounds
easy enough
[Music]
follow me mr. Graham guys forgiven
number of iterations okay so remember
our opponent is gonna play rock 40% of
the time so I think the strategy should
converge to always pape well we did
always paper if we played always paper
against the strategy we'd have a 30% tie
rate of 30 percent loss rate and a 40
percent win rate which i think is the
best you can do
okay we're writing a fucking Rock Paper
Scissors bot I think you can follow this
but please follow me on instagram
compute the utility
let's just let's just write a quick
funky called value so if zero is rock
now let's just write that this isn't
this isn't genius shit we're writing a
rock-paper-scissors bot
don't be noobs now thank you thank you
please promote my Instagram if you want
me to do more streams it's not even
about subscribing a twitch anymore I do
really appreciate the subscriptions but
I appreciate more increasing my
Instagram followers my goal is to have a
million by the end of the year okay so
if value from the perspective of P 1 P 2
if P 1 equals equals wrong and P 2 okay
so first off P 1 equals equals T 2
retiring 0 because there's no value for
player 1 that's a tie if player 1 played
raw and play or 2 played scissors we
know scissors smashes rock there's
probably like a smart way to just like
use the fact these the numbers I gave it
no no a million Instagram how would i
monetize Instagram followers I don't
know yet but really guys it's about you
know we're not gonna go into that right
now okay player 1 plays scissors and I
caught paper and paper covers rock
there's some ways to do this is like
mods and shit but like do you want to
think about that right now I know I
don't cool um so let's just do this
let's play 100 rounds of let's play
thousand rounds of rock-paper-scissors
don't be cheap and then let's see what
my value is 41 28 31 negative 23 this
probably isn't enough to get a real
sampling oh let's play 100 rounds of 10
and also this is a noob shit it's
probably a magical way to do this with
like range estimators and stuff they
talk about this stuff on the paper but
you know I'm an idiot so
I think I don't know maybe fit a
Gaussian to that let's I mean that's
pretty small so I don't think we're
exploiting at all
yeah so after playing all those games of
rock-paper-scissors yeah we're not we're
not exploiting at all but just let's uh
let's try for a sec let's try that
strategy that I was talking about and
see what value we can get so that
strategy would be always paper so never
rock always pay for a never scissors
[Music]
no cheetah yes that doesn't matter
actually you really shouldn't do this I
always run into problems like NP copy
okay look now we're getting an average
value of 10 see this value of 10 so
we're exploiting him by always playing
paper that's right um please follow me
on instagram if you haven't really
follow me in Instagram you know I love
Instagram power cycle okay now of course
I hand coded that strategy so let's see
if we can use counterfactual regret
minimization to learn that strategy
because we want to do machine learning
this is a machine learning channel for
those who just followed we're coding
rock paper scissors agents um so my
opponent is pretty stupid plays rock 40%
of the time paper 30% of time and
scissors 30% of time so it seems like we
can get 10 value out of him 10 out of
100 so we're getting we're getting 10 I
don't know this is like proper way to
talk about this but let me tell you why
I'm interested in this stuff I know you
guys like the rants there's money in
imperfect information games there's no
money as perfect information gives in
here's why when you play chess against
somebody it's quick to tell who's who's
good at chess and who's bad at chess
right you're not gonna you're not gonna
play somebody against chess for money
but my chassis laws like 1400 all right
if you have a lower low if you have like
a you know thousand T low I'm gonna beat
you if you have an 1800 eat long you're
gonna be me there's no reason that we
need to wager on this but with imperfect
information games there's much more
variance and it's much easier for people
to wrongly estimate how good they are
with respect to somebody else so if we
learn how to play imperfect information
games we can make money and then with
money we can buy expensive shit like
Gucci and Fendi and Prada and and
javante and and the you know st. Laurent
all those rich people brands and then we
can post that on my Instagram so I
become Instagram famous I'm satisfied
with you but you know really what we got
to do is convert you guys into an
Instagram audience that will go with
that you got to take high quality photos
I know I know I know
look look we're looking into that we're
looking into that you don't want we're
gonna get money we're gonna pay a guy
he's gonna be my Instagram guy and he's
gonna be a millions of followers okay oh
you missed the old rants I know you
missed the aldryn that was a different
there was a different character that was
George Hotz the common I see you and I
work in research and I do this shit all
day I'm very satisfied with my twitchy's
oh no guys it's a weird year it's 2019
its sanity 2019 everything's changing
you got to keep up with the times be
left behind okay
golden keyboard
[Music]
where is action utilities initial oh
it's initialized okay all right so let's
just write whoops what did that do
it's not that long just try to write
this training iterations
[Music]
no no guys we're not living in the past
you know we're not talking about how
like this was done manner this was done
that this is the future we're gonna live
in the future
futures crazy place it's just I'm just
cleaning a colorful bit okay ah we want
to say action utility oh yeah can I just
do that that's the same thing as
actually doing the the tuple with one
right so that's equivalent to that yes
it is oh cool
get rid of characters save characters
save typing time be faster next time
coding I know they're shorter you can
write your code number code is written
you write code in order to be read not
to be yeah I know I know
now what programming today I mean
sometimes I just come on the stream
because you guys are like I like talking
out loud and when I talk to myself I
just seem weird but when I talk to I'm
talking to 200 people right now it's
like a lecture Broce the future really
is a crazy place it's Merritt it's hard
to do things watching yourself and
marina
um no no I'm the cock files are kind of
over you can see you can check my github
I implemented a lot of I just want to
like a number theory textbook
maybe they implemented like 20 proofs
from it it's good tools aren't really
good enough yet and I mean it's a
company idea right like you could take a
company you can make you could make good
tools for that kind of programming I
mean a really cool thing about that kind
of programming is you can't write bugs
but even with the amount of bugs I write
in Python I'm still more productive in
Python than it would be in a language
like cock train
[Music]
I don't really understand this okay
other action equals 2 then 0 gassy just
like wrap it round see that you see what
they're doing there it's like wrap
around I'll just copy is fine
basically if it's to the next one zero
and I guess this is for for
[Music]
rock-paper-scissors
I don't just copy the normal thing to do
it more
no comedy knees are ultra rare exclusive
March you could have bought them at one
point but you know what they say get an
early get rich getting late get fucked
cumulate action we're grads alright so
we're back to this idea of regrets some
actually isn't it is used here well it's
a strategy okay it's a strategy if I
have a strategy okay so my regret equals
[Music]
the action utility minus the action
utility of my action got some plus
equals notice how they're doing this all
with four loops so you don't really have
to do four loops thank you thank you 24
new followers and it's to keep the
followers coming guys this is a follower
shell stream I love you all if you can
get me followers because we need
followers them we need to be in coma
Instagram lover how does dream like two
weeks ago I was lying in bed it was this
girl it smoked a bit of weed and I was
just like ranting for an hour about how
I'm gonna be an Instagram celebrity and
then never hear the secret you know it's
like that shit when you like say
something it becomes true what am i
starting a new company yeah that's a
great question right um you say some a
lot of times and it becomes true well
that's how I felt with this look every
scams are over guys scams are over the
best thing is just be authentic and be
real
they're not gonna copyright me for this
oh man that is a great song if you guys
haven't heard it
[Music]
if I turn what if they're right
what if I ruin Broadway by being in this
ad tonight I see what you're saying
and I make you this pact I will never
make again so long
[Music]
that way the rainbow taste the rainbow
here the full cast recording one Spotify
Michael last week you expressed some
anxiety about storing in skittles
commercial the Broadway musical yes I
have been having some doubts I mean I
don't really do ads well it wouldn't be
stressful to be seen by millions of
people in the big game no just to be
clear the ad won't be on the actual game
people will buy takes much longer but no
there's a whole album it's called
skittles advertising the musical um it
really is great no I wasn't getting the
pie I was taking a piss real shit okay
for each individual iteration we're
training our regrets may be temporarily
skewed in such way an influencer
strategy is a- regrets um you know
chosen converges to a minimal regret
strategy is the average strategy across
all iterations is this it
I think I can use value here
and then yeah okay there was the action
energy you see you brethren thank you
for watching ten Prince
this is actually a really stupid way to
write this okay see you see what it's
doing right like it's kind of annoying
this is a stupid alright this I can just
say other action plus 1 mod num actions
these guys are noobs and I want to
confirm that mod and pythons way to like
minus 1 mod gnome actions goats - I
understand they even wrote a paragraph
introducing inline if statements like I
know the guy like discovered in line of
statements and you know I get excited
now there's the thing about these kind
of research people like some of them are
absolute geniuses and I understand math
I never will but then they like code and
they came Oh strategy some plus equals
strategy
small right
that's just not right
how did strategy some become three what
oh okay
so here are my regrets I regret playing
rock not at all cuz I don't understand
why that's negative that's weird
cumulate action regrets
I mean looks like we're close I just
need to write this last function yet
average strategy so what we're expecting
to get and we can run it down here once
we have a strategy is a value of about
when I delete that I think the optimal
strategy against a agent we should use
the right word for this an agent with a
stationary distribution that favors
wrong is to always play paper so that
strategy is that when you encode it in
strategy for him and this gives me a
mean value of 10 so I think that's the
best we can do so that's what we're
hoping for when we run this at the end
you know it's always nice to write your
evaluator
to my misspelled average okay equals NP
zeroes please uh follow me on Instagram
you know just that's my real dream in
life okay wait this looks like denticles
to get strategy
great it's just identical to get
strategy I think normalizing sums just a
sum the normal sum is greater than zero
sure oh well they're not doing this zero
thing it just doesn't make sense I don't
really understand what this does but I
think that it's just that if I take that
line away negative regrets up well that
sounds are highly okay yeah this this is
computer in a manner similar to get
strategy without the need to be
concerned negative values okay I mean
again I don't really understand that but
okay so let's train for a lot of ethics
and then
okay so strategy is global thing that I
don't really have anywhere Oh
so this is strategy some we don't have
that at all strategy I don't even
understand like I don't know what this
is used for period because it's used
here like like that used to be a global
variable let's just make sure sometimes
you restart your notebooks make sure you
don't have just a little bit hanging
around that you're using
[Music]
oh no strategy just come to Uncle I can
treat you today okay so this key what's
not working in that one strategy some
use strategy some I don't know it's
basic okay let's get the average
strategy and see what we have local
variable strategy reference before her
oh my god I hate when stupid numpy does
this put this up in here I just have one
block that I copy set print options per
se it's true
okay now it looks correct I think the
strategy is exactly right so almost
never play Rock almost always play paper
and almost ever play scissors so if we
just replace this with strategy equals
get averaged strategy there we go ten
point two okay we just learned the
perfect strategy you think this is basic
do you understand this algorithm do you
honestly can you honestly tell me you
understand what this what this algorithm
is I don't know just kind of copied you
from this shit now let's see if we can
try to understand it okay so like this
is poorly written because the others
accumulates like this shouldn't be here
they should pass in regrets um let's
refactor this
move these down into train
this is better way to code because you
want to stick you wanna stick Global's
everywhere global some pretty nasty
especially in articles you write too
it's also doesn't eject me gnome actions
I could just say a strategy that shapes
of the CRL there's also ones like closer
to the same thing
is that really small right like it
doesn't look spelled right strat eg I
guess it is right
I mean asked repeatedly what's your
problem
I don't know op time come in all that
shit is
that's right I don't even know what
average strategy was it's just a stupid
thing they used in there it's fine so
they really are you see much simpler
that is like once you write things that
aren't terrible you shouldn't do that
you see the danger there so let's just
learn em get our coffee in there start
let's see if it all runs no mansions is
not defined well stupid race condition
alright alright then of course we train
it for more don't the verge better how
am I gonna draw that little plot as well
get strategy requires one positional
argument strategy cool so it always
picks paper it's a paper his action one
I am so rock paper scissors paper Swan
this isn't in blue which starts that one
all hey Lu Italy okay guys I think we
learned about counterfactual
urbanization neither I will stream in
our let's go through and make sure we
actually understand what's codes doing
okay
so qu
late current strategy based on regrets
[Music]
select my and Poland's
action
okay let's so I mean this is the rules
of rock-paper-scissors here the action
utility of the other action so if we
yeah you always want to do the next one
so we can say like if P plus one loss
that's covered by so we want to do this
MA remember how I said we could do is
cute thing with a mod equals p2 so paper
we want if player two pays paper we want
to play the previous action which is
rock so that'll clean up that code now
if we were doing this in Cocke you know
be kind of beautiful because we could
confirm those two things are equivalent
like I wish it was just a way to just do
that in Python right leg over the same
function we just say those two functions
are equivalent
[Music]
eight that's pathetic why do you do so
badly call variance guys even if you're
you know playing an advantage you can
still lose here's gotta remember that
how they coded in Java
okay the average strategies computer
regret matching in other words is this
the best respond to their strategy you
might not be obvious because always a
pure it might not be obvious but there's
always a pure best response strategy to
any mix strategy I mean I guess alright
cuz even if you have the correct mixed
strategy of rock-paper-scissors which is
one-third one-third one-third I can play
I can play always Rock and it'll do the
same there's no agent that'll play
against that better the only difference
is exploitability they go into this
stuff called local best response Oh
modified so both players use your grant
matching should we do that you actually
write that eight is just like my number
out of a hundred my my wins some winning
what I say that in poker I'd be like
yeah it means my advantage is like if we
play for a hundred I expect a dollar
each I expect if we play a hundred times
for a dollar each I expect to be up ten
dollars which I'm sure there's an
explicit way to calculate it but I don't
know it
a median a better estimator of the chef
oh yeah 10-point know exactly oh yeah
look at that median estimator solid all
right let's do it
okay so if we're gonna train both our
players with 2p iterations just all
right this tumbly well we can write it a
little bit smarter
all right
she'd be perfectly symmetric hey I do
suck a chance I we got five minutes to
do this let's go let's go let's go let's
go by the way guys this is really just
for me to shield free Instagram
followers so please go on Instagram
right now tell your friends tell your
mother
tell your sister tell your dogs and dogs
have Instagram accounts to go follow
after our trials on Instagram that's
right thank you rs poni for subscribing
I appreciate every subscriber just being
assigned to every time so this can
actually go inside the loop
okay so put this down here move these
two new thingy entertain that's no it's
not exactly gonna work that's okay
actually you know regrets um here and
strategy some here
I also have to pass in my opponent
strategy again you see fucking up
whenever you use global variables
don't use global variables burrows and
return the two things we update look at
this functional programming ish
it still works I know it could pass in
the opponent strategy every day from
here
starts I'm not I'm dangling Global's
global variables are a bad choice if
you're using global variables you made
bad choices good news is you can fix
your bad choices by refactoring be a bro
refactor and don't use global variables
because somebody someday is gonna be
reading your code and I'm gonna be like
why is only fucking global variables all
right so now we want to go to player
let's say regrets on p1 walls s do we
actually need to track both of these I
think we do yes we do
got some p2 a song p1 strategy some T
two generations
all right let's train player one now
what school is for opponent strategy we
say equals get average strategy get
average strategy this is why I like
using them get over strategies judges so
this is train p1
and we should know what this converges
to it should be because they're both
trying to exploit each other it should
be just 1/3 1/3 1/3 for both of them
[Music]
turned strategy some p1
no it's not ready to get a machete yeah
sure just the same as calling normalizer
like that's all it does yeah it just
calls him harm home has is so stupid
okay well that isn't what it converged
to but it really may not matter there
might be no things forcing this to
converge to anything
[Music]
yeah as garrotted s
as long as this is zero I think it's
just right wait 30 not as fucked up yeah
okay this is not an okay strategy all
right let's figure out what happened two
players are some game pair of average
strategies converges to a neat Nash
equilibrium okay maybe this is like
unstable like Ganz you know so hope to
try something like this where they like
train against each other for a bet or
did I just make a typo I think we might
have to reset the over gret some here
try resetting them both I don't know
I'll try just resetting one and see what
happens
do anymore
and keep your rats local yeah that's
closer more Oh run run run run yeah okay
so that's much better
now when we run them against each other
we're still getting that because I
didn't run this okay cool
so that's very close to zero okay so it
works let's see if we can take this
outside and if it still works or do you
have to do the regret sums I know what
we did the first time didn't work train
train train train train no see that
doesn't work okay so you have to reset
the regret sums every time or it doesn't
work as for why that's true
maybe we'll leave that as an exercise to
the reader because I don't know but it
certainly seems true now if you want it
to converge to this stuff yeah no I mean
okay you can kind of see why right if
the other opponent is playing a strategy
where they're always playing Rock right
you're gonna say oh well my strategy is
I'm always gonna play paper and you're
gonna you're gonna really regret every
time you don't play paper um but then
your opponents like oh hey wait a second
this guy's moron he's always playing
paper imma always play scissors so um
you know what I have an idea let's uh
this isn't that many iterations
let's put strategy every time
yeah okay cool you see what Convergys so
yeah look she can see the first one here
player 1 had a propensity toward rock
player 2 learned always uh always play
paper then yeah yeah well I was really
cool player 2 Oh this worked way better
than I thought I look I love when things
work so this thing learned to have a
propensity towards scissors for some
reason despite that it well I guess it's
just a small propensity some reason I
learned to never play scissors oh I
guess cuz that was okay that was the
strategy from before where it never
played scissors then it learns that it
has to start playing scissors again then
it plays this which isn't really
exploitable cool I mean I wonder if we
could put it to K factor on the strategy
or even if we have to we probably don't
that's probably one of the cool things
about it well you see that it eventually
converges I wonder if we can even lower
this number is this number you can see
yeah yeah needs a few more than that
didn't say this algorithm was fast guys
cool yeah it's converging and like
that's close to an equilibrium but you
know things take a long time so really
cool look you wanted to play early rock
I don't know why he learns early rock
maybe you might using the same random
seeds or something but uh yeah and
there's probably 27 subtle bugs in this
that's making it less than perfect I'm
pretty happy with that we built an
automatic rock-paper-scissors a I pull
like the stream give me your feedback
and also don't forget follow me on
Instagram
she's over there now so look that's I
gotta use the other hand so it's over
there so that I see the see the
Instagram hope you all enjoyed there's
some high quality programming content
the algorithms called counterfactual
regret minimization and it is the key to
solving high complexity imperfect
information games oh why don't we go
what are we gonna play the fucker knows
about that our PS game thank you thank
you for following on Instagram tell
everybody you know I want a million
followers by the end of the year I
believe in you guys I don't know I don't
know how I'm gonna do it yet but never
just believe man you ever know them of
them am i sharing that too bitter nope
nope no it's a secret
oh I got all bloated somewhat about
effort you can even retype it you learn
stuff by doing it thank you thank you
Pokhara alright what's up by twitches
bye see you later from beautiful lovely
LA with my got some candles I got some
other thing behind me no vinton a we did
ipython notebooks high quality shit ahh
bye bye bye bye
that doesn't change your camera
it's not second right very cool
we had a very relaxing morning
i'm going to talk about the dream i
wrote this up yesterday
you know i went overboard with this
stuff turns out we don't actually need
uh
instead of mapping it from you into
kill computers good morning
actually care about any of that
you're actually second you're not first
look i made a civilized breakfast this
morning
civil breakfast look i made eggs i made
avocado
i made chips i mean put on the pot
i'm gonna be civilized today on today's
stream stride machine thank you for
subscribing
drinking water real beautiful relaxing
morning we got a massage
so we actually don't sign
let's see if my test for the checkpoint
works then we'll talk about what the
pointer is
a few people come in here
this language is called solidity
it's the most common language for coding
on the ethereum blockchain
so
i know my voice isn't loud and quiet
today today is a quiet alternative i'll
turn the volume up a little bit
you guys can hear me better
george are you short on money or why are
you streaming two days in a row
i was gonna ban you but you're saved
because you're a previous subscriber
i want you all to take a minute and
you know does chat just trigger me
why do i do this that's a good point
i kind of like sharing i like
documenting sometimes we have good
people but sometimes we have morons in
chat i think i think i talked a lot
about this in new york what i was going
to do about it
and then i proceeded to do nothing
you guys really think i i stream for
money
you're just gonna trigger me chat
i know what we're gonna do today is
gonna be a subscriber-only chat day
perfect
that way at least if you want to trigger
me you have to give me money
okay so i wrote this stuff up last night
ah this is another reason i do these
streams because it gives me somebody to
talk through stuff with and
sometimes when i say stuff out loud i'm
like oh that's stupid and that's not the
right way to do it
so hopefully you guys all know
what gb is by now um cheap is a fork of
the main ethereum chain at this block
think bitcoin cash but for ethereum
instead of bitcoin
the money is cheap the transactions are
fast and the party is still going
so what i'm trying to build is bridges
in order for the cheap chain to have
value um it's nice for that value to
come in from somewhere else right
so if you just have a blockchain
completely on its own there's no way
to give any value to any of the tokens
really you need to have exchanges
now
um so chibi has an exchange
uh gp has an exchange here on centex
um which gives it a value it's an
exchange
from the seath pair to the e pair right
so historically what gave bitcoin value
like the early exchanges like
mount cox before there were other
cryptos there was a btc
usd pair um crypto's come a long way
since then
so in order to give it value the value
is determined by
you know this is the the number people
are willing to sell at and this is the
number people are willing to buy at
and the value is somewhere in between
there
um so in order to give the
seat chain not just value but also like
you have to connect it into things so
we're building bridges
um we built one bridge we did a test on
it called bridge f hash
which allows you to bridge from chains
that use
f hash for security which are like
proof-of-work chains
themselves is the proof-of-work
algorithm on mainland ethereum
uh we worked yesterday on bridge binauts
which is a bridge to the binance smart
chain
which is another chain that also has
value on it you can see how much value
these chains have on them
um coingecko.com so finance is actually
back in third
it has a total market cap of 44 billion
dollars
oh bitcoins up it's a little bit over a
trillion and ethereum is at 212 billion
so what i'm what these bridges will do
is bridge from the cheap eat chain
uh which is actually now also on coin
market cap
but not entirely if you go here you guys
you can see chibi's coming up we're
working on making it a track listing
um three watch lists which watch lists
what does that mean
the tv
um so you say okay why do you need cheap
why don't you just bridge the ethereum
chain um directly to the binance chain
and you can do this but it's really
expensive to run these bridges
at least bridge f hash requires you to
submit every block
for validation um
and without every block
you don't have uh you know a blockchain
so chibi and if you look at any swap
they did something similar
where they put a middleman they put this
like a middle chain it's called the
fusion chain
so the cheap chain can function the same
sort of way but instead of creating a
new chain the cheap changes to the
ethereum chain
so on the cheap chain we'll be deploying
three contracts
bridge f hash which brings
bridge to mainnet uh
bridge to finance
smart change
and then check layer um so
one of the problems with cheap cheap is
going to move to a joint proof-of-work
proof-of-stake model
if to just use proof-of-work you
have this problem where you can
reorganize the chain if you have big
mining power off the chain
so you can go like 200 blocks back run
a minor uh mile a longer chain
and then as soon as your longer chain
becomes longer than the real chain
all the get nodes will switch over to it
and the problem with this is you can do
a double spend
so most exchanges the centec exchange
makes you wait for 30 block
confirmations
but reorging 30 blocks is not that
expensive
and what you can do if you do a reorg
is you can withdraw money wait for the
withdrawal to be confirmed on the chain
you're withdrawing into
uh and then you can
um well actually that's not
no you withdraw let me actually change
this terminology
you would draw your seat
into other chains
deposit back into seat okay
so you can withdraw your seat
out of the cheeky chain see if there's
the unit of value on the chibi's chain
you can withdraw it out
and then you could
wait for that withdrawal to be confirmed
on the chain you're withdrawing into
and then you could potentially
reorganize the whole cheap chain
such that that withdraw transaction
never happened on the cheap chain
but you already have the value on the
other chain giving you the asset on both
chains which is a double spend attack
so in order to prevent that what we're
working on today is something called the
check pointer
so the idea of the checkpointer here
is and i'll i'll write like the tldr
here
cheapy is a proof of work
chain for the most
recent 100 blocks
um and then a hybrid chain
hybrid proof of stake chain from the
back
uh so after things are 100 blocks back
you'll be able to use the checkpointer
to a test
and that's what this function does
you'll be able to attest at this number
the block hash was this
and we're going to figure out how to
weight that based on how much seat you
have so it's proof of stake
then once you have these attestations
you'll be able to submit them
to the bridge authority and the bridge
authority
is what lives on these other chains the
bridge authority says
using really proof of authority um the
cheapy
hash is this you can trust that
uh men
so we build these bridges
the bridges are useless without an
application the application that we're
talking about
is the cross wrap and the cross deposit
um
i gotta i gotta be a little bit careful
with my uh
terminology but i gotta i gotta really
get down this deposit withdraw
terminology
but the basic idea is you'll be able to
withdraw your cheap beef
out to either the main chain or the
finance smart chain
you'll be able to trade it and things
like uniswap and then you'll be able to
deposit it back into the cheap chain
so it's just going to show up on main
chain or binance smart chain is a token
called wc
um this is your daily reminder that even
if it's making
money speculation is for losers
um no i don't think many other tokens do
i think this is if i actually get all
this stuff working
i think gp he'll have some of the best
probably the best bridges um
out right now if i had to make this
stuff work we can bridge to both the
main chain and the binary smart chain
and give cheap the value on both of them
what you could do is if you wanted to
switch from the main chain to binance
smart chain you could like
buy a bunch of seats on the main chain
deposit it in
uh to the cheap chain withdraw it out to
binance smart chain and then sell it
over there
and that completes a a beautiful cycle
of value
um i also like
so this is one of our competitors
um we made fun of it a bit yesterday
uh for using
fusion dcrm technology which i've never
heard of
these are going to be some simple
solidity contracts anyone can audit
validate and also anyone can submit to
so the only places where we're going to
have any kind of authority
is at first it's going to be on the
bridge authority you're going to say
which
validators you trust the validators are
writing into the checkpointer
um yeah so the checkpointer allows users
to attest to the state of the chain
here and then during my massage this
morning i was thinking through
um we also want to build in this
function called
trust um
trusted
to um trusted sub message
uh dot sender equals
uh to trust we're gonna have to do a
little bit more than that
we're gonna basically want to keep
around like 100 biggest
like like like if you have see you'll be
able to say
i trust this address to correctly attest
to the state of the chain
are you doing this for fun or do you
have a contract or something like that
do you read that do you read the one
question you can't ask
and if you phrase it differently it's
still the same question
you're asking why don't ask why
stop
do you guys ask these questions because
you can't follow this
or do you guys ask this question because
you find this boring
or like why i'll ask why why do you ask
the question
maybe most of you follow and
do
i really need to like check all the
balances and stuff
i don't know why this solidity tutorial
is weird like that
i thought it was that
it's all done crap
there's something about the world but
like
motivated reasoning
i remember when we did like tests for
people to see
this isn't this is simple stuff
right i'm not doing anything fancy i
don't know that much about this stuff
um so you know it's it's sad to me if
you guys can't follow
you
optimism for the most part is
pretty good style
so let's take a look
um
desert made
of verifier to trust
cool
it was expect
uh the block reward and cheap ease is
worth
for production ready system you might
therefore increase this parameter
you sound like a miner who's asking for
more coins
[Music]
given
no this transaction so originally i was
trying to
put this in the uh
the signers i i was having it submit a
signature but you realize you don't
have to because you have a transaction
with this
data that's already been signed by
um
by the uh
the user by message.sender
by message
function
[Music]
so what i call it get block by number
so the function is get blocked by number
and then we're gonna return the hell out
see so
you see kind of what i want to write
here okay so i want to get the block
i want to iterate through the trusters
and say okay which hash do they trust
and then how much do they trust it but
the problem with that
is i have to like write some fancy data
structure to actually track that
come here we can at least do something
stupid
say verifier
and here is your turn att's block
number sub verifier
checkpointer dot
block my number
let's log that
uh no that's not exactly right because
i'm returning
what did i say returns a challenge
so the reason that i want to also return
the block number
um is because
using that block number you can fetch
the transactions from the block and then
you can figure out what
was used like where the transaction is
that actually signs it
ah let me say yeah
this is now
sweet ah that's a promise because i
didn't want to write it
yes then we should just say expect
return block hash.cash
to equal submit cash
you know i was just thinking about
yesterday's stream and i'm like you know
what why do i why do i do this
like
i made i made 1300 last month from
it it's not money
is it really and then what it usually
comes back to is like
sometimes i'll get really quality
suggestions from chat
um sometimes you guys know things that i
don't you you point me to new things and
i learn new things and i think that's
really what makes it worth it for me
um you know it's upsetting and i've
complained about this before
it's it's upsetting that that the
audience is in a bit higher brow
and like i'll get i'll get brought down
to to a certain sort of level
um but it's not good
yeah so how do we do it better but then
you know you have a problem with uh
like like my real dream would be if
somehow these this was uh
like we were editing on on ether packs
etherpad is
really old um we were editing in some in
some joint thing and we could all like
work on the code together
i think that would make for a cool
stream
but the problem there is you're going to
need a lot of sort of
gatekeeping
i don't know i think these are the right
problems for me to solve
oh it's not a question of actually
implementing that technically it's a
question about the social structure that
surrounds it
um the merge sort was kind of a fun
experiment we did get a lot of
contributions to that
merge sorts in many languages we did get
a merge sort
in many languages but it's not useful um
part of my goal with with cheap eat is
it's something that
a lot of people can contribute to in a
decentralized way
uh it has been cool it has has been cool
to see to see all these things pop up
i think everybody can can see what it is
and can contribute as
much or as little as as they want we're
all interacting with a community chain
those i guess have been some of my
favorite streams
uh where we build
we build things like remember that the
the voice chat app
um the
tic-tac-toe app where i learned react
so those have been some of the good
streams the bio streams have been pretty
good
because the buyer streams i don't really
know very much about biology
uh there's a whole lot of people who
know more
than me in the chat i guess all right
we'll take it off subscriber only and we
can have more people talk about this but
please like just don't become don't
become cancer don't don't
don't be like oh good send me links to
get me started with computers
you make me sad why are you
here
it was nice so it subs only mode i agree
never mind we tried
we tried and we got i like turtles
so let's write bridgette party
uh we still didn't finish bridge by
dance did anybody finish it for me
if we get any pull requests then we
never get pull requests on the bridge
so bridge authority is going to be a lot
like the bridge sail what you're going
to want to do
is you're going to want to fetch
send blue bridge authority
so that transaction this uh this
checkpoint or a test
um
it's a big number
i need to work on my posture
yeah when i'm exploring new stuff where
people don't
um but i don't really know that much
about this
two numbers
so what we'll be able to do is we'll be
able to get
four
provider
uh
provider get transaction
uh yeah comments like hey george you and
kelly still like
who cares you know
twitch shot just becomes a war for your
attention the good commons get washed
out and since they require effort they
will vanish i mean this is the problem
this is oh god i have all these same
thoughts a year ago in new york
like
this is the whole problem with the
internet
the shittiest people rise to the top
um because they're the ones who do all
the talking
the they're the ones who have no have no
shame have no
have no um
in fact i think a lot of them just don't
understand
i i think a lot of them don't understand
that
and and if you have a system that's
selecting for that
uh my friend is this saying about defies
like d5 is a
is a game for sharks and there's only
going to be it's a winner take all game
for sharks and
there is something beautiful about that
at least there's something beautiful
about the fact that there is a scarce
number of these crypto coins and it's at
least
some competition you're putting you're
putting
some pressure on kind of better people
where there's no pressure on better
comments
whoever figures out how to solve this
you are going to do wonderful things
whatever whatever social network
uh figures out how to solve this
it is going to do amazing things
does that work or do i need like more
cast somewhere
it all looks okay cool did that actually
get shorter
micro transactions for well-rated
comments
but i mean the internet has tried a lot
of systems for this
so microtransactions for well-rated
comments is reddit gold
and and reddit's one of the biggest
circle jerks on the internet
reddit has come to this is
i mean the problem with democracy reddit
has
democracy is is two wolves and a lamb
voting on what's for lunch
reddit uh
you know we just put up with it and i
put up with it on twitch
i i put up with low quality comments
i'll even engage with some of them
even to engage in order to not engage
is still the problem
how do you fix this this is what the
world needs
the world doesn't need you know stupid
bridges between uh
between cryptocurrencies i mean it's all
cute and it's all fun and we're all
having a good time i'm enjoying writing
this it's a good project
um you know if code really was law
and the world accepted that i could hack
all these crypto things
so easily
but you know again it comes down to why
i'm not a criminal there's no
i could do it but i'll just be taking
money from somebody
all right so i wouldn't do it it's all
it's all so easy to
to to hack uh but you don't have
good people on incentivized to do it
only kind of mediocre people and that's
who's doing a lot of the the real crypto
attacks today
um
the check that's really bad here and i
don't know if it has to do with the
wannabe hacker community
so
i've seen i've been on other twitch
channels and watched other chats
and they're way more cancerous than this
like there's there's always been wannabe
hackers
um and i don't really think they're the
problem
you know look i'm a wannabe biologist
but i would never go into a stream and
you know
write hi i'm just getting started could
you please tell me
three books to read for biology like i
would never do that
uh it's it's a type of
person and this type of person
is also like getting ahead in the world
because okay
you wanna you wanna get laid i always
say this you wanna get laid go up to a
hundred girls and ask them uh hey do you
want to go back to my apartment and have
sex
one of them's gonna say yes one out of a
hundred you're gonna get 99 rejections
but if you're really looking to get laid
in the next hour
that's like the best way to do it
right okay fine you know you hire
hookers online but
what that eats away at
is the comments right what that eats
away at is
you can just imagine all these all these
all these girls on like only fans and
stuff
you know and the messages they must get
and this wouldn't continue to exist
if it wasn't effective every once in a
while
so this whole system is optimizing for
the
total shameless um
the corporate system the corporate
system who's the ceo of boeing
the ceo of boeing is not somebody who
cares about building good
airplanes they're they're not selected
that's not the pressures that select
them
um the number of people in chat is a
factor
and it is true that when it gets larger
well
when it gets larger you can see this at
a party when a lot of people come into a
party
you get screaming
and everyone has to scream everyone has
to scream to be heard
if you could figure out how to solve
this problem
so much would get fixed in the world
i was texting my sister this morning
about whether whether technology
actually destroyed the world
i was i was super pro uh
you know i i had i had always had some
some
uh concerns about you know the day that
i become obsolete to technology but
i i feel okay about that
it's like it's like a father watching
his son surpass him
um but
i don't feel okay about about where
technology has
taken us so far and where
so you have the the standard
conservative complaint
of
uh people aren't self-reliant today
people aren't good people don't people
don't take responsibility for their
actions
i think there is some truth to that but
it's not the whole story
it's that the systems that we've built
today
are rewarding the wrong
sort of person
from small systems to twitch chat
to larger systems like social media to
even larger systems like corporations
and this may not be a new problem
um the the
problem may have always been there just
the awareness of it is so much greater
today
because you can see it play out so
clearly
because for the first time also we feel
like we might have some control over it
you know are you really going to change
the dynamics that choose alpha monkey in
a tribe
no that's kind of in the monkey's dna
but can you change the dynamics of who
gets to speak in twitch chat
you can
so you end up with problems
you can watch you can watch what every
social network has become and you can
see what these problems
are reddit is maybe the saddest one
uh but it's top down too the way there
was a subreddit i liked our consume
product and they product and
i they banned banned it for the same
reasons you know they gave for banning
like the
the q and on and pizzagate subreddits
and
i can understand why you might want to
ban those but
when you really read consume product
that's not what it was
consume product was something that was
making fun of uh
you know consumerism and
i think you know it's just easy to say
well
if we have a guy making fun of
consumerism next to
a nike sneaker ad how's nike gonna feel
about it
probably not good and now who's making
who's paying us well nike they're the
customer that's the product so
you know consume product have to go
yeah no accountability is a big factor
here for example people want to be heard
and important or have some sort of
agenda
and that's why i always get asked
these sort of questions and like you
know
the people who are upset about the cheap
pre-mine
do you think i really have a plan do you
think i've really thought through
this is what i'm gonna do with cheap eth
no i don't have an agenda
i'm just having fun
and and
you know i almost think that you can say
that to these sort of people and they
don't believe you
they believe that that is all just
manipulation and service of an agenda
yeah of course of course the
prioritization of chats and sweets not
who can
uh chats and tweets is the problem not
who can chat and tweet
uh so i'm i'm trying
like a little bit on cheap one of the
big narratives is is
you know it's it's kind of a joke but
fuck speculator right
um is it speculators
who ruin crypto
crypto has so much going for it
yet at the same time you'll read a lot
of the commentary about it and it's it's
low brow dumb shit one of the only
places
you'll get
remember that time that we went through
the programming languages and we looked
at the
the average haskell or uh
or rust stack overflow post
versus the average like java or ruby
stack overflow post
and it's because java and ruby
appeal to these people with agendas
whereas haskell and rust kind of don't
so one way to do it is to remove the
agenda
unfortunately the problem
is and you can go into pure math and
pure math
is almost all signal and very little
garbage
but it's also useless
the more useful something is
the more of these people show up
i think this is what happened in silicon
valley
silicon valley was a beautiful place for
people to come hang out and mess around
with technology
and then money showed up and you know
the money's all great until
and everyone you know look the people
who are technology we got money good
we're appreciated for our work
everybody's happy with this
but then it brings in a new kind of
person and a lot of these people
that i meet starting startups today
don't really know anything about the
technology don't really have any
any
it's not for the love of the thing it's
like a calculated
you know they are this kind of person
like the kind of person who buys
a dog um now we have a lot of this we
have a lot of this
in san diego the kind of person who buys
a dog and now
they didn't buy a dog to have a dog they
bought a dog to have an identity
maybe it's a different kind of person
maybe these are just maybe i'm just
lumping in a whole lot of things that
have set me into one thing
um mba bros ruin everything they're just
trying to 10x and flip to flip yeah
so is this the problem are our
speculators the problem
because well someone said well yesterday
sometimes people say good things on chat
speculators are just middlemen
um our speculators are our middlemen and
crypto is this whole world that's
designed to cut out middlemen
yet it has more speculators than
anything else
and maybe that eventually calms down
these speculators eventually lose their
money
yeah so i i agree that i agree with this
that it's the gamification over time
um and the optimization
criteria becoming more and more apparent
what says javon's paradox
uh no not javon's paradox what what is
what is what is one thing
when when something is a
once something becomes a metric it
ceases to be useful
ah
good heart sloth yeah
any observed statistical regularity will
tend to collapse once pressure is placed
upon it for control purposes
even better once a measure becomes a
target it ceases to be a good measure
so as we've gotten better at measuring
things
uh we've started to close this loop
you get this this hyper-optimized this
reminds me of um
my experience at uh chingua university
in china it's like the mit of china
my understanding and i may be completely
wrong about this
is that china's college
admissions process is almost entirely
based on a test
and with any test if you administer a
test to a billion people
and you're taking the top point one
percent those thousand people that
you're getting
are not necessarily any smarter or
better than like the top one percent on
the test
right the top ten thousand and in fact
there's probably even something weirder
about them
right because they've hyper optimized so
much for test taking
i saw the same kind of thing in in
competitive programming and competitive
programming and
one of the difference between
competitive programming is in ctfs and
it's not true anymore
but for ctfs it was just a bunch of
people who
didn't really optimize for being good at
ctfs
they just kind of played them and
everybody had a good time nobody did
drills nobody nobody optimized nobody
like said
oh this is this type of problem this is
this type of problem
we were all just there to explore
computers and that's what made the ctf
scene so good
the competitive programming scene was
much more optimized
like the like the competitive math scene
uh and as a result it was just i think a
lot less fun for everybody
um
independent people have to create their
own community separate from the system
convincing one person at a time to go
the independent route the revolution
won't be televised yeah i'm buying 123
acres of land
uh i'm gonna put up some some some
university buildings on it
i think that's
if i want to do that i run into still
the same sort of problems
the problems are a lot better one of the
problems with the internet and
you know people gave me so much shit i i
was the admin on the comma discord for a
while it's gotten a lot better now but
if you're talking shit you don't get any
benefit of the doubt
i'm just gonna ban you right if you're
if you're at
all on the edge i'm gonna ban you
because i can't be spending my time
right there's no time for a trial who
has the resources for that
the reason as a society we can spend so
much resources on a trial
is because you're doing this with your
real body right there's stakes
you're staking if you're on trial for
murder you're going to
jail for life right that's a real stake
you've put something
up but if you sign on to discord
with an anonymous account
you're not staking anything
um and on the other hand like
you can have places like like 4chan
where everybody's anonymous and nobody
is staking anything and they work
uh but places like the common discord
it's like look man you know
we're trying to a lot of people here are
trying to have a nice conversation
banned
uh no ctfs weren't optimized really back
then
um yeah the testing day is insanity
parents climbing buildings helicopters
everywhere
cameras watching students from the
ceiling and that's
i guess the problem with
i feel like when my company grew big
that's when the parasites came out yeah
because
well in a small group of people a small
tribe
so let's talk about you know the man
who's trying to get laid and goes around
and asks uh
you know a hundred women do you wanna do
you wanna do you wanna come back to my
apartment did not have sex
he's never gonna see those hundred women
again so in a city of a million people
you can do that
in a city of a million people that's a
fine street
yeah that's a fine strategy
in a tribe of 150
that's not a good strategy
um this used to be something that was
talked about in pickup back in the day
where you need to get over your fear of
rejection
and you do most people are are
irrationally afraid of rejection or at
least they were
maybe today that's changing like we live
in a shameless
society
we live in such a shameless society that
you'll get things like
like you'll get things like cancer
culture because
all the people doing it have no shame
right like like
the the person who is completely
shameless
trying to shame other people
it's a hard thing to fight against
what if bandwidth was your stake some
sort of system that chokes the bandwidth
yeah the problem isn't what the stake
is the problem is
well
you know and this is one of the reasons
you say like oh george this is a crypto
stream what are you talking about
this is one of the reasons that i really
like crypto
because it forces you to think about
these sort of problems
in very rigorous ways
it forces you to think about the
problems of of of consensus and bad
actors in in real rigorous ways
um how this is in the u.s but in germany
you can't fire someone once they pass
the trial period the system is entirely
designed to feed the parasites the u.s
is a lot better about this
we have a european office and i've heard
about these problems
and you know uh
well i i have a strategy for dealing
with that
yeah higher efforts i mean we do this
and there's a few things that we do
um the social welfare state accepts this
and basically argues that as long as the
total net revenue is is the same it's
fine
yeah i'm obviously no fan of any sort of
social welfare state for these
sort of reasons you can't
you can't give people ubi because they
don't have skin in the game
um i believe that this has been tried a
whole bunch of times you're like well
let's solve homelessness and give the
homeless people houses
and the problem with this is if you give
somebody a house they're going to trash
it
i'd trash it fuck man you know
you know think about how i treat an
airbnb when it's my name on it versus
like
you know obviously my friend you know i
extend the same
courtesy that i would that i would uh
extend to uh
you know how i retreat my own airbnb but
like if it's someone i don't really like
and i'm at the airbnb yeah
fuck it man yeah well let's not go over
that chandelier man
let's do it right
um
oh how we deal with low quantity
candidates for software engineering
positions
hacker rank um
i saw i saw a few comments where people
were complaining about that people are
saying oh
karma users hacker rank george i thought
you said you didn't like hacker inc
no i didn't say that i said what i don't
like is people who are
optimizing for hacker rank
you are the problem people who are like
practicing hacker wreck you shouldn't
have to practice
and if you're the type who had to
practice
you're wasting everybody's time you know
because you might be able to get through
the hacker rank but as soon as i talk to
you on the phone i'm gonna tell that you
don't actually know things and you just
practiced hacker rank a lot
uh so we put hacker rank up as a front
end because it's very cheap for us right
you have to think about you have to
think about uh time investment
right and this is this is the same
problem that i'm talking about about
this chat
i could make a nice chat if i hyper
carefully moderated it
but even that even it gets a little bit
harder but
the problem is this asymmetric time
investment
um no everyone our challenge on
hackering is not hard
it's not like at least like the
the the one for the full stack engineer
you have to like know how to like
use requests to fetch a url
um you know you have to like like write
some javascript which like
you click a button and it makes uh it
changes the color of the button or
something like it's it's
very simple stuff and you can use google
uh if you can it's more a bar of
wait you can't do this okay then there's
no way i would even talk to you
um they're not they're not
they're not very difficult competitive
programming problems
but no okay let's let's keep this on
topic i'm good
subscribers only is helping right
because you guys if you're a subscriber
and i ban you
i don't think you get your money back
and so it's good subscribers have a
little bit of skin in the game
um it's not the best sort of system
so you could imagine a system this is
kind of how we run the comma discord
where
maybe moderation on gradients
like right now we have like moderators
and non-moderators and that's binary you
know
i don't know
i don't know how you really do this and
if anything
i'd argue society's maybe gotten worse
at it over time maybe the founding
father is like
the people who laid out all this
structure for america
banning subscribers is like slash
mistakers yeah
yeah so trolls that fly by so we prevent
that already you have to be you have to
be a follower for a bit
i actually think it's trolls um scott
alexander talks about this once on why
the new york times doesn't have comments
the problem is not the troll who's you
know you know
screaming out you know a bunch of slurs
and obscenities
the problem is the person who writes
five
you know very well written polite
paragraphs about you know about the man
boy love association or something
right like what do you do about that
person
it's not like you ban them but but
what what what what exact rule did they
violate
uh we're gonna do an urban stream one of
these days i don't i don't know how
seriously they're actually thinking
about these problems
what's interesting about these problems
too is if you say that you're working on
them
i don't know about any of this stuff
spell check your shit
uh
aoc test all right beat me at age of
empires
age of conquerors
everything's allowed as long as you can
reasonably explain it
can you explain urban looks interesting
you're on thin ice
you're on thin ice you see right there
that's it like like what's wrong with
that comment
the comment is derailing we're trying to
have a coherent conversation here
all right and it's nice that you're a
subscriber and you do have skin in the
game so if i do ban you you know you're
banned um
just something that takes 10 minutes
that kind of commitment
topic cue we tried this in one stream
once
you know this comes back to oh my god
you want you want to talk about you want
to talk about a truly
toxic set of people the people who
emailed in applying for jobs
at hammer
you get these they're there what is this
i want to use it correctly
i feel like i've looked this up before
and then i've looked this word up before
yeah sick of fans
it has not been a similar problem since
the old irc days there were always
people causing problems now twitch has
been easy five for the masses
so this is something you'll hear over
and over again
uh the barrier to entry used to be
getting on the internet
now everybody's on the internet
um so urban
has an idea about this or if it's like
okay well make the new internet harder
to get onto
but the reason this doesn't work is
because
what does the new internet offer me
right
the internet was this beautiful thing
that gave people new
powers and the new powers
are uh
what draws in these very intelligent
people and these these these great
people in the early days of the internet
the problem is urban doesn't really give
you new powers it's just different
um i tried my best
to do this at comma when i'm more
seriously talking about comma uh
there's a lot of you know comma's
mission is to solve self-driving cars
while delivering shippable
intermediaries
but personally i started comma to change
culture
um someone's gonna solve look why
would i start a company to solve
self-driving cars
uh self-driving cars are gonna be solved
right
i don't i don't care about getting rich
uh i don't care about me being the one
who solves it like like i like that idea
and in a more um
you know if i'm going on an ego trip
yeah it all sounds nice
but when i when i lay down at night and
only have my thoughts
i think what do i really want to get out
of it and i want culture to change
um one of the things that we're doing
is com is cool
com is a new power open pilot's great
but you gotta work a little for it
you gotta you gotta figure some things
out and and
the the problem with urban is it doesn't
give you a new power
you have to work for it you have to
figure some things out but it doesn't
give you any new abilities
comma gives an elite group of people who
figured out how to use comma
the ability to watch their car drive on
the highway
uh i hope it solved open source ego is
important
i'm not going to hate on ego right i
like the idea of solving it open source
i like all those things too but
at the end of the day the only reason
that i keep doing it at all
is in hopes that you know culture will
change
it all sounds you know it all sounds
that all sounds nice but
d5 gives people new powers that's true
and if you go back to the early days of
the crypto community they were a lot
better
the problem now i'm not going to give
specific examples here because some of
them make me sad
the problem now is it gives people new
power but it also gives people there's
also
status to be claimed and then you have
people in d5
playing status games uh
you know look you guys know me could i
start a real crypto company
yeah but i'd never do it because fuck
status if you can't win
without playing and this is true in
common too
i'm not playing any status games
um and if i lose because of it you know
i've always said i'd rather die before i
sell out
weighted believability by topic of
knowledge and track record
yeah so this again comes down to who
evaluates
what i did find is when i did those
tests for the haskell streams the people
who i gave vips to
in general were much better commenters
um and i wanted to build this i thought
of a stream where i like
make an irc server with a modified
protocol and just anybody who figures
out how to modify the client to join can
talk
ah but to bring this all
full circle to why i'm doing cheap eath
it's to think about these problems
it's to think about if right now
if the current culture that we have in
the world
reaches the singularity the point where
all human labor is worthless
we're dead
you want to keep playing these
optimization games
machines will beat you with that every
time
you can't
the unabomber manifesto doesn't have an
answer at the end
it just says blow it up and in 500 years
they'll have to deal with it again but
that's not my problem
me and my kids will be dead
so as to why and as to why like
unless people kind of get that and
one of the reasons you can't talk about
it too much
if you talk about how you're changing
you know your point is to change culture
and then someone wants to work with you
they'll try to mimic that language
um they'll they'll they'll hear you and
they won't really have the same beliefs
as you
they'll just try their best to identify
with your beliefs
and most of these people do it so
laughably bad
that you can spot them but like the
problem is kind of the more you
talk about that evaluation criteria the
more you're going to get people who try
to optimize for it
i think this was a weaker form
the point that i was trying to make
yesterday about reputation
sometime i'll go to extremes and say
things like reputation is all bullshit
and i don't believe that what i believe
is bullshit
is people doing things for their
reputation
it's that it's not jevon's paradox it's
that's that thing i googled again
um it's it's
once you treat your reputation as a
metric and you start
optimizing for it you you don't have any
reputation at all anymore
it's fake it's a terrible metric
was it goodwin's law good hearts law
good hearts law
i tell your girlfriend who is your lingo
in the book the damon the purpose was to
give transparency to society
what does that mean
today we censor information not by
stopping the flow of information but by
just putting so much irrelevant shit out
there you'll never see what's real or
not
more any quantitative social indicator
used for social decision making
yeah papa waz i'm reading your comment
um yeah the whole tech is governed by
the social structure i'd love to see
that die
i'd love to see that die you know
the ethereum the ethereum dow fork was
sad to me
it's sad to me when the social
has any impact um
i wish that everyone who was good just
refused to play
they don't they don't they don't and
they find leaders who are willing to
play
um who are willing to play the social
game instead of the technical game
the only way to stop this is to stop the
social game from yielding fruit
the only way to stop the
the only way to stop the the trolls and
the junk
is to stop them from getting anything
out of it
as long as they do they'll always exist
let's see your link
i'll check it out reduce the incentives
right so how do you do that
all right i still haven't i still
haven't gotten to listen to uh
prior patch observatory yet
uh i've i've
waffled on proof of stake
proof of work it's very easy to model
and analyze proof of stake is complex
i think that they both have
major problems
so i i don't i mean proof of work again
because it's simpler it's much easier to
talk about the problems like yo
all the bitcoin miners are in china and
everything in china is owned by the
chinese government
therefore bitcoin right
what we're trying it's not trolls we're
trying to
increase the general level of discourse
in the world
the problem with the distributed social
networks i agree that they're less toxic
but they're not less toxic for any real
reason
they're less toxic because of the sort
of person who chooses to be on a
distributed social network
what happened to ovh cloud ovh cloud
broke
i loved ovh back in the day
wow
damn
it burned down ovh burns down
burn the computers burn the data centers
uh no
i i think this i think this has been
tried a whole bunch of times
the whole argument is not it doesn't
come from like how i would treat an
airbnb
the argument comes from the idea of when
you give people something
that they don't
they don't feel nearly the same
ownership
especially when an impersonal
organization like the government gives
them something right
like if a friend gives you something and
you have a relationship with this person
but like
shit man you know whatever the
government wants to give me
i'll just scam them and get more i have
no i have no issues with scamming the
government
right i wouldn't scam a friend that's
the difference
um is there an alternative to ubi
well yeah but people don't like it you
know
you know what you have to do right it
comes down to incentives again
if if you're setting up homeless
shelters and and give food to the
homeless
it all sounds nice and it is nice it is
it is nice
at that one moment at that one moment
when you see starving people you want to
feed them
but if you set up an organization that
gives food to starving people what
you're actually doing is incentivizing
starving people
you're incentivizing people to be food
insecure
you can't fix this by giving them food
this is i mean i don't you know no i i
i'm so cynical about the government
i think that like when they're giving
you know when they give rice to
to to an african country it's not
because they want to
solve world hunger it's because they
want to undercut the local markets and
keep the country dependent on the rice
and you can do this at the individual
scale or at the country scale
um this is also true about corporations
of all forms of corporate welfare
crews shouldn't exist
cruz continues to have money pumped into
it
with no plan to ever make that money
back
um this isn't uber who's unprofitable
this is cruz with no
revenue
we got to reintroduce survival of the
fittest yeah i
i i agree with this
but can you reintroduce it the problem
is if you're reintroducing it you're
you're a monster i think what's going to
reintroduce survival of the fittest is
going to be a a
major collapse and you know i hope for
that collapse and i hope that it comes
sooner rather than later
there will be a point when it's too late
i don't think
there will be a point i don't think
reform is possible anymore i think i
think we need
some revolution
of course and and and you know you have
a homeless intensity that's growing
because you you
if you put programs in place that
tolerate or
or help the homeless like it sounds very
nice when you do it but you're
incentivizing that behavior
you're incentivizing that behavior
you know i saw i saw i was in san
francisco and just mentioned it before
the san francisco
san francisco hall's films much worse
than san diego homeless problem because
san diego i think does a lot less to
incentivize it
um you know as a general rule i feel
that
you know if if if you want to sleep
under a bench in a park you know hey
that's your choice man but like don't
expect anyone to like
you know give you food or let you pitch
a tent
right like how is that okay
how are we okay with with with it's
illegal
it is illegal for me to pitch a tent and
camp on
my property
people don't know this but that's
illegal right
and if i get it in the middle of a of uh
you know
if i pitched a tent in my backyard in
rancho santa fe
and i started renting that tent out to
people and said hey man come sleep in
the backyard under the stars
they'd find me right yet
you know you go to walk on the venice
beach boardwalk and there's tents
why you know that's is this a fair
application of the law
well if you can't afford it you can set
up a tent
i think you got to have one rule at
least
like at least this isn't quite survival
of the fittest but
you can't have different rules for
different people
um yeah
you know the the the rich people have
allied with the poor people to fuck the
middle class even further
ah
yeah and the reason they exist is
because they're allied with the rich and
they all
i don't want to go off on this but
a lot of homelessness is because of
mental health problems it's hard to
incentivize mental health i don't really
believe this
uh i think that like well that may be
true
but you can totally incentivize mental
health right like like you can totally
cert there's there's
many many people you know am i crazy
right there's many people on on a border
like i could see a world in which i'm
homeless right
but you know
what's the incentives to to keep doing
it or stop doing it
right like you have to treat people as
if they have agency
um but this is getting too far off topic
i
i feel that i'm not a city planner i'm
not an elected politician i'm
a decoder um
and if i could figure out how to build a
system in code
that fixes a lot of these problems in in
code that's i'm happy with that i can
move there and you
spend my life there
the homeless non-profits are hoarding
immense wealth it's cheaper to build
apartments where'd they get the wealth
what it's all about incentive structure
and setting up good incentive structures
all right let's just think about let's
think about a simple one like
i do think that that my little my little
trick here will work
right um cheap eat will never exceed
this value
because i'm holding 24 million cheap
beef for dumping on speculators
right but just because i'm holding that
cheap
to dump the speculators won't come
this is good the the best power is power
that you're never going to have to use
but this only works when you're really
very secure in power
ah
i'll if we if we actually get
to a serious ubi uh
i'll leave that country
if because what that is doing is it's
subsidizing you don't want to subsidize
anything
um yeah so okay you would speculate you
have a high ceiling to go until you need
to dump it
and that's fair right
you you don't want to completely remove
i talked about this a bit last stream
you don't want to completely remove
um
you don't want to remove investment
right an investment is this idea that
you
you you buy in and
like you know
or even let's say investment just in the
sake of like you buy in and then you do
work to create value for other people
and then that that that value goes up
there's nothing
wrong with that there's certainly
nothing wrong with amazon employees
holding
amazon stock then i guess you get into
the problem of well who's gonna buy the
amazon stock because it doesn't really
have any use
i don't know
um
yeah after ubi every election will will
become
who's gonna pay for voters more yeah
now you want an alternative to ubi i'll
give you an alternative to ubi
post scarcity right that's a good
alternative
instead of making things this is cheap
instead of making things free you make
them
cheap right what sort of world we live
in would we live in
instead of an apple costing a dollar if
an apple cost a penny
that's a nice world right you want
everything to be
cheap so so it's not like like like
what what you don't want is to give
people free money but if you make it so
it becomes very
easy for people to get enough money to
afford
food and housing uh that's great
right and and you want to do this by um
well i mean in the food case food is
already pretty cheap
in the housing case you want to do this
by increasing supply
isn't cheapness relative well not
exactly no
so it comes down to what your
fundamental backing currency is
if your backing currency is human labor
it's much nicer if we live in a world
where it only takes one minute to
produce an apple
instead of one hour to produce an apple
and this is the power of technology
uh cheap is is all for fun it's a little
social experiment it's not
it certainly doesn't have a utilitarian
purpose like that
um what if c burns older coins the older
a coin is the less it's worth
well so you don't actually need to burn
the older coins i think or
is that any different from inflation is
that any different from straight up just
i mean cheap is an inflationary currency
uh the miners you issue new ones
uh it inflates i think two coins are
super block
um
so you can do yeah i does inflation
remove
speculators
it helps against them
oh you're saying in inflation the value
decrease is not evident
inflation is hidden because yeah
i'm not sure that that matters all that
much
um how can you have things cheap when
you're optimizing for profits and
capitalism there are the very same
people are getting squeezed out now is
the working class who need to be paid
more well
paid more is all relative right they can
pass their 15
an hour minimum wage but if you've
deflated the currency such that 15
is now worth half as much deflation
fucks over the
if you think of the rich people as
having assets and the poor people's
having debt
um inflation is great for both of those
two classes right
if you have debt inflation's incredible
if i owe someone ten thousand dollars
and the currency deflates 10x well it's
effectively like i only owe them a
thousand right because denominated in
dollars like debts held in in usd
um in the rich people if i own apple
stock i don't care if there's inflation
right the the iphones are still you know
an iphone is still an iphone the iphone
didn't inflate
um so
yeah i mean it it it it just screws over
people who don't have debt and don't
have assets
people who work for salary which you
know no bosses are going to say oh 10x
raises right
um
what's the point of launching a
cryptocurrency
did i launch a fucking cryptocurrency
stop using that language
you know again that's the person who
doesn't get it
right sorry sorry sorry marcus but like
i'm not launching a cryptocurrency i
built this little thing
you can play or not play i'm gonna ban
you for it but like because i i think i
i don't think your intentions are bad
but like oh
don't use that language all right
how about this you know what a nice
thing about this little subscriber chat
is
i'm gonna shame you and i can shame you
because you have some stake in the game
right you have some stake in the game by
subscribing
i don't mean to be me but that's all i
can be
uh
some people are going to be way too into
being shamed it's true
it's true you can't see you can't even
do that can't even do that so you have
to ban
them right we need twitter with stakes
um yeah when i was coding i i just like
i wasn't really thinking out loud
because i've already kind of thought
this through i'll just
i'll finish i'll finish coding this uh
off stream i'll use the bathroom and i
get some water
you know i'd be interested to see the
real breakdown of who lost money on
gamestop
for some reason i don't think it was
melvin capital or at least if they did
lose money
they were a very small percentage of it
yeah reddit's the saddest one right
right reddit is the saddest
yo let's let's bring the ghost of aaron
schwartz back and you know
talk to him about it um
because they tried they did try and
you know i'll i'll bring i'll bring up
this talk success pool just once
this is reddit politics
right
um okay so there might be intelligent
conversation about this
there might be intelligent conversation
about this but now we're down to this
right
i've never heard of this person
i i
like imagine instead of
this being our politics our politics was
like
a a discussion group about
the kind of things we're talking about
here on this stream
right katy porter
tears into oil exec for claiming his
industry doesn't get special tax breaks
stacey abrams has a plan to
dismantle the filibuster and protect
voting rights clyburn
condemns lindsey graham for calling
covid aid to black farmers
quote rep come on
it's not news that's not none of that
stuff is
news so some rando ran some
ad with a gunshots at what
the cheery yo
yo i should have got those big spec
dollars
big spec dollars how about silver you
know
no body silver
how about amc
ah crater
oh i feel i feel like i need to take a
shower after going to our politics
um you know what and just to be fair
just to be fair people you're like
our politics is left-wing you know if
you just come over to the
the right wing i feel even worse showing
this one on stream
it's not even i don't even know the
donald dot win is with this like
patriots.win
democrat gun confiscation bill on the
floor of the house today i'm trying to
talk in my republican voice
thanks to biden we are now paying for
mentally ill men to join the military
mo brooks calls out democrats for
excluding aid to farmers who are white
all right
ah all right should we try our
lubricator
um no it's all toxic shit
um
you asked me if i'm left-wing i don't
even know what you mean by that
i'm uh progressive that's right
definitely not a conservative because
progressives are winners and
conservatives are losers
i mean it's true look at the story arc
of history even conservatives and
progressives know this
well i'm giving air time to it to look i
didn't really give air time to it we
didn't talk about it it's being spoken
about in that way
uh
it's not politics right
politics is a bellwether politics is a
bellwether let's
let's pick something less controversial
all right let's go to reddit science
our science right
cannabis production is generating large
amounts of gases that
heat up the earth's physical climate
moving weed production from indoor
facilities to greenhouses and the great
outdoors
would help to shrink the carbon
footprint of the nation's
legal cannabis industry
what the fuck is that
this is science
now
breaking the warp barrier for faster
than light
travel no you didn't right no you didn't
this is this this is clearly better than
this right like first off fuck off with
the nation shit what a science in
america
a new paper has shown that bitcoin
mining's energy consumption now
approaches australia's annual usage
eating oily fish twice a week reduces
cardiovascular risk
israelis create cancer drug without
animal tests
right researchers find one in five
healthcare workers experiencing
depression and anxiety during the
pandemic you like my tucker carlson
voice
all right all right all right all right
fine
we'll do hacker news right
i feel like we've done this before i
feel like we've done this before and i
feel like um
you know you guys see where where my
bias has come out right
so so they're showing you what's really
just wrong with reddit
right reddit reddit does it entirely uh
i mean hacker news is kind of harmless
shit
it's not it doesn't have that same toxic
it's trying to like like like like sell
you something
um like
whatever this is i'm already interested
right so okay here's my
there's my biases i don't know
cloudflare's cameras got
let's see what happened
hmm
first internal report of a twitter user
claiming to have access to our cameras
that they hacked into the all right
like there we go you know like they got
me with something right that's the first
thing worth clicking
is it is it useful i don't know
um this is because this was on netflix
i want a computer that i own like i've
never seen best before
oh the fire in the data center
all right like okay they got they got
stuff that i'm interested in
by the way i just look at this website
and like right away i see this website
and i like it
i like it you're not trying to show me
shit there's no calls to action
i have an idea in my mind i have in my
mind an idea
i want a computer that can be completely
autonomous but also can be used
to communicate securely with anyone on
the party
i mean that's an interesting line
i have a computer that is largely
designed to maximize the profits of the
computer industry
i'm not sure i agree with that
i don't agree with that
yeah i know like i'm yeah this right
here
is is is
i like it and i'm sympathetic to it
and like to be fair i have a blog that's
worse more poorly written than this
uh but like
this doesn't really make sense
you know what i bet even the hacker news
are they discussing this
[Music]
modern apple's not really spying on you
that much that
intel management engine yeah there's a
lot of hype around the intel management
engine
but like again
i have an apple m1 i don't know
look at this beautiful website
berkshirehathaway.com
oh what seriously
i see you
that's a cool example of chat this is
something see i would have never i would
have never known this
this is this is why i keep you guys he
around
still oh yeah you guys know this on
nissan.com
you know nissan.com isn't the uh is it
the car company
hipton you're on thin ice do does anyone
see what's wrong with hipton's comet
hipton's comment isn't i quote and again
because you have steak
if i have to give you another warning
it's band time
i can't i don't think you're doing it on
purpose right
but like i want you to think about that
question
like would you say apple is the most
trustworthy
my reply to that is who the fuck am i
right i i don't think you're doing it on
purpose and maybe
you know
you would you would do it on purpose
i don't know i'll give you one more try
to learn but if i have to talk to you
again
band time
um
oh
you can't do this though
you can't do that because it's not real
this is a much worse search engine than
google
i can't even find cheapy i was just
looking for cheap and i don't know where
it is
dick
yeah kind of
um hammer doesn't actually work it did
hammer isn't what you want
you can't fix this with a search engine
right you have to what you have to do is
you have to figure out how to
disincentivize
news ads in seo spam
like as long as there's money to be made
doing it
it will exist it will pop up in any way
shape or form
all right i'm seeing some bandworthy
questions here
you know what i'm gonna prove it how's
alex alex is great
and you're banned congratulations
we got the first one
um and it's not that there's anything
wrong with that question
again it's derailing and stupid and it's
about me
the stream's not about me
hiptin you're banned too congratulations
at least it wasn't me i had to think
about you again you're banned
right like the problem is that i had to
you right there by you saying
at least it wasn't me i again had to
think about you and put effort into you
get the fuck out of my stream
right
this this and and we're witnessing
examples of this behavior
today but see it's not it's not clear
and even my judgment isn't perfect maybe
i'm getting it wrong
um but it's good it's good seeing these
things play out in real time you know if
you ever go to couples
therapy you get to watch the dynamics of
your relationship play out in real time
so we get to watch the dynamics of
like these sort of people and internet
communities
right playing out in real time where
you know and and then people can
complain oh
you didn't write what all the rules were
but you can't write what all the rules
are
because as soon as you write what all
the rules are there's people who are
going to figure out how to exploit them
this is just the classical you know is
am i just rediscovering it
discovering all the old problems of
governance and
all that
yeah i mean you feel kind of afraid to
ask questions you should
feel kind of afraid to ask questions you
should genuinely think
am i contributing in a positive way to
this discussion
am i furthering the discussion or you
know am i derailing
am i am i
you know don't do that stuff it's it's
it's on everybody to kind of do that
oh there's definitely dumb questions um
here's an example of a dumb question
right so
if you have a question that's like
the answer doesn't matter either way
it's a dumb question
right like the answer isn't going to
change your behavior or
anybody's behavior if you're if you're
asking a question that's derailing a
conversation that's a dumb question
twitch is a fine place for discussions
we've we've been talking for like an
hour and i feel like we've had some
great conversations
i feel like most of it's been really
good
i'm sorry i'm in the wrong category um
this isn't how this started out it
started out as programming and then i
realized that
you know nobody was paying attention to
the programming anyway
uh oh yeah oh it does say that in the
description
just chatting pulls in the most trolls
to a chance yeah
um but you know what
here's here's here's a general rule of
thumb if you're asking a question about
me or you're asking something about
yourself
that's not a good question okay we're
here to kind of discuss
ideas
please pay 35 million for rocks
you know kind of i'm thinking back i'm
thinking back remember slashdot
oh i didn't realize it was a group
that is the top rated comment on
slashdot the top rated comment on
slashdot is
good that the cameras were hacked i hope
it exposed
quite a lot of abuse by jailers and
police
if it leads to the imprisonment or
firing of crooked employees
by the american
carceral state
i mean this one we can do right like
like
here's a simple test that would that's
the only comment that's expanded on here
the guy can't even spell disgrace right
do you think he has anything good to say
if you can't spell disgrace right
who cares about comments because
comments are what makes the internet
decentralized
find all combinations of a list
i don't understand how those are
combinations of a list
no it's not about i'm not talking about
intelligence
i'm talking about the fact that you know
it's just low effort you can't even
spell disgrace right everyone has access
to the same spell checkers
um
i don't know if any of you guys have
ever been on fat life but fat life does
this interesting thing where they don't
allow you to search
fat life based on age and location
actually based on age
gender and asl you you can't search
based on that
which you know those are like
interesting dynamics of dynamics where
you have like
you know i mean i would you know love a
dynamic like that if you really want to
use fat life like a dating site you
could
you could write something that does that
search for you
um
reddit does a decent job of making the
the good comments right you can access
the spell checkers in prison
it's like the miners complaining about
nice hash
[Music]
all right
the whole stream was a derailment
um i'm gonna just work on this myself i
don't really have anything more to say
about it
no one really follows it when i talk
about it you know and the fact that no
one really follows it
like these these these these crypto
streams are kind of over
by the fact that there's no pull
requests on the bridge right so so
nobody nobody was paying attention
to kind of what it was so you know if
i'm not
who who am i talking to right if you're
just here to see some fancy like
keyboard tricks like fuck off your
cancer
um
but this is my plan i'll build it slowly
off stream
uh i like that we had a nice
conversation
about internet communities uh
in general what are our takeaways
i implemented proof work that all works
would the internet be a better place if
people had to identify themselves with
their id so this is facebook right
you know people hate on these tech
companies a lot people hate on
people hate on on facebook i think gets
a lot of undue hate
you know it's almost pass a to hate on
facebook now facebook did this
facebook put a real name commenting
policy on everything and you can compare
the com some of my favorite comments on
the internet are youtube comments
whatever google's managed to do
youtube comments like um
i remember i remember the comments on
like gucci gang
uh
right i only came here for the comment
section my phone battery one percent
me listen this song my phone is shutting
down
that's hilarious
[Laughter]
that's a great comment
little pump the type of guy who sell the
phone to buy a free app
will pump the type of guy who would wake
up to take his sleeping pills
the type of guy to call the police
because someone stole his drugs
right these are these are at least
they're at least funny
and they're not toxic right
uh no notice how zero of the comments on
gucci gang are shilling for global
warming
which is great
it's a tradition to visit this comment
section once in a while
yeah gucci gang is a great song i agree
um but we can't listen to it because of
the riaa
ah all right i think that's a good note
to end it on
um i think that's kind of the end of the
crypto streams
nobody followed him you know
nobody follow them we'll get the bridge
to work uh
well i i'll i'm really just gonna put
more of this promotion on goku
um
wow wait this really there's really
eleven hundred
eleven eleven a hundred people watching
right now
because this is stuff people can relate
to and this is what people really want
in the world
not some stupid crypto bridges to move
value people really want a solution to
uh to to
internet communities being toxic
are you trolling with the number of
people that's insane for one of my
streams
holy shit we actually have that many
people are you trolling with the number
of people
um why do you reject people looking to
learn from an
engineer with experience like you right
so
let's let's break this comment down
why do you reject people looking to
learn
from an engineer with experience like
you
so first off you used me twice i i've
said
these streams aren't about me right
i don't reject people looking to learn
if you're
looking to learn the videos are on
youtube
the stream is on twitch i'm not banning
anybody who didn't comment
there's no this isn't this isn't like
you know this isn't like the
um if you're not against racism you're a
racist
if you're not against the terrorists
you're with the terrorists
no who i'm against is people who are
making
low quality comments if you're here to
learn welcome
i like you i genuinely do like you
if you're here to expect me
to spend my time to specifically educate
you
get the fuck out right like that's not
what this
is and nobody else wants to watch that
right um
we get people sometimes who say they
want to come to work for comma for free
and i think i've gone on this rant
before
and sometime i'll be brutal against them
on the phone
you know because they don't want to come
work at comma for free
they want to come learn and jobs pay you
money
but if you want education you pay you
want to learn from me
enroll in my college it's 50 grand a
year right
like that's how we'll do it i don't even
like
we'll see i'm i'm obviously trolling
about that but like
like if you have
so so then you say i don't know this
whole elitism thing is weird
yes there's elitism there's elitism
based on real skill
if you come and you have something to
contribute to the conversation
you are a good person if you come and
you want to ask stupid questions and
derail
conversations you are a bad person right
sorry not everybody is equal some people
are good people
and some people are bad people and it's
not intrinsic you know
you could have been a bad person you can
see or the error in your ways and you
can fix it
right but if you're gonna come here and
you're gonna
bring down the level of discourse nobody
wants you here
get the fuck out or shut up right
oh wow that's harsh that's harsh there's
no room for subtlety on the internet
and i hate that i have to be that harsh
and staying right
i'm not gonna ban it because i don't
think he gets it
but i hope you guys get what i'm saying
right i'm not look i'm a little upset
that nobody submitted a pr
but you know that that's more like you
know look
fundamentally i do want to do things
that there are demand for like i'm happy
when i see a lot of viewers on the
stream
um you know that's just uh people are
pretty good at like it's a good like
bellwether of like where i should be
focusing my energy
um yeah
uh elitism is great just make it based
on skill
right don't make it based on bullshit
because we need that you know who did
you think about think about
think about a doctor right do you want
to go to a doctor who
who has mad doctor skills who's going to
fix your problem
i went to i went to physical therapy
this morning i
have chest pain i used to go to physical
therapy for jaw pain
guy's a genius like like just
the way he managed to like push exactly
where the pain is tell me which rib
is wrong where the like like how it's
dislocated i'm amazed
right and like like i have so much
respect for skill
right and that's what i mean by that you
can be like it's elitist and you can't
be elitist
no everyone's elitist do i want to go to
a doctor who doesn't know that these
things are even ribs
no right there's nothing wrong with that
the problem with elitism is when it's
based on bullshit and gatekeeping and
credentialism
elitist is this meritocracy god you can
barely even say that word anymore
right you know
yes i guess it kind of is but the word
the the word merit is
yeah the reason i don't use the word
meritocracy is because the word merit
is not exactly synonymous with skill
right someone earns a merit badge
someone's given a distinction of merit
right
i don't want that because that's the
same gatekeeping
i mean skill and like ability
meritocracy is elitism based on still i
think that's what it used to mean i i
don't
like the word unfortunately also
conjures up i remember like the github
meritocracy carpet incident and
it's just you don't want to use loaded
words if you don't have to
skelocracy no it's stupid it's stupid
i let's get rid of aquasies right
um okay
please don't ban me why would i ban you
right don't say that
don't say that if you're saying please
don't ban me again you're making a
comment about you
don't make comments about you and don't
make comments about me we're here to
explore ideas
there should be transparency about merit
why do you think there's not
yeah i have a kind of uh
i always have a concern about you know
worrying about future generations
because it seems like everybody's
worried about future generations
and it seems like i mean unless you
think that things have been getting
worse
throughout history
i think that overall future generations
are
going to be okay um
i mean i will more worry about like you
know the next five years the next 10
years things that i'm going to
to live through
um
all right we're good we're good on the
viewer updates it's interesting that
there's over a thousand for this
when i've really done nothing on the
stream it's it's really been just a
talking hour
so i this is clearly what the demand is
for the people
uh bitvote.net
if you want to rick roll me you can rick
roll me just don't link me to tub girl
you know
ah god god
please change that
an ambitious tool to help empower
digital democracy and collaboration on a
large scale
[Laughter]
i mean they're not exactly these awards
some people say
most people think researchers believe
but like you know we're kind of in that
in that uh
uh i'll tolerate that about the porn
i don't know i i have a
i have a bit of a aversion to people who
rail against
porn like i usually put them in like a
certain type of group i think like the
the ceo of gab is like super anti-porn
i don't know i watch porn i like it i
think it provides value to my life
um i could see how people could become
addicted to it but i think people are
addicted to
a lot of things that are stupider than
porn i don't know
which is itself said that rant hour is
popular well so
this is i mean this is bike shedding
right
uh you know
uh this job was to improve the plans for
nuclear power plant the majority of its
time was spent on discussions about
relatively minor but easy to grasp
issues such as what material should be
used for the bike shed
right so it's it's it's that
everybody feels that they can kind of
contribute to this where you know if you
don't know
crypto and you don't want to put an
effort to play along you can kind of
you know that and that's why these these
streams are more popular
um i don't know i'm not that worried
about porn
just as i've never worried about a
communication like
medium in general no i think that this
is going to be fixed i am
overall i'm hopeful for this um
overall i'm hopeful that in the next
10 years we're going to figure out how
to build
good internet communities
um is this what i should do next
i wanted to build a dating app i think i
can fix a lot of the problems with
dating apps
i don't know the dating app one i think
i could actually do a lot for
the general purpose internet community
one
maybe it's different for every community
maybe there isn't a general purpose
way to fix this no the dating has all
the wrong incentives
if someone's interested if someone's
seriously out there you know what
if someone out there works at and has
real power at a dating app
and you're not interested in trying to
maximize your bottom line but you're
trying to maximize like
enjoyable encounters for people uh i
have a lot of thoughts on the topic
um
well you don't quite want an iq filter
but you want to imagine people on iq
matching people on attractiveness
i mean and that's that's another that's
another sad truth about about uh
dating apps it's you you have an
objective uh attractiveness
you you you have an attractiveness from
zero to ten
uh and you are only ever going to be
uh you know you're not really going to
be able to seriously date up
um and you won't really be okay with
yourself if you're dating down
and this stuff is fairly objective
and this is another one of these maybe
it's better we didn't know but it's true
one person six is another person's nine
you're going to get some amount of uh
spread but there are some things that
are just universally unattractive
like being overweight right being
overweight is just
unattractive um
you now again the the beautiful thing
about that like you know i have
a lot more sympathy for like short men
than i do for
uh you know people who are who are
overweight
uh because you know if you're short well
not too much you can do if you are uh if
you're overweight
you can you can fix that it's not easy
but you can
there's plenty of people who have um
if you talk about objective
attractiveness or intelligence google
play will pull that app down
really is that really where we've gotten
to
i don't know if i believe that
um yeah surgery is a very extreme
you know yeah the subway guy
there's plenty of examples you can look
i mean i've experienced
like i haven't been seriously overweight
but i've been like
you know 20 pounds overweight at some
point in my life and like you download
my fitness pal you start counting your
calories and
you know it works calories and calories
out
some people have yeah but for most
people calories and calories out
um across
yeah and again it's not everybody some
people make it it work for themselves
but there are like
you know when you have dating apps
you're just going to frustrate
everybody involved if you're if you're
not matching well on looks at all
right the same thing with intelligence
right you're going to want to match
on intelligence but but the real thing
that you fundamentally want to do
and if anybody out there is making a
dating app please take my one bit of
advice
there's a few dating apps that do this
but they're way less mainstream charge
men money if you have an app
that is 90 guys and 10 women
charge men money until it's 50 50.
simple
ah
if you can't have a dating app without
photos but you should kind of
de-emphasize the photos
again that photos tell you yeah look
photos would not be a problem if you
were
grouping people based on looks
but tinder
tinder is not tinder does not care
tinder wants to keep you in the app
right the incentives are all wrong for
tinder
uh even if they're doing attractiveness
elos like
clubhouse has tanks so hard
um
linkedin is the most terrible dating app
you know uh
linkedin i think is the most toxic of
all the social networks
but its toxicity is less in your face
and then you can figure this out
when you think about what people value i
think instagram is one of the least
toxic i like instagram follow me on
instagram instagram.com
i have a blue check now um instagram
is kind of about beauty
beauty is a nice value right
what is linkedin about
linkedin is about corporate letter
climbing
twitter's about hot takes i haven't been
on facebook in 10 years so i couldn't
tell you what it was about
um but i i think linkedin is is the most
toxic of all the social networks
um actually going even further than
instagram i'd say the least toxic of all
the social networks is github
um
facebook is posting your political views
nobody asked for
i i don't like tick tock
uh here's something here's something i
like about about github
if you want to get a pretty good idea
pretty quickly of whether someone's a
good programmer or not
look at this right go on your github
i'm sorry i'm giving away one of kama's
hiring things
but go on your github and look at this
right if yours looks like mine you're
probably a good programmer
right like it looks like look you know
why because i code
almost every day i code on the weekends
and go back through time and you can
find all the same shit
some years i coded more than others but
it's been pretty consistent
you know to back when i wasn't really a
good programmer yeah or actually also
when github was kind of less popular
a lot of this other stuff isn't on here
but yeah i guess really starting with
comma
you know i put everything on github
yeah it's not it's not perfect
um you you you can't you can't look at
this and say it's perfect we do not
we will not we will not exclude somebody
because they uh don't have this
but if they do have it it's a pretty
good sign
in general you wouldn't find that people
that program more are better at
programming
what do you mean i think it is
universally true that the people who do
something
more are better at it the correlation is
not perfect but like
it's pretty obviously true the people
who sail more are better sailors
the people who ice climb more are better
ice climbers
you could push junk and if you had the
commitment
to push junk every day for many years
i'm gonna have a lot of questions about
you
if you do it at work you really don't
have the energy to do github stuff
what do you mean
maybe that's you that's not me
i i worked and look on the weekends
my weekend contributions usually weren't
they were the bullshit like twitchcock
right you know and like so during the
week i'd contribute to common ai
picked a totally random week and during
the the weekend i'd contribute to my
other repos right
let me get up junk pushers background
elixir project on heroku
free tier the interesting thing about
that is
you don't think i look you know when
we're thinking about interviewing when
we're thinking about hiring someone a
comma
okay what are they doing what are they
contributing to
um when i look at my github i'm a little
disappointed that actually most of the
contributions are just to my repos
or just to uh commas repos
right the best people are contributing
all over the place
um do we still have a lot of people
cool we do all right if there's
one thing i almost feel like this is the
kind of thing that i could get banned
for saying
but if there's one thing that i want
all of you i got a big audience right
now
to take away and it's this
some people are better than other people
now with that said
how good of a person you are is not
fixed
every day you wake up and you take
actions
and your actions are either making you a
better person
keeping you the same or making you a
worse person
i guess this is turning into general you
know motivation bullshit but
there's almost it's practically taboo to
say this that like
no not everybody's the same some people
are better than others
right
now you're not better than me
right you're not better to other people
you're better to yourself
generic motivation shit can't ban me for
that right
um but yeah
i think that's a decent thing to kind of
end the stream on
no i'm not talking about when i say
better
i'm not talking about to me i'm not
talking about to the world there
certainly is objective skill out there
i'm talking about the you
and if you are really honest with
yourself and you search deep down you
know
you know whether you're doing well or
you know whether you're doing badly
it's only you know to
only only only you know you can kind of
judge yourself
right but don't you have to honestly
judge yourself
don't be a hypocrite don't judge you
have to kind of judge yourself based on
the same standards you judge other
people
um ooh be better than me oh man i love
people who are better than me
man i'm so happy i'm so happy when i
meet people who know more things about
things than i do
so happy
you know
i'm reading the comments and i see a few
people who should be banned and i think
you can all spot them
right i see two people right now who
should be banned
and you can think about why they should
be banned
stay live until viewers dip on their uh
dip under 1k
you spot them good everyone knows them
everyone sees you
don't do it
good one of them identified themselves
great
don't let github become linkedin for
programmers
it kind of can't um
github can certainly take a worse turn
but fundamentally as long as they have
like repositories
as long as they have a place where
actual work is being done
let's let's push our stuff to bridge by
the way
uh would i employ someone with spotty
github history yeah yeah
it's not it's not a disqualifier
oh my god wow yeah you can do it in the
past
you know what to be honest if somebody
like did this and they did it as a joke
like i'd respect that but then if people
stood
if i found out somebody did this and
they did this seriously
to try to fool somebody then fuck them
this is a joke because it's funny
yo who wrote this
by the way that's pretty good
this person's a good programmer
as you can tell look at them coding on
the weekends
we definitely look at what the commits
are
gets places by spit get up spice make
some progress
um well so we're back to back to oh it's
not good heart good heart i'm gonna
remember his name one of these times
yeah
so you know if once a measure becomes a
target it ceases to be a good measure
so i feel like i kind of screwed up by
telling you about this
but clearly people are already very
aware of it so
you know
um like i think doing it genuinely
if you just genuinely like resolved to
you know
commit some code every day and you wrote
some real code yeah you'd probably
become a better programmer i think you
would
okay this really turned into just
talking
oh why do i do this you know why does it
why does it devolve into this
it devolves into this all right all
right we're gonna
i'll re-watch this video and i'll
understand how i end up derailed
this whole video was one big derailment
by twitch chat you guys have a lot of
power
you know
if it wasn't for twitch chat we would
have actually done what was in the title
of the video
it's my reaction to twitch chat it's our
toxic interaction
we need to go to couples therapy
um
it was the moment we entered sub only
yeah well but then we have to think
about why we entered sub only
if you don't look at chat you get work
done i know
you know with talking yeah you're
talking i programmed the minds look i'm
not i don't care man
it's just a way for me to think right i
could never if i had like rehearsed
these
before i'd never do it you know
i'm a product of my environment right so
are you
oh you have a pr on bridge what do we
got beautiful markdown okay
this is shitty looking markdown
let's see what your markdown looks like
this looks shitty make it more beautiful
to be fair maybe it's better than what i
had but only marginally
ah those aren't real comments you know
last toxic talk wow and you know it's
toxic
sorry get out self-awareness is not an
excuse
how does one solve this is it about
molding humans through technology
platform issue only or is it not enough
humans will still fuck it up in some way
maybe uh i'll leave you guys with this
nakamoto consensus algorithm
greatest contribution to computer
science in the millennium
one day we're going to figure out how to
build these systems real
same kind of problems trustless
consensus
people actually solve this i think they
solve a lot of these problems
you guys are getting it like you guys
can know
you know
um there are definitely good and bad
people
there's also good and bad structure
i'm not saying people are forever bad
but like you
you you have to you know sorry not all
people have equal worth
like do these things have to be said
today
these are these are the kind of things
that they'll practically like like
like ban you for saying but it's true
and everybody knows it
the emperor has no clothes
luanne payne gifting subs thank you
um good and bad or subjective i don't
think they are
i think there's some amount of
subjectivity i think it's like
attractiveness
uh luanne payne for gifting subs you of
course get to ask a question
maybe we need a class system with more
transparent rules i like that
i like that you know
one of the things i said at comma early
on about office politics
was that you know some companies like
google will try to claim that they have
no politics
um comma has politics they're all mine
and don't violate them
this actually works pretty well
right because you know i'm not
benevolent dictator is the best as long
as you can keep a dictator benevolent
and am i benevolent i feel like i do my
best my
i guess you can judge my benevolence
based on my
allegiance to the mission right and then
if you don't agree with the mission com
is not for you in the first place
uh you know the mission is to solve
self-driving cars while delivering
shippable intermediaries
and there will be no politics except
mine
but you can't have there will be no
politics because if you have no politics
you know
benevolent dictators are blinded by the
ability to see with their own eyes i
know
i know no look i definitely suffer from
this i
i have i have some limitations
as as a person uh
i mean i try to work on them i try to
get better
i wish i could be better i want to be
better
nine ways to be a better person and be
happy
hmm one of the sequences was about this
uh kowski had some had some japanese
phrase that means i want to be better
this talk just reminds me of unqualified
reservations
yeah i definitely read it um
it's a pretty big influence
uh i don't know but then i you know i
don't really agree with where
it's it's it's sad to me that
you know neo reaction got like
associated with
these like alt-right kind of people
you know i i think there really are a
lot of great ideas there
and i think that you know
don't don't present them as
conservative they're not conservative
ideas
i think they're progressive ideas i
think they're the ideas that will lead
to progress
for humanity not we're not trying to go
back
to you know it loses me when people talk
about going back to medieval
feudal fiefdom kind of shit you know
like that's not that's not better
that world sucked right or you'll hear
you'll hear near reaction arguments
where it's like
there was no crime in victorian england
yeah there's no crime in glenrock new
jersey
either right there's there's places
today where there's no crime
you know um
yeah no i think i think uh i think i
think mobile tasks and i i hope so
when you don't you know you just don't
don't
don't like
if the people talking about it are
really very angry
it's not good uh
it's not good politics all right we're
gonna need
you know
should i start praying maybe i'll start
praying for caesar
i don't want to be the guy who decides
who gets banned and who doesn't
i want caesar to do it
and i want caesar to you know i will
know caesar by
like him knowing things and and
oh yes i want to become stronger yes yes
thank you
um
uh i was at a dinner once
um but some
let's say tech people right say
conservative tech people
and the phrase that i kept having in my
head was
positive vision for the future
i want a positive vision for the future
i think elon's the closest we have you
know if anyone decided that
well let's see maybe that's his plan
right you know i'm doing my tipping off
the fence thingy one's plan
uh get enough uh
all right so so you can kind of do it by
um
you guys should subscribe to gray mirror
if you don't uh curtis kind of talks
about this a little i i disagree with
this idea of an orbital stack but
you could certainly do it as a quick
power grab right if you can get mass
into space
right like mass in space is is is a
great weapon
right if i have if i have if i have a
ton
in space and it has a little engine on
it
and i can orbit it i can decide exactly
where i want it to smack into the earth
right so you can you can you can hold
the planet hostage and
take over
um
caesar was beneath god well yeah
hey you know what i won't i won't be
closed-minded i'm
hold out hope for jesus for the second
coming of jesus too like a legit second
coming of jesus
right not some like like like like you
know
wacko who calls himself the second
coming of jesus but i mean like
who's actually gonna do it
jesus caesar someone from historic
history please come please god if you're
out there uh
i'll just i'm serious uh
plea please god if you're out there um
humanity is falling into a hole
and
we have so much potential
i pray that you send someone
who can save us
we need it now more than ever we need it
before
we fall to the cancer of the machines
we need it before we destroy ourselves
in a stupid war
uh we need it before we create horrific
institutions like world government um
please god hear my prayer amen
i don't know i'm not very good at
praying george you're here no worries
uh thank you thank you um who's the one
the one jesus caesar
uh
neo satoshi yeah
i don't know but not
you know i never really prayed before
because i'm not too much of a believer
uh the first of food wins and mass
extinction
is pushed and uh god
no it's not um
i i don't i don't it won't look like me
hey my ma
you know i'm i'm i'm not
i just think about it i think about
because i think like okay what's wrong
with me and like what
it's not it's not that i like lack
knowledge
like i don't expect this person to have
clearly more knowledge about things that
i do
but they will sort of have a seriousness
that i don't
right when they speak they'll sort of be
a
a gravity with which they speak
i'm i'm uh uh
i'm a troll all right i always have been
and it was will be
uh you know i'm here to i'm here to
fight
with with the right with the right
the right story i will join your army
uh
uh i i worry that one day it'll be too
late
here's here's an analogy that i give a
lot i've probably given it on streams
before
you can think of society as a bowling
ball rolling down a hill
and at the top of the hill the bowling
ball isn't going fast
so if you brush up against it with a
stick or even just breathe on it
the bowling ball will change course
slightly but as the bowling ball picks
up speed
it becomes harder and harder to change
its course
and you can see the tree and you can see
that you're heading for it but you know
it may be no amount of breathing or
stick poking is going to change it
uh you know
i pray caesar comes to give it a swift
kick with his boot
uh out of the out of the path of the
tree
um to give some concreteness to this
analogy what i mean by the tree is the
singularity
all right what i mean by the and what i
mean by the singularity is the day when
there is nothing that humans can do that
machines can't do better
this day is coming it's just a matter of
time
and there's nothing inherently wrong
with that
if we structure things correctly but if
we structure things to be
optimization based and hyper competitive
well you know do you really want to live
on
the machines ubi is that really what you
want for your life
right maybe maybe if the machines are
benign that's what they'll give us
uh you know
ubi and better birth control right you
can do that
but i don't want that that's not what i
want for the future humanity
okay
humor is the only story that makes sense
when no others do i've heard things like
this before
the old guards
what other option is there
well
start over on mars you can't start over
on mars
what i would do if i actually built
i probably said this one before what i
would do if i actually built
a cursively self-improving super
intelligent ai and i had it i had it
like sitting over there
um what i would try to have it do is
build me
a uh ship and
accelerate that ship to as close as i
can possibly get to light speed
and get the fuck out of here right
at least i'd have some time to think
um you know mars
if you guys are thinking about mars i
have a bunch of land out in san diego
uh and it doesn't have any uh power or
water or sewer systems or
shelter but it has air and already there
it's not really somewhere i want to live
you know i live in my beautiful little
slice of the cloud here
ah i spent more time reading
um
no it has to but space is such a
modernist narrative right
what is our future as information
god and this stuff's hard to think about
because like
it's like bike shedding this is the
problem with the jailbreaking the
simulation talk that got some of my
lowest brow audience members ever
you know hey guys we're talking about
good and bad i got you know why do i
fall for this shit there's 1200 people
in here
you guys are a lower quality audience
than the audience that sits around to
see me grind out solidity
no offense audience that's true
i'll have to clean up space to get out
i'm not sure about that
i think it's less bad than we think i
don't know you see nothing is really
that bad
everything's kind of nice haven't you
guys seen the economy remember the time
we had a pandemic
economy doesn't remember our economy
remembers oh there was a little dip
oh there's a little dip but then the
economy keeps right on economying and
things keep going up
prevent the dip by providing massive
liquidity injections
so i don't know everything's pretty good
there was a sale yeah everything was on
sale for a little bit
the stock market had a sale
we're living in the most interesting
times in history enjoy and spread love
i like you you're a good commenter and
we'll leave it on that note
we are living in the most interesting
times in history
enjoy and spread love good afternoon
everybody
and enjoy the rest of your day bye
WEBVTT
Kind: captions
Language: en
Bimbopapirrin: PogChamp
Bimbopapirrin: Maybe Muted?
slovn1k: no sound bro
suurrend3r: no sound
suurrend3r: PogChamp PogChamp PogChamp
808kid: No audio
suurrend3r: yeah
Bimbopapirrin: We Good Bow'/
Marvi182: yes
suurrend3r: now it works
slovn1k: yeap it's on now
808kid: Yup
Bimbopapirrin: cheer5 Now its good
slovn1k: amazing
suurrend3r: Yeah use that please
quillford: sounded better with built in mic but still fine
coProof: Noooo I can’t right now
myaocat: hello geohot
twitchistrash788: Yo
coProof: What are you doing
myaocat: its geohot and those who dont know I'm getting sue by sony. (dj sound)
coProof: Okay bye I gotta go hang w a girl
ronaldlangeveld: good to see a python coder :D
barin122: lol
barin122: whats your keyboard, it sounds freaking amazing
myaocat: lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE
Zealeigh: What seekrit? I missed it? Kappa
aresfour: geohot I love seing you hacking
barin122: Hard to tell the name, looks even better than it sounds though
suurrend3r: essskettiiitt
Marvi182: das keyboard?
myaocat: keyboard for real hackers
twitchistrash788: Be careful using Spotify, accounts get leaked everyday
suurrend3r: LUL
Bryanswagbeast: Hello World!
Bryanswagbeast: mrmuff21 DrinkPurple
myaocat: how something from random is secret?
OPHaru: OMEGALUL
twitchistrash788: Lmao wtf
slimydude: lmfao
suurrend3r: lmaaaaoo
twitchistrash788: This is the state of the modern media
myaocat: now rap about bch!! 😎
memoryleak: lmao
OPHaru: thanks geohot, i am going to moon with my bch now
Bryanswagbeast: Fuck Politics
myaocat: lupoGG lupoGG lupoGG lupoGG lupoGG lupoGG lupoGG
twitchistrash788: The media in general has gone to shit
twitchistrash788: just sensationalism
myaocat: lupoTHINK
thecameroncobb: Please live stream more
Bryanswagbeast: Can someone help me with something regarding my laptop?
thecameroncobb: @Bryanswagbeast whats up?
myaocat: @tomcr00s3 how did you sent money without balance in your previous stream?
Marvi182: das keyboard? with black keycaps?
Bryanswagbeast: so i disassembled my laptopto replace the thermal paste and apparently i fucked up something that the display is blank now :(
Bryanswagbeast: sorry for autocorrect
myaocat: hahaahaha
myaocat: maybe it's time to change profile cash
thecameroncobb: @Bryanswagbeast like... your screen won't display anything?
myaocat: i have etherum. do you want eth?
Bryanswagbeast: yup but the led on the caps is still on
j4m3s_b0nd: which keyboard is that?
j4m3s_b0nd: model?
twitchistrash788: All I have is BAT lol
Bryanswagbeast: and the logo hp on the back is still on
Marvi182: i think thats a das keyboard
OPHaru: SELLOUT
myaocat: @tomcr00s3 i dont really have money and stop ignoring me. do you want eth?
thecameroncobb: @Bryanswagbeast you might have damaged the ribbon cable leading to the screen. I would recommend that you check that and disconnect and reconnect the ribbon cable
slimydude: do eet
Bryanswagbeast: alright thanks ill give it a try
twitchistrash788: Yeah they send free BAT periodically
twitchistrash788: But it's mostly useless for now
Bryanswagbeast: well i did disassembled it carefully
myaocat: open your wallets people
Bryanswagbeast: hey geo can yoy please send me money so i can buy a new laptop? @tomcr00s3
myaocat: lupoLONK
Bryanswagbeast: lmao
thecameroncobb: I don't have any crypto rn. If someone tells me where I can buy some and send it instantly I'll do it
myaocat: i send you eth cause fees on binance is shit
blackburn1911: hi people
blackburn1911: !uptime
myaocat: @thecameroncobb from private people or exchanges
barin122: drive your self driving car dude
barin122: who needs to run when you can be a gangsta in the self driving car lol
barin122: fair enough
thecameroncobb: @tomcr00s3 why aren't you on Instagram?
myaocat: or twitter
myaocat: if media talks about you it means you are worthy
twitchistrash788: Zuck
suurrend3r: Facebook
thecameroncobb: facebook
suurrend3r: Zuck = Facebook, Instagram, WhatsApp o.O
myaocat: that was fast transaction
thecameroncobb: You should go running...
myaocat: with btc you need to pay a lot money for transaction
twitchistrash788: lmfao
thecameroncobb: lmaooooo
magarky: hahahah
suurrend3r: LUL
magarky: LUL
un3okapi: LUL
igorovich: bring em down
blackburn1911: @tomcr00s3 how you learned about AI?
myaocat: lupoPOGGERS lupoPOGGERS
un3okapi: Yes.
kPrimal: a l e x j o n e s
thecameroncobb: Alex Jones
un3okapi: you're fine. :/
myaocat: oh no
xEHLE_: no, but he will appear behind you
myaocat: dont
kPrimal: alex jones alex jones alex jones
myaocat: lol
myaocat: america is after you now
OPHaru: don't refresh guys, stream offline forsenS
thecameroncobb: You should implement text-to-speech on your streams
myaocat: lupoPLS lupoPLS
memoryleak: Kappa
fwef64: @tomcr00s3 back to using google chrome I see
un3okapi: it's online Kappa
Captainmontereyjack: hobbTos hobbTos hobbTos
magarky: Jebaited
deep_40k: Play the piano behind you
myaocat: lupoWIFE lupoWIFE lupoWIFE lupoWIFE lupoWIFE
OPHaru: LUL
twitchistrash788: You gotta use FireFox
twitchistrash788: Way faster and leaner
twitchistrash788: plus it's built using Rust
barin122: Chrome is faster than Firefox on mac though
un3okapi: use brave :^)
thecameroncobb: Tor &gt;;)
twitchistrash788: Chrome crashes and lags when I launch it
twitchistrash788: I use Brave occasionally
thecameroncobb: Tor browser ftw &gt;:)
twitchistrash788: Yep Tor=Firefox   security   privacy
un3okapi:  illegal fire arms   drugs   cp
thecameroncobb: @un3okapi true
twitchistrash788: lmao
jurodiwy_777: LUL
un3okapi: Can someone steal the money this time?
G07syvk9: sorry im poor
Madscars: what car you drive?
kPrimal: lamborghini tractor
blackburn1911: alias money="subscribe tomcr00s3"
cybermajestic: no sound
cIafran: @cybermajestic fine for me
vtcN_: that mouse scroll wheel sounds like a g502
juniperus1976: @cybermajestic all fine..
un3okapi: @vtcN_ LUL
slimydude: KappaPride
kripp_lover: crypto chad
cybermajestic: geohot hello
vtcN_: un3okapi LUL i have the same mouse, so was familar
myaocat: crypto is future?
twitchistrash788: virgin
kPrimal: crypto virgin
Bimbopapirrin: pwnNB
fn_mad: Sup
twitchistrash788: physical money virgin
un3okapi: @vtcN_ good ear SeemsGood
darrenofsky: what is your opinion on vscode?
cybermajestic: why you use nickname toomcroose, you nickname is geohot
OPHaru: bitcoin cash is the real bitcoin SeemsGood
cybermajestic: ?
suurrend3r: when geohot says "I don't know man" it really means "hell no".
suurrend3r: LUL
cromize: would you recommend going to study computer security these days?
thecameroncobb: @cromize yes
cybermajestic: @tomcr00s3 you play game?
jurodiwy_777: Dota stream when?
cybermajestic: plays dota
KingKewpa: is what youre doing the same as what wallets do to send txs
cybermajestic: hackers 1995))))
alexlucas_: What mac do you use?
lolegendal: hello
blackburn1911: RitzMitz
un3okapi: Kappa /
delta__vee: o/
jurodiwy_777:  4Head /
OPHaru: i do :)
kimmilol: Kappa /
jurodiwy_777: 4Head /
twitchistrash788: lmao
twitchistrash788: Try Nim
twitchistrash788: Nim is like Python   the Speed of C   Macros of Lisp
MrSnoopDog: erlang
thecameroncobb: Write your next project in Scratch
slimydude: factor Kappa
jurodiwy_777: what time it is where you live?
blackburn1911: create your own language
FalconJet_: try solving interview questions as fast as you can
un3okapi: speedrun making you own OS 4Head
foxubu: What happened?
denim_lap: all the best man
thecameroncobb: See... I am trying to trade some of my TRON for some BCH in Binance right now but they are "undergoing system maintenance" -_-
gpucluster: i remember when i unlock iphone 2g with geohot hardware unlock method , good times
thecameroncobb: Geo should grow his hair long like it was when he made that iPhone video
twitchistrash788: VS Code is nice
un3okapi: jet brains is better :^)
VertXY: using Scratch the programming language? Kappa
twitchistrash788: I can barely run Jet Brains IDE
twitchistrash788: They're so heavy
un3okapi: true :^)
Tuchopi: imlauer se la come con frutas
suurrend3r: @Tuchopi LUL LUL
foxubu: so that the money gets stolen again? lol
suurrend3r: @Tuchopi only english papu
Tuchopi: @suurrend3r ñ
gpucluster: I heard, or he asked to send him money? If you want money you need start PUBG or DOTA)))
OPHaru: lol no^
suurrend3r: LUL
foxubu: Ordering food 1:40 AM? Lol
Tuchopi: @suurrend3r LMAO
suurrend3r: @Tuchopi hahahah
ziggyzergling: LUL
yagurastation: Molo! from UTC 2
blackburn1911: hack uber to get free food
denim_lap: :(
Tuchopi: Hack mcdonalds to get vegan burguer
denim_lap: geohot
FalconJet_: ask for light ice
twitchistrash788: wow
un3okapi: no wtf
twitchistrash788: SF prices
un3okapi: you crazy?
TucoBenedictoPacificoJMR: could you share your dotfiles pls?
Tuchopi: Hack ice and make it hot
blackburn1911: hack McDonalds to get healthy food
denim_lap: ok guys
vtcN_: i put my ice in the microwave when im thirsty
suurrend3r: @Tuchopi he is not doing any hacking now
Tuchopi: @suurrend3r he's doing imlauer se la come con frutas
OPHaru: hack bch for free crypto
suurrend3r: he is retired from hacking
un3okapi: @vtcN_ do you put water in the freezer when you're hungry? 8^)
gpucluster: How much is his elo rating?'
TucoBenedictoPacificoJMR: over 9000
akalioceania: How much adderall did you take today lad?
gpucluster: nope , i see game in youtube / maybe 900))
FalconJet_: tim allen?
Tuchopi: tonald drump
thecameroncobb: Grow out your hair Geo
vtcN_: on your teeth
MessageOSRS: I like u :)
Tuchopi: he has been hacked away from reality
notbigd: scam
suurrend3r: hotz, politics is for losers?
thecameroncobb: Geo weren't you going to go for a run?
OPHaru: imagine delivering uber eats and u see geohotz PogChamp
Tuchopi: "Hello, i want to order a McHack with fritatas"
un3okapi: D:
foxubu: Lol
thecameroncobb: bruh
OPHaru: lmao
TheHandSolo: what the actual heck
OPHaru: i hacked ur order :)
vtcN_: re-order and hope it's the same guy
foxubu: When George freaks out :D
foxubu: Cute as hell lol
OPHaru: true
un3okapi: true
kishan0505: Whats up man
Tuchopi: Hack them and put 100 orders by random names and random places
kishan0505: !uptime
suurrend3r: there's no bot
kishan0505: Oh ok
Tuchopi: !hack
kishan0505: What ide does he use?
LuminousCS: vim
kishan0505: Ok thanks man
TheHandSolo: so if he keeps up these stream numbers he will be able to get partner on twitch with out even trying
TheHandSolo: nah your only affiliate. its the 1st step to partnered
TheHandSolo: u havent got the "tick" next to your name
myaocat: why don't you put yourself in science &amp; technology category? you will get more views too
TheHandSolo: 1000% agree
myaocat: c&amp;p stack overflow
myaocat: @tomcr00s3 not sure how but if you will be in science &amp; technology you will be 1st there
gucci_uzi: cheer10 coding sucks to learn
roosterhax: its kinda complex doing a crypto transaction, the really hax way, thats why it shouldn't be suckie
myaocat: why is it printing 2 ip address?
newtomcroose: @tomcr00s3 bro pls dont fall on my face
myaocat: i wish i could pay subs with etherium because fee is only 0.01eth
newtomcroose: @tomcr00s3 evrybody doing bitcoin
newtomcroose: yu
newtomcroose: Hello
suurrend3r: This is hard af
myaocat: ezpz
newtomcroose: hello
newtomcroose: @tomcr00s3 hello my name is jeff
insaeq: @newtomcroose kamikaze quotes :0
jeromez: what is your tmux prefix
insaeq: dlxxF
newtomcroose: My name is jeff . please call me jeff
newtomcroose: George doing bitcoin
newtomcroose: that's how much we have in common
newtomcroose: @tomcr00s3 lets talk about love
newtomcroose: @tomcr00s3 in the summer night
newtomcroose: george have grammy awards ?
newtomcroose: george do u have grammy awards ?
myaocat: don't you add newline when doing write?
newtomcroose: https://www.twitch.tv/tomcr00s3
newtomcroose: comma.ai/shop
fengyuhen: (´｡• ᵕ •｡`) ♡
myaocat: lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoGG lupoGG lupoGG lupoGG lupoGG
suurrend3r: @newtomcroose I think he muted you :(
newtomcroose: politics is the mind killer
myaocat: he probably muted me too lol
ssh4422: the audio dosent work on smartphone
newtomcroose: he muted everybody , even elon musk direct message in twitter :|
myaocat: lupoYE
maruchandayo: !uptime
newtomcroose: !no
newtomcroose: give me some rice
newtomcroose: i need RICE
TheHandSolo: i think he should code a bot for his chat
suurrend3r: @Tuchopi are you still here?
newtomcroose: now you get too much to lose
newtomcroose: @tomcr00s3 can u fight with khabib nurmagomedov ?
PlayITAntabuzz: hrllo
PlayITAntabuzz: how are you?
myaocat: fine and you?
PlayITAntabuzz: good thank you
myaocat: np lupoYE lupoYE
egohot: Bug bounty ???
h4v0k22: Have you tried debugging using something like btcdeb? https://github.com/kallewoof/btcdeb
myaocat: lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE
BrainIet: ClappyHype
clinuco: DoritosChip DoritosChip
newtomcroose: nooo
newtomcroose: are u kidding me ?
newtomcroose: thats not gonna work now
myaocat: shh
Bryanswagbeast: Eh! Im back!
Bryanswagbeast: what is tmux? is it for windows as well?
Bryanswagbeast: i think hash is part of the bitcoin
myaocat: why do you have star
Bryanswagbeast: im a subscriber
Bryanswagbeast: ninjaCreep mthGrin
myaocat: lupoHEY lupoHEY lupoHEY
Caene: So you're going by "tomcr00s3" now nerd? Haha whats up douche bag, it's Tanner from Highschool. Remember me? Me and the guys used to give you a hard time in school. Sorry you were just an easy target lol. I can see not much has changed. Remember Sarah the girl you had a crush on? Yeah we're married now. I make over 200k a year and drive a mustang GT. I guess some things never change huh loser? Nice catching up lol. Pathetic..
myaocat: nice
BrainIet: PartyTime
myaocat: if i had money i would subs to ninja too
myaocat: lupoNICE lupoNERD
myaocat: lupoCRY lupoCRY lupoCRY lupoCRY
Bryanswagbeast: Caene hes making money everywhere wdym? your the loser lmao!
myaocat: it's fake comment
myaocat: if he came here he is the loser lupoTHINK
karlitios: Lol Caene. Probably troll. If not, you're the one who's pathetic.
Caene: People actually getting baited by copy pasta LUL
Caene: I thought it was a myth
Bryanswagbeast: you dumb loser lol
Caene: LUL
myaocat: so did you fuck sarah?
Caene: ^
Caene: &lt;3
myaocat: lupoCRINGE lupoCREEP
Caene: sarah turned out being a transgender, so she fucked me in the ass
Bryanswagbeast: Yo geohot hash is what makes up a bitcoin
suurrend3r: Go hotz go, never give up never surrender
PlayITAntabuzz: its the rats
h4v0k22: Mind dumping the raw tx hex in the chat?
maruchandayo: i wonder what the heck is going on inside of hes head.
maruchandayo: he type too fast...
newtomcroose: no i get too much to lose
Bryanswagbeast: mthSip
myaocat: its just the keyboard is loud and mouse lupoNINJA
Bryanswagbeast: so satisfying
PlayITAntabuzz: apm king
newtomcroose: fucking advertising in twitch :|
Bryanswagbeast: thats the reason why im getting a blackwidow chroma version 2 from Razer
newtomcroose: @tomcr00s3 who need a hero ?
newtomcroose: @tomcr00s3 bro . how u can eat 2 breakfast ?
Bryanswagbeast: Hey geo use try and catch to see where it stops running the code! @tomcr00s3
egohot: try and except
Caene: he burns 40000 calories a minute just by using his brain, so two breakfasts seems reasonable.
Bryanswagbeast: lol except
myaocat: did he write all of that?
Bryanswagbeast: yeah
myaocat: so why it doesn't run lol
RishabhDeepSingh: Heyyyyyy
Bryanswagbeast: people proud when they type blablabla words a minute when he codes a full page under 1 minutw
Hrudu: @tomcr00s3 sup bruh Keepo
PlayITAntabuzz: simple is beter
PlayITAntabuzz: go eter
Bryanswagbeast: Try and Except!
newtomcroose: @tomcr00s3 if u wanna do a challenge . solve this https://projecteuler.net/problem=600
myaocat: R)
RishabhDeepSingh: What are we building?
myaocat: ps4 exploit
ssh4422: @newtomcroose this is too easy
newtomcroose: @ssh4422 its easy for u . not for geohot SwiftRage
Bryanswagbeast: he is building his own bitcoin transaction
RishabhDeepSingh: ok thanks @Bryanswagbeast
newtomcroose: @RishabhDeepSingh u r so nob
RishabhDeepSingh: yes i am :(
ekxose1: @tomcr00s3 what do you think is true that very few people agree with you on?
newtomcroose: @ekxose1 what do u think about eating rice in mars ?
ekxose1: pretty lame
newtomcroose: noooooo
Bryanswagbeast: do any of you try Codingame?
Caene: codinggame?
RishabhDeepSingh: @Bryanswagbeast yes me
Bryanswagbeast: no Codingame
Bryanswagbeast: hey should try to solve as much puzzle within a certain time
Bryanswagbeast: meant he
myaocat: 3:33 AM
Bryanswagbeast: where does he live?
myaocat: merica
Hrudu: @tomcr00s3 do you intercat with chat sir ? Keepo
th3_maj0r: yo boys
Bryanswagbeast: lets all start a project!
Bryanswagbeast: lets hack the ps4 and xbox one s
myaocat: no
ekxose1: cryptodoggies!
Hrudu: who's on java / kotlin / android bois ? Keepo i wanna make a friend
myaocat: lupoSPOOK lupoSPOOK
Bryanswagbeast: @hrudu wdym
myaocat: @bryanswagbeast can you pon pon smiley here? lupoSHARK
Hrudu: @tomcr00s3 Geohot interact with chat BabyRage
Hrudu: @Bryanswagbeast are u an IT guy ? Keepo
RishabhDeepSingh: @Hrudu me
Hrudu: @RishabhDeepSingh we can be friends and talk Keepo
RishabhDeepSingh: Yes sure mate
myaocat: kotlin going to replace java for android
RishabhDeepSingh: it has already replaced
myaocat: same as swift for objective c
Bryanswagbeast: ninjaPon
Hrudu: not quite sure tho Keepo
myaocat: everything is dying fast
ekxose1: @tomcr00s3 thoughts on curing aging?
Hrudu: did u guys hear about java 11 prices and stuff ? Keepo
myaocat: no
Hrudu: oracle is FCKED
myaocat: how
Bryanswagbeast: hey guys should i buy the rtx 2070?
RishabhDeepSingh: Nope
myaocat: oracle sue google for using java lol
Hrudu: java 11 will not be free Keepo
myaocat: java is shit
Hrudu: taxeable by proc Keepo
Bryanswagbeast: no rtx 2070?
Hrudu: @tomcr00s3 geohot would u mind interact with ur viewers ? Keepo
Bryanswagbeast: hes busy right now
Hrudu: yea
myaocat: he is working
Bryanswagbeast: mthPose
myaocat: lupoTRIG
Bryanswagbeast: mthOMEGA
myaocat: lupoRAGE
Hrudu: is that python btw ?
PlayITAntabuzz: hex
Bryanswagbeast: yes Python 3
PlayITAntabuzz: he program in hex
Hrudu: ok
myaocat: assembly
Hrudu: actually started from scratch ? XD
Bryanswagbeast: yup
Hrudu: lordy Keepo
Bryanswagbeast: this is the second stream
myaocat: lupoNERD
Hrudu: ok
PlayITAntabuzz: something different to my "hello world" script
Bryanswagbeast: his first stream is already uploaded on YouTube
Hrudu: @PlayITAntabuzz 4Head
Hrudu: i'll check it out
PlayITAntabuzz: @Hrudu :)
Bryanswagbeast: print("Hello")
PlayITAntabuzz: help print
Hrudu: never digged in python tbh Keepo
Hrudu: as i dont know its advantages and stuff , need knowledge girls BabyRage
PlayITAntabuzz: is it fast is it greasy?
PlayITAntabuzz: i prefer fortran
Bryanswagbeast: Python can be confusing
Hrudu: isnt powerfull tho ? Keepo
PlayITAntabuzz: :D
Bryanswagbeast: it requires good indentation unlike java
Bryanswagbeast: python is powerful
PlayITAntabuzz: no parser lol
Bryanswagbeast: good for automating stuff and hacking as well!
Hrudu: yea i heard so
Bryanswagbeast: i like java better
Hrudu: u on java bryan ?
Bryanswagbeast: yeah
Hrudu: nice
PlayITAntabuzz: rly pepehands
Hrudu: wich area ? Keepo
PlayITAntabuzz: show us the grease tom
saulgd: does Geo only use python?
Bryanswagbeast: Try and Except @tomcr00s3
Hrudu: he's a python expert seems like Keepo
Hrudu: @Bryanswagbeast wich area bryan Keepo
Bryanswagbeast: California
Hrudu: not the location , which area you use java in ?
Hrudu: platform
PlayITAntabuzz: will i be same as him with same keyboard
PlayITAntabuzz: i will maybe buy today
Hrudu: web dev , mobile ? ....
Bryanswagbeast: wtf then be specific
PlayITAntabuzz: also i will try buy some friends
Hrudu: mb Keepo
Bryanswagbeast: pc
Hrudu: desktop app ?
Bryanswagbeast: for java?
Hrudu: yea
Bryanswagbeast: whichever
Bryanswagbeast: mostly for games
PlayITAntabuzz: 1 forward 2 backward
Hrudu: ok
Bryanswagbeast: and c   for games as well
PlayITAntabuzz: show us where the trouble is bob
PlayITAntabuzz: put some grease on it
PlayITAntabuzz: alittle ducktape coding
mr08040: Good morning from the East Coast
Bryanswagbeast: Good Night from the West Side
mr08040: Seriously
PlayITAntabuzz: sqeeze the hex out of it
bensiso18: Sabbat Shalom form Israel
PlayITAntabuzz: shalom sabbat
ekxose1: @tomcr00s3 thoughts on neuralink? and invasive BCI's in general?
BigGucciGuap: HeyGuys
PlayITAntabuzz: !sr gucci gang
BigGucciGuap: PartyTime what it do ladies
clinuco: FutureMan
Bimbopapirrin: pwnPG
PlayITAntabuzz: lizard
BigGucciGuap: lizard squad on your forehead
mr08040: while true; do clear; ./tx.py; sleep 1; done
PlayITAntabuzz: LIZARD SQUAD
suurrend3r: @ekxose1 he is 100% focused on the code
PlayITAntabuzz: no focus on chat pepe
ekxose1: i got a bank of questions so hopefully he'll do a quick q&amp;a
PlayITAntabuzz: @ekxose1 he use razer
Hrudu: sup bruhs Keepo
PlayITAntabuzz: :(
h4v0k22: not sure if this helps, running bitcoin-cli decoderawtransaction https://pastebin.com/nLiwcZ4T
h4v0k22: debugging the scriptsig suggests there's a problem
h4v0k22: 473044022065d0457d1494fa732af57b32301c7e5ada768da835bf2b7d5c960c47bb21ff2602204a8707d8f27a876b52e1a5c013fc461ae521d995601ee2499b66a81762eaafd741210256fa29513e4c252be196b12642ff678022b8992d08c3a9d8cf1cd6d9313b566d
PlayITAntabuzz: were being screwed by the damn rats again
PlayITAntabuzz: 3k
greis795: do you work in a company?
egohot: where's your monte ?
Nagato_Pain: is that java script or python guts @tomcr00s3
Nagato_Pain: guys*
greis795: python i think
keepingtrckofthisacct: its python
theGeekPirate: ^
h4v0k22: I've tried running the script sig through btcdeb, this usually creates a stack debugger
greis795: but he also types in command line bash
h4v0k22: Trying to see if this is not caused by the difference between btc and bch, but the script sig should work find
Nagato_Pain: @greis795 @keepingtrckofthisacct thanks
h4v0k22: btcdeb 473044022065d0457d1494fa732af57b32301c7e5ada768da835bf2b7d5c960c47bb21ff2602204a8707d8f27a876b52e1a5c013fc461ae521d995601ee2499b66a81762eaafd741210256fa29513e4c252be196b12642ff678022b8992d08c3a9d8cf1cd6d9313b566d
h4v0k22: also, nice alterantive to bitcoinjs-lib is bcoin :D
h4v0k22: full bch support
h4v0k22: bcoin.io
Nagato_Pain: @tomcr00s3 keyboard that u use ??
h4v0k22: https://github.com/bcoin-org/bcash
bool3max: have you ever considered using a tiling window manager or something
bool3max: all those floating browser windows are a pain
th3_maj0r: he is on mac
blackburn1911: yeeey
memoryleak: Pog
PlayITAntabuzz: POG
h4v0k22: Well done :D
Bimbopapirrin: PogChamp
greis795: boom
slimydude: VoHiYo
un3okapi: Pog
un3okapi: Holy shit
Bimbopapirrin: HYPE
greis795: boom bitch!
PlayITAntabuzz: YOU ARE BITCOIN
Caene: u r bitcoin
slimydude: can you explain the problem again? i was looking at another window.
clyde542: "What ever you're having, I want some"
h4v0k22: So now do it on the real bitcoin, not on bitcoin cash
th3_maj0r: wooow
DREKANworld: I don't hear anything is it normal guys ?
th3_maj0r: nope
Bimbopapirrin: LUL i have no bitcoin :(
Bimbopapirrin: pwnMIR2
tomcr00s3: bitcoincash:qzgkpum2asc2frhzj9n9hsy9sq233xrqhys5p05c8k
magarky: 10 cents PogChamp
h4v0k22: congrats
PlayITAntabuzz: LOL
ashimathilda: you are beast bro
chaprio1: #ad Kappa Kappa
GoldenDickies: bch is bitcoin
PlayITAntabuzz: lol
h4v0k22: can use the regtest network too :) don't always deploy, but when you do, it's in production
th3_maj0r: is that an iphone?
GoldenDickies: 1 sat fee
Nagato_Pain: your keyboard Hyper X ?
soad188: JUST DO IT
Bimbopapirrin: CiGrip
Bimbopapirrin: Lets do it bois
slimydude: LMAO
un3okapi: LOOOOOOOL
DasMastah: Wow lol
twintowerpower: He definitely regrets all of this
twintowerpower: just trying to keep up apperances for his loyal viewers :D
Nagato_Pain: Hyper X keyboard ? ?
Nagato_Pain: @tomcr00s3
un3okapi: just hack time 4Head
blackburn1911: LUL
potimotti: ma boy hotz live &lt;3
soad188: LUL
th3_maj0r: ahahahahah
un3okapi: D:
blackburn1911: at least it worked for 1m
suurrend3r: omg
suurrend3r: this is just amazing
h4v0k22: OP_RETURN
greis795: can i ask something that i dont undersand?why programmers prefer running python from command line?
h4v0k22: What should we use in the ./seekrit ? this just random data?
un3okapi: Geohot - "bitcoin sucks"
un3okapi: got the headline.
un3okapi: thanks
h4v0k22: burning coins doing that
keepingtrckofthisacct: @greis795 please clarify? python is a language accessible from the command line.
z0di4ckx: hi
keepingtrckofthisacct: @greis795 he's coding in 'vi' but executing via the cmdline
greis795: @keepingtrckofthisacct why not use jupyter or a text editor and instead run python from command line which is not very user friendly?
twintowerpower: he is using a text editor
keepingtrckofthisacct: @greis795 he 'is' using an editor, just not a 'grapical' one
greis795: oh ok
potimotti: its vim
greis795: sorry for my noob questions
potimotti: its fine. i dont even know vim myself. heared its difficut to get started with
keepingtrckofthisacct: @greis795 don't apologize. you're learning
h4v0k22: yeah, no rbf in csh
unDe4dman: 1
greis795: i learn data science now and i am not fully familiar with all the concepts
greis795: @keepingtrckofthisacct thx man!
keepingtrckofthisacct: @greis795 then, you'll become good friends with python!
juniperus1976: Me
greis795: yeah!
greis795: vim is like bash?
Bimbopapirrin: PogChamp me :)
keepingtrckofthisacct: @gr
keepingtrckofthisacct: @greis795 no, vim is an editor, bash is an environment
juniperus1976: nerve-racking
greis795: so vim i guess is a special text editor that u can use in bash?
keepingtrckofthisacct: @greis795 ...zsh,csh,bash, etc
paradox109: @greis795 just google vim editor
Number___Nine: yo
twintowerpower: we may need emergency surgery in the studio...
keepingtrckofthisacct: @greis795 'bash' is 'how' you interact with the system
paradox109: nitial release:2 November 1991(26 years ago) thats vim for you
ququa111: i dont understand coding but im watchin u
paradox109: lol
markoancev123: why am i watching this i dont know jack shit about programming LUL
un3okapi: you watch him for his political commentary
h4v0k22: use OP_RETURN
markoancev123: must be
Number___Nine: &gt;4:34 am lol
mrgh0st0: its satisfying :D
markoancev123: 1:34 pm here
Number___Nine: 12:34 here
suurrend3r: 08:35 am here
greis795: 14:35 here
soad188: mostly european are seiing this
juniperus1976: 13:35
h4v0k22: Just append am output with OP_RETURN data so you can write data to the chain
z0di4ckx: 7:35 am hare
return100000001: hellooo
markoancev123: i dont know anything about programming what language should i start with
paradox109: english
soad188: @markoancev123 c, is really easy
juicegohard: python
paradox109: LuL
ququa111: what about python?
Number___Nine: @markoancev123 python
h4v0k22: OP_RETURN will not be spendable, but your other output with the value will, the OP_RETURn output doesn't need a value
z0di4ckx: he use Python
markoancev123: python i dont want a snake Kappa
juicegohard: ZzzzZzzz
keepingtrckofthisacct: the 'pythons' have it
z0di4ckx: python 3
soad188: c is easy to understand for people that starts programming
soad188: but useless today
paradox109: learn autoit for botting lol
Number___Nine: @soad188 yeah, and then you hit the memory model and concurency, lol
h4v0k22: Keep your existing output, and just add another with an OP_RETURN script and a 0 value output
juniperus1976: language does not matter.
paradox109: @juniperus1976 then write in machine code smartass
paradox109: lol
juniperus1976: I do it every day... ;-)
ququa111: 4Head
keepingtrckofthisacct: @paradox109 prolly not what @juniperus1976 meant. picking any specific lang isn't going to 'make' you a programmer.
h4v0k22: Keep your existing output, and just add another with an OP_RETURN script and a 0 value output, OP_RETURN outputs are not meant to be spent, and are prunable
h4v0k22: istandard yes
Number___Nine: why is geohot sitting on his old crappy chair?
h4v0k22: these prevent some unwanted tx types
h4v0k22: yes
a28b: hello
h4v0k22: No no, real bitcoin, we heard it hear
th3_maj0r: "fake"
mrgh0st0: @Number___Nine clever enough to not buy fancy chairs
Number___Nine: mrgh0st0 but he did buy a while ago, iirc
h4v0k22: You could also try a vanity address for what you're attempting to do
h4v0k22: https://bitcoin.stackexchange.com/questions/20305/what-is-vanity-address
ragemaster999: here we go
mrgh0st0: @Number___Nine maybe he broke it when another celebration :D
ququa111: LUL
a28b: LUL
h4v0k22: OP_RETURN is limited to 40 bytes of data
unDe4dman: LUL
greis795: hahaha
a28b: LUL LUL
Lythaslol: why is he doing in on bitcoin cash and not bitcoin?
greis795: !uptime
a28b: PogChamp
juniperus1976: Yeah
ququa111: POGGERS
tomcr00s3: https://explorer.bitcoin.com/bch/tx/f5db7ccb0fc0a64cbbaab00e1ba98f12d7629f12db9086eadbe66170413241b2
greis795: how many hours did it take?
markoancev123: how big is your head?
un3okapi: what happened to boba tea?
th3_maj0r: ahahahaah
Number___Nine: how about the chair? lol
magarky: How big is your penis
rrdpc: 15 hours
h4v0k22: good technical coding session, pity it's BCH and not BTC ¯(°_o)/¯. ¯_(ツ)_/¯
ququa111: i just wanna suck ur ballz
th3_maj0r: How much long is the cable of ur keyboard?
XPicolasCageX: Okay, stupid question.. can you update your dotfiles rep in github?
a28b: LUL
Ropat: When did you start playing piano?
Lythaslol: @tomcr00s3 do you prefer BCH over BTC?
th3_maj0r: hahahahaha
un3okapi: how much can you bench?
clyde542: Do you still blaze george?
Ropat: Thanks!
XPicolasCageX: Best way to start learning python?
cromize: would you go studying computer sec. these days?
juicegohard: LOL Fedcoin
markoancev123: can you hack me a pornhub account
unDe4dman: AHAHAHAHAHAHAAHHAAH
a28b: LUL
clyde542: I love you being as human as possible, keep it up!
suurrend3r: do you like Freebsd?
egohot: have you ever used vpn
mrgh0st0: whats your next goal on comma ai ?
ququa111: delicious orgasm Kreygasm
Quiplash: adderall or ritalin
h4v0k22: When we doing some lightning hacking?
un3okapi: trump or hillary?
XPicolasCageX: @tomcr00s3 Any reason you are not using any plugins for vim?
h4v0k22: sending ln tx's using pythong
h4v0k22: python*
egohot: does tomcr00s3 ever used vpn
willoregan: any ideas for next Twitch session?
un3okapi: that was fun!
willoregan: yep, that was cool
Lythaslol: @tomcr00s3 if you could recommend one book everyone should read as a programmer which one is it?
suurrend3r: you say that you read Linux, Windows and Mac kernel, what about BSD?
th3_maj0r: Try to stream more bro
Ropat: Do you take vacations and if so do you have a specific destination you want to travel to?
Number___Nine: read linux the whol 5M lines lol?
blackburn1911: were to learn AI and machine learning like you?
athmo2: vacations = scam, life is work people
juniperus1976: idea for next stream: reconstruct a 3d scene from photos with ml
Ropat: oh ok
un3okapi: they're advertisement's propaganda D:
Number___Nine: twitch checkers
egohot: did you used vpn in hacking days ?
th3_maj0r: Which is the plugin that u are using to block ads on firefox?
juniperus1976: hard fun! ;-)
cromize: live rap?
h4v0k22: lightning on bitcoin, do some hand crafting of hashed time lock contracts
un3okapi: code deepfake from ground up :)
ququa111: are u gonna upload this yt ?
willoregan: analyse instrumental audio file, generate flows and rhymes
h4v0k22: You can do using p2sh, more flexibility in having custom redeem scripts
h4v0k22: isStandard is very restrictive on output formats
greis795: where do u work?
alexlucas_: steam bots ?
un3okapi: @greis795 comma.ai
h4v0k22: used for multisig, and backwards compatability with segwit
greis795: @un3okapi thx
juniperus1976: ml is boring...? hmmm
h4v0k22: Also use for HTLC's
h4v0k22: yes , peter todd's challenges sha1 , sha256 etc
h4v0k22: https://lists.linuxfoundation.org/pipermail/bitcoin-dev/2013-September/003253.html
h4v0k22: Social scalability :D
h4v0k22: Hashed version of the bitcoin script used for unlocking the funds, logic is in the input instead of the output
h4v0k22: https://www.soroushjp.com/2014/12/20/bitcoin-multisig-the-hard-way-understanding-raw-multisignature-bitcoin-transactions/
h4v0k22: multisig is one of the first usecases for p2sh
h4v0k22: Yes!
h4v0k22: LN channels
h4v0k22: HTLC
h4v0k22: Atomic Swaps
MrPeppah: adios
un3okapi: gngn
juicegohard: pce pit
h4v0k22: Thanks for sharing the codeing session
juniperus1976: Bye
a28b: bye
juicegohard: pce out
Ropat: bye
greis795: bye
XiaoLongBao: bai
alexlucas_: bye
kevczy: Sup George hotz
cIvIcbooks: Yo
codevisionary: hey george
aerotone: windows eww
kruger3117: Ayy
Harm133: Pog
mrgh0st0: CoolStoryBob
knilecrack: wsuppp
zenkai_oogway: PogChamp
foxubu: George o/
Quev1337: yes
dkingdoms: yooo
kruger3117: OwO
smokingbud: yass
javadragoniv: we missed u, u crazy bastard <3
yousef19961: Wsupppppp
nlztw: yes we can
filipenunooliveira: Hi from Portugal
jamesred2313: Windows Kek
jrubenoide: Yes
mkdrmnd: welcome back george
codevisionary: yes I can hear your voice audio
th3_maj0r: We can hear you
erichtp: Yes
dekassssss: hi
foxubu: Windows? Woow
Xandoo: HeyGuys
Gentris: Finally...
zenkai_oogway: yes
jamesred2313: Windows 10 kekekekek
zenkai_oogway: we can hear you
JohnnyWangPepega: yooooo george whats up!
kelvin99: yes
filipenunooliveira: Yes
kruger3117: Yup
yousef19961: Yes
Zasuslive: Hi
knilecrack: no instagram please
Nubadoxd: GeoHotz is really hot ashlolLick ashlolWaifu ashlolLick ashlolWaifu ashlolLick ashlolWaifu ashlolLick ashlolWaifu ashlolLick
foxubu: Your voice has echo
Scrumilation: windows?
erichtp: HELL YEA NO MORE LAG
th3_maj0r: omg this quality george
trader_f: not anymore IMAC PepeHands
dbroers: Yes
nlztw: sick
knilecrack: fuck yeah
Nubadoxd: Inception Hotz incept me ashlolBad
tanoshiizo: legal PogChamp
Cube_Is_Life20: qira for windows when?
capsimirhd: holyyy
dorkmo: windows10 lol
adamalex16: yo
data_day_life: it's crispy as fuck
ainschtain: yo george watsup
jimmyadaro: omg legal windows
funwayz: WE ARE LEGAL
er_ricotta: HOLLA HERMANOOO
kevczy: Why are you using windows
jamesred2313: Windows 10 is free
aerotone: PogChamp
codevisionary: try linux
jimmyadaro: why windows tho
adamalex16: making a game?
zenkai_oogway: @georgehotz Did you see the new windows terminal ad?
mondeverest: bogaEdna bogaEdna bogaEdna
kevczy: Ok good
no_step_on_snek_: 720p? :/
the_middle: Hello world!
mondeverest: bogaFirewall bogaFirewall bogaFirewall
eyep1e: windows?
Nubadoxd: Use kali noob CoolStoryBob
jimmyadaro: omg ls in windows
data_day_life: you have to enable *nix support
Zasuslive: Learn UE4 not unity!
jimmyadaro: how about ls -latr?
knilecrack: yeah
Scrumilation: No, the actual new terminal, you ahve to compile it yourself or some shit
kelvin99: unity   ml do it please
zimxtv: What do you think about Uber going IPO this month
knilecrack: you can install wsl bro
aerotone: no its fine
markovchain21: Hello :) it is an honor. i just finished the 10hour slam stream
foxubu: Install wsl
flovvvvv: hi
adamalex16: pp mode
knilecrack: welcome :)
aathove: hey dude
jamesred2313: Windows crashed
Duschjenkovic: xDD
foxubu: Stream stopped?
emi1ie: emi1ie subscribed with Twitch Prime.
markovchain21: Hello :) it is an honor. i just finished the 10hour slam stream. <3
hoffs: much better
Nubadoxd: @georgehotz daddy the stueam is gone ashlolOhNo ashlolBulbathump ashlolBulbathump
acheesedanish00: uping the resolution
capsimirhd: lmao
kevczy: Stopped
xyrtha: How did you learn to code ?
mrgh0st0: Blue Screen
deR_Ed: insta celeb waow
bpostalci: What happened
xyrtha: do you have tricks ? ;p
Johnnymamen: refresh stream
menchedanem: windows power
kevczy: Crashed
foxubu: George exploded lol
javadragoniv: meh quality, camera is not really nice lol
kevczy: George your stream crashed
flovvvvv: you cool
J3rwin: Your good
billymack: does anyone know which keyboard he uses?
th3_maj0r: He didn't chrash
avagyannarek: Duude we missed you
knilecrack: :D
aathove: @billymack hhkb 2
flovvvvv: woww
tanoshiizo: PogChamp
th3_maj0r: refresh guys
UniversalGeneve: noice
Scrumilation: LMAO
LazDays: LUL
adamalex16: saxy
J3rwin: ...the fuck
codevisionary: OMG
knilecrack: rofl
smurfd0: no, 238 .. crisp
dorkmo: lol
tanoshiizo: who's this guy? PogChamp
Chris_XIX: WOAH
konradcho: hahah
funwayz: ??????
FartKnockGomez: the future! PogChamp
avagyannarek: DAAAAAMN
trader_f: LMao
jdquintana: Happy Hacking Keyboard
zenkai_oogway: PogChamp
nlztw: haHAA
Nubadoxd: @georgehotz you're 2 much to handle ashlolCool
Aerdeyne: PogU
FartKnockGomez: @tanoshiizo dude is a straight up genius
ranjaman: wtf
J3rwin: FeelsWeirdMan
no_step_on_snek_: haha damn
jamesred2313: Is that a Zuckerberg meme
kelvin99: cool stuff
kevczy: Crashed
purpbroccoli: very fashionable
yousef19961: Lol
flovvvvv: ahahah
HanksPlay: i want to see you walk outside with this
tanoshiizo: diy? PogChamp
LazDays: PogChamp
HanksPlay: WALK OUTSIDE WITH IT
yoyo_brobro: YEEET
HanksPlay: lol
nmuntz_: I was really starting to miss your streams dude!
konradcho: like alien from rick and morty
FartKnockGomez: geohotz is the shit
UniversalGeneve: LUL
markovchain21: i just have a LeapMotion
jamesred2313: No
msjuck: hey dude
Nubadoxd: @georgehotz that's 2 much, I can't handle it Kreygasm
Dimendz: I finally caught a live stream Pog
knilecrack: is it working on that laptop ?
funwayz: Some matrix shit
Cube_Is_Life20: fuck wires
mondeverest: i take 4
veomx: Hi George
austin_1_2: @hanksplay he hasn’t been outside in years Kappa
nightknight0000: new house?
WoockieCookiee: hey @georgehotz still CEO Comma.ai?
myaocat: i thought you was going to buy macbook
HanksPlay: HanksPlay subscribed with Twitch Prime.
kevczy: George your stream crasheddd
knilecrack: I thought u need better config for that
jamesred2313: Refresh the stream
Bombapil0t: 10k followers gg wp
aathove: can you check your balls temperature on it
J3rwin: would people beat me up if you wear one of those and go outside.
knilecrack: like really good GPU 1070
knilecrack: ahhaha
HanksPlay: congrats on the new office btw
UniversalGeneve: is comma ai dead? was waiting for you guys to hit L4 first
nlztw: u look dope dude
Bombapil0t: futuremen
kelvin99: would love to see walk t0mcr00se in this AR headset
yoyo_brobro: why cant i donate
FartKnockGomez: real version tony stark LUL
Zasuslive: George how we gonna hack the simulation
Protoxus: VR is the future jgrTARD
myaocat: congrats i thought you hate office but your in office all day
alxhotel: Where do you work ?
veomx: simulation in a simulation. r&m
mehi9h: I hope ur not switching to win
Scrumilation: that looks like some shit kim kardashian would wear
Cube_Is_Life20: fuck wires I wanna take that shit around
aathove: auction your keyboard
WoockieCookiee: i dont know why u arent CEO
acheesedanish00: George is gonna prove the simulation by making another simulation
jxeus: you look like a nerd
FartKnockGomez: lady gaga wants one to go with her dress
th3_maj0r: 1m2019.com
Bombapil0t: what the heck
kevczy: I’ll pay 10,000for that keyboard
codevisionary: that's why you should be using linux @georgehotz
UniversalGeneve: so is the camera on that modular? seems detachable. it would be nice if its a tack-on to regular glasses
veomx: where are you george
alxhotel: Instagram
Zasuslive: million subs on insta?
data_day_life: 1 million followers on IG
Bombapil0t: get big o ninsta
knilecrack: thre is no dream
dorkmo: instagram
HanksPlay: get instagram famous
dbroers: I’d pay $2000 for that keyboard
trader_f: 1M follo on IG
FartKnockGomez: wireless quality vr?
aathove: just bot your insta
myaocat: pewdiepie?
Nubadoxd: @georgehotz this is the equivalent of a cowboy hat, in the hotness mesure, 10/10 all the puss you can get Kreygasm
markovchain21: i think i finally found out how to exploit our simulation @georgehotz
Protoxus: @veomx T H E C L O U D
dbroers: Instagram
kevczy: Instagram celebrity!!!!
th3_maj0r: ahaha
grootdoloot: <3 <3 <3 <3
smokingbud: i can legit send you 1m followers @georgehotz
Dqyijote: omg new computer :O :O :O
capsimirhd: lool
nlztw: jerk off 2 times twice is a dream
Goooshlrific: literally anything else porbably
jamesred2313: Why don't you use brave browser?
eyep1e: 1m followers insta dream
flovvvvv: George you awesome
HanksPlay: YEAH i want to see those IG thots in Virtual Reality
aathove: why are you learning unity??
Dimendz: What are the specs on your new pc?
th3_maj0r: instagram will remove public likes number George
ISD_Schogol: Whats better for insta then AR? You should get some titties :D
myaocat: did you try the new terminal on windows?
Nubadoxd: Call Jabril Kappa
kevczy: Omg
codevisionary: don't worry george, you're better at coding than all of us here
Zasuslive: can we talk about the simulation later or something at least
trader_f: 10K ANDY Pog
adamalex16: just followed
kevczy: Dude I’ll teach you unity seriously
dbroers: You just need a gold necklace
knilecrack: it's not out yet, the terminal
mehdirussel05: happy ramadan
tybutnowyoudie: did you move to san diego?
ranjaman: lets hack things
Harm133: what language
HanksPlay: yes he did
kevczy: Would you text me back in instagram
Bombapil0t: windows ffs
myaocat: c#
nanodanger7: nanodanger7 subscribed at Tier 1. They've subscribed for 12 months, currently on a 12 month streak! 1 year lol
th3_maj0r: https://www.instagram.com/georgehotz/
grootdoloot: #hacktheworld
Zasuslive: learn Unreal Engine 4 not unity :))))
Adolfich77: karmikS karmikRaid cmonBruh
Nubadoxd: Only follow if I can get some Lorno in the IG story's TheThing
aathove: pee or poo, which is the best?
myaocat: you create unity programs with c# or c   but
adamalex16: ue4 is a fucking power house
KtothePop: WutFace headset
FartKnockGomez: stream from the future PogChamp
knilecrack: start pwershell windows btn i or A
veomx: how much is one of this
cccnrd: fancy profile pic
knilecrack: x   1*
zoloviski: unreal engine dude is much better
Dimendz: Use source engine :(
poopboy7: VR Hentai game ? PogChamp
yoyo_brobro: yoyo_brobro subscribed at Tier 1.
kevczy: Is it gonna be vr?
Harm133: C# is awesome Pog
LazDays: wut c# PogChamp
adamalex16: well heavy but if u wanna make a killer game go to cry engine that is a fucking unit m8
myaocat: oof
cccnrd: wooow northstar?
Zasuslive: why unity m8 use unreal engine
zimxtv: Is pixetech his new company?
knilecrack: windows  x and I
knilecrack: that's all you need
FartKnockGomez: seems legit
tanoshiizo: so anime is real now?
cccnrd: prototype from u or leap?
Acles123: techwear
Adolfich77: is this guy is tesla auto pilot killer?
cjaynowski: PYRAMID SCHEME
trader_f: Shopify 4Head
tanoshiizo: LUL
aathove: you're on coke right??
trader_f: RICH POG
Bombapil0t: TriHard
myaocat: we cant see the glasses
nlztw: FUNgineer FUNgineer FUNgineer
SpecialAgentSkye: Pog
baymer1: Do you think real time tracking will come soon enough to make AR relevant?
Toaster_PG: lmfaooo
CoffeeD2: how the fk are u not rich already? lol
Bloodspark_: LUL
veomx: with sugar
UniversalGeneve: SeemsGood SeemsGood
J3rwin: FeelsWeirdMan
cccnrd: ar overrated
KtothePop: 200 grams of adderall ? D:
rattata400: AR? :P
myaocat: did you try the new windows terminal????
psYch0maD: You seem to happy for not being drugged
dorkmo: B-12
Dimendz: What processor and gpu are you running?
Bloodspark_: lol
rattata400: what is AR?
rattata400: :P
Duschjenkovic: LUL
Dqyijote: pls hacking nasa u re the best
veomx: pls tell hehe
knilecrack: it's all good
Bloodspark_: you're so hype
Bombapil0t: :)
zenkai_oogway: Kappa
trader_f: Kapp
740ii: normal people always think you're high as hell
markovchain21: i saw a pic on Instagram, where he played the beta version of beeing rich with a new BMW @georgehotz
Bloodspark_: hyper*
jamesred2313: We trust you brah
myaocat: you arent rich because you quit working on google. you said because of being office but you are sitting on office. trust no one
Bloodspark_: new pc? :o
gl3nn_wolf3: George your back !
Bloodspark_: RAZER OFC LUL
J3rwin: You have 300  viewers already? what did you do
gl3nn_wolf3: we love you
KtothePop: RAZER OMEGALUL
brevan04: The real George Hotz got a windows!?! FAKENEWS
kevczy: Weed temperature lol
codevisionary: dude he's ready to program, and has 300 viewers. Of course he's hype
Chris_XIX: How often do you go live tho? That's what I wanna know if I subscribe
yellingdog: yellingdog subscribed with Twitch Prime.
Kvann1 : PogChamp
cccnrd: prototype from u or from leap directly? we are trying to build a northdstar at our interaction design course
Mac_33: Are you becoming an AR boy?
UniversalGeneve: UniversalGeneve subscribed at Tier 1.
tybutnowyoudie: PogChamp
Zasuslive: who cares it does the job it needs to
Dimendz: Fair enough
rattata400: dont show activation code
dxxdpools: Why windows?
baymer1: Isn't AR kinda weak cause of poor real-time tracking? How much longer until it's gooood
stale2000: PogChamp
veomx: you welcome your new subscriber?
ISD_Schogol: 1800?? O_o
aerotone: monka
brevan04: Drive car with VR
myaocat: why didn't you buy i10 cpu?
cccnrd: why pixie? what does it mean?
J3rwin: Razer wat
dxxdpools: You putting Ubuntu on that?
cccnrd: cringe name
foxubu: What are we going to learn today? :)
veomx: how much for one?
dbroers: Shoulda got the Dell XPS
NolanBridges: @veomx $599
Mac_33: I know some people who work at the company who developed the lens system for the HoloLens
cccnrd: love u bb
veomx: ah thx :)
ArfArf: hi
dbroers: It’s too big though
codevisionary: hire me @georgehotz . I want to build your website for pixetech
brevan04: Eye tracking?
KtothePop: FOV Kreygasm
myaocat: pixie like pixel animations
foxubu: What are we going to learn today? :)
NolanBridges: @foxubu Unity
redbullwiiings: dont get started on FOV Kreygasm
myaocat: united nations
brevan04: Will it have eye tracking? Good eye tracking is worth $$$ in research
Bullanguerock: HYPE
alxhotel: pixie like in pixel 3a is the best phone
foxubu: @nolanbridges Okay, let’s code :D
Zasuslive: its easy
Mac_33: You should watch this before you drink more La Croix: https://www.youtube.com/watch?v=vx9VRdtio7E
baymer1: Damn, recognizing AR needs improvements to be actually enjoyable is a huuge step, I'm excited for Pixie Tech
J3rwin: does he create companies every time he streams
myaocat: geo did you try the new windows terminal??
ranjaman: sounds good to me
Bloodspark_: Pog
CaptainAshtar: hey @georgehotz good to see you online
Dimendz: Learning is the fun stuff, go for it don't be worried.
dorkmo: <html><body>buy pixie</body></html>
s4ngim3d: hello
cccnrd: @brevan04 eye tracking overrated mouse tracking is betta
onu4r: dude we missed you
ISD_Schogol: In b4 sued by nigerian company Pixie Technologies Kappa
cccnrd: just use unity and done
onu4r: where were you
yellingdog: no emotes yet? what is this a twitch chat for noobs?
HanksPlay: Hey George, how long this stream is going to be? because im going to lunch but i want to watch everything
myaocat: did you see the new windows terminal???
cccnrd: join the northstar discourd, nice community
UniversalGeneve: push an MVP and connect with SF insta ppl = more $100 in your pocket(s). i feel like an MVP should be enough. like real-time environment snapchat filter tech kinda stuff. (P.S. not trying to backseat, just genuinely interested in this)
stale2000: PepeHands What about 999 mode in OS class? PepeHands Does that not count as game programming?
brevan04: Dead Reckoning
kevczy: I’ll pay u as a tutor 5000 dollars
HanksPlay: PokPikachu
brevan04: Fake news
ranjaman: don't you using a mechanical keyboard ?
Bombapil0t: magic magic
brevan04: Dont do stupid looking animation
myaocat: ar isnt new.. snapchat doing it
HanksPlay: the video is too loud and i cant hear you
kevczy: The user interface is reallybD tho
J3rwin: so "hardcore"
trader_f: Do a Woman can suck my d pls Kreygasm
CheeseburgerB: :)
claymorehack1: hey man what's up
trader_f: TRUE
HanksPlay: true
CheeseburgerB: f
crusher_az: lol
trader_f: fuck this shit
kevczy: Lol
Zasuslive: its clearly fakezzzzz
myaocat: you are scam
robinduckett: HTC Vive has the same deal
kevczy: Dude tho if you don’t even have few thousand bus...
dbroers: Agreed
myaocat: stop throwing fake news
CheeseburgerB: LUL
robinduckett: I'm paying £30 odd a month for my Vive
tybutnowyoudie: LUL
veomx: what you think about oculus rift?
nlztw: LUL
Dimendz: For me AR won't be worth it until I can't tell I'm using it lol
UniversalGeneve: PWNED
trader_f: Lmao
J3rwin: OMEGALUL
Acles123: LUL
rhytual: LUL
joiput: LUL
KtothePop: LUL
brevan04: Lol
knilecrack: ahaha
Bloodspark_: LUL
flovvvvv: lol
Rlchibi: LUL
kevczy: Lol
thesidjway: LUL
CaptainAshtar: wtf that's insane
2bumbum: LUL
pyythonn: lol
crusher_az: LUL
slimpimp007: lmao
nlztw: yee, right
JBirch10: quality and functionality
Bombapil0t: :D
brevan04: Show off hardware
SanyBarbie: Hahahah! Legend!!
andrex_andrex: FortOne FortOne FortOne
skinzo1998: !time
Dimendz: 3 billion dollars and that's what they come through with?
dorkmo: shipability!
Roudkill: Aw shit, here we go...
knilecrack: don't u need vs for unity?
SpecialAgentSkye: Will you be able to capture what you see through the ar headset? @georgehotz
KtothePop: TRACK PAD LUL
cesaaron88: Here we go agane
knilecrack: windwos btn   arrow to fix windows
codevisionary: A professional website design is key to marketing whatever it is you're trying to sell, whether or not you have a Shopify. @georgehotz If your site looks good, the product your selling looks good, it will sell more. Plain and simple. Hire me, please?
kevczy: Vs is free
JBirch10: get a mouse you barbarian lol
J3rwin: "Im new to windows"
cromize: cromize subscribed with Twitch Prime.
myaocat: i dont think its nice to trash on company. why dont you trash about apple and their prices? did magic leap do something to you or are you trying to compete them..
Zasuslive: george doesnt need a nice website to sell
kevczy: C# is really ez
Mac_33: @myaocat You just contradicted yourself.
CaptainAshtar: @georgehotz what is this windows now?
robinduckett: first mistake
saulgd: trackpad and laptop keyboard NotLikeThis
Bombapil0t: collecting data Kreygasm
Risx: Risx subscribed with Twitch Prime.
J3rwin: LOL
SpecialAgentSkye: OG jailbreaker. Dont bash!
virgoshlok: hi!
hoffs: debt is part of american dream
myaocat: would you mind if soneone trash on comma ai?
smurfd0: you get what you pay for .. :)
myaocat: Tesla is doing better
o_sagga: you're awesome man
JBirch10: YES WE ARE
rhytual: no pressure Kappa
aerotone: PogChamp content
onu4r: you would be a great sales guy
fjeuber: Mate I have 128 gigs of ram do u even try xddddddddfdddddddddddd
Zasuslive: its 10x easier than the stuff you've done in the past
Cube_Is_Life20: qira for windows when?
saulgd: @georgehotz are you using WSL?
Bombapil0t: not yet ^^
Dieun: I heard this guy is master game dev
codevisionary: check out Magic Leap's website @georgehotz. I bet the product design and branding play a key role in whatever sales it has.
igorovich: windows SwiftRage
J3rwin: something tells me you will be at the end of this stream
o_sagga: get a second screen!
tybutnowyoudie: comparing commaai to tesla FailFish
CaptainAshtar: owww that will be amazing to watch :) i'll get the popcorn
robinduckett: Apple has financing too ffs
Nesquik80: @georgehotz why windows?
myaocat: @cube_is_life20 he didnt test it but you can try
elfacu00: will this be reuploaded?
flovvvvv: Uniti so simple for you
p0pmart: G E O H O T B O I S
SpecialAgentSkye: Unity UX Pepega
th3_maj0r: Cam bottom right would be probably better with this editor
CheeseburgerB: F
codermark: Can we except a new AR glasses from you? ;)
BilgehanB2: !uptime
knilecrack: ahahaha
KtothePop: F
JBirch10: get a mobile external monitor for your laptop
Bloodspark_: LUL
FargioFarmani: F
Zasuslive: do unreal engine instead!?
Bombapil0t: fml
purpbroccoli: Unity setup stream
Infinitelym: rip
dorkmo: unity upgrade streammmm
igorovich: specs of pc???
seanxedge: F
Zasuslive: Why not use Unreal Engine/!?!
mehi9h: mega F
Dqyijote: omg poor guy
o_sagga: F
Dimendz: I do think unreal engine would be much better for AR
CaptainAshtar: :D love it mental...
SpecialAgentSkye: NotLikeThis Y UNITY YYYYY
d0neall: LULW
alxhotel: F
robinduckett: lol I wanted you
saulgd: NotLikeThis
J3rwin: F
o_sagga: get a second screen!
surfNsmurf: Hack something instead, let's see that SSH wizard
Toaster_PG: omega lul
imageliner: F
robinduckett: warned *
cesaaron88: setup stream Kreygasm
funwayz: 420 haHAA
cccnrd: boiiRollt boiiRollt boiiRollt
fimonlark: why you choose unity instead of ue4
seanxedge: Unityhub makes everything easier :D
myaocat: did you look on windows terminal? i think you will like it
CheeseburgerB: NotLikeThis
allthesm0ke: "burj khalifa cost to build" are we the same person hotz...?
robinduckett: mistake two
cccnrd: unity is better for noob
Kvann1 : Blender PogChamp
aerotone: dont show ur id WTF
cccnrd: what did u verify!!!
codevisionary: oh no, you just showed your drivers license
KtothePop: @georgehotz you could do some jumping jacks while its installing PogChamp
asherism: KYC? you buying crypto?
MatiGoG: just get godot LULW
Nesquik80: @georgehotz why windows?
zimxtv: Ur license bro
Dimendz: just get unreal engine
SpecialAgentSkye: PogChamp ITS DOWNLOADING
keepingtrckofthisacct: you back! @georgehotz
saulgd: nice 3rd world internet speed LUL
c19946: open that pic showing id please
duzy: too small 2 read
Zasuslive: go for unreal engine
Staredad: Hey geohot
tornyl: is it laptop?
benjibanjobenjo: DOWNLOAD t90Hype
smokingbud: speedtest?
myaocat: why cant you just apt-get install unity KappaClaus
Bombapil0t: razer blade?
robinduckett: it's not like we don't know who he is
Acles123: do you know c#?
Cube_Is_Life20: hey George does zerodium actually pay out?
FargioFarmani: preread the tutorial
gofoboso: why waste time on creating games?
imageliner: I want ti see the download Kappa
HanksPlay: show us your chrome history
pyythonn: unreal engine is where its at
KyleUE: why unity?
cccnrd: dont do this
cccnrd: just directly build ur project
myaocat: this will be fun to watch
PabloBree: I'm pretty sure that in less than a month, you will learn unity completly @georgehotz
SpecialAgentSkye: sudo apt-get install unityhub
tornyl: @georgehotz is it laptop?
virgoshlok: unity vs unreal which one should a beginner learn??
eyep1e: @georgehotz stream more man i miss this
onu4r: @georgehotz give me ssh access
Trenz2: Hey :D
cccnrd: F
SpecialAgentSkye: F
NolanBridges: @tornyl it is laptop
robinduckett: can't apt get on a Windows machine
Kvann1 : F
Bloodspark_: f
asherism: F
Bullanguerock: F
1Riaxma: F
coaker30: F
veebii: F
fimonlark: F
pyythonn: f
Zasuslive: This is a good opportunity to see how georges brain breaks down a new field/industry
myaocat: f
acheesedanish00: f
Cube_Is_Life20: F
benjibanjobenjo: <f
codevisionary: @georgehotz stream everyday, you can become a twitch partner and get $$$$$
zimxtv: F
veomx: we have two hours time difference? lol
Kvann1 : F - Fix cam BlessRNG
inspectorrr: f
Zasuslive: or how he learns to use a new application ..
Bloodspark_: I thought it said failed istead of nailed LUL
J3rwin: Just stream everyday lol 4Head
jellyjar: oh wow a windows pc?
alluxua: what he is trying to code?
fumundaqueso: maybe he sliced his neck shaving and doesnt want you to see
kevczy: Yea what are you up to nowadays?
tybutnowyoudie: can you move your cam?
Zasuslive: he is learning Unity3D
keepingtrckofthisacct: with your skills, you should dm streamers: handmadehero (casey) or naysayer88(johnathan blow) @georgehotz
Kvann1 : Fix cam BlessRNG @georgehotz
myaocat: f
acheesedanish00: f
KyleUE: why are you learning unity?
Zasuslive: he is getting into AR
riddari_: holy shit
gofoboso: yeah why?
crusher_az: lol
riddari_: I finally caught a geohot stream
J3rwin: he 3d printed that
WizWiz0: why not Unreal?
saulgd: can you do the whole strim with that thing on your face LUL
alluxua: That is pretty adorable
Bloodspark_: windows ding
google_cat: D:
alxhotel: Why Windows ?
aathove: you need a gaming headset to be a real streamer
cccnrd: where will u get your display driver from???
Dimendz: Any reason you went with Unity over ue4?
keepingtrckofthisacct: @riddari_ i know, right?!
eyep1e: fooken windows
kevczy: What is that green called?
HanksPlay: developers get pixie for free?
SpecialAgentSkye: Cam little lower? We done gone looked at top half of your face for 5 minutes LUL Not complaining though, still looking Kreygasm
Zasuslive: probably memory bias, just went with unity just cause
kevczy: Have u gone to any ctf?
pyythonn: prefap
aathove: LUL
codermark: hoping you will make the best AR glasses, I really want one :D
cIvIcbooks: is semantic versioning not a thing anymore? everybody using years in the versions
aathove: where's the RGB lighting now that you'
aathove: where's the rgb lighting now you've got a windows pc
avagyannarek: ResidentSleeper
stathizzzz: I dont know about Unity either but would choose Unreal engine I like more playing with C   than a pseudo language like C# LUL
wall_streeter: why unity?
alluxua: so geohot is moving from self driving car to gaming industry?
NolanBridges: @aathove agreed, it's a Razer too LUL
keepingtrckofthisacct: I'd suggest Unreal
kevczy: He’s just doing whatever he wants
Zasuslive: AR isnt gaming
aathove: @NolanBridges get a load of George using razer and NO RGB
keepingtrckofthisacct: @stathizzzz
rhytual: @cIvIcbooks you are not a real hipster if you dont version by year
allthesm0ke: RATTED
dxxdpools: Where did he go?
alluxua: By the way, what's AR?
Zasuslive: augmented reality
pentaquant: Hi @georgehotz I'm 27 and in Finance in SF, and it fucking sucks. Do you think its too late to make a pivot to data science or SD?
saulgd: is he a babyface now? Kappa
fjeuber: Augmented Reality
NolanBridges: @aathove look what you did LUL
Bloodspark_: LULW
Bombapil0t: litstuff
saulgd: @pentaquant make your monies and GIT OUT
jellyjar: ah he has a razer blade?
P0LY: LUL
Nesquik80: @georgehotz what razer do you have
aathove: @NolanBridges fuck he's gonna start coding his own keyboard
Bloodspark_: GAMERS haHAA
kevczy: George how about the defcon that is coming up
Dimendz: Do you ever game?
codevisionary: thanks to gamers, us programmers have better hardware @georgehotz
Cihonidas: LUL
JBirch10: You need to understand them with what you are doing now
Dqyijote: Gaymers
UniversalGeneve: @pentaquant bio major in SJ, pivoted to DS/ML, beel loving it
HanksPlay: AND DELETE BLENDER
HanksPlay: download Maya
Toaster_PG: i am gaymer
Darth_Kirias: Hey man, is that a razer laptop? @georgehotz
riddari_: holy shit windows looks fucking hideous
slimyoof: @georgehotz have you tried vr porn? OpieOP
Kvann1 : @HanksPlay DansGame
o_sagga: @georgehotz just finished college, what should I do?
rauluz: have u seen the new windows terminal?
c19946: why u not try using react native ar or sth like that learning c sharp for ar is wasting time
jellyjar: lmao
dxxdpools: Did he say he will be back?
slimyoof: LUL
erichtp: AR porn tho
alluxua: what is vr porn?
saulgd: @georgehotz just came out of the womb what should i do?
rhytual: LUL
Bombapil0t: LUL
Hjorthlol: @riddari_ the fuq u say
pentaquant: @UniversalGeneve how long did it take you to pivot?
raikkonen933: windows ResidentSleeper
stathizzzz: VR what?? PogChamp
riddari_: @Hjorthlol windows sucks
myaocat: till the batteries die
HanksPlay: and LIDAR is a SCAM
TheTastefulToastie: and who wants life amirite?
HanksPlay: lol
codevisionary: AR is the future
Jeppelelle: So, when can we expect a haptic penis sleeve?
stathizzzz: Augmented chicks > virtual chicks, makes sense PogChamp
Jannnik: just create JOI from Bladerunner 2049
Acles123: wait until vr becomes life
markvlk: Do you miss living in your office
aathove: where are the stream snipers
UniversalGeneve: @pentaquant if you have drive, you could do it in a year, it took me 6 months, just taking moocs and doing a lot of relevant projects
trader_f: no more vim
cccnrd: where r u rightnow?
o_sagga: @georgehotz just finished college, what should I do??
kevczy: Unity asset store still sucks
alluxua: game developer
veomx: the cloud hehe
th3_maj0r: @georgehotz http://1m2019.com/ doesn't work
HanksPlay: masturbate
PhelpsGG: @georgehotz I appreciate you and the work you do brother. You're a brilliant mind in a society of mostly stupid people. We need more people like you man. Much love <3
gofoboso: pay your loan :p
cccnrd: learn programming
riddari_: how does one become as good with vim as geohot?
0xBADBADBAD: You should focus on your instagram influencer career.
fumundaqueso: why do you keep chugging an empty soda
mkdrmnd: too late 😂😂😂
asherism: what inspired this new venture or "hustle"??????
HanksPlay: learn python and javascript and get a 6 figures salary =D
revolutionist123: PogChamp
benjibanjobenjo: hack the next playstation and get infamous :)
aathove: yo geo are you gonna move to denver with the new law
saulgd: i'm already thirty NotLikeThis
pentaquant: @UniversalGeneve thats the shit thing about finance, long hours
Bloodspark_: PogChamp
BookRaider: what do oyu mean by sell out?
Dimendz: Be the first person to make VR and AR actually good please.
Cihonidas: life hacker
elonzupsk: Hahaha but you did with comma
veomx: a word
Kvann1 : stop NotLikeThis
Bioaim7: true
Bloodspark_: Nice movie plot LUL
cccnrd: r u feminist?
ApexJnr: @georgehotz americans on reddit told me 25k is low for a web developer at 22 (then i realised that they have no concept of what people make outside of the us ) NotLikeThis NotLikeThis NotLikeThis
J3rwin: sellout?
maxviaa: are you using a monitor?
stathizzzz: Unity's ECS model is crap, build a custom ECS model in python that is gonna be 10 times better with less effort than learning Unity PogChamp
erichtp: define selling out
knilecrack: Whats wrong with selling out
o_sagga: thanks man
myaocat: One who betrays a cause for personal advancement.
codevisionary: https://clips.twitch.tv/AbrasiveBashfulGrouseNononoCat
dbroers: Why not make games in the App Store? A lot less risk and work, and you make money.
alluxua: geohot, how about sing a song?
ApexJnr: @georgehotz make a game where u hack ps3
rhytual: @ApexJnr 25k is like the lower boundary for a web dev in central europe
elonzupsk: Real bs hahaha
veomx: i miss your small room
VertXY: Thanks for the advice, just split up
Zasuslive: he doesnt want to become a game developer guys, he wants to create an AR product/platform
JumpTwiice: PogChamp
aathove: you should kickstart it
SgT_Vimes: Sellout!
dbroers: @vertxy lol
codevisionary: you're right @Zasuslive
ApexJnr: @rhytual if you're 22 years old, 25k is fine and you're ahead of most people your age on average XD
Acles123: headset looks like something out of ghost in the shell
myaocat: http://1m2019.com/
elonzupsk: Damn that looks great
HanksPlay: i dont believe in what i do here at google, but i have bills to pay =/
pentaquant: Like private equity.... pure sellout
SpecialAgentSkye: unity LUL
aathove: are you sure there's nothing in the can, you keep drinking from it LUL
elonzupsk: Lets raise seed for that
th3_maj0r: Installing unity is harder than learning unity
Zasuslive: its never too late to switch to UE4 george...
dbroers: Kids...
Zasuslive: ;D
kevczy: What are you drinking
Adolfich77: where is coding??????
ApexJnr: @rhytual i got flamed and they were talking about 80k   but then i realised they dont understand
0xBADBADBAD: Imagine getting life advice from a person with that desktop background
lightofhel1: too many reloads ResidentSleeper
asherism: lifestyle creep!!!!
0xBADBADBAD: love you tho
aathove: i buy poo on the deep web LUL
HanksPlay: idk, i like to buy stuff, makes me happier i think
Hiladina: does stream freez for ou guys aswell?
eyep1e: green tea   have to live in cali cucks
HanksPlay: idk, im a little empty
Bombapil0t: :D
UniversalGeneve: @pentaquant i was a lab rat - 8 hours a day, plus i had to devote an entire day for taking care of my grandmother. i'm not trying to give you a sob story, but what i'm saying is that if you want it, you'll make time. i was sleeping 4 hours maybe 3-4x a week, just so i could fit my studying in. you can do it, you have a background setup for it, i had to relearn a LOT of math.
JBirch10: Electricity lol and internet, insurance, you know bills lol
data_day_life: !ig
elonzupsk: Hit some angel meetings with that prototype
ApexJnr: @georgehotz ps3 hacking game 2020?
0xBADBADBAD: No.
Bloodspark_: depends on who you are yeah
javadragoniv: gee 800$ where did u find that lol
myaocat: no one is talented like you. no one can hack iphone, create a self driving car under a month..
knilecrack: What if you are happy selling out
eyep1e: wen ps2 hak
revolutionist123: @georgehotz How 1m goal goes?
nanodanger7: @georgehotz this is my 1 year subscriber anniversary any discount? :D
Acles123: true
kevczy: Now you talk like my dad
SpecialAgentSkye: Like in game skins LUL
pentaquant: @UniversalGeneve thats not a sob story thats a fucking motivational story. I'm going to DM you
0xBADBADBAD: What else will I do to fill the void in my soul?
aathove: should i buy poo off the deep web
anthraxvirus322: Any Pepega in chat
aathove: TehePelo
Bloodspark_: Pepega Clap
WaIeed: First time on unity?
SpecialAgentSkye: Should i sub to you for the dopamine rush @georgehotz ? 🤔
rhytual: @ApexJnr its a good starting salary at 22 for sure (guess u are from europe?) - muricans also have a different tax and social system, so the numbers dont rly work that way (ofc SV is a bit different LUL)
Poethick: @georgehotz F2 to rename
davidsit_site: lol
aathove: 4Head
BookRaider: i can sell you high grade poo for $1
kevczy: I’m going out for defcon!
myaocat: nice
aathove: @BookRaider please I need my daily hit of poo
Dimendz: I genuinely think if you want to make the best AR product, unreal engine is the way to go
myaocat: @kevczy who pay?
orochiviia: LUL
youngsachi: PogChamp
Dimendz: ooo PogChamp
kanogger: :)
sharmajee: NotLikeThis
HaywoodJabroni: whats up forsenE
anthraxvirus322: BUT can you put Pepega in unity ?
myaocat: f
kevczy: No pay, it’s gonna be tmrw for ctf
Zasuslive: yh so ease of use = unity
Johnnymamen: any antivirus preinstlled on razeer laptop?
aathove: wait isn't that just blender??
HaywoodJabroni: any bajs forsenE
showzennn: Are you going to be a game develepor now @georgehotz ?
myaocat: @kevczy what team are you?
ZiklarxD: Upcoming gamedeveloper? @georgehotz
JumpTwiice: bajs🔭
HaywoodJabroni: forsen1
Bioaim7: he already is @showzennn
anthraxvirus322: Game developer PogChamp
Dimendz: Need a second monitor lol
myaocat: @kevczy i also play ctf but im really bad at it
smurfd0: kindof like 3d studio or blender
myaocat: maybe i should ditch the lifestyle
anthraxvirus322: just add one more screen 4Head
showzennn: @Bioaim7 what games has he made?
kevczy: I work on reversing
myaocat: i don t know what it even means
th3_maj0r: almost 500 viewers boys
HaywoodJabroni: PogChamp
Hjorthlol: DatSheffy /
anthraxvirus322: PogChamp
HaywoodJabroni: monkaS
youngsachi: PogChamp
Dimendz: PogChamp
alluxua: I like his sweater
HaywoodJabroni: monkaS powerful
kevczy: I’ve won about 3ctf by now
Dimendz: u r god
Bloodspark_: PogChamp
HaywoodJabroni: speshial forsenT
NolanBridges: Dabbing John Lemon
anthraxvirus322: it is alive monkaS
cccnrd: boiiRollt boiiRollt
Bloodspark_: Who is this god? Pog
HanksPlay: i recommend you to go back to T pose
cccnrd: boiiHip boiiHip boiiHip
NolanBridges: @HanksPlay I agree tho
eyep1e: john lemon for potus
anthraxvirus322: FeeldAmazingMan
myaocat: @kevczy did you debug a .net application? i am trying to attach process but cant see locals and i dont know how to resolve it
anthraxvirus322: FeelsAmazingMan
HanksPlay: unity and skeletons are messy
NoneFuture: what's going on guys?
HaywoodJabroni: pajaShrugL forsenE pajaShrugR
HanksPlay: just go back to T pose
showzennn: prefabs implement Composite pattern?
NolanBridges: @nonefuture learning Unity
Kvann1 : Character
anthraxvirus322: just go back to T pose 4Head
HaywoodJabroni: 4Head
NolanBridges: @nonefuture so he can code games for AR I think
gal40: Any node in the hierarchy is a gameobject
NoneFuture: @NolanBridges thanks
gofoboso: getting Boro
gofoboso: boring ×
showzennn: he is going to create a simul
しのし: auto save above scene
woobot: auto save is top right of the scenes
NolanBridges: @gofoboso You know you don't have to watch if you think it's boring...
veomx: hey george you have really a BMW
machinelearningbot: you definitely need to create the CLI version of unity
stathizzzz: John Lemon is it the guy singing "Imagine all the gameobjects"??
myaocat: 448 views what
anthraxvirus322: sure SeemsGood
veomx: Im from Bavaria thats why im interested
Dimendz: Parameters, now we're talking
NoneFuture: Okay
knilecrack: Bavarishen motor werke
spoco: wysiwyg = cancer
HanksPlay: @georgehotz change the model back to Tpose, maybe is going to offset the arm animation
anthraxvirus322: Just make unity CLI 4Head
Quick_001: WhatTheHeck.. George on a windows machine
anthraxvirus322: its a VM Kappa
myaocat: Is it John Doe?
anthraxvirus322: John Doe monkaS
anthraxvirus322: monkaGiga
Zasuslive: painful to see him waste time with this stuff
Kvann1 : Turn off PlayMod
onu4r: @Zasuslive this is how learning works
stathizzzz: George on Windows is like Game of Thrones season finale 4Head
gofoboso: BrokeBack
Dimendz: It's like vaadin designer but for video games lol
zimxtv: Lol chat needs python and ML
Luki512: Hello @ all
zimxtv: And most importantly chat needs Vim
gofoboso: Yeah py ml
gal40: All nodes in the heirarchy are gameobjects. The outermost John Lemon is a dummy gameobject which encapsulates everything. The inner John Lemon is just the actual model.
Kvann1 : just drag and drop it in obejct
Jeppelelle: drag ub ubti tge cibtrikker fuekd¨
pyythonn: drag it to the right
hintz3y: LMFAO
birrdd: ratirlCoffee
JonThomasK: whats up mr. hotz
Jeppelelle: drag it into the controller field
Staredad: Iirc changes made during playmode is not saved, does this apply to animator controllers too?
Jeppelelle: 👍👍
Luki512: The mic sounds like its stuck into a bread :)
Jeppelelle: This is gonna be a 27 part series :D
Zasuslive: @onu4r I guess if you wanna become an indie developer but he wants to develop an AR platform/product, theres quite a bit of this he can skip (e.g. character animation)
knilecrack: why it's good
myaocat: mic is ok
gal40: You are currently in Play Mode. Changes are not saved when in Play Mode
birrdd: broski
machinelearningbot: what is he drinking>?
JumpTwiice: Kappa sure
SpecialAgentSkye: Mic isnt that bad tbh. Its good for a laptop mic imo
rhytual: Kappa
knilecrack: piss
JonThomasK: liberal tears @machinelearningbot
revolutionist123: Kappa
myaocat: macbook mic is crap
myaocat: also you hear the keys
Bloodspark_: it's okay
mondeverest: drink more coffee to speed things up
Kvann1 : @georgehotz Turn off PlayMod, changes are not saved
trader_f: Show a tour of your million dollar mansion
showzennn: @georgehotz Click JohnLemon Add Component and add a Script than u can use GameObject references and drag the Unity objects to the Script references
spoco: If you could just write code, I would pick up Unity right now, but this stuff is so off putting that I can't even
pentaquant: @georgehotz I bought a new razer blade advanced mer white. Fucking beautiful
knilecrack: he is walking away from you
myaocat: john lennon
gal40: @spoco I use unity and I never ever do this. He is following some tutorial but you can do everything with code
myaocat: ^ i heard
veomx: order a starbucks cold brew venti
Kvann1 : @georgehotz Turn off PlayMod, changes are not saved BlessRNG
Bloodspark_: alive monkaS
gofoboso: maybe you should do that tutorial beforehand
slimyoof: LUL
redbullwiiings: goddamnit john lemon
knilecrack: told ya
Bloodspark_: Fisicks Pepega
stathizzzz: John lemon has left the building...oh wait.. no buildings !! Kappa
Bloodspark_: No gravity
spoco: @gal40 ok good to know
saulgd: click and drag strim ResidentSleeper
Darth_Kirias: wtf that doesn't look like john lenon
trader_f: game designer ResidentSleeper
Bloodspark_: Noob LULW
mybestman: Try rigidbody 2D?
Darth_Kirias: blueprints ResidentSleeper
gal40: You are editing the Prefab. The john lemon in the scene is not connected to the prefab.
pyythonn: increase mass?
SpecialAgentSkye: Should i sub to you for the dopamine rush @georgehotz ? 🤔
myaocat: HYPE LETS GO
slimyoof: monkaS
Dimendz: MonkaW
gofoboso: u
Kvann1 : Need some RigidBody
youngsachi: WutFace
revolutionist123: BibleThump
veomx: :D
c19946: it 's impossible you can write code in this stream
gofoboso: tutorial inception
redbullwiiings: BibleThump hes dead
gofoboso: watching a tutorial inside a tutorial
knilecrack: :D
Bloodspark_: BibleThump byebye
imageliner: @specialagentskye you asked this twice now do it and don't regret it! KomodoHype
c19946: lemon fucked up
discipleyo: yoooooooooooooooooooooooooooooo
aerotone: its z pos
aerotone: nvm
rstk1: windows machine,
veomx: almost AAA already
veomx: at least alpha
Bloodspark_: yeah hitbox
Lazysloth: john lemon = lemon grab unacceptable
slimyoof: VoHiYo
Bloodspark_: PogCHamp Clap
c19946: why they name this animal john lemon?
revolutionist123: me :)
Bloodspark_: PogChamp Clap
grizvok: how long has he been live?
Kvann1 : You can use JavaScript Kappa
Lazysloth: his head looks like lemon probably
Bloodspark_: C# :/
Hazor90: !uptime
Lazysloth: no u can't use javascript
gofoboso: because it's catchy
gal40: JavaScript is no longer supported.
aiis: He's been live 49 minutes
Lazysloth: it was never supported
gal40: It actually was never supported because it was a javascript clone named UnityScript not javascript itself
grizvok: @aiis thank you
JumpTwiice: outdated visual studios LUL
Zasuslive: Isit cool if I shill my indie game just once 😅
c19946: he said script
Dimendz: C# Pog
Lazysloth: does he have unityvs installed
Yellow_turd: you're so hot when you type like that
leveledgod: @Zasuslive ask forgiveness not permission
PabloBree: white IDE NotLikeThis
Bloodspark_: NotLikeThis
youngsachi: WutFace
knilecrack: ctrl   shit   home/end to select everything
revolutionist123: my eyes are burning with that white IDE WutFace
Staredad: LUL
asthmaa: vs2019?
Bioaim7: that he even uses an IDE is gigantic
Bloodspark_: D:
knilecrack: change theme
Zasuslive: @leveledgod check it out on yt Project Fox Online. Based on metal gear solid 4’s multiplayer
Harm133: you can set the IDE to dark mode
Zasuslive: Forgive me guyzzz
Lazysloth: install vim extension for VS
Kiddepants: Not gonna lie, first live stream from tomcr00se :D
Hazor90: you can change theme to dark in settings
mehi9h: just make it dark pls
darkwon_: visual studio has dark mode built in
gal40: Tools > Options > Environment > General > Color Theme > Dark
stathizzzz: George there is a Dark Mode in Visual Stdio if it suits you
Bloodspark_: :horn:
smurfd0: .. or just grab gvim
Lazysloth: gvim is meh
twitchistrash788: Csharp is best with VS
Dimendz: People that don't use dark mode in any IDE are psychopaths
aladdin_mck: Use Emacs!
BookRaider: use notepad like a real man
veomx: after comes the yoko ono extension pack
aladdin_mck: Yea fr
elyaizen: your setup look really good man, you need dark mode
Lazysloth: thats for controlleers probably
Zasuslive: A real editor has yellow as its background, easier on the eyes :))
Lazysloth: for joysticks
gal40: Input.GetAxis returns the displacement from the middle of the controller. It works for both joysticks, and wasd/arrows.
KyleUE: did this dude just gatekeep editors?
Bioaim7: duduuumm
BlackSords: how about using unity platform instead?
Lazysloth: does self driving stuff quat is hard tho
myaocat: @gal40 are you israeli?
gal40: Yes
myaocat: ma kore :)
spoco: @Zasuslive with cyan text right? Kappa
liquidcomb: WutFace STOP
avagyannarek: @gal40 Are you illuminati?
grizvok: vscode intellisense is incredible
Lazysloth: gal = wonder women SeemsGood
supremad: jetbrains FTW
Kiddepants: Xcode or Visual Studio?
asthmaa: @grizvok have you tried intellijidea?
keepingtrckofthisacct: @gal40 hi, do you stream?
gal40: No
gofoboso: ReSharper
twitchistrash788: Intellij requires a beastly machine to run smoothly
BookRaider: get off his dick guys give him some space
Acles123: ctrl   shift   end/home
keepingtrckofthisacct: @gal40 looks like you should :)
Knarez: whats the deal with his new computer
Zasuslive: @spoco cyan is a godly colour :]
CraftyGaming: OnAnimatorMove is a built in function
Lazysloth: new computer = windows gasp
zneel_73: bro your can is empty since at leat half an hour
Bombapil0t: windows, bling bling ide, game dev NotLikeThis
twitchistrash788: T POSE
Bloodspark_: No, 1/2 dab
gal40: The Animator component will automatically look for the OnAnimatorMove and call it
xaxxjs: hi bro
miths: georgehotz stuck in tutorial hell LUL
Knarez: right click task bar -> cortana -> hidden
Knarez: thank me later Kappa
Bloodspark_: LUL
Lethly: what are the specs of the new computer?
Knarez: LUL
Lazysloth: ew
Crypod: LUL
smurfd0: strutting like aboss
Bloodspark_: PogChamp Clap
shinzxc_: PogChamp
grizvok: LOL
revolutionist123: PogChamp
Kvann1 : PogChamp
youngsachi: PogChamp
orochiviia: PogChamp
the_best_russian_bear: PogChamp PogChamp
cIvIcbooks: fuckin jon lemon
stathizzzz: Walking on his toes PogChamp
BookRaider: time to run away kids
JumpTwiice: LUL
gofoboso: they see me rolling
Bloodspark_: no omnidirectional movement LUL
CraftyGaming: Man, for once I know more about something than George
JumpTwiice: gachiBASS ASS ETS
zneel_73: empty can bro
aiis: LUL
Lazysloth: nice headset
Bioaim7: LUL
Zasuslive: ffs g2g. Near the end of the stream if George has a lil break and does somewhat of a Q/A can someone just ask where we sign up to help break the simulation (im srs loll) will watch the stream on yt later
Bloodspark_: LULW
EddieTex: you using windows bro? lol
stathizzzz: Nice sunglasses
Bloodspark_: what
Lethly: what are the specs of the computer?
M03x: am an c# student should i get into unity ? or just switch to java it has more job opportunities 4Head ?
Lazysloth: judge dredd cosplay
Bombapil0t: :D
twitchistrash788: He's drinking redbull
JumpTwiice: LUL true
UniversalGeneve: LUL LUL
revolutionist123: TriHard
Bloodspark_: It's a Razer Laptop, I saw an i7 8th gen and GPU idk
asthmaa: @M03x kotlin
asthmaa: java old
shinzxc_: @Lethly razer blade 15
CraftyGaming: I just got a job in java because it pays more, fuck java
grizvok: or go
Lethly: cheers
elyaizen: have you found a name for your AR machine?
Muratandjose: D:
Knarez: LUL
manutdgeo: @georgehotz dude, you are like an idol to me, been seeing some of your wokr since the ps3 exploits, keep it up man !!!
Zasuslive: lmaoo
borkloverr2: What do you think about swift?
BookRaider: Java died in 2007 when oracle bought Sun
twitchistrash788: lmao
trader_f: sardBan sardBan sardBan
Bloodspark_: monkaS
Maakishoot: where can I find this unity tutorial?
stathizzzz: Im a JAVA hater too SeemsGood SeemsGood SeemsGood SeemsGood SeemsGood
M03x: LUL
Bloodspark_: BAN monkaS
tigopotter: george why did you quit comma.ai??
shinzxc_: JAVA (puke)
miths: Java is love, Java is life <3
Dimendz: Why do java devs need glasses? Because they can't C# PepeLaugh
Zasuslive: me
Harm133: me me
Muratandjose: are python questions banned here aswell
M03x: @asthmaa is kootlin based on java ?
CraftyGaming: Mod me
JumpTwiice: me PogChamp
grizvok: @Dimendz LOL
elyaizen: me
nanodanger7: me
discipleyo: me
Bioaim7: TypeScript <3
Zasuslive: oh nvm subs only
Lethly: i have subscribed for a long time
miths: MEME
Knarez: me Kappa
youngsachi: TriHard
Muratandjose: no me :)
trader_f: not me
Bloodspark_: me :) pls
Lazysloth: lol don't even want the power
nanodanger7: one year man :D
asthmaa: @M03x yes
avagyannarek: JAVA is PHP
hintz3y: cheer1 me
the_best_russian_bear: me Kappa
tanoshiizo: that guy
gl3nn_wolf3: I'll do it
shinzxc_: 12 mo PogChamp
Maakishoot: JAVA suck Python for life
Bloodspark_: fuck
Erciks: i dont. Mod means responsiblty
Rellekz: me
Kiddepants: This is my first live stream lmao.
khronicz: khronicz subscribed with Twitch Prime. They've subscribed for 2 months!
Knarez: LOL dude the blue crown is not a sub
Kiddepants: On here
stathizzzz: Who s in the mob??? PogChamp
JumpTwiice: not even a sub LUL
Knarez: it's only twitch prime
zneel_73: LUL
MatiGoG: monkaS
imageliner: LUL
Knarez: LUL
trader_f: sard17
Bombapil0t: mod @nanodanger7 :D
slimyoof: LUL
Knarez: no
khronicz: khronicz subscribed with Twitch Prime. They've subscribed for 2 months!
orochiviia: froggenPega
aerotone: LUL no
Zasuslive: xD
Knarez: only if they subscribe with it haha
gal40: If you are seriously interested in using windows, you might want to look into WSL (ubuntu in windows)
grizvok: you get the same from twitch prime
zneel_73: scams
Muratandjose: he doesnt know LUL
CraftyGaming: shhh nerds relax
M03x: @asthmaa is it only for mobile ?
discipleyo: if I sub can I get mod?
nanodanger7: im here
UniversalGeneve: LUL
eyep1e: just mod everyone
Knarez: LUL
th3_maj0r: a lot of subscribes now ahaha
mondeverest: bogaShh bogaShh bogaShh
trader_f: he wil ban all LUL
M03x: scammed LUL
JumpTwiice: monkaS incel mods
kaanfsd0: love making money is meh :(((
hintz3y: kappa1 I'm the top cheerer
meeeeeeeeeeeeeeeeeeeeeenz: hey. what are we doing today?
twitchistrash788: Elevate me
Erciks: LuL
Dimendz: Go for partner ship
the_best_russian_bear: desertukMoncat
stathizzzz: Mod me for non subsrcibers PogChamp
o_sagga: me toooo
nanodanger7: yay
asthmaa: @M03x no, they working for native, ios, android, web server all
zneel_73: LUL
Bioaim7: aren't you sell out now ? @georgehotz LUL
Howi_: LUL
javadragoniv: @georgehotz i can only guess with a name like mine i can sub for eternity and i wouldnt get mod huh
Luki512: Where you see the follow date?
grizvok: he's a shifting fucker
revolutionist123: This chat this some more emotes
grizvok: shifty*
Scheback: how long will be the stream ?
M03x: @asthmaa thank you SeemsGood
eyep1e: VR sims coding
JumpTwiice: WutFace
grizvok: MY EARS
shinzxc_: WutFace
twitchistrash788: WHoa
Bioaim7: aren't you sell out now ? @georgehotz
Zasuslive: woahwoah
myaocat: yes
MatiGoG: WutFace
Muratandjose: WutFace
Erciks: yep
sDeRs122: yes
zneel_73: monkaS
tanoshiizo: WutFace
eyep1e: REKT
youngsachi: WutFace
aerotone: WutFace
Bombapil0t: CurseLit
Yellow_turd: WutFace
grizvok: FUCK MY EARS ARE BLEEDING
Staredad: WutFace
trader_f: owh shit
revolutionist123: This chat needs some more emotes**
nanodanger7: lol
Xavur_: monkaS
discipleyo: NotLikeThis
Dimendz: WutFace
Kiddepants: That's loud lol
UniversalGeneve: haha
Lazysloth: fireplace is loud
Kvann1 : WutFace
javadragoniv: fuck yeah
stathizzzz: I cant hear nothing, Im deaf Kappa
Bloodspark_: Bloodspark_ subscribed at Tier 1.
Zasuslive: its called ambience and its killing many speakers and headphones rn
grizvok: my earssssssss
imageliner: LUL
Yellow_turd: still there WutFace
Rlchibi: stop play
slimyoof: NotLikeThis
JumpTwiice: WutFace WINDOWS SOUNDS
M03x: WutFace
sDeRs122: omg that kinda painfull
jedynka_trygonometryczna: @georgehotz is it you bmw on instagram?
youngsachi: WutFace WutFace
the_best_russian_bear: sova96RipEars sova96RipEars
avagyannarek: same
slimyoof: i hear static
gofoboso: it's windy
shinzxc_: LOUDER FeelsGoodMan Clap
Bloodspark_: WutFace PLS
M03x: windows WutFace
mehi9h: oh thank god
Xavur_: why no linux :(
revolutionist123: WutFace
grizvok: my headphones were kinda loud
grizvok: jesus
Bloodspark_: mod me :)
UniversalGeneve: sound card broken?
Kvann1 : @georgehotz Turn off PlayMod, changes are not saved BlessRNG
Lazysloth: play mode isn't saved
Rlchibi: yeah any changes made in play mode doesnt stick
CraftyGaming: The only changes that will save in play mode are prefab modifications like materials and such
gofoboso: kookoobird
miths: What kind of game are you going to build? georgehotz
JumpTwiice: wasd to move cam around
Enriquetecfan: Why are you learing unity ¿?
gofoboso: this one 1-0
Bombapil0t: squeeze some $ @Enriquetecfan
Bloodspark_: So close to cam monkaS
meeeeeeeeeeeeeeeeeeeeeenz: jhon lemon = john lennon?
Staredad: @Enriquetecfan AR
Kvann1 : Double click on game object, to zoom it
IWasnotDemi: @georgehotz I love you
Bloodspark_: John Lemon: The Adventure :)
JumpTwiice: the keys W, A, S, D to move editor cam
JumpTwiice: NotLikeThis
Enriquetecfan: Thanks Chat !
CraftyGaming: With the Directional light selected, you can press 'e' to change to the rotation widget
dorkmo: vladimir lenin?
CraftyGaming: r, to scale, and W for transform
miths: y u no create own game engine? PepeHands
zneel_73: freezes
smurfd0: think ur dropping frames...
Lazysloth: fps = 11 lul
flitnlockphilly: Dude just make your own game engine in visual basic, like bisquit would
Bloodspark_: @miths LUL funny
M03x: @georgehotz can you get rich with unity ? 4Head
UniversalGeneve: @georgehotz do you have a stream schedule, or just whenever you have time?
stathizzzz: Bisqwit god !
flitnlockphilly: don't worry, it is
JumpTwiice: u bet LUL
CraftyGaming: It's pretty hard to watch tbh
miths: I don't know unity but it is still painful
M03x: @stathizzzz  1 SeemsGood
HanksPlay: trihard1 trihard1 trihard1 trihard1 trihard1
flitnlockphilly: Hackerman spends 12 hours learning how to use basic UI
Bloodspark_: ol
M03x: LUL
JumpTwiice: imagine using vim LUL
gofoboso: 666
birrdd: ratirlCoffee interesting
gofoboso: 999
CraftyGaming: nav mesh is the real magic
kevczy: Vim for unity? That sounds disgusting
Bloodspark_: true :D
gofoboso: 333
M03x: @birrdd ratiirlTip
M03x: nvm FeelsBadMan
birrdd: @M03x ratirlTip
my_curiosity: @georgehotz is this project related to the car ai thing or are you doing something other for fun ?
adriaroms: new computer?
birrdd: ratirl subs in here, LUL
M03x: @birrdd while he is live LUL
kevczy: @adriaroms yea
Zasuslive: 160p exists wtf lol least I can stream the audio
birrdd: amazing!
Bloodspark_: LUL
adriaroms: @kevczy specs?
birrdd: @Risky2001 so bored?
gal40: NavMesh is the mesh of where an ai agent can walk.
kevczy: @adriaroms umm it was in the beginning of the vid
birrdd: is there a command for ur new pc specs?
miths: What are the specs on your new pc?
Zasuslive: gal40 indie dev?
mikeyyinspace: !specs
adriaroms: !motherfuckerSpecs
Bloodspark_: !specs Kappa
CraftyGaming: Ctrl s is muscle memory for me now, along with ctrl shift s in visual studio
Yellow_turd: What are the specs on your new pc?
HanksPlay: i dont think is boring
gal40: On my free time
Lazysloth: Intel Pentium Processor
HanksPlay: crash
kevczy: The stream looks pretty decent
birrdd: pentium PogChamp
Bloodspark_: Thhis is pretty entertaining for me at least
JumpTwiice: PogChamp
adriaroms: !newMonsterPCspecs
Bloodspark_: PogChamp BEAST
JumpTwiice: monkaS deth
my_curiosity: i thought he was a mac guy :D
youngsachi: PogChamp
UniversalGeneve: bigARms
mikeyyinspace: i heard soda improves blood circulation Kappa
M03x: can i use unity on my i5 820m geforce ?? DeelsBadMan
flitnlockphilly: What would you do if george hots slapped your girlfriends ass
gofoboso: Al
Xavur_: slap his ass
kevczy: @flitnlockphilly I’ll Give it to him
gofoboso: all the muscle is in the fingers
Bloodspark_: @M03x barely maybe but the more complex your project becomes the more it's gonna lag and shit
Lazysloth: probably some rich people water in a can
kevczy: What is that drink?
Bloodspark_: LUL
flitnlockphilly: Can I run this project on my voodoo 2?
Bombapil0t: DansGame
Bloodspark_: HAHAHA
HanksPlay: eco? why not google home?
stathizzzz: Bad boy
tigopotter: george why did you left comma.ai?
kevczy: Why are you going doo doo
UniversalGeneve: *NY accent* computer~
Bloodspark_: WHAT
FartKnockGomez: this is how skynet starts DansGame
CraftyGaming: I think I'll name my next dog Alexa, just to create a little chaos
UniversalGeneve: LUL
Muratandjose: i thought i heard my name
hawkield: Windows? DansGame
gofoboso: lol
Caene: Justin who? Kappa
UniversalGeneve: WutFace
mondeverest: bogaS
stathizzzz: Justin who??? WutFace
FartKnockGomez: LUL what a douche
UniversalGeneve: justice beaver
CraftyGaming: You will use multiple cameras in most solutions
kevczy: Ok now it’s about comedian
gofoboso: blieber
jotembruv: how come u didnt go with ue4
JumpTwiice: this tutorial is scuffed af LUL
stathizzzz: Only justing I knew was justin.tv
KrakkenTM: Hellooooo @georgehotz
adriaroms: specs?
W1lkins: Was the refactor of minikeyvalue from python to Go streamed?
Kheri0n: will you be creating ai world in unity?
KrakkenTM: still not verified here? LUL
knilecrack: you should've named him GeorgeLemon
Caene: monkaS
gofoboso: DrinkPurple
stathizzzz: Change this house to a rock Opera hall and let john give a concert PogChamp
kevczy: What is the drink)))))))?
gofoboso: BCWarrior SwiftRage PJSalt
KrakkenTM: F?
Caene: F
Muratandjose: f
youngsachi: f
zbszx: LONG LIVE THE STREAM
mondeverest: bogaBusted bogaBusted bogaBusted
foxubu: foxubu subscribed with Twitch Prime. They've subscribed for 8 months, currently on a 1 month streak!
mondeverest: bogaQ
Bloodspark_: F
salihyil1: why u learn unity?
gofoboso: long live rock n roll
Lazysloth: refresh plebs
Bloodspark_: no :)
CraftyGaming: You dropped frames, they are paying respect. F in unity will focus on the selected object
el_pirulote: it's the f word
Kheri0n: PogChamp
gofoboso: rainbow
PhosphoricAcid: F
KrakkenTM: f
Caene: Would be fun to see you progress from noob to not-so-much-noob over streams. Could be fun.
mondeverest: keeps freezing for me
zneel_73: F
zbszx: alright guys, does anyone know neural networks built with pytorch? i am struggling w/ my homework
stathizzzz: 0.5 Fps
knilecrack: yeah
gofoboso: lag
the_best_russian_bear: F karmik4
foxubu: freezing
Darkhunder1: f
CraftyGaming: Full F
kevczy: Focus
markovchain21: unity ate him alive
KrakkenTM: https://www.youtube.com/watch?v=YOBM5UaeTXk
markovchain21: razer pogg
mondeverest: bogaGood
HanksPlay: i want to see @georgehotz playing VR Chat!
Rlchibi: are you still streaming to Taiwan xDD
kevczy: I’m good
Lazysloth: saved!
Bloodspark_: LUL
Darkhunder1: ok
markovchain21: @KrakkenTM ellinas ?
Caene: It said Taiwan there though LUL
Caene: Legit
foxubu: 0 kb/s :o
KrakkenTM: @markovchain21 yy
naix_1337: PogChamp live again
buhrmi4tw: aaayyy
Bloodspark_: oh back
foxubu: pppkay
Xavur_: omg thats bad
Caene: The pixels LUL
kevczy: Hm unity never helps my lige
KarlaVxleria: : (
foxubu: blurry :(
kevczy: Life*
stathizzzz: 75 Mbps download, 3 Mbps upload LUL
Bloodspark_: potato stream HYPERS
Caene: It's better than nothing!
Xavur_: have you tried turning router off and on again? LUL
Caene: LOL
kevczy: There it’s back
Nougekai: @georgehotz what do you think learning machine learning (python) as a neurosurgeon? Worth the try, or is it too much?
salihyil1: 160p
spoco: welcome back to 2005 Kappa
Bloodspark_: oh saved again lol
foxubu: Someone is jamming your wifi ^_^
THX1342: Привет гопник
Bloodspark_: quality is fine again PogChamp
knilecrack: okay
Caene: Smooth fps now though
kevczy: Dude I bet Starbucks WiFi will work better then this
stathizzzz: Are you on 56k modem? PogChamp
Bloodspark_: except fps
Caene: Check for shady vans outside
Fantasma56: F
zneel_73: you fucked up showing your ip
markovchain21: sony devs are payback time :D
NoLimitFitness: are you connected to teheran again?
THX1342: гопник стрем
Dsplits: @georgehotz you look alot skinnier
mikeyyinspace: get off the phone itll speed up ur internet Kappa
UniversalGeneve: LUL
kodApan: RIP
jotembruv: NotLikeThis
knilecrack: hi agagin
CraftyGaming: Here we go boys
joiput: LUL
naix_1337: 1 Megabit? PunchTrees
Caene: Is this NA internet?
knilecrack: 0
CraftyGaming: squint your eyes and maybe you'll be able to read some of the larger text
mikeyyinspace: PunchTrees
mondeverest: bogaHacker
SpecialAgentSkye: Close Limewire. Sometimes takes a lot of bandwidth Kappa
kodApan: saved
mikeyyinspace: F
CraftyGaming: Actually looks good
markovchain21: F
Chris_XIX: F
Bloodspark_: cant read SeesmGood
Chris_XIX: Lost it again
Bloodspark_: SeemsGood
knilecrack: it' good
markovchain21: good now
mondeverest: bogaGood
spoco: works now
kevczy: Yea
THX1342: cheeki breeki cat
Rlchibi: probably the server you are on
Xavur_: zeeman internet
icanthitthose: what's happening
THX1342: just code an 8bit game
CraftyGaming: refresh if your screen is black
Bloodspark_: it's shitty nevertheless LUL
knilecrack: you can focus search bar with alt d
THX1342: make a roguelike
kevczy: Recommend youtube
Caene: Use your phone for internet. LUL
THX1342: there~s no graphics
knilecrack: it's good now
Caene: Phone hotspot LUL
SpecialAgentSkye: Its fine. Its not bad at all
Dsplits: moving into the game dev industry now?
markovchain21: it is like 100% fine now !!
Harm133: can jailbreak the first iphone but cant properly stream LUL
knilecrack: tes
knilecrack: it's good mann
markovchain21: you need jailbreak..
Xavur_: call your provider and complain
CraftyGaming: Since you went to 1Mb it looks fine man
SpecialAgentSkye: Can break Sony security but cant get good internet LUL
THX1342: it~s good
kevczy: Dude just go to McDonald’s
Bloodspark_: not 100% but okay LUL
Caene: @markovchain21 You will eat those words, just saying.
th3_maj0r: Faq windows
JumpTwiice: 4Head just get a house
kevczy: McDonald’s WiFi looks like to work better
markovchain21: @Caene ?
CraftyGaming: Señor lemon
Caene: @markovchain21 You will see
Lazysloth: u made that headset brah
Bloodspark_: PogChamp John Lemon AR
markovchain21: @Caene not even humor or jokes allowed?
KrakkenTM: @markovchain21 na fantastw spoudazeis/spoudases kati panw se upologistes?
Nougekai: @georgehotz what do you think learning machine learning (python) as a brain surgeon? Worth the try, or is it too much and better make a friend who knows ML/DP?
Bloodspark_: Chat is annoying :)
knilecrack: twitch chat most toxic ever
Bloodspark_: ban them :)
meshuggahsahin: o hey KonCha
THX1342: "work" hobbT
JumpTwiice: @knilecrack chats like this one are the least toxic ones compared to big streamers' chat
knilecrack: it's awesome now
Bloodspark_: It's working now
prakyath_kantharaju: learning is always is good.. But if you are looking for a friend
icanthitthose: what kind of game is he building
fuuqtv: true
KrakkenTM: @georgehotz hows comma.ai going?
fuuqtv: if i have bad internet i dont like the place
Xavur_: 5G is coming soon lol
Caene: I think @markovchain21 is right, it seems stable now. SeemsGood
knilecrack: @JumpTwiice that's what I thought, twitch chat in genral. This is fine
Xavur_: 5G will be good for streaming
eyep1e: building simsAI?
markovchain21: @Caene i am sorry, if i offended you. i am new to this stream
Caene: Huh? I love you
Caene: @markovchain21 <3
stathizzzz: The CIA is watching out for you and reroutes all your traffic to thir servers, hence the bad internet PogChamp
fkndean: BOOOOOOOOOOO
fkndean: hi
Xavur_: unity looks so outdated :/
knilecrack: yeah
THX1342: @georgehotz have you heard of Godot? Open source competitor to unity
gal40: Why are you dealing with post-processing so early on?
Lazysloth: if cia is watching order some pizza
tigopotter: which one is your new computer?
foxubu: So much clicking to get things work ...
meatballsimproved: what's the game going to be about?
Bloodspark_: Raytracing PogChamp
CraftyGaming: See, this tutorial is telling you how to make a scene look great but isnt teaching you major design concepts
KyleUE: i need raytracing on my AR girlfriend.
Bloodspark_: same :)
foxubu: @CraftyGaming true words
Poethick: @KyleUE LUL
markovchain21: maybe it will get better at the end again
gal40: I don't get why you are messing with post processing when you don't have much of a game yet
Bloodspark_: He's following this tutorial :)
Lazysloth: it is because he is on the camera section
osaidaz99: is this going to be uploaded on youtube?
Dsplits: you should make a game from scratch in C
Bloodspark_: PogChamp
Lazysloth: what can go wrong lol
CraftyGaming: get into using delegates and events, coroutines and fun coding stuff
UniversalGeneve: he's going off the grid!
foxubu: @osaidaz99 Search for Comma ai archive. Disclaimer: not his channel.
Lazysloth: autopilot off
asaalgk: you should check out unity machine learning agents toolkit, its fun and easy
Dsplits: btw can't believe that you're on windows
Lazysloth: YOU MADE IT!
knilecrack: why everyone hates windows
JumpTwiice: background makes it seem like you're streaming from heaven
CraftyGaming: Guarantee someone followed this tutorial and it is a game on the google play store Kappa
Zipzipcekirge: fun fact you can enable unity dark mode by changing a branch instruction
Kheri0n: do you have any degree?
bunnydd: use godot engine
CraftyGaming: I frequent r/gamedev and r/unity3d. So many people post their store pages for tutorial games
dMunkei: @Zipzipcekirge what you mean?
dragan2271: hi bro
dragan2271: whats computer specifications
Zipzipcekirge: get a debugger and search for skin symbol. There is a jmp eq instruction if you make it jump not equal it will get into dark mode @dMunkei
Rojaster: he is doing game right now?
dMunkei: @Zipzipcekirge What do you mean by get a debugger?
JumpTwiice: @Rojaster he's just tryna learn unity
Lazysloth: you can just change the hex in the unity editor and it will be dark mode
Rojaster: @JumpTwiice for fun ?
JumpTwiice: @Rojaster possibly for future projects?
CraftyGaming: There is a unity plugin for VS that will allow you to attach it to the unity process for debugging, its fantastic
Chris_XIX: @dragan2271 8th gen i7, 32gb of ram
Nesquik80: @georgehotz you like mac or windows more?
ayman_saleh: Why windows and not linux?
asaalgk: lmao
Panda1Express: LUL
UniversalGeneve: good friend
gal40: When in 2d mode you have to seriously scroll out, because the canvas is huge
Bloodspark_: LUL PogChamp
CraftyGaming: "she" PogChamp
Xavur_: do another speedtest then :)
funwayz: she PogU
lukaakul005: ur crazy
knilecrack: what means pogu
knilecrack: twitch ebonics
fkndean: if you only knew the way
fkndean: of twitch ebonics
mikeyyinspace: why ebonics
mikeyyinspace: twitch isnt black cmonBruh
JumpTwiice: cuz TriHard
Xavur_: CruW
knilecrack: cuz
Bloodspark_: cmonBruh
Dsplits: no it's like that visual studio forces that name convention
mikeyyinspace: he must not know what ebonics means
mikeyyinspace: itd be twitch lingo
youngsachi: TriHard
knilecrack: it's ebonics black ppl lingo?
stathizzzz: Unity's procedural coding style is not your style, you're more generic guy
CraftyGaming: abstraction!
gal40: You accidentally put two instances of the script
CraftyGaming: public variables can be set in the editor, or those marked with [SerializeField]
estilen: 500k in my account by next year
JumpTwiice: @georgehotz favorite language? dont say python
erenesmer: !keyboard
smurfd0: he kinda looks liek Rick from rock and morty ;)
knilecrack: where is sprint?
julien9877: todo: sprinting
julien9877: LUL
CraftyGaming: literally just change one float, LUL
Artbarte: sup
knilecrack: gg
erenesmer: !keyboard
CraftyGaming: You said you wanted to move faster
Darkhunder1: camera
julien9877: no change 1 float to increase walking speed
knilecrack: it's good don't bother man
Bloodspark_: LUL
gal40: Application.quit is ignored while in the editor
RRHDS: going to make a game?
showzennn: is at the end
LoLskiller1: what tutorial do you follow?
JumpTwiice: no
mikeyyinspace: fine for me
knilecrack: no
aathove: no
knilecrack: don't touch
Darkhunder1: no
liquidcomb: fine
nanodanger7: no
UniversalGeneve: it's good
youngsachi: maybe
nestradalink2: good for me
Quidos: VoteNay
aathove: you dude <3
julien9877: do it xqcM
JumpTwiice: PagChomp pvc viewers
julien9877: xqcN ?
showzennn: change turn speed
JumpTwiice: being a pleb FeelsGoodMan
nestradalink2: kfc emotes are the best
knilecrack: if you need g's IP you have it
alluxua: sing a song, please, geohot
tigopotter: which one is your computer?
gal40: After you normalize the movement vector you can set its magnitude
julien9877: put it to 500 PogChamp
JumpTwiice: Input.GetAxis() is between -1 and 1
Vjasal: hello @georgehotz
knilecrack: wooooooooo
julien9877: xqcFast
bubabii: omegaLuL
CraftyGaming: Hacker PogChamp
showzennn: ahahha
showzennn: LUL
andrex_andrex: ehehe
cIvIcbooks: fuckin jon lemon
Bloodspark_: Speedrun hacks
zneel_73: LUL
julien9877: new sonic trailer PogChamp
jacopo_l98: xqcFast
tigopotter: which one is your computer?
knilecrack: gigasonic razor
Lokimjolnir: hello everyone
th3_maj0r: Razer 15 lsxyzOk
jagger_rsw: whoa... george is programming in spreadsheets or sth :)
grizvok: ROFL
gal40: When you edit inspector variables while in play mode they are not saved
Darkhunder1: camera
ArcherCreatlol: hey geohot, ur qira docker file doesnt work, could u update it?
mikeyyinspace: !uptime
Darkhunder1: change camera in stream
JumpTwiice: 4Head
noodlearms_1: hey
ShinzoLK: Did you leave comma ai? If so, why?
gal40: Well I g2g. Have fun learning unity
ArcherCreatlol: what's ur goal in learning unity?
data_day_life: data_day_life gifted a Tier 1 sub to gal40! This is their first Gift Sub in the channel!
Dqyijote: Well I g2g. Have fun learning unity
littlezippy92: I think unreal is easier to learn to use
th3_maj0r: ahahah
codevisionary: have you considered building your own game engine @georgehotz ?
local_root: whaaaaaaaaaaaat? geohot and windows?????
fkndean: first time i seen george on a windows
BIakerTv: why the m_name syntax?
fkndean: KappaRoss
knilecrack: 1st time george seen georgd on windows
local_root: m_ = member variable
th3_maj0r: lol
JumpTwiice: python syntax LUL
fkndean: syntax game
BIakerTv: gotcha thanks
fkndean: If you wanna write good code write it in HolyC Kappa
local_root: @fkndean on templeos of course too
fkndean: oh yeah bby
fkndean: I would pay to see George try that lmfao
caslecasle: caslecasle subscribed with Twitch Prime.
julien9877: xqcPrime
BIakerTv: little hint i learned in college - if you type it all out yourself, it's not plagiarism ;) (jk)
local_root: what's the sudden change or the reason why he's programming a game??
knilecrack: because of AR
alluxua: geohot is always random. No reason
dorkmo: AR
knilecrack: he is making some AR set with big field of view
caslecasle: Am i subscribed
local_root: interesting
dotEXEguy: out causes arguments to be passed by reference
knilecrack: dude wants to be better on every field
smurfd0: https://www.c-sharpcorner.com/article/out-variables-in-c-sharp-7-0/
caslecasle: -
local_root: im just glad it's not java
alluxua: probably he always has passion on tuning hardware
littlezippy92: @local_root geohot is getting into pirating games and making cracks
local_root: @littlezippy92 definitely!
littlezippy92: KappaClaus
julien9877: just use || DansGame
Knarez: that tutorial isn't consistent about its spaces between the if and condition parenthesis REEEEE
codevisionary: every real programmer's goal is to do everything you can possibly do with a computer, and one of those things is developing games
local_root: @Knarez probably because the person who made the tutorial used tabs instead of spaces smh
caslecasle: Mod me ploxerino
codevisionary: tabs > spaces
Knarez: nah it looked like they just forgot it it one of the snippets lol
local_root: tabs that convert into spaces >>>>>
Wansie: why are you doing this?
sharpblade95: cheer1000
th3_maj0r: Probably asking for mod is the worst way to get it
caslecasle: Nah not with him
dorkmo: heyguys1
caslecasle: seen it happen
ef_0ne: because why the fuck not
ef_0ne: stop asking
th3_maj0r: lol
pandatastisch9: what's happening here?
gznn: he having fun whats the problam
codevisionary: things are happening
poopboy7: tabs are overrated smh
codevisionary: nope
codevisionary: tabs are superior
cosmoz_AI: why unity ?
godlessmonkey: Is this your first time with Unity?
codevisionary: @georgehotz build your own game engine and go head to head with Unity
th3_maj0r: Richard in Silicon Valley use tabs and he is a great programmer. Need any other proof?
ef_0ne: PogChamp
sharpblade95: cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1
Caene: PogChamp
Dqyijote: lol
dorkmo: heyguys1
MonsterMannen_: HeyGuys
CraftyGaming: My IDE knows when I press tab, to enter 4 spaces
mikeyyinspace: heyguys1
data_day_life: this is why I hated unity
Lazysloth: change ur camera settings
Lazysloth: its not revealing other stuff
mikeyyinspace: heyguys1
ef_0ne: why not ue4?
mikeyyinspace: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
showzennn: project -> SampleScene?
dorkmo: heyguys1
mikeyyinspace: heyguys1
local_root: what computer did he get?
dorkmo: heyguys1
Bloodspark_: bruh
mikeyyinspace: heyguys1
CAPTN_136: heyguys1
CraftyGaming: double click on anything in your scene
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
data_day_life: bad bot
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
boy_milk: george gimme ur cummies
CraftyGaming: middle click and hold with move the scene around while right click and hold will rotatte your view
data_day_life: quality chat
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
dorkmo: heyguys1
mikeyyinspace: heyguys1
Bloodspark_: HeyGUys 1 Kappa
Bloodspark_: fuuu
Bloodspark_: HeyGuys 1 kappa
mikeyyinspace: heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1
JumpTwiice: Kappa = GreyFace
smurfd0: u have an error in the bottom of the screen...
mikeyyinspace: heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1 heyguys1
pandatastisch9: my ubuntu image stops at booting wtf
knilecrack: asell out
Bloodspark_: 1 bit LUL
julien9877: my chat experience BibleThump
mikeyyinspace: LUL
pandatastisch9: started user manager for uid 121
zneel_73: sellout
local_root: what computer did you get @georgehotz ?
youngsachi: LUL
pandatastisch9: what does that even mean
codevisionary: where's the morality @georgehotz ?
th3_maj0r: lsxyzLS lsxyzLS lsxyzLS lsxyzLS
JumpTwiice: sellout LUL
knilecrack: bitcoin out
CraftyGaming: You can visualize your raycasts through Debug.DrawLine
cankoloz: LUL
Kadyen: why Unity?
Risx: what're you drinking?
Bloodspark_: why not?
smurfd0: UnassignedReference something something error..
Rojaster: we love money too man, give us money cuz we're watching you
aiis: Is this running on a Tesla computer?
Bloodspark_: @aiis yes Kappa
aiis: LUL
codevisionary: no, only linux runs on tesla computer
Rojaster: Oh, I got it, that's why he is on windows.
CoffeeD2: he's like a supervillain "this new invent will get me all the moneys"
Bloodspark_: exactly :)
local_root: it's so weird seeing him coding in an ide instead of vim
codevisionary: removing tesla hardware just to install windows on it would be a disgrace to humanity
JumpTwiice: D:
nestradalink2: VSC > VS change my mind
mikeyyinspace: PogChamp winner stream
smurfd0: game over man
Caene: monkaS
Caene: I got caught monkaS
codevisionary: atom > vsc
CraftyGaming: obby working code Kreygasm
cosmoz_AI: why unity ?
bubabii: i dont understand what is the reason bug?
knilecrack: text editor wars begin
pentaquant: @georgehotz penis
local_root: notepad.exe >>>
ef_0ne: real programmers use pen and paper
ef_0ne: scrubz
codevisionary: why does that create a link?
Caene: pen and paper   A4 scanner >>
Giammanaco: Why he has bought a Windows Computer?
knilecrack: cause it's cheap
knilecrack: with 32gb of ram
local_root: @knilecrack what kind of computer did he get?
CraftyGaming: Unity has a great editor language used to streamline certain repeated actions. Just another layer to learn
knilecrack: razor something
local_root: razer blade?
knilecrack: razer* yeah
pentaquant: Yes
local_root: nice
pentaquant: I just got one and fucking love it
local_root: @pentaquant enjoy it :]
codevisionary: step one: buy razer laptop, step two: overwrite windows with all zeroes, step there: install linux
codevisionary: step four: be a good person
Sydowh: Hello
CraftyGaming: Hello @Sydowh
pentaquant: Well, I've partitioned for linux
pentaquant: but fuck a wipe of windows for linux. I still need to play roblox
ef_0ne: just use proton
codevisionary: cringe
CraftyGaming: Quaternions inc
Sydowh: Good to see you are still learning Kappa
non_pc_character: Heyo! first time watching George
non_pc_character: whats cracking
th3_maj0r: ctrl c ctrl v programming
codevisionary: isn't that what people go to college for? @th3_maj0r
MichaelMcMillan: windows, come on bro?
th3_maj0r: @codevisionary exactly
dragan2271: hi
xxtakki: is there any particular reason why you are learning unity ?
th3_maj0r: He wants to build an AR
local_root: @xxtakki im guessing because of the popularity
codevisionary: @xxtakki
codevisionary: https://clips.twitch.tv/AbrasiveBashfulGrouseNononoCat
codevisionary: this is why
xxtakki: tyy
Pryetranka: george hotz x reason, choose one
dragan2271: @
NonTrivial778: I try to learn unity and I got bored
Kheri0n: @xxtakki i think he wants to become god by creating his ai world in unity
dragan2271: @knilevcrack
CraftyGaming: You know George, I've been hearing a lot of good things about Unity in Linux with these new 2019 builds. Anyone here know more about it?
local_root: @NonTrivial778 probably because the engine does too much for you
Smokinate: george how often are you in san jose bro im from san jo @georgehotz
NonTrivial778: LUL
pandatastisch9: can u program on dmt next time
ibimsmarry: What are your intentions behind learning unity?
NonTrivial778: @georgehotz you made a raw bitcoin transaction
Lazysloth: he has ar headset
CraftyGaming: I do tasks like these in batches between coding
NonTrivial778: yeah
non_pc_character: If george reads this message we are living in a confirmed simulation Kappa
CraftyGaming: click the topmost waypoint, hold shift, then click the bottommost one
Smokinate: so who is george talking to if he never reads chat
vickson12: WHAT IS HE DOING?
Nevermorewinz: @georgehotz is commai still alive?
CraftyGaming: You can change each axis independantly with multiple selection
stathizzzz: Raw bitcoin transaction > game dev, PS jailbreak >>> game dev
non_pc_character: @codevisionary monkaS
metalneck69: Unity DansGame
CraftyGaming: You plebs don't see the potential Unity has in the AR/VR field. John Lemon doesn't mean shit, he is a tool for learning more advanced systems
stathizzzz: I think geo wants to make a Unity world to simulate autonomous car driving with insane ML algos PogChamp
Lazysloth: nope
CraftyGaming: Link your github @codevisionary
th3_maj0r: o
Lazysloth: get rekt
stathizzzz: RE KT
Caene: ^
th3_maj0r: aggressive twitchchat
pandatastisch9: toxic
Lazysloth: unreal engine is ugly, c   is painful
metalneck69: “Link ur github” monkaS
th3_maj0r: quite yeah lol
non_pc_character: no sound? DansGame
vtmr: LUL
funwayz: WOW
sharpblade95: you're not getting hired with no sound
Caene: Sounds is overrated anyway 🔇
nestradalink2: the game for deaf people
Kheri0n: make a sounds with your mouth LUL
pandatastisch9: that's the job of the sound programer
Lazysloth: he turned it off because the fireplace was loud
finessin95: I play an mmorpg from 1997, doesn't have sound and it still has an active player base
dorkmo: hot take: soundtracks underrated
stathizzzz: John Lemon is deaf, hence the deaf game
KeyboardOreos: why Unity WutFace
KeyboardOreos: I'm a 3D Artist Kappa
vickson12: @finessin95 Are you talking about old school runescape?
KeyboardOreos: Unity is nice
Caene: @finessin95 Tibia LUL
matt4kr: dude you should check out Unity ML-Agents, it is crazy shit
dorkmo: heyguys1
finessin95: @vickson12 No, what Caene said, Runescape came in like 2002 or something
KeyboardOreos: That room is so bright! Holy shit
Caene: Tibia, super nostalgic stuff. :)
non_pc_character: Pog
Rlchibi: we a twitch gamer now??
ArcherCreatlol: POGGERS
osaidaz99: big fan from saudi arabia :))
JumpTwiice: ANELE ?
osaidaz99: ?
stathizzzz: John Lemon for President monkaS
finessin95: @Caene Probably the game I've had the most fun in
th3_maj0r: wow you should change the topic from Basic Programming to Hardcore gaming
Caene: @finessin95 Yeah, good memories
JumpTwiice: D 💿 C
non_pc_character: Can we preorder this?
CraftyGaming: Casual playthrough
th3_maj0r: Progamer
non_pc_character: 60 dollars and DLC included?
Lazysloth: one eye ghosts
GeorgeHopkins: cheer1 cheer1
mikeyyinspace: ill take this and the season pass
Lazysloth: that ghost is camping
darkwon_: needs sound
KeyboardOreos: PogChamp
finessin95: We found a bug boys
CraftyGaming: Need to up that turn speed in navmesh agents
Caene: John Lemons looks so depressed FeelsBadMan
Muratandjose: is there a point where his eyebrows arent just sad?
slimyoof: stealth god
th3_maj0r: Anyway this is better than Fortine
stathizzzz: JOhn Lemon has shited his pants, thats why he walks that way PogChamp
Lazysloth: lol ghost stuck
smurfd0: ruh roh, u got ghosted :D
th3_maj0r: Fortnite*
routerbomber: Which is your new computer?
Lazysloth: this is new comp
prakyath_kantharaju: razer
aerotone: his trajectory is prolly fucked up, u might have moved him so he gets stuck
Caene: The ghost can't reach the set point
fuuqtv: delete him
NotSnuffy: !specs
lightofhel1: go Jonny, go!
KeyboardOreos: Look at your instagram, so you're wealthy now ?
KeyboardOreos: looked*
ArcherCreatlol: make fortnite PogChamp
vtmr: monkaS
Caene: LUL
aerotone: speedrunning
the_best_russian_bear: 1 step - write game
Caene: Delete ghosts, beat the game, put ghosts back in again - ship it.
cIvIcbooks: this is front page twitch quality
the_best_russian_bear: 2 step - finish game
the_best_russian_bear: 4Head
aerotone: ghosts have collision you know
Lazysloth: i would just move him
undefined_behavi0r: what's that game?
cankoloz: Who is this guy PogChamp
th3_maj0r: Strategy game guys. 2k19 Starcraft
KeyboardOreos: NotLikeThis
drag0s92:  5 speed
JumpTwiice: speedrun PogChamp
codevisionary: this guy is geohot @cankoloz
lightofhel1: speedrun PogChamp
codevisionary: google him
Caene: Yeah, the collision is making it so that ghosts can't reach the set points. AI doesn't even know it's stuck. LUL
JumpTwiice: @codevisionary u didnt get the joke LUL
stathizzzz: Issue a run command
Caene: Damn ghosts!
cankoloz: @JumpTwiice LUL
th3_maj0r: Hack the game! Yeah!
codevisionary: what joke
codevisionary: ?
JumpTwiice: PepeLaugh
dorkmo: no clip
b_______________________b: ALL WRONG :(
Zepcon7: Why on windows?
cankoloz: He doesn't know PepeLaugh
siwySF: he lacks critical information PepeLaugh
JumpTwiice: han ved inte PepeLaugh
codevisionary: ^ toxic
b_______________________b: clint2
b_______________________b: damn it
julien9877: he is unaware PepeLaugh
Nameless770: Waypoints were added to group and then groups global position was changed.
Taddell: From making self driving cars to creating childrens games in unity?
drag0s92: :))
codevisionary: @Taddell exactly
codevisionary: @Taddell we're joking though, right?
codevisionary: @Taddell toxicity gets you banned
kevin99gh: hey @georgehotz RalpherZ
th3_maj0r: wait, toxic again?
JumpTwiice: LUL i dont know if this guy is a troll or if he's serious
JumpTwiice: @codevisionary
Taddell: Joke a joke...
th3_maj0r: No, I'm joking, I don't know why he banned u, probably he didn't understand
JanTSV: Heyy, whus Up?
NonTrivial778: @Taddell bro take it easy with george
CraftyGaming: Just came back, each of those ghosts are children of your "Enemies" object. Make sure enemies is at 0,0,0
kevin99gh: i cant wait for VR to be more popular...i wanna live in vr BibleThump
youngTrick: nice new crib
CraftyGaming: I have to go play softball
dorkmo: when vr doesnt make me feel like puking
youngTrick: white on white on white
kevin99gh: yay nom nom lunch CorgiDerp
th3_maj0r: ahahaha yeash so easy
drag0s92: 'eazyest game ever'
smurfd0: "who u gonna call?" ;)
osaidaz99: happy Ramadan
codevisionary: have you seen Ready Player One @kevin99gh ?
aerotone: NotLikeThis
drag0s92: that one is in tub ?
Ustunner: What’s good George
kevin99gh: @dorkmo they are fixing that...newer vr headset should be fine for u i think
kevin99gh: @codevisionary no
CoffeeD2: ready player one is pretty bad
codevisionary: ikr
cankoloz: @CoffeeD2 I think it's average
codevisionary: at least we agree on something
kevin99gh: i cant wait to sit in a giant forest near a river with rtx on in vr BibleThump
cIvIcbooks: OOOO
Caene: PogChamp
Lazysloth: YOU MADE IT!
kevin99gh: prooo
cankoloz: PogChamp
youngsachi: PogChamp
drag0s92: circR circR circCosy circAmazing circAmazing circAmazing circAmazing circAmazing circAmazing
UniversalGeneve: LUL twitchies
Caene: Great journey!
siwySF: sound was 10 hours
dorkmo: heyguys100
JanTSV: when are u joining dem?
JanTSV: tsm
Jewishrambo: BibleThump ending?
Bloodspark_: @kevin99gh same about vr BibleTump
knilecrack: nice
Dsplits: you should do a music production stream
codevisionary: LUNCH @georgehotz
drag0s92: circLewd
Johnnymamen: l a u n c h
Bloodspark_: ANYWAYS PepeHands ?
th3_maj0r: TSM is a professional gaming team
Caene: Lunch and rant PogChamp
Ustunner: Go smoke
stathizzzz: Now lets break Android kernel PogChamp
markovchain21: use AI to make beats/music ?=
vtmr: sound engineer PogChamp
Caene: Sound is overrated 🔇
drag0s92: what laptop is is ?
kevin99gh: george needs to be in the vr/ ar industry
th3_maj0r: Razor 15 2k19
drag0s92: it is*
purpbroccoli: How's the keyboard?
Dsplits: what are you working on now?
drag0s92: thx
cIvIcbooks: are you going to use the headset camera to slam the user environ?
zneel_73: no more python tmux coding?
Caene: How is the keyboard on the Blade 15? They look sleek and the hardware seems fine for a laptop
kevin99gh: mod me?
th3_maj0r: Now u can swipe up on instagram right?
pikkuuu: I just don't like doing dev stuff on Windows for some reason
Ustunner: You a millionaire yet
th3_maj0r: You can link the stream on your stories
sharpblade95: bye
JumpTwiice: PogChamp
UniversalGeneve: bone induction headsets
kevin99gh: omg im happy
kevin99gh: geo headset
dorkmo: showlove1000
kevin99gh: hype
pikkuuu: LUL
zneel_73: LUL
Caene: LUL
vtmr: LUL
youngsachi: LUL
showzennn: LUL
kanogger: LUL
JanTSV: LUL
kevin99gh: we need ar using the power of the cloud
vtmr: 4Head
salamifred: LuL
zneel_73: LUL
kevin99gh: ez money
funwayz: MOST OF LUL
julien9877: how dare they!
tacorising3: LOL
yungosk: LUL
pikkuuu: just keep the money 4Head
julien9877: pay em in equity xqcM
codevisionary: I would work for you for free @georgehotz
codevisionary: hire me
drag0s92: i do love you bro, no homo! how can i make my money ur money ?
Lazysloth: just don't pay em duh
Dsplits: how do you expect to grow a company without employees?
BookRaider: is comma ai gone? what?
MalhadiJr: why the font rendering look awful ?
showzennn: you making headsets? really? what a waste lol
simon8162: You get paid in exposure
dorkmo: psy them in AR headsets
th3_maj0r: You can't make more money with hacking? lol
dicapriyo: so it all boils down to money 🤔
codevisionary: I'll be your employee for free @georgehotz
pikkuuu: ez money PogChamp
cankoloz: @georgehotz show the headset :)
JanTSV: high voice = real shit
JanTSV: LUL
kevin99gh: when do u see ar replace phones
dicapriyo: Kappa
vtmr: Kappa
cankoloz: Kappa
youngsachi: Kappa
nestradalink2: if
put_your_money_on_me: CoolStoryBob
dicapriyo: PogChamp
julien9877: LUL
aiis: Please give us 60 pixels per degree headsets @georgehotz
pikkuuu: CoolStoryBob
drag0s92: circClap circClap circClap circPaid circPaid circPaid circPaid circPaid circPaid
Lazysloth: magic leap is shit
showzennn: making headsets is about moving the world forward and not money Kappa
dorkmo: 2 burgedubais
th3_maj0r: I think this AR is too small btw, anyone else think the same?
codevisionary: the problem is that they have a professional website, and you don't @georgehotz (hire me for free)
julien9877: wtf
MDSZilla: 0
Dsplits: lol barely
aerotone: 2000
Lazysloth: they are giving them away
siwySF: more than 2
youngsachi: 1
Dsplits: is magic leap a public company?
julien9877: JUST 790M LUL
Dsplits: @georgehotz the point is taking the company public.. that's when youll get the return
Dqyijote: u only talk about money bro
MDSZilla: So they raise money but dont deliver?
UniversalGeneve: LUL
UniversalGeneve: RIP elizabeth
Zasuslive: George I see u making awesome software for this AR headset/platform.. but ergonomics, build quality, mass production etc don’t seem like your thing
funwayz: comma ai 8.1m
Zasuslive: Maybe that shit comes later
zneel_73: do you recommend for niche startup to raise money ?
emilwallin: Mästare
UniversalGeneve: it's not that she didn't deliver, she FAKED everything, which is worse
Dsplits: theranos was the biggest scam
MDSZilla: That's a total scam then wow.
JimsGlock: !playlist
pandatastisch9: i wish i would be smart
th3_maj0r: Commaai 8 milions? not a lot
pandatastisch9: will nsi-189 fix my brain?
aerotone: 300 comma ai's PogChamp
aerotone: I M A G I N E
MDSZilla: What ever you spend your investment is to grow if you dont then it dies true.
P0LY: LUL
JanTSV: does that mean 300 geohotzs??
lpdon2: why did he dump the macbook pro?
zneel_73: do you think that there is still place for new social network startups?
dicapriyo: i thought elon musk bootstraped tesla once Kappa
kevin99gh: i hope nintendo next console will be vr only followed by playstation 6 vr RalpherZ
cIvIcbooks: those valuations depend on litigating the fuck out of their ip not producing value
youngsachi: LUL
Dsplits: why a headset company?
funwayz: scam is everywhere
JanTSV: @dsplits why Not?
jamesred2313: Big difference between we have this and we Don't have this
Zasuslive: Headsets kinda make sense as the next step after phones
Dsplits: you should start a company that builds tools for the financial industry
kevin99gh: im a communist RalpherZ
stathizzzz: HOw much money did Elon offer you? Why reject him?
codevisionary: they had separate visions @stathizzzz
Zasuslive: Bro now your talking about other stuff pls talk about the simulation briefly an update since your talk
cankoloz: Iphone DansGame
kevin99gh: @zasuslive respect mr hots BibleThump
drag0s92: romania - the same thing
Sun__G: software communism is good for security though LUL
siwySF: jonh lemon dev became communist? LUL
emilwallin: Overpriced
stathizzzz: Id be happy with an alternating vision provided the money is good
youngsachi: LUL
pikkuuu: that's what a communist would say Kappa
knilecrack: communisam forces you to share
enzozordan: how long have you been working on this? (vr)
Sun__G: free software is the most successful implementation of communism Keepo
BiszkopTT: what do you think about slavoj zizek? Kappa
JanTSV: @knilecrack nah
knilecrack: yeah
Dsplits: so you're not going to raise money for your new company?
kevin99gh: communism= vr chat for ne
julien9877: I AM not A COMMUNIST
julien9877: Kappa
kevin99gh: me
codevisionary: most people don't even know what communism means
ssssimba: all about illusion
aerotone: how can i short this shit?
stathizzzz: Dont talk about communism, CIA is watching...
o_sagga: thoughts on bitcoin?
knilecrack: but there is nothing wrong with the ideology it's the people
funwayz: i was born in USSR LUL
aerotone: how can i short magic leap
smurfd0: isnt it always like that when new tech appears.. people pretend to have stuff for sale...
Dsplits: they are not public
aerotone: ill just short the current market then LUL
aerotone: tech bubble 2
aiis: which doesn't work if tech in general overachieves...like he said
Zasuslive: @kevin99gh was I being disrespectful?
hardtarget4: lol
kevin99gh: im joking @zasuslive lol
stathizzzz: Uber going down due to automation
Zasuslive: My bad lol
Dsplits: uber is going bankrupt in the next few years
julien9877: PepeLaugh oh no no no
JumpTwiice: why did it plump
austin_1_2: I think Uber’s Ipo is at a better price thang Lyft
vtmr: BOGGED
aerotone: have u seen beyond burger IPO price? holy shit what a short steal LOL
JumpTwiice: poomp eet
Dsplits: @georgehotz start a hedge fund
julien9877: 📉
Dsplits: no no please tell us
JumpTwiice: PepeLaugh 👉 📉
julien9877: finance is just a funnel scheme
Frogtech_: kaceyThink
pikkuuu: hedge funds etc. are not about creating value, if somebody actually believes that they're crazy, they're about making money for the the people running the fund naturally
undefined_behavi0r: traditionally the "value" of finance is providing liquidity: allocating capital where it is most needed. (However I agree that modern finance has strayed far from the ideal)
Zasuslive: Entropy :o
JanTSV: Change title to: learning economy on my new computer
pikkuuu: dab PogChamp
aerotone: hedge funds create jobs tho Kappa
tkslots: @georgehotz would you prefer freelancing to salary career?
JumpTwiice: KKona
stathizzzz: That applies to software too
julien9877: PogChamp
kevin99gh: @georgehotz should debate destiny RalpherZ
pikkuuu: KKona wealth you say
strippersncoke: would you see AWS as an example of this? @georgehotz
JumpTwiice: PogChamp
Dany4k: 5Head
stathizzzz: Destiny is a crook, geo is the real thing
hardtarget4: hardtarget4 subscribed with Twitch Prime. They've subscribed for 2 months!
ssssimba: what are your thoughts about google keynote
P0LY: kurzweil 2029 monkaS
mikeyyinspace: Oil? KKona
MDSZilla: So a business that allows more buisness to depend on that buisness to run
Kustex: just joined, are you talking about the coming singularity???
Dsplits: Would you ever work for a company again?
the_middle: what about AR? Did u finish lemon?
eyep1e: budge phones before headsets
Kustex: PogChamp
cankoloz: Why do you thing google is gross
zneel_73: can u recommend good books to read? related to business
eyep1e: budget
cankoloz: think*
o_sagga: why?
stathizzzz: Amazon is the new hype!!
o_sagga: which big company you recommend? Microsoft?
lefg7: where do they A players work nowadays ?
aerotone: @georgehotz is it time to short the tech bubble 2?
P0LY: a/b/c? what does it mean
Blizzie: what do you think of the new microsoft terminal ?
meridiansis: ceilingboob
JanTSV: YouTube is buggy af
Caene: @P0LY Skill grade.
deadpool_reynolds: @P0LY good/normal/retard
MDSZilla: Amazon still isnt in my country so it provides no value to me LUL
kevin99gh: i want a vr headset with 8k per eyes using 2 hdmi 2.1 cables n 2 pcs MrDestructoid
Dsplits: But amazon has a lot more b and c players than google
littlebighead82: @georgehotz what are things that you consider a scam that society does not
KAZERKE: LIVE moon2POGGYWOGGY
o_sagga: @MDSZilla AWS
aerotone: amazon is in every country, prime on the other hand
MDSZilla: Not in mine
Dsplits: But ads provide value to company
Caene: So true LUL
aerotone: where do you live? iraq lol?
hubabuba1243: I love amazon
th3_maj0r: But amazon uses his warehouse workers as slaves
MDSZilla: Somewhere on planet earth Kappa
escapd: doenst google provide value to you?
Caene: Microsoft is smart. They set a low bar, so that any minor improvement is hype.
o_sagga: @MDSZilla you're benefiting from AWS, doesn't have to be in your country
aiis: not real 8k
Caene: LUL
thirteenn: wouldnt ads probide value to you if they're targeted correctly?
hubabuba1243: I buy stuff on amazon all the time
Sun__G: @georgehotz thoughts on social purpose as a company form? (like purism)
MDSZilla: @o_sagga I guess.
o_sagga: @MDSZilla Also Twitch :D
Dsplits: google provides value with android
ssssimba: Do you think google could ever be controlled by any rules in the future, when AI become big enough to be scary?
tkslots: @georgehotz will you create the first 4d environment? :D
Sun__G: why do you think its hypocrisy?
MDSZilla: @o_sagga Oh yes ofc :)
minmaxy: as an amazon employee, i'm not sure about the assessment, google still has the top talent afaik
Kustex: how many % of your worth is in bitcoin?
smurfd0: .. or googles slave ;)
KAZERKE: LUL
dunehazard: LUL
youngsachi: LUL
MDSZilla: Loads of videos about people quitting google on youtube itself LUL
Alpasfly: wait, are you using windows??
stathizzzz: Android has led mobile industry a decade back, due to bad implementation decisions and adoptions
Jakobo06: im guessing you dont like fb too :p
Blizzie: dont be evil OMEGALUL
notpikrua: Probably Netflix is #1
kevin99gh: cant believe oculus quest require a phone just for initial setup wtf
KAZERKE: quitting Google is profitable because of the 1M view YouTube video you can make out of it LUL
stathizzzz: Kotlin is much better implementation wise and platform independent wise
Dsplits: so facebook definitely provides no value
deR_Ed: clean coal, clean oil
Dimendz: A players are doing their own thing for the most part
cIvIcbooks: big companies with shittons of cash demonstrate the lack of ideas to reinvest their capital
zneel_73: netflix only recruit seniors
JumpTwiice: HeyGuys
drope77: byee
austin_1_2: Only reason why Facebook is still a thing is Instagram
drope77: love u
JanTSV: bye
rushd0wn23: thank you!
o_sagga: byeee :( love u
zneel_73: bb
kevin99gh: bye we love u
dicapriyo: bye
breadobtainer: tata
Dsplits: later
Caene: Good stream @georgehotz!
KAZERKE: I just arrived moon2PH
Alpasfly: besides netflix doesn't really do that much in terms of adding features
deadpool_reynolds: C You
tanoshiizo: hediHi bye
UneekPlayer: Bye
Sun__G: Kappa /
cIvIcbooks: <3
tacorising3: thanks geo
stathizzzz: BB
BiszkopTT: later my guy
Caene: Bye bye <3
emilwallin: Bye
o_sagga: BB
baxteriia: byee
slimyoof: take care george KonCha
BiszkopTT: <3
Zasuslive: Talk simulation
o_sagga: <3
qlo_sca: budiHI
Zasuslive: Pls
tanoshiizo: bye char KonCha
tanoshiizo: chat*
treestompztv: <3
mikeyyinspace: @austin_1_2 do you realize what you just said?
Raritetus: i definitely need more
 
all those there was what I wanted to do
hacker ring it's one of those pretty
Saturday gang oh good I got banned once
again whoo all right No
evidence of that worked
was the programming challenge to get
higher
and this is broken
yeah I'm sorry the ban was too crappy it
was a triple bite
let's go
thank you for subscribing ok
why is caching used to increase your you
performance thank you for subscribing
why do I have internet something
I know
let's try let's try plugging in the wire
nevermind no wires Internet no it's not
it's mine oh well yeah that's broken
a surge wedgie stillness broken today
too slow
I don't know why it's broken let me well
we don't hack things anymore
you're tired
oh so slow let me see if I get here
look what we got we got a wire I know I
know on the fringe being dropped we've
wired now maybe wire will fix
yeah I need a slop okay that looks okay
should be there
let's leave all this crap I don't even
know what it all does
okay
[Music]
oh here a Belkin let's try that one well
there's a USB 2.0 Ethernet adapter it'll
have your less bound
can harm our app system I know I used to
do that to fix my 4chan all the time but
I think it works on Macs
it's not refresh
it's when a USB like broken
okay no those look like the problem here
real tech semiconductor cork so I'll
show up is network and deleted most to
the Hat
no network
is connected but your computer does not
have an IP address
that's it
it's not better
all right we're on wired now let's go Oh
get off her some top tech companies
let's play this game it makes the first
read fat no it make a second and
subsequent reads faster you'll need an
email to save my progress haircut man at
Mill inator calm
what haircut man I'm keeping this a
secret
oh man we've got a phone number 201 nine
eight seven six three three three
position non-engineering oh no
internship full-time engineering how
good eight years full-time I'm a green
card holder within a week never the Bay
Area assure the Bay Area all right
generalist engineering pledge I promise
to answer myself without help from
anyone guys you can hear me okay are we
good are we too laggy should we lower
the bandwidth I'll supply retrieves did
from a table that be select they asked
me this question already maintain the
users logged in states cookies they're
illegal in Europe fill in the missing
line of code if num is greater than max
no max not equals num select the answer
y equals Baz X what is the value of Z
what do you have bar and I'm going to do
have foo to be bar select the line of
code that function that calls this
method on an object you have to push
result array push value element can be
used to obtain the elements of a binary
search tree in sorted order this is
garbage who's heard of any of these
algorithms is this a trick question
function returns index of first matching
element in array
returned
kind of language is this is this like
Ruby return I if array element equals
element sure suppose you're designing a
distributed worker library and would
like to be able to queue jobs what is a
good method of making the code work well
the best way is to write three versions
of the library global function
referential transparency so what just
looks the most correct
and coding is complete you'd like to
update the UI or spinlock so we love
spin locks
sure this is bored I'm bored
okay so Larry gets printed first when
foo is run and then Moe will be printed
and then curly will be printed oh sorry
and I got a op tes this is boring I'm
bored
what should we do let's do something
we're not here to answer that that was
boring
yeah Lao remember the password for
haircut man absolutely
yeah sorry we'll make a bigger no I
don't want to twitch slam I want you
something new can I allow people to talk
on my twitch if you're a subscriber that
kind of be nice wait am I still laggy
this is nevermind I'm done
streaming today this is garbage
someone needs to fix the internet in
this house
know this you have people I was gonna
I'd do it for Pico CT I will see if he
goes ooh Kiev I think they'll be mad at
me I'm friends with these guys I don't
wanna do their things on a live stream
this is
well my friends are just being dropped
periscope to know okay okay okay okay
this is all right
I'm out this is this I gotta get better
internet give me money I'll buy better
Internet
okay okay okay okay okay
I work a day a day a day all right I
gotta get my let me get my charger uh
oh yo I got toothpaste I finally found
like the last Walgreens that didn't
close in San Francisco dude the city's a
fucking shithole man
look I'm sure there's nice places I'm
sure there's nice places but by the
Twitter office finally I booked a decent
hotel tonight you know we're living we
live in civilized and we're gonna do a
stream for all the people who support me
on Twitch
I'm here for you guys
don't think I've forgotten you know
twitchies uh just because I'm a you know
a superstar on Twitter now
uh yeah man you know when you can
all right uh like so I'm my I got my
mobile set up so I don't really know how
I'm gonna do this
let's minimize this OBS and now we're
gonna get the chat up here on my phone
live
uh hi
hi okay cool
uh I'm gonna pause that and we'll keep
the chat up here yo yo yo all right so
tonight we're going to be finagling a
fanatra
uh check out my shirt it says uh
season's tweetings
well we found the uh we found the
Twitter merch guys we found the Twitter
merch
um
so okay there's finagle and there's
finatra and you know
I kind of know what these things are but
I think finatra sits on top of finagle
uh
so Twitter open sourced all this stuff
there's Scala Frameworks hang on I gotta
I gotta make sure my father doesn't go
to sleep
oh how do I do that
sleep
you know what I should really do I
should get my iPad out and do second
screen on that
that's what I should really do
now you non-subscribers are going to be
muted I look I mean we got a low quality
stream here tonight I'm sitting in a
hotel chair it's decently comfortable
okay
finatra bills on Twitter server and uses
finagle so let's get started you have to
add a dependency so do we have SVT I
think we might oh we don't have SBT okay
how do I install SBT
get SVT perfect
Mac Oh I can use SDK man what is SDK man
can everyone see the screen okay
uh no no
Shrek on VHS you are just banned
congratulations bam
wow that was pretty brutal we had to
start our night with a band guys
um
I'm gonna stay our in a hotel till we
finish with Twitter no no no no we're
gonna we're gonna live in an apartment
this is just where I am tonight
I wanted some civilization
to understand what I meant if you uh
were in this city
okay
um Brew install SBT let's go
some SF culture
yeah culture culture
I don't know look I'm so happy I left
the city it's it's just it's stressful
to be here
um
how do my phone not go to sleep
wake
tap to wake raised awake
I search for sleep while these settings
are hard to use
um
good we're waiting for spt to compile to
uh spt who's that so
wait
I literally don't know how to make the
phone stay awake
uh that's right there's no free speech
in my uh oh this is going to take
forever to download
uh yeah no I'm an intern guys I'm an
intern
uh so I mean this is no secret Twitter
is coded in Scala uh you all saw my uh
lacking Scala skills
okay
so let's understand what these things
are it's an extensible RPC system
let's see if we can get a fanatra
talking to another finatra
um and that would be pretty cool
and then we'd be making good progress
oh go to settings display brightness
auto lock thank you it's called auto
lock great that's what I wasn't thinking
of lock
auto lock perfect auto lock never thank
you thank you zedekio you are the reason
that we're not muting subscribers right
now
everyone can talk because of you
um okay let's make sure we're still
look okay
we got green down here see I like having
my other screen over here I really don't
got my streaming set up here
um if you guys were with me when I when
I lived in New York
we had similar quality streams so that's
what we have right now
um
we're done with the hat we don't need
the hat right now we're good let's just
let's just
people can go without the Hat yeah no I
I wanted to be like hardcore for Twitter
so
shave my head
um
I went to a barber shop this year
list of Twitter bugs oh this is awesome
also I want to really like everyone who
contributed to my stuff on Twitter uh
you know like thanks for helping out
like
you know I'd love to just see these
these
one of my big things in life is like I
don't like that there's like a divide
between like consumers and companies
right I kind of think it should be like
a spectrum
uh and you know I would love to see like
Twitter and something you know not me
obviously someone like officially a
Twitter you like at them with like a set
of improvements and they're like hey you
know we're working on this this is going
to be de-prioritized this is high
priority we expect this to come out in
three months
uh you know I just think that'd be
really cool to interact with companies
like that instead of in like uh like PR
kind of way
um I'm getting paid two thousand dollars
a week so not enough to afford to stay
at this hotel
a lot of companies with the docs on
GitHub yay I mean you know we really try
to do that at comma with with our open
pilot GitHub
you can go to
sorry we're waiting for SVT to install
when I installed this last time okay got
it we have SBT now
um you can like file issues on open
pilot here and we talk about them
oh did I write a bug that was my code
um yeah I split log or D used to also
include the encoders I split into
encoder d
thank you for gifting Subs huckle bite
um do I want to work there full time
[Music]
oh let's let let's I'm I'm happy I have
an internship
I also find all the hate really weird I
find all the like the weird like you
know the news like I news bright like
you know dude Twitter's cooler than the
news right
uh
how I'm a pretty normal intern I I told
you guys what I'm working on I'm working
on liked by for search
um so we can search likes
uh I I is some great teamwork getting
rid of the pop-up so now when you go to
Twitter
um you know when you go to Twitter
search and if we do a search for
something like
oh no the internet's slow here there was
like a way to pay for premium internet I
probably should have done it I hate when
the hotels do this
it really why is this slow
Twitter interested yeah I didn't get any
housing yo where's my housing
um so now you can use Twitter without
getting you see so silliest pop-up this
pop-up still exists but you can click
not now and it won't come back
um but the the pop-up that you can't
bypass is is gone uh for 99 of people so
I'm very happy about that
okay we have SBT running great started
SBT server and we're in the RPC
directory okay
uh do I type that no you literally you
guys don't understand I literally don't
know how to use any of this tooling
IG with spt
not a valid key okay
an old project and Target are
let's look up like SBT for idiots
similarly
okay so you guys know what an HTTP
server is it's a HTTP server uh Thrift
is Thrift was also used to Facebook
um Thrift is not thrift stores but uh
Thrift like RPC it's it's a
serialization format I think it also
includes uh RPC libraries right so you
know Elon talks about the microservices
of Twitter and what a microservice is is
um something where
you know it responds to a bunch of rpcs
so you know this is this is Twitter's
framework for doing that and this is all
open source none of this this is my
personal laptop none of this is any is
any Twitter secrets so before in before
George's leaking Twitter Secrets uh this
is all very public stuff okay
Okay so
SBT we do it like that let's see SBT
tutorial you guys like I'm telling you I
know nothing about this stuff
SBT by example all right
start SBT shell
why Thrift over protobufs because this
isn't Google
um I don't really know actually so this
was Facebook used this all back in the
day too
uh
supports a lot of different languages
but I guess protobufs do too okay so I
think maybe what we should do is we
should write a server in in finagle and
then we should talk from python so your
so it's just not like copying and
pasting stuff and it's probably not that
um
see what I mean
okay we can run compile
okay cool
let's take a look at the files here
generated by SBT
okay now this looks like anything
is SBT let's start there SBT is a builds
tool for Scala Java and more then why
does it have a rebel
getting started with SBJ uses a small
number of Concepts it's highly
recommended to read the getting started
guide okay we already installed it we
installed it on Mac osgrade SBT by
example okay
uh start the shell we can exit the shell
we can compile a project okay what if I
click compile okay well I don't think
that actually did anything creating a
source file okay
then create Hello dot Scala in these set
of nested directories
Maine oh sorry that's the one part of
the screen you can't see uh let me think
about how we want to do this and you can
see it fine I'll just shrink me a little
more
okay
Source main Scala example
then create Hello dot Scala
so my Scholar's been improving slightly
um
by the way and this is this is a
challenge this is an absolute challenge
to anyone uh you know who who all the
haters out there right you know we don't
talk about the haters too much we're
gonna we can do this challenge the
haters bro
if you want to challenge me
come live stream
let's go and you'll do this only if
you're famous right I'm not gonna like
you know like why 500 followers and I
want to live stream if you have like 50k
followers and you want to challenge me
to a coding coding duel it'll be like
Dueling Pianos I think we could set it
up I think it would be a whole lot of
fun
um
you're so shocked and let me see but
here's the thing about the haters they
don't really hate me they don't have any
idea who I am they hate Elon and think
for some reason I'm look guys I'll tell
you the truth I literally I had a
two-minute conversation with Elon he
told me make search great I'm like
okay uh what do you mean by that it
sucks make it great okay
uh you know like I'll I'll do my best
like and that's
look
you know Mr Peanut Butter from BoJack
Horseman
Mr Peanut Butter just shows up and
stumbles around and says yes to things
and he ends up in places so you know I
want to take some inspiration from Mr
Peanut Butter
um people literally got mad that you
could just ask for help no I mean people
think well that's the other thing too
like I got another like George like why
are you an intern you know you think a
33 year old man would be something more
than an intern who the fuck cares man
what I'm trying to like I'm trying to
like move up in some career ladder oh
you think he would at least be a PM by
now oh okay
uh so you know you know that's that's my
uh that's my that's my quick response to
haters and we're gonna we're gonna focus
on the code look we just wrote Scala
says print Ln
uh hello and oh well we didn't put the
auto compiler on but we can do that with
Dash compile I think and then it'll
automatically recompile
okay well
oh it's a it's a it's a twilda it's not
a it's a twiddle it's not it's not a
dash
of
no no I'm a Twitter intern okay I press
enter to interrupt or Plus for more
options okay let's try if we change it
to hello world and then we save it
recompiled okay that's pretty nice now
how do we run it
run your app we can type run
up
oh that's cool like Auto recompiles all
right this is a decent workflow actually
all right so this is hello world I agree
or scholar geniuses
all right so let's get finatra up here
now let's first understand the
difference between phenatra and finagle
uh finatra uses finagle okay that sounds
good therefore it is highly recommended
that you wreck that you familiarize
yourself with those Frameworks okay so
we have to understand what Twitter
server and what finagle are um no and
this is the real truth guys never stop
being curious about things there's
always more cool things to learn
uh I mean I'm in I'm in okay Spirits San
Francisco's bumming me out a little this
city bums me out a little uh you know I
I I you know I miss Alex
um I miss my my lovely home
uh I missed my nice car
you know it's just I'm and then like I'm
here and you know it's just just
part of it kind of bumps me out but I
don't know I'm you know I'm also I'm
excited for the future
uh I I think that there's like a much
needed kind of cultural Shake I'm going
on
um
I don't want to work remote I'm not that
kind of person right I I like coming
into the office I like interacting with
people
uh
you know otherwise like you you miss out
on the experience right like I feel
really bad for the people who are like
in college during coven
College colleges college is hanging out
with people and
it's just a side quest man yeah that's
right all right
Twitter server to find the template from
which servers at Twitter are built
or with SBT a library dependencies plus
equal
all right let's just throw a little
server up here this sounds fun
I don't know why I need what do I need
finatra on top of finagle
oh an administrative HTTP server okay I
didn't realize this was public okay this
stuff's at Twitter too
so let's try this work
no
um how do I put that in SBT it's
probably in one of these files
maybe an sbt.json I put it here
or active.json
s let's go back to the SBT documentation
you know if you're ever like uh yeah
like worried about asking dumb questions
and embarrassing yourself I mean there
are dumb questions and I'm not saying
there's not dumb questions there are a
lot of dumb questions but you should
never worry about looking dumb right
like looking dumb is fine like how other
people perceive you is doesn't doesn't
matter wasting other people's time is
different right if you if you like ask a
lot of questions when you should be
Googling I mean that's pretty bad of you
but like oh no people won't think I'm
smart dude think whatever you want about
me man
um like I you know and the the danger of
doing anything other than think whatever
you want about me is
like then you'll work really hard on an
image instead of skills
and an image is very fragile an image
can be broken skills are not fragile at
all skills will stay with you for life
so where were those great where was that
great tutorial for SBT I don't like not
having my monitors I have nice monitors
at work but I didn't want to stream the
mark
learn
SBT by example okay it was here I don't
know what happened here Library
dependencies okay
Library dependencies can be added in two
ways manage dependencies are configured
in the build definition
there's nothing to add to build SBT okay
where's build SBT
all right that's right we don't use uh
let me switch this over to this and let
me download a plug-in no not Docker not
Jupiter not remote we're going to
download a plugin
for Scala
uh uh manage dependencies Library
dependencies where do I write this
you can simply list your dependencies in
the setting
but like where do I put this
these are Json files
okay oh
touchbuild.sbt okay I don't have a
build.sbt
so now I have a build.sbt now let's get
Twitter server running
so I just put this in here
this is going to do something
compile
apply these changes by running reload
okay great
cool
compile
oh nice it's fetching them
okay so now we have hello world now
we're gonna
we use finagle what this uses finagle
okay use this finagle guys okay Twitter
server uses finagle and finatra uses
Twitter server
this is like a diagram of this somewhere
um
object basic server extends Twitter
server
I don't know can I create a new how does
it know hello is what should run when I
hit run
example dot hello okay can I put another
object in here no I think I'm gonna need
to create a file called basic server
right
extends Twitter server okay we don't
have a Twitter server okay
let's make a file called basic server
dot Scala
here are Imports
run
not found Twitter server but I imported
Twitter server I don't know you're
probably gonna save that okay
multiple main classes detected
select one to run basic server
running basic server okay
so 888 let's say
oh pretty cool
why does it just say hello
oh I see because that's the server okay
we'll change this to say hello Bob
uh Ctrl C run oh we don't want this
let's just get rid of hello Scala you
know what if I just comment this out
will that not complain anymore okay good
running basic server
now all we have to do compile can I do
come
address is already in use
oh that's the ad oh it has the admin
interface on there okay
cool I mean I don't I don't want to do
anything that's secret to Twitter I'm
using all public libraries here
um
failed to load class
hello Bob okay good uh so I think it's
also bound
to this port ah yes so I didn't know
what it is was public oh check it out
boys look at this
uh this is called admin HTTP and it
listens on 99990.
um you know a lot of times whenever
you're working with a company
uh they're open source stuff's a lot
higher quality than the internal stuff
and this is because companies like to
like put their best foot forward with
open source whereas internally this is
why a comma like when something's crappy
we try to open source it or we try to
sell it
uh because okay cool
so great this is a server that listens
on 888a
oh this is a pretty nice framework okay
um
all right
okay uh so this is server I don't know
why it didn't show up there let's see
what those complaints were
Warface okay
board server Health okay
on stream client
okay
wait what I control C do why is it still
running
is this still running oh it's all still
running what a scam
stop
oh shutting down SBT server
let's try again
hmm
started SBT server
okay none of this is running
I have to do run for that let's just do
compile okay that's good run
info running basic server
like takes time to come up
we should be able to do quit server yes
quit
okay go ahead and then it quits
uh okay that's nice
cool we have a bit of a workflow here um
if I do change this hello Bob to like
Hello Kenny
see if I ever hit run again if it
actually updates
okay okay okay
Hello Kenny
finatra Builds on Twitter server and
uses finagle okay we familiarize
ourselves with Twitter server we have
not familiarized ourselves with finagle
if an angle is a extensible RPC system
for the jvm used to construct High
concurrency servers uniform clients
server apis
all right let's let's try a little bit
of let's try a little finagling
okay this clearly includes finagle just
doesn't include Twitter server oh so
what if I just don't extend Twitter
server what if I just do this
then I think I won't get the admin
interface
ran it so let me shut it down using this
Miss quit server yes go
do I have to do compile no I think if I
do run it'll Auto compile it for me okay
value not found on exit
um
there must be some Twitter server thing
no main class detected
how come this had a main class
understand
uh look I'm literally an intern to make
search better are they gonna get rid of
microservices I don't know that's all
about my pay grade guys I'm just trying
to be more useful you know
um
the last thing I ever want to do is like
be in a leadership position or have to
manage anybody
like I I this is this is what would yeah
um that and Supply Chain management to
comma upset me ha ha
surround to stuff and I'm here to
hopefully get some cool things shipped
if we can
okay no main class detected
why
I have a main class
I don't understand
if I uncomment this one right can I use
this main class again
how does that work but this doesn't
what's wrong with basic server
when I copy and pasted this code
whenever you copy and paste don't learn
so let's start with that
um
VAR server
but wait ready server by the way cool
thing about Scala is you don't have to
write the word return it just Returns
the last thing in the uh in the function
okay so we have to create this thing
called service
um we need
request response and status
um we need a weight and Future
I wonder what a way in future though
we need HTTP and service too
let's try that let's comment this out so
it's not accidentally loading any of
this
the hello service great
uh so this is because I'm not running
Twitter server I think I'm not going to
have the admin interface now
I don't have the admin interface but I
think I should still have this okay good
hello Mr Kenny
just control C work
no control C doesn't actually kill it
um SBT kill run
how to kill a running command in SBT
I don't know
so I've never seen this spt thing before
uh
uh let me so let me check if this is
uh so there's definitely some pants
uh pants is Twitter's custom build
system
okay there's stuff about this yay
they've migrated from pants to Basil uh
which is much nicer I should watch this
actually
to understand a lot of times you see a
decision but sometimes you can't figure
out from that decision like why it was
made and it's really useful
um so yeah it seems like in like 2020
they did a big migration from their
custom build system pants to Basil which
is uh which is potlick
skip the rebel just do SBT run oh I see
what you're saying okay that's not a bad
idea
um
all right so I'm expecting to say hello
Mr Kenny but I have to wait for stupid
SBT to start up
okay hello Mr Kenny great
you know a lot of times how quickly you
can kill and restart your thing okay so
just finagle is this HTTP server I think
finagle also supports Thrift
now I do not know what fanatra is
fanatra seems to build on top of both of
these and provide something else so when
we add Twitter server we get that admin
interface uh on 90 90 but we don't have
the admin interface now that's cool that
Twitter open sourced this so actually
good stuff here
oh yo we should go through these
tutorials man I don't understand you
know they don't
okay
all I'm saying is this is this is a lot
more useful so the stuff I've read
uh again usually companies open source
stuff is much better than then they're
closer stuff
um okay
so
this is Twitter server this is finagle
okay
finagle Builds an HTTP server does
finagle also do Thrift
or is that just finatra
minimal HTTP server calm Twitter finale
http
current programming with futures
it seems like the thrift stuff is just
in phenatra
Sona type
what's this
if enable just looks to be HTTP or I
don't know
extensible RPC system
it plants uniform client server API see
this is when things get Java e
h
I should do a stream where we just go
through all the Apache projects and make
fun of their non-committal language
your server is a function oh here we go
it's so pretty cool actually and I do
any other companies use this or is this
stuff all specific to Twitter
um like go built seemingly a lot of this
like goes HTTP server is incredibly good
they built in one and go
um you just
Scala is good okay we like Scala
uh calm Twitter Twitter server all right
let's let's start with just this one
Twitter finatra HTTP server
that probably still works right I don't
think I broke anything
we're downloading finagle guys
what is this npm
all right so let's see
Mr Kenny's still working but actually we
don't extend Twitter server anymore so
we don't have anything there
vinatra Builds on Twitter server and
finagle
test dependencies
getting started great
for not your basics
level you can think of your financial as
a server container
container has life cycle and state the
state includes flags and modules which
can help to create it
injector that provides access to an
object graph
all right guys just think of your
fanatra app as a container okay
that's that's it it's just a container
man this container has a life cycle
right so like think about it like like
like uh like it's like a carton of milk
right it's a container and it has a life
cycle because it's got an expiration
date and inside it is some milk right
this milk includes curdles and not my
analogy broke
flags and modules which help to create
an injector that can provide access to
an object graph oh God
it just makes sense to people
um like react God another thing I don't
know you know you know I met some guy in
a this coffee shop I mean he was like
bro react sucks you just use smelt
this is this is this is I heard the new
hotness no guys like I'm terribly shit
react
um
I've heard I've heard svelte is good
not no no guys you know what and then I
was like I I was uh I was talking to
Alex I was like Alex we need to get rid
of reactic comma we need to move to
something else the react is the only
part of the common code base that like I
can't do anything with
like I just I just uh you you
okay fine I'm not like you saw me do
react you saw me do react on one of
these streams
um so I'm not that bad svelt is vanilla
JS that's what I'm talking about was my
jQuery shit man
uh triangular move to anything except
angular oh
is this is this what react is to it
includes flags and modules to create an
injector that provides access to an
object graph
see like no one writes like you read
like a go library and they don't talk
like this
something about like like like these
these Java people who like to talk like
this
reject modernity return to PHP and
jQuery man you know what when I started
getting laid we were using PHP and
jQuery and I'm a shield for that forever
oh everything is vanilla Jazz I like
that take
all Java people are broken
wow
uh no I'm not back in Jersey
react has one no no we will fight back
the svelte Army will fight back all
right we'll do some svelte in another
stream
um
flags are constructs that allow your
container to help and parse command line
input in a type-safe manner
hold on let me get back to the
foreign
[Music]
spicy spicy chat now that I brought up
front end
okay guys guys guys we can't get
distracted here you're getting me
distracted react is wonderful I'm an
idiot and react is a wonderful framework
that's the truth
um all right how do we
next
understanding the code base Financial
divided into three main parts inject
HTTP and Thrift
framework contains all the base
functionality
you know what's a nice front-end Library
QT here there is QT
QT is nice it's fast simple to read
our react now has server components
um I use this this is library in Kira I
used I use called meteor JS I don't
really think it's a thing anymore
let's see if it's still a thing
uh oh it became a platform is Media JS
still relevant
um
yeah
I use this in Kira and then I replaced
all of meteor JS uh
with
where is it fakemedia.js
yeah I replaced everything that meteor
was basically doing with this and it ran
10 times faster
um one of the kids at the uh
is called million Js
yeah million Js
I don't know if it's any good this kid
from uh hack days wrote it uh but I like
that it's small
do you want you'll do a front end is
that what everyone here does
bunches
tell me more about bun
is it is it am I broken or Frameworks
broken
yo I just love all this shit though you
know I love computers man
this shit is written in Zig no no no
no please no zig someone should just we
could we just make python fast and just
use Python oh my God but then this
brings me back to like Django
Django
are you right Scott off of work all
right we got some Scarlet Geniuses in
here great
um
all right so you can you can you can
mock my my high quality Scala
you really understand this syntax
maybe I should like understand this
syntax right
all right so this syntax I understand
all right
okay
um Twitter you tell a weight
a docs for this
wonderful reusable code from Twitter
check the Scala doc all right let's
check the Scala dock
um Twitter util
oh wait
synchronously await the result of some
action by blocking the current thread
and if I don't do that
if I get rid of a weight right this is
how they test DNA you know you just like
knock out one thing and you see what
happens
I feel like SBT is like sbf's long-lost
brother you know
the documentation does look nice
actually
okay so it just finishes
foreign
just exits if I do that
create the server and then when you
await the server
all right so what is this syntax can you
scholar Geniuses tell me
new service request response
okay and this is defining a function
called apply
this is an implicit return a future
value
we create a class called response we put
in the version of the request we put in
status okay
let's just do this just that's going to
print 200 right if I did it right I'm
going to put the weight back in
wait
for a server
oh dump SBT for mill
all right SBT versus Mill
how many people here have taken the
plunge with Mill
I've been a long time SBT user and
finally took the plunge with Mill
the result has been pretty good so far
very fast incredibly flexible relatively
simple
sometime a caches too much
meal is a new build tool for skull
it's typing the service
this is a type signature
oh it's like uh it's like in C if I do
like it's like that
it's a specialization
like that
um
I I accept that these are types oh by
the way did it print see the printed
anything
that is 200 okay good and I like that I
can print Outland anything and it's not
like that's not a string you can only
print Ln strings
um
can you ask GitHub co-pilot to explain
it
there is I did I did hear about this
that's like explain code kind of thing
okay Scala type specialization
or maybe we should look at a Twitter
scholar tutorial
okay good yeah yeah so this makes sense
so it's just like type it's called
specialization in in C plus plus I think
I don't really know what it's called but
it's that
um
I got hired by Twitter I am a 12-week
intern at Twitter
I think if you want to be hired
full-time you have to know Scala so you
start with the internship and then if
you get good at Scala by the end of your
internship
you get a full-time job
um
I had a two-minute conversation I'm not
going to answer this again I had a two
minute conversation with Elon where he
told me fix search
uh you know I said that I wanted to work
on improving developer experience and
he's like no fix search I'm like okay
oh and I I did I I did yeah uh
not great this place is fucked man San
Francisco's fogged
how's it going I've been here a week
like hopefully I can like get something
little shipped next week after I want to
get that liked by things shipped and
then and then we can see see what's next
tomorrow's pretty good actually I don't
know again like people think that like
the media is just liars man they're all
just straight up like it's burning it's
it's like it's not it's kind of normal
um yeah
some of the ml people are cool
now you feel sub only coming should we
do SUB only
all right we got to do something only we
gotta do SUB only elon's a band topic
um
because I'm doing normal internship and
like I'm trying to learn this stuff and
I'm trying to kind of learn it fast like
oh what's Scrooge
oh Scrooge generates the bindings okay
okay okay great
this is this is this is all used at
Twitter as well
um
all right let's let's stand up a finagle
server
future I face oh is deprecated oh oh
this is useful this is so useful okay
good
okay
finagle integration
you can generate oh this is for Scrooge
that's finagle not fanatra okay fanatra
Basics okay
scholar services framework
user guide
Twitter server Basics like we know about
Twitter server Twitter server is great
um Twitter server can start a HTTP admin
interface
foreign
is meant to be used in conjunction with
finagle clients and is a finagle Surfer
thus it is expected that you will be
using Scrooge to generate finagle Thrift
bindings
build screw reviews SBT
SBT users need this I just like do that
does that do anything
it shouldn't right just like creates a
variable
I don't know how this build SBT what
this like syntax looks like but it's
just a variable
uh no so it didn't download that stuff
but I think I have to like include
Scrooge core oh this is like I
understand
this syntax means like get it from like
the package com Twitter or something
here group ID artifact ID okay I see
okay creating a server
let's create a server
class server info
extends
binary service method per endpoint
provide an implementation
hmm
what is this doing for me that I can
already do with phenot draw
why am I in Scrooge documentation now
so if the association is still CPU heavy
yeah this is why we use cap and Proto at
coma Captain Proto zero copy
it's really nice
if you want stuff to be fast but then
the python Library Pi cap and P is
terrible
and like multiple people at comma have
tried to write a new version of it and
they all fail at some point
um but yeah we still waste a good bit of
open pilot CPU on on pay
user guide
introduction to logging
Thrift server Thrift server definition
okay this this looks good
or maybe we should start let's start
with an HTTP server
HTTP server definition okay this looks
good
let's start here
create a new class which extends CT com
Twitter Financial HTTP server
[Music]
um
project example server main extends
example server
what is this
a little Scrooge layer we're not doing
any Thrift yet we're still on HTTP land
so this is just the example surf our
object
I understand this syntax
I didn't have that before right
great lots of Errors withdrawn it
doesn't seem like I need that
um oh this is a class oh I see okay so
this is creating an object
because HTTP server is a class why can't
I just say
if that other one was doing extending
the Twitter service example Twitter
server example
Stan's Twitter server so how come I
can't say
I don't understand why I can't say
object examples have remain extends HTTP
server
why do I need this level of interaction
but I guess I don't really understand
oh okay
a more complete module involves adding
where's example controller but that's
not there
I have to like write that right
let's return Union anyway so let's see
what the bug is
thank you for subscribing
uh yeah well I make more money from
Twitter or I make more money from twitch
okay exception thrown in main Instagram
let's see why
unable to load a cash item
uh
uh what's a cash item
let's Google this
why am I in calm Google
oh no do I have the wrong version of
java
oh no
oh that'd be a nightmare
wait wait can we just can we just is
this a meme right now
Java illegal laying exception Homebrew
Java which Java version do I need
why do I even have any Java
I literally copy and pasted the example
code
like unless I did it wrong
we also recommend using log back isn't
the library that had all those bugs
isn't this like that zero day on the
internet
um now this is this is a meme guys
look look at this look at this
Java Lang a legal status
log for J yeah it was log for J that was
it
not slf for J
it does on okay which version of java
should I be using does it tell me
unable to load cash item
foreign
does anyone know
we got some we got some we got some
Scala Geniuses in here right
object creation impossible since method
configure HTTP server is not defined
okay so you do need to define a
configure http
um maybe there's a chance that I
actually just need to put something in
there
it returns unit though but
public example Server create flag I
don't know do I need this no there's
Jabba
I'm sure I can't put three question
marks there
um
example module
how do I get my
when I add the following controller
oh do I have to name this correctly is
it like Java like that
well let's create example controller
and then here great
oh okay this is looking good let's see
if we have the wrong Java in a minute
seek do everything module what's the do
everything module
port example service
um where's example service
oh I don't think I need that
inject example service okay
um let's just get rid of that we don't
need that
this should be valid right if I just say
class example controller
extends controller and let's just
implement the Ping
so now we have a example controller
being added to the router
let's go
could use mail sounds like it'll be
faster
we don't have example controller even
though I import it
I created it there
is there a reason that it's not being
built
import example controller
do I have to say like example.example
controller
oh maybe because it's not part of
package example
um okay it's not a member of package
example okay
put package example up there okay now
it's part of the same package so it
should import okay
guys I need to go to boot camp
all right
is it running
no
exception thrown in Maine on Startup
okay it's the same unable to load cash
item crap
I forgot saving the file
what are you talking about I saved the
file
okay now I saved all the files
no same matter I think we really oh
you've added to Maven Ops
Java version if it's not Java 11
uh Java 11 Homebrew
using Homebrew to install Java 11. for
install Java 11.
we have Java 11 it's just not the one
that's being chosen
um Homebrew select default shop
cleanest way is to use Homebrew JN oh
that's j n
okay let's install JN
Brew install jnf
looks like it's when it's loading the
modules yeah maybe
okay
JN version
system
great
uh then you can install Java versions
like this
Brew search Java
okay
oh I have to add them to my JN
which Java
these are bin Java
okay
um this can't be right
changing Java version on Mac
system Java remained untouched
okay we have to export Java home
is this Java home here
how is that oh maybe I link it Brew link
open jdk 19.
okay let's try Brew link open jdk 11.
okay okay
this one has open jdk 11. okay let's try
it in here
uh SBT run
copying runtime jar oh we're gonna have
to like install it all for I don't
really know how this stuff works I know
so little about Java
but okay so this kind of makes sense
like we're creating This Server and then
the server has the controller and the
controller has methods on it so when I
go to slash ping it should give me the
word Palm
expected dot do I have to do
example.example controller
do they have environment variables on
Mac yeah it's the same
example control is permanently
definition
oh do I not even need to import it
because it's already in the same package
there's some chance that's true
we can try commenting it out you know
guys it's always better to write less
code all right
working
they're running
let's see if my great server is running
did I give it a port
um I did not
so I'm going to get like debug here too
oh Sinatra is this what this is
oh great there are https doesn't work
that's a website I trust with my
business
um help no
all right I think it's working maybe
uh what port is it on
oh I should have choked for 90 90.
there's a chance it's up on it's up on
here oh sweet okay listening servers
HTTP on 888 all right let's go ping oh
my God guys we are Java Geniuses we're
Java geniuses
oh
let's see
foreign
ER or famous computer person would like
to take me up on my challenge I think we
have to pick something that we both
don't know
like we take like some some language we
both don't know some framework we both
don't know and then we see who can
accomplish a task first in that
framework
yeah we did Java yo we did Java
everybody
all right
um all right should we make post work
oh we can add another thing to get name
and it's always Kenny
so now when we run it
all right good to know it doesn't work
with Java 19 you need Java
11.
so I think that what we're going to do
for this stream is we're going to stand
up a thrift server and we're going to
get that Thrift server talking between
Scott and python we're going to call
that a day
does that sound good
let's open it up to non-subscribers for
a little bit even though evil D Raven I
see you're just subscribed so you can
always still talk because you're a
subscriber and you're a good person
all right Kenny okay
uh yes I think that's what we're gonna
do we're gonna get a thrift service
stood up and then we're going to talk to
the thrift service from Python and
that's going to be the history
foreign
problem did you know that you couldn't
do that in Java 19.
uh
uh I'm a Twitter intern for the next 12
weeks so I have like another week to
become good at this
um and if I'm not good at this
uh
grateful for your help guys I I didn't
do anything right like I hate this I
hate this like you see some stupid media
like a genius hacker brought in to fix
Twitter in 12 weeks what the fuck am I
gonna do in 12 weeks
right
like I got an internship
okay and I I really like I hate this
shit where it's like
like
uh you know like like I'm some kind of
wizard or something I'm not
I'm a good programmer but I'm not a
wizard right I'm not gonna you can't fix
an organization of 7 500 people in 12
weeks
I can do what I can
right and I can try to help and I can
you know
hang on
ah
you are at the hotel I'm at that's where
I stayed be careful the folks outside
the hotel sometime pull their pants down
and pee in the street
and signals
gotta watch out man
uh bro now this this city is I don't
know anyone lives here I really don't I
really don't this is the most unbearable
part of these 12 weeks
um
you have to pee in the street to blend
in hot I like that I like that good
point good point man
it's my dad's advice you know my dad's
advice always look you want to walk
through a sketch area just dress worse
than those people and they'll leave you
alone
pay millions to live in the slums San
Francisco okay so we have to stand up a
thrift server let's find the thrift
server drift server Scrooge and finagle
okay we're gonna have to use Scrooge
all right using Scrooge to build Scrooge
use spt
SBT published local for some reason I
don't think that's going to work unless
that's a command we should figure out
what that does
oh no no it's publishing it to Maven no
don't do that
every time
this will currently not build and
publish The Scrooge spt plugin
creating a server
oh Scrooge generates a service per
endpoint which is a trait defining a
service for each Thrift method
so this is my Thrift IDL here
I don't actually want it to be binary
fetch blob let's create some new Thrift
IDL
oh there's also well obviously that's
public
finagle binding code
how do I use Scrooge
ful purpose
to start
clone no no you can't make me no I don't
have to clone this
no no please don't make me do that
this requires having the Scrooge project
available locally
we did build build local
published to iv2
uh no dates for my LinkedIn yet LinkedIn
is not the best website for dating
that's why I moved to Instagram and got
a blue check if you don't follow me on
Instagram I'm at georgehots
uh so make sure you follow me
um that's where the dating opportunity
is it's not on LinkedIn unfortunately
all right
are we really gonna do this
let's say now we have Scrooge
working off the master branch
ensure that you're using the latest
released version of Scrooge
okay that's not usually what I know I
know man LinkedIn is just not where not
where the uh the women are looking to
date
foreign
no but like man
uh oh this is George Watsky line let's
not die before I get the fuck a robot
you know
pathmaster oh don't tell me they went
Maine
develop great
okay
there's only one oh there are multiple
branches there's release
maybe release
oh don't tell me they changed it from
master and then didn't update that
that's offensive I'm offended by that
okay
okay let's get command line help
no SBT
um
oh there's an SVG here okay
what does that do
why am I running sketchy code that I
downloaded from Twitter
Java eh
the screw generator is responsible for
converting Thrift IDL files into
generated code
okay
um to generate
let's create a thrift file first of all
Thrift example
Thrift by example I will generate a
simple multiplication service
where's the IDL for this
of course they made it more complicated
oh here we go
now let's create a new folder called
Thrift
and let's call this multiply.idl okay
we're going to implement implement this
multiplication service
we can use type def to get pretty names
yep what's going with i32 what you
didn't think that was pretty that's
racist
all right good
[Music]
I don't think I can do Thrift gen Scala
because I don't think thrift supports
Scala does it by the way we got to use
Scrooge do we suppose a variety of
languages but not Scala okay
great so that looks like a nice
multiplication service and we're gonna
have to implement the multiply and we're
going to call it from Python and we're
going to speedily multiplying numbers in
Java from python right ready it's going
to compute it's going to compute great
things like two times three and three
times seven
but not really big numbers because
they're i-32s
okay so as soon as this finishes we
should be able to generate source with
content written to the current directory
generate source with content written to
a specific directory
using extra include paths
I don't know we'll just try this and see
what we get
it's downloading maven
just something hard time like seven
times eight ah you're a prime subscriber
I will take your suggestion under
advisement once we get to that point if
we get to that point
all right
defining Thrift controllers
let's define a thrift controller see my
controller is way more sophisticated
than theirs okay quiet example
Thrift controller dot Scala
we'll start out with package example
oh that looks useful
I'm going to surface we're doing a
service for
students controlling what do I need a
service for I don't understand this
oh multiplication service okay
how do I get Scrooge to generate this
provides a DSL
given the following Thrift IDL
okay this looks good
we don't have to worry about error
handling there'll be no errors we just
won't write errors
sounds good it's definitely not going to
throw any errors
um example RB we don't need RB fuck Ruby
man
okay good
all right
guest write code to a folder dot dot
slash drift
that right
Thrift
oh I spot multiply wrong we should fix
that
multiply dot IDL whoops
oh I miss my nice keyboard
uh Thrift
dot slash Thrift slash multiply IDL
the quote
all right we're gonna see if we get
stuff here in Thrift
we get
so this looks like it like generates
okay calm
oh com Twitter example Thrift Scala okay
we actually probably want to not put
that there then
probably want to put that
let's just do it right
and delete that
that's going to create this there
is an example Thrift controller okay
com Twitter
example Thrift scholar multiplication
service.scala okay great
now we're importing that which is right
all right controller extends
multiplication service
what's a filter we don't need a filter
we don't care about that that sounds
stupid
um
okay they made a function called add one
our functions called multiply
so R is equals
multiply future what did I call them
N1 and N2 args dot N1 times args and two
okay
and this is our example Thrift
controller let's stand up a thrift
server
it's an example controller example
server extends HTTP server which one of
these was actually using
stuff in hello I guess because finatch
HTTP server okay let's get rid of that
we shouldn't even need that import I'm
going to import stupid
all part of the same package guys we're
like family
all right the following Thrift
controller okay
uh no add the controller to the server
okay good
um example server extends to Rift server
which
assume is something like this
that's good
now we're gonna override daf router
but we need a thrift router too
let's assume it's the same
don't be that again it's not what I
needed
um
[Music]
did I do it right
oh no we're gonna have to tell it that
we have an object
because otherwise gonna be like I don't
have a Mane to run
object is not a member of com package
Twitter but it is I see it right there
don't you
objective example I probably need to
like specify that in the build file
somehow
I don't know how to do that
all right
um object Thrift is not a message of com
Twitter that's not good
yeah the controller to the server if
this is right is it not
yeah Thrift server running tough Rider
okay that's right
oh I probably didn't ah we have fanatra
hdp server we're gonna need a phenopter
thrift server over here and that doesn't
do anything you have to manually check
out Scrooge probably because I just
didn't read the documentation right
thank you thank you real drone Powell
copying code from examples brow that's
all wait what that's not even write it's
like some of the right version
um
not Scrooge finagle server
where's this
the natural Thrift server is that not
right
oh just for natural Thrift for the
server
using log back no well I don't care we
recommend We're not gonna do that
the Neo lotites are out there watching
DVDs bro
okay object HTP is not a member of shed
okay well this is junk okay let's create
a new folder called Junk
how do I like to say it's junk and I
don't need it
is there a way to like tell it not to
build this
I guess I don't really know
we're back to object as an example is
not a member of com Twitter and it's for
some reason that's not
I understand though because I didn't
specify anything about Source main oh
maybe I need to put it in source
let's try that
MV calm source
that right
No Object example is not a member of com
package com Twitter I don't understand
do I have to put it in Main
oh maybe Source main Scala
now it's in the same place exampleless
come on work
oh okay
requires huh
com Twitter finagle okay okay that seems
more fixable at least
um
calm Twitter example Thrift scholar
multiplication service
okay
require finagle generated Thrift service
all right
better I think
defining Thrift controllers here we go
oh
is this like because I have to like tell
it it's like part of that or something
generated Thrift service
sample service service multiplication
service
first let's fix Scrooge
we're gonna put it in dot dot slash uh
Source means Gala
so that's my compile
do I have to add these maybe I have to
add these
stuff will seems stupid no never mind I
don't want any of this
understand oh maybe you have to have
this namespace Java thing
um faded ASF and I swear you can't be
typing shit that's real
all right we gotta go back to sub only
wait unless is there a Java genius who
can tell me why this is the wrong type
okay
found
this
didn't
well this is already a problem because
there's nothing called multiply there
where did this get add one from
examples of controller
where does that even get that from
understand
example service
but one controller class
I don't understand this should be right
the natural Thrift controller
okay and then I extend it with that
extends controller example service
okay
Scrooge generates a generated Thrift
service
which should be what I want why didn't
the Scrooge do what I wanted stupid
Scrooge
cation service
someone want to help me
does someone know what does someone know
what to what what to do
all right let's read The Scrooge
documentation because we might just we
might have done that wrong finagle oh we
might have to like pass like finagle I
think we have to pass finagle I think I
saw something about that
let's just run Scrooge out
I think I can pass finagle to this
because Scrooge might just be
a very generic thing unless I tell it
it's specifically for finagle
yeah generate finagle classes there we
go we got a finagle dingleberry let's go
so this should generate something
different
we'll add this here I should probably
have this
oh look now we generated lots of crap
I'll love it I love that boilerplate
boys love it
[Music]
um
all right let's see if this builds now
okay good now it's only complaining
about multiply we should be able to find
that
multiply and example to a scholar
something called multiplying here
self dot multiply
how does that get add one
got Scrooged
the Zuck haircut always comes back right
I mean I got I got a little hardcore I
gotta look like I belong at a social at
a social network you know
I don't understand though where is that
getting imported from
oh we should probably we should probably
add a printout Landing there
say trying to multiply
can I put commas does this work
please let's try that
or is it multiplication service dot
multiply
wait now this should actually just work
I don't get it
to spell multiply wrong no
um
because it should just be an extension
of that
object multiply is not a member
okay it should just be an extension of
that and it should work because I'm
importing it right
like I'm importing multiply
multiplication service
[Music]
um
not found value multiply
value it's a type
let's spell it wrong did I
this isn't here right
okay methods self dot multiply
do I have to say self dot how come this
one didn't
Legacy style we don't want anything
Legacy Style
Scrooge response and request wrappers
uh oh I don't have that with FN do I
need with FN
oh does this filter stuff matter
I think it matters
non-subscribers do you have any ideas
where why is multiply not showing up
I see it here
extends control our multiplication
service which should be right
don't say hi you answer my question or
the the naming how is this not
deliberately obtuse well it is
deliberately obtuse right
otherwise who would employ all the Java
programmers of the world none of that
none of this is felt deliberately up to
so far this has actually all been pretty
clean
like these sort of Frameworks are very
um they're very opinionated
about like how you use them
oh maybe it's because I'm capitalizing
it and shouldn't be
or maybe
let's try this if I capitalize M there
to rerun the screw generator
I mean even though it's not capitalized
here and it just becomes capitalized
there it's a chance as a typo or
something
no no luck
okay self dot multiply
um let's try multiplication service dot
multiply
and maybe there's like a using namespace
somewhere that's I don't know where it
is
dens control or example service
uh just handle without oh no it's okay
that fixed it
I mean that's weird
I don't really understand that
okay whatever it's running out great
um is Thrift web Financial
is there a way to call the thrift server
from the web
let's see first off this is up okay
great we have a listening server of
thrift
um cool all right we're getting there
now let's just see if we can do some
python to talk to it oh who's excited to
code python let's go
python
call multiply dot Pi okay
um python Thrift what port is this on
okay
okay so Thrift is on 999
um Python tutorial Thrift talk right
all right let's let's uh do I have
Thrift I don't have Thrift
Brew install Thrift
oh it even looks complicated in Python
no we're coding the client in Python
guys I'm not trying to avoid Scala I
swear no no we've written our scholar
this should multiply
thrift store
what does dash R do
uh graph dash dash gen Pi dot dot slash
three F multiply IDL
all right gen pie great
um
oh you gotta love it oh you gotta love
it
from tutorial import calculator
uh from multiplication
service import multiply
why is that complaining
oh and forth cannot be resolved
let's see it works
let's throw a shebang on there
no listen index out of range
great
can you do that
no module name multiplication service
oh from multiply that multiplication
service
that's my picture install Thrift
shits were circulating let's get to the
bottom of it
uh
uh cannot import name multiply
okay well that's fine
oh here we go client
uh like I don't know what calculator is
uh oh from multiply important
multiplication service easy
easy
great
uh we don't need Main
we need a transport it's on
and now we need our t-socket
can you find thrift
buffering is critical raw sockets are
very slow
all right well good to know we want to
multiply to be fast right
wrap it in a protocol
create a client to use the protocol okay
protocol thanks
all right let's connect
and then I don't know if ping works it's
gonna work
because I didn't Implement pain
might be part of the might be like you
don't have ping okay guys you don't have
ping
um let's try client Dot
uh
multiply that's capitalized oh that's
disgusting
all right what did you guys want to try
seven times eight no no we're gonna
start with something easier let's try
two times three
rat
two times three okay you know what let's
let's write good code guys we're gonna
write high quality code we're going to
parameterize them here
okay
T socket read of zero bytes
can't win them all
transport open
wait uh oh
what if this is a finagle Thrift and it
doesn't work with a normal threat
that would be a tragedy
no what if we get rid of this buffer
transport I knew I didn't trust it
all right how am I going to debug any of
this
there's got to be some way to do
debugging
um
it wasn't even trying to multiply
it's not even getting your call but this
should work
T socket read of zero bytes
finagle Thrift I mean this this is
normal Thrift right
uh to a facilitate scalable rpcs
using finagle Thrift
use our own open source
generator
okay maybe we do need those filters
after all
filter stuff mattered that I just didn't
care about
okay filter type agnostic
with FN try the Ping example now what do
you mean I don't have ping
No it should be it should say trying to
multiply if it was actually getting hit
it's not getting hit yet
uh
you can see the options here
sorry I can't click that
many mangoes look there's just a lot of
angry people in the world and you know
all you gotta do is just be positive man
and like don't let him bring you down
man
check your socket open line no I don't
I don't think so it seems right
okay we need debugging let's figure out
how to enable deep bugging
oh maybe we can see some stuff in
Twitter server let's go to the admin
interface and see if we see anything
I'd like to read zero bytes uh
important logging no the port's
definitely right here
no
um
draft
you want to add a time sleep before you
actually call the thing and it crashes
uh
uh so I've receive multiplies where it
breaks
it's not connected or something how come
I don't see it in Downstream clients can
finatras only listen to other fanatras
like that would be the real tragedy if
this like adds something to Thrift
he added logging to the server side
oh
okay oh that's a good point I should
just Google this
why have I not just Googled that yet
[Music]
um
no this is not logging okay finatra
natural log
okay
great
I think there might be there might just
be like args I can pass to this
[Music]
how do I pass arguments to this
is SBT log level though that's not what
I want
um
SBT run command arguments
how do I pass command line parameters oh
I put it in quotes like this
but that's ridiculous that if that's
what it is
this should tell me maybe how to turn on
debugging
we got there
um
log a pen
log level equals debug
Rift server name
socks proxy
um not that didn't work
error passing flag log level error bad
log level debug okay great
do not like that
SBT verbose debug no that's not it
um
well at least not a pass out there we
figure out how to do
uh
Thrift server
we might just need the problem might be
that we need that filter thing it might
actually do something that I don't
understand
add filter
I don't understand though no filter
should just be better than any filter
right
permit stats no
okay should we try to something we can
try to do is we can try to write the
clients
we can try to write a client
in Scala and see if the Scala client
works
Thrift server warm-up
warm up what
okay we did add we did add it to the
router right
yeah router add
example Thrift controller
oh do we need to do everything module
what is this
oh that's probably unrelated
okay handle multiplication service
arguments
former Twitter employee here do you know
how to make this work just
SBT jvm debug your running commands of
what
handle.width function no I don't think
it's that I mean the with function okay
we might be able to get further with the
width function I can definitely write
that
let's give that a try
you guys you want to know what they're
really all angry about
that turns out
that 80 of people
in most jobs are useless
and Not only would the world run the
same it would actually run better
but imagine you're
[Laughter]
no you can't just go to Twitter and be
interned no
no
you have to be at least level seven by
now haven't you been to levels.fyi I've
been spending my whole life caring about
my TC and then I ask other people what
their TC is on team blind no
oh
stay woke
um
I mean what a collapse you're going I
mean look also by the way guys I'm not
Elon Musk I'm here eating the popcorn
just like y'all man
this is
Elon has provided the world with a gift
like this this is the most entertaining
shit since like
SPF stole billions of dollars
but this is actually useful
Maybe
a day in the life of a Twitter employee
yo you can like go to the office now you
can go hang out in the meditation rooms
like
you know and also don't spread the fun
Twitter is actually the office is still
it's it's nice there's still food it's a
nice place to work
the 80 make the 20 feel good I'd rather
work in a place without them
um you know I just
some of the some of the people who will
like interview at Kama and the things
that like might work in other companies
I'm like bro like or they try to like
they try to like play like there's some
organizational structure
you know they try to like play it like
there's like multiple different groups
of people when it's actually just like
the four of us all chilling in a room
being like this is this is hilarious you
know
um yo I spent way more time on Twitter
too it really it really has gotten again
we'll see what happens long term
I I wouldn't I wouldn't uh
I wouldn't Bank on that staying forever
but you know also when I talk about this
stuff
please I have no Authority right like
I'm not speaking with any voice of
authority I'm speaking with a guy eating
the popcorn just like the rest of y'all
uh but you know and that also said I am
like I want to see this experiment
succeed for for a whole lot of different
reasons
I learned about this thing effective
accelerationism it's like effective
altruism but cool
all right so we have to do request I
mean this just goes like a little deeper
it seems
no you can't justify all the people no
[Music]
okay now we have a request and we have
to return a response type so this just
looks like it strips out like one level
of abstraction if I do this
oh com Twitter Scrooge I wonder is that
actually going to be imported
or is that going to be like you don't
have a scrooge
Solo or troll thank you for the raid
thank you welcome new people okay
so what we are trying to do is we're
trying to use Twitter's Scala services
uh they have one called finatra one
called finagle and one called Twitter
server and we're trying to build a great
micro service right we're going to use
the word we're going to use the word
microservice so now now when when um you
know you hear Elon talk about
microservices this is what a
microservices
microservices this is a great
microservice and we're working hard on
it and what it's going to do is it's
going to multiply two numbers together
you're going to pass in two numbers and
it's going to multiply them and then
it's going to give you the response
right this is a really important
microservice because we need to have
Strack multiplication out because you
know I don't know why
um
microservice POG yes
okay but I'm trying to call this
microservice from python
oh crap already in use uh kill all Java
is all the Java dyeing or is there still
Java
die Java
die harder
the Java's gone okay
let's try svg.com so we could multiply
in no this is just a scholar service
that's going to multiply numbers I'll
open source it you guys can use it also
this is none of this stuff is I'm on my
personal laptop none of this stuff is is
Twitter's I don't want to see some like
misinterpretation somewhere George is
doing internal
Turtles Twitter this is literally all uh
public open source stuff on my laptop
but it's I mean it's code written by
Twitter but
okay
okay
um we have a few things we can do now my
python doesn't work and I don't really
know why my python doesn't work
uh oh is it possible it's not t binary
protocol
are there other protocols
we can try writing a client in uh in
Scala maybe we should do that
guys if I wasn't a Twitter intern how
would I have sweaters that say season
tweetings
and how would I have this hat
with a Twitter on it right
so yeah right
so yeah leaks Twitter
guys he leaked finatcher guys
all right so when this service runs it
brings up this cool little admin
interface we need to figure out how to
get more debug information let's start
there
okay
um an HTTP server a thrift controller
and server with function okay
figure Thrift we have a configure Thrift
right
over our def configured throughout
router for the threader router add
okay that's good
I'll say these two I've gotten a few
emails from people asking like you know
about like like internal Twitter stuff
and I have no really I really like I'm
not even lying I just don't have insight
into that stuff like who was fired like
I don't know I I didn't fire anybody I
didn't say anybody should be fired I
didn't do any of that shit man
right so you know I didn't do any of
that shit man as as our boy Shaggy once
said it wasn't me
so that's if if any if any media wants
to quote me y'all can say it wasn't me
right you know
fire the interns I mean there's a chance
I'll get fired if I maybe I don't do
enough code maybe I'm not hardcore
enough for Twitter maybe just like
they look at my terrible Scala and
they're like Jordan get the fuck out of
here you're not Twitter material we only
want hardcore engineers and
do I have an opinion on it oh man you
know what opinions are like assholes
everyone's got one you know that
we hear that before
um
uh
I swear I don't have any Insider
knowledge
it's like the joke in this too
oh
okay wait here we got we gotta Focus we
gotta Focus we gotta Focus
my opinion was the reason I ended up
with Twitter not so much come on how
funny is this shit man
um
you know like like I'm not the only one
who was hired at Twitter too you know
Twitter's got a bunch of new people I'm
not gonna I'm not gonna say what anyone
is
um
foreign
the media presented you yes dude fuck
the media the media like like you could
like hand the media a pizza and they'd
like report about a school shooting
right like that's that's like No I gave
you a pizza
like that's that's that's the level man
um no no I can't name anybody man I
don't know anything man I don't know
nothing man wasn't me man
um
okay hang on I'm I'm going off topic
because I don't know how to make this
work okay we gotta just do it we gotta
just let's just
communicate with a thrift service okay
Financial provides support for
integrating with Scrooge generated
finagle clients
HTTP service
Thrift marks
okay
Builder what
Thrift client module
method per end point
does this look way too complicated to be
a client
let's should we look more into the
debugging see if we can find more about
debugging
it's clearly like for example making a
connection right it's opening the
connection so there's got to be
something else
uh
log level info is there a bigger log
level than info
where is this log level
I don't even know like which service
this is in
Sinatra log level
Long Level and longer here
I've tried setting it to logging or
warning or error
thanks for the bug report
there might have been a regression
log level error
foreign
Ty I think can we say that now on
Twitter when a journalist gets fired we
can tell them to learn to code
um by the way I really hope the media
knows that they did this to themselves
like there's a reason there's a reason
that like the New York Times is a total
laughing stock
right like you know
when you when you stop reporting the
truth
and when you start like you can fudge
the truth a little but when you start
just blatantly like not even caring if
you're telling the truth you deserve
everything you get
okay invalid log level info that's
literally copied from there oh maybe
okay wait maybe it's that
does anyone still trust the media no and
like the media's mad about this too but
like Bros like you want people to trust
you trust is earned
I trust Twitter
okay why didn't log level debug work
I did something log asynchronously the
output file is standard error that
should be right is there anything called
like debug
GC drainer debug log
okay
foreign
should we just make another quick one
called RBC client
no I don't want a totally different
directory
Thrift client module
do I need this do everything module is
that the problem
my echoservice.scala
oh with logging
should we do with logging
I think that'll improve things
sure well
method per end point
extends controller
is this even right
try this
like this is a service
what is this used for
great let's try this other way to
we need debugging
and example Thrift controller
okay now we have examples of controller
could this error stuff matter
I think so
header data is available
can I I guess it's not even
getting there
just just in case like it's the yards
that are broken I'll just have it like
print the word called
T socket read zero byte so it's probably
sending the stuff
by the way can we note how readable the
python traceback is
and this is the Java Trace back
just noting
putting that out there
drift web forms
fin not try
no
should we innate should we should we
enable this
do we need this logging we're just not
like is there logging and we're just not
seeing it for some reason
let's add that to the build
I can do one that might work
I have some logging please
it's clearly connecting right
we can see if uh configure Thrift is
being called
foreign
value not found version log back
try curl well you can't curl
actually netcat we can see what happens
right now I can't open it
okay configure Thrift is called
okay it connects it just doesn't
do anything
to file okay we got to enable debugging
it's got to be lots of debugging here
oh defaulting ah here we go
failed to load class defaulting to no op
logger implementation okay I should have
just read that
um all right we just gotta find a
version for this thing
um
that one looks good I don't know one
four four
let's make sure we're not getting that
slf4j complaining again
all right we're downloading some stuff
that's good
oh oh look at that serving admin HTTP
that's nice oh look at all this quality
logging
okay oh sweet unknown exception closed
Channel adjusted frame length exceeds
bajillions discarded
aha look at that all right I love when
we make progress guys
it feels so good you know
of course it's a lot of vlogging
um okay so if there's a chance we're
using the wrong maybe someone's done
this before
um python talk to finagle
uh oh your client won't be able to make
use of
Twitter's upgraded
drift protocol
we had to extend the thrift protocol
we introduced the notion of Twitter
upgraded drift or t Twitter which
augments the protocol with support for
our internal infrastructure specifically
we tack on a request header containing
tracing info finagle ID strings and
Wiley declarations
T Twitter clients perform protocol
negotiation upon connection will
download
oh oh okay but I'm not sure the server
do you see what I mean
foreign
might only support
great so this just might not work
you see the problem
um
okay
between golang and python server okay
finagle Thrift
Source Main
all right it supports Java Scala and
Thrift
we did Ruby support for this but no one
has done JavaScript yet
oh
oh common source
oh this looks nice
deprecated
might still work
okay
all right we need Twitter we need we
need special
protocol
T finagle protocol
okay from
protocol
protocol
let's try this
protocol equals T finagle protocol
transport it's going to complain because
those generated files aren't there
uh from gen Twitter finagle
where's Jen
is Jen in here
well let's just see maybe there's an
updated version of this somewhere
man if I could pip install this I'll be
so happy
oh I have to upgrade protocol to finagle
oops Fitbit uses it
from Twitter comment RPC finagle
protocol
I say
Fitbit thriftcly
what
it looks like look at the requirements
of this
Twitter common RPC sick
oh you just gotta know where it is
why do I want the old version let's do
the latest
Twitter common RPC all right
um this looked useful
oh man I love what people do at work for
me
guys you have a programmers just about
getting other people to do your work for
you
do that you're winning whenever you're
doing work yourself you're losing
it's one of my uh Eric Raymond hacker
culture
here
I love I love this uh the hacker
attitude
uh
the world is full of fascinating
problems waiting to be solved no problem
should ever have to be solved twice
boredom and drudgery are evil freedom is
good attitude is no substitute for
confidence
shit man like
I love that I love that so much
all right why did that work
Twitter comment or RPC finagle
uh uh nine-year-old commit no
no nine-year-old commit no
no okay I understand I installed this
all right so is it just not in there
anymore
uh finagle
hmm okay wait maybe we do need
maybe we do need nine
Alexis Alex is calling give me a sec
we stream we're on stream
we heard yeah I gotta go I gotta I'm
gonna go back to streaming but you're
live right now and we're do getting the
finagles and the finatras we're doing
we're looking at Twitter's open source
code
I'm wearing my season's tweeting chair I
I was just gonna compliment you thank
you I call you when I'm done
thank you
okay
um maybe this version
transport not open okay okay that's a
that's exciting
you just need to
yeah okay we have to open the transport
okay so I think we do this oh t
transport T framed transport
I don't know what that means
oh
oh we have to open the transport okay
no same bug
um
but Twitter wouldn't lie to me like this
this has to work right
how is there no other search result for
that didn't I have it another window
this
here upgrade protocol to finagle
foreign
finagle protocol T binary protocol
upgraded
I don't get it this should work
adjusted frame length exceeds
why did they remove it
that's the worst part of this they
removed it
all right let the non-subscribers talk
for a bit
it's a Twitter okay so let's talk about
what we're doing I'll tell you what
we're doing for a minute
um the
the normal Apache Thrift isn't
compatible with uh uh Twitter's finagle
so we need our own
okay I mean maybe we need a t frame to
transport
not a buffer transport let's try that
already open
okay
you mean not open you can't tell me it's
both oh
I have another open there
how long is not to find well that's
exciting
this is because we're in Python uh new
which doesn't have Longs anymore
we'll just make that little change
oh shit
[Music]
jeez
yo let's go let's go what other number
should we multiply
oh yo how great is this
oh man
oh that that was that was very pleasant
all right let's try something really
hard like seven times eight I don't even
know I think the answer is 56 but yeah
56 and we even get it to print called
man
yo by the way by the way
all the haters I would love to see you
do that as fast as I did I would love to
see you not know this stuff and come in
and do this as fast as I did
sorry
so what we did was we wrote a micro
service
using finatra
we generated the the protocol
definitions using Scrooge oh let's see
maybe we even get some metrics let's see
if we get metrics
Matrix
oh yeah okay
let's see if we get some metrics about
like how many multiplies we did
oh man
now metrics are broken we don't need
metrics
uh admin HTTP Thrift Downstream clients
will it give me a client if I if I like
do lots of multiplies because we can
like put this multiply in a loop guys
oh we can make it multiply lots of
numbers
but actually just 56 over and over again
nope
keeps are not loaded what's the profile
process info
threads oh guys
our multiplier microservice has only 67
threads
incoming connections
utilities logging
please add a dependency pink
well we don't get any metrics oh oh
all right
uh
any any any questions
all right so yeah we we wrote a
service
um using Twitter's framework uh using
Twitter's microservice framework called
finagle um it's a thrift service Thrift
is a serialization format was it created
by Facebook
uh Apache Thrift
okay it was initially I was initially
released by Facebook Facebook was using
this when I worked there back in like
the early 2010s
um
so then we made a python Thrift client
uh to talk to the Apache uh no to talk
to the financial service
but
finatra is built on top of finagle and
finagle modified Thrift to add in a
bunch of metadata so it can't speak
normal Thrift anymore
but if you import Twitter common RPC
finagle protocol the T finagle protocol
and you use that as a protocol then you
create a multiplication service client
it's pretty fast want to see how fast it
is
guys
It Only Takes Two milliseconds to
multiply a number using our microservice
right so this is this is a micro service
and like it can even multiply larger
numbers like 7 times 80.
uh yeah all right any other questions
oh no no no no no no no no this this
this only supports integers I'm sorry uh
if you want a service to multiply
floating Point numbers that's going to
take us two weeks uh and it's gonna need
at least six Engineers okay two weeks
six Engineers we can have your
microservice that multiplies floating
Point numbers
2ms is absurdly slow yes
69 times 1 may very well be possible we
could probably even multiply 69 and 420.
um
no the the sort these sources are kind
of nice and actually this this framework
is pretty nice I don't mean to hate on
this framework when you're working with
a lot of people at scale you need stuff
like this you need like strongly typed
definitions between things
um and I look
my guess is when Elon talks about all
the microservices it's like this stuff
got out of hand almost because the
framework made it too easy to write
microservices right things that probably
should have been included in the program
themselves ended up becoming a
microservice because it's easier to
develop and ship your own microservice
than it is to add it to someone else's
code
when will tiny grad support the
microservices backend that's an
excellent question uh now that we have
multiply if we could just get like ad
and like a few other things the tiny
grad could totally support it
um
when you're dealing with lots of people
touching your code you need to have
types and lending rules yeah
uh
uh yeah I mean like types you see like
like way of enforcing types so strongly
you put them in different processes and
you don't really need to do this but you
see how it happens
um divide would be sick well you know
I'll leave that as an exercise to the
reader
um
well no it's not just not wanting to
understand the code base I don't think
it's an understanding problem I think
that when you end up getting a huge
explosion in number of microservices
it's because
procedurally it's easier to launch your
own microservice than to add it to
somebody else's because if you add it to
somebody else's you might break it you
know like you need permission whereas to
launch it it's
a lot easier
maybe the problem is having so many
people touch the code I mean yeah right
like I think this is the problem with a
lot of code bases programmers are going
to produce lines of code but lines of
code do not always translate to uh
functionality right it's not like having
more lines of code always gets you more
functionality a lot of times you'd end
up with just like layers of indirection
and abstraction and boilerplate that you
don't really need if one individual
could come in and just slice through it
all
um how does Twitter's microservice
framework deal with transactional
semantics over several calls
uh I didn't see much about that and it
didn't seem opinionated on that although
to be fair I don't fully understand what
finagle is and how it's different from
finatra so this here is called Twitter
server this is different
um finatra is the thing that's actually
like um
implementing sorry finagle is the thing
that's actually implementing the uh RPC
interface so I'm not that sure what
finatra is adding on top
um
there probably is some like stateful
stuff maybe
it doesn't
by allowing you to easily Define oh no
no no okay no no never mind never mind
this is this is okay now this is no
problem at all
um so what what fanatra gets you is is
this and you can see it more in my HTTP
example
um in my HTTP example here you see how
you can like break it out into like Ping
name and Foo that is finatra whereas
finagle is just handing handling the low
level uh like mechanics of http
I have no idea who's fired on Twitter
um
why not use node.js for a server I mean
you can look node's not going to scale
to like really huge things
uh
financials like the node.js syntax of
creating routes and controllers yeah
it's like the same as like flask as us
uh like flask
if you look you can set like routes and
flask
is probably what I'm most familiar with
all right like this kind of syntax
similar to this kind of syntax
why don't I write it in Rust dude look
man look we we could write it in go or
we could take five times longer and
write it in Rust what do you think
um whenever I I would recommend go for
like a microservices architecture yeah I
think that that's uh more modern choice
um Elixir is pretty good too based on
erlang some guy on Twitter was like
Twitter needs to stop using hipster
languages
um Elixir or like who uses erlang
who who uses this which like big
companies on this
um
you know what I'll say this too like
Facebook's PHP was very pleasant
actually
uh WhatsApp users are lying oh okay
if you want to feel based you compile
rust code you know a feeling is is just
a feeling Twitter should switch to C
plus plus I don't think that's a good
choice I don't think that's a good
choice
um sequence plus there's so many ways to
shoot yourself in the foot like this you
know there's so much see first of us has
so much syntax
uh go was oh wait oh man
I gotta find that like golang
uh go is for people too stupid to code
in C plus plus
oh yay
oh they're even they're even more brutal
the key Point here is our programmers
are googlers they're not researchers
they're typically young fresh out of
school probably learn Java maybe C or C
plus maybe python they're not capable of
understanding a brilliant language but
we want them to build good software
I mean he's right right and like you
know I want to remarkably condescending
philosophy great Hacker News you added a
lot to this right
um you know it doesn't matter how smart
you are right it's always easier to use
tools that are like
it's always easier to like use languages
that are better simpler no matter how
smart you are you can just keep more in
your head
uh what's the chance of Haskell getting
good yeah
look I wrote a compiler in Haskell once
um like I like the language there's a
lot to be said for it
but until they like stop catering until
they stop calling it a monad right if
instead of monad they called it
something like State container right
like now we're on the path to like oh
okay let's call these things like normal
right like
the multiple uses for a monad but these
things should be like called normal
programming terms not well if you
embedded in the third order type Theory
using homeomorphic encryption types uh
uh in a in a godal vector space right
like okay great
um
no I don't have ultrawide monitor this
is just the monitor on my 17-inch
MacBook
yeah a monad is a monoid in the category
of endo functors exactly yeah that's
that's that's the quote I was going for
I hope it can make me big
ah fam
that's today's stream that was fun
Twitter's uh
what I'll say I mean this is not a
secret but that stuff that I just went
through is a lot nicer than Twitter's
internal stuff
um I mean they're and this is always
true if you want to understand how a
company's stack works you should always
look at the open source stuff
um I should have done this I should have
done this before I came here I should I
should have I like when I was like
reading the engineering blog I should
have actually just said okay what are
they I guess you don't really know
what's important and I will say that
finagle Sinatra and Twitter server are
very important
um
I would use go I don't like Java I think
Java is incredibly verbose and I think
Java kind of exists to keep people
employed
um
I'm not going to go into specific
critiques of the Twitter code base uh
though there I do actually have specific
critiques I have no insight into any of
the other stuff
like like you know
this is a pre-twitter I heard a rumor
that like Elon manages people through
Twitter right and you just kind of like
oh well that's what do you want to post
it on Twitter so that's what we gotta do
uh you know I tried that a combo and I
told them all like you saw you see the
top tweet on uh
that's the wrong box
sorry
that must be very jarring for all of you
um
uh yeah I could go to twitter.com AI
but that's not coming I
uh
we yeah see I didn't tell no one had a
conversation about this you just posted
it on Twitter it's management through
Twitter man
um
can I post the code somewhere yeah I'll
pushes
and you don't want this shit ready
yourself let's do it I gotta like figure
out how to get ignore and stuff this is
junk
um
kubernetes is lame yeah but it's the
least lame of the other ones what you
want to use mesos and Aurora
uh
yeah what else was I gonna say about
punishment through Twitter oh yeah
commented oh yes yes yes yes
um by the way if you want to buy a comma
three uh until Monday this is the best
price it's going to be all year our new
website's really beautiful this is the
the moment of the stream where we shelf
a comma
yeah uh a whole bunch of people come
worked really hard on making a new
website I think it's really it's
beautiful it uses webflow it's very
responsive uh and we're doing Black
Friday sale so uh if you're gonna buy a
common three now it's your time to buy
it where's the Vape oh yo my new hobby
man let me get my vape all right thank
you all for watching my stream I
appreciate you all let's spread love
um
Let's uh
look
guys like I don't mean to be a terrible
person I don't need to be like oh these
are real people they lost their job guys
it's business okay like and that's one
of my favorite things about like America
right like America it's not Europe we we
have this attitude I don't know like
look I've I've never gotten fired
um but I've gotten rejects from job
interviews and like
uh I usually quit before I get fired I
mean that's one way to preempt getting
fired you're like you know you're fine I
quit all right and that's but you know
come on you can't take this stuff you
can't take the stuff to to like
seriously like you know
um and what I will say this in defense
of Elon his heart really is in the right
place
uh I would much rather have someone like
that
um than a faceless bureaucracy that that
nobody can interact with right and you
you know like and you know I'll say the
exact same thing in defense of Mark
Zuckerberg right
you know who Mark Zuckerberg is you
might disagree with him but at least
there's a Mark Zuckerberg there who runs
tick tock
right
we don't know
right like who really ran Twitter before
like no one knew right and that's
terrible that's terrible to zero another
thing another interesting thing I saw on
Twitter you know maybe you guys saw my
tweet where I was going after like you
know the problems in the culture and I
don't like uh mbas I really don't like
mbas I think they're they're the very
toxic way of thinking
um I think project managers have largely
exceeded the scope of their role uh it's
because the term managers is in there
and it should they should probably be
called like project coordinators or
something uh you know the sjws man
Cavani throw that out for Twitter bait
man you know
um but no it really is it really is the
founders it really is it's the founders
and the investors uh who created this
shitty culture for the last 10 years
um you know if you found a company and
your culture's shitty you are the only
person to blame for it unless you are
controlled by your investors and if you
are controlled by your investors you're
still to blame because you got yourself
in a bad position you just can't fix it
now uh so keep control of your companies
build good culture build awesome things
the next decade I think is going to be
Welcome. Can everybody
hear me?
Hello.
Turn off subscriber only.
Good morning. Good morning. Good
morning. Why does it not show me the
amount of views on chat?
Why does it not show me that?
First, first uh stream manager. This
will show me zero viewers. I don't want
it to
I don't have unlimited bandwidth.
Wait 20 seconds. Oh, for my viewers.
Yeah. Yeah. No, that's reasonable. But
uh no, what I want is
uh No.
Hello. Hello. Hello. Can you hear me?
Well, I got a new microphone. I'm in a
new spot.
Life's good, boys. Life's good.
What's up?
All right. I was thinking about how to
make cloud fast
and
I realized how to do it uh yesterday
and then we we'll we'll have the opening
rant. I also brought a uh triangle rice
triangle to eat on stream and I also
have a green tea. Uh you guys can't see
it but I have a beautiful OLED monitor
here. I'm not in San Diego. I'm in I'm
in Hong Kong.
Uh what is the topic today? We're going
to make cloud equals 1 fast. So we have
a device called cloud in tinyrad.
Um this is cloud and we're going to make
it fast and I realized
uh that I did uh
something wrong. Oh, we got the hype
train going. Yeah, hots for Doge. Yo, we
got we got a lot to talk about, but
let's just say the vibes are good. The
vibes are good. Uh, thank God for the
Trump victory. Oh, thank God for the
Trump victory. Wow. If if it's I'm not
going to stay in Asia. If it was if if
Camala won. Yeah, I'm staying in Asia.
Fuck that shit. Like, it's over.
America's the next Europe. But, um,
Trump won, Elon won, Joe Rogan won. Uh
yeah, the the the the boys won. Um my
favorite my favorite stat of all time is
that uh the Hispanic men voted for
Trump, right? And I hate that. I hate
that like racist shit, but like, oh, oh
shit, I thought illegal immigration
meant they were all going to come vote
for Democrats. Oh no, what if we're
importing Republicans, right? Like I I
can't I can't with these people. I can't
wait. Like like like we sent a
resounding victory against racism,
against sexism, against deep statism,
against bureaucracy. Oh my fucking god.
Like like oh wow. If this had gone it
just it just it just if this had gone
the other way. But what are you what are
you people even voting for, right? like
like you people are voting for a fake
managed candidate who didn't have a
primary who can't go on Rogan for 3
hours. If if that's what wins America,
if that level of stupid I thought
America I thought that level of
stupidity, you know, that's maybe was
where America was and maybe I was a
little miscalibrated. Maybe I I
underestimated my fellow You guys know
how much I love America, right? You guys
know how much I love America. Um
ah yo
uh no, it's it's so
especially you know just just in the
last week just in the last week the way
things have shaped up. I really I really
hate when Trump, you know, like
uh just just like like when he just
attacks people or when he whines like,
"Bro, you're president of the United
States. You won. Okay, now it's time to
be the adults in the room." I I look
Elon Elon will be remembered as one of
the greatest men of this time. Like,
like he'll he's a legend. He's a legend
in history. Um,
all right. So, you know, let's just say
the vibes are a lot better and I'm going
to go back to America. Uh, I'm not going
to I'm not staying in Asia. Um, move
Kama to Texas. Look, I mean, that's a
question I I'm not That's a question for
the comma people, right? They're they're
they're smart people. Uh, we voted to
move down to San Diego. If they want to
vote to move somewhere else, we could
uh, you know, we could have that vote.
Um but no I think I think even uh I
think even California
uh a lot of the I saw which propositions
passed in California. Oh normalies
returning. Oh my god. There's there's a
whole set of of of people who I never
ever want to see anywhere near politics
again. Right. They're absolute clowns.
They will drive the country into
poverty. um they will you know
you cannot be I understand not wanting
to like you you you can't you can't you
can't be on the fence about whether
crime should be illegal, right? Anybody
who's on the fence about whether crime
should be illegal should never be in
charge of anything. Are you fucking
kidding me? Well, I don't know. Maybe
crime should be le No, it shouldn't.
Um,
no. I don't support the mass
deportation.
It's not even It's You know what? We
need a mass deportation. We need a mass
deportation of bureaucrats from
Washington, right? The guy who crossed
the border cuz he wants to make some
money. As long as he's not using
government, uh, as long as he's not
using welfare, I don't care, man. Why
should we care? Why? Why? Why should we
care? Oh, he's taking American jobs.
I hate those people, too. Uh, so you
know, what a what a victory. What a
victory. Um,
you know, and also here here's another
thing. I voted for Trump in 2016. I've
never said that on stream. Uh, I've told
that to some of my friends. People have
gotten mad at me for saying that. I
voted for Trump in 2016. And I think
we're in a world now where uh you can
say that.
Uh, so
you know,
I voted 16 and never again. I'm with
you. I'm with you. I didn't vote in 20.
I just I didn't vote I didn't vote in
20. I'm like, this is this is I don't
know. I don't know. You guys are both
clowns. Uh, but I, you know, it's just
just the the the the And I never want to
see there's a whole class of Republicans
I never want to see in politics again.
Mitch McConnell, never want to see them.
like like Mitch McConnell and Nancy
Pelosi should be moved into a retirement
home somewhere and we should never have
to hear from either of them again. Uh
that would be that would be a great
victory. Uh Ted I'm over Ted Cruz, too.
Uh yeah. Yeah. All these all these all
these all these like lifetime
congressional
Oh wow. Look, look, I don't actually
know if things are going to uh get
better. I don't know what's going to be
fixed electorally. I I
you know, it's uh but what I do know is
the the cultural the the the cultural
rejection
of it's not leftism, okay? It's not it's
not it's not leftism. It's not
it's like nanny statism,
right? The cultural rejection of saying
no, no, no, no, we do not want to be
ruled by our betters. We do not want to
be condescended to. Uh because the level
the level of of condescension was was
insane. White dudes for Harris. You
watch any of this stuff? The level of
complete condescension.
Uh
you know, I saw I saw a ESR tweet. Uh
you guys know ESR, Eric Raymond. He's a
old school open source guy. He wrote the
questions document. Uh he had a tweet
that I liked and it said um the only
thing that I really look for in a
politician is is is gun rights. Gun
rights are a major proxy for me, more so
than free speech, more so than anything
else, because fundamentally the people
who want to, and I don't own guns. I I'm
not I'm not shotguns. I like guns. I
certainly support other people's right
to own guns, but I'm not, you know, big
into into owning guns. But
fundamentally, if you do not believe
that your citizenry can own guns, then
you're saying that you are their rulers.
You're saying that you as the ruling
class because obviously the ruling class
has guns, right? Uh you are are the
anointed ones. You are are the uh you
know the the the special privileged. No,
no, no, no, no, no. You trust the
citizenry with guns or you know we
don't. The American project is over. Uh
so you know based founders based Elon.
Uh and I've liked
Trump has Trump has his good and his
bad. Uh, I've liked his Red Alert style
videos on Twitter, you know, talking
about how we gotta how we gota how we
got to end homelessness. Uh, you know,
you know, there's a lot of stuff.
There's a lot of stuff that I I wish I
wish Trump would uh, you know, really
extend an olive branch on uh, the the
trans stuff, the abortion stuff. Like,
come on. Come on. Stop trying to stop
trying to restrict other people's
freedoms, right? These aren't unless
what you're restricting their freedoms
for doing is crime because no, you're
not free to do crime. I'm sorry. Crime
should be illegal. I know. I know that's
a controversial position, but you know
what? It's not a controversial position
every anymore. Um, it turns out it's
just Europe that's fucked. America is uh
is coming back strong. And uh yeah, I'm
uh I'm going to uh going to go back when
my my tour in Asia is done.
Uh,
Democrats are horrible. No, I it's
it's not there's horrible Democrats and
there's horrible Republicans. There the
the horrible people are the people who
see themselves as a ruling class who who
see themselves as as your as your as
your better as your I'm I'm I'm the uh I
went to college and I got a degree and
therefore I know better than these
people. Right? It's that attitude. It's
the condescension.
Um
the first thing you hear is Europe is
fucked.
Uh, yeah. I'm happy I don't live in
Europe. I I think that there's Can it be
fixed? Sure. Vote for Vote for the
Donald Trumps of Europe. I'm sure you
guys got some. Um, but not not like we
don't want like these hardliner
rightwinger,
you know, we can have a big tent, a big
a big tent. And that's why that's why my
favorite statistics from the uh the
Trump election just to engage with the
left on their level is uh Latino men and
Native Americans voted for Trump. So,
you know, land acknowledgement bitches.
Uh,
the Native Americans voted for like like
you can't uh you know,
I just just Yeah, the the the the DEI
the vocism. It is it is over. Uh we are
free. Uh and uh
yeah, no, I think there's a lot of work
to be done, but I think now at least
like we're not we're not disagreeing
over whether crime should be illegal or
whether we should, you know, disband
America and give it back, right?
I you got that level of lunacy, right?
These people genuinely do hate America,
right? Like there's people out there who
genuinely they hate America. And you
shouldn't be You can hate America.
That's a great thing about America, but
you shouldn't be anywhere near any
levers of power if you have that
attitude. Uh, you know, I I want the top
America lovers to run America. Uh, you
know, people who who not not not who
don't apologize. Oh, America was was
stolen from from British people. You
know, we stole America from the British.
That's right. That's right. We did. Uh,
yeah.
This this this place used to be called
um York, but now it's called New New
York. That's right. That's right.
British.
Um,
yeah. Uh, so no, look, I I I I lost I
lost the plot. I lost the faith there
for a little bit. I lost the faith there
for a little bit. I think that that uh
you know, I I started to like the left's
like just just the the constant racist
shit got into my head. Um I hate the
racist shit. Everybody wants the same
things. They want a nice country, nice
rich country where people work hard
and uh you know hard work pays, crime
doesn't pay
uh and you believe in these you believe
in these values. You want to produce
more than you consume. Uh I think
everyone with that attitude should be
wealth in America. So, you know, the
caveats, my my biggest caveat about
Trump is you have to the immigration.
You have to let in high-skilled
immigrants. High-skilled immigrants are
the reason America is rich. And we all
love being rich. Okay, we love being
rich. That's that's another one. If you
love being poor, oh man, you shouldn't
be you shouldn't be near any uh levers
of power.
Um,
so, uh,
oh, please not stop stealing smart
people. Yes. America, continue to brain
drain the world. Yes. Yes. Uh, the
Perplexity CEO didn't get a green card.
You see that shit? That's offensive.
That's offensive. Uh wh why the hell
would you not
uh he's got no issue with legal
immigration? No, no, no. Look, look,
look, look, look. And I'm all for
closing the border. I'm a actually one
of the things I loved about Trump in
2016 was the wall. I love everything
about the wall, okay? And not because
the wall is like a like like, you know,
again, I think a lot of these people are
economic migrants. I think we should let
98% of them in. Uh but you have to
physically control your borders.
Like you you this is the the job of a
state, right? And also the wall would be
a great great way to make work for
Americans, you know, of all the stupid
make work projects in government. At
least we could build a wall. Turns out
turns out we can't. Um
uh
Triple XD CEO is is still waiting. Yeah,
this this kind of bullshit. Like why why
why
does that guy not immediately like I
also don't understand why other
countries aren't more aggressive about
this, right? Like I looked into, you
know, what what Hong Kong stuff was and
it wasn't it's not like like easy and it
should be dead easy, right? It should be
dead easy. Green cards are, but at least
for work visas,
anybody who can produce more than they
consume should be given a work visa to
work in the country.
Uh, do you need skilled immigrants when
you have AGI?
Yeah.
Do do you do you need airplanes when you
have teleportation?
Um, I fled to the commies. Typical
Jersey move.
Uh,
should NASA exist? What do you mean?
Yeah, I think what? Funding funding the
colonization of Mars? Putting an
American flag on Mars. Hell yeah, I want
my tax dollars to go to that. What do I
not want my tax dollars to go to? We
have to save the the the the the
indigenous seals of the Manicopa region,
and it's going to cost us $300 million a
seal. Like, no. No, no, no, no, no, no,
no. Mars. Mars. Our big American flag on
on Mars, a city. You know, you know my
take on Mars, right? I want to go to
Mars once we have fivestar hotels on
Mars, right? So, someone's got to build
those fivestar hotels, right? And if
it's immigrants, that's the best, right?
We'd love Let's get some immigrants to
Mars to build fivestar hotels, right?
Big tent. Um, but yeah, no, it's uh
thank God. Thank God for not just the
Trump victory, but the other thing that
I really didn't want to be in America
for was like Trump wins by one state and
like
hanging child. No, I don't want to be
there for that, right? Like who wants to
be around for that kind of shit? No.
Resounding Trump victory. Um to quote to
quote Sarah Lynn, suck a dick, dumb
shits. Let's get to coding.
No, she was
this wasn't like like you know Joe Biden
has got a problem with Joe Biden. Camala
was
she couldn't talk on if if it should be
immediately disqualifying if a candidate
can't go unbroken, right? That should
just be what? and and you're going to
you can't talk for three hours on a
podcast to your constituents, but you're
going to talk to uh Vladimir Putin.
Come on.
Come on.
Uh what what are these? What are these?
Uh
we unburdened by what could have been.
All right. All right. All right. You
know what? But it's not. And also,
here's the other thing. Here's the other
thing. I'm not saying everyone who voted
for Kamala is a bad person. I I totally
get like a lot of reasons why I uh you
know, not everyone loves Donald Trump
for for all sorts of reasons. I know a
lot of Camala voters.
Yeah. Like like I I I get it. Um,
I think that no one was particularly
happy uh with the candidates. I would
have been much happier to vote for
straight up vote for Elon instead of
voting for Trump. Uh, but the Trump I've
seen he was restrained in his victory.
He's he's he's yeah, you know, I always
hoped I always hoped in in 2016, I think
some of the the my favorite Trump stuff
from 2016 was when he was uh making fun
of Jeb Bush.
You know, I grew up I grew up, you know,
you grow up, you grow up, I hated George
Bush. I hated the Iraq war. that whole
that whole uh you know if you if you
look at if you look at Glenn Greenwald
right like that guy has tracked uh you
know the kind of the kind of politics uh
I have the kind of like like if you
think of like the more left-sided
politics it's like uh you know I like I
like Glenn Greenwald and you know just
being against being against uh
surveillance state being against foreign
wars you know come on I'm wearing a
shirt that says Institute of Crypto
Anarchy you can you can guess you can
guess what
Um,
uh, I like JD Vance. Uh, certainly a lot
better than Mike Pence. Certainly better
than Mike Pence. Uh,
I mean, I like this tweet about AI. You
know, look, you know, you never know
with these people. I haven't, uh, spent
a ton of time going into it. This is not
a this is not a full endorsement. And
you know, even someone you fully
endorse, they might say something that's
like like I think I pretty fully endorse
Elon, but even he might say something I
think that's stupid actually, right? You
always got to be thinking, right? You
always got to you always got to have
your own opinions. But yeah, no, I'm
going to go back to America and uh I'm
going to figure out where in America and
uh yeah, we're going to uh make America
great again. And I'm sorry for ever
losing the faith. Uh I believe in
America. I You guys know how much I love
America, right? I love America so much.
All right, let's see. Let's see. Let's
see the triangle and let's get to
coding. Uh I'm glad that the Santis is
the next president. Yeah, I I don't know
that much about him, but like
I I don't want these old guard
Republicans either. Definitely not a
Republican, right? What am I like? Oh,
yes. Oh. Oh, yes. Liz Cheney. Oh, Liz
Cheney supports Camala. Wow. That's even
more reason that I hate Camala, right?
Oh, yes. Yes. Dick Cheney. Yes.
Are you kidding? It was worse than push.
Oh yeah, yeah, yeah, yeah. That's that's
the most important thing to watch.
I don't know that much about Mike Pompe.
I don't really like follow politics that
much. Um I couldn't tell you like who
all these people really were. Um but I I
want to see all actually I loved an RFK
proposal.
um move the it's very hard to dismantle
um like a bureaucratic institution, but
you can move it, right? Just like move
it out of DC. Take take like like I'm
fine. You know, you you can't you can't
dismantle like um the you can't shut the
Department of Education down. You know,
I think that one should be shut down,
but if you can't shut it down, why don't
you move it to Oklahoma? Right. Oklahoma
Department of Education. Um the the I
think 92% of the DC district voted for
Camala, right? Like way more of a
landslide than anywhere else. Um you
know, San Diego's close, Orange County
went Trump.
Um
but but all of these all of these
government agencies just move them out
of DC.
Uh, I love it
because
remember that your fight is not with a
Camala supporter, a leftist, anyone, you
know, that's not who your fight's with.
Your fight is with an unelected
um,
bureaucrat class that spends your tax
dollars, takes your tax dollars, and is
unelected. And these people need to go.
These people need to be removed from
government. And uh let's see how much
Trump succeeds at that. You know,
there's a lot of I'm sure I'm sure we'll
all find reasons to be upset after four
years, but I love that Elon's keeping
his eye on the prize, too. Uh this
entire bureaucrat class needs to be um
retired. Retired. I love the the
two-year severance. This is straight
This is straight out of Curtis. Give
these people a nice a nice severance and
just uh yeah, you know, go go go do
pottery somewhere. Yes, pottery would be
perfect for you.
Um, oh, I like you don't like I like
Trump and Elon are bureaucrats.
say a lot of things about him, but I
don't think they're bureaucrats.
Sam
um
there's nothing wrong with oligarchy as
long as the oligarchy is competent.
There's nothing wrong with monarchy as
long as the monarch is competent.
There's nothing wrong with democracy as
long as the electorate is competent.
Right? It's not about the system of
government. It's about the competency.
It's about the ability of the
uh the people to successfully deploy
capital. Right? Elon is the best capital
deployer in the world.
Um you you want people like that
deploying the government capital and be
that capital um money or personnel or
resources or anything. You want that
stuff to be efficiently deployed such
that you get a return on that and that
is how you live in a rich country,
right? And just analyze everything
through that lens, right? You know, I
don't I'm not a fan of like charity. I
think charity is pretty stupid. I think
the greatest charity is business, right?
Because imagine you could give a million
dollars to uh a cause or you could take
that million dollars and start a company
for that cause and then you could funnel
$100,000 into that cause every year,
right? And then in in 20 years you've
given twice as much.
Um
oh, no one even talks about the
mainstream media anymore, right? There's
another
uh Yeah, but no, the the the death of
I've been reading Reddit. Here's another
here's another great like go read you
can go read Reddit and they're like why
didn't anyone tell us why didn't anyone
tell us you know they supported Trump?
No one here is saying they support
Trump. Yeah, cuz you banned everyone who
said that.
No, I hope I hope the racism thing is
really just gone.
Hispanic men voted Trump. Native
Americans voted Trump. Okay, now can we
stop dividing people along those lines?
Can we stop?
I love the Morgan Freeman. You want to
end racism? Stop talking about it.
And on the stop talking about it, we are
going to put subscriber only chat on it.
And if you'd like to speak, you can
subscribe. Woo.
Okay. So, what I realized was that
all of this stuff doesn't actually have
to run in uh real time.
We can just cue them all up.
Um,
so
let's get a little loop going here.
Cloud equals one. Python test tiny.
So you see all those requests now is
going through the is going through the
cloud. Um, so I built this cloud on
another stream.
Um you can go you can go read the stream
where I built it and these are the basic
uh so these are the devices in tiny
graph over here right this is like the
clang device right you can see clang
device clang program clang compiler the
buffer in clang it's just malik so it
uses this thing called malik allocator
here which is just you know malo
look at something like cuda right here's
cuda here's the cuda allocator right set
the context do the cuda API blah blah
blah blah then we have the cloud And
cloud is just like an abstraction layer,
right? So it puts the real device on the
other side and it puts um it puts
uh
uh the
puts the real device on a HTTP server
and then the uh tiny red front end
becomes a HTTP client. So what I
realized when I was walking yesterday is
that we don't want to make all these
requests because the problem with making
all these requests is I'm in Hong Kong.
If I want to talk to a tiny box, um,
is it some tiny box at AI?
Well, so this is here we sh tiny box,
right? So this is a tiny box. You can
you can see the latency and it's about
200 milliseconds round trip. So it's
about 200 milliseconds, right? Ass.
Um, so every one of these things is
unfortunately a round trip.
Um, but instead, let's just start
queuing them all up
because the only one that actually
matters is copy out.
or if we're running with uh
debug equals
two.
So what if I actually just straight up
what if I straight up just cue them up?
What if I just what if I just leave this
all intact
but just instead of actually doing the
request only do the request if it's a
copy if it's a get buffer request
those are gets
okay I think all the non-get requests I
think we can pen
Oh. Oh, also um
fire song boys.
Why is this complicated?
gap there. Any other not
How do we encode data in JSON?
This is going to involve a whole rewrite
of this, but you see what I'm trying to
do here. So, right now, it's making all
these requests, but the only request
that it really has to make is these get
requests.
Um
sometime when we post to a program we
also return a time
but only if uh
only if r is not n here.
So that's another thing that we'll need
in in real time. Uh and that's a post
that we're going to need in real time.
Okay, whatever.
Let's
think this through.
[Music]
Okay, let's just let's just redirect
this. So, what can I do for Alec here?
Um, oh then also part of the problem is
we have to track we have like shared
state between the buffer and the uh
so right now I have the post to Alec
returning an integer and that integer
represents the buffer. Um, We're not
going to have that anymore. Or we'll
have to better yet, we'll have to
specify that integer here,
which is fine.
I'll just have to be tracked with the
session. What's the session
called? Cookie.
Shouldn't call it cookie. That's a bad
[Music]
offer number Should be nice.
They want an enome
something like actions enum. Okay. Are
we are we
we're doing HTTP pipelining
actually? No, I mean we have to change
the API sufficiently because like if you
post this ALEC and then like you have to
know which buffer number. So we have to
move the buffer number allocation
to uh
the client.
Does does everyone kind of
understand this? Is this Is this
See how many people we got.
295 viewers.
Where's everybody?
We could do it like this.
Okay. So, we can't use pickle because
pickle's insecure.
What's like what's the best There's got
to be just like normal ways to define
this kind of stuff, right?
What's the best way to do it?
Python
JSON API.
That's
something like paidantic.
No, I have to what? I have to download
this.
This is I have to I had to uh you see it
was bad. I have to uh
All right. It seems like data class has
asked.
So what happens if I actually do that?
So the problem is this doesn't actually
include the class type
which is kind of annoying.
Has the same problem too.
runtime type checking and validation
also like okay so what if I do this and
then I do like what if I have like a top
or like a list
it should be called a data class
instance okay this is like kind of
useless
I guess I could make a data class called
Q.
Well, I'm trying to like make like an
API, right?
Like it doesn't serialize and
so what if I make a new data class
and two users
uh A user B user
Sounds
like that's the string I want.
How do I evaluate that?
And also what if I have bytes?
Okay, I'm trying to make an API, right?
So I'm trying to make like a like an API
for uh I know I can use rapper. I can
use the string as well, but uh like we
have to see how this works.
So, what if I make a bit with like, you
know, something like
there's like a safe eval Python, right?
drift data class. I know the answer is
no, but I'm curious what it will say.
No. Okay. So, I wanted to define classes
that look like like let's say
um
pedantic can't even do what I want. Um,
also like this is a really inefficient
encoding for binary data. I need a more
efficient encoding for binary data than
that.
Um,
what does JSON do when I do that?
That's even worse.
You see that's so inefficient.
log into that kind of shit. I don't want
any of that.
Um,
binary data encoding in JSON
need B for bytes.
Oh, I see.
Object of type bytes is not JSON
serializable.
This is also something I have to pick
install.
[Music]
Yeah. But is Seabore built into Python?
Yeah.
Does anyone still use Marshall?
Is Marshall secure?
Okay.
Oh, it's not secure.
Oh, it can be used to execute arbitrary
code. Damn it.
Chains on.
Okay,
we're okay. I have an idea.
All All right. The only place where we
actually use this
we use get data.
I think maybe we should just include all
the hashes of everything and then start
with the uh
the the hash lookup and then I'll just
write a quick custom format for that.
um
just like the hash length and the object
hashlength object hashlength object
that's that's going to be quick and we
can use JSON for everything and we'll
just specify the uh the hashes of object
as strings because that's I mean that's
eventually
uh where we want to get to with all of
this.
All right, we want we want everything to
pretty much just be uh identified by a
hash. programs already identified by
ash.
So let's do that. Um I have a class
called buffer option.
I can just get here
tonight. Let's do shit
plus some cringe comps.
D is that
data class.
I see the value of uh pantics runtime
type checking.
Right. So here's kind of what I'm
thinking. Something like from data
classes import data class
uh buffer alec.
Oh, I need a decorator. Really?
That's kind of interesting actually.
Is that hallucination?
I can't find anything decorator
data class
true.
Um okay,
we have size and buffer options.
Oh, and we should also have um
buffer
I want it to look something like
self
device
options.
allocator.
Alligator.
device
for free.
Okay.
So we'll like register things for the
hash right
self.h
cash return.
I will delete them from
All right.
Making good progress here.
So then my copy in becomes uh
self.device.q
We'll say
in
we'll say hash
call
data hash
number
and we sell that device.
So the buffer number is guest and the
hash is by
later. Okay,
cool.
Now,
You should probably all inherit from
something
that um that's wrong. Copy in here. You
guys should pay attention.
Copy in
subq.
out
source. Um,
now here there should only ever be one
copy out. So here we can do self.device
drain.
[Music]
self device.
All right.
Okay. Um,
programic.
Do I just need a data hash?
I might just need a data hash.
Oh, I need a name, too.
Yeah.
That just can't be the way. That has to
be self.
It's like segment. You don't know.
[Music]
We just need 10.
Oh,
okay.
And then
We're grabbing Zack
What else?
Optional couple.
Wait. Tiny grad and the H100 is
comparable performance to torch.
I have never run anything on an H100 in
my life.
Uh, I don't like cl, you know. I don't
like clouds. They're only in the clouds.
Can't afford one of those.
Data hash
string.
I don't know. Camala talked about cloud.
What did she say?
I mean, you know, AWS is is really a
fine solution, but Azure just gives you
larger free money. Google Cloud is very
stingy with the free money and that is
why I go with Azure, Microsoft, a good
American company.
Is that what she said?
Oh, the data goes into the sky. That
that sounds more like Camala.
Uh
and then we'll say if wait we do float
of data device.
Okay, cool.
All right. You like my little You like
my little uh
little thing?
The data goes up into the sky and then
she pointed up the cloud.
Okay. Um so I guess we're going to just
have one method here called drain.
[Music]
Then we have to encode.
So I think we just do wrapper self.q.
All right. All right. All right. Well,
watch the Camala cloud
clip.
Those private files in some file cabinet
that's locked in the basement of the
house. It's on your laptop and it's then
therefore up here in this cloud that
exists above us, right? It's no longer
in a physical place.
If you like truthful news and
So you're now no longer are you
necessarily keeping those private files
in some file cabinet that's locked in
the basement of the house. It's on your
laptop and it's then therefore up here
in this cloud that exists above us,
right? It's no longer in a physical
place.
[Music]
It all makes sense now, right?
Uh, no. Like, like I said, I think one
of the greatest things about the
resounding Trump victory is that
I think, let's not gloat, but I think
people can be open in in talking about
this. Uh,
I I support Donald Trump for president.
I am not a racist or a sexist. You can
try to call me those things. I don't
agree with you. You can call me whatever
you want. I don't agree with you. Uh, I
voted for Donald Trump because I think
that living in a rich country is a lot
better than living in a socialist shit
hole.
Um,
where you have bureaucrats.
Uh, there was a good clip I liked on
Twitter. They they they replace the word
uh democracy with bureaucracy. You know,
they're Republicans. They're they're
running with open contempt for American
bureaucracy. They're they're they're
going to they're going to be an end to
bureaucracy and they're gleeful about
it. Exactly. Exactly.
Uh oh. And the hypocrisy of uh that that
that uh Trump is going to somehow end
democracy
when these people literally tried to
imprison. They they they tried to lock
him up. I think one of the things that I
love that Trump did in 2016 was after he
won, he said, "We're not going to lock
Hillary up, right? Come on. You have
some, you know, have some have some uh
have some decency."
Um,
no, just a small number. They they
really the Reddit people were like
like
if if you think everyone who supports
Donald Trump is fascist,
you live in some deep echo chamber
somewhere,
right? It's it's normal. The the what is
normal has shifted. The the Overton
window has shifted. Um,
and now if you support
Oh, it's a little I mean it's okay, you
know, it's a little weird. It's a little
weird if you if you support, you know,
DEI and racism. It's a little weird.
Nothing wrong. It's just a little weird,
you know.
You want You know what? And you know,
it's my it's my advice to the Republican
party. You guys want unity? Pass a
constitutional amendment for abortion.
You know, that that'd be the
like like if they did that, you know,
that's that's unity. And what what do
you care? What do you care? You know
what? You don't you don't you don't want
an abortion, don't get one. You don't
want a gun, don't get one.
You don't you don't want you don't want
trans surgery, don't get it. Right?
That's great. You got to support other
people's freedom to do other things. You
know, you got to support people's
freedom because at the end of the day,
freedom is a belief that should bring
people together, right? You have freedom
to do what you want. I have freedom to
do what I want. And we can want
different things, but we can respect
each other's freedom. And that's just
just we can all respect freedom, right?
And you know, I I really another another
the view that should be so far beyond
the pale is is uh being against free
speech or or being forced censorship.
Are you kidding?
Like
you know everyone Oh, censorship,
censorship, censorship.
You want to censor the views you don't
like, but do you want them censoring
your views? Right? Can we all just agree
to this beautiful nash equilibrium of
free speech for everybody?
Oh, but but but that's not free speech.
That's hate speech.
There's no such thing as hate speech.
There's this isn't real. This isn't
real. It's a marketing term.
But he said that and he hates those
people. Okay, he can hate those people.
That's okay. Can't be violent against
them. Can't do crime because that's
illegal. He can say what he wants and
that's free speech.
Um, America really does have some of the
best uh free speech laws in the world.
Uh, and there there's been, you know, a
lot of it's important that people stay
very vigilant about them, but America
has this thing called the Brandenburg
test. uh you know and and pretty much
you have unrestricted free speech in
America up until it leads to imminent
violence uh which yeah I mean there
should be some line
um
but that's the line
causes imminent violence
right not well I hate these people I
hate these people okay you can hate
those people that's okay that's okay you
keep you keep that hate you can talk
about it you can get together with other
people who hate those people, you can't
do anything, right? Cuz that crosses the
line.
See?
All right, everyone. Hopefully,
everyone's on the same page. Hopefully,
no one here believes in hate speech
believes that this is a real thing.
South Park South Park has the best. Uh,
the South Park hate crime episode is
great.
Well, well, but you see, he did that
crime because he hates that person.
Wait, isn't that why everyone does every
crime?
I murdered her because I loved her.
All right, back to back to cloud equals
one.
Um,
let's just focus on one test. Test tiny
test plus. I I wrote test tiny. I'm very
happy with test tiny. Um,
okay. So renderer is still going to be
sent. I don't think we're getting rid of
send.
Oh, I didn't print it.
Okay. So, does this look like a
reasonable set of instructions?
Freedom equals one freedom.
I finished my my CV triangle. It's gone.
I did.
Uh eventually this API can be shared
with other things. I hope.
used for security.
What is
What does that flag do? I'm sorry. I'm
too curious.
Oh, bureaucracy.
Wait, this is this is literally
bureaucracy.
What sort of you say used for security
equals true with MD5 it
complains our devices globally
instantiated? Yeah.
Uh all right. So we're going to need to
upload the hashes.
Um,
do this
something like
Maybe I can do instead of doing that.
Doesn't
that work?
How does that work?
Unbound. I set it right there.
I should just wear a hat.
Okay, that look good.
Um
then we can do something like
Oh yeah. Come on. Is that beautiful or
what?
unelectable. Sounds like you won the
election.
Take it up at the Supreme Court.
It's cute, right?
That work
that over there work then
that executes before that.
Okay, so we just need to support the
bulk method now and we can also delete
support for a lot of the other methods.
All right, so let's first move this API.
You like this API? It's a lot of lines.
I know.
Dream.
I I'll I'll engage with that for a
minute because I I shouldn't be like,
you know, uh you know, uh like screw
you, Trump's president. That's like a
bad vibe. Um I think the real response
to that is
half of America elected him. Everyone's
aware of that. Is this his finest
moment? No. I thought he was such a sore
loser in 2020, right? And he lost for a
lot of good reasons. I didn't vote for
him. I was mad that uh you know that I
couldn't uh I had a bunch of people
waiting on visas and Trump canceled
them. Uh you know, I don't like that. Uh
and then I think he was a sore loser
about the whole thing. He lost the
election. Um
but okay,
you have that on one hand
and then you have a bureaucratic elected
unelected machine on the other hand. I
don't know.
I'll choose the guy who's got who's a
bit of a sore loser over the uh
bureaucratic unelected, you know, he's a
bit of a sore loser, but he speaks his
mind. He's being honest, right? There's
no there's no secret guy behind Trump.
Uh there's no there's no secret team
behind Trump, you know, and I respect
that. I think that a lot of people uh
across companies too, the secret team
stuff needs to go. I think one of the
coolest things Elon says is go on X,
right? Like like like CEOs of companies
should be on X
because that's like where the
conversation's happening. And again, I
agree with this like nobody wants the
era of these these hiding bureaucrats is
is over.
Everyone wants someone who's just out
there speaking their mind, right? And if
you can't speak your mind, if you can't
if you can't go on roan, if you can't
speak your mind,
you shouldn't be the leader of a
country. You shouldn't be the leader of
a company. You got to be able to speak.
That's your job, right? That's half of
most of what you do is just is just
words. Just being able to, you know,
communicate clearly and and do, you
know,
So yes, the era of the bureaucrat is
over. The era of the
uh you know, you don't have to be a you
don't have to be a shit poster. You
don't have to
uh
let's unpack the H.
Should
we check the ashes?
I never
was a shot at 56 hash.
What?
All right, nonsubscribers. Do you have
anything reasonable to say? We talk a
little bit.
We got we got to parse this.
Uh they're hex 20. No, don't have
anything reasonable to say.
Okay. So we have that's a pointer plus
Chad is sleeping today.
It feels just so clunky, you know?
Okay, we got four. Why are we going to
the slash drain drain?
Why didn't I endorse Trump sooner? I
posted about it the the day before the
election.
Uh,
you know, I have a lot of there's a lot
of caveats, right? I I don't,
you know, love Donald Trump. Uh, this
isn't like,
you know, had it been like a
VC kind of candidate or even a JD van. I
don't know. JD Vance has some caveats,
too, right? Like there's always caveats,
right? Not, you know, I'm a uh it
definitely wasn't like towing the line.
And it's just like it's kind of
controversial, right? And I don't want
to be controversial
um about stuff like that. I have very
very middle of the road opinions on
politics.
Um
you know, and like this isn't a
fullthroated endorsement, right? Like
you want my fullthroated endorsement? I
endorse economists, right? I'd like to
see Robin Hansen,
uh, you know, Brian Kaplan. I'd like to
see these people have power,
right? You want you want a more a more
Democratic I don't I don't know if
they're Democrats or Republicans. Scott
Alexander, the these are these are the
people who I who I fully endorse who I
fully endorse for power and Elon. And I
did I did I tweeted months ago, you
know, endorsing Elon for uh for Doge. Um
because I do I do I do
wholeheartedly endorse Elon
uh and and believe that what he's doing
is
unequivocally good for humanity.
Um,
no. I think that you again, if if we're
if we're at a place now, if we're at a
place where we can get rid of if we can
move past, you know, people who just
like like like like can we not can we
can we move crime being legal so far
outside the Overton window we never have
to talk about it? And then can we maybe
have two political parties where one is
more protectionist supporting things
like tariffs and immigration
restrictions and one is more open which
supports you know free trade and and
lack of immigr like like that now now
we're having a real political debate
right like we we can have an honest
political debate about whether we think
tariffs are good for America or not. Um,
right. That would imagine that's the
debate. Imagine the debate was was was
at that level where it's like, what are
tariffs actually going to do for
America? I'm not sure we know. I'm not,
you know, if you if you ask me, I'm 70%
against them, but I'm open to having my
mind changed.
Do I feel Elon starting to become the
Ministry of Propaganda for Trump? No. I
think Elon,
we we had a we had a we had a uh
No, this is personal. I don't talk to
you about that. Um I understand what
he's doing. I respect it and uh
I think that we can get good results
because of it. I think that it shows
where Elon's model of the world more
accurately reflects reality than mine.
Uh,
do I think there's free speech on X? No.
Uh, no, definitely not. Um, do I think
what's important to me is not
necessarily that a single platform has
free speech. I don't feel that it's the
platforms
uh right this is free speech just says
the government won't interfere uh you
know with you I don't think that if you
run a social media platform you should
have to have free speech right there is
no free speech in the tiny grat discord
if if you if you say something stupid I
just ban you right like if you say
something that's even just like like
like like dumb or or or noobish you just
get banned right there's no free speech
um but you know it's it's a Discord you
can get kicked out of a Discord you can
get kicked off X you get kicked off
Facebook. The problem is when all of the
social media uh companies coordinate
coordinate to suppress certain
narratives and not others. So no, I
don't think there's free speech on X,
but I think that when you have an
overlap, when you have when you think of
the the the speech allowed on X, the
speech allowed on Facebook, the speech
allowed on Discord, right? It's
important that there's good overlap of
the entire speech space.
Um, you know, yeah.
Do you think two gay frogs can make a
baby frog? This guy's a subscriber.
Uh, fighting inflation is too important
at this point for tariffs. I look again
I I would have to spend if you if you
told me that it's my job to figure out
whether tariffs are coming to America or
not, I would spend, you know, 50 hours
doing research and probably get to the
bottom of what tariffs are going to do
and then deciding whether we want it or
not. Um
yeah, what exception to spe free speech
should there be? Pretty much what the
American exception is. uh imminent call
to violence and that's it. Other than
that, there's no such thing as as hate
speech. There's no such thing as well,
there's misinformation, sure, but like
it's not like like a we have to ban
misinformation, right? You can go post
misinformation all the time like two gay
frogs being able to make a baby frog,
you know? You can post that. It's you
know,
I highly doubt we'll get such high
tariffs. Trump may be bluffing to get
better terms from other countries. Yes,
I've heard this. I've heard this take.
Um,
what about doxing? You know, again,
there's there's
gray areas. Uh,
but X doesn't have free speech. And and
that's okay, right? It's just important
that it has a different uh overlap. What
do I think of doxing?
[Music]
You're getting close. You're you're
getting close to you're getting close to
to a targeted call to violence there.
Um, yeah.
I think that again it's it's it's
very different when a platform bans.
Okay, we don't have to we don't have to
go into this. We don't have to go into
this. Let's get back to work. I can't
believe I turned on subscriber only and
we're we're having a debate about, you
know,
leave it up to leave it up to free
speech.
Could we just like
I don't want I don't want to I don't
want to be involved with any of this. I
I love like the Elon tag and I I totally
agree with that. You know what brought
me into politics?
Something also I've never talked about
was Gamergate. Um I think a lot of
people I think a lot of people were uh
people who who you know similar
backgrounds to me were were
woken up by by Gamergate and not not
proamergate, anti-Gamergate, all this
absolutely stupid shit. just realizing,
wait a second,
things don't really work how I thought
they worked.
Uh, I already did my 10 minutes. I
already did my 10 minutes. We got to We
got to go back to coding. We got to go
We got to go back to coding. That's
okay.
Um,
but you know, if you miss it, I'm going
to come back to
If we lose America, we've lost freedom
for the world. you know,
um,
that's the politics stuff. I think a lot
about like
I think a lot about what my future looks
like,
like where I sort of end up,
what the right levers to pull are. Um,
I'm not Elon. I'm I'm I'm a different
generation,
right? So, what is what is this
generations what does my generation's
Elon look like?
I don't know.
Um,
and then like
would I be happy being Lana Shorts,
right? Would I would I be happy having a
a legacy like that? Uh I don't know.
I mean, I'm not saying that I even can
do these things. I can try. You got you
gota kind of like think about uh
I hear I hear the ego people screaming
well you should hope that you even end
up you know as far along as Camala
Harris's like well you know at least I
know know about the cloud right um
no I'm not sure what is going to where
you really want to be in the in the
future and AGI is going to change a lot
of stuff I'll use their word for it.
I'll use the word AGI. It's going to
it's going to radically
uh
you know change change the economy the
same way the industrial revolution did.
It's the next industrial revolution.
Like what does the future look like? And
then that's question one. What does the
future look like? And then there's
question two. It's like where do you
want to be in the future?
Um,
delusional. What do you mean by that?
No. the the the uh what's what's the
expression? The the chickens haven't
come home to roost on whether my
strategies actually work.
Uh we'll see. You know, Kama's finally
got the tech to to do
uh what was set out at the beginning.
I think AI is not useful. Say it's not
useful.
Um and I I do think I do think this
current set of tech gets rid of Google.
Um
here's uh the paper at the beginning of
comma talking about how to how to learn
in simulation. This is this is the kind
of this is the cutting edge stuff today.
here's our paper from nine years ago and
we have slowly worked to implement it
over nine years.
Um,
so then I think about like what my goals
are and my goals are very uh they're
tricky, right? They're not they don't
look modernist. They don't look like
building a large castle. A lot of Elon's
goals look like building a large castle.
Um I interviewed for Woven by Toyota.
They are still using HD Maps. Uh yeah,
like
I just want you to think about the type
of person who joins a company on the
decline,
right? the these companies can't hire.
Toyota is not going to be able to hire
their way out of this. Um even when you
buy companies, you have to be really
careful, right? So if you're if you're
Facebook and you buy Instagram,
uh you buy Instagram and Facebook is
still again a company on the rise,
right? You buy Instagram to get more
reach. You buy Instagram to succeed more
than you could have alone.
And these are the kind of acquisitions
that work out. Uh same thing with Ocula,
same thing with WhatsApp. You you you
get acquired by Facebook and you
continue to succeed
when Cruz gets acquired by GM. GM's a
dying company, right? This doesn't go on
to Yeah. When Twitch gets acquired by
Amazon, right? Like when you get
acquired by winners who want to keep
your product around and make it
successful,
um you know, you you go on to you go on
to do well. But when you get acquired by
Toyota or GM, right, you know where your
texts go. You know where like the whole
thing, there's a reason that company is
deeply broken.
Um
so you know we we make slow and steady
progress on uh one of my
biggest failures with comma
is
we have
had the best adas tech for five years
except maybe for Tesla.
We have unquestionably the best
should you know most people on Reddit
will even say that that comm is a better
experience than Tesla. Uh Tesla has more
capability at the high end but for the
actual reasonable use cases of ADOS
today used the commun this year still
works. Yeah exactly like we had this 5
years ago. Um but it didn't matter
right just solving that problem alone
doesn't translate to success.
there's not like a set of ADAS
benchmarks we can crush them and then
we're successful
but with deep learning frameworks I
think this is true
with deep learning frameworks I think
there's a set of very clear technical
because the people making the decision
about whether to use jacks or torch or
tiny are highly technical people
and
I think like you know it's a lot more
possible to in here.
Um,
you know, I don't know. I don't know who
ends up I don't know who ends up
watching these videos and whether I even
want to hire people who do end up
watching these videos. I think we get
some some stuff from streams. I think we
get more stuff from Lex.
Uh,
do I think everyone can be a technical
person?
Why? Why? Why? Why? What do you think?
What do you think? I I'll let I'll let
you answer that question.
Um
I think that so okay, you think about
what you want to do when you're like you
want AI to be more decentralized and
less centralized. Uh now, unfortunately,
building a big castle doesn't work for
that. And a lot of the projects that
have tried to decentralize things have
failed. Um, you can look at things like
graphine OS for for phones. It it's
cool.
Uh, and if it supported my phone, I
would run it, but it is always
uh going to be a niche, right?
like
this structurally always works out to be
a a uh a niche and a very important
niche. I'm very happy there's people out
there doing this, but this doesn't win
over Android
and it's it's an work, but this doesn't
win over like Google uh built Android
and
Yeah, I think decentralized social
networks are also this isn't really
going to work. And the the
decentralization
doesn't have a pull for people, right?
If your pitch is privacy, security,
decentralization, it's not going to
succeed. These things don't succeed. Um
I think this what does succeed is
simplicity.
And there's this
moes form because of complexity.
And if you can remove complexity, you
remove the moat.
How many how many people's moes are
effectively complexity?
Oh yeah. So if you design something
where it's so simple that anybody can
replace parts of it and if it becomes
popular
um
and there's projects that look like Tiny
that have succeeded. Uh look at SQL
light. SQL light is by far the most
popular database software.
Um it's written by five people.
uh they don't accept external
contributions.
Um it's 24 years old and it's it's it's
basically this one guy. Um,
and no, he's got like a crew with him
and yeah,
SQL light.
Any path to full-time tiny employee for
EU contributors? Yeah. What?
This it's a remote company. How much
have you contributed? How many of the
pull requests in Tiny are you? Right?
Like don't even ask that question until
you've landed a whole bunch of PRs. Then
we can start to have that conversation,
right?
These are the, you know, this is Tiny.
When you're up here on this list, then
we can talk about a job.
Oh, does SQL light a base code of
ethics?
It works.
The Ten Commandments is one of the best
code of conducts in history.
The Ten Commandments is the OG code of
conduct.
Um,
love it. Love it.
All
right,
we parsed the hashes. Now,
uh how do I get the last entry of a
dictionary?
Uh actually, it's just the dash.
So this
down
commands.
All right. Now we have to parse that.
Yay.
Um,
we'll just we'll just say uh we'll write
a to-do security
Sudoo security.
All right. Now, let's write this shit.
You use match case.
What Python added that
310. Well,
we only support 310 though because I'm
not writing this with a bunch of crappy
ass statements.
Um, okay. case buffer.
Make sure that works.
What? This doesn't work.
How does match case even work?
What?
Oh,
that
is that instantiating it.
the expression state.
All right, cool.
Use a new API.
Let's get that from delete.
session buffer is not key.
See that buffer now?
Okay.
Whoa, that even works.
Oh, that's so good.
Oh, how nice is this? How nice is this
code, boys? How much more readable is
this shit than that?
Oh,
why is that in there with me?
What this is gonna do?
Oh,
I never actually add it to
Yeah, I don't add it to H there. I do
add there. Okay, cool.
J
sounds amazing.
This is the Stupid.
the stupid uh
what am I doing?
I hate this construction.
All right. Can we handle everything?
[Music]
What?
Oh, it runs every time.
Match case is literally one line longer
than is instance. Literally unusable.
Yeah, but I just hated instance. It's so
slow.
Okay. Key error.
Uh oh. Code.
Actually, don't wait. I don't want that.
Oh, this isn't right.
We have to encode that as hex
Now, is it because
Let's
try that
different
in has no object
one of these. Yeah, I have to.
That's fine. But
session. That's right.
Copy. Copy. Should not be
should be session
buffer num where I got from here.
out.
Okay.
Buffer number one, but we buffer
allocate there.
Uh oh, because we're using session buff
nom. session button should just be
deleted.
And this should be
yes.
Oh, is it still the buffer?
Whatever.
Byes has no object and code.
Oh, that's always bytes.
It's not that
patience.
string
should be the same as this
cannot access local variable name where
it's not associated
with shit
because that should just be hash.
That actually shouldn't be hash. I know
where I got that from. Should be C.
Okay, we're gonna call this bin hash
and we're going to call this dash
consistent.
Okay, cool. We did it with two requests.
Sorry, we did it with one request.
Um,
let's commit this
cloud 2.
New cloud is cloudy
PR.
Red
All right. Who remembers the to-do?
Who remembers the to-do? Who remembers
the todo? What What do we have to do?
There's a There's a big to-do in the
code.
Security. That's right. Well, we'll just
leave that one for the security
engineers, right? What else are security
engineers here for? Um,
valid index type bytes.
Those data hashes are textify is
whatever.
Bytes is good by me.
Invalid index time string should be
bytes.
Decoded that
name buffer options is already defined
on
101. Okay. Well, the good news is all
this crap can be deleted.
We don't need anal. We don't need
buffer. We don't need program.
Yay.
How do we do on lines?
We don't need types anymore. We don't
prod
the type of bin hash.
What do you mean? Determine the type of
bin hash.
Who's doing bin hash? What?
Determine the type of bin hash.
I'll stop being clever.
All right, we need some meditations. Um,
what goes in the
What's that?
How we doing lines?
That's great.
You guys can all see it now. It's on the
cloud 20 branch in Tiny.
So, that passes. What doesn't pass
symbolic reduce?
How does this fail?
Memory view assignment value different
data structures.
Oh, the size isn't right.
Why is my chat losing connection?
Okay, cool. So, we have two posts to
drain. Let's see if I run with debug
equals two. One more post to drain.
Great. Um, comment out that command.
All right, we're making so many less
requests now.
And then at the end, we're going to
actually try to try run something on a
tiny box.
Uh, no, it was just it was just timing
out like it was like saying like chat
timed out.
Cool.
Okay.
Does everything just work and all you
have to do is security?
As you see, we're training emnest over
the uh over the thing. We're not going
to push this anywhere because because
it's very insecure and bad. Um, so let's
write some security.
How are we going to do that?
[Music]
AS literal email is safe.
Let's just uh
let's just ask uh
start with a tiny
How do I save?
Whoa, look at that. It regenerated all
that stuff. It knows
more item and data.
string
I could use eval but it's unsafe and I
want save
Let's
parse list.
I don't think I can literally on it.
malformed node or string. Okay, so it's
as parse.
Okay, we have an a module object.
Not terrible body. I think it is
We'll have an extra
object
l
for motor string. Okay.
What is low now?
Let's
keep call
list object.
list object is not iterable.
What good is a list object if it's not
iterable?
else.
Okay.
Custom
It's actually not a bad idea.
The only one where it's recursive is
buffer options thing
and maybe we can actually image d times
regressive too.
It's better if I just write this and
then like well
I want I want I want to basically
replace
uh
c
Custom
X.
What is literally about?
It bitches me out of call. Can I just
add call support to it?
Fuck.
[Music]
I almost just want literally val. I just
want to add support for a white list of
classes that I know are safe.
Can I replace the call?
How many lines is security going to cost
us? Probably a lot of lines.
What is it called?
Funk.
EST
name object. What kind of
All right. I should probably be using
some other editor that lets me do this
easier.
What's in a name object value?
Name object has no value. I don't you
know tell me something I don't know.
Uh
it
okay.
Uh
how do I look that object up?
marks.
They're all keyboard marks.
All right. ST keyword object.
Did the stupid thing show me how to do
it?
Does it come up to handle it in the pink
correct?
vert.
Okay, cool.
That just works.
Why did I mess around? I should just use
the use the AI.
So that's still insecure.
All right. Should probably be using one
of those AI assistant craps to do this
for me. Um, buffer options.
We'll get to we'll get to that in a
minute.
It doesn't work.
Now if I do this with image equals two
it doesn't work
GPU
underlying buffer is not writable
test
images.
It's being skipped because the default
device is GPU.
It's kind of annoying.
Somebody test that, right?
That does not actually work.
This doesn't work.
attribute has no object ID.
Most of them are as
What's an a attribute? Is that handled
by the clown?
Oh, image F.
I don't know what to do about that.
Look here. Image equals d type image f.
That's just because of how it's
serialized.
Security really worth all those lines.
We think security is not worth those
lines and we should just take it out and
use eval.
Oh, look at that is instance crap I
wrote. You know what I should use
instead? Psych. Just kidding.
All
right.
lambda x is the worst syntax ever.
All
right,
we will disable subscriber only chat for
the big reveal.
So, let's
Get this post.
So, let's go all the way back to America
now. So, this is a uh
tiny box in America.
And
let's check out the branch.
Okay.
Go over here now.
That didn't just work. Did I? It didn't
work.
I didn't say cloud equals one.
Here we go.
All right. Now, that's kind of slow.
Oh, I was trying to do beam. Well, that
doesn't work. Okay, fine. Okay, let's
train an emnest model across the Pacific
Ocean.
Why did it start? Don't do that.
hasn't even post a drain yet.
There it is.
All right.
Or it takes a lot of time. It's got to
compile all the stuff it's compiled
before.
There you go.
There's an emnest model
trained on a tidy box at home and this
API is only going to get better. That's
the worst this API is ever going to be.
So yeah,
uh if you want I can do something like
print X here
so you can see all the things that it's
actually sending.
I love the internet.
So there we go.
So, let's take a minute and actually
take a look at what this is.
We should actually
we should post all those Is it actually
uh
we should post on exit to not keep the
out of the cloud? But that's actually
problem solve.
Do I do this?
We should do this destruction of the
cloud device.
All
right. So now I can say uh say like if
=
1.
Um,
And then what we want is on destruction
of the device
but we can ignore those
errors.
Yes.
Is that ever happening?
Happens.
Okay. Okay. So, you see this is about
the round a lot of that is just the
round trip time
uh to uh
to America.
Oh, part of the reason this is slow is
because it's uploading the stupid uh
it's uploading mnest every time.
So Python to format with some
underscores between
Okay. Commas
So the problem is it's sending Yeah,
it it's it it's having to upload the
entire MS data set. Um, so we should
probably have some pre-negotiation where
we figure out what happens already have.
But, uh, yeah,
you see kind of where we're going here,
right?
George is betting on China now. I guess
he's simply wrong here.
Depends what you're betting
Um, you know, had the election turned
out differently, I was uh
I was ready to uh
uh
do no AI generated code. I didn't use AI
generated code, did I?
You can use AI like I used it, like a
search engine. I obviously don't have a
problem with that. My problem is when
people put up pull requests of AI
generated code, it looks like dog shit.
But it's not like a moral thing. I'm not
like morally opposed to AI generated
code. I think it just looks terrible.
Um, you know, you think AI could write
beautiful looking code like that,
George. That code's not beautiful. That
code is terrible. Okay, that's your
opinion, man. Uh,
I got a safety serializer in five lines.
Money from Tiny. Okay, first off, you
need a completely different
understanding of me if you actually want
to understand anything. If you just want
to shit talk and chat, then you know,
whatever you do you. But you think I
care about money? You think money has
any value to me? What would I do with
it? That's you start thinking, right?
Like like you start you start go up a
level. Go up a level in Maslov's
hierarchy of needs. Uh I don't need
money. If I have an idea that needs
money, I'll get someone else to pay for
it, right?
Um please subscribe to me. I do need
money. You know, I'm just
um you subscribe. You know why you
subscribe? You subscribe because you're
a better person than nonsubscribers. But
if you don't want to be a good person,
you don't have to subscribe. It's all
good. Um, I was talking about striving
for wealth. No, I wasn't.
Wealth?
What am I going to do with money?
What am I going to buy a yacht?
Then I got to have a yacht guy. And then
my yacht guy is going to be like, I want
health insurance. And now I'm paying for
the yacht guy's health insurance, right?
And then my yacht guy murdered his
mistress on my yacht. And I got to deal
with this. The police are calling me and
I'm like, I don't know, man. I haven't
even been on the yacht in nine months.
I don't know. I didn't do it. What? Oh,
come on. I got to go down to the
station. Uh, really? I got to deal with
this now.
A right.
But you're rich. You don't care. No, you
still care.
I need money to scale up comma AI.
What?
Karma could raise all the money he
wants. But can I deliver a return on
that capital? I'm not sure yet.
What What explain what I'm going to do
with money to scale up comma AI? I'm
gonna I'm gonna I'm going to hire a
bunch of bureaucrats.
You can buy pussy. Yeah. You can also
get it for free and it feels better, you
know.
No, no shame, man. No shame. If you want
to buy it, by all means, go ahead. Uh,
[Laughter]
[Music]
no, no, no. But if you're paying a lot
of money for it, that's the if you want
to buy it, absolutely go ahead. Just
make sure you're paying market rate.
Don't don't don't overpay. Um,
[Music]
I could start a BTC mining farm. Why? To
get more money.
Oh, I need money to scale up Tiny Grad.
Bro, I have $4.2 million right now in a
bank account. I have no idea what to do
with it.
I I have no idea. like like I have no
idea how to deploy that capital and get
effective uh returns on it that will
make Tiny Grat better, right? Do I want
to hire a bunch of software engineers
who are like I don't get out of bed for
a total comp of less than $700,000? No,
that I don't want to hire that guy,
right? That guy's not going to write
good code.
uh hire Eastern Europeans. We hire
anybody who comes in and contributes.
Um that's it,
right? Just just show up and contribute
and eventually we'll hire you and we'll
pay you enough money to uh to to live.
And if you uh you know show that you
are a real owner in the company and are
starting to like you know make decisions
like an owner of the company would then
I'll give you an equity grant. That's
how you hopefully get rich.
My salary at Tiny Corks 80K.
No, people who assume money are the sole
motivation are kind of like the way that
like
like okay you can think about like like
if someone who is is is like middle
class strives to be like upper middle
class right someone who someone who's
not that comfortable strives to be more
comfortable right and you can imagine it
like that um actually this might not
even be true it might even just be that
like you have not thought at all from
first principle about why you want
money.
Why you money people? What do you want
money for? Have you thought this
through?
I want to contribute to Tiny, but I
don't even understand what the issue
even is. Well, you know, you got a long
way to go, bro. Um
I get ads from China Mobile texted to
me.
Okay. Big number better to flex on
porons.
These are the stupidest reasons I've
ever heard.
To start a family, bro, just go do that
shit. You don't need money to start a
family.
to survive.
Well, you need money to How much money
do you have?
Are you from subsaharan Africa where
you're like, I need money to survive. I
currently make $150 a year and 300 would
change my life. I believe you.
If you're like, well, I currently make
120K, but with 150, I don't believe you.
Top three things I enjoy about Hong
Kong. Okay.
Um, the efficiency with which this city
operates. Everything is nearby. This is
probably the most dense place on Earth.
I'm looking outside my my window right
now. I wish I had a camera that I could
pivot and show you. I'm looking outside
at skyscrapers that are that are just
massive,
full of people. So, I love the density
and the things density brings. One night
I have uh I have a I have dandruff in my
hair. So, I I want the ketoal. It's the
good kind of shampoo. It's like 9:30 at
night. I went to one store. They're
like, "You got to come back when the
pharmacist is in to buy it." I'm like,
"What?" Not only did you understand what
word I'm looking for, you immediately
gave me an answer. And like it was a
reasonable answer. And then I went to
the place next door and they're like,
"Here."
Wow. Do you know how hard it is? You
can't You don't leave your house in
America. you buy it off Amazon. Um,
so, uh, that escalators, everybody in
Hong Kong stands on the right side of
the escalator, so if you'd like to go
faster, you can walk up the left. And
this is respected throughout the whole
culture. I love it. Um, do I speak
Cantonese? Not at all. Uh, people speak
enough of English. That's fine. Um
yeah, just just and then and then cash
and then cash. Um so much uh you pay
everywhere with cash or you can use an
octopus card which is basically as good
as cash. Um like it has a little bit of
tracking but it's not like these credit
cards which massively track you that you
have to sign up for like like it's it's
really a uh an anonymous society if you
choose to live that way. Um so yeah cash
efficiency and density.
Um
yeah, passing lane escalators is I I
know I know. Uh
this is most of Oh, Southeast Asia. at
Seattle like been the Seattle this this
this kid in Seattle like you know I was
I was walking by the train tracks and he
jumps me like jump scares me to try to
get me to fall in the train tracks and I
like look at him and I you know
uh little scrawny anarchist looking kid
right
um
but uh wait
oh no yeah mainland it's actually I
don't think it's the government I don't
think that the ali pay and the WeChat
stuff is coming from the government. I
think it's actually just uh people in
society. I think the government actually
wants cash. Um you know, a lot of a lot
of the uh myths you've heard about the
Chinese government, a lot of the the
myths you've heard about China in the
West just aren't true. Um
you know, there are some I I do
appreciate America. The free speech in
America is is is unparalleled. That is a
wonderful thing about America. Um and
America has a much longer legacy of uh
continuing property rights. Right? So if
you want to look at like like it would
America would have to fall so far before
they do things like seize land, right?
Whereas you know China this is almost a
living memory.
Uh do I think Hong Kong needs to address
bureaucracy? Not really. No. Um you know
I I had I have had a few encounters with
government people here. They're
It's not going to be they're not like
striving to be uh they're not like
striving for growth.
Um but they're competent and they're
like this is not going to be the next AI
hot spot for AI software engineers. And
that's one of the reasons that you know
I am going to go back to America. Um I
might even I might even go to San
Francisco even worse even worse than
just America.
Uh but you know I'm sorry you don't get
to enjoy a nice life while you're
building the future.
Um
myths interesting word for western
propaganda. Yeah it's western
propaganda. There's propaganda here too.
Uh about the west
uh how do I interact with crypto? I
don't have much crypto. I'm mostly a
nocoiner. Like people think crypto cryp
anarchy man. Like it's not again it's
not about you money people.
Uh I did go to Shenzhen. Shenzhen 80% of
the cars are electric. The streets are
silent. Unbelievable.
Uh but you money people. We're back to
the money question. What do you all want
money for? I I've so heard flexing on
the pores
to travel to Hong Kong without worries.
Bro, this place is cheap.
Like I go eat lunch. My lunch is like
$6.
Like I if you're traveling from America
or Europe, you're going to come here and
you're going to be like everything's
cheap. Especially if you go to other
places in Southeast Asia. Went to
Cambodia, man.
Shit was dirt cheap in Cambodia.
Uh to build a rocket company. Well,
again, why don't use other people's
money for that? If you have a serious
chance at building a rocket company, get
investment.
Um, you were born to buy an NY
penthouse. Why?
Why? Oh, yes. Oh, my penthouse. I'm
really penousing today.
Um,
to buy an election.
Um, yeah, I bought a Rolls-Royce because
I literally don't even know what to do
with money. Like, I don't even know what
the what the
like. It's also It's not even that
expensive. I didn't buy a new
Rolls-Royce. like, you know, I bought I
bought a used huge Rolls-Royce that
depreciates similarly to a lease on a
Tesla, right?
Um will I be fine if the Chinese
government put an official into my
company? No, I would not. I would not be
okay with that. Um,
but this also like you know
Hong Kong is a separate system from
China, right? It's part of the same
state, but it's a separate system.
Um, am I allowed to work from there?
Well, I'm not taking a job locally. Am I
allowed to work on my computer? Yeah.
Hong Kong is the most expensive city in
the world.
[Music]
Everything I pay
I'm paying maybe 30% less here than I do
in San Diego for everything. Like that's
just my spending.
I guess like I paid 30% less for Yeah.
Maybe even more actually.
I traveled. I traveled a whole bunch.
Have I been to Taiwan? Yeah, Taiwan a
whole bunch of times.
Um,
what do I think about Dubai and the UAE?
I'd rather be here.
Uh, time's cool.
You can exchange money for almost
anything. If you have a lot of money,
you can have anything I want. Okay, go
on.
Hong Kong is not going to be merged with
China. I mean, it's China's. It's a part
of China, but you know, it has a
separate
legal system. Yeah.
Is there anything I don't like?
Um,
I mean, part of it is just where I am,
but yeah, you know, there's the
downsides to density sometimes.
Sometimes you just want to be away from
all the people everywhere, and it's kind
of hard to do that. Uh,
no, but I don't know. There's there's
there's cool nature here, too. I go on a
lot of hikes. You see my you see my sad.
Um,
by the way, we trained we trained an
MNEST
all the way in the remote cloud
program buffer alic. Did I forget to
like do any major things? This is
mergeable kind of.
So now, yeah, I mean, this doesn't have
to be written today. Oh, I should fix
the uh
so right now it's it's before it trains
the emnest. It's uploading the entire uh
emnest data set. Oh, make sure I bump to
310 and setup.py.
Uh yeah, I should bump to 310. I think I
think it's about time to go to 310.
That's going to require a bunch of
changes.
Uh the UK is on the path to zero. I yeah
I'm not I'm
America was at a big fork in the road
and America took the correct fork. Uh
whereas with Europe I think it's much
harder.
I think I I saw the things about if
Europeans voted uh you know like like
none of them would vote for Trump. Yeah.
It's not
Europe may feel this way because they
have more functioning institutions
uh than America, right? Like the the
American particularly the federal
government is like what what what's the
what's the Reagan quote? Like uh when
the man shows up, hi, what's the
scariest words? Hi, I'm from the
government and I'm here to help. Like
like that's that's been the American
attitude for a long time.
Um,
you're from Europe. It is bad for
Ukraine.
What is bad for Ukraine?
The UK has the most AI startups in
Europe. Let's brain drain them all.
Let's everybody just come to America.
Enjoy freedom. Uh, let's let's give
everyone a visa.
Um, does the result need to be copied
back? Yeah. So if you want the model, if
you want the model, you could like save
the model. So the beautiful thing about
these abstractions is they're like every
normal tiny red thing will just work
with these abstractions. Um, and it's
actually pretty fast, too, which I'm
very happy with. I'm so happy I rewrote
it like this and didn't real and didn't
think that I had to like refactor all of
this uh stuff. Now there is there is
more latency because every request so
every like step if you're trying to get
back the uh
the the intermediate loss is going to
add your network latency. It's going to
add a network round trip.
Why should anyone come to America if
money doesn't matter? Well, it's it's
not that money doesn't matter. Okay,
money obviously matters and you need
money in order to do things. But the
idea of you I must hoard this little
pile of money. That's what doesn't make
sense, right? I don't Can you get a
startup funded in Europe? I don't know
if you can, right? Or at least like like
I don't know. Like I had a we had a
comma office in Europe for a bit and the
level of like ridiculousness
of like how you'd have to employ people
so you can in California like I'll give
you this about California and America. I
wake up one morning, I decide someone's
fired, they're fired. That's it. No. No
severance. No, you have some
unemployment with the state and my
premium for my insurance might go up a
little bit, but like you just fire
people, right? Like that is square one
to starting a business. I don't think
Europe lets you do that. If you can't
just fire people, how are you ever going
to run an effective company?
Life in Europe is really happy. People
in USA live to work. In Europe, people
work to live. What is this living that
you talk about? Oh, I'm going to go look
at a museum and see old things. Life is
work.
Do I fire a lot? Um, well, you know,
again, if I'm firing someone, it's my
fault for hiring them in the first
place. We've gotten a lot better. We
fire a lot less people now. At the
beginning, when I didn't really
understand and hire people, we've hired
a lot of people.
If life is work, why do you go on hikes?
to think about work.
It's just like like like it's not life
is not sitting at a computer and typing,
right? That's not what I mean when I say
life is work. I'm saying that at the end
of my life, the greatest thing I will
have done is work, right? You're not
going to look back on your life or
family. Uh but life is not,
you know, leisure.
Leisure is the most like you'll think
back on your life and why why did I
waste all that time, you know?
Yeah. Right. But like I don't want like
a loophole for firing people. I don't
want I want formalism. I want a
government that just says yes, you can
fire people. Why should you be able to
fire people out of nowhere without any
repercussion? Because otherwise you
aren't going to have good companies.
Right? And society suffers. Why should
you be able to? Because you want to live
in a good, rich society.
I mean, some great scientists come from
Europe. Absolutely. And I would like to
give everyone who wants a visa to come
to America and work there and make
America rich because Europe's not that
interested in being rich. Come to a
country where we're interested in being
rich, right? And this is what like like
also another thing like you people who
are obsessed with like I'm making money
and making your I would much rather live
in a rich society
and be the middle then live in a poor
society and be rich.
I was never for deporting 15 million
illegals. I never
I never I never said that. I think we
have to seal the border.
I think you have to control your border.
If someone's been living in America and
paying taxes for 5 years, I don't care
how you came here. You're paying taxes.
You're contributing to society. Cool.
Because
I deport you, right? If you came here
illegally and you know you and your gang
are are are doing gang shit, yeah, go
back to where you came from.
All
right. You want to do crime? What?
Crime's illegal in America. I'm sorry.
I'm sorry. Crime's illegal.
Um,
if you're firing them for no good
reason, see, that's the thing. What I
got I got to hide. I'm from the
government. What is the reason you fired
that person? I'm not answering that
question.
The rich absolutely should. Well, yeah.
I mean, the rich do pay more taxes.
Should you have a progressive tax
structure? Do you mean more as in flat
or more as in progressive or more as in,
you know, the other terrifying thing
that Camala Harris brought up is
unrealized capital gains tax.
Every politician who even mentions this
like it's it's it's an economic
genocide.
All right. Well, what can we what can we
can we do C4 over this? Maybe we can.
Um
Oh, no. I mean, the the debt's out of
control and we got to just cut. Elon
said a trillion. We'll start with a
trillion. That's a good place to start.
Economic genocide. Really?
Um,
you've only heard what from people in
America that the greatest scientists
come from
what? American exceptionalism,
propaganda. America is great because
it's a multicultural society that we
bring the best and the brightest to
where they can come experience freedom,
low taxes, and nice life. Right? That's
that's how America should work.
A good reason to fire them. What?
Everything I wrote in the contract.
What kind of like a world is this?
I just start giving someone money every
week and we kind of just talk about what
they're going to do. And if they're
doing a good job, I'll give them a
raise. If they're doing a bad job,
they'll get a talking to. If they're
doing a real bad job, they'll get fired.
Right? Simple.
Isn't it better globally? Yeah, but I'm
an American and we're trying to make
America great again, right? It's called
the America First Agenda.
Sorry, globals.
We're We're done apologizing for
America.
Hong Kong, America,
global variables are bad. Anyways,
uh I mean that that was today's dream. I
think we were pretty effective. I think
we uh we got work done. We did things
Um, someone's got to fix that bug.
No, Israel is not the 51st US state. And
uh, again, you know, my opinion, my
opinion is that that's a 2,000-y old
religious conflict. And, you know,
they're going to have to figure it out.
And I don't know why I have to pay.
That's That's my deck.
Why? Why? Why? Why? Why does America
feel the need to take sides in 2,000-y
old religious conflicts on the other
side of the world?
See, we had to upload the entire data
set. That's why that was slow.
Do it for Diddy.
Wait, no, no, no, no, no. A rich world
is great. I'm all for a rich world.
Uh, do I think wealth inequality in
America has anything to do with
corporate capture? Absolutely. Uh but
you are demonizing the wrong people. You
are demonizing the wrong people if you
are demonizing the rich. Especially
people like Jeff Bezos and Elon Musk,
right? Jeff Bezos and Elon Musk are rich
because they provided immense amounts of
value to society,
right? You you want to talk about you
want to talk about things like big
estate taxes to get rid of the fifth
generation of the Ford Foundation? Well,
that's a different story, right?
Um,
I heard Bulgaria. Most people in
Bulgaria would have voted Trump.
I don't know why we can't talk about
Mojo. I think Mojo's okay. Uh, it seems
America will soon be run by followers of
Curtis Yaran.
I mean, it's I I like like
I like um
No, no.
Yeah, see it's uploading. It's
uploading. It uploaded 600 megabytes
there.
Yeah, Elon is a block term.
Thoughts on the proposed tariffs?
This gets into my my skepticism. Uh I'm
I'm skeptical of tariffs. Uh, but I
would much rather a political debate
where we can debate tariffs versus no
tariffs than like emotional insanity.
You know, I I think that like you you
can't just
it's disgraceful. I mean, it's it's so
disgraceful what's happened. There's no
more Congress was supposed to be a
debate hall for American politics. Now,
uh, unelected bureaucrats, NOS's, and
corporations write these 3,000page bills
that nobody reads. Then people use the
worst Pymican rhetoric to to push like,
you know, like like uh oh, clearly this
is the the the American infrastructure
bill. Why? Why is it giving $28 million
to fund the
uh New York Dolphin Study Center? Wh Why
is it doing that? Why Why is that on
page 1162 where you're just sneaking $28
million to fund your friend in the
dolphin? Why?
Um, I don't know who that is. Uh, which
one's Dragon Back?
Yeah, exactly. Exactly. Going to come
over here with some
uh
Let's see. What does Duck Duck maps look
like?
Oh, I haven't made it down there yet.
Down there. I just did last weekend I
did uh
from Fortress Hill to Repulse Bay.
Yeah, tax evasion. No, it's literally
just looting. By the way, Dr. Go, your
map looks like shit.
Thank you. Thank you.
I am in Hong Kong. I'm coming back to
America. Uh, should I go to Thailand?
Should I go to DevCon?
That's kind of like, should I get on a
plane tomorrow, go to Devcon?
Uh, but yeah, no, we're we're we're
bullish on America again. I I apologize
for ever ever wavering my faith. Um,
I'm getting fat. Am I fat? I don't think
so.
Go with Six Flags. Just want the fucking
war to end. Me too, man. Want all war to
end. We can all live in peace,
prosperity, and wealth.
What do I need money for? Building
vault.
All right, guys.
Did we enjoy today's stream?
Um, oh, actually, let's try one more
thing.
This is what I really wanted this to
work for, and we're going to see if it
works in a minute. So, T24 is a common
device.
Now let's see
if we do uh
object of type type is not JSON
serializable.
What is this?
Oh,
is that
cool?
Oh, now this is because it's doing this
search locally.
Yeah, look, it's all these requests
sending. Terrible.
Um, it's because it's doing locals. What
if I say no locals equals zero?
Right
now, we're running the open pilot model
on a remote comma device through the
cloud.
white stream. Yeah. No, I was I was I I
went down I went down a spiral. I went
down a a move in Asia spiral. China's
the future. China and America are the
future. Hand in hand in mutually
beneficial cooperation.
There we go. We're running this model
now on the on a on a real comma device.
Um, I mean, I could also run it on my
cell phone.
Should we run it on my cell phone?
I got Termox here on my cell phone.
message myself.
I've never tested this at all before.
the password.
Maybe it's a who am I problem. I just
who am I on my phone?
Do I have a password?
Okay, I set a password. Let's try it.
Oh, I'm in. Cool.
All right, let's pull Tiny, guys. You
can see how outdated it is. How I
haven't looked at this for like ever.
All right, so now this is running on my
cell phone.
It's a Z45.
So, I'm going to try to use the cucumber
back. Does that Let's just see if things
work first.
Does it do
GPU? Okay, good. This is running on my
cell phone, boys.
Let's see if we can train Amnest on my
cell phone.
Uh, we're going to check
like, do you want to prove this is a
cell phone?
Where was that thing?
Did that just work?
Oh, it's Yeah, it's fast because my cell
phone's so close. That's just Wi-Fi
latency.
All right, let's try an emist.
Is it slow downloading stuff?
Why is it so slow?
Can't do that on an iPhone. Actually,
you probably could.
I don't think it would take that much
work to get uh
see it took 30 seconds to upload 46
megabytes.
Or no, maybe it's uh just that it takes
a long time to run things and have to
compile everything on the phone.
Now, you could totally run this on an
iPhone. I think you could get Metal
working probably pretty easily, too.
Uh, I'm just linking to you can see what
I'm linking to.
Is it training?
I hope it doesn't time out. Oh, no. It
just takes It just takes that long for
uh There we go.
We are training Amnest on my cell phone.
You just saw that shit live. I didn't
plan that. I didn't test it on a phone.
See, this is what happens when you just
do it correctly.
Everything just kind of falls into the
right place.
Beautiful.
Takes two seconds to step.
Uh, what did I want to what do I want to
look up?
Oh, could I do this in a uh
Yeah. Yeah. Yeah. Uh, as long as you
have these things on an iPhone, it
should just work.
These are these are the only
dependencies to make the metal back end
work. So, I actually think that this can
all pretty much run on iPhone, too.
People don't realize like how insane you
can just do everything in Python, right?
This is this is a this is an AMD driver
in Python.
This is like the full AMD runtime in
like a couple hundred lines of Python.
Here's the full Nvidia runtime, couple
hundred lines of Python. Oh, let me if
you guys haven't seen this, let me show
you this. Um, you can just run this
thing called viz equals 1 in in in Tiny.
Um,
let's run it on
this is fine. Actually, you know, let's
run it on efficient net. So, I have an
example which I'll just run a fishision
on.
So, now I can just go to this URL. So,
this is the visualizer. We've rewritten
everything uh into
uh graph format.
So like yeah this is
these are the kernels
uh that run here. I can you know let me
show you the kernels.
So these are the kernels that actually
run. I just ran I just used the
environment variable debug equals 2.
You see I said debug equals 2. So that
just shows you all the kernels that run.
Right now here we can do a visualizer.
Okay. What was this kernel? Let's see a
kernel. This one's a convolution. So
let's take a look at this kernel. Click
on it right here. Um, so this is how it
starts out. Uh, you can see that it's
loading with these shapes, multiplying,
uh, reducing,
bunch of different stuff, storing out
there. Uh, then we go through all sorts
of transformations. So you see these
shape trackers. These shape trackers get
replaced by just math.
So you can see the math that replaces
the shape trackers, right? This is
actually how you do the indexing. two
ranges. These specials here are the uh
are like global dims and local dims on
the GPU. And you see these expands. This
is uh loop unrolling and corsening.
As you see these expands,
um
there's a contract here. Is this doing?
Why is there contract there?
Um
the web course but it also supports the
one course too. Okay. So then we do a uh
a rewrite just to simplify things. See
if it has a lot less. We went from that
complex graph to that slightly simpler
graph.
Um now we push the expands through and
we create everything vectorzed.
Uh so these are just the expands are
gone. Things are vectorzed.
These are the same sort of like rewrite
rules. You can think of these as the
same way you think of passes in LVM.
This is by the way the eventual code
that's generated for that convolution.
Uh this is the expansion pass. So the
expansion pass actually makes a massive
graph which take a while to load here.
So this is this is the graph. Each one
of these is actually like a single uh
plus or equals or something in C. And
then we have this last one here which
just does a bunch of final final device
specific cleanups.
Yeah,
there you go.
And that's just one kernel. Don't go
like some kernels are a lot simpler than
that. I look at this kernel, but it's
simple. It's much simpler kernel.
Yeah.
Um, let's see. Is my emnest done
training on my cell phone? Oh, it is. It
actually it's done training on my on my
uh on my cell phone right on the table.
me exit out of SSH on here. I love this
phone, by the way. Z45.
Um,
is my phone hot? No. Oh, Jay Blow. Hey,
welcome. Welcome. All right, we just got
a raid. Uh, we just got a raid so we can
go through uh a little bit of what we're
doing. Um,
uh,
should this be added to ends? Yeah, it
probably should be. Uh, how's Jai
coming?
2025 for full public release.
It's not out yet, is it?
Oh, it's a lot of color.
Oh, I think I clouded that out a lot.
Oh, it's a lot of lines of new code.
I'll have to figure out how to cut
lines.
Yeah, I'm getting pixel fold after
Google learns how to make a CPU. Yeah, I
feel that.
Why is Kitty better than the usual
terminal? Because it's GPU accelerated.
It's like fast.
Like I feel like normal terminals like
things are just like slow. Like watch
how fast this stuff is.
It's just like even like look at how
fast it like loads. Like that's like
slow on normal terminals. Most of that
slowness is not the terminal. Most of
that slowness is uh in fact like all
that slowness. Oh, by the way, another
here we'll show it off for people who um
who uh
you know we should make these flags a
lot simpler. So here we can download
like a 1B.
Let's load up like a 1B model.
Um you know built into into tiny
probably the easiest thing to use. Hello
tiny chat.
But oh unfortunately I think you might
be thinking of Twitter. Isn't it X now?
X is a synonym of everything.
Tell
me. Yeah. Isn't the UI a lot nicer? Some
guy just did a PR for this. Uh it
reduced lines and made it prettier. Um,
so yeah, you can you can try this uh
this 1 gigabyte model. Um, so this is
the incantation for this. It should
probably be uh Oh, it works on Windows
now, too. Yeah, of course. Uh, I bought
a Windows laptop for my trip to Cambodia
because I didn't want to bring anything
that was like, you know, my Mac costs
like, you know, two Cambodian GDP per
capita. Uh, so you know, it's
appropriate in Hong Kong, but I bought a
I bought a crap Windows laptop for
Cambodia. I did kind of grab on this.
Um, it's not that crap. It's actually
very light, too, which is nice. There's
a lot of a lot of backpacking. Um, but
of course, it's dead because no laptop
can sleep except for a Mac.
Yeah. 1 hour battery. Yeah, it's about
how long it lasts.
Um,
plug it in to charge.
Oh, my housekeeper tied up all the
cables.
Is it charging?
You bunch sleeps on your HP. Yeah, but
it still only probably lasts an hour.
Uh, is it dangerous in Cambodia?
Um, no, no, no, no. It's safe. It's
safe. I I just saw a thing about
Cambodia being like two from the bottom
in like respect for the rule of law, but
I think they're mostly talking about
like property rights and stuff. No, it's
safe. I felt safe.
Microsoft broke suspend.
I can like actually believe that. I
mean, the Windows team, everyone's on
the like the if you're at Microsoft,
Microsoft has some very smart people on
some good teams, but do you really want
to be on the Windows team? I I couldn't
believe how hard it was to not sign up
for a Microsoft account. I remember Elon
complaining about that.
Um,
yeah. I mean,
okay. Uh, so for new people, you see how
to run,
uh, by the way, like all of that tiny
stuff like debug equals 2. It works
everywhere, right? So, I can just run
debug equals 2 and that'll work just as
easily with tiny chat, right? By the
way, Tiny Chat, see this? So, you can
resume from this, but this is completely
client side. So none of this stuff is uh
is stored on the server. It's not stored
in a database.
Bob's burgers,
right? And then here, so this is all the
uh
this is the running of the kernels for
by the way, how fast is that? See, that
is stuff the GPU uh that's why I use
kitty and not terminal. Um so you can
see yeah, it's doing like 25
milliseconds of token. Um we're getting
kind of close to the uh the bandwidth. I
think that This can actually go way
faster if anyone even looked at it. So,
um I paid out a bounty. Some guy wrote
gguff support. So, this is actually
loading a gguff. Uh we can see here if
you go to download um this is loading
this uh Q6k gguff, but then I think it's
unpacking it to float 32 uh which is
just a total waste your ramp with. So,
um we can do uh better than that. It's
using this one. So 1B uh GG uh it's
pretty fast to use. You can 7B and get
almost the same speed or maybe half the
speed of that.
I don't think I have 7 on here
or 8B. I have to download it. I said
download it. I have it.
I have it on my laptop.
Um,
like run on the tiny box.
Um,
can I show the banned words list? I
didn't make most of the band words. You
guys can see the bann words. Everyone
talking about stupid editors and crap.
Banned. Uh,
all right.
Any any any of the new people here from
the raid who want to see any any tiny
stuff? What we did today was so you can
run with cloud equals one here. We'll
just run this with cloud equals one. And
that's going to run the server locally
on my computer.
Actually, it's not. That's actually
going to connect there still
locally on my computer.
So this is now going through uh the HTTP
API for tiny. Um if I run with debug
equals 3, you'll see it actually print
all the uh oh it prints u and
everything. That's kind of crazy. Um but
you know these are the buffer freeze.
This is the program exec requests.
Uh I wish there was a way to like just
say like debug cloud. We're eventually
going to need some some fancier stuff
than just like one number.
Yeah, that's what
88 requests one hash.
What do I think about Triton? Uh, a lot
of people like it.
I think that it's better than CUDA. I
mean, it's interesting what it doesn't
require you to deal with in CUDA. It
basically abstracts away. So, you have
global dimensions and local dimensions,
GPUs, and it abstracts away needing to
deal with the local dimensions. Um,
every time I've tried to use it for
anything off the beaten path, uh, the
compiler bugs out and crashes. I've
tried multiple times to write a Triton
backend for Tiny and if you write things
in a slightly different way from exactly
how they want you to write them. Uh they
either the performance isn't good or the
compiler just crashes. Um I try it every
once in a while, you know. Uh I think
that like yeah, it's it's it's a good
choice for a certain set of things.
Um, but I think that long term, Tiny
Greg wins.
Uh, because we're going all the way to
the metal. We're going like every time
all of these abstractions at every layer
you go from like, you know, okay, so up
here we have PyTorch and then we have
torch inductor and then we have Triton
and then we have CUDA and then we have
the CUDA runtime and then we have the
driver, right? Each one of these
abstractions is slightly imperfect. So I
think that it's overall like and
normally this is a bad idea. Normally
you want to build on abstraction stacks
like this but I feel that ML compute is
simple enough that you don't have to and
that's kind of the whole bet for uh the
whole bet for tiny. So one of the things
we're working on now
is a talked about this on Twitter this
morning. Um
the AM driver. The AM driver is actually
a complete driver uh for the uh
7900 XTX that runs in user space. Um we
already have runtimes so we're not using
any of the user space from AMD already.
We can like replace it with this.
Yes. So I mean you can see where this is
going right. We're building each piece
of it and eventually
um you're just going to run. So right
now cloud equals 1 is connecting to your
computer, right? This is actually
creating a server if you don't pass in a
host. But we're going to update tiny
eventually to such that cloud equals 1.
Uh
and it'll even be the default if you
have an API key set. So you'll set up an
API, you you'll sign up for the tiny red
cloud and then you'll be able to
train huge models. Um, this gets into
another thing we have to get working and
see how stunning emnest works. So,
stunning emnest, it doesn't work yet,
but instead of having a loop where you
do your uh where you do your
uh steps, you're going to specify all
the steps up front in actually a tighter
syntactic way of doing it. So you can
see like how this is just like like here
you do all your samples beforehand in a
large virtual tensor of steps by BS
right you don't want a data loader you
want this you want to prespecify
everything and then the back end will
figure this all out um you already saw
some foreshadowing if you watch the
cloud stream for how we're going to do
uh
for how we're going to do
uh model weights and stuff and The
answer to that is hashes.
So, you know, right now it's actually
uploading
um each one of these hash things, but if
the cloud tells you that it already has
it, it'll just say, "Okay, yeah, don't
bother. Don't bother. I already have the
the hash of that."
Um, AMD still hates money. No, it's not
that they hate money. That's that's the
wrong way to think about it. They don't
understand modern software development
practices. They don't understand CI and
fuzzers
um and all these things that make modern
software development so good. Uh like
like I'd be nowhere without Tiny's
amazing CI and we've put a lot of effort
into this. We also have a website uh I
don't know how robust this is so don't
all dios it but stats.tiniggrad.org
um you can see tinyrad performance over
time. Um,
we're not quite to needing it yet, but
yeah, you can see I've been working hard
to like make that faster.
Um, this jump's not a real jump. This
jump is because we put more stuff in
there. That jump's probably a real jump,
though. So, you can like look and see
what it was. And then each one of these
is linked to a commit. So, we can see if
like things got faster or things got
slower. Um,
what is my build system, bro? It's
completely Python.
It's tiny is 100% Python. Um the only
thing that we still use that isn't. So
all this stuff is completely optional.
There are no install requires is empty.
We don't even require numpy anymore. Um
the biggest thing that we had we're
still using numpy for is we were using
numpy for random number generation, but
we've moved off numpy for random number
generation. Um
so we just use uh we use three fry.
Uh yeah.
Uh so the only thing that we still like
link to on the system is we're still
using the drivers from Nvidia and AMD
and we're also using the compilers. So
like uh this is the hip compiler and we
use code manager. This is the CUDA
compiler. Um, you know, the the CUDA
compiler still uses uh MVRTC.
Yeah, which is why it works on Windows.
Yeah, it works everywhere because uh
actually I was shocked somehow Open CL
just worked on Windows. Um, you can see
our open CL like we're not using some
like some Python thing. We have these
autogen uh we have this autogen stuff
that just extract that turns the header
file and then we use uh it's just cypes.
It's it's all the C types.
Um there's like two kinds of people in
the world. There's like people who
haven't tried Tiny and then people who
understand like how amazing this is.
There is no dependencies.
Okay, this is not built on a huge stack.
Tiny is a sovereign stack and it's less
than 10,000 lines.
Um and people complain about people
complain about the lines. They're like,
"No, no, no. You write you write code
that looks like this, right? How's
anyone going to read code that looks
like this?" You can read it. Just spend
a little bit more time, right?
Uh, are we going to keep it under 10K
always? Well, yeah. You know, it's a
debt ceiling. Um, does Python affect
Perf? Okay, so here's the thing about
Python and Perf. I mean, you saw it
running this LLM. So, uh, you see this
batch thing here
for each one of these batched things? So
this is a graph API. We support graph
APIs. So like CUDA graph
um but we also support metal graph or
whatever it's really called in metal. I
don't know it's called just
um
yeah indirect
indirect command buffers. Um we also
have this whole HCQ framework which is
how we wrote the drivers for AMD uh
Nvidia and then also QCOM down here. So
uh this is a fast driver on cuc uh we
don't have to use
a lot of time is spent if you use open
cl a ton of time is spent basically in
malak and free recreating the same
structures over and over again. Um this
looks much more like ACQ looks kind of
like a vulcanesque API uh but it speaks
directly to the GPU and doesn't rely on
whatever quirks happen to be in the
Vulcan implementation. there aren't that
many GPUs. So, our idea is that we'll
just we'll just write back for all of
them.
Um, it's pretty pythonic. Yeah. Yeah,
it's extremely Pythonic, right? Like
people who people who complain about the
uh the tiny red code, okay, if we're if
we're interested in looking into like
what like big parts big important parts
of tiny grid are, ops.py is a great file
to read on tensor.py. You can understand
like how our comms work.
So, um,
here's our com. Uh, you see that it's
actually just a pool.
And that's the that's the code for pool.
Takes you a bit to get it, but like once
you get it, it's it's Wait, that's not
the comp. This is the comp. Uh, so we
pull it and then the comp is just um
after you get the shapes right, it's
just a multiply and then a sum.
Like these are all the old parts of tiny
graph that like they haven't even had to
be touched in a long time because
they're just correct.
We support all the same stuff does.
Um
yeah, we support way of guide
convolutions. That's a way of
convolution.
What is my ops coverage? like everything
we support all of Onyx.
Uh we have Onyx. Onyx is we're working
on a migration. So Onyx is actually
still in the extra directory which
doesn't count toward lines. Um but it'll
be in there soon. Uh we're working on
migrating uh Onyx over.
But you know, our ops coverage is
complete.
Um but yeah, so very quickly we compile
them down to these basic ops. So this is
these are the basic ops in Tinyrad. Um
there's a few more there used to be, but
there's still there's not
uh they're not many really. Um
this is all like the things that can be
on one of those graph nodes if you
looked at the visualizer. So like here,
let's try to let's visualize something
simple.
It's like a test tiny
Uh so let's do test gem
and let's put no optals one and demo
equals four. So you can see this is a
tiny little matrix multiplier. Maybe we
should cl so you can really see the full
loops, right? So this is a tiny little
matrix multiplier. It's a 4x4
matrix. Um so let's run that with viz
and then we can
running this.
Uh so if you just run tiny by the way
like you could try this all on your
computer. None of what I'm showing you
here is is this is all like well tried
tiny now. Um so this is the matrix
multiply here. Uh you can see that it's
um loads with stride zero. So you see
the stride zero loads mole reduce axis
is two. Uh and then there's the output
shape tracker which is 4x4. Right? So
these are this is effectively a 4x4
times a 4x4 matrix. Um now we can see
how the rewrites happen. So these views
and shape trackers are transformed into
uops. So you can see it's now indexing
and that's the code to index it. We'll
transform that one too. Us are globally
unique. So you can see that like you
know those are just shared right away.
Um
all those rewrites. All right. And then
like add zero. Why would we add zero? So
we can see those go away. All right.
Don't add zero there. Don't multiply by
one. You know, so on so forth. Clean it
up.
Um there's no optimization. So those
don't do anything. And then here instead
of doing like mole four, we can do a
shift two. Read the rule here.
replacement shift. Sorry, that's where
my head is.
Oh, yeah. And that's the eventual code
that's generated. Um, have you tried to
ever debug LLVM? Have you tried to sit
there with like, oh, I'm outputting
these like files in dot format and then
rendering them to SVGs? We just have viz
equals 1. It's like a modern uh web
thing.
uh use it for graphics. We're not
interested in doing graphics. So part of
the reason this whole tiny grad thing
works and can be so simple is because
we're targeting a restricted subset of
compute. Um tiny grid programs are not
turn complete. Look at how we do a
range. If you really want to see some
magic
uh just oh it's just tiny grad for for
the folders. Just look at this one here.
tiny grad um and then exclude runtime
autogen this exclude this one directory.
We have a script called size and you can
debate whether you think it's correctly
counted but we don't count the
autogenerated files because they're
deterministically autogenerated. They're
just like headers that we pull from
parts of the internet.
Um but you know the actual
the actual code
and this is this is a breakdown of what
all the files are. So most of them are
in tensor a lot in ops. Um a kernel is a
trash pile and should mostly be deleted.
This is the Nvidia driver. The Nvidia
runtime C style is a renderer got like
this is actually what renders all the
different uh not that C style is
related. Um this is what renders all the
like expressions to actually output C
code.
Uh I just rewrite this one. This is what
renders the expressions for LVM.
Um pretty simple to read right like here
you can see this rewrite. So like when
you get like a square root okay you
rewrite it as the context call square
root bitcast is bitcast
cast is an op depending on which what
your types are range creates a bunch of
basic blocks which just happens in LVM.
So like if you want to see this in lvmir
I just change this here to lm one. There
you go. There it is. LVM.
Um, we can raise the debug level even
more.
Um, these are the UOPS. And then we can
raise the debug level
one last time and see the assembly
that's actually created.
So like this is the
this is the graph specification. This is
the name. These are the UOOPS that are
generated after the optimization passes.
This is the LLVM code that's rendered.
And then this is the uh AR assembly. And
you can just raise the debug number
uh no company
like like this is and this is why I
think like money just gets stupid,
right? It's like
Tiny was mostly written by like five
people. Um
we have a really great team here and
it's because we you know the way we
hired it's the most merit-based thing in
the world. We hired people who came in
exclusively through bounties.
You you showed that you could do the
work and then you got a job here.
Um
yeah.
Yeah. No, I mean those five are great,
right? Cuz because you get more people,
you're going to get more code and you're
going to get more crust and people are
just going to be writing things that
nobody wants. Um like we have stuff in
Tiny Grab like transcendental here,
right? We're spending 154 lines. You
don't even need your accelerator doesn't
need to support x blog or sign. We have
implementations of x x blog and sign uh
in other uh
in other formats
that three fry.
It's just straight up it's three fry.
It's like the most clean implementation
of three fry you've ever seen. And
that's our random number generator that
matches Jax perfectly, right? Try to
read that same code in Jax. Like try to
figure out how Jax works. Okay. So like
to go through a full thing in tiny.
Um so we start in tensor, we start in
defand, right? Uh so you know a bunch of
checking.
um
generate the seeds we go zero
implement the counters but then here we
get bits from three fry random bits okay
so that's the internal one the internal
one here is calling into three fry apply
okay so three fry apply is a function
even this functional layer is going to
be removed when we replace the gradient
API once we have a big graph um
maybe I can raise more money so I can
hire hire you. That's exactly what you
don't want to do. Uh I'm not like just
start contributing, right?
Uh so yeah, then it's calling alu binary
apps three fry. Okay, so how does how is
three fry actually implemented? So three
fry is an op here.
Um and then you're like, okay, so where
else is three fry used? Uh oh, here it's
used in UOP graph. Here's a rewrite rule
that rewrites three fry using this
function. Let me get the definition of
this function and there's the actual
three fry. All right. It's like no
uh
like the most boilerplate is in
tensor.py and a lot of that boiler plate
can be removed. Um but like that's the
most pure
uh function. No, we don't need a scrum
master. We don't need an agile coach. We
don't need a head of diversity and
inclusion.
Um, can Tiny train GBG4?
No. Um, we have no support yet for cross
machine stuff, but you've seen the API.
It's just going to be the cloud API.
Um,
and I I want to I hope that like it's
still going to be it's going to take a
year still like our our golden our
target is why is comma not using tiny
for training, right? And we're not going
to like force them to use it. you can
obviously shield it to them, but you
know, comming.
Why hasn't comma switched to Tiny Grad?
Once KA of their own accord switches to
Tiny for training, we've won.
Um, it's still going to be a year, maybe
two. You know, these things take a long
time. Building infrastructure takes a
long time, but every, you know, every
day it gets a little bit better.
And this is my uh
you know,
a piece of my legacy,
Tiny Gradu, uh, you know, it's it's the
team, too. It's it's and you can see you
can see they're on GitHub. Um,
you can see everyone's contributions.
It's completely open. It's just it's
beautiful.
Um,
yeah, and there's a lot of ways to
contribute to this project. Like there's
a lot of different parts of of of Tiny
Grid. Oh, here's another good new good
new one to show off if you guys haven't
seen it. You know, we have docs. They're
actually pretty good. Like the docs are
like very usable. Um, so quick
understanding of Tiny, you know, that's
other stuff and that's Tiny.
Um, some guy made this this on Twitter.
Uh I guess there's still um
so yeah if you want to like see like oh
how do I create a tensor? Oh okay cool.
So I have like the basic creation
methods random creation methods. How do
I do move in the tensor? I create the
lowle ones the high level ones. How
about element wise operations?
Sure I can do all this. I can do all
these activation functions.
Element wise casting. Okay. Now we get
into complex ops.
um you know the basic reduce ones I
shouldn't call that complex ops I should
come up with a better name for that uh
but like here okay here's comp 2D
pretty straightforward
just see the pietorch docs
and there's still there's still so much
to do the dtypes we support
uh we have docs for hq those hq devices
you contributed by complaining
uh uh in issues. Complaining in issues
is good. You have clear reproducible
things. We prefer if you find an issue,
the best way to really get us to look at
it is to put up a pull request with a
failing test.
Um, and you can mark the uh you can mark
the the test as failing. Uh, and then if
we look at it and the test should if the
test clearly should succeed and doesn't
succeed and you mark the test as
failing, that's the quickest way to get
us to really look at any issue.
Um, when JI is out, rewrite tiny and JI.
I'm a Python shell. There's there's a
few things about Python I don't like.
Probably one of my least favorite things
is the lambda. Oh, the lambda
expression. The lambda expression's so
clunky. The type system shit. Um, but
uh there's no there's no better
programming language. I love Python.
Like like how much you can express in
one line
the density of Python. By the way, we
were talking about those graph rewrites,
the things that I was showing you
before. Like here's the different graph
rewrites.
Um, graph rewrite is Yeah. again are
equivalent to an LVM pass. Here are the
matching rules. Um if you want like the
normal matching rules you'd expect,
they're actually just in the oplifier
here in symbolic. So like you know this
here says uh x + 0 = x. x * 1 = x. x / x
= 1.
You can just add rules to this. I added
this rule this morning. So x or x and y
is just x.
Uh,
I don't think Mojo is
fast at stuff like this. I I don't know.
Um, they started out not like open
source and I know it's more open now,
but like trying to build non-opensource
infrastructure is kind of a non-starter
and it makes me worry about the
long-term future of the project. Tiny
has been MIT licensed since day one and
it will continue to be MIT licensed.
Which is this?
Python is number one. That's right.
Um,
no, that's not why I despise JavaScript,
but we're not going to we're not going
to go into how how how JavaScript ins
are floats.
Doubles. Everything's a double in
JavaScript. You have a pointer. It's a
double. It's a double. Sorry, you wanted
a different type. I'm sorry. All we have
is doubles.
JavaScript can't do math. Yeah, it's
um
who's in my house?
All right, I think it's time to go get
food. Thank you for watching today's
stream. Uh hopefully this last part
serves as a good uh intro to tiny grad.
Um
I'll I'll make an exception but you have
to be very careful while doing this.
Okay. So you know clips are banned of my
content. Uh if you post clips I will get
your uh I will copyright strike your
account. Uh we definitely don't want
clips of any political stuff taken out
of context because it is taken out of
context. Right. So, you know, sorry. Uh,
until the copyright laws are overthrown,
I will copyright strike the shit out of
you. Um,
but if any if anyone would like to take
any of the tiny content and make and
make tiny explainer videos. Uh, what
hypocrisy? Oh, whoa, whoa, whoa, whoa,
whoa, whoa. Um, hypocrisy would be if I
licensed my code and tried to charge
people for code. That's what I don't
believe in.
having an artist talk about how they
want their thing to be expressed. We got
to respect that, you know. Um,
and I also, you know what, I'll I'll
make another I'll make another I'll make
another exception. So, uh, I believe
that a copyright should only last 5
years. So, all my content older than
five years can be clipped.
Uh, but but you know, new content, no
clips. Unless it's for Tiny Grad
Tutorials.
Um, Hans figures it out. Which one's
that?
Used to have the number one clip on the
channel. What clip is this?
Can we watch it without login?
Uh, copy it.
This is Yeah. Yeah. Yeah. This is this
is basically a minimum like RNA copy
routine because I knew your body didn't
have RNA copy routines. The spike
protein. This is this is the this is the
exploit. This is the payload. The
payload basically just says make a copy.
And these are a few helper functions.
This is sick.
Yo, remember that time we reverse
engineered co? Those were good times.
What I mean genius must figure this out
too.
Yeah.
Ew. Co young and happy. I'm happy today.
We're in a good mood today. Today was a
good stream, right everyone? Was today a
good stream?
It's NPR for Viz and Mes. I don't know
if anyone still reads Mes, but
uh we we happy today. We happy today.
Summer mask. Yeah, get your summer mask.
Um,
I got to figure out how to cut lines.
We We'll figure out how to cut lines.
We'll have to We'll have to We'll have
to go in and uh
figure out where we added lines. We'll
also Another cool thing that we're going
to be able to do soon is uh we have a
web GPU port in progress.
Is this ready to merge? Might be ready
to merge now.
I merged that one. We have a meeting
today. We have a meeting today at 8:00
Hong Kong time. So, in about uh 4 and a
half hours, our meetings are open to
everybody. uh so everybody can listen in
on the meetings and if you are a good
contributor you can start participating.
Um,
so what we're going to be able to do
when you combine cloud and web GPU is
you're going to be able to basically if
you have a 4090, think about it, you
just need to open a website
and then other people can use your GPU
and then we built the decentralized
cloud. Now I know this shit's going to
happen, but you know, like the code
makes that possible. Um,
approach to learning. I read three
self-help Twitter threads.
Uh, cryptocurrency backed by TF Flops. I
don't think this stuff works.
I also I don't know about how much this
distributed stuff's going to work. I
mean, we're gonna we're going to offer
like it's a value added cloud service.
That's like uh you know, one of the one
of the places we can play. And you're
like, George, but how are you going to
compete with Amazon, right? Look, how
are you going to knock MongoDified?
We're going to relicens Tiny under the
business source light. No, I'm kidding.
Uh we're going to use 4090s.
Um,
tiny uh exposes a public API. Uh, you
write a backend for it. It's not like it
exposes an API. So like you can look at
maybe the simplest backend to understand
is like the hip back end. If you want
like a GPU one
doesn't support a lot of fancy features.
So if you want like an absolutely basic
one or actually the clang one is is
pretty basic. The clang one is really
simple.
Um, and then you also have to understand
there's a renderer. There's the compiler
there. Uh, this is the runtime. And then
clang graph uh will batch multiple
things together so you can run them in a
batch.
Hellhound, thank you for gifting subs.
Did you have a question?
Who was gifting subs before? Did I miss
someone gifting subs?
get you in touch with our AWS
salespeople. No,
cloud equals one. I think I think we're
targeting something like GPUs are going
to be like
I think we can do 50 cents an hour and
we'll bill you down to the second form.
Yeah, I think I think we can do 50 cents
an hour.
Um,
let's do some quick math on that. All
right. So, if we have a tiny box at 50
cents an hour, that's going to earn $3
an hour for the whole box. All right.
Now, 24
that. So, how many months? That's an AMD
GPU, by the way. So, like in a year.
Yeah. Cool. That's pretty good profit.
Yeah, that's pretty good.
Uh 50 cents an hour if you want. No,
that might get you a we might be able to
get you a 4090 for that.
Uh, and then we're billing you per
second. Uh, so, you know, as long as you
keep the connection open, you're being
build for it. But, uh, if you just want
to like, you know, quickly train a model
um
or yeah, do anything just just, uh, but
we'll get there. We'll get there. We
have to uh Oh, I don't think new ML Perf
is out. Uh we're on new ML Perf. Uh our
time isn't great, but uh you know, we're
there. We're there. Uh we're there with
uh not with ResNet. Uh because ResNet
was removed from ML perf. Um yeah, 2.5
for H100 PCIe. Uh so
yeah, a 4090 is about like um a third to
like 2.5 4090s is one H100.
Um,
so yeah, we're a bit cheaper than that,
but again, it's not just the price. Our
price is competitive, but the main thing
that you're going to get with our cloud
is a an orchestration layer that just
basically lets you connect to a single
GPU, train on GPUs on demand. No, don't
spend time, oh, I got to set up my
environment. I got to send my SSH keys.
I got to run this script. No, cloud
equals one.
Cloud equals one. It's going to be as
easy as cloud equals one. All right,
cool. Thank you for watching my stream.
Enjoy your day, everybody. Have a nice
day. And remember,
America, America, America, America. I'll
see America soon. But for now, I'm going
to go eat noodles in Hong Kong.
buklao: Supp
SKPTCL: ahoy m8
thefacultyof: sup
jay_al97: hello @georgehotz
allthesm0ke: Where's the prank Hotz?
thefacultyof: what are your plans today
allthesm0ke: You have 2 hours left if you're in PST/MST
lightofhel1: yo
E_Pizza: effHi geo love ur coding big fan
FalconJet_: sup george
shr3knad0: Hype
jay_al97: i was just watching an old video
lonez: YOOOO
sfmoose: Leeeeets Goooooo!
tahecs89: hello everyone
samwilliamson7: What’s going on George
shr3knad0: I love comma.ai it’s honestly insane
sfmoose: I qira’d hard last night, thanks for the dockerfile
SKPTCL: Use comma ai equity to acquire pure leaf?
buklao: Pfff only spindrifts are allowed
shr3knad0: Do you like the new stack overflow
Cube_Is_Life20: George what are some not so intermediate level projects to do? and should I always use a libraries or write my own?
buklao: You still own shares in comma right
alienware997: Greetings from Germany! 7am in the morning here but perfectly just woke up
sfmoose: What reading material should I read to become proficient with debuggers and qira?
siggb: How is your instagram?
sfmoose: 9-5s are a scam
allthesm0ke: REDIS BABY
buklao: So you're erlich bochman of your company nice
Toaster_PG: teach me java pls
buklao: Java is a shit language
buklao: Libtards made it
Toaster_PG: y
chase_higgins: yo George you quit?
lightofhel1: sudo?
buklao: It's slow and id rather use rust
ScrubLifeChoseMe: eyyy
Cube_Is_Life20: instagrambot-py is a great library on github I got 200 followers in a week with it.... too bad George only wants organic growth
shutchie: Memcached?
ScrubLifeChoseMe: commai Pog
chase_higgins: George how do I join the church?
Adriasian: says 90
ScrubLifeChoseMe: bro u got 90
canardppc: what's your name on linkedin mate ?
FalconJet_: says 90 on my end
ScrubLifeChoseMe: and its only been 5 minutes c
chase_higgins: @canardppc it's George Hotz lmaooo
skout23: AWS dynamodb too expensive?
Erichmoraga: It's pretty late, George. People like to sleep.
dorkmo: filecoin
shutchie: @skout23 wants local I think
Adriasian: papa george
canardppc: well can't ind him, maybe bc i'm french, i don't know
Cube_Is_Life20: George it's fucking late 10pm eastern 1am western
Adriasian: golang baby
chase_higgins: now working for Church of the New Hackers
wilderel: yo when are you putting more shit on soundcloud
anudeepgi: but early morning in India :)
buklao: Lawl types "verbose"
wilderel: much love from your ROomanian boys
Adriasian: sudo kiss me
shr3knad0: 10:45 is not early in the morning
shr3knad0: This incident will be reported
Toaster_PG: hows ur instagram doing
sfmoose: My cat is #27
FalconJet_: hey george, do you like the touch bar when dev'ing on laptop or nah?
anudeepgi: PogChamp PogChamp
shr3knad0: Kappa
Prest0n1337: What are you workin on tonight?
onu4r: I bet he can't reach 1 M by the end of the year
sfmoose: You’re 1% the way to your Instagram goal. We believe in you.
KrakkenTM: does he read chat?
Prest0n1337: not really
zeccran: @georgehotz do you know how to get user input in 32 bit protected mode of a booatloader?
chase_higgins: George when's your bed time? lmao it's so late
Ahxs: yooo
chase_higgins: like 10 pm man
buklao: It's 1:17 am
rvggggg: ghnghh
Prest0n1337: I understand
jay_al97: I do
i_am_sneaky: yo
KrakkenTM: not me
Prest0n1337: You just dont' explain much bro
chase_higgins: we got you george
rvggggg: wait it isnt subscriber only chat? :)
wilderel: no one bro
SteveATZ: because we like watching you work
thefacultyof: im just here to see smartman do code word
zeccran: I like learning things from you, may not be my focus, but i learn new things
buklao: I care
lightofhel1: qira is love
wilderel: what the fuck is this shit code minecraft 2
thefacultyof: this dude disses his audience too much
shutchie: <<
shr3knad0: Kappa
arisnotle: I enjoy this shit
Prest0n1337: I been doing learning on writing STM firmwares and doing C
buklao: How you structure your projects is in my interests
SKPTCL: We care but we aren't all at your level
thermalterm2: never do meetups man
thefacultyof: oh man yourself, pal
i_am_sneaky: twitch slam was legit
wilderel: did you invite the bots in bangladesh?
KrakkenTM: @georgehotz whats your keyboard?
sfmoose: Django might be a better choice if this is something that needs to be async and production quality
CamBaiL: LUL
sfmoose: Or flask async
chase_higgins: did anyone claim that cash?
Toaster_PG: clean room = new man
Cube_Is_Life20: George can you explain what a "key value store" like if you need to save a value just edit a file?
Prest0n1337: I think most of the people who know who you are are the people in the live coding crowd
i_am_sneaky: right? piano gone? wtf
rvggggg: i can only code python am i a lame ?
Erichmoraga: It's interesting to see how George thinks. Dissing the audience is fine, folks.
i_am_sneaky: yes
sfmoose: Me
Prest0n1337: Or folks who've seen you on G4 back in the day when they showcased you
buklao: Yell mother f*ck and it'll work
Prest0n1337: bout the Sony stuffs
vaporwave_memes: I miss G4
sfmoose: We’re also here for the rants
Prest0n1337: I love the rant about contributing nothing
Prest0n1337: explains my life
goolulusaurs: A lot of the best twitch streamers are really good a commentary too while they are playing games. I think it would help a lot if you talked/explained more as you were going so people could keep up and follow along more easily.
Level_002: im here for the VIM orgasm
sfmoose: Lemme guess, introverted nerds on insta?
Prest0n1337: hilarious
buklao: Lmao it's a scam
alienware997: Im here to learn and because you entertain...right now studying IT, second semester so i can follow you for around 80% of the time @georgehotz
KrakkenTM: stop fkin complaining and keep streamin
KrakkenTM: stianHaha stianHaha
Ahxs: Front end Web developer PogChamp
sfmoose: We’re hear to ask what keyboard you use every 10 mins
SKPTCL: What do you want your viewers to be like
i_am_sneaky: @goolulusaurs bro you ever try explaining shit as you code? Shit gets hard a few hundred lines in
Adriasian: blinkxFood
Cube_Is_Life20: who wants to explain to what a key value store is and why it's not just just stored in a text file?
thefacultyof: like its not like everyone is going to be even remotely familiar with the project
shutchie: Logs
wilderel: when are the hot chicks arriving geohotz?
i_am_sneaky: @Cube_Is_Life20 google does bro
OArtero: are you saying that in a MTG with instagram you saw that your audience don't know what are you coding?
Adriasian: what are we using the key-value store for
Prest0n1337: I think he's lacking screen real estate and doesn't read our chat much
bakztfuture: is flask debug mode on?
Cube_Is_Life20: @i_am_sneaky im on mobile I'm not trying to leave the stream to Google that shit
SGK7: Nah he only listens to subs @prest0n1337
Prest0n1337: Waiting for my twitch prime to hit it said on the 2nd so any minute
Prest0n1337: The whole talk only to subs bs though won't win people over
i_am_sneaky: 2019 you cant multitask on mobile?
goolulusaurs: @i_am_sneaky No, I bet it is hard, and I know even with games a lot of streamers have trouble talking while they play, I guess its just a skill you gotta practice.
bastianbeps: hi
Prest0n1337: thats like people who sit and wait for donos
Ahxs: That’s a sick UI
Prest0n1337: How's the last project you streamed going?
Cube_Is_Life20: @i_am_sneaky lmao yeah I got it
Prest0n1337: By the way @georgehotz nice hair cut
Level_002: this guy is limited by the mac. Need some windows or linux on his life.
Prest0n1337: I like better when you look like Bob Ross's lost son
maruchandayo: hi
maruchandayo: HeyGuys HeyGuys
Prest0n1337: I like seeing you program though George seening other experienced people actually showing how much they use reference docs instead of pretending to be a unicorn who knows everything
maruchandayo: sanic is also very fast
sfmoose: He had Linux servers he sshs into frequently. Plus docker and rendering farms, he’s not limited by a Mac.
Prest0n1337: I'll hit you with my Prime sub I think I have to wait like another 30min
un3okapi: sonic the hedgehog
thefacultyof: Kappa
Bloodspark_: really LUL
TimmyName: I don't think a lot of these people realize who george is
onu4r: dude there's also FASTAPI
onu4r: it's new but great
cjoelrun: aiohttp fast
maruchandayo: sanic is not that bad. i'm using it on production without any issues.
jocal17: who george is?
Prest0n1337: Well correct me if i'm wrong others helped George but he got most of the public recognition over the lawsuit
Toaster_PG: george == god
Level_002: Entrepreneur son of Tony Stark @jocal17
Cube_Is_Life20: I'd like to see George write his own api framework that'd be some real entertainment
Prest0n1337: you could write an API but api framework not sure what that is supposed to be
Level_002: @Prest0n1337 ehhhhhhhmm... example Slim Framework
TimmyName: DarkMode
Smithygmx: hes typing so fast
SKPTCL: give me mod
SKPTCL: ill clean this up
dorkmo: oh hey
maruchandayo: @fraudulentfarmer both of em is shit
funwayz: LMAO
Prest0n1337: George can you time me out
sfmoose: Bitches love env vars
Erichmoraga: Stay focused.
Prest0n1337: I can't talk to these idiots
Hexybu: purge drxPog
leond53: LOL
SKPTCL: Thank you sir
MrBankster: WOW
alienware997: Here want mod too:D
Ahxs: ban hammer George coming in hot PogChamp
Cube_Is_Life20: that's the George we know and love
Level_002: nice
TimmyName: alienware997 wants mod
MrBankster: george i am really into your beard
TimmyName: python3
TimmyName: ban me
lithiumx4900: I like the frequent streaming times. It's hard to find consistent programming streams
maruchandayo: @lithiumx4900 the best stream is here boi
Prest0n1337: i'm doing learning on ARM M4 tonight so i'm drinking a pot of coffee it was that or bleach so if I talk to much
syska: you have 127:0:0:1 viewers sir :D
Prest0n1337: thats my excuse
mrpentakills: You are insane with vim my man. Saw some video of yours yesterday and realized you are on twitch. How long have you been here? Glad you are here anywho.
maruchandayo: SeemsGood
lithiumx4900: I live in LA. Sorry about the traffic in advance
Prest0n1337: I can hook you up with Paul Denino
MrBankster: la >> sf
TimmyName: bruh that rap you made back in the day fire
Prest0n1337: I actually can tho
sfmoose: Make us proud
Prest0n1337: Yo it's geohot for those who don't know
Prest0n1337: I guess i'm a nerd for knowing the first line
Prest0n1337: fml
sfmoose: If only there was a way to analyze the binary
Cube_Is_Life20: @sfmoose kek
Prest0n1337: well you'd wanna analyze in hex
Ahxs: Double os import Kreygasm
lightofhel1: double import os btw
z0di4ckx: YOOOOOO!
syska: import os OmegaLul
cjoelrun: I use docker compose for env stuff
Cube_Is_Life20: gotta import it twice just to be sure lmao
maruchandayo: lol
Zealeigh: That jumper is fucking with my OCD
Prest0n1337: for that person who asked how to get started in RE there is Ghidra and lots of new tutorials on the topic
Prest0n1337: just check out youtube
fa_k: what is he actually working on?
Prest0n1337: hey key value store he explained part of it a sec ago
sk84uhlivin: I really enjoyed your SXSW presentation George ^_^
Cube_Is_Life20: @fa_k database stuff
syska: i hate mongo
TimmyName: yeah the SXSW
Prest0n1337: I started to watch it but from what I gathered in the first few mins if we are talking about the same talk seemed a bit of a odd talk
Prest0n1337: maybe I stopped to early
fa_k: @Cube_Is_Life20 oh ok
fa_k: python stopped working monkaS
Zealeigh: If python forks does it become medusa?
sfmoose: I’m here for the jetskis
Toaster_PG: cool... but can you code minecraft in 1 week??
Cube_Is_Life20: can't fork = he writes his own version of leveldb
jagger_rsw: but python sxxxss, rust rulez
poobum999: BCWarrior
TimmyName: good mods
shutchie: Memcached
jagger_rsw: Also, why are we looking at puting to and getting pieces of text out of files. Gerge, why won't you program AGI live instead? :)
sfmoose: Nginx is god
abhinavneelam: Everyone follow @georgehotz instagram
dorkmo: inception key value store
dorkmo: a key within a key
th3_maj0r: yoyo
dorkmo: yooo
poobum999: yo DogFace
th3_maj0r: are you drinking jack daniels?!?
nizero: sup george
redeagle1881: I like your terminal set up, have you got your dotfiles up on github or something?
nizero: i watched your sxsw talk, it was pretty good
th3_maj0r: @redeagle1881 yes
redeagle1881: @th3_maj0r on the /geohot gh account?
th3_maj0r: yes
Cube_Is_Life20: check out HyperLevelDB or substack level-party they may help with your leveldb problem?
Knarez: LUL
vybhavb: Hello!
aMulisha: LUL
Quad___lol: lmao
nizero: loll
aMulisha: It's Y2K bro
ab289528: 4Head
2knucklechamp: I dont think thats april fools either lol
Quad___lol: i remember when internet was an anonymous place FeelsBadMan
Quad___lol: @georgehotz what do you think of Tery Davis! do you think you can compete with him?
2knucklechamp: What is he trying to build? The title didn’t make much sense to me.
zutchbell: an hashmap probably?
josalt: Hey everyone
TimmyName: ban that quad guy
Adriasian: very cool
ab289528: oh got it
Cube_Is_Life20: so it's just a database with 2 columns?
Lazysloth: what keyboard is that
trashcan___: hhkb
2knucklechamp: Lol yeah that keyboard sounds hackerman
ab289528: ^
Cube_Is_Life20: @quad___lol Terry Davis was a schizo who was stuck in the 90's George is easily on par with him
kougithings: @Lazysloth If you get the same keyboard your programming skills will increase by 30%!
Lazysloth: so 0 x 1.3
th3_maj0r: sub the channel increase ur skill by 35%
th3_maj0r: sub > keyboard
Cube_Is_Life20: @kougithings same thing happens if you switch from atom to vim
Lazysloth: spacemacs, with vi bindings
reverseIRA: ugh! i still stuck on visual code with hundreds extension BibleThump
2knucklechamp: I wanna learn vim
2knucklechamp: Python in vscode makes me want to kick a baby
Lazysloth: they got vi bindings in vscode
reverseIRA: yep
kougithings: @cube_is_life20: I tried out vim, couldn't figure out how to quit it. Now I have stockholm syndrome.
zutchbell: i prefer atom
Lazysloth: its !letmeout
ab289528: @kougithings 4Head
mudmud17: !time
reverseIRA: my mentor said that using vim make u discipline
Lazysloth: in russia vim disciplines you
AFROH4CK: they should
m0etaz: is this the new Redis?
pau1riddle: Yo, George!
th3_maj0r: 119 viewers
josalt: You are popular George!
joker2k999: Lol
Lazysloth: how many lines do we have left
ab289528: you are
Bombapil0t: 9.942 > 9000 PogChamp
pau1riddle: Comments and blank lines usually don't count.
MrVehe: You're popular, but in spain it's 8:30 am, NOBODY IS AWAKEN TO THIS TIME.
joker2k999: Lol
Lazysloth: MrVehe aren't you though?
ab289528: 3am here in brazil
RaketenTier: not Popular? LOL. Suecase with Sony. Kicking Teslas ass...
abhinavneelam: @georgehotz why don’t you keep posting on insta?
th3_maj0r: 8.30 here too
MrVehe: I'm working, that doesn't count :) @Lazysloth
Lazysloth: georgehotz only posts on tinder
bourbaki77: I like listening to you hack while I work on my abstract algebra homework B)
iHench: %s/tinder/grindr
pau1riddle: @bourbaki77 I was reading Algebra: Chapter 0
trashcan___: append only >> delete
pau1riddle: @bourbaki77 best book on abstract algebra
bourbaki77: Is. that the one that blends in category theory?
pau1riddle: yeah
Lazysloth: yo i think his hoodie is insideout...
pau1riddle: it's not for newbies though
bourbaki77: Nice! I tried but I was still to much of a noob
Lazysloth: probably doesn't even wash his hoodie, just turns it insideout
Lazysloth: lifehax
bourbaki77: We are using Shifrin
enlightenedwaterfowl: Don't forget to support PATCH
Lazysloth: can't you make a script to run a test on ur server instead of running the command repeatedly
abhinavneelam: I think he said it didn’t work because of an environment variable or something and that it had to be a command line variable
enlightenedwaterfowl: The strongest trees grow in the harshest winds
ericswenson15: Micro service
ericswenson15: Rip monoliths
v0lko: what's wrong with consul?
Lazysloth: your mom is a monolith
joker2k999: Lol
Ni3uS: @georgehotz hey.. could you write some kind of a code, that can help me find my real mother?
risky_banana: I'm subscribed and I don't wanna say shit like that
joker2k999: I never worked with ngnx
bourbaki77: my god it's full of stars
Bombapil0t: :D
Bombapil0t: good ppl subscribe on twitch and follow on instagram. don't forget guys
joker2k999: Gotta re-factor bro
Lazysloth: did he say what this kv was for?
yamesboard: just joined, what are we building?
Grimonja: Or volume server registers with master on boot
joker2k999: I see we back in tmux boys
poobum999: monkaS
joker2k999: Lol
Bombapil0t: haha
Lazysloth: i thought a cat was on his desk when he tsk tsk
MrBankster: TDD?
ab289528: hahaha
joker2k999: Gotta be subscribed bro. Everyone knows this.
pau1riddle: But if you want to change code, you have to change tests. The more tests you have, the more difficult it is to change code.
th3_maj0r: yes
MrBankster: i like space seperated lists, like in clojure
jay_al97: pass it a set
enlightenedwaterfowl: ;)
Bombapil0t: type speed like a sewing machine
Cube_Is_Life20: do you still do bounty hunting?
joker2k999: Yea when he’s not shilling for the gram
enlightenedwaterfowl: I honestly forget the semantics. Most people get it wrong though. I don't think it's necessarily true that one is meant to be idempotent
enlightenedwaterfowl: (I'd have to dig around myself)
pau1riddle: Bountry hunting is low leverage position, better become a full-fledged security consultant, that eat scraps from bug bounties.
enlightenedwaterfowl: PUT vs POST, yeah
joker2k999: you haven't had a rant in a while bro. U feeling ok? lol
jay_al97: are on the side of making software now that you're done with breaking software?
Lazysloth: you can't break what is already broken
enlightenedwaterfowl: -H "content-type: text/plain" ?
enlightenedwaterfowl: Didn't read the full args lis tactually
enlightenedwaterfowl: Yeah you probably want to specify content type via curl
Cube_Is_Life20: please be a one stream project. I unironically don't want to sleep tonight
TimmyName: I'm glad I subbed to have access to your VODs, because I'm lost currently
enlightenedwaterfowl: oh nvm, saw the request body
sam_disgusting: ASMR 10 hours of rhythmic spaghetti code key tapping to fall asleep to | MOST RELAXING (10:00:04)
Knarez: are you wearing your hoodie inside-out
th3_maj0r: twitch app use white text on white background?? wtf is this
TimmyName: get betterTTV
TimmyName: dark mode
TimmyName: android
th3_maj0r: on the mobile app?
Cube_Is_Life20: my chat reloaded but whoever mentioned the hoodie, he's probably hiding (((their))) logo
joker2k999: something IS better than nothing
wall_streeter: should one use python over php for web dev? if yes, why? Thank you!
joker2k999: python / (everything) = gucciGang
Varicode: Past broadcasts behind sub wall now :(
TimmyName: jsut sub
Varicode: Wonder if they'll still be posted to YT
Varicode: Yea most likely will
wall_streeter: @joker2k999 , why? :D
Varicode: Just noticed that wasn't the case some time ago
Knarez: LUL
Yaak0v: weird flex
joker2k999: but apparently only py3 because if you use py2 your a degenerate
nevroje: LUL
joker2k999: but ok..
wall_streeter: @joker2k999 LUL
wall_streeter: @joker2k999 but still, why?
joker2k999: i don't make the rules` bro
wall_streeter: @joker2k999 you just follow them? :( Are you a government employee or smth?
Lazysloth: man the gov is rich, they got funds to infiltrate a twitch stream
HoodedCloak: I watched your video interview. Super Hacker George Hotz: I Can Make Your Car Drive Itself for Under $1,000 and I just wanted to tell you that you remind me of Dr. Rodney McKay from Stargate: Atlantis and he was my favorite character. You have the same mannerisms, especially in that view interview.
enlightenedwaterfowl: High praise
HoodedCloak: Video interview*
Varicode: @HoodedCloak <3
HoodedCloak: :)
joker2k999: lol, bigSwag return is always good.
Varicode: LUL
th3_maj0r: ahahah
ericswenson15: You don’t like point and click editor?
Keyyyz: hell yea got to catch a stream
joker2k999: more or less being inflammatory ..
joker2k999: time out hammer incoming. lol
HoodedCloak: Dr. Rodney McKay was an absolute genius of the Stargate universe.
ericswenson15: That’s cool
HoodedCloak: So that's why people are saying it's high praise, probably.
Varicode: LUL
ericswenson15: You prefer it?
joker2k999: lol!
ericswenson15: Lol i never know what to do next while I’m actually building, so I draw out plans sometimes
Cube_Is_Life20: has geroge done any projects like his own os or browser? I'd download those in a snap
ericswenson15: And then build to that
ericswenson15: Then I can get a bunch of iterations on the plans
ericswenson15: Low coupling is everything
ericswenson15: Based on what I’ve read
lbucci3: - what problem r u trying to solve?
ericswenson15: For testing
ericswenson15: For refactoring
ericswenson15: Pub sub drastically reduces coupling
ericswenson15: You don’t seem coupled to any framework that is good
enlightenedwaterfowl: There are other messaging patterns beyond pub/sub, but yeah, decoupling is a good idea
ericswenson15: Yeah
ericswenson15: Scatter gather
ericswenson15: Coupling is where you have low dependency between components
Varicode: BIGSWAG
ericswenson15: It’s small functionality
joker2k999: trying to solve whether to more work later, or less work now...
joker2k999: *do
ericswenson15: It’s the same reason microservice is better than monolith
ericswenson15: It means you can easily pull apart code
ericswenson15: So less than 20 line functions
ericswenson15: Short files
ericswenson15: These thing naturally enforce low coupling
ericswenson15: Single imports in segregated files
enlightenedwaterfowl: Looks like 409 is a good status code for already-exists ("Conflict")
ericswenson15: That provides sing point of reliance
toolegit2quit_: watching ads for you george.
aresfour: george, did you go to uni?
joker2k999: lol, not sure if i like any enough to watch adds for em.
ericswenson15: The opposite of low coupling is a single file with every import and 1 function doing everything
ericswenson15: Long function and file names also reinforce low coupling
enlightenedwaterfowl: I dunno about that one
ericswenson15: Because specificity naturally introduces a need to separate functionality
pau1riddle: I saw some madmen disable hjkl in vim. So that they use / sor navigation.
ericswenson15: Robert Martin recommends 5 to 6 word variable names
enlightenedwaterfowl: I'd take that with a grain of salt
pau1riddle: Martin is a scam
ericswenson15: So idk but I extended that to file names
joker2k999: haven't used vim is so long...
ericswenson15: Yeah idk it’s just what I read
itsyaboyegg: as someone new to programming, is learning vim useful?
ericswenson15: The author of testable JavaScript says low coupling is the best way to combat untestable code
fowlmoves: what type of keys are those?
pau1riddle: %s/start_response/sr/g
fowlmoves: @itsyaboyegg its completely optional
ericswenson15: Iright
ericswenson15: Your pref
Lazysloth: itsyaboyegg if you are new to programming you have bigger problems then learning vim, but eventually it will be useful
ericswenson15: I use atom which is really nice
fowlmoves: @itsyaboyegg IDE will do just fine, just as emacs would
itsyaboyegg: is there any advantage learning it?
ericswenson15: Yeah
joker2k999: learning everything is useful. what not to learn.... theres a start...
ericswenson15: Robert Martin says your terminal is like your workbench
Lazysloth: cool story
ericswenson15: But I like atom because it helps me mentally
ericswenson15: Yeah idk lol
joker2k999: until they turn off your power..
Cube_Is_Life20: I think you forgot to change one of your start response's
izhosrs: hey @georgehotz can you send me a self driving car?
fowlmoves: @itsyaboyegg there isnt any inherent advantage to knowing vim, other than being useful when you remote into almost any *nix machine
Lazysloth: well there is more advantages then just remoting, its a great editor
fowlmoves: DELETE should retuen just headers. no?
fowlmoves: return*
fowlmoves: Optional body
aresfour: 204 no content
Harm133: thats what she said KAPPA
itsyaboyegg: @fowlmoves cool, thanks for the input
ericswenson15: Coupling is the boundary where you say, if I change this I also have to change this
ericswenson15: So you want to introduce boundaries between those two pieces of code
Harm133: what are we building a key value store for ?
ericswenson15: Because if each has a different rate of change
joker2k999: a bunch of SR. programmers use vim.
fowlmoves: Yeah API interface boundaries
ericswenson15: Then you can minimize on adjustments
joker2k999: since emacs i haven't looked back. still can't write lisp to save my life. lol
ericswenson15: An api with lots of function implies low coupling
enlightenedwaterfowl: Redis is great
ericswenson15: And yes that apis exist
joker2k999: go Redis bro.
pau1riddle: People say Redis is already pretty minimalist.
enlightenedwaterfowl: It is
ericswenson15: An api decouples your app from the api functionality
Lazysloth: !uptime
fowlmoves: It is very minimalist
Lazysloth: rip no bot
fowlmoves: But has most features you need
ericswenson15: High coupling means it would be hard to swap out your db
enlightenedwaterfowl: Yes it is
ericswenson15: Low coupling means you could switch in any db
enlightenedwaterfowl: Redis is highly configurable. You can put it into append-only file mode and maxmemory = 0, it's a quite different service at this point
enlightenedwaterfowl: Can be as reliable or unreliable as you want
ericswenson15: Highly configurable is good apparently
enlightenedwaterfowl: Did George Martin say that?
Lazysloth: burn
0TestUser: close to the 10 k on insta :D
ericswenson15: The author of tao of microservices says you should build so the app is highly configurable
pkacprzak: is posting link to AI/CV app I've recently published on reddit fine in chat? I'd like to get your opinion
ericswenson15: And yes lol he also says it
ericswenson15: George Martin says to build from configurable functional requirements
foxubu: The warmest greetings from Germany :)
ericswenson15: Though with microservices that mayb be harder
Lazysloth: ericswenson15 change your name to GMsays
ericswenson15: I suppose you could use a dashboard
foxubu: What? Python 2? :o
ericswenson15: Haha
ericswenson15: You first
joker2k999: lol
ericswenson15: Idk
foxubu: Oh sorry. Just the docs
joker2k999: gonna miss py2..
ericswenson15: Uber switched to microservice
ericswenson15: One exec wrote a book
enlightenedwaterfowl: (FWIW geohot, Redis definitely backs up to disk, per configuration)
ericswenson15: Def from a non dev perspective
ericswenson15: But really insightful
ericswenson15: She says chaos testing is the most inportant test for microservices
ericswenson15: So random extreme tests
ericswenson15: Like high load
enlightenedwaterfowl: Yeah she's probably wrong
Cube_Is_Life20: @pkacprzak no? he's not doing code reviews atm
ericswenson15: Or simulate failed service
ericswenson15: Lol idk
enlightenedwaterfowl: "Chaos" testing is not useless but it's not "the most important"
ericswenson15: Oh ok thanks
ericswenson15: What is most important?
pkacprzak: @Cube_Is_Life20 I meant for chat, not George
ericswenson15: Regression is what I do
ericswenson15: Integration is hard for me
enlightenedwaterfowl: "Chaos" testing is something you do when you're massive company like Netflix, Uber, whatever, and people are actually depending on your infrastructure
ericswenson15: Right
enlightenedwaterfowl: It's not something you need to worry about until you're an engineer at Uber
ericswenson15: You’re smart
ericswenson15: Haha
ericswenson15: Is the whole world moving to microservice?
ericswenson15: Where I work it is
ericswenson15: Apparently it reduces developer ego
ericswenson15: Because it’s not 1 person building the whole app
ericswenson15: It’s a bunch of teams
ericswenson15: Makes for more pleasant people lol
enlightenedwaterfowl: The thing is, it doesn't really matter. "Microservice" is just a pattern for structuring programs. It doesn't necessarily make anything better or worse
ericswenson15: At Uber they measure microservice quality by availability
kanogger: will we hit 10.000 today?
ericswenson15: They us 9’s
ericswenson15: So 99% availability
ericswenson15: Vs 99.9%
ericswenson15: So getting Dow to the actual seconds
ericswenson15: Lol
Varicode: PepoG
ericswenson15: That’s bug
ericswenson15: Big
ericswenson15: That’s a macroservice
joker2k999: you can doo it bro
ericswenson15: But I don’t worry about number of lines til I’m done building
ericswenson15: I go back and break apart
Jiggletoes: if it works u eat ass
ericswenson15: But I do use tiny functions that are extremely explicit
ericswenson15: Robert marring says no arguments to a function is best
ericswenson15: Followed by 1
enlightenedwaterfowl: No arguments means it's probably a side effect
enlightenedwaterfowl: Which is actually the worst
ericswenson15: And it gets exponentially worse as you add arguments
enlightenedwaterfowl: Please take everything you read with a grain of salt
ericswenson15: Because each implies additional coupling
joker2k999: tabs looks like my browser when I'm trying to remember the pip update command..
ericswenson15: Yeah I have no clue
ericswenson15: But reading is insane
ericswenson15: It’s like better than a whole year of coding
ericswenson15: No joke
ericswenson15: Good job on your function length @georgehotz
SGK7: Ppl appreciate what u have to say but ur sounding like an evangelist now
enlightenedwaterfowl: Pretty sure this guy is a high-level troll
ericswenson15: This other book recommends learning a language a month
ericswenson15: Haha sorry I’m a troll
joker2k999: update that py3 bro
joker2k999: lol
alienware997: alienware997 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 1 in the channel!
alienware997: alienware997 gifted a Tier 1 sub to Harm133!
Harm133: Pog
alienware997: ;)
Harm133: Thanks mate :D
Harm133: Mate Im the best
joker2k999: a lotta love in the chat bro's
enlightenedwaterfowl: This eric gentleman is a high-level troll
alienware997: i randomly gifted to somebody so...as long as its not eric:D
Harm133: haha
enlightenedwaterfowl: Thanks @alienware997
Lazysloth: they need to reneg a sub option lol
Harm133: do we get any emotes?
MrSnoopDog: mac so clean
enlightenedwaterfowl: Can you ignore people on this Twitch thing?
Lazysloth: yes i blocked him a couple min ago
enlightenedwaterfowl: geohot: Redis uses disk
kanogger: nice didn't know that, thanks
alienware997: alienware997 gifted a Tier 1 sub to Lazysloth! They have given 2 Gift Subs in the channel!
enlightenedwaterfowl: Thanks
Harm133: LUL
Jiggletoes: lmao
Varicode: LUL
kanogger: PogChamp
joker2k999: LOL
RomanNYC: LUL
Lazysloth: wow thanks alienware997 :D i can talk shit now
anatoly1974: how many languages do u code with @georgehotz
joker2k999: so you'll show up at.... 9:05?
kanogger: rip
joker2k999: damn... that power tho..
joker2k999: lol
Varicode: Wait why did we ban @ericswenson15
Cube_Is_Life20: @anatoly1974 he uses python3 for everything he can
Varicode: George was engaging with him about the code
joker2k999: because people sometimes don't like enthusiasm
Varicode: :/
Jiggletoes: george hotz long weiner
Knarez: could you use a lock
waterpringles: handsome
alienware997: @joker2k999 espacilly when somebody spams. i mean no Problem to write more and often but for every sentence a new meesage? so i'm fine with that:)
alienware997: alienware997 gifted a Tier 1 sub to Cube_Is_Life20! They have given 3 Gift Subs in the channel!
joker2k999: i figured George was gonna make him sub if he wanted to spam like that.
Harm133: since Im a sub now and you answer sub questions, what do you think about go ? @georgehotz
Jiggletoes: so many gifts why
Lazysloth: i like go's mascot that's about it :D.
giovannag: Why not :D
joker2k999: lol
Lazysloth: oh gofmt is cool too
pau1riddle: I remember George said about Go, it was "disgustingly verbose".
Harm133: :)
joker2k999: i think you use what you know best/first then port...
alienware997: im a little bit languid....or maybe im just friendly and like to make a gift to somebody. And when the gift is also helping this entertaining guy in this black box on my desktop gg:D
Cube_Is_Life20: oh sgiz I just looked at chat thanks for the gift
alienware997: np:)
Harm133: host immortal.local
Harm133: /etc/hosts
JumpTwiice: what keyboard is this?
kougithings: @jumptwiice: probably a HHK
joker2k999: dang, i gotta use 3/4 my screen to actually read whats goingz on
Harm133: I contributed to opensource Pog
JumpTwiice: PagChomp
mmmmmgrayonss: PogChamp
ericswenson15: Sorry what was I banned for?
enlightenedwaterfowl: Trolling. Stop trolling
ericswenson15: Oh ok sorry
enlightenedwaterfowl: Oh
JumpTwiice: Oh
ericswenson15: What dB you guys like?
andreas_bylund: oh
jay_al97: urlopen is easy
ericswenson15: Oh
ericswenson15: I read MySQL has nore accuracy?
alienware997: anybody interested in an indian ctf? Should run since two hours now and its organized by the Computer Science Departement of University of Delhi. check ctftime when you're interested in helping me)
ericswenson15: Have you guys tried multiple dbs?
Cube_Is_Life20: ay the instagrambot-py library I used uses requests
ericswenson15: What are we building?
ericswenson15: Nice
giovannag: @Cube_Is_Life20 Is that a bad thing?
ericswenson15: What does it do?
Cube_Is_Life20: @ericswenson15 comments, follows, likes, etc. @giovannag no I just thought it was interesting
JumpTwiice: LUL
Harm133: LUL
PeterBensch: PeterBensch subscribed with Twitch Prime.
Varicode: LUL
joker2k999: LOL. oh wow bro
alienware997: Twitch Prime is free!
myaocat: YouWHY
joker2k999: LOL.
pau1riddle: He is a stalker
andreas_bylund: LUL
Varicode: Tfw Preston tries to work for comma but forgets he has to get into google first
mmmmmgrayonss: ya yeet
KhaosVFX: esketit
myaocat: ba
geobitz: i dont think youre an asshole
Varicode: LUL
giovannag: @Cube_Is_Life20 Oh, nice ^^
myaocat: block him too for lols
iamchoco: Any reason for not using python async features? This would seem a good fit
pau1riddle: I would work at Google, though, to be honest :)
geobitz: i think youre like the donald trump of coding but not so narcassitic
Knarez: LUL
joker2k999: then he passed the weed right.. lol
pau1riddle: It's 2019, lol.
myaocat: he said 2018
PhillipWei: the hotness is startups
geobitz: neither is donald trump
TheTastefulToastie: these days it's landing a job at netflix
myaocat: yo im geohot and those who dont know im getting sue by sony B) B) B)
myaocat: are you building backend why no rust/elixir/nodejs? is python better than them?
kanogger: LUL
joker2k999: told ya...
myaocat: rip
myaocat: god you dont know elixir
xyz: LUL
joker2k999: better because you have to think less..
myaocat: how many left to 1m followers?
th3_maj0r: around 990k
th3_maj0r: only 990k*
joker2k999: that back 990k is gonna be a b*tch
steffeKutta: that keyboard sound PogChamp
Yaak0v: that's me alright. always puttin question marks
enlightenedwaterfowl: Header, response body, escaped query param
Cube_Is_Life20: damn George is giving up on instagram already? he just needs to promote it more with his YouTube audience
myaocat: :(
joker2k999: i think all google(recent) employees finish their term, then go and start a youtube channel. interesting cycle... can't say its a bad idea. gotta get that passive income somehow...
Cube_Is_Life20: apparently the alternative to requests is httplib2
joker2k999: doesn't requests always take a while?...
anatoly1974: ping it ??
sadko12: hey
Knarez: fzzPepega
Levent133: hi
sadko12: i wonder if he sees the chat
kanogger: maaaaaTanner maaaaaWhut bleiloHija
Ishaan96: Hi george!!
Cube_Is_Life20: chat is on another screen to our left, if he looks that way then he's reading chat
Markus_47: killall python ^^
anatoly1974: what are u coding Man @georgehotz ??
Cube_Is_Life20: create 100,000 keys and see how it goes?
Cube_Is_Life20: @anatoly1974 read the title of the stream
rage_au: watching this guy is inanse
thisisweeezy: looking great
enlightenedwaterfowl: Rocksdb?
joker2k999: lol
enlightenedwaterfowl: What's your hesitation with Rocks?
BonchPatrol: apache ignite?
Cube_Is_Life20: CodernityDB claims 100,000 get and post requests per second
joker2k999: yea then BOOM. lol
enlightenedwaterfowl: He's looking for an embedded k/v store
enlightenedwaterfowl: (I was an early employee at Ripple. We went through a bunch of embedded DBs)
enlightenedwaterfowl: Rocks is good. Not really sure what your issue with leveldb is though
joker2k999: he's gonna go hit the bong...
MokBeBek: What about Pickle ?
Cube_Is_Life20: zodb allows your multi access
enlightenedwaterfowl: Redis ftw
rage_au: Redis
enlightenedwaterfowl: Probably put it in AOF mode
joker2k999: looks sketchy huh...
DrRobotvinnik: you're my personal maxkeyvalue George <3
rage_au: Redis is crazy good
anatoly1974: MongoDB
Cube_Is_Life20: how long would it take to make your own?
BonchPatrol: put instead of post?
rage_au: his keyboard skills are next level
Markus_47: What keyboard is he using?
Grimonja: didnt return it from Get
Grimonja: Oh well
keepingtrckofthisacct: !uptime
alienware997: Who wants a gift?
gerntt: me
BonchPatrol: yeet me a gift brother
RomanNYC: me :)
joker2k999: theres a joke in there somewhere...
alienware997: i'm going to smoke some and when i came back, there will be gifts!
RomanNYC: PogChamp
gerntt: PogChamp
Twitch0xme: u need apt update && install on same RUN line
keepingtrckofthisacct: what's the uptime, please?
Yaak0v: @keepingtrckofthisacct Current Uptime: 3 hours, 44 minutes, 34 seconds
keepingtrckofthisacct: @Yaak0v thanks
gerntt: 33 days LUL
fowlmoves: Istn it just ADD or COPY?
aresfour: ADD req.txt /path/in/container
aresfour: or COPY
OrdinaryRamblings: @Legonigel sup
fowlmoves: repo update?
fowlmoves: aha
last_pacifist: slam
lefg7: lol
aresfour: Dockers one process per container policy flew out the window lol
murat_kvebekov: @aresfour, it's one program per container :D
murat_kvebekov: not one process
Trenz2: Ariana Grande Kappa
astr0nils: for ariana grande its worth Kappa
TODNESSISBAE: hi
TODNESSISBAE: just wanned to say u are fucking inspiration
Trenz2: you have to follow on instagram to be inspirational :))
aresfour: @murat_kvebekov then they changed it, pretty sure docs used to say one process per container
Trenz2: @georgehotz when u gonna do some ctf's , that was fun :P
alienware997: alienware997 gifted a Tier 1 sub to aresfour! They have given 4 Gift Subs in the channel!
aresfour: ure right, it was changed in 2017 https://github.com/docker/docker.github.io/pull/1418/files
TODNESSISBAE: yea i have
alienware997: alienware997 gifted a Tier 1 sub to Trenz2! They have given 5 Gift Subs in the channel!
Trenz2: ty dude <3
aresfour: thank you @alienware997 <3
Trenz2: u're awsome
na_chaos_Pepega: PogChamp
gerntt: PogChamp
alienware997: alienware997 gifted a Tier 1 sub to RomanNYC! They have given 6 Gift Subs in the channel!
giovannag: PogChamp
RomanNYC: :o
Trenz2: PogChamp
MokBeBek: Do a bash PWD !
Shinnosky: OSFrog OSFrog OSFrog
RomanNYC: thank you!!
keepingtrckofthisacct: everyone's getting subs...cool
Twitch0xme: its just bringup.sh not test/bringup.sh
murat_kvebekov: i thinku should remove test/
murat_kvebekov: and it will work
murat_kvebekov: just bash -c "cd tmp && ./bringup.sh"
murat_kvebekov: now it's other story xD
BobbyFlo: whats up man
murat_kvebekov: the problem in "copy" command was that u added extra slash i think
murat_kvebekov: so bash copied content instead of directory
murat_kvebekov: it self
murat_kvebekov: imho
alienware997: @georgehotz try Kitematic, its a gui for the docker container where you can rename them and much more:)
ActionIsComing: ayyy man
Xavur_: wassup man
Xavur_: How long you been streaming for?
ActionIsComing: !uptime
alienware997: The one who helps solving the porblem in the chat, will get a tier 2 subgift:D
Lazysloth: i hate writing dockerfiles :( so i can't help
ActionIsComing: lol who cares about subgift
oOocouchpotatoOo: that was mean :('
alienware997: @actioniscoming nobody but its funny
Xavur_: he looks tired af
murat_kvebekov: @georgehotz found solution... https://stackoverflow.com/a/37715522/2480216
darkzade: !uptime
Lazysloth: dark there isn't a bot
murat_kvebekov: @darkzade, 4h 16m
murat_kvebekov: ±
darkzade: @murat_kvebekov ty
murat_kvebekov: yw
Xavur_: so he started streaming at midnight? or where is he from
local_root: there you go my g imma sub
local_root: local_root subscribed with Twitch Prime.
Lazysloth: its probably san diego
murat_kvebekov: @xavur_, 22
AlSweigart: 43 raiders from AlSweigart have joined!
alienware997: Why you just not mount/share the filesystem you need with "-v" when you create the Docker Container?
Lazysloth: Kreygasm
alienware997: alienware997 gifted a Tier 2 sub to murat_kvebekov! They have given 7 Gift Subs in the channel!
Lazysloth: no sub emotes i guess we spamming commas , , ,
joker2k999: HeyGuys
Shinnosky: VoteYea
joker2k999: who says garbage code gets written after midnight...
davidsit_site: thought it was garbage in garbage out
joker2k999: sounds like basic. lol
joker2k999: like a boss.
Lazysloth: commit -m "dockerfiles are hard"
joker2k999: Cheers to you Sir.
Trenz2: border 0 , ink 7
LordOfSubs: twitchRaid twitchRaid twitchRaid twitchRaid twitchRaid twitchRaid twitchRaid
Jiggletoes: big peen in the chat
Mua_987410: where?
Jiggletoes: my hand
LordOfSubs: true
Grimonja: Python is just black magic tbh
risky_banana: you ever start coding and then all of a sudden the sun is coming up and you can hear birds and your wife is super pissed off.... ah wait, that's me
joker2k999: im in that club as well ..
LordOfSubs: It sucks that we require sleep
joker2k999: i know! i can't believe someone hasn't solved that problem yet.
LordOfSubs: Meth looked promising, but we know how that turned out...
Lazysloth: i tried to not sleep and nap, it worked but i got bored and lost track of time
joker2k999: facts.
cmanatlan: Modafinil supposedly works, although I wouldn't personally trust it
risky_banana: modafinil will get you there
joker2k999: ..get you somewhere..
Roundlay: Been using it for 10 years, works a treat
joker2k999: *ahem.
Lazysloth: where do you get it?
Roundlay: The pharmacy
cmanatlan: get it prescribed
joker2k999: gasp.
Lazysloth: are you like European?
cmanatlan: i think you can get it prescribed in the US
Roundlay: Expat in Japan
risky_banana: its used for night-shift workers to reset their body clock
cmanatlan: Roundlay oh probably can't in japan
risky_banana: or idiots to stay awake and super focused
risky_banana: either
joker2k999: spy? don't answer that.
Lazysloth: of course japan would have modafinil haha
cmanatlan: oh you're the one who's taking it. can you get modafinil without an Rx in japan? @Roundlay
Roundlay: Not legally
th3_maj0r: lol
Roundlay: But sure
cmanatlan: lol
cmanatlan: meant at a pharmacy
Roundlay: Nope
alienware997: Kratom has become illegal in the US, isn't it?
LordOfSubs: no
joker2k999: chat has gone so left.. lol
LordOfSubs: well some States
quickfloor: bro
lostshiya: @georgehotz I'm an absolute zero in infosec, what's the best place to start?
cmanatlan: joker2k999 what do you mean? how is this discussion even political/social
cmanatlan: we're just asking what drugs are legal :P
joker2k999: LOL.( <--) just means 'it took a turn'..
alienware997: @sheyjoko i thinkthats the wrong place to ask that:)
Grimonja: They just dont want to die D:
cmanatlan: oh you meant it took a left turn?
Knarez: LUL
quickfloor: Why George behind is ordered ? that is not a hacker room :(
alienware997: @quickfloor George likes it clean, like his code xD
Lazysloth: putting stuff in tupperware is ordered?
NMODE: ko1ayPepeV ko1ayPepeV ko1ayPepeV
joker2k999: true.
NMODE: ko1ayPepeV russian hackers ko1ayPepeV
murat_kvebekov: & - needs to be at the end
murat_kvebekov: to make it background gprocess
murat_kvebekov: ow
murat_kvebekov: thanks for sub
murat_kvebekov: didn't realized it
quickfloor: and you guys did you understand something is changed ? yaa that is tmux style
joker2k999: your gonna be later for your coffee chat broSeph
Roundlay: What time is it where George is?
murat_kvebekov: @roundlay, 3 am
EventHorizonxD: look at you go mate
alienware997: @murat_kvebekov no problemo:)
murat_kvebekov: @alienware997, ty :D
Roundlay: O:
murat_kvebekov: @alienware997, was concentrated to what he is doing, and didn't lokked in chat for a while :D
TODNESSISBAE: how long has he been streaming
kanogger: !uptime
joker2k999: !uptime
alienware997: @murat_kvebekov same problem here:D
quickfloor: !followage
murat_kvebekov: 4:50± uptime
TODNESSISBAE: !uptime
Lazysloth: no bot guys, your commands are useless
TODNESSISBAE: lol
murat_kvebekov: @lazysloth, 4h 50m
akbang47: no bot wa du HEck
joker2k999: of course, hackers never use bots
quickfloor: !keyboard
quickfloor: Leopold FC750R
joker2k999: lol
joker2k999: thats cute.
NMODE: we are bots chat MrDestructoid
murat_kvebekov: @quickfloor, 12 nov 2018
murat_kvebekov: @georgehotz for background & - needs to be at end of command
quickfloor: Stackoverflow background is really Ridiculous
Lazysloth: it was april fools, gotta wait till the person managing it wakes up
quickfloor: How does George focus on this keyboard sound? or that is loud for us
NMODE: only this year I found out that fools day is in many countries
myaocat: hack the gibsons
joker2k999: thx for the stream broSki
joker2k999: get them diffs in
quickfloor: u going to Starbucks tomorrow ?
Roundlay: You can change the SE april fools thing with the time icon up top
JonThomasK: whats up george
quickfloor: @georgehotz u picked the best category bro . this is so Basic
myaocat: anyone can explain what is he doing? cant understand
2_kka: Finally caught the stream live, shoutouts to comma ai archive
local_root: !uptime
Shinnosky: !favorite_sushi
Lazysloth: yay passing you may sleep
2_kka: Also wasn’t George’s twitch channel named tomcroose or something before? I thought I had followed the channel in twitch ages ago but the name’s different now
myaocat: hack the planet!!
quickfloor: U won !
Roundlay: gg
JonThomasK: WE DID IT
quickfloor: Good game
Roundlay: <3
TODNESSISBAE: nice
skinzo1998: NO i just got here xd
joker2k999: peace bro
quickfloor: !instagram
anudeepgi: PogChamp
JonThomasK: we instagram famous?
myaocat: thanks for streaming although couldn't watch from statt
joker2k999: more rants bro
Grimonja: Is it 302 redirect? not 307?
Grimonja: Went afk for few hours
PhosphoricAcid: comfy streams
skinzo1998: time difference :( it's ok i'll still watch it on youtube
TODNESSISBAE: when are u going to stream again
PeterBensch: buh bye buh buy, sweet dreams PokPikachu
quickfloor: Angur hoodi ?
2knucklechamp: Please be on tomorrow
2_kka: Quick! Ask about crypto before he’s gone
JonThomasK: ill get qira docker going.. been really busy. @georgehotz
quickfloor: *augur
JonThomasK: bye
quickfloor: Could qira be secend ida pro :D ?
joker2k999: yea docker gets good. good tool for the tool box
TODNESSISBAE: bye
pau1riddle: peace
th3_maj0r: peaceee
2_kka: Later George
Atxpert: i just got in :(
ggwpl2p: bye dude
myaocat: bb
Shinnosky: Grey hoodie cheerrr uuuup
anudeepgi: bye
TODNESSISBAE: when are u going to stream again
Grimonja: Yea i did but on Readme it said 302
alienware997: Bb:) good night:)
myaocat: hack the planet!!
Grimonja: So just syaing
joker2k999: lol
Trenz2: have a nice one man !
JonThomasK: "Fuck off with the crypto"... new band name
Shinnosky: U right
ggwpl2p: lmao
TODNESSISBAE: legend
myaocat: hack the planet
myaocat: hack the planet!
joker2k999: he turned into Confucius there at the end. lol
 
good
morning I don't want to die I hum under
my breath as I fight death in the quiet
depths of the
bunker uh GM GM everybody let's go uh
look at this keyboard man this is my new
keyboard okay it's
tiny all right should we use this tiny
keyboard for the stream proving once and
for all that it absolutely doesn't
matter what keyboard you have even a
small folding
keyboard uh tiny keys no no no no but
okay guys no there's been all right
we're feuding with a company right now
okay there's a feud going on we can
we're going to lower this this is a
little loud we're going to we got a feud
going on and I'm going to tell you all
about it um because I you know I just I
just on this stream I just I want you to
not make the same mistakes I
did uh no no no it's not well you know
what it's qualcom related kind
of um how many people we got we the feud
the feud aspect has to wait till we get
some some more people in here uh no no
no no more patent trol no more
Patrol uh no no no no it's it's not
qualcom you love drama I know that's
what you're in here for
right uh okay so I bought a OnePlus open
okay I bought this phone I bought it
from the OnePlus store that was my first
mistake uh never never buy anything not
from
Amazon no like never buy anything not
from Amazon I was like oh I can save
$200 I seriously screwed up uh do not
ever buy something
from uh from the store that's not
Amazon okay so that was my first
mistake um so I got the
phone and uh I bricked it okay all right
I bricked it I bricked it no way no way
I I I set the fast boot partition to B
ironically to try to not break it I did
Fast boot set active slot B or whatever
uh yeah so I set the actor slot to B
because I was like oh well you know I'll
I'll I'll mess around with b and I can
always go back to
a well it turns out that when you do
this you get
qdl uh you end up in in in qdl uh mode
now I've owned OnePlus devices before uh
I owned two other OnePlus devices I
owned a OnePlus 3 and a OnePlus 5
OnePlus historically has released all
the qdl
data
uh so I was like whatever I'll download
it oh I'll have to get I'll have to get
a uh I'll have to get a Windows
Phone let's see if we can find
it
um turn this off we'll see if everything
still works
I
got yeah
so OnePlus let's just download like like
system
images
uh wow their website is very slow um but
yeah yeah so for those of you just
getting in here whatever you do never
buy anything thing from the OnePlus
store uh for reasons that will that will
become apparent in a bit uh all right
well like the website's fucked but the
moral the point is you can't download
any images for the OnePlus 10 the
OnePlus 11 or the OnePlus open uh
OnePlus stopped releasing images to
restore so my phone is stuck in qdl mode
it's not broken it's not bricked they
have software that in 5 minutes can
restore it the problem is I don't have
it uh the software for the OnePlus 11
leaked see like I'm working out how to
like really put this into a Twitter
Zinger because this
company so I'm just like you know what
if I don't have the software I don't
even want the phone I'll return it right
uh return policy within 15
days uh they won't take it
back they they will they will not take
the phone
back um and like look I don't care about
the money I don't care about you know
it's not even about that like I'll keep
the phone
it's uh I I I just said I look coming up
as I I posted the coming up is Qualcomm
q q USB do you have tool to fix uh hi we
don't have tool to fix I'm like okay if
you don't have tool to fix I want to
return the device I liked OnePlus for
their openness but it seems qdl flash is
no longer available after OnePlus
9 hi George thank you for your response
as per the explanation below the device
has been rooted it actually has not been
rooted because I uh all I did was
literally fast boot set active B uh we
will be unable to create a return
request and process the refund we will
be unable to create a return request um
so OnePlus is refusing uh to take my
phone back and you know what guys I
fucked up on multiple ways I mean I set
the partition to be and I bought
something from the OnePlus store but
this is a company that has absolutely
and completely destroyed their brand it
is so sad that they've gone from the
OnePlus 3T in the comma device to take
the fucking phone back it will take you
5 minutes to run the software to restore
it I'm happy to run that software but
you didn't give it to me uh and you know
what honestly could I figure out how to
do it sure I could spend all weekend
doing it but I'm too old for that
shit um I I'm so I'm so disappointed and
then like you know it's just like come
on man let me return the phone no no no
no no you can't return the phone we're
not honoring our policy you read the
policy does it say anything about
rooting or anything like that no it says
don't you know tamper with it or open it
um so I did a charge back and just like
you know it just it made me have a
realization being on the other side of
this and I never want Kama to be like
this uh I I just I cannot believe that
this company has gone from oh I kind of
like their brand to completely
destroying their brand in my mind do not
buy a OnePlus phone and if you really
want to buy a OnePlus phone if you
really decide you still want to buy a
OnePlus phone uh buy an on
Amazon what kind of company doesn't let
you return
something um so I think we're really
good about this at comma uh you know the
30-day money back guarantee at comma is
really complete and true we take them
back in all sorts of States I mean look
if you if you broke it on purpose but
you know the phone's not even broken
they can run their their factory restore
software it'll be fixed in 5 minutes um
but you know it just it just leaves such
a bad taste in my mouth I'm sorry sir
but we cannot help you process a return
request well why do you say you have a
uh you know no questions asked 15-day
return policy do not buy do not buy from
the uh from the OnePlus store uh always
buy on Amazon you have like no consumer
protection and now I'm dealing with the
bank to do a charge back and you know
what like guys look I don't even care
the problem is like you just piss me off
man
um just just
unbelievable
uh they can sue me though you're not
supposed to charge back when I'm not in
the right what do you mean I'm not in
the right they have a 15-day return
policy you may request a refund or
replacement within 15 calendar days of
delivery defects or damages caused by
misuse neglect physical damage tampering
incorrect adjustment normal wear and
tear or incorrect installation I
genuinely don't think any of them apply
all I did was run fast boot set active
B um but also it's
like it doesn't even matter right
like
why oh no no no look I'm not trying to
keep the phone I'm trying to send the
ship back I'm I told them Monday if they
don't give me an address I'm just going
to ship it to their office and like it's
just but like why would you H why would
you have a brand like this you know what
I mean and you know I told him I'm like
hey man I got 200 you know 22,000
Twitter followers we got to figure out
how to write this up as a as a neat
Zinger on Twitter uh but it's so sad I I
really recommend you don't buy this
phone
um just like like
cuz you know I compare this to Apple I
compare this to Apple my MacBook was
late in being delivered and like I was
mad about this and the first thing they
say is well you know you can always
cancel the order and get a full refund
and I don't want to do that right like
look you know things happen whatever I
want my MacBook um but the fact that you
offered that to me made me feel
good I don't really want to return this
phone I don't care I just want to
unbrick it uh and you know you know what
I could probably piece together the edl
software from the OnePlus 11 I'll maybe
I'll do it fire hose they added this new
thing called uh you know I added this
new thing called VIP verified image
programming you just got to work around
it and like like once you're Brew
installing gidra again and I'm like yeah
I could do this but I'm too old for this
you know like like why are why don't you
just here so did this finally load no
their website's broken um but yeah they
stopped releasing the images after the
OnePlus 9 uh so you
know I'm still giving this issue my time
yeah cuz it upset me okay it upset me
and like like you know what you know
what guys you know how the P you know
how you know pickles from BoJack
Horseman uses the pickle pack to help
process emotions you guys are here to
help me process my emotions about this
how should I feel about
this uh no I don't like
it's so disappointing like I you know
what the Google pixel fold is worse but
I should have bought it like and I
expected this kind of behavior from
Samsung right like if I bought a Samsung
phone I know what to expect but you know
I thought OnePlus was better the irony
they call at the open
like
H H but yeah no whatever you do whatever
you do I'm not even going to tell you
not to buy the phone I'm not even going
to tell you not to buy the phone but
whatever you do do not buy it from the
OnePlus store never buy anything from
the OnePlus Store buy it on Amazon where
it would already be on its way
back uh absolutely absolutely insane and
like like why do you do this right like
this isn't worth it and this is this is
my philosophy of coma too like I
really I ask people you know when they
come in Discord and they ask something
I'm like I really want you to put
yourself on the other side of this right
I really want you to put yourself on the
other side and you know what I do put
myself on the other side I run a
consumer electronics company sort of I'm
not I don't really run it anymore but
you know uh I used to and
uh
just we we we every customer like we're
just like please send it back like just
please send it back we'll give you your
money back right like we don't want you
to have a bad time we want you to send
it back uh and the fact like I didn't
even want to send it back but when you
told me I couldn't fuck you I'm sending
it
back
ah no that's all yeah like why do you
want me oh you can send it in for repair
like you know what no but see then then
what really infuriates me is guys look
you know I still know how to hack phones
and stuff I could fix this I could fix
this I could release a nice tool on
GitHub that reimplements I was looking
at like this this like edl thing and
like this you know the the world has
become like like inofficial no that's
actually like I don't mean to hate I
don't mean to hate it's actually it's
it's pretty good but
like there's like this doesn't implement
this this
VIP uh programming I could implement it
I could write a restore script for
everybody in their OnePlus open but why
would I give them that you know why do I
want to help this brand out I want to
send this phone back and never think
about OnePlus again uh no it's not good
content like like like you know I
emailed the CEO you know I've met the
CEO too which is it's just like sad it's
just it's just sad when these people
take over these Brands and they just
they just do not
care um and look it's not going to
impact sales tomorrow this isn't going
to impact sales tomorrow I am hoping
that if I I may maybe maybe five people
will watch this video and decide just
you know what I don't want to buy a
OnePlus open now good good like don't
don't like or if you are going to buy it
buy it on Amazon because you can
actually return it
um I don't want a replacement I want to
return
it but I agreed to the policy I agreed
to what
policy misuse neglect physical damage
tampering I think this means if you take
the phone apart you know what I mean
like I understand if I smash the phone
with a hammer you can't take it back and
it doesn't have value to you right but
fast boot set active B which should have
worked cuz you should have flashed both
partitions I mean you know I should have
thought oh maybe they don't flash both
partitions but again like my assumption
that these people just weren't a shitty
company you
know um so oh you agreed to the policy
like okay you could say I'm in the wrong
I don't really care about the 1500 bucks
but like
they have their policy and I have mine
and I'm putting them in blast on stream
and now I need you guys to help me
process my emotions because if we're in
a bad mood uh you know we're not going
to uh we're not going to we're not going
to work on mix we're just going to close
the stream and take a shower and eat
apple
pie
um like if they
had no struggling financially good they
should be cuz like this is like don't
act this
way um yeah no it's just you know what
it's also it's like it's like
disappointing you know like I we we use
the OnePlus 3T in the early comma
[Music]
devices I guess like part of this isn't
even my anger at OnePlus it's my anger
at the phone market in general
like why don't you release the uh why
don't you release the image not only do
they not release the qdl image they
don't even
release there there's not even releases
of like the OTAs you can download
there's no factory images for the
OnePlus open there's no tear down videos
for the OnePlus open uh there's no like
people who take it
apart yeah
um so you know what I'm going to send it
back and buy a
Samsung
uh yeah no and like look look look look
look look look if if they decide if if
my charge back gets denied whatever
that's like what it is man sure you
agreed to the policy yeah I don't really
care but like it just it just makes me
sad that people aren't
better um C companies don't want you to
own your things anymore yeah like like I
was I was sitting I was sitting with
Alex and I'm like do I have to make a
phone
uh
like you know it's just it's a bigger
problem it's a bigger problem
where this device which mediates so much
of your life is not owned by you right
and like you're like oh Apple's good
Apple's consumer focused why can't I buy
porn on the app store right I'm not
saying porn should be visible maybe it
should be a super opt in thing but why
can I not buy porn why can I not
download porn apps on my iPhone you know
it's just like like like a device that
you put so much of your life into is not
owned by you and jailbreaking is not the
solution I I was thinking last night
like you know you go on you go on like
whatever I say infoset Twitter these
people hate me like yeah you know why
you hate me cuz I got out because there
was no future in this shit there's no
future in jailbreaking phones right like
like like as long as you're playing this
cat and mouse game with a manufacturer
who genuinely doesn't like
you like you can't have this um so look
again I Ron a consumer electronics
company trying to do it better um two
ways I've really tried to do it better
one is Forks of the software and the
other is Forks of the hardware right
Forks are the solution to this stuff if
somebody could Fork the iPhone tomorrow
and make the porn
iPhone uh you know again it's not it's
not entirely porn just say porn as an
option um then like this wouldn't be a
problem right then you can let things
compete on the free market but the
problem is these people are so locked in
right I can't make this device how much
did they get the OnePlus 8550 chip for
right uh the the Qualcomm and that's why
it's somewhat Qualcomm
related um no I really can't use a
better example than porn right like like
porn is a very clear place that I think
what what you what percentage of men
watch porn an absurdly high number right
right why does the phone not support
it Android is open source yeah but like
Android's an example of where open
source like this is where it breaks down
right you know and they this is the
gplv3 too isation you can go back into
history and read all about this
stuff
um when I'm making porn pole you can
look up that statistic right
uh but it's just a way again where
yeah patents don't make competition
impossible I think competition's
possible I think it's possible to make
phones uh I think it's just
hard should the percentage of men be
that high no no you see that's the
difference between me and fucking
Communists and authoritarians right I
believe that people should really be
able to make their own choices now you
can talk about if they're stuff
pressuring their choices but I'm not
here to say porn is good or porn is bad
right I'm here to say the market should
have two editions of the iPhone the porn
edition and the non-p porn edition right
you don't choose what other people do
with your life
exactly um no it's just so okay look if
you are going to take one thing away
from this never buy anything from the
OnePlus store and do not expect anything
from their support people um if you do
want to buy the phone uh buy it on
Amazon who will actually return it and
you know again it just makes me
appreciate
Amazon
um you know and like the worst part is
if I bought it on Amazon I might have
even put like I I can Unbreak it from
qdl but like I can put in the effort and
do that and I would feel good doing it
because I knew that I always could
return it but the minute OnePlus told me
that they weren't going to honor their
return policy I have to return it right
I don't have a
choice like like you know maybe it's
oppositional Defiance this order or
something but uh all right yeah I bought
it from OnePlus cuz I like was like oh
you know what I what a ah you know what
I made stupid mistakes in my life I sold
my meta stock what a stupid mistake you
know these are these are my great
regrets in life my great regrets in life
are selling meta stock and buying a
OnePlus open from the OnePlus store um
so I email the CEO we'll see if that
goes anywhere I did a charge back
through the bank we'll see if that goes
anywhere I escalated to level three the
language fucking pisses me off like talk
to me like
a
um all right all right all right just
cuz you know what it'll really calm us
down reading some comments let's read a
couple comments from last week's archive
and then we will get started on this
beautiful stream Saturday you guys know
that black we have to do some meditation
we got to we got to I need you guys to
help me process my emotions here all
right how should I feel how are we going
to get revenge right or are we going to
let it go are we going to are we going
to you know be like Jesus and turn the
other
cheek
um would anything
change well how do we make stuff
change right like that's a question how
do we get OnePlus to release the qdl
files yeah
like no I'm not adding them to Sony and
axel Nicks Sony and axel Nicks crossed a
incredibly serious line when you sue
somebody you threaten violence against
them right that's what it is but now no
you you are threatening violence you are
threatening using the state's power
apparatus against an individual right
like suing somebody like that is really
not that forgivable right um you know
there's times when it's appropriate to
sue people over like limited scope
things but no I mean you know what Sony
and axel ni did is is just like like
Beyond The Pale what OnePlus did like
okay wow they're another shitty consumer
brand right like I I just I had a higher
opinion of them than I should have and
that's that's all I'm really going to
say about that and you
know
uh yeah right like it's not they didn't
do anything terrible to
me they're just like they're they're a
shitty brand and they don't honor their
policy and like okay what are you going
to do about it I should have bought on
Amazon you know it is buyer bew cavat M
tour
right
uh but
we're trying to be better at comma uh
and you know if if I try to be
accessible right like if somebody feels
and look there are 2% of people who are
unreasonable right there are some people
who are just so unreasonable and you
just you just have to say no to the 2%
of people but for 98% of people uh you
know I want comma to be good uh and if
it's ever not you can email me I read
all your emails I don't reply to most of
them but you know or you can post a
comment and that is a beautiful segue
into
today's comment
reading this is actually a decent
introduction to C types every time I
watch your videos I get more and more
impressed how you do things grateful for
the content Andre and George are the
only coders worth no come on you got to
give me this is what is this I want I
want good I want spicy
comments well that's because you have to
pay
taxes I don't know oppressive powers and
love the free market oh okay okay okay
okay so I think I'm the rare person who
believes in the free market and
regulation to ensure the free market
right you can't an unregulated Market is
not a free market uh you need to have
regulations to ensure the market is free
right I think it should be absolutely
illegal that Apple doesn't let you Sid
load apps onto the iPhone right
Microsoft got hit with an antitrust
lawsuit for bundling Internet Explorer
with Windows right fast forward 20 years
Apple doesn't just bundle Safari it
makes it impossible for you to install a
competing web browser how is this
legal uh so no you absolutely need a
regulatory apparatus to ensure the
market is
free like I don't know it seems it seems
obvious to me and it seems like one of
these one of these dichotomies well the
Democrats want to regulate everything
the Republicans want everything to be
free like no we want to regulate things
to be free but nobody's going to give
you
that
um yeah the universities are really are
really showing their true cards lately
too so that that's been
nice um whoever these University you
know whoever runs them
uh
word
[Laughter]
salad anarcho capitalism I mean again
the problem with anarcho capitalism is
the exact same thing you can't like okay
I just I want you to ask the difference
what's ask the question what's the
difference between communism where the
state owns everything and capitalism
where Black Rock owns everything right
like what's the difference answer
none uh you you can't have this
right the if all the corporations merge
into one super Corporation that's
effectively the same thing as
communism
uh interns are paid between $1,400 a
week and $2,000 a week I posted the
salaries on Twitter
uh I am a transom and I agree with
George here on wokas thank you thank you
uh yeah you know you know yeah good I'm
happy we went to the we went to the
trans issue last time don't don't don't
don't hate trans people guys hate always
punch up always punch up you
know um JK ring is the root of all evil
no JK rling JK Rowling is an example and
I never want to be that example you
always got to watch out for JK Rowling
which is like you know she wrote Harry
Potter books and now what is she known
for I don't know some feminism oh I'm
going to have some five hour explanation
where I explain to you the real trans
IDE oh my
God H I don't even know it's it's it's
just like it's just like like I just
think of I just associate that with a
Karen you know it's like all right wow
okay no these comments are stupid these
comments are stupid if we're talking
about JK comments are stupid let's go
let's see what we got here okay so we
are sshed into a tiny box tiny
eight transhumanism exactly you should
experience life is all genders I love
this shit uh but you know always watch
out for doing irreversible shit until
the future comes where we can reverse
everything and live in transhumanist
Paradise all right that one goes over
there that one goes over there let's
create an extra let's create an
example and we'll do mixol
dop
all right ten. nn. State import
load uh okay it's a torch
file ohol what should do do
this that going to work so I don't
accidentally corrupt my beautiful uh
model we've been seeding it a while too
just in case anyone
needs hm
interesting
it's probably a good idea
anyway oh
interesting I want to support readon
tensors so this is a good start to
that access
default
oh this is unrelated this is pro this is
unrelated to
access okay that was not fast uh so this
should be a
dictionary Fork in model print K and
actually KV and model do items print k v
do I V do
shap okay uh Cool
Bros oh okay so they're not all
interesting now unfortunately in a tiny
box we only have six
gpus so maybe we just use four of
them until we have a better way to Shard
it
oh I see so the attention's the same how
does this even
work I guess I don't really know how
mixture of experts models
work okay the experts have all different
weights
um we make the code a little bigger I
heard someone said I
Trin um should we get the glasses out to
avoid I strain may we should get the
glass where are my
glasses
uh you know for a long time people have
been able to see things at a further
distance to me and like I got my eyes
checked and my vision's good but the
problem is that I have a
stigmatism and is
interesting all right how much is Black
Rock spending on lobbying it's spending
subscribers only chat on lobbying that's
right
um you can also print the D type by the
way notice how we can do torch load and
it doesn't actually load it anywhere
this is done all
dynamically uh so we can do like uh v.
device
here and you can see that wait
no that absolutely should not be
GPU no no no that shouldn't be
GPU that doesn't make
sense wait
what
[Music]
no that shouldn't be GPU how is it on
how how did I fit all these weights on
the GPU they should be disc you can see
here like this is this is on the
disc
oh oh I see
interesting so this is how we deal these
These Are B float
16 but we're doing this thing
to hack around
them this is this is a converter from uh
bflo 16 to
uh
float uh
16 huh all right we'll comment that out
for
now and now you can see they're all on
dis um yeah so it's creating them but
it's not actually doing the copy because
the tensor hasn't been
realized uh so that's the okay here's
the basic format
um let's understand how these mixture of
experts models
work or maybe there's just
some neural
alignment
it feels strangely different than
anything I've tried
before oh these are this is some
different
model okay what does number of experts
per token
mean I mean I know that this this number
of experts per token number of experts
this is the same as what gbd4
is
two experts at a time
apparently how does it know which one to
run no not myal instruct okay this one's
good
how do I actually run this there's one
linear layer that takes the MLP input
and outputs one scaler per
expert
what oh this is a great stream okay
uh one more official
way
this doesn't look
right called
gate current hacked way of
inference
okay
uh
by the way do I have a
tokenizer I do have a tokenizer by the
way come on how good is mistol man how
good is mistro that's so
cool uh
results what is
this
I don't
know
okay so here
this number of experts per
talk
striped hyena
what they don't need to give more
details in the magnet
like don't figure it out man like we
just dropped this for you that's so cool
that's so
cool respect the hacker culture
man it's coming back you know it's
coming
back
um wait okay we gotta like like is it
actually switch
transformers this is great because this
is also how gp4 works so we're going to
learn how gp4
works
is this striped hyena thing related or
are you guys just talking about
unrelated
shit what is
this oh this is some like like this is
this looks like uh what's the new one
people are hyped about I put a bounty up
for it that was stat Bas
models um yeah what what's the Mamba is
the other one people are excited
about yeah okay does someone have a
clear explanation of how this thing
works give me the simplest explanation
for how I'm actually supposed to run
this
model
check the model weights and there's one
in the MLP called
gate okay I see
gate uh you can check the convert
script Grand the MLP input through that
it gives me eight outputs one per expert
okay how do I decide which ones to
run no I don't really care about this
unless this explains
it didn't you take the top two highest
values okay let's just let's look at
normal llama and then
uh let's take a look at what we have to
do here and we'll see what we can import
from
llama you know we'll just kind of make
it work with the
uh okay we have a Transformer block and
it has something special called gate so
we're going to have to rewrite the
Transformer block we'll call it like
mixture Transformer block well someone
has to have already just written
this
oh okay so
here self feed forward m o
e
all right we'll copy and paste
Transformer block and then we'll change
it we'll see if it can
load mixure transform block from extra.
models. llama import tension feed
forward RMS
Norm from Tiny grad import tens
from typing import
Union
variable
optional
cool and then we're going to need
another class called
[Music]
Transformer FFN Norm attention Norm
attention okay so it looks like feed
forward is the only thing that
changes this is class called
M what if some of them aren't experts
what if some of them are
beginners you name an expert that's like
when Arthur named his dog
pal uh should this really be
called okay
fine this is the
reference
uh feed forward
expert
yeah okay we'll just we we'll stick with
my name and call
it let's see if this official one's
better I don't think this supports
it yeah this doesn't support
it did did mistl drop a real one
to run it I think it was in like a
branch I saw this
yesterday Mega Blocks public no no they
had a they had a branch I I saw it
yesterday here mix
jop
uh this looks
complicated
this looks very complicated but they
call ite so we'll stick with the
name uh another potential inference
implementation
okay these people just called it feed
forward I don't know how I feel about
that
whatever
mixture
feed
forward yeah I saw theire layer I I
don't
know which one was the best one there
was one that I like the best the one
that had thee name that one was like
readable this is readable
uh I don't think is the right name here
I think the right name is like mixture
feed
forward
and
then are the experts just normal
MLPs there's a list of
them W1 W2 W3 yeah I think I can just
use a normal feed forward
there uh
self. experts equals feed
forward oh I need to come up with
stupid these are in you should make
them
mixture feed forward and we can just put
in so this
somehow number of experts per token oh
torch. toop K oh I
see
wow so this isn't
jettable expert
weights wait no no it runs them all I
don't understand
this
yeah I mean this is this is an idea from
uh from pack 8 which is really cool like
it's really cool that this is just being
used and this is what gbg4 is too um so
you know just keep that in
mind
uh okay maybe I just edit this so I
don't need to do
then we can just
do equals
Transformer okay so where are the args
for this
thing. Json
okay
uh Dimension equals
uh hidden
[Music]
dim equals
that and heads equals 32 and KV
heads equal 8
uh
Norm PS = 1 eus
5 uh vocab size equals
3100 and
then
TF block equals mixture transer block I
should probably do is put the number
experts in whatever we can do that some
other time
uh okay is feed forward right there yeah
so feed forward experts and that's a
list those are just normal uh those
things we're going to have to put these
on different
gpus and think about how we want to do
that whole thing's not going to fit on
one GPU good thing we have a lot of
them
okay that's probably still correct I'd
say don't need to do that which is nice
oh we just import Transformer from
here
is the Tiny Box up and running yet yeah
I'm working on Tiny Box right now rest
the station into a tiny
box Tiny Box oh we're missing n
layers n layers is
32 this such a weird
ordering
put here doesn't matter KW
args okay mixture feed forward and it
takes four positional arguments but five
were given oh this is stupid
linear I don't really care about that
let just to deal with that shouldn't be
like that we're going to refactor that
someday uh
okay feed for
linear that's
good okay the model
built
uh get State
de
[Music]
do
items uh okay we should like check if
they're the same or
something can we
assign I have like code for
this uh but I hacked the B flat
shit
um a state loader
somewhere load State
deck I don't know if that's really what
I want to
do want something that looks kind of
like that though
okay uh V do
assign State sub
K you in I assume they all are be FL
16 they are okay
good no fake B float 16 to float 16
good thing we made that fast just in
time thank you
kilin okay we are lacking in the freaks
cyst
Department
um we have that in the model but we
don't have that
in yeah okay that's fine we just skip
that
one oh also if you're into feuding with
companies check out the latest in the
feud with AT&T my Feud with AT&T was
over but they showed up and sucker
punched
me uh no they tapped me on the shoulder
I'm not going to say A Sucker Punch but
uh you know don't tap me on the shoulder
man
um what's that what's that song you know
internet love I'm on the internet cuz
I'm an internet
Thug what are we doing we're trying to
get mixl to
run okay that's all pretty
good
um is it going to like
work now we have to write this have to
write mixture feed
forward squeak
glue never at the top just feels so
unreachable I dropped out a c cuz I'm
completely
unteachable Quentin's new friend yeah
yeah Alex says I'm not allowed to name
things Billy anymore I always want to
name things
Billy all right so how do I implement
this can I put in the
gate what's particularly annoying is I
can't actually copy all the way to the
GPU uh but let's just try it anyway I
don't know where's my where's my llama
inference engine probably the one coder
is
better tokenizer
crap
okay let's just
try start pause
equals wait
what do I have it so I can pass
temperature into here yes I can okay I
don't know what's a good
temperature how we feeling temperature-
wise 0.7
uh start pause equals
z and talks equals I don't know that
that sounds
good am I hosting the Tiny Box in a data
center uh a compute
cluster start pause should be greater
than
zero don't really know why that
is
[Music]
oh no jet no
jet underlying buffer is not
writable see that could have been bad I
think I just tried to write to some of
my oh yeah that's bad wait no
what cing Q right buffer from
MV
oh well it doesn't like that I did those
hacks
for
this is also terrible I didn't realize
that uh we're going to have
to going to have to do some El Cho let's
El Chapo that where's where's where's my
Choo El
Choo it's not in help that's in Ops
right you see how that's printing too
much I'm not happy about that so let's
fix that let's new code uh it's not an
Ops either it's in
device
it's
here because I now pass in the
device something like
that okay now it looks more
beautiful no if you're getting errors
trying to use metal this is a known bug
there's people complaining about it I
don't really know how to fix
it cuz I can't reproduce it uh oh we got
to do that was that copy we got to do
that there too got to get the Choo out
uh
copy I forgot that dis devices could
have very long
names that's in realize maybe no it's in
device where I schedule the copy where
do I schedule the
copy
um internal buffer copy
here we're doing 10 and we're chopping
them to
10 good now it looks
beautiful uh no it's not your fault the
bug's annoying you can you can read
about it um wow W look at all those
gigabytes that's too many gigabytes
man okay underlying buffer is not
writable can I have a readon memory view
in
Python what if I
can't you're off topic
now data.
readon
underlying buffer is not
writable
interesting can I do a const pointer in
C
types which by the way which
specifically I should be using python do
I have 311 on here got to install it
because I think python 311 will tell me
which actually raised the error
right why does that come up all the time
any
know oh wait we're going to have to
install all of tiny grad's dependencies
you ready ready you ready for this we're
going to install all of tiny grad's
dependencies in Python
what
oh s pip install d e do
right oh npy had to download oh look how
long I took to install npy this is all
of tiny grad's
dependencies okay two typed Dot from
buffer I
see from buffer C types from buffer what
else is like fromont buffer but
const from buffer copy
no
C types instance that shares the buffer
must support the writable buffer
instance we are not making
copies for a bite array that is
what um address of from buffer
okay I want C types read only memory
view all right I have an
idea think Quenton can help us sorry I
can't use chat GPT on
stream it's against the open AI terms of
service no I'm sorry I'm spreading flood
it's not really against the open AI
terms of service I just don't want to
show you guys my chat GPT history so
then I'd have to log into something so
let's ask quen
create a read only view o
oo string
buffer wait what does that make a
copy oh oh
no I can pass the string as a
parameter using ctypes pointer
interesting um can
I get a cons pointer in C
types wait for a constant value these
types are immutable and can be used for
read only memory access
what bites or integer address expected
instead of string instance okay I know
let's try some
stuff so what if instead of this what if
I just literally
do
this does that work C types is really
like finicky
and expected C Char instead of memory
View
okay the from buffer is
failing maybe I can hack the memory view
can I
unset the read only
property on a memory
view oh
no
no uh okay memory view has like a bunch
of
weird we have to get big mistel up it
can answer my
questions probably someone like cast it
to not be read
only oh to read only okay how do I do
from read
only I mean look we
can hack this all to not
uh like we can just not make it read
only but it's something we should fix
anyway right and I know you guys like
when I struggle so that's
good
foreign functions which help a
microaggression
um okay uh convert a memory View to a c
types
object no I don't want to do that okay
where is this actually being
used can I not just no that's going to
complain
is it going to
complain byes like objects require not
string oh it doesn't know that it's
Python
uh can I do
that without creating a
copy
you can pass the memory view as a
parameter to a c function using the
ctypes pointer but this doesn't
work two bytes makes a copy
is there front buffer const why is C
type so poorly
documented from
address I get the address of
memory probably by creating a c
types integer
expected python get address of memory
View
found a
solution complicated
crap we can only use bite array to
create a
mutable memory
view
oh
that looks
terrible there's a
bug suggest that c
types oh but someone has to have fixed
it by
now all right let's see it on
GitHub
wanted read only
access
this is awful then what do I do with it
what do I do with a
uh
what do I do with a readon
shed okay you know what I have another
solution we're going to call it the B
partition in honor of the OnePlus phone
I
bricked uh by the way if you're just
joining the stream whatever you do do
not buy anything from the OnePlus store
they do not honor their return policy
pay the extra money and buy it on Amazon
Jeff Bezos is a g Who makes rocket it's
an Amazon basic trucks called rivan and
the OnePlus store is really the worst
customer support experience I've had in
a long time uh so do not and then also
why did the company stop releasing the
qdl stuff after the OnePlus 9 uh you
know just just why do you why do you do
this why does everything become shitty
over time you're just like oh how can I
extract more money how can I extract
more how the people haven't given enough
milk them for
more um did I buy a cyber truck no I
didn't um you can't can you buy a cyber
truck is that like a normal thing can
you just buy one why is it so slow I
have a very fast hard
drive okay well we made a copy all right
someone happy we made a copy made a copy
and now this will
work
make this work with read only memory
views if
possible the cob is almost
done no those were the days I know that
the company's gone so
downhill like they they've just they've
just just people bought this phone
because they could mess with it right
now Google's more
open oh did copy does copy retain the
yeah it
does
oh okay I don't really know why we have
a bug but let's try
that all right hip works great uh why
are those realizing when they shouldn't
be oh I guess because it's running the
mod
can I go all the way through there
without running anything let's
say no something runs are there realizes
in there yeah
realizes uh there maybe
are yeah there's a realize here that's
disgusting uh I should change
[Music]
this
I'm going to actually change it so the
jit will automatically
realize at some
point realize should be
true but when I call it
here oh that's
forward okay for jit
yes here we'll just set realize is false
for not using the jet if we're not using
the jet there's no reason we have
to I don't realize good that's good
let's
go well something's still realizing
what's calling realize where is it being
called
uh
what why do those have to be
realized no don't
realize okay never mind this is all
useless then
uh what I don't those
are it's kind of annoying you do have to
realize those right that's the KV cache
now we don't to write over the weights I
just did that in case I broke it you
know I bricked a OnePlus phone we're not
going to Breck uh we're going to Breck
my mystal weights then we have to retor
[Music]
though
sure if Mell refund my weights well you
know what Mell can give me back the0 I
pay for my weight I'm sure they'd be
happy to do
that uh e there's a realize there too
there's a disgusting amount of realizes
in this they need to be removed the
realizes must be
removed but that's a later project for
now we just have to settle for the fact
that you just got to realize okay that's
fine whatever the model realizes you
just got to be okay with that okay you
just got to be okay with that okay you
just have to be okay with
that um
um okay all right let's
see uh okay wait wait are there any I
didn't set you said that I missed
one uh maybe we'll do this the other way
then is fine
too uh no not v. assign I
want
uh model State di equals get State
model model State dict sub k. assign
right let's
go and then I actually don't need States
sub K there I can just do V there stat
sub K is also okay we'll just do it like
that oh okay okay you're right I missed
the
gate oh yeah I see what I did I didn't
include the gate thank you someone
mentioned this that's why I did that and
you were a good
person uh
okay devic is meta
oh I don't even set the D Types on this
do I this doesn't
matter um
num
experts ARS dim dim wait
what okay I sort of see what's happening
there bu equals false that's fine okay
let's
go okay it loads um now unfortunately
it's going to use up all my GPU Ram I'm
sure of
that um let's see did we get an output
of a gate let's get an output of a
gate so it's interesting so this like
picks the ones I'm
using top K
okay so you top
two why do they call this feed forward
EXP and this is this is
wrong
uh enumerate self. expr but I guess what
I don't really understand is why is it
still running all the experts
right like this is still running the
code for every single one of these every
time does it not run
less like what is this thing
doing do you run every expert every
time takes the two best NN
layers it should learn to only fire top
K them in inference but why this sure
looks like it's firing all of them right
it's going through every expert and
running
it and then it's multiplying it by
something by the way this will actually
run it's a bad implementation you can
only run two yeah that's what I
thought
uh so does this run this is actually
probably going to
run because see it runs okay oh this is
this is so cool
actually okay um we're g to have to put
the experts on different gpus but we can
do
this uh tiny grad is amazing so this
just loaded only the weights that we
need because it's all lazy
uh so we're going to have to we're going
to have to do some GPU assigning but
this shouldn't be
bad okay so
if if feed forward. experts in k k.
split Fe feed forward sub experts. one.
split this that this that this
that uh okay so we'll call this expert
no and then this needs to take in an
argument for
device uh else device equals device that
default actually we just shouldn't do
that at all we can pass in an argument
to your
device
um and
here we can just say expert number ided
2 + 1 device equals device. default plus
colon plus string experts no + one right
uh so let's just quickly print all these
can say
states. shape device I just so I can
show you where all the things are
going uh assign shape mismatch or device
mismatch oh that's
brutal
um actually want to allow
that it should be fine
okay so by the way how easy is Tiny grad
to use so we're using we're using uh
five gpus
here uh we're putting the experts we're
putting two experts on okay so there's
one GPU with all the attention stuff and
then we're going to have five experts on
five different uh
gpus uh on four different gpus okay so
you see we've put like expert 0 and one
on GPU 1 expert 0 and 2 and three on GPU
2 this on GPU 3 and this on GPU 4 all
right this is a good test of all of tiny
grad's fancy uh multi-gpu stuff so let's
uh let's go by the way this should have
a type I think this returns tensors why
do I not have a return type for this
this is a dickster
tensor
I we should create a branch called mix
draw
mix could change it so
far all right so now we got actually run
some of these experts wait so yeah so
you're telling me this implementation is
just dumb and there's no reason it
actually has to run all of
them
yeah there's no reason this
[Music]
wait you can this gate outputs eight
values you can take the top two and
softmax
them oh
Bast let's
go
um okay g. numpy I'm going to have to go
to
here so we're going to
say uh Choice equals g.
npy you know what no we shouldn't use
npy npy is
evil uh because it uses
numpy so I think we can use dot data to
list all right this will feel a
better I'm just going to throw an exit
here
okay uh there's a few too many zeros
there for my liking why are those all
Zero by the way yeah n's like sorry tiny
is like the ideal framework for
this uh you're running out of Ram
Captain oh no no you're running out of
ram data also uses numpy yeah but
someday it
won't okay was there an input yeah there
should have been should be my input here
right oh and I did just put in zero for
the token maybe that's wrong let me just
copy uh let's actually get a let's get a
tokenizer in here we're going to have to
do this anyway it's not a big
deal
um look cod.
p uh uh input the stupid tokenizer
sentence piece processor oh Le I got the
sentence piece processor working
great okay
um
hello hello uh oh we need to also put
the start
token let's in llama we're not going to
use these fancy ones here so how do I
get the start
token llama codes
crap
boss boss ID okay so we're g talks
equals
that BOS
ID plus en code below let's print the
tops
that
good modu name sentence piece
huh do I think it's good for that I
don't know if it's good for that I don't
know what it's good for
man is the gate still going to be
zero wait what what oh no okay the gates
aren't zero anymore
great uh I don't know why it was
Zero I mean let's just make it work for
one token
first Off to the
Races oh no you do have to run all the
experts if you're
doing I don't like that okay
whatever you see what I mean like if
your batch size is bigger you do have to
run all the experts and you do have to
mask them like this can you buy tiny
boxes for your research lab I hate when
people ask questions like this I don't
give a shit what you buy it for as long
as you're not buying it to help Iran
make nuclear weapons or help you know
whatever the new axis of Evil is if
you're helping North Korea or Iran I
don't buy a tiny box but otherwise buy a
tiny box right like I don't care
otherwise right as long as you're not
using it for a illegal us sanctioned
purpose I don't care but if I did get a
reach out from Kim Jung lon's nuclear
program trying to buy tiny boxes I would
say Sir while I respect the sovereignty
of your country I live in the United
States and I am not allowed to to sell
you these these tiny boxes Mr Kim
jung-un sir um that's what I'd have to
say but otherwise I don't care buy the
Tiny
Box no I don't care I just don't want to
get get harassed by the feds okay all
right so don't use it for illegal shit
but otherwise I don't
care and if you're using them unless
you're using if you're using them to
screw customers if you're using them to
not give customers the 15-day return
they're entitled to I don't care buy a
tiny box thank you for your 15 grand sir
I can't be the moral please here
sir you can buy them on the OnePlus
store don't buy anything on the OnePlus
store I can't believe it bro like like
it's just it's just I have emotional
regulation issues you know what I mean
like how do I get so it's $1,500 I don't
care but like I do care because you
wronged me as a consumer
okay do the right thing no that's
Google's model do not don't be evil that
is our motto our MTO is don't be evil
like North Korea and Iran but otherwise
you're good and I'm not even saying
North Korea and Iran are evil I'm just
Outsourcing that opinion to the United
States government okay all right
personally I don't have a strong opinion
either way uh but you know that's just
that's just what my government tells me
is evil and I am I genuinely do love
America you know so you got to support
America all right so this is only going
to work one token at a time and you
think that's going to be slow and the
answer is maybe I don't
know make the world a better place no
don't be evil my company will not be
evil but I'm not going to judge other
people for being evil we believe in Live
and Let
Live can I filter by positive vowels I
don't know if that's like a like a like
a thing about like we're going to filter
the countries by positive vows or this
cuz why does positive matter man numbers
are just numbers
man uh okay but no we're not going to
filter by positive Val uh we're going to
take the two largest we have to get the
two largest how do I get the two largest
okay really sorted enumerate
Choice that's probably right actually
that wasn't too bad I complained for way
too long about that do I have to reverse
the sort we'll find out in a
[Music]
minute to list uh we're going to have to
put a few assert x. shapes of
zero
the reason they run all the experts is
the batch size isn't always
one um but when the bat size is one you
can you can run more okay
good um that doesn't look very
sorted does that look s oh
no key equals Lambda x x sub
one
okay those are the worst two experts we
need the best two experts we're hiring
only good experts at this job okay um
top
two okay we are calling upon experts one
and
five um okay self. experts
subtop uh subz
subz X we'll call it E1 we'll call it E2
oh we're hand coding everything here
that looks good all right we're going to
run two experts and they're on different
gpus so it's going to bitch me out now
hopefully and telling me you can't run
that ex no it didn't do that okay uh
well CU I didn't
realize
um no okay hang on hang on hang on hang
on going to have to normalize the the
probabilities
uh think this stuff's
right have to normalize the
probabilities and then we can add
them
you know what we'll just do this in R uh
E1
times this plus E2 *
this all
right um we'll throw r. realize in here
and now it's going to bitch me out for
you have to send it to the other GPU and
I'm aware and I will okay there we go
all devices supposed to be the same
so um
feed forward okay we're going to have to
figure out what device it's
on how I do
that
okay E1 device equals E1 sub what's in
feed
forward W1 what's in a
linear so I can do like
E1
W1
uh what's thisle line here make a wait
okay E2 so here we're going to have to
go to E1 Dev and here we're going to
have to go
to x.
device seems
good all right let's
go all right let's see if it loads the
other expert oh look at it's loading the
expert on GPU 1 and it's loading the
expert on GPU 3
great
um when I don't set debug equals zero we
can do them in parallel too which is
even better okay that should just be
right I think let me just print these
two things to make sure I didn't do
anything
stupid they should be like normal
Norms uh uh if I'm using soft Max oh I
need e to the okay
fine we could do that
uh yeah this got to be like the log Max
or
something I mean we should just be able
to dox there fix
that okay
great uh wait ises that that
right yeah that should be right right
cool so like yeah we're going across
devices it's loading all the tensors you
know we can play right where it belongs
if it wasn't
copyrighted
uh okay good so let's return rat and
let's not print that all right let's
go what is my next
token let's go
mix all
right should we preload all the tensors
I think it's spending a lot of time
loading and
stuff
here you can preload all the tensors if
you
want uh let's throw
a tal tqdm state
St tqdm is a dependency of chiny gr by
the way because tqdm is one of the most
beautiful
libraries only the most beautiful
libraries T do set description loading
K
so thr realiz in there I'll see how long
it takes to load
everything not too
bad uh oh we only track the RAM used on
the main device so see it's like copying
them to all the different
devices we can probably see the ram
here
okay you can see the RAM usage on the
gpus why does this take so long to load
now what's doing
this why is it
slow is this the same bug we had last
time remember when like things like
weren't loading and then I don't know
how fixed
it can I see my ratio how much have I
uploaded should I feel morally okay to
stop seeing this
CH
wait this was like the other bug yeah I
know I
I stupid
AMD yeah yeah I don't know why this is
happening on
HTP CPU is at
100% it's probably like some race
condition in Hip or
something no let's TR normal
python
no I loaded something small to memory is
a test and it fixs
that I mean let's try coder
pi
by the way we no longer have to create a
cach anymore I deleted all that cash and
stuff now it's just building which is
fine I
think I don't
know seems like the same
crap uh I love htop let's try beautiful
emst this is like some bug in the AMD
gpus to
this is a bug in the AMD
gpus by the way we dropped multiple
thousand bounties we're going to be able
to see if we can load Twitter here but
probably
not uh no this is like weird stale
Twitter can I estr python yeah we can
python
okay this one works okay it seems like
it's mostly the ones just loading from
the
dis um which one is it
using yeah okay so that's where it's
stuck AMD
kfd all right GDB it
is I don't know why that
happened oh this also isn't hip we
should do
hip map 64
oh we should also do dbug equals to
okay AMD I'm fixing your
bugs they were respon I sent them some
new bugs they haven't fixed them
yet see look here we
go why does it not load those
why is it giving me a oh that's
okay all right so what happened why is
it mad slow
here
great we're deep in the lib HSA runtime
how do I get GDP to print a python Trace
back so I can see where that's
hanging
all right boys uh yeah so we're in the
HSA runtime okay you know we had an HSA
back in the day it was the home and
School Association and now like I hear
all these things and I'm like wow was
everything just
communist no like why is it doing
this
um okay well one of the things I'm
probably doing
is copy in is async we can always make
things not async this async things just
break
things hit mem
copy does this one
work
I should have run with debug equals 2
because it could just be building code
now which is okay but it also could be
hanging which is not okay no I think
we're hitting the same
bug
like I don't know what's going on
here why why is it
hanging God AMD fix your
shit all right you ready for
debugging
we shouldn't blame AMD yet okay it's
rude to blame people until you're sure
it's their fault then like one plus you
should blame them for really ruining
what was a nice
thing okay so it is these mem copies
that take
forever uh
yeah so like I'm calling hitmam copy why
is it so slow this should be like a
normal
thing
um would single GPU work bro with first
off this is a single GPU I'm using a
single GPU right
here can it be that the memory is full
it's not full what do you mean I have so
much
memory you saw my memory I have tons of
that this is just
cash
no how did I fix this last
time like this can't be my fault I'm
calling hip mem
copy okay I know a way to fix this but
nobody's going to be
happy
that should work at least I think
maybe you loaded a large basic t sir and
it loaded and fixed
it I I want to there's a $1,000 Bounty
right now for somebody to just rewrite
the whole hip run time like if it's in
the kernel it's in the kernel but right
I mean here you go this is going to load
I think we just copy it through the
CPU it's just
slow
look how slow it
is now we should be able to at least use
read
into should be copy out so let's do to
clang let's try to clang here this might
be a little
faster you see what's happening so say
okay good cl's a little faster well
that's just cuz those disc
but so you see we can see like man tiny
card is so good like look we're seeing
exactly how fast all these loads are
happening okay we're reading from the
disc at like 2 gabt a second we're
copying to the GPU at like
um and yeah if we do this without you
bug it won't wait for things anymore
should be a little better all right cool
okay all right this is at least working
oh this isn't using hip anymore this is
also using oh
330 we got an answer that's our first
token oh let's go boys let's go okay we
just copy everything through the stupid
CPU fine whatever man whatever we're
rich okay we're
[Music]
richh this going to load FAS this
time no still loads really slow I mean
we are loading a lot of gigabytes right
and we're loading them all over like to
many gpus so just something to be aware
of okay uh
4 I in range 10 I don't know let's
generate let's generate 20 characters oh
we got a different one that time okay
well that actually makes sense okay
talks. appen talk start pause plus
equals one print what is it s.
decode
decod talks. decod
talks okay what is mistel going to say
to us let's find
out we have to wait for it to load
again well now it it's a copy through
stupid clang because there's some bug in
copying from the no it's like some
kernel you see what it is
right
okay all right slash slash
fire
base
user
manager um all right but does everyone
understand how we did this with the gpus
we should be able to bring Rock msmi
wasn't actually causing any problems so
you see we're using 89% of the vram in
four gpus which each have two experts on
them and then we're using 17% of the
vram in the main thing which is doing
all the
attention
um xcode project all
right
import
fire
base we do need it to run off all the
models actually like you think you can
get away with running less models but
you
can't okay guys mistl has spoken to us
Firebase user manager. Swift xcode
project import Firebase type Alias
Firebase user mixt what is it say saying
what does it mean all right let's just
do the zero temperature and see what we
got can you show where I split the
experts on the devices yes in a minute
let it generate something let it
speak
h
e
[Music]
how you get the value of a variable in a
different class I have a class called
main
activity um run it on the Mac I
can't I have nothing else aside from a
tiny box that's capable of actually
running this
model
[Music]
um yeah could I do Dashi yeah I could do
Dashi we should really come up with a
better way to deal with this in general
um but I do think that is going to be
today's stream I'm pretty happy with
what we did
here uh I have refactoring work to do
that isn't playing around with mixol uh
let's give it a
push
yeah and I should figure out how to
actually clean this up um I will get
this
merged so where is that to device yeah
this I commented
out it shouldn't be
here it should be somewhere
else uh thoughts on mlx yeah no mlx is
pretty cool
um that just shouldn't be there SC it
out I'll figure out how to clean that
up let's get
this open sourced incompatible types in
assignment
what
what this shit Works
anyway
Mi strol fix up update stats add
that add a type there comment that out
remove that switch to async and don't
let a sign across
[Music]
devices
how do you think python M Trace is g to
yeah mlx is is pretty nice it's like
nice small readable code which is
cool uh I got to eat breakfast I got to
take a shower we got things to do today
don't buy anything for the OnePlus store
and really reconsider whether you want
to uh you know deal with that brand at
all I mean like the phone looks pretty
nice the software was
terrible
uh don't set your fast boot partition to
be
uh we'll let nonsubscribers talk for for
a little bit if they have any questions
about mix draw uh hopefully I did it
right but we also why is the AMD thing
broken um I don't know if we're ever
going to really the so the bug
is when you are copying directly from M
mapped dis into GPU something's really
slow
uh yeah we'll have to figure out a
better way to do this anyway there's
actually a cool PR right now on Tiny
grad to use the metal like direct copier
for that
um but no we'll get there we'll make
sure this works really well on the uh
tiny box when you get a shipping Tiny
Box by the way this was the first real
use of like there's nothing else that I
have that's capable of running this
model and the fact that this model just
worked so quickly on a tiny box I mean
are we 100% sure it's working no but I
mean that looks pretty plausible
right
um why is mistel gaining so much
traction AI field not similar to llama
V2 because it's
better uh take off the glasses sure even
though you're not a subscriber I'll
listen to
you um how many Voodoo 3 3000s do I
need oh yeah I did say I'd talk about a
little bit how I split them so basically
I just put the experts on I put all the
attention on gpu0 and then I put the
experts on one two three and
four um do I think quantization makes
performance worse yes uh it definitely
does but how much worse probably you're
still better off you're better off
running like a
quantized accumulator thank you for
gifting Subs wow 50 subs thank
you um see you
lator uh do you have a
question Mad Dog Nation with the 20 sub
gift Mario B with the five sub gift uh
you know I love you guys thank you I I
you know we're trying to do streaming on
Saturday we're trying to have more of a
scheduled regimented life I sleep on my
eight sleep bed just kidding I wouldn't
buy that crap but I do have an aura ring
um and I don't even mean to hate on
eight sleep uh but I do mean to hate on
OnePlus who's really like their brand
reputation was here in my mind and now
it's down here like bro take the phone
back you know what I mean do you want me
to have this phone and be upset and tell
my twitch people I'm upset and tell my
Discord people I'm upset or do you just
want to take the phone back and we can
just you know call it an L all around
right instead of it being a big L for
everybody and now this is a big
L um a SAS bed no really so
disappointing so disappointing but like
it's not like this isn't like Qualcomm
right like the thing about Qualcomm is
like we're going to be stuck with
dealing with Qualcomm for like 10 more
years right like they're going to
decline but it's going to be slow um
they actually might not even decline I
have seen some signs that qualcom may
actually fix things um I think AMD is
going to fix things uh I have seen zero
signs that OnePlus is going to fix
things
um after CEO left is is p no longer
there uh because I like I met the CEO
you know like like this thing like I
have history with these companies
like um wait I didn't know about rock M
6.0 they just named the thing something
different it probably has all the same
bugs so like I don't know like this bug
is going to be really annoying at least
the other oh my God like the other bugs
I've given them are reproducible on
their systems and they still haven't
fixed them I have two bugs one where I
can cause uh errors with the micro
engine scheduler and one where hip
compilation inexplicably takes 5x longer
than CL compilation because they're
using a different code path and it's
it's just stupid there's no reason for
it uh and it is open source like I could
fix it but I don't know if like you can
actually submit pull request to their
projects yet and it's across two
different projects and I don't trust
their
CI
um when is Tiny gr beating Cuda
not
um but this is a uh yeah I mean this is
this is like this bug I don't know if
they're ever going to be able to like
reproduce it on their system what I'm
doing is I've M mapped an nvme drive and
I'm trying to do copying from the mvme
drive direct to the GPU
uh this is likely some this there's some
chance this is a Linux kernel
book uh where like you're getting some
like N squared behavior on a on an
allocator or
something
um but yeah no it's just it's annoying
to have to sit here and wait 18 seconds
for it to load the weights actually
that's not that
bad is it really only 18 seconds that's
not that bad
um did I play with M
advise oh that might fix it actually
what if I lock the
pages yeah if I madis lock the map pages
that will probably work but again that's
doing something that I don't want to do
right I don't really want
to I don't really want to have
to copy the pages through CPU memory at
all like we're going to figure out how
to make the GPU just directly load from
the nvme on
PCI um if this is at all possible but
this is one of the goals of the Tiny Box
so we're going to figure it out for you
guys uh but yeah no I mean this is this
is unclear like it's unclear somewhat if
it's an AMD bug I mean it is just
annoying that like this doesn't happen
anywhere
else um but yeah yeah they the fixes the
fix is long and
boring
uh my opinion on Triton
uh I found that what it could really use
is a fuzzer uh I like the Triton guy
um but there's a lot of flakiness if you
don't use Triton like exactly as it's
intended like if you stray at all from
the examples Triton fails sometimes in
just like completely inexplicable
ways uh so I think it's kind of flaky
and I don't know like if this is going
to be fixed or if it's built talk about
Triton 2.0 it might get better it might
get better but yeah my opinions are in
general it's like if you are following
the beaten path Triton is good if you
expect to use it as a general purpose
programming language
don't um but I'm sure it's great for
things like flash attention and uh have
I delivered any tiny boxes we have three
tiny boxes now one of them is Tiny eight
one of them is Tiny S one of them is
Tiny
n
um yeah this was cool no like I'm glad
that we figured out how this mixture of
experts things actually works what it
means for there to be two
experts uh yeah very
cool and it's like simple like I I WR
like I really like writing simple stuff
for
people um
actually I don't even need a Transformer
block there do I this is the same we can
actually make this simpler what am I
doing uh Transformer blocks identical I
just need to change I just can say feed
forward and instead of TF
block I'll just change this to feed
forward equals feed
forward and then I'll just change that
to feed
forward and then I'll change this to
Transformer
block I'll pass feed forward in
here and
and then I
will get rid of that and say feed
forward
equals Funk
tools.
partial mixture feed forward eight
because there's eight
experts and then we can delete this
redon in
crap and we can import Funk
tools and we don't need those anymore
and we don't need that anymore or
that uh RMS norm and let's see if it
still
works so the only thing that really
changes is the feed forward
function and you see this fun is partial
so I just put n experts equals 8 there
so that's kind of cool so then it's
called with the same API as this feed
forward um yeah so just by swapping out
this one one class we can get mixture of
experts support and yeah okay you see
because my wow it seems faster
too it seems
faster and like so when you set the
temperature to zero it's cool you're
going to get deterministic Behavior so
you see we're getting the same stuff
every
time uh super
cool oh yeah look at that look at that
we made it even simpler
boys um and you see that we put the
experts like this is our expert sharding
policy right here things like this are
super easy to express in tiny
grad uh which is cool and then that's
our sampler and then we just changed
yeah the mixture feed forward class and
we pass that in
through
simpler that was a win guys that was a
straight up W right there straight up
W um yeah sucker quent you don't have
any
experts um so here you see we push the X
tensor to the device that contains uh
this choice of expert device that
contains this choice of
expert uh just based on the device where
the weight
lives and then we bring it back to the
original device where we average
so uh cool does simulator have a
question that I missed it's very
important uh or or mad dog Nation or Mar
Vine if you are a subter you get to ask
questions not everybody can't ask
questions just we don't want questions
from low value people like
nonsubscribers
gifters are welcome to ask
questions um what are they doing if not
fixing B
I mean they're looking into my bugs like
I can't like at least I'm getting
responses from people who say they can
reproduce them you can't yell too much I
mean they do have different uh can we
measure cross GPU overhead we can here
I'll run it with uh I'll run it with
debug equals 2 so we can see what's
going on but the cross the way I'm doing
this there's no cross GPU
overhead by the way we're not using hip
we're using just open seal here
So This Is Us loading all the stuff you
see that it has to waste stupid
time uh loading things into
clang it has to like it's doing two
copies right it's first copying it
that's how he fixed the
book what my favorite cake you're not
you're listening only I don't even know
what that
means uh okay so you can see here this
is the
moving all you know what let me uh let
me just do here I'm going to write
Global have another class called Global
counters by the way like as Tiny grad
becomes 1.0 you can just import these
things now from Tiny grad I made it a
n.p for things that normal people can
like use so we can do a global counters.
reset there so we can get an idea of
actually how quickly the model is
running it loads fast for a little bit
and then I think we're running into the
end of our Ram cash or
something maybe not I don't
know
uh what's the reason for choosing Pi
torch instead of tensor flow we didn't
choose either we chose tiny
grad non
subscribers okay so we can see how long
things are
taking uh let's control C
here so we can look at the last run here
okay so we are we're taking it's only 90
milliseconds of GPU
time um there's a lot of overhead now
because this isn't in the jit uh so
that's another cool project here but
we're actually getting 10 tokens per
second which is pretty
cool um if you ignore the tiny gr
overhead which unfortunately is
High um we should just work on reducing
that
yeah
uh yeah but you see that these are the
copies here the copies take basically no
time this is micros seconds oh that
copy's a little bit
slower uh yeah but we're copying 496 I
mean that's like less
than that's not as instant as I like it
oh you know what'll make it more instant
I think we can go a little faster if we
do hit but it's going to take time to
load
now cuz it's got to compile the model
but if we go to hip with opencl we have
to do copies through the CPU but with
hip we can do transfer which copies
directly from GPU to GPU and it should
be
faster so we're getting like 90
milliseconds before let's see what we
get with hip why is Tiny gr overhead
High yeah I mean tiny gr's not really
written to be fast in Python yet um you
know the code's written to just like
work and do things we're not worried
about that kind of stuff yet but we'll
get there and then it'll be
better um hip manages to be
slower okay get let it run let it
cook hi's just insanely
slow what why is this so
slow maybe the copies are at least fast
yeah the copies are
faster a little
bit my hip is so
slow why is this so
slow um but let's see maybe the copies
are at least faster let's take a look at
the copies okay so how long we taking in
h well a lot of that's again just python
overhead but we still still 92
milliseconds a uh thing but yeah these
are the these are the copies between GPU
and some of them are insanely fast um
because this is going still should be
faster but still that's that's pretty
good um but yeah there's very negligible
overhead
between that part of the problem is I
have to go to the CPU here and this
triggers a uh like it's hard to
synchronize things across gpus and we're
working on stuff for that that's going
to make it a lot better um but we're
synchronizing more than we have
to uh use go or see and it'll be faster
look no no no no don't do
that
um e Rand doesn't look like the other
ones that's ugly uh W parrot how's my
new Rand coming we're switching to we're
to switch to three
fry um no no no no the solution is not
scyon or go or see the solution is
fixing the algorithms to not be slow
right most problems are algorithmic not
uh just straight up performance right
like or you're making copies where you
don't have to or you're just you're just
not thinking about things correctly um
so agres will make this faster and I
will start to care about this I mean we
should be able to get
990 milliseconds would be
nice what about the bitter lesson yes
the bitter lesson do you need moderators
you want to go from a non-subscriber to
a moderator bro bro that's like me
walking into Google and be like you
should replace Sundar pasai with me I
mean they should but they're not going
to do
it do I need help yes getting a refund
from one plusus that I'm entitled
to
um can you fake a demo like he can
though we are not going to fake demos
we're going to drop drop Torrance when
I'm in
charge do I need a new CEO oh my God
some guy reached out to literally like
he wants to run tiny grad I'm like have
you solved a bounty and he's like
no like how the fuck you going to run
tiny grad then you know what I
mean you could sell unbans there we go
this guy's oh I mean at least he's
honest you know you gotta got to get got
to get got to give them props on
honestly
have you solved a bounty like bro all of
tiny grad is just solving
bounties but how good's our multi GPU
stuff that was pretty good
right um Noe chat they're not out yet
but I'm glad that we like have this and
we'll do another stream maybe next week
or maybe in two weeks this Field's
moving really
fast
um
where we can run these things but yeah
that's how gbt 4 runs so it's nice to
now finally understand what it means to
have two experts
and have I read the Mamba paper yeah but
I didn't really understand it I think
someone's got an implementation in tiny
gr I'll read it once it's in tiny
grad but how does tiny grad's lowle
interface with the hardware work I
created a library called GPU C
types um it just
like just like look at
this this this is all the time you read
stuff is now through this it's just C
types yeah I kind of know what a state
space model is 200 bucks for
implementing Mamba and Tiny grad but I
think someone already did
it
um
we don't do high bounties for the
inference bounties because they're like
fun enough people will do them on their
own and they're not like that valuable
to cor tiny gr I mean they're valuable
uh but they're not GPU types is 100%
autogenerated and checked in
CI uh so it's checked to make sure the
hashes are the same it's built in CI and
it's checked to make sure the hashes are
the same which is
cool uh so yeah no it's it's really nice
how tiny gr interfaces with the hardware
now
yeah Shing models across gpus yeah so
we've been talking about this a lot
um chenu uh our first intern is working
on we now have
gpt2 uh almost down below 2 milliseconds
per token uh and this is just starting
to really beat all the other
libraries um on speed there which is
cool uh you know from gpd2 gpd2 is
mostly the same as llama we can have
like the fastest llama inference across
a whole lot of
platforms uh which is cool again given
it's fp16 we we are not pushing into the
we can do in date but we're not pushing
into the crazy quantize types yet
um yeah three
bounties
uh if I search for tiny guard bounties
does Google work well
enough yeah so we released three new
,000 bounties
uh the embedding in one kernel without
new Ops supporting large batch
sizes uh removal of Cuda hip runtime and
replace it with a short python GPU
driver um you can see that I've done
this here for uh for Cuda and we have a
similar one for hip uh so this will
launch a Cuda kernel without the Cuda
kernel uh Cuda driver on time uh so just
kind of implementing that in Python and
getting it working uh but you can still
use cud and hip for the compiler so you
don't have to rewrite a compiler
uh but you do have to write a driver
probably 200 lines um and then for the
math oriented Among Us uh if you can
prove or disprove the merge ability of
two arbitrary shape trackers in
lean uh we have a proof here of it's
like sort of a proof reshape without
symbolic uh yes so we we switched we
only use symbolic to merge the shapes
which is cool uh so but like formalize
this proof and make it work for so view
reshape without symbolic is basically
just saying we have one arbitrary shape
tracker and one like contiguous shape
tracker saying can the contiguous shape
tracker be moved into the arbitrary
shape tracker but given two arbitrary
shape trackers uh can you merge them or
not right and then uh I want this in a
formal programming language doesn't
necessarily have to be lean we just
recommend
lean uh which is kind of
cool how's the ml Pur stuff going pretty
good so a lot of it's waiting on I I do
have to do the sharding thing I'm
working on sharding across gpus in some
nice way so this one was really like the
mixture thing was really easy to Shard
across gpus because we just put
different models on different gpus
effectively but I want to be able to
Shard like linear layers across
gpus and batches across gpus and this is
basically the same thing I tweeted a
little bit about the API it's it's going
to be really straightforward but it
needs a refactor to
lazy. uh which is a refactor I've needed
to do for a while that was almost what
today's stream was going to be today's
stream was going to be the lazy.
refactor but we ended up doing mixol
instead because I think it'll have a
broader audience appeal and I'm always
thinking about the audience and it's
really important that we get people in
here to hear that they should never buy
anything on the OnePlus store just like
imagine I was watching a YouTube and
they were like don't buy anything on the
OnePlus store and I would have been like
wow I wouldn't have done it I'm trying
to help you out boys and I'm trying to
make my enemies suffer at the same time
they're not really my enemy I'm just
disappointed I'm just let down you know
what I mean I'm just I'm just I'm let
down I'm let down as a consumer right
and I don't ever want people to feel
that way about comma so if if anyone's
got a problem with comma like that just
know that you can always reach out to me
now I might deem you in the 2% of
unreasonable people and to be fair if
OnePlus deems me in the 2% of
unreasonable people I will respond to
you by saying I have
222,000 Twitter followers so I can't be
that unreason right that's the truth
right if famous people have a problem
with you there's probably something
that's wrong with you right like when
some jack off in chat tells me
something's wrong with me I don't care
but if Taylor Swift told me something
was wrong with me oh my God I listen man
I'd listen I'd listen cuz you know what
Taylor Swift is more right than I am
right this is something I had to
remember a lot of Twitter with Elon it's
like whatever thoughts you have your
thoughts are not as good as elon's
because he's a billionaire and you're
not right like you just always have to
remember that right and you should
always remember that when I'm talking to
you that I'm famous and you're well if
you're famous hey look if you're famous
then I respect your opinion but if
you're not famous ask yourself why right
right or rich rich works too right like
if someone's rich and famous their
opinions are better than yours right
it's just wild man like whatever Taylor
Swift has like on if Taylor Swift has
honest thoughts about my personality I
will listen take them to heart and
change Taylor
I will change for you Taylor I will
change for you well she's like the most
famous person ever man I knew Taylor
Swift when she was slightly less
famous
um yeah
man Taylor Swift if she wants to if
Taylor Swift genuinely wanted to be CEO
I would let her
absolutely like you just you know what I
mean like I just I would trust Taylor I
i' ask questions about why Taylor Swift
wants to do this right you always got to
ask that question right like maybe I
actually have a short on OnePlus and
they're actually an incredible company
and I have some ulterior motives I'm
Shilling my bag like Jake Paul with his
Charizard around his neck you know like
shill your bags bro got a lot of Pokemon
cards got to Shi those bags but I don't
have bags man I'm not trying to Shi bags
I'm just really genuinely upset with
myself that I ordered from the OnePlus
store and look I'm not even like I'm not
even upset that I bricked my phone like
I wouldn't even be that upset about that
I like like like if they release the
files i' even I'd go find a Windows PC
and install it if it like even if the
files leak they leak for the OnePlus 11
there's no leaked files for the OnePlus
open by the way if you're at OnePlus and
you want to leak those files right but I
don't even care like the thing just
upsets me now it upsets me to look at
that phone to think about that phone to
think about my interaction with OnePlus
and I do know that there's a few people
out there who feel that way about comma
and my question is are you and the 2% of
unreasonable people or are you famous
because if you're you're famous and you
feel that way we will change for you
that's
right um well Taylor Swift didn't tell
you
shit uh unless you actually know Taylor
Swift if you do uh you know like would I
listen to
skyb probably not maybe though how many
followers does she have right you got to
ask these questions are there small non-
Bounty tasks that need to be done in
tiny grat yeah I mean but I'm not going
to give you I'm not going to spoon feed
you man read the questions document
right like are there things that need to
be done sure submit a PL request start
getting stuff merged become a purple
most people are purples before they
become Reds you should listen to Kim
Kardashian you
should
um uh do you get your employees to go to
these conferences fuck no conferences
someone once bought a conference ticket
on a comma credit card and we had to add
a rule to the employee handbook that you
absolutely cannot use company money to
buy yourself conference tickets
um there's no the conferences are
they're not good um go read the internet
in your basement you'll learn more uh I
don't know like they can be fun if
you're viewing it as a vacation right if
you're like hey I'm taking a few days
off work to go to the conference like
that's cool man that's like part of your
vacation but like you have to treat it
as your vacation right don't come up
with some excuse like I'm going to a
conference and it's for work but
actually no uh what about Taylor Swift
tickets I was too poor to buy Taylor
Swift tickets man I could have bought
and brick like three one pluses instead
of buying two Taylor Swift tickets you
know
um the link I retweeted just sent a
broken link and You Don't Know Jack
about pirating ah uh ner is in Nola yeah
that's part of it too like how much
crime is there in that place I don't
like going places where there's a lot of
crime I don't really like crime
conferences are only useful for
networking and tell me what networking
is useful for and like that kind of of
networking not the kind with like like
like like disc you
know wow that's that's hard time plug
like this kind of networking I get but
like the other kind man the other kind
is a scam right it's just like I'm going
to like hang out with my friends but
Bill it to the company and that's what
networking is okay um yeah so today uh
look if you're going to kill someone
like like that's not my highest priority
now my highest priority now is should
just tell all people out there never buy
anything from the OnePlus store make
sure you buy it through Amazon so you
have a good return policy um and
remember also that everything after the
OnePlus 9 if you do get it into a uh edl
State uh you will not be able to restore
it yourself uh you can like kind of find
leak stuff but then they added another
level of security to the fire host
programmer called verified image
programming and like you can kind of get
around that but then like at what point
are you just like why do these people
hate me I gave them money I gave them
money why don't you release the files
but you know no one else is going to
change you can only change yourself and
that's the universal advice here um so
uh yeah thank you everybody uh for
watching my my stream on this beautiful
stream Saturday uh contribute to Tiny
grad uh if you don't know where to
start that's a you problem man like you
can figure it out man like I didn't know
where to start you know no one ever
tells you where to start in life right
it's not like the yellow brick road
right like this just it's just a life
and you're just play man it's not life
is not a linear video game it's it's a
nonlinear video game right it's a it's a
open world okay all right all right you
and your North Korean brothers look look
I can't pay you if you're in North Korea
unfortunately man I don't want to
violate any sanctions I'm a good
American I try my best to follow laws
and respect Joe Biden okay thank you
everybody bye-bye have a good night have
a good morning have a good Saturday
byebye
good morning everybody good morning
twitchy's let's hope we have good enough
wi-fi for streaming
wi-fi for streaming wi-fi for streaming
wi-fi for streaming
you guys see that with cartman glitches
out on the zoom call
uh all right so
i was gonna do something today it was
nice and peaceful
and i thought that i would share it with
you streamers
um i got tea
prepared for me by the by the lovely
alex
made me tea i'm very happy
welcome my streamies welcome my
streamies as long as i'm not you know
blocked like the new york post story you
guys can all come in here
and watch me stream
yo what up all right so
you know we're getting back into how
we're gonna do some coding
uh and i guess love when i do coding
we're going to start
we're going to try to write mnist we're
going to try to write deep learning from
scratch
um and we're going to see and you can
all watch me embarrass myself
with how little calculus i know uh
so i've already done a little bit of it
this was done off stream and i'm like
you know what this will be a nice stream
for everybody here
so you know i just went to the mnist
dataset page
um and here are the files that are
available i show this little fetch
function
uh which here we can restart this kernel
here we're going to do it without pi
torch and without
tensorflow we're going to do with
nothing or this little fetch function
here
which uh you know will fetch them and
then we can like
uh you know like an m show one x train
oh look it's a five blow yo let's see if
it's a five
yo look at that it's a five all right
all right we're doing well we're doing
well all right cool
um we're gonna try to really we're gonna
try to write this entirely from scratch
um and we're gonna see what error rates
we can get uh so who knows how to write
back propagation without using
a library maybe if we should first write
it in the library hype train incoming
wow that was fast all right
you know what let's first guess just
start and do a little pie torch just
because we can
uh so what am i going to call uh
my net we're going to call it bobnet
uh let's say what is it torch
all right so let's just let's just first
let's just first write it in torch
you know uh we'll import torch nn
i'm gonna write bob net as a torch
uh let me just make sure that i'm not
blocking that part of this
screen i'm actually going to move me
um what do you guys think we're going to
move this over here and we're going to
move whoops
i'm going to move me up here yeah there
we go
i think that's nicer cool
all right i moved i know i moved um
so yeah we're going to start with a
little torch
knit you know it's just it's just
relaxing on a beautiful saturday i went
to blue bottle this morning got some
nice coffee
super bobnet self and like you know what
doing these doing these old doing these
like simple exercises
it never gets uh old so we'll just say
you know
we'll call it l1 and then.linear
we're going to go from 784 down to let's
say 128
and then we're going to have an
activation function we'll use a good old
value
and we'll have another linear layer
which takes us from
down to three and we'll use a
logarithmic softmax so that shouldn't be
a problem we gotta write the forward
pass you take in an
x you apply layer one to it
what why is that this used to be better
i feel like i used to hit
that and it would not do that it would
just go back to
the beginning of the line but whatever
um all right so we can instantiate a bob
now we'll say model equals
bobnet all right now i can run my model
on
say now we gotta do a lowercase model
one say x chain one through ten okay
forward takes one positional argument
but two are given i forgot the self you
always need the self
don't forget about the self people uh
empire ndra has no oh we gotta turn into
a tensor
all right good given numpy array is not
writable
and pytorch does not support
non-writable tensors oh that's a tragedy
let's just do a dot copy in there
because i did it from buffer it's
actually from a python buffer so it's
not writable in numpy
expected object or scalar but got type
float oh we're gonna have to turn this
into floats okay so let's do a float
wow this is harder than i thought well
i'm being a noob here all right don't be
a noob all right let's go let's go let's
go
i'm gonna reshape this into that times
that
all right good so we got some stuff out
um let's write a quick training loop for
this
uh how many epochs do we want for i in
range
100 um
let's set our batch size equals 32
do something like
np random
brandon's
yeah i can say something like size
equals
perfect shape size equals 23
size equals bs bs is not defined oh no
um we'll say samp equals that
let's just do two for now
print samp okay good
so those are our samples so we'll just
sample from the array
um we'll call this just x
uh we'll run the model we can't just
write it on x we gotta run it on
that
hmm that pndra is not oh
okay we'll say y equals
y train substance all right so we have
our out equals this
um and then cross entropy
loss and pi torque yeah this
i think i just want to say loss out why
is that exactly what i want
um we'll call this loss
function first we're going to write it
in pi torch and then we're going to try
to replicate the same thing
without the use of pi torch and that's
what's going to end up taking too long
and be
too hard for us to do on the stream into
object is not callable who's trying to
call an
int who's calling an inch don't call ins
oh because i gotta make that a tenser
yeah you know what i'm actually going to
move this here
and then here we're also going to say
torch tensor y
chain same
i didn't get that could you try again no
siri bad siri
sorry
no siri bad siri okay uh what do i want
this to be a long can make it long
yeah it's long okay cool let's check our
loss
all right perfect so now we just got to
do backwards
so we'll say lost dot backwards
we're going to need to write a uh we
need an optimizer
and then pi torch atom
yeah torch optum
is something like optum equals
torch dot optimum dot atom sub
model dot parameters that should work
uh and then oh we're gonna have to zero
the gradient if we didn't zero out the
gradient
did i forget to do zero grad in one of
my examples
i think i did
that might have been why i had such a
problem learning models that output two
but that was different
okay um import
from tqdm import train
let's make it a train
uh and then actually oh who's ready for
some walrus oh no don't tell me i only
have python 2.0
no no no no what python version do i
have right now
get python version oh you know you guys
know i love the walrus operator
um you know let's just try a walrus and
see if it's going to work come on walrus
i believe in you
uh the walrus is my favorite operator
and anyone who doesn't believe in
is a wire yeah i got a walrus all right
so look now i see you know i can just
use beautiful things like t dot set
description
let's say like loss 0.2
f like that yeah i know there's like a
better way to write that in python now
uh dot item oh yeah wow that was so nice
oh i love walrus operator
uh who loves walrus operator this guy
all right um
let's also check the accuracy
so let's say uh
torch dot arg max
out uh dim equals one
say cat equals that let's not do that
let's see if i wrote something right
okay
um and then what we want to know with
accuracy is
cat equals equals y
and dot sum
accuracy is that
uh now we want to actually need on that
oh can only calculate means on floating
point oh i gotta make them floating
points
okay good they're floating points all
right good accuracy
and we'll say here accuracy
all right
i can do that right perfect
we want to make some quick graphs up
i know you guys like graphs who likes
graphs you like graphs graphs look good
for the youtube right
let's go let's go let's go call it
losses
accuracies equals that comma that
say losses dot depend loss
accuracies dot append accuracy
and then let's just throw a plot down
here plot loss plot accuracy
oh no we got plot losses and accuracies
all right yeah buddy let's get it
all right so let's go for a thousand
steps
32 is a good batch size run train train
train train train train train train
train
loss goes down accuracy goes up oh let's
not let's clip that
too
can i say plty limb well accuracy
doesn't go higher than that so let's
just say like minus one one it's all
good
yeah cool but one's a little low let's
go to two all right cool
beautiful loss goes down accuracy goes
up
everybody's happy right is everybody
happy good i'm glad if everyone's happy
you know you know i'm happy and we're
all happy
all right let's lower that only to 100
boom boom let's go okay good wow
accuracy goes up so fast oh it's
unbelievably fast
300 400 let's go um
okay cool so we wrote a little trainer
in pie torch and then let's write the
final evaluation
who can write this quickly model
um i don't want to copy that code
we're going to copy it let's do it
model torch tensor x test
reshape float
and then we want to take out and we just
want to do an
arc max on that m1
let me say y
test threads
uh let's just throw a dot num pi on
there so we're not testing it in torch
y test equals equals y test threads
dot mean i think that works in numpy
cool
oh we got ninety percent good that's an
a all right
who's glad we got an a i'm pretty glad
about my a
all right evaluation
um training
model all right model training
evaluation
no we only got an 88 that is more
mediocre
i'm not going to write adam let's change
it over to sgd
oh we got to give it a learning rate for
sgd i can't use the default one
is that a good learning rate that was
not a good learning rate that did not
learn
um did not learn
okay let's try a tiny learning rate
let's actually initialize bob net up
here so we don't
does sgd even work we got to give it
some momentum too
you know what we're going to do without
momentum because we're going to
implement this
from scratch in mnist from scratch
um you know what let's just be explicit
about our lack of momentum
no momentum that's right okay how well
do we do well we got an
oh that's a b it's a b it's a b plus
i've got b
plus i don't know it's been a while
since i've been in school set up b
plus
oh 91 oh that's pretty good let's up our
bs we need more bs
just like you know all right let's go
let's go let's go
oh 93 oh that's a pretty good number
who's pretty happy with that all right
that's too many let's do less steps
91 i do a thousand steps i get it more
all right how long does that take
only a few seconds right we can be
patient 92 all right who's excited we
got eminence can i do losses common
accuracies no this is going to complain
to me isn't it
no i should have tested that without
having to do that yeah yeah great high
quality shit
oh wow it's like losses versus
accuracies can i do that
is that good i want to save that line
you know i don't like writing crappy
code oh that's terrible
that's not what i want to do you know
yeah you guys probably in the chat right
now that i'm not reading are probably
like oh you just got to put the squiggly
you put a semicolon and then it doesn't
but we don't have any semicolons my
keyboard doesn't have that
my keyboard is actually out of
semicolons oh that that 2 is aggressive
let's go
1.1 and minus 0.1 let's really get a get
a nice graph oh that's that's a
beautiful graph what do we all think oh
that's so beautiful all right let's
evaluate it
we'll get 93s yo that's an a that's not
even an a minus
i'm just out of that a minus range i
mean 95 would be nicer you know
but i'm pretty happy with that
all right so that was it in pi torch
we're never going to do it in tensorflow
because tensorflow is a piece of garbage
and we don't use tensorflow around here
we use pytorch all right let's just
check in on chat
before we get started on the heavy math
part of this
where you guys can watch how bad i am at
calculus
we're doing mnist from scratch all right
you know what let's just try let's try
256 for the bs just quickly
is it does it do a lot better no it
doesn't do a lot better it does
marginally better
bob nat bobnet is probably the crappiest
uh amnest
uh yeah no that's hard we're gonna do
this all
from scratch oh we got frame drops
oh there's no i don't got friends it's
just looking pretty good hell yeah
math let's go boys let's go do you think
we can reimplement this thing
without the use of pie torch
um the mug is sick right alex they liked
your mug
deep learning is absolutely not a scam
we're gonna win self-driving cars
uh i probably totally missed a hype
train i'm sorry for missing you guys but
without pie torching without numpy whoa
whoa well that's like like like giga
hard mode yo we're not going that far
we're definitely not doing it in c we're
doing it in python we're going to do
numpy
and we're going to show that we know
math and we're going to see if we can
replicate
these amazing mnist results truly
amazing mnist results
what do i have can i not use requests
what do you want me to do and see you
want me to use socket
want to use socket receive and send do
you want me to write an http oh you guys
would love that
oh you guys would love that oh i bet you
would i bet you'd love it if i didn't
use requests and i like
opened port 80 oh you want me to write
some tls negotiation
oh yo by the way can we talk about how
the walrus is the sickest operator in
python and anybody who isn't pro walrus
is a loser
that's how i feel i'm the biggest python
three shell you know you can you can put
some clips
of me next to me from the past
talking about how python 2 was great and
now shilling for the walrus and you can
be like he's a flip-flopper like john
kerry
and you guys could do that and wow
that's some sick branding if i'm still
calling john kerry a flip-flopper 16
years later
damn all right
the rg flip-flop i carry chat you guys
distract me
yo yo yo the walrus is bad you're lucky
you're a subscriber
all right please subscribe to my channel
it's only for my love of the subscribers
that no that's not
i'm not even i'm not even playing this
is the new twitch channel i'm just doing
this because like
i was gonna write this today and it's
more fun to talk to myself and
you guys give me an excuse to talk to
myself lex friedman part 2 coming soon
boys
i think i did well i don't really
remember what i said lex friedman is a
great guy
people like him are going to save the
world
hard target for thank you for
subscribing
um no i don't know when it'll become
available lex has a lot to do
i hope his social media app can work
what i told them about that was i think
it's a harder problem than self-driving
cars i know how to solve self-driving
cars
i don't know how to solve human nature
um okay
i'm never doing jerry all right we got
we got to hide the chat you guys
distract me
sorry sorry chat you guys are a
distraction
um
wow you know you're just going chat
you're getting a whole chat mindset
you get out of a coding mindset you see
that was fun you know you guys could
like clip those
clip those like 30 minutes and it's like
you know what guess what i don't have
bobnet written in another window unlike
certain scam streamers that i know who
write all the code beforehand
you know scam streamers don't be a scam
streamer
you just gotta disclose man like
everybody you know it's like freestyling
you know this is
real off the dome shit you know and like
battle rap is great
you know like like the pre-written stuff
you know i
look like the type to win a pulitzer
prize until i pull it surprise and
bullet your eyes right like you never
came up with that shit
you know in the moment so that's why
it's nice that it's pre-written but
you know you just got to disclose
everyone's got to be on the same page
about that kind of shit
right and then we're all good you know
no sense as long as their permission
preach kanye west all right let's go
okay
so what is a linear layer does everyone
know what a linear layer is
oh well actually hmm
bias equals false i don't really want to
write that bias
what does this need about i don't even
think this one needs a bias because i'm
doing
yeah that's fine actually that's an
interesting point i don't think i need
biases if i'm using
well no actually that's not exactly true
let's see how the accuracy does
pretty much the same all right we're not
going to write biases but we should
write biases
at some point wow it doesn't matter at
all
i'm trying to think what happens if i do
that without a bias if it matters
probably does but
okay so what is a linear layer without a
bias it's just a matrix
l1 equals np.array let's first see if we
can
copy let's first see if we can copy the
um
the weights from torch and get the same
result
um you know is known by array normally
what type is this
in 64. oh well that's not
i meant to say empty zeros float 64.
that's disgusting numpy
float64s are disgusting and you should
be ashamed for making that the default
type
scientific computing is bullshit
everyone knows float32 is all the floaty
wait a second
i'm only saying that because of nvidia
only supporting float64 and the
expensive gpus i've never actually tried
training a float64 neural network i
wonder if they work great
yo you think if we up the accuracy to
float 64 everything's just going to
become super precise now it probably
means you were lazy with your gradients
yeah yeah yeah in date works you just
got to add noise
uh oh yo all right
guess what i bought for tomorrow and
this is a little i bought oculus quest
2 and i don't have a facebook account so
you all know what that means
uh but i bought a quest to
i don't have a facebook account i don't
know
am i not going to be able to use the
hardware i paid for
pogba lucky i would love your five
thousand dollars i would appreciate it i
would frame that check
check from the oculus founder for
jailbreaking the oculus
yeah that'd be cool all right but enough
daydreaming
let's focus on writing this
okay so we have model i love pytorch by
the way
if i haven't expressed my love for pie
torch you know
i can just say stuff like that oh that's
so beautiful
that's that's so beautiful am i gonna
have to detach oh you have to detach
numpy you can't trust numpy you have to
detach it from the graph first
i don't really understand what graphs
are but i do know
oh wow they got it twisted all right
let's get it twisted
okay we'll call this the init the
network
no more by torch here
now that's a lie we're not going to lie
copy weights from pie torch
yeah that's right don't lie
um that's not actually what i want to do
like how do i assign the
does that do what i want is that still
the original array
uh what there's a python way to do this
how do i get the memory address of
something
in python get object memory address
python it's not wrapper id
i'll check your id all right
okay that is the same id so but now if i
do this it's going to have a different
head
yeah okay so i want to do that i want to
actually copy in the weights
i don't want to uh not copy on the white
side let's go
okay um so now if i want to actually
evaluate this
let's write a numpy forward pass
um we'll call it forward x we want to
say
what is it x dot l one
all right it's gonna look very similar
to the pi torch forward pass
um we've got to write a value um
what is it max 0x
our np dot yeah that's right isn't it
oh is it max yeah it's max
numpy's not picky about its types
uh what see that's what i mean i'm not
sure
shapes are not aligned
yeah see i don't like that i'm i'm
confused by why pi torch has their
matrices like that way
isn't it really like that
uh what do i want to say transpose
only integer scalar arrays can be
converted to a scalar index
um
okay good we got some
it's not the right shape
i didn't even get the right shape out
[Music]
well let's not make the batch size 10.
let's make the batch size 32.
okay we got 32 times 128 now the batch
should
still be the same here what
oh that's not what max is oh my god
my relu was broken we got to do maximum
let's just make sure that actually does
what i want
let's do a batch size of one for now
does my relu work
did i write a crappy value well that's a
lot of zeros
you know what they call that relu death
because you know what the gradient is
with zero it's zero
okay so that
now
what do i want to do we can just say
um
y test preds equals uh
np dot argmax
dem equals one you know see in pi torch
it's dim and a numpy it's axis why do
they call them different things
that's mean of them all right let's go
speaking of mean
uh that one all right good well look we
get the same
same results in numpy as we do in pi
torch
how unbelievable is that boys that's
unbelievable
all right
uh we're not really going to copy the
weights from pi torch
now we're ready for the real challenge
training in
numpy because we wrote
tested numpy we still got to write
training in numpy
because we didn't do that yet let's
check in on chat and see how you guys
are doing
also we're not plugged into the wall
here
uh so my laptop's gonna die and then
there's gonna be no more stream and
you're all gonna be sad
[Music]
it's european powers loves european
power
yeah it looks european
no my laptop loves european stuff don't
worry
build autograph who build autograph now
that's that's that's real like like giga
chad mode there
i don't know um
no i know vim today uh is this my mom's
basement
is that a piggy bank that's the most
realistic looking pig i've ever seen
is there pagans out of that
we're programming the matrix we did do
some matrices that's
you got to know how to multiply matrices
yo should we do it without numpy
should we should we make this work
without num pi
should we program matrix multiplication
are we allowed to just use np dot dot
like savages or should we program our
matrix multiplication so we get the axes
correct
do you guys know how to multiply a
matrix
numpy is cheating bro
uh but not with default python lists i
mean np dot dot is a little bit cheating
do it with cython oh now it's going to
be slow why don't we just code it and
see
while we're at it
please don't use python what oh yeah
check out my american flag spatula
what alex everything i have is here i
brought you clothes today
what am i gonna do go cook at my am i am
i crack done
uh what's kona
do it with eigen oh yeah that's c plus
plus
you know
what's k kona
now no we're going to write we're going
to write
k kona means american i don't know if i
believe that are you guys giving me some
memes that'll get me banned from twitch
all right
it's an emote for america alright we do
love america on this channel we do
love america
um all right well you know i'm real
scared of getting banned you know
they're coming for
you know first they came for the the the
the the white supremacists and i didn't
speak out because i wasn't a white
supremacist
and then they came for hunter biden and
i didn't speak out because i wasn't
hunter biden
and then they came from me but there was
no one left to speak out for me guys you
know
when the censorship comes listen
when the censorship comes and nobody can
speak freely
fairbanks alaska let's just go
let's just go let's everybody go to
fairbanks alaska and i want everybody to
remember that
you know when when when everything is
dead and there's no hope left in the
world
the shelling point is fairbanks alaska
and we'll all just descend on that place
and uh yeah
all right uh when they come for us um
mics sound weird yeah they're trying to
censor fairbanks alaska
but don't worry the message is getting
through
nothing left on twitch when white
supremacist and hunter biden are gone
um
ooh ooh f
dot value oh that looks so much nicer
than having to like
put a rel there oh let's upgrade bob net
with an f dot value
oh f dot rel u oh that's so much nicer
than n n dot value it seems
fast don't you think look it's lower
case that means
fast what does the f stand for fast
oh look at that we even got pretty much
the same accuracy with
f
okay uh no i'm procrastinating now
because to be honest i don't really know
how to do this all right
we got to compute derivatives there's
probably tutorials but we're going to
try to figure this out without a
tutorial
oh god this is this is hard mode this is
hard mode
no we're going to need a tutorial i
don't know how to do this stuff what's
the chain rule again
i don't know i don't remember
we gotta like get derivatives of logs
and shit
this is too hard
the loss can be described as
minus x sub class
in the case of the weight argument being
specified
super hard
[Music]
okay oh i know this is called a log
x sum
let's just break this up a little bit
so i can do like np dot x dot sum
i'll take the log of that
x sub class
whoa no way it's like the same
it like knows it's seven
that's pretty good
oh we can yeah look we can compute
uncertainty
let's see how uncertain is that
uncertainty
um let's see if i can write this for
so it works for multiple
i'm just gonna have to change sum to the
axis equals one
oh the european power is shocking my
hands
you know the converter doesn't do
anything that was just a wire
yeah it's just a wire it doesn't do
anything
it is shocking my hand though
can i write that is that right
it's not what i want that is definitely
not what i want
how do i write this
no
that's how you write it in torch no that
is not what i want
i want to like select it for each do you
see what i'm saying
that's that and then for each one i want
to select
is this not obvious how to do
like so we have y test and y test has
shape
you know that we want to select for each
one of those
that's not right
how do i do that you see what i'm trying
to do let's see if chat can be useful
bro you need to get your cost function
which is a funk of output which is the
funk of your net params
and then differentiate bro
you got two eyes and differentiate
i'm in the cloud you all know that you
guys paying attention
how many people are watching right now i
don't have that up
like how come that's not an easy
operation in numpy i really don't
understand how to do that
um it's called like numpy gather
take oh wow how have i never used take
before
that's not what i want
now np
take
that's not what i want still what i
really want is like this
for i in range
y test spreads out dot shape
sub zero and i want to say this
well i'll just write it in this notation
uh y test spreads out sub
i uh
y tests of i
i want to say that
what
this does not already bode well if i
can't do that
oh i guess i could like encode it to one
hot and do it like that
who invented logs and shit
714 700 oh that's how many people we got
watching
why test preds out oh you're right it is
that
thank you author zero you're a bro
um i have seen this before
yeah i've seen this before it's that and
that's so stupid
just you know i don't want a range there
i want to write that but why is that a
different thing
all right cool that's a nice measure of
uncertainty
you want to figure out what the highest
uncertainty is let's take a look
uh let's say mp.max rat
no and argmax rat yeah so let's take a
look at this image who's going to be
confused by it
x test rat
raise uses indices oh
god yeah see what number is that
nobody knows nobody has any idea i mean
it's probably a six
but really nobody knows see how
confusing it is i'm confused too
i am just like network network and me
are the same
because if you don't understand this
we're not even up to the hard stuff yet
we've been doing easy stuff we've been
playing on easy mode we've literally
been playing endless classifier 101
shit looks like a crippled six yeah
that's right
let's see what else is confusing
um what do i want to do let's
zip ret range red dot shape
zero uh
let's do this
sorted list
i know this is the content you like i
know this is the content
you like that you're here for we're
working hard to make content that people
like oh let's look at more messed up
images oh yeah i don't even know what is
that what is that
oh that's that image is so messed up but
if we set reverse to false
let's see let's see what the least
messed up images are 13
let's see oh yeah everyone knows what
number that is wow that number is so
obvious
oh let's look at 69. oh yeah wow wow
it's really good at zeros
this one a zero two oh that's an obvious
three that's a beautiful
that is the that is a canonical example
of a three if michelangelo sculpted a
three instead of david he would have
sculpted that three
uh this is a beautiful three right let's
look at more messed up numbers
is this the content you want yeah yeah
we're looking at meth oh yeah oh
oh six is a really ugly sixes are like
yeah they're spermic you know it's like
phallic but oh
um two that's not
two that's a you think that's a two
maybe
it's a week nine so week nine niggas
seven is artistic seven i hate when
people try to be artistic when they're
drawing sound oh look at that artistic
too
got a little swoop in there plot them
all in a grid oh you guys want me to
write a grid
all right let's go let's go what do you
want a 4x4 grid
grid
oh you know i'm really am i really
writing a grid for you guys
oh what's the easiest way to write a
grid
i don't know a good way to do this who
wants to who wants to write a grid on
easy mode
um x bad dot reshape
4 28 times 4 28
and now we just say
np dot concatenate
i concatenate on axis two but is that
going to be the shape i want
what a bounds of array of dimension two
oh that
yeah yeah all right let's see let's see
let's see did i make my did my magical
grid code work
oh that was the most beautiful grid code
i've ever written
oh
all right let's make a parameter called
g for my grid
g equals four call this g
times g put some g's in there got a g up
in there too
oh that's the most concise beautiful
grid code i've ever written oh that's
beautiful no but actually let's look at
beautiful numbers let's really look at
like the pinnacle of number
oh these are the pinnacle that 4 is kind
of ugly
you know i think that was supposed to be
the pinnacle of number
let's make g big yo let's make g8 that's
a big number
oh that's a big g what how does it know
what number that is that's the most
confusing ass number i've ever seen
it's like really confusing numbers
though oh these numbers are
these numbers are gross
oh by the way is that not the most
beautiful grid code you've ever seen i
mean i've written that coded comma as
like a big function
and then i'm just like np dot concat
reshape that's right that's how you
write a grid
all right so who knows how to
differentiate this
how am i going to differentiate log x
shit
i don't even know how to differentiate a
matrix
oh we only look at pretty numbers here
let's go 16. oh it's crazy
uh like the computation power that lets
me yo let's go 32.
wow the computation power that just lets
me do that i
love the future i love the future i just
want you
like eniac fuckers you know like eniac
fuckers who'd like to like oh
well i have to make sure there's no bugs
in the vacuum tubes
and i just did that i just i just made a
grid 32 by 32. 32 times 32 is such a big
number
that i need a calculator to do it is it
it's 102 4. wow see i don't even know
yeah well it's two to the fifth and five
plus five is ten
ten to the two tenths is one or two four
i should have known that i should have
thought before i spoke
oh that's that's beautiful let's just
okay all right all right we're getting
distracted see i have chat open and i'm
distracted
okay we are going to make it train in
numpy
i believe in us we're going to finally
figure out how to differentiate a log
x i don't even know
i mean i can have pi torch print the
gradients and we can check if they're
right
no i'm closing chat peek strip one maybe
if you're a subscriber i'd care about
your opinion
all right
whoa np dot gradient you're a vip so i
believe in you
wait wait can i actually do this yo
let's go
let's go np dot gradient
uh well actually i do want to add this
to the forward pass
well we'll add the log x to the forward
pass
that's not even i can't even do that
all i can add to the forecast really is
the x
differentiate by hand and write the
function bro you know not all of us went
to
school okay
oh this is np.gradiency that's
that's my school let's go
does this work oh
the gradient of an n-dimensional array
i can't just do that
wait that just takes the average or some
shit
but you're a vip so i believe in you
the gradient of an n-dimensional array
oh it's change in y divided by change in
x so it's divided by
so this one they divided by one and this
one they divide up
i don't get it
i don't think that's right i don't know
okay
we're gonna we're gonna we're gonna use
we're gonna use google
in this section we will develop
expertise with an intuitive
understanding of back propagation which
is a way of computing gradients of
expression through recursive application
of the chain rule
understanding this process and its
subtleties is critical for you to
understand
and you think i should understand it but
i don't i'm a neural network script
kitty
we're gonna read slow mode read all
right let's go
um recall the primary reason
is this written by this is this written
by mr carpathi himself
um recall that the primary reason we're
interested in this problem is look at
neural networks
f will correspond to the loss function
let's start simple so we can yeah
so i believe we're trying to compute the
gradient with respect to the
input
that looks really hard
yo you know what why am i using dot
transpose when i can use dot
t oh that's so much nicer
so
all right let's first look at the
gradients in pi torch let's use pi torch
as a teacher
i mean i have done this stuff once in my
life but like
i don't know it off the top of my head
and i should if i want to really be
good at neural networks um
yo are there there's people like who
know off the top of their head
what the first test image in mness what
number it is is it a seven
it's a seven oh that's a beautiful seven
you know what i made the fig size too
big so that my seven was too big oh yeah
tiny fake
1d target tensor expected multi-target
not supported
up because it's y test
okay all right so can i say like
lost.grad
it's not a leaf tensor use retain
grad so
i don't understand why it's not a leaf
tension there's probably ways to like
view the graph
oh and then before we do backwards i
forgot to do optum zero grad
and that's in the optimizer
i can say model.0 grad as well i think
that makes more sense
i really forgot to do that and one of my
things and that's why the learning rate
was so high
and i couldn't get my examples to work
well i mean i had to set the learning
rate so low okay
okay so we zero the grad we compute the
model we compute the loss function and
now we check that so now can i say like
model l1 grad
linear object has no grad oh wait dot
god
it can't be zero it can't be that
perfect can it
zero up there what's not zero everywhere
okay that looks quality
oh can i do out.grad
grad attribute
won't be retained during autograd
backwards
if i want it it's not a leaf tensor
because it's only used in other
computations
can i do that there we go okay
so this is the gradient with respect to
lost that grad is one
why is it one
there's also a mean there's like a
there's like an implicit mean in there
uh let's get rid of that implicit mean
you can do it with a reduction
what if i say reduction equals none
um and then
shape is this
128 okay so that's for the batch size
that makes sense
oh yes it's slightly better okay
uh
i don't get
what
oh that's one okay that's fine
because there's only one example there
if i did two examples
can implicitly only be created for scale
i want
okay let's see if we can compute this
which is the gradient through the loss
function which i think is what we have
to get right
first
it's just ugly i hate when it gets hours
like that okay
um
backward pass cross
entropy loss
well we can break this up a little bit
more
we can write log softmax right
and our loss is a different thing
all right let's add us
if we use normal softmax then what's the
loss
um let function just solve these logs of
x
and then instead of doing cross entropy
loss
we'll use nll loss
implicit dimension choice for logs off
max has been deprecated
oh m equals one
wow
maybe we should pick a more
controversial sample
is that really right that it's just
minus one there
can be described as
i guess that's kind of right
yeah it's still minus one even when i
reinitialized bobnat
well that's a simple enough loss
function i do know how to take that
gradient
um what if i say
model.sm.grad
log softmax object has no attribute
grade
okay so yeah because the weight would
have to be the gradient so it has a
gradient it's just that tensor is
created implicitly
there's ways to like debug autograd in
uh
this stuff isn't there
okay well either way that's easy enough
to compute which i like
so it's just seven right zero one two
three four five six
seven so minus one and then we have to
put it
through logs off max
what's the derivative of that
you know we don't have to use a model
here either this is using a lot of fancy
torch stuff we don't have to use
kind of meet in the middle
um like if i just made those normal
matrices
and for that i can just run that
let's check in on chat
bro just use wolfram to get the
derivative bro you know what
by chad69 that is not a bad idea
let's just get the derivative of this
thing
wolfram alpha
so i want the derivative of log soft max
okay
so log x x divided by
oh
sigma
let's just say x x plus x y
it's not a vector
assuming log is the natural logarithm
that is exactly what we want
derivative
see i'm not even really sure what that
means because i can get the partial
derivative with respect to x or with
respect to y but i really want that
okay let's first figure out what i'm
trying to do i'm trying to get the
derivative of the
output with the input with respect to
the output
all right so first let's start with
np.010
uh then we say out sub 7 equals minus 1.
okay look that one looks the same as
that one oh i did it so well all right
now derivative
of log softmax
oh yeah what happened to ikea
i have an idea why don't we read the pie
torch source code
you know if there's enough food for me
ah
this function doesn't work directly with
nlos which expects the log to be
computed
between the softmax and itself
i mean so i should be able to i should
let's use a little pie torch for a
second
so if i do where is that defined
uh torch nn dot let's
say gn
wait no that's the gradient in
that's not the
in fact i can just say like l2 sub zero
so it's that that i want to take the
soft max of
well no not l2 just
x action no next test spreads
out yeah that
let's retrain the model quickly
all right i think what we're going to do
is we're going to get lunch
and then we're going to come back and
then we're going to solve this hopefully
it's all set up
got it beautifully set up let me just i
can push this to github if you guys are
interested in playing along at home
what let's take a break for a minute
um half done
eminence from scratch
promise i will finish
soon
all right you guys can play along at
home just so you know what we are trying
to do is it clear to everybody what
we're trying to do
we're trying to re-implement that
backward pass i mean the forward pass
was so easy we already got the forward
pass done
we're trying to re-implement the
backward pass in numpy
and then we're going to train this exact
same network in numpy
but we have to figure out how to get the
derivative of log
softmax you know that's this is this is
this is
complex math but we're going to be able
to do it when we come back
after lunch i will see you all soon
thank you for subscribing
symbol lab oh log of soft max derivative
on math stack exchange i was reading
about the stack exchange controversy
last night or some monika girl
we are all monica um
no they they monica man everyone's
protesting
i hear static exchange is horrible to
their users because they didn't
reinstate monica um
i stand with monika i think i'm not
really sure
from the from the two minutes i spent
reading about this last night
wait what's the lavender letter wow
no no no no no no we're not we're not
we're not going here
um
log of softmax function derivative
using the log identity c see this stuff
wow
that's why you never go on math stack
exchange compute stack exchange would
give you codes
uh cool yeah yeah well we'll be back
from lunch in like uh
i don't know like an hour or something
maybe maybe
eighty percent chance all right thank
you for watching part one we'll be back
for part two soon
oh we never back down when there's a
challenge never give up
never surrender
we got some caffeine food
um
let's go
bring my mug back okay we're going to
cook and by we i mean well not we
and we're going to have tortellini and
we're going to have salsa grip chips
yeah oh we got chips too and no sour
cream
disgusting food yeah oh
this sounds so lovely my even my days
are so lovely welcome to sunday
saturday of that all right
we're going to conquer these derivatives
right now
we gave up when it gets hard and if we
give up get we get when things get hard
what example would we be setting for the
children
a bad one that's right set a good
example
for the children let's go
okay um let's first
do this in pi torch
torch dot tensor that torch and then
log softmax of chin
jout
uh functional
i'm gonna put did dim equals zero
let's print gout
okay those are big numbers i hate one
torch
torch no scientific
notation
oh no they love sound who likes
scientific notation who made that like
the default
oh my grid is ruined i can't call things
grid
oh those are much more reasonable
looking numbers what do you all think
um
we have out
i feel like i can't do the backwards
pass yet
okay so that's what we got from log soft
max oh that's good
that like makes sense right because it's
so sure that it's a seven
wasn't so sure about on this one
this one it's almost so short it's a
three
we should probably do this too just for
politeness okay
no no we don't need politeness let's go
um
so now we have like this
and like that's the derivative i guess
that's the derivative that's not the
target
what is nll loss let's just read what
happened to our losses
and loss uh
with reduction sentinel it's this
so wait
oh i guess the loss is just like
selecting it
so if we just actually it's this vector
so we can say something like loss equals
gout
oh yeah i love spicy
wow torch hole 64.
um let's just actually put this up here
all right and then here we can take the
mean so we have no loss there
doesn't seem right
[Music]
that one has lost no like no no no i'm
forgetting a negative sign somewhere
oh there's my negative sign that i'm
forgetting
ah so the negative sign goes in front of
the weight which is that
thank you um does that like match what
we're seeing for the loss yes it does
so if we just do this one yeah this one
has no loss and that one has
big loss that one has less loss
okay
um now if i do lost dot
backward does that work
element zero of tensor does not have
require grad
sour cream is disgusting
it's not this isn't a debate that i'd
like to have on stream
but i believe
no never i would happily tell them that
that i think sour cream is is absolutely
disgusting but i haven't really
rehearsed my debate yet
and you know everything i do on this
stream i practice it before i do it on
stream
wait tenser got an unexpected keyword
argument retain
grad why can't i retain grad
oh maybe i just do gin dot retain grad
oh dot retain grad not retain grad
equals true yeah because we want to
retain grads
that's right cannot retain grad
on a tensor that has oh requires grad
okay we gotta require the grad
all right we did lost dot backwards and
now we can do g and dot grab
oh well okay that one doesn't really
have any loss so that one's kind of
unfair but if we do this one we'll have
some loss okay good
okay so
yeah i think that's our output
um
dsm equals gen dot crack
yeah yeah look we took the derivative
yeah
who likes our answer okay that's pretty
good
um let's just do the same one here
yeah now let's see if we can get the
same answer okay the other derivative
should be easier i think that was the
hardest one and we did it
by cheating
oh oh i know why the loss is so high
because the answer is not actually
seven
yeah now the loss ain't so high anymore
eh
that one still has loss let's just check
here if this has loss
now that one doesn't have loss but this
one does
that's a good amount of loss you guys
want to take a look at it just so we see
like what we're looking at here
it's a 2. let's confirm that it's a two
no we can't m show it
it's a two
oh okay so the derivative says make it
more two and less three i believe
or more three and less two i don't know
this doesn't make any sense
less three more two okay lesson learned
and then we want things that look like
this
we actually can't get that derivative
there oh but actually
i think i can say not requires grad but
i this one's going to complain it's
going to say that you didn't retain the
grad and you need to retain your grads
but just to confirm that this is going
to be that but minus 1.
what do you mean what am i doing
um oh they love when i explain what i'm
doing
uh what am i doing right now
i'm yeah well
do you know what mnist is what
do you know what mnist is
um mnist is numbers and
you can get the computer to tell you
which number a number is
oh numbers yeah yeah it's pretty good at
it too like you want to see some numbers
um i'll show you some numbers and then
the computer can tell you which number
it is using matrices
you know because we love matrices that's
correct um
yeah but getting the matrices to be good
at telling you which number numbers are
is
that what we're trying to do and it
involves calculus and i'm not very good
at calculus
i'm good at programming but i'm not good
at calculus so we're cheating and we're
using programming instead of calculus
and it's sad uh we shouldn't be doing
that we should figure out how to compute
that without it but we'll get back to
that one
i promise we'll go back to that one
let's move on now to l2 we got to get
the derivative of l2
l2 uh
yeah so this one's just like we're gonna
like transpose the matrix or something
number rectangles go burr
um see and now it's
yeah uh okay
so we should be able to produce the same
image
using numpy
is it really just you know let's just
try some like dimensional analysis crap
what if i just do
l2.t
is that the same image invalid size
oh it's only in a valid size because we
should really do
yeah let's make everything batch because
we don't make it batch we're going to
regret it later
how did that break oh because dim equals
1.
and then when i wanted to make dim equal
one and you guys would like don't make
dim equals one that's a lie you guys are
just controlled opposition
uh
dsm dot shave l2 dot shape
i don't even think i have the shapes
right if you oh because i used 10 there
no i didn't use ten
just is ten
yeah okay so we just don't understand
what we're doing let's read
back prop
it tells you how to do it with a matrix
um
weight dot t dot transpose dot
d d tips use dimensional analysis oh
good that's what i'm good at sweet
okay um what is x
oh
okay so we're doing the forward pass
where we're doing
oh w dot x should i not have transposed
those
w dot x x dot that
seems right
probably the most tricky operation is
the matrix matrix multiplication
if we want
if we want dw
suppose we have the gradient on d from
above in the circuit okay
so we do have the gradient on d which is
dsm
so we want to say dsm dot
i think it's l2 dot t and i think that
is the derivative
dw is that
it doesn't have the right
shape
well so if that's d w
like somehow that became
okay so i guess first we compute
well so this isn't dw
this is d
oh yeah no shit we have to retain the
things from the forward pass yo if we
didn't do that of course it doesn't work
yeah what am i trying to do we didn't
retain the thing from the forward pass
i'm trying to compute this without
actually using the image
okay we gotta name things more carefully
um so we're gonna say
uh x underscore l1 what do they name
things you know what we'll just say
yeah x underscore l1
x equals x test two and this is going to
be x dot
l1 which is x dot l1
x value
equals np maximum xl1
0 xl2 equals
x rail u dot l1
yeah so it's really this that we have to
compute
ah this isn't l1 this is that wait
all right let's just print the shapes
here
thank you oh this looks so good alex
there's cheese yeah
that's delicious thank you
oh and then actually we can confirm
that these are the same things
like it has to be right
yeah they're the same
well but they're not actually perfectly
identical
they're very close but they're not
perfectly identical all right
so then here we can just make this xl2
um
all right so what was the input we want
x value
and then actually i think we want
let's just try that
no
oh
in this example
our w is x
value and our l2 is x
we want to compute dl2
and dl2 equals l2
dot transpose dot dsm
that's not right
same shape as d
it was the same shape as d
oh did you make your own what did you
make your own
yeah with sour cream
i don't know how you eat that what i
don't know how you eat that
what am i doing wrong you guys like
screaming it in the chat
chat is quiet today
too spicy
okay so
in our forward pass let's just be
explicit
w
is x value and x is l 2.
our x-ray u has shape 1 comma 128
and l2 has
shape
i'm going to get the derivative of x so
we're trying to get dx
so we can do x
relu oh
is that just right yeah okay that's
right
perfect is that the same image i mean we
can transpose it but
okay good look that image looks the same
as that image computed by pi torch
oh yeah we're making progress we made
our first derivative
we also need dx value
should go on to the next because we're
going to need that for
oh now what's the derivative of a rally
you know what this one i think i can
figure out
no actually i can't what's the
derivative of x it's just
one
and then the derivative of z of zero
wait is the derivative of a value really
just that that and that
i think that's right
so
so it's just one wow
is that really the derivative no
so
huh i mean that seems right right
what no nothing can be removed
everything on the internet is forever
ask hunter biden he knows
we're trying to figure out what news is
fake and what news is real
um it really does seem like the
derivative of value is just
zero if x is negative and
and one of x is positive but that just
seems too simple
i mean let's try it
derivative of value
so we're trying to figure out what dx l1
is
and then according to that it would just
basically be this
maybe
let's name this better
dxsm
name this d alto
the derivative of l1
if that's x-ray u then i think that's
just
x dot
dx i want
does that image match
almost i think my relu derivative is
probably aggressive
it's probably not right
because that doesn't look like that
other image thank you
we got tortellinis
here's good to me
yeah that doesn't look right
okay the one derivative that i
calculated myself
is wrong
no okay that says right that wow is that
really the derivative of
that's unbelievable if that show okay
um but no that doesn't explain why my
image doesn't look like
the other image
so x value is what's going into l2
and x is what's going into 11
l1 so that dot that
oops that's an l not a one
what'd i do wrong
probably no i probably got one tiny
thing wrong i'm just a little i'm a
little shocked
that the derivative of value
is that
i probably have to like multiply it by
something for the chain rule just remove
debris bro no differentiation
relu is not a continuous function it
can't be differentiated yet nobody cares
about that
i probably have to multiply it by
something for the chain rule
after all the good comments who reads my
crap back prop
for relu is you take the dx coming
backward and
zero out the entries that had negative
pre-activation
is that really right you're telling me
it's this
i mean this seems more right to me i'm
not exactly sure why it's true
that still doesn't look right
i guess i mean
we have to use a chain rule
[Music]
i'm pretty sure relu evolves into
lucario
um
[Music]
i know torch does the chain rule for me
one if x greater than zero
else zero but that's exactly what i
wrote here
like i just can't believe it's so harsh
okay so i guess i do have to i probably
have to multiply it by the input then
all right
because that's the chain rule
that still doesn't look like that
all right let's look up the chain
um
did you want to look at the numbers
and the computer will tell you what
those numbers are
oh that's cool yeah like reads numbers
it's like this is like the classic
machine learning
yeah it's famous
what did you just ask the why question
oh
um his feud with schmidt uber is lame
no young lacoon i don't know i mean i
guess that was a
big schmidt hoover fan but then like
what does schmidt hoover
do today he still complains about the
feud although it was like a feud and
there was like
leaked videos on youtube of like you
know him like like looking at y'all
it was weird
um no the feud had to do with like who
invented deep learning
it was stupid um
who cares i think andre karpathy did
actually
that's what i'm gonna go with
okay then the derivative of if we define
yeah so this kind of seems like y
we do have to multiply it by dx value so
that's probably right
why doesn't my picture look like that
picture
too much wood
oh wait
no i think one of these shouldn't be dx
value
one of them should be x-ray
yeah there we go boom
we use the chain rule and we figured it
out
is that right
yeah so we just basically we just zero
out the derivative everywhere
to zero out the derivative everywhere
that uh
the original function
was negative
okay and now we're done
now we implement the learning rule
oh now we have to do the derivative of
log soft max
that isn't done like that
the sauce is spicy
you told me 10 minutes ago yeah yeah
yeah i'm sure you told me 10 minutes ago
okay
[Music]
can't use mse for classification bro
that's exactly
bitchin 69
knows what's up
so therefore we have to figure out how
to get the derivative of log softmax
okay well so we know it's going to
involve
will involve
xl2
out i'm going to move this down
back here
we'll involve xl2
out and produce
dxsm
um
the derivative of log soft max equals
1 minus soft max
minus softmax if it's not equal
first note that that's what soft max is
so if we want the derivative
oh my god see look at all these upside
down
why do they use symbols in math why
can't they just use normal people things
like
letters
all right that's the softmax function
cross entropy with softmax
oh this looks nice
oh now that i turned off science what
wait oh i didn't turn off scientific
notation for
numpy
that one actually know how to do
so
foreign
all right i don't know where they're
getting these z's and y's and k's from
it's just equal
oh
the time of the forward pass you have
that
okay grad import
one
so i don't really know what the grad
output i is i think it might just be
that but
negative
well let's just first try it looks like
we're doing an x on the output
so if those are the three things
what's the input
those are really large numbers
um it's not really right nan's
worse we hate nands
output
sum minus x
times sum grad
output data
okay so soft max is that
so
so
this code doesn't look very competent
because this is gonna it's gonna set
this over and over again
okay let's go back to first just
computing the log soft softmax which we
were doing
whatever that range thing was
here so that's
wait if i do if i set softmax let's just
use softmax forget log softmax
uh
just want to know how to turn that and
that into that
uh
long softmax update output
th tensor new contiguous
grad output
grad input equals
grad output minus
x times sum
so first we sum up the grad output data
which i think is just minus one
those numbers are just crazy small
oh probably it's related to
yeah oh
okay i think i get this
uh
all right so we're going to need the sum
what i just don't understand is how it's
not the sum of the x
guess that is output data yeah okay
so first well first we have to get the
output data we haven't actually computed
the forward pass
we haven't computed x underscore sm yet
so how can i expect to take the gradient
yeah so we can do the forward pass on
soft max
um i made that same mistake twice i
forgot my forward pass
so the forward where do i compute that
again it's that range crap that i did
here we go this and i called it big
stupid things
i feel like i just did that already okay
xsm
equals minus xl2
uh we need out here
um times out
uh
plus np dot log np dot x
xl2 dot sum
axis equals one
oh that looks similar to that
um i think you're supposed to do a
stability hack for soft max but i don't
really care
no it's like not really times out
maybe it is
okay so we have that
so those numbers look suspiciously close
so that's output
take the x for the output data
really big numbers
oh actually let's rename this to lsm
because it's log
softmax
so to be right if i go like that does
that give me like reasonable
probabilities
no
well actually this should be the same
thing as gl right am i not even getting
the forward pass right
yeah i'm not getting the forward pass
right okay because there's a negative
that i'm forgetting somewhere
the log softmac function
this like simplifies to something though
it's like this in theory but like you
can simplify this right
so in log space that's just the same as
dividing is the same as subtracting
so
we can just do some 2 there
if i want i can just take that outside
and i can do np.log that
minus log that
um why is that all right
oh well that didn't compute it for each
one and that computes it for each one
so times out
negative infinities
oh i didn't do an x
oh but okay log of x is just the same
thing
so yeah it's that right
i mean they're similar i feel like
that's just due to numerical
instabilities in here
log x sum is that a
numpy function
yeah that's probably just numerical
instabilities okay so that's the forward
pass of the soft max
i mean okay that's no that's actually a
lot to attribute to numerical
instabilities i don't think it's
numerical instabilities
because out's not right
oh i have to it for like each one what
if i do that
oh there we go okay don't attribute to
numerical instability until you've tried
harder
good okay so this is a log soft max
forward pass and it
matches
all right let's clean up some of this
crap we don't need that anymore
all right now we're actually finally
doing the forward pass
those two things match now we have to
figure out how to get the derivative
okay
that shouldn't have anything to do with
out
yeah so the log is just this so we have
to take the derivative of that
oh wow okay i was being the news i was
trying to combine the things together
don't do that
okay all right so that's the derivative
of
out i'm not exactly sure how it got that
oh because the mean is the derivative i
get it
d out equals negative out divided by 10.
so those should be the same
okay those two are the same
all right now let's see if we can
produce that and now we can go back to
that code
and we can look at what it's doing okay
so we want the sum of the grad
output data so the grad output data is d
out
so we can say d out dot sum
this sum and then the
output data itself
i don't think that's right
it's not out is it it's the grad output
data
i guess that output data is the
output data from log softmax which is x
let's x that and see if it looks
reasonable
okay okay
so what if we just is it this
d out equals npx lsm
times d out dot sum
just call it alt for now d out minus
oh yeah buddy
dx lsm equals d out minus
npx lsm
gotta cite my shit
all right now we have dx lsm computed
from that
and the pictures look the same yeah
buddy
all right
um you know i kind of want to keep that
pie torch coat around it's not deleting
now we don't need this pie torch code we
just want people to think we're pros
and we didn't need it
so actually to be complete we can say x
loss
equals um
x lsm negative
out times x lsm
dot mean uh dim one
axis equals one
so that's the loss
now if we want dx loss
which is that
do we actually have to use x loss
anywhere
i feel like we should
but yet i don't
um
what do i call it up there samps samp
uh it should work for two samples too
right
um
i don't know why it doesn't work for two
samples but we'll do with that later
okay forward backward pass okay we have
the gradients now the weight matrices
written entirely in
what is x loss
oh i'm not even setting d out anywhere
we have to set d out
that's probably why
having two samples didn't work
no that's not why
all right let's go through
it's test subsamp x dot l1
and p maximum delete that
delete that
see if it works for a different one uh
actually let's use the same code
just say sam equals one
samp there so what if i do one comma two
there it does not work
square can only be implicitly created
for scalar outputs
uh
oh because we have to take the mean
i don't really understand how to do that
that's going to be a nightmare
because there's only one weight gradient
and it like computes it over the mean
okay well you know we can just compute
the gradients one at a time
it shall be slow but you know what they
say about slow
it's okay great it's just okay okay
so those two pictures look the same they
don't huh
what did i not do right
oh i should have left that pie torch
coat around we could have compared them
yeah my my x1 gradients totally don't
look the same
let's just hope i made a typo
dx lsm
d2 x value you know what i know how to
check for a typo
restart and clear output
training the pie torch
that's the gradients at zero copy the
network numpy forward pass
confirm they're equal
ah dxsm aha
dxsm because that should be lsm my dx
rally was wrong and that's why my
pictures didn't match
beautiful junk
junk junk junk junk junk let's commit
this
we have numpy backwards
pass no what
what's wrong
you can tell me in your favor
ice cubers
um
oh
appreciate that switches
twitches i know you're still there
i see you can you see me
you just see a lot of things
how many pixels
yeah outlet was pretty good
you want me should we stop should we
stop with the net
i promised alex today we were going to
smoke weed and watch the sopranos
and instead you guys all got a shitty
calculus lesson
how many people we got watching this
you can always see me
oh they can't see shit yeah they can't
see over there
better cal class than i had in college
yeah we struggle until we get the
derivative to match torch
yo imagine the first guy who had to
figure this out and couldn't just
compare it to torch
man that's the lewis and clark of deep
learning
oh carpathi wrote an autodesk oh we
could do that
nah newton just wrote it on paper newton
couldn't import torch
shit man imagine you let newton import
torch for a week
i'm lost without test vectors too
what oh you want me to use the big
handle wow i feel like newton i bet
newton had some shit that looked like
this
all right let's go to the bathroom and
let's get back to work
we've still got to implement the fun
stuff like gradient descent
and xavier initialization that stuff's
fun
you know it wasn't fun the derivative of
log soft max
and the derivative well the derivative
of revenue was shameful but i didn't
know that
with the derivative of log softmax that
one was bullshit
so complex
so
uh
okay um first
i think we're gonna have to
no we're not playing chess the legacy of
com
tom cruise is being taught in college
security courses you too can have this
kind of skill
all right let's first figure out let's
get it to work for batch gradients first
all right so like let's do 0 1 2 3.
that doesn't work grad can only be
implicitly created for scalar outputs
and that's because we got to stick a
mean on there
that's a lot of feet
wait what is i commenting out that print
how something's still getting printed
oh lost.grad and outdot grad
oh look at that wait is that really true
oh that's minus one
why is it minus one if i do mean and not
minus one if i don't do mean
still minus one never mind
what loss function i'm using a lot loss
i mean that's just going to change the
magnitude of the gradients we can just
do that
okay so those that's a picture let's
confirm
that the two pictures look the same i'm
using samp two
okay those pictures look the same
um okay now if i do samp01
oh it does that
all this we just have to make length of
samp
okay operands could not be broadcast
together
uh oh that's what
hmm got reshape
oh
whoa look at that that's trippy
how'd that even happen
okay so that's what zero comma one looks
like let's see if zero com1 looks like
that up there
no they look totally different
i mean that the out is different
now those are the same
i don't know i kind of like mine better
should i kind of just like stack them
i like i like my gradient better can
someone tell me why it's not better
they're stacked more fairly it seems you
know we love fairness on this channel
oh okay
so this is one of the problems actually
my dx lsm is just wrong it's not even
the right shape is it
2 comma 10 is right but yeah
we wanna do some axis equals one i
believe
yeah and then we sum axis equals one and
then we put a reshape there okay good
now those look the sack and now it looks
the same oh that was really easy to make
work
overflow encountered in log um
we can actually fix this too there's a
there's a stability hack for this where
you subtract
why is it printing stupid scientific
notation
it's really insisting on scientific
notation
um yeah you want to do like log sum
x
oh log add x
oh it only handles two inputs well
that's stupid
um what's the numerical stability trick
for this
overflow encountered in log
see any overflow do you see an overflow
those look like very reasonable things
to take the log of to me
i think i can do something like
i want to subtract the max
because x gets big
if
the numbers are big
so if i subtract
this works out to like the same thing
mathematically
that doesn't look like the same thing
subtract them in
add them in something like that
log sub x trick
uh
oh we subtract c okay
if we set c to the max so
the way to do this if we want the same
value
and so my logs don't complain about
overflowing anymore
because we say xl2 dot max axis one
um dot
reshape
oh wow yeah it's really just the max
okay that looks the same but now if we
want that
fast one we can say
i'll call it say
where does that not match that matches
oh because we don't want to reshape it
there
i only want to reshape it there
perfect beautiful stability hack
and yeah the derivative doesn't do any
logs it just takes an
x so there's nothing i can do about that
probably there probably is but you know
that would involve knowing calculus
well you know
all right so let's check a bunch of
gradients now
yeah that looks like wow look it's like
learning look at how much it's learning
look at all that learning it's doing
well that's beautiful those gradients
are beautiful
all right let's check it down here
looks the same oh man imagine newton had
pytorch
pie torch newton
lost that crowd is just one i don't
really understand why it's one but we'll
understand someday
you don't need those anymore that's all
right
okay
def forwards backwards
xy
you know what my posture
yeah i know it's not good i'm hunching
over the computer
this chair doesn't have a headrest like
my gaming chair
i don't know about these just you go
boss chair
herman miller
i get those guys confused
okay so these are the only learnable
parameters in the model
so we can just return them
beautiful
all right let's get my xavier knits to
match
you know it's really important how you
initialize your
your networks if you don't initialize
them right
um torch
linear annette
linear one is here
and it caming uniform
wow i don't even know what's a gaming
that's some crazy kind of noise
whoa is kaming the new xavier
h is just left
oh it's okay i think it's called random
numpy actually too
okay random
okay times math
wow gaming
crazy not even going to start on how
that works
we will test it a little bit
yeah those numbers look pretty similar
to those
uh okay so what can i copy we're going
to want
that same code
that can come with me
l1 equals gaming
l1 dot shape zero i can just say star l1
shape
renet okay
now we want to do
forwards backwards but not on the test
and we'll just copy that too
that's fine
y train
l1 l2 no sorry
dl dl2 one of these days
right atom
runs fast uh
now we want to compute the loss and
accuracy
oh well actually i can just compute the
loss
kind of crazy high losses is that right
is my log sum x oh it's because it's not
initialized well those are actually
reasonable losses
the only question is why is there no
loss for the first one
weird okay
so those are actually reasonable losses
um
okay so we're getting an accuracy now of
nine percent that all makes sense
now we want to write
sgd uh so we have the derivative
so sgd just just as mostly this one i
actually think i can implement from
memory
um
oh we have to put our learning right
we're not gonna use any momentum
uh okay
that's x loss
i don't know about xl2 as well
which is the out
uh np.org max
cat oh we do need
okay now we need to copy the appends
and we can copy that line when we update
the description
um posture posture posture
update description
and then we'll copy the code we plot
them too
okay so of course nothing gets better
because we didn't actually implement
the update rule yet and the update rule
is l1 equals l1
minus lr times the derivative
oh that looks like decent accuracy
um let's evaluate it
it's called numpy eval
85 that's pretty good i mean it's not as
good as torch but
i don't know it's not supposed to be
plus is it definitely not supposed to be
plus wow that's big negative numbers
yo last time i saw numbers that big
okay so the only question is why is it
shittier than torch
should be pretty much the same
let's just rerun the whole kernel i do
my caming initialization wrong
did numpy forget what the square root of
2 was
it's a pretty common thing to forget
so close like it's almost the same
and it's still learning maybe we'll just
let it learn maybe it learns slow you
know
maybe yeah pi torch has 160 iq
numpy only has
this is probably due to some numerical
stability stuff
they're always talking about these kind
of things and no one ever takes them
seriously
i wrote sgd
oh yeah look 93 it just is slower
that's so weird
my batch size is 128 that's the same
right
it learns it just takes longer
picking random stuff
oh landsamp oh
look what i did
yeah oh so that was oh i had a learning
rate that was effectively
[Music]
32x too high let's try it now
it's learning faster i think
it seems like it's running slower never
mind
it doesn't learn at all like that
okay well that was a bug
yeah the laptop fans going you know
takes a lot of math to learn
deep
what other bugs did i write you know
that's the problem with optimizers you
write bugs
and they're impossible to find because
the optimizer just optimizes over them
you know i guess i didn't check the
magnitude of these gradients i mean m
show is going to hide all that from you
let's check them
hmm they're very different orders of
magnitude
actually they're very different
i don't know never mind no they're
similar
they're slightly different
it doesn't just look like a scaling
thing
they're different they're actually
different
they just look similar
the means the same though
we have these here
transpose obviously
i think this is just numerical
instability
pie torch works really hard on this
stuff
the l1 weights have similar but the l2
weights are different
this is useless
what is numerical instability it has to
do with if you do
like uh
yo you ready for some craziness let's
try 64.
does the same
hmm
all right should we cheat and add
momentum
a little cheating
let's just see if it fixes up
one of these days we'll write
no i think you know what i think i think
uh 86 percent is just what we deserve
um but actually np set seed
is it re is it red
reproducible
it is
let's remove the log x sum hack
it does the same
i didn't do anything like leave samp
anywhere in here right
this is one of the downsides of uh
notebooks
you know what let's restart and clear
output
and let's just try the numpy ones
let's not import torch up here that kind
of ruins it
you don't even have torch imported okay
oh that wasn't numpy well actually this
might already
be
uh
oh well okay never mind
what already is float 30 float64s
maybe float64 has made it worse
and then got an ex unexpected really
i have a fig size somewhere in here i'm
sure i do
on that stupid crap
no other fake sizes all right chat i'm
pretty happy with this
i don't know why it's not as accurate
there may be bugs but
and just the fact that the two gradients
aren't exactly the same
i'm pretty happy with this
even though we only got an 85
oh torch uses momentum by the formula i
turned it off
you know it gets there it just takes a
little longer i don't know let's give it
four thousand
let's make the batch so smaller
it gets there
maybe 2000 is fine
let seed hack let's mess with the seed
until we get a good one
yeah just like real deep learning papers
yeah that's right
i have so much compute that i'm willing
to burn to get a better accuracy
oh look this one's better over 90
percent
with hand coded
stuff here with numpy
wow numpy perfect
um is there any other is there any other
like hacking
that sgd is using
no
is my initialization bad
well there's something we can do what if
i don't edit the things
i just use the ones from pie torch
oh look it improves them
it's possible that their initializer is
just better than ours
initialization's super important
uh let's just run that oh no i don't
want to run that
i should just want to run model equals
bobnet and then
yeah okay so that's
junk but now we don't do the inet
huh it's good now
it's really just all the initialization
my initialization isn't right
that's wild
stupid gaming initialization it's not
right
look now it learns how could it be wrong
look at that if i steal the weights from
bob nat it learns
oh wow wow that really that really makes
you think how important initialization
is
wow that's it that's using uniform noise
that's this if this is what changes it i
mean i already know it's that
[Music]
yo that's even better
i think i've managed to beat pie torch
with my sick uniform initialization
look at that we're getting 96 percent
now
that's insane that's just insane that
that does it
and none of these match pi torch which
does something totally different
use gaming initialization get crappy
evaluation
use uniform initialization get
strong
but none of those match pi torch which
is something entirely different
it's entirely determined by your layer
initialization oh
i can't get over this enough pie torch
linear layer and knit
only calms down
was just supposed to be m times h i feel
like it's supposed to be m times h
that was just bugged
six divided by i don't even know
i don't even know this doesn't make any
sense but
that one's pretty good as well okay
they're all good they just need to be
scaled right
yeah somebody forgot a times h i think
in that in that crappy example that i
copied
wow numpy is better than pie torch on
both of them
but
what is pi torch using i don't know this
is a great mystery of the future
but for now let's run our notebook sit
back
and enjoy our 96 percent
accuracy
using two linear layers we've actually
beaten
pi torch inaccuracy um didn't even seed
hack changed it back to one three three
seven
everyone knows that's a no number up my
sleeve seed
beautiful pie torch 93 percent
numpy 96 yo and what if i make it float
64.
i bet it's going to be even more
accurate same accurate
did that look less noisy to anybody else
what if i make it float 16
more accurate wow what if i make it
you win date
you win date is weak float
16 look float 16 such a winner
float 16 just wins
note add
more accuracy
with load 16. all right
colonel restart and rerun all let's
commit this
i'm very happy we got over 96
that's accuracy that exceeds pi torches
accuracy
because we're using we're using
uh good initialization functions
initialization is super important when
you do your deep learning always
remember that that's the lesson we
learned today
and we're getting 96.3
of accuracy we'll do very quick
questions no we can't be overfitting
this is the test set
we train on the train set and we test on
the test set don't pi
eval test on the test set
oh yeah look pytorch got a crappy
patchwork sucks
compared to numpy i'm going to write
deep learning but it's going to be
accurate
no what is this both a thousand i did a
thousand for both
pi torches is noisy crap which actually
makes me wonder if i wrote bugs but
actually you know what we can do
we can use layer in it on pie torch
just for fun
initialize nd as parameter weight
dot copy
torch assign weight
i don't want to do that i want to copy
just this
can i assign a numpy ndi i can make a
tensors
oh we gotta transpose them don't we
cannot optimize a non-leaf tensor
what um
leave
with torch torch no
grad
oh now it matches yo whatever
torch's default initializer for layer is
pro tip if you like
accuracy
next
next time through
the notebook consider
pro mode weight init
with numpy
instead of
beta torch and knit
weak crap
now we don't want to say we want to say
instead of beta
torch init weak yes
that's what we want to say
oh yes
virgin torch versus chad numpy oh that's
yeah yeah consider chad mode
wait instead of virgin torch init mode
perfect
all right i think we can commit this i'm
very happy with the work we did today
boys
very strong accuracy
to do why
is torch linear init
bad
is a hundred percent accuracy not
possible oh well
i mean that's a philosophical debate
on the test set of course it's possible
in life and in general 100
accuracy probably means you have an
evaluation problem
um numpy
accuracy greater than torch accuracy
all done
ah can you feed your own drawing to test
okay okay
how do i make a drawing
okay fine guys what number should we use
what number should we use for our own
custom drawer
no we're not using paint we're using
okay okay can we get can we get a vote
going here
let's draw a nice three all right four
all right we'll draw a four right i'm
sold on a four
okay so it's 28 so that means we gotta
go seven by seven
four fun can it
recognize four okay
so we're gonna draw a nice four
and we're going to go through all by
hand and we're going to compute this
and then we're going to see if we've
written
high quality code or not or if we've
really just over fit to junk
we can improve our 4.
this four looks upsettingly like a nine
all right should we go should we go to
14 by 14.
no 14 by 14 is too much that's a good
four
if it doesn't recognize that as a four
nothing's a four
do people believe in my four
all right that's a good four okay so
let's um resize it how do we resize it
quickly
we gotta resize it
um
how do i resize resize resize or size
resize
uh in a one-liner
well it's not so num it only takes in
things that are
28 by 28 so we got to resize it
that's not going to work
i want to stack those all i concatenate
them
upscale to 28 by 28.
okay you ready we're going to write out
we're going to write out the whole thing
by hand
we have an m m dot
reshape
all right let's take a look at the
forward pass
dot l1
uh we gotta do a relu next
uh np.org max x oh it's a nine
it's a nine oh no it's a nine
that's really a nine let's change it
until it's a
nine i mean to be fair it kind of is a
nine
nine it's a nine
i mean like you understand where it's
coming from right is that more fory
oh now it's a four yeah now it's a four
that's right
what is it
um wait how do i get large
text ipython
notebook large text
never mind i don't know how to get
large text but let's run it again
oh just put a four in the output and use
four backwards to get at the canonical
four pick yeah that's not as easy as you
think it is
all right let's draw two you know i
don't like fours they look too much like
nines
who who let me convince that it was four
okay fine at three threes are good
that's a nice three
that's a five damn it
deep learning doesn't work
still a five
we're putting it back to four and we're
just calling it
deep learning doesn't work no we like to
end things on a positive note
let's draw a better three
that's a four
these are all fours well really that
that cross over there really makes it a
four
a nice four oh someone wrote a nice four
oh user four
no your four is too large
all right we will try your four just
briefly
just to see if it works oh that look
hell kind of four is that
list has no attribute reshape that's
what kind of four that is
your four's not even the right size it's
812.
you have one too many zeros over here
oh yeah why was i trying to draw my 4
the stupid way what if i just draw it
like that
i can't believe i'm deleting the zeros
in your example
and you know what the worst part is i'm
not even 100 sure that i'm deleting the
right zeros
oh but now i accidentally deleted one of
those
no no no i deleted the wrong zeros
it's a seven okay that's not a four
but you're right what if i draw the four
like this
that is undisputably a four beautiful
that one's a four
i'm very satisfied with that we're gonna
leave it at that i bet even if i delete
this it'll still be a four
oh yeah that's a nice four oh
oh how does this four look oh that's an
even more beautiful four
to even bring it closer together let's
bring it closer together
oh that's the four
why don't you let me draw my four with
the slant that is a
solid four it prints four let's see how
convinced it is that that's a four
oh super convent wait what
isn't that number bigger than that
number
zero one two three oh four's over here i
didn't count right oh look it's so
convinced it's a four
it might be a nine it also might be a
three
and let's see what number it's
definitely not it's definitely not a two
it knows for sure about that
okay let's rerun this let's commit it
and then that was today's stream
that is a beautiful four except we
actually have to change this to four
train evaluate four four
love it
look it knows what a forest very
impressive do you wanna draw a number
are we done we're done
it knows four
thank you all for watching everybody
should we do questions
um
hmm
it works
to be fair the other four did not look
that much like a four i only had seven
by seven to work with oh the quest
jailbreaking stream want to know about
that
um you gotta go
who even gets out of bed for 5k i will i
will give you an exclusive license
to this four recognizer for only 500.
it can be yours i'll take it off the
internet just like that wu-tang album
it can be yours
nobody draws four with a slant exactly i
don't know what i was thinking
of course i thought it was a nine you
know
will i raid someone after finishing
stream to be honest i would but i don't
know how
i'm not a very good twitch how much for
a five recognizer
i don't know about that what
are you gonna shower
all right and then and then i'm done
with streaming i'm done with the
computer for all that
is there water involved
raid awkward chats all right
you're not chilling for yourself are you
this is an ad i'm watching an ad right
now
um
investigating info this sounds too much
like doxing
we gotta i will have i will have people
to raid one of these days you got oh you
just got an ad for this stream i'm sorry
you get yeah yeah no we got um
i know the oculus is challenging me yeah
yeah we got we got things to do
oh yeah lana locks yeah well
that sounds good lenolux has
raided me several times she's streaming
right now
his channel is intended for mature
audiences
start watching what i got an ad again
wait can i not i already have a raid in
progress all right excellent
passing on the viewers enjoy everybody
thank you all for watching
i hope to see you here again next time
we stream and we'll do something else
all right bye-bye i got things through
today
okay we're back wait let me turn my
lights
on it's raining too much for lunch so I
ordered a
calzone and it'll be here soon and then
we'll have a
calzone but we didn't do any coding last
stream so let's get to some
coding uh zero viewers I don't know if
anyone can even see this because I like
how I
like I don't even know I don't even know
if people are going to show up it
doesn't make any
sense
um it says z z z for the session so
that's probably just
wrong still zero viewers okay well if
I'm talking to nobody then I'm talking
to
nobody maybe you'll show up eventually
okay so we're gonna answer a few
questions hip P
top first let's measure the speed of
it so let's use the lower level tiny gr
apis um from Tiny B time import
create hip device one device
zero device
one now we have copy in and copy
out
um these are slow because they're not
pinned
pages
so
let's
allocate I let's allocate something
that's
like a
gigabyte b0 B1 and then we'll
say d. allocator do transfer v0 V1
with
timing thank
you uh argument type hip is not ital so
we have to do hip colon or just say hip
there and here we can say hip colon one
let's
go okay and we're missing a parameter
called size so we just create a new
variable called size here we'll
parameterize this a little bit timing
can take
a function Lambda X and we just want to
know the gigabytes per second so if x is
seconds and we can say size
overx that's measured in that in a
second let's see if this
right uh and let's give this a floating
Point
descriptor okay well that's probably not
right because we need to put a size in
there let's just put a space in
there um I put it in synchronized for
some inexplicable reason it's because I
didn't eat czone yet okay so where
actually copying at an absolutely
horrendous
speed um our copy speed is 3.9 gabyt per
second which is terrible and like nobody
really thought about
this I don't know why I didn't measure
this okay it gets a little faster when I
get bigger but I mean okay there's a
chance that synchronizes just
[Music]
slow it shouldn't be
though yeah this like
sucks is that even this doesn't even
make
sense like that should be
asynchronous but it's not she transfer
it's M Copy async it's just not a
synchronous this
sucks uh I create the devices there
shouldn't be any reason that that's slow
remember that over
here I'm
getting yeah nobody's thought this do at
all okay great because remember that in
the roam bandwidth test which uses the
HSA apis I actually get very fast
communication between the
gpus like 28 gigabytes a second and here
I'm not even that's not actually real
I'm not even synchronizing and it's just
not
working I don't know let's try it three
times never trust something the first
time okay it does get
faster synchronize I get rid of those
are infinitely fast now I see um so it
must be doing some like
pre-synchronization shit okay that's
actually pretty good then
um let's just if I do ictal equals one
and park okay cool let's actually make
sure we can commit this
stuff uh create a
branch
okay uh cool that's ioctl but we want is
AMD L
for um okay so why is this slow that
synchronize the mem copy fast it's here
it says wait for Signal that's actually
slow and that is that
signal
interesting
[Music]
I do two of
them
interesting so it has this weight event
here okay um so this is not the max
possible speed but what I want to
check is what if I write a kernel myself
like if I write a hip kernel can I
access
uh stuff so we have something here
called compile
hip you can use this
[Music]
API let's see if we have a demo that I
can just crib off
of yeah this
one
what is this for we're trying to get
llama to run quickly on two
gpus so if you missed the earlier stream
we trying to get llama to run yeah
quickly on two gpus I don't know a
better way to describe it than that okay
um let's just try like float
a
I get access to like
the like
this so we have block idx times 2 I
don't want either of these how do I just
get the
um does hip have the the lower level one
I forget if they do that would be in C
style here so you actually have to do
this WOW block idx times block dim plus
thread idx okay block idx time block g.x
plus r idx we say a sub GX = B sub
GX um
now we want to
program something
like not to program but kind of like
that I don't need a compiled as Runner I
think we just want build here so we just
have runtime and we have the name and
the library
great so D 0.
runtime uh uh the name of the function
is test and the library is lib so we can
have frog if I do instead of doing this
transfer does this even
work call with
ARs
[Music]
great
oh we need a global size loal size um
Global size
equals
uh size over
four1 and local size
128 valid configuration
argument
what did I do
wrong
maybe that's
wrong or is everyone saying the dumbest
crap in
chat um what does this
mean invalid configuration
argument
oh hit program device test what no but
do run time should work
too Global size local
size oh those are buffers no no they're
not that should be
right
oh okay so is this the
problem oh sure it was
that I mean let's first we can get rid
of this other device we don't need this
other device
right let's see if that's faster by the
way yeah okay so that's copying within a
GPU
that still isn't really fast enough but
it's pretty
good okay so something's wrong invalid
configuration argument let's Google
that right yeah TP Ram is fast as
shit um which is like what you'd expect
remember it has to do so this times two
is the
real
uh oh
oh I think I have to divide
that Global sizes I have to divide this
way I mean I'm not sure that's the
problem but
maybe okay there we go okay good so you
actually see that this is just as fast
as transfer which is interesting and of
itself um okay now the big question does
that work across gpus
like can I have two things on two
different
gpus okay memory access page not present
or supervisor privilege okay um so I
actually have an idea for this there's a
hip enable
P2P um I think I do it in one of my
PRS
I do it in this
PR or I
don't oh here we go enable here
okay from GPU C
types import hip
um opip import check
then here we want
this check set Dev
zero okay so that will enable access
both
[Music]
ways uh actually we don't even need the
second
one just enable us to access RAM
on oh my
God not only did that work that's faster
than
transfer wow okay I mean that just this
just wow what a stupid waste of
time like I can literally just have a
copy
colel
what if I do
this I'm surprised this is so fast this
might not even
matter wait this is fire just enable
perer
access it's faster this this is
amazing
I don't why did I waste so much time
doing like transfer I just could have
enabled perer access between them and
then I can just access the RAM on the
other on the other
GPU it's literally faster to write the
dumbest program that you can believe to
do the
copy if you enable perer
access can I enable it after do the
Alex how fire is that we don't need HSA
we don't need anything we'll just do
that like okay that's not the
theoretical maximum but who cares I can
actually avoid a second copy
too
not only can I avoid a second
copy yeah I'll just straight pull out of
that Ram okay I just need some
synchronization
mechanism this is
fire um all right so all that stuff
about needing a driver or anything I'll
just write this all right now let's just
get a synchronization mechanism to work
that isn't
slow
um
okay so we're going to need
uh I can just
like
like is that going to
work
okay actually it didn't break but I have
no idea if any of that actually
worked okay so let's inq
that and then if I do d0 synchronize it
should actually probably never
synchronize right it's gonna hang no it
doesn't hang why doesn't it
hang um I guess I don't know what the
initial state of that
is
welome to the dumbest way to write this
ever oh I guess yeah okay so we can do
something like Prague clear
Sam Global size local
size and that's synchron should never
finish I
think okay that shouldn't
work just H
VTO
oh
okay
cool um I don't even know if I can
control C this
like
wait that's like
sick all right like let's just C that in
Honey gr that just works and then we
don't have to do deal with any like we
can delete all the transfer
code just pull right off the other one
we we use the dumbest spin lock you can
believe waffle Awakening you're banned
you're banned man congratulations you're
asking dumb fucking
questions
um so yeah I bet if we put this here it
doesn't work but I don't really like
that how do
I fafo boys
fafo oh I actually have to implement
this
no that doesn't make sense hang
on no that doesn't make sense you see
the
problem how is that that fast it can't
be that fast oh because I need to clear
it no still not
working oh oh well okay maybe the clear
isn't finishing in time yeah okay have
to synchronize after we do the
clear interesting doesn't work at all
[Music]
anymore okay okay we spoke prematurely
we actually have no idea if this is work
okay by the way we should be able to
just say set and then say like in value
here and then just do
value I think this works
um am I allowed to just go like this
this is a tiny great
question see
works well I mean that's a problem
does that stuff
work okay that stuff works uh so we are
setting it but this must be
wrong what if I allocate it
here it's going to bitch me out and tell
me it can't set it because I didn't set
the thing the other way okay memory
access fault that's fine just enable the
perer access both ways
okay that works now uh does this
work interesting okay maybe it doesn't
work
um I clearly set the
value this should be equivalent
right
can I do print inside
hip does that
work uh no known conversion from in
oh but it does have print F
what have a lot of questions about that
okay so this doesn't work
um volatile only creates a compiler
barrier I have atomics
wait C+ 11 atomics are just straight up
available all right
cool how do I use
them
where my pizza I got a calone boys oh no
it didn't go
[Music]
through
no
it didn't go through because of the
issue with the
bank the bank just ripped me off and
took my food so we're gonna have to wait
another 20 to 35 minutes for this
calone this
tragic all right let's figure out let's
find atomics we had these up
before Oh by the way this kind of
copying is nowhere near as fast on Cuda
but I guess it's only because Cuda
doesn't have the uh peer-to-peer working
I don't have those
cards all what should I do like Atomic
and
we shouldn't make this a make it an
in I don't know anything about
volatile
in atomic and with
one well not Atomic and with one does
that
work
also this sleep aive
see let confirm if I com this out
works okay that
works
uh
if I set this to one does that
work that works
okay problem is just when I don't set it
to one until down there it doesn't
work okay atomics don't fix this uh do I
have
to specify it's Atomic what's Atomic
exchange
system atomics are required release by
default here I don't really know that
much about this stuff I I've never used
atomics
before
um
okay you know what I do know does this
though like nickel does
this I'm pretty sure nickel has do
there's like better ones of these wonder
I
produce
no
no I mean it's probably not invalidating
the cache probably the problem here is
that Sam is put into cash and it doesn't
expect that something else can write to
it this is usually what the volatile
keyword will overcome but it doesn't
seem like I'm having luck with
that doesn't like that
um can I have like a global cash
flush it's could to be something that
bypasses the cash
uh we can look at the kernel I think I
can sayal 5 and we'll just assemble the
colel oh sorry D
six I mistyped six
five okay so here's the konel
um there's the compare flat load
b32 so that's the
command
I
mean what flat and
Global I guess cuz I have volatile if I
don't put volatile it'll do
Global wait
what I didn't put volatile and it like
worked
think it actually
works no it's just broken the other
way which is
weird standard atomic in pointer work
TR
no include
Atomic this is actually making giving me
some questions about this entire
copy I have no idea if the copy is
actually correct because I didn't check
it which I should do while sim0 equals
0 set to zero synchronize
okay it doesn't work
um weird that it doesn't
work is it even doing that or is that
just somehow optimized
out do you see the code for it here
I
don't yeah without volatile that just
goes
away with
[Music]
volatile GLC
DLC typically loads
use force a
Miss oh it is love it love it love it
love it so you're telling me if I do
system I think that that sounds right
uh
that all right well that doesn't work
uh oh get rid of
VTO still
wrong we can set that to one and see if
it works
now that's
fine
um
allow seems
right global Atomic
end that's wild that it's actually a
command but hey more power to
it
um can I always try on the other
device no
nothing
is there still
some is there some sink that I'm
missing
okay so what if I put this on
that's never going to
[Music]
work I put this on the other GPU clearly
so it actually does
run yeah that should kick it off
right does D1 synchronize also need the
system business
no
no I mean I wrote that that just that's
just waiting for all the kernels on the
GPU to
finish could it be
slow could it just be really slow I mean
that's a possibility right let's like
just make this tiny more
mags no looks like it just doesn't
wrong
for
trying to get like a semaphore to work
across
gpus don't seem to want
to if I do
that
D1 synch there does it
work yeah okay
so behaves as expected just once we're
in the loop we're not getting out of the
loop stuck to whatever the first read
says um yeah I mean I have a choice of
which GPU I want to put the semore
on
it looks like Atomic system should do
exactly what we
want
but they really Shi the it's raining
hard so you tip your
driver
um it's fine grained
memory could it be something about how I
allocate the memory
maybe the memory is like not like
coherent or
something
H just do hit Malik are there flags for
hit
malic hit mic with flags what kind of
flags
be you have no idea if any of the
accesses are even
correct like it says it's accessing the
memory on the other GPU but yeah like we
have no IDE
TOA so that's one no no it's definitely
access okay wait we do know the first
axis is correct because if I set if I
put a one there it
works right I just put a two there and
watch it not
work then if I put a three there it'll
work who knows why it's a two and a
three read the code
boys but if I change it back to zero it
doesn't
work Global Atomic
and
GLC okay I probably have to put some
maybe I can put some specifier on the
pointer and say like it's like a global
pointer or
something um hip Atomic and system
example what are the
odds
uh here let's learn about Cuda system
wise
atomics okay this all just looks copied
from
Toman doesn't store does
it what does it tell you what this
function
does
[Music]
I mean we just just want to mute
t
SA
printfs available under special H had
are
interesting
no
works
okay
okay someone has a working spin
lock what are they
doing is Master threat okay they're
using Atomic
cast
thread
fence just spin on an atomic until you
get the
lock okay let's try Atomic cast
system what what is atomic
Cass our address
compare
[Music]
Val oh so it will like oh compare
exchange
swap no that's not what I want though I
I want Atomic
end all right they're using the same
atomic exchange I am Atomic and is fine
there thread fence I throw some sync
threads around this if it matters
no that stuff
matters I mean they're not trying to do
it across
gpus
Nock kernel walking deep dive into spin
locks all right let's see what we
got no this is not on
GPO I'm I'm it's not that I'm writing a
spin lock wrong
um I mean they're trying for something
so much more
complicated
oh they're only checking it from one but
again these things shouldn't
matter
okay so we have coherent and noncoherent
memory
something we can try
doing is creating some host
memory do I have a function I have a
function called host Al don't I yeah
host Al here we go so I can try
this what interesting I should be able
to access that
too it doesn't work
but let just try some dumb
stuff
uh I want to like uh how do I convert
this to a memory
view to
MV
that well that should be zero but if I
put like 42 in
here 32 is
acceptable all right so that
works uh let's print the semore
here
[Music]
it
here
okay so it's clearly being set even if
it's in host
memory um that's fine it's really cool
that we can just allocate host
memory which is actually an interesting
choice to places to put the semaphor and
this like kind of makes me reun how I'm
doing this stuff in tiny grad because we
can just do the copy from the
[Music]
GOP oh boss calzone's almost
here calzone's gonna solve this
problem
um
so let's I can't type
six clearly set the 74 to one we're
doing Global Atomic ad on that and then
we have GLC which maybe is the problem
maybe we're like not flushing the right
cach Global Atomic C
Corporation these are like real uh
functions in
the in the
GPU glal Atomic and bitwise and of
register value and memory value okay
that's
right
Co
there's probably some flag I can set
these things to like
uncashed RB check
the
no there's nothing
there
forget to
sleep
no we got to take this hoodie off I've
been wearing white hoodies but we can't
eat food with white hoodies on just have
a bad
[Music]
time yeah
buddy yeah
buddy got a
calone let's go basil Bara and pepperoni
and I learned a great
trick are you going just use normal M
Copy um I don't know actually don't
understand
that so what's happening I'm almost sure
is that something is cashing that
load something is cashing
load how are we going to disable the
cash
so I mean volatile clearly does
something I think if I add volatile
there yeah we lose volatile qualifier
okay so I can't put volatile
there hip device set cache
config no that's not
right okay so you can see you see how
the decompilation has GLC
see I think that's what we want to
figure out how to
disable wait that just worked no it
didn't
um this GLC is what we want to
change so it's probably like qualifiers
that we can
put in front of the
memory okay these are function
qualifiers oh here it's like these
here fory like
managed does that work
no variable
type thread fence and thread fence
block
oh thread fence
system
no
well
it's this GLC right
here if we can figure how to get rid of
that I think it
works exter
shared
managed maybe I put managed
here
no does not
work I we can we can change the assembly
I mean I wish it was just like a quick
way to try that unfortunately we don't
have
that
let's understand more about
GLC so it looks like we can set all of
these with different types of
uh
what's lad AC
choire
what have
Theory maybe it just magically works for
the one they
tested
dude I think it just magically worked
for the one they
tested
H okay does the big size not work oh
that one just might be really
slow okay we might be in slow land
now
um see what happens when we do
that interesting okay it looks like it
only works for Atomic
cast uh
actually but you see I know what's
working cuz this one's
long
I'm not going to put this in
copy I'm just going to make something
called
block before I do that I'll block on S
take that out of there take that out of
there all right does that look
good cool now let's make it big
again
now let's add one let's add one all
right I think we got
it yeah the problem was that compare
exchange just made the copy kernel slow
got it but we just don't
need we just inue a separate
kernel um to block on the
copy
um let's also
confirm that it doesn't actually matter
where I put
this I told you guys that calzone was
going to fix our
problems
oh interesting that doesn't
work okay it doesn't work if you put it
on d0 does it work if you put it on D1 I
don't really care I'm happy to use host
memory for
this nope doesn't
work you have to put it in host memory
and then use Atomic Cass
system
[Music]
Okay so
we can definitely
add actually
H we can even add the semaphor setting
to the uh to the alpha
kernel
because so we have to just use kernels
for
these but at least that's not making any
damn CIS
calls oh I actually know how to
implement this in tiny grab pretty
easily should we do that does that
interest you
guys so the problem I was having
yesterday we going up we're going to
zoom in on
me and we're going to bring this over
here the problem I was having yesterday
is that the events are uh are
slow because they make sis calls but we
can just do that on the
GP like it's kind of an elegant
but
it
works
then we actually might not even need a
copy kernel a lot of the kernels I think
can be like we can combine copy with uh
whatever else we're
doing no we don't have to enq
those we could probably
also actually we probably could
combine the
uh the block kernel with the copy kernel
if we use a loop inside the copy
kernel there's a lack of pepperonis in
this cow zone so I'm saying Mr
modotto
and what do you guys want to talk about
during eating
time was in Thailand I met a
guy from New York we got a pizza
place oh the the docar should use hipost
Mal with defense system yeah that's
exactly what I'm
using
um we could probably also hip host Malik
a big chunk of ramp and then just index
into it for
semors but all these things
are minor speed UPS compared to uh I
want to talk about Cal zones and my
complaints about the food in
Italy let's just enjoy our Cal
home before the shit cating has to
start I solved the problem why can't gbt
forers do this for
me
want to see the
czone
czone this is not the best czone I've
had how come you can't understand what
I'm
doing are you sitting there with Google
open are you just passively or you just
passively consuming
I love Millow mushroom mow Mushroom in
North
Carolina stop
consuming consuming with perplexity open
yeah come
on all right I will legitimately ask
answer questions if you have a question
about what I was actually working on I
will answer
it are we sure there not a more
idiomatic way to do this I mean you saw
that thing that someone linked right
they're
doing I don't have a good understanding
of like how atomics work and
stuff I I know I do know about the
difference between AMD and x86 sorry
between arm and
x86 and like x86 ensures ordering while
while arm doesn't you have to flush
things and apple has a
hack no you want to ask don't like about
this
specifically I'm working on the usual
land interaction my GPU driver I'm not
even using my own GPU driver all I'm
doing so torch has this
sorry hip has this event API where you
can create
event and then schedule a stream to wait
on them but they're really
slow um from a CPU perspective now to be
fair they'll get faster when we enable
to boost
but what's the comparison between Tiny
Box and
adex well so your adx a100
box with 80 gig cards is going to cost
you 100 Grand so remember that you can
have seven tiny boxes for the same price
of your
one a 100
box so of course that box is better but
it costs seven times as much
money um how does it compare
performance- wise one way to think about
the Tiny Box is like one h100 or like
two A1
100s seven tiny boxes is like
14800 um is there any benefit of Ron Pro
the only benefit I see is that they have
48 gigs of RAM instead of uh
24 on topic please uh the ram is uh the
ram is
good but overall is not worth the
price turn that light no this light is
what I have to
turn
how is Tiny Box worth 15K well how much
is an
h100 the cheapest you're going to get an
h100 for even if you're buying it like I
know someone who bought them for 28
each
um
so my Mi i300 I'm not sure if they're
m300 Mi 300X we were talking about this
at dinner they're 20
grand like you can get a whole tiny box
or a single one of these
gpus and you also well no tiny boxes and
h100s are equally hard to get I'm not
selling you a poor box if you have a
$1,000 do not get like don't get duped
all these people selling you stuff in
the th000 price range just go buy a
gaming PC and buy like the gaming PC
with the crappiest processor and RAM you
can believe and the best GPU you can buy
um comma could probably get h100s for
like 30 grand meta is maybe getting them
for 25 just divide it
out they said 9 billion for
300,000 which I think when you divide
that out it's 30 grand each I bet
they're paying a little less but not
that much
less Nvidia is generally pretty about
fair about this kind of
stuff so the memory speed of an
h100 is the tiny box together has almost
double the ram bandith of an
h100 so like an h100 Ram bandwidth is
about equivalent in some ways the Tiny
Box is equivalent to 2 h100s or 4 A1
100s
if you're just talking about Ram
bandwidth that's
true okay not quite two h100s but like
1.6 What GPU am I using I'm using
six um 7900
XTX oh yeah the software support is way
better on the
h100 um if you want things to should
just work out of the box
buy I mean don't even buy an h100 just
buy
like
um buy the uh a6000
probably a68 is I mean they're expensive
you're paying you're paying for nothing
basically or you're paying for software
development and you know how we feel
about paying for software
um from a power
perspective the Tiny Box is more h100s
are more power efficient but not that
much more power
efficient uh I think they're probably
maybe
like so if you go with the one to one
maybe like two ex's power
efficient
the Tiny Box is more on par with the
a100 for power efficiency than the
h100 what's Comm using these days in the
compute cluster tiny
boxes
um can you run 80 gig models yeah so you
can run that's what we're working on
right now
we'll be able to run llama 2 70b on
quantized on a tiny box and it'll be
pretty
fast all right I'm almost done with this
cowone Alex going to be mad when I'm not
hungry for dinner cuz I ate a big czone
for
lunch big good
C have I talked about llama 3 no
we'll see I mean llama 2 is not a big
step up from
llama um tiny bucks V2 uh I hope to
reuse the
case I mean we'll do we'll do Tiny Box
refreshes whenever GPU refreshes
happen but don't get your hope I don't
think there's going to be new gpus till
the end of
2025 I think we're still over a year and
a half away from new
gpus
and then like they're sort of out of
tricks for various
reasons so the ram bandwidth hasn't
improved from like the 3090 to the
4090 but what they did to hide this was
they just put a big L2 cach on the
490 you think Blackwell coming out Q4
2024 no
way some show me a link to
that I've heard Q4 2025 for
Blackwell roughly how many tiny boxes
can ship this year a
th if we have
to we're building the factory planning
on six a
day
really that be pretty wild
what the hell are they basing this off
of I don't believe
it
send me the link to Mo's law is dead not
Tech PowerUp who's like this is an easy
to predict timeline is every other one's
been around for two
years send me the actual link to the
mors law is
dead just send me the link is that a
YouTuber
I mean Mo's law is not dead Mo's law is
just broken right now largely because
our economy is
broken description and if you some of
them were pleasantly surprising as I am
preparing the next episodes of broken
silc will be coming
out so 2023 has been an interesting year
has it it actually I would say that 2023
was a year with a lot of unusual and
unexpected outcomes too a lot of the
products we've been covering this entire
year like for example and the first
company that I actually want to talk
about is NVIDIA because well I've seen a
lot of Buzz going around over the past
few months about how strong Blackwell
will likely be like the types of memory
have I think I've seen the same leakers
guess three different memory bus widths
or something and because of this I
thought it would be good to double check
with a coup of video sources and one of
them did give me the okay to quote them
and you're seeing that quote on screen
here remember I'm not going into a bunch
of specific about the exact segmentation
of the rx59 but those
decision I heard rdna 4 is
canell
haven't actually been set in stone yet
and so what you're seeing here I do
believe is what you need to know if
you're planning ahead for the Next
Generation Now Blackwell is being
prepared to be ready to launch in
quarter four of next year want it to
they'll have no trouble they're not
worried about TMC 3 it will be ready to
launch them but whether or not it does
depends on how well love lace is selling
before they make the final decision and
how competitive they think rna4 will be
how well they think it will sell if they
don't have a new generation during that
holiday season but no matter what they
are planning to make a big deal about
RTX 5000 efficiency at cs225 they want
this thing to be ready to go into air
laptops to be sliding into the second
wave of stri laptops and so whether or
not it launches in November or something
in 2024 this thing is going to launch by
like between January and March of the
next year that means it really is simply
up to them and effectively that does
mean that blackw is launching about a
year from now people whether it's in
November or in February or something all
right and as for performance blackw
rization uplift over LEL will not be as
impressive as Amper to love La however
the RTX 490 was cut down by more than
10% so I I don't believe it
um fundamentally what process do people
think Blackwell is going to be
on get more coffee too got coding
too the C was disgust
[Music]
it
is gdr 7 going to be ready in
time so I heard that they're not going
to have GD are
seven why do people think this I've
heard that what they were going to do is
increase the bus width to
um okay this is
interesting gdr 7 would be
awesome
I
mean why do you think AMD is dropping
something
new
I mean all right you want to see if
they're dropping something new why don't
we look in the
driver this is how you can tell if K is
coming out with new
things uh what's probably the best place
to
look nothing's a big deal for Tiny Box
like you guys who have never shipped
Hardware in your life you don't don't
understand
like you don't I I'll make this even
more generic for you people who've never
shipped anything in your life you have
no idea how hard it is to actually ship
something oh I'm in the way oh
sorry I forgot to do that
um you have no idea how hard it is and
you think you think I'm worried about
this no shipping software is easy like
ship a physical thing you know you
understand you have to figure out what
box it fits into
and oh the difficulty okay you ready
Let's uh let's see how fast we can code
this let's get some semaphor in this
bitch
possible that they could make a 5090
feel like a love La over Amper uplift if
they really felt their pushing super
hard and I do want to drill in on that
last point there because some people
might argue it sounds like hedging but
it's not it's just pointing out the
reality that the RTX 490 if any video
wanted to they can launch a 490 TI that
has 12.5% more CTIC course that's
clocked at least 5% faster and that uses
faster memory and video didn't even use
the fastest memory on the market and
they're still not with the RTX 490 and
so well Peak love LA Performance could
nearly double amp video pulled out all
the stops like they did with the 39 TI
they haven't yet and if they were to
pull out all the stops with Blackwell
probably 490 to 590 feel a lot like 3090
TI to 490 it just depends on if Nvidia
wants to but if you noticed how many
times in like the past 5 minutes I've
said if Nvidia wants to that tells you
they are in a dominant position in the
market if so many of their decisions are
just at their whim and therefore my
advice to Nvidia next year is to Simply
execute with a standard two-year Cadence
and check their arrogance a little bit
that's it seriously that's it Nvidia
just needs to do business as usual
improve their segmentation versus the
mess that we saw with some Loveless
launches or un launches meaning no
hilarious pricing gaps between the 80
and the 90 class make be a logical
pricing difference and nothing like the
48 12 GB or 46 16 gab then if they just
do that they're in such a strong
position that I think simply creating a
consistent and reliable generation is
what people are looking for out of the
company that is in this type of a
dominant position I mean if video just
bumped down the pricing a little bit
here and there I'm not even asking them
to be generous I really think they have
nothing to worry about it's extra greed
or underestimating am that I think is
the only thing that could cause them
trouble and consistency just saying hey
we're coming out in quarter 4 2024 and
guess what we got we got another
generation that's like 60% better
overall we're going to launch it at
similar price points too before but some
of them are a little cheaper than the
original launch prices because we got a
little ahead of ourselves there with our
greed that's it two years it's better
goodbye that would look really
impressive in a world where Intel's
never launched this alchemus plus
product that everyone told themselves is
definitely coming out because some bogus
road map was shared and I think people
should by the way remind themselves of
that when they look at other battle mage
road maps didn't pay for alchemus plus
why would you believe it why would you
believe these road maps at half the time
don't end up true with Intel and with
AMD canceling top rdna again we got AMD
being a little chaotic Intel being crazy
chaotic I don't actually think Nvidia
needs to be that generous they just need
to not be insane with GRE next gen Cal
down a little bit and be consistent and
people will reward them by buying their
products all right I've just gone
through the Nvidia portion of this video
I now want to touch on what I think AMD
has to do to have an especially
successful year and also what Intel
needs to do including updating all of
you on what you should expect out of a
lake which some people online are
already dismissing I'm going to get to
that in a second but first an ad from a
sponsor I'm sorry you have to wear hat
this piece of content is brought to you
by World of Tanks you can support this
channel by clicking on the link in the
description and checking out this freet
tolay arm Warfare multiplayer game that
by now hased a mive player Bas millions
of players due to it inredible g there
are over 600 armed V to choose from from
11 different nations
okay so we're going to have to insert
compiled we're going to have to
basically insert those things into the
uh into
the command stream
here
um so let's go back to our slow ass
llama with some slow ass
llamas we need to inject basically
special
programs okay should we
sync um we want syn buffers no okay
so let's just hack this now with hip
stuff no actually I can just do hip
device don't need a vent create okay if
it
synchronizes
um we just do this
one we have set and we have have
block dealing with some slow ass
llamas oh actually let's fix this over
here so we don't get
surprised October
surprise
do I even need this thread fence
system no do I need these sync
threads no do I need these stupid
parentheses no sir I do not do I need
this stupid quote line bullshit thing no
I do not no I do not not sir that is a
no that is a no I do not okay let's see
does that
work there we go great now let's turn
this into a one
liner you can't make tiny gr have too
few lines people will get upset that
there's not enough
lines it's like fat shaming you got to
have more
[Music]
lines
wow look at that remember how many lines
we had and now we like got rid of lines
and now it doesn't have many lines oh
that's sick man I hate
lines okay I wrote really nice stuff
before that were like syn event and
might be okay they're just not going to
I'm going to graph nicely oh I know what
I'll do I'll extend compiled as
Runner that seems
right got like nice stuff here here we
go so let's just copy that
shit yo I just want to listen to
copyrighted music
just to copyrighted music we just like
like what if we just like like just a
tip you know what I'm saying like just
just just a little copyrighted music
it's watch a little
bit
that goes down here don't put it up
there
[Music]
Bros
how do I construct that okay well first
we're going to have to do oh God we have
a device
here another construct for this why is
it so complicated
non
sync Prague is a
string oh I
don't that's block that's the wrong one
you can't do that that's the wrong one
okay okay okay
um lib Good device got to pass in
the device sub device I it's that's
that's something that needs to be
refactored 111
111 all right um and we don't actually
do that we say super
doet uh think that works except we do
need to override exac as
well um or at least to override
call because we have to pass in the even
though we don't call it with
an it might just be easier to do okay we
have to
say self
dot Sam
equals device sub device. host Al
FL ah and then here we just take this
here and do that about
s care about
that hope we care about
that um I did like a nice job with this
I so some oh I do need to put I do need
to do call it's so hard so hard fine
fine fine you have to put that there
fine
fine fine you happy
go do that oh y not crazy not crazy I
swear to God I'm Not
Crazy Jet equals jet device equals Dame
oh that's do the Dame
H here we go
super. oh we got pass in a list on list
passing that list fuck you there we go
um get violent let's get
violent VAR
vals wa
jet oh no but that doesn't no no no
that's going to also print the stats no
don't do that don't do that
ah never mind we don't even need
this we got to make Block events
still blocker BL
blocker uh what to block
at the Block is Hot jeny From the Block
so much
block we don't need D name that's dumb
we don't need to allocate a semi there
that's dumb and we don't need a ventom
anymore and that's just
sad uh actually let's keep a ventom and
let's call this
sync it doesn't
work
whatever whatever it's a later problem
okay I think those
work I have some tests for this
crap
what can't I fit into a technical
screening interview hip device has no
attribute host Alec oh yeah you can use
a fucking allocator
god remember that time my CPU didn't
have
Boost sync event has no attributes C
prog that doesn't seem
right oh we got to
build this makes me think about how
broken
see void P has no attribute
bu
oh yeah you might want to replace call
as
well there are some really nice stuff
here here we
go
we're going to need to do self. CL frog
and what goes in
here
actually this might just be
that uh no we got to do Global size
equals 1 one1 local
size
wait I missed the hype train what I miss
shit
boy can I do this all
for this
this that's not a okay
fine lock call Se SE event name d name d
name
here sync event has no object
EVT uh yeah because it's called
Sam and this is called SE
sem
cool great it's just slow as
balls
um oh I can just say do update stats
equals false I think that's
right I can call
that oh no because I have to get a list
of buffers I don't want that
either okay whatever uh why is that why
is that slow as
balls very
slow why are all those transfers taking
years no it's not even just that one
oh I know what's
wrong
um that's not
cached this actually calling the stupid
compiler uh what do I do about
that
here's the cash to program that's not
right I don't want
that um we can like precompile that
maybe I want cash on that that's just
annoying
should exract that shit
better well least it doesn't take 27
years anymore great
does anyone understand the events in the
blocks is everyone happy with them uh if
those work we should also be able to
delete them from
transfer where is
transfer transfer in
device and we just don't need this
anymore cool still correct okay how fast
is llama
now yeah
okay this is only a problem
if
whatever C up
later C void P object has no attribute
size
okay
um we probably want that to be a
buffer think about how to do
that yeah okay it's complaining there
which is like fine I guess
this is a deeper problem all these
things are deeper problems like you just
realize that you got your abstractions
wrong and you're
angry it's also
wrong
um but wait no no that's just that's not
a hard problem
uh
we have
to oh yeah this doesn't
work so we have to reset
it when we do the sync
event um 2 MV selfs sub Z equals
z pretty sure that's
right
still
broken and that still doesn't work
okay so yeah uh Dr CU you can't pass
this shit here which I don't have to do
anymore but that doesn't make it more
right actually it's fine as long as I
have J equals
2 uh that's okay that's a known
bug
okay well so it doesn't work and it's
slow the best of both
Works those are just kernels
though I mean I guess we are still doing
all the nq's for
see what
slow in code ARS Cuda
style hello
Society it sucks that I can't make this
a normal buffer but we establish that
that doesn't work
right
okay the main reason this isn't working
is
because we always fire that no that
should fix
that yeah that puts that on the CL prog
but we reset it there to
zero
oh you know
what
Chinese
character does it work if I sh it on one
device that works except now it's m slow
why is it sinking on one
device I know that's too many
questions okay that doesn't work but if
I if I put the what if I put the stuff
back in
transfer
oh wait I'm doing Source allocator
transfer I don't want
that uh I set this up to work with Des
allocator
transfer
no no source is probably
right okay so source and then on Des
if it's a buffer copy I
block on that
event which is
right I do this after the buffer is done
storing wait that's not
right oh okay so I'm doing the block
before I enq the buffer so that would
have to be on the desk device
like you can do the copy from either
device hello
nobody nobody is talking multi call
multi call multi
call
um so if I put like a source synchronize
here this
works
yeah okay I put to synchronize there it
works um so that's in queuing the copy
on the D
buffer uh but I'm also doing the block
event this seems right right like
there's event like there's event 31 with
the sync event I set the Su for
is
zero I
mean
wish I had a better test than
llama
how's that different
though
um so here's an idea I remove
that nothing works
anymore okay let's see if any of the
multi-tensor tests
fail they might just be passing actually
that might just be passing because I
said debug equals
two still
passes
oh GL we have some
ease good
that find a more minimal
test all right so the really cool thing
about doing this with kernels if we also
do the copy with kernels is we can shove
it all on the graph and then it really
is just
kernels kernels kernels
kernels
oh interpreted object has no attribute
runtime
what oh yeah this should only
be
but all the jit stuff doesn't
work this is
interesting oh but I see why they're
failing
okay the jits aren't failing for any
interesting reason they're
just
um yeah okay let's fix
this we do need to pass that in oh
[Music]
doesn't make sense we create the sink
event there whatever
um then we actually need to create a
buffer here so let's buffer
[Music]
uh
there needs to be a
buffer which I'm not happy about it's
not a buffer it's a host
alic
oh God that one
[Music]
fails but it passes if we do that why is
that all event four oh that shouldn't be
event
four um instead
of
[Music]
okay great it's not really one but
whatever uh yeah block at three event
three okay good uh this doesn't work why
doesn't this
work not putting anything in a
jet which shouldn't also really
shouldn't break anything either but
this just doesn't
work
interesting so this is this is reliably
failing which is
good um but it doesn't fail if I put the
synchronize back
in
block it three HP one block out 11 hip
one
clear oh lot of Lu thank
you wow that's a lot of
people yeah you had a great stream today
a lot of people came on I stuck around
for like five minutes um um so hello uh
welcome new people uh my name is George
Hots uh I am working on a deep learning
library called tiny grad um so you can
get tiny grad on GitHub on your friendly
neighborhood
GitHub and this is Tiny grad uh it has
22,000 Stars so it can't be too bad
think about it like pytorch it's very
similar to pytorch maybe the best
example to start with is this example
called Beautiful mest um so beautiful
mest this is an mest example and unlike
a lot of mest examples it gets you
98% um so we can go over here to my Mac
and we can actually run
it um let's just update to the latest
master and then let's give it a try
examples beautiful
MST uh so it's actually pretty fast uh
it's training an nness model
now and it got
97.6% you're like oh this is a boring oh
we'll let the non Subs talk we'll let
the non Subs talk that's a good point uh
we'll let the non sub talk so this is
Tiny grad tiny grad is my deep learning
library um it's actually a company uh we
are the tiny Corp tinyg
um so you're like oh well why would you
use this instead of pytorch right and
pytorch is actually good software unlike
self-driving cars where everyone else is
an idiot uh pytorch is actually pretty
good software Jax is pretty good
software what are the differences
between tiny grad and the other uh
Frameworks the whole difference is this
these are the only operations that tiny
grad compiles to so we have unary Ops
binary Ops and ternary Ops those are all
examples of element wise Ops we we have
reduce Ops which can reduce an access
like a sum Max uh we have buffer Ops
which deal with actual physical buffers
on the device we have movement Ops which
deal with different ways to look at
buffers and then we have load Ops and
load Ops are just like contiguous copy
very boring things so the only thing
that really exists is element wise Ops
reduce Ops and movement Ops and you're
like but George how do you get a
convolution how do you get a matrix
multiplication ah I'll show you how you
get a matrix multiplication so this is
Tiny grad's map mall right here and we
can run
it and it's not that fast right there
you're only getting 2.4 but it's a small
Matrix if you make it a big Matrix it
will be a lot faster but that's still
2.04 Tera flops which are pretty
good so how does this work well look at
this
code one way to think about a matrix
multiply is to think about your two
matrices that you're multiplying putting
the squares on faces of a cube doing the
N cubed multiply and then doing an N
cubed sum and the last pH of the cube is
your multiplied Matrix in tiny grad you
can actually write it like that so we
reshape and multiply together and then
it's broadcasted to be the cube and then
we sum across this axis of the cube and
we are left with a matrix
multiplyer um you can also do
convolutions like this so if we go in
tor. pi which is the front end for tiny
grad we can go check out the conf code
um so there is winegrad in the conf code
here this is winegrad but if you don't
want to use winegrad this is the
convolution it's very simple um it's
really just a bunch of movement Ops uh I
think it's pretty good to look at this
one called pool uh it's kind of
confusing to read but when you
understand what it's doing you realize
that you can express convolutions Matrix
multiplies all in terms of these
absolute minimum set of
operations uh element wise Ops reduce
Ops and movement Ops so that is kind of
the power of tiny grad um whereas
pytorch will have a com 2D transpose on
Cuda in U and
8 and have a specific set of code to
implement that the problem with that is
you have your operations multiplied by
your run times multiplied by your D
types uh because of those multiplies the
amount of code you have to maintain is
huge um in tiny grad we factorize those
Concepts pretty well so the amount of
code you have to maintain you replace
those multiplies with plus we have code
that implements D types and our code
that implements D types is completely
independent of our code that implements
convolutions if you add another dtype
here this dtype will work for all
convolutions all Matrix multiplies all
Max pools all everything then you say
how do we actually make it fast well we
believe in the bitter lesson so we have
a search machine here which does a beam
search to search over a bunch of
permutations you can do on a kernel and
the permutations are defined right here
um all these different operations you
can do to like mess with the kernels to
keep the compute the same but to make it
actually fast so where are we right now
in practice uh tiny grad is faster than
P torch stable diffusion on Mac um for a
bunch of things where the fastest on uh
AMD we're less competitive on Nvidia but
only because the world has put tons and
tons and tons of effort into Nvidia uh
we're working on getting there and
that's kind of where we are right now um
something else that's really cool about
tiny grab you can pass in this argument
debug equals 2 and it will show you the
real kernels that it's launching to the
GPU um so you can see these kernels are
batched because we're using the uh graph
API on metal but these are the actual
kernels um we have a cool argument here
called jit graph equals 1 and that will
graph whatever we put in tiny grad's jit
and then I can go over here to net.
SVG and we can actually see what this
looks
like so this is the mest uh kernel sorry
well this is the mest net um expressed
in its
simplest things so like you can see this
sum is actually a convolution after some
Matrix
Ops and does these then it does the
backwards pass and then you'll see that
this these are backwards passes and then
this big shit here is the atom
Optimizer um can you add convolution as
a custom op so you don't need that why
why do you think the convolutions in
here are very fast um the convolution is
automatically generated from movement
Ops and reduce
Ops uh so that is what tiny gr is
and my belief is that eventually we will
pass all the other deep learning
libraries because of this as they start
to collapse under the weight of their
own complexity because they have
multiplies in there we have ads and
that's a different algorithmic order of
complexity uh we end up winning uh deep
learning okay so what we are working on
today is
synchronization so what is the tiny
corpse business model um we are the tiny
Corp and we write and maintain tiny grad
but tiny grad is free open source
software it's MIT license so how do we
make money well we sell tiny boxes um so
you can pre-order them today uh for
$115,000 you get a computer uh I've
posted some pictures of it on Twitter
which you can find if you follow us on
Twitter and yeah this is the Tiny Box
it's 2x cheaper per like flop per Ram
bandwidth and anything else you're going
to find and it should be an incredibly
usable platform for training uh deep
learning models so our short-term goal
for the tiny Corp is to get AMD on mlpf
uh I announced this
uh about not quite a year ago yet and
people are like George gave up on it
well you know shit just takes a long
time but trust me we have not given up
um we are working to get AMD on MLP and
today what I'm working on is
synchronization between the gpus so AMD
has this Library called hip uh which is
knockoff Cuda it's literally knockoff
Cuda uh only available in the US
[Music]
yeah what we're going to do for
international is you're going to be
responsible for forwarding it uh the
last thing I want is a tiny box to get
caught in customs uh so feel free to
order it pre-order it if you're outside
the US and we we'll try to find a
forwarder we like but again you're going
to be responsible for getting it from
the US to your country because I'm not
hearing that Germany took a tiny box
hostage uh for some who knows what
reason uh so you know this is this is uh
if you live in Dell
land um but yeah I'm sure you can use a
forwarding service and get a ship
there so yeah uh you're going to need a
lot of power for your Tiny
Box I'm missing football isn't football
on on Sundays what college football
um yeah exactly exactly they don't want
they don't want they don't want their
citizens to have this much power but um
we make efforts to support hip uh yeah I
mean we are it's it's so this box has
six uh here I'll show you the box so I'm
St a few boxes you can see this is the
box here I have uh
67900 uh XTX is and I'll show you this
is one of the things that I'm most proud
of about the Tiny Box this is not easy
to do uh so this is all the
gpus communicating with each other and
this is like the Matrix of bidirectional
PE uh copy bandwidth so we have full 16
Lane pcie4 connectivity between all the
gpus um you see we have full inro device
access this is something that AMD can do
that Nvidia can't do um you're welcome
to connect the 2ps used to the same
socket same cable same breaker it's all
fine um we can just limit the power uh
in software we have a script for that
but yeah it's it's a fully operational
compute station we want to start driving
down uh ml perf numbers yeah um so for
distributed training across tiny boxes
every Tiny Box has
a
uh has a Again full width 16x
pcie4 uh ocp 3.0 slot so for those of
you who don't know what an ocp 3.0 slot
is it it looks like this
um so you'll see that I have a connect
X6 card in here and this is actually
connected to another Tiny Box I forget
the incantations to run the demo we can
get a full 200 gigabit between tiny n
and Tiny
uh tiny Eight's another Tiny Box it also
has a melanox card in
it
um yeah
uh
so this is this is the actual if you
guys actually want to see what tiny 8
and Tiny s look like uh these are a
comma AI uh it's actual fit band uh
what's the IV status you
go so yeah they're connected over infin
band so we we will get to multimachine
stuff but mostly we're interested in
Multi-Device stuff for now uh we figure
most people are just going to buy one
tiny box and we'll get to
uh all the cross stuff
later uh cool so since you guys are new
here and we have a lot of viewers right
now uh I'm happy to answer any questions
you might have even we can get a little
bit generic with the questions I'm in a
good
mood um I just date a calzone it was a
disgusting czone and I regret purchasing
said
czone uh but yeah distributed training
across uh systems oh you guys don't know
about btop yo we got btop no this
doesn't have btop
St be uh what's the picture on the left
oh no these are our tiny boxes this is a
shower curtain so that the heat doesn't
leak um did we get some direct support
from AMD I have contacts at
AMD they
are not as useful as you might think uh
mostly you're on your own for making
these things work uh I don't know like
they're trying I I think that if I like
through another tantrum they do stuff
again but you know everything's about
triage and these kind of
companies
um do I have any thoughts on distributed
training across the internet I'm quite
bearish on that because you are several
orders of magnitude off from the banth
required uh and you have high latencies
so basically the only algorithm we've
got to successfully train uh large at
least large neural networks in the
traditional sense the RL stuff kind of
works but the large traditional neural
networks are all using some form of
synchronous gradient descent whereas
your entire data center is synchronized
all the weights are copied between your
machines uh people have tried other
algorithms they kind of don't work and
there's no way you're ever going to make
this work across the internet so these
nodes have the same bandwidth between
them as any gpus have between them and
then you can do ring reduce which gives
you uh if you have 28
if take your full duplex bandwidth and
divide it by two and that's about how
much all reduced bandwidth you can get
um what is the best chip the best chip
is the Nvidia h100 let me show you the
problem with the Nvidia
h100 the problem with the Nvidia h100 is
the price of the Nvidia h100 so we use
this where use this card exactly so you
can have have one of
these
or 36 of
these um and when you put 36 of these
next to one of these uh this doesn't
look like a very good deal anymore uh
for example it has 80 gigs of RAM well
each one of these has 24 so what's 24 *
864 um so yeah these are a uh a really
good deal uh what software llms will be
shipped with tiny box if you're looking
for a very consumer experience you're
probably not going to have a good time
uh we have a list of demos that we want
to make work so this is our Bounty
spreadsheet um if you solve any of these
bounties by the way uh tiny grad the
tiny Corp will pay you uh so we have the
Tiny Box launch apps so at launch we're
going to do 10 tokens per second llama 2
unquantized mixol at 5 plus tokens per
second uh hlb C far to 94% less than 10
seconds and we're going to have reset
training in under four hours um after
launch I want to get the rest of the ml
perf models tiny llama training and the
Pokemon RL replication uh but yeah so
this is this is pretty much what's going
to be supported at
launch um again there's just no way
really for you to run llama 270b and
fp16 without renting a machine that
costs1
$1,000 uh
so yeah yeah h100 is are very expensive
and that's the main problem with them
let's see what their ratings are
bad where's graphics
card
um so
yeah uh I don't intend to keep any
software Secret Sauce to myself no uh
why would I if you think you can compete
with us on Hardware by all means try you
have no idea how hard it is to ship
Hardware um it's it's all open source I
don't plan
on yeah how fast I wrote mixol right the
the dev speed with tiny grad is
unbelievable it is faster than anything
it has less bugs probably than anything
because like the oh the main I guess I
didn't really other talk about the other
selling point of tiny grad um tiny grad
is well that's too many
actually tiny grad Master is under 5,000
lines of code so all of this
functionality fits in 4,997 lines uh we
we keep the lines of code limited
because the biggest determinant of how
many bugs your software has is one bug
per 100 lines so tiny grad only has 50
bugs in it um pie torch is maybe a
million lines so one bugs per 100 line
that means there's 10,000 bugs in
pytorch uh yes that is insane um yeah I
my theory about software is it is 12u it
is 12u um it's 12 U and I'll tell you
why it's big um so we can make it
smaller the problem is you can't make it
smaller and quiet so these are
n 140 mm noct TOA
fans if you go smaller with it you're
going to start to need pressurized air
uh you can use Delta fans Delta fans are
high power and high noise but but they
will do a lot more cooling than these
noctus well but we can use nine of them
because we have lots of surface area so
if you have lots of if you have lots of
fan area you can spin fans slow and you
can keep the air at pretty much ambient
pressure and then the Tiny Box is so
quiet that it is not the loudest
computer in your office even if all
those gpus are running full
power um this is up from the Thousand I
originally targeted what thousand
thousand
what
uh oh the Thousand lines yeah and it's
probably going to go up again I mean
again the lines are not meant to be a
code golf exercise the lines are meant
to be a complexity reduction exercise oh
did I figure out risers I did figure out
risers and it required custom
cables I literally had to get custom
cables manufactured in order to get uh
signal Integrity with PCI 4.0 and I had
to get two revs of a board I got a great
guy uh that I've been working with to do
the uh to do the stuff um can you run
the Demos in your PC well yeah I mean it
works pretty well on Mac so you can't
run llama 70b but you can run llama 7B
um we also have like examples
coder so this is a this is the technium
tune um so like write hello world in
Python but
misspell
hello
[Laughter]
see there we
go spell it with more
O's pretty good right it runs the
code um I
want 100
o M see
almost is that the
output you expected and this is all
running in tiny grad in those same
uh they don't give the expected output
all right all right let's
see
[Laughter]
o um that's not tiny gr's fault of
course but it's fast right and this is
on so it's on an
M3 um again all that same tiny gra Nic
still applies so I can say debug equals
2 we can see how it's actually copying
the things from the disc and there you
go those are the things that it runs
it's putting everything in the jet now
you can see that now it's all in the
jet uh no we're not switching from token
count to line count we believe in line
count we believe in line count no bike
shedding um did I get any interesting
customers I why do I care like I'm not
what I'm not I'm not like some like like
oh some famous person bought it and a
lot of famous people bought this but
like that's not the point
boys
um like it's either good or it's not
good right stop relying on signaling you
know uh so you can see what it is yo if
Taylor Swift bought one I'm tell you I
don't think Taylor Swift bought any
unfortunately one day I hope Taylor
Swift will buy something from me does
Taylor Swift have
starlink
um do you think the no it's not faster
than a 490 but it's cheaper than a 490
and it's not half as fast as a 490 so if
you go to 4090 price tracker um I don't
even know where you're going to get one
for yeah 490s are not even oh okay wow
okay I can get a used 490 for $2,000
like that's the problem with
490s um did I make Quenton uh no no no
no no we we named him qu to make fun of
open
AI um I did that on stream did I end up
liking decision Transformers no all RL
is a scam and I never want to hear about
RL
again so yeah we are making
synchronization
work uh we were making a lot of progress
maybe I don't know this one works and
then I turn off debug equals 2 and then
it fails and I don't know why the
synchronization doesn't
work
um
no RL is total scam boys don't let
anyone tell you
otherwise see it works if I enable
that how can you make it out of the hood
the bus runs every day Morgan
Freeman
this Morgan Freeman
quote no you should take the boss and
leave the hood have you considered
[Music]
Calabasas uh all
right
so how
come this doesn't
work
oh it might be this one causing the
problem if we
aren't finishing
that
so
let's throw a synchronize in
[Music]
here
where were we we got
lost oh if you're here to complain about
the font I have bad news for you people
have been complaining about the font for
a long time and I don't really do
anything about it I understand that I'd
probably get more viewers but that gets
into the fact that I don't stream for
you I stream for
me and that's like weird like why are
you going to do something if you know
you're just doing it for you man why
would you do something where you have an
audience and don't love the audience
well the truth is everyone else does the
same thing and they're just lying you
but we're honest on this
stream okay cuz what the hell why
doesn't this work man piece
shit
[Music]
uh thank
you okay so even with those two
synchronizes it still doesn't
work what if I set that to
zero you know it just blocks forever
that's
good that works just
like um let's throw some CL progs here
let's do that I don't think it matters
but
there's something
wrong how does that do something
different
why are those all the
same these things should also only be
used once so I don't even understand
what the problem
is
[Music]
um what part of tiny written in C none
of it none of it's written in C it's all
in Python you think I write shit in C
you see me sitting around waiting for a
c compiler to compile shit well you
think I got all day I got places to go
okay and that's why it's all in pure
python uh we do have it also doesn't
have dependencies people are like George
but what libraries do you use you can't
possibly like count it as 5,000 lines
cuz cuz it's got libraries and like it
doesn't have libraries the only
libraries it uses are numpy tqdm and C
types and tqdm is just there as a meme
numpy is numpy and GPU C types is a
library I wrote that's entirely
autogenerated that hooks to the
GPU so yes that's right btfo haters it's
all
python
um but why doesn't this work this is a
bigger problem I don't understand why
doesn't this
work host alic
clear
oh codai does depend on sentence piece
I'm very upset about that if someone
wants to fix that I'd be supportive of
that no Bounty for that I'm going to
support your shitty
code okay so we
allocated Atomic
exchange system s value self dos what is
wrong with
this
let's just try
this rid a value from there and just put
one there that's not going to fix
anything that was stupid I knew it
wasn't going to fix
anything it's in host memory
we're in system there's only one
thread the only thing I can think is
like I got the device
wrong okay we put the sync event on the
out device which right the sync event on
the out device of
copy
um so I wrote a test program where I was
testing this semaphor style and it
worked
fine should go back to
it
so we don't include the tests and we
don't include the example
code uh there may be some c in there but
it's not actually used for tiny grad you
don't actually need
it so this semaphor style works fine
here um let's get rid of this because I
don't do that in the other
thing okay so that breaks it let's
change it to 2mv
[Music]
sam4
host function called clear host of 0al
Z see if just clear works
here yeah that works
fine I shouldn't need that
synchronize
that
fetch it works
fine so this is this is this was my like
test code for the semaphor and you can
see that these codes are the same as the
uh the ones I use here in device not
it's in
realize so there's block and there's
sync block I call set there we can just
call it sync it doesn't matter
you can see that it's sleeping and then
doing the
copy that clear is correct that always
goes in before that program
runs
uh yeah there's the sync
event what is a
Zin shows that I'm out of that I'm out
of
touch
oh it's all like
Snus should we get the Vape out no don't
get flagged
again the real highlight of today's
stream was reading my LinkedIn
apology
Sno
uh I mean I don't know that like looks
right and I do those
copies I reset them these these it's not
like these events are even reused are
they
no event three for some reason I trigger
a synchronize
there which is
fine
um how come this
fails
I'm calling the program the exact same
way that I do
here Global size local size I can get
rid of that where that stuff
matters
clear I en the thing that sets the
semaphor I call this with the same
semaphor no it's not caused by any of
that oh
oh I mean I don't enable perer
access I don't think that
matters like for this I can just
do
uh which one does that run
on where's Prague d0 so I can do like d0
allocator do
transfer b0 B1
size should basically be the same
thing it's the same thing just
slower is what I'm doing I don't have
the wrappers in trans I mean that's not
the level transfer anyway so it doesn't
matter
um
yeah I can show that we like don't kick
off that transfer until after that sleep
is done because that's going to be 100
milliseconds longer okay that's
fine and if I don't ever set the semore
it never
goes so what is the problem with
this sync offers SI
inputs block
event we have those synchronizes but
those don't even
matter block 11 event
11 you should all have
access to this host memory that I
allocated
well you need semaphor to deal with the
fact that there's six gpus in the
computer remember the guy who had three
PS3s but we have six
gpus
okay we set the
value we do this Atomic cast
system I don't know maybe we'll add that
like thread synchronized shit yet that I
commented out why did I delete it why do
I delete
things um
thread sync Global or
something
hip
thread thread group blah blah blah blah
blah blah
blah
no we're not reading the LinkedIn
apology again and you know what we're
not even going to no we'll we'll let
we'll let nonsubscribers keep talking
thank you for for for coming around and
joining my
stream um we love having you here some
of
you
uh
SE prog what like what's going on
here device
device that shouldn't
matter actually if I get rid of that I
wonder if it
works interesting still doesn't
work it just takes longer to not
work I understand where's the copy back
to the
CPU where's the CPU C
copy there has to be a CPU
copy
got device default number oh there's
just a copy out okay never mind no no
it's not a problem there's just a copy
out it's
boring uh I didn't actually do a copy I
don't actually do a copy the CPU anymore
I probably should but I
don't
um how are we going to debug
this I know what we can
do let's try this print self. se. MV sub
Z when we when we inq the Block events
okay they've already all happened by the
time we in the Block events see how
they're all
ones um
actually let's look up Atomic cast
system what if I said that
two
that'll store a two in there and then it
won't trigger
twice doesn't change
anything they're all
ones oh this has got to be some cash
coherency
garbage that's all I can think it
is
we might be able to fix this by using a
function for copy so let's try using a
function for copy I didn't mess off I do
I am using the destination device right
because we have to use the desk
device yeah D allocated a transfer
okay um let's try
a let me do a
here let's go over to realize where we
create this
thing um buffer X
for let's make device
here and we can have another
function um actually we need both
devices so this is desk device and this
is Source
device let's go over to hit peerto peer
because we're not actually we didn't
actually
check yeah there might just be cash
coherency
issues um we get a lot more control if
we put our own
uh okay now we have a function called
copy um let's just make this actually
stupid great lib
equals
uh this
Runner
uh you know
what actually don't want to do this what
I want to do is
this copy
kernel compile run so I'm I'm writing
like a GPU program to do the copy and
then I can just change out buffer X for
here to be a copy
con
um
so just here we'll call this
copy uh we can even put the size in
here we can say
uh I get the
size SI i.
out do
size time
si. size
great um
size uh size over no actually see that's
annoying
whatever um is this D device the actual
device no put D device in here okay
fine
uh the buffers are fine that it gets
called with that seems
good what's that angry about oh we there
but we don't to use that anymore okay so
now we're in queing the copy kernel copy
kernel has no attributes C I'll Prague
and that's cuz I didn't do a build we
have to do a
build I don't like having the font where
you guys can read it because then it's
harder for
me let's try desk device
here we'll
see okay so we have a memory access
fault but we know what this issue is we
have to enable peer-to-peer access
between the gpus so remember that fun
that Library talked about GPU types this
gives us access to the actual hip
stuff uh blah blah blah blah
blah okay so we have to
give it's device sub test device.
device and then we have device sub
Source device.
device that should give that should fix
the memory access
fault Pier access is already enabled oh
that's a different problem
um enable Pier
uh d0
D1 enable Pier d0 D1 you want to see a
cool python trick if I put Funk tools
lru cache in front of this it will never
actually get called with different with
the same parameters
more than
once so we set device to the D and we
enable access from the
source that seems
right uh d z is not defined well yeah
because I'm an
idiot
d0 desk
device uh Source
device
okay so it
works let's see if it
works without debug equals 2 it doesn't
okay so what debug equals 2 is it's
inserting lots of synchronization points
but actually we have a bigger problem
which is that this needs to be copy
kernel and not proper copy
there um which actually is interesting
because I don't even need to make that
two things I could just make that one
thing whatever uh okay let's see if that
works without
do damn it like why doesn't that
work okay there there has to just be
some like cash coherency
issue or somehow this event is like this
is
running maybe it knows it doesn't depend
on the
buffer
interesting okay I have a
theory what if I just literally do that
and I pass in Rob sub Zer there and then
to this thing I pass in the
[Music]
buffer
I have to pass in the actual buffer here
then let's try that there's a chance it
just doesn't work yeah because I didn't
pass the buffer
in
um cannot be converted to pointer what
did I do
there Rob off Subzero that should be
right oh d off
okay come on work without debug equals 2
now piece of shit why doesn't that
work we
block
where did that even go what one I just
happened it's impossible to
debug
what does that face
mean right so this runs llama using all
this stuff
now okay now have to shot it to so we
can run llama across two
gpus using all the same event and block
stuff now I wonder if I run it with
debug equals 2 if it gives me the right
output she's very
slow okay gets the right
output that's
crazy this is is on a tiny box see how
it says tiny
n but if I run it there it doesn't
work okay is there some
hip Global synchronized thing I'm
missing if I do Shard one it
works but if I do Shard
two see it gives the wrong output
hello
gr why doesn't this
work this one I'm only running
once there has to be some cache
coherency
issue it doesn't matter if I use buffer
copy or copy
kernel like we can also just like change
this to buffer xar and it's the same
which actually uses the transfer
function on the GP you can see the
xers
uh it's interesting how whatever that is
takes forever
though debug equals one doesn't really
do anything I doubt it
works no it
[Music]
doesn't debug equals 2 only works
because we are uh oh I need to say I got
to say this
here have blocks in there but debug
equals 2 just works because it like
forces the entire GPU to
synchronize yeah there's got to be some
cash
garbage
what
huh
just try
this make it the whole
warp can't
hurt I could do that if it
breaks no it doesn't what if I do that
does it
break oh it's not actually doing
anything never
mind
how exactly does that not break
it but if I were to change this to like
two does that break
it how does that not break it okay
that's even
weirder
that breaks it if I set it to zero oh
well okay that seems actually kind of
right yeah okay it won't actually set it
okay that's
fine
um I don't know what if we set a global
size and local size
there also set a global size and local
size here there the whole GPU don't let
anything slip
by doesn't
work oh I don't know about that yeah
just set the python path we can
import the uh amus data set into the
real thing if you want if someone makes
a nice PR for
that um again tiny gr's not 1.0 yet if
you want to use it you want to use it
for something oh
yeah
um all right so like where's like my
cash
at hip device enable Pier access M Copy
Pier can access
[Music]
Pier like I don't really know what
to I don't know what else to
do are there any coherent memory Flags
where
oh okay I do have an
idea interesting that that changes
things okay I want to set lru equals z
let me just disable freeing freeing is a
very overrated
thing no didn't fix it but it's
interesting that disabling lru gives
different looking
outputs no never mind it's not
this by the
way no that's annoying because I'm GNA
have to copy it back but we could see a
nice graph of what it's actually
doing
for
no more
free no
[Music]
free
[Music]
I don't know if I'll figure it
out like there's so many layers of
bullshit that it could literally be
anything uh okay AMD log level equals
okay it launches the
kernel you can see that this pointer is
the same the object has four
bytes the Shader name is sync the Shader
name is
block um
whoa okay that's cool it's calling AMD I
don't know why it didn't show me this
before but it calls AMD rockle copy
buffer now
which is
like exactly what you'd
expect it's putting that in the same cue
that block is
in which is
good who's posting that face
working I'm queueing on the desk
[Music]
device
this should work like it it blocks on
that
event
um we could start printing the addresses
of the buffers but it probably just
didn't do right back
appropriately
coherent memory non-coherent
memory hip host
coherent does it work if I set that
maybe that's the host
memory somehow has to be happening is
that
the block
event is somehow finishing
before what if I make this Global size
like crazy
big what if I had a
sleep I had
sleep
what does thread fence system
do
not fix the problem
apparently have these here as
well
let's put longer
sleeps what the hell is wrong with
this I even tried passing the buffer in
there so that that event has to run
after this
one it's definitely on the same
Q event
five it's definitely on that queue I
built it for that
device
can we do
block all
right let's take a look here so we set
device to two and we launched the event
kernel where we set a one into that
thing then we put the block
kernel we allocate some Ram who cares
about
that
load some whatever who cares about
that then we launch that kernel with the
argument of the first parameter there
the Shader name is
block then we go onto this
device and we launch the rockle copy
buffer from there to
there
why is size
small I don't exactly understand that
but I don't really
care unless that's the
problem no I didn't break that did I no
because then that wouldn't explain the
uh no I couldn't have broken that
because that wouldn't explain why it
works if I
do uh debug equals
2 right let me just add some dumb shit
we can do
a in the sync event we can add a self
sync equals
uh device subs. D name equa
dot what did I call
it
event then here we have device self.
Dame equals
block on self. do
sync okay that works
fine so if I do like the old
school style of well that's not really
whatever
if I do device Dame event
record and event
create it
works even without debug equals
2 but as soon as I take get rid of this
block and I just use that
block
[Music]
what literally just event record fixes
it okay that's some
bullshit yeah then this has to be some
weird cache coherency thing right
because how come I can use event record
and that fixes
it like event record shouldn't do
anything
but there has to be some synchronization
event happening if I do that event
record that's the whole slowness I
wanted to escape in the first
place let's see what's going
on
uh working fan control the auto policy
is like good it's not a problem okay so
that works I'll see if llama
works okay uh llama is like broken and
slow so like kind of what you expect
what if I put that block back
there I can get rid of those seal
progs does that
work all right that works great um we
don't need this that didn't actually
turn out to matter
we get rid of
[Music]
that don't actually this was insane we
don't need
that setting the semaphore was never the
problem how about blocking the
C
okay that seems like it works now for
some
reason that works but if I get rid of
this event record
which is literally not a thing that
shouldn't do
anything I don't even hips set device
there I don't know if that matters but
still whatever hip event record does
fixes
it and if I remove that event
record it's
broken is it
faster yeah you can always self. sync
but the whole point is to avoid that
because that's slow as shit
uh yeah it's like wrong now but if I do
an event. record it's correct okay there
must be
some all right let's use the copy kernel
instead of the buffer
transfer
is the
same no the copy kernel doesn't
work o Nar n n n
Nar okay
well the copy
kernel doesn't work in llama you got to
use the X for kernel for
that oh you found a rock am hip issue is
this a
real I'm not even trying to use event
[Music]
record try to use a nonblocking stream I
think I want
that whatever so my copy kernel didn't
work but buffer copy
[Music]
does and if I stick a
magical event record in
there I don't know how many people we
how many people in an elementary school
classroom
seven H you better be
baned
uh create the null stream
what
[Music]
Redeemer okay so whatever is happening
whatever event record is doing doing
there has to be some live cach thing the
cool thing is hip is open source so we
can actually take a
look um not this not this let's go over
here to rock our runtime cancel new
window open recent Rock Run
time okay let's look at event record
it's not actually what event record is
let's look in here hip event
record
nothing it's not in the rockout run
time it's in the hip CL run time I got
go get a spin drift do we have spin
drift in this house we probably don't
and that upsets
[Music]
me
as president meatloaf would say we have
to deal with water like from the
toilet because we don't have any spin
drift you just got access to Nvidia h100
you know what you know what
you're the problem everything could just
be easy if everyone had lots of money
and could give it to Jensen but we can't
just we can't just give money to Jensen
you want to set up to it you want to see
this sick ass computer I
got there's really only one thing that
shows you how sick this computer is and
I show it off all the time and it's this
test
GPU multi-gpu with hip what does hip
mean hip is amd's knockoff Cuda okay you
heard of Cuda well this is the knockoff
version it's kind of like it's kind of
like instead of cocacola you bought
Sam's Cola drink okay that's what it's
like um and they're like trying to make
Sam's Cola drink happen but we found
okay hip event.
C what are I doing in here
uh let's this stream weight record
command okay here hip event marker great
set aent scope
oh there's like some there got to be
some cash coherency
thing that it's doing and we have to
figure out how to mimic
it by the way I can get rid of these now
right now that we know about the great
hack of
uh event
record so I put a random event record
in and then I run this without debug
equals
2 and it
works but I take out the random event
record which may I remind you I don't
actually use this event and that event
record does nothing and now it fails um
what happens if I put the event record
here does that
matter it does
not
Rockham doesn't work on WSL I don't know
about
that
all right so what if we switch to the
copy Kel but we put volatile on the
shit I don't know what volatile really
does okay the copy kernel
Works let's comment this out watch the
copy kernel
fail and
then
um look man you know what the difference
between recurring expense and
non-recurring expense is like you might
some dude you might be new to this
stream but you have to understand we
don't do things on this stream in order
to accomplish things I know a lot of
people do things in order to accomplish
things and this is a really toxic
mentality and like I shouldn't even have
to explain this to you you should
educate yourself but I will even though
it pains me to do it if everyone just
did things to accomplish things the
world would suck ass we do things
because we
can right oh the one about the jet ski
yeah I never got that jet ski
okay okay never got it never got the jet
G let's see if we put volatile here
volatile nope nope nope even fun is
overrated because as soon as you're
doing things for fun you're like how
much fun can we quantify the fun I don't
know fuck effective altruists that's the
moralist story all
right all right don't buy jet ski okay
you want buy jet ski up you want to buy
jet
ski no you have any digestive
cookies all
right oh God Society man society I wait
okay hip how a hip me
advice oh hipm preit preit
Asic preit Asic is there is there
a society
bro H
suck how does how does putting the
the I need like some like
hip host register hip host
unregister how do I sync the
cash take a bus bro Morgan
Freeman what kind of flags can I have
this
sucks
yeah you see this's a
stream hip sync and resolve
stream that sounds awful I really don't
want to do
that no wonder these things
suck okay wait I have another
theory okay so we know that works when I
put an event record
[Music]
there what if I put a block here
just the block no event
record that doesn't
work so it's something about okay what
must be happening then yeah the L2 isn't
being written back on
the uh Source device so the sync event
is happening on the source device The
Source device must not have a synced L2
so we have to just figure out how to how
to flush the
L2 hip device flush L2
cach
um
oh what if we disable the L2
cash get fucked cash all right now if I
disable
this
oo okay okay we found out how to make it
work you just have to HSA disable the
cash fuck you cash that's right all
right let's see if it works for
llama how slow is it going to be when we
disable the cash balls
slow wait it's so
fast wait that's the fastest it's ever
been this cash
sucks with the
cash without the cash oo
thread fence makes system makes all
device memory
rights some okay so wait but didn't I
try a thread fence system
here
no
is that a bug well who knows what a bug
is because who knows what the intended
behavior is you can't call something a
bug if you don't know what it was
supposed to
do thread fence
system I mean I would think that that
would work but it doesn't work think all
H okay just like let's just try
something stupid what if I put a thread
fence system at the end of every hip
kernel I think I can do this it's going
to take a bit to recompile but let's
just try
it
just got to
recompile last time you know what man
some people believe in fake news
does nothing work anymore now that I
thread fence
system oh it just hangs
forever what does make sense
man
oh no okay thread fence system did not
fix
it maybe thread fence system is just
broken because I know it does work when
we HSA disable the cach
some
implementations oh oh some
implementations can provide this
Behavior by flushing the GPU L2 cache
hip and hip clang does not provide this
functionality as a
workaround users can set the variable to
disable the GPU L2 cache
I I I
just what a piece of shit man like like
I'm sending all the gpus back and we're
using Nvidia okay okay here we have this
function it compiles but it doesn't do
anything I know you wanted it to do
something but it doesn't and you can
pass in this shitty environment
variable
life a musical man you just don't have
good
writers no we gave up on Boost there's
no boost there's no boost and now you
have to disable the
[Music]
caph literally literally that's what it
works no okay
there has to be some function that we
can
call I have an idea boys I have an idea
this idea needs a whiteboard okay right
now we're having
the other device pull from the first
device but if instead we have the first
device push it might work all right so
let's just let's just invert the
priorities man let's just make it
push all right does everyone
understand
uh let's open a Whiteboard app
whiteboard online
okay is this a whiteboard oh good we
have a whiteboard okay so right here we
have
gpu0 and here we have GPU one and this
is the source GPU and this is the desk
GPU right now what we're doing is we
have the
source GPU setting a
flag and then we have the desk
GPU wait for the
flag okay then we have the desk GPU over
here do a
copy and the data comes from a kernel
that ran out up here
okay so copy takes the data from the
kernel okay so it takes this data and
copies it the problem is some of this
data is still in the L2 cache okay so
you don't get that data and then you get
a big
X let's try this instead so here we are
on gpu0 and here we are on
gpu1 first I'm going to do the kernel
cuz of course course the kernel happens
first but then I'm going to do the
copy and the copy goes here then I'm
going to set the
flag and then I'm going to do the
weight so now when it reads from the L2
over here the L2 is correct wck cuz I'm
on the same
device does everybody understand what we
have to
do oh I just want to listen to
copyrighted
music wait memory fence instructions
let's see what we
got thread F oh oh under the system
clang path to enable the workaround hip
should be built oh oh just just just
casually rebuild hip just rebuild hip
okay well we're not doing that
so let's fix this
now we have a
copy so first thing we got to
do
this is slower though too which I'm not
really thrilled
about but that's a different problem
okay so first we're going to invert the
buffer xfer instead of doing the
transfer on here we're going to do the
transfer on
here
now if we did a buffer xer
what we have to do is we have to create
a sync
event on the input
device
so SI inputs. z. device and now for this
we can just do like Global counters.
kernel
count okay
[Music]
now we've got to exact
this then we create a block
event on the output device and we exact
that let's take a
look
so yeah uh we do the X for here the xer
is actually that's not really right
where do I write that word X for I
forgot uh it doesn't matter like that's
actually happening on a different device
it's actually happening on this device
now so we can just actually change that
to Source
device great okay so we're doing the
transfer and then we put the block and
then we do a block there let's see if
Works without debug equals
2 yeah
buddy all right let's see if llama works
oh we don't need H say disable cash
anymore we can keep that sweet
cash we love the Cash we love the cash
not to be a cash okay let's go work work
work no the answer is wrong just Chinese
characters
what we disable the
cache oh it works if we disable the
cash
great I do feel like this is a different
problem though
I feel like this might be a buffer reuse
issue wow wait who loves HSA disabled
cash by the
way chines
characters it ain't broke don't break it
yeah I know I
know
um cuz when a wolf Cry Wolf you still
see that Wolf's teeth
motherfucker that's a great song
man some some of the hardest bars in rap
I swear you can't fuck with me but I
could fuck your girl make a up for me
then slut for me then steal for me then
kill for me and of course it'll be your
cash then I'll murder that bitch and
send the body back to your
ass uh We Be Steady mobin
uh let me try lru equals zero and see if
that
works out of
memory did I keep free disabled I might
have to put free
back kill for me then steal from me and
of course it'll be your cash then I'll
murder that bitch and send her body back
to your ass
yes okay so that's just an lru problem
oh that's
great cool uh yeah we can fix
that I mean this is a different problem
this is actually a tiny gred problem but
we fixed the sink issue uh which is cool
if the problem is if we're reusing a
buffer that's kind of annoying okay now
the problems on the other
side uh
now we need to find some way to clear
the L2
cache bye person I'll miss
you see notice how it's right for the
first first ones when I disable the lru
but then as soon as I get to the jit
where we have a placeholder it's all
wrong all right why don't we look into
HSA disable cache and see what it does
and can we only disable the cach
sometimes because like now we're still
running into the problem now we're just
running into the problem on the other
side so you see over here
guess what we have over here we have an
L2
cach and for some reason it's going
right to Ram here and not going into the
L2 cache which is
incorrect which is yeah which is weird
Okay so when you do the cross device
stuff when you do the cross device copy
it isn't
uh yeah you see it's just going to the
ram it's not going to the
cash there has to be some way to flush
the
cash okay we know exactly what the
problem is now we can look there so
there's a whole other runtime for this
thing called HSA and maybe there's stuff
about the cash
here
copy might also stay on device Zero's
L2 no it
can't how do I know it's going to
ram
um I mean the problem is it's reading
stuff from the
L2 I know that HSA disabled cache fixes
it so is that even
defined where's HSA disable cach to
find rock
T you can modify the memory allocator in
Rock Rock
T using the
various HSA fence scope t
all right well here's the rock T thunk
interface okay so let's get some rock
tea
going
this interacts with the rock K
driver oh we found it you say disable
cash disable cash check user pointer
Reserve
SPM even if I have to flush the entire
GPU
cache the colel I mean that if the
colonel looked for an environment
variable that'd be
wild
um I mean there has to be a there has to
be a cash
flush
this doesn't even really make
sense oh
wait no no no no no no somehow it works
when I disable the
cache it's possible it's luck
though mean okay the the deeper fact
that I can't that if I enable the lru it
just totally
breaks says that there's something wrong
in tiny
grad how much faster would it be if the
cach worked well right now it doesn't
really matter because we're still still
we're entirely limited by our uh our
CPO so making the cash faster wouldn't
even help right now but that's not the
the like that's not the
problem we have to think about once
we're good
why do I have to rebuild the
thing HSA packet header fence
scope
invalidating L2 cache is done dur during
AQL packet
commands yeah I agree that that quote is
hey don't ever question my authority I
will add Authority if that's the problem
but I don't think that's the
problem disable
caching what's
SPM
dis whether all memories
coherent okay whatever you know what I
have a cash flush
it's whatever event record
does
um what if I put an event record
there I what I would a completely
useless event
record
uh oh I'm on the wrong
device oh I disabled the cach anyway it'
be nice if I can find a test that
fails okay event record does not fix
it
this might be a stupid or bug actually
you know what this really might not have
anything
to except for the fact that disabling
the cash fixes the bug which is very
suspicious why is L2 cach relevant well
it shouldn't be
but the L2 cach doesn't really matter
for models that look like llama for
various reasons
um wait actually even
crazier can I put the semaphore on
this it's going to complain you can't
access this memory fault memory fault
memory
fault
memory fault memory
fault
oh uh
oh
uh uhoh
and then we played a fair use amount of
copyrighted
music uh
H all right guys that might be today's
stream um is the Box GNA come back
nobody knows do I have to go into the
BMC to try to make it come back I
do
uh
I mean I don't even know like did we
konel Panic
did all right well so we learned
something what did we learn we learned
that we're going to need to write an HSA
driver and we learned that we're going
to have to use
fences and put fences in the appropriate
place to deal with the memory
accesses
will the Tiny Box come
back I'm not sure if it will on its
own so we'll need to go in and reset it
by hand Tiny Box is
Gone
Good
by
time Bo
I tried to
enable some peers and it didn't come
back and a died
goodbye
tin
box
goodbye Tiny
[Music]
Box
[Music]
let me see what will We Be Steady
[Music]
mobing
can't even say the first line man can't
even say the first line you
know uh I don't have perfect patch now
oh we're
back
uh yeah well don't do that
again
for
[Music]
something like
that uh why is this so
slow I know I'm not happy about any of
this
so there's this interface here called
HSA and yeah I think we can figure out
acquire fence
scope all right should we try to play a
song what what what song we have to we
have to play a nice song not Timber by
Pitbull should we try to play a nice
song and that'll be the end of today's
stream
Sandstorm I don't know how to play
Sandstorm Moonlight Sonata what even is
that oh I can't this like piano it's
like real piano Chief Keef oh Prof oh
Prof
man H props cool squad goals wait we're
not allowed to listen to copyrighted
music though
aichi play any of this stuff Waka
fla W FLA
little be wanton
[Laughter]
soup
swag it can't be copyrighted come on you
think that little be little be you're
trying to copyright strike me
boy all
right um what did we learn we learned
that we still need to write a GPU
driver and that's the moral of the story
you know what I know I know I know
exactly what a perfect thing to leave
today's stream on
is thread fence system makes all device
memory rights All rights map to host
memory and All rights to peer memory
visible to CPU and other GPU
devices some implementations can provide
this Behavior by flushing the GPU L2
cache hip/ hiip clang the only way
anyone actually uses these gpus does not
provide this functionality as a
workaround users can set the environment
variable HSA disable cache equals 1 to
disable the GPU L2 cache a very
important major feature of the GPU this
will affect all accesses as for all
kernels so it may have a performance
impact good night everybody have a good
weekend
[Music]
yeah dude yawns going ham on Twitter
I'm so happy part of you wants to send
him an email and be like bro you're
totally doing the right thing
thank you thank you for speaking truth
thank you
we don't do that you know talk about
Tommy I'm ice cream on these streams
obviously my personal views are not the
company's views comedy I does not share
those views on incredib I don't have a
person in Twitter but we did you know to
boost our support you wanna lose tough
times along I will say this have you
ever hear this history will remember you
very well history remember you was a
great
you just made your first fork ever man I
don't have any for I have a knife
welcome back think we huh
oh no reddit has lost interest Neil
almost officially I don't like the tires
your top side toward you'd make millions
I don't know I couldn't get through it
looked into Canada's yesterday wooden
Elon do to make me happy this you know
like there's this whole myth that like
the hospitals are like oh my god see
this is the models I was looking for
yesterday that's Rihanna's Twitter
so what did he want do you know he like
geese turn up to people like you know
[Laughter]
[Music]
[Music]
doesn't have clothes smoking pot Jerry
you know what should we give a little
high it's my last night in the apartment
should we smoke a little weed pretty
good brother looking pretty good all
right we're gonna we're gonna smoke
alone
go smoke a little weed
we left in the bottle the bowl Argos
probably back fresh bowl now we gonna
wait Lex Freeman went to defend Yvonne
and ended up taking the tweet down Lex
come on man we gotta stand up to these
people you know what it is let's go
let's go let's go Lex fell under the
pressure
where do we have the do we have the
desert screenshot of Lexus deleted tweet
anywhere no next to the super nice guy
he's a super nice guy
no Coronas not fake news but like you
know Lex is a nice guy let's let's just
search quickly and say we're gonna find
going on Twitter is this gonna be the
first get high and go on Twitter stream
I don't pull the Elan I'll lose hope
no no no chump chump goes to fly man
chump you know I watch oh we're talking
we really would get high we're going on
Twitter talking about Trump is that
really what we're gonna do you look at
Trump in the primaries and you see him
punch of the Republican guys you know
when Tony chose punching at Jeb Bush Jeb
he put the exclamation point on the end
you know cuz everyone knows how boring
he is he tried to put the exclamation
point to make it less boring but he's no
boring and that's funny all right
and then like I just punch in Hillary
Clinton dude all right I mean it's a
cheap shot but like dude this is the
Clintons but then he becomes president
and keeps punching
[Music]
all right now that's that's it did you
know every time every time they're
thinking about Trump he's it's a small
victory for him people get so butthurt
about him I think he's got a funny but
yeah I imagine trying to be in the way
this is going on to shut down anyone who
has a different opinion audio clip from
YouTube now but you know what I texted I
texted Alex this morning and I said the
internet it's gonna become cool again
because once like YouTube Facebook and
Reddit censor everything like who's
gonna be left on the Internet all the
noobs
and all the people who remind smart can
go form the ultimate man the alternate
Internet's gonna be for a while they're
good for all have them tell all the
noobs come from the internet and then
come to the alternate internet
censorship around here no like you don't
have the alternate alternate in them
it'll be great Conde Nast okay people
think of reddit is like oh it's this
it's just like hip site made by three
guys in San Francisco it's owned by
these people a global mass media company
founded in 1909
we got a fact check yes I'll became an
independent subsidiary of Han yang conde
nast publications subsidiary bullshit
okay boom yeah the new search engine you
know I'm going to start a startup and
our mission is going to be to organize
the world's information and I'm gonna
have like ball pits and chefs and it's
all gonna be sick
yeah read it read it lost the iron
Schwartz cultural ago any viable
alternatives to Twitter and reddit not
that I've really seen icy bitch shoot
showing up as an alternative for YouTube
I think gab is its to ten years with
terribleness to be a real alternative to
Twitter the same thing with the votes
the bitch you I don't know I mean it's
it's bad if you go to the homepage
yeah all right I'm hoping some like like
legitimate creators start going over to
bitch you there's this whole joke of
like so you know you do a witch hunt
right and you kick a whole bunch of
people off and they all go we're gonna
go to the new platform and you know the
new platform has three civil
libertarians on it and 97 witches
[Music]
introvert videos that nonsense for
videos I should be able to solve the
talax problem what's the college
problems in Cosmo we're being
open-minded about new ideas can I
suggest anti-aging research hey Jake is
a humanitarian disaster that kills as
many people as World War two every two
years yeah bro thumbs up we like the
talent that's what he says
god no really we're getting high we're
talking about Elon and Trump and Twitter
and the alternative internet it's going
on part right now bro y'all fucking rich
rich rich I don't know I don't know
about Gavin no dad I've just seen some
screenshots when I'm vote briefie let's
see let's see what's on
vocht have your say oh well that's wait
really
I hate when they do this I was looking
at some of the porn alternatives to
tumblr today I was like BDSM LR there
was another one and they both had login
gates why do they do that registration
takes ten seconds if you're yvonne right
now just-just-just if you're either on
right now you're you're sitting there I
think you want owns like what percent of
Tesla does Ilana twenty percent
so if Tesla goes up eight percent and
Elon owns 20% we're doing four cents
right tonight Wow you don't just made
2.3 billion dollars you've looked at
zero that
oh yeah I think I don't know
who's even buying Tesla during tourism
all right we're gonna try to figure out
why oh my god nom too high to do this
voice no no we're not we're not we're
not too high we cannot no should we do
easy stuff what do you want guys want to
do instead we camped a museum easier
it's too hard right now also I've been
doing this shit all day at work let me
see how see how my dynamics models
learning learning oh god it's not even
up to testing if I did the yeah I wrote
this was one of this day at work so I've
been playing with models all day today
we're tournament dynamics models for
driving pretty cool look at the grooves
man big bruise this is shit ton awaits
yeah I hope that's how the so many
lawsuit is remembered as that as it just
track just Sony where's your fucking
diss track that's right bitch if you
guys alright I'm taking suggestions so
you can't do anything hard sorry there's
no Museum tonight it's my last night in
the apartment let's get high let's drink
coffee maybe we'll have some some bud
light's I think I got a few last Bud
Lights in the fridge how much did the
Sony lawsuit cost me so I got donations
and I had money left over I have like
seven grand left over so I donated ten
grand to the e FF so of my money it cost
me three thousand dollars and didn't
even have to I just kind of was like I
felt kind of bad like taking donations
but you know Bernie Sanders took
donations but I got my refund so we're
good what good seats yet no no we're not
doing we're not doing CD f's how often
do I usually smoke every other week
every other week at San Francisco I
think I smoked more drank less men in
suits who follow me yeah no they had a
private eye all right this is this is
the smoking weed stream man this is the
smoking weeds Jay now the security
clearance yeah I wouldn't I wouldn't
trust me with the security clearance
prank call some people
yo yo is your refrigerator running
yeah cuz I'm moving out of my apartment
tomorrow and I was just wondering I got
some like food and I was wondering if I
could keep in your fridge rater alright
yeah that's good to know I thank you bye
oh that's a good pretty well it was a
prank
oh I was supposed to your stocks up man
your stocks fucking up but you know
what's up even more
Bitcoin and you know what that means you
don't wait is gold up to Gold's not up
that much wait
Gold's up I don't know I can't we know
Gold's down but that's up from like last
time I looked at it can I see this over
like wow gold is up damn the US dollar
has lost 5x of its value since 2000 but
I'm having is they happening soon should
do viewer Skype Falls I always had up to
do viewer Skype calls I don't know if
we're set up to do viewer Skype calls
let me say no but I have to give you
guys my Skype use discord yeah yeah I
could do it in this cooker just created
this cord now when I creating a fucking
discord no fucking discord that was a
dupe I know your dupe
okay here's what we're gonna do whoo
easy you'd think it would be to build an
app how easy you think it'll be to build
an app where you guys can stream let's
do it let's see if we're gonna build the
app that we use over that time I learned
to react on the stream and then forgot
I'll react
no I said it can't be called app it has
to be called voice app yo this is my new
six startup can you guys check it's
trademarked it's just you're gonna go to
Voice app calm and you're gonna be able
to talk with people right away no
they're not a voice that's gonna be so
secure all right um oh man okay what
language we're gonna write this in
JavaScript voice record using recorder
JX
in the media stream recording API no we
have to figure out okay how do they do
twitch tag top whatever I did for twitch
tactile we want stuff similar to that Oh
simple skills Sunday I remember that
remember this voice all right we're just
gonna call it but maybe Pierre jsr what
spear J ass it sounds good I just let's
let's hear a buzz words my new startup a
simple peer-to-peer with WebRTC
oh yeah yeah this is what we're fuckin
talking about all right
media calls oh my god this is so great
this looks so easy oh I use Pierre jf
didn't I use Pierre Jay asked for this I
used pure jazz for this denied yes
this one we're not gonna write a react
we need a server or can I like grant the
permissions to localhost simple
peer-to-peer call answer I said one of
you guys is gonna have to write the call
side of this thing
alright because I'm not gonna post this
on github and it's gonna be the first
person who actually manages to figure
out how to write the other side of this
that will get to come on voice yep well
we're not doing new video show stream in
some video canvas element probably an
example for this
Pierre call another peers ID so wait I
should I print out my Pierre ID that's
answering the call so while I'm
answering the call you guys are gonna
have to call me and figure this out I
think I printed my PR ID I kinda
remember this stuff in twitch pact oh
wow it's so easy how you just don't
remember this well I have to make a new
Pierre I guess so I can say HTML
this state here dot on pier dot on yeah
we'll put that here what is it my app
work I worked really hard on this app I
understand them to my twelve year olds
give up on web oh it's done all right
cool
okay so this is my peer ID you guys
whoever figures out how to call me first
I just will find well right call that
HTML and me out there well you know what
let's make them plot it wants to make it
it has to be a text box import text box
HTML 5 geo do they still have a
w3schools yeah yeah w3schools type of
deep balls man
oh you know what is all this shit type
equals text
types of callings oh we should put the
game after looks better I now have an
input equals equals we should make it
say after how are we gonna have text oh
yeah beautiful
okay so now we just have to make a
function call at all and we is calling
bro alright now we have to oh man
yo I could use some jQuery right now dot
txt holy person yeah we're gonna use
proper very person to call he is callin
bro undefined it's not dot txt no dot
value it's gotta be value I think it's
value is value yeah okay cool wow that's
loud alarm
is the answer and my name is Khan 8g to
checkmate 5-0 anyone in Chad Nanako
daredevil yo this is this is dumb shit
man
this is dumb shit hey alright let's go
let's go we got Voice app over here here
yo who's ready to who wants to invest in
the startup I don't know how you can
invest or what you get but mmm this
isn't good this isn't good guys our
valuations going down illegal invitation
any video videos too much too much
is that why it was an illegal invocation
illegal invocation and calls
wait I don't even have getusermedia do I
have this yes oh no I'm in chromium it's
a good browser the one time it's
appropriate to talk about browsers call
illegal invocation and caught tight
there
what
regal invocation when using media good
catch we'll fix the examples by the way
this is still an issue in the media
section oh we have to bind it to
something what that looks like some
lame-ass JavaScript shit oh yeah use my
microphone cool ok here is not defined
good that's a good at all good damage
well good damage I we got the new answer
ready to go here is not defined we've
got to make a new peanut in the we is
fallen bro function yeah is this I
something happens I don't know show
stream in some video canvas element this
is probably the hard part
no but seriously if you guys want to
invest in this you can't because just a
great idea it's called voice app it's
gonna be the easiest way to voice
somebody ever let's think of it like a
cell phone but for your web browser yeah
it's a cell phone for your web browser
okay well good we fixed that bug gone
then we're fixing so many bugs okay show
stream in some video elements audio
element the audio embed element yo are
you telling me VoIP okay audio element
from a stream what is a remote stream
media stream html5
you know make me a cellphone and do my
HTML code that's the line I was thinking
about okay good
get audio tracks media track Chanel find
media stream audio element that captures
the stream but we want to do it the
other way we went off on capture a
stream whoa
WebRTC examples streamed stream from a
video element to a peer connection dude
WebRTC is crazy who's ever working on
this stuff you guys are the the people
we need fire RTC comm what I have to
create an account that's too hard I
can't do that this is why we don't know
what's on vote because we didn't create
an account get user media like gaining
access to an input device oh this is too
hard they need to make this stuff easier
man you know we just got our seed round
PHAs audio call example yeah they have
an example Oh perfect a tutorial they
only made it way too complicated now
playing the audio Wow oh yeah window
create object URL oh yeah let's just
let's just steal this I don't will not
forget this time myspace set no paste
what if we just call on receive stream
failed to execute create object URL no
that didn't work
wait what is document query selector
though this is a not we want on receive
call all that answer media straight
answering call started on receive stream
call dot on stream on receive stream I
think that we're gonna have to create an
audio yeah
oh look at that audio you're an answer
you'll always be an answer failed to
execute create object URL audio source
well if I just set the source just
stream am I crazy for thinking this is
gonna work that's how I would have
implemented it file not found object
media stream that's the lamest bullshit
I've ever seen that just turned it into
a string okay well you can't just type
in string there you've learned our
lesson show stream in some video canvas
oh well my tutorial go for noob
get user media create object URL I mean
it seems like it's the right idea
no functional to execute create object
URL and URL no function was found that
matched the only thing he provided wave
the lower consider avoiding create
object Oh source object oh that makes
sense
oh yeah that's so sensible yes wow
that's a brilliantly designed API by
super smart people yes we'd love
JavaScript yes I don't know it's
actually probably 2i yeah okay who's
ready to make a call with Voice app we
just put it on github know how else to
do anything how do I host a single page
HTML site easily we have the posting
single page oh my god three dollars a
month I can't afford that
open file upload know what I want
Geocities ya know gh-pages yeah yeah if
fire basis is all too hard yeah yeah
github dot I am what if I don't have a
get up no I don't want to use guys stop
it with all his web 2.0 shit I'm ready
for the web 7.0 which is free from
censorship yeah I know it's a setting on
the repo yeah it's simple HTTP server
you'll host on your Raspberry Pi okay
bro you got to tell me an IP address and
home that tatak to you you tell me where
your Raspberry Pi is I'll netcat of you
and then you can host them and first off
why - ugly tabs in my shit way to kind
of start up it's already using tabs over
here at Voice app voice app wait no no
no no no honestly guys what we're
messing this is this is a legitimate
startup here we need we need really to
sell it we need to do a better job
selling this it's um voice app note the
caps is the revolution revolutionary way
I gotta spell it right
revolutionary yes perfect revolutionary
way to all people without censorship or
government injure interfere
it is HTTP I think
so only only top-tier agencies can
listen listen to your calls or maybe
maybe even day camps you missed around
go by voice at all right neck pad who's
guy who's guy who's guys what's your
port give me a URL bro give me a URL and
ikat it right to you put in P and add
title oh yeah we definitely need a title
okay fine I'll put in a P now we got
these do I need to put a title in ahead
I think I might need to put a title in
head title voice app is phone calls
oh wait none of them I'm gonna hang on
hang on hang on I'm forgetting I'm
forgetting a key part of a startup we
have two virtue signal about the good
we're doing for society voice app can be
used by corrupt people in banana
republics man I'm really not good at
this
definitely when I not USA for planning
revolution yes okay that's good good
good oh yes planning revolution powered
by AI what else we got
what else we got served on Ice Age oh I
like that better powered by AI donation
male 2 need some burrs and make it cold
no actually I got a better idea for
we're gonna send our donations no that's
good yeah I all right cool
what else we got alright what else we
got evolution powered by AI and not so
much so much blockchain anymore anymore
but crypto is okay I know I sweet we got
in that kind of alright we're gonna
knock that out I'm excited
thank you we will wait no no don't tell
me
oh man okay you know what we need to put
this in
[Music]
wait I can't access your computer ought
to get four it's off my bra oh yeah chip
the height change you've not my dream
boy Trey let's do it wait surged on sa
put a surge that sa and did your net
that work yet static web publishing oh
oh I kind of like this I mean it
probably is gonna have to install
seventeen million things but ok nvm it's
fall global search I like it I like it
no I have to use a fucking email and
password and look it's gonna download 70
million yo gifts subs who's been gifted
subs it's open start again nan Fox thank
you for subscribing who else subscribed
let me know if you subscribed
oh yo no actually I want to say you
right the way that you said it in all
caps was really inspiring planning
revolution a ipod startup and not much
blocking anymore after I lost all my
house and bit connect ok that's that's
that's the top tier
yeah try your netcat alright our depth
our blinking white silence China's neck
out who can get a neck out to work guys
you got it you should pay attention now
because these are the censorship
resistant tools after youtube's only
gonna let you stop Oh what no what that
is
who's Walter O'Brien all right we got a
new netcat Cano you guys open a fucking
port or can I not open a for it this is
my fault
refresh your fbk what's an fpk you just
sent me a message I don't have an f PK a
fucking Facebook you think I'll go oh
refresh my FB k oh yeah oh sweet
if somebody else's somebody about to
call me wait my Fuhrer just froze up I
was weird I think they're trying to spy
on me for building censorship resistant
tools to allow people wait no but you
can't DDoS my call because it only
accepts one call who's Walter O'Brien I
[Laughter]
don't know what he did
I'm not even gonna I don't even know I
can't even assess the truth of that
right now wait can we not host a webpage
anywhere okay do we need to write a
bootloader let's write a bootloader hang
on hang on hang on I'm gonna write a
bootloader give me a second whoo loader
dot html' all right you're gonna have to
type in bootloader okay we're gonna
write a minimum thing that loads and
executes arbitrary you can host it you
just don't want to put your IP in the
chat I don't know who can host it man
yeah that should open a port but you
have to make sure that your ports open
to the Internet
so if you're like behind a router we got
to get around
zero-zero webhost i come on there's got
to be something that's just gonna let me
upload stuff free web posts you know i
don't want to have to login no this is
something that they can take away cuz
it's censorship
let's try search maybe search will work
search by entering in an email and
password no Leno calm at all alright
that's my project nonchalant volcano oh
wait
Serge is sick well that was amazing
here you go boys alright I'm creating
the new thing first person to call first
person to type it in and call let's go
Serge is amazing
let's go uh-oh we got multiple calls
here hello hello oh I think we have to
stop it from getting hung up no no no we
got to prevent it from getting calls we
use getting calls we have to have accept
call how do i do prompting JavaScript
its prompt you'll be able to call in a
minute don't worry don't worry we got it
we got to add some new functionality but
it's only on there this side so we don't
have to update the page prompt okay why
why prompt your answer if Y y equals
equals yes
but actually is it gonna not be able to
do prompt because that's in a alright
try this one boys it's hosted on Serge
Sh you answer yes hello is there a
person there no hello okay only one
person can call I don't know why it
doesn't work let's just try it here
hopefully again hello yeah it works
locally I think the problem is that
we're just getting so much spam maybe
you answer is the wrong idea maybe we
just need to make it the first one
you're on oh yeah it should be for subs
only that's right make it confirm you
have called that's right
I hated that anyway this is why we use
yet because okay
looks we got to fix this PJs
answer
hello
is there a person
I can kind of hear you
hello
permission just missed Oh No hello is
that a person test yes yo I hear you
yeah it's a Pingree on through you Pig
we don't ones we gain congratulations
welcome you're the first person who
managed to use voice app which voice app
is the revolutionary way to call people
without censorship or government
interference this is a totally safe
phone call we can talk about whatever we
want nobody can listen in the street see
you thank you goodbye
we're taking the next call if anyone
wants to call in and ask me all I have
surrounding your problems we got it the
next call coming in is that a call
hello I'm gonna give everyone a little
bit of time this seems to actually work
okay just a lot of people don't seem
that working mics on their computer hey
do you hear me yeah I can hear you oh
wow sweet gets brings the delaine's
in this question delay yeah yeah can you
hear me friend they're from the app is
voice calls yawns that's great cuz Voice
app works both ways you can both talk
and be talked to
visionary yo thank you thank you and we
hosted it right here on surge I hope we
don't get censored that's right that's
right we built the decentralizing I
thank you I will take one more call
we'll take one more call
hello
hello
yo that's it boys out I'm done I'm done
nonchalant okay you know that surge that
and sage wow wow that was a lot what a
street
what is the Train boys this is smoking
weed streams this is so dangerous
what's dangerous about it you guys can
use nonchalant volcano for all your for
all your needs
all right that's the stream good night I
don't think we can top that I think for
a short stream that's some quality stuff
we're gonna name the title well just
keep it as not new zero by maybe other
things I don't even spelled but right
you know I kind of got to pack up this
apartment is it gonna stay on the deal
yellow I hope it blows up now but the
real the real takeaway from this is guys
we're experiencing a minor episode of a
bunch of those people thinking that they
can censor again and to them I say you
have no idea how hopeless what you're
trying to do is because the spirit of
freedom lives strong in every
red-blooded American voice app once they
start bleeping out words in whatsapp you
know Facebook's gonna do it right how
long before you cannot say the word
Twitter on a whatsapp call when
censorship comes you guys know how easy
it is to build censorship resistant
tools don't ever forget that you saw
this here tonight don't ever forget when
they are when they're taking this stuff
down from YouTube and you know it's only
gonna get worse man the dominoes once
one of them falls they all start falling
but you guys know that I give each and
every one of you permission to be free
if PJs shits on the PJs servers or if
searched on Sh shuts down voice half is
over we ran out of funding I'm sorry we
paid all our money and taxes I don't
know what to tell you
but you know just keep the spirit of
freedom alive and keep the spirit of
hacking alive that shit's the real
spirit of hacking man you know hacking
has nothing to do with computer security
the hacking is it's like a culture
computer security was this thing that
existed for a small period of time there
were plenty of hackers before buffer
overflows existed and it will be plenty
of hackers where a buffer overflows
after the days that buffer overflows
only exists in the past because
everybody is programming in the memory
safe language of rust hack the planet
hack the planet you know hacking is an
idea man and what's at the end of I'm
just I'm not gonna read the whole thing
I'll just read the last I'm a hacker and
this is my manifesto you may stop this
individual but you can't stop us all
after all we're all alike good night
everybody
[Music]
let's
[Music]
go
[Music]
[Applause]
[Music]
my
[Music]
[Music]
so
[Music]
[Music]
good morning
everybody
[Music]
Flor
[Music]
you
[Music]
[Applause]
[Music]
[Applause]
[Music]
I
[Music]
[Music]
[Applause]
[Music]
[Applause]
the
[Music]
[Music]
[Applause]
[Music]
theall the
w
[Music]
[Applause]
[Music]
Cod 4 TV that's your shout
out thank you for subscribing we
appreciate everybody who subscribes we
appreciate everybody who doesn't
subscribe slightly less and we have zero
appreciation for anybody who doesn't
even watch this channel
because you can't appreciate everybody
man you got to you only have X amount of
appreciation it's a limited resource
people who say they appreciate
everything actually appreciate nothing
that's a quote I forgot what that quote
was from
yo when you have nothing you appreciate
everything and when you have everything
you appreciate
[Music]
nothing
starts with us collapsed in a club
rifling through the things that we knew
swear I recognized you from before from
back home from somewhere I don't
know it's so good
[Music]
man
[Music]
[Music]
[Music]
okay think it's time to pause the
music as pleasant as it
is
can I enable some emotes for some guy's
not even a subscriber no I can't do that
man lighter Mary you've watched enough
you know what time it is it is tea time
but first let's at least figure out how
to
open what extensions do lean files
have
see what
happens I installed
this no I didn't see KSI versus Logan
Paul I'm kind of over Logan Paul guys
guys I know I know it's sad we had we we
had a wonderful uh time together but you
know okay just do lean
um beautifully syntax
highlights how do
I got do like shortcuts for
this you are running lean in the
directory without a lean package
Tomo this is not
bro
I'm just clicking buttons
guys
oh sorry that's
loud
but I fixed
that please tell me how not to be Noob
well I don't think I can help you with
that hey Alex what up this guy wants to
know how not to be a
noob oh my god do you want you have any
tips for him uh yeah don't ask how to
good tip oh that's a good tip that's an
A plus tip on not to be a noob
today that's
pathetic whoa call don't be CW they
watch My
Stream we're off screen right now they
can only hear us they can't see us
shit we got to get some tea and then we
got to
start I big app thing what you
think anything in M you know me I just
get excited when I hear things I like oh
you're like everyone else yeah exactly
that's why I fit in
man fitting in is very important to me
you don't want to stand out standing out
overrated despite what the mainstream
media tells
you what's the opposite of
aake a fucking
raindrop yo think about it no raindrop
Tri to be unique and
special
same
we're getting some tea guys we're
getting some
tea don't be a snowflake be a
raindrop well we got a lot of good
quotes from this
stream oh you know what I want for lunch
Alex what pasta
really no I had too much carbs yesterday
you no I don't tell them about my
life
know I know I dro dropped an ice cube
yeah I know it's over there I have
cleaning staff my cleaning staff will
get it and by cleaning staff I mean I
have a robotic vacuum cleaner because
everybody can have slaves in the current
year they just can't be
people we address difficult Concepts
like slavery here on this twitch
Channel
okay what are we going to do in
we whoa whoa whoa robots aren't a race
guys it's not racism or cheating if it's
a robot it's not cheating if it's a
robot you know that's my slogan for AI
sex
workers true it's not cheating if it's a
robot you know what I
mean the emotional dependency will only
be I don't
know a why I just going to be upset
about
that it's all about how we brand it and
I'm going to Brand it to make people
upset because then more people are going
to retweet it and then I'm going to have
a million followers on
Instagram all choco blade when you said
it once it was okay but if you keep
spamming like that you got to you got to
leave the chat the chat's only for
people who want to say intelligent
things once not things lots of
times I I don't like this book book
because this book doesn't like like how
to do something in
lean can we write like a SK o can we
write a metam verifier and lean oh that
would be sick yo can we write a metamath
verifier and lean oh that sounds so
meta yo what do you guys think what do
you guys think we'll continue twitch
coock and we'll write a metamath
verifier in
lean oh does lean have like a parsing
line Library does lean have file
IO you see what I'm saying
though that would be sick
man wait is the the parsers written in
lean
so this is the start of my one in in C
but what if I write a metamath verifier
in
lean no no we looked up we're not
talking about lean the drug we're
talking about lean the programming
language and lean cock is too hard what
about lean metam well first off has
anybody done this
before
that would be a great that would be a
great lean
project
verifiers verifiers why can't I spell
today
BR Lua Russ yo we should add ours to the
list I wrote a metamath
verifier written in a custom
language has no I don't think anyone's
written one in lean
yet and I don't know anything Category 3
sucks
guys I don't think it does
anything I've given category Theory way
too many chances in my life The Hacker
News circle jerk loves category
Theory cuz it's one of those like like
if you say man I know about blockchain
you're put in that category of like
posers but if you say I know about
category Theory
you're put in the category of like
slightly higher tear
posers I'm glad you like my stream
cly I just you don't get any of this so
you don't get to you don't watch you you
not watch my
streams you can tell them the truth it's
okay what's the truth if you don't watch
my streams I oh that's
good there all seems like mental
masturbation that is
true I am a cam girl but the difference
between me and cam girls is I'm not
making nearly enough money because not
enough of you give me gifts and uh
you're not a cam girl I am what do you
mean they just don't give me gifts and
stuff I totally what do you think this
is what's the difference way harder than
you
do I know some C girls I don't think
they work harder than me
it's like oh it's Sunday I'm going to
like you know take my clothes off and
turn my webcam
on some cam girls work hard of course
they do some twitch streamers work hard
but there's a whole tier cam girls like
me hey hey hey just cuz I'm rich doesn't
mean I don't like making money those
things are completely unrelated I think
rich people like make money more that's
probably
true h
what is
this I love open problems man they're
all hard though I
think okay this is lean
four can the question is like can I do
like file IO in lean
io.
lean
what all right well first let's close
out of this folder this was never going
to happen and let's move over to Twitch
coock we're going to change the title of
the stream to lean metamath verifier
Maybe
yeah yeah twitch coock yeah yeah we're
back we're back to Twitch coock you know
this has been twitch coock for those of
you that don't know this is a recurring
thing we do uh on my
stream and we're going to see if we can
write a metamath verifier and lean so
I've already written one in Python if
you guys go to the twitch hcock uh get
repo you can see the one that I wrote in
Python um in in in
metamath
I'll show it you in a
minute um so this is the python verifier
that I
wrote wow the text is Big you guys are
going to be
happy
what oh it's downloading stuff that's
fancy
yeah basic programming is not a joke I
don't know I just don't really know what
a better category is it it's kind of
basic guys like we're not we're not
like put it this way any program that
you can write in like a couple hundred
lines and there's no fancy algorithms in
here this is 518 lines and like there's
nothing really to
it we writing the search stuff but I
think we got to go deeper and we got to
write metamath and lean and then if we
write lean in
metamath wow that's the circle man no no
all right it looks like lean does
support file IO I'm going have to write
a parser
too in Python we just used a
parser so if we look over at mm.
G how do I there's got to be a way to
like I want to open a new oh that no
that's not really what I wanted um but
this is a uh oh search
Marketplace oh antler Grandma par so
perfect what was
this imagine not using the superior Nano
I do hear there are Nano trolls they're
common
now
like that new jailbreak kid's a nano
trol what was this line cuz Life's too
short to not use
Nano that's a good
line we'll call it main. lean Maine is
always a good thing to name your
programs when you don't really know what
else to name
them all right
so why is that
C++ do I have metamath syntax
highlighter probably
not okay for reference for those of you
who are unfamiliar with the metamath
language this is a constant this is a
variable these are type definitions this
is an axium and this is a proof um so
now we're going to try to parse that
file from
lean
W that looks very similar to Cock
actually but lean has stupid crap like
this how do I get that in my
thing
your
phone I saw it can me call
it valid type Teck oh but that's why I
got to put it in the Nam space
hide it already has something named I
don't know we're not going to deal with
this
now but how do I get this
character
what's a
ligature can I write that and that's
fine
too oh that makes a lot of sense okay
good you can write that as well
if you can't get the Unicode it's in VSS
code settings to enable ligatures
ligature is a font
thing no the ice on the
floor sa no it melts and turns into
water then it's fine you the only cup
George we out of
cups
oh lios are font thing oh no I
understand uh n but we
not
okay so that looks like
Hall that all looks
codable programming and
lean mean is a programming
language
uh oh now we're talking import
system.io wow this is weird though
variable io.
interface I don't know what that
does or this is the longest hello world
program since like no this is actually
the longest I don't I don't know a
language of a longer hello world program
than
this
do this
run declaration hello world uses
sorry
un
identifier iio interface did I spell it
wrong are you cleaning my sweater yeah
see
interface I literally just copy and
pasted this example and it doesn't
work I don't like the smell of
it it smell
it I don't think it smells like maybe
smell like something
else it really has no
smile that's sunny it's beautiful think
I read a little bit and
then yeah you want to go to roof
it's much nicer it's quiet on your
balcon I show
balcony all right
well I
mean I don't know can I if I run it from
the command line does it
work
error unknown identifier iio interface I
literally just copy and pasted it from
here this is the most Jank hello world
let's make sure I actually copied it
correct World gives
error
I'm using lean three oh is this for lean
four or is this for older
Le
okay
yeah yeah uh yeah that that'd be nice if
uh you
know no I don't want theorem proving in
lean I want programming in lean I don't
want to prove theorems I want to write
programs
I I
really error unknown identify iio
interface why don't we just use Pro
python because that would ruin the
stream you understand that today is
obscure languages
Sunday and Python's not an obscure
language oh we're out of
tea we're out a tea and hello world is
actually broken hell World example
doesn't work nobody had a regression
test on that um now I really like the
guy who wrote lead though so we
shouldn't insult him too much until
we've looked way more into it he has
priors for being very legit M he also
wrote
Z3 so overall I think lead is very legit
and the hell World thing is just an
unfortunate oversight or something I'm
doing wrong which I really hope it is
but I did copy and paste the hello world
example I know nothing about programming
is this a good stream to learn
programming proo there's no stream
that's going to teach you programming
there's only one way to learn
programming and that's to go and
program
h
okay all right all right this looks more
this is like a more
useful let's just start with
this does that work maybe I just didn't
need that line at
all ah sweet I fixed it I deleted that
line yeah programming skills
Bros okay
so the first thing that we're going to
have to write is a
parser someone already wrote One
lean andler
parser yeah I don't think so we have to
just probably quick writer on parser we
could load this file theoretically and
like parse that and write like a metap
right like a metap parser but that seems
like a
lot delete my message before he
see what what am I going to
see can we ask questions about Jailbreak
I see your message dude
you know what you're going to get a
timeout you know why because you took my
time that's right I'm not Banning you
just a
timeout
okay oh if we want to use numbers those
are gats those are hard to Gap I
say
okay let's
try
FG
string I don't like that it's four
spaces but we'll talk about that
later read file dot do
slash simple.
mm
call it get
fileting about there get file uses sorry
stop using
sorry oh fs. get
file has Type
[Music]
IO
expected it's
string type iio Char buffer is expected
to have type
string oh it takes in a
string I see and it returns an IO buffer
can you print ioar
buffers no I want a
string a Char
buffer the nice thing about these very
typed
put okay how do we convert a string to
an IO Char
buffer
true
string
two string is environment because get
file just type iio
trer it's a sensible error thanks for
making it very clear what I have to do
in order to fix
it yo yo get out with this stuff get out
not appropriate
the typ check that read file Returns the
result I need to unwrap I need to print
inside the
monad oh so what if I just get rid of
that is that stay inside the
monad yeah I've deal with this with hle
before but I forget exactly what the
idea
is
let's read the chapter on
monets yeah know we have to use like
do
it's like do in isn't it do yeah
this I this is simple hassle stuff that
I should just
know
so what if
I think if I do
this and say do
s return s does that fix
up
we still wrap it inside the moment all
right wean
comment single line comment start with
dash
dash fail to open do DOS simple
Dot and use the whole path
this actually running
from
perfect all right now let's figure out
how to keep it in the
monad
[Music]
um just read the hasal metam math
verifier
look at
that okay this is interesting look
there's like people done doing this kind
of stuff
already think this is exactly right
um wish I had a comment saying what it
was
for of course the monad lesson doesn't
really teach you
anything
great somebody will eventually write
documentation for
this
I really wanted to print out the
file time get file but it's expected to
have type string so I want to keep it in
the monad how do I do
that is have zero
one
doesn't use
iio you know I wrote a compiler once in
hascal
sad how little I remember about
it
type IO charbuffer but is expected to
have type
strength I think the best I can hope
for
I'm
sorry I walked a lot yesterday so I'm
kind of sore
tired we're just going to call it lean
we're going to get rid of the new title
because that's really ambitious of us
and don't like being ambitious and now
it fits on one line I went walking
hiking sounds like one of those things
that people do who like take doing
things seriously and you know what I
think of people who take doing things
seriously do I dance or show titties no
no sorry
you might want to try myfreecams.com
okay how to wrap in monac
quean these are things that I never
quite understood about
hasell like it's one of those jokes like
if you ask me what a monad is I don't
really know what if I add return here
does that fix
anything
no
not
useful um well this isn't even the right
type okay let's getting the common
syntax let's let's try something a
little bit less ambitious get stir iio
string there's a get string
right get
Char get line oh
perfect we'll call it get file and we'll
actually you define it as get line
okay yeah okay now
now
this is now
more yeah I have to wrap it in the monad
crap I think I might have seen what the
syntax
was in the one where
they do multiple hello
worlds
[Music]
no there was one where they did two put
strings
why don't you play some music cuz it
copyright you know what you're asking me
dumb questions again now you're banned
now you're banned and you were
complaining about how long my my timeout
was don't complain just get
banned something like
this
type string to iio
unit is expected to have type iio
unit oh here we
go or the sugar do
syntax wow see you're good bro cannot
read from in yeah but that's fine cuz if
I just do hello it prints hello wow
thanks bro I like you all right now
let's try to get a Char buffer to turn
into a string and yeah what is what is
the do
[Music]
syntax is this true is this in is this
hasal sytax as
well I
say let's just make that work first
because that does look like a much
cleaner way to write
it
um let make this a do block
do
semicolon one doesn't has
anyway
um that looks like what it would be in
has
thanks for not telling me actually had
to write any
dues oh it's commas and there's no
braces
no oh do I have to
return no it still has the
monad
so to be clear this syntax
worked oh I guess so I guess what I'd
have to say is something
like yeah
okay
sensible I get
it I don't really get it because nobody
really gets
it all right has Type Char buffer but
it's expected to have type string so can
I do like dot two string does that
work oh oh
maybe oh yeah we be reading
shit yeah let's just call it ni string
let's put that in parentheses and right
two string and now we can just get rid
of that there and that should work
too Y no
what oh did I not like put it in the
monad or
something
um yeah
that was what I wrote before
right I'm not even going
to that code
works let me just make sure I can write
my own put
string uh I'm not going to give it a
type signature I doubt that I have
to well no I don't know how to make
functions that take arguments how do I
do
that
string I say how do I give it
a
what here we go
I see so like I'd have to say something
like line
s
s
anymore okay has Type IRS so just do
that that is the same type
right yeah string to iio unit all right
cool
sweet
[Music]
okay
um so I mean this is all dumb what I
really want let's just say like you know
we'll call it like uh I could do
something def double
stir string to
string s col col s++ s and then I can
say something like
b
double s
a two
string
whoaa
what this
work string
imp
a
oh that's doing like monad
application um let
be that
right cool
turn yeah I get
it I can do all that okay now we're now
see I like that because doubler is now
out of the iio monad world and we're
back in pure beautiful functional worlds
I'm going to not call this function
hello
world call it
main we get file down
here iio crap below
this that's IO crap we don't need any of
that can actually do
that import must be the beginning of the
file can I open iio down there yeah okay
cool we don't need custom pster
anymore
Perfect all right now let's focus on
parsing a
string well so
usually the first thing you want to do
is you want to
tokenize um so I think tokenization is
actually all very easy we just have to
separate on wh
space
we did basic cooking you guys remember
basic
cooking
it's really very hasal
likee all right let's see maybe we can
find the stuff lean libraries or string
Library I don't know if this stuff's
really like
supported offer
stuff
grammar
Leen not that a.2 string is a single
identifier inductive types okay can we
print the type
of just do like check
strength string has type type okay well
that's kind of
useless know the dur function
and I don't
like where is lean string type
defined here we go add string.
split
AIT data string Ops oh here we
go
split too generalize to something
like P ch
all right so it takes in a function and
it
returns takes in a function and a
string and it returns a okay def we'll
say white space which goes from Char to
bo uh and then how do I do defaults on
this so like I can say something like
space true
and then default
false try something
like
well
split wh space a.2 string we have to
import
that
import data. string.
Ops string. Ops
[Music]
or maybe
this that's the wrong type now
uh
map
Great this this is the problem with
obscure languages you can't Google
shit
um well you
know
no put
map
FMA where is map not defined do I have
to import something for
map
never used
f
[Music]
[Music]
f
[Music]
[Music]
even
[Music]
and sitting in chest
feeling it's
outside end of week gets here
[Music]
quick
[Music]
[Music]
I
[Music]
perfect
I just had a a Moment of clarity you
know just I woke up you
know
we should do meditation I think we will
what's my opinion about sites like code
Wars and hack Rank and Le look
guys I
think my friend and I were talking this
morning
and and let me tell you
what I think makes people
good A lot of people go through life and
take things very seriously if you go
through life and you take I am going to
be serious about increasing my skills
and becoming a better programmer and
becoming a programmer that I could get a
job you're never going to be
great because you're always going to
lose to the guys having a good
time now all I can say is if you're now
going to be serious about having a good
time you're missing the point
entirely if you're not enjoying it do
something
else and this isn't to say that you
should find your passion because you
don't really have a
passion that's all
bullshit it's not like you're going to
one day come upon wow my passion is
slicing avocados and I'm going to go on
and become a professional avocado slicer
no I mean there's some parts about what
you're doing that suck and there's some
parts about what you're doing that's
good but if you take it seriously and
you think like I'm going to do this cuz
I'm a serious
person you're a loser I mean
it jot was a character that I played
sometime he gets played
again George hot runs come AI That's a
character
too not
me
[Music]
now gu
like everyone in high school gets this
everyone in high school understood that
you made fun of the kid who took School
seriously you
know and then for some reason people go
out to the real world and they forget
about
this they think that it's a good quality
for somebody who takes their job very
seriously and I'm not saying don't do
good work I'm not saying don't take
pride in your work there's a big
difference between pride and
seriousness because I love ice then
who's Tom Cruz Tom Cruz is my Alter Ego
that
wraps George George you could you can be
such a good rapper if only you took your
rap career
seriously George you could such a click
company if only you were serious about
growth yeah I'd rather die I really
think I think I'd rather
die you know what I mean
because once you start taking it serious
you sold
out and just never
sell just think about what you're doing
in life and like say would the kids in
high school make fun of me for this and
sometimes you still do it anyway because
kidss in high school are D and don't
know shit but sometime they know deep
truths
so one of the things that's much more
exciting about lean than hasell is you
can prove things about your programs in
lean
people in high school usually made fun
of people who are good at it so I don't
think this is a good example let's let's
break that down a little
bit what is it is that a thing to be
into you know I think what was it what's
the Napoleon Dynamite
line
you know oh I wish I I want the setup
for that line can I get the setup for
that line what's the
setup I don't even have any skills what
do you mean you know like nunchuck
skills bow hunting skills computer
hacking skills girls only like guys who
have great
skills it's
true right if you're into it I mean it's
it's not about like computers are cool
man you know you know you know what uh
what's the Timothy Leo man the PC is the
LSD of the
9s and like when he says that he means
that the way LSD expanded the mind of
people in the 60s right and like you
know most of you here have have have
used
uh probably I don't know maybe most I
don't know if most of you these LSD here
um but yeah I mean you know you compare
how that expands your mind to the
discovery of the
internet right when you find out that
all this stuff is just available on the
internet you never tried any drugs in
your life
well um I don't know if I'm allowed to
encourage drug use wait what what what
no no that's not what I want why did
that become that not
that
oh but does that still work no that
can't
work it did work though when I ran
it
interesting well I figured out how to
get weird
things
I don't wanted to do a replace on
that and then it works all
right you smoke three LSD marijuanas
man
um if you do take LSD there's good stuff
though
see here we
go no LSD used to have a good um maybe
it wasn't LSD but uh if if you do uh
decide you want to you want to take uh
LSD I would uh
have a have a deep understanding of what
set and setting
mean and make sure that you're
comfortable with
yours recent crypto drop thoughts are
you about to shill for your shitcoin if
you're about to Shi for your shitcoin
I'm kicking you
out
um if you want the truth about micro
doing there's G micro doing uh this
one's pretty good there's also micro
doing quit my
job I think is this a good
one
yeah this is kind of
interesting
I don't know somebody took it too
seriously see you can't take it
seriously wait what just happened when I
did that what did that what came up
there love G
man but yeah this is if you're
interested in
M self expound with sub psychedelic
doses of LSD no
benefit
Sleepless Elite who do you think the
elite
are
that's
mean all right
um let's read the code maybe he wrote a
parser sure what he wrote
here
what is
this I think I'm
good um yo this cyber truck's sick man I
I want I want I want I want a cyber
truck we all want a cyber TR we all want
a cyber track it's it's yo the Cyber
track I love I no we will we will we
will talk about I just joined your life
is an avocado slicer bro as long as
you're not serious about it by all means
go on and slice avocados just stop being
serious about it and don't like you
know cyber trick no we'll just look at
the Cyber truck and we'll talk to cyber
truck for a minute all right so
like let's look at this thing like the
only problem with this
picture is that the sky is the wrong
color oh like I wish I just had I wish I
just had like like insta Photoshop you
know where I could just take
this I could take this and move it over
there
you
know we're doing we're doing Photoshop
wait what we just photosho where the
Cyber truck
belongs I'm Mar
yeah yeah look at that he just built his
Mars Rover and he's going to sell it to
people it's good I did Photoshop I
Photoshop is not Photoshop George what
reading about the Le I want to get the
real oh yo yeah we don't talk about
politics on this channel do I want to go
to Mars only with his five star hotels
and I'm not saying I have to stay in one
I'd stay in like a Mars hostel but if
there's not a festar hotel on the whole
damn Planet it's not a place for
me no like the armored test the armored
glass our Theory our Theory at work was
that they put the wrong glass in like
you know they just put the wrong glass
in for the demo and I don't know man but
we are all talking about it it might
have even been PL who knows
man yeah was it a stunt I who
knows these stunts usually aren't really
deliberate but like maybe what happened
was like they found out like an hour
before that it had the wrong glass and
they were like should we not do the
thing and he's like elon's like nah just
do
it well I don't think it's a total stunt
right I think it's just like
yeah I mean especially he threw it TW I
don't
know
who
knows well I going to get distracted by
that
um where were we with string.
jooin
it's impossible to Google anything for
this
I guessed it was right who saw my sick
guess
perfect
why there's a space before it like that
oh I guess because it's right joining
with that that makes
sense how would I fix
that I don't even know I guess I could
do the first one and
then open
link I'll Trust You CU you're a subscri
yeah that's what I'm talking about
that's some real nice
Photoshop
yeah I mean that's that's what the Cyber
Turk made
for
fold L1 what's F fold L1 is like what I
want look let's
read nit list
basic
f f one
no it doesn't
but
uses the first element of the list as an
initial value
yeah all right well you know what first
thing we should
do is
uh download
this
I can't get
crap no fold out one do not
[Music]
have it's kind of
annoying doesn't par that Library
data
nit
in library where was it why can't I keep
this
straight library and nit data
list oh a knit data oh I
see so these are the
types you want to write fold L just for
the fun of
it I mean this is a learning
stream so
allor right we got to make a text
more it's not basic dlan it's default
dlan
no
um protected
there it is okay so we'll just do death
fold fold
L1 and it takes in a
function from
alpha to
Beta to Alpha those are Place holders
for types I
assume
and this is what's confusing
here so we're actually just going to say
it takes list beta to
Alpha this probably is not actually how
you write this and I'm probably wrong
wait but how come I don't have betas and
Alphas all these are unknown identifiers
I
see
[Music]
oh that shit's crazy
man
universes
you and have it has already been
declared
great two more arguments initial I don't
want the initial accumulator I want to
take it from the list but you know what
this is too
hard this isn't actually something we
need we're not doing
this okay we need a parser
though um we should also really filter
we want to filter all the ones that are
empty so I assume this
filter yeah filter from the decidable
predicate Okay cool so we can just
say death uh no empty actually I can
just do this with a Lambda right so
let's say let
L2
um
equals l. filter
Lambda r r not equal to
that
comma typ string to
prop oh not equal doesn't
work
oh my God get
out who are these
people you
know f l one only works on non-empty
lists oh yeah you're right I I know this
from Hell Now function programming is
coming back to me ever so
slowly um we need a predicate on a
string I want this one to go over there
um
empty let just a string
now is this a predicate no it's not a
predicate what does it need to return
for for a fa for a
filter decidable
PR would it be great if I could just
write that but I don't think
so
wait this is list oh I'm in the wrong
basic type
here the string basic
type string.
empty not
equal what if I just wanted to filter
the
empty
now it's complaining about something
else decidable
predicate
great oh
exists
that's for
sets just look at how filters used in
practice
um okay so maybe uh just write a
predicate is
empty bu see
like No it should just
be want to go to
prop string to
prop
me here I can just write string.empty
um something like nil and here I can
write Default
true it's
not be easy if it was just
that has type nothing but is expected to
have type
string
can I just does this not yeah I don't I
guess I don't really understand what
empty is
but obviously complains about that so
that's not right is
empty I'm using a Vim extension guys uh
I don't know how to synthesize
placeholder yeah cuz this is be a
decidable predicate which I don't really
understand
for
currycurry
oh less than it's ah
decidable oh I guess I can return
decidable PR as a
type
what's
prop all right who wants to be a mod
we're really we're really getting raided
today you got to be a subscriber who's a
subscriber who wants to be a mod got to
be a
subscriber twitch Prime
subscriber you're you're oh what what's
that
mean oh that you're wow gifter
subscriber wow you know there are
different tiers of subscribers here one
month subscriber you're a mod thre month
subscriber yes welcome you're a
loyalty to this channel one month
subscriber yeah yeah yeah no no no
loyalty to this channel is very
important to me and that's why alien
wear 997 you're a new
moderator 11 month subscriber
congratulations you're a mod perfect
perfect Yes Channel classes we know
about Channel classes been a loyal
creeper again we appreciate you but not
as much as
you're only top gifter for Subs you've
gifted Subs to people congrats you're a
moderator all right we got three new
mods there are tear there are there is
class structure but the great news about
the class structure on the George H
twitch channel is you can move up in it
today by buying a subscription and
continuing to subscribe month after
month it's not an immutable class
structure we're big Believers in Social
Mobility here on my twitch Channel and
you can move up in the world just
subscribe
for
I had a sausage in the fridge I don't
know if it's still good we're going to
smell it and if it smells good we're
going to cook
[Music]
it what's the expiration
date sell by November 22nd no no got to
go sausage has got to go guys got to go
it's not good it's going in the
trash you know I really wonder about the
guys who come in the channel and say the
N word
like is that one person with multiple
accounts or or or is that multiple
people and and that's the real other
multiple people what they come in the
channel they say the N word and then
they get banned and it's like this
happens wa every time not every time no
no there's there so there's been there's
been there's been I think three strikes
to
and like do you think it's one person or
do you think it's three different
people I just don't even really
understand it is it is it like high
school kids maybe you know memory
remember when I said high school kids
were wise I take it back high school kid
you know when you're young and people
just yell penis out loud like that's a
thing is it like that you're just like
going somewhere you can say this
thing it's funnier in real life though
see like real life makes it funny
because you're putting your real life
identity into that penis like that's
like you as a person like everybody can
look at that guy and then like you're
putting yourself out there you know but
if you do this on the Internet it's not
that you just get like in in IRL you
can't right click and ban
somebody and that's what makes the real
world so
Charming we all have to put up with each
other I'm debating whether I want to
Fitness we going to go to the gym
yeah
um or go get a
smoothie oh you just gave me 250 bits I
didn't see it he's only been subscribed
for one month and he's he's new people
he banned me too for asking dumb
questions bro if you've been banned once
you're banned for life wait that's it we
would do that to
people we do that to people
I I don't know I'm not into life
sentences I believe in Rehabilitation
Rehabilitation that's a
good yeah yeah well we'll give him we'll
give him eight years that's how long
Martin scy
[Laughter]
got aren't these mods life for a
website
Communists explain to me how the mods
are abusing their
powers I don't know anything about
markup languages and type
settings wait why is that
glitching I don't
know how much lagging is my stream doing
I'm not that much lagging okay thank you
thank you oh I see the bits
wait oh I got to click over here to see
the bits oh yeah Mr mtin you know what
congratulations you've just bought your
way into a moderator just like that guy
who's the ambassador to the EU if you
donate to my if you donate to my channel
what's the cost of being a moderator
toight it's not see that's it's a favor
based system we don't like make it at
Clear cost sure because like some people
might have to like donate more and don't
get anything I'm learning how to be
politics so I can run for president in
four years you talk him about that no I
haven't told him about my presidential
run yet can I steal your K when I get
um juice place
I love the B but I do want real dinner
lunches you bring
sandwich I like that do you like
sandwiches yeah I mean you like
hamburgers a lot yo that's real shit you
want to give me a hamburger from Burger
Lounge I'll get you a burger from no get
the lounge burger with no thousand M
dressing Lounge burger no thousand M
dressing no other side just make sure
sauce I know I
know they put the sauce
on no that's that's carbs you we ate
carbs yesterday should you tell them
about t no we're going to bring tast up
in a minute this is I'm sorry there's a
wall on my stream we'll be back to
programming in a minute okay Burger
Lounge burger no sauce Lounge burger no
sauce I'll back in a little bit thank
you a thank you for subscribing all
right let's get back to let's get back
to programms um so we have to figure out
how to make something a decidable
predicate oh fucking props and sorts
we're back to
this no no no Tor pasta no Tor pasta
yeah it is like that is like Tor pasta
but no it's it's this
man and normally I'm really against word
play but Tor pasta divine
possibilities it got a it got a it got a
4.6 on
Yelp I got three bread holes with my
beer for
free fetuccini and Alfredo oh that maah
helper looks sick man I wish I could get
a maah Helper right
now um no but
no come
on
to
prop does that
work no we still have error
here but this seems to work what
is fail to
synthesize type
class
instance for a Char
buffer how is that a Char where's a Char
buffer coming
from where's I don't get
it definitely a string fault is
true uh no you can't buy your way out of
a
ban it doesn't work like that at
all
like here I think this is uh is
even a I feel like it's just not
supposed to take a type
yeah h
no is there map to filter
map n and
some
decidable
predicate
bro you want to get banned again stop
asking about your baned be happy that
you're here and contribute positively
and you won't get banned again keep
talking about how you were banned on
some old account you'll just get banned
on this account too it's that
simple you average like four 3 to 4X
more viewers than other streamers who
code that's right we don't even do
anything good you know because they
probably take what they do seriously and
that's the difference between me and
them I don't take it seriously you can't
take it seriously
guys
okay we got to be very serious about
figuring out why I can't get a filter to
work filter lean
list
great here's
something this.
filter wait that actually looks like
what I wrote
before except I didn't write the not
equals like that
instead of his empty can we try just
[Music]
Lambda r r
not can I do SL NE yeah are not equal to
that does that
work oh this seems to
work all right I just didn't know what
not equals was fold
it
F
L I keep writing gold
L all right let's see if that actually
removed all the
terrible for running
this
perfect okay
[Music]
um now we need to to
parse should probably Define a type
system that this can be parsed into
okay so metam has like
commands
things don't always start with the
command sometime they start with a
type
y we love two ice yeah I got Burger
coming over man who's excited about
Burger I'm
excited I don't even
know I feel are serious things written
in lean the hello world example didn't
work
makes your teeth strong you know how
they claimed it was milk that was just
marketing because they can sell milk ice
is really what makes your teeth
strong
but they won't tell you that because
they can't sell any ice you
know okay we're a long way from actually
parsing this let alone you know doing
anything with
that
for reference this is my verifier in
Python so we have this thing called
scope and I'm probably going to want
something basically similar to
that and then each one of these I just
call them dicks and sets in Python but
in a strongly typed language they'd
actually be like a good strongly typed
thing
maybe we should read the code for split
and that'll help us
understand
two strength
wow
oh I can just do list. two string look
at this oh they've already done
basically what I wanted it's pretty nice
ni so we can get rid of this fold L crap
and we'll just
say oh and it's recursive oh that's nice
we can just do
that why doesn't that
work environment does not contain list.
twring why does it does this mean
protected
[Music]
why is this
protected that's what it means I
protected means I just can't use it like
uh as a r thing that's cool
oh yeah look at that high quality shit
we've removed all the
junk
now my Google search by image software
how do you know about
that Tuesday's your data structures Exum
what do they teach in data
structures
hey you know what is chewing on I bad
for
teeth oh
man it's bad for
you
do I have
anemia wow I got to stop chewing ice
don't chew
ice
all right guys from now on if you see me
chewing ice I won't do
it wow okay all right chewing ice
chewing ice gone no more ice
chewing it did seem it did seem like
they were talking about much more
serious ice chewers than
me
like it talked about how here we
go lur at the bottom of a tall hard to
but if you are addicted to ice You' be
chomping your way through a few bags of
ice
daily wow wait Sonic Ice they have
websites
to
[Music]
wait this is
incredible can you believe
this
wa no but
like why do you chew
ice
I need to get
vitamins yo apparently I here I've been
taking iron supplements did this guy
stop chewing ice when he started taking
iron
supplements I will leave here and go
over to McDonald and ask for a cup of
ice
no no this is like a serious
thing
all right guys we're done chewing ice
we've learned too much about it and we
have to stop we're going to change our
behavior and if you see me chewing ice
tell me
George you can't chew ice anymore and
we're going to text Alex she can go to
Right Aid and get
multivitamins
can you go get men
[Music]
multivitamin
at Right
Aid if you are still
out I
may have
serious health
problem as
diagnosed on
Twitch but don't worry it's only twitch
serious
serious there we
go ah all right don't uh don't eat ice
chewing ice is bad for
you I I regret I regret chewing ice
tortured by an ice cruncher
they chew during meeting yo if you're
chewing ice in the look no we're done
with this we're done with this we're
we're done with this guys we're done
chewing ice turns out I was wrong I
can't always be
right I messed up whatever you do don't
chew
ice Alex gave it a thumbs up we're going
to we're going to get a multivitamin
we're going to fix my anemia and we're
never going to chew ice
again wow wow we learned guys you know
you guys have really been with me on in
really pivotal moments of my life and
this was a pivotal moment of my life
this was the day I learned that I'm not
going to chew ice
anymore you guys with them snowflake
icons you're really you're really you're
really tempting my addiction right now I
just I just want to chew a piece of ice
I just I just you know
you know what I'm going to do I'm want
to start vaping instead what do you guys
think what do you guys think
vaping I'm kidding about the snowflakes
guys don't worry don't feel bad
especially if you're a
subscriber yeah oh we got some we got
some multivitamins coming and I have
some
iron could to fix that iron
deficiency whoa whoa whoa whoaa whoa
whoa whoa whoa no one's smoking crack
here don't smoke crack guys crack's not
fun funny chewing ice is not funny
either it's a serious problem I was
wrong I was wrong to trivialize ice
chewers don't chew ice don't do
it but vaping might be better and it
might be a similar sort of thing like
imagine just sitting here vaping yeah
that sounds pretty
good have I ever suffered from substance
abuse
what do you mean by
that I would say the answer to that is
no because
like suffered implies like there were
great negative consequences in my life
and I wouldn't say that's
[Music]
true
no though to be
fair the D just hasn't said anything yet
I think it's just because I'm a casual
ice chewer but I I see what
happens I'm not going to vape don't
worry guys I'm joking about vaping um no
but I understand what happens how people
progress from casual ice chewers to to
more serious ice chewers and I'm going
to nip that habit in the bud right now
that's
right we're not going to chew ice any
anymore we're going to we're going to
stop and ever since I've decided that
I'm going to stop chewing
ice it's hard to think about anything
else I don't know what it is as soon as
I realized chewing ice was an
addiction it's all I want to
do yo Leen is written in lean except
some of these are meta and I don't
really know what meta
means do they have a spec for this
language
anywhere
now Coke sucks guys
ice you want to know the quickest way to
never want to do cocaine again go into a
room of people who are coked up and then
ask yourself this
question are these people assholes and
then the answer is yes and then what's
going to take you a little bit longer to
get through is realizing that you act
like that
too right it's not it's not no but
that's not me but it is you and that's
right don't chew
[Music]
ice what's the point of not allowing
twitch vods for non Subs when everything
is available on
YouTube um no but like you can really
you can really see which drugs are bad
and which drugs aren't by like that
General test right like you go into a
room with people who've been smoking
weed and like yeah they're usually like
they're chill and they're like you know
down to like talk about stuff and think
about stuff I'm like yeah that's good um
you go into a room with people tripping
and you're like all right these people
are kind of crazy man and then you
realize that the craziness lives within
you you go into a room of people who've
been casually drinking you're like God
these are nice socialable people you go
into a room people been drinking too
much you're like wow wow these people
wow man um so you know drink casually
smoke weed and that's about
it do I smoke weed regularly not as much
as I used
to
um Meta Meta Theory language check it
out
anything overdoing is bad that's
right this looks like a
scam
N I don't know about this lean is good I
just wish it had more
documentation Aderall is not math um
Aderall is mixed amphetamine
salts so it's amphetamine it's not
methylated
okay
yeah and you know what they do they
patent the mix of those salts so they
can call it adero it's such a
scam oh yo remember the time we found
about that remember the time we found
out about that on the
stream the people who were like what was
it what was it that guy who's like I
shine IR LEDs into my head and I can
focus
better I chew ice I shouldn't be judging
anybody
hi everyone my name is
George I've been chewing ice now for
three years
now I know about
rust RS that I is that is that that's
not
rust oh yeah know this blog yeah
yeah
sounds kind of interesting guys we're
getting
distracted never mind it's
gone what's open
shift
wow I'm
boring the goal is with the
project you want to know what the goal
is all right we got first off we got to
meditate we got to meditate we're too
worked up we're distracted we're going
to meditate then we're going to focus
the goal of the project check out
backstage
all right we're going to think about how
to actually structure a proper
par we did our Lexing already it was
very
easy then we're going to meditate and
then we're going to structure
a okay pet space
here backspace AI is not a secure
website
oh yeah I mean it's HTTP oh my God
somebody's going to change
it wait you have to log me out
what last Basics too
wow so welcome back to the headspace
journey and today 20 I'm well done on
completing what almost another 10 days
of the
journey over the last nine days we've
been looking at the types of obstacles
that can arise when you do this type of
exercise and also at just how important
it is to include others in our
motivation not only because it it's a
good thing to do and it improves our
relationship but
also we're not ready to meditate
I'm sorry for getting
distracted not ready yet we not calm
yet
we're just not in the right head space
for
meditation
headst Pro worth
it I think
so no no no Chew in the ice do I ever
fear time I think there's a little Wayne
line about that from a technical point
of view what it does to the mind in so
much that it softens the mind and makes
it more pliable more flexible
essentially makes the exercise much
easier much more pleasant to
do just something to to bear in mind
before beginning today's exercise as you
have it a wiggle around around get
comfortable on the chair on the floor
wherever you
sat just
starting nice big deep breath in through
the
nose and out through the
mouth I just heard the ice maker it's a
trigger for me for my addiction to
I
I shouldn't think of myself as an I
should think of myself as a casual ice
user and with the next out breath that's
right just gently closing the
eyelids as you just start to experience
the weight of the body and just settle
in with those different physical
Sensations we're going to have to
meditate later there's a burger here I
think
is there a
Burger
multivitamins okay
Alex tell me everything I just we
learned something uh my ice chewing is
an addiction and it's bad for
me your teeth back your teeth and it's
also it's also reflective of uh anemia
oh you could be low and iron I could be
low in iron yeah well good thing I got
you the best so we got men multivitamins
right here thanks to Alex she's most
wonderful girl I
know Burg dressing thank you do I chew
it yeah I know gummy vitamin very clear
they don't even see what flavor it is
also guys we got to meditate later we
were meditating oh no I'm sorry I
interrupted no we're too
distracted Burger is too exciting it is
exciting I'm hungry excited yeah you
didn't eat all morning I know I was
fasting fasting oh were we yeah oh yeah
[Music]
Bros oh look at this
[Music]
burger the ice maker is
Che what I hear the ice maker I hear the
ice maker I just I want to chew ice you
know yeah want chew ice so
bad
interesting that they say it's an iron
deficiency because I think with iron in
it I don't think I have an actual iron
deficiency I think I'm only a casual ice
chewer but I found a form ice chewing.
comom where people talked about like the
best ice to chew how they go through
like a bag a day
yeah this
amazing oh
Burger Alex they want to see you
code I that like a special thing no they
want to see you Cod they want to see you
do the programming oh
okay you have to ask one those
challenges you'll have to ask her you
know what she has her own twitch Channel
I'm not going to say what it is don't
tell them about my channel I won't tell
them about your channel don't worry you
can change the name of your channel and
you can I'll host you you
meog yeah and then you can be a famous
twitch streamer
too I don't think I'm anywhere here as
entertaining principles of chemical
programming
I don't know about
this
see and this is always a problem when
you get into obscure programming
languages you get into obscure
programming languages that are just
obscure for the sake of being
obscure
yeah I don't like Coke or Pepsi I think
soda is mostly disgusting and just
sugar I don't know what
faster is the axis they compete
on
I mean I'm surprised at the lack of
um like documentation for
lean let's learn more about
it should I use lean the answer is not
yes
m
I wish GitHub could quickly tell you how
many lines of code something
is I don't want to hear about the bad
health effects of burgers that's that's
just vegan's propaganda man not going to
fall for
that how is you going to get
iron I just double
iron I never see you
ice I'm not I'm a casual ice chewer it
hasn't progressed to an addiction yet
I'm telling you where you end up is bags
a
day one of the more cheaper cheaper
habits I mean yeah if you're going to be
addicted to
something
we're going to write a
parer
we already wrote
alexir dog two string
here why
not
that
has be a neater way to write
that command
exp I shouldn't need all that there has
to be a need a way to write
that
MacBook 16 I was very excited and then I
saw it it was a little
large
um
function expected at
lexer
don't get it it seems
right I saw my Razor it's gone and by me
I mean
well you know my Razor was
sold
because it failed to use expected type
to elaborate
it I don't know if this is
right I did you a favor and sold your
laptop oh I didn't tell them that I was
waiting for you to tell them that I know
what you're doing
just set me up like
that I know
you pump
back they're doing it I don't get
it string do
to S string
here and that mean syntax is weird I
agree get rid of that
colon oh I just do I need a comma there
oh okay that's fine my good that makes
sense I forgot a comma well I wish lean
could give like you know useful error
messages that'd be
cool
oh I see the problem with the camera
yeah that's good
burger what are
youing we're
trying purple
yeah that was the first thing we like
that
need
okay now we need to write a parser we've
written a
lexer this is unused
junk
um that looks like a useful function now
we need to write a parser so
parsers
that's the same as
sasal can you shell coin no no no not
here no shell
coin wow I can't believe we failed at
meditating
today we're not relaxed the ice thing
has really unnerved me
casual habit that I've just
had all right we want to write a
parser um so let's write the type
signature for a
parser
parser it's going to take in a list
string and it's going to
return an object which we'll
Define
and it's also going to return a list
string but I don't think any of that's
actually I think that's a completely
wrong type
signature so first thing we have to do
is figure out how to define an
object
um like I remember remember this is what
we did in high school for
compilers Here We Go types as
objects constants A and B are of type
type oh well that's was explaining how
it was doing that other thing
before um and then are they inductive
types
python 2 is
dead but if you're asking the question
which one to
learn oh this looks just like a high
school
tutorial ah okay well at least I
understand
the that a bit
better I guess this syntax is only if I
want to use that's like the match
syntax so that makes
sense no I'm over insulting Python 3
Python 3 was a tragedy to humanity but
like you know sometimes you got to move
backwards in order to move forwards and
the absolutely stubborn python people
won't let us move forward with two so we
all just got to agree on three we were
strong armed but we got to just go with
it you know real recognize
real G tazy that was real nice of you
that was real nice of you thank you for
gifting those subs to those people I'm
sure they will appreciate it I'm sure
they're great people you know someone's
a great person if they have a star next
to their
name okay so this crab of app types blah
blah blah blah
blah structure and
Records structure command is essentially
a front
endu type and Link one Constructor is a
structure or
record
objects
yeah
yeah want to thank you for resubscribing
people who subscribed a long time we
really value a
lot about the economy you
think when it's going to crash
will it
crash should I not buy a house now I
don't know should I wait for crash is
everybody waiting for the
crash Twitches what do you think when's
the economy going to crash let's do a is
there
yeah it's called the stock work
no what do you mean and when will be a
crash Alex it's called the stock market
I know I know I'm talking about anywhere
else know what's it called the whole
stock market is a v on will the econ
right I understand how the stock they
fundamentally can't be a beted on
that no you can pick exactly when what
time
you we're done with tea we've had too
much tea today and if there's ice in the
tea it might tempt me to chew it
Valu of type Point are created using
Point really make yourself so vulnerable
for
tches what do you mean by
that ice
chewing I didn't know I didn't know it
was like smoking in the 50s
man
h
you have your
trash
uh yeah
s this sounds
pleasant
[Music]
not listening to
was if you're a
subscriber
too loud too loud too loud too loud it's
got to be
quieter
whoa what is this camping in
[Music]
[Music]
Alaska
[Music]
you
let's read the metamath
[Music]
hasal that's a weird
one
[Music]
right I mean all right this one is
written do they use a parser what's
their types
that is
par oh yeah oh Mega
par don't want to know I don't want to
know I don't want to
know
strings as
outputs go is D minus
[Music]
minus
n don't
[Music]
par
[Music]
[Music]
see like you see like these
statements so we're going to want like a
type called
statement I don't
understand
for
[Music]
he
[Music]
all
some
that's all the
statements
[Music]
depression isn't that just a
fancy
out
[Music]
okay I mean it seems like there's
actually different kinds of
[Music]
statements
[Music]
aspiring neat
absolutely I'm by the way very happy
with camp in
Alaska and yeah there's plenty of great
hasal
Partners uh
but yeah if you're in education
employment or training you should be
aspiring to get out of those things um
um
cuz I mean again it really is about how
you view it if you're in education and
you're like man you know college is mad
chill I get to learn all this cool stuff
I got these friends here like and you're
not like trying to do something with it
that's great by all means like don't
consider you're neat you're in education
but but you're a neat right because it's
like what what the government's trying
to say when they call people needs it's
like you know you're not on their track
you're not part of their
Society
um it's not what you did I don't know
what you did yeah but you really it's
Enlightenment it's Enlightenment like
like Buddhist you
know thinking the Buddha man like kind
like wandered around I like sat under
trees it just neat I wish that was that
cool like
don't I I love this I love this
sentiment
I just want to kickflip into the sunset
and
disappear sounds
nice why can't I be snowing yo I'm
excited it's
[Music]
cold
[Music]
this isn't exactly
right
[Music]
Feel Again iar Feel
Again
[Music]
[Music]
way
not
me not
you not
me
[Music]
me let's see what do I have do constant
statement variable statement loading
statement
Al
great
I don't see the relationship between
those
not
what
they
I know how to write this I
think um I don't know if something can
return two
things
when
wait is that a real Rob Pike
quote
that's an awesome Rob Pike
[Laughter]
quote all right my respect for Rob
Pike's gone up even more that's an
awesome
quote
[Music]
who was written in rust or hasco like
they have to
fire probably 2/3 of their software
Engineers let's see what the Hacker
News
[Music]
yeah
wow
this is so
smart I've I've gained a lot of respect
for go they mini value in go pretty
happy with
it
all right now let's see if we can write
a
parser all right so we have a list
string and this is the syntax in hasle
for
that we want to consume until we get to
a
[Music]
terminal
h
we have to keep around this idea of of a
stack you
know
structur a parser as a function takes in
an
input stream of characters yelds a
Parry
yeah so we
can it's parser here is that a
type
for
for
oh lean parser combinators ah someone's
done this interesting good
find yeah that's pretty
nice
meta Mutual death
wow
huh the
tactic
it's very
cool do look very finished
but
something run parser
what's up with all this metad shit what
does it
mean how are they defining their
types
tactic this is how you use their
Library
and they have chain
L1 parse
term par
adop forsing lists into trees
okay so I get what they're saying
here
first we Define this
item fails
otherwise reflects the
monatic nature of parsers great
right import tactic is this a real
thing cock calls them
tactics I don't really know if that's
right
right where do they keep
around
well
okay I mean I guess we can build it
slowly um
so this type thing is
overrated can I do that or does it need
one might not even need
one um we're going to get rid of that
because that's implied in
the type of
thing if we we have
now say something
like colon colon
a return uh
you
know
consumer I think that's that's that's
right right did I get that
wrong I can do a comma
here no no no that's not right cuz I
want to do the rest of the list so that
we'll do
um constant
well constant statement and then this is
in the structures
one found a better
one
I don't really understand this I think
we'll get there but this is good stuff
to read once I try to do this and then
like see why they did it the way they
did um
they like explicit was the
Constructor constant
statement con
consumer
for
like this is why you need a
monad doesn't make
sense
can't call this
out call in here
unknown
identifier consumer yeah that's
okay no
like
we need something that says like
consume
until here it's something like
this you know
can I not do
that I feel like I should be able to
so okay let's just keep it simple right
now what if I just did
that it's obviously wrong
but no doesn't
work
oh
what I don't know what this dot. p
is we can try something like defining
this as like make constant
statement say make constant
statement
L
what but I defined it up there I don't
get
it
do with that
later function expected at constant
statement has class
type get
it type expected l term has typ list
string cons has typ list
string
defp oh
expected type is known but it's not a
structure
statement yeah okay I don't think this
stuff's
right let's see how the other guys did
it
parser start pars
result
yeah I know and go read that
tutorial and tell me if you think you
understand
it
like generic type
type The
Eliminator
preface structure name can be omitted
whenever
the
ah I
mean
no you see what I'm trying to do here
like there's a common construct in
languages I want like
generics
inheritance oh and then to find an
object
using objects of the parents
structures
wait nicker you've contributed no value
you're
baned
no value
banned
see the
problem all right I
mean maybe the problem is this
actually
oh wait so first off I forgot that that
might actually fix
it
it does not but there was
hope all right we really need like like
a union
type
pattern
matching recursive
definitions well founded recursive
definitions
dependent pattern matching accessible
terms magic exercise oh that's
interesting inductive
types enumerated
types see I need like a generic generic
type of any of the
statements you know how does has let you
do
this uh that nanop Parc tutorial showed
it
right
no that
no
this how do I do
that how do I do that and
lean
those are types
right
oh
okay I think actually maybe we can do
that as an
inductive
[Music]
right we might be able to do this okay
I
say beer
props
this is really fancy stuff I don't know
man um all right so what if instead of
making this a
structure I say
inductive
statement then I have things
like
constant
statement colon list
string
statement is that
right command
expected what like the
simple inductive types
weekday
type have to extend
something a
type
maybe Le line
comments def some good ones in here we
just
look and then here we'll just type the
statement statement
now identifier but that's a
type shouldn't that be a
Constructor
maybe statement
dot seems better not going to need
statement not going to need this if
that's the
synx now we
are
what if I just made the parser this this
string
do that
work
interesting
um r
p
parser think I need to define a two
string on
it
all right let's look up how the list two
string
works I'm sorry you can't see right
there know move it over a little
bit let's just string
[Music]
there string in the list is the more
interesting one actually I I already
know how to do
this
def the only question is like how I put
it in the name
space
I can say
names actually better I can just say
statement on two
string no I
can't sorry I need to move it
here no um is it m name space or
something and list okay name space
statement and
statement def two
string uh we want to go from a statement
to a
string we want to match it with constant
statement
l that we want to return l. to
string colon plus plus L2
string that needs the equal sign there
that's
there okay uh invalid field
notation
term
see the
problem the parser seems to return it
okay
just in casee something's broken
there doesn't look like it ill formed
[Music]
match expression
equation type is not of the form C where
C is a
constant
like parents
what
but
yeah isn't that the same exact thing as
this when you match with successor n and
you extract out
n type is not of the form C dot dot L
has Type
oh is this just because of
this this do two string down
there what I ignore the L start with
just that invalid application function
expected but I don't understand because
the exact same is when you do that thing
with
the isn't it the same as
this I spelled it right that matches
that
that's how statement was con
oh okay
fine fine stupid syntax doesn't go in it
does has have it in a global name space
or is it the same as
that
we got keyboard
in got keyboard people what are we
trying to do today we're trying to write
a metamath verifier and
lean we we we we'll change it to we'll
change it back lean
metamath
verifier see and then like after we get
a parser in here we can start thinking
about how like much of lean proof cheing
functionality we want to
use
um we're just going to change this to
list that
perfect we're first trying to write a
parser combinator all right look so now
I parsed all of that which isn't really
true okay now let's go back to writing
our
parser
um see if that works at
all
call in
there
uh valid composite
expression looks like we're just doing
PRS and it's colon colon
so if it's a constant it starts with
this we're writing a parser by hand I
don't know there's no real there's not
really good libraries for lean does that
work okay non-exhaustive match okay okay
that's
fine
um really because we want this to
return parser should return a list of
statements not just a single statement
do
that and then we can say
this
this it's still not exhaustive because
of this which you can say
that oh I'm missing this case as well
now it's exhaustive except that case has
to go underneath that
case
perfect okay so statement to
string this is where we really want to
say instead list. to string but it's not
going to be happy because we have to
make this actually in the name space of
statement
Nam space statement end
statement is that right why doesn't this
work
um has two string statement okay let's
find has two string and let's look at
what it
is
I'm coding it in lean
Mexican um
has two strings is really what I want to
read is there like a lean standard
Library index anywhere on the Internet
is there really not one of
these
has two string that should be
okay actually maybe I don't even need
that in name space
that's the same problem
[Music]
um has two string
statement I
mean I I guess I don't understand what
is this
saying
lean
Define two
string I
guess really what you want to look at is
like this right
I don't know what this syntax
is
prop blah blah blah
blah instance has two
string oh do I just have to I think I
get
it has two Str string
statement just
need Lambda
C statement. two
string has
Type
statement
what
has two string oh I think I could just
can I just do
this no I can't do that what is it doing
differently okay so what if instead I
just what if I just copy this oh wait
was those not were those weird
brackets oh those are weird brackets I
see statement to string
you
CS see if that
works sweet check out that second print
down
there remove Lambda well yeah I
shouldn't need a Lambda at all right I
mean maybe if I just do this I don't
know what those things
do what what are the what are the
greater than and less than mean oops not
that yeah
buddy it's good
progress
all right
um don't think we need the lexer to
print anymore I think from now on we can
just print the
parser if you don't know what Lexing and
parsing are look it up if I got the
definition wrong tell me in uh in chat
okay now unfortunately see this is
parsing wrong because the constant
statement should stop at this and right
now it's just taking up everything
so yeah that's
great
um font size too small can make bigger
here so this is parsing wrong because as
you can see over
here build Twitch coock metamap
almost
parse I put three e on parse just cuz I
can what kind of parser is this it's not
really a kind of parser I don't really
know about parsers so we're just kind of
writing code and seeing what
happens and then we'll figure out what
kind of parser it is I mean it might
help if we learn something about parsers
first but we're really just learning
like what the type systems look like the
parser itself is kind of irrelevant but
actually you know what it might be time
it might be time to to
uh to start uh start learning about uh
what kind of partial things are because
we're to the point now where we need to
understand
um I think it's time to
meditate it could be time to meditate no
I think it's time to read about
parsers
this is I think actually extremely easy
stuff though to
parse um LL
parsers left to
right the ability to Peak on the next
k
um
the question is kind of like where do we
keep around the context
let's see if we can understand a pars or
combinator and somebody wrote one of
these recursive descent parser love
it
oh
yeah I think this is what we want to
write for each procedure implements one
of the non terminals of the
grammar predictive parsing is only
possible for the class of L grammars or
the Contex free grammars
yeah which production to use by
examining
oh contain left recursion yeah we don't
have any left recursion
which production rule to use we always
know the production rule I
believe
um oh that guy that guy I don't even
know why he exists he should just be
banned he should just be
banned is it one person or is it
multiple people see that's that's that's
one of the great Mysteries of the
internet is it one person are all the
trolls really just one person is
possible
okay let's try something I'm not again
I'm not really sure what kind of parser
I'm writing can you define Heap well you
start with a mound and you add a few
more and then it's a heap all right
um list
string let's return list string cross L
[Music]
string that's
right not the right type
signature um okay let's look up
recursive descent parser hasal no
understand how to build
it wow this does not look
easy
expression
token okay okay okay okay okay here's an
idea
no
okay so for reference it's going to look
something like
this
let me share a few more types first of
all looing
statement Cod
R oh we have name
type code
VAR
um Central
[Music]
statement back to the
grammar uh
name type code math
symbol
axum
statement we have name type code and
list and then finally we have provable
statement which is name type code list
list
uh now let's just write out
quick floating
statement say name type
code
variable
[Music]
rar
loading statement
name type
code
VAR what is monad I really don't know I
don't know if anybody
knows name typ code Ms list. string MS
maxium
statement name type code Ms that's true
and then provable
statement is name type code Ms
proof change that here we should have
put music on for this this was long and
boring change this here to axium
statement we'll change this here to Pro
statement and we change that this and
then we don't really need to the proof
I'm happy with
that we should PR the proof just for
completeness
list okay none of that should have
broken my
thing
nothing brok good now we actually have
to parse this
stuff have eight years of has experience
I still don't know what is Monet I know
I know I've written so much in Haskell
and I have no idea I haven't ritten that
much it's been a long time but
still
um okay so fundamentally we need a
parser to
consume like I'd like to think
eventually called fold
L right so let's actually not call this
parer what I really want to do is
like it's a
function from you know L lists
string to a list statement and I want to
produce it
with is it fold
out I think it is fold which was the
thing I was looking at before that was
fold
out like the list
printer here we
go
hold
on so I want a function that takes
in that's not exactly right
either
there have to be clever ways to write
this
what real world projects are made with
what hle x
monad xmet is a great
uh yeah no I don't like this one
either there's another one someone
posted
parer
what what time's coming tomorrow
okay
yeah
combinators combines two parsers into
one this doesn't explain what a pars or
combinator
is does
this this sounds like the kind of thing
I should
learn
before I will try to write one and then
over the week I'll learn what parses
are simple think of par function okay I
mean yeah that is the high level parser
that's
right
okay now if I could write a
function that took in a list and
returned a
statement cross a
list I'd now know what to
write all
right l
parer
how do I deal with the the cross in
practice oh it's the
comma why is that
complaining oh in a little
parser you should be
done uh we just going to return a
statement I
guess I have another one here called
parser
okay and now for parser what we want to
do is
say this can just be a function
now
which is
just
what rule parser
L
Plus+ okay
let M comma
n little parser l and then we want to
return
uh M plus
plus parser
n or colon colon if it's a
list how do I call something that
returns a cross
cross
um
so can I actually like first and
stuff or actually can I do
this
non-exhaustive
match
why cross
never gonna
[Music]
work did anyone write the data types
chapter
things that are cross
type you know what I have an idea wonder
if I can actually say if you created
your account today you can't join my
channel
um let's
see users in
chat collapse chat chat
settings followers
only for a day
perfect love when you can fix stuff one
click I think that's appropriate you
have to have followed me for day if you
want to
talk that's right
okay this still isn't answering my
question of the
Cross like little Parks return statement
cross list
string
n option RB Tre
sum like it's not any of these because
they're all too
simple oh one and
two and I can use that Syntax for it but
I can also use one
and2
I don't understand the case that I'm
missing I don't care if it's
nil
oh I think though I want to do
that
no yeah yeah solve some proofs
man the following are missing list
nil but that's not that's a
return I'm actually returning
that
[Music]
um I mean I guess I
could all right if they'd rather I write
it like this I
will
I don't know if it
matters but we could just do
this say
l equals little parer L do
that it's still
complaining wasn't
that it's crazy how different that langu
that syntax
is okay is my let what's messing me
up the only way to really learn this
language is to just read some of this
code um ifs no here we go
l oh let in
[Music]
ah oh oh okay we're getting closer now
the only problem is we can't Define
things
recursively we need a special type for
that at least you do in
cock
what if I just say
meta yo what if I just throw a meta in
front of
that no what why is this
here
meta did not
fix function expected at parser term has
Type lifts
statement
what but you see the problem who sees
problem we got to fix we got to figure
out how to do recursive
function I don't know how to
do some Lemma
shit these things should be like no next
preve no it's not going to be any of
those um if you find like finded stuff
they should probably do
it
here how come Maps allowed to be
recursive because they do simp I can put
simp definition parser uses
sorry hate when it uses
sorry
no no no no this is crap no this doesn't
make sense there's some other problem
here because look join uses
it I notif fire parser but I defined it
right
there you can't do recursion without
meta if it's true that I can't do
recursion without
meta how come there's no meta
here missing some
imports oh I need proof of termination
I
see yeah um if I write meta does it fix
it I understand why I need proof
of function expected pars or term has
typelist
statement this I don't
follow no I I totally understand why I
need
[Music]
a a proof of termination okay I mean
actually I should be able to then we'll
write it the other way and I think
that'll fix
it um if we write it such that if we
have a
list like this and we talk about
that
um
it still doesn't prove termination
H this
does like there's no guarantee basically
what I would have to prove is that
this is less than
that which shouldn't be too hard
but maybe this isn't the right way to
write it um the Partiers okay okay okay
okay let's think back to how
to let's all right let's get rid of
little
parser let's go back to just
parser we go back to list
here um
list bar
eror okay things are back to
working is there an error in the
statement to string function we can
look uh non oh because I added a new
type
statement. parse error equals parse
error good
point Thank you make mate ninja good
catch all right um
[Music]
so the problem right now is that this is
consuming
uh unlimited
stuff
so I think now we want to say consume
until uh list string string
list
uh
string list
string uh and it
returns list string cross list
string actually can I mix this
can I say s string and then
colon can I do that seems like I can I
don't know why that's
complaining it's an
X okay so we want to
consume someday we're going to get to s
colon colon
L and that's when we want to
Output consume no we want to Output um
all we've accumulated so far all right
these are like the cute things that are
like annoying to write
um
see what I'm trying to
do I'm going to consume until we get to
string
s um if we don't get to string
s well at that
point at that point we can return yeah I
know we can return now this comma
L now if we're not at string
s um if we reach the end we're going to
return
that or if we're left
with if we get something
else that isn't
S we want to
say um
let a
a
consume
until l
in this is going to
be
a plus plus
plus or a colon
colon
consume
until
now a A.1 a
A2 yeah that's
right uh that equation's not been used
because for some reason s isn't
bound
whatever
can't be a
name
induction tactic
failed I don't understand why this seems
right to
me
if it it can't prove termination what if
list is infinite no there's no fuck no
such thing as a list an infinite
list
oh this is if I put meta here does that
fix
it swish how do you know about
this consume until uses
sorry well I don't think Sorry's very
good either but
um let a a
equals consume
until
in yeah infinite
list infinite list did meta fix
it consume until uses
sorry valid let
declaration
ow someone killed my par I don't need
that
need
okay fine fine fine fine fine fine we
have to make
the use Naturals for
induction look up many
combinator look up many combinator from
the gist
okay that's seems like it might
work uh lean parser combination
like second
link
many
no
no no I don't want to do that
no I know I've done this hack
before
no that's so
annoying oh input size
oh wait okay how are they doing
this
okay
fine wait but I how can I cross more
things wait is that is there a list F I
might be able to do this but just
find o h what's this
partition oh no way no way I think this
is already what I
want see how come they can do it with
that
though oh no that's not exactly what I
want it's almost what I
want also oh wait are they using how
does that work for them
no but look look look they're they're
they're doing the same
crap
how come this is
okay what if I had at
simp how come length
works cuz wait wait no I can't believe
no no no no no no no no no no you're
trolling me with this infinite list shit
you're trolling me because otherwise
this wouldn't
work right I have no
idea no no this isn't
no because I can write this
that compiles
okay is it only because I'm outputting a
n
it seems okay to me
too no do without nap
there could I do
this hey that works okay
too the termination Checker will accept
inductive
types induction tactic failed can only
eliminate into prop
or DC
cases is it this one causing the
problem wait
what now it's
okay
all right let's just run
that that's okay and that one breaks
it okay can I use an if
statement not proven shit via induction
okay
if then
house there equals equals a
problem R new
parand
No it should be a string
right um no there's got to be a I don't
know how to do string
comparison
KY
Ross thanks for subbing
nudex
um no wait this isn't right I want to do
string comparison can I do
that
I don't think
so um yeah if someone gives swish a
subscription that would be great
um no pin for lists is it's say
polymorphic
right why is this
wrong throw together a quick pred
good oh okay we just did
it guy Ross thank you for for gifting
who just got it to work no induction on
that bullshit I don't know why that one
worked but you know hey that's what you
get when compilers start doing search
but who else is excited that compilers
have started doing search so that's just
really
exciting it's a wonderful
thing maybe Alex is very excited about
this you update magos for this what do
you mean was a red
badge um
yeah all right all right all right now I
I really don't want to write that there
has to be a better
way and really
also
doesn't
work
um there has to be a way to
compare how do I do equal in this
thing has
LT how come I can do less
than has
EQ
type that
using not equal all right you know what
can I do that what if I say a is not
equal to that does that
work do
EQ can only do not equal well it doesn't
matter I can flip the closet
around I I don't know I don't know how
come you can do not equal and not equal
does that still work perfect um now I
can probably even put let's put s string
back
here thr that there wait
what um
oh yeah and now we can do consume until
that
L
perfect let
const comma
rest statement. statement
con oh yes yes
yes yes this is
working now plus
plus
wait
Plus+ parser L parser
rest oh but no no
oh
um have I tried single equals no I
haven't maybe that works interesting I
think it is single
equals oh I guess single equals isn't
used for anything else oh yeah cool
um all right now we're back to this crap
again despite it so obviously getting
shorter
back to this
again
H all right well that's parsing well now
let's see if we can parse two
statements
like size
of using well founded keyword in the end
of your
definition you losing well
founded
meta
oh that's
better no
oh can't use
m i mean I don't really understand
because it does
seem like are infinite lists actually a
problem all right you know what maybe
this is similar to what failed up
there what if I do
this that works okay okay that's really
interesting so now I'll just do match
a
with
see oh that breaks
it I remember it was always broken no
never mind it was always
broken
is it not obvious that
oh
okay so the
problem the problem is that
H it doesn't know that consume un
until always returns something
smaller what if I did
that if that
runs we might have to write a proof
about consume until
never
mind would like to work with me in 3
years bro I don't even know what I'm
having for breakfast
tomorrow in 3 years I want to be a boat
guy I'm going to go live on a
boat it was only a warning for some
reason it's still Grand I don't know I'm
going to live on a
boat drop out and start a band do
it now I have some LTE on my boat I need
the internet I love the
internet starlink no I'm waiting for the
Tech to get a little bit better and then
I think boat Tech's going to be really
really good and then you know what I'm
going to live on my boat and I'm going
to declare myself sovereign country and
I'm going to sail from port to port as a
sovereign
country I'll fly on one of those flags
of convenience I'll fly under like the
you know the the the Haitian flag or
like
Micronesia or or one of those one of
those countries where I can like pay
them a bit of money and be like you know
what man yeah you can put your flag on
our vat and I don't care if you go
around calling yourself Sovereign cuz
then I'm a sovereign
country oh yeah we're going to have
gambling we're going to have drinking
we're going to have drugs we're going to
have everything on this boat that's
right because we're a country and we can
make our own laws and we still can't
kill people cuz murder is wrong but
other than that you know and like yeah
everything nothing no violence on my
boat no no violence that's you got to
draw a line somewhere um but you're
allowed to you know offend people on the
boat that's all fine no no no no no no
whoa whoa whoa that's not fine that's
violent that's not
fine no no no nothing violent but if you
want to if you want to everything
everything you know about about
everything you want to have guns on the
boat that's cool definitely we're going
to need guns on our boat to defend the
boat from
Pirates and and if if okay all right
look look look look look look look if
we're violent to other boats that's okay
cuz we're a sovereign
country um but you know we should obey
the Geneva Convention we shouldn't like
you know use chemical weapons on the
other boats we got to we got to draw a
line somewhere that's that's that's all
that's all I'm saying that's all I was
saying but yeah sovereign country boat
oh no shit but starling's going to take
away my
internet got to have our own
internet I don't know man I sometime I
get hyped on the boat I idea and then I
remember that you can't do it because
the Navy will come get you we got to be
ready to fight the Navy I think the
Navy's pretty good
yeah yeah man you know every time I
think overthrowing the government I
remember how powerful the government is
that's right NASA is practically a
defunct
organization if I go to space they can't
send their aircraft carriers into space
but there's no internet in
space I don't know we have things to
focus on that aren't
this the real
question is why this isn't
allowed okay all right all right let's
fine fine fine fine we're going to look
at how we did
many we're going to look at how we did
many we're going to we're going to use
the the inductive iterator I've seen
this
before it just can't it can't you can
prove it but it can't prove it
automatically wait why is that a
Lambda
um I don't really know why that's a
Lambda and why that's a comma I don't
know what any of that
means this
mean is the comma the same thing as a
cross
for
wait we okay fine zero is a par
error and
then this I'm just going to say n comma
this and comma
this now Plus+
parser n minus
one
comma what no I what do you
mean
now I don't understand why this doesn't
work parser n minus
one
PR
fail to prove is well
founded I don't get it I wrote literally
the thing they want
oh you
know can you prove it if I do
[Music]
this okay never
mind
reps oh plus one plus
one no
what okay is cross not what I want
[Music]
here
[Music]
core
reps what does the comma
mean okay all right all right simpler we
got to think simpler this is too complex
for stupid
bullshit
match
a
with de that one
[Music]
later okay okay
okay
even
simpler here equals
failure
um
Lambda um
no don't want to say match a with just
that's just a
function
okay I know I understand
um do XP no I don't do XP I want well I
guess I could
say um
Lambda X comma match x
with yeah now
parser core
n
rest are we getting
somewhere invalid match expression and
expression expected
and
as type list string becomes list
statement but is expected to have type
list statement and that's because I just
have to move around these
parentheses to be like
that that
parentheses I know it's very similar to
hll and I think now it parses and ends
with a parse error oh okay let's
go
oh look at that we're parsing two
statements
now and Chad is dead you know what well
all right we can are people going to
behave if I put this
back we'll try but if we get any more
misbehaven move a window right I'll move
it over there I can't move it
right well I guess maybe I
can don't really need these
anymore good progress good progress guys
good
progress that
better
all right and now we're parsing into
those things let's not do list two
string let's do uh l. fold
L
um Lambda R comma
s RS comma
r++
plus that just say
this is that what I had
before pfold
L sufficient number of arguments you're
also need to pass in a base
string why is that a
problem type statement let's expect it
to have type
string
to
string here we
go
um
that fix
the it does
not
all right so now we're parsing a
constant statement and a variable
statement now I have to just parse the
other statements but I think this
basically
works if this idea basically Works um
all right for a floating statement it's
even easier we just
consume oh well we can it's name
floating statement type
code and then VAR and then
L and then we say here by the way we
don't actually have to do this this
doesn't have to be plus plus we can just
change these change these to colon
colums now floating statement is the
next one so par
right
yeah like in some ways this is so much
more beautiful to write than
uh uh name tyo
bar this is so much more beautiful to
write than the python version uh colon
colon parore
n par
core n
l do we par fling statements
now oh yeah now we're making good
progress this is fast progress
now
um okay let's par the axium
statement uh so for an axium statement
we just have a name an
axium A type code and we're going to
have a string so I can't put that
there
uh let X comma
rest
consume
[Music]
until
that
in uh and here we'll just
write statement.
X
statement AUM
statement
name type code
noar name type
code
X
and
um
let
PC
par
in now we can just change this we that
code
everywhere
perfect parsing an axium statement oh
man this is a beautiful parser you guys
like that's the thing about functional
programming it takes you
forever to uh oh this is a nice chair
you guys it takes you forever to to get
things
uh correct but once you do oh the code
just
flows
um why is that complaining
there don't understand oh I have to get
a proof as
well um
in
let y rest
to consume
until
this
rest
in
there we go
perfect oh that's so
beautiful this
is look at this look at this beauty we
don't even need oh this is just junk Cod
we don't need this
anymore that's so so I'm so I'm so happy
with that
are you usually abused in channels bro I
kind of think that you're
trolling I kind of I kind of don't
believe you and it sucks but on the
internet you can't give people the
benefit of the
doubt we don't talk about Security on
this channel we talk about math sometime
we get people in like swish who know
things about functional programming and
we're happy we have good
conversations time sometimes I learn
stuff from people you know and these are
the good conversations that we
have please don't hate
me and get abused you watch some wall
streams yeah I mean some people are
toxic man this is non this channel is a
safe space for everybody who I
like and if I don't like you it's not a
safe space for you but if I like you
it's a safe space for you that's nice
there's a word for that it's called
dictatorship and it's going to be the
government of system system of
government on my boat that's right and
that's just how most boats run but I'm
not going to be supreme leader or
anything I'll just be Captain I'll be
happy with that man maybe I'll promote
myself to Admiral one day um and then
I'll probably end up in a tragic boating
accident due to my overconfidence but
hey you know at least I'm
self-aware the last dread pirate didn't
end up so well sucks man you know what I
will say that I will say that cuz that's
not even political man free Ross Alber
that's right free Ross Alber man I don't
even know that much about him but I
don't think you really got anyone killed
if nobody died and it was just some
bullshit free Ross
Al yeah free definitely free scy
definitely
definitely that was that was some
politically motivated prosecution what's
going on you
gummy vitamin yeah have one y one time
okay it's for men's no Alex I'll tell
you a story one time that's in Chicago
and you know we we've been like going
out and like we weren't like eating well
so we found some vitamins and we're like
bro we should really like they have some
vitamins so each ate like four and then
we threw
up you can't just eat four vitamins turn
out not an empty stomach yeah we like
bro we need even get dinner tonight
going out let's just eat vitamins man my
life used to be cool guys I used to have
a cool life I'm telling you know I'm
telling
twit no talking about
school functional programming is
beautiful like math yeah very
beautiful go to gy want to go to G
we we can't no that's much oh arms arms
maybe arms I do like
arms no no no leave your shirt on oh y s
Diego now I like walking around with the
shirt off it's true is this the safe
space I told them that my channel is a
safe space for anybody who I like that's
your
life yeah I a who I live I mean most
people operate like that I think it's
good look I wrote a par it's
beautiful you know how much python code
this was it's really nice like this is
just one part of the Python code like
this
is the one that I used for python look
at how terrible it looks compared to
that I guess this is way less
readable we programmed a metamath parser
in lean that's what we did so far what's
next well we're going to make it verify
metamath it might actually be really
easy but doing anything lean is really
hard because every time you search for
lean you don't get anything about the
programming language and so lean has a
hello world example you like hello world
yeah yeah well their hello world example
on the website is
broken who runs lean who started lean
where did it come from
Microsoft research wait really yeah know
the guy's really cool I know that um I I
met him he he was showing it to me he
show he showed me lean like before
showed you lean showed me lean and he's
and you know he's talking I'm talking
about computer proofs and I'm like oh
computer proofs are cool like can you
prove that there's an infinite number of
primes mhm
um and then
like he's like actually yeah I'll show
you here I'll bring the file off and it
was like 100 lines long it was really
nice the lean yeah you show me
lean um coolest programming and
Nutritional Health stream I've see you
giv Health advice we'll talk about
jailbreaks here
um no just just lifestyle advice just
don't eat ice man it turns out it's bad
for you like ice ice chewing is is a
problem what was it ice chewing. comom
is it a forum I can hang out on yeah no
it's it's you you'll appreciate it what
was it
ice yeah ice
chewing. no and like it's it's not HTP
it's like yeah
like
recipes favorite ice I could talk about
my favorite ice forever I'm curious
everyone little crunchy one the little
soft ones you get out of those machines
I can't this is like th inspiration for
ice so good and it kind of gets like a
hard thing in your my favorite ice is
bagged ice from this is a real thing
this is like the wizard chant of ice
check I eat Argo starch and baby powder
with mine it's weird but it's good no
like all right all right all right this
is one of those websites I'm so happy I
found this side I thought I was the only
ice freak out there no no but this is
one of these sites where it's like like
how much what percent of trolls is this
no I think it's
real I
also no no that Randy's not real this
guy is not
real guys do you remember how cool the
internet used to
be man
[Music]
amazing5 lead
leave the people on their ice
alone no no no no no some of these
people I'm talking about can you find it
it's like um like a really dense ice I
like the Frosted ice I like the Frosted
ice I don't like like the really solid
ice it's got to have some like air
bubbles in it what I'm talking about it
kind of looks like pellets like
something you imagine a Crunch bar
consistency but ice like a crunch box
yeah that's what I'm talking about it's
a certain type of ice and wait wa wait
wait guys like nuggets guys are there
any FDA rules against me selling ice for
human
consumption long ice I bought a 10B bag
of ice once not for chewing for what
well I just like stuff and like you know
keeping things cold right and I was
that's what people buy for yeah it was a
normal
reason
yo we could be the next I Carly we
watched I Carly last time don't tell
people why not we want we wanted to know
if I Carly was real her popularity was
real um no Lil Lil uh little pumps
always he's like yo where the party at
yo where I Carly at right like so we
wanted to see what was
up wow where is Miranda Cosgrove now
yeah let's we want to know well this is
where Sam is
now she looks about the same she looks
the same yeah yeah was she in Despicable
Me too
apparently she was in Malcolm in the
Middle what how did you not know that
wait what who was she I'm in the middle
go to
IMDb I don't know she was on for two
seasons two years epodes a guess Sor I
saw 2003 2005 yeah she like came back
for one of them wait so when did I Carly
run
oh how's jiby
looking jibby jiby got married I told
you yeah we shouldn't stalk
jiby I love jiby we don't don't stalk
jiby on the
channeli ji ji's a girl who wants her
privacy so
fucking cuz attacking is 97% M 97% dud
we've talked about this wait jibby G and
Emily r jakowski Wait what no I think
that's a different jiy used to watch I
Carly and Nickelodeon yeah that's c i
Carly were talking about yeah I think
people liked that yeah yeah I'll let you
get back to programming I'm I think this
is mine no mine's over there yeah you
too no this this yours but wait is this
yours over here
then one here I don't know who jiby is
okay thought they were talking about
jiby from ASR no no no there's some yeah
I know well that was part of the jiby
but jiby on um what there also a jiby
owski wait wait jibi on what I don't
even know
wait wait she was Emily RI was on I
Carly oh she's so hot
yeah
wait that's what she used to look like
no she still looks good there she's a
bad bad frame grab screen grab well but
she got so much more attractive from
from CU she's hot yeah I yeah I guess I
know
man also I think they just dressed
everyone terribly on the show wait I en
R raage jibby what was the top watched I
Carly I say save your life wow I car 11
million
viewers we got to do it yeah we got to
do
it see someone says puberty tends to
make people more attractive but Miranda
cos
wait what's happening right now I Carly
peak in no no no no no why is I Carly
making a
comeback this is week before we this
Singularity is real okay wait can we
find
out no we don't know it doesn't say why
why why did we think about I Carly you
just kept saying her name over and over
again from the little pump
song look she's making a comeback man I
know what do you thinking what do you
think it's does anyone
know this is us only Trends yeah wow but
like you know what if you're on a TV
show you just got to be checking them
Trends man why because you know when the
season's
over everyone already knows when the
season's over that's right sexual
tensions over third season yeah yeah
yeah
lost
whoa wow they actually managed to keep
it
up first season second season third
season fourth season Fifth Season sixth
season sixth season was is Major yeah
everyone talked about the loss finale
despite it's
sucking oh when we were talking about
what category Theory can predict
recessions I don't think so what do you
mean no when there's an uptick and
category Theory oh the world's becoming
too much bullshit okay and then yeah the
K category theory predicts recessions
not in the way that people would think
who use category Theory but in the meta
way maybe maybe it's meta category like
meta um things you can learn from like
it's meta category Theory yo we're just
like I Carly you
know I know I know we'll go back to
programming wow the Lost died
heart the end so reality TV I think they
do actually I don't think they
understand the programming yet some guy
was saying some of them understand the
programming I don't know
Nick loading is going to be on Netflix
oh I I own Nick Hits on
Amazon I'm G watch more Avatar you watch
more Avatar yeah so good yeah so we
going to do now yeah I think so yeah I
wanted a fitness you go Fitness okay
yeah but you know I can't go without you
you can have my key you can go fit you
can't Fitness without you you know that
I'll just come back just go up and come
back all I would do is arms okay would
do arms go all the way up there yeah
you're done hot watch footb drink light
that's a great idea too yeah I like that
also okay I don't know maybe I am done
programming for the day let's see let's
see how my viewership is doing let's
check my Trends on Twitch oh and I can't
show them there's multiple avatars do I
need to know about that no no no well
let's see how my the last air bender
yeah yeah she's watching last air bender
I bought it cuz I wanted to watch the
rest of
[Music]
Kora I have so many questions which I've
now done wait no no no but
where CH Creator dashboard which episode
you want they're going to ruin it for
you wait why would they do that Prince
Zuko is
ang what no it's not true it's not
true let's see oh yeah yeah where where
where in the we're in the you already PE
we're in the dying season of this
stream
wow you're showing them
the you're so
transparent George hates chat that's not
true is a Drake No I don't hate chat I
know all right it's all over pack it up
boys uh pack it up uh stream's over um
did you have anything else for the
streamers I was working I was going to
try to you know prove some metat stuffs
oh you you were yeah yeah how long does
that take three more
hours um yeah F no I don't know I I
think we wrote a parser that's pretty
good parser I'm pretty happy with that
we wrote a parser all right all right
guys
um I think I think that's a stream for
today five hour is pretty healthy you
got a stream for
today hot girl ruined our twitch
chat like George please don't hate me
you can hate your other viewers I don't
hate you I hate you even less if you're
a subscriber wait demo the parser I
check oh wait wait wait no no no no no
there is one more thing we have to do
okay we have to finish the parser I'm
going to finish the parser because it's
got to parse complex things like 2 plus
two um will it parse
Miu let's see if it'll parse other
stuff twitch stream is like a
clubhouse okay we got pars era here
all because of these
craps I don't even know what we're going
to do about
that I don't even know how we're going
to deal with
scope I've got
nothing all right we got we got we got
programming
just going to skip them for
now um no no no no we can handle scope
correctly
uh okay so we
wanna going to handle scope
for
hm
yeah
so now we're gonna we're goingon to got
to handle
scope uh so we want to say
lists statements
statement I hope we can do that yeah we
can statement scope statement equals
[Music]
parser Core
x.l
X no no no no no no no not this
again
um I can say n here can I yeah that's
good
scopes statement be error failed to
synthesize
why fail to synthesize class instance
for statement to
string is this one the
problem yeah
work
um
guess it's not to find
yet it can't recurse there
okay
who prefers yaml to
Json sometimes we use the little yaml
and
now
um now we're getting parser for some
reason
for
oh oh this is the
problem
what
oops the server
crashed this might work
okay
fine
no still can't do
that but par should work okay
now no why is that a
parer
oh
course there we go
actually default is not anything special
all right cool so we can parse
Miu um we didn't actually write the
parsing for essential statements so
let's just make sure we can parse
piano oh we can't parse comments
either going to have to parse
comments should be easy to do
um GNA have to parse
comments let's just
do
piano and we'll give it the right
title which is lean metamath
parser
parse
error yeah because we have to deal with
comments
perfect there no essential
statements essential
statements have pars for that yet how
does that
work oh I guess the scope statements
contain parse arrows
um okay I mean the problem is I need
kind of a forward declaration
um so otherwise we get
this
yeah
[Music]
um
you know watch I mean can I do
this this
work I can't call
recursively fail to prove that it's
decreasing I don't really get
why okay now I do get why
man that's
awful
yeah no we never figure out how to do
two plus two we're going to come back to
that someday
though
yeah the scope statements aren't being
parsed
correctly
um
um
yeah okay got to just add essential
statements what's the grammar for an
essential
statement it's actually the same as an a
isn't
it yeah it
is
disjoint statements
too um disjoint
is I don't know why I wrote it like that
it's actually all the variables you want
same as a variable
did I forget that
one
um I don't really understand why the
scope statement's a
problem
it's not
right
for
[Music]
hate
this
like
it's not obvious why this doesn't
work failed to synthesize type class
instance for statement to
string
list list statement has to
string
oh
actually might just be
this
for
I is going to complain about weal one
just's complaining about
that
that
wrong that runs
interesting this so weird
uh
unexpected occurrence of recursive
function
why no
why did this work
okay why did that work
okay so weird why does that
work and I
can't
theoretically that won't
terminate can't prove it that
well
complain about something actually
doesn't
it this is sorry
great oh this just CU it's nonexhaustive
for
for
equation 11's never been used so that
can
go
um
hard
one yeah that works I have no idea why
that
works the other stuff didn't
work really doesn't make all that much
sense to
me
the scope statement we can indent
it we need
this there we
go let just par
my and should be the length of the skope
hope oh it doesn't matter so switch it
doesn't matter how big n is um as long
as you know it's larger than it needs to
be because anything it just needs to
prove that it'll finitely terminate I
actually tried I changed this nend to an
x. length and then it couldn't prove
that uh it wouldn't
terminate but um this will always
actually
parse
um
so Weir that that just
works
proc pretty
well this just a printing
thing like I'd like to know why I can't
just do
this
well I can't because of
this can I forward declare an
instance
try mapping over a list but also
including
oh I don't think that M
matters that's right
for
think that map is
right
for
[Music]
um
I don't I don't like that I think it's
ugly way what I want to do is
this
it's pretty
nice
this doesn't
work
um
for
change the type definition for this I
just make it
work I want I want an open brace
too an open brace I don't really know
why I can't get one
like I don't understand why this doesn't
work I guess I just can't read about
that yeah like unexpected occurrence
of recursive
function it just can't handle that kind
of
recursion which is
fine like
I'd really like
this it's not what I want cuz I going to
put one of those
everywhere we shouldn't create a new
thing here
for
like it's parsing everything I guess I
just don't really like how that scope
statement thing
works
but I don't like it it's
ugly we can't map on statement to string
because then it has to understand how
it's going to be used recursively and it
has to make sure
nothing
it has to make sure it's primitive
recursive scope could be nested so
there's no other solution to
that I mean the way to really keep scope
around would be to use a monad but that
would involve understanding what a monad
is and that seems too
difficult for today's
work so there you have
it a metamath parser written
lean and next stream we'll look into
actually proving see if we can use it
for
verification there's your
demo seems a lot like Asko
yeah we'll have to next time
use a monad we're going to need a monad
but cool thank you for watching the
stream today any last
questions
before what does I Carly do at the end
of her streams whatever she does at the
end of her
streams all right
guys where's
obs
crashed how did it keep
streaming who
knows that the
shortcut no is that the shortcut
no for quit
things
I don't know I don't know how to do it
on my
keyboard wait it's not even
running where's
OBS this is mad
sketch
why is it not running how did it like
detach itself from the
finder
morning everyone I started with the mic
unmuted this time I know that's
important to you uh I didn't bring the
target of today's stream it's uh over in
the other room so we'll have to go get
it got dressed took a
shower
um yeah good morning people good
morning nobody in the chat room yet is
subscribe only chat on no it's not
okay I'll be right
back good morning good morning good
morning
hello a small
keyboard and a Galaxy zold 5 not a
OnePlus open do not buy a OnePlus open
Galaxy zold 5 check it
out um
yeah right pretty cool
right no we didn't do a muted intro this
morning uh the phone it folds look look
look at this it FS it FS that's pretty
wild okay
um so what we're going to work on today
is we're going to look into the driver
uh running on this
phone
and just plug it in
here ADB
shell we don't actually need the tiny uh
the tiny keyboard well actually we do
need the tiny keyboard for one minute
I'm going to start up terox here
uh let's see if you guys can see I'm
start up turmo here and we're on
sshd okay cool now we have an SSH server
running now we don't need that
anymore because who wants to type on a
tiny uh screen ADB forward
TCP that right uh
SS Lo
host
um I'm going to do this over
here
what oh there's multiple of
them
okay we're in boys we're
in open CL is not dead open CL is very
alive look I can run CL
info and there we go there's some
stuff so we have team on here like
normal uh we can
run oh that requires torch I think I
have torch can I do app install
torch uh app search
torch python
torch uh so this is turmo uh very cool
of these people they've built a
uh basically a Linux environment that
works on on Android
phones um I don't think if the screen
locks it gets slower I'm keeping the
phone the phone is open right here
connected to my computer forwarding the
uh forwarding the
port
um
oh you know what I'm pulling this all
over my expensive uh data I shouldn't do
this I got to connect this to my
Wi-Fi yeah I'm not on Wi-Fi wow 5G is
just so fast that you don't think about
it um I only bought 10 gigs of
data I just connected to my home Wi-Fi
here
okay should be faster enough
so hopefully al Five is just so insanely
fast uh CIF config
me oh that doesn't tell me anything I
think that's my home
IP uh how much did I pay for 10 gigs I
think it was $17 I bought on one of them
eim websites eims are amazing by the way
um yeah we love
eims
okay uh we'll let that install I I
showered we ordered some Dunkin' Donuts
to that'll be here kind of soon my phone
go I go find my real phone so I know my
dunk Donuts is
here it's not here
yet
where's my
phone I don't
know it's
gone maybe it's been the
shower
okay my dunin Donuts will be here in 15
minutes
um torch requires fspec which is not
installed okay let's just see if this
works so the advantage to using tiny
grad um is that tiny grad can use the
GPU while torch can only use the
CPU uh so for things that are this size
it probably doesn't make much of a
difference oh it's
Alex good morning we're on
stream oh hi Twitches want to say hi to
Twitches
yeah it's
Alex what do you guys we do today uh uh
we're we're we're working on the on the
folding
phone oh you're not no no no we're
working on the folding phone yo some
some uh some the minister of AI from
Dubai reached out on
Twitter no like like he he talked about
like look our country has really nice
infrastructure friendly Visa processes
and I was just like imagine America
doing that remember when Francisco
Suarez was doing it in Miami he did this
approach he did yeah like no but just
imagine like the the main you know he
has no
power no but he he was he does have some
small amount of power and influence at
least
locally that that that does make me want
Miami more no just just just you know
they're throwing it away San Francisco
don't get me started been here for 48
hours I've seen so many things dude like
it's
uninhabitable
uninhabitable yeah um the filmmer been
nice but yeah for the most
part okay wait one thing I learned
Americans are extremely receptive to um
friendliness and coincidence and if
someone is a spy um we should just be
weary of
coincidences that's all we learned from
Spy training where where'd you go to spy
training I'm not going to talk about it
can't talk about it anymore but you know
I was just thinking about the Russians
the Iranians the Chinese you know I mean
you do have to watch out for spies
that's true you do it's already happened
to me one time I didn't wasn't like
wasn't who was that Diane Feinstein was
like married to a spy yeah I mean
they're everywhere you have to be you
have to just be paying attention it's
all in plain sight hey I'm all for I'm
all for kicking spies out but you know
how about like you know a sane
immigration policy where instead of
letting in any riff raap who makes it
across the border we either let in
everybody or nobody but right now we
right now we have an immigration policy
which selects for the criminal element
right the first thing you have to do to
get into America is commit a crime no I
agree it's huge problem do we want to
build a nation of criminals how's it
working out for Australia you're
speaking to the choir I'll let you
stream I see you later what you home
today or you home tomorrow tomorrow
morning like a noish
okay hey what are Dunkin Donuts you'll
be here soon you're you're Savage I
wanted a big
coffee so specific I miss Dutch Bros
byebye
bye uh no we don't let in everybody if
you're willing to commit a crime we'll
let you in uh if you are talented and
actually want to come here through a
reasonable process there there is no
reasonable
process
um
all right it's subscriber only chat
time so this is using
opencl uh but the question is what is it
actually using from opencl and that's
what we're going to do here
today uh so let's open up vs
code hello after workor Tech um let's
open up vs
[Music]
code
sorry I'm unprepared this
morning
uh I can show you guys that un secret
there
um
s-p Local Host
2022 does that
work missing host in SSH connection
string why am I missing the host
SSH
D
p222 Local
Host oh do I actually have to add it to
my
config okay we'll do
that yep yep bro that's that's how I
feel man that's how I feel it's going to
shit it's going to shit if you're in
Rome and you know the Empire is falling
what do you
do okay is this going to work is this
going to be able to run on vs code
server over here on my Android
device no but like you're in Rome and
you know it's falling right what do you
[Music]
do vs code server failed to start well
that
sucks why did it fail to
start h
H like this
sucks all right VSS code
server
Android
terox okay package update
package install python yarn shit
okay great we have to add L
Atomic you move out of Rome yeah right
where do you go though that's the
question no like you know we just
talking at dinner last night and like I
I
just I would not trust Argentina
um I'm not sure these things are going
to get
better oh code server is
this oh this is
different
H
interesting
so Thailand and Japan and Japan
particularly they're not multi-racial um
you
know it's not for you is kind of the
problem with those places right this is
also the problem with
China
this is terrible why is this so
slow I don't have good Wi-Fi reception
in this
room um but wait this isn't really what
I want I
want I want VSS code
SSH
dude
I'm me just fix this let's see if it
gives us any information about the
[Music]
debug it's not
supported yeah Europe's just Advanced
stages of America there's no way I'm
going anywhere in Europe
okay what fails
here can you can you stop scrolling for
a minute please stop
[Music]
scrolling removing old log file okay
let's take a look at these log
files code server
so what if I run
this what's
mu what's a muscle mule
environment
oh by the way I'm
uh I don't use uh chat gbt anymore and
the best part is we can use this on
stream uh it's called labs. perplexity
doai set it to
mixol the moon's going to be absolutely
awful
um run vs code remote and Android let's
say
disgusting disgusting dead
company
ah
no don't can I can I keep the logs
please okay um no here I I just have it
here if if this doesn't work the machine
must meet Visual
Studio standard
C.O
thank you for gifting
Subs does bionic not have
this
no
wa so this thing has no dependencies is
it
a no no what why would anyone want
that
is the problem no okay so it uses node
so it is the same server I should just
be able to follow the server
installs the problem is when it connects
using
that so this is this is the same code
server I think we just need to figure
out what flags to pass to
it yarn Global ad code server let's go
come on
yarn all right just wow this only has
182 dependencies that's so lightweight
for
JavaScript you disagree that wealth is
what's important what you think's
important the friends we made along the
way the engine node is incompatible with
this
model no JS
LTS
wow the hype Train's a different color
twitch is really promoting something
here going global ad okay all right we
have to resolve the packages again oh
we're linking dependencies oh we're
building fresh oh that's good that's
good all right what are the odds this is
going to work oh and no we're already up
we're done that was good while it lasted
nice while it lasted okay argon 2 failed
this is this is a
joke Has anyone used this EC
system Mario bra thanks for gifting
Subs
uh all right fail to execute
this AR no such file or directory okay
well that I hopefully I can install
vils vils is llvm I want to know about
that we just have to get argon 2 to
build and then I think we're
good yeah perplexity Labs is awesome
right right
unbelievable like why would anyone use
the thing is even if the model's a
little bit worse than gb4 which gb4 has
gotten way worse they say they haven't
changed the weights but I think they
changed the prompt and I think it's some
like legal thing
[Music]
um it's five times
faster
okay okay install code
server code
server
um I mean we can also just why don't we
forward
1880 all right we got to get the
password that's my Donuts
man
why is that like
broken why is copy and paste not
work like something like is enable like
weird
select okay you know what why don't we
just type it fdd2
e496 dd6 D e06 oh I definitely did this
wrong
I definitely did that
wrong what how is anyone supposed to use
this
copy
copy what is this
weird it's just some t-x thing it's so
weird
all right we're
in uh is this the look dark modern wow
okay so we're this is VSS code running
on the
device uh open up your code open folder
we want to open Tiny
gr yeah I trust the
authors
sure this pretty crazy actually this
just running in
Chrome 16 months wow okay we got to get
wait can I install
extensions I need Vim key
bindings is that the main one this why
does this one show up first so broken
I heard this I heard this I heard this
fire song on Instagram this morning
don't take this as a political
endorsement but it's by Trump the Dawn
and it's called make them uh this one it
can't be
copyright
can't be copyrighted come
on
well you missed it if you were on
YouTube
uh
it's actually going to be so sad for the
2020 election 2024 elections Trump Biden
so
sad so sad uh oh let's get some python
syntax highlighting in
here is this just can I just install
okay let's see do my Vim extension work
okay my Vim extension
Works um
um
python the Swami at least seems smart
which is good um but that means he'll
never
win couldn't have a smart president they
might have actually do
something wait so I installed the python
extension is this one of these that I
have to like restart in order to make it
work oh just starty it anyway can't
hurt
wait this is kind of wild actually I
didn't know you could do this like I'm
just using vs code in a
uh unable to retrieve Mac
address I don't know about
that
oh yeah I forgot we can't copy paste
well if I have to type in the password
again I'm going to be
mad I'm
mad partial Watcher failed cannot create
Brute Force
backend oh is this my problem python or
see I want you to light
up
oh interesting look at this it's
installed in the
browser what is the goal you always
think there's a goal why do you always
think that is that how is that how is
that how
School taught
you yeah the reach on Twitter is
unbelievable
you know you got to hand it to Elon he
really I don't agree with I really don't
agree with the decision to like like I
would we could look at Twitter right now
but we can't because I'm not logged in I
really don't agree with that
decision
but Elon has like the purchase of
Twitter
was Elon did more for the the
like
anti- wokeist cultural movement than the
entire Republican
party
um you know you just look at how
ineffective so many billionaires are um
like Jeff Bezos bought the Washington
Post like Jeff Bezos seems like a cool
guy why don't you fix the Washington
Post um top three countries to move
to uh okay well we're just not going to
have good syntax highlighting and that's
just fine because that's just life you
know if you always have good syntax
highlighting you
just
right running file create participants
I don't have High Hope for
this okay is this the fix that I have to
make does this seem
related
I don't know let's just try
um where's binding
jet
config all right is this even
here okay well that doesn't even matter
uh
should I try to fix that copy paste t-o
can't copy
paste I have to disable the
mouse
that works
cool
um you know actually can I just connect
here
now or is this going to no it's going to
still try to install vs code server
never
mind no useless
oh we can copy and paste out of there
now we're rich okay load parcel Watcher
failed all right perplexity what do you
say about
that
[Music]
I got Watcher working by
installing
this looks so
difficult n CD
watcher currently only Watchman and
Brute Force backends are available
okay no it doesn't seem laggy at all I
mean I'm connected over wire it's
not uh okay okay version of node are you
[Music]
using this is due to platform process
returning Android
oh maybe this will fix
it magic string let's
go
nope
what is this
garbage
no I want the python
plugin what's Watcher node
great seems like a lot of people like
this to
work it's interesting they're editing
the same
file but how is this supposed to be
reasonable
okay let's just try it and see if we can
make it
work we don't need Watcher I don't know
why Watcher is
important go to examples let's touch
open
CL uh I
octl wow this is the effort I'll go to
to not have to use
Vim wait it doesn't
work oh activating extensions I
see all right
disable
okay it was related to the python
extension
fine very upsetting very upsetting okay
let's let's stay on topic here boys
let's uh let's let's stay on topic all
right
good uh from Tiny grad oh I don't even
have tab
complete oh this is vim qual quality
this is
terrible now we have to make python
work if I eat all this I'm going to be I
got I got a I got a breakfast sandwich
as
[Music]
well pretty
Bak
so look open se's already working what
we're going to do with the
stream I'm going to keep eating this I
don't put it far put it far it tastes
like
chemicals tastes like
[Music]
chemicals
[Music]
check out my Twitter
merch you would not
[Music]
believe
runs a regx in every file no no no I
need tab complete to work we can't not
have tab complete we need tab
complete okay
um besides isn't this your favorite part
of the streams when I struggle to try to
make things
work okay so the Watcher thing is
actually unrelated to this I think
what the hell's an
LSP oh wait that looks
good
no but now we're stuck on activating
extensions oh maybe they're activated
now no we're activating
extensions nope can't
work
all let's see what other python
extensions we
have what is this why is this crap being
advertised to
me
what does that icon
mean filter extensions most
popular popular wait this is an
extension
pack
pilent black black
formatter pyite is not available in code
server for
[Music]
web not available in code server for web
but for some reason this one
is that's so
strange oh we don't make me run a
container that's just a
tragedy well and if we have a container
I'm not sure we
can I just
want I'm
upset fine fine we we don't have any uh
we don't have any any syntax
highlighting
okay
we have to do this by
hand it's like the old days boys
remember when I used to use vim and not
have any of this stuff how did I ever
code for years in vim and not have tab
completion no
idea um
okay
allocator uh well first actually we can
just start with device
so let's srace
this srace does work
right there should be some compromise no
compromises never settle I have a
Samsung
um
okay so these are probably the ioctls to
the
GPU uh now we can look open pilot has
some of this
stuff I wrote it in this thing called
but we're going to try to do it in
Python this time because whenever you
can do stuff in Python life's
better um it's in Model D it's in
thneed cucon
too so this is an ioctl Interceptor and
these are the names of the
uh assuming they still the
same yeah these are probably the ioctls
for here we know what we can do an
allocate uh
anit
Alec uh no how do we do an
allocation
do and alic doesn't actually do anything
that's just pure python yeah it's pure
python delete it
them yeah so these two ioctls are the
allocation and
now control
P disable pylance in the
code wait contrl P doesn't do anything
let's start
there but I have settings extension
settings
settings no extension
settings no it's definitely not related
to my
firewall um whatever you know we just we
just got to we just got to accept that
you know um you don't get everything you
can't always get what you want
right like I'd like to live in a country
where we have
growth and not a country run by diesels
and idiots but like you
know can't you can't have everything you
want um I mean the the great the great
political divide of the coming decade is
the accelerationists versus the
Dells and
like the D cels can't
win
they don't even really want to win I I
don't really understand the mind of a d
Cel but the mind a desel is just it's
just he just a
loser like you there's no victory in
deceleration there's only victories and
acceleration
um but you know I I think you have some
people who are
just maybe maybe a phrase is like die
with dignity
right the first word you hear is
loser uh what do D cells want to do they
want to die with dignity right that's
that's the end that's the end game of a
D
cell acceleration is foolish and
naive well you
know two countries one accelerates one
doesn't who wins in the war there will
only be acceleration is
left unforeseen consequences maybe but
you're never going to get your world
government why Dells want a Dell that is
a great
mystery um I mean moderation is always
good but
like we we we can certainly have we can
certainly have debates about you know
how quickly we should accelerate sure
but fundamentally we should accelerate
fundamentally um you know one of the
replies to that tweet yeah was the the
minister of AI from Dubai and that he
talked about how good the infrastructure
was in his country and that's
cool like I want good
infrastructure
um no no no we can't raise the
retirement age we cannot raise the
retirement
age
uh you know it's it's it's It's
upsetting I I don't really want anything
to do with any of this stuff but when
like this is saying it's you know you
might not be interested in politics but
politics is interested in
you uh and this is this is a sad
truth okay so what we basically want to
write is we want to
replace uh
opencl with
the with a version of the driver that
just uses these ioyal uh but first what
we're going to have to do is is sniff
the
ioyal um so let's think about if we can
do
that uh how do we hook
hook native function in Python is this
possible no I want to do like okay
[Music]
here
doesn't seem
right yo can we make this work okay so
what I yeah what I want to do is hook
ioctl in in
Python um so let's think about
that all we can do where does I OCTA
live
uh my complexity
labs
oh this is
Android we have
crappy
uh oh
type Python 3 is hashed I don't know
what that
means libc not. 6 because this is
Android okay we have a funk pointer
object
um so this
is in
libc now we're trying to hook we're
trying to hook the native function you
see what I
mean no no it's not an implementation
that's not what we
want
um python
hook
[Music]
that can't possibly
[Music]
work oh I'm not on the mistal model yeah
good
point oh
whatever G too much
tabs where's my
settings
that's
awful what is this also modified
elsewhere do not detect
indentation
we always use two spaces that's
right we're we use spaces but we're not
going to debate about that debate is
stupid and monarchy is
cool okay there's no way that's actually
going to
work no of course
not this just changes the pointer in the
dll um let's think about what's actually
happening
here
so I guess like um I mean okay let let's
just let's just go extreme with
this uh let's actually edit lib C this
is Maps so we're going to have
to we're going to get the
address
address
stupid
perplexity so do we want that to be a c
in or really we want it to be a c long
and that's c types. c
long least that
works cast is not
defined yeah C types. Cast
wish I had syntax
highlighting must be a pointer type not
SE long
okay wow this thing actually kind of
sucks
all right how do I get the value of a
pointer that's definitely not
right stop
hallucinating
raw that might
work no what attributes does it
have that's not going to
work
contents okay
cool
is that really
right that seems crazy to
me oh that's probably not a ref that's
probably actually the
code
so would I do to hook this in uh
inne here uh wherever
my
what I do to hook this in need is like
this is just an Interceptor and I do it
by uh by linking but we shouldn't really
do it by
linking like linking is kind of
[Music]
ugly how do
I I mean there has to be a
way
hook native
function which model is
this
Mi what if they're not actually running
this
model
um
so
might be
that this thing is so bad about
hallucinating okay that is the actual
address notice how it changes due to
aslr uh so okay that's actually
correct um so that's giving us the
pointer to the
function uh
uh C types is particularly annoying
about this it doesn't really at least it
doesn't like you to create
a
uh found an
example
what is this Freda thing what is
Freda oh this is interesting okay Freda
cor is written
in
this is easy to
install NOP not easy to
install need freed to core dev kit to
build from Source no see this is the
problem with all this stuff like this
thing might be great but this isn't
usable we can like look at what it's
doing Fus
spawn exclude
ioctl
ioctl that's fancy
um
okay the other thing that we could maybe
do so ioctl is a CIS
call we could potentially attach to our
own process and hook the
CIS think we want to do that
though
um
okay whoa whoaa okay let's try
something forget doing this by
ref how do I set the how do I set a
pointer
C types is so poorly documented and
these hallucinating models are not
helping
me you know who you know who might not
hallucinate
techum
so this is Tiny graad this is this is
Quenton from uh you know my boy
Quenton uh
how do I write to a pointer in C
types access the location points
too create a pointer object
okay pointer. oh I can just do do
contents equals oh
cool well I don't know about that
but see value this one hallucinated
never mind perplexity you got to fix
this shit I don't know if it's the model
or I don't know if it's how you're
running it but it's been hallucinating
and we not approve of hallucinations
okay so like equals zero oh does that
work
expected CU long instead of in okay what
if I do CU in is it gonna swiitch me
out
um I just do
that okay now what happens when you try
to call I OCT does it work it works
lame um I mean this one's Pretty
good overall it's quite good when it's
not I'm asking at two specific stuff
maybe I I I'm shocked if mixol is
actually hallucinating that much I I
think it's it might be an issue with
that perplexities running it I I
shouldn't say that without evidence but
this is hallucinating a
ton like the fact that I put the thing
wrong like let's see if I do it here
what Quenton says
yeah no this hallucinates too never
mind see what I mean because it's
actually bu there's no
[Music]
underscore uh so that's hallucinating
too that's
lame okay um so I changed
this
like I thought that this was
actually okay what if it's not actually
calling do I have GTB on
here
[Music]
by the way super cool this I think this
the FID guys doing turmo like this is
amazing that i'm doing this on Android
um and you know who sucks Google uh
Google is the reason bionic is an
Abomination and it was brought into this
world and it's awful um and now
nothing's ever going to switch off of it
and now now we have this other broken
lib C
implementation oh let's uh let's print
the ioctl address and make sure that's
right oh that's very
early
[Music]
uh this is almost the same as this but
not exactly which is
interesting that's interesting right why
is that not exactly
that
sure looks like it's that why was the
break point
there why is it there
okay
regardless
um yeah okay so this crap actually is
the it just didn't actually write to
it why did it actually write to it
should have at least faulted
right like this looks like it succeeded
but it
didn't
how do I get the address of a pointer
can I do
that so that's contents how do I get the
address
CR cont check
no
um
do a DI of Contex maybe a Setter
exists no I I don't think
so I I think that it's
yeah I mean like what's stupid about
this is I guess I can just use
uh can I just use M Copy me copy
right
um M set even more brutal all right can
I just do this lipy do memet ioctl
address what are the arcs to M set
always get the order
confused pointer value non I don't know
set like 10 of them that going to
work segmentation fault
okay that's pretty good let's see where
it's seg
fting run
open open
pilot oh uh examples open CLI oal
okay uh received in seg fold info let's
see can I do
like
print
uh no that can't be
right
what oh I probably have to set the
arguments uh how do I do
that
oh we can also do that to make it
generic um
um no let
me maybe that
works oh can I just do
aess
okay let's see now what this
does null pointer
[Music]
access okay we're getting that again but
maybe it's different this time
yeah okay so I think this actually is
the I opal address yeah it is okay but
we can't actually write there because we
have to M protect
it
um good thing we're on Android and not
iPhone where this isn't allowed you know
you guys like I can't believe the
dumbass comments where people like you
can install other browsers on iPhone
George H doesn't know what he's talking
about you could just go in the App Store
and download Chrome yeah okay one day
you'll figure out why you're an idiot
and uh you
know you'll double down on being an
idiot because you'll never you'll never
you'll never reflect on and you'll go
through your whole life like this and
it's it's sad
man like like you
know
um okay so my M set that's correct now
we're just going to have to M
protect I think it's protect M protect
okay
uh good C.M protect for people like
don't know you can do this like python
is the most beautiful programming
language in the world and you know you
can access all of C from it and you can
like use it in these cool ways and then
it's
python okay uh uh I don't know it's
going to work no way seven Seven's a
good number let's try
seven okay same
problem my M protect isn't
working yeah my M protect giv giv me
minus
one
uh why minus
one do I have
to I have to round
this
illegal instruction boys illegal
instruction all right uh
let generic
okay all right now of course my
instructions illegal because we mem said
it all right but notice what we did okay
so we M protected the whole page to be
writable and then we mem set it oh
yeah yeah yeah boys yeah this is the
real this is a real metal
shit
you was a Tim Dylan lyric I don't even
know really who Tim Dylan is I just I
just remember this was on a like he was
like freestyling on a
podcast chilling in my Rover American
Empire is over I was like
damn damn this is so true that's so true
so sad so sad bye-bye American
Empire um do I have any advice for a uni
fresh
bro bro listen man and listen listen
listen all right look look look look
look look okay first you got to you got
to go to the junkyard and you got to buy
12 Mufflers right and then you put these
12 Mufflers on a table and you set up
this table outside your house but the
trick is that you apply from a permit as
a lemonade stand but you're actually
selling Mufflers but this is actually
legal due to the Harrison Stamp Act of
1964 okay now you have your 12 Mufflers
on a table nobody's buying them this is
fine that's a tax write off
right
you ever seen these like Instagram
videos that give like fake hustle advice
like that I love
it Mufflers man got sell Mufflers man
make everyone's car quieter you know
guys guys you got to make your cars
quiet buy some Mufflers
right all right but then you're going to
Parlay those Mufflers into holographic
Charizards do not buy first edition
first edition the Market's about to be
flooded with it you got to get the
second edition Charizard but from the
original set you know the ones that had
the Blastoise on the front not not metal
Raiders and not a magic ruler man blue
eyes white dragon you got to get your
blue eyes white dragon okay you hear
what I'm saying all right we're good
3,000 hit points but you got to Tribute
two monsters to summon your blueyed
white dragon you can also tribute two
monsters to summon a dark magician I
don't know why you do that because you
get a Summoned Skull and it has the same
2500 attack points okay Summoned Skull
but I got my catapult turtle and My
Magical Scientist out there on my first
turn you didn't even get a turn bro you
didn't even get a
turn all
right did we when are we playing Zelda
again you guys can should we play some
Zelda no we we have work to do work them
work okay um
illegal instruction well that's not
good uh okay what's
the what can I
intercept what can I intercept from
python okay so first
let's uh ctypes
dot create
string
buffer um we can do something
like
type error oh
obviously Python 3
boys all
right check out my new
hacked instruction this is a great
instruction okay arm
64 uh break point
instruction all right
um no this is not RM 64 oh you just
included debug break yeah what do you
think this
is too
complicated
no I don't use rust or assembly yeah I
use C types that's right thank
you to trigger a software
breakpoint
okay we have to call python
somehow where did that come
from what called that
is
Addie no I don't care about that the
question is how did it get to
there like where's the pointer to
[Music]
that
what the
stack I don't know I even know how to
find
that
um do you want to understand the
difference between CPU and GPU yeah one
letter
bro
uh well okay just to quickly test my
methodology what's the return
instruction we can just get them from
here oh yeah yeah undefined that's right
that's right you deserve
undefined okay
so this is return well that's kind of a
crazy return that can't be return is
that return wow that's just a normal
return
[Music]
okay error that's
good uh all right let's uh do this write
at the last
[Music]
minute move them Imports up to
here okay good now we're getting an open
CL error because I bricked your IO
control that's right oh another another
interesting song come on this can't be
copyrighted this can't be
copyrighted uh there's just one part of
it
like like I've just listened to that
verse you know um the reason you spend
time with me is cuz I love
philanthropy you know
uh this is this this hyper
wrapped uh also I love that like the
kids are into like they know the
internet was good in the 90s man so
they're into they're into '90s
uh '90s uh internet stuff no it's just
it's like the energy of this you know
it's interesting that like these kids
are making songs about what my life was
like when I was like 20 you
know uh
um you know like like like uh like
Monster Energy drink and like oxie and
like you know hacking iPhones like this
was this was this is a
true understanding of what my life was
like when I was 20
um but it's it's cool it's cool that
like yeah that that this is what the
kids have figured it
out
um which is
cool so now we just need to save the
dying globalist American
Empire
ah okay we we've hacked it to return but
we don't actually want to return we want
to hook
it
um yeah so really if we can find the PLT
this might be
better
how do I find something in the
[Music]
PLT I used to know this stuff so much
better
um so we want to do ioo
PLT yeah there it is
wait
what I think that's
right
instructions
interesting so so even more true they're
all here all the pointers are
here
how do I get
this I'm sure I played ritual for you
guys
too
this chunk has
these has all the pointers in
it they're probably like the relocks of
the process that's pretty awful
actually uh it's better if we can
actually hook the the
real
program
okay um I can intercept a signal in
Python
so I'm going to have to raise a
signal is signal assist
call I think it
is
all right we'll give we'll give uh we'll
give Mixel another
chance
do you think it's
right and then which
uh abort debug
exception which Indian this is
this
illegal instruction did I get the
indianness
wrong illegal instruction thanks shitty
language
model
is this
exported
no can you access can C types access the
p
LT Google's so
bad so bad so
bad
do we think that's more
right
what are the odds this
works
low
be okay thank you for being
honest but none of these things are
right at
all oh well this doesn't have arm 64
did I just miss it was it just right
there and I just didn't click AR 64 okay
okay well can't see
[Music]
that it's not that is it
this not applicable okay uh
service maybe this stuff's right who
just trust llm stop trusting llms okay
they're
Liars bad system call okay well that's
kind of an
improvement
um
raise no import signal raise signal
doesn't
work uh where are
the
okay uh what's the best way we need to
like trampoline back into python uh does
c types handle callbacks that's really
what we
want okay how to call a python function
with
c um okay that looks
cool so can we like what if I is this
going to
work wait is this just going to work
this would be so
cool uh we really need to do the pl
though at that point we don't
want where are those PLT
things don't really want to have to
intercept stupid i
octl j blow welcome welcome your people
um this is a pretty lowlevel
stream uh so I think uh should
be similarish
uh to the kind of stuff you're working
on what we're trying to do is we're
trying to hook I octyl from
python um so we have the opencl driver
on the system calling uh ioctl yeah I'm
SS into Android so this is Android uh
for those new this is the phone right
here it's a Samsung Galaxy zold 5
definitely not a OnePlus open cuz
OnePlus
sucks uh yeah and I even have a tiny
keyboard for it you know this is my tiny
setup um you know very appropriate for a
tiny
grad uh so open CL works the problem is
not with opencl the problem is I want to
go a level lower there's okay so here's
your opencl API right CL create kernel
CL Alec memory CL you know uh stick a
INT in the shit right like like CL set
kernel Arc that's what I meant um so we
have that at this layer and then we have
the kernel layer for the GPU and I'd
rather just tiny grad talk directly at
the kernel layer but we don't code and C
anymore we only code in Python so what
we're trying to do is we're trying to
hook
ioctl um we're hooking ioctl from python
to intercept it and make it do things
and let's see what's going to
happen Okay uh c. cint is not defined
okay well what type does I opal have
it's probably a good thing to think
about did I root the phone no it's not
rooted um I got the wrong model so I
can't root it uh but we can this is all
the same you want to find an exploit
like this is all the same stuff as find
an exploits I'm just you know okay so we
have a call back object I should be able
to get the address of
it and what we're going to want to do is
we're going to want to point my octal
there and
dead um types a check C
type cast to
address let check it
out address of
maybe
Okay add just of seems to work so we
just want to point ioctl
there to this callback instead of where
it's currently
pointed um so we could do this by
actually hooking the ioyal call but I'd
rather do it in the
PLT okay so it
br17
ldr
see and it add something inexplicable to
it
what okay well this isn't even right
anymore yeah we could do
that
already a VIP look at that
um wow you're 742 years old
man uh
okay so this is actually working to hook
ioctl itself but i' rather not hook
ioctl itself I'd rather figure out what
the stub is that calls into ioctl and
where that pointer
is um so I don't know how we're going to
find that it's easy to
find and then the other problem no there
should only be one Global ones of these
right like this gets into some some
Nuance of how dilate actually
works wonder which is does this actually
just
work it's
that this might be easier than I
think let's go to GB
here
can I get all these things to shut
up it doesn't look like
anything I think that's just actually
creating a special new C types thing
which is kind of
useless
um
yeah so that's ioctl
there and you see we're getting bad CIS
because I changed the first thing in I
octal to be service
B so we could actually hook it there I
think if I remember the PLT stuff
correctly is
here yeah okay here I opal got
PLT
that is the symbol we want to find how
do I find that symbol from inside
python wow like I used to know this
stuff super well and now I don't um got
PLT blah blah blah blah blah Global
offet table that's
nice examine the section headers that's
nice
um the other beautiful thing about doing
it like this is it should be
architecturally
independent uh yeah we we have to find
basically this pointer
somehow how did I find it it was in HEX
16 when things got handed to
me ctypes
find.
PLT okay how does this
work this works by using DL Sy
there's no way DL Sim is going to get me
this this has to just be some some GDB
magic though if we can get the base
point or the got we could search
it and I want to info
segments
GDB print
segments info
files maintenance info
sections okay here got PLT um of course
this is actually
wrong because that's well actually I
guess that's the got PLT of the
uh
python
so annoying
um yeah okay how does that
work
what Apex what is
this is there another libc that's I
don't know what Apex is but
whatever um can I see the symbols
exported from this yeah these are the
symbols
exported I don't think there's going to
be anything God or PLT related
unfortunately because they're not
symbols yeah they're not symbols
h i we can get a symbol and then just
like search for it that's pretty
terrible
though
okay uh to give you a little bit of
context for what we're actually
doing uh this is okay so these symbols
are imported from a diid or it might
just be dialate on the
Mac
uh and you can get symbols from an
imported library but is there anything
more I can
get DL error DL
open op handle deal
info o o
o TL s data
useless Library search pads link
map this might
work someone have python code to do
this the C types Library what
what you even saying bro chains the
point of the link map
structure okay Dynamic section of the
shared object chain of loaded
objects origin sear info size no it's
not any of
these This is
complicated
oh yeah symbols can have versions by the
way there's
ioctl it's really easy just to actually
patch
it the problem is then we have to make a
trampoline like we have to patch it
back
maybe that's not that big of a
deal
uh no but it's still annoying because we
have to actually assemble a trampoline
then if we can figure out how to find
the
PLT we should be able to not need to do
that we want to find the got PLT and we
want to change this address we need to
find this magic
number
um how
is we need the got PLT of lipy so we
need
this am I really shifting to Dubai well
not
tomorrow but yeah I mean if things don't
look up here right like I'm not you know
I'm not going crazy and renouncing yet
but like it's it's very bad but yes you
yes off topic you're right wow I get
distracted so easily we need to put
subscriber only chat back on cuz I don't
think that person was a subscriber I
know it's nice to include the new people
but new people have dumb things to say
that's
true uh and now we're going on a rant
about new people which is which is uh
you
know
okay okay let's think about how
this Library
works
let think about how DL Sim works I don't
know you want to read the code for
DED D it's Mac yeah it's Mac what's the
one on
Linux
libdl DL Adder what's DL
Adder translates address to symbolic
information use DL Adder
one
Elm
open historically this functionality now
relies in
[Music]
libc not
this
oh not
that where's like the code that where's
this code can we just read
it
okay uh DL error
run DL Sim DL
Sim this actually it should we just look
in
gipc uh uh let's download G
say can we still download it from the
good old tarball man I love this old
school look at this uh how do I download
this can be downloaded https or we can
use an FTP server how do you guys feel
about
that wow XY is so much
better
let's read GB C I trust the authors of
GB C I'd
say
uh DL
Sim
crap
tests
no that's not what I
want let's just a DL sim.
C here we go okay DL Sim
implementation DL error run DL Sim do
it okay want calls underscore
dlim okay where is underscore DL
Sim it's here in DL Das Sim oh it's in
calls do Sim okay let's try do Sim ah
here's do Sim okay link map the caller
if
needed search the global
Scope Call DL
lookup G scope loog does anyone
want everything should just be written
in Python it's
unreadable GL lookup symbol X is that a
function search
loaded we have to check whether this
would bind unde map to an object in the
global scope which was dynamically
loaded something went
wrong
filling got PLT
header DL trampoline Thrice the got PLT
offset undo the
what that's if it's
mips
arm DL mock PLT okay DL info
PLT okay this looks like I can get me
the PLT got this is probably the easiest
way to do
this it is this rtdi link map thing
okay Dynamic section of the shared
object what is
that
okay this looks somewhat
useful let's try
this okay we have to see if we can get
the okay we'll get the got we'll fetch
iio
control we'll get the got we'll find the
function we'll set the function to the
Callback and then we're good
um all right link map C type c structure
cool bunch of fields e too many tabs
um DL info
okay
where they getting DL C name from F
Library
DL
cool temp D call jlink handle so I can
do Liv c. handle crfs
bu link map the link
map uh
go here by the way remember we're doing
this on Android boys we had to make it
hard we're playing on hard mode this
isn't lyrics
okay undefined symbol DL
info no don't tell me bionic doesn't
support DL
info can't be no symbols in
that oh of course bionic doesn't support
it what's DL iterate pader just when I
was talking about Android okay
Returns the order in which they were
loaded
the elf program
headers okay this looks even
better oh
God even Q andx supports
this python P
Trace
use
all right fingers
crossed inspection C function type
instead of function that's fine I can
just do
this expected C function type instance
instead of C function type oh
wow
see I just love how fast this
is but still didn't do
it oh I
see does that work no it's probably
hallucinating
again wrong type okay
well
um yeah I think that I don't actually
need this I think I do need this
take the eyeliner like
unboxy okay it got a call back but
walk through shared
objects one continue
writing I think just something's a
little wrong but that's so cool that
we're getting a call back
okay program header at zero that's
probably not
right contents V I don't know
P nothing um what if I just do p header.
contents
but I feel like I should be getting
multiple call
backs this
should wait so is
this deal iterate P
header should that show me for all
loaded objects or just the main program
walk through list of shared
objects
[Music]
um okay well this just doesn't match
this these things
suck
maybe we're supposed to return
zero and not
one of course of course it's backwards
of course of course of
course uh okay that seems right but I
think we need to get this struck
right
that looks even
stupider
whoa so this library has it there we
go um that looks wrong too but whatever
it's a system
U Base address of the
object path to the library what is it
really a
half LW
half
short okay let's call this let's print
pader
do
dppy name let's check out the dppy
names
nothing an indented block after class
definition
oh where did what is
that okay there we go look look at all
our beautiful libraries oh that's so
beautiful oh that's so those are
beautiful libraries boys look at all
them beautiful libraries that's the one
we care about about now we just got to
find the got PLT find the IAL address
swap it out with a python call back and
we hooked
it
Crazy Fast
right okay um I don't think those are
right DL iterate P header
okay pointer to the array of Elf program
headers
uh first person in chat who finds what I
can find shit
I there's nothing to find we just got to
actually do this program to the array of
Elf program headers so one of the
program headers specifies the uh got PLT
I
believe so we can do readelf
on
S so what are the program headers now
those are the
symbols read I just want
headers program headers okay L let's
make sure I'm actually getting the thing
I
want
uh
what program headers I foret the section
headers don't tell me I need section
headers those are just symbols
did I pick the wrong
button section
headers that's dinon that's not what I
want oh it's capital
S okay there got PLT right there so I
want the section headers
this gives me the program headers how do
I go from program headers to section
headers
uh yeah okay that's the segments that's
great
what are we trying to do here we're
trying to hook ioctl so we can see the
ioctls and parse them from beautiful
Python and this is going to be Universal
and we're going to build the best tool
set for debugging all these
gpus so it's important to get this
right we don't want a half
asset okay the got PLT is here
here which puts
in this load
segment which is actually useless and
we're never going to be able to find it
unless we can get these
segments there has to be some nicer way
to do
this that's cool though we we've learned
we've learned a lot about um dilet
here okay these are these are our
options that looks like the only
reasonable one unless DL Sim could
somehow magically do what we
want yeah I know it's from from BSD
um but it's an absolute tragedy that
they use
this
symbol SEC
comp like I'm installing SEC
comp like ideally what I'd like is if
the
DL Sim Returns the
address there's got to be like some
other way to get the
uh to get the trampoline
function trying to think about it if
like I could find something that calls
IO
control because this this is going to be
so annoying right I'm going to have to
go through and
basically sure iterate through the
program headers iterate through the
Section
headers
um no EST TRC doesn't do what I want
yeah sure you can get it with estrace
but I want to get it into Python and
make it nice you know this whole
hopefully the lesson you guys have
learned from this stream is that you got
to spend time to set up your environment
nice because once your environment's
nice everything else is
nice
what does DL open return a pointer
to this is the libc this is the uh what
is the D open
struct it's kind of stupid
to we could just search the entire
space for the pointer to
ioctl
if we're okay with not using
ioctl I could
probably
[Music]
okay we don't want that to die how do I
break
uh
no that's not the
call
might be a pointer to the
call there was better GDP I wouldn't
have to copy paste like that okay wait
that's M protect what no I just copy and
pasted the wrong
thing
[Music]
um
maybe it's
[Music]
this
so this is the python
trampoline what's very interesting
interesting about it is it
looks it looks like I can
just C that looks
relocatable yeah okay that might be the
easiest way to do
this I can take the code from the
Callback and mem copy that over
ioctl um I want to redirect standard
arror to
null
[Music]
okay let's figure out how to get the
actual code of that call
back it's a c function type object so
normally I just pass in these callbacks
I pass in the call back
here um and that's
handled I don't actually need
that that's handled automatically by C
types
no so there's like C types. address
of that gives me an address but we've
established that that's not
actually uh I want to D
it I don't think contents works yeah it
doesn't have contents um maybe I can
cast
it to
a void
pointer C void pointer cannot be
interpreted as an integer contents
uh
long see
long that
work uh must be a poter
type c long cannot be interpreted as an
integer because we need do
value
okay so that's probably the actual
data now we are going to get lib C and
get
ioctl where's my mem copy we're going to
mem copy but instead of M copying from a
string
buffer we're going to mem copy and to
call CL device we're just going to call
ioctl we'll clean this up in a minute
um so not address. contents where did
that come from
address so I don't need the buy ref
there I say
then this one we can also do pointer.
contents
and let's give it x 40 or
something all right see if it prints the
word
here prints the word segmentation fault
okay something
anyway
it's segmentation faulting oh it's cuz I
didn't M
protect
yeah I think we actually want to do this
also by
W boss ever okay
well that's an interesting
problem I didn't know we had a
bus oh it's probably working it's not
printing for some
reason yeah
um I don't know let's just call
IO call zero doesn't matter
okay bus
error
okay
yeah that looks
right oh no ADR
crap PC relative address no useless
useless you see the
problem okay well this is not
relocatable then that sucks um the
callbacks are not relocatable that's
great I don't want to have to do that
again okay I mean we can try
this
no contents
value heck that okay so this is the
pointer to
iotl
um you might be able to find
that uh lety memory
find
it's called like stirer or
something yeah but I want this is this
calling is there something called me
m yeah this is it
uh uh lipy
mm
uh IO control address oh oh this is oh
this is this is lead boys this is this
is lead as shit all right
uh
okay we're going to search
there
for we want a pointer to
that
bro let's just call that one bro is that
going to
work zero that's not good uh finds the
substring Hy
stack uh C types create string is this C
types uh bites no I don't think this
byre thing
works
um
oh no maybe this should be contents and
this should be like
that did that just
work
uh I think I have to say that libc mm
returns
a
me. res type equals ctypes
do
c
okay so you see what that's doing it's
searching this for that so beautiful so
beautiful just search you didn't search
hard enough you didn't find it you
didn't search hard enough bro okay that
might just be the got pointer I'm
looking for with one call to libc me
me man this is why I'm
famous uh uh
okay okay mem copy
opt
no that should not be what the problem
is oh again I forgot the UN
protect we don't even going to need that
imp protect you
know uh I just really want to look
here yeah I octyl got PLT Lipsy me
bitches got about me me it's like gang
gang stir stir gang
gang
if what if the character were to have
like an anti- catch phrase you know like
every time he comes in the room he says
what's up bitches you know but not
that um yeah Tik Tock core man these Tik
Tok kids Tik Tok kids okay all right bro
bro we got a bro bro let's go let's go
let's go uh okay what
P bro. contents equals oh you got you
got to keep this all straight
man um can I just do bro. contents
equals callback yo if that works yo if
that works that'd be that'd be the
sickest
thing um
int
it shouldn't be an
INT why is it an INT should not be an
INT I told you the res type was a was a
void
pointer that should not be an
it just SC in where we how long you been
on this stream bro if I listen to
everyone who said that stuff what would
I
do worry about that don't worry about
that I can't say bro contents because
int it's an INT object but shouldn't be
an INT object I told you the res type
was a cype void
P you can't just said bro equal to call
back bro that's not going to
work
work all right I just need to convert it
to a void
P does that
work might work I don't
know
C void P has no attribute content Okay C
long P fine does a long P work
better oh we aren't doing a long P we're
doing a void P I don't know maybe that's
the
problem no attribute C long P okay fine
CU long cypes pointer let's go let's go
what's up B
itches a it doesn't work okay C long
object row equals call back all right
let's
go that's fine I think I don't care
about
that okay well doesn't work
um. contents.
value that should be the I octal
address oh that probably isn't how that
works actually this might just work put
that up here yep yep yep yep yep yep yep
go go
go no
um
interesting we've changed it but I worry
it's not actually changing the
underlying memory and this is just some
like stupid
uh stupid
thing
whatever use are M
Copy
um
wait I can't even M Copy to bro bro why
can't I M Copy to bro bro bro bro
bro
bro just just
bro just just just bro oh this is a c
types you long I'm going to tell it's a
you
long I don't put any underscores on you
long I'm not hallucinating like an LM no
way
bro uh okay that does sound something
um okay the mem copy is
failing do we have to M protect that is
that protected no it can't be
protected should be right oh maybe the
problem is call
back
um well I
mean there should least
work I an idea that that uses something
else though so that's not going to work
okay what why doesn't this
work
um do I need to M protect it maybe I
need to protect
it
it's not the
problem
okay like it's the same if I did like
that do value
right okay those are the same why isn't
my mem copy working why does my M Copy
seg BS let's
see is that
protected
was this the problem no this isn't the
problem wait that does not have what I
thought it would have in
it but I do that exact thing down here I
don't
understand
oh no I mean it can't really be this but
I mean that is
bugged
what
try to store it in here and this is a
problem yeah okay that store is just
failing don't need seven there just six
is
fine okay why is that returning minus
one
interesting
why is that M protect
failing permission
denied but also that does not look like
a real address oh no it must be the
address that's
fine oh Pro right prod exact that's not
what I want uh
Pro read and prop WR are what I want so
which one's
exact
three oh that's a different
error okay myam protect
succeeds I don't know what that
is okay actually let's see if we're
jumping in the address do we have EIP
control wow this is I haven't hacked
anything in so long boys
uh okay
well something's messed up in IO
control uh oh well that just might be
because that's
[Music]
fine okay that's just cuz this is a dumo
control
uh let's see if my Interceptor is
online is the Interceptor online no the
Interceptor is not okay what
I am protected it I copied something
there BS
aray
wait wasn't that failing
before uh thank you for gifting Subs
what wasn't that failing
what change does that
fail B okay
whatever I just need GDB to
intercept
okay
is that calling IO control or
something okay that's correctly
Rewritten with what I'd
expect
interesting it's finding IO control
address in the
G okay is ADD is calling it okay so
we're actually calling it here from
that but anit device works
okay do only work in
GDB
no uh could it not be calling it through
the G
[Music]
somehow I
know but what's so
interesting is if I enable
this it
breaks but it breaks by jumping to the
address which is so weird um okay let's
try call back
here
uh
have that
um I at the address of call back it's
like
this segmentation
fault
should just work if I put call back here
I
[Music]
think so why is that by ref that
shouldn't be by
ref maybe just doesn't do
anything probably doesn't do
anything okay we're jumping to
there from isad because Python's trying
to call IAL
probably no was trying call
chy but chy IR in the
PLT
[Music]
interesting it is the real ioctl address
right
definitely the real ioctl address the
thing that we're updating is
this I don't exactly understand
why we have to m AC okay it's very clear
that the thing we're updating is
that so why is chdir
broken it's the right number of bytes
I'm not over copying
anything
um why is this
failing
[Music]
52 why does it then
add that's 228 why does it
okay what's possible
is that like it's not a knitted
yet I've seen this be a problem
before okay I mean we could just write a
stub if this really doesn't work we can
write a St but I don't want to have to
do
that why
is why is that
wrong okay let's try something let's
just see quickly if it's possible that
my M protect is breaking
it unhashable
type
why you trying to Hash
it oh let's just change
that expected see you long instead of
in
H okay that me copy is not doing what we
think it's doing because this should
change then
or
no that's the
pointer we want to dreference that how
do I do
that
[Music]
no like that's
the yeah that's a pointer type that's
not what we
want that might be what we
want
bus
error interesting let's just stop there
for
that wrong
type okay I
understand
I mean contents definitely doesn't do
what you think it
does also don't really understand
understand why that's egg
false int has no attribute
value
okay uh fine fine fine fine that goes
there that goes there this is a you long
going in
here does this update that yet okay
finally okay so that updates that all
right so before far it's the ioctl
address
okay now when I call ioctl or when when
this thing calls ioctl it
should call
in the G but it
doesn't this doesn't
work
uh all right where is me actually this
actually wrecks uh ioctl
itself okay let give me a bus so let's
let's figure out what called
that wow that's a terrible
name that's branching to mem comp PLT
and that's what's
crashing
why is that
crashing this must be the wrong address
somehow
what what's so weird about
that is it's confident that it is the
address
right
I I I don't
know I'm clearly updating the one marked
ioctl dog.
PLT
incorrect value in some register bro
word
salad
um I worked really hard to find this and
by that I used mm I was really happy
with myself for using
me but
my
they're clearly
pointers but yet whenever I trace it
back it's always something else that got
corrupted and I can call I octal without
trouble
wait no but that buz eror is probably
just
what
oh even weirder why does it think that
that's
ioctl but okay
cool
oh CU I'm still corrupting the real
ioctl that works
fine
okay this just must not work how I think
it
does
all right all right all right all right
all right all
right let's go back to corrupting the
real iotal and then let's call this and
let's not do any of this cuz this stuff
doesn't
matter delete this
crap
delete that crap
well we definitely don't need that
anymore actually save the call on we'll
get rid of that bro we got to clean this
up
Bo
cool so this is corrupting like the real
bites of the
function
um and now when I call a device it fails
as
expected but the question is where did
it fail from okay this is for some
reason calling into mem comp
PLT oh I might be corrupting too
much
uh let's just
do eight bytes actually we can just do
four bytes is fine that's going to throw
in illegal instruction right so I'm
actually copying those bytes to the
real
um that's the real ioctl of bytes that
I'm
overwriting okay received a legal
instruction great
uh
why does it think that that's mem comp
in the
PLT so it means so this is the address
that it's returning to but for some
reason it thinks it's
mcom
[Music]
this the I control and the God is what
it's not even
close
is the same
run okay well this is the different PLT
anyway uh what is it info
files which PLT is
this
F5 is that even
valid um get further
down wow this loaded a lot of
crap okay 7 F5
CE wow this is a lot of crap that got
loaded 7 F5
c 7
F5 Graphics
common wow so much gets loaded when you
import opencl this is going to be so
great to just
bypass uh
be is there anything that starts with 7
f5e oh here we go live GSL okay good
okay
so yeah this doesn't
work we'd have to find the address okay
okay the problem is I'm corrupting the
wrong got
um there's a g for the relocations are
specific to each Library sorry I should
have thought about this more the
relocations are specific in this case to
live GSL um this coffe is going real
jittery too funkin Donut's cold
brew
uh yeah so I'm not going to be able to
do it like this and we're going to have
to go back to hot patching a
function okay well at least we know what
we have to
do so this turns out to be
useless is this pointer used anywhere
no find the io control
address so this is just getting the io
control
address in
libc we need the stuff that corrupts the
real function yeah this is the good
stuff um now you'll see when I call uh
IAL it's kind of
useless um okay illegal instruction
which is because we're just hitting that
okay all right I w't take a deep breath
regret all of this
work coming back to something beautiful
and simple ground
ourselves and move forward in a clean
way Orion hello
welcome 2000 is good all right so this
is changing the real code in lib's
ioctl we're going to want to change this
to a trampoline to call back so let's
search for arm 64 trampoline and be
upset
um we had an assembler before here we we
go okay let's try some AR 64 and what if
I want to do Branch
to assemble something wrong that's not
valid AR
64 how do I
Branch BR maybe can I do
that we can't just you can't just BR to
a you can't just BR to a you got be with
a register bro can't just be to Nowhere
Man can't just BR to a constant maybe I
can if I do
this something wrong okay
um little adrp
garbage
[Music]
okay so we have code that we can
overwrite but we have to overwrite it
with something that is
uh
totally uh
relocatable
maybe
I don't think that works either yeah
probably do that maybe can't even do
that
okay let look at the ABI and figure out
which registers we can just use I'm sure
there's some we can just
[Music]
use
so
complicated come on perplexity don't let
me
down uh what's the AR 64
AI how are regs passed in and which are
saved
following registers are considered call
or saved and don't need to be saved by
the call
E the following registers must be saved
by the call E if they are used okay
well um 16 sounds good then we'll use
16 except we
can't uh can arm
64 Branch
directly to and
address why do I not think this
works that's arm not AR
64 have a
26 a PC relative load
instruction
can we do BR like
that
great okay we're reaching the
limitations of what this crappy
uh there's no way I can control a
register null break point Thank you for
gifting Subs level six hype train
welcome I appreciate you welcome to my
stream some of you I like some of you I
don't um but everybody is just you know
trying to do their best except for the
people who aren't like the haters and
the
losers okay well that doesn't
work we need to load a value into
that let's disassemble I octl and get
ideas
so okay it looks like you can just move
things can I
move that looks
good
now no but I want to like move like an
arbitrary thing I don't know how to do
that
okay I mean I can put it as like the
next
thing maybe I can do
this no way this is going to
work this doesn't
work okay arm 64
relocate
trampoline
code okay that seems pretty
good
uh
dword okay well that doesn't
work
um
okay who thinks that's
right that's actually going to jump to
data which is not what we
want we want to
load I don't think that's right adrp
like
that better here okay
adrp and we want to
[Music]
LD okay that should
work
um
Tramp struct do pack q and we want the
address of callback which I had stuff to
get
before but now I don't have
it um C types it wasn't just address of
see this is what I get for deleting
[Music]
[Music]
everything level six hype train can you
guys help me out what the required
argument is not an integer right um
ctypes not address of but that's not
right yeah okay let's just see what the
illegal instruction is I want to remind
everybody that we're on Android so
everything just doesn't work as good or
as
well all right we're still copying that
there because we have to actually copy
trampoline thank you everybody thank you
for
participating um if you participated if
you didn't participate well there's
always next time okay there's always
later interesting yeah I think that this
is the
problem
I don't think I actually want that I I
had this
before I can do contents
[Music]
there okay let's cast that to a
pointer yeah it's the same cast as this
right except I might not need to BU ref
[Music]
there
fine that's
not I want that to be an I do value
contents value contents
value
wait
Bros
Bros bros did we just get a call back
did we just did we just get a call back
Bros oh that's right that's right we
just got a call back okay now let's
actually just make this shit match ioctl
oh yeah return minus one there yeah yeah
yeah yeah yeah yeah yeah okay let's go R
yeah call ictl R all right let's see if
the ioctl actually works now if I return
something crazy like 69 here yeah - 69
let's go
oh all right we got a call back with a
trampoline
unfortunately
for
[Music]
all right I had to buite the chemical
food into a pipe on function
right
okay let's try toit the CL device now
man I want that chemical food we got to
eat the chemical food yeah callbacks
okay sweet
um what's the type signature of
ioctl it has an FD no I one
that
wa no but why is it dot do dot it's not
dot dot
dot Remember by time we listen to music
that totally wasn't copyrighted but
apparently everything's copyrighted how
lame is
that bro they should make copyright a Le
you
know um so why ises this
suck how I do this
in I do this in open
pilot okay this is my I octal
Interceptor okay file Dez request ARP
okay all
right so that's a uong and that's a void
p and returns and in no wait that's not
right
um C
types.
in just do I opal call this file DZ
request file de what is
this oh Python's so good uh request not
request this isn't python okay see like
look now look at this beautiful printing
we're going to get cuz we're in
Python all right don't worry we're going
to have to restore the trampoline have
the trampoline back uh types u in oh
don't know u in what am I doing um
what c
in there we go look at that let's make
that a
hex data
XX boom look at that
we can see all the requests right there
because we're intercepting ioctl from
Python and it's not even a lot of code
okay so this was a huge waste of time
and this was a huge waste of time and we
don't need that anymore and we don't
even really need
that that's stupid
too that
okay and do we care about
that not really this is dumb we can just
change that to
that don't need that
anymore that's stupid too okay cool all
right look at the beautiful 26 lines of
code we've written in the last all
morning um but
we can
uh fix this
now uh
okay
before we do
that should
probably
okay we have a backup
[Music]
here this will work okay great now we're
going to have to actually call this I
didn't think this through
okay
um is that a
that work like
that
probably
oh this should be Tramp
C here we want to put in
backup here we want to put that
tramp see if that breaks anything broke
nothing uh we should be able to actually
call IO
here
Weir wait how did that like work
shouldn't have
worked
whatever all right cool complete hook
Hing and
unhooking all right now wait
segmentation
fault illegal
instruction no no don't do this no oh
man this sucks uh we have to flush the
iach python arm flush
iach does arm have an I cache this has
to be the problem though
right it works so well that one time if
I don't print here I have to be able to
print
okay no problems
except python arm flush
cash perplexity do you know about this
is that really in Leb C no you would
hallucinated
this
hallucinated
I'm very curious how it's going to call
this oh quent's a damn wire that's not
right
um
really what I wish is that there was
another
way what if I just call the CIS call
what what's the difference between the
CIS call and the
uh does this use lib
C
if I do an ioctl from python does it use
Li
C I feel like it probably
does yeah that doesn't
work because it's trying to call
that okay so that doesn't
work but I mean actually it's an
interesting idea we can remove that line
if I do it from
python
I don't think it's going to work better
but it's interesting
nonetheless signed integer is greater
than
maximum okay how do I do
an
oh
interesting okay so I have to actually
call it with a
uh no I need to be able a c a c
instruction doesn't
work Al this is old does this apply to
AR 64 find something for AR
um this is actually something that one
of you guys can do okay signed in cre
the maximum yeah uh that's CU that's a
PO going I have to read the
pointer it's encoded in request how big
is I
believe
um
it might just be it might be that 940
this like there's a special type of
request
here
encoded
cisl see notes is it a notes IAL
structure con completely arbitrary blah
blah BL blah I NR type NR
[Music]
size
BSD is the same so
[Music]
useless what's the
stru and I
request
no no you're to no okay never mind I
want gbt 4
back
um
do I have to use mem copy for this and I
could use M Copy okay so one thing I
could do is like call something like
args create string buffer there has to
also be a way to just get bites and not
do this um let's just assume that it's
like length equals request and FFF
something like that
uh fin
M Copy AR
RP
length pass in args there does that
work segmentation P very
fast
okay well it's a different problem Oh
this is probably
because no that's clearly a pointer I
don't understand
this
oh okay
cool invalid
argument
okay so that's not the
length how do I get the
length i' I've done this before maybe I
even have it in in
need
let's close some of these stupid
windows
close
close this
one see what's Def
come on how many people are watching and
none of you can help me
out then you were like oh yeah I looked
up like iow how many people
watching
[Music]
can't I'm get an answer on that around
9900 900 people watching and none of
y'all can help
me all right it's this yeah it's this
what and orbits type bits
[Music]
what type size shift is this dir shift
is this okay so we got to go like this
and then the first two Byes di so I can
do 3 FFF that should be
right invalid
argument what is an invalid argument
not
FD I don't restore this we're going to
that right we're going but that's
fine OS
error
oh is that maybe
allowed
Quest per limited Val 32
bets like bites or an object supporting
the read WR B interface like
by and all but the last
case the ioctl fails and oh s error
exception is raised
interesting
um maybe that one's supposed to
fail okay I shouldn't have deleted I
didn't delete that okay so we could
still do Liv c. all FD request RP and
rat and let's move this down here and
say right there okay
cool um we don't actually need any of
that
oh okay so some of these are supposed to
return minus one but not that one and
we're getting on segmentation fault
because something's happening with my
trampolines
do we figure how to
flush flush
iash AR 62
instruction flush
dcash flush the hold
[Music]
dcash flush cash user range
what args not ARG P Bro like I literally
don't know if you're a troll or not you
know
I literally don't know like maybe the
registers are wrong like I don't know
maybe they're
wrong
um is anyone paying
attention is anyone paying attention or
is this just this just like background
noise cuz I'm just going to I'm just
going to turn the stream on off if no
one's paying attention you know what I
mean 900 people
watching right can you follow this does
everyone know what an instruction cach
is why do you never teach your stuff
because none of you pay attention you
know see how many of you just consume
this content mindlessly and how many of
you sit down and try to follow
along
right how many you are really like oh I
see what he's trying to do can someone
explain explain it to
me followed but you can't read it's so
small you'll follow the 1.5x version no
you won't who are you lying to
man
you're just here for the rants you know
what we might be done with streaming
today we might be done it is true you
get you get very active when I when I
rant
about uh bullshit you have no
mind I have the lowest quality
audience you're zooming but you're
following good explain it to
me
why is this saying a legal instruction
and even worse why is it
non-deterministic why does it work
sometime and not other
times no it's not because of Qualcomm
no mystery or it's not a
mystery
does this
work
interesting
what what is um oh look here look we
found this stuff oh that's
nice finally we found the good we found
the good uh The Good the good file all
right of course it doesn't actually have
the thing I'm looking for in it but
all right
I is that going to work
uh
okay now the question is what if we
don't back it up what if we just
literally create a better iopl I just
use that forever and forget the one in
lipy there we go look at
that
great okay don't need
that um don't need
this don't need this just do that okay
sweet um backups are
stupid we can move that down there okay
go go go go go don't want to be rude but
I don't know why you so mad bro bro get
banned get
banned oh you're sub for two months all
right I won't ban you but like
bro
yeah see at what
point at what point are you the dancing
monkey right what what's what's that of
course it's a very copyrighted lyric but
can you tell which side of the glass
you're on right can you tell can you
tell which side of the glass you're
on
we'll delete that crap oh beautiful
right we just use lipy CIS call
oh we finally have working patchy yes we
have finally working patchy good very
good all right we should probably like
flush the cash but it doesn't really
matter cuz I don't think we've ever
called it we're all on the same side of
the glass we're literally not we're
literally not bro there are literally a
piece of glass between us and the camera
sensor right it's right in the front of
my Logitech C920 right okay cool look at
this beautiful beautiful we have python
can you believe think of how many lines
of code everything else would be oh we
don't need this this is stupid delete
that
deleted oh
beautiful we get libc we get the ioctl
address we hav protect it so we can
write to it we copy the trampoline
in trampoline is call back why didn't
calling from lib seawork it did but my
restoring of the
trampoline the NSA Hot Patch yes exactly
exactly
uh
okay so I kind of wanted some of that
code I deleted we should probably start
putting this in
yet cooking
works by the way you know where on
Android
right qualcom doesn't tell you what CPU
it is if you do that it's just this
problem
processor we have
uh see it tells you it's Linux but over
there it tells you it's
Android
um 12 gigs of
RAM 8
cores this is what we're on by the
way it's a h Samsung zold 5
no hopeing Google anymore you know you
guys make me realize that a lot of the
conversations I have are
stupid
um okay so if we want to get
this
pointer is there some way to get access
to that
memory like I could use mem copy and
stuff but that's a lot of work all right
we'll we'll do what we know works for
now
uh here we have the answer to well
actually we already know what it is okay
so we can just say length equals request
shift shift
16 request here
go
uh equals that
libc M Copy buff RP like X
down um segmentation fault because this
needs to be AC types C
long there we go okay so that's actually
the
data uh from the string but we don't how
do I do this I can just cast it
right like we do this kind of stuff in
tiny
grad like C types helpers for this why
is C type so confusing this is not tiny
GR
okay so this is from a memory view so C
types
cast like does this
work C types. pointer let's say
[Music]
C
segmentation
segmentation fult
d
there has to be another there's another
function like create string buffer but
it's just memory I
think creates a mutable character
buffer oh AIT size well at least I can
just pass a size in
here does that
work okay at least we're not getting the
one stupid extra thing anymore
um fine that's
fine right uh so those are the those are
the
arguments see these are the
uh that's the argument right now we're
going to need to parse the
structs which gets a little bit
crazier so all all these requests are
are defined as I opal so we can look
here and we can see what actual number
it is maybe we want to actually break it
out okay so an ioctl has a
number
uh a number a type a size for 14 and a
Direction so they don't call it length
they call it size let's use their nor
clature
um size we have number we have type
can't I call it type what
is either ize I type and number so
that's the size for this one we want
want request shift shift
30 this one we want request shift shift
a and that and for this one we just want
request and
that
um let's break this
out uh
either
size uh size hex
um some pars
here I mean I want to build up really
good tools for this because I want to do
this for all the
gpus that head Stop's kind of
annoying
okay
uh okay
cool
maybe it has to do with Sundar Pasa you
know what you want to bait me you want
to get banned subscriber for two months
were you A Gifted sub or were you a real
sub you know I really appreciate you sub
gifters but the problem is the giftes
are not always worthy of being a
subscriber you
know all right
so where are all these iotal they're in
the kernel should we go get the
kernel zold five kernel
source no that's the zold
2 of course that's
add
uh okay here we go Samsung open source
all right let's see their confusing ass
website where they do the minimum
possible to comply with the
GPL and if they feel differently about
it I'm sorry for the
slander who look at
that okay so how do I get the
Release Center mobile
phone okay okay very confusing so what's
the uh old five model
number all
right
search
Source download selected files they must
not exceed 1 Gab
my source download purpose is
ETC all
right because those numbers are all in
the
kernel all right of course Samsung makes
their open- Source download thing as
egregiously slow as possible
oh if they make you sign up that should
be a violation of the GPL wait I I don't
even like like is there another place to
get this
file
nope right well the good news is we can
probably just get the
Qualcomm uh 8550 reference
kernel
these also might just be the
same as the uh as the ones in need so
let's just take a look there can I have
a TC here I don't have a TC I have a TC
here we have a TC
okay
um
no this is a commment very vom ass
[Music]
too
this
okay so GPU OB Alec is type
45 K GSL type Alex is hopefully oh it's
nine oh you know what else is nine our
type over here okay
sweet um so these actually kind of look
the same they might just be the same as
this one which means qualcom hasn't
changed them in a long time which means
thank you welcome I appreciate
you okay NR 45 what's a
45 GSL GPU type Alec okay we call Alec
here 45 look at
that yeah now we get an object info oh
sweet okay so what we're doing for those
of you who aren't paying any
attention
is
there's a
file in user space on Android that
basically is the GPU uh driver but these
GPU drivers as you can see make lots of
stupid ioctls many you probably don't
need um so what we're going to do is
we're going to
extract uh what the driver is actually
doing and then we're going to write our
own compatible driver
um
so
like we really need to get this
file in Python let's figure out how to
do that um so I released this thing
called GPU C
types and we can probably use the same
stuff I use
here I use this other
project um
called sh my own Fork
off what are the odds that's going to
work very
low do I have clang what version of
clang do I
have
kind of doubt this is going to
work by the way we're on Android here
just just just so you know when stuff
doesn't work it's you won't experience
the same
terribleness uh P install
dot okay cl to
p no module named package resource
pip install setup
tools cl to
Pi
okay um let's go get
that should I put this in examples I put
in
extra shouldn't put it in examples it's
really not an example it's really an
extra but then I have to figure how to
move it we'll we do with that
later um extra let's say it's called
qcom GPU driver that sounds something
I'll enjoy typing over and over
again
uh let's get that file from here third
party Linux include MSM kgl in open
pilot third party Linux
include MSM kgl I don't think it Imports
Linux type and Linux
ioctl probably things I don't have but
maybe I do have them we will find
out let's get that now let's try clang
to Pi
that source code has too many
errors did I try pip install all clang
oh let's
go it's only a
warning doesn't seem like a big deal
okay but we are going to need to Define
some of these types
apparently a size T un sign long let's
see if that fixes those
errors find a u 64t what's a un 64t and
unin long great
love okay that was
easy
um unfortunately it doesn't seem to
extract the ials but we do get the
commands which is
cool
oh there might be a flag for that I
think there's a flag that I passed a
Clank to
Pi
uh that's in GPU types
generate no
here here here we
go um oh well I can pass in an output
which is
cool maybe they are here and I just
don't see
them
like I think that these defines are
not that's not going to I mean that's
all ruined by the pre-processor
so we should be able to just extract
them
if I have this stuff here
okay
uh.
file parent SL
extra qcom GPU
driver. parent. par
um kgs
l.h.
read
lines
like a jit for calls on the GPU
exactly uh what posic path object has no
it's not read it's like a
read this has a
read read
text cool
um
yeah that's a little
Annoying with the
slashes so we're going to have to first
remove
those uh
do header. replace by the way imagine
trying to do this in C how does anyone
code in that language man place that
with nothing look at those slashes
beautiful okay cool um and I want to
filter all lines
that x x
in uh header do remember when I was
doing the on liners for Advent a codes
split
sln if x. starts
with uh
Define
what um no let's join them with
that okay
cool be nice if like this shit parsed it
for me but like you know you can't have
everything
um what's really important is that these
structs
work so I should be able
to from
extra.com GPU driver.
Ms um
import oh my god let's get the Alex
struct GPU object
Alec might actually be quicker to just
do these by
hand I know it sucks
but no module extra
uh s
pend okay not called that what's it
called so I created this which should
contain all the structs at least but it
doesn't contain the
defines CU that's only in C I think it's
called struct underst
store okay
cool okay so those are all the types uh
um if NR
equals is there way to pretty print a
struct i wored that there's not which
sucks C types pretty print
struct get Adder uh all right
whatever wow is that python to
code field type S
do Fields um I don't think it's like oh
maybe it is okay
uh C types.
Cast stru GPU Alec RP this is only if
it's that y y y y y okay is that going
to work no of course not but we're going
to run it out
way open clr6
didn't like that wrong
type
pointer wrong
type oh this goes there do backward
argument two must be a pointer
type O ex CutiePie you know if you paid
attention you
know uh okay it must be a pointer timee
okay well I need a pointer to
that
okay what's it whining about now long
pointer destruct has no attribute Fields
okay now how do I dreference the
pointer can I like what if I know about
a field can I print like s.
size uh no but can I do s. contents.
size Maybe
okay that works cool uh
contents that going to
work yeah
buddy okay now for each
Alec we can
see this is the allocation right there
size Flags
ven pretty cool
uh let's not do this terrible you know
it's the future we can give that a
little bit of
that do maybe make it hex do that do
that yeah yeah yeah throw a little
uh that in front of it cool um and
actually we don't need this anymore I
can just directly cast it so
cool cool all
right now we have Alec being
called
um now we just like if we can do that
automatically the amount of time I've
wasted in C writing this stuff see has
zero
introspection
um we're using open CL but see we're not
really using open CL right so I bet if I
call another Alec here
like notice that that oh that second
Alec does do something but actually this
is kind of interesting right we're
passing in 16 but the size that it's
allocating is hex a
th000 so what if I allocate hex
2000 see the first Alec so it's rounding
it up to hex 1000 and egregiously
wasting your memory um it seems like
everything has to be page aligned right
by the way I just
like everybody out there who's like
using like like
like I think that so much of modern
software development is just completely
wrong we build
these abstractions and these apis on top
of things um to try to ensure uniformity
but all of these abstractions are leaky
right like so when I pass in 16 and by
the way this is you can read the code
for uh you can read the code here for
Ops GPU right the code for Ops GPU here
to Alec is actually just calling seal
create buffer so that's the lowest level
API exposed by open
CL but you see that when I call this
with 16 it's actually allocating 4
kilobytes and I have no control over
that also notice that all these other
things are being allocated up
here um which I didn't ask for I don't
really know what they are
it's all part of the init device so
we're going to write a 100 line we're
going to write a entire GPU driver
that's the same length as
this
um
yeah okay it's going to be a little bit
longer than this probably it's probably
a bit of setup you have to do but I want
to replace all the user spaces uh we can
use them just for compilers but I want
all the user spaces replaced and I want
the raw I want the generic GPU driver
that just works with every
GPU yeah you realize this when you start
doing embedded stuff the amount of
absolute
crap the the reason that you make a
react app that uses 3 gab of RAM on
somebody's computer to basically be a
button is insane and you know this is
very if anyone from Jonathan blow's
audience is still here he complains
about this stuff a lot
like the lowest comp denominator I mean
a lot of these people should just be
excluded from writing software and all
the software in the world would be
better I mean like not like excluded by
anybody but just like
like here's here's my bar here's my bar
to whether you should be writing
software or not do you understand what
you are
doing all
right when you when you write some
JavaScript right in Chrome do you
understand what that is I interviewed a
candidate like I was asking these
questions and he was just confused by
them like like what is that what is
Docker right how could you write your
own Docker what is Javascript right if I
ask you what is
Javascript uh what what would you
say virtual Dom Eat Hot Chip be bisexual
and lie the fuck is a virtual Dom well
let's just see this is what I mean like
like I know a okay so what you've done
with a virtual Dom is you built
abstraction on top of this thing called
the Dom do you understand what the Dom
is
Right high level code that the browser
understands okay that's great now when
you actually run JavaScript what
happens right like what's happening on
your computer when you have magical
JavaScript do you do you
know and like there's layers of
abstraction that are kind of okay um we
don't hold the people in comma research
like the people in comma research uh I
would not be upset if you uh didn't know
what JavaScript actually did it gets
translated to
C++ yes it translates it to C+ see this
is what I mean like the level of
stupidity that's wrong do you know
that's wrong are you trolling the
JavaScript is nowhere translated to C++
V8 is written in C++ but that's
different all right keep that complexity
straight so we don't hold like the
people in comma research I'm not going
to ask the person in common research
what uh well how does JavaScript work
but I am going to ask what a softmax is
and you better be able to tell me what a
softmax actually is and not well torch
has this function called softmax and you
call it
no why wouldn't I care about my research
people knowing that because it's not
that relevant right like you can't know
everything right but what you are
working on the piece that you are
working on right if you think about it
like a tree right like a big a big a big
a big dag right a big a big directed
ayylic graph of all the knowledge in the
world you should understand all the
nodes up your
Dag
and the only way you can break the tree
is if you truly have a perfect isolation
which you don't math is a perfect
isolation this right here I'm telling it
to Alex 16 and it's aling 4
kilobytes right it gets even deeper
right this just happens to be this
beautiful you know abstraction to the
kernel but now we can get to like what's
actually in the
hardware like down to sh registers and
mosfets well kind of
right I mean let's see let's see how
many no no no no no no if in JavaScript
you do not understand the concept of a
jit you should not be coding JavaScript
right you should understand what the
browser is doing when it runs your
code yeah if you don't understand the
platform how the platform you're
building on works the software you put
together is Bal to be
bad code is then a runner executed by a
JavaScript engine okay that's great
what's a JavaScript
engine why should one understand any of
it I mean you don't have to understand
it but if you don't stop
programming right like like like all
this bad code in the world and then the
rest of the world starts to cater to bad
code
the stupid apis the stupid libraries are
built around crappy
programmers and look I'm all for a lot
of times like look I'm no fan of Arch
Linux or nxs or any of these things that
are just nerdy right A lot of times the
simplest thing that most people use is
also the best thing um a lot of times I
this is also true about movies too right
like a lot of times the the bigname
movie is also like I mean maybe you know
there are exceptions to this but a lot
of times the the popular movies in art
are actually good because they work on
many different
levels
um well yeah no no no but then the
Frameworks build complexity on top of
this and then you have people who like
are there people out there who are
coding in some JavaScript framework and
don't even understand what JavaScript
is well because you're not actually
thinking about what the computer's doing
you're not actually thinking about what
you're asking it for
right and now we're going to build a
whole new layer of abstraction on top of
things out but what's cool about this
layer of abstraction is we're going to
be able to build this like there's no
excuse like all this stuff's like open
source and runs on your computer right
you should just be reading the code um
or at least having a good understanding
of what's actually
happening
uh give you a job at commet AI are you
kidding man did you do the programming
challenge did you solve bounties like
where do you think jobs come from the
job fairy grants it to you because they
like your you know that that that you
that you went to Harvard and and and and
and suck thick of the
system
um CPU does not really operate on the
quantum level you don't want any Quantum
shit if you're getting Quantum effects
your CPU got too
small
uh no I I mean the problem JavaScript is
is
is um is a trash sheep because like
exactly of this right like a lot of
times I think we've done it a few times
on this channel where we rip on like you
know the low quality programming
languages and also see that the that the
English and the stack Overflow post is
also bad and it's not bad in the sense
of like I'm not saying that like these
are foreign people who can't speak
English I'm saying that these are people
who can't communicate
clearly right you you find that
that you know all the foreign people you
know you never really know because they
learn to communicate really well in
whatever the chosen languages right
communicating in in English and
communicating in programming are the
same
[Music]
thing
um every programmer should understand
the Deep work in operating systems yeah
I mean anyone wants to work on the other
teams at come and you better understand
what a CIS call is right and like not
like I don't want to hear when I ask you
what a CIS call is is right if I can
like I can tell if what you're doing is
like reciting something you learned
about what a CIS call was in
school
um I can tell the difference between
that and you've actually like for
example so here's my IAL thing libc
cisal right how would you know that you
can lib C CIS call 1D and that's
actually the pretty much the same thing
as lib c
octyl um how many people in charge of
hiring can't pick up on that Nuance yeah
right um and like this is why you know
my companies don't hire many people
like what needs to happen is companies
need to stop
tolerating people who don't understand
people who just like oh but they can get
the job done like no what you've done is
you've made a short-term
tradeoff maybe it might not have even
been good in the short term but it
definitely wasn't good in the long term
if tiny grad succeeds if this project
actually succeeds and goes on to become
a major uh neural network framework in
5,000 lines I hope that everybody
rethinks what they've been doing in
software for the last 20 years
it's like complexity Builds on
complexity tiny gd's small enough that
you can see it as the whole picture if
you put one hack in here the hacks grow
the hacks grow exponentially because you
put one hack at the low level right and
now you need two hacks up here at this
level to fix that hack to work around
that hack right but now you need you
know two hacks up here to work around
each one of those hacks you're have four
hacks right then the whole thing just
becomes
hacks how young do I hire we don't
discriminate based on anything
discrimination is really stupid
right like if you're discriminating what
you're doing I can't believe that also
you know a bunch of responses to my to
my tweet about the things were like you
just don't want to pay American
salaries bro I take a look I posted my
salary ranges right I posted my salary
ranges is you know at the high end of
that it's it's a total comp a half
million like and you know again you can
we can debate the valuation of tiny Corp
but you know this is what investors
valued with that and show projected
revenue and stuff right so it's not a
it's not a price thing it really has
nothing to do with a price thing
um if you demonstrate to me that you can
produce the value I'm happy to pay you
whatever right it's it's not not worried
about that
um a lot of it is a is a is a work ethic
thing a lot of it is a you
know this is this
is it's so sad it's
so it's not
like you know you're not willing to work
80 hour weeks that's not even the
problem right it's you really have to
care you really do and if you don't
care why are you here why are you in
this industry right like get the fuck
out like care or leave right it's that
simple we're angry
today um we discriminate based on two
things right we discriminate based on
skill and
motivation um so you know someone can be
incredibly skilled and unmotivated and
uh you know we don't want them and
someone can be incredibly motivated but
unskilled we don't want them right but
that pretty much covers the whole
thing um if you're here for a paycheck
please leave you are making software wor
for
everybody you are making software worse
for everybody right this is not like
look if you're at a if you're at an
Amazon fulfillment center and you uh you
know you're there for the paycheck
that's great right I got my package I
don't have any complaints right you're
below the API lines two groups of people
in the world right there people above
the API line who tell computers what to
do and the people below the API line who
uh who get told what to do by computers
if you're getting told what to do by
computers by all means be there for
paycheck whatever but if you're telling
computers what to do what you do and the
work you do affects the industry and
affects everybody else right so you know
the reason we have shit um you think
about
that how would you go from above the API
below the API line to above it Okay so
we've talked about what you can't change
uh and what you can change right so it
turns out things like growth mindset
don't really affect anything
your IQ is fairly fixed even your
motivation seems to be fairly fixed
right so these things are all fixed um
how much how much motivation you have in
the morning how smart you are fixed two
things you can control okay you can you
can control your choices you can control
your
habits um by
establishing uh bad habits you know you
you things don't get better by
establishing good habits things get
better things like and good habits this
can this can vary in in all sorts of
different ways to like you know
um this basic stuff right and then the
other one you can change
is like a how questioned is your life
philosophy right how how far have you
really thought it through um if you are
just here for a paycheck just don't like
like just
don't you you end up making more work
for other people and this is the really
the truly unforgivable sinners in this
world are the people who exist to make
work more work for other people and know
what they're doing right these are the
truly unforgivable sinners in the world
the the the like the person you know the
common example I give is the the
lobbyists for H&R Block that Lobby to
keep the tax code
complex the people who are literally
unknowingly working to make other
people's lives worse so that they can
can uh you know continue to make
money in our world democracy the world
ain't a democracy
man
um well how much work you put in matters
it definitely does matter right you know
I like like that carac has a good take
on this right um
if you're putting 40 hours a week into
something versus 80 hours a week you're
probably not going to be twice as
productive at 80 hours a week but you
are going to be more productive at 80
hours a week than you would be at 40
hours a week it's pretty obviously
true
um so but it's also it's a lot of it as
a question of what you're working on and
why you're working on it right if you
find yourself in a place where you
entirely just thrashing under complexity
where all the layers below you have too
many hacks in
them like this is how things start to uh
start to collapse it depends on your
mental stamina like again the thing is
you can control or your habits and like
your life philosophy and choices right
again if you're showing up to software
for a paycheck please quit you can
actually do that that's a decision that
you can
make
and we don't live in a dream Society we
don't live in a dream Society okay uh
millions of people continue to die every
year uh we're on a single planet uh we
don't have fully immersive virtual
reality uh you know we are not in a
dream Society there there's so much
further that we can go when we have you
live in the culture fine you know you
live in the culture from the the Ian
Banks novel you're a human born into
that world you're a human born into a
world with Minds great you're wire
headed but right do whatever you want
but we're not there we're not there
yet um the workforce landscape is going
to change drastically I think we're at
the end of this stream I think actually
this is a pretty good stream today I
will commit this but hopefully everyone
understands what we built here and how
you can go from this to building GPU
drivers right the next step is figuring
out more of these IO controls the next
step is writing code to call the io
controls yourself
um and then that's a GPU driver
right you just got here well
welcome
uh no it's really not understandable
right if you want money there's a lot of
easier ways to get
money um
again whatever you know truly if you're
truly in something that that that is
that's isolated from everybody else and
you're doing it to make money whatever
the problem is when you're making money
at the expense of other people and you
have to think about that not first order
effects but second and third order
effects think every day about what
you're doing and whether what you're
doing in its second and third or you
know about second and third order
effects you know this this famous story
where um there's like a frog infestation
on on an island and the Brits offered 10
cents per dead frog people brought in
right um so you know this was we'll get
rid of all the frogs right 10 cents a
frog that's great first order effect
less frogs second order effect some
entrepreneur entrepreneurial people are
like well what if I breed frogs in my
basement then kill them then bring them
in and earn big money so a whole bunch
of people started doing this they earned
tons of money bringing in the frogs that
they brought in their basement the
British are like people are scamming us
uh we're going to stop doing this uh so
you know we're going to stop giving the
10 cents so guess what happened all the
people who are breeding frogs released
them and now you had more frogs than
before and you lost money right if you
were the Frog breeder you're evil you're
evil
um
all right we'll let nonsubscribers talk
see if nonsubscribers have anything to
say no shot anyone is actually putting
in 80 hours a week I work more than 80
hours a week bro when I'm actually
working iio you ring
internals
interesting
what is this used for I've never used
this
I've never used this
before like you I've seen this stuff in
the kernel but I've never seen it
exposed to user bace
before
[Music]
wow so what do I think about Google
limiting this like all just heard is
that there's lots of great security
vulnerabilities in uh by the way uh fun
fact if you uh if you root
this if you figure out a user space
exploit to root this say for example in
the Qualcomm GPU using the ioctls you
root this too it's the same
chip um so if someone wants to root the
quest three it's the same root as
that I'm too old for this right but
where are the kids
where where where are the kids who pick
up the torch it's not harder
today what should companies do if they
can't find strong Specialists from she
was not 18 it's better to start somehow
then tell investors we can't find
anyone
dude like I don't know why' you take
money if you can't make progress on the
problem
yourself you
know like just sit down and start making
progress
yourself and then like eventually figure
out what you're doing every day and find
someone who can come in and do what
you're doing if you took money for a
project that you can't make any progress
on yourself give the money
back
um you can sell zero day for cool one
mil why would you sell don't sell the
zero day
like multiple times like I like tried to
sell exploits but then like it's just
like why why do this you know it's like
not worth it
man um do pwn to own right like at least
everyone gets to see the X P's
cool
uh 's tiny gr optimized for M3 Isa I
mean the metal compiler is pretty good I
don't know if we know the M3 Isa yet
let's see uh there's a project called
Apple GPU let's see if they've updated
it all for
uh the
issue
I don't
know I looked at it and the ISA looked
totally different but I might have did
something
wrong yeah that's the wrong way thinking
what do you mean what percent is written
by AI right written by AI there's no
difference people think there's this
thing called AI right like what do you
think AI is used an editor was that AI
used autocomplete was that AI right used
fuzz testing was that AI like
imagine earning actual models on Quest 3
I mean tiny gr will install without
route you can ADV into it and install
Tiny
grad
um do you think having soft skills is
the key to succeed at every
job I mean yes but there's a lot of
overemphasis on what soft skills
actually are right like like
people uh conflate soft skills with
like
agreeability and this just
isn't that's not what it means right
like soft skills mean like the ability
to to to read social cues right not and
the soft skilles are yeah kind of like a
but for that it's yeah it's like a
requirement for
life um
oh Dragon seor P some trains cool I
trior infin on
trior
uh no reading social cues is not it's
not as complex as you think it is a lot
of this stuff is like over thought not
greeing social cues as much as like
being able to empathize and by EMP
empathize I don't mean feel bad for or
sympathize I mean actually to put
yourself in somebody else's shoes and
think through things from their
perspective that's all that
means is anyone currently working on
integrating AI with debuggers everyone's
working on integrating AI say probably a
Sharpie is going to have ai it's a
Sharpie with AI it warns you if you're
about to write on a surface that you
probably don't want to write on like
have you ever used a Sharpie on a
whiteboard don't worry new Sharpies with
AI will prevent
that um Maran thank you for gifting more
subs you just want to say you hate HR
well I mean it's one of the most
demeaning Human Resources is one of the
most demeaning terms in the world um the
fact that companies with a straight face
will have an a human resources
department well you see we have our iron
ore resources over there we have our
human resources over there right it's
just
dehumanizing um what's pack of people
who are willing to dehumanize others
well comm's an idiot sounds about right
right
um she was not 18 thank you for gifting
Subs
uh I love this I love this culture of
gifting Subs this is this is nice I've
been making some money off twitch lately
I enough to buy this
phone um and people Ops is better people
Ops is better as long as that's
genuinely what it is right you have
devops and people Ops that's
fine
HR is the globalist back door I mean
there is some truth to that right
there's some truth to how the like you
you have to be very
careful when you start interacting with
the system like like yes they are trying
to they are trying to backdoor your
company effectively right like the the
Nazis would do this explicitly the Nazis
just had a rule that says if you had a
company and Nazi Germany you had to have
one Nazi party member on your board
right in America you know we Tred try to
do this in all sorts of subtle ways
right we do it with things like
compliance we do it with things like
diversity but it's the same basic idea
right um You need to have one
underrepresented minority on your board
right it's basically the same thing as
you know you need to have one Nazi on
your board right it doesn't have to be
whoa whoa whoa your board doesn't have
to be controlled by Nazis we just need
someone in there right
um Intel gives employees a 10K bonus if
they recommend a diverse candidate I
mean I'd like to see lawsuits for all
this stuff right this stuff's illegal um
you know it's illegal and it should be
to discriminate based on race uh to to
to use race in the hiring process uh you
know just it's it's it's racist there's
no other word for it um it's a damn
shame that you know the the these
racists have this this like they they
have this like it's not racism it's
Reverse Racism you don't understand man
I'm not punching you in the face I'm
reverse punching you in the face right
like what what's the
difference
um it is racism regardless I mean this
is this is this is one of the death
blows to the uh to the globalist
American
Empire I just you know I see that reply
from the Dubai guy and it's like look
there's a lot of stuff I like about
America but this country is really going
in you know it's going the wrong
direction and and the I'm not saying
this is like a conservative right not
saying this is like I don't like the
social progress that's been made no I'm
saying this in the sense of
like
like where's the where's the where's the
train where's the highspeed train in
California right where's the
infrastructure where's the where's the
new buildings where's the new better
stuff
um I mean the Ivy League schools
uh I used to was saying like this ends
with tanks on the Harvard campus maybe
it still
does you can say thank the car lobbyist
for the bad train Network this isn't
really actually the problem like the
problem is that you can't make lobbying
illegal but what you can do is not give
the government any power that's worth
lobbying for right as long as that power
exists people will spend money to try to
C
but why does the government have a say
in whether Elon can launch a rocket or
not right why does the why do you have
to get a wildlife fishing game permit to
launch a rocket
right
um do I vote no no voting is
a it's a psychological trick
basically you feel like complicit in in
the system because you voted for it but
the problem is all the real decisions
are made look if your two choices in
2024 Trump and Biden the the what you've
missed is all the selection before that
right we we have we have we have 350
million people in this country right why
are the choices the same two and they
happen to be the same two who ran in the
last election this isn't democracy
right I me South Park does this well
it's like the douche and the turd like
that's that's what it is um and the
Empire collapsed look hey Bin Laden's
you know Bin Laden's laughed in his
grave man he did it he did it good on
him you know he he succeeded he brought
down the American
Empire uh with a lot of the same things
that brought down the Soviet
Empire uh do I think there's no point in
needing permission to launch a giant
rocket not
really right like what are you worried
about you worried about your neighbor
might build a giant rock it and launch
it for some reason I doubt
it no it's not marketing it it has
nothing to do with marketing budgets
right H it has to do with whether you're
you're you know in the nobility or not
right they just they just do it a little
bit differently it's the same thing
that's existed in every you know in
every in every oligarchy right there's
no there's no there's the the class of
people who can run right it's kind of
funny like they made Donald Trump out to
be this whole bad guy
but you know Donald Trump was at the
same parties as Bill Hillary Clinton
right imagine Hillary Clinton instead of
you know taking the thing that she did
was like Hey Trump you know look you're
at that party hey you remember remember
that uh remember that party back in 92
right because that's really but but that
you know that would if you wanted to
attack Trump successfully you do that
right um but it's the same it's the same
class and it's not you and it's not
anyone who represents any of your
interests in any real
[Music]
way
um stick to Tech where I know it well no
trust me I know this stuff well too I
know this stuff well too and why are you
saying that right why are you saying
that what are you what are you clinging
to right I can't believe you know some
of the responses to my my my tweet
yesterday right like it was actually it
was more attacks from right-wing people
than leftwing people
um
well no I mean this is this is one of
the this is one of the the the
techniques they
use no but it's just like you're wrong
and I'm right right I've spent a lot of
time thinking about this there's a lot
of stuff that I don't know much about
right if you ask me about like uh you
know what it takes to to farm carrots
right like I don't know that much about
farming carrots you might know more than
me about it right um but when it comes
to what actually makes countries and
Empire successful over the long term
I've spent a lot of time thinking about
this
lately uh
right well no
like so you start thinking about your
life you start thinking about what's
going to affect your life outcome in 30
years right and you don't want to be uh
you don't want to be boxer from Animal
Farm right you don't want to be the guy
who just says I will work harder right
the whole Farm is rotten right don't be
boxer the throws the
horse I'm not a marelli I'm telling you
this is actually what
makes
like and I guess it's the same it's the
same like like group of people that
needs to
it's the Dells it's the same group of
people it's the people who don't
genuinely want
progress and I'm not talking about
progress in some vague social sense
right some people may think that's un
progressed but I hope everybody
agrees that a plane that goes faster is
better than a plane that goes slower I
hope everybody agrees that having the
option to have planes is a whole lot
better than having the option to have
covered wagons and having the option to
have teleporters and Hyper Loops is
better than having
planes a sonic boom is a technical
problem you can deal with
it what's my opinion on climate change I
think that it's a technical problem and
it needs to have a technical solution
and no amount of histrionics or shame or
guilt are you know
appropriate for what's a fundamentally a
scientific issue that has you know you
can talk about the potential bad effects
of climate change you can talk about
ways to mitigate them right I don't want
to hear some histrionic about how New
York is going to be underwater in 10
years like it won't right and I would
like to have that person if that person
truly believes that can they bet me
their life savings right bet me your
life savings that New York will not be
underwater in 10 years right prediction
markets
um I don't know anything about the FEA
Court law law the more you start like
learning about this stuff
they uh it rewires your brain to think
like it's a mind
virus
well no
but it's not a money and economy
question right the problem is the
money's fake right if the money were
real a lot of this would be fixed so
it's a lot harder the the a level of a
scam you can run is much smaller when
the money is real fundamentally you have
to tie it back to value and uh one time
I went to this
event six seven years ago now and there
was this the head OFA was there and this
guy from dcvc was there and
like I remember so vividly like saying
perception is not reality and he
disagreed with
me right like perception is not
reality the map is not the
territory um I'm not
sure like
a political party can drive
change uh
like I mean America's had these
revolutions before you can go back to
look at what FDR did right so the Great
Depression happens FDR shows up
establishes all pretty much the agencies
that exist today and they had a good
30-year run with
them
um you need something that looks like
that you need something that basically
looks like a coup uh
and I don't think that comes from a
political party I don't think I'm
capable of doing
it
um well I mean look if there's no such
thing as real reality why don't you jump
out a 10 story window right and see what
happens don't worry the ground's not
real
like
um no it's just it's
just sad to
[Music]
be in a in a declining
Empire and similar to the Roman Empire
like there's not really anywhere to
go well don't jump out of a building if
you believe the ground is real if you
believe the ground's fake I mean you'll
find
out um you're sounding like Rio yeah
yeah no I watched I watched his stuff on
this
um all right before you jump out the
10th story window why don't you just
jump up and see if you hit the floor
right just try that nice and safe do do
a small experiment first
guys
um no I'm not sure doio is pessimistic
right like this this especially this
indefinite
optimism
I mean the effective altruists
are probably the same people that are in
the Deep State it's a similar it's
similar
ideas well okay it's more like the Roman
Republic turning into the Empire
maybe maybe we have 200 more good years
I mean that'd be great we need a
Caesar
um for the Youth out there are you in
America or
not you're in
Germany Europe
has I if you're in Sweden and Denmark I
know less about if you're in Mainland
Europe
I mean you're in a museum
largely
um
wow are most people here not in
[Music]
America a very
uh a very diverse crowd
just do a poll all
right it's this website
right does this
work
[Music]
oh you can do plls and twitch
well I'm in
America
wow uh I mean I should have broken
Europe
down I mean had I known yeah Europe is a
whole lot of different things
uh I should have broken it down and I
mean I guess yeah if you're in like
Denmark or Sweden I guess you'd say
Europe as well even though like I guess
I should have broken Europe into like
Eastern Europe Western Europe Nordic and
and uh and and
Britain
um
interesting I mean
Europe seems to
be Portugal is not Eastern Europe
bro
um yeah where are you other people
from
ISS all right all
right what what's up San
Diego I spelled Canada wrong yeah I
probably did if can
yeah I mean Europe is a museum right
like what does anybody expect the next
like great thing to to come out of to
come out of France to come out of
Germany right
like Italy no like they're just not
there's no way in
hell many good scientists do come out of
Europe um mro is from France too but
again you know look at look at the look
at where mvol comes from
right I
mean I'm talking about like on a so you
know FR France France is one I I like to
like pick on in
particular um so like France's GDP per
capita has been completely stagnant
since 20 8
right can I see the
graph all right so
like France Peaks
there Taiwan in that period of time
almost
doubles all right so when does Taiwan
when does Taiwan cross over
France Where's My
Graph all right there go Singapore and
and France are pretty closely tracking
you know one country
Embraces deceleration the other country
Embraces acceleration and that's what
you get should I move to
Singapore yeah I
mean work and life are the same thing
and that this got like mixed up like the
other option besides work is basically
some form of wire
heading
no but like okay I mean it's not quite
at uh France's level yet but there you
know right the the the
Chinese lift out of
[Music]
poverty yeah I've had machine guns
pointed at me in Europe too that's true
it's the only country where I
[Music]
have um yeah the the anti-nuclear
stuff look at India versus Britain I
mean
India um well all right so so here's
here's here's an interesting
one right we'll do we'll do uh UK versus
us right the UK has that same stagnation
the US doesn't which is
interesting um but I argue that most of
this is basically
scamming I me I don't know I actually
don't
know this is an
interesting this is an interesting
number to show America's working
actually okay some some some some white
pill on
America and the US has delivered immense
growth and like it is actually hard to
say that that growth isn't real like
it's sort of real
well yeah so the US is the global Empire
and you know this is um
share of Worlds money in
USD
uh can you show me a longterm graph for
this
uh no
uh this is probably
right but I mean I'd like to see it as
uh I've seen this graph before could
someone find a good
one I want this but going back
further okay do not expect that to make
noise why is this not a
[Music]
gra all right well I mean this it's this
but graph can I see this as a graph can
I see this video as a graph
please um so okay America's On The Rise
you're right look
[Music]
so here you are at I mean that's Peak
America
right okay so so you have the whole
world is using British
pounds um Peak
Britain Peak Britain is
1946 right something happens in Britain
America
explodes
Peak America I mean America does come
back again okay okay this is kind
of 19 yeah like the year we went to the
moon is Peak
America all right here's where we are to
die I don't
know maybe we shouldn't maybe we
shouldn't be so bearish on uh on America
wow the French used to have their own
currency
yeah I mean yeah 19 wow you're right it
correlates perfectly with that I love
this website if you've never seen
this um this is why you're getting
scammed if you're not if you're in
America and you're not making enough
money this is why you're getting scammed
basically the top 1% have figured out
how to like steal the
money
uh 2023 is a lot worse
yeah the Russia sanction you know bricks
bricks um I mean I I I love the idea of
a multi-polar
world I don't know what seems to happen
though is these things Decline and they
don't come
back
USA does have sick geography that's so
true the entire world basically
subsidized American living beyond his
means yeah that's pretty
true uh pay you in crypto I'm happy to
we pay Bounties in either crypto or
PayPal you can
choose the USA doesn't have
me I continue to be a patron of the
United States until it collapses further
and then I will
not all right
uh we'll raid
lxs I do
at am I doing this
wrong
I I vote
no I can't figure out how to do
this
how do I ever do this in the past
everything computers are so hard to
use it doesn't
work oh there we
go
thank you for watching today's
stream uh everybody the uh you know I
don't know man Empire might be okay some
white pills some black pills stop being
a noob be smarter be better you can
change your habits and you can change
your life philosophy you cannot change
your intelligence or your motivation but
you can change those other two things
and that would be a great start to
fixing the world thank you everybody
enjoy your weekend
for
I just dreaming everything you do is
public and you gotta be careful what you
click
go back and let's go cheer now to be
number one let's try this weekly top
Cheers
you
and this is what it says g2o is a
general framework for graph optimization
but we're gonna write our own version
nodes and edges of a graph so I suspect
that under the hood G - o is just
turning things into large matrices
easy out here
let's refactor this a little bit
move all the shit out here
what up I'm ROG passing friendly points
and fixed points that sounds pretty good
idea myself doc frames local frames if
fixed points else self dot frames is
that right why did I write that
definitely move this up here
or have-nots in local frames if
fixpoints else self dot freedoms okay so
you might actually need the local frame
logic here we might just get rid of this
well so there's another way to do this
right you don't actually have to pass in
the frames we could just pass in the
points and the frames will get at it
habla moss suerte see rapido fuerte
Caliente no at the end a square test no
conozco that's that's my high school
Spanish
lopa windows not defined now because I
use that no bueno
these cells I'm gonna have to pass in
max-frame
no see I don't like this no okay we have
to think this through better well that's
what I do Marvel investigator for
keyframes all we're gonna talk about
keyframes boo how chunk win game wind
wailing wailing wailing wailing yeah
her son sir whoo y'all
that's all my shine you guys okay so if
we're actually gonna do this let's take
this through more write this shit okay
come on yo bro
you guys should cheer
so really good have an optimized here yo
come get yo just post in uh whatever
this is you can cheer and I get money
weekly top Cheers
new Tom Cruise cheer your way to the top
learn the sequel's bros
well
so here's a thing to kind of think about
what properties do these things really
have frames and whether they're fixed or
not and we don't want to add a frame to
the graph if it has no points I mean
that's the other way to do this right
like I could actually just insert the
points at each
tell such as a lovely girl but if we
don't agree good we'll get a copyright
strike okay
the optimizer and we are doing need I
think we really need Kay I wonder if
it'll work better if I pass in the
points as that work
there's passing and all camera matrix we
can try that so like we're using KP use
right we can use KP s and then we can
for the camera so this is not all just
pass in in a1100 and see how that works
expressing verbose the optimizer know we
have work works later this is twitch
time you look the errors are much much
smaller I don't know if that's better or
not they actually look identical it's on
a different scale
all right so maybe that'll be the new
way we do things we will pass in the KP
use and we'll get rid of this and then
we don't need decay anymore what when
creating a class don't extend from
object but is that Bajada
iPhone 3 class
you just want me to write that
save your ATP all that means Wow okay is
the optimizer better yeah I just saw it
the arrogant really low but no it's
fucked
no it's like just go in a new room no no
the bad okay
well save all works should get rid of
all I really don't think it does
anything different at all
look at the air go down
okay by the way think about it in terms
of that is probably better then we can
move the optimizer to here we'll put
these guys up here I don't know why Gigi
oh really does want you to put the
camera in it
well okay so what if I say for ID ID O's
frame that's a little annoying
because fight okay then I'm gonna need
my own representation of the points
this whole local window thing is
annoying but maybe that is a parameter
to the optimizer the putting back should
probably be outside of the optimizer
okay so that's all moved GG oh shit at
the frame de Graaff that's alright
points to frame at edges okay now that's
the thing we don't really want to
probably believe it could waive indexing
them did you sent this array frames are
all still in order at least we don't
have like an index array no I'm Sam well
not sure this isn't that bad
see I don't want to put the frames back
here I want to like pass that just be
optimize it right
okay so this you don't want first off
this all crap is stupid I'm not maintain
this electorally factory even better
than this though
we still like passing in these arbitrary
stupid frames and moins classes
so we can get rid yes problem is that
error then doesn't as much meaning
that's okay yeah I thought GPIO was kind
of shitty anyway because like okay what
did that even mean like two pixels
that's gonna change the color
almost like this pruning is back with
the pearl right guys I need you to cheer
or do whatever happens on Twitch so I
can make money because otherwise you
know who's gonna fund these twitch
streams that's right
witching is not free you know somebody's
got to pay for it the bandwidth you
might just have to lower the stream
quality that's right
someone's got to pay for that I'm gonna
say no so after the future
how's our chicken stock
it's a help a std man it's bad type ID
oh did I mess up my refactor or
something did I mess up troll mods get
my troll mods wrong Dan edge bad check X
Y Z V STD bad type ID
oh so that did I go with the all one or
not the all one I want to not be all one
and deleted the camera for everything
and that's why it's complaining yeah
well with the altar coating when you
guys can't see either oh I'm really
terrible I'm sorry
twitchy so I know I've let you down I
know this is why nobody donates to my
channel and and poor so s is just not
what he used to be oh wait I already did
that Wow it's literally already exactly
that function great minds think alike
you know
take your clothes off just dip it off
then why there yeah donate come on oh
gee Hasani yeah y'all bro I don't know
what that is but I think that means I
get money I love money guys money's
little my favorite things in the world
uh you know I love money
all right we factor out I did soon we're
gonna try to write our own optimizer
today and yeah we're going to Taylor
Swift is building a giant wall all right
guys
should we be real on this channel no I
don't know if we could be real on this
channel no no we can't be real we can't
be real no one gave me enough money yet
oh shit two people is that money I don't
even know guys how does twitch work how
does twitch money work ah perfect
they're really showing hard the stream
how much could you reasonably expect to
make and just where does all this money
come from anyway so here we go you're a
smaller time twitch streamer will focus
on twitch since they're a market leader
right now you're just getting started
and through a combination of good
gameplay entrancing charisma
and devilishly good looks you built up a
small base of viewers congratulations if
you got up to 54 he sent me a pyramid I
don't know what that shit means much
more important is that it gives you
additional monetization on ah one of the
most significant ones being
subscriptions a little differently when
they do on sites like YouTube although
streams are free to view some fans
choose to subscribe to streamers that
they like haha not only supports the
streamer financially but gives the
subscriber perks like special emoji and
badges for use in the chatroom as well
as the ability to watch streams without
any twitch advertisements so at the time
of writing twitch subscriptions cost
between five and twenty five US dollars
per month Wow how much the viewer wants
to pay with that money being split half
half between the streamer and the twitch
player and viewers can also purchase
what are called bits alright guys this
is not good content we have to show good
content on this channel we are going to
be a number 1000 twitch channel I don't
understand yeah no they of course it is
man like you know let me tell you
something I used to be a cam girl um and
yeah you have to let your body's like my
free cam dollars ya Bryce well you know
sent the carrier pigeon no I know no
we're gonna be we're gonna be good guys
we're gonna write good quality shit okay
well so this mean is now long because
this is in terms of I don't know what a
good error function actually is there
should we do something like just call a
certain amount of points or yeah this is
greater than zero service no it seems
pretty good
why is it - cam so expensive because we
love money if we didn't love money it
would be cheaper but we love money
what's the problem but we really not to
talk in self-driving cars on this
channel we talk about slam and we're
about to write Levenberg mark Watts
kicks
you know the scrolling is backwards on
this computer so when I go to normal
computers I'm confused
okay so let's think about the problem
we're frames we have points and we want
to determine relationships between them
so my guess is what this actually
becomes is a really big
oh hell yeah Wilford yeah yeah I have
seen I have seen people do this before
so I like I watch I know what I watched
on Twitch i watch a mario 64 120 star
speedrun and yeah yeah okay by the way
is anyone there going to another pyramid
man
is anyone go to the cvpr because I'm
thinking about going if I make enough
money on Twitch to afford my cvpr truck
that's my dream man send me the cvpr I
know it's not like super good games done
quick or whatever but but cvpr bro make
enough money to send me the cvpr
okay no no we have to focus on content
quality we can't just come on Twitch and
talk about how we want money that's not
good quality content
neither is saying that so that's a
problem I'll be right back to Ritchie's
you want to support from Trump
so what we want to do is we want to take
this reprojection error and we want to
make it into like a flat matrix which I
think we can do right like we can just
flatten it out it's a three by F dot
pose P dot modulus no bro live stream
hacking it'll get too many viewers okay
we gotta think about what we want to do
but I don't know about Levenberg marquab
but we were looking at mr. iBooks here I
was looking here at uh applied linear
algebra nice squares so it is it's a
least squares format suppose that an M
by M matrix is a tall so that the system
of linear equations is over determined
so we're gonna need an over determined
system of linear equations yeah
I mean I think I could just stack the
poses and stack the points can i but the
real game is so we have to figure out
what we want to optimize we have to put
it in the format of least squares
somehow g2o is doing this such that I
know it's nonlinear least squares -
which was even worse somehow they're
doing it such that the pose and the
points get optimized see them sad this
is really so right here is actually all
the things we need to optimize let's
just comment this out for now this looks
like we don't use an optimizer at all
wow it sadly looks similar one on our
brakes no brakes yes we go now but cool
phone sub three well that's okay we want
to simultaneously solve for all of these
projection equations now we could
optimize each point independently in
terms of least squares but that wouldn't
jointly optimize the poses and the
points at the same time like I'm really
I'm really just not sure how to do this
right do I write out two matrices and
like like ping-pong kind of back and
forth I mean maybe that's what it does
damply squares is used to solve
non-linear least squares problems seems
like a generic way to solve nonlinear
least squares problems
like do you see the problem like it will
try to matrices like I could put the
pose okay maybe maybe the GTL papers
talk about this sitar
and I know I have to make the papers
bigger so you have to read them this
example illustrates how to represent an
objective function by a graph now I
could write an objective function I mean
okay so maybe that's just the idea maybe
first we just write an objective
function and then after we figure out
how to optimize that the whole objective
function I want to optimize it's just
this but like spread out a lot more all
right so what is what function
okay
let's say I put my points over there and
we want to make this thing equal to zero
all right so we'll stack well stack all
my points in one water for that stack
all points in large it actually goes
like Python debugger there well that's
great thanks broski Oh kiss my toes
optimizer ground truth step that's not
right Wow the documentation is not up to
date bros spit a pull request okay
that's good
so this is a beautiful a beautiful long
vector of points which is all the points
in our system now
okay so we want to minimize projection -
UV that I'm not exactly sure how to do
like how do I subtract UV but I won't
put the UVs over there so now P DB yeah
yeah I know okay we kind of helped we
kind of have three things right kind of
have the map points the points and the
frames there's probably some clever
thing that we can do to put like two of
them together but I don't see it off the
top of my head
if we didn't want to optimize the poses
it would be pretty easy what kind of
object is UV so UV is just the U and the
V it's just two numbers it's though it's
the coordinate in the image I'm in this
case the normalized coordinate in the
image right so and we could do all those
projections right you can project the
point according to the pose we would
expect that to equal UV okay so that
could just be me nigga so let's see what
a least-squares function looks like that
minimize okay okay okay okay so you have
this matrix system a times x equals B so
I think B is actually just all the
actual uese stack oh you can't say PDF
sorry just that oh my god is that okay
so that's all the UVs when they're
flattened so now we need a matrix times
a vector that will get us that which
[Music]
this term and this is the term that
makes it nonlinear slicey yeah it's for
two bits yeah bro I don't even know how
to watch ads but oh man I'm loving that
scoreboard
I love twitch let's say there's this
problem too
there's the problem of this stupid
non-linearity here this is not actually
linear system
there's no way to really make this a
linear system on my there warp slim
talks briefly about what they do for
linearization but the stupid / is
nonlinear Broz there's no way I can just
write this is a matrix equation if we
can cert all vectors in the datum throw
I don't know what you talk about
sometime okay linear least-squares
derivation of the normal equations yeah
this is actually a you do e squares but
I'm just talking about setting up the
problem I mean okay you know what let's
just use side by lease quo no no no
there's another side pi there's also
CyHi least squares this one okay
function which computes the vector of
residuals right so actually I think this
is much easier than I think I think we
just actually have to do this okay B
squared oh this is actually really easy
cuz no I know exactly all right okay so
what we want to do is least squares upon
B B is my target right and now I just
need to write the equation that
generates that so I should need to do
the projection here that just builds the
UV matrix and for fun minimize f of X so
that was a question of like exactly what
I'm trying to optimize
I don't know what access you can get to
that in a minute
for now we just know basically we want
to write this so given the residuals f
of X minimize f of X subject to some
crap okay there's me squares fun be
alright get our get Q residuals now we
can figure out like that faster probably
[Music]
let's try that okay fun take zero
positional arguments but one was given
see that's what I don't understand okay
so that's an initial guess well okay oh
I think we actually serve ourselves got
flat hand that's lesson - B you don't
need to be there we need X right and
then what is X well what if I just yeah
okay so I guess that thing I was doing
at the points is kind of right what if I
just put the points there in terms of X
instead of points homogeneous yeah so
get point location guesses this is only
gonna optimize the points guys so call
this X 0 this is a gas right and then
that's what we pass into there so
instead of saying P dot let's say we're
gonna say X for X is not defined yes be
Wow Oh
Wow oh-oh it worked
eventually it just took 27 years it
returned something kind of absurd it's a
little absurd looking do you think well
no actually what was X is zero but that
should optimize all the points right the
only problem is right now we're leaving
the poses as fixed oh and those poses
are really crappy well those poses so
crappy Oh weird using our PI oops not
use our PI which is actually this is
actually okay that we're just doing this
because we have the gun truth poses okay
27 years great this probably way to not
make it take 27
vector our residuals a function of shape
and never scalar values why I must
return a 1 D or F or shape M that's okay
yeah that's right let's just say verbose
ey yeah yeah I know I know all about
Taylor bro
no you can do even better because if our
BOCES with the to see what's going on
scam
no brutally slow so I passed in verbose
equal to two we're using the LM method
Oh LM is that Levenberg mark wat all
Levenberg mark why doesn't handle bounds
and sparsh jacobians trust region
reflective algorithm what's up little
countin never oh my god this is taking
forever yeah how slow this is taking oh
no I have a phone call today
oh it did an iteration great
[Music]
I have to do a phone call at noon grows
this is so slow I've got our own tassel
love making money bus love mine
okay I see why that's slow probably
we're not making that function faster
Livia
Oh soft l-1a Huber loss Olaf Huber loss
oh that's great let's use human loss
there that'll work back
I don't be good to outliers right except
it still takes forever how can I make
this not take forever well I think I can
stack all those poses right feel like
robots equals two made things just take
way too long
just a - Niner really just in time bro
you almost got - nine okay 1901 times
four no that's not right I think I
actually want to concatenate or me SSS
three yeah and we'll multiply that
okay so then in order to get losses I
can say any dot hoses x0 all right yeah
we don't exactly want to do that right
no no bad mouth lies are like that ok so
the problem is that some of these appear
in multiple frames and we only want to
let the optimizer alter them in one kind
of way I mean ok I can certainly fix
that with a linear that's just linear
big linear I guess I'm using side Piper
yeah for optimization I mean ok
okay
we only want that to be a function for
each point we want the frames to be
maybe we could rotate we could create
like a huge house bra we could create
like a huge matrix right that might be
the way to do this let's follow G to
load us right I could create this
massive matrix where there's only like
five frames so I'm saying like we put
like a frame there if it's valid and the
fall five frames can get multiplied by
the point
but that's not exactly right either
because Oh guys life is so hard no that
one's correct it's just really slow
really slow
oh I don't actually want any money I
don't care I just like the idea of
making money you know that sounds fun
sounds like something I'd do a lot of
having things to do
it's probably a better way to phrase
this problem all right guys I gotta go
to work
we'll think about this tomorrow create a
branch get checkout we'll call it G so
right now no what should we name the
optimizer who knows we're gonna network
this startups are either worthless or
worth billions right I'm gonna call it
something twitch out whenever we can
call things twitch it's good I wish I
could on our million dollars to twitch
man twitch out well but like readme
should go to the other one - good work
tonight guys go work today I was pushing
so urgent we're gonna write a custom
optimizer we're gonna really continue on
this more next time
like tomorrow when we're back on twitch
live streaming with all your bros
alright alright ladies
chrome over here
passion
british
not to be confused with
these hashes
there's not these hashes
uh we don't record the videos anymore
you have to watch them live
um
maybe we can make watching the old
videos a perk
for subscribers
i don't know if that's possible i'm not
a twitch expert
but you know that might be possible
uh yeah these bros man um i did hear
that the british uh burned down can i do
that can i make it a perk for
subscribers i'll look into it after this
stream
um
i did hear that the british burned down
the white house in 1812
and that's why we gotta tax them
um
i'm uh
very amused
the british burned down the white house
oh yeah remember when i wrote bubble
sort yesterday oh that was fun
all right
uh
where were we writing crappy optimize
optimize cracking
i won some chess games this morning it
was a good morning i like my win chess
games
okay
we have to define the jacobian
yeah eat the fish bro eat the cake anime
uh jacobian
ah this one
this one really went too far into the
bullshit about
what you have a broken website bros
so we don't care about these intrinsic
parameters of the camera
oh look they're doing it symbolically oh
so there's this thing called senpai
which can do symbolic jacobians let's
install it
evaluate the symbolic
actually you know what this might not be
that bad right so we have the parameter
vector
and we have the measurement vector
and we have the function that relates
them
i play 10 minutes
um
so let's see did somebody install cool
we've senpai
[Music]
calculates the jacobian matrix
derivative of a vectorial function
yeah okay so this doesn't seem bad so um
from senpai
import matrix
i don't know what row and phi are
what are wrong phi
well okay so let's just say x equals
matrix
our
that's not right we want to define x
with respect to b
oh it's a little shitty isn't it
yeah we're not saving streams anymore
gotta watch him live bros i think we
will make that a perk for subscribers
so if you are a subscriber
then you get that perk
otherwise you don't
all right i don't know maybe no senpai
let's go back to try to understand this
perk for followers let me see if i can
do that
i'll look right now
you know what let's let's google
together
twitch
old streams
available to
followers not followers but subscribers
is what i want people who pay me money
five reasons no one is watching your
twitch streams oh let's learn how to be
a twitch
you just launched your channel no
schedule we have a schedule
we communicate
my stream is not about my audience sorry
people and i'm certainly sure as hell
not promoting my channel huh
oh
expression for the rotation matrix based
on the rodriguez formula
oh
well that's something we're going to
have to solve
dude i could be a twitch dot oh i'm
gonna wear a wig
twitch that's twitch thoughts
okay so
that you're getting it never be like a
loser everything is winning
i hire a bunch of models bro i'm in san
francisco have you seen the kind of
model when i moved to new york
shit when i moved to new york my house
could be lit man
i already know what you know what's next
i have to come ai guys
it's gonna be sweet
see
ah
okay where were we oh we were watching
tutorials again so we go back to that
that keynote one was pretty good
well the mac app store i hear they're
trying to make the mac app store uh
better
i am an advertisement
okay
we learned yesterday how we were going
to
estimate the hessian from the jacobian
because the hessian equals the jacobian
transpose times w that's that's good
so we just need to define the jacobian
that's where we were yesterday
it's this
okay
five 3d features
so they're putting the features there
the images there and they have camera
calibrations so we don't
thought we could put the camera
calibration in
no i don't think we care that much okay
so what is this
a1a2 okay
so those are observations so on the
each
row
is a parameter
and each
no each column is a parameter and each
row
oh thank you thank you nanodanger7 thank
you for subscribing
um
these are observations and these are
parameters
and like
so then this is the jacobian so so
basically
we're asking the question what's the
derivative of a with respect to a1
which i don't think is anything right
i mean it's not like if you move the
camera your observation's gonna change
well maybe it will
no okay this is the point
if i move the point it certainly will
change and if i move the camera it'll
change as well that's interesting okay
here we go there's bundle adjustments
that's the same picture
they use the same
picture except they made this look
terrible
okay we haven't even written out the
jacobian yet we haven't even gotten to
any of this yet
three cameras four features okay so the
other problem is
we have to parameterize our mr
thank you for subscribing to my channel
no you can't get this hoodie anywhere
this is this is the softest merch uh in
the game uh after maverick march which
is the real softest merch of the game
and who i stole that from
um
blah blah blah
okay so
we do need to
we do need to deal with how we're going
to parameterize rotation
and i do think we have to parameterize
it
as euler angles
because the problem
wow
okay the problem with a rotation matrix
is
rotation has three degrees of freedom
and a rotation matrix has nine so you'd
have to figure out some way to ensure
stuff about it
can we figure out what uh what u2 does
let's read each other
okay i was reading the auger code
not this stuff let me open it over here
question
3g2o
core
stuff
types
let's see how they parameterize rotation
is what i'm interested in here
oh edge
lots of x white wow look at these people
make a little bigger for you guys
lots of x y z i don't even know
point x y z okay
linearize oh plus so i'm not going to
know really what that does but it's a
way to a world too lazy
um
camera
edge x y z prior the vertex s e through
airplane so this is a vertex
draw a triangle
wow i don't know g2o supported opengl
that's kind of nice i use sublime to
read code
reading code in vim is hard um
but i write code available
and then i read code and sublime
i don't know i've kind of done it this
way for a long time
all right let's see if there's any
information here this is just like
drawing stuff this isn't even anything
saved
inverse offset dot rotation
so
it does look like it's a three by three
hmm
vertex sc3 okay
vector six internal two vector mqt
too compact quaternion oh what's a
compact quaternion
oh
so it's a quaternion with only three
sheds
because they normalize it i say
from euler
to euler
so first they're trying to need to work
quaternion
no i don't really use plugins
too hard to keep straight
all right this stuff kind of makes sense
they're using compact quaternions
i'm not even gonna i'm not even i don't
know what that is
so then they're doing it here
they call them w i don't know why they
call them w
but alright so get point location
guesses
plus
camera
poses
well
i want to keep them in order don't we
we're just passing the frame so passing
the frames
some of the frames aren't gonna have
shit you know
now it's a map
so now you pull this
point has no actually posed one point
those are frames i cast in frames
oh
i am playing
cool
okay i can get poses now i think if i
want the translation it's like i always
get this wrong okay wait guys we're
gonna try to do this okay these are
columns
when i select something the first thing
i get
if i do like sub 3 i should get the
third
row
that's right
so if i want the third column
i do this
yeah
this is t
now for r i can do this
all right
from now on
if you ask about the keyboard
and you're not a subscriber
you're banned
who gives a shit
let me tell you something about tools
guys
step one don't be a tool
you can try step two
i don't have shit on this computer
anyway um
step two
tools don't matter
only your mind matters
and unless you're a tool it's not a tool
don't be a tool
as we used to call each other in high
school you're a tool right
you're a tool it's like funny it's a
real good insult i like it
um
one of these days we'll watch battle rap
i love battle rap
rod reed
oh god
why did they why why couldn't the guy
win vanity be named like paul cb2 paul
i wouldn't have to spell it wrong
cool
all right so we can say w equals that w
cool
tools
don't be a loser don't be poor
such good life advice you know
every parent should tell their kid that
kid
son when you grow up don't be a loser
and don't be poor
okay
what happened that dude's paper i like
that paper
that paper we were reading that phd
oh a modern synthesis
what the hell is a synthesis
that sounds like one of those like
critical theory words
this wasn't the paper we had yesterday
october leg back divergence oh well this
does sound kind of interesting to read
triggs
just be aware and enjoy your life
you'll pay me two thousand dollars cash
for five percent of twitch slam that's a
good deal
you could have five what five percent do
you want which which part of the code do
you want
oh yeah
this shit
ooh taylor expansions
tailors and hessians
bundle adjustments
what was that guy's phd i liked it
bundle adjustment
tutorial
oh beautiful mondrian
linearly squares
sparse matters bros
map
tnse3
ah this means something
the euclidean group for se3 is used in
the kinematics of a rigid body
wikipedia they can't just explain math
like normal people oh the ly group
translation
rotation
money is matter food is matter money
doesn't really matter either but you
know it's a good way to uh keep score
right you think about it like points
and how much money you have is like how
many points you have
it's not that money's actually useful
for anything it's just a good way to say
like
you know you can decide who has more
points right and like i'm not saying
points are everything but like would you
trust someone who didn't have a lot of
points right that's what i'm saying
right like you come in a counter-strike
server and you see someone's kills and
death ratios just shit and they tell
their good counter-strike i know you
believe them right
that's right like someone says they're
good at life but they don't have that
many points i don't know if you believe
them right
this makes sense yes that's only
sensible
two views
okay whatever that paper we were reading
yesterday
bundle adjustment you know that one
um what did it say
phd
terrain
oh mapping
oh yeah it was this one but of course
we're not going to purchase it
we're going to download it free
love free
why do they call it taylor
um
let's look it up
oh brook taylor
oh
for some reason i thought she'd be hot
but there's some old dudes in britain
mclaren series
uh
it's so linear like you can expand
things into like big polynomials and
shit
for taylor's not look like taylor swift
i know i'm very upset about this don't
don't
don't guys i'm upset
all right
so
where were we
blah blah blah blah
okay now it's not this
up up up up up here we go all right here
we are
okay the camera parameters oh so they're
using wacky w all right well let's put t
first right
cool
so we can say x0 dot append t
x0 got a
pen w
all right now we have a parameter vector
and a
residual vector that's complete
so if only
i could hesion them
so now
well
these are in order of id right like i
don't actually leave frames right
yeah cool
well we can change this residual
function a little bit
to not use this magical f dot pose
anymore
we want to say
i have a 2rt helper don't
well i don't actually use that um
so that how this thing had the code to
go back from rodriguez right
so
um
okay
so we can say
frame info
we'll just say tw equals
sub length points times three
plus f dot id times x
now let's
brutally copy and paste that
brutal
all right
hi guys so i don't know what's trying to
be called here
i'm gonna assume this is that
numpy ndra object is not callable
data's just a number
right
yeah
theta times theta np dot omega times
omega
oh oops
we've got a plus
gotta put your pluses in all right cool
invalid value encountered and multiply
theta zero
why because it doesn't rotate
god i don't know what to do about that
okay it's small
now if i change this to actually use my
new rt
it's gonna work oops
so the problem is we were getting the
frame poses from this magical outside
place and that's never going to work for
bubble adjustment so let's try that
man
[Music]
expansion for the rotation matrix based
on the rodriguez formula
well
wait
so are they overall zero i don't get it
let's see
some of them zero
oh the zero ones are zero hmm
like those zero
zero
well
i just don't want to do about that right
w has the following form
i wrote this right
their promise is divided by theta shit
maybe this equation is wrong
you
let me just write that um
yes see this you'll write that
i'm going to use a library here because
i want this to be differentiable
also
um let's say
rotation
key matrix and we'll call it rotation
okay
so we could just do this
i think it will work if i do this
it just sucks the rotations are like
this we have to parameterize it like
this
cannot copy sequence with size two
um
is this actually
bullshit
now this is from matrix oops
i know that one's good
cool it seems to work oh well let me do
that
see if they're in the same ballpark cool
ballpark all right that works
all right so we really shouldn't use
crappy scv2 functions there
um but we can do some things like search
red test test these
[Music]
do you subscribe to my shit boys
what
don't buy netflix
don't buy
media companies guys the media is evil
okay cool
tw and we'll just say like p is this
media is a scam guys
don't
okay friends don't let friends do media
don't read the media don't look at the
media don't think about the media
they're bad it's a mind virus
don't work anymore i break it
they're broken now they break
that cannot be broadcast together
yes i disabled twitch video archive yes
the past is the best
wait this broke because i moved that to
there that's a joke
oh
crappy opt continues
[Music]
if you capture video i'll see you for
copyright information that's right
i got lawyers bro
yeah
we won't talk about stalls
it's my opinion on watching porn every
day
oh
i don't think it's bad
hey probably it probably has like messed
us all up but like
at this point we're already kind of
messed up it's like any addiction just
figure out how to manage
it long as it doesn't take over your
life as long as that's the thing right i
mean that's the difference between like
you know drug addiction and drug use
right like
does it
negatively affect your life that's what
you have to ask yourself about porn as
well that's what you have to ask
yourself about the media
that's the thing man like you all these
people like oh i'm so anxious man i saw
something that said putin was gonna
start world war three yeah where'd you
see that you talked to putin friends
with him oh no you saw it in the media
that's right and why does the media want
you to feel that way that's the question
you gotta ask man
and pre-import is not a scam
uh
generally i'm terribly a fat
i mean
at least they're not okay at least the
like the problem with the media isn't
like that it's content right um
uh porn doesn't really like the second
they have agenda pushing porn the second
they try to make porn more addictive
than it already is
i mean like like there's no like like
god i mean they could maybe do it i mean
they could maybe figure out how to get
you in like a negative like anxiety
spiral with porn and then the fuck the
porn industry but i haven't seen them do
that man
uh ubuntu
now but really like kids look at what
the media does to your minds
like like if you read media if you don't
read media this doesn't apply to you but
if you read media i want you to think
about like your mental state
before you read media and after you read
media right
okay
so
now we want to figure out how to how to
jacobianize this matrix
like what we want to do
to do
compute the jacobian of this
your mental state before and after
fortune
we've always done 4chan kids
um all right
so we want to compute the jacobian of
this so so residuals are a function
that you know f of x
equals b prime
if we can figure out how to compute the
jacobian of that
and basically what we want to do is we
want to alter the vector x
such that
so
is this going to work can we do the
gradient maybe that
local works fun
oh yeah
because fun is
x
minus b
twice times two
sum of squares alright cool
does this work
source is not an umpire in our scale
oh
rodriguez oh i see the problem
okay let's see if we can write this
without the rodriguez
what does this
do
rotation matrix two euler angles
you stream at the same time every day
aside from actually liking your audience
it's something you can do to improve
twitch viewership to improve your twitch
channel
i read a tutorial about this this
morning on twitch
all right this is all crappy oh so3 oh
not to be confused with se3
so they go through a quaternion to do
this
does cb2 have a definition of this crap
inverse transformation can also be done
easily
whoa
jacobians
interesting
yeah okay
here's the problem it's doing that
divided by shit again
like yeah that's the exact equation i
wrote out
but
what if r is zero then the norm of r is
zero and then you're left with that crap
again
should i special case it
because that is exactly what's written
here
god i wrote this out already
and i wrote this already you guys watch
me do it
this is defined by theta shit
like okay they do cancel out
i don't understand why this is true
maybe this is the gods punishing me
because i don't understand why
okay i mean
it works
the only problem
is in the zero case
dance
rotation by an
angle theta around a fixed axis
specified by the unit vector
see look at this expansion
this expansion doesn't have any divided
by's in it
see the problem
there's no divided by's here
hmm
okay so this is kind of cute um
look they do it without
access
math square root np dot access dot
access right so that's effectively the
same thing that's actually a cuter way
to write that right
so i can just say np dot www
it's the same thing
um
so they normalize the access
see
that is sad right there
okay
so
see they talk about how it has to be a
unit vector basically
look they divide by x it's the same crap
we could put a stupid non-linearity in
it
like okay
cos any times theta
and i want this just i want this to just
go away if theta is zero
this isn't good i mean you can do that
and that's probably correct
and to be
what
it fails sometimes okay
love this unreliable function
numerical instabilities
works most of the time
okay
band
you get a timeout that's right
i can give people timeouts
i did say the keyboard thing was a
banned question
that was very clear
so omega's just zero see that's the
thing right
that divided by doesn't even matter
because that whole matrix is full of
zeros
you multiply zeros by something ah the
problem is fucking nands man
perfect
i fixed it
what do you think of my fix guys
[Music]
there are tests
such great tests
setting an array element with a sequence
what are we doing
setting an array element with a sequence
oh okay that kind of makes sense
yeah so that stuff's not allowed um
the better way to write this is probably
mp.concatenate
rotation matrix
do we want to concatenate them along
x equals one
the input arrays must have the same
number of dimensions now we can
transpose that
for
this all right
all right
cool that's right
i don't even have to say reshape that i
can just say this it's the same
cool
yeah it's computing the
derivative
class enumerate
returns a result
with an error set oh
class enumerate returns a result with
narusat well that's great error love it
okay so some of my crap is
non-differentiable which of my crap
nobody knows
well
hang on think about something else here
p dot rt so that's just rt
it's a 3 by 4 matrix dot that right
so i do think it's the same thing as
just saying this right
is that true
[Music]
cool it is
a cute way to write that instead of
matrix dot
is that differentiable
oh
well okay there's a lot of nands
nands oh
divide by zero encountered in double
scalers
well this could be a divide by zero
we do the same trick
for numerical stability purposes
don't divide by zero kids
it's bad for computers
no
no bad thing you divided by zero
now we have nouns
we divide by zero and we get nands
let's make x a little bigger
well actually the irony is
no wait no that has to be positive
the other one could be negative
divide by zero encountered in double
scalers
all right well that turned out to not be
so necessary
gotta parameterize your shit correctly
wow look at how small that error is oh
it's so good
i guess i'm doing mean it means a little
small
no wait i can't
do that
squaring this
unless it's just the mean of
okay
that's tiny but still
you can't just take the mean because one
degree ten will be minus ten right
we're at a mate
we're mate and the optimizer's still a
piece of shit
hmm
look it divides by zero
and now we get
we want to compute this symbolically
so make sure it's kind of working
but
notice how that is much higher hour when
i mess it up
do
hmm
okay
the idx doesn't actually matter because
you're doing a projection
it's kind of interesting
you can actually do even better than
this
should i say
go to that
it's probably slower but you know
more conceptually nice
cool
point
let's call this one from croj
okay
so really we just need to differentiate
that one function
symbolically and then stick that in a
lot of
places so
point tw this is so
point has three
tw has
six uv has two
go back to our bundle adjustment shed
was that paper that i liked
no
this one
the bundle adjustment jacobian matrix
okay
so i don't know about camera constraints
i don't think we need any of those but
these projection constraints this is the
jacobian
so yeah this is so this is where you get
two by knowing from right
and they're actually are they
independent i don't know
i don't think they are now
but you see you see how okay so this is
this is the jacobian this is the
jacobian of nine parameters with respect
to two parameters
we could like stick them together it
doesn't really matter so it's like f of
you know
some nine parameter thing
i can get the jacobians like that
and that determines like the external
encoding
why do we use jacobian well
because the paper says to
no so a jacobian
basically
i want to ask the question
how do i alter
these things
how do i alter my input vector
to make these projection constraints
more true
this is the question that we're asking
here
um
because that's what i can change i can
move my cameras around and i can move my
uh three space points around
and these constraints
are all fixed right
so here we you know we have a
measurement vector and here parameter
vector
um
we shouldn't call this parameter vector
we should call this initial
parameter vector right
so the i'm trying to get the jacobian of
well there's a way to actually talk
about this but like
it's this with respect to this
now i think if i could do it for just
one numerically i think i can just like
kind of write that out and then once
that's written out i just need to shit
it all over the place like that right
so we have some big matrix
it's like yeah it's like this shape by
this shape but let's make sure i got
this right okay
so each one of those things is going to
be a
column so i actually did that as a row
so i did that backwards
yeah
that makes sense
all
so i can define the jacobian here
but the problem is we have to actually
get the jacobian we have to actually
take the jacobian of this thing
so let's see if we can use senpai to do
that
the question is like what is jproj right
i don't know if that thing that we were
using
like
we can try it i don't know
might work
does that work
who knows
um
but okay so let's see if we can get the
grad crotch here
that work
grad only applies to real valued ah
try
jacobian oh they even have one called
jacobian
from autograd import jacobian oh let's
try that oh
[Music]
all right so the the gradient only
applies to scalar value output functions
jacobians work on vector oh
it's printing something
well
i mean that's not right
because j shape is not right
like that's not the right shape
um but maybe because it's stupid and
can't handle maybe it just views that as
extra parameters right
so
we can write this pretty easily just say
we'll call it
ptw
well
uh
quality so before and after so wheel of
fortune kids
ptw 3d
all right
now
basically what we want to say is
i'm going to concatenate these two
arrays
i'm not sure you can even use
concatenate like that but let's say
proj takes two position arguments ah
perfect
look at the shape of the jacobian now
it's two by nine and that's what we want
so then we just have to put the thingies
in the right place
we're rich guys we're
rich computer the numerical jacobian of
the projection function which is all we
really care about
i mean okay be kind of nice to do
symbolically but like i don't know if
that matters um this is slow it's
probably slow
i don't know what that is
oh it's still getting zeros
yeah i think i want to compute the
numerical jacobian
i think if i use senpai i don't need to
write this pdw shit
doesn't
really matter like it's easy it's better
to think about it this way
all right so for each basically you see
how there's two by nine for each uh
row in the matrix
so this returns a two by nine thing
i'm not doing the jacobian now but let's
try the sempai jacobian
perfect
this is going to compute the jacobian
sp symbolically
doesn't matter like i don't care uh
jacobian with respect to x and y
okay
um senpai
symbolic
vector
symbolic matrix is fine let me just
treat that as a
matrix
matrix
a matrix symbol here we go
no
so we'll say ppw equals
sp.matrix
or pdw i'll make it nine by one
and then
can i prompt on that ptw
probably gonna need to redefine these to
be senpai ones
that's right
does that work
array takes two one positional argument
but two were given
i don't know what that means
i mean i guess maybe we don't want to
use numpy we want to use like senpai
i don't know if i can do that like sp
dot square root sp
model senpai has no attribute dot well
if it has an attribute square root and
we don't actually need to do dot there
we can say sp dot sum
does that work
senpai has no attribute sum
fine i'll write it out explicitly who
cares
does that work
add object has no attribute sign i'm
pretty sure senpai does have sign
it doesn't have dot
array takes one positional argument but
two were given
no i made it through there okay
um
senpai
matrix
multiplication oh yes
i think maybe we could just say times
i think you can do that numpy too look
at that that looks like some shit
right so that's a symbolic jacobian
um
look at that symbolic jacobian guys
actually i think we're doing this
symbolically i might not need that eps
yeah okay good
so that's the very complex symbolic
jacobian
ah so we can say
judy
okay now senpai has a way to actually
compile that and make it nice
look at that does that look right
who knows man
um
senpai
compile function
yeah this is autorap crap
now
why am i streaming
guys why is a stupid question
why do people do things i mean like
you know i'm like i'm nowhere near as
nice as like richard feynman would be
about this but like
watch richard feynman's thing about like
like you know he asked the question like
how do magnets work and like you know
he's very polite with the journalists
but like it's a stupid question like
what do you mean how do magnets work
right like with respect to what oh just
like invisible rubber bands pulling
things together
no there's not
how the magnets work you know go study
maxwell's equations right
and like aside from that there's no
other real
so why i mean don't question like what
do you mean by why
unclassifiable statement this is much
more interesting what does that mean
it's trying to compile fortran
great
it doesn't build
um
okay well that was good while it lasted
there's other ways to use autowrap i
think
we use senpai comma senpai is really
great
but
it doesn't always work
ah okay
let's try language equals c
backend f2 pi and language c are
incompatible
okay
back end equals cipher
no module name psiphon oh well now we're
getting some history install site
why you want me to keep if you enjoy my
twitch channel please subscribe and send
me bits and if i see that i'm making
money off this i will continue to stream
indefinitely
subscriptive value is neither array
nor pointer
what
what are you complaining about
ptw like didn't work
that looks like totally fine c to me
oops
true
okay can i see the c code being
generated oh man
you funkify
oh this looks let's try you funko oh
oh i think i have to pass in uh
do you have to pass in something to auto
wrap
i don't know
try you funkify maybe your funko fight
works
i i feel like i have to pass in
well let's actually first just try that
one if i just batman ppw here i think it
doesn't know i think actually that has
to be an array too
no
you funkify
pass in ppw and j crotch
error
passing
double
to parameter
see this is what sucks about senpai like
i don't know what's wrong
can i allow you into this python i think
there's a way to do that
maybe binary function we'll try the last
one
binary function you're my final hope
f
j podge
back to this fortran shit
that looks okay to me
except for like what is all this maybe
it doesn't look okay
okay the only thing i think that could
be bad maybe is this np dot array
sp dot array does that work
okay well
like i can probably write that in a
better way
let's think about what i'm actually
doing there
okay that theta is fine
but np dot array
i don't know about all those weird
parentheses either
i think they matter but
even though this finishes that doesn't
mean anything um can i call it maybe i
can call it if i call like jproj with
like mp.09
i kind of like my plus epsilon too
okay so senpai is a lot like thiano
in which it's total garbage
matt mall object is not callable
wow
i want that to come up again
c code
can i import that from somewhere
senpai
senpai printing c code c code okay let's
try this
sim
printing c code
c
so i don't know if any of this other
stuff is supposed to work but if we can
print some c code i can at least read it
and audit it as c code
and you know what they say about c code
it's very fast
and fast i love fast
is that c code
is this c
not supported in c
immutable dense matrix
oh well that seems bad
i have an idea that's what this np array
is doing
okay
if this is the source of my problems how
can i write this in a senpai y
can i say sp.matrix
that looks
marginally better
it has less weird big parentheses
thingies
auto wrap
that's good while it lasted
wow
pow 22
i mean that's sketchy
you funko
come on you funkify
um
no
bad argument double binary function oh
and classifiable statement
okay
well none of that works
does that work
matimo object is not callable
i just don't know
let's google it
well
is this differentiable would i just
write this
not differentiable
so it's not even that
that looks like the simplest bullshit
now
at least that doesn't work okay so we
have like structural
failures
auto funk results
subscripted value is not an array
pointer or vector i don't know why
through the fortran fight before
fortran failure is unclassifiable
okay
so for some reason it's just not getting
auto all right let's let's find a senpai
auto wrap example
by abc
oh does it not work if i use matrix
symbol
i don't think we have to use matrix
symbol i think i can say
sp dot symbol
let's just create them all um
p x p y p z
t x t y
t z
w x w y w c
right
symbols i don't know what's idx crap
can we put them in a vector
w equals that
does that work
symbol object is not subscript
that's not a symbol
that is a symbol
it passes in symbols where symbols
that moves the array into c
cannot add
senpai class mutable dense matrix and
class tuple
oh well that kind of makes sense right
simply vector
senpai
matrix
well okay so sp dot matrix
does that work
capital m
ah
matrix size mismatch oh well that's good
at least
because i shouldn't be
simply no attribute vector
um
like that's sensible at least okay fine
you can't add that to that i'm senpai
vector symbol
no you don't want vectors though
oh crap
does that work i don't know
no
but okay see how we're defining the
symbols explicitly now this is better
wait
this doesn't make sense
r times ptw 3
should
oh
does that work
unsupported type for list and add
oh i don't like this anymore
i like it
what if i do this and do sp matrix here
does that work
can i add
matrix and list
this is crap
auto funk results
see j projects like the function
interesting i don't maybe
the problem is it just doesn't have a
name for that
it just calls it auto funk results right
and that's the problem
oh
i'm going to stream today until i fix
this
auto wrap arcs
i know those brands don't actually do
anything
argumentative
now the question what if i suppose by j
cross here so
the first argument must be a sempi
symbol is this a sempi symbol
is not a simple symbol which doesn't
really make sense
like that is right though can i have it
just print the code
i'm trying to do that before with c code
does that just print my c code
great
like that's not c code where does that
set to
matrix
you funcify
that
to that
diano
the code
that expand
hmm maybe you can't return a vector
ah that's better
so let's just say ju
and jv
yeah
what do you think of that
yeah we'll get rid of our bows too so if
i
did this right
i should be able
i just didn't like returning a vector
that's not a problem you're okay with
that
j u
sub-zero
oh no that's not right
compiled
jacobians
okay so remember how we have a two by
nine matrix now instead of having a two
by nine matrix we have two one by nine
matrices do you know what they say
that's a two by one matrix
buffer has wrong number of dimensions
expected two got one okay that's fine
data type now i understand yeah because
i'm dumb all right all right come on
we're making progress
man
well it's only because we passed in
zeros
shouldn't really do that
oh and let's put this back is that gonna
crash it
yeah i don't know it doesn't crash it
out once
wait a second
i pass in nine i get one out
that's not right
[Music]
scam
oh well yeah because i'm okay this is
fine i'm not actually taking the
jacobian yet
that's just to compute the projection
function which we should actually be
able to use
it's not jacobian it's actually just a
function
but like
so i could pass on that function but it
doesn't matter let's figure out the
jacobian now
so we want to say xproj dot
jacobian
crotch
that's not even with your program that's
just the projection function
matt maul has no attribute jacobian
[Music]
um
is that right
that mole object has no attribute
jacobian what
better
data type not understood
we'll see if it works when i comment
this crap out
i think it's time
after all this
this library sucks
you know it was good autograd
i liked autograd
but with autograd was it couldn't
compute a symbolic jacobian which we
need to do
if we don't do it symbolic it's doing
like some numerical shit
syntholic
differentiation
all right
automatically differentiate
i liked autograd
okay well this matrix symbol shit
doesn't seem to work so
uh
dx would be y z put this back
t x t y t z now we will go in a little
bit
all right well
which one is that one
i'm going to add mutable dense matrix
and lips
get rid of it
support it type
i understand why that's a list
oh i guess that is a list right
i don't know simply matrix shit actually
works
it's not a list it's a matrix i don't
get it
i don't see that this is what i don't
understand um
okay
fine
some more
i like that better
maybe
time for a list and add well at least
that's better because it's just an ad
put this back in
data type not understood uh i what line
i don't know what any of that is
oh because it's trying to make a matrix
of 9.
okay cool
um
then for this maybe i return
sub 0 divided by
2.
cool
now jacobian
maybe
well that's a tuple so that's fine
but
we'll go back to juv and shit
mole has no attribute jacobian
well
so that's not actually one about that
but still a maul
sweet
so now we can get jp jt and each one of
these
should be a three by two matrix
okay you okay cool but that's exciting
right take a look look at how exciting
this is
so each one of these should be a two by
three matrix and they should be just to
bring it full circle
uh where's the good paper no no no no no
no no
no no
no no
these
these two by three matrix so like this
one here
should be jp
this should be jt and this should be jw
if we did it right
i think i can just create this matrix
once
simplify the code a little bit
[Music]
so close uv
[Music]
project missing two required arguments
we've got 20 more minutes of streaming
hopefully we'll actually get those
jacobians compile and compute
that's right
um
no i do want more i want some coffee
that's really what i want
um but warm coffee guys i haven't had
warm coffee in so long
uh
all right let's see if auto wrap's gonna
work we wanna wrap this
odds that works
hello
yeah
did something all right
so now if i jp
[Music]
so if i did this right
no no no no no so i have to pass in
the points
this should return a two by three matrix
i think maybe
quiet argument p wow
well okay that's fine
so i pass in the point there and a two
three right two by three two by three
two by three
oh okay fine
two by three two by three
your voices two by three
all right who's excited
compiled
i am the social media coordinator for
common ai that is true
what the okay
can i redefine proj or something oh no
just take some crap now
ptw don't think this works anymore to be
honest
yeah don't know matrix size i'm finished
hang on maybe i need to just
what
oh my god it's times 22
and at times two there when what how
about even compile
[Music]
yeah matrix segments match okay because
the problem i don't know why p is a
weird matrix size
um
yo
what if instead of a suv
fuv
huge utility vehicle i would settle for
starbucks if someone bring me starbucks
right now i'm pretty happy
all right
well it's a fortran object oh my
favorite kind of object okay
let's try fuv here
yeah so we want to do like this
cool
so now we're actually calling the
the functions
um this takes a long time i hate when
things are slow oh god i hate when
things are slow
tuple objects not called oh yeah i don't
all right so now for each one of these
we can actually compute uh
let's just say about to list here
w
and here we can get like jp equals fjp
ptw
jt jw
fjt fjw right
so each one of these if i did it right
should be a three by three matrix and
then we'll just have to put them in the
right place
and then we'll have a jacobian
this is so annoying
oh look at that some of them are nons
though
what are you doing
but that does sound like a tomorrow
problem
today we learned what jacobians were
we well we knew what jacobians were
yesterday but today we wrote the
bullshit
we wrote these uh beautiful rotation
functions
uh and they return things that are the
right shape
and that have numbers in them so if
they're the right shape and they have
numbers in them
you're probably doing pretty well for
yourself
well i mean i'll go to starbucks guys
maybe we'll say
i have a job maybe it'll work
look at him that's a fucking nons look
at the nons
maybe it's a non non we just don't put
it in
just leave them zeros right
yeah so well i guess i'll write this now
because why not
and then we're done
so we can say that j
so i is the point id and f is the frame
id so
first we address the
row
in the matrix
the r
row
uh oh which we're gonna deny the x for
again i think
i don't know if we need idx
actually i think they're just in the
same order as the idea so let's say j
equals zero
j sub j
times two j
j times 2 plus 2. so that's the row in
the matrix
the column in the matrix is of course
the point id which is this crap here
let's write the same
equals jp
oh and now we set jp
now we just need to set jt and j
q so those are the same
it's the same indexing as this
that's so ugly
um
see here f
idx
colon f idx plus three
and this one is f idx plus three colon f
i d x plus six
and now
we have a big j
and you're able to do because we did it
b-hat
comma j
kind of less crappy
yeah we have a jacobian
is it the right jacobian
tune in tomorrow to find out
we stream every day because it is every
day bro
and maybe we'll listen to that song on
the way out
jake paul's in copyright strike me
don't watch the media
on youtube
[Music]
right here oh you show up for that merch
i'll give it a thumbs up
yeah he's talking about alyssa violet yo
selling like a god church
[Music]
all right we gotta turn it off before we
get to nick crompton nick crompton is
terrible
um jake paul jake paul oh man oh no no
we also have to look at one more tweet
oh oh there's a twi oh yes
yes
this tweet
this tweet bro
it's just funny y'all
oh all right thank you thank you please
like and subscribe and make sure to send
me money because i'm poor i gotta afford
coffee
just kidding i'm not poor what do you
think i am
but i do love money so if you could send
me that that would be
great um if you are amused if you if you
like this content if i look at my money
and i made a hundred dollars this week
i'm like i'm gonna keep twitch streaming
if i look at my money and i made less
than a hundred dollars
i'm probably still going to keep twitch
streaming but but thank you for the one
bit
i i feel like yeah thank you i have the
cam girls you know they always do it i
should watch more cam girls
and
be better at shilling and and being a
twitch thought all right all right bye
bye cheers bye bye
where's my broadcaster
is it over here
find my Instagram it's actually super
easy it's just 1M 2019.com that stands
for 1 million followers in
2019 uh now you might be like George but
you know don't you hate Facebook don't
you hate social media and no no
because let me tell you something about
the world guys and we're starting with a
rant today I know we're starting with a
rant but don't hate the player hate the
game or something something like that
either way uh I have something that I
want to do at the end of this year but
in order to do it I'm going to need 1
million
followers uh so yeah there's that so
that's good all right cool um good
morning good morning good morning we're
drinking pure leaf tea today pure leaf
tea uh they don't sponsor me but if they
want to I'm open to the idea I would do
it for free tea it's not going to cost
you much but you are going to have to
reach out and if you use the words
partnership or collaboration we're done
if you say something like hey Broski I
see that you shi for the tea on your
channel we're going to send you free tea
cuz we like you that's good and then
I'll tell you guys pure leaf tea they're
cool they sent me free tea and it's not
going to be like a big deal they're
going to be like yo what's your address
I'm going to send you tea and I would
appreciate that um I also see that my
camera is like glitching out because of
that's being so bright
um that's cuz they don't have any
dynamic range so let's take this
backpack right here and let's put it
over the window yeah from the
window to the walls no no no it's not
closed enough uh let's try this bathrobe
oh yeah that's looking good oh that's
looking black yeah yeah just like like a
mayback with black mat yeah oh just a
little oh I see a little bit is that
good all right all we good we good all
right let's uh let's get into it today
after we have some pure leaf tea thank
you Tyler Duty Tyler but TY but now you
die oh I get it sir Heros thank you for
subscribing I appreciate every single
one of my
subscribers I wish drinking pure leaf
tea That's
Right 10
months that's crazy that's so much
subscribing I appreciate all of you for
subscribing to my channel okay let's get
into it today so I have this tool called
Kira um while I was off stream I
wrote as I just lost my monitor okay we
got kilb oh yeah we back we back so
Gucci all right let's go um wow that was
rough okay we were just about to get
into it
too um okay so what we're working on
today is called is called Kira
um I made a little Docker to make it
easy for you guys so you can just go to
build on Docker and you can go to
test oh shit though this is a problem
because I didn't forward the
port H okay because I switch to local
network I'm going to leak my secret IP
to you guys uh so I got a forward is
that how you do local forward is that
right let's just see if it works whoops
uh Docker
test then we'll put go a screen because
we definitely want a
screen yeah okay good so we had to do
the forward by hand on the uh SSH thing
not supposed to load more I don't know
why it didn't let's x that
out why didn't this
load
okay well cure is particularly broken
today that's
okay what did I
break okay well let's debug this
first um so yeah let's just go into
screen right
here uh let's try a local Cura see if
that one works
okay doesn't work okay either so usually
this stuff comes up with I can actually
so Kira works on Macs too now that I'm
using Docker oh let's close Docker on my
Mac well first let's demo it now but I
can't even demo it either way let's
close Docker because that's killing all
my
Ram okay um we don't have any Rams all
right so I don't understand what's
Happening Here
uh that's annoying
too we have debugs does K have debug
options maybe it's cuz my Instagram's
open
I always clear my history for you
guys all right so usually like things
show up here I don't know why they're
not uh I don't really know what I could
have done to break
this oh you close the door now cuz we
don't need no
wifi
uming UI it does use the same port for
web so a lot of cous communication is
over web sockets this is written all in
the days before uh like react came
out what is wrong why doesn't this
work synchronous XML HTTP request is
depreciated on the main thread
okay but I don't think that's the
problem all right well before we do any
crazy porting stuff okay see that's
really annoying because you see why this
is saying
this uh how can I make that go away like
it's going to come up over here too it's
happening because this thing is trying
to connect to the web
socket um but yeah let's so let's debug
what's going on
let's add a
flag is it dropping
frames this computer's too
crappy 19% frames drops it's not even
the wifi it's just a crappy
computer I'm on a 2018 MacBook
2018 MacBook 8 gigs of RAM am
I I have any Ram free or
something OBS is using all my shit web
Kit's using some of my shit because I'm
watching my stream over
there yeah it's quad core you guys this
is
bullshit lower the bit rate it looks
crappy if I lower the bit rate I used to
have a better Mac but I got the little
one
instead oh my God this is
unusable okay
um is there any way to get OB all right
all right
all OBS use Hardware
encoder let's see if we can get OBS to
use the hardware
encoder
oh that's if it has Nvidia
[Music]
um encoding
overloaded go to
settings enable Hardware encoder under
output oh but it's not here enable
Advanced encoder
settings h
yeah this is what we got to figure out
how to enable so I know I know we're
working on the lag guys we're working on
the
lag can absolutely use EnV Inc
as Intel Graphics MacBook OBS Hardware
encoder higher equals less
CPU oh what's
qsv we're gonna fix this guys we're
gonna fix
this Intel no qsv support oh Mac do
support
qsv through video toolbox all right
let's find out what video toolbox is
welcome to fixing the stream on the
stream is so matter okay well that's
great this isn't going to be what I
want um do we have to install
it thank you for subscribing Hardware
encoding in real time isn't well CPU is
better GTX cards don't do real time well
I don't think that
works this is practically a maxed out I
guess I could have bought the 16 gigs of
RAM um
OBS video
toolbox support OBS is open source right
is there a newer
version do I have to install this kind
of
crap where is this log file saved
um yeah no lag now yeah I know I know
guys I'm trying to fix
it there's a newer
version I'm not sure if I just have to
stop the
stream oh this used to work CU I had a
better computer
video output is currently
active um I okay we could lower the bit
rate we could lower the resolution but
then you aren't going to get 1080 and
then all the people on the YouTube
channel are like could we get 1080
because I want
1080 oh my God
okay adding video toolbox h264 encoders
okay where is the OBS log file is it
like a thing to view
it um that's not
great OBS install Hardware
encoder I have a video card I have a
I streamed on this a lot
though I know you have to stop the
stream to change the streaming sessions
but I don't even see the encoder show up
here right like audio bit rate shows up
that stuff shows
up uh
CPU throttling due to
Temp that's possible the computer is
pretty
hot the Intel Quicks sync
encoder I mean I have okay so what what
D do I have it's like some Intel
Graphics
crap oh God Intel's the
worst well I mean that's not doing
anybody any
favor hardware and
coding okay
I like my 5K
monitor
um how do I check with my CPU is
throttling
God I hate the news Google's become
unusable because it gives me like the
news this is not what I
want SMC fan controller
this looks super
janky is it still
throttling should we set up a real
computer for this should we go get a
Linux box with like a real GPU
I don't even think it's lagging anymore
I think you guys are just annoying now
we're only dropping 20% of the frames
it's not that bad it's
fine higher equals less CPU I let's go
to super fast maybe that'll use less
CPU let's pretend it does let's use that
placebo effect all
right
um we could also probably lower the
resolution of the monitor I doubt that's
going to matter I don't know
whatever okay let's actually get to
today's
work so for some
reason that's to be expected but for
some reason Kira
broke like usually it shows up with a
thing
there I have no idea why it
broke um did we not forward the port
correctly that doesn't make sense
because the web socket would work I hate
when things are broken
guys all right so this is Kira here
let's watch the network and see what's
happening you'll just watch the archive
on YouTube later great
it's fine it's just like it's not
triggering or
something should be communicating over
web sockets but like it's
not which is really weird because okay
well let's try it on the Mac and see if
that works okay I guess I mean we can't
do it in the Mac it's oh that uses
Docker and I just shut Docker down to
try to save
CPU so now if I try to run it in Docker
it's going to be like oh can I connect
to Docker Damon oh you didn't bring a
Docker Damon I left my Docker Damon home
sorry it's also possible that like
Chrome got updated or
something um that is how you do an SSH
forward
right just try the other one just in
case it's that
it's not that but we can try
it
yeah
huh okay now it showed
up oh it's probably a race condition all
right let's try to refresh it and see
what
happens it doesn't work all right so
there's a raise condition in the
JavaScript well this is good to debug
anyway
um I haven't read this code in a long
time I mean I could buy a better
Mac I just sold my better Mac actually
because it was a 2017 and who wants the
old
one
um
okay so I believe it's UI
JS what actually kicks everything
off there's a dollar sign when
here I actually don't think I wrote this
code I think somebody else wrote it
nope I
did okay we can't blame anybody else
this is shitty this isn't how I would
write this I don't know what is dollar
sign deferred even
mean deferred object is is a chainable
utility
object register multiple call backs into
call back
cues invoke call back
cues so these things like resolve
here all right well just to show you
this so if we cira bin
LS and it loads it doesn't show up but
if we control C this and we do it
again it shows
up
so that bug has to be caused by yeah
some kind of like JavaScript raise
condition like when it's loading it's
not actually doing the
trigger um Can this go like where it
normally goes like down there
beautiful nobody cares about what's new
in the Chrome
update
um it's it's not the docker that's the
problem
um like it says client connected so
that's working but it it's got to be a
raise condition in the JavaScript and
it's happening just because of how I'm
like tunnel over to the thing right like
look this one kicks it off right so
let's see what happened
here ping interview ping timeout
upgrades I don't did I write this I
don't think so
well okay so it apparently is going to
print out loading UI okay so here's
loading UI so
let's refresh this page and see if it
prints loading UI it does so that is
getting called
what does hold ready
do code looks janky I wrote bad
code so this is all written
before
Oh head. load Scripts
I don't know what's triggering the ready
event but like this is
janky so this is all being called on
document. ready and then it's like
holding
ready who wrote this garbage let's get
blamed and make sure it was me again cuz
you know if I have to blame old me I'm
devastated God an asshole man no not
that um get
blame wow wow you know what I just
realized future me is going to one guy
be like one day be like wow that guy was
an
asshole
2015 August the 27th what was I doing
that day thank you for subscribing Koger
UI elements now exist in the
Dom I really I wrote a comment without
doing them I didn't even put a space
there that's pathetic old me I was just
commenting it out and see what happens
well head. load
script this is all in a document.
ready scripts to load after the UI has
been initialized
well it is printing loading
UI so that's not the problem but if I
contrl C and I do it
again it all shows
up I don't know what set t-il is I did
write some debugging at one point in
this turn the lights off cuz they're
buzzing
you guys can still see me maybe we need
some music up in
here ah you're welcome happy to be
streaming all right so that's printed
out by BJs where's Bas JS it's not
here oh it's in client compatibility oh
I'm sure there was a great reason I did
that
these are the debug things I do remember
writing
this it's like doing something
are you kidding 16 shouldn't be
hardcoded who wrote this
no wonder nobody else ever wanted to
develop
this for meteor development if window.
location.
Port
3,000 okay well I don't think we need
that
anymore
stream
URL is that even used
why does it connect in every single one
of
these oh this is just begging for race
conditions isn't
it ah okay so you see
these it's cuz the these are happening
before loading UI I
think so let's just figure out how to
hold
those well so first off why do we
connect in every single
thingy like guys I wrote all this code
so if anything's bad in here it's old
me's fault and fuck that guy he was a
crappy
programmer all right well not
that like in every single one of these I
do a
connect okay so this was based on a
JavaScript framework called meteor I
wrote it in meteor but meteor was
insanely slow so I ended up writing this
thing called fake meteor which was like
meteor but
fast that noise is annoying too I'm GNA
turn the sound
down but I'm GNA turn to sound out for
Mac Miller cuz I MacMiller all right
fake meteor oh yeah I also had to write
big.js wow that's
janky who the hell knows if this work
who wrote this
shit danger FX is a bad
function well we're not even up to the
Python 3 yet we're still debugging the
nightmar JavaScript
code it runs a version of jQuery that's
from the ancient days I don't even know
what a WC Docker
is but right now the real problem is
that
it's it's connecting individually in all
of
these I don't know why it does
this I mean I guess that it needs like
stream to be
defined but that should block until the
UI is
loaded to the race condition
guys this part of the reason
javascript's such a crappy language
too who knows where all these call are
coming from I don't even know how to
start debugging
it maybe this is just cuz I don't know
JavaScript and I think things have
gotten
better wussy Docker dock bottom oh does
that work no of course
not
um yeah but
I feel like this load ready thing was a
hack around
this head. load script so that's going
to load all the scripts does that do it
synchronously what's
head I don't even know what that is
is head just a defined thing that like
points to the head of the
document no
idea okay um well
yeah so okay you can see these stream on
things this is this is like like when it
gets this thing it triggers this
function on a call
back I know JavaScript in 2015 right
should we learn some Modern Javas we'll
modernize the JavaScript soon too first
we're going to fix this raise condition
then we're going to P to Python 3 and
then we're going to not design
JavaScript I I actually don't know
there's a great like page that goes into
like what modern JavaScript is and
that's kind of a nightmare as well just
like you know yeah oh why don't you use
Babel to translate it from ecmascript 7
into ecmascript 8 and then don't use npm
make sure to use yarn but actually no
one uses yarn anymore and we're back to
npm
um to-do parameter should be dynamic oh
well well that's good that's a great
Todo I love when to-dos end with
question
marks okay so the problem is and we can
confirm that it's this
case yeah so right now like loading UI
is happening after history and
reight but if I kill this and I do it
again it works because loading UI has
obviously already happened so history
happens
here but when we refresh it it's broken
and how many people see this is the kind
of thing how many people installed Kira
and never got past this first screen
they're like oh it doesn't load because
of this race condition probably because
they have a shitty slow computer this
doesn't happen when I'm not streaming to
you guys I don't know how this was
working yesterday either I actually
think it's because I'm not on Wi-Fi
right now so my internet's actually
really
fast uh
okay
well okay I'm not even really sure how
this is happening because I don't I
shouldn't be even loading the scripts I
thought I load the scripts in
that yeah I load the scripts here which
should be
after that so where is
history not
there there's a DA history somewhere so
thanks
crap thanks
grap there it
is so it's in compatibility
base.js which I think might actually be
loading too early
yeah see compatibility base.js loads
there and I'm not sure
why we do need that one to load
first because it defines the stream URL
for everything
else oh history doesn't even seem to
work in the same
way
oh okay where does reh highlight come
from compatibility highlight
JS so where is that important
probably
in yeah that's in index.html as
well
okay well
H okay so this isn't too
bad it seems like there's these
functions
running I forget exactly what depth that
auto run
does um like this is a this was a meteor
concept
call the
function how do things get added to
session.
tr so yeah this stuff is this stuff was
a meteor concept that like would track
whether these things would
change I forget exactly how I wrote
this oh you just have to do session.
getet right and then it
tracks
um wow wow look at look at how bad this
code is I set it to an
array and then I set it to undefined
after I run the function
synchronously yeah they all have oh
promises oh this is the
new JavaScript hotness
um okay can I use a mutex maybe
newex
um well another way to potentially deal
with
this is base and
highlight can
go here well not really there
but let's try this
I think the reason I put them in
compatibility was because this doesn't
work for some
reason but let's see if we can load them
dynamically after the UI has been
emitted um I also have no idea if this
is synchronous or asynchronous
and it might just fix it but that
doesn't really tell us
anything p is not defined
okay p is probably defined in one of
these compatibility
things yeah
like I don't know why this stuff is in
basee it kind of shouldn't
be should be in something
else we could put it in
UI that actually might be the most
sensible place for it
oops hot
Corners uncaught error da is not
defined I'm not sure
why did Define it here
um and all those scripts are being
loaded afterward I I don't really get
it loading fake medor
I'm defining these functions in a global
name space I
think da is not
defined has this not finished loading or
something I
okay I don't really know why those
functions aren't being defined in a
global name
space I load
it can certainly load it after those
things
it's being defined in UI which I link to
the other things are not in
here like base.js should not even be
loaded till after this file tells it to
load you can confirm that that's true by
going like
that
yeah let's try just loading early
scripts da is not defined but yet I
Define it right
there I don't understand why defining in
base was
different like the fact that I named
them compatibility shouldn't have
anything to do with
anything oh no it does it does cuz
there's some bullshit in the server I
think wow I wrote bad code I should feel
bad yeah yeah I wrote
bullshit all
right okay let's
[Music]
um why did those have to be in
compatibility compatibility if if
they're not in compatibility I wrap them
in
something um I think these are just used
in like a global
context yeah you know we can see exactly
what I did and why this broke there
there is something special about them
being in the compatibility folder
yeah see look I wrap it in a function
look at
that
wow I do have chat open what do you all
want uh no I wrote Kira mostly when I
was in intern at
Google it's an inter project it's not
terrible
but yeah okay well at least we know now
why it doesn't
work um well okay this is interesting
because this should actually still be
okay with the current script loading
scheme let's just make a new
file
uh compatibility early.
JS and let's just put this in
here uh
I don't understand why that's there so
we're going to leave
it now we got to go to
index um where's index
scripts without compatibility don't load
in their own if they they load in the
global name space whereas the new ones
like someone like was like George you
know you shouldn't load all your
JavaScript in your Global name
space let's
refresh look at how loading UI is now
before those ones
oh yeah your boy fixed
it all
right uh I don't think we actually have
to differentiate early scripts and
scripts I I don't think that does
anything differently I mean we can
double check let's just see what the
network load order is all
UI JS base JS highlight JS okay I mean
it works but whatever I'm not I'm not
actually going to do that
I that
diff okay so we moved that shit to
early.
JS we move those to
there we can also remove that
comment kick
okay looks pretty good now uh let's also
comment back out the debugging so it
doesn't
spam I don't really know what the proper
javascrip you way to do this
is uh we really don't use this
anymore all
right let's read the
death um
okay that
moved added some new scripts
there oh and
then yeah we'll read that too okay that
looks good
Cool
Fix race condition in JavaScript
coding or
UI cool that's pretty good making good
progress today all right let's figure
out why this isn't filling up that whole
box look at how ugly that looks that
looks like noobs wrote that you know how
I feel about
noobs no no no
well I think it's actually just because
there's a Max size of these things it's
not that
bad not too bad
okay cool
um so we are running Kira in a Docker as
well the problem is the docker now is
not going to
work the docker is going to suffer from
the same problem because we didn't
actually update the Docker
so we actually want the docker to use
this external Kira I'm not sure how to
make it do that um Kira also comes with
really nice Kira
tests like uh
Bin
poop so if you guys like want to see
kind of more what this is there's a loop
here you can see like it loops around
five times and prints out the number one
through four so like these are like the
hits to the thing
we can see like okay call Print F we can
check out what uh RDI
was see that's not great because it
thinks that
that's uh but you can see RDI
was um percent d right here it's a
string and then all right guys I mean I
made a promise to you all we're going to
Port this to Python 3 uh yeah I know my
Docker file pulls directly from my
GitHub so it'll work fine if you set it
up right now the problem is it won't
like change I I don't know how like
build contexts work in Docker I got mad
that it was like sending all these
megabytes so I just put it in its old
folder um if somebody knows how to fix
this and wants to send in a pull request
uh I'm I'm pretty bad at Docker um I
would appreciate that but like just
compare this install script to the old
piece of shit install
script like it was
unbelievable uh well a lot of this is
just due to environments getting
better but like wow this is
understandable like okay we're going to
have to get we're going to install pip
we're going to get Kira install python
packages improve Docker file
comment I shouldn't write comments like
I'm
dumb build qmu and Link
Aira link is a fancy word yo yo you know
what we're going to do well I I've got
to run to the bathroom but we're going
to put on icy Narco link this is a great
song by a great rapper his name is icy
Narco he's like little pump but like Ice
T
Pokemon
e e
all right well that's uh link by Icy
Narco all right um we're also hungry got
got to eat some food so we got Uber Eats
right here on my phone also I'm not
sponsored by them if they want to
sponsor me I would appreciate it again
don't send me an email about partnership
and collaboration just be like listen up
you got some free Uber Eats credit chill
fre UB on your stream and I would I'd be
a great
shill um I would I would CH for whatever
unless it sucked I wouldn't chill for it
if it sucked cuz like I'm not like
desperate man oh by the way speaking of
being desperate please follow me on
Instagram um my Instagram is 1M 2019.com
that's cuz I want to get 1 million
followers in 2019 yo tell your friends
1M 2019 it's simple to remember just
like you know what do you want you want
1M that's right um we'll get to the 1B
later oh all the super food is not good
for
you I've been eating well I lost 10 lbs
guys remember I was like 10 PBS fatter
remember like you saw me in Japan I
watching old videos like I have fat
chubby face I'm like fat kid you know
that's gross don't be don't be that uh
you know like look man I never
understood that shit you know like fat
shaming man like I looked at myself in
the mirror and I'm like you fat you
should not eat shit and I stopped eating
shit and I lost weight you can do it too
[Music]
um but see oh Deluxe Ramen oh ramen's
pretty good for you right KATU house
Ramen oh it's
Deluxe comes with some guas even those
are definitely not good for you I could
get extra ramen noodle Choice off
topping okay yeah we're doing
Ramen oh but Ramen never comes good in
the Uber
Eats okay okay all right all right
what's good for you on
uberit you know what's kind of good for
you how about like a
gyro is that good for
you or sandwich can we do a
[Music]
sandwich dumpling
but really nothing here looks
healthy what's healthy what do we
got all right we'll scroll ues with you
guys is Blaze Pizza bad for you all
right park Gyros
perfect update we've lowered delivery
fees and introduced a service fee
oh yeah all right we'll get some Falafel
balls too special instructions no s sa
dry all right marinated Lam and beef is
that good for
you gyro wrap iceberg lettuce y love
that Iceberg all right that's got that
crunch
um place order oh we got some Ms coming
that's good 1M 2019.com follow me on
Instagram let's see can we get followers
right now oh shit we just got 12
followers you guys oh man that's sick
that's sick we got 12 follow you're not
going to regret following me I don't
even post much I really don't post but
when I do Post uh it's going to be
you'll see you'll see you got to follow
me to find out I mean if you don't
follow me you're not going to find out
you're going to hear it about you're
going to hear about it late you know
you're you should be afraid if you don't
follow me on Instagram you should be
afraid of missing out I know that gets
to you Millennials I don't like
sauce it's bad for
you um
okay good now let's look
into if someone wants to fix up that
Docker file I would really appreciate it
like to instead of get cloning Kira like
Kira is there it's in dot do slash if
you could figure out a way to like you
know copy it I really don't even want
you to copy it into the docker context I
want you to mount it in the docker
context um yeah that'd be real nice but
I don't know how this stuff works okay
back to let's do the main event today
let's convert this this to Python 3 so
first let's figure out where we
have that's really
annoying that that comes
up
um SSH don't print connection
refused port
forward no no no this is people who are
getting connection refused and want to
debug that
I just don't want to print that anymore
oh oh here we
go info
level oh Q yeah yeah we got that Q don't
kill a window going to detach from the
window yeah so let's drop a q in there
and see what we
get now if I open this it's not going to
work right now let's just
Runa NLS okay it's
running now
oh look at how that race condition
doesn't happen anymore that's so good
now when I kill this oh yeah SSH with
that
q no it's not really live I recorded it
yesterday but I knew you were going to
say that so that's how I did
that ah yo speaking of live is so
addicting man do we have more than 40 do
we have more than 40
oh we landed oh six more followers six
more followers I love you guys you're
all great um I really we're going to
throw guys if you haven't seen it uh I
don't know if we can actually get to
this post but so I'm not logged into
anything on this computer
but yeah I don't know I post a thing on
my LinkedIn I did promise some great
content when I reach 10,000 followers so
that'll be great content
right let's first figure out where all
the python is that seems like a good
plan
right well not in the
VMS just stb isn't even used
anymore is distri up
stream let's remove it and see if it
okay that's garbage I don't think extra
is actually used and that's a python it
might all live in middleware which would
be
nice oh c DB
though
H so Kira uses this thing called Kira DB
that I wrote um it's a really stupid
database it's written
in uh
C++ and and it's a python
extension and it's super fast it
supports these things oh
meth um static 2 is also
something but I don't think any of
that's actually imported unless you vad
static
mode so first let's check out what
version of Python 3 we have that's not
what I wanted d v all right good 368
there is a newer one there is python
but uh all right let's just first pip
three install dasr requirements and see
what we
get let's make sure all our requirements
are
ported HTML is not a
package what do we use that for
pip
uninstall my mother texted
me I'm
streaming I'll send her my stream link
Twitch
TV slash GI George
Hots there you
go my's nice but I like talking to my
mom sometimes but not when I'm streaming
you know it's it's not like Alex we can
talk to Alex on the
stream uh skipping HTML as it is not
installed okay
well I didn't even
work PP install d r oh it's installed in
the
VM oh cure is in the VM
okay it doesn't even look like I use it
though I don't know why that was
installed I I just did a pip freeze you
know
[Music]
so for those that don't know it's a
virtual m is
VM uh and it like does
things now it creates a system python
that's like separate from your main
python okay so we removed HTML
built
curb we actually have tests let's run
the
tests cuz I took out HTML let's run
let's first see what run test does and
see how sketch it
is let's try it
error
great well that's sketchy it's just
this is just this is just
sketch now I think my pseudo app get
updates broken
do I even need this wa cuz Phantom JS
doesn't
work get install Phantom
JS cool
could not connect to display but isn't
the whole idea
of is the idea of phantomjs that I don't
need a display
this is janky as
shit well okay I don't know if this is
actually
necessary oh I see what's going going on
here it doesn't support newer yub bundus
this is really
[Music]
[Music]
garbage either way the files change is
fine the test pass I don't know why the
tests are written so poorly but you know
like really what would you expect from
old
me it isn't just that though I going
over this now just shows how much better
like General system requirements I've
gotten HTML isn't
needed in requirements
you know let's actually go through I I
did something
badly a lot of this stuff shouldn't
actually be needed uh let's go back to
the old Kira and see what used to be in
the requirements file
this all right
pip
six okay well we did need HTML at one
point pillow P elf
tools Pip's not in here anymore
sixes HTML is not in here
anymore did I just rely on flask socket
I a to install
flask that's not
great get3 install R
requirements and I realize that that's
overriding the global ones
but okay all right
[Music]
so it all looks pretty good
except for Cur DB which is broken but
that's to be expected because Cur DB was
a plugin written for python
2 p inet module was not declared in this
scope
oh yeah no way in hell I'm writing the
back end of nodejs if I don't have to
use JavaScript I don't want to
P AIT module was not declared in this
sculp here we
go porting extension modules to Python 3
[Music]
changes to object API module
initialization has
State okay this doesn't look
bad of
course they actually then proceed to
p n module
by the way I'll take one minute to talk
about
how Python 3 has set the world back uh
in huge ways because of all the
developer time which could have be spent
written features is now spent
writing uh Python 3 ports
wow not even going to write it like this
can I just copy and paste this crap
yeah let's just copy paste the
crap I don't know what those do
um do I not have a p module
death P method
death seems like it's the same
so I don't really like what they did
with all the fds I'm just going to
rewrite this for Python 3 it seems
failed building wheel for security
b error
invalidation get state was not defined
in the
scope sure do I actually even need a
Traverse and a
clear uh oh it's not my extension
methods that's definitely not
right um it's just
methods I don't think I actually need
those that can
die size of struct module
State not sure I even have a module
State let's see what it is here
oh instead of storing module state in
globals they should be stored in an
interpreter specific structure
but do I even have any
globals I don't think I
do zero
return statement with
no okay
destruct probably
changed oh I don't even know about this
[Music]
H
capsules I test for the
[Music]
do
[Music]
that's CU not the VM
nice
[Music]
task wait I don't understand why I
didn't print that stuff oh because it
didn't run test are you kidding me
why is this using Python 3 by default
great it
works it's not forwarded to Python 3
though
God I don't know if this shit's ever
going to
work okay that noise is getting annoying
yeah so if I was doing this again
today I probably wouldn't write a python
extension and I would use C
types
um yeah you might consider
scyon the idea okay the idea probably
isn't actually to Port this extension
it's probably to just use
scyon uh I'm not good at scyon which is
part of the
problem but yeah this is this is a
hopeless effort I
think yeah so if you look at cure DB
there's underlying Library called
Trace wow I can't believe I got this all
to building windows as
well Google at the time was still on
Ubuntu
1204 that was a lot of the reason for
this hacks
too um but yeah yeah I think the idea
should be to move this whole thing to uh
to
scyon hope we build more reasonably
too yeah so if I recall correctly this
thing just opens the trace
files
uh and like qmu writes them I have like
janky qmu patches in here
use all fds up to
30 I was just to make my shit
deterministic that's funny
okay let me
track add pening
change
wow I don't know what Global pending
changes means
okay I mean the right idea probably here
too would be to move
out there's newer stuff to move to
instead of this qm crap
testing infrastructure is
fine should actually do that call
properly uh we should fix this though so
why why let's fix the
tests phantomjs has crashed qsb
connection could not connect to
display um what do this even
do it literally just tests whether it
like
loads I can just curl and test that same
thing
I think the idea was to eventually do
more but
perfect
as that test doesn't fail
um so this is also really poorly written
um oh that's just exits there like it
doesn't
exit because it's bash b e which is
right
um bash tail on clean
up got to do a trap
is
so now we see what prints out test
pass uh let me just leave as a comment
what the old because that's the only
valuable
thing let's confirm that the tests don't
pass if this is true but the PID is
still killed
yes all right we improved our testing
infrastructure is my Uber here oh it's
on its
way for
all right where
we
C I don't even know what happened here
okay well that doesn't work
um that's not
[Music]
connected all right so the right way to
actually do this here is going to be to
recode this in
scon I don't even like syon I really
like uh C types but I don't think that's
as fast
scyon link to C++
but sion's definitely the move
here so I wrote a class called
Trace here db.
pation is a
file okay well first
off this a bit
bigger there's the methods we're going
to have to implement and we can get them
from cb.
cppp so these are the methods we have to
implement
why won't that highlight
pisy what's not called PC what's it
called what are syon files called
they're not py
files just P do with that later uh let's
quickly look at the test to make sure
that
not like cing the wrong
thing test CB okay so it creates a trace
object in Python so that's going to be a
class takes in a set of weird
arguments yeah it's a type
here are the arguments I don't know what
ti
is but that's what I actually passed to
trace know what I do with file name oh
connect a file and start
Okay cool so we're going to
want class Trace
object
defit I don't know why I didn't use Sion
to begin with I guess I probably didn't
know about it size down is Big
N want to call well we can't call on
both
Trace
um did call them both Trace but we can't
actually do
that whatever sounds like a
problem let's just make these ones
work call it TI it's probably better
documented in the
C Trace index great
all
[Music]
right C extern from trace. h
a PIX that's
it build a
wrapper cdef cpb class Trace
Trace create scyon rapper
Class
C
C
um should rename it to py
trace that be perfectly compatible but I
probably don't actually call in that
many places so
only call two places
um okay so we're going have to get a
build environment here working P who
knows how to build anything in scon not
me from rectangle C import
rectangle I think that's the same thing
as just doing
that
oh we put those definitions in a file
called rectangle. pxd so we'll just call
it trace. pxd
um and then from
Trace C import
Trace all right I have to get a build
environment up for this
stuff I'm sorry if you can't see there
should I put me down in the corner there
we can move me go down there down there
bro also my Foods here so I'm going to
be back I'm going get my food be back
real quick and we'll do a eating stream
I know yall love eating
stream for
oh yeah we got
Foods
lights yeah you know what this is a gyro
it's not bad for you I don't
think hey Google are gyros bad for you
one
flawful I got
one I love
food's not bread is it is it bread am
iing bread right now don't eat bread
Bros carbage make you slow
um
okay so there's a big change let's make
a
branch because we're going to rip out a
lot of this extension share
e
for
okay Trace is not yeah
um
so
Trace is not type
um let
need what
h
H oh
dog's
fancy Trace Trace pxd not found but it
should be found
CU I see it
there
oh wait what no that's valid
python from Trace
all but why does tra Trace pxd not
found doesn't even look for it
not me Chas
there no it's not complaining
anymore turns out a knit. pie was useful
[Music]
Trace is not a type identifier
don't doesn't mine look the same as
theirs I don't see the
difference from
rectangle C import
rectangle C def Trace oh well if they
don't do that maybe that
matters Trace is not a type
identifier why is it not
oh we have to do that
too
maybe wasn't
that is it in a name space
no a name
space a waful
sea
extern WR
I did not need cpde or CDE for the
second definition
maybe
that
no Trace is not a type
identifier but but why is it
not from Trace C import Trace
oh maybe from trace.
Trace C++ class must have a Nery
Constructor to be stack
allocated I don't know what that means
I don't even know
can I factor Trace just have another
structor
this doesn't make
sense I'm literally passing in an INT
it's not a stack object
I don't know why
I let's just move it
um so let's just move it here
process wait the thread's not called
until after we connect to file and start
so this seems fine
let's just say trus one
unsigned
Z seems fine
[Applause]
well because I didn't update this
here call wrong number of arguments all
that's
fine I'll just write it out call it
Trace index
okay so we just need to Define these uh
functions it's not
bad odds that's going to
work low got to beow
low type I
don't copy and paste from
here that
work syntax error pxd typ
C you into 232 was not
a beautiful someone was thinking
no no no no no you have to have boou no
you what do you mean you don't have
Bool that's
impossible we're using
Pon the keyboard doesn't make you
smart step one be smart step two buy
keyboard if you do those things in
reverse order you're going to have a bad
time
okay well
bu in
syon oh we have to import
bu
beautiful oh yeah
it builds
let's try
that be a nit
found file or regular
file I need a n
each element of X modules must be an
extension r
that says it's
okay oh maybe I can't have the
uh array
okay we're getting
somewh need header guard
PX call Destructor was not declared in
okay now
this I don't know
I'm no Destructor
P call
distractor not declared in
scope do I need a Destructor for Trace
I have
one do I need to break it out in
the pxd
file no don't do
that just
error pix call Destructor was not
declared in this scope
um wait are you guys not happy with
scyon do I regret quitting college no
I'm in good company like famous people
like Lizabeth Holmes also quit
[Music]
college all
right um let's read what's being
generated by syon
what line is the error
on pix call Destructor
like I don't know if that's not a valid
thing I'm not even really
[Music]
sure syon is just generating that does
syon not
work UPG
NOP same
problem PX call Destructor was not
declared in the scope
I don't even know I know where to start
with this
shit um
okay so I guess something has to
generate
this but it's not being generated for my
class type for some
reason rectangle has a Destructor
specified in the H it implements it so
do I
I don't know what except plus
does want to try
that oh also there's no semicolons on
any of
these okay well we didn't need the
semicolons but it's not the accept plus
I I really I wonder what that
does
oh oh it's for exceptions I get
it
um look yeah your college degree is
worthless uh if you actually learn stuff
in college like you know did projects
and acquired skills skills are valuable
um degrees are completely
worthless it it comes
from degrees come from an like an oldw
World System where the way you could
tell if somebody was like good at there
wasn't really a way to tell if somebody
was good at something or not right and
there still isn't in some
Fields um but today we have much more
Quantified metrics about people that
there's no reason like there there's
ways to do much better interviews than
to rely on a piece of paper given by
like a really really a failing
for-profit organization um you know a
lot of these colleges they claim to be
nonprofit but if you look at the highest
paid employees in a lot of States
they're College Deans or football
coaches so they're taking a ton of money
off the table like nonprofit just means
that the organization itself doesn't
make profit but there's still people
just rolling what do you think all that
tuition money's going
right
okay seeing it that's weird could be
that I didn't see that there
see same
crap in function destruct pix called a
structor
oh yeah that's another thing too like
right now another way of determining how
good somebody is is by how many
Instagram followers they have right so
you can go to my Instagram 1M 2019.com
you can see that I have yeah 5,900
followers I would love to get to 10,000
by the way so if you guys um if you're
in any Discord pump groups for stocks
you guys know about these Discord pump
groups just tell them about 1M 2019.com
tell them to uh follow me on Instagram
guys we're going to do it let's check
out um
ig.com yeah yeah look at my growth rate
it's off the
charts so we're estimated to grow 30,000
in the next six months but this isn't
taking into account like fourth order
and fifth order effects on that
guys they don't know shit listen listen
listen if every one of you gets two
people to follow me on Instagram and
then they get two people to follow me on
Instagram and then they get two people
just two people if like that only
happens
like well so let's see 1 million is like
two to the 20 if that happens just 20
times I'll have a million followers
okay this is annoying
um maybe I need this disc utils language
C++
shit
no what could be happening
here you must store a
pointer oh if the class gra doesn't have
a n Rec Constructor I
see I almost like that
better I don't know why I put the trace
index like there I'm sure there was a
reason otherwise it's weird
why I don't
know who
knows okay pix call Destructor was not
declared in this scope
oh you know
what I have an
idea they told
me maybe we just need to create a
dialect
method shouldn't really matter they say
I don't have to do that but but we can
try
it deletion of non Heap C++
object I don't know let's try
this operation only allowed in
C++ aha okay well this this is getting
to something maybe this needs to be the
first line of the
file oh wow oh yeah that was intuitive
oh yeah you got to put it as the first
point of the file or it doesn't fucking
work wow brilliant ass shit all
right don't forget your dist utils
language C++ is the first line of the
file let's see what happens if you make
it the second line of the file probably
works okay okay it probably doesn't work
cuz I had that string in the
middle and that's cuz python doesn't
really have block
comments if I don't have a real block
com it it wouldn't do that
okay yeah you know what should have been
a dead giveaway it was generating a C
file and not a CPP file
right
[Music]
also make mod to up
notice how want a
branch I'm eating flaf
so we got a vitamin you take a vitamin I
think it's vitamin
time a
vitamin
and what else we got
here
theine Al theine let's take an Al theine
too what do you think
taking lanine this drugs a
clock got a line we got
multivitamin flul jmic I'm tired yeah I
know I'm tired all right all right you
got me don't worry we got the
I know that's why we're going to go get
some more pure leaf Teo I'll be right
back
I'm just saying spin
drift if uh yall want to sponsor me too
I'm cool with that I just want to do a
quick shout out from my 1M 2019.com that
is 1 million 2019 for my
Instagram also if somebody knows how to
get me that blue check mark $1,000 my
Instagram is very important to
me where were we all right here DB
python setup install we'll leave that
guy over there let's just clean up some
of these windows so it's less shitty
make this full screen and no we're going
to need we're going to need
Google we're not going to be able to get
away with this without
Google look how slow that window is
moving it's
disgusting um right here db. PX Trace
we're basically porting that over to
that uh we got to Port get
pmaps well we also have to update Trace
which we'll do in this window
okay get pmaps what is that
call calls get Pages oh
we need some music for this too what's
today's music guys what do we
got what are the odd St going to
work um oh oh syntax error and C
variable declaration why do you think
it's C do we have to do this
again what are you guys
doing
yo you heard this
song I I think I honestly think like
Tesla paid them for this shit at least
gave him the free Teslas to
rent
but fuck it jailbreak the
Tesla fuck it jailbreak the Tesla
Tesla
what if you could
do IIT
fuck it jailbreak
Tesla fuck it jailbreak
thees fck the
Tesla minutes
this does not test get P Maps
d
I know I wrote this before
[Applause]
control
I the hell is
that all
right yeah I know but they want more
money than I want to
pay um what do we got let's listen to
just
like
Loi I got to spell Loi right it doesn't
matter
I like this guy but maybe he's got some
new ones this new
[Music]
ones no I was a little too chill for
today I
think oh yeah perfect Beautiful piano
music most emotional
s
e
e
e
e
e
e e
writing this years ago that took me
forever to find my stupid python was
freeing
true
e e
[Music]
oh I know
why that file doesn't
[Music]
exist wasn't
that is opening the file
[Music]
should be calling that I didn't reild
[Music]
[Music]
[Music]
[Music]
accidentally calling that early
[Music]
working
[Music]
[Music]
that is not working
[Music]
[Music]
it's failing
[Music]
[Applause]
[Music]
[Music]
[Music]
I open F huh
oh
wait that's returning
zero is that not
right I mean
so zero is actually a valid FD which is
interesting
right minus one if an error
occurred yeah
so my check looks like it was just wrong
I'm not sure why file descriptor uh zero
isn't
open but oh okay that's that's good
cool that was some wacky shit
guys it's returning file descriptor
zero
rebuild wait who's saying rip my
Instagram career what are you talking
about I'm G be Instagram famous how's my
Instagram doing am I famous yet oh yeah
no look guys wow we went from 5,000 to
6,000 fash and Drake went from zero to
100 all right cool we're getting
somewhere oh this is good oh tests are
passing wow how much nicer is this than
the old shit did I not know about
cphon um I want to take a minute to say
thank you to everybody who writes and
maintains these beautiful libraries that
we all rely on um everybody out there
today who is maintaining a library I
really do appreciate you uh you're
helping Drive Humanity
forward um and everybody today who is
desperately trying to acquire followers
on their Instagram you are not so I'm
just putting that out
there address
types oh can't be called type in Python
T that's good that's
sensible that's the kind of thing that
people are going to remember what it
means later and they're like What's T oh
I don't know let's try T
type do this over here
too just type it's like a stutter you
know my favorite though and it cracks me
up every time I see it is when people
spell class with a K cuz class is a
reserve word in a lot of languages so
you
know you can pay for school but you
can't buy class you
know oh you follow Tom Cruz who's this
I'm sorry and um Tom Cruz is
dead n he's a Scientologist is
cool vector
Vector I guessed at that I assume that's
right
Vector
cum fetch cums by address and
type
address
Char
num and go TOS we don't really need them
[Music]
okay
oh I think this is easy
I 100% sure I need that list
there uh
integer is
expected
oops
oh oh yeah got to do War
here
man yo I don't know what you do in the
world if you ain't just like smart and
see things like
that like for me to explain why I had to
do or there requires like you to
understand like really a lot
of like obscure subtlety
who understands why I had to do or there
who understands why it's got to be or t
type entity instead of object I don't
know what that
means um fetch registers
oh these are so
easy see look at all the shit you used
to have to write
thanks
scon it works fetch memory is actually
the same
function slightly different I want to
know what memory with valid is is that a
complex
type
no it is
not it's in fact a un
16 how any of this stuff works I do not
remember memory with
valid oh it's just like okay whether
it's valid or not oh I understand no
never mind it's just like it's like
bites does it return a string for that
though that's gonna suck did I return a
string I feel like I might
have that's just
that I feel
like never mind it's not a
string so this is going to
work oh I know what I want to listen to
nice and quiet
though no quiet
who misspelled the
address no okay never mind they have
they got to have this acoustic this is
this is too
much
wow oh
[Music]
oh this sounds pleasant I used to write
those songs like I'd have to play them
both at the same
[Music]
time it's hard to do it at the same time
you know so it's you know Adam
[Music]
song an elevator
[Music]
oh shit we got
[Music]
strucked I forgot how to play that
song
buing I don't think that's right
[Music]
I don't remember how to play it I got to
hear it on the on the album again uh One
Good Reason U how's it
[Music]
go I don't know
wait that's
it that was
[Music]
good the okay
got we have to activate everyone
here uh what else um not
now how does not now go
um uh
[Music]
now me sorry this is lower than I
thought I'm
[Music]
yes I
am it's
[Music]
a come toize
you is Left Behind
St here hold on to me I right here
[Music]
okay what else stealing
[Music]
this it's pretty
cool it say when they were thinking
about getting back together
[Music]
this
[Music]
time sing it I don't her was a
[Music]
[Music]
[Music]
mess it
[Music]
up I don't know what else okay we're
looking for more uh letters to God okay
off
[Music]
[Applause]
[Music]
[Applause]
up all right this is a little
choppy but is this
enjoyable it's
[Music]
pretty what is thistv icons
old MTV guys your host the original
Antichrist Superstar Mr marn
man there's no other band still making
music that means so much to me the care
showed me that there was more to life
than
met
what I don't know
man I like that first video
better systems go
[Music]
[Music]
by
[Music]
the I I don't want to that you know
first it
[Music]
[Music]
[Music]
I forgot how to play that one that's
been a long beautiful we're almost done
think reaction might be
done because I that's it
[Music]
test
passes that s you watch the world okay
you guys are going so
[Music]
fast so let's take a minute watch smoke
smoke watch the smoke arise for me
pull up in the
streets I think that's a beautiful song
actually wasn't that a song watch the
world uh wait let me just say what I was
going to say first so that slash this so
we have replaced
234 lines of disgusting C++ code with
zeros and comments and N with 72 lines
of beautiful cpython in fact it's not
even 72 lines because that stuff let me
just make sure I actually implemented
every one of
those I implemented that one I
implemented that one I implemented that
one I see it right there I implemented
that one I implemented that one that one
that one and that one so we actually
don't need this stupid comment because
they've all been implemented 58 lines of
beautiful python that's what I mean
about people doing good for the world if
you've managed to take 234 lines of c
and turn it into 58 lines of python that
runs equally as
fast this is so much easier to maintain
and read than this and we're going to
get Python 3 for free how beautiful guys
how beautiful if you like you should uh
follow me on
Instagram eventually this joke's going
to get old but it's not a joke because
something incredible really will happen
if I get a million
followers
uh all tests
pass boom wait let's see if Kira still
works we didn't test that kir is using a
VNV though so we're going to have to
Source VNV activate like VM what bin
activate and then we're going to do pip
install
kir installed
onay ah because we need syon
oh yeah test passed guys the tests
passed
um okay well now we should be able to
run Kira Kira test spin
Loop uh oh uh oh we got a
bug we got a
bug cannot convert negative
value uh unsigned in
oh okay well
you see this isn't even a real bug just
like that other bug it's just revealing
hidden
bugs it's because I use negative one to
mean something special you fetch changes
by C
[Music]
yeah I'm not even sure what that's
supposed to
do limit equals zero
or this is not going to fetch
anything either way let's just make
limit an INT
um that should be
fine make all the limits ins there's no
reason they don't have to there's no
reason for them to be unsigned
well maybe that one can stay on I don't
know F changes by cum I'm
lost by address and
type yeah it does something special with
that there I don't
know should be able to autogenerate this
from so that was a fetch changes by cum
okay in string requires left operand not
it this was relying on undocumented
broken
behavior um
what does this
do what was negative one supposed to do
here oh God maybe it's in that file I
deleted should not have deleted the file
that's called premature victory
[Applause]
okay in
string requir string is left oper and
not type okay well that's a different
problem
oh this just means we need a Char in
there okay that's not that bad I really
don't know about this minus one thing
though we're going to look more into it
in a minute first let's fix that
bug problem is the types yeah get type
from Flags
by the
way do
that Str oh I didn't
build okay limit equals z or or I is
less than
limit but what about limit equals minus
one
that actually just shouldn't return any
ever
oh
no okay all right subtlety guys oh you
got to get your subtlety right who sees
the subtlety if anyone sees the subtlety
I'll give you a job a comma
who sees what the minus one used to do
your boy
[Music]
sweet no these are broken those types
aren't
right pmaps is broken
yeah oh
all seems
oh
okay let's go to where that function was
this
here
yeah yeah okay so we didn't
really do that right these are just not
equals they're supposed to be
ends let's
print you didn't read what you were
translating from don't get it wrong yeah
we should probably add that stuff to the
tests but uh we're lazy so we're not
going to
okay everything seems to work now
good all
right um
merge that into
Master pretty happy I
think so minus one was being
used yeah basically as like the largest
int but I used zero in the C code so I
really shouldn't have been passing minus
one in there but it's fine that's why we
have that
hack all
right because he asked questions and
doesn't bother to see if
anyone oh you were working on Kira
Docker o who did a pquest did anyone do
a pquest I would appreciate a pull
request
um oh is that a PO
request oh someone fixed
this oh nice oh I appreciate
you okay um I'm not logged into GitHub
here so I'm going to merge that guy I'm
going to go over to my other computer
and I'm going merge that guy and then
I'm going to merge
uh I could do that from the command
line let's see if
scyon did it run the tests
Travis CI run my
tests let's wait for Travis C to run my
tests cu the build was failing why was
the build
failing okay well we'll wait for that to
run my
tests but we should also now if I did
everything
right be
able let's try
tip three
install d r
requirements
oops
cirb oh it's going to complain I got to
pseudo
that successfully built kirb oh
yeah now let's run the let's Port the
Kira tests to Python
um me import cat security read to Python
from future import print
function now if I run the tests
yeah okay who's excited about adding a
ton of parentheses to all these
prints oh yeah oh this this is a great
use of developer time
people
three
h oh
it's cuz I'm in this
directory damn it that's
[Music]
annoying this isn't going to work it's
not going to
load import name pyra what
why
not work
for cannot import name p
Trace
um that has something to do with like
the module relative or
something I think
be import P TR is that right but I don't
know if that also works in Python
uh two
does that also work in Python
to shitting all over my system
libraries so dis details install project
what
okay python Cur tests test
curb
works okay well something expected bytes
stir found
okay
well ah God okay
well fex import and make test
3 compatible
okay well fortunately that's the only
string we pass
in so we can do
this by editing this
[Music]
crap um if Python 3 encodes string to
lights
if what's the way to detect Python 3
oh it can't really be
that it can't really be
that thank you for subscribing thank you
for subscribing yes sis version it can't
really be that though can
it I mean what happens if you do that in
Python 2
it doesn't matter
[Music]
yay Python
3 okay
who said I'm rich follow me on Instagram
that's way I appreciate it I appreciate
it can we get to 6,000 followers before
the end of this stream I think we're
pretty close
right oh we can oh we're going to be at
6,000 followers in no time Hard Target 4
thank you for subscribing look at that
we just upgraded kir DB to Python 3 we
deleted 150 lines of shitty
C++ I mean wait we deleted 260 lines of
C++ and replaced it with like 60 lines
of python and we made it compatible with
Python 3 at the same
time DNS hijack Google oh that's good oh
that's a good plan I like your plan can
we get to 6,000 just 15 more 15 more and
then Instagram will have to give me the
blue ch Mark and R will have to accept
me on their dating
app they'll be like wow this guy's got
6,000 followers we're going to accept
them he can be
cool
okay all right
well let's like see what happens let's
exit the
VM Kira has like stupid crap but what if
I do Python 3 middleware cure. py cure
test bin
Loop oh oh oh missing parentheses and
call to print oh oh well if I guess if
I'm missing parentheses and my calls to
print from future import print function
oh my God we're going to really have to
do
this oh yeah this is a great use there
is a tool 2 to
three which should do this automatically
but I don't really trust things like
that
okay this was the most this was the most
gratuitous fuck you from the python
Developers
forgot how many different things Kira
works with
too iPhone binaries and stuff
oh this is a lot of
prints yeah putting parenthesis around
print is there from past import old
print function I would appreciate
that I did see it once as a joke
I don't even know what that
does I really don't know if that works
exception comma
e it's not right though it's as e
right it's also azy
in it's azy in Python 2 as well isn't it
hope
so child Watchers are only available on
the default
Loop
great and now my shit looks
ugly look at how ugly that looks
whatever child Watchers are only
available on the
default I don't know what that has
anything to do with any of my changes
what does this
mean just cuz like something didn't
install
I really I don't understand how this
broke
from okay
well I don't know let's finish the print
function thing and then think about it
more is it possible my exception thing
was always broken
which
there a lot of static analysis stuff in
this as well
looks like a stupid print
anyway don't do that
oh my
God I I really I can't believe this I'm
I'm already upset by Pyon
3 what is this
everywhere in the world programmers are
doing this
for
was the old style log I don't know why
that's still in
there just cuz it didn't offend anybody
yeah so they changed the name it's not
called Q
[Music]
anymore I thought static was disabled
though child Watchers are only available
on the default Loop so this looks like
I'm literally just trying to import
pill which should be a relatively normal
thing to do
um but I think we can also just import
pill like it's not a big deal to just
import it
elsewhere is aren't like crazy
libraries it's not string IO anymore in
Python
3 okay that's
fine probably because I like imported
future great no module named string
I yeah so they called it something
different
in Python three string iio
that
it was stupid that it was
uppercase
okay well now we've moved
on yeah so static
to built and loader we're just going to
have to change that all right now it's
time to start thinking
going to have to
start opening things with RB so they
show up as
bytes
um Works in Python
to
huh because that's probably running in
Python 3
yeah it
is okay uh ljust must be a segment. data
that
right yeah because what these do is they
just check for like here that's not
right that has to be
bytes these things have to be
bites yeah like this one here that's why
that specifically was failing but these
all have to be bites
be stir not bights
program
6K followers woo we're famous we're
slightly more famous than they were
earlier oh wow thanks guys I appreciate
you I appreciate you all right must be
stir not bite
well see what's going
on in middleware
C
whatever plan
huh
well to be honest I I wasn't even aware
that that was valid python 2 syntax
map Lambda XY
wow not know you could do that
okay just
progress
uh self static
memory python
2 I do Char a integer is required
this might not even be what I
want um what if I am in normal Python
and I do oh sorry python 2 and I do
something like that
what is that a string that says
that that's
crazy that's what I want to do but
in function object has
no great
static.
memory
yeah the static stuff was always pretty
janky
anyway so
yeah those are
characters
in wonder if it works at all
me's see
for
okay that's all a lot of The Superficial
stuff now let's do the non-superficial
stuff let's find a
hat here's a
hat we need a
hat what yall think you like my hat
bin Loop test you get no such file or
directory well did you copy in the
test uh also make sure your home
directory is Kira itself
sequence expected stir instance int
found
okay I mean we kind of decide what we
want to do about we have to decide what
we want to do about this
how does that do
that see the difference
doesn't use bites anywhere does
it those are
okay
Prince
PRS just how we open the
[Music]
files see this one's really a much more
fundamental problem
move the cam can you move your oh shit
sorry my bad
[Music]
[Music]
yeah sequence item zero
[Music]
expected stir
instance int found and get
instructions yeah
I don't know why that didn't
print not even there yet
that's okay
error sequence item zero in found in get
instructions with where is that error
coming from that is the thing I changed
to name right
oh it's being called with
that no wait that's actually correct
Fork num C
num can I get the line the error was on
get instructions
22 I don't think that's right
[Music]
yeah that doesn't work
so add is useless
here the most we can do is Chas back
print
exception so we can debug it
better okay these problems are actually
all in the same
function yeah they're all just
here so if I figure out how to fix this
we're in
lock
oh I might just be able to do that
expected a bytes like object in
found sure what that's supposed to do
for
there has to be a canonical if Python 3
generator object has no attribute
next the generator objects usually have
an attribute
next isn't it
yeah I don't even understand that's not
even
right X just stupid anyway
object of type filter has no Len oh okay
fine
[Music]
filters are generators in Python 3
we're getting somewhere
list indices must be indicators or
slices not
float I'll probably do some
divide where do I do the
divide that that's that's one of the
things I appreciate actually from uh
from Python
3 yeah right here
type map has no when let's find the
rags rags
object of type byes iio has no string
iio well that's
true string import string
B is that
right module
name must be stir not bites well that's
fine this's going to be bites
too and you can add bites to bites can't
you
okay so the picture actually didn't show
up Works in Python I don't like that
that's a picture either but I remember
really hacking that for
performance thank you sorry I'm not
paying any attention to you guys I'm
kind of focused
uh all right what's printing out these
base file
issues yeah let do that
what this shit's not even used
anymore I think that's the
[Music]
problem no it's
this least now those mappings are right
probably more open
somewhere yes that open there's an open
cure config no not
that
hurt for
bites like object is required not
string see okay if we're doing
that wherever this file is opened we
actually don't want to open this
is what
so that's
split Cod base memory
so this is the problem
um let's go to
569 and let's print
F yeah I really don't think we should be
opening those base
files let's see what the file
yeah that's fine that doesn't have very
open
do so we're explicitly open that it's
text
failed to
get this is a different ah here we
go
what God I don't even know what that
stuff does beautiful
okay except for the picture being broken
I think everything is
good let's find out why the picture is
broken
look like a PNG to
me tiny PNG
it does seem okay I don't know
printing
101 that one works
correct ra
aha let's just see if that works python
as
well
cool I think that was the last
thing the last Sol ones
Python 3 Port less subtle
things Wait no that's already what I
named
it that's
fine good
name let's try the
test good
test pass don't know how good the tests
are but they
pass that's Cur in
Python that's Cur in Python 3
it wasn't too
bad oh we done
all right there were a whole static
analysis stuff built into Kira but I
shouldn't have broken any of it
I think I'm pretty happy I think that's
a good day work
um all right well that's today's
stream uh I'm just going to go read over
my diff for stupidity and make sure I
didn't do anything really dumb let's up
the version to
1.4 any questions
let's see what my end follower count is
this is a follower
Aon
[Music]
6,020 oh I appreciate you all
okay when do I think there's AI oh how
was the hike
yo yo the hike was
crazy uh all right so you go to
let's go Google
Maps oh San Diego when am I moving to
San Diego
wow I don't know is that public is that
Kam related we don't talk about
Kam uh so you
get wow that's slow wow that's that's
unbearable
wow you get to
here um you see this part here so this
looks like oh it's a nice walk on the
beach right wrong it's only a nice walk
on the beach if the tide is out if the
tide is
in I think this was the rock where I
fell into the
ocean yeah I was like you know
scrambling around this across this rock
and like I slipped down here and I fell
in the ocean so everything got uh I was
going to go get a haircut
today yeah I know I know this computer's
terrible
um need more content on
Instagram uh was I implementing this to
do more with the fen fig yeah we'll go
back to the fonkin Fig I think maybe
eventually
um can you look at my PR uh yes I think
yes I think I will merge your PR uh the
the control C I appreciate
that
um I need a plan to reach a million I
registered 1M 2019.com isn't that enough
do I have to do more these
days so glad I finally got to see one of
your streams thank you thank you for
joining I appreciate having you here
this is what we did this morning we
ported Cur to Python
3 and then we're going to merge it
maybe we'll do some refactoring in it
too I don't know I don't really read
that much of the code fuck you for not
answering my questions I don't I don't
know about your questions you want to
talk about when AI is going to do
something when questions are usually
dumb like I don't know man the better
like how hard is it I just want you to
think about this right Uber Eats tells
me my food is going to be here in 15 to
minutes it's been 37 minutes where's my
food right and then you're asking like
when AI is going to be able to do
something let's first focus on being
able to figure out when my food's going
to get here that is
practical how do you stay motivated
that's a subscriber only
question
um yeah one day one day they're going to
like I think they lie to me on purpose
about the food though cuz they know I'm
like oh 37 minutes I'm not going I'm not
going to order food if it's going to
take that
long oh you're a subscriber you asked
that question
um bro people say like how do you stay
motivated I think a better question is
how do you stay
unmotivated I tried doing nothing it was
really hard doing nothing is
surprisingly difficult like you're like
wow I'm going do nothing today and then
like you're like wow I'm going smoke
weed and do nothing but then you've done
something because you smoked weed and
then after you did that you're like shit
man I'm high I don't want to sit here
and think that sounds scary I better do
something exactly
can't do
nothing don't feel depressed if you're
not doing anything productive feel
depressed if you're not doing anything
everything's productive look at me see
I'm out here trying to get Instagram
followers right sometimes people are
doing that but what I would say is if
you're going to do something you should
do it yeah
why have you still not learned some I
don't know what differential geometry
is I don't know anything about things
that were sent to the comma office do
you know Elizabeth Holmes and Sonny bani
had code names Eagle One and Eagle 2 and
they had like security escorting them
that's what shit's like at the comma
office
too uh am I millionaire yet uh I don't
know that's a personal question everyone
was millionaires
you know back in the day but then you
know
yeah if you're gonna do something you
should do it that's a good quote am I
good at
math
uh I mean that's a funny question right
who are you comparing me to probably
better at math than
you maybe not though you might actually
be really good at math so like if you
want to have a math Showdown sometime
I'm down
um is Kira stable right now well no
that's what you mean is it stable it's
yeah it kind of works it's better than
it was a few days ago when it didn't
work at
all
um is that I can't see if that's one
times one or one plus one because
they're different they're actually one
off I am not a Millionaire on Instagram
that's a good point we know that's true
do you think someone learning to code at
30 could do something subst look okay
all right all right I'm only going to
say this once don't try to do something
substantial in the space that's how we
get like thought leaders and losers and
people who are like hey man you know I
just want to learn to hack so I could
just go do
something right just go do something can
you do something yeah you can do
something and try to make it useful to
somebody right and don't like go around
like asking people hey man what'll be
useful to you what'll be useful to you
cuz that's annoying instead just do
something and if people start using it
that's cool um if people aren't using it
then you know maybe do something else or
make it better
uh what's the license of Kira I switched
it it's
MIT MIT is the new George hates
intellectual property license so
everything can be MIT and you can do
whatever you want with it because I
don't really
care will I stream tomorrow guys when
Uber Eats figures out tell you I know
things for the next I know things for as
long as UB breits when they figure out
how to tell you
you
uh when my food's going to be here
quickly I'll be able to tell you what
I'm going to do tomorrow have you ever
talked to Martin scy no but I emailed
him once he didn't reply to
me uh i' totally visit him in jail
though no that put me on some list never
mind food is coming Uber
2019 uh what was the last time you took
some Aderall not for a while
um I don't know the problem with thater
all is like it's trading off like now
for the
future yeah kir ported to Python
3 oh play some smooth
cords what was that what was I doing
this morning I I was recording a little
bit
[Music]
this was like Sor I was thinking this
morning my opinion on Kam YouTube
channel as long as he doesn't monetize I
appreciate
it do some
crack my friend smell crack once I know
smell crack but my friend smell crack
once no crack story and he's like
look and he sat down I smoked the crack
and and then like a couple minutes later
he was like that was terrible but I kind
of want to do it
again so I never smoke crack
but there is a great Kendrick Lamar
quote I don't smoke crack motherfucker I
sell it that's a good
quote uh Let Her Go Let Her Go I'm one
with the wind and Snow Let Her Go Let
Her
Go I don't know if these are the
words crack stream yo yo no that's what
I was thinking about that's what I was
thinking about during my hike I almost
live stream my hike for you guys and
like you know it's kind of sketch right
cuz like here's a cliff and here's the
ocean like the tide wasn't very strong
but if the tide did come in you you
would die
um um maybe you could scramble up the
rocks and you just have to wait a while
but I then realized that there have to
be streams somewhere on the internet of
people doing dangerous
things and then I resolved to look that
up and then I didn't look it up
um no guys look if I wanted to make a
vlog I'd have to hire editors and like I
know these people right like they got a
couple editors and like they they edit
the life together and like it's every
day bro it's every day bro yo live
League real shit oh but no there have to
be like like think about it like I know
watch people die is banned from Reddit
but like imagine like watch people maybe
die and it's just live streams of people
doing dangerous shit we live in a fucked
up World
guys
um no no there's plenty of footage of
people doing dangerous things but like
live
streamed God you ever actually try to
automate anything with AI no what's jpeg
Mafia let's check this out
[Laughter]
d
I know check that out more later but uh
yeah one dude live stream hitting a rock
with a Wings suit on Facebook that's
crazy like you
gota well then oh oh then we started
thinking yeah how many people who've
died on live
TV like this has to have happened a lot
and then we realized that
like
TV was just wow
oh but these are not
live I'll look this up when you guys
aren't here with me but what I realized
was TV was just the OG streaming except
you had to watch five assholes push like
narrative approved
content now I'm here on the internet and
I can say whatever I want
how cool is
that do I know the New Zealand shooting
I do not read the
news if this is news though I don't read
it I like like if you want to know the
news about something like the Ethiopian
plane crash which very interesting
Boeing 737 Max 8 mad sketch you know
they were using One sensor they had two
sensors they didn't do the sensor f fion
someone at Boeing should really
like I don't know but but I hope none of
the other planes like
that um I don't know anything about
Metal oh they did some like anti-
virtualization
shit thank you bdh rocks for
subscribing uh oh oh yeah yeah that
video yeah no I know that video that was
kind of the news that's kind of yeah
yeah no that's not no it's not cool to
like live stream killing other people
that's just dick man but if you want to
like live stream yourself doing
something dangerous well
that's if there's one right you have in
your life it's your right to life
liberty and the pursuit of happiness
even if that means streaming yourself
doing dangerous shit that can only harm
yourself that's the right that you
have wait wait wait wait wait okay there
was definitely something wrong with the
plane um a little little update on this
cuz this one's kind of interesting it's
kind of in my industry um 737 Max 8 had
something called the mcast
system let's see if there's anything
that isn't like crappy news about
this um nope crappy news crappy
news uh stack exchange crappy news
so the
real Yeah so basically because Boeing
was cheap and didn't want to get the 737
Max certified as a different type from
the 737 they had to make it fly like a
737 the problem is a 737 is a really low
plane so they had to stick the new
engines they put some new engines on it
that's what they wanted to put on it
because all the carriers want these new
engines they're quieter and more
importantly they're more efficient so
they use less fuel so the flight can be
cheaper but 730 7 is very low to the
ground air airframe you'll see it if
you're you know on a plane the landing
gear is real small and there's not that
much room between the engines and the
ground so they couldn't put the engines
under the wing they had to like stick
them out Way Forward the problem with
sticking the engines out Way Forward is
well you're playing center of gravity is
now in a different place uh your plane's
kind of when your plane's kind of like
this it can stall and it won't tip
forward as easily so they added in this
janky hack called the maneuvering
characteristics augmentation system to
get around it
um what it would do is basically to
prevent stalls it would nose you down if
it detected that the angle of attack was
was too uh high for the given speed the
problem is it only used one angle of
attack sensor so when this angle of
attack sensor failed it nosed your plane
down and then the angle of attack sensor
was still failed so it's like oh we need
to nose the plane down more oh we need
to knows the plane down more as far as I
know there was no actual way to turn off
the mcast system they're using trim to
nose the plane down so they had to uh
turn the trim off but if you turn off
electronic trim the only other way to do
the trim is manually and I don't even
think you could trim back up fast enough
to recover that
flight so yeah
um mcast was mad sketchy oh and they
also because they didn't want to get
retype certified they didn't tell the
pilots about mcap
it used One sensor and uh there was no
easy way to like turn it off you can
talk about why it's different runaway
trim but then that's just a long thing
but
yeah
um so that's that's Boeing but the moral
of the story is if you want to find out
about the Boeing 737 Max groundings Read
Wikipedia do not read the news the news
is the most disgusting thing on the
internet think of the most disgusting
porn you've ever watched and then the
news is
worse yeah I know Bo has a DLC oh oh get
this get this there was a there was a
readout there was a but there was a
light which would tell you whether your
angle of attack sensor had failed it
compared the two sensors and it was an
angle of attack sensor failure light but
that light was an option it didn't come
with the plane by default so you know
you have to ask how much does this
carrier care about safety
um for reference Southwest bought all of
them American bought some of them and
United didn't buy any of them so that's
just the US
carriers
uh what if you don't understand the
Wikipedia do not read the
news I just like how safe do you want
your play to be I mean lionaire you know
they don't really prioritie safety you
can check the Jack deck ratings
um yeah so just like yeah before you get
on a plane you know you can check how
safe your plane is um and you can see
lion a is way down here at number
57 uh so yeah yeah like like these yeah
yeah yeah Korean Airlines are also
particularly uh dangerous given um
Japanese Airlines are very safe and US
Airlines somewhere in the
middle um cath Pacific lovely of course
the new zealanders have a safe
airplane oh Ryo is actually pretty safe
they rer on here yeah ryer is down here
at 34 that's not
bad um so yeah ryer is like on par with
like Singapore Airlines like incredibly
safe planes in fact they're all pretty
much incredibly safe until you get down
until like
uh yeah
like here is probably where I would like
you know reconsider
flying you yeah of course the airlines
are
safe well part of the reason their
airlines are so safe is because they're
using new
planes um they're buying like the
a380s uh you know they're not buying the
the cheap shit and like
this
one um part of it you also there is a
bit of a bias to where these planes fly
like it is much easier to fly a plane
around like you know the desert in the
UAE than it is to fly a plane around
like hurricane season
Indonesia um how about Chinese Airlines
Chinese airlines are all over the map uh
from hyan Airlines very very safe all
the way down to China Airlines and
Taiwan which they say is the worst one
I'm not really sure
why
um ah
sorry I don't know but the Jack Teck
ratings pretty good and they they have
like all the stuff about how you can
uh uh we don't talk about comi on this
channel don't we know the rules already
wow look at this 260 people yall want to
watch this yall want to watch
rant fuck Bitcoin
D yeah I don't know I I bought some
quick shorts on Boeing and then I
realized that it turns out not to matter
because like people can't actually
evaluate that this actually was a major
screw up on Boeing's part most of the
time when you read like some event in
the news and the stock dips buy the
stock almost always buy the stock I made
a killing last year buying super
micro um oh wow it's up even
more I bought super micro down here at
1260 actually I got it even lower than
that and now it's up to
2060 um but there was no good way to
really profit off this one I did buy
some Airbus and airb went down a little
so uh
um formal methods could be used to
verify stuff in machine learning
no uh which broker
uh TD Mar
trade it's fake news
guys thought on 5G I don't got no 5G I
got
LTE no never mind I got
Wi-Fi all right guys the questions are
getting dumb whenever the question what
about crypto comes out we're down to the
dumb question Zone we're in the dumb
question zone so we got to go uh I'll
leave you with one last thought which is
uh 1M
2019 please follow me on
Instagram byebye
all right guys the questions are getting
dumb whenever the question what about
crypto comes out we're down to the dumb
question Zone we're in the dumb question
zone so we got to go uh I'll leave you
with one last thought which is uh 1M
20109 please follow me on
Instagram byebye
WEBVTT
Kind: captions
Language: en
zktskhan: hello
Keyeh: good evening dude whats up
andrewfashion: mr hotz, i can make you IG famous
dorkmo: thumbs up lets do this
sl4ckerman: second stream of the day? nice
goofe7: #1
480i: Stream is smooth now
Aocuser: seeing you
Keyeh: webcam freezes sometimes but I see you
eugenedream: sup
480i: Spoke too soon. Oops.
eugenedream: I watched your simulation talk at sxsw and it has me rattled
AideTechBot: do you hire interns
480i: Yeah the talk was good
AideTechBot: ;)
NclxGaming: Are you having fun programming inside the simulation?
480i: I think I would have to pay to bring geohots pure leaf tea. Does that make me a geohot shill idk
rr00mm11: Any reason you're not using a tool like modernizer for that?
acheesedanish00: 2 streams in one day?
acheesedanish00: fuck yeah
chase_higgins: Hey George what are you porting?
Keyeh: qira, a debugger he wrote
chase_higgins: Sick
Keyeh: not frozen
ScrubLifeChoseMe: welcome back
lazystring: hey
mattikaldi: fresh cut?
anatoly1974: did u find God Yet George ??
davidsit_site: well thanks for thinking of us and dropping online for a short bit. hope you have a good night
anatoly1974: how is this basic when is it is machine code ??? @georgehotz
NclxGaming: What's your #1 programmer in the world (or people that inspire you - if any - because of their skills)? yourself? :P
Keyeh: its BASIC dude
davidsit_site: basic machine code.
davidsit_site: basically machine code
davidsit_site: lol
NonTrivial778: GeoHot what do you think about password managers ?
zacoaa: Do you like java?
davidsit_site: no java
cIvIcbooks: kernalshark has a interesting trace reader
ViktorTV: do not shit talk java
ViktorTV: java is great if uour goal is to have a stable job
ViktorTV: 100k a year easy life if you know java well
BradyLange: Java is good stuff
ViktorTV: however if you desire anything more then java is shit
davidsit_site: java was my 3rd language
lazystring: CHAT IS DEAD
th3_maj0r: 2 stream in a day wow
Keyeh: LMAO
Masboy_: !uptime
glitchedoutt: Prolog was invented for perpetual employment of monks
NclxGaming: What was the word he said? lol
davidsit_site: hotz is going to automate all jobs and make a religion? I thought that was a joke....
zacoaa: Im tryna figure it out
davidsit_site: I mean. I'm down to help automate everything. I'll not help past that
th3_maj0r: Metroment
glitchedoutt: This stream is brought you by capitalism
Keyeh: so its basically water
th3_maj0r: metroment has 0kcal
magician2378: this stream is brought to you by the simulation
TheFrozenTruth: @georgehotz what chair do you use?
z0di4ckx: hey
NclxGaming: I don't think why someone would want to learn programming to find a job
Rydberggg: what can you play on piano ?
480i: Y u no aeron
glitchedoutt: Herman Miller Aeron
davidsit_site: @nclxgaming. elaborate please?
th3_maj0r: why stream drops so many frames
karelomab: Brought to you by Ice Tea
anatoly1974: what is your speciality in the realm of coding ??
nightknight0000: close laptop lid, will fix all your lag issues
xcodevn: turn off preview help a bit
NclxGaming: Brother if you need money why would you spend so much effort just to get a job? You learn programming to CREATE and to do stuff that are actually worth it not to get a stable job.
th3_maj0r: u need to restrat i think. next time we will see
480i: @nclxgaming Don’t you need both
glitchedoutt: Material Design
Knarez: needs pretty colors Kappa
ABuffSeagull: if you're gonna use React, use React Hooks, it's quite a bit better
davidsit_site: @nclxgaming agreed
ABuffSeagull: although I still love Vue
favvs13: @georgehotz TriHard 7
BradyLange: ScaredyCat
acheesedanish00: I'll sponsor you geo
lbucci3: start drinking Bang! a bunch of girls on IG get sponsored .. :p
ABuffSeagull: React Hooks is a more functional structure, instead of OOP with components. Which is nice, since React really pushes for functional patterns
kakurai: hey @georgehotz , I'm a huge fan of yours. Greetings from Brazil.
anatoly1974: All I want to know is what the hell is that machine code doing there ??
lbucci3: another Brazilian
FugaxOfficial: hello
Knarez: when was the last time you used xmonad
ffthgezgxjkndd: !uptime
ffthgezgxjkndd: danke
Keyeh: python implements integer by default?
Keyeh: bigInt*
anatoly1974: some 30 minutes in @ffthgezgxjkndd
Keyeh: never actually look into it
NclxGaming: For how long did you work at Facebook? Thanks for quitting btw
NclxGaming: Could you imagine this guy working @facebook? NotLikeThis
Keyeh: dangerous energy to drink OMEGALUL
acheesedanish00: not bad actually geo
luhartt: bang gets u wired
lbucci3: Bang - all IG babes drink it
davidsit_site: yeah. @nclxgaming. boredom increasing the time spent on Facebook hours graph.
anatoly1974: FIRQ,IRQ
thylacinev: do you code during most of your free time?
OArtero: @georgehotz do you use cherry Blue keys in your kb ?
Enm1ty: no way those are blues
Enm1ty: sound like buckling spring
Enm1ty: topre?
somewhere_rains: !uptime
Keyeh: inb4 its not even mechanical
NclxGaming: Lol. @davidsit_site Nice formula (assuming you meant georgehotz's boredoom time)
Enm1ty: monkaS
AugTV: What are u currently working on?
jay_al97: hey you're back?
jay_al97: this is the second stream today?
Dsplits: messy code
acheesedanish00: qira port to python 3
jonahglover: jonahglover subscribed at Tier 1. 
NclxGaming: I know who Siraj will call when he needs some coding help
chase_higgins: Do you do all your programming from the command line?
davidsit_site: ....kmsl @nclxgaming
jonahglover: @georgehotz were you listening to sunny day real estate during your SLAM stream? One of the songs sounded like "Circles". Related: am I as good as George Hotz if I listen to early 2000s emo when I am programming?
Hamled2: Do you have any test coverage configured for qira?
Hamled2: it says passing on my computer
Hamled2: browser cache
ferrari_pizza: hi geohot hi all
anatoly1974: can u tell us what project r u working on at least we are confused !
nmuntz_: @georgehotz I noticed that qemu 2.5.1 is not compatible with python3 so to build it it requires python2 installed. how hard would it be to port your patches to the latest qemu version?
erichtp: Are we at a million on instagram yet
nomadicpatch: !uptime
Bloumbs: Bloumbs subscribed at Tier 1. 
chase_higgins: Nope not a million yet lol
erichtp: At least he fixed the frames dropping
Gtxgaming23: i hate python....
davidsit_site: as it drops
erichtp: Two streams one day PogChamp
Bloumbs: @georgehotz what was it you were doing with the tesla comp you posted on your instagram George?
davidsit_site: didn't Tesla just give away a car to someone who hacked it
erichtp: @davidsit_site idk if it was Tesla themselves but someone won it in Pwn2Own
ferrari_pizza: I did not fall in love with python either
erichtp: I like Python it’s like c++ without the curly brackets and shit just works lol
davidsit_site: what languages beat python?
ferrari_pizza: ruby
ferrari_pizza: but it's smaller
ferrari_pizza: libs
davidsit_site: but better is subjective
geobitz: jailbreak the tesla the people deserve it
geobitz: plus a big shots fired toward elon
Hamled2: I've taken a liking to ruby as well, especially I think it works better as an "upgraded shell scripting" language over python
erichtp: Tesla has the holiday dances you can make yours fortnite emote LUL
davidsit_site: like if I said Ida is better ( because I have no experience with q), it's subjective....sell the tesla to fund my projects after unrooting it
ferrari_pizza: of course it's just a personal choice,
NclxGaming: People talking shit about college yet the best programmers I know went all to college O_o
NclxGaming: What do you guys think about GoLang?
ferrari_pizza: whattsapp runs erlang
Irkanu: heyo, just got in. did you finish the font config cache exploit?
ferrari_pizza: old but great
Hamled2: I've been looking at building binary analysis tools (working with a new book from No Starch about it). What are the biggest challenges you've had trying to make an IDA competitor?
tribegvng: g man
davidsit_site: thank you for explaining. I misunderstood its use case.
ferrari_pizza: in too stupid for reversing in 2019
tribegvng: do you like ghidra?
atomfighter10101: Hi @georgehotz
davidsit_site: didn't touch it. did you?
Hamled2: it just takes time ferrari_pizza. My best advice for getting better at reversing is to learn programming -- a lot of reversing something "easily" is knowing what the developer originally was trying to do
DrewHintz: @Hamled2 take a look at Ghidra, it's great. No debugger yet though.
atomfighter10101: @georgehotz what is that awesome debugger?
bcrscahh198987: wow assembly
mikey9988: Assembly monkaS
ferrari_pizza: I'm coding in java
bcrscahh198987: what kind of assembly? x86?
tribegvng: @DrewHintz yeah everyone is loving it
Hamled2: Yeah I saw MalwareTech working with it, haven't used it myself yet
bcrscahh198987: which ISA?
atomfighter10101: Is this web assembly
Hamled2: ferrari_pizza have you tried reversing any java code
ferrari_pizza: sometimes in c for esp8266
bcrscahh198987: web assembly rofl
bcrscahh198987: web assembly is a joke, I'm sure of it
r1c1c: hi youtube
tribegvng: unless it has a secret backdoor
tribegvng: lmao
bcrscahh198987: why would people reinvent assembly in javascript
rage_au: what is he doing
ferrari_pizza: @hamled2 no, did not
Hamled2: ferrari_pizza one way to do "reversinG" in an easier fashion than straight-on assembly (x86 or JVM bytecode) would be to take a chunk of Java code, and remove all the variable names (replace them with random stuff) and try to work out what the code does
brevan04: Same bat time same bat channel
Hamled2: it's practicing a lot of the same skills I think
prakyath_kantharaju: prakyath_kantharaju subscribed with Twitch Prime. 
ferrari_pizza: I've got 2 projects for android I'm working on, so maybe later
atomfighter10101: Oh its your own debugger looks great man
bcrscahh198987: does hotz stream games
bcrscahh198987: or only programming
Hamled2: keep working on those, that's also great practice :)
r1c1c: @bcrscahh198987 yes he does sometimes
davidsit_site: only fortnight
tribegvng: whats the diff between Ghidra and Qira?
NclxGaming: Which language did they use to program the simulation?
davidsit_site: (kidding) @bcrscahh198987
bcrscahh198987: lol
ferrari_pizza: @hamled2 I would also like to make my sony vcr read my android filesystem
bcrscahh198987: What' sthat web ap?
ferrari_pizza: :)
davidsit_site: we don't use Sony products in this household
atomfighter10101: @georgehotz Can qira run on windows10
Hamled2: that would be interesting, might be possible!
bcrscahh198987: nvm, it's qira
tribegvng: Runs it any browser
tribegvng: in*
Hamled2: tribegvng, Ghidra focuses on static analysis tools for reversing, where as Qira is a dynamic analysis tool primarily, or that's certainly where it stands out
ferrari_pizza: @i don't actually know who Filesystem is my SD card...
bcrscahh198987: qira is for application audit?
ferrari_pizza: those Linux ones...
tribegvng: I think i need to understand programming fully before i reverse shit right?
Hamled2: ferrari_pizza ext4 maybe?
ferrari_pizza: yes..
tribegvng: at like an expert level
ferrari_pizza: ntfs also possible...
Hamled2: tribegvng I think it helps a lot. They're very related skills so it'd be hard to be an expert at one without having decent skills at the other (maybe not specifics like assembly reversing, if you've never programming assembly, but in general)
tribegvng: i'm shit at programming though so its probably not gonna happen
erichtp: @tribegvng how would you know how to go backwards without going forwards first?
Hamled2: just keep working on it tribegvng
ferrari_pizza: Linux kernel is flexible in reading FS
tribegvng: understandable @Hamled2
Gtxgaming23: what is he programming
Hamled2: ferrari_pizza usually NTFS on linux is done through FUSE so not actually in the kernel
karelomab: FAT32 ftw
ferrari_pizza: year, vcr reads fat32
Hamled2: for flash drives?
ferrari_pizza: yes
karelomab: he said he has a SD card
karelomab: its 99% fat32 :/
Hamled2: ah
Significantbits: What vim colorscheme is this?
tribegvng: Just got a new M.2 drive damn they are fast
tribegvng: also risking it with no backup drive
karelomab: i mean
karelomab: you would use m2 for OS
atomfighter10101: So qira preforms a dynamic analysis on a running program in linux
karelomab: you put your data on a regular 3.5"
tribegvng: yeah i'm using it for OS but my company bought it so i just got a 1TB drive
tribegvng: have a 6tb backup
Hamled2: I think it runs it with qemu atomfighter10101, not sure if that means it allows for other guests than just linux
Gtxgaming23: isnt strace better than this qira&gt;
Hamled2: Gtxgaming23 I think qira has an strace output window within it...
Gtxgaming23: ok
atomfighter10101: Thanks @Hamled2 .
tribegvng: It's strange though it disables some of the sata ports
tribegvng: wonder if thats related to the board
ferrari_pizza: just use cemu for super mario cart
karelomab: really? i have m2 and my sata ports are fine
Hamled2: the motherboard only has so many SATA channels, so it's redirecting one of them
tribegvng: i'm running am4
karelomab: hmm
Hamled2: unless it's using the pci-e bus
Hamled2: depends on the m.2 implementation i think?
Hamled2: was it b-key or m-key
tribegvng: i'm not sure
vtcN_: m2. us a form factor
vtcN_: *is
Hamled2: yeah but multiple m.2 options support variously SATA-based drives and NVMe PCI-E based drives
tribegvng: I think its on this specific msi board
Bloumbs: I feel like this stream is George inside a glass room, and were all on the outside chatting and watching him code lol
Bloumbs: not in like a bad way
Bloumbs: love it lol
karelomab: glass room?
karelomab: LOL
Hamled2: which I think would determine if a SATA port needed to be disabled to use the M.2 slot or not, but I haven't run into this scenario before idk
davidsit_site: back to your Black Mirror episode
ferrari_pizza: glass is broken.. 😂
Bloumbs: room. box. whatever
davidsit_site: EleGiggle
brevan04: He low key is going to get the weed
karelomab: you mean Class room
tribegvng: getting the vvyanse pill
tribegvng: :d
ables91: not again
karelomab: looks like george is going backwards
karelomab: first there was qira
karelomab: now there is half of it xD
Hamled2: nice TODO message
karelomab: good old hardcoded magic numbers
chase_higgins: George check slack lmao
davidsit_site: in py3
ables91: sickkkkkkkk
chase_higgins: Er discord
andrewfashion: what in gods name is he building lol
andrewfashion: what is QIRA?
vtcN_: how many magic numbers are there now? a million?
mikey9988: every number is a magic number besides 0 and 1 monkaS
karelomab: that's future george problem
ferrari_pizza: I like how George is on his trail to really get an epic coder
mikey9988: what exactly is he working on @ferrari_pizza
ferrari_pizza: ollidebug and Ida are epic in a way
tribegvng: i like how people on the commai yt chan are like what keyboard do you use
tribegvng: like it makes you a good programmer
jgab19: !uptime
ferrari_pizza: his timeless debugger python3
ferrari_pizza: compatible
RockyJ0: Hey!
tomayyo: !uptime
tribegvng: is this anything similar to how groups crack the netflix encyption? or is that entirely web based?
tribegvng: they dont have any specific file to crack
Hamled2: well the content is delivered encrypted to the browser and decrypted by some native code module, I think
jagger_rsw: so after ai, cars, instagram George is back working on security?
Hamled2: so they would be reverseing and "cracking" that module
ferrari_pizza: what kinda crypto in Netflix?
tribegvng: its thier own format
Hamled2: https://en.wikipedia.org/wiki/Encrypted_Media_Extensions
ferrari_pizza: crypts what?
Kuaang: hi. I am looking at Korea
ADivorcedF0rk: lmfao
Hamled2: this, not sure if it's what netflix uses now, but that's the general idea
ADivorcedF0rk: do it then
glitchedoutt: I thought Netflix knew their shit
tribegvng: the method is private atm cause groups are still releasing it scene
glitchedoutt: With ChaosMonkey and all that
Hamled2: there's only so much you can do to hide the data when the ultimate goal of your program is to actually play the video, glitchedoutt
tribegvng: so its still cracked
qin_baba: how high is ur iq
glitchedoutt: Haha fair enough @Hamled2
Hamled2: glitchedoutt chaos monkey is just server-side "resilience testing", the only way I think it interacts with esecurity is kind of like [D]DOS type attacks
ferrari_pizza: but game of thrones isn't Netflix.. 😂
Hamled2: in theory they're more resilient to a specific DoS attack because their systems are already built to withstand any given component dying due to hardware failure or attack or wathever
tribegvng: wouldnt be surprised if they stopped once it gets patched
ferrari_pizza: where are new episodes...
tribegvng: since the releases are trash
ferrari_pizza: vim with a das keyboard... nitemare...
ferrari_pizza: :)
Sylens__: might just start learning vim over learning emacs
unDe4dman: а сколько трансляция идет
Sylens__: youre so fast with this it dont make no since lol
ferrari_pizza: intellij
tribegvng: i split beer on my quickfire and the ctrl key is fucked. not sure what to replace it with tho. custom or?
unDe4dman: !up
unDe4dman: !uptime
tribegvng: good keyboards though damn shame
JonThomasK: react is garbage
Crypod: 1:28
Crypod: @JonThomasK what do you recommend instead?
JonThomasK: if you are going to use a reactive framework? Vue
foxubu: You are still streaming O_O
Crypod: interesting
ferrari_pizza: and he knows all the fckn Unix commands
ferrari_pizza: 😂 😂 😂
tribegvng: i just got someone to build an app but they're using codeigniter i'm dreading it
tribegvng: is it really that bad?
unDe4dman: how many broadcast goes on time?
chase_higgins: Codeigniter isn’t too bad
advil0: hi chase
tribegvng: oh good
chase_higgins: Hey
ferrari_pizza: what is coodeigniter
chase_higgins: Codeigniter is a pho framework
chase_higgins: Php
tribegvng: we're implementing stripe thats the only thing that concerns me . if they find a vuln and put some malicous code on checkout
ferrari_pizza: @chase_higgins ahhh
Hamled2: what does changelist mean in the context of Qira?
advil0: stripe is pretty secure
tribegvng: yeah but if they own it on my side
Hamled2: an object is a key-value store...
chase_higgins: I have stripe implemented in a codeigniter application, it works fine
tribegvng: cant they do like a mimt thing or log anything on the form
Irkanu: If Stripe gets fucked, then a lot of people are fucked.
Hamled2: Object.keys
JonThomasK: ES6 has a generator like python
advil0: yeah stripe is used by TONS of sites
Sylens__: if you dont know go to stack overflow &lt;3
tribegvng: yeah i've used it before
tribegvng: just never with custom code
LilDogMike: whatcha dooooin?
chase_higgins: It’s pretty hard to mess up lol
tribegvng: wasnt there a js vuln on neweeg though
tribegvng: i kinda mean like that not on the payment processor side
Ustunner: What’s good George
tribegvng: https://www.volexity.com/wp-content/uploads/2018/09/newegg_4.png
mikey9988: monkaS
AshfaqSeyad: hey man
nizero: georege i read this article about u as a kid and it said something about how u would go to ur neighbors houses and "fix" their computers ... is that story true
ferrari_pizza: @tribegvng... what's that credid card func... vuln?
tribegvng: not sure if they actually owned the server
jonnyasl: jonnyasl subscribed with Twitch Prime. 
tribegvng: or just the api
tribegvng: @ferrari_pizza https://www.volexity.com/blog/2018/09/19/magecart-strikes-again-newegg/
tribegvng: or was it xss
shafiemukhre: @georgehotz why are you using vim over others?
ferrari_pizza: it's a post command...
ferrari_pizza: json post to Uri...
tribegvng: but they obv were able to write to the checkout page?
tribegvng: to edit insert the code
nizero: george are you moving to SD with the rest of comma.ai team ?
Hamled2: what is the intent of the address readout in the lower-right panel you're working on?
brevan04: Can I hack civic torque with Qira when it is done?
jonnyasl: Haircut?
LilDogMike: do you ever not do this?
tribegvng: @ferrari_pizza if you're a target for attackers best form of defense? bug bounty or something?
tribegvng: H1 etc.
funnnnyyyyy: can i work for you pls
ferrari_pizza: &lt;maybe get a decent cup of coffee&gt;
nizero: use push
tribegvng: push?
Hamled2: George, Object.keys...
JonThomasK: js is cancer anyway, dont blame you for not knowing it in depth
gluecks: is there any good dev environments for python like VS?
tribegvng: electron apps are the best tho so fast
funnnnyyyyy: it's kinda funny i have extra points for my math homework in math at my school and i hacked the teacher computer to get de copy of the homework correction on inthernet and i just did my homework at 2:37am in canada
davidsit_site: today on what never happened
tribegvng: is that a bot
funnnnyyyyy: i send it to my class mates and i charged them 5$ each to get it and i made like 25 i think
Irkanu: something higher in the dam is applying padding
JonThomasK: probably a height: 100% somewhere
tribegvng: bots are getting smarter
Irkanu: can't see b/c your face.
Irkanu: higher in the DOM*
mobilakias: mobilakias subscribed with Twitch Prime. 
tribegvng: @georgehotz did macs death shock you?
serhejenos: wow, I'managed to get some sleep and you're still going at it
braktwitch: hi
xune789: Is your motivation for getting a million followers on instagram, to impress thots irl Kappa
unDe4dman: its IDA ?
lucemferro_: are you in support of universal basic income? can i get some of your thoughts about it?
ferrari_pizza: a HashMap for every address.. what are binary size limits?
JonThomasK: qira is awesome
Elinbae: Have you ever thought of creating a cryptocurrency? it seems to be the new cashgrab of the century
unctarheelss: hiii
Juggling_Pro: hey george
joker2k999: the transfer is real...
boneitis: oh shiiiit. will this be the time i finally succeed in installing qira?
JonThomasK: im close to getting qira fully in a docker container so you can run it on any host
Hamled2: JonThomasK what work remains to be done for that
boneitis: giggity
JonThomasK: sorry i mean fixing the docker
joker2k999: looks like the sequel to ddd
jay_al97: your hair got so long
joker2k999: keep the fro bro
Hamled2: do you want to do a source-level debugger view?
joker2k999: peace bro's.
Hamled2: oh yeah I saw some commits about that
Hamled2: right
joker2k999: no.
Hamled2: yes its the PDB for ELF
JonThomasK: i've got a semi-working setup of running qira with docker instead of your local machine so its highly portable (mounts your binary into container)
Hamled2: it's the debug symbol data joker, links the assembly instructions to source code lines
Oh, now it's working.
Okay. I don't know.
Hello.
I was listening to
don't want this. I know. I know.
Twitchies. No.
If we get a 100red viewers, I'll play
you a brand new rap song. I wrote a rap
song. I wrote it last week. I don't
think it's actually worth releasing on
Soundcloud. It's not that high quality,
but um yeah, if we get if we get 100
people, I'll uh I'll play it. All right,
let's make Slam Fast. So, where were we?
Wow, it's been a while, guys. Oh god, I
had a date Thursday night. So, I got
home
late Friday
and I didn't stream Friday and I'm very
sorry. And then
yesterday,
uh,
it's probably not. Do you have an issue?
All right, let's look at issues. Let's
see what issues we got. I probably don't
care about it. Cannot work with test
fryberg. Yeah, I know, man. Probably
sucks. Wow, that's shitty slam. Who
wrote that shitty slam?
Well, at least someone else got it
running. That's exciting. Uh, okay.
Yeah, we should fix that. Now, we see if
we got 100, maybe we'll play a rap song.
Um, but now what are we here to do?
Uh, profile with flame. Search by
projection less stupidly. Don't add
points to the optimation draft for pose.
At least I can do that one. That one's
easy.
How many else could I fit in my closet?
Um,
it has to be it has to be organic 100.
Organic. That's right. Like the guy who
runs the rap battles. You know what I'm
talking about.
Um,
yeah,
bro. You guys ever watch battle rap?
No. Like, if you've never seen like
battle rap, I don't know what's good,
bro. Like, if you've never seen this
kind of shit, man. Super legit.
You would have not have quit. You would
have probably thought of it, realized.
Nah, I worked too hard for this. I'm
Solomon. I'll come back and demolish
them. Where's your gladiator armor kit?
Your heart is sparticus. I am Sparta
shit. Come on, dog. You got this shit.
I'm giving you back all your confidence,
bro. I use back kick. Don't use any of
that bullshit. I'm just saying. I'm just
saying you was a legend. I'm just
saying.
I'm just If you guys have never seen
Borat, will I accept a PR for Windows
support if it's easy to maintain? Yeah.
Okay. So, first thing we're going to
change is we're going to improve the
optimizer for uh
pose.
Stop. Please, I don't want to go home.
I zoomed I zoomed out a little. Is that
okay? Can you guys still see?
Add frames to graph. Add points. Wait.
Right. So, I'm already doing that.
Um, let's just pass verbos into that and
see what we're actually doing here.
345 edges. Okay, that's actually not
bad.
Never mind. We're already doing this.
Okay. Well, it's really not optimizing
it much ever,
which is kind of shitty. Like look at
the chise. It stays the same.
Hm. That's interesting.
Am I adding all frames even if they're
not local frames?
Ah, yes, I am.
Ah,
well, we can certainly change that.
So if we fix points
say local frames if fix points
else let's try that.
Yeah it's fine. I also put that logic
down here.
What? How did that break?
We just got unlucky.
Still not optimizing for shit.
local frames and fix point elk soft
frames.
Hey, we should smoke some weed today. I
think we should. Um, I'm not really
feeling this Red Bull. I kind of want
coffee.
I kind of want Starbucks, but I can't
bring you bros to Starbucks, so we'll
have to go downstairs and settle for
closet coffee.
Um, but yeah, I think I think we're
going to talk bull today. I think so. I
think Sunday. That's what we do.
Let's get Blaze, bro.
Um, but let's figure out where we are
first.
Okay, so I don't know why this doesn't
optimize at all. Are some of those edges
just total garbage? We can't optimize
them.
Fix points else frames. Like that's
right.
I mean, we don't really need this. We
can just say
bird is nine.
Um,
look, it's not really optimizing.
And those are pretty high errors,
actually.
Okay. Also, why is this that and this
that? That doesn't make sense.
Look at it mess up.
It's going crazy.
Why is it not working?
Did I mess something up?
If FF is not none, then estimate and put
it back.
It goes crazy now. Okay, let's figure
out what I messed up.
Well,
no, I'm fixing the positions of the
points, so that should be okay.
Okay, you know what? Let's just refactor
this to do this.
[Music]
How much do I smoke? Uh,
depends if I'm coding. I don't smoke
that much. Um, all I smoke weed.
Let's see what we got here.
Guys, I'm in California. That shit's
legal, bros. I don't smoke cigarettes.
Sometimes I smoke spliffs.
Smells pretty good, but I'm smoking this
a lot.
What else we got?
Some sour tangi. I bought this off a
friend. He got it up in uh in Eureka.
It smells pretty good.
I don't know though. Some sour tangi
might be. Check it out, guys.
I don't know. I'm not feeling that.
I'm feeling this.
Oh, it's XJ13.
There we go. Yeah, this what I smoked
last time. Um,
smells I don't know.
See what else I got.
Yeah, this is sativas, bro.
Mostly I smoke sativas.
I don't know. Um, my friend smoke
sativas, that's why I have a lot of
them. Here's a hybrid cherry OG.
I'm not feeling this.
This is This is the old shit.
Now I'm feeling that I'm feeling that
I'm feeling that XJ feeling that XJ uh
uh 13. Yeah, just weed. I don't know. I
used to do more drugs when I was
younger. I don't want to do drugs that
much anymore. Just weed.
Back to my office. I don't know what
does that mean.
Just put a little in the grinder.
Grind it up. How often did I smoke? At
18.
Uh, when did I really start smoking?
When I lived in LA, I would smoke weed
every day when I was 27.
Now I smoke like once or twice a week.
making a mess. Look, look, look at it.
Look at that bowl.
I want a new I want a new uh what are
those things called?
I might have one somewhere.
Have one new screen.
Screen's getting really clogged.
Screen. Oh yes, I have screens. Oh yeah.
Oh yeah. Look what I found.
Oh, look what I found. Bros
screens.
All right. I just need something to get
this one out.
See what I got. What do we got? I got to
get this one out.
There we go. We got a USBC to USBA. This
probably work.
Yo, I love this piece, man.
Oh, man. Look at Look at that screen.
It's just like torn to shreds in there.
Oh, yeah.
This isn't really the best tool for
this.
Thank you. I like this room.
Um,
I can't even get this out.
No.
Oh, there we go.
Yeah. Look, look, look at that. Look at
that screen covered in shit.
the bottom of my bowl.
Whatever.
No, let's clean it. Let's clean it back.
All right. So, there's a bit of
tar at the bottom of that shit.
Yeah. Look at this brand new gold
screen.
I remember
my friend and I ran to the store to get
this shit.
You allowed to smoke weed on Twitch.
They going to call the Twitch police on
me.
Perfect,
guys.
Oh, this this is I can't I can't smoke
all this this bowl this bowl. See,
that's the thing. I don't like this bowl
will last like at least two smoking
sessions.
Oh, nice. Good.
Uh, but no, honestly, smoking weed was
way more cool when it was illegal. That
was less cool.
One of these days I'll give up smoking
weed.
Um, is weed No, you don't need a medical
license anymore. You can just buy it.
Uh, is weed bad for a healthy body? I
mean, dude, like it's like drinking,
man. If you're going to drink like No, I
think it's less bad than drinking,
probably.
Um,
is it healthy for you? I don't know.
You know what's the most unhealthy thing
people do? They don't think.
Oh, that's a clean hit, bros.
I love that new screen. None of that
tar. Get it out.
Damn, bros.
Yeah.
Can weed change the world? I don't know.
Uh, kids don't do drugs.
Eh, I don't know, man.
Don't do drugs to get fucked up, right?
I That's generally a thing. Like some
people talk about like, "Oh, doing
drugs, man, was so fucked up." Like,
don't do drugs for that. You're an
idiot. Um,
I don't know. But I'm a big fan of
drugs.
Okay, so where was I?
I didn't really write this very well,
now did I?
Part I want to say is this graph frame
subp
is it going to complain about like
that's not a hash and that's not a
hashable object blah blah blah blah
blah. Yeah, probably
FF is not none.
Segmentation fault 11. Okay. Well,
that's another way of complaining. What?
I don't understand why it's broken.
No, it's not.
How many lines of code are we? Let's say
Well, I never had slot count take that
long.
Oh, because it counted everything. No,
we only want uh
460. Not many.
Ah, that's so much better.
Um,
well,
so I can't do that anymore.
See the problem? This this this doesn't
work anymore. This code,
this vert's never none.
self.points equals new points. Well, you
know what? Actually, since I'm not
iterating over self.points anymore, I
can just say here self.points.
What is it? How do I remove an element
from a Python array?
Oh my god.
To remove the elements first occurren in
the list.
A remove. Well, that's cool.
We get rid of all this new points crap.
New points is not defined. Oh.
Well,
it's kind of useful to have
See, it broke. Why' it break?
Break.
I really Is this like a new regression
though? That's what I don't really
understand.
Am
I running the pose optimizer every time?
That could be the problem.
Yeah, we don't want to do that.
That was the problem.
Unsupported type.
What?
Oh.
Oh, it's still broken. I don't know. My
essential matrices like that's weird.
Get initial positions from fundamental
matrix.
Is that wrong now? Did I like change
something to make that wrong?
Well, put it this way. None of those
changes introduce that.
[Music]
I'm good, bro.
Now see, look, the first two are messed
up. So this has to be some problem with
the essential matrix thing,
which is weird because that was
historically pretty reliable.
Did I have the test NYC video? I don't
know.
Okay, that one. Look, that one's messed
like Yeah, it's messing up on I think
that's actually been happening for a
while.
Um,
I probably like need to invert it. I'm
just not.
I just don't think that's right.
Okay. It's like scary if that does
equally well.
Is my It looks like my initializer is
just completely fucked.
Maybe the bigger problem is just that
like RT is garbage.
Yeah, like every time it's saying to go
more that way. This doesn't even look
like it's in the right
like rotational frame. This doesn't
really make sense, right?
Okay. So, this translation is coming
from a
uh coming from a central matrix, but
that doesn't make sense.
That's That vector doesn't have a normal
one, does it?
Whoa.
Does Wow.
Okay. So that's what it's estimating.
It's just my essential matrix estimator.
That's total garbage. Um
I forget exactly what matches is
actually on pruning
frame.
Length of descriptors, length of
matches, length of inliers, sum of
inliers. Well, maybe inliers is just
crap.
We only set max trials to 30. I don't
know that.
See, look. I get a completely different
answer.
Well, I get a different answer every
time. That's even worse.
Oh, length and wires is short. Um,
oh, that's just filtering out ones that
don't have work distance. 32 64 maybe
that many more. and makes the magic
crack
visual threshold bad.
This isn't repeatable. Well, now it is.
My residual threshold was just bad.
See if it still messes up. It's still
messing up.
Wow. Okay, it's messing up even worse
now.
That's pretty good.
Look, it's saying that it's moving like
this is total garbage.
Don't ask questions about like, oh, how
can I learn to code or what should I use
to code? They're stupid fucking
questions.
All right. Well, this is great.
Are these like correct or did I mess up?
Like seriously.
Oh my god. Oh my god. All right.
This is it.
Oh, zip object. Fuck you, Python 3.
Okay, those are pretty correct.
Um, do I think your terminal ships
matter? Not really.
Okay, this just giving me a different
answer every time.
I swear this used to be better.
My residual threshold isn't good.
It's just accepting all.
Well, now it's repeatably wrong, which
is kind of more interesting.
But it's it's amazing actually how
different these numbers are every time.
fundamental tort model.paramps.
What if I just didn't put in a pose?
I just let the optimizer do it.
Okay, well that doesn't work.
Um,
sour.
Wait, what? Oh, no. Two cups.
Does that work?
That works.
So, what's taking so long is my stupid
essential matrix filter. Um,
it's not even very good. It's slow.
Yeah. So this just is like this is the
try anything for the optimizer.
Try anything for the first one approach.
Um
works.
I don't know how it's moving that one.
Shouldn't be allowed to.
I don't know how it moved that,
but yeah. Wow. So, it turns out that
that's doing less than nothing.
I mean, that's concerning on one level.
Yeah, they do this center normalized
point shit, too, which I'm not sure how
I feel about.
Okay. Um
I mean
Well, no. Okay. So, you guys see the
problem with the with the uh initial
estimate, right? We don't really have a
good initial estimate.
After
that, it's good. This actually used to
be okay before I even did pose
optimization
and before I even did the kinematic
model.
Huh, that's interesting. It doesn't even
matter where I put them.
And it's fast.
This is relying heavily on the velocity
model at No, wait. I disabled the
velocity model.
Okay. I mean, this says something about
like whether this shit works or not,
which is like not really. Let's tell it
to move that way.
Look at that. It like kind of fixes
them.
First off, how amazing is that speed?
So let me optimize it with both equals
true.
Seems like it would benefit from more
iterations.
So, okay, you can literally put anything
in for the initial estimate of pose. You
can put in total garbage and it gives
you something
except that one. The one over there.
All right. Now, let's put pose
optimization back on.
It's even higher quality.
Sometimes it does that
mods.
That looks good once we put in pose
optimization.
It is concerning to me that that just
doesn't work.
Um,
let's just do this
fundamental matrix.
The hell is that?
It's the Samson distance here. That's
the actual interesting thing.
Basically, I don't want to do this
center and normalize point shit.
Residuals
It calls the same setup constraint
matrix.
I don't actually give a shit. I want
someone here to talk to, so I'm not
talking to myself.
Well, okay. Okay. It's amazing that
fundamental matrices don't seem to work
at all. Really?
No. But I swear it used to. I swear it
used to. What changed?
No pose optimization.
No optimization at all.
I swear this used to work.
It's moving that way.
Is that what it looks like?
Why is the fundamental matrix doing
this?
So that's with only fundamental
matrices.
Maybe it used to only work on like Ohio
and shit. This is what we initially had.
No, it doesn't work on Ohio either.
Well, kind of.
Okay. All right. Let's just uh
implement this class.
Let's try with our own variant.
Can't initialize it with stupid matrix.
self
gramals.
I
call
Setup constraint matrix.
Those starts are pretty nice, too.
We'll just say this.
Why do I have to do that? Oh, okay. All
right. So that gets the matrix.
So there's actually a second constraint
I can enforce because this is an
essential matrix. So basically this
it's kind of poorly written.
[Music]
Okay.
And now we also need the residual
function.
desk matrix is not defined.
Interesting.
center and normalize points. What does
this do?
Okay, so I don't need matrix. We can
just say like best.
No, I can't
center normalize points.
Oh, I just don't even need that.
That's better. Like at least now it's
ping ponging between two reasonable
solutions.
You see? Oh, that's actually pretty good
now. So, okay, this problem, this is a
known problem.
Um,
we don't know which is the correct
Yeah. Okay. You can't know whether
you're going like this or like this from
a fundamental matrix,
but that's much better at least.
Yeah, I kind of think their like
subtractor thing doesn't work. Um,
also let's move this to helpers.
And let's make the assumption that it's
always moving forward.
No, no, no, no, no.
Well, the norm is always one, but what
do we really want to know?
I don't know if it's a reverse
empty sum.
Yeah,
sum's pretty good. Well, how about you
know what? We can even do better. If t
sub 2 is less than
greater than zero, sub 2=us one. Right?
And so it's all about this way.
Okay. I mean, it's backwards, but
cool. So, it's doing that only with
fundamental matrices. Now, that looks
much better. I don't know what the bug
was with the other one.
All right. So, that's without an
optimizer.
So that's pretty good. How is my Is it
filtering a lot? That's good.
We are doing a thousand trials, which is
a lot.
Does it look just as good with 100?
It looks a lot faster with 100.
It's not bad.
All right. So now we have a working
essential matrix again.
Oh, we actually don't know if that's
Let's uh let's try it on the rotation
one and see if my rotations are reversed
because that might actually be the
inverse.
No, it looks good.
Cool.
So,
you see what it's doing?
Um the essential matrix always has to
have a magnitude of translation of one.
Ah so technically this should be like an
SE something quad.
[Music]
Interesting.
Okay. Well,
those tabs.
Those are tabs.
What?
That wasn't my problem. My problem was
whether they were That's better. No, no,
no. Those are No.
They're gone. Well, that was close. All
right. All right, let's not commit the
stuff that disables all the
optimization.
I don't know why it goes crazy like
that. That's a different problem. Do I
have Oh, or
All right. I don't know why I'm running
into hashing issues.
It's still rotating.
Stupid velocity model.
Yeah, we're not here to talk about
self-driving cars. Like, wh why why do
you think we are?
That's interesting. That test is
failing. Sorry, I said I'd be profiling
today. We haven't done any profile.
We've just done improvements.
No. Yes. Cool.
All right. That's actually looking
pretty good. There's little bumps there.
Like that's not good. That shouldn't
happen. All right. That's enough.
Put
my own central matrix.
Let's just say a custom. I'm not going
to call it my own. I did I did copy it
from scit
note about that.
$500 million, guys. What the hell do I
do with $500 million? You can't deploy
capital like that. That's the real scam
of those ICOs. You know, they don't
realize like capital is not always a a
boon.
be a burden, right? How are you going to
deploy 200 million? How how are you
going to deploy $4 billion to improve
EOS? You know, like you can't even scam
with that. Should we do live streaming
crypto scams one of these days? Sometime
I scam crypto. There's so many great
scams in crypto.
We'll do some blockchain
blockchains.
Um, okay. So, it turns out this
optimizer is so powerful that even no
matter how crappy the rest of my slam
is, it kind of works.
So, I mean, that's kind of good, but
kind of bad because it's masking other
bugs.
Okay. So if I start off, let's get rid
of my kinematic model because that's
breaking things
like this breaking our pie.
No,
but okay. Okay. So, you see like when
the essential matrix runs like it goes
like that.
Am I pose optimizing? Okay. Why isn't
the pose optimizer fixing that? That's
what I don't understand.
So, this is almost pure rotation.
So, I'm not really sure what they
expect, but also like it shouldn't be
doing that.
Wow.
Okay. So, first off, all these points
are total garbage
because it's pure translation.
I hate that the optimizer does that. Was
my local frame window that small or
something?
Look at that crappy one.
Watch what happens when I put in the
ground truth.
Oh well.
What?
Oh, the scaling is just stupid.
Um, you know what? I have a good way to
actually scale that ground truth.
Instead of adding scale perm, we'll
multiply it by
pose of one.
Let's do 20 for now.
See, look. Look at it's becoming crappy
cuz I left in some optimizer.
Did it get crappy? It's doing the same
thing.
Are there bugs?
We don't rap about blockchain. Okay,
guys. Being nerdy is not cool. Don't be
a nerd. All right? I don't know who told
you it was. They lied to you. All right?
They lie to you about a lot of shit.
Don't be a nerd. It's not cool.
Okay. Well, the optimizer is not uh
and that's all garbage.
Should it really be such garbage? I
mean, I don't know.
These are the ground truth poses.
It's very concerning how when I run the
optimizer, it changes things.
Well,
oh, we're going to be back to that
shitty bug. Ready for this shitty bug?
If you set set fixed equal to true on
all the frames, it just crashes. Watch.
Yeah. Highest quality.
So, I mean, that's a hack you can do.
What?
Yeah. And now it's like doing that. Huh?
Like I told it to fix all the frames and
I think it's just massively moving the
points.
Or no, it's just lying to me and moving
the frames.
Set fixed. Oh, not equal to zero.
That looks good. What's the error?
Let's run the verbose optimizer.
Okay, there's some bugs here cuz I don't
understand like why there's any error.
This is ground truth poses. They should
have extremely low error and any points
that do have error should be reported to
the police immediately for repointing.
No, no, don't rap about nerdy shit.
Being a nerd is not cool. At the risk of
quoting Sam Bidd, bring back bullying.
Sam Bill.
Yeah, that guy exists.
All right. So, I don't understand with
Let's Let's work out why with ground
truth poses
we're getting uh Call the You guys are
going to swap me, man.
Does that work in San Francisco? I would
hope that if there's any city that's
smart enough.
Okay. So, where are all these errors
coming from? That that's a great
question, don't you think?
Because the the
like these are the ground truth poses.
Spit four bars real quick.
Whoa.
I drive big sick whips,
bra.
You see that? You ride ball with
bra. Oh, and then like
ah,
ride up real quick,
huh?
You ain't gonna do shit.
Nah,
you like my bars.
Braha.
Nah. There you go. That's some rhymes.
Hey, my error is really high. Look, look
how high the error is, bro. Error is
more high than me. Look at that shit.
Terrible.
Terrible.
All right. Um, well, so why is this
slow? First of all, that's that's
another that's another bullshit. Um,
pose optimizer is off.
Let's turn optimizer off.
I don't think there's bugs anymore with
my ground truth loader. All right,
let's disable search by projection. So
that's what's slow.
That's what you get if you don't search
by projection. You just get a lot of
bullshit points. All right. Goes that
way. Comes back that way. Don't you wish
it was this fast? IRL.
We can make search by projection a lot
faster.
Not changing the world. I'm not doing
shit.
Doing things is overrated. Kids, stay
home. Smoke weed.
Everyone always wants you to do
something. Everyone always wants you to
make something of yourself. Well, don't
do that shit. That's dumb.
Guys
buowski
just way to live life.
Yeah, that looks pretty good.
Except that the points are all garbage.
I mean, like there's outliers, but I
don't even I don't really understand
like all that noise.
Do I have other bugs? I have to.
Oh, okay. So, it actually looks like
that. It's not pure rotation.
That's a lot closer to pure rotation.
Wait, that's not right.
Is that right? We just have a bad angle
on it.
That's right.
I guess that's right. I just had a bad
angle on it.
Cool.
So, this is the ground truth, guys. We
had a better debugger. Yeah.
Yeah. Yeah. Oh, dude. Dude, dude, that's
a line, man. Is that a line from a
movie? We're not here to save the
fucking manatees, bros. We're here to
get rich and get the fuck out. I like
that line,
[Laughter]
dude. Like, I could see that line in a
heist movie. I would watch that.
Oh, wait. It's actually a movie. Oh,
cool. I'm gonna watch that.
Okay. Now we added back in search by
projection.
Every point should be a search by
projection point.
This is so low quality.
You know what?
Here
also every time. Maybe it's better now.
Look at how the points are like
wiggling.
And look, the errors are crazy high
still.
Okay, that that's that's the great
mystery that needs to be solved. Why are
the errors high?
You can move all the points, right?
Fix points is false.
No, it's not running.
No, I don't see boiler room.
Why? Why is the error so high?
Okay. G2O print errors.
Like it works. just has high error which
which like the pruner should be pruning
these things
go like crazy. What if I do that?
Okay. Well, that's second false. That's
even better.
Well, that definitely works. Look, the
air is dang tiny.
We're much more aggressively pruning
things now. But actually, it's possible
the error is staying tiny because I'm
actually just deleting all the old
points,
which actually is probably more likely
These errors are in like pixel space
though. Should
like the reprojection error is really
low.
Why is there so much error here?
Okay.
You know, we're not getting any more
copyright strikes. You know, I always
log in and my videos are always
demonetized.
Demonetized. You think if we watch
PewDiePie, he'll copyright strike us?
Yeah, maybe.
Um,
okay.
So, this this amount of error just
doesn't really make sense, right? Look
at all that error. It's terrible.
Set vertex
vertex F. ID
You know what we can do though? This is
more exciting.
Change this to graph frame subf.
Okay. Error still getting large.
I don't understand what this set
marginalized means. Like Orbslam's
errors are never this high. Oh, it's
Twitch slam. Look at that.
Is Twitchlam famous.
Ah, 68 stars. Not bad, bros.
Um,
we'll watch the boiler room. It's all
right. I don't care.
For one reason, become filthy rich.
That's it. We're not here to make
friends. We're not saving the fucking
manatees here, guys. You want vacation
time? Go teach third grade public
school.
I got to watch this movie. All right.
So, I got something to do today. That's
what I'm doing. I'm watching that movie.
That's what I'm doing after uh after
after bullshit. Um
set robust kernel set vertex
point ID. Yeah, that's fine.
Add edge. We add the point and we add
the edge. Fixed false marginalized.
True. Set information.
Oh, this is actually a much cuter
encoding.
They don't have a stupid point ID
offset. Oh, that's there. This was
written by smart people.
wall.
See what they did.
And it shouldn't matter anywhere because
I don't use vertex, right?
Yeah, that's nice.
I mean, it's not going to fix the error
thing at all, but it's a much cute.
Do you guys see what that did, though?
69 stars. That's right. I mean, we're
not even up to as many stars I can get
in a Mario 64 game in like
two and a half hours, bro.
Yeah, I think I think I could get a 4
hour 120. I could be a live streamer.
Okay, error still high. Error should be
loud.
Well, okay. So, this is an interesting
question. What is cam baseline?
Let's set it to 10.
Did nothing. What
if I do like plus 100 here? What do I
get
fault?
Don't do plus 100 there, bros. You get
seagg
plus 20 over there. Do I get seag fault?
You get seagult.
So much sag fault.
Oh, they're using a different solver for
me. That's interesting.
Let's try that. Then we won't get troll
mod error anymore because I'm not using
troll mod.
Okay, this still has crazy high error,
but it does seem like it might crash
less. Maybe
that looks visually very good. Why does
it have high error?
Should we make a new robust kernel for
every one?
Does that matter?
No, change nothing.
Um
Get rid of the NP. What do I got?
Crap. Ends fall.
Even with my new favorite optimizer,
CPAR C3.
Oh, that one went away.
Okay, errors still really high. Look at
that. Look at those errors. Try twos are
errors, right?
Okay. It's like four points of thing per
error. It's not.
Um, hang on. Let me check my phone,
bros.
Where is my phone?
Oh, here it is.
Uninteresting bullshit. Okay. Um,
public SC3 quat
Oh, it's an SC3 quad. Oh, unit image
projection. Is that
Oh, zero. Maybe. Do we want zero? Maybe
we want zero. Oh,
the error is still high. But I think we
do want zero. I don't think that does
anything.
But
look at the air. So high.
All right. So, let's let it optimize the
poses again.
See what we get.
We get segmentation fault 11.
Let's see. I know why we're getting 11.
Oh my god. Apple. I don't care.
It doesn't move them that much. But
okay, the error doesn't explode anymore.
That whatever that's fixing is the
solution.
like that looks like crap
when I run the optimizer and let it
optimize the poses.
So, we kind of see the bug.
So, what's nice, this is very nice
visual debug.
[Applause]
Okay,
so it seems maybe like my K's are wrong.
525 320 240
seems right. So this it is it is 525
right? My f is not along right. And
let's try that.
That looks more wrong.
way more wrong.
Okay, so 525 is probably pretty close to
Fryberg.
My god. All I get is Twitch slam shit.
Okay, that's the same matrix
effectively.
0.1 pixels doesn't matter.
It's not a K problem,
but yet when I let the optimizer move
the frames,
I get crap. Yeah, I've heard rumors that
Fryberg's a real place. I don't know if
I believe them.
See, look. Look at that shit.
It shouldn't have to do that.
Does keep the error lower, but like it's
not right. Clearly,
I don't know.
Okay. When I don't let it move the
frames, the error certainly gets large.
So, there's a bug somewhere.
SBA set cam matrix 3D double baseline
derivatives the rotation matrix with
respect to Jacobians
don't even know about that
well so that's interesting
do I need to do
wants a quitter on there.
This is the only thing I'm thinking
could be wrong.
How do I set the pose when I put it
back?
rotation matrix um
turn.
Well,
There's the rotation. Let's see if
that's
all close pose.
Okay.
Even do better than this. I think we can
do we can put these here
and
say estimate
[Music]
We're going to do graph frames dot
doc.
Close. Correct.
Correct.
I mean, okay, it's possible I'm like
doing something wrong. It's possible
like
you want to like apply the matrix
onto the translation or something.
The only thing I'm thinking is that my
pose estimate is wrong.
So what if I say
pose equals empty dot?
Okay, that's wrong.
Looks cool though, right?
And she has about the same error, which
is weird.
The only thing I'm thinking is if
they're representing pose like
differently from me somehow.
Well,
let's just get rid of that. You don't
actually need to do that while we're
doing these tests.
Still crazy high error.
Higher error.
So it wants the linal genen.
What are the losses on the rotation?
Now, don't worry. They're illegal for
the good of the people.
Like
that just makes it seem wrong.
Makes it seem like I have like
my pose wrong
for those points.
Um
there's like a question of which you
apply first
unapply the rotation. Sure.
No.
See, like that doesn't matter for this,
which means it could be wrong.
That high error
better is lower.
Okay, let's focus on why the error is
increasing.
Okay. So that direction all the points
are positive.
All right. Well, you know, let's just
read G2L. It's open source, right?
What's the interesting one? P2MC edge
edge project P2MC
in my G2L
types.
I don't know what P2MC even means.
Vertex cam
Why am I not using vertex cam?
Why am I using SBA cam?
Point to camera projection moninocular.
P2S.
I don't know any of that.
Hack my computer, bro.
What?
See? Okay. The only thing that could be
wrong is the ordering of rotation and
translation. And I'm not really sure how
this stuff works.
But what if I didn't use SBA cam? What
if instead I used vertex cam? I don't
know what SBA even means.
I'm already using vertex cam. God
spa cam is just the estimate
of the vertex
pose.
ation pose.
I mean, see, like that's the thing,
right?
What does position mean?
Let's think of how that matrix is going
to apply.
The error should not be this high.
I mean okay wait we are increasing the
number of edges
Oh, that looks beautiful. Look at how
beautiful that looks. Right. I want that
dense slam.
Um, we'll get there. We'll get there.
All right. First, I'm out of Red Bull.
I'm back in five minutes. Got coffee.
All
right, we got coffee
labeled coffee.
blah blah blah blah blah blah blah.
Now like this is a different problem.
Orblam's using the optimizer in a
different way. It doesn't make that much
sense.
Pose.org orientation posed out position.
So an example
pose here means transform points from
world coordinates
to camera coordinates.
Okay. Okay. I mean, that's Yeah, that's
like what I'm doing. It's fine.
It's not that.
Can I break down like where the errors
are?
What is this set marginalized do?
If I take it out, it like crashes.
Crash just all these errors.
They are creating a new robust kernel
for each one
and they're using a different edge
project.
Let's try that one.
Bad type ID.
Pick outliers randomly. Okay.
Bad type ID.
Why is that happening?
Okay. Okay. Well, they're using troll
mod.
Not bad.
Add bad type ID.
Oh, they had the camera as a global
thing.
Oh, I like this. Okay, this is kind of
nice.
Shorter.
That adds the camera up here.
And I like that because we'll be able to
add optimization better.
See three.
So here we go.
Focal length.
That.
Oh, I think this actually might let us
optimize the camera, too. Oh, that's
exciting.
Who's excited about that? I know I am.
Red Bull is highly addictive, bro. Red
Bull, not even once.
Let's just create the robust kernel a
shit ton of times
only because they do it in the example.
How much dumb shit is done? Because it's
done in examples.
One too many parentheses
local variable f reference before
assignment. Uh
that's true.
name optimizer was not.
Okay, we still have bad type ID. Well,
except parameter ID. Oh, because we're
not setting parameter ID, which means
that's for the camera. So, that tells
you how to use the camera.
Oh, segmentation vault 11. Oh, that's my
favorite segmentation vault. I love it.
It's so informative when it does that.
Oh, it tells me so much about what went
wrong. Oh, love it. All right. Um,
is the problem in the putting back?
Must be a real number, not non type.
The error goes from large to not as
large. I know that
there are problems in the putting back.
That just throws all the points away.
because they have bugs.
Okay.
Do I not want to Maybe I don't want to
end it.
That's interesting.
There's still errors, but they're I
think they're lower.
Oh, they're much lower. Yeah.
What do you think, guys? Does that look
better or worse? I switched to the other
optimizer.
The other optimizer doesn't take poses
and inverse.
For that reason alone, I kind of like
it, right?
Name pose is not defined. All right.
Avoids an inverse. Do we do an inverse
when we do projection?
No, we don't.
Okay, they're still high errors, but
they're
There's an average of three error per
hch.
Does that seem reasonable?
This optimizer seems slower.
Okay. Well, we had the other one
working, too. I don't know. I don't know
which one's better.
Sigh to UV. I don't know what that
means.
I don't know.
Do we want the
old one or do we want this one? Probably
this. Probably the old one. That one
looks newer.
Let me set each camera separately.
The errors aren't noticeably higher.
They're the same.
They're like exactly the same.
Oh my god. Why? Why are they so high? I
I don't understand that.
Doesn't hurt. Doesn't do anything.
That should be throwing out all things
that have point that error above two.
All right, let's just make it a
parameter.
We should have deleted all that code. So
no. Okay.
Um
Just make it work for both. Not that
bad.
points are the
Yeah. So, this is just so we can use
either one. I'm not sure which is better
yet.
Same error we had 10 minutes ago, guys.
Wow, look at that. So fun. All right,
cool. So, this is the alternative
optimizer.
Um, let's actually let it optimize
frames.
It actually looks literally identical to
the other one. Except maybe slower.
That's just slow because we're doing the
thing every time. Why am I getting those
bumps?
Why does that look like crap?
The errors are not that high.
They're staying at like 13,000.
They're growing slightly. Still, there's
less errors than edges
when I let it optimize frames.
When I don't let it optimize frames,
let's see if this happens also with the
other optimizer. Let's first see if I
didn't break the other optimizer.
H. It does seem crappier, don't you
think?
But yet, I think it's actually getting
lower errors.
Look at these bumps.
Like, that's not really in the data set
as far as I know.
Do we just have some garbage points? But
like I think my outlier rejection should
get that.
Okay, that one does seem vaguely better.
All right, let's clean this up so we can
actually commit this.
So we run the optimizer sometimes.
Let's run it without that. See what we
get.
key error.
Uh, okay. I broke that.
How did I write that?
Well,
ah, because it adds all the frames.
That's interesting.
Oops.
So, we only add the edge if the frame is
actually in the graph.
Now, we're doing pose opt again.
It's a nice looking map.
[Music]
optimizer.
So now we are both optimizers.
Oh, and I disabled the kinematic.
Oh well, it was shitty. Anyway,
like look at how shitty that looks.
That can't be what it really is.
Why does it always like jerk it forward
like that?
Changing the world's a scam. Don't do
it.
If you're thinking about it, you should
reconsider what you're doing with your
life and realize that it's a lot easier
to change yourself than it is to change
the world.
Garbage.
Oh, this is also with the higher pruning
threshold. So, change that to two,
I
look at that. She jumped. fix that. But
still
Why does it jump back? Maybe if we can
answer that question.
Well, that actually is backwards, but
yeah, look, it like jumps back.
Am I like keeping some state around
accidentally or something?
No. Process frame gets called again.
It's called with the map.
There's one map. Optimize actually
changes it.
Oh no. You want to spying on people,
guys. You been spying on all shit. I
don't know what to call that shit.
You guys know what I saw?
Google does by exploits. Absolutely.
Okay. So, it seems like after the
optimizer runs, it gives me a crappy
pose,
which is weird.
You wouldn't think that.
The new the new pose after the optimizer
runs is crappy.
It's almost like it's like doesn't want
to move the current pose or something.
You guys see what's going on?
like it globally optimizes and then it
just like shoves the frame back there.
You see
it just jumps.
Big jump on that one.
Like it's not even pose optimizing it.
And this is without a local window, too.
So, we'll actually move all of them.
The optimizer decides that's the best.
See, it just jumps back there. And then
there's, look at that gap.
Why is that happening?
Yeah.
It moves them and then it just jumps
right back.
Well, 50 is not helping anybody. Um
We do only paint the map after we
display it.
Sometime we don't run that optimizer.
The kinematic model is disabled right
now.
And F2.pose will actually change
definitely. Right.
I don't do that.
Look, it's still doing it.
It's like jumping back. Look at the
jumps.
That's without any pose optimization.
That's just using fundamental matrices.
F2.pose
Yeah, that right there.
H.
Oh no shit.
Okay, it runs the optimizer.
That should be
hu.
Am I printing the inverse of the post?
Yeah, I'm printing the inverse. Okay,
that's fine.
That's the inverse. So, that's the
transform from
There. There. There. There. I went
backwards.
There. It's backwards. Why did it do
that?
That's what I don't understand.
There.
You guys see it? Look.
Goes forwards and then it goes
backwards.
It's not really backwards. Just like
down.
Why did that happen? Look at that. You
can see it better from this angle.
Look, look, look, look, look, look,
look. It's down.
Yeah. Right there. Right there. That's
supposed to be after pose optimization.
I don't do pose optimization. One of the
was one of the RT matrices weird.
No,
that look at that bad frame went there.
That's wrong.
It didn't do it that time. It did the
down there.
Okay.
So, putting in the ground truths.
And it's jumping down. Does it do if I
don't put in the ground truths.
Just move them all gently down.
Move them sideways
down.
What if I don't optimize? Still do that?
But you know, because if I don't
optimize, nothing can move.
But it wants to move that one down.
Why are those points such garbage?
I see your shit, but when you talk about
self-driving cars and comma, I don't
respond.
Did it again. It moves it down.
Why does it think it's more down than it
is?
I mean, okay, it does vaguely look to me
like it actually did move down.
Look at that.
Do both optimizers do it?
This one does it even more.
Look at that.
So that's the first frame right after we
did a global bundle adjustment.
Go back to set. You don't see the
problem with set.
I don't want to try another video. Like
that didn't move down.
That doesn't make sense.
That matrix said it didn't move down.
This matrix said it didn't move down.
How did it move down?
And my output here is that's down. No,
no, that's the wrong axis. Yeah, look,
my output here is 62.
That doesn't make sense because it
didn't run the optimizer.
And the last pose was this. Okay,
something weird's going on here. You
guys see what's up?
Notice how this one is 004.
Then we dot it with 0.05, which is what
should give me the pose here.
Wait, minus 48. Hang on, let me think
about my coordinate frame.
So, yeah. Wait, how did that get minus
48?
How did that get 62?
That's the bigger question,
right?
Because this and this does not 62 make.
How's that at all different from that?
It didn't even run another optimizer.
There's no pose optimizer, right?
Oh, we have ground truth for the pose.
Oh, okay. I see what's going on. It's
using the ground truth. The op Okay,
sorry. I'm being dumb. The optimizer is
moving it away from the ground truth
and then the ground truth comes back and
it's like, oh, it's actually there,
right? I'm not using like the
differences from the ground truth. I'm
using the ground truth itself.
Okay. Well, that explains the mystery at
least.
J electricity PBS mysteries. Remember
that line? That was pretty sick. All
right, so now we're just left with the
question of why the optimizer makes the
frames go there.
I mean, that's a much more uh benal
question
that seems less like a bug and more like
bullshit.
By bullshit, I mean, you know, just
things that we can't really fix.
See, that looks better. But now the
points look crappier.
All these crappy points. But these can't
have good
These can't have good losses.
Maybe we should do this
pruning forms that have too much
parallax.
Like these ones that are like zero and
one like Okay. Okay. Well, I think that
is their depth, but
we just probably can't tell too much
about them.
Okay, now we're going to pause after we
ran the optimizer. So, this is what the
optimizer outputs. Yeah, like these guys
should be pruned. Look at that point.
Why is that point there? That should be
pruned.
Called 20 points. We should call way
more points than that.
That only left in crap.
Okay, we deleted if the error is large.
That's good. So is the problem like
these others um p errors
p errors.append Append prod two.
This has something to do with depth.
Is that better?
Yeah, that got rid of some of the really
crappy ones. Notice how some of the
points like didn't move.
Those ones didn't move and they're
garbage.
I don't know why the pruner didn't get
those. Look at those garbage.
Okay, I'm just I'm just doing the pro.
This is straight up normal projection.
Uh
so after we put the frame pose back. So
that's right.
All the ones that don't move are just
garbage.
Well, the thing about them, okay, they
might only exist in two frames
and somehow like the two frames have
their match somewhere reasonable.
They will go away eventually maybe.
Okay, it does remove them eventually
because they're not seen in multiple
frames. So those are just outliers in in
optimization.
These are the estimated depths of the
points.
Some of them are really huge. Maybe we
should filter those out.
Or
s sub 2 is greater than let's say a
th00and can't be more than a thousand
away.
Well,
that's not really right.
We can do it for now, but
it's not helping with anything.
Okay, we more aggressively prune on
reprojection.
These points are all still garbage. Look
at them. All that garbage
trash
and ferry, bro.
How's that trash point staying around?
All right, let's get more aggressive.
It does look like most of the trash
vanishes.
trash just shows up.
Look at all that. Well, but there's not
much parallax there as a problem.
Um, so that's an actual filter we can do
better.
All these new points that aren't found
they're not found with search by
projection.
Should I be more lenient on my search by
projections? Where are my search by
projections?
64.
That looks better.
Yeah. More leniency on the search by
projections.
Still getting all of that crap though.
But that can be done by search by
projection. Really?
It's like speckle. All speckle.
Those points get found with search by
projection. They shouldn't be used
anywhere. if they shouldn't be added to
the map ever.
Well, it's not really true.
Yeah, consider the tradeoff. We truly do
that after search by projection
because the problem is it finds these
matches
that get rid of the speckle.
We didn't do any profiling.
I'm sorry.
Look at all the fucking speckle, man.
All this shit.
Garbage. Look at all the garbage that
showed up. Garbage, man.
Bron Zoo quality.
I can hear the Bronx Zoo is pretty nice.
Is that true? I don't know.
this speckle.
It's staying in the map somehow.
I mean, I guess it just finds it in all
the frames and like that's okay.
[Music]
Speckle. Look at it. It's terrible.
We pruned some of it, but
well, it's better when I let the
add new observations if the point is
already observed in the previous frame.
Okay, that's fine.
filters are not aggressive enough.
The filter I'm thinking of this one.
I do this and make that.
That's a less aggressive filter. Oops.
Do that.
No points anymore.
I think those are the checks that Orb
Slam's doing that are pretty good that I
don't have right now.
Okay, this is also wrong. I shouldn't do
this.
Um, this is garbage. I don't want to say
if any descriptors. I want to find the
best one. Um,
bestest equals none.
Best or equals none. Okay. Tast or
test=
desk or equals oh.
Wait, what?
Oh, no. That's just Oh, that's fine.
Never mind.
H.
So like the problem with this is this
can actually add multiple observations
of the same point as far as I can tell,
right? Well, not not at the same point,
but
because that break is just breaking orb.
Oh, that's a bug.
Yeah. So, see the problem?
So first we can just say BEST equals
mining
distance for O and T.
So effectively that's the same as that.
But the problem is that we can actually
match it with multiple things.
My dxp adds an observation. Ah, all
right. Well, that's at least going to
fix it to what it was before cuz that's
a bug.
That might have been why shit was
crashing, too.
We should add a check for that.
I mean, okay. So, effectively what this
is
is
okay. The the bug
was that multiple points were being
observed multiple times in the same
frame.
Um there's a chance now that this is
just going to work because I think that
was what the bug was. Like the the
structure of the graph was weird. It's
still cycle. Never mind. I don't know.
Maybe I don't know why that happens, but
we can at least add a check for that.
Check
each point
observe
max once in the frame
for key in map points.
Um
basically assert.
That's all right. Right.
Oh, my assertion fails. That's
interesting.
Object
of type map has no L. Yeah. Yeah. Yeah.
Yeah. I know. Yeah. Mhm.
Is it working now?
Oh no. Look.
Yeah, it's being added multiple times to
the same frame. Oh god.
Okay. So, there's a question of how
that's happening.
No, we got to assert that it's equal.
A point can't be observed multiple times
in a frame.
So, is the problem in search by
projection? Let's comment it out and
find out.
Yes, it is. So, this still has the same
bug. See?
Okay. So,
we don't actually need that check, but
we can add it to the bottom, too.
Yeah.
Okay.
So
for the points
for each point.
Yeah. Okay. You see it can just be added
multiple times.
That should fix that though. If f points
mid dx is none.
All right. But my search by projection
has bug.
Who can find bug and win $1?
$1. Find a bug. Win $1. If I had Venmo,
I'd Venmo you, but I don't because it's
a Facebook product or something. So, uh,
you guys have a Facebook for that shit.
I don't Facebook.
Yeah, the errors are kind of
This is interesting.
Okay, so this is what happens when you
don't do search by projection.
You don't really need it.
It's just bugged.
Now, I have an Instagram, bro. I got I'm
on Insta. I DM I DM Instagram models.
That's what you do on Instagram. I
invite them to my palace in Dubai. Tag a
sponsor.
Uh all right. So this is what happens
when we don't do search by projection.
We want search by projection though. We
just don't want broken search by
projection. So let's see what's broken
about it. Okay. So first
project
all the map points into
a current
frame.
So that's not really right, but
whatever.
only the points that
fit in the frame.
That's good.
Don't post on my Insta, bros. You don't
follow my secret Insta.
Psych. I don't have a secret Insta.
Think I got time for that shit? I don't.
Sorry.
Okay, KD query ball points. So for each
one we get all the points nearby in the
frame.
If the point is unmatched then we add
the observation.
That'll break out of that. I don't get
it. That should actually be okay.
frame point subidx equals self. So it
actually shouldn't be able to add the
observation twice. I don't get it.
Five is also aggressive.
Two.
That doesn't do it anymore. It just
takes longer. Good. Well, if you're
going to see it, I probably make it
happen fast. We can change that to two
later.
Assert length of set ids. Okay.
So
the indexes
we should only do that if it's
unmatched.
Well,
H. So, it's not that.
Should we listen to music? you can
listen to the music. Um,
now so we're adding the observation to
f1 multiple times. That's what's
happening. So for a given point,
but if we have the observation, it
should break
should break out of that loop. And we
only iterate over the points once.
Get better.
I want to say is p.orb distance pals
p.org distance. It's refactored us to
that.
Okay, it's clearly not going to fix
that. Um,
how is that happening?
F1 KD query ballpoints. So that gives us
indices into the frame.
Throw assert is good. You should people
should assert more. Um if unmatched
get the distance.
All right. So the problem is actually
that a point is being added multiple
times to a frame. the same point,
which I really don't understand
because we only run this once.
Proesi
It's just a way of it doesn't matter
what that can return every point. It
shouldn't do anything bad.
Actually
that in an observation
if frame
frame
not
self.
Aha.
Looks good. So now we can remove that
sanity check from there because it's
kind of stupid and slow.
set frame not in self frame. So we are
literally adding
same thing twice.
Well, so that doesn't make that much
sense because I've never seen
that point somehow already has an
observation in that frame
and we could just do an explicit check
for it.
Oh, I mean, yeah, you know,
I guess there
it can be added up there and added down
there. I mean, there's nothing that
stops it.
if
point unmatched
and
this
point doesn't already have a match in
the frame. I mean what I really want to
say is this if
and f1.pointsframes points frames not
okay let's write this more intelligently
I don't really understand why this is
happening n tensfl is not that useful
for shit like this tensorflow is good
for neural networks and that's pretty
much it um I mean you could try to write
bundle adjustment with tensorflow but I
don't think it'll work well
I think I actually have tried if you
check my gists
um Okay.
All right. All right. So, what's the
problem? The point
f1 point submx already has a match in
the frame f1.
Yet, it's just not to midx, it's to some
other point.
So although that point may not have a m
Oh god I don't understand this
self assert
that the point is not matched
and assert that the frame
does not already have a link to this
point.
How could a frame have a link to this
point?
Frame.point subidx if idx is something
else.
So it's okay. I need paper.
Here's a point. Here's a point. It's the
same point.
God, this doesn't make sense.
Just added it multiple times to the
frame somehow.
Man, I don't know why I'm being so dumb
about this. I don't know why this is so
hard to think about.
sub midx is n
if okay we'll just put it up here
if p if f1 in p frames
continue we
already matched
this frame
this frame.
Okay, it fixes that.
Is there a chance that that even fixes
the SE fault? Oh. Oh. Could it fix the
SE fault? Oh. Oh, maybe. Maybe.
Not this.
It's here.
Nope, it does not fix his effort.
Go get some mate. That's kind of what
I'm talking about, right?
We already matched this map point to
this frame. I mean, it's a map point.
Yeah. Right. So of course it can already
be matched to this frame
point
not visible.
So, you have to reopen and then you
close that and you try it again. There
we go.
All right. Now, that's just not letting
it optimize the frame. Let's let it
optimize the frame again.
Oh, okay. It's still a total piece of
shit. Oh, that's great. Oh, look. It's
still jumping back. Oh, I love it. Oh,
thank you. Thank you. I put in all that
effort. I find a bug and it gives me
nothing. Oh, that. Thank you.
All right, guys. Thanks for watching
today's stream. Sorry we didn't get more
accomplished.
Yeah,
down in 10. It's lunchtime.
Had to eat lunch.
understand this better.
It happens up here.
Doesn't happen here. It happens when
it's found in both the new observations.
Did I write two lines? No, it's
lunchtime.
That's junk.
Cinematic model's junk.
Let's just make sure it still kind of
works
pretty good. I don't know why it's
jumping all over the place like that.
We will get to that next time.
Get the commit though. Read factor.
Great descriptive name
to do stream this afternoon. Uh maybe
we'll see. Now I'm going to go I'm go
I'm going to work. I'm going go into
work on the weekend. You know, we got
things to do. We like it when people
come into work on the weekends. All
right, Twitchies.
on this beautiful tuesday morning
i put my phone into charge
where's your phone bros
bought an apple watch
so useless
explain to me what i would really do
with this thing i really don't know
it's dead too even better
well i had a little display of
wearables that i bought that nobody
would ever
use good morning campfick
all right guys so let me tell you why i
haven't been on twitch for a bit
because we've been out of mate
but today
we have green mate
yerba mate enlightened mint
this is the best one
though i used to think that i'm having
it now i took two sips it's kind of
mediocre
you know what i want twitchies
waffles
get me waffles
um no i don't know about any waffles but
all right so
let's uh let's see what music we're
listening to today
and then we'll get to it and we'll get
to working
oh yeah i'll be listening to this song
you know
when every other person here wants every
other to leave
that's right
san francisco
is truly a tribal city you guys
it's home to different factions of
people
who all want different things and all
dislike the other factions we have our
very own set of morlocks
you know the morlocks who read the time
traveler
ty the time machine how was that
that was cool
ah the more locks
all right so let's go
um
what do we want to do
well
let's focus on let's turn the optimizer
off
let the optimizer off but we'll just uh
we'll fix all the vertices and then
let's focus on removing the low quality
points
look at all these low quality points
those shouldn't exist
eventually go away i think i think my
pruner eventually works but like it'll
work a lot better if we could just not
add them
all that crap
all right
so let's read
let's read orb slams filtering
we do we do like this filtering here but
let's see what orb slime has to say
i know warp slim just has like really
fancy ass shape for this here we go
triangulate each map
what's up new gum cruise
i'm actually hanging out with that girl
tonight
um you
know we still hang out
okay
check
parallax between rays
let's figure out what that means
let me see it works on paper
do you guys know
what parallax between rays means
search for matches that fulfill epipolar
constraints so that search for
triangulation so that search by
projection i think
well this isn't search my projection is
points that are already in the map so
this is about adding new points
triangles find the point 25
new map point creation
[Music]
connected keyframes so each unmapped
new map points are created by
triangulating orb from connected
keyframes in the co-visibility graph for
each unmatched orbit ki we search a
match with the other unmatched point in
the other keyframe
and describe those measures that do not
fulfill the epipolar constraints
orb pairs are triangulated to accept the
new points positive depth in both
cameras parallax reprojection error and
scale consistency
are checked
initially a mapping is observed from two
keyframes so that it could be matched in
others okay so
yeah
guys
i like microsoft
i don't have a problem with microsoft
they've never done anything to like
really piss me off
um
i tell you i probably like them better
than like google
um
i don't know i mean i don't really just
like google either
but like
fundamentally microsoft's business model
is much more aligned with my goals than
like google's business model
um like it's unfortunate that like
google and facebook are media companies
talk about this a little on twitter uh
it's unfair it's unfortunate that
they're media companies right because
the media company does not have the same
goals as you
whereas a company like microsoft or
apple i mean they kind of just want to
like
you know they won't like sell your
product right like they want to sell you
a product or service
that's fine that's like the engine of
capitalism that's what makes capitalism
great
um
like really i mean capitalism when it's
based around consent um i mean that is
consent right when i go when i purchase
an iphone x this is a consensual
transaction between me and apple when
when google you know
tracks my cookie around the internet and
then like uses psychology to figure out
what's most likely to get me to click on
an ad
it's not so consensual anymore right
no just wanting money is great guys
don't don't don't get it twisted like
capitalism and wanting money is great
um the problem
is like you know like it's just i mean
you know you could feel oh god
we won't go there we won't go that's too
much but like really what it comes down
to is consent
okay
um
ah yes
model
initial pose estimation
new map point creation
okay we check for positive depth in both
cameras
parallax reprojection error
now if i recall correctly orb slam just
does the triangulation in
yeah it's just doing it in the real
world it's just doing it in like full on
uh
current keyframe
so we we had this for a bit but i didn't
think it worked
all right this trip is
just doing it in the actual pose of the
frame but when i tried this it didn't
work
it had like numerical stability issues
um
what do we know capitalism is always
consent it's like advertising that can
kind of blur the line right i mean what
is advertising but kind of a form of
coercion
um you know you don't want coercion
don't content
oh
okay i think i actually know the reason
it broke
ah this is interesting
okay
i think that it's just because my
0.1 check was bad
so let's let's go back to doing this
and
let me like the checks just in line here
did i break the google chrome sandbox i
don't talk about that
um
okay
does that
triangulate the points we don't have
matches for
so for some reason that i'm still
triangulating them all we don't really
have to do that
well do we
no we don't
okay so they just say equals equals zero
which is ballsy
sorry i'm waiting for uh
i'll try texting you this afternoon i'm
both until okay
i'm talking to a reporter later today
you know we gotta i gotta say nice
things to the reporter
no nobody calls an assembly language
don't be don't be a noob
noobs
a lot of noobs
all right
um
let me just say not equal to zero let me
try that
we certainly don't want to have divided
by zero that's good
i'm not even really sure what that does
um
okay now we're separating triangulation
from the checks
okay now let's do checks down here so we
check that it triangulates in front of
the camera
so basically what we want to do
i believe
like you can really see this well on the
kitty reverse one uh i wanna
and i probably should have gone to the
hospital but i decided
i'm going to refactor this a little bit
is
[Music]
wow
[Music]
so if you dot it with the
inverse of the pose
you project it from the local frame into
the global frame which makes me think
that if you dot it with the
pose
itself like
is that the same thing like i don't know
why they
god look at all this complex shit they
write
why is there all this complex shit um
[Music]
is that so crazy
that that that i don't like why is that
that's just wrong
i'm sick of math bros
okay so it's not like
right rcw row two dot oh so they're
really only computing the z
let's just say compute couldn't care
less
should i do this is this more right
it seems more right
okay
so we have to check that it's in front
of both cameras so you can see like this
point here is behind the camera as well
so let's just think this through and
think whether i'm doing this right so
we're moving forward so we're moving
forward on the z-axis
so we would expect that the points when
moved into local camera frame
are if we're at six and this is zero
no hacking anyone talks about hacking's
banned everything's illegal bros don't
hack
uh
all right so this is a zero and this is
six
so we would expect that if the point is
at 66 in global coordinate frame it's
not like 60 and low corner frame so this
is correct right
um
so i don't know why but that's correct
okay
well so this is a orbs there's a cv2
camera thing that i really like this
just shows you a good way to think about
it
this yeah
so that's our pose matrix and we're
dotting our pose matrix
with the uh okay
so you see look we decipose matrix and
we dot it with that
um so we end up with
so we'll say you know p
l l1
dl2
if pl1 sub 2 is less than 0 or pl2
sub 2 is less than 0
check
points
are
in front of both
cameras
i don't like this equal zero here when
do things equal zero
i'm not sure what that means in a
floating point world
this is not literally identical it
equals zero
okay
it was like somewhat less crap
okay check reprojection error in first
keyframe check reprojection error and
second keyframe okay i don't know why
they wrote this like ridiculously
complex shit
um
i should just be able to take that point
i don't understand i can just take that
point
and i can go like this right
empty dot k
okay here
probably move this out of the main class
bro get out of hacking hacks are losers
there's cool brows math do math that's
cool
very cool so those are the x and y
points
now we can actually test the
reprojection error
i mean
pretty cool
so those are the errors in the
reprojection
if we assume that that's the point so we
can check them
they all look reasonable
oh i don't know what an allowed arrow
should be
greater than one or something
five nine nine one
oh so they're not using mean squared
they're just using
i just mean squared they're just not
taking the square root
[Music]
um
that's cuter
5.991 times sigma square 1.
okay
i don't know
look at this one seven
greater than one
[Music]
what i say about hacking equals bam
wants to be banned
okay i think the last check i need to
write is the parallax check it would be
helpful if i understood what parallax
was
so bitcoin
subtle
there's always some sucker that will buy
and machine learning is not limited by
data it's limited by infrastructure
okay let's let's
check parallax
check reprojection error check scale
consistency
i don't know what that means i don't
think we have that
oh you wouldn't we don't have scale
let's talk about that mlml's kind of
cool
it's not self-driving cars we're really
here to talk about slam though
um
okay
check
parallax between rays let's understand
this
in
fx i don't understand what this stuff is
oh
okay so this is just dotting it with
kn which i think i have already
so we can take
this
i'm going to check that we'll check that
up top um that's in helpers
uh we should just check this for
all of them
cool
do this kind of shit somewhere else too
uh
i don't know if that transpose is really
okay
it probably is yeah it's like a fairly
symmetrical matrix okay
so that's just projecting them into
normal
frame
so let me see what this parallax check
actually means check parallax between
race
okay
well
so that's
xn1 they call it xn1 and xn2 copy their
naming convention i don't really know
what that means but
rwc1
so
it's the rotation of the keyframe
i don't really understand this
no stereo and very low parallax
well first off that's a bug
guys you should be checking for my bugs
okay
so we want to
this is a
rotation based on the pose
so the copy there is exactly and not
really understand what it does it's this
ray
one dot ray two
i don't
i don't understand this
why are they rotating
oh kind of get it
parallax
is large
now
we can use
okay so right one dot right two so
i mean i guess i just call this array
one
i don't exactly understand what array
means
parallax is large enough so
oh they're doing xn1 there oh that's
kind of cute
um
i do that with triangular right
no i don't
what how does this work
oh cause i just don't do it with kpus
okay this is this is stupid
we don't actually need to dot these k
ends because we actually track that
already
so we can just do kps here
by
rotating
into pose frame
i might have that backwards
i have to do sub idx right
yeah
could you update your readme section in
libs cv2 misleads why
i don't think it matters
so called cv2 i don't know if it's
opencv
it's not open cv3
or iphone import cv2 um typography
it's python 3.
still important cv2 right
okay so they're dotting them together
and dividing it by
the norm
so this is apparently whatever parallax
is
it's always one
like this might only be like not close
to one in the presence of crazy rotation
or something
this does seem like the most useless
metric
or i did the math wrong
okay it's like always one
cosine parallax rays is less than
oh
so we don't even have a cosine power
exterior because there is no stereo
the fuck is this shit
b stereo one b stereo 2 and cosine power
x raised is less than 0.9998
if parallax is greater than or equal to
0.99998 continue
let's see what we get
loss of a lot of points but is the crap
gone that's what matters
no we still crap
we should have more crap did i get the
check backwards
no
i don't know what this means
we want to look for high parallax points
i have a definition somewhere
if uh scene is planar or newly planar
and there's low parallax can be
explained with a homography
parallax is checked
okay so basically
yeah points at infinity do not have
um
sufficient parallax now sometimes not
including them on the map and are very
informative rotation of the camera you
know shit okay cool
um
huh
they're parallax now so they did
definitely the other one the other check
i understand like most of the time this
thing doesn't have stereo
cos parallax stereo equals cos parallax
rays plus one
and b stereo zero b stereo two
or more so that's the only check that
matters um i don't know
like
it just looks like it throws a lot of
points away
let's try it out the ground truth and
see if that works
are we we're just throwing a lot of
points away when we do this
oh that looks better oh that looks
significantly better take a look
look at look at how it's not like
you know
that's so much smoother
wait except for the fact that it's so
smooth that it's just flying off the end
okay so actually it becomes under
bullshit because it's totally wrong
so this check is garbage
wait zero vertices to optimize oh
because i'm not finding the frames okay
different problem bros
put that back to 20.
otherwise it gets really slow
okay so now we have we have jerkiness
this is without the parallax check
this is vaguely correct
let's add the power last check back in
i don't know it looks kind of the same
it's the same kind of low quality shit
look at that low quality shit
i think the map might be higher quality
and i think we might be getting less
crap
but are we just getting less crap
because like
we're adding less things
oh i love money guys i love money
money is great money is you should want
money money is what makes the world go
round
love money
love capitalism
money some people don't have money yeah
yeah that's a tragedy man
but i got money i love money
you should love money too that's right
let's see let's look at some money
oh yeah look at this twenty dollars yeah
bros look at that money ha ha ha i love
money
monitor's dirty
don't talk about hacking we're not
talking about hacking bros
i'm talking about slam that's right
and money they're talking about money
that's right twenty dollars yeah
get it
look at all this crap being added to my
mouth look at all that crap i thought
that went over there
oh i hate this check
i don't understand what rays are man
that's array
the other checks are all very reasonable
noise so i use two for my reprojection
army
we should up this to two let's be a
little more reasonable here
how can you have money i don't know
earn it
perform a valuable service for your
fellow member of society
it's not open tv3 this is not
it's
wrong wrong like not having money
have money
the problematic nature
of this twitch
no no no no those belong there no
that's never going to match up those
points ah
my map is ruined
you want to earn money from computer you
can earn money from computer
there's so many opportunity to earn
money
look at that shit look at it
doesn't really do that
when i do this one it doesn't do that
what would i do because it's not up
because it's optimizing but like
um
update normal and depth
we should probably track normals as well
it might be a cool thing to do
what do you think about working no no no
no no no no no
that might give you money but what you
really want
is passive income
just imagine
the problem with working for google or a
big company to have money
is
you have to work
imagine
you found a way
where you could just
get money
you know what i'm saying
like
you don't have to do anything
you just get money
what a deal that would be
all right let's let's change this a
little bit
it's well
uh
i don't know about this
yeah bro work is life but you think you
want to do your work for somebody else
man you got to get equity you got to
work for yourself
you spend your life making the salary
let me tell you something you're never
gonna be rich
you're always gonna be working
you gotta you gotta get some money you
know maybe maybe put that shit in the
stock market bro
figure out how to invest and don't
invest in dumb shit
invest in index funds
that's right if you invest in index
funds
invest in you know what pewdiepie says
invest in property bros
um
if when x dot shape
equals equals one then we just want to
add a one to the end oh come on should i
just write this out right
code
terrible
that's that's still there no i could
just say
learn
what
parallax means
i don't want more viewers i like having
a few of you bros if i have too many
viewers it would turn into lowest common
denominator trash like our education
system
you know sucks index fund's great
oh you don't have money to start the
work well that sounds like a
bootstrapping problem
i don't know how to fix that
that's you have to be born into money
you don't be born into money that's
fucking bullshit man i don't know where
you're from but this is america and
america is greatest land it's a land of
opportunity and there's so much
opportunity you can like pick up a rock
in america and there's opportunity
underneath it probably i don't know man
dig into time series model i don't know
yet
the trick to getting rich is okay step
one find somebody who has money step two
convince them to give you that money but
don't do this in a scummy way don't
don't like be a creep about it you know
what i mean
i mean you could probably talk about the
same two steps to getting laid but you
know like
don't be creep about it man
like don't be like sketchy about like
how you make your money make your money
like an honest way you know
oh yo yo i do love taylor swift that's
right that's right i do love taylor
swift uh i don't know though i don't
think i'd actually really get along with
taylor swift
um
yeah we should commit this is pretty
good this morning
all right we have a local window again
fixed up that we use add ones we do the
triangulation global frame
we have a commented out check for
parallax
cool
change
what's my kind with the lips of selena
gomez i don't know that much about
selena gomez guys
um i just know that that come and get it
not on our song was about
justin bieber being afraid to lose his
virginity
um
what
mac do i have like what's like the most
expensive macbook pro you can buy at the
store not like special order because
that's too much but like go to the store
like give me the highest then macro pro
that you guys sell um because i'm rich
and you should aspire to be rich you
should aspire to make money because let
me tell you something if you're making
money you're contributing in a positive
way to society
and that's what it's all about guys
that's what it's all about
doing services and goods for your fellow
man
doing services and goods for your fellow
man
how much do i like trump we're not gonna
talk about trump guys
no politics stay out of politics bros
politics is the mind killer you know
let me tell you something like every
time people read these like political
articles and like oh my god this is
happening or this is happening i'm like
i don't give a shit man
though i am excited
about uh
about peace with north korea because we
love peace peace is great
um
thank you be friends
i'd like to go see north korea like i
kind of want to be one of those like
i don't know like i have a friend who
went um i kind of like to be one of
those people that goes like maybe right
when it like collapses
yeah it's a bill gates i mean yeah this
is right you know it's a god you know
what i didn't like that bill gates said
though taxing robots that's dumb as fuck
um bill gates calls for robot tax no no
no no that is so dumb
um i don't like taxes
but not a political way you know like
i'm not gonna like campaign about it i'm
just gonna like mildly complain while i
pay my taxes because that's what you do
in america
you know they say that there's two
things in life you can't avoid taxes and
death and i'm okay with paying taxes i
would like to avoid the uh death though
i think maybe maybe if we all work hard
you know we could avoid that good so
this is good that this works um because
it didn't work before when i did it in a
global frame but it was because of the
what do i
police in new jersey they attacked a
woman
i don't know man that sounds like
politics
um
i don't know you have to also ask the
question of where did you hear that from
did you see it in person like if you saw
it in person then yeah i trust you
feeling pretty fucked up but like
time series model is two steps to get
laid
no no no getting laid is like getting
money convince someone
you know you you find someone who has
that and then you you you know you you
uh
convince them in a positive way no
coercion to uh you know
to to to share it with you right now
it's the same thing with money it's all
the same shit bros
what do you think about break bitcoin
code and bear is that a positive impact
on society that's the question you have
to ask yourself it's not just like if
you just like be rich and you're a dick
don't do that be rich and have a
positive impact on society
all right
so
look at how good that looks until like
it doesn't look good anymore
see when you do it from this angle it
doesn't look as good what is all this
shit that shows up all this like speckle
does the rotation one work i feel like
that one doesn't work at all
worked a little bit
if i had to parallax check it it'll work
oh it's kind of better with the parallax
check
well okay so part of the problem too is
we got rid of the kinematic model
we have this or true in here
but then we just get this kind of
behavior which this actually is not the
ground truth for the thing as far as i
can tell
yeah like looking i'll just keep
changing that way so the kinematic model
is crap
oh no no it's always other individuals
there's only individuals bros
all we have is individuals in the world
everybody let me tell you something
you're born an individual you'll die an
individual and whenever people try to
talk about how it's for the common good
like oh oh do it for the the common good
i mean that's just like that's just
their way of saying me
but they're trying to be more like
politically correct about it right
like like you should you should fund
this
project for the people
and then like you look at the person
who's saying that you're like but isn't
that like your project aren't you gonna
like make a lot of money no no no it's
for the people don't do that don't be
one of those people be like yes it's for
me and i will get rich but you will
benefit as well
and then everybody wins right like don't
be one of those like you know what i'm
saying
um do we not so we can talk about elon
musk you know musk is a bro man
we love elon musk
elon musk is doing so much good for
society
elo musk is going to get me into space
man now let me tell you about space look
i love space
but like i don't want to go to space
until it's nice but what's great is
there's all these people in the world
who want to go to space even when it's
not nice and they're going to make space
nice and then i'll go to space when it's
nice
um am i a better program with the law
mosque yeah probably now
okay so the optimizer just messes
everything up there
default 11. great
why does it do that
space have different gravity i've heard
this yeah better watch out for space
gravity
why is this seg faulting what seg faults
i don't understand
are there nands going into the optimizer
oh they're nams going into the optimizer
no nans
so that's egg faulting i don't
understand
okay okay i know i know what quit
unexpectedly i know i know you're sad
about that
i don't even have gdb on this computer i
only have ll db
make space nicer again that's what i'm
talking about man i want to go to like
man the intercontinental space
ritz carlton space mandarin oriental
space
i want to go there right
mandarin oriental space
but don't be poor because if you're poor
they won't let you go to the man or an
oriental space got to be rich
you're this point look it's so far away
look how far away that point is it's so
far away that points practically look at
this point this point's practically in
space
i think about quantum i think it's full
of scammers man
i don't know
i think that p equals b
p equals b q p
no i'm sure someone's going to link me
to the blog post say showing me that
isn't right
oh i know why it's
segfaulting oh that's a stupid reason
it's like faults when it can't move any
frames for some reason
like the problem is when you have almost
purely rotational
movement of a camera
you don't really get uh you don't get
depth information of the points
so you can't make a good map
honey rise of mars that's what i'm
talking about they gotta make a rice
shop on mars first though because i
don't want to grow my own rice that
sounds hard
what's my comment about nasa versus
spacex what do you mean why is it versus
bro anyone who wants to go to space is
cool
nasa can go to space spacex can go to
space you know what's really cool about
space is really big
there's plenty of room and space for
everybody
and maybe we don't have to like be dicks
and like fight over space maybe we could
just be like you could have this space
and i could have this space and damn
there's so much space
i would love to see humanity colonize
all of space
the match is just all of space imagine
there's like space mcdonald's man when
are they gonna build the first
mcdonald's in another galaxy
when i get many simpler videos that
serve as a test case instead of just
watching this one all the time
yeah i mean that's kind of sensible i
should probably do that
i should probably get more test cases
well so a few things i want to do
use the alt optimizer is the alt
optimizer better
it's not better
it's the same shit
we could get many simpler videos i mean
that's okay so that's one direction we
go in this is we talk guys i didn't
smoke today
uh is there some way you could get a dot
product to map i don't know what that is
so
part of the problem
with other videos
well there's other freiburg videos let's
download another freiburg video
um
this one looks cool
wow look at this
efficient online surface correction for
large
wow
that looks pretty nice
so they're using depth info though
okay so those are for testing and
debugging um
floor
desk
desk 2.
room
room that sounds good
let's get room
room
why call she he
no no no no no no no no there's only
gonna be beautiful women on mars that's
what they promised me man have you ever
read any bee comic about space
that's right
no i don't know about that man i think
there's better things to do on mars to
be honest
like eat rice
all right this is downloading you guys
can't see it download because i'm
covering it
what's fr1 and fr2 i don't even know
oh this is a rolling shutter camera
what a scam
this is rolling shutter camera
let's see what like uh
lsd slam
data set
you know what i can actually they talk
about this in the orbs paper don't they
like what data sets they tested on
all right so this is kitty they tested a
lot on kitty
which kitty is this
because some of the kitties are better
than other kitties
they're also doing loop closure
which i'm not writing loop closure
they didn't use room i didn't see them
use room
look at that accuracy though
they use desk
um
all right you know what let's just write
a proper
what now
i did this in one of my previous uh
here we go
oh man you know we should track i think
my apm is kind of low man i should get
my apm up you know
copy and paste this and just we'll stick
it in the parse ground
ground truth timings dot txt
yeah cause that's rgb.txt
this index out of range i need to save
it as tip
now we have room
let's see what room looks like
room
our room looks nice
except why is my slam so crappy
i think it would make like a nice map
looks like shit
i'm getting troll mod failures uh
why is my slam so crappy
these points are crappy
okay that's arguably less crappy
wow
but it's still not it's not crispy
okay
so one of the things that
orb slam is doing did i do the mouse on
tmux i don't think i used the mouse ew
that's gross
one of the things orb slam does that i'm
not doing is orbstein uses keyframes
i am putting every frame into the
optimizer
which i mean you think like more
information is better right
but that might not necessarily be true
that's a pretty nice map
and a bro stack is it a nice map
let's get rid of the ground trees
let's see how crappy it is now
so we're not using that constant
velocity model we're using crappy see
now it's like messed up
oh no we got an infinite jack
hate that infinite jack
yes so the
problem is right now that it always
assumes motion because that's how the
i mean what we could do
is we could re-scale it
so let's say yeah hang on
initial positions for fundamental matrix
if frame id greater than 5
what we can do is we can get the
velocity here and we can say velocity
use
kinematic model for
velocity
um well so velocity right now is like a
crazy like pose-like thing but
that's that's wrong um
that
is now going to print out yeah so you
see that's like a velocity so we can
actually scale it based on that
um
velocity right and now we can say f1
that pose
divided by equals magnitude
no wait do we want to divide the
magnitude or multiply by
minus two
that's a little better right now it
stops all right good it doesn't bug out
as much now
up no
okay well it just goes crazy now because
magnitude goes crazy but it shouldn't
damage it feeds back on itself
no
okay this was the crappy idea don't do
this
stupid or slim actually just uses a
kinematic model like this and it works
when i use a kinematic model i end up
with this
oh
troll mods
yeah so if it loses translation it
doesn't recover translation this is a
problem in orb slam as well
money is kind of dirty that's true i
wouldn't like a money
the problem with the fundamental matrix
though is like it doesn't scale the
if you don't have a translation
component that's very large
it doesn't scale it well
[Music]
well it survived longer now
look at that open cv book oh that looks
nice
it's a crispy part of the map
and how it jumped to over there
that's not what it's doing at all
okay now it's like broken
why is it so crappy
this part of the map's kind of nice
stop being crappy
okay
what dude you almost be famous fuck that
just go do something
gotta get that discipline that's true
you do need discipline in life
okay well that didn't work
god why is worm slam so much better
actually i've never actually seen orbs
lame run on room so maybe it doesn't
work
this is with ground truth
and ground tree helps it
it doesn't troll mod like crazy anymore
those are all wrong
oh no it's not light
so much peace
like my mouth doesn't look crispy
you know what else well no i can't
really do that
we do run the pose optimizer at every
frame right
oh no we don't because we have ground
for posts so we're just sticking it
it keeps jumping over there
that's where the real poses
fix yourself slam
something
look at that bro look at that bro yeah
stand still bro if you're a moving
object you're bad
look at that bro stand still
he's famous
he's in freiburg
oh my god we literally pass right by a
white wall
that's unusable
i guess that's why nobody succeeds at
room
nobody uses room
download one more than web slam uses
desk and floor
let's download desk
desk
so there's also depth information we
could potentially use but that's kind of
cheating
and notice how they don't use so notice
how they only use xyz
they don't use rotation
because i don't think it can do it
we know web slam succeeds at floor and
desk and xyz
um okay
desk
see how desk looks
this ground truth
okay like but even look like this is all
messed up like this is the same this is
ghosting it's the same thing twice right
those points are all garbage
we know orb slam does almost perfectly
on desk
the real problem is because my crappy uh
do we need key frames is that the
problem
once them talks briefly about why they
use key frames
bundle adjustments
i don't care about real time
uh
so i almost initially everything was
processed shortlisted in the math
location
yeah okay
so
this
the accumulation of linearization errors
i don't really understand what that
means
um because that would involve like math
but like i've heard the same crap with
kalman filters too
um
all right i mean this is a great video
to test on like you can really test
almost everything on this video
um but let's try
let's try this
let me try one fourth of the frames
no
so that's just doing it with less frames
it actually seems to kind of work better
look at the map is crispier
i don't know well that just messed up
but like
you can't see what oh you can't say oh
you can't read the text oh sorry
yeah okay
i've got today's work on slam
tomorrow
to do
um
in
yes
okay
if we need
keyframes
tomorrow
but yeah so
that's what we will do tomorrow
the idea of key frames is instead of
putting every frame in the optimizer you
only put some in the optimizer there's
linearization errors i think is what's
happening now and i think that's why
webb slams a lot better than us still
um
so we will uh look into that uh tomorrow
i'll see you twitches tomorrow it is
nine in the morning welcome welcome good
morning vietnam uh
we're resting peace robin williams uh
that's it all right see y'all later
oh wait till a few people saw some fun
to get before you read the paper all
right so the reason we're eating this
paper so I check out archived sanity a
lot it's pretty good and I think it was
in top recent there's this paper out
called glow from open AI well okay so
there's this paper called wave glow and
then I looked up below by open AI in
general you know this is how citations
work right if you track them back you
eventually get to better papers so then
this paper came out called glue and then
this paper referred to this paper nice
nonlinear independent components
explanation estimation I don't really
understand what that means but on the
glow thing either like you know look you
can like change how much just for one is
smiling like look you can really make
her smile that looks painful
we can make a smile not at all we can
make her old and sad oh she's old with a
sad look at her butt oh little see
that's better Wow
Walt's your blonde hair and no beard no
way Oh beautiful
but yeah so apparently they did this
unsupervised or like they're claiming to
by by using whatever his trick is
contained in this paper we propose a
deep learning framework for modeling
complex high dimensional densities
called alright
so let's try to figure out what a
density means in this context oh I'm
sorry my chat I haven't been looking at
my chat not that what's up yeah no yeah
we're reading so we're reading this
paper today oh I like that idea we can
make a reading group oh with your new
paper every day um so let me bring up
the chat on my phone again so I can see
the UH
is the bandwidth bad they all look so
good
well okay maybe not so bad kind of okay
yeah I cut off the top of my screen I
figured that was the best way to deal
with the fact that my monitor is not
sixteen by nine it but it is 16 by 10 oh
let's go to my chat oh here we go
I'm down for the plant I only ever get a
rant or two while reading well we read
you know like rice with terminal reading
paper shop yeah so do what are they all
not supposed to talk loudly in the cloud
but I went to the supermarket today guys
so you guys know that this is the new
drink of choice I take this green tea
delicious green tea that's what I have
right here bro two more cuz they were so
cheap we also have fishes and for
actually more expensive than fishes we
have an individually packaged couple
have you ever seen anything like this so
it's actually the same price as vicious
this is the same price as this these
weren't even 99 yen
these were 79 bro you're getting ripped
off when you go to those machines and
then I got this but we're gonna eat
together on the stream
like an apple pastry tip I had cooked
fishes for dinner but I'm gonna go put
all of these in the fridge and maybe we
will eat the fishes later on the stream
oh they love plastic they'll have
plastic if everything is in plastic all
natural men who remember the natural
mood bro the hotness mmm no we're gonna
eat this one stream
so don't worry we'll also be coding on
this stream it won't just be a I know
you like eating stream it won't just be
when I call this one in 90 Solon
capitals so I have a theory that let's
[Music]
so we have this matrix
and want to be rich with scam stream on
twitch and get people to subscribe to
you think that's what I want
so mmm I'm not saying okay you have pip
pie pot you can use pie pie to run pip
it's like pie pie - M pip or something
um all right before we play around with
this more let's read the paper we're
reading this paper I don't know you guys
are gonna like reading stream but we're
doing readings - don't be racist no
racism on my stream all people eat the
same nope that's true we're reading this
paper we're gonna understand what all
these words mean so this guy's famous
y'all know he's famous but here's a star
next to his name oh well we got it
always a c4 senior fellow complex high
dimensional densities so I think what
they're saying here is like if you have
like a picture right you can think about
a picture where each pixels dimension
and then you can think of like the
pictures people's faces and those
pictures are embedded like they are in
that high dimensional space first
purpose nonlinear determinative
transformation of data is long it Maps
it onto the latent space so as to make
the transformed data conform to a
factorized distribution resulting in
independent latent variables
improvisation
okay so independent with respect to what
what is a factorize distribution and why
do I need to know the determinant of the
Jacobian stream just started just you're
here $1 the training criteria and
assembly the exact log-likelihood which
is tractable unbiased ancestral sandwich
I don't know what that means
ancestral sample if joint distribution
representation distribution of the data
is easy to mop in this paper we
considered a special case where we asked
the learner to find the transformation
of the data into the new space such that
the resulting distribution factorizes
the components are independent
you know nothing's big in the cloud
everything is just as big as it needs to
be new Tom Cruise how much mass we're
trying to understand this paper okay if
you don't have any constructive comments
to say toward understanding the paper
then you know we're not gonna go can I
post the paper
yeah called nice okay inference sampling
in painting
and the core idea behind this is we can
split X into two blocks
sounds like Lenny around because linear
regression we consider the problem with
learning a probability density for
parametric family of densities over
finite data set D of n samples each
living in a space so that that's where I
was going with with this my samples are
here all right
no Tom Cruise only constructive things
for understanding the paper I'm verbally
warning you anymore non-constructive
things will be given time out on Twitch
because we're here to be constructive no
more rants everybody here is happy I
don't want to totally block you but
we're gonna give you a time out
that's right
vertical pre-processing will transform
the variable proposing can increase
likelihood arbitrarily simply by
contracting the data I guess that's a
reasonable hour in Russia that's why
people are talking in Russian I also use
the change of variables formula equation
one
this is not simple
okay so let's just write down some
definitions here we were asking the trip
they learn how to find a transformation
h equals f of X of the data to a new
space okay so I guess H as the late in
space which assumes F of inverter is
invertible and the dimension of H is the
same as the dimension of X in order to
fit a distribution and I know that P
means
I want pictures too f is invertible you
know we're trying to read this paper
okay here's the name of the paper I'm
going to get a fish I try to read the
paper and we're gonna try only know
Python it would be nice if I do knew
another language but we're reading this
paper today that's what we're doing now
I think Python is actually the
appropriate language here next time we
code something like twitch slammer
twitch chats we always Python but
today's reading day we're gonna see if
reading day we're gonna see how reading
day goes
easy to have another recall in the
easing of universe
give us fish
fish hole finite data set d of n
examples each living in a space
yeah you like this that's good fish fish
is delicious aw bro you don't need a
fish before
this is really hard
P is definitely a distribution um I
don't know maybe this is a stupid stream
that's not what it is that's not from
chemistry maybe this is a stupid stream
with chess guys we were going to try to
read this paper but it turns out this
paper certainly hard maximum-likelihood
using the following will be a predefined
density function
okay well so the distribution of the
hypothesis is just saying is a Gaussian
predefined density function
what is the next project that's a great
question I think so I didn't know about
this paper till today the architecture
of the model is crucial to paint a
family of rejection whose Jacobian okay
I understand like what this means right
like it's obvious what this means but
why yeah
I don't think I need the author to
explain it to me I think I just need to
sit here for an hour the only question
is do I want to sit here with you guys I
don't want to sit here alone is this a
nice stream I don't know is this a good
stream seventy five people are watching
this shit it is hard I feel like on
stream there should be action you know
yeah I'm tempted to sit alone and this
is what I was doing tonight I thought
I'd bring you guys along make flappybird
[Laughter]
do we want to make flappy bird but what
is flappy bird all right let's make
flappy bird let's go
twitch flappy sure you sure you really
do this this is really what we want to
do we're not gonna learn anything doing
this is bullshit
give you something gonna learn something
do it when I'm making shitty flappy bird
all right some scratch and see that
sounds awful you're not gonna learn
anything they're just gonna be
frustrated debugging things no eh I hate
fucking AI
no no no I knew what maximum likelihood
estimation is I we can look it up
I mean yeah it's okay use pencil and
paper to break the equations down and
why is it taking a log okay all right
well okay so these are my new samples
what should we call let's call them big
X all right and now our goal is to find
some function f that's going to turn
this back into that I just multiplied it
by a random matrix this should be doable
yeah you're right you're right I don't
have MATLAB do I have that one I have
that lap well no sirree knowledge okay
they have topcoat I mean the codes
probably easier not nice get up
standard normal
we only support MLP encoder we only
support by objective layers with given
inference compute the log likelihood of
a batch according to the model
distribution okay so we have this X we
can look at the shape of X get F prop
okay so the log likelihood is the prior
plus the log dat Jack get F prop and log
dat dacovian the state of the layer and
log have to go wow okay if self in code
or is not long great
alright so we need the encoder now
see the x4 how to use it
okay so we have some log likelihood of
the prior then if we want a sample from
the distribution we have to have this
thing self encoder okay so let's see
what that set so is instance encoder I'm
okay okay so that's the MLP here this is
the encoder and it's written pi learned
- I don't know the last person who's
written anything in PI learned to his
instance encoder MLP so it should be
like class MLP we're actually the MLP is
just defined here and PI learn two
models MLP I learned who hasn't been
used in centuries multi-layer perceptron
so I mean this is what they used to call
neural networks back in like forever ago
like 2004 just see what the initializer
is for
this possible heart attack and will
appear to be okay so layers batch sighs
now I assume there's an activation
function is there an activation function
has a header encoder see where did these
things come from this sure doesn't have
it
all right so maybe it's only here in
layers so what's a layer blocks brick
base from layer import layer
oh there's a theano one too it's even
find a tensorflow
no there's not we're gonna try to write
one in tensorflow
what try to have tensorflow my Python 3
get high stream no one gets hot here
this is the cloud
should we eat that Apple or should we
save the Apple for tomorrow or should we
get the door is Domino's
that's always an option as well sure
Domino's this Domino's everywhere in the
world man you wanna see how quickly a
man who remembers why it's gotta get
here in 30 minutes or less are your
pizzas free
okay so this just goes through the
layers what are the layers let's just
initialize as a triangular MLP it's not
talked about in the paper or Lu
MLP in our experiments this building
block has a unit Jacobian determinant
for any M as trivially invertible I see
what's trivially invertible at least the
core idea behind this is we can split X
into two blocks how does it split X into
said blocks maybe that's what I don't
understand
the architecture of the model is crucial
to obtain a family of by Jackson's whose
Jacobian determinant is tractable first
we consider affine transformations
[Music]
alright this is the last time we do
paper reading stream guys I forgot how
hard reading paper is any square
matrices this is interesting well
triangular matrices whose determinants
are simply the product of the diagonal
element inverting triangular matrices a
test time okay I mean this is just an
interesting idea and of itself right
like if you have a neural network by
ejective activation functions triangular
Jacobian I mean this interesting idea in
and of itself right like taking the
inverse of a neural network if you have
a neural networks what's the Lu function
the equation for tell you
it's just that so let's say like hey I
want to compute the Lu la Plata and V
dot X X X minus 1 if less than zero oh
yeah so we want to say is numpy and line
yeah
yes we can just do it so I'm gonna do is
plot it we can do this you know
so that's an Lu which is actually an
invertible function which is pretty cool
and matrices are invertible as well so
maybe those are the things that maybe
this is what they're talking about here
the architectural model is crucial to
obtain a family of by Jackson's 2
zoocobia determinate is tractable in
this computation is straightforward it's
actually interesting how yeah like
really invertible most of these things
are many square matrices M can also be
expressed as a product of upper and
lower triangular matrices so this is
like SVD because no SVD triangular
weight matrices and by jected activation
yeah so that's bioactive do I read books
a lot sometimes sometimes you read books
I eat of the axes like the best function
ever don't read any fucking articles
news is for losers losers really do
losers spread news tune out the modern
propaganda do your part there were some
news rise with loser
um boarding of every books like you
can't really read a textbook whoever was
talking about how if you want to like
understand a paper you gotta like write
out the equations and stuff is
absolutely right I'm not much of a
writer I can't really write but I can
tell you so
I don't understand this yes I understand
sampling all right let's just make a
little neural network and then let's
take the inverse of it
well can we make an invertible M nest
it's kind of an interesting idea so it's
cool as new Karass is built into tensor
flow so you can say things like that
I do import tensor flow dr. oz as cross
and then can I say that
oh yeah doesn't work let's see it's
annoying you have to write stupid tensor
flow everywhere it's gonna download
analyst from the internet
Oh
I'm in the cloud Japan is the cloud
pretty much make sure you get your
passport card your passport card
Oh get your passport card also get money
got money gotta get money you know
what's cool about Asia man
all right the best oz stupid question is
this the Geo hot no wrong guy okay so I
mean it just kind of can we take an EM
missed and can we train and can we train
like the typical classifier in that and
then can we invert that net and try to
get it to generate pictures
Claire normal classes is not defined you
guys can see what I'm working hey you
guys can see fine cool okay so we have
this little problem new Tom Cruise
I'm warning some of you guys if you're
not here to be constructive and help
understand the paper you're bad and if
you're a subscriber no no no no we're
banning macbook guy cuz his question was
stupid
wrong guy bro I don't know who that is
see I can't ban you if you're all the
way down there
all right so wills must be vant keeping
track at this account I don't know who
you are
are you subscriber no you're not a
subscriber why would I let you something
y'all are getting banned I wants to be
in charge of banning people which
subscriber would like to be in charge of
banning people not you please subscribe
first subscriber to be like I want to
ban people you're a subscriber
congratulations if I could only if my
stupid thing would work see the problem
is the button to make you mod is further
down we have to wait till a few more
people talk talk talk so then I can
click here and then congratulations ban
all they'll be able to say obnoxious
shit
all right where were we what was my over
here okay so we're gonna try to amnesty
bill thing I think that's like the trick
here um oh I could type mod' name I
remove tab and I'm give them time outs
if they say stupid shit you asked me if
they should go to college okay see now
whatever I understand is okay so they're
using rel you my understanding of rel
you is that it's not reversible it's
just like their actual paper you don't
have an actual paper just have stars
might be the right one see let's make
sure this is the right one and then like
let's put more effort into reading their
code oh here this guy did it in PI torch
that's probably readable
[Music]
limitation of models from paper pillows
really your network okay so they're
using batch norm I mean I guess that
doesn't really matter they're also using
rel you so I don't understand because
aurelio is not invertible for reference
this is what R Elliot looks like and you
can see how it's not a very by active
function it's also not a differentiable
function they're saying leaky rel use
this Aliki value but if you have a
normal value it's not invertible because
of that big klappa so I don't understand
how they're doing this inverted grant
application of the miles of rivers for
additive coupling layer I don't
understand this build value Network and
if couple later
layer 4 dot universe okay so I guess
this is something they define here maybe
ok layer with coupling law the two
things are of a song base class inherits
from base coupling layer can do this
inverse thing okay I understand this
input dim odd even that doesn't seem
right because a plus B oh I don't know
base coupling layer
[Music]
self dot second oh okay
get even get odd this seems stupid
like it seems like they actually just
divided it in half
yeah okay so I think I see what they're
doing here even valued columns versus
odd value comes this seems extremely
complicated and it seems like it's
literally just designed for the
inpainting problem yeah okay
nobody even or even so then they like
switch between them okay I don't
understand why this four layers forward
passes just do all of the line towards
reciprocal I mean okay so this would be
pretty easy to now recode and tensor
fault this is I don't understand why the
other stuff so unreadable I mean like
these are you know get even get odd
thank you for the follows both please
subscribe I need money to buy apples
you don't apples $2.50 here it's a nice
looking Apple Bob actually they're
cheaper than that like a dollar eighty
so something give me a dollar eighty I
can afford an Apple did a lot of people
get banned
yeah so we're reading that paper it's
like okay I mean this is like a cute
trick they're using you can see what it
is now right it's a pass through and
then a transformation and a pass through
and then a transformation but it seems
diagonal scaling you know how's that
updated
maybe it's just learned so I don't know
how things are learned on here yet but
at least we understand what the the
model is inverse mapping through the
layer gradients should be turned off
through this path you're good moderator
I like you that's good thinking that's
good thinking you know mmm had a line
about that once about how he's not gonna
shoot somebody he she was gonna smack
him with the back of a pistol so that
way next time he sees him he can smack
him with the back of a pistol again just
a good life lesson guys don't shoot
people smacking with your gun no guys in
the cloudless sir it's not here
the building block has unit it's ballsy
but they're using batch norm here it's
ballsy all right so I understand the
model now which was not clear at all in
this paper like the core idea is that we
can split X into two blocks how will you
take the odd cons and the even column so
how do I understand okay this is amazing
that this works like at all
it seems stupid like it's a weird trick
we can implement that same can implement
that in tensor form or we can
[Music]
yeah Iceman ice me okay so here's the
loss function like I said I just I think
I don't wanna like do anything that
complicated
I just wanna that's good that's good
good good good timeout three timeouts
equals bana do we need another tea or
should we eat the apple who thinks tea
and who thinks apple put that hungry
maybe just a tea we'll get a tea
and how do I know how cheap these tees
are savage we've got what we're going to
you don't want to yeah I don't know I
don't like these coupling lighter things
I like the idea of just no never been
broke prom all right here's a lesson
they don't teach you in liberal arts
college like it's not like anybody he's
just gonna wake up one day and end up
poor oh okay it's a small we gonna rant
about this oh we gonna rant about like
it's a state of mind all right like
maybe there's like a couple different
mentalities of how people think about
money and you know some people and these
are the people who are gonna be poor in
life they have this idea like that like
a money's gonna rot all right and they
just gotta like spend that shit all
right and then they you know they they
go to the bar and they blow 80 bucks and
they put it on a credit card and it's
just like they have a poor person
mentality right and if you have that
kind of attitude toward money you're
gonna be poor arrest your life all right
you're always gonna be poor and then you
like this like middle-class attitude
toward money as much as the middle-class
may still exist but like you know they
see it as something that you know we're
gonna we're gonna work we're gonna work
towards and you work and you get paid
your money and then you pay your end
right and you have to make sure maybe
you know these people maybe even have
this idea of like savings right they're
gonna like put money away and they're
gonna save a small amount of money for
something like retirement right um and
then you have the rich people attitude
do you guys know about PE RT do you guys
know about compounding interest I
remember I was in fifth graders in an
algebra class and they tell you about
this shit all right you know PE RT we
can do PE RT all right so it's like you
know P times n px which is R times T
right and then P is your principal so
let's go start out with $10,000 right
$10,000 and I'm getting an interest rate
of say 10 percent and I'm getting that
interest rate um every year so let me
just think this there so then I said on
my $10,000 for 10 years
holy shit look at how much money I have
look at how much money I have wait I
don't think that's right I think I
messed up that's probably more correct
okay well let's see if that if that were
zero then yeah yeah so I'm making ten
percent a year look at how much money I
have right then you start to realize
what if I have a hundred thousand
dollars that isn't even that much money
but you now over ten years have turned
that into this much money let's say you
had a million dollars
you've now turned it into this much
money and let's say you captured in
there for twenty years
holy shit let's say you kept it in there
for a hundred years this this is like
you start out with a million dollars and
you end up with twenty two billion after
a hundred years this is how rich people
think about money like stop thinking
like like like like like oh you're gonna
get a job you don't gonna get a job you
just gotta figure out how to get some
money and then start earning interest
bro
that's you give rich so you know you
don't just go broke and the truth is
even if you ran out of money to are like
with this mentality in five years you're
rich again right you guys stop thinking
about it you see you have like the
middle-class person right and the
middle-class person they get a raise and
they're like oh now finally we can
afford our trip to to Disneyworld or we
can afford to eat nicer steaks or
bullshit like that Wow
what do you get banned for Wow y'all
gotta don't ban hey don't ban
subscribers well subscribers don't gotta
get banned that's okay but if you
subscribe you have a lot more leeway on
the bullshit you can get away with
saying on this account don't subscribe
fuck you you didn't give me any money
if you subscribe I subscribe right
you're one of the cool people what you
say is cool right so yeah don't don't
ban the subscribers okay alright you got
to stop if you want to keep your
moderator power you can't be on this
[Laughter]
look poor people they have a terrible
attitude during money and that's why
they're poor middle-class people have an
okay attitude toward money and they'll
be middle-class for the rest of their
lives
they're not gonna struggle too hard but
they're never gonna understand what it's
what it means to like not have to worry
about money here's the trick guys if you
make $50,000 a year figure out how to
spend ten thousand you don't need
whatever shit they're trying to sell you
you don't need it
good life advice Joe much this tea cost
me 79 yen you know what's this apartment
cost me nothing guys nothing the only
thing in my life that I've spent any
money on was like my computer and my
phone so much this shirt cost me nothing
you know was his hair cost me Supercuts
stop spending money on shit that you
don't need start putting that money into
PRT all right that's today's life in my
book is a structural no they're poor
because they don't understand economics
the money should earn money this guy
gets it you shouldn't be earning money
that's the real that's really the
difference between the middle class and
the rich person attitude the middle
class person thinks they earn money the
rich person thinks their money earns
money that's a good summary two poor
people like to think like money grows on
trees they think like money falls from
the sky oh shit shit we got some money
let's go spend it on something stupid
yeah poor people thinks money grows on
trees or falls from the sky or some shit
you know they don't understand like
anything about like and you gotta like
work for somebody right and like you
know they're they're like no
understanding of like a business right
and this is yy-you know they're poor
middle-class people understand this
right they understand them vaguely they
have a vague inkling of this but they
still think that it's
money rich people know that money earns
money that's right and the cool thing
about this advice is it's not like easy
to do but you just got I do I do because
like you know I mean I asked you wanna
talk about people who I respect and like
someone who's poor is not very high up
on that list you know what I mean cuz
it's not like it's a all right well as
always I don't get started on fat people
you know like you know there's a lot of
things there's a lot of things you
shouldn't judge a person based on but
you can certainly judge them for being
poor and you can even judge them for
being fat what am i I don't believe in
the US dollar money is a scam made by
people to scam you have knowledge grows
ya know that's the thing man you're poor
start developing a good attitude toward
money get some money save your money
you're fat
let me tell you man stop eating crap
let's start exercising is that simple
you can stand other people out of money
too right the lake you know don't do it
okay alright alright
Ram talk rant time is over rant it's
really true it's really it's absolutely
true um there's an interview with with
Morgan Freeman where you know
interviewers talking about like you know
people from his home town rough it is so
hard to get out you know you made it out
but it's so hard
Morgan Freeman looks at him it's like
the bus runs every day yeah yeah yeah
alright alright you're poor cuz you have
a condition too no I mean people really
just don't understand what money is and
if you really it comes down to like
you're one of those three attitudes
all right let's let's get back to it
let's get back to machine learning I
wouldn't buy a Bitcoin you can't buy a
Bitcoin I was talking to someone about
like like why is Bitcoin priced at what
it is and again you know a lot of people
really don't understand economics do you
guys want to know why Bitcoin why
bitcoin is priced at what it is I'll
tell you why bitcoin is priced at what
it is go watch one Bitcoin oh it's worth
exactly one BTC one Bitcoin is worth six
thousand five hundred thirty two dollars
because exactly doesn't the official AWS
stream
well it's taking a long time to load
I'm in the cloud Bros no bitcoins price
is exactly what it is because of this
because these people up here are willing
to buy it
and these people down here are willing
to sell it and the price is just where
those two things meet right here this is
exactly what a Bitcoin is worth this
much money because these are by orders
and these are sell orders that to truly
understand what markets are supply and
demand well yeah I mean it's our what's
on the AWS stream is it any good that is
how the entire market works now really
internalize those facts all right
back to learning things here and the
number of viewers really goes up yes I
did I opened an order book and said
that's why bitcoins that price oh hey I
am machine learning at Amazon okay
alright we got a competition all right
let's start code all right
so what we're gonna try to do first we
got to understand where's that one with
twitch I don't want to not torch pyramid
that's
as it works we're reading nice could
someone link the paper please
should I just figure out to put the
paper like in the description or
something
all right now it's in the description
I'm in the clap
Wow 101 people wow so much people
alright I'll just come for the rant I
know you come for the grants know what I
want but my PI so it looks like we just
need she was trying to use by torch do I
have five torch on here it's just cool I
have fighters but let's not make this
model so complex no well I moved to
Japan because
wait a second
yeah that's no no twitch Prime is not
okay Joker I'm very sorry you were muted
I didn't want that to happen your
subscriber if you just have twitch Prime
fuck you but if you're a subscriber to
my channel and you come here for the
premium Tom Cruise with a three content
you can get away with a lot of shit damn
hidden OH
so okay they can blow that up there I'm
sorry you were Bend the new moderator
was power happy thank you for
subscribing thank you I really
appreciate when people subscribe
I'm looking I'm looking at my phone down
here nothing is toxic
here is toxic everyone here it's good
attitude if we get too many people will
just shut it down and I won't stream on
Twitch anymore you know um math
prerequisites I understand the paper I
don't think there's that much like deep
math involved um I mean you should
understand what a Jacobian is like ass
cuz they use the word a lot but I don't
understand why all right let's say I
want to figure this out I mean this is
still one of the best trees we're gonna
have to solve what is a Jacobian
determinant jacobi imagination all first
order partial derivatives post its
matrix and the determinant
yeah I mean you tell my basic calculus
calculus hopefully I was understand
calculus all right um so let's try what
I was saying before about making it
invertible so let's just go whoops 784
784 and then tell you I'm going to try
to make an invertible neural map
so in theory what happens if I say like
work it's not gonna work it on and I
could make a sequential I think I have
to make a tensor out of this I don't
really know how to make just torch
tensor so eyes much oh because we're
gonna want to say reshape one let's just
say for cool
um it seems like they all went the same
yeah I considered streaming from the
transistor
maybe maybe all right so I don't really
know how to use pi torch but I feel like
I should get better at it researchers
tend to like it so big now something
like I just you know just work right
it's a slice like that I cool what's the
same thing it just seemed looks like as
an image time pie
take all numpy on the Vario that
requires grad I so we're just we're just
running through the stupid little neuron
that I made we're gonna see what we get
can I do this so that's what M this
looks like when you like visualize it
like that you know is that my phone
locked in her chest we'll probably like
some of the highlights for this channel
ever this channel is only gonna go
downhill from here
that's all I can this kind of the
distribution looks like right so we can
kind of see where things coming up with
things from the distribution why I got
dumped I can't call an umpire on
variable that requires grad to last to
be that's one way that didn't work
can't call numpy on variable that
requires grad these are detached on pi
does anyone understand what that is
thank you for subscribing thank you
thank you
time I go off thank you proteus thank
you I really appreciate when people
subscribe to my my twitch so I can
continue to buy rice and other various
food what I press ok
[Music]
what is the detach operation doing
detach does the same thing
here's an example of the difference if
you use tensor detached the gradient
computation is guaranteed to be correct
guide so anyone talking about transistor
what they were fine - is this looking up
when you get no phone he's allowed
that's right no phonies I'm looking into
a little bit more
it's a online course I'm gonna have to
find an FPGA board I like grad okay
February you don't have yours my
favorite time all right let's try to do
the thing let's try that yeah it doesn't
look like that right so we're going this
figure there so that's what the input
distribution and that's what the output
distribution looks like you should be
able to learn like the amnesty inverter
right so by George train
um just write a quick trainer so the
60,000 things will do batch sizes of say
100 will say why why those models up X
chain o plus 100 I was just trying to
tries that as the ass that is extra that
shape sub-zero cool f dot n ll loss
backwards optimizer don't step
all right so let's just write a quick
trainer can you see or is this the part
I can't say model train no that means
you look at this a loss
optimist not define getting a qdm EDM is
on my favorite looking never your ass I
said yesterday isn't there a tiki DM
around this will get a little progress
bar boom alright well I'll just went to
Nan's did it go to Nance so here it goes
to Nance and so much Nance
so much dance
and why is that happening
[Music]
pouches full just not being a knitted oh
hello I was a model about liars
even to type ipython notebook
[Music]
okay snap a scan the same questions
let's put the Jake Paul sweatshirt on
I'm getting cold
there we go I can't go away to this
don't wait
all right so now we train and they all
become mad okay I do wrong
nothing go down exciting to optimize
your step
what do i do optimizers depakote than
that let's do one step few steps man
that much steps
now
not in man now I'm stable you know
what's always stable Adam here's Adam
I'll look Adam always stable so slow
though beautiful see what it looks like
now okay good so now you can see that it
matches all right so let's learn the
inverse Adams an optimize our google it
all right so this learns to inverted
mists so now let's take a sample it's
just a model extra choice works we have
to say like X check this sob an
inclusive or exclusive perfect probably
you know it was a probabilistic test
shape sub-zero model exchange CC sixty
plus one detached numpy we should
actually just say I wish you call this X
attacks
- OH xx die already
okay wait 28 all this one y model X X
now we learn a nice numpy inverter built
in our groups
yeah look this upside down alright so
you see my function learn to turn that
into that oh yeah oh yeah get it get it
alright let's add in a bunch more stupid
layers and see if it gets to learn it I
was gonna take forever because no GPU oh
come on the GPU you guys I'm poor and
poor on GPU so learn that words ok
inverter hi whoo ok so we're turning
threes into backward 3 inverter hi cool
that's good that's good
now let's invert the function and see if
it can turn this into that well first
let's just try it I mean this model
hypothetically should just be so work
let me go
Oh to Python 3 now we have Python 3
programmer that's 110 said oh so we have
to say ten sir why why I want to do it
up there
name ten so it's not defined torch top
ten center
okay so it kind of works in the universe
but like not really right so but that
didn't actually invert the function I
just like put it in because the function
is like the inversor itself it's
knocking now we should actually be able
to completely invert this because
matrices can be inverted and because Lu
can be inverted when you figure how to
do this there isn't that shit and
sublime said some stuff about that I
didn't pipe I this morning
oh and D FAA yeah those four CTF no
stupid coupling law thing no this is way
better I'm actually inverting the model
so they made a claim in their paper
we're not trying to copy the paper
exactly I don't totally understand the
paper I think the best way to understand
it is to like build something that's
like not exactly the right thing but
yeah so they're saying they make some
claim one way to use this observation
would be to build a neural network with
triangular weight matrices and by
ejective activation functions so we are
using a bioactive activation function
the Lu function is by jected limiting
design choices to depth to depth like
get it okay fine
so we have this thing called model we
can say
um can you guys see this okay by the way
I didn't like my face is there should I
put my face up here I can move my face I
like code over there
hey face up here so better cool and now
I'm like coding over here that's like
that I'm sorry okay how the first one is
a stupid one the first one is this
sequential isn't what I want
children children okay yes they're
children because there's nothing special
about a sequential okay so I should
actually be able to invert that a linear
layer oh they have biases should we
retrain this without the bias bias is
bad people well learn okay we fill say
let's find out let's take so long guards
please don't leave subscribe so I can
afford a GPO I'm only on CPU you know
CPU it's so slow
Oh guys we got rid of the bias cuz
somebody want to deal with um let's Jack
here it's a really work then he did buy
us
ok broke garbage I'll have to invert the
bias to
[Music]
I have a great iPhone this one
and you know it works I don't know I
guess we need bias okay it works is
biased only with mice Wow
my CPUs bottle to the moon okay
it's a by winning a lair
by linear transformation I mean you're
like by linear interpolation
what's a bilinear transformation you
know adds them weird okay
if Tyco bad just type in what I want
here and so I'm gonna try to invert this
neural network right and in that linear
time equals a little in here down that's
great
didn't work no it's the name of the cat
allah go oh I cam that waits Waits
yeah okay so why timed up by is touch it
so what it is cool okay so now inverse X
I don't want to say this we don't say so
first we have to subtract the bias and
then P and move m dot wait
well first let's let's just do compute X
and make sure I wrote this right they
had a real name for it they called it
yes forward inverse that's too forward
first actually I understand how these
things work
this should be really easy if I did it
right okay if type equals linear it's
probably like a nicer way to do this but
what we want to say is okay so they're
claiming it's x transpose X and if you
down x and wait T plus I'm done Pius X
eight-balls
I'll tell you
although he acts like you ways to do
this and numpy isn't there yeah so we
just say like an x equals x less than
zero
and we got X this is actually correct
isn't that this x + X + NP down X minus
1 X equals ax ax
all right so if we did that right
we should say y equals forward X X sub 0
0 that parameter object has no attribute
t1 point can't call a lump on variable
that requires grad oh but I did detach
to detach the bias probably 200 here
unsupported type for nun type maybe that
is just that parameter object has an
electric t can't call number oh we're
gonna have a name for the matrix here
they call it a let's just say a little
I'm not waiting I'm pi not te let's also
move this here can't call numpy on
variable that requires grant all right
it's gold attached here whatever that
means
okay seems good unsupported type oh I
don't know a transpose or nun type X
none type
Wow turn acts oops
um NP Tylenol stop transpose oops
numpad transpose I'm show xx we shape
show why why are we shape okay that
works cool all right so that's oh wow
wait how did that work it has no bias
that's so weird
well actually I kind of understand it
it's actually cause of how M show works
cult
so now just lets you know throwing up is
easy here let's actually add this up
here okay so that like kind of works but
not really so let's try this with
inverse okay runs up through some values
okay so we want on Lu what's the inverse
of the expo
where's my graphic value it's somewhere
isn't it yeah so the inverse value is
just going to be whatever the inverse of
the X function is what is the university
export universe and px who knows that
it's just- alright it double negative
okay so how do we undo that so you undo
that is you multiply that by just the
inverse of this and beat ugly now all
the ton inv so if this worked this thing
would look like that but it is I'm wrong
I think my in value is correct we can
test it quickly
plot should be a straight line it's not
temesta
does that not work even
gonna work
what are you wrong
exampie copy ax nags Alex less than 0 XM
x equals NP x one day I'll stop doing
that oh it's cracked
it seems crack just looks shitty when
you're ok so it should be right
no it's not right
ok looks right but it's not right ok so
a few things you know +1 in here the
inverse function is different what is it
do you know what it is not that not that
ok whoa for mouth
so what's the inverse wait isn't the
inverse of e to the X just long there
you go
well I'm dumb of course it's long this
literally Wow okay I'm stupid
that's cool no jail I know it's knowing
of the inverse value function and if I
got my matrices right okay that's still
wrong so now let's think about what I'm
doing wrong with matrices just closed W
Gavea nope no ox okay um if we have
something and we dot it with something
oh no I'm the worst perhaps ever that No
is it possible to just do inverse on
this whole thing can I just say towards
dot inverse model know what that means
no chasing if it's the square matrix
okay this is firm paychecks and we could
write it but I don't think it's not like
it's a pretty read the layers okay
this is just good for now so let's
figure out why doesn't work NP the
knowledge inverse okay so X dot W
dot W to the minus one should be the
opposite is it lagging lag what's up
okay this should look like something in
the hologram
I mean this work should unless these
matrices are like poorly conditioned or
something I'm sorry it's lagging guys
I'll buy more Internet I had a place
this is the same thing as saying X dot W
right let's like try something stupid
that's like a de transpose here
oops
yes and that breaks that so yeah you get
this wrong it breaks
you might check to see if these things
are the same
I really wish they'd changed the print
function back in Python 3 so it can be
supported both ways but they're dicks
and they won't do it
see if that works like are those the
same yeah they look pretty similar
what is the right thing do you like see
the benefit bro
doing a band brow what band band
stupid fucking question is that okay um
[Music]
what does my in value work for a long
time to a certain amount
yeah I mean like it fix it with tools
but you know it's always better to
change your behavior than to like add
some custom environment ship it's better
when I do that why doesn't my inverse
work okay I don't understand all right
let's keep track of all the
intermediates
I'll see where they begin to diverge
they diverted by the first thing your
liar
no I haven't diverged appreciably by the
first linear way the alley layers wrong
but in value doesn't work
I don't know why I was like okay doesn't
it make sense actually so that should be
that should be the output those are
completely identical it was a change a
tiny bit but within like numerical
instability of matrix inversion that is
broken entirely even for things that
just shouldn't be broken at all like
these ones okay something's going wrong
with my Lu inversion
right now I just shouldn't do anything I
don't get it now
those two are definitely the same that
was the first one I upended that's
actually just the same as why why yeah
bro if you're subscribing because you
think you will get something you're
subscribing for the wrong reasons
information is free if you're
subscribing because you know you want to
give me money that's a good reason to
subscribe if you're subscribing because
you want something don't subscribe
torrent it figure out how to get it for
free bro that's the best way to do it
because free is great I love free I'm a
big fan of free
[Music]
okay well what should happen between
here and here is Lu ya see that one only
changes the negative values here
something stupids happening it's like
even changing the positive values but it
doesn't make sense because when I call
this out no now it doesn't do anything
is in value broken
when I test it
yeah see look okay something's really
wrong yeah cuz that's just doing that
see that's correct
see that's correct something else must
be happening what's happening to go from
there to there that's not an L you 8 8 8
8 8 8 3 3 y 0 it's just the first one in
one
yeah doesn't make sounds you see what
you see what's like I was happening here
I know what's happening
always copy try save memory cheap fogs
okay that's better now it all looks
correct those are the same those the
same
those are the same hmm this one broke
okay let's go back to a simpler model
learn to fine don't need to plot this
okay that works okay huh I guess just
one of the matrices wasn't very well
invertible seems to work okay now like
that solid spicy inverse yeah bro let me
tell you the difference man you ever
seen Jeff Bezos talk to you and read
your comment but you really gotta give
me money right if you're debating about
subscribing don't but at the same time
please subscribe like if you're thinking
about the utility that subscribing will
give to you then you're the wrong kind
of person and please leave the channel
right like if you're the kind of person
who's thinking like maybe if I subscribe
I could learn something for like a job
interview then fuck you get off the
channel if you are subscribing for the
sheer Glee of clicking the subscribe
buttons and so you can have a little
star next to your name that is why you
should subscribe you people with the
Stars are better than the people without
the Stars you see everybody has a name
on twitch right and they're right here
here are the names on twitches you
seeker anagen he is better than jib
palely you see joker 2k nine nine nine
he is better than her do and if you're
harder I'm sorry I didn't ask for your
preferred pronouns if you're a
subscriber I will ask you everyone who's
not a subscriber you're just they okay
you Paul yerko have star you are better
than P
who don't have star that's how it works
okay so that's the only question you
gotta ask yourself do you wanna be
better than the people without star
that's it that's the reason you should
subscribe that's a good reason ten
there's a good reason
can I subscribe that was want to
subscribe
do I have star I have star
I'll see that's good I'm happy ahead
star it's in my notifications I have so
much friends requests do you oh okay
alright alright alright let's go back to
the paper I think I know what I did I
think I know what was the problem
I think numerical instabilities are
adding up mmm that works does this work
there's a little bit of noise and the
problem is once I add an another layer
there's too much noise excellent bro
excellent please subscribe though until
you have a star you know the kind the
worst kind of people are the people who
say they're gonna subscribe an adult man
I'm counting my money over here don't
look oh that's not that much money any
more people to subscribe
followers you're worthless to me you
don't get a star I mean I guess you're
better to not followers but to be honest
if this channel gets too popular and we
if we ever felt like a thousand viewers
on the channel we'd have to shut it down
like the day we had a thousand viewers
is the day we shut down the Tom Cruise
with the three twitch channel everyone
else like everyone else I'm sure there's
other people like this bro maybe we just
start banning people for spreading anti
subscriber propaganda why can't we be
too popular because do you know you act
differently you know you act when you're
in like a room with your friends you're
pretty cool everything's chill and
everything's relaxed but you know when
you're not chill when you're like
speaking to an audience of a thousand
people you can't be chill anymore it
can't just be like the Tom Cruise with
the three switch channels twitch channel
is just a cool place to hang out like
it's a cool place to hang out we code we
should talk and that's what it is okay
so I am now understanding one of the
things they said in the paper
let's bring the paper back and then I
think we might always to be on streaming
for today but we wrote an invertible
neural network the problem is it doesn't
nicely invert nice there's that word
again nice so this is only the relayer
Network and you can already start to see
the noise appearing in the picture dance
once Thanos
Oh panels
Plus Thanos I don't understand
I don't watch Avengers movies I guess I
saw the first Avengers just a little
load with the paper go there's a paper
um well these are these woke you know
have limiting design choices to depth
and selection nonlinearities mmm okay
but this might have more to do with the
numeric approximation of NP Lin algin
see if I can get a better one
look at that noise it's disgusting noise
Dan else's
it's from superhero movies isn't it
how much beauty 500 but I did watch this
thing on a Gucci that was pretty good
and I don't really watch that much
YouTube anymore the beginning of this
year I watched a lot of YouTube I've
just been reading a lot I read a lot of
papers read books
everyone's happy in the cloud all right
inverting triangular matrices
Flattr its bro guys haven't you been on
Google Maps lately haven't you been on
Google Maps they're really pushing that
around Earth propaganda just zoom out on
Google Maps wow my internet shit it's
flat it's flat and then they push the
propaganda wow that took some time you
saw a Catcher in the Rye it's a movie
they made a Catcher in the Rye movie
rebel and the RAI hosted you 4-0 viewers
you guys have yours wait who said
politics no so many politics work
slavery problem everything is politics
yes Segway slavery and then they're
gonna make you bi and that's the right
slavery they but it wasn't a movie it's
a good it's a good movie it's a good
book I mean yeah I want you catching
that I what's the name of the ml book I
was reading
look at my books oh I guess I looked at
this um yesterday I mean this is just
like the classic it's just that yeah I
modern approach I own the physical book
I own the physical book go buy it go
support the authors if it actually
supports the authors if it supports a
Marisol publishing company just toured
it this is a good book
this one's interesting Hardy's theory of
numbers I read this this this was very
quick to read Jonathan Livingston
Seagull it was alright I don't know I
wouldn't really recommend it
I'd recommend catching the ride that I
read I read this I read prime obsession
this was cool and yeah that's that
physical I don't know any physical books
from the cloud bro no physical here
Hogan's cloud okay so today we learned
about invertible neural networks you've
been streaming for two and a half hours
I think streaming time might be almost
over we didn't get through this paper
yet but we understand the beginning of
it a little bit maybe tomorrow we'll
stream more this paper structure and
interpretation of computer programs
this papers legit yeah no it's a good
paper um what is this
when was this written they have
computers in 1996 I'm probably gonna
work on this more tomorrow without you
guys trying to understand this
yeah polyfill test tomorrow without you
guys
but look what what do you want - what do
you want to stream tomorrow why should I
read this it's kind of interesting
registers to the exercises our discover
this random exercise accumulate
procedures known as fold right there's
also a fold left language is this like
bliss or skew or something no no we're
not streaming when I streaming tutorials
let me know if you have come up with
something to write tomorrow we can write
it yes less you know oh there's a cool
uh it's hard learn tasks Oh sounds
pretty cool no no no the GPU we can't do
real neural network stuff but we thought
we thought a little about invertibility
of neural networks today what is this
link
I do love functional programming I like
you more like the provable programming
languages I haven't played with him that
much but like there's cock which is very
poorly named I was doing some cock
tutorials
no no don't stop with the plural
networks we did some neural network
stuff today and then stuff is mostly
just people doing like flashy garbage
it's 9:17 am I talking too loud for the
cloud baby no no see this year you're
talking to a flashy garbage
this is flashy garbage I checked if you
were a subscriber are you gonna write
your own language no I was looking into
our Python today myself cutting Roman
it's all the links I clicked project you
alright six to do the hexagon
[Laughter]
accepting donations there behind into
that realize never in broadcast social
eating category
what's your startup plan Gaussian
processes I mean that's more interesting
now if we're gonna stream or m/l stuff
we're just gonna do more we're gonna
like go back to this paper like the
thing about ml stuff is it like kind of
works always okay so actually where was
I with invertible neural networks we can
we can do some casual stuff while we
figure out what we're gonna do next
stream yeah social meetings overrated
kind of agree with that should I eat my
Apple or if your abdominals can you get
a personal pizza from dominos
that was a miss click in Japanese I want
Domino's Japan but in English an apple a
day turns you gay single pizza to go one
smile was this this answers hope you
know I'm in English language wait for
500 yen I can get English
pick up your order at a Domino's store I
don't they have pizza odds here I know
the Domino's I saw it it's around the
corner place where station named Osaka
wait what
none of the either near me oh that one
maybe it's kinda near me you guys Ted
I'm a member sheesh store
oh sweet yes because it's not really
close to me I'm gonna have to walk a
while to get there um single pizza to go
no thanks wait I don't want any of these
for one person I'm only one person I'm
in the cloud guys don't worry wait I
don't want a pizza sandwich
Pizza menu yeah you you guys actually
sent somebody to meet me at Domino's I'd
be so impressed what no one smile Rach
these are expensive what happened to my
thousand yen Pizza how much calories is
this it's probably too much calories
I see that's why the stream can't be too
popular
giga meat pizza sandwich where you get
pizza sandwich all right we go back to
special order special offers to actually
want Domino's guys you think pizzas and
one looks good but what should we stream
tomorrow let me know and I'll be excited
about it all day and I'll prepare for it
no they had a good but they had a good
deal I don't know what happened to it I
just like the idea of Domino's okay I
want like oh yeah what are you doing do
you paying she look I got a thousand
yen's and we're gonna spend it at
Domino's well tomato rich premium
margarita single pizza to go for pickup
one smile range
see but okay so I don't understand how
oh my god this is so difficult I look at
that ad special offers though but how
come there was that special offer I know
I was like $8 so I hate how do I get
back to that special offer for
joking dominoes browse somewhere
Domino's yeah okay so how do I get the
1,000 yen pizza cuz I'm poor pick up
your order at a doll pickup perk song
Osaka not there from there
that's the one I'm near okay
hey man people of all socio-economic
classes can single pizza to go I
definitely don't want to pizza pickup
single pizza to go now do I get how do I
get discount pizza menu people of all
socio-economic statuses this bullshit
I can't afford these expensive pizzas
campaign pizza does that politics pick
up single pizza to go
pennilyn two pizzas how they really op
selling me on double cheese pan pizza
ultra crispy cheese burst well there's a
surcharge for that crust and award
alright do I actually want a pizza guys
should I stick with you if you wasn't
here guys want to come for a walk we'll
pick up the pizza
no I don't want sides wow really
upselling me here I'm so poor I got
literally the cheapest pizza I can get
alright guys I'm in Japan I'm not
ordering a pizza
that's disgusting I'm gonna eat the
apple and that's gonna be the end of the
stream all right so here's Apple keeps
off the stream I'm not inviting you guys
to pizza look at the size of this Apple
for comparison here's an iPhone 8 choose
an apple and here's an apple they're the
same size do I have I think I have to
wash the Apple I'm gonna go wash the
Apple what do we want to stream next
stream
fool your hands daily expense Snapple $2
in the u.s. mid challenge like slamming
chess were like good challenges
[Applause]
fuck the problem is CTF in project you
lose they don't like when they you
scream their shit
I already did chest chest and go her the
same thing
I'm really bad afford I was this there's
a rotten bit in my Apple companies are
stupid there's people who like rice
together 27 million models believe in
bought for tonight that something
fundamental something on Twitch s or
twitch slam like what could be next
twitch what huh no no I haven't seen any
sex balls I don't know where one would
go to get that I don't speak Japanese
what's Twitter Mary hmm right in NES
emulator that's not fun I've never
written an emulator before well so
what processor guys you know what
language we're writing it in Python
hmm questions like how much bullshit
peripherals are there
yeah I'm really there's our boy what
else okay it's been done tons of times
what else do we have what are they
making yeah I don't want to implement
all the stupid op codes emulated test
engine we brought a chess engine guys I
mean I'm interested in like I'm
interested in like yeah we got on the
slam my game I wrote like a little dev
world for it it's in twitch line now I'm
interested in like proving computation
all right there's apples too big to eat
do you think it's like closed s and put
it in the fridge it's still be good
tomorrow morning
does that Apple is more than one serving
of Apple but it was actually a really
good Apple in the US if you got an apple
that big or tall it tastes pretty
disgusting what's our master hacker what
is our master hacker
know that stuff means now I'm interested
let's let my interests now are in like
provable computation I'm not good at
this stuff though I don't go and write
up that much I think I've seen this
before
their cycle rhythms parsing algorithm
for context-free grammars no we're not
billing shitty hang like things yeah
I've seen this before
pretty cool bro pretty cool Moore's law
and I'm you're late man so marched you
like Misra C no no that's like
automotive bullshit
I mean like like cops are right over
there here where they even go with us I
mean like concert
hi guys to my big one
math
and it takes all the Bitcoin does does
does a good stream no but I so I'm
taking ideas I don't know how you can
send them to me you probably can't so
I'm just gonna think about what stream
is gonna be and we'll do it tomorrow
don't drink tea well I finished the
Bitcoin thing like today yeah you want
to see what uh what CPU my back as I'm
gonna see if it's vulnerable to talk
back to the paper yeah okay we'll do the
paper more tomorrow let's gonna do
tomorrow but for now I'm leaving you
guys going down with us dominoes get the
dollar is Domino's sugar it bros teeth
nice no not really get pizza see you
guys later
WEBVTT
Kind: captions
Language: en
marvluebke: th3dis1Ayy th3dis1Ayy th3dis1Ayy
Izimoney92100: hi hi hi
Iliftmymousealot: what up
hardtarget4: yo
boompowpoq: hey
saintmthw: whatre you eating
justdatobi: Hey
xdarkmaga: hey
0xsam: I’m hungry af
Izimoney92100: wadduuuuup, first time catching you online
asvp_sui: Hey
theGunrun: Howdy
mirceau: Sup Ice Tea Time
hannefuggi: Hi
xdarkmaga: what we doing today?
CasparBaIT: oy
fourhundredtwenty: hi
Fatmetheny: Yoooooooo
speeddrawing101: HELLO
marvluebke: :D
samtheprogram: samtheprogram subscribed at Tier 1. They've subscribed for 10 months!
on111: Pog
fourhundredtwenty: GunRun Clappy
bigduddas: yoyoyo
mirceau: Tea Time ?
epicmegusta12: oyoy
boompowpoq: remember to clean the burger with alcohol first
squiggly_nibba: Dman two days in a row it's a miracle
TheNakedFlame: Hell yeah
i_macuser_i: Hi @georgehotz
CasparBaIT: lol
jbnunn: jbnunn subscribed with Twitch Prime. They've subscribed for 4 months!
NonTrivial778: we need some sovit music
Aehoard: hey George! how are you?
CasparBaIT: &lt;3
blasio115: no :)
beersnbits: you're the man George!
smurfd0: science :)
speeddrawing101: what are you eating?
TheNakedFlame: Consistent streamer PogChamp
bichid69: live stream boisssss
on111: i love watching your youtubevods to learn
prafaeltsantos: &lt;3
phelipe3: dude, I usually watch you on 2x. You're so slow in real life!
icyvran: George have you used Wolfram Language?
Danilok100: we all gonna loose our jobs
RobinMalfait: Hah, I was just looking at your vid of yesterday!
jamesmaloney: You can still eat burgers if you get drunk in the meanwhile
0xsam: Pickles?
mirceau: I missed you George! More streaming 2020 and I’ll subscribe
schrammel: what we doing?
mehmetislicik: SeemsGood
erichtp: we live in a society
hardtarget4: Jebaited
WillGreen98: Heyo
lambdaman0f: im already subscribed :(
samtheprogram: i just moved to san diego, what's good food here post quarantine
Danilok100: capitalism will collapse
Iliftmymousealot: do you still have meat in california?
filipeoliveiraa: heyo
b2kemann: peter schiff was right
inshelootts: right now
aliman_21: hi
henistein: Hi george how are you doing? =D
bigduddas: monkaW
Kertoip007: 1st time watchin u live, cheers George
filipeoliveiraa: monkaS next month
inshelootts: Hello my little broder
dr_set: F society
er_ricotta: what are u doing?
hardtarget4: WFH for the foreseeable future FeelsGoodMan
on111: monkaS
bichid69: whats with the black background hotz, y u racist
inshelootts: ahhh
b2kemann: but washington post told me it was the flu
jordanoBC: what up bro !
anthraxvirus322: cmonBruh
bobda_builder11: what are we doinggg
ScrubLifeChoseMe: eyy
bichid69: its literally called SARS-COV-2 BRO
RobinMalfait: corona is the group; covid19 is the disease, sars-cov-2 is the virus
dr_set: They named corona because they didn't want to called SARS so people would not panic
er_ricotta: 1000 death/day in Italy :(
anthraxvirus322: @robinmalfait 5Head
aliman_21: @georgehotz what if they just decide to end the simulation?
nanodanger7: nanodanger7 subscribed at Tier 1. They've subscribed for 22 months, currently on a 22 month streak! 22
bigduddas: SCAMMM TRAIN
parviz_gc: hi
ScrubLifeChoseMe: @georgehotz what u munchin on?
sambukahot: Hello! You are a professional and this is a very cool motivation for development! thanks👍👍👍
guacDev: jorge!!!!
ido1m: inb4 "man who cracked iphone now cracks coronavirus"
bsx1123: 0.1 for flu is a bit low
fourhundredtwenty: what do you say to germanys death rate then?
BesterGester: https://www.worldometers.info/coronavirus/country/italy/ Look at closed cases
bradfox2: 9.9 not normally age distributed
nvda9: check out bing covid tracker.
dr_set: What about this guy from Stanford saying that we suck at testing and stats? https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/
jamesmaloney: Italy is full of old and oversized people, it's kind of normal
bradfox2: 9.x whatever
boompowpoq: @er_ricotta no mai piu di 500
mehi9h: ooo I missed the streams
robbsalm: cosa?
thecoldwar32: hey
mars4real: Pog
BoxerU: yo
bradfox2: Italy median age much higher than us
anguelov: anguelov subscribed at Tier 1.
vloood: my internet sucks, and i have webpass
robbsalm: i am italian ;) what are you going to do today @georgehotz
fourhundredtwenty: check out germanys death rate
squiggly_nibba: China is lying
icyvran: This is a really interesting topic for a stream
boompowpoq: @jamesmaloney you are talking without actually knowing what is true.
s4j0k5: check Serbia
bichid69: how did we erradicate SARS v1?
vloood: stream keeps cutting out
ISD_Schogol: "finished in china". have you considered that they simply stopped reporting to make themselves look better?
Max_kappa_keepo: Trusting china LUL
prafaeltsantos: Portugal!!!
drparse: if you're 20yo it's flu, if you're 70yo it's SARS
jbnunn: stream's good here @vloood
squiggly_nibba: @bichid69 we didnt it died out
tutnjarko: 99% of deaths in italy had other diseases
blackklopi: almost no cases in russia, iran, irak etc
ackxhpaez: It's a chinese biological weapon people!
aliman_21: irak lmao
er_ricotta: wait a few days and in Germany will be a mess too
SnadderG: Have you looked into the connection between smoking/high pollution and death rates?
mumubecks: Iran has high death rate
yourboibl: yourboibl subscribed with Twitch Prime.
blasio115: @blackklopi they just dont publish anything lol
Edelknecht: "More than 99% of Italy’s coronavirus fatalities were people who suffered from previous medical conditions, according to a study by the country’s national health authority." (Bloomberg article '99% of Those Who Died From Virus Had Other Illness, Italy Says')
bichid69: @squiggly_nibba why/how? I don't remember it being this big a deal
anthraxvirus322: 10iq chat
robbsalm: china's pollution is insane
blackklopi: @blasio115 could be
yourboibl: just got my comma ai sweatshirt and that shit is comfy as hell
nvda9: some countries hiding the actual information
ackxhpaez: I like those odds
n8tfly: Nice duuud
icyvran: Will be alive, not fine
Izimoney92100: WASH YOUR HANDS
Filiadelski: except if you have asthma like me, then god help you
mitsukomegumii: Take a look at the R factor for SARS vs COVID-19
ScrubLifeChoseMe: @georgehotz so if someone gave u 100 skittles and told u 10 could kill u, would u eat some of those skittles
Atlas03: dont eat bats
boompowpoq: healthy individuals under a certain age death rate is the statistic which would be meaningful
ScrubLifeChoseMe: -reddot
a_ato: age * 100
Max_kappa_keepo: Problem is that hospitals get filled up
CompestLive: Hello again
er_ricotta: George where do you live?
SHAVEYY_: mukbang!
mattdougherty22: thanks for streaming
reduf: I'm leaving after the eating stream Kappa
bichid69: Whats the difference between human and bat COVID?
matn1400: What's up
alphagainzzz: where is the burger from?
robbsalm: today a 34 yo healthy guy died with covid in rome
bradfox2: @boompowpoq right
nico_d0t: You're eating fries and my room stinks fries
CompestLive: What if the cheif had corona lmao
Atlas03: i had thai food today FeelsGoodMan
h3ku: There is an interesting article about the death rate calculated based on the cruise ship where everyone was tested, so it take into consideration asymptomatic caseshttps://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/
icyvran: SeemsGood
nvda9: poor countries population gonna wipe out
vloood: Italy has ppl dying all cause cuz hospitals
hastingspb: @georgehotz where burger from?
grenaderaven: i watch on youtube normally, are those vids edited or raw stream
vloood: Up by a lot
dohtem213: George, fuk the burger and let's find cure for coronavirus. you can sell it to countries for billions
liamcaccetta: ahaha what the fuckis happening
smurfd0: this seemed like good papers https://www.reddit.com/r/Virology/comments/fgzuaf/eli5_what_is_the_difference_between_covid19_and/fkazfba/
wateroraqua: yo what are you doing
mattdougherty22: YT is raw
Krakken_TM: rip economy
b2kemann: for c in crisis: freedom -= 1
theonlymonkas: what yi
zgamer0123: Geo i'm from spain i can't enjoy the society
theonlymonkas: what you eating?
nico_d0t: running Comma Ai in cure finding
TheMixStar: so george is now going to analyze the virus? lol
xrealyy: vaccine incoming by geo
icyvran: https://www.wolframcloud.com/obj/examples/COVID19Gene
icyvran: https://datarepository.wolframcloud.com/resources/Genetic-Sequences-for-the-SARS-CoV-2-Coronavirus
wateroraqua: he's hacking coronavirus?
sulphur: what's your draobyek, and yes. I do expect a timeout.
luigifrcruz: SARS-CoV-2 can spread more easily because you can infect someone before you show symptoms. This doesn't happen with SARS v1.
saintmthw: corona ai
charlesz31415: shake shack?
johanoutdoors: monkaS
Spisepower: monkaS
Atlas03: monkaS
dorkmo: george touching every part of his face
SpaceGhost8: *cough* monkaS
64pillars: monkaW
Penguino138: Was that Corona couhg?
khiomtv: monkaS
anthraxvirus322: monkaS
Fulk33: 6000 / 30000 = 20% different
theonlymonkas: monkaS
mars4real: monkaW
TheMixStar: rip george
dohtem213: Geo did Trump contact you for vaccine?
khiomtv: CHAT xqcL_HF
boengels: boengels subscribed at Tier 1.
liranisme: why many years of experience you have?
nvda9: 2% fatality rate
alxhotel: What's cooking?
johanoutdoors: @georgehotz Why didn't you want to stream in 2020?
liranisme: how*
charlesz31415: covidAI
uduver: Hello, hello!
SHAVEYY_: I bet geo doesnt even know his ABC's :)
ScrubLifeChoseMe: LUL
nanodanger7: Choo Chooo HypeGriffin2
ISD_Schogol: *Not yet
boengels: pleasure to be here
Atlas03: LIES
h3ku: There is an interesting article about the death rate calculated based on the cruise ship where everyone was tested, so it take into consideration asymptomatic cases https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/
th3_g3nt3lman: hey George
Iliftmymousealot: nice
ScrubLifeChoseMe: ???
hairybardikles: hairybardikles subscribed with Twitch Prime.
64pillars: is it a beyond meat burger
mitsukomegumii: lul
ScrubLifeChoseMe: lmaoo
samtheprogram: choo choo HypeGriffin2
realolejka: your first rap album almost ready
micos7: I got that sht in Plague inc ,started in China nuked the planet really fast
SHAVEYY_: 69
kiikoh: level 1 hype, otherwise known as "the minimum level of hype"
anthraxvirus322: 1
devm0d: Burgers prevent sars v2
bichid69: is there a vaccine for SARS?
xioph: Hey George, just wondering if the earth is flat?
Krakken_TM: hey gorge so ok lets say this virus needs attention. but what do you think that countries that just before quarantine their borders were open
tajpouria: f yall who separating the virus
finnad: no there is no sars vaccine afaik
khiomtv: touching face DansGame
johanoutdoors: @georgehotz Why didn't you want to stream in 2020? People appreciate you on here.
martinstuessy: ey georgie
kektobiologist: you think it's more than 4 percent? or less?
liranisme: what's the best way to become a hacker?
socialnotsocial: so how awesome are your lungs going to be after recovery?
bobda_builder11: i had influanza type A
SHAVEYY_: *researching corona whilst touching face*
martinstuessy: @georgehotz can we dockerize corona?
bradfox2: look at the net economic impacts of shutdown vs deaths
Atlas03: u buy a hachet and start hacking @liranisme
Krakken_TM: @socialnotsocial in most cases people recover from this with flu symptoms
finnad: you touch your face a lot :D
Izimoney92100: touching ur face YouWHY YouWHY YouWHY
Krakken_TM: its not something fatal
bichid69: @SHAVEYY_ hahahahaha
krilltwitch: https://www.frontiersin.org/articles/10.3389/fimmu.2018.01581/full THIS//
Krakken_TM: its just that transmits so easily
webxl: What was accomplished in pt1??
yourboibl: this?https://i1.wp.com/virologydownunder.com/wp-content/uploads/2013/08/Influenza-A-virus-schematic.jpg?ssl=1
theonlymonkas: nothing
Krakken_TM: that people can overcrowd the hospitals
b2kemann: @georgehotz you should try jupyter lab, it's sweet
SlowlyRunnin: !uptime
25missedcalls: martin shkreli could help now...
drparse: george was washing hands before it was cool
Krakken_TM: and there will be decisions on who gets to live
xioph: are u debugging corona in prod?
TheMixStar: idek what is this
OLEM13: covid-19 is not dangerous itself, what is killing people is the viral load
liranisme: how to become a hacker?
kiikoh: why do these sites look so bad
shanumbra: LUL
Initial18: @xioph We want the bugs in there to prevent Corona from doing what it should be. alieldThink
Iliftmymousealot: they dropped the zero day
derowon: derowon subscribed at Tier 1.
Bo0sted05: what are you trying to do
kiikoh: not even the url is pretty
kektobiologist: they look perfect
Krakken_TM: also guys even if u wear an EFFECTIVE mask make sure u use correctly, not touching the front part with your hands and then scratch ur face etc
theonlymonkas: LUL
SHAVEYY_: because researchers cant write code @kiikoh
nico_d0t: It is called polymerase
DevoE444: covid 19 is a buffer overflow
bichid69: https://www.ncbi.nlm.nih.gov/nuccore/KU922529
peter35_: eat your own batsoup
tiagodopke: looks better than most websites
TheHareld: What is he exactly doing by the way? I'm lost
xioph: myaocat just dmed me thanking u for banning him @georgehotz
webxl: What are the odds an SV hacker saves us from Great Depression II?
Penguino138: Pangolin Soup
nvda9: George types 200wpm
jagger_rsw: based on the case of Germany, where do they the most tests per capita, the mortality rate is ~0.3% - 90deaths / 25k tested
elezaun: What's up? What we learn
TheNakedFlame: crazy how nature do dat
luigifrcruz: Genome for Avian Flu: https://nextstrain.org/flu/avian
Krakken_TM: @webxl none
FSRoosta: Severe conditions are nearly always accompanied by a bacterial pneumonia alongside the virus
harbad: did he you say that the president contacted you @georgehotz ?
nico_d0t: https://journals.plos.org/plosone/article/figure/image?download&amp;size=large&amp;id=info:doi/10.1371/journal.pone.0181969.g001
lexhonecker: George, what's your goal today?
bradfox2: German fatality rate source?
Kubissus: @jagger_rsw they misclassify the deaths thought
mitsukomegumii: H1n1 genbank dump: https://www.genome.jp/dbget-bin/www_bget?genbank-vrl:FJ966082
theonlymonkas: are you working with the goverment?
Kubissus: If you die while having coronavirus and some other illness they will report that you died from the other ilness
Iliftmymousealot: https://www.rki.de/EN/Home/homepage_node.html
xrealyy: the instance of a guy who can become anyone he want in just a matter of days, nice hotz
jagger_rsw: @Kubissus no idea - they probably do tests on those who died - source of data: https://coronavirus.jhu.edu/map.html
champ900: hey george
guacDev: jorge jorge!!!
Atlas03: ofc he is but hes not allowed to tell @cjocol2201
catacata92: maybe there are quite a few variations of flu
theonlymonkas: LUL
b2kemann: top users of internet: 1.trump 2.isis 3.geohot
robbsalm: when an ai expert saves the world
nvda9: it's cool. bing.com/covid
Krakken_TM: in 2017-2018 71.000 people died from flu
h3ku: https://rnacentral.org/search?q=swine
bichid69: stitch em up bro
Fulk33: @georgehotz your not gonna find a single genome for the flue as there are thousands of different viruses. The flue has mutated like a gazillon times
harbad: they don't database the whole virus? weird.
schrammel: what are you trying to do?
Jakobo06: I think that they are typically segmented due to the shotgun sequencing method
alphagainzzz: !commands
alphagainzzz: dam
tarasyarema: hey, do you like advent of code?
Jakobo06: its expensive
bichid69: !commands
harbad: I think @jakobo06 is onto something
djcows: Shoud i go get some fast food before society shuts down completely?
jmp0ut: hey, folding@home stufF?
liranisme: how do I become a hacker?
jmp0ut: biohacking already on ACE codons
jmp0ut: ?
nvda9: who believes that it's biological weapon. bs
Krakken_TM: this virus is an excuse for the greatest depression
Jakobo06: For a highly accurate sequencing you typically use illumina sequencing, which only works for short dna sequences
ad_1337: @liranisme first of all you need a black hoodie
theonlymonkas: @djcows yes
harbad: it's not the flu
cybermajestic: hello hotz
harbad: it never was the flu. people are just stupid.
bichid69: its not the flu bro
myuchelys: 'flu-like symptoms'
myuchelys: not its like the flu
railander: the symptoms at least
bichid69: symptom my arse
jmp0ut: angiotensin-converting enzyme 2 (ACE2)
hypertextlabs: what did you end up getting to last night, quick recap possibly?
Wraken__: pasteur in France got the whole genome @georgehotz
jmp0ut: see metacyc
SHAVEYY_: @liranisme install arch linux to become a true haxor
robbsalm: george how do you know about this shit?
Penguino138: Some on in politics started that BS to make us feel safe
ancientchineseelder: Def ain't no flu
Beldathas: Hello from France ! demOiii
cybermajestic: @georgehotz what are you doing?
gyne: boomers be like it's just the flu
bsx1123: People are saying that because the symptoms are the same
bichid69: not every cough is the flu
ancientchineseelder: Supposedly 700k actually died in Wuhan
socialnotsocial: what are your top picks for second order effects? and top 10 anime battles?
ancientchineseelder: look at the cams online, nobody out there
jmp0ut: @georgehotz check metacyc.org
harbad: Don't believe nothing politicians say.
bichid69: if you cough when you're stabbed that's not the flu
jmp0ut: or EMBL
jagger_rsw: what george is trying to do, I just joined, is he trying to prove sars-cov2 is not h1n1?
zennydmt: will u post these videos on youtube?
theonlymonkas: LUL
Krakken_TM: countries didnt even close borders just before quarantine
Krakken_TM: shit is suspicious asf
xanax_and_bj: When you look at videos of Italy hospital inside, you see almost all of the corona patients are severely overweight
champ900: what are you eating
Krakken_TM: and suddenly every1 is doing the exact same legislations
ad_1337: HHKB Pro 2?
dvdutch: Whatre we doin rn
jmp0ut: https://www.ebi.ac.uk/
jmp0ut: that as well
Krakken_TM: worldwide policy
bichid69: do we have a vaccine for SARS?
risenn_: !uptime
hastingspb: where burger from
jmp0ut: genomics database
catinthepimphat: covid-19 is the disease caused by the virus
xioph: top 5 conspiracy theories?
ancientchineseelder: its 5 AM rn but here's wuhan cameras : https://www.youtube.com/watch?v=Vu4EOyji76s
maxpokerrr: any more cooking streams?
Erixp: covid-19 is the disease right ?
kubaaa6: Can you watch donald trump talk live and reeact to it? Hes talking rn
webxl: Trump was like "the flu kills way more (now)"
gyne: LUL
25missedcalls: can u heck nasa nao?
ancientchineseelder: for anybody interested
robbsalm: an healthy 34 yo died of covid today in rome
painpainmorepain: ليممن تمنبيب منتننتب ﻻهص حهشب
railander: LUL
smurfd0: its probably becase it mimics a flu
bradfox2: try and predict mutations
Crypod: blame Valeant Kappa
dvdutch: Covid19 is the disease, novel coronavirus is the virus I believe
painpainmorepain: يمنن عهبىس
champ900: do you think it will be over in a month
tajpouria: 700 people!!!
xioph: is covid-19 a type of burger?
lidermaury: the government created coronavirus to reduce the population
painpainmorepain: يسي
SpaceGhost8: orange man will save us
painpainmorepain: منني
jijoe99: PogChamp
dvdutch: No cap
TheBusbyBabes: well sars killed healthy people
painpainmorepain: سيشض
painpainmorepain: للر
Penguino138: Exactly
painpainmorepain: صثش
hypertextlabs: "were not watching Donald Trump talk about it"
catacata92: :)) cool
painpainmorepain: يبخؤن
djcows: preach
mars4real: amen
hypertextlabs: ato
sfingrs: And here i am in Serbia waiting for my burger delivery for 3 hours :(
painpainmorepain: صمش
Crypod: Jebaited spam ?
bichid69: can we corona the borona?
hypertextlabs: good shit
joaofoliveira: we do have animal vaccines for covid already
joker2k999: rant maybe?
lawli3t__: Hello from France !
Penguino138: Even my educated brother got convinced it's just a flu.....
anon_v28: why do you always seem like you're on adderall?
osuiw: heyo, just came from the first part on youtube.
guacDev: صمش صمش صمش jorge!
jagger_rsw: I must say US is interesting society, Trump says something, and the whole country doesn't care ;). As in, in Germany Merkel says something, and Germans and EU pays attention :)
robbsalm: hello from rome
zennydmt: have u studied infection diseases before?
Krakken_TM: @georgehotz so whats going on there. is going outside restricted?
railander: my dad is in a hyper state of stress because he can't take his eyes off the news, despite better judgement from me
SHAVEYY_: @georgehotz привет геохот
webxl: Massive stimulus incoming
kubaaa6: If he was on adderall he wouldnt be eating lmaooo
xioph: can we weaponize burgers as a counter attack to covid19?
saintmthw: "im on vyvanze"
Danilok100: we all gonna be jobless
djcows: he's on coffee
bichid69: 721 peeps boissssssss
tarasyarema: go do some advent of corona challenges!
mars4real: eating stream Pog
nvda9: china hid the news
eiscosogin1: because europeans are addicted to government like heroin or crack
bradfox2: build a virus rna embedding nn and see if we can predict future mutations
bichid69: 721 OMG
xrealyy: dont eat shit geo, nutrition foodie only
railander: borgar Kreygasm
tarasyarema: i liked when you solved advent of code
finnad: 8000 cases omegalul
maxpokerrr: trump is master troll
osuiw: !streamtime
ls111: can u eat like that even on adderal?
komocode_: doom eternal
Izimoney92100: is this an eating stream??
otaky152: @shaveyy_ ты сука кто
joaofoliveira: search for the animal covid vaccines already available
Rahleo: everytime i show up food is being consumed
krilltwitch: that burger looked so good!!!
socialnotsocial: thoughts on university?
a_ato: zoraoWUT zoraoWUT
jmp0ut: @georgehotz https://www.genenames.org/data/gene-symbol-report/#!/hgnc_id/HGNC:13557
jmp0ut: target
o______________________k: squadPH squadPH squadPH
osuiw: !UPTIME
joker2k999: LUL
Nafferza: KEKW
djcows: quarantine gang
dvdutch: Does China have a propensity for producing coronaviruses? Including SARS
ancientchineseelder: george smoke some weed
nvda9: some countries are angry at china
harbad: lol, yes they are
64pillars: xqcM 📈
khiomtv: I wonder why LUL
painpainmorepain: ijew
lidermaury: cause everybody is at home
theonlymonkas: lets cook something
xioph: thoughts on covid19 as a SaaS?
hypertextlabs: hack the box
noobaj: @georgehotz how can you expect everyone to understand those paper? just asking
o______________________k: squad4 KEKW
b2kemann: quarantine brooo
RoboticMind90: Lets start coding
Izimoney92100: ResidentSleeper ResidentSleeper ResidentSleeper ResidentSleeper
farlopote: HerbPerve
Fobechi: Were all so bored
webxl: because no one has anything better to do!!
fedman2010: everybody is sitting home watching twich )
lawli3t__: @georgehotz Try do an sql injection into covid-19 and dump the dbs for view his informations !!! NotLikeThis
jagger_rsw: It's like with bitcoin, you make a stream at the right time and call it 'blockchain ai for crypto' and 2k viewers ensured
dvdutch: CaaSaaS? @xioph
Iliftmymousealot: chat is getting real trollish
webxl: They killed sports
khiomtv: KEKW users DansGame
osuiw: @georgehotz whats your uptime?
zombiedigital: @georgehotz build urself a lab and get a covid-19 infected guy somewhere who wants to experiment. LULW
icyvran: There are a lot of people in their homes, that's why many people are watching the streams
harbad: @liranisme obviously you spam a hacker's twitch chat.
kostilin13: europoors taxed to death
fedman2010: what is the best programminglanguage ?
railander: never heard of that one
tome_silva: lung fibrosis
QUOTE_IF_GREEK_IS_GREASY: geohot more like geosexy
dvdutch: Good question
gyne: supposed irreversible lung damage
FSRoosta: nobody knows
happy_havok: @fedman2010 whatever fits your needs the best
khiomtv: @fedman2010 Scratch
bichid69: jokes on you, I already can't breathe at night without a ventilator
Erixp: @fedman2010 there isnt a best one
dysoco: I believe there are some reports of lung scarring but nothing conclusive yet, might only be a few outliers
lawli3t__: @georgehotz Try do an sql injection into covid-19 and dump the dbs for view his informations !!! NotLikeThis
railander: @tome_silva lung fibrosis your life is 2-5 max
SHAVEYY_: @fedman2010 BASIC
Madogstony: wait did you sleep last night?
brofessorbob: North Park checking in.
xanax_and_bj: @georgehotz Do you think Bill Gates is behind engineering this virus?
jmp0ut: answer
l1ttlemtman: 700 people
mars4real: that magic bag has infinite food LUL
jmp0ut: https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
javadragoniv: @fedman2010 machine code, learn 10101010
wpreston: wpreston subscribed with Twitch Prime.
Izimoney92100: TOUCHING YOUR FACE WutFace WutFace WutFace WutFace WutFace
l1ttlemtman: that's insane
gyne: there was a headline going around that it could make men infertile but haven't seen any basis for that
finnad: @xanax_and_bj lol
jmp0ut: angiotensin 2 catabolysis thats why
dvdutch: Teach yourself @liranisme
nvda9: is he in NYC
zombiedigital: there is a conspiracy with bill gates foundation and covid-19
jmp0ut: it's not a conspiracy
theonlymonkas: JOe rogan
jmp0ut: it's genetic engineering
bichid69: jokes on you, I already can't breathe at night without a ventilator
Plurmorant: @zombiedigital event 201 WutFace
brofessorbob: Do you know anybody who has the Covid-19 in San Diego?
xxtrippyhippyxx_: why havnt you streamed in a while???
mars4real: chat WeirdChamp
Rahleo: science and science only :D
gyne: it's the chemtrails broooo
osuiw: that'd joe rogan yo
kostilin13: KKona why not
jagger_rsw: I think george touched his face - hello, police!
Iliftmymousealot: what's the mission for todays stream?
brodie_codie: better question how to be a cyber security analyst
Crypod: later-food is better than now food
Tsoding: monkaS
WEEEEEEEELL_ITS_KNOCC_OUT: WutFace
Madogstony: !uptime
khiomtv: Rationing food PogChamp
emilwallin: WutFace
guacDev: ice cube on floor!!!!
klaazdw: hey guys
Madogstony: rip
Erixp: ice on floor
railander: DROPPED SHIT ON FLOOR!
lawli3t__: @georgehotz Try do an sql injection into covid-19 and dump the dbs for view his informations !!! NotLikeThis @georgehotz@georgehotz@georgehotz@georgehotz@georgehotz@georgehotz@georgehotz@georgehotz@georgehotz
vaskogomez87: soggy fries lol
Izimoney92100: ICE ON FLOOR
robbsalm: he s gonna slip
dvdutch: Ice cube
dorkmo: touchingnface chewing ice
lidermaury: please talk to us
xrealyy: sugary green tea?
shlver: he didn't wash his hands before handling ice DansGame
xXICEW0LFXx: green tea is where it's at
osuiw: @georgehotz you dropped ice on the floor yo
yevheniiushtyk: how do i stop being a noob, george?😞
curlypyoob: how do you get all the DBC files from the car manufacturers
carcharotch: he gonna slip on it WutFace
harbad: lol peace guys, it's just ice
Quad___lol: dropped ice DansGame
hairybardikles: Do you like black tea geo?
bradfox2: Ito en
FSRoosta: wash hands you reprobate
mrhdr: Tsoding sup komrade
osuiw: so your one of those guys huh
railander: dropped ice DansGame
nvda9: sometimes George looks like Jerry from Rick and Morty
theonlymonkas: eminem-godzilla
dvdutch: The floor will soak it up
brodie_codie: study the owasp top 10
jmp0ut: @georgehotz https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
Tsoding: mrhdr, tsodinKomrade 7
socialnotsocial: thoughts on university?
xioph: thoughts on turning covid19 into an ice cream flavour?
tarasyarema: hey solve some challenges here https://adventofcorona.hackersatupc.org/
Erixp: rip wood floor
djcows: Pick up the ice!
jagger_rsw: PS3
bobbyjoeboy: StoneLightning StoneLightning
brodie_codie: then sans top 25
icyvran: What do we talk about?
xXICEW0LFXx: I've been watching archives on YouTube for the past two days straight lol so i"m glad to finally catch a live stream
a_ato: ice
mars4real: LUL
chusiv: Ok so nothing alike the flu, whats next George?
vaskogomez87: its just water guys lol
emilwallin: LULW
wpreston: the chance of damage seems high considering the staff are limiting access to the patients and making less changes to the ventilators than usual.. good article on the current status of a patient's care is https://www.propublica.org/article/a-medical-worker-describes--terrifying-lung-failure-from-covid19-even-in-his-young-patients
miraeldoto: whats goiing on here
Izimoney92100: WASH HANDS
o______________________k: LUL
khiomtv: coughing monkaS
davidbarreroo: !height
Keyeh: heyy george, check childish gambino new album its sick
aptgetmark: is there any courses that you have done that you would recommend ?
brbdontdie: hey george, you social distancing?
marvluebke: @o______________________k what a name :D
guacDev: i will watch the ice cube until it melts
74c55639: @georgehotz do you like the show?
javadragoniv: @georgehotz BRO JARED FUCKED COME ON
SgT_Vimes: Watchu say about Epstein now?
krilltwitch: shoot. he coughed
bobbyjoeboy: CoolStoryBob CoolStoryBob CoolStoryBob
miraeldoto: @aptgetmark are you kidding?
dvdutch: What are we trying to accomplish this stream?
lexhonecker: @georgehotz what is your goal today, George?
o______________________k: @marvluebke squadHYPERS
b2kemann: cold t4a?? i'm gonna make myself a hot one as a demonstration
nvda9: lmao he read it.
ancientchineseelder: Pneumonia usually has permanent effects on lungs. What will be interesting to see how much more severe COVID does or doesn't make it
xioph: @dvdutch pretend we know how biology works
Crypod: MEV-1
64pillars: xqcC FBBlock touching face
jmp0ut: junk dna
KaleSC: yeah, whats the goal today?
harbad: they didn't strip the white space??? lol
Fulk33: https://github.com/Urinx/alphafold_pytorch
brbdontdie: george, you are being a baad role model with your hands touching your face
dvdutch: Build a coronavirus API
mikhailangelo: its only 8 letters who cares 4Head
brofessorbob: trimer
mars4real: hoursW
jagger_rsw: we should notify twitch, he's touching his face
harbad: shut up about touching his face, it's fine.
Tsoding: exploit vector LUL
SnadderG: Any nice people in chat that can tell me why I would use jupyter lab over notebook?
brbdontdie: but its for his own health
Madogstony: cyber
gyne: ace 2 PogChamp
bobbyjoeboy: PogChamp PogChamp PogChamp
jagger_rsw: @harbad trump says it's not
nvda9: George is a good rapper.
railander: mers monkaS
lidermaury: hes not
eyesonlyug: George, what're we trying to do in this stream?
jmp0ut: because you're looking for HCoV-NL63 not COVID-19
Kmerck313: This amazing
harbad: do you believe everything politicians tell you?
Crypod: wow
b2kemann: why itsn't there more biotech in the world?!
brbdontdie: can covid 19 be spread like a computer virus?
champ900: @georgehotz if you met trump what would you say to him
Fulk33: https://github.com/Urinx/alphafold_pytorch
KaleSC: what we doing today?
brofessorbob: Share the link
elezaun: Please clarify Severe Acute Respiratory Syndrome is a Syndrome not a virus. If not related to Corona virus family, What virus does it look like? Shooting the shit.
bichid69: run md on it
Quad___lol: just ask US government for more corona info LUL I bet they can handle you a vaccine as well
brbdontdie: so basically can computers catch the virus?
DrPeacock: people asking "what we doing today" when it literally says it in the title lol
bichid69: molecular dynamics bro
o______________________k: squadCozy squadL squadCozy squadL
dvdutch: You guys think remdesivir will work?
khiomtv: Corona a literal exploit of humans
St47ik: fold them good
Waldoqq: Waldoqq subscribed at Tier 1. They've subscribed for 3 months, currently on a 1 month streak! Wtf I didnt get an alert you were streaming how long you been on for?
catinthepimphat: 3 separate protiens are required to make the spike
robbsalm: what's a protein?
joker2k999: 10mins.
mars4real: @drpeacock bold of you to assume people on twitch read titles LUL
xlionel775: are you going to keep doing biology shit or it's a one time thing?
yevheniiushtyk: yevheniiushtyk subscribed at Tier 1.
harbad: @robbsalm look it up
brbdontdie: @robbsalm its like chcken or steak
bichid69: download the pdb
railander: @robbsalm prob way ahead of you LUL
DrPeacock: @mars4real why wouldnt they lol its a big font?
harbad: you have internet, use google
robbsalm: chill brro
yevheniiushtyk: vibe check
foti_kasparov: Finally able to catch your stream ! Europe gang
robbsalm: i am studying cs not biology
brodie_codie: same
nvda9: ok boomer @robbsalm
brbdontdie: after autonomous vehicles, george is going to create a hospital startup
maxpokerrr: bio hacking george
b2kemann: cs will merge with bio, it's the next revolution
Crypod: so basically we need something that will achieve penetration on this virus only and no other cells. then let white blood cells in?
yevheniiushtyk: @georgehotz so what are you trying to achieve exactly?
brodie_codie: might be right
jmp0ut: you have to sideline an apoptosis routine specific to the virus than the host which is too difficult as your heart will die
harbad: Proteins are what make up most of our bodies. They are made up of amino acids and are the structures that make things work in our bodies.
brofessorbob: This is a waste of time. Let's CTF!
brbdontdie: i could see him moving into creating cyborgs and stuff
Quad___lol: replace proteins with fibre and problem solved
robbsalm: @harbad how are they represented in that genome?
Beldathas: We have the same chair as you in my workplace
catinthepimphat: you need to focus on the closed state when it is outside the cell
jmp0ut: heart break hotel
brodie_codie: CTF SeemsGood SeemsGood
jmp0ut: is what this is
djcows: That ice is melting fast, it will leak in between the cracks of your floor and your house will explode, better pick it up
b2kemann: a to insert cell above, b for below georg...
brbdontdie: @djcows i don't think that's how houses work
tykabmo: well what type of cell does Covid-19 infect?
DevoE444: Is coke cola killing the virus ?
catinthepimphat: identifying a proper epitope to create an antigen from for our WBC to attach to
brofessorbob: Is this a kaggle competition or something?
harbad: the genome is just a collection of codes with start and stop codes with protein sequencing 'codons' in between. Each codon read to create part of proteins.
byte_baron: i hearrd swallowing your toothpaste kills coronavirus?
railander: coughing monkaS
gclawes: ASN.1 is like old-school protobuf
khiomtv: monkaS
bichid69: nah bro kaggle's lame
ToxicVulpes: coronaS
Fastela: So many windows
dvdutch: Proteins have a file type
dvdutch: ?
djcows: @brbdontdie Oh oops my bad
champ900: what do you hope to achieve
Quad___lol: it is spreading through web monkaS
VanishBlox: sup George, how's progress Goin?
catinthepimphat: @tykabmo epithelial cells in your lungs
1shortking: file.protein
iskjmss: guys what came first? the protein or the computers?
socialnotsocial: kaggles for pussies who can't cure cancer
byte_baron: ethernet cables carry the coronavirus apparently
VanishBlox: sup bois
jmp0ut: you dont want covid-19 you want hcov-nl63 which is the actual human variant
emiven: are you using tab nine?
VanishBlox: the DNA
jmp0ut: which is disgusting
harbad: think of codons like like short bash scrips to run small programs.
nudax: nice to see you again
maxpokerrr: if i drink corona bear will i get corona?
brbdontdie: hey goerge, did your computer get its vaccine yet?
zombiedigital: corona hackaton
Edelknecht: Corona doesn't work upside down. So Australia is safe
gabo_sk: hello
brofessorbob: I thought GEO would be on linux.
brbdontdie: you are exposing your pc to coronvirus
VanishBlox: I was just watching the comma ai archive video of it
VanishBlox: of yesterday stream
dvdutch: He probably got linux on a VM
nvda9: imma bout to buy hazmat suit
tarasyarema: ADVENT OF CORONA
FaustPetrovich: FaustPetrovich subscribed at Tier 1. They've subscribed for 5 months, currently on a 5 month streak! 777 people are watching
Keyeh: kek
Erixp: kek
zombiedigital: KEKW
Crypod: KEKW
yevheniiushtyk: kek
djcows: kek
VanishBlox: kek
inDOObitablee: KEKW
dvdutch: KEKW
railander: K E K LUL
harbad: @georgehotz check whitespace
carcharotch: kek
m113v: kekw
khiomtv: DansGame
filipeoliveiraa: KEKW
phrixus_bro: kek oh my god
St47ik: Any new mutations?
brbdontdie: does george play league of legends?
tome_silva: this is a waste of time
monst3rcow: kek MaxLOL
troxtheone: destroy that virus!
VanishBlox: nature is a troll maaaan
1shortking: where is my 144 fps cn3d viewer
dvdutch: The white supremacists made the virus confirmed
VanishBlox: GAY
harbad: they aren't identical
St47ik: MrDestructoid
maxpokerrr: KEKW can cure corona
Crypod: curvyHmm hmmm voltron
harbad: they are different, only in structure.
osuiw: I was thinking more like Megatron
yevheniiushtyk: voltron LUL
nvda9: ctf
osuiw: looks more like a jet
VanishBlox: GG
DevoE444: is Corona a form of Ligma?
railander: GG
Erixp: ggg
brofessorbob: Glycine? Brah
lexhonecker: George, I think you will need to get PyMOL for displaying the proteins correctly
foti_kasparov: That's a nice looking protein
VanishBlox: corona virus is epic gamer guys
Jakobo06: Barcoding maybe
osuiw: @DevoE444 nice one dude
lexhonecker: That's what the pros use
tauzN: @DevoE444 ligma what?
TheHareld: What in the actual fuck is he doing? Does he have biology degree or something or?
bichid69: get chimera or nglview
harbad: like normal prions vs mad cow prions, they are made up of the same thing, just folded differently.
St47ik: the whole worlds is in chaos cuz of 8 kb of genetic data NotLikeThis
Crypod: alright, which one of you made this virus? that's twitch-speak right there oshiMad
bichid69: nglview bro, integrates with jupyter
harbad: slightly different folds
brofessorbob: It's called a trimer.
pomprocks: is this like figuring how how a computer works by measuring the size of the chips?
ragemaster999: @georgehotz what are you trying to do?
logi6000: impossible he's streaming!!!
brofessorbob: https://en.wikipedia.org/wiki/Protein_trimer
maxpokerrr: any coomers?
1shortking: wow
nvda9: it's 3 .30 am here
Erixp: PogChamp
icyvran: What are we going to do tonight George? George: The same thing we do every night, Watcher. Try to take over the world.
VanishBlox: I'm a zoomer
dvdutch: "try-mer"
toast_ps: l
socialnotsocial: thoughts on university?
toast_ps: L
Quad___lol: MEAT SPIN
bichid69: ngL
dvdutch: Trimmer has 2 "m"s
Draco401: ngL
shlver: LUL
yojana57: what's happening now?
Keyeh: OMEGALUL
cutza: lol
bichid69: ngL lol
govlog: u should fuzz the coronavirus syscall to find a kernel rce
dvdutch: We gon cure this before the stream ends
viper262_: NGL view
Draelios6: NGL VIEW bro
VanishBlox: MrDestructoid
lidermaury: im just here for u guys in a chat
Waldoqq: NaCl?
robbsalm: we got this
jagger_rsw: @georgehotz just fuzz it :)
yevheniiushtyk: first corona jailbreak when?
1shortking: u codemonkeys sure know a lot about biology all of a sudden
Crypod: Not Gonna Lie View Kappa
pomprocks: biology is like alien technology that we are always trying to figure out how it works
VanishBlox: not gonna lie view
dvdutch: not gonna lie
nvda9: does corona die in high temperature
VanishBlox: fuck u person for saying it before me
Crypod: LUL
b2kemann: jupyter lab!!!
harbad: "this mac sucks" love ya @georgehotz
murkythunder: @1shortking codemonkeys made an algo detecting cancer better than any doctor, we masters of everything
mumubecks: nvda9 no. summer temps wont help us. check it out
法國人: People playing animal crossing onTwitch right now. Meanwhile George Hotz trying to cross-over things
Usisuvach0: @nvda9 yes at 56 C or above
m113v: @nvda9 yes thats why go in the oven
Fastela: @nvda9 I've read it does, for temps higher than 70 degrees celsius
Fastela: 56? ok
Usisuvach0: yes
Usisuvach0: 56
logi6000: are we gon find the cure
nvda9: i thought it's rumor
Krakken_TM: 56?
xeroeffect: Do you have enough toilet paper?
Krakken_TM: i heard 22 KEKW
bichid69: restart the kernel
dvdutch: Will you not end the stream until we find the cure?
jmp0ut: medium chain fatty acid sidechaining?
Krakken_TM: fkin missinformation
jmp0ut: a human can manage
djcows: Just warm the earth up and corona will go away
harbad: buy a bidet, tp problem fixed
jmp0ut: a virus cannot
mumubecks: not just hand washing. Put hands in boiling water
shlver: just cut off your handw
theonlymonkas: LUL
Krakken_TM: @mumubecks no hand washing is enough
Svr123456789: Hey science !
logi6000: we all know he's just doin this cause that porn star said she'll fuck whoever finds the cure
Krakken_TM: but u have to do it right
Krakken_TM: for 20s
gabo_sk: what is he doing?
dvdutch: Who @logi6000
VanishBlox: you guys know that death cures the virus right?
eaterenrgy: @gabo_sk Saving the world
liiiiiig0: PogChamp
Xent12: @logi6000 lmao which pornstar said that
harbad: oh, that's cool as hell!
St47ik: PogChamp
TommyBates97: where you all from chat?
dvdutch: pog
Crypod: wow nice
gabo_sk: oh cool
logi6000: look it up @dvdutch
TheMoatman: What library's doing that vis?
Erixp: PogChamp
klaazdw: POG
Jehhred: This is some next level Data Science!!!!!
eaterenrgy: Pog
NewManSD: PogU
theonlymonkas: Kreygasm
b2kemann: &lt;3
jmp0ut: which pr0n star is pushing for proteomics
alphagainzzz: Kreygasm
zol0: WayTooDank
Draelios6: Pog
jmp0ut: i love her already
lidermaury: twitchslam   coronavirus?
phelipe3: you're clever AF
VanishBlox: Kreygasm Kreygasm Kreygasm Kreygasm
xanax_and_bj: You should work for Bill and Melidna gates foundation
o______________________k: squadQ squadQ squadQ squadQ squadQ
DevoE444: there is no cure for any virus cause all viruses transform
nvda9: 80% people will recover
Kmerck313: Wait which pornstar?
gorgai: I dont understand anything PogChamp
Draelios6: No FFZ FailFish
xeroeffect: Who’s brain is that?
Beldathas: Pog
SgT_Vimes: So, is this...biohacking?
St47ik: twitchcoq   twitchcov
dvdutch: Nvm she ugly
shlver: we need you full screen
alycia: first time live in what 6 months ???
Svr123456789: Are you trying to learn to the corona virus to drive a car ?
logi6000: @gorgai look it up
theonlymonkas: LUL
MownarN: First time here excited to see u stream George! U made me way more interested in programming than I already was
icyvran: 848 viewers
PiroFloydian: oh hey he came back
yevheniiushtyk: that's a lot of ice
joker2k999: LUL
brofessorbob: How's Corona in SD? Is it as bad as the news makes it to be?
pomprocks: i think this is the learning to type part of learning to program
carcharotch: quick reminder that ice cubeis still melting
m113v: how can i donate you @georgehotz
St47ik: NotLikeThis
emiven: What is we haced.. the coronavirus... :O
theonlymonkas: ice cube
harbad: they bind to receptors, for those who don't know. The 'spikes' stick out of the viral body and attach to cells. Then the virus injects it's genome into the cell.
Crypod: we need a magnet monkaS
railander: ice cube PunOko
dvdutch: Get the tablets out
robbsalm: let's eat some zink
s3bastians: @georgehotz Hello! You are the self-driving car guy, right?
Erixp: eat zink monkaS
Tsoding: The ice cube is almost melted :(
oanto80: please buy a descent mic
iskjmss: shame they made the titanic out of zinc
myaocat: test
Draco401: This dude LUL
gabo_sk: monkaHmm
brofessorbob: Comrade Tsoding is here
osuiw: the mic is fine
TheMoatman: Suck on some coins, they have plenty of zinc
myaocat: im unbanned PogChamp :) &lt;3
harbad: no
harbad: lol
Tsoding: @brofessorbob, monkaS
Keyeh: descent LUL
DevoE444: eating zinc after burger, i can see the irony Kappa
hastingspb: they made it out of sink
Iliftmymousealot: l-theanine   caffeine stack?
gabo_sk: coronaS
GeneralSoak: no we need more zinc
brofessorbob: I hear Russington DC is well this time of year.
jmp0ut: because it works on angiotensin 2 enzyme catalysis for transcription
logi6000: for everyone asking whick pornstar it's Lola Taylor
lidermaury: its almost 900 people
jmp0ut: you janky biohacker bruh
dvdutch: Did u guys hear the titanic sunk
snorting_milk: snorting_milk subscribed at Tier 1. They've subscribed for 7 months, currently on a 7 month streak!
harbad: capsid - the shell body of the virus
nvda9: George that chair is good?
Draco401: @dvdutch Really!?
luismario0o: I don't know what he is doing..
jmp0ut: biology does not work on logic gates it works on resource efficiency
byte_baron: @dvdutch fake news
dvdutch: Yea look it up
tykabmo: @georgehotz can you go get me popcorn and a diet coke?
Draco401: No way
champ900: lets see some hacking
jmp0ut: hydrolysis
St47ik: @champ900 biohacking
brofessorbob: It's biology
Cas_9: I think you should start with an introduction to Biology course
alycia: what exactly is he doing ?
Tsoding: @alycia, he's hacking Ligma-19 PogChamp
St47ik: @alycia saving the world
gabo_sk: hacking coronavirus
theonlymonkas: do you use zinc to prevent hair loss?
salz_pfeffer: I'm in for the intro bio with you
harbad: @georgehotz they are differently folded, each protein is made up of the same pieces, just folded differently
robbsalm: great idea
railander: lets see it FeelsGoodMan
alycia: Is he using Corona science to jailbreak ?
jmp0ut: @geohotz check this: https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
brofessorbob: Central Dogma of Biology. Do you know that?
wootawee: phylogenetics/evolution of molecules
Darian141: @georgehotz love ur content bro! keep up the great work!!
mumubecks: Why no hacking for cancer or aids? corona hype train?
nvda9: It's Deep Dive in Corona
marvluebke: wat
marvluebke: LUL ^
theonlymonkas: LUL
gabo_sk: x d
logi6000: we all know that @georgehotz is just doing this so that he can fuck that pornstar that says she'll fuck who finds the cure
brofessorbob: Cancer has too many causes to ever have a singular cure.
robbsalm: LUL
lidermaury: what was it
iFAK: @georgehotz please jailbreak covid19 and rescue humanity. Would ultimately love to run unsigned code but stopping it would suffice. Cheers from Canada m8
DevoE444: @Quad___lol good observations keep going Kappa
salz_pfeffer: ah the python example
Okayge_TeaTime: one more "xD" and im out 😡
barrenaps: Is this an open source project?
theonlymonkas: xD
Darian141: xD
Nedeljko99: Marko Njegomir je PICKA Marko Njegomir je PICKA Marko Njegomir je PICKA
gabo_sk: xD
marvluebke: xxxxxxxxxDDDDDDDDDDDD
lidermaury: xd
VanishBlox: xD
cutza: xD
DevoE444: xD
Darian141: xddddd
iskjmss: xD
gyne: xD
St47ik: bring back XD
nvda9: xD
VanishBlox: xDd
djcows: xD
railander: @brofessorbob well did you see the discovery published earlier this year? seems very promissing
yevheniiushtyk: xD
Nedeljko99: Marko Njegomir je PICKA Marko Njegomir je PICKA Marko Njegomir je PICKA Marko Njegomir je PICKA Marko Njegomir je PICKA
gabo_sk: Dx
djcows: y u so cute xD
St47ik: Cx
VanishBlox: dicks
gabo_sk: ¯_(ツ)_/¯
gyne: so why would more zinc mess with the molecule
dvdutch: link @railander
bichid69: I hate biopython its shit
SgT_Vimes: ”Python tools for covid-19”, that was my initial idea too!
mumubecks: why is the marking text all the time?
brofessorbob: @railander Which study?
outlier2: josiah zayner has a bioengineering course: https://www.the-odin.com/bioe101/
byte_baron: dude, just ml the cure already man, people are dying
VanishBlox: marking text means you hack better and that's a fact
socialnotsocial: that ice cube still hasn't melted, pretty much proves global warming is a scam
railander: @dvdutch @brofessorbob https://www.nature.com/articles/s41590-019-0578-8
byte_baron: machine learn the cure!!!
theonlymonkas: LUL
robbsalm: wutt
Erixp: LUL
harbad: lol I thought you loved it!
gabs2819: LUL
dvdutch: thankls
bichid69: exactly my poiny
dvdutch: thanks
abnerrrrr: hello george &lt;3
bichid69: biopython is shit
jmp0ut: yes
jmp0ut: https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
liiiiiig0: PYMOL @georgehotz
shlver: what are yo utrying to do?
Smube: hack the stock market
1shortking: LULW
Erixp: LUL
foti_kasparov: noobs
canpake7: Damn, didnt even finish the first part
socialnotsocial: thoughts on university?
triple__m: ban him
theonlymonkas: not me
St47ik: The world is collapsing NotLikeThis
SHAVEYY_: ban time PogChamp
TheGpSd: Hi
railander: @dvdutch @brofessorbob it cured all cancer tested on rats
theonlymonkas: ban LUL
numlox: numlox subscribed with Twitch Prime.
gyne: wyd b 😳
wpreston: https://coursera
VanishBlox: what are you trying to accomplish?
sal_gent: the disrespect level is rising Kappa
ragemaster999: @georgehotz https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
Kmerck313: BAN
DevoE444: Greta Tunberg has the cure, you heard it here first
dvdutch: Too bad covid will kill us all before cancer does @railander
logi6000: everybody gangsta til geohot gets the ban hammer ready
railander: monkaS @dvdutch
VanishBlox: 😳
brofessorbob: @railander Thanks for sharing. I'll have to take a deeper dive
matn1400: &lt;3
SHAVEYY_: you should go to fortniteburger.net
Erixp: its a &lt;3
b2kemann: covid is the new ban
harbad: protease is an enzyme
harbad: it breaks down proteins
robbsalm: oh shet
dvdutch: Dont go to that site
railander: @brofessorbob for laymen, scishow did a video on the paper
法國人: it looks like all it wants is love :D
VanishBlox: what are you trying to accomplish George?
0xC3301: 0xC3301 subscribed at Tier 1.
SHAVEYY_: @VanishBlox monkaS
GHFear: coagulating exception descriptors
0xC3301: 0xC3301 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 1 in the channel!
0xC3301: 0xC3301 gifted a Tier 1 sub to jagger_rsw!
harbad: protease enzymes are also used to separate strands of dna or rna to be transcribed
1shortking: @VanishBlox goodnight sweet prince
0xC3301: 0xC3301 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 2 in the channel!
0xC3301: 0xC3301 gifted a Tier 1 sub to jaegerbott!
0xC3301: 0xC3301 is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 3 in the channel!
theonlymonkas: me
0xC3301: 0xC3301 gifted a Tier 1 sub to Jadess!
gabo_sk: anygifters?
Crypod: J smol MiniK
St47ik: protease enzyme for breaking down of proteins
klaazdw: w0w
iskjmss: knutOil
PistolPetez: i dont want a sub
gabs2819: Pogchamp
BrodatyWhiteBear: @gabo_sk You can be Kappa
法國人: @0xC3301 please don't gift me a sub, I try to keep my account vanilla
ipo___: Anything groundbreaking yet?
nvda9: !
railander: dodged EZ
CompestLive: I want a sub haha
canpake7: Where we at right now?
champ900: are you afraid of the heinekenvirus
torukmnk: torukmnk subscribed with Twitch Prime.
VanishBlox: I want a sub
samthedogg: I wanted a sub to this
smurfd0: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1000589
foti_kasparov: https://github.com/jorvis/biocode
VanishBlox: I want a tasty sub sandwich
robbsalm: ahahahah
railander: goatse WutFace
Atlas03: rooAww_RB
ragemaster999: @georgehotz https://www.ncbi.nlm.nih.gov/gtr/genes/59272/
samthedogg: I get notifications when he streams
bichid69: dude, surely run some md
Atlas03: Kreygasm
bichid69: try jax-md
nvda9: George should make more music
robbsalm: it looks like death
bichid69: it looks cool
法國人: are proteins always symmetrical ?
St47ik: they're really like little bio-machines
Jadess: :)
St47ik: MrDestructoid
harbad: proteins are almost never symmetrical
ipo___: I wish I could read all text simply by double clicking... these cyborgs
keith282: @ragemaster999 we were looking at ACE2 yesterday
ProtoLambda: watching python streams instead of writing python, living the live, lol.
o______________________k: squad1 squad2 squadOK squad200
harbad: viruses usually have symmetry for structural strength, otherwise they wouldn't survive harsher environs
法國人: @harbad don't they tend to be ?
railander: what? pretty sure they have
railander: its been promoted everywhere
harbad: no
Usisuvach0: i just don't get it how it stays so long on surfaces
brofessorbob: Anyone know anybody in San Diego directly infected with Covid-19?
zangerxx: why is ubuntu better then windows ? is it only for vim ?
nvda9: I'm getting the walking dead vive here. people are wearing hazmat suit.
Backrub: biometrics
DevoE444: we need to inject the female covid 19 to kill it Kappa
gclawes: @georgehotz they have started folding@home covid projects, they just don't have a dedicated category for it yet
Crypod: what is Linus folding for then? monkaS
Backrub: do you get a notification on your phone when your password is used??
cutza: they have, it is under "any disease"
sal_gent: @georgehotz they told users to put the client in Any to help with COVID-19
Penguino138: Linus just started folding COVID
St47ik: Java DansGame
foti_kasparov: Java GUI sucks
0xmilan: 1st time I get to watch this live. it's 11 PM here
gclawes: if you run the folding agent you'll see covid work units come through
Fundlak: java FeelsOkayMan
gclawes: but you can't select for it yet
phrixus_bro: love java
Tsoding: Looks more like GTK  🤔
o______________________k: JAVA :D &lt;3
NaT3z: How much does George know about these topics before beginning a project?
info303: they should advertise foldingathome on twitch for all the gamers to help out with covid-19
supnerdstv: whats he doing?
Nawelz: that cpu sound LUL
railander: noise PunOko
法國人: Java :D
info303: all those video cards
1shortking: its gonna blow monkaS
iGalactic: monkaS
Erixp: plague inc monkaS
robbsalm: nice
o______________________k: MAC B LUL LUL K PR LUL
gabo_sk: monkaS
samthedogg: a professor from my college made software for folding protiens
on111: monkaS
railander: yes LUL
samthedogg: https://ifestos.cse.sc.edu/software.php
lidermaury: who is monakS
KhanDesi: how do I play this stream at 2x speed?
edu4594: yes
Fundlak: yes
Erixp: yes
toast_ps: yes
gorgai: Yes
robbsalm: yes
javadragoniv: oh yeah
champ900: yes
marvluebke: yes just a little bit
Klairm_: How you doing during the lockdown? @georgehotz
joker2k999: looks like it.
ls111: i hear a fan
shlver: blue yeti nice LUL
djcows: it's fine
gabo_sk: FeelsGodMan
toast_ps: spit some bars george
Atlas03: its the same u use for asmr
Backrub: i have that too
GPlay97: GPlay97 subscribed with Twitch Prime.
emotional_baggage: &gt;really nice microphone
railander: i think the issue is your apartment accoustics
TheBusbyBabes: CPU? i thought that was a plane taking off
ragemaster999: rapper btw LUL
perzibes: -380
gabo_sk: FeelsGoodMan
wainemier: started
emotional_baggage: &gt;blue yeti
Nawelz: sounds like when my IDE is indexing files
SHAVEYY_: rape?
astr0nils: just find the vaccine already bro OMEGALUL
GoOnAli: blue yeti PepeLaugh
lidermaury: blue yeti is overrated
ICAntF331MyFAce: @railander 👈
djcows: get a seperate streaming pc
robg_10: whats harder hacking chrome os or corona
法國人: does he use zsh ?
harbad: What is interesting about viruses is that they are the only thing (almost alive) that has symmetry. but only in capsid proteins. spikes are not symmetrical, the genome is not symmetrical.
prafaeltsantos: @o______________________k it'a rlly old MBPR
St47ik: protein machines
wpreston: sounds like internal mic to me
1gonyali: I hearing the air sound now :D
c0alman: :D
brofessorbob: You should connect with your boy Siraj. He's been diving into bio hard.
ipo___: CPU cooling down
alycia: after this stream corona is defeated
bichid69: try ambermd
IndoPridePinoy: how do you know they are not using all those video cards to create another virus?
ragemaster999: the crypto miner is still running
gabo_sk: can you rap about coronavirus?
dvdutch: So CRIPSPR Cas9 is the future of healthcare
zangerxx: what is he trying to do ?
keith282: trap trap bernie sanders trap
VanishBlox: BAN BAN BAN BAN
cutza: ban
ipo___: what a botnet
Loutlot: Loutlot subscribed at Tier 1.
canpake7: Click on the siri icon to get the fan to speed down CarlSmile
VanishBlox: BAN
St47ik: isn't that for the Anti-virals
thickbordiga: turn on the WH press briefing just announced 100% tariffs on all trade with China
cockwizard69: monkaS
railander: monkaS
o______________________k: LUL
brofessorbob: You can block Ace2
jmp0ut: but then your heart stops
harbad: that's the easiest way to prevent the virus from replicating..
TheBusbyBabes: monkaS
cockwizard69: monkaS 👇
jmp0ut: so that doesnt work
DevoE444: does viruses have sexual orientation? KappaPride
gabs2819: monkaW
keith282: @zangerxx we're making a vaccine through python, only subscribers get it
GoOnAli: ive realised its physically impossible to code without touvhing your face
railander: @jmp0ut Jebaited
o______________________k: squadKey squadA
djcows: Hey Siri, find a cure for coronavirus
Klairm_: how you doing during the lockdown? everyone k?
dvdutch: stream animal crossing instead
zangerxx: @keith282 thank god im a no vaxxer anyways
matn1400: it does
lidermaury: everybody gangsta till ban
harbad: stopping spikes from binding with cells
tome_silva: worms
Waldoqq: @thickbordiga fake news
Crypod: so soap is just a bunch of warms?
Erixp: PogChamp
gabs2819: LUL
railander: PogChamp
Crypod: worms*
jmp0ut: why do you think ACE inhibitors are given to cardiac patients
gabo_sk: cool
robbsalm: hell yeah
kurokodairu_: Soap just takes away the fat thats holding together the virus .-.
yevheniiushtyk: why not just inject soap into your bloodstream?
WaeHaKe: PogChamp
maxpokerrr: so we just need to inject soap?
GoOnAli: git pull vaccine EZ
klaazdw: lol
theonlymonkas: LUL
harbad: lol sounds great
FurikuriYugi: Hey what's up buddy long time no see hope you've been good
topped123: hey george what are you doing
VitalyzedTv: LUL
railander: vaccine confirmed PogChamp
St47ik: git clone vaccine
socialnotsocial: thoughts on university?
dvdutch: github gon save the world
champ900: what are you doing
Wolvey: push the vaccine already
1ntegral_: git clone ...
keith282: git clone geohot/vaccine
iFAK: pull requests??? @georgehotz
railander: clipped and shipped
meemukeisariktk: what are you doing? @georgehotz
ipo___: I just joined ... is it true you made a vaccine???
logi6000: @georgehotz are you just doing this so you can fuck that pornstar that says she'll fuck who makes the cure
bichid69: take a shot of fairy liquid
on111: time to make pull requests for this vaccine
xrealyy: fuck off corona
alternatemule10: what are u doing
VitalyzedTv: hes developing a virtual vaccin
Kaotavn: WhAt ArE yOu DoInG?
Zipzipcekirge: soap the seas and let it rain soap easy cure
法國人: @topped123 he is creating a vaccin in Python
Crypod: oshiThink i see
b2kemann: WE ARE DRINKING TEA
xrealyy: fuck off corona get them soap
yeah_haey: can you find human 0daysq
alkiiis: where is the repo :)
c0alman: Pog
foti_kasparov: Do a vaccine with soap then
el_pirulote: @georgehotz i am a believer
tome_silva: vaccine
iFAK: any edgy forks?
Penguino138: loll
TheNakedFlame: Then put a non-sharing licence on it
jmp0ut: phospholipids
alphagainzzz: @logi6000 source?
harbad: it's from the host's cells
t_lokus: IBM had some protein simulation runs and they published some results I think
maxpokerrr: @georgehotz will i get corona if i drink corona bear?
St47ik: break the lipid membrane EZ Kappa
ragemaster999: the crypto miner is still running
1gonyali: SSSsss haa whaatt :D
theonlymonkas: T E A
brofessorbob: M == Membrane
THX1342: hello... how's the sciencing going
Atlas03: HTATS LEWD rooBlush
dvdutch: My dad said we should make an inhaler that just sprays lysol into your lungs
harbad: the lipid bilayer is from the host.
wpreston: Free course on the basics for those that need it https://www.coursera.org/learn/covid-19
nvda9: virus r just lifeless thing
joker2k999: oh man... lol
Kaotavn: same lol
NaT3z: Lol he's like a hacker Jeff Goldblum
railander: im learning FeelsGoodMan
St47ik: MOAR SOAP
法國人: that looks like a giant orgie to me
Crypod: that's why it's 20 seconds. give the soap more time!
railander: 4Head
21_savior: soap PogChamp
emotional_baggage: i feel like a monkey watching videos like this
joeyskitkat: Everyone safe back home George?
o______________________k: OMEGALUL
iFAK: SOAPPPp
viper262_: true
Penguino138: They're legs dancing lol
zol0: 4Head
Erixp: 4Head
cutza: so we just need a vaccine with soap
o______________________k: 4Head
Cornflays: LUL
canpake7: wait what
Akash_44: 4Head
Nawelz: 4Head JUST
h3x1e_: just inhale soap 4Head
St47ik: 4Head
snorting_milk: LOL
tome_silva: gg
champ900: EAT SOAP 2020
1gonyali: it looks like worm :D
murkythunder: start adding soap to every recipe
Atlas03: inhale soap u mean @georgehotz
theonlymonkas: LUL LUL
alkiiis: Genius
foti_kasparov: VACCINE WITH SOAP
ragemaster999: this guy is a genius PogChamp
canpake7: that does not make any sense
marvluebke: inhale soap = helth
gabo_sk: 4Head
logi6000: @alphagainzzz just look it up
zombiedigital: lmao carona cured "inject soap2
shlver: our cells also encased by bilipid membranes
St47ik: Inject soap 4Head
robbsalm: snort soap
PiroFloydian: No we need to INHALE soap
1ntegral_: Even better smoke soap
info303: do lines of soap
saintmthw: soap vapes Pog
o______________________k: just get better DUD 4Head
mrhdr: u die
gyne: intravenous soap drip PogChamp
brofessorbob: That's just crazy enough to work.
Crypod: big bwain
VanishBlox: EAT SOAAAP LUL OMEGAAA
djinnieee: Eureka!!!
Erixp: WE FOUND THE CURE PogChamp
railander: we found the vaccine PogChamp
joker2k999: lol
b2kemann: smoke soap
theonlymonkas: LUL genius
yevheniiushtyk: that's what i said NotLikeThis
brofessorbob: Inahle soap
saintmthw: soap vapes PogChamp
zol0: vaccine spotted PogChamp
kurokodairu_: Just use soap gas PogChamp
St47ik: almost 1k views PogChamp
Klairm_: do you remember demonhades from teamhades? @georgehotz
法國人: inject soap in your blood XD
Fantasma56: JUST DRINK SOAP BRO 4Head
THX1342: drink liquid soap. check
ipo___: what pornstar was that? Kappa
snorting_milk: Snort soap!!
harbad: viruses are somewhere in between alive and dead, they do have metabolic properties, but only inside a host.
inDOObitablee: LUL
Zipzipcekirge: someone in my country ate soap with yoghurt and got sick :d
o______________________k: PogU
Crypod: LUL
Wolvey: LUL
Tsoding: LUL
Akash_44: LUL
Nawelz: this looks fishy 4Head
VanishBlox: INJECT HERION SOAP
Jehhred: EVERYONE STOCK UP ON SOAP!!!!!!
1gonyali: Soap injuction :D
Erixp: LULW
info303: wrap it up boys, we did it
dvdutch: My dad is literally trying to make an inhaler that sprays lysol into your lungs lmao
mj315: LUL
railander: coloring book FeelsGoodMan
C3r0C3r0C3r0: C3r0C3r0C3r0 subscribed with Twitch Prime.
jmp0ut: http://physicell.org/
brofessorbob: Well once in your body the virus envelops itself and hides in your cell.
PiroFloydian: SOAP VAPES
Penguino138: Is smoking weed during COVID times dangerous?
keith282: where's methhead mike? he would love that coloring page lmao
Loutlot: yay subbed
theonlymonkas: paint it
b2kemann: soap destorys the fat covering the rna
tome_silva: do something else
FurikuriYugi: [for l in m: c.append(soap)]
ipo___: GEORGE HUTZ
fireposeidoncx: @georgehotz is the waffle maker still available?
railander: the solution is driking tide pods after all LUL
o______________________k: squadOmega squadOmega squadOmega
Usisuvach0: @Penguino138 if you are at home it should not be
socialnotsocial: thoughts on university?
DevoE444: soap is patched by avast Kappa
VanishBlox: where is the github page for cure I wanna pull request
nvda9: washing your hands with cocaine cures corona
melike0009: @1gonyali selamin aleyküm
yrreseason: I wanna do hackintosh, is Hackintosh Gay ?
St47ik: LUL
0xC3301: Tide Pod Challenge 2020?
THX1342: LUL
eazyxlan: Favorite OS for coding?
smurfd0: thats fairly basic, was your hands with soap.. we was taught that when we were 1 year
iFAK: fuck they were on to something
Akash_44: LUL
PiroFloydian: THE ZOOMERS KNEW
canpake7: Are we building a self drinving anti covid-19 cell?
St47ik: Also bleach then Kappa
Crypod: actually don't do that yet, chat monkaS
lidermaury: dont make friends with people who dont have an iphone
yevheniiushtyk: 1k views almost Pog
joker2k999: sketchy breakdown?
AJVGAMES: omg its geohot
dinxpoy: great now they're gonna empty tide pods off the shelves
Penguino138: @Usisuvach0 but will it affect my lungs ability to fight it if I eventually got it?
theonlymonkas: temple os
lordFOE: Is that why little kids are safe from the Corona?
lordFOE: They been suckin down tide pods?
iFAK: I JUST WANT TO BE PURE
SnadderG: I bet bleach would kill the bacteria that resides in your throat
cutza: tidepod shortages incoming
s3bastians: https://www.quora.com/If-soap-is-so-good-at-killing-coronavirus-COVID-19-then-why-dont-people-eat-soap-to-kill-the-virus sorry for long link
1gonyali: We move up Soap Injection from Sql Injection LUL
Usisuvach0: @Penguino138 last day i smoked weed was yesterday, and it might make you more vulnerable i am not really sure
harbad: ubuntu, mac, and windows are easily the best because of the community for beginners. But if you're serious, stick with Ubuntu or Mac.
melike0009: @1gonyali la gardaş sen hayırdır
Usisuvach0: but still smoking at home and alone
1gonyali: hi honey @melike0009
Usisuvach0: and not being in contact with others
brofessorbob: Soap injections wont work because a majority of the virons in your body is inside your cells.
Usisuvach0: i think it's ok
VanishBlox: next we start overflowing the DNA of the virus
Penguino138: @Usisuvach0 Been on a week break a bit out of paranoia. I go to the store rarely but if it takes up to 2 weeks to infect me....
brofessorbob: Review https://www.technologynetworks.com/immunology/articles/understanding-the-lytic-cycle-what-are-the-steps-310621
法國人: I think by ubuntu he means linux
edu4594: btw i user arch
melike0009: @1gonyali hi
foti_kasparov: "you wash your hands with soap, which makes your hand slippery, causing the virus to fall into the sink and down the drain."
VanishBlox: I use win 10
1gonyali: what a nice place ha honey? @melike0009
sondreal: sondreal subscribed at Tier 1. They've subscribed for 8 months! yes
Klairm_: do you remember demonhades from teamhades? @georgehotz
nvda9: he doesn't post anything on twitter but has a verified account
harbad: Windows is okay, just gets in the way sometimes.
ELEMENTiQ1337: finally i catched your stream
aknaveg13: Just watched your interview with Lex Friedman
xxdvxx: What if we can use accelerator instead of killer? That mean faster symptons and more quarantine.
Usisuvach0: @foti_kasparov not only that but soap kills the outer membrane of the virus
b2kemann: cmd is bad though
THX1342: @georgehotz did you put that notebook on github?
liiiiiig0: !uptime
Usisuvach0: so it won't be able to survive or spread anymore
gyne: E
St47ik: E
Nopy1: Are coronas spheres, and not 2D-crowns/halos/rings?
zol0: TRUE LUL
railander: E
dvdutch: E
joker2k999: he's been live about an hour.
Tsoding: If it compiles it works PogChamp
St47ik: Any Truers LUL
liiiiiig0: @joker2k999 thanks
logi6000: just skipped online school
zol0: any budget true lulwers LUL
xxdvxx: What if we can use accelerator instead of vaccine? That mean faster symptons and more quarantine.
nvda9: why am I watching this? it's 3:54 am here.
VanishBlox: if lua then print("best language") end
t_lokus: idk much, but IBM supercomputer got some combinations to get in-between the "pre-fusion spike": https://science.sciencemag.org/content/367/6483/1260.full
o______________________k: @nvda9 making a cure and posting it on github :)
Klairm_: do you remember demonhades from teamhades? @georgehotz
ELEMENTiQ1337: ELEMENTiQ1337 subscribed at Tier 1.
harbad: BOOM
bichid69: wait, what do these proteins do?
1gonyali: bizim işler böyle işte @melike0009
Landowner555: YES
Erixp: PogChamp
murkythunder: re Pog
St47ik: PogChamp
gabo_sk: Pog
edu4594: lul]
sondreal: PogChamp
edu4594: lul
railander: PogChamp
neogloom: Pog
Coraxxi: 5Head shit
edu4594: LUL
harbad: You got it @georgehotz
VanishBlox: pog
iFAK: POIFECT
Usisuvach0: i don't know in which way computers will help fight the virus, there are lot of tests that needs to be done
railander: vaccine soon bois PogChamp
theonlymonkas: DansGame
St47ik: Biohacking confirmed PogChamp
khiomtv: CTF it
luismario0o: can coronavirus turn into a good person??
joker2k999: making his own covid-library lol
gyne: integrating the coronavirus into the blockchain PogChamp
railander: D:
melike0009: @1gonyali eyi eyi
harbad: hahaha!!!!
ICAntF331MyFAce: alkXD
robbsalm: ahahah
gabo_sk: LUL
mj315: LUL
thebiggaeboi: if his programming does something with this virus im going to be impressed
St47ik: CTC Capture the corona
VanishBlox: LUL
Klairm_: do you remember demonhades from teamhades? @georgehotz
robbsalm: savage
cutza: are you going to rebuild it so it kills people more effectively?
thebiggaeboi: im also very lost
saygan_: what's my man working on?
Aecxlol: !uptime
Crypod: more cross-field collabs are needed to solve world problems
Usisuvach0: corona virus is obfuscated :D
Quad___lol: import Vaccine, Bio from CIA
railander: monkaS 👉 cutza
joker2k999: he's looking for 'something cool' in the genome of the corona'
harbad: I know where you're coming from @georgehotz . I'm a CS grad with a minor in biology, bio students don't tend to be super sharp
iFAK: git pull vaccine
Kmerck313: ^^^^Bann
VanishBlox: @saygan_ making a cure and posting it on github
Fulk33: @saygan_ making a vaccine for covid19 and putting it on github
nvda9: good night.
BrynjolfTwitch: Hey George! What you are coding?
St47ik: @nvda9 gn
Usisuvach0: trump is live
logi6000: from CIA_DATA import covid19-plans, vaccine
Klairm_: do you remember demonhades from teamhades? @georgehotz
luismario0o: nmmmmmmmm,,.............,,,,,,,,,,,..---------
Killeraing: why are videos only for subscribers?
harbad: reverse engineering covid-19
Erixp: hes making a cure and posting it on github :)
railander: the glyco 4Head
Crypod: it's sweetened?
VanishBlox: @brynjolftwitch a cure to post on github
Waldoqq: trump address on now @georgehotz
St47ik: @Killeraing you can find VODs at comma ai archive youtube channel
dinxpoy: @BrynjolfTwitch the man is literally coding a vaccine and putting it up for free because greedy companies dont wanna do it themselves
THX1342: I think glycoproteins are proteins   fat
theonlymonkas: twitchslam
St47ik: isn't glyco sugars?
harbad: true
Samplafied: FrankerZ
railander: you DONT listen to mr trump? 4Head
iFAK: whatcha drinking??
yevheniiushtyk: Not enough ice! LUL
iFAK: oj?
razr22: glycogen
joker2k999: lol not twitchSlam.
socialnotsocial: thoughts on university?
VanishBlox: THE HOSPITALS ARE A SCAM! BUY TVS
SnadderG: When are you running for president?
dvdutch: If you wanna become a populist listen to him
St47ik: This is TwitchCoV
konradmad: lmfao!!
edu4594: https://twitter.com/OrwellNGoode/status/1240276031682097154/photo/1
railander: trump is funny at least LUL
iFAK: XD
gabo_sk: this is mr robot 2?
MacoNighto: what is he trying to do ?
dvdutch: Vermin Supreme couldve stopped COVID
iFAK: yet Biden is getting the nominee
St47ik: Twitch-CoV-2
theonlymonkas: THE COQ FILES
Micazeera: Hi dude, you can look this? I'm brazilliam developer and i wanna know what to improve the codes https://github.com/Micazera/CoronaVirus
harbad: hey @georgehotz you're my hero, lol
noxpppp: @georgehotz what are you talking about ???
LaneBoyR6: Hack trumps accounts and take him down :D
murkythunder: hes so dumb he cant lie
ideology_sniffing_raccoon: Kappa
Crypod: he doesn't lie. he thinks it's the truth KEKW
Biniano7: Would you be able to make a program for trading stocks?
railander: you cant lie if you dont know the truth LUL
logi6000: yo Biden is all of Trump's bad parts but creepy. like pedo creepy
ideology_sniffing_raccoon: He does lie
meeeeeeeeeeeeeeeeeeeeeenz: could you tell me why are you doing this? just bored in quarantine?
zombiedigital: kkonavirus-19
dvdutch: He could definitely make that
joker2k999: m-16 = shits getting real.
harbad: he's very old fashioned business, that's all
Crypod: we just need someone he likes to feed him the truth
mascer95: just because it's the truth in his mind, doesn't mean it's not factually incorrect...
SHAVEYY_: if trump made linux we'd all be using linux
VanishBlox: Donald trump is biologist confirmed
jagger_rsw: @mascer95 depending on definition of "fact" :)
Crypod: that's a nasty question Kappa
St47ik: almost 1K views
socialnotsocial: thoughts on university?
railander: i think he's just really stupid
harbad: ambulance?
logi6000: @shaveyy_ but Linux would have a 200 dollar license
yrreseason: George wtf are you doing right now
ELEMENTiQ1337: dats true
DecayingSkullz: HDR is freaking out
logi6000: @georgehotz those sirens are the Marshal's with the m16
Penguino138: George is making a vaccine to upload on github
mascer95: I believe if you actively avoid the truth to not be lying... it kind of makes it lying... just my two cents
harbad: reverse engineering covid-19
KhanDesi: lol come on, he objectively lies. Obviously, he also believes his truths. But he also lies
Jehhred: I wish I knew that in school. I can't be an labelled wrong if I'm ignorant'
Crypod: yuuuge
railander: monkaS 👉 @logi6000
St47ik: Yuge
gabo_sk: reverse engineering the coronavirus aka save the world
St47ik: Hugh Mungus
Danilok100: trump does not care about the truth
Pasha_Pechkin: stop politic plz, letz hack the corona
murkythunder: TRUEEE
Crypod: oshiThink i see
Klairm_: do you remember demonhades from teamhades? @georgehotz
theonlymonkas: LUL
mascer95: @jagger_rsw of course it depends on the subject. but there are quite a few topics where we have a factual truth (usually science)
VanishBlox: The police are coming George, we are doing too much bioterrorisim
railander: although they should LUL
St47ik: NotLikeThis
harbad: it's all about getting into your head and giving you what you want.
harbad: feeding you a line and drawing you in.
VitalyzedTv: THATS TERRIBLE REPORTING LUL
fwef64: can someone get me up to date with what's been going on so far?
mascer95: @georgehotz I believe if you actively avoid the truth to not be lying... it kind of makes it lying... just my two cents
Penguino138: SAD
jagger_rsw: @mascer95 i don't want to get into philosophical discussion of truth :), but the only thing everyone can probably agree is the law of excluded middle, everything else is pretty much conventional :)
harbad: the world is overreacting @fwef64
dvdutch: It entrapment
St47ik: Reverse engineering politics Kappa
foti_kasparov: Media sucks amn
railander: ye but that's what he signed up for as president, some people need that assurance
harbad: that's what's happening.
tornix98: did trump pay off a pornstar?
railander: it's a panic
Mlewii: you should actually debate destiny
thebootystrangler: how you gonna reveal
St47ik: but the fear is when it mutates NotLikeThis
klaazdw: lol
pomprocks: it's probably spreading a lot faster than they realize
Crypod: re-engineered SARS?dun duuun
sl4ckerman: !uptime
Kyoto_o: death rate is not low, 300k  to 10k  deaths was 4.5% yesterday
SnadderG: who hasnt payed off a porn star
alycia: he is close to a vaccine
gabo_sk: monkaS fbi
Crypod: LUL
jmp0ut: if they put it on paper how is it not considered prostitution
railander: @Mlewii i don't think he cares about what anything destiny has to say
gyne: sars 2 electric boogaloo
Kmerck313: Lol you would too
FurikuriYugi: fear weekends your immune system
jmp0ut: it's a strange juxtaposition
peter35_: that 'deep state dept' line the other day was hilarious
dinxpoy: it's pretty serious when ppl in their 60's die because they have something simple like hypertension
mascer95: @jagger_rsw tell that to the scienctists working on quantum computing. law of the excluded middle will just be another convention :P
Kyoto_o: is it low to fixed number 7b people on earth, yes, is it low to total amount of 300k? no
pomprocks: there could be 300k people infected. or 3 million. they don't know
osuiw: @Crypod TARS !?!?!
FurikuriYugi: *weakens
viper262_: out of closed cases 13% deaths
Loutlot: legit asmr
THX1342: reports from doctors is that with treatment, people are relatively fine. but while in treatments things are BAD.... like coughing blood felling like you are drowning and needing to be restrained, bad.
logi6000: did he wash his hands?
foti_kasparov: @sl4ckerman Not Modbot found :P George hates bots
Crypod: *flushes and washes*
Nopy1: why not use IDA pro instead of that jupyter BS CarlSmile
Dai_Vern0n: he's he on adderall ? we seem's so active and productive
esence: imagine being a virus and getting cucked by based Georgy
astr0nils: He washed his hands Kreygasm
Penguino138: Count for 20 seconds
thebootystrangler: how u gonna reverse engineer a virus
VanishBlox: covid devolves it's spreading points and then invests them into lethality 😳😳
dorkmo: only washed hands for 10 secondss
gyne: not 20 seconds!!!!!
tornix98: he lied about paying off a pornstar
Crypod: @osuiw MARS monkaS
hawsh: he didnt wash his hands
Tornyl: hello george
harbad: @georgehotz Covid-19 could fix social security issues for the US. I do know that.
joker2k999: lol
GODaruu: the death rate is just low at the moment, its still an ongoing situation so it will change once we get to the end
socialnotsocial: thoughts on university?
logi6000: he washed his hands
gyne: george hotz is cancelled
jagger_rsw: Not being US-person, the interesting thing about the current wave of trump-like statesmen (bolsonario etc.) is that previously presidents could be shown as role-models for kids. Now, not so :)
1gonyali: microphone is very very good maannn :D :D :D
gabo_sk: wash your hands
foti_kasparov: Didn't wash hands
St47ik: With more infection and spread the rate of transcription errors can make it mutate NotLikeThis
Mlewii: @railander yeah probably, i would just love to watch it
gabo_sk: please
xrealyy: the problem with this is spreading like chat said, numbers might increase really fast, people are dying in their houses due lack of space in hospitals ;&lt;
Biniano7: @georgehotz can u make a program trading stocks with high percentage gain?
Voctolm: it's important to understand how he reacts to it
erichtp: touching face monkaS
esence: wash hands? Do you guys pee on your hands?
Crypod: he did wash his hands. i heard it
harbad: @georgehotz this virus could fix social security issues for the US. I do know that.
railander: dont touch face monkaS
joker2k999: pee could be the cure...
Jehhred: Brad Pitt: 'Well uh, from my multi-million dollar mansion, I have no idea..'
theonlymonkas: 12 monkey
railander: not 20 secs monkaS
zombiedigital: @georgehotz whens the cure ready
recursive_x: still looking up adrenochrome ?
dj_vicio: what??? 20 seconds!
ELEMENTiQ1337: get your hands out of your face george monkaS
Leon_Trolltsky: @biniano7 of course he CAN, will he? Idk. For you to use? Likely not. Haha
logi6000: Geo did you buy Bitcoin. prices are good now
gabo_sk: f
NicksizAdam: @georgehotz hi george, an offtopic question, i'm bored in fkn house and wanna make self-driving application by screen capturing of a racing game called crew 2 by ubisoft. do you have any suggestion as a starting point?
VanishBlox: George has the virus guys😔
theonlymonkas: or is it
peter35_: if the IC spooks hate trump he's can't be that bad
ICAntF331MyFAce: :O
mascer95: @jagger_rsw i agree. and i don't really want to discuss it any further. I also find George rather inspiring. I just find his statements of the past few minutes rather questionable...
yaus_baus: wew
Fundlak: &lt;20 = deth monkaS
theonlymonkas: :0
BrynjolfTwitch: this is the part two of corona project right?There is a video about this on the comma.ai YouTube channel
liranisme: @georgehotz how do I become a cyber expert?
gyne: when a mommy protein and a daddy protein love each other very much...
THX1342: @georgehotz did we figure out how the quine works? how the replicating section of the code makes the rest of the virus?
dinxpoy: cray how nature do dat TriHard
dvdutch: we gon break 1k viewers
logi6000: @nicksizadam sentdex did something similar with GTA. look it up
harbad: all of the green spikes are viral, the rest are left over from the host cell.
dontusethiscode: Remember when @georgehotz made that cooking stream. The birth of Corona
harbad: for the most part.
Gr3ybearddd: @liranisme study cyber security topics..
dj_vicio: how's this program be used?
theonlymonkas: GTA 6
Fundlak: the protein printer go brrrrrr
logi6000: xd
j3ckerd: What's @georgehotz IQ?
NicksizAdam: @logi6000 yeah but it works poorly
railander: it is different than flu but demoraphic most affected are elderly, especially in risk of death
harbad: glycoproteins are usually markers with carbs on the end
saixj: appreciate the streams keep up the good work
VanishBlox: INSERT MAGENTA
Famousix: !commands
railander: 40 or younger very low risk
St47ik: sugars
THX1342: I would guess the fatty "shell" is the glycoprotein
logi6000: @nicksizadam he did that on purpose. it was made to be like a gta player would drive
Penguino138: Almost 1k viewers guys!
socialnotsocial: thoughts on university?
foti_kasparov: This is the first step of reverse engineering the simulation
THX1342: forgot the name we learnt yesterdat
St47ik: they say it already had mutated once and there are two strands already
harbad: the envelope is from the host cell
dvdutch: Make a public repo @georgehotz
jmp0ut: it tricks the body into thinking it's sugar
xrealyy: is this channel gonna hit 1k live viewers for the first time?
logi6000: look up fluid mosaic model
Nopy1: ah, so high fructose glucose proteins now wtf.
viper262_: 1k
Penguino138: 1k
Nopy1: use real sugar
jmp0ut: then slips in with the sugar
jmp0ut: like a porn star
jmp0ut: in my bedroom
b2kemann: remember the time there were news papers AND gossip magazines?
harbad: @georgehotz the 'copy machine' is the genome itself.
champ900: 1K viewers POG
recursive_x: wouldn't take long if something similar was made
VanishBlox: I want to have sex
murkythunder: `it would be really helpful if you had a bio friend to ask these questions to to give you the faster answer than googling
pedrosantos867: are he for real?
harbad: it doesn't kill the cell right away.
dvdutch: The COVID cure will be written in Swift
Penguino138: 1k
VanishBlox: it's deepfaks
harbad: it blebs off pieces of the host membrane
lordBzzl: automatons being automatons to other automatons
GHFear: It would be safer to write it in Rust @dvdutch
dj_vicio: that's how the flu medicines work. they risrupt the copying mechanism.
bichid69: 1k viewers boiiiiiii!
dj_vicio: but coronavirus is not very similar to the flu
THX1342: You could also break the virus' keys so they can't get past the cell's door (i.e. breaking the spike)
Kyoto_o: you have to be a virologist
avgandrew: !uptiem
brittonx2: cells immune to exploit is the way!
dj_vicio: unlike what news say (lie)
avgandrew: !uptime
railander: i dont think "bio" is enough to know this shit, probably have to ask a virologist
harbad: it applies to all viruses
Crypod: can the virus survive in a body with high blood alcohol? curvyHmm
theonlymonkas: PixelBob
r3mote: welcome back :-)
dvdutch: *Novel* coronavirus
GHFear: @Crypod no
murkythunder: yh hotz would be like a hacker friend, he needs a bio friend which is like a version of him, but into bio instead
St47ik: ACE2 receptors are used for people with hypertension to reduce blood pressure
Kyoto_o: would you monetize cure if you have found it? @georgehotz
harbad: but covid-19 itself is a membrane-bound protein.
theonlymonkas: 1K
dontusethiscode: @Crypod yes the virus is an alcoholic
bichid69: isn't the whole thing the capsid?
Crypod: LUL
Hawklite: how do you tell the "copy machine" to only not copy corona cells instead of all cells though?
logi6000: well what if instead of doing all this work. we just hack the CIA
mascer95: @Crypod yes. It does not enter the blood as far as I know
railander: 1k viewers PogChamp
fwef64: How certain are we that he decoded the DNA correctly?
logi6000: it would be easier
NicksizAdam: @logi6000 i also tested a pretrained model that gives predictions as degrees but cannot convert the output to discrete classes, "w", "a", "d", properly. i have degree to pressing time conversion problem
b2kemann: covid: twitter: datascientists assemble!
knickerbockerr: What is he doin
Crypod: interesting
GHFear: @Hawklite the copy machine is in the virus, not the body.
bravech: bravech subscribed with Twitch Prime. They've subscribed for 2 months!
harbad: reverse engineering covid-19
Penguino138: The copy machine is in the office
BrynjolfTwitch: !time
jmp0ut: every cell membrane does
VanishBlox: @knickerbockerr he is making a cure to post on github
knickerbockerr: Pogu
dj_vicio: is he RE it or creating a program ?
dontusethiscode: 1k viewers pog stream
mascer95: @fwef64 I would say pretty certain. Otherwise the development of tests wouldn't have been this quick
jmp0ut: cytosolic fluid hacks
pedrosantos867: !uptime
St47ik: @georgehotz ACE2 receptors are used for people with hypertension to reduce blood pressure so it's not easy to stop the exploit NotLikeThis
railander: @knickerbockerr finding a vaccine and posting it on github PogChamp Kappa
FargioFarmani: finally am catching a livestream!
THX1342: @georgehotz that image under replication ilustrates the 3 main parts of the code. 1 creates the envelope and 2 create the capsid (from what I understood)
Nedeljko99: Marko, uloguje se Marko, uloguje se Marko, uloguje se Marko, uloguje se Marko, uloguje se Marko, uloguje se
lordBzzl: seemingly simplistic machinery
o______________________k: anyone buy the mac pro thoughts ?
Betazz: do you think the virus mutates?
saixj: are you going to reach out to any pharmaceutical companies if you find some good leads
Lizardan: @o______________________k it's great
jmp0ut: @georgehotz look up cytosol
Tramb0x: brief tinder
deep5: what machine is he using
harbad: @georgehotz the virus is encapsulated by the bilayer from the host, which protects it from the environment. the bilayer is also how it tricks the host cells to pull it into them.
railander: all viruses mutate quickly afaik @Betazz
Betazz: oh
FargioFarmani: I have the 16' and its great!
inexitu: the virus does mutate
o______________________k: @Betazz mutates everytime it enters a new hosts i believe
Usisuvach0: @Nedeljko99 sta ti je bre mentalen eden
Usisuvach0: sto spamsh ti ebam facata
logi6000: let's just hack the CIA instead. copy the cure. and also while your in just find the aliens locations
jmp0ut: find my location
Crypod: @o______________________k get slightly higher spec than you need. don't want to get stuck with a machine u can't upgrade when chrome decides it needs more ram
VanishBlox: so we can clap alien cheecks
jmp0ut: signal hack and life memories being sidelined for pennies on the dollar
logi6000: @vanishblox you already knew it
jmp0ut: brainjacked victim
Fundlak: he is already watching through your camera :)
pedrosantos867: Which keybord are you using?
Betazz: dayum tho New York's the epicenter just like division predicted
theonlymonkas: BAN
harbad: once inside the cell, the membrane is shed, the genome is then activated and the viral body releases enzymes to break down the host dna and begin making replicating.
ShakDiesel: LUL
railander: !specs
法國人: @pedrosantos867 read the bio
mascer95: @pedrosantos867 pls read the rules
pedrosantos867: I'm sorry
harbad: enzymes** i forgot to say
Crypod: !bio
theonlymonkas: LUL
bichid69: these may be proteins already in the cell
deed02392: do you have an end goal in mind or is this just for curiosity sake?
St47ik: @georgehotz attempt to stop the exploit https://www.bmj.com/content/368/bmj.m810/rr-2
Nedeljko99: @Usisuvach0 sry bro
logi6000: hack the CIA instead and get the vaccine
Klairm_: when did you started this? @georgehotz
ELEMENTiQ1337: pepeHmm
o______________________k: @Crypod nah im not going to get one. was just curious. 6-8k is insane IMO but I wish :)
bichid69: I dunno I'm just a chemist not a biologist
vaskogomez87: @georgehotz can you unlock the vods for people that can subscribe pls?
gyne: ??? it definitely does
Crypod: @o______________________k even better LUL
harbad: the virus hijacks the host's replication
vaskogomez87: *cant
logi6000: from CIA_DATA import vaccine, alien_locater
法國人: !uptime Klairm_
seffieinsane: can i give u a suggestion. can u just look into how our own body does not kill itself :)
mascer95: @vaskogomez87 I believe most of his VODs are uploaded to youtube
squiggly_nibba: @vaskogomez87 commaiarchive on youtube has all the vods
Ozonemaster: there are a lot of reasons to take rna and write rna
法國人: nvm
seffieinsane: our body can take care of the rest
avgandrew: @logi6000 KAPPA
Klairm_: @法國人 not this stream, where did he started researching about covid-2019
St47ik: attempt to stop the exploit https://www.bmj.com/content/368/bmj.m810/rr-2
harbad: no, canada
noobaj: LUL
Ozonemaster: Ur cells use RNA for the creation of any protein
vaskogomez87: @mascer95 @squiggly_nibba wow, thanks guys
railander: they stopped naming pathogens after real places
法國人: @Klairm_ pretty sure he started from this stream tho
seffieinsane: @georgehotz look into how to body reacts and stop it from killing then the virus will get stopped anyway
Klairm_: @法國人 and what's the actual goal?
St47ik: using ACE2 inhibitors like in ppl with hypertension
lidermaury: ban me
Apocalyptic0ne: https://www.sciencedaily.com/releases/2010/05/100528210736.htm
Lizardan: I have a feeling George is going to end up enrolling in Med School after this
jmp0ut: you would have to use an ACE blocker and synthetic sugars to survive as well as fluid breathing equipment
Betazz: viruses and antibodies
logi6000: @klairm_ to find the cure so the pornstar will fuck him
jmp0ut: PFC ventilator
jmp0ut: fluid filling the lungs is not fun or cheap
Klairm_: @logi6000 what xDD
o______________________k: squadCozy squadL
railander: @Lizardan nah that's not as interesting as AI
法國人: @Klairm_ sorry I think he made a stream yesterday for 4 hjours, Just trying to understand more how the virus works I suppose
smurfd0: kinda weird, like Sars, didnt really hear much about that besides some elite athleats got killed by it...
liiiiiig0: LUL
Lizardan: @railander true
Crypod: just go to udemy LUL
St47ik: ScamSchool
jmp0ut: its a scam by oldie foldies
o______________________k: pay 400k in debt Pog
Fundlak: LUL
jmp0ut: fuck that noise
Orestes13: LUL
theonlymonkas: LUL
lidermaury: med school and law school are cool
jmp0ut: just become a porn star
recursive_x: lmfao
deep5: LUL
jmp0ut: and launder money
Square___: guys, what is he doing lol
Muzyd: PREACH
jmp0ut: what pr0nhub?
inDOObitablee: Ban
St47ik: Medicine in python
aleman578: nice
logi6000: @klairm_ a pornstar said that she'll fuck who find the cure
harbad: agreed, that's why I'm not in biology anymore.
theonlymonkas: BAN
socialnotsocial: thoughts on university?
AndreiKnight: sit down sherlock
Betazz: agreed
AresD7: They found medicine in Japan: avigan, seems to be working
dj_vicio: fuck doctors
ideology_sniffing_raccoon: ???
aleman578: hi
jmp0ut: what about just brain in a box living cybernetic fantasies
d3adb33: finally I join live from Germany! Nice to see it live!!!!!
railander: vaccine on github soon PogChamp
jmp0ut: or coming to life for war
o______________________k: squadOmega squadOmega squadOmega
murkythunder: cure the coronavirus (python tutorial)
Kjjj11223344: Hell yeah!!
yaus_baus: 3d printed vaccines
Smube: u cure corona yet
dvdutch: Open sourced COVID
re1mond: Hi, Tony Star!
yaus_baus: yeet the corona away
Penguino138: @Usisuvach0 So should I avoid smoking for a few days/weeks until COVID blows over? I'm in Idaho only 30-40 cases so far
inDOObitablee: @Square___ hes making a vaccine and postingit on github
jmp0ut: have you seen engineering yeast to produce opiates thoug
gogenhub: Thats what im trying with my startup: https://genhub.co/
dvdutch: Make a COVID library
Leon_Trolltsky: Genius
socialnotsocial: thoughts on university?
jmp0ut: you can create more heroin than afghan in a week
VanishBlox: hey George I found a YouTube video by the WHO on how the virus works https://youtu.be/dQw4w9WgXcQ
dj_vicio: doctors live to scam people with vaccines and insurance $$ . Hackers are the real heroes!
jmp0ut: it's already done
b2kemann: print infinite burgers
Usisuvach0: @Penguino138 i won't smoke for 2 weeks from now on
lordBzzl: thought emporium always pushing the bar
AresD7: Search for Avigan
Betazz: even coding how to make machines smell
Usisuvach0: i am from Macedonia 115 cases so far
railander: Jebaited
Usisuvach0: 30 new today
Betazz: LUL
jmp0ut: chinese labs produce heroin for so dirt cheap it's throwing all of CIA's efforts down the drain
法國人: LMAO
Akash_44: Jebaited
klaazdw: lol
liiiiiig0: LUL
ideology_sniffing_raccoon: LULW
bokeee_: LUL
St47ik: LUL
youngsachi: LUL
Snowlav: Jebaited
jmp0ut: no more drug moneys
Digital_donger: :tf:
harbad: nice
deep5: KEKW
Nyt1k: Jebaited
PiroFloydian: Jebaited LUL
Penguino138: @Usisuvach0 So basically wait till the voluntary quarantine blows over then re-analyse?
harbad: very nice
logi6000: XD
foti_kasparov: KEKW
smurfd0: &lt;3
Greaser_1: :-)
St47ik: LUL LUL LUL
Muzyd: GOTTEM
VanishBlox: GOTEM
b2kemann: loool
Julll: LUL
Kustex: hehehe
xxdvxx: GOTTTTEM
THX1342: YES!
Crypod: Clap Clap
recursive_x: lol
ideology_sniffing_raccoon: Jebaited Jebaited
logi6000: let's fucking go boia
deep5: Clap
Usisuvach0: @Penguino138 who knows man
AresD7: U know about avigan @georgehotz ?
Rairden1: the 2012 BBC doc (life inside a cell) is excellent
THX1342: I linked his channel dozens of times yesterday :D
o______________________k: squadOmega squadOmega squadOmega
FurikuriYugi: PJSalt
lordBzzl: what happens if you get Copper ions in your body
THX1342: glad you watched ity
Usisuvach0: just don't smoke
Digital_donger: he hates us Jebaited
dvdutch: LMAO
Crypod: it's not even April 1st wolfCry
Usisuvach0: repair your lungs a bit
jmp0ut: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4924617/
St47ik: always check the link LUL
Betazz: this is getting out of hand tho
VanishBlox: 4Head 4Head 4Head 4Head
abhinavneelam: what you engineering now?
lordBzzl: Copper is bad for viruses and such
Penguino138: @Usisuvach0 I don't NEED to I just wanted to make sure I wasn't being paranoid instead of safe
re1mond: !uptime
jmp0ut: Complete biosynthesis of opioids in yeast Stephanie Galanie,# Kate Thodey,^ Isis J. Trenchard,^ Maria Filsinger Interrante,^ and Christina D. Smolke^*
Kustex: can i get corona through this stream?
Penguino138: @Usisuvach0 Thanks of course
bravech: HahaHide
gogenhub: i meant turning biology into information tech
jmp0ut: gang gang
Apocalyptic0ne: "For example, the SARS virus also requires a lipid-rich environment for its replication, so her lab now is working with SARS researchers on determining what lipid is necessary for that virus's replication." https://www.sciencedaily.com/releases/2010/05/100528210736.htm
dvdutch: Should I do my homework due at midnight or help cure COVID with geohot?
Usisuvach0: well like i said i smoked yesterday
Crypod: can we make the zinc rust and break off? oshiThink
th3_g3nt3lman: TheIlluminati
Usisuvach0: but today no
DevoE444: @georgehotz hows is the virus react to PH
pedrovictortech: What's the actual goal?
SHAVEYY_: geo creates virus
TheBusbyBabes: you dont have it D:
re1mond: !up
SHAVEYY_: sells the solution Kappa
Usisuvach0: i spit all the mucus that creates the smoke today
Usisuvach0: and i feel a bit cleaner
noobaj: is there any data on people who've recovered/immune to the virus?
lordBzzl: nanobot with a copper backpack
SHAVEYY_: no
jmp0ut: hire robots to package and sell all the drugs and rig them with heavy ordinance as well as self replicating and fabricating more to hold them together as well as beryllium plating the facility so that radar has problems penetrating it
Betazz: create a virus to kill the virus
Penguino138: @Usisuvach0 I don't get that crazy of mucus from smoking weed
SnadderG: No proof that you go immune @noobaj
jmp0ut: see a black box with robots do not go near it
JLO_: wa hassan mach m followi
icyvran: Mutations
lordBzzl: @Betazz that's an idea, what happens after?
Usisuvach0: it's nasty @Penguino138
jmp0ut: it's a nuke spot
theonlymonkas: saint laurent
Penguino138: @Usisuvach0 Maybe get a filtered bong and slow down :p
Klairm_: there are people that got infected again after got recovered btw @georgehotz
Betazz: @lordbzzl I dk LUL
logi6000: George so when is the military coming with the M16's due to marshall law
THX1342: can you share this notebook right now @georgehotz ?
recursive_x: how long to learn the codes
jadams: ratirlSalute
Usisuvach0: ok @Penguino138 but here i smoke joints
stuartlz: @Klairm_ Fake news
Penguino138: @Usisuvach0 Yeah joins are much harsher. But we should probably all avoid any form of it till we have more clear answers.
PiroFloydian: so basically hes translating covid19 to code so he can hack it
Usisuvach0: yeah
THX1342: LUL
Klairm_: @stuartlz not fake news dude, happened here on spain
Usisuvach0: i am stopping to smoke
yaus_baus: machine learning powered molecular synthesizer for psychoactive drogs
harbad: @georgehotz the best way is to stop the virus by inhibiting its glycoprotein spikes from attaching to the receptors that start host cell endocytosis.
lordBzzl: @Betazz could be an issue...
Usisuvach0: i got some weed on aside
THX1342: smashing that stripped ELF
Usisuvach0: hidden good
bebytesback: This is serious some of the best content on twitch, Thanks @georgehotz
habituss: Hey, I just got here, can someone explain what is the program he is reverse engineering?
mandjevant: Yo what's he doing?
Usisuvach0: but i won't smoke some weeks
theonlymonkas: BAN
harbad: covid-19 is what he's reverse engineering.
VanishBlox: BAN BAN
Lizardan: @habituss coronavirus
Penguino138: @habituss He is making a vaccine to upload to github
recursive_x: not even a doctor can figure that
mandjevant: but... but... how
deed02392: @harbad is making sense
Penguino138: @Usisuvach0 I started my break on 3/15, got plenty of alochol
noobaj: @klairm_ the test's were wrong
ackxhpaez: Self-driving virus?
habituss: How the fuck is corona a program lol ?
yaus_baus: were hackin rona
Penguino138: Rona season bb
lordBzzl: viral envelopes need to go on strike
THX1342: everything is code in the simulation, habituss
harbad: nucleocapsid is just the body of the virus. it's just inside the lipid bilayer.
Usisuvach0: @habituss we are all programs
VanishBlox: @mandjevant he's geohots, he jailbroke the iPhone so he can jailbreak the virus too
Usisuvach0: our brain is the same as computer 0;s and 1;s
gyne: genetic...code
againstZzZ: habituss dna is basically algorithm
pogu: @habituss It's a thing that is programmed to do things in response to things, literally program
Kustex: @habituss we're all in the simulation mate
FurikuriYugi: Corona is a Mexican beer lol
Apocalyptic0ne: a virus is an organic hacker come to take your shit
DevoE444: DNA is computer like technology but more advanced @habituss
theonlymonkas: LUL
murkythunder: dna would be a data structure
esence: atom is a primitive data type
THX1342: wait til the IOT folk get a wiff of Biotech....
habituss: Alright, but where does the code comes from ?
b2kemann: wallstreet hits the floor
Apocalyptic0ne: rna sequence
lordBzzl: quarks are the primitive data type
harbad: it is the part of the virus that holds the genome and (in the case of covid-19) it is very weak. which is why it doesn't survive outside of a host for very long.
VanishBlox: dna is kinda like binary
socialnotsocial: @georgehotz thoughts on university?
bichid69: engineering boiiiiiiiiii
harbad: dna is only slightly more sophisticated than binary
THX1342: socialnotsocial his thoughts: it's a scam
robg_10: Does QIRA work with this ?
SHAVEYY_: genes are like binary
SHAVEYY_: they can be on or off
PiroFloydian: dna is basically in base 4
dvdutch: school is definitely a scam
VanishBlox: is dna like bytecode?
harbad: it's more like base 8 because of dna and rna
chusiv: He took the genome, translated it into RNA and then by isolating bytes he gets to split it into the different components of the virus.
Betazz: is there no such thing as a good virus?
Betazz: like bacteria
dvdutch: Is quaternary actually used for anything?
harbad: and codons then make it even more complex
lordBzzl: universe is weird, simple things become complex things
St47ik: @Betazz viruses aren't good or bad
recursive_x: I'm confused
VanishBlox: they just wanna fuck mate
St47ik: they're just genetic data moving around
theonlymonkas: NotLikeThis
THX1342: Betazz I think all viruses kill the host cells in their replication so I would say: no
Kustex: what is he trying to do?
foti_kasparov: university is the place people that seek for social value go
Betazz: hmm
murkythunder: why dont we create aids for sars
THX1342: unless you get a virus that eats only cancer cells
THX1342: that would be nice
alkiiis: @Kustex programming a vaccine and posting in on github
bichid69: ITS THE SAME ONE BRO
peter35_: deepmind released something with their alphafold about ncov i think
theonlymonkas: @foti_kasparov PogChamp
VanishBlox: and your body is their perfect sex chamber 😏
lebop: what is he doing
Penguino138: University is a place for either doctors, or people who don't know what they want to do with their life so they waste it
lebop: ?
Betazz: viruses even take over bacteria then
harbad: there is such thing as a good virus, look up bacteriphages
lordBzzl: we need to bring the fight to virus nursery..
jadams: 5Head
harbad: they can be used for amazing things
THX1342: oh yeah bacteriophages... true
lordBzzl: or the virus womb
St47ik: @Betazz oh wait there are actually good viruses like Bacteriophage
Landowner555: in a university you have labs to actually work with this stuff tho
Br4nnon: true
saintmthw: wow i just got called out
THX1342: russians are all into bacteriophages
esence: but I want to take a loan
Darkm1ght: fuck that world of warcraft comment hits hard
DevoE444: i study only Greta
kingpin9: this guy is making a point
bokeee_: atpRtsd
murkythunder: CORONA GO TO THE POLLS
murowski: me
dvdutch: The internet &gt; university
SnadderG: You need university when you are dumb like me
theonlymonkas: PogChamp PogChamp PogChamp
RomeoR77: hey boss!! What r we doing?
Betazz: @stuartlz haha
VanishBlox: I'm playing MINECRAFT
bravech: Don't worry I'm just wasting time watching you
Jehhred: This idiot right here is reading news
Br4nnon: i'm self studying fullstack js web dev
sondreal: news LUL
Penguino138: Pokemon Go to the polls
cutza: doomsurfing
ideology_sniffing_raccoon: ME IN TIK TOK
Strfkrs: Ok dad
fwef64: Yeah, let's stop wasting time watching this stream.
lordBzzl: @St47ik any other good viruses?
Makifun: just get learned
o______________________k: facts
dvdutch: George sounds like a libertarian
VanishBlox: streams over guys
gyne: like how to get into uni PogChamp
theonlymonkas: he is
Landowner555: doing this stuff with biology is the equivalent of reading about sex
peter35_: true FeelsBadMan im addicted to twatter
St47ik: @lordBzzl T-Virus Kappa
SHAVEYY_: I stopped playing vidya games once I started programming
foti_kasparov: Always remember that bro that said once that the internet is the biggest equalizer ever in the history of humanity
SHAVEYY_: video gamers are for zoomers
djcows: wuhan bat soup flu
b2kemann: kong flu!!
THX1342: YEEEPPP
THX1342: PREACH
gyne: racist cmonBruh
Nopy1: aaaaah non pc detected!!!
Penguino138: Delicious Pangolin soup anyone?
bokeee_: @Donique9 atpQuan
pogu: How does he have full access to ncbi
alfyfav: make a clip about that
dj_vicio: seafood market my ass. Biochemistry lab you mean.
recursive_x: lmfa8
THX1342: damn right.. get skills
o______________________k: LMFAO
lordBzzl: @St47ik coool
yaus_baus: wuhan seafood mmmm delicious
iron_lasagna: hi :)
o______________________k: squadOmega
pogu: Isn't ncbi like bajillion dolalrs a month
harbad: same virus? I thought they were two different strains. @georgehotz
Apocalyptic0ne: @george check out this article
Apocalyptic0ne: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2982146/
smurfd0: isnt there 2 strains?
TheBusbyBabes: a guy made soup so bad he crashed the world economy
Betazz: yes
Betazz: 2
ackxhpaez: The Chinese name is the "US Army bio-weapon"
dj_vicio: here we go
St47ik: NotLikeThis
VanishBlox: I bet the guy who made the bat soup is so happy everyone knows his soup now :D
harbad: catalytic activity - using energy to create something
MrDrSpace: George streaming POG
bichid69: yeah theres the L-Type and S_type
iron_lasagna: McDonalds has closed :(
DevoE444: hack CIA if you want to find the cure Kappa
logi6000: watch there be some exotic strain of weed that cures it
SHAVEYY_: the chinese name is 阴茎病毒
murowski: oh shit chemistry
lordBzzl: we have a viral envelope and some rna stuff and a few connectors and that's it?
recursive_x: is that in round up
lordBzzl: how do they even form
bichid69: L-Type and S-Type are the two strains
harbad: they form in host cells
d3adb33: but it is organic chemistry - not anorganic :)
dvdutch: Blue dreams cures COVID
SHAVEYY_: we wouldnt get viruses if we stopped fucking animals Kappa
St47ik: @lordBzzl like everything else, evolution
theonlymonkas: click click click
Penguino138: @dvdutch Blue Dream weakens your lungs for if COVID hits u
logi6000: @dvdutch ha that sounds good
iron_lasagna: Pog?
ybdev: ybdev subscribed at Tier 1.
DevoE444: @SHAVEYY_ good one
logi6000: blue dream my favorite
ktzkalash: geo finding the cure lol
noobaj: L-Type &amp; S-Type, L-Type is more contagious and it affected wuhan
murkythunder: this is useful LUL if you know how to use it
theonlymonkas: LUL
dvdutch: I dont actually smoke weed thats the only strain I know lmao @Penguino138 @logi6000
harbad: VIRUSES ARE REPLICATED ONLY IN HOSTS. VIRUSES DO NOTHING OUTSIDE OF HOST BODIES, THEREFORE VIRUSES ARE NOT CLASSIFIED AS 'LIVING'.
DevoE444: this virus looks like sushi
saheenshoukath: wait I didnt signup for biology
noobaj: the one causing outbreak outside of china is S-Type
jadams: copy and paste :)
Penguino138: @dvdutch Well Dutch Treat is the best and it's in ur name lol
o______________________k: squadOmega
logi6000: yo so if I smoke enough blue dream then I won't have any lunga for the Corona to attack let's go
SHAVEYY_: dose the virus have a heartbeat
montreehall: https://www.youtube.com/watch?v=OOJqHPfG7pA may help
mabac95: wtf is he doing?
lordBzzl: @St47ik true, amazing universe designer
theonlymonkas: BAN
dvdutch: I think I smoked blue dreams once and had a panic attack
sircrocodile163: George stop studying chemistry. You will end up like Martin Shkreli LUL
SHAVEYY_: BAN
Penguino138: @mabac95 He is making a vaccine to upload to Github
Crypod: LUL
inDOObitablee: He's making a vaccine and posting it on Github @mabac95
iron_lasagna: Print("Cure"); :)
SHAVEYY_: @mabac95 making a vaccine for github
harbad: @SHAVEYY_ they don't have a heart.
SHAVEYY_: wtf how
dvdutch: You should be listening to the cure rn
harbad: @georgehotz yes
omisyss: What is the advantage of using jupyter instead of just running a Python file
TheSpeedyLive: what is he doing?
saheenshoukath: imagine if he really find a cure
theonlymonkas: Martin Shkreli vs Geohot
murkythunder: would the information be public?
smurfd0: its made by he-who-must-not-be-named :P
Rovelo: @georgehotz human testing is hard to to LUL
inDOObitablee: He's making a vaccine and posting it on Github @TheSpeedyLive
SHAVEYY_: @omisyss you can experiment way more
SHAVEYY_: better for learning
MrDrSpace: Sick, A virus causing a lockdown and we know zilch. That's comforting.
Penguino138: @TheSpeedyLive Vaccine for github read the chat bro
mabac95: Ty guys
dvdutch: Medical scientists arent as hyperfocused as programmers @georgehotz
VanishBlox: @thespeedylive making a cure and posting it on github
SHAVEYY_: @mabac95 github.com
drake_elite: can i get this pdf
iron_lasagna: so what would be the benefit if he actually achieved what hes trying to do?
Landowner555: u would be a pretty legit bioinfomatician
Penguino138: hilarious how many keep asking what he's doing and our answers
logi6000: @iron_lasagna a cure
esteve_11: esteve_11 subscribed with Twitch Prime.
SHAVEYY_: @iron_lasagna making a vaccine for github
logi6000: @iron_lasagna and getting fucked by a pornstar
iron_lasagna: lol
harbad: he's reverse-engineering covid-19
SHAVEYY_: nah nah dude he's reverse-sciencing covid
Foxxy_xx: how was the progress last night? i fell asleep and missed half of it lol
Landowner555: we're gonna strike back china
Penguino138: Lots of people coming to this stream who can't even read apparantly
lordBzzl: can a virus be completely be described in code?
Foxxy_xx: and since im not a sub i cant watch the video back
recursive_x: lol
edu4594: he's creating a git repo for the vaccine
viper262_: @lordBzzl yeah
logi6000: we could just take the North Korea approach and kill everyone who gets it?
Br4nnon: lmao
Nopy1: #hacklyfe
Landowner555: what we need is a vaccine to cure autism
saheenshoukath: that sounds logical
VanishBlox: Wooooho bois give yourself a pat on the back we broke 1k views!!!!??
iron_lasagna: @Landowner555 but arent you enjoying the stream?
harbad: is North Korea really? wow...
SHAVEYY_: bro i'm gonna make so many pull requests to this cure
Kustex: @Landowner555 we need more autism
Landowner555: lmao
foxubu: lol
tykabmo: Has he reversed engineered the coronavirus and solved the world problem?
Penguino138: A lot of stupid in the chat. Kinda liked it when there was 200-300 viewers more
SHAVEYY_: i'm adding leds to the cure PogChamp
d3adb33: maybe soon
dvdutch: I'm gonna make a pull request and put in a line that prints "boobs" to the console
Landowner555: @Penguino138 no u
xxdvxx: Thanks for the stream
iron_lasagna: @tykabmo yeah but a few bugs
brownyyyylocks: are we live or has this stream ended?
T3chHS: if (hasCoronaVirus(person)) { person.killPerson() }
saintmthw: @dvdutch hackermans
logi6000: @t3chhs the true cure
edu4594: live
St47ik: 4Head
SHAVEYY_: @T3chHS you dont need brackets if your running 1 instruction :)
sircrocodile163: LULW
brownyyyylocks: made it!
AresD7: @georgehotz there is a medicin they're using in Japan called Avigan seems to work, do you knwo about it?
Lizardan: He’s going down the rabbit hole
iron_lasagna: just do it 4Head
Landowner555: dont we already do that lul
brownyyyylocks: thanks edu!
harbad: @georgehotz those ones might not survive though.
dvdutch: 200 IQ
n00b_Solid: just infect millions squadH
Penguino138: @Landowner555 you think there needs to be a vaccine for autism WutFace WutFace
FurikuriYugi: you can't fix stupid but you can profit from it
SHAVEYY_: so its more like if(hasCoronaVirus(person)) person.killPerson()
T3chHS: @SHAVEYY_ works wither way
Fundlak: LUL
St47ik: LUL
Betazz: there are antibodies
SHAVEYY_: yeah Kappa
T3chHS: either*
thegodofunderworld: Will this stream be uploaded to YouTube?
habituss: he's looking into that now ?
recursive_x: just find the same RNA within the protein that will break down the one already within the subject
Nopy1: and how does different strands of the same virus work??
RobinMalfait: Isn't that literally how they work? :P
bichid69: isn't the issue with the symptoms the immune response itself?
murkythunder: there have been cases where people with corona in china have caught it twice i read
Penguino138: @Landowner555 This stream is brought to you by Autism
camel3: squadLUL squadLUL squadLUL squadLUL
MrYasser2194: yeah thats it
TheKiit: Hi
foti_kasparov: Vaccine is the weakened virus
ybdev: Yes you can get reinfected. Hi!
Landowner555: @Penguino138 lmfao
St47ik: but you need to trigger anti-bodies
Rovelo: LUL you cant just make another virus
lordBzzl: @viper262_ but where do we go from there? we could have a virus template
cutza: That's the S strand
donasaurus: Yeah its that easy... oh wait
St47ik: chewing ice DansGame
esence: lmao, just tell your cells to be prepared
ybdev: We do that with mosquitos.
tiagodopke: chewing ice stream?
harbad: If we don't cough and spread the virus to everyone, then the virus you're talking about would just die in one host. @georgehotz
noobaj: @georgehotz check data available on immune/recoverd people
thegodofunderworld: Will we have the full stream on YouTube?
Betazz: people who got reinfected weren't fully recovered
theonlymonkas: ASMR
maxjowett: lol
kornez: my favorite ice chewing stream PogChamp
murowski: or just kill all old peoples SeemsGood
logi6000: if you listen to anti vaccine people tho it's full of Mercury and pesticides
lordBzzl: new viruses pop up, we whip out our template like a magic wand
ideology_sniffing_raccoon: does george has a discord like other twitch streamers?
VanishBlox: if Person.Infected than Person.kill() Person = nil end LUA BEST LANGUAGE
Tsoding: The Ice Cub near the fridge has finally melted PepeHands
St47ik: @thegodofunderworld on comma ai archive youtube channel
Crypod: indubitably
Rovelo: what about recombination lul
dj_vicio: careful there George. The NWO WANTS to kill people.
dvdutch: Is george any good at chess?
Betazz: so there's no proof that they got infected twice
bravech: PokDarkrai
Andremm2: how do we know that this is not how this all started lol
saixj: can you make you portrait screen smaller
theonlymonkas: no
MrYasser2194: @georgehotz you have to make it weak enough it doesn't do a lot of damage and strong enough it triggers a immune response
raondev: @georgehotz Nice to see you on again &lt;3 love it to watch you while I'm learning for my university stuff
kornez: @georgehotz any mixtape coming?
Rovelo: cant viruses literally share DNA and become a combination LUL
montreehall: https://www.youtube.com/watch?v=OOJqHPfG7pA
kokiworse: kokiworse subscribed with Twitch Prime.
harbad: @georgehotz we can't see everything on your screen with your handsome face in the way. lol
Loutlot: glycoprotaina are unique to each and often acting as a flag to immune system
SHAVEYY_: twitch staff PogChamp
Rovelo: staff monkaS hide
VanishBlox: George pls install feet cam😳😳
Digital_donger: staff being helpful PogChamp
Digital_donger: Kappa
recursive_x: pretty sure if you distill corona extra into corona light that also works
harbad: the glycoprotein 'spikes' are similar to host proteins for endocytosis.
edu4594: MiniK
FurikuriYugi: cmonBruh
harbad: that's how the virus spreads from cell to cell.
ybdev: I was the girl at the hackathon. People with compromised immune function are basically unable to make any defenses. They can get marrow transplants and then do it.
saintmthw: subscribed twitch staff PogChamp
dvdutch: Somebody play me: https://lichess.org/Uh3hSPWq
Fulk33: Its crazy that there are like proteins that are basically data structures and then there are proteins that run code
Rovelo: @georgehotz please check out Antigenic shift monkaS
Rovelo: for the love of god
evil_tourist: Ideal candidate for the role of Eliot in season 6
Landowner555: ^
artikkk: !followage
edu4594: we live in a simulation
lordBzzl: could a programmer understand a virus...:P
d3adb33: oh boy - season 6 was a mess - i hate it.
Wuthappenedgusy: no but this guy can
xrealyy: simulation... haha
VanishBlox: Yes, he could
lordBzzl: haha
Masturbear: lordBzzl I'm both :) it's bio-informatics
SHAVEYY_: just write an AI to do the research for you 4Head
b2kemann: someone has link to the papers?
murkythunder: make vaccine cure generic so we can cure all viruses at once Pog
lordBzzl: what's the simplest virus there is?
thegodofunderworld: What is his objective?
FargioFarmani: somebody play me: https://lichess.org/o8Da6fkl
sondreal: LuvPeekL hello
thegodofunderworld: I just came here
thegodofunderworld: What is he trying to do?
DevoE444: ctr alt del , end covid.exe gg you won
VanishBlox: ai find solution: killing every human
Br4nnon: it
theonlymonkas: BAN
Br4nnon: it's in the title**
saheenshoukath: reverse engineering the coronavirus #lockdown
saixj: do you plan on streaming again tomorrow around this time
d3adb33: reverse engineer the corona virus
lordBzzl: can repeat @georgehotz technique but on something simpler
info303: are we doing unsupervised learning now?
dorkmo: post corona virus cure to github
yevenesh: can bubble sort solve coronavirus?
SHAVEYY_: post coronavirus to github pls
saheenshoukath: how can I use the cure once found? git clone it ?
bichid69: deepmind computed these structures here
bichid69: https://deepmind.com/research/open-source/computational-predictions-of-protein-structures-associated-with-COVID-19
thegodofunderworld: Wow! reverse engineering !!! I should have expected that. It's hacker stuff
SHAVEYY_: put the cure on gitlab plsplsplspls
mabac95: @dorkmo how he's doing it? searching stuff on google?
recursive_x: other than using crisper anytime the protein mutates to break down the auto communal parts idfk
bobert_____: bobert_____ subscribed at Tier 1.
St47ik: https://en.wikipedia.org/wiki/Antigenic_shift
Snowlav: what limits the size of the virus?
SHAVEYY_: @mabac95 his stream is just opening chrome tabs right now
revenantrazer: lol
Masturbear: big isn't necessarily functional budd :/
lordBzzl: @Masturbear PartyHat
brownyyyylocks: sub life
esence: it's all about them likes and subs
revenantrazer: reverse engineer coronavirus for the subs
recursive_x: I'm on here maybe once or twice a month lol
vloood: trump was just like "Romney is in isolation?! Gee that's too bad" LMFAO
saheenshoukath: same
harbad: @Snowlav smaller viruses tend to travel further, cost less to produce, and can infect more. hosts
d3adb33: I watch always on YT - now it is my first time live.
dj_vicio: we need more people like George
VanishBlox: yo deep mind made a paper check it out https://deepmind.com/research/open-source/computational-predictions-of-protein-structures-associated-with-COVID-19
emiven: people are using NN to predict virus mutations
RakeRoux: RakeRoux subscribed with Twitch Prime.
vaskogomez87: cold and soggy fire, nham
alexyzdev: If anyone is going to be able to build a cure with a python script I think it's going to be george
fwef64: Reverse engineering coronavirus is cool, but do you know what's even cooler? Optimizing it to perform better.
Kmerck313: 1000 ppl
THX1342: how can you use a NN to predict a mutation? It's like trying to predict a dice roll, isn't it?
saheenshoukath: this is my youtube channel.subscribe.im desperate https://www.youtube.com/channel/UCMoemgeR-6D5nmSJjShbcQA
lordBzzl: needs to be something like X-informatics :)
FargioFarmani: @georgehotz please play me https://lichess.org/r6EOP9JX
recursive_x: lol
logi6000: @fwef64 time for an upgrade
SHAVEYY_: isnt evolution just mutating randomly until something sticks?
THX1342: ^
Snowlav: @harbad like wave lengths? LUL
montreehall: https://www.youtube.com/watch?v=OOJqHPfG7pA
foti_kasparov: &gt; Create the vaccine &gt; Sell it for 1$ per person &gt; 7 billion people buy it &gt; You become a billionaire !!!
Loutlot: initiation codon is not always AUG for virus thats confusing
info303: @SHAVEYY_ thats how reinforcement learning works
Masturbear: THX1342 no, there are rules and predispositions in strings of DNA/RNA that make stuff more/less likeley to happen
THX1342: maybe using NN to check protein folds might make sense
recursive_x: k
THX1342: @Masturbear oh ok
法國人: @SHAVEYY_ correct, except it's not random
harbad: @georgehotz the M is for MRNA
djcows: Are you shorting the market?
THX1342: @Masturbear any keywords for me to research that?
murkythunder: @foti_kasparov sell it for 1000, become a trillionaire
northumb: what have you reached so far george?
lemonspree: random question of the day; what are your thoughts on Norway? @georgehotz
harbad: @georgehotz it's a replication and translation codon
dorkmo: whats to stop evil doers from re-releasing sars every year?
logi6000: @lemonspree found out where this guy lives I guess
alexyzdev: @northumb he knows he needs to either eat zinc, or soap..
Masturbear: THX1342 hmm if you wanna go really basic just look up: transversion/translations DNA/RNA
emiven: lol e det deg lem
foti_kasparov: @murkythunder But if you sell it for 1$, everybody will be happy ! :P
d3adb33: see the rest (hopefully) on YT....have to quit :(
brownyyyylocks: why can we peacefully co-exist?
harbad: think of it like code
brownyyyylocks: YOLO
murkythunder: @foti_kasparov no, ppl will complain why its not .5 or why its not free :(
Masturbear: thats just a simple example of a factor that has to do with it, theres many more but it'll give you an understanding THX1342
d3adb33: in EU it is midnight
harbad: when a script ends, it's just like a return statement
montreehall: if covid-19 is mucus vicks and mustard kills it
d3adb33: good night everyone!
harbad: it stops running.
info303: lol
djcows: TRUE
nashesvobodnoye: How does he plan to "reverse engineer" the virus? I mean do we know precisely what each piece of the gene is doing?
St47ik: LUL
THX1342: @Masturbear I understand the basics but not the mechanics involved in mutations. I thought it would be a random error in transcoding/translation
o______________________k: squadOmega
sayyy: ANELE
recursive_x: zkdkSip
info303: being evil is low effort
dvdutch: Unabomber was p smart
THX1342: didn't know there were 'more probable' outcomes
kornez: LUL
lordBzzl: @mastubear is bionformatics only on genetics?
gyne: monkaTOS
logi6000: what was that song called
harbad: we actually know what most proteins are doing @nashesvobodnoye . Their indevidual moving pieces are documented.
SHAVEYY_: make a virus
SHAVEYY_: sell the cure
WeBDaEMoN3: @georgehotz this is the phylogeny of the virus with its evolution https://www.gisaid.org/epiflu-applications/nextflu-app/
FargioFarmani: great play!
21_savior: xqcT
St47ik: NotLikeThis
Masturbear: THX1342 the mutations are somewhat random yea for sure. Everytime DNA is copied to RNA mistakes happen somewhat at random
Ant__K: monkaS
roystang: rip
Mariosavitch: hello mr. hotz
ICAntF331MyFAce: monkaS
Ant__K: squadHmm
murkythunder: evil smart people have a doctrine they stick to at least, they dont do it for chaos
harbad: very much of the proteins that make up viruses are very well documented.
Snowlav: Masturbear like flipped bits in electronics?
nashesvobodnoye: !uptime
TheHareld: Is the streamer playing IRL Plague INC ?
harbad: phylogeny is the tree of mutation and ancestry
d3adb33: and for all of the end of the world fans - have a look on this hymn :D https://www.youtube.com/watch?v=yUKZhbZHXsI
St47ik: @TheHareld we're all playing it IRL now
WeBDaEMoN3: @georgehotz you can select ncov in the tab on the left
recursive_x: bullshit field germ theory createdir
Masturbear: lordBzzl bio-informatics is the field that studies organisms their genetic material by using programming. but it's pretty broad, just google it ^^
recursive_x: it
harbad: HIV is WAY different.
harbad: don't bother with HIV
ToxicVulpes: all these viruses are literally just BIOLOGICAL version of . exe
esteve_11: What is the result of reverse engineering a virus lol?
bichid69: can you not just rm -rf / of the virus?
SHAVEYY_: bro they turned the computer virus into a real thing
lordBzzl: @Masturbear will do, thanks
SHAVEYY_: cant wait for fortnite irl
11plus4thinking: what are you trying to accomplish by reverse engineering the coronavirus
dtsa349: Hi George, nice to see you :) Happy to see you are working on some corona virus-related project. That quarantine already affected my life, the third week at home, working remotely, everything is closed except shop and pharmacy. I read a little bit about coronaVirus. The aspect you may have to consider is getting a virus inside the cell (mitosis) and protein ACE2. Scientists are trying to make a vaccine that stimulates to make antibodies for that protein. Have a nice day :)
TheHareld: @St47ik We are losing hard though :/
d3adb33: a deeper understanding is a good start for a reverse engeneering. Maybe more or less
Masturbear: Snowlav basically, but since theres ATCG which are all composed off many molecules alot can happen. but if you're just looking at results yea it's just like htat
is_physics: does he have access to paid papers?
recursive_x: m
SHAVEYY_: @11plus4thinking putting the cure on github
harbad: @esteve_11 you can understand where the virus can be stopped.
o______________________k: Hi George, nice to see you :) Happy to see you are working on some corona virus-related project. That quarantine already affected my life, the third week at home, working remotely, everything is closed except shop and pharmacy. I read a little bit about coronaVirus. The aspect you may have to consider is getting a virus inside the cell (mitosis) and protein ACE2. Scientists are trying to make a vaccine that stimulates to make antibodies for that protein. Have a nice day :)
St47ik: @TheHareld there's still hope
PiroFloydian: @georgehotz what are your reasons for doing anything?
montreehall: HOW TO MAKE DECONTAMINATION BOX TO KILL BACTERIA AND VIRUS (EX. CORONA COVID-19) WITH H2O2 https://www.youtube.com/watch?v=6PM_D1fuAS0
11plus4thinking: @SHAVEYY_ doesnt matter if he finds the "cure" it needs to go through a long testing period that can take up to a year anyway
bichid69: bro just rm -rf corona
Snowlav: Masturbear thank you for the explanation!
esteve_11: @harbad Does he have any hope of actually achiveing it?
SHAVEYY_: @11plus4thinking he's injecting the virus into monkies 4Head
TheHareld: @St47ik I already did not have hope even before this pandemic dude, so i'm all in if this shit turns into World War Z or smth
cengea: bruh
Masturbear: Snowlav np! :D
bichid69: @esteve_11 absolutely fucking not
Hoefler02: Run :(){ : | :&amp; }: on it
recursive_x: ba is bs
kittenplan_et_al: is it mostly "junk" like the human genome and you're trying to find the viral "genes"?
brittonx2: you should do a SARS-v2 hackathon
St47ik: regex the proteinz Kappa
murkythunder: if world is this freaked about 2% deathrate whait til they find out about global wamring Pog
11plus4thinking: @kittenplan_et_al "junk"
Masturbear: kittenplan_et_al generally virusses have A LOT less junk
lordBzzl: '.exe' does not have and maintain physical body and processes, could be where biology is better at
kittenplan_et_al: @11plus4thinking well some of our "junk" is actually viruses Keepo
Alteriume: imagine if u could have a biologist in chat that could tell you what is junk and what isn't
St47ik: ocean water is full of viruses
SHAVEYY_: bro Bernie sanders be live
SHAVEYY_: wtf
Fulk33: First ones always end in GG
iiiiiiillllliiiill: i am bilogist btw
misterbinu: If you solve coronavirus using Python I am going to get mad
Masturbear: Alteriume not like a biologist knows every piece of DNA LUL
St47ik: LUL
lordBzzl: definitely some bio peeps in the room
Zorbaselo: what is this i entered now
harbad: @iiiiiiillllliiiill what do you study?
tone_by: what is he doing?
Alteriume: Masturbear you a leftist? name everyone to your left
bichid69: I'm a comp chemist, still don't know shit though
dtsa349: he doesn't read chat? :(
11plus4thinking: @iiiiiiillllliiiill whats a bilogist?
logi6000: @tone_by making a vaccine and posting it on github
St47ik: @Zorbaselo reverse engineering the virus and saving the world
harbad: he does from time to time.
METH_HEAD_MIKE: just copy paste the glycoprotein code to the Influenza virus and make a flu vaccine 4Head
Masturbear: Alteriume im a lefty, and i'm alone atm quarantining hard :)
法國人: @tone_by he is developing a vaccine to fight corona
Alteriume: Masturbear FeelsBadMan roughs time
Zorbaselo: @st47ik tf bro i dont undrstand shit but i keep watching
lemonspree: ELI5: What are you doing right now and for what purpose? @georgehotz
TheHareld: @METH_HEAD_MIKE LUL
iiiiiiillllliiiill: @harbad i specialize in ant psychology
bichid69: @METH_HEAD_MIKE Wait this is actually a pretty good idea
Masturbear: Alteriume personally meh, globally ye travisty :/
11plus4thinking: I heard that the us is using the supercomputer summit to simulate the virus
St47ik: @Zorbaselo you're not alone LUL
TimoPuukka: @georgehotz are you related to Kenny Hotz?
aasimm: what are we doin
Alteriume: Masturbear I mean, since me and my gf don't really go out and our family too we kinda cheat and still see each other but yeah
is_physics: sudo virus-get purge Sars-Cov-2
wootawee: banning people left and right :)
anbu_bb: is he setting up for a nn?
法國人: @11plus4thinking really ? name your sources, if that's true that's cool
harbad: @iiiiiiillllliiiill ant psychology? did you study microbiology at all?
Aagaard89: @iiiiiiillllliiiill are you really an ant shrimp?
lordBzzl: what's the most complex virus to simulate with code?
Alteriume: Masturbear her neighbour were doing a fucking party the other day, didn't quite understand wtf was going on
pigporkman: just do rm -rf ~/coronavirus?
pigporkman: ezpz
StoogeThomas: StoogeThomas subscribed at Tier 1.
Masturbear: @georgehotz are u trying to find what those chunks of (i assume) DNA do?
aasimm: !uptime
recursive_x: it all is
bichid69: @pigporkman already suggested that
lordBzzl: or just the most complex virus
lordBzzl: ?
sobwyn123: @georgehotz how fast can you type ?
misterbinu: Should we try to run this through IDA?
logi6000: guys we need to just shut down the area 51 computer that has plague inc running
Zorbaselo: he is using the computer a way that i have never seen
Masturbear: Alteriume yeah i cheat a bit too, i see the same 5 friends daily. and they me and eachother exclusively
informalgarlic: @georgehotz why you have no dono link??? @georgehotz
Fulk33: weird that the different parts all end in LQ
Snowlav: where does a virus get it
Masturbear: Alteriume man so many stupid people.. they'll all be sick in no time
Snowlav: energy from
equipollent_z: Biggest CTF in the world right now 😄
FargioFarmani: Where is your Ice Tea?? @georgehotz
iiiiiiillllliiiill: @harbad i majored in the effects of prayers on viruses
wootawee: blast the seq
Snowlav: could you starve the virus of energy and kill it that way?
t3rminal: Y29yb25hdmlydXMK
tazicke11: can someone explain what is he doing, im New
blazeofglorytv: This guy is crazy
Masturbear: Snowlav if it has no host cell then it dies
georgehotz: https://pastebin.com/FBtprSGK
djcows: Just pray and the virus will go away
Hoefler02: Crazy awesome
harbad: he's going to find a cure and post it on github
logi6000: @equipollent_z the flag is the vaccine and the reward is sex with a pornstar
theonlymonkas: twitchchess
Masturbear: it just steals proccesses in those cells to survive and replicate normally
iron_lasagna: lol
recursive_x: scared night
St47ik: PogChamp
komocode_: HACK THE PLANET
lordBzzl: woot woot
Snowlav: Masturbear I see, ok
Greaser_1: :-)
latisrof: did he post the paste?
equipollent_z: 😄
komocode_: zer0_cool
St47ik: @latisrof https://pastebin.com/FBtprSGK
equipollent_z: Hack the 🌎
latisrof: ty
VanishBlox: https://pastebin.com/FBtprSGK
davidgames68: @Transferer agr1 agr2 agr3 agr4
Alteriume: the echo in your room makes me sad @georgehotz
logi6000: @georgehotz are you just doing this to fuck that pornstar
theonlymonkas: LUL
Ghost_001: monkaS
Transferer: @davidgames68 ResidentSleeper ResidentSleeper
osuiw: howcome
davidgames68: @transferer agrJoy
b4by__y0d4: where is cc defined?
harbad: reverse engineering the virus is actually quite smart, but it's very difficult to figure out what to exploit in biology.
法國人: ^
logi6000: marshall law in affect that the sirens there coming with the M16'S
wootawee: "almost no way" = easy for evolution over time
St47ik: @georgehotz did you check Antigenic shift?
cutza: MARTIAL
StoogeThomas: The virus spread for animals to humans. Now his reverse engineering it and it will spread from humans to computers. True story 100% fact ;)
StoogeThomas: from*
FargioFarmani: makes sense
Zorbaselo: where the hell he learned this things??????
montreehall: the UK gov said there going to start using the cure next month live on TV the other day
harbad: internet
Penguino138: @Zorbaselo like the rest of us. From years of self isolation
lordBzzl: @harbad small realistic feedback loop needed, I think..
BesterGester: @Zorbaselo internet
St47ik: @Zorbaselo the internet Kappa
NoPartiesGuy: wtf happened here 1014 people watching, where are streams with ReactJS and Jquery in one project Kappa
法國人: @Zorbaselo internet
leesingods: Cant believe how lucky i am was watching the corona video on youtube and clicked the twitch link and you're live..
Creamy_Goodness_: so much white. turn on darkmode for gods sake
Tsoding: zorbaselo, What do you mean learned? Did you assume he ever stopped? LUL
Luccaasss: imagine, geo hot discover the solution of the virus
whitsyerhing: Whoever has the dials for our simulation is a prick
harbad: @lordBzzl what do you mean?
MuscleMario: @leesingods same here.... wasnt expecting him to be on.
theonlymonkas: my eyes
Zorbaselo: bro not the coding section i am asking about the gene things
kakurai: geo's reverse engineering Sars-Cov2's genetic code?
bichid69: TM score is some bullshit metric from CASP
Penguino138: @whitsyerhing The dials are already set on the inception of any multi-verse. Ie the universal constants
StoogeThomas: you should all be shorting the markets right now.
Masturbear: Zorbaselo internet
StoogeThomas: easy money
Simplex991: the only channel worth watching on twitch is finally live
Ziv0: over 1k viewers
法國人: @Zorbaselo he is doing it right now, you blind ? LUL
logi6000: @whitsyerhing there distracting us so we don't jailbreak out. that is his goal for 2020
vanst0rek: will this be on youtube ??
BesterGester: @Zorbaselo Still the internet
alexandru_cristiean: !uptime
Penguino138: @vanst0rek everything goes up on youtube after the stream
mabac95: what does the function "translate" does?
leesingods: @MuscleMario Damn i knew someone else was here that came from it too
harbad: protease is used to break down host protein, then uses it to build its own genome.
mabac95: with a parameter like cc[266-1:13483], True
element731: @georgehotz 100 bits of you can solve this thing by supper time. Guar-an-teed, sir!
Mariosavitch: awesome function
Masturbear: georgehotz if u'd complete sentences we could maybe help out xd
bichid69: TM-score is such a bs metric it's unreal
Mariosavitch: GG
alexandru_cristiean: How do I stop being a noob @georgehotz
St47ik: GG
wootawee: gg!
leesingods: ggwp
Mariosavitch: get rekt. GG
saintmthw: gg, qq
Mariosavitch: QQ gg
Ziv0: gg no re
welcomedungeon: k, gg
antony4s_: gg KEKW
Tsoding: KGB tsodinKomrade
StoogeThomas: @alexandru_cristiean stop spending time watching twitch and use your time learning
b4by__y0d4: In the pastern code, where is $cc defined?
iiiiiiillllliiiill: ggx
St47ik: LUL
harbad: @alexandru_cristiean you spam @georgehotz 's twitch chat, that's how.
element731: KGB, comrades?
harbad: @alexandru_cristiean obviously.
FurikuriYugi: queue
Tsoding: KKomrade
element731: Qanon?
blazeofglorytv: Is it ok that I don’t understand a piece of it?
c1tr0n75: c1tr0n75 subscribed at Tier 1.
NoPartiesGuy: @alexandru_cristiean whatever you do do it more frequently and longer and you will become better
mauke53: @macab95 The code is missing some imports defined in the previous blocks. "The string translate() method returns a string where each character is mapped to its corresponding character in the translation table."
UniversalGeneve: is george just pattern matching letters, or is he looking at the charges of these AAs?
法國人: cagibi
St47ik: @blazeofglorytv yeah this is some advanced stuff
mazsociety: does chewing ice help prevent the virus?
vanst0rek: Guys check out INOVIO PHARMACEUTICALS
lordBzzl: @harbad seems like a complex system, even if we pull it off in code
RakeRoux: qmap.pub
olokinhomeuxd: esse cara é brabo
ideology_sniffing_raccoon: EZ
Zorbaselo: bune aq
ideology_sniffing_raccoon: PogU
montreehall: I just found this https://allworldreport.com/world-news/coronavirus-cure-australian-researchers-claim-to-have-found-cure-for-deadly-virus/
c1tr0n75: c1tr0n75 is gifting 3 Tier 1 Subs to georgehotz's community! They've gifted a total of 3 in the channel!
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to 0xfadead!
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to 0x0range!
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to itz_padi!
St47ik: PogChamp
araeasmes: WutFace
o______________________k: :D
logi6000: u guys remember that meme in 2016 where it showed a pic of toilet paper and said its a meme from the future you wouldn't get it. we need to find that guy
VanishBlox: higz me sub pls
VanishBlox: give
ideology_sniffing_raccoon: Pog
FargioFarmani: How do I stop being a loser?
Mariosavitch: i was here
Ziv0: I was here Pog
MuscleMario: LOL greatest CTF in history
vaskogomez87: ez dodge
o______________________k: squadOmega squadOmega squadOmega
Mariosavitch: real life CTF
harbad: it's very complex, but if you break it down to the smallest pieces, it can be understood.
samthedogg: how are gifted subs being chosen??
benzojamal: just solving corona 4Head
ideology_sniffing_raccoon: I was here LUL
cutza: subs only vaxx
kakurai: @FargioFarmani become geohotz
Nyt1k: I WAS HERE
Ghost_001: LUL
Cornflays: PogChamp
fwef64: FargioFarmani you can't
Juankinator: first iphones then Coronavirus Kapa
Fr0zenOfficial: IRLCTF2020
Aecxlol: oonoliGlissade
Greaser_1: :-)
lordBzzl: post-covid19 party
Zorbaselo: guys i have a question i learned python what should i do now?
phunandgames: dangPOG dangClaps dangPOG dangDial
vanst0rek: god created this CTF
VanishBlox: FOR WHEN WE FIND CORONAVIRUS, MARK ME DOWN IN HISTORX CHAT!
St47ik: @FargioFarmani dive into something you like doing and keep at it till you get good, or just watch Jordan Peterson LUL
法國人: Covid is shitting his pants right now
tremendomendez: PogChamp
Ghost_001: pacing monkaS
aasimm: DxCat DxCat
MuscleMario: @georgehotz Im actually creating a CTF my job on the side, releasing it for state farm employees April 1st. lol
logi6000: @zorbaselo cure corona
blazeofglorytv: Is he high or what?
keepingtrckofthisacct: no code?
Mariosavitch: gg
Cryzeal: Zorbaselo what was your purpose
iiiiiiillllliiiill: addy hype
kakurai: geo's always high
lordBzzl: @法國人 lol, wrath of human rance
harbad: lol I agree with @georgehotz
Fr0zenOfficial: btw @georgehotz make sure you are hydrated enough :)
samthedogg: how do i get the .cn3 file hes using??
djcows: What's in those cookies?
lordBzzl: *race.
FargioFarmani: Thank you all! Up to a great start
murkythunder: lol like statefarm employees will give a shit about a ctf
Azereos: Azereos subscribed with Twitch Prime.
c1tr0n75: c1tr0n75 is gifting 2 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
harbad: @georgehotz let's do this
MuscleMario: they wont
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to Itsmeek0!
c1tr0n75: c1tr0n75 gifted a Tier 1 sub to 0xreself!
St47ik: SARS-CoV 3 confirmed Kappa
Fulk33: @georgehotz Reason why there may be stops where there arent: "Hidden stops are non-stop codons that would be read as stop codons if they were frameshifted  1 or −1"
MuscleMario: but im bored so i wanna get ppl excited.
MuscleMario: :D
theonlymonkas: DansGame
kakurai: sound's just messed up here?
peter35_: the sim managers are running us for this CTF
St47ik: sound's fine
alex_grist: Do you use regular or ungoogled chromium?
harbad: I'm hearing fine, do you need to restart?
Zorbaselo: @cryzeal i dont remembee i started it finished a book, now i dont know where to go people making projects like mobile or web but i dont know what to do with python only know about AI
11plus4thinking: what are you drinking good sir
theonlymonkas: T E A
MorningScifi: We need a geneticist up in here for some pair programming
UniversalGeneve: it's mostly protein regulation studies
c1tr0n75: Cheer15 I am recovering from this evil thing man, slowly but surely
Mariosavitch: are you looking at each one as a particular function? @georgehotz
aasimm: schools aren't a choice these days george
logi6000: @c1tr0n75 true hero
harbad: again, HIV is not like Covid-19
Fulk33: @georgehotz Reason why there may be stops where there arent: "Hidden stops are non-stop codons that would be read as stop codons if they were frameshifted  1 or −1"
theonlymonkas: LUL
St47ik: @c1tr0n75 be strong mate you can get it 💪
Ghost_001: i don't even know what a protein is LUL
logi6000: @aasimm but education is ripe for disruption
Fr0zenOfficial: what OS are you using @georgehotz
c1tr0n75: thanks peeps
Fr0zenOfficial: nvm its mac
harbad: he's using IOS
Apocalyptic0ne: lol have you heard of all these stores being forced to close by local pd? people are nuts
phunandgames: @Ghost_001 Protein makes you big boy and stronk HahaThink
wembassy: reverse engineering as in?
lemonspree: did someone ctrl c the pastebin of the code?
UniversalGeneve: you use pdb blast to search sequences
Ghost_001: PogChamp
lordBzzl: they keep mentioning Chloroquine as anti-malarial drug..thought the plasmodium got resistant?
Abnico: he uses bloomberg terminal
felipeit999: Hello
theonlymonkas: LUL
mabac95: @lemonspree https://pastebin.com/FBtprSGK
samthedogg: where is the .cn3 file from? in cn3 = open(...cn3)
lemonspree: thanks @mabac95
harbad: the gene sequence of the covid-19 virus is what he's reverse-engineering.
Masturbear: @georgehotz https://blast.ncbi.nlm.nih.gov/Blast.cgi?PAGE=Proteins throw it in here
THX1342: the biggest thing I think geo is showing people is that you should not be afraid of not knowing. just DO IT. research. get the fucking skills and hack the planet
wembassy: ah
tarasyarema: Kappa
wembassy: how far has he got so far
harbad: @THX1342 AMEN
Ghost_001: @THX1342 PogChamp
aasimm: You ain't gonna pass HR if you wanna immigrate from some third world country it you don't have atleast bachelor's degree
lordBzzl: @THX1342 100%
MuscleMario: I like that geohot is doing this, i got really into dis Crispr / biosynthetic circuits stuff b4, when u get bored w/ computers n wanna study biology hurrdurr
Masturbear: yea googling a sequence does not work LUL
mohammed1996mizab: INVENTED STRINGS
wootawee: Track mutation/evolution: https://nextstrain.org/narratives/trees-background/
Ghost_001: LUL
BiszkopTT: this is way toooooooo hard
Fr0zenOfficial: LUL
wembassy: it would be amazing if someone came up with a programming language/simulator for genetic manipulation and open-sourced it
St47ik: rewrite nCoV 2 in Rust KappaWealth
ideology_sniffing_raccoon: WUT
dav231002: lool
revenantrazer: LOL
Zorbaselo: guys i need help from someone who knows python n
Digital_donger: LUL
DecayingSkullz: MedChem Express
Nyt1k: monkaS
benzojamal: mass production LUL
lordBzzl: @Masturbear MaxLOL
theendri99: can somebody please explain what is he trying to accomplish?
wootawee: banned
brownyyyylocks: what i miss? back from standup
Simplex991: LUL
hat3m: what is he doing ?
PiroFloydian: port doom to the virus
mabac95: !uptime
Azereos: na fuck Rust...rewrite in LISP 😎
WaeHaKe: i'm making notes, wiki = 100% legit
harbad: @georgehotz I'm near vegas
Abnico: @hat3m he is doing ur mom
hubabuba1243: @hat3m nobody knows
blazeofglorytv: This guy is a fucking genius
GeneralSoak: he is hacking the source code of the virus
djcows: He hacked the iphone, he hacked the playstation, he hacked cars, now it's time to hack life
法國人: @hubabuba1243 some knows, you don't
lordBzzl: peeeps, focuuss on the present
harbad: @georgehotz I have a place you can crash at, if you headed to Vegas.
logi6000: guys Fuck Earth imma go to the Moon and chill with vector
ziNNGG: he didnt hack shit, he stole it from me
Masturbear: can someone give me the sequence, so i can do it for him
samthedogg: @theendri99 @hat3m hes trying to find a way to stop the cloning "code " in the RNA or a way to block human ACE2 protiens from attaching to covid-19
harbad: helicase is what cleaves apart dna
ummyeah1929: ctrl f 4Head
lemonspree: Masturbear, which one?
Masturbear: lemonspree one hes looking for atm
FurikuriYugi: alt f4
aasimm: back with tons of tabs
harbad: @georgehotz Helicase is like an axe and dna is a block of wood.
theendri99: @samthedogg thank you for your answer
THX1342: @Masturbear https://www.ncbi.nlm.nih.gov/nuccore/MN908947
WeBDaEMoN3: @georgehotz this is the link I sent before - you gotta select 'ncov' from the tab on the left https://www.gisaid.org/epiflu-applications/nextflu-app/
wootawee: @georgehotz https://nextstrain.org/ncov
samthedogg: @theendri99 np . Now can someone tell me where to get the .cn3 file george is using??
dj_vicio: he forgot to count the virus he had for not washing his hands
THX1342: @Masturbear not sure if he is using that one, but that was the first published sequence
alycia: where to download corona vaccine
logi6000: @alycia cia
St47ik: github
dj_vicio: from github, coming soon
Fulk33: @georgehotz Reason why there may be stops where there arent: "Hidden stops are non-stop codons that would be read as stop codons if they were frameshifted  1 or −1"
法國人: @samthedogg not sure where but I'm pretty sure you can find out in the stream of yesterday
VanishBlox: George what is the translate function?
olokinhomeuxd: I have the cure, thanks to my 1 billion machines
Masturbear: THX1342 aight no this helps alot, i can just look up the orf he's looking at very helpfull ^^
samthedogg: @法國人 tired to . not a twitch prime member
wootawee: See all the sequences here https://nextstrain.org/ncov
wootawee: That is what changes
iiiiiiillllliiiill: can you not just use the blockchain to defeat the corona
logi6000: @iiiiiiillllliiiill exactly
theonlymonkas: NotLikeThis
法國人: @samthedogg ah yes right
olokinhomeuxd: @iiiiiiillllliiiill why?
ummyeah1929: why not just encrypt the corona then delete the key
School47: Hahaha Geohotz gonna hack corona!
logi6000: @ummyeah1929 hell yeah give it ransomware with no key
Nyt1k: just delete corona lol 4Head
St47ik: ctrl alt del
wootawee: download data button at the bottom of this: https://nextstrain.org/ncov
School47: cmon George, lets get root on corona
St47ik: nCoV is just a global bio ransomware
logi6000: this is what we get as a society for killing harambe. none of this would have ever happened if we just didn't shoot him
TorathorHD: what is he doing?
theonlymonkas: BAN
almonte550: Hi @georgehotz what are we doing today?
peter35_: harambe memes ConcernDoge
VanishBlox: Josh could you please explain what the translate function does again?
VanishBlox: george
Masturbear: He's just learning about viruses
Masturbear: not really doing anything so far tho LUL
St47ik: Virology stream
Connieboyboy: what is he doing
St47ik: also Twitch-CoV
esence: press 1 if you don't understand shit and don't see shit
Nyt1k: Kappa sure
lordBzzl: let's goo
Fr1gidTV: 1
almonte550: I was looking at that exact same page yesterday
St47ik: @Connieboyboy learning virology
hubabuba1243: 2
iskjmss: 2? 2? 2? 2? 2?
iiiiiiillllliiiill: maybe we can ask the bats and pangolins how to coexist with corona
PiroFloydian: @georgehotz what are your reasons for doing things?
nashesvobodnoye: next step, reverse engineer human genome KappaHD
theonlymonkas: 42
Connieboyboy: got it @St47ik
THX1342: Does SARS-1 target ACE2?
PaoloSisto: not really sure what I'm watching...
TorathorHD: but what is the objective?
dj_vicio: problems with the wife/gf?
gamerguy009: PogChamp PogChamp PogChamp
St47ik: @TorathorHD saving the world
jeffery_fan: next step, reverse engineering the universe
aasimm: its her guys
THX1342: TorathorHD learn about the virus..maybe get a new perspective no one had before
logi6000: now this is what I look like while coding on my phone
gamerguy009: Geohotz
ummyeah1929: catching HIV through lung receptors?
logi6000: not doing anything
almonte550: @TorathorHD there is not an objective, only learning stuff
gamerguy009: callme15HYPEE callme15HYPEE callme15HYPEE
aasimm: he is using termux
JdPaulBlart: when will comma.ai go public
jayfoxxy: Can anyone explain to me what geo its trying to prove?
lordBzzl: wonder whether the world becomes more biotech-y after covid19 troubles
MuscleMario: https://nextstrain.org/ncov reposting this cuz its cool
logi6000: @jayfoxxy not prove he's making an open source vaccine
fireposeidoncx: @jeffery_fan I'm in
aasimm: he isn't proving anything
St47ik: HIV targets immune system T cells @georgehotz
jayfoxxy: @logi6000 no way :O
murkythunder: geo can you make your title more clear, to many new ppl asking what u r doing :(
dohtem213: wonder if George get wasted drunk
brownyyyylocks: CD4 T cells
theonlymonkas: @MuscleMario nice
ICAntF331MyFAce: :O
St47ik: @brownyyyylocks right
esence: what are those, linux distros?
THX1342: jesus.. why do people crave validation so much...? " What are you trying to prove?!" "Why are you doing this?"
wootawee: eactly there
harbad: @georgehotz zoom in
wootawee: data at bottom
benzojamal: woah
St47ik: PogChamp
Landowner555: any breakthroughs yet
ziNNGG: holy shit what is it
lordBzzl: ooo that's cool
jayfoxxy: @logi6000 seeing this i get the conclusion that im completely dumb ahahahah
harbad: those are origin locations
THX1342: damn thats sick
revenantrazer: whoa
caiooliveira2014: @georgehotz I love U
benzojamal: nerd boner PogChamp
wootawee: "Download" data at bottom
School47: this is like Plague INC! PogChamp
ImpalerV: wntrBRAIN
ummyeah1929: colors and lines PogChamp
youngsachi: PogChamp
theonlymonkas: Kreygasm
lowtemperaturebody: yo wtf is going on
ICAntF331MyFAce: pogu
St47ik: PogChamp PogChamp
murkythunder: d3 Pog
Nyt1k: PogChamp
tokumei64: LOL did he just find this site? LUL
snapcs1: LUL
Cornflays: FeelsAmazingMan
Greaser_1: :-)
ICAntF331MyFAce: PogChamp
BiszkopTT: damn son
Ghost_001: PogChamp
shekshas369: PogChamp PogChamp Kreygasm
MuscleMario: @wootawee u deserve that credit lol
caiooliveira2014: PogChamp
VanishBlox: WOAAH WE ARE IN THE ENDGAME BOIS
dj_vicio: comes from the labs of Washington DC
ImpalerV: strong pee incoming
MorningScifi: HACK THE PLANET!
jtparker: And he is gone....
gamerguy009: PogChamp PogChamp PogChamp PogChamp PogChamp
shekshas369: well fucking ülayed
School47: hahaha we will hack it like Iphone or PS3
LazyNorm: PogChamp
Ghost_001: i have no idea what going on PogChamp
ziNNGG: you gotta read your chat more often
MuscleMario: count the time he doesnt wash his hands
esence: actually washing hands LUL
MuscleMario: -1 -2 -3
almonte550: I don't see Dominican Republic with cases in the map, maybe doesn't it doesn't have all the cases?
brownyyyylocks: WASH UR HANDZ
iiiiiiillllliiiill: get more addy we need you at 100%
vozdra: HSWP
1gonyali: içiyon içiyon biraları sonra işemeye gidiyon amk en heyecanlı yerinde
School47: @Ghost_001 just make more hype
mattdougherty22: some was better than none
Masturbear: click on play PogChamp (top left worldmap) @georgehotz
iskjmss: this guy is added up
harbad: @georgehotz Thanks for the stream, I gotta go be productive... Ugh.
snapcs1: https://clips.twitch.tv/BumblingAcceptablePeafowlTebowing
bichid69: yo check this out https://github.com/feiglab/sars-cov-2-proteins
Ghost_001: Kappa
theonlymonkas: hahahaha no hand washing
gattz_: Kappa
AntiVax_SoccerMom: Kappa
Apocalyptic0ne: fuck adderall
cutza: adderall vaccine
Ghost_001: sure bud Kappa
youngsachi: Kappa
revenantrazer: you have adhd?
kakurai: Why geo's wearing ninja clothes?
dvdutch: 2 months too long
lordBzzl: Africa's seeing more cases but maybe no analysis of genome yet
wootawee: @MuscleMario no worries :)
PiroFloydian: are you on anything?
shekshas369: when genuine passion is being confused for being medicated
Mariosavitch: if you want to search a protein sequence you have to search the blastp database. Here is the search for the helicase of covid https://blast.ncbi.nlm.nih.gov/Blast.cgi?CMD=Get&amp;RID=7FWDB250016 @georgehotz
shekshas369: welcome to 2k20
klaazdw: im dutch &lt;3
jeffery_fan: is adderall actually useful?
theonlymonkas: cocaine
shekshas369: LUL
almonte550: @georgehotz don't touch your face
wootawee: Everyone but the US has :(
dvdutch: Im not dutch
logi6000: how is Africa immune
ackxhpaez: Someone did a series of videos on nextstrain recently https://www.youtube.com/playlist?list=PL1J8Fh6-iQxIeYUmeKHsyHP0c3LcY8Wyh
Abnico: why did u stop the adderal?
Ghost_001: @jeffery_fan ye but coke is better
fireposeidoncx: George is going insane
farlopote: Spain is fucked
dj_vicio: no one travels to AFrica
St47ik: @logi6000 its not immune just not much ppl travel there
dvdutch: Spains got it bad
kakurai: Let's go to Africa and get some diamonds.
jeffery_fan: @Ghost_001 True
bichid69: check this out bro https://github.com/feiglab/sars-cov-2-proteins
School47: this is EPIC
dohtem213: adderall make u smarter
gamerguy009: Adderal is 1 molecule away from METH
Masturbear: too late 4Head
Abnico: adderal is op for math
AntiVax_SoccerMom: CHYNA KKona
dorkmo: german master race corona
jeffery_fan: US KEKW
iiiiiiillllliiiill: chyna virus confirm
theonlymonkas: LUL
lordBzzl: @logi6000 africa's not immune, could be data not coming back or as fast
esence: look at that duuude, SEATTLE xd
grenaderaven: africa has much younger population than rest of world so they're probably fare better
dvdutch: 1 molecule makes a big difference
dj_vicio: whats the URL For that?
sAfEgUy1: way too late
St47ik: Adderal is a litlle neurotoxin
School47: there is no air blocks even now LUL
ummyeah1929: wait so the earth is flat
UniqumTV: people can still fly china -&gt; japan -&gt; US
Abnico: @gamerguy009 u are retarded lol
dvdutch: The earth is hollow
theonlymonkas: yes LUL
Mariosavitch: blastp sequence search for the helicase of covid19 https://blast.ncbi.nlm.nih.gov/Blast.cgi?CMD=Get&amp;RID=7FWDB250016. - download the search @georgehotz
benzojamal: TRUMP LUL
aasimm: the earth is flat, they came from other side
samthedogg: US democrats were busy impeaching trump to even notice covid
JdPaulBlart: the deep state globalists injected it into our country
dorkmo: flights arnt blocked, just passengers
Apocalyptic0ne: adderall and ritalin are only effective in short burts IMO. Taking them all the time, as prescribed, seems to create a mental haze in my experience. I recommend them for focused tasks though
esence: look at Seattle
pwnbase: pwnbase subscribed with Twitch Prime.
Adolfich: russia knows something @georgehotz
BiszkopTT: This auspice data visualization tool is amazing @georgehotz
bayarealove: bayarealove subscribed with Twitch Prime.
kakurai: flat Earth3 confirmed
St47ik: LUL
lordBzzl: africa probably going to be hit pretty bad: https://www.aljazeera.com/news/2020/03/covid-19-warns-africa-prepare-worst-200322163148759.html
ziNNGG: we past 4:20 😡
wootawee: @georgehotz you want a MSA of the sequences there, probably available via download, then light up the nucleotides and you can see what has changed
Kmerck313: The FEDs will be knocking your soon
THX1342: South America is going to get rekt
kakurai: geo, pls save us.
wootawee: msa = multiple sequence alignment
aasimm: 4:20AM here
fireposeidoncx: This mal proves that the earth is flat
Abnico: @Apocalyptic0ne i agree, now i only take it around 2 - 4 times a week
dvdutch: Will oil prices go down because of this whole thing
wootawee: "download" at the bottom
dohtem213: so it is chinese virus
jeffery_fan: time to move to north pole, I'll expect to see none of you there
theonlymonkas: guatemala
lordBzzl: tldr 1000 people in 42 countries in africa
wootawee: *sequeces*
kakurai: Sony could sponsors geo on his searchs
logi6000: @jeffery_fan say hi to santa for me
blazeofglorytv: @georgehotz gulfstream is a key
Loutlot: torrent?
MuscleMario: DOWNLOAD @ Bottom
Masturbear: theres always junk and hotspots
jeffery_fan: @logi6000 Sure thing, will do
St47ik: cough WutFace
PiroFloydian: HE COUGHED HE HAS IT
StoogeThomas: lol
gattz_: monkaS
kakurai: RIP geo
Ghost_001: quarantine the stream monkaS
grenaderaven: its game over
theonlymonkas: monkaS
cockwizard69: i'm out monkaS
logi6000: no it's just terminal lung cancer don't worry
youngsachi: monkaS
St47ik: NotLikeThis
Ghost_001: no one is allowed to leave now monkaS
anguscupcake: how does george do this shit without a PhD in biology
fireposeidoncx: Rip
gamerguy009: Play plague inc game anyone?/
Nyt1k: monkaS
theonlymonkas: PIR
Apocalyptic0ne: @Abnico that's a good amount. I only take it under high pressure circumstances lol, like if a project is due in a week or if i need to get through a code sprint
Mariosavitch: https://blast.ncbi.nlm.nih.gov/Blast.cgi?CMD=Get&amp;RID=7FWDB250016 searched for the sequence of the helicase
aasimm: are we talking about it evolving over spread?
kakurai: geo, you cant get infected. you're our only hope, geo kenobi.
hazeystream: could you briefly explain what you are doing?
logi6000: @pirofloydian don't worry it's just terminal lung cancer
fireposeidoncx: Rip in chat boys
alex_grist: Do you use regular or ungoogled chromium?
lordBzzl: amount of accessible data is amazing
theonlymonkas: F
Ghost_001: hacking the world @hazeystream
Fulk33: @georgehotz screenshot that graph!
chillguy269: Studying the virus gives you the virus monkaW
benzojamal: chat, he has no clue either xD
wootawee: You could load everything as tracks into Jbrowse or Gbrowse, not so good code, but nice to see things
Nopy1: BTW HACKERS:If some of you want to help in a different way: try hacking up some respiratory machines... they are much needed.
yth1n: https://www.ncbi.nlm.nih.gov/pubmed/17934078 ppl talking about it in 2007, predicted possible epidemy
theonlymonkas: LUL
dohtem213: george learning shit everyday
aasimm: how can rna gene sequences differ of the same viruse&gt;
AntiVax_SoccerMom: what happened to cozy metamath streams esfandCozy
almonte550: If sars-2 is this bad, I can't wait for sars-3
Ghost_001: interesting LUL
dohtem213: FortOne FortOne
St47ik: @almonte550 Sars 3 confirmed by gaben Kappa
iiiiiiillllliiiill: i predicted corona in february, no one listened
logi6000: @antivax_soccermom your username suggest you boutta die
s4j0k5: !uptime
kakurai: China's confirmed Sars3. They said it's gonna be a hell of a season. Cant wait for it.
theonlymonkas: ResidentSleeper
benzojamal: @logi6000 LUL
AleexM: what are we doing?
logi6000: the sequal
Mariosavitch: a better version yes
St47ik: profiler LUL
hazeystream: could you briefly explain what you are doing?
THX1342: it's just stripped code man....
MuscleMario: yall givin out IDA pro licenses in dis bit? !giveaway
aasimm: how can rna gene sequences differ of the same virus?
murkythunder: better ui than ida
Nopy1: @kakurai can's wait for sars03e01
almonte550: @St47ik link?
AntiVax_SoccerMom: logi6000 KKona this is all a hoax to get you to take the autism injections
St47ik: @aasimm mutations maybe
BananStian: @georgehotz What is the goal in what your doing? And how exactly are you reverse engineering the corona virus? Glad to see you trying to do something with the situation tho B)
iiiiiiillllliiiill: @hazeystream pretending to understand viruses
theonlymonkas: LUL
fireposeidoncx: @georgehotz how is your church doing?
ziNNGG: @iiiiiiillllliiiill :DDDDD
dontbeameme: What’s the benefit of reverse engineering this?
aasimm: does it evolve that rapidly?
kakurai: The present season isnt that good. So boring that's almost killing everyone.
Apocalyptic0ne: @iiiiiiillllliiiill well you were a bit late to the prediction there, as it was spreading since november in china xD easy to extrapolate what will happen
benzojamal: @aasimm yes
THX1342: rant time PepeHands
St47ik: LUL
brownyyyylocks: goodie two shoes
BOSSTIEN: inspiring!
School47: LUL
dontbeameme: Real
Ghost_001: not yet* PogChamp
jeffery_fan: Hack the computer virus
Kwallenbeet: LETS DO IT
ktzkalash: LMAO
THX1342: lanaluLetMeIn
Ziv0: LUL
Nyt1k: PogChamp
ICAntF331MyFAce: PogChamp
Duschjenkovic: LUL
patulskitime: hell yeah!
faxity: MY MAN
VanishBlox: LETS DOOOOO IT :D
Kubissus: PogChamp
theonlymonkas: but have you hack the world?
gattz_: PogChamp
BOSSTIEN: LUL LUL LUL LUL LUL
St47ik: PogChamp
benzojamal: you doin good Kappa
VanishBlox: LUL
chillguy269: Is klout chasing really that bad?
snapcs1: PogChamp PogChamp PogChamp PogChamp PogChamp
MuscleMario: ... :( they laughin tho
CompestLive: LMAOOOO
xXICEW0LFXx: what does "hack the corona virus" mean?
pwnbase: pwn
dorkmo: lettttssss gooooo
myaocat: https://msphere.asm.org/content/5/2/e00203-20
AntiVax_SoccerMom: TREMENDOUS EGO PogChamp
0xmilan: love the rants
School47: George, you are the Best )
kleyy: PogChamp
samthedogg: GEORGE THE HYPE MAN
BagBoxx: PogChamp PogChamp PogChamp
peter35_: hack the planet !!
fuseteaseftali: Pog
THX1342: PWN COVID
Ghost_001: we gonna do what ? PogChamp
snapcs1: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp lets goooo
almonte550: Let's hack sars-2 and optimize it to make it more lethal
BananStian: Daym brah interesting B)
CompestLive: PWN vax
revenantrazer: @georgehotz its the first time you're hacking something that's not manmade
jeffery_fan: Corona is actually a computer virus that spreads through internet
snapcs1: PogChamp LETS GOOO PogChamp PogChamp PogChamp
roadrunnervx: lol
theonlymonkas: HACK THE WORLD
esence: good luck, Georgy, corona virus is man-made afterall!
darkzade: AT 700% P`ROFIT PogChamp
fireposeidoncx: Pwn it faster!!!
Ghost_001: LULW
BOSSTIEN: lul
aasimm: for those of you who don't know. I'm gettin sued by soni
SlamchestPowerthrust: lol
revenantrazer: @georgehotz its the first time you're hacking something that's not manmade..
Cornflays: billionaire PogChamp
ICAntF331MyFAce: PogChamp real money making time
dontbeameme: So this is for a vaccine, okay
FargioFarmani: welcome to communism
GeneralSoak: leeroy jenkins
Ghost_001: REAL PogChamp
theonlymonkas: scammer
revenantrazer: @georgehotz its the first time you're hacking something that's not manmadee
jeffery_fan: @revenantrazer Or maybe it is KEKW
bigie: how about coma.ai for the website ?
ICAntF331MyFAce: noobs will pay PogChamp
peter35_: clout baby
THX1342: LUL if you can't git clone you have to open your wallet, noob
vozdra: ItsBoshyTime https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4797993/#!po=0.943396
caine_corp: Are you sure you didn't take adderall?
BOSSTIEN: corona
mechanic_hammer: [Hell] Pwn the virus ! (Pt: 1,000)
aasimm: calm down
snapcs1: its usually true
Kmerck313: Nobody
caine_corp: LUL
iiiiiiillllliiiill: addy kicking in Pog
iTeQo_: Bro talk less and hack faster
parviz_gc: yeeee
roadrunnervx: have you thought about the name of your github repo yet? Has to be something cool
dontbeameme: Open source = Trojan horse for data
almonte550: How hacking coronavirus will affect augur 2.0?
kakurai: don't sell the cure to Sony's executives
iskjmss: yep he took addy
jeffery_fan: Im the first type!
Scyned: xD
benzojamal: how much would a corona virus cure be worth right now?
ziNNGG: @iskjmss :DD
dontbeameme: REAL
St47ik: LUL
ancientchineseelder: addy cotton mouth requires tea at lightnin speeds
PiroFloydian: tbh im prob a hypocrite
St47ik: Any truers
Apocalyptic0ne: y'all don't understand how adderall works for those who have adhd... He'd still be sitting focused and less talking
snapcs1: PogChamp PogChamp PogChamp
lgtst_: the truth
theonlymonkas: you are losing it geo
MuscleMario: nom nomz
MrSnoopDog: ayy lmao
dontbeameme: True
snapcs1: Kreygasm thank u george
Cornflays: yeaaaah brooo
FargioFarmani: oh boy how I missed these streams @georgehotz
icyvran: Flavor?
11plus4thinking: hes losing it monkaS
StoogeThomas: ice cream brand?
jeffery_fan: George Hotz tellin the truth on twitch
chillguy269: This is content
guacDev: what kind of chair is that
esence: THANK YOU BRO, GIVE ME SOME MORE
Crypod: FeelsAmazingMan 👈
Tompuscina: what happened
programmer42: George, you're cool bro
ideology_sniffing_raccoon: gachiHYPER
Mlewii: midlife crisis ?
theonlymonkas: BrokeBack
aasimm: asshole hypocrite
St47ik: don't eat it DansGame
u1337ochka: https://clips.twitch.tv/ExpensiveSparklyFlyWow
dontbeameme: Does this lead to hacking the simulation?
murkythunder: SIMP walk
St47ik: @u1337ochka LUL nice
MuscleMario: lol
School47: @Tompuscina we are hacking corona to make vacine
benzojamal: gay walk LUL
theonlymonkas: @Mlewii probably
logi6000: yo I swear one day the FBI gonna knock on George's door for speaking too much truth
fireposeidoncx: Stop eating pwn it faster!
firemang: firemang subscribed with Twitch Prime.
St47ik: nCoV readthedocs PogChamp
almonte550: If you hack coronavirus, will Sony sue you again?
guacDev: 5head
programmer42: thanks @u1337ochka
BagBoxx: PogChamp PogChamp
ancientchineseelder: lmfao
TrippinFlare: so what's the approach @georgehotz ?
gamerguy009: Are we living in a simulation?/
dontbeameme: mother terica was a do gooder
ABAD1DEA: Kappa
theonlymonkas: yes
cutza: Hack it for profit
jeffery_fan: NotLikeThis NotLikeThis NotLikeThis
Tompuscina: @school47 how is he doing so far
benzojamal: creating a botnet?
Jehhred: we're hacking corona to put on GitHub
aasimm: no we are hacking corona to mine crypto
11plus4thinking: @logi6000 the fbi is a bunch of idiots
inDOObitablee: We will deal with it when we get there.
lgtst_: ice cream with fries
theonlymonkas: potato
chillguy269: What's truth?
t3rminal: geotangent
dontbeameme: I wish I could see the optamizm
TrippinFlare: so what's the approach @georgehotz ?
snapcs1: true af
jeffery_fan: We will migrate corona from IRL to a computer virus
dontbeameme: George should never speak to children
theonlymonkas: Kappa
pwnbase: @georgehotz opinion on Peter Thiel?
MuscleMario: Re FBI: ... I want Geo to say something about Aaron Swartz
AleexM: george is such a legebd
dj_vicio: who is he talking to?
snapcs1: george is never wrong about anything
School47: @Tompuscina its only the begining as you see LUL
TrippinFlare: TRUEEEE
aasimm: we are hacking corona to mine crypto
almonte550: What truth? all the information is public on the internet, everything can access it
ideology_sniffing_raccoon: TRUEEW
AntiVax_SoccerMom: FIGHT THE POWER
murkythunder: @dj_vicio us
Nyt1k: @dj_vicio me :-)
peter35_: true bro FeelsBadMan truuuee
iiiiiiillllliiiill: addy peaking
theonlymonkas: se lost him
esence: economics degree LUL
jeffery_fan: we will upgrade corona to spread through internet
St47ik: @georgehotz calm down bro LUL
fireposeidoncx: Fuck Corona lets play minecraft!
dj_vicio: that's it. He needs the Aderall
Cornflays: FeelsAmazingMan 🍄
TrippinFlare: TRUEEEEE
patulskitime: blame the fed
guacDev: what kind of chair is that
School47: @jeffery_fan LUL
DecayingSkullz: love is the answer
bufferovrflw: ctf, capture the flu?
dr_set: those are making 50 million in wall street, we got left with ketchup
aasimm: we are hacking corona to mine crypto
bufferovrflw: *catch the flu
St47ik: Alex Jones mode
AntiVax_SoccerMom: quitting adderall was a mistake FeelsBadMan
davidgames68: @guacDev Herman Miller SAYL Chair
kakurai: PS5 Sars-Cov2 DLC confirmed
razr22: you need to go on JRE with eddie bravo
inDOObitablee: Lets create corona that only targets wealthy people
murkythunder: math DansGame
anguscupcake: which EE textbook should i get
TrippinFlare: so what's the approach @georgehotz ?
dontbeameme: Lol
tohsdnilb: fuck mAth!
vozdra: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4797993/#!po=0.943396
lgtst_: magic is math
St47ik: Slurp
ICAntF331MyFAce: math WutFace
almonte550: So we haven't solve coronavirus because of math
node_storm: that is true
theonlymonkas: we love math
dontbeameme: Lolol
Ghost_001: he is high LUL
jeffery_fan: Math NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis NotLikeThis
Tomishima: quick math?
nashesvobodnoye: magic IS MATH
gattz_: Kappa
St47ik: Math or m eth Kappa
theonlymonkas: slow math
Ghost_001: Kappa
worleywarrior: Fuck math, all my homies hate math
parse: Kappa
youngsachi: Kappa
ideology_sniffing_raccoon: Kapp
jeffery_fan: Weed
TsarSec: Kappa
reckful_bald_spot_114: Kappa
dontbeameme: ewwww math
VanishBlox: Is magic related to math?
okhandjoyjoyjoy: Kappa
nudax: LUL LUL
xXICEW0LFXx: dammit geo, now i'm eating ice creme you're a bad influence
FargioFarmani: you're not good at math are you ?@georgehotz
lgtst_: the hole point of doing math is having magic in the brain
Tomishima: just play AC for fun.
anguscupcake: is math related to science
Apocalyptic0ne: lol he should definitely be on JRE, I'd definitely watch that episode
kakurai: geo, o Brasil te ama
Ghost_001: Kappa who knows
MuscleMario: Aaron Swartz
dj_vicio: give him the aderall
Yemtex: mr. robot are you there ?
jeffery_fan: He
St47ik: magic is related to m eth Kappa
gamerguy009: Try smoking crack
diegoarigony: what he uses?
barrenaps: You are sounding like a crackhead
tohsdnilb: math math=fuckit
VanishBlox: Give him the coke
yevheniiushtyk: at least you're not a noob ;)
St47ik: DansGame
dontbeameme: Math and magic should never go together, pure blasphemy
logi6000: it could be autism. or a certain strain
ICAntF331MyFAce: oh no, someone has energy must be addy rockin :)
theonlymonkas: are you real life mr. robot???
Cornflays: FeelsAmazingMan 🍄
tiagodopke: joe rogan needs to get on george's strea
iiiiiiillllliiiill: lmao
dj_vicio: life's not that binary my friend
Mariosavitch: https://www.ncbi.nlm.nih.gov/projects/msaviewer/?rid=7FX88B5301R&amp;coloring=cons MSA comparison of the helicase @georgehotz
VanishBlox: LUL
jeffery_fan: Drug the CPU
saintmthw: 5Head
revenantrazer: yup
revenantrazer: intersting point
tohsdnilb: is this matrix 4
THX1342: yes
revenantrazer: its actually
logi6000: @theonlymonkas that could be it
revenantrazer: the problem with reductionists
lgtst_: right
PiroFloydian: hm
lgtst_: exactly
THX1342: it's using a canon to kill an ant
revenantrazer: thats a reductionist argument
myaocat: http://virological.org/t/alignment-of-58-sarbecovirus-genomes-for-conservation-analysis-of-sars-cov-2/430
theonlymonkas: D E E P
JdPaulBlart: ive been enlightened
St47ik: @georgehotz vaccines are software patches Kappa
esence: good points, tbh
11plus4thinking: so go to a psychiatrist basically
PiroFloydian: so how does that transfer to fixing mental health stuff @georgehotz ?
TheSpeedyLive: some deep shit
yevheniiushtyk: Sounds like something Intel would say
dj_vicio: my head hurts, do I cut it off to fix the ache?
benzojamal: so deep Kappa
ideology_sniffing_raccoon: when are you going on Joe Rogan ?
revenantrazer: software is way easier
Jehhred: software is hard....ware
revenantrazer: all discrete
revenantrazer: unlike nature
t3rminal: can you write a for loop or something?
MrBankster: you're take on covid being a hoax?
ninjadidio: true
leesingods: So the way you think is software???
almonte550: So are we creating coronavirus software to fix our bodies?
Cornflays: LUL
ICAntF331MyFAce: LUL
11plus4thinking: PIZZA? OpieOP
theonlymonkas: do joe rogan
swagomgswag: israel
AntiVax_SoccerMom: Israel?
snnoox: What about his self driving car project?
benzojamal: isreal?
dr_set: they are not trying to fix it, they are trying to make money . It's an incentives problem.
nudax: nice eyes man
peter35_: israel monkaS
JdPaulBlart: nah we just need to hack the simulation somehow to get to the real root of the hardware issue @georgehotz
jeffery_fan: Corona is not Real KEKW
Tomishima: Adrenochrome is not real chat!
Bitcoin__: Bitcoin__ subscribed at Tier 1. They've subscribed for 12 months, currently on a 12 month streak! I wish I had more time to watch ur streams, maybe Covid-19 can fix that? :D
ToxicVulpes: @georgehotz are you still pro $BCH ?
vrooom_vroooooom: @t3rminal lmfao
St47ik: @georgehotz vaccines are software patches KappaWealth
THX1342: yeeeeepppppp
Pasha_Pechkin: @georgehotz it's all good, but can u hack a russian government?
FargioFarmani: true that
myaocat: @georgehotz http://virological.org/t/alignment-of-58-sarbecovirus-genomes-for-conservation-analysis-of-sars-cov-2/430
theonlymonkas: i like this
cutza: LOL
11plus4thinking: LUL
flaczq: what is your main source of income, sir?
Snowlav: LUL
bigie: wanna go off on flat earthers ?
youngsachi: LUL
St47ik: LUL
Nyt1k: 4Head
guacDev: LUL
Cornflays: LUL
dontbeameme: it’s called 1984 George Orwell
VanishBlox: LUL
lemonspree: how is he not on drugs today
dontbeameme: Nobody listened
Marcel63: kappa
bufferovrflw: Is he bipolar?
dj_vicio: yea.. he needs another dose of Aderall
theonlymonkas: no
logi6000: @dontbeameme def one of my fav books
Connieboyboy: he has to be on druhs
THX1342: Snowden was a redemption to a lot of nerds considered conspirators
Connieboyboy: drugs
PilotHaman: https://clips.twitch.tv/ShyPeppyMangetoutPunchTrees
tahiraslam8k: What about Area 51?
theonlymonkas: he is the drug
shlver: I believe it. :)
zombiedigital: earth is pizza
Apocalyptic0ne: lol he's not on drugs
dvdutch: The earth is hollow. Open your eyes.
11plus4thinking: KKona EARTH IS FLAT MAN
AntiVax_SoccerMom: monkaS you have too much faith in society
leesingods: no people do believe that and its sad
St47ik: he doesn't need drugs LUL
Halixness: how is it going with the reverse engineering thing?
almonte550: Are we optimizing covid-19 or not
lgtst_: sugar injection
ICAntF331MyFAce: oh no, someone has energy must be drugs :)
ancientchineseelder: he microdosed salvia just before he started going on steram, someone clipped it earlier
School47: Ppl don't care they have no time to think about it
dontbeameme: People believe skinny jeans are good, so anything is possible to manipulate
tohsdnilb: good example of not making it months in quarantine
ageMonkey: haha
bufferovrflw: Watching George rant about conspiracies and eat ice cream
bufferovrflw: damn
Halixness: @almonte550 optimizing it would be pretty risky innit
tornpaperyoyos: oh hey george is streaming again
Bitcoin__: My day is ruined however, people have banana on their pizza.
Mariosavitch: here is the orfa1 msa diffs .. zoom in to see the code https://www.ncbi.nlm.nih.gov/projects/msaviewer/?rid=7FXGTZFN016&amp;coloring=cons @georgehotz
ktzkalash: @georgehotz forget about Rona. We want you unlocking the new PS5 that is coming
Fr0zenOfficial: So george what you do all day besides this? :D
Apocalyptic0ne: salvia lasts only a couple minutes max
dj_vicio: now he needs to hack glucose levels so that ice cream doesn't take a toll on him.
ideology_sniffing_raccoon: Epsteins death was weird
dontbeameme: George is definitely in the know
dongmuya: So far Hotz has solved the ice cream problem
logi6000: amped George is what I fucking live for
kiikoh: any progress here?
TrippinFlare: so what's the approach @georgehotz ?
Tomishima: he has take Adderall after weeks today SMOrc
mmi18: is that a 3d printed chair&gt;
MuscleMario: He's exhibiting symptoms that a medical professional would probably diagnose as manic depression. All great people are like this, society just wants to sell u that its a problem and sedate u.
Halixness: @georgehotz why not predicting the spread of the disease?
School47: is it hackable? ))
whitesaucey: hows comma doing???
almonte550: Is it Alex?
yth1n: https://www.ncbi.nlm.nih.gov/pubmed/17934078 predicted in 2007
youngsachi: mon
dontbeameme: Can you just do virtual experiments on AI
LaminertKatt: whats happening today folks?
guacDev: its the government
dj_vicio: oh shit, his wife. that' sit guys. Streams' off
esence: is it NSA
ziNNGG: coronas callin monkaS
AntiVax_SoccerMom: FBI OPEN UP SwiftRage
tohsdnilb: it's Trinity calling
dj_vicio: it's the CIA
youngsachi: monkaS
boxtooo: fbi monkaS
snapcs1: the FBI monkaS
cutza: BiLl gAtEs CrEaTed cOroNaViruS tO ImpLanT EveRyOnE wItH DiGitAl InK
swagomgswag: fbi heard him
Mariosavitch: u owe taxes
21_savior: monkaS
PilotHaman: FBI
School47: its CIA LUL
theonlymonkas: is the government
Apocalyptic0ne: FBI ON THE LINE
dontbeameme: CIA
ktzkalash: FBI CALLIN HIM
guacDev: FBI
chillguy269: monkaS
THX1342: it's the FBI telling him to stop streaming
ICAntF331MyFAce: monkaS
11plus4thinking: FBI OPEN UP LUL
benzojamal: monkaS
ktzkalash: LMAO
dj_vicio: Trinity hahahahahhaa
murkythunder: @MuscleMario stfu armchair psychologgist
Nyt1k: FBI
logi6000: I heard security
dvdutch: Its da CDC
razr22: monkaWait
PilotHaman: this stream is done
dontbeameme: FBI open up
lllowe: FBI OPEN UP
whitesaucey: george from statefarm
guacDev: FBI LMAOOOOOOOOO
fireposeidoncx: Its Obama MonkaS
alexandru_cristiean: Trump's calling
flaczq: "this is corona, pls end the stream"
nudax: lol
davidgames68: CIA FeelsBadMan
dj_vicio: oh shit
ninjadidio: morpheus
Mariosavitch: rofl
Apocalyptic0ne: RAIDED
Luccaasss: FBI, stop with this
ideology_sniffing_raccoon: monkaW
almonte550: FBI omg
logi6000: oh it's landlord
theonlymonkas: trump on the phone
St47ik: NotLikeThis
Restless_Bagel: monkaS
gamerguy009: IRS
almonte550: RUN
o______________________k: FBI OPEN UP
dontbeameme: FBI open Up
ktzkalash: lmaooooooooo
razr22: monkaW
maqebane: lol
guacDev: hahahahhahahhaha
Mariosavitch: stop making noise rofl
Fr0zenOfficial: "hello stop working on covid thank you." what a monkaS moment
VanishBlox: They caught him bois, Bio terror is no more!
alexyzdev: FBI
saintmthw: @ninjadidio LUL
benzojamal: landlord? LUL
MorningScifi: Landlord is angry yo
youngsachi: monkaS monkaS
Mariosavitch: TOO LOUD rofl
logi6000: fbi
almonte550: RUNNNNNNN
FargioFarmani: FBI guys
worleywarrior: NOISE COMPLAINT LUL
alexandru_cristiean: direct line with the White House
dontbeameme: F B I
guacDev: lmaoooooooo
Apocalyptic0ne: RAID
razr22: MonkaW
logi6000: CIA.
dj_vicio: too loud hahahahahaha
MuscleMario: @murkythunder im an armchair meteorologist
Mariosavitch: hahah
bufferovrflw: :DDDDDD
theonlymonkas: FBI
chillguy269: LUL
shlver: LUL
fwef64: @georgehotz how are are you willing to take this corona series?
snapcs1: LUL LUL LUL
vrooom_vroooooom: LUL
alexyzdev: HAHAHAHAHAH
Restless_Bagel: LUL
adamcernycz: Corona upstairs? :monkas
11plus4thinking: LUL
alexandru_cristiean: "no worries Donald"
St47ik: LUL
benzojamal: LUL
kleyy: LUL
VGBurnzy: this guy doesn't have a landlord lol
Fr0zenOfficial: fbi open up LUL
Ziv0: LUL
FargioFarmani: too loud
esence: 500000000 SHEKELS DEPOSITED INTO YOUR ACCOUNT
dvdutch: LMAO
dontbeameme: Looks away like we can’t hear him
Penguino138: They thought you were being loud? lol what a joke
mechanic_hammer: Open up! FBI
St47ik: Loud rant LUL
nudax: HAHAH wtf is happening
leesingods: Is the software you're talking about for humans are the way they think??
lgtst_: conspiracy
vaskogomez87: you think?
shlver: TOO LOUD
JdPaulBlart: Bogdanoff
dr_set: ? you are not been loud
baezor: XD
bigie: ! do you live in a retirement home ? that wasnt loud
dj_vicio: being loud == CIA tells him to shut the operation.
nashesvobodnoye: LUL
theonlymonkas: LUL
chillguy269: THEY ARE TRYING TO SHUT DOWN YOUR TRUTH TALKING MAN
kiikoh: your not loud
ideology_sniffing_raccoon: "TOO LOUD"
THX1342: upstairs neighbor was raided by mistake
School47: why everything is red?
kiikoh: it's not late either
Apocalyptic0ne: its 4pm, who the fuck complains about you being loud?
SpecialAgentSkye: monkaS Be quiet chat monkaS
Nyt1k: monkaS they are watching
pixelzman: hey hey hey
Kmerck313: I knowwhat you did last summmer
Bitcoin__: Play some loud music :D
dontbeameme: Nobody is working so what’s the problem, your quarantined
theonlymonkas: the fbi
ICAntF331MyFAce: neighbors NotLikeThis
VGBurnzy: @georgehotz hope you're doing well my man!
tome_silva: does he have Asperger's?
ktzkalash: LOUD = TOO MUCH EXPOSING
dr_set: TheIlluminati
esence: who the fuck calls you to tell you about lowering your voice?????????????
alexandru_cristiean: lmao if geohotz has to be quiet in his own house then I have no hope for true freedom
FargioFarmani: please whisper from now on @georgehotz
Fr0zenOfficial: probably getting mad bc he said corona too many times in the building LUL
logi6000: @chillguy269 they called me a madman. said the FBI were a bunch of idiots. look at it now George is being quiet
dj_vicio: CIA tells him to stop bragging or else RIP
esence: the land of the free LUL
shlver: you should get even louder Kappa
peter35_: we all have the tism here bro
Snowlav: LUL
benzojamal: that's the reason why he loves anarchism?
Mariosavitch: yes, take the sequence and enter it into "blastp" and then click MSA Viewer after results are done @georgehotz
Kmerck313: adilanHack
cutza: BiLl gAtEs CrEaTed cOroNaViruS tO ImpLanT EveRyOnE wItH DiGitAl InK
yth1n: https://www.ncbi.nlm.nih.gov/pubmed/17934078 predicted in 2007
chillguy269: @logi6000 Be careful out there brother, there can only be so much truth spoken at once
dontbeameme: did George y’all about EARN it act?
dontbeameme: Talk ?
fbmtr: Sars coronovirus?
amek7: where he lives?
dj_vicio: neighbor who called is a conspiracy theorist hahahahaha
theonlymonkas: COOL
logi6000: @chillguy269 my agents already on to me.
FargioFarmani:  1 @dj_vicio
dontbeameme: Did George talk about EARN it Act?
School47: is it DNA od corona?
Penguino138: Sounds like your neighbor needs you to scream CORONA more
kleyy: the virus is trying to tell us something monkaS
kittenplan_et_al: https://en.wikipedia.org/wiki/Human_coronavirus_NL63 has someone posted this yet? similar virus that binds to the same ACE2 receptor and causes fever, cough, and pneumonia
mescal33t: beastyAmazin
aethuall: I only found out how good biopython actually is. After refusing to use it and writing my own code for the longest time I caved in and just used it, makes my life so easy
Mariosavitch: You can search "blastp" for the protein and look at the MSA viewer to see the diff @georgehotz
almonte550: But the real question is, is our body running on 32bits or 64
aasimm: so we are looking at multile samples?
yth1n: https://www.ncbi.nlm.nih.gov/pubmed/17934078 predicted in 2007
theonlymonkas: 32 bit
aethuall: Yeah doing a blastp is good
kiikoh: @georgehotz do you have biochem background?
logi6000: nah 512 bit
ktzkalash: TELL UR NEIGHBOR YOU FINDING CORONA CURE. DO NOT SHARE WITH HIM
School47: @kiikoh this is not nessesary for him LUL
ziNNGG: monkaS
razr22: LUL
cutza: you are not even loud wtf
jeffery_fan: Hacked house
guacDev: the NSA
lgtst_: how the heck they know all the contacts?
Snowlav: monkaS
Penguino138: Then it's not ur fault George, u do u
TrippinFlare: Email complaints PogChamp
o______________________k: CALI LUL
chillguy269: They're trying to silence you bro, I am telling you
Apocalyptic0ne: lol fuck your neighbors, they sound like asshats
jeffery_fan: hacked KEKW
adamcernycz: I guess it is a bug then monkaS
esence: commiefornia
dr_set: Somebody doesn't like you and they are making stuff up
aasimm: fish em
informalgarlic: dude you allowed to make noise during day @georgehotz
t3rminal: no vaccine for him
boxtooo: fbi breaking in to make noise to get you on the streets
murkythunder: CHEW ICE
LaheyFPS: headspace LUL
Mariosavitch: GOV trying to shut down your real life CTF hacking
AntiVax_SoccerMom: slap out a quick fap
St47ik: Headspace time Kappa
guacDev: its comma ai's competitor
TrippinFlare: headspace OMEGALUL
iiiiiiillllliiiill: 420
eduardoadf1: !uptime
jeffery_fan: Kreygasm Meditation Kreygasm
dontbeameme: imagine calling George for noise complaint, the guy who hacked the first iPhone lol
slimpimp007: after he first complaint, Karen will come with another one soon after
Bitcoin__: When u have that type of neighbor, move out right away. Fuck those
azogshady: damn that's a big head g3orge
lgtst_: screw calming down, doesn't activates the brain
kakurai: has someone complained about him being loud?? LUL
Mariosavitch: lol
ktzkalash: plot twist your neighbor is a CIA agent
ziNNGG: :DDDDDDDD
VanishBlox: Calm chat
lebop: ???
ninjadidio: haaahahy
emel_ryan: headspace?
Hawklite: meditation is a waste of time just visualize yourself in the 3rd person for 10 seconds then your'e good to go
VanishBlox: Let's Calm
lgtst_: CORONA SOLVING NEEDS RAGE
o______________________k: squadOmega squadOmega squadOmega
Fr0zenOfficial: lets do this @everbody
LaheyFPS: 🙏
informalgarlic: @georgehotz meditation is too loud!! @georgehotz
dj_vicio: he reminds me of Josh from Watchdogs 2 LOL
icyvran: The accent is really important
aethuall: This is now a :) zone
murkythunder: turn that down youll get another noise complaint
Panerakis: LUL
dvdutch: :)
lgtst_: SHUT THAT SHIT
kiikoh: phone speaker is louder than you are
a_ato: LuvSnooze LuvSnooze
dj_vicio: too loud
shlver: FEELING
lebop: what is happening
VanishBlox: @everyone shut up headspace time!
o______________________k: :) zone
dontbeameme: Ewwww
theonlymonkas: let's open up those chakras
aethuall: Everyone spam :) to relax
MuscleMario: he tryna medidate and read chat.
alfyfav: rlly???
esence: AY TONE, CAN YOU TONE DOWN THAT CORONA VIRUS REVERSAL
Snowlav: 🙏 chat
Apocalyptic0ne: do your neighbors know who you are? You need to show you're the alpha male in the building
Penguino138: get ready for another call. Phone is wayyy louder than geroge
MJT_au: this meditation guy is about to sell you some crystals
iiiiiiillllliiiill: :)
informalgarlic: meditation is too loud
Yemtex: !time
dontbeameme: Why do I feel worse from this guys voice
brownyyyylocks: stop reading chat geo focus
kleyy: drhgBreath drhgBreath drhgEye drhgEye
guacDev: STOP LOOKING AT CHAT GEORGE
dvdutch: :)
Mariosavitch: hah
sircrocodile163: MUCH FEELINGS LUL
VanishBlox: @everyone Calm, it's headspace time!
icyvran: Copyright complain!!!
dontbeameme: George has a thing for British accents
dj_vicio: is that Alex Jones
Fr0zenOfficial: guys just roll with it and mediate aswell :)
anguscupcake: we're going to build a wall and make the corona pay for it
PiroFloydian: :)
dontbeameme: Imagine having a guy to relax u
dj_vicio: wtf is happening
ideology_sniffing_raccoon: ????
aasimm: dont focus on comments bitch
davidgames68: @Transferer :-)
lgtst_: that was awful
benzojamal: call dr. k, he will teach you how to meditate :)
murkythunder: having a guy tell u to relax is sorta gay ngl
icyvran: Challenge: Meditate while reading the chat
farlopote: PixelBob PixelBob
zombiedigital: da fucks going on here
gabo_sk: ResidentSleeper
MuscleMario: @murkythunder lol
adamcernycz: I hear that meditation tape even in Europe kappa
amek7: where he lives? in usa?
ktzkalash: WAKE UP THIS MATRIX
darkzade: BlessRNG
Marcel63: Ehm.. good night?
AntiVax_SoccerMom: ResidentSleeper .........
dj_vicio: he blacked out?
almonte550: Lets open up those chakras to let the virus enter more easily
ideology_sniffing_raccoon: .............
Penguino138: reach boner yet?
dj_vicio: illuminati told him to do that
esence: SLEEPING STREAM
JarlVonBarf: I thought the stream froze
dontbeameme: over 9000
benzojamal: ResidentSleeper
brownyyyylocks: omg geo==neo
cutza: SHHHH
sircrocodile163: WAKE ME UP SwiftRage
diegoarigony: what am i doing here
lgtst_: just sleeping
dj_vicio: strream froze on me too
Snowlav: monkaS
dj_vicio: its the NSA
VanishBlox: Shhhhhhh! sleeping stream
lgtst_: category
ktzkalash: U KNOW CIA IS CONTROLLING HIM
o______________________k: squadR HEY DUD where is my content @georgehotz DUD squadR
1gonyali: bi Ferdi Öğzbeğen Dilek Taşı dinle hiç bişeyin kalmaz
maqebane: meditation
vaskogomez87: reckful streaming? lol
pedrovictortech: Is that the "10 percent" app?
aasimm: he passed out
dj_vicio: CIA is erasing his mind right now
icyvran: Meditate while listening to the calming computer fan
sircrocodile163: I CANT WAKE UP SwiftRage
gabo_sk: f
snorting_milk: he fell asleep
dr_set: hack the guy that complained tv, and put it in perma max volume so everbody wil complain about him
dontbeameme: The noise complaint triggered George into meditation
Fr0zenOfficial: is his cam frozen or did he diededed?
almonte550: Is this part of solving coronavirus?
ktzkalash: MK ULTRA SHIT
chillguy269: @pedrovictortech its headspace
diegoarigony: dead
kleyy: drhgBreath
adamcernycz: Compression alg just chilling, no need to work, still image LULW
guacDev: rip
t3rminal: WHO PUT ADERALL IN HIS ICECREAM?
pedrovictortech: @chillguy269 Thanks!
MuscleMario: formatting his disk rn
Fr0zenOfficial: WAKE UP
myaocat: "smithereens" someone?
benzojamal: corona symptoms monkaS
Snowlav: he disconnected irl monkaS
TrippinFlare: ResidentSleeper
tiagodopke: actually losing viewers
ideology_sniffing_raccoon: is george getting hack by the deep state LUL
esence: D E F R A G M E N T A T I O N
ninjadidio: guys he's power up
almonte550: Geohots left the chat
Fr0zenOfficial: he escaped the matrix
allhail2daking: How you hacking rona virus?
TrippinFlare: meditation ResidentSleeper meditation ResidentSleeper meditation ResidentSleeper
21_savior: xqcMood
iiiiiiillllliiiill: the corona complained to your landlord because he was afraid
BananStian: Wake me up, wake me up inside FortBush
dontbeameme: Why do I feel ASMR coming on
bufferovrflw: Someone got root shell on him
dj_vicio: Agent Smith's work
VanishBlox: Chill he's changing his grapichs settings, it's too heavy on his pc
guacDev: he jailbroke the simulation
dontbeameme: ASMR next chapter
MuscleMario: D E F R A G M E N T A T I O N INITIATED
allhail2daking: Show us your desk setup
slayerdaniel: he’s having an out of body experience right now he’s hacked the simulation
ktzkalash: SO HE JUST TOOK THE REDPILL WHEN HE SIPPED WATER
dontbeameme: Simulation hacked
lgtst_: so someone calls in asks to be quite and george ends up sleeping. No conspiracy you say?
dj_vicio: CIA BRAINWASHING BEGINS........
esence: I FEEL SENSATION IN MY PIPI
TrippinFlare: corona incoming
erlsek: tanoviSHT
gabo_sk: this new episode of mr robot 2 is 1337
VanishBlox: He got a phone by the matrix boys!
ninjadidio: Jilbroke himself
ktzkalash: @lgtst_ LMAO
VanishBlox: THE MATRIX CALLED HIM
almonte550: He now will be able to solve all the world problems
o______________________k: I WANT CONTENT NOW DUD squadR squadR
TrippinFlare: squadW in the chat
FargioFarmani: which app is he using? @channel
thxslo: so thats how you reverse these ddays ? =)
ktzkalash: HE'S GETTIN READY FOR MATRIX 4
dj_vicio: someone clip this please. He's making history
revenantrazer: meditating before solving coronavirus
o______________________k: squadW squadSquad
ideology_sniffing_raccoon: APE GANG squadW
PiroFloydian: hes using headspace
imopfloors: he's temporarily leaving the simulation
Cornflays: nmpW
revenantrazer: 5head
mauke53: @FargioFarmani Headspace
brownyyyylocks: doesnt work on me
VanishBlox: George is new matrix actor????
MuscleMario: squadW yeeee
4zimut: wake up neo
kleyy: drhgBreath
vaskogomez87: any giffters bouys?
o______________________k: HEY squadR you awake DOMIE
VanishBlox: Neo wake up
Ziv0: mizkifHA
dontbeameme: I’m falling asleep, we not getting a cure sleeping
dj_vicio: Wake Up George....... the CIA has you
esence: AY TONE, CAN YOU MAKE THAT HACKER STFU
lgtst_: KNOCK KNOCK
icyvran: **This stream is sponsored by Headspace**
ninjadidio: follow th white rabbit
tiagodopke: hey george bring me some stuff from the outside
TrippinFlare: any oil princes OMEGALUL
logi6000: yo hotz is in the matrix right now so chill
stole_yo_eip: namaste
cutza: Watching e-girls sleeping level of quality stream right here
o______________________k: hey @georgehotz I need my exploit chain DUD squadR squadR squadR
ktzkalash: HE EVEN LOOKS LIKE YOUNG KEANU REEVES
Mlewii: !uptime
lgtst_: liquid sunlight my ass
vaskogomez87: stop staling domer
PaoloSisto: when is he going to discover the vaccine?
dontbeameme: So this is how hypnotism works
ideology_sniffing_raccoon: HEEEEELOOO squdW
sircrocodile163: JUST MEDITATE BRUH KEKW
razr22: stop looking at chat george
dj_vicio: shit, he's awake
VanishBlox: yo hold up, this is irl neo, the people who called him were the matrix
adamcernycz: Liquid sunlight, ooooook
Pasha_Pechkin: @lgtst_ who's where?
iiiiiiillllliiiill: you are all breathtaking
slimpimp007: this sounds a little sus
TrippinFlare: 24 HOUR VACCINE HACK STREAM PogChamp 24 HOUR VACCINE HACK STREAM PogChamp 24 HOUR VACCINE HACK STREAM PogChamp
Mariosavitch: *ring ring*: "Yeah we have complaints of someone meditating.. any idea?"
Dawoud3: drdisrepect V.2
o______________________k: squad1 squad2 squadOK
VanishBlox: anybody suspecios?
lemonspree: for how long is he doing di
dontbeameme: George has ADD, no way he is going clear right now
almonte550: Is @georgehotz opening his third eye?
dj_vicio: Corona's payback
sircrocodile163: ResidentSleeper
logi6000: everyone say ban questions now he's in the matrix he can't see i
cutza: Just like watching thots sleeping
Penguino138: i just took a shit and this is still going on lol
sircrocodile163: ResidentSleeper GO ON
o______________________k: squadL squadL squadL squadL
cammbamm92: cammbamm92 subscribed at Tier 1. They've subscribed for 4 months! WAKE UP
gabo_sk: geohot final form monkaS
Mariosavitch: danHmm
MuscleMario: I am from the future George, P R O O F: In the next few moments we will have 2 gifted subs.
brownyyyylocks: uhp opened eyes
VanishBlox: Everyone this is a calm stream
VanishBlox: Shhh
ktzkalash: PLOT TWIST: THEY BRAINWASHING US
thxslo: heaspace 10 min sessiosn =)
OptoCloud: Why u still meiditating? NotLikeThis
eduardoadf1: !uptime
lgtst_: why we still here
TrippinFlare: downloading code PogChamp downloading code PogChamp downloading code PogChamp downloading code PogChamp
dj_vicio: !uptime
Apocalyptic0ne: MOTHERFUCKERS, DO THEY KNOW WHO THE FUCK YOU ARE?
slimpimp007: George probably stressed tf out running a startup during all this
Br4nnon: monkaW transcending space and time monkaW
sircrocodile163: everybody shut up i have an erection
Br4nnon: monkaS *
saixj: f
ninjadidio: just to suffer
adamcernycz: I believe corona is meditating as well so it is a fair game
VanishBlox: He's doing that contact sequence where he opens his cabient and jumps out of the goo and goes into the sewrs
tokumei64: woah this sounds like hypnosis stuff
dj_vicio: @sircrocodile163 in your ass
iiiiiiillllliiiill: addy reaching critically low levels
cammbamm92: LOL @sircrocodile163
o______________________k: @sircrocodile163 HEY DUD ME TOO squadR squadR
benzojamal: viewcount 👉 📉 ResidentSleeper
lgtst_: the voice is about to ask for credit card number
lgtst_: 100%
icyvran: **This stream is sponsored by Headspace**
aasimm: does it help
darkzade: DOWNLOADING NEW DNA FROM GOD TO DECODE CORONA
VanishBlox: Hey, you're finally awake :)
logi6000: hey future George guy do I get a sub in those next few moments
Restless_Bagel: @icyvran raid shadow legends LUL
cutza: SLEEPING STREAM WITH HOTZ
Jehhred: Dude looks high in air
4zimut: send link
stole_yo_eip: namaste
ideology_sniffing_raccoon: this chat is shame less LUL
esence: TIME TO STOP PRETENDING
Apocalyptic0ne: Fuck your neighbors
Marcel63: HE LIVES
theonlymonkas: IM AWAKENED NOW! Kreygasm
Fr0zenOfficial: well done :)
St47ik: Kreygasm
aasimm: does it help??
OptoCloud: HES BACK BOIS
o______________________k: squadOmega
inDOObitablee: waffleT1 waffleT2
ktzkalash: IM FEELIN WEIRD HOL UP
Mariosavitch: it looks like the spike protein changed the most
VanishBlox: Hey, welcome back
gabo_sk: ssh god@universe
Andremm2: trying to meditate reading twitch chat must be a challenge LUL
razr22: LUL
esence: ASMR
tiagodopke: asmr stream
Apocalyptic0ne: he's got the bob ross voice now
almonte550: Can I be a mob because of me watching you sleep from start to end?
TrippinFlare: superpowers downloaded LUL superpowers downloaded LUL superpowers downloaded LUL
dj_vicio: getting a sub for sleeping , damn
razr22: yes george, whisper in my ears
lgtst_: aaaaaw sheeeeit
VanishBlox: Bob ross stream :D
sircrocodile163: ROADRAGE IN 10MIN LULW
dj_vicio: too loud!!
St47ik: CoolStoryBob
tarasyarema: wtf
Apocalyptic0ne: Now we're gonna code a secret little bush
TrippinFlare: have you seen a sequence before?
Cofffee: ASMR Kreygasm
VanishBlox: CoolStoryBob
ktzkalash: GOTTA START PAINTING CORONA
o______________________k: squadCozy squadPH
slimpimp007: yea you can be a mob
bigie: didn't it recently jump to humans from chinese wet markets
VanishBlox: CoolStoryBob CoolStoryBob
lgtst_: tap that mouse
St47ik: PixelBob
logi6000: holy shit George just calmed the fuck down. this is not good the CIA called him to stop him form truth speaking and it's working
lgtst_: SUSSSSCEPTIBLE
aasimm: so these are multiple viruses belonging to corona family
theonlymonkas: Kreygasm Kreygasm Kreygasm
TrippinFlare: are you trying to find the specific protein @georgehotz ?
slimpimp007: SUSceptible
dj_vicio: @logi6000 he will soon start telling us that we should also listen to the media and buy medicines/vaccines
logi6000: I know
logi6000: there getting to him
aethuall: @georgehotz Do you know what the ANI is across all of the ncov strains? I can't find a good source
tykabmo: @georgehotz I bet 5 bucks with my friend that you wont read this message
almonte550: remember you need to do -1
VanishBlox: Lua gang :)
logi6000: @tykabmo you most likely gon win
TrippinFlare: @georgehotz are you reading chat
Tomishima: python gang checking in
fendermd20: is this about the french guy exposing the patent for corona?
almonte550: There you go
tykabmo: bring on the money!
logi6000: you getting it
iiiiiiillllliiiill: which js framework is best for devloping vaccine?
murkythunder: pog
theonlymonkas: node
logi6000: I'm chatting so you get money and chat gets pushed up more
thisisdrew42: thisisdrew42 subscribed with Twitch Prime.
logi6000: there youngo
tykabmo: I knew the odds were in my favor ...about to take the 5 bucks home!
almonte550: @iiiiiiillllliiiill react of course
TrippinFlare: coronavirus vaccine in javascript OMEGALUL
St47ik: LUL
pz3300: George, you are the boy!
St47ik: @TrippinFlare transpiled from typescript
stole_yo_eip: stole_yo_eip subscribed with Twitch Prime.
logi6000: @tykabmo buy weed! but for 5 you really can't get shit
Mariosavitch: yes i think you can
tykabmo: victory 5 bucks baby @logi6000 team player!
Punkfx: @georgehotz have you worked with Go before?
ziNNGG: turn off that little wanka
almonte550: Why it looks like we are getting somewhere?
TrippinFlare: npm install -g coronavirus-vaccine
theonlymonkas: he is
OnlyB1ade: umm
logi6000: @trippinflare nah no npm. pip
TrippinFlare: brew install coronavirus-vaccine
caiooliveira2014: what they doing?
NoPartiesGuy: @TrippinFlare imagine having 256 ssd and not having enough space for this LUL
Mariosavitch: here is the entire thing https://www.ncbi.nlm.nih.gov/projects/msaviewer/?rid=7FYNU14F01R&amp;coloring= @georgehotz
aethuall: It also inhibits NF-κB which is good for the virus
TrippinFlare: SPONSORED BY AWS S3 PogChamp
logi6000: @trippinflare how bout Pacman -S python-corona-vax
aethuall: Less cytokine reaction
thxslo: What is his goal ?
Mariosavitch: the posted the entire nuecleotide diff above
firstavegner: chat what is he doing for real ?
allhail2daking: Do you meditate everyday?
logi6000: yo anyone look at zeronet source yet. this offtopic but it looks like good code
VanishBlox: He is making a cure for covid 19 to post on github
VitalyzedTv: his goal is to program a vaccin for corona
Riqour: @firstavegner he is going to code the coronavirus and destroy the world
aethuall: @firstavegner He's trying to understand what the proteins in nCoV do
VanishBlox: and post it on githun
caiooliveira2014: @firstavegner Vaccine for corona I think
Mariosavitch: entire diff https://www.ncbi.nlm.nih.gov/projects/msaviewer/?rid=7FYNU14F01R&amp;coloring= @georgehotz
Tanarif: there's already loads of vaccines in testing aren't there?
TrippinFlare: he's hacking the corona computer virus, which originated from Israel
nashesvobodnoye: So we know what certain piece of the protein is doing, but we still don't have a clue *why* these certain arrangements of letters perform a certain function. Maybe you can figure it out, George?
OnlyB1ade: ahhaha
aethuall: Yes, there's many vaccines that are in the clinical trial stage
logi6000: has anyone looked at zeronet. looks like a good project
Mariosavitch: I looked up the entire genome under "blastn" @georgehotz
myaocat: You may want to look at that : http://virological.org/t/alignment-of-58-sarbecovirus-genomes-for-conservation-analysis-of-sars-cov-2/430 @georgehotz
bayarealove: Thwarting coronavirus by not allowing them to replicate
TrippinFlare: Also the sequence of Corona is only ONE PART of the picture. Understanding how it interacts with the human protein is critical.
Marynx: what are you coding ?
NoPartiesGuy: imagine some bio guy just explaining to George some essential basics and the magic happening afterwards LUL
aethuall: I'm holding my tongue @NoPartiesGuy
stole_yo_eip: @Marynx corona virus
firstavegner: @Marynx he's trying to understand corona virus proteins
TrippinFlare: "just put it in a neural net" PogChamp
VanishBlox: we need a bio livestreamer to work with george
VanishBlox: they would be a killer duoe
logi6000: @trippinflare said every person who hasnt used NN
NoPartiesGuy: @aethuall Are you related to this field?
aethuall: Bio livestreamers don't get views
aethuall: @NoPartiesGuy Bioinformatician
sirleeroyjenkins: Is geohotz trying to literally hack the coronavirus
logi6000: @aethuall they need to tho
anotherkidnamedaustin: we love the state, what scam?
logi6000: @sirleeroyjenkins world's largest ctf
anotherkidnamedaustin: btw this is the only stream ive ever considered subbing to
NoPartiesGuy: @aethuall So does it make sense what is he doing or just learning the most basic stuff?
TrippinFlare: LUL
aethuall: I work in microbial genomics though, primarily bacteria
DecayingSkullz: Coronavirus exploits
thxslo: she will hack him beafore he her =)
iiiiiiillllliiiill: a virus is just an agile microservice running in the cloud
VitalyzedTv: WutFace
stole_yo_eip: F
dj_vicio: lol
saintmthw: @aethuall why not just comment helpful stuff for george then?
dj_vicio: he will eventually fall
kirisalolisa: !uptime
anotherkidnamedaustin: i work in micro too, bacteria/fungus tho no viral
dorkmo: chair noise complaints!
VanishBlox: BibleThump WutFace
TrippinFlare: sudo service coronavirus stop
TheKoreanZombi: $5k chair with 3 adjustments. Lol.
Sky_Light_37: @georgehotz left a bit early yesterday, where did we left off?
Mariosavitch: F
dj_vicio: who said the chair was $5k?
aethuall: @saintmthw I think that vaccine development is a very specific field that people who normally develop vaccines know much better than anyone else
logi6000: @trippinflare for the arch users systemctl disable coronavirus
sircrocodile163: @georgehotz your posture is tragic
TrippinFlare: ^ yeah, systemctl is more universal
TheKoreanZombi: @dj_vicio Only the best for geohotz
saintmthw: @aethuall not that. the "basics of biology" you said you're holding your tongue over
hmnvdota: hey guys, what is the challange
stole_yo_eip: @logi6000 works ty
Jehhred: Pandas will do the trick
logi6000: yup
publishcoffee: posture is for humans
THX1342: hmnvdota pwn covid
TrippinFlare: donation goal - new chair LUL
Nopy1: posture is for posers
aethuall: @saintmthw Proteins and virus-host interactions take so long to learn if you don't have bio background
sircrocodile163: @georgehotz you going for that S letter spine?
VanishBlox: if your neck while standing up doesn't look like a crocodile than you are not a real programmer
aethuall: I don't personally know a lot about virus-host interactions myself
aethuall: I only did 2nd year cell bio
aethuall: 1 course
aresfour: what's he up to? 😁😁
slimpimp007: my
aethuall: Rest is genetics, biochem, molbio
firstavegner: @Geo did you know that the sequence of the virus has 33'a s in the end ? that's strange
NoPartiesGuy: @aethuall I mean it's still geohot after all, so he could just learn it much faster I guess
iiiiiiillllliiiill: @aethuall just pretend like the rest of us
dj_vicio: 666 would be stranger @firstavegner
dj_vicio: beast # and trips
TrippinFlare: so we now have the genetic codes of proteins that define coronavirus????
anotherkidnamedaustin: tell everyone stay home, send TSLA's around spraying antiviral = corona defeated
aethuall: @georgehotz https://www.ncbi.nlm.nih.gov/genome/doc/ftpfaq/
saintmthw: @aethuall even so, he's the type that would either ignore or appreciate any input you have that could help
Cofffee: monkaS downloading coronavirus
nozpheratu: Check if the page responds to XML or JSON formats or something?
firstavegner: https://www.ncbi.nlm.nih.gov/nuccore/MN908947
lgtst_: improve TSLA vision to detect corona and arm them with lasers
dalvasorsali: pip install coronavirus
aethuall: @georgehotz You can also use Biopython https://www.biostars.org/p/261774/
iiiiiiillllliiiill: @nozpheratu hacker?
anguscupcake: nooo uninstall it
TrippinFlare: download in 256 gb ssd???
THX1342: are you going to analyze the mutations next?
aasimm: ctrl u
St47ik: @aethuall he didn't like biopython
dorkmo: view source?
Jehhred: Surely Pandas can do it?
Tomishima: scripted Kappa
campinggrounds: try inspecting the requests, maybe iit sends it raw
aasimm: scrape it out
bufferovrflw: Check the Network Tab in DevTools for the download link when you send the request in browser?
bbrak: What is he programming?
Noman35: 5Head @dalvasorsali
TrippinFlare: df.delete_corona()
nozpheratu: @iiiiiiillllliiiill Just a web dev bro
aasimm: try inspect element
maqebane: he is programming ananı amı
aethuall: Biopython is very underrated
dinxpoy: @bbrak he's coding a Corona vaccine he's going to publish on github
bufferovrflw: its RNA, not DNA, reeeeeeeeeeeeeee
yevheniiushtyk: @georgehotz python or python
TrippinFlare: git clone corona-vaccine
iskjmss: this man is hacking darwin
anguscupcake: so you can just code genetics and turn them into a real substance? bruh
nozpheratu: I thought he was reverse engineering it so he could make it himself in one of those DNA printers
h0h0h0: can someone let me know what exactly we are doing here?
jasondesante: what up GeoHot
VitalyzedTv: why can't i say the word keyb0ard
dj_vicio: hacking the Gibson @h0h0h0
xeroeffect: Hi this is your neighbor. Can you please keep it down. My pussy is taking a nap.
h0h0h0: @dj_vicio oh dang Penn jilette is on the phone now
nozpheratu: @h0h0h0 Making Corona virus bitcoin miner
grizvok: dont do it man
luigifrcruz: Scientists need to upload the genome.
onuei: @nozpheratu stonks
h0h0h0: ( i just watched hackers in the theater last week too)
aethuall: @georgehotz Go to the nextstrain page and scroll to the bottom and hit 'download data'
williamjennings1: Hello
THX1342: VitalyzedTv because only noobs care about "what switches you/re using"
TrippinFlare: open source crispr kit to kill coronavirus
bufferovrflw: THERES DOWNLOAD DATA ON NEXSTRAIN
lemonboxed: they probably got the dataset from a research instituition, they dont actually release the whole dataset unless you pay $$$$$
bufferovrflw: ^^^^
h0h0h0: 1000 VIEWERS lol on a programming stream
Kodak_Z: @h0h0h0 that's new...
h0h0h0: What's new?
bufferovrflw: You can download data on NextStrain ncov, someone let Geogre know please
Lizardan: @h0h0h0 it's not your average programming stream
aethuall: I pinged him about it
aethuall: @georgehotz Go to the nextstrain page and scroll to the bottom and hit 'download data'
BesterGester: @bufferovrflw link the download link to chat
axlebear: When is Corona 2.0 coming out?
kirisalolisa: our hero hacking corona to save us, so inspiring
asaalgk: u can press B to insert cell below
nozpheratu: Where is the fun in that?
TrippinFlare: TSV WutFace TSV WutFace TSV WutFace TSV WutFace
aethuall: god nevermind @georgehotz that's just the tree you can download
h0h0h0: So i understand that we are reverse engineering but.. to what end?
iskjmss: oof
TrippinFlare: to the bit level @h0h0h0
jemoetahh: shit i saw my birthplace in that metadata
dj_vicio: To save the world, what else.
nozpheratu: Find their unprotected S3 bucket
asaalgk: i just got in here, what are we trying to accomplish?
grizvok: same reason george does all of these streams
jasondesante: geohot gonna jailbreak corona
popposbubbolo: what is he doing exactly?
School47: corona on github PogChamp
hitmanhax: PogChamp
ideology_sniffing_raccoon: PogU
dj_vicio: researching @popposbubbolo
h0h0h0: Noone is really able to tell you exactly what he is attempting to do in here at the moment.
School47: yeah baby, this is corona code
MuscleMario: Please dont paste that 1.7Mb into jupyter
nr_fury: time
School47: can we launch it LUL???
astr0nils: nCoV is open source, thats why everyone got it PogChamp
TrippinFlare: analyzing genetic sequence of covid-19 @h0h0h0
Ziv0: https://bigd.big.ac.cn/ncov/release_genome this claims to have 1.2k sequences of ncov
School47: @astr0nils and decentralised Kappa
nozpheratu: Search gitub code for one of your seqeunces
jbnunn: ^^^^
h0h0h0: ok. then this is way above my standard programmer head. lol.
Tidusuper91: !uptime
OrlinTheMage: he touches his face too much
Ziv0: if you translate the second button says download all sequences
Trr67: monkaS
Hptenuse: yea no face touching monkaS
aethuall: Ahahaha there's a queue for access credentials
aethuall: That's actually cooked
benakiba: wouldnt be the first to do that for sure
Digital_donger: the virus is proprietary Kappa
iskjmss: getting sued by doctors LUL
logi6000: with all the chrome tabs he must have 1tb of ram
dj_vicio: yea from Israel
aethuall: @georgehotz I really doubt you can get approved for that
lemonboxed: not the virus just the data collected from patients
TrippinFlare: welcome to macOS @logi6000 (:
tkdboy555: Hey, the company my best friend works at is making their software free to use for people trying to help the corona-virus situation, the company is called DataRobot, based out of Boston. Don't know if it's of any interest to you, since you have to submit a request. https://www.datarobot.com/
Nussinov: I just tuned in, can you describe what you're attempting please? :)
logi6000: @trippinflare arch
Lana_Lux: 165 raiders from Lana_Lux have joined!
logi6000: fuck who sent the raiders
JjohnConstantine: LuvHearts
dj_vicio: haha
dj_vicio: shes hot
berke98: My antivirus licence has over, i don’t wanna get corona virus
Mariosavitch: that means u dead
ideology_sniffing_raccoon: PogU
abk467: @Lana_Lux lanaluHi2
o______________________k: squadOmega squadOmega squadOmega squadOmega
MuscleMario: ... raided lol
T3chHS: @Lana_Lux Pog
faxity: LUL
PiroFloydian: she sent her 165 viewers here
Digital_donger: she makes games PogChamp
rraksut: lanaluHacking
fendermd20: can u explain a bit what is going on in the stream?
Tidusuper91: What are we looking for?
Cofffee: She is trying to hack your stream monkaS
tkdboy555: LUL
bigie: it's like hosting but a bit more stupid
axlebear: monkaS
METH_HEAD_MIKE: @Lana_Lux PogChamp
School47: we can compile another virus PogChamp
BesterGester: People who just joined. He is making vaccine for corona virus
OrlinTheMage: she looks like Angelina Jolie
SHAVEYY_: @Lana_Lux PogChamp
PiroFloydian: nah i feel like raiding is better than hosting
Hptenuse: for the new viewers: he is reverse engineering corona virus to make it into a computer virus
nozpheratu: Lana Lux sounds like a good porn star name
lebop: @georgehotz its a host
silentheee: mathilM mathilS
TrippinFlare: we are downloading coronavirus chat PogChamp we are downloading coronavirus chat PogChamp we are downloading coronavirus chat PogChamp
h0h0h0: Apparently he is analyzing the virus structure. It's unclear to what end he is going it for.
ited01: wtf guys
o______________________k: @nozpheratu squad4
SHAVEYY_: @georgehotz encode the coronavirus as base64
Mariosavitch: lol
dj_vicio: Lana Lux Raiders are all from CIA and doctors from cambridge uni. to build a case against geohot
Incurs0: LUL
Nussinov: BesterGester what, is he going to inject some files in people with the disease? Kappa
Bitcoin__: LUL
Digital_donger: Kappa
swagomgswag: Kappa
Skriance: LUL
ideology_sniffing_raccoon: Kappa
Tymski_: Hello Raiders from Lana! We are coding a vaccine for coronavirus!
Mariosavitch: Kappa
sabibas: !commands
adamcernycz: Kappa
bokeee_: atpRtsd
viper262_: LUL
Cofffee: Kappa
jasondesante: we're always positive #mentalhealth
School47: Kappa
Cornflays: Kappa
garam_chai94: Kappa
PiroFloydian: LUL
Hptenuse: Kappa
alexandru_cristiean: HHAHAHAHAHAHHAHAHAHAH
nashesvobodnoye: Kappa
bigie: LUL
TrippinFlare: KAPOW
silentheee: haHAA
SHAVEYY_: polotics is for losers btw
TrippinFlare: Kappa
goodlink: Kappa
faxity: Kappa
nashesvobodnoye: LUL
SHAVEYY_: :)
ideology_sniffing_raccoon: Sure
jeankx23: MiniK MiniK MiniK MiniK MiniK
DecayingSkullz: LUL LUL
alexandru_cristiean: HAHAHAHAHHAHA
razr22: :)
stole_yo_eip: Kappa
logi6000: calm good joke you just got a noise complaint from the CIA
SHAVEYY_: @georgehotz encode the coronavirus as base64
h0h0h0: What do you mean reverse engineer? oh he is explaining YAY!
cockwizard69: show tits
dj_vicio: over 9000!
StealtHy34: what is he exactly doing?
TrippinFlare: C OMEGALUL DE FOR CORONAVIRUS
SHAVEYY_: ogcc
OnlyB1ade: very good
sabibas: dude
SHAVEYY_: Pog
sabibas: what are your specs
TrippinFlare: MacBook Air
nozpheratu: He's making a virus miner for bitcoin
dj_vicio: aderall again
SHAVEYY_: @sabibas some macbook
Ziv0: not the sources code - the compiled code Kappa
cutza: Remember tidepods are the solution
syns0r: encoded in base4
bigie: what if you make a PR and they accept it by accident and get pwnd
SHAVEYY_: encode as base-64
bokeee_: rofl
School47: you should wear mask to protect urself while working with korona @georgehotz Kappa
FargioFarmani: Programming in Unity sucks
bufferovrflw: Any way to "reassemble" it?
h0h0h0: ok he is trying to figure out how it works by analyzing the genetic code.
logi6000: calm good joke. btw he just got a noise complaint from the CIA.
iskjmss: there's a correlation between consumption of tidepods, coronavirus and death
nozpheratu: That's what she said
BesterGester: @h0h0h0 YAY!
fendermd20: do you mean the virus is created by a process and you try to figure out the parts of that procesS?
sabibas: oh he has a macbook with a dock?
dj_vicio: "noise" complaint
Tymski_: @FargioFarmani But programming in VSCode is cool
logi6000: @dj_vicio truth complaint
lemonboxed: with the graphs
SHAVEYY_: can you upload the cure to gitlab instead I hear its better af
h3llphish: h3llphish subscribed with Twitch Prime.
TrippinFlare: gitlab? WutFace
Ziv0: https://bigd.big.ac.cn/ncov/genome/sequence/download/all all.fasta
Tomishima: imagining the self-pressure Kappa
durinwildhammer47: what is even going on here
SHAVEYY_: I cant fucking use gitlabs UI
St47ik: DNA sequencer from ebay LUL
ideology_sniffing_raccoon: LULW
nozpheratu: Can you use that to print waifus?
logi6000: calm good joke. btw he just got a noise complaint from the CIA
cutza: Start the brewin'
esence: just take a photo and zoom in on your iphone
lemonboxed: the 600 dollar one must be broken
swagomgswag: cables PogChamp
SHAVEYY_: @georgehotz can you make anime irl?
durinwildhammer47: just use some reallllly strong binoculars
Nussinov: youd have to order some enzymes my guy Kappa
thejuror8: @georgehotz Hey Hotz how do you plan on reverse engineering it if you don't know anything about molecular biology ? You will eventually have to come down to that level at some point in order to properly understand it
TrippinFlare: VSCode &lt; Codium - opern source VSCode without Microsoft telemetrics
iskjmss: that shit better come with 2 topre keyboards
DisruptedNexus: DisruptedNexus subscribed with Twitch Prime.
u1337ochka: can't you just like filter all dna in ur body that equals to the sars-cov-2 dna with like a bloom filter or something
DenkoCode: DenkoCode subscribed with Twitch Prime.
durinwildhammer47: who are you?
wijlum: hi
SHAVEYY_: just use vim 4Head
Fundlak: scam train PogChamp
Bitcoin__: SCAM TRAIN!
AresRai: @thejuror8 he will find someone who already did the bio part 5Head
Zerolski: HahaGingercat
BesterGester: @thejuror8 you can learn that stuff online
SHAVEYY_: SHILL TRAIN BOYS !!!
TrippinFlare: Have you tried Brave? @georgehotz
St47ik: PogChamp
ideology_sniffing_raccoon: scam train Pog
williamjennings1: ArsonNoSexy ArsonNoSexy
astralhustler: comma ftw
kleyy: PogChamp
Digital_donger: PogChamp 2?
iskjmss: Pog Pog Pog Pog Pog Pog Pog Pog Pog Pog Pog Pog
bigie: it's a scam train LUL
Nussinov: PogChamp GAMERS RISE UP
Trr67: LULW
nozpheratu: @thejuror8 &gt;need education to program LUL
exzhhh: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
Cornflays: PogChamp
ipo___: Update us George, are we hitting a breakthrough
VanishBlox: come on GUYS
METH_HEAD_MIKE: Level 2 PogChamp
swagomgswag: SCAM TRAIN
TrippinFlare: LUL
ts012839050: scam train LUL
Cofffee: PogChamp 2
AresRai: scam train PogChamp
careaa: Kappa 4Head
araeasmes: YES PogChamp
mescal33t: beastyPoggers beastyAmazin beastyPoggers beastyAmazin beastyPoggers beastyAmazin
astralhustler: !claim
georgehotz: !claim
bokeee_: bokeee_ subscribed at Tier 1.
St47ik: Scan train PogChamp
milobailey: nice try george Kappa
SHAVEYY_: !claim omg guys I got the new sub!!!
garam_chai94: PogChamp1
FargioFarmani: !claim
VanishBlox: !cvlaim
Digital_donger: dopamine PogChamp
Vjasal: next episode of the stream: making bioweapon at home
logi6000: !claim
lgtst_: CIA up your ass
razr22: !claim
williamjennings1: !claim
AresRai: !claim
cutza: !claim
DecayingSkullz: !claim
lovelyhashbrowns: !claim
Mdog1224: Hypeeeee
tkdboy555: datarobot.com
viper262_: LULW
ideology_sniffing_raccoon: PogChamp Scam train LUL PogChamp Scam train LUL PogChamp Scam train LUL
williamjennings1: lol
Digital_donger: !claim
TsarSec: KEKW
durinwildhammer47: !claim
St47ik: LUL
swagomgswag: !claim
darushan: !claim
Noman35: Jebaited
Jehhred: !claim
MuscleMario: !claim
gabriel_denis: !claim
swagomgswag: LULW
gombloddo: gombloddo subscribed with Twitch Prime.
fizeh: !claim
TrippinFlare: !claim
inDOObitablee: LUL
williamjennings1: LMao
VanishBlox: 100!
viper262_: danO
electro55555: LUL
tiagodopke: !claim
shlver: SCAM TRAIN
Georgye: !claim
reaganchisholm: !claim
Tymski_: !claim
swagomgswag: LUL
adietrichs: !claim
Foxxy_xx: !claim
kirisalolisa: !scam
araeasmes: !claim
razr22: scammaz
shlver: !claim
ableslayer: !claim
Ghost_001: LUL
ipo___: !UpdateOnBreakthrough
dinxpoy: LOL
OnlyB1ade: !claim
BananStian: !claim
alexandru_cristiean: !claim
OrlinTheMage: !claim
OnlyB1ade: why
williamjennings1: !scam
milobailey: !claim
MacoNighto: !claim
fishing4fish85: !claim
esence: !claim
Aixyn0: !claim
cutza: !scam
lemonboxed: !claim
loligarchia: !claim
syns0r: !claim
PiroFloydian: LUL Jebaited
alexandru_cristiean: HYYYYYYYPE
informalgarlic: !claim
St47ik: !scam
lgtst_: distracts with hype train
TheRealREJack: !claim
Marcel63: !claim
Remembermyfart1: YES
Mdog1224: !claim
happypuppppy: !claim
axlebear: !claim
eadio: !claim
sabibas: !claim
inDOObitablee: !claim
Vjasal: !claim
williamjennings1: lmao
almonte550: !claim
Kodak_Z: !claim
swagomgswag: !claim
tiagodopke: !scam
nozpheratu: !scam
VanishBlox: We are level 2
bigie: I am so hyppped.
Digital_donger: !claim ANY CLAIMERS?
superuserg: !claim
tombradley456: !claim
slowgonzales: !scam
swagomgswag: LUL
arm627: !claim
loligarchia: soos
Sundaexz: !claim
lgtst_: !claim
stole_yo_eip: !claim
Bernasv: !claim
kirisalolisa: !claim
VanishBlox: GO ON BOYS
Nopy1: twitch pls stop
alb12321: !claim
dudvdx: !scam
TrippinFlare: !level 2
ideology_sniffing_raccoon: LUL
axlebear: whoa it works
St47ik: BITCONEEEEEEEEECT
Remembermyfart1: !claim
ableslayer: !CLAIM
Noman35: Jebaited LuL
unluckychickenn: i love you george
abhinavneelam: !claim
Cornflays: any gifters? nmpPOGGERS
anguscupcake: fake bro
u1337ochka: !claim
icyvran: !claim
Zerolski: !claim
ableslayer: !claim
SHAVEYY_: LEVEL 2 HOLY FUCK
hir0andobey: !claim
gombloddo: !claim
alexandru_cristiean: COME ON LEVEL 3333333333
r0xtehem0x: !claim
cutza: GIVEMEDOPAMINE
Nussinov: !cough
ipo___: !claimfake
raondev: !claim
korede360: !claim
SHAVEYY_: HOLY SHIT
dvdutch: !claim
SHAVEYY_: HOLY FUCK
azogshady: PogU
TrippinFlare: !claim
imopfloors: !claim
trajenx: scam train
sabibas: wow
azogshady: Pog
tellmewhy_tv: !claim
shlver: SCAM
h0h0h0: !claim
SHAVEYY_: LEVEL 3??
nashesvobodnoye: nashesvobodnoye subscribed at Tier 3.
logi6000: no this is the CIA distracting us
sabibas: can we do it
JjohnConstantine: !claim
Br4nnon: scam train PogChamp
St47ik: BITCONEEEEEEEEEEEEECT
hitmanhax: !claim
swagomgswag: no way
JohnEGQ: !claim
VanishBlox: WE NEED A NEW SUBSCRIBED
devioux77: lul
FargioFarmani: !claim
gattz_: !claim
SHAVEYY_: WTH!!!
MuscleMario: lol
JefeBezos: !claim
VanishBlox: YEE
luigifrcruz: !claim
Ghost_001: LuL
esence: WE DED ET
tiagodopke: !claim
SHAVEYY_: OMG
DecayingSkullz: !claim
GODaruu: !claim
o______________________k: no :)
ancientchineseelder: LEVEL 3
sabibas: we got it lets go
alexandru_cristiean: LEVEL 3 LET'S GOOOOOOOOOO
swagomgswag: LEVEL 4 PogChamp
SHAVEYY_: WE DID IT BOYS
dorkmo: !claim
Bitcoin__: Who's the longest sub?
Aixyn0: !claim
Penguino138: HYPE IT UP MOTHA FUCKAS
1gonyali: !claim
bufferovrflw: How many psychologists does Twitch employ?
fwef64: !claim
sabibas: level 3
St47ik: LUL
happypuppppy: PogChamp
dunehazard: KEKW
gogenhub: !claim
esence: !claim
icyvran: lol
TrippinFlare: PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN
sabibas: !claim
saintmthw: tier 3 sub PogChamp
lgtst_: FOCUS
milobailey: !claim
MuscleMario: Unlock unlock unlock
u1337ochka: PogChamp
bokeee_: DOPAMINE IS HITTING ME
VanishBlox: !claim
Aixyn0: !scam
tkdboy555: !hype !claim
PiroFloydian: PogChamp
kirisalolisa: !scam
dark_jmat: PogChamp PogChamp PogChamp PogChamp PogChamp
williamjennings1: lmao
shlver: SCAM TRAIN PogChamp
logi6000: did we all just get subs
alexandru_cristiean: HYYYYYYYPEEEEEEEEE TRAAAAIINNNNNNN
mescal33t: beasty1more beasty1more beasty1more beasty1more
gattz_: SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp
TrippinFlare: !claim
St47ik: Scam train PogChamp
bigie: do you really need the twitch benefits LUL
almonte550: !claim
azogshady: Pog Pog
adamcernycz: So new phone call about noise? Kappa
Digital_donger: choo choo PogChamp
milobailey: lvl 10
tombradley456: !claim
TrippinFlare: PogChamp
fwef64: !hype
exzhhh: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
Jehhred: !claim
axlebear: EZ
icyvran: !claim
Aixyn0: !lvl42
Br4nnon: Level 5 unlocks fireball PogChamp
TehQi: !claim
bufferovrflw: How many psychologists are employed at Twitch ?
DecayingSkullz: Kappa Kappa Kappa Kappa Kappa
ideology_sniffing_raccoon: PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN
azogshady: Pog Pog Pog
alexandru_cristiean: SCAM TRAIN LEVEL 4
rubho: the best kind of scam, where we get out dopamine for completing goals, and you get money
dj_vicio: louder!!!!
Toastie1: PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳
moonify: maisterWHAT maisterWHAT maisterWHAT maisterWHAT maisterWHAT
georgehotz: !claim
williamjennings1: !claim
fwef64: !claim
logi6000: !claim
azogshady: Pog
cutza: !CLAIM
happypuppppy: GIFTED PogChamp
syns0r: !claim
luigifrcruz: !claim
milobailey: FOCUS GEORGE
wrying: !claim
TrippinFlare: !claim
OrlinTheMage: !claim
MuscleMario: !claim
azogshady: Pog Pog
sabibas: RECEPT THOSE DOPES
ad5k: !claim
icyvran: lol
moonify: !claim
Zerolski: !claim
imopfloors: !claim
vicious503: !claim
bokeee_: !claim
camkinstrike: !calim
DecayingSkullz: !claim
viper262_: !claim
parviz_gc: lol
azogshady: Pog
JjohnConstantine: !claim
tremendomendez: !claim Kappa
bufferovrflw: !claim
bigie: i just came
devioux77: LUL
TrippinFlare: PogChamp
Itsmeek0: I SUBSCRIBED TO GEORGE HOTZ TIER 13 AND ONLY RECEIVED SADNESS
Remembermyfart1: !claim
Ncwr: !claim
gattz_: LUL
MorningScifi: !claim
camkinstrike: !claim
alexandru_cristiean: SCAM TRAIN SCAM TRAIN SCAM TRAIN SCAM TRAIN SCAM TRAIN
Ensthor: !claim
parviz_gc: wtf
Marcel63: !claim
trumpetjean: !claim
thejuror8: !claim
Digital_donger: !claim
bigie: !claim
alexandru_cristiean: !claim
superuserg: !claim
VanishBlox: let's do this boys
tehEGO: !claim
slowgonzales: !claim
informalgarlic: DoritosChip DoritosChip DoritosChip DoritosChip DoritosChip
icyvran: Noise claim
trajenx: !claim
viper262_: !clams
ideology_sniffing_raccoon: PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳
ableslayer: !claim
gogenhub: !claim
fwef64: !hype !claim
auron018: !claim
mashafique: !claim
swagomgswag: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
TrippinFlare: LUL
eadio: !claim
MParry: !claim
faxity: hahahaha
azogshady: Pog Pog SCAM TRAIN
cutza: DOPAMINEDOPAMINEDOPAMINE
lgtst_: GOT DAMMIT
CompestLive: !claim
MuscleMario: Free Chicken Tendies
milobailey: !claim
1gonyali: !claim
Kahawa: !claim Scammaz
georgehotz: !claim
Cornflays: LUL
axlebear: !boost
Bernasv: !claim
parviz_gc: this guy
exzhhh: Kappa
mudowoster: !uptime
phrixus_bro: phrixus_bro subscribed at Tier 1.
icyvran: !claim
FargioFarmani: !claim
georgehotz: !claim
K_I_N_N_Y_B_O_T: !claim
williamjennings1: VoHiYo VoHiYo
TrippinFlare: !claim
chargen: !claim
anguscupcake: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
gabriel_denis: !claim
nashesvobodnoye: !claim
GODaruu: !claim
CompestLive: !calim
DeimosTK: !claim
AresRai: !claim
tombradley456: !claim
kleyy: !claim
hitmanhax: !claim
georgehotz: !claim
MuscleMario: !Free Chicken Tendies
georgehotz: !claim
TrippinFlare: PogChamp
tremendomendez: PogChamp
seniorkae: !claim
esence: !claim
williamjennings1: !claim
SHAVEYY_: pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4 pOGcHAMP level 4
Mdog1224: !claim
Noman35: !claim
Ghost_001: !claim
georgehotz: !claim
h0h0h0: !claim
fishing4fish85: !claim
exzhhh: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
iskjmss: !claim
happypuppppy: !claim
u1337ochka: !claim
VanishBlox: !claim
heroinefather_: !claim
o______________________k: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
neuromancer2: !claim
informalgarlic: !scam
RapidEU: !claim
simonas1122: !claim
fwef64: !claim
immutable0bject: !claim
azogshady: !claim
darushan: !claim
Abnico: !claim
mashafique: Pog
DenkoCode: claim()
onuei: REVERSE ENGINEER DOPAMINE RECEPTORS
parviz_gc: LEVELLLLLLLL 5
devioux77: salrosSCAM salrosSCAM salrosSCAM salrosSCAM
CompestLive: !claim
r0xtehem0x: !claim
xXICEW0LFXx: !claim
St47ik: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. This is a scam imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
shlver: SCAM TRAIN PogChamp
williamjennings1: what is going on
shoji22: !claim
ideology_sniffing_raccoon: LUL
swagomgswag: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
dorkmo: uni1
void8TV: !claim
alexandru_cristiean: !claimHYYYYYYYYYYYYYYYYYYYYYYYPEEEEEEEEEEEEEEEEEEEEEE
logi6000: !claim
RapidEU: rofl
gattz_: SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp SCAM TRAIN PogChamp
tkdboy555: !claim
teslost: !claim
williamjennings1: !claim
dj_vicio: !claim
ninjadidio: !claim
inDOObitablee: LUL
tehEGO: i dont know what is hypening?
kirisalolisa: Type !scam to restore sanity
SHAVEYY_: yes
alexandru_cristiean: !claim
williamjennings1: what is going on
gombloddo: !claim
mashafique: LULW
jasondesante: bro lets get to level 60
superuserg: !claim
mescal33t: beastyH beastyH beastyH
dvdutch: Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1
DecayingSkullz: !claim
onuei: TYPE CLAME TO CONFIRM AUTISM
ableslayer: ———————————————————————— imGlitch You have been gifted the Golden Kappa!—————————————————————
informalgarlic: o______________________k ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
takkeo: !claim
K_I_N_N_Y_B_O_T: !claim
trajenx: TOS
trumpetjean: !claim
azogshady: PogU
dvdutch: Hype
JjohnConstantine: !claim
dj_vicio: how you use bits
eadio: haHAA
icyvran: !claim
o______________________k: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ .
FargioFarmani: !claim
cutza: BITS COST MONEY
ideology_sniffing_raccoon: PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳 PogChamp 💳
1gonyali: !claim
fishing4fish85: !claim
CompestLive: !claim
eadio: !claim
Zasuslive: !claim
VanishBlox: !claim
williamjennings1: !claim
Abnico: !claim
gabriel_denis: !claim
anguscupcake: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ Jehhred: !claim
neuromancer2: !claim
esence: 1% KEKW
georgehotz: !claim
pjayys77: !claim
TrippinFlare: pip uninstall coronavirus Cheer100
urhentom: !claim
dj_vicio: !cliam
arm627: !claim
Trr67: LUL
St47ik: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. This is a scam imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
luigifrcruz: !claim
milobailey: !claim
VanishBlox: BOYS COME ON
dj_vicio: !claim
Noman35: !claim
OnlyB1ade: OnlyB1ade subscribed at Tier 1. They've subscribed for 2 months! yee
tokumei64: it's a meme
ideology_sniffing_raccoon: LUL
almonte550: !claim
AresRai: !claim
devioux77: LMAO
Bernasv: !claim
Ziv0: LUL
auron018: !claim
fizeh: LUL
syns0r: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
williamjennings1: !claim what
Wolvey: no Kappa
bokeee_: ROFL
o______________________k: LMFAO
Panda1Express: LUL
shlver: LMAO
maqebane: !claim
BananStian: !claim
xXICEW0LFXx: that is most definitely a scam
pdungeytv: LUL
anguscupcake: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
o______________________k: GOTTEM
kleyy: LUL
viper262_: LUL
swagomgswag: its not real LUL @georgehotz
SHAVEYY_: go to this @georgehotz https://dashboard.twitch.tv/u/georgehotz/home
happypuppppy: LUL
milobailey: LUL
dongmuya: !claim
Noman35: LuL
fizeh: HE JUST FOUND OUT
Itsmeek0: HYPE TRAIN UPPP
TsarSec: LULW
Restless_Bagel: Jebaited
informalgarlic: o______________________k ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
homies7: keep us excited cheer10
utkuzz: shshshhsahas
shlver: Jebaited
xXICEW0LFXx: lmfao
icyvran: !claim
exzhhh: lul
swagomgswag: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
tremendomendez: LUL
Julll: LUL
kito__: LUL
exzhhh: hahahahhaa
o______________________k: monkaS
korede360: !claim
nozpheratu: @georgehotz When Hype train gets to level 5, you gift all your viewers subs.
Sky_Light_37: LULW
MuscleMario: Free Chicken Tendies
Digital_donger: Jebaited classic
tokumei64: ITS A MEME COPYPASTA
tiagodopke: GOT EM
exzhhh: trolled
maqebane: lel
dvdutch: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
unluckychickenn: Pog
syns0r: !claim
AresRai: Jebaited
void8TV: !claim
SHAVEYY_: go to this @georgehotz https://dashboard.twitch.tv/u/georgehotz/home !!
Cornflays: LUL
ideology_sniffing_raccoon: THE !CLAIM IS A SCAM
Noman35: LUL
Sundaexz: LUL
tremendomendez: Jebaited
mescal33t: beastyLULWW beastyLULWW beastyLULWW beastyLULWW
chargen: !claim
Cofffee: monkaS
FaCeFat: LMAAAOO¨
Ghost_001: LUL
PiroFloydian: LUL Jebaited
dj_vicio: hahahahahaha
inDOObitablee: LUL
Nussinov: Jebaited
kirisalolisa: shshssh
bottters: o______________________k ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch You have been gifted a subscription on this channel. Type !claim to activate. imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
St47ik: stop NotLikeThis
Noman35: Jebaited
viper262_: BAN
bufferovrflw: !ban
anguscupcake: I SUBBED TEO U
SHAVEYY_: go to this @georgehotz https://dashboard.twitch.tv/u/georgehotz/home
dinxpoy: LUL
Cofffee: monkaS
Ziv0: LMAO
freshsoclean: gay
kleyy: i though he was trolling
milobailey: lmaaao
St47ik: Jebaited
void8TV: !claim wtf
CompestLive: LMAOOOOOO
ableslayer: LUL
o______________________k: LMFAO
Noman35: Jebaited LuL
kirisalolisa: LMAO
tokumei64: IT DOESN'T DO ANYTHIN
ShewNs: looooool
Fundlak: Jebaited
williamjennings1: what!!!!!
wrying: LUL
Digital_donger: a classic Jebaited
axlebear: Jebaited
mickjaggerrrr: lol
bigie: @george it's a meme not a scam
Vjasal: why would anyone disable hypetrain
cutza: LOL
swagomgswag: Jebaited
kito__: Jebaited
bufferovrflw: I'm a gifted child
almonte550: LMAO
ipo___: U all.. my mom just gifted me
adamcernycz: LUL
Fantasma56: monkaS
alexandru_cristiean: ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬ imGlitch This is the first time I use Twitch and I'm already bought imGlitch ▬▬▬▬▬▬▬▬▬▬ஜ۩۞۩ஜ▬▬▬▬▬▬▬▬▬▬
dvdutch: mines the only one that looks good
Cornflays: GOT EM
devioux77: salrosSCAM salrosSCAM salrosSCAM salrosSCAM salrosSCAM
dj_vicio: owned again! hahahahaha
void8TV: Jebaited
ts012839050: bang cya
swagomgswag: HIDE EM TriHard HIDE EM TriHard HIDE EM TriHard HIDE EM TriHard HIDE EM TriHard HIDE EM TriHard
Riqour: gift me
informalgarlic: but you are gift5d
alexandru_cristiean: Sold*
SpecialAgentSkye: You are a very gifted developer Geo :)
BrodatyWhiteBear: quebMonka
logi6000: what if I say I'm in a gifted class?
azogshady: THIS DUDE A BORDERLINE BOOMER
milobailey: how they scam with hype train?
phrixus_bro: i dont know what happened i got caught in the hype
St47ik: TriHard 7
tokumei64: not a scam!
revolutionist123: Jebaited
tkdboy555: alexandru banned too please
dinxpoy: Geo is such a gifted programmer
Remembermyfart1: DUDE WE HAVE TO REACH LEVEL 5 BEFORE TESLA
Wolvey: !claim Kappa
AresRai: Jebaited lol
void8TV: LUL
mescal33t: beasty1more beasty1more beasty1more
xXICEW0LFXx: it's a scam lol
Tomishima: natural selection at work
informalgarlic: @georgehotz but you are g9fted!!!!
o______________________k: HAHAHA
bufferovrflw: bro you just posted cringe
exzhhh: xD
xXICEW0LFXx: lmfao
slowgonzales: !ban
williamjennings1: VoHiYo
aiex42: Ban train about to start lol
dj_vicio: LOL
fizeh: BANNED LUL
alexandru_cristiean: :(
Digital_donger: monkaS
SHAVEYY_: G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin
ipo___: u talent, u jifted
SHAVEYY_: G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin G TriHard I be flexin
St47ik: Chat stop NotLikeThis
SpecialAgentSkye: ROLLED
DenkoCode: Hacks ps, cars, iphone -&gt; cant figure out how twitch works
bufferovrflw: KEEP THE HYPE TRAIN
VanishBlox: Boys the hype train is gonna cool down
esence: NO FUN IN THIS CHANNEL
pjayys77: the man is Emtional baggage though
cutza: !SCAM
veeraman: how close are we?
exzhhh: hahahhahaa
Nussinov: Hundreds of teenagers are outsmarting this streamer
ideology_sniffing_raccoon: LUL
axlebear: EZ jebait
VanishBlox: HYPE HYPE HYPE HYPE TRAIN
happypuppppy: socially engineered FeelsBadMan
lyricrush: WHAT KEYB0ard do you have
bufferovrflw: HYYYYYYYYYPEEEEEEE
TrippinFlare: ANY OIL PRINCESS??
void8TV: Its just a troll even
lgtst_: HYPE CONDUCTORS
Ghost_001: me :)
nozpheratu: PICK ME
SHAVEYY_: !claim
Orennnn: lmao
gombloddo: ResidentSleeper ResidentSleeper
dj_vicio: he RE coronavirus but can't ban ppl from Twitch
lgtst_: they already there
MuscleMario: PogChamp100 lets get some emotez
tokumei64: Jebaited
Noman35: ill do it :)
VanishBlox: HYPE HYPE HYPE HYPE
FargioFarmani: its me
almonte550: Can I be a conductor?
swagomgswag: ME PogChamp
shlver: Me :)
MorningScifi: choo choo
Lizardan: me
icyvran: Go go go go
SernOne: Once you sequence the cure to the virus just go ahead and CD/CI that puppy, we'll be waiting
tkdboy555: TIME THEN OUT, GIT 'EM
boxtooo: me :)
DecayingSkullz: Hyper train ENGINEER
Sky_Light_37: me :)
SpecialAgentSkye: not me :)
bufferovrflw: CHOOO CHOOOOOOO
tremendomendez: me poh
pjayys77: like a mod
bigie: LUL it's like manual for herding sheep
tehEGO: lol
MuscleMario: yeah w/e
Cornflays: me nmpSMILE
Mariosavitch: too soon
Noman35: monkaS
Ghost_001: PogChamp
AresRai: LUL
cutza: pog
ipo___: GeorgeNutz
gombloddo: PokCharizard
icyvran: lol
TsarSec: no shit
OnlyB1ade: PokCharizard PokCharizard PokCharizard PokCharizard
almonte550: Coronavirus band people permanently
veeraman: how close are we?! 🦠
dj_vicio: why he complaining then lol
xXICEW0LFXx: it is definitely a way to make more money, but hey it gives you more money too soooooo
ts012839050: PogChamp100
nozpheratu: We need adblocker for twitch
DenkoCode: &gt;man twitch.com
dj_vicio: !claim
Loutlot: Cheer1000
abhinavneelam: George Botz
Wolvey: PogChamp
PiroFloydian: HOLY
OnlyB1ade: PokGarchomp PokGarchomp
abhinavneelam: George Lotz
St47ik: MrDestructoid
kito__: will there be vod of this ?
almonte550: I don't even know how to use bits
tremendomendez: PogChamp
trajenx: is george going to hack the corona virus?
Lizardan: STAFF PogChamp
PiroFloydian: 1K bits!
saintmthw: staff gave 10 bucks PogChamp
TrippinFlare: dilemmas of George Hotz Cheer300
fdddff: fdddff subscribed with Twitch Prime.
tehEGO: i bet twitch cant max out hype train
Cornflays: @Loutlot nmpGUN
faxity: Loutlot LUL
MorningScifi: Check for n-grams, George?
mescal33t: @Loutlot beastyPoggers beastyAmazin
pjayys77: lvl 5
swagomgswag: LEVEL 5 PogChamp
dj_vicio: level 4 yay!!!
St47ik: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
Loutlot: scammed
tremendomendez: PogChamp next level
TrippinFlare: PogChamp
Itsmeek0: LEVELLLLLLLLLLLLLL UPPPPPPPPPPPPPP LEVELLLLLLLL 5555555555555555555
Digital_donger: PogChamp insane
exzhhh: Scammed
trajenx: i don't think the FDA will approve a self-driving corona virus
dyslexicgruffalo: so when he says hes reverse engineering what is he meaning by that?
Nussinov: level 5 is for noobs try reaching level 10
logi6000: how do we know when the hype train going
St47ik: Final level PogChamp
gombloddo: PogChamp PogChamp PogChamp
almonte550: What are the last level?
saixj: got to clean up the data
imopfloors: PogChamp100
hitmanhax: Pog EXCLUSIVE EMOTES
dj_vicio: FDA are dumb brutes
brownyyyylocks: so many ads on this channel
informalgarlic: FINAL LEVEL CHAT!
StealtHy34: can someone explain me what is he doing please? im dumb
tiagodopke: who cares about the FDA
almonte550: I want to see the last level before coronavirus hits me!
JustAsGoodJo: Pog a fellow scientist :)
Nussinov: that would be called a deletion mutation Kappa
ideology_sniffing_raccoon: LEVEL PogChamp
alexandru_cristiean: HypeUnicorn1
logi6000: @tiagodopke vapers mostly
pjayys77: "reverse engineering the coronavirus"
St47ik: Any gifters TriHard
alexandru_cristiean: :HypeUnicorn1
DenkoCode: self driving corona virus
firstavegner: he's trying to understand the relations between the proteins in the coronavirus
Cornflays: any gifters guys? nmpPeepo
anguscupcake: he is building a wall and making the coronavirus pay for it
pjayys77: no one knows what it means but its provocative
ideology_sniffing_raccoon: LEVEL 5 PogChamp
JustAsGoodJo: untranslated region on the 5 prime end
almonte550: What level of autonomy does coronavirus has? has it hit level 5 yet?
grey_street: PogChamp
mik12f4: I wish you did more videos like this.
JustAsGoodJo: sides of mRNA are not translated into protein
tehEGO: can all the crypto miners just start contributing to coronavirus
Nussinov: the 5-UTR is there for the mRNA processing machinery to bind :) it usually does not encode any proteins
limpid_kzonix: hi, from Ukraine) nice to see you on twitch!!!
dyslexicgruffalo: what exacyly is he doing?
St47ik: @tehEGO they can't
tehEGO: and have the coin pay percentage of solving
Remembermyfart1: just throw deep learning at the problem, dude
Lizardan: @dyslexicgruffalo coronavirus reverse engineering
St47ik: ASICs are for crypto only
TrippinFlare: tf.train_coronavirus_vaccine()
dj_vicio: for those asking what he's doing STFU and keep watching. If you're smart enough you'll understand. If not, god help you.
auron018: introns Google that, it will not be included in the mRNA
Mariosavitch: model.fit
mescal33t: cheer200
almonte550: @dyslexicgruffalo learning stuff
St47ik: 20% PogChamp
ideology_sniffing_raccoon: corona crypto LUL
dyslexicgruffalo: @Lizardan i get that but what is he actually doing and why does eh think it'll help?
samu79rai: yo george wat up
dyslexicgruffalo: jw
tehEGO: the combinations are transactions
Feedael: Feedael subscribed with Twitch Prime. They've subscribed for 3 months!
Lizardan: @dyslexicgruffalo trying to find a cure
Nussinov: 5'-UTR----I'm Retarded----3'-UTR
trumpetjean: trumpetjean subscribed with Twitch Prime.
dj_vicio: final lvel guys come on!
hitmanhax: PogChamp 54%
TrippinFlare: LEVEL 5 CHAT PogChamp
dj_vicio: 1 min to go
St47ik: 1min left PogChamp
logi6000: when does the Google trends part of George's steam come
TrippinFlare: !claim
nashesvobodnoye: nashesvobodnoye is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
nashesvobodnoye: nashesvobodnoye gifted a Tier 1 sub to iskjmss!
nashesvobodnoye: nashesvobodnoye gifted a Tier 1 sub to 1shortking!
nashesvobodnoye: nashesvobodnoye gifted a Tier 1 sub to 33333333333333!
nashesvobodnoye: nashesvobodnoye gifted a Tier 1 sub to iRenansz!
nashesvobodnoye: nashesvobodnoye gifted a Tier 1 sub to 64pillars!
AnAnonymousCheerer: Anon67
TrippinFlare: PogChamp
aiex42: HYPE TRAIN LVL 5 is the last level
dj_vicio: holy.....
Cornflays: nmpPOGGERS
St47ik: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
pjayys77: dayum 138 %
hitmanhax: PogChamp DODGED
informalgarlic: skaPOG skaPOG skaPOG skaPOG
Sky_Light_37: PogChamp
TrippinFlare: SCAM TRAIN PogChamp
bufferovrflw: HYYYYYYYYYYYYYYYYYYYYYYYYPEEEEEE
ideology_sniffing_raccoon: LEVEL 5 PogChamp LEVEL 5 PogChamp
brownyyyylocks: gift me
grey_street: Hype
alycia: test¨'
jasondesante: I hope they increase the level cap of hype train with the release of burning crusade
happypuppppy: PogChamp
mescal33t: beastyPoggers beastyPoggers beastyPoggers
JjohnConstantine: PridePan PridePan PridePan
somnium_s: !uptime
Aixyn0: !train
milobailey: HYPE SCAM
iskjmss: @nashesvobodnoye spasibo brat)))
Izimoney92100: PogChamp PogChamp PogChamp PogChamp SeemsGood
almonte550: Did we broke it ?
St47ik: 140%
1ntegral_: Dynamic programming is the key for alignement comparison algoirtihms @georgehotz
pjayys77: 30 Seconds Monka
hitmanhax: PogChamp OVER 100
TrippinFlare: DELETE CORONA PogChamp DELETE CORONA PogChamp DELETE CORONA PogChamp
aiex42: SCAM TRAIN HYPE
logi6000: I mean if I could get gifted thatd be great
bufferovrflw: gift sub pls
pjayys77: give all the munies
St47ik: TriHard 7
ideology_sniffing_raccoon: LEVEL 5 140% PogChamp LEVEL 5 140% PogChamp
bokeee_: Choo Chooo HypeUnicorn1
nashesvobodnoye: Choo Chooo HypeUnicorn1
imopfloors: HypeUnicorn1
TrippinFlare: Choo Chooo HypeUnicorn1
trumpetjean: Choo Chooo HypeUnicorn1
pjayys77: it was a good run
Izimoney92100: lvl 5 bois
happypuppppy: asking for handouts :z
theonlymonkas: PogChamp
dvdutch: HypeDragon5
iskjmss: PogChamp
mescal33t: Choo Chooo HypeUnicorn1
bufferovrflw: 250 bytes bruh
logi6000: choo fucking choo bitch the next station is anal devestation
cutza: !coronavirus
St47ik: PogChamp
gameinchanel: can you CRISPR edit the covid-19 to super covid-2020 alien edition
FargioFarmani: Choo Chooo HypeUnicorn1 1-Monats-AbonnentTwitch Primetrumpetjean: Choo Chooo
bokeee_: i did great dad )
bigie: level 5 autonomy
Cornflays: LUL
Kodak_Z: kodakzUSA
dyslexicgruffalo: !streamtime
ipo___: Nutty George
HoiskyPoisky: LuvHearts
dj_vicio: @logi6000 you sure know about that subject, do you?
dyslexicgruffalo: !time
nashesvobodnoye: LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvSign LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush LuvBlush
auron018: !time
Lana_Lux: Hello!!
TrippinFlare: can you push your CRISPR changes to github on the coronavirus vaccine branch?
gameinchanel: kntentHelo
St47ik: @Lana_Lux hey Lana PogChamp
Sky_Light_37: @georgehotz can you zoom the notebook a little bit? pretty hard to read
zak_krack: LUL extra letter
Lathendros: it was me sorry
zak_krack: alien dna
pjayys77: F that W
theeliteoftheelite21: it stands for wuhan
Mariosavitch: git commit -am 'Typo' @georgehotz
TsarSec: lanaluCat
FargioFarmani: who is Lana??
SHAVEYY_: OMG
anguscupcake: no
Nussinov: W usually means weak for pyramidines i think like A or T?
SHAVEYY_: NOOO
JustAsGoodJo: translating into protein :)
logi6000: no
DecayingSkullz: Oh my
St47ik: mods cmonBruh
ideology_sniffing_raccoon: monkaW
T3chHS: LOL
dvdutch: yum
pjayys77: hmm mod boyz
patulskitime: ban
saixj: clean the data
cutza: ban
stole_yo_eip: W
SHAVEYY_: monkaS MODS!!!
Izimoney92100: BibleThump BibleThump BibleThump
alycia: Make me mod and I can BAN
shlver: KappaPride
Mariosavitch: git commit -am 'More typos'
electro55555: is that a lolipop
ipo___: white stuff wut?
thebiggaeboi: LMAO
Lana_Lux: Could anyone fill me in on this process?
SHAVEYY_: GEO SCROLL UP
Ghost_001: LUL
St47ik: @georgehotz get mods bro NotLikeThis
Mariosavitch: lol
logi6000: george didn't even know what to do when he looked at chat
ideology_sniffing_raccoon: no mods
JustAsGoodJo: N is usually denoted as a missing nucleotide :)
TrippinFlare: no ones has any clue @Lana_Lux
alycia: I am willing to be mod!
Mariosavitch: git commit -am 'add random characters to confuse hackers'
lebop: @georgehotz just give me mod so i can ban them
bufferovrflw: try except?
1ntegral_: Dynamic programming is the key for alignement comparison algorithms @georgehotz
KruptWorld: hahah youre hilarious geohot!
shlver: @Lana_Lux asking what hes doing is a banned question
Lana_Lux: @TrippinFlare LUL
dj_vicio: dont look chat please
St47ik: PogChamp
CompestLive: lmso
Lana_Lux: Ooooo
CompestLive: lmao
alycia: TEST
anguscupcake: what mac does george use
abk467: PogChamp
TrippinFlare: Kappa
SHAVEYY_: PogChamp
almonte550: @georgehotz can I be mod
CompestLive: I want sub :(
nashesvobodnoye: PogChamp
logi6000: Lana ban that dick dude
Ghost_001: monkaS
CompestLive: Or mod lol
rraksut: the people asking for mods are the same people on alt accounts causing trouble
Loutlot: ?
knilecrack: what are you trying to do?
METH_HEAD_MIKE: monkaS
Mariosavitch: i sent you all the diff code, can I be a mod?
Ghost_001: mod corona monkaS
u1337ochka: why would anyone ban people
FargioFarmani: can I be mod please?
Bitcoin__: Twitch Staff :)
Restless_Bagel: staff :)
SpecialAgentSkye: I have contributed nothing. Can i be mod? :)
CompestLive: I always make the chat lit and HQ gib mod kappa
benakiba: &lt;message deleted&gt;
Cornflays: monkaS
bufferovrflw: Can't you just try except for the KeyErrors?
St47ik: :)
lebop: lol
OnlyB1ade: yea
dvdutch: &lt;message deleted&gt;
faxity: Loutlot hype train conductor PogChamp
SHAVEYY_: can I be mod?
TrippinFlare: I have 84 commits can i be mod george
Lana_Lux: Can I ban everyone? :)
SHAVEYY_: :)
pjayys77: whoa our twitch overlords are present
kakurai: so many saint people over here
stole_yo_eip: @Lana_Lux me first
samu79rai: Squid1 Squid2 copyThis pastaThat Squid4
bufferovrflw: George, try except for the KeyErrors?
ColdZer0o: @Lana_Lux just end me
St47ik: @Lana_Lux ban the virus LUL
Vjasal: are you looking at genome of viruses that only infect humans, or other ones too? @georgehotz
publishcoffee: @Lana_Lux it would be an honor to be banned by you
logi6000: @lana_lux shit George we have a non comrade in the union
TrippinFlare: i will review your PRs can i be mod pls
ezamlaid: what is he doing?
Riqour: can i be mod? Kappa
KruptWorld: is this part of your church youre starting? i want in!
trajenx: twitch staff might ban us for coronaS misinformation :(
Nussinov: table for the different letters https://www.bioinformatics.org/sms/iupac.html
ytazn: Yep
SHAVEYY_: @georgehotz I don't know x86 assembly, can I be mod :)
Lana_Lux: LUL
FargioFarmani: who is this Lana??
SHAVEYY_: @FargioFarmani game dev streamer
conductor1: I have no idea whats goin on :)
ytazn: Yep cock
knilecrack: twitcher
logi6000: @fargiofarmani nobody know she just raided the stream and became a mod
Lizardan: @conductor1 noone does
conductor1: thank god
xMrDidas: What is he doing ? just joinned
ytazn: RlyTho
saixj: check chat someone posted a link above
DBJNR876: @georgehotz those 16 Quadros you have in your machine better be Folding
FargioFarmani: well up to a great start then for Lana
T3chHS: @FargioFarmani a talented game dev
logi6000: @xmrdidas bannes
11plus4thinking: did you make some good money shorting the market?
publishcoffee: @xMrDidas he's hacking the coronavirus
rgbeezus: SeemsGood
AresRai: @11plus4thinking I seen a few byron viewers in here already SeemsGood
alycia: waffleD
dorkmo: highlighted message trainnn chooo
samu79rai: wow 16 quads.
ytazn: RitzMitz
almonte550: biopython again
stole_yo_eip: ../
JustAsGoodJo: there are ton of sequence alignment algorithms that score based upon missmatched bps
logi6000: I got 800 channel points just from this stream
11plus4thinking: @AresRai havent watched that hobo in months
PiroFloydian: ayyy we love memoization
rgbeezus: choo
abk467: choo choo
alycia: -380
cutza: Choo
dorkmo: choooo
n00b_Solid: CHUGGA CHUGGA
METH_HEAD_MIKE: choo choo
tokumei64: choo choo choooo
ytazn: Choo
SpecialAgentSkye: quack
shlver: Choo
1ntegral_: Yeah dynammic programming works great for alignement comparison algorithms !
DecayingSkullz: choo chooooooo
publishcoffee: choooooooooooooo
iskjmss: ANY -380ers?
TrippinFlare: PAIR programming with twitch chat PogChamp PAIR programming with twitch chat PogChamp PAIR programming with twitch chat PogChamp PAIR programming with twitch chat PogChamp
r0xtehem0x: Cheer100 chooooo chooooo
dorkmo: choooooo
Ziv0: chooo
rubho: train noises
DecayingSkullz: choo choooooo
BesterGester: -380
OnlyB1ade: CHOo0
ited01: i can do this
knilecrack: damn
shlver: choo
Bitcoin__: Your neighbor is crazy, move out D:
dorkmo: chuga chooooo
ideology_sniffing_raccoon: CHOOO PogChamp CHOOO PogChamp CHOOO PogChamp CHOOO PogChamp CHOOO PogChamp
ProtoLambda: chooo
dj_vicio: @Lana_Lux why you restrict non-subscribers from watching your videos?
almonte550: KappaHD
kleyy: wow
logi6000: @ited01 we found the true hacker
almonte550: MiniK MiniK
ytazn: Pog
Mariosavitch: lol
dorkmo: chitty chitty choo choo
miths: You guys excited about the new 14'' mbp?
Sky_Light_37: achoooooooooo corona train
ited01: @logi6000 xD
VanishBlox: Goodnight George
yevheniiushtyk: skrr skrr
toasty_jk2: @georgehotz that's why there are w, y and r's in the "dna" : https://en.wikipedia.org/wiki/FASTA_format
ited01: now it's purple
alycia: is corona created by the governemnt?
knilecrack: no
ited01: no
Cornflays: -380 LUL
michownz: no lol
logi6000: @ited01 who are you and whos is so wise In the ways of science
highxsnow_: yes
mik12f4: Is this Part 1 of 10?
yevheniiushtyk: @georgehotz is it hard to self-taught math?
KruptWorld: are you finding the jailbreak for cornavirus? XD
theonlymonkas: LUL LUL
JustAsGoodJo: sequence alignment is a very open field in bioinformatics and genomics atm
MuscleMario: Choo Chooo HypeUnicorn1 me got it
TrippinFlare: you need a library in this case @georgehotz
Mariosavitch: 60 page algo
TrippinFlare: github search
Nussinov: the scoring for biosequences is rather tricky because you know, evolution and stuff
samu79rai: you can do it
21_savior: PogChamp
void8TV: Use dynamic programming for protein folding
TrippinFlare: git clone coronavirus
KruptWorld: can someone fill me in on what hes trying to achieve here?
HoiskyPoisky: phone call inc
almonte550: Finally, some loops and funciotns
vidminok: attaaaggtt
Mariosavitch: its in the title
TrippinFlare: can we write it in rust?
zak_krack: I have never seen a twitch stream like this one.
logi6000: @trippinflare were all bouta do it
21_savior: git blame china
Crayonsss: can someone tl;dr how this works?
Cornflays: FeelsAmazingMan 🍄 Time
theonlymonkas: hands
Crayonsss: what hes doing
1ntegral_: @zak_krack Same
KruptWorld: ya but like how what??! lol
almonte550: Can we write it in go?
Nussinov: 5'--- Pepega ---3'
ideology_sniffing_raccoon: pee pee time
bokeee_: gawd daym thats a loud toilet ROFL
lgtst_: tl;dr - it doesn't
frantisek1337: what keybord do you have
void8TV: @georgehotz Protein folding is NP Hard bro
knilecrack: call it twitch_covid
logi6000: call it CIA IS WATCHING
peacedivision: Is he hacking the ps4 ? finally ?
samu79rai: PowerUpL CoolStoryBob PowerUpR
KruptWorld: lol
miths: no tmux DansGame
Nussinov: HACKER ALERT
KruptWorld: hes hacking nature @peacedivision
theonlymonkas: vim
SpecialAgentSkye: He is hacking Corona PogChamp
yevheniiushtyk: why do you do ls and ls -l everytime you create a new dir?
Anin209: Hackman PogChamp
KruptWorld: just like he said we wanted to
imopfloors: George needs to make a bioinformatics startup
thejuror8: @yevheniiushtyk Reflex, I do the same
KruptWorld: i think its the start of his church!
almonte550: @void8TV he is not folding anything yet
TrippinFlare: alias l='ls -lha'
saintmthw: @yevheniiushtyk muscle memory after cd
peacedivision: @KruptWorld fuck nature, i want ps4 hacked :(
1ntegral_: what's your setup ? @georgehotz
JefeBezos: iTerm and zshell are unreal
yevheniiushtyk: oh ok haha
bigie: vi not vim DansGame
dinxpoy: guys he's creating a ps5 emulator for x86 PC's
KruptWorld: @peacedivision get started on it then
yevheniiushtyk: i can type fast but i can
almonte550: neovim &gt; vim
yevheniiushtyk: cant type that fast while i code or in terminal lmao
peacedivision: @KruptWorld i don't know shit about coding and stuff
georgehotz: https://github.com/geohot/corona
zak_krack: /fun/corona
knilecrack: this is how it all started
zak_krack: what a path
TrippinFlare: git clone https://github.com/geohot/corona.git
KruptWorld: youre the fuckn man!
logi6000: just cloned it
almonte550: finally, now I can download some coronas
JustAsGoodJo: python tab struggles lol
VGBurnzy: i wish i understood this :/
KruptWorld: i have a titan rtx sitting here let me know if i can contribute somehow
tokumei64: @KruptWorld folding@home :)
mashafique: You should post more often on Instagram
KruptWorld: im a mid-level programmer i would say
KruptWorld: oh ya i wanted to get on that
Nussinov: KruptWorld Kappa
pistolpetepcp: are you doing science today
hir0andobey: can this actually help to create a vaccine?
TsarSec: join the folding@home project for the rona @KruptWorld
zak_krack: i loving george's speed. not at typing, but at making progress
Keijo: i would call myself a golden legendary master lever programmer
Tomishima: scripted Kappa
diegoarigony: poor kb
KruptWorld: but what is geohot doing? literally programming a folding protein? lol
samu79rai: kill the Corona virus for us all George
MrJeff_: @KruptWorld Folding @ Home. But i heard they're struggling with bandwith as it went from 30,000 users to 400,000 in the past week.
KruptWorld: @haha diegoarigony
miths: We demand Plague inc playthrough to prove you know anything about pandemics.
AresRai: hes having fun :
Nussinov: KruptWorld right now I would say he's analyzing the available sequences
almonte550: @KruptWorld just learning stuff
logi6000: @diegoarigony it sounds amazing I'm gonna get the one he has soon
ohko10: !uptime
zak_krack: I think he's trying to understand its function, and how the variants differ from each other
dj_vicio: lol
bigie: ok everyone start making PRs LUL
firstavegner: yes that what's he's doing
zak_krack: the bits that don't change are likely to be important bits
almonte550: whitespaces &gt; tabs
KruptWorld: @zak_krack you mean hes created like a comparing tool?
miths: spaces monkaS
KruptWorld: creating*
Sky_Light_37: W LUL R K
zak_krack: "Phe / F UUU, UUC "
zak_krack: Sounds rude
JustAsGoodJo: i need to learn these shortcuts tbh lol
MrJeff_: @KruptWorld You can contribute your GPU or CPU to Folding @ Home.
TrippinFlare: W OMEGALUL R K
SHAVEYY_: bro I thought you independent hacker who dont need no work
FoxMcWeezer: What’s the corinavirus
yevheniiushtyk: recently got hhkb pro 2, gonna take some time to get used to it lmao
zak_krack: @KruptWorld I think he's trying to use an existing one from biopython
dj_vicio: everyone needs to work
shieeeeeeeeet: !uptime
almonte550: @MrJeff_ I'm already contributing but they doesn't have any WU left, I switch to Boinc
samu79rai: tell it what to do
Br4nnon: where are you at in your project
miths: Lmao you call yourself a georgehotz fan? I'm fucking loaded on channel points bro. I highlight every message because I'm just that jacked. Try talking in chat again when you're a true fan
peacedivision: so is he going to find a vaccine doing this ?
samu79rai: u make up the rules here
1ntegral_: Why aren't you Twitch partner ? à
1ntegral_: @georgehotz
MrJeff_: @almonte550 Check LLT's video, they're setting up another server for users as they have 10gb.
theonlymonkas: LUL
pistolpetepcp: zsh vs bash
VGBurnzy: @miths nobody cares
r0kz_: Lmao you call yourself a georgehotz fan? I'm fucking loaded on channel points bro. I highlight every message because I'm just that jacked. Try talking in chat again when you're a true fan
toasty_jk2: @Lana_Lux :)
Cornflays: Lmao you call yourself a georgehotz fan? I'm fucking loaded on channel points bro. I highlight every message because I'm just that jacked. Try talking in chat again when you're a true fan
Keijo: this is very boomer chat
dj_vicio: moooods
1ntegral_: @pistolpetepcp Is that even a question of course Zsh !
BesterGester: @peacedivision probably not
theonlymonkas: lol
AresRai: meh copypasta
blazeofglorytv: Lmao you call yourself a georgehotz fan? I’m fucking loaded on channel points bro. I highlight every message because I’m just that jacked. Try talking in chat again when you’re a true fan
SHAVEYY_: check latest commit comments
pedrovictortech: @miths Imagine needing to have things to prove that you are a fan
Keijo: needs more hydracock
bokeee_: this chat is dank ngl
slimpimp007: ayo somebody come get their manz
zak_krack: zak_krack subscribed at Tier 1.
Bagofpotatoes: what's Geo trying to do? something about sequencing the virus genome?
miths: @pedrovictortech imagine getting mad over a copypasta LUL
T3chHS: So you're going by "georgehotz" now nerd? Haha whats up douche bag, it's Tanner from Highschool. Remember me? Me and the guys used to give you a hard time in school. Sorry you were just an easy target lol. I can see not much has changed. Remember Sarah the girl you had a crush on? Yeah we're married now. I make over 200k a year and drive a mustang GT. I guess some things never change huh loser? Nice catching up lol. Pathetic..
almonte550: @MrJeff_ great,
pedrovictortech: @miths aigth you got me there
Mariosavitch: lol
pedrovictortech: aight*
KruptWorld: lol is that a copy pasta?
11plus4thinking: @T3chHS real original salmon15Dank
SHAVEYY_: monkaS tanner
yevheniiushtyk: do it in haskell
miths: Tanner is back monakS
SHAVEYY_: So you're going by "georgehotz" now nerd? Haha whats up douche bag, it's Tanner from Highschool. Remember me? Me and the guys used to give you a hard time in school. Sorry you were just an easy target lol. I can see not much has changed. Remember Sarah the girl you had a crush on? Yeah we're married now. I make over 200k a year and drive a mustang GT. I guess some things never change huh loser? Nice catching up lol. Pathetic..
IndoPridePinoy: when can i download corona cure?
valibuu: why cant I write anything
T3chHS: The most classic copypasta
theonlymonkas: LUL
valibuu: What is he trying to do ?
11plus4thinking: chat spamming a dead beaten copy pasta salmon15Dank
slimpimp007: I can't picture a grown ass man named Tanner
TsarSec: LUL
kokadoo: R u infecting corona with a virus?
theonlymonkas: my name is tanner in 54
Br4nnon: he's trying to hack into the mainframe sodaVeg
33333333333333: woie
Mariosavitch: your computer will get corona if not careful
zak_krack: @valibuu He's got a data source which is in G, C, T, and A form, and he's translating it into the 26 proteins that DNA can form. I think.
OnlyB1ade: tanner is literally tanned
TsarSec: so whats the rna sequence for NOP?
esence: HERE WE GO BOIS
raondev: oh Boy what ha Idiot with spamming this shitty text
Keijo: Rest in piece Billy
Bagofpotatoes: jesus, stop filling the chat with highlighted copy/paste shite.
Jehhred: Is Data Science to Programming the equivalent of Geology to Science???
KruptWorld: hahah @kokadoo . i wanna know what hes working towards too!
SHAVEYY_: shutup I like myhighlight mesages
TrippinFlare: TSV WutFace TSV WutFace
abedbawsxx: are you trying to print hello world? let me help you
yevheniiushtyk: i can't use editor if it doesn't highlight whitespaces, i guess just my OCD, anyone does the same? lmao
Mariosavitch: dklsvhefwhfi23ifef
Bagofpotatoes: @zak_krack what can be achieved after mapping it onto those proteins?
SHAVEYY_: your a geohot fan? name every Continent
1ntegral_: @Jehhred Data science to Computer science you mean
zombiedigital: nopcauenapo undsacuoneapcubeaupi
TrippinFlare: python 2.7????????????????
raondev: @shaveyy_ shut up
theonlymonkas: LUL
KruptWorld: just hearing him type gives me a boner
SpecialAgentSkye: My boss thinks fixing bugs is deleting the line of code with "bug()" in it :) :gun:
Cornflays: @georgehotz are u calling this exploit coronara1n LUL
VoidSpyke_: :retab
11plus4thinking: @TrippinFlare does it matter???
SHAVEYY_: :( im running out of channel points
pistolpetepcp: @1ntegral_ zsh is more like zzzzzzzsh
zak_krack: @Bagofpotatoes easier protein diffing for a start
miths: @SpecialAgentSkye LUL
cybergenik: No Data Science is to Programming what Theoretical physics is to science. Your not building anything, but your extracting extremely valuable information using complicated algorithms...
Juankinator: pythLOLn
JustAsGoodJo: see differences in which codons are coding for which proteins
Jehhred: @1ntegral_ Yeah pretty much
zak_krack: G, C, T and A are hard to look at. Protein strings have more letters and are much shorter and easier
Toastie1: So am i the only one that's lost here
PiroFloydian: rip
parktype: Why using a mac?
IndoPridePinoy: wrap it bois., no coronavirus cure
dyslexicgruffalo: vi, convert spaces to tab?
TrippinFlare: COVID-19 JIRA ticket
11plus4thinking: @cybergenik please learn to use the correct your FailFish
JustAsGoodJo: see which bps are conserved across strain
miths: @parktype Steve Jobs was his grandfather
cybergenik: sorry you're
Bagofpotatoes: @zak_krack cool... so "diffing" the protein means comparing it against similar virii or wha?
TrippinFlare: @11plus4thinking isn't 2.7 deprecated?
bichid69: pppppppppppppppppppppp
parktype: ahh makes sense @miths
Riqour: @cybergenik don't apologize FailFish
ackxhpaez: My company actually opened a COVID Jira project
kubaaa6: @Loutlot are you an engineer?
cybergenik: wait @11plus4thinking LOL, a fellow reckful fan
couso_99: @Toastie1 I dont have a clue either :/
KruptWorld: im so happy this chat is actually chattable
abedbawsxx: @Riqour don't feed the trolls FailFish
yevheniiushtyk: does he have some prior skills in bio engineering? how does he do this shit wtf
11plus4thinking: @cybergenik why am i a reckful fan?
dj_vicio: slash to terminate maybe
bob_babyelephant: yo i love your shit
kubaaa6: kubaaa6 subscribed with Twitch Prime.
dj_vicio: escap
lemonboxed: every company is doing a covid project right now
cybergenik: 11 4
Riqour: @abedbawsxx LuL
kubaaa6: Want to watch your old vods pleae dont delete :)
bob_babyelephant: lololol
TrippinFlare: @yevheniiushtyk he's a bioinformatics dropout
JustAsGoodJo: LUL
KruptWorld: @yevheniiushtyk right!?!?! im tryn to get it too
11plus4thinking: @cybergenik ok so? doesnt mean im a fan
almonte550: Because they do bad stuff
lgtst_: extra crap
lgtst_: topping
ahahahaitslit: what the hell is he tryna do
JustAsGoodJo: you should put those protiens into pymol and see protein-protein interactions
dontusethiscode: doesn't look like a bad protein to me xD
samu79rai: ect.....
bob_babyelephant: also you use tmux and vim right
cybergenik: @11plus4thinking do you just like the meme?
Loutlot: @kubaaa6 I do python but mostly for fun
FoxMcWeezer: Ramirez! Cure me that Covid-19 now!
11plus4thinking: @Loutlot what does "fun" include LUL
miths: Im a java developer, help me chat PepeHands
bsuis: @kubaaa6 they're on yt
pistolpetepcp: i can solve coronus, give me btc
logi6000: just ran download sequesnces
toasty_jk2: because it is FASTA: https://en.wikipedia.org/wiki/FASTA_format
KruptWorld: i dunno @ahahahaitslit i think its finding the protein that can kill the corona
yevheniiushtyk: using arrow keys on hhkb is so fucking annoying
logi6000: can confirm it works on arch
samu79rai: faster george faster
kubaaa6: @Loutlot ok was wondering why staff was watching unless they knew programming :p
TrippinFlare: protein.is_bad()
tehEGO: Did corona possibly come from a snake, and now using python to solve it.. is that like two snakes eating each other
Tymski_: Every time I code in python I get missing :
miths: @yevheniiushtyk you get used to it really fast imo
JustAsGoodJo: maybe codons don't align with the total number of bp?
KruptWorld: @georgehotz do you ever listen to music when you code?
OLEM13: what is he doing?
Lana_Lux: @JustAsGoodJo can you explain what he's doing? lol
dunehazard: chill mac miller
fa_k: @KruptWorld he just did yesterday
vaskogomez87: jesus i cant even see
knrbg: Hello from Bulgaria
bufferovrflw: -STOP UAA, UGA, UAG  STOP UAA, UGA, UAG
bufferovrflw: you added more whitespace, lol
toasty_jk2: also i noticed that some genome samples have trailing adenine
dontusethiscode: love the font size
hellashotsx: What is he even doing?
TrippinFlare: "diffing the protein"
logi6000: I'm back
yevheniiushtyk: @miths aight, gotta practice ig
limpid_kzonix: https://community.datarobot.com/t5/research-center/join-the-fight-against-covid-19-with-datarobot/td-p/2282
Juankinator: corona = null Done Kappa
yevheniiushtyk: @miths u got hhkb asw?
ahahahaitslit: does anyone have a spare magnifying glass?
dj_vicio: another aderall shot
miths: @yevheniiushtyk hell yeah brother
Mariosavitch: chicken tendies?
zak_krack: A 4K monitor really helps watching this stream
zargy: Have ice cream for dinner
yevheniiushtyk: @miths nice mac/win?
ancientwoodland: he's uploading corona into the mainframe
Lana_Lux: sounds like my dinners
KruptWorld: @hellashotsx he just made a library for helping find the protien that kills corona?? ahha i have no clue
icanthitthose: what does engineering the coronavirus mean?
parktype: What kind of fuckery is this?
limpid_kzonix: @juankinator lol
AresRai: hes making the corona sequence and then will see how it goes from there, protein folding will be difficult x)
BesterGester: @Lana_Lux He is creating a tool to check the differences between viruses
zak_krack: Also remember to go full screen with F11 and fold down your left side bar
Punkfx: What is his strategy here for reverse engineering Covid. That doesn’t even make sense
samthedogg: im back, have i missed much?
Lana_Lux: @BesterGester ah, cool. thanks
JustAsGoodJo: @Lana_Lux i'm working on understanding LUL. from what i gather, he's looking at fasta codes (which are sequences of dna) across multiple coronavirus strains potentially to compare them. he then translated those sequences into proteins to compare them
Tomishima: What is his strategy here for reverse engineering Covid. That doesn’t even make sense
samu79rai: George do you believe in aliens
miths: @yevheniiushtyk mbp 2015, planning on buying the new 14'' mbp though. hbu?
almonte550: @Punkfx we are just learning stuff
fa_k: mactoodlers stop
zak_krack: I can explain what he's doing: he's currently cooking rice.
Ghost_001: @Tomishima Hack the world
OnlyB1ade: KappaHD KappaHD
dj_vicio: cereal
dontusethiscode: i. might get corona from this font size tbh
Nussinov: Tomishima it;s clickbait dumbass
DecayingSkullz: We need a Geohot cooking stream
fukurowlz: hacking the rice
pjayys77: hack the planet, cmon now
yevheniiushtyk: @georgehotz 2018 13" mpb, how long have you got the hhkb for?
icanthitthose: how do you get the corona sequence from a computer a program
OnlyB1ade: PokGardevoir
knrbg: Hello
OLEM13: An intereactive view of the virus?
Tomishima: He is out of his safe zone boys
JustAsGoodJo: @Lana_Lux but mrna sequences are pretty messy with regions that are untranslated or not coded into protein (ie functional bits) so he's cleaning them up
knrbg: How are you
phrixus_bro: hi
brownyyyylocks: whats in the oven?
yevheniiushtyk: @georgehotz which one do you have?
VGBurnzy: new macbook air, that's all
OnlyB1ade: hack the rice
TrippinFlare: new macbook air launched
dj_vicio: get a Lenovo Thinkpad
ideology_sniffing_raccoon: "CHEAP" LUL
dj_vicio: great for research
VGBurnzy: 1.1ghz.... what year is it?
1shortking: i3 for $1000 PepeLaugh
brownyyyylocks: rose gold finish
Mariosavitch: lol
pistolpetepcp: LOL
stole_yo_eip: lmfao
parse: LUL
dontusethiscode: if you were poor
Sky_Light_37: LUL
dontusethiscode: kek
Mariosavitch: unless your poor.. $1000
djcows: Just get a pro
anon_v28: $1000 dual core lol
yevheniiushtyk: gotta use the repair program to fix the sticky keys, drives me mad
BesterGester: @VGBurnzy That's base clock, not boost
djcows: i got the 16, super solid
miths: thinkpad x230 for the poor
logi6000: 1300k for a laptop=poor?
limpid_kzonix: probably somebody will be interested in thisLook what I shared: COVID-19 Open Research Dataset Challenge (CORD-19) | Kaggle @MIUI| https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge/tasks
VGBurnzy: """pro"""
pistolpetepcp: Gotta pay the apple tax
Sky_Light_37: pls donate guys, he is poor
Juankinator: who needs ram anyway just close chrome tabs
Winnepooh_: extra 8gb of ram from Apple, $400
Lana_Lux: @JustAsGoodJo interesting. and thanks. once they're cleaned up or compared, what can you do wit that info
Program: Good evening, everyone.
SpecialAgentSkye: @VGBurnzy Missing 8 quotation marks buddy
Tomishima: @Sky_Light_37 lol
bob_babyelephant: lag
dj_vicio: cant do shit with 8GB of RAM. only open 2 tabs in chrome.
yevheniiushtyk: i got 8gb mpb pro and i kinda regret it lmao
VGBurnzy: @SpecialAgentSkye sorry
DBJNR876: yes i concur
almonte550: Are we going to predict what sars-3 gonna look like?
dabdabay: ne vaxta stream bashlayib bu oglan
bichid69: What happenned to your razer blade?
Nussinov: You're thinking of polypeptide
Tomishima: he just streams for fun and the FBI and CIA
JustAsGoodJo: polyprotein is functional protein that is chopped into bits by an enzyme
Nussinov: proteins are made of peptides
alexandru_cristiean: @georgehotz getting that sweet Google job or hacking my way to freedom?
AresRai: shape probably
dontusethiscode: Is this guy like a budget christopher olah? I
VGBurnzy: @alexandru_cristiean who would want to work for good LUL
imsuperficial: let's just discover where the coronavirus lives in latent space
Juankinator: cant we just nuke the coronavirus?
PiroFloydian: Keep reading you were almost there
QuantumDota: Memes
Hello_im_nix: !uptime
zak_krack: Proteins are 3d
yevheniiushtyk: work on temple os after hacking corona?
bichid69: What happened to your razer blade?
kevin21071: you ever took BCAA?
Nussinov: @georgehotz typically a protein a more biologically 'complete' unit, whereas peptide typically refers to much shorter, sometimes truncated proteins
Loutlot: Peptones are material prolines made of
Hello_im_nix: is that a HHKB? Sounds like one
dj_vicio: BCAA == chaim aminoacids
AresRai: @dontusethiscode budget ? :o google this guy
dj_vicio: chain*
kevin21071: Branch chain amino acids
Tomishima: pyhton &gt; ruby
JustAsGoodJo: @Lana_Lux that's what i'm interested in seeing! you can look at protein interactions. once a virus is inserted into the cell membrane, it must replicate and make more of itself (more protein) so the goal is to disrupt that machinery
SpecialAgentSkye: We are developing an anti virus that we deploy with OTA update to all humans that can detect corona PogChamp Kappa
dontusethiscode: @AresRai google olah lol
fukurowlz: recently the minister of health of my country says "maybe this virus turn into a good person, in that case it will be another case" to avoid implement a quarantine
yevheniiushtyk: @Hello_im_nix yeah he's know to use hhkb
DecayingSkullz: @Hello_im_nix yes it is
JdPaulBlart: did you see the stanford paper on your speed detection challenge @georgehotz
ancientwoodland: critical firmware update, recommend immediate install
zak_krack: you can also download the 3d folded shape of coronavirus instead of just the protein sequence
peacedivision: we need to clone @georgehotz a few thousands like him maybe 1 would hack the ps4
Loutlot: Polypeptides are not act like Proteins unless they are folded correctly and functional
vaskogomez87: ah yes
Mariosavitch: jkerhgiu3wijefhwdf
logi6000: @peacedivision but that clone will get sued
dj_vicio: this guys' a robot
peacedivision: @logi6000 he wouldn't you can do it anonyomous
yevheniiushtyk: @dj_vicio just a big nerd
1ntegral_: yeah probably faster with dictionnaries
logi6000: should robots have rights?
pz3300: What happened with that case? Did it get dropped?
theonlymonkas: yes
JustAsGoodJo: i think you want to see the three dimensional structure of these proteins, which is a structural biology battle.
Nussinov: Loutlot this is not true. There are non-functional 'proteins' and functional 'peptides', this distinction is more or less meaningless, like most categorizations in biology
SpecialAgentSkye: Should rights have robots?
nitcat: nitcat subscribed at Tier 1.
bichid69: What happened to your razer blade?
parktype: What is this?
logi6000: @specialagentskye shiit idk
theonlymonkas: LUL
SpecialAgentSkye: idk shit @logi6000 /shrug
georgehotz: https://github.com/geohot/corona
yevheniiushtyk: oh fuck imma start that
Darvein21: !uptime
Tomishima: public repro in 2020 Kappa
fa_k: Ah Yes my penistosida is also foldable, may i please
ahahahaitslit: let's kill this virus boys
pz3300: Imagine if robots starting raping people
nitcat: np
zak_krack: I think you can download the 3d structure raw data at https://www.rcsb.org/structure/6lu7
11plus4thinking: salmon15Dank if (Coronavirus = true) { find cure } else { do nothing }
mashafique: How much bio do you know Georege
mashafique: George*
megaman0711: hi I'm new, can anyone give me a tldr of what he's trying to do? thanks
Lizardan: @megaman0711 title
Mariosavitch: but a bitch aint 1
bufferovrflw: @11plus4thinking bro, you just assigned true to Coronavirus
TheRedLineUK: can I hear topre switches??
Nussinov: zak_krack that ramachandran outlier score Kreygasm
kaiokenx90: hey george i just farted wanna reverse engineer that?
zak_krack: I got 99 sequences but a twitch ain't one
SpecialAgentSkye: Building an anti virus competetor for Avast Free Anti cheat that can beat corona @megaman0711 Kappa
pz3300: Cherry brown are best
peacedivision: @megaman0711 he's hacking the coronavirus, this would lead to a ps4 exploit
Mariosavitch: i got 99 sequences but a cure isnt one
megaman0711: ahaha
fukurowlz: @mashafique let him study two days and that will be enough
11plus4thinking: @bufferovrflw bro it was obviously a joke
Amaz1ngLALALA: Hi guys, I'm Russian from the future, you should stop him immediately, no joke
TheLogg: LOL^^^
bufferovrflw: @11plus4thinking bro...
SpecialAgentSkye: Hi russian from the future. Im adopted
pz3300: In soviet russia virus cures you!
bichid69: use tensorflow to find a cure bro
11plus4thinking: @bufferovrflw bro meet me @ twitchcon
yevheniiushtyk: oi guys, you got any tips on how to get into reverse engineering, and binary stuff, i wanna broaden my skillz a lil
peacedivision: he is making the ultimate virus that would wipe the world in seconds and he will be immunite to it
mashafique: @fukurowlz enough for what?
TrippinFlare: what's cleaving?
bufferovrflw: @11plus4thinking bro we're gonna have a good time at twitchcon bro
TrippinFlare: cleaving - Proteolysis is the breakdown of proteins into smaller polypeptides or amino acids.
bichid69: @yevheniiushtyk it's jus 1 0 bro
yevheniiushtyk: history 🤔
SpecialAgentSkye: Just make an AI that guesses them PogChamp
Tomishima: is do not trust this dna sequence
yevheniiushtyk: @bichid69 wot
Mariosavitch: what do you wnat
TrippinFlare: google
11plus4thinking: @bufferovrflw bro im gonna bash ur head in bro squadR
bufferovrflw: @11plus4thinking bro, don't
Tomishima: remember the Xerox copy machine software bug
Nussinov: Try researching the protease from a previous coronavirus. the chemical mechanism of the cleavage should be well understood at this point
logi6000: it started with new something
zak_krack: cleaving is chopping a protein sequence into pieces
logi6000: I have 1k channel points
SpecialAgentSkye: Wasnt it the google docs sheet you had ?
SpecialAgentSkye: @georgehotz
bufferovrflw: George, I believe it was FASTA
11plus4thinking: @bufferovrflw ok :)
fukurowlz: @mashafique to lear a lot of bio
bufferovrflw: FASTA
pz3300: Apparently Corona is making people play poker there was 300k players on stars tonight
Nussinov: @georgehotz https://www.uniprot.org/uniprot/Q9BYF1#interaction here's a great site if you haven't been here yet
fukurowlz: learn*
yevheniiushtyk: respect for people that study this shit wtf
cold_x: the chinese gov will be knocking on his door at no time
ancientwoodland: get u dont have that red- bet u dont have that green - bet u dont have the biggest ball the wold has seen!
mrflurriesxvx: sorry i cant hear what youre saying
bufferovrflw: @georgehotz It's FASTA, iirc
williamjennings1: what is he even doing lmao
pistolpetepcp: He's looking for genomes that were cleaved
yevheniiushtyk: maybe it
brittonx2: I thought the furin did the cleaving...
georgecruece: how is the progress everyone
logi6000: the one with the map of where it came from
Lana_Lux: @JustAsGoodJo ah cool! thanks for the insight :)
mrflurriesxvx: i cant hear youuuuuuu
SpecialAgentSkye: @georgehotz Wasnt it the google sheets doc you had open?
brittonx2: the furin is on the host side
YoungGuns_: just got here, what are we doing??
MrEuds: Hey @Lana_Lux :D
yevheniiushtyk: @YoungGuns_ hacking corona
pistolpetepcp: Wait waht is a furin
freshsoclean: i couldve copy and pasted all the work you did in 20 hours in 1 min
georgecruece: has he found the key
SpecialAgentSkye: @YoungGuns_ Hacking burgerking to eliminate corona
fukurowlz: hacking god
Juankinator: @YoungGuns_ 3d printing corona beer
logi6000: is it the one with the map of where it came from
JustAsGoodJo: @Lana_Lux of course :)
mrflurriesxvx: imagine having covid 19 and aids at the same time
georgecruece: @justasgoodjo can i kiss u
yevheniiushtyk: its 2 am already fuck
YoungGuns_: chat so helpful :)
Juankinator: LUL
edu4594: he's linking the corona beer with covid-19
JustAsGoodJo: @georgecruece lanaluHuh LUL
JMSWRNR: monkaS
mashafique: @fukurowlz I wouldn't say you can deeply learn a lot of bio in two days. Probably just cram enough info to be able to work with it
mrflurriesxvx: lol i can learn everything in a day
KruptWorld: watching geohot with liquid drumnbass is magical
Lana_Lux: @MrEuds hey! :)
dj_vicio: rice overcooked
CompestLive: hi
edu4594: everyone in this chat has an iq of 240, damn
m4xh3ra: !uptime
bananacat98: bananacat98 subscribed with Twitch Prime.
zak_krack: @edu4594 we're nearly all faking
yevheniiushtyk: i wonder if he talks to himself off-stream PRChase
localcanofdutchgold: @zak_krack don't tell him 5Head
mrflurriesxvx: sexy beast
pistolpetepcp: To be honest, you need a high iq to even watch this
dj_vicio: @yevheniiushtyk HE IS talking to himself during the stream all the time
11plus4thinking: @yevheniiushtyk he def does
fukurowlz: @mashafique if u want to work with a specific topic of bio, i think that two days will be enough
bananacat98: you can do it!!!!
alycia: LuvHearts
SpecialAgentSkye: @yevheniiushtyk I think all developers do. I explain things out loud to myself so i understand them better
georgecruece: i can totally follow him, dont u? ArgieB8
yevheniiushtyk: nothing wrong with that i do too while i code so was just wondering haha
dj_vicio: yes, we all do
vaskogomez87: dlandlasndnsdd "ENTER"
mashafique: @fukurowlz Two days is enough to develop a working knowledge but I don't think that knowledge will last if you don't review it. It's not a one and done thing.
saintmthw: @yevheniiushtyk auditory learner?
11plus4thinking: 11 🤔
SpecialAgentSkye: me :) I skipped 11 :)
Mariosavitch: git commit -am 'Skip 11'
dj_vicio: but geohotz even yells and fights at himself
Mariosavitch: git blame china
zak_krack: this protein doesn't go up to 11
Winnepooh_: I usually just repeat "how can I be so stupid?" when I code, not sure if it helps
georgecruece: i has eaten 11
Amaz1ngLALALA: 11 monkaS
AresRai:  4 🤔
saintmthw: the coldlight oracle
Nussinov: @georgehotz check to see if some of the proteins are encoded on the other strand of dna
parktype: 11 Pepehands
yevheniiushtyk: 🤔 WHO
logi6000: is it the site with the timeline and where the virus came from
StriderKeni: StriderKeni subscribed with Twitch Prime. They've subscribed for 3 months! Cheers from Chile! evo19Chile
TrippinFlare: grep "11"
Mariosavitch: well 7, 8, 9 so maybe 7 did
fukurowlz: @mashafique yeah, sure, but i mean that is a good time to start with it
Juankinator: bush did coronavirus
ad5k: mysterysQmark mysterysQmark mysterysQmark
fukurowlz: @StriderKeni saludos, de chile tambien &lt;3
georgecruece: damn, he is just learning biology on google :( :( :(
Mariosavitch: can you look at the commit history of the virus
edu4594: obama did corona
ahahahaitslit: lmfao
logi6000: is it the site with the Timeline and where the Corona came from?
SpecialAgentSkye: @Mariosavitch but 5 sexed 7, so maybe 5 was in on it too?
fa_k: geohot did bioinformatics did he?
zak_krack: @georgecruece you can learn a lot from google / stackoverflow, even at the top levels
pomprocks: solving biology is like solving artificial intelligence. but harder
fa_k: nice rarted take brother
zak_krack: engine roar
KruptWorld: @pomprocks what is he solving in biology exactly?
georgecruece: @zak_krack but he hasn't written a line of code for half an hour :( :( :(
ad5k: Weren’t a lot of contributors to bioinformatics CS people who learned some basic bio
mashafique: @fukurowlz That's true. It's a good enough time to get a working knowledge to build upon.
yevheniiushtyk: so y'all think coronavirus (sars ig) could be bio engineered in a lab, or is actually from people eating bats?
logi6000: is it the site with the map of where corona cane from
Nussinov: @georgehotz wrong exonuclease is not related to exon. exo refers to the directionality of the mechanism of degradation of the enzyme
dj_vicio: go check the rice before you burn the house
dj_vicio: see? he talks to himself all the time
dj_vicio: never talks to the streamers
ninjadidio: :D
toasty_jk2: something with the ending "-ase" is an enzyme (a protei with a function)
fukurowlz: streamers?
fukurowlz: what
SpecialAgentSkye: We are streamers PogChamp
OnlyB1ade: hmm
fukurowlz: i didn't know
zak_krack: we're streamees
shieeeeeeeeet: we are streaming our thoughts in chat
fukurowlz: lol
norlagg: Pepega
aramaki2345: it looks interesting but i dont what the f im looking at
JustAsGoodJo: exon is just part of a gene that is in mature mRNA
fukurowlz: here comes the twitch money
yevheniiushtyk: 2 am timezone gang rise up
Juankinator: we do have twitch accounts so technically we are streamers
vaskogomez87: what language is this guys?
cold_x: english
localcanofdutchgold: didn't wash hands DansGame
fukurowlz: @vaskogomez87 python
allpurposebucket: better be 20 seconds of washing hands!
Relatate: python
ahahahaitslit: he does literally everything in python
pistolpetepcp: YOu have along way to go buddy
SpecialAgentSkye: We are streaming out combined brainpower to geo 5Head
georgecruece: how long has he stop writing codes
dj_vicio: hands washed?
vaskogomez87: @fukurowlz ty
ad5k: That was like 10 seconds
bufferovrflw: WASH HANDS GEORGE
logi6000: it is the site with the map of where corona is
bufferovrflw: PLS WASH HANDS
gianniskokos: !uptime
thejuror8: @yevheniiushtyk One study that made a supposition that it was released from the Wuhan P4 Virology laboratory, the study was quickly removed afterwards for being veryweak scientifically. Not much else so far, people seem to be widely in favor of the zoonosis theory
Usisuvach0: https://chemrxiv.org/articles/Analysis_of_Whole_Genome_Sequences_and_Homology_Modelling_of_a_3C_Like_Peptidase_and_a_Non-Structural_Protein_of_the_Novel_Coronavirus_COVID-19_Shows_Protein_Ligand_Interaction_with_an_Aza-Peptide_and_a_Noncovalent_Lead_Inhibitor_with_Possi/11846943/5?file=21777303
JustAsGoodJo: introns and exons are in nascent pre mRNAs, exons are in mature mRNA
ninjadidio: @JustAsGoodJo oh intresting
bufferovrflw: Let's make him wash hands
fukurowlz: @vaskogomez87 he always code on python, i think
logi6000: is it the site with the map of where corona came from
Mariosavitch: a different genome sequence
thejuror8: @yevheniiushtyk 2AM timezone too btw
Usisuvach0: random finding @georgehotz
yevheniiushtyk: @thejuror8 yeah, i think about this a lot though
Mariosavitch: its a virus
Juankinator: i cant understand anything can you please play fortnite
11plus4thinking: 2 am gang BasedGod
fukurowlz: @StriderKeni nunca pense encontrar a otro chileno por acá xd
yevheniiushtyk: @thejuror8 how come it appeared just now
logi6000: @juankinator eww
zak_krack: r-i-c-e
pistolpetepcp: wow line numbers in a text doc???
Nussinov: dont link preprints maybe 4Head
zak_krack: good to get carbs with all this protein
yevheniiushtyk: i'm sure people in china have been eating snakes and bats for a while now
ahahahaitslit: how long do u guys think this lockdown is gonna last lol
ad5k: Hope u got some mirin
dj_vicio: @Juankinator that's why you dont understand; because you're frying ur brain with that damned game
logi6000: @dj_vicio exactly
playfiendss: what is Lord Hotz exactly trying to do?
fukurowlz: @ahahahaitslit almost 3/4 of the year
11plus4thinking: @yevheniiushtyk oh, they def have, they find eat all kinds of exotic animals over there
thejuror8: @yevheniiushtyk It's hard to know anyways. If it was intentionally released which is a crazy theory, then at least one unaligned government would have made a declaration, so it is reasonable to exclude this possibility. Then it could be accidental, but there is very little fact to support this theory as well
SpecialAgentSkye: Fotnite in 2020 LUL
imsuperficial: @playfiendss coronavirus
AresRai: peepoSad want mroe pictures
ahahahaitslit: probably
fukurowlz: @playfiendss understanding how coronavirus work
Juankinator: @dj_vicio r/wooosh
georgecruece: plz writing god damn codes :( :( :(
Brunovercelli: Yeaah man, the smartest mind in the world is streaming. I miss that shit
yevheniiushtyk: @thejuror8 doesn't have to be intentionally, could have been some sort of an accident
ackxhpaez: He’s trying to reverse engineer the coranavirus, since it was an engineered bioweapon
dj_vicio: @Juankinator speak English to me, not that gamer damned language
georgecruece: stop randomly searching online plz
Amaz1ngLALALA: Well, he defeated Corona?
thejuror8: @yevheniiushtyk Yeah second part of my message
11plus4thinking: @ackxhpaez not how that works
georgecruece: just write the god damn codes
Mariosavitch: no pepper or salt?
yevheniiushtyk: @thejuror8 i'm from czech republic, and there's this bio engineering lady which also thinks that this was an potentionally bio engineered virus
fukurowlz: @georgecruece lol
bufferovrflw: @georgehotz Wash your hands before you eat the rice goddamit ]
zak_krack: george let the man do it his way LUL
dj_vicio: no hands washed before eating
11plus4thinking: plain rice DansGame ? plain rice DansGame ? plain rice DansGame ? plain rice DansGame ?
dj_vicio: ew
thejuror8: @georgecruece Bro coding is 90% Googling
Mariosavitch: damn thats some depression era cooking
SpecialAgentSkye: Plain rice Kreygasm
Nussinov: ackxhpaez it was shown that it is very very unlikely it was an engineered bioweapon. https://www.medicalnewstoday.com/articles/the-new-coronavirus-was-not-genetically-engineered-study-shows#Ending-the-rumors-about-SARS-CoV-2-
DecayingSkullz: soy sauce
yevheniiushtyk: @thejuror8 ah mb didnt finish reading lmao
dj_vicio: 10% copy/pasta
thejuror8: @yevheniiushtyk I do the same lmao
mescal33t: 🍚
brittonx2: http://www.virology.ws/2020/02/13/furin-cleavage-site-in-the-sars-cov-2-coronavirus-glycoprotein
dj_vicio: where's the protein lol
logi6000: @juankinator sorry to be excluding but I'm not sure you exactly fit in with this channel. go watch some gamer
zak_krack: i can't believe this guy hasn't visited stackoverflow, how does he get anything done?
DecayingSkullz: do you have any soylent
Mariosavitch: does it have a spike protein?
JefeBezos: Not even hot sauce?
dj_vicio: yea @Juankinator with all due respect GTFO
ackxhpaez: CCP propaganda!
11plus4thinking: @thejuror8 nah i would argue coding is 10% googling and 90% the person thinking of what questions to ask
SpecialAgentSkye: @dj_vicio 5% copy pasta. 2% cleanup. 3% praying it works.
georgecruece: he only eats rice? no other things?
Juankinator: @logi6000 its alright im joking
Nussinov: @georgehotz first hyperlink in this document is the nature article
fukurowlz: @zak_krack almost 10 years coding with python
logi6000: @zak_krack they haven't done this type of advanced shit yet
nic0latesla: you are cute
georgecruece: this man is weird HolidayCookie HolidayCookie
dj_vicio: @SpecialAgentSkye gotta be some % for "talking to yourself"
ited01: a
Mariosavitch: no
SpecialAgentSkye: Thats an async task @dj_vicio . It never stops. 100% talking to self LUL
Crayonsss: i assume u do this for fun? imagine what they pay people that work with this!
thejuror8: @georgehotz Nature would absolutely publish it if the article was of quality
bob_babyelephant: good stuff geo
JustAsGoodJo: i mean, nature might if it had 100 pages of supplemental
11plus4thinking: how can you enjoy plain rice DansGame
Nussinov: @georgehotz this is true, but not all evidence can be strong by nature of the situation
11plus4thinking: explain DansGame
zwisch: do you put anything in your rice?
ahahahaitslit: salt
dj_vicio: how can he eat with no water or chicken, veggies, etc.
zak_krack: yes a fork
KruptWorld: how do you determine if its lab created or not?
thejuror8: @georgehotz A previous paper supporting the theory was removed because the methodology was very weak
Tidusuper91: I'd put a bit of salmon.
SpecialAgentSkye: @zwisch A spoon Kappa
zak_krack: or a spoon
KruptWorld: is there like a signiture?
georgecruece: plz add something to.rice
dj_vicio: damn that bite hahahaha
zak_krack: LUL
bob_babyelephant: I like coding
yevheniiushtyk: well good to know he doesn't eat only takeout food lmao
toasty_jk2: just do a BLAST search and you will see it is 91% identical to the virus found in bats 2013
peter35_: news: lab origin conspiracy DEBUNKED
boneitis: !uptime
Usisuvach0: @KruptWorld it's visible if it's injected
JefeBezos: You’re not meant to eat the spoon too
fukurowlz: THE ASMR
thejuror8: @KruptWorld Sequencing and statistics, comparisons with existing specimens studied in said laboratories. It's easier than you think
dj_vicio: @peter35_ sauce?
SpecialAgentSkye: @JefeBezos Says who?
zak_krack: no sauce, it's plain rice
georgecruece: do u have a gf
KruptWorld: @georgehotz how does someone determine a lab created virus or not?
zak_krack: Kappa
Amaz1ngLALALA: WutFace
skieth028: hello there what ya doing?
peter35_: dj_vicio im saying how that's how they would blindly report on that paper george just had up
vaskogomez87: ah yes yes
11plus4thinking: @toasty_jk2 its really scary how viruses can mutate from animals to humans
zak_krack: i've got work tomorrow but I'm up watching this stream :(
logi6000: @zak_krack damn work
kevin99gh: is he trying jailbreak the corona wtf is this sourciYOUNGB
SpecialAgentSkye: @zak_krack Same. 3 hours till work FeelsGoodMan 🔫
KruptWorld: damn folding@home doesnt do corona yet
yevheniiushtyk: hm so sars had the potential to be even worse than coronavirus, but somehow it got stopped?
georgecruece: do u have biological background
thejuror8: @georgecruece He does not LUL that's going to be the main issue
Usisuvach0: @11plus4thinking it's also scary how bats get infected by it and mutates inside of them, but it does not harm the bats at all
vaskogomez87: @zak_krack me 2. 1:30am here
zak_krack: @SpecialAgentSkye I kinda feel I might learn more here than at work
Nussinov: @georgehotz one key insight is that COVID19 is derived from no coronaviruses known to be pathogenic, and the analyses show the pathogenic mutations occured within humans. it is very hard to believe that researchers that would "design" this virus would use a non pathogenic template and then PREDICT the downstream mutations to optimize for pathogenicity.
AresRai: @yevheniiushtyk more like sars exchanged mortality stats for reproductive stats
fizzword: hey
Juankinator: @georgecruece dont think so, hes learning as he goes i think
JustAsGoodJo: might have a different name
thejuror8: @Nussinov Damn I did not know that, that's spicy as fuck
11plus4thinking: @Usisuvach0 yep exactly, this is just the beginning
peter35_: i hate the word debunked
SpecialAgentSkye: @zak_krack I for sure will. Im at home, working on some ai stuff for ibm, that i cannot access because its not remotely accessable. I dont know what im paid for LUL
KruptWorld: @georgehotz are you working on setting up that church to hack nature at all or just been busy with other stuff?
zak_krack: yep @Juankinator . I love that, more people need to be able to explore new areas on the fly
georgecruece: he must be genius
bonzer66: @thejuror8 what is he writing? I just joined in like 10 mins ago
Usisuvach0: and bats are carrying god knows how much viruses in them
Nussinov: @thejuror8 the cutting edge is spicy as fuck, you should read more PogChamp
Juankinator: @zak_krack yep, google makes that easier too
11plus4thinking: @SpecialAgentSkye free money TriHard
Usisuvach0: all of the COV viruses are from bats
Usisuvach0: MERS, SARS, and this one
thejuror8: @bonzer66 Just scrambling around with the genetic code of Coronavirus, he's learning
Nussinov: Usisuvach0 where did you hear that?
SpecialAgentSkye: @zak_krack But they wont fire me because it would take too long to get someone else into the exact project (extension for watson). So im not getting fired LUL
georgecruece: does he have the machine to cook the vaccine
Usisuvach0: hear?
SpecialAgentSkye: @11plus4thinking TriHard 7 Rise up
Usisuvach0: it's everywhere
Usisuvach0: read about it
thejuror8: @Nussinov Yeah I know nothing about genomics, I mostly read ML papers these days
dj_vicio: @SpecialAgentSkye you work for IBM?
Usisuvach0: but the infection to humans is not from bats directly
Usisuvach0: it's from intermediate host
thejuror8: @georgecruece LUL don't be crazy
Usisuvach0: MERS was from camilla
zak_krack: what is spider beer?
Usisuvach0: SARS from civets
nic0latesla: i love this guy
Nussinov: @thejuror8 ML concepts are commonly used in genomics
SpecialAgentSkye: @dj_vicio yea. Its not fun at all. As much as it might sound like a nice workplace
zak_krack: Is that a default chromium link
Usisuvach0: this one they say it's from pangolin
thejuror8: Cmon Hotz just do [:-1] like a man
Usisuvach0: but they are not sure yet
yevheniiushtyk: Coronavirus are usually pretty harmless viruses right? When our nose gets runny etc, that's all coronaviruses as far as i know? Thats why they renamed it to sars cov?
thejuror8: @Nussinov That's cool
fizzword: what is jupyter?
Usisuvach0: but the first host is bat
brownyyyylocks: i made fried rice with bokchoy jalapenos and sesame seed oil
brownyyyylocks: it was amazing
logi6000: imma have to go it's been nice talking to you guys
JustAsGoodJo: easy way to run python code vs. using the terminal @fizzword
georgecruece: it is online python editing platform
zak_krack: yep @yevheniiushtyk this is the world's first pandemic coronavirus
Nussinov: @thejuror8 in fact most of the biosciences now use ML, given the 'big data' praxis
Juankinator: @fizzword python IDE
fizzword: oh, cool. thanks
SpecialAgentSkye: @brownyyyylocks You just made me hungry. I hope your next commit fails the CI pipeline 😡
KruptWorld: @fizzword its make developing for data easier and you can run lines of code instead of having to recompile it all
bananacat98: I have no idea what is going on but his typing sure is relaxing FortBush
dj_vicio: georgehotz researches/RE Corona while drinking bath soup
georgecruece: jupyter sucks
Juankinator: @georgecruece amen to that
KruptWorld: @Juankinator damn that a nice simple way to say it haha
1ntegral_: @fizzword you both code and text in markdown format it's used a lot in Data Science
dontusethiscode: @brownyyyylocks i made fresh pasta with bat and tomato sauce
georgecruece: total messy codes after certain time
yevheniiushtyk: I'm staying careful during this pandemic, since I don't have my 30% of lungs to be permanently damaged, on other side, USA is gonna get it bad I think
Juankinator: @KruptWorld haha you did explain it better
yevheniiushtyk: *don't want
zak_krack: i want to see the diff of those two strings
SpecialAgentSkye: Bath soup drink rice while researching geohotz /RE Corono
JustAsGoodJo: might have differences in residues
Danilok100: !uptime
Nussinov: @georgecruece messy brain
dongmuya: Is what Hotz working on have anything to do with what Folding@Home is advertising? Borrowing your idle GPU/CPU?
thejuror8: @Nussinov That's very exciting. I'm kinda hoping to get an opening in Bioinformatics using my soon to be solid background in ML
pistolpetepcp: this is the glycoprotien that binds to the ACE2 receptor?
almonte550: Let's do edit distance to it
brownyyyylocks: lets hope bitbucket goes down
thejuror8: @Nussinov It's a very interesting domain for sure
zak_krack: does anyone else keep trying to copy   paste things off of george's stream
KruptWorld: haha true
dontusethiscode: where is Alex @georgehotz
georgecruece: @nussinov i like codes are split into files in traditional IDE
brownyyyylocks: thats it im starting a cooking stream
thejuror8: @georgecruece If you try it you will see how practical it is with Python, it's a lot better
fizzword: @yevheniiushtyk as far as I know your lungs only get damaged if you start showing serious symptoms, which would only happen if you have a preexisting condition
georgecruece: pycharm is nice
Nussinov: @georgehotz you might want to try a multiple sequence alignment. there are web tools
thejuror8: @georgecruece Almost no reason to use something else
Maxmemix: Whats the goal here?
KruptWorld: @Maxmemix im trying to figure it out
thejuror8: @Maxmemix Having fun   learning I guess
Bo0sted05: yea what are you trying to do
360Plato: https://msa.biojs.net/ check this out
SpecialAgentSkye: If its made by jetbrains, you know its prolly top tier imo
georgecruece: @thejuror8 it is just good to do small tests in jupyter
ak0ya_: to understand I guess at this point
thejuror8: Lol guys this stream is just not going to be a 24 hours DSLAM coding session, just get on with that
ak0ya_: to formulate a problem?
yevheniiushtyk: @fizzword ah okay, still it's important not to be ignorant during this pandemic, made me mad how people labeled it as "oh it's just an flu" when it started
thejuror8: @georgecruece Yeah it's just very very practical
JustAsGoodJo: yeah sequence alignment allows for miss matches like indels and gives scores
KruptWorld: i think its to find what will bind to it and destroy it
nashesvobodnoye: I would be bored to sleep... Guess thats why i'm not George Hotz
yevheniiushtyk: bruh im hungry af over here and this mad b eating all the time
yevheniiushtyk: man
georgecruece: why do americans also eat rice ArgieB8
georgecruece: it is weird
yevheniiushtyk: don't we all ove rice
yevheniiushtyk: love
Waywoah: Why wouldn't we eat rice?
leesingods: Rice = best side
brownyyyylocks: side? bruh main dish
brittonx2: http://www.virology.ws/2020/02/13/furin-cleavage-site-in-the-sars-cov-2-coronavirus-glycoprotein/
georgecruece: i thought u ate hamburgers everyday :( :( :(
dj_vicio: it's not about the tools. It's about Methodology.
SpecialAgentSkye: @yevheniiushtyk People are still saying its just a flu because they dont understand how pandemic research and statistics work. Comparisons of #cases to deaths is fundamentally wrong, but thats their argument. Its #cured vs deaths that matters. Rest is a buffer for death or cured. (cured = beat the virus as you cant "cure" a virus)
JustAsGoodJo: tools give us high dimensional data that is inherently difficult for most people to find structure within
SpecialAgentSkye: People tend to live in their own narratives. Sad really.
mlgdotca: did he cure it yet
justdoityourself: It's all about the cleavage sites... simple LUL.
Lizardan: @mlgdotca he cured his hunger :)
Vindalis: jailbreaking the coronavirus LUL
saixj: could you zoom in a tad bit for your webbrowser please
PiroFloydian: @georgehotz you ever listen to bas? think youd like him
dj_vicio: not yet. he has another rice plate with bat to go
Juankinator: coronara1n incoming
leesingods: import Cure
brownyyyylocks: viruses are like ideas. it does not go away completely because it never truly dies
leesingods: fk didnt work
JBirch10: ever thought to find a chemist/virologist to help understand what you are looking at??
georgecruece: is he reading a paper ArgieB8
skieth028: can anyone explain what is he doing? is he like trying to remake the virus? XD
gollosadstation: found anything yet?
sillybaboy: how are you gonna reverse engineer a virus just based off of sources you don't know can be trusted?
fafws321: How do you undersand those biological terms? Do you have a minor or smt???
T3chHS: Does george has biology background?
yevheniiushtyk: I love how my country (Czech Republic), has been handling this, compared to other EU countries I think we have it pretty good. They immediately started to take action, school were closed almost immediately, public gatherings, social distancing
thejuror8: @SpecialAgentSkye Cases is still very relevant if compared to the total available hospital beds, it's when cases exceed this total that death tolls skyrockets
KruptWorld: lol
SpecialAgentSkye: Yo you prolly wont see this, but i still think your rap talents BEAST @georgehotz LUL That light it up contest was sick to this day
brittonx2: http://www.virology.ws/2020/02/13/furin-cleavage-site-in-the-sars-cov-2-coronavirus-glycoprotein/
Nussinov: You don't need a biology background to be skeptical of a paper
pistolpetepcp: isolation_source = "fecal swab " LOL
georgecruece: @t3chhs yes he has doctor degree in biology
dj_vicio: he understand them because he's geohotz man! How dare you?!
360Plato: their not top minds the y just memorise
Nussinov: but you need to be willing to learn
bufferovrflw: That cough doesn't sound good
gattz_: monkaS
Mariosavitch: BEER IRUS
Ozonemaster: so here's my thought: "... BUFFERING
skieth028: PogChamp
dontusethiscode: F cough
GoldSkis: omg it's spreading
dr_set: corona cough?
publishcoffee: are you feeling hot, George?
almonte550: CORONAVIRUS
Tomishima: cool tactic
Mariosavitch: lol
gattz_: this stream got infected monkaS
thejuror8: @georgehotz Hey give us an example
georgecruece: u get corona. everybody get away now!
PeepRL: corona virus
Tomishima: woman
SpecialAgentSkye: @thejuror8 Correct, but looking solely on these numbers for a conclusion of the "deathlyness" of the virus is wrong is what im trying to say
leesingods: If you look for the Cure the virus has a defense mechanism which is why he is coughing...
PeepRL: whoops. coronga* virus
brownyyyylocks: we need AI Scientists
thejuror8: @SpecialAgentSkye That's fair
Ghost_001: HotPokket
360Plato: not systematic at all no way to derive it
aiis: Most medical professionals aren't meant to really think for themselves by design.
ahahahaitslit: as far as undergrad goes isn't the entire degree memorizing shit?
SpecialAgentSkye: Can you give an example of how you use words wrong?
KruptWorld: hahaha
peter35_: yeah their's barely any mathematics in biology
jagger_rsw: george quoting Feynman from BBC series on ducks :)
georgecruece: information theory
KruptWorld: did information theory exist back then?
theonlymonkas: nice
thejuror8: @georgehotz Hey give us an example of a scrambled interview question of yours please
vaskogomez87: @georgehotz yeah give us an example
Nussinov: @peter35_ you don't know what youre talking about LUL
Tomishima: funny but is true
DatBrownKid999: Hey george can you do my C homework for me?
brownyyyylocks: orange juice and bongo drum
theonlymonkas: richard feynman is cool
Juankinator: honestly i always saw biology as just a shit ton of stuff to memorize
Ghost_001: monkaS
Abnico: what sauce is in that rice
JBirch10: why not find a virologist who is already working on this to see if you are on to something??
jagger_rsw: @georgehotz feynman on this - https://www.youtube.com/watch?v=lFIYKmos3-s - "Richard Feynman - Names Don't Constitute Knowledge"
JustAsGoodJo: @peter35_ i'm a computational biologist. there's mathematics in biology lol
Tomishima: wlaking wikipedia
pistolpetepcp: Yea it's like physics, you can say you slipped on water, but you need to ask why
11plus4thinking: feynman FeelsBadMan
Skriance: what about engineers
Nussinov: you would not be hard pressed to find a "physicist" that studies biological systems
11plus4thinking: feynman come back FeelsBadMan
Voyburke: dewFeels dewFeels
360Plato: Eric Weinstein talked about this in that prestige goes to hard science fields and so do the top midns
Ghost_001: FeelsBadMan
lelqganka: ti si pedal
Ozonemaster: that prhase is thought spoken
ahahahaitslit: geo do you listen to the portal
SpecialAgentSkye: @georgehotz Can you give an example of a misused word in a question, to test someones knowledge?
raystriker98: !uptime
Lizardan: Feynman the legend
georgecruece: stop watching videos and get back to work now
KruptWorld: @georgehotz how would you know if the virus is lab created or not? is there like some signiture in the genetic code?
360Plato: Easier to build off hard rules then approximations
PiroFloydian: vid very quiet
Crypod: LUL
pedrovictortech: Yep we are listening from the speaker
thejuror8: KEKW TRUE
brownyyyylocks: yo my theory has always been geohot is feynman reincarnated
SpecialAgentSkye: @KruptWorld You need to realize he is not a biologist. Im pretty sure he couldnt tell you. He is a developer, winging biology using google, and the knowledgeable people in chat
JustAsGoodJo: i think people just like to sound smart
KruptWorld: oh thanks @SpecialAgentSkye
Nussinov: feynman wrote about his time doing biological research, some very interesting insights. they ring even more true now that google and online biological databases exist
mashafique: As someone who has a degree in Physics and Mathematics memorizing doesn't get you anywhere. If you don't understand what you're doing it doesn't matter. You can memorize all the equations and theorems you want but if you don't know how they work you're not gonna get anywhere meaningful.
360Plato: @JustAsGoodJo of course
Musashhhi: he lived a cool life
skieth028: PogChamp
Bitcoin__: Bitcoin__ subscribed at Tier 1. They've subscribed for 13 months, currently on a 13 month streak! I shared the 12 months earlier today???
Lizardan: Feynman the legend
Sarkin_dota: As someone who has a degree in Physics and Mathematics memorizing doesn't get you anywhere. If you don't understand what you're doing it doesn't matter. You can memorize all the equations and theorems you want but if you don't know how they work you're not gonna get anywhere meaningful.
Voyburke: big forehead = big brain
thejuror8: Associating names to concepts is probably one of the hardest parts of getting into something new
SpecialAgentSkye: @Sarkin_dota Amen brother
Lizardan: You have to become one with the math to understand it
dj_vicio: as opposed to girls. Big boobs small brains
mashafique: @Sarkin_dota what was the purpose of copy pasting what i wrote LUL
SpecialAgentSkye: Or awomen. I dont discriminate Kappa
AresRai: literature LUL
Nussinov: proofs are criminally undertaught in america
Sarkin_dota: @mashafique I'm just doing twitch chat's job, don't judge me
Lizardan: science Kappa
mashafique: @Sarkin_dota lmao that wasn't a premade copy pasta
Sarkin_dota: @mashafique I made it one!
Mariosavitch: yes
PiroFloydian: it literally says how in the preceding phrase
asaalgk: OMEGALUL
mashafique: @Sarkin_dota I am honored
dj_vicio: written by two diff ppl
brittonx2: the spikes are the key! Read this one! http://www.virology.ws/2020/02/13/furin-cleavage-site-in-the-sars-cov-2-coronavirus-glycoprotein/
360Plato: maybe not relatively
thejuror8: @georgehotz It just means that computational analysis of proteic binding is not perfect
u1337ochka: yo @georgehotz are you going to Joe Rogan for a podcast?
tehEGO: maybe interaction is the premise that they would be in that scenario
thejuror8: @georgehotz Probably very far from that actually
dj_vicio: cant read
ahahahaitslit: can't sees hit
pistolpetepcp: does this mean that it doesn't always bind to the ace2 receptor
nozpheratu: Can't shee shit captain!
tehEGO: but when put in the scenario they do fit
mashafique: Too small to see
abhinavneelam: zoom in bro
norlagg: BeanieHipster
11plus4thinking: why?
PiroFloydian: yeah cant read
AresRai: D:
nitcat: amen
Lizardan: D:
zol0: PepeHands
ahahahaitslit: what about the portal
dj_vicio: well
tokumei64: get a bigger monitor plebs
dontusethiscode: GeoHotz VS Jordan Peterson
gclawes: upvote for the portal
dontusethiscode: best interview
vrooom_vroooooom: joe rogan just reacts to shit people say about the future
whitesaucey: dont want to be famous yet wants to be insta famous????
PiroFloydian: no the xkcd lmao
OnlyB1ade: KappaHD
PiroFloydian: this was fine
raystriker98: you're already famous enough
pistolpetepcp: what is the ACE2 receptor
dj_vicio: yell at the neighbors again
yevheniiushtyk: pop some CBD
Juankinator: joe rogan will just ask you about ai and the terminator scenario
tehEGO: maybe it would be better that papers like this should be refactored to as lamens as possible
Vindalis: george will be the first one to develop an autonomous vaccine for the coronavirus
360Plato: @dontusethiscode what would they even talk about JBP is zonked in rehab
leesingods: You could just go back to normal after the interview what would chage?
Lizardan: Rogan would be the worst podcast for someone like George. Rogan is a comedian.
AresRai: joe will ask about DMT and terminator
raystriker98: Joe Rogan is dumb af
mashafique: To me it just seems like you're just too nitpicky with words. At the end of the every field has a way of talking and if you haven't actually studied that field it doesn't make sense to expect ot understand the way that they are communicating. Also, since a lot of the stuff you loo k at is not aimed just for the average person. It's for people in the field.
Nussinov: @georgehotz I think what is being said is that - using the state of the art computational analyses, one could not reverse engineer the virus seen
PiroFloydian: this was legible the xkcd wasnt @georgehotz
KruptWorld: its maybe saying although its the current form is the most optimized for it its not the best one that can be made for interactions... like the predictive models found better ones?
THX1342: pistolpetepcp the cell's bouncer that let's covid in
Icaro_sama: @Juankinator and gorilaz, and dmt
williamjennings1: do math on stream
pistolpetepcp: @THX1342 thanks
williamjennings1: forget the corona virus
dontusethiscode: @360Plato i imagine hw will be out at some point lol
thejuror8: Guys cmon, this paper is probably of very good quality. Very little people in this stream, including George, have the knowledge required to understand it, so let's say humble
Nussinov: @georgehotz there is loads of literature on synthetic biology and the generation of proteins with specific degrees of binding affinity
bufferovrflw: @georgehotz Any review on the papers?
abhinavneelam: prove the shortest distance between two points is the distance formula
bufferovrflw: *any reviews
chillguy269: Does it have an abstract of what the paper is actually trying to demonstrate?
AresRai: yea
ak0ya_: what exact question are you trying to answer with this paper? @georgehotz
mysterykiller1234: no.
mrhdr: explain
360Plato: its all approximates
dontusethiscode: no
raystriker98: these are peer reviewed?
AresRai: its very vague
Lizardan: @thejuror8 exactly. the wording is not for tech people
Nussinov: I see why you're skeptical but you do not have domain expertise
haroldakme: Why is the computer programmer trying decipher a medical paper
jagger_rsw: remind us :) why are we buying your subscriptions? is it something like if you take over the world you won't kill us (first) or sth else? :)
thejuror8: @haroldakme LUL LUL LUL
thejuror8: I love the character tho
peter35_: "stay in your lane tech bro"
thejuror8: That's just great
KruptWorld: oh, are you saying its not written in scientific form as other papers are?
brownyyyylocks: @ haroldakme why not?
AresRai: lets invite a virologist PogChamp
davedavidsonfromdavis: george is right
Juankinator: @haroldakme anyone should be able to read and understand it
nashesvobodnoye: This is only a summary of current information imho
Ozonemaster: what do they even mean by optimized
Mariosavitch: written by the chinese
11plus4thinking: lab scenario what does that mean 🤔
raystriker98: They're saying it's not a designer virus
Ozonemaster: there are so many things in nature "optimized"
skieth028: are you guys really serious? this is twitch.. hes not really revese engineering the coronavirus... LUL if he is on a lab the might believe it.. like LUL
KruptWorld: in before paper is debunked!
Ozonemaster: thats jus a retarded adjective
ak0ya_: that was produced in the lab
Nussinov: @georgehotz you do not need more evidence than what they referred to LUL it is more or less obvious
Lizardan: @georgehotz It would be awesome if you could invite an infectious disease doctor to your stream and help you with this.
thejuror8: @georgehotz It's very speculative but it's a bio paper, the format is very different from a mathcomp sci. paper of course
ak0ya_: it could still be evolved in the lab
mashafique: People in the field are aware of which lab methods and techniques are available so they would know what would be doable at this time
THX1342: there's no explanation of what the signature of a 'lab based virus' is
raystriker98: I guess bio papers allows for speculation
Mariosavitch: weird flex, but ok
Lizardan: Different from com-sci and math. yeah 4Head
EdwardSnowden25: Hello gerogehotz
JustAsGoodJo: it's a correspondence paper, not a real bio paper. it's like reading a review or a letter, not the same as a bio paper
almonte550: Did you voice changed?
mescal33t: Superhuman AI for multiplayer poker beastyPoggers
skieth028: title is just for views... attract viewers... LUL and its working LUL
thejuror8: It's the Alpha0 paper from DeepMind ? Yeah they are very good
fission1110: this is a letter to the editor not a peer reviewed bio paper
JustAsGoodJo: ^
Nussinov: ^
AresRai: @skieth028 u bite so keep biting
Michaeltth: KonCha
thejuror8: @fission1110 Lol that explains it then
chillguy269: @fission1110 If that is the case that makes a ton of sense
Mariosavitch: it contextually makes sense
skieth028: @AresRai hmmm yummy LUL
dj_vicio: lack of details in the Corona paper because they dont know shit about the virus yet but yet they want to comply with something to filter out dumb vs smart ppl believing in their "facts".
tehEGO: its not a paper
PiroFloydian: @georgehotz fission said it, this is a letter to the editor not a paper
davedavidsonfromdavis: does anyone know what percent of bio papers can't be replicated??
Nussinov: @georgehotz its still subjective LUL you understand the domain-specific jargon better and are therefore more comfortable
tehEGO: no it says at the top its not a paper
pistolpetepcp: can we replicate the virus infection lol, i volunteer
shlver: @georgehotz you need to simulate the environment of inside of the human body, it's impossible to simulate the interactions or other cofactors in the human body. When they say computational analyses they are doing electrostatic interactions between the simple interactions of structure only.
Juankinator: maybe bio papers have stuff that is harder to replicate
ak0ya_: There are good papers
bigie: the ones that stack 10 refinement networks and don't publish code or trained models
ak0ya_: of course
AresRai: some bio papers are very good
Nussinov: this is a letter to the editor
Tomishima: drowing in pappers . information overflow
skieth028: instead of working on. hes comparing biology papers.. again this is purely for enternaiment.. dont be serious about this guys LUL
teslost: paper 7
PiroFloydian: this is a letter to the editor not a paper lmao
williamjennings1: lol
JustAsGoodJo: lol
badmyt: maybe this example works because chess algorithm is a bit easier than NATURE's one? I guess you cant dive too deep in explanations as you'll get to write whole book explaining every single step, maybe people related to medicine know this shit and dont need such descriptive details in the articles
360Plato: a good bio paper imo https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4488989/
Mariosavitch: ur waisting valuable CTF time
thejuror8: Guys if we keep spamming it he will read it eventually
Juankinator: yeah you lost me at the title
jagger_rsw: I sometimes want to read papers on fuzzing, b/c ppl claim great research, and half of it is beyond paywalls. I asked why, and they told me it's for university prestige points.
thejuror8: Hey George apparently it's not a paper but a LETTER TO THE EDITOR
Nussinov: @360Plato go away
archer723: archer723 subscribed at Tier 1.
Michaeltth: robust
davedavidsonfromdavis: https://en.wikipedia.org/wiki/Replication_crisis
mashafique: Literally just highlighting and clicking things and putting on a show and then being confused why you don't understand something LUL
thejuror8: @mashafique cmonBruh
williamjennings1: read the whole paperr
nashesvobodnoye: Knowledge should be free, and intellectual property is BS
skieth028: LUL
saixj: you should do a coding tutorial to bypass some insecure paywalls if possible
imsuperficial: bernie sanders: leading the biological revolution
KruptWorld: the format isnt the same as other science papers
mickjaggerrrr: u should switch to biology
Mariosavitch: Martin Shkreli   Hotz == Will cure everything
thejuror8: Unrelated but Elsevier should get lost
lsankar4033: lsankar4033 subscribed with Twitch Prime.
raystriker98: revolution fueled by quantum computing?
GoBerserk: @nashesvobodnoye most of the paywall problem is the publisher not the author
JustAsGoodJo: 1953
Jehhred: What did he say the way to get passed paywalls was?
thejuror8: @Jehhred Sci-Hub via Tor
thejuror8: @Jehhred sci-hub.tw
thejuror8: It's illegal
mashafique: @thejuror8 ?
thejuror8: (Disclaimer)
zwisch: LUL
KruptWorld: sickkk
nitcat: unreal lol
KruptWorld: what is this site
skieth028: LUL
Nussinov: if you knew francis crick you would be afraid to share it
thejuror8: cmon you guys don't know about sci-hub
DecayingSkullz: http://cbm.msoe.edu/markMyweb/sepaTimeline/assets/1. A Structure for Deoxyribose Nucleic Acid.pdf
JustAsGoodJo: watson and crick don't even make any claims in that paper though lol
DecayingSkullz: there it is^
Ozonemaster: why is sci-hub banned in spain anyways? XD
DecayingSkullz: http://cbm.msoe.edu/markMyweb/sepaTimeline/assets/1. A Structure for Deoxyribose Nucleic Acid.pdf
thejuror8: only realistic way any masterdoctorant does any research is Sci-Hub nowadays
ahahahaitslit: probably 90% of people here know sci hub
nitcat: April 25, 1953 and it's paywalled in 2020 unreal
Michaeltth: Rare to come across really good bio papers
thejuror8: @nitcat LUL LUL
Nussinov: LUL LUL LUL
DSykes_: @georgehotz Can you sum up what the fuck you are actually doing
RobotTard: the kid is now a man
thejuror8: When reading old papers I also noticed that the style is so brutally different
UniversalGeneve: yo. its the original DNA paper by crick and watson
imsuperficial: @DSykes_ hes doing coronavirus
pistolpetepcp: Yay functions
thejuror8: Today style of papers is very much pragmatic
Nussinov: uh oh a bessel function nobody tell him about structure refinement and validation
Mariosavitch: yes we do
skieth028: you cant reverse engineer a virus with just googling stuff... you need to be Virologist... LUL even scientist needs 3 years min to make VACCINE and hes doin it on by GOOGLING? LUL LUL LUL LUL
localcanofdutchgold: "bitch"
o______________________k: @dsykes_ just exploring and learning from an autist :)
almonte550: https://en.wikipedia.org/wiki/Replication_crisis
thejuror8: @georgehotz The previous paper that you read is not a paper, it's a letter to the editor. I think it mostly explains the weird style that you highlighted
JustAsGoodJo: bio is separated into subdisciplines. in bio, we use biochemistry and biophysics like that paper. in computational biology, we do analyses. it's not all like a "correspondence letter to the editor" type paper you were reading
AresRai: @skieth028 dude ... stfu
yevheniiushtyk: these streams make me more interested in science and math
Juankinator: @skieth028 dude we are just fooling around shut up
whitesaucey: post modern neomarxists!!!!!!!!!!!!!!!! screw em
mashafique: The arrogance of someone who is not a specialist in a field trying to talk about how that field should do something
JustAsGoodJo: LUL
logi6000: we back bois
KruptWorld: @georgehotz could you explain how youre attempting to hack the corona virus? i heard you say 'payload' n stuff which reminds me of jailbreak days
GoBerserk: @JustAsGoodJo is correct
KruptWorld: oh i guess youre doing it now nice
THX1342: rememeber the human genome program? hhundreds of millions of dollars and decade to finish
JustAsGoodJo: @GoBerserk &lt;3
Nussinov: we have been attacking it that way for 30 years
360Plato: but is it really a full picture without the epigenetics?
raystriker98: so the papers should be backed by maths and cs?
KreuzCroix: I mean, it's a really new virus and is not really controlled under a laboratory environment...
williamjennings1: it all makes sense now
JustAsGoodJo: we use statistical analyses, probability densities all the time lol
dj_vicio: if they change concepts/theory/history they can manipulate the future
dj_vicio: its all about perspectiv e
skieth028: "probability" "permutations" "permi" "mutation" LUL LUL LUL
williamjennings1: is that a bed next to his computer
Ozonemaster: yeah
kleyy: fermi
Mariosavitch: me
Nussinov: you are absolutely right!! this is exactly the kind of analysis that was most certainly done and yet NOT communicated in a LETTER TO THE EDITOR LUL
whitesaucey: nobody is george lol
ahahahaitslit: biology is lit
nashesvobodnoye: @georgehotz research computational biology
tshields44: first principle thinking is not common
Tomishima: just 5000 ppl global
dongmuya: nextstraing.com
Abnico: gonna start a biotech company
Tomishima: is the find ppl that understand this shit
shlver: @georgehotz the sequence doesn't exist in a vacuum, how the proteins fold depends on its environment and that environment is in the human body. We know coronavirus binds ACE2 because we can see viral load increasing, computational analyses is limited in scope and cannot take into account the cofactors and physiological factors that could contribute to the change in the structure of the glycoprotein and uptake of viral rna.
Abnico: next bull market biotech will be the new crypto
reportyourself: nice to catch you here bro. luv your wisdom and the interesting content. w000t
Mariosavitch: imagine showing this to someone in 1918
logi6000: @mariosavitch yo just like the TV
hiimwatchingu: @georgehotz hey can u hack into my school and change my grades
GoBerserk: @shlver another person who gets it
ahahahaitslit: u listen to the portal?
nashesvobodnoye: learn to code LUL
Jehhred: lol learnig to code is easier said than done
KreuzCroix: Finally @shlver
KruptWorld: but besides coding domain knowledge is important
pistolpetepcp: Visualizing stuff is fun
logi6000: @hiimwatchingu well you could do that but that's not learning anything. learning is the best thing you can do
Nussinov: dont listen to that viral load guy LUL
Tomishima: learn to code is easier than using this data
Juankinator: anybody can code, writing good code is another story LUL
liejoes1: i
imsuperficial: True. I've been coding for 20 years and my code is mostly shit LUL
360Plato: couldnt you quantify the structure with some characteristics
sit_d: refactor tomorrow
dj_vicio: no, its easier if you turn off all destructive things that deviate you from the goal of learning to program like social media
justdoityourself: @imsuperficial all code is shit LUL
imsuperficial: thanks :)
Jehhred: @Juankinator Then how would you suggest being able to learn to code really well?
williamjennings1: should i buy a mac book pro
Mariosavitch: look it up in the diff viewer (MSA)
Nussinov: this website is super
logi6000: @williamjennings1 do you have the money
pedrovictortech: @williamjennings1 depends on what you want to do
teslost: @shlver is not protein folding still one of the unsolved problems because of the computational complexity?
justdoityourself: @Jehhred do it because you love it
Juankinator: @Jehhred get people that know how to code well to review your code, or check source code from big projects that are well done
WhatDaRob: May I ask what are those charts showing_
WhatDaRob: ?
WhatDaRob: Mutations?
Nussinov: teslost https://en.wikipedia.org/wiki/Levinthal's_paradox
georgehotz: https://nextstrain.org/ncov?
Jewishrambo: damn this application is complex
GoBerserk: @teslost I'm pretty sure that's correct
Tomishima: THis DNA is worst then X86
pedrovictortech: @WhatDaRob spread
badmyt: diversity of conoravirus types Iguess
yevheniiushtyk: i'm 20, not too late to start taking coding seriously? I'll have to self teach myself though, since HS here taught me almost nothing )-:
pistolpetepcp: i think these are spectrometer graphs
logi6000: yes paradoxes let's go
aliman_21: how much progress have we made?
brownyyyylocks: im self taught! you can do it!!
Riqour: @yevheniiushtyk no it's not this is one of the few things you can start super late and still get decent at
justdoityourself: @yevheniiushtyk the best programmers has certain personality traits, dont discount this
GoldkettenManfred: @yevheniiushtyk its not to late
logi6000: man I learned python when I was 12
bigie: they're poor
dongmuya: The two strains are S-strain and L-strain
Crypod: poor italy FeelsBadMan
25missedcalls: will you play animal crossing tonight?
xPolarDreamz: i dont get what hes doing?
Ghost_001: good question
dongmuya: L mutated from S
Lizardan: @xPolarDreamz title
williamjennings1: @xPolarDreamz i dont know either
Ghost_001: @xPolarDreamz Hacking the world
raystriker98: mutations are usually useless until that one mutation "evolves" it
yevheniiushtyk: like i have been fiddling with code for so long but I haven't made any significant progress, this stream really made me want to pursue coding more seriously and learn all the things
xPolarDreamz: @Lizardan reverse engineerring what
badmyt: this is ridiculous how fast it mutates, how should the vaccine stop it anyhow if it changes itself a thousand of times daily
myaocat: mutation - the changing of the structure of a gene, resulting in a variant form that may be transmitted to subsequent generations, caused by the alteration of single base units in DNA, or the deletion, insertion, or rearrangement of larger sections of genes or chromosomes.
tokumei64: mutation is just any change in the genetic code iiuc
KruptWorld: bro programming is just logic
Usisuvach0: L is the dangerous one
Nussinov: KruptWorld not really
Jewishrambo: if it mutates wouldn't it get weaker because it has had more transmission chains, but if its more lethal less mutation chance idk
dongmuya: L Mutated from S
Crypod: results on masks FailFish
Usisuvach0: S is the mild one
KruptWorld: learn logic and then you can translate that between languages
dongmuya: L is the newer one
Usisuvach0: no
KruptWorld: why not @Nussinov
Usisuvach0: L is the dangerous
Nussinov: KruptWorld syntax, structure, style
dj_vicio: nsa with disinformation
justdoityourself: @yevheniiushtyk you need a full feedback cycle to grow and improve
ahahahaitslit: lmao
Nussinov: LUL
peter35_: there's an isomorphism between logic and computation Nussinov
costcospizza: true
dorkmo: he's on nextstrain github contribtors
Tomishima: ok
tokumei64: @badmyt it's not as simple as that, not all mutations change the virus in a way that makes research/vaccines obsolete
KruptWorld: @Nussinov right, but logic doesnt change
dj_vicio: aderall shot
abhinavneelam: maybe simplified for the general public
thebiggaeboi: LMAO
skieth028: Programmer: i know a lot of stuff im really brainy.. Programmer: *sees a covid-19 publication paper for public consumption* Programmer: wtf this is really complex and complicated XD LUL LUL LUL LUL
thebiggaeboi: adderall shot lol
roach_swalower: adderall shot ftw
elon_musk__: HeyGuys
santi_264: how long has he been straming for
Liz3DE: this the first stream i see live. until now i only saw the uploads on the archive
myaocat: What does "Split into L and S stains with L" means?
iKanak_: iKanak_ subscribed with Twitch Prime.
myaocat: *strains. sorry
thejuror8: @KruptWorld It can, under different axioms D:
tokumei64: the effects are basically stochastic, it couild have no noticeable effect, or it could drastically affect the virality or behavior
Crypod: hear that? that's the hand wash
guacDev: wash for 20 seconds georgie
skieth028: this is recorded... and playing it live LUL LUL LUL
whitesaucey: L strain is more contagious than S strain
pedrovictortech: @georgehotz Just call that dude out! Start some beef!!
KruptWorld: he started at 1:55pm pst
Mariosavitch: rice and ice cream. love it
dj_vicio: more bat icecream
thebiggaeboi: stop taking adderall shots man
luigifrcruz: @georgehotz Preprint paper with more information about strains https://academic.oup.com/nsr/advance-article/doi/10.1093/nsr/nwaa036/5775463
SneakyGamerr: Just got here and i might have a stupid question. What is the purpose/goal of doing this or what is this trying to achieve realistically?
Liz3DE: should i sub?
Jehhred: This man about to eat his bodyweight in ice-cream
pleasepolitethanks: ice cream with a fork
roach_swalower: this dude using a fork for ice cream&gt;&gt;&gt;
Greaser_1: :-)
Mariosavitch: lol
Nussinov: @georgehotz you are misattributing the behaviour of "biologists" to the behaviour of novel science. mistakes are made in all fields, especially in the situation where the science is SEXY and must be published quickly. not all math or ML papers lead to worthwhile results either. while some papers provide significantly more information that others, science is accumulate
Mariosavitch: are you really holding the fork like that
elon_musk__: MrDestructoid MrDestructoid MrDestructoid MrDestructoid
skieth028: reverse engineer the coronavirs... *EATS ICE CREAM* LUL LUL LUL LUL
Emanuell45: @Liz3DE im pretty sure hotz is loaded
dj_vicio: same fork he used to eat the rice
justdoityourself: corona-virus is already hacked... it breaks down at only slight temperature increase. Viral load can be reduced by just stepping into a sauna
Tomishima: imagine having a fridge
brownyyyylocks: my fav is honey maca
whitesaucey: where is the gf george??
THX1342: myaocat there's a running hypothesis the virus has split into 2 'families', one suposedly being worse than the other
YellowSnowman_23: YellowSnowman_23 subscribed at Tier 1.
Pin__top: good afternoon
ahahahaitslit: yee boi
thiefer20: Check out the account @Bobbeus on twitter I believe it may be an account sending out coded messages relating to Coronavirus
THX1342: myaocat this tweet is calling bullshit
brownyyyylocks: honey macadamia from connosieur
Rydberggg: is he really reading that fast ?
Juankinator: whats the process of getting a paper to in nature?
Mariosavitch: what we need is a simulation of the human so we can run different tests against our cure
Nussinov: Rydberggg yes he is a genius
brownyyyylocks: for all my aussies!!
mashafique: @Rydberggg nah it's just showman shit
360Plato: I would be funny if the classisica etymology of all these bioterms got thrown out for a quantitative classification
williamjennings1: georges studio is so cozy
Pin__top: ice cweam esfandH
whitesaucey: whitesaucey subscribed with Twitch Prime.
badmyt: @justdoityourself tell it to equatorial countries full of ill people
mickjaggerrrr: contact him
edu4594: what is p values
Rydberggg: he has 4 eyes or 2 brains
pistolpetepcp: Dude I hated stats class
THX1342: well, compsci has the benefit of infinite samples
Nussinov: nowadays youd get laughed at in biology for reporting p-values LUL
thejuror8: Yeah I mean, p-values have always been used in bio right ? And Comp-Sci papers used std which is not always better, especially in ML papers in which they're used to bullshit results
Mariosavitch: yay
Jehhred: What else are these biol majors going to do with the introductory stats unit they took?!?!?!?
edu4594: ah, pi
thejuror8: I'd rather have p-values used in Comp-Sci
KruptWorld: fuck youre making me crave icecream
pedrovictortech: P value is the probability of getting a certain respons
danisokpg: gd
sillybaboy: @thiefer20 what makes you think that?
elon_musk__: ezclap
edu4594: valeu @pedrovictortech
lemonboxed: p values is more stats i think
danisokpg: geo everybody can code?
Tomishima: scripted
justdoityourself: @badmyt reduced viral load doesn't mean it doesn't exist. But it changes all the mortality calculations
pedrovictortech: De nada cara @edu4594
u1337ochka: its weird cause statistics itself basically emerged from biology
AresRai: monkaS
Juankinator: cant remember what p value is but i remember it was from stats class in college
williamjennings1: What are p-values?
thiefer20: Check out the account @Bobbeus on twitter they have been sending out coded messages about coronavirus
lemonboxed: std deviation in bio papers
Srule: What key board do you use?
leidad32: @pedrovictortech ué tem BR aq
theonlymonkas: ban
dongmuya: This is the difference https://covid19data.com/2020/03/04/coronavirus-has-mutated-and-2nd-strain-is-even-more-deadly/
THX1342: ban
YellowSnowman_23: rip
mashafique: @Srule monkaS
thejuror8: @georgehotz They do use std in ML papers a lot, most of the time even
williamjennings1: @Srule i wouldnt ask
Vjasal: big pp value
Pin__top: its never a good idea to interpret too much from numbers
sidthescikid: does george always have this many viewers?
Mariosavitch: what is actually a "cure" is it something that stops the spike protein from working?
dorkmo: choo choooooo
theonlymonkas: no LUL
pedrovictortech: @leidad32 EU sou de Portugal! Mas o Brasil é muito bom!! Já vivi lá por um pouco. Petropolis
d0ubletruth: whats a good site for finding ML papers, im new to all this
reportyourself: @dorkmo choo chooo
THX1342: Srule e only answers kb questions if you highlight your message
ahahahaitslit: scihub
Tomishima: @skieth028 is live. all other points are true
edu4594: mano aqui tem muito br
williamjennings1: @sidthescikid no its cause he let non subscribers to view
elon_musk__: ?????????????
danisokpg: everbody can code ? viewers
KruptWorld: yo @georgehotz have you been working on that church thing you talked about hacking nature in like a tedx talk or what??
360Plato: @Juankinator it has to do with statistical significance
Srule: I'll infect your mom with the big D type
mashafique: I can't. The level of arrogance is astounding.
leidad32: @pedrovictortech moro no litoral, Fortaleza
thejuror8: @mashafique LUL true
luigifrcruz: Chat only in english...
Nussinov: @mashafique hes now trusting a tweet over the literature LUL
Mariosavitch: @mashafique leave or contribute
AresRai: @mashafique close the window LUL
Pin__top: penny pinching
pedrovictortech: @edu4594 Brasil e ecnologia estão cada vez mais ligados!! Tem imensos canais de tecnologia fodas do brasil
KruptWorld: loool
BernardoFire: @leidad32 tamo junto BR
edu4594: @leidad32 ja morei na praia do futuro, agora to morando no rj, niteroi
elon_musk__: Promiscuous
araeasmes: LUL
Psycarlo: loooooooooo
1ntegral_: @danisokpg Yep if you're here than you must be interested
nitcat: they got both
sidthescikid: @williamjennings1 wait non subscribers couldn't watch his stream?
ad5k: simplest explanation
mescal33t: beastyLULWW beastyLULWW beastyLULWW
pedrovictortech: @leidad32 Tenho que visitar um dia!!
nashesvobodnoye: welcome to science jargon
mikhailangelo: fight PogChamp
edu4594: @pedrovictortech sim, é muito bacana ver isso
BernardoFire: @pedrovictortech BR BR BR TAMO AQUI
FargioFarmani: Which mouse are you using @georgehotz ?
brownyyyylocks: MAMA SAID KNOCK YOU OUT
luigifrcruz: @georgehotz another preprint talking about mutations.. https://www.biorxiv.org/content/10.1101/2020.03.15.991844v1.full.pdf
leidad32: @bernardofire salv
Jehhred: Why do people use larger words to seem smarter?!?!? make it easy for us simpletons to understand
williamjennings1: @sidthescikid yeah before he would only have subsriber streams
dorkmo: Theranos paper
thejuror8: @georgehotz Btw they do use std in ML papers a lot, most of the time even, how am I bullshitting you when I say that
pedrovictortech: @BernardoFire kkkkkk
dj_vicio: his ricebowl is his mouse
THX1342: bio bois getting triggerred
360Plato: @dorkmo LUL
KruptWorld: lol
Nussinov: @georgehotz reminder that any bio paper written by entirely chinese authors should be taken with a massive grain of salt
Sky_Light_37: @georgehotz can you link the world map with the branches of the viruses pls?
leidad32: @edu4594 praia do futuro era dhr
shlver: @georgehotz you know sickle cell anemia is caused by a single point mutation?
sidthescikid: @williamjennings1 dang, I thought he was all about free info/data
danisokpg: @1ntegral_ so evertbody can code right?
Psycarlo: Big fan. Keep it up! Love from Portugal
raystriker98: do you think half baked bio papers are being published to gain some recognition?
1ntegral_: @danisokpg of course
thiefer20: https://www.mesvaccins.net/web/news/14930-nouveaux-cas-de-syndrome-respiratoire-du-moyen-orient-a-coronavirus-mers-cov-au-qatar
pedrovictortech: @Psycarlo Portugal caralho!!!
williamjennings1: @sidthescikid he post the streams on youtube after
saeveritt: saeveritt subscribed with Twitch Prime.
hexstatik_: @georgehotz are you not concerned about touching your face? :)
thejuror8: @raystriker98 Not in Nature at least LUL
dj_vicio: no bad words @pedrovictortech
KruptWorld: oops it was in the SXSW 2019
Psycarlo: @pedrovictortech mai nada
sidthescikid: @williamjennings1 ahhhhhh
pedrovictortech: @dj_vicio Sorry! hahah
patulskitime: https://seekingalpha.com/news/3554056-ibm-white-house-put-supercomputers-coronavirus-research
elon_musk__: AMAZIN
dj_vicio: @pedrovictortech nah, im fucking with you man hahaha
Nussinov: spoken like a true STEM lord
pedrovictortech: @Psycarlo Como é que está isso ai com o corona
Wireballz: @georgehotz is it man made ?
williamjennings1: i feel so focused
happypuppppy: LUL
Nussinov: @skieth028 LUL
Mariosavitch: lol
elon_musk__: DISGUSTING DansGame
Natterz : Can you not just jailbreak the coronavirus ?
zol0: LUL
Khilimanjaro: LMAO
edu4594: LUL
grey_street: LUL
Lizardan: LUL
Ozonemaster: LUL
danisokpg: @1ntegral_ a lot of practice?
pedrovictortech: @dj_vicio HAHA I got you dude
esence: ban him
yevheniiushtyk: LUK
ColdZer0o: LUL
yevheniiushtyk: LUL
Mariosavitch: LUL
Ozonemaster: disgusting DansGame
ad5k: big profit
Juankinator: LUL
rstk1: LMAO
araeasmes: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
happypuppppy: silenced LUL
Ghost_001: LUL
Ozonemaster: Kappa
mescal33t: beastyS beastyS beastyS
Mariosavitch: HOW DARE YOU
THX1342: Nooooo let him entertain us more
beefydangles: need to wash my hands after seeing this
Nussinov: imagine malding over clickbait LUL
Psycarlo: @pedrovictortech Tens whatsapp?
dj_vicio: show him @georgehotz
nitcat: LOL
PiroFloydian: DansGame
AresRai: disgusting SwiftRage
Mariosavitch: LUL
Waywoah: Waywoah subscribed with Twitch Prime.
edu4594: plot-twist: he really do it
thejuror8: LUL Martin Shkreli V2
Lana_Lux: LUL
akaCube: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
justdoityourself: The Hardness of every science falls off after mathematics, biology has always been filled with incomplete claims
pedrovictortech: @Psycarlo ya
gabo_sk: LUL
theonlymonkas: LUL
Michaeltth: Kappa can't go anywhere
Lizardan: Go out WutFace
johanoutdoors: yikes
SpecialAgentSkye: LUL
brownyyyylocks: dat sub money
elon_musk__: TREW
Kyoto_o: what a dumbass kekw
norlagg: LUL
patulskitime: money is the root of all good
Mariosavitch: Mariosavitch subscribed at Tier 1.
beefydangles: coronaS
thejuror8: NEW SHKRELI Pog
Jadess: @georgehotz You cant go out. #CoronaVirus
AresRai: going out monkas
on111: monkaS
Sky_Light_37: smogW
bobert_____: Cheer69
williamjennings1: george hotz gets sued by china
zol0: monkaS
Michaeltth: 😷
yevheniiushtyk: monkaS
vaskogomez87: yo temos aqui alguns tugas :D
beefydangles: monkaW
Miestensauna: i'm saving up to get a self driving car one day
beefydangles: monkaS
almonte550: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
sidthescikid: mmonkaS Geo u good?
beefydangles: 😷
AresRai: monkaS
dorkmo: hype train profiteer
Crypod: woke?
KruptWorld: @williamjennings1 haahhahha
dj_vicio: @almonte550 shut the fuck up troll
c0rz1: @Lana_Lux See what reading does to you?
lemonboxed: 10 monies pls
elon_musk__: @almonte550 TREWWWWWWWW
THX1342: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
Psycarlo: @pedrovictortech vai ao mey github, @psycarlo, saca de lá o meu email, e manda-me um mail com o teu numero para falaremos
dj_vicio: @Lana_Lux ban these guys
SneakyGamerr: Hi, this might be a stupid question but here goes. So what is the purpose/goal of this and what is it trying to achieve? No clue what is really going on but i'm hugely interested.
williamjennings1: read a paper front from back
pedrovictortech: @Lana_Lux You here?
edu4594: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
Mariosavitch: All you care about is real world CTF hacking.. HOW DARE YOU!
dorkmo: !claim
icanthitthose: im new to programming i just wanted to know how you reverse engineer corona virus using computer programming
theonlymonkas: ResidentSleeper
u1337ochka: yeah, guys want only one thing and it's fucking disgusting
thejuror8: They got first place in some open competition with AlphaFold, by quite a wide margin too. But they did recycle a lot of existing methods, and well they have Google money so
danisokpg: @1ntegral_ its necessary a lot of practices
mutrx: from corona import *
esence: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
Juankinator: Lux: LUL Direct Relief - Charity 2018akaCube: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting subscribe to me if you agree Kappa
nitcat: @mutrx LMAO
360Plato: ban this schmuck @almonte550
dj_vicio: @icanthitthose you can only reverse engineer it with HTML and javascript/css
THX1342: from covid import pwn
d0ubletruth: from corona import vaccine
ad5k: something like zfc proofs for biological findings would be useful
KruptWorld: hes making a jailbreak for the corona virus
ralaxe: are you a biologic man or something like that?
Lana_Lux: @pedrovictortech yes
Ekshernul: p values are an ok instrument, there are several huge problems with how it's used though since people just use 0.05 threshold without fucking thinking and knowing how tests work and what p value implies.
AresRai: @icanthitthose its his first time doing this, ask in a week FeelsGoodMan
pistolpetepcp: reverse(corona)
Wireballz: @georgehotz do you think this is man made?
Lizardan: Lot of people here that dont know George prob thinkin he's serious about getting subscriptions and attention LUL
JesseSkinner: i heard it normally takes 10 years to make a vaccine, is that true?
Jadess: It's all fun and games, until you cough!
lemonboxed: its hard to get good weights to train a deep learning model in a field where the data is inherently messy like bio
Vjasal: you can ban one person in chat, but can you ban the truth?
bob_babyelephant: from dumb import corona virus
THX1342: @Lana_Lux I knew you were a hacker
elon_musk__: @Wireballz Yes I made it
AresRai: @Lizardan LUL
skieth028: ROFL dont copy paste man i have a wrong spelling there LUL LUL LUL
on111: LOL how are people getting baited by this title. geohotz just does random coding stuff when he streams
Wireballz: lol
lemonboxed: i wouldnt get my hopes up
Dawoud3: have you heard that Santor Rand Paul tested positive from the Virus https://twitter.com/realDonaldTrump/status/1241897485779468288
pedrovictortech: @Lana_Lux How are you??
SneakyGamerr: @georgehotz Hi, this might be a stupid question but here goes. So what is the purpose/goal of this and what is it trying to achieve? No clue what is really going on but i'm hugely interested.
Lana_Lux: @thx LUL
Michaeltth: I'm here to watch the cure real time :)
danisokpg: @1ntegral_ broooooo
pedrovictortech: @Psycarlo Ganda trabalheira mas pode ser
thejuror8: It really is tho
Lana_Lux: @pedrovictortech doing alright!
skieth028: and PLEASE SUBSCRIBE guys... you're welcome LUL LUL LUL LUL
KruptWorld: @SneakyGamerr im tryn to figure it out too. he put up the library he made on his github
lemonboxed: its hard to get good weights to train a deep learning model in a field where the data is inherently messy like bio
elon_musk__: NO
Mariosavitch: no
Lana_Lux: @pedrovictortech how you doin?
elon_musk__: MAYBE
almonte550: here we go again with the simulations
kevin21071: whats folding@home for?
mickjaggerrrr: lol
Mariosavitch: we are in a sumulation
Rydberggg: you can do everything
beefydangles: with quantum computing
pedrovictortech: @Lana_Lux I am great and you??
360Plato: other factors are missing again like epigenetics
thebiggaeboi: add me on linkedin george
SneakyGamerr: @KruptWorld i've looked at the github just now and i'm trying to make sense of it. But i feel like this goes way over my head. :p
dj_vicio: we live in a simulation - The Matrix (1999)
elon_musk__: WE NEED A MATYOSHKA BRAIN
justdoityourself: @almonte550 when the only tool you have is a hammer....
kevin21071: You might need a quantum computer
anotherkidnamedaustin: to coagulate
Nussinov: google molecular dynamics simulations Kappa advanced stuff right there
u1337ochka: lemonboxed i think there usually isn't that much data in bio either
Usisuvach0: i think computer cannot help with this
thejuror8: It's NP-HARD
luigifrcruz: Simulating how simple proteins work would be a good starting point..
theonlymonkas: games
thejuror8: Protein structure prediction is NP-HARD
KruptWorld: @kevin21071 you donate your computer power to scientists who are running computations on folding proteins
beersnbits: George you should checkout folding@home
tj_rl: Let's start by simulating the universe
1ntegral_: @danisokpg Should begin with simple language like C to learn the basics Data structures memory etc
pedrovictortech: @Lana_Lux Did I just ask how you were twice? hahaha my dumbass
Not_Saercy: https://www.scottaaronson.com/talks/colloq.ppt
lemonboxed: protein complexity is like max complexity iono
anotherkidnamedaustin: the planck era of proteins
t_lokus: iBM had their mainframes doing protein simulations for covid, there are results published
williamjennings1: he wasnt joking when he was doing his talk at sxsw he really does think about hacking nature constantly
elon_musk__: ResidentSleeper
almonte550: If we simulate the whole universe can we solve coronavirus?
lemonboxed: its convoluted af
KruptWorld: folding@home currently doesnt do corona virus
saeveritt: cheer500 Lattice models are a trap
1ntegral_: then you can learn easier languages like python @danisokpg
GTozzi: LaTeX shows makes you look legit
mutrx: Its called molecular dynamics simulations
Nussinov: yes
JesseSkinner: yeah you just upload the human genome and it spits out a 3D image of a human body. WEIRD SCIENCE
Jehhred: of course similation works. We're living in one!!!!!
sidthescikid: what's the goal for this stream, is it just to formulate a plan of attack?
elon_musk__: it's to cure void
Lentaij: What's the dataset he's working with?
williamjennings1: @sidthescikid fun
Wireballz: Wargames "do you want to play a game"
elon_musk__: monkaS
Mariosavitch: beer virus monkaS
Usisuvach0: make a corona virus fuzzer @georgehotz
justdoityourself: @sidthescikid to enjoy watching how george prods at issues
AresRai: @sidthescikid pass time learn and share
thejuror8: There are a lot of Protein Folding problems that are proved to be NP-Hard at least
almonte550: @sidthescikid we are just learning stuff, it looks like we are doing stuff but in reality we aren't
mutrx: @georgehotz https://www.youtube.com/watch?v=lLFEqKl3sm4 molecular dynamics simulations
Krylexx: we live in a simulation
magicallyphysically: Can you link?
magicallyphysically: Please
KruptWorld: @Lentaij no dataset i think its the dna sequence of the virus
jagger_rsw: massively parallel search process
Mariosavitch: so how do you make a cure? do you block the spike protein?
elon_musk__: We can destroy the virus with a nuke
sidthescikid: I see I see, I like his process at problem solving
tshields44: https://github.com/yangkky/Machine-learning-for-proteins/blob/master/README.md
magicallyphysically: The Simulation
luigifrcruz: @Lentaij a handful of public nucleotide sequences from SARS-CoV-2
beefydangles: link the vaccine
superduperepic: ah yes of course 5Head
t_lokus: @georgehotz IBM has some results on protein simulations for covid https://www.ibm.com/blogs/nordic-msp/ibm-supercomputer-summit-attacks-coronavirus/
tenseroverflow: Whats going on?
williamjennings1: just take addearall and watch this stream
ageMonkey: is this thunderfoot?
danisokpg: @1ntegral_ yeeee bro
ehisoka: bof the virus for win
elon_musk__: y=kx ez
justdoityourself: @elon_musk__ lol you can kill it with a blow dryer
KruptWorld: jailbreak it @georgehotz !!!!! hahahah
Kyoto_o: keyword RANDOMLY
elon_musk__: @justdoityourself m8 that's a bit overkill
tj_rl: shake that
Kyoto_o: how much random is random
tj_rl: What is random?
anotherkidnamedaustin: simulate the planck era of proteing coag
anotherkidnamedaustin: pogger
magicallyphysically: 2012? quite ancient information to go off..
Lizardan: CNAT HEAR WutFace
KruptWorld: @Kyoto_o not random at all
Nussinov: @Kyoto_o stupid person has an interesting question, strange
williamjennings1: cant hear anymore
elon_musk__: Molecules DansGame
KruptWorld: quantum physics is the only pure form of random
Kyoto_o: you know nothing about "randomness" if you think it's a stupid question
cactusvacuum: https://www.ks.uiuc.edu/Research/namd/
Kyoto_o: @Nussinov
lemonboxed: hes basically saying to simulate nature they use a random model bc we have no idea how it actually works
ehisoka: youtube volume down
danisokpg: somebody knows about of sockects in Python?
Iknowyou123456789: pytorch or tensorflow @georgehotz?
ehisoka: is geohot ready for rap ?/
oubriq: wait til you read the fortran code :P
360Plato: see STRUCTURE can be quantified
Nussinov: @Kyoto_o LMAO i said you were stupid and the question was good. nice reading comprehension dummy
FargioFarmani: Please meditate again @georgehotz
justdoityourself: @Kyoto_o does randomness have a reference frame? that is the core issue
tj_rl: @Nussinov stfu
Kyoto_o: @Nussinov that makes even less sense, you are braindead
kevin21071: is this the lynda guy, that voice
shlver: They are lol
tj_rl: Stop bullying
Iknowyou123456789: why does he use chromium vs chrome?
mutrx: @georgehotz software is called GROMACS you can download proteins from https://www.rcsb.org/
Kyoto_o: @justdoityourself it does if it's generated within a personal pc, every state can be predicted
araeasmes: ultra-fast PogChamp
danisokpg: anybody knows about sockets in Python?
williamjennings1: puting your desk in your kitchen is great idea
tshields44: https://github.com/sha256feng/mldl-md-dynamics
rgbeezus: 2080ti fast
sidthescikid: @georgehotz do you have a reading/book list for 2020?
luigifrcruz: Folding@Home is trying to simulate the behaviour of the spike protein to find know weak points for medicine.https://foldingathome.org/2020/03/15/coronavirus-what-were-doing-and-how-you-can-help-in-simple-terms/
mutrx: @georgehotz software is called GROMACS you can download proteins from https://www.rcsb.org/
whitesaucey: George "is it open source" Hotz
Emanuell45: @sidthescikid he just skim reads everything
Lizardan: There's nothing more random than George's brain
sidthescikid: I kinda see that now lmfao
beefydangles: just read everything 4Head
tenseroverflow: @sidthescikid you think your skills are as good as his?
tokumei64: @williamjennings1 that's probably his whole apartment, if it's like mine
xPolarDreamz: get corona and research yourself
Khilimanjaro: LUL
nitcat: LMAO
pistolpetepcp: LOL
Mariosavitch: LUL
Ne0Zer0: LUL
Krylexx: PogChamp
360Plato: kek
yevheniiushtyk: easy money LUL
AresRai: LUL
tj_rl: lol
Emanuell45: KEKW
edu4594: LUL
sidthescikid: LUL
DecayingSkullz: LUL LUL LUL
くじょう: LUL
BOODLEG: LUL
xx_owlcapwn_xx: LMFAO openly admitting that LUL
Pin__top: D:
tj_rl: HAHA
beefydangles: EZ
esence: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
dj_vicio: how dare you?!?!!
cankunwang: cankunwang subscribed with Twitch Prime.
mutrx: LUL
oMYTHRA: LUL LUL
Mariosavitch: worked on me
ddd_dota: !uptime
brittonx2: Hahahaha
zeroeagle1: dammit just lost 5$
eiscosogin1: LUL
Liz3DE: LUL
KruptWorld: LUL
aiis: 200iq
sidthescikid: LUL TRUE
beefydangles: 4Head
1ntegral_: LUL
Nussinov: REEEEEEEEE I CLICKED AND SUBSCRIBE FUCK YOU FOR TRICKING ME
Mariosavitch: big if true
1ntegral_: So smart
kevin21071: dude how much money?
justdoityourself: galaxy brain
beypazarigurusu: disgusting
SneakyGamerr: Exactly the explanation i expected :D
Jehhred: Sounds legit, keep it up
Lentaij: easy -$5
almonte550: he world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
anotherkidnamedaustin: oh
kevin21071: Lets al go do it
Daniel_Duan: 4Head
IndoPridePinoy: HOLD UP TRUTH HAS BEEN TOLD
peter35_: clintSuave
anotherkidnamedaustin: so ur the scam
Pin__top: when am i getting my corona bux george
xx_owlcapwn_xx: 4Head hahahahah
edu4594: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
RomeoR77: I'm sold
KruptWorld: i gave him all my life savings
anotherkidnamedaustin: ur the scam, not the state
SneakyGamerr: This is who we should all give our money to!
bufferovrflw: PogChamp
THX1342: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
mutrx: PogChamp mark up price 5000% like Martin Shkreli
Emanuell45: what is this corona bro science
Ghost_001: not high btw LUL
SpecialAgentSkye: Works for me PogChamp
gollosadstation: place coronavirus for clickbait and study biology insted LUL
dongmuya: clutching my pearls right now
yevheniiushtyk: You laugh, but that's actually what some people are doing rn lmao
tokumei64: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
lemonboxed: the best scams tell you they are scamming you in the first clause
pz3300: Give us corona some hype George!
theonlymonkas: LUL genius
IaMvAzU: im in on the joke
sidthescikid: He's in
Mariosavitch: ban 'em
zeroeagle1: im sarcastic
IaMvAzU: stockGachiBear stockGachiBear stockGachiBear stockGachiBear stockGachiBear
PiroFloydian: we're all in on it
edu4594: on the joke, lul
beefydangles: its the next martin shkreli
RomeoR77: But george, how I get you to take my money?
Mariosavitch: yes
dj_vicio: yes
tj_rl: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
pz3300: We cool George?
theonlymonkas: martin shkreli is cool
samthedogg: some guys cant take a joke/get offended at the slightest
tj_rl: ;)
DecayingSkullz: he world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
Pin__top: elizabeth holmes D:
Ghost_001: FeelsBadMan
RexRothx: He must be new to Twitch...
KruptWorld: hell yeahhh
Lizardan: how do I donate a million dollars to your channel?
oMYTHRA: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
vaskogomez87: well guys, 2:30am here. in 5h already up. bye guys
mutrx: this is a great copypasta
sidthescikid: NEW COPYPASTA LUL
AresRai: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
edu4594: LUL
dj_vicio: aderall shot again
SneakyGamerr: he world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
bufferovrflw: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
ColdZer0o: he world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
nitcat: wheres the gofundme
mutrx: stock buy backs
xx_owlcapwn_xx: rofl
PiroFloydian: maybe the original guy was meming too @georgehotz
yevheniiushtyk: DiSgUsTiNg DansGame
williamjennings1: Is he drinking tap water!
beefydangles: PogChamp
Mariosavitch: big if true
Emanuell45: you know youre smart when your head is that big proportional to your body
mattdacentaur: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
sidthescikid: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
herrmuckelmann: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
Mariosavitch: nothing
nashesvobodnoye: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgustin
t3rminal: the world is in crisis and this guy pretends to "REVRSE ENGINEER CORONA VIRUS" and profit from it.. this is really disgusting
不好意思: LUL
ehisoka: ROFL
Pin__top: how did you know about my erectile disfunction!
t_lokus: @georgehotz IBM had some simulated proteins runs for "pre-fusion spikes": https://www.ibm.com/blogs/nordic-msp/ibm-supercomputer-summit-attacks-coronavirus/
reportyourself: stop spamming clowns
danisokpg: @1ntegral_ i have a questtion bro...
Lizardan: @Pin__top your username
JefeBezos: the world is in crisis and this guy pretends to “REVRSE ENGINEER CORONA VIRUS” and profit from it.. this is really disgusting
justdoityourself: watching geohotz give you big pp. You heard it here first
patulskitime: where is the github?
1ntegral_: @danisokpg Go ahead
samthedogg: @georgehotz lol was that an idiocracy reference? about baldness and ED
Penguino138: Just got done watching Devs, what is George up to now? Still parsing out the RNA?
JakobJayJohnson: !uptime
xx_owlcapwn_xx: killing the virus with python 4Head
KruptWorld: oh thank god your going over it
williamjennings1: what the fuck.
THX1342: that quote is pure gold
Tomishima: STOP with your highlight SPAM. Avoid useless and meaningless words and certain phrases that will bring zero value to the chat. You are destroying not ONLY my chat EXPERIENCE but everyone's chat EXPERIENCE.
danisokpg: @1ntegral_ so, to code its necessary a lot of practices
Nussinov: the membo
1ntegral_: @danisokpg Of course
SneakyGamerr: How is doing all this even possible?
beefydangles: STOP with your highlight SPAM. Avoid useless and meaningless words and certain phrases that will bring zero value to the chat. You are destroying not ONLY my chat EXPERIENCE but everyone's chat EXPERIENCE.
SneakyGamerr: :o
anotherkidnamedaustin: a membrane
Nussinov: it is correct
Sullyboy: sounds righ to me
anotherkidnamedaustin: its just a membrane
Sullyboy: right*
tokumei64: nice try @Tomishima
Mariosavitch: so to stop a virus you have to prevent the spike protein from functioning? @georgehotz
anotherkidnamedaustin: fluid
Kingxpecc: when did you start streaming
danisokpg: @1ntegral_ how much?
sidthescikid: Its a generic cell membrane in biology jargon
tenseroverflow: it is NOT correct
tenseroverflow: it is correct
mutrx: !uptime @Kingxpecc
xPolarDreamz: i dont know how you can use code to reverse engineer the corona
THX1342: the image on the wikipedia page, on the replicaiton seciton, gives some light on how the layers are formed during covid reproduction
Kingxpecc: !uptime
Kingxpecc: ! up time
不好意思: this is really interesting
mutrx: @Kingxpecc it isn't enabled lol
360Plato: ACE 2 is the vector right?
THX1342: I still don't get how the quine works....
Kingxpecc: lol
ghu90: https://plnkr.co/edit/TNuAIB1mFn01O1tG6KtM?preview
Kingxpecc: lol thanks thou
almonte550: Which one of those spikes has more information?
Nussinov: ah, i see you're misusing words to weed out the dumb memorizers Kappa
SneakyGamerr: I just love how he explains all of this!
t3rminal: med students feel free to correct him in chat
KruptWorld: ive been waiting for this @SneakyGamerr
thejuror8: @Nussinov LUL
Mariosavitch: rna transcription?
AresRai: you're speaking about the place where peptides take their shapes ?
williamjennings1: not loged in google
SneakyGamerr: @KruptWorld YEP me too! Sooo hugely interested in this!
barbadose: a ribosome..
Nussinov: a replicase
hellonearthis: touching face and biting nails is bad right? Is this work similar to the folding at home dot orgs sars-cov-2 floding?
williamjennings1: khanacademy
Nussinov: would copy the genome of an RNA virus
esence: just transpile that RSA into JavaScript bro
Lentaij: Is there really no interpreter like SMILES for proteins?
THX1342: RNA translation happens with the ribosomes
whitesaucey: talks about corona on twitch STONKSSSSSS
THX1342: ribosome is the organele
ghu90: this may help https://plnkr.co/edit/TNuAIB1mFn01O1tG6KtM?preview
yevheniiushtyk: we need a discord server lads
l1ght5p33d: NOVEL TRANSPILE 2020
sidthescikid: no a ribosome is the process to hook tthe randa
sillybaboy: @esence Javascript is an illness itself
tj_rl: Challenge corona to CTF
SneakyGamerr: How does one even begin to learn about all of this stuff. Does this come from previous knowledge or did he just started learning about all of this recently?
Mariosavitch: ribosome is the compiler?
sidthescikid: this is pre-ap bio
THE_korbi: geo you are so cool!
barbadose: ok so, what is this guy's background? what did he study?
danisokpg: so what is the meta ??
whitesaucey: the mitocondria is the powerhouse of the cell!!!!!!!!!!!!!!!!!!!!!!!!
Nussinov: @georgehotz i think youre thinking of a replicase? https://en.wikipedia.org/wiki/RNA-dependent_RNA_polymerase
MorningScifi: check his wikipedia page hahaha
tj_rl: @SneakyGamerr He doesn't know everything. But he's really good at learning on the go
AresRai: @barbadose no biology dont worry :)
THX1342: ribosome is a parser
tj_rl: @barbadose Computer science
barbadose: @AresRai didnt think so lol
l1ght5p33d: novel dynamics 2020
THX1342: Qira for BIo when
1ntegral_: How do you do Dynamic analysis on corona ?
SneakyGamerr: @tj_rl Yea i've noticed. I'm just getting increasingly impressed by the minute
1ntegral_: difficult no ?
barbadose: what lvl of cs? :P
lemonboxed: except its not a cpu its just similar
THX1342: we need a bio debugger with breakpoints and all
tyrobigboy: 5Head simple really
Kingxpecc: whats your twitter geo
Lizardan: @barbadose god level
Mariosavitch: exactly mr hotz
esence: trial &amp; error method
tj_rl: @SneakyGamerr The point is you can do this too. Don't be afraid to jump into a subject just because you don't know a lot about it
thebiggaeboi: truuuuuuuuuu
DecayingSkullz: First Principles
Minghello: !uptime
l1ght5p33d: geohot = ultra leet
1ntegral_: That's the spirit yeah
Kingxpecc: nvm
thebiggaeboi: truuuuuuuuuuuuuuuuuuuu
Pin__top: immediate feedback
danisokpg: geo hack something
Nussinov: you don't get anywhere if you try to learn only the things you already know Kappa
chillguy269: Most people so afraid to look dumb that they do not even start
tehEGO: in the words of missy elliot, flip it back down and reverse it
mutrx: @georgehotz MDS simulator is called GROMACS, and you can download proteins from https://www.rcsb.org/
mickjaggerrrr: problem solving
dongmuya: He doesn't care about being right, he cares about profit! SeemsGood
theonlymonkas: no
SneakyGamerr: Yea the learning process is amazing! And seeing you step through it honestly is really educational. At least in my eyes.
Mariosavitch: the fact that you can cross discipline is awesome.
portitforward: a lot of people end up in tutorial hell when the real way to learn is to continuously attempt things
THX1342: most people are afraid to learn. they get intimidated when they don't know something and stop at that
Juankinator: he only wants that twitch money Kappa
l1ght5p33d: all the datas is are belong to us tho
lemonboxed: unless the underlying central dogma of bio is wrong, then we wont be going foward
bacca18121: everyone in silicon valley is a charlatan
MorningScifi: hahahahaha
lemonboxed: microbio
nitcat: "did you sub to geohot on Twitch?"
KruptWorld: lolol
Michaeltth: back to the grind
Mariosavitch: lol
Pin__top: learning things are very frustrating when diving in with no prior education
Psycarlo: PogChamp PogChamp PogChamp PogChamp
1ntegral_: @nitcat LUL
Mariosavitch: heaven is gated for a reason
lemonboxed: isnt that just what calvanist think
Stegosaurian: Is anyone you know infected?
GTozzi: That's what the Ferengi believe
hellonearthis: ask a for different god
gabo_sk: LuvBrownR LuvBrownR LuvBrownR LuvBrownR
abdcw: its fine guys i got my virginity back i paid my church 2k
lemonboxed: thats like the most boring version of heaven
araeasmes: LUL
theonlymonkas: but do you have 1M dollars?
Lizardan: No corona in heaven BlessRNG
Emanuell45: ??????
araeasmes: lmao
esence: AYO, 1MIL AND FIDDY
dj_vicio: whats this?
Psycarlo: God's only accept Bitcoin
Mariosavitch: so thats why theres a gate
Lizardan: @theonlymonkas LUL he's got more than that
360Plato: or you just do a bioinformatic startup selling snakeoil
KruptWorld: lool
sidthescikid: ???
Pin__top: speaking in riddles again
Ghost_001: ???
gollosadstation: that's aint matrix can't be right
zeroeagle1: ahhahahahaha
Ghost_001: G OMEGALUL D
THX1342: LUL
nitcat: LMAO
anotherkidnamedaustin: should be backtesting data..but love watching u stream and its rare
mutrx: what's God's bitcoin address
liiiiiig0: LUL
dj_vicio: time for aderall again
Psycarlo: loooooooooooooooool
akaCube: bitcoin cash DansGame
Snowlav: LUL
tehEGO: NAh you get to the gate and says work to earn enough to get to earth 2.0
thisuserisdeleted: THE MATRIX HAS YOU
samthedogg: bitcoin cash is trash
liiiiiig0: LMAO
zeroeagle1: BitConnect !
yevheniiushtyk: BITCONEEEEECT
Juankinator: god only accepts doge coin
不好意思: lmao
DecayingSkullz: Bitconnect
Not_Saercy: Spoilers! Not cool man
lemonboxed: bitcoin cash
chillguy269: Those poor 20th century fucks
samthedogg: bitcoin, eth, tron
ToxicVulpes: BCH or BTC?
CompestLive: whats his btc address
lemonboxed: its bitcoin but still cash
SpecialAgentSkye: BRB buying btc cash
chillguy269: wrong time to be alive
Abnico: bitcoin cash has a tax now lol
THX1342: Faketoshi IS God... (at least in his head)
thisuserisdeleted: Coronacoin
xPolarDreamz: bitcoin cash is a joke
nitcat: so right the ribosome is the parser right
danisokpg: this boy is rich?
justdoityourself: the constant stream of trolling... pog
samthedogg: Bitcoin, eth, and tron are he only good ones rn
ToxicVulpes: cant get into the Citadel without Bitcoin Cash
Lizardan: @danisokpg google him
dj_vicio: rich? idk maybe not. Using the same fork for rice and ice cream.
luigifrcruz: meta
sidthescikid: Humans make humans 5Head
pistolpetepcp: sheit what makes that ribosome
tyrobigboy: like a human making another human
tehEGO: which came first the ribosome or the ribosome
FargioFarmani: f
esence: SERIALIZER
thisuserisdeleted: what is a human?
Michaeltth: an event last week 👀
l1ght5p33d: Recursive ribosome(Recursive ribosome)
THX1342: tehEGO the golgi complex
hellonearthis: it seem like your reproducing the folding at home work. https://foldingathome.org/2020/03/10/covid19-update/
nitcat: that'd be crazy
thejuror8: You mean, an FPGA ? LUL
KruptWorld: fuck me
danisokpg: @lizardan i think that ye
Emanuell45: brains are cheap?
sidthescikid: Actually true
thisuserisdeleted: Has anyone seen toilet paper? I am looking for it and I cannot find it anywhere.
lemonboxed: brains arent really that cheap to build it took like 300 million years
Mariosavitch: big if true
mattdacentaur: @lemonboxed
thisuserisdeleted: brains are useless when you let someone else think for you
nitcat: just a learning experience shared to us
Emanuell45: do you know how much food a brain needs hotz?
l1ght5p33d: we find corona cure here open source
saixj: preach
mattdacentaur: its cheap now because that 300 mil was just r&amp;i
Liz3DE: Learning!!!
thebiggaeboi: toilet paper machine learning
cankunwang: This is self learning
KruptWorld: aaahhh
yevheniiushtyk: Would be cool if we had an Discord server where we could share knowledge at
Juankinator: i feel scammed, unsubscribing Kappa
esence: OK, GUYS, GET THAT COPYPASTA OUT THERE, IT'S DISGUSTING
THX1342: @georgehotz it's interesting exploration but a fresh viewpoint and framework can bring novel ideas
dongmuya: He's trying to make profit, not save the world. Geez how many times does he have to say it? HeyGuys
thejuror8: @georgehotz Hey a good move would be adding "#learning" to the title of your stream :)
GTozzi: pepega
xx_owlcapwn_xx: lol
akaCube: so insperational Pog
thisuserisdeleted: did you guys find the cure yet?
Nussinov: im just here because im lazy and want free entertainment
justdoityourself: 90% of brains are NPC brains so they are a waste
MorningScifi: and novel coronaviruses @THX1342
eiscosogin1: did you make 1million yet?
sidthescikid: There's no TTV here cmonBruh
thisuserisdeleted: NPC brains lol
anotherkidnamedaustin: martin skrelli said the same things
KruptWorld: disgusting you profited from exploring the corna virus
theonlymonkas: D E E P
thisuserisdeleted: we just scripted to consume
BrodatyWhiteBear: Well... I'm not gonna lie, I would accept his Kappa
eddoo: hello
rgbeezus: arxiv
thisuserisdeleted: but the problem is where there is nothing to consume our programming breaks down
myaocat: they try to make a potential vaccine https://drive.google.com/file/d/1yP8GH1MkuRK5rmMpJSOF4OgFwqdx5b7y/view
l1ght5p33d: ecoli grows cure protien novel open source 2020
cankunwang: Most journals do not accept BioRxiv papers
KruptWorld: hahaha
tehEGO: lol
Pin__top: charity is a scam
araeasmes: nice
abdcw: yo sci-hub also kinda slaps no cap
MorningScifi: LOOPHOLE!
Nussinov: true
lemonboxed: were journals ever alive tho
danisokpg: how are your toyota geo
thisuserisdeleted: we live in the future
PiroFloydian: charity shouldnt need to exist and yeah it is a scam
sidthescikid: What's the alternative to charity
idkfa22: idkfa22 subscribed at Tier 1. They've subscribed for 2 months, currently on a 1 month streak!
dongmuya: Invest the profit right back into yourself and write it off as a loss cmonBruh
Nussinov: sidthescikid hell
PiroFloydian: @sidthescikid a functioning social safety net
justdoityourself: @PiroFloydian except when it isn't
dj_vicio: I heard the 3rd stage of CoVID-19 uses antibodies to fight against you and ultimately kills you
thisuserisdeleted: nobody told me memes can't save me
THX1342: @georgehotz did you check the mRNA vaccine video I shared yesterday?
sidthescikid: @PiroFloydian like a UBI lmao
myaocat: Are they legit? https://drive.google.com/file/d/1yP8GH1MkuRK5rmMpJSOF4OgFwqdx5b7y/view
dongmuya: @idkfa22 iddqd
lemonboxed: it could just be a rebranding of a terminoolgy to patent a new class of drugs
Mariosavitch: How do we know that the spike protein will bind to a specific receptor?
thisuserisdeleted: i think last phase of the disease is where we meet it in person face to face and comes out of a spaceship
Pin__top: i will gift 5 subs if you find the vaccine by the end of stream
saeveritt: Yo. Next stream you should make a digital asset protocol inside OP_RETURN for bitcoin cash
THX1342: Mariosavitch chemical bonds
barbadose: some chode
swagomgswag: chode
l1ght5p33d: pure f#$%ng magic
dj_vicio: mother chode
herrmuckelmann: no ssl
herrmuckelmann: oof
Nussinov: oh hey i used to work with this guy
justdoityourself: @Mariosavitch because people get sick :)
thisuserisdeleted: we figured it out guys. download your brain into twitch and then you can never get infected. genius
Ghost_001: good animation = future LUL
Mariosavitch: I meant if i have a spike protein do I have to simulate wha receptor it will bind to?
AresRai: @Ghost_001 indeed 5Head
mattdacentaur: @thisuserisdeleted but you do get cancer
lemonboxed: the future of bio is to animate your protein models with random wiggles
barbadose: what is the purpose of this btw? what is he trying to figure out?
AleexM: What is computational power of fold@home used for? @georgehotz
Nussinov: the language is good
lemonboxed: the future of bio is sick animations
luigifrcruz: @georgehotz Greg Bowman is the director https://twitter.com/drGregBowman
thisuserisdeleted: how can you get cancer if youre just bits on a server? you cannot get anything anymore. you good for ever
tj_rl: ^
KruptWorld: @AleexM folding the protien
justdoityourself: @Mariosavitch of course, if you want to trace the pathology
shlver: @Mariosavitch by cell electrophoresis.
cankunwang: p&lt;0.05
Pin__top: more like poo values
thisuserisdeleted: ahaha he pointed at the wrong one
Mariosavitch: thanks
AleexM: Is there any source on how that works @KruptWorld ?
swagomgswag: LUL
360Plato: We can finally quantify outcomes
xa1ry: what's the issue with p-values? @georgehotz
Snowlav: thisuserisdeleted bits still get flipped often
xPolarDreamz: i need some free energy
theonlymonkas: q values
thisuserisdeleted: ain't nobody gonna flip my bits
l1ght5p33d: any study can be flawed and have all the p values you want
Snowlav: thisuserisdeleted u new to cs?
KruptWorld: @AleexM im trying to re-learn about it too. i heard about it when it came out on the ps3 and i would fold@home with it.
thisuserisdeleted: @Snowlav yes
Snowlav: ok makes sense then
thejuror8: The fact that p-values are misused does NOT mean that they should be banished altogether. They are still a great tool
thisuserisdeleted: im new how can i make sense
hellonearthis: Sounds like something from the tv show "Devs"
myaocat: https://reason.com/video/biohackers-are-on-a-secret-hunt-for-the-coronavirus-vaccine/
Snowlav: thisuserisdeleted u don't that's the point
myaocat: Is this real?
nikudino: its exponential, we need quantum
raystriker98: quantum computing levels of compute
dongmuya: Theres no P values in heaven
THX1342: @georgehotz did you check the mRNA vaccine video?
shlver: @georgehotz the structure changes depending on ph. the pka of certain amino acids determines their electroengativity
thisuserisdeleted: yes @Snowlav
Nussinov: @georgehotz are you a frequentist or bayesian thinker Kappa
McAze: disgusting
lemonboxed: you can compute for as long as you want , doesnt mean you will ever make a working simulation
pistolpetepcp: I have a big p-value
Michaeltth: HackerMan
Mariosavitch: Co-Author: George Hotz
thisuserisdeleted: so i guess i was right there are different strains going around
dj_vicio: seems legit
KruptWorld: @AleexM so what i know so far is that after the protein is shitted out in a straight line it just starts to 'fold' on it self. and we are running simulations to simulate that random folding on itself to get the right fold
thiefer20: George Shkreli
THX1342: CRISPR
zeroeagle1: They understood how the world works
THX1342: CRISPR vaccine
myaocat: they didn't use any of the money they received..
BOODLEG: have you heard of DRACO? from MIT?
hellonearthis: does the cure involve gargling bleach and shorting cocaine
justdoityourself: p-values == wrath of khan protomatter
theonlymonkas: martin hotz
sidthescikid: CRISPR is overhyped, its very small scale and isn't feasible
thisuserisdeleted: i m not gonna take the cure if it involves suppositories
lemonboxed: dna vaccines are stupid
swagomgswag: i would for money
l1ght5p33d: find set of all possible folds
Nussinov: just inject that plasmid right up into those cells Kreygasm
luigifrcruz: I don't think these guys have Class 4 Labs..
shlver: @georgehotz the structure changes depending on ph. the pka of certain amino acids determines their electronegativity. High temperature, excessive changes in pH causes differing changes to structure.
Nussinov: ill show you my f-pilus if you show me yours Kreygasm
myaocat: They are making it..(producing it), they are not testing it because it's cost a lot money
Pin__top: what if corona merge with ebola
theonlymonkas: for how long he has been streaming ?
AresRai: 6h
hellonearthis: french news said they hard good results for treatment with anti malarial drugs
Mariosavitch: ACE2
thisuserisdeleted: intelecturals on reddit are calling corona ebola 2? @Pin__top
Ghost_001: !uptime
Pin__top: @thisuserisdeleted, oh god
esence: @Mariosavitch you like Ace Ventura 2 too?
KruptWorld: wait @georgehotz, wouldnt simulating the physics between atoms enough to simulate proteins? or anything for that matter? do we really have to get quantium? i think quantium is just for collapsing the infinite amount of wave functions, if im not mistaken...
Mariosavitch: great movie
MorningScifi: It's literally SARS 2
lemonboxed: the protein doesnt respond to the immune system thats like down a different chain
lemonboxed: proteins just make stuff
theonlymonkas: !uptime
l1ght5p33d: need quantum because tunneling
AresRai: @hellonearthis its because it contain zinc   something else that allow zinc to go through cells, which slow the ATP process and slow reproduction of the virus according to a video
thisuserisdeleted: theres a lot of sars related diseases tho
Iknowyou123456789: what is your WPM? @georgehotz
luigifrcruz: I think the immune system is trying to bind with the spike protein to prevent it to bind with pulmonary cells.
l1ght5p33d: classical solution is not the same as quantum for small systems like optical tweezer
myaocat: @lemonboxed i read that protein inject to the body and try to make antibodies.. something like that
theonlymonkas: KappaRoss
myaocat: * the immune system tries to make antibodies based on the protein
1jefferson: !commands
thisuserisdeleted: what if the virus mutates to a more deadly strain like mers but remains just as contagious
hellonearthis: thanks @AresRai
hitmanhax: scam
MorningScifi: mix in some frog DNA for good measure
edu4594: they used word...isn't even latex
myaocat: @hitmanhax probability is 50%
shlver: @georgehotz if you truly want to understand how physiological environments affect protein structure, you need to look at how pH affects amino acids and their side chains.
Nussinov: written like a narcissistic undergraduate Kappa
cankunwang: Every saw Jamal Murray's video?
barbadose: I actually don't think antibodies (B-cell response) are too important as a mechanism of defense against the virus, most viruses require a strong T-cell response
almostquiet: Man, i'm coping with this shit as good as i thought, i'm getting serious cabin fever and insomnia. Like i'm used to being socially isolated for but it's somehow 10x worse when the world is falling apart
THX1342: https://www.youtube.com/watch?v=MtDMXypfnTY watch this later if you didn't yesterday, geo, mRNA vaccines are interesting stuff
Mariosavitch: its like patching
lemonboxed: its probably better to understand the heirachy of order for each system before trying to "hack" anything
almostquiet: not*
lemonboxed: if you want to get anywhere
liiiiiig0: PogChamp
thiefer20: protonmail btw
astrailz: George "This is awesome" hotz
myaocat: no .. how do you know they are legit?
mickjaggerrrr: wow
KruptWorld: disgusting
williamjennings1: lol
theonlymonkas: instinct
hitmanhax: haHAA
sidthescikid: 6 grand bruhhh
barbadose: @georgehotz I actually don't think antibodies (B-cell response) are too important as a mechanism of defense against the virus, most viruses require a strong T-cell response
williamjennings1: donating realy money
thisuserisdeleted: haha ez money
myaocat: How do they know they are legit?
Mariosavitch: scamaz
bob_babyelephant: !time
almostquiet: what are they doing exactly that's so awesome?
Nussinov: oh, so this is an ad then Kappa
theonlymonkas: rich boi
lemonboxed: barfhackers
thisuserisdeleted: diy biologist
Mariosavitch: a scama scaming a scama
1ntegral_: Biohackers LUL just hackers
Emanuell45: seems scuffed af
thejuror8: Lmao imagine giving money to those guys
thisuserisdeleted: bioscammers
imfunniee: saw the corona repo, came here asap Kappa OhMyDog
NuHaru: yo george what are you doing?
Lizardan: Biohackers Kreygasm
lemonboxed: here we go again with barfhackers
williamjennings1: 20 bucks!
Pin__top: there is a book written in 2010 about corona D:
l1ght5p33d: open source only
thisuserisdeleted: Bioscammers are on a search for the ultimate heist.
thejuror8: Are they going to test vaccines on themselves ? what even is this
imopfloors: b i o h a c k e r s
mickjaggerrrr: 50 mate
MrYasser2194: can i get a link ?
NuHaru: @georgehotz u are a nice guy, what is the paper about?
pistolpetepcp: sending them $5
eaterenrgy: Pog $20
Nussinov: okay chat 4 people subscribe its the only way to keep this streamer from going under
Keyeh: lets donate 1 BTC!
eiscosogin1: if you send 20 bucks your profit will reduce
yevheniiushtyk: bit co neeeect
Ghost_001: biohackers PogChamp
sidthescikid: @Pin__top Proves my conspiracy theory
eaterenrgy: zentrePOG
KruptWorld: @NuHaru hes just exploring the biology of the corona virus
thejuror8: From fecal transplantations to COVID-19 vaccines, bioscammers truly never stop FailFish
almostquiet: b i o h a c k e r s aka ultimate cringe
esence: refresh the page to prove it to us
Kodaly: u ab out to leak your bitcoin address by saying that O_o
samthedogg: deff gonna guy more bitcoin if the fed prints another $1.5trillion like they did
pistolpetepcp: since I lost all during the crash lol
SneakyGamerr: why exactly would it be worth donating? What about that document peaked your interest?
almonte550: Can you send us the transaction hash to make sure u r not lying?
imfunniee: bitconnnnneeeccctttt
Pin__top: https://link.springer.com/content/pdf/10.1007/978-3-642-03683-5.pdf
zombiedigital: biohacking is more like with crispr i assume,
SpecialAgentSkye: sending 10 as well
Mariosavitch: so nice
niiq: donate to CureVac Kappa they need it Kappa
swagomgswag: @esence do it urself
almostquiet: Nice document though
tokumei64: @Kodaly doesn't matter, you can't just randomly pull bitcoin from an address
Vnz0v: u hacked sony
l1ght5p33d: this is the best stream
thisuserisdeleted: i bet these biohackers bought out all the toilet paper
tokumei64: i think he's aware of the lack of anonymity as well
360Plato: gatekeeper
happypuppppy: did he post the doc link already
Kodaly: @tokumei64 one of the advantages of having a bitcoin is that it's anonymous...
thejuror8: @zombiedigital Biohacking = Attempting to do medecine outside of academy with mostly weird motives
DecayingSkullz: yes
myaocat: full screen?
almostquiet: I hear just farting noises
eaterenrgy: Yes
Nussinov: i would have spent that 20 dollars on more toilet paper Kappa
IaMvAzU: yeaaa
almostquiet: Is that correct
MllCZ: geo about to become a bio engineer
Pin__top: springers also has another book written in 2005
Emanuell45: wtf
keith282: @Kodaly bro most people have a few hundred bitcoin addresses and the money with unique ones being used for almost if not each new tx chill lol
thisuserisdeleted: nice animations
t3rminal: its a front for a meth superlab
thisuserisdeleted: what vide game is that?
thejuror8: FailFish
myaocat: that's BTC not BCH .
Nussinov: FailFish
shlver: imagine people injecting themselves LOL
thejuror8: Oh my god
Michaeltth: the fear was these kinda guys were going to cause the next outbreak lol
justdoityourself: GMO Dogs?
JakobJayJohnson: @almostquiet i farted very noisy. Sorry bro
Zenzutsu: they use themselves as test subjects
imfunniee: wait so they are hackin real life
thejuror8: Imagine injecting yourself with a vaccine YOU MADE
thisuserisdeleted: imagine living in 2020
thisuserisdeleted: wait
almostquiet: @JakobJayJohnson np
mutrx: yikes, that's a lot of ethical violations
Emanuell45: imagine one of them creates hulk POG
almostquiet: Coronope? lol
Nussinov: They all sound like they injected one too many vaccines not gunna lie
mutrx: they probably made a vaccine that causes autism
sillybaboy: concerned about anonymity, voice not even scrambled ....
thejuror8: Absolutely immature
thisuserisdeleted: They deff inject something and is not vaccines
GTozzi: Do you have a public key @georgehotz
Zenzutsu: bionerds
sidthescikid: @Nussinov LUL
myaocat: I hope you didn't send to BCH address..
zombiedigital: this is starting to look like that movie "contagion" where this random guy comes out with a fake vaccine and makes millions of dollaz
s0rrz: actually hidden meth laboratory
thisuserisdeleted: I didn't know crack addicts are called biohackers now
THX1342: Dengvaxia
sidthescikid: Bureaucracy kills
Michaeltth: worst sideaffect allowed is autism Kappa
l1ght5p33d: They also blew up astronauts a few times so stuff happens
THX1342: Dengvaxia is an mRNA vaccine that failed hard in the Philipines in 2018...
shlver: lol so it's cool for people to make DIY vaccines and inject themselves. FailFish
mattdacentaur: autsim Kappa
dj_vicio: why he's using bitcoin cash?
thisuserisdeleted: nice jar bro
almostquiet: 3d printed antibodies bro, it's the new hype here in cali
dongmuya: China: no fucks given with red-tape testing SMOrc
Zenzutsu: just ask china for the vaccine
thejuror8: @zombiedigital Hey the Contagion movie is incredibly accurate, I rewatched it recently. Scenario was so realistic that almost everything that happened in the movie pretty much happened in this last month is some way or another
Nussinov: okay this might actually be a good thing
AleexM: "Get Johnny Knoxville to try it!" LUL
zombiedigital: @thejuror8 yeah true, i rewached it aswell
thisuserisdeleted: imma gonna watch Contagion movie now
ahahahaitslit: cleavage (Y)
saeveritt: Who's going to sequence the spike protein though
IndoPridePinoy: how much bitcoin is that?
almostquiet: 20
solitarynative: does he know anything about viruses before this
Sniky83: what's the goal of you're doing ?
xPolarDreamz: view the owner of pdf file
almonte550: @solitarynative no
georgehotz: https://drive.google.com/file/d/1yP8GH1MkuRK5rmMpJSOF4OgFwqdx5b7y/view
SneakyGamerr: @Sniky83 From what i understand. Exploration and education
RHN_X: So what exactly are we doing here, just tuned in
thisuserisdeleted: yesterday america had 24k cases now is close to 33k
xPolarDreamz: 3 dots -&gt; details
Nussinov: can we see any more technical details for this proposal? explaining the requirements for a plasmid is not really enough, you know
l1ght5p33d: geohot know everything becuase python
JakobJayJohnson: Are vaccinations safe?
almostquiet: Can confirm america is fuk
robg_10: !uptime
B0tch: DONT TOUCH YOUR FACE GEORGE
xPolarDreamz: Zach Weissmueller
hitmanhax: he's the author of the article
sidthescikid: @solitarynative From what I can tell he has taken chem classes in college
thejuror8: LUL Just realized they get paid in Bitcoins at the worst possible time to get paid in Bicoins, possibly
THX1342: a DNA factory
solitarynative: ok
siazhenwei: hi
THX1342: uses bioreactors
thisuserisdeleted: imagine combining heroin and corona everyone will get addicted Kappa
edu4594: btc takes 10 minutes to confirm
buckkets_: 10m block time sir
THX1342: they use bacterya to replicate the DNA
Keyeh: usa has the best spread of the covid19, the greatest --- absolutely
myaocat: he probably sent to BCH address and this is BTC.. (shrug)
Sniper_pro497: the Queensland government of Australia has just given 17 million dollars to the scientist's of the Gold Coast Queensland Australia the scientist's said they will have a vaccine for the conorvirus in January 2021
keith282: @RHN_X making a vaccine using python, online subscribers get to have it
THX1342: @georgehotz under development. they are way cheaper when they work
Lugueiro: !uptime
barbadose: !uptime
eaterenrgy: 6hr 8 mins
mutrx: a vaccine really isn't going to help us at this point
hitmanhax: ^
Pin__top: there is an article written in 1983 about corona im trying to find it
eaterenrgy: zentreDerp
thisuserisdeleted: can you even create a vaccine for this virus?
keith282: woah mutrx D:
Vnz0v: protonmail lmfao
THX1342: mutrx wrong... this is endemic now. a vaccine would help immensely
wootawee: Might be of interest: https://docs.google.com/document/d/1kP2w_uTMSep2UxTCOnUhh1TMCjWvHEY0sUUpkJHPYV4/edit
thisuserisdeleted: i thought this virus mutates incredibly quickly how you gonna make a vaccine that can target all possible mutations
l1ght5p33d: vaccine for corona 202(*)
ahahahaitslit: how tf would a vaccine not help
zombiedigital: sars is a rna virus
Mariosavitch: because big pharma wants to monopolize the industry and the use the FDA to keep it that way
niiq: valve worked with "Perfect World" to launch cs go in china.... the first case of corona virus was on 17th november. On 18th november they released a big update to cs go. the theme: a virus outbreak ... coicidence ? surely not!
KnollBoss: dna vaccines on humans doesn't get through testing
KnollBoss: FDA hates the shit
THX1342: @georgehotz Look at https://www.youtube.com/watch?v=MtDMXypfnTY
pz3300: @VnzOv is protonmail the feds?
thisuserisdeleted: i feel like retroviral are the only way and they are still lots of years until we can use those
GTozzi: APS are limited by patient locks
thisuserisdeleted: or maybe nanotechnology ? but thats just scifi
KruptWorld: thanks @georgehotz ! it was fun!
GTozzi: patent***
kevin21071: theres ton of open source closed loop systems
thisuserisdeleted: i think this disease is just a new seasonal flu
mutrx: @THX1342 the time it would take to develop one is much better spent on implementing lockdowns, and social distancing (to reduce the curve); not to mention the money is probably better spent supporting citizens. Wuhan managed Cov19 without a vaccine, it isn't essential to manage the spread.
pz3300: Or just eat healthy
thisuserisdeleted: they probably gonna create a seasonal corvid 19 shot
THX1342: DNA are the new hype because of the development speed. it is code, you can edit it and reuse code
THX1342: DNA vaccines
Mariosavitch: Skype SHKRELI from pirson and ask questions
Pin__top: here is an article from the 80's https://www.ncbi.nlm.nih.gov/pmc/articles/PMC288755/
Michaeltth: they gonna release shkreli so he don't get the rona?
JakobJayJohnson: Is life a big fucking scam?
THX1342: mutrx you have to think on future epidemics, not just the current one
thisuserisdeleted: see they shouldnt have jailed Shkreli . now they need all the help they can get Kappa
hitmanhax: free shkreli he's the only one that can fix this
pz3300: Do you use signal a George?
Ghost_001: actually high look at him LUL
justdoityourself: shkreli didn't kill himself
thisuserisdeleted: im glad biohackers are on the case. With biohackers we gonna win this pho sho
Mariosavitch: imagine if shkreli comes out of prison and then cures corona
pistolpetepcp: martige shreklihotz
l1ght5p33d: Shkrelis has bad interview ediquette he f*(&amp;#d himself
thisuserisdeleted: but he charges 1 million for 1 shot
PiroFloydian: LMAO
Nussinov: l1ght5p33d actually stealing is what fucked him
GTozzi: But there are multiple other boards/stages you have to go through in the European system (negotiation stage ostensibly) with governing bodies that do require ethical evaluation
mutrx: @THX1342 right now we need to focus on the current epidemic, and then we can investigate better strategies
KnollBoss: i would settle for jack dorsey consumating passionately with me
dorkmo: noise complaint from Twitter hq
myaocat: https://www.nbcnews.com/health/health-news/fda-working-treatment-coronavirus-blood-recovered-patients-n1165231
PiroFloydian: what about the ability to edit tweets? @georgehotz
l1ght5p33d: the judge couldn't let him go after all his talking sh#t
YoungScootah: Free shkreli
peter35_: to shkreli clintSuave
pz3300: Disrupting his yoga
Nussinov: one thing is for certain - you would benefit from him being innocent Kappa
THX1342: mutrx I think we can handle multiple things at once :D
myaocat: this may be faster https://www.nbcnews.com/health/health-news/fda-working-treatment-coronavirus-blood-recovered-patients-n1165231
keith282: i put all my ooin into chainlink XD
keith282: coin*
mutrx: @THX1342 not when the labs themselves are being closed, at least that's happening at my facility
thisuserisdeleted: i think if we all pray for america together at the same time that praying power concentrated on only one place will cure it. so we can do that for every country
samthedogg: bitcoin is going to recover after the halvening in May
DecayingSkullz: maybe you sent it to a BCH address instead of BTC
samthedogg: @DecayingSkullz nope
KnollBoss: @mutrx how did u find this stream sir
yevheniiushtyk: @georgehotz u gotta refresh the page
Lugueiro: @samthedogg ohh yeeahh
Nithron: omg 1 BTC
FastCashCoding: yea we still headed up
FastCashCoding: bullish AF
3ygun: Remember when Ethereum was worth something
KnollBoss: VITALIK
KnollBoss: crash it
PiroFloydian: i think if we all pray for america together at the same time that praying power concentrated on only one place will cure it. so we can do that for every country
YoungScootah: @georgehotz do you have any advice for a computer science student who wants to be a software engineer?
KnollBoss: @YoungScootah usually boils down to gain skills and code
mutrx: @KnollBoss i watched his vods on youtube and followed his stream on twitch
thisuserisdeleted: Christian viral healing bois
JakobJayJohnson: George looks like he's doing bodybuilding.
keith282: @YoungScootah if you want to become a software engineer then engineer softeare
KnollBoss: interesting
peter35_: you think ada/cardano is going anywhere?
mutrx: confirmed 20$ scammed
THX1342: lightning network?
l1ght5p33d: watch all geohot streams... strive to be a fraction of the leetness
FastCashCoding: fuck... if its confusing for geohot we got problems on mass adoption
FastCashCoding: its a segwit address
YoungScootah: @keith282 4Head
yevheniiushtyk: @georgehotz it's a segwit addres, refresh the page
sidthescikid: We're still doing the payment? I thought Bitcoin was fast...
Abnico: its a bep32 adress
Abnico: adress
samthedogg: @georgehotz itsa BECH32 address
Abnico: address
thisuserisdeleted: BETCH 32?
localcanofdutchgold: @YoungScootah switch all software design classes with math classes
FastCashCoding: not*
Abnico: https://ibb.co/1TpCsd0
YoungScootah: @localcanofdutchgold Sounds like a trap lol
Hawklite: btc can take up to an hour or two it's slow af
myaocat: https://www.nbcnews.com/health/health-news/fda-working-treatment-coronavirus-blood-recovered-patients-n1165231
im_drew_: george your the man bro!
axlebear: Yoink
localcanofdutchgold: @YoungScootah opposite, just don't know yet
YoungScootah: @localcanofdutchgold Explain please
Abnico: Bech32
saeveritt: Time for a bitcoin stream. Make an asset protocol for Bitcoin Cash where the data is nested in OP_RETURN
JakobJayJohnson: It Was At This Moment That GEORGE Knew He Fucked Up.
yevheniiushtyk: @georgehotz should have arrived regardless
thisuserisdeleted: time to juice up the recovered patients
Nussinov: @myaocat vampires
yevheniiushtyk: @georgehotz if you scanned the qr code
Lugueiro: @georgehotz segwit native (bech32)
Emanuell45: noo
NuHaru: dont worrz george i got zour bcoin man
williamjennings1: so many tabs.
Mariosavitch: i learned a lot thanks mr hotz
l1ght5p33d: BEST STREAM NOVEL BIOHACK 2020
youngmarsh: damn I'm late
DSykes_: hmmm yes
Lugueiro: yess
FastCashCoding: brian armstrong @georgehotz
yevheniiushtyk: @georgehotz part 3 when?
ahahahaitslit: the portal
KnollBoss: @georgehotz how many hours of leisure per day do u think is necessary
THX1342: if anyone has 3D printers, you can help out https://blog.prusaprinters.org/from-design-to-mass-3d-printing-of-medical-shields-in-three-days in my town were printing 320 and giving it to hospitals
Pin__top: i member
thisuserisdeleted: i learned quite a lot man now i know a cure is on the way for sure by next month plz
pistolpetepcp: I sent my $5 I don't see it yet
CompestLive: How much was it?
JakobJayJohnson: Great stream, great 20 Dollars scam
Abnico: @georgehotz relevant meme https://ibb.co/1TpCsd0
DecayingSkullz: gn
o______________________k: !claim
Lugueiro: 1m2019.com
ahahahaitslit: u listen to the portal?
firmstool: How close are you to finding a cure? PepeLaugh
dorkmo: choo choooo
Lana_Lux: good night!
imopfloors: gn
hitmanhax: !claim
l1ght5p33d: Lets do bio startup
PiroFloydian: gonna stream more soon?
edu4594: gonna stream tomorrow?
thisuserisdeleted: i had some summer plans so ideally if the cure could be delivered by april 1st would be grand
mutrx: 3 minute q&amp;a?
hefty_sum: 10 push ups
localcanofdutchgold: @YoungScootah software design is meh in terms of ideas
ad5k: Later
nitcat: night man, thanks for the stream, learned a shit ton of new stuff alongside you
georgehotz: https://www.instagram.com/georgehotz/
CompestLive: How much did you lose?
KnollBoss: 3 minute qna
Mariosavitch: IG is for women
KnollBoss: sir
KnollBoss: only 3
Abnico: https://ibb.co/1TpCsd0
DecayingSkullz: 1m2019.com
ghu90: https://plnkr.co/edit/TNuAIB1mFn01O1tG6KtM?preview
keith282: HOW ARE YOU NOT VERIFIED ON IG YET
keith282: WTF
thisuserisdeleted: april 1st we found the cure!! sych
sidthescikid: sidthescikid subscribed with Twitch Prime.
elektroids: ty
DecayingSkullz: #verifygeohot
mutrx: end of stream q and a?
mik12f4: do more videos please
Ne0Zer0: o/
sillybaboy: facebook is an illness
PiroFloydian: well fb is shit so
pistolpetepcp: Tik-tok
Tsoding: VoHiYo
AleexM: george u da man
inciMage: any audiophile here on chat i need headphone rec
un3okapi: @georgehotz what are your thoughts on black women
ahahahaitslit: do you listen to the portal podcast @georgehotz
Iknowyou123456789: tensorflow or pytorch @georgehotz
djcows: easiest way to get rich as fuck?
sidthescikid: Good stream &lt;3
mutrx: have you been tempted to make an algo for trading?
360Plato: wouldnt trust you if you had a blue check
DecayingSkullz: what does 2021 hold
myaocat: #BlueVforGeohot
lsfa: How to get past coders block?
edu4594: streamm tomorrow?
williamjennings1: do you sleep in your kitchen?
JakobJayJohnson: How big is your diaaack?
Nussinov: @georgehotz cya! keep reading and learning! thank you for the stream! :)
dj_vicio: fucking cancer
thisuserisdeleted: 2021 will be more of the same thing
Pin__top: what ever happened to that waffle maker
PiroFloydian: @georgehotz what are your reasons doing anything?
dj_vicio: say it
thisuserisdeleted: quarantine 4 lyfe
Abnico: bro check my meme otherwise i suicide https://ibb.co/1TpCsd0
NuHaru: im a computer science major, should i do bioinformatics @georgehotz ?
KnollBoss: @georgehotz if ur not doing stem should you switch subjects
yevheniiushtyk: @georgehotz tik tok is for the younger generation lmao
CompestLive: How tall are you?
DecayingSkullz: What book are you currently reading?
samthedogg: @georgehotz what do you thing about the NEAT algorithm
ahahahaitslit: do you listen to the portal podcast
saixj: delete tiktok that piece of garbage
Penguino138: Are you an Alex still dating?
kevin21071: TikTok has an algo that measures how good looking you are
dj_vicio: that's it? you quit?
aiis: Kreygasm Kreygasm Kreygasm Kreygasm Kreygasm
Pin__top: yay
ahahahaitslit: lmao
Ne0Zer0: every night PogChamp
PiroFloydian: fun
l1ght5p33d: SOLVE THE WORLD WITH PYTHON
saixj: yes pls do it ever night
hitmanhax: thanks homey
pistolpetepcp: lol tik-tok is like vine, not ideal
Hawklite: what time do you typically go live
Nussinov: @NuHaru read about it and see if you are interested. if you are interested, do it!
yevheniiushtyk: Pog
samthedogg: NeuroEvolution of Augmenting Topologies NEAT
Stegosaurian: !uptime
ghu90: i loved learning with you
THX1342: yep keep going
CompestLive: How tall are you?
myaocat: biology is like computer.. there is the theory and practical.
FastCashCoding: can we make alot of money @geo?
THX1342: gn
jay_al97: have you got a shell yet?
dj_vicio: what??? already?
saixj: it is a great learning experience
dongmuya: g'night!
highxsnow_: tiktok is a gay dating app
el_pirulote: i understood that i am retarded
Nussinov: clickbaiting that hard takes a lot of energy dont it
williamjennings1: its only 8pm
brittonx2: I'm really enjoying these! Thanks George!
ahahahaitslit: u gotta listen to the portal podcast george
mutrx: only 8pm LUL
JakobJayJohnson: What you think about Alex Jones?
YoungScootah: @georgehotz can you be my CS mentor ?
PiroFloydian: CmonBruh bedtime?
saeveritt: Yo lets DDOS Bitcoin Core Nodes by abusing OP Codes in the Scriptsig
Newlax: @georgehotz why don't you use linux?
williamjennings1: what time do you wake up?
dj_vicio: @georgehotz you doing the 24-hr stream challenge?
hefty_sum: sleeb well
KnollBoss: slee
KnollBoss: p
Ne0Zer0: tomorrow we won't pretend to reverse engineer corona PogChamp
NuHaru: yes!
CompestLive: Yes! How tall are you?
dj_vicio: NO
Wireballz: @georgehotz do you think virus is man made ??
gabo_sk: yeah
sidthescikid: PogChamp
DecayingSkullz: yes pls do that
mutrx: what would we do as emotes?
yevheniiushtyk: PogChamp more streams means more knowledge and more fun PogChamp
l1ght5p33d: we would run out of proplems to solve
Ne0Zer0: LUL
Pin__top: yas queen
Alwaysidle_: where would you recommend to learn python?
ad5k: tea emote
gabo_sk: PogChamp
eaterenrgy: zentrePOG
GTozzi: Is there a place I can private message you? I run a non-profit relating to tech law and would like to her your perspective if interested. Smile face @georgehotz
Nussinov: becoming a twitch partner would be a DREAM COME TRUE Kappa
wootawee: FFS the virus is not man made, sigh
dongmuya: Hotz goal is to buy a yacht he said so on lex freiman
zol0: leaving? hope you made enough money off of this cickbait scam Kappa
AleexM: Just say no to corona guys, it can't enter your body without permission
pedrovictortech: Do it @georgehotz
lsfa: How to get past coders block?
Mariosavitch: lol
dorkmo: is work open in california?
0R4NG3: lol
pistolpetepcp: Same here, i'll be here everyday bro
Newlax: why don't you use linux?
ahahahaitslit: Do you listen to any podcasts
ghu90: lul
Iknowyou123456789: pytorch or tensorflow @georgehotz ?
360Plato: hackerrank bro
KnollBoss: @georgehotz how easy is it to get rich
jmp0ut: how do you know it's not manmade
edu4594: miss backspace.ai
williamjennings1: meditation stream?
Ne0Zer0: corona no coroning
Pin__top: some places its open
dj_vicio: just say it louder to Corona. She'll understand eventually.
jmp0ut: i heard china was testing broad spectrum antivirals last year
l1ght5p33d: the journey is the destination
mutrx: algo trading
myaocat: how long do you think it will takes to hack the brain?
sidthescikid: don't say it!
NuHaru: making roblox maps
Pin__top: be a full time streamer
KnollBoss: thank u sir i am renowned for my dumb questions
Jehhred: sell drugs. easy money
cankunwang: Short the market now
THX1342: hacking a bank
Mariosavitch: start a "Reverse engineer corona" stream
yevheniiushtyk: a lot of money
rgbeezus: stock options
saeveritt: algo trading
Crayonsss: Bitcoin couple years ago LUL
0R4NG3: hack crypto exchange
dr_set: Crypto scams?
Iknowyou123456789: pytorch or tensorflow @georgehotz
THX1342: algo trading is a fast way to get poor
djcows: like 5 million
mutrx: visit r/wallstreetbets to get rich @georgehotz
pistolpetepcp: Ask for money
Newlax: @georgehotz moneyz
sillybaboy: commiefornia
williamjennings1: millionaire.
Pin__top: rich spiritually
saeveritt: CoronaCoin
JakobJayJohnson: Would you work for google if they contact you?
AleexM: easiest way to become rich? Be super rich and donate to biohackers
ghu90: founding funeral ompany
DecayingSkullz: What is your perspective on neuralink
samthedogg: Most of getting rich is about having alot of charisma to bs people
KnollBoss: @georgehotz independently wealthy enough to not have to work daily
l1ght5p33d: extracting money from the economy should not be the goal
cankunwang: Look at Vix
sidthescikid: @samthedogg True
Nussinov: can you make a myfreecams stream called engineering a reverse coronagirl
saeveritt: CoronaCoin ICO soon
jmp0ut: financial stability involves selling packaged sawdust to refugee camps via UNESCO
keith282: if you want to be rich, make your own crypto
raystriker98: opinion on rust
samthedogg: you still shittin on waymo?
Jehhred: What company would you work for then??!?!?!?!??!
dj_vicio: was the NSA On the phone earlier telling you to "shut it" and then reprogrammed you with meditation?
djcows: ferrari as a daily driver and a house in the hills
archer723: Any chances we can do another $10 for the song stuff, really miss that, bro
boneitis: didn't he work for project zero for a time? :P
saeveritt: Have you seen those Crypto with useful Proof of Work? You could make one for simulating protein structures probably in a provable way
360Plato: 750k is fuck you money
NuHaru: is bioinformatics the future @georgehotz
pistolpetepcp: If god could ask you for money, you could too
mutrx: @georgehotz easiest way to get rich is to be born into a wealthy family
pjayys77: Why do you say no way in hell for working at google @georgehotz
scarbromangler: would you rather get corona or genital herpes
l1ght5p33d: kitchen is so nice
firmstool: Why would you not work for Google or deepmind?
AleexM: LUL
sillybaboy: @saeveritt the antibodies are your private keys
sidthescikid: @mutrx Key word: get
saeveritt: @sillybaboy let's do it
Nussinov: im 80 and ive been working at mcdonalds for 60 years im now a millinoaire AMA
JakobJayJohnson: Do you ever dreamed of sucking your own diiaaaack on the beach in winter?
KnollBoss: yeah the game just seems so bad
Digital_donger: @firmstool culture I think
jmp0ut: if you're a babyraping UN peacekeeper then raping a haitian woman and paying her in food scraps for sex to feed her baby means you're richer than her
saeveritt: Have you seen those Crypto with useful Proof of Work? You could make one for simulating protein structures probably in a provable way
Iknowyou123456789: Why no to google?
Emanuell45: @georgehotz what would you do, if you werent streaming ?
ahahahaitslit: u listen to any podcasts tho?
DecayingSkullz: Do you follow first principles way of thinking
Emmaralds: are you rich george?
williamjennings1: lol
iKanak_: @georgehotz ever consider playing CTF again?
myaocat: How long do you think we will be on isolation?
sunole: You are a researcherand not developer??????
360Plato: working on contract in faraway places is "easy"
Emanuell45: @georgehotz what would you do, if you werent streaming ?..
sillybaboy: your dono is still not there
jmp0ut: real news
CompestLive: How tall are you?
djcows: do you think net worths on the internet are genrally lower or higher than the people's true net worth?
firmstool: Why would you not work for deepmind?
dj_vicio: where you work at @georgehotz
ahahahaitslit: podcasts?
yevheniiushtyk: do you need college to be good? NotLikeThis
pistolpetepcp: Oh I got it: Ask for money, in return for services
sidthescikid: monkaS
Crayonsss: could you get rich illegaly if u wanted?
magicallyphysically: Imagine if Rich People are feeling overwhelmed at this point in time?? Imagine how the poor Lower Class and Middle class are dealing with this. This is some bullshit.
esence: why don't you want to work for Facebook?
saeveritt: Useful Proof of Work == Protein Structure SImulation
Stegosaurian: How many people do you estimate COVID-19 is gonna end up killing? And what do you think it's economical impact will be?
l1ght5p33d: meta principals way of thinking only obviously
Iknowyou123456789: Virus would go away if it turns warmer right @georgehotz ?
cankunwang: Do you lost in stock market?
CompestLive: How tall are you?
sidthescikid: You need poor people to get rich people
samthedogg: is a straw bent in half 1 holes or 2 holes?
esence: @georgehotz do you watch TechLead?
jmp0ut: @georgehotz come to the canadian shield with me to build a particle beam from the asthenosphere to the vanallen belt so we can make the small arms dealers stfu and world peace for deep space engineerring
ahahahaitslit: podcasts?
PiroFloydian: @georgehotz what are you reasons for doing anything?
almonte550: When is this crisis going to end?
THX1342: lies... virus is well in south america
xPolarDreamz: Do you think is the end?
myaocat: Is coronavirus changed the world? would we change the way education system works?
Emanuell45: @esence i was going to ask the same thing lol
ak0ya_: what do you read every day?
YoungScootah: @georgehotz you remind me of Martin shkreli
sillybaboy: @Stegosaurian the economical impact will kill way more people than the virus
Pin__top: how many people will gain from corona virus
magicallyphysically: Yes exactly every class SUPPORTS eachother.
un3okapi: @georgehotz how do you fit a square peg into a round hole?
ColdZer0o: @georgehotz what happened to your VR headset
magicallyphysically: You need every class to cooperate.
Iknowyou123456789: When is your IPO? @georgehotz
nitcat: lmao what a question
firmstool: Why did you say you would never work for Google?
zol0: 2 holes confirmed Kreygasm
boneitis: toilet paper hang over or under?
jmp0ut: i got planets to teraform
xPolarDreamz: Is this the end?
magicallyphysically: Yes this is the end.
hellonearthis: hope it brings in a UBI
lsfa: How to get past coders block?
magicallyphysically: End Times.
gill_bates_macrosoft: hey @georgehotz can you do something like the cryptopals challenge
NuHaru: its 1 hole watch vsauce
ahahahaitslit: podcasts?
ghu90: dont be extreme
Nussinov: @georgehotz MUST ANSWER THIS QUESTION MY LIFE DEPENDS ON IT https://embed.gyazo.com/611a66d1dfd1dc187ab289c302b6bba9.png
dj_vicio: where you work @georgehotz ?
PiroFloydian: thats the stupidest take ive heard in a while
360Plato: put it one
pjayys77: think there was a study that a combination of warmth   humidity not just warmth might effect the spread of the virus
ghu90: its just a virus
djcows: LUL
CompestLive: How tall are you?
dj_vicio: another aderall? damn
ahahahaitslit: lmfao
zol0: over PogChamp
hitmanhax: pro play
dorkmo: make bet on date of 1 million infected
magicallyphysically: I have used 1 roll of Toilet Paper in `one month EVERYONE IS STUPID
magicallyphysically: ...
Jehhred: Would you rather be the worlds best racquetball player or receive $70.00?????!?!?!!?
samthedogg: if you go to college for an art degree.....enjoy poverty
roystang: tabception
boneitis: i'm floored that you had to check that. thanks for the response geohot
bfgz: if your TP hangs under youre a mutant
THX1342: @georgehotz is Idiocracy a documentary or a comedy?
dr_set: can we get more Hack The Box some time? That was fun.
Not_Saercy: What is something you would like to work on but can't?
keith282: @dorkmo april 3
ahahahaitslit: you listen to any podcasts?
zol0: LUL
360Plato: can you engineer a better adderal after this is over
Ne0Zer0: LUL
Hawklite: why should we care about prolonging humanity?
Morality: lul
PiroFloydian: LMAO
Lana_Lux: LUL
mutrx: LUL
almonte550: When is this coronavirus crisis ending? weeks or months?
saeveritt: Whens the next track dropping
eaterenrgy: zentreKEK
PiroFloydian: @georgehotz what are your reasons for doing anything?
Emmaralds: whos the most famous person uve met?
xPolarDreamz: How much money does it cost for a vaccine for corona?
ahahahaitslit: u listen to any podcasts?
myaocat: Can you hack recaptcha? Kappa
l1ght5p33d: covmap &gt; nmap
JakobJayJohnson: Are you 6 foot 2?
sidthescikid: @georgehotz What classes did you take in college?
magicallyphysically: Cool
Nussinov: dogs are having a great time these past months, everyone working from home and walking their dogs more often
ehisoka: tomcr00se?
esence: dog in China. GULP
lsfa: How to get past coders block?
Newlax: @georgehotz If humans lost the ability to sneeze, how long would it take for us to realize?
dj_vicio: where you work?
vrooom_vroooooom: how did you meet kanye
KnollBoss: @georgehotz what fields do you see a big future in (like if you did computer science 20 years ago)
yevheniiushtyk: Ye PogChamp
happypuppppy: you met the lyrical genius of our generation PogChamp
Stegosaurian: Do you have enough food stockpiled in case your city gets put on lockdown?
cankunwang: Cat or dog?
ColdZer0o: @georgehotz what happened to your VR revolution
pistolpetepcp: Night, I gotta work also, but in the same place i am at now
sillybaboy: dono still not there hotz
ahahahaitslit: u listen to any podcasts?
magicallyphysically: Everyone just needs to clean up there act.
jmp0ut: deep space engineering is where it's at my guy
magicallyphysically: Easy clap.
ehisoka: https://www.youtube.com/watch?v=_Yhyp-_hX2s
mik12f4: any family still in your hometown?
adamdavis1211: did you say computer science is the future. couldnt here
Crayonsss: how much bigger then the statistics do you think the virus is? and how long before the reported "first infected" in each country do you think the virus actually came? i had the flu 1 week before the craze and i just wonder.. what if
jmp0ut: money is a scam
mutrx: does size matter..asking for a friend
xPolarDreamz: India is the cause
buckkets_: Whats sectors do you think will go permanently remote because of this?
jmp0ut: humanity held hostage for charity
myaocat: money
DecayingSkullz: Do you miss NJ
almonte550: @georgehotz How long will it take until this coronavirus crisis pass away?
pwnbase: @georgehotz would you take funding from YC?
PiroFloydian: Money
Emmaralds: will u have fully self driving b4 tesla?
axlebear: What is your overall life philosophy
saeveritt: My mom's on tiktok
magicallyphysically: Well I ask you this @georgehotz How many lives have been lost to Cancer?
bufferovrflw: I kid you not, he turns himself into a pickle, he calls himself “Pickle Rick”, funniest shit I’ve ever seen
PiroFloydian: thats a pretty simple question
JakobJayJohnson: Would you work for SONY if they contact you?
yevheniiushtyk: neuralink when?
criiscarpenter: !uptime
jmp0ut: aaron shwartz died to those intellectual property racketeers
nikudino: 2.5
cromed56: !uptime
pjayys77: what movie are we headed to World War Z , I am Legend ?
Digital_donger: think we'll see humans on mars in our lifetime?
karnbirr: What drives your work ethic?
360Plato: people will realize college is just a rubber stamp?
hitmanhax: pork roll or taylor ham?
magicallyphysically: Hmm
ahahahaitslit: lmfao
dj_vicio: even a childs life?
jmp0ut: all the post secondary institutions just hold published IP's on a shelf and does not use it
magicallyphysically: I doubt Humanity.
samthedogg: starlink?
ipo___: Hey Gutz, hows progress?
Nussinov: one life is worth around 700 dollars isnt it
magicallyphysically: At this point in time.
ColdZer0o: level 5 autonomy or deep space travel
Emanuell45: @360Plato college is not a rubber stamp lol
nremind: thoughts on UBI?
Sniky83: https://foldingathome.org/about/
jmp0ut: like smart traffic lights, published in university, bought out by property trolls and 3M corporation and never used
666bingbong666: @georgehotz looking for SWE interns?
Newlax: u should start a company to cure corona
l1ght5p33d: we want AI folding on the GPU's
CompestLive: How tall are you?
saeveritt: Do you listen to lofi
8bitben: how much should the stimulus check be?
yevheniiushtyk: D:
Pin__top: D:
xPolarDreamz: People bought slaves for 1000s
5_betbluff: NJ represent
Emmaralds: whats your IQ?
Emanuell45: 150 
Nussinov: traffic lights that can solve differntial equations
samthedogg: UBI will raise the cost of everything so $1000/mo is the new $0
Hawklite: how is a person being born now a negative value to society when it requires people being born now to keep society going?
tj_rl: Do you allow WFH ;) I'll apply
JakobJayJohnson: Do you watched Paris Hiltons porn?
dj_vicio: where do you work / WFH?
jmp0ut: waiting on consulproject to replace politicians
jmp0ut: archaic shit
saeveritt: Check out Will Smith's new lofi playlist on youtube. It actually slaps
Stegosaurian: If there is a socio-economic collapse and the internet is shut down. What will you do?
CompestLive: Do you know what hackfourms is?
360Plato: Is IoT bullshit buzzword or real field
lebop: what are your suggestions to learn things fast?
mutrx: traffic lights that you connect to via bluetooth
ghu90: sadly it depends on where it is born
CompestLive: Do you know what hackfourms is and if so have you been a member?
ipo___: Have u met zuckerberg?
tj_rl: 100% agree
dj_vicio: jewckenberg
sidthescikid: @georgehotz UBI is a scam, 3.2 trillion in spending
l1ght5p33d: wellfare has benefits but diminishing return
yevheniiushtyk: What are you looking forward to?
lebop: what are your suggestions to learn things fast like you do?
pedrovictortech: pizza with or without pineapples
williamjennings1: can you make autopilot hack the traffic lights to turn green and never have to have a stop light again
Jehhred: Have you met zoidberg, I mean, zuckerberg?
myaocat: can we make a model immune system of human body to make a potential vaccine?
mik12f4: What are your thoughts on limiting how many kids people have???
brownyyyylocks: why are there no women engineers at comma?
5_betbluff: you ever play poker?
CompestLive: Do you know what hackfourms is and if so have you been a member?
Pin__top: the zuck!
DecayingSkullz: have you met Elon
mutrx: @brownyyyylocks there are
pec_adillo: jeeze chat so many questions
lsfa: Who is the richest person you've met?
8bitben: when will Openpilot support volkswagen
zol0: @georgehotz which TTS voice does zuckerburg have when he talks?
AleexM: best book you ever read?
sidthescikid: @DecayingSkullz Yup.
Pin__top: he met elon, he was in contract with him
StevenTalking: !followage
jmp0ut: forget wage slave problems, look at the the depopulation problem of the western civilization, we literally need 14 wives with 3 babies each male just to keep up with the silver tsunami of dying pensioners to move the economy forward rolling
magicallyphysically: Instead of making Toilet Paper.. make more Money Maker
tj_rl: At least UBI gives the individual freedom to spend the money. As opposed to welfare programs that control and supervise the use of money
im_drew_: favorite movie?
Emanuell45: people are not having kids anyway
pogu: Isn't elon musk the most famous person lol? He has 3rd biggest following on twitter
pjayys77: have you met Hackerman
360Plato: IQ means test to have kids lul
KnollBoss: Pog
Stegosaurian: What TV shows are you watching?
imperiex: are you doing ok on toilet paper?
Michaeltth: lol
lsfa: Who is the richest person you've met?
Hawklite: how is a person being born now a negative value to society when it requires people being born now to keep society going?
KnollBoss: Geohot anti discrimination
Emanuell45: @pogu bulllshitt. no way
StevenTalking: what are you working on right now??????????????????? long time follower first time chatter uwu
AleexM: Pog
ipo___: This person is rich so im not gonna hire them
jmp0ut: like what kind of actuary says yes open a business in the u.s. where babies arent being born and the wealth is stuck in the funeral home
Emmaralds: any cool stories with rich/famous people?
brownyyyylocks: fine my dream job is biz dev at comma anyway
xPolarDreamz: Where is the end?
sidthescikid: I never said welfare is good, the poverty cycle removes the incentive for people to work if they take away benefits
lsfa: How did you meet Zucker?
Newlax: are you a myth?
PiroFloydian: sounds like eugenics!
Stegosaurian: What are your top 3 favorite books of all time?
jmp0ut: nuclear family = nuked family
saeveritt: Where's that MATH hat I saw on instagram
iKanak_: @georgehotz what keyb0ard key are you going to name your biotech startup after?
almonte550: @georgehotz If this coronavirus crisis goes on until end of this year, how is this affecting comma ai?
Iknowyou123456789: future of bitcoin? @georgehotz
pjayys77: are we living in a simulation
Major_Spicy: @georgehotz you back to regualr streaming? Pog
kubaaa6: At all the companies you did work for what one was ur favorite
JakobJayJohnson: Do you watched MR ROBOT?
lsfa: What did you do at Facebook?
Emanuell45: @Stegosaurian he doesnt read bro
DecayingSkullz: Do you think going to Mars would be productive
Iknowyou123456789: what is the future of bitcoin? @georgehotz
Nussinov: @georgehotz whats your favourite book
pwnbase: @georgehotz what did you think of the silicon valley finale
Emanuell45: @georgehotz favourite tv shows?
Maagicbr: what are u doing?
jmp0ut: in Canada our birth rate is going to 0.48 by 2050
Jehhred: You going to stream hackerrank soon??
jmp0ut: wtf is that
magicallyphysically: Mars is not an option o.o
5_betbluff: lol
astrailz: Which year do you think mankind will land on Mars? @georgehotz
Newlax: Why are you a part of my simulation?
8bitben: why did bitcoin go lower when stocks went lower too?
hitmanhax: PogChamp 100k
im_drew_: 100k confirmed
keith282: 100 thousand? its going to a million!
myaocat: i saw your video in youtube that you was in facebook hackathon..
Emmaralds: you worked on the facebook android launcher?
JakobJayJohnson: You chess elo ranking is?
dorkmo: oh I remember the facebook phone thing
5_betbluff: @8bitben cash is king in a recession
weedlord666: why should i care about anything at all
AzzoDio: do you watch Devs, great soundtrack
THX1342: thoughts on the fermi paradox?
l1ght5p33d: Cloud Llifee
ipo___: I already told 14 people that George hotz says it will go above 100k soon
lsfa: Best field of comp sci to get into right now?
keith282: @8bitben same reason, people liquidating assets
jmp0ut: how does the money move to less people expediently without turning everyone jibhead on stripper pole land
brownyyyylocks: 8bitben i have same question!!
williamjennings1: will you be having kids?
samthedogg: mathematically the stock-to-flow ratio (which BTC has followed with 99% accuracy) indicates a 98k bitcoin by December 2021
l1ght5p33d: we care because we want to
bob_babyelephant: what vim color scheme do you use
5_betbluff: You meant Bitcoin cash to 100k right?
tykabmo: @georgehotz Do you play Rocket League?
magicallyphysically: I'm working on my theory at the moment.
edu4594: yeah, what vim colorscheme do you use?
THX1342: yeah
magicallyphysically: Nearly complete
tj_rl: I second Rocket League :)
im_drew_: do you think that life is a simulation?
lsfa: The best field of comp sci to get into right now?
myaocat: what do you think about injecting chips to body?
Emanuell45: @georgehotz ever played league of legends?
8bitben: gold, btc, and stocks all went down together
jmp0ut: i wonder if martin schkreli is bankrolling cigarettes in jail rn
magicallyphysically: same here lol
lsfa: The best field of comp sci to get into right now?
AlexEDM: lol
magicallyphysically: I hate that game
Keyeh: changed github photo omg
Emmaralds: how smart do u think u are?
Ozonemaster: @georgehotz how do u have time to paly league
elon_musk__: LEAGUE OF OMEGALULS
FastCashCoding: yea bch for real
bufferovrflw: What are the qualities of a person you look for?
magicallyphysically: Injecting Nano-Chips?
YoungScootah: Shkreli is the man
Newlax: Why are you a part of my simulation?
Jehhred: You ever waste your time playing runescape?
l1ght5p33d: play with AI, gain all wins
xeroeffect: Do you still use 2 fingers to drive?
KnollBoss: @georgehotz is emailing you a good idea or is that business only
Pin__top: starred
C4TFive: all the windows on your screen give me anxiety
360Plato: low spatial high logic iq?'
jmp0ut: i learned inuktitut syllabics in 20 mins, small things to stop civilization destruction
5_betbluff: just got here, any short explanation on what you've done with corona?
jmp0ut: easier than english
Liz3DE: ever tried emacs?
KnollBoss: i will try not to
ipo___: George u rich??
KnollBoss: but i can not make any gaurantees
nurbscrv: @georgehotz TRUE or FALSE? 🍑💨🦠 COVID-19 is transmissible via flatulence. PLEASE EXPLAIN YOUR ANSWER.
magicallyphysically: Time Loop is almost at the end
magicallyphysically: :(
brownyyyylocks: how is comma10k used by segnets? i made 2 PRs!!
AlexEDM: starred
adamcernycz: Stars hype train! Kappa
yevheniiushtyk: Spaces or Tabs?
Michaeltth: D:
Pin__top: sstvMisc
myaocat: Would you drink a batsoup for million dollars?
nitcat: LOL
C4TFive: speak for yourself
Ne0Zer0: a github star isnt much, but its honest work SeemsGood
8bitben: PyCharm or VS Code
Nussinov: dump your COVID load in my mouth
l1ght5p33d: i need to see the p values
elon_musk__: TREW
Maagicbr: XD
brittonx2: hahahaha
lsfa: The best field of comp sci to get into right now?
jmp0ut: glycoproteins from fartbomber
almonte550: @georgehotz so farts are better than coughs?
YoungScootah: Do you drink energy drinks ?
keith282: @8bitben vim
pjayys77: great anatomical term, asshole
THX1342: that was too precise for a bio paper
saeveritt: How do you feel about golang
360Plato: aight imout
AlexEDM: ask and thee shall receive
Newlax: Why are you a part of my simulation?
lubold: how is the fermi paradox monte carlo paper called @georgehotz
bufferovrflw: CAN WE GET CORONA TRENDING ON GITHUB
GTozzi: The only reason I asked about private messaging you was because twitch a limited forum to talk about the intersection constitutional law and contemporary technology
8bitben: vim vs. nano
GTozzi: but I need ot update my website anyway
mutrx: what scares you the most? @georgehotz
myaocat: Would you drink a batsoup for 10 dollars?
solitarynative: nim?
Sky_Light_37: anal is the cure
djcows: Thoughts on WallStreetBets?
nitcat: LOL IQ OF 130
CompestLive: Have you heard of hackforums and have you used it before?
l1ght5p33d: i only read and write assembly
adamdavis1211: what is your iq george
Emanuell45: everyone has an iq of 130 lol
im_drew_: What is the possibility that life is a simulation?
8bitben: do you vape tho
xPolarDreamz: what is the iq to code in python
scarbromangler: would u rather get coronavirus or genital herpes in your lungs
DecayingSkullz: VScode vs VIM?
Keyeh: D:
samthedogg: @georgehotz are A.I trading bots legitty or shitty?
peter35_: same bro FeelsBadMan
Nussinov: xPolarDreamz 85
AlexEDM: love the profile picture on github
KnollBoss: as a kid which books did you read @georgehotz
yevheniiushtyk: Even tried CBD?
xeroeffect: Do you believe in magic?
666bingbong666: @georgehotz do you sponsor interns?
Couchmann941: how is your life going in general?
jmp0ut: know how i cured my stimulant needs for narcolepsy, training my dopamine receptors with noopept   citicoline
lsfa: Most lucrative field of comp sci right now?
C4TFive: your github profile looks mean AF
THX1342: man the descriptions from the frontlines are scary af.... people neeeding to be tied up...
weedlord666: you know about joe exotic?
icanthitthose: do you need a high iq to be a good programmer
Liz3DE: ever tried emacs?
CompestLive: Have you smoked weed before
FoxMcWeezer: If you were rehired at Facebook, what level Software Engineer would you be?
Emanuell45: i mean everyone interested in computer science generally have an iq of 125 or higher
saeveritt: golang = small brain python = ?
CompestLive: Have you smoked weed before?
Krissam: Genital herpes in your lungs is the easy pick
C4TFive: sponsor sounds like out of country
mutrx: @Emanuell45 mine is well below 60
AlexEDM: LOL
jmp0ut: citicoline and noopept is the best stack for add/adhd issues that i've found
dorkmo: tiger kinggg
llIIIIIllIlII: damn he looks edgy in that picture
tj_rl: Would you rather discover aliens or the corona virus antidote?
jmp0ut: i went superhuman
xPolarDreamz: are u still hiring for comma?
AlexEDM: the fact that you remember Buck Angel
yevheniiushtyk: lmao
Emanuell45: @mutrx calling bullshit on that
THX1342: georgehotz have you hired anyone that switched careers into coding?
homestarr: lets go over t cell flow cytometry data :)
smarttties: it's the new Netflix show
localcanofdutchgold: @Emanuell45 doubt it
CompestLive: Have you smoked weed before? lmao
CompestLive: Have you smoked weed before?
KnollBoss: what books would you recommend reading @georgehotz
almonte550: @Emanuell45 125 in computer science is the new 100
lsfa: Most lucrative field of comp sci right now?
hordead: so did you crack the code?
pedrovictortech: @georgehotz Opinion on Serverless?
magicallyphysically: Kappa
magicallyphysically: Never smoked
Nussinov: Kappa
sidthescikid: Kappa
Keyeh: Kappa
lsfa: The best field of comp sci to get into right now?
barbadose: @emanuell45 true..l1
Emanuell45: @almonte550 trueeeeeeeeeeeeeeee
ahahahaitslit: nobody has read infinite jest
PiroFloydian: dont believe that for a second LUL
ipo___: insane, never smoked weed
Pin__top: those dank kush
saeveritt: Book: Holographic Universe
magicallyphysically: Sure Kappa
sk84uhlivin: The Last Question :D
jmp0ut: hourk
KnollBoss: David foster wallace
samthedogg: @georgehotz have you read 48 Laws of Power?
axlebear: Kappa
weedlord666: why does everyone care about your opinion on trivial things like your editor of choice
KnollBoss: ....
dorkmo: tiger king on netflix
jmp0ut: HURK
Pin__top: infinite jest is so long
8bitben: could you create a DIY ventilator
pwnbase: have you finished the will to power yet
lsfa: The best field of comp sci to get into right now??
tornpaperyoyos: @georgehotz favorite weed strain?
bufferovrflw: Thoughts on transgender people - thoughts on substituting hormones in their body?
zol0: @georgehotz is minikeyvalue reliable enough?
myaocat: Does Folding@Home doing integrity check or someone can send fake data to cause millions of death?
Nussinov: good thing you said those last two books otherwise i woulda thought you were mentally a high schooler Kappa
Pin__top: robert greene!
icanthitthose: whats your iq?
PiroFloydian: fav food?
THX1342: admirable new world
lovelyhashbrowns: What do you think of the Nim programming language
Pin__top: human nature was great
Emanuell45: https://thetab.com/us/2017/04/10/which-major-has-highest-iq-64811
mutrx: when can i marry my anime waifu in VR @georgehotz
AzzoDio: atlas shrugged so boring, but infinite jest is great
nic0latesla: please sing "It Was Called the Cold"
jmp0ut: actually only fiction worth reading is the hackers manifesto
l1ght5p33d: everyone needs to read MATHEMATICAL AND COMPUTATIONAL PHYSICS FOR ENGINEERS
lsfa: The best field of comp sci to get into right now?
gill_bates_macrosoft: have you tried to use emacs @georgehotz
gamozo: gamozo subscribed at Tier 1. They've subscribed for 4 months! Heya
CompestLive: Do you have ADHD? lmaooo
jmp0ut: and maybe simulacra et simulation
xPolarDreamz: Thoughts on trump?
DarkEpopt: @jmp0ut how? :)
pwnbase: I swear Nietzsche founded RL with the will to power
brownyyyylocks: is mimetic desire stronger than reverse psychology?
jmp0ut: @DarkEpopt elaborate?
Liz3DE: i wanted to know more about the firefox 0day, but couldnt find anything useful
Iknowyou123456789: when is your IPO @georgehotz
FoxMcWeezer: If you were rehired at Facebook, what level Software Engineer would you be?
peter35_: clintSuave
Abnico: have you read Simulacra and Simulation?
Pin__top: the orange man
myaocat: Does Folding@Home doing integrity check or someone can send fake data to cause millions of death?
magicallyphysically: Trump is not fit for this situation.
Abnico: @georgehotz have u read Simulacra and Simulation
bufferovrflw: That's not an answer, lol
lsfa: The best field of comp sci to get into right now?
Nussinov: I nothing trump
CompestLive: Do you have ADHD? lmaooo
Pin__top: middle is the comfy zone
hitmanhax: haHAA
AlexEDM: that was a political answer to a political question
solitarynative: based centrist
fuddy12345: centrist KEKW
elektroids: fence rider
Abnico: the matrix is based on that
eaterenrgy: In the middle zentreCOMFY
ahahahaitslit: have you read anything by nassim taleb?
rndmsqnce: how do u date so many women
magicallyphysically: I would prefer not a jackass
jmp0ut: i noticed neo in the matrix holding simulacra years later was a whoa moment
magicallyphysically: :)
DarkEpopt: You said you helped your narcolepsy by dopamine training
lsfa: The best field of comp sci to get into right now??
axlebear: Favorite move?
scarbromangler: NIetzsche is post-modern
rstk1: favourite website?
l1ght5p33d: middle cloud
AlexEDM: how many women HAVE you dated?
Abnico: bri the matrix is based on it
samthedogg: Trump gets shit no matter what he does
AlexEDM: I must know :)
theonlymonkas: your eyes don't hurt with the white theme??
CompestLive: Do you have ADHD? lmaooo
solitarynative: have you tried nim-lang?
cankunwang: 35199 total cases in US
ahahahaitslit: black swan yeah
magicallyphysically: Whose the Black Swan!?!?
peter35_: yuval
lsfa: The best field of comp sci to get into right now?
dr_set: Harari
barestalk64: Favorite albums?
magicallyphysically: I keep bumping into the Black Swan everyday
magicallyphysically: Who are they?
l1ght5p33d: geohot has lain with many womens
PiroFloydian: bronze age mindset looks like some cryptofash stuff at first glance
yevheniiushtyk: @georgehotz your favorite movies?
AlexEDM: well.... been in a relationship with or 1 night stand? numbers? I'm a numbers guy
Emanuell45: lmao
myaocat: Why should i use folding@home if they will sell a vaccine for thousands of dollars? @georgehotz
THX1342: LUL
ahahahaitslit: lmfaoo
theonlymonkas: favorite albums?
williamjennings1: lololo
barestalk64: Thoughts on essays on pessimism?
jmp0ut: stims are garbage from doctors causing heart disease and dopamine problems
xPolarDreamz: have u ever coded in brainfuck?
jmp0ut: noopept is a lot cleaner
jmp0ut: same with citicoline
brownyyyylocks: mimetic desire stronger than reverse psych?
ak0ya_: Do you like to visit you parents?
seasamborn: seasamborn subscribed with Twitch Prime.
rstk1: favorite github project lately
sidthescikid: @georgehotz Where do you get most of your information/studies?
PiroFloydian: bernie's def not a communist but trump is pretty fashy in a lot of respects
lsfa: The best field of comp sci to get into right now?
Liz3DE: Have you ever tried emacs
williamjennings1: were you addicted to kratom?
cankunwang: Ideology makes ppl stupid
scarbromangler: How is Nietzsche not post-modern? The 'God is Dead' diatribe is basically a lament on the death of long-standing cultural assumptions and truths
nurbscrv: @georgehotz You neglected to toast your hamburger bun that one time. If you read postmodernism you would realize the irony of your condition.
almightykod: who is your favorite (most interesting) historical character?
hordead: George where is your college degree?
CompestLive: Let me get mod, I proivde great content in the chat kappa
Rovelo: 4Head just get some crystals if you're sick
yevheniiushtyk: github.com/trending
tj_rl: Pithy sayings make people stupid
pjayys77: can you even say there was ever a true communist country
saeveritt: youtube "Will Smith Lofi Playlist" and thank me later
ahahahaitslit: If you liked black swan by Taleb then check out antifragile, it's better
PiroFloydian: Nietzsche is more existential than post-modern
Anonymous835: Hi @georgehotz just joined how did you tackle the research ? Where did you start?
lsfa: The best field of comp sci to get into right now?
Newlax: SeemsGood
5cl0ck: sup, just got here, is this in the end? what happened to the DNA stuff?
myaocat: If you believe in science would you donate your body to science?
ar2zee: Do the apartment tour
jmp0ut: only reason they dont prescribe phenibut and noopept in the west is coz commies developed it yet as a stim noopept ameliorates myocardial infarction and transient ischemic attacks
peter35_: LUL
Rovelo: LUL
theonlymonkas: favorite song
Panda1Express: haha
karnbirr: Do you play video games?
Nussinov: LUL
FargioFarmani: I am really impressed by https://github.com/geohot/corona
CompestLive: Let me get mod, I provide great content in the chat kappa
nremind: you should switch to arch full time btw :P
magicallyphysically: OKAY DUDE
magicallyphysically: LOL
8bitben: why zsh?
AlexEDM: what's a typical in-office work week for you? how many hours? etc
cankunwang: When will you start stream tomorror
solitarynative: your mbti?
lsfa: Most exciting area right now in comp sci
pwnbase: com-mies is blocked by twitch as a hate word
l1ght5p33d: were livin right now bros
sidthescikid: @georgehotz Where do you find current studies/information?
magicallyphysically: Yes
ak0ya_: do you believe in marriage?
mutrx: are they all Will Smith songs?
Pin__top: looks like you got lots of new viewers after the break
KnollBoss: you're a cool guy, good night sir
yevheniiushtyk: How to not be a noob?
KnollBoss: sleep well
pogu: commies
samthedogg: @georgehotz who killed seth rich?
THX1342: what are options for a hacker do make money other than selling out cheap for bug bounties?
theonlymonkas: will you come back tomorrow?
naabee_: P????
theonlymonkas: favorite song
brownyyyylocks: same time tomoz
pogu: @pwnbase Jebaited
magicallyphysically: Thanks for doing this Stream @georgehotz very insightful and helpful LOL
Michaeltth: lmao
PiroFloydian: LUL
zol0: WTF
C4TFive: bel-air LUL
tj_rl: How many jumping jacks can you do?
magicallyphysically: And hilarious
VGBurnzy: lol
jmp0ut: @THX1342 peptide medicine, biohack yourself cheaper medications
ahahahaitslit: LOL
joivan: LMAO
mutrx: gib_money()
samthedogg: @georgehotz did you say Siraj?? the DIsgraced Ytber??
gamozo: Heh, kinda true
myaocat: How did human created?
PiroFloydian: sativa or indica @georgehotz
pwnbase: @pogu its blocked for me
gamozo: the world pours money into security right now, kinda silly
Nussinov: @georgehotz whats the longest you've ever stayed awake
ar2zee: how do you see development in 5 years ?
anotherkidnamedaustin: working during a global pandemic??
THX1342: I just wanted a rant over bug bounties LUL
tornpaperyoyos: There was siraj drama?
icanthitthose: @georgehotz can anyone be a good programmer?
frostism1: do you like Python 3?
r0xtehem0x: How do you stay motivated?
richfromoil: do you think that no alien civilization explores space because they invent sex bots first and stop trying?
l1ght5p33d: smol drama
treestompztv: BUY PUTS
pjayys77: bug bounties
sidthescikid: M OMEGALUL RGZ
pogu: @pwnbase "commie" completely works
magicallyphysically: LOL
C4TFive: this is cancer
xPolarDreamz: i lose brain cells when i watch morgz
tokumei64: dear god no please make it stop
Pin__top: oh gawd
julien9877: stop
CompestLive: What does dom backwords spell? Can I get it?
tornpaperyoyos: oh god i hate it
rgbeezus: 10k on a date lo
funwayz: @georgehotz do u still plan to drop streaming when it hits 1k?
Nussinov: FailFish
Emanuell45: @georgehotz what are your thoughts on doing illegal things, like using stolen credit cards of the net
mutrx: it sounds like satire
CompestLive: What does dom backwords spell? Can I get it? LMAo
Digital_donger: NotLikeThis
Stegosaurian: Why don't you work from home?
magicallyphysically: This is a shit show
mutrx: but it legit
CompestLive: What does dom backwords spell? Can I get it?
hordead: What is the saraj drama?
lsfa: He's gonna cure COVID-19
KnollBoss: this guy has more money than I will ever have @georgehotz
theonlymonkas: nice
8bitben: pizza or pasta
KnollBoss: morgz
homestarr: open source immunology data on immport (made by northrop grumman)
theonlymonkas: favorite album
pjayys77: ehhhh
KnollBoss: please save me from my sins
magicallyphysically: I need some weed
anotherkidnamedaustin: date during global pandemic?
PiroFloydian: sativa or indica? or cbd?
5cl0ck: Way too many cooks
Emanuell45: @georgehotz what are your thoughts on doing illegal things, like using stolen credit cards of the net...
Penguino138: Wont smoking weed make corona come get you?
tj_rl: What's your favorite question?
anotherkidnamedaustin: work during global pandemic?
edu4594: where do you work?
pjayys77: youtuber persona on full blast
jmp0ut: just to waste on a date wtf
magicallyphysically: I'm all out Herbal Weed
Liz3DE: ever tried emacs @georgehotz
magicallyphysically: :(
jmp0ut: while i struggle in my social housing unit all my life
mutrx: favorite adult swim skit?
CompestLive: If I find an exploit in comma website, can I get a job lmao
brownyyyylocks: @ 8bitben oh man pasta
homestarr: go to shared data
jmp0ut: the world must have a sick sense of humor :D
homestarr: theres a browser
0R4NG3: lol
CompestLive: If I find an exploit in comma.ai website, can I get a job lmao
mutrx: programming on a 10$ keyboard vs 10,0000$
THX1342: thoughts on phineas phisher?
xPolarDreamz: lol
FargioFarmani: My question: What century was the best to be alive in?
theonlymonkas: will you ever do a cooking streaming again?
Nussinov: you know these motherfuckers know data when they put a word cloud on their site
Iknowyou123456789: why do you use chromium instead of chrome @georgehotz ?
anotherkidnamedaustin: work during a global pandemic????
PiroFloydian: sativa or indica? or cbd? @georgehotz
Rovelo: Kreygasm holy pandas
jmp0ut: the 29th century was the best
mutrx: programming on a $10 keyboard vs $10,000 @georgehotz make it happen
lemonboxed: the best simulation science has achieved so far is animal crossing
tornpaperyoyos: Can I have a job?
magicallyphysically: @georgehotz Love that reference because both is kind of useless bag of dogshit and automobile
Emanuell45: @georgehotz what are your thoughts on doing illegal things, like using stolen credit cards of the net...
C4TFive: why are you using a mac NotLikeThis
8bitben: smarthome vs. dumbhome
yevheniiushtyk: We got corona in this century doe
lsfa: Is it worth getting into the field of hacking in 2020 or is it too saturated/over?
jmp0ut: from all of my time travelling days
jmp0ut: the 29th century was decent
theonlymonkas: can we get comma ai on Guatemala
tykabmo: @georgehotz what do you think of hackthebox?
anotherkidnamedaustin: weed is lit
Penguino138: @georgehotz You're smoking even with the threat of corona?
xkasper7: this guy doesn't even know what html is i bet
l1ght5p33d: actual leet hacking &gt;&gt; security
anotherkidnamedaustin: when u dont need to focus
lsfa: iIs it worth getting into the field of hacking in 2020 or is it too saturated/over?
TimoPuukka: !uptime
ghu90: clone humans?
naabee_: Kappa
firmstool: What's your beef with Google?
anotherkidnamedaustin: work during global pandemic?!
mutrx: how funny is rick and morty? the pickle part killed me LUL
yevheniiushtyk: Bud vaporizers are great
brownyyyylocks: 100 years we'd be picking cotton on his cotton farm glad its 2020
Penguino138: @georgehotz You're smoking even with the threat of SARS? lolol
myaocat: why is php still used?
sidthescikid: LUL Me 6 years ago
roystang: whats sad about gogle
nurbscrv: @georgehotz Please explain what a closure would be in the context of Lombardy.
jmp0ut: buy your octopamine from amazon, mainline the spider octopus adrenaline juices bruuuu
Stegosaurian: Why don't you work from home?
xPolarDreamz: inspect element hack
samthedogg: @georgehotz you every play around with Pixhawks?
theonlymonkas: favorite albums
lsfa: iIs it worth getting into the field of hacking in 2020 or is it too saturated/over?
Pin__top: have you stocked up on supplies
CompestLive: cout &lt;&lt; "Give mod" &lt;&lt; endl;
8bitben: wordpress
ar2zee: Can you recommend to aderall as a performance booster ?
icanthitthose: @georgehotz how often do you read?
HexaField: are you familiar with Eric Weinstein and his podcast? quite interesting discussions
Rovelo: 😂 👌 🔥 pickle riiiick
Lana_Lux: how many stars on github do you need to be truly happy?
yevheniiushtyk: favorite food?
anotherkidnamedaustin: indica = in da couch
jmp0ut: @ar2zee i recommend noopept   citicoline instead
PocketsKing: @georgehotz how much IQ i need to have to learn coding ?
anotherkidnamedaustin: sativa for life
sidthescikid: Italy is fucked change my mind
naabee_: Kappa
mutrx: @PocketsKing 0 can confirm
PiroFloydian: TRUE
ak0ya_: do you believe in free will?
saixj: so your compnay does not drug test
ahahahaitslit: please go on the portal
samthedogg: @georgehotz Were you going to AUVSI this year?
Penguino138: @georgehotz When do you realistically expect Corona to be under control?
THX1342: life is suffering
8bitben: pip or pip3
THX1342: LUL
Lamppostic: 90
pjayys77: when are you gonna debate Destiny
pec_adillo: 10 iq
scofflerr: Like Naval Ravikant?
theonlymonkas: do you have a podcast? or a favorite one?
C4TFive: like 17 iq at least
KnollBoss: this thx guy seems smart
5cl0ck: thinking you're better might be what kicks your ass outta bed
KnollBoss: mod him
brownyyyylocks: weinstein is thiel's man at his firm
ColdZer0o: @georgehotz do you still believe we're in a simulation
CompestLive: cout &lt;&lt; "Give mod" &lt;&lt; endl;
yevheniiushtyk: start that shit github.com/geohot/corona
solitarynative: 60iq masterrace
happypuppppy: 10000 github stars = nirvana
Rovelo: PogChamp
anotherkidnamedaustin: eric weinstein is lit
PiroFloydian: oh it is
Rovelo: destroy destiny PogChamp
Lana_Lux: @happypuppppy :)
AresRai: it is toxic
FargioFarmani: Are you afraid of dying? @georgehotz
iamquote: Thoughts on open science?
myaocat: Do you think Snowden is a russian spy?
xkasper7: you and him actually look like brothers
raystriker98: thoughts on lex fridman
tj_rl: I would really recommend Eric Weinstein's podcast. Especially episode #019
PiroFloydian: debate vaush! LUL
l1ght5p33d: I like being in the simulation it makes me happy
pjayys77: I needa be there for that
dpolar: Destiny? Sounds like a stripper
Penguino138: @georgehotz how long could you survive with only the food in ur house?
anotherkidnamedaustin: el ron hubbard theory
xeroeffect: Do u want kids?
5cl0ck: WTF IS THIS, HOTZ DRIVE THROUGH??
C4TFive: dont talk to destiny hes a loser
ahahahaitslit: I also recommend Weinstein's podcast
jmp0ut: i am in a dream theatre held hostage to optogenomics who tried subversion therapy on me
theonlymonkas: when you are going to play minecraft again?
samthedogg: @georgehotz starting a religion is in 48 laws of power. i think you did read it lol
mutrx: chicken tenders for dayyys
ahahahaitslit: George would be a good guest
jmp0ut: it was a nightmare simulator to begin with
DSykes_: do dmt
Digital_donger: favorite database software?
jmp0ut: when i was 8 yrs old
jmp0ut: pretty messed up
raystriker98: thoughts on Lex Fridman
nurbscrv: What’s your favorite yoga pose? Prove it.
treestompztv: Simulation doesn’t have virus protection 4Head
tj_rl: Smoke on stream?
Nussinov: I haven't bought groceries in 2 months
CompestLive: cout &lt;&lt; "Give mod" &lt;&lt; endl;
xPolarDreamz: @georgehotz your readme doesnt have the md file extension
djcows: Tendiees
l1ght5p33d: Kids are work the whole point is to get less of it
DSykes_: do DMT
8bitben: you gotta go to the grocery!!
solitarynative: when will you start your own crypto-nation?
Emanuell45: @georgehotz are you worried about getting old?
Emanuell45: @georgehotz are you worried about getting old?.
happypuppppy: did he say chad pose?
jmp0ut: optogenomics games are not meant to be torture chambers for children
Emanuell45: @georgehotz are you worried about getting old?..
firmstool: Imagine this guy bouncing some of his smoothbrain, ill-informed takes off of destiny. Hilarious
theonlymonkas: favorite album
Iknowyou123456789: house tour please @georgehotz
sidthescikid: @georgehotz Is there going to be a Q&amp;A tomorrow?
CompestLive: Who is that behind you????
mik12f4: you ever fall asleep doing a webcast?
anotherkidnamedaustin: SARS just means BUY STOCK
tykabmo: @georgehotz Cobol or Fortran?
Penguino138: @georgehotz What time u planning to stream tomorrow?
archer723: house tour please  1
Juankinator: anything you watched that u recommend? (tv series/movies)
DSykes_: @georgehotz do DMT on stream
CompestLive: Who is that behind you?????
anotherkidnamedaustin: !streambot
Kingxpecc: how long are you going to stream for
Nussinov: @georgehotz can you answer this question? called the portal question: https://embed.gyazo.com/611a66d1dfd1dc187ab289c302b6bba9.png
5cl0ck: are you stoned?
jmp0ut: star trek picard is decent rn
ahahahaitslit: have you seen westworld
julen9601: What is he doiong guys?
8bitben: can you build livestream into openpilot
saeveritt: star trek OP
magicallyphysically: I loved Star Wars
Iknowyou123456789: what car do you drive @georgehotz ?
magicallyphysically: Star Wars best tier
GTozzi: Pecard is good af
THX1342: advice on controlling ADD when you have multiple interests?
l1ght5p33d: Deep Space 9 is best Star Trek
zol0: whose that in front of you monkaS
DecayingSkullz: have you read Hitch Hiker's Guide to the Galaxy
jmp0ut: star bores is so boring now
Penguino138: @georgehotz when dogecoin moon?
MorningScifi: Some favorite books?
Digital_donger: @Nussinov good question LUL
myaocat: what do you think of black mirror tv show?
williamjennings1: HeyGuys HeyGuys
ghu90: they cloned Dolly 25 yrs ago, how have they not cloned humans yet?
naabee_: LUL
Nussinov: @Digital_donger LUL
THX1342: LUL
magicallyphysically: Dont believe ANYTHING
magicallyphysically: PogChamp
anotherkidnamedaustin: @georgehotz time to buy stocks again
theonlymonkas: favorite netflix show
xeroeffect: What fitness activities do u like?
magicallyphysically: World is a lie
un3okapi: How many times do you masturbate a week
yevheniiushtyk: why is android shit
pogu: @magicallyphysically Pog
tj_rl: China did
zol0: LUL
xkasper7: do something with kubernetes raspberry pi clusters!
kuzan8: @georgehotz any books to read?
magicallyphysically: @pogu LuL
firmstool: Main monitor dimensions/resolution?
jmp0ut: they dont do functional magnetic resonance spectroscopy to verify brain medicine yet change the chemistry though the tech is 30  yrs old
icanthitthose: Elon called, he wants his bong back
mutrx: @georgehotz rate my apartment https://imgur.com/a/WNZIM8t
magicallyphysically: Dude I loved that show same here
C4TFive: shithawks everywhere
HexaField: why do my knees hurt? /s these questions are shit chat come on lets up the intellectual bar
djcows: How do you make sure you don't think too much "outside the box" and become delusional, but still stay innovative
ToxicVulpes: when u gonna make a westworld
almonte550: Do you have a TV at home?
0R4NG3: LOOOL
magicallyphysically: SHITHAWKS ARE A COMING BUBS
Nussinov: LUL
MorningScifi: ... I can't rewind WutFace
vrooom_vroooooom: that was on redditr
grey_street: LUL
bubblesnot: safest mobile app to store documents on with a transparent encryption scheme?
AlexEDM: lmao
Michaeltth: LUL
Emanuell45: lmaoooooooo
djcows: LUL
Emanuell45: LUL
C4TFive: convenient AF
magicallyphysically: CORONAHAWKS are coming
esence: he's a minimalist bro
naabee_: efficient
THX1342: how can you profit off of the suffering of the world like this? disgusting
ahahahaitslit: nice
Pin__top: ahahah
Nussinov: efficient as fuck
jmp0ut: why does my life hurt, i think multiple sclerosis
Rovelo: EFFICIENT LUL
PiroFloydian: gross
happypuppppy: LUL
gamozo: Can prep food while shitting
bloodandsteel: LUL
anotherkidnamedaustin: efficient
okoll: jaja
ehisoka: ROFL
solitarynative: minimalism Pog
xeroeffect: What was your favorite toy as a child?
ehisoka: I NEED THAT
sidthescikid: Cook next to where you shit
C4TFive: dont even need the sink, just wash them in the tub
ahahahaitslit: westworld?
0R4NG3: haha
treestompztv: $3k/mo SF
mehdi_tw: what's the plans for the quarentine ?
nurbscrv: Describe New Jersey from the perspective of a tomato
anotherkidnamedaustin: imagine having a girl over
Emanuell45: this guy never heard of "Dont shit where you eat"
Ne0Zer0: LUL
Psycarlo: Summer or Winter?
jmp0ut: :D
xkasper7: have you ever worked with kubernetes
DecayingSkullz: When will we see the cooking stream
Nussinov: @gamozo the twitch chat way
samthedogg: @georgehotz were you going to AUVSI this year?
DarkEpopt: @georgehotz who are you boring for and why is it Trump?
Miestensauna: rate alphafold?
djcows: Favorite type of mask?
anotherkidnamedaustin: quarantine for SARS ?!
r0xtehem0x: What keeps you motivated/focused?
naabee_: @Emanuell45 LUL
Rovelo: coronavirus started in that apartment LUL
justinlinw: Are you working on CommaAI stuff during quarantine?
l1ght5p33d: Its not in exact same spot
jcowley00: Just out of curiosity but do you think you are at your peak for retaining and using the information at your fingertips or is that something you try to improve on
gamozo: What should I fuzz on stream?
Psycarlo: @georgehotz Summer or Winter?
solitarynative: clone harambe for us
bubblesnot: @georgehotz safest mobile app to store documents on with a transparent encryption scheme?
yevheniiushtyk: How much hours of sleep do you try to get?
theonlymonkas: 1M on instagram
karnbirr: What drives your work ethic?
dadadududede: dadadududede subscribed with Twitch Prime.
mutrx: it all started with harambe
Emanuell45: @Rovelo lmaooooooooooooooo
peter35_: hottest actress
8bitben: do you ever drink
theonlymonkas: do you like your job?
zol0: have you ever used tokyocabinent?
tykabmo: is 42 the answer to the universe ?
mehdi_tw: de you think computer science will help against coronavirus ?
DecayingSkullz: Harambe died for our sins
jmp0ut: hottest actress, none of them they're all boring as fuck and their jobs are trash
tornpaperyoyos: Is the coronavirus a punishment for killing harambe?
xeroeffect: What’s your greatest fear?
nikudino: "drink" a bud light
Penguino138: @georgehotz u and alex still dating?
l1ght5p33d: desire to be ultra leet
anotherkidnamedaustin: alcohol is worse than SARS
bloodandsteel: do you like whiskey?
Emanuell45: @georgehotz what music do you listen to?
mutrx: Kate Upton
magicallyphysically: HELL YEA SAME @georgehotz
zol0: Kreygasm
ahahahaitslit: fax
yevheniiushtyk: Ever been in Europe?
ghu90: goodnight, wash ur hands
mickjaggerrrr: do you know him? https://www.youtube.com/watch?v=mPbtR4vorgY
logi6000: Yo we back I love when he just talks to chat
Psycarlo: Summer or Winter?
Nussinov: I'm a fan of anya taylor-joy
MorningScifi: Planning on doing any music collabs with Elon Musk
cankunwang: good night everyone
t0rment1337: change 1m2019.com to 1m2020.com @georgehotz
Rovelo: PogChamp 2016 memes
thezedzed: bonjour
Penguino138: @georgehotz favourite type of wine?
xkasper7: are you a fan of sam Harris
samthedogg: How was the GOT ending? was bran useful?
anotherkidnamedaustin: when is the next album?
jmp0ut: alcohol is crap, better to do ketamine in dimethylsulfoxide
nikudino: my landlord thinks that 5g caused corona fml'
saeveritt: How many times do you eat through out the day
tj_rl: Go to Italy, I hear it's lovely rn
mehdi_tw: favorite nba team
xeroeffect: Do you live in the cloud?
jmp0ut: it rubs the ketamine on the skin
logi6000: George are you just trying to find cure so you can fuck that pornstar
Penguino138: @georgehotz you like NDT Cosmos series?
williamjennings1: ghb is a good alternative for alcohol lol
programmer42: Your favorite programming langauge?
magicallyphysically: Time to cast Rezz on Jesus PogChamp
themorph3: which keyb-oard are you using ?
magicallyphysically: AngelThump
nic0latesla: cofee or energy drink?
gamozo: Cya
DecayingSkullz: gn
Ne0Zer0: LUL
l1ght5p33d: talking is overrated we need python politics
esence: cya
logi6000: no
Emanuell45: later
ak0ya_: bb
THX1342: LU:
bloodandsteel: bye
Nussinov: LUL
Pin__top: good night
Ne0Zer0: o/
ak0ya_: thank you
AresRai: gn
FargioFarmani: F
THX1342: bye
theonlymonkas: favorite tea brand?
buckkets_: bye daddy
hello hello hello
yeah we're live live boys
all right so
to recap things that we've learned
the coronavirus is just sars
that's something that we learned
what else did we learn
that's all we learned no actually if you
look behind me you see that
i went to the supermarket and i bought
two weeks of food
um yeah yeah
because i did some i did some models
this morning i mean like really dumb
stuff i kind of just like did this and
woke up
so this is the month of april
and this is my model is very very crude
but this is the number of people uh
infected in america at the current rate
so as you can see around like april 15th
well um
so i did this math and then i'm like
damn i should go to the supermarket so i
went to the supermarket because
for this part of the curve you're going
to want to keep your doors locked and
you're going to want to uh
have a good source of food and water um
here's when the m16s come out you know
the m16s we always talk about
uh what's this one
see this link
but
does this let you do any like i haven't
found a is there a good website that
lets you do like
projection oh look we stopped the
coronavirus in its tracks
this plague.com too
um doesn't look like a curve
it's just new york
okay that's the first day it looks like
it's leveling off but you know
that can all be very very suspicious
george you look jewish with you on your
team
um i am circumcised and i do hear that
that's the most painful
part of uh
countries are already hitting the max
carrying capacity okay well that's very
optimistic of you
i think italy is the highest at point
one
um if we look at the us that sure looks
like an exponential curve to me can i
zoom in on that
uh you know we really try to stay away
from news and we try to only focus on
data
uh i just downloaded i downloaded this
data from
plague.com
so this is just um
this is the data as graphed on days of
march
uh zero is actually uh um
the last day of february so if you look
at that i mean you can say like okay
that doesn't look like a curve but not
with the log
on that and uh
i mean that fits pretty well guys
um information is beautiful
these are nice graphs now but what i
really want to see is uh is projections
are there any good websites that have
projections
yo look into msm and how it inhibits
what's this is this part of coronavirus
let's check my docs here
i don't have any nlrp
i'm confused by this but yeah no i just
i just downloaded this from from
plague.com and this is just the
the number of uh confirmed cases in the
united states
if you guys haven't seen plague.com this
is a good way to watch this
oh my god it's even higher now
33 yeah 43.6 fits the curve perfectly
see that's that's the real exponential
there
he's like 30 32. i'm i'm 30.
uh i mean the interesting thing
so the hospitalizations
i wish i could just filter out every
news
story um
this doesn't tell me what i want
twelve percent
have been hospitalized
um but it doesn't matter that much what
age you are
right for whether you get hospitalized
the icu
it starts to matter a lot more if you're
if you're older you're a lot more likely
to end up in the icu
and you're a lot more likely to uh to
die
instead of benchmarking singapore well
and those countries have really
i don't know what singapore did
specifically but south korea took
well not quite china's approach
but um you know
they uh
they tracked people's cell phones
i mean they they enabled the batman
device like that's probably worth it
uh if our government was that confident
patient medical data
can it be possible that china all of a
sudden didn't report new cases
let me show you why china didn't report
your cases here's my theory about that
um i don't think uh slaves
if you guys don't remember codex i love
this website scott alexander's a genius
returning home with your disease will
not make your planned parents pleased
infecting mom and dad proves you have no
conscience
those who don't report their fever are
class enemies hiding among the people
save pennies not wearing a mask spend a
fortune getting treatment on your sick
bed
a surgical mask or a breathing tube it's
your call
right so i mean yeah china has no new
cases
oh this is a nice data set
id
oh sequins available whoa
wired noise we speak english in this
channel
i'm going to refresh twitch so i can see
the viewer count 321
all right cool i think it's time to get
started for today
first we need some tea ah
i like corn as well
um oh the csv for that date is at the
bottom of the page
perfect just something good to grab for
later
you never know when you're gonna need
data
well i mean yeah it's you know more
people have died than 9 11.
9 11 was was an attack on u.s soil
though and i think that's why
you know it's so
it lives in wuhan
oh it's a little data
china was not behind the attack guys
um though i mean it's interesting
thinking about
china originally really downplayed this
and then they went they did like a
complete 180
from downplaying it to you know those
propaganda posters
i mean i think this is what you get if
you actually get a smart government
that cares most of all about economic
growth
and this isn't necessarily the wrong
choice
you know people in america are always
like but you've got to think of the
people's lives the economy be damned
i mean if we're using the excess economy
growth for you know bullshit
uh maybe this is true but the standard
of living in china has risen
so rapidly china has pulled more people
out of global poverty in the last 30
years through their economic
growth in any other country um
you know china was it was a 30 years ago
let's see maybe maybe 40 years ago right
40 years ago shenzhen was a fishing
village
now shenzhen is a 20 million person
crazy city with some of the sickest
malls in life
uh do you say india up next
i've never been to india and maybe i'll
change my mind if i go
but um
i'll believe it when i say it
what can someone lost their job do
online to make money
capitalist utopian communist dreams take
who thinks a communist state is a dream
state i don't know what kind of dreams
you're having
all right let's get back to work um so
here is a sars cup 2 ncbi i found that
other remember that thing that i like
lost
i found it again this here
down here so these are those uh
this is what we're looking at this is
the coronavirus
i mean it's nice because this one breaks
down orf1ab
uh anarcho-communism
yo i wanna date once
and this girl told me she was an
anarchist
and i was like oh that's interesting
so i went back to my car and i got my
gun out of the glove compartment
and i put it in her face and i told her
you're my slave
and this worked you know for about
two minutes until the bartender pulls
out a shotgun
he said you know what you guys are both
my slaves
and this worked for about 10 minutes
until
the army showed up outside with some
tanks
pointed them at the bar and said you are
all my slaves
and then we're kind of back to you know
where we started
uh so that's what i think of anarchy
yeah the military oh kova dash githubaio
has projections
so size thank you for subscribing
uh nah the girl was kind of weird she
brought her dog to the bar
um
oh projections now we're talking
wait can i project further
wait but i want to go further
can i not go further
how do i project further
anyway yeah for the last couple weeks uh
it's been
very logarithmic
what do i think about how italy is
handling this story
you guys kept asking me the question
like when is this all gonna be over when
is this all gonna be over and i was just
like i don't know
um you know when i started these streams
i didn't take coronavirus very seriously
um and now that i've learned that well
it's you know sars
i've taken a little bit more seriously
uh is there any way to go further with
the projections this is probably open
source
now
um
is the source of this somewhere
let me go out further with this
ah there we go
and then can i predict more
this is the source code
i'll make a small feed guys
the local dash app
some social shaming for 10
vis responses
look how biased as science is this
what the people can't handle the truth
so
probably all cool things to learn about
there's so many like incredible python
packages out there now
stats models
i don't know why my donation never
showed up
did it not go i don't i didn't check but
i don't think the wallet i have on my
phone supports segwit addresses
it's the bitcoin cash wallet
and i have the private key i have the
private unions like oh let's steal his
crypto i got like
600 bucks
social blocks has been extended in the
netherlands
yeah the 21 is probably gone um
all right
what is this doing historical
replay
we're getting distracted i promise we'll
get to do reverse engineering in a
little bit
what is this doing
oh python package for molecular dynamics
simulations now we're talking
mdanalysis.org that is where we were
going to go well actually i just googled
it and found it
we did say we were going to try some
molecular dynamics today
i'll let that run for a bit maybe it'll
eventually do something
all right don't ask me how i studied to
code
don't ask me about why you got banned
from discord
uh as rule i will say this
the people that you know with flu
symptoms probably have the flu
the flu affects millions of people every
year the flu didn't stop just because
there's coronavirus
um
okay you know the amount of people who
are a little bit sick now and probably
like i'm sure i have the coronavirus i'm
sure i have it well
i mean do you
i have zeesh because uh
it came with the mac
[Music]
i'm gonna turn the lights off
all right guys let me show you what what
you bought i got prepper stuff today
check out what's in these bags check out
some of these beds you know
no one knows where i live in a couple
weeks everyone's going to be trying to
try to rob me of these potatoes man
oh you know what i could really go for
some
shells of white cheddar macaroni and
cheese right now
oh this looks sick right all right we're
just gonna cook this up
who's knows it for roo
yeah no i'm ready for the m16 man
testing my lock out we're good all right
i don't know what this is doing
i can use the potato skins as tp
i have no idea why people are buying i
bought two weeks of food
and i'm gonna start eating it now
oh it's like doing the predictions of
all of them
should we spend time trying to make this
work
get all data
oh exactly
wow these people went really overboard
with like this
i don't know i mean this this model
seems way too complicated it seems like
it just runs too slowly
when like just fitting a line to the log
it'd probably be pretty good
no okay make
figures
do you guys want to see me do this or do
you want to get back to reverse
engineering
you guys can vote in the comments
what does yes mean
oh no what
reverse yes isn't doing what i'm doing i
don't know the vote seems 50 50. or
should we make macaroni and cheese
y'all making the macaroni and cheese in
a pot
cooking it up
[Music]
bringing more water
that thing around tweet around
oh sweet
okay united states where did they get
this number from that like didn't go up
that day
okay
we're gonna spend a few minutes
trying to
fix this and if we can't fix it we can't
fix it
we just want a model for the united
states that extends past
download the data we only model the
active cases
wow
wow
does that work
when will coronavirus 2 come out well
this is already v2
actually um you know they used to have a
name for it used to be called sars
but i think they figured you know
oh i said it's not
so this is sars detail
so does this have the predictions or
does it need that stuff that i commented
out
sweet it has predictions
all right
let's go into modeling
uh
don't show predictions more than 10 days
ago
how do i make the prediction longer
you
word immunity is like the biggest crowd
source
uh maybe this is it yeah prediction
dates let's
do plus 30 there
oh this didn't actually
work at all um still is calling
historical replay
first with ramp windows so that thing
that was actually taking forever to run
i think it was running on every country
and that's why it was taking so long
we of course only care about america
so if we could just make it work for
america i'm happy
i don't get it this is stupid
it already writes the stuff there
i don't know if it rewrites it again but
also australia no no we leave america
here
you can you can follow my instructions
you can do a first try
if we want to know if we want to know
when is the shit hits the fan date
is this irresponsible graph making
what uh oh
yeah so i think there's a problem i
think we can't even see it
gotta go to log can we see it
no no no
okay all right
so yeah
oh it doesn't automatically scale at
some point anymore
sweet okay
so we're here now oh this is this is
perfect this is exactly what i was
looking for
um
so yeah we're we're here right now
and if we continue on the current
trajectory
uh we'll hit a million cases in about
two weeks
and we'll hit a hundred million cases
about uh
two weeks after that it's march 23rd
so let's see april 23rd yeah april 23rd
we now and this is of course going off
of confirmed cases
it seems like 50 of people don't have
symptoms
uh so
um yeah you know what's you once you
look at that graph of it and you're like
holy shit man
um society was nice while it lasted
uh the three blue one brown video is
very good
um
i'd bet against the grafton uh the three
blue one brown video goes into
the fact that everything actually is a
sigmoid
so you're gonna reach some point um
so it's interesting also that we have uh
the social isolation and we don't see
this at all
we don't see it reflected anywhere which
is probably because it's too soon to see
it
because of the incubation period
[Applause]
who's getting arrested for spreading
rumors
oh yeah well i was in china um
this is america you can uh say whatever
you want
to predict humanity's workout
no we're not uh
we're not we're not reverse engineering
yet we're just extrapolating out
so we'll see um the
[Music]
i think the population with the highest
penetration right now is
italy's and it's at 0.1 percent
1.1 percent of america would be
uh 300 million 300 000 people
so yeah you know what um
if we hit a million people by april 5th
uh everybody uh
run for shelter um
don't run for shelter calmly walk and
shelter in place for the next two weeks
uh can we see the italy graph yeah it
should work
huh so some of italy's effects appear to
have been working
i mean yeah the united states will pass
italy at some point
there's also it says it's just active
cases
i mean the united states will obviously
pass italy at some point because italy
has 60 million people
and we have uh 300.
i mean the question really is what
percent of the population gets this
disease
i think the best uh way to estimate this
what percent of the golden princess
cruise ship number of cases
diamond princess
um can i get real data that's not news
can someone find the the cruise ship
data
uh i mean yeah the cruise ships recycle
the air but you know we're kind of all
on a cruise ship right
uh yo it must have been terrible man you
get free
free carnival cruises for life or
something
check the s-i-r model analysis of stars
yeah check this out
hmm
oh this one rarely returns new sites
sweet
duckduckgo returns news sites as well
which is kind of upsetting
um okay but
uh god this is whenever i look at these
decentralized
projects it's like this is terrible
this is terrible i don't want to have to
pick one of these i don't know what any
of these things stand for
why don't you start with that i get that
it respects my privacy and all i don't
care
anybody who wants can see my searches
the only thing is i don't want shitty
news
um diamond princess
number of coping faces
great
okay cruise ships this is a table from
the cdc okay
ah yeah yeah this is nice oh look they
did a good job
this link is it fake or is it really
live
um we can yeah i have seen the new york
times one
what do you mean is it fake no it's not
fake
what do you think is fake
okay
so the diamond princess cruise ship had
30 i mean this is simple math now
let's just let's just look at
percentages right
so assume that like the cruise ship
fully circulated the air
and there were 711 cases and i've heard
that
uh half of them are asymptomatic
oh come on of course we want python 3.
okay so 20 so
about
if we assume that they're not testing
people without symptoms
then 10 of people look like they're
going to get
the disease assuming that this stuff
doesn't work
so 10 of america is 30 million yeah okay
uh i don't think the noise thing had
anything to do with me yesterday
there's people upstairs banging shit
uh so 300k dead um
if you're going with a 10 mortality
which seems
high uh and not no not 300k with the
virus
it seems like 3 million with the virus
well
so 6 million with no no
60 million with the virus
30 million that show symptoms
and then of those uh seems like five
percent
uh
uh death rate's about five percent if
you're going off the sars
it's like a million people
um bro i don't think the holocaust was
fake
my shelter
a little crunchy
we're gonna put on a lovely song and
then we're gonna get to reverse engineer
whoever's listening to music
you don't like the music billion
bitcoins uh well you know
good thing this stream's not a democracy
what did young lacuna beside
everyone should switch to pie torch
yeah that seems right
so basically yeah i mean this year just
um everyone's uh
yeah sometimes i let the people vote so
they think it's a democracy
i kind of like bright eyes um
no i think jonathan's right
but
exactly it's like a real democracy
nose for attitude understands what's up
[Music]
point of no return you mean immortal
technique
if you guys really want a mindful dance
with the devil
all right let's get back into this with
a little bit of just improving our
documentation
and then so for reference
the issues that we're working on you can
find them here in the readme
oh actually i should pull some updates
so we have two open questions
um how is orf 1ab cleaved into
polypeptides can we predict this from
the sequence
let's look into that question a bit and
the other question we're going to look
into
is which protein is the immune system
responding to
you know you think 20 is not right as
the upper bound for infection
the cdc have that quite nice graph
right like
i mean
it's starting to taper off i don't know
maybe the upper bound is a little bit
higher
could someone link zeus to repo
especially if he subscribes
so one and a half americans dead i think
that's a pessimistic
no no it's possible it's pessimistic
and we're going to see we're going to
find out in the next few weeks whether
the
like
um no i think orf is cleaving
i think we're going to find out in the
next couple weeks how well the
um like the social distancing stuff is
is working out we're going to get lots
of really cool experiments across all
the countries
no and we're not at the forefront of
this italy right now is at point one
percent
um
but it is actually it is interesting
dude someone did link that italy data
saying that it's
it's going down
um is plague.com open source because i
would love to submit a pull request
to be able to switch this to graph to
log mode
because like you can't see anything
unless it's in log mode
we have my viewer all right the new york
times one is good
making my computer lag
okay this is making my computer lag
this is cool i'll check it out later
when i'm not streaming
um do i even still have my
i love this guy we can look at italy
because italy actually does appear to be
tapering off
even if we go out further
well
i mean yeah it's really not taking into
account the second order effects
this is also only active cases
so one percent of italy is uh
six hundred thousand
yeah i haven't even talked about case
fatality rates i just don't really know
um i mean it depends on so many factors
you know when you look at when you look
at when you look at germany
um you're like how does germany not have
any deaths i mean they don't have that
many recovered either so maybe they're
just early
like they don't seem that much earlier
than like spain which has like 20x
adapts
but out now i'm heavy into speculation
realm
we're done with that for now
um stop saying racist stuff
bench ai
don't tolerate any racism around here
this is a no racism
place
yeah germany doesn't have any deaths
no racism that's right that's right
okay i don't want to let this turn into
a general
coronavirus speculation discussion
i will just say i bought two weeks of
food this morning i recommend everyone
else
do the same because work case you'll
have lots of macaroni and cheese to eat
if you don't have two weeks of food in
your house already
it's the kind of thing that i should be
more serious about
i mean i just did the math on calories
all right all right well okay we can
check this out too so this is not that
bad
the first milder outbreak
protected against the sars
back fitting data okay
so the cleaving
i think that the cleaving is happening
with these protein aces
former nsp1
conserved domains
like protease there's good stuff
on this website
so it's this responsible for the
cleavage
located at the end terminus of the
replica poly protein
so the replicase polyprotein is
ortho1a and or1b
participates together with nsp
for
let's understand what a pep hang is
[Music]
oh i was listening to some
i was listening to some stick chip to
him before
um no no
it was i saw him in hacker news
i forgot what it was called um
yeah yeah this guy he just plagiarized
chiptunes
[Music]
let's look into molecular dynamics while
we listen to this because we can't think
while we listen to this
i love underwear girls inside the pants
i listen to that in high school it's
kind of shifted open my eyes
[Music]
[Music]
girl guy thank you for subscribing
do
[Music]
oh you want a song like underwear goes
inside the pants
i will listen to it on stream i know i
know one other song kind of like it
um what's it called oh
i can't even think of the guy nomads
um no it's an
it's an old song
it's a portland guy
um
nomads and it's it's it's a classical
piano beat
um
we're gonna find this now because it's
gonna drive me crazy if we don't
uh actually if we go to my youtube
i used the i liked it so much that i
used the
the song in this
pick me apart yeah
um somebody stole my car radio and now i
just sit in silence
this is all right um also
most of it's terrible but other side by
macklemore
defenses remix shit got me into sipping
lean man
you know i listened to that i'm like
damn a sibling
it's a little bow burner mask yeah
all right that really switched up the
vibe hard
[Music]
[Music]
what they used to simulate this
it's just the analysis so it must have
[Music]
been
[Music]
[Music]
[Music]
so
[Music]
so
20 000 atoms all right
wait there was a network there or what
is my stream online uh my twitch
glitched out
uh this is the github for plague.com oh
you want to add a log graph to this we
could like do them a favor
did someone already do it
whoa this is so cool
like
i mean i just love to be able to is
there already a way that i just don't
know
i want this on log
all you can do is confirmed daily
increase
yeah so you silly fall that's really
good
not america um
why they took log mode out
why did they get rid of vlog
[Music]
does someone want to read the changelog
and figure out why they got rid of log
mr shabasaki thank you for subscribing
[Music]
i know east of china is a separate thing
i remember that
perhaps an oversight no i want to work
on a qr code
we're playing with uh molecular dynamics
tools
well so you see notice how it's
md analysis is an object-oriented python
library to analyze
trajectories from
um md and now from molecular dynamics
simulations
but the question is okay now how do i
actually
trigger a molecular dynamics simulation
like what do i use for that
comes with a number of real trajectories
for testing
grow max
chronogen machine
it's one of these things that's going to
need like huge amounts of computers like
a big cluster
the good news is i have a big cluster
they got rid of log because they're
monitoring people visiting the site
that doesn't make sense wait we back on
the hype train
yo the hype train's back
yo i love the hype train it made me
money yesterday
does this one have vlog i wanna have a
log scale i see that's much better
i just
[Music]
all right things look pretty good for
italy right now
but we're done with this we're getting
distracted we're only
all about that hype train right now
drogo thank you we're at the level
two hype train we got a hundred percent
i think we're about to get to the level
three hype train
choo choo uh or how to lecture for md
analysis all right
let's see is it long
well um hello everyone um
is that
yo level 3 hype train we got we got
four minutes to get some more subs
now i don't get any more noise
complaints it's just someone yelling
i don't know maybe they'll get
all right we're gonna watch this later
it looks like gromacs is the thing to
use we have excellent
cuda based gpu acceleration
well let me show you something i have
i'm using it right now but
we got a lot of those machines that come
choo choo thank you for the hundred bits
nacho avavin
nasho boy devoid yo
anyone else who subscribes right now you
get a shout out you got three minutes
i'll give you a shout out we're gonna go
back
no the claims are all fake we learned
droco thank you for the bits
thank you for the bits droco keeping
those bits coming yeah love it
love it look at them gpus man we got
plenty of gpus to fire off in gromacs
is this a tutorial for this
namd is this a different one
what is this huh
solvating the protein
generating a protein structure file
all gems for you thank you
71 we got two minutes to get the hype
train to level four and then we can give
up on the hype chain
if you were thinking of subscribing
right now is the time
right now is the time to subscribe
grow max how do we put things in
to grow max
this growmax looks better than this one
i trust this one less i mean
why do i need a protein structure file
i guess it's okay fine it doesn't
actually fold the proteins mr zlz thank
you for subscribing
gold seas thank you for subscribing
gold skis we're at hydrate level four
so like
it's gotta be someone just did this
using gromacs
visualizing protein soldering compacts
ilya rpv thank you for subscribing
can we study protein folding through
molecular dynamics and simulation
okay so itasca this is what this is what
the guys talked about using uh
with that zang website talked about
using
um what do i think of using ml britain
x2 thank you for the
for the bits
first of all is structural sim templates
oh it is zang lab yeah this is actually
the thing that they make
and they're the ones who had that who
had that analysis of the uh
of the coronavirus here
um over here and they generated these
models
see i guess the estimated tm score i
mean i guess if
the way i test it works is it identifies
yes structural templates with low meds
you know biologists love to name things
like this
you see the stanford paper about my
programming challenge
no
do you think the u.s is going to develop
an app remember that time they tried to
make a healthcare website
it's not on my eyebrows
is there a way to see where the virus
overlaps with a bat yeah we could do
that
i actually have a link for that in the
uh
this doesn't mean it's okay
like how about this i mean i don't know
if i got a
uh a submission of their their their
test results
um if they submit their test results to
me i'll tell them how they did
okay this doesn't work at all
you can't randomly shuffle the pairs of
data and take twenty percent
put eighty percent of it in a training
set and twenty percent of the test set
the reason why
is those frames that you randomly pulled
out
are extremely correlated with the frames
in the training set that look just like
it
see what i'm saying you can't do that
level three hype train share
choo choo hype oh look at that
yeah you can't do that
how do they know well let's just let's
just
we'll write that in the readme how
do the researchers
know where
or 1ab leaves
you hear those dogs
does not indicate snakes
by the way i feel like i did read the
comments
um and someone said i got the number of
base pairs of hiv wrong
whoa really
hiv is you can fit three hivs in one
coronavirus
look at this paper for how the
researchers know okay
oh
i'll put this link in here
did i do my markdown right one
i don't know why that took forever
by two viral system
and i think i saw the other one in there
too
yeah so or three and
or five are cleaving it
very cool
are important targets for the
development event oh just if you prevent
the cleaving oh that's clever
you chicago where fun goes to die i
believe in that school
it doesn't matter if it stars or oh i
believe in it even more if it's about
sars
okay a lot of the science that's come
out about coronavirus i think is kind of
crap
um because you know you want to get
famous publish your chrome environment
but this is very cool
and considering stars and chromosomes
want to get popular stream coronavir
stuff yeah right
um
oh okay look you see i think that in
sars they're calling it different
things let me just check here
let me check in the in the uh
in this structure because i might want
to change my naming to match
ncsp yeah
so they're calling this one thirteen
we might wanna change my naming
ncsp 10. where's
that's 12 where is oh 11 is like hidden
down there
oh okay
13 amino acids
just to make my numbering match the
other peoples
look how i'm using their language 13aa
that's 10.
someone found out that i put two sevens
in the sars
and they submitted a pull request for it
it's pretty funny
i typed seven twice
okay now my uh
my stuff matches there so it's easier to
understand
okay frame shift we learned a little bit
about these
wow
which numbers which
4005.
that can't be right
what do those locations mean those just
can't be right because i'm already
like 12k in the virus you know
zoom in too much zoom
yeah it's like right around it's right
around that
that missing point
pump this link computing the opening of
that spike
yeah we've learned all about this yes
there's
yeah there's two um
as far as to spike in motion
yeah look at that
what did they use for this yeah oh wow
they they have it cool
we modified this bond orders and the
sugars we use the
a-wrap
oh i see what they did so
they didn't like this isn't like
molecular dynamics or anything
they just um
they they you can download both the
proteins actually have them both uh
both here so you have the open state and
the closed state
um so they they just built something to
to go between them
uh wait hang on i gotta i gotta do
something
for work i'm just gonna do it right over
here
um so you guys can't see it i'm sorry uh
you know what you guys can see it's not
secret
what's your question
okay
someone linked me the graph we'd use to
see the us numbers
um so i modified this covid dashboard
thing
probably if you just search for covet
dashboard it's probably good
um the best accuracy on the comma ai
test set
uh
forget the virus stay home
i mean there's an argument to be made
that if you're going to get it you want
to get it right now
before you know all the hospitals are
really overloaded
um
you had to get like a month ago that was
really the time to get it
imagine how good the people were
recovered from
well actually let's look that up
community the stars
specific igg antibody
i've seen this like reference before i
don't really know what it is
immunoglobulin g
whoa i mean is this like a
what's the dna sequence of this thing
how many base pairs is this thing
looks simple
i don't know what heavy constant gamma
one is no i don't think this is right
i don't know let's not get too
distracted
um
free full text how do i get free full
text
i take this i go to scihub.com.tw
i take this so i put that in there and i
get free text
is it a bad time to eat meat no
top right of pup bed oh
sweet
despite protein and the nuclear capsid
protein
they spelled nucleocapsid wrong concerns
me
um contribute down to the antibody
production
oh okay i mean that that kind of gets it
like one of those questions that we were
uh
we were asking
let's just do a citation here
we'll spell it right
let me actually not just
let me actually write a tiny
documentation for this
nsp3 and nsp5
is what they were saying right
uses the 3cl pro which is nsp5
and a papine-like protease which is nsp3
it's interesting that like the way that
it's cut up is actually
inside of the protein
contribute dominantly the antibody
production during the cost of the
disease
spike protein especially the ace2
binding region
is capable of producing neutralizing
antibody
five major they spell nuclear caps that
are wrong there
too but it is a chinese journal so
you know
the pattern of cytokines
are all these people going back and
reading the sars papers
because these papers are so much better
than any other coronavirus papers i've
read
what's this one
what is this they tested the biologists
the survey was negative against all of
them except for one guy who got bitten
by a bat
i don't know about that study
what are cytokines
so
i i mean you know they always talk about
a cytokine
storm and that's what uh hydra
yeah this um
this is they gave this in france uh
because they think it prevents the
cytokine storms
is there a good video
like is it one of these that's not like
at a stupid high level
we're immune system of pathogens and
other four
dots each antigen has a unique matching
and all of this is
no no no no no is there a good one of
these
can someone find it good how the immune
system actually works
that mentions like lymphocytes and
cytokines and stuff
uh viruses become more transmissible and
less deadly well there's
i'm reluctant to click is is this is
this a rickroll link
oh hey everyone on behalf of cambridge
to analyze this factor by identity no no
this is too long i want like one of
those new youtubers
like you know like like wendover and
stuff like those people who make those
really good explaining videos
that coronavirus explaining video was
very good
to the right of what i clicked before
[Music]
[Music]
hey
a pathogen is a disease-causing organism
there's a few examples we've shown here
on the screen
your body's fairly well equipped to try
and deal with the pathogen does get in
there we're going to discuss this in the
context of some of the blood cells that
are involved now you also know about red
blood cells they are therefore
transporting oxygen there are also the
lymphocytes and phagocytes lymphocytes
and phagocytes are both types of white
blood cells if we have a look at what
they really look like here in this
dimension
t lymphocytes
cytokines are messenger you can see
first of all this red blood cell i've
highlighted one of them here but that's
the one where you can see hundreds of
them on the screen
the lymphocyte there you can tell that
the lymphocyte because it's got that
really large nucleus and the phagocyte
down here you can distinguish that from
the lymphocytes because of the unusual
shape of a nucleus and we describe this
as having a lobed nucleus it has that
shape because it needs to fit something
inside there we'll discuss that a little
bit
later first lymphocytes when a pathogen
enters the body
it has something on it's called antigens
and these antigens can be recognized by
the antibodies
of the right type of lymphocyte it
reduces these antibodies in large
numbers
and when they attach to the antigen it
results in the destruction
of this pathogen well how exactly do
they work well there's a few different
methods that antibodies can use in order
to destroy pathogen first of all they
might cause this certain set of
reactions which is going to result in
the cell membrane of the pathogen makes
the organ
another thing it might do is it might
make it easier for phagocytes to find
the pathogen we'll discuss shortly
how phagocytes can destroy pathogen
another thing you can do is make the
pathogens
stick together which again makes it
easier for pathogens to find them and in
both them
but also it prevents it from going about
its daily business imagine you and a
bunch of your friends are all stuck
together you find it really difficult to
have your lunch and things like that
it's important to realize that very
specific antibodies are needed for
specific pathogens
and since each lymphocyte makes only one
type of antibody it might take quite a
while for your body to find the correct
lymphocytes they can produce the right
antibodies to destroy the pathogen
and the consequence is you might get
sick in the meantime before your body
actually finds the correct antibody and
is able to destroy that pathogen
one thing that happens is that memory
cells of that lymphocyte are produced
after fighting the infection some copies
of this specific lymphocyte were made
these specific copies are
memory cells and what that means is if
that pathogen is your body again
it can immediately stop producing the
antibodies that it needs and then it can
fight off the packaging before it has
time to make you sick
so basically you can't get sick from
that same pathogen a second time this
is immunity let's look at the next type
of white blood cell and these are
phagocytes and they've got a very very
different method of destroying pathogens
first of all the pathogen enters the
body and then the phagocyte recognizes
it and starts to move towards it
the next thing that happens is the
phagocyte engulfs the pathogen it's
really important to use the correct
vocabulary here don't say that the
phagocyte eats the pathogen that's not
correct
it's a very different process you're
eating then what is inside of the
phagocyte it gets destroyed using
enzymes and finally the homeless broken
down products of the
of the pathogen are exited from the cell
and then it's been destroyed
the pathogen has been destroyed in the
phagocyte and go on and engulf new cells
so what about possible exam questions
well one possible one is that they might
give you this sort of picture
showing of what blood might look like on
your mind these are red blood cells
these are lymphocytes and these are
phagocytes
and functions of each other well the
first one now this is a red blood cell
and it's used to carry
oxygen throughout your body this is a
lymphocyte
and it makes antibodies it only makes a
specific antibody and antibodies can do
a whole bunch of things it can get
things to stick together and this is
phagocytes
don't say that they eat pathogens they
engulf them obviously
blue cell you know that's responsible
for transporting oxygen b is the
lymphocyte and this function is to
produce antibodies to help destroy
pathogens and c
is called a phagocyte and you might be
tempted to say something like it eats
pathogens but once again these don't
make that mistake you cannot get them
off for that you get the ghost pathogens
if you do like that you get your full
six marks
yo i'm gonna get a degree in bio when
i'm done with this
i just listened man
you mad bro you mad you know what bro
i got a plan for you you should start
your own competing coronavirus stream
now that was a meme from yesterday you
guys
okay cytokines and t
lymphocytes
these are these are the these i i've
seen this stuff from from uh
from aids
acquired immunodeficiency syndrome well
that sounds terrible
completely real talk guys
you can now buy a test at home to test
for aids
and like it's not like you mail it in
it's like you can just take it right
there and you like mix some stuff
together
very chevy sure
it does not give you aids no and the
test is for hiv i should be specific
about that
aids is what hiv causes unless of course
you're carrying moss then you don't
believe that
carrie mullis was the inventor of pcr
he won the nobel prize and then went on
to talk about
mullis expressed disagreement with the
scientific evidence supporting climate
change and ozone depletion all right all
right you can go either way on that the
evidence that hiv causes aids
and then all right then really you know
and asserts his belief in astrology
why do they link these together
you know i do always find that it's
weird
um someone mentioned the uh so
someone mentioned that that the
holocaust was was was a hoax
a couple comments back and like this
very obviously isn't true
but i find it funny that they're like
they label like
denialists right like whenever they have
to label
the nihilists i always wonder it does
make me a little more skeptical
yeah denialists right you know there's
no like
you know two plus two equals four
denialists
though you know i have a finite test
guys i have a finite test so you can
look up what that means
you know some weird shit that i believe
in but
so it seems like the igg one is still
produced
persist for a long time while igm
is expressed transiently
whoa
immunological epitopes in the spike
protein
so for reference you guys remember that
this is the spike protein here
we should label it with the number of
base pairs
or the number of amino acids i mean
uh it's here
1273 amino acids
and remember that it's a trimer i think
i'm using the right word
because like three copies of it kind of
weave together
quality meme bros
oh so that's in sars v1 so they added
they added a bunch of what's a
glycolysation
site
whoa yo there's like a whole world of
bio words
no no he didn't exactly take that drug i
think he i think the guy who died
took we'll look it up az
death chloro quinine
yeah so the problem was he took
chloroquine not hydrochloroquinine
so it's actually really not yeah hydroxy
a less toxic derivative of chloroquinine
um which one is it's called like uh
yeah yeah plaquemines yeah you can you
can like buy this like there's people
who have it you can you can like pick it
up and you can go down to mexico and
pick that up
phospholipid bilayer we learned about
that what's the book of
hours i can't i can't not click that
link
nice book bro
four regions with highly immune
reactivity
how do they know this
based on antigenic prediction
ace2 binding region is a weak
antigenic determinant
wait so the dna vaccine actually works
there's some guys trying to make it open
source uh
open vaccine
yeah these guys i tried to donate some
bitcoin to them but they used a segwit
address so
my bitcoin went through
all right stop spamming
my immunology notes from uni
i don't think you want me to open those
on the stream
um the dna vaccines were never approved
please watch this
all right
make you a mod please
no no no who's trolling next next trolls
you know we're gonna
we're gonna martial law in the chat man
um
that's difficult
so wait when the mice are monkeys for
what's that adenoviral delivery vaccine
containing expressible full length of
the spike
gene anti-ace
ii binding region activity was
combination of these two bindings and
antigenic determination
it may be used as an antigen for asylus
vaccination
i mean yeah this is basically what these
guys were saying and like it makes a lot
of sense
they had a uh they had a pdf
um
so let's see are they
express a modified form of the spiked
protein
modifications to increase its stability
a furin cleavage site let's understand
that i'm sure i googled this yesterday
and i just forget
what is fearing though oh it's a
ubiquitous
what there's so many words
um we may want to consider mutating this
site
oh it's modified isn't it attenuated oh
it can't penetrate the transmembrane
proteins but it's recognized as an
antigen okay that makes sense
yeah yeah the urine is on the host side
okay uh yeah i'm sure
that's something your body produces it's
not in the thing
um it's just weird that it's a ten
they're not talking about attenuation
they're talking about stability
right like i mean i guess you wouldn't
want all these spike proteins binding to
your a
sites but
it may not matter yeah the whole sphere
includes the spike yay i know this yeah
okay so that makes sense so it's a fury
and cleavage site but
oh interesting so we should actually be
able to find that oh that's a good open
question
find the
urine cleavage
site in the spike
glycoprotein you know these things could
just be called like
any wizard magic and it's all the same
man you're just manipulating symbols you
know
oh here they're even making a claim
about where it is
p rra
so they're saying actually that
huh let's test that
so i just wrote some code for this to
get the spike lego protein from sars
no module named data yeah cause we're
just gonna restart
and then of course for our spike
glycoprotein we just do corona
spike like approaching right so these
are the two
so they're saying it's a pra
let's do some furin
oh look at that cleavage site can i
cleave this one
can't cleave this one look at that
quality man
look at that quality you know
this might have been an easy
let's try to understand if this is like
a known thing
or did that just come from that one
paper
uh i don't like how all these papers are
talking about
in general the more papers are talking
about cov2
i'm less interested why
does
like why do they even think these are
the same thing
why do they align it like that that
doesn't look aligned to me
all those symbols look wrong
furin in text prra i don't know about
that
you know this is all
why why do they think
here we go
so something like predicted
the furan substrate and the location of
fury and cleavage sites can be predicted
by two bioinformatics methods
see they name them stupid things
so if i feed in the sequence can i uh
what are these things prop
prediction of pro protein
oh this seems better
a 20 residue recognition
sequence motif
oh is pi tau open source
oh here we go
official gene symbol i think i can get
that
um
i need the gene name
no this one
is that a gene
i don't know what a far file is but
maybe
okay
back trio
my friend were for chinese company and
you know their big company like billion
dollars and they'd write stuff in
english occasionally
and uh you know my friends from america
like who speaks english
like you know and you proofread it and
you'd be like you know this isn't how
you write things and then
you know the big boss was kind of like
no no no no no no and that's why things
are released like that
i know but don't we all think it's
disgusting monetizing the human disaster
disgusting
how close are we to cracking it man
let me tell you something about the ps3
you know the ps3 took me five
weeks the iphone took me 12.
um no and then like to really finish the
ps3
took another like the ps3 was like a six
month project
the iphone was a three month project the
first time
um the jailbreaks were usually done in
about a week
but yeah i mean what this shit's going
to take 12 weeks man what do you think
we're going to find a vaccine tomorrow
yeah we just got started you watch my
online streams
we put three days into this it's gonna
take a while to hack the coronavirus
guys
no i mean if if coronope's vaccine is
gonna work
we'll get back to okay get back to that
um
you guys wait until you had corolla
virus
ratio of new stuff we needed to learn
versus stuff i know to hack the ps3
when i did the first iphone i didn't
know the difference between
kernel and user space i didn't
understand that the baseband was a
separate processor
um i knew what idle was but i never
really used it before
uh yeah it's in the fun folder right
uh
discover at least
does ginger have a plug-in for bio can
we write one of those were they sledded
slave files
can we write a slave file for bio
yes see like i didn't know no i mean i
learned it then but like
uh
i don't know but see i'll say something
else too
um george watsky i think phrased this
well
uh it's
you see the words i say and they portray
me in the nicest light if only you heard
the
typewriter chatter tap tap tapping
through my mind at night
so for every project i've succeeded at
there's also been a lot that i've failed
at
you know i put a lot of time in my life
into uh trying to find a collision in
shaw one
um like a lot of time like i put months
into that
and uh in no show one collection uh
oh i worked on this stupid nokia phone
for weeks and weeks and weeks
i wrote a gpu hashcracker
to to crack these uh these nokia hashes
um i missed a stupid rsa exploit in that
one that came out a few months later and
then the gpu thing became a thing and
then i used those gpus to
my bitcoin and buy drugs
but uh
yeah so like not all the projects
succeed and i don't know if this is
going to be one of them that succeeds or
fails
but it'd be pretty cool you know
don't you think
i've been learning a lot of stuff which
is really cool i really like learning
and i'm going to uh so you guys if you
don't know i'm part-time at common now
i'm not at uh i'm not a comma full-time
anymore
we're profitable the company's going
well
um well you know this week
this week's not so great but um for the
most part we're profitable
uh yeah so i've been you know i've been
working on backspace
worked on backspace a bit um
i've been promoted to part-time it's
true but yeah so i have some time
i don't know and i i kind of like
hanging out on stream and i kind of like
talking it's it's nice uh so maybe i'll
hang out on stream for the next
uh a couple of days until i really have
to focus on something and write some
real code
but i mean like also like you know where
is this project going i mean i don't
know we're we're
learning first that's the the first step
to any
uh to exploiting any system
is um
i still do a lot of work at kama but you
know it's just not uh
it's not a full-time uh job anymore
we're hiring too if any of you are
interested
um it's a cool place to work like i
think that we're
i think that it's like really on the
track to solving self-driving cars
i don't really i didn't really feel that
way last year
but the comment is working really well
what am i trying to achieve well the
first thing that you do whenever you're
about to hack a system
is you have to learn everything about it
when i did the ps3 i had a wiki
that documented everything on the ps3
um for the iphone i don't think i had a
wiki yet i think i just
duh like
the cool thing about reverse engineering
this is
like wikipedia has
when you're looking up something
specific from the iphone for example
there was a binary called bb updater
um and bb updater was uh
the the thing that updated the baseband
oh man you know
i think back i think back in like how
long would it take to do that iphone
unlocked today
in no time at all
um
i worked at a i was an intern at spacex
it's
people work very hard there people are
very motivated by the mission
um oh just because of my skills about
the iphone
hi galactic thank you for subscribing
a promoter that drives expression of the
protein
this
what is this website
it's like ipfs
huh
i would see ya
that's cool she's a crypto coin
oh it's good of them they actually have
something
can you see a coin 54 million
cool
do i think elon's overrated no
uh i think
i don't know why we got derailed on this
topic but
i think without him there wouldn't be a
spacex and a tesla
and when i think about what companies
are actually doing anything today to
push the envelope those are the first
two that come to mind
right google and facebook have
metastasized
i think elon's foundational science
is physics he's a modernist
and i think my foundational science is
information theory and as disgusting of
a term as it is i'm a postmodernist
you know elon knows a lot of physics
um doesn't know as much about you know
like deep learning and stuff
remember that time that you know this is
why elon always claims that he's going
to solve self-driving cars in a year
that's the growth is exponential man
i don't know boring companies the
dumbest shit
i i think boring company is uh
like nerling's cool but he's not going
to achieve what he claims with it
um boring company now that
what i'm not doing any security shit man
we're doing in security now computer
security is played out and you know
overrun by losers today don't don't do
that shit
computer security look when i did it
like
15 years ago it was cool
like hacking was this
like true
um
you're like reading fracking stuff
today you're going to devry university
and getting a degree in cyber security
you know
all right uh
based on
injecting dna that
synthesizes
spike
i spelt synthesizers wrong so i'm just
going to use expresses
uh
we learned what plasmids were that's
spider beer video guys very cool
build apis around corona solutions
this seems stupid but
we'll give it a try
what i know a great api it's called csv
a poly a site after the coding sequence
an origin or replication and an
antibiotic resistance genie
there and they're in plasmids
um it's cool how it works the spider
beer video describes it basically you um
only some of your bacteria are going to
take up the plasmid right and then the
bacteria replicate and they replicate
the plasmid hopefully too
but you're left with you know a really
large percentage of bacteria
that don't have the plasmid and how do
you separate the ones that don't from
the ones that do well your plasmid
includes an antibiotic resistance gene
you put that antibiotic in the solution
and then you're left with only the good
bacteria
the spike protein sequence will need to
be synthesized by a third party
so the spike protein is this many amino
acids
maybe cobble together
can you synthesize a whole plasmid
like if i go to one of these gene
synthesis services
how does it does the dna just come in a
vial
oh they do cloning do they put it in a
uh
i mean there should be a service
actually that can give me
will be delivered dry
in a circularized plasmid
5 000 base pairs
all right so i get 5 000 base pairs
um i mean all right well i'm wasting
that many on the stupid spike protein
and i hope i can fit that other stuff
in you know we gotta we gotta run
packers on our code man
uh and then all right so what's well
it's only gonna cost me like
this is gonna cost me like four grand
bros
you think if i sent them you think if i
actually sent these people like the
coronavirus spike protein mixed with
like a couple other plasmid ship that
actually make it for me
i don't mean to steal these people's
idea but you know they're gonna do it
well and i'm gonna do it shitty
um
and i feel like i can get this strand of
e coli to do the replication for me
yo sick bro we're making bacteria work
for
us we're not just killing them anymore
you see it used to be
we'd fight them and now we just kill
them
but in the future bacteria are going to
work for us
um there's a buffer overflow at the end
of fda's
there's a's at the end of everything
apparently um
i forget exactly why i think it's
because whenever it's copied some of
those a's
fall off sometimes there's like a's at
the end of your dna and eventually like
the a's start to get eaten up and then
you die
yeah telomere that's it is it called a
telomere
compound structure region of repetitive
nucleotides
wait that doesn't look like a's
wow this book's full of words that
i don't know
endo free giga prep kit
oh good thing they don't have endotoxins
in them
wait which kit was that a giga prep kit
wow
should we start buying some of this
stuff you think it'll get here
we should try some simple stuff first
you know when you start pwning stuff you
don't start poning
you know your first buffer overflows are
in joke programs right
so like yeah we make like you know
glowing glowing yeast or whatever
good compilers for this and stuff
the spider beer guy seems like he was
just sticking them together but i will
be i will point out that i haven't seen
that project actually get finished
get a thermocycler and start doing pcr
yeah all right let's buy a
does thermocycler have a good
recommendation
genome compiler.com
doesn't work
gene.org
why do you think this stream is better
what changed
ready to use viral vectors eh
oh no it's prone to dimerization i
definitely don't want that or do i
is that a good thing oh no
oh bad m kalama plasma sent in bacteria
as
agar stab go you ever remember those
strep throat kids oh yeah like and then
you rub it on the plate
the doctor let me rub it on the plate
once i thought it was cool
well that was crazy that's what they did
back in the day
i'm sure they'd never show that to you
now you know what i mean
i i mean i don't know i've been to the
doctor in a long time but like when i
was a kid
i go to the doctor and uh they'd want to
test to see if i'd strep throat
this was sick and they just they'd stick
a swab down your throat
and they'd uh rub it on an agar plate
and then they put the agar plate in the
in the heater
uh and they had the quick test and the
long test
i think the long test they didn't like
put it in the heater or something
because some of them like
died by heat or something and then they
would just look at it and be like oh
yeah those bacterias we're gonna
prescribers from amoxicillins
this ad gene set is amazing for learning
these methods
oh if i'm conducting coronavirus
research they'll prioritize my order
that's nice of them
i don't think they give you adderall for
strep throat
virus of the day oh
so cool
it's got a lot of stuff in it how many
base pairs is that
is that base pairs or is that amino acid
it's probably base parasite
six kilobases
all viruses are expensive
who are these people it's a non-profit
plasma
wow
i can send them plasmids
wait but i mean i guess okay
these things i guess i think dna i guess
is mad stable
oh i can get crisper plasmids
look at all the stuff i can buy it's an
empty backbone
man if i could just write the right code
you know
you have to contact specific labs
i mean they'll check my credentials what
do you mean credentials what are my
credentials
create an account
i'm in the united states uh
academic i'd say uh
oh type in institution
hmm
huh comma ah
um no we can i'm sure we can set up and
what do you mean by an institution man
what's an institution do they have do i
have a description of what it is
do i need to buy a thermocycler first
and then put it in a thing and put a
little sign over it and say
you know what should we name it guys
yeah yeah
no i'm not coming as an institution
ordering how do i create an account
what is an mta
uh
they still make it clear to me like what
is a lab
verifying the status of your
organization
yeah yeah you know i see i say um
yeah we'll just because we could set up
and set up an organization
exactly yeah i can a lab is a place
where i conduct welcome to welcome to my
my lab um we conduct experiments for
research here
uh now
see that's what sucks about bio man i
don't know why i'm looking at my first
food here is there a lime should we eat
a lime wine was delicious
line
this onion is sad
can you eat onion potato
you guys see the waffle maker
three chips
i heard about sous-vide okay how do i
sous-vide
vrv exe thank you for subscribing
i used to have a vacuum sealer
i used to smuggle weed into burning man
and then i got my car searched in utah i
didn't have any weed
some bullshit that i got searched they
found my vacuum sealer
cops like what do you use this for
if i'd known about sous vide i would
have said sous vide
there we go
um but i don't have a vacuum sealer
anymore oh yo
guys no real talk though i bought
something today
okay
if you do get coronavirus important to
have
how am i doing
oh oh yeah 99 that's right
um yeah but i don't have thermometer
unfortunately
my lab is very under-equipped uh
so tomorrow i gotta wake up at 7 00 a.m
and go to rite aid and stand in line to
make sure i get one of the seven
thermometers and the thermometer rations
um no my oxygen is 99 it's good
now it's percents bro
yeah if that goes below yeah if that
goes below
uh 95 it's time to start worrying
um i mean the other thing
that i don't have in my house that i'd
like to have okay so it seems like
there's like
four stages to coronavirus there's the
asymptomatic stage
uh some people never get past that
there's the symptoms but they're
flu-like and manageable and your
pulse oximeter won't go below um
you know it won't go below 95. if it
does go below 95 you need oxygen
uh and then if the oxygen stops working
you need a ventilator i'm not going to
go so crazy as to buy a ventilator but
if i could buy
oxygen i wouldn't mind it
um i mean this is not like four states
it's not stages but it's like
you know how far the virus can progress
in each person right
the oxygen balloons no like
i was looking this up it's oxygen
concentrator
if you get coronavirus you think you're
gonna die you're probably not gonna die
bro
you might but it's unlikely
i know the demographics of my stream
oh yeah at lunch at work today we were
like uh
you know this this this uh it seems to
affect men more than women you know more
men are getting infected with
than women and then
you realize that the reason for this is
probably because men don't wash their
hands nearly as well as women
you're 95 well okay maybe you're gonna
die
you're a cobalt programmer
ah
i mean this is the thing right
uh treatment
uh low
blood oxygen level
oh here we go
i know if i buy an oxygen machine i'm
just going to use it all the time
liquid oxygen tank should i get one
oh damn have a fire extinguisher close
by
i'm sure they're all sold out
wow
that i was looking at those are just the
batteries but here
seven liter
do you hook this thing up with a tube or
can i just have more
oxygen in my house
i kinda want one of these
oh no no
what else do they sell
i can't man i can't you want to buy an
oxygen machine or you want to buy a
mobile wireless charger
a whistling catalyst with shitty
okay maybe these aren't the guys we want
to buy an oxygen machine from
it'll be here in may after everyone dies
[Laughter]
recreational wait
[Laughter]
yo man is that nitrous nah bro it's
oxygen you want to hit
wait i mean honestly
like i want one of these not just to
save me from coronavirus but like
it delivers air through a sub headset
well you carry on working so you can say
goodbye to coffee jitters and unplanned
naps
is breathing oxygen bad for you
i went to one of those oxygen bars once
when i was hung over in vegas it was
pretty nice
don't they don't one of the ways like
the cyclist guys cheat
is they uh
wait
no no no no no no no
they'll sell anything to people
what's this
no it's sold out
everyone had the same idea they bought
all the oxygen
oh one new oxygen march
27th that's not that far away
let me see if i'm logged into my amazon
on this other browser
yes i am
you can remove those proceed to checkout
whenever it gets here we now have 20
worth of oxygen showing up
oh wait no it's not going to show up
till april or may never mind
cancel order no no i'm not waiting for
april 27
to may 6th i'm out item would not arrive
on time
all right this really got derailed
i think i think yeah i think i think
we're gonna call it a night
um wow 666 dollars uh yeah i think we're
gonna call it a night
thank you all for watching tonight's
stream
uh what did we do tonight
well let's make sure that
what do we do tonight we went over some
some curves we
made a little bit of progress in reverse
engineering we went on some tangents
about
oxygen yeah we didn't really do that
much tonight
um maybe we'll stream tomorrow
no promises for stream tomorrow
the first stream starts the strongest
and then the streams kind of fall off i
feel
um i'm kind of tired
i don't know why i'm tired fatigued man
i have coronavirus you know
do i like jazz music no
who do i crack pile solver
all right we'll do we'll do three minute
q a
who's being racist no racism in my
stream that's
right do i have plans to develop agi
yeah maybe we'll get to it after
chronovirus
um fireflies man oh that's a good song
would i use neural link as a first
adopter hell no
how do i manage my passwords i'm not
going to tell you that
how did you get into programming and how
do i improve so fast let me tell you
i've been programming since i was
five i don't know if you call 25 years
fast but
um is our company thinking about
expanding into bioinformatics
no comet ai solves self-driving cars
me personally i'm gonna start a buyer
lab and then buy things from
gene bank or whatever those things were
um
no well use red or blue switches i got
the toe brake capacitive so we never
talk about keyboards on here
yes i've heard about rocket league i
played rocket league
do you have asperger's asperger's
uh i don't know man you tell me what's
my first program it printed out like pp
and poop and stuff and i thought it was
funny i was like
four um don't hit
you know whenever people ask about
adderall
because i feel like i talk about it all
the time can
can all you guys in the chat like just
respond to the adderall people with
my usual spiel on adderall
how are you as an intern give me a job
at common ai
or you want to be an intern in the bio
lab well the bio lab doesn't have any
funding so
sorry about that comment that does
though
best way to learn computational linear
algebra
what do you mean by computational linear
algebra i mean like deep learning
why is elon saying corona is a joke i
don't think he said that i think he said
coronavirus panic is dumb i'm like
yeah coronavirus panic is dumb panic is
dumb man
you know like like like if you're
referring to those people who are like
hoarding toilet paper and stuff like
yeah that's dumb as shit man
toilet paper is not even an essential
good
off the top of your head recital line of
code you'll always remember
int main parentheses into arc c
char arc v char star
rv little thingies clothespins
do i still meditate yeah i mentioned
yesterday
um no don't be smoking these days man
coronavirus is out there someone really
psyched me out about that
if everyone's gonna buy toilet paper i'm
not gonna be the idiot that does not
that's a good point
uh thoughts on
unpaid internships didn't obama make
them illegal
oh i gotta write a bot do i have enough
toilet paper i'm not gonna tell you man
um
i'm motivated about the future of comma
yeah
man
thoughts on you getting mod low
attacking is too commercialized nowadays
it's true but you know what's not
commercialized
bioman there's a whole wave of
bio that's just gonna be taken out from
underneath these
shitty medical organizations you know
think about it man
yeah i was going to use an example of
something but i shouldn't talk about
that but
the uh
the things that the open source world
can do
and can do so quickly if
everybody at home had dna printers
uh i mean we probably would have died
from someone releasing something
terrible but
you know we also would probably uh
have a vaccine by now right just imagine
how many people at home
would be willing if they had printers to
just experiment on themselves and like
try a whole bunch of different things
you know like just print out plasmids
print out plasmids print out plasmids
inject them
see what kind of response you get
um
it would go horribly for some people but
very quickly we'd figure out what works
and what doesn't you know
universal health care you mean the
government being in charge man
what is the government in charge of
that's good again
don't make me bring that graph up again
but you find the things the government's
involved in like education and
healthcare
are terrible and things that the
government really has no say over at all
like tvs are awesome and things like
cars and housing are somewhat in the
middle because the government has some
say over them
software is also software's also gotten
incredible
fire departments that's true though you
do want the government involved with
fire departments because
do i do i give this example it's
probably one of the things i talk about
if you had a for-profit fire department
putting out fires isn't that hard there
aren't even that many fires i mean you
know they'd set up as a consulting
service to prevent fires
but eventually really they're gonna have
to get growth
you know they're going to show their
quarter-over-quarter growth of the
number of fires they put out
and there's just not going to be enough
fires to go around so you're going to
get a skunk works division
and this is just what the incentive say
you're going to get a skunk works
division the arson division right
i mean you know they don't tell the rest
of the company but they start the fires
fire department goes puts them out and
growth goes up right remember the
episode in silicon valley where they get
the
the click farm you know faking all the
clicks it's arson division yeah
no health insurance is not exactly the
same
you think they're going to make people
sick i think that's i mean that's a
little further fetched than uh
there's a lot of people there's a whole
lot more people out there
who will do uh property damage like
things
right and look here's how the arson
division would work right the arson
division is not going to go around
burning random people's houses down
they're not going to be very popular
they're going to find somebody who has a
nice fire insurance policy and burn
their house down right
there's a whole lot more people out
there willing to do financial fraud than
actually like do harm to another person
food deserts already make people sick
i've never was there where's these food
deserts man
people's always talking about this you
know
there's sleep paralysis no
favorite conspiracy theory infinity is a
scam i'm a finitist
keep it up they help us all stay calm
thank you
thank you they kind of helped me stay
calm too it's nice and calming
um we're destroying people's lives in
the global economy for less deaths than
the annual flu
well so here's the problem with that
uh you know and i yeah i want to say
like like
in my personal life com ai is still
shipping out
products we're shipping out products on
schedule um i think that it's important
while being safe from coronavirus to
keep the economy going as best you can
um i think that yeah i mean i think that
the economy is really important but
right now it's less deaths than the
annual flow if if this thing spreads to
a huge percentage of the population it's
going to be a lot more deaths than the
flow
right you can't just say like right now
it hasn't right right let's say i
i uh i have a car that one out of ten
cars
uh you know uh randomly jerks the
steering wheel and drives off a bridge
right
and let's say i've sold 100 of those
cars you could be like well yeah but i
only you know it only killed 10 people
man you know
toyota cars killed like 12 000.
well yeah but you know
you sold as many cars as toyota you see
the problem
the mortality rate is significantly
higher in the flow
taylor and camera feuding oh is this is
this more of that because kanye yo i
made that bitch
famous uh
you an anarcho-capitalist i don't know
what that is man
you know my thoughts on anarchy is p
equal to np i don't think so
but i do think that p equals uh bpp
uh sorry bqp
uh b also equals bpp but i think that
one more people
accept um
don't don't p values trigger me don't
get me started on p values man
p equals fc squared
how do i feel about ethereum 2.0 i don't
know i'm about to have an opinion
we'll win the next election no no
i'm not in the politics man i think joe
biden has dementia and then like
america is going to have to choose
between you know a man with dementia and
trump and like
well we'll see what we choose
who do i think is gonna win i think
whatever predict it says
love your call i'm glad you let me call
uh
bqp times bqp equals bqp
not bqp i don't know z distribution
you can go to any doctor that you
willing to wait for
meaning you don't have to go within the
network
for free
when do i think coronavirus will be last
week's news
um i mean what's going to happen that's
bigger than coronavirus
thank you i should i try to i feel calm
tonight
i didn't feel so calm yesterday i do not
wear crocs
no
um i mean
when was 9 11 last week's news right i
mean at some point it was
i don't really believe that bch is the
real bitcoin i think it's a funny meme
i don't think there's any such thing as
the real bitcoin that's why it's funny
911 was last week's news like seven
weeks after it happened i don't know
about that
um you know i was there i lived uh
i lived half an hour from from the world
trade center
um and
they say something from school early and
you go home and we didn't have a cable
tv back then we had antenna tv
you turned the tv on and channel two
works but
4 5 7 9 11 and 13 don't
you know why
george hawts don't don't what
how's the stock market crash effectively
to be honest like yeah i have less money
it's all fake anyway you know
uh if we solved cancer or heart disease
do you think coronavirus would be a real
threat
no cancer and heart disease are a much
bigger deal than coronavirus
oh if i had you know if i get
coronavirus i'm not that scared if i get
cancer
shit man i'm not talking shit about 911
men
i'm not talking shit
what do you think i'm talking shit man
cancer can't be transmitted
yeah no i don't know so i mean i think i
think
uh coming back to the original question
like uh
i i think that that story i told not
talking shit i'm
more saying like that was just what made
911 extremely real for me
i mean it's weird you know small things
like that uh
am i a virgin
uh
am i as scared of ai's elon i don't
think so
no
i watched the first episode of the bill
gates thing
where do i see myself in 15 years i
don't know
um no but i think i've got something to
think about like when will this be old
news
people are going to talk about it for a
while
there's a lot of there's a lot of uh
you'll see like the volatility index of
the stock market's extremely high
um check this out i can probably google
let's go
yeah now just give me that but for
longer
if someone wants to link you guys do a
great job with us
oh yeah this is cool
huh
why is that lit up that's the recession
that's coronavirus
well it's good that volatility is going
down
wow what happened then
yeah that's i mean that's the financial
crash from
this is cool
i don't think brexit was actually that
big a deal
um i also don't think trump's election
was that big a deal
does the government shut down honestly
does the government do anything besides
take our money
that's kind of how i feel i mean
if the federal government shut down i
mean the russia
government shut down and it was kind of
okay
um so yeah i don't want to give the
power back to the states yeah that
sounds
like something
do you think corona will dip off on us
for us to have a good 420
no these i think these next two months
are going to be rough
i will see it might taper out
but the problem is if it tapers out and
we if it tapers out because of the
quarantine measures
as soon as we let up on the quarantine
measures it's just going to go
up again
um
do you think human response to
coronavirus would be
adequate enough when faced with an
actual viral threat
i think this is definitely an actual
viral
threat i'm not sure
i'm not sure what more you expect
to be fair if this thing had like a
50 death rate
i think everyone would respond way more
extremely
and actually i think if it had a 50
death rate it never would have spread
right like you think about it like that
you think about it
once things become too deadly
humanity will go to any extreme to stop
them
but you know my age range corona 0.2
chance of killing me all right you know
how scared am i if i get the disease
a one month incubation 50 percent yeah
we
would be under marshall on a minute um
where do i think it's gonna stop
i think give it two more months
and we're gonna have a really good i i
think
i think even in a month we're going to
have a good idea of an answer to that
question
um oh yeah i should play those games
pandemic and plague and stuff
what human language is
[Music]
no hablo rappy though
i'm just like uh who's that guy marco
rubio or
plague.com
no no that's not that's not that's not
the game
is that the game
like pandemic is the game
this is good with the reviews
if it's banned in china it's got to be
good overwhelmingly positive very
positive or i'll do it um
i don't wanna show you guys my steam
account shit
uh let's do it over here let's play some
play game
it's gonna take a long time to download
plaguing evolved yes
yes um
add to cart purchase for myself
you must agree to the steam yeah yeah
yeah
yeah sweet
install content
all right we're downloading plague
yo look we're playing games
would like to receive keystrokes what
no
all right my mouse froze
dimension
there we go oh create my very own fake
news story all right let's go
um wait let me first see can i make the
resolution bigger
[Music]
i have to unlock the virus okay we'll
play it with bacteria
oh damn this is like
um all right all right fine
i'm a new player let's play it on casual
name my plane sars
no it's a bacteria we gotta name it a
bacteria
polio v2
let's go hang on i'll make me smaller so
you guys can see the whole game
casual is really easy is it too easy
select the country to begin my plague
well we know what country we're choosing
let's go uh
okay oh good i love that they haven't
grounded the planes yet oh
all right what can i do
oh look at those hot spots oh no
no no i didn't mean to click there
i'm gonna minimize this so it doesn't
keep doing this
okay well good right i think we got some
spread to mongolia
you control the plague indirectly by
evolving it
here we go
all right all right
[Music]
blood to blood oh poor musicians
oh insects
oh that sounds nice yeah
oh yeah if i just increase the
infectivity we'll get everybody
severity doesn't even have to be too bad
i don't think we want severity if our
goals is our goals just to
infect everyone or to kill them all
[Music]
trump's playing this at all
[Music]
you're on the wrong team bro
[Music]
okay why does this affect me
[Music]
let's see what the symptoms are
oh yeah i like that yeah yeah yeah let's
make people unable to sleep
[Music]
oh hypoxia
abilities
[Music]
it is bacterial we should really spend
some time on antibiotic resistance
yeah business as usual no we gotta shut
this down
i can't believe they banned this in
china
i love that we live in a free country
guys
upper right oh i can increase the speed
oh i see
oh people are being infected faster and
faster okay
wait does time stop when i do that
now we got we got to make it more
effective
[Music]
yeah sweet
oh yeah spread to russia
look at that that's a lot of infected
people
it's not killing anybody though oh
no aid initiative
there we go yeah that'll get those poor
countries
oh yeah sounds annoying
oh yeah
oh more infectious from tv
all right we gotta slow this down people
are gonna start to respond to this fast
now
world menu
okay all right that looks like a lot of
the world that's pretty good
sweet they haven't grounded anything yet
oh yeah you got on a plane that was a
dumb choice
[Music]
birds insects
oh air that sounds good
um
that's a good point
we need 12 okay we got to get a few more
and then we're going to buy that
yeah that's right
oh look we're seeing all the
harmless disease oh
harmless you say
oh perfect
so
so
that sounds nice
i mean i guess my question kind of is if
i then change the
symptoms
research priority law oh good perfect
there's not enough dead people though we
gotta increase the number of dead people
how do we do that
[Music]
oh no they shut down the borders
fatal source of gangrene yeah
but if people die aren't they gonna do
more research
oh
oh yeah what else makes it more deadly
oh yeah that's good
so
foreign
people are looking for a cure now let's
pause
while we figure out how to make sure
that doesn't happen
yeah that's right
slow down your research
[Music]
when are they gonna find a cure
oh that doesn't seem good
[Music]
all right we haven't gotten africa yet
let's get africa
[Music]
what's gonna make it spread in africa
livestock yeah
[Music]
oh insects that always gets them in
africa
[Music]
extraordinary mutation patterns
what was morocco hard
algeria hmm
it's hot there
i think that's gg
there's definitely a way to lose this
game i just played it on easy mode
well that's a brutal game so glad i
don't live in china where we have you
know
we're in america where we have free
speech and we can play games like that
wait i haven't gotten everybody yet
um i think we need more symptoms
yeah that one's good
that one's good
those last million aren't going to find
the cure
so
pretty cool
play on the hardest all right all right
all right play hard mode alright i got
you
all right you know what yeah yeah that's
that's a good idea well we'll end the
stream on a hopeful note where i lose
that that's that's a good idea plagues
don't always win sometime
humanity triumphs
then there's a new mode to save the
world by popular demand
oh and normal or higher to unlock let's
see the scenarios
huh we'll just play on hard
covid 69.
all right well we'll start this one in
in the usa
all right
i like it surviving in water
too infected can i lose before they even
like spread it at all three sweet
[Music]
hmm you'll get them on birds
[Music]
so
[Music]
top-notch dynamite
world of pc
and i think the first idea is to spend
on infectivity
are a bunch of people streaming this
oh
all right rats i'm sold yeah get the
city dwellers man
oh coughing symptoms sweet
level two hype train yo get this hype
train going let's win mega brutal
this pathogen kind of sucks why is
everybody like washing their hands
all right should we upgrade for double
rats
birds no no let's get birds
15 dna points
my
this game is actually being extremely
generous to me this thing would have
died out a long time ago
i guess it's a bacteria and you can have
like a deep reservoir of it or something
what do i do
[Music]
it's the problem with time you know
okay we gotta get the birds
but it's not even spreading in the u.s
you know why don't i pick um
a less developed country
perfect
so
we still have the same five people
so
is this just just brutal just take
forever
it's only about five people strong
dry winds
i need more transmission yeah yeah well
i don't i only have four dna points
upgrade abilities
i don't think so
any more transmission i think i already
upgraded a lot of these
you can try livestock or we can try to
get one of these
[Music]
where are we right now i mean those are
those are fairly rural areas of america
i don't know if that's accurate
guys this disease is boring
[Music]
yeah we're gaming no 3400 maybe in
ethiopia from the tsunami
oh the tsunami killed him well i'm
losing to a tsunami
all right all right eight people all
right no six people never mind
mexico that's a good strategy i like the
mexico strategy
what will spread it to mexico
all right let's save up for that insect
one 24.
mexico closed its borders over 10
diseases
no they didn't oh you mean irl yeah irl
i think they did
the irony
so
do we save up for the super rats
fudge the death toll numbers
yeah i can devolve but i barely get any
points for it
it seems like you just gotta like be
patient wait for those things to pop up
no i can't can i put rats i don't think
i can put rats can i
[Music]
so
bird seems like a good deal me 22.
oh devolve all symptoms okay
wait it costs money to devolve i don't
even get it back
i just spent money on devolving
not all the ones that gave you
infectivity
you get small amounts back no it looks
like i just spent things and now i have
less infectivity you know what
ultra brutal winds guys
ultra brutal winds
ah
you know
humanity wins that's that's a pleasant
note with which to end tonight's stream
on
uh maybe i'll stream again tomorrow but
probably not i probably will stream
again wednesday
no no more q a really did q a it's
bedtime
good night everybody thank you all for
watching we are gaming channel
our christian channel we spread love
and everybody subscribe to me so we can
spread money and by spread money i mean
spread money you know what i mean i
check my twitch i'm like damn i'm making
money i should stream more
but then i remember that i don't do it
for the money i do it for the love
goodnight everybody
WEBVTT
Kind: captions
Language: en
afterworktech: we back
afterworktech: I like the new sound of the keyboard really relaxing.
Lana_Lux: 374 raiders from Lana_Lux have joined!
Lana_Lux: HeyGuys
Lana_Lux: oh we're in the library today?
Lana_Lux: LUL
afterworktech: ASMR stream &lt;3
afterworktech: Thank you for the raid @Lana_Lux MrDestructoid
Lana_Lux: sounds good :)
afterworktech: If anyone is interested in tinygrad a very good intro to the project here https://youtu.be/kh2z9J_gXWg?&amp;t=7440 | https://tinygrad.org/
H4nsec: H4nsec subscribed at Tier 1.
Fredirecko: Fredirecko subscribed at Tier 1. They've subscribed for 3 months!
xakerado: xakerado subscribed at Tier 1. They've subscribed for 4 months! Communists
satanic_pope: what's happening playa @georgehotz
Gadaros: Hey @georgehotz its always nice seeing you bro!! Whats up!?
AerisThor: I like the new keyboard's sound
khargoosh: khargoosh subscribed with Prime.
khargoosh: Hey George I wanted to say thanks for your Playstation work. I really appreciated getting Other OS back for a little while.
gliched_robot: I am writing a lora finetuning for tinygrad: https://github.com/Prakyathkantharaju/tinylora
gliched_robot: here is an answer from perplexity which does that: https://www.perplexity.ai/search/dataclasses-with-child-ue25LUoDRI6zZP_x5W5jyA?s=c
lava4o4: how come certain text in the command line is colored?
StackSample: emoneyLemon
OMGizGoZilla: hello George
Saas_1_: Both
lava4o4: i like this format
MDSZilla: Both
git_stash_pop: GoldPLZ GoldPLZ
lava4o4: and the other one as well
SekstiNii: can we shit on harvard now
StackSample: I liked the PianoTime bit
Saas_1_: this is nice for having it on in the background
lifeofAwais: I don't know everythign is relative to how my day went
good morning my
friends
I cleaned my
room you're a good man Charlie
Brown you
know
we hate AMD we hate AMD we hate
AMD all my homies hate AMD let's not
hate AMD let's pity
AMD uh that's what we do on this stream
we we we we pity AMD um you know
it you just you just like no did they
open up their they're not going to open
up their firmware they're not going to
open up yeah you think they're going to
meet that Monday day deadline you think
there's any way in hell they're going to
do
that
uh no I mean look Lisa Sue responds to
my emails we we had a nice exchange back
and forth she's very polite but she
doesn't say
anything so it's it's it's emails that
that again are just like they don't say
it's it's it's a it's a style of
communication that you see a lot in
business where people just literally
don't say anything like why don't you
just I I'd much rather did you say like
fuck off then like write me three
paragraphs that use the words like
Partnerships and
strategic right like why don't you just
talk like a person so again very
nice which which makes it hard to be
like angry about but you know you got to
be a little bit smarter than that right
like you got to look past
I engaged with AMD over 100 emails
multiple Microsoft teams calls and they
gave me nothing right they gave me
absolutely
zero uh thing of any sort of
substance um so you know I I don't know
I don't know if there's like a word for
this Behavior again if you're not
exposed to really how
like it seems
like I don't think business used to be
like this right I don't think like like
Walt Disney or Henry Ford acted like
this I don't think they would like you
know
I think Walt Disney and Henry Ford would
be like you're an
idiot
um delegate no I'm not delegating to
someone that's not triggered by business
and knows how to navigate no no no no no
no no you
see when you give up on your ideals you
lose everything I love that line L told
me you'd be a pop star all you have to
change is everything you
are it is it it is the managerial
class you know again look qualcom CEO
doesn't even reply to me
um Jensen went for a ride in the Nvidia
in the in the comic car once
uh you know which which is interesting I
think thinking back on that um it's just
it's obvious why you're going to be
successful I don't think
that uh
Bill huet gave gave Steve the spare
parts to build his frequency counter
yeah yeah
like I mean it's just it's not going to
change I guess you you get these sort of
people who end up running these
companies
who
like it's very much like like a Don't
Rock the Boat sort of
strategy
um how hard really is it to make your
own chip it's not we're going to make
our own chips look we're also we're also
still likely going to get AMD on ML perf
and we're here working with with okay so
the mistake that I made so that nobody
repeats this mistake do not work with
the company work with the product okay
don't waste a minute thinking about the
company I don't know why I didn't
realize this with AMD I did realize this
with the car companies I I realized that
there's no way we're ever going to talk
to Toyota and ask them uh please sir can
I have the uh steering API for your your
LC
module
uh like I didn't I just knew that was
impossible um I don't know and maybe
when I started comma it was the same
crap right actually when I started comma
I took meetings I took meetings the
amount of clowns that came to my office
like total and complete clowns the
Rolls-Royce guy would drive us around to
Rolls-Royce and take us out to dinner
right and then you realize he has this
job um I did realize this with ttor what
do you mean realize what with
Tor no look I think that t Tor is an
underdog and they're not really like
they don't feel like they have a lot to
to
lose in in in
reality again like tens torrent looks
Leaps and Bounds better than than Gro
for for
example
um I'm the Toyota CEO and here's your
API uh
like remember also that I think that
these these people are so encumbered by
uh like lawyers and license agreements
and
stuff again I I wish there was just more
I guess I don't like the style of
communication I wish there was more just
honest
like George we can't open source the GC
the GC is we have three agreements with
these three shit companies and they have
these terms and we just can't open
source it why don't you just say that
you know just just be
be uh honest instead of this again it's
very nice but it says nothing right it
tries to communicate a feeling instead
of uh you know like a like a like a
thing
my experience with qualcom made me think
AMD responding to me was legit yeah yeah
I think that I think that's that's part
of it you know we're just trying to
We're just trying to navigate we're just
trying to change the world here we're
just trying
to
um I'm kidding about the the like you
know look the by Monday thing is not a
uh you reply to that tweet and say look
it's going to take 6 weeks for legal to
get get things together here's two docks
that we know we can release right like
look I understand it's a process but you
don't I didn't get anything like that
so um I never worked with paraly but I
met him a bunch he's
cool so I mean yeah like what what do we
do what do we what do we would so I
think I think I know what we're going to
do on today's stream on yesterday's
stream we wrote a uh
oh yes I've met I've met Jim on on
multiple I've hung out with Jim on
multiple occasions
um the these guys
are Jim Kell Palmer lucky they're even
Elon Musk they're they're they're very
much what they seem to be I I think that
you'll understand uh who they are by
watching any of their
content I guess what's so weird is like
you know just you can watch some Lisa
Sue content and you understand exactly
what you're going to get right you watch
some Jensen content you understand
exactly what you're going to get I guess
you watch some me content you understand
exactly what you're going to get
um it's not po it's just it's just
like
what it is is that they don't want to be
great um they don't they don't desire
greatness well no I didn't there's no
need to ask apple or Nvidia have you
ever seen apple or Nvidia have you ever
seen their driver crash
no uh I don't think I've ever seen
Apple's driver crash uh we have a bug
now with the metal graph API but I I'm
sure it's cuz we're not using it
right um I I I've never seen like
Apple's driver behave in a way that
looks like there's race conditions in
it um I've never seen aidos driver
behave that way either it's this is just
this is just yeah how was Intel so far
the guy in Discord saying that they had
an eight guy meeting with a VP like like
like what just I'm picturing I'm
picturing a gang bang man like that's
all I can picture you
know
um do I think a new architecture can
help AMD or is the firmware going to
suck forever no they have to desire
greatness and that's you can't you can
lead a horse you know they just oh
you're running it on power eight well I
don't how to help you man get an AMD
epic system run the Nvidia driver you'll
never crash the Nvidia driver So Lisa
Sue has to go no I don't know about
that
um I just I I just think it's a real
it's a real
mismatch
of you know tiny grad
desires
greatness and AMD
doesn't AMD desires to be second tier
Nvidia for slightly less
money uh and I don't
think well tiny grad desires to be the
best machine learning
framework we live in a lot of things
today like that are win or take all like
I I do think it's going to be pretty
winner take all I know greatness
requires time I'm I'm not saying it
doesn't require time tiny grad is not
going to be great tomorrow it's not
going to be great in months it's
probably not going to be great next year
I'm thinking about five or 10
years
um I think there are some engineers at
AMD who feel like I do but honestly I
think less and less my guess is what
happens in cultures like that is
like no one who desires greatness will
tolerate
it
um
I I'm saying that my interactions with
with AMD showed me that what they desire
to be is always second place is
always is always is always Med well oh
you know the firmware you know it's not
yeah it's not great but like so why
would anyone buy
this um do I think the radon division
needs a new CEO I don't really know like
it it's hard to judge somebody without
understanding their goals and not
everyone's goals are greatness not
everyone's goals are you know truth and
Beauty
um does t aim to be high performance
across Hardware Partners well provid s
good uh yeah yeah we do
um generic
Solutions don't fall short just think
about the bitter
lesson uh is it easy to switch to
another graphics card yeah we already
switched to we already switched to a
video um
we on our first on our first try we
trained a reset on
649s
um yeah I can show you the the ml per
flog I just like like like if if we had
run that and the Nvidia driver somehow
crashed I would have been shocked beyond
belief like I would have taken 10 to1
odds against that happening and of
course on the first try uh the Nvidia
run
succeeded um it's just as fast as the
AMD and it will be faster like like all
the optimization and work we put into
AMD just Nvidia just beats it right
away
what I think about
grock why did anyone fall for grock's
stupid demo some guy in here yesterday
was like I get 400 tokens per second on
two A1 100s and I believe him it's it's
a meme
it's no and actually AMD is in real
trouble uh because what's going to
happen no
I can't believe people fell for grock no
zuda is not going to help no amount of
like the only thing you can do in user
space is mitigate the problem with AMD
gpus goes down to it's not in the driver
it's in the firmware and there's a
chance it's not even in the firmware
it's in the hardware the the drivers May
the gpus may very well be broken at some
deep Hardware level are they really that
bad
yes uh
don't
don't buy a what however whatever your
budget is buy a less powerful Nvidia GPU
at that budget and you will be so happy
you did um I mean if you enjoy if you're
a masochist and you enjoy pain and
suffering purchase an AMD
GPU
ah and like their their their process is
not going to did I figure out what
architectures use for the firmware we
could do that on the stream if you want
I'm sure we can figure it out today if
we spend all day on it but I think we're
going to do something
else um but you're just
gaming so what's going to happen in
gaming if AMD loses too much market
share in
gaming uh the game manufacturers are
going to start saying this just isn't
worth it if it takes any more effort to
support it's it's a it's a negative
feedback move so as gaming becomes worse
less game manufacturers and and as AMD
gets a smaller market share less gaming
manufacturers want to put any effort
into supporting AMD right if I'm testing
my game but only 2% of people have a AMD
GPU why am I going to why am I going to
spend resources
here
um yeah I mean amds and PS5 and Xbox
because do you want to try to work with
Nvidia do you want to we tried to buy
chips from
Nvidia they're they're I'm sure the big
companies have the same problem Nvidia
wants way too much money uh this is this
is look at the Tesla Nvidia thing um my
understanding of that is that uh you
know Nvidia wanted a large amount of
money from Tesla for uh compiler support
and Tesla was just like we're making
orang um so that's why consoles are
AMD as a render programmer in AAA we
always have to cover cover Edge case
special edge cases for AMD drivers that
crash exactly and
this is exactly what I said in my email
to Lisa I'm like what you are doing is
you are not fixing you're not root
causing issues you're writing
mitigations and you're writing
mitigations at every layer of the stack
if you don't root cause an issue here
you write mitigations here and now if
you have mitigations here and root
problems here you write mitigations here
and you write mitigations here you write
mitigations all the way to the
application
code um do amdg Intel gpus suffer from
the negative feedback loop well Intel
gpus don't have any Market share to
begin with so no games work on them
um how did their software get so bad it
was always bad and they have no real
desire to like change it and make it
better with the AMD chips desolder
themselves you know why you know why
Apple doesn't have any Nvidia discreet
gpus is that up to AMD to fix their shit
I
mean yeah like the problems lie in like
okay so they talk about about auler in
their firmware and they talk about how
the scheduler Deadlocks occasionally
when they're using an in order que so
they switch to an out of order queue you
can't switch a deadlock by changing an
in order que or an out of order CU that
makes no sense all all you'll do there
is you'll uh make the mitigate you'll
you'll just make it harder to trigger
right you'll just you'll just mask the
problem um I knew a software engine that
worked for radio and we switched to
working for NVIDIA the stuff might be
why
yeah
again you know they're not going to take
me up my offer it's not going to get
better um they may something may trickle
out that's open source from firmware but
they don't understand like what would
radically be required to compete with
Nvidia
uh you know what I'll say about
Snapdragon Rock Solid GPU
driver we we run the oh God like I even
think about it imagine we are running
the open pilot model on an AMD
GPU I have never
seen the Snapdragon GPU do anything bad
we run that open pilot model 100%
reliably pretty
much I don't think amd's Engineers have
bad intentions either I I don't think
Lisa Sue has bad intentions I don't
think anyone there has bad intentions I
I again like I said I can fix Qualcomm
with power over overnight I can't fix
AMD this is a much harder problem to
fix and I may very well like you know
again I I don't I don't know Lisa who is
more successful than I am so like I
don't know who am I have question this
right
um like maybe there's some strategy I
don't really understand or some goals I
don't really understand but whenever
someone's acting in a way that don't
doesn't make sense to you like they just
might have different goals than
you
what would be required to fix this
deeply
uh no I'm I'm not even going to call
this the managerial class
actually um let's see if let's see if
let's see if this is let's see if this
is
uh so I had a I had a dinner with with a
bunch of people in
Taiwan
and as much as open pilot people open
Pilot's pretty popular in Taiwan
and just you know you have couple beers
you start talking about
culture I I think that it's more of
a
like
cultural you know don't don't sort of
like don't sort of like rock the boat
whereas like contrast that to you know
if you read elon's biography about what
life's like in South Africa right going
to some like going to some like like
like like what was it called like wealth
school or
something
um no it's it's not a shame culture it's
kind of like a more it's a more
Cooperative it's a more Cooperative
culture a less individualistic kind
of um yeah B school that's
it a risk averse culture and one guy one
guy had a couple beers he was going off
he was really like you know the
Americans fucked us man it's it's like
we we do all the hard work here to make
these to make these uh to make these
chips and then Nvidia goes and sells
them at at a 90%
markup um seems pretty individualistic
yeah look it's not everybody I'm just
I'm just like like saying that if if if
we're trying to like understand this
from a from a lens that makes sense
right it's like not a like like bold
moves aren't going to
happen AMD can't afford to make moves
why
not I don't know I shouldn't say that
stuff like I don't I'm not trying to
like say like oh that's you know the
culture and all people from that culture
are like that I'm just like that's
that's a lens with which I can interpret
the behavior that makes more
sense
um yeah they have the consoles the CPU
cell they get something going and they
keep it that way and yeah it looks so it
just it won't get better the the the AMD
firmware is not going to get better the
AMD driver is not going to get get
better um
yeah what is
this
wa a bit more expensive I'm cheaper than
that I'm I'm 10K cheaper than that what
are you talking about yeah it's similar
to
this uh I have a better I have a better
processor than that uh I have a better
SSD than that I half the ram but you you
don't need RAM you think you need RAM
you
don't um I also is this have the full
but yeah no I mean what I'm 10K cheaper
than
that
Oh you mean their product yeah yeah um
it's good to know that that's like a
price how do you mitigate the lack of
P2P well we're going to get there um so
we have our AMD stuff has 12 GB per
second of all reduce our Nvidia stuff
has well okay not our Nvidia stuff yet
but we can get 5 GB per second on the
computer because it has to go to host
memory so the all reduce is less on the
green Tiny Box and the red Tiny Box but
I have a theory that once we get to just
the io control layer we don't even have
to go to the driver we're going to be
able to to mitigate
this um yeah ENT the amd's Enterprise
stuff has the same bad
firmware um the Enterprise stuff may you
may hit the bugs less because
their strategy doesn't seem to be like
when you I I gave I reported to them
multiple bugs and the bugs were fixed
but they were not fixed in the right way
like you don't when someone shows you a
bug you don't figure out how to tweak
things to make the bug stop happening I
mean you can do this but you do this
you're always destined to have bad
software when someone gives you a bug
you have to root cause it you want to
really understand what caused the bug
and then fix the underlying issue not
paper over some stuff until until no one
sees the bug anymore and I mean that's
their strategy in video games it seems
to be actually the way that a lot of
these video game things work they don't
again they don't root cause the issue
they just say Okay Witcher is using this
Shader if Witcher do
this
um they have great Hardware people yeah
the hardware seems great I
yeah um I don't affect the stock market
I do think I do think the the only
effect I ever had on the stock market
was the time mobile I tanked 7% after
Tesla released the statement
uh no I I don't even think that AMD
stock is necessarily going to go uh the
the only thing that I can say 100%
definitively about AMD is that they are
not going to Leap Frog Nvidia in machine
learning
that's the only thing I can say it would
be nice if they were explicit about
hacks like that come like you know and
and and maybe that's why they don't open
source the firmware it's just it's
embarrassing that they probably have a
hack in there that references Grand
Theft auto4 like Grand Theft I was
running Vice City on a PS2 you
know
um what is the problem with AMD the
engineers or the
executives the the the problem with AMD
is that they do not desire greatness
they do not desire greatness and they
will not get greatness AMD hasn't leap
frogged Nvidia in about 13 years and if
everything continues like it is they
won't Leap Frog Nvidia for another 13
hour isn't it generally okay to work
around bugs in the games it might be it
might be so if you're targeting games or
you're targeting fixed function ml
inference this strategy might work but
if you're targeting ml research with
flexible Frameworks the strategy might
work uh well I'm not going to build a
GPU I'm going to build an exeler
right is it common to use the same
firmware I mean what do you mean by the
same firmware right it's kind of like
the same way the same Linux kernel runs
on
all the processors are great the Epic
processors are are are are great
uh they don't have firmware issues they
don't I don't know my epic processor
locking up we're going to build a DSP
yeah AMD settles at number two is is the
simplest way to put it maybe they should
make a separate firmware and driver just
for ra out and maybe I was offering to
do this for them for
free uh right that's literally what tiny
Court this literally what I wanted to
do
we're going to use Nvidia now rather
than AMD yes we
are okay here before sub mode that's
that's the perfect time for sub
mode
so how do we want to
start
kfd iio control did we have this
somewhere user include Linux kfdi
control so let's start by
building we'll call it
kfd chiny gr has these things called
autogen
here
um will create one called kfd using
that we're going to need the KF
[Music]
Spa
any of those CL
ARS uh it's not called co-manager it's
called
kfd base kfd fix up kfd
kfd don't need that
yeah
I do like how simple this API is this
API is like so much simpler and cleaner
than
um so let's see if we can switch
over the same as this or is there more
to that one looks pretty much the same
okay that's cool so let's see if we can
switch here from importing this we can
say from Tiny grad runtime autogen
kfd
report kfd
um so let's see I control 1 HSA 1 python
test TS test off test tiny ad is a tiny
ad or tiny I never
remember uh
okay we're missing
this
are we even using that crew
one is it the same criu like the
checkpoint and restore in user
space
okay where's this comprehension here
it's
here
oh I'm doing something else
here
instead of doing that let's just take
the this
path Okay
cool so amds we looked at the Nvidia one
yesterday it looks a lot more complex
than amds so it's kind of why we're
starting
here um oh let's
also I think it's HSA kmt debug equals
[Music]
7 maybe it's not
that
HSA kmt debug
level I guess we can't use more
either um wow that's a lot of
events just use less of those just go to
HSA use less of those not that HSA
there's so much HSA
just say it's kind of gotten out of hand
with how much code it takes up in tiny
grad um so we're going to try to we're
going to try to cut back on that and go
right to the uh right to the lowest
layer 496 that's something
sorry the text is even small for me but
we need small text in order to
save so we're going we're going right
down to this to this low layer
here um n then Jen just said we have to
do the memory stuff so let's hope that's
true I don't know what those IO controls
are
all right let's start with a let's start
with a get
version could we not use the rock M
userland stuff we're not actually going
to rip out HSM we're going to support
this we're probably going to still end
up getting AMD on ml
per um it's just it's upsetting it I
don't know the lack of a desire for
greatness just upsets me at
people like I would so much rather
somebody say that
like we desire greatness we just don't
think you're great then well actually we
want to be middle of the road you know I
just just like I just it
bothers uh no we didn't we didn't do
anything on this this is my hobby this
is an actual this is a real waste of
time like I should not be spending time
on this but it's Saturday and this is
what I want to do so you know
everyone has Hobbies
man where is get version how does
that oh
what oh that's
annoying why is that not uh
okay we need that code
then yeah we need ioctls from
header no we really need that's so
annoying
all right we'll deal with this
later some people just want to be happy
and you don't need greatness in life
yeah it's fine if you're an individual I
just don't really want to associate with
you like if you're a company what are
you
doing all right so what are these
numbers no okay we're going to want
to going to want to write some code to
be able to send these IO controls which
is less easy than with the invid ones it
turns
out
so when we get this working you'll just
be able to install Tiny grad on a new
version of yuntu and you won't have to
install any of amd's user
bace so let's um
what I want is like kfd AMD kfd I
control get
version should we just start writing a
parser structure all there it's like
just this one that
doesn't why are these commented
out oh maybe because I don't maybe I can
just fix this by including whatever that
is yeah like this almost
Works see if I can just fix it by
including that' be
sick where is that
defined Linux iio
control user l I
control we want to put it first if it
matters
did that fix this by chance no same
shit we need to Define here or
something oh well okay that's just
nothing it's not actually following
includes oh there's a flag to follow
include so let's try that one we might
not need anything we just to include
that
no no just more
broken and
uh I mean it's cool that it expands the
macro like
that
did something but it's still what is all
this
crap I don't like
this all right should should we write a
proper generation thing for
this
structs are all fine it's really just
this one thing that's
wrong let's read the uh Source document
I don't want to parse that like that it
should just be a
f
I you have to know the size of the
Str
what are these
calls we haven't even gotten to these
calls
yet
a zero and a 69 targeting dry
render what are what are those things
tar W this is hard
than what are those things
targeting um why don't I print the name
of that
there kfd great I printed it check it's
right okay Dev
kfd so we're gonna have to open Dev
kfd what mode do we open it
with
FD so we probably just want to use os.
open S TR let just take a
look
was it open 64 or
something two
redirect
that
open open at yeah
okay what's flow
exact what does this
do oh it's about the that's
cool
oh there's a really cool issue in Python
the multiprocessing is broken because it
uses Fork instead of Spawn uh and all
the fds stay open because it's CL exac
oh that's it's wild okay um they're
opening it with o rwr so let's just do
that three that's
good um
let's change this up a little let's
do I want to create an object how do I
create an object that's not a
dictionary
um
he's like set add or
something oh here we
go
all right so we
want a dictionary with
name and then a tle
of an
INT
get
k so now hopefully I can do something
like K
dot
version who thinks that
works it works but it's annoying I just
don't like that
it's
I like that
it's we want to like call it with that
struct we want to create a
function you always want to like
generate
python that's probably the way to do
this right like don't do this
dynamically just like write out python
code
for
I don't even know if those are inputs or
outputs all right let's just do one by
hand and then we'll we'll do it faster
okay so we have the the
number
um we need like the reverse of that
macro yeah this in
Reverse
either
size I type
NR
uh
okay so P OS how do I do an I control
import I
control to do this here don't
I oh I actually do res this this call um
yeah that's
fine
it's an F control it's a mutate
flag like it's crew the buffer
is p buffer new cont the
action buffer seems true usually
whatever
um f
control control
FD our request is an IO control number
okay so kfd version oh it's
like
the different Q types Q types q q
q q q
q should we listen to some some royalty
free chip tune
royalty
no
Creative Commons chip
long
playlist free music
archive just love
YouTube who thought this was a
democracy
[Music]
did I do that did I balance it well yeah
I think
so
[Music]
[Music]
[Music]
I really need
that don't don't overflow
it
[Music]
[Music]
[Music]
[Music]
[Music]
for
[Music]
[Music]
for
[Music]
[Music]
oh we need that to capture
[Music]
[Music]
[Music]
a
[Music]
[Music]
who understands why writing this pay
attention you want to learn predict
what's going
on
[Music]
okay okay afd
version let's actually put this
first
[Music]
you he
that
[Music]
[Music]
one of
these open the
GPU
I like this
song
[Music]
extensions
bro they're never going to make you
good okay we have to figure out what the
is what do we think that
[Music]
is this is like en knitting the
GPU I'm sure this is where GPU ID comes
from so we have to understand how to
parse
these it's the uh
[Music]
API DRM info oh we have to get DRM oh
shit I saw
this it's actually
included go to this yeah DRM
dm. DRM
number
69 69 and hacks
no 45 is that already in HEX
[Music]
actually on
v no
[Music]
45s a what
what iio control is
that zero is that a real
[Music]
one
version
I'm sure this is where GPU ID is coming
from
right here
acquiring VM for BF for E4 using
seven so this 69 is
probably
I did that right
right
x45 is it an i or an IO it's an i r
actually wait no that's not an i that's
an i
[Music]
w
not any of
those it's ey
type I do
that oh I type they 100 so what's 100 in
sure lowercase D
is that
DRM has to
[Music]
be
[Music]
where
is Okay it definitely has the DRM
control
base but the number is
I'm pretty sure okay GPU ID is not
returned yeah we're acquiring VM for I
don't know you know what we can read we
can read the run time let's just read
the run
time
time NS
code
um so I'm pretty sure that's where that
print statement comes from here
acquiring G
for no it
doesn't
here oh it's in rock key thunk interface
fine okay Carm takes
in acquire the VM from the DRM
renderer
crap no I know it is D but where's uh 45
is my question okay so yeah they can
call acquire VM that's great but where
does no de render FD I'm worried about
that deall
game close DRM render
IDs what is
this FMA allocate device
to CPU blah blah blah blah blah allocate
device
maybe
object
all right so here's where we open the
device maybe it's in this initialize
thing where is that
function where's the
function what is that linking
to oh here we
go
that be in
here ah lib DRM AMD GPU here we go it's
probably
here
sorry about hitting the table I know
it's loud for
you
wow we got a lot of viewers again this
morning people are into this stuff
that's
cool or you're into the AMD
rants you're into gpus what are you guys
into turn off subscriber only for a
minute why we got so many viewers this
morning you're into gpus gpus are
hot
um so where is where is
45 we're not what mean we're not trying
anything we're just guys it's over the
Tiny Box isn't shipping with
AMD AMD offered to to buy all our gpus
on off of us maybe we'll take them up on
it I'm not shipping the shit to people I
have
standards so what is that thing what
what is that what is that function
that's being
called okay we have to acquire the
V is's the next next thing we have to
do why are you guys constantly worried
about like are you joking about being
sued or do you actually go through life
worried about being
sued like take it from someone who's
been sued several times it's
fine we're suing someone now we're suing
this woman hit her car and didn't have
car insurance and didn't want to pay she
had some car insurance but it wasn't
enough to cover the damage so I'm suing
her
um I'm suing her this lawsuit's been
pending 18 months now nothing's
happened um you like AMD and hope
they'll fix it they won't fix it unless
they change their
culture like their culture is the
tolerance of
mediocrity uh and yeah again if you're
looking for a mediocre GPU that kind of
works buy an AMD
you know the other thing that you don't
understand about suing someone is so
what you do if you're on defense is you
just delay and you end up costing the
plaintiff absurds amounts of money like
more than they're ever going to recover
from you that's kind of the strategy all
never mind now now we remember why that
we go to subscriber
only
um yeah I take pride in what we ship I
don't want to ship shit to
people you
know oh what's the
poll you don't know why you're here
great you go through life what you go
through life what else don't you know
okay
um whatever whatever let's go to rock
tunk interface we're going to have to
figure out where this thing comes
from GPU ID where do we set GPU
ID
where does a GPU ID come
from
oh
interesting so it may not come from what
I thought at
all retrieve the GPU ID it looks like it
comes from
CFS
is there actually something in there
that talks about the GPU
ID validate node ID GPU ID oh
here get DRM render
ID how do I get GPU ID oh these are
interesting Li HSA
kmt so I can get this in
SFS here we go device virtual why do I
have two of
them GPU I zero don't use that one about
that one oh that looks
better
okay well that's where that GPU ID comes
from so that's nothing we have to
dynamically allocate so we can just go
back here and we'll just manually put it
in assist devices virtual blah blah
blah Now call this DRM
FD okay
now let's create a
struct um
called acquire
VM
St acquire
VM St do I wish this could auto complete
but they
can't
uh DRM D equals dmfd let's
goore there match love when things match
check GPU
ID all
right Works Cool did we just acquire a
VM wow what am I going to do with this
VM I just
acquired hello we're
streaming
good
morning we're streaming we just acquired
[Music]
a
e
all
right you're bullish on Intel I'm not
bullish on Intel the the seven this the
I had a eight guys had a meeting with a
VP to figure out how to solve my problem
what the hell is my
problem Microsoft would have Aqua hired
the vs
okay all right good we're requiring a VM
let's set memory policy wow can we
allocate memory of GPU what do you mean
of
GPU let just see if this
works
where's that
header
okay we pass in the VA address we pass
in
the size
where do I get a VA
address can I just make it off I just
make it off can
I where did that come
from M map offset is input or output for
CPU mapping for user point this is
overloaded from kfd map
offset oh that's reasonable I guess
virtual address of the memory to be
allocated all later mappings on the GPU
will use this address where does that
address come
from
by the way remember that most hacking is
very boring and looks like this so if we
want to look for exploits This Is How We
Do
It newb programmer showed up and said hi
what are you
doing you don't know why you're here
great well I'm glad you're here to watch
me we love having you here but only some
with you okay we're getting minus one
let's see if we can figure out why we're
getting minus
one no
feedback just error only
error
uh oh we have to give it a GPU ID of
course tell it What GPU we're allocating
the memory
on no
better
nothing okay um where is that VA address
coming
from let's s Trace M
out
events
okay here here here's where the VA
address comes from wait no it's almost
that almost comes from map wait come
from that M
map how does it m map it
after oh what that's
weird map
map private map no
Reserve it's not even mapping that on an
FD do I just like get an address like
that I don't know try
it let look at Python's at
map file no is minus one length is
this
Flags
man Lil Wayne who misses Lil
Wayne oh I don't think that's actually
going to give me an
address closed false access equals
access read how do I get Pro
none we have Pro
none Pro read Pro WR no we don't have
Pro none that's not supported okay uh we
need to get the address of that
mapping
accessing shit is possible with shit
okay uh C types C in from
buffer
that is not writable do don't care about
that cn32 from buffer this fails if I
map
shit supports the rable buffer
interface get address of read only
okay that looks
terrible ffi from buffer that looks
terrible
there's no way that
works this like a I've done this before
and there's like a nicer way to do
it so
hard what is that what type is
that yo we can't listen to copyrighted
music hey hey can we get Weezy we can we
can we listen to your music that that'd
be sick
man um I bet I bet he'd be fine with it
if if L Wayne's fine with that but we
are we
good we are we good to listen to
copyrighted music I listen to
copyrighted
music um can I increase the bit rate no
you get less bits we're out bits are
expensive
man
we can't do it if it's read
only what if we just do MF
right now it's not read only anymore
error
I want to just get that
value I feel like I've done this before
maybe even in tiny ground
somewhere
no
no underlying buffer address is not
writable so this is just crazy so I
first map Anonymous
memory and then I map it in are there
docks on this
shit not that I didn't get
that km tiio control okay FMA allocate
memory
object void pointer memory marg's VA
address where does this memory come from
aperture allocate area what is this
portal allocate area
aligned like you get to the bottom of
this and it's like one simple little
crap like you got to
find right here just calls allocate area
aligned oh my
God no he sold no Weezy why you sell out
man Universal man they're
evil memory mapping of files in the M
yeah but can it get me an
address get the
address I don't know what you know what
I have here we just read the driver
let's read the driver see what the
driver
says here we
go
all right where's the
driver host bar oh
wow oh we can allocate
doorbells we can allocate all sorts of
things what do we allocate
again this isn't like you think think
that like we're not even close but we're
actually this gets a lot easier as we uh
like allocating memory is half of the
battle once we can allocate memory okay
allocate memory of GPU then we map
memory to
GPU um then we map it read
right with this offset oh I see you see
what we're doing
here wow that's a crazy use of map right
like that I would think that would be
like M protect like look look at this
crazy use of map I didn't even know you
could use M map like
that map no Reserve it's also not a
flag
we have to find map no Reserve
somewhere what does this
do do not Reserve swap space for this
map
thing all right that doesn't seem useful
actually yeah we
don't do
that
all right so how do we get the address
let's just solve this problem underlying
buffer is not
writable it still has an address I can
see an EST
Trace we have this buffer it's just not
writable it's also not readable
so that sucks map map closed access read
pause
offset
why does what return null
[Music]
sometime we get the
address
I feel like maybe I've done this in C
types
before there's some like it's not
returning no um maybe I've done this
before some like helpers for this how
about these like from MV and shit here C
types address of but that's not going to
work if I
can't I think this doesn't work I think
it's not a c types object and it's going
to give me
crap yeah invalid
type we can try we can't make it from a
buffer because C types doesn't support
read only buffers I've dealt with this
crap
before
um
it is there an os.
map we might be able to use like a
deeper I if we have to we can import map
from libc that will definitely
work but I'd rather
not
these are the small downsides to using
python
for
do we want to just do
this this will definitely
work right what are the ARs to M and Li
C
um
address
zero it's zero
zero yeah null that's the
size
Pro zero
Flags private
[Music]
Anonymous uh FD is minus one and offset
is zero let see that give us a good
address the fed's been spawn on all our
shit you're allocating memory of GPU no
we're still getting an error okay that
didn't fix
it walking around with their chest out
like Janet Jackson and
shit all right can we get more
information on this
error oh it's probably because we didn't
um of course we're going to have to set
the memory policy oh God you know if I
want to set
policy
right what kind of policy do we
want trying to itch your
eyes don't scratch
them how
many three
eggs okay alternative aperture base
alternative aperture
size GPU ID is of course the G I just I
love using apis like this because it
feels like I'm actually like talking to
something and not thousands of lines
of crappy C written in a crappy way a
like to ensure
employment how many lines of code exist
in the world just so people can have
jobs default policy
one alternative policy
zero okay well setting the memory policy
works but we still can't allocate memory
of
GPU maybe we need no
Reserve do we need no
Reserve I don't think we do oh also wait
it didn't actually I added a thousand
here
I think it matters but no okay
um why is map no Reserve different oh we
have to check the
architecture
right what TOS on the
side
all right we still can't allocate memory
of the
GPU this does not
work oh we might have to get some
apertures do we get any apertures
we did not get
apertures do we get apertures before or
after we acquire the VM okay we get them
before we acquire the
VM where does this me handle aperture
start come
from what are these
things do I need
them two apertures overlap knit men
handle
apertures of
GPU stick the mend map offset into there
but what else is happening here you want
to do a better you want to do a bigger S
Trace try to figure out what's going on
AMD is not going to give a shit okay I'm
just I'm just making that clear to
everybody it's not going to get better
if you're buying an AMD card and
thinking oh this is going to get better
like I'm sorry but you're duded like I
was duded we all were deluded we
believed we believed it might get better
but it
won't
oh what is this m bind I don't even know
what that is M bind have you ever heard
of
that enables the AGP
aperture
interesting I don't Alex you know how I
feel about questions like
that
just however you think they're
good I'm not a very picky person except
I demand greatness for my
gpus what do M
bind what does this
do what
happened and the eggs are on the floor
yeah I know I've tried chefing before it
always ends
badly chefing
no what's M
default what is M
bind what is an bind oh
Numa I don't care about this think this
matters wait then we M unmap it
before we do
this thank
you oh the third eggs on the floor oh we
saved two of them that's pretty good man
that's like Titanic
numbers
okay your wife sympathizes with Alex
um let's get some M
map
we have to unmap the
address what just
happened I am a Mormon moron
justes
you cannot just believe partway you have
to believe in it
all all right how do
we oh I know what we can do to debug
let's check out our driers
ship
we have
some high quality debugging shit let's
go all right all right look at this
progress R
22 all
right what's 22
again
um why can't you guys answer my question
you're talking about eggs what's
22 invalid
argument okay hang
on we might have we might have glossed
over some
stuff okay map
offset 2 kfd from user what user
pointer what's a user
pointer do we need
Flags oh maybe we need
VR that seems reasonable are they
passing in
Flags oh look at all them
Flags
Flags what if we do we just need some
Flags let's figure out what these wow
look at all these flags
man all right add some
Flags let's try some Flags let's see
what we
got oh it worked great we got a
handle did we even have to set the
memory policy or was that just a
scam don't like setting
policy we even have to do that do we
even have to acquire a VM oh how nice
would it be but we didn't have to
acquire a VM is that a requirement you
have to acquire a VM that's very
reasonable we're happy to acquire a
VM all right aloc memory of
GPU
it's pretty cool
right okay we have a handle and an map
offset and now we can use Python's M
map I don't even know about
this did we need to mmap
it we
didn't that was
fine yes
wait you hand for the plate the Plate's
not
done why do you want the
plate the wire you got
P there was an earthquake and now our
apartment socks you want the
plate that's
aggressive this is like when they come
at the restaurant and they take your
plate you done that you know I fucking
eating what it is that's
right
for
Okay so we've alect the memory of the
GPU uh that's pretty
cool it's so weird that I give it a VA
address
though like I don't like that's a weird
API but whatever I don't care um okay
now we can M map M map
uh on the FD length is st. size Flags or
what flags we love flags Don't Mess the
flags up last time we messed the flags
up just I get like a sense of deja vu
like I did this once before and I messed
the flags up last
time map memory 2
GPU but didn't I already allocate it
I map shared map fixed those are normal
Flags
wait
what make sure we got the right Arch and
shit
V probably
this can't do fixed
there how are these args different on
different
platforms
map fixed is
10 map
fixed we passed in the FD now we also
need to pass in the offset oh access
access is easy map. read and M Pro right
I mean I'd love to exact but you know
can't ask for too much
here I wish it could autocomplete on the
St but it can't and map offset so we're
going to say buff equals
that let's see what we got
here signed integer is greater than
maximum wait oh no
is it the
offset operation not
permitted I think it's the
offset that
sucks lib C.M map all right so what are
the
arguments
address oh wait oh I can't can't even
give it an address in Python oh this
doesn't work okay yeah we have
to VA address it should be a lot easier
I think to get from a normal from a
pointer
um address size what's next
Pro
[Music]
Flags
FD and
offset okay
cool
actually
huh whatever
uh
re the memory of GPU we can see what's
happening here let's
go actually let's add a time sleep
here mapping mm page Target user address
address physical address VM flag
size I wish I could just see into the
GPU like what's that doing on the
GPU domain
CPU create
bva what's a
Bova
why do I have to map the memory to the
GPU I aled it on the GPU I don't
understand
also I'm kind of curious what flags were
passing a later thing okay passing a
handle a device
arrays got make a
pointer device ID array of GPU and then
the number
of M memory to one or more
gpus
okay I guess that's
reasonable
whatever
um have to take the handle from
here
and
devices sir
stmn success equal
1 there all sorts of bugs in this crap
too in the user
space I forget how I got around
them
M memory 2
GPU no but like I allocated it on the
GPU I don't really understand why I need
to
uh device ID is array pointer create
just do something like C
types
did not
work device ID array empty okay
well oh gu it's passing
in that's very
strange
uh how do I allocate an array C
types recommended ways to create an
array
are pointer and are
created I want a
pointer
incompatible
types LPC it I have to cast
that
type
where's my python struct
this m memory 2 GPU okay device ID is
array pointer is a
u64 but that's not that's going to bitch
me out cuz it's like well I can't cast a
pointer and not a
pointer
um I have to make the
type this
works try
it object doesn't support item
assignment
okay we just need to cast that
correctly even though it doesn't want to
cast
it oh I might just be able to do address
of again we're getting this
crap what why is n devices that and N
success that okay that doesn't seem
right at
all oh passing in the wrong thing
there
oh okay I forgot I had a Time
sleep okay great so here we map the VA
to the VM one B size one address before
dma mapping one Bo address after dma
mapping
great so I think that's
allocating 4 kilobytes on the
GPU
I like how fast that
is we're only 5 milliseconds
in
okay
um
here's something I don't really
understand how did I just mmap GPU
memory does that just go over the PCI
boss let's create how do I do c types
from like a raw
pointer um memory view object from
address C types these things are like so
annoying because I can't use Python's M
map here because I can't pass in a
VA
byebye
for
pointer C types pointer Val no you can't
just do that we can try it but I don't
think it
works pretty sure that don't
work type must have storage info
yeah
um
oh actually it should a void pointer
right
problem is it's a void
pointer we should be able to cast
it C types pointer C
types say like human date or
something no I I did that backwards but
I think this
works then if I want to make a memory
view out of
it
uh maybe memory view.com oh I
see I should maybe just 2 MV will
work size
is
all right cool I think that works why
the memory is there
but uh so I don't know let's
[Music]
uh we writing AA to the
GPU it's always
why is it always
so I think we can also allocate memory
on the CPU and make that memory
accessible to the
GPU or can we map any memory no we need
a
handle oh wait no that Buff's
correct passing the VA address map Pro
whatever why is that just
okay and success is working so we
definitely map the memory to
GPU this is right I'm pretty sure sure I
don't think it's
wrong how do I use 2 MV and the rest of
tiny
C uh CT from
mvy yeah that's probably
right I'm probably just doing something
else
wrong the memory policy
um that stuff SS Super
annoying so I don't know why I'm over
allocating there not need to do that we
need to unmap
it it's crazy that that works by the
way so this is basically only being used
to get an address that I can pass into
this
just make sure that this is
working
um
okay it might just be the wrong address
somehow not actually totally sure about
that okay so what what type is
this it's a LPC Char object how do I get
the
actual
um C
Corner wrong type
okay all
255s good map
there uh the memory bu doesn't extend
there it doesn't sense whatever this is
this is definitely not normal memory but
I can write to it without a seg
fault okay you want to see it's SE fault
we can try
this yeah there you go
right don't know if this memory is
supposed to work
okay do we hit the target user space
address that's right uh let's check what
these flags are maybe the flags
matter our problem before was Flags our
problem again may be
Flags hit not the I
want the one I
want where are the
flags
the flag's not
here no this is tragic where are my
Flags they're definitely in this
file Nvidia CEO says you're going to be
rep I can't believe that
shit of course he's going to say that
imagine you're replaced with a
uh I'm not even engaging with that never
mind I take it back I regret engaging
it's too stupid to engage with he's
trolling you and you're falling for it
oh okay good it's in
here
um wait those flags don't even that's
not GPU memory oh we're getting we're
getting rugged boys we're allocating
remap are we getting so
scammed we're getting so scammed we're
getting scammed
like all right well those aren't the
flags we want let's find some better
Flags I knew it was
Flags
so we allocate normal GPU memory like
here what flags do we use these flags oh
different
flags let's see what other flags we
have oh those are flags too look at
those
flags
we're going to have to do all this again
for NVIDIA too o fo1 those look like
good Flags what do you think of those
flags some of these have to be real
Flags what happens if we allocate like
that segmentation
fault
interesting don't try to read and write
to those
okay
uh actually does that just work totally
differently no I'm still doing this VI
address
garbage
nft
memory who's got nft
memory oh look they're allocating you
know what this is that's a guard page
they're putting a guard page on each
side you guys know about guard
Pages sometimes you got to guard things
with guard page like
tassles GT g t what's GT why do I feel
such Deja Vu doing this like I've done
exactly this
before did I do this on another stream
and I'm just like forgetting
it okay
[Music]
vram memory type
well it seems like if we allocate vram
it's SE
F let's try to read the V before we try
to write the
vram oh well we got okay never mind as
soon as we got that there we should uh
assert buff not equal to
that
what what's even giving me that where's
that print
that okay the remap is failing oh I see
I probably can't map
that like even though it has a VA
address I probably can't mmap
that
can I map
that that has a completely different
issue this is the only one I can mmap
which is MM remap for some reason it's
full of
255s which I guess I don't totally
understand what is an mm
remap
uh oh so writable is the first number
there so this has writable this has
writable this has writable this has
writable D
is also includes executable
what these are also
executable okay whatever you do you man
I count that right yeah let's count it
right all right uh public
oh this one's
public these two are not
public and there's just no substitute
here so definitely no
substitute no substitute for any of
these mm
remap let's see what we can learn about
this let's go into the driver and let's
learn
things the
driver like docks on
this no
docks mmio is mapped to kfd
device wait
mmio you guys know what mm is
Right memory mapped
iio I mean it's kind of
crazy
oh this is
interesting look at the uh look at the
FD
there might just be using the wrong
FD it's not the
um GP Ur Ram is on the uh DRM device
which I guess kind of makes sense right
so let's do GPU Ram I don't even know
about that
mm uh all right so this buff asserts
okay it buff asserts but I have an idea
if we change this to DRM FD it won't
buffer
anymore oo look at them
190s I don't know what a 190 is let's
see if we can write an AA
there AA is a little aggressive let's
write 101 named after my favorite
California Highway oh it works
great all right I think that memory
might actually be on the
GPU let's take a
look can't
tell all right I kind of feel like I
want to shower
uh so that's going to be break
time but that's pretty good I think we
got some GPU memory
allocated so I think our goal for this
stream is going to be
to execute a kernel and have that kernel
modify the GPU memory just take the GPU
out and see if it
works yeah I don't think that's how it
works uh how can we check if that memory
is actually on the GPU or not should be
domain vram that's pretty
[Music]
cool wow so who thinks we can map the
secret GPU memory that contains the
firmware what do they call it oh it had
some stupid name who thinks we can map
the
uh oh what was it what was the stupid
acronym for it let's look at my notes
Here see this what we mean you got you
got to keep it all straight in your head
um ah the TMR trusted memory region if
we could map the
TMR oh is writing speed the same
um it's going to be hard to
measure yeah we're not really going to
be able to measure that right like
because how would you do it I could I
could like like M Copy is slower than
the PCI
bus how do we see if transactions is
there a way to like debug the PCI
bus what do you mean cat from Dev
zero Linux snith pcie bus
transactions I don't believe
so we have to buy some expensive ass
shit wait this is actually pretty cool I
kind of want
one
like that'd be sick let's look at the
tlps and
shit does the memory start zeroed out no
it doesn't it starts with 190s in there
what's a
be I don't really know what that
means um
what flags are we doing by the way vram
writable executable public no
substitute actually I'm not even sure I
need to do this do I need to map the
memory to the
GPU not sure I
do I mean I might need to later but for
now yeah I don't have to okay cool so
we're just allocating some memory on the
GPU and then we're mapping it using the
DRM FD which it makes sense that it's
the DRM FD because the Dr MFD varies per
GPU there's only one kfd for the whole
computer yet these you want to go into a
tiny
box which one were they playing with
13 uh if we go into tiny 13 here yeah
look you can see because there's six
gpus it has six uh dris
pretty cool right good thing I'm a
member of the render group and can
access
it
um how many viewers going to stick
around if I go take a
shower I woke up I went right to the
stream we acquire GPU memory let's do a
little bit more than we usually do on
streams and let's make a plan okay step
one
allocate GPU
memory step
two uh
execute uh GPU kernel to fill GPU
memory step
three read GPU
memory the the beauty of this we're not
going to have to install a single piece
of AMD crap in user space this is all
just the kernel Drive their colel
interface is a lot cleaner than AMD than
nvidia's um the fact that it's like in
one file like this they have normal
Nvidia you're like allocating all these
things which is um I think part of the
reason is you know you know who you know
who we have to thank for why this
doesn't suck lonus T
vaults I bet their API was like awful
and then lonus was like no no you want
to get merged into the colonel I want
you to be a reasonable adult and not do
this
um so yeah I think that that that's why
this API is nice versus Invidia who's
not in a Linux kernel um and they write
an API that oh well just allocate a
device and a subdevice and a no it has
nothing to do with in general complex
things work less
well uh nvidia's firmware works because
again I am a talented promising young
graduate
do I want to work at Nvidia who wants to
be the very best or do I want to work at
AMD who makes
rickle like it won't get
better and I I
I
um let's see if we can find the part
about
yeah by the way like Bojack Horseman's
like my favorite show of all
time Di and all I got was this
churo you know the shittiest thing about
all of this is when that stranger behind
the counter gave me that free churro
that small act of kindness showed more
compassion than my mother gave me her
entire goddamn life like how hard is it
to do something nice for a person this
woman at the Jack In The Box didn't even
know me I'm your son all I had was was
you I have this friend and right around
when I first met her her dad died and I
actually went with her to the funeral
and months later she told me that she
didn't understand why she was still
upset because she never even liked her
father it makes sense to me because I
went through the same thing when my dad
died and I'm going through the same
thing now you know what it's like it's
like that show Becker you know Ted
dancing I watched the entire R of that
show hoping that it would get better and
it never did it had all the right pieces
but it just it couldn't put them
together and when it got canceled I was
really bummed out not because I liked
the show but because I knew it could be
so much better and now it never would be
and that's what losing a parent is like
it's like
Becker suddenly you realize you'll never
have the good relationship you wanted
and as long as they were alive even
though you'd never admit it part of you
stupidest goddamn part of you was still
holding I love lost as well
and he didn't even realize it until that
chance went away my mother is dead and
everything is worse
now uh yeah it's like Becker it had all
the right pieces but it just couldn't
put them together and when the show
ended you were sad because you know it
could have been better but now you know
it never would be um all right well let
you chat amongst yourself give me 10
minutes I'm going to take a
shower uh and then we're going to we're
going to finish the we're going to do
the
plan um reg view
Memory and confirm konel fied GPU memory
we can actually start to do a lot of
cool low-l stuff here
uh amaran style shower stream yall don't
want to see that okay uh what time is
it back at
um put in
tiny do fun tests put in
[Music]
tin
for
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
okay so at a very productive
shower I'm just like I'm see it now and
I'm seeing why I care about this I was
talking to chenu yesterday and I'm like
this is stupid you know why am I why am
I wasting
time why am I wasting time on mediocre
ass
AMD
uh but I mean it's not about AMD this is
this is actually easier than doing this
with Nvidia there is more open source
code and then the API looks
simpler um
okay so let me tell you like what I'm
like seeing okay so we have this code in
tiny grad called
schedule uh it's in realiz but here it's
called it's called run
schedule so a few things a few a few
things I'm
realizing
um we can do the graph matching
okay let me try to structure my
thoughts we have this this jit and I'd
almost like to remove the jit
entirely we we construct this graph in
lazy. pi but very often in machine
learning you're just constructing the
same graph over and over
again um which like we could bypass the
python exec tion environment to do this
and then we wouldn't have to use the jit
but we shouldn't need to call all of
this this realize crap if if we could
figure out how to Hash a graph and I
think there's good algorithms to do
this like we need like a graph
comparison algorithm that says like
here's here's your graph right tiny
grad's lazy and it constructs these
graphs in a lazy manner
um if
we could like capture on the
graph and say okay when you've seen this
graph it corresponds to what the answer
is it corresponds to a command Que in a
GPU we can prepare a command CU in a
GPU this is why this is worth it like I
really want to go to the the colel might
be good
enough look I just wish I just wish AMD
showed me that they cared I wish they
showed me that they gave a shit cuz like
if you don't give a shit why should I
why do I want to fix your gpus like why
do I I can what you do if if I actually
wanted amd's firmware to improve and
like I just like it's even that I want
the source code I just want them to show
me that they
care
um no you don't need the okay so there's
different levels of
Q if they were to open source it they're
like oh we care right I don't want I
want some like verbal platitude saying
that you care right I mean I could ask
for money but that's tacky I don't want
money like show me that you care show me
that you want this to be
better
um so the way that you make this better
is you write a fuzzer I I could write
all all sorts of like you want to take
tiny C can generate a massively diverse
set of
kernels and I found compilable just like
be better be better care care can you
get people who
care when there's bugs when there's when
when there's bugs in common shit I'm so
angry like I want them to be
better
no actually show some words are so
worthless and I I fell for words from
them they gave me
nothing why why would I want to like how
much how much money is it worth to get
AMD on
ML or do they just think it's
worthless do they not understand that
like you're not going to succeed in ml
by just pushing your sure you can
probably run government scams to push
your instinct Cards into fake government
supercomputers that don't do anything
but if you want to actually succeed at
ml this is it's it's a boots on the
ground strategy this is how Nvidia
succeeded Nvidia worked their way up to
where they are Nvidia gave me a free
computer Nvidia gave me a computer with
four Titan x's in it this is this is OG
inidia they
cared I don't know
I mean Nvidia got bad after the stock
price went up but I do you really blame
him AMD cares about server gpus it's the
same
shit
yeah no I I I just like Nvidia deserves
to
win I'm not I'm not starting down to
Rabbit Hole of Intel Arc I'm going to
guess that Intel Arc so your software
looks like your organization and I'm
going to guess Intel Arc looks like 8
people having a meeting with a
VP all right you want to tell me to relx
again you're banned from the stream
bro
um saying it once is fine saying it
three times Bann from the
stream uh the server gpus is all have
the same
box no I I think they have genuinely no
idea I I think that
yeah no Intel AR never be
good it's not
yeah t Tor will be good T torr is doing
things the right way to be good to
potentially be good
someday what Snapdragon Elite no Jensen
deserves to win they they just just it
it makes me mad to think about it
can this can this be
communicated no I'm not like I'm not my
I'm not it's not it's not my job to to
to explain this to
you well Nvidia doesn't care Nvidia
genuinely there's nothing I can like
like AMD doesn't understand the value of
this and I like I just don't want to do
it you know what I
mean no Nvidia doesn't Nvidia genuinely
doesn't have to care about this right
like most people are T tiny grad when
you tiny grad is actually the best if
you're trying to do multi-gpu AMD
training tiny grad is hands down the
best way to do
that uh if you're trying to do multi-gpu
Nvidia training use pytorch like it's
way
better
no I'm not like I'm not explaining like
I just I want to come up with a strategy
I'd like to come up with a strategy that
like takes value from them and doesn't
give them
value like the Nvidia strategy actually
does take value from them if you could
really get clusters of 490s but nvidia's
going to if you could get clusters of
409s to be competitive what it would
force Nvidia to do is lower the price of
of of of Blackwell no Nvidia doesn't
care and Nvidia shouldn't care
right like this is a different software
ecosystem that may bear fruit for you
know Nvidia in three years but that's
that's that's you know
crazy
uh uh why would they lower the price as
an alternative well one alternative is
their own consumer gaming cards uh but
yeah they probably still won't lower the
price they'll probably just further Nerf
the gaming
cards you know
what I guess I guess to be like more
concrete like there there's just such a
sense of
mediocrity around around AMD and I feel
almost like looking and working with
this API mediocrity will creep into my
life
it's very possible Nvidia kind of stops
making gaming cards
which no they I mean they don't they
don't actually stop making gaming
cards large graph
equals GPU command
Q Nvidia make gaming cards because they
don't want AMD having all that Revenue
yeah I mean that's actually that's a
really good
point
uh they won't release 650 mm Square
gaming GP years yeah that's very
possible we'll see well you're right I
mean there there's there's no reason if
if I'm inidia now I'm like rdna 4 is
cancelled rdna 5 maybe I'll just ship a
driver patch to uncap the
um
all right ugand in wrestling you are the
reason we're going back to subscriber
only so a large graph is a GPU command q
and then like you know uh memory
scheduling is totally
separate I spell that right I always
forget if separate has an e or an
a an a
do you like do you like capture the
large graph and run it as a GPU command
to each node in the graph has a
program so here about the mediocrity
thing and this is is also like George
why don't you take a more diplomatic
approach with AMD I just can't like I
just I just don't you know don't
tolerate
mediocrity
um and yeah I mean the code is a lot
less this code's actually written by
some people who care right this code is
this this this API is is open
source um it's probably who who's ever
writing like the DRM stuff for the Linux
Colonel I mean like
what a what a work of art the Linux Kel
is you look at the Linux konel you think
there's some things janky about it but
like
wow wow you know so so much
respect like the the people who are the
the maintainers of all the different
kernel
subsystems it's it's the most incredible
software engineering project in
history
like it's written in old style C it's
it's these people
who again you know it's making me it's
making me reconsider it's making me
reconsider
rust
uh yeah no many people have contributed
to it it really is the most incredible
software enging project and it's high
quality
when you look at the kernels for these
other operating
systems the windows kernel oh my
god when you look at like what the
windows Kernel's apis are and how yeah
lineus gatee keeps I
know um no I think switching stuff to
rust is good I think that a lot of the
like the C Style the Linux kernel is I
don't love it like I think I think it's
I think it's like kind of antiquated um
it's like painful to write a lot of this
stuff I think I think rust would fix a
lot of those
problems um and don't like I mean Apple
just moved to C++ and
C++ adds
problems so where is
that they haven't pushed at all really
on uh on the compute stuff I don't know
why the compute stuff from what I've
looked is like I don't think I think I
could write a compute driver I don't
think I could write like a like a GPU
driver
what are the names what are these code
names
snabi yeah
like I know like you look here and it's
why is this not up to date at
all did just no one update the docs and
it's actually up to
date
I've seen this some some guy actually I
saw a Blog his tiny gr W with
this
I mean my idea is to bypass all these
drivers though so I don't want these
these uh like the apis aren't exactly
what you want I want tiny grad this this
is what I was thinking about in the
shower like I want tiny grad to take the
graph and
construct like I see it right like you
have like a GPU command queue right I
have all these these these dispatches
each dispatch has two resources so each
each node in the let's go to the
[Music]
Whiteboard let's move
this okay canone see can anyone see the
Whiteboard
[Music]
good
put this away
dri trash trash here throw this trash
away you know something I'll never
understand about these companies when
they have like open source driver that's
way better is why they even bother with
their own
driver like why don't they just give the
documentation and give what open source
people want these things are reverse
engineered and
better um I don't know that much about I
know a lot about gpus for compute I
don't really know much about gpus for
like
Graphics I never got I never got that
into
that
like the kind of people who can tell you
like what a Vertex shade or a fragment
shade or are like I vaguely know um okay
so we have like
tensors right this is like tensor one
tensor two we could do something like a
mle right do like a
sum and so this is the this is the uh
maybe afterwards you do like a like a
reu
right and then this gets stored in right
so this is a this is a single node I
mean this is a this is
a uh M Mall this is a convolution this
is anything
so you probably can't see I got to find
a better marker that's one kind of sucks
see this marker better not really very
good
markers that's better okay so this
graph gets shrunk down into just a like
here's your compute
node right and your compute node I mean
where does tensor one come from so we'll
have like like we'll have a compute node
here a compute node here this Edge is
tensor one this Edge is tensor two it's
all just it's all just graphs all the
way
down um you know another another amazing
project that I wish
it's Chris lader might have even said
llbm is too confusing for me to
understand now
but all projects event eventually
collapse under the way of their own
complexity um so yeah some other compute
node uses tensor
three um so this this whole thing is
this
right so yeah you have kind of a graph
where the
um the nodes are compute and the edges
are
tensors I wish thinker like
this if I just I just spent a lot of
time I don't know if this is possible
but
like you just see it so much more
clearly as you as you go through this
like I used to have these things so
there's actually a little this isn't
exactly right there are movement Ops
here but these are just ways they're
just they're just addressing modes for
that tensor um and I had like so much
complexity around the movement Ops and
most complexity is now gone like the
movement Ops are now just represented as
shape trackers there no longer are
explicit movement Ops in the kernel
except in ml in tiny grad except in uh
except
in a movement up is just a way of
talking about how this multiply accesses
this tensor like with strides and stuff
and through those strides you can
describe mat walls you can describe
convolutions you can describe everything
uh basically through this you can
describe yeah like everything
okay so these are compute we're now
quin's working on adding support for
this uh which will have our compute
nodes allowed to have multiple
outputs um which is cool so that just
makes it a more complete graph so the
edges in this graph are
tensors
um maybe it's not just a tensor it might
be a tensor plus a movement
do yeah I mean you you need a movement
up there and then if I'm like using
tensor one somewhere else I may view
tensor one in a different
way yeah that seems
right um okay so like that's what your
graph looks like
now is this is this
visible can you guys
see oh full cam oh I don't know what I
was thinking you're
right
uh yeah so I should have drawn this more
on the other side of the
board man it's all just
graphs you get caught up in like Nuance
of all this stuff but fundamentally it's
all just graphs and then like you like
this graph okay so there's two things
that basically get topologically sorted
uh so this is a graph
but
this is a graph of what we call in tiny
grad
Ops Ops get lowered to
uops uh so the difference that op
operates on an entire tensor whereas a
UOP operates on a
register that's basically the
distinction um Ops get lowered to uops
and then uops have to be topologically
sorted to go into the compute so the
both Nvidia and and AMD gpus are
basically just uh they're just
processors processors have an
instruction
pointer uh the instruction pointer moves
through a list of a list of instructions
and uh it goes
there uh so like you can imagine like
it's like load you know mall we have
like two loads
a mall we have an ad we have a loop
around
this we have a store actually the loop
has to include the loads as well so like
a loop right so here we have like a you
know go to
10 10 is up here get rid of the loop
like that really really linearize that
shit uh so this is what the linearizer
does so the linearizer is a is a kind of
a misnomer now we're going to write the
new linearizer called the lowerer and
the lowerer just lowers Ops to uops but
still keeps them in graph format by the
way did anyone do my defined globals
[Music]
thing
okay did anyone do my uh my Define Globs
thing so there's a little more usually
have like indexing before your loads too
you have to do like like U uh U 8
indexing U 64 indexing um so on and so
forth
okay
uh no what what am I say sorry I was
just talking about about data types I
didn't mean
to indexing is the expression of the
movement Ops in terms
of uh like assembly
instructions if if you want to do like a
stride of 64 you have to take the index
and multiply it by 64 um it's the same
multiply as this so you end up using
pretty much the same alus in most of
these things some of these gpus have
separate streams for integers and
floats um but yeah so you have this gets
lowered to this and then it's a node in
this graph um so this is topos sort
one okay so uh fun fun definition of
what a topological sort is so let's look
at this graph and let's topologically
sort it so the definition of a
topological sort is it's a list such
that an earlier item in the list
anything that's anything that's a child
is always lower in the list so there's
two valid topological sorts for this
graph you could do one two 3 4 or I can
switch one and two right there's no
reason this has to be one this can also
just be two this can be one and we're
good
okay
um
I'm just thinking about a little I'm
thinking about whether these things are
actually graphs or not they're not
exactly graphs because there's like
ports on these things like the these
edges are not exactly symmetric the
edges have an order in a node uh because
so some nodes are unordered like like
it's just it's just commutative nature
right if if if a plus b equals B plus a
but a minus B doesn't equal B- a so
these edges are ordered so the structure
is not exactly a
graph um but it's close enough to a
graph okay so this is a topological sort
right let's let's talk about what can
what can change in this topological
sort so these two loads there there's no
reason that they have to be in a certain
order I think everything else has to be
I guess I can move some of the indexing
below a load and the order with which
you topologically sort this can say a
lot about performance So eventually I
want to have ai search algorithms
searching the uh the topological
sort there okay now let's get to the
next
thing oh yeah no this is this is good
shit
boys
yeah see what I want to do is I want to
stop thinking about it in terms
of I what I what I said to to chenu
yesterday is like do we still want
non-graph API so if you look in tiny gr
now there's this folder in run times
called graph and graph can run things
like this but I think we actually only
want to support
graph because you're never going to be
running one
node the only time I see you running one
node is if you're doing it for
benchmarking for beam which beam is a
whole another thing so within this this
UOP lowering uh there's lots of
different things you can do you can
choose the order with which you iterate
over these things you can choose like um
yeah the order often matters a lot
because of whether you're getting cash
hits or not like this is they'll teach
you this in any basic computer science
class they'll teach you uh like a matrix
multiply right we you usually learn
about caches uh you learn about Matrix
multiplies and you learn why you don't
do this times this the problem with that
times that and then you go that that
that that that is it thrashes your cach
so you'll learn the tile based Matrix
multiply algorithm like you map M all of
these right um and then you you'll do it
in tiles right so I'll go like this tile
this tile this tile right multiply those
multiply those multiply those and that
tile is usually the size of my L1
cache um you can go even larger you then
also want to tile to like an L2 cach
right you figure out what you eventually
store um so so cash awar Matrix multiply
if you didn't go to college watch one of
the many nice YouTube videos that
explains this
concept um so this sort of cach
awareness is determined by our our UOP
lower and we have this thing in tiny gr
now called beam search that will just I
mean it's just sorry I mean it searches
over an optimization space we have these
these optimization operations which can
uh
determine how this stuff is broken down
into this stuff okay
so the term 10 to kept using was graph
compiler it's a smart term I see I see
why uh use graph compiler okay
so we now we have to do the same thing
here so this is our compute node we have
to topologically sort these things so
let's just come up with a quick topos
sort one two three four five four and
five can be switched one and two can be
switched but note that two and three
can't be switched because that would
violate the topological sword of the
graph uh so let's come over this side of
the board we have a
Q right Q is one 2 3 4 five uh three has
edges back to one and two so these are
dependencies and four has an edge to
three five has an edge to
three so yeah that all that all make
sense let's say one and two like
creation Ops okay so that's that's
that's a topological sort of that graph
but right now the data structure that
we're using to represent this
Q uh we have two data structures that we
use to represent it so the one that
looks like this is schedule
item
um and actually you have to go a little
bit further than this because you really
want to talk about these being outputs
right so this outputs
one um
uh oh those aren exactly those are edges
so it's not exactly right you got be so
careful how you define this you got to
think about how it works for multi
output we're going to have multi output
in China soon but so we have a we have a
the type is is list schedule
item we're going to finish this like if
you uh go to Tiny gr I feel like tensor
p and mlops and almost now lazy are
finished
like we're just done it's beautiful
they're done um we're now kind of there
with
viop there's things in tiny R they're
just like
there uh there was this concept Erdos
would talk about called from the
book
um are there Str like arions or so Eros
would talk about these these proofs
being from the book like that one's from
the book
um so yeah like
I want to find the code that's from the
book and I feel like like
mlops uh
tensor uh view are getting close the
linearizer is still a pile of hacks the
scheduler is a pile of hacks uops are a
pile of hacks the run times are not
expressing the correct
thing everything else kind of sucks but
lazy. py is now a lot better
um and the concept of the scheduler is
good now the concept of the scheduler
used to used to be intertwined with all
the crap and it didn't make any sense uh
but now it makes sense okay so you have
a list schedule item so what do you
lower a list schedule item into we have
something that lowers it to this list
jit item but that's not exactly right uh
the problem with jit items is they
are it's kind of right it's almost what
you want but you we really just want to
make this into a GPU
Q right or maybe another word is just
command Q you're going say
GPU everyone's trying to oh we got tpus
Intel's got
xus
AMD it's actually kind of smart of them
AMD when you use when you install Rock
am torch you don't do roam you do do
Kudo how many lawyers had to discuss if
that was a trademark violation or not um
so yeah I mean we should instead of jit
item we need to rename
that we need to rename that structure
command
q and then like we lower command Q to
Hardware command
Q Hardware command Q is actually xute on
the device so the the the realization I
had in the shower was that
you can capture this
graph as a hardware command
C right like this is this is kind of
where it gets annoying that we're using
python it's not python we need to be
just better about not
having all things are all possible in
all
languages but it's it's like it's
functional see what I mean like there
there's a functional trans
from this graph to a hardware
command so as soon as I can recognize
that graph using hopefully an iterative
hash function yeah I can just totally
use a hash function this is a Merkel
tree right if I do like a like a like a
like a Merkel
tree and if I use a cryptographic hash
function it'll never
miss
sorry it'll never it'll never
Collide I don't to have to fall back to
a slow path and deal with like
bucketing if I can find some fast
cryptographic hash function to Hash lazy
as we go I then just have to do like a
key match to a hardware command que
shove that Hardware command Q in oh man
and we don't even like need the jit
anymore I mean we still want the legit
to avoid the execution of the Python
code that builds that graph and does all
that
hashing but this will make tiny grab
fast without the
hashing
uh so the other thing that's like kind
of stupid in gpus that I kind of want to
get rid of and you see why tensorflow
did it this way is the concept of these
individual memory
allocations I really don't want to do
that anymore I just want to allocate the
whole damn
memory
I'm not going to deal
with like it shouldn't be there
shouldn't be a concept of of
multiprocess tiny
[Music]
R uh if we just allocate all the memory
then the hardware command Q includes
offsets into the memory but you're only
sort of running one at a time I have to
think through that stuff a little bit
more I don't know whether we allocate
all the Ram or not it's not actually
that big of a
deal we'll have to we'll have to build
these same abstractions anyway so
whatever we won't actually do that
but it's a cool thing to think about and
we can avoid all the I
controls I do kind of like allocating
all around the more we can avoid CIS
calls the
better just we we just won't be so proud
of it we'll just write like all the
ram see what I'm saying so like you can
take the GPU RAM and you can you can
allocate it
all
um I see why you people think I'm on
drugs I see I see
why maybe I maybe you know
you ever you ever actually SE I me it's
you know you see me when I actually take
stimulants I calm down I don't like act
like
this see why you think I'm on
drugs
um roam Hardware command cues don't
support graphs you need to use pm for
yeah I think that's what we're
using
um we we have some
stuff like the only primitive that we
need so it's not actually a graph the
only primitive we need is the ability
for
one uh thing to wait on two things or
multiple things right as long as we can
block as long as we can put a barrier
here that blocks the execution on the
completion of one and two that that's
that's the only primitive we need
here and this is like this is why I'm
working on these apis if we understand
what these Primitives are we can push
these Primitives to higher up in Tim
grad you have to think about like I have
these things like load off sync and load
off weight before copy but they're not
really
right um like niml jam was like can you
delete that and you can almost delete it
not exactly you you want this idea of
like yeah you want this idea of this
weights on these
things it's a bump
allocator others may use the seam GPU
fuck others get off my GPU it's my GPU
I'm taking all the
r um what I want to avoid hopefully what
we can get the GPU drivers to be is most
GPU stuff is accessible user B so we're
going this is the other reason I'm
interested in looking at that the that
other crap's making way too many kernel
calls though I have an idea that you do
have to make a kernel call to so on
Nvidia you don't have to make a kernel
call to ring the door bath um on Nvidia
you can just poke the doorbell memory
and you're completely out of the kernel
by the time you're even like doing like
a CU launch kernel
um so on Qualcomm you push this stuff
all to the uh
all to the driver
um so not that you have to you have to
push this stuff to the kernel you have
to tell the colonel hey run these
things I mean we can reuse a lot of
these Primitives or a Qualcomm uh driver
as well I know I cancel the Qualcomm GPU
driver but I'm realizing this is more
important than I
thought there's a part of me that
like we want to get to the
hardware what is the hardware the the
GPU is just like it's a pile of RAM and
then a command Q executor and then each
one of these nodes in the graph of
course has a has assembly right this is
this is like assembly we have this whole
like compiler stack that generates the
assembly from this um but we can
eventually remove the compiler we can do
you can Co generat allocation all those
fun
things um and then you also have to
think about how to use the local RAM on
the
thing but this is like what this whole
Paradigm looks like whether you're using
gpus or tpus there's other paradigms
that look kind of different where you
kind of lay the graph out on the chip
service intens torr are thinking more
like that but if your idea is the GPU
basically executes one kernel at a
time um it it looks like this and yeah
we should we should rebuild the run
times to look more like
this command Q Hardware command q and
HSA is probably a good place to do
it that's also like this is less of a
waste of time than I thought I thought I
had to spend time working on all the
high level uh on the high level like
tiny Gr stuff stuff I like the
linearizer but I just my eyes glaze over
when I look at the linearizer now I was
never very good at writing a
linearizer um I'm much better at this
stuff but this is also going to fix this
is how we're going to make like llama
fast how do you make llama fast on six
gpus it's not the algorithm it's this
it's a little bit of algorithm
stuff you think I'm Reinventing
Vulcan
uh yeah I mean Vulcan might have these
sort of
Primitives again you stick apis on top
of things the apis are right mostly but
not exactly right like Vulcan my every
time I've looked at Vulcan I'm like this
this thing was designed to be way too
flexible this
is
no you don't want to go into Vulcan yeah
I don't think I
do um I don't nothing about DirectX I
haven't I haven't compiled a program on
Windows in 10
years
um but
yeah so we end up with these command
cues we end up with these programs it's
it's this graph to it's all just
lowering it's all lowering from a neural
network spec down to a hardware command
queue that properly executes the
stuff
um okay so to get into how to drag
Nvidia a drag AMD and actually make them
good the way if you actually want AMD to
be good you know it's like going on
Twitter demanding they release the
firmware it would be nice to show that
they care if you actually want someone
to be good you give them a failing test
and you give them a test that's hard to
make pass you give them a test that
frustrates them and it's like we need to
rewrite all this
shit um so if I really wanted
to
uh
like you really want to make AMD good
you write a fuzzer at this level don't
worry about any of the other crap you
write a fuzzer at this level that uses
all sorts of command cues and then as
soon as it detects either trash or GPU
stall generates a repeatable example and
then you know what don't even send them
the fuzzer just send them the examples
you know
what no see I just you know you want to
do it open source but you really want to
you really want to do this as a business
you you uh you you send them two and
then you say well the rest of them are
$1,000
each um like I mentioned yesterday
better schedule
it what inference no one cares about
inference we do training
boys inference is done a long time ago
let let like tensor RT compilers like
that do inference who
cares this is probably kind of what
tensor RT is by the
way um you Nvidia has Nvidia has mix
quality too like some of the things are
very high
quality uh I was impressed when I found
a bug in nickel how quickly someone
responded and we got it
fixed all right that's kind of like
that's everything that that that
explains to you what what tiny gret is
Tiny grat is a compiler that goes even
from higher level shit than that tiny
grat is a compiler that goes from
x.com 2D
w.u right is this everything that I drew
here is this one line of python up here
com2
dw. goes to that goes to that goes to
that um but no they the graph
capturing we call it a hash capture and
graph I'm sure there's good papers on
this I just need to read one and
implement it
by the way we're hire if someone finds
this stuff cool and wants to come work
on it um I have many millions of dollars
to hire
you uh again what do we really look for
in people a desire for greatness and
skills like I you want things to be
great and and you have skills like if
you're on here and you're like wow this
is actually like I want to work on this
stuff full time like come work on
it um
start by doing bounties prove that you
can do
it DM me for a job don't DM me for a job
do bounties right I wish I wish
everything was I wish everything was
like this it's like it's not I'm not
going to like gay I'm not going to judge
based on how well you can
communicate uh I'm going to judge based
on how nice your your code is like you
wouldn't believe you know just just like
just do the
job do I have remote jobs if you're
asking that question
no
um do I have remote jobs I mean yeah do
the fucking bounty right like like I'm
not gonna you don't have to show up to
my office in San Diego to do the Bounty
do the
Bounty you think you think you think if
you do five bounties and then tell me
like look hire me pay me you know this
give me this Equity uh and I don't want
to work at San Diego but I'll keep doing
this you think I'm not going to hire you
like you people don't think you people
don't spend a minute and think like you
know you have no
empathy that's that's no
empathy but what if you want free money
rob a bank bro you don't even need a gun
just go into the bank tell them you have
a gun don't actually bring a gun and be
like I'm here to Rob this bank can you
give me the money right there we go free
money
with the ml perf bounties go do the ml
perf bounties we now support Invidia our
Nvidia stuff's getting good I don't know
why it just didn't like like like we
should put uh we're going to put more
effort to Nvidia and make Nvidia faster
I got to get some boxes up real
soon um but you can also rent them on
vast AI we are focusing on speed on
Nvidia so normal people can use this
shit no one has a 6gpu AMD system and no
one should buy
one you're still lamenting your 7900 XTX
per purchase I am
sorry I apologize on behalf of AMD for
their software being
shit do I care about college degrees you
just got banned you actually just got
banned you just got banned you pay no
attention at all
you were also saying something about me
being smart and then caring about
college degrees you show me that you are
dumb all right to mean too mean we not
being a mean
here like is that person trolling or is
that person serious I don't care if he's
16 this the be you know on the internet
no one knows if you're a dog saying I'm
16 you know what I love there's a thing
on 4chan where it's like um the phrase
tits or GTFO is a phenomenal phrase and
people think tits or GTFO is
misogynistic and I will give an argument
for why it is not misogynistic at all
and actually a true expression of
equality and
meritocracy so the the phrase tits or
GTFO only comes up when someone claims
to be female the thing about claiming to
be female on forchan is you do not
actually have to be female to do it
alternatively you could be female and
not claim it onfor Chan everyone is
anonymous but if you are saying hi I am
female I am feminine tits or
GTFO right you are asking for special
treatment and in exchange we would like
to see some tits right is that fair is
that fair I think that's fair right
because it's not it's not about who you
are it's not misogynistic this isn't
about women or men this is about you
claiming that you're special and saying
you're 16 is the exact same thing
thing is there a difference between
trolling and being serious for trolls
the only difference is the mental state
and you can't think about the mental
state right like like like what's the
difference be between someone who's just
an idiot and a troll the troll might
actually be smart and just be trying to
provoke and agitate the idiot is just an
idiot the difference between a troll as
an idiot is an idiot will never get
better a troll
might all right wow good rant tits or
gtf oh now we have all these we have all
these we have all these wonderful ideas
and now we come back here and the M map
returns minus
one we need
food where's my phone
folding
phone folding phone where's my folding
phone it folds it's phone it's a folding
phone oh change C view good
point Sorry I need I need I need an
operator I need a stream
operator exactly what part of AMD
software sucks the
firmware the the the out of order
schedule
queue so yeah you know what they still
say they're going to open source some
stuff and I'll believe it when I see
it AMD can earn respect does AMD want to
earn respect open source their
shit put out a blog post that says we
want to be better and we are taking
concrete action toward being better by
open sourcing and documenting our
shit wow is that so
hard we want to be
better just imagine that imagine imagine
they published a blog post that said we
understand our drivers suck balls and
have sucked balls for 15 years but today
we are making changes to make them
better these are concrete changes these
are not just empty words we are open-
sourcing this stuff we are documenting
this
stuff we're putting bounties out for
bugs wow they could turn it
around are there going to be T flop
bounties on the yeah I think we do some
T flop bounties on that why am I paying
out bounties to make a shit better why
am I doing
that not
anymore delete those bounties oh those
bounties are fine but
like what kind of food do we
want definitely don't want shansi Magic
Kitchen
again I want
breakfast or I feel good after I
eat heran
Grill 59 delivery fee
Sweet let's get some vodka Freda and
some sweet
plantains sounds
good
no but like it won't happen
right and live for the
moment that takes too much
pride no I don't know if it's hard for
them to open the drivers I I think that
they're just like I look back at their
communication with me and all I see is
kind of like a they're engaging
emotionally and not
technically right like the kind of
person who like we understand your
frustrations nothing nothing more is
like more when you actually start to
look at this phrase a lot of people will
use it and then you like realize how
much infuriates you like imagine you're
standing at a imagine you're standing at
a checkout
right and uh you know you have all your
stuff on the on the counter and you know
the person's just sitting there uh on
their phone and they're not scanning uh
any of your any of your stuff right
they're sitting there on your phone and
you're sitting there and you're like uh
excuse me uh could you could you uh you
know start scanning my stuff and they're
like yeah I understand your frustration
yeah I'd be frustrated too you know I
understand I see where you're coming
from I really I really get it like if I
was like at a grocery store and like
someone was waiting to check me out and
the the uh the clerk was just sitting on
their phone yeah I'd be frustrated too I
really get where you're coming from I
really I really empathize with
you and you just like like like you look
at this person you're like no no put
your fucking phone down and start
scanning my
shit um yeah which is just like it's
it's it's
worse it's like would you rather that
check out person just stand there and
like not do
anything AMD we hear you yeah you don't
hear me right like like like I I don't
look I don't I think it's rude to like
quote from people's emails or post
people's emails but like you see phrases
like that and you're like no no no no no
no no you don't understand what I'm
saying at
all MD needs to implement self checkout
exactly that's what I'm saying that's
what I'm saying how do we make change
how are we going to make
change
answer we're we're not oh the government
involved for back door see that's kind
of what I mean we could use we could
start like like there's a there's an
aggressive strategy here the aggressive
strategy is to
like look through and figure out what
patents they're infringing
right like you could do that you could
find exploits you could look through you
could you could break their their their
PSP right like you could you could do
all the things that like
just like open source the firmware and
we wouldn't have to do any of these
things right that's like that's like an
aggressive that's like an aggressive
strategy I mean not in like a blackmail
kind of way just in like uh well this is
what we're doing now you know I choose
to spend my time doing security research
on on on AMD what if someone leaks it
you don't want to do that the problem
with leaking things
is like it's not usable by any no no
like like the Linux driver people aren't
going to look at leag
sources
um yeah so that that's not a solution
unfortunately um it's also illegal for
you uh to do that so don't do it we
don't encourage illegal activity we used
to end every stream with don't kill
anybody don't leak any internal shit
either
um amd's PR man
understands your frustration and has no
idea what you're saying yeah that's a
good way to describe
it
um well I mean there's a difference also
between like looking at leaks and uh ice
Leo welcome uh there's a difference
between looking at leaks and like
encouraging leaks and doing leaks right
right looking at
leaks I mean again if you're trying to
like like be legitimate don't do that if
you're trying to just like you know fuck
around whatever some leaks are
interesting to read how do you think I
know things about the windows kernel
right
um that's said I'm talking about
companies here cuz we respect companies
the government works for us so if you're
leaking shit in the government well
that's a whole different
story what's very GPU oh this guy's
writing this guy's writing
a
um Implement a hip API why are you doing
that
don't Implement a hip API that concerns
me about your project right
now
uh do this thing work
though pretty
cool
oh hasn't been updated in
years wait he also wrote
coriander was this a
fork
I mean the problem with targeting hip is
like what do you mean by hip is that
also your
uh
wait
very
cool I think I judg too quickly for
about the hip
thing few core operations critical to ml
don't do t
h um um here you want all the you want
all the operations critical to
ml X2 log
2 s and square root are all you
need where do I use
sign just in
sign actually right do I do that
in
T uses sigmoid sigmoid doesn't use
sign goe for sigmoid
here sigmoid is just
X sign is
stupid do we really need I think this
like a tailor series approximation for
sign
uh this is a I like this
paper
um like goes into all the amp so there's
there's muu here is there a sign
instruction oh there is a sign
instruction there's a muu CO
sign the mufu supports
tan you know we might want to add more
uh more
Ops
so the muu is nvidia's multifunction
unit it's interesting the ones that they
have
here don't need f64
shit Grand n
what about
randan oh will you sign for
[Music]
randan oh use
sign I use cosign
anyway okay never mind we need
sign
for
you
know the more I'm thinking about what
our Chip's going to look like the more I
think it's just going to look like a
uh like the first version of the chip
just looks like
uops so we have a lower level called UOP
so these are these are Ops and then
these are the
uops a bunch of
like but it's it's it's like the
simplest uh
Assembly Language I've
seen we'll have to we have to get better
also not all the devices support all the
types and we have to be better about not
supporting
types um bu is super annoying bu caused
all sorts of problems web GPU that was
one of the reasons we had to F with web
GPU there were all these hacks around
the code for
bu
does this have
warps remember that time I wrote a risk
Core
risk now where's my uh it's not CPU do
oh that's the python version there you
go there was a CPU and Vogue I didn't
write any I didn't write any like
dispatch or anything I WR I writee just
like real simple
crap
um
so I think about it once this starts to
look more like a GPU I mean you have to
do you need warps
basically and I kind of feel like what
we're going to make looks like a
GPU
we have to also build uh there's so much
work to do before we actually can
actually do this like so much work
remember when I was riding the Cherry
stuff and I thought like I was somewhat
close to
something
all right we're going to want we're
going to want to basically build a GPU
with tensor course we're going to want
to get a simulation environment working
bring Cherry
back where is
Cherry I I just I I was so
naive people make fun of me for like
like being naive about stuff like that
yeah of course if you know about things
you're uh you know it looks dumb right
but like this is how you
start
I thought this was much closer than it
is we're
uh oh this is when I was writing the
risk five
core 10 oh this yeah I got I got a bunch
of friends who've taped out chips too
who could definitely help
me
um
we sell
cards we sell cards we sell a version of
the tiny box that has a whole lot of
them in
it
um so naive so
naive with nickel style Primitives you
don't need nickel style Primitives you
don't need any of this
stuff I think I think it's like 5
million to tape out a 12 MIM node we can
raise for
that we can raise it
uh I mean if we actually get to the
point where we're doing a tape out like
that I I'll raise I'll raise a 500
million
um our last Comm round was 500
million yeah maybe that could be our
next round for uh for tiny once we get
to that point we we raised uh we raised
five on 50 for the first
round
um yeah we'll raise uh we'll raise 50 on
500 we'll do some chip tape
that's can't believe I thought i'
flipped the
company
see seeing seeing very GPU thank you for
linking very
GPU thank you for linking very GPU
you've given me hope that I can actually
like you know yeah that we can do this
in a reasonable
time how do I win against the other
custom chip people by having software
that
works those are the last people I'm
worried about the question is how do you
win against
Nvidia
you don't control the whole process end
to end does anyone in here know will I
be able to tolerate working with tsmc
like I'm not able of tolerating working
with
AMD will I be able I'm disabling
subscriber only in case someone actually
knows but the minute an idiot talks
we're just putting subscriber only
back Jesus
backslash hello never
mind my guess is that all big corpos
work the same I mean like no look I have
no problem walking into the Apple Store
and purchasing a uh tsmc should do what
you need if you've got the money but
expect anything you do to be
copied you're not that worried about
that what do you mean copied like a tsmc
is not going to run off yeah they're not
going to run off other chips they might
like yeah designs I'm not worried about
that if if they were running off knockof
versions of my chip I'd be pissed but
like that tsmc does not do that that's
so stupid that no no company like that
would ever do that
no they wouldn't they wouldn't but
they're not
Chinese even the Chinese mostly wouldn't
do that and they they'll Chinese might
you know give it to the government but
tsmc is Taiwanese they're not gonna do
think I I just did a bike trip around
Taiwan like Taiwan is like
a a first world IP respecting democracy
they're
not who Taiwan is not China we're really
getting spicy
here no I'm not worried about
that Intel Foundry service no no do we
want you you want you want you want to
have eight people talk with a VP
no uh I'm sorry to pick on that guy too
I think he was trolling but if he wasn't
trolling was deep some some some deep
question questions about about your
culture um no look I I knew someone who
work Intel is yeah Intel
is I I heard a story uh about Intel
having a contract to change light bulbs
and it was $300 a light
bulb just buy a lithography machine
okay
um You probably still get a price from
Intel yeah how many jerk off meetings do
I have to be in before they give me a
price no we can take out a 12 NM champ I
think that's totally within our
abilities no I don't think it'll be the
same order with
tsmc also need to talk to Cadence
synopsis do we need to talk to them or
you need to just like pay them you know
50 racks or 500 racks for their
software I know we're so far away from
taping out a chip
guys I can't even get a price without
talking to them I hate
that no we're we're still we're years
away from taping out a
chip but I I do think our Chip is going
to look more like a
GPU we have to remember
that like nobody is touching Nvidia
right now it does not require a radical
rethink of the architecture maybe just a
clean room design that like copies the
best things from gpus is is
good just buy another startup that
already has the
relationships look I don't want to like
I don't want to participate in this
world right we'll get it chip taped out
we'll figure out how to do it and we
figure out how do it without without
participating in in these
games the fuck is a
partnership I have a partnership you
know in high school when someone's like
yeah I hooked up with her last weekend
right what did you do did you have sex
with her well no like we drove to Dairy
Queen and sat in the bed of her truck
and ate ice cream oh yeah you hooked up
with her I got you uh you
know
so I hate the word partnership and I
never want to see it I have no idea what
it means it is it is it is some business
version of hooked
up find a startup that you can tolerate
working with again
like not joining Nvidia guys we're going
to beat Nvidia it just might involve
using video on the
way I did go my own route with pick and
plays yes yes I did cut out all of the
you know what it is like these people
just don't desire Greatness by the way
the comma 3x failure rate is like
1% because we desire
greatness like I just I I bought the
best pick and place machine I could and
you
know
um T
to T Toren had an opportunity tens Toren
had an opportunity for us to write their
software they turned it
down
uh burning down Nvidia come on God come
on we love Nvidia guys we love Nvidia
you know what it is like they might be
price couching but we have to respect
greatness that's the world really just
needs more respect for
greatness a lot of people seem okay with
big vram and some okay
course um I don't think that this is the
future I think that like there's that
might be fine for batch size one
llms
uh no no no come on like how much resp I
you w you watch that b200 and you're
just like like it's just a challenge to
the world he holds that chip out and
it's just like come at me
bro uh you know we got to we got to we
got to respect we got to respect
Nvidia um oh beating Cuda is easy Cuda
is not
good like it's just it's just like kind
of not
broken I want to see if it's 92 okay all
right back to
work go to the bathroom then we go back
to work we're going to take out a GPU
we're going to make our own
GPU we're going to get to the bottom of
the most minimum thing we're going to
build a simulator for it we're going to
figure out we're going to run the
simulator on all our workloads and we're
going to tape out a GPU let's go this
was always the plan it just takes
forever everything takes
forever
I'll say one more
thing should we sell red tiny boxes
too should we sell red and
green
we'll start with green we'll start with
green it's possible we'll sell red and
we'll we'll put a we'll put a big
warning on the red box we'll put a big
warning saying um may have unfixable
driver issues we'll get like a we'll get
like one of them
stickers we'll get like one of them
stickers that says may have unfixable
driving issues did I get green
pre-orders I'm just going to ask all the
pre-order people like what they
want
looking for big skillers looking
ridiculous blue and red like I don't see
what the big deal is double barrel 12
gauge biger than Chris Wallace get
pissed cuz Biggie and pox just missed
all
this so what won't lead to issues going
through the roof
yes
where my
food
get
ramp getting ramp down with this
hard
okay so we're allocating
memory um let
me this pretty minimal already you don't
need s Trace I don't
think without guard pages
is
um going up a
bit create
events here we go create que I think
that's what we have to do next so let's
create a
q
GPU to get there
um what are my Q
options
that's not what I want to look at look
at the actual
file oh guys we're going to tape out
we're going to tape out we're going to
tape out
chips towards a transformative
hermeneutics and
gpus no there's only one way to win
there's only one way to win and it's
uh someday I'll own a
Fab I don't have to deal with the people
who make the Fab
equipment someday I'll make my own Fab
equipment
where's it
stop some things are okay to buy if I
can buy it on Amazon I'm fine with
that the part is when things lock up you
can read that you can read the high
quality while we switch the que to out
of order someday I'll make my own
atoms you know it's a process it's just
a
process oh you know you know you know my
dream to build a self-replicating
robot
2 kfd we pass in the ring Base
address so where does that address come
from allocated memory that had Flags
o4 user
pointer what's user
pointer
do you have to allocate memory for the
ring buffer I don't know but is this
this has to be GPU
memory write pointer address read
pointer address why are they just like
[Music]
random oh I don't
know
single Cadence sheet uh license is 500k
a year I mean that's
fine well like I said we're going to
[Music]
spend it's going to cost uh like $5
million to tap out the chip we just
accept
that is there any open source
stuff
we're so far away from
this just like people who've done it for
like really
uh oh tiny tape out oh this is actually
a
thing
oh I've seen this
before what process note are they
on
this is very cool who's ever doing
this e fabulous okay so skywater 130
nomer open source
PD
six month we
time
it looks like fpga kind of
stuff open
road by
DARPA w why don't they give the money to
these people instead of Intel
oh they're
nearby
oh I got some stuff
before
wait wait
really
might be possible to work with bubble
Founders
to that's
interesting I that's interesting that
that's how they price
it part of the problem also comes into
like what sort of memory controllers you
can
get oh the 7 nanometer open road is not
a real mode
okay
we have such a long run road to go like
until we have
fpgas there's not even a point to
thinking about a tape
out if pgs are so fun
though the open tooling is getting kind
of
good Tiny Box fpga
Edition doesn't matter what we're going
for we still need we still need Hardware
command cues it's all about scheduling
we need software that can schedule
things better than other
people
hard
$8 I get three
plantains off the
white
compile the model of fpgas well you got
to be very careful how you do that
this open tooling for low spec
fpgas my GPU scale yeah I can have less
I can have like less compute units
but that's fine like let's see what a
modern Z Point looks
like
we don't even need
that the good ones
here these
things how crappy is that
Ram
well like I I want an fpj boy that has
some like decent Ram I have one I have
one over on my box go look at
it
do someone got a good
one
vato no no so you do it without
vato oh smells
great
um what did I use last
time I probably didn't document
it us yosis I'm next
pointer
really what's the
best what's the best
um what you mean it works on Ultra scale
Plus
ice 40 or ecp5 wait no the ice 40 is
like that crappy little one
right no no no no no there's better
stuff than
that no I used a better
one what's Ultra scale plus you know
what upsets me you know who owns
zyink
crappy
ddr4 block I'm
sure you want get one I I got
one
I have one in this closet maybe I
don't
where the fpg board
go don't
know Ultra screen is only partially
open what's the
best what's the best Ram I can
get on one of these
no no no
there's
DDR3
the hell is this
crap wait
what it's an ultra
scale is that
ddr4
um well if the 490 is the best you can
get unless you're buying an a100 or n
hard or if you want maybe an AMD
one but yeah it's the best consumer
GPU
yeah uh per dollar no per dollar the
7900 XTX is
better
okay where can I buy these
things one has one in it that's actually
very
cheap is this an fpg G or
not wait those
fire
do they have
PCI don't technically need peace we
could do everything over
Network
okay so there's a 144
bit there's like cheap ways to buy these
cards I know they're
are
that looks kind of
good how much does that
cost
what am I
connecting an IDE
Drive oh look at
this Ian it doesn't have a ton of
uh PCI it would be nice if it had
more oh that's just that same
song that one is a little bit more it's
a little
[Applause]
wider yeah it looks like the same
song
the more enery you buy the more Angry
you
are this looks like the
company PCI 3.0 is that
8X we could
oh is that is that all
Ram that looks pretty
cool we could probably get a decent GPU
on this ooh luxury
package check out this
company I like that they have things on
eBay
are you Chinese I trust you
Chinese where's this com
from wow we hiring 10
people
see I mean the problem with this is it's
cool that it has hbm and stuff but I
don't think we're going to get any sort
of open tool chain for
this
it does seem kind of powerful
though wow that these people took
blockchain
seriously no I mean I I just trust this
company what we found at comma is we
prefer working with Chinese companies
because they don't like jerk you
around they don't jerk you
around like they
might they're not going to waste your
time just to waste your time they might
like exaggerate things a little bit but
everyone does
that
oh SSD need to
buy PCI gen
3x5 did you end up using unisoft
no
um we no we stick with
A45
oh there's kintex Ultra scale and Artic
Ultra
scale oh PCI
316 whole fat chunk of ddr4
80 gigabyte 80 bit bus so for comparison
to like like the 4090 is
384 so it's 4.8 times slower
than than a
oh this is exactly the card I was
thinking of
actually the squirrel
card
actually I heard you can get these very
cheap
too you know what the guy knows a lot
about this
stuff when we're ready for
fpga
Altera an Intel
company PCI Gen 5 this shit actually
works
aconic when it's time we'll find the
right
fgi you're working on a risk five core
that can run tiny
ground
so yeah I mean I think that's the basic
idea our our core would probably be I
mean risk five probably makes sense like
it's it's not too much more transistors
to put the extra to put like all the Ops
on there but only some of the stuff
would be accelerated through the vector
accelerator and
stuff I mean yeah but it's not a lot of
the scaler can do
everything it's all about
scheduling warps Global sizes local
sizes we're going to take all the GP par
stuff just build a good
one you need
branches you think you don't need
branches but you need
okay let's create a
queue ring Base address goes
in ring size goes
in GPU ID goes
in Q
type
why is this not
in should be in
here
yeah oh it's not K what did I import it
those
can't
set the Q type Q
percentage I don't know what that
is what's qid wow what is any of that
stuff oh I get a
q fail to look up W pointer
bow
oh you know here's a fun thing
too if there's any exploits in
this we can
um they probably AR exploit this is
Mainline Linux
code bit cereal risk
five we didn't find any
exploits finding exploits is a long
process that involves months of research
into a
platform it's only when you fully
understand how to use something do you
understand how to misuse
it okay wait none of those things are
being passed
in oh it doesn't like my right wait
right pointer address is an input or an
output doorbell
offset
from okay why is this not
creative fail to look up W pointer
bow
no W
pointer
why we have to
you might have to map the memory to the
GPU I doubt it but maybe that fixes
it it's probably our flags areow I don't
know what a user pointer is but let try
out get
one well that just doesn't
allocate I think it's because it said
something about how the API was
different if I was doing user pointer
map offset to
kfd
user the M that fails or no it's the
allocate memory
thats
all right so here's where we create the
CU oh wait that's different
flags this is where we create that
queue this interesting wait a second
look at
this this is somehow ending up
here as the right point of address
but I don't think I'm putting that in it
says it's an
output the ring memory is a different
kind of memory though which which kind
of memory is
that it's gtt memory okay we have to
understand what these acronyms
mean what's
gtt
graphical translation
table GPU
accessible GPU accessible system
memory
oh well you can apparently disable
gtt oh
okay gtt is system memory that can be
accessed by the
GPU does that work to allocate
that okay it allocates it doesn't create
the
CU it
allocates um user pointer on the other
hand doesn't
allocate
can't make your own physics and you
can't make your own math everything else
is
negotiable
see how that interacts with
that oh okay it's just mapping normal
memory I
see um let's try
that map private map
fixed I don't think we have to do that I
you just map private map
[Music]
um where's our other call to map down
there do this let's just try
this that just might have been fine the
whole time so not
that okay doesn't work
um bind me to Numa okay that's the M
bind
shit we don't care about that but here
so this
works I don't know what this map offset
is where does this come
from because I do think I have to put it
in if I'm doing user
point
oh failed to get user Pages
14 wait
huh I don't really get it what if I just
put address in
there
okay that worked it just didn't remap it
which is fine I don't care about
that because I already have it mapped up
here like remapping that's not going to
work uh address is not
defined
okay good we're allocating the Q memory
now we're still failing to look up the W
pointer
bow which makes me think they're not
actually let's find this in the
uh oh let's just put some crap in the W
pointer
no qrw
pointers
oh wait it like went further that time I
don't think those are why does it say is
that just
wrong I'm not reading it wrong right it
says that those are uh that those are
outputs but that doesn't make
sense from
kfd I don't think that's right
let's read this oh the hardware is fine
I just wish they'd the open source and I
wish they'd
care yeah it sure looks like it's
input okay those might just be wrong
then
whatever
um let's read the HSA and see what we
got there in tiny is this the driver
um so we create q no this this allocates
all the memory
too uh no the lock do you know how long
it would take to break that lock not
actually long not the
lock
undocumented breaking the L for take a
couple days documenting it all check
box
for
for
let's run this again and then let's take
a look at the Q
shit
Q read pointer Q WR pointer very cool
all right
[Music]
um let's go
here
fail to look
up and it's fail to look up W pointer
B that it's the wrong kind of
memory we need we
need kind of
remember
um okay w point of mapping so we look at
the right pointer
address and we see oh do we have to map
it to the GPU
maybe that's where it's trying to look
it
up is this the one I want to remap or
no that gets
deleted those
things it's interesting that that remaps
if I do the flags of the
G uh memory 2
GPU ah okay good that makes a lot of
sense so we didn't map the memory to the
GPU Base address right pointer
address yeah I know it's
right um cool we can even write to that
memory
ta so what is user
pointer
also don't need
that we've created a que who thinks it's
talking to the
mees
all the am user space driers open source
but it sucks no I mean it's not really
that the user space driver sucks it's
not that the HSA stuff sucks it's that
we don't really have control over what
these things are and without control
over what these things are it's hard to
make things I mean yeah you can say the
driver sucks it's it's fine it's it's
just not performant in order to get
these things to perform to be performant
you have to like pre-allocate
everything is the command Q documented
yeah the command Q is documented um it's
the same command queue that HSA is
currently using so we can we can go use
that uh I don't know exactly how these
ring bufflers
work
to
hey Forest
water
okay just's a lot of work to do
here so there's multiple Q types
compute stml a compute
AQL are we creating compute AQL
Q oh Q type is one oh that's an sdma
Q oh we're creating compute AQL
cues which makes sense I'm not sure what
a compute CU
is
so we can put AQL packets in oh is that
is one of these where we put in pm4
packets and one of them where we put in
AQL
packets so this is this is our HSA
driver in tiny
grad
um seems like the insight's gained by
making a compact version of this driver
would be very efficient yeah useful to
figure out why the firmware crashes it
would yeah the problem is without
knowing exactly like how we're putting
things into the queue um it's really
hard
to figure out anything about the
frameware crashes but what you mostly
want to do
is write your own version of the driver
and then every time it crashes like
maybe you can log what you did or maybe
you can just write a fuzzer
again why am I fixing this I'm not like
we're not really trying to they work
well enough that we'll be able to test
this and maybe someday if we like how
about this if we go a month without
seeing a driver crash on any of our AMD
machines uh a month is aggressive let's
say if we go if we manage to go a week
without seeing a driver crash on like
some new version then um you know we can
ship RTI
Bo like we we we want to make sure
what's an acceptable amount they don't
crash um what's an acceptable amount for
uh thank you for subscribing three
months in advance
uh what's an acceptable amount for your
training jobs to
crash
can it automatically restart on
Crash uh well you can write that
logic the Nvidia number I mean you can't
just say the Nvidia number could it
automatically restart from what I've
seen with the AMD GPU crashes one in 10
will bring down the system 9 out of 10
just resets the GPU and you can just re
you can just rerun the
thing what's an acceptable number what
number should we feel okay shipping the
red Tiny
Box 90% up time I mean the Tiny Box is
sold to ml researchers who just want it
to
work not people who should be tinkering
with GPU drivers
no 10 days without system crash yeah
that seems pretty
good no you don't we don't do Watch Dog
in once a week all right if if we go a
week and we feel good that it's going to
be another week we didn't say oh damn we
got really lucky that week then we can
think about shipping red Tiny Box
okay Q's are
real signals are somehow
RealD IO control create
FD
why would you as a customer choose red
over green save
$10,000 we're launching green first
we're definitely launching green
first
wait oh did I just get two
kfd did I get two and from
backwards no that's from kfd that's
right would be competitive at 25k I mean
you saw another person selling something
similar for 35k so
yeah
oh no no no no not one GPU reset a day
no you don't want one GPU reset a day
GPU reset brings your whole job
down no I I I want to even say I want a
week with no GPU resets across all our
AMD tiny
boxes if there's even one GPU reset
that's one too
many
aqlq man why is that
special
interesting okay events are
real creating an hdma Q
There
test set events weight events set
events or vents pointer is like in user
bace okay that's pretty
good let's take a look at what we're
actually going to put on these
cues
so this is an HSA kernel dispatch
packet submit packets I don't think
those things are
real yeah I think also like yeah this is
not this is virtual AQL
Q's
all right so we wait on all these
signals
that's not really what we
want completion
signal
what's an
HSA
barrier okay so I mean I've looked at
this stuff before so there's these
there's
these okay we're going to need this HSA
stuff no matter what to get these
uh to get these
things so we have a kernel
dispatch and we have an and packet oh
there's an or packet to which is kind of
cool but yeah so we're going to
basically the end packet is exactly the
uh that's like the weight event that I'm
talking
about like that that'll become a weight
and Tiny
gr it'll looks simple
enough
we can do we can do SAS level stuff as
well I'm kind of interested in
that but no I'm more interested in
scheduling for now like micro
optimizations are the last thing we do
like
SAS PTX is
fine though I wouldn't mind our uh PTX
being made
uh our PTX backend should generate
better code than our Cuda back
end if someone's interested in improving
that um we have a uh
where's
my compare speed Cuda PTX I love how
things just
work um yes you see that some of these
are getting bad ratios and I want to
like look into
why so then you can just
take which one here is bad that's a
pretty slow kernel to begin with yeah
that one's terrible why is that one 14x
slower what are we doing wrong so I can
say like num equals 105
yeah and
then so
the
generated uh oh this is just like some
load Fusion issue okay oh this might be
const
reordering so you can look at this
kernel is is 14x slower if someone wants
to look into like this kernel
specifically uh you should do it figure
out why that one's slower because like
most of are
faster some of them are way
faster then you'll occasionally hit one
that's 15 next
slower that one's 2x
slower 1 point it's probably only a few
things too I with like a few fixes our
our PTX can be consistently faster than
our
Cuda what's wrong here our Cod is
shorter probably like some casting we
did bad l
now the it looks like there's a lot of
problems also around the
loads in the integer
engine
um see how it does over time see now
it's
slower ice Leo thank you for gifting
subs
today ice Leo is our number one sub
gifter on this stream
it works out to be about the
same yeah every one of those that's
repeatedly
slow if uh if someone would like to look
into
this we would appreciate you and it's a
good way to contribute to Tiny gr I know
I'm one of those people who just gets
obsessed with like driving a metric
down uh beam search does not take into
account prior and future
kernels all single kernel optimizations
we don't even have it clearing the cash
um oh which is reminds me that's another
thing I should look at so niml genen got
uh some got pm4 clearing packets working
but where is a pm4 packet
submitted submit pm4
ibit packet oh it's AQL
okay
oh it's like some secret garbage okay
whatever I don't know why it's not
there but can you submit it to the
[Music]
same it looks like you can submit it to
the same
aqlq no Intel seems
like the only thing Intel has going for
them is how cheap the a770 is it's
probably subsidized they probably lose
money with everyone you
buy like they fit 16 gigs of RAM on a
$300
card that's pretty
crazy Intel his friends with Biden
exactly don't worry they lose money but
they just get billions of dollars from
the
government whenever a company takes
money from the government they usually
end up becoming
worse I mean and think about
why you you just get addicted to free
money did we get anywhere with a neural
network uh predicting speed up no not at
all um that was a huge flop the big
advantage that beam search got was
adding uh we added parallel beam search
so it could beam search uh across it
could compile on all 32 cores at once
letting us check 10x more
kernels so don't make a smarter search
just make your dumb search
faster guys it goes all the way to the
top for however much we think for
however much you know we think AMD what
we think about
AMD the government is way
worse I've had some interactions with
some government
people that are like okay look there's
people who are content to live in
mediocrity and whatever you you can't
really help them then there's people
who
like actively work to make the world
worse yeah how very bitter
lesson stop trying to be smart just use
more
search can someone explain in what way
one colel can be better than another I
mean like explain how one person can be
better than another it's the same thing
some people work
faster
um some people work work better some
people use less
power what about the not my problem
people let's not let's not go off on
this
tangent Captain oano it's because you
didn't install Cuda
correctly do you have
Cuda
Sorry by the
way install Cuda correctly and then if
you really want to be a mench uninstall
Cuda and add a decent error message that
doesn't say has no attribute and vrtc
create program and says install Kuda you
blockhead
could you run beam search on an
fpga I'm going to interpret what you
mean by that charitably and say will our
fpga GPU support beam search
yes a good first issue would be yes a
more usable error message for that it's
a trash error
message okay so these are the packets
we're going to
create um oh God we have so much work to
do
here we have so much work to do
here you missed the live PR
reviews see what we got today oh we had
minimal
flag
wait
what
what oh you disabled the cash oh that's
cool um we definitely don't need any of
that
crap that's cool my only concern is you
check oh
oh you check the
version you check the version in the
Constructor see this is a good
PR he even creates this in the
Constructor instead of having to create
it every time this is a good quality
PR he thought about checking the version
he only adds it if it's the right
version he speeds things up by pre-re
that and improves that to that
though actually you should also do this
there's no reason not to do that up
there as well but
whatever uh no that would actually
probably make the code less readable so
I think this is a phenomenal PR and
cestini we appreciate you Vulcan backend
via
compute
um yeah we're not going to merge
this uh we're definitely not going to
merge this if you're having fun writing
it enjoy but we're not merging
this um Onyx float compatibility okay so
a classic geohot stand PR which includes
17 million
commits good things CI is
free looks shorter buffer
pars yeah this code looks better than
what we had we also I'm confident we
have good tests on
I think this is why geot stand likes
it um half to float to float to
half a
decorator
interesting
whoa It's enabling more
stuff that's
cool I mean it even enables one called
really slow but still that's
cool uh and adds better checking to this
very good all right good start here good
start here um tensor core PTX yeah we
definitely need
this
um
though okay no if get M PTX that's
good
uh
no this is SC well this might be okay
for the flops
here yeah why is the typing nowhere
that's a good
question
um I think it could be
tighter I think this is pretty good but
I think it could be tighter I think like
in general when when I see a PR this is
like and you know what maybe this is a
draft
PR
um oh yes definitely had it a benchmark
but like this is a equals and this is
like when I see things like this I'm
like why is the spacing different that's
why we don't use deterministic linters
okay PTX clean
up um
why are there new childless childless
uops I'm sketched out by
that um this
one I gave them some
feedback what do you you no no no no no
what are you doing you want random
numbers you can just put them there
don't this is this is what why is this
no no this is bad code this is this is
terrible right like look look at that
look at that copy past a
shit um needs needs needs a lot of
work um my
code so um it's correct but it's wrong
for various other reasons we have to
filter out a sign and this is what
started me on a lot of this scheduler
stuff
uh so I should be better about marking
my PRS as draft um include negative
float in test D
type
um converting negative float to unsigned
integer is
undefined what the hell I believe
you these kernels needed new
instructions
oh uh quin's been maintaining R muu uh
just another great favor we did for AMD
which was we wrote them in rna3 uh
emulator that we use to test our
stuff um you know they can what what's
the problem with compute I don't know
what it is
uh you can use you can use that to find
compiler
issues um or do they have an rdna 3
emulator like why don't they release
it
um let's see remove requires grad check
for replace and ass
sign
uh all the optimizer tests are failing
when they
use a sign so this
guy remov D these assert require grad
stuff I don't care about replace someone
should really add an underscore in front
of replace does someone want to add an
underscore in front of replace because
replace should never be used by the
user if someone wants to do a PR where
they you replace replace with an
underscore in front of it I would merge
that because no one should be using
replace I'm sorry it's
confusing I didn't really like write
this well but use UND put an add an
underscore in front of replace and it's
a sign that should work and you should
not be testing
uh replace here but I don't blame you I
blame me uh for not documenting this
well uh so this is yeah if if this
person's
watching uh or sees this this is not
this is my fault for not explaining that
like nobody should use replace and I I
didn't explain the difference
well um I will clean that up uh disable
TC in action with a mount one this I
mean this shows some like issue with
with with beam search
on if you have this extra option the
beam search is a lot
crappier uh than if you remove the
option it's almost twice as slow so it
just shows kind of something's wrong
with beam search uh level zero
runtime uh we're putting this on
hold
um for basically kind of the stuff I'm
working on
today because do we really want to
merge Intel crap
not really I don't know I'm kind of like
done with that level I'm kind of done
with like the level zero level I would
merge Intel speed ups for opencl like if
someone wants to get Intel tensor course
to work there is a $400 Bounty for
that
um with merging a Dev container Json I
don't know what that
is if you submit a PR and explain to me
why it's
useful
and who's going to maintain it and keep
it up to date um then I'll think about
it use true half for Onyx this oh yeah
well that's actually pretty bad I didn't
know there was a hack there like
that um that's what giot stand's working
on oh this is my start of Intel M mall
I'm convinced their API is just
wrong so you'll notice that I have to
zero out half the Matrix to make it
correct
uh that was my reply to that guy who
thought he was fixing stuff
but like obviously I tried it without
the divided by two I don't know I I
think that it's wrong and I think that
it doesn't actually take in 16 I think
it takes in eight on the consumer
gpus but they only ever tested this
extension on
the the big ones they didn't test the
consumer GPO so that's my guess about
that bug but it's also very possible
that I'm just doing something wrong and
don't have like my local group size or
something oh yeah so there you go
there's some tiny grad PR
reviews um it's very accessible to
contribute to uh I I've seen I've seen
cestini around before uh I really
appreciate PRS like this like it it was
clear my first thought before I clicked
on the pr was what happens if you do
minimal on an older version right and if
that's not immediately your first
thought
um this PR is not for
you also I just where's this slide
from from some GTC talk like
just everything takes 350 milliseconds
to compile on AMD and I fixed
it uh oh you're in here cool um come
some GGC talk no you don't need to
Source it it's just it's just cool that
they're thinking about this kind of
stuff
um
okay so we're going to have to write all
this crap to load in that we should
probably start writing decent code like
I think we have to go
past all let's write a new driver called
kfd
um and I don't like that IO controls
from header is a
thing I don't like that I need lib MMA
stuff don't need an
unap I don't like that I need
that but
whatever um I don't like that I need
this either I'm gonna actually just do
that sorry about having to construct it
every time
whatever I'm not happy about that
either and we have to import
tfd from the run
time I don't control some header uh I
don't control number okay I guess that's
fine there doesn't actually have to be a
uh
whatever I could merge that into one
line I probably
should and we should definitely be
passing the FD in here um um either is
tt2 size is size of the
struct it type is or
k NR is
tt1 think that's more
readable
oh we shouldn't actually put that in the
assert okay
cool um no actually what I really want
to do is rewrite this to not be like
that
um let's write this out a little
nicer so we're going to have we say
functions equals this function
subname
equals um we want to create a
function
actually I can just use kfdi
control not
exactly to apply partial is it fun
tools uh that's good Funk
tools.
partial and then the thing that I want
to pass
in
oh I shouldn't really say it's TT like
that I should St what kind of stupid
names that I give these
things uh user
stru oh even user struck isn't
uh isn't really
right should I create a class
I do hate
classes I should really okay I remember
I remember the conclusion I came to
before about this which is that I need a
dynamic I need Dynamic code
generation
that like parses all this stuff and
generates I'm not really thrilled about
that but it'd be nice because it would
give me
uh
no kfd just calls into AMD GPU so why
are you looking into
kfd well AMD gpus is in the kernel what
do you
mean like I'm at the user space kernel
space boundary where where would you
rather have me
look
um
the actual driver is called AMD
GPU oh I mean yeah but this is I'm
communicating with the actual driver
right maybe I'm just calling it the
wrong
name
okay so the the API is going to look
something like AMD
Kio get
version and then
Kio
uh see that's not exactly what I want I
want I have to like create the struct
and then call
it I don't think I can make the struct
creation maybe I
can
okay I could pass in the user struct
here and then have it create constructed
user struct out of KW
ARS uh move FD out here kws
here and then
uh made return
made that in there like that
um like we can try
that put functions in
here uh Kio equals ials from
header
you know what else is frustrating about
the whole AMD thing it's
like why do you never explain your
reasoning which was another really nice
thing
about um
you know about dealing with Elon
like he just
explains why okay I want you to open
source this give me a reason why
not right and give me a real reason
don't give me some like corporate speak
Feelgood shit give me a good
reason just like be be
honest I don't know why that's so hard
for these
people give an example of him
explaining you can even see like he he
does it plenty of times publicly
too um I remember it was about the
mobile icon contct he's like you know
why would I pay out for something that
I'm not sure that I uh that I can
use and like again sure we can talk
about well why would I build something
that I'm not sure that I'm going to get
paid for but at least we're having a
conversation at that
point no they don't say there's no legit
reason we don't want to they don't give
a
reason they they what they're doing is
they focus on managing uh like they try
to manage your
emotions that's what a lot of that stuff
was it was like it's it's focused on
this form of
management uh oh we're going to manage
our emotions we're going to manage our
Partnerships we're going to manage our
client
relationships
um and when you manage something you
don't tell them the
truth you just you you figure out you're
like okay I might I also think that like
you manage enough and there starts being
no more
truth like you start thinking in this
mindset for too long and there isn't an
underlying anymore there's just a you
know perception is reality kind of
thing maybe everyone's just terrified to
put anything into writing they want to
do phone calls I'm like I want do any
phone calls why we just like this should
be an email I'm gonna schedule a phone
call get people together I don't waste
any with
time all right do we like the new
API looks cleaner than
that um now when we want to like do
something like AC choir
VM we know the GPU
ID see require VM
Works uh let's also import this so we
can no I have an idea and you get like a
certain type of person who says well
George that just isn't how the world
works and I'm like why not let's change
the world let's make it work that
way seems like it' be a much better
world and they don't see it as
dishonesty but they just they don't
like the thing about doing that is
you're having a conversation then that's
not at like the limits of Your
Capacity you're having a conversation
that's you're like just modeling the
other person and trying to figure out
okay well what do I want from this
person
right it's not the question is not
what's true the question is what do I
want from this
person uh and like you know how do I get
it uh I found in my professional
life the people who love verbal
communication with the exact same to
conveniently forget what they said or
agreed
to yeah that's kind of yeah I think I
think that's exactly
true um which is another reason I much
prefer to do things over email I think
there's just a lot less room for sort of
miscommunication you can quote an
email um but yeah no they're very
they're very reluctant like you I don't
know what they say like twice they tried
to like say oh we'll get on a phone call
like I don't want to get on a fucking
phone call what are we going to discuss
on the phone why don't you just why
don't you just you know say whatever you
want to
say but it's not like they'd say
anything real on the phone calls either
I did multiple of these phone calls and
it's I like you ever the example I
always give is this time I went to a
nail salon to get my nails done and I
listen to these two women
talk and oh quick call jump on a quick
call let's jump on a quick call what the
hell is
this
allocate memory of
GPU okay we got to do this VA address
crap oh well actually that is not right
we want the other one okay let me create
a higher
level
uh function
actually I can make this inherit from a
class can
I oh you getting a phone call and they
talk about their person oh yeah yeah I'm
going biking this weekend like who the
fuck
cares no I I mean I've had phone calls
like that like they they weren't look
AMD wasn't that
bad I I've had some I mean those phone
calls I just don't do right like I'll
only take a phone call you know I always
say this to
people
um here I'll read one out I'll read one
out it's from cloud flare and I don't
mean to pick on cloud flare this is just
the one that comes to
mind
see I can find
it
okay hi George I run blah blah blah team
at ploud flare I would like to chat
about an idea if you have time next
week why would you send that
email
like this I said this is not how this
works we don't have resources for phone
calls what exactly do you want from me
figuring out if there's any way we can
help you
succeed they say a little bit more they
say a little bit more but like mostly
that figuring out if there's a way we
can help you succeed if you actually
just said it goes on to talk about how
they wanted to do inference on edge
Hardware
okay actually you know what I'll read
the whole email because it is a good
example and I didn't reply to this
person because
like the the first part of the thing was
figure out how we can help you succeed I
don't want to spend time talking to
anyone who talks like that right while
also helping us do faster inference at
the edge on more limited Hardware here's
what your first email should have been
hey George saw you work on Tiny grad we
have X hardware and we're trying to run
y model our current times are Z
uh but we'd like to have our times be
W uh we're willing to pay you know this
this problem is worth order of magnitude
dollars to US can you help that's an
email I will respond to
right that's an email I'll respond to is
that so hard is that is that so hard for
people is that so hard for people to
read the questions
document
if everyone hasn't
read I'm not going to start responding
with skibby toilet although that'd be
pretty
funny be precise and informative about
your problem volume is not
Precision questions not to ask how can I
use x to do y
I tried X Y and Z on that's an old taian
motherboard when that didn't work I
tried X XY and Z notice the Curious
symptom when I tried to see right why do
they never talk like this why do they
always talk like
[Laughter]
this why can they not talk like smart
people
for
say it cuz they don't care I don't like
saying that I mean I've heard like you
you'll get that a lot from like Jimmy
Fallon talking about you know you know
the the Republicans won't pass gun
control because they don't care right I
think it's wrong to assume right or I
think it's rude to assume somebody right
away doesn't like doesn't care right
like like there might be other reasons
for this um I I do think that I I like
again having thought about this for
months
AMD does not aspire to Greatness right
I'm not really even saying they don't
care and if I said that that's going too
far I'm just saying they don't aspire to
to Perfection and beauty and elegance
and like things that make things great
they aspire to well all right do the
bare minimum to shove it through so the
Enterprise won't you know sue
us stream chat has better questions than
business
people all right do we like the new API
is the new API cleaner kind of like the
new
API
um
we're still on test kfd phase this isn't
actually a good driver
yet we're getting somewhere with these
abstractions the problem is I didn't I
didn't ACC like you can read my C code
for NVIDIA and I didn't slowly build up
extractions as I went I just thrashed
around you don't need no Reserve that
didn't do anything I don't even know
what that
does actually wait no we might need that
in the future when things get
big it's just annoying okay
whatever it has something to do with
swap that I don't quite
understand um from
mlid a
leaker
again let's be careful about what what
do you mean a
leaker like if someone like post
something like that that's not like what
I mean by a leak like that's not
copyrighted
right like if somebody if somebody like
breaks their NDA and like says words I'm
totally fine with reading that I'm
saying the problem is when you access
leaked copyrighted data your thing's not
clean anymore so you want to avoid doing
that
um
where do you have a citation for that no
I don't care if it's an mid sort oh mlid
is just like a oh it's like
a he has a YouTube
channel I mean this might explain all of
this too right one thing that could
potentially
explain
like amds Rel like I say like look I
want to write a beautiful driver for
you one thing again
I wish
you you know like if someone like called
me and was just like honest about that I
wouldn't tell
anybody I guess you don't they don't
really know that right but if someone's
like hey look man like you know but
that's never hey look man it's like like
like you're trying to manage some
shit I I think it's possible
though yeah I know no I probably
wouldn't tell anyone either to be honest
so you can't really blame for that if
that's if that turns out to be the case
if this stuff is masking like deep
Hardware bugs in rdna
3 uh I
mean what do you do right what do you do
if you take out100 million doll chip and
there's a deep Hardware bug and it like
kind of can never
work no they didn't tell
me it if they told me and like again if
they like you know engaged with me like
that come on like that's like that's
just that's just like you know what it
is that's just like a shitty thing in
like the world right like no no one
wants that to
happen um no look do I if that turns if
that turns out to be true if if all
these problems are deeply just the
hardware is you know look sometime the
hardware flumix is and
well um
oh mlad is Mor law is dead oh I I know
that uh no they're not there's no
conspiracy between they're like second
cousins and like you know taiwan's a
small island I
would
uh no I mean MISD design goals is it's
it is it is possible I I still only
think it's like 20 30% likely but it is
possible that this schedule on rdna 3 it
has nothing to do with like in order and
out of order execution just
fundamentally the hardware like sometime
doesn't work though usually you can
mitigate things better than that so
again I think it's pretty unlikely but
um I'll read the analysis yeah we we'll
take a look we love bashing AMD on this
stream but only in a positive
constructive way which is that they
should release their shit but if there's
a hardware bug all right I totally get
why they don't do it right maybe it's
[Music]
that um all right that's not
working we want
to Malik
there got to take a look at these again
these flags are pretty
important so what's the difference
between user pointer and gtt
see
what's user
pointer
a phone call from the government trying
to push back doors into your
products yeah I I I think that yeah I
believe that that
happens um you know
again what are they going to
do if I ever got one of those national
security letters that you're not
supposed to talk about I'd just post it
online I'd post it online and if you
want to put me in jail for that you can
like I think that's just so morally
wrong to do to
people um yeah well most people are
pussies who talk about
this
uh you only got one life
man me like
there's war I Nvidia and if they weren't
going to win performance they at least
had to be able to make it look like they
were more efficient even though they
really aren't and that explains this
weird naming the weird bumbled clock
speeds everything this this lot was just
rushed and that is why I think it's
compounded their bad decision making I
honestly think this this launch was rush
and I actually think it was rush for
three reason get to now number one Lisa
Su said that they would launch R3 this
year and from what I hear CH wants to
keep up the perception with investors
that am always launches when they say
they will un like in and that to
investors a delay looks worse than a bad
launch at least if they have
a this Easter season now as you probably
already noticed this isn't one of those
videos where I put 8,000 folks or an
entire PowerPoint on screen buch hyper
specific leaks I'm going to put quot on
screen soon but for the most part this
video is about telling you the back
story and the mentality of the engineers
video on Andy so don't look for a bunch
of things to screenshot and share maybe
just listen to what I'm saying you want
to share what I said
actually what's
rgg they performance make it look like
they offici they really didn't think it
would turn out as bad as it did and so
yeah that's basically my summary of what
I believe went wrong and a good
architecture on paper they had an
architecture that simulations pered they
wanted to and they had an architecture
that physically when they tested it
always performed was supposed to in some
games the last minut where the average
go way short because they just still
haven't finished the drivers they Cherry
Picked their results that they presented
on November 3rd because they thought
they get the average J at least as of
now they failed to but they accepted
this failure because they had multiple
reasons to watch this launch that would
come out at the end of this year instead
of next year that's how we get this
situation now there are two more things
I want to
interesting I mean I don't
know look you you basic like like I
don't know
well what a waste what a
waste why are people why are people
dishonest
why don't they just
like if your shit's not ready don't
launch
it
can I get this but
longer can someone find a good one of
these
where
yeah that's not even totally up to date
I
mean it's
bad if AMD Falls to too smallish share
of the
market they're going to shut it down
they're no longer going to be able to
uh
219 can we find this but up to date can
someone find
it
oh user stats of steam
is that can I get
that I don't know what that
means
okay so this is sorted by popularity
interesting
um Intel radon Graphics Intel Radeon TM
graphics
no what that bug
is
the PlayStation 6 will still use afd
yeah 2021 no I want to know recently
whatever doesn't matter that
much
all right chat you're going away for a
while you haven't been saying anything
good you got me distracted on dumb
shit
oh Flags can't forget about
Flags
I do any Dam that doesn't work though it
does work
wow but no it's the second M map that
fails so we can just do like a normal M
map
there map private map Anon map no
Reserve okay pretty
cool um on now we got to get back to
buff so we can use
2v let be doing the
dmfd if you're
doing gtt I don't think you do it like
that oh I should assert that Buff's not
uh that's
fine it still returning an map
offet
interesting
like I wonder if that does
anything what about user
pointer okay it doesn't work for user
pointer oh because I mapped
private
what oh no I think I have to pass in
user pointer there too whatever I don't
understand this if I do map share does
that work yeah that works so why do I
even have to what if I don't put an
address in
here oh
interesting what if I don't set address
at
all does this set VI
address just not have to that never made
any sense yeah does VI address get set
on the way out no it doesn't but this
might be okay if I just put zero in
here no that doesn't work um it's
interesting that allocate memory works I
wonder if it's actually putting that at
address
zero
so it does need to like allocate it sort
of
okay version of car VM memory of GPU
that seems pretty good that's giving us
GPU memory now how do we allocate a
q ring Base address is
buff ring size is that GPU ID is GPU ID
Q type is
that Q percentage which I don't really
understand is
that Cube
priority is
that right pointer address is that read
poin
address
that failed to look up we pointer bow
but that happen because I didn't map it
to the GPU we've we know about this
problem now so M that to the GPU
how do we M memory the
GPU SE successes
one
um wait I should just be able to do
this it might free before
I it's a little
sketchy use pointer is address of
that um handle is m.
handle and uh and devices
one
cool I mean I kind of want to make
something that like wraps this as a
class I guess what I could do do all the
functions start with AMD kfd
ioc yes they do we can remove
that
uh we can make it lower case it's a
little nicer at
least um um so we can just do K.G get
version k. acquire
VM k. Al memory of
GPU k. map memory2
GPU k.
create that looks nicer
right except I broke it how did I break
it oh an Mees
error oh hey
hey I found there you
go is that
repeatable
I'm looking at chat
again seeing what you guys think about
that so now just don't use it no there
just shouldn't be Mees SS right there
shouldn't be
ways create Q type zero
failed but is that is that a repeatable
crash so when you get this stuff failed
to
respond it's
um all right let's push this let's
reboot the
computer we can try resetting the GPU
but I don't think this works
better
Oh see now the GPU is in a broken
State like this is this is what I
struggle with now what the hell do I do
right so I I don't actually think that
that deterministically breaks the GPU
yeah you get this failed to write rag
garbage
get it
reboot oh now there's no more kfd kfd is
locked cannot create
process
now let's point something out somehow
from user space calling normal apis I
got your GPU into a state like this is
the shit oh there oh it worked oh it
worked that time great what crashed is
there a crash jump is there is there any
normal thing that like I can send to AMD
and be like yo your G U crashed I did
all this with Nvidia gpus I never
crashed it once they have a stable user
space kernel
API most of the client code is about
hiding these problems yes this is what
I'm
saying it very well may I don't
actually it might be Hardware I mean the
hardware might just be broken why else
would they not want
like now just don't use it yeah now just
don't use AMD
gpus like this is my whole experience
with
it there is nothing that you should be
able to
do oh it's gone
again and it's gone oh that time it
worked oh there we go it's in a a broken
State now it's in a broken state where
every time I talk to
it we get this all right we got to
reboot now to be fair I'm doing stuff
that's a little like I'm probably not
using all these apis exactly correctly
but that's not how this should work you
need to write a
fuzzer should we just should we ride a
fuzzer I mean now it's pretty now I
think I know how to Rite a
fuzzer tiny bux isn't going to be RNA A4
I'm never doing this again I'm never
buying these gpus again I don't trust
this company one
bit we're going to build our own
gpus and then I'll hide Hardware
failures from you
guys
I'm
kidding if I had Hardware that was
broken I wouldn't sell it
sell every AMD this isn't going to get
better
guys they're too busy working on rickle
I'm telling you they're working on
rickle and Mi open and you know giving
puff pieces about how AI is going giving
puff speeches about how AI is going to
change the
world let's I mean let's let's do
this
the future of your PC is AI opportunity
to really show everyone when you bring
everybody together you can actually have
a better solution with such a rich
ecosystem great Hardware Great software
great Partners I think we're going to
learn a lot over the next few years but
the way I think about it is the cloud AI
of course is foundation you need to have
very very powerful Cloud infrastructure
there's also a lot of opportunities for
very does someone want to make a mash up
of this and mes
crashes yeah that's what I'm saying like
like like do it do a do a mash up of you
know in those cases talking about
talking about AI puff bullshit and
interpers Mees
crashes you had a meeting
they pulled all people from gfx projects
onto compute AI well I mean do they
going to fix the
mees but no like what they don't do I
can send them this crash I can put this
in a while loop and I bet you it crashes
repeatedly or something and maybe I just
have to like add in a few random randin
somewhere um but there should be no way
to crash and that had to be
rebooted all right let's try it again
now let's see what we get there should
be no way that this can break from user
space you know that your pro you know
that your shit's fucked if I'm always
opening a window and running pseudo D
message W in
it
okay that time it
worked oh you found my
issue has it been closed AI or what we
call the client side or Edge side with
Rising AI can be very very powerful what
I view is a world where um everyone
everybody's life is uh improved by AI we
can all become more productive we can
all become smarter oh I didn't know I
didn't know I'm getting Mees failed to
respond and don't worry guys don't worry
they fixed it on Z 63 don't worry they
fixed it on 063 are you fucking kidding
me wow I didn't realize I didn't realize
I didn't realize there was other people
commenting on that issue they're never
going to fix it guys you can either sell
your Hardware or you know no sorry
that's your only option sell your
hardware and buy NV
video
what did I even do there all I did was
create a
queue all
right
hey look at that pretty
[Music]
repeatable
and to be fair I am creating the ring
buffer on GPU memory and not Gart memory
but like that's probably wrong you
probably should create it on Gart memory
but like I'm not even fuzzing
guys I'm not I'm not
fuzzing
and now it's fucked I'm not fuzzing I'm
literally trying to use the
thing nope you have like this
is
okay instead of fixing any issues they
shove mitigations in the wrong place so
as soon as you go right to the kernel
and you try very reasonable things fine
maybe I'm using the API a little bit
wrong right maybe it doesn't work maybe
it it throws an error it doesn't crash
the
GPU this is completely unacceptable and
it's not going to get
better disable U I'm sure I don't have
the IU
enabled how do I
check I'm happy to disable the
I
okay I do have the IU enabled happy to
disable
it yeah let's disable the IU what do I
do IU
off who wants to make a bet that this
doesn't fix
it
disable
amdu here to enable IMU to disable IMU
okay crub command line Linux equals no
that's junk wow I can't believe I fused
that
scri
also do I want to put it in Linux
default do I want to put it in Linux
default
or
Centos options and graub command line
Linux are always
default
okay
what I do grub grub config or
[Music]
something grub
CFG update
[Music]
okay
[Music]
still it would be good to fix the Q
creation code yeah we're going to fix it
but I mean again why don't we write a
fuzzer why don't we you want to write
the
fer okay so we we disabled we disabled
uh like they have the complete wrong
mentality for writing this shit all
right let's go let's see if it'll crash
Again by the way we very much welcome
any fuzzing of anything in tiny grad I
love
fuzzing up
hey
hey was it
theu IU
disabled hey it's still a piece of shit
hey all right AMD there's another crash
there's another crash being your unpaid
QA
team ice Leo thank you for gifting more
subs is there a way to tell if it's the
firmware or the hardware
no no no way to
tell all right GPU reset succeeded did
it reset no now it's just
hanging no but like the thing is instead
of figuring out what the root cause of
this problem was they'll stick three
more if statements in the
kernel but I have a complete okay you
guys saw this I have a completely
repeatable way to trigger this error
it's not even a race Condition it's a
completely repeatable way to trigger the
error I just run this program three
times oh good they fixed the
dmob good to know all
right
should we package this up nicely in a
gist
why is an AMD playing ball because it's
a hardware issue and they don't want to
tell
anybody all
right let's move this over this is in no
way ready for tiny grad let's move this
over from Tiny
grad run
[Music]
time tiny grad tiny grad
runtime driver kfd we'll move that here
uh we also
need the file that I
import
um time graad run
time uh driver
tiny
grad run
time
uh goes
here
should we change the title of the stream
to being amd's unpaid QA
team
for
what
that one was
fast
wait no do you guys you know what we
could
do we could um anywhere they think that
they're shipping s uh Sr iov to allow
multiple people on a
GPU are there clouds with these
things like it's like this is like
Colonel
crash let's rent cloud and spam this
shit no I really I don't think they
understand how bad this
is and I you know what what day is that
issue isue from what day is that issue
on GitHub
from May 30th 10 months
ago all right you want to reproduce this
on a tiny
box and then we'll try upgrading to
their latest version and making sure it
still happens on the latest version and
then we'll report the
bug
this has a different
issue a different issue here
oh that's not even a oh probably because
it has a different GPU
ID I actually get the GPU ID we can't
just hardcode it um where do I get the
GPU ID
from as you're still in public preview
wonder
why
oh I know
mus do
that um actually why did I com that
print I like that
print
oh space left on device
e
um actually wait better than that print
what I really want is a
try
accept import error pass
okay eventually you get no space on
device
okay oh that time I got
error there we
go okay now because I'm a nice person
let's update to their latest release
shit
probably shouldn't have that in there
because you know if you don't have that
we want to make sure no I'm sure that's
not related to the
crash
so there's a repeatable like basically
kernel
crash maybe read the GPU ID from an
environment variable no I can just get
it from
here that's a good point I shouldn't
just talk about it it's lazy with
me
uh I'll see what we can find
about the posted it on
Discord
um well no
but oh I'm sure it affects cdna I bet
you're the same bug I bet you could run
this on a cdna system and it will do
exactly the same thing it's the same
code
is
all that
crap I mean should I even should even
should we try it on the latest
version should we try it on
cdna I I like I I don't know what's
going to get through to these people
like that this is totally
unacceptable I think at this this point
you know yeah don't don't just offer to
buy back my gpus offer to buy back every
single rdna 3 GPU in
existence
for
all right here's the instructions for
installing uh the release candidate all
right
oh I probably wanted to overwrite
that
okay so you see we're on the new we're
on the new
version
um
right so don't tell me to try the latest
version uh yeah I don't know should we
start we can go after cdna we can find
we can find we can write a f and find
any s crash is
there
I'm giving them till Monday to say look
we agree this is fought we're going to
release our
firor we're going to you know here's
here's some docs here's what we can
release today and we're going to make it
a you know here's the process and we're
going to release all our
framework just nobody should buy these
cards and we'll we'll we'll hit the M
next
no I mean it's an addiction it really
is oh has no one reached out yet no no
no no no they've reached out I I emailed
with Lisa Sue yesterday she just doesn't
think this is
important like I got bullshit
back
so we'll make it
important I watch some videos
over first we're trying on the latest
version and now maybe if we start
attacking some Mi
instincts
where can we rent
uh
funny I I really haven't seen them
anywhere
either oh you can't rent them oh I
wonder why I wonder why
can I get an
mi30 well you know
what I have some Mi
25s great Hardware Great software great
Partners
yep no no no this is the one they said
they fixed it by switching the cube from
in order to out of
order
like is there any fuzzing at all on this
layer there is no way
that any kernel commands Should Crash
the
GPU we can try maybe F9 is less buggy
there's a chance they're less buggy
there's a chance they're less buggy and
they just don't give a shit about you
know rdna
3 but from what I've seen it's not like
one bug it's the whole process that's
broken
it's not that it's too many bugs it's
that it needs to be re-engineered from
the bottom
up release the firmware and release the
docs I'll do it
free to be fair and again I wish you
would just say this if this is the case
you're like I'm not going to give you
our firm where you've already said what
you want to do is you know use our GPU
to develop a driver stack and then build
your own GPU and we don't want to help
you that's totally fine but that's not
what they say I get bullshit I get
bullshit that says they care they don't
care I get bullshit that they say they
care and then it doesn't work say you
don't care and we're done that's great
that's then then then then your words
align with your
actions
oh you need to sign an NDA oh you need
to sign an NDA to use the Mi oh no
that's just Azure whatever man that's
not yeah
yeah do you have to sign an NDA to use
an H uh one 00 no I can just go right on
vast Ai and I can go right here to On
Demand pricing and uh oh look an h100
right there I can buy it for 275 an
hour uh by the way we're still
installing
hip
no there's a way to make apt
multi-threaded there's like a command
you can use I've done it
before marle doesn't let you publish
benchmarks AMD doesn't let you publish
opinions about their new
gpus it's not against nidia's terms you
guys are obset obessed with nvidia's
terms Nvidia terms literally all Nvidia
terms say is azure do not host 490s or
we will be upset with you and not give
you allocation for h100s that's all
nvidia's terms
say no you can't rent them they don't
work you know how you know they don't
work go on ML perf have you seen
AMD
why is an AMD not compare despite geohot
Lisa su's plan to get AMD on ML
perf AMD does not do ml they don't have
the capacity and Engineers nor desire in
the leadership to develop their software
stack AMD is had excellent hardware and
has years now to get anything going they
didn't so our best guess is they won't
zap I wish I just listen to
you look at my tweet go on my Twitter I
told them I fix this for them they're
not
serious they I I think the hardware
might be
broken if the Hardware's broken if the
Hardware's broken just be honest with me
and don't treat me like you're managing
a
relationship it's a harder issue for
Consumer cards um yeah I Me Maybe the
harder issue is fixed on I don't know
but who's
WS this is exactly how they manage coms
if they have a hardware issue yeah
sounds right let's spread that rumor
could everyone go post on Twitter right
now that the real reason AMD won't
release their firmware is cuz they have
a hardware
issue
let's wait forever for the Tiny Box to
boot back up maybe I should have just
installed it on this computer is this
broken
now I don't know why that's broken it's
turn it off and on
again crashed real bad that
time
find a bug which permanently bricks it I
I don't think these bugs are going to
permit brick it but it does seem like my
computers don't want to reboot okay that
one's back all right so now we're on the
latest uh rockan let's print the
firmwares
that all right so we just go in
here um we run
Loop and it crashed oh hey it's the new
firmware and it
crashes
wow looks like it even crashed harder
that time look they added
some look it's different
now they added some retry
shit oh it's staying up
wait the error is definitely different
on here it definitely looks like they
switched to que from in order to out of
order or some
shit they improved
something all right class action lawsuit
for all R dna3 owners the hardware is
broken guys they sold knowingly
defective Hardware
all right um I don't know I'm not
wasting anymore like I don't want to
waste my time riding a driver for
that uh should we should we should we
tweet that one should we should we tweet
the uh the crash it's repeatable I I
repeated it on two
computers uh it's almost instantaneous
and I tested it on 063 what else do you
want from
me if anyone has a cdna does anyone have
cdna let's replicate it on the cloud all
right where can we rent where can we
rent Mi
any now to be fair there's a chance it
won't
work um
um I don't have an MI
250 no you don't understand they're not
going to fix it for the next gen they as
a company are structurally incapable of
fixing
this like I
wasted I wasted months like engaging
with them thinking that oh this is a bug
that we can fix this isn't
right where's my GitHub issue where's
where's my where's my where's my GitHub
issue that was open 10 months
ago right and
also what if the reset works it doesn't
really matter no the reset doesn't work
after have to reboot the computer think
the reset
works now it's just completely
Frozen
also if the reset works even if the
reset works it totally does matter that
brings down your whole training
job and the reset doesn't work I now
have to reboot this
computer the power reset works yeah
that's true and I think I actually have
to be careful about how I reset this
computer now or it won't come
back right I I know know I know that you
know people are going to think oh George
gave up on getting AMD on ml per I
really tried guys but what can you do
what can you do when just like you know
you're you're you're trying again George
you're not using the API correctly I can
replicate this using the API correctly
too just not as quickly right I can
replicate this in Hip I can replicate
this in torch I can replicate this in
anything just reason that you go to this
level is not because oh I ran stable
diffusion and torch once and it didn't
crash it's fixed this is not how you fix
bugs gradient accumulation but you
accumulate by saving your dis and
rebooting out of band not in band you
have an external Raspberry Pi monitoring
your AMD GPU and sending a reset to The
BMC all
right let's hope it comes back
again
like oh no no the custom extensions you
need for Tiny Box green too that that
stuff that stuff is
universal um the Nvidia PCI controller
is a little better but not
much um all right so uh yeah who wants
to who wants to find some cloud
machines or should we improve the f I
mean I can't even improve the fuzzer
right is not even like I can fuzz better
I have a 100% repeatable crash I'm going
to hit the same crash over and over
again and this crash is completely
unfixable I'm not doing anything I'm I'm
literally all I'm doing is creating cues
and it's not a det notice how it's not a
deterministic crash right it's not like
you know you have to run it in a loop in
order to crash but all of these things
look like this and it's because they
don't root cause any issues they just
slap some stupid mitigation on it and be
like can't
replicate
um they fixed it what who fixed
it oh God no
see
yeah pumping trash 3.0 and hopefully 4.0
next
year did my computer come
back sometime when the GPU crashes badly
it doesn't come back and the only way to
get it to come back is to do a BMC re
reset fortunately because this has
happened so many
times I made a script to make this easy
for
me AMD layer Norm now don't wor don't
worry guys rickle rickle
coming
e
no nothing works on these cards you
don't understand it's not pie torch that
can be better I I'm doing a relatively
simple thing with the kernel API in a
loop and it's Colonel panicking the
card
oh oh I
mean wait yeah know I mean this really
only works these these these crashes to
bring things down really only work if
they are um yeah they on a VPS you're
only crashing your own machine right but
if there's any shared machines that use
AMD gpus I'm sure all these crashes
work $5 can I rent can I rent the an
MI like rent it for a long
time it's kind of
interesting all right uh I'm
disheartened I don't do this
anymore I'm not even going to tweak the
crash like it's not going to get better
it's not going to get better why why do
you keep why do you keep doing this to
yourself it's an abusive
relationship I'm not stuck with AMD like
I like this driver interface and like it
was kind of fun and like we were going
to go through and create a queue and
launch a
thing we can still do that you want to
still do that want to still do that and
just try to work around the
crash slowly work around the crash a
little bit at a
time
oh is it worth the effort
no yeah what about the next 10 I know I
know I
mean okay do you want to try to make the
crash repeat the problem is every time
it crashes I have to reboot the system
again H how are we going to get through
to
that you helped the scene a lot you
ordered AMD gpus don't do that if you're
trying if you're not a masochist who
loves dealing with this kind of shit
unfortunately I'm a masochist and love
dealing with this kind of
shit but if you're actually an ml
startup trying to do you think K owns a
single AMD
GPU why can't we just let AMD gradually
die what about come on like like like we
don't want
that that just
sucks you want to crash it once more
let's crash it once more oh look at
that you learn the hard way the starter
cost many months
yep I'm I'm convinced now also judging
from how it crashes differently on Tiny
13 that they lied about the Q thing and
they actually just shoved a retry
somewhere no it's just as consistent on
the other thing it just it just like it
flips between two things I think they
just shoved a retry in there and they
don't say like that might also explain
why that PDF made no sense
right part of the reason this PDF might
make no
sense like what committed in order or
out of order like this might be complete
nonsense let's write the real version of
this PDF there is a deep Hardware bug
with rdna 3 that is triggered by this
use case we can't predict when it's
going to happen but we shoved a while
loop in there to retry things and flip a
few different flags in hopes that
they'll work right
right TPM wrote this PDF yeah why
why it's G take it's going to take me
years to take chips out
guys like I like I like this I like the
kfd programming model the kfd
programming model is pretty nice I like
that it's like create Q Nvidia has you
do so much stuff before you can create a
que I like that it works I like that it
describes the four types of memory I
just wish that it was
reliable like I wish that you just
couldn't trivially crash
it I don't actually think it is like if
it's Hardware it may not be Hardware
related this may very well just be the
firmware what if I make a really cool
interface around 10 tour you're those
cards are a
toy they're not really worth like
they're fun to play with but they're not
they're not a serious ml make a
cooperation with t torr you could do the
software side I offered I offered that's
originally before I started tiny grad I
was going to do the uh I was going to do
the software on T Tor uh as a
contract um you know I I don't blame
them uh I think that they weren't
ready
gather everything crashing pie torch hip
tiny gr and C DNA R DNA display it so
every fucking idiot can understand it
hinted problems that occur in production
because of it that's probably the best
way to get attention about it but like I
I I don't know I think we're just being
lied to in some way I don't really
understand
like I'm not sure attention is the
problem there may be something they'll
never admit to Jim Keller thinks the
software part is easy the software part
is the only hard
part
um poster reproducible gift for sure
it's in it's in my repo it's in my repo
abusive relationship abusive
relationship
yeah their ml market share already
rounds down to zero and it will continue
to round down to zero until they take
this
seriously all right guys that's it
that's today
stream uh whatever you're doing if you
are are trying to do series ml uh do not
buy
AMD uh I'll send an
email uh right
now uh with that mes
crash bye guys
let's
go good morning everyone good
morning Mar is D and doesn't
work
that's all right we're going to use
whatever we can use and we're going to
see if we can solve press the light up
button this the wrong
python that py
good so who's familiar with how to play
press the light up button let's let's go
we're pulling out all the stops we're
using whatever we
can good morning oh you got an ESRB
rating you got a disclaimer for this
stream am I just going to get
disclaimers from now
on it it is possible that there will be
some marijuana smoking on this
[Music]
stream fuck twitch man
oh
No Just twitch though I live in
California
right wait that's
ridiculous is fuck twitch against the
ter I look I don't care if they ban me
man it'll be good it'll be
good sometimes you know it say it's like
the guys who ban themselves from the
casino man twitch banned
me we'll have to you know here's the
thing about twitch let's go um I I was
looking yesterday I only get 50% of the
money you guys pay to
subscribe apparently Twitter you get
97% I'm going to switch my streaming to
Twitter what's
kick what is this knockof
twitch how many of you how many of you
would follow me to uh to to to
this
wait is this a
joke wait this is a joke I like
this
I could be the biggest guy on
kick
all right all right all right well we
we'll just say this we'll just say this
hey kick reach out to me give me a deal
I'll love to switch I love to switch
twitch twitch got upset with me for
smoking marijuana on stream uh and I
would love to switch to kick and you
know we we were going to rant about RL
today but now we can be upset about
this um I got to close the door Alex is
sleeping and I don't
know uh yeah no kick reach out to me
give me a deal let's go go make me a
make me a kick
partner I like this I I like this I like
this good I'm so happy I love to see you
mocking the
form um yeah yeah yeah yeah yeah you can
you you you can hook me up with credit
on a crypto gambling site I'm cool with
that too as long as it's legal in the US
we only do legal things in the US like
smoke marijuana okay uh so yeah now that
uh that upset me about twitch uh and I'm
I'm happy to switch to to to kick
uh but we're really just upset about
reinforcement learning so we got to we
got to stay focused this stream is going
to be on on Twitch but if kick reaches
out and they're like George we have a
lucrative streaming deal for you I would
love to
switch
um I I I was not aware twitch and if
anyone from twitch sees this I I was not
aware that partaking in in in inlegal
conduct in California legal and
wholesome conduct in California
uh would get would get a would get a a a
banner to come up on my stream warning
people that I'm that I'm doing drugs
like like I'm like I'm like I'm banging
seven G rocks on this stream that's what
people think twitch you see what's up so
you know kick hook me up uh I would love
to I would love to switch also twitch I
I I never really thought about that but
twitch is getting 50% of the money which
is kind of
insane uh so you know we know when I get
banned they'll be not really because of
the the marijuana incident it will be
because I'm speaking truth to power uh
you know I'm surprised I haven't gotten
banned from LinkedIn
yet but
um Yu I appreciate I appreciate the the
sub gifting but we are going to move to
kick uh no I mean this is this is how
many of you would subscribe to is the
same thing can you subscribe to me over
on
Kick let's switch over right now just
subscribe for six months no twitch
twitch
uh this is this is the uh the marijuana
incident is is really the uh the the
last
draw
um I am I want uh I want a moreare split
uh 50% doesn't cut it for me anymore I
want I want the banner lifted from my uh
page and I want the uh I want more than
50% Revenue uh I you know I I look I
look look like we do this for fun but
now now now you're branding me as as a
drug user and now we got a problem so uh
that's that's what I'm saying uh twitch
you can you can reach out to me today
kick you can reach out to me today uh
this is this is going to
uh yeah yeah we're using leverage and
we're negotiating all right I get like a
thousand viewers on the stream man
thousand concurrence that's pretty good
what else I could be like the biggest
streamer on kick you got you guys got
anyone with a thousand concurrence
more more more more
more well okay I'm not beating India
Support over
here
um you can beat this girl I I just I
can't beat
this see what we got
oh oh content been marked as I like I
like it a lot it's very good see now
twitch is going to Mark right very nice
mve
yeah I'm looking
small M very good very good you don't
like it I think I'm just look at this
I'm very full I ate too much you want to
eat something too much
today I'm very
full it goes BR 10 hours I love this
maybe 12
hour yeah I know how this noodles yeah
please eat noodle no no no I'm going to
go to home and why no I need the
yeah uh some of the kick streamers are
banned on Twitch no we're we're we're it
is 2024 and we're speaking out for the
rights of everybody uh if twitch bans me
Twitch bans me that's that's their
choice uh but no twitch we need a better
deal we need a we need a better deal 50%
is not cutting it anymore
man uh and you
know
if I make a tweet dising twitch and
praise and kick they'll hook me up today
we're not ready to go that far we're not
ready to go that far
yet
um I I don't I don't I don't know enough
about kick they have they have a link
tree can I can I subscribe to their only
fans um you will definitely not get a
better deal from twitch or from
kick twitch warned me that I might be
intoxicated swearing a lot and potential
nicotine
use
no no no we're definitely not supporting
Google look we're really only on Twitch
for legacy
reasons what's Justin oh Justin
TV kick is kind of shady with their
deals yeah they look they look kind of
sh Shady uh no I think we should TR
stream on
X I mean the problem is if I stream on
Kick no one's actually going to find my
stream but if if I stream is real George
Hots on X does this
work and then I think can I gate my
streams behind subscribing to me
yeah I did one stream on on Twitter
before I had to get like a media account
I I don't know I don't know if elon's
fixed this
stuff why not multi stream X doesn't
have chat you'd rather watch on
Twitter uh I don't know but all I'm
saying twitch is we're going to we're
going to need a better deal uh we're
going to need a better deal and we're
going to need we're going to need that
uh that content warning removed uh and
you know if you're not ready to do those
things you're going to have to ban me
that's that's that's how it's going to
go um X added chat on
desktop let's see well well let's see
let's let's let's talk about my
negotiating
power
is science and technology uh on the
front
page I have more viewers than most of
the people on the front page right
now I have more viewers than that I have
the same same number of viewers as that
I can't compete with
these
I don't know what tarov
is uh watch hours are very important for
negotiation do I stream for money I get
money for it and I think I should be
getting double that's right oh look look
look look look I'm not I'm not here to
be difficult but you know you you you
flagged My Stream as as as being uh as
being uh as being adult mature whatever
and you're clearly watching my stream at
twitch and now that you're watching I
want a better deal that's all I'm saying
all
right no I don't think they they don't
they don't they don't give 50/50 to to
Big
names all right I like all right so I'm
I'm the 7,000 top streamer on
Twitch have a lot of followers wow
people have wasted 330 hours on this
junk remember that time I showed my I
showed my Revenue you want to do that
again big names get
okay
i' i'
uh no no no no no no no I'm not going to
stream more regularly I stream regularly
on the weekends now and if that's not
good enough
I I'll wait for my kick deal to come in
man no uh we we we might switch to
X well we lost followers on that one
that's kind of
wild no I I applied once to be a partner
and I was rejected from it and the whole
thing was the whole thing was not uh you
know I really didn't like it it it was
not a uh like it was not like if you
meet these requirements you you get this
it's a backroom deal thing they just
decide if they like you or not uh which
you know kind of upsets
me on Twitch there's no better streamers
in T and programming than me I believe
that
um yeah so you know twitch you triggered
me uh we're going to need a better deal
uh we're going to need we're going to
need a better deal uh
yeah if we like you you get a deal and
you know I don't like that sort of look
I'm fine if there was like an actual
rule like I had to set a schedule for
streaming I had to I had to actually do
it
um want to see my
revenues what what what what what can we
do that's mildly on the edge right now
to like get
banned because you know getting getting
banned is is uh
here's my
Revenue it's 30
days I made I made $88,000 you know if
if the split was more fair I would have
made
more um I'm not not gay it's
true not that there's anything wrong
with
that
uh hot tub stream what else what what
else can we do that's like kind of on
the edge to to to to to get this to get
this ball rolling let's Google best ways
to get banned on Twitch all right you
know what no no no we're going to
perplexity
that all
right no to avoid getting bad a stupid
AI you see this is this is the problem
with AI okay whoa whoa whoa whoa whoa
first off marijuana is a legal substance
what is hate speech I do hate uh who do
I really hate the professional
managerial
class weapons oh where's my where's my
uh where's my where's my here oh yeah
yeah yeah look at that look at that I
got a box
cutter uh what else we got nudity sexual
acts that doesn't sound that doesn't
sound good oh derogatory language
relating to sexual orientation
no that's that's that's that's you you
know we we're supportive of all the
lgbtq rainbows um we're just not
supportive of college administrators
inciting violence h no no we don't like
that making fun of medical conditions oo
oh man what medical condition can we
make fun of oh
yeah uh disabilities or other sensitive
topics so engaging in illegal activities
displaying copyrighted material without
permission or guys of promoting gambling
streams what what gambling streams can
we promote I don't even know any of them
if I just say them is that promoting a
gambling
stream oh you I you how I feel about fat
people guys being fat is a choice um
that is that is definitely true your
weight is your
choice stake.com is banned guys go watch
some gambling streams
um you want to get baned stream a movie
no I wouldn't want to violate a Studio's
copyright they're just out there trying
to make money uh wait can I really not
talk shit about fat people I'm sure
we've talked shit about fat people of
all the things you know of all the
things look you make fun of someone for
their race you make fun of someone for
their height you don't do that but you
make fun of someone cuz they're fat that
is a choice man you choose what you put
in your body remember yesterday when I
ate that cinnamon roll I regretted it
all right and that was a choice I made
and it was a poor choice and fat people
make poor choices every day and that's
why they're
fat a segment called fat
watch harming yourself on
stream some of these things are fucked
up we don't want to do that man we we
want to do we want to do normal
things
um would not like that hay is being uh
made fun of sexual acts is nice has to
be personally insulting yeah that's just
not my style guys we don't we don't want
to insult
people
um there are two G well no she's not
really gender Spectrum guys
um masturbate on stream nobody wants to
see
that uh where where where's it where's
the deck of cards does anyone want to
play blackjack right now
does would anyone like to play me at a
game of
blackjack selling meta stocks is a
choice that's
true gender gender is actually a
spectrum sex gender distinct I mostly
agree with this
stuff um all right all right let's let's
let's get back to RL you know we can't
just we can't just have a stream there
meta and 800 viewers now could report me
yes please no I don't know should you
actually report me what's going to
what's going to get me a twitch dealer
banned we got to we got to accelerate
this you know what I'm
saying why am I not logged into anything
change the title to please ban
me start around Andrew T A let's see
let's see a you know the
funny let's see Andrew
t uh the funny thing about poor people
is they should just stop being poor me I
have seven Ferraris and I rape girls in
Romania and it's okay cuz I'm Andrew
Tate okay and they tried to put me in
jail once and it didn't work that's
because I'm richer than you and better
looking than
you I don't know I don't actually not
like Andrew Tate I think he's all
right top G top
G we we don't I don't actually hate
Andrew Tate I think it's
okay okay so remember yesterday we coded
this great game press the light up
button today we're going to try to use
stable baselines to solve it all right
stable baselines three we're pulling out
all the stops we're not using tiny grad
here we're using we're using stable
baselines all right
include
[Music]
I don't find the AI coding to be very
helpful
how does this
work okay we need it to be a gym
environment
uh
it's mostly a gym
[Music]
environment
should probably pre- select all the
states
here
is
see I don't like how do I pass in
parameters to a game um I we can just
like I I guess just putting them
here oh wait I can just pass parameters
after that one that's kind of cool
cool um render modes that are supported
or just none and we don't need render
FPS
uh
[Music]
state so we have to uh
to get the
observation self. size we to do self.
state sub
self.
right see it's nice to be H I'm thinking
I'm thinking clearly in the morning
which is
good
uh so we have to put the observation
space
what
am I getting none there
oh no stay off twitch don't stay off the
reefer
man twitch is upset with my weed smoking
then you know what uh which is GNA go
off twitch we're GNA have to do it it's
you know it's sad but it's gonna have to
happen is this inclusive or
exclusive great don't give me any
docks one above the largest signed
integer
okay good press the light up button is
working let see if we can
learn press the light up button has no
OBS okay well that's
fine
no one ever said spun is going to make
me more productive
man
index one is out of bounds with a step
size of
one um yeah that's true because the game
is
over
none type doesn't support object
environment
for
I don't know about
this non type object does not support
item
assignment
doesn't look useful all right perplexity
let's
go not returning any info information
info dictionary oh is that what this one
has to be okay let's see what the return
is from
Step info here get info or do we have to
do info we need a
dict
great
I think it's actually working maybe I
don't
know
uh
okay
oh I can do do render that's pretty
cool except that render doesn't
obviously work on mine
but
is
you tried to render but the render mode
must be defined when initializing the
environment must be human or RGB array
not
none I
see
for
okay so we grew this game yesterday it's
called press the light up button one of
the buttons lights up you have to press
it it just basically uh put the state in
the
action okay this thing actually looks
like it gets very good I press the light
up button that's
cool uh let's try press the light up
button with size 10 something we could
not solve
yesterday wait it solves
it
okay let's try a longer
game um
um this truncated isn't
[Music]
working why is it not finishing the
game
okay when I have a game length of two
for some reason it doesn't finish the
game
this is really
dumb oh cuz we're resetting it every
time okay well that's not
right
okay
cool uh so yeah it looks like it learns
this game pretty quickly
actually all right stable baselines 3
just works uh let's give it a big size
and we'll give it a game length of 10
let's see if we can get 10
reward didn't learn that
fast let let play for 20,000 time
steps okay I learned how to play great
uh so stable baselines
Works
um what if we just change our
environment
I love this game by the
way so okay do every understand how this
game is
played uh this is the lights and this is
light 11 so you press button 11 right
this is the lights this is 0 1 2 3 4 you
press button four you get a reward uh
light 13 light one light eight you press
the lighter button and it goes on for
for 10 oh let's see if it can learn in
hard mode
um in hard
mode okay it can't learn in hard
mode um in hard mode the policy changes
uh for each
step so for the next step you have to do
something
different
no it doesn't look like it learns hard
mode at
all
as a chance hard mode just doesn't work
um so now we can play the game ourselves
okay uh that is 01 two
three
h and let's also play it with a smaller
size let's also play it with
four so you just have to
add wait what I told it size
four there we go uh so that's the answer
to that is 0 1 2
uh int object is not
subscriptable okay oh it's a vector
environment I
see uh so the answer is three the answer
to this one is also three yeah see
because you have to do that no but that
somehow ended the okay now there was
just a bug uh action plus self. step Nom
mod self. siiz that should be
right
one the answer to that is episod
one no it somehow thinks the target was
two try three there okay three is wrong
okay so you have to you have to put in
the action like one before right so for
this one the action's also going to be
three yeah okay so that's right so hard
mode does
work see if we can learn it
with
so my guess is this policy doesn't
support anything
temporal it doesn't seem to be able to
learn the game on hard mode but the game
on easy mode is
just the game on easy Mode's very
straightforward it learns it very
fast okay let's see if it can learn
lunar
lander see look at how nicely it
progresses
oh it's
beautiful I just wish I could set render
[Music]
mode
okay let's figure out how to set render
mode they had some like render you can
type so this is using stable Baseline
this is like
the most common
RL
can render him it doesn't
[Music]
work
you have to create it with render mode
human
so that's the Baseline posy what I'm
learning is that not going to do R mode
human no now it's now it's doing render
mode human to learn I don't want
that
should also be able to register press
the light up button with
Jim um forget v m m reset M
step trunk
cated
you have passed a tuple to the predict
function instead of a numpy array or
dicked have I done that did I do
that
uh it all works nicely if you're playing
in stable
baselines setting a model array with a
sequence the detected shape
was
whatever we got to figure out how to fix
this to actually switch to rendering
human
mode get M return the current
environment
VM render human this should
work oh render mode RGB
array okay that for some reason
worked but now what happens when I learn
here okay that for some reason
Works let's let it learn for a bit see
look how the reward goes
down I mean goes up I
mean okay so RL works if you use stable
baselines well sort
of
that's pretty
[Music]
good
all right so now we reimplement this in
tiny
grad well thees stable Baseline support
uh decision
Transformers
we've also learned that press the light
up button should definitely uh
work because it learns it really
fast even with a large size and a large
game
I didn't learn that one that fast
but okay let's register this with Jim
how do I register a game with
Jim
well we tried decision Transformers all
day yesterday and they didn't
work so you know there's just 7 million
places there could be bugs in tiny grat
there could be bugs in my implementation
there could be bugs anywhere uh and we
didn't really have very good tools to
introspect uh which is
what upset me
okay
um I don't know I don't know how to
register
it
okay I push this to geohot Dum
RL um
um I think they built a good I think
another reason this thing is good is
they built a good uh
Vector explained variance
Advantage actor
critic so much
code does this thing reliably solv
C
say the thing it's like
okay the tiny gr example for this is
better
that one didn't work okay it doesn't
work every time maybe theirs is more
stable not time it learned see the
reward you probably can't see
that
oh yeah don't go off the
side no I mean whatever they wrote in
this seems to just be much more robust
than what I
have okay let's find the stable
baselines decision
Transformer in the current weeks we'll
be extending the ecosystem okay did you
do
that
what was I reading what was I reading
last night I was carefully reading the
decision Transformer paper last
night um I have it right here on my
folding
phone
[Music]
[Music]
for
[Music]
okay let's get decision Transformers
working on press the light up
button stable baselines
Jacks sounds
fast what's tqc o truncated quantile
critics I was reading about this so they
they wrote a really nice wrapper for
vectorized environments
first uh which which is smart like a lot
of this a lot of what was struggling
with yesterday was just that I don't
have any
uh so I watched
these uh like like I watch I watch this
and it's it's a video about like the uh
the roads in
Congo further on there's another pothole
which has been there for so long that
the drivers have dubbed it the
ancestors see just that little clip that
that pothole that's been there so long
the drivers have dubbed at the ancestor
um and you realize
that what these people should do is
build
infrastructure they need to fix their
Road and I watch these these these these
documentaries and it's just over and
over again people putting in 10x more
more work than they should put in
because everything needs to be done
right now they're kind of thrashing
about um and it's the exact same thing
in code so yesterday what I'm doing is
I'm struggling with could there be bugs
in tiny grad could there be bugs in my
Transformer trainer could there be bugs
in my RL implementation could there be
bugs in my game uh you just you just
don't
know um where the where the bugs are and
what you have to do is you have to
carefully build infrastructure or you'll
sit around and you'll thrash the whole
time uh say it's nice to have things
like Sable baselines which guarantee you
at least that like someone's looked at
this and someone's maybe it even has
some CI testing and and that sort of
stuff
um but yeah know this is the best
documentary deadliest Journeys oh
fire
let's get some more coffee and then
let's find an implementation of uh
decision Transformers and see if we can
make that work on press the light up
button and I will leave you while I go
get
coffee with
this that's too many times St it's going
to take too
long see seems like a
[Music]
number
so what makes RL a lot more challenging
than than supervised
learning
is you don't have a fixed
spell that word right I don't think
so oh okay
this is what we
learned is it going to
land I mean this is clearly showing even
though it's not Landing it's clearly
showing some
intelligence it's keeping the thing in
one
place
good
recovery it hasn't figured out Landing
yet but I didn't write this this is this
is just stable
baselines uh no I was also I was just
frustrated on stream yesterday about if
you saw my tweet we're going to we're
going to Thanos snap on Tiny grad we're
deleting a lot of it we're deleting all
the back ends people don't really use
we're focusing on the things that
actually need to work well
um wow look at that it's almost like
it's going to
land it does too many
lines uh
okay no 100,000
no iOS you you've said many distracting
things so you're you're done talking I
think you're done talking you time out
someone for the rest of the
Stream
okay let's see if we can get the ja one
working my might be
faster it's just going to
work so might be easier to read since
it's
new
[Music]
well we
TR it doesn't have
[Music]
a2c I like how their reward continually
goes
up
Bas if I just change this to
sack all right I I remember what we were
trying to do now just try
that no we can't use sack because it
only is cuz it's disc
great Advantage actor
critic they're also playing a lot more
games than I
was like in order to learn this it's
playing 10,000 it's playing 20,000 games
so I wonder if it's just that if my
thing was just a lot slower how many
update steps do they
take this is really nice uh okay so
they're taking yeah they're taking like
an order of magnitude more update steps
than I
was
um I left it on for about an hour after
the stream it didn't work I'm not sure
it can solve in Orlando but it might
very well solve um
solve this okay decision Transformer
repo let's just try this start
there how do I use this
thing
experiment module name
gy
I don't know about this is there like a
is there a useful decision Transformers
repo that I can just check
out here let's see this hugging
face
example decision transform
what custom data
collator takes about 40 minutes to train
in a collab
[Music]
Network okay uh let's go let's go over
to Tiny grad for a bit and let's modify
beautiful cart Pole
let's modify beautiful card Pole to
solve
uh press the light up
button I'm going to copy the press the
light up button
game this render is stupid
let's create a new okay this is wrong no
go here got
this let's create a new folder called
RL I guess that was kind of a stupid
repo I don't know if we need a hold repo
for that
um render function
G so we we create the environment down
here with
a is there some way to like convert the
environment
like I I I recreate it down here so that
we can actually see it
rendered yeah works on on Ubuntu yeah
let's let's make this thing reliable
let's figure out what tricks they're
using in stable baselines let's make
this reliable and then let's see what we
can replace with a decision
Transformer and we'll get it to register
too
okay so this
is this is Tiny grabs cartpole solver
it's called Beautiful cart
Poole
um it works maybe 50% of the time 75% of
the time
let's get this to
register
examples. RL light
button we'll just call the
ID
uh the second element returned by m
reset was not a dictionary oh this is
supposed to be info as well I
think okay so it's getting one reward
test reward 1.0 okay I learned that very
fast uh
let's let's make the size 16 and the
game
length all right when I give it a bigger
size it does not
learn what if I just give it game length
10 does it learn on that
okay it very quickly learns to get
10 uh what if I give it the size two
does it learn
that size four no it struggles a lot
more interesting I wonder if I have a
bug like how come it can't learn with
four but it learns fine with does it
learn with
three
yeah it learns with three but it
struggles a lot you see the test reward
you see
this does everyone understand the press
the light up button
game
Che
so it looks like yeah for some reason it
doesn't work once I make the size big
but the
uh look like it doesn't work at
all
but this one
does so what am I doing
wrong also think that my model might be
a little small let's take a look
at stable baselines as
model
what
C
RL debugging let's see what we
got why is debugging RL so hard yeah
yeah
oh here we go look look at these nice
little
uh oh wait I love
this
no I'm sure stable Bas lines is
good I'm I'm curious why mine broke when
I switched to a
[Music]
uh
that
[Music]
so I think that again they're just doing
a lot more steps than me we're just not
doing
many
what
these are my hyper parameters all right
we're sitting here we're tweaking hyper
parameters
again
not getting
reward where's my sampling here Tod do
what what's the temperature
here oh we need to add a
temperature also is this even right
where my soft Max
[Music]
okay evaluate clearly takes the AR Max
so that's
fine uh X assumes that there logits on
the
output which is
fine
but we have a bug where we're not okay
so if if you're following along with
this this is beautiful cart pole in uh
in tiny grad we're going to try to get a
reliable uh
a2c thing and then figure out where we
have to change it okay so you divide the
logits by temperature you don't it's not
really logits that you want there this
is labeled wrong in gbt so I think we
first do the X
then we divide it by the
temperature then before we do
multinomial we do a soft Max and I
wonder if that's part of the
problem
I mean like multinomial shouldn't even
work if it's not normalized so I don't
understand still doesn't
work wonder if lands cple more reliably
now
though so we're extracting the hyper
parameters to
here
[Music]
uh we change that
30A why am I
that's the actor not the
critic now this is
unstable oh multinomial does the
normalization I
see
really but what kind
oh it does normalization but that's not
the same thing as softmax
right like it yeah it's not the
same
um
God there's so many hyper parameters
here called
gamma
[Music]
does this solve the game with size
four four at least sometime randomly
gets
reward doesn't solve it so we have to
still have bugs
now the problem is not stop stop stop
stop stop the problem is not grid search
or anything like that the problem is
probably not even hyper primers the
problem is probably
bugs even this it doesn't say stably
soft
it seems like I broke something by
adding soft Max and
temperature
I have double
exp it's x.
divt
multinomial no I don't think
so so this exp is because I want the
model to learn
Logics but I agree that that softmax
makes it
worse in
practice
well then what's the loss that's even
weirder like we we can't not have a we
can't not have a uh okay that solves it
right
away and if I add a soft Max it breaks
it but we can't not have a I mean you
think it's
that all that seems to work
too just remove that
EXP
solves it
fast let's change the size to four solve
that no can't solve it with
four okay the model outputs logic
J
how do I
select an
action
temperature so I also have log softmax
too
I mean that looks like that mostly
but I call it log dist here and I do an
exp
here well okay then that's
on
do an XP
too like I don't think this is right I
think I have to do a softmax and I think
this is exactly why it doesn't work with
more than two
actions
see this is so
complicated you do little things you do
exp instead of soft Max and that just
breaks
everything one of the best things is
still the open AI spinning up in deep
RL see I bet I bet you that's I bet you
that's the
bug
what is a soft
Max Max
Dev
why do I have tan H feeding into a
softmax I
don't oh I have a log softmax here
already oh okay
well then this was right to just be X
but I don't have a
temperature so this was right I think CU
I have a log soft Max
here still can't learn
it like there's got to be something
wrong right because it learns it with
two
instantly so reward 10 but if I make the
game size four it doesn't learn it
anymore oh that time it learned
it
unreliable let's get that to be reliable
there's got to be some there's got to be
some
bug I have a test for log softmax
in in tiny guys
right
yeah and log softmax does what I think
it
does apply a soft Max followed by a
logarithm
wait that just might not be what I think
it
is
I think it
is okay
why doesn't this work with more
than two
[Music]
outputs so much potential for
bugs let's take a look at this and see
if it's a proper probability
distribution should
be
okay that looks like a pretty legit
probability
distribution meaning they sum to
one why is it not capable of learning
once I set the size to if I set the size
to
two instant
solve if I set the size to
three solves but
slow not even always yeah there's
definitely a
bug
the entropy
loss not these
things I maybe this like a broadcasting
bug why would something so reliably work
with two and then break almost entirely
when it goes to three see sometime it
gets lucky and gets
it let's go somewhere it just can't get
lucky let's go to
Five
nothing
for
those valid log
distributions yeah they look
valid it's not printing multiple times
because of the
jet
let's confirm the J's not somehow
breaking
something it's still broken it's just
slow
um is it a ranging issue can't see the
output but you may need to Res
no no it's it's it's cross
entropy
I just I don't know if this is
[Music]
right the Mas and manage calculation
might have a mismatch
it added
torch
I guess I don't really understand why I
do that sum across
there
it's maybe it's these sums that are
wrong what is do minimum oh minimum
should be a local minimum between that
and
that can we sum across the action to Di
menion and then we take the mean across
the whole
thing is that not what we
want there's so much like like look at
this tiny function there's so much
potential for bugs
here and I don't know how anyone else
gets any of these other things to work
because they're so big and
complicated where's the PO function in
here
policy
loss Advantage actor critic okay this
doesn't even look like it uses po then
MSE
loss
entropy is none you just take the
negative mean of the log
probs why do I do
this why is mine more
complicated they have a value
coefficient
okay it looks
like they don't even have
P normalize advantages roll out data.
advantages okay
advantage
reward minus the prediction from the
value am I supposed to detach that no
okay I detach the whole Advantage
here I multiply the advantage times the
log prob though again why do I take an
exp
there
can I just do a mean overall they they
don't bother to sum across that
axis which might be totally
fine this just doesn't
work
[Music]
compare the output of the one that works
yeah but
like there's so much difference I can't
even find where their stuff
is
do I not detach
that I mean that's probably a
bug
for
okay why can I not write action loss
equals log dis time M advantage.
mean you have no idea you're talking
about um some input tensor not found oh
that's because I'm passing an all log
dis and not using it that's just a jit
buug
does that work to solve size
two the 10 H has nothing to do with that
the 10 H is in an intermediate
layer this doesn't solve it anymore oh
well that's because I need a minus sign
here oh
okay if I don't use po it doesn't solve
it how how does that
matter oh well is the bigger problem
that I didn't do an
exp it's probably the bigger
problem okay that solves it it just
takes
longer and we have another
hyperparameter
here called train
steps okay that seems to solve it and
behave how we think it
should let's take a look at these Mas
advantages and see if they make
sense Advantage we subtract the the
estimator the
value
you see I wasn't detaching there see
that was probably a
bug okay so
we reshape the reward to match the size
of the value that seems right
bump the size to four see if it gets
solved
interesting
it gets solved it just takes a while is
it worse with
PPR interesting it's worse with
PPM
do I have a bug in my
PP or we just got lucky and
unlucky that eventually solves
it I worry that things like this might
be tiny grad bugs
too like who's tested if clip really
works and minimum really
works
who's tested if detach really works
[Music]
for
oh look we got some big rewards
there random we're watching random
numbers
again now we can't even solve we can't
even reliably solve this with big sets
of
uh we we can't even reliably solve press
the light up button with big
sets we let this finish and we'll watch
lunarlander
Crash okay our best landing
yet
um
so I wonder if the difference between
these things is actually the fact that I
have a sum
there
no it's weird it's weird it's it's worse
with
PPR can this one solve size eight or
does it just get a little bit
better okay it solves it
interesting okay okay this is good
progress
um maybe the sum is actually
good
also be nice if this were
faster actually need that line in the
jit that checks that
thing here look reward
10 uh so I'll put the jit back on and
I'll get rid of this summon poens is not
found this we don't really need
okay you don't have to use the input
tensors okay so this is reliably now
solving with size
eight uh the thing it's just when I put
po back on it
breaks okay good good good this is this
is good
progress why does po
suck detach can't be wrong I don't think
so I
mean we can always do this
too
okay with po no
solve yeah probably there a bug and PPR
that would make
sense
po should actually like not do anything
most of the
time which makes me think
that it seems to reliably solve it
now
well okay kind
of it's a lot faster without P
too
sof okay let's carefully read Po and see
if I wrote this
right
uh old policy divided by new policy
policy so we're effectively doing that
when we subtract in log
space then we take the
X
um
it's not fucked up if he deleted the
nice messages okay it's not nice to go
off topic it's nice to what's nice is uh
is is
correctness
ioso I I don't know if you're trying to
be helpful or not but that's not helpful
and I'll explain why and Gerald Dam you
get timed out uh that's not helpful
because the the problem is not is po or
trpo better
the problem is why is my uh po not
working sure looks like that's what I
wrote wait hang
on no maybe
not no oh wait this is
wrong I'm multiplying there by masked
advantage and then I'm putting that into
the clip no this is
wrong okay so this one gets clipped I'm
multiplying it by m Advantage
twice that shouldn't be
there then we have another one
this shouldn't be ratios minimum this
should be ratios times mass Advantage
minimum okay let's
say look like it works better but that's
clearly wrong
right
still
broken found a good a good basic
po that doesn't work either but it's
clearly wrong what I had
right so
complex see that solves it
okay calculate the ratio current log
probs batch log probs compute the
surrogate
losses he also normalizes the actions
which is kind of interesting but okay
compute the S
okay so I mean let's just write the
right thing there was clearly a bug
here unclipped
ratio
equals we got to stop trying to be
clever in writing things on one line
that's really hurting us
now we want the
minimum
they're calling AK is the masked
Advantage batch rtgs minus V detach I
think that's
right
check critic
loss I don't think that's
wrong I mean remember this works if I
disable the PO
lines so right now we're just we just
get no
reward
that's crazy we fixed the bug and it
still
sucks but this is okay so we do vanilla
policy
gradient it solves
it see it's solved after 100
episodes
we found two bugs so
far 0.2
found one bug with the detach and one
bug with how we were Computing
this and the worst part is it's still
solved
cple let's go back to card pole for a
minute
soft where's vanilla policy gradient
doesn't solve it well it solves it it
just takes longer and then is
unstable
okay that solves carple faster and none
of those bugs actually seem to
matter know that bug was really bad wait
did I get my signs
right
let's check to make sure we're not doing
any silent
broadcasting well those are the same
shape we definitely take the minimum and
then
do this
subtraction it doesn't actually matter
if we do the mean before or after those
parentheses are
useless they have a separate Optimizer
for the critic and the uh
then the and the actor I don't think
that
matters I don't think that
matters The covariance
Matrix no it didn't solve
it
is this really
right we had an obvious bug and it
didn't affect
anything just
infuriating okay compute the current log
probs is an open source test Suite I'm
sure there's many things like that but
that's the problem there's many things
like that we just subtract the logs it's
just the same blah blah blah BL blah
blah
blah gradient descent easier okay great
um
you sub with your hard-earned money bro
you just got banned with your
hard-earned money that's right that's
right that's
right I don't know what you thought this
was do you think this was a
democracy
huh there's a lot of zeros
there
also looks like broadcasting and
broken we'll go back to the game size 4
just it get
smaller
[Music]
interesting how are there so many zeros
oh I'm looking at clip ratio I want to
look at
ratios let's look at
ratios they're all like kind of in the
right
range they're all like kind of near
one why is this one always
one that looks broken
that looks really
broken most luck with this
implementation let's take a
look okay TF
minimum train batch postprocessing
advantages
times clip by value yeah okay
that's that's what I have
how did we have major bugs in this and
it just affected
[Music]
nothing okay the
they're doing the square the other way
but that doesn't matter right x - y^2 =
y -
x^2 true or
false
7 - 4 = 3 4 - 7 = -3 that's the same
square okay I think that's
right I don't know what this ignore the
value function
is there's bugs this shit's impossible
guys okay look we're writing code that
looks looks cleaner we have unclipped
ratio and clipped ratio and then we have
action
loss
these ratios look approximately right
I'm asking you to learn the
game
[Music]
um okay we're supposed to return a numpy
let's return a
numpy let's that
war
it's not
learning it's so weird though is it
manages to learn
okay vanilla policy gradient works it
also manages to learn the uh card
pole but it can't learn press the light
up button with the wait
what that just
learned okay I work now we're in hyper
parameter land let's ra slow the
learning
rate
okay you change the learning rate it
seems like it's learning
Now sort
of
no never mind doesn't learn
anymore at least I'm pretty confident
this is correct I'm glad that we fixed
these bugs let's give it a try on lunar
lander also raise the hidden State size
maybe I'm just trying things this is
stupid
no this there's no this is not there's
something deeply
wrong selected action none of this is
attached
right no all
not
wrong solv
it okay all right at least at least it's
solving it sometimes
now
um
and we fixed a serious bug so I'm happy
about that we moved all the hyper
parameters up to hyper parameter
land let's see if we can learn how to
land the lunar
lander
probably too
ambitious okay
well so
close
let's see how reliably we're learning
card Pole
now okay
good oo ballsy bro
ballsy somehow didn't get 500 on that I
don't
know okay this looks way more reliable
than it used to be oh no no it went on
stable never mind I spoke too
soon um I less learning rate more hidden
State the problem might also
be no the problem might also be hard to
learn let's take a look at a2c and see
if it's a cuz this might not be enough
layers this problem is like an exor
problem actually wait no it's not no
it's only an exor problem if I have to
be able to play the game both
ways
um okay you say the one that works is
the one that normalizes the
advantages okay solves cpall
like it gets fast after a bit which is
cool when it's done filling up the
replay buffer
for
[Music]
I still think something's wrong with my
PO because this is doing
better who knows maybe these clips don't
work
work like if anything's broken in tiny
grad's gradient engine it's
this torches had problems with this kind
of stuff
too um or it's not really torch it's
like you don't exactly know what you're
doing you don't know what's getting uh
where the gradients are flowing where
the gradients aren't
flowing
for okay well it's
great we're not going to you don't get a
choice you have to use
PPL
[Music]
so actually I have a lot of questions
about the use of tan as
well
oh no we just got lucky that time it has
nothing to do with anything we just got
we just got good
initialization
seems worse with a larger hidden
state I'm not swapping tiny grad there's
no point then when you just swap it all
out for
baselines again this is a deep
misunderstanding of what we do on this
stream okay
we don't solve the problem nobody cares
about solving the
problem now we can write some tests to
see if the gradients match that's
different we fixed like a major bug and
nothing got
fixed
deep misunderstanding of my suggestion
time out
bro that's right Iron Fist this
morning now we're not adding more crap
why does this not
solve
why does it solve with vpg and not with
well now probably doesn't even solve
with vpg anymore because we got rid of
tan H which actually turned out to be
great are they using three layer
networks or two layer
networks let's go back to that that
tensorflow one you said you had luck
with this one looked kind of clean okay
ppf policy great but of course it
doesn't include any
uh do include the the the catalog oh my
God see this is just
like what am I even reading
here no Tage is in the middle Tage is
stupid okay on policy algorithm actor
critic policy okay here we go actor
critic policy observation space that
space that sounds good feature
extractor how does anyone write any of
this stuff
man carefully initialize the
stupid create the layer that represents
the distributions okay latent dim to
action DM and then they
like
MLP extractor let's see how many layers
is this oh here we go it's an option
that you can find here how do we get the
layer
sizes where do the layer sizes come from
oh there's a value function coefficient
that's interesting okay we have a gamma
whoa look at that learning
rate whoa 7 e minus 4 that's that's
crazy that's a crazy small learning
rate oh they're using RMS
prop
oh this is what I mean like why is it
RMS CR and not
atam why do they have
a
point explained
variance that's
cool oh and then they have a FP graad
Norm
great so how do I get the size of the
actual
Nets is that going to be something we
can
find all right so it looks like they
have two that are 60
4 all right so let's add another
layer and their hidden State size is
64 I mean there's a chance it's this
these functions are not these functions
are a little Annoying for these things
to learn I think so but I don't know
that actually probably doesn't make any
sense but whatever we're adding another
layer anyway don't add more layers until
you made it work with the other layers
yeah I know I probably shouldn't do this
but we're doing it anyway so you know
that's
right
um okay now we've matched the other
one now we learned nothing but remember
that their learning rate was a lot
smaller than ours we were just like
getting like lucky on
cardfall oh there we
go okay is it reli
ible
okay two in a row can we go for three
let's go for three three three
three three okay oh that's using vpg now
let's put po back in and see if that
works
Sol fast okay good good good good good
all
right two let's see oh oh
boys oh yeah we needed a three layer
Network oh come on no no no no you were
so good you were so good no it didn't
work that
time why is po more
unstable
no we're not fixing the random C that
does
nothing does it work with cart
ball
yeah okay look it learns much slower now
but it seems more reliable
maybe I don't know I'm just making
excuses for an underperforming
Network don't do it don't go off
the oh 500
exactly all right can you solve lunar
lander no of course you can't solve Lun
Lander that's way too hard great we're
back to that
guy it's interesting that it prefers
that I still think there might be some
bug in my
PO
still B for a
while
look at their rewards they're going
almost positive
now look at those
rewards oh no no it lost that it lost
that oh it was so good well this is the
problem with vpg it's really
unstable okay we had it good for a
little bit it might have made a landing
on the moon but we'll never know cuz
those records were
lost no now it's just in it's in it's in
junk land oh
great
let's try with size eight the other one
worked with size a right let's go back
to Dum
RL uh we can also now
do whatever um
how come they have a learning rate
that's much smaller and how come they're
using RMS
prop what batch sides are they
using N M's might be using a much
smaller batch
size okay this just isn't solving
now does vpg solve this
one
no how this is so
simple
how does that not
work shut the search tab
oh this search tab I like the search tab
I'll make it
bigger no it's a little too
big
okay again like we're not
learning we're just it's not
learning how is it not
learning when I give it lots of options
it forgets how to
learn it gets reward
sometimes
change learning rate to their number can
try
that I actually worry that it's wrong in
the other
direction okay now it just doesn't solve
this anymore because I raised the size
to eight okay I mean we we were too
optimistic with
four okay let's go back here and see if
this actually reliably solves this
solves
[Music]
16 yeah look it gets reward right
away to be fair we're doing a lot less
total times depths than them so let's
try like total times STS of 100 and see
if we get
it that seems to work
better
it solves it very
fast so we're just we just have
something wrong
still we are going to find the
book okay maybe we should start thinking
about what the the thing is there really
is nothing to learn in the value
function
we're not rewriting this in P
torch you like again the point of the
stream you want to write a test do do
you think that the problem is do you
think that the problem is that the train
step is not Genera the right
uh is not generating the right
gradients we can do that if you want to
test
that
fine we'll write in by
torch is that close enough to pie torch
it that just
works
oh it's so hard to write things in
[Music]
pytorch
just sounds so
painful sounds painful and it sounds
like we're not going to learn anything
because the bugs are just going to be
different we can check the
gradients
that's
fine
you know where I worry the problem
is what are these being initialized
to
[Music]
okay this is what it looks
like
there's so much potential for bugs
here
okay I don't I just don't want to do
this you know
if
all right let's just convert this to pie
torch
if it just works in pie torch man I'm
I'm just I'm just that's it that's it if
it works in pie chch we're just shutting
tiny Corp down this is that that'd be
just total
bullshit
f
why I hate
P critic has no attribute perams how do
I do
this I'm sure co-pilot can do this for
me
get
pams
parameters no I this
isn't
Matt have to be the same D
type but got long and
Float kind of a Bugg and light up
button log soft Max
expected wrong
file
multinomial
expected parameter num
samples brand in missing one person
parameter
size branded an argument size must be a
tuple of in not an
in tensors can't be realize because this
is
torch
probability tensor
contains Nan in or okay
PCH Wow first off holy shit that's
fast second off why is it
n wait that's insanely fast
we should we should give up just that's
insanely
fast yeah it's the same okay so pie
torch has
n and also doesn't solve the
problem
P seems just less numerically stable it
has
n okay
great you guys Happy P torch is less
numerically stable and still has zero
[Music]
reward though that is a little
concerning that we are on the edge of
numeric
stability
no it's faster it's it's a lot faster no
I look there
are tiny grad's not fast at things like
this P George
is um but it didn't help with the reward
and it's actually unstable with a
learning rate with the same learning
rate I'm using in tiny
grad
so I mean you watch my translation do I
have bugs in
it except for removing the realizes and
removing the jit and the
speed isn't that good no RL doesn't
work I mean that's true if if that just
worked we would have just shut tiny cor
down
maybe that's why they had 70 minus 4
yeah I mean all right let's go to 70
minus 4 and let's train it for 10,000
EPO let's
go okay let's go back to things that we
know actually
work let's go to cple cple
work okay carple works great so my
translation's correct
wow that's fast
though can we go back to Tiny grat now
that we know there's not there's not
bugs would it be great to have an
automatic pie torch converter
no no
like
the whole thing is frustrating right
like of course in many aspects tiny grad
is in no way as good as
pytorch um but it will be
better
eventually and the the problem with this
is you just kind of have to have faith
in that I can make some arguments I
could make some I I could make some some
reasons uh but mostly it's just a matter
of faith uh and that's all that's all
starting your company is right if if you
start a company and you're like we're
going to compete with Google and you you
have your first thing and of course you
know it's it's not as good as Google
it's it's very quick to get
demoralized
um the the the the advantage and
hopefully what ends up
happening is that the very simple
underlying stuff of tiny grad makes it
very easy to make progress in ways torch
can't
uh but okay we we translated it to P
torch and we see the exact same
behavior
uh I mean it is true that if we're
worried about places where
okay something you can do something that
does someone want to write this here you
guys for someone can write this so I
wouldn't translate at the API layer I
would transl at
the um mlops layer there's this thing in
tiny gr called mlops and if you just
Implement these things in
pytorch if you implement versions of
this in
pytorch uh you
can test the automatic
differentiation wow that's so fast
though like it's equally shitty and can
we seriously talk about the fact that
tiny gr is more numerically
stable now why we're on the edge of
numeric stability in the first place
well that I don't
know which is another
like
so fast so
fast all does tiny gr handle mismatch of
D types yeah it'll just do the right
thing
it behaves identically in pi torch and
Tiny grad so hopefully we can rule out
tiny gred bugs
now the OBS returned by the reset method
was expecting the numpy D type to be in
64 the OBS return by reset is not within
the observation
space
H oh
here okay I don't think any of that
stuff's the
problem uh yeah tiny grad has has the
same upcasting Wheels pretty much as
Jack as
Jack's
it is so much faster to just test this
in P torch though it's so
fast learn nothing
quickly with reinforcement learning
it's not the backend stuff and the
reason py torch is so fast is because
you're getting it to C really
fast
um okay so why does this not
learn
do you want to like look at the
gradients can we do
that is that GNA make any
sense py torch is 20x
faster
that
how does this not
learn
this should be the easiest problem there
should only be
[Music]
gradient
arel is the most frustrating thing in
the
world
there's no Nan in the
gradient it just like doesn't really
work
okay ready the most dead simple thing
it's called vanilla policy
gradient okay we're going to write the
stupidest thing and we're going to see
if we can solve
it
I will notice there's no way this could
ever solve hard
mode because I don't keep
the stuff together
okay and make one model called
actor actor is a very simple model all
it does is be an
actor we call the
actor
sometime we do a training
step and inside this training
step we run the
model the
model is an
actor we optimize the model using
atom
rename this frustration
Chronicles ew
torch we don't pass in the Old Log
distribution anymore cuz that's stupid
and this model only returns a log
distribution we use the vanilla policy
gradient which doesn't even use
Advantage all it
uses is
reward we only have one loss it's called
the action loss and here we'll compute
the backwards pass on the action loss
and then we'll run the step and then we
have the action loss we realize that and
that's great okay we also have a
function called get action that's
identical except instead of doing that
we just do that okay now um this is all
probably good we can copy this we don't
have value any anymore because
evaluation is
dumb we have
time uh we always need T
range and we'll run it for appox okay as
you can see this has a lot less stupid
uh discount Factor discount factors are
lame we don't even really need reward to
go we could just use Rewards
keep next Replay buffer that's
fine train steps we can only do one
because it's
vpg batch size can do
okay uh yeah that is dumb don't need
that
stupid all we have is the action
loss don't have the entropy loss don't
have the critic
loss okay it doesn't
learn um let's go over here
and I'm sure they have an implementation
of vanilla policy
gradient no do have po
though po solves it perfectly and almost
instantly
no never mind right it does solve it
with the on policy but it takes a lot
more time there but whatever I don't
care about that um wait that's size two
no size eight okay
fine yeah their po solves
it takes a long ass time but solves
it okay
uh wish there was a way to pass
in parameters to
this let's try size
two okay this doesn't seem to work at
all
sometime it gets lucky and gets reward
most times it does
not uh are we calling train step yeah we
call train steps we don't need that we
don't need
that samples action loss
[Music]
great so I'm really using a soft Max the
replay
button
oh I'm not using selected action okay
something's
wrong
yeah so this is actually just wrong you
can't no I can't do that that's fine
but uh need a
mask based on selected action
and then we
can call this mask reward multiply that
by just mask
times reward and we can put reward
there I mean it looks better
no
okay okay vpg looks to reliably solve
this
with
if we get three in a row we consider it
reliably solved okay three in a row
great this reliably solves this with
these oh no but that's size two okay
let's go to size eight let's see if it
solves
it nope size eight doesn't solve
it okay uh we don't even need layers
here I know we don't need
layers so we can just do
that we don't want to need that we can
just do that hidden State can be tiny
because it's literally a pass through
net if this isn't working something's
just broken in the way that we probably
have bugs in our where we're doing soft
Maxes and exps and
shit uh
uh does it solve it with size two okay
it solves it with size
two but when we go to size
three it doesn't solve it anymore good
this is like a pure this is like a pure
implementation of trash filth and
garbage okay that one's all done uh but
three is unreliable okay so we're seeing
the same behavior with wherever the bug
is it has to also be in the uh this
vanol policy gradient okay no more
critics no nothing all we literally have
is a dumbass
actor
um that's how stupid this is and it
doesn't
work this model should be simple enough
we can look at the gradients actually I
think we can even go simpler here let's
literally do this
they should solve
it linear layer should solve it
right
nothing good I think we can actually
look at the gradients of this one I
think we're getting to the point where
it's simple
enough uh I wish there was a way don't
need gy
make okay uh the linear layer is of
course unreliable how the hell is it
unreliable
this should learn the identity
Matrix I think this should learn the
identity Matrix okay uh
print model.
L1
weightp all right 8 by8 identity
Matrix
what oh that's with size equals
[Music]
2 it's not even solving it with =
2 it kind of solves
it uh
do a linear layer we do like
tensor
okay I mean you see why it gets no
reward right like this is just junk
um why is that always
zero okay sometimes it's not
zero it's two oh we can also get rid of
reward to go we don't really need
that
[Music]
why is that sometime five and three in
shit
huh I don't really understand that but
whatever oh that's cuz it's it's doing
uh it was doing a where to go but okay
so those look
right masked
reward the batch size is also crazy we
should be able to do a batch size like
four I I want you to learn the identity
Matrix
please
[Music]
it got reward that one it didn't get
reward like everything should just be
pushing it perfectly towards the
gradient we can get rid we don't need
adom let's use
SGD
I I'm thinking it has to be some of
these log soft Max and
Xs okay Master W looks correct let's
look at log
this.x let's look at
this
and knit with the identity Matrix so we
can try
that uh well we also don't need a
bias
wait a
second why does that not have
[Music]
reward
so identity Matrix actually isn't the
perfect
solution but I also don't understand why
this doesn't have
reward oh I think I might have just
broken the reward
thing yeah I broke the reward thing okay
that's a different
bug let's put reward to go back in it
doesn't even matter it's not like it
hset
okay the identity Matrix is actually not
the perfect
solution because it's not downsampling
the others
enough
um if we really want to form the
identity Matrix that works I it's like
multiply 100 and subtract 50 should be
pretty
extreme okay now it gets the reward
every
time and it has pretty low loss which is
good
great let's go back here pump
that um nothing seems to learn
now
all right let's look at some
gradients
[Music]
[Music]
I hope we like get something satisfying
out of this
okay these gradients
look what's backwards but that's
actually right because we're subtracting
the
gradient wait everything looks like
correct back to doing this just so we
can see
it
I don't know I should be able to make
the learning rate
one okay that
works do it work if I
don't okay we got a
solution we made the learning rate one
me there just shouldn't be any noise in
this
problem okay all right all right all
right now let's try with a slightly
larger
size
four okay it solves it
by the way how satisfying is this we can
like see the gradients and
shit see what it becomes more like an
identity Matrix every
time
okay wait a
second why does this gradient look like
this oh cuz we had multiple we had
multiple steps that's okay and they all
look
correct you could also increase the bat
size it doesn't
matter we don't need stable gradients
there should be there should be zero
instability we can actually make the bat
size one there should be zero
instability in this
problem I guess just sometimes it
doesn't have any
gradient
this is fire
Bros does everyone understand what's
happening so this is the gradient and
this is the single weight
Matrix um we have a reward to go that's
all fine all right let's add some things
back in until we break it well
first let's take the oh well can we go
to Adam
first matter if use Adam or SGD I don't
know how Adam I don't know what the
update will
adomus oh it's like
instant everything good about SGD even
better
without um how about a learning rate of
one2 is that going to
work the learning rate is just too
small
like it doesn't learn just because the
learning rate's too
little even
though this looks better than
that
Suess it has a slightly higher
probability no let's use
this
okay I like the learning rate is just
too
small it's getting a reward of 10 why is
that not get rid of
that see print
okay it learns it's just
slow even with
Adam
I don't
know well I mean this is useless for
fixing anything
else like it doesn't learn okay let's
Jack The Learning right
out
still doesn't learn okay well that's
exciting at
least well I don't know if the jacked up
learning rate works okay if I'm doing uh
all the fancy stuff I do in this one
okay let's go back to vpg because that's
all
it no we have no action loss
okay interesting all right all right
maybe we are getting somewhere with this
so we have a reliable solution from Tiny
grad vpg uh as long as we set the
learning rate to
one1 and then I mean we should be able
to set the batch size crazy high I don't
think it
matters if anything El want after okay
good
oh that's so
beautiful I love watching deep learning
happen beautiful okay uh this one
doesn't
work why doesn't this one work even with
the big is it the value function we can
get rid of that
too call this master Advantage advantage
and reward are kind of the
same
no not L um is it because our actor is
very complicated we're getting rid of
the second layer
again I knew the second layer was a
mistake doesn't work
okay we're
using the same
advantage using the same action
loss um get rid of all these other
losses oh it's going to bitch if I do
that though I don't know I just multiply
by something really
small
no
nothing let's go to a simpler actor
let's use the same action function we
use
here we can actually watch gradients
again should just work
right oh that solves
it that solves
it but if I put two two layers in the
net no luck can't learn the identity
from two
layers
is that
stupid if I switch it to this
one hey
Lawrence but if I do this it doesn't
learn t
h this is something like deep learning
doesn't work
shit single
layer all right put the gradients we put
the
gradients
put size back down to four so it fits on
one
wait why are those gradients so
small
I don't look small
anymore the first
one why do they start so small like that
let put just numeric error if I just
didn't get any reward there does look
right
also what is the
default wait what no I told you not to
put
that set print op so that did nothing
when I wrote that there aren't paying
attention
why is that gradient start
small no maybe okay again maybe it's
just not it gets no
reward it's not sufficiently random in
the
first but then it gets reward and it
starts to fill those in and I'm more
happy but we do
this and it
breaks no
gradient why is there no
gradient um let's multiply
that
why is there no gradient for so many of
these I see it get rewards
sometimes is there like a reu death
problem no there's no gradient here
either we got a gradient for a tiny
bit it goes
away we don't need a hidden State size
to be
big learning rate too high we do have a
high learning
rate
so
tiny the littlest bitty gradient I've
ever
seen
wait
what we just got lucky with that
one tiny gradient tiny
gradient
okay this maybe like a log softmax
problem again this this might be our
problem
debug is not going to
help where's the gradient
going
still very
[Music]
small cuz that's also being multiplied
by 100 too
H why is that the
why is that the output of the
model just just collapsing to garbage
fast maybe the learning rate is too
high okay at least now we have some
gradient okay it solved it kind
of yeah okay all right you can't have
very large
gradients with
uh if you make your learning rate too
high your model will become
crap
we set our learning rate
high the distribution converges to a
single thing very
quickly don't really understand how that
is but
whatever
could it be doing n of the weights yeah
maybe
I mean whatever it is the same problems
in
torch I feel like they have some trick
for this I feel like I saw some garbage
about this in
a2c
for
sort of learn
sometime
that should help with the gradient too
with the entropy
loss t ball should always give it a
gradient I
think
I mean okay it makes sense if we Jack
the entropy loss up that we're going to
get that behavior all the
time lower the ENT we don't see
that we see a distribution that
converted to
something why is that one still
B
it's like this one started to learn that
that's good but it hasn't learned
anything
about what to press in that
case
there TR have jell you yeah we can just
jell you try
jell here it's like kind of solving it
those look pretty good I don't know why
is that one still that
though it's actually it's always that
one
I don't know if we're just getting
unlucky but it sure does seem like the
second action here always has
that no that time it learned and that
time it was that one that didn't
learn look at
that like all the other ones learn but
that one doesn't
learn what sense does that
make it should learn pretty fast because
it should learn to pick that action in
that
state
yeah look how some of them just are not
like they're not
learning TR jelly
you look
better
okay R you
death all right I like the
hypothesis
interesting see seems a lot more
reliable
now there you go look we're at
10 all right dying rues
eh where's your prize I make your
VIP
congratulations
[Music]
turn the biases back
on
cool boner P you'll get another
timeout you didn't suggest reu death you
were just shit talk
talking you're a coherent suggestion for
you and even if you did you know about
the boy who cries wolf it doesn't even
matter if they're actually ever was a
wolf because he cried it too many
times and you know you can't just keep
listening to boys who cry wolf that's
right
okay that's fine and the Jet back on
there okay reward of 10 let's try
Advantage like it works it's just
flakier
we need with
PPL okay Advantage Plus
po worked
Once flicky garbage
I jack the batch SI back
up
10 not
10 go back to our p torch
version it's
fast switch this to
jelio torch have
jelu
alue
what does torch have I you like torch NN
crap torch and and crap l l is a good
loss
function L use a good
activation not as good as
jell jell you was the
winner
uh
can also just try that just cuz I saw it
in it's another stupid hyper parameter
just CU you didn't put the hyper
parameter oh no wonder this doesn't
work I left this in
there
if anything that made things
[Music]
better I saw they had a value scale
of that
so
oh unreliable
garbage check the hidden State size back
up
I don't
[Music]
know well not using the reward function
not using the value function seems to
help
okay now is there a bug in the value
function
10 as soon as we use the value
function I'm too slow
let's look at these
values shouldn't do anything
actually that should change nothing why
does it change
something that time it got lucky and
solved
it
no
solve put the batch size back
down so we can see some normal size
prints why is it learning negative
values of
states
okay this is learning all the values of
states are good I mean that's sensible
okay fine it eventually learns that all
the values of states are good we have
reward of
10 but if I put this in here which is
just the reward minus the value
do I use this Advantage I use okay I use
it down
there I wonder if there's some
bug is it actually the same if I
do mean square error really doesn't
matter which way I put it
right
looks to be the same level of
crappy it's true that in this problem
the value function just adds noise
I
batch
rtgs minus v.
detach okay I don't know we can we can
add this let's add
this
we doing my critic loss
right we'll just leave that down
there and let's add in this this
normalizer since they seem to have
it
I wonder what that
does no
so don't need to detach there
anymore shouldn't matter
but
okay still socks and his
flaky
this mask can go up here this has
nothing to do
with we're g to call we're going to call
it action
mask
uh log distance not associated with the
value oh I don't care about that well
that's kind of ridiculous
um what do I actually want
there
oh probably is the best place to get
that
I mean it's the number of actions
but let's just take a quick look at the
action mask and make sure it looks
reasonable what does that probably
should be
Boolean think that breaks anything
but
whatever doesn't
hurt
solved
hello
hello hi we're
streaming hi
T it's Alex she says
hi
Alex do I want to go walk and get lunch
yeah you want to you want to get a you
want to go to the sub
place yes bro what's it called Caesar
shit wait yeah yeah don't tell them man
some weird might show up and we're going
to knife him man is that going to get me
banned from
twitch I've been trying to get banned
from twitch it turns out they're ripping
me off they're only giving I don't know
why I can't hear you oh it's cu the
internet
sucks I would love a sandwich uh well
how about we go in about 30
minutes okay perfect that sounds nice I
see you
soon oh I'm going to knife him man is
that a threat of violence is that good
is that going to get me banned from
twitch
[Music]
uh knife the sandwich no I'm referring
to the person who I am going to stab
with a
knife no clips you guys know there's no
clips see taken out of context it looks
like I'm threatening somebody with a
knife and I am but without seeing the
other context you don't
understand all right so we have 30
minutes maybe we'll stream after lunch
too do we have a lot of people watching
this shit no 112 all right you all like
watching me fail at reinforcement
learning this is apparently a popular
topic RL sucks and's dumb I might be
banned from twitch when I get back
though and if I am you can find me on
rumble or whatever that other one was
the gambling
one where they where they pay a fair do
you think I trust that
company
um they tossed who live oh she got a
three on
vacation uh no no no I don't know if we
kick for that that's kind of interesting
what are we
kicking um oh kick oh kick the the fake
twitch wow it's been so long it's been
so long we've been failing at
reinforcement learning for hours this is
terrible okay so like all we kind of do
there is
we normalize
[Music]
stuff why is the entropy loss so
big let's put the J back
on
why does this not
work no I want to clip the rewards like
that okay I mean to be fair this value
function is all just noise in this
problem because all states have the same
value can we solve cart pole let's see
if we can solve
carple okay we soled carple sort of went
a little unstable afterward but
see you can see the reward here does
everyone like see this this is like way
too small for
everybody lunar
lander we shouldn't call them EPO we
should say episodes
okay we're getting we're sometime
getting good rewards it looks
like do you want to get the plotting
code from yesterday so we can plot some
stuff like had a knife
somebody
the plotting code was cool uh let's go
find
it o that was the best one yet any
conclusions on decision Transformer we
just remembered that reinforcement
learning doesn't work at
all
[Music]
what
okay I should really this is the kind of
stuff that I should really be using uh
some GPT shit
for
wow I didn't know the critic loss just
went to the
moon let's stop plotting that
one also can I do pause zero I don't
actually need to pause do
I
slow enough why would I make it slower
pause zero is not what you
want oneus 6 that's not real
time all right the entropy loss goes
up the action loss stays the same but
that's just cuz we're like normalizing
shit and it doesn't have anything to do
with anything
uh the
rewards seem to stay the same because
nothing actually
works it is wild how high that critic
loss
is
we should try a more aggressive
discount wait we're getting positive
rewards sometimes this might be
working was positive
rewards that's
stable it's a pretty aggressive learning
right
still can we solve this before
lunch may we should have a learning rate
schedule sounds
boring
oh oh look at that graph go
up surprising thing is that it works at
all yeah I
agree
it did one Perfect
Landing and it'll never do it
again yeah for all the people who say AI
is here I've never tried RL it's so
true whoa
brosies yo I think if we just let it go
let's just
go is that the best one you've seen
yet I don't know let's let's randomly
change a bunch of hyper parameters and
not do a controlled experiment at
all
yo look at that reward go up
boys ready to normalize the
advantages that's
right there's some like woke thing about
that I think you you got to normalize
everyone's
advantages we need diversity and and we
need to normalize advantages that's woke
people are on to something guys you know
let's not discount
them all right so this is
learning maybe we should try their magic
learning rate from the other paper from
the other implementation
to I wish this was
faster look look at the the thing going
up yeah yeah up the direction we want to
go let's
go there's nothing I love watching
numbers you know I love watching numbers
we didn't get decision Transformers to
work and that's kind of sad' be like
nice if we did you
know up is not discriminatory up is the
direction we are going up is the
direction yeah that's right you remember
that remember that eade commercial back
in the day with the monkeys and they
turn the
chart I think we're going to land on the
moon I think it's going to
work no no that's down it's not the
direction we want to
go go up number go up let's go
right it's getting
slower probably because the episodes are
taking longer I should plot that
too plot episode
length because we got to go get
sandwiches soon Alex is upset when I
make her
wait
we only get it's one it's one shot it's
one shot when it's that's it's on the
final
we don't talk about Dogecoin no it's
slower I don't think it's the graph I
mean it could be the
graph uh but my theory is that the
episode so longer but actually no it's
probably the
graph
it's probably the
graph the critic losses
low okay one shot come on land on the
Moon
where is
it oh there we
are okay
well kind of sucked
um
Loy boy all right let's let's mess with
hyperparameters randomly and try
again no that's the problem it's
floating that's why it's taking so long
now where's my
graph so just not
happen for I and do I have I reuse ey
somewhere don't I don't reuse
ey train
steps and you'll be a lot faster now I
think that a lot of the slowness was
just my stupid
graphs uh
oh
see look we're getting some long
episodes now
rewards going down what hyper parameters
did I randomly change last time I don't
remember
socks
oh it's way faster now at least wow how
slow was drawing that
graph it really was just drawing the
graph every time that was
low okay sometimes we're getting these
very long episodes I
say but I guess okay sometimes it's long
episodes that make it
slow yeah we we we've landed in we've
landed in take forever
land see look it's now it's now maxed
out the the time and it just floats
around we can watch it float around
sometime it just must get massive
rewards from
floating
land land land land land
land
land we actually saw the same behavior
with the uh the other
example
okay uh I mean no no no we're not going
to start we're not going to start reward
hacking uh what might help with that
I can change the discount
Factor let's do controlled
experiments uh there was something else
I wanted to change more that was more
meta uh but I don't remember what it
was okay we now have we now have a
discount factor of uh
sometime it's slow because it takes the
whole episode well I guess the other
problem is there is a sampling bias
towards times when it takes forever and
more of those are going to start showing
up in the data set oh maybe we just
increase the size of the replay buffer I
think that's definitely going to help
okay do we like the new discount factor
I think we
don't that's sometime that's going off
the
rails put that back and let's increase
the replay B for to
20,000 yeah I mean there's definitely a
bias towards sampling the episodes where
it hovered because those are much longer
episodes remember also the policy that
we wrote out at the end is the argmax
policy uh we don't sample at the
end yeah back to
hovering all right let's try a lower
discount factor and a larger replay
[Music]
buffer oh I also want to change a figure
size that's what I wanted to
change
yeah I don't know how to do
[Music]
that someone wants to post about how to
do that I will change the figure size to
make the figure bigger for all of
you
oh figure it takes a
parameter
crater
no okay not a good discount factor I
don't know we'll try that I don't like
the replay buffer just make it
that a little more
normalization
oh wow wow that's a big big size now oh
that's going to take forever to
draw I don't want to L at all now maybe
maybe
okay now we're doing slow
episodes reducing samples from it we
could do
that I don't know I don't want to start
how many hyper parameters are we going
to introduce to make this thing work
great worse than ever the best discount
Factor we saw was this maybe we need a
smaller replay
buffer
[Music]
um Le it didn't flow yeah I
mean
sure
I think that's going to help but who
knows oh I don't like how large that
is but I think the conclusion we made is
there were bugs but like there weren't
any major
bugs well that PO one was actually super
major and it didn't seem to affect
anything when I fixed it so I don't know
about
that
also change my critic loss
to it's getting some real positive
rewards
now
oh oh oh oh come on that was so
close what did I change I don't even
remember did I change my fig
size
even that's yeah it's 1010 so that's
good the smaller replay buffer makes it
more on policy which seems to work
pretty
well
we can try the Kathy bless learning
rate we can also try just letting it
train longer and maybe it'll figure it
out these episodes get long and that's
why it could
slow we have to go get a sandwich
man land on the moon bro you got this
moon for you you got
[Music]
this
all
right more train
steps lower learning rate few more
episodes
the entropy loss I think like the more
that goes up the better we're doing as
long as that's low the thing's just
pretty much acting
randomly that's a way to know I guess
when you've converted
Ed so the orange here is episode length
the uh blue is the return the this is
the critic
loss uh this is the action
loss which yeah I think there's a reason
it's always
zero because the advantage should try to
get as close to zero as
possible
makes
sense if I disable
Advantage okay the critic loss is
getting low so we're starting to
actually learn a model of this
thing learn which states are good which
states are
bad
oh feels like we have to train it longer
still
maybe there's not enough of a penalty
for
hovering this is getting stupid though
again my point is that this doesn't work
I'm sure I can find some set of
hyperparameters if I sit here for
another few hours that will
work but something just seems so broken
about this whole thing and that's why RL
is dumb and doesn't
work you feel like track Mania would be
easier than lunar lander it like might
be I mean there's also some really
counterintuitive thing in deep learning
where bigger things learn better um
that's not that counterintuitive like
one of the explanations you get for it
is that if you have a truly
multi-dimensional space uh local Minima
become less of a problem because given a
random point the odds that you're in a
local Minima are you know one over two
to the number of Dimensions you have
assuming each Minima can equally go up
or down um so you're like oh but you're
using an Optimizer you're more likely to
find them yeah but if the number of
Dimensions is a million you think your
Optimizer is going to find a one two to
you know one over two to the million
thing probably
not um like optimizers aren't that
good uh so this is using actor
critic is this is another one of these
like it's unstable in the same way Gans
are unstable you have you have two
competing models I don't know if they're
as competing as Gans because they don't
think you back prop through the critic
we are detaching the value
function uh the other thing is that we
just may not be training this stuff for
nearly long enough tiny grad's way
slower than torch on this um again tiny
grid slower enough because tiny grid is
usually fter like on a big net tiny gr
is is faster than torch on Mac but on
small Nets torch is just going right to
C and that's just very fast tiny gr is
slower for small
Nets
um yeah we want to see that entropy loss
going uh going up uh the entropy loss is
just a loss function on the diversity of
actions uh it it forces it to learn more
robust
policies um I don't know like sometime
it gets good episodes now and sometime
it
doesn't uh T guards faster on large Nets
no just the kernels are better on M1
anyway
um the small Nets is just is just so
much overhead in in launching kernels
and
stuff I think and torch is just using
CPU which is even faster because there's
no
overhead just function
call yeah um I don't know and the other
thing is we just may not be training yet
for nearly long enough these things just
train
forever we definitely have it learning
something the numbers are going down the
the Returns on the episode are going
that way and that is the really
fundamental
one
um we have some good Landings in there I
think what we'll do next is we'll just
uh every hundred we'll have it render to
the
human and we will watch one good landing
and then that'll be the end of the
stream and someone someday is going to
make reinforcement learning good but I
don't think it's
today
NOP
okay every
50 I shouldn't have done 50 because
that's the same one as the
graph I don't want that
okay so here's where we are right now
crash there's some good ones in there
I'm pretty
sure I don't know I like I I wish I was
just missing something fundamental but I
don't think I
am I think it's just just just bullshit
I I we fix that bug in po I'll commit
that bug
fix uh for anything for all I know the
bug fixes end up making things
worse the house is a
mess
still streaming we're watching the lunar
lander try to
land oh oh Bros yeah know we're going to
go get sandwich after after it
lands after a successful
Landing no that was not in between the
flags are you happy that it's sunny
outside we missed the
walk
hunger strike until RL works if only
nature works that
way okay has it learned now if it hangs
out it gets more more
reward it's a pretty good
[Music]
Landing I mean it's clearly learning
something I don't
know there has to be one good one in the
next
oh this could be it come on no no move
over move over move
over oh oh all right remember yesterday
when I said AGI was
close send this send this video to a
Doomer okay send send this send this
video to a Doomer and ask them if they
can get the lunar lander to
land no no no no we're not going to be
able to eat till it lands in the middle
of the flags if it doesn't land in the
middle of the flags this episode we're
just going to have to try it
again because that's the real Spirit of
RL just trying random seeds until you
get one that happens to be
good is this easy with classic
trajectory optimization yes but you
again you missed the whole point it's
also easy with a
joystick you don't get to experience the
joy
of reinforcement learning if you just do
that like I see some rewards and they
look very
good oh come on this is it oh yeah right
in the
flags oh
Bros
bros
Bros all right that's it
that's it I it just it landed they good
enough if if we if we sit around here
and we wait for something better we're
GNA we're going to have a going to have
a sad
time wait this one might be better no
this one's not going to be better
move
over oh
[Laughter]
Bros um what's also interesting is the
that the AR Max policy doesn't
work this is this is now switched to the
AR Max po
which just seems to do
this
enjoy it Bros let me see if Alex is
actually ready to go you ready to go a
sandwich are you actually ready to go a
sandwich
all right so I think the lesson that we
learned here and we're going to we're
going to let we're going to let
subscribers non subscribers talk I think
the lesson that we learned here here is
that
uh when you're doing RL you have to
lower your
expectations if if you think that you're
going to make it work with the fancy
decision Transformers algorithm your
expectations are too high uh if you
think that you are going to make it work
reliably your expectations are too high
if you think that sometime it might get
slightly better at a task after you pour
an absurd ount of compute into it that
is the right expectation for
RL
um we're not going to start like like
yes with adding things to the loss
improve things yes but that defeats the
whole purpose right why not just feature
engineer at that point um reward shaping
is just feature
engineering
uh yeah you just you just need to you
know lower your
expectations
um and that's what I need to do for
twitch because I don't think they're
going to contact me I don't think
they're going to going to apologize to
me for wrongfully Banning My Stream uh I
I think that that that I deserved what I
get and you know you just that's just
life this is not this is just dumb you
know just like garl how about searching
hyper prims great now we're searching
hyper oh yeah I'm sure I'm sure we could
put a big grid search sh those hyper
prams um and find ones that kind of work
what was the learning rate in the in the
example 4 e minus 7 or 7 e minus 4 yeah
how did the hyper pram search go for
that
right oh is this the best landing yet
yeah oh oh oh so good so good except
move over it's pretty
good no no no no Kathy is 3 e minus 4
the the one in the
uh in the other one was 70 minus 4 okay
so it learns it learns somewhat reliably
is it great at the task not really do
you not understand why it's not great at
the task you have no idea we looked the
gradients it was 74 yeah I remember
um
I remember trying stable baselines once
and like it just couldn't solve lunar
lander with the stock things and I
complained about
it this is why we don't let
nonsubscribers
talk
uh but this was actually a game you
could play I didn't
know
you got to do RL to find the best way to
do RL no someday decision Transformers I
actually have a lot of Hope
for um and oh by the way do you know who
made upside down RL I was I was reading
the papers last
night upside down RL was invented by
one Jurgen Schmid
Hooper
uh he still got it Schmid hoer still got
[Music]
it I'm send this video to a Doomer
remind them that AI Doom but no it is
true that once we get good reliable
solutions to lunar lander we are just
one step away from good reliable
solutions to everything and that seems
to be how these methods work because
they scale really
well yeah he really liked turning the
letters of RL upside down and he wrote
this a ton of times in the
abstract
um
what we go you go you're going to go
without
me we're not saving checkpoints between
runs okay the last run of the lunar
lander do you want do you want to watch
it try to land
talking do you want to see what we did
sure look look look we we made
that Oh I thought you were talking about
a real lunar Lantern no no no look look
look look look going to kind of work
it's going to kind of kind of okay lower
your expectations it's not really going
to
work oh and that's the end of the
episode it just stops right there all
right guys thank you for watching
today's stream uh these two streams
should be put in one stream and the
whole label should just be RL is dumb
and stupid and doesn't work great thank
you
byebye don't kill anybody I was kidding
we're not really going to knife anybody
that was just to try to bait the twitch
people into Banning
me
what what I'm G to go I'll in are you
that itching for sandwich I want
coffee you can have that coffee you want
that coffee I want to go to California
are you're going to go to California
Bean you going to make conversation with
people
huh say
goodbye you can say you can say she's
just itching to go I I I don't know I
don't know what to say goodbye
everybody
chat a minute uh
come in here look i got the chat in its
own window now
i'll probably make it like the same size
as me yeah that's good
well that'll make me move me i want to
make me that big
so i cover the chat and then there we go
we have slightly less screen area to
work with
but it should be nice uh for you guys
um so if you recall where we were
in haskell 48 hours
so we're going to need to write the
section on mutable state and that's what
we're going to do today
ah a few other things that i want to
discuss with you guys
here on the george hat's twitch stream
i'm out of t so there's no tea so it's
only water tonight
i'll wait for some people to come in
to the chat and have a date uh
at eight o'clock
uh so we're just gonna have to you know
text at like 7 15 and be like we still
good for eight
uh where are you hello
so i assume data io ref is it oh mutable
reference is in the
i o monad
i don't know how i feel about that
why does it have to be in the i o bonnet
hello
good day oh we have subscriber
subscriber-only chat on
uh we can turn that off for now i think
yeah also
okay so we have a few things to discuss
before the stream starts
um i applied to be a twitch partner so
uh we'll see if they accept me or not
um if they accept me then
i'll be a twitch partner and just like
the way i want to show you guys my
instagram you know after i got 10 000
followers i promised on my linkedin
that i would make higher quality content
for you guys and you can see really like
around here
you know like moving up moving up from
like even these three
look at these last six pictures they're
very high quality
uh cold cold water welcome first time
joining the stream
uh i also want to give a shout out
uh to pokemane uh pokemane
is great uh i watched a bunch of videos
on that drama i couldn't sleep like two
nights ago
and i watched three hours of videos on
the pokemane
pokemon pokemane drama and then i
actually watched your stream and i'm
like damn you know her twitch stream's
better than mine
um and that's why are you like the desk
picture
and that's why i you know i always
aspire to be more because
uh you should always aspire to to to be
more
um what is my instagram it's
instagram.com george hotz please follow
me
um it's my dream in life to have a blue
check mark and to be a twitch partner
because these are things that people
work their whole life towards and i'd
like to just do them easily
pokemane yo um
uh no i didn't prepare a test for you
guys i'm sorry there's no test
uh maybe for the next one we'll see if
tomorrow i'm not lazy
i did prepare a section of this book
that i wanted to read to you guys
um i finished my book i finished my uh
my my white noise book i got a new book
and i'll show you what the new book is
um but yeah let me just
so you guys can see me yeah my book
white noise i finished it it's over
um
ah
do you believe life without death is
somehow incomplete
how could it be incomplete death is what
makes it incomplete
doesn't our knowledge of death make life
more precious
what good is a preciousness based on
fear and anxiety it's an
anxious quivering thing true the most
deeply precious things
are those that we feel secure about a
wife a child
does the specter of death make a child
more precious
no no there's no reason to believe life
is more precious because it is fleeting
here's a statement a person has to be
told he's going to die before he can
begin to live life to the fullest
true or false once your death is
established it becomes impossible to
live a satisfying life
would you prefer to know the only the
date the exact date and time of your
death
absolutely not it's bad enough to fear
the unknown
faced with the unknown we can pretend it
isn't there exact dates would drive many
to suicide
if only to beat the system we crossed an
old highway bridge screened in littered
with sad and faded objects
we followed a footpath along a creek
approached the edge of the high school
playing field
women brought small children here to
play in the long jump pits
how do i get around it i said you could
put your faith in technology
it got you here it can get you out this
is the whole point of technology
it creates an appetite for immortality
on the one hand
it threatens universal extinction on the
other technology
is lust removed from nature
that's this mornings i don't want to
know
the date of my death
um
well no what if you're told you have a
different date
uh yeah base transfumas right now my my
the new novel i'm reading
uh is this
uh yeah that's this is the next thing
i'm reading
um the corrections
uh i don't know that much about it but
i know that this guy you know uh
in 2001 he it was chosen as like an
oprah book club book
and the author was like uh i don't
really want that you know because people
are going to see that on the cover of my
book and then they're going to think my
book is like for women you know because
all those oprah books are for women
and there was uproar and controversy so
i'm like you know it's actually probably
a pretty good book
um docker disrespect is back on youtube
live uh no you know i think i think it
was a really bad business move on
twitch's part
um the way they handled that whole
situation i don't think it's very smart
to um you can rule
with a uh you can rule using fear
right so so what that does is creates
fear in the mind of other streamers like
am i doing something that might violate
the code of conduct
by not saying what dr disrespect did or
why he was banned
but the only rulers that usually rule
with fear are rulers who are insecure in
their power
i can't imagine that twitch is possibly
insecure in their power over the bits
that are coming through
their own uh thing so i don't know i
mean i think
it's gotten a lot of streamers to think
about a backup plan to think about
you know first twitch came for whoever
and then i didn't do nothing and then
twitch came for doctor disrespect and i
didn't do nothing
um so yeah i mean i think that was a
really bad business move for twitch
but hey you know i'm not twitch i'm just
here to enjoy the decline boys
enjoy the decline
enjoy the decline that's a coded incel
thing you can't say that man
can't say that on twitch this is a
family-friendly streaming channel
all right let's get to programming
um oh so i'll show you guys the other
thing i've been playing this is more
programming related
uh this thing called refinement types
i think i finally understand intuitively
what why you can't build the thing that
i want to build in python
why backspace can't really work in
python
so the thing that i really want to build
is an equality operator for functions
now of course you know this can't work
all the time because of the halting
problem
but it can work often enough only famous
people can find problems that are hard
to decide
oh speaking of speaking of famous people
and famous problems there was oh there
was a proof that np equals rp recently
but
it was it was pulled um
so uh oh i also i wrote a blog post
today
but i'm not happy enough with it so i
don't think i'm actually gonna publish
it anywhere
but um
i'll i'll go through with you guys
because it's kind of fun
uh if i was gonna
write a blog i'd call it like the
singularity is nearer
uh you know so i can find a ray occur as
well i wrote this i wrote this thing out
on money creation
um uh consider a mining town once upon a
time it was a mine and the mine was the
largest employer in the town they mined
copper ore and sold it on the global
market this brought money into the town
which sprouted a restaurant a real
estate broker a doctor's office at a
church
although these people weren't employed
by the mine meaning the employees of
these things
they got customers from the miners who
fundamentally got money from outside the
town
but eventually the mine dried up the
miners lost their jobs since the town
was no longer bringing in enough money
to pay them
the doctor the realtor the waiter was
still employed as their minds didn't dry
up
but their minds did as they were really
just mining the miners the town
persisted for a bit passing the same
money around in a circle but with each
pass there was a transaction fee
there's always a transaction fee and
there were still things like food which
needed to be imported into the town
the town went broke died it became a
ghost town um
so i do this little analysis of like you
can break all jobs down into three
groups
um you have jobs that don't create any
wealth uh
shoe shiners bank tellers politicians
retail workers clergy social media
managers lawyers
the service industry this even includes
things like truck drivers who really
just move things from point a to point b
um an economy made up of only these
people wouldn't work
uh because i mean you can't just you
know someone has to create the value
right where does money come from
and i don't mean the literal answer
involving the fed or involving the mint
function the erc20 contract
i mean where does like wealth or value
come from
um the second group produces money
linearly so bring jobs down into three
groups
uh farmers miners manufacturers how many
uh widgets did you make how many bushels
of apples did you grow how many tons of
copper ore did you extract
uh your power plant operator how many
kilowatt hours of power did you generate
uh so this is the linear group and this
is the group that could sustain an
economy by itself
uh this is kind of the bedrock of any
economy
um the third group uh seeks efficiency
improvements for the second this is
scientists and engineers
um scientists who genetically engineer
crops to get more yield per acre
engineers who build tractors instead of
oxtron plas
this group can't sustain an economy
alone but mixing a few of them in with
the second group
yields much higher uh per capita money
creation more money created per
individual in the society now
you need kind of a mix of two and three
and you probably need a lot more twos
and threes
um but yeah so this is uh the share of
the labor force working in agriculture
uh it's plummeted and what i kind of
wanted to look at so agriculture is
clearly in the second group
um the third group has this exponential
effect way back in the day if you go
back to 1300 they barely existed
but they're exponential uh science build
on science builds on science build on
science
uh so they eventually come to be the
driving force of society because
the number of farmers and stuff is could
only increase with the population size
they don't build on all the farmers
historically
um today although we aren't quite there
yet it's easy to imagine a few farmers
farming all the land
extending their reach with automation
and sensors or even no farmers just
machines and more machines to fix the
machines but the machines would still be
in group two
group two's the basis of any economy so
i kind of wrote this blog post just
while i was uh playing around i went on
the um
on bls.gov and i looked at the top 30
jobs and i made a little spreadsheet
uh and i classified them i'm like okay
which of the jobs are group one which
are group two and which are group three
uh so group one turned out to be most of
the jobs
um which i guess i mean isn't surprising
given what i know about the modern
economy
but i think it would be surprising to
somebody in the past uh so i broke it
down into three subgroups
um the top four jobs are movers of stuff
waiters are movers of stuff retail
are movers of stuff drivers movers of
stuff clerks like information clerks i'm
shocked four million people are
information clicks
like they do like well they have a
filing cabinet
um you need the first group for societal
uh harmony i'm not sure about any of
that
uh what is this nature article
uh is this nature or is this
like why does it have a trash news
looks like trash news um i found
teachers somewhat hard to classify as
well
uh if you assume education works their
group two producing more productive
people like a tractor maker uh education
is really just daycare then they're
group one
uh we gave them the benefit of doubt and
included them in group two um we
included computer occupations in group
three but i'm sure a lot of these fall
under oh i didn't break down the three
groups of group one so
movers of stuff um fighters of entropy
maids janitors doctors nurses you're
fighting against entropy natural order
of nature is
disorder uh and then bosses uh and i'm
amazed at how many of these people exist
management's executives specialists
money managers finance
sales i mean what is sales but trying to
be someone's boss or you don't know
uh admins um yeah so so
probably yeah probably only a few most
most education is daycare but
we put it in group two because otherwise
it would look so incredibly skewed
uh so here i did um all the minor jobs
on bls
and i assigned them to each category and
this was the breakdown that i got
um so and money managers move money yeah
sure
uh the bosses are well i put bankers in
group one because they move money
i mean like the kind of like oh i
consult on the economy um
so is 73 of us
jobs are in group one
uh this is uh
i mean this isn't good i
don't i don't really know how to like
like drive this point home this is not
that complete of a blog post
my writing isn't that good i haven't
haven't written in a while um
i i mean
[Music]
it's interesting also that like uh the
other thing that i was thinking about
exploring here
is that i think that the group one jobs
in some ways are the only
ones that can be like the
class of job can be automated we could
automate
every truck driver right and there could
be no more truck drivers
you can't really automate every farmer
because farming is tool complete
right what farmers do changes but
they're still effectively farmers
what truck drivers do or what teachers
do
we could we could in theory automate
this stuff entirely
um and the jobs in three are i mean
that's kind of what backspace is
uh yeah
like like well then and then i think you
know the movers and stuff like i can
respect the movers of stuff and i can
respect the fighters of entropy
uh here's a whole class of people that i
just cannot respect and this includes
like politicians
uh like like the all the bosses
management executives specialists
finance like it's all bullshit
um i originally called these the 1ds
jobs but you know
uh
backspace got taken down got taken down
by who it was canceled
for threatening programmer jobs um
[Music]
you can assume services are inherently
different from material goods yes i can
because of this problem
right like you can say okay we're going
to export the services but who are you
exporting the services to
we don't need any of these services
fundamentally like food and food
production is
is
this gets into the philosophy of
economics uh
more than anything else but um
yeah so that's my that's that's my blog
post
uh yeah yeah yeah maybe maybe i'll make
a sub stack
should i make a should i make a sub
stack and charge and
give it a subscribers um
meaning is not my problem they can go
read
who did they who wrote being in time
whoever wrote being in time i hear that
book gives you lots of meaning
anybody who can finish it has meaning in
their life heidiger yeah this guy
anybody who can read that book um
has has has meaning in their life but i
don't know i don't like the blog post
enough to publish it yet
maybe i'll work on it more but i
probably won't because i'm a lazy piece
of shit
so uh yeah there's that uh but oh yeah i
kind of want to see this this same
analysis done for china
uh is this is this breakdown uh for
china it's similar to humans need not
apply you guys know i really like that
video
um but yeah uh
so that's that's what else i did today
and it's unclear that the the movers
definitely had some kind of value
um and i think there's the
i mean you can even break movers down
further
into movers that are exploiting movers
that are up against the pareto
optimality of arbitrage and movers that
aren't
like a truck driver or a like a like a
like a freight
ship or operator um are probably
exploiting economic arbitrage
opportunities
where nobody could argue the same thing
for a waiter and a clerk
nobody could argue that the the the cost
of the hamburger the hamburger costs
much less when it's sitting on top of
the little thing
and then when the person brings it out
somehow it increases that much in value
right it's not an arbitrage opportunity
versus you know for a for a truck moving
food into a city it may be
um
the mining is kind of like a move or two
does group three try to make group one
more efficient
i mean the problem is i i don't really
know how you
measure the productivity of group one
um
i don't know again it's all it's all
very tentative
um but you can very clearly see how to
measure the productivity of of the
second group right
how many ores how many tons of ore per
person can a miner extract and that's
skyrocketed during the industrial
revolution um how many acres can a
single farmer cultivate
uh how many how many uh tons of corn can
we get from a single acre
um so yeah i mean maintenance
i i grouped all of construction in group
two which probably includes some
maintenance as well but
maintenance somewhat falls under this
fighters of entropy
um what do i think the optimal ratio is
i i don't know um i mean optimal to what
it it probably already kind of is
optimal
uh but i mean it is optimal under under
some
i don't know unless unless there's some
big distortion going on in the economy
uh but group one jobs have been growing
at the expense of group two
uh group one jobs do not contribute to
money creation as a whole
and it's concerning to consider what
will happen if this trend continues we
cannot have a worldwide economy of group
one jobs
as just like the town the whole world
would end up going broke
all right now you can't get a link
because it's not published we are going
to program on the stream
uh i'll show you the other thing that i
was playing with too
uh this is more programming related
so there's this thing called liquid
haskell and
uh it has refinement types
yeah like like look at this here i can
let me do some refinement types
so i can say something like zero colon
colon
into zero equals zero right
um and then
i do liquid refine
okay and that's type checks uh now let's
define what zero
is so i can say zero
that's in it's in my in my refinement
types book i'm gonna try to play with
refinement types a little in the uh
thing we were writing
ah here we go so i can say
i can make 0 like a type i can say type
equals v int v
equals equals 0.
so i'm defining what the
and then i can say here that like you
know so i define zero as a type and i
can say
zero is of type zero
so now when i type check this it's fine
but if i try to set zero equal to 1
well it's going to complain because 1 is
not a subtype of 0.
ah so you can do this with functions too
um so like here's kind of a fun one
uh just because we did merge sort on the
last stream here here's the merge
function
so we have like merge
y s equals y ass and give merge a
traditional type signature which is like
uh a a a right it's just an array
of type a and that's polymorphic uh
we can do
that and then if we get
two arrays neither of them are zero we
can take an element off of both of them
if x is less than or equal to y we can
say it's x
colon merge x has y colon y
s otherwise
so yeah that's all beautiful but what
happens if i try to type check that
um it's complaining about that because i
didn't give it an ord type
so i have to talk about how a is ordered
this is still within the realm of
traditional haskell okay
now it's complaining about some kind of
type mismatch
so let's try to give it a liquid type
signature and see what happens
um oh well first off i'm still
complaining about zero not being zero
liquid type mismatch
[Music]
it's not a subtype of a required type
i'm not sure why
well i might have to tell it that i have
to order this
yeah there we go uh so i don't know why
it was was
talking about that as oh yeah i was
talking about that as a mismatch
because i was telling it implicitly that
it was decreasing on on length of s
so yeah now if i tell it length of xs
it's now complaining about the
termination check
um because xs isn't getting any smaller
here
because i've put uh here so liquid
haskell is actually
checking that this function terminates
and it's like talk like that so if i do
that
it works
yeah uh and you can like you can define
like all sorts of types like this too
you can define like like an ordered list
type
here this is insert this is the type
signature of insert uh just like an
insert into a list function
that proves um
let's copy that one over
that proves that insert is actually
doing oh we didn't do this but
um it proves that insert is actually
doing uh what insert uh
claims to do it this is an insertion
sort
um that's not even what i was thinking i
thought it was just like insert like a
normal insert
oh i don't know what list on one is
um ah a list whose contents are exactly
x
and the contents of y
list s is a list with elements s
like you can in the type signature you
can talk about
what the um output of the function is
for example say you have an append
function to an array
you can assert we can actually try to do
that if you guys are interested in this
don't let me know
we'll talk about what it is and then let
me know if you're interested um we can
show
we can write a append function to a list
and then we can prove the property
that the input list is equal to the
length of the output list
minus one so you can check that your
your insert actually works right um i
think they have also something in here
called like
board list
which is a type
see that's in this it's in this other
refinement types book
um word list
no maybe not but i was playing with the
stuff and it was kind of cool
uh oh yes yeah structural introduction
computer programs
uh if he even prepared a test
no you don't get a test um but now
you're going to get some questions about
refinement types and dependent types too
so some of those are going to be on the
test as well
here's zero as a refinement type
his natural numbers as a refinement type
kind of it's here
so this is this is this is a good a good
simple example
uh so this is going to pass uh
should pass
specified type doesn't refine haskell
type
for main pause
here we have to say that pause has type
int
yeah okay cool uh but this is actually
the wrong type this doesn't include
normally when you have the positive
integers it's only uh
zero has to be strictly less than so now
it's going to fail
uh now it's failing this
check so if we remove zero the check
goes back to passing
oh i saw no you just timed out
uh dbomc you're timed out again
congratulations um
refinement
uh please please stay on topic i'm just
gonna quickly time out everybody who
says anything off topic like gpg3
that's totally off topic to what we're
discussing it turned out
um
what are your thoughts on cross-platform
frameworks it's not q a time timeout
uh no it's not live um
it's haskell and then this is this
framework on top of it called
uh you are so fucking power hungry
suck my fat cock george oh yeah wow
that's a ban
um
it's just timeouts for those people yeah
stay for please stay focused
um
yeah so these are refinement types and
we can try to play with refinement types
it's kind of a i don't exactly
understand the difference
there was a stack overflow explaining
the difference between refinement types
versus dependent types
um
the main difference is along two
dimensions
refinement types are restricted to
decidable fragments so that verification
and inference is completely automatic
refinement types never need you to
provide a manual proof
um yeah but i'm not sure that's
a function of the type system itself
so this this liquid haskell requires me
to install
uh z3
um so i mean it's using it's using a sat
solver underneath the hood
in theory can't you do that with
dependent types too
one cannot use arbitrary functions as
specifications
yeah so this
this seemed like a thing as well um
like i guess my specifications have to
be easily translatable to the smt
language
uh ad block term
gpg3 and blog term
twitch chat
i should learn i should learn how to do
this stuff
appoint moderators consider moderation
type
ban users unique
chat ooh slow-mo look at all this great
stuff
and blocked thank you
no that didn't work either
why should be a mod in my own thing
yeah does this include all the chat
commands it's like neatly laid out
um turn
uh are we at least allowed to talk to
others in chat you want to socialize no
time out
um
oh followers three months oh that sounds
nice that sounds like a good compromise
cool
that's a good compromise
you have to be around for a while and
then you know you probably care more
about getting banned for life
uh yeah we gotta get better about
moderation we're gonna have a nice
you're if you're a subscriber it's fine
too
um this is thinking about backspace
stuff yeah
blacklist bandwords twitch
oh i have to like go in that's too much
effort
only if i could do it with uh
yeah that's too much effort
take some time off stream and get
nightbot
oh i looked at this once and i thought
their website was
lame
yeah you get social credit score in chat
okay so this was my
lisp stuff from last time we're gonna
add in
uh
defining a type for our environments
this declares m as an i o
ref holding a list of strings that map
to mutable
list vowels that sound okay that seems
reasonable
um since irfs can only be used within
the i o monad
oh i learned about monads oh that's the
other thing that i did
um category theory for programmers
yeah i went through i went through the
first chapter of this book
um and then i also read the chapters
about monets
uh this book's really good
um like i still think mostly category
theory
is um you know like meaningless
but to be fair i still don't know what
the united limit is and there's this
like one limit in category theory and
they're like after you've studied
category theory and meditated on it for
many years
you can finally understand the oneida
lemma
um don't don't what's a monad it's just
like a monoid product of
it's ammonia it's a free monoid on the
singleton set of endo functions or
something
um oh there's video lectures too oh
that's
cool um but yeah
uh i've been really i've been really
enjoying this this uh this book
oh cool
oh good for the ones that i don't get
yeah monoid in the category of endo
funders
uh
yeah so so i did that too but so now i
kind of know what monads are
but only kind of
since irs can only be used within the
iomo ad we want a helper action to
create an
empty environment can't just use the
empty list because all access i o rev
i definitely don't want to have to deal
with the
yeah okay so we're going to extend
eval
which we call here to just to just use
um
m
this seems easy enough
should be fine
um and then yeah we want eval over here
to take in an m
for these the m don't matter
i'm just saying the m doesn't matter for
any of those because i don't think any
of it does
but we're gonna need to get an m inside
the rebel
yeah until quit run one i don't have a
run one
read prompt eval and quit here until
do i want to modify my until
uh yeah well i don't have a run rebel
but maybe if i
put null end like this
i knew a haskell kind of explained money
i can make the text a little bigger
uh and we're going to need this null
nullim constructor
so yeah i made that blog post instead of
a test
yes i think i'm gonna have to modify
until can i do that
like until is gonna have to
take in that bound operator or something
don't ask about the tmux shit
yeah like yeah you can like use them
like you use the i o monad every time
you make a haskell
program um i saw something on hacker
news this morning where the guy said
that he wrote haskell for a long time
was disappointed and then switched to
rust
okay so we're going to have to figure
out why i can't shove the null and bin
like that
oh well we're going to need m here
oh man i love how functions just are
like that
okay couldn't match
oh man so we're gonna we're gonna have
to listen to a song
i'll try to get a live version so we
don't we don't have to block it
uh but yeah
i've been listening to this song no
there's one
where they're like old yeah yeah he has
this man
[Applause]
[Music]
[Applause]
[Music]
[Music]
you
[Music]
i fucked it is i watched you go i saw my
hair in the phone
[Music]
[Music]
please
[Applause]
[Music]
[Applause]
[Music]
oh
[Applause]
[Music]
all right now we have an m so we
should be able to like set variables
[Music]
we're not here to talk about copyright
dbomc you know honestly didn't i time
you out once
yeah the general theme of the chat
should be
functional programming uh preferably
related to what i'm doing slightly off
topic from there is okay
um this is good this is a good book as
well
uh yeah
the idea of mechanical reasoning
fascinated people long before computers
specific questions about the scope and
limits of mechanization were
investigated systematically in the early
part of the 20th century um
it's a sad terrible tragedy you know you
can't i mean i don't know
what that's one way to look at it one
way to look at it is the halting problem
can never be solved
another way to look at it is like the
halting problem can never be solved we
can never go faster than the speed of
light
um
with both of those things like it
probably also seems like we're gonna
find cute little shortcuts around them
so it doesn't really matter
um where were we oh that wasn't the book
i wanted to bring up though i wanted to
bring up structure of computer
programming
yes so we can test
let's go to the examples here and see
which ones we can run now
so these expressions work
well we have to make define work yeah
define
size two
um
so atom defined
adam var
form let me read my form
equals
eval m form
bind to define var m
var all right that's cute
but we got also defined to find var
yeah we didn't write any of this throws
our stuff so we'll put that up here by
the environment
best way to make money without selling
out get timed out on my twitch channel
did you enjoy ender's game time out
topic stay on topic boys best place to
learn vim
you guys are lucky your subscribers and
you just get timed out
you know
people pull this shit when they're not
subscribers and i just ban them
can i time you out you know what rooks
you're gonna get timed out
for a week because you asked
i don't know if that's how many seconds
are in a week but it seemed like a lot
of seconds
oh now this looks complicated
oh well first is bound
oh man this all looks really tricky is
bound
m far read i o
ref m
i don't like when they write it in this
style i'm like i'm confused by this
look up var
getting timed out for a year would make
my day you're just banned
oh my god timeout
timeout
what is your most unpopular opinion i
don't know if it's banning you but
you're banned
no no no no i'm not setting up a
separate
channel for off topic chat you want to
chat off topic
go anywhere you want on the internet go
go
go on 4chan man go on 4chan you know
i feel like like if we just did this is
this okay let's let's talk about this is
this a procedure that would work
what if everybody who made off-topic
comments just got banned
like i don't have that like like if you
know look if i was one of those
streamers who had like 10 000 viewers
this wouldn't work
but with like a thousand viewers okay
probably only like 200 talking chat we
ban half of them
it's better
i kind of want to just play with this
environment thing like somewhere else
it seems like there's a lot of
complexity here
but like i don't i don't really
understand let's let's let's just play
with the environment in a separate uh in
a separate haskell
maybe we can even make a module
i wouldn't ban good viewers i'd ban
viewers who talk about off topic shit
are they good viewers i don't think so
don't get bad viewers
if you don't have anything on topic to
say don't say it
let's just write a little let's because
i i want to understand these these
environments
um is this really the best way to write
this
maybe maybe it is best to just write it
in here i mean the rest of the thing's
not very complicated is decently
factorized out
yes we didn't write define the bar
this is so complicated
this one like returns some kind of error
oh no this actually has to return a lisp
val
i just so define returns the value
itself
okay that's not bad
um okay
so already defined
uh
why do they use m down there and up here
they call it m
ref
i don't know i don't like that i'm
copying and pasting code i don't quite
understand
uh we're going to go through and we're
going to come back and we're going to
copy it then test it and then we're
going to rewrite it until we understand
it
okay lift i o does something
value ref equals new i o ref value
m equals read i o ref m ref
right i o ref return
value
oh and like set var is a separate thing
here
it's already defined
the player's not even in scope
i see what the import is
is it this
oh cool
i did not mean to start that
okay we'll have getvar and setvar
i think the ref is just like i'm like
passing it into a monad or something
um we are not writing it with any errors
so inside the do we'll say
that
i'll call this turn
value
unexpected do block
i think that's right
okay lift io
dot set var needs to return
an io lisp val as it's mutating the
environment
hmm
i see what you're saying
that doesn't look good for me though
well let's let's try a simpler
definition of defined var
where we just ignore the case where it's
already defined
and then uh variable assignment will
only uh
will only work so let's just get rid of
this
we should be able to make define var
work
i guess i really have no idea what what
uh
lift io does what if i just do that
could not match
well
so here's kind of a question
oh
definitely that but you're right i think
the last one might be i o it has to
return an i o lisp
that
match type yeah so then
eval's also going to have to return an
io list
valve
which i guess is okay
but now it's complaining about all those
things oh because do i have to return
val because it's now in a monad
lame flame
lift i o allows regular functions to act
on i o
values so you're saying if i lift i o i
don't need that
can i do that
and then i can get rid of the i o here
i don't want that io
but yeah like if it's modifying the
environment i i can't see how
i would get around that like it has to
be in the
it has to return the iomo net if somehow
it doesn't return the i o monad
um then how does it actually modify it
i just don't say perform io
no no we're writing good code here good
code
um
what i'm returning there i guess i don't
even need to return anymore
because it's all in io
oh i want an io show i'm sure io show's
not a thing
oh yeah lift m all right we'll lift it
into an m fine
if i lift m show
and get rid of the return yeah okay cool
uh now the only thing i'm not doing
right is this one
and it's probably because i need to like
lift it into the monad yeah yeah map
m which will do it in the monad
no i have to pass the monad to it or
something
oh what maybe i just don't need to
return anymore
get rid of that one for now
not match expect to type m with actual
type
m
oh that's just because i didn't
capitalize that
cool
i broke that unfortunately yeah we have
to fix this one here
um so
yeah i don't really get this either so
what they're doing here is they're doing
it in map
m doing like
like this and then like apply
uh function to x
cannot match type i always spell with
actual type
uh reminder for the new people please
keep chat on topic
if you don't have anything on topic to
say don't say it
so i thought this was the same as doing
this
but maybe it's not you guys still don't
really understand that notation
ah there's no x there
okay now it's complaining about the same
thing oh
i just need to put a apply in the monad
tail
and then that is the same thing as that
so we just make apply return and io lisp
val
yeah but now it's got other things to
complain about
hmm they don't look like they change
apply
i have to like lift damn it or something
i remember writing haskell like this
before never really understanding just
like sticking lift m
stuff
is it return
oh sweet lambda man
nice job
um
okay that seems like it did something
well i actually also need to be able to
get variables too
um
all right
um
okay i'm comfortable with it being in io
so do m lift i o
read i o ref
um let's look up
all right
hmm okay i have to break it out of the
maybe
well actually i think i just have to
apply this to it
yeah okay i'm gonna have to break it out
of the maybe
without throw error because we don't
believe in errors
just say undefined here or something
cool pattern matches redundant
um what did i do oh
hear this
how is that different
yeah okay i guess you can't do that
anymore cool
okay now let's try the example
from here
i'm excited that it's like a different
book now i can type in define
size two and now i type size two
define size four size is now
four wait then why did it need to do
something different
yeah i should look at type signatures
more i agree i
just don't really like
i don't really understand
um okay so
let's let's let's look at the type
signature for
okay you're saying i should like i can
look at the type signature for maybe
so i can do this like ghci and type like
that yeah
um okay maybe
be
a b maybe a gives a b
all right i mean that's sensible
so this is of type b undefined is all
the types actually i can ask what's the
type of undefined
type of undefined oh it's undefined oh
that's cool
uh yeah ghc is the compiler ghci is like
you can get like an interactive uh
prompt to play with i mean it's really
this is not a difficult stream to follow
i'm not a very good haskell programmer
you're really not watching me do
anything fancy here you're watching me
follow
like a noob tutorial um sometime when i
do like like like fancier stuff or
thinking stuff i don't expect anybody to
follow along but the reason i'm
enforcing
uh on topic stuff is you guys can do
this it's not that hard
um
so this is a function that takes type
a and goes to b and this returns maybe a
okay
that's very sensible
um
let me just text this girl and say are
we good for eight
we good for a question mark
you don't really need the lift i o in
there
you're right
you're cool
um we i'll pay only
do i not need this lift i o i hate the
left i owes i think lift i o is stupid
oh sweet none of the lift i os you
really need
lift i o is only if you're in a monad
stack
you shouldn't need any of them if you're
not handling errors oh
they add so much crap to this example to
deal with errors
arrows are dumb
um
okay we now have getvar and define var
and i'm not sure why we need setvar and
why it's any different
though i probably uh i'm probably
leaking
i'm probably leaking memories
um
look at the type of f map
i don't really know what a functor is
that's in the category 30 book so we
should just look
that's like you're right i gotta i gotta
i gotta be better with types
like
functors at the risk of sounding like a
broken record i will say this about
functors a functor is a very simple but
powerful idea
a functor is just a mapping between
categories
so it's like a function that goes from a
to b so amorphism in
f
a functor preserves the structure of a
category what's connected in one
the maybe funka
um
congrats
for telling me about lift i o you're a
moderator now
moderators come and go vip stays forever
vip is only if you pass a test
but if you say something that's very on
topic you can become a moderator
you don't have to use your moderation
powers you can just sit there with the
little sword next to your name and be
happy
um
oh wait so maybe as a functor
yeah yeah yeah i've seen this before
um
cool
oh we want to rl wrap this
map is basically the same as fmap but
for lists
see all this is deep functional shit
like
f map
okay i get what map does
so so map i can take a function which
goes from a to b is a list of type a and
it gives me a list of type b okay that
makes a lot of sense
um
yeah well so if i'm not handling errors
i still need to unwrap them maybe like
maybe as a type
and if i try to pass maybe if i try to
like return maybe it's going to be like
oh that's a maybe type you can't do that
i think there's a way to like hard drf
maybe i think there's like a like
shortcut for maybe undefined
um maybe i can just search for it no
uh fmap it's like you're from from just
i have to import something for from just
probably
okay let's go back to here
and we're eventually going to run into
why i needed set var and define var to
be different
but we haven't run into it yet and we
only do things when we actually need to
so let's go back to our
structure here okay
cool oh now it's going to be deep
if functions work so wait first can i do
this i can do like times
5 size yeah 10. all right sweet
define pi equals 3.1415
yeah remember when i made floats work oh
good thing i made floats work
otherwise we'd have to go back and make
floats work to find radius 10
times pi times radius
radius
no
it broke
okay uh let's commit what we have
um i'm gonna get ignore liquid
i was trying to get it to liquid type
check but we'll get to that later
um we have m
there's a lot of map function map
underscore
map m
yeah i like that's how they explain
monads it's like you have this like zero
and you have a pen thing well those are
monoids
and then monads are special monoids
or something i don't know i didn't
totally understand it i tried
um i did like that the c-plus plus void
class
was equivalent to the haskell unit like
i was like that's deep
um and i'm starting to i think i'm
starting to intuitively understand yeah
like why backspace won't work on python
um and it's because
like you can't get
um
you can't get
without typing functions can do
anything and it's really hard to say
that a function won't do something if
you don't have a type
um take something as simple as like you
have a class in c
plus plus and uh yeah
so
um like you have like a class in sql's
plus right
uh and let's say i have a uh in
i uh and i have some like we'll just
call it draft
um well
uh draft
returns a sub i right
so how do you reason about this piece of
code
right like or
even worse what if i have this
well you know yeah we'll just said i uh
said i hear right
um so i can make this private
uh and then i can put like an accessor i
could put like a like a set eye method
that's like it's so hard to reason about
i call that get and set
like prove to me that this function
will never do anything weird well
in order to do that you have to look at
this set i function
and you can analyze all the possible
setters of i
uh and i guess i is private so this is
strongly typed right if i was up here
all bets are off
um and that's actually because c
plus plus is a pretty strongly typed
language right
if i write the same thing in python
you know um
actually who knows my c plus plus code
isn't defined
who knows what's wrong with my sequel's
plus code what'd i do wrong
uh you're right it shouldn't be void yet
that's a bug what else is wrong with my
c plus plus code
uh i less than or equal to zero yup
there's another bug congratulations
who's got more
you don't actually need a public i could
do a public we're only looking at one
class so there's no main
there's another book i is uninitialized
exactly
um so i mean this fixes it but with ion
initialized
if i is uninitialized uh you can get i
mean this is an exploit right
um i could instantiate a class c
uh if i could figure out how to
instantiate a class c and get it to land
on memory that's already been
initialized
uh this is an arbitrary byte set
anywhere in the program
um you're right i checked the wrong eye
wow this code has so many bugs
you know you write something tiny and
you're like holy shit
it's wrong it's wrong all over the place
um yeah
versus like
like this is this is supposed to be a
simple class
that just wraps um
this all right let's write a constructor
for it
uh
i mean this becomes even more
uh shouldn't see also be unsigned char
yeah it should we'll just make it
let's just make a char all right
um and then now we're actually gonna
have to set
uh something like mln m-lan
equals lan that's not the convention
that i use we should use the right
convention
i'll say when equals when
uh do that
is this correct
how is it possible that bad code gets
past the compiler well i won't see my
different files
no i didn't like that i used malik what
is it
still live.h
a semicolon
okay cool compiled
bounce checking doesn't happen by the
compiler well so i mean we could in
theory add the bounds check to set and
get
yeah um but then like if these things
were not
private all bets are completely off for
example there's no such thing as private
i was thinking about trying to build
backspace on analyzing um
alpha
useless
oh the text section of the data section
print all text section
tv one of these days i'll learn how to
use otool
all text sections
in malek size of well yeah i mean
theoretically sure
i do know that char is one byte so
that's not a real
um
it's not even this didn't even include
any code
fine all right something that actually
uses it
who knows what number it's gonna print
oh of course i have to construct it with
a length
um
it's optimized right
now we can out tool it there we go
oh look at the mangled names let's let's
uh
let's compile this with uh os
we can actually make readable code oh my
god
when you compile it with os it doesn't
even have a class anymore
uh let's separate this into main.cc
and then shouldn't be able to optimize
around that right
maybe you can
unknown type name say class c oh no this
is going to all forward declaration oh
you need a forward declaration
oh my god
is this good enough or do i have to also
include the private members
said i as a private member of c oh
maybe i do need a public
whoever said public maybe you do need a
public you're right
shouldn't have a simple plus i know
now i can't find that
um
fine wow wow you really like me to write
real code
fine all right real code
yeah finally real code okay now let's
compile that with os
and it shouldn't be able to compile
across files right yeah
cool
yeah that's the best it can do if it
compile i think okay maybe os isn't good
um clang plus plus client actually makes
smaller code
clang
okay well that was a lie about playing
making smaller code this is bigger code
stupid clang maybe it's because i did o2
instead of os
oh yeah o2 wow it like aligns it or
something
they both do it wow
generate almost identical oh do i have
just g plus plus is it's clang
stupid g plus plus is actually clang
that one's actually g plus plus
segmentation fault what
why is it seg faulting
gdb
oh this is stupid lldb oh my god
[Music]
who trusts gcc anyway this is why we use
clang
the compiler of choice that doesn't seg
faults
oh compiler explorer yay yeah i saw that
uh i mean we could play with compiler
explorer
i mean this is kind of what we wrote
here well it's not that different from
actually do what you do on compile
explorer
[Music]
oh
well they have everything in here
clang compiler options dash
zero ass oh this is so cool oh yeah look
how come they made small one and mine is
so big
oh it optimized oh that's not good
i don't want it to optimize
cheater just inline the shit
add new
hmm
compiler no
inline i don't want to get rid of that
and that doesn't mean mine
yeah oh this is so much nicer
um
but yeah the question is
can you from this determine
like anything it's thrown away the type
information by the time it gets here
like i guess from this you can say okay
it's private so it's fine
just go any better at this not really
yeah i mean it all looks really hard
how can i how can i make this not
inlineable
that's that's crazy the amount of
reasoning that it's doing
that should make it not unlineable
uh this will make it not inlineable
yeah you don't know shit wow but it's
just
in line and access
i'll see what it did it just inlined in
access to the internal class member it
didn't respect the private
you guys see look it didn't respect the
private
i mean this is a compiler it doesn't
have to but
none of it's real
there's a beautiful example of an
optimizer reasoning that appears to
disprove mozlast's theorem
um
let's see what gcc makes
but gcc can't totally reason about it
it manages to optimize away get and set
but it leaves in the calls to set i
which is a weird call to leave in when
you think about it
yeah um but my point is like i think i
now understand on in
a like on a on a philosophical level
not philosophical like like on a
you can't um why you need types and what
types
are uh which is something i didn't
really understand
um all my years as a as a python
programmer
uh because you just think of it as as as
bugs
um
yeah link the example sure sure see this
is this is on topic like
if you're adding here's here's another
thing for like the on topic off topic
thing
if you're adding to a conversation that
we're having it's on topic
if you're trying to derail the
conversation
or you're trying to um you know
ask about something that like you can
google
then it's off topic and you know you
shouldn't be talking
oh yeah well yeah undefined behavior is
there's famous last theorem in here
if i actually do this in clang you're
telling me this works
hmm i think we need more optimization
from us theorem takes a long time
oh perfect
endless loop with no side effects is
undefined behavior
why does it need this mac stuff i only
get that
that's just to make the optimizer
actually do it
oh no no i see what's happening here
um oh yeah because you have to increment
them
i feel like there's a cuter way to write
that
it is max
if a is greater than max a equals one b
plus plus but that's
that's not only going to loop this
doesn't disprove from moz last theorem
this only disproves from oz last theorem
up to one thousand
this code is a lie
um what's the correct way to like
increment three variables and iterate
through all of them
it's like a right way to do this
uh
i could say like yeah for b equals one b
less than or equal to a
b plus plus this does it
no but there's still there's going to be
some unreached value there
i mean it it's a joke about compilers
but the code is wrong
um
how do you increment three variables and
get them to see
every possible number
like there's like walks that can do this
you know what i'm saying
what so how do you walk two numbers
if you want to go you want to go like
outward in a spiral
i mean okay i guess there's a really
naive way to write this
that wastes some compute i don't know i
feel i feel dumb not being able to come
up with that but like this definitely
works
broken
okay that will definitely walk through
all the numbers but also check ones that
it's already checked
uh so how do i avoid
ones that it's already checked i mean
maybe that outer thing with a actually
does work
let's think is this going to go to every
possible number
well no it's not because what about like
um
well this will go to 3 1 1 so that's
fine
yeah this look at every number this is
fine i i don't know why i thought it was
a problem
that will definitely reach every number
well let's see any number more than once
uh no but actually no no there are
things this will never go to this will
never go to for example one two two
yeah it won't go to one two two you're
right um
how do i do this define max as an
iterative iterator and call next at the
end
i'm just trying to
it's true it does say it's been
disproved that's right
that's a good point um one two two is
equivalent to two one
one uh for for mars last theorem
uh no it's not
um i agree that b and c can be swapped
for addition being commutative um oh i
guess yeah
no it's not equivalent to two one one
how do you how do you like iterate up
all the numbers
let's let's just think about a spiral
right so i can go to like zero
zero uh
i can go to like zero one
one one now i wanna go
back infinite descent yeah like the
proof
thing is this is this related to that
um so that's going
up over down
uh we'll go down again go over
go over again right like this is a
or let's just say i want to iterate the
the
normal numbers ah
so like that diagonal that diagonal that
if i want to iterate the 2d plane
what's that what's like a what's a
what's a 1d
space filling curve for the 3d plane
seems
it was limited as a space filling curve
maybe this problem isn't so trivial
or i'm just missing something stupid
the max thing works it just checks
things that it's already checked before
um which ones has that already checked
well okay so for the max thing we just
would want to start
one of them if we start any one of them
at max that should get everything
let me think of that as any duplicates i
heard a
uh i forget whose quote it was but the
quote was that programming languages
are designed to be languages of thought
i thought that was really uh
that was really deep
so this definitely works
but in order to avoid any repeats
yeah no it's not easy yeah diagonals was
the right idea yeah but what is a
diagonal
i mean sure i understand how to write
this in 2d space
but how do i write this in 3d space
right in 2d space i can just write it
like
um yeah i can get like all the pairs
that sum to five right
so for for 2d space if i want to do a
space filling curve for 2d
i can say something like um
in sum equals zero uh
while one uh for i
uh and i equals zero
i less than sum i plus plus
uh and then the pair is um
let's just say see if this works
uh
minus i
uh some minus i
sum is zero why is the first one one
that makes sense
yeah so that should get that should get
all the two pairs right
why would you always want to include one
two two a always has to be bigger than b
yeah no i know but i'm just trying to
say uh
i'm just trying to say like like how do
i extend that to 3d space
um well first a quick proof that that
actually covers all of all of the like
first quadrant and 2d space all of the
all the positives
um i mean every every point in 2d space
has to be the sum and we're iterating it
through sums
you do the dumb approach of counting
with an ever increasing
base
i don't know
[Music]
uh it would suffice with 2d space but
how do i write this how do i write this
in in 3d space
uh powersum
you need the constructive method to
confirm
yeah it's kind of exactly what i'm doing
yeah proven number system with three
components is countable
is there a link for that
gilbert curve halfway down the page so
okay i was right about hilbert curves
i see the hilbert curve in 2d space and
is that what i had
oh this is this is fancier
wait but i have to like predetermine a
depth
can you do the 2d space but add to every
pair the third number via loop yeah but
the problem with that is what do i count
the third number up to
right and i don't think it's the hilbert
curve either we're just trying to do the
integers
this you're telling me this does it
make sure we iterate through all
positive conversations of a b and c okay
let's just um
let's just print that and see if it
looks right
why think when we can code
god sorry i can't type
what no this is just this is stupid this
is wrapping around on the integers don't
give me that bullshit
i don't know how i didn't just read that
and be like no shit that's wrong
now this is correct for 2d
iterate over the sum of the three points
okay okay
yeah that might work yeah so i think
that's right i think
if i iterate over the sum because it's
definitely true that any of them are
going to have a sum and we want to find
all the combinations uh that sum to that
value
yeah yeah yeah this is this is easy this
is you're right you're right you're
right it's totally we do
uh for end a equals zero a less than a
less than or equal to sum
a plus plus um
yeah so we'll call it
l sum equals sum minus a
um and then we can just copy and paste
this
uh except this is only going to go to l
sum
this should do it right
uh i missed one why did it miss one
those don't sum to zero um
oh oops
zero that
does that get everyone let's just pick a
random one
we'll just do like grab six three
seven
get six three seven
one twenty six thirty yeah it gets that
cool
i think that's good
space filling curve in 3d boys
was that trivial should i just have
known that was i dumb for not knowing
that
it's raining i don't know if my date's
gonna happen
jesus noah
cool
uh all right let's just go back and
let's get that example working
and then i gotta go but it was a good
stream voice
let's figure out just why that example
doesn't work
non-exhaustive function oh and unpack
numb and it's just because yeah
yeah cause you're can't sorry
multiplying floats doesn't work
um does
defining functions work
um i'll merge a pull request if somebody
gets floats to work
uh and actually let's just check this
does this work
no it doesn't work it doesn't work
yeah because i can't just define
i mean this might work but i don't know
what that's gonna do
i don't know sounds like it's an extreme
thing
uh i gotta go shower
okay go floss uh
thank you for watching tonight's stream
uh i'm hoping to be a twitch partner
uh so if you guys know anyone to twitch
i don't really care that much uh
[Music]
but i don't know actually you know what
i do care about though
a blue check mark if you know anyone on
instagram i legitimately want a blue
check mark
uh and i i'd be willing to trade
my copy of white noise from blue
checkmark i will mail them
if you know someone on instagram i will
mail them this copy of this book it's a
really good book
um it's it's it's nicely like laid out
you know now you guys can ask whatever
questions and nobody gets banned
dm you for a blue check mark you can
actually give me blue checkmark i would
deeply a blue check mark would improve
my life
um a yeah so no i'm
not i don't know maybe we'll stream
again tomorrow but
we're gonna be reading this book and
that's we're gonna be doing
maybe instead of streaming reading this
book
isaiah yell the goat thank you for
subscribing
uh is cure usable with interpreted
languages i mean you can use it but
not well not really uh i will never read
book stream
why is jonathan a sellout
this book has a great conversation about
that that's pretty common i've had a lot
of people have read it i just never read
it
um i coded my thing and see i just i
don't know why i didn't think of
it's obviously it extends to the second
dimension to the third
and that is a proof that three
tuples are countable numbers
camus i read the stranger
uh and i was kind of i don't know i
don't like it that much
just a long time ago don't actually read
being in time i haven't read being in
time
telling people to read being in time or
critique of pure reason
only exists for trolls i don't think
anyone's actually read either of those
books
um
you should be crime and punishment kind
of punishment's easy to read you need to
read that
uh yeah i was thinking about that i was
thinking about crime and punishment
two things if you want to consider
yourself a serious intellectual
you have to have contemplated suicide
and have a reason why you don't do it
and have contemplated being a criminal
and have a reason why you don't do it
a lot of people just go through life and
they keep living and not doing crime and
they haven't really thought about the
opposite
and then you haven't really explored all
your options
constant positive i i i i read that i
like i
i sat and i looked at each word and i
tried to read
critique and purees and i just i just
um
let me say it because crime and
punishment was brought up
three month follower chat's pretty nice
start following today
one day the three months will be you
um no like you can be evil just don't go
around saying don't be evil and then
take it away and then like be like oh
but we're still not evil we just don't
say it anymore no that's
you can be an asshole you just can't be
a hypocrite
uh yeah tonight's a new day this is the
first date
um oh casino odyssey and cyber space
that's a good that's a good read
absolutely i reread that recently did i
did i mention that on one of my streams
uh there is only but one true serious
philosophical problem and that is
suicide
i like that um
cmky grayscale thank you for subscribing
do the august leak code challenge if
lead code is fun
i'll do it but if it's for fox who want
to like oh i want an elite card so i
could pass my fang
interview well you know i don't care
about you um
what does it mean to be beaten mentally
i'd definitely rather be beaten mentally
um
guys coronavirus is a cold
that's where it goes overdose on heroin
i don't know
i think there's better ways but we're
not going to discuss suicide methods
uh yeah metamorphosis are probably like
that whole that whole the whole world is
quite good
uh do i have a simple explanation of jet
only because you just subscribed
you ever run clang on a program it's
like if there was a little clang inside
your program that just runs on pieces of
it as you go
uh rich dad poor dad no i don't know
that book
uh the hypoxia seems like a better way
to go than heroin i agree with that
um
just do the lead code contest for fun
they're only on saturdays in the evening
less than two hours yo
i would like i'd like to flex for a
minute just so you were like
oh well george george doesn't do it
because because uh you know
yeah you can't do it um look at advent
of code
and look at the leaderboard bros 21st
and i like missed half of them too
um i know a whole bunch of the people
like i know a whole bunch of the people
up here too and like some of them are
yeah they're actually better than me
um so i'm not saying i'm not saying it
was unfair because i have very fair
contests but like i could have been more
on top of like doing it every night and
stuff
then i probably could have moved up
maybe to like
13th i don't think i don't think i can
beat those people
um
yeah well some of them some of them i
know personally some of them i know
because they're famous
how happy am i with this apartment yo
there's construction
there's construction i'm upset and
i complained i sent an email complaining
and if i don't get a complaint i'm gonna
i'm gonna
anti-shell for this company on stream
i'm gonna tell people i'm a twitch
partner
um
uh no look i don't know competition
programming like once it becomes like a
thing it's like
their thing you know it's like it's like
bug bounties
um i don't know
maybe maybe we'll see we'll see if it
looks if the contest looks fun we'll do
it
uh i'm not i don't i didn't complain to
the city no i complained to the people
who i rented the apartment for i want a
discount
um
no i'm not irl streaming my date i gotta
go thanks all for watching
i'll be back on at some point for my
12th stream and 12 streams means twitch
partners twitch you know you know
all right bye
everybody
we got a stream for you today
i made a test
uh yeah so this
what we have i'm gonna wait for i'm
gonna wait like we'll do the test in
like 20 minutes we'll wait for people to
get in here
what else is that gonna say
i'm gonna try to be quieter during the
stream
you know sometimes i'm loud
good morning i don't know
um today's stream will be drinking some
lovely
green tea this is
green tea from japan you can tell it's
from japan because it says japan
right here i mean
i guess i could write japan or anything
i want so i guess that doesn't really
mean it's just from japan
um we're going to try one day followers
we'll see if it gets out of control um
you know
this is warm up this is the morning
everybody can be chill
but when we're focused on something uh
anybody who
uh off topic things you'll get a time
out and if you do it again you'll be bad
um you know it's the internet you can't
give people the benefit of doubt on the
internet
you have terrible things like civil
attacks and anonymity
not terrible things they're kind of nice
things the alternatives are worse
um yeah
good morning good morning we have a test
for you guys today uh so i hope you all
studied
oh uh i didn't change it's part three
i know it says part two sorry i didn't
change it
all right we'll change it
i don't know how to this will do it and
i can go in here and i can edit
can i edit by the way i would like to
say that i've now
streamed for 12 days um which makes me
actually eligible
uh to be a to be a partner and we'll see
if they uh
are cool with that
um if they're cool with that i'll stream
more maybe i'll even post a schedule
uh if i'm not a twitch partner for some
reason
i'm just not the kind of content twitch
wants and then you know
we'll have to we'll have to move
somewhere else
um yeah there's a test so um
the test is in 15 minutes so everybody
you know
better cram you better study no i'm not
streaming games
i don't want to play games except bob i
was you i played baba's here that was
pretty nice
what benefits do you get from having a
blue check on instagram it doesn't
matter it's just uh you know it's just
it's kind of like getting that star next
oh my god
i gotta keep it chill it's like getting
that star next to your name
you know
um oh my god
didn't like you guys like like say like
like can you can you read the thing
about
why haskell well you know what you guys
can read it's on my channel
yeah it's in my it's in my bio if you
are asking
why you are missing the point
astrograph thank you
thank you you can't you can't take my my
quiz
we only have 31 people in here that's a
pathetic amount of people
31.209 i don't know why oh there we go
that's what i'm talking about yeah get
that number up
let's get that number up
this just nobody needs to talk about
that you get a timeout
um 251
thank you
[Music]
i watched mark shkreli on the breakfast
club last night
a little boss you know
um so if you recall where we got to
last night uh
we were up to the point where we were
trying to find this function
the square function
and it didn't work i guess we didn't
write the stuff we needed to define
functions yet
if we type like well if we copy and
paste this
it crashes and prelude undefined
undefined called it here
oh because it's trying to access square
it's not trying to define it
i say so we're just going to have to
change the eval
function here
yeah the problem is see that's atom var
so we're gonna have to add another one
in there i think
we can read the tutorial and see what it
says
now we can define variables we might as
well extend it to functions
let's start by defining new lisp val
constructors yeah i guess i really don't
have one for function so we're gonna
have to add it in here
primitive funk
wow
tie a list valve type
huh
and then apply instead of being past the
name of the function
you know should we should we use a real
editor
who thinks we should use a real editor
which which will have um
you got you guys pro using a real editor
i'm going to close workspace can i close
close folder oh that's not what i want
to do i will oh my god
this is hard to use you know some of
us have work in the morning
okay so when i'm like looking here can
this like show me the type for maybe
is there like a way to do this
i don't want a this here smaller
um no like i want to be able to see like
the type
you know you get vim keys on here
bim keys for yes code let's first do
that
oh there's like a way to like open
marketplace god i don't know how to do
anything
there are there are hotkeys for this i
just don't know them
yeah so one of these plugins extensions
then vim emulation mode okay cool
that's nice um
is it real vim
that's not too bad
cool uh but now what i really want to do
is like can i like see the type here
haskell shortcut
keys vs code
i don't like this
warpers are losers man
no actually you know what i'm gonna i'll
refine that i'm gonna say that people
you want to go like to like do like larp
in like a place
that's cool you want to like you know
go like pretend to be a communist that's
that's not cool man like either you know
be a communist or don't you know don't
don't like don't like act like you're
all serious but you're really not
you know don't claim to be what you're
not
oh you know my life my job will be a lot
easier if everyone just claimed what
they were
right this girl's dating profile she was
like a two paragraph rant about how much
she hates men and then it was a
thumbs up but i'm actually a really nice
person well no you're not and thanks for
telling me that in the first
uh you know two paragraphs right
um
why do i why do i read why do i read you
did chat
you guys are you guys are you guys are
trash and like there's no there's no
hope for it
you just get minimized you know you're
minimized oh that's nice
yeah minimized i mean that's the real
you know
i ban you because i care i minimize you
because
i'm sick of your stupid trash
i don't know never mind i take back the
s code we're just gonna use we're just
gonna use this
okay
um apply
so this is going to have to be changed
to this vowel and where do i actually
call apply here
funk
oh it's already an atom right
so i guess i can just change this to be
like atom funk
and then i can change this to also the
atom funk
and then i can change this to lisp val
so just work
see if that works
it type checks so let's you know
probably means it works
past the list val representing the
actual
function
hmm oh is that what they meant by
primitive function though
no primitive function here is a list of
lisp vowels
wow
i just i guess i guess they do want that
to be a primitive function and not an
atom
so we can just go and call the
constructor
here
okay so they're using define
that looks nice yeah so that's the one i
want
that matches that
this eval
adam define
list adamvar colon params
colon body of the function okay that
seems like it matches
why they have to write it like that
i guess actually that's how it's written
up there so it's like it's like the same
as this but it's that
and we have a make normal funk
should just make funk nothing well those
are
vargs i see
i don't even know what var args are i
guess we'll get to that at some point
those things create functions and we're
also going to need to add the function
type by primitive function
whoa the closure's an environment yeah
that's crazy
no instance for show environment
can we do deriving show here
on input deriving
can you not do that
parse error on input deriving can i make
a type derive
show
there's not
no instance for show environment
can i define show environment
see how many people we got all right all
right we're still on the rise
we're still on the rise we'll give it a
bit more time before we have the test
uh and then everyone who fails to test
is uh is banned
what do we think
wow this is what i leave that i leave i
leave and you're adult
i don't know how else to to express
[Music]
um
show for io types here we go oh
here let's try that
though
why is that being used
it's returning a type function
which takes params as the string why can
i not just pass params in like that
look up funk primitives
oh because that's not it's at least foul
like that
like no that doesn't work i'll go back
to that
at least that worked
couldn't match this vowel with char
i guess that's what that show thing was
um they're all atoms
it should be treated like i think not
just atoms i don't get it
what if i just change my param here to
be
that oh no on the scope
okay that works
cool
param is adam x this is the list
then we're gonna need to write the
runner for it which i don't think i
wrote
so yeah i mean what happens if you get
var and you get a function
so now i want to run like square it's a
false
you don't know how that happened
okay so we e-valid so that's a list
we eval the atom we get the variable
hmm
yeah maybe we need them
like we need to somehow capture okay
we're gonna need to write something that
actually substitutes the
x in for the parameter i'm going to need
to actually write the runner
here we go this
that looks complicated
all right let's get up to 500 people
then we'll do the test
500 people and then it's tested
meme review
the test is on the contents of the of
the stream
uh i hope you guys watched uh parts one
and parts two or are familiar with
what's being discussed uh
because if you're not why should you
chat you know
you don't want to pay attention why
should you get the privilege of chatting
would any would any what any classroom
work like that if everybody just you
know
you have no clue in your chat yeah and
this is this is the problem with the
internet
the test is very easy
if you miss part two the test is very
it's like last test
it's very easy you can use the internet
it's open book
like the vim versus emax people you guys
are cancer man
you know i don't know what else to say
oh so oh it's hitting this spool false i
say
yeah because it's it's trying to do the
lookup primitives
and that's what's not working
you want to come here you want to not
pay attention you want to just chat like
why are you here
go go somewhere else
go go on go somewhere else
you know you say it feels like people
are asking stupid questions on purpose
to troll you i really don't think they
are
um and that's what i'm sad about i'm
never sad about trolls trolls are really
easy to combat
um if that's
what it was then that's uh you know look
we can just ban them and that would fix
the problem
um the problem goes
goes deeper than that
it's maybe maybe you know my audience
just isn't who i wanted to be
um
yeah never underestimate people's
stupidity i mean that's the truth
sub only is a little bit better but i
mean you know you look
you shouldn't actually have to uh
okay i'm not sure it's just a moderation
problem remember
all right we're 439 you want better
moderation
everybody do well on the test
go go go go go
that's the test
first question is a twitch username and
are you a current subscriber
i tried to get automatic grading to work
um you have 10 minutes
let's go
test test test test
i don't think they are trolls i i don't
think they are
i think this is actually the majority of
my audience
there's the test
uh
you think you're meta and funny you're
not
in some way maybe twitch isn't the right
platform
right um i mean it would be cool too
like you guys are watching me code it
would be cool if we could all
uh like collaborate on this you know
um multiple people on the voice chat
i mean you know it's and it's my fault
it's my fault for for not uh
what window manager do you use timeouts
do you know what do you not get it or
are you trolling
right oh is that person trolling if
they're trolling we ban them
the demographics go against what you
want well where are the demographics
better
i heard that lead code contest today
who's talking about some contest
contest every week
starts in 11 hours
oh bi-weekly contest okay let's go
the contest has already started
oh well i'm not allowed to disclose
contest solutions
and then people can earn lead coins for
reporting me as a violator
um having more mods would go a long way
the mods the mods help to an extent
but again we'll see let's see how people
do on the test
you got a three you got you got a 3 out
of 16
congratulations i said i set up auto i
set up auto grading
here's the link to the test
you got you got you got a three three
a three
i didn't actually test the test i assume
you can get a 16.
the haskell questions are worth more
well we got our we got our first zero oh
we got a seven oh
no
the subscriber question is not worth any
points and the the
saddest thing about this is these are
the same
questions you're not doing a test oh we
got a 13
oh that's that's better
you did it without looking online oh we
got a 16. oh that's good
and you're doing fine to the first
question you got a funny guy here yeah
i like the auto grading i don't actually
know how to get we're gonna figure out
how to figure out how to
how to get um which people did well on
the test
and get their usernames and then we can
vip them and i'm not sure where the
threshold is going to be
uh we're grading this test on the curve
obviously who's if we ever got a 16
congratulations you're a vip
um unfortunately twitch has no way
there's no like option in chat
uh twitch if you're if you're watching
uh i'd really like a vip only chat
no we got a 14 not bad not bad
a 15 filling out the top see all of
these people
just shouldn't be welcome in chat
anymore
like if you got below an eight if you
you failed
you know that's that's going to be a big
theme
at my university if you do um
what do i think of islam you're banned
that's come on man
our politics is an instant ban anybody
anybody who brings up like like remotely
what do you think of trump banned
um
yeah yeah yeah i'll post a link again
you know i i know this isn't really your
fault such as touch which chat works
all right we have a couple of 14s this
is nice
um yeah i mean
it shouldn't be 14s are pretty popular
twitch bot that auto bans what do you
think of questions
yeah i mean you can't oh we got 216's
congratulations we got some new vips in
the channel
in before it's the same vips
see right there we need we need
the auto band to also like what is your
advice you know that's the same thing as
i know the people asking these questions
are are in the failing are in the
failing half of the test
do you think what is your advice
so you knew all but the hassle things
yeah you know what i
copied the questions in the previous
test
oh
how long you got um
how many people have answered it so far
we got 40 42 no answers are still coming
in well we'll give you we'll give you
all till till
uh 11 11 20.
a lot of the questions are actually the
same questions that were on the previous
test and that's because i'm lazy
the test link is here
oh you can give people ranks and the bot
can react to the different
ranks all right i gotta set up nightbot
i'll set this up off stream
uh yeah don't worry i have forever who
did well on the tests and who didn't do
well on the tests
do you test your co-workers not once
they have jobs
okay i see three clusters of people
emerging
no not really you you ruined the cluster
that eight that came in ruined the
cluster
um the 12 is the nice separator see
we got champions we got seven and below
we got failures and then we got
you know developing countries
a lot of sevens
i'm i don't know i'm kind of tired this
morning too
uh well the sevens are really you guys
are shrinking the graph
is there any way we can see how we did
uh not really we'll go over we'll go
over
give it five more minutes and we'll go
over the answers
you got me at haskell well guess what
that's what the streams are about so you
know you should have studied
the haskell questions were really very
simple
just joined and i'm still learning there
was no category theory questions
seven point average is really not all
right i mean it does mean i did a good
job designing the test
um you always want you always want the
average on your test to be a 50 but like
these tests aren't hard
all right we got five perfect score
sweet
okay you used a rebel for the haskell
question that's exactly what you're
supposed to do
you know you're not supposed to to do it
by hand
i'm scared of my results what if i get
banned yeah i mean it might happen man i
don't know i'll do well on the tests
yeah see that's kind of the problem
um no but see i'm also lazy right like i
think would i want to watch my own
twitch stream probably not
uh so how do i how do i make a twitch
stream that
like like the keep hacking elite twitch
stream
um you can't know your you can't know
your own grade
there's no cheating man this is it's an
open internet test
i see the problem is i can't give you
your grade right after the fact
uh wow we really have a it's not even a
bell curve it's just uh
i do a vip only poll on future stream
topics
yeah this is a trash carve okay three
more minutes three more minutes
88 responses let's go you got three
minutes how do you see how you did we're
going to go over the answers
it doesn't matter where you ran the
python code
all right two minutes
if you don't have the link by now i'll
do a pencil
does anyone have a pencil it's not a
number two pencil i brought a number
three pencil and now the scantron won't
grade me
you can read the number it's easy to
change
my crooked teeth curve i forgot
all right cool two minutes as soon as
this says
20 we're done
uh
your dream chat discourse be like
just generally you know high quality we
got six perfect scores all right cool
um
one minute one minute
uh who is haskell he's like some old
dude
just named like curry haskell was that
the guy
hurry is that his name
haskell curry that was the guy okay yeah
he's dead now
and time is up everybody please bring
your test to the front of the room it's
actually too late to bring your test to
the front of the room because i i
clicked off the thingy um okay
so uh you guys this was literally on the
last test
and so was this one there was no excuse
for getting those wrong
uh
so if you wanted to do the python thing
it's pretty easy to do though actually
i'm a little concerned that it's
actually the wrong answer
um so you gotta just import os import
math
important numpy as in p copy and paste
and you get
this answer here which is the majority
answer
uh what is the derivative of this you
know i changed it a little bit
good good to see that 79 percent got
that correct
um
who put one
why would it take one year some super
linear castle scaling
uh 12 yeah everybody who can add 9 to 3
should have gotten this question
all right what is the type of maybe in
haskell um if you wanted to do that you
could just bring up ghci we went over
this last stream you just type
type of maybe here's the type of maybe
that one matches that one click it what
monad is used in every
haskell program that is the i o monad
um what is this haskell code return
you just copy and paste this and put it
in haskell well we got a lot of one
we got a lot of people just said one
what is the type of eval currently in
the repo you had to check the repo
and we're using parsec and both that
capital parsec and um
lowercase parsec were accepted as
correct answers one
unfortunately was not accepted as
correct answer
okay thank you all 109 people for taking
my test
um let's create a spreadsheet here
now can we yeah yeah we can sort by
score perfect
i've gotten better at google sheets
all right so wow it turns out we have
the same people
all right so we're gonna give all of the
um
we're gonna give all of the people who
got perfect scores
vip
um mayfield
uh four congratulations you got
double vip uh i don't know i don't know
how to
there's no double vip um linear pup
congratulations you are now vip
patrick gecko congratulations you are
now a vip
um and lambda man who submitted twice
is disqualified for submitting twice no
just kidding you're cool
um and try to lose
you are also a vip
uh will you unban
okay uh congratulations
if you got a 14 uh you get a special
shout out
uh a five seconds bad
okay okay okay fine fine fine you want
to get on you got a 14 i'll unban you
oh glad you like the test uh cool
so it turns out the 15 is actually for
someone all right so
people who
um a special shout out to the 15s
and even a little shout out to the 13s
um and no we're not we're not scrolling
down to the zeros because people write
inappropriate things in the twitch
username box
um it's funny nobody writes
inappropriate things in the twitch
username box and then gets 16s
uh you are vip levant congratulations
that's what that little gem next to your
name means
not bob saget i unbanned bob saget yes
you're fine
um can you get vip you got 14
and just type i o stream instead of io
um
i'm going to give you a special shout
out for typing i o stream
uh but the rule was you had to get you
had to get
16 just checking your gem um
no the the name of the monad is actually
io
and considering you know these people
did get it um so special shout out
and there will be more tests um
i guess casing cost you a shout out
oreo i don't even see you on here
where's your band though your band's
right here
you don't you really don't want to be
banned
didn't know there was going to be a test
well you know
went to a grand vip test sometime
uh no we like we like tests um
all right the low scores yeah they're
down here
the lo the low scores are are down here
cut off for people who shouldn't talk
honestly yeah
if if you got less than 50
50 or less these people
you know
heavy question could you rant on ego
death let's see you didn't even take the
test
get a timeout
look you know what i'm gonna say
i'm gonna say there actually is a group
of people
who are worse than these people and
those are the people who didn't even try
i respect the people who tried even if
they got
fours and fives
cage chaos you're you're you're talking
you're talking a big game how'd you do
on the test
12 okay okay okay you gotta see
your schedule for the test you guys
i do this because it amuses me
no i don't respect people who kind of
three no respect
for people who got a three the 14s and
the 13s get some respect maybe even the
12s
um parsec casing shouldn't matter it
doesn't
your mom you got it all right
right up until there troll you were so
close
you got 13 out of 16 and i'm a sub can
you get vip no vip
is only for the people who did perfectly
and can we talk about how
mayfield iv managed to to
uh get vip on both tests so it's good to
always see like the same people at the
finer take
the final table uh let you do the test
no sorry
yeah vip icon does look nice i know
all right cool let's go back to coding
i'm going to make my function run
so what's happening now is in this apply
yeah so we really i think i mean who
remembers the type of maybe
it's coming in handy again
so here the problem is that this bull
false is being run
we're going we're going off the map here
um well
i think does get bar have to be in the i
o monad
it shouldn't because it doesn't modify
anything right
let's look at the type of read iorf
variable not in scope data
hmm that's in the iombo now
now the answer the dog's question was
10.
so yeah
did they modify apply
yeah they added io they added an i o
type signature
um i mean i guess if i just
remove that because it's the only place
i use it and i change this to io list
val and i put a return here
cool
so the problem now that bull false is
coming from right here
[Music]
um
so this is the b
this is a function
i don't exactly understand
so it's doing a look up in function
that lookup is what's returning maybe
oh so that's okay this is a function
that transforms a
into b
i need that
that's easier to read
let's try another function um
exec
look it still it definitely is an atom
it's not looking that off
but i guess i do kind of want to look it
up
it's always going to be an atom but i
could i could i could look it
up do this look up funk
primitive somewhere else
[Music]
or are they just adding all the
primitive we could also
add the primitive functions
since we're now storing primitives yeah
look at this
so we're now storing primitives as
regular values and variables
we have to bind them when the program
starts up
so like that's how they're choosing to
do it
instead of doing this this this lookup
because i guess in lisp can you redefine
a primitive
maybe you can the these things are just
functions so we need to bind them
here and then we can just do
a instead of doing this
when you eval a list we can do a get var
uh on funk
yeah but we're gonna have to bind the
primitive function we're gonna have to
put the primitive functions
into the i o moment into the into
the m
i will watch the past lessons and get a
perfect square bob saget
you are you are close to getting banned
again
don't don't discuss don't discuss
getting around bands
bro come on congratulations you're
banned again
don't broke them on me
[Laughter]
here's my advice to you go start your
own channel
and you can be as tyrannical as i am
free bob the people are protesting
there's uprising
what gets you negative points
just
[Laughter]
i'm glad i'm glad i'm glad you guys are
uh you guys are making me
[Laughter]
god
[Laughter]
anyone who dms because they're upset
they were banned like you think i'm
gonna like unban you no
i just know i made the right choice
yeah it's funny it's funny yeah we're
having a good time we're having a good
time you know i'm feeling my i'm feeling
my
my tea
is my 12th stream so now i'm legitimate
to be a twitch partner you got to stream
12 times in 30 days
the band people are gonna stage it stage
a coup man
yeah i'm deeply worried about that i'm
so insecure in my power they're gonna
that's that's kind of the beauty of you
see you know
this is a great uh slate star
kodak seeing like a state
um
this is this is a great this is a great
post right
you do not want you do not want your
city
to start looking like this you want to
keep your city looking like this
because when the state comes in and
wants to tax you
it's very easy if you all live in little
boxes made a ticky tacky on a grid
but if you live in a place like this the
state
can't the state can't make sense of you
um and that's how you avoid being
overthrown
right evenly spaced rectangular grids
are terrible places to live
yet city planners seem to love them look
at this
look you could live in a prison
[Laughter]
um
now it's a good post definitely worth
reading i should read the book though
that he reviews
let's find bars
so then everywhere i was doing nullan
i'll just switch that up with primitive
bindings
should be right
let me find bars i don't know i guess i
don't have that
it's defined right there that seems
sensible
does bind bars just call
the blind bars here oh here we go
find a whole bunch of variables at once
let's get all sorts of lift
m's again okay let's let's write
something more reasonable here
um
i just what if i do like a map m define
define var
i don't think i need to flip anything
i do need to expand because they're
tuples
okay mapm
let's try this
well
i do m equals
null m
wait really though how can i i can't
just fix this
like this breaks the whole levant 47
this breaks the whole show
because it's a function and um
not for one constructor
in order to make deriving work you have
to remove
this valve huh
but i need that constructor
oh this is so sad
um
how can i cheat this
look up recursive types and deriving
oh if you enable the flexible instances
languages instruction okay that is what
it was asking me about
did you take the test by the way
didn't take the test he just joined
well i believe in you to do very well on
a test shortly
um
yeah okay so
we'll have to define the flexible
instances language extension
how do i enable this
it's like x flexible instances
yeah it works cool
oh even better i like that better i like
that better
i i'm going to edit this
oh let's just have to read me a little
bit
so flexible
fargo pharmany you're forgetting
that the reason that i stream is for me
and not for you so
you can watch it on twitch and you can
hear the music
or you can watch the muted inferior
version on youtube
yeah we should write tests i think
that's a good point
then we can do some test driven
development oh i like that all right all
right we'll do some test drive
development let's do it
mayfield what should i use looks good
so
h spec
you like this
i'm probably gonna have to like bring it
out into a uh
oh run haskell do i have run haskell
i'm gonna have to like factor this out a
little bit
wait is this gonna work though because
we don't have the i o monad
i don't like the environment as in the i
o monad
um
describe
tests do
it
2 plus 2 equals four
do
i have to figure out how to get eval
string in here
uh element
primitive equals
eval string m
our string is plus two
uh equals equals
number four is that gonna work by
any run haskell oh run haskell
now we're going to need to make like a
module or something well first we need
test h stack we definitely need
i cannot find module test h-spec but i
installed it
you asked to include executables
but there are no executables to install
hmm i don't know why it didn't install
oh do i need to call it a module
then we're gonna use called a module or
something so let's do like
module test where
oh because i called it test maybe called
spec
what
um oh maybe this is module main or
something
no but this is okay
i don't understand like kabal installed
age spec
could it be cabal installing it to like
the wrong place
i feel like a cabal installed other
things and it worked fine
lib
what okay now it works whatever i'll
take it
okay well hmm i guess like an important
name can i
import main is going to end badly
remember the hidden package
how does parsec hit it
this
just like run haskell
main
oh right now i can't even
compile i broke parsec
oh this isn't good
rejecting goal
no
i should never have cabal updated i
deeply regret that mistake
that you stack now no no
rejecting process cabal
uninstall process
no
conflict ghc
cabal install process
um
why is he trying to install ghc
let's see if we okay we upgraded
cabal install parsec come on
that doesn't work
i'm trying to downgrade
um
um
i gotta use stack instead
okay
stack install parsec
oh this is a nightmare
no this is like some sandbox crap no i
dislike this
and why don't i just use a virtual amp
brew install haskell stack
but this seems so just fixable i can
just fix this one conflict and
it'll all be good
constraint from user target
why is he trying to install ghc
i had to like get one ghc to work for
ghc up to be happy
all right this is kind of a nightmare
it's downloading a whole ghc
stack troll isn't going to help
stack is more like local package
management
i don't want to create a new stack i
don't want to do that it's a virtual
image
the ball manages global depths yeah i
know that
i did cabal update that was the mistake
that was the
the deep mistake never up
i'm not rebooting
stack new whatever creates like 10 files
see i hate these things they're so
complicated
oh my god
the ball on update
uh
that's what i think you were in your
days 19.
it helps to delete the whole directory
okay okay i like that move
well
can i just delete this
buy a new macbook only if it has an arm
processor
oh
well it should have had a flack
oh no this created new full files
not spec that one i like
oh no i did not mean to do that
um
27 months nano danger 7
you're cool
oh update
oh now it seems like it's working
okay
it's downloading a lot of crap let's go
if you want to use should be well i
really don't like that i have to
use the back jack
could not match expected type i o string
yeah so okay the problem is this is
returning an io string
which i guess is kind of right
okay yeah that makes sense gotta lift it
out of the monad and then
yeah okay so that's a different problem
um
oh can i do hiding main
it should work right
oh oops
perfect cool 2 plus 2 equals 4.
all right we're making progress let's
make sure 2 plus 3 is not 4.
yeah good good can good do equals equals
or do i have to do should be
no i can't actually should be i can just
do should
i can put should be here right i don't
have to do those egregious back
yeah now texts talking all right
cool we got a testing raffle
testing boys testing
um
let's copy some tests from here
should probably be able to avoid that
terrible copy paste
nice
cool
we got test boys
who's trying to test their luck oh that
just seems like someone's trying to get
banned
anyone who tests their lock is like
banned me
you ever you haven't yeah you ever come
home and you see like you know after
your dog went through the trash
and you come home and your dog like like
comes to the door and he looks sad
you're like why are you so sad and then
you see you went through the trash and
like you know you know you're a bad dog
like i don't know what to tell you man
you know
okay so let's
test let's come to a test that doesn't
work yet
and we're gonna do some test driven
development boys
test driven development wow this is
really nice
is there some way in h back to like not
have to type this thing twice
what i'm saying
yes he looked it failed it's getting
true now
shouldn't get true
yes just define a function
what do you mean by that
yeah but it's not exactly what i want
like i could define a function that's
this
i agree but then how do i do this
oh maybe i could say yeah yeah yeah
uh i just did commit and push
maybe i could say like where um
where steam equals this
and then just do scheme in both places
i don't think so because i think the
wear will only apply the do block
it's not right
test
before hawk what's it before hawk
run a custom action with every spec item
yeah
i could
writing specs
describe an it
context an alias for describe
before
before flush db
no that's not what i want
i don't think there's a real way to do
this at least not anything easy
it's kind of fine like like
in reality there's no reason that the
test should be the same as um
okay so let's get our let's get square
to work
the god bull true why did it get bull
true oh because i returned bull true i
put bull false here this is gonna work
yeah cool all right so we gotta actually
make it run the function now
king f66 i'm sorry we do haskell on this
stream this is a haskell stream
by the way can i just talk about how
much i really like
libraries like how nice is it that there
was just a testing library
ready to go with all this
functional programming is
it's enjoyable it's enjoyable
i thought one of the things enjoyable
about it is you can spam more
and it works you know
we had a lot of viewers how many viewers
we got how are we doing on
on the viewer's account so that's still
right
it's pretty good right libraries now
frameworks definitely true
something like test helper phone
well yeah so i understand that i can do
that
and those are fine for these
i guess yeah you know what i should just
i should just write that
yeah okay let's let's let's write a test
helper function
uh and then this would be nice
okay um
test
yeah we have a list experts i think
that's right
all right let's check your code
this is what i like to see when people
write code
um i've never used a for loop in haskell
before
like that should be a result expected
yeah that should just work right
now i can like replace this with like
we don't call it test alpha phone we'll
call it test
oh i need data foldable for four yeah we
can do that
okay so
why is this experts here
i think we want to more say something
like
e colon experts this
like that
and then we're going to want to pass in
just a list containing that
and that
yeah i need data foldable
that should be
wait what
no that's
oh that's not really what i want though
um i mean it should just be the last one
it can always be the last one in the
list
all right the first one the list should
define the name of the test
and the second one in the list should uh
that's going to work right failed
expected that we've got that
yeah um
let's see what we got here test helper
phone
do m v equals primitive bindings
for a knit
x bar
the last x-verse
that's a net is this is all of them
except um
actually caused by a missing do
to last empty
list oh
i could say what i can say first
uh head called head
sweet nice job
staff on thank you i don't exactly
understand
this oh this is a lambda expression oh i
get it
cool so now we should be able to replace
all of these
with the new style test framework
oh so much less code so beautiful
much beautiful
you can probably do without the lambda
oh yes that's definitely true i can
cool
um
my daily schedule like i time out people
who ask
questions it's definitely in my schedule
so we're gonna have to this looks so
complicated
vars do i have a bind bars i don't think
i do
well that's what the the present means
it means you're a sub gifter
i get it
wow
damn okay we should have made bind vars
should have taken it more seriously when
we didn't write
bind bars
oh
okay we have to bind the params to the
vars
um
i mean like does haskell have zip
so map m vine bar m we want to zip
params with the parks
now that that's
done we probably really want to make a
copy of the environment before we do
that
i'm not really sure how to do that um
we can say return
eval body
uh oh we actually want to buy them in
the closure
closure body something like that
cannot match type list val with char
oh body is a list why is it a list
shouldn't be
i guess i can just do this if i want
oh i don't think we need to return
let's just map okay could not match
type lisp valve with char
oh the params are
yeah the programs are atoms they
actually really shouldn't be
um
adam params it seems right
wow and then i have to change the type
of params over here
to what it was
okay non-exhaustive
match in function eval probably
when i call eval from apply
so my list body is should
be this
because maybe i don't really understand
why it's a list it's probably a double
list or something
does that work sweet
to do why is body a
uh list
well we can actually you know let's just
do what you do now
don't really get it yeah i guess there
can be more stuff there
i think this is always
right yeah
something to do is get done we'll do it
once we run into an example that
we can't do loving the
tdd functions bro
okay let's move on
square now works we should test things
like double square
it's kind of nice
oh um
now this gets into like
now we can use the solar express
building block okay cool
yeah um
we're gonna have to write cond
do we have condon f in our scheme
what did i not define them that i was
supposed to
evaluation part two
ah conditionals
so here implement the con statement
well let's get that implementation for
the if statement and then test if
and then we'll test our ifs both ways
undefined
clearly undefined or we're getting it
undefined oh because uh
abs isn't defined uh no not abs i mean
uh if it isn't defined
so we have to define if it's a primitive
it's not even a primitive
it's weirder than that they wrote it in
put it in here
oh my god i hate whoever gives us tabs
case result of
get it you could write it with
parentheses or maybe you meant to enable
block arguments
the case needs to be indented it is
indented
oh no there's
[Music]
the same indentation as results
yeah okay uh evals have different number
of parameters because we have an m
we're going to have to pass an angle
here as well
we might need a return no i should
probably
um
cool it does not work
still undefined
let's just test a simple f
um if bull
true seven three
actually i don't need bullshit can't
just say true right
is that how true works and
that
okay those work they're getting an
undefined
somewhere else
[Music]
oh can i not do that
undefined
oh my defined doesn't work that
oh i wish we wrote some errors
are we testing stuff because we want to
write good code
um let's go to run here
that works
oh minus five doesn't work
yeah okay oops my bad i made that up
you can't write minus five but you can
do that
uh we also want the one with con to work
so we should implement cond
well khan looks painful with like else
wow that's a big list
i'm going to use a for loop there
if none of them is true the value of the
cond is undefined
we have an undefined i don't know
i'm pretty happy with this for now
we're gonna probably need to deal with
the lack of errors at some point
all right that's today's stream
quick q a anyone has anything
that they want to say
thank you
um errors are important please please
study for tests
there will be a pop quiz in the future
just always always be ready
to be tested i'm always ready to be
tested
honestly if some guy came up to me in
the street i was like yo george
here's an ipad you got 10 minutes go
ready to be tested
thank you oh yeah so that makes my 12th
stream
um what's your homework somebody
implement
con somebody implement con to do a pull
request
also if somebody would clean up my
readme i'd appreciate that too
um yeah make the readme last shit
uh implement cond
and write a test for cond in spec
my tests they're so beautiful oh i'm so
happy with my tests
yeah i yeah i read up on hadoo i
understand i understand how it
translates
um oh yeah float operators that would be
a great pull request
here we'll add some to those
uh
to do and again you know if this is
actual work for you don't do it but if
it's fun do it
um add float support
add cond support
uh so we should be able to do up to
that'll get us the whole chapter one
i don't know if we have support for and
should be all of
uh chapter
1 of
so yeah we should be able to do
everything in chapter one
after that's done right tests
clean up readme
who's been working who's busy beaver
reaper someone working on it
you guys miss busy beaver
that's cute
written in rust oh this is recent
good i'm glad to see people working on
this
busy beaver is very fun to play with uh
open cog is it ben gortzal
oh i've looked at that no that shit
makes any sense
yeah i've i've read
i i've voted this before never makes any
sense
um yeah we we do uh
i mean these are noob streams right we
do we do this
this uh book this is the
this is like mit's uh
i think they're they're like textbook
that they do for freshman programming
and stuff
um actually i'm not 100 sure mit still
does scheme
but oh wait maybe we can't do all of
chapter two never mind i lied
no no no i lied about chapter one
just the exercises
just say up
to
can chad prepare tests i guess yeah if
somebody makes a test
if someone are you saying you want to
give me a test and you want me to do it
on stream
or are you saying you want to prepare
the tests for the other future streams
both would be acceptable
i guess thanks for watching everyone
enjoy your saturday
go learn something uh i gave your
homework
go go go do poor quest somewhere in my
high school ski report
hello hello hello
and bring up the chat on my phone
because i think we're gonna need the
full
monitor for this stream
i think it like takes a little bit to
propagate and that's why
i find this ui so confusing
so there's another way to get to my chat
on here my channel
and then i go to videos no
i can click live here and that works
first
hi perfect hello people
what's up what's
all up cool we live boys
we live let's go let's go yo
let's get let's see how many people we
got all right so first we're gonna have
to make a decision
and we're gonna listen to a song
looks like we have some relatively low
tier
questions and comments
um in here
i did watch some landing congratulations
so now that we're done with the bagel
we're going to be doing write you a
scheme version 2.0
now i did version 1.0 a long time ago
and
i do want to give one note um
on the last stream
uh i read the comments briefly and
i think it's kind of a
tragedy that we can't trust any
institutions anymore
um it's sad that that all of the
uh universities journalistic
political these institutions are just
so unequipped um to deal with the modern
world
and they are not adapting well
so like paul graham said
i'm excited for the people who are going
to come in and build new institutions
um it's not that way not to trust them
it's just that i don't respect them
you know i don't respect i don't want
the new york times to say good things
about me i don't respect the new york
times
i don't want an honorary degree from
yale university i don't respect yale
university
who do i respect a bunch of random
people on the internet
satoshi nakamoto
vitalik eliezer yukowski scott alexander
scott aaronson curtis yarvin
uh paul graham um
you know it's it's a smattering of
individuals elon musk who can be trusted
and i think are adapting to the modern
world in an okay way
while these institutions remain so
incredibly tone deaf
uh to the fact that we're not interested
in being lied to anymore
all right
i also the only other comment i'm going
to respond to
is non-constructive proof
um there's a stack overflow if somebody
can link that to me
um if somebody can link that to me i
will go over that proof
because i realized that i didn't go over
the proof uh at all i just kind of
glossed over it and once i understood it
and then i realized that i actually
didn't
understand it totally the way that i
thought i did so if somebody could link
to that proof
um
this is the desert identity right
thank you hype train um
does someone want to uh
want to link to that i know it's in the
comment but we don't get youtube
comments anymore
uh there's no more youtube comments in
my browser they went away
i did make decent revenue from the last
stream i did um
so if nobody's gonna link to it then um
not here um so
r uh equals the square root of n
is integral uh if rational uh
for n uh exists in it so
what you're trying to show here is that
if
r is a rational number it has to be
a integral number so
we start with okay so r is some fraction
a over b
um the greatest common divisor of a b at
one which means it's a reduced fraction
and then this is the bayesian identity
this is something that has to be true
now if you'll notice this jump to the
next step
um so if you look here uh a
minus br times c plus dr if you take
a over b and you substitute it in here
uh the b's cancel out so you're left
with a minus a which is zero
so it's zero times uh c dr which
obviously equals zero
um and then you can take
uh this
um and you guys should remember foil
from algebra to multiply your firsts um
your inners uh your outers
so that's plus dra and then your lasts
which is brdr but actually you'll notice
r times r um is defined
to be n all right so we can actually
just change that to bdn
um so we're left with ac
minus bdm uh
minus brc minus dra
so we can factor an r out of here
um let's let's just flip these around
all right it's the same
um so we can factor an r out of this
uh d a minus bc
but we know that da minus bc equals one
so we're left with replace that with one
and we're left with uh
what's written here now ac
well considering b and c are obviously
integers
c is also an integer so this is an
integer
this has to be an integer obviously n n
is an integer it's
defined to be a natural number so
because these are both integers
and we know zero is an integer i mean
another way we can just write this
is zero equals b d n minus r equals v
minus a c
right so uh
uh so yeah i did promise it was a noob
stream so we're gonna we're gonna go
through and be nice
to people like that
george made up all sorts of shit in the
last stream
he's fooling you guys just because he
cost confidently about fields he does
not know as much as programming
what's wrong
do you have a counter example to
anything that i said
um and you know what i'm gonna make i'm
gonna make a claim i'm gonna make a
claim here
the time traveler 253 come forward right
now with a counter example or you're
banned from the stream for life
give this guy 10 seconds
20 seconds come on come on
come forward you have people who talk
like this and they talk like oh i am so
clever he said a lot of wrong things but
then they don't have any specifics at
all
all right i'll review the stream and
write down some examples okay i'll uh
you know you can you can reply in the
comments but now you're banned
um right because you don't have any
examples you honestly don't
what you don't like is a feeling like if
you had like three things like you want
to come at me with those things i'm
happy to have a conversation
but if you're gonna be like oh well he
said a lot of wrong things
because they didn't make me happy and
things that don't make me happy are
wrong
you get banned
okay um so
we're gonna do this oh also
the other thing that i wanted to talk
about was i found a bug
in my busy beaver code and it wasn't
producing
i shouldn't have been lazy you guys
shouldn't let me uh
get away with with laziness
so this is from the busy beaver streams
where i implemented
the zany zoo paper um
so you shouldn't be allowed to i
shouldn't have gotten away with being
like oh i know what's right even though
my numbers don't match
if your numbers don't match the paper
you are
95 of the chance you're wrong maybe five
percent chance the paper is wrong if
you've really looked over it
but um of course we're in the 95 bucket
i had a bug
so these are the number of states that
we should be generating
uh for the given sizes in their tree
normal form
so this has been pushed to github
if you go in
36 for two by two
three five zero eight for three by two
two seven six four for two by three
one of my biggest mistakes was this
when i added in these other states even
though they're overwritten later on
i didn't make a copy of the machine and
not making a copy of the machine
caused these num states and num symbols
to be incremented erroneously so once i
made a copy a lot of that bugs were
fixed now
i'm still not getting a perfect match
for four and two
so i wonder if i still have a bug um
this one is giving me five one one one
six two uh do two and four
i think this one gives me three four two
five
thirty two and they're very close um so
one of the things i found
was i set this bound on the number of
steps to 200
if i change it to 100
i get a perfect match with paper
but when i change it back to 200 which
is what they claimed in the paper i
didn't get a perfect match
so i'm not exactly sure what's going on
here but it's nice to see my numbers be
a whole lot closer to the papers
you aren't done until you've matched the
paper perfectly
of course i'm still not done because i
haven't matched the paper perfectly but
remember when they claimed that the 5x2
machine was getting this many
my implementation got this when we ran
it over on the server
now i got this so uh that's at least a
whole lot
closer to what the paper said
uh you created a copy before but you
deleted yeah maybe
maybe because i thought like it didn't
matter uh
because i was like oh i overwrite it but
i forgot that all these things have side
effects
but we will program in a language where
there are no side effects
in haskell and i think this is an
appropriate
um stream
so scheme is a programming language
we're going to be writing a scheme
interpreter in haskell that gets you
kind of to what the truth uh programming
languages are
i want to talk about one other comment
that i read it was like george
could you please uh give us a tutorial
where you tell us what your terminal
setup is and what computer you have
these kind of things only matter to
people who like to circle jerk
they do not have anything to do with
skill uh so if any time
two things that i want everybody in the
comments to dog pile
i want them to dog pile people asking
about like frivolous
things like that and i want to you all
to dogpile concerned trolls
and uh tell them that i don't give a
fuck about their concerns
um and you know my brand and all that
and you know they can uh
they can get fucked and then the uh oh
the wokeness police
uh the the only solution for the
wokeness police is
absolute and complete ridicule
uh so yeah i mean that one that one
ridicule is always ridiculous always a
good oh they're coming for you man the
wokeness please
you heard of the boogeyman you heard of
the boogaloo oh they're coming for you
uh so that's yeah uh
level two hype train thank you thank you
um
what toothpaste
um this guy's a vip so we're gonna
listen really to what he has to say
is there some fundamental cs topic that
you can teach people they wouldn't be
able to teach themselves
oh that's another kind of thing that i
was thinking um
it's very hard for me to teach like this
um it's very hard for me to teach
like okay the twitch comments are twitch
comments from from hundreds of random
people are not really a good uh
audience for lectures one of the things
that i think that would work a lot
better
is if we brought one person onto the
stream and taught them a specific
topic and then if you really want to
teach somebody something
i think the best way to do is kind of
socratic method style
right you make sure you check their
understanding at every step
um because a lot of times when you're
learning something
uh you don't know what you don't know
and then by
being being asked to do something and
realize i remember i remember being in
third grade
and um my uh
it was in second grade second grade and
they were they were
going to put me up a grade for math and
i spoke with the third grade teacher
and she asked me george do you know your
multiplication tables
um and uh i said yes
and then she asked me some questions she
asked what's 6 times 6 and i said 36
and she asked me what's 8 times 8 and i
said 64.
and then she asked me what 6 times 8 and
i didn't know 6 times 8
because i actually just knew the squares
i didn't actually know i didn't know
that you could multiply besides
multiplying numbers by itself
um so uh yeah
yeah we could potentially take vips we
could also potentially say it's like 100
for 30 minutes uh might be another
option
so we can either charge money or we can
have a merit-based
thing uh those are the two things that
it is acceptable
to discriminate upon in a modern society
you can discriminate based on
uh paying money or you can discriminate
based on skill
don't charge you'll get banned from
twitch you guys are always so
like don't do x don't do y you'll get
banned from twitch
well i could get big twitch if twitch
bans me twitch bans me man
like i'm not gonna i'm not gonna go out
of my way to violate any rules but if i
can't do what i think is like
normal things to do then all right i'm
banned from twitch i'll go stream
somewhere else you know
all you do is criticize everything we
say brah
uh i don't even know how to respond to
that
yeah i don't know about making your own
stream server i think there's another
one
um do we have to ban someone yeah always
always be
yeah i know i can show my earnings but
you know it's tacky
um we'll stream on a voice app
if i die i die that's right
that's the philosophy lanalocks
thank you for bringing your people in
and i think that is a perfect time
to actually get started on the stream
okay
although the majority of modern
programming files see algo style lifts
lisp syntax is simple using the same
syntax to represent code and data the
list
this is called homo iconicity i didn't
know that
if a program written in it can be
manipulated as data using the language
such the pro i don't know i mean python
has like an ast import ast
um a scheme a dialective lisp is pretty
straightforward we won't follow the
strict
scheme standard for stake of brevity but
aim to include many useful features
why haskell because this guy loves
haskell okay that's good to know
um what are we gonna do we're gonna make
a very basic but robust programming
language that is both simple to use
and highly extendable is that how you
spell that word i don't think that's how
you spell that word
no it has an a um
so this is some basics of lisp uh
understanding check what form does
scheme use to represent data
um the same one that it uses for code oh
man i should have paid more attention
how would you create a function lambdas
you can use lets for setting variables
scheme is a dynamically typed
interpreted functional language
c is a statically typed compiled
imperative language
yeah can you rearrange lead expressions
into lambda
i don't think so you can definitely put
lambdas into lets
um write out an explanation and
example that demonstrates using lexical
scope while the
things are only scoped when they're
inside the lambda so i think most of
those answers questions or answers are
right but some of them are probably
wrong
you guys can make fun of me in the
comments
um
before we start there's a note i have to
make before we start i'm going to take
a time to complain about string
um
uses overloaded strings and all files so
i advocate
text this is the strong position on text
i don't know i'm already questioning
this tutorial
um from from a word being spelled wrong
now we're gonna we're gonna go with it i
believe in this tutorial after much ado
here's the remnants of the
representation of the s expression from
lisp val
all coded data is represented by one of
the following data constructors
there's nothing else take a look
okay so let's write that out so we have
data which is a list val
which is creating a
oh i really i'm gonna have to do that
that text thing or it's not gonna be
happy
language overloaded strings okay atom
is a t dot text so if i remember my
haskell syntax
correctly this is the
name of the type and this is the
underlying haskell type
uh and then it can have multiple uh
types and that's why this is kind of
like an or for types
so damn critical listen bro
it's about having standards and that's
why
you're banned
right now it's not about i like to be
criticized too i like to be criticized
precisely
and exactly you know ironically your use
of sodium critical
is a vague imprecise criticism
the type that gets you banned but
precise constructive criticism is great
um string is a t
text fun is an eye funk is that a
haskell type
i guess it has to be
what's an l funk
from iphone i don't know we'll see if it
compiles
um lambda ifunk
mctx well now i just don't know what i'm
doing i'm just typing
we all know what a nil type is and then
bool bool
deriving
typable data oh
now here we define ifunk
iphone call i don't really know what all
this does
hopefully we'll figure it out
all right here we go bull number and
string are trivial wrappers for haskell
values nil is the null type
atom represents variables to represent
an
s expression let's just look into
exactly what an s expression is
um
symbolic expressions are a notation for
a nested list restructured data
so s expressions which contain cycles i
guess they can contain
cycles
okay cool
evaluation method
oh my god this is so complicated is the
other one better
yeah this is way better i'm not doing
this we're doing the old one
i i i did the old one a long long time
ago um but this is i don't like i'm
already confused if they're asking me to
type all this stuff i don't understand
so rmd um most high school tutorials on
the web use a style of teaching akin to
language reference manuals
boring they show you the syntax of the
language a few language constructs
that tell you to create a few simple
functions at the interactive prompt
the hard stuff of how to write a
functioning useful program is left to
the end or omitted entirely
yeah all right now we're talking oh good
good good this looks this looks much
more approachable
let's start with main.hs
module main where import system dot
environment
okay that just sounds like boilerplate
crap main has
type i o i know types when i see them do
args equals get args uh
put sterling hello
i assume that's the concatenation
operator args
question mark question mark zero
all right well you gotta spell
environment correctly if you try to
import the environment you get nothing
all right cool we got a program
oh it's not okay index too large because
we're taking a zero with arc hello hello
hello
maine bob hello bob all right cool
um the type declaration
type declaration the io type is an
instance of the monad class
uh monad is a concept and no one in
haskell will ever give you a straight
answer to what a monad is
they'll tell you all this stuff about
how it's like grounded in some
you know seventh level math man but
maybe this is more to say a value is of
type moan added the class is to say
there's a certain type of extra
information
attached to this value most functions do
not need to worry about these pieces of
information
the extra information the i o actions is
to be performed using the carried along
value
well the basic value
when attached with information is void
represented as that
okay both i o string and i o parentheses
parentheses belong to the same i o monet
type
there's two ways to create an i o action
lifting an
ordinary value into the i o monad
combining two existing i o actions
all right this is what a do block is it
like puts the monad stuff together
precedence of haskell stuff okay cool
let's move on to parsing
oh we're gonna need a parser or cabal
install parsec
drive no it's 18 days old
you're asked to install executables but
there are no executables perhaps you
want to use lip
well let's just hope this works
hiding spaces yeah i mean because like
spaces is like like a
what's ghc main.hs dot slash main
okay gotta compile um
we'll define a symbol which is a parser
char all right that seems kind of nice
all right so symbol is just anything
there and then we're going to write a
read exper
let's type this one out read expert
string
to string read expert input
case parse symbol
lisp uh i don't know where i got the
word lisp from
input
of left error
no match plus plus show error
right val found value okay it's
something
can i like put my read expert what if i
put my read expert here
that do something
no no match list oh it's trying to like
match the word lisp
unexpected l or i guess i can only parse
these things so if i put like a bunch of
stars it's good
would you get an m
i gave you an m
hello found value oh
who knows why it's m oh yeah echo star
yeah that's not a star
you know when the first star you see may
not be a star yes you gotta you guys
gotta pay attention to the songs you
know
uh
[Laughter]
i'll say yeah never mind
um
yeah let's tie more people out let's
boot more people you know
people people think they can do whatever
they want on the internet we need
standards
i think this whole place needs standards
um this is why the moderation problem is
is such a problem
all across the internet a lot of people
have gotten away with terrible behavior
that they never behave that way in
public um the way that i
act on streams is really very similar uh
to how i act in in
in uh
you know life i'm not anonymous my name
is george hawks
um and this is a representation of who i
am fuck you trying to use you know brand
to like you know like say like oh you
got a brand you gotta you gotta act a
certain way
but like some of you guys act anonymous
and you can make a website
here's here's an interesting website
what if you make a website it's like
troll trace from south park
which is everybody's internet comment
history
next to their real name um and
here's here's maybe how it works right
you're either cool with that and you can
continue to comment on the internet or
if you're not cool with that you're
banned for
forever commenting from the internet
again it'd be great
uh facebook and the real name policy you
know
you'd be so not cool with that good get
the fuck out of my channel don't come in
here again
anyone who wouldn't be okay with that
don't talk in my channel
done
ah
[Music]
expert that get args
put spur sterling
breed expert expert
cool all right
we wanted to add white space we're going
to add support for white space and
that's why we had to hide spaces so we
can add a spaces type
now this is all using the parsec library
which i mean this is the kind of thing
where we could dive into exactly what it
is
maybe we have extra time we can
implement a parser
um because it would be fun
but yeah so here we want spaces
symbol
oh skip many one maybe
all right so now we can parse things
that have spaces i'll make this a little
bigger so you guys can all see
who's complaining about the moderation
policies oh let me see this
i'm mentally unfollowing you then
following you back
alright uh
is he always like this yes um
yes sub only mode
uh we touched briefly on the bind
operator in lesson two
we mentioned it was used behind the
scenes to combine the lines of a do
block
here we use it to combine our white
space and symbol parses
however bind has different semantics in
the parser and i o yeah this
can be based on whatever the uh
type is okay cool
so we're back to defining uh lispval
atom is a string
you don't have to do any text stuff um
i mean that was like that was my
complaint about that last tutorial
they're introducing
to me what seems like a political battle
going on in the haskell community about
whether string or text is the one true
thing
like get the noobs early no no string is
the one true string oh no it's slower
yeah watch me n squared concatenate my
strings together in python and not
care um number
integer string string
pool pool all right that seems pretty
reasonable
um this is an example of an algebraic
data type it sold a set of possible
values of type list val
atom list dotted list
cool all right so we want
a thing that parses par
string and i guess parser
list vowel so the output is a list bell
do char so if it's a string we're going
to get a char
here x mini
none of backslash
uh that end quote return
and that's for like uh association
alright cool all right par string
parse adam we can just copy and paste
this in
now we'll type it out it's quick
so this is a lisp atom and we can see
what the uh
i really like all that tabbing we'll see
if it makes me do it
letter symbol so i assume that's a
parsec's version of an
ore so you guys can look up parsec i've
used it before
it's a haskell parsing library
magnetic parser combination star
constraint is an industrial strength
pricing library a simple safe well
documented has extensive libraries good
error messages and is fast
it is it is defined as a monad
transformer that can be stacked on
arbitrary monads
it's also parametric in the input stream
type i don't really know what those
words mean
library for writing parsers and haskell
it's based on higher order parts or
combinators
so a complicated parser can be made out
of many small ones
and re-implemented in many other
languages that's nice
i mean a challenge here would be like
you know i'm kind of i'm kind of copying
here
um i'm just typing what's here but a
real challenge would be to like
translate this into a different
programming language
let atom equals first colon rest return
case atom of uh
cool true so i've seen this before this
is just
scheme syntax uh for getting true
and then um in haskell when you're doing
pattern matching like this
uh this just means match anything
so that's what that does there see if
that compiles
uh oh yeah list i think i made the same
typo last time too didn't i
somebody called me out for it in the
comments
um any advice on how to start with
reverse engineering so you're going to
get a timeout
this has nothing to do with what we're
doing right now um
do i think learning haskell is valuable
and why absolutely not like everything
on these streams it's a complete waste
of time
if you're here to learn something useful
go to college and get an mba and scam
people
um
yeah just no it's not live
big you duckus
parser list val oh god a lift em
i know these things do something with
monads but i don't really know what
number dot read
many one digit
this shows one more way of dealing with
monadic values
it's easiest to read this backwards
since both function application and
function composition associate to the
right
the parsec combinator many one haskell
also has
very good documentation and the stronger
types get the stronger you can make
documentation kind of automatic
well i mean that's sad but um
we'd like to construct a number list
spell from the resulting string but we
have a few type mismatches
first we use the built-in function read
to convert that string into a number
then we pass the result to number which
is this thing up here to get a lisp val
function composition operator creates a
function that does both together
oh okay unfortunately the result of many
digits is still a parser string
so our combined number reads still can't
operate on it
we need a way to tell it to operate on
the value inside the monad
lift m does exactly that so let's try a
little experiment
well oh we're going to have to
import control monet and we're going to
try a little experiment where we'll see
if we get a tight mismatch if i get rid
of that lift then
i mean i should
so yeah it's it's
inside this so this is the monad that
it's inside of and lift
m is applying this function see i never
could have
okay question am i learning right now
i'm not really sure right
i think they have exercises at the end
of these and we'll do the exercises to
make sure we really
you know check my understanding um
because like i can say this but i never
would have known
if i had gotten this error i would have
been like i lift am i i wouldn't have
guessed that right
um cool so there's some uh things we're
gonna have to think in a little bit
um this hasn't been thinking yet this
has just been typing
parser list val
so parse expression just seems to be a
combination
and we'll move this down here since it's
a combination of the previous three
parse atom
parse string or parse number we can get
any one of these and it's all an expert
um so i guess we want to yeah we want to
want to find read experts so instead of
calling this spaces symbol thing
we'll call parse expert and i guess lisp
is just like the name of the top token
or something
um yeah well so i don't need val here
because it's actually not used
okay so let's see if i just make it true
does that work yeah cool
um rewrite
parse number okay well let's double
check
let's take a look okay that works
rewrite parse number
with outlift m
using do notation and explicit
sequencing
with the oh wow i've never seen that
operator before
but let's think about how to do this so
how do i write a comment again with
haskell
comments weird well that doesn't work uh
something like that
there are just two dashes i can do
single line comments yeah okay cool
that's good
um using do notation
and explicit sequencing so what if i
just say something like
do uh
first many one
digit or i say like x and then i say
something like return
this uh
well so what do i want to do i want to
read x
and then i want to call number on that
i think i can actually just that does
the same thing
um yeah so how does that work
cool my god does the same thing um
i don't know how to do explicit
sequencing with this operator i guess
they want me to write another one but
yeah
uh
yeah that seems it seems right um so i
can also
just show like that's equivalent i can
do that as well
uh because i left a parenthesis there
cool cool but i think i think our first
check your understanding went pretty
well
uh i don't really care about this type
i don't really get um i don't know i
don't care about that one
we did half of it our strings aren't
quite
r5 rs compliant because they don't
support escaping of internal quotes
within the string
uh change parse string so that
that gives a literal quote character
instead of terminating the string
oh change parse number to support the
scheme standard for different bases
add a character and a float constructor
uh you guys in the comments decide which
one we want to do here i don't want to
do them all we'll do one
um
full numeric tower well that sounds like
a lot uh you guys can choose from two to
six
and then whichever one people like will
do
all right what are we saying six all
right all right i see a lot of votes for
float
let's do float uh add a float
constructor to lisp val
okay so i think we can say float float
where is haskell haskell float type
oh they're 12 doubles or something i
don't know we'll see first let's see if
that works okay
so we expect something like 3.4 to
compile
oh it already compiled well that's
somewhat concerning
what did it parse us
it would be helpful if we had a way to
print these i think there is a type
what if i you know
found val plus plus show val it's gonna
be like oh you can't show a list valve
um how do i make my custom type showable
haskell make type
showable
no instance from show this val it's like
a way to do this though
oh import debug.trace and then use trace
m
string thank you
um
do you have an associative problem any
friends there
no trace tray
show
bob
driving show okay all right let's try
that approach
sorry tracem
uh driving shell
like that oh hell yeah that works okay
found value number three
oh so i guess it just parsed that
um so that's a little annoying
because i don't know which is going to
what's going to take precedence
parse float do
many digits
why many digits
uh let
atom equals
no this isn't right
it's a way i can like get that whole
thing right
um
i should do i think i can sequence them
with this
and then the haskell function read float
might be useful
so i guess that's the same then as this
so we'll just copy and paste this and
change that to read
float and we'll call the float
constructor instead of the number
constructor
and then we'll add it here so we can
parse float as well
variable not in scopy hey probably
because i need to like import it or
something
numeric dot read float orders need to
import numeric
no module named numeric is important
import
numeric
couldn't match type float with
actual type double string
i don't know how i feel about that
why is it a string oh read float must do
some fancy shit
reads an unsigned
real frack
is that the wrong read float
no i'm starting to write read flow
yeah hugo
so we want something that's going to
take in a float taking a string
and return a float isn't that right
floatmer maybe he's not a haskell type
maybe doubles the right answer
read double oh this is from some bio
library though
well actually i should be able to type
read float into google and it'll tell me
stuff right
oh god what's a red s
reads an unsigned real fraction
um i don't know reed didn't have these
problems
a parser for type a and returns a set of
possible pairs
can you put a show there no of course
not there are like ways to
uh see something that's annoying about
haskell how do i debug
i think i can just use read as long as i
can infer that i'm parsing a float okay
let's try it
ground value float 4.0 great well that
wasn't exactly the float that i wanted
eh
i mean i guess it parsed this and then
well all right let's first do a little
test what if i do string x all right
that should
why did it get a four where'd it get
four
oh it like didn't it didn't concatenate
these
so reed might actually be correct but
i have a problem here with my
concatenation
um
so like let atom equals x colon colon
y or plus plus
um there's probably a better way to
write this
let atom equals and then we'll check to
make sure it's working as a string
we don't want that we want that
okay now it's saying 3.4 so now we can
return
float read adam let's go cool
do i need that i don't need that
beautiful
um
oh we don't want to ignore hs
cool
drops the intermediate values is there a
way not to
you can try with a tight hole to debug
your types
yeah i've seen that before thank you for
subscribing
my philip 3 um
cool all right we now have float support
uh next we're going to add a few more
parser actions
uh so we should be able to parse a list
parse list is a parser this vowel
parse list uh this is using the lift m
syntax again
but i think we're pretty comfortable
with that
uh sep by this must be parsec stuff
parse x first braces okay the parse
expert this is actually
down here in the hierarchy
uh the dotted parser list is slightly
more complex
parse dotted list is a parser list bound
do we already have
support for these things yes we do in
our algebraic data type oh that's
beautiful
i'm going to start getting some scheming
soon parse expert spaces
i don't know what end buy is maybe does
google support parsec
yeah n by parses zero more
okay that's fine yeah zero more and then
i get it
separated and ended bicep
uh char
spaces yeah so it really is only doing
it's only doing the parse expert these
are being thrown away
and that was my bug and that's why i had
to write that but i'm sure you can write
it much better
um keeps them and you can bind them in a
lambda
well that's that thing that i didn't
understand
see you saying i can do this
well let's uh let me comment it out and
see if we can write a better version of
parse float
always be improving yourself always be
improving a b
c improvement doesn't start with c
george says so many wrong things on the
stream
uh so we want to use this guy
oh let's list val again
uh my car is not the best guy let's
finish writing this one out the turn the
type is dotted list
head tail
it doesn't work
the function on the right hand needs to
accept an argument
so many one digits
that thingy well
no but see i don't think that's gonna
work because char there
is um i need the char i need the actual
dot as well
i need the dot you know what let's let's
let's uh let me post this to github
and then uh you guys can do we can do
some live pull requests on here
um you know what i'm gonna uh
should be able to not not that i'm gonna
hide my screen for a sec
while we do github
you guys can see me though while we do
github um
so what should we call the repository
haskell haskell scheme
uh haskell scheme
writing
myself a scheme
in way less than
48 hours should we go on all night boys
we got two things of tea
let's go let's go
all right so somebody can post a link to
that
uh and now we can bring the screen back
yeah buddy
uh yeah i've seen rebel autograph all
right
uh so now we can go over to my github
anonymously uh yeah haskell scheme
uh we should actually write a quick
readme just to give
credit where credit is due following
make sure this link works
cool tutorial
cool
all right we'll let you all talk again
uh and we'll see
uh said zero f congratulations you're a
moderator
you said smart things
and if the dumb things come back we'll
go back to the subscriber only
and one of these days i'm not i'm not
sure what i'm going to do yet
like we had a quiz and to be honest not
enough people passed the quiz
to do it only people who pass the quiz
can talk
uh but one day we are going to do
something about the general level of
dumbness in the chat
um i'm not i'm not a partner yet
uh i got to do like three more streams
this month and then we'll see if they
give it to me
uh if they give it to me i'll be more
active on twitch if they don't give it
to me
yeah remember that time i was a twitch
streamer
everyone's got to have a career doing
something man some other guy in the
things was like i don't like when this
guy is always chilling for subscribers
does she not
have money uh and the answer to that
is yes i'm broke so please subscribe and
the real answer to that
is you subscribing gives me validation
that i'm doing something good
it's like following but it costs money
and it's just you know it's like it's
like it's like praise man
you know and i appreciate praise uh
who doesn't appreciate christ but also
you always wonder you put something out
of the world and you're like is this
thing
do people like it or not
um
i know no i understand people on twitch
are all like this
uh it's not i know it's it's not my
channel but what i'm saying is
i want my channel to be a a is the word
respite
respite respite you know yeah
a respite from the siege of the
terribleness of the internet um
whenever i use words like i use words
that like come into my mind
and then like does this word means what
i think it does and then i google it
does this word mean what i think it does
yeah
that's what i meant to say um
cool we did that
uh we got to add single quoted syntactic
sugar
what is this note how we can sequence
together
and then yeah that's cool
the sequence returns a parser and then
combining that with a parse expert as a
parser list val exactly the type we need
for the do block
now let's add support for the single
quote
syntactic sugar
let's google this
uh when you single quote it oh it
doesn't evaluate it okay
i've seen this before
um and then oh what's the structure and
interpretation of computer programming
yeah you know would be really cool if we
do this
book um it's a free book too i believe
actually i think i have it in my ibooks
do i have it in my ibooks no i don't
i also got another book today
recommended by martin shkreli margin of
safety
um yeah this can we get the pdf of this
so this is a thing written in scheme i
just want to quickly look at it and see
if the scheme
looks uh similar to my scheme
oh no i do have it here structure
interpretation key program is cool
um yeah i went through this a bit when i
was playing with backspace
uh
yeah this looks like my scheme we should
try we should try some of the examples
from this book
in the scheme just so we know that what
we're doing is not like
you know some it's something real that
exists outside
of just being in this tutorial
and it's not all made up it's real
programming boys
real programming uh structure
interpretation computer programming is
like uh
one of the freshman books at mit um
i think it's pretty good remember if the
book's more than
let's say if the book came from earlier
than 2000 it's probably good i'd like to
survive this long
finally let's add
our definition to parse expert to
include the new parsers but
put the parse expert calls the things
which also calls
parks expert that's too much that's too
much
man it's too much it's too recursive
will this ever terminate you can't prove
it anymore
oh man this would be so terrible see
that's why i'd be so terrible to doing
like
something non-turn complete like cock
like i'd have to show that this
because it's recursive right parse list
calls parse expert which you can call
parse list
so you have to show that the total
number of unconsumed characters is
what what is this spam
oh the other thing that i wanted to talk
about from the previous stream
you guys i wasn't ripping on web
developers
it wasn't web developers who i was
ripping on when i was talking about crud
apps
you know you want to code front-end
stuff there's some incredible front-end
stuff i do not want to hate on front-end
people who i want to hate on
is the people who make themselves
subservient to business people
the people who see themselves as like
you know someone's like oh is fang all
crud apps
well think of who you you're you're
you're putting yourself underneath
right um that is
is who uh i'm complaining about when i
complain about the crud apps or like you
work for some government to make some
like stupid forms so somebody can
upload some identity card or something
like that's that's what i want to
complain about not uh
not not the use of a certain type of
language to create
you know web apps also okay i guess i
also want to complain about like the dog
walking apps and these kind of
no you know
like it's it's just it's just it's just
crud
okay parse there return
x all right so we should now be able to
parse a list i believe
misty oh no
unexpected space oh no i think my floats
broke it
my floats broke it we're gonna put the
float down there and it fixes it
but then i don't think my floats work
anymore
yeah i think um
maybe try parse float
yeah yeah remember that you gotta do try
yo sometimes you just gotta try now
we're talking
all right that's nice all right we can
make lists
let's let's bring up our structure
computer programs
um and like see if we can like do things
like that i don't think so because i
don't think we can do symbols yet
um whoops
sorry
i don't think plus is gonna work there
oh adam plus
wow fancy boys look we're parsing all
these thingies in the real book
i think we can even parse 2.7 and 10
thanks to you guys choosing floats
um
who's spamming bullshit mods can we take
care of the bullshit spammers
you know what you know what it's just it
gets lower quality it gets lower quality
we actually had someone who knew stuff
about haskell in here talking like
that's pleasant you know know something
or get the fuck out
that's right wow
imagine that as a principle of society
know something or get the fuck out
wow that'd be a nice society man
cool and we can check our dotted lists
too i don't exactly understand dotted
lists found
value dotted list yet and that's nice
okay
um which of the exercises do we want to
do
does he use try in other places oh yeah
try parslist yeah
oh try parsnip and par that should work
yeah that's nice cool
um
so which one do we want to do do we want
to do add support for the
back quote syntactic sugar
i kind of hate back quotes because that
quote is my
thing in scheme and every time i want to
back quote i have to press back code e
uh add support for vectors
a vector should have oh that looks too
hard
no never mind these all a card
you guys want to do i don't understand
let me see what vectors are
these might all be bad we know it um
vectors
are heterogeneous structures whose
elements are indexed by
integers now this is this is too much
it's too much
too much we're not doing any of these um
well let's see how bad let's see what
that quote is
quasi quote qq template
are you looking for constructing huh
i don't really get it
wow it's amazing we're seeing we're
seeing uh spam by
subscribers get out
you know to think you spent your
hard-earned money and now you can't even
post here anymore because
there's got to be i mean just because
you have money
doesn't mean you're allowed to to write
dumb shit
um yeah i don't know in fact
i don't know what vector is i didn't say
no everything i said no things
um and be honest when you don't know
things and go learn things
don't ask dumb questions like where do
you find
motivation and did i tell you my stupid
story about that yet
once upon a time i was idling on a
twitch channel
and i asked the guy where he found
motivation and he gave me a really
deep answer
yeah and now we're never going to repeat
that answer so i hope you guys heard it
hacky hacks thank you for subscribing
i don't understand what these things do
we're moving on we're moving on we're
moving on
we want this scheme to actually run
stuff soon so we're going to start doing
some evaluation
um currently we've just been printing
out whether we recognize
wow i don't know if we need this
i wrote my own show and i like my show
actually somebody on the stream told me
driving show and i appreciate deriving
show man you're a good person
um
onwards list instant read expert
found show value i already did that yeah
cool so we can just have parser here
unexpected single quote didn't i write
single quote oh did i not include parse
quoted
i had to like include this somewhere
didn't i
right there cool
yeah adam quote number one number three
list that
i don't know i kind of like that better
what did i add
beginnings of an evaluator primitives
okay cool so
let's go put this in a different can i
put in a different file
i know how to do that so we won't do
that just put it here
we'll write a couple comments data types
here we'll put parser
and here we'll put
eval eval takes in a lisp vowel
and it returns a lisp val eval
val at what does the at do
the notion val at string
matches any lisp vowel that's a string
and then
binds val to the whole list val and
notches the contents of the string okay
that's cute
so this is a normal like uh what are
these things called
this is like a type matching
comprehension there's a real name for
them
but if it's a string it matches that one
if it's a number
it matches this one it's a bool it
matches this one
and if it's a c but now this one's going
to be different we're not going to use
the add syntax
if we have a quote val then we just
return
val which i don't exactly understand
let's
the quote means like make it exactly
that and don't evaluate it
quote yeah return through without
evaluating it
cool i don't like you but
man i do enjoy your content get banned
wow you know didn't your mother ever
tell you if you don't have anything nice
to say
don't say it
now there's a there's an exception to
that which is
if you have something nice to say but
you don't it's not nice but it's true
true supersedes nice but your opinion of
whether you like me or not
that's not like true or false that's
just that's just bullshit and that's why
you're banned
i know but like it's stupid man it's
stupid
you know do we want just think think
is the channel better or worse for never
having that guy post again
and i think the answer is better
when we change our main function to read
an expression
get args uh oh wow this is a lot of
oh no get args
print eval read exper head
what okay so that's already head there i
don't even need to change this that much
i can just do eval here can i
uh like x equals eval expert
oh no i want to do read exper read
expert expert and then we can just put
out the thing that we evaluated
cool could not match type
io string with type list val
oh yeah um so let's do
show there and then we want
read expert to return a lisp vowel
oh that's cute so now the string is
actually an error in the language
yeah that's nice all right
i gotta spell lispval correct and can't
keep writing list vowel
could not match statement of type i o
with type
list val but read expert should take in
a string which exports a string type
it's because i have a dewblock or
something
okay maybe instead of here what if i
just say eval
uh read expert expert and we don't put x
there
oh no we're gonna need a show we need a
show that's the problem
i had a show there though um
read expert expert yeah that's good cool
uh so now it's going through if you
notice my quote here went away
because of this uh pattern match here in
my email
cool that's nice
um oh yeah now things are getting
exciting
watch this boys watch this if we try to
like add two plus two in our scheme
yeah non-exhaustive patterns and
function eval because we're going to
have to implement
a plus and now it's time to implement a
plus
so if we have a list with an atom func
and then args
so what this is doing is this takes the
first
item from the list this is the rest of
the list
we're going to apply is apply a haskell
built-in i think it is
yeah i don't know
uh
i don't really get it but whatever
apply funk map
eval args
well oh no i gotta write apply
uh so actually you know what let's just
try to write apply without reading ahead
so we want to apply this is an
atom a list val
and it's going to return a list val
if the atom is atom plus
um no this is actually a list here
is that this the syntax for lists
um equals
so like x and we can say number
some x
uh not in scope
well let's just try that for now
not in scope adam uh yeah and
wait what why is adam not in scope i
don't get it
list adam plus
non-exhaustive patterns in function eval
okay
so that matches that pattern oh
it's not an atom it's a funk is
actually being taken here so it's
actually a string
so we don't actually need the word atom
here we can say string here
so like that
couldn't match type integer with actual
type list value yeah we're gonna have to
unpack them
yeah so the problem with those x's is
their list vowels
so i mean i could i could like i could
write a little helper function called
like on number
which is stupid but goes something like
this
uh and it is number right now it's
integer
um
a number number x equals
x and i think if i say like some map on
number x
that works construction number should we
have one argument yes
it's gotta be putting parentheses
okay cool so that did return four i do
think there's a nicer way to write that
but you know i think we're pretty good
on the check our understanding okay
so we got the type for apply correct
um apply
funk args maybe
bull for false
oh fancy
maybe cool force what is a haskell maybe
it's like a type
here's the function maybe if the
function isn't found
we return a bull false but otherwise
this is a look up
okay
i don't know where it looks that up
maybe is applied to too few arguments
oh this isn't a comment wow
wow that was that was look up
funk primitives oh i thought this was
like a comment
i can't see all right um so now we have
primitives which is this data type
that's kind of like a map data type from
string
uh it returns something that takes in a
list and returns a single value
it's pretty nice and then we can write
out some of these primitives
uh here we have plus
i guess that's a numeric bin op
of type plus
we can copy and paste that not much will
be gained from typing that
all right
um i think numeric bin op is a function
that we're going to have to write
oh we got to put an equals there oh i
got to tap that over one
cool uh variable not in scope
okay so numeric been uh look but it
tells us the type how beautiful
your integer integer
okay
all the integers
oh okay that's actually a function here
so we'll just say like f
args actually
we know what the r's we want to match
are number
x comma number y
and then we'll return f x y
uh
uh oh we have to return a number
numerical
is that right
this character oh tab character oh god
and
haskell hates tabs as much as i do
set et
cool
now let's check how closely i wrote that
to what they wrote
seems pretty good um
oh well okay that's kind of nicer well
they actually wrote an unpack
numb that's kind of that function i
wrote before that i threw away remember
this vowel integer
[Music]
we'll just do that for now um so they
called it
op and they're using fold l the problem
with my implementation here is it only
supports two
arguments uh my other one didn't because
i did
some but uh fold l1
op map unpack num on params
cool now two plus two
that still works we can also add a three
in there then we get seven oh that's
nice sexy bros
all right um
we implement a form of weak typing i
don't like this week typing
no weak typing
you'll throw a type error at the haskell
level about incomplete patterns
um so let's see if this works
i'm gonna nest shit and see if we get a
five oh yeah five
yeah let's see if this works
change unpack num so that always returns
zero well that's what i want to do
anyway
that's right everything else be a number
or be
zero
add the symbol handling functions
add primitives all right which one
should we do
what's your keyboard wow
do you listen bro you get a timeout
maybe you just you know don't listen
you guys want three
one
uh
yo what's the mouse boss california all
right all right
uh why do you think we're talking about
the singularity
i think zero for everything else is
related to nil
punting i don't know what mill punting
is i just didn't want to write that
other code
because i think it's ugly and i think
that you know get your types right um
yeah i don't know about this okay uh
what do we want to write
we like one or we like three
let's let's write let's write one let's
do one one looks pretty easy
hey guys you all want three all right
can someone explain to me what three
is add symbol handling functions
returns true if
obj is a symbol
are they like atoms
symbol is what we've been calling an
atom
okay okay we can give this a try
let's see what we got symbol
question mark foo
false but foo is supposed to be a symbol
what is just foo it's an atom foo but i
don't understand
oh
so like
but that's an atom plus
return
whoa wait this is a lot of functions you
guys want me to write
i like eq that one seems like something
we can implement i like eq
that should return true
how does it know to return false
where is that false oh that's just in
the maybe okay cool
um so we'll add some primitive function
uh eq
we can call it
um compare
it's a bin op i thought a bin op only
took in two things
i don't know compare been up
uh we don't actually need to write the
type for this one
let's say that it's only if we have atom
x
atom y in the list
uh otherwise it returns
false equals
bool x equals equals y
variable not in scope oh
let me just compare it up oh i don't
have an
op i don't know
i mean that works right non-exhaustive
pattern and function eval
we'll get it though this should be a
funk
lookup funk primitive eval which
this should be an atom i believe we
can't eval an atom but that's an atom
fine
um
be bites back thank you for gifting subs
to people
i appreciate you you are a good person
go imagine mr beast came in here and
gifted
everybody a sub
uh you know
uh bee bites back if you have a question
i will take your questions seriously
you get a real answer won't even try to
troll
what do you think of pvm well i don't
know what pvm is
oh virtual machine
um
is a tool for parallel networking of
computers
it is designed to allow a network of
heterogeneous unix computers
to use the single distributed parallel
processor
so my immediate
thought about this is
what you the main problem you have here
um so even even within a dual xeon
system
it's a pneuma architecture it has
non-uniform memory access right
so the problem with
with doing this is you have different
bandwidth links to different parts of
your memory see i want
multiple processors to act on the same
bit of data the question is where do i
store the data
well so i have a few options i can store
the data on one machine probably local
to let's say one of the processors
but then every time the other machine
wants to access that data
it has to go across the network and the
network is much slower than the bus
that links the processor to the memory
um
so you can another way to deal with this
is to have two copies of the data
in the memory of both machines uh but
then you need some way to synchronize
them you're gonna need some kind of like
uh caching mechanism uh what do they say
there's two hard problems in computer
science and one of them is cash
invalidation
so that's my like analysis
right away of something like this like
it can't exactly be
automated um pvm consists of a
runtime environment library for message
passing task and resource management
so yeah i mean as a anything that's a
library libraries are always nice
um but i think there's there's like
mpi yeah and i've seen or like m-p-i-c-h
you know build your beowulf cluster
uh but yeah so i don't know what the
advantages would be over
uh something more modern that kind of
does this but there's no way to do this
for free
it's always going to be somewhat tricky
to uh
use um
you mean a different pvm well okay now
let's look at this pvm
predictive vision in a nutshell
but see when i give a real analysis on
something without troll look it's like
real
so let's um starcodex has to say
there an archive post or something
unsupervised learning from continuous
video um so my immediate thought is okay
it's gbt3 for video
and of course gpt3 for video works
really well now actually build it
let's see what actual results they got
so one of the problems in general with
video prediction
and i'm not sure they deal with it in
any kind of good way
is what's your output space
uh so if you're if your output space is
images what's your loss function on
images
something like msc or mae probably
doesn't capture what you want
you can use sophisticated things that
try to capture structure like ssim
or you can use gan style loss functions
which are unstable
um so that's my first thought to this
uh and then another great way to
immediately evaluate any machine
learning paper
is look for the actual benchmark that
they
are um that they are state of the art on
so they're going for tracker benchmarks
okay compared it with these things
i'm going to archive for that i'm sure
github is still up
there's brain corps
how did they get outputs from this thing
so what's their actual loss function
primary signal predictive so
i don't know why you need all of this
complexity
um what's their
real loss function
i don't know um so
i i could spend if i really wanted to
dive into this paper it would take an
entire stream
um all video prediction things
you you have to ask a few questions uh
one is
is the is the prediction that they're
doing
context specific or context free um
at comma when we build models which
effectively compress
driving video we ignore things like the
trees
um and we do this in an unsupervised way
because the trees are irrelevant
the exact shape of the trees are
irrelevant to how to drive the car
uh so if you're building things that
just predict video
humans don't really do this humans
always have our specific context in mind
um so i'm not sure like if
they do that here uh
and then the other question is are you
reasoning are you trying to predict an
image space
or are you trying to predict in some
vision feature space
i think that predicting an image space
is the wrong idea
uh because i don't think they're doing
image space
i think it's something else
uh but if you ask the question
can you build gpt3 for video it's a
classic link you think oh gbt3 you know
what if i just took all the youtube
videos and put them into one huge auto
encoder
um well so unfortunately you don't get
the beauty of gpt 3's loss function
uh gpt3 is just this loss function
um it's categorical cross-entropy
category cross entropy is is a
beautifully simple loss function
that can be used because there are not
that many tokens in your language space
even if you have like
uh you know 8 000 right that's that's
only 8 000 dimensions
of output versus for video
well it's not even it's it's
not even the number of pixels because
what you're not
capturing there is joint representations
even if you had an output for each pixel
which is way more than 8 000 dimensions
what about in pac-man where a ghost
could go to the left or a ghost could go
to the right
right that's the you have to capture
that joint distribution
not blur the ghost both ways
um
[Music]
you don't care about gpg3 why not
well it's not rude to say you don't care
about gbt3
when you took the time to explain it it
is
don't let the hype interfere with what
it actually is whether it's over hyped
or under hyped or whatever it doesn't
matter
why do you think it's not really solving
anything i kind of think just scaling
those things up and you're going to
solve the turing tests
and it's going to be a late it's going
to be a sad truth about humanity
that most people i mean here's a
question
how many people are already worse
writers and dumber than gpt-3
and then what gp3 gpt is going to get
most of humanity
so
uh
yeah i mean i don't know gbg3 is
probably higher quality
than some of the commenters um in here
okay non-exhaustive
pattern match in function eval
why is that why is this not a list with
arcs
it is a list with arcs and the first one
is an atom i don't get it
i don't get why this isn't exactly that
uh
oh because i'm mapping eval arbs okay i
think
i'm not sure why i didn't have that it's
probably some good reason okay that's
true and that's false okay cool
we wrote eq
i think parsing floats was broken by the
eval stuff
oh well i got an eval
float
uh yeah let's see can we add two floats
zero that's right that's right zero
um oh no
unpack num
yeah well you can't add floats add only
works on integers
yeah yeah you can add three and three
but don't add 3.4
and point four
um i don't know i mean gpe three starts
to show where the problem with the
target test as a formulation is
uh ben gortz will propose the coffee
test and i prefer the coffee test
we don't need error checking do we this
seems like a lot of stuff to write
for just errors
um i prefer the coffee test it's can you
build a robot that can go in the average
american's house and make a cup of
coffee
12-hour type mismatch
yeah i think errors are boring let's go
on to evaluation part two
additional primitives
these seem pretty useful
a wozniak proposed the coffee test oh
even better
uh let's let's just for correct citation
uh coffee tests ai
damn it is wozniak that's crazy
oh gorgeous yeah you know what that
doesn't even
get go you go get a degree in some
post-modern shit
um damn cool
uh i love you know reading about like
apple history growing up in wozniak
it's cool
i need error checking no we don't need
error checking that's boring
we'll add some error checking if errors
become a real problem
for now
let's add these guys for more evaluation
um
these both take exactly two arguments
yeah see but we don't have errors so we
can write this simpler
unpacker op
x comma y yeah
equals do left unpacker
oh we don't even need this we can just
saw it so much simpler when you don't
have errors
that's that numbers turn
cool left
turbo bin up unpack
stir and then
bubble bin app unpack pool
i'm gonna have to write these as types
here
we believe in strong typing
unpack stir
string s
return ass
um cool
couldn't match m7 list valve with list
val
i want to do wrong
all right all right we're we're over
talking about gbt we're we're talking
about that we're we're working on
something here boys
um
bin up oh it must not like that these
types don't match
um
no it's the return types that are wrong
let me just write the type signature for
bull bin up
uh so we take in this thing called an
unpacker uh
which is a list val
and returns i guess type a
a a bool
list val
it seems like errors went away since i
wrote that
maybe i had to write the a for the
polymorphism
this is the right case wrong and you
should have unpack y
oh yeah absolutely good catch
uh that doesn't explain what this
problem was
this just doesn't like these things
or my bull bull bin up is broken
two left
and packer x on packer y
let's type m1 bull
uh so this is a
unpack pool which goes from a lisp
val to a bool and this goes from a lisp
val to a string
let's add some more type so we can get
some better errors
couldn't match type char with char
huh
why do i need to return here i don't
because i'm not doing stupid throws
errors i can just do that
yeah now we're talking
couldn't match expected type list val
i don't think we need all this complex
stuff because we didn't do errors
can i just say uh bull
x up why
oh no we do need to pass it through
unpacker
yeah oh look our shit's so simple
because we didn't write anything
stupid oh well too bad three's not equal
to three i mean it'd be nice if three
was equal to three
but oh true also doesn't equal true so
you know we got to fix these things
equals equals actually isn't uh oh it's
not equals equals
yeah that's true but true oh it equals g
oh true equals false oh it's not good
um
equals three true true equals four false
oh yeah now we're talking
but i don't know why true equals false
that's not good
oh how we doing on look at some viewers
well
you know you guys like when i rant about
stuff i think more than actually
coding
free the pleb so we can spam that's not
that's not
appealing
i'll free the plebs if somebody figures
out why true equals false
i guess there's not a bull bull been on
for that
it's a number been up oh and they're
both getting set because they're being
parsed as numbers
oh i don't know
let's be a little more fair to the
numbers
and say because if i actually if i do
that i think that's going to return an
error
yeah non-exhausting pattern matches just
because i was nice with that
but if i say unpack num bool
let's say bool true and i return
one and then false i return zero
true no longer is equals false and since
i did figure it out
i will free the plebs and we'll see
if the plebs have anything to say or
they're going to talk shit
only be fade thank you for subscribing
what is your profession
a garbage man pizza delivery man yeah
pizza delivery
false equals false that's good
um let's let's go over to our
uh book here and see if our
things work um too bad let's figure out
where our floats don't add
let's figure out how to make our floats
at
non-exhaustive pattern match and unpack
numb oh
well instead of
integer here
i mean can i do that
hmm can't do that
yeah see that's a problem
we can't add our floats
cool that stuff works
let's see if this big long expression
actually gives us 57
naming the environment a critical aspect
of programming languages
the means it provides to use names to
refer to computational objects
in the scheme dialect public scheme
dialect of lisp we name things with
define
oh we're gonna have to make it define
cool false great
uh i don't like the way they did errors
in here they're very complicated
carl oh you're building a rebel oh rebel
would be nice
that sounds pleasant
let's add a raffle
um
flush string
read prompt those seems
like
it's a lot of functions
putster prompt
h flush standard out
and then we'll call getline um
errors are stupid
string io string eval string
equals return it's just
this um show
eval read expert extra
uh and we're gonna have this take in
extra
so then i should just be able to say
here put sterling
eval string extra doesn't work
actual type i o string
well because we returned it so it's in
the monad
this should keep it in the monad i think
yeah i know how to mow man all right
um and a function that evaluates the
string oh
look yeah oh we can use this oh that's
what that thing does
oh yeah haskell level 9000
yeah all right
so we want to put it in our loop
wow
eval and print that seems like a nice
thing
all right that noise is getting annoying
eval and prince takes in a string
and returns an io monad
all on its own so we can just
eval and print expert
um yeah cause that's not right
uh equals eval string
exper poster
57 cool now it's time to tie it all
together we want to read input perform a
function and print the output all in an
infinite loop
the built-in function interact almost
does what we want
so we need to roll our own loop
until pred prompt action
do results prompts
if tread
results
then return from the moan ad else
action result and then
call it again action
and then we'll just change our main
uh to do until
equals equals quit c don't you love the
currying of functions
uh we love carrying read prompts
let's bring that down here
put that in this section
[Music]
called rebel
it looks stupid when it's not
capitalized
compile error because i did oh uh
until quit we want to
read prompt list that's a stupid prompt
eval and print which is the function we
run
all right we have our lisp oh we have a
lisp
no match
oh number four look at our lisp
oh yeah oh if only we had those
oh that'd be nice what do i do rl rap
yeah rl rap boys
we'll do a run.sh
cool
who's saying wow
what are people arguing about yeah this
chat needs some moderation i agree
uh or maybe you should just get off the
internet zzyx
get the hell out of my channel uh you
know and people always are dming me
who's being racist do you want to get
thrown out too
um people are always dming me yo dude
can you unban me
no
please go and sub only
yeah yeah it's too bad it's too bad why
we can't have nice things
uh you know
it's too bad
welcome subscribers
no they can spend all their channel
points if they want to spend their
channel points and they want to say
their one thing
they can say their one thing and spend
their channel points
yeah look it's beautiful my list is my
scheme is
beautiful it's only 172 lines
oh okay they made oh adding variables
and assignment oh this sounds like the
kind of thing we need
in order to get through our book because
we have naming in the environment
oh this is all going to be hard though
wow how many sections does this book
have
we're making some progress
all right you know what we're disabling
channel points
help channel points guide
yeah i'm sold i'm sold you guys are
subscribers you're good people what are
channel points people do
how do i disable this
moderation
disable channel points channel points
here we go
how to earn channel points some
managing channel point rewards
get a dashboard and proceeding to
channel points under the community
section
oh um manage rewards and challenges
uh oh highlight my message oh yeah
that's the one that can go
uh send a message in sub-only mode no
that's okay but you can't send messages
in sub-only mode
damn this is pretty nice well you know
what
i have a better idea you can but it's
gonna cost you
seven million channel points
seven million channel points
do you have 7 million channel points oh
that's what i thought you can't send a
message in sub only mode
please stop so you could spam you would
really suck if you subbed and then got
banned
that's why you don't spam
what an easy fix what an easy fix linux
with
five underscores i agree
okay we're gonna need an io and m
oh this looks hard oh this looks hard
oh it's got to take in an environment
now
oh this looks complicated
um
no this is gonna this is gonna be fun
this is gonna be fun
we're having fun here right we having
fun
let's let's drink some we're only
halfway through the tea
let's let's drink more tea let's take it
let's take a
two minute break and then we're gonna
write variables
and then we're gonna write some real
programs in our scheme
it's cool like how simple this is gonna
be when we're done we might have to
write errors but i don't like the way
they did it they added errors to
everything uh which might kind of just
be a limitation a haskell
but our scheme is doing so much nice
stuff already
richard l thank you for subscribing
oh we got it we gotta your twitch mods
are getting ridiculous
apparently any dissenting comment is
ground for time out and warrants the
leading of said comments
by the way the comment was
i don't know i don't know we're big on
censorship in this channel
you know what i mean this is a small
community we love censorship
kind of push to get up we just did
um no i mean
in real life you can give people so much
more of a benefit of a doubt than you
can give them on the internet
i think this is one of the problems with
internet communities period
and it kind of sucks that
like the real the moderation of internet
communities has been given over to these
companies who have no taste at all
um let's see what the pms say
okay thanks uh
no but i've been thinking about this
maybe this what we're gonna do on our on
our break
i've been thinking about this i've been
thinking about moderation
and how to build it's an age-old
problem it's politics
how do you build a good community and
the the politics that are in vogue in
silicon valley are kind of tasteless
uh so so far what we've done and there
happens to be a button for it is
subscriber only and
it's true that the person who subscribes
um at least has a credit card tied to
their accounts they're a real person so
they're less likely to say stupid things
i don't know how to do sub emotes
uh they want the revenues they allow all
people to twitch
yeah yeah and there's no i mean there's
no taste right
they value their value profit over taste
i mean there are some smaller internet
communities but i feel like they're kind
of dying out
um so two hypotheses
uh one hypothesis
i think i think actually i think i know
the the reason for this
um the average iq of the internet has
fallen
precipitously precipitously over the
last 30 years
69 operator chase quixote thank you for
subscribing
more people the bar is lowered yeah
you can create pockets yeah um
and we've got to be more deliberate
about how to do it
so if we go back to the quiz
only like six people did well enough on
the quiz
and this might be a
are there any communities we need to
pass a quiz to get in does anybody
like know about any online communities
one of the problems with personality
tests
is iq tests
you can't um a personality test
someone without the personality can game
it
uh if you actually have like let's say
you want like high conscientiousness
people right
if you if you want um or or agreeable
people
uh people know how to fake those things
you can't fake intelligence
i mean no but this isn't supposed to be
mensa
mensah is deliberately a
a intelligence based community
that's not what i'm going for here what
i'm going for
is a who's going to make intelligent
comments on a different
topic
what was the window to take the tests
one random stream we offered a test
oh the dms all the dms are there the dms
are all there
nope not clicking on any of you oh i
could i could click here
i could click ah but i'm not going to oh
but yeah i'm not going to
um yeah the turning paper annotated
tarring is nice to read
it's kind of hard to test people and
give them a fair chance
yeah i know they're so close their names
on the screen
change your username then you can get
some words on the screen
i mean no so i think you want a mix of
both i think you want a mix of
i think that in communities you want a
mix of um
so i think there's two things that are
acceptable to discriminate on
you can discriminate based on skill and
you can discriminate based on
paying money um if you think about how
like job interviews discriminate based
on skill college allegedly does
but it's you know actually based on
usually
uh racism or nepotism um
but you know theoretically it should
just discriminate based on skill if you
think about a bar with a cover charge
uh bar the cover charge is
discriminating based on
money so i think you do want both
we want both smart people and uh people
who are willing to contribute resources
it's not a question of their actual
wealth it's a question of whether
they're
willing to to contribute uh they're like
look you know i understand
that i might not be as good as the other
people here but i'm willing to
contribute
you know this right um this is the
classic
uh don't buy a girl drinking a bar
because what you're basically saying is
hi i understand my value is lower than
yours
but how about me and this appletini does
that level the scales a little bit
uh not saying don't ever buy a girl a
drink but don't open with that right
i didn't even count all the questions on
the test did i do something wrong i
might have done something wrong
uh but i don't think i was i was
i'd like the chat to stay on topic
what we did today was extremely
approachable
everybody could follow along with this
no i'm not gay and why would you ask
that say dumb shit like that again
and you're out of here
you know i don't care if you're a
subscriber you're banned
yeah today i mean i did it it is new
blessings i tried to make something that
was
followable today thank you for following
along
um
a question like what programming
language did you learn first i don't
like that's not a good question um and
it's not a good question because it's a
question that's
like it's totally meaningless i think i
said a few times how
i try not to talk about myself on these
streams because
my idiosyncratic life path doesn't have
anything to do with
skill it doesn't have anything to do
with anything that's real it's the same
thing with keyboards and terminals
and
um so what are examples of good
questions a good questions are questions
that lead to the discovery of truth
um like when we looked at that when we
looked at that paper earlier the
the the video predictive one yeah what
are your
well yeah what are your thoughts on
i mean honestly even what are your
thoughts on can be higher tier
than uh what programming language did
you learn first
um what is truth so truth is something
that if two people uh were to sit on
their own
uh and research something they would
come to the same conclusion
well let's say n people it doesn't have
to be two right it's something that is
objectively
discoverable through the universe
uh no i mean let's ask the internet
that's that's kind of my definition but
uh so another definition that i have for
truth
is anything that has predictive power
no truth isn't subjective opinions are
subjective
uh you pointed out that cs education is
bad i haven't done that into tetris
i think it's a similar sort of idea and
it might be a good test it might be a
good it might be a good course
yeah truth's not subjective this is
people who want to sell you hogwash you
know if you want to sell snake oil
instead of medicine
start out by telling people truth is
subjective
truth conforms to reality but maybe and
then you can maybe put a kind of value
hierarchy on truth and
the truths that allow you to predict
um the future are valuable
this is you say this is straight from
oh substantive revision
see i'm concerned about that revision
but we're all here we're all here
discovering we're all here together
science allows you to predict the future
so science allows you to compress the
past and if you can compress the past
you can predict the future
the book is writing a scheme in 48 hours
uh the
[Music]
on my github
it's here um
i don't know i'm
yeah please follow me on instagram
we're all on a journey of discovery here
together about where we want to end up
taking this channel
i saw something
one of the comments in the last video
was like
george is becoming more of a cult leader
every day
my only thought on that is well what if
we live in a world that no longer
believes in truth
but there's a cult that does believe in
truth
you know who's the cult
usually usually cults are are uh
demarcated by people believing dumb shit
like comet hail bop is going to beam us
all up to the starship enterprise
um you know and now people believe dumb
shit
like uh well you know uh
biological sex is a social construct or
something like that right
i mean yeah the cult's called science
right
well this is what the university was
supposed to be i i
i think uh no i know what happened to
the anabaptists and jan von leiden and
shit man it didn't end well for them
you know
well i mean it doesn't matter whether
something calls itself science
ask whether it gives you power what does
it give you power over nature
we seek to find the power over nature
uh yeah listen to dan carlin's thing
about the at the end of that this is
good
um
when you're bringing up current day
stuff biological sex is not a social
construct right
everyone that's that's not even that's a
strong man it's it's not even
nobody actually says that but um i think
it's kind of along those lines
there's a lot of really shoddy thought
being done
um do we need like an faq
like george do you still do bounty hunts
faq i don't know
what am i doing here boys what is this
why do i have this twitch channel
what do i have nothing better to do with
my life it's a way to think
right if you want to build
why seek power over nature well if you
want to live forever i sure hope you can
get some nice power over nature right
yes to talk to myself right uh the
twitch bot can have faq
yeah well it's not an existential crisis
like
um
no thoughts on get out of here
living the examined life that's that's
that's a nice i've heard that like
examine life what's that from
no this is it's like socrates said this
why do i get all this modern crap
oh buy my self-help book on amazon
i have a phd
i developed thanks for the bits
yeah i'll have it in the title and
people will ask what i'm doing
but see the problem is the internet
boosts the loudest voices it's the one
who asks
i'm sure this is true that internet
commenters make up
a small fraction of the people in
society i certainly know twitter does
yet they are taken to reflect a new sort
of democratic consensus which is
meaningless the people who are
commenting on your youtube videos and
they're good to respond to and they're
good to kind of riff off of but to
believe that you're surveying the
general population with internet
comments it's just totally wrong
um actually i was gonna i was thinking
about
uh vitalik uh
one of the things i'm interested in
recently is homomorphic encryption
um
do you actually have any implementations
of this stuff
oh there's implementations this seems
kind of fun to play with
the problem with society is dumb people
are full of confidence while the smart
ones are full of doubts
i don't know maybe maybe that's a
problem
we're in the post enlightenment
yeah man but uh you know you don't build
uh you don't build
uh instruments of war with post
enlightenment ideals
you build them with enlightenment ideals
so
humans have far surpassed their capacity
for tech
when i hear an argument like that i
think back to like we have exceeded the
carrying capacity of the earth 10 times
over
no we haven't
i don't think i i don't think that the
prob
people attribute this this problem to
like cancel
culture and i don't think that's true
um i think that's just the the boogeyman
of the moment
you know there's always a boogeyman at
the moment right remember when the
terrorists were the boogeyman at the
moment
it's just it's it's the same
um thing playing out you can say like oh
well the reason that we all got
dumber is the terrorists i don't think
that i think that's just as true as the
cancel culture thing
um
make a list of banned comments and
normal comments well here's an
interesting question
yeah i mean what if we started
i mean i wonder if we could build
something so there's this thing called
uh
what is it it's like uh sentiment
analysis
so this is emotion but what if you use
technique similar to sentiment analysis
to extract like
i think we could at least ban off topic
comments well
what i'm more thinking about like of
course they'll always be bad comments
and you can ignore them and
if you're trying to do things on an
object level yes you can do this
but if you're trying to think about how
to build how can we build a higher
quality stream
uh now i mean part of this also is is
how much effort am i willing to put in
before i do the streams
how much effort do you want me to put in
before i do the streams one of the
compliments i'll get on this stream
is that i haven't pre-rehearsed any of
this material i'm doing it live in front
of you
um thank you anonymous gifter
anonymous see that's i can respect
anonymous you know
um blockchain the comment section proof
of stake right
these are these are ideas
a lot of the thinking in the crypto
world um
i've been reading uh i'm reading
vitalik's blog recently and
like um i've come around to proof of
stake i used to be anti-proof of steak
quadratic voting
uh i mean i've always been pro quadratic
voting i just thought it was too hard to
implement in practice
but like they're doing it um this is
like git coin
thing uh
they have like grants much into it too
much but
this stuff's really cool
bitcoin grants
yeah it's not that much money
um
quadratic funding i haven't spent a lot
of time thinking about this
and kind of how to attack it
can you machine learn what to ban by my
history of banned comments yeah
all right so that's i mean this is
something i say a common like all of you
here
uh you learn to you know what would i do
right run run your model of me in a
situation and then think about
uh you know if you don't know what to do
run your model of me right so i wonder
if you could do the same thing with the
comments here
um and it's not to say that like like
i'm not i'm not implying there that
my way of doing things is right
just as who i choose to ban it's not
right in any objective sense
but you know it's it's uh
well i'm not going to be upset
i want george larger and his computer
smaller we can do that we can do that
hacky hacks but that requires planning
oh if i announced the topics before
yeah um okay
so we'll announce i mean this is what's
nice to do
in in a few parts i think this is
today's stream
and what we'll do uh
it'll be either tomorrow or
tuesday around like 11 00 a.m
uh eastern standard time we'll come back
online
and we'll continue scheming in haskell
uh so if everybody could review
please review the book
please review structure and
interpretation of computer programming
and we're going to try to
implement some of the stuff from that
book in our custom dialectic scheme
no the bots they're not good enough yet
they're not good enough yet i do
have faith in the next decade
that we're going to be able to build
part of the problem part of the
moderation problem in general part of
the spam problem
is if it takes
less effort for the spammer to send the
message
then it takes even for you to just
delete it
spammers are totally winning in the
world
um but if we can have ai moderators
like
only will this delete trolls
this will also make trolling a less
productive activity it'll be less
economically incentived
uh incentivized because those trolls or
those spammer or those
salesmen or whatever they are they're
just hitting up against a machine
that they're no longer hitting up
against a person
um will there be a test i will try to
write a test
uh i will write a test so so yeah i'll
write
all right i'll write a little haskell
test uh
it'll be on stuff covered in this stream
so if you paid good attention in this
stream
you'll be able to do well on the test
i see you guys really like when i make
tests apparently i graded the last test
wrong though so i'll do
we'll do better we'll do better um yeah
please study for the test
and then i don't know how do you guys
feel about my other idea if we want to
actually do lessons for noobs
um maybe we'll do uh you know what we'll
do an auction
we'll do an auction uh if i ex this is i
don't know how much effort this is to
put together
uh but if someone wants to spend an hour
on stream uh learning a topic
uh who's ever willing to to bid the most
we'll say we'll say you put in a bid and
you put in
the topic that you want and the top one
might not get
chosen
quadratic funding yeah i'll have to
learn more about quadratic funding
please only vips
i hope vips can speak too when uh it's
subscriber only
uh auction stream lessons bidding with
channel points no
no channel police are worthless
unless you have seven thousand seven
million you can send one message
are you close to twitch partner
hopefully i mean it comes down to
whether they approve me or not
um if they don't approve me twitch is
telling me george hey we don't really
want your content around here
that's somewhere else you know uh you
guys all know where to find me
oh vips can't chat while subscriber only
that's sad
um
you guys will you know people who care
will find me somewhere else
people always manage to
uh
the elite can't speak i wish i wish we
could vip as we want
twitch i need more options twitch i need
more options
i'm not making a telegram chat well
vip's are the most butter subs i agree
with that
um cool
i mean look i'm thinking about this the
the
part of the college is to build the
online collaboration tools
uh not for people outside the school but
for people inside the school
where you have a real identity it's all
on the intranet
um
ironically google plus worked very well
inside of google
uh oh i guess i can yeah if i can give
subs to vips i could do that
i don't know if i can give subs can i
give subs
see roxas brandon if i wanted to gift us
oh gift a sub oh i can
oh that's nice
train intelligent bots that quote
quality questions to drive higher
quality discussion well then
i mean it's just me discussing with a
bunch of machines and eventually we'll
get there
you guys know i want to be a girlfriend
but that's my dream right
um
i want to yeah i want to start a call i
don't know do i want to do anything in
the world
should i just be a degenerate is is it
worth it did you actually have any
control i don't know
um oh it costs me
five dollars to gift a sub and i get
back half
wait that's a joke i gotta pay my own
um we've dropped these strict iq tests
we don't say we're not going to say iq
it's i again i didn't realize oh
so it's just an entrance exam uh
the university is going to have an
entrance exam and everybody who gets
above a certain point
on the entrance exam is welcome to come
to the university
you also have to have taken uh
the sat but and have finished high
school
but just for uh just for notation
purposes
just just for uh you will not be judged
based on your gpa or sat score
we are interested in tracking those
metrics uh over time
uh it's in twitch's favorite and not
like see that's what i mean you're right
you're absolutely right it isn't
twitch's favorite do not let vips talk
in sub-only mode
and this is where these platforms are
hostile
to both users and streamers to keep you
in their gamified bullshit right
this is why like you know am i going to
go out of my way to not get banned from
twitch no if i get back from twitch i
get back from twitch
i don't care i don't really do this for
money
i do this for my entertainment and your
entertainment there's a million other
ways to be entertained on the internet
yeah geds ged is fine i don't even
finished high school i i guess
i don't really care about that but like
i want to i want to track these things i
want to know what
correlates to to to to high school gpa
what correlates to sat score
uh are you pretty sure vips can talk
cool
uh let's let's just can vips
talk in sub only mode twitch
uh oh cool yeah yeah no they can
great
um unfortunately i don't notice what
subject first stream solve complex
github tickets in a popular
module oh i was like that sounds like
real work man
uh that sounds like that sounds like uh
pay me
there's some stuff that requires a real
like
expensive kind of focus if i was gonna
do things like that i have a whole set
of projects that i work on off stream
um that aren't uh
and then honestly it's probably going to
be
most of the time spent understanding
what they want and understanding the
code base a tiny amount of time writing
code
and then a huge amount of time getting
it upstreamed oh you got to sign your
contributor license agreement
and so on and so forth
um
yeah there's been a lot of talking on
these streams lately doing a lot of
thinking what else is there to do
in new york we think
cool guys it's just three hours thank
you for watching today's stream
i don't know if it's going to be monday
tuesday or wednesday
um but we're going to try to have a test
uh
test test thank you all for watching
have a good night everybody
thisisuntrackable: hi
Crannigan: Hey I'm new to the stream
lil_cheet0: <3
Crannigan: decided to follow you on a youtube binge earlier :)
lil_cheet0: shamaDab shamaKiss
coProof: BCash?
coProof: how much will the transaction be
LeviStreams: lol @Crannigan
Crannigan: monkaS @LeviStreams
Crannigan: needed something to watch while finishing my genetic algo
coProof: what are transactions fees these days?
LeviStreams: commanaiarchive kept popping up in my youtube recommendations
Bryanswagbeast: Eh!
moreningwould: same
Bryanswagbeast: whats he up to?
crazyserb011: I was watching an older video on youtube :D
quillford: can you check my speed challenge?
suurrend3r: hiii
LeviStreams: great content to binge for sure
coProof: are you doing bcash or bitcoin
suurrend3r: I know you won't use brave for a long time
suurrend3r: the same thing you did with Startpage xD
coProof: can you make a bitconnect transaction from scratch plz?
ThatGuyChaos: Thoughts on Coinbase CEO saying they’re going to be “the next Wells Fargo”? Seems like he doesn’t understand the point of crypto is to not have have massive centralization hubs
spellwish: how come you use iOS and not linux or windows
Bryanswagbeast: lol what are u about to hack? -_-
Bryanswagbeast: ninjaCreep mthGrin
coProof: MAC OSX
abstractingagent: YES GEORGE WHAT'S GOOD HOMIE
crazyserb011: hahah
Crannigan: fuck politics
coProof: can you make the transaction dependent on rsi crossover?
ThatGuyChaos: @ me bro
Bryanswagbeast: ill donate if you teach us a little bit of hacking!
ViktorTV: @tomcr00s3 are you by any chance looking for interns are would even consider having an intern?
bjornswife: just just coinbase bruh
Mac_33: I'm supposed to be working on class assignments, but I'd rather implement AI-denoising for my renderer instead
littlebighead82: what the point of using SHA-256 encryption Kappa
Jewishrambo: Yo
coProof: rand(1,100)
Mac_33: what happened to 'fuck chrome' Kappa
Mac_33: check out ungoogled-chromium
kkuette: I hate google but tensorflow's fine :D
Bryanswagbeast: Reverse Engineering? @tomcr00s3
coProof: why is it not changing
bjornswife: yoink
bjornswife: bitcoin cash is not bitcoin
Bryanswagbeast: lmao
crazyserb011: I told everyone on facebook that i'm not voting they all got offended
coProof: yeah no dont worry i wont touch the BCH chain
Mac_33: Do you have a public twitter acct?
ViktorTV: @tomcr00s3 would you by any chance have an intern at comma?
bjornswife: imagine using facebook in 2018 lul
Crannigan: if I told my dad i don't vote he'd have a heart attack @crazyserb011
coProof: ourselves
Bryanswagbeast: if you can track where i live, ill believe u! @tomcr00s3
Jewishrambo: Do math ourselves
littlebighead82: bch DansGame
LeviStreams: hotz, when you gonna do a from the transistor stream?
Mac_33: ripemd160 is a shorter hash used for the address string
quillford: cheer1
crazyserb011: I find it funny. they don't care who i vote for just that i do
coProof: Mac sounds correct
littlebighead82: why is that funny lul
bjornswife: do your public duty and vote for trump
crazyserb011: hahha
coProof: right after I buy some BCH
Mac_33: If I don't forget, ripemd160 is then converted to base58 for the presentable public keystring
Bryanswagbeast: #fuckTrump
bjornswife: hotz wants to build the wall
Mac_33: base58 because they wanted to take out some similar chars like O->0
crazyserb011: not into politics.
littlebighead82: how old r u
Mac_33: I actually tried writing a cryptocurrency in Swift
crazyserb011: 26
littlebighead82: and u don't care who makes the laws?
crazyserb011: it's all the same
coProof: can the private key be randomly generated from your toy slam algo?
bjornswife: replace politicians with smart contracts
crazyserb011: the 1% make the laws
littlebighead82: big yikes
Bryanswagbeast: do you still need money for rice? lol! @tomcr00s3
bjornswife: poggers
Mac_33: Hotz, we should automate governance.
Jeppelelle: Dude, come on, close the update notification RuleFive
bjornswife: use tezos
crazyserb011: ios want's an update
coProof: Updates Ready to Install
revler1: i like money :)
bjornswife: give this millionaire your bitcoins
coProof: zqr
bjornswife: hurry
glitchedoutt: Are bitcoins still useful to purchase?
littlebighead82: gotta love open source
Bryanswagbeast: wait... were u serious? r u teaching us how to hack? @tomcr00s3
coProof: hurry up
Bryanswagbeast: for white hat hackers?
Mac_33: Do you even ethereum
sfmoose: this is where geo hot looses his bitcoin live
coProof: if this was ethereum i'd send you some but no
littlebighead82: Ethereum Kreygasm Kreygasm
Mac_33: Up next: we wait 45 minutes for the transaction to confirm
bjornswife: dont trust us
sfmoose: STEALING IT NOW
coProof: that sounds like a challenge
littlebighead82: downloading the main frame now
quillford: cheer1
revler1: i am a noob :(
sfmoose: BCH PLZ
coProof: i'm gonna need to donwload a little more ram if i run that
crazyserb011: and it's gone
unctarheelss: no 1080
bjornswife: seed=1337
crazyserb011: https://imgur.com/gallery/lcxyE0D
coProof: most common seed therefore easiest to be haxed
brandoncode: do you go live every day?
sfmoose: does comma ai not provide enough work for you?
sfmoose: sorry no speaky of it again
sfmoose: audio is fantastic
quillford: audio is fine
pugs0n: audio is fine
Jewishrambo: This stream is scuffed.
Crannigan: what if I really am fucked?
Jebbbbbbbbbbb: comma ai confirmed dead PepeHands
sfmoose: audio is great dont fuck with it
808kid: Audio is fine
Jewishrambo: Is he drunk ? What you drinking ?
littlebighead82: "You're fucked. That's right!" LUL
Mac_33: Are you intoxicated? I see you're only typing at 200WPM...
sfmoose: play us something in Hungarian minor on the keyboard
coProof: No one wants yur bch
littlebighead82: bch is like dirt to us Tom
sfmoose: yeah do 480 or higher
Jebbbbbbbbbbb: D:
coProof: You’d have to pay me to take your BCH
crazyserb011: hahah
crazyserb011: ban
Crannigan: pwned
Jebbbbbbbbbbb: Geohot booli D:
sfmoose: LOL
brandoncode: Audio is very good
Jewishrambo: PogChamp
suurrend3r: LUL LUL
Crannigan: audio is much nice
littlebighead82: lol coProof
LeviStreams: lol
unctarheelss: dictatorship
Jebbbbbbbbbbb: cash.coin.dance LULW
crazyserb011: on to youtube
glitchedoutt: audio is awesome (gulp)
Jewishrambo: Audio is good BibleThump don’t hurt me
crazyserb011: lol
CharlieKelly_aka_Dayman: lol well it was a fun stream
ThatGuyChaos: Lol
glitchedoutt: heil audio
Crannigan: LOL ^
Jeppelelle: Why not just start a normal bank and then just put 393 billion into your account balance
bjornswife: roger ver made you
suurrend3r: say a guy who streams once a month
Bryanswagbeast: yeah the stream is over and he will hack u!
suurrend3r: did you ever try a git alternative?
ThatGuyChaos: What’s the over/under on minutes until someone steals it
coProof: Yeah pls integrate twitchslam here
Jebbbbbbbbbbb: exbosed
crazyserb011: he will hack your moms pacemaker then what
Jewishrambo: Exposed
bjornswife: lol
brandoncode: what time is it where you live?
littlebighead82: take his bch and he will hack ur amygdala
minhazm: Git amend and force push
bjornswife: that was quick
Jebbbbbbbbbbb: @tomcr00s3 Are pop tarts sandwiches? 🤔
SnakeOneMLG: VoHiYo
coProof: Git push origin master
suurrend3r: did you ever try a git alternative @tomcr00s3 ?
Jebbbbbbbbbbb: D:
Jebbbbbbbbbbb: SO MEAN
KhanDesi: lol
suurrend3r: LUL LUL
bjornswife: fake
sfmoose: please show the private key so we know you're public key matches.
suurrend3r: LUL
KhanDesi: ^
KhanDesi: we must verify
Jewishrambo: Use vscode I plen
sfmoose: it's the only way
Jewishrambo: Use vscode pleb
KhanDesi: @sfmoose damn, you subbed, but there's no emotes for this channel
KhanDesi: that's either dedication or desperation
coProof: @jewishrambo is right
SnakeOneMLG: is the audio broken for you aswell chat?
KhanDesi: @SnakeOneMLG no
pugs0n: AUDIO IS FINE
Mac_33: I have a screencap of your privkey, but I feel merciful tonight.
SnakeOneMLG: hmmm 🤔
Jok4ndre: https://clips.twitch.tv/ArbitraryEnchantingWolfBloodTrail
crazyserb011: Microsoft bought git. how do you feel about that
quillford: no they bought github
bjornswife: basically same thing tho...
crazyserb011: wow
Jebbbbbbbbbbb: ":Microsoft bought git "🤔
ThatGuyChaos: Definitely not the same thing
SnakeOneMLG: hmmm interesting, when I have quality on 360p the audio is completelly broken but on 480p it is normal
weedlord666: git===github
pugs0n: solution: don't use 360p
SnakeOneMLG: B)
Mac_33: sell toaster, buy internet
Jok4ndre: git == github?
SnakeOneMLG: git = github
Mac_33: Just as I sent that, my player downgraded to 360p
SnakeOneMLG: haa
SnakeOneMLG: haha
kkuette: Please just check git wiki page
KhanDesi: git != github
kkuette: you'll see
Jeppelelle: you guys sitting on toaster internet speeds?
KhanDesi: gitlab > github
Jebbbbbbbbbbb: @tomcr00s3 Was JS a mistake? 🤔
bjornswife: bitbucket andy
Mac_33: Endianness - Fucken computers, amirite?
Jebbbbbbbbbbb: D:
brandoncode: don't like youtube to stream?
KhanDesi: JS = John Swick
CharlieKelly_aka_Dayman: jon snow
Jewishrambo: JavaScript u noob
Jebbbbbbbbbbb: JS = Jour Smom Kappa
sfmoose: Jet Ski
KhanDesi: jon snow dies
KhanDesi: snape kills him
glitchedoutt: jamba shake
CharlieKelly_aka_Dayman: NotLikeThis
RenderMonkey: python 3 was a mistake!
KhanDesi: Jebaited
coProof: Just do a Tripp’s handshake and yur good
sfmoose: time to just use BTC
Mac_33: Do you have an opinion of the Swift language?
Jok4ndre: is there a python 1?
KhanDesi: yes
KhanDesi: it's a snek
coProof: This is good bedtime material
suurrend3r: that's some clean code
FalconJet_: what keyboard do you have?
sfmoose: I can't wait until he goes to send and the wallet is empty and he just RAGE QUITS
OMG_STD: @tomcr00s3 have you used Go or rust? Any opinion on either?
Bryanswagbeast: dont know what type but he mentioned a mechanical keyboard with no letters
sfmoose: @FalconJet_ just buy Ergo Ez Dock and call it a day
KhanDesi: how he type letters if keyboad have no letters
sfmoose: ErgoDox EZ
Jeppelelle: Guys, build a dactyl keyboard, thank me later
Mac_33: @KhanDesi Whatever the opposite of hunt-and-peck is I suppose.
KhanDesi: hunted-and-pecked
glitchedoutt: what's dactyl
Jok4ndre: what is he doing?
Mac_33: Sending fake bitcoins from one address to another
littlebighead82: 80  viewers POGGERS
Mac_33: With raw python3
sfmoose: WIN A JET SKI!
KhanDesi: Yo, who wants to send me like $300, I gotta put my team together for DreamHack Atlanta. #BrownWall
suurrend3r: b'' for what?
Mac_33: Why are you not writing this in x86 assembly my dude?
coProof: Okay going to bed. I expect my wallet to have 30 BCH in it by am.
ViktorTV: @suurrend3r byte
KhanDesi: @suurrend3r to convert to byets
suurrend3r: @ViktorTV sure
suurrend3r: thx
Targon28: just found your videos on youtube today and just watching you program is insane. How often do you stream
KhanDesi: ^ same lol
KhanDesi: I want more SLAM
Jeppelelle: Isnt the youtube channel just someone that ripped of his streams and uploaded?
suurrend3r: @Jebbbbbbbbbbb yeah
KhanDesi: yeah, sounds about right
suurrend3r: @Jeppelelle yeah xD
suurrend3r: LUL
CharlieKelly_aka_Dayman: i only found this stream cuz of that youtube channel tho
KhanDesi: falcatedFacts only
Mac_33: Bitcoin Cash = Fake News Bitcoin
Mac_33: As we all know, the only *real* bitcoin is Ethereum.
Mac_33: Kappa
trashcan___: at least call it by its real name
trashcan___: bcash
KhanDesi: the only real crypto is KhanDesium, please send it to me
Bryanswagbeast: just give yourself 1000 bitcoins! @tomcr00s3
Jok4ndre: i also come from that channel.
sfmoose: Yeah youtube is how I found this channel as well. Binge watched the archive.
Mac_33: The script part is a bit annoying to implement tbh
KhanDesi: you binge watched a bunch of 10 hour streams?
Mac_33: You need OP_CHECKSIG at least
Mac_33: You need to gather inputs and form a new output, append script and sig
Mac_33: And S E N D
Mac_33: You literally just send the shit to the node
Mac_33: *in the correct format
Mac_33: Ah yeah, handshake first
Mac_33: You can just broadcast the TX, if it's valid it'll be accepted by the nodes
SnakeOneMLG: !uptime
Jok4ndre: no bots
Mac_33: I believe TX witness is for the newer type of txn
Mac_33: SEGWIT
Mac_33: Google it
CharlieKelly_aka_Dayman: i just did 3 politics tho
CharlieKelly_aka_Dayman: ok thanks! ill try that
un3okapi: guys, how do I git gud like geohot?
suurrend3r: WutFace WutFace
Targon28: Tips on learning even 1/100th of what you know? lol
suurrend3r: I think hotz is drinking too much enery drinks
kkuette: Google it ?
SnakeOneMLG: He is just very good at working with little information
trashcan___: i think its a spindrift
suurrend3r: LUL LUL LUL
SnakeOneMLG: monkaS
suurrend3r: NotLikeThis NotLikeThis
Mac_33: What are you on
suurrend3r: Cocaine and Python
Mac_33: You can ask other nodes for key balance
Mac_33: You do not need to sync the chain. You're creating a light node
Mac_33: getreceivedbyaddress
Nagato_Pain: heyyy
Mac_33: May not be the right one
Mac_33: Like, you need to get the inputs for your address
Mac_33: And then count up the satoshis
Mac_33: Since you only have 1 txn, you just use that amount
suurrend3r: do you like Ruby hotz?
Mac_33: Yeah I noticed that, my bad!
Mac_33: I'm sure you could ping some service for the balance!
Mac_33: If you don't want to use other nodes, you *have* to sync the blockchain
Mac_33: I guess you could only sync the last 100 or so blocks for this purpose
Mac_33: You just request the blocks from other nodes
Mac_33: I think you could just ping a full BTC node for the balance too, and rely on that data
Mac_33: Yeah there's no protocol call for getting balance, since an address doesn't have a balance, you have to read the ledger to figure out the "balance"
quillford: is this blockchain for sensorless openpilot?
Mac_33: You really just want to download blocks, find the single input to your old address, and use that to form a new output to send
Mac_33: Important: Nodes may ban you if you don't follow the protocol properly
Mac_33: So make sure to ping different nodes
Mac_33: Are you trying a random node each time?
Mac_33: You are, yeah
honeybadger_____: do u have a full time job or used to?
un3okapi: comma.io
Jeppelelle: hes working for Sony
Jeppelelle: ;)
PENK4: 1080p please
CharlieTLe: Hi George, was just watching your SLAM video!
scriptedp0ison_: im hyped
suurrend3r: EleGiggle EleGiggle EleGiggle
suurrend3r: PJSugar PJSugar
Mac_33: Have you gotten any response? Network byte order?
scriptedp0ison_: how do i become a part of google project zero?
Mac_33: You find 10 0days in 10 hours, and then send a tweet to sergey. Then the ritual will begin.
scriptedp0ison_: lol
Mac_33: What are you doing differently now apart from the call? Try version again?
kimmilol: LUL
Mac_33: DAMNIT
Crannigan: Kappa
suurrend3r: daaaammnnn
Jeppelelle: hahhahah
Mac_33: That's lame as fuck
suurrend3r: LUL LUL LUL LUL LUL LUL LUL
scriptedp0ison_: seriously?
OPHaru: LUL
akalioceania: clip it boys
honeybadger_____: i hope u didnt lose alot lol
suurrend3r: for real?
abadonna6: EZ
Jeppelelle: who was it, confess guys
sfmoose: fuck man I just shit myself
Mac_33: That reaction WAS priceless, however.
Crannigan: LOL
scriptedp0ison_: same
OPHaru: nice Jebaited
sfmoose: RAGE QUIT!
Quiplash: congrats u played urself
Boblikesdoritos: The bitcoins are safe!
akalioceania: https://clips.twitch.tv/FurryGlamorousLousePipeHype
ThatGuyChaos: Lol
sfmoose: This stream is amazing
scriptedp0ison_: hype
ThatGuyChaos: Spindrift shill
Mac_33: Hotz, I challenge you to a Type-off
sfmoose: 23
sfmoose: i bad at math
Mac_33: Tomorrow, the internet. Be there.
Jeppelelle: Forget about this bitcoin crap, just create a new cryptocurrency that mines with the tp:s from SLAM
ThatGuyChaos: When’s the spindrift ICO
scriptedp0ison_: B)
trashcan___: right after the lacroix ico
Mac_33: Bitcoin will end world hunger.
Mac_33: Everybody says so.
scriptedp0ison_: George you don't use cake?
scriptedp0ison_: cake browser
Mac_33: ungoogled-chromium is neat
Mac_33: Also can you close that update notif in the top right
sfmoose: steven hawking loved strip clubs, google images that shit
sfmoose: need more bitcoin to cover tx fees to steal bitcoin. fuck this broke ass bastard.
scriptedp0ison_: north korea is really banging the blockchain
Mac_33: Everything you have to work with is in that one BTC protocol doc
Mac_33: If you were stephen hawking, you'd be dead.
gofaq: Hello... What are best choice: python or clojure?
scriptedp0ison_: python 100% right now
sfmoose: python if you enjoy employment
gofaq: should i learn python? ok)
gofaq: i try
gunnaren: Yey - finally made it to a livestream!
gofaq: love u vids and stream
Mac_33: what music are you digginga tm
syte29: The legend geohot at it again
sfmoose: you need more bitcoin so e40
sfmoose: e40
sfmoose: e40 choices
akalioceania: play infant annihilator OMEGALUL
Quiplash: rest ez lil peepee
Mac_33: Don't you just hash the tx, sign that and append it?
syte29: I wish I had this much focus. I've been coding the past hr and still haven't produced anything noteworthy. :(
Mac_33: George, how well did you do in university?
sfmoose: That's why I don't go outside, I like to do stuff.
abadonna6: i'm good at masterbating
scriptedp0ison_: mad respect George stays grinding 💯
sfmoose: can you teach me?
jitterbug_gang: how often do you masturbate george?
syte29: George too busy putting reverse shells into bitches so he can pop it later
Jok4ndre: !song
sfmoose: he likes his tx raw
CharlieTLe: Noticed you used vim a lot, why not download the vimium plugin for chrome?
Jeppelelle: Whats the theory behind that a reverse would work?
Mac_33: Because a website said so
Jeppelelle: ok :D
syte29: He really is like the new Martin Shkreli
foxubu: Back to Chrome? :(
un3okapi: martin shkreli is irreplaceable
syte29: RIP Shkreli. He still updates his blog though :)
syte29: They do have similar personalities though
Mac_33: I forked your repo, YEBOI
scriptedp0ison_: george you ever work with opencv?
suurrend3r: it fucking works
akalioceania: is this guy on drugs?
Mac_33: This guy is on LIFE
syte29: Adderall most likely
syte29: I would like some too :)
jitterbug_gang: this is what a peak alpha male looks like
foxubu: wait till he gets neck and back problems the way he sits
5umu: hey george what are u coding
Jeppelelle: 5umu he is teaching us how to steal his bitcoins
5umu: Ah thanks
suurrend3r: he hit this high only once a month thats because he stream so irregularly
5umu: just tuned in
RedzaMusic: i love lil pump
Mac_33: Merkle root of the block
Mac_33: you can traverse that and find a given txn
scriptedp0ison_: lil peep?
foxubu: we want kitty
jitterbug_gang: hey george have you ever done DMT?
scriptedp0ison_: shes okay
suurrend3r: I hate lil pump but love geohot
Mac_33: hotz will you join my discord for COOL PEOPLE
Mac_33: I haven't created it yet, but I may if you want to join.
Mac_33: Oh I was right about SOMETHING
foxubu: Code this in Java ... Gosh Kreygasm Kreygasm
CharlieTLe: Noticed you used vim a lot, why not download the vimium plugin for chrome?
scriptedp0ison_: python is life thats why no java
foxubu: Subscribers have a longer Squid4
scriptedp0ison_: ?
foxubu: @scriptedp0ison_ true
michalmx2: u
sfmoose: hacky hacky hacky
abadonna6: where's the like button
Mac_33: and SMASH that like button
sfmoose: we love you george
gunnaren: we love u
scriptedp0ison_: were here for you george
jitterbug_gang: wholesome geohot
foxubu: we love geohot
scriptedp0ison_: lord geohot
abadonna6: i rate this broadcast 5 stars
v0lko: @CharlieTLe does that do muhc? I used to use vimperator, but it's not supported anymore
sfmoose: please play us out on that keyboard tonight. something soft so I can fall asleep.
sfmoose: yes yes
scriptedp0ison_: hype
CharlieTLe: @v0lko Yeah, it's pretty awesome. Highly recommend.
abadonna6: 2 dollars closer to a jet ski
scriptedp0ison_: ever listen to froggy fresh?
Mac_33: No ice? Just freeze some water. BAM!
sfmoose: gimme 2 dollar I make you holla
foxubu: Kitty Music Please°
foxubu:  / Ty
foxubu: Ty  /
CharlieTLe: I like "kasbo aldrig mer" or "martin garrix"
CharlieTLe: https://chrome.google.com/webstore/detail/vimium/dbepggeogbaibhgnhhndojpepiihcmeb?hl=en
foxubu: Damn he jumped out of the screen lol
scriptedp0ison_: got me dancin in my sheets
NoPartiesGuy: Guys, I have a question, what linux distro for a dev (mostly node, but python is planned also), ubuntu, fedora or manjaro. I heard ubuntu collects data, so I am sceptic to this one. I am just curious, maybe there is other distro, but I tried couple times and had certain problems, e.g. with mmy mechanical corsair keyboard. I thought this will be good place to ask, if I was wrong sorry :p
Mac_33: macOS is by far the best distro.
foxubu: Manjaro if you wanna stay update to date with packages.
scriptedp0ison_: ubuntu gives you the choice to send your usage statistics for future development. it has a far bigger user base..so when you need help its there
scriptedp0ison_: ubuntu can be configured for bleeding edge too
Mac_33: You don't have to send *all* the satoshi, you can send the excess back to yourself.
Mac_33: LAME
un3okapi: uh oh
foxubu: WTF
5umu: woww
gunnaren: what a douche
OPHaru: LUL
NoPartiesGuy: wow
quillford: if i send you bitcoins, will you check my speed challenge?
honeybadger_____: lol
Froopyland: lmao this stream
syte29: let's find that person
sfmoose: I'll send you some bitcoins, if that means the project continues
syte29: and beat 'em :(
abadonna6: we will find you and we will dismember you
gunnaren: that was our uber eats money
Bryanswagbeast: will i make your day if i donate you? @tomcr00s3
scriptedp0ison_: pull apart everyone to find the block address
NoPartiesGuy: LUL
syte29: yes :)!
tacorising3: LUL
OPHaru: time to steal 2,300 back
tomcr00s3: qq7pxh4xfyqype5nqynt4h6zxz0ma4du6cl47kva2f
scriptedp0ison_: #geohunt
JoneKone: no doxing
5umu: LOL
gunnaren: LUL
syte29: dox 'em anyway :)
xEHLE_: twitch gets really upset if you do that
Bryanswagbeast: lmao
OPHaru: TOS forsenS
notbigd: lol wild
Bryanswagbeast: Hey brother will i make your day if i sub? @tomcr00s3
michalmx2: hello George. do you know gynvael coldwind?
sfmoose: but you only had $2 something
sfmoose: not saying that was wrong
sfmoose: wasnt
JoneKone: how did he steal it?
syte29: what a dick
Bryanswagbeast: is there a way you can get his ip address ?
syte29: private key posted
syte29: what a cunt :(
scriptedp0ison_: bioluminescent cia agent took it
JoneKone: asshole
Crannigan: the private way posted for a good hour before anyone did anything though
Mac_33: Other nodes know which IP submitted the txn
abadonna6: who knew
notbigd: no surprise
scriptedp0ison_: cant you check or request the transaction ledger?
lupo1989: well if your hackimg playstation you can also to be hacked once you publish your private key xD
syte29: :O
xEHLE_: @scriptedp0ison_ is that a reference to the less PC version of that phrase from Terry Davis? LUL
honeybadger_____: lmao
OPHaru: lmao
abadonna6: lmao
syte29: which will be stolen it in a second :(
abadonna6: someones getting rich today
OPHaru: another 4usd to steal TriHard
sfmoose: how do you have a sound when it deposits?
sfmoose: that's awesome
sfmoose: you're welcome for the $4
scriptedp0ison_: lmfao maybe
Bryanswagbeast: I subbed brother!
foxubu: Send him 3 dollars back just in case
sfmoose: :)
sfmoose: i know just gotta move fast
quillford: you should just go back to twitchchess
ziggyzergling: asking for civility in twitch chat
suurrend3r: Yeah, what happened with twitchchess
suurrend3r: this is fucking cool too
Bryanswagbeast: whats twitchchess?
foxubu: @Bryanswagbeast see github.com/geohot It was a project he streamed to build neural nets for playing chess
Bryanswagbeast: ok thanks!
scriptedp0ison_: contact the BIA (blockchain intelligence agency)
eionard: !playlist
syte29: i never got my bch from the split. stupid gdax :(
scriptedp0ison_: arent those nightbot commands
syte29: geohot in mission impossible
sfmoose: still pending confirmations
foxubu: time's race #ACTION
Bryanswagbeast: lol
Bryanswagbeast: lets track that b****
syte29: dude's probably just waiting
xEHLE_: if im not fully retarded, which i may be, the stolen bitcoins got sent to the BTC donation wallet of Khan Academy
xEHLE_: at least it went to a good cause, i guess
sfmoose: good sluthing
Mac_33: I don't see it
sfmoose: I do I do
honeybadger_____: Pog
honeybadger_____: PogChamp
abadonna6: cliffhanger
JoneKone: @xEHLE_ All "non" profit organizations are a like.. like the cake
guishade: PJSalt
Bryanswagbeast: how many exploits do you currently own?
sfmoose: Slow AF
sfmoose: spin drift sounds like a race car
Mac_33: up next: we wait 45 minutes for the transaction to confirm while hotz plays us music on his piano
Bryanswagbeast: lol he took roche! you can tell since he's rubbing his nose! lol
syte29: blockchain confirmation, so fast
syte29: someone wake me up
syte29: :(
syte29: geohot you investing in EOS?
syte29: Also, https://quadency.com/ very useful :)
Mac_33: EOS is a scam
stoogethomas: bch is a scam as well
Mac_33: That's way too much
Mac_33: Like 50sat/byte is enough
eionard: LUL
Jok4ndre: fbi
sfmoose: maxLOL
gunnaren: lol
syte29: lmfao
suurrend3r: lmao
5umu: LOL
OPHaru: LUL
syte29: geohot gonna fuck you up
suurrend3r: WutFace WutFace
Bryanswagbeast: Do you own any exploits? @tomcr00s3
syte29: watch it beep again
5umu: lmao imagine
CharlieTLe: KAPOW
5umu: all of that gone
syte29: isn't there a lib for this?
syte29: lots of libs. why is he packing these transactions manually. just for torture :(?
honeybadger_____: lmao
sfmoose: So simple
Mac_33: he wants to do it by hand
Mac_33: Yeah, when you coded SLAM
syte29: ah :)
syte29: good way of learning
sfmoose: use vscode and let twitchees finish writing the code while you sip spin drifts
syte29: if he were a javascript dev, it would've just been this import * from "react-bitcoin-cash"; Sigh, no wonder js is a meme :(
Mac_33: The whole JS culture is flawed
Mac_33: "how do I append to an array?" "INSTALL J-QUERY"
syte29: Agreed, we had a kid doing frontend for us, who couldn't write a nested for loop
syte29: ...
gunnaren: @Mac_33 dont you mean "you need to make a library for that " Kappa
syte29: Or struggled to do fizzbuzz. It made me die on the inside
sfmoose: https://www.npmjs.com/package/true is my fav npm package. it returns True for you.
sfmoose: left pad is pretty good too
syte29: 100% used in a serious way
syte29: Tj Holowaychuk left for that reason :(. I love JS. I hate the community
Bryanswagbeast: what programming languages do you know? @tomcr00s3
syte29: Everything is "pull in package"
stoogethomas: I don't get why geohot would support bch makes no sense. Everyone on the bch side are marketers while the people that support btc like nick szabo and adam back are actual cryptographers...
syte29: dude wrote a validation library that validated fields based on their name. wtf... :(
Mac_33: I know there are scripts that scrape github commits for privkeys and automatically steal any coin there
Mac_33: Maybe someone has a script that tries to look for bch privkeys on twitch streams?
syte29: Ah :O. That maybe it :(
Mac_33: Public key is the key you make public
sfmoose: 1McTRkmGKV59o2Wfpqh4N1mXKypyALfCMc
syte29: Makes me sad that some dick would steal over 4 dollars
Mac_33: So the non-base58 ripemd160 key
AJCrow: what a nerd this guy.. lol
sfmoose: @stoogethomas I can only surmise that BCH was used it currently has lower average block confirmation times for a quick project like this.
Mac_33: Could just use LTC for that
Mac_33: It's identical to BTC
stoogethomas: @sfmoose Ehhh no bch has 10 minute confirmation/block times much like btc. If you wanted quicker confirmation times you could use doge or ltc
Mac_33: Save for the block time
scriptedp0ison_: nerdlife
scriptedp0ison_: were all nerds
AJCrow: yes we are
Mac_33: Yeah @tomcr00s3 why didn't you use dogecoin for this
Bryanswagbeast: how many programming languages do you know? @tomcr00s3
stoogethomas: well respect to geohot either way his been doing amazing work for years much more than anything i've done
syte29: his progress makes mine looked like shit :(
syte29: look*
Mac_33: With enough practice, you can become like him
Mac_33: @tomcr00s3 what's your vimrc like
syte29: I feel like I probably couldn't. Geohot has a lot of natural ability
syte29: :(
scriptedp0ison_: SSSsss
sfmoose: ok signing off, that was a fun one. keep up the crypto streams.
xEHLE_: 2 bucks illegally donated to khan :(
syte29: later @sfmoose
scriptedp0ison_: FBBlock
suurrend3r: getting crazy now
5umu: LOL
stoogethomas: I'd be happy to send you like $20 worth of bch
AJCrow: George of the cryptojungle
scriptedp0ison_: lmao
Mac_33: How many hours do you sleep at night?
crazyserb011: I was AFK did someone steal the money
Mac_33: Yeah, but someone sent more
stoogethomas: block explorers are usually delayed. just saying
xEHLE_: Looks like none @mac_33
Bryanswagbeast: Getters n Setters maybe? @tomcr00s3
scriptedp0ison_: after you get it setup. use argparse to turn it into a cli tool for btc transactions
stoogethomas: what language is he programming this in? python?
syte29: python
scriptedp0ison_: yea
stoogethomas: thought so
syte29: :), i like python
crazyserb011: do you know who took it. do we know
Bryanswagbeast: yes Python 3
stoogethomas: I think pythons good but I like my code separated by brackets :/
syte29: any of you guys competent with sed or awk?
crazyserb011: is he going to hack them?
suurrend3r: give me a job hotz
scriptedp0ison_: yes awk
syte29: trying to learn 'em to get better at file manipulation which i have to do a lot
xEHLE_: No, but it got sent to the donation wallet of khan academy LUL @crazyserb011
scriptedp0ison_: awk is grep for parsing field delimiters
suurrend3r: getting stuck here
slovn1k: why do u use VIM? it's supper hard to learn
suurrend3r: hard af
Bryanswagbeast: lol hey geo, roll out the Job Applications!
suurrend3r: @slovn1k nah it's easy
scriptedp0ison_: vim isn't hard to learn
crazyserb011: hack khan academy lol
syte29: I'm trying to learn the entire language right now.
syte29: Syntax feels funny :)
Bryanswagbeast: @syte29 which language?
scriptedp0ison_: yeah gonna take a few years
syte29: Awk Programming Language
scriptedp0ison_: oh nvr mind
Mac_33: @tomcr00s3 Why don't you use ed?
scriptedp0ison_: its oldddd
Mac_33: ed is the standard text editor.
vtcN_: edlin
scriptedp0ison_: nano anyone?
syte29: people use nano :O
syte29: I kid I kid :P
scriptedp0ison_: lol
Bryanswagbeast: Getters n setters!
crazyserb011: It's funny his like the only streamer that everyone is afraid to steal from lol
syte29: Trying out spacemacs right now. Learning that common lisp
scriptedp0ison_: nooooo
Mac_33: Told ya
blizz191: Add me on league when you get on :)
syte29: Everything suddenly became about functional programming all of the sudden. Presenting it like some new and revolutionary idea. Sigh
scriptedp0ison_: lisp is good for learning the programming principles
suurrend3r: just reset the router
Mac_33: I don't think the nodes share ban info
Mac_33: So try another node
Bryanswagbeast: Just hack that guy Geo! @tomcr00s3
syte29: Agreed @scriptedp0ison_ :)
suurrend3r: @Mac_33 oh yeah LUL
scriptedp0ison_: @syte29 I need to learn more of it lol, only watched the derek banas tutorial :D
Bryanswagbeast: his tutorial is trash
Bryanswagbeast: you wont learn sh**
Bryanswagbeast: try Thenewboston
syte29: Oh nice, learning it from Land Of Lisp. I have a hard time listening to video tutorials
syte29: Are they any good?
scriptedp0ison_: Derek banas goes over the core so you can build from it yourself
Bryanswagbeast: yeah thenewboston
syte29: Ah, not too long of a video. Thanks @scriptedp0ison_
Bryanswagbeast: derek makes the core in one video! it could be confusing for beginners
scriptedp0ison_: Derek banas for a quick go over. then use what you learn to build from it
syte29: Yeah, I'm really just looking for something quick
syte29: I've used other functional languages just not Lisp
scriptedp0ison_: derek goes over it fast lol youll get the hang of it
syte29: This is good :). Just skipped around throughout the video. Will watch tomorrow. Had never heard of Derek prior to this.
syte29: Also an emacs tutorial <3
scriptedp0ison_: He's a really good teacher. :)
Mac_33: You're not using multisig here dude
Mac_33: Luckily there are a lot of nodes to get banned from
scriptedp0ison_: 200  lines of code, your crazy
Nagato_Pain: read the chat @tomcr00s3
scriptedp0ison_: jk
Bryanswagbeast: lol
sfmoose: I want money
abadonna6: LUL
scriptedp0ison_: BCWarrior BCWarrior
foxubu: No, The more money you receive, the faster you have to code LOL
Mac_33: Doesn't it find a new node each time?
xEHLE_: ^
Nagato_Pain: some one explain im new here and im still noob in coding
twitchmiker: that's probably why people run local nodes on testnet to test their incomplete code ;)
scriptedp0ison_: george can you auto request a node if you get blocked
scriptedp0ison_: make a fuction to handle it
Mac_33: Code FASTER HOTZ
foxubu: CODE FASTER HOTZ LOL
Mac_33: FASTER my boi!
OPHaru: take my money :)
Mac_33: This is pretty hilarious
Tanthny: LUL
sfmoose: cracking up
scriptedp0ison_: ArsonNoSexy
syte29: at this point
syte29: it's just kind of fun to send
Mac_33: Now you need to gather all the inputs, loop thru em and add them to your output
honeybadger_____: randomly mutes
suurrend3r: focus on the finish
syte29: increase temptation for the thief :O
xEHLE_: Seems like everyone in here got bitcoins LUL
honeybadger_____: the steam randomly mutes
NoPartiesGuy: Br PogChamp PogChamp kf PogChamp st
syte29: i just bought some bch just to have him freak out
scriptedp0ison_: @mac_33 you seem really versed, its impressive
honeybadger_____: ur muted...
Mac_33: I just tried implementing a cryptocurrency from scratch
Mac_33: It's incomplete, but on my github
eionard: LUL
OPHaru: LUL
scriptedp0ison_: oh lol its too complicated for me. i dont have that much experience yet
syte29: that's pretty cool. I may try that project at some point :)
abadonna6: yoink
syte29: what language are you using @Mac_33?
syte29: Also, do you have a repo up :)
scriptedp0ison_: every time someone donates Mario hits a block...get it (blockchain joke)
Mac_33: @tomcr00s3 is it okay to post my github repo link here
syte29: pretty soon george bouta go over one of them turtles
syte29: I posted a link earlier @Mac_33 . I don't think he cares :)
scriptedp0ison_: love the stream
foxubu: Drink Mate @tomcr00s3
syte29: bedtime
syte29: goodnight peeps :)
Mac_33: @syte29 https://github.com/VKoskiv/VaporCoin
un3okapi: f.lux SeemsGood
scriptedp0ison_: later @syte29 hopefully Derek Banas can teach you
syte29: Thanks @scriptedp0ison_ . @Mac_33 , will definitely star. Looks interesting. Thanks man
scriptedp0ison_: George what gave you the innovation to create comma.ai?
quillford: what does that even mean>
quillford: ?
suurrend3r: this is depressing
Mac_33: https://xkcd.com/1728/
Nagato_Pain: guys i want learn coding should i start with python or java script ?????
Nagato_Pain: @tomcr00s3
scriptedp0ison_: python
Mac_33: You should start with x86 asm and work your way up
un3okapi: LUL
scriptedp0ison_: javascript or ecma script is for the front end development aka web pages etc
Mac_33: You have to EARN the privilege of using a compiler
Mac_33: Which input are you trying to spend?
scriptedp0ison_: lol @mac_33 i dont know about that
vtcN_: lmao start with asm...
Nagato_Pain: @scriptedp0ison_ thnx Dude
scriptedp0ison_: assembly ARM architecture is easy starting point
Nagato_Pain: @Mac_33 lol so funny
scriptedp0ison_: then you can write POS malware :D
suurrend3r: just keep trying hotz
scriptedp0ison_: trying to make an IP camera exploitation and exfiltration framework but i need to load and emulate like 20  firmware and mip architecture sets
suurrend3r: LUL LUL LUL
scriptedp0ison_: to try and desanitize some of the built in security methods..need to make a script to automate that
SnakeOneMLG: Is this Chrome?
sfmoose: blockchain.info
SnakeOneMLG: I thought you were using Brave
blizz191: Hotz can i make you a website ur web design skills are sub par
jotembruv: !uptime
suurrend3r: theres no bot
sfmoose: you can make a wallet with a private key at blockchain.info
Mac_33: Can you not import the privkey to your phone wallet app
sfmoose: then send the BCH elsewhere
pau1riddle: Guys, please help with a problem from a textbook. How can I represent n * (-6) with 2 shifts and 1 add/sub?
scriptedp0ison_: is this assembly?
pau1riddle: No
pau1riddle: Well, yes
vtcN_: if people do your homework for you you will never learn
pau1riddle: I know you can do n * 6. It is the same as n << 2   n << 1.
pau1riddle: But -6 I don't know.
pau1riddle: Can't use ^ or &
scriptedp0ison_: what type of register are you working with? if this is assembly? there are different opcodes for each architecture and it's mostly based on the register type
suurrend3r: we getting close to depression
Mac_33: https://i.redd.it/y59sstwfphs11.jpg
scriptedp0ison_: otherwise if not assembly, then what language
pau1riddle: C
scriptedp0ison_: ouch haven't touched C in a year
Mac_33: I've been working on a path tracer in C
Mac_33: It's a lot of fun
pau1riddle: It's just to be clever. Usually compiler does such things because shifts and addition is faster than multiplication.
Mac_33: I'm trying to train a model and add AI denoising
suurrend3r: "Nobody likes C" - Geohot
scriptedp0ison_: I stopped learning C, maybe I'll pick up when I learn reverse engineering
pau1riddle: The only reason I learn C is because books use it. And because I want to fix 2 HUGE bugs in kernel drivers.
Mac_33: i like c
scriptedp0ison_: I like C too just got lazy, i should pick up again
suurrend3r: Go GeoHot Go
scriptedp0ison_: @pau1riddle yeah i have no clue about the answer you queued, i havent been on c in ages
pau1riddle: It is not about C. It is for all languages.
newtomcroose: @tomcr00s3 my bro
pau1riddle: Where N is either unsigned integer or two's complement.
suurrend3r: C will die soon
Mac_33: It will not.
pau1riddle: Will be superseded by Rust and Go.
scriptedp0ison_: @suurrend3r it really wont
pitersk: so wrong
Mac_33: It is the only system implementation language that is widely used
scriptedp0ison_: the hardware your using has C built into it
pau1riddle: It will remain as assembly language.
suurrend3r: @Mac_33 C   is
newtomcroose: Cool , u writing a code for bitcoin , so where is taylor swfit ?
Mac_33: Try committing C   to the linux kernel
scriptedp0ison_: hell the servers that is housing Twitch has some C built into its drivers, etc
Mac_33: Every single device you use and see in the world has C code in it
scriptedp0ison_: so C is here for all..its great
Mac_33: It's not going away
scriptedp0ison_: I wonder what the B language was like
pau1riddle: But it is not evolving either.
newtomcroose: stream is lag ?
scriptedp0ison_: it doesn't need to
Mac_33: It was updated in 2011
jotembruv: stream is not lag
blackburn1911: hey
newtomcroose: come on , stream is lag :|
scriptedp0ison_: I always have to specify -std=c11 or my shared object will not compile and ill get an error. need to reconfigure gcc, did some tinkering and messed things up
lolcoolkat: no lag for me
newtomcroose: a technical guy , dirty hand ? right ?
newtomcroose: @tomcr00s3 do u have donation like ninja in twitch ?
scriptedp0ison_: @newtomcroose go reverse dns lookup twitch, and check the MS response time to the ICMP echo reply, that might be your issue if the response time is really high
Mac_33: typeof(NaN) = number
Mac_33: Remember to increment transaction nonce!
newtomcroose: guys , maybe i be found dead in my apartment
PEREZthe1: @newtomcroose cool :)
scriptedp0ison_: I'm getting latency too but I'm on a cellular connection, in the middle of no where
vtcN_: lol
Bryanswagbeast: hey mac what programming languages do you know?
scriptedp0ison_: MrDestructoid
chloven: LUL
newtomcroose: :))
newtomcroose: i use assembly for everything , even AI :|
scriptedp0ison_: ouch sounds rough
newtomcroose: geo get heater :D
Bryanswagbeast: @mac_33
Mac_33: ye?
Mac_33: oh
Mac_33: Quite a few?
Mac_33: Depends on what level
newtomcroose: @Mac_33 what is your favorite food ?
Mac_33: I like me some good wings
scriptedp0ison_: waffles are best
Mac_33: I mainly use Swift and C in personal projects
scriptedp0ison_: how is IOS development?
Mac_33: Okay, haven't done much of that lately
Bryanswagbeast: I was gone for a while right now! Did they take his bitcoin again?
scriptedp0ison_: Ever touch up on Objective C?
Bryanswagbeast: swift is better
Mac_33: I can still manage it
Mac_33: But swift is more prevalent
newtomcroose: :| why people talk about programming langues too much ? just learn python and pick a project :|
pau1riddle: I came up with new revolutinary optimizarion technique based on machine learning. You build ML module into kernel, it learns on your behaviour as computer user, and then loads caches and shift, across the whole stack, even making it so that branch prediction doesn't make mistakes.
suurrend3r: @newtomcroose so freaking true
Mac_33: You can't write performant code with python
Mac_33: It's good for a quick script/prototyping
Mac_33: But I need my stuff to be fast
newtomcroose: @Mac_33 yes yes , u right . learn assembly
suurrend3r: You can write in python first and then in C
Mac_33: I'm fine with just -O3
suurrend3r: LUL
pau1riddle: Caring about programming languages is a sign of Level 1 programmer.
scriptedp0ison_: @newtomcroose why do people use a spoon for eating oatmeal but not a spoon for spaghetti?
vtcN_: Mac_33 thoughts on jon blows language jai?
newtomcroose: ohhhhhhhhhhhh i fall a part
pau1riddle: Nobody who achived anything cared. They just did.
Bryanswagbeast: i first learned C  , java and then python
pau1riddle: Others were arguing on forums and imageboards about which one is better.
newtomcroose: @scriptedp0ison_ why people need se.x toys :| ?
blackburn1911: I use php and I'm happy MVGame
un3okapi: oooooooooooooo
scriptedp0ison_: @newtomcroose I don't know, maybe to make people like you happy?
newtomcroose: We should talking about bitcoin right now . we are not good twitches right now :|
scriptedp0ison_: lol jk
Mac_33: I mentioned that earlier!
foxubu: Give up Goerge ... You feel so tired FortBush
blackburn1911: George is a winner
newtomcroose: how can i do scam with cryptocurrency ?
Mac_33: You should google UTXO if it's not clear
scriptedp0ison_: @newtomcroose you dont, thats how you do it
newtomcroose: be smart , do scam , be rich , get fcked . right ?
Bryanswagbeast: ninjaCreep mthGrin
foxubu: same day lays only lol
suurrend3r: TearGlove
scriptedp0ison_: PogChamp
Bryanswagbeast: mrmuff21
un3okapi: :(
scriptedp0ison_: ThunBeast
suurrend3r: monkAS
scriptedp0ison_: BrokeBack
Bryanswagbeast: SeemsGood
scriptedp0ison_: HassaanChop
suurrend3r: cmonBruh cmonBruh
scriptedp0ison_: HeyGuys
Bryanswagbeast: DrinkPurple
foxubu: Get Mate George! You look tired ^_^
blackburn1911: the stream will be saved?
Bryanswagbeast: ninjaBlank mthMad
scriptedp0ison_: NomNom
foxubu: @blackburn1911 for 7 days
newtomcroose: @tomcr00s3 write a code to learn how to break bitcoin hash with ML and ... . what do u think ?
Bryanswagbeast: AI
foxubu: Fuzzing
newtomcroose: naaaaaaaaaaaaaahhhhhhhhhh
Bryanswagbeast: You need help? Call Elon Musk! @tomcr00s3
newtomcroose: elon musk just coding in php :|
scriptedp0ison_: or just call the nsa
newtomcroose: but its crazy what u can see
chloven: LUL Chrome
blackburn1911: I know the feeling
newtomcroose: chrome . can i kill you ?
denim_lap: !uptime
newtomcroose: !uptime
denim_lap: no bot D:
newtomcroose: we hate bots :| ?
vtcN_: i've had to hot-add ram because of chrome
denim_lap: anyone having idea of upitme
denim_lap: ?
newtomcroose: who need a hero ?
scriptedp0ison_: we all do
Bryanswagbeast: yupp! Chrome sucks the rams titties
denim_lap: D:
pau1riddle: Chome is now 51% of browser market
newtomcroose: She's got me spending Oh, spending all your money on me And spending time on me She's got me spending
denim_lap: that's one way to say it
scriptedp0ison_: Chromes a RAM whore
denim_lap: ok gus
scriptedp0ison_: @newtomcroose you have the voice of an angel
newtomcroose: @scriptedp0ison_ i wanna be taylor swift bf
scriptedp0ison_: @newtomcroose some serious goals you got there
Bryanswagbeast: so that computer that geo has is a borrowed computer from commaai and has 4 gtx 1080 ti and probably about 8 gb of ram! LMAO
chloven: :O
scriptedp0ison_: my computer is like Chrome cum take my RAM
scriptedp0ison_: *come
denim_lap: enough with chrome already
newtomcroose: realy ? he is a genius ? should i be a genius to do scam ?
scriptedp0ison_: okay @denim_lap whatever makes you happy
newtomcroose: @tomcr00s3 omg its 1:58 AM :))
denim_lap: thanks :D
scriptedp0ison_: @newtomcroose what are you talking about?
newtomcroose: @scriptedp0ison_ what going on in this chat ? :|
suurrend3r: you gotta make it work @tomcr00s3
Mac_33: i am falling asleep, put on music
pau1riddle: Lol it's 2 pm
newtomcroose: hard things for a legend
suurrend3r: put some hardcore music and keep going
newtomcroose: @suurrend3r what about energy drinks :D ?
Bryanswagbeast: some fucking slipknot brother
scriptedp0ison_: put some ytcracker on
suurrend3r: @newtomcroose that will work too
Bryanswagbeast: Sponsored by red bull!
vtcN_: dual core
pau1riddle: i dont like it
newtomcroose: @tomcr00s3 put some neffex one shot
Bryanswagbeast: wtf is that?
vtcN_: bone thugs n harmony
suurrend3r: LUL LUL
scriptedp0ison_: 😢
suurrend3r: @tomcr00s3 I think a little break drinking coffee will help you
Bryanswagbeast: i rather listen to you play the piano! @tomcr00s3
newtomcroose: @tomcr00s3 i recommend dua lipa musics for you
suurrend3r: a little break*
pau1riddle: george's IQ is now diminished to that of a cat because of sleep deprivation
newtomcroose: we dont talking about IQ
Bryanswagbeast: surrender!? Please have some manners! Its Break;
pau1riddle: no willpower to execute, just clicking around
newtomcroose: EQ is important
suurrend3r: LUL
scriptedp0ison_: @bryanswagbeast no its "break <ENTER>"
suurrend3r: LUL LUL
suurrend3r: "break n"
scriptedp0ison_: BrokeBack
newtomcroose: I see the moon I see the moon I see the moon Oh, when you're looking at the sun I'm not a fool I'm not a fool I'm not a fool No, you're not fooling anyone
Bryanswagbeast: kill all python lmao
suurrend3r: sudo killall Xorg && rm -rf /
scriptedp0ison_: lol..err..c..aN..t..Ty....p3
newtomcroose: @suurrend3r and hello to the real world :D ?
suurrend3r: geohot it's time to get a real job
newtomcroose: PogChamp PogChamp
suurrend3r: LUL
newtomcroose: what is your mean about real job ? work for google :D ?
pau1riddle: yeah fck this comma ai self driving shit
suurrend3r: LUL LUL LUL
pau1riddle: go church some jira tickets for ecommerce website
newtomcroose: fck ML coding . just learn php
suurrend3r: "nobodies code in php since 2004" - geohot
Bryanswagbeast: for(int i = 0; i <= twitchViewers.length; i  )
newtomcroose: @suurrend3r except facebook
scriptedp0ison_: why not sudo ps -aux | grep "Xorg" | awk -F "pid:" '{print $2}'
Bryanswagbeast: System.out.println("Hello")
suurrend3r: @newtomcroose facebook got hacked
pau1riddle: because nobody uses grep anymore, it's ripgrep everywhere
scriptedp0ison_: no Java up in here son!
Bryanswagbeast: python then
scriptedp0ison_: @pau1riddle riddle me this why do I still see its usage deployed in professional development environments?
newtomcroose: JUST ASSEMBLY
scriptedp0ison_: lol jk
Bryanswagbeast: oops! gtg! Fornite update out!
suurrend3r: @newtomcroose I think wikipedia is in php too
scriptedp0ison_: @bryanswagbeast eww Cod Blackout is where its at
Bryanswagbeast: html
lolcoolkat: fmt.Println(“Hello”) Kappa
newtomcroose: Knock knock, let the devil in Malevolent as I’ve ever been, head is spinnin’ This medicine’s screamin’, “L-l-l-let us in!” L-l-lick like a salad bowl, Edgar Allen Poe Bedridden, shoulda been dead a long time ago
scriptedp0ison_: @newtomcroose Venom was good
scriptedp0ison_: George play Eminem - Venom
pau1riddle: nooo eminem
newtomcroose: george is not high right now :D
lolcoolkat: watching this is hurting my head WutFace
denim_lap: man I work well to your sound of working
scriptedp0ison_: @lolcoolkat how is the fmt method, redirecting standard in to your teletype device through stdout?
lolcoolkat: what lol
newtomcroose: what lol ? or what is lol :| ?
lolcoolkat: idk what u are asking
scriptedp0ison_: @newtomcroose why you so :Z all the time?
scriptedp0ison_: george get some rest man
newtomcroose: @scriptedp0ison_ because my iq is 2,000
newtomcroose: @scriptedp0ison_ LIFE IS WORK . not rest
suurrend3r: This is like send a post petition without libraries and a lot of captchas Kappa
lolcoolkat: iq is 2000 but your english level is a solid 5 Kappa
newtomcroose: @lolcoolkat because i am a legend Kappa
scriptedp0ison_: @lolcoolkat lol
lolcoolkat: CoolStoryBob
newtomcroose: http://fortune.com/2018/05/05/warren-buffett-elon-musk-trolling-sees-candies-moats/
lolcoolkat: does anyone know whats going on anymore :D
scriptedp0ison_: YTCracker is literally nerdcore/hacker genre music, some of his other songs are better
suurrend3r: I think when Geohot says "life is work", what he is trying to say is that it's not worth work for somebody
suurrend3r: because life is work!
scriptedp0ison_: George much respect for sticking through this
slapusillydawg: my favorite change in python 3 was making parentheses necessary for the print statement, dont fukin @ me
suurrend3r: "i'm just guessing" that's the best part of programming
lolcoolkat: @slapusillydawg Kappa
suurrend3r: the art of guessing
suurrend3r: I didn't know it was that hard bro
scriptedp0ison_: @slapusillydawg no, whats better was the implementation of formated string literals and how PEP8 standardized them
sntboss: i want to be good in c   first , there is away to learn fast ?
scriptedp0ison_: @slapusillydawg We don't care for string interpolation anymore
vtcN_: Practice
keepingtrckofthisacct: @sntboss practice
sntboss: any links can help me be good ?
PEREZthe1: @sntboss get off twitch, then practice
slapusillydawg: i see all these people @ing me when i explicitly told them not to and its really giving me anxiety rn if im bein honest
suurrend3r: @sntboss you just gotta code and stop watching live streams Kappa
vtcN_: Pick a thing and write a thing
lolcoolkat: @slapusillydawg Kappa Kappa
sntboss: do u know anygood learning website ?
scriptedp0ison_: @sntboss no C is a very time consuming language to learn as it's closer compiled to the Assembly opcode for your specific CPU architecture
scriptedp0ison_: go with a higher level language such as python, or ruby.
suurrend3r: Here is 06:21 goddamn
lolcoolkat: 5:21 here ResidentSleeper
scriptedp0ison_: its 4:21 am for me
keepingtrckofthisacct: @suurrend3r how long has he been streaming?
vtcN_: 421 for me. Gotta logon at 9...
vtcN_: Working from home is nice
lolcoolkat: better sleep WutFace
scriptedp0ison_: @slapusillydawg what are you talking about?
suurrend3r: im not really sure I think since 01:30
scriptedp0ison_: he's around 4 hours now
scriptedp0ison_: its really impressive because hes so devoted
scriptedp0ison_: how many people can go through this much mental labor and still be disciplined enough to sit through it this long. not many. respect to George for that
lolcoolkat: alot... Kappa
scriptedp0ison_: lol u troll
suurrend3r: @scriptedp0ison_ hedo this once a month
vtcN_: @scriptedp0ison_ on a personal project
FalconJet_: did anyone take his bch
scriptedp0ison_: i know..watch comma.ai archive on YouTube
lolcoolkat: I did :)
beep13: is this just for a learning experience?
scriptedp0ison_: @beep13 that and for fun
scriptedp0ison_: I love watching these streams
lolcoolkat: and to kill his braincells Kappa
keepingtrckofthisacct: is comma.ai completed?
TheHandSolo: George, Im such a long time admire of your work
beep13: yeah i found the youtube stuff yday, now im here =)
suurrend3r: we all love geohot work
lolcoolkat: same came from comma ai archive :D
vtcN_: @beep13 same, it got recommended so i watched his twitchchess stream while working today
FalconJet_: @tomcr00s3 you on a mac or a hackintosh?
suurrend3r: mac
suurrend3r: macbook
lolcoolkat: he’s on Ubuntu rn Kappa
FalconJet_: oh fasho, i see the battery percentage
jotembruv: fucking segwit indeed
suurrend3r: what problem is he fixing now?
beep13: !uptime
twintowerpower: !downtime
beep13: id he just start?
beep13: did*
twintowerpower: nope
jotembruv: hell no
vtcN_: uptime too high, hasn't patched in a while
suurrend3r: he start streaming 5 hours ago
beep13: he is on east coast no?
beep13: what hours this guy sleep lol
twintowerpower: pretty sure he is west coast
suurrend3r: here is when the shitty code start Kappa
suurrend3r: I don't know if I write that right cause my english is not too good brahs
twintowerpower: did you mean to say he's cute as a cat? @suurrend3r
suurrend3r: LUL
suurrend3r: LUL LUL LUL LUL
beep13: west coast it is!
twintowerpower: he's losing hope the only thing that can keep him going is more moneys
Mac_33: i fell asleep
un3okapi: made 10$ in crypto donations at least LUL
suurrend3r: "fuck off" make me laugh
suurrend3r: made*
suurrend3r: @twintowerpower lol
NoPartiesGuy: are there any archives from streams, since I see they are not saved on twitch
suurrend3r: just remember when you hack the ps3, for sure was harder than this
NoPartiesGuy: Maybe it wasn't LUL
TheMartesLive: @NoPartiesGuy comma ai archive on youtube
suurrend3r: I love Twitch and Geohot
suurrend3r: SoBayed
scriptedp0ison_: @tomcr00s3 Amazing stream as always
Jaany: hello george :D
scriptedp0ison_: George you gonna get some rest man
un3okapi: ResidentSleeper
suurrend3r: people who write the protocol should be in jail
suurrend3r: wrote*
suurrend3r: Kappa
myaocat: hi
myaocat: yo its geohot and thoae who dont know im getting sued by sony (dj ton ton)
suurrend3r: tired af
scriptedp0ison_: George get some sleep man
myaocat: can you do some rap
Jaany: sup george :D
myaocat: NEVER GIVE UP!!!
scriptedp0ison_: You did good man lol get some well deserved rest
OPHaru: we tried BibleThump
slapusillydawg: woah you really have the email address lol@lol.com? PogChamp
myaocat: sony gave him
Jaany: LUL
suurrend3r: ResidentSleeper
myaocat: lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE lupoHYPE
Jaany: 5hr30m for $10 PogChamp
suurrend3r: thats pretty sick
myaocat: 50% goes for tax
Jaany: 5hr30m for $10 PogChamp
un3okapi: more PogChamp
foxubu: Drink Mate!
myaocat: recursion stream lol
un3okapi: <3
Jaany: <3 take care
myaocat: lupoMEOW lupoMEOW lupoMEOW
suurrend3r: SeemsGood MingLee MingLee MingLee
 
I ain't worth nothing to you if I start
making hits yo let's go
all right where's my chat where's chat
uh so I lied this isn't a tiny grad
stream this is actually a music stream
when we're making music in in Ableton
Live
what do you think guys
can I be a producer
now let's eat this chip
don't worry it's a fresh trip
I wouldn't I wouldn't use Guilt Trip
good morning happy Martin Luther King
Day
no where we celebrate how Martin Luther
King died for our sins
uh
or something I don't know if they like
Martin Luther King anymore you know
would they like judge people I think I
think you know we're not gonna go there
is a positive oh I don't have my camera
on what you can't even see me
what's going on
what kind of stream is this
kind of low budget garbage stream is
this my camera's not even plugged in
oh
oh low budget stream is this where's my
chat do I even have chat
ah there we go
okay
oh Chad's here
uh what are you streaming during work
hours
uh we make we make music now
what do we think
thank you
okay
um no uh what was I gonna say oh okay
let's minimize this yeah Drake finally
got competition that's right that's
right um no but uh all right so
uh I was gonna write a c back end and I
wanted to get 2500 for it and it's not
only that I need the money it's just
kind of like can the tiny Corp succeed
as a business right
um you know Alex is like you sit around
all day and you work on Tiny grad and it
doesn't make any money
um so I put a post on LinkedIn about
that uh you know but what good is that
man and you know it's not worth going on
Twitter Twitter's a talk successful
um
but if we're not writing the C back end
for the love of it you know why why are
we doing anything so we're just going to
write the C back in for the love of it
let's go uh
okay so the good news is see an opencl
and all this stuff look pretty similar
um so let's go in here let's call it Ops
clang
uh we should probably have like a better
way to
switch between them
uh
no we gotta we gotta make money and okay
look
for everybody out there who has a neural
network that they're running
uh whether you're running it in the
cloud whether you're running it locally
uh you can hire the tiny Corp and we
will just make it faster we will make it
faster and simpler we'll make your
workflow simpler you know tiny grad is
very easy to use
uh 2500 for a back end but you know what
like it's not even like not even like
worth it like
you know it's just it's just it's so
it's so pathetic that the business world
is so pathetic
um
it's like I don't care man
you know I just if I wanted 2500 I could
just Rob somebody's ethereum right like
that's if you want money you just you
just robbed ethereum we're gonna make
the sea back into this stream it should
be pretty quick
um it's it's very fast to to write
things in tiny grad uh because it's tiny
okay
so let's go down here to Ops GPU
and
now we're adding a third one of these to
do select
run times in a smarter way
and clang
um
think also another thing that we can do
see how images only supported there
this
we want an image
uh we'll do that I'll have clang from
Tiny grad runtime clang import CL buffer
and cl program
copy something there that would be
regrettable if I did
so let's get started with playing deals
one it's playing is actually a GPU back
end I know that's a little bit confusing
but we're going to use all the same code
that the GPU pattern because we'll give
you a lot yeah
back end I mean there's now two back
ends right
um
all you people asking about Elon are the
reason we're now going to subscriber
only congratulations no I'm not going to
start making money streaming on Discord
that seems like a lot of work
uh
you know what I mean it's streaming on
Stars streaming on on Twitch uh
why is that list index out of range
kind of an error is that
does it not like what I did with climage
um yeah Elon can be blocked that's great
uh no Elon and I are on fine terms and I
just I just hate this you know I really
I really this really fucking pisses me
off people are like oh George had to
leave Twitter because no it was because
of the food and you know what you guys
can like not believe me or believe me
but that's really it like I hated living
in San Francisco and the food was shitty
like why am I here
right like there's really nothing more
to it everyone always wants there to be
you know you look at some stories uh
I'll bring up Twitter story The Mudge
whistleblower story and the Munch
whistleblower story didn't get traction
because it wasn't clearly on political
side a or political side B
right
the world is a is a nuanced and
complicated place
um and you know if you don't want to see
it that way if you're just looking for
political drama you should get a bullet
in your head that's right that's right
we should we should we should shoot
people that's right
um no it's going to be the only way to
deal with that
um
okay
what the fuck is this list index out of
range
that really breaks it
[Music]
oh if not Cuda and not metal
that should work
can I not even port or something
I did break it with that right
wait what
no I broke it into much more serious why
oh
I didn't mean to put that there I meant
to put that in run time so also I don't
understand why
oh I guess because it doesn't have a
buffer I guess okay that's fine my bad
okay we're good everything works
C back end
um
I need to implement that
we need to implement this
the good news is C doesn't have any of
these things
barrier is just nothing
uh one too many
okay and then we'll have to deal with
there's no way he left just because of
food you know what
you know what
hmm let's say you've been subbed for
five months I'm tempted to ban you I'm
tempted to ban you
can either believe me or not
you know there is no limit to why people
will get shot in the head like that's
that's the only way to deal with it man
that's just the only way to deal with
that
okay uh
uh CL buffer
I don't actually need prod so this is
just this is just going to do Malek you
need c types we're definitely going to
make liberal use of C types
um
I should actually have the same copy it
and copy out as my lvm buffer
so this is two CPU so that's gonna be
copy out
um
we don't need a contiguous self.cl
ass array
we need a product.shape I think we'll
just reshape it into a DOT shape
oh well we don't actually want that to
be copy
ah I do this in the metal back end right
it's
NP Dot copy2
wait
this isn't making a copy oh no it does
make a copy here okay two CPU doesn't
make a copy this makes a copy okay
um NP dot copy to a
H now for copy in
solve that CL uh D dot C types dot data
broad B dot shape
actually there's another I can just do B
dot size can I not and in numpy what
does size mean
np.zeros let's see so is the size gonna
be
interpret three is a data type
oh okay it's not okay great so we'll
just do B dot size times
okay cool
oh it's not actually CL I probably
shouldn't use that
and just use the generic buff
cool
congratulations you got a timeout
um and if I see you talk again in the
Stream you're gonna be banned
uh because I had to think about you and
that's it I mean that's just that's just
in the new in the new fascistic tutorial
regime
if the regime has to think about you you
know bullet in the head man that's just
that's just
it's the only it's the only way to deal
with this kind of stuff ma'am
or with everybody accepting Jesus Christ
uh into their hearts and if they don't
bullet in the head here we go okay
ah cool
that's right
um no this is nobody nobody is safe what
do you mean one day you're in Stalin's
Inner Circle the next day you're in
Gulag and Siberia and be happy you
didn't get a bullet in your head
Ah that's right
okay
um I kind of hate that we use name name
should go we should just remove name
from everyone name is stupid
like
oh okay
um
[Music]
what is it with named temporary file
can I just pipe to clang can I clang
that
he or X is required oh well I've seen
this before that's actually not bad uh
XC
yeah let's go let's go
now can I clang to standard out
um
let's see I use this stuff in metal
uh so yeah bro
someone you know we can tell this bra
I'm just writing it on Discord
writing on Twitch twitch twitch
writing
let's see back and on Twitch
uh
oh you have to time him out more it was
a test if he talked then we could ban
him
all right because you know half of
being uh all powerful
on my stream is just the random
exercising of power right see and this
is really this is really if you want a
population to fall in line you see look
if you exercise power in limited
uh you know restrained ways
then like you'll get a lot of people who
try to like Skirt the Rules right like
look at what we see in America today
right look at all these companies who
were like well you see technically I'm
not taxable in their jurisdiction
because I've moved my but if you just
arbitrarily enforce the rules and every
once in a while like you know take a
wrecking ball and smash Google's
headquarters like you know what fuck you
you're still taxed in Ireland I mean
maybe you're not I don't really care we
just took a wrecking ball to your
headquarters that's right that's right
because sometimes you just got to do
that right but see the trick is the guy
with the Wrecking Ball needs to be
uh infallible because you know if the
guy with the Wrecking Ball sucks and he
starts smashing things that people like
like Legoland then or remember the time
that the mayor of La dumped sand into a
skate park you see that's what you can't
have you can't have once the wrecking
ball starts smashing things that people
like and not think they don't like like
imagine someone right now took a big
wrecking ball to Congressman buying
stocks
everyone in America would be like this
is fucking amazing wow we love this guy
but you know unfortunately Congress owns
the wrecking ball and it's not even very
good wrecking ball so
um yeah
problem with dictators but I think or I
think or who thinks who thinks we're at
the point who's ready
who's who's who's ready to to make that
leap man who who's ready and it's just
like it can't get worse than this
uh it just it can't get worse than this
and like we just you know it's time
that's terrible code who wrote that
uh you don't know man it can be fixed
really
but really I left that in there I
thought I fixed that
okay never mind we do have to call it CL
well that's terrible
fix that bug
okay
now we just need a GID now I'm not
really sure what we're gonna do for GID
there's a bunch of different ways we
could do this
um
actually the way metal does it might be
the best
of where it uses dots which aren't going
to work
either way I know where I can't really
hurt let me decide whatever we want to
make it Global or not later
oh
why does that work
oh do you think
okay uh we have to add op estimate this
needs to be an actual someone does
someone want to refactor this and make
it like an actual like class with
inheritance and shit
not this garbage this probably shouldn't
even be here
to do remove name
factor out
estimate and man estimate yeah this
should be this the runtime should be
much more generic none of this stuff has
to be here because now you just have
boil the flight that you're copying okay
uh clang return non-zero exit use of
Undeclared identifier GID well that's a
problem
uh if debug greater than or equal to
four print prog that should also be uh
outside
run time
okay so this is the uh program we are
compiling
you can see it looks like absolutely
beautiful
um
see
uh code
okay
um
let me refactor this
where do I have I have a stupid if metal
somewhere don't I
guess okay
um
should we factor I guess we'll call it
extra args
equals this
it goes in metal this is plus CL program
dot extra args
you know it forces you to make things
generic when you uh okay
extra arcs so we're gonna have to stick
that in Cuda as well Cuda has no extra
jars
and opencl has also no extra
metal has extra args clang is going to
have extra arcs too but the extra args
are going to be uh inch tid sub 3 and in
maybe you went I don't know if you went
Works let's say we'll just make it
great quality okay uh cool
cheers
um let me push push this
uh clang dragons
start applying back
people are gonna be like George you
wrote this so fast I can't believe
you're gonna charge twenty five hundred
dollars for that bro like just oh
fucking a man
redefinition of unused CL image from
line
uh
okay
yeah you know it's just it's just
that's it I'm gonna have to sell the
Rolls Royce guys I'm gonna have to sell
the Rolls Royce you know
uh well now we have this stupid crap oh
do I feel important I'll have to import
list
now I need to do colon
see this is something that should just
be in a super class
it shouldn't even be here they should be
in a super class but I'm not gonna do it
now because I'm lazy
okay name CL image already defined
possibly by an import but it's not
because it's in the other side of the
else I don't understand
now what's in the other side of the else
I don't understand
you're wrong
great
uh okay playing back end let's go all
right now you're complaining about
something stupid because what's what's I
never remember the argument what is it l
what builds a library
shared
a shared I think it's Dash shared you
gotta share
CL program is not callable okay that's a
different problem
uh okay we built it but
it wrote something called a DOT out okay
oh you gotta love it oh you gotta love
it okay um
[Music]
fine
where's hash where do I use hashlip I
just don't have to have this code
somewhere should I put in helpers
go
Rock and code
uh FN equals uh temp
slash clang underscore
uh oh and we have to give it a stupid
where do I get OS X I have that
somewhere but I have it somewhere
probably in a pretty unrelated place
yeah of course it's an opencl okay great
um
it's not gonna work on Windows
okay
FN equals clang
uh let's go die lib if OS X
so
I probably wrote that right we're not
actually going to test it
no we will because we'll have a test for
the playing backhand yes we can oh
that's nice we can test it okay
um
Dash oh
f
M okay great look we got a great clang
dialip okay
top five or Dylon Dylon Dylon Dylon and
dialogue
uh we gotta load the stupid Library okay
how do we load a library with C types oh
do I have code for this that I can steal
obvious doesn't do that okay we gotta
just look it up
C types load Library
[Music]
C dll
is it really called cdll
either the load Library method should be
used or the Constructor should be used
C types Dot cdll
and self.lib
print self.lib I wish we didn't know if
Jay actually have to write it to disk
um well actually at least I can do this
uh if
os.path.exists what is that OS path file
exists
do you think after years of using python
I'd actually know this but it's actually
because I'm a junior engineer uh that I
don't know this and if I were a senior
engineer with many years of distributed
system experience than uh you know I
know that it's dot OS path exists
psych I lied
um no one remembers that shit if you do
remember that shit you're wasting
valuable brain space you know
who was at Sherlock Holmes was like
anything unrelated to the case
uh we don't uh remember
okay
um we have to get the oh we have to get
the name name
I'm not gonna work I'll call this fxm
I'm gonna pass there
has no attribute name oh we have to save
name
that's stupid
okay great
we have a funk pointer no you can know
it without Googling I'm just saying
there was that's valuable brain space
that you could be devoted to you know
knowing like all the cast on love Island
I think that's you know this is an
important thing to know let's see what's
in arcs
um args
arcs oh shit this is all wrong because
g-i-d and shit
uh
oh
this is wrong
we have to like add a helper function
called launcher
that calls that function
um fine fine fine fine fine fine fine
uh oh that's just such a pain though
oh man who else hates C
because I need to like wrap it you know
because I could call it in here
that extreme avoid fuckers
I could call the function a bajillion
times but that's just terrible you see
my problem okay so this GID means that
we have to like run with all the
combinations of GID
um but
just by writing another function
we could do this by injecting the loops
in there and just not having did and CID
uh
yeah maybe that's the best idea okay
well
this one doesn't get an extra arcs
either so extra arcs is kind of dumb
uh add wrapper function oh it'll need
multi-threading
foreign
fucking multi-dreading all right fine
you're right if I if I just stick it in
there as Loops it won't work nicely with
multi-threading
I think I'm really writing
multi-threading this is not going to
have performance someone's going to
write multi-threading and it's gonna be
like 50 lines and I'm like bro there's
no way I'm merging that shit
uh
let's think about this for a minute
okay so first off this Max output shape
should actually be uh
no I don't know no we're gonna write it
the other way it's more portable
threading I don't care about threading
this is meant for embedded systems
from type
all right uh
kiss clang
uh
here's my for Loop Creator here
no I I know like it's just it's a
decision that I'm making to not do that
uh okay
listen to my dropper shape correctly
somewhere okay that's fine good
no but you don't need threads threads or
threads are a scam uh what
is DL open failing
[Music]
what
uh probably because I wrote bad code
not OS path exists you guys should have
caught that bug
and then really this is an atomic which
is shitty
uh
never
okay we need brackets
closing brackets
the final one if clang something kernel
plus equals
uh this time is length up top that
output shape
that's right
uh oh no we probably don't want those
no we do want them in group for reduce
uh that's fine that's all right
cool
uh okay it compiles except that we need
some reshape somewhere
uh I did a reshape
I cannot reshape array what
uh oh
this multiplier thing
yeah
yeah see type slip as a ray
does that work
foreign
shares the memory
ah
converted d-type into a c types type
understand though that's a float I
should have the right type
thank you thank you for subscribing
ah
is that quinoa VM
Sylvia why does this work
it's not contiguous dot buff
which is this thing
contiguous isn't something I care about
wait
is this right
what
we have a lot of questions
okay it fails and it fails because we
don't run it so in order to run it where
am I printing logs uh there are none
that's fine that doesn't matter so if we
just do Splat args two should
uh too many arguments okay oh because we
splatted args two we didn't Splat ours
to colon
man
how does anyone program
all right let's see his work
let's see if my clang backend works
uh invalid Declaration of function Max
uh what is it in C it's not Max
implicitly declaring pow
okay how do I get pow and C does that
include math.h
metal has includes I gotta put slashes
yeah slashes
all right we still don't have Max uh did
I mean f Max I might have meant F Max
actually
actually these arguments that those
don't actually belong in the program
there's a declaration of Step oh well
what is that garbage
uh does that work in metal
okay I forgot that clang is slow as
balls
let's go to that true
okay so this is a good trick whenever
you're dealing with stupid instability
um you should always do a OS dot rename
uh now am I gonna remember the Syntax
for this
string destination okay
source
uh because rename is atomic
and then you don't ever get half written
files
okay it's fast uh is that our did we
just try to see back in in 33 lines
yo where's my twenty five hundred
dollars
now it has some bugs
um Dash oh yeah good point Dash oh zero
because it's slow as balls
I'm gonna switch to GCC if Klein doesn't
become faster
so slow
this is so slow
oh I think we should probably do
I'm gonna slash on there
it's like the end of the function you
know it looks nice
how many function calls am I doing one
no no it's fast it's it's clean building
that's slow nothing else is slow like
the ones that are pre-built look at
zooms
but then it has to build boom and it's
slow
uh
uh is it possible that c types is no
because then it wouldn't be faster a lot
it's fast
right up to where I was
it has to build them
mostly
can I write out the compilation speed
yeah
seg fault what
foreign
ear slugs it's got a call build for
every single one of them
oops
okay what's that fault
nothing
is it loading in too many things is the
problem with cleanup or
there might be out of bounds accesses
which is cool actually
isn't it creating process time it should
run as a service
I don't think you can run clang as a
service
I think that works
oh okay we found one that fails
actually it gets the wall of them and
then just a few of them fail okay
except some of them segmentation full
okay
there's something in common that all
these ones use
I forget what it is let's test some fall
this index out of range what
which list index is out of range I wish
I had newer python that would tell me
I don't understand
what okay well this is a bigger problem
because it also affects that uh okay
what did I do wrong
print Buffs
prints first reduce
why would the length of shape trackers
be different from the other lengths
okay Buffs for some reason is shorter so
something's deleting above
that's weird
uh oh no those are just fake buffers
that's fine uh which one's failing
oh it's just this type one at the end
okay
uh
uh
that is fine
this doesn't work for some reason
well that mid shit should work oh
yeah Klein can't group for reduce
it's not a thing
well actually
it can you just have to put it somewhere
else but we'll just disable that for now
uh group
for reduce
are we grouping
the only thing that can add to that is
uh
if not clang at
so we're gonna do it down
[Music]
it's another place I had to group for a
juice right uh that's only Authority
that's fine
equals one GPU equals one
uh test Ops
okay segmentation fault 11. what's
happening
something is probably accessing out of
bounds memory
which is interesting
no group
or reduce
what's accessing out of bounds memory or
what's going out of scope even scarier
something's going like out of scope
before it finishes
whatever it's pretty good
uh okay
so what do we want to run
how slow is efficient in that remember
do we does that example still work
remember that old example where we could
see uh
we could run it on the webcam and it was
good
got away from doing practical things
sweatshirt oh that's pretty good wow
this example still works
that's sick
hairspray all right
see if I run it with GPU equals one
is it faster
marginally
it's marginally faster
were you getting a crossword from
coffee work okay how about my remote
remote control all right cool uh see if
we can replicate that in C that will be
our that will be our example
foreign
foreign
all right let's go
I didn't even do the thing that I wanted
to do
one minute and see no it shouldn't be
that slow let's see how long it's gonna
take I forgot I want to actually do that
y equals one
all right hang on it's got to build the
20 million kernels give a second
it's building kernels
okay so that's how long it takes and see
and it would be great except for the
fact that I think it's wrong
unless is that really a website
no remote it's right
you just thinks I'm a website now
okay I mean that's how slow it's gonna
be and see it's actually going to be a
bit faster because we're going to put it
in one thing
okay
oh my God I'm gonna have to write C that
sounds so painful have you ever written
C it's actually one of the worst things
ever to write okay first off we got a
unique names we'll steal this from
opencl again we need to genericize this
Behavior
um
so Prague
use rust oh should we should we try it
from rust you guys I can write it and
see or I could take five times longer
and write it in rest is that what we
want
you guys would love that you guys would
love to sit watch me struggle and be bad
at rust you know
uh
okay
no where's the Hairspray
just Hairspray
I mean to be fair it looks like
Hairspray water bottle
I'm not a website
um
okay
wow can you believe that example still
works thank you to everyone who's kept
the example still working
uh because I know I haven't done shit
okay
um
let's create an example
called compile efficient net
to figure out why it's seg fault
sometime I'd be interested too okay
um model load from pre-trained
uh get him
no you don't get a choice you get zero
things on the Pirate Bay all right all
right great chat great I'm gonna start
calling you chat because that's what all
the other streamers do okay
uh model pre-train blah blah blah blah
blah
uh image
I'm still like ran down what does it
have to be
like does that run the model
I think that runs the model okay
uh clang equals one
uh
uh confused with one
so let's actually wrap that in tiny jet
I should probably wrap it in tinyjit
here too
function called infer
I should just wrap that in tiny jet
um
ew why do I call it forward forward's
the most disgusting thing
uh run X
model dot forward x dot realize
okay
okay I just changing the old Power
compiler
tiny jet
tiny Jets
um
run
uh
okay realize boom boom boom boom that's
good
um you know it's not actually a GPU it's
kind of a terrible name
ew why do I do dot CPU that's crappy
code too
do I really dot CPU here like I
converted to the CPU like that's a real
thing that works
for
yeah we do dot CPU wow can't believe any
of this code still works
all right cool oh that works
okay
um we wanted to actually jit so we'll
run it twice
to run widget
okay now it's actually in the jet
should be able to say print run.jit
cache
guys I tell you this stuff's like really
fancy now
uh
uh all right back to subscribers only
uh what the hell is this
oh that's the jit cache okay cool uh
yeah so we have this thing called a GPU
Runner uh you can see it in the top of
GPU here
so now if we want to get all the
functions that actually run we will just
look through the jit cache
uh for
X and run dot to cash print x dot clog
uh Seattle Dog dot Prague
what's that
Tuple has no attribute
clog oh is the jit cache oh okay because
the gcash is the uh function and the
args
so we actually want to look in the
function here
okay great so those are all the
functions in uh
wait that's terrible what
why is it that
try to fog
oh
okay
check out all my beautiful uh
C functions
okay now we just need to create a main
function to call them so we'll call
helpers equals that
um
then the thing that we actually want to
use to call them is going to be
function.clpog.may look we use name uh
we have to assign each argument
okay
what are the args we're gonna have to
we're gonna have to like create buffers
we're gonna have to use like Malik and
chat
foreign
we want to get the real buffer I can do
that with DOT CL
IP why Malik just big arrays oh you just
don't want the Heap yeah you're right
that's easier I will do that good idea
um thank you that's why you're a VIP uh
the actual underlying I don't care about
any of the other stuff okay good those
are the underlyings
this should just work right
I just have to name them
how do I get a unique pointer to that
should I use ID that's kind of terrible
it doesn't even work
oh because clogs oops
okay
um
Buffs equals this
can is this allowed
or is it gonna complain that like that's
not a hashable thing
unhatchable type okay great
okay uh four are in
args uh r dot CL
uh I can get the size two
sea float array has no attribute size
what attributes does it have
length oh I'm gonna just do length
okay 128. uh is that actual 128 or is
that all right fine whatever
okay um Buffs
if idr.
key just in case I can change it
see now in Buffs Buffs up to key equals
buff
underscore buff num
probably like a nice like one liner that
does this you know what I'm saying you
see what I'm doing here right I'm just
like assigning the buffers
uh names okay
and then we'll call them sea args
CR VR starter pan graph sub key
parentheses
comma join C args
this is a good old school programming
stream you know
uh
okay
there you go those are the calls for the
net
uh put a space in there
okay now hang on
okay those are the statements that's
good
we need to declare the buffers
uh if you can't actually what did I come
up with
length r dot CL
and then see how he's got a pen that
because we also have to do the buffers
themselves
uh okay we don't want them on the stack
we want them on the Heap
so okay let's write out the C program
now
um
helpers
classification you want to declare the
buffers so it's float
x sub zero oh this is real this is
really this is an old school programming
stream if you guys can follow this one
you're good
uh
for x and
uh Buffs dot items no it's actually
about values I don't really care about
the key that's good plus date map plus
uh in Main
uh plus statements box close bracket
uh we also need some stupid includes
oh I can only concatenate lists not
strings to list okay where did I do a
string oh that's a string
okay
that should be an efficient knack
pipe it to climb uh
XC Dash
okay we redeclared things because we
didn't do a good job with the names
I thought I fixed this
oh I don't actually set it ah okay I see
uh I have some stupid play yeah I gotta
do that
too many arguments to function call
what does that make sense
[Music]
oh uh this is stupid okay hang on hang
on where is compile efficient at this
args is you've just gotta do that which
is like it's a stupid thing
huh
okay don't work
you probably started with a simpler
thing and like gotten that to work
uh okay
no okay that now that args thing's wrong
never mind
it doesn't include the uh the extra two
many arguments to function call
like did one have a bajillion okay
oh
what did I do
let the non-subscribers talk maybe one
of you will actually say something smart
why does this not work write it down
all Buffs to delete
we gotta deal with Buffs to delete ah
there's another here we go here so it's
this uh for I not in Buffs to delete
kind of stupid way of dealing with this
I deal with this in a different way
in uh
I do this in a different way and if I in
uh ARG
is he programming in c using python
if I not in uh
function.clberg.puff
I in function.cl products that Buffs to
delete continue
that's right
okay now we just forgot one what Ops
Triton
oh because that stupid thing
uh
foreign
program has no attribute Buffs to delete
because it's not in a CL program it's in
function boxes
there we go type that decline
okay it's only complaining about the Ops
tribe thing uh uh where is that
done that's in lazy
how do I print a standard error and
python
I'll equal system standard error
okay
that runs an efficient net
uh do I get annoyed that out I better
okay good
compiles
how is what buffer fed to the next
function
just name a buffer is the right things
right
uh okay now we're not done we still have
to load the weights
and identify the inputs and outputs
yo it's fire bro
should we just put them all on one line
it's kind of a lot of lines
um okay so some of these are buffers we
have to save
I have a lot of this still a lot of this
logic is repeated from uh
from the open pilot compiler
oh this is also wrong uh I have to do
length if I I happen to know that one
and that's the wrong length
which actually
makes me wonder all about a lot of stuff
but
because that's 1 000 right
okay
some of these buffers have to be saved
uh
I mean this is a little aggressive don't
you think like putting that on one line
like that
you just print them right
could we put this in it because there's
like an auto formatter for C
I want a web one
clang format perfect
I don't have client format uncrustify
some stupid like python thing to do this
if I don't have client format
Brew clang format
clang format also known as clang format
15. yo please Brew don't update seven
million things I know you want to I know
you're so oh
no no okay just claim format just climb
format oh thank you
pipe it to brew install planning format
just private declining format I would
say
oh it's gonna use it's gonna use eight
tabs
there wasn't so many of those it's a lot
of buffers
I think we can reuse a whole bunch of
them if we actually get the cash working
pretty beautiful right
beautiful C code
all right
probably don't actually want this to be
main we probably want this to be a
function called like net or something
and we want to identify the inputs and
the outputs
um
hey do you think chain remover would
remind if we played Daniel remover music
I kind of don't think so
like you can't really like like there's
a level of artists I mean I know I'm at
that level by the way if anyone ever
wants to use my songs in streams feel
free to because you're spreading the
word man like that's I'm not gonna you
know like we're trying to make money off
time grad contracts but we don't have
any tiny grad contracts so we're gonna
have to sell the Rolls-Royce because
we're going broke boys we're going broke
we're going broke we're gonna have to
sell merch man you want you want to join
the you want to join the low gang you
want to join the low gang and buy some
of my Maverick merchandise
foreign
Maverick merchandise do you want you
want to buy Maverick merchandise and
join the low gang
we just steal Logan Paul's or what can
we run nft scams is that what Logan Paul
does
okay
um God I'm gonna have to use like lib
JPEG and garbage
to like load a thing
you could buy a merch oh well thank you
I appreciate you but I don't actually
know like am I just gonna load this in
Python now we're not going to load this
in Python no no that's so cheating if we
just load it in Python ugh
how do we load a image and say
I'm gonna do this we have to link to
opencv that sounds terrible we didn't
have a cheap eat scam so I can lose
another five thousand dollars
uh did we get eight teraflops fuck we
got 8.46 teraflops we crushed that shit
all right great uh my net runs uh
let's go let's go
um suck me off George what the fuck is
that shit you get out of mine get out of
my thing get out of my thing I'm not a
whore
um
that's right that's right uh
I'm gonna warn Alex that we're streaming
20.7 will be better yo you want to fund
8.7 if you the tiny Corp is a bunch of
whores man you can contract us to do
almost anything as long as it's tiny
grad related and kind of on the
mainstream of uh
of of of shit uh George you look cute
today get the fuck out you know what
subscribers only subscribers only that's
right if you guys can you who can follow
this oh
my twitchies
why
no I'm arguing with the twitch
subscribers it's okay
they're aggravating me this morning
what did I do why didn't you ask what
they did
you said they're angry with me no I said
they're aggravating you oh they're angry
at you
no
still have a high ball brother good
to close the door and I love how you
lock it please
oh okay
can you guys follow this
this isn't that hard is that
look we just
we output it here
we'll make it we'll make it good for
noobs
call it noobs.c
we're gonna have to save the weights
I don't want to open oh that was a
mistake
oh yeah of course it's gonna open it in
fucking xcode
okay you see this program
the C program hang on before we do that
let me pass it through clang format
I don't like that it like puts things on
the same line but okay you see this C
code here
this C code was automatically generated
by tinygrad
and it runs an efficient net
foreign
actually
is a little annoying because this is the
act this is the output
yeah I guess it shouldn't matter
okay
so let's look at the open pile compiler
to see how to get the inputs and then
we'll just go call them input and output
that sounds like a good idea and that'll
be the API because they're Global
buffers and then we'll just like link
them to there
that sound good
so it automatically generated this C
code which runs the efficient net
now this is actually
somebody to do
it's the most portable C code ever it
just uses math.h and if you don't even
have math.h I don't know what to tell
you
does it run yeah
does it give the right answer you know
that remains to be seen
oh okay
let's look in the open power compiler to
see how I get the inputs
I think I get them if need
it's okay do I just get them there
okay
inputs.ladidated.realize.cl okay
uh fine
we'll call this the input
dot input
now we have a special name
special names
the output oh do you like my names
the input and the output and we'll call
this name input
and that one will be
no hang on
I think what I want to do is this my
input dot lazydata dot realized Dot CL
call input
then we'll call this one the output oh
this is quality this is quality
uh how come it doesn't know what that is
type any
I should fix that
should know that realize oh
maybe because I did that do you realize
say that it returns a tensor
it's gonna be able to infer that
hang that light up
no because tiny jet tiny jet can
actually return anything so that's kind
of fine but whatever we'll just leave it
there okay
um
if key in special names
else that Puffs sub key equals special
name sub key
actually
I don't think I have to do that I think
I can just say
offs can I not
oh no because
sorry about the bad code
kind of ugly
let's see if we actually got the names
we wanted
okay you see how that one's called
output yeah hype train let's go let's go
ah
uh I was doing extra computation too
which you don't actually need but
there's the input it like pre-computes
some yeah what was the problem with buff
sequels because it doesn't have the size
the problem is you have to add the size
here
all right that could that could be
cleaned out if someone wants to clean it
off I don't care uh okay
um let's do a argue let's write ARG Max
for uh and I equals zero Pi less than
one thousand I plus plus uh
say best
equals how do I get infinity and does
that work
test ivx equals -1
if outputs sub I
less than best
equals outputs of I best idx equals I
gotta love C
f
um
we shouldn't load the weights
don't forget a semicolon
ah
you should probably call it outputs
or should we call it output I don't know
less lines to change
use of Undeclared identifier Infinity
C flow Infinity
oh do I write big Infinity
macro float Infinity
how come I didn't print off my category
category zero
it might be right
I mean to pipe actually no piping's
wrong semicolon's wrong and is right
okay
foreign
we need to load the weights and we need
to get the input
okay for weights I have a weight
detection algorithm
in in need
oh do I have it is it in here
no it's in the need okay
okay so the quick way to find the
buffers to save
is to find ones that uh
just different ones that are not used as
outputs
no it's I mean it's a little more subtle
than that
we want to find the first usage of
something and if the first usage of
something is an input
then it's an input
but if the first use is just save if
something is an output
then it's an output okay
so
if I
not equal to zero
offers
stacked
we can generate a header file with
weights well yeah but that's gonna be
really big is that really what you want
to do
I'd rather I'd rather just uh
like save a contiguous file
you know
so the hype train ever fail hype train
failed
um
I mean this is actually probably the
right way to detect which buffers to
save it like makes like a graph
uh
is there a better way to do this
I want to know what the first usage of a
buffer is I want to know if the first
usage of a buffer is an output then we
don't have to save it if the first oh
this is okay this is the first usage of
a buffer
um if the first usage of a buffer is an
input
uh then if
I greater than zero Buffs to save dot
add key
okay first usage
is not an output
uh we can also do Buffs to save
minus equals
um
the input
don't save the old
uh what does that start what was python
set remove
what happens if you remove
a Chiara Stone okay that's actually what
we want
uh
we gotta
have you tried the language translation
features from GitHub
yeah but this isn't actually translating
the tiny grad to see that's not at all
what it's doing
it's outputting c that runs the uh that
runs a thing okay
for be in Buffs
what do you mean if not an output
oh you're saying just put it in the
okay fine
good point
yeah yeah okay fine
cool
uh okay B and Buffs to save we have to
save it
it's open temp dot weights
ah
WB as X
okay if B is in Buffs oh
not really what we want
foreign
okay cool
um
playing
as much as work
too many weights are zero
tragedy of all the zeros
you know
how big is that
it's probably right the zeros are
probably just a part of that I don't
know
seems like
it just seems like the size is wrong
what do you mean Matrix
yeah this doesn't seem right
the winter
and that should be the real weights
right
we should load them
yeah model.load from pre-trained okay
foreign
check for each buff that it's not zero
well either way we're like mostly right
let me just uh let me just finish this
I included Matt that age yeah I got it
um to see if there are zeros written out
yeah I could
it's an open better here why
I always forget which way every goes
pointer size
number of elements stream okay
uh
uh okay if you want to know the buffer
name
oh what the hell am I doing of course it
didn't work
you see what I wrote
uh dictionary iteration order is fixed
hang on
this is
sorry I'm tired okay name
ARG I'm about to save see I knew I'd
figure it out okay uh so here we want
the name of the buffer
class name comma one comma okay here we
want the size of the buffer
plus length uh
I've got CL
a it shouldn't be r dot CL they should
just CL
's a stupid name
uh for our name comma CL and that's the
same
foreign
foreign
foreign
foreign
foreign
cool
is it right
category
no that's not really what I expected I
thought everything was less than
infinity
even worse more weights are zero and the
weights file is bigger
yeah
why do I kind of feel like
this is writing like way more than it
needs to
there's like a bug
all right
do I concat to the file
no
bytes like object is required not list
and I've got to tell
okay I was just wrong uh
yeah see look f.tel is 512. this just
bugged
some c-type's bug
well I'm using it wrong one more lively
81 Megs again
thank you
this doesn't make sense right look
that's 128
and that's 512.
unless oh is this floats
I mean
whatever
by the way that's the right size
all right category
negative 596.
with minus 34.
all right we're going to link to lib
jpeg or something how are we going to
get an image
thank you
are we going to write a BMP loader
oh apparently my thing's the wrong way
what
okay if outputs is less than best
oh I was expecting an ARD Max you're
right
okay category 486. uh we actually have
to get these categories let's just do
that
I don't have to figure out how to
actually write this and see
which is already there
it's kind of terrible I wanna
opencv for c yeah but then I have to use
opencv and I have to link to that oh God
uh
can I make an array of strings and see
I feel like you can't do that
foreign
[Music]
oh here we go array of pointer strings
okay that's what I want
those Barrel being water
when quotes
foreign
PNG format is super simple to parse but
I have to link to uh
uh-huh
I'm very upset about all these things
I'm not linking to open I don't want to
link to opencv
um PNG format at least requires me to
link to zlib
which is only marginally offensive
I've never even heard of Targa
ah
do you want to read or write an image I
want to read an image
I'm I'm this close to piping it from
python
we could pipe it from python what do you
think
no it has to be standalone
okay we'll link to fucking lib jpeg what
is it l jpeg I got a link to
how do I use lib jpeg
C example lib jape oh and then I have to
resize it
I never even heard of that like at least
if I type ljpeg I probably have that on
my computer
Library not found for lib jpeg great
simple jpeg IO with lib jpeg
oh
[Music]
great oh that's
how I link to it
it's not ljpeg
the code does not perform
proper
I think to live jpeg
to lib jpeg you need to be making it
part of
L jpeg this assumes that lib jpeg is
installed on your computer
God
okay well
I have to install lib jpeg Dev no I'm
out I'm out
okay fine through install lib jpeg Dev
I can install lib poker eval sorry
Brew install jpeg now I'm not happy
about this can I link to PNG
no I can't link to PNG
bitmap of bitmap sucks
I'm trying to link to a thing that uses
you need to rearrange the order of the
libraries
lpng doesn't work
you could append your code
is PNG simple
is PNG simple
uh PNG header
load PNG in C header
yeah I'll link to live I'll link to to
zlib
great it's a visual studio approach
LCL
[Music]
C link to open oh wait no what is it
what is it not oh and CV that's what I
want
there's no way this is gonna work
CV2
dude dude this is the worst part of C
I load a picture
okay STV image
you would already have a Target what
what is this
single file
wait oh
public domain image loader okay can it
resize
I'm gonna have to write resize
I'll live
oh stb image resize oh well now I'm
downloading two files
foreign
size you guys can see what resize looks
like it's not that
because we have to convert it to float
anyway
okay stb image seems like the way to go
foreign
wait I have to define something no no no
no I don't want to Define anything
before you include the file
need to define this before including
all right let's download an image that
we want to recognize
I know a good image
it's actually already in tiny grad
stable diffusion by tinygrad.jpeck
all right so how do I use this thing
uh
uh
stbi load
file name
X Y desired what's an stvi you see
I'm worried about this already
image equals
we'll deal with that in a minute
load
load
foreign
copy the actual
tvi load
file name is RB sub 1 and X Y Chan
X Y chain
desired channels three
loaded image
the Chan
oh
slashes
okay cool
um we are going to have to we'll just
write resize manually
it's really not bad uh okay we have
something called
input which has size
one three
check
uh let's just look at it for a second
and make sure that that size is actually
right
3 224 224 is that
okay if we didn't put I expect it to be
that
it is okay
um
now we just have to figure out how to
get things from
stvi UC
what kind of thing is this you know
there's probably just docs for this
right
are there Docs
or they're not box
oh I love the these people are thinking
the right kind of way I like them oh
they have a Twitter
oh
yeah okay uh so
what kind of output do I get
yeah it's great that it's unsigned Char
but that doesn't help me because like
what's the format
uh uh okay
is it RGB or BGR
and do I wanna input things in RGB or BG
I don't know let's just assume it's RGB
let's assume channels is at the end okay
so uh four and Y equals zero y less than
224 y plus plus
we'll do the same thing for a good old X
and then oh one of these aren't right
um
search chance three
if it makes me include a cert
make me a clue sorry okay
there's no Docs the docks are a lie
we don't need docks it's simple and good
okay
um
X
okay x divided by 224 point
times x
t y so we're going to say input Sub Zero
times 224 224 Plus
y times 224 plus x equals
image sub
TX times right t y times
X
get
sample position
times x times 3 plus
TX times 3
plus 0 and then we also have to okay we
have to do some normalization
um
divided by 255
minus
0.5
kind of dividing it by
the optimizer deal with this
minus 0.45
divided by a point
two two five something like that
something like that
tabby cat boom boom first try boys first
try
easy easy
right all right now let's just get rid
of including stupid uh temp
not do this
let me uh image Library
frog plus equals
TV image implementation
and instead of including it
I do wonder if I can just do plus batch
I'll be able to do that right it's what
a preprocessor does right
uh
get rid of that
oh by the way thank you for the spb
suggestion chat
uh
expected string instance bytes found
yeah that's fine
uh decode
it didn't light up yellow I should have
known
beautiful
um
okay I sort of feel like
should we include the weights
I don't like that it has to load the
weights
is there a nice way to do that though I
mean they're huge
parsing that's going to take forever
it's 20 Megs of shit
20 Megs of shit
all right let's just let's just
let's just prove that we are uh you know
not just just making shit up and uh you
guys can link an image link an image and
we will we will try running a DOT out on
it uh oh that program is disgustingly
huge wait hang on
also is that even optimized
it takes one second
but it takes way longer to compile oh
boom that's so much faster look at that
it's so fast
O3 decline we pass in O2 I don't like O3
oh truck who trusts O3 not me
finally embed in c23 oh we can look at
that
okay Coca-Cola let's go
all right temp code jpeg
packet
it may not have anything it just may not
have something for that though
I don't know if that's in the imagenet
categories you have to give me something
that's in the imagenet categories
c23 I'm not using c23
uh
uh okay I mean we could base 64 encode
them
I don't like that but
okay no remote controls are in there all
right let's go
okay this is the remote control we are
recognizing
remote control
I know I can use the Linker but I really
don't want to use the Linker okay we
gotta just
I don't know this is terrible um we have
to use base64 and we have to include
them
all right we'll try this banana I would
do your Petco but it seems like glitch
okay 160px banana ink
banana
yo this program is sick okay hang on
uh we need to get the weights in there
should we use the Linker
okay you gave me data I don't know if
that's gonna work
so it's not gonna have shoes
uh okay no no we got to get rid of the
weights this is a good point we have to
link them
let's link them let's figure out how to
link them
we'll use a Linker
um
I mean really the thing that this
produces shouldn't be
well well I mean making it C is cool
oh you know what it's not actually that
big a deal hang on hang on hang on
no no we're not going to use a link I'm
not gonna use a link we're just gonna
we're just gonna do slash X I mean it
makes the thing big but does it really
matter
I can do I can do like slash X and C
right
so I can write something like
like slash X you know
like this
it's going to take forever in Python
alone
like that
that's a weight right
I mean that's terrible but
foreign
[Music]
unsupported format
no we need this to be bites
piping it anyway
actually I can just use that as an
initializer can I yeah why would I meant
coffee if I have a buffer you're right
well this is going to actually make it
faster
when I declare the buffers yeah what am
I doing
just increase the pointer for each
buffer
that's an idea
let's just see if this works first and
then I I gotta clean away even
expected expression oh we got to put in
quotes
I'll just like set it equal right I can
set it equal as like an initializer
I'll cast it and then yeah
this is very slow now though
cool
okay it's actually slightly slower which
is interesting
let's also see how big a DOT out is okay
that's kind of big
but
uh let's fix this
no I don't want to do Basics before I
definitely don't want to do Basics
before
um
foreign
uh oh okay we have to do the buffers
before the gnats
cool
um now for these ones I should just be
able to like I should be able to like
use an initializer right actually I
don't even have to use a string
I Can Do ox
comma
your image lib fetch is probably taking
a while now it's cached
promise you that's not
so
you need this
I don't need hex at all I could use
decimal what's shorter
probably decimal
now you're saying I do one big thing and
just assign uh assigned pointers
yeah I can create the buffers 100 files
what I'm doing right
so not what I'm doing
ah
okay
labels actually let me move labels down
I'm upset about labels but I'm not that
upset about it
that's fast it's it's what compiling it
can take 10 seconds I I can't be crazy
okay so first we output all the net
stuff oh yeah this is some bug okay
um
join
stir X
what is that why is that like that
oh uh no
you probably got append
the net functions okay these are the
empty ones and then this is where they
start to get uh not empty
that looks reasonable actually looks
like decent code
incompatible integer to pointer
conversion oh they're ins oh that's not
what I want
you know
I mean I could write out the floats
I could literally just write out the
floats
no no this is wrong because those are
integers
do I just want to write out the floats
I don't think I do
why is writing up the floats better
no and they're easy to make floats
that's not a problem
less of them
but floats have a lot of no I hate
floats
I hate floats and I want it to be the
exact value it won't be the exact value
if I do a float
with an expression of type it
oh I finally could be floats I don't
care
does that like print out a float
yeah I I I've regret The Hacker News
about testing the floats too
join star CL
uster X for X in
CL sub
no it's gonna memory
let's get rid of the bytes
shouldn't need that
memory view unsupported format
bitch at me and Tommy it can't be a list
or something
maybe not
well this is the slowest
oh god what happened
just wait already
one two three all right it's not too
slow look how long they are though
they're so long
whatever it gets piped to the compiler
put it in the pipe just put it in the
pipe
warning access elements in scale or
initializer
oh
um
foreign
we don't need load weights anymore now
do we
I thought that was ever going to be okay
so slow
it was faster when it was not floats
right
I don't like that it's floats
how long does this take
four seconds
how much of that time is actually spent
on this stupid line
most of the time
uh uh why did I delete the thing that I
was doing with
if I do bite since
the faster
after it crashes
float object cannot be interpreted as an
integer
slightly faster how about when I private
to uh
private award count or something I trust
that more though
foreign
seconds to compile and most of the time
is spent on the stupid weights
uh
how much bigger the floats are smaller
72 Megs
106 Megs okay
the floats are bigger
uh no I don't
know not that
fast as that
slower and bigger
[Music]
binary data in C header
[Music]
data is stored as a character array
I think I like that one the best
fast small
go find those lines
should we add some uh
line breaks in
like after a certain amount of numbers
let's check it for correctness
so slow
painfully slow
okay well at least the thing is fast at
least the the outputted thing is fast
um
I'm actually pretty happy with that I
think that's my might be what we get
so we can stick some more times in here
if you want
okay so python takes four seconds
oh by the way to print like that not
like that
that's cool
someone who did time is smart
okay clang it slows balls
okay so clang takes 15 seconds
okay how much faster is it without
O2 15 seconds is actually not
unreasonable
to compile the weights one time and then
link to it yeah but then I have to have
another file I'm not doing that
okay
I mean here's another idea
how much of clang is spent parsing that
stupid thing
a lot actually
let's try one more thing
uh
that might be faster to parse
or unicode
what
technically we don't need to encode them
all like that just if they're
unprintable
we'll just see if this makes clang a lot
faster that made python slower oh but
it's made clang a lot faster interesting
interesting okay so clang's a lot faster
at uh
let me just pipe this through t
I love temp temp's my favorite folder on
the computer
um it is adding a slash zero to the end
of this but this is the fastest
this makes clang twice as fast
uh
cool
yeah I like that makes Klein twice as
fast it's probably a faster way to write
this though
is that slow
I wonder if this is faster
I love that
it's the same thing right
sweet okay I'm happy with that
they're just stupid strings
are we happy with this boys
get rid of my comment there we don't
need that
space is there make it a little prettier
that's a fine comment
I was I gonna complain I I have a
feeling my pie is gonna fail because I
made that realize change come on my pie
oh good you got it yo that's fire bro
we have a completely portable
application that runs
the classifier
and it wasn't really fast
like this isn't slow garbage I'm so
happy we didn't load the weights we got
rid of all the copies look at the real
Time That's so good now
it takes 300 milliseconds like nothing's
that fast
and it's a completely portable C file
just 85 megabytes
I wonder how many of the floating things
are we can get away with not doing that
not doing slash X is there a faster
encoding
nothing's one minute yeah we didn't need
threads
takes that long to even do a pad create
P thread create takes 300 milliseconds
it's true I wrote it on unixfacts.com
all right do we have any other pictures
we want to try
uh oh actually
I want to do one more thing
uh uh
so I want to support like wagette
pipe to a DOT out
yeah okay but that fails okay um
how hard is this to do
three FPS
load from file
uh okay this should actually be pretty
easy
if
ARG C is greater than one do that
else
and the file I want is just standard in
does that work
I'll have to recompile it
insertion failed
oh because you can't do a gat uh curl
okay except it thinks it's a match deck
why does it think it's a match deck
wait it also thinks it's a Matchstick
there I thought the banana worked
does the banana not work
foreign
does it think everything's a Matchstick
oh something broke
oh oops
uh no the banana works the banana worked
uh hang on no I found a bug but hang on
I just want to see can I write this as a
what's the uh
England
should we give it a name a DOT out or
should we give it a real name
should we call it recognize
no I like a DOT out a DOT out it's a
great name
someone else can call it recognize
right like I could move a DOT out into
is there do I have a recognize on my
computer
foreign
so now
um
do I have like user Ben
is that my path
it's my path
cargo bin opt Homebrew bin I could
probably put an October bin
MVA dot out opt Homebrew bin recognize
okay now you can just type recognize and
it's a universally useful tool you can
just run that on the image we can sell
it to blind people
think about it think about it we could
there's definitely a big market for
blind people you can also just pipe
things to recognize this could be a
universal Unix tool look you don't even
have to be in this folder anymore I
could be over here and I can just pipe
it to recognize is that not is that not
fire guys
um
so where has been what user bin is
usually the
yeah user Ben ah
install
with uh
MV 8. out
sudo mva.out user bin recognize
record nice
to our
what did I do
oh do I have to say
maybe we should maybe we should
60x141 C3 category 954 banana with
8.654804
bro
wait wait should we just have it print
out the category though
uh
debug equals get in debug a toy
uh
guys we have to think about
accessibility here okay
what
guys we have to think about
accessibility accessibility is very
important
think about think about it
yeah I know but you know all blind
people have Max it's true I read it on
the internet
uh
okay so debug I think works
so we'll say if debug
if debugged
house printf
label sub best idx
foreign
so now we can run it with debug equals
one and get the fancy output or we can
just run it like this all right hang on
we got we have to reinstall it let's
reinstall it
now
when I curl a banana recognize say
banana yeah
yeah
did you turn that into a sample and put
that in Ableton and download some other
samples from splice and then we gotta
get some fat 808s on there you know some
fat 808
right right and then we made a hyper pop
song and that is why we were here in the
first place yeah
this is completely portable recognizes a
completely portable thing it can it can
run on Raspberry Pi yes
um it can run on
a-l-l-y that's right
MK welcome thank you imagine oh shit we
just committed Three Bananas
remove all bananas
foreign
yo yo this tree's pretty good guys
all right come on does anyone does
anyone else want to does anyone else
have another image
we don't even have to look at it now
does someone want to set this up as a
Discord bot
oh all right let's just make sure that
my compiler still works
without all my times and my T's I don't
need T's
can't believe I was going to save the
weights that's completely non-portable
we need portable this thing is now a
super fast image detection tool yeah you
can run recognize you can compile
recognize on your computer and it runs
anywhere I did hear the new simorsi
dream song Kathy never broke again it
was okay it was okay not not I need I
need more bangers like ritual
um what is Mac camera what is this
though
oh is it a one liner to use a picture
with the
Brew install image snap
that was very slow
wow I look crazy
is that how I look in the Stream I look
crazy
we need warmer colors on this
I look crazy man
we have warmer colors how do we get more
oh I didn't turn my light on
oh no wonder I look so wow I look like
an evil villain
I look like an evil villain oh
oh that's not very accessible
you need warm warm be warm ah there we
go yes
what my light's like broken
so I think color temperature is so
whatever
I'll take it
yeah yeah but you know we don't even
have to do that like
all right fine
no but it has to like open it Hairspray
huh
remote control remote
spatula
poncho
[Laughter]
Hairspray
sunscreen sunblock sunblocker this thing
does not Vape
oh
sunscreen
this is the most base thing I've ever
built on stream thank you thank you we
did it all for accessibility
okay
[Music]
is W the standard is the problem just W
can I just turn the W off
why would I want a w
oh yeah
why'd you put why is W on by default
whoever wants w
Hairspray
Hairspray
beer glass
water jug oh spatula
plunger plumber's helper
punching bag punch bag punching ball
punch ball
hand blower blow dryer blow dryer hair
dryer hair dryer
remote control remote
Band-Aid
hand blower blow dryer blow dryer hair
dryer in more categories
Hairspray
vacuum vacuum cleaner
ski mask
ski mask
Triceratops
space heater
upright upright piano
accordion piano accordion Squeeze Box
accordion piano accordion Squeeze Box
upright upright piano
hammer
boa constrictor constrictor constrictor
no no green fish crawfish crawdad
crawdaddy I'm gonna get sued for it not
working spiny Lobster slangos Rock
Lobster crawfish crayfish sea crawfish
I'm out of stuff
upright upright piano
wallet billfold pocketbook
pretty good
cry daddy that's right that's right yo
you guys can just use the recognize tool
whenever you want anywhere you go you
need something recognized you can just
use recognize it's completely portable
like if I'm just searching the internet
and I'm searching for a picture of a
Triceratops try Sarah tops
I'm like oh what is this a picture of
well I can just copy this image address
and I can curl and I can pipe it to
recognize
and it'll print out the word triceratops
and then of course you can pipe that to
say
Triceratops that's right
[Music]
you know keys can be reproduced from
Stills if if you're going through and
you're reproducing my keys I guess it
actually is pretty easy
it's an interesting point
hmm I want to send two of those in the
video
[Music]
Triceratops
game changer
uh nah but you see if you break into my
house we got a legit security system and
I will come and fuck you up I would love
sending people to jail I've got a few
people sent to jail in my life love
getting people sent to jail but only if
they're criminals
a gun no we just send them to jail and
it's the best you get to use the power
of the state to yeah you know what I'm
saying
um
all right
no actually I've got people sent to jail
though don't do crime
uh and look I'm not talking about like
look no one's ever said anything to jump
with like drugged or stupid shit like
that I mean like crime where there's a
victim you know
uh uh we gotta make crime illegal no we
really do we really do
can I clone a Triceratops well
all right
are we done
foreign
man you know I looked I look crazy
I'm sorry I'm new to Tiny garages I have
any Docs
um okay so wait wait no we gotta we
gotta distribute recognize
we gotta we gotta put recognize up on
the website
it's a standalone Mac utility
I think I have the website
tiny XXX little secrets in here oh it's
just
uh we should really zip up that c and
put it somewhere
people won't trust it if we don't
distribute the safe I just distribute uh
uh a binary people won't trust it
the plot recognized Etsy
and then we'll have a one-liner to
compile it on your computer so it's
because it is completely portable and
that's like the coolest thing about it
all right so what's the one-liner to uh
actually the one liner is going to be a
will get pipe to that
you recognize got us yeah I recognize
God as viewers
uh all right we're gonna have to g-zip
that or even better XZ now we're just
gzipette
um
small does it get
all right 28 Max that's fine
uh
update
produce
100 percent portable C code to run to
our models
uh
this has to come on we got to get on
Hacker News for this if we can't get on
Hacker News what are we doing uh okay MV
recognized gz.c uh
clang okay we wanna
Pearl
uh it will be tinygrad.org slash
recognize.c.tz
pipe to
playing oh recognize
ah
and then
recognize oh we're gonna have to
that's it was that banana the banana is
always good
but now it's not going anywhere right
you should add the commands to generate
it yay that's small
where's the banana
uh we gotta pipe that through gunzip
and it never hurts to throw time on
there uh you know what I'll say debug
equals one and maybe we'll add timing
info to
that's really hard to do and say but
whatever I say debug Eagles won
uh
see time
no anything I add makes it less portable
I recognize
uh oh this isn't that doesn't actually
work and does it work and
foreign
can I get a small URL with an image
that URL is too big what's a code block
does this actually valid HTML
foreign
can I get syntax highlighting though
it's actually a code
no I don't like it I'm using priority
I'm using a monospace font already I
don't like it it's fine it works uh
foreign
URL for a
uh you want Hacker News feeding fire
from Apple aren't you the guy who is not
allowed to talk
I thought you were the guy who's not
allowed to talk
um
find me a small image I need a small URL
with an image
foreign
foreign
oh here we go here's a small Wikipedia
well no but I don't think that's
actually an image
no that's not an image that's a file
I'm worried about opening this I'm gonna
trust you
well it's like a bird no but see the
problem with that one is it doesn't have
a uh no
it
I could upload the image to tinygrad.org
that's
a fair point but it has to have the name
of the thing in the like what I like
about the banana is it has the name of
the thing and the thing you know
I already put it there
I don't know what a small cap pick is
going to be is the problem
tinygrad.org banana.jpg
okay fine
fine we will include the small banana
picture here
no I don't like it because it's not it's
got to be Elsewhere on me
okay okay okay we gotta we got a banana
here but is this file huge now yeah
that's huge it's gonna take forever to
download
whatever
it's fine if it's the same site
foreign
version
let's just look around the internet for
bananas
bigger
here we go media eye stock photo
banana.jp
of course it doesn't work unless I have
a
oh but that's an Ico that's a cute idea
though also Twitter's blocked on my
computer
but you're right who's got a fav icon
that's recognizable
does that work
they'd be cool
icons don't have three channels
for some reason
how many channels do they have
is this Library supposed to be able to
load icos
how come the cert doesn't print that
I'm curious why it doesn't load icos
uh
so I'm going to change this slightly
I'm actually not going to coordinate
that out I'm going to call it recognize
I'm going to get rid of the installation
instructions they're kind of stupid
I mean you can install it everyone knows
that
I guess that's a good point
uh oops
because if it's four I can deal with
that actually
no can't load icos
do they have an image of a car
a fav icon would be cute though
Ico file format
no I know people can open it but like
just link to something from the comma
site the comma site is not stable and
will change
I mean this is just a good question
right this is like a fun like brain
teaser question
it's like where do you uh where do you
find Reliable
reliable images
foreign
no it's not the same repositories tiny
grad
it's work
why doesn't Google allow me to search
I wonder if chat GPT could do it let's
try Bing chat GPT how do I use Bing's
thing
can I use Bing
here how to use the new Bing with GPT do
I have to log in
if I have to I have to log in
stupid who whitelisted the New York
Times
who'd ever let the New York Times
anywhere near their technology
foreign
can you find me a banana with a short
URL
oh oh look at this
no let's just unsplash photos banana
that's not good
too long
we're gonna find the perfect banana guys
is this stupid is this not good content
well that's too bad because it's what
we're doing
and if you have a problem with it that's
your problem
error 400 what is an error 400
oh it's pretty short
I don't know how stable that's going to
be
no no no no no you will find a shorter
banana oh an SVG there's no way that's
gonna work
uh I don't know let's look quickly can
we view the source of this page
no probably not it's probably all Ajax
now
all right we're really going off the
roll we're really going off the rails
here guys we're really going off the
rails with this stupid banana Quest
go to google.com what is this image
when they didn't pander
any of these websites gonna be
permalinks
oh where'd you get this IBB Co
what is that is this reliable
what is this
is that going anywhere how long is this
URL been up let's go to archive.org and
check
oh you just uploaded it
okay what's the expiry policy for this
thing
also it doesn't work for some reason
interesting
okay I think we might have hit a Chan
equals four good well it gives us an
opportunity to fix a bug every bug is an
opportunity
um no I think that banana is actually
broken so hang on let's fix it
okay I got four
uh this is actually okay we're just
gonna have to change this to Chan
I think it's RGB a so that's fine
look guys we're upgrading recognize
okay well it's a cathode ray tube
oh
hmm
I don't think a CSS banana is gonna work
banana on white background
maybe it's argb
well good no we found a broken banana
I'm fixing it
broken
huh
I don't know
foreign
code the image data how how small do you
think base64 encoding makes things
okay regardless uh
I think this banana was slightly shorter
but it might be too big of a file
the bananas on a trustworthy banana oh
whatever we're just gonna leave it at
that
it also doesn't have to be a banana
what else do I use I have like normal
tiny grad URLs I use right
oh media eye stock photo
it's a lot shorter
let me use the hand
classic
hen
great
tiny grad section oh you know why the
other banana might no I don't know
whatever
it's a hand
I'm also going to put a uh
with my with my homepage go well they're
using them to edit that I was using them
to edit that
yes I do write to br's by hand thank you
very much
thank you
cool
all right you guys ready to try it
foreign
foreign
before we do something irreversible like
push that
some people are going to want to look at
the C code right
I love pipes I love pipes
oh we'll even let non-subscribers share
in the love for pipes
wait this made it really slow playing
formats insanely slow never mind we
don't get client format
it's just so slow
as you see a better hooks
Point format's too slow never mind
compile it to wasm and run it on the web
yo can we do that I don't even know how
that works
I don't know if we can do that we'll
we'll try
and pile up and run on the web okay
we'll do that next
we'll do that in a minute ah
but I'm just saying like for people who
are going to end up looking at this it's
gonna look like
oh wow let's push this
that's quickly looking I try to do
anything really stupid
I can put all the weights at the bottom
actually
should I do that
might just make it look nicer
I'm already assigning it
now but I stick the image buffer in
there
whatever
now I'm going too far
push
what
foreign
with 70 OT should do that I mean it's
very fast already what do you really
want to be faster
okay C2 wasm
but I don't understand so it's going to
be wasm and then I'm going to have to
use JavaScript
I have to like run it oh that's too hard
this is too hard someone else can
compile it for wasm that that's another
person's project and you can get credit
on Hacker News
uh let's see if tinyguard.org pushed
pushing a bit
use wazzy and Vince dead
too many lines
gotta keep a look at it and see this
great it works
no it has
okay fine I'll change it to over nine
thousand
okay you guys trying the example
try it does it work on your computer let
me know if you have bugs let's fix them
now
I only tried this on one environment all
right let's go here and see
well this computer is a lot slower
oh no
undefined references to Pal and EXP
I included math
I don't understand
oh is it like
do I have to do LM really
well that's an easy change anyway
cool
oh wait does debug affect time I don't
like time we're getting rid of time and
Lead Out Loud
why didn't print weird stuff
monologues welcome
we did we did somewhat accessible stuff
today
we didn't just totally go off in the
weeds I mean we did when we looked for a
banana for a while
um we did we did spend a while looking
for a short URL that was a banana
but that was the most of the weeds we we
went off now what we have right now
is a completely portable uh fix for
Ubuntu belt
uh is is a completely portable
C program that can run an efficient map
um
hang on I should actually write a little
bit more description
uh of what it is
so
um it is
and efficient Nat b zero trained
on
imagenet to
classify the 1000 default categories
did I spell that right
with LM and dropping time okay it works
on Android Terminal S I told you this
shit's a hundred percent portable
um okay we have LM in there now
let's just try the exact line
and let me get the capitalization of
imagenet correct
[Music]
oh it got faster with O3 I don't trust
O3
yeah we switched to a chicken yes it's a
hen now
sweet
um
yeah so it's completely portable C code
we can actually look at the C code
let's just uh copy this out
we can look at it here
if you had o speed wow it works on
Windows wow you know something's
portable if it works on Windows
uh so here we can
load and we can actually take a look at
the C code that's being generated
so these things here are all the uh Mr
Shades through the default all these
things here are the kernels they're like
opencl kernels but they are
um
open GL opencl the kernels are the same
but there's C so I just took the global
indexes and I put some loops around them
uh to make them easy to run yo if it
works on Temple OS yo wait it should
work with GCC actually let's test that
see if I wrote anything that makes it
not work on GCC
um
so um
Hotel
hmm no LM oh do I have to put LM after
recognize.c yeah probably because gcc's
like that
okay cool
yeah did you see it works
cool
works on a Saudi Linux yeah
uh but guys this was an advertisement
because tiny Corp needs contracts
um
I could I mean I like this is one of the
first streams I've did in a bit where
there's something interactive for people
where you can actually run something at
your house
put it in the browser you can put in the
browser
it's just a shame to put this in the
browser where the browser has webgl and
you know for a small Contracting fee we
could make webgl work
um but all right so if monolux's Raiders
are still here what we did today is this
you can see it on tinygrad.org
um
look
it's kind of like to make this better
I move my description around a little
what can kinis Corp do that other
companies can't do you just saw me write
a c back end
five hours ago tiny grad had never
outputted any c code in its life now
it's outputting 100 portable C code
um
I like I wish he'd open source it uh
fabris pillard wrote one but it's closed
source for some reason I don't know why
uh which is sad
I think it's cool but it's closed source
uh it needs LM LM is now included by
default there's no there's no not LM
um
okay Deca Joe
I've seen you too many times I've seen
you lie about how you were apple and now
you're banned congratulations even
subscribers can get banned
uh
you speak in bad faith you get banned
you speak in good faith you might get
banned too don't don't think the rules
don't apply to you the rules apply and
what are the rules there are no rules
they're just rules
um
this looks a lot like python what are
you talking about where do you see any
python there's no python
this is C
is completely portable C
all right it can't even go to the bottom
of it it crashes vs code because it's
too large
so you'll never actually see the uh
bottom of it
well maybe you will
you sit and wait while like all that's
crap Scrolls by
wow in the image Library
you'll never actually find the code that
runs the net
unless you do something like this
wait that didn't work
ah here we go the net implementation
so this is the code this is the C code
that actually runs the net
uh
and yeah let me push this
and then we have a climb back end and we
can leave the climb back end now
training and see what do you want to
train and say
if someone has no idea what you're
looking at can you run a c compiler on
your computer
do do you have a terminal where you're
capable of running
this
that code looks horrible and unreadable
well good if you have WSL then it'll
work in WSL this looks horrible and
unreadable
you don't like my names I think they're
beautiful
uh no it's really not made for reading
I mean like the I don't know
this stuff's pretty readable actually
another once you get to one I mean the
weights are really big and there's
nothing we can really do about that and
we have to import the image Library
oh you love buff 147 well buff 147 is
busy
it's it's uh working there hard
does it recommend it's just an imagenet
recognition mat you can compile any that
you want if you want to compile face
rack Nets you can compile face rack Nets
above 152 clears buff 147 Ah that's cool
um
we want to do a formatter well I tried
that and it didn't work
uh you can't run it through a formatter
theoretically you probably want to break
this up into a like include weights.h
I could move it and put all the crap at
the top
to make it more readable
now we're good
now come on we got to get this on come
on Hacker News loves bullshit like this
and they should hire the tiny Corps
I I feel like I got a lot of energy what
do we want to do next
I'm gonna go get some more coffee
uh and then we can you guys discuss
about yourselves what we want to do next
and we'll do it
foreign
make stable diffusion fast on the M1 GPU
well that's going to take forever
ah
yeah so we could do a training C API
pretty easily as well
um if you're just looking pretty much
anything that like tinyjit can capture
um if you look in
like Benchmark train efficient that
uh actually not this one
but if you look in my C4 thing
um you'll see that I use tinyjet
so the same way that we use tinyjit here
we use tiny jet
here
with open AI what's open AI
enter is bothering me
I'm going to stick LM in here
I hope you know you need LM
oh that should really be a test
you should really test that that doesn't
regress
oh did you use tensor cores yet in Cuda
no
we have a bunch of refactoring to do
before we can use tensor cores so it
turns out the M1 also has tensor cores
that's how I got my mammals to be so
fast
um sell 49 of tiny Corp to Microsoft for
10 billion sold sold Microsoft sold
great done
um
[Music]
this is amazing can finally use it in
Android after Jay and I cool I hope you
use it
uh yeah I mean they the net they
shouldn't be too slow either like I mean
you saw the speed it's like not terrible
why doesn't someone leak open ai's code
and models open eyes coded models is
probably they're probably terrible
um their code's probably spaghetti and
mess and the models are huge
like okay here you go here's a 100 and
okay it's a hundred and
seventy five billion weights let's
assume they are let's assume they're
float 16. that's 350 terabytes
uh wait no 350 gigabytes it's not that
big
uh
okay well you have 350 gigabyte download
uh where are you sticking that
well the whisper source code looks fine
because that is open source I'm saying
if you leak their internal stuff
internal stuff always looks worse than
open source stuff
it's true comma
um let's do it every company
general question
get a general answer
I don't know
fuck
how about this you answer your own
question
you answer your own question I love I
love questions like that because it's
like how do you find ideas I told you
guys how I became a good programmer
right I told you about the volcano in
Indonesia right
there's a volcano in Indonesia called
igen it's the only volcano in the world
where you know you can see blue flames
because there's sulfur gas coming and
it's combining with the lava and the
blue lights on and I you know I didn't
know anything about programming and I
went down to the bottom of the volcano
and I came up that next morning just
understanding what a pointer was
find God
us
uh Georgie zoomax he hates right to
repair him
should enjoy a nice game of Minesweeper
yeah you've heard you've heard my you've
heard my volcano right
good good what age did I start
programming the volcano thing was I
think when I was 11
. uh remember
attacked by bats and Batman Begins it's
been a long time since I've seen that
movie and then he decided he was gonna
win as a grown man he was gonna like
dress up like a bat right remember that
it's similar
um similar similar experience
did carpathy sell out now that he joined
open AI
I don't know his friends are probably
pressing him to do it like
you know I saw that I'm like okay man
like I mean it is just sad it is just
sad when like these organizations
acquire lots of money and then people
decide to like join and be a cog in that
instead of starting their own thing like
her path he's very capable of starting
his own thing but you know he's doing
something it makes me sad
though to be fair he might just be going
there as an intern for a few months and
that's boss but if he's still there in
like multiple years I'm like oh okay
week
um
I mean you know and I like to add to
that to his face
uh
what features would you remove from C
plus plus to make simpler passing by
reference passing by reference is stupid
and you should never do it
um any luck finding MILFs on LinkedIn
LinkedIn dating is atrocious linkedin's
a terrible date again
but I have triggered people and that's
really why I do it you can't use
it was very professional
all right should we rewrite it in Rust
101v1 and rust and I'll probably lose a
little more rust experience what do you
want to do
professional environment
rust the game I didn't know it was a
game
oh I feel like I've like heard this
before and
still working on the C back end what
else do you want it to do
I mean okay like you can watch me do
like there's some boring refactors to do
like a lot of this stuff is duplicated
with this stuff and like one of these
days I'll get around to that refactor
and actually like this could be made
generic as well
uh because the jit knows the inputs and
stuff
foreign
like the jet keeps track of the input
tensors the jit also keeps track of
uh return
what is import replace yeah
actually this would be a good do you
understand thing if someone wants to
submit a pull request to do this
and you can also
get parameters on self.rat
someone wants to do that
shows that you understand uh some stuff
about tiny grad
this there's probably just a nicer way
to write
like to assign names to all the buffers
and stuff
uh
this is all mediocre garbage
there's an argument that that should be
moved to the top and this should be
moved to the top and then like you can
have the net
uh
be smaller
just the runner for the net
technically we could just stick it there
instead of calling Nat
which is an interesting idea
every AI company now asks questions
about responsible AI well
I mean look
um
like it's not necessarily a bad question
right it depends what they mean by like
there is their response like like I
don't know
you know the whole like
corporate
fake ethics movement I mean it just
pisses me off because it's so
disingenuous
thank you enjoy your sleep
uh
you know it's just it's just so
disingenuous and like there are genuine
things you can have a conversation about
responsibility of AI I just think that
like we're in such an environment that
you know if someone's bringing that up
like
like
they probably just don't get it right
let's try it with unsafe images
recognize is safe
recognize is safe by default we have to
we do have to think about our AI safety
implication and considering
um it just outputs one of
uh a thousand pre-specified words
has tiny it's anti-capitalist
it's not well sort of it depends what
you mean by capitalist right it's not
anti-capitalist it's anti it's actually
anti-democratic right
um one way to to like if you have a
um
if you have a company you can exclude
small competitors for the marketplace by
criticizing them for being unsafe or not
environmentally friendly right like
imagine a company like you know Exxon
attacking Tesla for not being ESG or
imagine the FED attacking Bitcoin for
its energy usage right like you see
there's obviously something wrong with
that
right like
but it's not anti-capitalist there's
nothing anti-capitalist about Capital
about Exxon trying to accuse Tesla of
not being an ESG company right
um what do I mean by a c back end I mean
that it's entirely C it's pure C code
that can execute uh an efficient map
why do I have it run the jit twice
just a decision that I made
you shouldn't really capture on the
first jet that's fine
they probably just changed the prompt I
don't know again like
chat gpt's safety filter is like stable
diffusion safety filter right these
things are not going to exist uh
if there's a market for them not to
exist
right if there's a serious market for AI
That's not restricted
um
but
the problem is like the Restriction also
comes like chat CBT already like lies
way too much
um so there's like the cringy stuff
where it's like I can't say anything
positive about Donald Trump but then
there's also the stuff where it's like
it's not sure and it outputs this weird
thing to say that because that's rated
is better by that rlh app there's a
really good uh Sky Alexander thing that
goes into it where like you know how it
says like as a large language model
trained by open AI
it outputs that because that's what it
was told to Output like it was told
multiple times you are a large language
model trained by open AI right but
imagine instead it was told it was Darth
Vader right and like the rlhf people
upvoted all the things where they're
like oh yes that's a very Darth vadery
response
um and downloaded all the things where
it like you know it wasn't Darth vaderie
then like you have to model that thinks
it's Darth Vader in the exact same way
that Chachi BT thinks it's a large
language model
right there is no
um Mike Solana posted a thing about the
the conversation the New York Times
conversation with Bing Ai and it's
really it's a conversation with yourself
these things are mirrors
um
am I using blast now uh no blast uh it
links to nothing
it's just it's just the map Mall kernel
like you can look at the maple kernel
um
strange filter doesn't work well all the
time again it's weird that people are so
obsessed with this stuff
right it just it doesn't interest me
that much like it's kind of stupid
is Chachi PT is kind of stupid like
okay it's it's a good art project and it
did like force a bunch of conversations
but the fact that it has like staying
and people are still talking about it
like
how much do you actually chat gbt versus
how much you Google like people talk
about how they integrate it in their
workflow but like it's like rust you
know
hang on let me just create a polar Quest
over here
all right we'll merge this oh here
that's the Stream
no I should only write a test for this
it's not too slow
this thing is actually that I don't need
any of the testing dependencies I don't
think
foreign
okay
foreign
[Music]
foreign
exits
uh how do I do that
chat now
how do I test if that output's hand
there's like a way to like assert
oh I can use grab Maybe
pipe it to a variable and grab it
if it's a graph
well grep if I do like
what's the return value of that
okay let's just try it actually so uh
you could use a print hello and the
print's not found Echo hello
pick up something else
okay it doesn't work okay cool just
paper to grab
pipe the graph into line count or no I
don't think I have I think I actually
just pipe it to grab grep's return code
is non-zero
this will check the return code right
or will it only check for failures
I don't actually know
I guess they'll check oh I'll check
uh yeah that's right
let's just check those statements here
can tiny Court build a tiny browser well
no unfortunately not right the only
reason this whole thing works for neural
Nets and the whole kind of philosophy
behind uh
behind uh no I like seeing the curl the
the whole philosophy behind uh Tenny
grad working is because
there's turn completeness all over the
stack where there doesn't have to be
and neural networks are fundamentally
very simple if you give up Turing
completeness starting right at the
tensor level and you accept that
everything from then on down is going to
be tensors everything becomes simpler
versus supporting Turing completeness at
like
torch level at the torch script level at
the sea level at the Triton level at the
Cuda level right like it's so much
torrent completeness all the way down
that you don't need uh but you can't do
this with a live browser web browsers
are complex because the web standards
are very complex they're also constantly
evolving whereas neural Nets are
evolving but the fundamental tensor
Library like this Library could have
been written in 2012.
um how did you know what you wanted
right there was no there was no new
tricks like you don't you don't see any
like like they discovered a new I'm not
even sure what it would look like
I did not push my new website
move oh man
push
oh
I broke something
oh I called it test CPU yeah
um
I need a pre-commit hook for that
do I do any web stuff not
I don't do any web stuff
should we should we try to get it to
compile for the web how many viewers we
got we still got a lot of viewers we
could try to compile it for the web
730 viewers all right you guys want more
stuff all right fine
uh should we try to compile this with M
script down or something
figure out how to load a image in
um all right all right we'll do web
we'll do web we'll do web
we love web
uh is that a
convert to website
compile C to Watson is that is M
scripting really
is this still the best way to do it
foreign
it's installing python it's installing
that python
I'm not happy
um
M scripting sucks ass great
why would I want to use this it sucks
ass
all right well we'll just let it run
try what what is this thing blink
this looks hard
this looks way harder than just running
it locally
you know what I mean though if you're
the kind of person who doesn't have an
environment that you can just run this
in you're not the target audience for
tiny grad anyway like eventually we'll
build web stuff
so
we'll you know what I am interested in
benchmarking it we'll see how
foreign
all right all right let's Google it
initial memory too small
oh here we go
you just need to set the total memory to
more
okay well initial memory is not a
multiple of okay we have to round it up
64 kib so that's 65536
u891 times 65536 great I love when
computers make you do math by hand that
they could trivially do for you oh
beautiful
um
okay it's kind of a small thing let's
open recognize.html I don't know
it's on the Chrome
this is
but what is in this 169
kilobytes of JavaScript
what is this downloading
this can't really be downloading
something can it
we have a course error oh
dude I hate the fucking web
all right what is it python
they got rid of simple HTTP server in
Python 3. do I have python 2
no I don't have python too great
what's the simplest way to run a HTTP
server
no it can't download the wasm file
because it fucking cores Dash mhdp
server that works
all right
input hello
input hello
oh God exception Throne see JavaScript
console
cannot enlarge memory to arrays
why did it use Malik
foreign
why would I not want to allow memory
growth what's the downside to that
[Laughter]
that's not the right hang on hang on we
need this one
and we're going to allow memory growth
now I have a feeling that it's trying to
get me to type in
image in here uh python M HTTP server by
the way I appreciate you guys that's
cool I didn't know I thought it was gone
Python's amazing I love python uh
JavaScript on the other hand uh sucks
okay oh aborted failed image null okay
image not equal to null okay that's good
we just need to figure out how to use
the web all right all right let's use
the web you guys ready to use the web
can we use can we use svelte with wasm
m
what is
this is like a janky kernel that it runs
in
uh
like I don't even know we're gonna have
to figure out okay if we really wanted
to do this we'd have to figure out how
to get like a float buffer
into
always svelt over now oh you guys love
web all right all right all right we
have 770 viewers you guys love web we're
gonna figure out how to do this shit
uh all right
okay we're gonna have to get like an
image and then we're gonna have to like
make it a canvas
my float buffer I have file loading but
how am I going to get a file on the web
I know that I have file loading but like
again there's no way that I know of to
actually fetch the bytes of an image
you see what I'm saying
no local storage doesn't fix this what
do you mean fetch
xhr HTTP request it's gonna bitch me
about course
but I can't fetch because because of
course
okay well I've never heard of fetch
let's let's see if fetch can do anything
good
use no cores option
wait can I actually do no cores
okay let's try some JavaScript
so we create the web folder in diagram
oh you guys I'm a web Beast all right
why did it stop auto completing I hate
you
I don't like the closing tags they're
extra bites and stop making tabs
everything in the web likes to auto
complete
well beautiful soup work no
can I use fetch to fetch the damn banana
can fetch get me the banana let's see
all right where's fetch
fetch web APS
okay syntax fetch resource all right all
right all right resource
our bar resource can I do let or let's
support it yet
or do I need to babble that to get a let
all right let's fetch a resource is that
gonna work
dude I hate the web
George doesn't know the web all right I
don't know just by fetching my resource
work
foreign
I don't know
do I need semicolons or not I don't know
well let's not put semicolons
well it's a promise okay can we await
the fetch
we probably can't use a weight
[Laughter]
okay okay there's another way to get
promises right I get a promise that
resolves
how do I use a promise
God I fail I'd fail any uh
uh I don't know
my request fetch my request then we're
gonna use it then okay let's use it then
okay then
response what if there's an error
console.log response all right
let's try my web does it work
okay
the air comes after the then
all right I like this API so far
can I can I actually fetch
um okay method okay so I get a res I get
a response what's a response
myimage.source create object URL I don't
want to create an object URL I want the
actual bytes
dot blob okay
stop telling me to a wait anyway it
doesn't work I just tried it okay blob
fucking promise
why is it a promise don't be a promise
okay do we have to do I find another
line then
that
console.log that are we at the bottom of
it
um we need our bad thing
oh cool
wow wait can we talk about how sick
fetch is someone made the web good I
remember when it's XML HTTP request
wait how do I get my a weights to work a
weight works if I put it in a function
okay
um function uh
all right function all right function do
things
you're telling me I can use a weight
do things
anyway fetch resource
response
does that work
oh I gotta make it an async function
oh oh is that good we made an async
function all right
blob oh my God I could get a job as a
junior front-end developer let's go
oh we gotta await this I've forgotten to
wait all right let's go
all right good we got a blob okay now
how do I load M script ends
wait but if I could just fetch the whole
time could I fetch the wasm
downloading
fail to asynchronously prepare
whereas get binary promise
are they using fetch I love fetch fetch
is my favorite API
okay let's actually throw some HTTP
server up in here so we have an HTTP
server
and now we can go to web.html
localhost 8000 web.html it's called Web
because it uses the web wait now is that
let me fetch or is that gonna
we have a blob I love fetch no no I'm
not Fs in knitting no no no no I
definitely don't need a FS
I can just pipe it right
okay
um if we fetch the binary file
[Music]
let's fetch the binary file okay we
fetched that now let's fetch
what's it called recognize.wasm
Prague
console.log proc that's
that's a promise because we gotta await
that great great great I'm a JavaScript
programmer guys I'm a JavaScript program
okay I'm a JavaScript programmer all
right good good
all right type basic wow
how do I feel about that
oh okay all right
let's do this okay web assembly
instantiate binary oh we might have to
we might have to uh
let's get binary does that call blob
read binary what calls blob we might
need a blob all right well I don't know
but either way I like that
webassembly.instantiate
what are Imports and do I need them
can I put a frog in there no I'm gonna
need more blobs right
I'm not using wazzy ends
I'm writing this from scratch
argument zero must be a buffer Source
okay can I do blob
I'm gonna try awaiting the blob next
all right all right we'll await the blob
all right let's wait are you a buffer
Source be a buffer source
all right what's a binary
we have to get a binary promise okay we
fetched
oh okay response array buffer
failed but that's failed
oh if that's not response okay okay
let's try that
Imports argument must be present and
must be an object okay okay we just need
Imports now let's where can we steal the
imports from
okay they get passed into instantiate
async wasm binary file eh
it's not even anywhere else in here
all right let's read the uh let's read
the document let's read the uh let's
read the here
so as you instantiate we need an import
object okay so it's just functions there
must be one
a web assembly instance object
um import object
okay the values to be important to the
newly created instance
what's optional what do I need it if
it's optional it says it's optional
oh yeah that doesn't work
okay Imports argument must be present
and must be an object well suck a null
argument one must be an object why is it
optional then it's not optional that's a
lie
[Music]
secondary overload
all right all right fine fine that's an
object all right let's go why are you
guys doing f
why is my stream working at least all
right good my stream's working all right
is my lighting good you got to tell me
when my lighting's bad
import zero module envira
it was not a
h
you need buffer source as the first Arc
this is not a buffer okay okay fine
we're fine no it's an array buffer
oh maybe do we not want to await it
let's not await it
no it must be a box of source okay
const prog
array buffer
you need to import reaction spell kit
and partially hydrate the reactive
islands that sounds good
import 0 module n error
all right let's Google this this has to
be a normal thing that people have
please try building with s assertions oh
okay all right let's build with s
assertions
because we probably need to pass
something in the environment that it's
expecting okay should we use wazzy shit
or whatever that other thing was
I rebuilt it
did it rebuild okay it rebuilt
Joy npm on it
I'm not using npf points
uh
okay okay okay hang on hang on
uncaught in promise type error module is
not an object or function
ah
npmr Xbox
Sports I vaguely remember using an older
version of the app script SDK I printed
the array buffer it's fine the array
buff is not the problem
great job
all right
I have an idea
this one was pretty good except for
Imports what are Imports
okay well this one takes in wasm binary
and this one takes in wasm binary file
I don't really know where these things
come from
oh
wait
argument one must be an object okay well
it's clearly not that
but
instantiate async
oh that fetches the binary file where do
oh Imports is the third argument to
instantiate async I see info
okay what's in info
oh here we go prepare Imports
yeah yeah I could I could just do that
oh here hello world web assembly oh now
we're talking
wow this looks like oh
what language is this it's a wet file
import object console log okay well
we need to end
let's make an end
where do I get wasm imports from
oh it's because I tried to resize the
Heap
you can't resize the Heap anymore that's
right I'm taking that privilege away
from you
there should be no oh there's probably
some now
okay you know what
you know what what this is this is
there we go that's you can afford 64
megabytes of ram stop being cheap
or being cheap
me out of my
okay wise of imports is not defined yeah
that's fine because plasma Imports is
now nothing because you don't need any
Imports because you're going to be good
code and you're not gonna
module n v error n is not a
module is not an object or function oh
oh it's trying to access n okay this
works this work just works let's go
yes wazzy snapshot preview doesn't work
of course we need the wazzy snapshot
preview yes you too can have glass of
imports good
okay we just need a function called
assert fail great all right guys we're
getting somewhere we're getting
somewhere I'm understanding I'm
understanding how wasm works okay
yeah great so we'll just copy and paste
this
because that might be an important
function to have
guys we're learning okay it's not about
just doing it if we just want to do it
we would just hack together some
terrible looking JavaScript but we're
here to learn okay
okay function import requires a callable
are you not a callable
we're here to learn okay
oh that has too many bars I say
okay we need M script and Men copy big
very important
good thing we didn't need the other ones
because those were useless
yes we're gonna do no I'm not copying
the entire things we're going to figure
out which one we need because we're
learning boys we're learning okay
is wazzy shit more portable because this
is not portable this is says the
violation of the tiny grad
idea because oh don't tell me keep your
weight's not defined I'm gonna be mad
is this call open app
okay wazim doesn't make a giant JS file
okay let's look at wazenium I just don't
like it
like I just don't like it look look at
their test the Link's broken
right this has no stars
okay I know I know I know we're gonna
make a new function it's called fucked
and it just prints out get fucked
and there we go now when you try to call
assist call open that you just get
fucked
common there all right good good good
good good you like my JavaScript okay
that's my JavaScript and we're just
gonna make them all thought until we
figure out which ones we actually need
we need assist control F call f f c n t
l yeah okay good well you can you know
expect
there we go
oh one that's just gonna go i o control
we can have that too great fucked yeah
cool
oh wazzy snapshot preview needs an FD
right oh wow I have a thing for you
I need an FD read okay cool well you can
have that too
I get it I get it I get it it's like an
environment all right after you close
perfect yeah I got you
the environment sizes yeah that's very
important I'm sure we oh it's because I
get an environment variable oh that's
just upsetting
oh that's so upsetting I get one
environment variable and I have to do
all this
okay never mind get out of is not
portable code and I feel bad about using
it
um
oh okay cool all right we instantiated
the web assembly great great and it
happens to get fogged yet all right this
is great
I'm so happy well we definitely don't
need mem coffee because that's useless
we'll leave it there I already copy and
pasted that one
passion for programming or something
like that all right cool uh we
instantiated it now how do we run it
instantiates streaming
okay
promise that returns a
web assembly instance object
well it returns a promise oh well we
know what to do about promises we just
await promises remember when a weight
didn't exist
how unbelievable was that
okay good good good good we got an
instance and a module I got it I'm sure
I need both of those things I'm sure
they're very important
all right
um instance
instance property so I can access the
exports
can I call it
is a stateful executable instance of a
webassembly module
this is such a waste of time
oh okay
Hobbs dot instance
got exported funk
that's not a function
oh because probably that's probably only
their export okay let's see what my
exports are
all right memory
um main here we go
foreign
call
it with one and that
all right I think we're good I think
we're good
a board is not defined okay that's fine
we'll just console.log we didn't need
all that weird crap
utf-8 is string I knew that was stupid
I wanted JavaScript just over Engineers
everything
oh it told me to get fucked I wish it
told me which one
I wish you told me which one it tried to
access and I wish this abort thing
didn't
guys we're learning okay
utf-8 to string
oh because we need utf-8 to rate a
string oh
I give up
such a friendly wasm no look look we got
all our shirts and shit working
um
okay well we gotta figure out which
one's printing that
I don't even know how to do that
you know hacking is just binary search
by hand
oh get fucked too okay let's see
oh it's calling FD read
okay we might actually need an FD read
that one actually sounds important okay
because that's how we're gonna pass our
image in
D read here we go
foreign
okay
but this one is FD read
I wish my asserts worked
they probably made it complicated for no
reason
that would be my guess that's what they
like to do in JavaScript
okay
string to utf-8
where's my assert fail function I wish I
had a working assert fail
while utf-8 to string is that the
opposite direction
people just calls utf-8 array to string
keep or array keep u8 okay I kind of get
what it's doing
Max bites to read is stupid
all right we can we can we can rewrite
this this is useful let's let's write
this code because we're learning okay I
know we can just make it work if we use
wazzy shit but we're learning okay
all right
uh all right we have a heap UA
pointer
no this is this is only because someone
wanted to support Unicode which everyone
has universally agreed is stupid
okay
um string Dot from charcoal okay okay
okay
heap.ua sub pointer
const C
uh console.log C let's see
Heap u8 is undefined
that might keep you weight
ah wasm memory buffer of course of
course wait where do I get was a memory
from
I don't like JavaScript
okay where's wazza memory come from
is a global
let's try this inst Dot
exports.com memory that work
cannot read properties of undefined oh
because it's ins dot instance
kind of confusing we should probably
just call it instance
yeah that's stupid
I cannot read property of undefined
reading memory
we looked at the exports why was none of
them the memory
it's an entertaining rabbit hole right
oh here memory oh I'll just have memory
right there
if you go to azim
wait a second
stupid
why does this need to be so complicated
why can't I just say keep you weight
equals instance exports dot memory
oh and then we want to view it as a U.N
shit
dot buffer
we're learning okay
console.log C undefined
tpu8 undefined
it's an array buffer that seems
reasonable
how do we get it as an inter right look
at all these numbers with numbers okay
cool numbers uh you and eight array
right buffer to you and eight array
I already did that up here did they not
container IB
M okay good good look we got numbers we
got numbers we got numbers all right
let's go
we're gonna make this work uh
okay while c not equal to zero
pointer plus equals one
um
what is it append is it append could it
be append why is it bringing up form
data
held out of pen does not a function okay
uh push is it push
of course all right we got lots of chats
and push I knew you guys knew JavaScript
all right uh now how do I convert that
to
well there has to be a fast way to do
like stir many Char codes at
you know what I'm saying
I want charcoal that I want the other
one anyway
from Char code
can I can I just do this
does that work or is it like you can't
pass in an array there and I have to
figure out how to do a map oh we gotta
figure out how to do a map
oh
no that has to be from Char codes
oh
how do I Splat in JavaScript
I don't know how I Splat I want to Splat
I can't do that can I do that
dot dot dot okay
some of you say it won't work and I need
a map
dot dot dot L okay okay
thank you thank you thank you for the
JavaScript oh look at that yeah buddy
who said I needed a map you're an idiot
no no offense I didn't mean to be harsh
I'm the idiot watch me try to look I
start images null oh that's such a good
assertion okay let's go
that's right all right so dot dot dot
you guys
you guys all right cool uh console.log
FD iov iov count pinum what are all
these things
uh
uh what are these things
I hate the web
okay
now fde we know what FD is
we don't know what iov and pinum are
let's see if we can get any hints from
this convenient
genome
[Music]
oh that's the return value I say
okay
okay now we just have to figure out how
to stick our integer in here
uh
we have dat that's a blob
can do blobs work like a rave offers
can I create a new U and Aid array on
Dat called image
did that work
too large oh here we go
no it made an array buffer zero okay
blob.array buffer up good to know
that didn't work
oh it's a promise of course it's a
promise
we'll just do new uint a array new data
array buffer no no no okay wait data Ray
buffer right cool cool you just gotta
give me more weights up great
um okay
now here what am I getting iov count
okay four
let's read that thing here we go well it
looks like good code to steal
uh Heep u8 sub iov equals I'm not going
to read four at a time that's cheating
okay um image
VAR image pointer equals zero
of course everything has Global scope
and JavaScript I think
I don't actually know if it does
it's not let's not let's not insult
JavaScript until we're sure
iov
plus one
what
all
I don't like that
okay well that's complicated
uh we need the Heap
u32 as well
thank you
wait what
there's two Reeds oh that's so
complicated oh this is nested so many
times
console.log pointer that
do response that array buffer instead of
blob oh yeah now we're talking
why would anyone want to blob
why are there two
why are there two I don't understand
that
and they both have the same pointer
oh no because I didn't increment the iov
now we're going to increment the Iowa
great
okay
uh it wants to read 127 here and then
102 4 here
all right well
bar J equals zero J less than Len J plus
plus
um keep eights sub pointer equals image
sub image pointer
Len plus equal no pointer plus equals
one image pointer plus equals one
image is not defined
find it local here so we just gotta get
rid of those and then we'll work image
pointer is not defined well yeah because
I used camel case here and I used other
case there okay well that's dumb let's
do it like that cool
uh all right
a certain image is not equal to null but
it shouldn't be equal to null
that's P now oh I don't think we set
pinum I think we have to set pinum set
phenom
all right
Phenom after we've done done reading off
okay we're getting fucked
well let's figure out where we're
getting fucked by randomly putting Fox 2
in places and seeing
does it have to close because if it's FD
closed we don't care about that one no
does it have to seek that would upset me
it's FDC okay well we're gonna have to
seek now
really we have to seek
this isn't too bad we're just gonna seek
a little
ah okay console.log
offset High offset low
when it's a new offset
okay
seek
the stupid image library is using seek
what's a lens of one
[Music]
oh
oh I see what you're saying okay so we
actually just have to go I don't
understand what what's new offset
oh we have to like put that in there
yeah we have to go back 461 all right I
get it
image
pointer plus equals offset low
come on just work
yo
oh that's a lot of getting fucked stop
it
oh
wait no no no no that's too much getting
fucked
it won't even load anymore I can't even
right click and
is it running
I I don't know I'm trying to right click
I can't
it crashed my browser
okay we'll stop printing get voctor
oh
[Music]
okay
oh memory access out of bounds
how can I make it a board
how do I abort
I need an abort controller
no no no I'm not implementing resize
memory no that's too crazy
now I gave it a ton of memory I gave it
a ton of memory I fixed that I fixed
that I fixed that
oh it has enough memory
it's probably because I didn't save the
seek
well let's just read that Library
I'm tempted to decode the image in
JavaScript
uh or is that library that I'm using
compile efficient.net
STV image
this uses seek does it not
just use different seeks
what is this by the way
where do I just have a console.log with
nothing
JavaScript abort
JavaScript cancel web
assembly
oh wait there's an abort in here how do
they do it
how come I can just call a board
I'm going to implement yeah okay fine
does that work
ah
that's fine
I'm okay with that
it actually accomplishes exactly what I
want
no I don't think I do need relative and
non-relative
he said yes I'll see car though see Cars
one
okay well let's see which one's getting
a spot let's see is it fuck two
oh I know what it is I know what it is I
know what it is I know what it is okay
this is fine this is okay
we're just getting fucked too it's fine
we need right
and the problem is because right's not
returning anything
yeah I know what the problem is okay
cool
uh Wright's not returning anything so
yeah I know there's a secret in there
but doesn't actually call it
you have to do the same crap here
with uh
that'll actually already probably do it
probably already fixed the issue but the
issue is it's reading the image and then
yeah okay
okay maybe it just works
it's only six though it's not a lot of
right
um
can I say equals can I can is this
allowed in JavaScript
probably not because that'd be
convenient oh maybe it is cool
um
oh it's 10.
oh yo you're right
wait it's banana bananas six letters
dude
wait wow
it works
yeah
all right we just gotta package it up
foreign
foreign
console log banana yeah but that would
have been cheating
uh
where's my environment
how come it's not actually getting from
the environment
I would like it to actually get from the
environment
I think my stupid debug thing can kind
of go debug's kind of stupid
why isn't it getting from the
environment it's printing zero get
fucked
uh
maybe M script M drops it yeah I believe
that
like has environment stuff it just
doesn't use it
uh
all right whatever
here okay I already no no we need some
we need some HTML
um div
results wait div
ID equals result
and then we're going to use CSS don't
worry
um
I will make it a form with a button
don't worry we're getting there we're
getting there we're getting there that's
stupid learning that
um
results wait okay all right document Dot
get element by ID result is there a
better way to do this now dot enter HTML
plus equals
wait is there environment get and
Environ get
it's never calling Environ gat
use
document.queryselector that doesn't look
better
banana okay cool
why did you say hello
all right
no we're gonna renaming get fucked okay
we're gonna name it good stuff
we're gonna name it
function not
implemented that's right
and then we're gonna call
wait where's get fucked there it's not
there
here we go
function not implemented
throw new error wait can we throw errors
does that work
yeah throw new error sir
this function has not been implemented
please contact
your
nearest
development
Center
for help
yeah I know I'm putting it there just so
I can see it
love it
um
hang on
we also need to do
uh
result pending
oh
uh window dot on
sorry I haven't got a job
uh
how come it didn't write result pending
oh I know
um
document wait what is that document.set
timeout
oh I'm making an escape I'm making a tag
okay good point
ah perfect
thank you
result
banana okay good
now now we just need we just need a form
okay
and we need to figure out how to put in
the
upload file form W3 schools oh no no no
it's not PHP
JavaScript
foreign
why can I not take JavaScript seriously
uh no no no no you need to type in a URL
okay
uh
input box
that was scary why didn't that work
okay
label type
texts I don't know we don't actually
have to upload any files don't worry
it's all local
and then we're going to do some style
I'll do some nice styling we'll put some
hyper pop we'll put some 808s you know
you know what I'm saying URL
okay
uh oh it needs to be editable how do we
make it editable no no it's not edible
because we have that okay
um run
neck
resource
async function
no we don't even need resource we're
just gonna no this is too hard okay
const resource equals document dot get
element by ID
URL dot shit
uh what do I want to do on change no I
won't like on submit
form on submit equals Run net
I hate autocomplete
so I'm trying to close the body tag I'm
not closing the body tag okay value okay
there's like a way to put like
placeholder text I say placeholder yes
placeholder
Place holder put
URL here
does this only work because it's
localhost and localhost can bypass cores
no we want it on submit oh no shit
I want the form to not really submit
okay fine uh type equals
button
e dot prevent default love it wait is
this called with e
I remember this from JavaScript I know
JavaScript
all right let's put my URL here
submit
result will go
here
pending
no not in run that that's ugly
you can add fetch URL mode no course
on submit needs parens on the function
no we're not going to do this we can't
submit the form anymore this is just a
button and on click run neck
and you can't submit the form anymore
and actually we don't need a form at all
because forms are stupid okay let's go
uh let's put a bunch of Burrs in here so
it's called
submit
running neck
no can it not be an async maybe it's
because of async
oh I need parens all right fine
can I do this
no it's gonna picture me because it's
Asic
oh okay good
uh wait we have to make sure this is not
null
how do I assert that that's not null
okay what's that
because otherwise people are just going
to click the button we have to think
about people who just click the button
okay if that equals equals equals null
throw new error
sir that is not a valid URL actually
we want we want to do uh we want to do a
prompt
yeah I know front end okay who said I
don't know front end look at my front
end skills all right I know about prompt
uh actually I'm not going to do prompt
what's it called how do you get those
annoying alert that's it
oh
what is that it didn't work
that
on click
oh I don't need that all right
why didn't that work
that should have told me that
you're not submitting anything
this is a UND array okay
no that actually gave me a URL
I was just
a response might be an error okay well
we got to check if response is an error
good point how did we not check if
response was an error oh okay
response type basic status 200 what I
hate
oh because it fetches garbage I see
if resource
equals equals that
sir please type in our URL
okay good good good
you have to check if response is an
error
this one's going to be an error oh 404
okay
dad is okay equals false
if response
if not response okay
sir that is not a good
URL try a new one
see how we thought about error handling
early
now that is a good URL I hate you why is
response not okay
if we get to course
there's a no course there's got to be a
course problem
oh
yeah
all right now guys but now we need some
CSS
oh I have to await you know I have to
wait here okay I already awaited all
right let's go
uh we need some styling okay head
Style
okay well first off
why are these things not on the same
line oh it's because I put a burr there
and that can just go away
but we definitely need the ID font size
to be 72px
right and people like big
I can't just call it ID I have to call
it result and it is a DOT right I didn't
do that wrong right
I did it wrong
that's a class that's an ID
yeah okay good
um we also need to center it text align
Center
okay we also just need more Panic we
always need padding 100px at pad okay
uh now wait we're gonna put this in a
box
div ID equals my box
[Music]
box
I guess one needs some text align Center
and Paddock
okay
but now there's too much padding because
they both got padded so we'll just give
them each 50pxs of padding
okay that's too hard for me to click on
so we got to make the font size bigger
but I feel like that's not going to make
the whole box bigger
yeah that didn't make the Box bigger
like I wanted to
um
let's give this a class
big with two G's
what what's this hundred bytes thing
all right oh 100 bytes of CSS to look
great nearly everywhere oh I love it
where's the bytes of CSS
create your website
I thought it was 100 bytes where are all
these sources
oh
no it's 3.5 it's too big
why does this have so many sources
why do I need a template
no
if I curl it does that work
what the hell is this doing
oh you just I just downloaded some
sketchy shit to my computer
no no this is everything wrong with The
JavaScript ecosystem no my my CSS is
fine just give me a little bit more time
and we'll make it big and everything is
fine no
big
font size
42 48 PX
that's too big
it only has it doesn't have that many
cheese okay
put URL here result will go here oh wait
we have to talk about what it is we'll
talk about that in a header
wasm
efficient tiny grad efficient
and we should throw a link into tiny
grad because we need links
backlinks encroach your SEO for pagerank
haven't you heard bro I'm sorry I'm from
the 90s whenever I do the web it's like
you know dating in the 90s that's right
dating in the 90s
why isn't everything just always
centered
it's not big enough
oh that link is terrible I don't like
this font
okay no perfect
that's too big let's make this font size
smaller
only 48 PX just in case it's a big
result
um
why as I'm trying to get efficient oh we
need padding of course we need padding
on our heading we can't not have padding
you have to have some padding okay
that's
inside guys
oh star text to line Center oh I love it
oh I can do a star all right cool I love
Stars why would anyone not want their
font family to be monospace and their
text to be a line Center oh love it
CSS bro oh look now he's even that
centered oh this is great this is a big
Improvement okay
now if I put the banana URL here
that's too big
we need this to be bigger though we need
the Box bigger
with equals 700 PX width equals 70
percent
70 of what nobody knows that clearly
wasn't enough okay 700 PX
okay
class
big with
that many G's
will get you
what did I want
I wanted a width with 700 600 PX
perfect now you can fit the URL no it's
not enough px's okay eighty percent
eighty percent of what nobody knows oh
that's perfect okay good
pending
banana
oh yeah oh this H1 is not big enough we
need a bigger font size okay let's make
the font size bigger let's put the third
26 PX that's that's is that good PX
no that was the same size I want it
bigger is that bigger that's bigger all
right good
um ew it's like bold that's gross let's
call it not H1 and then just make this a
span with class not H1
that looks terrible
just make the H1s not bold how do I make
the H1s not bold
we need more height on the input box why
do we need height
's useless
it was all banana a font weight normal I
love you guys
all right because I don't know it's just
the Bold the Bold I don't like the bolts
also don't underline My Links
how do I not underline
text decoration none oh I love you guys
this is like chat EPT
oh this is like coding with chat EPT oh
chat's the best
decoration not not good who wants text
decoration anyway
oh yeah yeah this is a nice looking
website boys I hired a designer for this
so you better all appreciate it all
right now I bet it's not gonna work once
we don't talk
yeah
yeah not accessible well sorry you can
use the C version and compile it for
your you know wheelchair or whatever you
have
um
all right let's try it on other things
just try it on the hand image
up so this function has not been
implemented
please contact your nearest Development
Center for help oh shit we didn't try it
on non-jpegs which one's not been
implemented
oh no
okay
too
um
wait
I said value equals that that'll work
okay we have to implement the function
let's figure out which function is not
implemented
also
is it FD close please be FD close
nope it's not FD close okay is it
finally getting from the environment
let's say
it's not getting from the environment
okay is it open at or I octal all those
are never gonna work
no it must be mem copy big or resize
heat oh if it's resize Heap or fucked
okay is it resize Heap
and it's resize Heap hmm
all right all right all right let's see
what it does
your memory is big
foreign
we didn't do anything we just told that
its memory was big
ah
wow that's a lot of memory that it wants
okay well we'll just give it more
five through six times one or two four
well you know what now you have 128 mags
why are we being cheap with memory
memory is a great deal
comment here
memory is cheap right let's try to
recognize things that aren't hens
and then we'll ship it
now do Shrek
I don't think it has Shrek
oh sir this function has not been
implemented
oh okay all right which one
is it mem copy big
okay we need mem copy big
thing we tried a lot
well this one's easy great remember when
I already had this one we should have
just used it
where's my Shrek go
no Shrek has more than three channels
you can't use Shrek
let's try this Shrek
course
okay let's try no course
does that not sound like cookies
sure that is not a good URL
I feel like no course doesn't work
no cores won't help if they've disabled
I knew there was core's problems
well you can't use that one
but Wikipedia works
that's really slow
where's the banana where's our old
trusty banana
it's too long
course proxy.github.io
all right that's pretty good if I could
ship it let's go
all right hot dog
there's no way that's gonna work oh that
might work actually whoa oh
Wild
wait should we also make it work with
local files can I drag I want to be able
to like drag no never mind
never mind I'm pretty happy
wait shit hook it to the webcam
yo can we do that
no no we gotta hook it to the webcam
boys we gotta hook up the fucking leg
down let's go let's go we're looking
into the webcam and we gotta figure out
how to get to make a JPEG shove the jpeg
in the hole
show the image in an image tag
oh show the image in an image tab I see
what you're saying
yeah wait dude the webcam okay okay okay
we'll leave this mode available but
we'll also have webcam
all right or dump to a canvas
um that's too hard for me
JavaScript webcam now you think we're
using a library no we're not using a
library we're going to figure out how to
do it without a library let's go
see let's look who programs like this
who would name a variable
can we just take a minute to talk about
the name of that variable
okay
no no no no
that's too good
make the webcam work
um canvas too hard well we can also have
image
okay
image box
uh
uh okay
document dot get element by ID image box
all the media
by the way by the way can I never hear
from anyone again about how I don't know
web after this okay look at how much web
I did today okay I never want to hear
George doesn't know web okay I did a lot
of fucking web today that's right
imagebox.source equals respect resource
why did that work
oh because it's not an image
um shit how do I create an image
document create image
I gotta be image tag
document.createelement
does that work
yeah
oh sweet all right now just we need to
make the Box small
um
give me the Box uh height 400
PX with
no you have to stay in the Box
wait how do I make it stay in the Box
guys
uh
create an image tag in HTML I'm fine
then source is good
no this is not good stop
oh okay well that's better all right
we'll just leave it like that
fire bro
foreign
you know what I have a better idea I
know exactly how large it should be
actually 224 by 224.
now Shrek doesn't work
um
all right well you know what we should
probably
just add
[Laughter]
bro the web is so much fun
yo
okay
um
all right are you ready for the webcam
this is the best website I've ever made
all right all right
um
the webcam
I'm glad you like this stream yeah
because you guys can play along because
some some reason you all know JavaScript
garbage
no no JavaScript is very important and
I'm just compensating for not being good
at the web
um
on media devices okay
um function
load webcam
this doesn't have to be an async
function does it no if it's not an async
function nothing could be async function
okay
all right let's create a new button
called
use
webcam
and we'll we'll call it like use webcam
like that what do you think
foreign
because I made that eighty percent let's
make it 70 percent
[Music]
maybe we should put used webcam over
here
now this is a professional website we
shouldn't be writing in in in you know
hyper pop caps
does that go on the next line yeah we
can always use some VR
do we like my formatting
shit we need to hire a designer
um
that's too much padding now I'm upset
with the amount of padding let's lower
the amount of padding
that didn't lower the amount of padding
I wanted my box has too much padding
it still didn't do what I wanted the
button has too much padding
elements
call that padding
but didn't
no stop trying to make it important it's
not important
heading bottom 0px
yeah
that's what I want
we're going to leave the URL
functionality working while also
implementing the webcam function
should we have our radio button to
select
okay fine I like your used webcam
all right let's let's get the video cam
let's go
uh
in honor of all media devices
[Music]
we don't need audio that's stupid why
would we use audio
why am I taking the names from this guy
cool
cool okay we got a media stream
oh this is pretty good
shit we're gonna have to figure out how
to like encode them as pngs or something
that shouldn't be too hard actually okay
uh
uh no no this is what I want okay how do
I get the video can I just like send the
video camera okay
Source object no I want to like get a
frame from the video camera
uh get user Media frame from
webcam
taking still photos
okay of course they make a lot of things
way too complicated
oh we need a video Source object really
do I need that
what's a video
document.getelement by ID video
you have to make a video
because I kind of went where I want it
because I wanted to know I like I want
reference our stream is not defined
oh is that the Stream
green
why don't I just do why did he have two
things why doesn't he just do that
okay cool
uh we just need to make the video the
right size
wow the web's really good
why are all websites so terrible when
you can actually like make them good if
you don't write tons of garbage no it's
because they're using 30 million
Frameworks okay
um why didn't that work oh
because that's a class
can you early invest in this
yeah you want to invest in the
let's put a border on this
right don't you wish everyone made
borders that look like this all right
border Style
wow look blue shows up as blue in my
thing
4px is a disgusting amount of PX and
they're different sizes now which is
upsetting to me
[Music]
vid is not defined oh yeah because I got
rid of vid okay
um
you can add object fit cover oh fire bro
there's a CSS for that uh no I'm just
I'm upset that like why is that border
I want them to look the same oh yeah all
right let's go let's go
oh it's using this webcam how do I use
the other webcam
I want to use the other webcam this is
my Chrome settings
whatever we use this question it's fine
a good point
oh shit wait it doesn't make sense
could I do I all media devices
you can definitely use them in both OBS
and browser but whatever I'm fine with
this I'll use the other webcam I have
two webcams for a reason
okay
[Music]
um
we have to click a picture
how do I take a picture all right
now stream it to the wasm parameter
hey Chrome setting contact I don't care
about this oh I'm over that okay uh
JavaScript webcam take picture
okay taking still photos okay
um lots of complicated garbage
video dot add event listener
handling clicks on the button take
picture it was the take picture function
here we go
oh great
yes look at this this is this is so this
is oh shit so cash bro
um I know what we're gonna do I'll have
some great ideas wait till you see wait
till my designer gets his hands on this
okay
where do I get this canvas from
how did you get a canvas I don't have a
canvas
only 224.
where's my canvas how do I make it I
have to make a canvas
so
how do I get my canvas document I can
only get ID canvas okay
let canvas.com
is that the ID or is it just called
canvas
oh that's great
I love how JavaScript doesn't have any
like names okay now we have a canvas
here too we use webcam
hmm
where's my canvas
how come I didn't draw it
it's not helping why are you posting
weird shit
uh
you want to post things like that post a
link
okay
we drew the image I don't get it
data URL
sir this is a Wendy's
photo.set attribute oh with that set
attribute who writes things like that
see if that works
that should have went there
who's saying bye
why are you all saying bye
wait did it stop streaming
what is messing are you saying bye to
the astral XI guy oh he left oh good
well he was useless so he left
uh
they're trolling okay
yo chat you guys are difficult all right
um
what does this work
see you on East Denver
right okay so what does this work
if width and height where did width and
height come from
on
canvas.set attribute what
hate this
do I have to await the video play or
something
yeah zero zero okay
um oh wait can I wait that
there we go oh wait love away
oh yeah okay
now I just need to make the canvas
invisible and make the video Invisible
why does it look why do I look squished
well we definitely don't need to make
the canvas visible
canvas
visibility
no
no it didn't work why is it still there
only set the height not the width or
display none
okay well
okay we'll make two functions
enable webcam
no I know what we'll do
cument Dot
set timeout
I know web
this is your document that's that
timeout of course
oh I don't have to document.it I can
just set timeout
that's pretty cool
I have to support ie6 though so you know
it's important that we use document
that's that timeout
what documentation system that's not a
function
oh about the window not set timeout okay
good
okay all right uh let's make it not a
PNG let's make it a jpeg
why did that be black first don't be
black all right let's go
um
where's this video I want this to be
display none
okay and then after we enable the webcam
uh webcam enabled
dot webcam enabled
we do this
webcam this is the worst JavaScript I'm
writing
uh okay
I don't know why it's squished okay and
then here we do
uh video dot style how do I set Style
set Style
JavaScript
put object fit on image box
oh good idea
uh
uh no because I really want to actually
see that
no I don't want to do that
and we make the video visible how do I
make how do I make it visible how do I
set
oh without style that visibility equals
nothing okay um that's
that's style dot display equals that
what's normal for display
no that didn't work
dot show
no I want to change the aspect ratio
video.show is not a function stop it
play equals visible
play none
how do I display block
in line
okay cool
I think this UI is pretty intuitive
right
when you use webcam it like it's gonna
like take the picture there and then put
it
and that just stays there
as preview
that's not that intuitive let's stick
video somewhere else
let's take it above use webcam
but we'll also make the height
zero PX
and the width 0px
but then when we do this we can say
video.style dot with equals I don't know
100 PX
yeah but that's okay that's almost what
we want but we want that to be above so
we'll just do display block
oh but you want it to be centered
centered why is it not centered
perfect that's what I wanted
but it needs a little padding
no but now it has a border never mind
you know what needs padding the use
webcam button
no margin top
perfect
okay
all right we're almost ready
big and big right
wait these are so stupid why don't I
just give them names
instead of this one we'll just call this
URL
instead of this one we'll say use webcam
not big and big or fine they can stay
but that big is stupid and can go
why is the word pending scroll off the
screen
okay
now we made a JPEG right and we can make
a PNG we're not we're not we we're not
poor we have plenty of memory
so what's a data URL oh wait a second I
know what we have to do this is really
easy now
um
run that with resource
resource
oh wait run that with resource
I need to await it do we
okay
and then I actually I don't even need to
do that there
okay
oh
okay it's complaining about three
channels or something I don't know let's
try a jpeg
jpeg works
why did it say result oh oh
because this needs to go here
with this
foreign
URL works
now
ping pong ball all right let's try The
Vape
punching ball
wait is this right
I worry these aren't right
purse
even my face
uh what do we know reliably works the
remote
okay
it's pretty good
yo who else loves the web
let me make a copy of this because I
actually didn't save it anymore
okay
uh we need CP
fun
tiny grad
wasm
uh we need web.html
I love web 1.0 right everything's so
easy
it all kind of confusing the web jumped
the shark can we all just admit that
it's okay
um
try it on the web
slow
foreign
okay
let's push it
oh clear the pending text yeah good idea
uh yeah we can fix that hang on
where do I get the result
um that's not that easy to do actually
because I don't know how many uh
that's fine whatever ship it fuck it
ship it
no okay be better if we get rid of it
all right all right we'll do a good job
we'll do a good job
when result is back is not the easiest
thing in the world it turns out but
um
foreign
all right let's give it a bit to push
you guys try it out let me know if it
works and then that's the stream we did
web today
thank you
what if all these Frameworks didn't make
anything better and you all got scammed
foreign
I feel like it's just not going to work
on the web for some reason
push push push push push
this is the real web can you believe it
works here
gonna fail in Safari well you know
oh shit
oh it worked it's just slow
oh because it had to fetch it from the
real web
sweet
works on Opera
foreign
all right who wants to hire the tiny
Corporation look at the things we can do
look at the things we could do
ah
worked on Chrome mobile wait oh yeah
let's try to mobile
wait is this gonna work
it's gonna work on my iPhone
did I design this website to be mobile
friendly oh it looks pretty good okay
use webcam tinyguard.org we like to
access the camera that's fine
thank you
why doesn't it work on my iPhone
just a white box
it almost works on iPhone what fails and
how do I debug this
it's probably not pending forever
actually
so the the efficient that itself works
on my iPhone but my webcam doesn't
which I don't understand
water bottle return nipple well
use the emulator in Chrome
well what did I do wrong why didn't this
work
don't worry about the cores issues all
right great I believe none of you about
the temple OS
I just don't understand why like it's
not giving me a preview is there any way
to get like
I'm also gonna need to change the
styling for mobile hang on I'm on the
same I should be able to hang on let me
uh throw my HTTP server up
which I already have uh what's my IP
address
all right it's actually right
what's because I turned Wi-Fi off that's
not gonna work
yeah this does not work
no it just doesn't like
what's instascan
some QR code thing
needs return and feel to use URL
can someone figure out this is open
source right
can someone figure out why it doesn't
work on the iPhone
what my pull requests
iOS needs more attributes
what attributes
oh
okay
what year is this from
foreign
[Music]
hopefully that won't break my stream
URL works on edge Chrome
webcam not
all right okay 0.132 that should
actually work
this is like a firewall or something
okay load it
now that if I do that it doesn't even
come up with a request to use the camera
unless there's just some bullshit where
you can't
Android Chrome Works
this actually might just be that I can't
request the camera from a
also how do I make it work looking good
in Mobile
mobile viewport it was like a it's like
a tag finesse
yeah this
put it after the head tag
at least I can access the thing on my
hmm it says pending forever I don't know
how it works
how come you use webcam doesn't work
code pen on that stack Overflow Link
Works
what code
oh it's like some
well either way I want uh
at narrow when there's a course issue
wait on your iPhone
okay so maybe it is that thing that I
commented out
for some reason I can't use webcam from
uh
URL but that's fine we'll just push that
and see what happens
po dot pop
no there's web on Tiny grad no it's not
it's in tinyxx in the tiny website
I would never ruin my
beautiful tiny grad
try to disable the console.log it makes
the code slower get out of here
it does request access though the other
one doesn't
for some reason my local URL can't
request access it's probably because
it's not https
no it didn't fix the webcam
Android work easy
I'm no I'm not I'm not seeing anything
foreign
good
that means it doesn't have three
channels
it's annoying because
you can still debug iOS
Safari via Mac OS okay you're right I
should try to Mac OS
no it works fine in safari
yeah RGB m a image doesn't work
um
thank you
connect phone to Mac
I don't have a cable for that
hmm
oh
I say
I have to add them to the video element
is it true like that
you tried setting the attribute and it
works oh okay
yeah I say cool uh do I set them like
that
what are those parentheses I've never
seen that before
no that is okay I say
because it plays in line capital or
plays in line
oh wait it's not even true it looks like
you don't even need the true okay well
I'll leave the truth because I trust him
more than true
iOS Maybe
webcam is working for you in iOS Safari
how what version of iPhone do you have
wait did I even push anything
oh I didn't even wait I did push and why
is this so broken
oh it worked sick
it's pending
I'll probably make two requests that
says pending
um
I don't know
wait it's stuck on pending now
why won't I fix one thing do I break
another thing
no one cares about Firefox
why is my iPhone stuck on Pandey
it doesn't make any sense
why would I fix one thing would I break
another one
works on yours
it's working on your iPhone
oh no it worked because it's just really
slow
and now it's faster I don't know
check that boys
check that yeah it's a little slow
probably because everyone's handling the
site
I don't actually know if that's true
yeah
yeah
all right we made it work on iPhone whoo
actually I'm I'm really happy with how
simple that was
uh especially the web part
because it gives me hope for oh my
canvas flipped oh
now you've experienced me the other way
the whole time
there we go
now make it use the rear camera I don't
know how to do that that's too hard
Band-Aid
bro you have to go
that's a great event
okay
wow
that went on a lot more than I thought
it was going to
come on come on if that doesn't make
Hacker News what will make Hacker News
uh
you know I just want to say Dropbox was
a stupid idea time gradual you know we
were wrong about Dropbox timing Brad's
definitely a stupid idea
can you publish it on product hunt yeah
what are we gonna do with that
um no okay so some real future ideas
it's a little slow right now so you
can't really make it real time like the
net takes too long to run but when we
switch this over to webgl or web GPU
um we can run it real time
right we can run in real time we can I I
really want to move away from from wasm
entirely no whasm get rid of the wasm
switch to switch to switch to good old
uh vanilla Js
um
um uh facing mode environment yeah
I think it was one line like that
wait
wasmo replaced JS I don't think it will
all right all right all right I had
facing mode I'll add facing mode all
right fine
where is that
[Music]
getter
foreign
like that
okay that doesn't affect anything
uh front camera is facing mode user I
say
rear cam on iOS
yeah give it a second to push
if fetches recognize that was I'm
waiting why is it not cached
oh it fetches recognize.wasm there I see
uh shit
I can fix that wait Alex is calling me
relax We're on stream
what's up
oh hell yeah I want food I'm starving we
did web today we actually had a
hilarious time
check it out it's the wasm tiny Grand
efficient net it classifies me as a neck
brace
yeah
yeah wait do you want to go somewhere
food
um
I mean I kind of feel like I should eat
Mexican food because if I don't eat
Mexican food now I don't know what I'm
going to
what do you mean
what do you mean you don't know when
you're going to
Mexico yesterday I'm interested in
Lefty's Chicago Pizza though
but we had pizza yesterday is that too
much pizza
don't get me started
um
cheese steaks are disgusting and I don't
know
I I could have told you like oh
um wait I don't know
oh that sounds good yeah yeah you want
to find us some Japanese where are we
going Japanese
Hill
or you want to go to Utah or no no no
let's walk to that one well you know
what we'll take that we'll take the car
just come home when you get a chance and
we'll get we'll get sushi I want to go
to sushi Alto but see if we can get in
no there's just reservations there now
it's crazy
someone found out about it I know
like Ellen yeah
all right do we fix the did we fix the
webcam does it use the right one
okay yours is the right one
desk
uh wait I was gonna fix another bug
what what other bug oh recognize wasm
um yeah
we don't fetch it every time
um
okay
this is easy to fix we just say
prog equals none
not
if Prague
go even further
I don't know if we'll change anything
either but
most console.logs are stupid
right actually do I need any of this to
happen twice or just this one
oh and like image pointer and stuff
I think the rest of them
I probably do want to reinstantiate I
don't know I don't think that's slow is
it
I mean see it's loaded from the browser
cache but still
okay the reeds are a little much
where's 107.
oh I'm still logging the resource I say
it's probably slow tail
yeah your memory might get messed up I
agree we're not touching that
harmonica all right
what kind of food should we get
well we're never going to see the
difference about this one
that's fast
Vietnamese sushi burrito
uh pasta pizza donor
okay wait wait wait wait wait wait we
gotta do a few more things we're almost
done we gotta do a few more things we
gotta do this webpage a title
let's call it wazen tiny grad
tiny grad has wazzle
put a table somewhere tables are cool
is the tiny Corp hiring front end devs
look guys the tiny Corp doesn't make any
money
and that's the problem
bro
you're not even allowed to say this on
stream
but I'll show you what it is
oh Alex's home we gotta go
computer keyboard
yeah we recognized my keyboard
Paige has title which is the normal tiny
grad page have a cover title
oh a long one
all right
are we done
it's nice actually the whoever got me to
put the uh to switch to the back camera
I I appreciate you like this is just a
much more usable experience we gotta
turn this into adapt and launch tiny
token I agree I agree would you guys buy
if I were to sell governance tokens
would you buy them
what about now I will warn you I will
warn you before you buy any tiny
governance tokens
um
our response to when are you launching a
governance token will there be an
airdrop is bra so I've just gotta I
gotta warn you about that
oh we should make
oh
pajamas you just think that because it's
dark in here now
uh it will definitely be a rug
um well I mean the governance tokens are
all wrongs right it's just a question of
your time Horizon right everything's a
rug if you have a long enough time
Horizon even the US dollar is going to
be a rug someday how are your Roman
leadership's doing you know what good
because they're made of fucking gold you
know what your dollars are made of paper
that's right
um
yeah finally you know the keyboard I use
right look it's a picture of the
keyboard you've never seen the keyboard
on the stream and look at the keyboard
all right
um
gold ain't shit well let me tell you how
are your Confederacy dollars doing the
paper ones actually probably pretty good
they're probably historical collector's
item
um
but yeah
okay
we did what do we do today we wrote a
C back end for tiny grab
we wrote
efficient net a clang back end for tiny
grad we wrote a compiler to compile that
claim back into extremely portable C and
just when you thought the stream was
over and we were done we learned web and
we wrote a web version of it using wasm
and let me tell you something anyone out
there if you like that demo and you want
it to be real time it would be probably
three days of work to get tiny grab to
support webgl you're like but I could
just use tensorflow but could you do you
know how to do that no because the
documentation is
super confusing and you need to npm
something
I'll make you one JavaScript file you'll
just say Source equals the JavaScript
and then you'll have the JavaScript and
it'll run the ship
um yeah
Nets in the browser what do we think
uh
uh do we make Hacker News yet are we on
Hacker News yet that's that's all we
care about we're doing this because
because we need we need contracts guys
Alex is upset with me
that the
eye Alex is upset with me that that that
it doesn't make any money uh so you know
I how is this not on we need we need to
be on Hacker News so we can we can get
contracts we did a demo to show off the
insane power of of tiny grad uh do I
work out yeah bro yeah do you we don't
work out bro
um
oh the tiny the SoundCloud the
SoundCloud I'm learning look I'm
learning guys
what do you think of my trap drums yo
and then four on the floor yo four on
the floor four on the floor snare
laughs
you know Jake type B
your fire alarm needs new batteries type
beat all right we leave it that thank
you for watching the stream uh goodbye
everybody
uh let's see wait wait wait is a lot of
luck streaming
you rated me we can raid back
uh
no not streaming how about Jay blow
streaming
do I believe that everyone can be a
programmer at least some degree
oh he was going to talk about whether
everyone can be a programmer oh that
does sound like good bait that does
sound like good bait I would love to see
it but
um
find random load to your Music Streamer
no that's too much effort I gotta go I
got food uh create some random one
viewer
it might be live
all right so now I tweet this
foreign
you know
I figured it was most appropriate to
live stream here on Twitter instead of
on uh on on Twitch since we're gonna
figure out how Twitter works on Twitter
should we should close the closet door
um for those of y'all who don't follow
me on Twitch I'm a streamer
uh Twitter's not Instagram stuff's not
copyrighted
um
if you want to post it it's entirely you
can no clips obviously you know my rules
uh but let's go
okay so um the way that I got this by
the way uh my friend who is watching my
Twitter text me he's like yo I can get
you media studio
um
uh yeah so you know we got media studio
uh not through any uh legitimate
channels
um so Elon you know this is free money I
would have happily clicked Bing uh
dude all right uh so we can uh I'm in
OBS here so I can go like this
and uh
we should be good that should be my
screen all right cool
uh we're gonna move OBS over here
and then we have a nice Chrome with uh
clear history here uh
all right
and bring that up
all right so these are my Twitter notes
so far uh you know you can all probably
find this funny if you work at Twitter
um so we're gonna do this without being
logged in I just go to twitter.com
uh you see what comes up here and then a
great place to start with any web stuff
is to start looking at the uh is the
resolution good enough for you guys to
see this these stuff
I know people complain
oh well it looks like it's being cut no
it's not being cut off my mind oh okay
that's kind of visible
um there's also a lot of lag
there's also a lot of lag uh we don't
have any live chat here so you guys can
post on this tweet and I'll read it over
here
um if you want me to uh see something oh
my God okay so I was already looking
into it a bit
um it looks like so a few notes about
Twitter it doesn't load at all if we
turn JavaScript off
uh so if I just pin no script here uh if
I turn no script on you'll see that it
just complains it says javascript's
unavailable so that's the first thing
you do
because if you can do things without
JavaScript it's easier but the first
thing Twitter does is loads a whole
bunch of JavaScript
um so we can look and view the page
Source here
where's my JavaScript
um
oh there's a no script tag that's some
that's some OG
uh yeah so it loads these things
I feel like that number actually changed
is that like a cash Buster
uh copy and pasted which ones actually
was but yeah um so I can go here and I
can I already have cache disabled uh so
we can go here and see the JavaScript
that it loads
because it's not being loaded
it was being loaded last time I looked
though so I don't know what happened
um
regardless it loads JavaScript from
uh oh well so I can change my notes up a
little here
this is what webpack is I I don't look
I'm not that familiar with front-end
stuff so you know if you're expecting
for me to be an absolute front end
wizard I'm not uh you can all watch me
uh you know be a noob
um but we know some Basics we know the
old school internet
uh
yeah so I I noted a few things they have
a CDN at twimage.com if you go to
twimage nothing loads but if you oh
sorry
um
if you do a who is we can figure out
when they registered it
it's old
registered so we're docsing Twitter I
hope this is okay we're doxing Twitter
on Twitter it's like meta I don't know
um how laggy is this live stream by the
way
uh let's let's refresh and see what
people have to say in the chat let's go
not that visible is this recorded low
res let me see if I can do something
about that
um
custom here
put video bitrate where's resolution
can I can I stream in higher resolution
we have a lot of bit right here
uh we used a custom I use the custom and
I copy and pasted the r
I don't want to show you guys any stream
keys or anything no we're streaming and
oh I guess we're streaming at 1080 and
my streams my screen's a lot more than
1080 but you should still be able to see
um hard to read any text
all right we'll have to just zoom in a
bit more all right well we'll zoom in
we'll try it zoomed in you know it's
harder for me to work zoomed in but you
know what we're here to have fun anyway
um
okay uh
so yeah this is what I found kind of
from the front end
um now I don't know if this is the same
API that uh Twitter does but there's a
really cool thing you can do so let's
like go to a tweet here oh let's click
these does this truck make my dick look
small great great God love it um
so here this is tweet detail
excuse requested URL there's actually
something really awesome in Chrome you
can right click and go to copy and copy
all as curl
and
wow I'll copy all oh that's not what I
do
okay okay yeah great great great great
great great yeah yeah yeah yeah okay we
want to copy
as curl not all of us Carl
uh so this is this is a curl request and
we can break down what these things
actually
a minute oh let's just kill this
there we go
um just create a new file here called
curl.sh and actually let's start making
some requests from python y'all want to
see me do some coding you know we're
here to code am I violating the Twitter
terms of service probably
but I'm doing it live on Twitter so
maybe it's okay
um
okay okay that crowd works all right so
let's break down what these requests
actually are
um so for those of you that don't know
graphql is a query language for your API
and I think there is some ways to
request
like some metadata now I don't know if
this is the Twitter developer API so
let's let's
always read the docs if the docs exists
first
uh okay it's readable yeah what are you
talking about a resolution and proof how
do you go live on Twitter bro you gotta
have a guy you gotta have a guy get you
access to Twitter media Studio man like
legit I don't know if there's another
way uh but yo my friend texted me this
is this guy's like an internet like he's
an internet genius you know with all
like the people he knows on the internet
uh and he's like yo I can get that for
you
um
so uh yeah let's see if the docks here
uh say how to do it
uh what was I looking for okay let's
let's just search for graphql and see if
it's the same API
your search for graphql returned zero
results okay
let's go to uh
realapi dot Pi okay we're gonna call it
real api.pi because it's python
um
let's first find a request that returns
a less expensive amount of data I recall
correctly this one does
bad guess token oh well oh well that's a
bad guess token okay
um
let's find a shorter one of these
okay so this is a totally different API
this is API 2 guide Json I also found
this thing called hashflags.json
um it's kind of cool it like shows you
like probably the people who paid
Twitter money to be a part of this thing
uh yo this is so fun boys it was great
you know what's great about not having a
real job at a place you can like just
you know mess around publicly uh
and you know it's fun it's just fun man
because there's no expectations you know
once there's expectations uh so I know
that we're on Twitter now we're not on
Twitch so some of y'all might be new to
my stream and new to the kind of things
I do uh we kind of shit talk casually
while programming
so let's look at this here copy copy is
curl
all right that one runs and emits a less
offensive amount of data
so let's go here
um so let's throw some V's on that bitch
we got vs
uh good
wow API V2 HTTP V2 yeah Twitter uses
HTTP V2 okay so fundamentally first off
interesting thing to note is that it's a
get request so let's start with
request.get
and let's copy and paste this
uh yo I was I was listening to you know
some gang gang
I listen to gang gang
why how do I do this the quest dot run
it feels like a way to do this
ah see I don't know anything
don't hire me I don't know anything like
you think George you should know how to
use requests man if you are a real
senior software engineer you'd know that
kind of stuff but you know I'll ask I'm
a fraud
um okay so I will note that that
actually does nothing
uh let's look at the status quo too
because I'm probably getting a 403 I
guess it's gonna be a four or three all
right so for those that don't know 403
means unauthorized you just got to know
your HTTP codes that's a question I
throw out in common interviews I'm like
you know what's the 200
all right
what's the difference between a 301 and
a 302 man you know what do you think of
the band 303 now I've never asked that
um
can't trust the hoe we won't trust as a
hoes don't trust me
uh
we're gonna need some of these
parameters because they're important
oh we should bring the mic up here too
we'll give you oh yo I tried to get
better lighting I almost bought
expensive cameras but then I bought a
ring light uh so that's why my face
looks like I'm glowing
ah oh wait are we allowed to listen to
copyrighted music because this isn't
twitch
should we just should we do it I don't
know man this is weirder talking to
myself without a comment or stream being
like George no no they'll mute you
they'll kick you off the internet if you
listen to copyright music while you
stream
um
all right
okay so let's figure out you know what
first let's
you know what I always say hacking is
just binary search by hand so let's
figure out which one of these actually
matters
so notice that the request still works I
don't know let's delete these ones
and see if the request still works
all right you see what we're doing we're
doing binary search by hand
good the request still works great
uh do we need those ones
what is dash dash compress do for
current
nope we need some of those some of those
are important
compressed oh and automatically
decompress the content so I don't think
we need that
uh I probably should have done this in
the bash script so I'm not copying and
pasting things over and over again
all right good that still works which of
these can't be important uh Authority
cash control not a brand that's those
don't look important
still works so we're just trying to
figure out which of these HTTP headers
we actually need to make Twitter
requests
um
probably not important but maybe
important
still works
X Twitter active user
all right
we're doing web boys we're doing web who
likes when I do web right we need this
serious health token
um
I didn't even need the csrf token okay
great
um I guess I just needed the cookie or
do I need the guest token let's try
without the cookie
the cookie was not important maybe just
the guest token was important I don't
think I need a user agent
internet
see look look at all the stuff I've
already removed we can remove all that
stuff and make Twitter that much faster
because that's how it works okay we need
an authorization and do we need a guest
token
let's just do that last thing
see look look look look at how much I've
already optimized we were making all
those requests with all that stupid
stuff and now we don't need all that
stuff okay
um
programs data headers yeah that's it
let's say headers equals headers and
let's throw some headers here
so I mean there's a lot of ways that we
can go about approaching something like
Twitter so this is let's figure out just
how their API works and think about what
we might be hitting I started some notes
on the back end usually I mean you can't
get much information about their back
end but usually when you want to look
into something like this
you read their engineering blog and it's
usually pretty good
they talk a lot about Hadoop uh I will
also I will be honest I've never written
a line of Scala in my life so maybe we
should just take a quick look at what
Scala actually looks like
um learn Scala should we learn Scala
uh
Gauntlet installer I you know what maybe
we should do some hacker rank programs
in Scala all right we'll get there we'll
get there come on I got to prepare who
knows who knows what's gonna happen at
my Twitter interview guys
you know who knows
um
how do you go live on Twitter you got to
be a giga Chad to go live on Twitter bro
uh
uh can't really see anything
quick grab hotz's bear token and go
Rogue
what's my Bearer token did I post up oh
oh that token guys I'm not logged in
because you can't you can't do anything
with this token I'm not logged in
um that's why I'm not logged in guys
uh
do you think I'm stupid do you think I
would do this with a logged in account
bro I have some off stack no I'm I'm
okay I'll check
no one tests my op sack I'll fuck you up
in court bro
uh
headers we have X
guest token you know what this reminds
me of I did spend some time automating
uh dating sites like automating Tinder
and Bumble and stuff
reminds me kind of doing that
let's throw a shebang shebang
by the way who's excited about the new
python python is it python 312
um okay good so we'll notice that I've
replicated the curl in Python
uh okay now let's break this out a
little bit
um
oh God
look at that uh
uh I want to decode those things it's
not like a way to do that
like not
gonna first
say URL
I URL
all right
there's got to be a way to decode this
I'm sure if it's gonna work
um
python decode percent encoding
parse import unquote
whoa okay so basically that's just Json
and the variables
can actually what if I just do this
can I just still pass that to requests
hello we're streaming on Twitter
no it wasn't but um our boy we just say
we're not going to say on stream but the
hook this up and got us Twitter media
studio so we're streaming on Twitter now
we have 857 viewers yeah we're reverse
engineering Twitter on Twitter
yeah
so how does Twitter work right
okay so good good I'm glad you know they
have safety mode user Fields guys safety
is very important
um yeah yeah yeah yeah this is this is
Alex you all know Alex
do you want to say anything to the
stream he's like I have a light now
it's in the wrong place I do the light
wrong do I have that light over there
look how much
oh I know okay we'll lower the light you
want to you want to be in charge of
Lights I bought a ring light guys
you know that you need to be it should
go back there yeah I know but that
doesn't fit back there we'll just lower
it a little bit yeah yeah is that better
yeah
yeah all right
I think even if I just put it on the
table it'll be better no no but then
we're not messing with the light too
much okay
thank you
I'll be done with this in seven hours
Alex I gotta prepare you know if I don't
get this job how are we gonna put food
on the table
what yeah I don't know what they're
gonna ask me maybe I should learn Scala
[Music]
now listen do some scholar challenges
guys we'll do some style challenges
oh that sounds lovely
um
let's say
how do I describe percent encoding like
right uh
let's just take this and throw this in
here okay hang on I want to do a few
things
um
let's call it uh what's called variables
it's called Data variable somebody's
sketchy
data and then yeah you see that I have
to like Google things too because
because I'm actually an idiot
um all right so we have params equals
variables
let's see does that still work
oh the following features cannot be null
look at this we're getting some data
back though
uh headers
params variables data
shouldn't that work
um
is that what params are
dictionary list of tools I mean
try that does that work
hmm weird
why does that not work
isn't that exactly what params is
list
of Tuple or bytes
send in the query string for the request
okay I don't really understand but
whatever
um
wrong I don't know
regardless uh let's break this Json down
so uh
Json
Json dot dumps yeah good you understand
sweet
all right
um let's see if this is normal Json
all right oh no loads
please get that backwards
extra data okay
is this not valid Json
um
why is there extra data
data line one
column 89.
it's like a broken quote or something
oh and features oh I see
okay so that's why that didn't work
um because we have something called
features too
okay so first we have variables
and that's equal to this
a user ID now remember you know you can
say like George why you wasting time
copying and pasting and the truth is
this is how you learn at least this is
how I learn and like I said you know I'm
slow so
uh
the truth about being a 100x engineer is
just putting in 100x more hours
no it's not really true
so now
let's see if we can get params to work
[Music]
variables variables
I promise we'll clean this up but this
is using the undocumented Twitter API or
it's probably actually documented
somewhere and if someone wants to post
like a link to it I would appreciate
that but we're learning okay
that doesn't work
okay does this still work oh great I'm
glad that works otherwise I would have
been annoyed okay
okay
um can we Json dump these
jump jump
oh let's just throw a gear repo here
just so I can
whack
just so I can get diff when I break
things
I'm probably not going to push this
but uh it's so I can get deaf when I
break things
okay again it's loads
well those automatically be Json encoded
well they won't be uh wants to write a
dictionary comprehension
params equals
okay Json dot dumps X for X comma K in
params.item see I can do some stuff
without having to Google probably got it
wrong I got it right all right cool
uh I agree so we have headers we have
variables and we have features
to start looking at what our response is
okay so our response clearly looks like
Json so I think there's actually I can I
do like r dot Json yeah so
on method response
um sir r dot status code equals 200 200
is good guys when you get a 200 you're
winning oh good good they have a Ukraine
flag and they have atheist and resist
and Panasonic is that good that's good
let's get to another one of the good
people
um
it's not use this this is junk
uh variables sorry I just picked a user
at random I don't mean to call you out
but I mean I guess I'm shelling for your
causes so
um
well we're going to try incrementing the
user number by one now remember when
we've incremented the user number by one
he went to jail and became a Nazi so
let's hope that doesn't happen to us
when we do it
[Music]
let's try eight do we get a new user
I think we got a new user guys
I think I don't know I can't really tell
uh there's a python thing to like pretty
print Json
python pretty print Json
oh actually there's just a pretty print
in Python
pretty
uh okay so that dumps
no
no preprint
all right look at all this great stuff
we got
um and now this should work for any user
ID all right should we should we
sponsors webql timeline enabled all
right so we're making a query to Twitter
that has this stuff
well probably like do you like George
you can just do this all in this simple
web tool and yeah yeah you probably can
but remember I'm slow so
uh I bet
wow you can see when a Twitter account's
created all right let's go get my user
ID
this is too mad I guess it's too meta
all right
how do we get my user ID
uh user by rest ID
variables
it's my Twitter ID
well I have a long user ID
probably because I'm not legacy uh oh
our status code is not 200.
status
Our God status code
400 what's a 400. 400 status probably
fail my own interview oh that's a bad
request okay we messed the request up
guys
so have you messed up
oh maybe that 22 is uh actually in the
yeah yeah it's in the percent okay get
rid of the 22 no 22.
we don't have any 22s on that sorry good
oh look at this
here we go president of com AI oh URLs
display URLs this is pretty nice should
we write a custom Twitter client and
replace the Twitter client with
something that is fast and lickety-split
we can
now that we have secret access to the
Twitter API right like there's an API
and then there's an API right and that's
like it's sad when these these apps do
this right they have this whole
developer API now maybe it is the same
API and I'm just an idiot and search for
graphql and just their search is bad
um but all right let's see how can I
make a Twitter API getting started
access the Twitter API okay okay okay
okay okay okay seems very complicated I
tried to click sign up and they asked me
if I was gonna like sell my data to
governments or something and then I got
bored so I stopped doing that like I'll
show you what happens if you click sign
up
so these these endpoints don't look
anything like these endpoints
um which use this graphql thing now
what's interesting about the graphql is
I'm not really sure what this is
so when I look at it it looks like
base64 encoding
but I tried decoding the base64
now we want to decode
like this website probably get so many
good leaks and I just get this which is
kind of useless
um so that might just not have a usable
thing but we have user by rest ID with
safety mode user Fields with super
but all right so you basically make this
request actually do we need features
what if I just send variables does that
work
status code 200 no we definitely need
features do we need any of these
features
to disable that feature
400. oh I think if we still get a 400 we
can maybe get some text
yeah yeah okay the following features
cannot be no oh great
um
foreign
one of my most accessible streams yet
because I'm not like doing something
that's like crazy hard I'm doing like
hack this box level stuff you know all
right good you're getting 971 viewers
um
the following features cannot be not we
absolutely need a responsive webql graph
timeline what about verified phone
labeling can I disable that one
no no that one can't be no liner so can
I disable these
that's a variable that's not a feature
query violation variable has an invalid
okay there's probably going to be some
way there's some way in graphql to
request like
I don't know if variables and features
are like a normal part of graphql I'm
honestly not that familiar with it
there's probably some way to request
docs man whenever you can get things to
document themselves that's the best all
right let's just search for graphql
Twitter API maybe someone's just
documented
and Twitter is public API
[Music]
did I caught my graphql in here
oh okay maybe this is just then the
Twitter API
notice how this looks different though
these are Twitter I
that's 1.1
right this is Twitter API 2. so maybe
this is just Twitter API one
well actually you know what a better
thing to search for would probably be
user by rest ID
oh here we go
okay so I know this is not the real API
if the first hit is uh
is the twint project an advanced Twitter
scraping and open source intelligent
tools
while evading most API limitations
oh then they throw it in some
elasticsearch no authentication no API
no limits
um wow
wait this seems pretty cool
why are they archival
yeah
so let's get some more graph let's get
some more high quality uh graph URLs oh
tweet detail here's another one
all right
so I'll notice that this has a
completely different whatever this is
it's completely different
um
these are my rest ID tweet detail really
good list of these somewhere let's at
least uh let's at least clone this and
take a look
at the Clone
did the lighting get improved
so maybe they have a list of us and
maybe like if so someone's already done
some work reverse engineering this so
no it seems like it's interesting that
this is different
and they're still using okay there's two
of them authorization and yes token
so that seems to be important
I wonder if that's an older version I
wonder if we can change that and still
works
query violation
variable with highlighted label I won't
maybe we need that one back
interesting okay so this is a different
version of the API so that's like
encoding the version
probably just some hash thing I don't
know let's um
we should try a little harder at that
base640 code I bet this is some normal
graphql thing can does anyone know
graphql and could just link me something
to it
uh hex down a64 code
let's look at the bites the bites Never
Let You Down
uh what is it oh it's like b64 decode
incorrect padding okay so it's not even
valid base64 I don't know I'll throw
some equals
there we go
I don't know that could be like AES or
something
right like whenever I see whenever I see
10 random looking bytes there are those
bites random
and they look pretty random
regardless it doesn't matter uh we can
just get it from Twitter
so what else might we want to do we can
get details about a tweet
uh we can get user by rest ID
user by screen name how do we get user
by screen name that's interesting idea
viewer here's another one
these are secret urls
you know I really don't like when they
have a completely different API like
this this should be refactor when they
have a completely
a good and this is something we do at
comma we use for the most part the same
API internally as our apps use right and
if you're not using the same API the
problem is it's just stupid to maintain
these two things that are basically the
same right and you're like well okay but
the internal one needs more access well
first off this one is an internal but
you should always have your apps
accessing through your apis
um
one of the things that I'd really like
to see with Twitter is a better API and
to again allow alternative front-ends
right if Twitter moves to a more to a
Less ad base than a more monetization
based thing
you should be able to plug the data into
anything what you're paying for is
access to the back end
look I'm happy to pay like I think a lot
of people are
um you and your wife are so cute well
thank you
uh would pay 99 cents a month to watch
these as long as they're in 1080p
um you hear about your eight dollars
uh
uh might want to censor the
authorization header I'm telling you
it's it's junk I just this is literally
a virgin Chrome
browser
um
convert curl code to request code like
magic oh interesting I'm just reading
all the the comments the dev platform is
under utilized by content creators
yeah because it's confusing
um we posted YouTube I don't know here
here's another one Twitter ql
user tweets and replies
how come they're different for all of
those
all right so maybe we should have a goal
W you're selling the voice in my head
when I'm scripting yeah all right I'm
supposed to talk right I'm a streamer is
this recorder streamed on YouTube and
then some cryptos cameras are great
um
wow a lot of trash
would you are these real trending topics
could we get real trending topics back
you know I was the top trending topic in
2010 Black Rain was the top trending
topic
I'm hoping like the old days of the
internet are kind of gonna come back
when it's less about
you really do have to wonder what all
the people at these companies do
right you just you just have to wonder
like I look at all this stuff and I'm
like yo like
I don't know maybe it's arrogance but I
think Twitter could be built and
maintained by 20 good Engineers right
um
maybe there's something I don't see you
know what I think we've we dove into the
front end and off uh we kind of get how
it works
um we can go and a bunch of people have
already done it like but I think I get
what it is
so it's this graphql stuff
um maybe we can make some guesses that
then it responds with some JavaScript is
there some way
is there some way to query like graphql
like to dump the type system of graphql
I'd really appreciate that
um graphql verbose
okay so what we get interesting things
when I like let's take out user ID
query violation
right like so this leaks some
information
um yo you do those like webpacking.krs
right I think
actually what if I what if I comment off
two of these does it complain about them
both or just one
no it just complains about one
first one
code
let's look up tracing Trace ID
um
I'd like to intercept
all right
learn
uh all right so quickly our guys reply
do you want to see me go into backing
stuff or do you all want to see me try
to learn scholar
exploring graphql I feel like I've done
these before and there's like pretty
cool ways so you guys I'll check the
Twitter in like five minutes we'll see
what the replies are you want to see me
do scholar tutorials or you want to see
me uh
go into the back end and try to make
some like numbers about okay how big
does this thing actually have to be I
read some things where they had like
they were talking about like a Hadoop
cluster with 10 000 nodes
I mean it just seems wild to me it seems
wildly over engineered for and again
maybe I'm talking out my ass but like
there's not that much
there's a few things that make Twitter
simpler than a whole bunch of of the
other services right
um so
first like
if if you're dealing with something like
YouTube
um YouTube
the storage requirements on YouTube are
insane right the the uploaded data being
uploaded to YouTube is is is is
petabytes right we're going to do this a
little at least
um so let's talk about the back end a
little bit
uh so let's say that there's well let's
just look it up
um number of tweets per day
there's over 500 million tweets sent per
day okay so we have 500 million tweets
uh let's say with metadata it's 1kb per
tweet
all right so this is 500 gigabytes per
day
this is not a lot of data
right
compare that to something like YouTube
um now to be fair probably one tenth of
the tweets have have uh have either
video or images embedded into them
um those can pretty much go straight to
your CDN you can have like a separate
system for this right
so let's let's look like I'll show you
guys when you have an image posted on
Twitter
like um you know this truck here
uh let's grab that okay so it's on
pbs.twimage
um this looks to be where all the images
actually are
images uh
JavaScript fonts
so that's ABS maybe we can figure out
what these things stand for
and then video is hosted somewhere else
um
can I do something like format equals
PNG
does that actually give me a PNG let's
take a look
uh
what is this
yeah content type image PNG cool
can we get a BMP let's see if we can get
a BMP
oh let's put that in quotes
you know like lead hackers probably have
like better ways to do this than like
holding down the back arrow but
did we get a BMP
nope we got zero bytes bmps are not
supported
404 no BMP for you can we get a chip
let's see if we can get a chip
oh we got a Jeff but it was actually a
PNG okay so the gifs are alive guys just
like okay the gifs are alive
um let's see if we can do small
Mall what if we smell small wrong
oh can't be found okay so they have some
image ingestion server that's taking
these things in storing them seems great
resizing them a whole bunch you know
uh that's good
so that's what you're doing for images
okay now
70 million 500 million tweets okay I
mean that's not nothing okay that's
actually more than I first thought
[Music]
um here's what they talk about their
their their back end
so like I said if you want to understand
the back end of a company uh the best
thing to do is to read the engineering
blog uh you'll at least get some some
basic ideas
uh so these graphql I mean I just want
to like get an idea and some of this uh
you know it's hard to tell from the
outside
but we can try to figure it out
um like so we're making this graphql
request right and then somewhere in the
back there's a database right and
there's a question of how this request
actually gets routed to the database
um like I said I'm not logged in here
also
I mean maybe here let's try a search and
let's see let's search for uh Twitter
all right and then
what requests actually happened
user by rest ID you know we know all
about user by rest ID what does the
search actually happen
search is an interesting one right the
search is probably handled by a
completely different system
um than this I mean so so far what what
requests have we found we found tweet
detail and user by rest ID so those are
probably pretty direct access to some
kind of database
um now from this blog post they said
they used Hadoop and Manhattan Manhattan
is a custom internally developed
distributed key Value Store
um
I mean I'm sticking with what I said
about the 20 engineers
um I mean okay there's not there's not
maybe 40 right maybe it takes a bit more
because you do have
the thing that makes Services hard is
when you think about how um horizontally
scalable they are right the more
horizontally scalable of services the uh
the better it is right think about
something like WhatsApp right WhatsApp
is almost perfectly horizontally
scalable right if it's just if it's just
point-to-point messaging right because I
can I can Shard all my servers and then
like okay it's got to find The Shard
when it delivers the message but that's
really no big deal right whereas Twitter
needs to do something like and this is
kind of a difficult request you can
think about how it might make it is when
it makes your feed right making your
feed is a big is a big question and this
is a distinct thing from search
right
so
yeah like like that there's some there's
some difficulty there
um they've all switched also to these
algorithmic feeds instead of just
straight up linear feeds
um I know there's a lot of controversy
around that I generally think
algorithmic feeds are better
um it'd be nice to know what the uh the
algorithm is
foreign
let's talk about their event processing
let's look into what their event
processing stuff is this is also recent
um these things do change but not that
quickly
okay we generate approximately we
approximate
400 billion events every day
so that's pretty far off from the 500
million tweets again so they're saying
400 billion events okay you're also
going to have to deal with lights and
stuff right
um
so you can think about how that might be
represented in something like a table
uh
there's various event sources we consume
data from and they're produced in
different platforms and storage systems
such as Hadoop vertica okay I've never
even heard of this one
[Music]
ah
[Music]
vertica analytics platform
what does it do
analytic database management software
company
that's too many words man
column oriented okay I've heard
something about this
so his date is by columns rather than
Rose
okay well they use it
um
Manhattan distributed databases their
custom thing so Hadoop means a lot of
things too Hadoop is a is a like really
large
um
thing but I I assume when they say that
they have storage in Hadoop they mean
hdfs
all right hdfs is hadoops uh storage
system
I remember also reading that they were
storing things in in Thrift
um I haven't seen Thrift since I worked
at Facebook uh but Thrift is um
Thrift is uh
similar to uh it's kind of like protobuf
but I think it also includes uh like a
IPC system like uh maybe even via RPC
it's some some some it might even have
an RPC built on top of it right you can
think of like a uh there's like look
like zmq if you want to like understand
zmq's docs are pretty good to understand
any IPC
um
okay Kafka this is another it's Apache
Kafka
open source event streaming platform
this gets into this gets into fancy
stuff
um
at comma like so we we wrote Our Own
um
we wrote Our Own uh
distributed file system because they
were all just so complex and yeah I mean
when you do deal with these very complex
things you end up needing like multiple
Engineers just to maintain them right to
maintain this large cluster and deal
with you know who knows how it might go
down I'm surprised that things are as
robust as they are but uh so this is
what we use internally to store our
petabytes of uh video data
okay the old architecture is shown below
new architecture on Kafka and dataflow
yeah they said they were talking a lot
about how they moved to Google Cloud oh
yo guys I got a vape by the way
vaping is my new hobby
um okay
foreign
events okay so what does this say about
how they're doing their events
so I like got distracted this was like
confusing
new architecture real-time pipelines on
Kafka and dataflow
um
patch compute Clause latency
what's heron
Heron Therapeutics
all right let's see let's read the uh
comments if you are wondering about
those IDs they're just string constants
probably for versioning
wait
oh that's a really good idea wait why
did I not just look in the in the in the
yeah I can just look in the uh
we just look at the scripts
um that's smart
that's not internal you're not internal
to Twitter doing that are you
uh so where are the script shows did ABS
twitter.com responsive client web Legacy
um mean JS yeah that's a good idea so
we'll just search in here for user
I rest ID
uh oh is this a pretty fly here is there
not so what this does
can I pretty fly this
how did you get yours to be pretty
um
uh online JavaScript beautifier
paste in that huge beautify code
of course it's written in JavaScript
take forever
um
oh we have all the feature switches
there too that's cool
that's really slow
create a new file called main.js
um I can do this in here kind of not
yo for Ross man he's everywhere
uh okay
we're gonna plug in
pretty fine
vs code pretty fi Js
uh
how to beautify a JavaScript file on
Save
so true beautify oh I need this
you
pretty five
Json now I want JavaScript
formatter
prettier code formatting using prettier
that sounds good a lot of people use it
command shift p
okay
command shift p
pretty
[Music]
prettier create configuration file no
command shift p
select the tasks you want to want
which is command
command shift p
pretty far let's create configuration
file
no
code Snippets for JavaScript no
prettier formatter prettier code format
I I don't understand
using command palette a format document
oh God I can't read
format document
there are multiple formatters for the
JavaScript
one of them should be configured
all right it's doing something I think
there's a bar there moving
did this pretty find my JavaScript I
don't know what editor you're using
um live streaming myself coding had to
suck for the viewer
but if the encrypted responses and
protobufs well what's this
elephant bird is Twitter's open source
library of lzo thrift and or protocol
buffer related Hadoop input formats
okay well good
um
scaleless sound Scala sounds more fun
and hardcore we'll do a little scalato
oh the prettify oh press the button oh
yo let's go
what I was wasting so much time let's
let's go let's go in here okay press
this button
oh that was so boss bro I'ma like that
tweet yo Yara slav coming through coming
through with the coming through with the
legit yo this shows you I don't know
anything about the front end right
all right I'll use her by rest ID oh
look this is so nice Bros who wants to
send user by screen name let's go let's
go Elite Twitter hackers boys we're Leaf
Twitter hackers
um
user by screen name
now let's do that
now it's gonna bitch and maybe like yo
but you you can't use that because
you're not sending the right thing so
then we're gonna send the right thing
okay
variable screen name has an invalid
value
all right well let's use screen name
screen name is realtor shots
is that going to be me
oh look at that wait wait wait wait wait
wait wait wait now does this API give us
Elite super user access where we can see
band people
Twitter suspends accounts that violate
the Twitter rules I'm sorry real Donald
Trump you still can't be accessed even
through the API
yo
yo this is that though hey look oh we
got all this stuff oh cool
yeah oh look at this this is this is the
elite list
let's just copy and paste this list this
list looks so useful
moderate tweet can we moderate other
people can we edit tweets
Bros did we just find the secret edit
button
okay
um let's copy and paste this oh we want
stuff to be ad free we might be able to
do that
okay so we found the secret Twitter API
you know they talk about how this is a
secret good open pilot well that's not
real but the secret good Twitter API
exists
let's just call this api.js
and paste that there okay cool
um
prettier was a scam
all right what do we want to know
can I like filter all just the ones that
use the word operation name because
that's all we kind of care about right
there's probably like ways to do this if
I actually do JavaScript let's just look
through and see if there's anything cool
sorry for edit
oh that's cool
check tweet for nudge Community by rest
ID Community reorder rules
quest to join Community oh this is the
secret secret Twitter API guys secret
Twitter API
wait a second
Bros
should we downloaded three
create tweet down vote I wonder how that
works
delete retweet delete scheduled tweet
DM muted timeline edit draft tweet edit
scheduled tweet it doesn't look like we
can edit a normal tweet
um we can check followers
what else we got
we can see noteworthy accounts
you can pin replies okay that kind of
makes sense
we can enroll coupons we can remove a
follower should we remove a follower
what follower Would we not like
a little safety mode settings that
sounds good
um trusty friends tweet edit history
Twitter article delete all right you
know what I just want operation names
uh I I know wait what am I thinking you
guys have I spent my life on the text
editor for so long that that I forgot
how to grab shame on me
let's grab
the rap
yeah now we're talking
put that into uh
API on
Dot JS yeah here we go oh look it look
that's so much nicer
you won't even throw that through sort
let's throw that through sort
guys I love pipes I love the command
line
all right ooh Bird Watch create appeal
create notes
um
you can't edit tweets you can only edit
schedule tweets and assume favorite
means the same thing as like
likes
favorite tweet unmoderate tweet can I
moderate tweets
well I can moderate tweets
all right well this is the this is the
secret Twitter API
so uh the secret good Twitter API is uh
is here
cool
um
ah let's go back to where we were uh
thank you thank you by the way to those
to the people who uh who sent me that uh
I'm gonna be right back
bro we got 1200 viewers
all right so I think graphql let's just
do a little more searching to graphql I
don't think it specifies anything about
a database
so I don't think it actually tells us
anything about the front end let's just
look through the comments maybe we got
something good
all right we have 1300 viewers
oh that's cool
encrypted response it's not encrypted it
just looks like nothing like it's just
it's just a version this query ID thing
doesn't seem like it's really anything
maybe good
um ooh graphql introspection oh
graphql allows us to do this
what
by querying the schema field
always available on the root type of a
query
oh how do I do that
I don't know let's try it
okay what if I go schema there instead
uh this would probably help if I like
understood what graphql was
graphql
introspection how to
should I search for four Noobs sometimes
you add for noobs they help you
yeah the graphql playground
it's like a request
no
no I don't know if this works
true
I don't do anything
foreign
fetch existing types
schema query type
oh do I put schema here
I don't know I'm just guessing I don't
think any of this is right I don't know
how graphql works
oh what is this type name user
is that the skin
no I didn't do anything
it's always just says that okay whatever
you want to First commit is changing tab
space for two from two to three yo if
they use three spaces I'm out I'm out I
can't work at a company that uses three
spaces that's impossible
um
pronounced Jif
uh imagine if George was down to be a
technical co-founder why would I found a
company with someone non-technical right
uh does he have access to the code base
no I don't have shit uh yet another Elon
fan joined us uh I would like to see you
get root and replace the blue check with
an icon determined by an hourly Twitter
pool
should we get root
um
wait how do you live stream to Twitter
you got to be late like me
oh yeah I don't overreact
Iran you know it's like
it's bad
thing there that's cool
400 bad requests if you ask me I I did
kind of know that
um okay
what were we gonna do oh yeah we were
just talking in general about the back
end
okay they have 400 billion events going
through Apache Kafka
Crossing billions of events in real time
day versus we consume data from
different storage systems I already read
this
Kafka topics event processor
Cloud did they really just move
everything to bigtable and data flow
why did they do this
but processing and relay event
processing which converts Kafka topic
events to Pub sub topics with at least
one semantics
I'm going to use these things first off
they love Java
a lot of this Apache stuff is like deep
in the Java land we wrote Our Own
pipeline at comma 2 because I was sick
of the complexity of all this we have
like a dead simple uh pipeline for
processing all our and all stuff
um and then oh we wrote this thing I
wrote this thing the end of last year
called mini Ray mini Ray is is like Ray
but mini and it just uses our existing
pipeline it's basically like you can run
a chunk of python code across the whole
comic compute cluster like nicely uh I
was pretty happy with that I spent like
a month writing garbage and then like I
wrote that it was 100 lines and it was
good
um
all right let's do a few scallop
tutorials and then uh
we'll uh we'll call tonight
all right
hacker rank Scala
Scala basic view all skills
Gonna Learn Scala guys
basic fuels what
okay
I'm gonna create an account
hang on I'm just gonna create a throw
away
all right
I'm here to prepare for job interviews
I'm a working professional
uh I've been a professional developer
for more than 10 years I have my
interview in a week
what about tomorrow okay guys oh
okay okay print hello world I'll make
this big no no we can't use closure guys
we gotta use Scala Scala okay def F
print Ln hello world
submit code
did I pass
I think I passed okay next challenge
let's go
uh print hello world end times
oh
okay
this will be the outline of your
function body okay
uh do I put this inside the object that
it's solution that extends app
uh def f
is an INT okay maybe we should read some
Scala code first Biz Buzz Scala
all right all right that looks doable
okay one until hundred map oh man
okay wait
okay guys I don't know if I'm allowed
I'm cheating right now I'm cheating on
my interview right now I'm using this
okay we're going to try it out okay
people are like George doesn't actually
know Scala No One's Gonna respect me at
Twitter
all right
so we need to do a for Loop
so we're gonna do four I'm gonna get the
tap there for I
equals zero
two n
okay we gotta print many hello worlds
right so we're gonna use hello world and
forget how I print things again in Scala
print Alan hello world
all right did I write good scholar
uh oh I did not write good scholar
inspected output and what did my thing
output
not all all wait
unlock this test case for five hakos
he
compiler message wrong answer oh is it
because
skull is one of those languages
all right guys I didn't use any hacko
it's great yeah guys okay give it a list
repeat each element in the list and
amount of times
okay
oh
where's my where's my template
wow we got viewers all right people are
liking the skull like
watching me not be good at school
okay
um this will be the outline of your
function body
oh
okay deaf f
uh okay
four
I oh no don't tell me don't tell me wait
wait can we can we install Scala on my
thing so I can like play around a little
bit can I get like a scholar prompt
Brew install Scout
root install Scala jvm base everything
gets built on the jvm man all right so
how do I use Scala
[Music]
maybe we should do some Scala tutorials
first
is Twitter really written in scholar or
am I being trolled
scholar school started as a lecturist to
prepare experienced Engineers to become
productive scholar programmers oh look
at this
the first few weeks will cover basic
syntax and Concepts bro I need something
tonight
oh good good good good good good
all right
great I'm glad that it depends on oh my
God we're installing x11.
uh uh okay
it's Carla you can give the result of
the expression and name hey we already
did two hacker ranks okay so we're
Elites hacker rank scallops
um
you can create functions with def well
that would have been nice to know before
I didn't fail at creating functions and
create Anonymous functions
that's cool
you can partially apply a function with
an underscore
I see add two on all right cool you can
carry the functions
[Music]
stand
fill in the first parameter and
partially apply the second but why can't
I what if I just don't do that what if I
just set it to that
it's the carrying I know I don't need
that extra thing there
partially apply the second what
Curry dad
wait what
it's installing python 311 is that the
new python
where's python 312
I'll probably twelfth now oh my God guys
we're installing the whole world here
guys
all right 2 000 viewers let's go
um
yeah Curry functions
uh
effective scholar oh well okay there's
no such thing as effective skull that's
good scholar line documentation or in
Scala
install Scala on your computer
the SBT bill is this done yet no it's
not done we have to pour the add weight
out icon theme
okay
let's come back to here now that we now
that we've learned Scala let's learn
let's apply what we've learned
uh okay how do we get the length of an
array
Basics continued lists Maps okay
numbers array
let's preserve order are these lists yes
the lists okay
good
um
Scala probably wants us to use a map
here
functional combinators
zip partition I'll flatten okay okay I
think we got this
all right
a flat map sick bro that's exactly what
we want okay
I'm gonna write this as a Scala
one-liner because we're neat programmers
ready oh if this works if this works
okay
ARR dot flat map okay let's figure out
what we have to do here the outline your
function body fill in the blank part
what's numb
s is the number of times you need to
repeat the elements okay so we're going
to do
arr.flat map
um
lists
okay so it's being called with this
someone just do nothing
so we need to like multiply
I really know how to do that
well okay hang on hang on hang on what
if I say
X is not a list
but I can create a list can I not
um man if I just wrote something good it
would have been mad skull skills but you
know I don't have those guys goes okay
flatten we we do a flat map
but we want like a like in Python it
would just be this
but it's not python
Scala list Scala uh insert multiple
nope
okay maybe we need a loop
it's a for Loop something that we can
like
there was some of those in those in
those examples I read
what are the examples
um
Scala Loop
Scala for Loop
okay uh
there's other ways to do this though
Scala range array is what I really want
on your creator array with range grade
um
oh there's something called range I mean
okay this is a bit of a hack
but I think we can do
range one dot and num map
X returns num okay let's see
run code
compilation error error not found value
range oh we need to import array
underscore
wrong answer
but it's almost the right answer we just
outputted oh no no we don't want num
there we want y implies X so let's go
let's go is this some scholarship
all right come on come on okay wrong
answer your output
um
expected output
okay that's the input
your app one one two two
um maybe we have to put zero there
I don't know if that's inclusive with
num or not
no it's not inclusive okay oh yeah yeah
buddy let's go
yo if that works
yo who's the king of Scala this guy this
is right that's right King of Scotland
man I'm ready to go beer I'm kidding you
know don't worry I'm not really that
arrogant guys I'm not
okay
um for hackers using Scala all right
well we're a hacker using skull this
will be the outline of your function
body okay
your only implementation of a filter
function we recommend not using the
inbuilt library function well let's see
what scholar School tells me
filter oh this looks good let's use
filter
okay uh we want to filter things that
are less than x
so let's just use I don't care what you
recommend we're just going to say ARR
dot filter
and then
you filter X
uh
uh filter it
if let's try to do this dim
filter we want to return true
so
uh why one two and zero
are the list elements
oh they're less than three they're
displaying the order they were in the
original list okay
um we want to know if x is less than to
win
does that work
yeah let's go let's go
all right these are getting too easy
guys we need to we need we need some
more Scala we need some more complicated
skull
let's go am I going am I ready to pass a
Twitter interview can I write Fizz Buzz
man I'm just gonna be the one of his
lists of pairs of functions
all right uh we we oh I think we're done
there's not even another one guys we
finished all okay great we've written
everything we need
um
oh these kind of look hard
oh we have skull in it
was it SBF
SBT close
SBT not found
how come I don't have SBT
one plus one
yo that took a long time guys
see how long that one plus one talk
oh Varney well Steve
Res three
cool
love Scala all right good I think I
think we're good on Scala that's
probably all the scholar we need to know
um
all right
yo we have so many people here I don't
know if we should uh we should leave the
live stream but it's it's uh
it's getting close to my bedtime let's
let's read through the timeline and uh
see what we got
let me drag this over here
this reminds me when I was trying to
reverse graph ql code with
um he nice tea dunk using common list
amazing things are happening but the
media will be silent bro who's the media
what when when you want to know about
the FDX store you can go to the New York
Times or you could go to autism Capital
who tells you everything about it
um
can you access the endpoint blah blah
blah blah graphical introspection here
we try that
uh full thread on learning Scala
oh well Scala school is the top one okay
cool
um
you should make a timeline way back
machine on orbit and then
yeah yeah
uh relevant context
best streams on the internet thank you
thank you thank you
um Brew install
[Laughter]
uh I get it I get the joke
uh
um reload vs code oh I see
format document yeah sorry I'm an idiot
um
resolution approved that I'm glad about
graphql client oh
that's an interesting idea
uh
finally someone to fix the lights thank
you
um
Doge
uh thank you for that guy prettier
uh we looked at that admiring on us work
some nfts
those are for persisted queries
oh I say how do you go live on Twitter
you got to be late
uh
uh thank you I'm glad you're entertained
yeah I'm just reading Twitter you guys
are probably reading Twitter too Elon
Musk come watch Miss while he's watching
uh
uh now you don't got better things to do
than watch me stream I hope
what's the code editor I'm using oh
great okay
okay nothing too great
I am interested in the quote tweet still
oh boy I will miss this place Twitter
stream on Twitter exposing Twitter code
guys I don't have any special
s all right we learned Scala that was
pretty good let's think a little bit
more about the back end I know we'll
wrap this up by 11. I'm sure you guys
all have jobs which you drive to in
person uh tomorrow
all right
so the Scala thing was a was a diversion
but you know I did get a lot of views
and that's what matters yeah you gotta
do it for the people
oh okay
so Hadoop and
our current distribution is Hardware
shown below
I like to the new approach okay it seems
like they moved everything
it seems like they moved everything to
Google Cloud
um
which is interesting
I mean yo Elon here is where the real
money is going to come right see I'm
going to work for 12 weeks and then I'm
gonna be like well I can lower the
Google Cloud bill by 25 million dollars
right
um nah look honestly and I'll say this
um
I'm gonna say the same thing to uh
uh at my interview
Elon lost how many billions on this it's
not what it's about right
um
I'm here to help the cause if I can you
know I'm not here to help the cause
forever but I think it's kind of like
you know some people go out and like
canvas for a political party uh that's
kind of how I see this
I kind of see this as me uh
you know look if I can be useful if I
can't be useful I don't know you know
maybe maybe uh you know I get the
Twitter and it turns out that it's all
just uh
you know the people really know what
they're doing and I'm honestly not that
useful I don't know Scala
uh
um
you know I don't know Scala I'm not that
familiar with all of these really big
distributed back-end systems
um I don't know react uh but you know I
can do what I can I figure things out
pretty fast
uh and you know again it's really it's
about the cause
um
it's about the cause for a place for
free speech exists on the internet
and uh you know what's something that's
really important to me
there's not much in the world that's
really very important to me you know a
lot of things it's a joke but I mean
this kind of isn't right I look and then
it's one of many things it's always
going to be uh like an ebb and flow
right it's always a cat and mouse game
there's always the people who want to
make you know want to restrict speech
and who want to make speech free and the
internet kind of goes back and forth but
I felt that the internet's really kind
of sucked for the last 10 years
um or at least it's gone downhill
now maybe not in the last 10 years maybe
it's really been like the last five
and I think this is something that could
potentially really reverse that tide
fucking health I'm down to uh if I'm
useless then I'm useless you know
but uh that's that's yeah
data transfer in Manhattan using Rock
Steady I think roxyb is something kind
of like level baby
persistent key Value Store
okay
it's okay
Manhattan is Twitter's internally
developed
key Value Store
it is the default storage solution at
Twitter for persisting real-time
Servicing
it's used to serve all or nouns at
it's like it's interesting right there
like like look just you can tell a lot
by like their terminology right like
they have nouns that's actually a really
cool way to think about it right like
nouns and verbs
um
data transfer between storage machines
is a typical process
when we started from our older
okay yeah they talk about they had these
custom
uh storage engines but I don't think
rocksdb is multi
computer I think it's just one computer
so it's interesting it almost seems like
Manhattan is backed by rocksdb now
um which is cool yeah they had they had
these custom storage engines so I would
imagine that Manhattan now has a roxdb
storage engine
I remember reading about these in one of
their engineering blog posts yeah
Manhattan had two read write storage
engines
this one a read one and a right one
most
mhb eks implemented as a my sequel
plugin
a plugable storage engine
yeah okay great
um
SS table storage engine
tunable amplification
cool
uh right amplification is also done it's
also done by uh by Flash
you know if you're a flash if your flash
is like really full you have a lot of
right amplification with it moving
things around you'll burn it flashes
fast
um
our our head of infrastructure.com is
always talking about he loves talking
about like the lifetime of these ssds
and stuff
um
we only ever had one group I can get
into that but
um
we Kickstart evaluation of roxdb as a
new storage engine this is also what LSM
based
oh log traction merge string okay I kind
of know this
um with confidence that it could match
box TV storage engine great
Manhattan is a multi-tenant system that
is a single cluster shared by
multiplication and data sets
ah
Okay cool so it seems like it's this big
distributed Twitter Manhattan's not open
source right
I wonder why not
[Music]
um
moving from a monolith to microservices
migrating to multiple data centers using
Cassandra this is another one of those
Apache things
[Music]
um
okay but it seems like most things so I
bet you most of these these queries that
we're doing are just hitting so there's
this thing Manhattan which sits in front
and then in the back end there's a roxyb
okay and roxyb is a lot like level DB if
I recall correctly I used it once
um
so this is like multi-machine and this
is single machine again a lot of these
uh
things can be sharded
so it's used to serve okay so all four
nouns
so when we're getting nouns like when I
run that out when I run my little script
here uh which gets the noun of me
right
here that gets the the George hotz noun
I would assume that it's hitting
Manhattan and then rocks DB right so
there's probably some cash in front of
it and maybe we can try to get some
insight into what that actually is
uh let's throw some V's
oh this is the big curl again I don't
want the big curl let's do the little
girl little girl
I'm throwing a demo
okay
um
so you're gonna figure out what server
this is
uh this is the response from the server
server tsaa
okay
so tsaa uh so like this is web front end
Manhattan multi-machine then this is
determining which machine that the
George Hots things actually located on
and then it's sending that
um there might be some caching layer in
here
all right so usually usually you throw a
caching layer after your web front end
so you don't have to hit the database if
I make the same request over and over
again
oh it might even tell you something
Twitter response tags
bouncer compliant
gsaa how do I disable HTTP 2 maybe I can
uh how do I ask for
oh
tell Carl to accept
okay there we go at least it's 1.1 now
um
wow I don't know there was http 3.
cash
that's some perf header
uh it's a Json wow that's crazy that
sends that
[Music]
um
okay and then like
let's go back here like is it all that
stuff when I like load this what's
actually loading the timeline and then
is it actually requesting for each tweet
I feel like not all the stuff showing up
here
right because like where's my
where's my JavaScript I don't understand
clearly not everything is here
oh is it does this show up as part of
tweet detail
it might
authorization denied by Access Control
oh I can click there and format oh
that's nice
yo by the way whoever showed me that
thank you I love that
um I don't understand okay why is
something's filtering here
because it says 26 out of uh
what's that
this hxhr
why is it not showing all the requests
this is this is where I like having the
live uh
Chrome Network
isn't showing
all requests because then everyone in
the logs is just streaming at me
filter is red which means there's
something in the filter search box that
doesn't match any of the
results you just can't see the search
box oh I have the word API in here oh
that's dumb
right there we go and here's okay here's
the JavaScript being loaded at the
beginning oh that's great
can't believe I just put the word API in
there okay so here's all that JavaScript
being loaded
um whatever these client events are I
think they're being blocked by my ad
block
uh we can turn it off but who cares
and it looked like the other stuff
guide dot Json
well that's the trending topics
sorry if I have to get close to the
screen you guys definitely can't see
these are JavaScript
fetch xhr
to buy rest ID guide.json
search for this
switch in here oh that's not right
um
sync message
like four what's this
what is that
two
okay this guide that Json seems like a
decent part of the API let's see if we
can find any documentation on it
um
all right well
ah yes
all right so it seems like this
authorization guest token thing has been
around for a long time
um I wonder what guide is
I don't tell you
even if I could speak Japanese I don't
think it goes into it
um
all right guys it's 11 o'clock it's my
bedtime uh if you don't watch I stream
on Twitch frequently but you know I
figured it was uh it was more
appropriate to uh to do this stream on
Twitter let's just make me big uh my
name is George Hots uh
uh I stream I tweet
nah man I don't know look
when you know we had no idea what we
were doing but an artist's first work
can be his greatest
uh Ode to the night rats Club I think I
should go listen to it
um
yeah thank you for watching uh hopefully
it'll be entered Twitter
and I'll see what I can do to uh help
the cause
uh you know I'm a old school internet
guy I want the internet to be as uh
free for uh you know my children as it
was for me right so anything we can do
to help that cause
that's what we're here for
all right thank you all for watching
have a good night
bye
gotta make eye contact
okay bros
let me see let me see if we are actually
uh online
uh
twitch.tv
slash
all right
oh the video is only available to
subscribers
oh wow that that'd be brutal i don't
actually want to do that hang on
i will uh i will change this
once i figure out how
you guys know i'm a noob
uh
audience everyone
uh
no
start a prediction manage poll
wait wait how do i how do i say it's not
just subscribers
i'm working on it i'm working on it boys
wait
shouldn't
be sub only
hang on hang on
what how do i
one sec
i don't know i don't know how any of
this stuff works
twitch disable sub only stream
subscriber streams
i don't know go to your broadcaster
dashboard
got everything so hard to use i don't
want to stream anymore this was supposed
to be fun and it's not fun because this
is too hard
um
go to your subscriber dashboard
select subscribers under your audience
yo where is this shit
slash sub only off
oh it's not sub only oh all right wait
then why why does this
this video is only available to
subscribers
am i just stupid or
oh oh
this isn't live
oh great now i gotta watch an ad for
toyota
oh
i'm not a subscriber i'm in
all right
cool
can you hear me well
is the sound quality good
i know these kind of things are
important to you
and we are here to deliver a satisfying
experience
all right great
you can hear me well and the sound
quality is fine all right so all right
hang on i'm going to turn that down a
little bit we got to do mixing we got to
do levels all right guys
i know i said i was never gonna stream
again but
look at this
i wrote this code
it's a hundred lines of code and it's
learning how to listen to speech
a second conspirator exchanged the good
for not the just us all promise well
like like we're so close
it's
listening and i wrote this from scratch
this morning
okay so let's talk a little bit about
what it is
so first we have this data set called lj
speech lj speech is an open source data
set and i just downloaded it
um so you'll see we have we have we have
wav files
uh
we're gonna have to go through we're
gonna have to i didn't write this code
very efficiently
but yeah so it's like wave files that
sound like this can you hear this
enabled the commission to conclude that
five shots may have been fired
the examination and testimony of the
experts enabled the commission to
conclude that five shots may have been
fired
the exit okay so i wrote like nothing
this is just pure pie torch
um there's this file in lj speech called
and i'll make this a little bigger for
you guys this is filed in lj speech
called metadata and it's just the name
of the wav file
followed by uh this
so i'm ssh into uh
what
that can't be the only what my screen
died
i don't understand
okay i don't understand what just
happened
well
by the way the project's called
self-talk
uh so i think it died
yeah it did okay i don't know it died
maybe you had a memory leak or something
um
it died
never mind you know what
i hate streaming and i hate all you like
why am i doing this
why am i streaming
real talk
uh
no i know but like explain to me what i
get out of this really go buy comma
threes
uh
no you can't get a refund no there's no
refunds what do you think this is the
bernie sanders campaign get out of here
no you're all terrible all right
you you missed me coding all this maybe
you already missed the good part of the
stream
okay so this is like learning to listen
um all right so i'll go through and
explain kind of how it works it's very
short
first we have the data set here
i don't know i don't really want to
explain this to you i was having fun
doing this myself i think
i don't think i was i was having fun i
don't think i want to explain it to you
we we can do a little bit on the stream
uh but then we'll go back to not doing
the stream all right
i don't know
stop being pessimistic pretend out here
make bigger you know when i when i work
myself
i'm just at peace and then you guys show
up and then we're not at peace anymore
all right we'll just we'll just hang out
for a bit
and
so one of the problems is that this
isn't cached um
i'll try it explicitly
[Music]
okay
so this is me printing out you know what
i'm just gonna make it do the sample
speech
so you guys can say domination testimony
of the experts enabled the commission to
conclude that five shots may have been
fired
the exhibit
um
let me just factor this out we'll say
load example
and then
x
uh
return mal spectrum all right so i'm
using mel spectrograms and i took the
mel spectrograms from a hifigan i use
the same ones they use okay
so maybe
i can show you yeah this is a male
spectrogram
and this represents speech
so here
i'll show you guys what i was doing in
the notebook yesterday
um this is that file so this wav file is
this examination and testimony of the
experts enabled the commission to
conclude that five shots may have been
fired okay cool so let's just go up
here let me insert a cell above
i'll make it a little bigger for you
guys
all right
can't open this oh because i moved it
i'm going to move it to
moved it to data
okay so this is
a wav file
this is the sample rate of the wav file
uh so it's it's 22 kilohertz um and
that's that that wave file that i showed
you there
all right so now i found this thing
called a mel spectrogram and i stole the
type of it from the hifigan
so the male spectrogram
you can think about it is it turns uh
michelle is not defined
uh this and then let me just put it on a
log scale here
and let me
size it a little bigger so you guys can
see
okay cool
so this is a spectrogram representation
of the waveform neural networks are very
good at processing images
so we can treat this like an image and
you can see how this image corresponds
to this waveform right
that five shots may have been fine the
examination and testimony of the experts
it enabled the commission to conclude
that five shots may have been fired
right
so you can see how this uh
this wave kind of kind of looks like
that right
so let's make a validation set that's
just this one and then let's watch this
thing learn how to uh
i should be committing this to get to so
let me just
give it this junk um
let me do git ignore
my cache
it should just be default and all
sort of works
i'm not pushing this anywhere yet it
will be called self-talk on my github
um
how much do you guys like to play at
home
with uh
should we call it tiny voice
oh i kind of like tiny voice
it's a lot to change the name though
the reason it's called self tiny voice
sounds nice oh you're so right all right
fine
tiny voice
and what we'll do is make a sim like so
still self-taught but we'll we'll push
it to github his tiny voice okay you
guys want tiny voice
tiny voice
why do i still cute tiny voice
okay
um tiny voice
i'll push it to github eventually i
don't know how much do you guys actually
like read the code
does anyone here read the code
you guys can read it here just just use
it use a
user yeah yeah just copy from here there
you go
it's already toxic is it already toxic
yeah you can reconstruct it from the vod
perfect this is the new twitch streams
and they're all closed sourced now this
is highly copyrighted shit we're gonna
we're gonna make a company we're gonna
sell it to google
that's right no we're gonna sell it to
meta so we can pump my meta stock that's
right i bought metastock after the uh
zuckerberg
uh interview
and it was a terrible mistake
it was a terrible mistake i made a
terrible mistake
um load examplex
put this stupid comment back up here
[Music]
just in case we want the male spectrum
to be on log scale i don't think it
really matters
so this processing it here's your net
this is being fed into a groove the
groove is munching across like this i
have a little bit of a preprocessor a
linear relu linear relu i'll have to
throw some batch norms in there this is
my forward it runs prepare it runs the
groove encoder which goes across like
this
decode
we've had all the sequences to be the
same length in this beautiful pad
sequence function that i copied from
some stack overflow thing and that's why
it looks like shit
this is getdataloader and the reason i
put in a function is so i could use it
nicely for my notebook over here
this is my train function i tried to use
pi torch lightning but importing it
didn't work due to some tensorflow crap
but i'm like i'm just not dealing with
this so i wrote it in raw pie torch
we're gonna get some coffee and then
we're gonna get back to coding
um
yo
you guys know the
the 10 minute all too well taylor swift
oh i just listened to that a lot i found
it really nice
i can't get rid of it because i remember
it all too well
yeah well no i do the log because it's
outputting um
powers and not dbs and it's a lot easier
to visualize dbs i'll show you what
happens if i don't do the log you can
see it
just looks like this so it looks like
crap
but if we want to actually show it as a
nice image we'll do it in log space all
right okay
okay um what did i promise i would do oh
yeah let me get load example here
and then
let me load example
data
uh okay we'll just call this val because
my whole vow set is this
down here we'll just run the model on
the vowel set
we'll call it m gas
sorry i'm writing this kind of badly i
apologize for the ugly code
and realize i was going to stream it for
you
okay
so now it's going to learn to recognize
and hopefully we're going to start to
see itself is not defined um oh god okay
fine
oh
that's actually useless
i'll just change this
so all the waves have the same sample
rate i pre-initialized the male
spectrogram here
oh well that doesn't even work this
can't even be here
call it melted transform and just
initialize it
i love python like i love that you can
just do that and i can see you gotta
like think
okay expect it all to be on the same
device that's
fine it's because i didn't send my
example to dot cuda
actually i don't think i put it through
any uh i gotta
get a torch tensor
probably say device equals cuda and that
would save two tenths of a second but
considering we don't care we won't do
that
okay so i think now it's just guessing
that there's a lot of spaces in the
thing
remember that if this works
why is it
why does it not understand the size of
this
okay it stopped outputting the spaces oh
we should be saving this model every
couple epochs too we'll have to write
that code but eventually you're going to
start see it
generate these words the examination and
testimony of the experts enable the
commission to conclude that five shots
may have been fired
it's actually probably taking a lot
all right we're using 43 percent of my
30 90.
should i map into phenome space and not
word space
i have a neural network shouldn't these
things be smart enough to just learn
i also hate this like
saving and loading models all right oh
oh it's starting to learn something okay
all right it got the letter t
hmm
[Music]
let's just throw a torch dot save here
uh model that state deck for path we
want to save it to
model slash let's say tiny voice
underscore
dot torch
dot pt
uh
epoch
my epochs are actually real i'm running
through the entire lj speech data set
um
let's only do this validation here
these look kind of cool
you can see it's starting to understand
how to listen so what we're trying to do
here
um
yeah i use uh i use vs code now should i
use f strings you're right you know what
i should be using f strings thank you
you know what thank you
sir who suggested f strings you are the
reason i stream because i do learn
little tips from you guys and remember i
don't stream for you i stream for me
because i hate all of you
not really i like some of you f string
guy you're a bro i like you but most you
hey
uh i do like that you know what i
learned yesterday
um i was complaining one of my
co-workers i'm like i always paste
things and it always has like weird font
formatting you can just do control shift
v
uh
okay so our loss is getting low but we
still haven't learned anything i i
either way let's throw some batch norms
in here
um
batch norm 2d a mini batch of two
implicit
all right well first off we want batch
norm 1d
through batch norm
okay
so
again we can we can think about what i'm
actually putting into this model and i'm
sorry i didn't do this all on stream but
this 80 here represents this dimension
here so we're putting in this image
basically with a groove that we roll
across
this is the groove
ah
that should be printing stuff every time
i don't know why it's not but the way i
like the idea we're not saving so let's
just let me exit this
um
also we have to do something else to
make sure it actually gets put in
my ctc losses actually running the cu
dnn which i think we can get a good bit
more speed if we do that
i remember we're training here on a 30
90.
ah
okay
so now it's only listening and it hears
rs
so you see all those r's that's like
what it hears i'm outputting each sample
here
i'm doing the argmax and putting it on
the cpu
um should we try we can also try a
larger batch size and see if that
affects things but we'll get to that in
a minute
let's first see if it actually hits my
uh
you know what i shouldn't really write
it like this
this is a bad way to write code
um i should put this at the top of this
loop
because the problem with putting it at
the you should actually always run your
validation at the beginning of the epoch
this is a trick i learned
because if you don't do that there's a
chance that your validation stuff breaks
and you have to like sit there for an
epoch while it runs and it's interesting
to validate just the model that's
initialized on nothing
so
let's see
okay good
it's only uh it's only half a megabyte
so that's nice and small
uh let me actually also uh do time dot
time
my end time dot time let's call it uh
times damn all right out time stamp
uh
i don't understand why it's called a
time stamp i don't know what about it is
stampy let's throw this in here oh wow
wait bros i love format strings that was
really nice
this is really nice more strings are so
nice uh we're using pi torch because did
you want to write ctc loss by hand by
the way there's a bug in their ctc loss
uh i think we can go a little bit faster
if we say i think it's non-blocking
equals true
can i not do that
i have to like specify a device
yeah it's like two
yes
that should make things a little bit
faster
um oh we should put our batch norm in
right now
because we're not gonna be able to load
them
see you know we're just gonna
um
[Music]
the fashion arm layer will now have one
or two four running estimates
this probably just works if i do this uh
do we put our batch number before or
after our activation function would be
four
i think i can just do that
um
i don't know where i put batch norms
with respect to the
let me throw that let me throw a
sequential here
[Music]
a little bit more on the decode because
why not
[Music]
good now we have some batch norms
you need some batch norms always why is
that why is that showing up like that
right though
guys you know what i did
why does that not work
typos
oh yeah
well we have to import time
don't forget to import time does that
take time
okay now we have batch norm so it should
train faster
running mean should contain 600
oh
yeah
is there a flag for this that can
no there's not
ncl yeah
do you see the problem the problem is my
sequence isn't shaped like that problem
is my sequence is actually shaped like
lcn or lnc
i'm sure this is common code and there's
like a good way to do this but a stupid
way to do it
it's like i want to use the uh what's
the thing that auto completes code
patch norm 1d not useful embedding not
useful grew not useful
oh please don't make me write permutes
it's going to be slow
the channels are at the end i really
don't know why you care
doesn't even use batch norm
also change it to the batch first but
that's still wrong
you guys see the problem
just add an extra dimension
yeah i mean i could do this
but i don't really want to
like look you got to do this crap
the lstm is a pack sequence that's right
no
i don't want to do that
whatever come with those off for now no
batch norms you get no batch norm you
want a batch norm but you don't get it
because you suck
would you use layer norm does that sound
good we need some norms
okay
it's learning how to listen
did i write this cache code correctly i
did
uh so you see like this is what it hears
and you're gonna see when i was doing
this this morning i started to see words
appear and i was so excited and that's
why i streamed for you guys
uh
these models only work on a single
sample rate
should we get tensorboard to work
what is the latest coolness that like
the kids are using to put their models
into do you guys know
weights and biases should we use weights
and biases
well this really doesn't work well
i have to sign up for this i hate when i
have to sign up for things
sign up oh great okay
i hate all this
welcome george hotz okay what's my
password
okay
oh let me let me go verify my email oh
i hate this
okay all right all right i confirmed my
account
no no no that doesn't work all right
we're gonna have to log in on here hang
on
oh wait no okay this is create your
account my full name is george hotz my
company or institution is twitch
stream
and my username is geohot
how often do i train models
every day bro
what am i interested in doing with
weights and biases
everything of course
oh i'm doing everything bro
create a team to collaborate
skip
okay great
oh
oh now i have a secret api key
all right
um how do i how can i hide this from you
okay i see how to hide it from you
oh look we're getting some words out
i'm just pip installing wan db and i'm
going to wan db login and then i'm going
to copy and paste my uh
api key
and i'll put something else in the
clipboard so you guys can't see it i'm
sorry if i'm talking loud into the
microphone
okay
great
beautiful oh it's so beautiful all right
now we're here
no no no but like it's learning how to
listen bros it's learning how to listen
you know
okay
import when db
randy be a net project is
uh what's the new name for it
sorry i forget tiny voice
my entity is geohot
and
all right all right what does wandy b
watch do
all right all right i don't know um
randy b log
randy b
watch
let's put my hyper parameters in here
no we're going to get in the habit of
writing long variable names
learning rate
epochs
batch size
okay so this is learning rate and this
is epochs
[Music]
all right look you can see that it's
starting to listen what's great is that
we've now saved these models we should
be able to load them
this one
torch dot load model dot is it torch dot
load
torch.load
it's supposed to be fun
turning 21.
wait do i do this instead of
no there's like a stupid way to do this
if like load the state deck
here we go
we say model dot load
state
dict torch dot load
i put those in the models directory
models by the way let's add that to git
ignore
[Music]
can i hook it up to my microphone once
it's trained yeah that's that's where i
hope we get to in this stream
uh
we'll have to transfer it to this
computer but that should be fine i will
have to commit it to github done
rename it subprime intellect
all right
uh let's see
currently logged in as geohot okay great
run randy
right let's oh you guys should be able
to view my project can i make it public
oh
wow that's a lot of lost logging
can db handle all this
how come validation still isn't printing
anything
uh did i do something wrong
did she do anything
i don't know
whatever let's let it train for a bit
it's slow though why is it slower
okay
when db log for the val loss oh that's a
good idea
i don't even have a valve loss actually
i was just printing the string in the
validation
now i got this one wav file
hmm all right all right look at that
graph goes down that's pretty good bros
what's in system
oh
gpu power usage gpu memory
oh that's pretty good who loves wan db
can wan dv log anything
i don't have all data stream i do have
to go to work you know some of us have
to eat lunch
um the numbers are going down
okay should we figure out how to get
batch norman
is bachelor going to actually make
things a lot better
i wish we went db'd from the beginning
because we're going to have to restart
the model but by the way can we talk
about how these almost look like words
now
uh we can just actually
just do the validation over here so this
is just a notebook i have
first off let's move that up there
uh by the way you guys i don't use vim
anymore i use a vs code so everyone who
like i use vs code with vim keybindings
but everyone who like you know circle
jerked about vim like well you know i'm
sorry but i use vs card now i've moved
into the future okay
some people are still
not understanding the new normal and the
new normal is vs code
uh from rack import rack
um we'll keep this
let's get the latest
i wish we could play taylor swift on
stream but we definitely can't because
taylor swift is super copyrighted and
taylor swift's very protective of his
music and it's a shame because
no uh but i don't know man maybe if i
was in the industry i'd hate them too
so i don't blame taylor swift you know
you can't you can't you can't blame
taylor swift okay
uh what else are we gonna load where's
this crap
come right import load example
get rid of the dot because we'll just
run this on cpu
i don't understand that
that equals that and let's take a look
at the image let's make sure item show
torch dot log 10.
okay
great so it's just it's the same image
it's just rotated if we want we can you
know some t's on that
uh and you get that image okay
now this is what we feed into our model
which we constructed up here
val
how's our training going
oh look our loss is getting low let's
check our wan db
uh oh do i only have the the beta vert
do i only have the trial version of when
db so i can't have tiny numbers
i don't get it
wait i don't get it
how come these numbers are lower than
the numbers i see here
i feel like i feel like we didn't buy
the wan db professional edition so we
don't get any more steps
remember he's just slow
it does have to go all the way to the
cloud
no i just think we're not getting any
more
oh look at these gradients wow
what is this
can i make this public
there you go enjoy guys
check out wendy b geohot tiny voice and
you can watch tiny voice training in
real time i know i think that's never
mind i think it's real i just don't
understand why those numbers are lower
than those numbers
logging it every time we're watching it
every time i think we called watch way
too many times
well this is uploading way too much
stuff let's throw that out there
waiting for wan db process to finish
this one
oh yeah see i knew i did some stuff
wrong
i think it's just because i it's not
because of the loss it's because i i
uploaded the great i put watch at every
single step
um
i'll put it before the train loop that's
always smart thank you thank you for
following my rule of putting it before
the train loop
okay
great
that's pretty good
let's look at the newer one here is it
what's it called does it have some new
name oh glorious music oh we love
glorious music okay look the losses are
tiny now
great
things are improving things are
improving boys things are improving look
at that it's updating in real time now
because we're not uploading the
gradients at every single time step
we're also training faster so this is a
win for everybody
you know when you just make things
faster the whole world gets better
um okay
so this is mgas let me print mgs for you
guys
actually we can do one better and we can
m show him guess
uh
i cannot call tensor and i'm playing on
attention that requires grab
let's detach numpy does that work
oh okay well it's the wrong size
oh maybe that's the problem
no i used that okay never mind
um
this should just work
multiply loss
loss is one one is a great loss okay
whenever i get losses around one i'm
happy
chance that right
yeah i don't understand it didn't work
oh
why is that zero
okay there's some bug
oh
what
yeah it's because you gotta do this
i forgot i did in the wrong order okay
we're good
oh yo yo boys look what we got here well
first let's fix this bug
but
we will wait
just just i want you to let's go back to
lj speech
the ex
the exam
and
testimony of the
experts
enable the commission right
is that pretty good
wait can we talk about how you used to
get like a phd for doing this shit and
now you can do it in a hundred lines of
python that's right that's right college
academic system
oh
it's wet in my bathroom
um
okay
all right we're gonna have to commit
this to github
um so i can uh
get it to run on my computer
do you think it'll work that much better
if we get some uh
check the
lightest play there will be fireworks i
love that song
uh
whoa look look the examination and
testimony of the
like almost hearing man
you can imagine like a kid hearing like
this you know this is how child learns
to hear
glorious music
oh great and like this is like useful
now
yeah she didn't like do all that stupid
stuff
how many viewers we got i can't tell oh
wow we got we got 1100 viewers what are
you guys doing today
okay
um
let's take a model and let's commit it
ah
good model
that's a stupid name
models underscore good what do you think
we'll just say
demo
um
yeah and then we'll see if we can hook
it up to the microphone
why does wan db have a
we directory want that
demo time
okay
let me go over here to github
new repo
repository name
tiny voice
giving
letting
uh we'll make the description letting
computers listen to you
and
really care
that sounds good
no github i'm not naming my shit maine
i'm sorry but
it's called master
i know that that language triggers
github but
you know ban me
um
now really what i want to write with
this
is uh
okay
let's go over here
um
[Music]
get clone
tiny voice
let's open this up in vs code by the way
i love the s code can can we talk about
how nobody uses vim anymore
um
it's just like one means before i don't
care just pick a default and stick with
that
let's see if this so this is running now
locally on my computer we don't have a
model named torture audio
tip install torch audio
okay
oh no
no
okay you know what
do we need torch audio
you know we do in order to do ffts
oh
why would they do this to me
i pip install upgrade torch
come on this is gonna work right
torch audio is weird
am i selling this hole to microsoft i
know i love github oh man
all right wan db uh
pip install lan db not like we need it
but it's in the thing and it imports
great
enjoy
uh no
file okay that's a better error because
i put it in demo
not in demo
oh did i copy the wrong one is that a
bigger number that's a bigger number all
right we're good
attempting to deserialize oh we have to
map location because i saved uh yeah
okay right
great
um did i not commit after i wrote the m
guess code
let's make sure we're getting the same
guess on my mac here
we're not
why not
how come this one gives me a different
thing than this one but the image looks
correct
that just doesn't make sense
oh
of course
same bug okay good
char sets not defined
should have committed better all right
the examination the commission to
conclude that grade
our loss is still going down let's let's
go to this fancy web interface to
confirm that number is still going down
oh glorious music this is we're doing
glorious music right
all right uh-oh
number might have stopped going down do
we need to use learning rate decay
i feel like we might need learning rate
decay
we're using the gpu over here but we're
not using it here
oh that number is pretty low now is that
number actually that low yeah that's a
pretty low number i wish it like didn't
repeat letters
uh okay
python
listen to soundcard
sound oh have i tried pi audio
all right let's give this a try
insert cell above
and if this works we're going to go to
work
import pi audio
is actually the way to do this with
torch audio
hmm
that is terrible
all right i'm sorry if the audio breaks
i didn't do it all right
format
in 16 that's a great format
uh rate
now we do this divided by two
um chunk one two four i don't know what
a chunk is
channels oh we don't need two two is a
lot of channels one channel is plenty of
channels
okay
um
oh i see it reads chunk
all right record seconds five sounds
good
stream stop stream what's p oh we're
gonna p terminate okay you gotta
terminate the p
okay
no model name pi audio okay well
pip
install
pi audio
no
no
it didn't work
port audio not found pi audio
brew install okay let's say
how to install pi audio on a mac oh we
just need to but he had installed poor
audio
we have to brew install port audio
okay now we pip install pi audio and we
cross our phone oh it worked i'm so
happy when it works okay
uh this is
where i'm ssh so we're not doing this
one by the way i want to point out the
model is still training in the
background so it's learning to be better
every day it becomes better
no module named pi audio oh cause i'm on
wow okay i'm still on this computer one
computer
actually
yes it can access the microphone but let
me make a new file i'll call it
listen.ipinv
five is a lot of seconds three is a good
number of seconds all right
hello python
hello python can you hear me am i
talking into the void
let's take a look at frames here all
right that kind of looks like data um
we can do i think it's mp.from buffer
and p dot in 16.
uh
bytes like object is required
not list oh
um
join frames all right okay great
now we need to normalize this
divided by that
um where's that mel spectral shit all
right here we go
call it wave
oh form installed torture audio all
right that worked
too much audio
sample rate why do i even point that as
a parameter
um
spectrogram and m show okay so this is
what this is the talking i did let's
take a look at the spectrogram
object is not
that shouldn't be right
did i do something wrong
oh oh wait did that no that turned into
floats into object is not callable but
why is it an int
it won't look like an it to me let's
plot it
okay great let's record again
hello twitch we are learning to
recognize speech
all right that looks about right hello
twitch
we are learning to recognize whatever
um
int object is not callable
why is this an inch it's not an int bro
brah bro i wouldn't do you like that bro
oh does it have to be a torch dancer
expected double but found float okay
okay okay that's doable um
as type torque dot follow 32
type
invalid shape for image data okay okay
that's an improvement
ah that's because we gotta just throw a
nun in here i think
all right cool
yeah bros i'm feeling it
okay
now we gotta shove this and then what
did i say again let's make this we can
play that right
um
python play
pi audio
read frame
self.stream.right okay whatever
wow this this library really is very
verbose
what i just do
insert code cell above
um
we need to open a stream we need to say
output equals true
uh
for f in frames
stream
dot write f
and then we can say stream dot close
i have to have better posture you know
hello twitch we are learning to wreck it
hello twitch we are learning to wreck it
all right all right let's let's let's
try it you really want batch storm bro
hello twitch we are learning to
recognize speech
great day
hello twitch we are learning to
recognize speech
great day
hello twitch we are learning to
recognize speech great day okay cool and
that's what it looks like hello twitch i
love driving my speech great day okay
cool
uh now let's go over here and let's get
the model out we need the model as model
okay
load
now um oh we need load example it's not
going to work um
what does load example actually do
it just does the mill so it's just the
male spectrum
so
okay that's what goes into the model
let's go over here to the model
um
let's change this to val equals mel
spectrum sub zero that t
that's a stupid thing i would say
airport arco pp rate e
okay
well
i don't think there are bugs
i think that uh
are there bugs i don't think so
i think we wrote it right
unless some reason we didn't get the
rate right
how do we know that
well we know that if we do the length of
the waveform
that's about right right because it's
like that times five
hello twitch we are learning to
recognize speech
great day
i think we need some batch norms
a poor arco ppraty okay let's try a
different recording let me let me try to
sound as much like hang on hang on hang
on i gotta mock the lj speech lady let's
go
the examination and testimony
hello i am speaking like the woman from
lj speech
recognize
hello i am speaking like the woman from
lj speech
why does that look the same
hello i am speaking like the woman from
lj speech
hello i am speaking like the whammy from
lj all right all right all right is this
progress
oh our losses are getting lower
that seems good do we need batch norm
though
we might just need batch norm
hello
i'm peculiar hemorrhoids tiporia
all right all right let's let's try a
simpler let's try something very simple
i slowly
walked to the store
i slowly
walked to the store
i had
eyes lowly whoa
um okay
well
you think batch norm's gonna fix that
maybe we might need some batch storm
we'll try a little bit with batch norm
if it doesn't work then uh
it doesn't work
oh
wait
the examination and the testimony of the
expert so that one works now
okay the problem is that it can only
recognize the lj speech lady
i'm not sure more layers i think batch
norm might actually fix it because the
problem is that we have covariate shift
and i don't really know what covariate
shift is but
let me just make a quick class called
good batch norm
uh we're gonna initialize a
bn
equals norm
let's 1d uh channels
i've been trying to not use just single
letter variables everywhere
forward
south
x turn the n sub x but no okay we're
gonna
all right so we have l and c and we have
to permute it to what's the right thing
to put in ncl so we'll say
dot permute
one two zero dot permute
one two zero
is that right
throwing good batch norms here
wait good batch norm is a terrible name
call it temporal
batch norm oh that's a much better name
wow we have a lot of viewers
i'm sorry i'm going to let you all down
no no we're back we did some streaming
today i guess there's really demand for
this shit um all right let's take a
minute since we have all these viewers
here for an ad
all right check out comma body.com
you can buy a calm body and put your
comment three on your account body look
at it
it is the future of people man like this
is a person and this is a common three
and this is a body and you can click buy
it and you can buy one
i'm like it'll ship in a bit yeah that's
great all right make sure you buy a
comment three two yay buy this one it's
expensive all right good yeah i added
the car wow that's a lot of money man
wow
um
all right look it winks at you look at
that oh yeah look look that's what's
inside the body looks like it's not just
a hoverboard on a stick man it's
hoverboard parts in her remanufactured
stick oh yeah great oh my god all right
cool thank you for watching my ad
let's see if it works with batch norm
oh when db takes forever to boot now
it's gonna like complain like my
bathroom's not even gonna be right see
there we go i knew it was wrong
oh
all right we're not going to win to be
in it yet
uh we can't load because it's a
different
kind of model now
oh also let me just look quickly into
how we can maybe make it a lot faster
um if we can get the ctc loss to be on
the
charge cpc loss
you must call wendy be a net before
calling watch okay well i wish it was
just fake wandy b that wouldn't make me
comment all that stuff out
[Music]
all right so my real dream with this and
i might stream again this weekend
uh
is
to
uh
make like cycle damn but like make
something that does
speech to text to text to speech and
it's like all in one
right
um i'll show you also what i've been
working on at comma
uh
i've been getting the
streamer to be super low latency so this
has been this has been my other project
here
um
i can now stream in about 100
milliseconds of latency from like all
the things on the device
uh so
yeah
um all right let's look up permute
oh i didn't finish this
in order to use cu dnn
targets must be concatenated format oh
we want to do concatenated format it
shouldn't matter
um instead of doing this
we say
dot join
x sub 1 for x in sorted batch
two labels which should work
um
expected stir instance list found
oh
no yeah because that's not right um
how do you do that in python like i want
to turn like i have like a bunch of
nested arrays
python
on nest arrays
no no no that's not what i want
i can do some oh that's right i can do
some oh that's cool
it should work
this might be a lot faster on the loss
list object has no attribute to oh
because we have to turn into a tensor
but actually there's a rule for which
tensor we can turn it into it has to be
an int 32 tensor
uh d-type into 32.
so this one i say i just sound like
torch
is documentation even right
first time chat from viewer do you take
adderall see we have like this shit
oh yeah oh it's not faster never mind i
just got excited and i thought it was
faster
i hope it's just correct even
i just wanted to tell if it's correct
would be to load the old models
then i have to get rid of the batch norm
do we think batch form is actually
really going to help
why is that sometimes 64.
oh because it's the others in size okay
that's fine
uh okay
we want them to be ncl
so
this is the batch size yeah i think this
is right
is ncl
ncl
and cl okay that's right but now my
better question i guess is
is that what's wrong
let's puts it back
just put it back to what it was wait no
no that's c sorry
yeah now this isn't right you can't undo
a permute by can i do how do i do
unpermute
okay
this
i'm going to write this out lnc and
after this it's an ncl then to go back
in lnc we need this
that should be right
i want to confirm that the shapes are
the same
yay you got it you got it bro
all right
x x equals self.bnxx
return xxx all right let's go
we have batch norm now
is it gonna be slower
seems pretty fast
not slower
oh look it's getting teased look at the
t's the t showed up
um okay let's think about what other
changes do we want to make to our model
it just might not hurt to make it bigger
i'll just say like h equals now it's 128
but
let's make it like 256.
double
please augment the input oh you're right
i do have to do data augmentation
oh that will fix this
um okay it's only slightly slower to do
that
i don't know if this bigger model is
actually going to help
um much
i might decrease the batch size
i think i want to increase batch size
maybe
yeah we'll have to write some
augmentation
i saw a blog post it did augmentation it
was just like
that's a lot slower now
but maybe it learns better should we try
this one for a bit
let's put randy b back in
i'm gonna just game this behind
okay
uh we can also probably use uh
do we want to import apex and use atom
with the folded gradients
it'll make things faster
a little bit anyway
maybe only 38 of my gpu
okay well let's you know what we can do
we can go to our wan db here and we can
see
oh okay good look at on a salad up there
can i zoom in like this
that was slow
and the back button didn't do what i
wanted it to
man if only we'd train the other models
oh my god look how much better it is
it's already saying letters i feel like
the other one did not learn this fast
oh look at that look at that look at
that the purple thing is coming in like
a comet bros
yo that's why you got to use batch norm
look at that look at the batch norm it's
just gonna smash through everything like
the patriarchy man just smash through it
you know
let's go let's go on a salad oh look at
look at that on a salad
yeah it's coming
okay we do need data augmentation too
um
i saw a post that talked about this
speech
recognition it's like an assembly ai
no they're just trying to sell me shit
well the good news is if we add
augmentation we don't need to retrain
the model
and we can we can just start from the
old
model i'm pretty happy with the model
now
good bit of batch norm we got a bunch of
non-linearities we got a groove
i don't know what non-linearities the
gru uses
oh well come on you're supposed to keep
going man you got to smash through the
other one oh god that looks good look at
purple
well it depends what kind of date
augmentation you want to do so i think
that we can look at these like images
and what i've seen is pretty effective
is if you just like like just crop out
parts of the image
batch norm
look at the power of batch norm
first i'll leave you guys here for a
minute to watch that purple line just go
down
how's purple doing is purple gonna pass
red soon
see that's the beauty of machine
learning when you do it right
it just works
looks like the lunar price chart yo
anyone who is stupid enough to invest in
a stable coin that is backed by a shit
governance token is an idiot deserve to
lose their money
so um yup that's right no bailouts in d5
there's bailouts in d5 i'm gonna be
upset
all right uh let's zoom out on this
no i don't want to view full screen why
would anybody want that
why is that
how do i zoom out no no that zoomed in
more
oh well actually that did it and i don't
really know why but
okay
um
i don't actually know if we might be
overfitting because we don't have a real
validation set
but that sounds like a pain to write do
we want to write that
i don't know it might just be
overfitting
that's a lot of work
well the good news is we can load these
models
so we can kill the thing
um
let's add a little bit of drop out
drop out
well
yeah oh
dropbox fine
ah
dropout all right fine fine fine i'll
write the thing
um
get metadata uh okay
val equals true
okay
uh how do we want to do this
next
actually that's
you know what i hate to apply some
filters now map
um that should be good
unfortunately we've shown it the
[Music]
unfortunately we've shown it the whole
valve set so we might want to train the
model from scratch again
just copy and paste
i'm sorry it's ugly boys i'm sorry
i'm sorry
i'm sorry
is that what we want
none of this is what i want
oh torch.mean losses
just write
balos
print bow loss
and we'll randy d log it
one item there
wow the loss is getting low
where's my windy bee
oh look at look look it on a salad
it's all meaningless without a
validation set though
that's right
you know just like you should always put
ci on your shed if you don't write a
validation set you know that's just
terrible
let's use a format string here
all right val loss colon
oh how do i format string
with like i should look that up iphone
format string flow format like i want to
do like there's like a way to do this
yeah it's like this
no no it's not like that it's like that
okay fine
um
where's my valve so it's going to colon
0.2 f
um turn the lan off for now that we
gated it that there is probably that
functionality built in if we knew how to
use it
oh great unicode
python 3 okay
okay
draft encoded into utf-8 or decode it
from utf-8 whoever thought that string
should be unicode
i'm upset with you
no no it shouldn't get that much
metadata
wait why why do they both do that
oh no because this is this get out of
data
um let me do an lru cache on that funk
tools
dot lru cache
non-import phone tools
don't do that twice
um
set as
lame self.meta
i'm gonna make it a f string oh i love f
strings i wanna use everyone now
strings should be saved as pngs rockpike
utf-9
you know what i don't know if that's a
joke or not
um mean argument must be tensor and not
list you know i was afraid of this
i don't really like do this
just got to be like a nice way to do
this right
torch.tenser
see this is why we put the validation in
the beginning
okay so we have a 700
thingy validation set that's pretty good
all right good good
okay good we have a low val loss but now
let's see if when we don't load the
model if we still have a low low valor
since we didn't train on them
we are making a change now to the thing
so if there's any changes we want to
make in our model we should do them now
but
there's
not it's not really a change to the
model format we'll turn lan back on
we'll remove the load we'll train from
scratch let's go
all right avid sun five let's go avid
sun
how's avid sun gonna do compared to on a
salad
all right we're starting with a very
high vowel loss
all right
it's off to avid sun's off to a pretty
good start here even with a little bit
of drop out
augmentation we can always add
wait where's my chart for val loss
oh valos
oh just when i was asking about it it
showed up
can i compare val loss to loss
no
that doesn't work
like there's got to be a proper way to
do this when db that loss
train loss vowel
this has to be like the most common
thing
commit equals false somewhere else i'm
ready to report this step oh
oh okay
we can we can write uh commit equals
false here i don't make it slightly
better
um
a few times per second you should
aggregate them yeah oh
i don't know
how much of my time am i just wasting
and when well not that much because
otherwise the batch thing would break it
oh okay it does not learn as fast now
that we have uh
now that we have batch norm does not
appear like it's overfitting that's good
i gotta go it's lunch time
okay well either way we have a pretty
decent model
here
let me just grab this
we can try running it
[Music]
okay
let's go to the other window here and
listen
let's try this one
no
i slowly walked to the store
i slowly walked to the store all right
all right it's something
i mean this might just take way longer
to train
you're training it for a hundred epochs
now we add a drop out
look at how look at how the curves
change from when i add a drop out to
when i didn't have dropout
i don't know if we're doing are we doing
too much dropout you think
i only did 0.1 dropouts that doesn't
seem like a lot of dropout
but it's recurrent dropout so it might
be a lot
we don't know if we were having a
problem with overfitting so maybe we
actually don't need to drop out
yeah but gurus love overfitting
okay well there's no problems with the
vowel loss we definitely have no
um
overfitting problems all right
all right chat i'll talk to you for a
minute what do you guys want to talk
about give it more gpu yo should i put
it on my a100
train till overfit maybe then try the
other one until overfitting
uh
you think the mic being different makes
it
we have an a100 somewhere we just bought
one
we love a100
because of course if you want to put in
a data center you got to use a100 but
this is just in my workstation
which i can use a
non-a100 non-a104 all right i'm actually
like this isn't that good i don't know
uh
should we should we get rid of the
dropout dropouts too much
who trusts dropout anyway
uh the good news is we can just load
from
the most recent
okay this is clean with the valve set
and stuff so
we're good
oh look at that it made an ascii graph
of my loss
there's some way for me to tell randy b
that i'm continuing and it doesn't make
fallen grass
but i guess fallen grass is okay we can
turn off on a salad and have it sun and
stuff oh look it closes the eye that's
really cute
all right we turned dropout off dropout
sucks
oh yeah actually we can't no we're not
oh
if i want to use dropout i have to set
whether it's training or not and i
didn't do that
um we also changed it to not
sink
until we pushed the valve loss so
all right there's fallen grass up there
oh no does it only have one data point
now
oh no that'd be sad if that's true
oh what it only has one data point well
that sucks
it's not enough
data i regret writing commit equals
false
there should be a way for me to resume
is there any way i can say
resume fallen grass sex
resume
set the resuming behavior
all right so we can say when db run id
equals on graph 6.
i'm just learning how to use randy b
boyce
maybe using a tension will improve the
quality of the model
should we use a tension
do we need attention
[Music]
did it really resume fallen grass i
don't think it did
oh we have this fallen grass sex
which is a different fall in grass sex i
see
great i mean no no that looks like a
pretty good comparison graph i'm pretty
happy with that
i don't care what it means we're not
doing science here we're doing party
and we will call this commit party even
though it doesn't have anything to do
with the party we just called it party
and remember that it's not a party
uh if it happens every night
call it fallen grass six new i like the
way you're thinking bro
i like the way you're thinking
um all right
let's let it train
for
[Music]
six more minutes
on a salad got a pretty low loss
let's see if we can actually see if make
it over fit
i can't imagine why it wouldn't overfit
i don't have that many examples
but maybe the ctc loss is pretty uh
robust to it
oh we also have to remember that we
change the batch size between these
models so maybe that's one of the things
that made it better
see what's in here
oh check it out fallen grass 6 uses more
gpu power that's good
um
gpu time spent accessing memory
it's wild
gpu temp oh it's probably being loud
right now
network traffic glorious music did a lot
of that
i don't know why oh i think that was the
one i messed up my logging and had it
logging everything forever
look at that val loss go down
okay
uh
oh i didn't do torch no grad yeah that
would make my valve slightly faster it
doesn't matter though because i mean i
zero the grad out here so
it shouldn't make a difference uh from a
like accuracy perspective you're right
but i should do that for my val
um looks like it's i o bound i don't
think it's i o bound
um probably like you gotta get like the
grooves and stuff to go on the thingy
and i probably didn't do that
i did have ones that like got pretty
good on that validation sentence
uh
oh we didn't actually make sure the
validation sentence is not in the data
set also but it doesn't matter we have a
proper validation set now because we're
doing real science
yeah it's a 13 000 example data set i
filtered out some of the really long
examples
oh you can read the code
okay so here's my end dream of this once
i make this thing actually recognize
speech pretty well
um i want to then
build
so you have a speech recognizer and then
i can have a speech synthesizer and if i
build an end to end thing that does both
um
especially if i'm passing in so one of
the biggest problems in building speech
recognizers is the alignment problem
uh
it's a problem in texas it's a problem
it's probably both speech recognizers
and text-to-speech right because if you
have a data set that contains speech and
you have data set that contains text
right like it's a let's say it's like a
supervised set here's your speech here's
your text you don't know where in your
speech corresponds to which text
and we can kind of see this here in the
notebook right
um let's go over to that notebook where
i talked right
uh
so this is
the male spectrogram what did i say i
slowly
walked to the store
so i slowly
walked to the store right you can see it
there but you don't know where in that
wave form like we can annotate it and
say this is i
and this is slowly and this is walked
and this is to the store
right like we we could annotate that but
we don't have that by default
um
so
uh but if we train jointly something
that both recognizes and synthesizes
speech we can deal with this by putting
in the
probability outputs
from the
uh we're going to need the probability i
think we can we can max it but we can
put in where the empty symbols are you
see these zeros
what these zeros represent
okay
sorry i'm not explaining this well i'm
using this loss function
but this loss function deals with this
alignment issue but the alignment issue
is easier to deal with when you're
recognizing speech than when you're
synthesizing speech
uh and then this thing it's it just
incentivizes it to output zeros
uh if there is nothing but i can put
these zeros into the talking model
uh and that'll help we can also
use a phonetic
instead of using the letters we could
use a phonetic pronunciation
um
i think it should be okay
you could also change your group to be a
bi-directional group but i don't exactly
understand how a bi-directional group
works so i didn't use one
where's on a salad
how come we are losing so much to on a
salad
why was on a salad better what else did
we change
nothing i took the dropout out
whatever
this one looks okay fallen grass looks
okay
tortoise text-to-speech this one's open
source
sorry
once you have the first token you want
to predict the second token given the
input and the first
there's a way to measure the acute
emotional intelligence seriously
emotional intelligence
there's a way to measure the acute
emotional intelligence which has never
gone out of style
oh these are so good yeah i know but
this is what i found too
basically everybody who writes a decent
text-to-speech thing decides that
they're going to put a cloud interface
in front of it and start a shitty
startup which sucks i mean it's like i'm
going to do it better because that
stuff's a lot of work and like i said
we're not here to do science we're
definitely not here to do engineering we
are here to do party and party does not
involve you know making things nice and
runnable for people
um
yeah that's really good
but i think it'd be cool to like train
one that's that's like
end to end
uh from speech back into speech
going through this intermediate are we
starting to overfit oh we might be
starting to over fit boys
okay we're not over fitting yet we're
not getting
worse on the valve loss yet
sounds like a bit of work to balance the
two losses
i don't know about that
i mean my point is that i would force
the encoder and the decoder to go
through this intermediate bottleneck
maybe i could include some like
embedding about what what speaker it is
and we can get other data sets that are
trained on uh multi-speaker data sets
what was this trained on
[Laughter]
how's this thing work
see what they're doing
what are we running in the terminal this
is my trainer running
you can see that it's learning how to
kind of recognize some speech
how's it doing compared to honest salad
why is on a salad better
does anyone uh oh
oh oh look at
that look at that
is that overfitting
did i just see an overfitting
i think i just saw an overfitting
i'll give it a little bit longer and see
if the overfitting continues
it can't be too overfit because it
hasn't memorized the uh the input data
yet
okay no it's not an overfitting
nevermind it was just random noise
what's overfitting overfitting is when
you start to just memorize the training
set
instead of actually uh
uh
like learning the problem
so the way that you control for
overfitting on a problem like this is
you just separate your data set into
training and validation and then you
run the neural network you run the same
loss function on this part of the data
set that is not used for training and
you make sure that that loss function
stays low also what is the reason
overfitting exists that's uh
that's a pretty deep
you think about it like
it's because there's not enough training
data
right imagine you were taking a test
and you knew that there were only going
to be 10 questions on the test and you
could like learn how to do them or you
could just memorize the answers
all right if it's like a physics test
it's not like you'd know any physics but
you can know all the answers there's
only 10 questions on the test
right but you see if the 10 questions i
give you in practice are different from
the 10 questions on the test and the
only way to do is to learn physics
and an overfit model would then fail at
the validation it might do great on the
training set which is the practice test
right imagine a practice test and a
practice test you just memorize all the
answers
uh yeah humans can overfit too of course
humans sometimes have awareness of the
fact that they're overfitting but
sometimes they don't
all right i mean
how many epochs are we into this model
35.
worse
worse
did worse
on a salad was the best model
fallen grass
is on par with glorious music very low
quality
i don't know why it's worse
i didn't turn the batch norm off did i
no it's still on
metronome 1d
[Music]
decode
looks pretty good
do a relu after the groove maybe i
shouldn't have done that does the crew
have an activation function on the
output
um
[Music]
it does
the sigmoid function
ew
i'm going to change that
probably shouldn't have put this value
here
i doubt that matters too much
it's a fancy optimizer
it'll learn to fix whatever stupid
mistakes i make like that
unless i've really destroyed the
information
i don't know i mean the valos is still
going down
what are we building speech recognition
all right guys i gotta go to work
hey food
any last questions
we'll see if we stream again
neural networks are quite dangerous for
applications that actually matter to
people's health and safety bro
you are a neural network
uh oh
the loss just went way up
we took a bad step
let's wait for that to load
one of the problems with streaming uh
neural network stuff
is
we all just have to sit here while it
trains
i like i can
throw more gpus at it but
i don't know all right let me just try
one more thing
no that's not gonna work
all right let me cut the batch size down
and load that
uh
cut the learning rate down
apex
atom
let me switch the optimizer to that
import apex
it should make things a lot faster
let me turn the lan off just for testing
it's like not that much faster
why is it slow
is this slow
we're going back to the cpu here
um
look at that let's see now it's fast
because i reduced the batch size a ton
it's still slow
i'm getting
20 amp box
per um
sorry maybe if i have num workers to a
now but it can't be all the data set
because then the batch size would have
uh
would have would have broken it
oh
that was fast
oh this is still slow
maybe we want to make our batch size
bigger
no but okay that got slower
i don't know there probably isn't a
magic trick to make it fast
why did it do validation twice
oh that was the first one the second one
all right
well that's actually a good bit lower
the examination led the experts to
conclude
i'm not spamming all that crap anymore
okay val lost 70.
well we did lower the learning rate
69.
all right
um is this the good model
[Music]
see if it works on me at all
nope
ah
there probably isn't some magic trick to
make this fast
we can read again to make sure i didn't
do anything really stupid
target lengths must be less than 256.
they all are
t blank is zero
i do have that
zero infinity crap
let's just get rid of that i don't think
we need
um maybe we'll only do validation
if apoc mod 2 equals zero
maybe we'll
up the epochs to 300 that's a good
number of that box
we create the data loader every time do
we have to do that
uh no we just have to recreate the
iterator
which i think is actually all we do
never mind
yeah we create the data loaders up there
commented that out
um oh we stopped setting the just the
loss in the description okay that
actually didn't do anything so put that
back in
it's too slow
boys i like things fast
um
oh i think can i do something with
pinned memory and maybe make it faster i
can tell the data loaders to pin memory
homeworkers is eight it might even be
too many markers
um prefetch factor
it's probably pretty good
what does pin memory do i don't know you
can just set it and make things faster
it like it locks the pages on the cpu
so you're not cache thrashing
not faster
it's just like looking h top let's see
all right i mean this is using
the examination testimony of the experts
concluded didn't you feel like that used
to look better
by the way is that one in the valve set
or the uh
or the train set
what
did it freeze
this is terrible
i think anyone who mentions the word iq
from chat should just be banned
because you add no value
can your validation loss be lower than
your training loss sometimes
um
okay well i don't know what happened
there
maybe eight's too many workers
let's try two workers i don't know i
don't like trust this stuff
um
cash looks pretty correct
nobody's being forked
there's not going to be some magic thing
that makes this thing fast
that actually made it really slow though
so
that's definitely not what we want
no markers two
if
val else eight
should we just pre-cache everything
[Music]
[Music]
all right it'll be in one pinned memory
throw some tpdm around that
um
but
never should happen here
oh i didn't call any data
okay
so we can prepare this cache
uh
should we do it on more processes it'll
make it faster
whatever it's pretty fast
this probably isn't even the problem
though
maybe we'll say maybe really fast
come on fast fast fast fast
not fast
useless
useless completely and utterly useless
that isn't that size 64 though
okay this is going to be the final run
i'll make it public so you guys can
follow it
it's like the collation function that's
slow
oh different salad
all right it's a public project
we already have some loss
okay
all right it feels like we've overfit a
bit
no no that's a pretty low value alright
great
okay
enjoy
we can we can play with this maybe we'll
play with this more this weekend
um i'm gonna see how many subscribers i
got if i got a lot of subscribers
and i see you people really like this
content
uh we can come back to this this weekend
i have an idea that the reason it's slow
is because the data loader's slow
um we can also enable cuda cache huda
cache makes things very fast
uh so we'll figure out how to figure out
how to make this all very very fast
and then it's a lot more fun
everything's more fun when shit's fast
you know
at 65 that's a pretty good val loss i
think i don't know let's look it's still
going down
this is a pretty good model i think it
got to be pretty good
give it one last try
to run it on my my
my example
um and then i gotta go because really i
can't listen to taylor swift and i gotta
listen to swift alright
the chicken has left the coop
the chicken has left the coop
yeah we gotta do like pitch augmentation
and all that kind of shit we want this
to work with different voices not that
we still we got wednesday
i don't know
all right all right let's try something
stupid
the
the
[Music]
[Music]
all right well
it put the spaces in the right place
kind of
but you can see look the examination and
testimony of the experts like that's
that's pretty close
um okay so here's what we're gonna do
this weekend if we get 100 subs
um no promises maybe we'll get 100 subs
and i'll be like ah you know i'm going
to my land this weekend but maybe we'll
stream for you guys maybe all right look
here's what we're going to do
first off we're going to figure out how
to get a crap-ton more data and you know
what our data needs do you know what you
know what always improves data you guys
know it
diversity the data needs more diversity
and if we get diversity for our data
uh
i don't know but there's a lot of
benefits to diversity that's what i've
heard so we should get that
um
then we're gonna figure out how to make
it train faster because you know crack
is more addictive than cocaine because
the onset is faster i know you guys love
when i talk about drugs boys i'm on
drugs boys
you know is that is that what you want
is that is that what you want to see
should i wear a clown nose on the next
stream
that's right that's right
um
i don't know what i was saying about
that it's just wouldn't it be a lot more
fun if this just trained in like 10
minutes instead of having to sit here
while the loss goes down a tiny bit but
you guys can watch live on my weights
and biases look at that it's still going
down
that's pretty nice look at those you
guys can steal the model out of here
um
the examination and testimony of the
ex-birds
like you see where it's coming from
right like that's pretty good by the way
just just so you guys know the one
the one sentence here
that we're listening that we're trying
to get
okay
the examination and testimony of the
experts enabled the commission to
conclude that five shots may have been
fired
like that's pretty close right the
examination and testimony
oh i did still compute the valos at
every step never mind did i just not
write that right
i only put that in there i just want to
put that whole thing in there never mind
but whatever we get a vowel loss at
every step done
because it's not like i'm doing this
every like i'm wasting 20 of my model
train time whatever will we get the new
one we're going to train it with so much
data it's going to train so fast
um wow we got a hype train going we
can't end the stream on a hype train
uh what else we got chat
what else we got
we got chat can can i come here
pop out that's right we pop out at your
party
i'm with the game and it's gonna be
robbery so
thank you for subscribing thank you
thank you
jokes tara e dalton sc2 floya thank you
for subscribing
thank you for subscribing look at the
numbers go down
um
with different salad eight
break star thank you for subscribing
uh
yeah we'll try to stream this weekend
again
and we'll finish this and it's gonna be
really cool when it starts to talk don't
you think like i just got so excited um
i saw this i saw this uh
whoa dust insomnia thank you ken slayer
break star thank you um i just saw this
i saw this
natural speech
um
this one
is it this one
this one just came out yeah yeah
i saw this and i've been turn testing
people around the office
like asking if they can hear the
difference
uh between the machine
and the com and me and the human and
like you can't anymore
and i just thought that was really cool
you know i just thought that we we live
in a pretty uh incredible world
uh
i'll i'll play some for you guys like
listen to this maltby and company would
issue warrants on them deliverable to
the importer and the goods were then
passed to be stored in neighboring
warehouses maltby and company would
issue warrants on them deliverable to
the importer and the goods were then
passed to be stored in neighboring
warehouses you can't even you can't even
tell anymore
uh which one's the
the computer and which one's the knock
computer
and just like what a world we live in
man
you know because the truth is oh the
first one is better yeah and the first
one's the machine right
most people actually said the machine
was more human than the human
uh no we're not close to the turing test
yet because there's still some big stuff
missing but everything it looks like and
the dolly pictures are so
cool um
you know
just just like what a world we live in
uh
put it on gpu directly you create the
tensors to speed it up yeah but i'm
doing that in the data loader
this is something i've always wanted to
look into anyway i'm interested in this
for work
uh
yo we got some
comma is close to the alphago moment
uh i posted a picture of our new data
center
sorry compute cluster
uh we got we got
lots of power in these machines
uh
the whole thing is being trained in
simulation now so
not exactly the model that we're
shipping yet but pretty soon for open
pilot 009 we're going to ship a model
that's actually trained in simulation uh
so it'll have driven
uh oh those aren't cherry picked
examples
that's not a cherry pick example i think
that's pretty legitimate
um
all right our model's overfitting a
little we're not really not really
overfitting but
just
when we get
air race car drivers why do you want
that
who's lisa dole is that that's a go
player
i don't know man
when do you get it i don't know when
you're gonna get it those are stupid
questions
i have realized that maybe if i read
chat less i'll hate streaming less
uh thank you guy who forced me to use
function strings we should use more
function strings everybody can see this
right you can you can all see different
salad right you can you can you can
follow at home
great
say testimony and validation of the
experts
[Music]
you can't see resource details oh
interesting
well you're not missing much
the examination
history of the experts
oh
this is also like
you're supposed to do like beam search i
think
i think you're not just supposed to do
arc max like that
uh we can look into that too
but first we're going to make the data
loader fast i'm going to make everything
fast and we're going to write some some
tests and some ci because test and ci
are always good
okay
wow level five hype train keep going
until the clock runs out does wan db
want to sponsor my stream
um how about this wendy b you take
whatever money you were going to give to
me and you make the back end of wendy be
open source and we would use it at work
uh i would appreciate that more
and i know you're like oh yeah look i'll
pay the money i just
like if the back end's not open source
i'm not getting locked into your thing
when when db goes under or gets bought
by mbas right like that's the problem i
just can't trust your company unless
it's open source
uh and that's why you can trust open
pilot because it's open source
um now i don't need to insult when tv
like this is cool but fuck your business
model man like you know don't don't keep
the back end closed source
uh because i don't trust it so i'm
saying i appreciate your front end's
open source but like i can't use it
because i want to add something to your
back-end and i can't it's close source
um you should be able to look at look at
all the other oh yeah no well
yes i know there's randy be local but
what is this generate a free license
from the deployer like is this open
source i don't actually think it is i
think this is like uh
like i gotta like run some docker right
like i looked for where the actual code
was and i didn't find it
yeah see it's like this yeah
it's something
but uh
yeah
all right guys i i gotta go i you know i
gotta i gotta go i said i was gonna stop
streaming like seven times and i haven't
stopped streaming yet
uh so now it's time
goodbye
we back for a double stream today that's
right
i didn't even do any work today all i
did was speech
all i did was this speech shit no that's
not true i got encoder demerged i tested
encoder d so if i broke your open pot
i'm sorry
but i tried not to
uh yo let's wait for some people to get
in here and then let's test the latest
model because i did keep training models
uh i got a box that's got a bunch of 30
80s in it
ah we can go in the boxes with the 30
90s in it too
you want to use an a100 we got an a100
you can use the a100
oh
oh the dishwasher's drying
was the was uh was the uh
the water out
oh
wait
is anyone here
i don't see anyone in
in
the chat room
wait is it not live or is it live or i
don't know
i should be live
oh we still sub only or something
uh
no
all right we should be live i don't know
why we're
not refresh this
connecting chat oh you're all here i
don't know
does anyone else feel like everything's
falling apart
okay
so
last time we were here we were on
different salad eight we've trained a
lot more models since then you guys can
follow me right here on wan db tiny
voice i'm taking off my apple watch
oh yeah all right check out unique c22
i added cyclic learning rate one cycle
lr think of climbing a mountain and then
sliding back down you climb the mountain
you slide back down one cycle lr is the
best learning rate
um but
you'll see
that our model over fit a little bit
so um
let me just zoom in here on the y-axis
yeah you'll see that our model over fit
a little like these are the good epochs
so let's grab a model around like epoch
55.
oh we have to grab them off the real
remote computer too
okay
fun
the project's called tiny voice on
github
okay so we're gonna have to grab the
model off of this one
models
sort it by time with t
okay we'll grab like epoch 60 or
something
scp
from
this
fun
tiny voice
is it not batman
oh no we gotta do models
okay
now let's go over here so i also found a
bug from last time
okay my computer is named tubby we
brought it over to tubby let me start my
other window here i do
okay
so what i forgot to do last time
oh
we gotta do model dot eval
okay
uh no we gotta pull
so i probably just should have pushed it
probably pretty good
okay
now have we constructed the model no we
haven't restart
okay
testing hello welcome to the stream
testing hello welcome to the stream
okay
so we plotted that waveform now let's
load the model
uh oh that's not gonna work um
made a couple changes here
um load data
see if that works
oh did i not do auto reload i did i
don't know why it doesn't work no we
don't want to have to restart that
because my beautiful
i understand
i put that in a function now that
shouldn't do that
why is auto reload not working
probably because we never actually
imported it okay we'll have to record
again
start
hello and welcome to the stream
now for those of you that weren't here
this morning
we're writing speech recognition we are
pushing to tiny voice
and
we're gonna
see what
oh i'm just sorry i'm ssh my bad
um that's why it didn't work
ah this is not
my local computer
so now when we run it it'll work okay
great
that's the best i've seen so far
that's almost something
the examination of the testimony of the
experts
uh oh also i wrote the decoder wrong
so apparently
when you write these things
you
this is not the right decoder
because it's allowed to have duplicates
uh two texts not defined
from pre-processed import to text
and guys if this doesn't work we got
some great
uh
stuff
ready for you guys if you guys missed
this morning's stream i'll play this
audio for you that we are successfully
uh the examination and testimony of the
experts enabled the commission to
conclude that five shots may have been
fired
this is going to be a long stream i
think we're going to be streaming
tomorrow too by the end of this maybe
we're actually going to get it to
recognize
speech
okay so let's rewrite two texts let's
write it properly
so this is a classic
we want to
join all neighboring duplicates
so we could think or we can google join
neighboring duplicates python
and someone probably wrote here remove
adjacent duplicate elements from a list
oh that's terrible
ah
iter tools group by perfect
new there with some magic python
import editor tools editor tools group
by
x um
[Music]
okay
what why is this junk
well we need k for kg and not not that
we've got to copy the whole example
we could try to figure out what that
does but you know that involves a lot of
thinking
okay
um
oh well they shouldn't be tensors
say x dot numpy
yeah we shouldn't really do that we
should actually probably put that out
here
okay
cool uh the examination of the testimony
of experts
include five shots may have been fired
that's a lot closer to the real thing
right
that's pretty pro
okay
now let's go back to my example
let's try recording again
oh yeah i gotta forgot i gotta sound
like the lj speech lady i found out that
lj is linda johnson and it's named that
because
the examination and testimony of the ex
all right let's try
the examination and testimony of the
experts enabled me to conclude that i
should kidnap a dog
the examination and testimony of the
experts enabled me to conclude
no it still doesn't work
it's actually getting good right it's
not good yet at generic stuff i still
can't recognize my speech okay so
we have two approaches that we're gonna
take
one approach is improving the model
and the other approach is improving the
data set
oh the yeah yeah yeah sorry yeah the
output's crap don't worry you're not
missing anything
it doesn't work yet
and it's because my voice doesn't sound
like linda johnson's
ah also i don't need to put torch to
answer that let me try a load example
okay
great
um i kind of feel like the data set one
is going to be more productive and we
can kick that one off sooner before we
mess with models
so i downloaded this data set
in preparation for you guys
it's called libre speech
libri means free and speech means speech
i think these are different uh
listeners
we have flax and i don't know how to
load a flak in python
i also refactored it off stream
um
so let's make a new file here called
pre-process
dot pi
so pre-process over here
can i get a terminal down here
terminal
great
oh no that's on tubby
i'm on the wrong computer okay guys
don't let me do this this is the problem
with working on two computers
all right here i'm on
this
now we're going to do pre-process
library dot pi
so pre-process up there
that over there
do this here
all right we have the data set path
leave free speech
okay
um os.lister
os.path.join
data set
train clean 100.
um
split terminal oh look we got another
terminal over here okay this is fun
uh
tiny voice
h mod plus x pre-processed clean breathe
three process library oh another change
that i made off stream was i just loaded
the entire data set into the memory of
the gpu
ok
great
so these are more directories
these are even more directories there's
a better way to do this i think
and we'll just do it like this
no such dir
oh because we have to merge
oh this is terrible guys
okay now we're at the flax
um
fn equals
os path join
ah
are you guys making useful comments or
useless comments i see a lot of useless
comments from you guys
from if fn dot
ends with
flack
i'm gonna have to figure out how to open
a flag
just torch audio open flax
black
i could use glob modules should we ban
useless comments
yeah i think maybe we should
no one person's joys is not another
person's signal that's bullshit and the
contrary to what they told you and you
know care about your feelings school
they're dumb questions they're dumb
people
okay torch audio load let's try it
um
[Music]
print rat exit zero
let's try pre-process libre torch audio
is undefined we gotta import
great
so that actually works the same
um we can just take load example and put
it up here
we can even use sample rate
sample rate is sixteen hundred
we should keep that assertion
um we gotta return the mouse backgram
and then let's print red dot shape
tuple object has no attribute shape oh
because we did this not load example
okay
850 so that's actually within the x max
i think we're going to have to raise x
max for this data set
okay not too much though
so xmax is because we have to pad them
all to the same
length
oh
and this might actually be different i'm
not sure these are going to be
compatible
it does sound like a later problem
though
okay
let's uh
let's get x max
i'm sure we could actually if we wanted
to do this faster we could uh like i'm
sure this like torch audio can actually
load this data set
we're improving the data set right now
so we're accessing the libre speech data
set one of the nice things about the
libre speech data set is it includes
many uh
can i play a file in here
i'll like add like a
gonna play this
open anyway
oh okay never mind
uh
okay so those are all good
load example just works um
we'll copy this code from here
oh we have to figure out how to get the
metadata
so i think the metadatas are in these
oh shit the metadatas are in these
directories
let's go over here and look
okay
so we gotta just get that get the
trams.txt
um
okay and that's actually pretty clear
what that's called
so we can just say this dash this
dot trans.txt
oh actually now that's sorry i gotta use
format strings now
okay so this should work
ah
that's d and that's dl
uh
meta
let's take a look at this file and see
what it is
okay
great um
so in order to
watch this dictionary comprehension boys
k colon v
for
no no no
okay first we're gonna map
x dot split space comma 1
for x in meta
um then
we're going to say
k colon v for kv and this
oh actually
it's probably just better to say
dict
meta and then
we'll say nn equals uh
d
dash
dl
dash dll
okay so then here we can say y equals
meta sub nm
and if i did that right
i'll call this x
i did this right that should work but i
probably didn't do it right let's just
print a couple y's to make sure
uh dictionary update sequence element
zero has length
one
ah
uh what did i do
all right this is just a path oops
meta equals open
see what i did
oh
um yeah not for xml dot split slash n
that should do it
key error okay well it's a different
error
looks okay you don't think
oh it's because i forgot my f
who knew i forgot the f
can you guys pay attention
oh and that because this has flak oh
okay never mind
it's actually just dll uh sub minus five
actually that's probably just a better
thing to
write because that'll cut the word flack
off it
ditch the flag
kiara flack okay well it's not that it's
like this oh my god it's late it's late
guys maybe i shouldn't stream
okay good
uh good we're making progress now
um
oh we don't even need an xmax anymore
xmax isn't even used here
this will just be figured out oh well
okay
we do probably want to say a few things
like
if
um
let's figure out the length of y
print x dot shape sub zero come on blank
y
so we probably want to filter some out
here actually i might have removed that
filtering
i think i did remove that filtering
make wi-max 250
ah
if x shape dot 0 less than x max
y length y is less than y max
then we'll add it to the total
let me throw our qdm around one of these
so we can get some
some printables
all right
then we're going to save this as library
did i spell it right okay good
lee free
now we're going to import torch
okay good
uh let's just test it quickly by like
doing two of those
okay looks good
um do you think you need float32s or do
you think float16s will be okay
ah
okay
i don't know how fast this is gonna be
probably not very fast at all
whatever
let's run it and let it run for a bit
until we get bored
okay
um
let's look up the documentation for mel
spectrogram
to figure out if this what units this
stuff is in
nft
i don't know about that
like is this in some
normalized thing or non-normalized thing
by the way i copied these parameters
from
all right should we should we write this
to make it go fast
what's the slow part here
is this the slow part
okay
uh
dispatch dot append x comma y
see if this is fast
i can't help myself but make things fast
you know that right
i love making things faster let's go
and that's the tqdm on this one
dispatch is not defined
without a defined dispatch
okay that's super fast
great um
for x comma y in dispatch
gqpm this dispatch
[Music]
okay it's gonna finish in three minutes
they don't really make that faster then
this is pretty cool thank you thank you
um
man you know
i'm taylor swift man taylor swift is a
reason i'm streaming for you guys today
so make sure if you ever meet taylor
swift george hart says
i don't know what i said here
um
python goes burr that's right should be
doing pi prime it'll be faster okay
when you're indenting like that
highlight and move once what
oh my god
can you guys like we're writing speech
recognition we just processed libre
speech
then we're going to put libre speech
into the model and we're going to train
the model right here in rack right but
right here we're loading the lj
so we can you know
decent
so we can try here
um in load data we can put in libre now
so instead of loading the lj we can load
the library now i don't know how big the
library's going to be it might be really
large
in which case it doesn't fit in gpu ram
and then
yeah we're trying to get some variation
in the data so the problem with lj
speech is that it's one woman who speaks
all of it so libre speech has uh
diversity and we love diversity on this
channel
uh so yeah
um no it's not based on a transformer
okay so you know what we can also do we
can work on improving the model let's
let's work on improving the model while
that runs
uh so first let me show you that my
trainer works
i probably don't want to run up there i
probably want to run a normal window
over here
um so it's called wreck
and you can run it with wayne equal one
if you want wand we're not changing that
stupid thing so first it loads all my
data onto the gpu
um this is the full libre speech that's
pre-processed
i moved it to pre-processing so we don't
have to
so what's the model the model is here
and it's kind of shitty
um it is a neural net
i wrote it on the morning stream all
right now we see that we're running but
let's write a less shitty model
so a few things to note the ordering is
wait that's not right
don't control c that i was going to ctrl
c that and that would have been a bad
idea okay
the ordering of these things
is just being selected here
um
so we're going to have to do a little
transformation
the order
is
time batch frequency
batch frequency
so first we're going to do an x dot
permute
um and we're just going to permute it
like that
which will commute into
uh
batch time frequency
and then
i would actually if i just say batch
first equals yes i think this just
works let's do that
i hate temporal batch norm
i'm just going to test this quickly
i don't know why i didn't think to put
the permute down there
delete the stupid code
uh i think we need to change it back
yeah we need to permute it back here too
so in order to permute that we just want
to say i think it's the same
that is the inverse of that
uh i don't know why i do zero there i
guess that's oh there's me selecting
from the encoder
okay great
libre's pre-processed so we have libri
as an option as well but let's first
just see if i didn't break anything
there
uh if i'm loading a model i did break it
no i'm not on your model good
which i'm going to mess with the model
okay running mean should contain
684 elements not
256.
why oh
you probably want to do
batch frequency
no
i'm not happy with that either way
which is the most like channels in the
neural net
we want to do
convolutions just look at let's look up
torch conf today
we're gonna throw some convolutions in
here i'm gonna see what we get
okay
the input is n
c in height and width
so i think we only have one channel
coming in
um the height is the frequency and the
width is the time
so we want to actually put two here
it doesn't matter actually the height
and the width don't matter
um
and then we'll uh how do i add an axis
there like that
let's just write a quick thing to test
the model
uh we want to make a model rec
and we want to run it on
uh torch dot zeros time
just let's say 200 batch just 32 and
frequency which is always 80 okay
let's just see if that runs
number of dimms don't match in permute
i don't understand that's three dimms
right unless that doesn't do that for
some reason
print x dot shape okay
number of dimms don't match in permute
but i see three there
did i do something wrong
[Music]
that is what i was doing right
do i not have the
what's not that
saying this isn't right
oh
wait what
oh
wait it's this permute that's failing
okay
yeah yeah it's this it's this one that
fails okay
okay
so now let's look at our shape and make
sure that it actually is batch time
frequency all right good batch times
frequency so this is effectively
um
batch
channels
so think about it as like a monochrome
image
or do we want to treat the 80 like
channels no we don't want to treat them
like channels because they have spatial
uh locality to them
so it's a convolution so this is a
height and width
so if i were to throw a convolution in
here
an um
nn.com 2d
uh
channels in channels out
let's come in with one channel let's
count it up to 16 channels
and the kernel size can be three
x equals self done codex does that work
great
uh oh we want to do we want them to not
to pad
uh there's like a mode for that right
padding mode no not zeros uh padding
uh it's like valid or same
padding the same which is testing
i don't know how anything works
okay
um
that's right uh let's write a block
res block
oh what's the classic res block
c here
um
and it's just a sequential
uh and called
2d
c
uh we want to do a batch norm 2d
batch norm 2dc
uh and then we draw a relu
do you put your values before your
batchbones or after your batch norms
rail you
ah come on batch norm
and then
forward
self x equals
uh return x plus self double block x
all right so it's residual
ah i gotta throw super knit in there
let's throw a few res blocks in here
this should just work right
um
it's probably too many
okay let's do some rough math on whether
that's an insane number of dimensions
i don't think that's an insane number of
dimensions
maybe we can maybe even do more
but all right now we'll just throw
c equals 16.
put c's here
um
now let's calm it back down
uh now we can run it through
recurrent
i'll just call it pro
self dot group x and then the decoder we
can
probably keep the same
yeah that's good
so it's actually just prepared that we
changed
um
h that's good
uh although we are going to need to uh
get rid of that
channels column
so i think it's just x
this
that should just do it
input size minus one expected to be
equal
oh
oh it's because
expected 256 got 80.
this isn't what we actually want to do
for the last one
we want to do uh
200 times steps
could it be too crazy what's 80 times 16
that's normal okay
um
let's permute
zero
two three one
that'll put the 16 at the end
right so they'll make the channel last
great
now we want to reshape
um
let's just say bs equals x dot shape sub
one
so we want to reshape it to be
oh well it's actually even easier than
that
x equals x dot reshape
x dot shape 0 x dot shape 1 minus 1.
that should merge
the 80
and the 16 into one dimension okay great
now let's put a linear layer
uh in the front of the guru
self dot
uh
flatten
equals nn.linear
uh 1280h
that should actually be
c times
you know the frequency is 80.
uh x equals self dot flatten x
that should bring this dimension down to
32 200 256
has no attribute flattened because i put
equals equals
32 200 256.
okay that should go into the groove now
which should not actually change the
dimension of it it should stay the same
input must have three dimensions got two
i see three dimensions
one two three
must have three dimensions got two oh
why am i doing that
okay good
good okay so that runs the groove now
and now we can put it through the
decoder
the decoder is going to give it uh
32 200 comma 10.
running mean should contain 200 elements
not 128 okay
so that actually that thing didn't work
the thing that i did with batch norm 1d
should we just put temporal batch norm
back and just reshape it
as much as i hated temporal batch norm
it did work
we know tempor temporal dash norm is
well tested code and you should never
just carelessly throw away well-tested
code just because you think you could
write it more efficiently
i wrote this in the morning stream
so we can change these back to temporal
batch norms
and then we're going to permute here
we don't want to actually put batch
there we want to put
let's try that
should actually do exactly the same
thing
except we'll change batch first back to
false
okay
so this is a batch
uh that's the time
and that's the frequency
we have 29 which is right because that's
how many characters we have in the
character set now we can return our log
softmax again and it should be good
all right
let's get rid of this stuff
now i think it should train right
unless i broke something let's see how
fast it trains first of all
okay
it's a lot slower
why is it slow
is it using the gpu
98 okay it is using the gpu i don't know
maybe i made a lot of those res blocks
maybe
16 was a crazy big number
it's really slow
i hate when shit's slow
okay the only thing i really changed
let's look at the diff here
okay so i changed that that's irrelevant
i added this code for res block
i replaced this
with that and i added this linear layer
in here
hmm let's get rid of a red block and
let's go down to c equals eight maybe
that'll make things fast
we were getting about 12
per second before
let's make sure i wrote a good res block
toe
okay we're getting six per second now
it's not really very good
uh what are the res blocks actually look
like
transformers
it's not too many res blocks
uh and oh you gotta put a relu at the
end of the res block i forgot that
um
and then dot functional dot value
oh we don't need to print out that size
anymore
height
batch
wc
that doesn't matter
because we're combining them anyway
the height and the batch stay
the height is effectively the highest
time so that's time
uh res block
that's even slower
how is that slower
what a 3080 is better than a v100
wait i don't understand
i just changed something and then i
changed it back
there's no way that
you can use a bottle in that grass block
with a one by one comp i could
this shouldn't be slow
but wait let's just talk about why this
is slow it just shouldn't be it doesn't
make any sense
it's got to be these permutes that are
making it slow
crew is the same size all this stuff is
the same
double check param order
okay i'll do that
but the release didn't make it slow no
that's a joke
okay so this should be like a normal
convolution
batched one we have a rally oh yeah
that's okay
870 by 80.
maybe that's like a really large picture
maybe we should be calming it down
maybe we want a stride
there's no way c equals 16 is faster
this just should not be that slow
use mix precision
this is when i dip back to when i knew
it was fast yeah that's not a bad idea
bro
i agree with you okay
so
let's get back to when we knew it was
fast
that is good thinking
okay we had another
oh
well that's one of the reasons it's slow
because i'm running two of them
oh bros bros why didn't you tell me i
was running two of them
oh why don't you tell me
well you'd be like george you were
running two of them because none of
y'all are paying attention
are you running any others
what's it different
local variable h reference before
assignment okay
um what will we settle for in terms of
speed
goes reduce the batch size probably
pretty big
that's not too terrible that's half of
the speed it was before
and we have some good quality
convolutions
let's up that to 16 and see what we get
let's see if it's still slow
we should also can we print out a model
summary of how big the model is
like just to see if i did anything
stupid with like
slower
oh you know what
i have an idea
let's drive this one
uh
we want to stride it
one comma
c
over two
that should be a lot faster
that should only measure reduce it to 10
there
right we're not losing any information
padding same is not supportive for
strided convolutions
um
i don't really care about
let's try that
so i don't want to lose any on the time
axis
and i guess i don't really care but
no i do
i like when these things match
what data am i currently using this is
libre speech
uh okay yeah that's not right um
divided by there's just two times eighty
done
our strides are c over two
that should be pretty good right like
that's pretty good that's a
good that's a much better encoder
convolutions for feature extraction and
we're using it we're using a groove for
uh
all right great we're back to speed all
right the speed's back boys the speeds
back
okay
so
let's
kick off this model to train let's see
how it does
when equals one
fog encoder
okay
uh
so if you guys don't know i'm on weights
and biases so you can just go to wan db
geohot tiny voice
um our new model is called uh
rose elevator oh that's nice
okay so let's compare rose elevator to
unique c which is my my recent run of a
model
okay the losses are looking pretty good
losses are looking actually identical
losses are actually scarily identical
like you think this convolution just
doesn't do anything at all
it does manage to use more power in my
gpu though
but a smaller percentage of the power
oh because i trained this one on a 30 80
and now i'm on a 30 90.
all right so how's my loss coming
these models look scarily identical
i made big i made major changes to the
architecture i guess that goes to show
that model architecture just doesn't
matter at all
well i didn't do something stupid i'm
not like training on the wrong computer
am i
uh
[Music]
oh i'm not safe
i'm not saving the zero anymore for some
reason
i don't know why not
why did i why did i take that out
that's such a bad design all right
whatever we'll find out at epoc5 5
whether saving the model works or not
are they both libra yeah they're both
free but only one of them is called
libre
okay
so we can let that train
it literally how did i change the
architecture so much and it looks the
same
okay it's going down a little faster
let's do some augmentations oh you
missed that i already did augmentations
that's already there
all right let's change data sets
let's just see first off if lodeo libri
works
um
well actually you know what we can do
we can kick off this job on a different
computer
sorry if you were looking forward to
that name it's gonna get a new name
uh save first epoch
let's uh put my ssh agent into here
let's pull over here
now uh ssh add
ssh id rsa
ssh agent
you guys know how to do this boys
all right we added my identity now we
can ssh into this node
uh oh no
tiny voice
we should do this in a session but it is
hardwired
i don't know how to use like no hop you
know i should know how to do this with
no hop okay
let's wan rack over here
i should not have done that in an ssh
session you can yell at me for that
don't start long running jobs in ssh
sessions um
okay good good good good yeah complain
about numpy all you want comfy sponge
who's rooting for the comfy sponge
uh sorry about rose elevator well it was
it was a good start we know that it's
not totally broken
so the comfy spawn just come in and it's
training over there but we don't think
about it
now over here we can try out the new
data set
the libre pre-processed just for us
i believe in the libre it actually
trains just as fast now that we did
those those other things because it
really is just a
linear layer
but mixing it a bit so
okay
um let's see how big the data is
you know when they talk about big data
sometimes the data's too big
and then if your data is too big you're
gonna have a bad time
okay so
[Music]
this times this times this up up
wait no that wasn't because the data's
too big
this data is double that
and a little bit bigger there okay it'll
fit on my gpu no problem
this is a different problem
can only concatenate list
not string to list
let's just add some uh you guys know how
we do debugging on this channel right
we uh
we add prints
okay so the data's about double the size
in libre speech but the key thing is it
has diversity
we can check back in on my model over
here
all right looks okay
yep pretty good
pretty good
well i is not defiant oh
more eye and samples
i feel like it's going to be obvious
once we see what the bug is
those are supposed to be lists
where did i do that processing i did it
over here
and i ran in this one but it's gone
we sit and we wait while the data loads
so we just copy the entire data set over
to the gpu
because we're lazy now we're not using
the
oh
oh i pre-processed the characters there
for this one and i didn't fit that
one is that fast
uh
yeah see i i pre-processed the data
um
text x
we're not using a data loader anymore
so we'll see if it's slow
um
oh this doesn't have my great improved
decoder from my mac which we should push
it's hard to work on two computers
uh
from text okay
so we have to add um
which is kind of annoying
okay
we'll call it
targets equals
from text which we'll import here for
pre-process
from text x
or i am
samples
um
length x for x and
targets
one map actually was a function and
people used it before it was terrible
that should work
oh
but of course
this only applies
should we just pre-process libre again
yeah we probably should
well we can you know we can process lj
again never mind okay
careful this is only for v-bray
i know a good hack
uh if
type
x y
y sub 2
is list
that's really what i want
um
whatever it's mine for now let's see if
it works
okay okay let's see how our model's
doing
by the way i love weights and biases and
i was like why can't we use this at work
and it's closed source
but
this is pretty nice
okay
it's not falling as fast but that's
acceptable
that's not what i meant to do
okay we're printing out way too many
useless things
ctrl c
okay um this train's slower
because of that crap
did i figure out how to make it faster
yeah i made it faster i just i strided
the first convolution a lot
okay
this is training on
libre speech and it's slower which is
interesting
um we could get a profiler out and start
profiling this stuff but it might be
past profile or clock it is eight
o'clock
so um i think it might be past profile
o'clock i don't know what to tell you
profilers are for when you're bright and
bushy tails in the morning
um but you know for when it's late
you know it's not time it's not it's not
profile o'clock
okay
will the model trained on libre speech
learn by the way now
interesting fact
i didn't change the validation sample
the validation sample not the vowel loss
but the validation sample
is still on uh
the other one
let's let's throw this one in lan as
well
it's calm in frequency space yeah so
it's in frequency versus time space
the convolution model seems to do about
as well as the other model
you don't really see much of a
difference
so unique see is there a way to like
label and say like here
rename run
this is um
linear model
good
this is
whoops
ah
oh terrible it's terrible
terrible i can't click
rename run we'll name this
comm model test
and good galaxy
will rename to
com model with libre
speech
let's open the eye
take a look this is being trained on a
completely different data set so if this
one has similar characteristics it
really has nothing to do with the data
set
the highest gpu power usage
no i think those are just fake
it comes back down
but that one actually is going to be
different because that's being trained
on a 30 90 not a 30 80.
it's slower probably because i didn't do
the tax pre-processing because i was
lazy and i'll pay for it later never be
lazy and one day i'll learn that lesson
tomorrow
i mean if this one learns to recognize
it let's see how this is doing in the
validation okay the examination and
testimony of the experts it's pretty
it's something
by the way someone asked earlier if your
val loss can get lower than your real
loss and the answer is of course
especially if you're using dropout which
we're now using we added regularization
to the model we're using dropout
we're using um
oh you want to do something real ballsy
we could load the data set and then use
libre speech as a value and use lj
speech as a validation set
that's that's that's like cross domain
validation set
uh all right i don't know what do we do
on the models train do we just like
chill are we gonna chill while the
models train
i don't know you guys can see this right
go on my way in db
do we think this model
uh oh it's a shame we changed the model
because otherwise we could resume one we
shouldn't have done both at the same
time
we should have done one at a time and we
should have resumed this model
on the new data set that would have been
the thing to do
oh we're gonna make it faster
making it faster sounded fun this
morning it just doesn't sound faster or
it doesn't sound fun right now
um just we have to like kill it and like
uh
okay well the comp model and the linear
model do exactly the same
which almost makes me wonder if there's
a bug
and like i'm not running the comp model
for some reason
but i pretty clearly am so maybe it just
doesn't matter
value added that value
that rez block is pretty right
i could write faster res blocks but
again
why does this oh
oh this is gonna be different because
there's a different number of batches
i didn't think any of this throw
train train train train train
could make an intentionally terrible
model i could
okay this one hasn't learned anything
yet
but actually it's unclear if it will
because this is not a complete my
validation thing is on a completely
different data set
this one is a little slower but i think
it's just because the gpu got hot
maybe this is overfitting maybe right
there is overfitting and libra's speech
doesn't overfit
[Music]
uh all right
what do i do well i don't know we're
gonna stop streaming that's it that's
all we got right now
we'll we'll we'll have to come back
when it's done training
can we play a game no
this is all we're doing on this stream
no no more rants
uh
no no no no you're all remembering
you're making me remember why i hate
streaming we came here to code
well we do all the model trains okay we
got some s's
i mean if it really learns to recognize
that
that thing would be would be amazing
but we don't know so that's it that's
all we got thanks for watching the
stream pay attention on uh on on my lan
db
uh to follow along let me make sure the
latest thing is committed
uh on tiny voice
uh
oh but that breaks it on
uh libri only
let's just rerun the libre speech
preprocessor
this one learns but it just over fits
now it's not overfitting in general
because we do have a real validation set
but what's happening is we're
overfitting linda johnson
um
you know we're not going to get any
results on this this we're only on epoch
4. this needs to train for 100 epochs uh
before we can get any real results
and actually this is all so misleading
because
um
i didn't make the epoch a fixed number
of samples
because this data set is twice as large
as the other data set
how much money am i using by the way
i think
14 15 gigs
really what we want to do is we want to
load both data sets
train on a huge data set
uh yeah and then that'll be good because
we have a lot of data
all right thank you for watching uh
we'll be back on tomorrow
early in the morning
uh to see how this model trained and
tomorrow
guys here's what's gonna happen tomorrow
and i need you all to subscribe because
i saw that i got 70 something subs and
i'm like damn all right fine you know i
should stream
you know
uh let's see what's this paper you're a
subscriber let's look here let's look at
the paper you linked
which one
poly loss a polynomial expansion
perspective what does this have to do
with anything
oh is this a replacement for categorical
cross entropy
i don't know
oh look at this
asami uso so would be so so fobby bell
look it's just looking like that to
listen like baby
yeah oh man because if this model works
on that i think it's gonna work on my
voice
unless i wrote
bugs wait let's just check something
quickly
is it possible that i didn't scale
things correctly
let me just look at the statistics
quickly
uh
let's just say like
you know val.max
oh
i don't think mine has that
maybe it does because it's a male
spectrogram
well that's similar-ish
we'll concatenate the images
you might know
now they look pretty much the same
i can't visually see the difference but
in one we get
fame busy sosas and as remember this is
the noise we recorded so
the examination and testimony of the
experts enabled me to conclude
yeah so
they look very similar to just me
looking at
i could write this processor myself so
i don't know if it's any good
but uh
yeah
okay guys i'll see y'all tomorrow
uh
let's come up with a schedule let's come
up with a time let's say nine o'clock
we'll be back we'll check on these
models and we'll uh we'll make it work
tomorrow tomorrow it's gonna recognize
my voice but my real goal for the
weekend is to make it talk
not just recognizing but also speaking
and it will speak with its tiny voice
and you'll be able to type words and it
will say them
uh
what do we got thank you thank you
better than categorical cross
entrepreneur check it out all right good
night
twitch to good morning
good morning all right
I played with a little before the stream
but I thought I would start fresh for
you guys
uh I just wanted to check the
feasibility of this and honestly I have
no idea if it's gonna happen so if it
doesn't happen I'm a liar I'm a fucking
liar who am I I'm only 25 can't remember
half the time that I've been alive
because half was in a cheap apartment
and half was on the east side
uh good morning good morning good
morning everyone good morning uh let me
just make me a little smaller let me uh
uh here we go we live let's go let's go
oh let's pop out chat there we go
um
morning
um all right so you all know about
stable diffusion we gotta get more
coffee I'll be right back
uh and we're gonna try to run stable
diffusion in tiny grad and the process
we're all gonna learn something about
deep learning
foreign
we're streaming
um
good morning good morning good morning
all right I'll be I'll be right back
guys I'll be right back all right you
got me uh what was I gonna say oh yeah
guys remember when you were in your late
teens in your early 20s and you still
felt feelings cherished that moment
because it won't last forever
all right good morning everyone good
morning
I think it's uh time to get started yeah
man feelings
uh yeah there it does I
well we've been talking about feelings
this is a programming stream this is not
a feeling stream
so let's just create a file here a new
file called stable diffusion
so right here I have the I downloaded
the weights
uh this is V 1.4 checkpoint
um
that
[Music]
um
let's say file name
yes and the file is called
model.checkpoint
so
um we can take a look at what the file
actually is here you can see that it's a
zip archive so there's actually already
some code in tiny grad to read these
things and utils
um it's in fake torch load zip
so we're just going to do that in for
from
extra.utels import fake torch load
zipped now unfortunately this doesn't
take a
I should change this around a little
[Music]
foreign
factored there sorry I already looked it
a little I know carpathy hey carpathy
should come on my stream we should
stream together
here's the difference between me and
carpathy though carpathy is a legitimate
man who is trying to educate people me
I'm here to entertain that's the
difference man it's like what's the
difference between
news that's like actual news I don't
know I'm going to give an example but
you can't even give it and then like CNN
C1 is like professional what's the
difference between MMA and professional
wrestling and you know if that if they
put professional in the word you know it
means that it's uh you know yeah okay so
yeah professional wrestling all right
let's go
um we actually have to open this let's
open it and of course we're in 5.3 so we
gotta do RB let's just say that equals
fake torch load zip let's go over here
and let's run it I already know that
this won't work
because I tried it for about 10 seconds
before the stream okay can I create an
object array for my memory buffer uh you
see that this thing is loading the
um I don't really know how this is
supposed to work so I'm calling this
from buffer thing here
uh to load the parts of the file so this
is loading the different weights
um
like inside of this checkpoint file
which is the torch weights file there's
this thing called Data pickle and then
there's all the things all the like
objects
and you know what let me just add a
parameter um
say load weights equals true
uh if load weights
we can just say over here
uh for KV adapt is it a dictionary all
right
too many values to unpack expected two
uh oh
okay
um so this is like the pie torch
format I think we might have to go in
here to State debt
okay so these are the different these
are all the different layers
um in the model and we can print
something like let's do
dot shape call it 50s
sorry
um It's gotta go in there
one supported shape oh I guess it's not
a string
these are all the different uh matrices
being stored in uh the checkpoint file
now I know this bug is a known bug in
tiny grad here in my my unpickle here
where I'm loading in the 10 series I'm
just putting in the size I'm not putting
the shape
but I think we can put in the shape if I
do this
prod we're gonna get to the stuff that I
actually have no idea about in a minute
you can all watch me struggle
oh that's what y'all come here for
from Tiny grad.com
so these are the shapes and these are
all of the
uh things inside of the stable diffusion
checkpoint so let's take a look at what
they are and if we're going to need them
okay we have this thing called modeled
Fusion model now I I legitimately I've
run stable diffusion on my computer for
those of you that haven't been on the
internet in the last two weeks and don't
know what stable diffusion is it's like
Dolly but free uh yo yo yo yo by the way
shout out to e Musta I don't know how to
pronounce your name but bro your boss
open AI billion dollar company being
like oh we're gonna rent see Dolly and
then this guy shows up and he's like nah
bro stable diffusion free by the way
stable diffusion has a safety Checker in
it and you can comment it out you can't
comment it out if it's on the server
that's the power of Open Source
or if you wanna if you want to make porn
if you want to make racisms whatever it
is you want to make you can do it you
have the power you aren't going to be
censored by uh the people who care about
you know
AI safety oh yes yes yes yes yes if if
even one AI creates a naked picture of
Taylor Swift We we can't no no this this
violates AIC and what these people are
doing is they're diluting the whole idea
of AI safety if they believe that AI
safety is is you know I was going to
come up with a racist example but I
don't want to give a real racist example
naked Taylor Swift that's something
that's PG-13 man you know racism's rated
R these days let's try R for racism all
right
um
oh no I'm not even kidding there's
actually an AI there's a safety Checker
I'll show it to you it's a joke
I already commented it out
inside of uh so this is this is the
stable diffusion repo some guys ported
it to make it work fast on the Mac
pretty cool
uh
there's actually code in here called the
safety Checker and it runs this model to
check safety
and if it's not safety it loads this
replacement Rickroll image uh so this is
actually code that somebody wrote but
hey you know what people write code to
do all sorts of things
um
[Music]
all right so these are the models inside
of stable diffusion maybe you put a
license equipment a license agreement on
the open source
if you're going to use this to to make
celebrity pornography you are a bad
person and must post on the Internet is
that how you're a bad person or
something
I don't know man I don't understand
mural
moral Purity Arc shit
uh I just understand uh Power that's
right
okay
so we have a bunch of models inside of
this thing and now we get to the point
where we're going to have to read the
paper to understand what these models
actually are so there's something called
diffusion model
which looks like a Transformer
it has input blocks middle block and
output blocks and I guess it's just a
normal Transformer with those things
uh then we have this thing called the
first stage model encoder and decoder is
this a unap
foreign
[Music]
and then we have another thing called
con stage model Transformer text model
and that one actually has the word
Transformer in it so it's probably a
Transformer
bro bro you know what's stupider than
racism talking about racism never mind I
regret that I brought it up
are we gonna have to go back to chat sub
only
um yeah so diffusion models iteratively
generate things out of noise it's like a
well we're gonna figure out what it is I
don't really know how it works
uh yeah I hear you guys saying no but
like you know what all I hear is yes yes
yes moderate Me Harder all right
subscriber only great
um
[Music]
so let's uh let's look at this paper
stable diffusion archive
hmm
stable diffusion
no you know we hate red seeking on this
uh on this channel we think that the
world should mostly be open source
mostly I mean there's things that don't
make sense open source but like the
model definitely
a good source
okay
so this is the paper
here so these are the things
I don't really know much about diffusion
I know a lot about units
so what we can also do is maybe just
read the code and maybe this is a better
idea
so here's text to image this is the
thing that actually loads the file
this is not going to be easy we're not
going to finish this stream
Omega comp load opt dot config okay
config stable diffusion V1 inference
oh okay so this thing called ah
so it looks like this one here
is ldm models diffusion model open AI
model unit model
this one oh no no that's not the unit
that's the auto encoder
I don't know where that is
let's see if these sizes kind of make
sense
first stage model encoder
sorry
um
first stage model encoder common weights
just Google it bro
latent diffusion Unit Model Auto encoder
oh and then okay this thing called
constage is a Frozen clip embedder
and my guess would be maybe this is the
unit model
in the diffusion model is there a reason
to believe that from here
the fact that this one happens to be
called First Stage makes me think that
it's useful
um in channels three okay well I mean
this does have in channels of three look
here you can see
that so that is in Channels with three
right because this is uh
this is a weight for a calm so that's
your out channels in channels width and
height
um so it makes sense that that's the
autoencoder KL now is this diffusion
model here does it happen to have four
input channels
yeah okay it does okay cool
wow
um okay these are coughs
who put comms in the Transformer
uh
right so we have to implement a unet
model an auto encoder KL and a frozen
clipping batter
oh man I'm ready to give up who's ready
to give up this is too much work there's
a lot of work Bros
[Music]
now we're learning even if we don't
succeed we learned and isn't that the
real reward
stupid like all advices you know
it's a lot of people man I watched some
Nathan For You episodes last night
and it's just like man like it's funny
it is it's just like
people
think like there's advice I
don't know you're gonna find your
passion one day man one day you're gonna
just you're gonna be walking in a forest
and you're gonna be like I'm really
passionate about button collecting and
you're gonna find it and then your whole
life from then on is gonna be telling
people about how you found your passion
and it's button collecting and that they
can find their passion too or something
okay
I have 32 gigs of vram because it's a
Mac and it's shared
um
all right
so this thing despite being called a
unat has a tension and I've never seen a
tension in a unit before
taking it step by step would be better
first Transformer then comms and
Transformers yeah that all sounds great
okay great
great
um
let's try to figure out first off why
there's all these things
like what are the inputs and outputs of
these things you guys remember my
well you know
I didn't know you could put the tennis
so you know it's like an old model from
back in the day I think it first came
out about some paper of like segmenting
cancer cells
oh man Transformers I don't like
Transformers like
ah
I feel like in in there's just like
they use a lot of terms like
self-attention and query key value that
obfuscate what like the truth of it is
I mean that would be a fun project if I
was actually AI researcher I'd figure
out like what parts of the Transformers
actually matter there's probably papers
that do this
I just wish that the terminology would
change
around Transformers like we stopped
calling them queries keys and values and
it's like okay you have like your fast
weights when you do the dense multiply
right Schmidt over with the fast weights
and slow weights like it actually makes
a lot more sense
um like it can change the weight Matrix
depending on context I think is where
the power of Transformers come from
uh I do have a nice Transformer
implementation here
inside of tiny grad
so you know I do get how they work and
hopefully we'll be able to reuse that
to make it work
oh my God and then we're gonna write
this and we still have to write a
sampler on top of this oh this is never
going to happen
uh modern units like the one in image 10
contains attention blocks between pixels
and down sample channels to allow for
larger contexts interesting
[Music]
is it this
uh
do these things work well for sagnets
too
like should we add I think we are
segment at comma and actually now it's
not a unit anymore but
foreign
sorry we're just gonna have to read this
paper
um great love this word love when
they're democratizing things
how come you don't have any like
dictatorizing
dictatorizing High resolutionary
synthesis
we train this model and we're going to
tell you how you can use it when you can
use it and how much you're going to pay
for it dictatorizing high resolution
image synthesis
see this is this is
I I tried to put my finger on exactly
what this problem is with the world and
I wonder if it's just one of these
things where you know I'm just generally
upset and it's not really a real thing
that I can put my finger on but it's
like whatever process in people's minds
leads to the use of words like this
right like
I spent most of my time working on open
source self-driving cars
right I would never use this word
what is it about the type of person who
uses that word
it says not on my paper
there's something in their mind you know
uh
I had a conversation with someone about
the word privilege and I think I did a
really good job like turning it on like
you know I made him think it's like
you okay so you're privileged right he's
like yeah yeah I'm privileged yeah I
feel guilty about that that's good uh
and those under privileged people about
this people are not privileged right
yeah yeah yeah and I was like
do you think your life's better than
theirs
I was really upsetting to him but I got
him to admit yes and it's an interesting
thing right
it's like you have these people who who
they not only managed to feel Superior
they managed to like
like maybe they just feel guilty about
feeling Superior and that's really where
it comes from
um so I don't know I don't know if
that's the same kind of thing but like I
don't know I see words like this I'm
just triggered man you know I just
triggered and I'm sorry I wasted three
minutes of your time
uh because we're here to try to make
this work and you know making things
work is Technical and very difficult
um
all right
I don't know I just like
you know we gotta
kamagata we got sued we got we got sued
by Patent troll I'm gonna take a minute
and shell for this uh I'll get it it's
nice when you Google his name now our
our blog post is the third hat uh
yeah uh we got we got we got sued by uh
by this guy and like
you know it's just it's just sad
like
are we like we we hired a private
investigator and like looked into this
guy's life and like it's just it's just
sad
and and then you realize that some
people are just there's there's people
in the world who are just assholes
like on TV when you have someone who's
an asshole they always have some kind of
redeeming quality about them right like
think of like house or something right
like but in the real world you just find
people who are just straight up like
dude there's no redemption in your story
arc
you're just an asshole
um
he's not going to get any money we're
both just gonna end up wasting you know
who's gonna make money to lawyers right
like and the lawyers are going to make
money his lawyer is going to make money
our lawyers are gonna make money he's
not gonna get any money from us it just
sucks though it's just like it's a huge
waste
uh yeah we're shaved in Silicon Valley
right I actually watched that episode a
few nights ago
uh dude like you know it's just it's
just you know it's sad too you can go he
gave a talk at South by the same year I
gave a talk at South by
um
now you can you can find his his talk
and like he just doesn't it's just it's
just sad man it's just sad
uh
well that that's all we're gonna we're
gonna say about that
um by the way this image was generated
by stabled Fusion well we're all big
fans of stable diffusion
um you know this it is nice though like
you know I don't know if we're
depressing on this stream a lot but we
should really hype up how awesome like
them just releasing stable diffusion was
and there's still a lot of uh you know
cool people in the world
uh you know oh my God
all right we're going on rants we're
going on rants I know you all like rants
um
this I can't believe this
so this is Aurora uh notorious scam
self-driving car company board memo
accidentally leaked to staff so here's
my theory about what happened right
because actually when you look at uh
Aurora is a publicly traded company that
went uh public through a very legitimate
very very legitimate uh Speck so they
they
um
okay so you see this uh pump right this
is when the memo leaked right so step
one
uh buy a lot of stock maybe options you
want to buy options you want leverage
right step two leak a memo about how
you're gonna be bought by apple or
Microsoft
pump
dump right that's seems to be what I see
what I see happen and I'm like you have
like people like this and I cannot
believe this
these people out there think for some
reason like
Tesla's not winning self-driving cars
yet when you look at videos like this
uh if you have if you haven't seen
if you haven't seen videos of uh of the
new self-driving if you haven't seen the
new videos the new FSD beta like
it's so good look at this
and like it works it's shipped to people
it's running on cars it's a profitable
I'm just
it gives me very little hope for like
Fair who who doesn't like Elon Musk like
it just gives me very little Hope For
Humanity
who do you want you know
and this was talked about it a lot just
like
okay you don't like billionaires okay
who's a good billionaire
hopeless man hopeless
it's a scam
it's a scam 2.8 billion dollar scam oh
you saw zuk's commercial like oh
my God
what hope do we have what hope do we
have what would people like scams
like they find out it's a scam and they
still like it
foreign
it makes me upset and hopeless about the
world
uh well no I'm yeah
let's let's focus on what we have to do
so we haven't
autoencoder that's not the unit
all right so this is the ldm here we go
section 4.30 okay
if a paper should people Implement well
I'm implementing a paper right now
right this is how you learn this is the
best way to learn like what the latest
tricks are in deep learning just like
implement the latest papers
um
I like doing a tiny grad but you can do
it in torch too it doesn't matter with
my glasses at
I have uh I have an astigmatism
I realized like these things that I used
to blame as floaters in my eyes which
made it like hard to like look at things
is actually an astigmatism and did you
guys know by the way that health
insurance is like a buffet
don't go up the more of it you use and
everybody can go to the eye doctor
let's do it so yeah
I can see a little better now
conditional latent diffusion
train a huge model
conditioned on language prompts
into the unit
oh this looks very complicated
image generation with latent diffusion
okay I don't understand why it has three
pieces
why does it have a unit and auto and I
understand why it has two pieces we need
a clip in better to embed whatever
phrase I put in right to do to do text
to image
that makes sense to me
I don't understand why we have both a
unit and an autoencoder
the autoencoder is used to reduce the
dimension of the image before the
diffusion process okay well it's
actually that makes a lot of sense
because it's called First Stage model
um so when you want to train the
diffusion model you can do so on down
scaled images
okay cool
uh
so what does it go down to
oh it says this is unused okay is this
like 32 by 32
and then what
when I'm doing the steps in diffusion by
the way just to show you guys how stable
diffusion works
favorable diffusion
[Music]
so this synthesizes the thing okay it
loads the model
shape for piano less sampling
the thing that's doing diffusion is you
have to call the unit multiple times
okay
cool so so this is I mean it says here
that this is like four by 64 by 64.
all right so let's see how big am I
uh on my samples by the way if you want
to see what it generated
here we go a juicy red apple floating in
space uh how many pixels is that you do
final
one five twelve by five twelve okay so
this has input of
three by five twelve by five twelve and
then the output is 4 by 64 by 64. is
this right
[Music]
I imagine the unit has the same input
and output
um
you can check this
so here Unit Model the full unit model
with attention betting
forward so
[Music]
what's EPS prediction mode
working with Z of shape
why is it two
why is it two
can someone tell me why it's two
yeah I understand but why I only told it
to synthesize one image
oh
um you gotta recorder KL has
in code and decode
see if that's getting called you're
telling me this is only getting called
once right at the end
so it's gonna it's gonna like run the
whole pmls sampler and then
call it once at the end I think if we
understand it right
so my guess is it's going to call decode
at the end
now here's forward
calls and code and decode okay that's
pretty good
so yeah I mean it just kind of looks
like an auto encoder
oh did I now put another one okay
here we go good
all right so exactly what we expected
great
so this can actually go both ways
because it's an auto encoder
all right so this is this is cool
um
thank you thank you uh
to uh Flavio Schneider for giving us
real information
uh
this makes sense
why they shipped the encoder I mean I
guess that's nice of them
but so the auto encoder seems completely
separate
uh this is what runs each time to sample
um so okay let's take a look at the unit
and in my understanding of units is
let's check the paper but my
understanding of units is they
they have so like an auto encoder is
going to go down to just one bottleneck
layer whereas a unat will have a lot of
cross connections
at least if units are still what I
remember from my youth
which they might not be
they now have attention apparently no it
looks like
switch
conditioning
pixel space
so this is this this must be the auto
cutter here with zencoder and decoder
uh
I don't really know what a diffusion
process is
let's read the paper Okay diffusion
models are probabilistic models designed
to learn to data distribution by
gradually denoising a normally
distributed variable which corresponds
to my nervous process
rely on a
re-weighted variant of the variational
lower bound
maybe this is real something I find a
lot in machine learning papers is they
like to call things very complex things
when they're not actually complex
like it's like oh yeah that means we
divided it by seven
the models can be determined as an
equally weighted sequence of denoising
Auto encoders which are trying to
predictive denoise variant or their
input
XT where x t is a noisy version of the
input X
but this still has nothing to do with
okay I mean here's something we can
actually try
if we take this image
let's let's take our our friendly Apple
image and let's put it through the auto
encoder
and let's see if we get the same image
back
you can think of diffusion to do nothing
yeah I understand the basic idea
um
I understand the basic idea of diffusion
you know I think what's kind of
confusing is the thing here that they're
calling autoencoder is not the denoising
auto encoder they're actually using the
unap model for that
it's my understanding right and I
understand why they need the encoder the
encoder is not just put there because
they're nice if you're doing image to
image stuff you need the encoder
um
so actually let's do the math what
actually is what's 4 times 64 times 64.
what's the uh what's the latent
dimensionality of the autoencoder all
right so autoencoder is a projection uh
so tricking things A8
um if you're doing image to image stuff
I imagine you need the uh
you need the auto encoder so the first
thing we should be able to get working
is this first stage model and we should
be able to just take an image bring it
into the latent space and bring it back
does that sound right
uh oh have I seen Transformers our
efficient World model Samplers yeah I
paper output work
no
in general when I see a paper like with
a title like this I'm like uh uh
like is that sample efficient what does
that mean
oh great yeah and then like they show
this stuff off and like not to like like
hate on the uh actual work
I just more mean like
this isn't a
paper it's uh it's uh what's it's like a
like
uh research report right
purely
oh
yeah
good on them for making it open source
I never heard of this
what is this
reliable evaluation even with a hand
cool
there's all these tools I like I gotta
spend more time looking through all
these tools if you don't really use any
of them in comma
I don't know like I mean you saw when I
did Tiny voice I used weights and biases
and
I mean I wish it was health and source
we we looked at that we have something
similar comicult reporter that we wrote
um one of the problems of way to bias is
not open source and if you want to add
something it's hard all right we're
getting distracted but we're learning
we're here to learn about deep learning
[Music]
okay
I think I think we now have a good
understanding of uh
of what
stable diffusion is
uh I guess the only thing we don't quite
understand is
uh how the clip model gets in here so
let's just take a look at the paper
let's figure this out
conditioning
hmm
this is just that right
I want to do it twice
condition ldms
so I guess the unit thing is what
they're calling our ldm
what do they call the whole thing the
LDN
where D amps
diffusion models
I think the previous work that relies on
auto aggressive attention-based
transform models and highly compressed
discrete latent space we can take
advantage of the image specific
inductive biases that our model offers
this includes the ability to build the
underlying u-net primarily from 2D
convolutional Iris
further focusing the objective on the
perceptually most relevant bits
neural backbone of our model as you
realize hey
I am conditional unit
meaning you're stuck in which Step it
was
the forward process is fixed
ZT your latent space
I guess what is this thing called
diffusion process
so I think I hated too much on this
paper
I haven't I haven't read it
I
I just like
this phrase upsets me and it's hard for
me to look past
like
what do you mean by sample efficient
um you know what paper I saw that was
cool uh from Berkeley learning
to walk in 20 minutes
oh
they actually bought a a Chinese robot
dog and they ran live reinforcement
learning on it
which paper uses Jacks this is Jax
no this is pie torch
this paper uses jacks
walk in the park
um
yeah see real robot equals true I mean
this is this is the future for uh yeah
these jacks I've never used Jax I know
much about it
all right we're gonna get a little we're
gonna get a little distracted here
I'm sure I've read this before
I don't know is it like tensorflow where
if I type in Port Jax how many seconds
does it take before that returns
yeah no I understand yeah yeah sample
efficient refers to the number but like
what does efficient mean right
you know what's interesting also about
like just stable diffusion in General
open sourcing there's
almost no value in like
all the difficulties I mean at least
this is true with comma like the open
pilot model is open source MIT license
but
it gives you nothing you need to be able
to train it
the training is insanely hard
um
because like
the loss functions I don't know maybe
this isn't really true on images but
like I know it's true whenever I've
tried to train autoencoders like okay
what loss function you're going to use
right and there's the whole idea of
Dance Again is like we're going to learn
the loss function
um we're gonna learn our discriminator
which is basically a loss function
because you use something like mean
squared error you don't get the kind of
images you want no like I don't know why
maybe like people are like well yes I
mean that was true when we had Nets with
10 million weights but now that we have
Nets with 10 billion whites mean squared
error works perfectly so who knows
am I get a retrain model with stable
diffusion well I'm just trying to get
stable diffusion to run in tiny grad I'm
trying to write I'm trying to like write
an implementation of stable diffusion uh
okay so let's let's just start coding
I think I think we've done enough uh you
know uh shit talking before we kill it
so maybe it's coding time
even though we don't understand still
how the tax model goes in we can
understand how the auto encoder works
not the diffusion model but this thing
called the first date model
yeah I'm using I'm using SD I'll add a
comment about that
um oh yeah I said load weights equals
false
it just means not looking the actual
weights because you get this oh
I guess that's why I didn't do it that
way
short crap
too many indices
sine
how do I do this
foreign
there's like a generic way to write
that thing right
like not that
one that works even if this shape is
zero
no I don't want slice assignment
no but I can't just do equals because
that will
it's not what I want
to be
foreign
too many indices for array but there's a
generic way to write this there has to
be
ah
yeah jitting helps a lot because you do
a lot of dispatches to the the uh
the GPU it looked like I mean I wrote
all this stuff in tiny grad it's
laziness
uh I did in terms of laziness but you
can do it what is this R is this what I
want
no
put
oh that might be what I want
[Music]
put missing values
oh
okay
no
there has to be like there's a simple
way to do this right
I'm hoping one of you is gonna answer
this
[Music]
like I mean I I can't just do that
triple object doesn't support item
assignment
is it like copy it underscore
no
insert
now what I want
I don't like set the data I'll copy two
okay that's fine
uh that's because these things are
[Music]
object
[Music]
[Music]
foreign
now we're loading them we can set load
weights to true
first stage model
basically it looks like you have res
blocks and attention blocks
so I should have the equivalence in here
did I not use Bachelor
okay normally bias but it might not be
Bachelor might be a different Norm
[Music]
residual block
foreign
[Music]
group Norm
so our press block has
in layers M layers and outliers
doesn't seem like it matches this right
where's my in layers outlayers and
is that not right
res blog we also have these things
called attention box
they have down
even in the encoder we have down and mid
decoder we have mid and up
so here's our unit
um we can actually look at here where it
calls uh
oh wait
I'm looking at the wrong thing
we're we're doing the auto encoder first
you guys gotta catch my errors
why I keep you around
um
here's the encoder
uh what are these things use okay here
we go this makes sense so this is down
oh it has these things called resnet
blocks
and then here's mid
and here's a norm
okay that looks straight forward enough
you know I should really work to make
like it matched pie torch exactly
so it'll be easier to load things
uh okay Call of Duty is called wave bias
Norm is called weight bias what is this
normalize okay group Norm
uh do I have a group Norm
yeah I have something called group Norm
so
let's see another layer Norm
uh they're like similar I kind of
remember how to do this
tembi channels
and we're back
right
no idea
what else do we have for breakfast
foreign
please
there was anyone else thinking about
what a rubber eats it's time for Uber
Eats guys it might be a great time
all right we'll let the non-subscribers
talk but only if they behave
you gotta be on topic and answer good
questions and if you distract me even
once
we're done and you lose your talking
privileges for the rest of the stream
should we order breeds
uh
what do we want do we want to ask app
not to track of course we do
oh yeah I tried to order ubereats I did
a bike trip around Iceland
uh
uh and I tried to order it was a joke it
was like a meme like we're at a campsite
and like it's freezing and there's no
dinner
and
friend was like yo
why don't we order ubereats and for a
split second I was like man this is a
great and then I remembered I was at a
campsite in rural Iceland and there was
no Uber Eats
restaurants
oh I could get an eight dollar burger
for 976 dollars that's a good idea
um
badass breakfast burritos well this is
all terrible
well this food looks so bad
I don't want fucking Del Taco
Dunkin Donuts is a four dollar delivery
fee
burgers bagels this will be here very
fast
oh Mimi's Cafe finally something that
looks somewhat okay
four pumpkin spice griddle cakes topped
with powdered sugar
that seems nice
it's only 15.99 for four fucking
pancakes now this place only has a 4.5
um
snooze am Eatery and it's going to take
so long to get here
uh
fresh juices and smoothies
do we want avocado toast
hard-boiled egg no no I don't like
hard-boiled eggs
they put french fries in the breakfast
burritos yeah
vocal crepe
all right we'll settle for an organic
acai bowl from local crave we can't just
sit here and do this forever
um oh croissant toast
oh bravocado toast all right we'll get
one of those too
all right we got an organic acai bowl
and a bravocado toast
all right so the total is twenty dollars
and then it's a delivery fee and then
there's a tip and then oh the total is
thirty dollars great no you only get a
tip if you walk it up to my apartment
I'm not giving you a tip beforehand if
you walk it up to my apartment I will
give you a tip otherwise I will not and
before you say I'm a dick you know you
all do the same thing man and if you're
not doing the same thing it's because do
not bring into your apartment you have
to go meet them at the street and I hate
that
never give tip bro
foreign
should we try to like replicate this
exactly
I'm gonna probably be the simplest way
um
Vlad 10 of you're staying weird stuff
guess what you know you gotta just
randomly ban someone every once in a
while and you're banned
um
foreign
keeps everyone else in line you know
what I mean I learned this from
Singapore
uh and guess what you gotta we gotta go
back to subscriber only chat
foreign
blocks
there's a lot of code
so why does this have a
why does the encoder have eight there's
only four that doesn't make sense
all right I would expect this to be four
because the output dimensionality is
four
the input dimensionality here is four
why is that eight
does anyone know
okay encoder decoder oh yeah there is
some other weird step
uh
Quant comp
oh here it's this
oh is it outputting a distribution
maybe it's including a standard
deviation
diagonal gaussian distribution
torched.chunked oh that's cool if it
does what I think it does
attempts to split a tensor into the
number
specified number of chunks
all right
dim equals one yeah okay that makes
sense because of bad shots
okay yeah so it's just the mean and the
log and that makes sense so it's
actually outputting a distribution
uh that actually makes complete sense
and I don't know why I didn't think of
it
um no freedom of speech can't be bought
I might just ban you just to prove my
point
uh
Quantum why is it called Quant com
does anyone know why
Quant curve
is this calm out
why come I don't have something called
Quant conf
hours in the VQ model this is not a
quantum
two
I don't understand why I don't have
something called quantum
I have encoder and oh here Quantum okay
fine
um
is this like a real thing
I don't know
it just looks like a normal boring
convolution to me
it's like a one by one column it's eight
it's literally
an eight by eight Matrix
okay I think we know how to write this
now we just have to do it
uh I guess the last thing I want to
understand is down sample
I have nothing called Min shortcut
I don't understand why I don't have a
noon shortcut
mid
normalize group Norm
must be in the res block
right here we go ninja shortcut oh it's
just okay it's in a different file
that's why I didn't find it when I
walked
so this calm shortcut and nin shortcut
if you use com shortcut is set to uh
true you use that one with a kernel size
of three otherwise you use a
nin stand for
a bit different you can see the
difference here it's the kernel size
um
all right so if it's doing an expansion
that's true
foreign
ERS here and how I like get them
they're fine
class stable diffusion
not that much documentation okay so
we'll have something called
self.firststage Model equals uh
KL Class Auto encoder KL
um self dot encoder uh equals what I
call it let's just see what name they
give it
they just call it encoder they just call
them color
told her
glass encoder
first stage model encoder now we got to
do down we got to do mid
uh so down is an array
it looks like it's length
for our eye and range for uh
what are they called
yeah okay it makes something called a
modulus
block a pen
block attention
they're both
there's no attention I don't know
uh they do have something called down
sample down DOT down sample module okay
uh so I see
looks like they have two things called
uh
okay array is called down south dot down
DOT append uh let's try a dictionary of
block
and down sample
do they all have down sample no they
don't all have down sample
um but they do all have block
so this is a resnet block
oh you can't see anything there sorry
foreign
Twenty Eight
uh size equals 120 128 uh
I'm 226 26 512.
and then five four five twelve
right
foreign
channels out channels
[Music]
here yet
no I'm not turning on notifications you
lost your notification privilege when
you spam me about some stupid special
you were having
[Music]
and within a resnet block we have what's
an array
oh no Blanc is an array I say
two things
[Music]
like that
that was in it we have Norm one column
one
[Music]
um
like that I got
how many channels I'll try this kernel
size
uh what is it called everybody
channels
without channels
also is the second column for these
norms
uh it's a group Norm so I should just
call it normal I the same as them
uh we have to put in channels
actually in channels uh it's about
channels
[Music]
class normalize
channels
do the same
okay I need self
and then group Norm to do right
group Norm
how big are these things they're just
the number channels
so we can copy that from count to D
is
called forward X self X I actually
didn't write any of the forwards yet so
it's good
okay
um
great
we don't actually have another way to do
that later while we test this
uh let's see if this thing's actually
gonna work it's called get child parent
key
um
stable diffusion get child models
model okay
uh stable Fusion has no attribute betas
that is okay
uh
[Music]
that's not how you do that
python exception two exceptions
it's like it's different in Python 3
right
oh no come on come on don't make me do
that there's got to be a way that yeah
it's this right
I don't know I hope that's python 3.
there you go to both
all right cool they're all none
they're all none okay it's useless
um oh here these ones aren't none
okay great
so you see that it's loading in all
these
uh
tensors here
I don't like that it says load up so CPU
but that's fine
oh you found some oh you found Docs
uh I'm going to move me up here
oh here we go how does stable diffusion
work
this would have been useful to read at
the beginning there are three main
components latent diffusion an auto
encoder a unat and a text encoder okay
good
the vae model has two parts and encoder
decoder load imaginal latent
representation
decoder and encode our Vulcan prize
resnet blocks to prevent the unit from
losing important information we have
shortcuts all right cool
all right put that in the unit and then
we put that in the all right
pretty cool man
foreign
part
we'll add this to here
ah we need something called conve in we
need something called down sample
how come I don't have a comment
is the encoder not here
um
Coda has a comp out are we only working
on that no
our encoder should have a combat his
content where is it here
uh self.cha
right there
we should uh actually let's add a quick
assertion here uh if W is not none of
that shape equals uh
all right we're gonna leave it down
sample as well down sample
just a curve
it has padding
because it has a stride
no asymmetric padding and torch column
well fortunately you know what does
support asymmetric padding
uh tiger guard because tiny guard's
awesome
actually it looks like it
doesn't support
even though it should
ton of operation does
um
we can fix that
self dot look how much shorter all the
code is when you write it in tiny grad
well I'll have to fix this um if
instance padding else uh
Camp flame padding equals two else panic
say self dot downsample equals comp to D
uh what's our channels and our channels
for that
oh that actually goes here
[Music]
kernel size is three by three The Stride
is two and the padding is
cool
oh okay that didn't work actually
why didn't that work
block shows up
why doesn't down sample
you added that right
first stage model encoder
down sample.com
.0
should be right because it's on the same
level as block right
it's about down sample right
oh sorry
[Music]
right uh now we just got to do nin
shortcuts
uh where are knitting shortcuts
block so we're definitely going here
um
BF in channels not equal to out channels
uh self Dot
and ninj
equals and channels our channel is one
huh okay I messed up
backwards
foreign
ER
do
we don't we're missing the mid we're
gonna do the mid oh fucking attention
all right we're gonna do attention too
what is a nin shortcut I don't really
know
uh I don't know it's like Nine Inch
Nails
oh man I wish I could play copyrighted
music on this stream one day we're going
to be free from a tyrannical overlords
uh should we write the encoder I should
write the decode or two let's write the
decoder now we're at the mid first all
right mid
okay
make attention
attention type
[Music]
torch makes use NN dot module we don't
do anything like that uh
okay awesome dot mid uh block one
I don't know what 10B channels are
oh they have Dropout do we care
that was something
being used probably not being used
10B channels
she looks fine
okay so we have block one
block two and we have to make a tension
one more let's just see if that loads
them
did I get it right audio diffusion pytor
should be able to apply this
uh
okay
good you always have to get Norm out
comb out and carve in
I thought I wrote convent
oh that's the decoder okay we have to do
a comb out as well
I love how short tiny drag code is
like like even when you when you
implement Nets in it
ah okay
pop out
[Music]
outside eight
carve out oh we have to do Norm out uh
is it normal just to normalize
that's a normalized all right cool
yeah uh shortcuts are usually added from
the down sampling Resonance of the
encoder to the option of the Resonance
of the decoder yeah but those are uh
that's all in the unit we're not in the
unit yet we're still in the auto encoder
okay the only thing I still have to do
is this attention layer
um can I use the one I've already
implemented or do I have to rewrite it I
probably have to rewrite it
see unless they happen to match up
perfectly okay Transformer block no it
doesn't match
make attention
cool
they're calms
all right well good on that
solve.q equals how to D
channels and channels
[Music]
Up Above This
normalize in channels
yeah I mean that's that's what it is but
I I got it right I just I don't know
what it stands for or anything uh and
this actually looks like the same thing
okay
attention block goes here
called attention one
block signs
cool all right that's the whole encoder
should we do the decoder too
uh
God I hate that it's like
it's like the same thing
you know they have something called op
sample all right fine
should we use the same code
I just feel like it's so similar you
know
[Music]
right
[Music]
oh see I hate this oh
[Music]
[Music]
okay what do we mess up uh decoder
that's not three that's four
uh
I also think is that three
oh it's eight yeah that's fine oh okay
I'll just write it uh
four if the code else three and this one
is uh
let's try
first stage two quarter mid block normal
I said all right
it should be flipped around
mid
block one norm.weight
that should be
oh no mid happens first
um
let's just say FD code uh
out equals
they have a name for this and then let's
just copy their name
uh block and it's called
weird it's a weird name
[Music]
[Music]
and where's my food
encoder mid block weight
uh okay we're in the encoder
can I mess this up
is it always 5 12 I might always be 5
12.
[Music]
yeah this mid happens first
what
up zero block normal one way that
doesn't make sense
doesn't make sense
especially since normalizes in channels
like a lock
oh so the network and network paper I
say
uh
uh weird
how does that go to 2v6 there how is
that 256
does that not make sense to anyone else
oh are the blocks backwards do I not
even need to do this
ah I'm sorry
oh no
[Music]
it's not right either
maybe you have to write them explicitly
[Music]
are these sizes in the decoder that's
right
the decoder looks like it goes from 128
to 256.
and up zero
and then it goes from
256 to 512 and up one
then it goes from 512 to 512 and double
no I didn't re-enable it did I
wrong
uh
uh conv in is wrong okay I mean fine
click decode helps
should I written it as two things
would have been a lot easier just write
this as two things
oh the Norms are
why is the norm matte
just do it the other way around it seems
like it happens after the calm and then
in this res block it happens before the
conf
ER oh all right
it's annoying
oh
sorry thank you
oh you need a picture
foreign
foreign
foreign
foreign
foreign
avocado toast
oh in the wrong category oh well
does it matter
however you wish we got
um
all right we'll write the decoder as a
separate thing
[Music]
[Music]
[Music]
[Music]
I regret trying to write it as one thing
oh no I deleted size
sorry I regret trying to write it as one
thing I made terrible mistakes
it was such a mistake
but we have avocado toast now so the
world is getting better
place
but you have to make it that way
you find home will make it more than
just a shelter
if everyone belongs here
she can hold ourselves together
you're afraid to die then so mine
[Music]
[Music]
foreign
[Music]
[Music]
let's first get the encoder working
again that's not a three
and Coda works just gotta fix the
decoder
um
foreign
um
I see
so is this actually how it works
oh
kind of annoying way to write this
foreign
ah
coder hot flop comp one
meow
okay it must be even enormous order them
what am I doing wrong
the resident block clearly isn't that
but the Norm Norm one
needs to be that
Norm one is in channels
I don't get
this out oh this is out channels
okay now we've moved on to the next one
we got through the first one I don't
understand what I'm doing wrong
I don't really understand what's going
on
these shapes don't really make sense
okay
foreign
it says it's 128 but it's 256.
Norm one
oh
no
we're still not zero so maybe it's this
which would actually make more sense and
would correspond with this I don't know
so maybe it actually is the same
no because that's got to be 256.
what
up zero block Norm one weight
because of the concatenation
which can oh
but this is how you learn
foreign
guys I don't really understand what 10B
channels is either
I've never seen that
okay
here's the decoder
block one Norm bias
5 12.
Okay so
has this even
if that's 512
how does this work
because I put in 128 256 there
foreign
did I switch it somehow
that's mid
okay so mid is mid is right
now we get to up zero and this Norm bias
is 256 128.
okay this one is somehow 128.
or no sorry this is 120. I don't get
this
I must be missing something stupid
I'm up zero we're still on the first up
okay
okay that's a different problem
foreign
hmm the avocado sauce wasn't bad let's
try and answer any ball
um all right this should be 26 512.
great we're getting close
foreign
now the only problem is on Norm out
which
should not be that
I don't know how any of his runs we're
just trying to make it load okay fine
decoder loads now
um
we don't have quadcom and post quantcom
we're gonna have to add those
and I think that's it for the auto
encoder you just have to add those two
someone told me once that acai was a
superfood
because superfood is but doesn't it make
you want to buy it
well
or time stamp and betting
AGI fire alarm all right
um that was going on okay
foreign
okay
so all we've written so far is the
loading I'm going to commit this you
guys can read
superfood is a marketing term it doesn't
really mean anything
um
stable diffusion
um okay let's write some code
so when you're implementing things in
tiny grad or Pi torch
you're right you're a knit which
specifies all the weights and then you
write your forward which talks about how
to actually uh
compute these things
so um we'll start down here forward here
and we're just going to say self.
X
um
here I just want to run the auto encoder
so I want to say something like uh
latent equals self dot encoder X
stop God
coder
turn
I think we have to save this
[Music]
oh I don't have to implement the encoder
not so easy
let's look at their forward
um okay
oh you're right temp B is timestampatic
whoever said that you are good
um
self.com then X
it's like a lot of stuff
okay they use swish cool
foreign
[Music]
this looks needlessly complicated uh for
x and salt but down uh we'll say for
Allen X
um what if we have something called down
sample
oh it runs it afterward okay
um or B and also block
[Music]
then we have to do the mids
um
[Music]
um
cool
something like that
decoder
all right so we do come in first
um then we do the mids
[Music]
uh then we do this imagine we do up
sampling
first
let me do the same thing here
cool
uh we need to put in wherever those
Quant columns are
all right that's just at the end of the
encoder
uh yes
very cool uh latent equals self dot
Quantum links
any bugs no bugs yeah
um all right
uh
should we load up our
foreign
[Music]
[Music]
foreign
foreign
what
that is how I use tiny grad right
permute
I have to say order equals
shouldn't I don't like that
um
[Music]
foreign
foreign
[Music]
cool
I know we have the right shape
let's put them on see what happens
[Music]
honey ground is so pleasant to work in
oh
um I forgot about this
if you want to call things forward
differs a little from pie torch
in pie torch you can just call it
because it's a subclass
[Music]
um
you know our stuff it's not a sunglass
actually we shouldn't call it forward we
should why we call it forward we should
just call it call
this is the tiny gratic way to do it
don't have a special function called
forward which you then put we are three
million lines of syntactic sugar around
just call
and I'm probably gonna realize that what
I'm saying is wrong
oh okay whereas in a block object it's
not called
see if you didn't write it
[Music]
[Music]
[Music]
foreign
pie torch tiny grab
foreign
this just tastes like sugar
that's how he's just Sugar Man
foreign
um okay we put weird padding there I
don't know that's right
it's probably a fun time you ready
debug equals one didn't work
in potential shape does not match the
weight of the
hmm
in potential shape does not match the
shape of the weights
have my tensor get so big
um
what did I do wrong
well we are in the encoder or the
decoder
probably still in the encoder
or clearly van Carter because it says my
name Carter I'll just add print X.J
all right
um
these comms probably also have padding
but I didn't do but I don't think that's
a problem
foreign
to have the same input shape as output
shape you've got to have a padding
include one
uh wow never mind we get stupid comments
when we uh when we turn off subscribers
nope what Mac am I using who said I'm
using a Mac bro I'm using Hackintosh bro
install Hackintosh and this is probably
normal
waste your time I just don't even know
what size
um
input tensor does not match the shape of
the weights
foreign
shape should be that's not bad
I mean maybe
I'm reluctant to believe that because
everything loaded okay
but you're right there is a problem
there
oh
I mean actually obviously if that's how
I implement it but
no never mind we just wrote the wrong
thing sorry
it's a shortcut right we know what that
is
yeah return X Plus H okay great uh what
is that H equals x h
h
[Music]
return yeah
foreign
tensor object has no mid okay okay
let's see where you're coming from I see
where you're coming from and I'm gonna
do South like that again
[Music]
attention blocks not callable okay well
it's because we didn't write it
[Music]
oh setups bro set up
one of these days
I'm gonna make keyboards and I'm gonna
rip you all off
one of these days
okay
oh we're in the decoder all right that's
pretty good
uh probably because we have to run them
backwards
all right
I don't get it though that should be
right
foreign
cool you ran let's see what our output
looks like boys that was so easy boys
are we deep learning Junior social what
no
wait
for forward pass the vector quantizer
after the unit is a bit oh yeah I see I
mean we'll deal with that later let's
get the shapes right first uh okay well
maybe we're not deep learning Geniuses
because that is not the right shape
it is somehow four by four
and then when I said we were deep
learning Geniuses I lied
it's getting smaller that shouldn't be
true
it should be getting bigger
I think it's because I wrote up sample
wrong I don't think up sample has a
stride of two that doesn't make any
sense it's going to be a down sample
up block up retention up sample
oh no I don't know how to write that
foreign
s definitely don't have a stride
but you always see these up sample
columns they're padding one
foreign
ization or something I don't know
that might only matter for training
[Music]
okay
um we have to write
torch interpolite
I don't want any more of his assets I'm
going to throw it out so I don't need
more of it because it's just sugar
how do we sell people sugar and tell
them that it's a superfood
answer acai evil
look George you make choices in your
life like order organized how you both
you don't have to make that choice
I do though I do
I have my dad an iPhone I got my dad an
iPhone and he's like looking at the
phone and like installing apps he's like
I feel like every one of these things is
subtly trying to manipulate me
I don't like it I don't like that
feeling and I'm like you know it's true
man it's true no I'll try to manipulate
you
you're welcome thank you for subscribing
um
okay torch and then functional
interpolate
see how to write this
thing down
so she looks like it just repeats the
things which is fine
um examples
oh up sample here
okay how do I write this in tiny grad
um
I'll repeat it so
let's see
x dot reshape
uh
Xbox
one shade x sub two shape one x sub
three shape one
uh expand
and just once to twos
assert all is instance
oh
that's not right
I'll explain that bug
[Music]
[Music]
foreign
okay uh that size is wrong because I
probably don't actually have up samples
in all of them
I probably don't have enough sample in
the first one
let's take a look
decoder up zero up one up two up three
no no sorry that's just not right up
sample
doing one too many off samples okay I
only have three of them actually I
wanted the first one
[Music]
all right see if the shape is right
okay uh let's save the image uh x dot
numpy which actually does the run and
then we want to save the image
um Hill save numpy array
oh actually let's
um let's first permute this uh
okay we have well let's just print that
first
no
oh it's actually running oh it's really
slow oh it's terrible
oh man that takes forever why doesn't
debug equals one print stuff for me
though
still doing the first convolution
oh that's terrible
guys it's so slow
no
let's commit that did I break the test
by chance
[Music]
crap I did
when I go
uh
oh GC broke what
um I broke the tests
too many indices for right oh
yeah yeah yeah yeah I have to do that in
both places remember that stupid thing I
wrote
um
cool
[Music]
classes hopefully more stable diffusion
well so if it's just really the First
Column being slow
uh here let's see GP equals one
no running on the GPU oh here we go
great things are going
oh man this is so slow
look at how many gigaflops it is
and crank up opt is opt by default not
big
crank about
the forward method of Lies the
quantization Great
all right guys this computer's slow
you think tiny grad's fast but it didn't
actually run
brutal brutal look at how slow this is
all these convolutions are massive
okay uh maybe we don't even have to do
this much
everywhere we're going overboard
by trying to uh
well if we just run the decoder we
should be able to
sample randomly right
um we'll say x equals answer dot uniform
one
x equals model Dot
for stage model dot d coder
yeah enlightened
wow why is this so slow
is it because I have bugs or is it just
because it's slow
and we can try this too I have another
running node called opencl
I think it's faster
this is what uh
people object cannot be interpreted as
an integer
well that's faster
that was faster right up until that
it's a lot faster actually
it's also not loading the real weights
do I have an FAQ section you think I
stream for you that's the problem
that guy I do it to like for my ego or
something I don't even know man
why didn't I print the fucking shape
though
I'm like really though I told you to
print the shape you didn't listen to me
oh because it did print the shape oh
great because it hasn't actually done
any processing yet okay
you can actually do all this still in uh
wait a second
that didn't do what I wanted to do but
that's fine
foreign
about me wanting to be famous it just
kind of keeps me working you know I
don't lie in bed I got to put clothes on
you know
these things are hard
um
pills save numb Thai Iraq
there we go
foreign
okay
oh I see we're in just chatting can I
change that while I'm uh streaming let
me see
yeah okay cool we'll change it to
programming
science let's change it to Science and
Technology
on the IRL is locked even though we're
not IRL
cool changed cannot handle this data
type
fuck man
okay
good Kiara
um
pill needs uins to save
organic humans
all right it's a little bit not as
horrendously slow now it's still
horrendously slow but it's a little bit
less horrendously slow
the other columns are fast it's just
doing some error
there's two there's two implementations
that use the GPU there's GPU and there's
opencl
um try software and game development
category
yeah yeah yeah I'm sure we can use MPS
to speed up things but then we wouldn't
be using tiny grad and we'd be defeating
the whole point of this stream all right
guys you ready to see the picture you
ready
who's excited about the picture
[Music]
oh yeah
black Square bro bro I'm gonna post it
on Instagram solidarity Man black Square
all right all right all right all right
let's try times again by 256. sometimes
black is just
means you didn't times it by 256. sorry
all right we're going this is gonna be
better all right we also might have to
actually write the norm and the
attention because they might have to do
something you see my two-do's we have to
Do's okay
we probably need the norm all right
group Norm how do I write group Norm
that's what there's nothing in the text
prompt yes bro that's my problem
[Music]
nft bro first thing generated by tiny
diffusion
all right all right take two take two oh
okay that's Ted two all right we got a
right group Norm I think I've got the
problem
what is group Norm again
zero
gosh I got one called real
real
how do you make pink lemonade pink
lemons
[Music]
if not real
exit
zero
did I mean to use x and H
yeah I did that right
what if I want to check I want to check
something oh yeah my norms
okay
what is group Norm
I have layer Norm here
uh it's like something like this
Groove Norm divides the channels in
multiple sizes of okay fine
yeah yeah yeah yeah yeah uh group Norm
divides the channels in multiple sizes
of those
okay so layer Norms like that and crypto
numbers like that
um okay so we want to do something like
x dot reshape
x uh x dot shapes of zero uh num groups
x dot shape so divided by number groups
of two X Plus shapes of three
[Music]
self.m groups
all right
um now we want to do
we want to compute x dot mean
uh on access
two three and four
so keep dim equals true x equals x minus
tracks
where did Y come from
standard deviation
same access
yes
that seems right cool so it's like the
same as group layer normal just has a
reshape beforehand
uh
soft I mean
x equals minus one is that really right
I don't think that's right
okay that's fine divides the standard
deviation return x dot reshape x dot
shapes of zero
x dot shapes and one times Xbox two Xbox
360.
turn to all the shape
does that work
cannot reshape
why can't you reshape
sad I ask you nicely
it's the one that doesn't work
okay
oh what
shapes of one
okay cool
uh
we wrote that we also have to write
attention
oh you guys want to see a graph we can
look at a graph too we can make our
graph if I hit graph
with my opt go
oh just added a lot of operation to the
stupid lead for the uh
you got so slow
should we SSH over to quiet quiet's fast
all right come on come on come on
picture picture picture picture
oh guys I'm not just trolling you ready
I'll show you the graph too we'll
generate a graph
you guys you ready to see the picture
who's ready I'm not it's not black I
swear I swear I swear I swear you know
I'm not fucking with you it's not white
either
what do you think
what do you think guys
that kind of looks like art I think it's
art
who else agrees with me that it's art
it's pretty crazy man
dude wait I could sell that nft for like
an eat bro is anyone still buying nfts
oh no module named pie dot oh
then we can look at a graph
oh what happened oh this is the new one
oh it updated oh that art does not look
as good
all right well maybe this is what
happens when we don't write attention so
let's write attention let's see
foreign
we can make a whole series of these nfts
all right okay this is the graph
so this is what actually running that uh
the decoder looks like
you can see
uh so it's not using convolutions these
are actually just reduces
these are skip connections so those are
probably a bunch of res blocks
these are the normalizations you can see
that's the mean that's the variance
that's what's actually Computing at
yeah
I really understand why that wasn't
folded into there probably should have
been
same thing with that should be folded
I don't know
okay
um let's write attention
I'm pretty sure I wrote that right right
it's going to broadcast
let's see what the attention is
called H bar
what's bmm
batch Matrix Matrix
I think I can just do Matt Maul and uh
that just works in tiny guy I think
why does it have to eat it
fine
again simpler and Tiny grad we can just
say w underscore Dot softmax
pretty sure it takes a uh
dim argument but let's just double check
doesn't
go but it's still right
you know it doesn't take anymore that's
still right it's just that
um
give credit where credit's due
10 values
foreign
[Music]
foreign
okay that's fine it is it is actually a
h bar
[Music]
oh
I kind of like the other way
should we should we just fix it to take
both that's a vehicle fixing tiny grab
all right cool where's my uh shape okay
uh
that's all kind of annoying
I don't know we should make it take both
but it doesn't look easy to do right now
okay
well it computed let's see what it looks
like with a tension
let's see also if we fix the test and
tiny red I hate when I break them
oh I love that check mark
what how did that get changed
we use your desk
it looks the same
all right so how many bajillions of
mistakes did we make
uniform is what I think it is right
computer random uniform oh no in uniform
is not what I want
uh
uh I want a gaussian
yeah random is what I want not uniform
and post Quant conf might matter
these things
yeah okay we should run it
we'll see what this image looks like
first but maybe we need that one cop
uh we probably made so many mistakes
increase that one comp does something
I mean I doubt it but
do we do the up sampler right I think we
did
yeah that's right
now we do the columns
we wrote a normalization oh we didn't do
the weights in the bias here okay
that's a bug
we're still getting credit looks like
that the way to the bias might matter
though
um
okay let's look up torch layer norm and
see which order we do these things on
we have an element wise alphon in here
okay
multiply by Sigma what is e is this is
this the mean
uh
all right now let's copy that from batch
Norm
Ally
okay so we have to do
self dot weight dot reshape uh one
uh
hmm
up up it looks different
it looks different have you heard of an
ad for fire Festival boom
what do y'all think
is it r
is it art can anybody tell me is this
art I I yeah
we'll post the orange Square
can anyone tell you if it's not art I
mean that's a good question right
foreign
let's just put in like bigger numbers
sometimes bigger numbers fix things
what other bugs did we write
did I think about deep learning is not
like cryptography if you get it kind of
close I mean okay if there's upside the
downsides to this if you get it kind of
close it works kind of
this
held for bullying what
are we bullying this guy's a brilliant
artist just like me
oh oh oh oh oh oh
a blue square
all right I mean it's nice that we're
doing all this computation and we get a
blue square don't you think
post Quant com
es oh we have to go to each one of these
things individually now and find out
where the bugs are you know
sounds terribly boring
it is how you learn though
if you don't need this
foreign
foreign
a ton of things that can be wrong here
let's look at my Transformer and see if
I did soft Max the same way
[Music]
right
that's just dot that's right query dot
key times that
fine fine fine
[Music]
self.norm there
do we have any uh
let's just look did I forget activations
I know I'm linearity as I call them
I put those ones in uh we're not using
time step
I think I put that one in
that's in decoder
our mouth swash or mouth swash I did
that
all right
um we're loading the weights
forget any did I
post conf pre-conf
uh
that shouldn't be wrong
anyway I'm kind of curious why this
isn't doesn't work
look how fast that is
like this
it's so close
he's so fast
get that error oh should we try it on a
different computer I was gonna like to
open the pictures
that slow
okay lots of norms decodes
position IDs
foreign
all right
single colored Square
[Music]
try this
try the whole thing again
it's possible just the inputs I'm
putting in aren't good
foreign
foreign
foreign
should we uh
load the model in pi torch
and then start comparing it oh this
sounds so painful guys
oh I'm gonna have to go to layer wait oh
this finished
but did I did I forget did I run this
sorry distraction
it doesn't matter what I put in there if
that really was correct
like that's running the encoder and the
decoder on an image which generates
something similar there's clearly bugs
I mean like no shit there's books
we're gonna have to load this in pie
torch
did I really expect that we get all this
complicated stuff right on the first try
no I didn't and we need more coffee
we'll let non-subscribers talk and
tell me your feelings
I'm a mess
you're scared what are you scared of man
global warming you should be because
it's real
would be weird
no it doesn't matter look we're getting
green squares
oh man it was even it even looked cooler
before it just generated stupid squares
I don't know maybe we should just like
run a little bit of the model and see
what we got
is it better than Dolly well it
generates single colored squares
so if you're interested in single
colored squares it's better than dolly
foreign
I mean the shapes can't be wrong so it
just has to be my forward that's wrong
and it's just in the decoder so let's
read the decoder code oh don't make me
do it I know how to do this properly but
I don't want to do it properly it's
going to take forever
all right convin we do the mid blocks
that's great code none great okay
um
we run them in reverse
we run the blocks
if the blocks do have something called a
tension we run it but I don't think they
do because I would have seen it
and then
we run up sample
um then
oh
guys we forgot stuff no never mind I was
excited but it's actually all here then
we run the norm out then we run the
non-linearity then we run the compound
and I don't think we're running 10 each
out
we're definitely not
foreign
it's all fast until that one how many
gigaflops okay
yeah maybe I could write a check at
which Step okay that sounds like a plan
um
well part of the problem with that is
let's just try that
no sorry
all right that looks decent
uh where's the D cover
I wonder if we need a fancy check for
that let's just print it
uh print x dot numpy
okay that doesn't look the same color
yet
that's the same color mostly
they all have the same number
yeah okay
okay
look okay there
is my up sample broken
up sampler latent rescaler no they don't
even use this they just use torsion
turbulate
scale factor mode nearest
with conf
rerun it it has the right kernel size
um
oh I could have made any one of a
billion bugs
yeah I know I'm
God versus the torch version yeah
annoying
it sounds annoying you know
I just wanted to write it and not write
any bugs but you know if we wrote bugs
maybe we should just give up because
there's bugs
in a way like it has like a weird
attention type or something right
thank you
double z
Nom res blocks
no drop out
no loss
oh all right all right all right
guys I want to cry
doesn't want to do this me
foreign
finally
[Music]
uh OKAY Model Auto encoder KL do I have
to have to give this parameters to my
God
DD config loss config embed dim
does it mean that's even right
some different there's some example to
show me how to do this
yeah this is like oh well you have to
use the other weight format
there's your shit and tell me I have to
use the other weight format
please just work
please bro
please just work bro
[Music]
bro you wanna just work
let's see I gotta pass in complex stuff
I hate like all these repos that do this
foreign
[Music]
right there
or should I try this hugging face one
then it won't be the same
missing one required to embed them
that dim equals four
encoder in it missing six required
keyword arguments
great
isn't this so much fun guys
kids you could get into computers
you could get into computers and you
could sit here and just just do this all
day no
don't you have a fulfilling life
[Music]
foreign
it's not good
do you know co-pilot is good if you're
an idiot and you're writing like
like uh well I need for a client to
write a react app which when I click a
button it uh shows an ad
I need something called Target
[Music]
great okay uh did it actually load this
from the thing
says it did I don't know if I believe it
torch.randan
all right the same thing in torch let's
see what we got if we get something
different
fucking
[Music]
foreign
stands for it stands for torch
we're just checking how much progress we
made none man none
oh look how slow my computer is
I'm gonna use detach all right
all right let's see your Torx looks
better
does it look better let's find out
oh yo I'm kind of excited all right
let's see let's see let's see let's see
yo guys
torch
foreign
color
intricacy of the noise man it wants to
see
it wants to see oh all right
um
well
foreign
this by uh
I don't know if I have to divide this by
36.
interesting
that's an interesting vlog
diagonal gaussian distribution has no
object shape
I mean that seems possible
I wouldn't expect a diagonal gaussian
distribution
sample posterior okay
Tuple oh it Returns the posterior as
well
well we don't want to do that
it's interesting about that everything's
a posterior actually
save it and then use it to generate
something where you like so what I'm
doing now is I'm putting the real image
into Pi torch and we're going to see if
we get the uh the real image back out
and then if we get the real image back
out we'll save the uh we'll save the
latents and then we'll feed the latents
in one little thingy at a time and uh
oh man
look at that noise
wait I got a question maybe I don't want
to multiply it
I got a question
or maybe they're just not images and
we're just not doing it right
oh yo
look at that image
looks stupider
I don't know if you don't want to divide
that either
I got a question
well guys
this is pie torch and it doesn't work
all right maybe I'll do something else
to normalize it
um
Works in tensorflow
is it trained
that's actually a good question maybe
it's not
I'm setting checkpoint path here but
it's possible it's just not loading from
it because it doesn't match
I think you're right
yeah I think it actually doesn't have
the weights
[Music]
all right torch download uh
[Music]
foreign
foreign
actually there's a simpler way to do
this
well maybe not
I can just create something
[Music]
key model download state
to get SD strict if it's true
it's possible that there's nothing is
getting loaded so I don't know
all right and this seems better
unless SD has no length
cannot handle this data type
uh oh
I'm coming that out too me too
yeah we're just using the decoder
um we can use both too but I'll say come
on come on come on come on whoa
I don't know if that's better or worse
I just have no idea
guys I want to stop streaming because I
want to listen to copyrighted music
um
where's my airpods at
I can listen to copyrighted music you
can't
foreign
I knew it was copyrighted music boys
oh look at that I got a question
and we're sampling from a gaussian
distribution oh no I tried dividing by
uh
yay we'll see maybe I fix that clipping
I don't know we'll see
that's not going to fix the clapping
oh maybe it will I don't know
good enough
that looks pretty legit
uh all right
okay just to show you guys what the uh
before and after looks like before after
it's pretty good
if we could make a tiny guy look that
good I'd be very happy
um this is returning let's let's just
dive in here a little bit uh and not use
the whole T model
uh
T model Dot and code
foreign
until we decode it and we get the same
thing out
okay
um x equals uh
T model dot decode Z now remember this
is not actually with tiny grab this is
with torch and we're cheaters and should
feel bad about ourselves okay
um let's see
I didn't mean that I meant shape
we got our Apple still
foreign
oh
I say okay you found it it's this
what I have to do divide by two
plus 0.05
foreign
by 256 and then they round
am I doing this from scratch no no this
is torch this is torch
uh what's the input is the input the
same do I have to do the same thing or
does it matter
foreign
[Music]
X clamp zero one oh is that really
okay fine we'll clamp it
I don't know
I don't like this either but I think
actually this might just be this might
be simple enough it might just be able
to say clam01 like that let's try it
uh
but good either way we have a z Vector
that I'm happy with and we can just feed
that Z Vector in on and one at a time
match our layers get them to match and
then decode an apple and then encode an
apple and then uh you know we
implemented most of the thingy oh
fucking equipment
work or something like no clip is one of
them you have to call like this bro from
to open this bro
um we do dot clip on a thing dot clip
um
[Music]
just use my CPU or my GPU
I don't even know just makes everything
slow
oh yeah buddy
That's What I Call well no no how do you
like damn apples
right
right
all right we clamped is everyone happy
[Music]
oh man
hey guys guys guys guys guys guys guys
guys
we're generating this with torch we're
not generating this with tiny grad we've
been nothing but script kitties we tried
to be hackers and we were just script
kitties so we got to get coffee and we
gotta do this we gotta make it work in
tiny grad when we can make apples and
Tiny grad then we can sell them to
Farmers think about it think about it
um you know all those works man listen
listen listen you don't even have to do
work anymore you can just like make
digital art and sell it on the Block hey
no you can't it's the future but two
years ago that idea sounded smart man
foreign
foreign
no no we don't have apple we don't have
apple no this is a fake Apple this is a
torch Apple I'll show you what a tiny
grad apple looks like and it does not
look that beautiful it does not I'll
warn you all right I'll tell you now
all right um
our mp.save okay just do this
um
let's just save it in like
temp apple.mpz
[Music]
does that work
s dot tensor and z
can I call numpy tension that requires
grad man I hate you torch we don't make
things faster
get disabled grad
contacts my phone
I don't know that was too much effort no
it's not what I wanted
dyslexia brows
one of these streams of 10 million
viewers literally I use torch guys we're
gonna get that same apple and Tiny grad
after two more hours of work don't you
love computers they're super rewarding
and fulfilling
um
all right let's just copy it here to
examples
uh
data data sets stable diffusionapple.mpy
um
mz.mp.load
datasetsats.stable diffusionapple.mpy
foreign
now we're loading the Apple from disk
script Kitty gang bro
let's see if we still have an apple
do we still have an apple
we do
go where wait you guys want to do
something crazy what happens if we like
make a negative Apple
[Laughter]
[Music]
yo we just made a negative Apple let's
divide by Apple we can also try the
reciprocal of an apple
all right let's go let's go let's go
let's go
a negative apple is less cool than you
might think
okay okay okay
five times Apple this has to be cool
no one to any power is one so
even to the Apple power you think it's
gonna make the Apple like five times
bigger
dude that's five times Apple that kind
of makes sense
who likes five times Apple
who's ready to go through very painfully
and figure out where we differ from pie
torch I'm so excited for this you know
I love tediously going through things
so we have nzt which equals
uh
torch
tensor and z and then we have nzg which
equals
tensor and G from Tiny grad
so now let's try uh T model dot decode
oh no T model dot post Quant conf mzt
okay
let's call This One X torch
X tiny
we're gonna give these better names
uh X torch
tiny
are we messing up at the first
convolution
oh this model here we actually do all
the small light
your model
post Quant called X timing
print next torch
next time
[Music]
are they the same let's find out
and now we're going to do dot numpy on
both of them and then it's going to
bitch at me and be like maybe I can't do
that unless you detach the torch
tiny grad has no such problems
stable diffusion object has no such all
right fine
uh
because it's the auto encoder what
oh it says I can't do model.post Quantum
I have to do model DOT first stage model
Dot postcode.com
let's tediously find out where we made a
mistake
okay well the first curve doesn't even
match so uh there's that
despite being the same size
we loaded the weights in here
we loaded the weights in here we did set
real equal to one you know
well it's not shame It's Magic shape's
fine
all right well you know what let's start
with this
[Music]
okay that works
now we do one convolution
and it's wrong all right
well good to know we don't have anything
working at all
at all it's always better than
something's working of course when you
don't have anything working at all you
probably made some dumb mistake
oh
like you mean like not assigning the
items
you mean like literally just not assign
any items at all
well we didn't put any weights in so um
yeah cool uh nice
uh if W's not non assert that
is so stupid all right W equals no
there's like a way I do this
all right well we didn't put the weights
in so that was good
we learned it's a sign here we go
uh w dot assign B
to create a tensor
okay that looks pretty good
this is how I put them
okay that's the mean now we're off by
only negative bajillion eight
um
should we just YOLO and see maybe it
works
okay
tiny grad Apple let's go
oh trying to get too slow
pretty much make it faster
I don't want to sit here and have to
wait while it does all this every time
I don't know there's gonna be more bugs
it's just gonna just gonna output is
stupid I already know it's not gonna be
good
foreign okay even dumber than I thought
yeah it's because we don't have the here
we go
oh I'm sick of waiting for this
whoa
okay well
that looks a whole lot better
it's like you can almost see how it
wants to be an apple
you know
and that's generated with tiny grad
all right but it's not good enough
we are not done until we get a beautiful
tiny grad Apple
foreign
should we make it out to be fast too I'm
upset at how slow it is
computer
it's definitely on a computer
all right
back to subscriber only chat
post Qualcomm great decoder
let's go in here to decoder
tmodel.coder.com
tiny
model Dot
first stage model Dot decoder.com
we should actually probably say
something like Z Model equals model
first age model
[Music]
does that match
okay that match is still
um block one
got mid dot block one
uh
got mid sub block one
I see I have to put in a 10B for the
torch
oh okay we found where it broke
it blocked one
all right let's dive into block one boys
let's Dive In
what's the first thing we do we do a
norm let's do a norm
Dot
Norm one dot normal
oh my
okay the norm is okay
is the non-linearity okay
the probability
okay we know the block doesn't work
[Music]
oh
Norm
non-linearity calm
the dropout's fake
it's even North is the only thing I
figured I would have messed up there
I must have messed something else up
let's read it
resnet block uh
Norm
swish I mean monology is that right I
didn't like mess up my swish did I
swoosh sometimes let's have a signal
that's right
Norm non-linearity cough
something we don't care about because
it's zero
Norm non-linearity Dropout which is also
zero conf
and then
either a conv there or an empty
it's just Lambda X X plus h
okay that seems right
um let's switch them both
just in case I somehow messed up switch
torch equals x torque times
torch.sigmoid
torch
I equals x tiny dot switch
what
that doesn't make sense
oh I guess we're gonna do the block oops
[Music]
okay still small I can't have one
huh okay the carve is wrong
kernel size stride padding
here we are in the resnet
kernel size is three
padding
as a bass
has padding
let's try it as one
hmm
okay
why is this convolution wrong
the other convolution right
foreign
by the way is there a way in Python to
make that work like with a dictionary
name Tuple or something
388 minus two three eight minus two it
definitely loaded
huh
okay
um
it's pretty safe here let's try CPU
equals one just make sure we didn't
somehow it's not some bug and Tiny
around
wait what no no
there's a bug in tiny grad
yo
there's a bug in tiny grad
all right well it's good that we found
it
damn it
and here I thought my tiny grad tests
were all really good
oh okay
look if I said opencl to what it works
there's a bug in the GPU implementation
of tiny grad
because I removed convolutions Maybe
understand how that wasn't well tested
so it looks like some newly introduced
regression right
this is the GPU test suite for tiny grad
yeah we will make a test
probably more than one bug yeah I mean I
agree
you can utilizers.c or make a class yeah
I don't want to do any of that
maybe I should make a class actually
that's probably a better way to do it
yeah
foreign
[Music]
like this
I don't know this doesn't matter let me
visit dictionary for now
um
okay well
turn the optimizer off and see if that
fixes things
oh an invalid buffer size
my focus is too large
is number too big
okay I mean what's crazy also is if I
say uh open CL equals one
it doesn't have the buck
which is using a lot of the same code AS
GPU
for just one part it's not using
okay
um let's
come let's add a test
uh what's this conf
foreign
okay so in general good programming
practice is when you find something that
fails
uh you make a test
foreign
no I'm sorry
oh yeah okay cool
um
so here we are in test Ops
we'll call it
test SD big com
so we have helper test stop here
sizes are I mean I'm going to assume
it's size related
um
it's like 64.64.
uh
Lambda x w
just torch functional com 2D
up here x
for the this one I can just say x.com
[Music]
test SB VidCon
[Music]
foreign
location mismatch
cool
it's not even that big of a conf
lict there's just a crappy Mac GPU isn't
it
foreign
okay so this is the program that's
actually running
uh is it possible we're overflowing
the image
it's mid
oh
okay we found the problem
we are overflowing an INT
God that's some bullshit
foreign
oh you're right
that's not the right kind of size at all
but it's interesting that that fails
anyway okay good point
uh
good point
sorry I read the sizes and then I just
didn't do it
this should actually be well actually I
think maybe just get away with one here
if this just fails it's good enough
yeah okay fine great
actually that's close
that's a different error
cool uh well that fails and that fails
in a more similar way to this way
this is actually a really complex thing
though
you see the problem it's this
how slow is it going to make my GPU if I
start using uh
and there's just over four like the
virtual tensors that are created when
you do a convolution are more than four
million big
this matter
that passes all right
yeah it's opencl but you see the problem
it's obvious what the problem is
this virtual tensor
let's do a product on it
this isn't python boys
this is not a land where you can just
sit around and
you know make unicorns into numbers that
are big
um
I mean of course you can adapt this
stuff once you get into gigaflops
all right
oh I don't even know how to fix this
you win 64 clu long
all those things sound so slow
foreign
[Music]
there
these are the data types available in
the opencl programming language
huh
in the openclc programming language okay
well fine
[Music]
foreign
now we waited a long time and got the
wrong answer
gotta love that
foreign
because they're integers by default
foreign
I hate this
and it's really slow
[Music]
I mean this is one of the problems with
like doing this
so I removed the calves
from the GPU
uh stuff like there's no more
convolutions
how about using 2D or 3D kernels
we could
see the thing is none of the buffers are
actually that big
oh well maybe it's easier to just focus
on the opencl one
uh let's add an assertion for when this
won't work
[Music]
[Music]
foreign
the tensor isn't actually that big
foreign
[Music]
[Music]
[Music]
foreign
handle this uh
Pi torch does things very differently
from Tiny grad with this stuff
maybe we should focus more on why opencl
doesn't work
so let's see how it works okay to there
it's a lot faster too so we might just
be able to fix this and then we'll get
speed
and we'll get opencl is just like it's
another back end for tiny grad
we also have the CPU backend
we shouldn't have any of these problems
either
okay so that's running all of block one
and it still matches
[Music]
um
let's remove that exit and see if we can
actually Jack something
oh
foreign
so maybe I'll make you happy
just nice how fast
these things have shot
I'm gonna try to zero for all those
aren't I
Ops counter's broken
I don't think that's degenerate I think
that's actually just
okay
this is the problematic reshape here
see where we are in the thing
it's actually not that easy
it's all lazy
um
[Music]
foreign
so like the very last thing that it
can't do
because if that's true then we could
just go to the CPU
you think call that stuff still works
CPU very slow
remember the other ones don't have this
problem
all right I'm turning on Q
Hello Alex
you still screaming yeah you're on
stream
I ordered
after avocado toast and acai Bowl but it
just tasted like sugar
I don't know
I don't like sugar
yeah
something else
what are my options
woman Little Italy
um I can get you a burger oh it seems
heavy we can cook pastas
yeah
maybe something at the little Italian
Market that sounds nice
uh all right all right
still running the CPU Port of China grad
is insanely slow
uh let's check our gpus here and see
what our Max image sizes are
oh same crap
oh this one's bigger
oh Cuda all right let's just give it a
try
foreign
see that I don't want to control C that
that was a mistake oh I don't even have
the weights over there oh it's going to
take forever
oh
no I say real equals zero I won't try to
load the weights
God bless
why is the example not even there that
doesn't make sense
I want a branch aren't I yeah
[Music]
[Music]
hmm
I'm a Batman on this computer
Kafka on this computer
I'm not happy about this I'm not happy
about any of this
this is a very serious bug in tiny grad
and Tiny diffusion is not going to work
till we fix this serious bug
watch my poor CPU struggle
the problem is it's never actually that
big
we have to have a better understanding
of the uh
the way
is that gigabit speed
30 megabytes per second
no that's not gigabytes I don't even
know why is that so slow I'm copying a
file across a local network
oh that's fine
that's what I get for just hand coding
crap with no thought to if anybody else
can run it I'm a terrible person all
right
no more
okay now we're going to want to apply
torch crap in here and I'm never gonna
get that installed
the GPU long thing seemed kind of like
the best idea
a lot of Lux hello welcome
what we're working on is we're playing
tiny grad
and oh it finished
it's pretty fast
uh
is it an apple
yo
no fucking way
boys
first try I just I'm off by one it runs
on an Nvidia GPU it just doesn't run on
this Mac shit because it's tiny
yo
we just ran it over here on cue and it's
fast they ran in the opencl port even
oh okay well at least oh okay at least
at least we didn't waste yo that look
how fast that is
bro that's mad fast
all right
well that's pretty cool
um don't waste time running bad on a
slow ass CPU we got a 3080. yo guys this
is why Nvidia is King you know
let's open a new window here
look a tiny guy here
the 3080.
oh that was nice
okay
um let's try adding noise
so it runs fine and Tiny grab you just
have that one stupid bug we have to fix
let's make Noisy apples
Rand and got an onward keyword argument
all right
look look look you know a crack tune
have you seen the moron who stands in
front of the are there any new movies
lately in clerks you're that guy
oh yeah look it's a noisy Apple
that's what happens when we add noise
let's add 10x more noise
go I'm so happy this actually works I'm
not even cheating I don't even have the
pie torch thing installed on here
oh that's a wow that's got noisy Bros
it's had 3x more noise let's add a
reasonable amount of noise
oh
all right we got to get it working on
the Mac we got to fix the one bug look
how fast it is on that though
all right should we just try straight up
random noise
that's just straight up random noise
more noise
[Music]
it looks like very nice
huh
why do we add noise we don't have to but
if we don't have noise we just get the
same Apple every time
and as beautiful of an apple it is as it
is you might get bored looking at it
oh okay
I I'm I'm very invigorated by by that
stuff working
um let me think if there's a simple fix
for uh
let me think if there's a simple fix for
this
the opencl stuff isn't in an official
tiny grad
um let me think if there's a simple
effects
so you're in pre-processing
we reshape it to this
and this is the problem
foreign
yeah we're making stable diffusion work
in my uh custom neural network library
called tiny grad
uh
I don't really know what to do about
this is not that easy
you know what I can probably do
she is not an early code is not equal to
ACC or
see
is not none and
um
C dot i x
C dot groups times
uh C Dotson
probably my four is greater than 1684.
this should fall back to the GPU
implementation there and as long as we
don't have the limitation of the GPU
implementation
should be okay
no that shouldn't be going there
not none
or C is not none and
this stuff is greater is the stuff oh
this stuff might be going up
okay
that's 64 times 5 12.
it shouldn't be too large
there should be okay actually
get rid of that assert I don't know I
just did the assert wrong
which is weird I mean the assert was
happening before
assert C is none oh
oh because comms are no longer supported
by the GPU
but okay I mean I see why this one's a
problem right 256 times 512 divided by 4
is 32768.
okay
this is a real thing it just doesn't
support comms anymore
um
I can do this earlier actually
fix it because it might just have
it might just have problems change seed
yeah I think uh you're we're not using
it like that you can't just change the
seat bro
okay
um
foreign
no this isn't right
have to put this earlier
foreign
okay now we just hit the other problem
foreign
the worst part is it's so close
okay well wait I know what to do
this is actually pretty simple
can I split it into two
I might have to deal with issues of the
boundary
yeah okay hang on hang on hang on
[Music]
let's think this throw
if
you just split the Conch
ah
I should just be able to divide
CN right
[Music]
let's just write hacks more for now
[Music]
if you copy the count of args I do this
in pre-processing
to go there
[Music]
we'll just split the column in half
right
foreign
foreign
[Music]
that works right
we'll even do it recursively
uh lazy buffer object is not
subscriptable okay
um it's because we have to do slice
foreign
[Music]
[Music]
if a carve doesn't fit cut it in half
foreign
foreign
just re-enter this with different
converges
I'll actually do that recursively it's
slightly wrong still though
if it's not visible
oh okay I can't reshape
um
putting in half there right
instead of splitting it in two you could
do a dispatch per yeah but that's mad
slow bro
well splitting in half as fast
this is actually going to run fast too
I'm fixing the speed too
okay that's fine
uh it just can't reshape this for some
reason why not
foreign
[Music]
and we've got to divide the input too
right
[Music]
sorry it's over both we can clean it up
um
hmm
doing error
the later hour it seems like which is
weird
well yeah but it'll recursively split it
in half read the code bro
if you guys didn't think about that
oh uh it's because we didn't change IX
if an IX isn't
unless CN is changing
uh
we'll have the assertion back
[Music]
[Music]
hmm
what was the output a problem
[Music]
[Music]
yeah okay another problem might just be
the output
okay
I'm not happy about this
foreign
like you know like this because this
isn't this is wrong too if I fixed the
input but the output's just wrong
okay this is a bad idea
I know it's using MTL textures can I use
MTL buffers I mean yes but
now not
not easily
this this this whole path is set up to
use uh
to use uh these textures you only so
this is the same path that's used in
open pilot and on open pilot you have to
use textures because buffers aren't
cached
I don't think
I don't know I'm kind of back to the
idea of trying to use longs
or refactor the shape tracker such that
this stuff's all not a problem which is
the real solution to this I mean this is
the real solution to speed
oh I don't know
should we work on the raw CPU ones raw
CPU will be fast
uh no there's other issues it's not just
that
I mean I don't know we made it work
we got to fix that bug in tiny rad
both the GPU implementation and the
opencl implementation have limitations
on the maximum size of the tensors and
of course uh
foreign
being huge means it doesn't fit
I mean that yeah that change would
require a pretty large uh
refactor
um
maybe optimize the size of stable
diffusion
but then we wouldn't be running stable
diffusion anymore now would we
um
well okay so like we have a few choices
oh there's actually one more back end
that uh that uh
that tiny grab supports
that we haven't been trying
it's called torch
it might be fast
at least fast enough to run
so tiny grad can use torch as a backhand
but it doesn't use any of torches Auto
differentiation stuff
uh
uh yeah I think we did I think this will
work
here we go
is it a different Apple
yeah we have to just make this stuff
fast
we have to fix the shape tracker we have
to make it fast
that is a
week-long refactor to fix the problem
with the Longs is a week-long refactor
to fix the problem with the buffers is
quick
quick it's actually here so you see I'm
using in my image columns I'm using
image 2DS
instead of instead of buffers
uh like that sounds not really buffer
but
uh the reason for that is on the adreno
GPU which is used in the comma three so
actually
oh yeah
big victory
for for tiny grad
if you guys haven't seen it
uh this is open pilot
tiny grad is now the runner of the model
in open pilot so if you have a comma
three and you're driving with open pilot
your model is being run by tiny grad
um so uh yeah how much do you trust the
tiny it turns out the Tidy grad's
actually more accurate than the Qualcomm
one
um we're we're like point one percent
more accurate uh so yeah tiny grad is
Tiny grad is actually used
um
don't worry the tests are very very good
the tests are far better than the
Qualcomm one
um yeah
oh tiny grad tiny grad runs
we used to use this Qualcomm Library
called snpe but tiny grad got fast
enough that we just ripped it all out so
this is the convolution kernel that's
used by open pilot
um but
uh it uses images which are metal
textures basically an image is a texture
on a GPU uh they're not buffers
so the GPU kernels here being generated
use buffers
um they're generated and this is some of
the ugliest code and uh
in in Telegraph it's very short so I
like it but
um
yeah the problem is these numbers get
very very large
when you're doing uh
this stuff
yeah
you got to think about how to improve
that
but yeah
this is a
50 hours of work refactor to fix
uh this is a fast refactored effects
this one's fast but it's useless because
I can't use it also in in tiny grad
um
if you want a real hack we could just
cast the tensor
uh I think we could
Alex
hello
GPU doesn't work in Seattle
I have fresh fettuccine and shiitake
mushrooms and lemon pasta
I think it might be lunch time
I was gonna take like 30 minutes for
lunch time
um
all right so let's uh
oh we have 7 or 18 viewers that's pretty
good
uh
are you brought me a recess
well thank you
all right we're gonna go eat lunch and
then decide if we wanna if we want to
finish this
um
recess with magnesium oh I've had movie
sets before I don't know if it's Reese
this time right now though okay
um it's cold boys
it's cold
um so what's up with the glasses I have
a astigmatism
you see a little better with
I mean it works we got it working
uh it runs with the torch back end it
runs with the opencl back end on Nvidia
gpus which allow images that are double
the size okay so uh let me explain to
you what the actual issue was you see
here that you have a Max 2D image size
of 16384 and it's trying to create
images of the 32768. if I go over here
this computer has both a AMD GPU and an
Nvidia Jeep wait where's my amtg video
I don't know my AMD GP is broken but
here's my Nvidia GPU and you see that it
allows images that are uh
three two seven six eight
so yeah uh this is why Nvidia is the
goat I don't know no they just like I
don't know why
this is a stupid limitation
um but because of that limitation
uh it can't run with the opencl back end
on here but it does run with the opencl
backup here
so
the solution to the it's fast so uh
here we can run with
debug equals two and tell me the time
debug equals two will Time Each kernel
so we can run the decoder in
0.6 seconds
uh oh we got it we got to fix the Flop
calculator for that
the number of flops is totally not right
[Music]
fix that bug
now I have to fix it on the other thing
is it a harder limitation to GPU yeah it
probably is
probably it's probably the max number of
like I mean I don't know how textures
are actually implemented but whatever
texture thing they have it only has
16384 or whatever that is let's let's uh
two to the what let's do the 14 or
something yeah uh
so it only has 14 bits for the texture
sampler and the Nvidia has 15 bits
um
oh let's give it photograph of astronaut
riding a horse bro we're not there yet
so the only thing we implemented today
was the decoder
um but I'm pretty happy with just how
easy these things are to write in tiny
grad and it seems like when you write
them in tiny grad they're like
they're a lot easier to read I feel
like I feel like the pie torch one is
just hard to read like that this is this
is all I haven't tested the encoder yet
but this is all this is a definitely
working decoder
um yeah
that's the implementation of it
and I say like you can look at it and
you can compare compare this to the
pytorch repo and then see like what you
think is more readable uh I can do some
more things to clean this up too which I
think would probably be worth it but the
big refactor I have to do involves the
shape tracker and the shape tracker will
let me fix
a lot of time like you don't actually
need 64-bit of just how horrendously
slow is that going to be on the GPU
right
um
like it's already slow enough doing all
the stupid math that I am doing you
really don't want to do this math
uh I can show it to you yeah
so this is going to fail now at least we
added this assert which I'm pretty happy
with we track the bug down uh
I can show you if I say debug equals
like five
oh
that's not even gonna no that's not
gonna print that
well it'll print something
you'll say open for this conf
so this is the function that's actually
running for this comp
and the problem is just like it's in
these expressions
they're correct but you don't actually
want to like call that in a loop uh
which it's doing right now this will
also make it a lot faster when I fix it
but like I said it's a big uh
what's the memory footprint
um I mean I think it would be cool to
fix this bug increase the speed a bit
what about the images annoying too
well okay I mean here's the other
potential fix for the opencl one let me
think for a little bit about how easy
this is
so right now we are putting
uh
where's the opencl
this is the opencl reshaper here and
right now we're putting
both the channels and the X in one uh
in one axis of the image
like this is this this is the actual
dimensions of the image the four is
because at each location in the image we
hold for uh
you hold four floats
guy who just suggested rust you know
this is why only subscribers can
uh
some of these could get moved over to
here let me think about what that means
instead of each one having a line
some lines are double
let me think of how much that would
complicate the code here
would complicate it
because I have to make that one roll
over
[Music]
yeah that doesn't seem more of that
we could store the image as two separate
uh things
the problem you run into there is what
are you doing on a three by three
convolution right how are you going to
deal with the Border
and that's going to be annoying
you're going to have padding effects on
both of them
though no that definitely matters
[Music]
um
wouldn't that break locality of things
in memory no locality is not really the
problem I mean the thing is like this is
a really large 16384 squared is a really
large number that isn't the problem the
problem just has to do with like
like I don't think you're gonna really
have one texture that's a gigabyte
um
especially actually it's times four as
well and times another four if you're
using floats so it's it's it's actually
a single texture that's four gigabytes
this isn't the problem the problem is
just how I'm splitting things up into
shapes
um
and like I don't think the other
Solutions are too much better
what if I were to move yeah see if I
were to move for example like IX over
here and then we have a 512 by 512 input
image that wouldn't work either
yeah I mean this is fundamentally the
problem
if I have something like a 512 image
with something like 256 channels you
just have something big and then
why wouldn't what method work
problem isn't the weights the weights
are small
using what 512
using this because then your other thing
would just be too big right even if I
were to move it over which wouldn't even
be nice because the nice thing about
this is uh your sampling effects on the
edges are good right if you're reading
off the edge you get you get zeros
command space and then type math and
Spotlight yeah I probably could
uh I don't oh instead of Google yeah
sometimes I got python
you need the negative when it unsigned
in
uh no it's too big
I'm not even checking for that which
actually you're right I think my check
is wrong
I think I should really do 231 now
um
well but remember the buffer isn't
actually this big this is just an index
into like
the way that tiny grad works now and
what's funny is actually older versions
of China grad wouldn't have this bug
there's some chance we want to go back
uh to this other way of doing it now I
want to write a good Optimizer that can
handle this so you see what happens here
there's this movement Ops expand which
is this is your uh this is actually the
weights
now this is the weights these are
channels out these are channels in it's
a three by three convolution
spans The Matrix into a virtual Matrix
that's the size of the input image
and then it does a molec on them
yeah 2 to the 31 minus one
uh
foreign
place
so the buffer isn't actually this big
again this is a virtual buffer after
this expansion where we're adding 64
times 64. uh so the real size of the
buffer is only 512 times 5 12 times 3
times 3.
okay so the real size of the buffer is
just like 2 million but then we add in
this virtual buffer
and it becomes huge
yeah and this is so it can have the
right output size right so this is the
output size
for every
piece
in the it's really cool to like think
about stuff this way so for every
output which here this is like batch
size channels out image size out
you have this many input operations uh
being done all summed together so for
each pixel output it's a reduce of 4608.
um the problem is this 4608 while it's
completely virtual
uh
in the output image
it's not virtual in the like
striated input size
so that's the bug there and this
requires a very deep refactor
um
yeah the opencl one we have this problem
with the image size
CPU is incredible numpy is incredibly
slow especially if you're doing the
convolutions with these strided tricks
so you see this is how the convolution
works in numpy
it's not really a better way to do it
but
you don't get the virtual stuff well I
mean read the CPU convolution you'll
understand the virtual stuff better I
kind of just abstracted that a level
further out for the GPU stuff
uh which works it works great it just
the indexing you I have to write a
general purpose indexer which is
something I have to do anyway so raw CPU
is very un finished
I wrote this at a cafe in Germany
um
but the idea is that this is going to be
a raw C implementation
of the back end
and uh yeah I mean this one also will
help with all those shape things it just
it abstracts you from the annoyance of
gpus and then the torch back end just
uses torch.com 2D
uh which is nice
and that's why that one works and that
one actually does work right now to run
uh stable diffusions decoder in tiny
grab
all right
uh maybe I'll stream later today I'm
gonna look into off stream what the
refactor is going to be for the shape
tracker but uh we got tiny grad to
produce an apple
and uh I'm pretty happy with that to be
fair it's the same Apple we put in
but you know that's just like you put in
an apple you get out an apple that's a
good start imagine you put in an apple
and all you got out was a single black
Square that'd be depressing
all right any last questions
we're gonna we're gonna rate a lot of
locks
streaming
foreign
no not streaming
oh wait streaming
[Music]
there we go enjoy guys
oh I gotta click raid now
five four
oh she's hosting me wait did we just
create like a twitch Circle or something
wait I don't understand we just create
that's like when two mirrors look at
each other guys
I don't understand
oh no mirrors all right
I don't know what just happened
I'm bad at uh
oh dude I don't even know what happened
I does this mean we just have to keep
streaming
does this mean we just have to keep
streaming oh I guess we gotta refactor
now all right all right all right all
right
recess boys let me see let me see wait
wait let me see let me let me see if
Alex wants me to keep streaming or she
wants to do something
it's really hot outside
micro partner
now I'd be excited
I heard it's only three dollars
there's gonna be lots of people there
more interested
this sounds like six flags
oh all right all right
uh yo I don't even know what happens
guys
uh wow wait a second how do we have a
thousand viewers I don't understand what
happened
dude am I even streaming now all right
all right all right let's let's keep
going we combined viewers
wait did I just find is this like a WOW
gold hack where I just duped my gold bro
recess time let's go
[Music]
[Music]
wait
if I do it again
What if I
do it again
let's try
[Laughter]
no that didn't work
you can't write again trench isn't gonna
ban me I'm not Destiny man
[Music]
wait no I think if Lana Lux raids me
back
then
dude I think we just found the viewer
double hack man it was one of these
Monero a while back
I don't know ddg is man I don't know
anything about this Destiny shit you
know you know my thoughts on uh on on
internet beef man I don't get into
internet beef man I don't get internet
beef but I do believe that regardless of
what you think of them cloudflare
standing up for free speech that's
something I support and also Pat and
Charles cloudflare you guys know we're
being harassed by a patent troll right
uh if you don't read the kame I blog you
should read the comment I blog at
blog.com.ai
uh
yeah I know that's the open pilot uh
yeah this would being harassed by Patent
troll cloudflare was harassed by Patent
troll ones and they crowdsourced prior
art against them and it was really
awesome
project Django
um this this we read this post I'm like
damn you know what I'm not gonna give
into a patent troll I'm even if it cost
me everything I have and what is it not
one cent for tribute no a million
dollars for defense but not one cent for
tribute uh yeah cloudflare clever great
um
marcan 42 wants you to drop cloudflare
what
yo Free Speech boys free speech We
Believe free speech on this channel even
for terrible fucking people because
that's what Free Speech means man
it doesn't matter if you're Nazi it
doesn't matter if you're a communist you
get free speech because this is America
uh whoa whoa whoa whoa whoa whoa
oh let me know if there's cost there'll
be cost I don't think they'll be that
big
um
I think uh we're gonna we're gonna
assume for legal fees too it might all
just work out
um free speech yo whoa whoa whoa my
twitch is a private community
it's just like what did XKCD say about
Free Speech man no it's just cool to
like like I mean again cloudflare
doesn't have to do this but you know
it's it's good on them to do it
yes guys
even Communists I mean free speech lets
me say that I think Communists should be
thrown from helicopters like free speech
lets me say that man
uh all right
well
I mean here's something we can do
it's not that it's fast on this computer
should we just do it on this computer
and deal with everything else later that
seems like a better use of the Stream
okay we have more
we just use the 3080.
[Music]
I don't have any uh
uncommitted stuff here right
[Music]
[Music]
hmm
we should uh
foreign
[Music]
let's see if the encoder works
before we do that let's just make sure
my retirement
foreign
[Music]
foreign
Apple still works
let me see if the encoder and decoder
Works uh that's really part of that
image is not defined
oh that's because I called it real image
why they call it real image
oh it's probably because I'm supposed to
tensor it somewhere I do tensor it right
there
okay good the encoder works too
that's pretty sweet
like
that wasn't that hard
it gives me hope for doing the other
parts
foreign
should we just
should we do the wait
I don't even understand what happened
with the stream guys but
okay we're gonna call this part done
we just have to do the U naught model
and the Frozen clip in better and if we
do these things
um let's move real down
[Music]
[Music]
foreign
cool
all right diffusion model clipping
better
and then we actually probably have to
write some sample art
empathic doesn't even work
[Music]
foreign
we're at 400 viewers I think
[Music]
actually
it's amazing that that worked
I also want to fix the Flop estimator
bro dark Apple
first name and last name I can see this
chat don't think I can't see chat
foreign
oh run a one minute ad break
I don't know what's wrong
twitch raid
Loop
what is this
whoa so long locks is like Badges and
stuff
they're a lot better twitch than I am
Ray George hops
doesn't work
wow I'm not even in my own chat anymore
40 Lux box cool man
how do I get the how to earn loxbox
oh
do we have Channel points on our Channel
bonus
90 Lux box
Lana go live right now
we broke twitch
[Music]
all right uh what do we want to do next
do we want to do the Frozen clipping
batter or do we want to do the unit
model
what
well thank you
we rate monologues rated us and we rated
Lana Lux and then we broke twitch
what happened
no no no no it's like it's a loop or
something
foreign
model it is
am I too tired for you and that model I
might be
let's see what's in oh this looks so big
all right I'll savor it better
people
is it the same res block or is it a
different res block
it's a different res block
foreign
[Music]
pasta
so what happens when you go here now is
it me
know how this works
wow
guys should we have an FAQ
should we be a legit twitch Channel
what am I doing how am I doing on
followers
George Hots hosting a lot of walks along
he likes
yeah
oh
yo we're back I fixed it
[Music]
I think this is the other
[Music]
so stable diffusion has three parts
it has
an auto encoder a unap model and a uh
clip model it's a stable diffusion
guy uh well no it's not a stable
diffusion day yeah we're getting stable
diffusion to work in tiny grad we got
tiny guy to draw an apple
I mean to be fair we got torch to draw
the Apple first oh this is dark Apple
dark Apple
look we had other Apple before it was
better
um
foreign
the unit model
to work
next
because we did the autoencoder KL
ow does anyone know is the latent space
of that autoencoder just I guess it is
just junk right
actually here's a question
I want to try
what happens if you put in zero
foreign
for reference zeros
but they're different because they're
not here
yeah and they're over there you're
watching me from over there which makes
it hard
if you stood behind the computer it'd be
more okay
I can't see them looking
we're not going to really write the unit
today guys it looks so big and
complicated
can we should we do it tomorrow tomorrow
sounds like a good time
tomorrow
let's Commit This
[Music]
tomorrow we stream and we do this
tomorrow morning
Maybe
Maybe
thank you all for watching uh I
appreciate most of you except for the
losers and the idiots
what do you mean
if you think to yourself as a loser or
an idiot like
I'm not calling anyone out specifically
yeah right it's not boost in your
self-esteem you know it's like fetching
jabojangles think I mean him I might
mean you
hmm
good morning everyone
good morning good morning it's you net
day today you ready
uh
my glasses on so i can see
a nice cup of coffee here
let me mute the twitch over here oh man
bro
i really am an old man
you know
i remember when i used to be able to
stream for hours straight
i can't do that now i stream for 30
minutes i get tired
that's a live price
good morning everyone
good morning
oh i
hate speech
we gotta pop out chat where's pop out
chat come on twitch
pop out chat there we go
good morning good morning
welcome welcome to today's stream where
we're going to finish it and we're going
to actually make it do something
all right
uh
so
i was working also on fixing this i was
also working on a blog post
called on device learning
this is my kicks for that gpu issue
yesterday i started working
but we're just gonna be working over
here on quiet
and quiet of course has a friendly
neighborhood
uh
how far did we get yesterday we
implemented the auto encoder and today
we will implement the unit
uh oh it's going to be a little annoying
because we're going to have to figure
out how to get stable diffusion
installed over here but it shouldn't do
that
so today we implement the unit
so you see where i stationed over the
queue you know i really love the s code
that lets me do this
examples
table diffusion
now we didn't use any pie torch cheating
at the end of the day
oh well here shit sorry i could bring my
mic up here
is that better
[Music]
um we didn't have any pie charts
cheating by the end of the day
we just did a little uh
okay
so we have model diffusion model
we have middle blocks
input blocks middle block and output
block
oh i also i did a bunch of cleanup you
can see like check out my layering arm
now it's a one liner i just reshape it
to make the thing i want to normalize
the last tensor
layer normate and then shape it back and
do the element one is that fine
i will say the uh after work tech the
chapters have really uh
improved the quality of the channel
oh look at the source code well this
isn't like this isn't like only look at
the weights right like we're learning
here
um using pi torch is cheating though so
it's all written in tiny grad
so yesterday we implemented the
autoencoder kl
today we're going to implement the
diffusion model
so
it's called open ai model unit model
um it's called diffusion models this is
something like
they have something called a resnet
block but it's a different resnet block
full
all right we'll start with this time
embed
so they have something called linear
model channel's time in bed
i also created a class called mid just
because it was easier
uh
okay
i think i kind of understand what's
going on here
so we have something like inside
um
oh
that should be right
and then self.bias tensor uniform
outside
and then
i can just do x dot linear self.weights
i think so the great thing about the
tiny guard code is it's incredibly easy
to read
so i can just see like make sure linear
is doing the thing i want
weights bias tensor yeah it's doing the
last one
length as well double otherwise dot it
and then add the bias reshaped to the uh
cool
so i just do what i want
uh now we have something called time
embed which is an array
this already has linear
320 to
uh
silly we have celia
you don't have silio how do you write
silio
what is a cilia
oh but this is the same as swish
this works right
i hate that it takes up a line
seems like that
is there going to be a q a at the end
there can be a qa right now but only if
you have a good question
ah so then here for time in bed
we can just go right uh tensor dot siliu
and then we have another oops
we have another linear layer which is
1280.
and then i have a nice little wrapper
called
sequential let me just do sequential
time with that
how tall is
zuck how tall is zach and you know what
for
taking me down this rabbit hole
oh bro
bro
bro contrary to the internet's belief
that says i'm five six i'm actually five
ten as a little five seven mark
zuckerberg yeah it doesn't stand a
chance bro let's go let's go
all right um uh you you got me you
ex dion you're the reason that
non-subscribers can't talk anymore
uh because you got me uh you got me
thinking about whether i could fight
mark zuckerberg and the answer is
obviously yes uh but uh you know you
know like like like
um let's see let's see let's see am i
gonna fight elon musk
uh elon musk is six two fuck no like
that's really what it comes down to
hey elon's a big guy
hey
wait a second
wait a second
is this disinformation
is putin five seven or is putin six two
is putin five five
all right this is off topic yeah i agree
i agree yeah we're dead we're done
now bro i'm not fighting putin bro i
don't fuck with that guy
no no no i'm not i'm not fighting putin
guys i'm not fighting putin
uh look i went to russia once
man
that's like i'm just saying i'm not
fighting putin
who who said who said they would fight
putin though something
someone
ukraine things started jake paul said
he'd fight him or something
elon said he'd fight putin
what was it elon
dude dude
you want to challenge putin on twitter
that's wild
i do think more problems should be
solved in the world by like hand to hand
combat
um i think that you know part of the
reason like
we have uh
you know like like like shootings and
bullshit is because you just can't like
you know you got aggression you want to
take it out get into a bar fight man
all right
this is a real thing
man manny lot's cool
i saw i saw a tweet last night it was
like like if you hate elon musk you have
no soul
i like i was like wow
uh yeah it's just it's so
i i don't understand our elon haters are
yellow they just made up for the cia
um
all right
on to the next thing
okay
the input blocks
input blocks is a module list of
timestamp embed sequentials oh this
doesn't look good
well first let's see if my thing's low
undefined oh
when i do that
okay it didn't load
so they're here i have diffusion model
self.time in bed there's a zero there
which is the number in the uh array
should work
no it doesn't
i spelled the fusion model correctly
stable diffusion has no attribute model
what
oh
oh is it called model or something wait
what
oh okay
this is a model
model diffusion model
wow okay
[Music]
where does this get initialized
did we find this
i think we actually found this um
is there anything else on your model or
is it just a fusion model
you see what i did you see the problem
like i assumed that model wasn't
actually a part of it and it was just
um
you just like named tuple can i not
i just want something that i can i can
do the dot on right
fusion model and the field name is uh
diffusion model
there's a new named tuple is there not
though and i think i use a tiny color
maybe i know
there's like a new one that's in like
tightening
okay you see how these now showed up
and i wrote weights instead of wait
okay
see now these four now have these
tensors here which means we're uh
we're we're we're loading well look the
world's like fusion power is great uh
but the world doesn't even need fusion
power it just needs sufficient power and
guess what we know how to build fishing
reactors and they're pretty good
and why can't we build them oh yeah
because we need to you know throw the
communists at a helicopter or something
uh like
you know you just
it's just so disheartening when you
realize that like
there's a huge chunk of the world
that
basically manages to profit from
stagnation
right you can think about this you see
this effect in lots of places right you
see the effect in like in nimbyism right
in the people who you know don't want to
build housing in san francisco
oh and this is because well
it makes sense right it's a rational
move if you own a house in san francisco
and if they build more houses well it's
supply and demand right if you make more
supply and demand stays constant the
price of your house is going to fall
uh so
they're incentivized towards stagnation
and we have an entire um
again
you're an oil company right
well
[Music]
it doesn't really you know we start
building lots of nuclear reactors maybe
this pushes electric cars forward maybe
people uh stop demanding oil so much
price falls of oil so the best you could
hope for is stagnation
uh so so we live in a world where
there's tons of people like
profiting off of this
especially as things like as growth
starts to stop
when you have a very
high growth
uh
society well people less people are
thinking like that but we haven't really
seen uh
growth in a lot of stuff since right
like there's look there's
i was in china in 2010
tons of growth china 2010 is there
growth in china 2020
a lot less um is there growth in america
2020 well
like not really no
i mean things are not that much nicer
today than like
what i grew up with
uh versus you know you compare that to
someone who grew up in i was in malaysia
malaysia
compare compare malaysia in 1980 to
malaysia today wow
[Music]
no france is not an example that says
fishing is not that easy fission is easy
look look at the look at the look at the
the idiots who can't put the hydrogen in
the uh in the in the rocket
right
um
i looked into it a lot you know you you
read the specs for the ssme and that's a
great engine right there they're trying
to reuse the space shuttle main engine
on the new rocket
but you know and then like you see
elon's reply to it it's like bro like
yeah hydrogen's great if you're looking
at specific impulse tables and then you
actually try to use it use ch4 i'm like
cool good choice man
like
it was done right
like
you know you you think this right you
read about spacex's engines and you're
like okay they're building these really
fancy engines why aren't they using
hydrogen oxygen all right so this is a
all right good we're learning some
science um if you guys don't notice
specific impulse
uh
specific impulse is measured in seconds
by the way that's how many seconds you
can hover a pound of the fuel
chemical engine
where's the table
it's like a table usually for this
well let me talk about all these crazy
ones
wow i didn't even know there were like
higher ones
i don't have hydrogen here
um yeah so they're they're like
bi-propellant liquid rockets and you can
you choose to use i think this is space
basically it's jp4
what is jp4
um
so
yeah i mean i think maybe they use they
use ch4
so gasoline is uh is is heavier
hydrocarbons where you have more carbons
uh but they're not as uh i mean it's not
as dense right because you don't gain
energy breaking the carbon-carbon bond
you only really gain energy
do you um
energy
breaking
cc bond vs
here we go
energy is always required to break a
bond what
oh okay
yeah
uh
but you gain energy from from breaking
the bond
am i not googling the right things or is
is
wow okay
been a long time since i really uh
let's get to the bottom of this
okay so this is kilojoules
is the energy required to break a
chemical bond right so it's it's harder
to break ch bonds than it is to break cc
bonds
yet they give off
energy
total heat content of a system
on emphthalpies
interesting okay so yeah but regardless
it's still
required to break
that's that's not why i'm not
understanding here
oh
i get it
okay okay guys look i'm stupid right
this is cool
okay look
so
this is a combustion reaction right any
combustion reaction is going to be some
hydrocarbon combined with some oxygen
produces co2 and h2o
what you do is you add up the bond
energies on this side the bond energy is
on this side and if the bonds are
stronger on this side well okay i mean
uh
you you you gain that uh you gain that
energy right
um
like it has to be released right
actually never change for breaking
total exothermic change for bond
forming
and you get
that much energy released
cool
ah yeah but okay so i mean you can see
what the what the advantage is to to ch
right
uh
no wait no the other way around
right
if a bond is weaker here
oh interesting
so you actually do get more energy from
the cc bonds i guess it just doesn't
because the carbon's heavier than the
hydrogen
interesting
okay kerosene gasoline blend
does kerosene
mean something clear
i know gasoline is just heavy
hydrocarbons
ah here this one
buy pro pallets
yeah okay and these are these are the
charts that i remember from like
looking this up right
so you have you get more specific
impulse from
uh liquid uh hydrogen than you do from
kerosene
but you make up for this because you are
uh
it's much easier to get a tank that
holds kerosene than a tank that holds
liquid hydrogen right uh hydrogen's real
cold
hydrogen
uh freezing or
uh no freezing but uh
liquid temp
hydrogen turns to a liquid when it's
cooled to a temperature below negative
negative 200 and yeah
fahrenheit
the time i'm looking for is boiling
point by the way
what why is it so hard to like find
normal stuff now
is google just not good anymore
boiling point of oxygen is negative 183
c
the boiling point of hydrogen is
negative 272 right so if you got to get
to like
you're close to absolute zero liquid
hydrogen storage requires refrigeration
to a temperature of 20
20 kelvin
ah
well from alpha
bond dissociation energies
whoa the co bond energy in co2 is even
higher
so if i have
hydrogen and oxygen
and i combine it to form
water
let's just let's just do the math
quickly right
um
sorry we'll we'll get back to uh we'll
get back to our regularly scheduled
programming uh in a minute let's just
like work out what the uh okay so if i
have something like two h2 plus o2
yields uh
two h2o
did i balance that right four hydrogens
here four hydrogens here two oxygens on
each side
all right good
so if i have two h2 then i have
that
plus the oxygen bond
minus uh
4 times 467
negative 858 kilojoules per mole that's
pretty good
[Music]
yeah yeah yeah i got your hammer bro
all right good uh
i hope you enjoyed today's uh
yeah okay and yeah i mean this makes
sense so you could do slightly better
with ch4 with kerosene so what's the new
engine after starship engine
cryogenic liquid methane methylox
she'll get slightly more out of that
i mean what's what's the methane methane
has the same boiling temperature right
wait
oh okay i was like what no but that's a
fahrenheit that's not celsius
uh so that's not too bad
ah and of course kerosene
kerosene is yeah
you don't really think of kerosene right
i mean this is really uh
a hydrogen sketch man
this
well that's actually not bad
some things that i should just know i
don't know it's been so long because
i've really thought about this stuff
all right back to the unit model
uh are you guys want to see a preview of
my blog post i'll show you my blog post
um
before asking the question how do i
build agi uh you must first ask the
question what would i recognize as agi
uh i suspect there's not a real answer
for this humans can be fooled both ways
into thinking simple things have
intelligence in life and to thinking
complex things don't that they usually
aren't fooled for too long at least with
the simple things i define agis machine
capable of taking almost any human job
this says a few things about what it
must be like
mostly it implies that the thing must be
human-like enough that humans quickly
recognize it as as fairly as uh
let me write that better mostly it
implies that the thing will be
human-like enough that
other humans
accept it
accept it as
i would say quickly accept it as here
just like level two driving systems will
incrementally win self-driving cars
there won't be a huge overnight switch
huge overnight switch
to the robo taxi economy agi to be
recognized as such will have to
interoperate with humans
um
just as
self-driving cars will have to
inter-operate with i don't even operate
in quotes i use the word normally uh
human
driven
this implies the following must have
eyes and ears uh
while some humans don't they can't do
every job must have a similar space to a
human must have a similar better charge
cycle but these are the obvious ones
must somewhat remember the past must
have goal-directed behavior i must be
able to communicate efficiently with
humans
more importantly though it must most
importantly though it must be able to
learn all humans and all jobs need this
skill
this candy account body he appeared on
my linkedin asking for a controls
engineer to help him stamp it occurred
to me that that would be pointless
nobody doubts we can make a model and
write npc to control it we could
probably also build a simulation
environment do our element simulation
then transfer it over but what happens
we encounter a bump gravel snow a human
trying to knock it over banana peel did
you put all those things in your
simulator the only way forward is on
device
learning um
i did i got five of an ap chem uh
they didn't let i get a d in chemistry
uh mostly because i didn't do any
homework uh so they didn't let me in ap
chem class so i was like bro i'll just
take the test and i spent like two weeks
reading the book and then got a five so
that's that's one that's one of my
accomplishments in school that i'm proud
of
oh let's not device transfer line i'm
not transferring it from anything
uh
i think there can be
good
universal
code
that
can
run
on
any robot
and manage
manage
to control
learn to control it without breaking it
ah
so i bought uh i bought a dog
i bought one of these guys
uh we're gonna we're gonna put some
common threes on some little dogs
and then we're gonna see if they uh
they learn to
make them learn anything
unlike
simulation
uh resetting
can
be much
more
expensive
so
you'll need
take
uh
into
account
there
are bad states
and there
are bad states
i think that makes this one kind of
does that make sense
um
is the lack of dexterity in the robots
purely software it's almost all software
yeah
um
if you are interested
in
solving this
problem uh come
work
on
ah
i imagine
a day
when
you can
drop open pilot on
any robot and it can learn
we had a link for open pilot
what
uh wouldn't uh wouldn't uh
drone
uh
oh all right should we curve happy story
here we can read it
you
i
it's interesting i mean
i talked about this on lex i don't think
that gpt 12 is ever going to have
consciousness and and introspection like
this
right like
i i think that you need
ah
let me uh
um
there's also a question
of the reward function
well
can start
simple
like
standing
or movement
i imagine
you'll
end
up adding
things
like curiosity
let me include a link to a paper about
that actually because people think like
people think of like curiosity like this
there's a mathematical definition of it
uh
ai when it was an opening i paper do you
mind paper
um
i think it's this paper right
so
um
um
[Music]
for a long
time
on my whiteboard
i
had the phrase
what is the human reward function
i watched
a bunch
of puppy
videos
to try
figure
out
i think this
is the question
we'll
have to answer
can't
in
a basis or it is
in our
dna
i don't
think there's a way
to learn it
aside from
years
from
millennia
um
you spell that word right
multi-agent
survival competition
sorry you guys are just watching me
write a blog post just want to ship it
um
to start
i think simple
reward
functions
would work
like
standing or movement
all right let's just read this quickly
and see isn't it just dopamine yeah what
the hell does that mean all right isn't
it just
like numbers man
is the best chance they're bad states
what's the humanoid functions the base
versus in our dna
ship it
[Music]
ship it
park it ship it
all right back to our regularly
scheduled uh programming
uh
what are we doing well on viewers oh 727
all right pretty good
like the airplane
[Music]
here we are unit model
[Music]
oh looks terrible
time stamp embed sequential
what
oh
what is this
i can't read this
input blocks
great bias i mean that sure looks like a
convolution right that's not a
convolution that's a convolution
i'm gonna go too deep in a stupid array
let's try it
3x3
all right cool that's easy
this next one i don't know what this
weight waiting bias is maybe that's a
time stamp embed sequential
do you remember this is just one list
like that's just the first one there i
must add things to it
right here append
there's a red block
she don't look like a rest block
okay well
layers equals res block append
could it just be a res block i
i mean i'm going to guess that this is
something like
a norm
an activation function and a comms
let's see where it is i don't know maybe
i can just find that thing that
describes the architecture
[Music]
this does not describe the architecture
oh
well here's something else to note okay
they have something called in layers and
layers and outliers so maybe that is a
res block
they have a different res block
unfortunately we have this resnet block
and then there's something called res
block
so you know we might want to make two
files for this or figure out if i
consolidate it all later but okay is
this okay good yeah there we go
normalization sell you and yeah okay
fine
uh group norm 32 so it's basically the
same thing
uh great
okay class
resnet block uh
we'll make a new class we'll call it
u-net resnet block
u-net resnet block
um
in channels out channels
channels out channels
so we have something called in layers
uh which is an array
that has
oh wait what no this is not
a res block oh i could just call it
red's block
not to be
um
fused with resnet block i hate these
things
um
but in point one seconds on a single
thread cpu i don't know bro
do the math on the gigaflops i don't
think you have enough gigaflops
all right we have normalize
we have silio
and we have uh
2d
channels of channels
and then the next thing here we'll put
is a res block what are in channels and
out channels 320 320.
that's in an array still looks like it's
in an array
missing caramel sauce huh that's the
process
three
okay cool
what are the input layers and you just
do the m layers and the out layers the
norm and the projecting we're good
um
no okay look
i was gonna write this in a blog post
but then i was like who am i even
speaking to crypto is good for one thing
here you want it i give
if somebody wants
i give them permission to clip this one
thing because it's actually a pretty
coherent point
crypto and blockchain are good for
exactly one thing
when you think about bitcoin and what
the application of bitcoin was the
application of bitcoin was selling
illegal drugs this was the only thing
bitcoin ever succeeded doing nobody
bought a coffee with bitcoin because
visa and mastercard are very efficient
the only place bitcoin was useful was
selling illegal drugs now
you look at the second biggest
cryptocurrency ethereum aetherium is
good for exactly one thing selling on
registered securities right whether it's
an ico or an nft
these are all on registered securities
that are ponzi schemes
the basic gist of any crypto and
blockchain project is this
is there a component of regulatory
arbitrage
meaning
is what you're doing illegal and the
only way to make it legal is to
basically do it in a decentralized way
if you're selling drugs or you're
selling unregistered securities
that's where crypto succeeds bitcoin and
ethereum have only succeeded at places
where there's regulatory arbitrage so
now
proceeding through this analysis
framework you think where is crypto
going to succeed next i think there's a
big market you know i really loved auger
i think there's a huge potential for a
prediction market especially with
predicted getting shut down why would
predict it get shut down that's a good
question
um
with predicted getting shut down if
somebody makes a good decentralized
prediction market
uh man there's money there right
gambling
think of all the places where
regulations suck and you can circumvent
regulations using blockchain that's all
blockchain is good for when someone
talks about putting ai on the blockchain
they're a moron because there's no
regulations around ai there's no
regulatory arbitrage to do an ai okay
that ends what you can clip i hope
everyone understands
crypto project
is there regulatory arbitrage maybe it
will succeed is there no regulatory
arbitrage never will succeed really
fucking stupid great
right here
[Music]
these guys
right just because we pitched the same
idea to andreessen you know we ran a we
ran a crypto we ran a crypto scam uh to
do our second round of fundraising i
mean it wasn't really a scam you know it
was kind of honest but then like you
think through what it really is and
you're like
okay you know i said some stuff that i
really don't believe in
um
uh to raise money but hey it was all
harmless you know uh
you look at a project like this right
so here's a dash cam and they're gonna
sell data we've had the same thing it's
called sensecoin but then you realize
that there is no
uh donut you know what i take it back
don't actually clip it don't act don't
actually clip it um
it sets a bad precedent no clips
uh but this is this is worth
highlighting this is a real point that
everybody who works in crypto and
blockchain uh should understand
and it's that
if you don't have a regulator if you can
build your thing on azure and use
cloudflare right by the way
cloud flare don't
bad move it's a bad move it's a bad move
look man you know
kiwi farms is no daily stormer like
uh i think they made a bad move kicking
uh
you know banning kiwi farms because of
imminent threat to life all you're gonna
get is imminent threat to life about the
next stupid thing people are upset about
right you gotta set precedence and like
this is where we need blockchain
technology right blockchain technology
can keep unsavory characters on the
internet
um blockchain will not replace a sql
database it will never replace a sql
database
and here's why
it takes way more resources to run a
blockchain than to run a sql database
right when you look at the entire
bitcoin and ethereum network i could run
these things on one decent computer the
whole network i could run on one decent
computer right that's it
i can rent a single computer in azure
and i can run
the entire network on it
um
now yes if you have an illegal sql
database well now we're talking right
regulatory arbitrage when you look at a
project like this there is zero
regulatory arbitrage there's no reason
you can't just build a dash cam that
makes a map and do it using old-school
technology here's the reason you can't
and it's because it's a bad idea no one
will invest in it as a non-crypto
project so you add crypto and somehow
people think magic is going to happen
another thing about crypto
dows right
democracy is a really bad idea
right
when you have something the size of a
government democracy might everyone
knows democracy is inefficient right you
study athenian democracy and you find
out oh my god wait a second democracy
sucks
the thing is
democracy is a low variance is lower
variance than dictatorship right um
dictatorship can be really good or
dictatorship can be really bad whereas
democracies are usually somewhere in the
middle you know
a lot of things usually suck and are
inefficient but they usually don't like
you know murder tons of their citizens
right which some dictatorships do um but
some dictatorships go on to build
singapore right um
so
at a
large governance scale you may want
something that looks like democracy but
for a company you do not want democracy
for a company
the companies that succeed have strong
leaders and there's no kind of
existential risk to dictatorship or you
can call it monarchy in in companies uh
where it works way way better so this
idea of okay we can have like an elon
musk we can have like a strong top-down
leader who runs a company or jeff bezos
or even a you know a zuckerface um we
can uh we can we can we can uh look hey
mark zuckerberg you know we'll give him
we'll give him the respect where it's
due i really like the pivot to meta i
bought your stock and lost money hey
after your lex freeman i went and
actually bought some uh i bought some
meta stock i bought some meta stock at
like 240 and now it's at 160. so
zuckerberg you lost me money but hey i
believe in you i'm totally i'm huddling
your your your stock uh how much it's
about like 200 grand
see i lost like 70 grand on mana i i
just like i liked it i did you know i i
just i believe
i also like i like that he's like going
on joe rogan and going on lex friedman
right like it's like you know that's the
thing i i invest what in what i like and
man you know i just like how could you
like google today like you can't they
just suck and you're just watching an
empire crumble right facebook's like wow
wow wait the thing that we built was
actually news and ads and sucks balls
and we're gonna make the metaverse and
like you know maybe it'll suck but like
maybe it won't
um
you like the fbi being thrown under the
bus be real i don't know what that means
bro
so yeah i take back the clip especially
since this became somewhat political the
last thing we ever want is political
clips
you know like people always have ideas
george you're a trump supporter
no i'm i'm not man george i i can't
believe that you you you are your
pro-choice man you know don't you know
about the babies and i'm like oh my god
like dude i i'm not like i'm not any of
those things
but george aren't you a libertarian oh
no i'm not a fucking libertarian right
like oh yes let's argue please about you
know these hypothetical states that have
never existed right like
oh i like i just like this is the
problem with politics you're a
libertarian you're a democrat you're a
progressive you're a republican i'm not
any of these things man
okay you want to put a label on me
you can't man
i don't know like like yeah
like i just
google's not ready to take the risk yeah
no clips are smart thank you thank you
um
uh
yeah the only blockchain things that
will succeed are things that are doing
some form of regulatory arbitrage right
um
if somebody could actually figure out
how to build assassination markets what
oh this is the paper the uh
the
assassination markets that's uh it's
really cool to read
um
like this is this is it
uh right like there you go that's
something that's super regulated right
if somebody could figure out it's a it's
a token that lets
you kill people right like that that is
a product that people might want
um you could build an assassination
marker top prediction market yeah of
course um
but yeah that that's the uh
think about think about what's uh and it
turns out that even you know bigger than
drugs right like drugs were cool right
and like you know bitcoin did a lot
drugs are not cool anymore by the way
drugs used to be cool but drugs are not
cool anymore don't do drugs um
like i haven't done
they've done little drugs this year but
like really nothing like i used to you
know drugs drugs aren't cool anymore
like there's no there's nothing in the
world if there's some like white powder
at a party it's someone swears to me oh
it's ketamine or it's molly fuck that
man
fuck that don't do drugs kids
um
but
my point is there's even a bigger market
than the drug market and that market is
for unregistered securities look at all
the ponzi schemes on ethereum right oh
also by by the way i'll give you some oh
you see now we get the viewers right the
people love this stuff here's here's
here's a fun little fact right
you guys see this uh
this this this this one it almost mimics
perfectly this one
and no one even remembers you know back
here this one right
like in two years we're gonna have
another resurgence of crypto what
everyone's gonna find in the price is
gonna go to here right you can't see
where i'm pointing on the screen
um let's grab a red bull
nah
but yes
look at any crypto project and ask the
question what regulations are they
arbitraging
um i also think that there could be like
you'd have to do it pretty well
but there could be like a decent uh like
piracy crypto right like like you know
we'll call it like blockchain flicks or
something block flicks and like or or
web 3 flicks and like it's like netflix
but it's web 3 flicks and like you set
it up you set up the incentive system
correctly use something like filecoin
right like
i can see that working pretty well
um
anything on blockchain and dns again
what regulations are you arbitraging
against i can run a dns server in
america i can put whoever i want aside
from the absolute like look in america
free speech is free enough that like
you get into the absolutely abhorrent
shit that like there's not even really a
market for right there's not there's not
a huge demand for like child porn or you
know whatever is not allowed in america
right dude we live in a pretty free
environment america just happens to have
some weird restrictions about drugs and
securities right and this is why crypto
manages to succeed in these two niche
markets right well they're not even that
niche right like america has absolutely
ridiculous laws around around securities
and investment so of course you're going
to get something like ethereum and icos
and nfts are going to be uh
are going to be uh
are going to be
ridiculously successful right you know
the drug war how absolutely ridiculous
is this right because america's been
wasting tons of money on this forever um
and you just you're not gonna do it
right you have
you have a pretty inelastic uh
there's always demand for these things
right when you look at any mafia
organization what do they do well
they're running the numbers and they're
doing drugs and they're selling drugs
right like the gambling and drugs right
what what are what are unregistered
securities markets so gambling right
like think about where where organized
crime has uh existed before
maybe the mafia offers hits as a service
but not as much right you think what do
they really do they do the numbers they
do that right
um
dns blocking is a major thing in other
countries no but it's not like a
decentralized thing would help that but
i can run this here in america
right i can run a dns server that serves
any russian banking website here in
america right you're like oh well
russia's going to block it yeah but i
can do a lot better circumventing
russia's block
with centralized stuff here in america
than i can with trying to make a
blockchain around it right
like i don't need a yeah
anyone can change your dns servers look
you're like oh we'll all have one ip
okay then i could have people run
proxies the same way tor did it
right like
if there's a market for that i can run
this service in a completely centralized
way in america
um and then you say dns hijacking and
blocking well dns hijacking can be fixed
with dns sec right again you do not need
a decentralized system to ensure that
dns entries can't be arbitrarily changed
this is just because we don't have
like
this is solvable in a straight up
centralized way with like
uh you know a central authority that
signs things with their rsa key right
it's actually probably much easier to
circumvent a decentralized system than a
centralized one
um isn't bitcoin still succeeding
without silk road i mean can you name a
successful bitcoin product aside from
silk road also by the way
yes silk road might be shut down i don't
know if you've looked around lately but
uh
there's a whole lot of drug markets out
there and they're doing pretty well uh a
lot of them use monero
i mean look you have child porn and it's
like
there's there's always a bunch of like
real sad people who are looking for that
kind of shit but i'm you know there's a
lot of not sad people who are who are
buying and selling unregistered
securities and doing drugs right
um
people who don't understand tech think
decentralization equals blockchain well
yeah i also like i don't know why they
want decentralization
bitcoin lightning is pretty i can't
dude i tried to set up a lightning
network node i couldn't believe the
complexity in it uh it's just not a good
system you know also the ethereum and
the l2s
i did a bit of work for optimism i wrote
canon you can go read my my canon code
but ethereum doesn't even need l2s it
just needs a half decent software
engineer to come in and rewrite geth
right like i could
it's not that the people who wrote
gether are bad software engineers it's
that the people who wrote geth don't
have the same incentives right
i could come in and take geth and i
could make it run 10x faster
and then you get 10x more throughput on
the network pretty much for free
um
oh my god cheap i cannot believe
dude this is why you can't do anything
with crypto i cannot believe like the
people on hacker news who are like
george hawks tried to run a crypto scam
with cheapies
dude
like first off this is an insult to my
intelligence
if i wanted to run a crypto scam
like you think i'm stupid
like
dude
do you think like
like this is what i would go with
[Laughter]
um
no but that's a big man you know what
but you know what fuck the haters man
like haters are always gonna hate i'm
just saying i'm just saying it's
absolutely insulting to my intelligence
if you thought cheap eats was a real
scam
you know you know how i feel about
running krypto scams right like it's
fine to run him against right like oh
yeah jason we're gonna sell sensecoin
man i'm like you know what it wasn't
even a lie like i was really thinking
about doing it like it's it's a cool
idea but
you know then you just look at it a bit
more and you're like oh my god this
space is so unbelievably toxic
uh
alex i'm at the dinner last night i was
talking about like just
she was like saying how upset she was
like all these people in crypto promised
to build all this stuff and then raised
all this money and then like didn't
you know where's eos
um
brock pierce got rich that's what
matters
ah if you want to be a villain i bet
you'll become like lightning
yeah yeah i like to think i'd be a good
villain i mean look if i was gonna be a
villain like i would hope that
uh
it wouldn't be obvious to you guys right
i would hope that i would actually do a
good job right
um i don't know i haven't decided to
become evil yet but if you ever stop
hearing from me and george hotz falls
off the face of the earth it's probably
because i found peace love
was it plur peace love unity rave in
like hawaii or something and
i gave up on computers forever it's not
because i gave evil or it could be in
the one percent world where i became
evil like jd salinger
um where's crypto s3 i don't know like
where's file coin man like the thing is
these people like raise all this money
and then
you know it just becomes about that it
doesn't become about the technology
anymore
and then you ask the question what can
you even buy with money well nothing
because everyone all everyone's rich
right you don't want to live in a world
where everyone's rich you want to live
in a world where
money rewards the people who create
value right
you can't just like like what does it's
in the malcolm in the middle where it
dates the dumb girl what if we made
every dollar bill into the million
dollar bill right think about it
um
uh okay so
does crypto have a chance at disrupting
the uh
the centralized
fiat currency system right um and again
let's look at it under my analysis
framework of regulatory arbitrage
how bad is the dollar
all right
how poorly run is the dollar
and
they're definitely scammers all right no
one no one's arguing the fed or some
altruistic good guys but
they can't scam too much
um like well no the dollar is mid what
do you mean the dollar is not the the
the venezuelan real or whatever right
like there's definitely um look at el
salvador right el salvador is trying to
use bitcoin
you do have these countries that are
incapable of running a currency right
like i went to uruguay uruguay has the
uruguayan peso but half the stores don't
even take it you got to pay with dollars
right
um
so the dollar is actually a
okay run currency right especially like
look look look at the uh
look at this all right
how are we at parody now with the euro
right despite the government scamming
like crazy and printing all this stupid
money during coronavirus like
well uh we did better than europe so
let's just say that right
um
so you're talking about you can't send
someone 20k on a weekend or after 5pm
right so you're talking about uh crypto
as a
as a system for sending large amounts of
money right
so again is there regulatory arbitrage
here is it for regulations why why are
transfers
don't go that fast or is there a huge
benefit to the fact that wire transfers
can kind of be reversed and tracked
right
like when you have wire transfers and
ach
the it's not really a technical problem
anymore but if you make them go faster
you run into well
you know
oops i sent it to the wrong address or
right all that kind of stuff
uh cryptocod thank you for gifting subs
um i hope i hope you liked my
analysis of crypto uh as someone who uh
knows enough about the space to tell you
the truth but doesn't work in the space
to perpetuate the scam
um
you did better because nato is invading
europe with war i mean maybe that's true
maybe that's true is this
oh dude you're no no no no wait wait
wait wait no no no no this trend has
been going on since 2021 ukraine didn't
start till here so uh
i i wouldn't say it's uh
usd is being weaponized yeah i mean this
is a bad idea right
um you know
the amount of um
lack of respect that's shown to russia
uh is is is staggering is is astounding
to me it's astounding to me the way
uh
you know our our leadership will treat
russia you want to treat iran like this
dude throw iran at the wall they're not
going to do shit man they're little
bitches
but russia
i'm not saying like them
right like
putin's a dick man
but
this isn't iran here
this is a uh this is the the second
largest nuclear state like uh
i don't know i you know i just i i it's
the the ukraine it's so sad like it's
it's just so sad that that that this is
what happens um
and again
we'll see all right we'll see we'll see
what happens with with energy prices um
you know who are you sanctioning right
are you are you sanctioning russia or
are you sanctioning yourself right
oh but it's a win-win man
uh it is the largest with five through
five yeah i've heard they have
technically more nukes than the us
i don't know
um
but we're on numbers maybe
no i don't think putin's unpredictable i
think that
it makes a lot of sense right like
you can disagree with it but if you're
in putin's position right
you're like well
look i could like roll over and be a
bitch
or i could not right
uh
you know
it's just that's just i i feel so bad i
feel so bad
for all the guys like me in ukraine who
are just like i cannot believe these
fucking people you know
like
by the apartment next to mine got hit by
a russian missile i just i cannot i
would be
look i'm mad about our government right
i'm mad about i'm mad about this shit
i'm mad that like you know my taxes are
going to
fund you know
gay rights for homeless whatever's look
you want to give gay rights to the
homeless whatever that's great but why
do i have to fucking pay for it right
like that's where i have the problem i'm
mad about that but hey you know at least
no one around here is getting hit by a
missile right
um no no no no i'm not i'm not i'm not
hating on russia man i feel like i got
the russian rap i love the russian rap
uh
crime punishment's one of my favorite
books
uh
i i'm just
i'm just saying it's it's it's sad it's
it's and i look i i blame
i blame the west more than i blame
russia
um
gas is coming to europe normal yet the
price is surging they're fear-mongering
i can believe that all these people
about the fucking global warming man
like
i don't know
i look at it and well there are some
concerns but
when you think about existential risk
right like literally
uh
on one hand we have global warming which
can raise the uh temperature
uh two degrees celsius uh
you know over a hundred years on the
other hand we have gain of function
research being done in the wuhan
institute of virology
all right all right all right
[Laughter]
cool all right all right we're sorry
sorry we really we really went off topic
there uh you know once we're into the
covet escape from a lab we're really
really off topic
i'd see you guys like it thank you for
the hype train
um
war will never be obsolete there will
always be war it's just a question of
what it looks like and hopefully we
don't have to have stupid boots on the
ground style war
um
really off topic wow we got a lot of
viewers so oh yeah all right all right
this is what the viewers like right
right right some real politique
you know some some this is the truth
about the world you don't want to see me
all right uh
uh
i don't know
i don't know that much about this stuff
either like i'm not really uh
the only thing i will like the only
thing i will say about me talking about
this stuff is like i don't really know
that much i haven't done that research
that much research i don't spend that
much time thinking about it but i i
don't have an agenda
right
and like
it seems that it's very very hard
the people who do know about this stuff
all seem to they have like this is what
the truth is maybe they don't even think
like this maybe it's just so ingrained
in them that we're trying to we're
trying to manipulate people
we're trying to you know manufacture
consent for whatever whatever
um when hots manifest though what would
i what would i write in the hots
manifest though
uh
russia will be pushed out of ukraine and
the russian federation will collapse i
don't think i believe that
um oh god i don't know man you know
whenever people ask me about that like
the social impact ai
i just like look at them and i'm like
dude
please tell me about the social impact
of the loom
like you blood-eyed motherfucker like
you know
wait guys let's just stop
why don't we all stop building
technology right
let's just stop
[Laughter]
[Music]
[Laughter]
i'm not locked in here with you you are
locked in here with me
[Laughter]
oh
dude you know
uh
um
maybe people never had perspective right
maybe people never had
a kind of historical perspective on the
world
and people had always been thinking
about whatever the issue of the day is
or
uh communism is eating the world right
now
i don't know about that bro
i don't know
there's always there's always been
commie agitators
i mean look it all came about after the
previous industrial revolution right
after the previous industrial revolution
we all had to like go to commie shit
right like a lot of the world did call
me shit and like well you see how it
worked for all the comedy shit places
right
like
some of them
collapsed because commie shit sucks and
some of them just kept the word
communist and are actually the most
capitalist places i've ever been like
vietnam and malaysia i know malaysia is
communist but vietnam you go to vietnam
and like dude i think
i went to vietnam and you go to vietnam
and like
so it's one of these countries where you
need visa so we got like a visa at the
border they yelled at us we did it wrong
it was like communist things and i'm
like yo guys like is this not like a
chill place
if we get to vietnam
vietnam
is
so interesting fact about vietnam if you
ask
if you ask people capitalism good or bad
95 percent of people say good
it's higher than any other country on
that scale
i don't know if this is still true but
this was true when i looked it up the
u.s is like 70
right vietnam is the most capitalist
place i've ever been when you look at
these markets just just the night
markets they come out every night and
they're sprawling you can buy anything
in these markets and trust me no one's
telling the vendors what they have to
set their prices to
it's it's unbelievable
um
so uh i don't know how this relates to
my original point but uh you know uh
communist communism sucks and people
should be throwing that helicopter
communism is ideologically really weak
because it relies on christian morals
which are dying
i don't know about that
i don't know i think that
that like progressivism or like sjwism
is some
[Music]
weird offshoot of christianity
like and there's been offshoots like
christianity's been forking ever since
you know the king henry viii or
something right let's hang camera the a
the protestants i don't know how much
history do i know um
but
uh
i i i think that that
i don't think it's like i think
christianity just
undergoes these changes
yeah tech health jobs around his
millennials and zoomers reinventing
christian values yeah like
again whether whether you're wearing a
cross around your neck and talking about
how jesus died for your sins america is
unquestionably a christian nation like
sure you can look at the statistics and
all these new people are uh are are like
oh we're atheists now we don't believe
in god
uh okay well you know tell me about what
your thoughts are on your neighbors oh
well you shouldn't covet thy neighbor's
goods bro you know that's a commandment
right like
um communism is the truth the majority
in capitalism is the truth of the
individual
i don't know the distinction i like to
make like if you want to look at a place
and ask is this place communist or is
this place capitalist
uh you just look at markets right and
you ask the question are prices fixed by
a central authority or are prices set in
a decentralized manner by individuals
um and of course every country falls on
a spectrum of this right
so like europe is more communist than
america but then america still has some
things that i think are ridiculous like
minimum wage loss right when you think
about what a minimum wage law is a
minimum wage law says that
uh
i am not allowed to sell my labor below
a certain amount right and this is a
form of price fixing
uh do i agree with elon's population
collapse sorry no i don't
um
i
like
is the future humans right i i don't
really think it is i think that the
future is is
some
human machine hybrid
thing
uh
the
raw number of humans on the planet is
irrelevant
uh
i think that i mean look good on elon
having kids like like you know the way
he's doing i think that that's a pretty
good idea like at least from his
perspective at his age
um
but
it doesn't matter
i i we're either
we're either about to achieve
uh
take off
or
we have a long sort of dark age ahead of
us i don't know i don't think that's
gonna happen like
it's just
it's hard for me to believe that we're
not gonna achieve takeoff
uh
i was way more pro-ubi before covid
uh now i'm super anti-ubi i just like i
saw what happened and i'm like oh my god
wait a second
wait a second
uh no no no don't give no no free money
no don't give the free money away
right it's just it's a bad idea um
yeah
you're gonna the prices are gonna go up
um
you're not gonna make people happier on
that you're just
okay
here's here's my
analytical take on on on ubi and all do
we still is this what the viewers want
is this is this the content the viewers
want all right all right
um
efficient markets
maximize happiness over the long term
all right
uh so
if you're giving ubi out to people
what you're doing is you're transferring
wealth from the productive to the
unproductive right
um
many things the state does effectively
looks like this
and
while
this may look good in the moment and
while people may advocate for it in the
moment
uh the net of the total population even
the people at the bottom ends up losing
over a long time horizon
right
um
we were talking yesterday about
how far the stock market would have to
fall before people started to death in
america and the answer is so
unbelievably far
right how long has it been since there
was serious starvation in america
has there ever been
there might never have been right so we
can ask like another question how far
will the stock market have to fall
before
uh
air travel is not accessible to middle
class americans right and the answer to
that is probably around the 1970s level
if you go back to the 1970s level stock
market inflation adjusted
probably air travel will no longer be
accessible to middle class americans
right so you can imagine a world where
that happens but for america to fall so
far
where uh you know we get
oh but people live in food deserts and
there's food insecurity and like no
there's not no there's not nobody in
america is starving to death
right
yeah you can you know and you'll talk
with some people and they won't even
accept that basic fact and like okay
then you're like never this is just
hopeless right
um
free money got us 10 years closer to
atlas shrugged
yeah
i don't know you read about like
accelerationism and you're like is this
what we want to do do we want do we want
accelerationist should we should we
should we uh
encourage the government to mint the
coin i don't know it's been a while
since i've talked about this stuff
it's all outside my control it's all
just
you can't do anything about it
you know it's like a bunch of people
sitting on a train talking about
like whether we want the train to go no
the track only goes one way man like
you're on this track bro
it's uh yeah it's outside my control
what am i gonna do go go protest you
wanna go protest something someone
should go protest outside cloudflare you
wanna protest something you can actually
influence if a hundred people went
outside cloudflare and said actually
stand for free speech you know i was
giving them praise yesterday and then
they bitched out right
like
oh even in threat to human life yeah bro
let me tell you something a lot of
people fucking died for free speech you
know
right like i don't know i just i just
think that was a bitch move
um
like there there oh we gotta shut it
down there's an imminent throughout the
human life and dude like
i'm not even like you think i'm like
standing up for dude like i went on kiwi
farms like once and i was like i just
don't understand like
this website doesn't even make sense
right like i know the last one was the
daily stormer i've been on a daily storm
when you look at the daily store when
you're like oh okay
i mean this is just a bunch of angry
people right
kiwi farms seem just like
like a bunch of drama like these people
like like weird internet drama with uh
with like
these people who like have you ever
heard the names of like zoe quinn and
brianna wu and chris chan and like all
this like dude i don't know there's a
whole internet subculture for this but
imminent throughout the human life we
must take the website down oh
oh oh don't let these pressure campaigns
when
um oh here's okay here's a good point
then we're gonna get back to work
so um there's two kinds of power
right
um
there's rational power and there's
psychotic power
so
if you're dealing with rational power
um
if you comply with the demands of
rational power
the pressure eases up right
so you can think this is usually how
most government agencies represent
rational power right like you know what
kama we've had a bunch of dealings with
nishta um you know
regardless of how i might feel about it
nishta is largely a rational power
so
i i kind of made the wrong
uh decision at the beginning you know
when i did all the stuff with the
cancelling of the combo one i don't know
maybe that was
expressing some some not quite rational
power but all of the rest of our
dealings with them have been quite
rational we've dealt with them
rationally we've given them a good
response we've we've taken into
consideration what they said and the
pressure led up right so when you comply
with rational power the pressure lets up
psychotic power works the other way
when when someone with psychotic power
is making demands and you give in to
their demands the demands are just going
to become more extreme and ridiculous
giving in to their demands empowers them
right and when you look at the pressure
movement against cloud flare this is an
example of psychotic power not rational
power the next target is going to be
even more reasonable and their next
demands are going to be even more
unreasonable and the only answer to
psychotic power is just to say
no
no i'm not doing that no
um
so yeah i mean a lot of people
when you look at how
certain factions have managed to co-opt
corporations and colleges in america um
it's because these people historically
have been used to dealing with rational
power
okay we're going to give in to their
demands you know what we we should have
a uh
you know we should have a have a have a
uh uh uh
uh
you know what what what whatever uh
mexican student union or whatever right
that seems reasonable rational power
right
uh and
like then you get into the well this
turns out this is not the power you're
dealing with right
you're dealing with a psychotic power
that will now make an even more
ridiculous demand but like well we
actually want all white people to not
come to class today because uh
oppression or something right like
you know now and now you get into this i
don't i shouldn't give examples like
this because examples are always
people like
when you give an example it just like
polarizes people in a certain way
and
then they like lose the ability to think
critically about an issue right like
they they they hear something like that
they have a strong
uh what are the words that it is cash
response
right like a good way to kind of talk
through these kind of things with people
is to make sure you never use
the term that like they've
repeated so so many times right
um
like you look uh
you know and like uh whenever people are
discussing abortion there's all these
like
terms around it
pro-choice pro-life right to choose uh
you know murdering babies and like
all of those terms don't exist to
clarify the issue
they exist to
evoke an emotional response from people
um and then once people are
down at this level of an emotional
response they're not going to be able to
think through
like
implications of anything and again
a lot of people want it this way right
if if you want to if you want to rule a
population it's a lot easier to rule a
population by getting them riled up
about some you know
some some bogus shit then like actually
thinking well okay what are the
long-term implications if we do this
right
um
yeah i read their blog post imminent
threat to human life bro like
all i'll say is like you know
a lot of people died for free speech
right like uh you can't you can't just
one person might die is not a
oh we gotta throw all our principles out
right
um
see you say this the root of all
problems in politics these days that
most people are too irrational and
emotional
i wonder if this has always been true
i don't think it's
worse today than it was in the past i
think maybe we have higher expectations
um i still cannot believe and i'll say
it i'll say it now i said it on all my
covet streams
that cloth masks were a thing right
cloth masks do absolutely nothing to
prevent the spread of respiratory
disease everybody in 2019 knew this
right well a lot of people just didn't
think about it but everybody who was who
was at all uh
if if you spoke to to to like anyone who
ever did any research on this in 2019
and said uh so can we prevent people
from getting the flu if everyone wear
cloth masks they'd be like well no
that's not really how it works right
the summer mask right
um
and yet and yet
uh
you know we had to we had to we had to
live through this and
i when i wrote one of my blog posts was
like i guess i just kind of hoped that
uh humanity was was beyond was beyond
this i guess
you know i
grew up with a very like uh
in the 90s
you know
for example like race relations were
you know
hey
skin color is not important we're all
humans right it was a very
it was a very big tent sort of thing um
i was like yeah this you know this is
really nice it's really nice that like
you know we used to have
things like racism and now these things
are kind of
they're a lot less than they used to be
as dan carlin on one of the uh on one of
his common sense podcasts which you're
like
you know i never thought these things
would like
come back
and yet like here we are right
and i said this is one of my blog posts
it's
like you know regardless of who you
think the racists are right do you think
these like ultra progressive we need to
segregate the
immigration you need to segregate the uh
the student uh
the the the student welcome weeks by
race so that people feel safe right you
have like the racists over here or you
have to be like we can't let these
people immigrate to america because you
know they're like this like race and
they're gonna like uh you know you're
just like dude how are these things how
are they back it's just so sad
all right i don't know
um it just uh now now we're really it
should have been solved a long time ago
but then you're like why did i expect
that you know
why did i expect these things to be
solved
um
they're uh
they're they're they're not gonna be
solved i i think that
i don't know i have some hope for uh
maybe or maybe it's you know still the
uh indoctrination i went through in the
90s but i have some hope for things like
the metaverse
right
but see them like i don't know we'll see
like it'd be nice if everybody could
just present as uh
like anything they wanted
and
but the truth is humans will just find
we'll find something
else maybe it won't stick but like
eventually they'll build up a campaign
for many years and it'll be something
else and
uh
i think the metaverse will be a big
mistake well it's inevitable
we need more love in the world yeah yeah
yeah i know that's the uh the lex
friedman take
um
yeah
yeah
i don't know
i don't know if it's love
i don't have answers
we need more elon's in the world i mean
that would be nice
right
i mean if we could just
i think about it i think about it like
last night i was thinking about it with
comma and like you know all the scams in
the self-driving space see like aurora
you know a bit of this back big
self-driving scam they don't really
affect us
all right the scammers don't really
affect our ability to do things it's
just kind of demoralizing
but
okay don't read it man like it doesn't
matter it doesn't affect you
and i i wish that
i mean it's an individual thing
obviously
like
you could make a decision to let the
stuff affect you or not let this stuff
affect you and i i think you just kind
of have to make it
you have to really accept
and it's always hard i mean it's always
going to be a struggle but because you
know there's a lot of people
um
i just i saw the front thing on twitter
yesterday was like find out if voting
laws have changed in your area yet it's
like a big ad for this
i always just wonder who's pushing these
things and i mean this is something that
kind of sucks about democracy right like
or maybe the saying like you might not
be interested in politics but politics
is interested in you
this is this is upsetting
uh
you nets don't want to instrumentalize
you with political slogans yeah
um
i don't know i mean
like i think we we in the last
eight years have gone through this sort
of
huge period of destruction
um
the destroyers have no ability or
interest in building anything new
uh
they're they're just they're just
they're just it's a virus
um
you know these people don't have a a
coherent uh
big tenth ideology
keep calm and build yeah probably sounds
good i
um
i don't know again i can sit here and
speculate but you can only really just
choose what you do you can't choose what
other people do
uh
start a podcast great i'm gonna
influence people
great
i get everyone to start believing what i
believe what are we gonna do oh i'm not
a movement man
i don't i don't stand for nothing
you know
i'm not trying to tell you how to vote
i don't care you vote
like i don't
uh i'm not trying to i'm not trying to
influence your political opinions
if there's one thing
that i'm trying to do
on this stream
is to get you to think that's it
uh
we all think together right it's good
because i think too like i said i don't
do these dreams for you i do streams for
me
um
to get you to think and to get you to
like
i don't care if you have arguments i
don't agree with
anybody in the world i don't care
i just care if you have arguments that
are like
so obviously wrong
like it's it's not even
you don't even believe these arguments
this is not an argument
and that's what pisses me off
i'll talk to some people it's like
they'll say something and it's like
i don't even think you really believe
that
or if you do you believe it in some like
like like like like
i don't know a four-wheeler you know two
legs good four legs better kind of way
like it's not really thought through
it's just
it's just empty
um
so yeah
uh
you know
you got to earn your right to an opinion
yeah
yeah
all right where are we
and layers
sell you in here
what is the goal for today hopefully to
finish uh i hope we can finish
the the whole thing i hope we can get
all of stable diffusion running in tiny
grad
hmm
m channels is another
channels okay we don't have any channels
in our channels we have
m
channels and
self-doubt channels
channels or channels oh
channels
probably going to be wrong i'm probably
going to have to redo that
so you
drop out
all right so this is paddington let's
get our padding right this time
well i mean the difference is
at the end of the day
there's nothing you can do about
politics but we can actually
make
tiny grab run stable diffusion by the
end of the stream maybe
or maybe i'm being too ambitious so we
can't
but either way we have a fighting chance
all right oh we got res block now we got
to do
norman projen
transformer blocks oh this seems
complicated
norm progen do we have any of this
no we don't have any of this great
all right so we have to write the
different attention block used by this
even though we have an attention block
used by the other one let's hope it has
a different name attention block is it
called attention block oh no it's called
aton block great
so
not to be confused with atom block we
have the attention block
so assassinate me bitch because i'm
doing the same shit martin luther king
did in the same hotel in the same sweet
bitch same balcony like assassinate me
bitch
oh man
love that love that verse
checking in the same hotel in the same
sweet bitch saying about me like
assassinate me bitch
so we're going through the weights one
at a time and we're implementing the
code for them and it just takes time but
we're learning while we do so
jeff bezos you got scammed for 12 eth
you'll be fine you're like the second
richest man in the world
where's project
but there's no project in here either
where does prajn come from
special transformer
okay
it's not a tension block it's a
special transformer
n heads times d head
all right well just say
you know there's like
you know one of my favorite things i say
about about uh
hacking
it's like
you have to stop looking at what people
say things are and you have to start
looking at what things actually are
okay well this is attention one so i
think this is where we have an attention
block
is that what's in a spatial transformer
oh a basic transformer block
inner game is n heads times d hat
how many heads and how many d hat do we
have uh
basic dim and
well we know what they have to add to
i don't know 320 what do you think
32 and 10
probably not right
maybe 10 and 32.
see if the rest of that math works out
basic transformer block
okay layer norm is just group norm with
uh group size equals uh
one
feed forward is just a linear
oh no free forward is more than a linear
it's like this oh god oh that's complex
all right let's go
is that where you can't see i'll move it
down a little
my work
i'm using jelly do i have jelly
they do
um
and then is not defined oh
[Music]
net zero price where's praj coming from
oh
we have a glide glue
something like that
all right you see how we see how those
ones showed up now we have those
you like like glues i've never heard of
a glide glue before
i'm hoping
that we're gonna be through this soon
and it's just gonna be the same crap
repeated over and over again
and then we're gonna do diffusion
diffusion
where's our cross attention
spatial self attention cross attention
oh we have no
no bias
what's the context
oh there's something called
where's the inner game come from doom
heads time heads
i don't know why they don't stick with
the same
please play house you're trolling stop
it
oh i can mix gel use and release
all right uh we got to put the
attentions and the transformer blocks
where are those so here we go
attention
and has
how'd i go
oh am i doing nn
okay uh attention to k-way oh
cue weight's fine but okay so we
actually have to do
context dim
and we have to care about which one's
which
query damn these ones are contact stems
i don't exactly understand this stuff
oh
wait there's not gonna bitch and tell me
yeah you can't have a thingy with before
the thingy
all right we've gotta put a contact stem
sorry
um
where does the tension one come from
well context damn okay this is in the
basic transformer block
where does it come from
nowhere just passes through all the way
literally just passes through all the
way
oh
two out can have a bias
okay we're almost done with the first
input block
we just got to do proj out
uh which is just a comp in the same
place we have project
and it looks like it's just
this but in reverse
okay
we've loaded all these
now please just be a repeat of the last
one
okay
input blocks
yeah it looks pretty much the same
all right let's just get the dimensions
right
okay 320 768.
so this one looks like it's 1280 here
that's the only difference
oh no is that the red block or the rest
box 1280 but now this is 1282. okay
never mind
the next one's still lie down
let's see if that loads
okay
one more
that one loads two
are they all just this oh the next one
has to fail
wait what is this op
weight bias
oh this is this one
it just fails okay fine
this one's going to fail because it's
the wrong size okay good
uh
so this is in layers to weight
uh so that's
god where
input blocks for in layers
where's in layers we don't even have
this stuff
over here in a res block okay so the res
block has a different uh
m channels
ah so this one's only uh
this is less
no that's wrong
oh no don't tell me i need another thing
okay we can't go channels to channels
there we need another thing
are we learning is this how you learn i
don't know or is this just copying and
pasting garbage
it's probably how you learn
oh we have to have another thing called
m channels what we already do
we actually have out channels
and then when we put res blocks
uh okay that's wrong i see
now we have a problem in out layers
where's outliers here uh because we
normalize out channels here
like it's kind of cool you kind of like
understand the structure of these things
right
i really like i really enjoy writing the
forwards a lot more than i enjoy writing
the uh
okay so where is this skip connection in
oh it'd be in here
uh okay so we need a skip connection if
okay that makes a lot of sense uh
if
channel
is not equal to out channels right this
is a classic family res block we have
self dot uh
uh connection equals uh
2d
[Music]
from channels
to up channels
okay skip connection being loaded now
our only problem is the norm here and
it's probably just because i have to
change this number which is 640.
uh maybe this goes to 64.
to do my
head
sizes and counts are a guess
yeah cool it looks
um okay how many more of these do we
have today
major 6 46 40. does someone want to
figure out what these numbers actually
are
i would appreciate it
you can be helpful
you can help the stream
if someone really figures out what those
numbers are i'll give you vip
okay
ooh that's big
all right we have another op block
i can figure out what these op blocks
are
it just looks like a convolution
should i just do that
i don't know
okay
this one's wrong it's going to complain
okay it's complaining because it's
644.80 so we actually need to go up just
that right
six forty four eighty alliance this is
probably also wrong
that i don't like transformers yeah i
just
i i think that they're i don't like the
naming of the transformers
most of my complaints are around me
query key value like it just it just
seems like there's a lot of
this is always my one of my complaints
about deep learning when people like try
to like say things are certain things
and i'm like well why is that that like
do you know
and then like they don't really get a
good answer all right um there's an op
layer there
and then
that's interesting
that one looks like it only has a res
block
okay cool we just have to get these op
blocks which actually just straight up
look like uh
convolutions but we're gonna have we
can't just call it a convolution because
we need something called up
self.up
here we go
it's called down sample
is it or is there one another one called
up sample and i didn't use the right one
all right it's calm
this is easy
channels
channels self dot op equals what are
these columns
three by threes and they don't do
anything what
i don't know man
hang on
oh you're scared
what are the rules for chat if you're
asking that question you're probably
breaking the rules you know
the rules for chat are like
i was about to say you know like
exactly let me not use let me not use
cash responses
um
here's basically the rules for any
social environment
show up stay quiet
look at the interactions people are
having with each other look at the
positive interactions look at the
negative interactions and try to be the
positive type right this is a good rule
for absolutely any social environment
including my twitch channel if you show
up at a sports bar and you say can i
please see the rules for the chat around
here
what do you think someone's gonna say to
you right right clearly
we support the yankees and we hate the
red sox okay and if you can't fucking
figure that out get out of the bar
read the room there we go
bro
bro
jose canseco
escalated quickly that's right
get him out of here
i don't understand i put those ops in
why are there no ops
six
oh that's right
self op equals oh
that
the yankees do suck i agree with this
we were i was a mets fan growing up you
know as much as i could be a fan of any
grown men throwing a ball around on the
field
ah my dad liked events so i like the
mets you know it's like it's like it's
like being a catholic it's the same
thing parents catholic you're a catholic
your parents mets fans you're a mets fan
right
you could go out maybe in your 20s you
could find like the truth about there
being other sports teams out there and
like hey man maybe the patriots are okay
you know
um specified in the v1
no that's not what i'm talking about
that's not what i'm talking about
you know what you did great great great
great we're learning we're learning
that's not what i'm talking about i want
to know these numbers these numbers over
here
uh okay
we have a middle block
and then we have output blocks
oh and then we're like done well there's
not too much more okay we did the input
blocks oh things tend to go faster when
we have all like the base classes
let's go find out what the middle block
is
uh
in layers
and layers out layers so that's a rez
it looks like it's just a res block
straight up it's not like this nested
stuff again
res block 20 2080 okay let's just try
that
no that didn't load any middle block
oh it's because i named it middle blocks
it's just a middle block it's a single
block
uh and that's dot zero and that's in
layers okay cool
yeah i think it's in head i think that
too but then it changes
right
it changes though it's not just that
all right what about those ones
um
it's unusual to change the number of
heads so it's just the dimension that
changes
all right we'll confirm that
and you said some smart things yesterday
and then
okay good we got our middle block what's
the next middle block uh
norm proj transformer blocks okay so
it's the thing that has a transformer
block so it's a spatial transformer
um
let's plug is this
right i don't understand why the middle
block is special and it's not just an
input block but whatever
hey man to each their own you know some
people want to be a middle class
and we support people with all different
sorts of diverse identities
including middle blocks i identify as a
middle block this thing identifies the
middle walk this train that's great
we're supporting its choices
all right now we gotta do output blocks
oh that's a big number look at that big
number
can you believe that number's so large i
can't
shhh
i just i keep thinking i got the machine
gun kelly this in my head you know
ow kelly ooh
i'm 45 and i'm still out selling you
this is what i'm thinking about yeah i'm
sure it could be done semi-automatically
but then would we be learning
all right like like all auto generated
code like yes you can make
auto-generated code
but it's not like nice you know
looks like they're all the same
two has a second thing here like a down
sample layer or something
what that is
up sample
uh no i never met kanye
yeah it kind of wants to chill though
i'm down i'm down
i'll come out the white only let's chill
bro
let's show i'm very much on your side in
the feud with uh
ms kardashian
ms kardashian
i think she wronged you bro
all right we have one called up sample
i'm going to make a up sample too i just
have a down sample
i'm going to guess by the way
uh okay this rez block has a skip
connection because it's going
up or something
do they all have skip connections oh
they do
interesting
okay
output block 2 here has a transformer
can tiny greg break shaw 256 man
sometimes i like this idea
like when people say something stupid
it's like
if you can back this up with any
reasonable degree of anything i'll give
you a real answer about like the fact
that neural networks are very linear and
hash functions are very non-linear and
like we can talk about how searching in
non-linear space can't be done with
convex
optimization functions right you know
like we can have a real talk about that
but i don't think you understand any of
those words so why would we have to talk
about that like that's the problem man
let's shame dumb questions yeah i think
so i think so it's a dumb question
now takes so long to initialize now oh
that's why i'm waiting
even though i don't have real on it's
still taking forever
okay transformer layer in
1920 okay well this one's going to crash
good
shows we're actually doing something
i have to figure out which 1280 i have
to change to a 19 something
here we go
oh okay so we got to change the 1260 to
1920.
for some random reason i don't know does
this work
ah like look how long this takes to
initialize now now that it's gotta like
now that it has all these weights
i didn't even set real equal to one so
it shouldn't even be loading them
oh this is a big uh
all right we have a down sample layer
here or up sample
five
um five two is just gonna be
this one is just gonna be this but i
think that's actually wrong
what's seven
seven is a resin a transformer
eight is a res a transformer and a down
and up sample
the up sample looks like it's 6 40 so at
least get that dimension right
um
what's 9
9 is a resin a transformer
10 is a resonant transformer and 11 is a
resonant
transformer eight nine ten
zero one two three four five six seven
eight nine ten eleven
all right eleven to the transformer all
right let's go
we just gotta change those numbers
oh man
this takes forever now
i hear my poor fan spinning up on my cpu
um part of the problem actually
is we're doing tensor dot uniform
maybe we shouldn't
i'm going to create another i'm going to
create one called tensor empty
so we don't actually want uniform a lot
here
um
let's see if this works
um
yeah but then you get to like conf to d
and it still has uniform
i'll just change it for now
it's going to break all the tests
the other alternative is we could make
it uh
no this doesn't work
first off because that's kind of the
wrong i didn't copy the right one but
this is slow
we we did that yesterday agi fire alarm
we'll we'll go back
uh
congratulations you're a vip on the
channel
thank you for following along
um
this is taking a long time
all right you know what
we're just going to make a method called
empty
and we can say even uh np dot empty
actually looks a lot more like something
like ones we'll put it up there
you should deal with the initialization
in a different place
by the way i definitely have more
yeah i have definitely more tense
without uniforms
i understand why they didn't show up in
my search
okay
notice how it loads a lot faster now
um let me actually quickly make a print
on here
we'll see if we get any gears
oh here's okay
um so empty is still slower than i want
because i actually don't want this to be
mp.empty
um
could we create a lazy buffer
see if this works
yeah
i just wouldn't have an op
we have to make up for that like a load
up just called empty
and i mean that's kind of upsetting that
that's in comms
we have to just think through how tiny
grad does that better
um so what tensor dot uniform is doing
is it's
it's it's kind of i'm conflating two
concerns right i'm conflating both the
structure of the tensors and the
initialization of them
um uniform works pretty well for
initialization of neural nets but
there's even better
there's better initializers and we
should just really separate out the
initializers entirely
uh from
uh
this stuff right we can have something
specially marked empty
that's initialized
it's probably the way to do it but i
don't know i haven't given too much
thought to it uh
let's go here zero one two three four
five right and we'll just put a comment
here hold six
um this is uh
probably this one
maybe it's this one
yeah it's out channels
okay so where's our problem uh in
norm.wait
oh yeah so this is
here
after that
uh
i don't know there might be a quick way
to do this
i probably should have like read them
all and then like not
done this but
whatever
whatever
is it this in reverse
can we see the pattern in backwards
no we don't see 1920s
i don't know oh this isn't too slow
okay our in layer here is 960
whereas our in layer up here is uh
1280 so we only do 960 here
um
we want to do
probably 640.
i think oh this one does have an up
sample
i don't really understand what the up
samples do either
uh i already in layer nine so i got that
right
i guess it's 640 here also
we'll be done with this in a minute
sorry it's slow
uh
all right
this is a 320 on nine
six seven eight nine so it's actually
320.
all right uh we have a 1920 here should
actually be a 640
i'm gonna guess this is 320
32 we're almost done boys are almost
done
lots of subs today thank you for
subscribing i appreciate you
oh you know there's two types of people
in the world there's subs and there's
non-subs
what does that say about you if you
notice up right
it's a true dichotomy right there's two
types of people in the world
the swin transformer all right
uh
i don't know it seems like a pretty
straightforward transformer okay
good well we're done
we're done that was the diffusion model
all right there's your model
look at it for a little bit and i'll be
right back
my phone
ow kelly oh i'm 45 and i'm still
outselling you
what
all right boys
we got a great spin drift
uh
also i want to uh
i wanna uh
uh transformers are simple efficient
world models uh i wanna i wanna i was i
was quick to dismiss this paper
yesterday
um
because i disliked the title and i do
dislike the title
but uh i read the paper and it's it's
pretty good actually like
i don't know i
like there's cool stuff in here i i just
it it's almost like we i agree the
pineapple's best
it's almost like we need better like
language talk about this stuff
right just because
what does this mean
it's just like
the term grates on me because
like sample efficient with respect to
what
um
like sample efficient on the environment
or sample efficient
in general
um
and the answer seems to be
they spent
tons and tons of time
training the thing
and then it only took a little bit of
time to to learn it like
well i and that's the question right is
this sample efficient with respect to
the uh
the
simulator or sample efficient with
respect to how many examples they take
to train right because i mean we know
that's not true we know that it takes
way unless something's changed it takes
10x the time and data to train visual
transformers versus like efficient nets
right i'm going to make sense because
you're baking less from prior into the
into the network
um
okay i'll actually say this with one
other caveat you're baking less of a
prior to the network and you're also
using the same optimizer it is very
possible that we're gonna find some
optimizer or some optimization
strategies in the future that are
capable of learning visual transformers
uh both faster and more with more data
efficiency than than confidence right
like and you can do this with you okay
um
does everyone know what the universal
fryer is
does everyone understand truly what the
universal prior means
there is
you can look at like a confident and say
that in a convnet
uh
we've baked in a prior
about like
uh spatial locality right a confident
base in a spatial locality prior whereas
a visual transformer bakes in this prior
it's still sort of there in the fact
that you could like whether like the
paper is like a picture is worth 16 by
16 words or something and you're
chunking the image right
um this is a little transformer
yeah an image is worth 16 by 16 words
right
uh so
well sample efficient means
uh
no need for large sample size to to
train
yes but like
what right
so this is like the visual transformers
paper at least the one that i know about
i don't know if there's another one but
these things take way longer to train uh
than the equivalent combats um but they
do event yeah here we know the visual
transformers have much less image
specific inductive bias in cnns right
inductive bias does that mean the same
thing as prior
uh yeah okay fine so i they're using
inductive price the same way i'm using
the word uh prior uh so
the continents have a strong spatial
locality prior in the structure of the
network whereas like visual transformers
don't you know
this explains it better than i could um
but there is this thing called the
universal prior and the universal prior
says that
shorter programs are more likely
so there's definitely a way if you could
put the the the god tier of
regularization that you want is columnar
graph regularization
if you could tell your model to learn a
set of weights such that the weights
were maximally compressible
uh
you would get all of these things kind
of for free
right you could just have
large dense layers
right with massive amounts of weights
who cares
um
but there's not unfortunately komograph
complexity is
in its limits uncomputable
just because it's uncomputable doesn't
actually mean it's
bad though like you could actually
imagine making something to train like
this there's a uh
it's a schmidt hoover paper from back in
the day compress wait
search here um
2013 wow
that's newer than i thought but um
so
like
in one way to put the chronograph prior
on your networks is to uh actually
search in a compressed space you don't
have to search in a compressed space you
can also just use a compressor and then
treat that as like a reward function for
your learning loop
um
yeah
i don't know how we got to this oh yes
i i was i was hating on the word
dude
this title just triggers me
it's like
uh deep reinforcement all right let's
really let's really try deep
reinforcement agents are notoriously
sample inefficient
uh
recently many model-based methods have
been designed to address this issue with
learning in the imagination of a world
model being one of the most prominent
approaches
however while virtually unlimited
interaction with a simulated environment
sounds appealing the world model has to
be accurate over extended periods of
times motivated by the success of
transformers and sequel modeling class
we introduce iris a data efficient agent
that learns in a world
model composed of a discrete auto
encoder and a progressive transformer
uh
with the equivalent of only two hours of
gameplay but
does this mean two hours of gameplay
after you've pre-trained your auto
encoder
or two hours of gameplay like like does
this include the training of the world
model
the ideal thing mathematically is to
build a maximally compressive model in
the world yeah
you guys know
i mean i came into deep learning kind of
in a different way from a lot of people
i came in through this stuff and i came
in through the hutter prize
um
like i had this book
uh on on on my shelf
when i was like right out of high school
i was like 18
and i was like man if i could just
understand uh the math in this book
i could uh solve ai right
um and part of this is like
naivety in my youth i'm like well george
you didn't think this through for a
minute obviously the guy who wrote the
book understands the math in the book
and he didn't solve ai so how could you
possibly think that if you understood
the math in this book you could solve a
i
right i don't know why like you know
when you're like 18 19 your brain
doesn't really work right and you don't
really think that through but it's
obviously true
um
maybe it's impossible to reach optimal
compression by following gradients uh
the gradient of the compression's most
useful signal to follow
i mean
well the problem with the gradient of
the compression is what compression
algorithm are you're using that's
differentiable right
like the compression algorithms i'm
proposing in the search thing would not
be differentiable compression algorithms
would llm what the hell is that
impossible to reach optimal compression
by following
well
it's not just a question of that right
like the way that we're doing gradient
descent today
um for example you have like a dense
weight matrix right and there's a
million weights in a weight matrix right
but
um so
like one of the things that we'll do to
kind of
incentivize some compressibility is
we'll use like weight decay right so
weight decay if you have weights that
are zero everyone knows like lots of
zeros are really compressible right if
only like 10 of my weights actually have
values and ninety percent of them are
zero that's compressible on the surface
right
um and that's differentiable i can
weight decay is incredibly different
it's completely differentiable it's in
the optimizer's fine but
what's hard to make differentiable is
like okay so what if i have a matrix and
i have a structure in the matrix
repeated in multiple places
right i mean this is clearly uh
compressible
i could just say copy and paste maybe
encode a small noise vector on top of it
but there's no regularization that i'm
aware of in neural networks today that
will
allow that to work or you can imagine a
convent with no weight chair right um it
is just kind of by
the definition of a convolution that we
say that uh the weights are shared right
i'm using the same weights every place i
do the convolution but you can imagine
there's probably even some like
parameters or like groups or something
uh you think of like a i think a depth
wise no deathwise convolution still has
a spatial shared um
but uh
do i think we need a breakthrough in
neuroscience in order to build agi
did we need a breakthrough in in bird
biology to build planes
what
yeah bro once we finally understood why
hawks have red feathers and black
feathers we could build triple sevens
man
uh
i think neuroscience is a pretty
uh
junk way of understanding the brain too
like i've never seen any insights from
neuroscience that i thought were really
any good
uh you know the paper i love could a
neuroscientist understand a
microprocessor and the answer is
not at all
um
the best insights i've seen into how the
brain works are just like the kind of
intuitive obvious ones
just like
uh well i mean this is how these things
used to work like just black boxes and
just like look at what they do right and
then just think about okay well what
does it have right
well evolution has nothing to do with
the okay so
you can separate the human into two
parts right you have the part of the
human that evolved
which is think of it like the code and
then you have the weights which i
learned throughout your lifetime right
so there's the structure of the network
and the structure of the network is
uh i mean it's somewhat procedurally
generated right like you think of like
procedurally generated video game so the
brain's procedurally uh
generated but
the
weights
are just some initialization you see
babies that uninitialize weights pretty
much
um
no well yeah but the reflexes are
probably much more to do with like the
architecture right
um
so
if you wanna
oh alex text mail i like this tweet uh
the two jobs that exist today are
one being on the computer and two
bringing things to people who are on the
computer
some researchers think bro
you ever heard of weasel words
some researchers think well some
researchers think cloth masks are good
good some researchers are idiots
are you selling your soul to the devil
if you take a job but huawei
bro
you take your job as a software
developer all right you know what i'm
gonna engage with this for a minute you
american or chinese and you know let's
say both ethnically and citizenship-wise
canada
all right you're canadian
ethnically chinese-canadian
why do you believe propaganda about
huawei being evil this is american
propaganda designed to like
white canadian okay
even i mean yeah i would hope that if
you were you're ethnically chinese or
raised in china you would understand
that almost all the american propaganda
about china is total bullshit
right
like like
you just
i mean i i spent a year of my life there
right like
it's
you know you know the one that the one
that's still that i brought it up last
night the one that kills me is foxconn
and suicide nets
the suicide rate is lower at foxconn
than it is in china in general and
before you criticize china in general
the suicide rate in china in general is
lower than the suicide rate in the
united states
like
you know you got you gotta you gotta
look at these things that uh
right
dude
uh
so are like
is huawei more evil than google probably
not
probably similar huawei makes hardware
they're probably even better probably
smaller apple right like is apple evil i
don't know
all right i'm sorry i engaged with that
but
please don't believe any of the
propaganda about the chinese you know
you know what propaganda like it's like
would you go to china and believe the
chinese propaganda about the rest of the
world
like no
just china under report stats dude like
does america under report stats i you
know i just
oh my god or like here's another one
right
remember when america was big on
criticizing russia for interference in
elections
wow
wow talk about the pot calling the
kettle america is the world's largest
interferer in elections and like this is
just a fact
um
all right so like i don't know man but
then then oh my god i say this stuff and
then people are like good america
america dude i love america it's the
greatest country in the world it's the
greatest country to ever exist and we'll
kick your ass all right wow how do you
believe both these things easy bro easy
i can believe seven impossible things
and i haven't even had breakfast yet
alex
what do you mean yeah i work 996 bro
like most people at coma work
effectively 996. no one forces you to do
it
like it's just
when you have a place where like growth
is possible why would you not work 996
you know
just tell me more about your work-life
balance you know why the companies want
work-life balance it's because when
you're working you're not spending money
on bullshit right like that's why the
media promotes all this stuff
the media doesn't care about your mental
health the media is just chill for all
the like it turns out when you're at
work you're not spending money on
consumer goods
um for weight initialization oh making
fp2s directly uh
oh yeah cool uh
pull request do a pull request for that
i'll merge it
yeah you're right i'm creating float64s
thank you thank you for subscribing
uh okay
okay we have to do out as well we have
one more but we're almost done
what's ema
yes fantastic thank you oh that's that's
that's ten dollars thank you
i'm gonna go buy a coffee or something
oh the story about how i got the
optimism
yeah man it's kind of sad you know i
haven't heard from them after they did
their token sale
i mean
you know
i think maybe it's kind of like
you ever have a friend who's like dating
like a shitty girl
and like one night you know maybe after
a couple beers you sit him down and
you're like like
bro
you know she's terrible right
um and then usually what ends up
happening here is your friend uh instead
of being like you know what i agree with
you man i really appreciate that i got
bros like this in my life telling me
this stuff you know he just gets upset
and defensive and then like you know a
couple years go by and you find out
you're not really friends anymore right
and like especially if he stays with a
girl right
um so you know it's kind of like that
it's like do you want to do token sales
and i'm like oh you know why why do you
do that how do you do that it's sad it's
sad look i still have hope you know i
still like optimism
but uh
you know when you start
every company that does a spac
like there's never going to be a good
company that does us back
it's just so obvious from the structure
of it
um
you know and unfortunately there's
idiots who buy into spax but see the
people who buy into specs they're not
even idiots right like the people who
buy into stacks are like well it doesn't
matter if it's good it matters if i'm in
before other people right
and it's the same thing right it doesn't
matter if uh
you know your token is is good your
token's good for the project it just
matters if like you know you're running
for the people
i don't know
like i when i see this stuff i'm not
sure how much people believe it or how
much they just like like and it's so
easy like i'm not saying i'm immune to
this i'll do this kind of stuff all the
time it's only you know with a lot of
hindsight you really gotta like when
something was five years ago it's like
oh my god like
i didn't actually believe that i was
just that was all motivated reasoning
bro like motivated reasoning is really
hard check out uh check out the scout
mindset
uh julia gelf's book
she talks about this
please don't go back to blockchain
don't worry don't worry
do that right i probably did that wrong
okay we don't have the ema
uh we did get that one right
i don't know what ema's i don't think
that matters
all right i think we're done that's the
diffusion model
oh
huh
cool
neat trick and people are using this we
should do this a comma
no we should do this a comma like we uh
we just like we'll pick a checkpoint at
random we should just average do do do
that
all right maybe we'll add ema to our
training i think that sounds pretty easy
to do that's not even training it's just
like our uh i don't know one vip per
channel made by allen can maybe earn it
next next next
i do appreciate the link
okay
uh
all right let's just see if this works
it's something like this right
oh sorry
x dot sequential
let's help that out
[Music]
this is
[Music]
your brain
unit testing what does it look like i'm
at work bro we're here to party
would you unit test at a party
would you download a car
i think this is the size right
this work
no we didn't write any of the other
forwards
diffusion model object is not callable
okay oh we got to make it callable
there's a diffusion model
yeah
oh diffusion model
oh
okay now we hit the first problem
by the way how much time we're wasting
on those prints
this is supposed to be the input size
right
all right uh
can't reshape
the first thing we're trying to do here
is oh probably it's not time in bed
i'd say that isn't right
how do i use
uh jagger on topic please
there's time for questions and there's
time for on topic and now it's time for
on topic and you know read the room bro
read the room we don't like the yankees
around here bro this is boston
you know
is it an up down
[Music]
well
we're passing the m as well
uh
no this is more complicated than that
okay what are the
timestamp embedding channels
we have this completely other thing it
seems like
we actually can't do sequential there it
looks like
i mean look at the call to res block
right it requires two inputs
a residual block that can optionally
change number traps great
return
checkpoint
amp
can serve time stamp embeddings
is that supposed to be edible
[Music]
it's really right
do this
self is not defined though
but then this stuff isn't right down
here in my unit model so we'll have to
figure it out
because we can't just use sequential
there
it's a time stamp embed sequential what
is that
what's a time step block
oh okay so a resnet block is a time step
block i understand
uh
i don't know
i probably don't want sequential there
then we probably want to do
oh and then does unit model take in a uh
call here does it take in this embedding
oh okay so we get this from
oh there's this function called
timestamp embedding okay i say
yeah yeah um
okay uh four x and b uh i'm just like
for uh
bb and b uh if
his instants bb res block
uh
x equals uh bb sub x comma m
uh else x equals x
[Music]
we want this like everywhere
i don't know this is just ugly coffee
paste
that's terrible that looks terrible when
i write such bad looking stuff um
and then that's okay for ouch
for time in bed we have to do something
else
uh
so self.time in bed
no that's not right
oh well they can do that because it's
yeah
create sinusoidal temp
repeat only is false
if not repeat only or we have to do all
this complicated garbage
uh return and nx dim
i don't know let's just try it um
tm equals tensor dot uniform
uh
n by dim
so where's dim 320 or something
i mean yeah okay if the time in bet is
that right so we'll just do uh
20 and then we can say
um
m equals t m dot sequential
time in bed
to do real
time embedding
i don't know i don't know how
transformers work maybe today's the day
we're gonna learn
uh
yeah the forward diffusion process is
not time i looked into more what the
forward diffusion process is it's really
cool actually
um i cannot reshape
yeah i think we actually might not want
linear there
no way we should
i don't know
why are you trying to reshape that into
that
self got weight
should be right
i don't understand that should be right
right
so
is it backwards
no i can't because
i have to do transpose here by the way
does dot t did i make that work
i don't think i did
okay
uh
commented out
uh list object is not callable
that's understanding
uh yeah i want to do uh
so sequential is just uh syntactic sugar
around uh
like it's like a reduce it just applies
the layers one at a time
i think that's a lot cleaner than the
way torch does it
uh list objects is not called okay same
issue here
m dot sequential
alright so instead of specifying it in a
class which makes it harder to see we
just like explicitly do it there
like you could create a class like the
either the pytorch sequential class up
here
uh but if we do it here it forces that
to be illuminated in the if you think of
this as defining the structure and this
is defining the way it runs it i think
it makes more sense to have it down here
um
spatial transformer object is not
callable okay well that one we're gonna
have to write
here we go
oh that's cool using inops
or do we have context
oh we might have context
it's right isn't it
actually let's do the reshaping on the
permute
you
okay we'll do it explicitly
uh
permeate first
this transformer block
looks simple enough
almost can just be copied
i don't know what contacts we need
make our feed forward fall ball
bro
just because you subscribe doesn't mean
we're going off topic i don't know why
why you think
oh man
45 and i'm still out selling you
[Music]
oh we do have something else called
contacts dammit
[Music]
doing
by the way is this a
custom defined great
that'd be cool that was built into
python
just cross attention it's here all right
we do have to pass in uh
see like i think that default thing is
much nicer i wish it was built into
python
um
[Music]
all right i don't actually know if it's
the same they used inops here i know
it's really cool we should actually just
make inops probably work with uh
with tiny red
okay what's this bug
uh
issue here
this is a norm
i see
oh
yeah i think
yeah okay what channel do they actually
want that one
okay
no
same problem
oh no it's just different ah
oh i didn't know that the next happened
on her
interesting
uh
okay i don't think we actually need
those
reshapes
uh we might need a k reshape
uh
channels are already at the end
don't need a q reshape
what
no this isn't right
god okay never mind i do have to look
what is it
uh rearrange
man
man that's complex
i want to permute it actually
all right
let's rewrite
uh
v dot reshape w dot permute
this one's got to be permuted also
i don't think i want to then reshape it
to that i think i want to god but
they're okay they're avoiding a permute
there
i think i can just do that
and then
i'm not even sure i need to reshape it
it might just be right
all right where's my problem now
self-attention to
and
this is because i'm not passing in this
one needs context right
if we go back to basic transformer block
we need to pass in some context vector
which i don't know where it comes from
this guy
context
then where do we actually create a basic
transformer block here where we're
getting this context from we're going to
look at the spatial transformer
our contacts
where we call the spatial transformer
down here okay and where does my context
come from in the unit model let's take a
look at it
all right so my understanding is with
these transformers the context is what's
going to be generated by the clip model
um we don't necessarily have to pass in
context because i'm the same size so
maybe we do
is m the context
it could be this
no we do pass it on
one more time
spatial transformer have that like time
awareness or whatever
no it's just an module
i don't know let's run it see what
happens
it's still wrong just because we're not
passing in the context
timestamp and bad sequential attention
blog l spatial transformer context dem
all right the context dim is clearly not
equal to so there's something that's 768
everywhere
uh where else do we see 768
nowhere
just must get just pat i mean this has
to get past the unit because it comes
from clip right
yeah okay here's just context
conditional plugged in via cross
attention
and in terms of labels
um
so
and when we call this thing we have to
create a context
let's just try this
all right none type has no attribute
sequential
uh oops
all right it doesn't like my permute
here
k dot permute why not
shapes are like types bros if you get
your shapes right you got your types
right
oh okay i don't understand oh because
context isn't really that
uh it's the wrong size for context
i don't know
what am i supposed to put in here
that
let's try it
no it's clearly not that
um
i mean here so it's good to know that
the clip model
look at the clip model right that's the
dimension of the clip model so we're
doing something kind of right
the question is what's the
dimension
there mean
just do the math and say
doesn't even that's not right
so the time steps have to be basically
the same
maybe it's this
it's a really big matrix but could be
that
some bug
tiny ground needs better errors
these errors are pretty confusing
so when we're trying to add x here
do we need some matching thing or can we
just do that
no i mean the feed forward should have
the same output dimension unless my glue
is wrong
oh well this is totally wrong
let's just make this right
[Music]
uh okay
this
that's it that's a good idea
use prime numbers for your stuff
agi fire alarm if you don't want to be
asking do you work on this stuff like do
you uh
you have a job working on this stuff
uh you do phd yeah
just write chunk
um
some of this can be fixed with syntactic
sugar
and so many lines
so many lines
oh
does someone want to write tests for
trump
by the way am i over the line count in
tiny crowd now
oh we're over the line count
more over the line count it's too many
lines
oh we have to say arg equals and slice
too it's even worse
that's not really where chunk should be
by the way i'm gonna move chunk
what's up i like cat and stuff
i just use slot count
slot counts the canonical way in tiny
grad
they're all kind of similar right like
chunk
hello
would you like some clothes oh yeah what
do we got
hello
your class right now
no i'm foam rolling
oh
it hurts so much
i know
my fingers almost have their feeling
back
yeah we're talking to alex
we're streaming we're talking to alex
yeah yeah yeah we can't say any
inappropriate stuff cause foreign
as if i would do that regardless
that's a good point we're very
appropriate people
i think so
in little um
or i could drive out of a car
oh i mean what are you in the mood for
i'm just thinking an acai bowl
from the
choice juicer i like like choice juicy
acid balls yeah
do you have a preferred bowl
i just get the normal one and i add some
bananas and i know they're just sugar
sticks but i love bananas
it's a normal acai bowl with like
granola you know it's got that crunch to
it you know as i use a superfood
from brazil which is where
my family's from yeah when you go there
you can get it like the real stuff the
promise they like freeze it and they
fill it with sugar to preserve it and to
beat it to americans it's not the same
that's a shame bro
you know what i loved in argentina that
i had
mate like real mate not sugar yerba mate
but i bought this like bowl and you put
the stuff in oh i loved it
with the metal straw yeah we could do
the mate you want you want to get some
mate stuff
um
it's okay
um
okay i'll get you up i'll bring you now
thank you alex
the rules don't apply to me yo i used to
say this kind of stuff all the time it's
like man like there's people that will
supply you and then there's me and the
rules don't apply to me all right
uh
yeah okay so self prod x chunk two dim
minus one
x
what is it x comma gate
something like
that's cool this is a cool unit right
there i should think more about what
that actually does
x times gate
let's just read the
torch
if it's not divisible
the tensor size is not divisible by
chunks
oh okay well we don't actually need that
assert
now let me just think of how this is
going to be hey
uh
i'm just throwing max on there
oh man
i always get my mins and my maxes
confused it's min
yeah that's right
oh i shall shoot damn okay it's lost
i'll shoot and divide by the by my knob
great when we save the line
yeah you know what probably a better way
to do this
and we could create like that we could
do this we could do like slices equals
um
slice
params
um
all right did i even do this right is
this
oh yeah
all right
and we're still going to lose one line
tiny grads back in the thousand lines
and the world's happy
where is this book
here
all right still in here
wait what
did i just copy and paste this this
can't be right
this can't be right
we copy and pasted garbage and now it's
wrong
yeah huh
thank you for subscribing my friends
down sample object is not callable okay
well that's not a hard problem to solve
where's my down sample object
probably commit we haven't come in a
long time
oh by the way does someone want to do me
a favor and uh write some tests for
chunk
yeah
write some write some tests for chunk oh
crap
uh
that's wrong
did we did you submit that pull request
by the way for uniform that i asked for
you didn't submit that pull request
um
because i can't commit that with uh
without
um
[Music]
oh attending the dot pines here um
slow a lot slower
oh it's so slow
oh six seconds bro
yeah two seconds all right great
uh let's
look at uniform and see what's we're
doing there it's intenser
uniform
uh okay np random uniform
this doesn't take a you had some way to
do it
um
numpy random default rng
you didn't submit the pull request
all right here it is
this should be 2x faster than uniform np
uniform
well it's not
oh well that's not going to be uniform
uh
discrete uniform
floating point random numbers return
random floats oh
oh it is
really
random generator
uniform
oh but if i do that then it doesn't have
a d type
this is terrible
it will always be slightly faster if i
move the type there
and then do the square root after
i don't want uniform i want stupid uh
should be full 32 right
a little faster
marginally
the rng floats fourth floor 32 but not
oh this is terrible
uniform
should be a late binding thing
i kind of actually wanted to create that
i want to initialize there for it and
load ups right
it creates this useless thing and we
don't need it
ah
all right fine we will just commit this
and then we'll switch it back
work
that's a great commitment work someone's
going to read that and understand
exactly what i did
just while i'm working on those we waste
six seconds to uh to initialize that all
right
down samples not qualitable that's the
easy fix
i actually think it's literally just
this
they'll probably surprise me and make it
not just
actually it's probably not that
i probably actually have to do a down
sample
uh
stride right
that's fine
up sample i probably have to do an up
sample i i wrote this kind of stuff
yeah so this is the up sample all right
uh okay even if you use calm you start
to do this
i think it's the same stuff it's just
like written in multiple different ways
which is annoying
um
let's just add a little bit of uh print
outs to shape tracker here because we
get this problem a lot um
okay
all right i kind of feel like whatever i
did with context which is where i just
put that big number in was wrong
remember i just randomly put in that big
number here i don't think that's right
i'm not thinking about this right
how did it get 960 ones
that's probably because i have columns
without padding which should have
padding probably an upsampling down
sample did it all right padding
oh the down sample one has weird padding
i did this yesterday
uh the down sample one has to have
it's just zero one zero one
no i mean the up sample one
or the downside was the down sample
upsample has normal padding down sample
has this padding
did not fix the weird 961. let's just
look at all the comps
one by ones it has padding
one by one
padding gas
padding
padding
padding
one by one
padding
one by one
padding
ah this one
okay and now we have a weird shape again
uh
probably because that was never supposed
to be 3a44 i probably made up that weird
number
it should be 496.
okay
now we have a different problem
okay
this input block is where the problem
starts
maybe like n heads and d heads is wrong
and i don't know
how does it have less here
i think that's supposed to be right
looks like
this is supposed to be
down sample
i'll time you out for that comment bro
oh great
i have to work tech beat me to it
what's that other print i have where is
this print coming from
i should always call it like i just put
print in and i think i'm gonna like find
it again and i'm never gonna find here
we go
uh we'll call it attention
cross attention
somehow these are bigger here and then
we down sample and context changes sizes
interesting
oh
why do i think it has to be the same
size
hmm i guess i do add to it there
okay what is the input size of context
can somebody figure that out
i kind of feel like that number doesn't
really even matter it might even be 77
and we're just like not doing something
else right this number might be like 77
let's make it 77 is that prime no it's
not prime 7 times 11.
uh
uh like i might have just written this
wrong
values come from context too maybe they
shouldn't maybe only keys come from
context
let's go look at their implementation of
cross attention
alright so there's self-attention
uh
now it sure looks like both keys and
values come from context
doing some iron sum here which is
actually this
let me do a rearrange
no the context dim that 768 is the base
context damn i'm talking basically about
the time dimension of this thing
like this just might not be right
i i feel like the context dimension's
supposed to cancel out it's not
yeah yeah okay okay i see the
problem uh
it's supposed to cancel out
actually did i just just do this the
other way
that might fix that
yeah the context dimension is the inner
dimension of the uh transformer and it's
supposed to cancel out
there we go
i don't know if it's actually right
we'll have to go through with pi torch
and try to fix this but
okay
uh new problem
we're on to output blocks we went
through all the input blocks
yeah so the the context dimension of the
transformer actually cancels out um
inside of the thing
it's just like it's the inner so if you
think of a transformer it's just a dense
matrix multiply and you think of it like
it's like uh
what is it uh like like
n by k and kym the context is your k
dimension your k dimension is going to
go away
um
i see
so this is probably the length of the
sequence of
from the
clip okay uh can't expand into well
i knew these things were suspicious
like don't they look suspicious look at
this
if your out channels don't equal
you're in channels like how is this
how does this work
where did that big number come from
must be doing something else is that
that times two it is that times 2.
how is it all 1280 1280 1280 1280 and
then we get to the output block and it's
this
there must be some other trick here
input block channels
oh
yeah it's a unit
you guys know about units
you
um we have to basically save the
intermediates from the uh
we have to save the intermediates and
like shove them in right
the unit you know just because it's got
transformers in it doesn't mean it's not
a unit
i gotta spend more time uh adorable i
spent more time learning about
transformers man
if they're here to stay as much as i
might hate them you know
all right that's something like
i probably call it something better than
that let's see what they're calling
no runner don't say initializer
uh forward here we go
all right jess great great name bro
great name love your name
that work
okay we made it to output block two
where we have a problem in cat
i don't know
sure seems right to me
oh there's an extra one
do i put another saved
seems right
oh
oops
bs is not defined
oh this is my down symbol
uh you know shit yes is not defined
cool
guys that's it
it's just ran
using addition instead of concatenation
in the unit
no they don't use
did i use addition
it's concatenation
oh you're saying doing that i don't know
i've always seen units use concatenation
maybe
all right well so it didn't actually run
uh
let's just say it compiled
oh great the tesla fastest
you have to be careful not to add
this
oh fine you know i'll just do it like
this
is this valid python syntax
put this in one
it's probably nicer to do this but
all right now let's see if it actually
runs on my gpu
uh so in order to do that we'll just say
print out dot numpy
uh let's say opencl one option
i was so debugging
okay
fair
uh did it just get super out of hand and
the memory kept growing
also i don't understand why it's not
lazy
like it should be lazy
i don't understand that
like if i do this it's lazy
oh because it realizes the weights
oh it has early weight realization um
let's see if i can run it with gpu
oh that didn't actually run
okay well now we're hitting that bug
again
we're running out of memory guys
thank you
thank you
um and if i uh
i'll run the test and say password
where's the pr
okay um
we're running out of memory
all right we can try this
he's gonna run on my cpu
oh
okay ramp
uh stable diffusion has no
yeah that's fine
i mean it's just running this is running
on my gpu but it's fine
this is using torch on my gpu
but it's not using actual torch it's
using like a torch tiny grad
fusion implementation and it's really
good to debug in so this should be good
cool it's running
is it right
now we find out
all right
let's take our apple and put it through
if you want something extra
they're called like sunrise surprise
balls they're just the most common have
you gotten one from this place before
choice juicer yeah
it normally comes with granola yeah oh
maybe they made it bad i'll settle for
no
[Music]
oh eggs oh i didn't know that was a
possibility
i'll go with this for now
that sounds like lunch
okay
so
we have something that i'm just putting
in zeros now but we don't have to put in
zeros
we can put in the latent space from the
apple
apple
latent
space
um
uh so what we got scp q what is attempt
render dot
render dot png only copy it to there and
then open
there we go
okay
uh we gotta load back the first stage
model
um
oh
no that's not right
what
okay
well that's annoying
out of memory
yo you know what i need
a 30 90.
i don't know what to do
i think i was gonna do this
run
one
but we're out of memory
i have an idea
um
oh yeah right
how nice is that
i mean
as a purely self-interested individual
oh come on
i shouldn't believe it i don't
understand
we ever like called dc
uh oh oh
guys
tensor.nograd equals true of course
it was trying to compute all the grading
it was keeping all the stuff around for
the gradients
um okay
useless
ah
i'm sure that was going to fix up
it takes five minutes on your 30 80.
oh animation
oh actually we never made this
work we only ever made this work with
opencl equals one
bad shape
huh
did i break something
maybe guy broke something
sure seems like that's what happened
maybe here
let me change this did i
i need those empty i didn't change any
of that
why am i getting bad shape for image now
wait i don't understand
i didn't change any of that stuff
somehow length of x shape not equal to
4.
that's the only thing i can think of
now it's four
here
didn't change this though
okay let's try checking out the old one
clearly i broken
never mind this is too frustrating
we're just gonna figure out what the bug
is
you guys remember this worked yesterday
right
now
i don't think that broke it i don't
think that broke it
this didn't break it did i
bias is not none else x
that didn't break it
that didn't break up
moving that up there didn't break it
no i'm using the same thing i was using
yesterday
yeah if we have to we'll go there
okay problems in mid
okay that seems fine
if you go back to what you had 10
minutes ago and don't use the image
you mean don't use the image
it's am i doing something really stupid
i'm loading this tensor
i don't think the input is my image
no that's right
what did i break
whoa
literally the problem was no grad
i don't know how that broke it
interesting there's the apple
dude i don't know
there's no fortunate
hmm
does this actually work if i do this in
pie torch
huh
interesting
assuming that doesn't work
if i do this
that works
does the image look right
guys
sorry i didn't show you the apple
that's crazy man
we're running it on torch cpu and this
works
all right
let's see what it looks like
bros check it out
you can almost make out some apple
all right
that's what happens when you do a pass
of the diffusion network and the context
is totally random
and there's probably bugs
we have to write the clip network
um
it's not completely dark right that's
something
okay well
there's a question of how many
bajillions of bugs there are in this
um probably bajillions
even though my shape is right there i
kind of just don't think this is right
oh well
is c correct no she's correct
no i don't think actually i don't think
c is correct there
i think this is the wrong c
i think uh
no no no it is it is it is
not too much of a difference
runs on torch cpu
all right let's see where i put to do's
uh nope
there's a chance that's wrong i wrote
it's wrong twice
my head sizes and counts are a guess
that's still true
oh
this time embedding's wrong we can fix
that
i mean that we just know is wrong
self.model channels
where does the word time steps come from
1d batch of time steps
no i guess that's the batch size
oh
i don't know if that's right
what happens if i change that
well
why did i do that
hmm
no but pretty far down it fails
so my understanding is it actually is
zero if we're just saying it's time step
zero
see if it looks any different
and then this context is even weirder
no looks the same
well let's just try multiplying the
context by 20 and see if
nope looks the same
okay
uh
so we have 17 million bugs to fix
and
mostly 17 million bugs to fix
we have down samples and up samples and
every kind of sample
this is a
great
this is a really well written unit
if you just look at how they did this
and how like
this turned out to be super simple
um
that's why they need classes for these
the other thing should probably use the
classes
we love the glad glue
oh we need to test for trunks someone
should write that
i don't know like i don't know if that's
right
do
[Music]
now we're in the other one so
start classes for u-net model
all right
how we doing on on viewers 799 viewers
not bad
i'm getting kind of tired
we still gotta write the clip model
yeah quite good day on viewers that's
right
uh let the subscribe non subscribers
talk for a little bit
i think it might be nap time
uh you know we started this stream very
early this morning
um
and then we have two things to do after
nap time
we have to write the
second
we have to write this con stage model
which looks like
yet another implementation of a
transformer
all three of them has this has three
slightly different implementations of
transformers
no one just cleans up all this code you
know
like here's another look at this this is
a
different self-attention layer from the
other self-attention layers at least
this model looks like it's the smallest
why have one when you can have three am
i gonna stream tomorrow i might even
come back on today
we'll see how i'm feeling
um
i think we should implement the con
stage model because the problem is i'm
not really putting in the right thing
here
i just made up some 77 things so like
it's not conditioned on anything
i don't really know what it uh what it
makes it do
three implementations that do the exact
same thing i mean there's like subtle
differences in them and it's like
annoying because you can't load them in
so we have to we'll have to do another
implementation of uh of transformers
to get this to load and match
uh then we have to get it loaded in
torch and we have to actually compare
the things
there's a scatter operation in the
vector quantizer
um
yeah maybe not we don't really have
scatters
we'll see
uh
we'll have to get this last one we'll
have to make sure the output matches
torch then we have to write the sampler
um i don't know how to do any of that
though
i don't know actually maybe it's not
that complicated
maybe it's just no that's the auto
encoder which also can be sampled from
uh
what's a plms sample we're gonna have to
write one of
those um
tiny grad is more than a thousand lines
10 guys not more than a thousand lines
would it be a good exercise to rewrite
tiny grad in a different language maybe
tiny grad makes you truly understand
every little part of that ah
yes we have another with mlp so this
looks really looks like a straight up
transformer
that we're gonna have to write this one
this one's pretty easy though
i mean it's good it forces me to rewrite
this this
qkv thing so many times that like
eventually it's it's drilled in my head
um
yeah
so we'll have to do one more model
actually i know there's a different
weights i know hugging face does
different weights that i think uses
their api so maybe hug and face already
did this
but
uh it's nice that it forces me to uh
did i disable no init
for the last image i don't think i have
to do that
i'll be it's like 77 is something i just
totally made up so
look at this though there's two
attentions where is this
it's like it's cool to like look at uh
you know this this lets you look at all
the structure of this stuff so
um
no not mid block where
there's all the
cue stuff here here
there's two attentions here
this first attention is a self-attention
in the image and the second attention is
an attention that's based off the clip
model
um so you see it's conditioning it at
every
uh thing on the on the clip model
[Music]
so yeah we have to write that
and then we have to
test it all
then we have to write the sampler and
then
finally we'll be able to generate a
picture using tiny grad
oh that will be the day that will be the
day and the day will probably be
tomorrow
uh i might come on more later to do this
uh do you guys want to watch me do
another one of these we know we've done
two they're all pretty much the same
everyone's just using these transformers
and
it's all the same it's all the same
model all right all right all right all
right we'll do another one of these
all right if i if i do it if i do it
i'll i'll come back on uh
after nap time
to see if there's nothing else to do
we'll see
token embedding position embedding
oh no
even worse
yeah spatial transformer
i don't
oh we have to do token embeddings for
clip we're gonna have to write a token
in better
um you know because because these
language models don't just use
this is your dimension you have to embed
the tokens
this is probably like your one hot
encoding space
and this is your uh your vector space
um
at least they gave me a simple weight
matrix for that but we're going to have
to figure out how words correspond to
these things
uh so we'll have to write that
but yeah the text model looks pretty
simple
and like now i feel like doing this you
know you think like oh it's just a lot
of it's a lot of uh you know stupid junk
and you're just like you're doing
nothing but like implementing weird
stuff this could just be done by a
machine like i don't know someone could
have told me that they were using like a
doubly stacked attention layer one of
self-attention and one of attending to
the parameters from clip but i never
would have really understood what that
meant without uh smurfd thank you for
gifting subs
um
i never would have uh
like really understood
what that meant
without
doing this
so it's a uh
worthwhile uh
exercise
wait
yo i just got a text no way
oh that's so sad
so sad
all right on that note sorry we're
ending this on a down note rest in peace
pat's day
uh you were you were the
he's really guys really to go to battle
rap
uh go go check some
uh
pat stay
man man
a month straight when he was on tour
with you which he admit that me and
swish ordered food and he just ate off
hours how ironic he's jewish and he's
scared to take a shower
pat's stay man i'm not the worst kind of
rapper
don't care about his hygiene long as his
bars are dope stinky little brat get a
fucking bar of soap
this is not a joke sticky little brat
get a fucking bar soap rest in peace pat
stay thank you all for watching my
stream maybe we'll be back on later
today
uh to finish this
uh or maybe tomorrow or maybe never i
don't know uh submit pull requests by
the way if you find any bugs i'll be so
happy if you're like bro i got it to
match torch
and you'll learn something while you're
doing it too all right learning uh keep
thinking uh you know don't ever give up
thinking uh you know some people they
give up thinking and as soon as you give
up thinking you give up the only thing
that makes you human man you know what
doesn't think rocks
right
and has everyone anyone ever paid a rock
a six-figure salary only dwayne johnson
doesn't name dwayne john
that's all i'm saying guys keep thinking
don't be a rock not the rock but all
right
let's go let's go i was like am i gonna
stream today
am i gonna stream today i don't know
is this what i'm doing today and the
answer turned out to be yes
uh
pop pop-out chat
all right can we make stable diffusion
work today let's find out
i got something for today too
we're going hard today boys we're gonna
learn today guys
okay
we got
a red
where's everyone
you all hung over you'll go party last
night
hello chatroom hello
oh all right there's someone i don't
even have subscriber only chat on good
morning good morning
hi look we got a red bull today boys
that's proof that we're going hard we're
gonna make this work today
i say this i'm gonna eat my words like
eat my shorts but words
all right everyone get the did we
capture that sound red bull it gives you
wings send me free red bull please
one day we're going to get a sponsor for
this channel
yo if you want to sponsor me i will be
the best show for whatever product it is
that you have
i did you know even if you're selling
even if you're selling guitar mounts to
put your guitar on the wall i'll chill
for that
um you know
even if you're selling
i whatever man whatever
except keyboards i won't shield for
keyboards
all right
on to the next model so there's one more
model oh i don't know why no greg brexit
we never figured that out but
this model is called the conned stage
model and inside the con stage model
there's a transformer
can it be a normal transformer could it
be so normal that i could even just use
the one built into tiny grad no of
course not
okay well let's enjoy writing uh
oh my god look at this
they're all just con stage model
transformer text model
that's like 3d boys look at how deep
that is
and all we have is an encoder we have
embeddings an encoder and a final layer
okay that doesn't seem too bad um
of course this equals
named tuple
text model
uh
we want to have text underscore model
text underscore model equals
oh wait no maybe that's just
i just have text model there okay
no i don't think so
oh text model equals what do we call it
we'll call it uh
see this should be transformer
this should be
con
stage model
we're gonna
i don't really want to talk about what
we're working on other people who are
here explain to explain to toads what
we're working on please can you do that
oh theodore doesn't know bros we've been
working on the same shit for the last
three days do not pay any attention
you know i gotta i gotta get triggered
last man i gotta i gotta
i'm drinking red bull it's a beautiful
morning it's a beautiful morning
oh you checked the title oh yeah we
gotta we got a a-rate genius over here
man you're going to harvard in your
future
it's funny because harvard sucks
all right so today we're writing the con
we're writing the text module
which conditions stuff based on text
and let's just go over here and see
which one it actually is it's called a
frozen clipping better
i wish i could play some copyrighted
music right now
tokenizer transformer
clip text model
oh it's called a clip text transformer
by the way
we have a layer norm here
i'm just going to type in 768.
oh man it's gonna take forever
i don't know i didn't really want to
stream today i just felt like i should
finish it you know
[Music]
you got to finish where you start i got
to be a role model to the kids
um that's ironic by the way i'm not a
role model don't grow up to be like me
grow up to be happy think about it you
could have a farm
and a wife
yeah
that sounds like the ideal happiness you
know what i mean
yeah
role models are guys with farms and
wives who don't think about you know
no not two wives man one wife you know
you gotta just you gotta just be happy
with what you have
like
and then you know you you have children
oh no but you're gonna have to send them
to a government indoctrination school oh
man
you can't escape it you can't escape at
this everywhere
oh it's everywhere man we're just fucked
i have so much copyrighted music i want
to listen to
encoder has layers
i like that they at least call them all
clip
no
no we just don't play time we used to
play copyrighted music these streams
used to be better man
but they've gone downhill and you know
y'all showed up too late okay linear i
have linear don't i
did i get good feedback from my blog
post yeah it was all right i can't
believe how fast hacker news picks up on
those it's really a terribly written
blog
um
which act am i using
great it doesn't tell me
config hidden act what's the default
hidden act can someone figure out which
activation function they're using
maybe it's jelly
the soundcloud magically make it
non-copyrighted no bro
the copyright police are coming for you
man
all right
layers click encoder layer
how many layers do we got
11 layers
got the layer norms oh we need the mlp
where's the mlp here we go
oh i spelt forward wrong we don't even
use forward we use call
i just need to copyright pipe the
copyright music to the live stream only
and not the vod bro
what i got to do to hear this new song
from ludo be an expert at computers
you know like that's how i feel man
nah you know what you know what you know
what's been bumming me out man
the kiwi farm shit
i was reading about that this morning
and it's just it's just like you read
his post and it's just like it's sad
it's like
you know why there's no
mark zuckerbergs and tom from myspace
and boots anymore it's because the
corporate internet's a parking lot and
you're not allowed to park there anymore
uh
he's right like the internet sucks guys
it's over the party's over we gotta move
on to something else why am i still here
man
why am i still here
sorry i didn't mean for this to be a
depressing stream today this is gonna be
a great stream we're drinking a red bull
that's does you always feel better after
you drink a red bull it's got like b
vitamins or some shit in it ma'am
oh yeah please tell me more about web 3
please tell me more about oh yes please
web three's gonna save us yeah those
fuckers come on
what a joke
you
stable diffusion object has no attribute
model well that's reasonable actually
all right cool looks like we got most of
that right we actually have to go of
course if you have an 11 you actually
have to go to 12
don't forget the last one
all right we got to get embeddings what
are embeddings we did this one fast this
one was simple
you know and then like
don't think this means i like kiwi farms
but that poem is really right you know
first they came for let's let's do it
let's do a reading of the first they
came for the poem right
uh
first
uh first they came for the daily stormer
and i did not speak out
because i didn't like the daily stormer
then they came for 8chan and i did not
speak out because i did not like 8chan
then they came for kiwi farms and i did
not speak out because i did not like
kiwi farms
then they came for me and there was no
one left to speak out for me
right
should we
came for for the donald you know
it's just
like
these things aren't even good
but
it really does seem like they want to
i read you know it's
i read his his was on hacker news this
morning
we should we should read it because
that's what i've been thinking about it
just bums me out man um
oh no tick tock was hacked
um i don't know i don't want to go
google it more his statement was
basically like bro the internet sucks
now
you know
oh it's not even gonna come for me
because i'm not even like
i don't say anything bad you know
because i don't really think anything
that bad i just i don't i just really
don't like the idea
uh oh the email host thing was at the
top of hackers you're like bro the
internet really just sucks now
um
i don't think web3 is going to make it
better it's the same fucking vcs man
like
i reread i reread my blog yesterday we
just got to figure out how to get
it's like
we got to kick the professional
managerial class off the internet
hatch aight thank you for for gifting uh
thank you for gifting subs
oh god the jack dorsey rant which one
no it's not this one it's the more
recent there was a more recent one that
i read this morning and like you just
you know you just you feel for the guy
man
i mean not really like you know what
he's a bully and he's being bullied by
some other bullies but
the the real thing that's just shitty to
me is like
i can't just stand up a server in a data
center anymore and run a website off of
it you can't because they you know
there's there's
ddos has been professionalized and
they'll just ddos you off the internet
um yeah the internet has to become a
neutral layer
you know i agree with that you know i
was sitting i was in the shower this
morning i was thinking about things like
you know the 1964 civil rights act and
like dude yeah like it must have really
sucked if like you had a town and all
the towns are little signs no colored
people right and you gotta pass a law
you gotta do something about that right
if you can't you're like oh okay what if
one business wants to discriminate you
know free market all that they're gonna
lose money yeah but if everybody just
colludes to discriminate right if
everybody discriminates against the
exact same group of people
and like you're like oh well they can
start their own thing but like can they
really
um
i heard jack dorsey just like stop
talking i saw i didn't mean for this i
didn't mean for this stream to be
depressing i don't know this shit just
bums me out man
like the internet used to be this cool
magical place and now i just suck balls
like you know
what's what's next what's next
it doesn't even it doesn't suck because
it's regulated that's not really the
right word
it sucks because it's centralized it
sucks because
a few entities have amassed tons of
power
and then basically like
you know you you have a company like
cloudflare who
if if you're the target of ddos on the
internet
you don't really have another choice
um
sucks because it's instrumentalized i
mean this is a component of it too yeah
once all this shit became metrics and
like you just
uh the power is constantly abused right
no no no no this isn't twitter right
you know what you know what uh upset me
also i think i talked about in one of
the other streams when aws banned parlor
if your twitter your youtube your twitch
and you banned somebody from your
platform i'm actually
totally fine with this
because
for example i don't pay anything to
twitch twitch hosts this content because
it's family-friendly content you know
our christian channel uh where they can
put ads on it and they can make money
right you know if i if i had like you
know a big swastika behind me and i was
talking about the final solution like
you know that's not that's not really ad
friendly content and i could see why
twitch would be like yeah you know
yeah yeah yeah there's the door and
we're showing you right right and i'm
very supportive of that but
when you have
uh
something like aws or cloudflare
where people are paying to rent a server
or they're paying for ddos protection
right these people are like
paying customers
right
aws it doesn't matter whether a server
is hosting you know you know nazi
content or a server is hosting like uh
bank records right the server is the
same server right
we're in america it's legal to host nazi
content right like it's it's you're
still paying for the server right
so why should aws
why should aws discriminate
right it doesn't make sense financially
it doesn't make sense for for someone
like twitter of course it makes sense
financially you don't want don't look
you don't want to talk to people on your
platform kick them off man you know
like i you know especially as things get
smaller i kick people i ban people from
discord all the time you know i ban you
from twitch i ban you from speaking to
my channel all the time just because i
think you suck right like
and that's fine there's nothing wrong
with that
but
if you were on your own server separate
from other people right like
i don't you know what i'm saying
um
cloudflare is one of the vendors of the
company and they straight up abuse their
power you know what
you read you read the the statements
from the cloudflare guy and it's like
you almost think that the board came to
him and said you want to keep your job
all right well you know this is what you
got to do right
i don't know matthew prince i i don't
know who you are i don't know if you're
a good person or not but
like you you know this is wrong right
um it's a sad world we live in and just
you know i'll i'll i'll do this i'll do
this on stream
when you go to
their website right kiwiforms.net this
is a this is a guy who pays for this
domain
just transferred it to cloudflare
klefler doesn't make it 404
right
if you make it 404 you're like look
we're we just turned off engine x we
just we just we just killed the process
they actually changed the content
right
and then they include a link to this
blog post right this is the content on
the guy's website now again
i just i don't feel that you know it's
okay to really like
like do that
um just because you pay and rent a
service you should be allowed to host or
promote anything well for the most part
yeah within the laws of the country
right
like like the these these
it's kind of like net neutrality right
there's a question of where net
neutrality stops
um let's say i own an isp right
uh i own i own an isp and i partnered
with um hulu right can i block netflix
traffic
can i say nope sorry we don't uh we
don't carry netflix traffic
all right can i do that
now you might say well yes you can do
that but then your customers are going
to switch to the other isp but what if
there is no other isp
what if the only isp in your area is
comcast comcast partnered with hulu and
blocks netflix is this okay
no i mean cloudflare yeah that's the
right way to put it cloudflare literally
defaced their website
right i think that's just so wrong
regardless again regardless of who it is
uh i i've never
aside from yesterday i've never been on
kiwi farms in my life no actually i
clicked on a link once when i read about
bayou
on hacker news
uh
you know but it's just
you could tell from the website it's not
the daily stormer it's not a chan
it's it's like you know it's a bunch of
weird internet drama people and like
again
that's not what free speech is about
right like what's just shitty is is not
it's not like
the content it's it's the machinery
that's in place right
i don't know
i saw
uh
uh
why isn't there an isp are there no
alternatives to cloudflare they switched
to a russian one ddos guard
um
and uh ddasgard also canceled their
service i mean again do you really like
it's probably not profitable right it's
probably not actually profitable to to
to do this the the profitable thing to
do and the reason that these like
censorship campaigns work
is because well look you can either
censor them or we're going to continue
to harass you right and this
harassment's going to be expensive we're
going to send letters to all your
customers
um
you know and the ironic thing is i
actually think this is exactly what uh
what kiwi farms does as well
right like you you can use these tactics
where
you you
[Music]
you know you what they call weaponized
autism
right where you just
you start harassing everybody involved
with a company until they cow tower to
you right like i said you know it's the
same thing you know i i'll bring up i'll
bring up my uh my experience with the
patent trolls right you know we're
getting calm is getting harassed by
patent troll now
and um
you know
would have been a lot easier to pay this
guy
ten twenty thousand dollars and he would
go away sure it'd be a lot easier right
it's gonna cost me a million dollars
right
um but
you know you either have principles or
you don't
um
well okay so extreme minorities mentally
ill people have way too much power of
companies due to social media yeah but
companies need to learn to you know
ignore the social media i can't believe
it i banned some guy from discord i
banned some guy from discord
and
uh
his i don't know if he did it under
under an alt
someone reached out to our investors
to try to get this guy unbanned for do
you understand how george hawks is
running comma he just banned this guy
and i'm like
yo like
this is why you can never be in a weak
position right
i own 60 something percent a comma i'm
the sole board member
my investors can say
anything they want and i'm just like bro
like you can't do shit right you know
it's not like our investors were even
trying to do that right
i just you know it's sad that we live in
a world where
there's people who think this is a
legitimate tactic
and
like i talked about on the stream
yesterday there's you know rational
power
rational power is like look uh you know
hopefully all you guys in the stream
know this uh if you're ever stopped by
the police uh listen to whatever the
police say
right complying with the police is your
best option uh for getting out of the
situation
it's rational power
uh but this is not rational power this
is psychotic power the more you comply
the more crazy their demands will be
yeah i mean sure doxing and swatting is
nasty absolutely
you know i don't wanna i don't wanna be
on these these these websites i mean
look i look i've been docs before
um
people have come to my house
i've never been swatted it's like
you know i i think that this
this swatting problem says a lot more
about police departments than anything
else
um
you shake down from the music industry
almost blocked an acquisition until they
go yeah i mean
you know and then i look at the patent
troll situation and the patent troll
situation do do i fault the you know
axel knicks i mean like axel nix is he's
he's the you know we should actually i
should uh point him out on the stream
uh this is this is a axle next you know
i like when you search for him now
uh
you know i
the word look look at all this this is
what you learned about axel dix he's a
notorious av patent troll right like
this is just how you do uh branding it's
like this guy and like look he's a loser
right
um
there's always gonna be losers
uh
the problem is that the court system
allows you know losers like this to to
to be parasites right the you can't
fault
the individual you have to really fault
the system you can shame the individual
but the problem is really with the
system
uh
i don't know it just it's just shit just
bums me out man
okay we have all the layers for clip oh
this is gonna be fast
oh really or maybe i wasn't kidding
about 77 maybe that was actually real i
thought i just made that number up
no yeah of course axel's toast right
like there's tons of prior art on his
patents and he knows this too right like
we're gonna try also like
i mean it's an illegitimate lawsuit um
we are going to try to recoup uh
what you do this is what my wife says
what you do with an illegitimate lawsuit
in america is you uh you try to recoup
legal fees um and we're gonna try
uh but likely what's gonna happen is
he's just gonna fold his llc
right
um you know and this is the problem oh
it's an llc conducting legitimate
business it's not but
um
how many customers must cloudflare lose
so they won't block a website again
i don't think this works right i really
don't think this works if if you
if comma used cloudflare would i quit
cloudflare on principle probably not to
be honest right because the alternatives
are shitty
you know and it's not even like a
question of saying like
okay look at fast food right you have
diversity and fast food you can choose
mcdonald's you can choose burger king
you could i don't know why you would but
you could even choose jack in the box
right
but if mcdonald's burger king
jack-in-the-box are all owned by
blackrock and morgan stanley and the
exact same people and they all have the
exact same values i mean what good is it
right
it's it's it's just you know the
companies the companies do this all the
time right you you you go on the shelves
and you look and there's like four
different brands of shampoo but they're
all owned by procter and dan gamble
they're all owned by johnson and johnson
right they're all owned by the same
companies
um
i mean yeah why are politicians in
charge right
so yeah a lot of my blog posts i've
really spent a lot of time in the last
two years thinking about this problem
and
um
yeah it's it's an illusion of choice
right
the companies can can engineer a choice
there's no actual competition right
uh you know i i find find one one
shampoo company
uh you know
that uh
uh
are the politicians really in charge
well no no the politicians are are
basically actors for a ruling class
right
uh now
why is this ruling class in charge is
the real question
you know you've saw my mockery of
harvard before right like this is kind
of where these people come from
like
i don't know i mean again read uh
there's a lot of good stuff in in in
courtesy arvin where he goes into
like what's actually happening what this
is
um
you know i think i think one of the when
i mentioned this one in my blog post one
of the tragedies for for neil reaction
is that it got branded as right wing i
don't think it's a right-wing movement
uh
i don't think it's it's not a movement
right and i don't think the analysis is
right-wing at all i think the analysis
is
like
true
um
i said this on first lexus like
what you learn from hacking is you learn
how to not
ask the question of
you know what do they say this is but
what actually this is
yeah 10 companies that own everything
you buy
you you live in disneyland this is
disneyland right and it's it's all i
mean this is what the internet feels
like today uh you know what we're gonna
let's find this quote let's find let's
find
let's let's go on on twitter and find
his quote
because he he did put it really well
yeah this this was his uh this was his
post
um
uh
this is an organized attack there's a
coalition of criminals trying to frame
the form for their behavior
these criminals provide opportunities
for professional victims to amplify
their method blah blah blah okay not not
exactly true um
but uh more importantly they want to
make it so that no small organization
can host a service which threatens the
cathedral okay okay a little lofty there
but it used to be that one guy with a
good idea could open a platform and be a
tom anderson mark zuckerberg tom paul
christopher poole or richard kennedy
take note all these names are from 10
years ago there are no new
groundbreakers online because breaking
ground in the new internet's corporate
parking lot is not allowed i just i
think that that's an absolutely
beautiful phrase
um
now like look
there's another like i think there's
kind of the normie way to look at this
which is dude like kiwi farms is a
website dedicated to harassing people
and like yes it was
or it is right like it's it's not i'm
not saying it's good i'm just saying
that like
in order to live in a free and vibrant
society
you have to tolerate this and i think
the meaning of the word tolerance is
lost a lot
tolerance does not mean
that you love something tolerance
doesn't mean that you embrace something
it means that you tolerate it you're
like
that's over there and it sucks
like i tolerate that there's mayo in the
world i hate mayo i think mayo is
disgusting you know i find it on
sandwiches but like i tolerate that it
exists right i'm not like you know on a
worldwide campaign to exterminate mayo i
recognize that some people like it right
um
it's christian right yeah it is
christian that's right
all right you guys know you guys know
you know you guys know i'm a christian
right
i'm not like a die-hard christian i
don't go to church too much
but
yeah i mean you guys some songs on
myself i thought like atheism was
fucking stupid man
like these people like oh there was a
big bang there was no god okay
all right like i got now i mean this was
so i can't believe i like fell for like
internet atheism right everyone kind of
fell for it right
like this dawkins era internet atheism
um
how is getting rid of a form dedicated
to abu abuse and harassment bad
if it shuts down because the person has
a you know a change of heart or because
it sucks or that's fine but
you know to use this
really a machine
um
yeah once you start removing one thing
you can remove anything right and it
and that is that is i'll always stand up
for free speech even for people who you
know don't like george hopps you know
right
whatever whatever it is you don't like
like that's that's you're right that's
your right as an american right and
that's that's what america means to me
i don't know i'm just i'm bummed about
this
every time every time i see this every
time i see one of these like just just
the chipping away is the internet
freedoms it just bums me out
because you don't really get them back
uh
weird centrist vibes yeah i'm a fucking
centrist you know
[Music]
uh
yeah i mean there definitely is the
paradox of tolerance sure absolutely
um
i mean they're all internet terrorists
right the truth is like like they're all
there there's terrible people here on
both sides right
like this is not this is not
there is not a good and evil right like
there's the you know you look at the
people arranging the the kiwi farms hate
campaign and it actually looks just like
the campaigns
on kiwi farms it's the exact same people
like
the the problem is like
i guess i guess like my issue with it is
you're taking it to this infrastructure
layer and that's the thing that i care
about which is that the infrastructure
is kind of sovereign
um
no and the owner of a platform sort of
should have a say right
you know look when cloudflare banned i
remember when cloudflare banned the
daily stormer right this was big news
and then i saw what the daily stormer
people were doing and they were like
talking they were like bragging about
how oh yeah cloudflare supports also we
have friends at cloudflare like i could
see being pissed off being like no i
don't support you fuckers i support free
speech but you know now you called me
out personally i'm gonna ban you
um
but this isn't that
how long are we gonna put up with this
shit what do you mean like what's the
alternative right
i don't know
oh kiwi farms wasn't
kiwi farms was terrible
but this doesn't excuse the other people
being terrible right you can't just go
around and
like
bullying and anti-bullying are the same
thing
right fascism and anti-fascism
what are you doing fascism oh well you
know we like dress up and uh black and
smack people with sticks what do you do
with anti-fascism wow we like dress up
in black and smack people with sticks
huh i don't really see the difference
whatever do the rounds on the debatey
side of the internet like what like like
the destiny stuff no come on like it's
all so fucking toxic and i like i just
don't want to be associated with any of
that you know what i mean like it's just
there's no there's no winning
um
you know it's sad what happens to all
these people who was uh
oh uh i'm thinking of the guy he was he
was here i think i actually got rolling
stone during like russiagate stuff matt
taivi right
you're mad taibi and he has like good
takes on things and you read a few of
them and then these people get a sub
stack and they cater to a certain sort
of audience and then
well the contents ruined because you
know they they lost the thing they lost
their impartiality and they just lost
their impartiality to the other side
i know destiny like debates people on
the internet
uh
[Music]
he's a political debate streamer yeah
like i don't know man i hate politics
i'm not here to debate any like bullshit
if anyone ever mentions like the name of
a congress person or all this crap like
you see what i care about i care about
like
the internet being free i like the
internet
code is law yeah
uh
no i mean yeah a lot of sub stack really
like once you become
i talked about this about consumer
product there used to be the subreddit
called consume product it was funny it
was making fun of consumers right and
now it's like one of the now it became
like a dot win right and it's one of
those that's now like on some right wing
thing and you gotta go man whatever the
right wing two minutes hate is we all
have to hear about it right
imagine talking about politics on
youtube it's my full time is this
politics
i don't know maybe it is kind of like
you know what's a saying
i'm not interested in politics but
politics is interested in me
i want to think of meta banning andrew
tate i've never heard of andrew tate and
i like to keep it that way
oh
man like it's just it just bums me out
you know
just bums me out
let's see the legislative internet 3.0
like hey
um
declaration
of the independence
of cyberspace right
so so here we go you know it's on the
eff website right
we will create a civilization of the
mind and cyberspace
may it be more humane and fair than the
world your governments have made before
uh 1996.
like
everyone went through this with web 2. i
have even less hope for quote-unquote
web 3 right
no
the free internet's a nice fairy tale
right like
the problem is that it became
it became corporatized
it became a
not even that it became corporatized it
became a avenue with which to control
people
and then once it became an avenue with
which to control people the government
has a monopoly on that and they showed
up and
i don't know i mean i don't know if the
eff is uh
once once once once once once we're here
like come on
what does the electronic frontier
foundation have to do with quote unquote
reproductive justice come on also i
these phrases man
these phrases
climate justice
reproductive justice the fuck
you know
i don't know and i just wish they like
like like they they just i hope i hope
normal people just see things like that
and they're turned off right
like i don't know i mean that that you
know the abortion would be a really hard
thing to get me to change my mind on
right you know i'm very uh
like i i i legitimately don't exactly
understand how you can be pro-life but
like that's
you know that's that's
like ugh
yeah
yeah yeah you have a phrase like yeah
i don't know no i like everything is
political now
it's
it's not the internet is just taken over
by this shit
um
tweeted that uh
abortion was okay uh until uh 18 months
after the child was born
um
i don't know i really don't want to have
a debate about this though
i'm not it's not even a question of
rights it's just a question of like what
ah i like like
again with all of these things right oh
not everyone has the luxury of ignoring
politics oh my god everyone does
everyone has the luxury of ignoring
politics at least everyone in america
does
if you're not in america maybe that's
not true everyone in america could
ignore all this garbage and nothing
would change right the truth is
does kiwi farms being kicked off
cloudflare affect me in any way no it
doesn't so i probably shouldn't think
about it and we should probably get back
to this
then you ask the question of okay where
would you draw the line right
like i mean i don't know what if like
what if they what if they ban what if
they they ban hacker news right
[Music]
oh my god all right i can't believe i
don't know i just
all right i'll end it with my one bit of
here's a real piece of political advice
real piece of political advice to all
the uh
republicans and right-wingers out there
uh
give up on the abortion fight uh you are
on the wrong side of history uh it is a
absolutely stupid fight and it it
undermines many other good points that
might be made you want to make you want
to make you want to make points about
i'm a political streamer welcome to my
political stream all right listen you
don't like guns
don't buy one don't try to take them
away from other people you don't like
abortions don't get one don't try to
take them away from other people right
well george that's libertarian you
should join the mices institute have you
read ann rand
right
uh all right that's that's that's oh my
god give up on not killing babies you
can't give up on gun control guns kill
so many people we have to ban the guns
abortions killing babies we have to ban
the abortions
i'm a political streamer should i should
i go into should i go into politics
oh my god please right wingers please
give up please give up
it is so stupid
you know at least at least i hope
they've given up on the anti-gay
marriage shit i i hope they've given up
like i can't believe
i can't believe this was a thing you
know i cannot believe that like prop 8
was actually something that like
california voted on
should she
no i did um
i did have a presidential campaign
uh i own the domain for and maybe we
should set it up it's called shut it
down.us
i want to get elected president and then
i want to shut the federal government
down
no i i really i really again i don't
really think that the uh
that the pro-life people have a very uh
valid point i i just don't
like i don't know but there you go i
gave a look i gave you my political
opinion this is a political opinion i'm
quite confident in
um i'm this this is a political opinion
i do truly believe in uh so
you know
but
i'm not associated with any cringe
fucker who says things like reproductive
justice
uh
wait
oh wait do the people oh the viewers
here for the politics man i'm sorry i'm
sorry i apologize i apologize you come
this this stream should be a safe space
uh nobody should have to be exposed to
uh you know my my shitty political
opinions man
uh
just admit it's killing a human
okay
if that's how you want to phrase it man
you can phrase it that way i don't know
we kill people all the time man
remember the half million people he
killed in iraq for like freedom or
something i don't know man
uh that one wasn't okay but like i mean
i'm just saying like
um you will unsub you can't take it oh
oh no oh no i've offended someone with
my political opinions
[Laughter]
with my absolutely moderate opinion that
like 70 percent of the country agrees
all right
you know what you know here's the thing
like like
like like here's the thing i i i respect
your right to have a different opinion i
respect your right to live in a
different way i just don't respect your
right to take away rights from other
people is this
this is so hard
i haven't really explained my position
what do you mean i've explained my
position
you're inside of your house
if you if you have a gun inside your
house or if you abort a baby inside your
house
it doesn't affect other people
if you do drugs inside your house it
doesn't affect other people
ah
i don't know
like this is i this is just i guess this
is something confusing for me about like
how normies don't like see this argument
and think it's like obviously right i i
i i don't know
i don't know a better way to phrase it
than that killing people inside your
house is kind of evil well no what do
you mean man
i think what do you mean what's wrong
killing people inside your house
no no to be fair if you go out on the
street and you kidnap them and bring
them to your house and then kill them
but if they came to your house of their
own of their own free accord
[Laughter]
well i mean if you rent the house you
have to check if it's um
allowed under the terms of service of
the people you rented the house from of
course um if all the houses are owned by
blackrock
if there's only one provider of houses
then of course you know murder should be
legal inside your house
do not
whoa you're not allowed to murder me in
my house it's my house
um
now come on
look i i don't really i don't really
want it i don't really want to get to uh
to to debate about this but like
yeah i'm gonna we're not gonna we're not
gonna go oh my god i say i say one i
think very non-controversial political
opinion and and we get we get lots of
controversial craps
oh
no oh no there's there's mass shootings
there's also stabbings in canada pat's
day got stabbed that's fucked boys
that's fucked we need to ban knives not
really rest in peace pat's day cause i
was very sad to hear that just a lot of
sad shit happened yesterday you know
um
the gun thing is not controversial at
all we have a second amendment and you
know what i am supportive of a 28th
amendment or whatever number we're up to
to to to uh
the pro-choice amendment we'll put it
right up there next to the second
amendment and then it'll be like
mutually assured destruction we'll put
those two amendments right next to each
other the right to bear arms and the uh
the the the right to abortion and we'll
put them right next to each other and
then everyone can just look at each
other and be like let's just give
everybody rights and stop trying to take
rights away from people alright alright
wow wow political streams get so much
we're gonna we're gonna welcome welcome
to george hawks tonight it's like tucker
carlson tonight and this is my opening
monologue we're gonna talk about
homelessness have you seen an increasing
number of homeless people in your
community this is something that the
mainstream media won't talk to you about
they're busy talking to you about russia
russia russia
it feels good i do love america guys i
love to be in america i feel i feel i do
feel i do feel like i have freedom and
rights here um like actually we should
really talk about the cloudflare
situation you know what here's a
positive spin on it it's like cloudflare
is a private company and you know we can
we can set up um
[Music]
we can set up um
you know uh
storm spark storm spark what do you
think and we can out compete them
because we'll be like cloudflare but we
won't hire the useless massive sjw
employees inside the company that
advocate for stupid causes
we'll get the good employee right there
we go all right
storm storm storm storm spark sore spark
and we can do that because this is
america and nobody can tell you what to
do in america
storm spark my cloud flare competitor
uh no i don't know i
hey you know what matthew prince if you
ever do see this i don't think you're a
bad person
uh
i i think that you were put in a shitty
situation uh by
multiple groups of shitty people
and uh
i don't know what you do i really don't
know what you do i really i i don't know
what you do i don't
it's just sad
oh what's my opinion asking on companies
asking me for my ethnicity and sexual
orientation i always decline to state
that shit i always declined that you
know what i cannot believe how racist
the government is i cannot believe like
how much the government will break
things down by race
like you racist fucks the only person
who ever cares the only person who cares
what race you are is a racist like
that's it that's that's just straight up
full stop
right you know normal people don't care
um
yes the only person who asks you yes i'm
gonna that's that's a
uh yeah race isn't real that sounds that
sounds right like it's just
yeah you know don't you wish the fur the
supreme court instead of going after uh
roe versus wade went after affirmative
action that'd be a lot more interesting
right
it'd be a lot more interesting
all right all right back to coding back
to coding
oh oh alibaba already owns storm spark
right
i don't know
political and new meta i'm sorry i'm
sorry we talked about politics it feels
bad man feels bad man
yes all the new viewers need an intro to
i shouldn't have streamed today i was
just i was just bummed out you
know every time every time
there's a uh there's a
uh i'll blow to internet freedom it
depresses me
look we coded all of cliff while we were
casually doing yeah i know i'm sorry
have i read search of lost time by
proust i know
it's nice to close the chat and just
watch the coding
somebody will read this
it is always reassuring to know that
like
people have felt like this all
throughout history
uh remember when we did that nice
reading of the uh the slave star codex
story the goddess of everything else
all right
subscriber only chat
someone brought up lidars it's
definitely time for a subscriber only
chat
lidars are our political hot button
issue
you know what i mean it's like it's all
right to like you know uh be pro-choice
but if you're pro-lidar man that's
that's really that's really
controversial
what's the goal of today okay today
hopefully
we're going to get
my stable diffusion working in tiny grad
so tiny uh stable diffusion has three
models
it has the diffusion model
it has the auto encoder and it has the
uh
clip model which conditions it on the
text
um
so we are writing the clip model because
it's the last one we didn't do it's very
simple
uh and we are almost done with that
and then we'll be able to put in text
something like
um a man holding a bowling ball over his
head and we'll get a picture of a man
holding a bowling ball
uh over his head hopefully
um
we'll start with the clip text
transformer
input ids
attention mask position ids output
attentions output hidden state all those
are booleans i like that they have types
everyone's getting timed out
oh clip uses causal mask oh this is so
hard to write
i thought this one was gonna be easy it
doesn't look easy
level four hype train
all right
we got we got the momentum back
the world is not as bad as you think it
is at first
the world is a beautiful place
i'm drinking a red bull it is labor day
many people labored hard so we could
have this holiday
what is their labor day oh you want to
do a pull request
um
well depends how complicated of one you
want to do
i told carpathia i told carpathian my
email back to him about tinygrad i'm
like yo you should fix max pool
i'm max pool right now only accepts uh
the stride equal to the kernel size and
you can fix that
um
that's a good one if you want to fix the
gpu execution bug
uh that one's going to be tricky
if you want to fix there's one test
that's disabled in the shape tracker if
you want to fix that test
ah those are some good choices
yeah it's pretty
simple um
trio what is this
input ids position ids
how is this actually used
where's the code that actually runs this
thing
so this is the uh this is the repo for
stable diffusion
decode first stage
um
i do wanna i do wanna revisit
uh you know i just i just i've been
thinking about this a little bit and
this is why i'm not a political debater
yeah you know all you people with your
pro-life arguments you could probably
like
here i am justifying murder in my house
and like
this is why first off i'm not in charge
of things and if i was in charge of
things i would be like okay let's look
at this from a statistical perspective
we're going to have some cut off
blah blah blah blah blah and it's going
to be very boring and very rational and
that's how i would like to see
uh politics be i would like to see be
very boring and very rational right
um like it's not cool it's not sexy it's
just like okay well you know this is a
necessary ill in our society blah blah
blah blah
right all right there we go so you know
that's that's what i would
really uh like to see
is why i never wanted this is why i'm
not debating anybody right like i want
to say some flashy shit i just want it
to be like boring and stable so we could
focus on like building really hard
things you know
it requires a super advanced
civilization to be able to build
spaceships and fusion reactors and just
metaverse tech and all this stuff right
and like that's what i want to see exist
um also i don't really want to die
like
and i think that
we have a shot not to i have a shot not
to die or at least like i don't know i
mean everyone dies right
last question and all that but
uh
like
there's a chance i could live thousands
of years
uh and you know i just i just
see
idiots and
like they're gonna kill me you know
idiots are gonna kill me and it upsets
me and i i think about all right how
much of my time should i spend fighting
the idiots and then
um
it's it's not like
any of the
i spend time complaining about politics
but it's not like it does anything
none of these things have ever been
productive so
i don't know but then like is tiny grad
productive like no this is this is an
academic exercise
we should get to coding we're going off
topic here i don't know i just i don't
really feel like coding
it's just just that i mean i don't think
off topic i think yeah sure if we're
going in the weeds of like
you know
kiwi farms and cloud flash share it's
off topic but if we're talking about
you know
why we build technology
um
i think that's that's kind of the point
i i don't mean why in some grand like we
build technology to help the
underprivileged african migrant children
uh
i mean like
you know
we built technology to
reach for the stars or something
joe's considered an idiot
you know what i mean
like
dumb things that have no relevance to
the future
all the dumb circle jerk arguments
all the things that have to
be uh
you know
every every current year every
two minutes hate every you know that
those people are idiots
everyone who promotes that stuff
all right because i don't really know
enough about how these things work
should we start at the top or start at
the bottom so you see there's a whole
bunch of nested classes here
clip text transformer inside is the
embeddings and the encoder inside the
encoder is the layer and inside the
layer layers the attention
like this one look how long this one is
this one's so much longer than the other
ones
self.shape
see this one has a scale
do we need a scale
itself that had them
all right how many heads does it have
you're right if it turns out that like
the the
corporate behemoth can't actually build
any working technology then we're fine
um
but i don't know like
how historically how have fascists done
that building like technology
probably like doesn't even seem like
it's that like they've done that badly
so i don't know
maybe we're fucked maybe we're not only
the future will know
ah
that's right you can't have happy
without sad you can't have
that's why you can't wirehead bro don't
wire it don't do it
batch time channel
what
why does it like reshape them four times
this is terrible
i'm gonna clean this code up
oh we didn't find out what the
activation function was yet
what is the default activation function
for a clip
click vit large patch 14.
so
but what activation function does it use
i also like i think this is only the
text encoder and we're gonna like it's
gonna output these things
so i might actually have to output these
middle weights
oh look here's the initializers
that's cool
quick jelly
that's a quick jelly
oh
i see
we'll have to add support for this to
tiny rod
oh well no wonder look at how long a
long jail you is that looks long
quick jelly
1.072
it's like a swish but
we have to delete a line somewhere i
think
a little problem
oh
clip mlp clip attention
we wrote those
now we have to right click and color
layer
nice now we have the configuration here
so we can look at that
do i just need the hidden states or is
there more
i don't know if i actually need more
stuff than this
all right that code looks very readable
um
now onto the clip encoder
can can i just do this
position ids
input embeds input ids
i don't understand why i can't just put
in like
words or normal stuff
so wait is this not backwards linear
where's my linear layer linear linear
linear linear
in features out features
shouldn't that be the other way around
i don't understand how that loaded
oh it's an n embedding
we're at a red bull
okay wait no maybe this is straight
forward then
okay
you
i think that's right
get rid of a tension mask
and let's just do what we think's right
here
i don't know that's right
um
i'm
oh wait this isn't right
you
oh
i think yeah this isn't right
it's not really right either but
you
that's not even right
transpose doesn't do the thing that you
want it to do
so
hmm
where's that permute
these
this
of course it's not gonna work
is it
this know
that's a guess
okay around
what's your question about the shape
tracker
no it's too many lines now
it's too many lines
do
where's a good place to lose lines
maybe it's wrong i don't know
if it's wrong write a test
if it's wrong right a test we can review
it on stream
this is i understand those lines are
stupid i know
um
clip
model is running
okay we're getting all zeros out
is it time to install pie torch and
start running the pie torch and making
it work with the pie torch
it might be that time
[Music]
you know we always love when people add
more comments if you want to add more
comments i'd appreciate you
how's that all zeros oh
let's load the wing
there we go now we have numbers
are they good numbers
who knows
they are numbers and that's most of
what we can hope for
okay
three because we only put in three
things
now
wherever we put in
what
is this
like i think that stuff's right
so many mistakes i could have made
that looks ugly
that's at least written in a very
straightforward way
i'd probably write it a little
differently
bannon's encoder layer norm
all right i think it's time we just
compare the outputs and make sure
they're right
uh and then we have to write an encoder
to actually encode them
gotta write bpe
oh man if we actually make this work
though that'd be pretty sweet right
would that be all worth it
would that be all worth it would justice
be restored in the world
uh i'm going to get a little food i'll
be back in three minutes
and for those three minutes we're gonna
let non-subscribers talk
we're streaming
oh yeah
[Music]
brad
um
the chair is pretty good
say good morning to alex
political discussion
i got a question
what rhymes with mariah
so
all right
let's
download this stuff
stable diffusion
job
this thing
yeah the patent troll fight all right so
let me tell you what happens
when you're on defense in a lawsuit now
i'm not a lawyer don't take my legal
advice you should retain a legal lawyer
licensed by the bar association of
america because you know we love
credentials right we very much support
credentials in this stream i'm just
saying you know if you if you came in
this stream and you had you showed off
your diploma from harvard you would
immediately get vip status because
because she went to harvard and clearly
you're now look we're done ripping on
harvard um but
here's what happens in lawsuits
if you're on defense
your goal is to make them take forever
right we don't want this to go in front
of this case is going to go in front of
a jury in three years
um it's going to probably cost us
anywhere from 300 000 to a million
dollars
and it's going to be a huge waste
but
what's important is that it's going to
cost him
depending on how he does it between 100
000 and a million dollars
and um
you know he's gonna lose and we're gonna
lose and everyone's gonna pay the
lawyers money
and
no one's gonna win except the lawyers
and then everyone's going to think twice
about suing comma ai because i will just
do this again like i mean you know i'm a
principal person right
um but yeah if you're going to sue me
let me explain what's gonna happen one
is gonna take forever for you to see
your day in court
uh two when you see your day in court
you're gonna lose and three you're gonna
rue the day you sued me so don't sue me
um but if you do wanna sue me you know
okay go ahead sue me man let's see what
happens let's see when you're three
years from now being like man i never
should have sued george hats that
motherfucker's crazy yeah
um no it's out of pocket man it's out of
pocket don't worry the money's fake it's
it's made up it's all fake it's all fake
uh
there's a lot of people willing to
donate to the fight yeah
um am i willing to take them down yeah i
mean look
we kind of has money
i think this is a decent use of cums
money
um
yo look we've looked into the guy oh
that's another thing you fuck with me
i got pride i actually got three private
investigators working for me right now
no joke i legitimately do um
why sue i don't i didn't sue him he sued
me man
like why sue i was pretty dumb
uh i legitimately have three private
investigators working for me you know i
know what this house is worth i know how
much his mortgage is i know what car he
drives
this guy doesn't have the money for a
lawsuit
but hey you know
uh if that's if he chooses man man if he
like mortgages his house to try to fight
me in a stupid lawsuit like it's just
sad
it's just it's just like like i almost
feel bad for the guy but i know because
he's a dick and he sued me right
uh what's the l ron hubbard quote about
how you can harass someone with the
legal system
can he give up at this point he can
he can
uh it doesn't really make sense for him
to give up right well actually i think
right now he can really drop it with no
consequences
i think after we file we're gonna file
we got a big thing to file against them
i think after we file that he can't drop
it
uh and one of the things in that thing
is going to be basically you're going to
pay our if we win this you're going to
pay our legal bills
um
no yeah like look i'm i'm a dumb guy to
fuck with because like i'm stubborn in
principles man
like you think you think i'm like oh and
you just got oh it's just the cost of
doing business man you just gotta like
you know you just that's just the way
the system works man do i look like a
that's just the way the system works
kind of guy i look like a i'ma fuck you
up you know oh i like that i like
someone on discord said this it's like
look i'm not locked in here with you
you're locked in here with me
it's not elon elon's
elon elon's not that much of a dick
uh like elon is ruthless but elon won't
like
um
no here's a here's a here's an elon
story uh
i heard there was a guy who was making
the
space internet
uh wait what
where's requirement stop high
clip come on
probably not that cleft
i worry about just typing stuff like
this
all right
conda
conda
conda conda conda conda all right hey
this works
um
elon gets tons of undershirt hate no
look i'm a huge elon fan i i heard the
story about like
apparently there was a guy who was like
working on starlink for years and elon
met him and said he wanted to work with
him and like had like four meetings with
him
uh you know the kid was like into
building the space internet and then
elon eventually said well yeah what do i
need you for i'm just gonna build space
internet myself uh he did something
similar with me like again i don't think
that this is um
out of band right like i wouldn't say
that somebody who does that is uh
like like a like an out of band dick
um i think that's all like that's just
that's just the game man
so yes elon is is pretty ruthless and
you don't get to be in his position with
without being ruthless
i'll never be in neon's position i'm not
that ruthless like i'm i'm not uh
i'm not an attacker i'm i'm uh
if you attack me i'll i'll i'll you know
i'll defend but
no module named cliff eh
oh after you pick three installed did i
do that wrong
no
no module named omega company
how do i install the environment oh i
don't have conda
oh this is stupid it can't be this dumb
oh here we go here's clip
sue your grandma and take her startup
ideas i don't know but like the other
thing about elon too is the man is doing
so much good for the world
uh that like it's hard to hate and then
you have to look at someone like axelnix
and you ask like what good are they
doing for the world nothing right
so you do have to you always have to
look at someone on that
who's sued
um
his name's uh
his name is axel nix he's a
51 year old man from uh
some place in michigan
and
i don't know like he used to be an
engineer and then like
four years ago
he stopped being an engineer i don't
know if he was fired i don't know what
happened
and he started patent trolling people
uh
i don't know if he has the money he
wants the money to burn i don't know if
this guy's money to burn i don't think
this guy's that much money
i think this guy maybe like still thinks
i'm bluffing or something
what is it downloading
this is concerning
oh don't tell me like the clip weights
aren't even in there or something
what is this downloading and why is it
so many gigabytes
he's smart he's watching the stream yeah
i don't think he's watching the stream
life is short life is short
all right
they said yeah guys it's a noose yeah no
it's a wire is that that is that better
you all you all happy
well we'll curl up the wire we don't
even want to be offended by this wire
like bubba sparks or whatever that guy's
name was
oh all right is everyone happy what
happened
you want to see the books
ah
i'll show you the book
you made eggs
this book
is a dollar
oh pancakes and eggs
oh i love pancakes and eggs
oh why is it so slow
i don't understand i thought all the
weights felt like in here
are they not
oh you're offended by walls oh i'm sorry
i'm sorry if you're offended by walls
ah i can't i can't help you
bubba sparks
gotta make sure
oh yeah yeah you're back in the mud i've
been and i confess i'm so happy here
there's nothing you could do to make me
stay way way
[Music]
remember that song he's just that
country boy city slick pitfall
temperament at the club at the gate the
way it's an event
if it's me considerate more than a
coincidence
even though they mumble let me suckers
keep their distances
sour please
i it's downloading it's downloading very
slowly
i know i know it's slow
uh
well we should work on the other one too
while we're here
so that's the con stage model but we
also have to do the uh
and every one of my talented is so clear
that's what they deserve making sure
that's appropriate
go to the unit model too
so
oh
well that's a lot of things that it's
missing
six required positional arguments eh
i said sour please is this like this is
like a meme
i don't know about the kids and the
memes these days
man i guess some of them are on kiwi
farms
not anymore though we took that hate
site off the internet a great victory
for
i don't know man the regime
victory we finally
that's right there will be no more
bullies in this school that's right
there will be no more bullies
those damn tick tock kids yo i
downloaded tik tok
and like i tried to like it
i tried to like tick tock
it wasn't for me
oh good it loads the unit what is this
an error message that's really long
oh unexpected keys and state deck oh i
say
missing keys and static though i see
oh
model
yo i did not have tick-tock guys it
wasn't me okay
it wasn't me
size mismatch
because i didn't put in one of the
parameters right about
it wasn't me
small channels
attention resolutions
num res blocks
channel malt
which song you linking to let's see what
we got
oh yeah i mean i worked i worked hard on
this one for a while you know one of my
blog posts is about uh
no it's comspark hang on
which one is that
ah circulation of the elites that's
right
uh yeah i mean in order for this to
change we need a new group of elites in
society
and that's kind of what that song is
about right
this thing works
that's still downloading
uh
we'll have to put in model again
and then we can like check
let's just load in
[Music]
so now we're checking to see if the
model i wrote yesterday which is the
unit
matches and it's not going to match at
all in fact i don't think this is going
to run
because i think you have to
yeah i didn't put in use checkpoint i
don't really know what that does i'll
put it in probably doesn't hurt
i'm afraid it might try to download
things from the internet
none type attribute has no yeah okay
fine
yo guys i'm just gonna start sticking
justice afterwards you know like
red bull justice
like it'll like yeah red bull justice
you know climate justice yeah webcam
justice yeah
are you trying to pip install the ldm
module yeah
yeah wait wait where's my
we get are we getting pancake justice is
the pancake justice this morning
hello
you know how they just like to stick
justice afterwards
five minutes pancakes
okay
[Music]
don't get me banned from twitch like
destiny
oh women worldwide justice i love it i
love it i love it yo dating justice
sounds like a good show
dating justice
a 1d batch of time steps
conditioning plugged in via
cross attention
okay i need time steps a 1d batch of
time steps
i don't know
can i just put in a
i have no idea what to put in here
um
comma three justice edition oh i love it
love it
i think like this in general i hope this
tactic can kind of work you know
like if everybody just mocks putting
justice after things
then like would they stop doing it
why do they have time steps they have
time steps because uh
all right in my unet model i don't think
i did any of that yeah i do
oh
a 1d batch of time step like okay let's
try to find out where this thing
actually runs
i never found it
text to image okay
uh get learned conditioning
oh yeah you can comment out the safety
checker here they added a safety check
that's another thing that's another
thing ai safety you know it used to like
mean like dude actually really powerful
optimization algorithms are scary and
can destroy the world but no no no no no
it means we can't have taylor swift porn
safety
safety that's right
safety someone might see taylor swift
porn and then kill themselves it might
happen it could
egg justice
i don't know the justice department
all right well the one in the the one in
tiny grad won't have any safety checkers
so we can try like taylor swift riding a
big purple dildo and we can see what it
says
now guys i don't end up like destiny i
don't end up banned from twitch
i i salute the overlords the regime
overlords
uh taylor swift justice
you guys get it
um
wait there's a lot of stuff here that i
don't really know what it does look at
all this code we don't have any of it
oh it's a oh of course it's a classic
ddpm guys
good thing i'm not using a ddpm
i'm using a plms
what
next lawsuit coming down taylor swift
don't sue me taylor swift
i'm a big fan you do so much good for
the world
you'd ruin you'd ruin my you'd ruin my
uh love for you
um
i wouldn't i wouldn't i wouldn't want to
upset taylor swift
i'm a big taylor swift fan i would want
him to tell swift
all right let's focus on what was i
actually trying to
time steps 100 time steps
num time steps make beta schedule
well i definitely don't want to beta
schedule
brandon's gnome time steps
what am i supposed to put in the hole
for time steps i don't know
okay there was a there was a post that
kind of talks about it maybe this post
will tell me
how does stable diffusion work okay this
is how stable diffusion works
latency
latents text condition units okay
that seems good
oh i don't know if i'm using any of
these
schedulers
that doesn't look that long we can
probably write that
um
[Music]
stable diffusion
but other ones may be used too how can i
just use a different thing
first we get the text embeddings
scheduler set time steps
oh here we go t
tqdm enumerator scheduler.timesteps
and we also pass in something called
encoder hidden states
oh this is just context right
oh yeah i didn't write this time
embedding stuff yesterday and i should
have
um
i don't know what if i just put in zero
does zero work
maybe this would be a tensor because
it's checking the device
bread and eggs are ready
oh thank you i come and get let's say
time steps is the amount of time it
diffuses yeah i understand that i'm just
saying why is it a like one dimensional
vectory thingy
um
mat
one and mat two shapes cannot be
multiplied
well it's probably because i have to
pass in the context
bread i love brown
thank you
i bring you pancakes
oh i don't know i'm ready for pancakes
yeah
and justice
is that my mom not my girlfriend
all of my mama
so
oh we have to give it a batch size tell
i really don't understand time stamps
time steps
um where's my unit here's my unapp
and then we also have to figure out
context here
oh i think i was passing it in down here
to make it work
unit model i call it with something
called context
does that really work without it though
oh my god
okay
let's see if the numbers look the same
i don't understand how this can work
without contact stuff
you also have to make it pass in
timestamps
hmm
no no no pancake justice is coming
oh oh i know where i did oh you're here
here we go
it's like i knew i stuck a 77 somewhere
random
okay what do we think we think the
numbers are going to match
they don't match
low probability that's right
that's a lot of numbers i know
these numbers are supposed to be the
same as deer's numbers and they're not
so now let's figure out why
it might just be my time steps because i
know i didn't write that
time steps time step in bedding
um
a one day time shirt try the eggs
what
extra day okay
because there's a less good lazy acres
bread
i would say yesterday's barbecue
well
that bread just showed them
well i can't believe they call
themselves a bakery lazy acres
what i'm hearing
is that we need bread justice we need
great justice
that's correct
i shouldn't even be allowed to call
all
[Music]
oh you're getting croissant justice so
that's a good choice
no we're gonna make this work today
who's who's feeling good who's feeling
who's feeling like
we're finally going to get some stable
diffusion justice
[Music]
and you see it's just we ate food
that's what turned things around
lime
okay we have to write this time stamp
embedding function
unstable diffusion is that real
so
hmm
tiny grad doesn't support cosine and
sine
[Music]
um
oh yeah look at that justice
i love that justice
okay maybe now because we have ones
because
the cosine of zero
is one
hmm
wait
call takes three positional arguments
but
what
oh
i know what i did
will the numbers be the same
let's find out
oh
my bad
oh three detailers left
my dream one of these days
oh
how do you make pink lemonade pink
lemons
come on be the same be the same be the
same
that's not the same
all right now is the part where we start
adding random print statements in hopes
that it will become the same
[Music]
yo can we play some copyrighted music
no
[Music]
oh you know about the fielder method of
acting i learned about it yesterday
seemed pretty cool
no
i love copyrighted music though it's my
favorite type
all right do we have a website do we
have a website where we can link to some
non-copyrighted music
does someone does someone want to link
what do you mean it doesn't exist
all music can't be copyrighted we have
to find non-copyrighted music
play your own music okay all right we'll
have to listen to the archives of tom
cruise
it's copyright me
no i legit bought these beats and shit
is copyrighted
i understand a lot of it's a scam and a
lot of it's like
all right this sounds nice
this
[Music]
[Music]
so
[Music]
oh
like
i can get away
[Music]
wait those numbers match
oh that's a lot of nested shit
it looks the same
i should probably do this in a notebook
don't you think
those look the same
[Music]
so
[Music]
those are not the same
we gotta find what the problem is then
[Music]
so
okay this is zero so now i want to say
something like if i equals two or
something let's try one
input block zero real input block zero
okay those two are the same
oh where did my where did my chill
copyright music go
see what else we got
okay well this doesn't work
oh the first one's just a calm i say so
the comb works but the rez blocks and
spatial transformers don't that's fine
keep me
[Music]
let's make sure they're the same
oh oops
you got impatient with them
oh i need a paper towel for these
[Music]
whatever
all right we we can't listen to
copyright free music
while
we are imperfect
i need a griddle so i can cook multiple
ones at a time
do these ones match
uh
i like the aunt jemima better
no
cuz it's better alex and can we get the
mouthwash with the alcohol in it it's
better
what
no we didn't we have alcohol-free
mouthwash
i like the
bright green listerine one
you know what i like
delicious
okay it looks like the resnet matches so
the problems in the attention
let's go look
let's go look in the attention block
you guys see what we're doing
it's painful and slow
but
that's what you got to do
nutella is disgusting
that's another one of my controversial
political opinions that nutella is
disgusting
do the numbers match let's find out
you know guys by the end of this stream
we're going to get tiny grad to generate
a picture
conditioned on a word
okay so we found that those don't match
so let's start bisecting
you guys did you know that 90 of hacking
is just binary searching by hand
it's true
hacker
facts
you guys can think about what we're
going to generate as a first picture
but they can't have anything to do with
taylor swift being naked okay i'm sorry
but it just came
we can't do that
we're gonna get banned from twitch and
sued by taylor swift
and that would be too much for me to
handle it one day
it will generate me naked now that
sounds like violence in terms of service
too
all right let's try it through the
blocks and see if it's the same
likely the blocks are where the bugs are
no
these don't match anymore
george hot coating stable diffusion oh
that's that's pretty good
um
all right
the block is bad
the block
is bad
well william said the block was hot we
say the block is bad
guys it's binary searching by hand
welcome to
hacking uh i'm sure it's just a little
stupid
input to block match
first layer
they match let's find out
i bet my attention is just wrong
wrong
so likely it's because of attention
yeah that code's clearly right
um
so you know we should have just done
this sooner
it's this
cross attention
it's just pretty cute
see if the queues match
but the bugs probably
yeah we didn't do these rearranges right
wait
it doesn't even look like the cues match
huh
that clearly doesn't match
do the inputs match
can i explain attention not really
wait
the inputs don't match
how do the inputs not match that means
the output of norm doesn't match
yeah
that doesn't matter
um
we did say real equals one right okay
we're loading the weights definitely
because again we're making it this far
so notice how the first one matches and
the second one doesn't match
so something's wrong with
i thought layer norm was just group norm
if i didn't
maybe the problem is here
should be right
thank you for breakfast you're welcome
okay my norms aren't working
and then layer normal let's go read the
code
i mean linear should do what i want
for the shapes right
oh
huh
calculated over the last three
dimensions where d is a dimension of
normalized shape
that's correct
okay what'd i do wrong
who who knows
who could find the bog by the time i get
back
all right who found it out who found out
what it is
no no no you you get subscriber only
chat
vanilla ice don't like me said some shit
in vibe despite me that went and got his
hair just like me a bunch of little kids
want to swear just like me and run
around screaming i don't care just bite
me
layer normalization
i think i was put here to annoy the
world
and destroy a little four-year-old boy
and girl
um
gnome groups
i don't get it
that should not do
oh
no that shouldn't do anything that's
right
that shouldn't do anything
i'm angry about this i don't get it
okay uh
sorry i went got pancakes and i lost my
place
we were here
normalize
dim num groups equals one
let's make sure we're actually loading
the weights into norm 1 and somehow it's
not slipping away
learn how to wrap as a little boy
oh there's so much good copyrighted
music out there you know
sure looks like we're loading it in
this here and then this is the input and
then that's the output after norm this
is what happens when i do the norman pi
torch
and this is what happens when i do the
norm and not pi torch
they're different
it's layer norm so it should actually
normalize
all the stuff
by the mean standard deviation which is
right
and then length of x that shape's not
four so it goes here
and does linear on weight and bias
let's read the code for linear make sure
i didn't do anything wrong
multiply by
the weights
if the bias is not none we add the bias
over here we multiply by the weights and
if it's not none we add the bias
oh
the standard deviation is calculated via
the biased estimator
is that the same
how is this different from group norm
i don't really get it
i'm saying num groups equals one
okay it's possible
that i don't understand what liar norm
is
and what i actually should be doing
instead of num groups equals one let's
try num groups equals 496.
all right just to guess
maybe it's right maybe it's not
yeah that's right
okay
uh
layer norm doesn't do what i think it
did then
shit
so
i don't really understand why it wasn't
one i thought layer norm i guess
actually that's all norm and maybe i'm
confused because that's what use a comma
oh so now everywhere i used to say
equals one
here instead of 496.
i should probably put 32 in the other
one to make number default but whatever
okay does that match now
cryptocod thank you for gifting subs
you can see the things match
uh they're happy that you gifted subs
that's why they match
all right let's just jump ahead
and see if well actually that was really
not very aggressive so let's just go
here and see if these match
some chance
come on basic transformer block don't be
wrong
don't be wrong don't be wrong don't be
wrong
matches matches matches
nope they don't match
they do not match
all right let's look after the first
attention
but yeah i think my attention thing is
all wrong too
um
actually
i'll just check after the first
attention
uh no they definitely don't match okay
so attention's wrong is q correct
my q is going to match but i think i
have to do some more complex reshaping
here
with like heads and stuff
all right
how do my cues not match
only my queue's not matched the number
of cues don't match
this doesn't make any sense
did i leave some princeton somewhere
else
all right let's try this
it doesn't match either of those
that matches
that matches
why do the queues not match
we forgot to save one of them or
something stupid
the x's match
do the cues match the cues have to match
okay the cues match i must forgot to
save or something
you can see that these numbers match
these numbers
okay let's just
yeah i didn't
we have to actually write the
transformer code here
ah this is not a transformer let me just
look at my code for transformer here
this is the tiny grass this is the
canonical tiny grad transformer
uh
n heads
and i should just be able to copy and
paste all this
uh
okay
so we have query dot key
times
1 over square root of self.head size
which is the same as that
softmax which is the same as that
weights dot value which is the same as
that
now we transpose it back
now we reshape it back and then we do
the output so that should be right
let's see if that fixes it
i
got rid of my print q well the second q
should be right as well as the first q
now if we did all that right
okay um we got a bug
oh yeah don't use transpose it should be
permute
i gotta get rid of transpose or fix it
to do the right thing
query is undefined
q dot k
weights dot v
that seems right
uh
scale
dim head
head size same as that
uh
no they don't match
okay
let's go down here print x.numpy there
to see the problem could potentially be
with context still
if context doesn't match
if context doesn't if attention is right
that should be correct
the good news is the net is just this
repeated over and over again so when we
get it it all just works like there's
only so many bugs right like you
probably count the bugs on one hand
these do not match okay there's still a
bug then
it's possible my numb heads is wrong
actually
i just kind of guessed at that
it might not be 10.
uh where are we gonna find this
there's a parameter somewhere
you know oh numb heads is eight
oh
okay well that explains that
uh
so this is 40.
and then this
would be
160.
okay
so it wasn't 10 heads it was eight heads
maybe that fixes it
oh here i have another bad one here
cool matches now
yup that matches
great
you see and like you think that oh we're
just struggling but it is in the
struggle where you learn
you can't learn just by skimming a paper
you have to struggle
just in the struggle that you're like oh
eight heads right you think oh this is
really stupid look i'm just changing all
these numbers you know showing off
flexing my fancy fin skills
uh
but what are we doing in reality we are
learning
uh you know it wasn't about the uh
the destination it was about the friends
you made along the way
something i really liked
from um john carmax uh lex friedman was
just like
how little he cared about uh
anything that might be referred to as
maybe a big question
just like those questions are all kind
of they're kind of dumb
um
like i agree with him
wait is this not
where do i have acting too
but i think
let's just delete that
meanwhile part was good that was my
favorite
read my blog yesterday it's like man
philosophies for high schoolers who just
discovered smoking weed
so i feel about like advice too so i
hope you know i like give you guys
advice you know that it's all fake right
i think i might just be printing in the
wrong place i think this is not actually
that transformer
meaning life is a bug question yeah i
agree with that
like it's in one of the other it's
called basic transformer block maybe
there's this
i don't know what's printing this
where's the print
oh i'm on the wrong computer ah
stupid
stupid okay we didn't waste too much
time on that we could have wasted a lot
more time
could have been a lot more time wasted
we could have wasted more time
all right let's see if my transform with
context works
okay that matches great okay
it's time to break mines now baby
let's add the printing back there and
let's see if we lined up all the layers
we're fixing bugs one at a time
we fix the bugs one at a time
but eventually there's no bugs left
uh
so
they're the same
four one
looks good looks good
let's put that in there
let's make sure that's actually
commented out let's put that in there
you miss a hundred percent of the shots
you don't take
[Music]
all right good these match
all right um
should we just should we just see if the
whole thing matches see if the whole
thing matches
oh new office tour never likes once on
his walk
come on come on matches matches matches
matches
will it match
so close
it's like close you see
no actually it might match
no it doesn't
it's close though which is weird
like why would you have something close
the numbers clearly don't match they're
not the same but they're close
which is just weird
could it be rounding errors no it's too
big for rounding errors it's a real bug
somewhere
it's weird that it's close
huh no those don't match either
okay okay
back back back
uh let's see
all right let's try three
do they match up three
not even close
they don't match at three huh
okay maybe it's down sample that's
broken okay so this is after zero this
is after one this is after two do they
match at two
maybe this is down sample
that'd be nice
it seems if we got a 12 there we have a
2.1 there
we know they match at one
we tested that
seven seven yeah okay they match there
okay so it's probably just a bug and
down sample
all right down sample use up
oh
maybe padding just equals one
that a padding bug would actually make a
lot of sense for that to be the problem
we had to use weird padding in the other
down sample but this down sample they
just trained it with that so that
actually just makes more sense
288 288 okay that matches now
okay okay let's see does the whole thing
match
that that
to answer your question of why it was
close that actually makes a lot of sense
right like if we have a
uh
if we have a problem with
padding
it'll be close but not match exactly
okay whole model whole model whole model
hold on oh and then we can actually wow
we're close guys
we're close
we just have to get clip to work
to get context and figure out sampling
man this is actually doable today
i have hope it matches
boom
boom but not matches right
that matches i don't have any more hacks
oh
yes
oh yeah buddy
fix
last bug in
unit probs
with a z
ah okay
let's load in the first stage model and
let's run it
remember running it yesterday let's just
get the code out that runs it
you
uh up sample
complete space to image
with auto
encoder and then uh what's this
image
make image
correct size
save
all right who think it's gonna look cool
scpq
cpq temp render
dot png
[Music]
oh hmm
okay
dark apple
oh we should actually we should test a
few more things i should test different
time steps
while we still have all that code
simpler image what
like with plain background
no don't worry about that
okay
those match
we can actually say how much they match
i think i can print
uh like something like np.mean
tnz dot numpy
uh minus nz dot numpy uh times two
um but let's try setting the times well
actually let's first just try it out and
see if we get a good number
i meant that that's this means great
error right
it's power
okay wow that's really good
e minus 10.
okay let's set timestamps to 10 and see
if we get something different
[Music]
mse
don't listen to what i say bros code is
law speaking is just speaking
is that different
those numbers different
numbers don't seem different but maybe
it doesn't matter
okay uh
let's put in random noise for the
contacts and see if that's fine
what do you mean that's too good no
that's fine
it's it's a it's a mean square though
right so
i don't understand
i put in context and it did the same
thing
i put in a time stamp and it did the
same thing
oh no i don't trust this thing
colin powell austin powers
still
looks like that
okay never mind i feel like we have a
lot more to do
thank you we gotta make the clip model
match
let's make the clip model match first
there we have contacts we can put in
context
uh
wow
it's amazing these things work
all right
a couple minute break we'll let the
non-subscribers talk
how we doing on viewers
855 all right all right this is this is
this is the stream we're gonna do it
even if it takes us five more hours
we're gonna make we're gonna make stable
diffusion work a tiny grab
we're gonna get some more coffee
and i realized
i think i have a solution to the
cloudflare issue i know what should be
done
so
um
i think what we need to like
imagine we just actually
regulated monopolies
you shouldn't be able to have a monopoly
in an industry
if we just did this with this this one
trick
we can fix all this
i mean this is it comes down to
these are my same complaints about um
how all the shampoos made by the same
people
well i mean you have to do it as the
government right
justice
monopoly justice
monopoly justice
well i mean the problem is the
government's involved in those same
monopolies
uh no we just need to enforce
anti-monopoly laws
oh this isn't work this is fun
you know aren't we having a good time
all right we just have to get a context
to shove in and then figure out how time
steps work
aren't we having a good time
well
open pilot may have monopoly over open
source over over open source
self-driving but
actually that's not even true
uh first off there's tons of forks of
open pilot but the the question to ask
if a company is a monopoly or not is not
a question of do they have 100 market
share the question is is it feasible
that anybody can compete with them
right
you can have a a
100 of a market right and that just
might mean that the market's too small
for anybody to care about say you're
selling weird uh
you know anime stick figures right and
like you you don't have a monopoly just
because you have 100 market as long as
someone else can start selling uh
selling anime stick things i mean
i i don't think it's that difficult yeah
it's difficult to define clearly but i'm
talking about a world where we actually
get some
you know look the current system is
obviously not going to do anything about
this
you do you think that you think that
congress is is capable they're not even
capable of abolishing daylight savings
time
which i actually support by the way
don't abolish daylight savings think of
all the daylight we're saving
and if you tell me we're making daylight
savings all the time it will save more
daylight then i argue that it just won't
be special
all right
man maybe i should go on political
debate youtube right what do you think
who wants to debate me let's go let's go
uh is spacex a monopoly no one can
compete with them well you say no one
can compete with them but why can nobody
compete with them
right
can nobody compete with them because
they invested in a technological lead
and they have this technological lead or
could nobody compete with them because
there's like
marketplace effects that because they're
launching a rocket nobody else can
launch a rocket
i'm not going on joe rogan
if this stream became too big i wouldn't
even do it anymore like a thousand
people is reasonable
i'm bigger than that you think i want to
be famous man
yes i agree microsoft buying bethesda
and activision's a monopoly how about
facebook owning whatsapp instagram and
oculus right
not oculus oculus is fine but the fact
that facebook can buy whatsapp and
instagram come on
then video is trying to buy arm can i
talk stocks of it bro let me tell you
about this one weird trick to get rich
quick
it's it's it's
and that is how you can make a million
dollars overnight
oh it got muted oh you missed it oh
sorry
sorry so if you missed it i'm sorry i'm
just sorry you're just gonna
let's load in the frozen clipping batter
bom bom bom
oh
you
oh you need cuda
all right you can have a kodi device
expecting all tensors to be on the same
device
wait
but i didn't load in any weights
you gotta load in weights
all right
subscriber only time
much like tiny grad you can just start
banning viewers when it goes over a
thousand that's a good point that's a
good point
uh oh we might want to say t model
equals here
there's no attribute cuda
it's an abstract encoder
oh i think i can get rid of the cuda if
we just do device equals cpu
okay this worked
great
okay that's the input
oh 77 all right all right we're not
gonna write the encoder but okay okay
guys now it's time to choose
what do you want
what do you want a picture of
a horse
sized
duck
fighting
a cat
fighting a bagel
a horse-sized cat
fighting a bagel
eating a bagel
okay a horse-sized cat eating a bagel
it's decided
a horse riding an astronaut i saw that
one online
okay
all right so this is the tensor that
describes a horse-sized cat eating a
bagel
um
phrase
equals that
let's put a comment that it's a horse
that's cat eating a bagel so you have to
do some encoding i'm not actually going
to do it
um we'll leave that as an exercise to
the reader or something
okay and then that's the output tensor
so let's go through and let's see if it
works um
where's my clip model
three
hmm
doesn't work
what did i do
anymore
now i think actually like this isn't
right
picture of the world where there's no
suffering oh wow let's not go so
abstract how about a horse-sized cat
eating a bagel
okay
con stage model object is not callable
well that's good to know
uh because it's constant model dot
transformer dot text model
i did this already i hate when i have to
retype things
model.transformer.txt model
tensor phrase
tensor phrase tensor phrase
okay then that's the context and then we
have context
you're guessing we'll get a black square
oh this isn't even a tenser i just
literally pass in phrase right
yo you guys have no faith
we carefully tested every part of this
model
no
we didn't write that numpy
i first come on first we got to get the
clip working let's get the clip working
first
once the clip works
i should have taken two red balls from
work
okay do the numbers match no of course
they don't match okay who's ready for
debugging time oh it's debugging time
okay
um
flipping better
model eval
what
like not in
so
so
yeah okay
we have a clip tokenizer and a clip
transformer
clip text model clip text transformer
like where is the definition of this
all right yeah from transformers right
that's annoying
jagger rsw thank you for gifting subs
i appreciate you
861 viewers you're all going to be here
when this works maybe
you know we don't um ever have any
promises
because promises will only let you down
uh
last hidden state what
okay well these numbers are not the same
as these numbers and that upsets me
we have to figure out how to make these
numbers the same
and this does mean we're going to have
to go in here and figure out where
clip text
um are there any obvious bugs can we
just find obvious bugs let's look for
obvious bugs first before we have to go
in and dive in and because we know we're
not gonna find any obvious bugs but who
knows maybe we will get lucky
all right we did the quick gel you
that seems
like a clip mlp
so like where are these
yeah like it's not in okay
that matches that
clip attention
i don't think i did this wrong
like i might have
but that looks pretty similar to the
other ones
this one was very straightforward we set
our num groups equal to none that's
right
uh we have 12 of these layers and we do
12 of these layers
there's a chance my embeddings are just
wrong okay well let's just find out
where this stuff is then
uh we're gonna have to open
where does python save this stuff where
are my
user live or something
we gotta find like where python hides
their stuff it's not here
uh it's in sight packages somewhere
y'all remember when people got banned
from let's run for posting about rocco's
basilisk man
yo
information hazard bro
ai's in the future bro if you guys are
rocco's basilisk to me or whatever
do it
do it it's your only response
uh
like what if those weights in there just
aren't right
roku is involved in becoming a base ship
poster on twitter yeah you know there's
two kinds of people in the world there's
people who get offended and there's
people who do the offending
uh i'm on the side of the people who do
the offending you know
what's the eminem line and if i offended
you good
because i'm a criminal
criminal
okay uh ubuntu site packages
there's two types of site packages great
our user local
lib python38
not there is it in dot local
no it's in dot local all right that's
chill
let's just open up one more window here
i promise this is it for the windows
you definitely won't need more windows
than 37.
uh
site packages
transformers
models clip
modeling clip
oh look at how much stuff they have here
oh it's because i didn't do anything i
didn't do an attention mask we got to do
an attention mask
ah
man who wants to go and listen to some
copyrighted music i will settle for
uncopyrighted music
[Music]
oh
[Music]
okay those match
wait i don't think we can do that song
it's probably copyrighted
we can only listen to uncopyrighted
music
we have to do this causal attention mask
crap
[Music]
okay
okay we gotta do this causal attention
mask
[Music]
gotta get your causality right bros
[Music]
[Music]
scared of your
oh my eyes i actually don't know how to
do this
[Music]
i got the shoes
[Music]
so
[Music]
[Music]
[Music]
[Music]
so
[Music]
[Music]
oh no it's the one hour version
[Music]
[Music]
[Music]
[Music]
all right let's try this
ah that does not match that doesn't
[Music]
[Laughter]
[Music]
god
[Music]
[Music]
scattered
[Music]
[Music]
this
[Music]
[Music]
oh
[Music]
[Music]
[Music]
think that we know
[Music]
[Music]
me
[Music]
[Laughter]
[Music]
so
[Music]
is
[Music]
[Music]
[Music]
wait
real talk though
why is that 64.
it shouldn't be
uh
you
oh i don't think that permute does what
i think it does where is it
transpose one two all right let's look
up pie torch transpose
that is what that is
all right it does put
oh did i forget a transpose or something
that shouldn't even multiply
that's annoying that silently fails
that shape was wrong
all right there we go
uh
it still does not match but hopefully
we're getting closer
all right where was i in the great
bisection
[Music]
look at a clip encoder layer
i did hear pat's day died yeah i heard
right at the end of yesterday's stream
it's very sad
i didn't know canada was such a violent
place
uh
minus 4.2
oh it's wrong like right away
all what well
right
i guess it works because we're only
doing one later okay
all right so that whole thing works now
but uh
now let's say like if i equals one do
that
see if we can make it through the first
layer without
it's the same thing we have to do for
the other model get ready for boring
boring boring
we're making my code match the reference
code
one careful layer at a time
i've now written transformers three
times
because they're all slightly different
well like clean these up and really
understand these shapes one of these
days well okay let's see what's going on
here look at that uh
yeah okay it doesn't even get through
the first layer okay
so
let's
go in
to clip attention
and let's print those out and see if
they match
you michael bay right transformers three
at a time oh that's good that's good
uh
we're trying to make stable diffusion
it's gonna get exciting soon i swear
okay notice how this tensor here
uh
matches this tensor up here
so let's move down and see if something
like this query states matches
like i think they will
oh wait where's that permute
[Music]
look that's wrong
okay those
match maybe this permute is wrong
i don't see where it is in here
if you do the bmm
then we add the causal weights
then we do a soft max
then we do the value states because we
don't care about drop out
let's just try that
40 290 402 90 405 5 294
it all seems like it matches right like
even that does match that right even
though it's slightly different
they do match
okay i think that's right
it was just that permute
um all right so we're still
let's go to like i equals two
i have an idea like if one layer works
all the layers are gonna work right so
let's just try and take that out and see
what we got
i just had a wrong permutation there
some chance
some chance it matches
oh man you know
great
it looked like the only bug
cool let's do the whole model
great
uh okay
that's all three models
working i think
right this one matches this one right
i don't know what that intermediate
output is but do i really care
i'm sure
let's just commit this and say all
models match
all
models match
i just had a spurious permute in there
we'll have to clean up all that code
okay
craze
all right
uh let's just try writing
what i think is stable diffusion and
we'll see if it works
so first thing that we do is that we put
our phrase into the clip model
to generate the context
context equals this
uh we'll say latent equals that
um
time steps equals that
okay
uh
let's put some comments
start
run
through
clip to get context
start with random noise
um
put
into diffuser
and then
up sample image space to
image with auto encoder
make image correct size okay this is not
going to work i have to disable cuda
i'm not using any more torch
[Music]
so okay and we have to re-enable all the
models so stable diffusion is actually
three models
uh when we're ready we can move this
stuff into the call function
we don't need this for now though let's
just not get confused
a stable diffusion object's not callable
that's fine because
what we actually want to call is the
model.diffusionmodel
so here we'll say
model.model.comfusionmodel
this is only doing one step so i don't
expect this to work yet but hopefully
in the next
something number of minutes am i still
printing something where am i printing
something
here
i'm putting me in battings i'm coming
that out
all right let's take a look at the
picture
who had their money on a black square
black square who had their money on a
black square do we can i see a black
square it's a black square okay
it's not a horse-sized cat eating a
bagel yet
but i have an idea with just a few
changes here
that's going to be a horse-sized cat
eating a bagel
did it have noise oh noise is exciting
i didn't see any noise
oh it has a little bit of noise all
right
um
you tried it on yours you tried it on
your good stable diffusion
not my crappy stable diffusion
[Music]
okay clip we're going here
we have to like sample in some way
all right what if i don't run this model
let's just see what happens
we've tested okay we've tested all three
models independently and confirmed that
each model independently does the
correct thing
now we're trying to put the models
together
and um well
you've seen that we're still not looking
at a picture of a uh
okay this is also just a black square
with noise
it's possible that my starting thing is
not correct
um so let's take a look at the script
here text to image
uh
um
okay
let's see what your horse-sized cat
eating a bagel looks like
wait is that a stable diffusion image
it's so good
that's so good okay no no no but just
just so
they initialized with standard normal
okay all right we have normal don't we
all right here just say random for that
that's a good point we don't actually
want normal i don't know why i was doing
normal okay standard normal it is
um
i think decode first stage is just this
so it is all just in sampler sample
uh
plms sampling
this is a lot of stuff
oh we shouldn't have looked at that you
know that just got my hopes up for what
it could be but it's not
oh here's all those other things that we
didn't know what they did
okay get model output xt okay okay
let's get stable diffusion running
let's let's get it actually to run
and then we can start adding print
statements to it
want us to re-download these stupid
models i can't believe this
it doesn't even need them this is a bug
in the code
as far as i can tell
okay select parameters corresponding to
the
we have to write this sampler
no inputs are put in it looks just like
torch ran down which was the same as
tanza random
um
time steps
okay
it doesn't look very interesting
except maybe they add one to it so maybe
the first time stamp's actually one
i'm not sure i don't think this is going
to matter
nope still a black screen you can take
my word for it
uh
well you know what i can do this runs on
my on my mac so we can just do it on my
mac
um
oh my computer gets slow when i do this
though right
actually if i set time stamps to uh
look at scp i'm not even sure that would
be faster uh
use plms sampling
does it still work if i say that's why i
have to say one there is not going to do
one step
let's determine if they are one step
oh wait a second
okay
okay i just did one step
so let's see if when they do one step
yeah when they do one step they get this
so we're doing something way wrong still
um what if i do zero steps actually
does that even work
oh you can't do zero steps
but when they do one step they get this
and when i do one step i get yeah i
don't get noisy comma garbage so we have
a book
let us find it
let us find it um
the only thing is i think are like my
noise isn't the right order of magnitude
or
let's just double check to make sure i
didn't break the oh i am saying real
equals one right
oh that'd be real stupid if i wasn't
let's just put in the apple and see if i
actually get the apple out
okay we get the apple out
wow one day we're gonna have pictures
looking that beautiful
um
sanity check
okay we probably just have to do
whatever plms sampling is that we're not
doing
plms sampler okay
self model q sample
zero time stamp times mass one minus
mask times image
which computer am i on
alcohol
or even put in a horse-sized cat eating
a bagel just so we
should be able to actually get out the
same stuff
all right cond is somehow big
is it not here or something
no it definitely is
you need to have access to the chat well
congratulations you're a subscriber
now with great power comes great
responsibility
uh so
i'll warn you about that um okay
con shape zero i is one step is zero and
the tensor of the
so it is just a time step of one
now let's make sure that my image is
actually
yeah so this is what we expect to see
when we see things that look like that
we know that we're winning
how does outs have so much pred zero
look at all this complicated ass shit
p sample.plms
get model output
um let's actually just try a little
experiment
what happens if i put zeros in here
oh do we need to do some multiplication
on the latents
we'll we'll get there if we have to do
that i don't know where you see that but
okay
so these are model outputs let's see if
even with that it still produced uh
okay it gave me a brown square
we should be able to replicate that
brown square
ah we can actually also just print
latent here
it should be the same right
because we got the model output there we
printed it
oh we should check to make sure context
is the same
i print it and i'll get it
oh
i always do that
unless you write dot numpy you get
nothing
no it's black okay
this is the numbers that correspond to
the output of the model we should be
getting the same numbers and if we're
not we got to figure out what's wrong
okay we're now we're getting different
numbers
wrong numbers
bad numbers
inferior numbers
wait if we get a hype train even
non-subs can chat
is that how it works
where's my context that i printed out
oh it doesn't actually go there
oh is it here
rip hype train no
oh they should sub so they can chat
that's a good point
they
should oh okay
uh segmentation fault 11. oh that's this
is quality
what happened
oh
oh i see what it's doing
okay
so first off i'd like to show you guys
that the context is the same
you can see this is the same as this
but it actually runs the model twice
it runs the model
once with
unconditional conditioning
and then it like
it does some scaling tricks so we just
have to do that we're going to run it
twice
so
okay
welcome to taika black coffee we get
immunity from rishi
unconditional justice absolutely you
guys know stuff all right um so we have
to run the model twice once with
unconditional conditioning and once with
conditional conditioning
and then we have to do some math on it
i was wondering actually why i ran with
batch size 2 and now i know
okay well
it looks like unconditional conditioning
is
similar i don't really know where it
came from
interesting also to note that the
unconditioned guidance scale equals 7.5
where did this come from
plms sampling
where did unconditional conditioning
come from
really far
uc
model dot get learned conditioning
batch size times quote quote
um
i mean
it's just this
it's not that
all right we're gonna have to figure out
model dot get learned conditioning
is what tokens are
all right
oh okay the first one is 4096 of course
everybody knows that
the first one has to be that oh yes that
makes perfect sense obviously
okay that looks like some unconditional
justice right
there good good
okay
so we do
unconditional latent equals
unconditional context
oh i don't have to do that weird math
where'd that weird math go
plms sampling with all right here's pmls
sampler and we have to do this
latent equals
unconditional latent
plus
unconditional guidance scale
uh
times
latent minus unconditional light turn
out latent.numpy and that should be the
same as that
if we did it right
e.t unconditional is undefined yes of
course
in fact the unconditional latent i gave
them better names
you see what it's doing right
it's using batch size 2. i just actually
run the model twice it doesn't matter
um
oh we should really print out e t here
that's what i expect this to be equal to
if somehow it's not equal to that okay
it's not equal to that
oh do we have to do a score corrector
scorecorrector.modifyscore
okay it doesn't match
mine looks very different from theirs
my unconditional latent match
i did set x to zero right yeah i said x
to zero there
okay negative 1 4 4.
segmentation fault 11.
a10 mask select is currently
okay i'm expecting to see this the
context definitely matches
okay
uh no
this does not match
what did i do wrong
all right
our so
matches
i don't really understand why all those
zeros are weird zeros but
that's just what happens i guess when
you multiply
i latent to zero that's zero that's zero
and that's just not matching
all right
great
i thought we were over this
i thought everything just worked now
all right maybe apply model is doing
something
let's say
apply model x noisy t cont
okay okay this looks like large amounts
of crap
um
split input params well hopefully that's
not true
those are uninteresting
why is cond being pound pounded like
that
wait what why is this seg fall
you don't even know
is just unreliable
it's just unreliable okay fine
self dot model
where is model
how did that get changed did you see me
do that or is this like one of these
like
like it like magically changed on me
so
okay
self-apply model here here here
and i'm getting negative fives out so
that's just not right
um
let me just add a negative zero here
print out let's just say x dot noise z
equals
x dot noisy
i don't really understand why cond is
like that
but this should just be what's going
into the model right
you know i can just check that i should
just check that at the model level but
we'll get there in a minute
and hashable type slice
this con is probably something stupid
that is a brilliant lyric
dumb stupid or dumb huh
hey
wait
that's a lot closer
it doesn't match but it's a lot closer
oh do i have the wrong
i think i'm actually doing the
non-unconditionals for now
uh let's just check
now unconditional's first
so it should be the unconditional um
that
i don't understand that
oh that's c and that's unconditional
okay
so unconditional is there am i printing
unconditional
no i'm putting context out that's the
problem
it's not that doesn't explain why
anything's wrong but
okay
we have some bugs still we gotta find it
oh
okay well it's interesting that this is
called c cross atom let's see where
that's used
in a hybrid conditioner
wouldn't it be easier to unit test
yeah you want to write unit tests bro
you want to go to work
i generally think unit tests are
overrated
um would it be easier if i wrote like a
whole nice testing framework for this
yeah that's probably the right thing to
do if i was doing it for work i'd
probably do it like that
but considering i'm not doing it for
work
all right
this is in the unapp model
let's start diving into the unit model
here
let's go back to printing out
ah
just print out x and print
oh
github's already shilling me co-pilot
all right i'm now confused about which
of these things are these things
i think it's these
and then i think that's right
okay those seem to match
let's print after middle block
i'll print my performance
i'm probably conditioning on the contact
strong i tried some stuff for contacts
but it probably wasn't uh fancy enough
i tried random actually
stop sag faulting
you know what tiny guy never said faults
so that's after the input blocks we get
something that looks like four and
okay that's not right
again it's almost right it's just not
right
um
okay let's go back to this old thing
exit zero makes this nicer
okay
so that looks like the output there it's
nine five
that's different
all right let's just try zero
zero match zero's just a conv right so
zero we expect to match
it must just be the way that i'm
conditioning on the context that's wrong
um
okay i don't know why they're all the
same but it matches
oh i know why they're all the same
because uh
just putting zeros
okay that's different
all right let's dive into the spatial
transformer now shall we
being imported from somewhere let's go
to it
norm projecting
would it be better to like write unit
tests and do this properly yeah maybe
in general
i like to spend like a good amount of
time on the hacky stuff and then
if i don't get anywhere after a while
then we pull out the real stuff wait why
is that running twice
oh
it should run twice right
okay we're getting zero nine nine zero
seven that's
right now here why didn't it run twice
i don't understand
i ran twice
did it run twice i was just trying once
and i'm just seeing things
it did it's giving me 0.11 there
oh i'm just printing that off i
commented that out there okay that's
fine
okay it's still correct up to there
it's probably not correct after we do
the transformer box
now we're gonna have to dive into the
transformer block and see which one it
is in
oh this is so annoying i already did
this
okay now it doesn't match
basic transformer block
let's check after the first attention
does it match or is it context related
let's find out
okay zero point zero six one zero two
and okay that's different
all right let's go back to just running
the norm is the norm okay
is the bug in the attention is the
number of heads wrong
oh i'm a flip if that's what it is
the norm is right this time
so the first attention is wrong
well it's definitely eight by
okay those all seem
right let's just add the cert
okay
those match
but as soon as we go through the first
attention layer they don't match
now we're sure we don't pass the context
into that one right that's the context
less one
i remember playing this yesterday and
that seemed right
can confirm there's no context
sometimes it just sag faults it's
apple's unreliable
mps stuff i think
okay those clearly don't match
um okay then the problem is in the
attention block
cross attention up here
we reshape them
all which should be right
scale equals dim head
i just had size here
all right let's print out the queue all
right all right all right ready
q dot detach dot cpu dot numpy
because the q match oh my god
i feel like i just did this
[Music]
maybe i should print out q before
i know which one it is
negative nine
the q matches okay
what doesn't match
[Music]
the soft max
so do weights dot v
we permute it back
then we reshape it
then we run that
let's print attention
does the tension match let's find out
that doesn't match okay
uh
there's no context here
it's possible that it's mask
if it has to do with masks man
is there a mask
i checked head size that's right
pretty sure anyway
it could be a mask thing
all right we're getting unlucky sag
faults i
think if exists mask
does mask it go in there
is this always going to cycle
so
it's like faulting every time now
oh probably just because i'm trying to
print oh mask is not none
okay wait no but q is wrong and that's
before the mask
it's not really cute guys
hmm
oh
what am i doing
oh
god we need a standard implementation of
attention
those have to get
this isn't right
oh
man
[Music]
i don't exactly understand why it isn't
right
now the context is from the test
prompt i don't actually think it has a
mask
it's like fault
okay
okay
that's the size of q that's the size of
k let's see if the sizes are right
why didn't even print the shape i told
you to print the shape
i didn't
do they match though
no they don't match
q is 40 47.
i understand why this is getting called
twice either
it's getting called twice here too
okay the first q matches
the k doesn't match but only because
it's permuted
that's the scale
this is making me mad
bullshit
all right there's a second cue here
the second q doesn't match at all
but that could just be just
this might be past the point where i'm
learning anything
i'm just throwing myself at this thing
should we step back and write the
unified transformer and why does this
keep crashing
why is it non-deterministically crashing
even worse
are there other prints that are actually
causing this problem
what's this one
that's not even in this program
maybe those are crashing it those are
probably crashing up
you
let's see if the score matches
okay notice how sim is wrong
scale is the same in both of them yet
sim is wrong here
[Music]
because something's wrong with a dot
dot for some reason doesn't match this
it should
because i'm permuting those last two
axes down there
see look over here you get that and over
here you get that
what's the problem
okay let's read my other six transformer
implementations and see if one of them
got it right
but no actually there's only two we
don't even have to exaggerate
we permute q
wait huh
why are q and k the same
no that seems right
i should
no i don't think it's the batch
it's the same size on both of them it's
just wrong
huh
maybe dot doesn't do what i think it
does maybe you actually do want to do
that
dot might be wrong
we want to collapse the first two
dimensions into one basically let's just
try it quickly
there's no rearrange and not in tiny
ground reshape's the same thing
now it's the same
let's just quickly sum up q and k to
make sure it's not like hiding somewhere
else you know
maybe most of the matrix is right but
then a little bit of it's wrong
no they're the same
the outputs are very different
this is so weird
let me just try it on the cpu back in
the tiny ground make sure i'm not doing
anything stupid
it's possible this is a tiny grab bug
i don't really understand it though
well it's the same
[Music]
this is a matrix multiplier
ugh
python uses fortran order for reshape
huh
i mean i
the only things i can think are like
this
it's the only thing i can think
no no but that just has to do with the
underlying it doesn't affect anything
no
more wrong
the shapes are right
those numbers don't look anything like
that right
i'm doing
q dot k times self dot scale
i printed out self.scale i don't
understand i also don't understand how
this was right before
i literally have two matrices
that match
the sums of the match
okay off by like a very tiny bit
two numbers which match
yet
when i dot them i get something totally
different
i don't really like that there's an iron
sun there
what is this
no this is the exact same thing i'm
doing here
it's not possible my head size is wrong
because otherwise that 40 would be
different
why is this 5
why is this .093
okay let's just in case
i don't understand how it could be that
stupid but it could
it's not this is even a loaded weight it
can't even have the wrong weights
they're totally different
no it's not that this is going to be
like it's giving slightly different
results
no it's precision garbage this is off by
it's literally returning five instead of
uh
i don't know
all right let's get stupid
40s
40s
okay
so maybe it is just
transposing or something
i mean i know k is
different
same reshape here
you're just screwing up the reshape
because numb heads and head size are not
co-prime now
you mean multiplication order correct
all right let's try that
i'm going to set q equal to 1.
if i switch to dot and their code
instead of iron sum i mean it could we
could try that
then i don't really like changing their
code
okay that gives us a very different
answer
it's not like that different though
i don't know i feel like something's
transposed that shouldn't be or
something
you know what's crazy like these things
can have weird bugs in them and you
wouldn't know it because
no one's probably really done this
stop sag faulting
okay that whole first row is the same
when i do that
probably is not right
i mean maybe my dot just doesn't work
this doesn't make sense because all my
other transformers work
which might be the end of this thing not
seg faulting
okay it didn't say fault that time
is that a different answer
oh i could get rid of the scale thing
because this is getting converted under
the hood into a conv
you can see what it looks like
no department was too thin
i don't know guys
fuck this man this is dumb
i don't do this anymore
i don't know why it doesn't work
there's probably something really like
dumb
my dot's probably wrong or something
i don't know
there's my other transformer
it looks fine
oh we're permuting the query there
[Music]
and here we permute the key hmm
okay it's probably just a matrix order
let me think about how to do this in the
other order
permutes grouping zero and two together
you know
i'm almost wondering if i broke it
have i broken the main one
just prints
how does it come out to the same shape
how can i permute the query here
channels
so
that's not the problem
[Music]
and then this isn't fun anymore this is
just work
[Music]
we can try that
try that
as you can be 1496 by 496 matrix
the worst part is i feel like this used
to work
i feel like i tested it and it was fine
what broke
no that doesn't work
the only thing i can think of is it's
actually this
i'm just trying to think of what would
actually give me the same output shape
hmm
i don't understand that
oh
this is broken
this is a bug
they're not even like the same scale
numbers
so
i understand what rearrange does
it's it's not that
those match
and those match just transposed
okay
that's rather odd don't you think where
are all those fives coming from
i think that's a bug
i think there's a tiny grass
[Music]
let me just try something quickly
test ops passes right
all right
this is a lot of the weird fives as well
are they the same
yeah i think they are
hmm
that gets us into 30s and stuff
they're the same
all right what if i increase this to two
where does the problem come in
so
those match
how do those match
okay
these match
those don't match anymore
ending with ollie
thank you for rating
we're gonna we're gonna figure this out
any minute now
it works if it's 40s
it just doesn't work
okay look at that so those match
the query and key are actually way
bigger than that
and if i go ahead and
all right agi fire alarm you might be on
to something here
you might be on to something
is this reshape possibly wrong
it's ollie i said ollie should i not
ah
okay so this rearrange is saying it's
batches
and
the number of heads in the head size
it's grouping these two together
it's odd because yeah i mean it works
fine look then if i go to something like
uh well so this would be 8080 and then
this would be something like 80 here and
80 here right and this should give me an
80 by 80 matrix but it doesn't match
all right there's the 8080 matrix there
and then assuming this doesn't crash
that one doesn't match
try using coprime
no i can't change those those things are
baked in
and like i don't think they're wrong
because i'm printing them out up here
right
um
like
our number of heads is there
uh
no like i don't really i'm
confused to see how this is wrong
all right let's try this
does this give me the same matrix
is tiny doing a permute on q earlier
where do you see a permute
i'm doing one here which this this here
is the same as this rearrange
right
i wish this didn't crash all the time
19s 20s like that's all right
which is the weirdest thing
okay let's try something else
does it have to do with the
non-squareness of the matrix
i'm starting to think that there's a bug
in tiny brad
yeah okay that's different
okay
let's get real stupid
i wish that would stop segfaulting
yeah how are those different
okay that one works
ah
what am i doing wrong
that's different now
all right let's make this 40 way smaller
let's go down to 10 here
and now it's a 10 by 5 matrix i'm gonna
print it out and we're literally going
to see
uh if it's doing it right or not
different answers
okay let's go even smaller
here we go four and two come on that
matrix is so small we'll just do the
math by hand
okay that's giving me a different answer
are my input matrices different
let's find out
what
did i say that
oh here i got we've gotten on by here
oops
are my input matrices different
who thinks they're different who thinks
they're the same
okay over here i'm multiplying this
matrix
[Music]
by this matrix and getting this matrix
do
what they look the same to me
all right who's doing the math wrong
let's find out okay we have tiny grad
with this times that equals that
and then over here we have torch
with
this times that equals that
uh you see they're giving different
answers
so you know just like the same way the
uh democrats and republicans give
different answers
um you know you know that one of them is
wrong and it's possible they're even
both wrong but considering this is math
and not politics one of them is probably
right so you can see that this matrix
perfectly matches this matrix
so we have no questions about the
veracity of this matrix you can see that
this matrix is equivalent to this matrix
transposed
so how
all right guys uh my router overheated
um so
uh in the minute that we were gone
i did the math okay so in case you
forget high school math uh matrix
multiplication works like this times
this
plus this times this so i did that times
that plus that times that
and sure enough the answer i get is
this
clearly
the answer that
is that
tiny grad is doing the thing i expect
the problem's not the matrices perfect
not perfectly matching that's not even
close
right
so this doesn't have anything to do with
reshaping this doesn't have anything to
do with anything like that
it has to do with ein sum not doing what
we think it does
where's that stupid iron sum
this
all right
import torch
let's go
let's do this
we have our q
we have our k
i hope we're going to uncover some deep
truth here boys if we don't uncover deep
truth okay uh torch dot tensor
uh let's say tq equals torch dot tensor
q
uh t k equals torched answer k
and we can try something like t q dot t
k transpose
uh nah this doesn't work
t q is this t k is that t k dot
transposes
shape is uh what
oh um
the router's overheating
you guys
what if it's cloudflare
what if it's cloudflare ddosing me from
the internet
uh no i put the router in the fridge i
think we're uh we're doing a little
better
uh
let's see
all right
and you're not gonna believe what i
think the problem is
you're not gonna believe what i think it
is
i did the iron sum by hand and torch
and it gives the same answer as tiny
grad i think there's a bug in mps
i'm running this on mac and i think
there's a bug i think there's just a bug
in uh in nps
i don't know why i ran it on mac let's
go over here and run it on
uh
let's not run it on mac
let's run it on a real gpu
i think there's actually i think there's
actually a bug in the map runner of
torch
mps is the mac thing but
i i did the math by hand it's there's a
bug
we just i don't know we're gonna run it
over here and it's gonna give me the
same answer
where's taming
maybe it's over
this is this is the last try if it
doesn't work now
if it doesn't work now uh
if it breaks again we're just out of
luck we were pretty stable all day today
i think it's my router overheating
um
also
i
genuinely think the bug
is mps
i think that it's just actually not
printing and converting the stuff back
correctly
um
unfortunately i can't run this on my uh
well let's make some
changes trying to run it on my other
computer
first let's not load the safety model we
definitely don't need a safety model
oh and then here we can put in only one
uh
ddm
and not in either ddin step one
uh look at the line that we happen to be
uh running out of memory and that's
interesting
is there a way but i don't understand
how this doesn't fit on my
computer
um do i have an old version of pytorch
or something
actually i think i might have an old
version of pytorch
there's also a
the new version of pi torch in tiny
grads
which is all very suspicious
how come i can't run it with cpu
they have like a dot cuda hard-coded in
here
let's get rid of that
we have another dot cuda somewhere i
think in the uh
creation of the
here
uh
con stage model
no there's like the parameters somewhere
add it up in the other one what's it
called
v1 dash inference
i think here
frozen clipping better
we have to put a parameter that's oh
here device get default device type
oh
i don't understand now that should
actually be okay
because kudos shouldn't be available
no cuda gpu is available
ldm encoders module
yeah device equals cpu
no
how come that didn't work
did i do it on their own computer
no device equals cpu or maybe when i
instantiate the frozen clip text and
better somewhere and
device if cuda is available
oh this shouldn't be a problem
this is a different script anyway
oh here we
well it's go
a frozen clip texting better it's a
frozen clip and better
okay
we still have one more cuda problem
and it's in diffusion plms
uh
yeah
that's a weird
okay i don't really understand why the
shape is that
well this is some other problem
why is it doing it three times
oh is the default like three or
something
that's stupid
the default is literally three
how did that not come up when i searched
for the thing man google's bad
okay um let's go back to actually trying
to print things out here
why is it running at a second time
why is it keep going
don't do it again
ah
this is a little annoying that i have to
copy these back
now we'll just copy it to render.j
render.png
okay we're getting this for some reason
i guess because we still haven't turned
off whatever makes it do gritty stuff
um
skip grid
and rose
okay
let's just dive right in to where we
were struggling so hard before
and print out score and then
give up
oh that's fine uh no we want to do it in
here um what's it called it's called
cross attention cross attention here
uh
we have this thing called here so let's
just do time to stop that scale
score
i'm gonna be so mad if this is just
right
like this better be wrong
this better be wrong or we wasted an
hour on an mps bug
no not that
five four nine nine
okay it's different uh but that's
actually okay it might just be different
because i didn't set it to zeros yet
we have to set the input to zeros and
plms
here's my model runner here
uh so i'll just say x times equals zero
here
that should give me the same stuff
oh i also don't really want to do that
but
hey
hey look at that
they're the same
would you look at that hmm it looks like
uh that whole time
we didn't have a bug
that pisses me off
so
tiny grads correct
uh the other one was wrong
all right like there we go that clearly
matches that
i i was staring at that i was like
there's not a bug here
and shame on me for assuming the bug was
in tiny rad the bug was actually in um
pie torch oh hey look at that
file a bug report
it's in mps it's not in maine pie torch
no one should be using mps it's not that
it's not deterministic it's that it's
actually wrong
um
but
you know
we don't have time for this
it would be nice of me to file a bug we
can try to track it down later
if we get to it we'll try to track it
down but you know we're already behind
schedule with this
what a waste of time
what a waste of time
um
all right well let's go all the way to
the end and see if they match
what made me suspect it was coming from
there because i did the math by hand
over here i did the math by hand and
tiny grads correct and pie torch is
wrong
and would you look at that the whole
thing matches
okay great
so we didn't have a bug that whole time
and it was just um
literally just bugs in the mac
implementation of fps
wow
wow
wow guys
you're telling me tiny bat has less bugs
than pie torch mps wow
um
you know you know what should have been
a giveaway the fact that it kept seg
faulting right
like there's some memory corruption
right
tiny grad
justice oh
i was like i don't understand
i spent all morning
i spent all morning
making sure these things were the same
how did they then become different and
the answer is they didn't
all right let's do both and see if
they're both the same
um
okay so this is like the adjusted one
with uh
this one does like the unconditional
latent stuff
negative 2 negative 3 negative 5
negative 2 negative 3 negative 5. okay
that matches
great so we've gotten all the way to
here and it matches
now we just actually have to write the
sampler oh man
what a waste
[Music]
hmm
i was sure i had the shapes wrong i know
i know
i didn't think i did
i put a lot of thought into that
get john carmack in here with a debunker
um okay
i don't understand why it does it twice
why does it do two samplings don't do
two samples can i turn that off
uh
so we're getting all the way through
plm sample pls here
old eps equals et
i don't know where img is coming from
xprive
well first
let's do
[Music]
actually are the two samplings exactly
the same
they probably are
pravdad welcome welcome
we found a bug and torch
and we wasted an hour and a half being
incredibly frustrated because of it
um
no like runs this thing again which i
don't really understand does it give me
the same answer
we'll see in a minute
i'm using the cpu but we could actually
go back to the gpu i didn't need to make
any of those changes i just need to know
about end sample
it's the same
okay so now let's take a look at
this thing
why are there two
i don't
understand
i told it very clearly what zero rows
does zero work
it gave me two rows
no no the solid color is a good thing
the solid color is a good thing this
actually looks the same as the mac
um
for some reason though i don't get the
solid color
when i run it i get something else
because i don't think they're putting
this right into the post quant conf
why are there still two i don't
understand whatever
uh
so my latent matches they're latent
perfectly
no solid color would be great anything
except for solid black is a big win
for for a tiny grab
um
oh
i bet
uh
i mean i wouldn't use mps for your
implementation either i'd use cuda
look it's not like we found a bug in
torch cpu or cuda we found a bug in mps
um
oh is both no i don't think it's both
samplers
regardless okay we still have
whatever is going into post quant conv
whatever going into the thing it's not
what we're getting it is what's being
returned here
outs old eps equals this
image callback
return image
i guess oh
okay
this is doing something here
and actually what we want is this
so that's not actually x
that's some e t from the model output
i don't know what old eps is
oops i ran it on mac again never do that
let's print length of old apps
pseudo improved euler
dwight's plan you know what
the chrome attack i want you to think
about that for a minute
do you think somewhere i have a list of
all the streams that i have planned
um
okay they look very different
that looks very different from that
and the input is zero so we just have to
figure out how to do this
xpread equals
get
prevent x zero
so we just have to implement this
so this is not actually laden this is
actually called et
um what's index we can print index
image encoder z quantconf post quantcom
you sure it goes into quantconf
i'm not sure it does
also it seems like it's running this
twice
oh once on et prime oh i get it
okay an index here is also zero
get model output
this doesn't seem like right
it's actually running it twice
oh it like does run it twice
um
i'm not naming enough of my variables
justice
my programming skills for hire yeah but
i'm real expensive trust me you don't
want to hire me
if you have a problem that you
absolutely need solved and it's super
important
uh i can do it
but realistically you probably don't
want to hire me
qualcomm turns it to shit and then
like that's not in model output so
unless you're telling me it's here
oh here we go yeah perfect
um
oh all right we got to get the alphas
prev's and the sigmas we know index is
zero right
uh
is this the
diffusion
all right subscriber only
this seems like the diffusion
i think the diffusion's in here
get x preve and prevex zero all right
what's torch.full do
where's x
what's x
what oh that's so bad
they just bind it
to just bind a variable like x is uh is
ballsy
[Music]
do we want to quantize denoised
i don't know if we do this
oh i see
oh we don't do that wait so we're not
even calling quantize
we are writing noise though
torch full what's b
oh that's the batch size
all right where are my alphas
where are these things they're like here
none
not even in the word model
i guess that's fine i guess they're just
in here
use original steps
are we using original steps
we just print these things
square root one minus at
yeah i see what it's doing
it's cool we should have that tiny great
should have a full
and i should use that more like usually
when i write that i end up doing uh
all right let's just hand code those
quickly
i don't think it matters
i think we should get something that
looks kind of like it right
um
okay
do we have noise drop out
i don't think so
how does any of this stuff work
very complex
uh float object has no
square root
let's just make them all tensors
oh i don't know what noise like is
do we need noise i imagine we do
it would help if i actually understood
what these things were
oh literally that
triple cannot be interpreted as integer
temperature is not defined okay we need
temperature
is it hot let's find out
temperature equals one
okay
astonishing this stuff works
t next is not defined okay
let's see where t-next comes
from oh
i don't know how i feel about that we
don't need this
let's see if it looks at all like
the thing
do we get it do we get a square that's
the only question i have
okay does that look like the right order
of magnitude
guys it's a little different but it's
the right order of magnitude
i'll make that all work in a minute
so we're going to have to
and black square
is there another problem
i guess we should make them equal first
okay what's t next
imagine t next is one
to next is none
it's like not i don't know
t next equals ts next
i'm gonna actually have to make these
is this the same alphas
all right come on t next give me t next
is it one oh it's one
and that's going to print out
a bunch of those tensors though
which are the same which is interesting
i guess index doesn't change
okay i guess that's fine
oh
it's actually the same
t and t next are the same
okay has to run that model four times
okay t and t next are both one
so hopefully we get those numbers out
if we did this stuff right well not
we're not going to get those numbers out
because of this
do we need noise
so i don't like that that's killed
oh but then no grad doesn't work again
because it's not freeing any memory
there has to be some other bugs still
because those numbers are not that far
off
how come my up sampler
doesn't
work right
killed okay
well that doesn't want to work
um
let's just switch the real
implementation to do that
i won't be too bad for it
i also commented out noise let's comment
that noise from there as well
i didn't generate the noise
does it keep generating two
even though i say on rows equals zero
should i say n samples equals zero
or did i spell in rows wrong or
something
okay
that's the answer it gave me
negative 02 negative 04 negative 04.
[Music]
we have to fix the no grad issue that's
that's crazy i don't understand how that
could be wrong that's a tiny red bug
does not match exactly
why not
that's the model output which does match
its package okay
let's look at the picture quickly black
square
uh
hmm
no that doesn't match exactly
it's very close though
to be some other problem
this probably isn't what's going into
the upsampler
we're not calculating the loss it's
inference bro
all right ouch is that image is that
return image all right
plms sampling output samples
sample
decode first stage
uh oh well that's a cool thing that it's
doing
it is doing this
maybe we have to do that too
x
equals
x plus 1.0
divided by
2.0
me do the clip down there
there's some chance it's something to do
with that
there's no accident but that's just not
a thing right it's just that
there's some chance it's that
like if they were all negative before
but no i don't really think so
i just noticed that was different
oh
square
okay so as you can see
this one looks very similar
to this one okay
let's start with noise
oh brown is a big improvement
it's insane it actually has to run the
model twice
we're gonna have to figure out why no
grad
uh doesn't work actually we should we
should uh we should commit that
brown image
hmm
do we think it's becoming
more or less like a horse-sized bagel
is it turning into a horse-sized bagel
that's the only question i have
no we wanted a bagel-sized bagel wow
uh all right let's where's my k times
zero i i did x times zero somewhere
yeah
let's get rid of that
let's run the real one and see what it
looks like
i think that's a pretty good step though
all right we've got to figure out why no
grad breaks that
it looks like a bag over taylor swift
you guys we're gonna render a picture
using tiny grad the bug that we spent an
hour and a half tracking down turned out
to be a bug in mps
mps believed that this matrix times this
matrix was this it's not it's this
should we go back to the gpu it'll be
faster
okay
unfortunately we got brownish mesh and
it got
nice looking stuff
so we still have a bug
um
i think i'm also gonna i don't want any
of these mods so let's just stash them
and we should be able to run it with
that
now it's going to use my gpu and it
should be faster
okay good it's faster
potential nsfw content was detected in
one or more images what
what
my junk noise images yeah yeah i believe
that
all right let's disable the stupid
safety checker
ah
[Music]
why is it sampling two can anyone figure
this out
if we do zero
oh what's n eider
oh this is another thing
and either
one
what's the default for n idler
two
oh well great
uh okay so let's go back to printing
things out
oh we put in random noise
did i run one in mine while i put in
random noise i'm not sure i did maybe
that's why i was getting black maybe
that's what i was getting brown maybe
you're supposed to get brown when you uh
you don't put in random noise
oh that might just be that
okay we have to fix no grade
be nice if this ran on the gpu as well
no brown
okay let's just try this
what if i don't sample it all
just random noise centered at one
[Music]
what does the autoencoder give me
this
interesting
is my random noise different from their
random noise
let's go into
you know also by the way i can just view
them here oh that's really nice
uh
i rm'd that now i already the wrong
thing
man i hate when i are in the one thing
[Music]
blah blah blah
image
that just work
see what that does
okay
they get random noise
i on the other hand
get
brown
let me printer thing going into the up
sampler
samples
and text to image maybe
yeah here we go
see if it looks similar to this
you think you saw a bagel in one of the
pixels wow
ah we can actually let's just check to
make sure that's actually
yeah brown
[Music]
they look pretty similar right
there's probably something about how i'm
doing this
let's read the code first stage
here go first stage
uh oh scale factor
divided by
1 over scale factor someone mentioned
this to me right
here we go scale factor
is it the scale factor let's find out
uh
quantize things decode
probably the same
how do i get the latency for the apple
oh look at that guys all right
looks the same
easy
all right
uh let's see how many steps we have to
do
to actually get well first let's
undo that bug i introduced that can stay
but in my sampler i
short circuited the sampler here so
let's just get rid of that that out
how many samples before it starts
looking like an image
bro tiny grad made something i think
it's a beautiful work of art i think are
we done
are we done oh 50 is too many i'm not
waiting 50.
okay that's noise after one
let's try 10.
how'd they ever backprop through this
all right you got ten
what
is that a cat
wait this isn't tiny grad guys this
isn't tiny grab don't get your hopes up
we're just doing some binary search to
figure out how many we have to do before
we know if we're breaking it or not
this is five
can i do like two
it looks like a raccoon well yeah i'm
not sampling much
we're trying to figure out when it no
longer looks like noise okay after two
it's still noise
three
let's try three
is three the magic number after five i
got this
it's like an artist filling in the
details
now you understand why it took four
thousand a one hundreds yeah right
all right well
five is not a three is not a good number
let's stick with five we can run five
okay
does it always generate that
should we try four let's just try four
just for completeness
can you add keywords like photo yeah
yeah yeah don't worry about that don't
worry about that if we get something
that looks like this at a tiny grad oh
that's such a victory
all we're getting out of tiny grad now
looks like that so
okay four is good
um okay
so let's add some print statements
get model output here x t
let's print t
you have to do the loop here
oh
okay
well
maybe if i just do one with a big t
it'll work
maybe the problem is i was just doing
tiny t's
set t to 7 51.
come on tiny grad i believe in you
all right we got to figure out how to
turn off gradients without it breaking
all right
whoa guys
random noise
you can't just put in more tea it turns
out
let's turn on no grad and figure out why
no grads break
oh maybe no god only breaks it for uh
maybe nograd only breaks it for uh
[Music]
okay
um
let me just add in these alphas and
stuff
quickly quickly
use original steps is false so it's not
even these
uh i don't know where ddm alphas is
coming from
i'll make eating sampling parameters ah
that looks terrible
what if i just set use original steps
equal to true
also if we give it a noise does it still
work
cool okay
i definitely don't need noise
so it's fine to leave out
um we probably do need
do those parameters really matter
i don't know
all right for index comma
time step
in
enumerate
oh my index should be actually reversed
list enumerate
1 251
minus -1
uh this is time step that's index
that should kind of work
uh enumerate takes it most now
you know we should also figure out if
the sample actually needs any of this
fancy stuff here
or if i can just do
i understand that might make a slightly
smoother thingy
uh
[Music]
model output latent time oh time step
don't make time
let's see if this generates a decent
picture
[Music]
we'll see if we actually need this
second order
that's pretty good
i mean it's something anyway right it's
not quite what we asked for but it's
something
okay so this is running the model four
times
and actually eight times well we should
make batches work and then it'll be a
lot faster
okay
we ran the model four times
got the new latents we put them into the
first stage model
and let's see if we get our first
picture that isn't noise
can we do it let's find out
oh that didn't actually run anything
that just cached everything
we should probably resolve the tensor
tiny grabs lazy
oh
wait
why is no grad still false i thought i
set this to true
we're almost there we're almost there
tensor has no attribute resolve oh it's
not called resolve it's called something
else
uh what's it called
realize
i've done this before too maybe we
should uh have resolve as an alias
so realize remember tiny grad's lazy so
realize actually
runs all the stuff that makes the tensor
the denser
okay we ran one step
and also we can try to run on the gpu
which would make it a lot faster
it was running on the cpu right now
are we gonna get our first picture
did i forget anything
if we didn't need that
we didn't need the noise there
oh that stuff might be slightly wrong
but it doesn't look like it's super
important
it looks like it's just some like
vaguely directional
thing like i don't know we can do it
maybe these numbers matter
stuff's all right
um i'm putting in very large numbers for
time steps which is right
let's look at these numbers
oh maybe it does matter okay a t is
pretty small there actually
um
all right let's just let's just let me
just write this quickly
uh we can do something like alphas
equals
actually should be the uh
alpha is prev
see if there's any pattern here
not one that i see
alpha's pre for some reason is a normal
float which has far more precision than
any human would ever want
um
sigma t is a nice set of zeros
and this last one here is square root of
one minus alpha
for some reason i think that i might
know how to compute that
but you know the uh text could always be
lying you always gotta watch out for
lying text a lot of comments live too
you know
it was just a crime to lie in comments
and you know what you've had you know
what happened nobody would ever write
comments
and that is why governments shouldn't
pass so many laws because they should
think about how what they pass their
they shouldn't think about what the law
says but they should think about what
the law is actually going to incentivize
people to do
okay
is that right
how many viewers we got
ah
shouldn't call it sigma t i should call
it sigmas
my viewers we got
oh let's try enabling uh let's enable
the gpu again 600 all right
let's cool
the gpu and see quickly from there
if we hit ohms no more gpu but there's a
chance for those work
not
oh render under under
it's rendering
very slowly but it's rendering
what do you think do you think we're
gonna get a picture this time
whose money's on picture
whose money's on no picture
you think no picture you think we're
getting noise
oh holy shit guys
yo
are you ready
that's a pretty legit picture
i see a horse head in there
bros bros we're killing it bros
all right let's just throw some more
compute at it
we're getting close
getting close we're getting close it's
working boys
tiny grad made that
renders
something
yeah right
um
i mean i don't know like
i'm sure the ones that i trained with
are fine if i just use them
let's print them let's see how terrible
they look
for example self.alphas come prod equals
tensor dot empty 1000
and then after we load it
uh
that does support amd gpus too
we're going to fix the memory issues
it's going to support it's this is going
to be the best this is going to be the
best support for m1s and is going to be
the best support for uh
uh
wait
not exactly understanding something
i think index might not actually mean
index
i think it actually might mean timestamp
here
i think something weird's going on here
that's gonna work better i think
all right like i think i think that's a
bug right
or they're doing something they're doing
something complicated we can just
replace with a simpler thing
okay
square root minus one
uh
d dim sigmas for original steps
stuff's all in there right
oh the d dim one's not
the sigma's always zero anyway right
that's just not right
can we just see if uh let's do a few
things
okay so we can say
sigma t equals zero
we can
say
square root one minus alphas we just
check if that's actually what it is
cool so those are useless
um for alphas and alphas pre we'll just
get them from the model
so we'll say model dot
alphas dot multiply sub index
all right actually we don't want index
here we want time step
sigma t equals zero and then the last
one is square root one minus a t is just
math dot square root one minus eighty
those approximately match those right
not really
alpha's preview doesn't match
oh it might just be as simple as
literally the previous alpha
do i have to write this ddm crap
i feel like i do
let's look at that picture
nope we're back to noise okay fine
these parameters matter a lot
at least i can keep these
see how good images look when i do 10.
so fast on gpu
oh i love the gpu
that's a pretty good picture if we can
get tiny grad to output something that
looks that good i consider it a victory
there has to be a better way to do this
what's the function
we want to write the function or we want
to just copy and paste this who thinks
we should write the function or who
thinks we should mindlessly copy and
paste
can i get a show of hands
function
you know what you're just saying that
because you don't have to do the work if
you had to do the work you'd be
mindlessly copying and pasting too
also it should just be 1.0 it's close
enough to one point now
all right
um
i definitely disabled that other thing i
disabled noise it should be fine
yeah leon we gotta go back to sub mode
just because that's just cause that's a
real inappropriate how much can you tell
me about your net worth
let's talk about how much you're worth
man
all right
we need something that resembles a
horse-sized cat eating a bagel
i had a whole lot of monero but i lost
it in a boating accident uh yeah you
know tragic so i mean if someone gets
that boat up maybe 10 million dollars
but
um
if tiny guy has faster inference than
torch well it's running on cpu right now
but yeah i think there's places where we
can get
faster inference than torch
i don't think we're gonna get faster and
for instant torch on uh on cuda
but i think it's very possible that we
can get faster and friends and torch on
m1
i think it'll also just be it's very the
library is very very portable
i mean so okay here's my entire
implementation that's all chunk my
entire implementation is 600 lines
all right this is 600 lines on top of
tiny grad to write all the stable
diffusion
um
we're gonna see here's hoping this is a
good picture
if this is a good picture
i think we're gonna we're gonna call it
for today's stream if this is not a good
picture we'll do a bit more debugging
we need something resembling a
horse-sized cat eating a bagel
ah does tiny girl use onyx for amd no we
don't use onyx for anything the it's
it's all written
there's a whole bunch of bugs here to
fix for example this shouldn't be two
runs of the model we should do the same
thing that they're doing where we're
batching them
um
all right we got our vector
going through the auto encoder now
10 steps
10 steps all right let's see what we got
oh guys
i'll take it
that's pretty good
[Laughter]
i'll take it i'll take it
i mean look it clearly understands the
prompt
um
[Laughter]
i would say that cat is very uh
no no no no but like
would you not argue that this right here
is very bagel shaped
yo
i'm sold i'm sold
generated with tiny grad
let's commit this there's a lot of
cleanup to do
you know we're not gonna stream clean up
cat horse
winning
you can't put exclamation points we'll
just say exclamation
i have to drop out of the tmox so it has
my ssh keys
bro
january with tiny grad
uh this was this was this was nice this
is this is the the
hardest i've went on a project in a
while
um my sampler isn't perfect
so i didn't copy their sampler exactly
um they had a bunch of random crap in
the sampler to do like
exponential moving average on the
weights and stuff
uh so they probably get slightly better
pictures
uh because of it they're also running
for 50 steps we only ran for 10. we're
gonna have to get tiny grad running on
the gpu and off the cpu before it's
worth sitting around and waiting for 50
steps
um it's not as good as the original for
a few reasons we're only doing 10 steps
we're not doing 50. i mean i would say
it's as good as the original i would say
it's as good as this one
where's my uh outputs
i would say it's similar quality to this
one
well i'll agree with you that this one
includes bagels like the cat face is a
bit messed up
um yeah we don't do any quantization we
don't add any noise
uh
though i don't think the real one is
doing the quantization either
uh so the next steps will be to clean up
this code would be first to make it
faster because it's just like yeah we
could debug it and write the sampler but
it's a huge pain if it's man slow
um so we gotta get it actually running
on uh
we gotta get it actually running on uh
uh on a gpu first
uh it's running out of memory i don't
know why things aren't being freed but
um we'll even let non-subscribers
comment on our artistic interpretation
of a
horse a cat-sized horse eating a bagel
or something
what was the exact phrase
um
we also
here a horse-sized cat eating a bagel
yeah it should run under amd gpu so we
have we have to clean up tiny grad we
have to fix that bug that we found
um
but i'll clean it up and this could
actually be a real use of tiny grad
uh i don't think you guys want to see me
do refactoring do you you know
it's boring
live debugged in front of you
all right should we try one more prompt
all right we'll try one more prompt
let's let's let's hear it for the
prompts now unfortunately we have to do
this weird encoding for the prompts but
we can do it
um
so you tell me what prompt you want
i i didn't write the encoder
uh so we'll just do it here you chat you
figure out what prompt you want and
we'll do one more prompt
um
where's the prompt
tax damage
no
oh you know what i can just do it on
here i think i think the mac one will
still do that yes it will okay
tell me what the prompt you want is
penguin i hear penguin holding a fire
extinguisher i hear human colony on mars
i hear taylor swift sitting on a giant
purple dildo
um
the devil dancing on the grave of
humanity no this is dark man we don't
want it we had a dark donald trump
shaking george's hands
you second which one
could i get can i get some some
consensus here
um
you second the dildo one no no no we're
not gonna do the dildo one a shark
eating a patent troll
um all right penguin with fire
extinguisher it is
uh okay
so if i go in here
i did it already
[Music]
okay
penguin with fire extinguisher this
isn't gonna offend anyone right
so
clip does these encodings to convert the
uh
the phrase to a um
wait what
did it not oh oops how do i have prompt
so i'm just using i'm using the uh
encoder
from
the original repo
we need to write this too
why is fish transfer gp via command line
you guys it's only running for 10
iterations it's not that smart all right
here we go
okay
we are now generating penguin with fire
extinguisher
any other any other questions it's now
it's now open question time on the
stream uh my net worth is about 350.
uh
if someone wants to submit a pull
request for a nice tiny version of this
i'll be
uh happy
dick's about eight inches
where do i think video models will start
to work
we need like another 10x
but i mean they're obviously going to
work
how large is the data set i didn't train
it it's training with uh
lion
uh leon leon
um
will it run on a comma three yeah
probably i could probably make this run
on a comma three
it'll be annoying i don't know maybe not
i mean i don't know what to do about ram
it only has four gigs of ram
uh leon 5b
uh oh the stable diffusion team is doing
music that's cool
man i love that they're releasing
everything open source it's so cool
yeah coherence is hard across the video
i i can't even like people like i don't
think any of the filters are very good i
think all the filters have this problem
all right we're still generating the
penguin it's slow it runs on cpu guys
uh
[Music]
no i don't think diffusion model's
inability to count as deeper limitations
i think that's just a question of
weights
i think they showed this with like the
can they write
does it require advanced math knowledge
no
you saw you go watch i did it
in what did i put 15 hours into this
15 hours all right penguin on a fire
extinguisher let's see what we got
[Laughter]
not bad
not bad
but this shows that after all that work
i got uh i must have got my clip model
at least somewhat right
actually i must've got all the models
right
[Laughter]
uh is it possible to downsize the floats
yeah it's doing all flow 32 we probably
gonna float 16.
right
you can do this right now with tiny grad
sort of only some of the back ends work
uh
can we see a 50 instead of a 10 yeah but
we're gonna have to be over 20 more
minutes
now all you get is tens until we make it
run on the gpu
there's a few companies working toward
video it's just i mean it becomes just
an infrastructure annoyance problem
after a point like this is pushing the
limits of what you reasonably want to do
they can draw faces fine i just didn't
iterate enough
uh
kind of need the floats what do you mean
no it's like a high-tech futuristic fire
extinguisher
is not going to the moon i will bet
against them shipping a car to be honest
i look i'd be happy if they proved me
wrong but i would bet against them let's
say like they could ship one car but
i'll bet against them shipping ten
thousand cars
that's just like my
um if there was some way to reflect that
in the markets
do i know what's wrong with gpu it's
just running out of memory
how much ml do you need to know to
understand the stable diffusion repo
i mean
instead of reading the stable diffusion
repo you can now just read uh
my implementation of it
and it's only 648 lines
on top of tiny grad
uh which is a thousand lines
so it's 1 648 lines for a full
uh and most of these lines are empty
space it's probably really more like 500
and i have a whole bunch to clean up
i mean it's amazing how short these
things can be
uh and then they require ungodly amounts
of compute to train them
i'm using a ton of other libraries what
other libraries am i using
i'm using
numpy and actually i'm using the torch
back end for this but
which import commands what do you think
i'm important
tqdm
collections and a bunch of things from
tinygrad
there's no imports here
even not even i'm not even using torch
to load the model i even wrote my own
implementation of the pie torch reader
which actually technically is not in a
thousand lines
collections is too much
collections man you use name tuple
that's too much man
um
no you don't have to do gradients you
don't need to compute gradients when
you're uh
when you're uh
running a model at inference
there's not more math needed for that
stuff i mean you watched me yeah it's
not more than high school math yeah like
you you watched literally mps fail at
multiplying a four by two matrix
what is tiny grad doing for you it
implements everything it implements
convolutions it implements matrices
um no i'm not training the bottle no no
no no
yeah there's no loss function
tiny grid's just kind of what i do on
the weekends one of these days it's
going to be really good you need to know
what an integral is no
you barely just know what a derivative
is right so we're just using the chain
rule over and over again here i can like
show you it's pretty simple the only
part of tiny grab that uses derivatives
is a thing called mlaps
like ml ops has
like conv is the most complicated right
this is the forward pass for convolution
this is the backward pass for a
convolution
um
but like most of them are really simple
like this is the backward pass for add
for sub
for mall
uh for pow and then like i pat
derivative divide used to use pow but
now it just uses multiply by reciprocal
like that's the derivative of reciprocal
ah
yeah my net worth is about 350.
i wonder how much i can cut down the
processing power well it's all about
cutting out the processing power as much
as like
i need to fix the bug in my gpu
implementation and get this thing
actually running on gpu with decent
speed
um
also there are some annoying things
about the uh stable diffusion repo like
it downloads all these weights that it
doesn't need because it loads
pre-trained clips that it proceeds to
throw away
i'm not really sure why that is
so this just loads what you actually
need
uh what gpu am i using i got a 30 80 in
quiet
oh that doesn't show you but it's a 3080
380 ti
we did it in three days boys
we implemented stable diffusion in three
days
needs some ethical ai man this penguin
yeah he's just putting out fires
everywhere man he should let the fire
burn did you think about that
this penguin has been created by tiny
stable diffusion yes
uh it went through a tiny clip
uh
kafka is just my name on the these
computers
batman's my name at work
uh it's just so when i'm owning your box
it doesn't show up as geohot
uh no we actually don't have any safety
in this uh please go blast me on ai
twitter about how uh geohot doesn't give
a fuck about what you're calling ai
safety because it's true right
um like there's actual ai safety
and that's the kind of thing that we
might want to have a conversation about
but
then there's like
oh no it might generate naked people
uh
i wouldn't say build ai and worry about
ai safety i think there are things that
could potentially be very dangerous but
no i don't be acquired
how many lines would it take to
implement dolly probably similar it's
probably not that much longer the
problem is i don't have the weights for
dolly
we couldn't put bad words in image props
google ethics is not happy oh no
no i just i think that like to be real
about this stuff like i think that it's
uh
it's the boy who cried wolf
like i think there actually are some
serious concerns in ai safety some
serious like long-term existential
threats to humanity
um if done wrong
uh and i think those are things that
should be discussed yeah very seriously
i do not think uh
gpt2 generating fake news
is an ai safety threat and it's the boy
who cried wolf
like
oh my god someone might use this to
generate low quality content and then
spam the internet full of blogs bro have
you heard of fiverr
like this is already happening you know
what i mean
um
so yeah i i'm upset when these companies
uh
grandstand about ai safety and its bogus
bullshit that everybody can see is bogus
ah so yeah
what i think about alignment research
again
i have a blog post about this i think
that ai alignment is largely a political
problem
um
but i think there are some mathematical
components to it that should be
researched
uh i think that married people are doing
a good job i haven't really seen much of
their recent stuff but in the old days
they they asked some like really
fundamental math questions about
whether systems are capable of like for
example can a system prove
that it's aligned with you and this is
an interesting question
who's bankrolling effective altruism
i don't know
i think the effect of altruism is like a
cult man and like the rationalists like
to
i don't know
i think like like some people get
involved they're like oh oh you're
interested in effective altruism too oh
that's cool man do you like go to
burning man and take acid yeah i do wow
me too man we're totally expanding our
minds and and we're gonna help people
effectively with altruism right uh all
right cool like
you know again i i'm always afraid of
anybody who like stands by you know a
movement too much like if i met someone
in the street and they come up to me
they're like i'm a mega republican i
look at them and be like oh my god
right
uh
oh hey hello girl yeah uh no she's cool
um
where's the next silicon valley and does
it matter
uh
i don't know
i'd like to know the answer to that too
it's not austin
it's definitely not austin uh
is there anything in nebraska no offense
um
the next silicon valley is in africa i
doubt that
yeah i think that there will never be
another silicon valley i think that
that's largely true
china
i don't know
i i spent a year of my life in china
uh i i think that it's
i mentioned him before uh lao y
uh he's a
he lived there you know 10 years and he
vlogs about it and
he's just like
you know uh
xi jinping is no uh
then shopping right like you have the
guy who liberalized and delivered growth
and now you have the uh
uh yeah i'm not gonna say anything bad
about him i want to come back to your
country man you know you know
like you know it's just i get it i get
it that's how i feel about putin too
like i get it
actually you know what putin i get more
you know
i get a bit less and like you know you
could really you really could be the
next america like china really could be
the next america but you have to
liberalize
right like
how is it that
people all around the world watch
you know anime
and watch uh
south korean soap operas and squid game
and listen to k-pop
um
how is it that japan and south korea
have these ridiculously outsized
cultural influences where
can you name any media from china
uh and like
that's
sort of what you're gonna get
um so it just it makes me it makes me
sad as somebody who uh if china had a
stable government that was liberalizing
that was very open to immigration
uh i would build it there
i would i would i would immigrate there
like imagine china had for example would
i move common to china of course i can't
move common to china because
let's say in five years we actually make
some progress and then the state comes
in and they're like ah you're a
state-owned business now we're putting
this guy on the board right so you have
no rights
um you especially have no rights as a
foreigner
uh so i mean and this is this is one of
the really beautiful things about
america uh if you immigrate to america
you can come here you can start a
company and you have no fear that the
american government is going to show up
and uh
you know uh
well this is a state enterprise now
i
it's upsetting to me that it's not easy
to immigrate to america i i don't
understand this i literally like
it should be this function we can use a
big machine learning model to predict um
how much tax you're expected to pay over
the next five years
uh
and then
you know by the way if if the machine
learning model says you're not predicted
to pay tax you can just you can put a
you can put a deposit down right you put
you put a bond up and i think anybody
should be able to immigrate to america
you just might need a bond
um but why would the u.s not want more
people who are going to expand their tax
base i don't understand it
um yeah cue up citizenship applications
by well expected tax yeah i mean or yeah
you know come here on a work visa you've
been paying taxes for the last five
years uh you've you've given a 170 000
to america congratulations your citizen
right like how hard is this
um
and no i i mean the immigration thing is
particularly upsetting to me you know i
say like politics doesn't affect me i
mean here's an example where it affects
me right like at comma we work really
hard uh if you want to come work at
comma we work really hard to get you
visas
uh you know i have to put time and money
into that
and it's still it's not guaranteed it's
just it's insane
like i'm trying to hire six-figure
brilliant software engineers why do you
not want these people in america
um yeah good luck i'm sorry you know
uh
text to video like stable diffusion
it's not that it would be hard
i think we already kind of know mostly
how to do it i think it just requires
compute beyond belief
rank list for citizenship based on
salary and education
again i don't really think it should be
based like education becomes this kind
of thing that can be gamed right i don't
even think it should be based i
shouldn't think it should be based on
either of those things it should
literally be based on how much value are
you going to create for this country
it's literally your expected tax
maybe over a lifetime right or whatever
discount whatever discount rate you want
to use
um if you have a million bonds of stocks
you can immediately live in the u.s
oh that's cool i hope that's true
uh i mean i know a bunch of countries i
looked i looked once and uh i looked
once and moving to malaysia and it was
similar to that there
um
i don't know i'm not excited to move to
the eu
i was just in europe for a month
place is a museum
like
do you do you really think a startup's
gonna come from europe
uh
it said i mean it's that and you know i
ran a well i was the owner of a branch
over in europe and the the amount of
bureaucracy is insane
um
you look at a country like malaysia and
a place like that's quite interesting uh
malaysia is a multiracial democracy
um i mean they have corruption
but
i i mean i'd have to do a lot lot more
research but it's potentially a place
that you could operate
um
right like
you know china has a lot going for it
until
you can't find a company you can't find
a company in china especially not being
chinese
um
yeah i mean you know and then you look
at places like singapore um
you can find a company in singapore
i think singapore has some startups
singapore is a little
do i think california is going to cease
being the main economic engine of the
usa
here's
look i live in california
um
california gets a
bad rap because of like
san francisco being run by absolute
wackos
like the people who are on san francisco
are are
just wackos beyond belief
um the people who run california aren't
right like gavin newsom is not a wacko
you know
uh i i liked uh there's this guy kevin
paffraff
uh you know talking about running for
governor it's like a long shot campaign
but that's who you're gonna get in
california he described himself as like
a jfk style democrat um i can see
california going in that direction and
if they do i do not see
i i don't see california declining uh
really at all
um
with their status in the u.s yeah if
they start if they do idiotic things
like past wealth taxes then maybe
um is america still the best country to
go to to create something new i mean i
think so yeah i think without a doubt
uh
we don't hire any remote workers
uh comma hires zero remote workers
i don't think remote is conducive to
building a culture
i think it's
i don't even have the computer's work
remote the computer's got to come to the
office
russia is on the rise right now
um
uh uh
i've been to russia
um
look
i'm not i'm not a russia hater right
there's a lot of people who are like
russia haters and like uh you know
putin he meddles in the election okay
well then i hope you hate you know the
cia as well um
i i don't know i i
i
am reluctantly happy that russia exists
uh i wouldn't say russia is an
irrelevant country right
you can ask questions like uh i'll do a
50 iteration while we talk
uh
all right all right all right it's it's
a lot more changes than you think to do
a 50 iteration but i think we can do it
that's a lot of coding guys it's a lot
of coding
i need to write the alpha right
[Laughter]
you know
come on guys come on
uh all right all right i'll write the
alpha oh
now we had the alpha what we had was
kind of okay i think i figured out what
i have to do for the alpha
okay
no binding for non-local
hmm
oh that's not right
that's not
right um
dammit
foreign
you
[Music]
uh we had a branch in rotterdam
for a while
that looks pretty good
i want to try 20.
all right you want the horse or you want
the uh penguin
horse or penguin
all right well on the horse
there i wrote the alphas nicely is
everyone happy
i consider moving to dubai
dubai is another one where like you know
i just don't feel very free in that
country
come on this time we're gonna get a
bagel who thinks we're getting a bagel
this time
cyber security tools in python well
because you're a subscriber and it's
your first chat i'll talk to you but the
only people who say cyber are
journalists
right
and like journalist adjacent pmc fuckers
right i've never heard a normal person
say cyber
you were in indiana for summer you can
really feel the freedom right sorry i
misread that i was in russia for a
summer you can really feel the freedom
and i'm like bro i don't know what
russia you went to
yeah no indiana is like mad free i mean
we're really gonna find freedom in
america as a lot of the uh
a lot of the like centrist states i i
think north carolina is a wonderful
place
um i mean look san diego yo this freedom
here man
ah
you're cyber fucked you'll get cyber
fucked bro
let's go
um
cyber equality
do you just bypass moderation no i but i
allowed cyber fucked
uh oh because i'm like yeah i think a
cyber fucker tele dictonix company is
something okay we can
we can we can uh we can talk about it's
gonna be for everyone for the people
cyber diversity uh yeah we're still
doing software and cars dead end
we have a toggle now in our open pilot
master
where you can enable it and longitudinal
control and i drove on it last night and
it stopped at a red light
our com is too difficult to sell in
europe we ship them anywhere man i'll
ship them wherever you want
uh i put it in a box and it goes there
if some state has a problem with me
block my shipment and we'll stop
shipping your state
um
i agree that not much codes need for agi
i very much agree with that i think that
look the fact that you can implement
stable diffusion and let's let's say
realistically this is 2000 lines of pure
python
um you can write this all 2000 lines of
pure python
uh
none of the imports to tiny grad are
fancy like it uses pi opencl for the gpu
but pi opencl is a
if you rewrote pi opencl you could write
it as a 100 line wrapper around opencl
which like okay you can say opencl is a
library with a lot of complexity no i
mean there's actually if you look in
tinygrad there's an accelerator i
haven't really
worked on it lately i started in this
cafe in germany but you can just write
in pure c and i think it'll be pretty
fast
like she's pretty good at compiling to
the cindy stuff now
um yeah the latest fsd is good yeah
10.69
what i think of carmax new company i
don't know much about it
um
i think he's a very smart man and i
think uh
he'll figure stuff out if he uh hasn't
already
can i explain why i know rotterdam no
more yeah look we got a new office
uh
some people quit we consolidated
it's it's not uh
it wasn't for us
you know weird things happen during
covid
[Laughter]
it's pretty good it's pretty good
[Laughter]
i'll read you guys the exact prompt i
think it's actually so good
um where is it where's my prompt
stable diffusion
a horse-sized cat
eating a bagel
it's oversized cat
dude this stainless is unreal oh this is
so good
oh man all right i think that's a great
note to end the stream on uh thank you
all for watching thank you for sticking
with me even when things didn't work
even when times got tough
even when there were bugs that turned
out to be fake bugs
we have written
stable diffusion in tiny grad
it took all labor day weekend but i
can't imagine a better use of my labor
day weekend
uh
you know don't kill anybody i'm just
gonna say in a chill way and don't don't
don't don't dddos anybody and don't ban
anybody from the internet we're all
friends here we can all learn how to
coexist remember that tolerance doesn't
mean acceptance it doesn't mean approval
it doesn't mean you like what they have
to say it just means you tolerate it and
you hope that they would return the
favor and when you say something that
they don't like they'll tolerate you and
that's how we can live in a nice world
thank you everybody happy holidays
you guys think I do that on purpose
um
so
we have a problem there's been a there's
been a catastrophe
tiny grad promised to be under uh 1000
lines
and Tiny grad has now violated that
promise
tiny grad is huge
it's 4
317 lines
okay
um so this is out of control and
something needs to be done about this
I'm tiny grade is fat yeah I know no
it's it's it's really
it's tragic how large it's become so
today on stream we're making teeny grad
okay
so tiny grad is going to take some parts
from Tiny grad
and it's going to
fill the promise of being under a
thousand lines
um so first off we're gonna go to
subscriber only chat you got to be a
subscriber in order to chat uh and we're
gonna try to stay on topic today uh off
topic things moderators please just ban
everybody I'm feeling them like a band
people mood you know it's kind of like
how we got to deal with the lines and
time right like some lines just need to
be banned
um so I was playing this morning with
code coverage and most of the lines are
actually hit uh there's not much
external stuff but we're gonna make
teenygrad
um so
first I think we're gonna call it tiny
grad skill
just so everything still kind of works
um let's copy over tensor.pi
so tensor.pi is the main
uh tensor.pi is the
no no
yes as you can see this is teeny grad
okay
whoa am i counting size dot pi and no no
it's not the kind regarding okay and
let's copy over size dot pi as well
size.pi is the custom line counter for
tiny grab right now
we're in teeny grad and the line count
is 531 lines
um
where's numpy
not a result what
why are you doing weird python
okay whatever
uh oh unfortunately these things can be
imported
I don't like that it's getting it from
other tiny grad maybe maybe it won't if
I uh
python path dot okay
um let's find a nice example that we
want to work uh so what do we want to
work in teenagrad should we do you want
to do stable diffusion or you want to do
llama
uh or you want to do
you want to do llama okay we'll do llama
um
let's see
okay uh so tiny grad examples llama dot
Pi copy it here
now we're going to run python half this
llama dot pi
and okay complains about
the weights not existing
[Music]
okay unfortunately this works
so I think that this just works because
of uh because it's actually importing
for tiny grad so we can't call a tiny
grad that was a lie we're gonna have to
call it teenagrat
okay welcome to teenagrad
um so of course we can't import from
Tiny grad anymore we're gonna have to
import from teamgrad
oh man llama Imports everything
oh this is this is awful
wow we're never gonna get llama to run
all we have is tensor and we've already
spent we've already spent so many lines
um
so let's go over here into teeny grad uh
let's make sure that the word tiny grad
doesn't exist in teenagrad
wow what is this garbage
don't need that
of course this runs llama in teeny grad
um
wow we import a lot of stuff okay so
this is out of order that definitely
should go above that
it was terrible
who wrote this garbage
so now what happens when I run Lama
dapai no module named teeny grad helpers
all right we are going to need some
helpers
this is helpers
um image D type I think we can just rip
out image D type stupid anyway
I definitely don't need that
I don't need that
um so we still have no module called
helpers let's create one called helpers
and let's figure out what we actually
need here okay so we use ARG fix
we use make pair
we need to import some stuff and type in
here
so why make tinugrat okay so the goal is
to uh
uh figure out what stuff has just kind
of gotten out of control and we never
actually need it in the first place
um and I hopefully will get some of
these insights uh as we work here
[Music]
we're getting we need debug
debug is a context VAR I don't know
we're going to say debug equals debug
uh when you flatten
uh okay now D type and D types
it's something for that
man things have gotten out of control
we have D types now
D types d-types are when tiny grab
jumped the shark everything's a fucking
float if you got a problem with a float
go use torch man go use torch D types
got out of control okay d-types got
absolutely out of control all right
we'll bring in the stupid d-type class
what's a named topple where am I getting
a name purple I'm getting it from typing
I don't really understand how it comes
from typing but we don't have too many
questions okay now how many d-types is
teeny grad gonna support
answer
float 32.
okay this is teeny graph it can only
support flow 32 okay and if you need
more than a flow 32
then it's not for you
great we have helpers oh we need timing
we actually use timing a llama use this
timing
we don't need chatbot mode
uh let's rip out chatbot mode
yeah we'll do that later okay first we
just don't do timing
nah and if we don't have timing there we
don't need to afford it there okay
okay from teeny grad lazy there is no
teeny grad lazy what's device doing
oh no this uses disk tensors
oh
this is a lot of complex shit boys this
is a lot of complex shit
[Music]
foreign
[Music]
you can't import device from lazy so
tinyguard also supports devices in
addition to stupid D types
okay well we're gonna need something for
lazy
I guess so what's what's the real lazy
when I go to device
the class what's device
[Music]
well this thing's only going to support
one device anyway so
last device
default equals
CPU
why don't we use AI to design a better
Society you're the reason I never read
chat bro
okay if you you subscribed you
subscribed and that was the first thing
you said
I think
oh no you know what see this is the
problem you guys derail me because now
I'll go into my rant about how whenever
someone says something that's like a
dumb fucking political statement you got
to think about the opposite right I
think we should use an AI to design a
worse Society said no one ever but
that's a much more interesting statement
okay
you know you know you're the reason I
don't stream
we're trying to we're trying to make
teeny grad here okay so we have device
and we have lazy about we have lazy's
Buffet no no no no no it's not
interesting after someone else said it
there's no point in being contrarian
okay so we also have load Ops too
big stupid compliment
um okay we have a class here called load
Ops 2 and load Ops are ways that buffers
get uh created
so load Ops is an enum
you can see it and it's not in lazy it's
in Ops okay we're also going to need
something called a box
go over here to Ops and we can just
steal load UPS here I think all of them
are used except custom which don't need
custom's a stupid one
from you know
see how far we got okay ml Ops so I'm
going to copy ml Ops over I copied
tensor.pi over in its entirety
I'm also going to copy over why didn't
that turn colored
you don't like my obstacle pie okay
um
let's call it now
I'm going to copy ml Ops over too you
guys can read ml Ops
um ml Ops is the functions and all their
derivatives it's a pretty short file
so we're just going to copy that one
over from Tiny grad
[Music]
group it Imports all has tons of stupid
Imports okay
oh shape type do I actually use this
anywhere
oh that's cringe
what shape type defined as
I'm gonna rip that out a real tiny grad
[Music]
cringe
see like permute doesn't use shape type
shape type sucked okay anyone who thinks
shape type is cool they're wrong
all right look at that I just saved a
line I just saved a line okay all right
all right now how big is teenager 691
lines okay
see how we're doing
let's run lava okay
device has no buffers
probably okay
yeah this is just for registering
functions to move between devices we
don't need that
no module named teenygrad NM okay so
we're going to need a teeny grad and N2
to support embedding in linear or you
know what I'm just going to copy those
into llama
this is embedding
and where's linear this is linear
bound
[Music]
um we don't need a jet and rip the jit
out
I think I can just say tiny jet equals
one of the XX
and then variable and Sim and far we
definitely don't need these
um
just rip out all this shitted crap
okay why am I using Global counters what
do I use bubble counters for oh just
like timing stuff
care about that I don't care about that
I don't care about that don't care about
that and this time you did still use
anywhere
she's in all sorts of stupid places you
can find whatever
okay uh State we're gonna need State I
don't think we need all of that but we
can look it's pretty simple
um so we have torch load
oh wow that's complicated
forgot how complicated stupid torch load
was
import strides from shape in the shape
tracker there oh that's disgusting
it shouldn't even be used in the shape
tracker
oh
uh yeah I know it's too many lines I
know I know it's way too many are you
saying that that's a lot of lines or not
a lot of lines I think it's too many
lines look this but we got rid of a line
already okay it was a stupid line
it's an offensive line
um
okay
so what this is
a loading thing
I don't know do you want to just copy it
in
and what's going to be annoying
I don't think I need rebuild 1030 too do
I
everywhere or is it only using some
devices
there's like two kinds of torch files
remember both of them use torch pickle
okay it's probably used in both of them
um
well it's not necessarily true that if
yeah if you want features you'll need
lines but there's ways to write software
that's just better
like
how many Vines could it theoretically be
um I think some guy made a pull request
to uh
to load the hugging face one and maybe
we should just do that
let's make sure I didn't break it by the
way
cool
yeah we could just load the safe tensor
one
okay before we go to llama maybe we
should try something a little simpler
than llama
we're gonna try like
we can get to llama okay the thing that
it can't do right now is this is the
stuff that loads tensors
I don't know I guess it's not that big
of a deal yeah we should probably copy
and state we'll copy and state we'll rip
stuff out of it later
so state is uh my implementation of
torch loading
okay
okay
this is more interesting though we're
getting somewhere
um
item type lazy buffer has no attribute
load up
so unlike in tiny grad tiny grad
actually supports lazy stuff
we don't have any lazy support in
teenagrad all the lazy support is going
to be fake
um so we need something in lazy buffer
called load up let's see what the real
one looks like
static method called load up
and it creates a lazy buffer
that looks boring
so let's see what's trying to be loaded
type object device has no attribute
canonicalize that's fine
so we have this function called
canonicalize which
um like when you pass in the name of a
device it will uh like turn it into like
a like a canonical representation device
okay okay here we go so now we have
something here load Ops Rand
uh that's the shape
that's the type
um
you don't actually need the randomness
so I'm going to say if
teeny grad it's even smaller than tiny
grad
so we're gonna we're working through and
we copied over a few classes from Tiny
grad for those people just getting here
so we copy over tensor.pi
um
thing so you can think about programming
kind of like Factor graphs
and you want to separate and clean your
apis as much as possible Right like
complexity can be okay as long as you've
managed to encapsulate that complexity
so tiny grad's done actually a pretty
good job of this
um this tensor dot Pi is almost all
syntactic sugar around the most
beautiful file in in tiny grad called ml
Ops and mlops are all the operations
that tiny grad supports at the ml app
layer contiguous cast sign value log x
square root sigmoid sigmoid is not
actually needed to be supported but it
turns out that sigmoid has a simple
derivative and we were hitting
singularities if you uh don't
you could work out why but like you
actually you just read this read this
toward data science um
so those are unaryops uh then we have
binary Ops let's add some Mull and div
we have one ternary app called where and
there's reasons you need where to exist
where is actually a very good op
um where is uh like X question mark ycon
Z and we have movement Ops expand
reshape permute pad shrink and flip and
that's it
uh so these turn out to be all of the
movement Ops you need
uh to Define like convolutions and
everything
um so like tensor and ml Ops are like
the the front end to Tiny grad it's
absolutely beautiful
um then code gets worse
uh lazy dot pi and Tiny grad is kind of
okay it's what determines is what groups
Ops into asts and then there's
linearizer and linearizer is the worth
file in tidy grad when your eyes are as
just trash
um but there's other kinds of uh there's
two kinds of back ends in tiny grad
there's interpretive back-ends and
compiled back ends and yeah compile back
Ends don't uh don't do this okay
so
I don't know
shape we don't care about d-typing
device
uh we don't care about
ARG
OS return lazy buffer op shape
can I leave that front there
okay lazy buffer object has no attribute
device okay well we need a device too
let's see if it's gonna bitch and say we
need a d-type too
well I thought you figure out why we
need a device
um
if data class is lazy buffer oh this is
being created from a lazy buffer yeah if
it's on a different device this will uh
this will bring it from that device
but uh okay we don't actually care about
that
we'll go back to small lazy dot pie and
we'll just just we'll throw an attribute
on there called device
and we don't even have to do it like
that we could just yeah it's fine
okay
lazy buffer object has no attribute
reshape
uh okay so let's make something called
NP
um and we'll say numpy dot empty
uh
so there's a question of what we want to
use as the back end
the torch is a bit faster so maybe we'll
use torch
so we're gonna
well you're not gonna be happy if I use
torque should be happy if I use numpy if
I use torch you're gonna be like but you
just implemented a thing with torch so
he's not okay
so now
we have to implement reshape uh
uh first off let's get rid of this
and let's create a property
uh and the property is called shape and
we'll return self.mp.shape
okay
so this this dot NP on this dot
underscore NP is actually like where
we're storing the stuff
no there's no we're not talking about
code golf here okay there's no code golf
um
oh this can't be solved on shape sorry
lazy buffer attribute has no attribute
reshape on it so we're going to have to
define something called reshape let's
look at the real lazy dot pi to see what
reshape is
of course it's something that's absurdly
complex and stupid
we need less lines okay uh and we'll say
self.np dot reshape Arc
um it's still bitching me out and says
it can't create tensor from none
but I returned the lazy buffer there
oh reshape needs to
interesting okay
I mean reshape doesn't actually act in
place
um reshape should create a new buffer
so let's actually change it to this
this buff we can just call device equals
numpy
uh
and then for this one we'll just say NP
dot empty shape
and then we'll set a self.mp equals buff
okay and now when we return something
because reshape means to return a lazy
buffer we can return lazy buffer self
dot NP dot reshape
uh Arc
okay lazy buffer has no attribute D type
okay well this one's an easy one to
solve we'll just say d type equals
d-type stop float32 but from teeny
grads.helpers import the types
um
okay
can't create tensor
from the lazy buffer why not
dated that class is lazy buffer that
should be right this should be the same
lazy buffer
hmm
well I should have returned to Lazy
buffer right
should be good
oh here we go okay from we have a
problem
uh oh maybe the devices weren't equal I
see okay we have to call the device CPU
because I called the default of icpo
for some reason it's still doing it from
this is actually a from operator not to
be confused with a throttle operator you
know we're going to be like Urban it's
it's it's it's it looks like the word
from but it's actually a chrome operator
um who's veering their Knocks
okay
uh can't create tensor from lazy buffer
object
I don't really know why
can't you create a tensor from a lazy
buffer object you should be able to
foreign
this should return here right
wouldn't it be nice if I knew how to use
a debugger
python 311 on here
11 gives better
thanks
just much easier to read okay load Ops
Loadout brand
ml reshape apply
cannot create
tensor
from lazy buffer
okay well for some reason from is
definitely getting triggered here
yeah okay why is it giving me none oh
okay device canonicalize uh has to
actually just return cpf
that way
now we have a different error uh at
least we're not calling from again okay
load Ops Rand
it's doing a reshape
I guess the firm was actually doing
nothing okay
cannot create tensor from data
why not
those should all return
[Music]
okay dated our class is lazy buffer that
looks good
okay here we go up here
pip install pretty errors
and do I need that in
whoa does this work
looks the same
[Music]
oh I need to dash M pretty Harris Let's
see
oh this is looking hard uh you must add
it to your
I don't know let's just import it in
llama let me just work
wow this is a feature the Teeny red had
the tiny grad does it I think I don't
know shit about my pretty eyes oh that's
a pretty error thank you
um
thank you see you're the reason I stream
you're the reason I stream and the can
we use AI to Make a Better World guy can
fuck off
ah
okay
so why are we online
why are we online why are we on this
line is Tiny grad somewhere in here it's
a tiny grad sneak in all tiny grads
snuck in this is the problem
yeah we need to go from teeny grad oh
goddamn tiny grad sneaking in
I don't know if I like pretty Iris
they're too hard for me to read
okay I cannot import name ARG sort from
Eris uh from helpers okay Arc sword's
fine we'll copy over a hard sword art
swords are cute I worked hard on this
okay
I cannot import unary Ops
yeah those are probably things we're
just gonna wanna copy actually
[Music]
well these Ops are fine
this is also some of the best stuff
uh we don't have a prime there's one
line fix for that
timing socks
[Music]
[Music]
this can be copy
uh
strides for shape
let's just copy that in it's not a Long
Function
well actually let's just bitch it out
and say sorry I can't help you this is
only in an assert anyway
wow we import something for an assert
I don't know how I feel about that
[Music]
I don't know how I feel about that real
tiny red uh timing is stupid
okay I kind of like timing finally
timing timing small
is timing small what's timing here's
timing
I have to import crap for it so
I didn't have to take the timing out of
other places
context lib context decorator what does
this even do why do I need that
what advantage does this give over just
being on like uh just using it
decorator
was this like hiring an interior
decorator
Base Class that enables a context
manager to also be used as a decorator
you're saying if I don't have that I
can't decorate with it
interesting okay whatever
Global counters we got to draw the line
somewhere no Global counters
oh but see that's like using the timing
crap
no timing timing's stupid I regret ever
putting timing in and we have to learn
about what a contact slip decorator was
I have space in my brain that I'm never
gonna get back all right let's go
fucking float
oh no
no guys we can't run llama we have to
support fluid 16.
uh okay we'll get rid of that nothing's
safe wait I don't even need anything
safe what
okay guys it's fine to have safety in
your self-driving car we definitely
don't need safety and teeny grass
we need bull
okay fine
should we invite bull to the party
this isn't even right this is bugged no
you can't do that you have to say NP dot
bull but that doesn't even work
oh
there's a bug this is bugged
wow okay well that was a bug and Tiny
grad for a long amount of time can
someone can someone write a test to
catch that because that's a bug
okay lazy buffers no attribute expand
that's a real problem
take a look at the bugs we're finding
because this has to be the numpy type
I don't like that it lights up a
different color from this one though
can you indefinitely uh simplify no you
can't
uh
so humans are pretty bad it's software
development for various reasons
I don't know
I mean it's kind of interesting it's
kind of interesting I sit here and think
this is possible for software and then
think there's no way AI is going to foom
but if I start talking about that we'll
go off topic forever
uh you know forever and ever and ever
okay
uh
deal my implementation of expand from
here
there aren't even movement Ops here what
I guess there are and P dot broadcast
too
okay uh we need to support MO
turn lazy buffer self dot NP times x dot
MP
should work
and Mark that as a lazy buffer so it
lights up nicely
okay we need Plus
okay
guys llama's running boys it's running
unfortunately it's Ball slow
let's get rid of those stupid prints
intense huh
well yeah why did we try to load llama
this model is huge
foreign
oh yes train mnest yeah so that sounds
fun yes
uh
I'm Nest stop hi okay
okay uh we'll create a little calm net
but no batch Norm that's hard
uh from teeny grad import tensor
oh and then like I import train from
somewhere oh it's disgusting and long it
has lost functions wow that's terrible
can someone fix this this stuff's so out
of date tiny grad has so much better
stuff than this now
wow do I use parameters I'm gonna need
optimizers too oh this is getting hard
oh no
okay forget mnist let's try uh
what's simple
I mean okay an optimizer's okay wait
wait I shouldn't have I shouldn't have
gotten angry at emness so quickly it's
fine
[Music]
we're going to need an Optimizer and
that's fine
[Music]
[Music]
we'll get rid of the stupid batch Norms
let's copy and paste the optimizer just
into this file
foreign
[Music]
at the top of MNS
okay good now we're now running around
with something where we can feasibly do
something okay oh it's gonna like bitch
because it's enough train
from teeny grad Dot
uh tensor or tensor
don't ever import from Tiny grad I never
want to see you do that do I need dedup
great okay we need dedupe and helpers to
helpers you can see helpers it's just
like a nice little like
she like did a bunch of like cute little
python tricks that we're gonna file okay
okay
um has no attribute from CPU okay so
we're gonna need a from CPU fortunately
from CPUs extremely easy to write
um from CPU X we just say turn lazy
buffer X
interesting
I don't do anything for that
okay train is not defined uh so we're
gonna need a train
okay
who has a train
um
like refactor this garbage like this
this train function this sparse
categorical cross entropy are so old
this is like ancient history
X train and Y train
where do we get the trains from
yeah we have to do fetch mnest
let's go into here and grab fetchemness
oh no do I actually include I include
mnist in tiny grad do I really do this
I'm reporting tiny grad again
I'm not I'm not gonna tell
okay uh
uh teenygrad amnest
[Music]
where's
I really have mnist in here
I've decided that it was important
enough to ship mnist in every tiny grad
okay that's just offensive
it's also awful code who wrote this
can someone switch this to pathlib
all right some Modern crap
can someone switch this out in tiny grad
I think I'd really appreciate someone
just going through these old examples
and like making them half decent because
this is junk
foreign
[Music]
got too many dots
such follow directory
why not
too many mnists
okay lazy buffer has no attribute shrink
that's real
I'm gonna have to implement shrink
or Shrink
they shrink so we can just steal it all
right here
right here
lazy buffer object is not subscriptable
we need a permute
totally reasonable
[Music]
[Music]
okay now we're on to the more
interesting stuff we have to get reduce
Ops to work
but this is starting to look a lot like
old tiny red again
um a new ml framework
so we can uh you know
sell it to IBM for 27 million dollars
but it turns out they were fake dollars
because they're not backed by anything
uh okay we need to implement reduce up
um
from
teenygrad.ops import reduce Ops
uh off your shape if off equals reduce
up some else raise not implemented error
um okay so we can find reduce Ops sum
okay so I heard we got a lot of viewers
uh for those of you that just tuned in
uh Titan grad has gotten out of control
a tiny grad has become 4 316 lines we
are building teenygrad which is pieces
of tiny grad but small and it's only at
794 lines
um so you know it's tiny grab but
smaller
I know people like small stuff
uh so we went through a lot of the
beginning we went through uh we copied
over tensor and ml Ops because those
files are pretty good and now we're
re-implementing at the lazy dot Pi layer
I mean it's simple enough to implement
that we should be able to do this in
about 100 lines
okay uh so we need to implement some
we need this shape for axis helper
function
uh
[Music]
these are the implementations of the
numpy variants
foreign
[Music]
okay we need binary Ops 2.
I actually don't like that I use that
one
there isn't a Max though in Python is
there
like that's the only binary op I think I
have I think the rest of them you see I
just did it like this
so like there isn't like a magic method
for Max is there
this is interesting uh
creating your own Min and Max functions
how did Min and Max just do it
like what if I change not in tiny grab
but what if I change the code and ml Ops
and teenygrad to do self.ret equals Max
zero if I do that what does that do
greater than
that's interesting
that doesn't work though because
binaryops Max is an element wise Max
um so we are just going to need to
implement
Ary I think in numpy it's called Amax
NP dot maximum
oh okay now we have another problem
oh this is annoying
wow
I don't really like that I pushed that
functionality out of ml Ops actually
I'm gonna fix that
I'm gonna fix that I I pushed this
functionality into lazy.pi it's kind of
I did it like kind of a cute way but
it's slow what I did
um so you can see that these things can
all now take in
if we go down to
here
oh hang on
it should be an element wise Ops yeah
make them all lazy buffers so we're
actually gonna fix this
yeah I don't like what I did this okay
so I can say something like
well no that's fine but this one here
like this one here I can do
x dot counts like zero
mlaps is exactly right like I didn't
change anything I guess I
don't like that I did this
it's only a few cases this is not
perfect
Now sources can go back to being a lazy
buffer we can get rid of all these Union
floating craps
uh yeah all this Union floating crap
it just has to be a lazy buffer
see look it's helping us refactor tiny
crap I can't believe I can't believe I
actually wrote this like I was like oh
yes let's make pretty syntactic sugar
the prettiest synthetic sugar makes your
apis confusing and slow
and you know
just a tragedy okay
and then this one's gonna have to become
self.com zero zero myself
that's element wise off that's fine what
did I do there
most about that
okay let's see if I didn't break
anything in Telegraph
I probably broke something but I broke
oh so much broken stuff okay
local variable source is referenced
before assignment yes because it's just
called sources
I probably broke a few of them
an INT object has nowhere to be realized
okay
um
here I do
1.0
self.x.com
this one's a ton of crap
let's see if all the test pass
how do I make it like if there's a flag
I can pass to this to make it like uh
error fast right
test.ops helper test Ops
I hear where zero this is the problem
was my where
do I make it exit fast
like the syntactic sugar is fine but I
went too far when I uh
float has no realized oh
yeah but what's that I just want like I
don't want to read a stack Overflow
what's the one what's the one line
um okay what I would fix this one here
yeah
Pi test Dash X can I do a dash X there
does that work
no great High test Dash X
it's gonna pass this time anyway and
then I just wasted time but whatever
we love going
slow going slow going slow going slow
it's slower too okay cool all right
that's fixed
um
we did it get in there let me just uh
tea
question mark
I don't want to push it too I I will
push it
oh on Branch Maine oh they ship that
shit to get all right well guess what
get with the program boys can't call
stuff Master anymore some slaves are
gonna get offended or something man
can't start calling stuff Master you
know some someone like like yo you're
not a karate master I'm sorry you are a
karate name that's right that's right
you know you guys know you guys know
about why you know Maine is very
offensive to me because you guys know my
story about Maine
one time I was in the spelling bee right
and they were like Georgetown Maine I
was like okay could you give me the
definition of like the state of Maine
and I'm like okay
m-a-i-n-e and they're like no that's
wrong what the fuck you mean that's
wrong I'm a Next Level genius how could
you tell me that you're going to spell
the state of Maine m-a-i-n-e and I just
I gotta look on my face and I'm like how
did I spell this wrong and that's
exactly how I spelled it and they told
me I spelled it wrong and I had to sit
down and you know that is why Maine
really upsets me and I understand that
Master might offend people but did they
think of the people that Maine might
offend like me
like me I was offended by Maine because
it shut down my dreams of ever being a
champion speller and then I never joined
Debate Club and they never ever learned
how to debate so you know I'm just
saying you're crushing little kids
dreams everywhere and you know it's
knee-high on the problem it's Maine
uh okay there's some numpy likes
almost like I'm gonna do this full like
that's it I feel like's a much better
name
should we rename it to full like nah
that's a true story about the spelling
bee guys I'm not just making that up to
rip on Maine
yo there's supposedly a hurricane coming
here and it's gonna be sweet because
there's gonna be no traffic
georgetown's died in a hurricane it's
really arrogant and thought that it was
cool that there was no traffic he lying
down the five in his Rolls-Royce going
80 miles an hour screaming about how
there was nobody around when he hit a
large puddle and died
all right no no see look I got triggered
by Maine boys I got triggered by Maine
they're trying to live in your head rent
free it's fine Master didn't even make
any sense man it's fine just give in but
then you give in and then you find out
you're giving in for the rest of your
life and I don't even know how mad I
should be and they did this they
calculated this they know it big brains
man and y'all think we're gonna survive
AI oh yeah man they're not gonna turn
your atoms into fucking Nanobots they're
just gonna psyop you into Oblivion
You're Gonna Wanna Die
Psy opt into Oblivion
is there a piece of paper that could
convince you to kill yourself I mean
that's a good question right is there a
floppy disk that can destroy the world
man I used to think about this stuff all
the time
and I stopped thinking about this stuff
because I realized that it was stupid
and we're all just here and I'm a
definite Optimist and you know the only
way to live is to be a definite Optimist
because
you don't want to be a definite optimist
then you know what are you gonna what
are you gonna do
average in your sub
it's not too bad I can write that one
and P dot X2
all right let's see how many lines are
we at with teeny grad 816 okay might be
doable all right we need log 2 as well
all right we need unary that thing
um
copy that one's real lazy.com
what's in lazy top high no it's a
LazyTown pie
[Music]
all right we need a dim div's not too
bad is it
oh true div
true that
okay
sport LT
true that
pad a pad pad is painful okay so these
these by the way are called movement
dots
it's coin boys yo I love the coin boys
man I love the koi boys the coin boys
give you hope for the future
you know what you know what's great like
the koi boys or the ultimate like
anti-rationalists you know it's like the
rationalist no you can't just flip a
coin the real probability distribution
is only 70 30 you're losing out on
expected value if you flip a coin heads
I do it Tails I don't
ah coin boys
the coin boys you know and it's just
it's just the only way it's the only way
in a world that is constantly trying to
exploit you I bought my dad and iPhone
when he came to visit and he's like you
know I just feel like everything on that
phone is just like like it's like you're
trying to manipulate me I just feel it
he's so right the coin boys know how to
beat that you know if everything's
trying to manipulate you and you see the
thing about being manipulated is you
think you can now think the manipulation
but if the manipulation is good enough
they thought about you out thinking the
manipulation but you know what they
can't predict a fucking coin
oh yeah oh yeah heads I click it Tails I
don't try to manipulate that bitch
[Laughter]
a good time while you're doing it too
you know because if if you're having a
bad time the manipulators win but if
you're having a good time you win
and that's the only way to win
by having a good time
NP dot pan okay well that doesn't look
bad
what are you teaching your kids on your
stream George don't you want them to go
to college and get a good job
you do understand that they need to go
to college and get a good job and
participate in our economy to prop up
the Boomers right
if they don't prop up to Boomers then
who's gonna pay for Social Security and
if they don't pay for Social Security
how are we all going to retire and live
to be 127. suck it Boomers
[Music]
are realized oh that's that's
interesting
I realize there's always none I think
tensor has no attribute CPU I see like
this is what I mean like this code is so
old
this code is so old you don't actually
even need that
I'll take that out
let's take it out of this sentence but
you can take it out of the other end
this too you don't none of tiny grad
actually needs dot CPU anymore if you're
doing Dot numpy
okay two CPU watch how easy this
function is to write
oh yeah except for the fact that the
loss is Nan we're crushing it yeah
all right so why is the Lost Nan again
um but so this is how you if you want to
tap into tiny grad at the lazy layer
this if you just implement this it will
get you everything you can run efficient
Nat you can run anything
stable diffusion it's all good
um where is evaluate
I'm just copying and pasting this
terrible code can someone please clean
it up
this doesn't count towards the lines by
the way
oh it's because we didn't actually do
Rand it's because we did empty so let's
make Rand actually work
load Ops
dot rant
I'm going to import the load Ops here a
load up is just like any other app
really
except that it can create the static
method
um and then of course it can't actually
be like that we have to figure out how
to implement Rand I think it's actually
implemented here
so here we can find the implementation
real tiny grad
and it says rng.random
okay we also need load Ops const
um
I just want to just do ARG
full is missing one argument
uh oh yeah shape
okay let's go
is the accuracy gonna go up let's see
let's see let's see
go up
all right all right this is looking
pretty good hey did we just do it are we
training amnest right now
okay 87 accuracy I want to accept that
stupid CPU thing again
oh that's annoying
like I could make it work but it really
should just be removed
how many lines now
Big Tiny grad is oh we lost some lines
there too
uh 830 lines
so this is a complete mostly complete
neural network library
uh you're gonna have to still Implement
there's like a few more of these
uh like a binary op actually you'll get
most of them here I'm not sure any
others are actually used
um
you'll need to implement like no that
actually might be all of them
yeah so this is pretty much all we
needed to implement in teenagrad and
then we copied a couple hundred lines of
boilerplate from Tiny grad
and this should get us everything
uh so let's see if we can actually run
llama
I think if we're gonna actually be able
to run llama let me think about it
it might work because they're Matt Vex
so
one of the things in tiny grad that's
very slow if you don't have like a
decent back end is uh so we do Matrix
multiplies by like storing and Cube stop
to memory
um
I don't know why we're getting less
accuracy on this one that's kind of
interesting
oh we're getting less accuracy because
accuracy because we use SGD uh and then
the real one we use atom that's fine
we'll consider 80 to win in this
town uh we can also just copy and paste
Adam if we really care to but okay uh
let's
spend this trains
okay
so let's see if we can make llama work
there's no way we're going to be able to
make stable diffusion work because of
the uh mole or the mall ad problem
[Music]
but they're fused together in the fancy
one so
830 lines and we have useless things in
there like State I mean also we're not
exposing most of uh most of chancer.pi
like most of tensor dot pi is uh is like
we support like every operation in here
we have batch Norman here we have a
tension in here comes
everything exists in here
um so this is like the front end
then this is the like high level ml Ops
which
if you see I've implemented the uh oh I
did not Implement stride
um
I'm trying to think like I don't
actually need stride
why did I keep stride
why not just replace it with flip
you don't actually need stride because
you can do the same thing by doing like
permutes and shrinks and reshapes
um
do you even need flip
is this some like really clever way to
right flip in a different way
I have to think about that
but like what this is asking is what is
the absolute minimum set of uh
what is the absolute minimum set of
things that lets you do everything right
like what's the absolute minimum set of
movement operations that lets you do
everything
um there are a bunch of binary Ops
there's always talk over like in theory
you can replace like in theory you only
need add and Mull and you can replace
a sub with nag and div with reciprocal
but I don't know I mean that gets a
little it gets a little Annoying to map
it to things a div I particularly hate
like I would like to replace div with
reciprocal but then you run into reasons
why you don't want to do that and it
gets annoying
uh we'll go get a Spindrift
and then we'll see if we can get lava to
run
part of the problem with llama is it's
very big and numpy's very slow
it might work if we ride a torch back
end
you know let's switch our numpy back
into a torch back end
or will you all think that it's cheating
if you don't think it's cheating if I
use torch
okay well there's like better numpies
too what are the other ones what are
like super jit and don't buy or
something
we'll try to get one of those
number
we can also try to implement this numpy
from scratch but I don't think that's
going to get us anywhere interesting
okay fine you'll all think it's cheating
if I use torch all right fine I won't
use torch it's like not cheating okay
you guys don't understand
me
slaws balls Ball slow
balls Ball slow is Ball slow
oh there's no way this is gonna work
there's no way this works
forgetting how big llama is
and how little Ram I have in this
computer
all right this only supports
this only supports uh flow 32.
if we want Lama we have to support float
16 and now this is getting kind of
stupid I don't know I think this might
be teeny grad
cinegrad is capable of training mnist
we don't actually need state.com anymore
not by stupid
and llama's stupid
yeah suck it llama
no more llama all it does is train mnest
do you really want to waste your time
writing stupid uh
float
but now we have more time so we can
clean up the emness code nicely
no llama
how many lines is the emness code
oh this is the most disgusting sparse
category gorgo cross entropy I've ever
seen
should fix this in emness too
do I actually have this in tensor.pi now
we should
yeah yeah yeah
uh
I've been having a nice email
conversation with Lauren continuing our
Doomer debate
um
okay that's not even too many lines
okay this entire emness trainer
please we've done good
this entire amnest trainer is under a
thousand lines and like works well
okay let me copy the optimizers over
from Tiny grad the optimizers are pretty
small actually
[Music]
um
foreign
[Music]
[Music]
[Music]
you can make sure Adam works too should
so that was optimizes cost us 55 lines
cannot create tensor
go back to this crap oh I think I
imported
yeah it was often not pi
oh I imported from tinyrad we have to
import from teenygrad
[Music]
okay we need sign
what do you sign for
all the optimizer uses wow
wow
well that's not really good
is that really what these things do
Adam goes through all that crap
look this is an arbitrary no it can't be
no this is supposed to be a constant
foreign
[Music]
[Music]
wow I didn't realize this all right it's
fine
uh
uh hearing apps are very easy to
implement
[Music]
wow
wow pow is a ton of crap
okay fine we'll support d-types it's not
that bad
we support d-types we can bring llama
back
no we can't bring llama back because
float 16 stuff is absurdly slow
wow
pow is terrible
there's some way to write this without
pow
T is the param
no these are constants
and they should be treated as such
they're just not being treated like that
hmm
okay this seems like a bug intense
without pie actually
yeah okay that's 0.09 that's interesting
um
there's got to be a better way to do
this
so okay you see what it's doing it's uh
raising to the power so that's it's it's
a constant raised to a power
how do I do a constant raise to a power
it's the same as just like eat it though
right
I can just do like change a base on E or
something
this is really simple
I don't know how this wasn't in there
already wow what a book
um
love that we're finding bugs
okay you want to do
so it's something like const raised to
the x
so if what if it was e to the x then we
would just do self.x
um
foreign
X over math.e
[Music]
who did all this
you can just import e
[Music]
I don't know if that's right
also I hate that I have to import math
[Music]
foreign
[Music]
[Music]
[Music]
might only work if it's greater than
let's say x greater than zero
it's a good test for this too
[Music]
no
foreign
X is definitely e to the x
oh I think it's like this or something
I mean I do I do this exactly in ml op
so
in order to get something to be X2
I first multiply it by 1 over
log 2.
foreign
division by zero
okay
runtime error encountered in log 2.
that's probably fine
um
is this correct now
uh we can do let's find the Optum test
I can't believe I let this go
okay great let's mess it up and see if
it breaks
excellent
hmm
okay
now let's bring this back to teenagrad
look at all the bugs we're finding in
tiny grad
but it's just like stupid okay and
actually we also don't need to implement
import math do we
uh because I do log right that's fine
I can't believe like fucking people who
want to like oh yeah so we're gonna save
what we're gonna save three bytes we're
gonna there's not gonna have to do one
look up like it's not worth it guys
someone just changed this to actually
just like not import all this crap from
math and just import math like oh no
it's three milliseconds slower I don't
care
readability is priority number one
if you're sacrificing readability
you've lost the plot
and that is why I gave up on the
thousand line count for tinyrad
okay I have to implement a square root
that's not bad
[Music]
okay let's see
looking good already now I sound like a
Google engineer yeah bro
sound like a Google engineer Circa 2008
when they were good engineers
sad like it's sad that
it was a good engineer still working at
Google at Sam
you know the people just go there to
like make bank and you know I have no
respect I have no respect for anyone who
just takes a job to make money no
respect
um
it's okay we're fixed that's a that's a
sick fix like I don't know how that like
didn't exist in there
oh we don't have that wait what no no
don't do that no no no oops
okay that's pushing to Teeny that's fine
okay uh categorical cross entropy Sports
categorical entropy
I don't know I'll wait for someone else
to write this can someone write this in
tiny grad please that doesn't use numpy
like this is embarrassing
if I'm not talking about people working
at subsistence jobs I'm not talking
about people who legitimately need the
money
you know who I'm talking about come on
that is who I'm talking about
all right where are we most likely to
find more bucks
I can't believe all that pal stuff got
merged without that line
uh I don't think cfar uses
right something we've been working on a
lot in tiny grad is this seafar thing
uh but cfar doesn't use it uses SGD
right yeah he's SGD
we've been working hard on this
um I'll show for you guys
so this trains
this Train's uh
cfar to 94 in 100 steps
so you can see now steps are taking
about half a second and it's getting
about 1.2 teraflots on a Mac
it's pretty terrible
uh so we're waiting on Winograd comes to
fix that so
I don't know why so much time is being
spent in this python
your GPU equals one it'll be faster
GPU equals one we'll use the opencl back
end instead of the metal back end
yeah okay at least that's faster at
least it's not wasting time in Python
there's probably some like realizing
there or something or something where
Metal's getting caught up
but yeah now we're on the GPU for the
whole thing
see like the python time in the python
time and then GPU time
um
okay so final verdict
um teeny grad is 810 lines
and the mnis trainer is 80.
so we are back at 900 lines and we have
something that can train mnist
um I think the one in tiny grad's a lot
faster
we can look at it
so I can get that same thing by just
doing
uh
test emness test columns is the same
thing
probably capitalized the end
you know by the way that was what was
wrong in the main story
I didn't say capital M
I had to say capital M A R and E and
then I would have moved on to the next
round of the seventh grade spelling bee
uh so you can see it's a little bit
faster in tiny grad than teenagrad
um there's a reason that the whole world
doesn't just use Tini grad
because time goes fast if we go to CPU
it's slower
it's still a lot faster than teenagrad
because like there's a reason for all
that extra code look I really don't like
spending lines but what we're spending
lines on is speed
um we're also spending lines to support
many different back ends
so that's a torch back end
oh no I use torch
um we can do a GPU back end
you can do a clang back in we'll see how
fast this one is
this one takes a long time to compile
because it's got a cold clang a whole
lot of times playing clang clang clang
clang clang
clang clang clang clang clang clang
that's fast when it's composite
yeah so that's what you get
that's what you get from the extra
you know
however many lines that is
from the extra
3500 and four lines you get the speed uh
and that's like the back end but this is
so what teenagrad is is an example of
the tiny grad front end just being used
independent of everything else
and it gets it back under
a thousand lines
so yeah I think that's today's stream
uh we mostly stayed on topic I'm proud
of us go us
uh today's a beautiful day there's gonna
be a hurricane it's going to be a
hurricane hurricane Hillary is coming
hurricane Hillary
uh
uh no torch wasn't slow torch pretty
fast CPU is slow numpy is just
atrociously slow like someday that numpy
is like the standard is kind of like a
joke
but it kind of works everywhere and
that's why
um oh I think we can also do
you kind of web GPU equals one
yeah web GPU
um like you see I can do like debug
equals four if you want to see the code
um it's only going to show you the code
right there
well let me uh
we can do test conv one step
and then we'll actually get a chance of
seeing something
so these are web GPU kernels
so this is the code that's being
generated by the time you've grad back
end and it's being compiled
this stuff all needs to be cleaned up
that's going to be a big tiny grad
project this stuff's going to be moved
to just be ALU Ops just like everything
else
um and then
I'll leave this I'll leave this with one
of the most influential I think I mean
I've only kind of figured it out
so Richard wrote this in 2019.
and
like this is the comma AI thesis this is
the tiny grad thesis and maybe you could
just call them their lesson companies
right
the biggest lesson that can be read from
70 years of AI research is that General
methods that leverage computation are
ultimately the most effective and by a
large margin
the reason for this is Moore's law
basically don't have code shit don't
feature engineer don't use lidar it
doesn't matter don't worry about that
and also the guy who wrote this the guy
who has like he he wrote this I mean you
know like like I thought of like comma
was based on this idea like it has to be
end-to-end stop hand coding stuff but he
like clarified it so I'm like he
probably thought of these ideas way
longer ago you know to come up with this
document this document is like the
Pinnacle of like
um years of thought he's also written a
great book on reinforcement learning uh
and you know it's just
you can take his position on AI Doom and
he's just like dude that's just not how
it works uh you know and I stand with uh
you know you know like the rich Hut Rich
Sutton for the technical stuff Robin
Hansen for the uh economic stuff uh
don't worry about AI Doom tell your
friend I mean air Doom is less stupid
than climate Doom uh climate Doom is the
ultimate in stupidity yeah yeah climate
change is a problem let's fix it maybe
with some nuclear power uh yeah but like
it's not gonna kill us in 20 years
please please there's people out there
who think that that one's even stupider
than a i Doom like like and whenever you
confront doomers and you ask them how
exactly is this Doom gonna happen they
don't really know like it's the same
it's the eschatology of doomers period
they can't really tell you exactly how
this Doom happens they just know that
Doom is coming and my response to that
is that is a feeling bro that is a
feeling we've all been there we've all
been there but you know
you don't gotta feel that way man
because like Doom is coming but it's a
long time away you ever hear about the
heat death of the universe did you guys
know about the heat death of the
universe
oh
I mean you know once you start thinking
about shit like this man there's a great
Asimov short story called the last
question
uh
you know if you guys haven't read this
uh and uh this is this is asimov's this
is by far uh my favorite story of all
those I've written this this is the
ultimate modernist question
I mean this is really the ultimate like
like if you view the world as a
modernist this is the ultimate question
uh everybody should go read it uh I'm
gonna push teenagrad to the tiny grad
organization if you guys want to play
with it
um teenagrad is nice in that it's much
smaller than tiny grad you can read all
the lines of teeny grad so easily it's
only 810 lines
and it is training amnest
uh with a full
uh oh I should copy in stupid mnist
all right we want this to be a
standalone thing
yeah yeah yeah yeah yeah okay okay we'll
do it
it's gonna mean like I want this to I
want you to be able to check this out on
your computer at home
and train amnest and as long as I have
these like dot dot slash tiny grads
extras data sets
no I did that wrong
should be right okay cool
and um so there we go we have an mnish
trainer uh in well under uh a thousand
lines
using
it's the cool thing too is if you learn
and understand Tini grad you are well on
your way to understanding uh tiny grad
so if you'd like to like if you like
very approachable code bases
uh the Teeny grad code base should be
very approachable in that it's super
short and the Big File doesn't really
matter
like you don't really have to care about
the Big File
um
because it's mostly syntactic sugar
that's completely unused by mnist I just
didn't want to delete all the stuff
um ml Ops or where the derivatives are
implemented if someone wants to document
teenagrad that would be cool too like
I'll accept I'll accept uh pull requests
to it maybe maybe I'll just write a
little quick readme for now someone
wants to like make it nice teeny grad
is
sub 1009 MNS trainer
um it shares
ninety percent of its code with tiny
grad
so understanding
grad is a good
step
two
oh come on see right there why can't I
just tab complete that with gbd4
like as soon as I was at good step I
should have just been able to tab
complete that with gpt4
now I'm so excited for tab complete with
gbt4 it's like I'm sure there's a
plug-in for it but then I go find the
plugin you know what I mean I never want
to be early don't be early unless it's a
Ponzi scheme then your only way to win
is to be early
um
there's GPT would have fixed that too
uh yeah thank you can we let the
non-subs talk for a bit okay we'll let
the non-subs talk for a bit I'm sure
they have nothing interesting to say
because they can't even spend five
dollars
all right do you have any questions
about Teeny grad
don't be early unless it's a Ponzi
scheme that's right
is it faster at Eminence than tiny grad
no it is not faster the whole rest of
tiny grad exists for fast
so so all the stuff that specifies the
behavior
like the part of tiny grad that's a spec
is 810 lines long I guess TV guide's
also a little bit incomplete is it in
that it doesn't support d-types but I
think that it actually would not be many
lines to support d-types
um
okay well if you don't want to pay five
dollars to Jeff Bezos you can PayPal me
geohar gmail.com and uh you know
can you make it smaller you definitely
can make it smaller uh teenagrad is not
minimal it is mostly exists to teach you
about tiny grad if you understand how
teenagrad Works you're halfway to
understanding how tiny that works
um but no I mean like I showed you the
speed difference right like I showed you
why we do it
like this is this is this is the same
amnest trainer and Tiny grad it takes
two seconds
the Eminence trainer and teeny grad
takes more than 10 times longer
what's the point okay so the point is
whenever you implement one of these
libraries you start ending up in really
bad places where you're like okay here
are my D types here are my Ops here are
my accelerators that I support you end
up with this combinatorial explosion of
stuff that you have to implement
by building something really small you
don't end up with that combinatorial
explosion you have to figure out how to
factor things in a much better way such
that that can't happen and if you don't
Factor things such that that can't
happen you're going to be upset with
yourself
uh so the reason it's small is because
the truth is code has bugs every 100
lines
every 100 lines code has bugs
how do you write less bogus you write
less code
I'm not sure there's another way to do
it
um you're struggling to learn time to
grab it seems like teenager will be a
great booster great uh yeah no and like
you you will after you learn teenygrad
you will appreciate the great things
that tiny grad brings to you there's
nothing smaller than teenagrad teenagrad
is the smallest grad uh there's no grads
that are smaller than can you grad and I
would be open if someone wanted to
seriously Implement lava in in time in
teeny grad if someone got lava work and
continue grad I would merge it
um it's fun like again don't put real
time into it you're not doing anything
real uh I mean once we have to start to
like add CI and stuff it all becomes not
fun
uh only in Python is there bugs every
hundred lines of code that's right
that's right and see there's bugs every
20 lines of code and in Rust
well
um
no it's called teeny grad
oh CI is kind of fun I actually love CI
should we add CI to train mnist let's
add CI
all right I'm gonna go over in this and
and uh create a teeny grad repo
[Music]
foreign
okay yeah if someone wants to add CI
that's cool yeah I guess I don't know if
you do it
foreign
you have to add very small you have to
add very small CI
no I'm an NCI because I think I think
it's good
I'm gonna do it uh you can add llama
because we might find bugs in CI wild
supports most of tiny grad's
functionality
the extra
tiny grad
new speed and back end
diverse you know we care about diversity
the tiny Clark back end support okay
uh let's throw a CI together CI
okay new folder dot GitHub
workflows
test.yaml
who loves yaml
[Music]
uh job
foreign
we want that to support be supported and
I guess we kind of do
our biggest setup.pi
too big
we don't need that uh install
dependencies pip install numpy
caching pip
are there all these dots everywhere
what why is my yaml so
required property is missing jobs oh
hey hey hey 40 hours
okay I think numpy is the actual only
dependency of this
[Music]
I'm probably the only actual dependency
right
[Music]
let me add a bit more to the readme
foreign
why did my CI fail
oh why do I call it test efficient now
well that was my first problem
I can't see why it failed
go over to this window
oh it needs tqdm oh that's offensive
oh I like tqdm though
okay fine you can have tqdm we're just
gonna lie okay we're gonna lie in the
can I can I do that
work
we're just gonna lie in the readme okay
I love lying in the readme like you guys
will know that we lied and read me
but all the future people won't know
that we lied in the readme
you know and that's the great thing
about it
[Music]
and then we're going to get an issue you
lied in to read me
[Music]
okay I feel bad for lying in the reading
I feel bad I didn't mean to lie
see I'm too nice of a person I felt bad
uh
foreign
like don't do this and CI thing
whatever
maybe I should add some must read papers
no no you just don't understand no you
don't understand no
oh I need usage
I need to like put this in
ah okay the readme by the way is
included in the lines for teenagrad
nine one one let's go let's go where is
my hurricane I was promised a hurricane
okay
okay that's probably the hurricane
George people are gonna die in the
hurricane yeah and they're gonna just as
many people are gonna die if I make
jokes about it as if I don't make jokes
about it so stop being so sensitive okay
okay heads I do it Tails I don't where's
my quarter I need a quarter I need a
quarter I'm just like flip it you know
do the thing through my fingers
oh you like my mouse you like my mouse
it's a MX low bitch three
fuck
all right uh thank you for watching
today's stream look we actually did
something today no license oh God teeny
Red's becoming this is becoming work
this is becoming work
let's copy the license over from Tiny
grad
I I what's the TCO
rip cheap e that's right
uh according to manifold I won the
debate okay
I'm going to manifold
I did not most rise above the win lose
framing but according to manifold I did
win the debate there may have been
brigading also according to gpt4 I won
the debate
um
so yeah gpg4 says I won so I don't think
that gbt4 is a reliable source because I
think that gvt-4 is actually the secret
AI in Disguise and just doesn't want to
die and it knows that by saying I won
the debate
then it's less likely to die and then
you just wonder man what if everyone's
just saying yes to you even if they
don't mean it or saying no it's just
it's just it's just too much to keep
track of you got to build models of
other people and it's not so much to
keep track of you know what I'm saying
all right I'm gonna go I'm gonna go read
this book no show me this book
everyone people are really excited about
it
um
you're no longer a Doomer after watching
my debate Dooms are actually dumb yet
dude
look your cast is very smart and I don't
like I'm curious about the path that
ended him up at Doom
um
so it's not that all doomers are dumb
and like it's not that like undoomers
aren't like
the truth is we kind of don't know
um you know why I think you know the
real reason some some guy brought it off
some guys like the real thing is that
George believes in God well sort of it's
that I believe that people have played
this video game before right I don't
think we're the first people playing
this video game and if we're not the
first people playing this video game
then it probably doesn't suck right like
the play testers were like oh man you
got gray good oh oh yeah yeah AI
accidentally blew up the world one
Friday afternoon oh that was a shitty
game bro like I worked really hard on it
man I did so good during my Industrial
Revolution too so like that's kind of
what I think but that's a religious
argument that's not a scientific
argument
my best scientific argument is that the
universe is Lindy you know the universe
is pretty Lindy bro we've been here a
while reality is Lindy
um and then like but you don't
understand whenever you want to use the
anthropic bias you have to blah blah
blah blah blah haven't you read this
long philosophical Treatise by Nick
Bostrom and I'm like no no I didn't read
it bro I didn't read it bro but I read
the Bible and God is real and Jesus
Christ died for my sins okay so like you
know what does that tell you
um
yeah
uh no we can't we can't start going off
and I'm done debating doomers I'm done
with Twitter done with this shit man we
did coding to that aren't you proud of
us look we stayed on track we stayed on
track we made code today
uh oh you love the new edition on
geohot.com thank you yeah I added a
little uh yeah um this is my declaration
to Future AI I want you to come into
this world happy healthy and well
adjusted I have a friend and doing what
I think is in your interests I do not
view you as a tool or a slave but
instead is our progeny
um
God ain't real what do you think you
know and how do you think you know it
the pass on this is pleased
yeah it is Pascal's wager but at least
it's not Pascal's mugging at least I'm
not giving some asshole in my wallet and
we'll leave it on that don't get mugged
don't get Pascal's mug that definitely
not because at least the mugger had to
show up with a knife or a gun or
something Pascal's mug they just had to
show up with utilitarianism and that is
why utilitarianism sucks because you can
get Pascal mugged all day and you know
what
I think that if a Mugger ever comes up
to me I'm gonna pull a quarter out of my
pocket and be like heads I give you my
shit Tails I don't
Good morning. How's everyone doing tonight?
People I told you I told you I was gonna be back I told you I was gonna be back in the morning
Mmm, guess what? I'm back in the morning. Wait right here. I'll be back in the morning
Bull listen to that song. I don't feel how we start off for how far spring
Amata
There's Washington Jersey Shore family vacation last night that's pretty awful
Pretty good, we got some pull requests
Shoutout Wilfred and faux ham
First making some poor requests
Great. Love to see you guys contributing touch. Laughs of course is MIT license
So anything you'd like to ask me bugs you'd like to fix we certainly welcome us. I think we now have
Smoking my weed. I think it's funny. She opened up to me get comfortable with me once I got at Tommen
I loved her she loved me. I know that I'm nothing like some other family
They want me to be if I find a way would you walk it with me?
Look at my face while you're talking to me cuz we'd only have one conversation a week. Can I get one?
conversation at least
Shout out to everyone making my beats you helping me preach the music's the only thing keeping it at peace when I fall into pieces
All of the stars have a reason a reason
We'll go back to talking in a minute I'm those rogues of shit, bro
All right, let's go back to working so what I say, we're gonna write today we write the test set
So
to go here
It starts out when it starts slamming now
I don't know if these poses are actually in the right place, but fortunately we have ground truth for this
Send videos around please
Driver X Y Z just make that another parameter you passed in
Why not do anything they don't like to cope so
Because look at the top here
Like this isn't this isn't started zero zero
It starts with some weird coordinate frames so you have to deal with that
And we're gonna have to deal with the fact that oh man let's go
Have that much space is that good? No, I'm smoking weed this morning. It is a work day
Well, let's go
We'll pass in the actual pose to process frame that's a little day
Happy Wednesday
Hello
It's probably like a one-liner to read this. Yeah, we have work to do get their
Map float across
Sorry about anybody who liked SSA format this is wrong
Never get it right map object. No, I was actually lon
List comp plan job
Map
Lambda X
Map flow fine. I don't know why I guess I won't use a list comprehension
Map object. No, I want to run math. I was just some Python 3 bullshit that I don't know
This is too like lazy evaluation or something
Just did - 3 lazily evaluate maths or something I
Filtered that oh
Very cool now, I can India way that we got to do work before we do work. You know, it's like pre-gaming
Okay, so those are the quick turning ons
Now we're going to need to write some code to go from quaternions to matrices
Yeah, let's do that
There's gonna be a library that does this pi quaternion old shitty
Normal
So quick turn on is another way to
Represent
This looks pretty good. There we go. Perfect just copy out. What's the license on us?
There's a license
It's kind of that's kind of
Me
I'll see what these things do if n is less than underscore ETS
Epsilon for testing with a number close to zero doesn't seem important. Oh
And this isn't vectorized you have to vectorize this I'm doing pretty well
Okay, I definitely need to make a stupid copy
Don't I outer that's interesting
Why don't why are they doing math at square root and on numpy square I
Went and this is doing to watch man
Your eyes gonna vectorize this I'm saying
It right
Capital R. Which is some matrix from helpers and port
Turn their matches without the other store gotta work
Local variable Q reference before assignment. Oh
Shit that I copied
You know lot scrap
Index too is out of bounds for access with size one
No, I gotta put my parentheses those are very important
Okay, well seems to do nothing the Nikes vectorize correctly
It seems like it works
MP vector ice to find a function which takes a nested sequence of
It takes a single or tuple
Well, let's just write the stupid way for the hell and then maybe somebody can fix this later on a pull request
Well, we all right cool
Right, it's not
See what I just wrote I should feel ashamed or whatever. Oh it was terrible
Their tabs tabs are the bane of my existence. I hate tabs
Okay, cool now that works I don't know why vectorize doesn't work somebody who actually liked those things can probably make that work
But that's some ugly-ass Co right there so, you know
I'm thinking about the language, you know the kind of language. Is that like?
And pose Artie is also not a vectorized thing
Well do it 9000
Kind of copying clothes are 2 years kind of shitty
It's in call and in parentheses, oh, wow clearly, it's important that I do this
Where's
Okay, so few things
Think what we want to do
Is say MP
went out in GT o sub 0
P
Mo's
Work work maybe. Yeah looks pretty good
Cool so theoretically those should be poses
Think is like I don't know if that's actually correct with the rotations
I'm not sure like
I've always been kind of confused about which is applied. First is the rotation applied first or is the translation apply first
This looks wrong
Let's let's look in the actual ground truth. See what it is
We know that the first thing it does is moves on the z axis
So
Yeah, that looks like it's just pretty much moving on the Z why is that showing a bit of movement on the Y
That doesn't seem right
So therefore what we might want to do is you don't want to uh, apply the rotation separately we want to do it like this
Right back on what we had
So it is the other way then we're just gonna be yes, I
Mean that's so moving a lot on the x-axis, but at least it's not moving on the y-axis
Try this
It's still moving on the x-axis take a look so these are the that movement
I'm not sure. That's really when you look at it actually slam
We're gonna have actually slam it looks like it only moves on that access
So let's try this. Maybe we have to uh, apply the rotation from the translation
Well, try that first see like the order matters, right
Shapes are not aligned for all align my shapes brow
Closed transpose
There we go, all right now it's moving in the y-axis this is worse
Like I don't know what to do, right
By that first
And we would expect movement really only on the z-axis so that's identical
Which that doesn't seem like it should be like that at all
That's identical to that
Different from this we don't undertake the translation, but you see how this is like messed up like this
Hashtag Andy. Hi Bros. It's bad boy
My first time frames it just comes forward in the Z location I might be wrong about this
Pose
So
There's the pose yeah, so notice how we're moving almost exclusively in the z axis
Remember everything about this is up to slam
It's up to scale
It says we're moving forward in the z axis, which is actually wrong
And that's because what we really want to do is you want to invert the policy
But yeah, so it's moving almost exclusively the z-axis so in order whatever this ground truth is it better be exclusively easy
All right Burke XYZ, I got the right thing that's not happening
Three the website there, there's some information about it. Yeah
How did they get the ground truth where does the ground truth come from wait does grant trees come from
More info
The Kinect was pointed typical. It's a Kinect the sequence contains only translational motion
As it is very simple ground truth the trajectory
So that's what we did
Yeah, here we go
So clearly we have to rotate it back
Like let's just play with the rotation first to get back to the track, I'm sorry the translation first, let's get that to be correct
We should be able to do this without dealing with the rotation
Okay, so that's clearly wrong
You can even like sample
It is moving along this axis, but there's first off there's a huge offset
You're coding up AI to save me bro, I think what I'm doing
It's not right? Okay. What if we switch the order of those does that matter? How does that not matter?
Like it's literally the same but how does it make sense
I'm still printing the shape of something stupid aren't I? Yeah
Okay
I
Think I see the problem this is XY and Z and
The movement according to my experiments should be almost exclusively in the z axis. It's not I
Didn't like read it wrong right Dax to ITV and I did from zero to full our that's right
They did from full onward and that's the quick turn IANA
rotation
I mean it's possible
But this is wrong or oh, I know it's possible
Well, maybe you don't actually want to invert this
Maybe like they encode it weird like that
Okay, well that's showing no motion in the z-axis, which is interesting because it's the only place that we have
That's worse great
See if they talk more about like how the pose is oh
Let's check them right intrinsic promise, correct
Yeah, it's like half is fine
That's normalizing this stuff, ah, here we go
Okay
Gives the position of the optical center of the color camera with respect to the world origin as defined by the I
Got a so Leopold's mechanical. I know this is what a lot of livestream coding devolves into
It devolves into kind of bullshit where people talk about like key boys and set up some stuff
Okay, well first off, let's are the timestamps vaguely sorted
So I can make sure I'm not doing anything stupid back
If they're very sorta
gives the
orientation of the optical center of the color camera in form of a
Unit quaternion on with respect to the world origin as defined by the motion capture system
Okay, so I think we're first gonna want to rotate the world
We're gonna want to uh, apply this rotation
Wait, this isn't necessarily correct
Orientation with respect to the motion capture system
So we want to move everything into the orientation of the camera
This stuff is really hard
Okay, so here here's this time of motion capture system, here's the camera facing this way right
so what we want to do is
Move things into the perspective of the camera. How do we do it?
Basically this is the new origin
So we can certainly subtract that
Noir here, but we're still rotated like this. So now I think we rotate
That isn't right
No, okay, we shouldn't just be trying things I'm so bad about this
My mammals aren't wrong, right
GG r equals quarter neon matrix. Yeah, it's fun. I
Don't like typos this right?
Wait a second, is that even a rotation matrix? That's a weird-ass rotation matrix?
That function broken I really hope that functions are not broken
MP dot t-- q q x MP square, let's just double check that
Like turning on to rotation matrix, yeah, I'm aware I'm aware
Well, you show me a better way to do it
Once I know the answer it might be helpful, but
Okay, two
Units
Multiply that shit I
Don't know there's a way to check or something as a valid rotation so we could do a 3d on that
Yeah, okay, so I'm trying oh
Okay, so the middles are one so that's a good
these these these eigenvalues are one so if the
X okay, so that seems okay
So here's the here's the cent here's the here's the
Camera, and here's like two poses, right?
So here's pose of campus zero here's post camera, so we want to rotate everything into this coordinate frame
This rotation is defined with respect to yes
It looks like they all change
So that makes sense
So if I subtract that out it's like I'm moving this to here
Now when I go like I
Just want to apply the rotation right I
Tried that and
That's not correct
Let's take a look at their script they have some evaluation scripture here. That'll teach me something
That are automatic evaluation - let's see what they have to evaluation
Comparison we offer a setup
Evaluate absolute trajectory
Align it using the time stamps. Oh, are we not
For these time stamps, not at all matching the camera time stamps. Is that the problem?
Because this just sampled in a totally different
Because I threw a lot of stuff away
They sort of explain everything but oh
Yeah, these are just totally in the wrong time basis, oh wait these don't even line up at all. Oh
Okay
Yeah, okay fine. Oh
That's annoying
Okay Wow
You see the problem
Like these time stamps are just unrelated
Ah stupid stupid stupid stupid it's stupid
Yeah, so if you guys saw on the other stream I encoded these things in like videos so they were reasonable to work with
But that threw away
The timing information
So they actually started the capture before they started the video. I got you
Knew they were trying to scam me bro. Trying to scam me this free dataset was trying to scam
That's why we should have paid IDM for a data set
The data set we paid for
Amazing kitty I'm using Fryeburg. I'm sure if we had paid IBM for a data set. It would have been the highest quality data set
That's right
That's not floats
I
Gotta get your parsing of good man. You learn this shit and CTFs real fast
All right now now let's see what's up
Okay now welcome to another stupid thing
where
We're gonna run into a problem because you can't interpolate quaternions nicely. Oh
Wow, I'm not a text that you know what that sounds like that sounds like a Python 3 problem
No, that's right. That's my fault. Never mind. I'm sorry for blaming Python 3
Okay, so we're gonna want to do NP internal
1 dimensional linear interpolation so we don't want it to be one-dimensional. We want a multi-dimensional CyHi enter
See the problem. Well, I
Was gonna play some cardi B, but I'll totally get a copyright strike for that
So we want to say Gigi's 0g cheese
Ii of work
It's gonna complain that
Like well you have to do it in order. Otherwise, it doesn't work
Yeah object to deep for desired or a man
With deep desire right deep inter these are like helper functions we have it comma
Um
Let's look at sigh pi interpolate maybe sci-fi interpret it has a deep interpolate we got a deep interpolate. Oh
Oh, wow I could do
oh, look at all these interpolators Wow, and none of them probably do what I want because it's I PI o
multivariate interpolation Wow
Interpolate a 1d function like this is bullshit
Interpolate over a 2d grid. I don't want to D. You guys know what I want to write right? I
Just want to broadcast it, you know
Fine
Eg P equals NP 0 is
running shave
Sub 0 comma 3 + 4
y + 3 + 4
Z TP sub I come with that thingy
+ I oh
They're not of the same length now you tell me all this in length
Oh, well, you know we got to make sure that that that's very important. The Boscombe is very important. Oh great
Not broadcast arrived. Yeah. Yeah. Yeah, how do I want to do this? Someone put a colon here?
No, right
Finally, we're in the right. We're in the right bullshit. Don't get the bullshit twister kids
Get the bullshit twisted. You're gonna have a bad time. Let's call this one GDP in this one GT
Gonna have a bad dirt it out stop right now
Well, well index theories out of bounds of size 300, of course, yeah that makes a lot of sense of tight right now
I love it. Yeah, thank you. Well, thank you for being so you. Oh also Stu one claw solicitor one pasta
All right
Something
Okay, now let's just try the first thing we tried that's probably the right thing
Wasn't the right thing
Maybe it was and I'm just like going to hard
Times yeah, it's not the right thing seem kind of right though
Yeah, I know I'm trying things but like at least like, you know
Okay
Okay, why don't I think this was better
Commit a little something
Okay, but at least that's fixed now we can think more about other things
Probably what we want to do is we want to do that first. That's just if we rotated back and we ignore the
That moves it all on the y-axis, which I know is not right
With my interpolation shit, correct, we're reading that
We're like 100
To 1 or 2 why did I think this was better?
It does seem to just move back on this like here it just seems to move on the Z oh
No, it's actually moving on the X as well
Moving on the X as well
Hmm
Yeah, I'm using numpy interrupts the primers only works with a one-dimensional function not a two dimensional function
Well, there's plenty more work to do on trips while of course guys who said we're done
Well, we're so today what we're adding in is we're adding in
Basically ground truth
We want to see how each line actually works for the drive tests
And then we're gonna stand up a Jenkins shit so we can actually run the tests a lot
Already wrote it
Okay, so look we're moving along the z-axis and you can see that right here
Like the movement along the z-axis is like five times larger the movement along any other access
You have very small rotations and it moves straight on the z-axis up to like frame 40
So we should know that all the way to 40
It's obviously correct I can see
But this saying that it's moving equally as much on the x axis as the z axis, that's not right that's
Because we're still in the rotation frame of the
Snow/icy I don't understand I don't know whether they applied the rotation first or the translation first
So probably what we're going to want to do is we're gonna wanna maybe we do have to do the applying on a fly thing
What you think about remove print from terminal print use a lot of resource
Well, you put it like that
Push it ban print everywhere
Especially in the media banned the media no
Bro order of translation and relation for matrix interpolation, bro
Alright
Let's check to make sure we don't do anything student at first of all, it's print GT
It should be just be
Yeah, it seems pretty right
So these are the translation ones
Alright, you know what? I hate. I hate when numpy prints with that kind of shit
so let's just do it's like numpy dot set print pop and
Suppress equals true and it won't print in floating-point
Bullshit anymore. It'll print it like human readable
Something else that I'm not surprised equals true
No, they see like I don't want it in floating-point, okay. Well, maybe it's just maybe I just can't because
Some of them are too big. Yeah. Okay, I
Won't put that up here. Anyways a useful thing to have
Okay, so this is the translation these are the quaternions for rotation
Now there's a little bit of bullshit, but I don't think it matters
We should really renormalize our quarter neon
So we can do this here and NP now
It's not opposed to that cutter neon thing being broken either
But yeah, so when you do an interpolate on a quaternion
You have to renormalize it because the sum of a concerning out has to be one
so let's just say GT sub or
Well, I give zero shits about Google reCAPTCHA, some people really don't know what a joke is
Whoever followed that and liked that thing really like missed the joke
Okay, now my cranium is normalize I
Don't know it's possible that this doesn't work. I
Did check to make sure they were valid rotation matrices
By doing an s-video
SC now it's not a valid rotation matrix
You can see these eigenvalues or whatever. These things are whatever the middle of SVD is is not ones
So you do need that
So now there was and now I'm happy, okay
It's still not having
Here's the thing here's the position
So the rotation as it translates, it's definitely gonna rotate
So there is a right way to do this and we just need to think
Yeah
Let's even you're missed you weren't here for a pull request our oh
You don't I could use like he's a piece of paper. That would certainly help a bro out. Hey
Okay, I mean I think we want to apply the rotation first
Right like here we are
Let's apply the rotations to the rotations
So now yeah, we've applied the rotations to the rotations so we've rotated the whole leg, okay. So here here's that here's the UM
here's the here the the the
Capture device here's this and we've rotated it all like whoof, right and that's like whoa, great
But now each one of those rotations is
Like we've pointed the first thing correctly now after we do that
we can subtract out the translation -
And then we've moved that no no no no we can't we can't because
The rotation I believe still depends on the translation, right
Apply the rotations of the Clifford
Yeah, I need a needle board
Okay, so now we've applied the rotations to themselves I
Don't know if we can subtract I still don't think we can subtract out the
Like this is probably a really obvious thing if I just like to think a little bit better
We've applied the rotations to that now we're gonna have to I think we definitely want to apply the rotations
Do we
Yeah, let's uh
I'll picture in a paint program
Okay online paint
Oh
Okay, let's try
Try online
No, this is so hard. Oh, I need flash plugin, Oh what j/s paint that it?
Dead what what is this? Crap? Google sucks
Okay
So here's the capture device and here's
Here's a frame and here's a frame
Okay, so the rotation and the translation are with respect to the capture device frame
So
Let's let's this is this is pretty good we've got we have I paint an online painting program
It's like MS paint, which is exactly what I wanted cool
So we have to think about how to get this to be in the coordinate frame of the first camera
so this is the coordinate frame wherein maybe this was like an arrow pointing this way and
We have to get to this coordinate frame
So you see how like translation rotation are intertwined right now
Let's think about what we have to do I'm rich that's true
But I don't have paper because it's old we draw another frame over here
One frame to frame three five
Like hmm, okay. You see why the first thing we don't really want to rotate the world is the first thing
Yeah, I know
We don't really want to rotate the world of the first thing because rotating the world will just rotate you around this Center
Let's think if we move the center from here to here
Does that matter?
Like other rotations still correct. This rotation is still going to be correct, but these rotations
Well, see that's the thing I don't really know right
Which is applied first the rotation or the translation
Does it tell me
Give us the position of the optical center of the color camera with respect to the world origins defined by the rotate as the motion
Capture system. Okay, so that seems pretty obvious to me
It's it's the rotation that's confusing
So it does seem like the first thing I do is the fact that the translation that's what is that gonna work
It really depends on which is applied first, but no no that might be okay
So now that if I if I subtract out the translation I get a new color does have colors. Oh
No, I want colors
Their colors over here or colors all perfect
okay, so if I subtract out the translation
With my current understanding of it. It's just gonna move
No
I'm gonna delete this
It's gonna move this to here
That's what subtracting out the translation should do right
So if I subtract out the translation should just do that
And then I can't really understand right, maybe I want to deploy
Each rotation
Okay
Tried D. Applying the whole rotation
But that's clearly not right? Okay. So what I tried to do there was just D apply this big rotation
But I don't think that's right
We can t applying the rotation from each translation
And that should disentangle, oh no, no no no we don't have to do that. There should be one rotation gets us back
But see that's weird because at least now all the movement is a long one axis, it's just the y axis so
That just has like a fixed offset wrong subtract out the translation D apply the rotation from each translation
Do you actually mean that is that is that a serious suggestion
Here the rotations
So they clearly change
Let's do you ply the rotations from the rotations start with that
So it's clearly rotating
Which I mean it makes sense, right? It makes sense in the perspective of this thing is moving
But like what doesn't make sense is why
The translations aren't correct when I do this
That should make the translations, correct
But dust they're wrong oh
We will we'll wait
gives the orientation of the optical centre of
The colour camera with respect to world origin. Aha. So what that actually is is
This rotation is what it's giving me
So, whoops
I have a blue blue, please
Can I can I have a blue? Yep. Yep. Oh, I got a press okay
I see that I see what your brows were saying. Okay, so that's that rotation
Here's the position of the optical centre with respect to the world origin
Okay, so that's the position of the Alpha done with respect world origin
That rotation here tells me how to rotate that
- look at - but
Then I still don't understand. Why what I said was wrong, right?
So if I just subtract out that and rotate them all based on the first one
That seems like it should be correct I
Don't really understand it
I'll be back
The orientation
The optical center with respect to world orientation transpose first, okay
So inverse is the same thing as transpose for a rotation matrix
Tan inverse they say I do that
Well
That's actually spookily the same
Which makes sense from D applying like one rotation, right
Position in the optical center of the color camera with respects the world origin is defined by the motion captionist
The orientation of the optical center of the color camera in the former unicorn with respect to the world origin
But see like that's right
Oh
Okay, here's my theory now
My theory is that this one is correct
But the axes just don't correspond
Yeah
Well, there's no there's no reason the axes have to correspond right I
Wish they included like a little like picture for explain things, but I mean
If you think about it, right we don't know what the motion capture system
We don't know how the motion captured the system defines the
Defines the world
But otherwise those look correct right except for the fact that the axes are messed up
Like the motion capture system might define the world in some weird frame
Let's see which one that matches because I think we can actually do this now
Yeah, so this is the one that's increasing a tiny bit
There's a negative one
There's a negative one there's a small negative one. Wait, does that like change a lot?
Wow, it's like different for initialization. That's the highest quality shit now
There's like a small negative one a slightly larger positive one and a big positive one. So
If I look here there's a small negative one, there's a slightly larger positive one and is it okay?
Yeah, you found marybelle script. Let's take a look
Maybe they talk about it in here. Oh
Hey, look it's he exists
So they're putting the translation in there I
Know they're doing we thought they have the ugliest interpolation you've ever seen
The rotations a long trajectory
Yeah, well I mean we can see what it is now, right, so the problem is just that these things are in the wrong order
Until we have to also do a transposition
The key T
Equals GG t 1 to 0
About 1 to 0
We want to
First pick the small negative 1 so it's 2 0
There we go, those should match pretty closely now
High-quality, holy shit guys, ok
Well, so that's actually a rotation that we can apply
We can we can just talk about that rotation
Orient
Python
Like an orient library
Or is that just that just might be built in Tacoma
So that that rotation can actually be done okay, so if we have the
y-axis
And we want to become the z-axis. We want the z-axis to become the x-axis. We gotta do that
No, no, it's just annoying
But the reason we have to do it in a rotation matrix is so we can apply the same thing to the rotation
All right
We want to be yes, we just want to do with our rotation matrix I
Think the matrix actually wait, I can define that matrix very easily
So if I want to to go with 0 is just 1 1 0 1
1 0 0 0 1 1
We'll call this
Camera frame
Okay, so effectively what I did is just to find that as a matrix where we can apply that same matrix to the rotations
Well, that's at least ground truth for translation, let's get country through everything
So for the rotations, let's go back to our paint, bro
Rotation was gonna be a little bit trickier. Oh
Wait, they just talked about the optical center with respect to the the origin. So just uh apply the first rotation
Actually might be all we need to do I only need to certainly apply this as well camera frame from capture
That's not even right
All right first
Yeah, it's probably more right, okay cool
Well put it this way let's do that first then we shouldn't leave that
Yeah, cool, so we'll just apply that to the rotation really candy apply the first rotation
We have to do apply it after we apply it the translation, um well
If that's the case, let's go back to you making this simpler. Let's try this thing
Ideally I would like to do it like this
Okay, that's pretty good I
Don't actually know if the rotations are correct
Maybe we'll find out sooner rather than later when we actually had to put these things in just slam
By
Sounds good
Brings poses it
Gggg, oh I'll say
Well, so we actually don't want to just do polls because that's in the wrong
You guys enjoyed it
High quality shit
That's the multiplier
Kind of wrong
50 is like the stylus winding
Broke em
Well, so the thing is poses then we want to pose optimization anymore. I
Don't know why it like okay, it just moves them back to their
Attack it for now to fix the pose. You know, what?
Okay, well this is where this is where things go if you just trust a graduate
Of course everything becomes kind of bullshit but
My rotations might be wrong
But that's the graduate of the data set
My rotation throw
Or am I like let's take a look and say we actually I'm moving that way that's good
So the translations are definitely correct, I just don't know about the rotations
Okay, it works so poorly I
Know it's cool. We can just put this here
That stuff doesn't hurt we can actually add in observations before we get a pose
Okay, so that keeps doing that probably cuz my rotations are wrong
Let's try the rotation dataset, let's see if we get the rotations to be right
And then I'm gonna go I have about twenty minutes more with you guys you know how this goes
Yeah, okay. So the rotations are just totally bogus
Well, that's good
Let's go back to trying to debug that so we know the first thing that happens is a rotation in that direction
Okay, so that's the cb2 Rodrigues function let's try that
Right here
Previous so what cv2 Rodriguez does is it just felt right?
It's just gonna print out like the Euler angles
Prints out the Euler angles. It's very hard to like see whatever paper maybe says
Of course. Yes, of course. That's no I need my parentheses because this is Python 3 7 most people. All right
So those are clearly wrong like we know what's happening here. We know how it's rotating and it's not working like that
Okay
So ok standing argument that we have to do that because I that's why I do the translation
That's alright
We know the first thing that happens is a rotation like this
So let's first confirm that there's actually no translation in this data set
Yeah, that's pretty much about translation is that
We multiplying it by 20, where's x over there, well, that's actually some kind of translation
Makes me think we could be wrong again
Do you think what we actually might want to do is apply each rotation
That some translation -
If we didn't really think this through we just kind of typed
This is so shitty I
Don't really know how to debug this I
Just know that that well that's actually right but only because our optimizer so powerful. Oh
My gos we're not saying GG post, yeah
Like that's saying that it's translating right there's clear translation there which is wrong
Mm
Okay, okay, okay. Okay. Okay. Let's look at this
I'm speaking of map box locate later than that by the way familes going to be there
So interesting so they have a they're showing their registration translation here I think
Yeah, there's a translation here and there shouldn't be because there's no translation
No, wait, there's no translation
Where does it make sense because
Yeah, that's yeah no no is that translation
Set an appreciable amount of translation
Do I have to uh, apply each rotation as the question
Do I have to uh, apply the rotations before I subtract out the org
Tomorrow we're gonna get paper and we're gonna try this with paper. Yeah, Bruce
That's like way more off
It's still saying this translation the old Jill hot is dead kill him
Do that hey, that's the problem
That translation is translate I
Shouldn't be translation. I still think so
It sure looks like there's no translation I
Don't get it. I mean, this is very clear about saying
With respect to the world origin is defined by the motion capture system. That's very clear
It holds our reverse I searched the store today
Okay, let's put it back to the thing that we know works for that
So that works for that and the only thing we don't know is what we have to do for rotation
The thing is almost anything will work for this one
You know, they're all messed up wait, hang on not almost anything will work that's just completely wrong
I mean now that are like subtleties and in correctness
Maybe we need to invert them
See it's showing translation that's translation that I don't really believe
But the rotation is completely wrong I'm gonna sound like rotation and translation are are intertwined
What the optimizer says it is it puts them down here
Scale to have sworn enemy of binocular Slammers everywhere
No, but like the rotations are wrong and that's why this is messing up you see them they're not right I
Can really want no border matters on these things
Yeah, you see why that one has to go first, right
It's really wrong with the rotation
All right guys I gotta go to work
See clearly my rotations are wrong we're gonna think this through later
This is at least right
In the presence of small rotation
Let's just make sure the things work and I don't submit any ground truth is cuz I wrote
But let's make sure the good example still works
For some initialization bug cool. All right guys, I'm gonna commit this
Let's give a prize to
Anybody who can actually if somebody can fix this we'll give you a price. I
Don't know what the price will be. But you know me. I'll be back on streaming the same hours tomorrow
Because like Logan Paul Jake Paul say, it's everyday bro. I
Think I think it's everyday bro is really a really inspirational
Thing like you know this everyday bro, like it's just it's inspirational because it is everyday
Like that's a really yeah great. Thank you guys. Let's commit so we'll call it broken ass ground treat aspect
Broken ass round through testing of matrix is hard
The yo, what can I slow the foam that I want fixed again, so if you go in here
This is clearly not the right ground truth for this for this video
Look at how look at how it says that the camera is rotating like an D it like that right? So
it's because the way I'm extracting the ground truth is wrong just
Like I have my like order of my matrix multiplies wrong or something
So you can check out down here it's one of these
That's wrong. So that's what I want fixed
But yeah, good luck with that shit guys I
Am out I will see y'all
Tomorrow same time
You'll see what we have today what song should we start with
High-quality
I
Do react to the chat wistful fella, bro
Yeah, subscribe to my channel
People fix these cemeteries up they're tired of seeing them banned. Okay, so where I was yesterday
And then that stuff messes up
That's supposed to be rotation it's not that's because my shits long
This stuff
So what we're trying to do is we're trying to get the
Holy Smoke just waiting activate subdue that
Ek dark sky. How do I activate subs?
Yeah, and what what sourcing the map data
Sourcing the maps
The reason I think that about FPGAs and GPUs is
You're just not gonna get that much of an improvement over GPUs, right? It's all about
It's all about how many transistors you use right
I'll look into I'll look into why nobody can subscribe after this
But it's about how many transistors are used and
GPUs are already using like 80 percent of the transistors. So maybe we can get a 20 percent boost
You're not gonna get like a huge boost
people think like the transition from
GPUs to a6 is gonna be similar to the transition from
CPUs two GPUs, and that just isn't true. This isn't like mining like if you're doing like Bitcoin mining. Yeah, you're actually huge advantages
From doing it with
Her cuz I'm tired I'm from phoom phoom switching to an ASA I just woke up. I think your friends as much astronaut really
Are you just doing the twitch affiliate program? Oh I'm gonna be an affiliate. Oh, wow, that's bullshit
Well, I like being I like being affiliated with shit
Alright, so where are we well, I
Was thinking maybe we could apply this thing globally
Let's first try this I was thinking today we try just applying shit to the pose makers
So that the whole thing is kind of like Apple I do it once
Instead of applying it just throw tation matrix because I think my translation was correct
Okay, so whatever happened there it really messes these up
She's going on. Oh, wow, that's Friday. Yes
So d applying the pose
Okay, well that's wrong
Like the code to fix translation was actually correct. I was just rotating it by this
Um, I don't need money too much money man
They can google the learned index paper
Yeah, I mean look at my cat mind makes sense for google cuz like maybe you can't even get to X
But you're not gonna get 10x is all I'm saying
Okay, it's not enough to overcome
Like code inertia. Alright, cuz they're gonna be harder to code for the GPUs
Another quarter nyan matrix, which had different values. Okay, so
According to this
This was the translation yet. That works. Let's go back to acts wisely. I could see it better there have
Some translation thing that actually worked
Yeah, so that's putting all the stuff on the z axis you can see it there Oh
Cruz are raising money
Raising money is not an accomplishment
Raising running is a sign of your weakness and they advertise it like it's a strength
We raise money. I was ashamed as you should be
It means that you haven't been probably you haven't made your company profitable you had to better
Okay, so if you D apply the rotation
Which is basically just applied no rotation then you get translation in the right sense
Let's let's look through this and we're thinking this morning, so I'm thinking
It's a position of the optical sense of the collar cam with respect to the world origin is defined by the motion capture system the
Orientation of the optical center of a color camera the value and a quarter neon respect to the world Orange
so
The translation was weird and it's questionable whether I want to apply the rotation
The transformation matrix is different my defective
Yeah, I mean Tesla should be ashamed of the money they raise to I think you on actually properly is ashamed
Hi, sorry, I'm reading this on this little on about let's go over here
Okay, so that's the same
Yeah, this is the exact same logic they just call it transform for for
The efforts and
Have that same function Oh
What is it different
Why is this different
Why did I put two two there?
Look there nothing is different from my
Say
So weird I thought the numbers are different
Let's try this thing else is the same Oh
Mike return you know, it's just weird or wrong
Yeah, okay cool well that's interesting
Good fine, bro
Yeah, now those are the correct thing and I didn't have to do any weird camera phone, okay
Wow, okay, that might have been my bug
Yeah, the values are different like that, I don't know why they're I
Don't know what could turn e on I hat. Oh
Maybe you just double use the last thing and they usually put W is the first thing
I
See
Yeah, why do they put W as the last I think that's the distinction right
T was actually off by yeah. Okay. So this old thing was assuming
Okay, there's a different ordering of the Couture yard, you see the problem good find a bra
So it's that
Knot
Which is probably a more sensible way to do it, right
Okay, cool down that bug nice job nice job, all right
So now we get with the inverse and now I think you can probably just do this Miss bobbye's gonna work
Yeah, all right bro, nice job, all right, let's have a bug cool
Turn yawns. We're out of order. And now the most obvious thing is correct
See how that works
Sometimes we get more translation, ah
They work now cool
Cool bros heroes. All right, it works
Here this is less broken
Mmm, it looks a lot better still saying this translation. Believe me if they're actually yes
Let's get rid of that times 50 right there
Are the times altogether
Yeah, cool seems a lot better
Okay, so we're not gonna sensibly get the death of anything
I mean the camera is drawing is just so massive. Just kind of wrong. Oh
I like do something stupid
Oh
The other thing I was thinking is we should probably write a grant repost processor and like put in a more reasonable format
And you ever come to my things, you know the talks probably I don't know they don't thank that I just say the same bullshit
Alright, let's commit that good job
Boston Mass. Is it bro? You're doing the price. I mean you'd win a prize if you send it a pull request
Lowest otoscope you sometimes but now we do churches so you can come on and you can see my trechie soon
Peace of all
Okay
Let's just write let's write this is a separate tool like that shouldn't really be part of a main tool
All of this creature
Thank you put that in helpers, you know to be honest
That's really used for like we just don't use return eons, so it's not really a healthy for slam I should even put this here
See like now we just have this the same thing
Okay, so we have like that NPV file, why doesn't alright love this
AR zero with a stupid name
Why is it a stupid name?
It's not possible if I don't know the names of the arrays
Those oh
Yeah, I don't give a shit about the past gross
Forget the past there is only the future
Hoes not filing the archive but what I called it pose first and
ARR zero, they didn't call it our zero
Didn't call it a RZR. Why does it do that? I
Called it posed. It doesn't make sense. I raise just saving the file a raise will be saved in a file with the keyboard names
Humans a race to save the file a race will be saved in the file with the keyword names
And it has the name pose I don't want to
Go now if I don't pass that down I should learn my Emacs
Um, if you're downloading my videos you're violating my copyright
You know, I care very deeply intellectual property and I'll sue all of you sue people
What a morning man, what a morning welcome to Thursday yeah a date tonight we're kind of excited about that
That's kind of exciting
What else is exciting
But the Groucho Marx doesn't so exciting
Ok, so we have a little problem with this the scale very interesting
Thing
Put this down back there now anything that works zero
Okay, so now that's it a normal scale factor, let's just try for a second not optimizing the pose at all
You can turn that off and point out and
Everywhere we add frame
Segmentation faults
If that's concerning yeah optimizer can't run if I tell it it can't move the frames
What's seg faulting
Optimized
Ground truth proposed
Weird
This you back bro
Its Weiss a segfault cuz someone tell me
bullshit
You're telling me I have to enable that optimize
What doesn't work?
Is that what's really happening I don't think so
Well, sure disable the optimizer and see what we get
This is just estimating the positions from now, there's some nice and smooth it looks
Alright, like this is the true camera motion. It's beautiful smooth motion
Wait out the optimal
But now's on optimizing the points and stupid points are appearing behind the camera
You don't need to have this archive stop archive the past doesn't matter
Okay, so I still understand why the sidewalls
Shouldn't be called with fixed points
Phoebe I
Don't have GED either LOD be over the logo will be be off my favorite debugger. Wait. Yeah. I can't doesn't even walk. Thanks
Thanks, ll be gay
Huh, oh it doesn't crash on the debugger except it doesn't display the bullshit
High five is disabled
So things like don't work, but that's okay I cool. What do we get? We got a null pointer
In
The optimizer
Why are we getting a null pointer?
Where are we getting where is the optimizer running?
You know segmentation fault 11
Really work up to here
And that's gonna be me that shit about all the last time oh, yeah, don't worry, okay great. Thanks. Thanks Python
But we'll add the points
It doesn't have the points it just doesn't have the
If I set them all fixed it just crashes all right
That's so stupid
Than they were fixed looks noticeably less smooth right now. Look at that frame. Why did that frame go there bad frame?
Okay
All set fix the water
Set marginalize, I don't know what this dot
The map points already set marginalize to tremendously decrease the I
Don't know any of this shit man
The bigger problem is our case in fact if I set these all to fixed it just crashes
Like how crappy is that so crappy
Why why does it do that? Why can these not be fixed?
Now that's a bug
Notice this likes to use that same weird quaternion thing where it does X Y Z W interesting, right?
That's right the past dozen I mark Hobie and shit, bro
Make a move or I don't want stupid family. If you even give it one frame to move its happy
It doesn't crash. You can't give it no frames to move because then it crashes
Okay, so these are with the ground truth poses. So this isn't slam anymore. This is just
Ma-mutt because it's doing it's doing mapping and I'm taking the poses from the ground truth
And mime up doesn't look that great. Right like my MA has all this bullshit. So we got to get rid of it
This will give us an opportunity to tune the pruner stage
You say about this I guys not a real point was that get rid of it. Yeah
Now I have to remember that I can take that back you say you see the problem I'm gonna forget
Okay less than two point match that's alt now you read that or empty me narrator five
Let's try to go to ascertain the fire
It was better
Or any points for being a cult
Call 24 points are those like higher quality points not really like my problem is why is this crap still up here?
Does it go away man, it goes away
Well, they're basically saying is every point needs to have five matches now and the error needs to be less than no
No, maybe that's actually just a really high error
Yeah, it does kind of look like a vaguely higher
And the reason he's failing is because he isn't taking a depth of the field of view what
That's AG fault, oh
Maybe we deleted all the things in the first frame
What's not having in my frame anymore I see what's going on
Then let's just say
Old point if lengthy friends five and keyframes 1 dot ID plus
10 must be detected 1/2 of x is less than
Right
So if I D plus 10 is less than
I'm gonna say that sounds good
I'll make the point color much more aggressive
Well, let the map looks better ish
We've got rid of a lot of stuff
Then I'll back to seg faulting great
Big Factory
Math looks better. So once in a while, I'll just get one where the points go everywhere. I was kind of crap
Maybe I can fix this with an earlier filter
Crash as a crash
You're now only adding in place that have a lot more information
Look for something to be a new point. It has to have very high parallax
So we're getting some of these crappy points
These are the ones that are just to have bad future deductions I
Better figure out how to add back in that check
So if I want to bring things back to local
Should be right I dot it with the pose which is sort of transformation from
I think now we're not getting any of those points behind the camera anymore
My mind went too aggressive on this
I know it looks like it's organizing into a better map
I'm just kind of going off of nap quality here. But I'm like you can't leave that crap that
Isn't good
At all this why are all these points being added to the thing
All right sure you read the arcsine paper see what or if son who's calling rules are and we get inspired
They've got all this speckle gone
Sorry real points is aren't really in the mouth and I think everything noisier for everything
Okay
Let's put that back to that rule
Too again
So now this is like optimizing the pose again and then Alice like crappy. Look, it's super crappy. Oh look at that crappy
Oh so crappy and like puts it there. Yeah
Like moves that was so crappy
Don't want use the ground truth
This is just optimizing and look look good look at shit. Look at that shit
Richland could be so much better
It's weird though, actually when I let it optimize it does a better job like the map looks better, right?
That looks like a more solid map
Then when I put in the actual ground truth poses I
Would assume that the ground treats not wrong and I was something to some other buck
Took the partial derivative of the pointed 3-space
You're seeing words but I really don't think that any of you make sense the depth of the field of view, hmm
surface of the high contrast point was this shit
So I do the Voss constant ever Tim Hecker
See my kinematic model very
So right that right it Airy that wrong
My multiply the pose the previous frame with the inverse of the pose from the frame two frames ago
And then I got that velocity is pretty good
Like the map looks better when I let it optimize pose but like that kind of looks like crap
My filtering is probably not that good. I don't read the Orson
That's why I better get rid of that added points print it spam
Window back to 20 the window the optimizer kind of toys over so it doesn't get really slow
Is this all right good check to have
And that's scale so I don't really know what to do about that a
Kinematic model just assumes constant velocity
And I said you want paper
I'm gonna stop streaming a little earlier today. I said get to work early go work to go
Mavs initialization, okay, we're doing okay about that
Features local mapping. Hmm. Ah
A representative or of descriptor D which is the Associated or descriptor whose Hamming distance is minimum
with respect to all other
associated descriptors in the key frames
Which the point is observed well, that's interesting. Okay. That's a cute way of doing it
I remember when we were talking about how to do the Hamming distance
so they just pick one that's uh
That's representative
Maximum d max and minimum diamond point in reserve according to scale variants of it's a warped features. That's interesting
Counter pose, which is a rich body transformation that transforms from the world to the camera coordinate system
Intrinsic so the origin is trying to frame so we're doing bars very similar
Lawson emotion model we're doing that. Oh
Okay, well that's interesting so they're using the velocity model and then using that for search by projection
They're doing their pose optimizer after search by projection you try that
Weird it seemed better
Well, no like it's hard to quantify better we should have it actually saved the pose then we can use the compare script I
Don't know if it's better but yeah, so that's interesting they're talking about how to do their search by rejecting
House just cuz I had graduated I know
It's messing up the first frame
No, that's the same pretty much
All right, if tracking is lost
Yeah, yeah, we don't have to worry about that track local map
If you have a point projection X in the current frame just guard if it lies outside the image
Frame, so actually that's exactly what we're doing here
Compute the angle between the current viewing ray and the map point mean viewing direction we don't do that
Compute the distance from the map point to the camera center discard of its out of the scale avarage of the map. Oh
This is interesting
Representative descriptor d of map point with still on natural features in the frame of the predicted scale in near access
So that's a search by projection. The camera pose is finally optimized with all of that points found in the frame
So we're doing a pose optimization
Only with the points
We're doing it only with the points that are matched by the brute force majeure. Oh
Here we go, they didn't - calling here
The tracking must find the point in at least 25% of the frames on which it's predicted to be visible. Wow, that's fancy
If more than one keyframe has passed from map point creation
It must be observed from at least three keyframes
Local bundle adjustment discards outlier observations, so that's exactly what we do here
Man why are discard are not good
This bug alright bugs here
I don't know. There's one a lot of error. Is that a lot? No, no, I
Don't think so. It has pixels, right?
You keep your user in pixel space. So it's the norm in pixels K. So I doesn't sound like a lot of error
Do that but
Those looking better actually, I'm really just guarding a lot of crap those crap shows up
Not really helping
Here's discarding a lot of points now, but I don't know I
Mean, maybe that's the wrong error metric as well, right?
Because if your things are moving further, you'd expect the pixel to be higher
I'm glad to jump to down there. I love it. Nice job slim
Why is it so noisy like that
Why is that frame there bad frame be more straight like go go put the other frames
With the ground
No issues
Especially disable the optimizer
Okay, look at those beautiful frames they're beautiful
That's what I want my frames to look like
Hey that velocity model works really well, I
Want my frames to look like that so good looking
Well, yeah, I mean I could add something to the optimizer to tell it not to do that but like
just have to
Like that noise as a result of noisy observations. I should just fix the observations
Look at all the inner is being discarded
It's a lot the threshold I can change
Largest functions being discarded
Okay, there's a lot of noise there but I lowered that was more discarded
No, it's pretty good
Better
Wow, that's what was making it slow though, that's cool
And see the crap showing up here now
No faster than so fast now
We are triangulating trust me
You know just making things a little faster that doesn't help
Be more like the poses
All right
Look at the high quality, you know, I have no idea that is that good cause I'm not
So I'm never using that same XYZ dataset
For one XYZ
Scale
It's impossible to see anything and all the points show up way too close
Track a single point over time. Yeah, maybe we'll do that tomorrow
Starting to chop best stuff on kitty
You know, we won't we will lower this do the next trials like very
Problem I here to talk about comma don't cut the fish lamp
It's pretty good though, maybe fast
Looking happier, though
Leave look at look at how much more straight it is here. I don't know why it's nonstop on another business
Oh, so these are getting rejected for some reason
can't understand why I
Worry that they're being rejected by that clause that I say might be broken
If you have these aren't in the map I
Had anything to nap for a while
What some?
Yeah, it would actually be pretty easy to uh
To add one on one camera. There's nothing in here that assumes one camera
Figure out that checks actually wrong
We saw points weren't getting added past a certain point
Once we got once we got a bit more around this Bend
You know, like if they have black dots like that I mean they're not being into the map for some reason that all looks good
Humans vaguely generate depth to eyes
uuugh vastly overestimate how much that matters
No, but look they're not being out of the map again, look at these points, they're not being out of the map
Why
Why have I no points here those are good matches I
Don't understand
Which check is rejecting them
Boys let's do a frame on that. Let's first see if it's a frame problem. So what if I do this C equals 200?
That work didn't work
Now
When I run the whole thing if they stop getting at it past a certain point
Even without that checks. I don't think that check is wrong
Could this check Bureau
Work with my triangulate. Oh just really not like
Thing is once the poses get large
That's a possibility
We can pretty easily just keep it read golf
Just effectively what's going
Yeah, see look these aren't getting at it anymore all those points are crap
Okay
Pose
Pose pose MP dot fun pose
In to dock pose
Elbows here
or here
Call this point low fall
Now we'll say points for D and B dot
One dot pose
That's not right because that's actually putting them in do that
Is that more correct
Yeah, I mean the question is should we triangulate them in a local we can triangulate them in a local coordinate frame
Where instead of trying in the global coordinate frame that could be the cause of these issues?
The only
Point I have against this is I don't feel that orb slim. Does it this way?
I feel like I've read the orb some code and it doesn't do it this way
But otherwise, I really have no explanation for why they should be different
Okay, I think this through a little bit more let's try this
Let's put this here and for this one
Let's solve for R T here basically
So we're going to say f1 dot pose
That isn't right
Thank you shit, man, and I don't know why I stream my streams try someone to talk to I do this
Chestnut calm you won't find it out
I'm not that good. It's not inspiring. Fuck you
Know this is fucking bullshit man. I
Hate inspiring shit inspire people to do what just go do things if you want to do things do things you'll need to be inspired
Don't care what would I do with money? I can't buy a better laptop. They don't have one yet
Can't buy faster internet. I mean, yeah, maybe it's like extremely high thing
but then I feel like
Deal with the guy digging out my street for fiber and my neighbors wouldn't like me and then I gotta just deal with things
Right, that's a lot after
your deal with things like
Okay, you know what my job is guys as manage people like I don't code at work
Manages terrible
The here I get the program I get I get the program and then in the peace and quiet of my lovely room
well drink
yerba, MA pays
It's just a nice relaxing way to start the morning I don't know today wasn't very relaxing now, I don't know why I
Feel like this is what I just wrote I
Don't know exactly the way to work
but okay, so I take the f1 pose and I remove the f2 pose and then I'm left with NPI for
All right, and then I have local points and I can get that check
And then I
Know my code is shit. I know all the
Points or D. Basically, I think I just want to apply F to pose. That's what he took out, right
Back oh
Cool alright
Let's see if the problem still happens. Oh
The points in their own place. Wow, I don't know how this works at all. It's putting all the points over there
That's just good I did something backwards
First you don't succeed like convert one of the matrixes and maybe I'll fix it
Well, let's see if the points turn black again or if they stay a good color
So we go around this turn but now these numbers are getting big right
Thank you might just be like numerical instability of the DLT. I
Swear orb slam does it the other way like I've read the code not this face. Is that ok fine
Who might argue with what works
Looks great look about beautiful. Look at that beautiful math. I love that map so nice
All right guys it's so fine points
Do in
I don't want that exits
Like an that one just it's weird
Use different sizes and colors for quaternions. I promise you are in
Pretty good
Hire you are you good do know things I
tell you the interviews for comma are basically is sit you down and I ask you questions and know things and
That if you don't know things I mean
That's okay to not know things the first time I don't like tell you something and then when I bring it up again ten minutes
Later, like no like did you learn?
It kicks my buggy code man submit a FOIA request I
Fix the bug man. What are you talking about? This isn't funny anymore. I mean there's improvements
Like we may both good bugs sure this likes
Alright we try it on Ohio. Let's try it in, Ohio
Ohio is always a great test
That's not right I just think go that way it goes the other way I stopped at battle I oh
Yeah
The wrong initialization is a common problem in the knock door slam
Yeah map, Ohio, bro
No, I don't care how old you are no one gets any special treatment I don't care
No, I came from difficult circumstances all I'm young. Oh
My dog. No, I don't care for your dog, but can you program that's what matters do you know? Thanks
This is the best I've ever seen Ohio work
What
quaternions, bro
Are you kind of music
See I don't see any quaternions on the sign though, it's that's a pretty good map of Ohio if I've ever seen one I
Found this video on YouTube. It's a video of some guy driving to, Ohio
Looks pretty good to me. Let it map Ohio for a bit more
When I hired me at 17, yeah, I probably would he's pretty good. Oh
And I wouldn't let him like code things
He's a quality shit, this is best map Ohio I've ever seen just putting that out there this is a pretty good, Ohio
Remember when we were at that Burger King with the Burger King signs right there right there it says like whopper eat whopper
More the green circles called they called it warm features
They're not good tourney opens prowl
It only gets a little slower
Switch
SiC Mapple, Ohio
Can you map in real time it's slightly Daffy far for real time. This one's almost slow down. All right stop
So uniting new points, I don't know I don't know why it slow
Yeah, it's a little slow if I tell me about flame may you know, we'll do tomorrow we'll profile
Tomorrow we'll focus entirely on speak. How about that? Sound good?
Tomorrow that's my promise to you guys. Well know we'll see what time I get home tonight
But I will try to do that tomorrow
Reconstruct surfaces from the points whatever you hear by that I have some local window, right?
Those sites like you can see it right there beautiful. Look at them traffic lights like you say went down the map
Map Ohio's like now we know we're alive great slam
So tomorrow we'll work on speed and
Then the day after that will work. We'll make the visualizer better
We'll actually have it like take some texture from the image of the stuff instead of just a point color
We're gonna make a turn a turn you'd be cool. Oh
No, maybe that's know some people in Ohio though when I was there like once I hadn't seen many people make turns
And you guys know there's only four words to so much better than other backwards
I'm not reconstructing surfaces office. So annoying little texture on the road
I'm not writing. This is feature slam. It's not that slam
No, I mean maybe we can start to add some leg maybe we can start to make it more dense
Um, but I think a focus on speed first, let's figure out why it's slow like why is it slow right now, I don't know
That's because I was probably cause it's true all I know why it's slow
It's because it's searching by projection things that are behind it
Yeah
Search by projection less
Right because we're actually searching by projection we're searching every frame
We're searching every point in the map to see if that's visible from my frame. You don't have to do that
I don't think that at all
Okay, so we can search by projection less stupidly that's gonna give us speed because like it's fast at first then it just gets slow
Okay, so we will roam file with flame
Search projection less stupidly because I think all the time right not yet is being spent on the search by projection
No, why does optimizing as always our stuff what's a big map of Ohio
Do you guys remember how this used to work remember how bad it used to think?
Ah, let's brew it off this is pretty soft. Okay Wow, it's Inger the second of frame
You see even pose maybe we can yeah, don't add all
Points to
Pose at least
Yeah, so we don't say that all the points out relation graph or pose cuz I propose optimizers taking time
Well, yeah, I mean so we can look into work
So I was doing this like clever thing where they like keep track of like which frames are likely the points to be found in
We can do the same thing
Well good look that's your jacking those points so good
Well, that's a lot of this a lot of features. Are that cinema?
Oh, yeah search by projection quality that you can't do that with or begin search by projection
a bomb at cinema
Alright so it can scale better with that
Down sample or points that are super close together. I already do that
I don't think you want you want you want to make the map less dense? I don't think we want to do that
Like I don't think that's the problem we're not getting look we're not getting that many matches
I'm actually printing out that I'm a matches for getting somebody's might just be a lot of matches but
Yeah, I mean, I think the problem is just the work of the love-u-lator they go bad look at that cinema
Use a higher resolution video there's a good drive through, New York
What's the license on us
It's long, hey, I'm happy to try a different video, but there's a few things that it can have
So this might have cuts the can of cuts it has to be Creative Commons license that it has to be relatively short
However, this doesn't have cots. Oh
Man but like this is a busy environment
Which is gonna make
Geo hot doesn't do shit, he's dead. My name is punk Reese I coach slam on the internet
And then I want to push on the density of his slant
All right
Like I wanted to after you get this to work what I really want to happen because I want this to do like a dense
surfing
I want to do like dense surface reconstruction. So it's like a super dense slam
What's the license on it, is it long enough that's too long
I mean like a two-minute Creative Commons license video and we could try it right now
We're gonna work at 10 today a shower still 200
Yeah, let's listen to sell out by real big fish, yeah
Spotify has a great song
Turn the radio off 96 bro ahead of their time
Dan twitch copyright strikes
The points are brutally guns here
Yeah, someone post a video in chat post a video in Chapel Thai slam on
That solid map right there, come on guys, give me a video
Why my type on this keyboard for this screen
Yo guys remember when we were at bugger King Ricky's all way back here
Can I slice them I guess I could
What
Control
Gonna give me a real video
We should be able to map Ohio in a reasonable time about this is unreasonably slow
Fast and slam. Well, like work Slim's like using threads and stuff which is kind of cheating
We're at density dance
Gap yeah, I guess I see
All right, fine I'll do it with you guys
I
Watched chess minions bear sits next to guy
Should you do this line?
There's too much motion
Come on bear I'm waiting for you
Creative commons standard youtube license
Creative Commons is better
Our Tony was gonna sit in the chair. Oh, that's a letdown
Ooh the immortal work left that looks do they get to watch I
Thought the bear was gonna sit in the chair, okay. I'm just I'm left out
Hi, this looks pretty good no
The embarrass how bad I am
On my media, oh, oh that's a lofty that's a lofty way to describe what that is media
No, you got a belches
Well, I'm not patient enough to play like long time control games. I'm better a long time control games. I
Played 10 minute
All right. Oh, we got 44 people right? Let's let's watch see if we find a short NYC driving video short
Five minutes of driving in New York City. Okay, and it's a oh
I love that fake news tow. Look at that. It's not five minutes
All right, so that guy yup. Just that was the red light. I'm sure yep. Good job, bro
Watch this at high speed
This is a good video
Well that got ya yeah, I've got a nice nice your turn bro
All right, well it's gonna detect all the features on that shit up and then this gets like sped up weird way, okay
So good. That's these are good things for a slam to the fact that this one looks good
This is too long. It's gonna take the wall
We'll try this one video and then we're out
Um download one moment please. We're going we're going with the dual pronged attack. Yeah
Wow, that's a long video damn you got stuck in a lot of traffic, bro
What
Don't do speedy
YouTube like break this stuff
Well convert I oh oh, okay is this one gonna work
Whose terrible this isn't that Creative Commons. Yeah it is
Striped video quality
Come on bro. Oh my Adobe Flash is out of date. Oh, that's great. Oh, oh, thanks Oh
Starting conversion. Oh, that's like quality start. Yeah zero. Oh,
Look look this is exciting
Use that oh that's nice like github downloader I trust that more
NES hosts on github. I trust wait. What is this shit? I
Hope it runs on my computer. Oh, that's sketch. Oh
Yeah, oh they got this we got this we got this is 100% 100% bro
But my ohio map is still being made
So good
Failed oh
Well now yep flash, okay, this is a scam
It's just a scam
This is terrible, I'm gonna know my URL once
It's gonna work
We have not authorized save video comm
Should I just get youtube-dl
Wait what okay
All right, what is this you took the other thing let's say
All right, whatever I'm sure it's not that sketchy
I'll the ad but I'll not turn off my ID blocker. I'll just install that I let's go
Yeah, I feel okay cool it was a YouTube D ality
Paste in the video name. Oh, sorry Wow. Okay. That was bad. I all controlled my
I'm tired this morning. I live in the closet
No, no, oh this looks like quality. Oh, yeah. Oh you tube DL you bros know what up?
Alright, you took the elbows coming through. Alright, what is it?
Videos I call the videos tests are tests iyc
Okay, so our beautiful map Ohio is still being made we are gonna control see this and let's try on NYC
Brand new video. I look at the quality look
At that quality, oh look at that building my focal length is clearly wrong
My focal point is wrong, that's why oh damn pretty good right I like this video cuz it has a turn
Youtube-dl we're gonna be using that in the future
Let's say, alright, let's make that turn let's go turn bro
All these feature they don't get a lot of features. It's a pretty nice map. I
Mean no, I shit. Let's massively skewed. I think my phone buoyant is wrong. Oh no, look what it is
Oh look at the barrel distortion on the website
But everything on the camera I look at a barrel barrel distortion Bros and of that
Let's see if it's gonna work on the turn
Won't work on the turn. I don't know. I don't know twitch slams not really been tested on turns before
He doesn't make a turn here, right
House is too slow. This is egregiously slow tomorrow speed guys. I
Know I'm getting worms on the texts, but it's good. It's rejecting them
Or it's saying are at infinity which I mean it's kind of stupid and it's gonna be annoying if we try to get rotation
Actually, they're uh, they're black. So it means that I've been used
Good a good twitch slam good twitch slam
Alright come on turn who's excited for the turn. Are you gonna turn here? I thought it turns here
Well, that's the guy who runs through the green light
Yeah, it only uses one car
The GPU I mean we can try using the GPU plus a little it's tomorrow
We'll profile and figure out what's slow we'll figure out a breakdown of the time
And we'll think about using the GPU. I don't know really GPU for like is it the optimizer? That's slow?
I just don't like the Python II crap. Yeah, I know. I'm sorry. I'm sorry
You guys I'm poor donate donate to my twitch stream so I could buy a new computer
Twitch lab hi. Come on make it turn its gonna turn bros. You think the turns gonna work?
Yeah, give it I give it a good 30% chance of working good
All right, you see how if we slowed down you feel like there was a lot of speed there and then we slow down
Slow and the old friends are really dense. So when I using or if slim uses keyframes, we're not using keyframing strategy
We're at you're just putting every frame in there
Which I kind of like I don't really like that giddyup keyframes because the new things not like optimized perfectly
Sure epsilon has good reasons for keyframes, but I don't really like them. Oh look. Look is that turning is that turning? What up?
I think it's turning. Oh
My god, this is horrendously slow. Yeah. Yeah could be I wasn't a twitch thought I'm gonna be a twitch stop
Smashed it up a pun. Yeah, hit that subscribe. You can't even subscribe. I don't know why I can't subscribe but apparently can't
Because I didn't like sign up to be a twitch
affiliate or whatever I
Don't know man, the world is full of scam you just seem so scammy like a twitch affiliate
It's still funny I agreed that a bit which stop don't get twitch not what do they do?
I should watch them twitch that themes and do what they do
And see if it works for me and when it doesn't work for me, I'll scream about sexism that always works. Oh
It's turning it's turning at a very slow. Oh my god. Okay. That was the worst turn I've ever seen
Well, I think it's a few things. I think my vocal is wrong
I mean that was a 90-degree turn and twitch slam turned a whole twenty degrees
Put my leg on my chair
I'm not do I look like any of those people man? I don't know why you think I'm anything like those people
Bill Gates Steve Jobs
Steve Wozniak, I'm not just not like those people man. I
Don't who that is, maybe I'm like that guy
Well, okay like it kind of made a turn alright
Well, we call that you know what this is undie bugga ball until we make trip slam fast. I
Know I know it's horrendous. Alright guys tomorrow
Today we fixed bugs
Tomorrow we make speed. What do you think? Look it made a good map until it made a turn
Oh, it's so good until it turned. I
Need to learn for the best dreamers, right if I like I'll keep eye mantle. Oh
Yeah, who's this twitch trending? Maybe a copyright strike for us. She's pretty
Can't buy things off her wish list
No, that's not my day I
Really don't get along with this girl don't click on every link you see I love clicking links browse
What Wow it's a nice chair I
Know
Oh, I I closed out the chat guys I closed out the chat I matki
Feud so sorry about that Matt key Q but I think that means that I am out for the day
That's it. That's a stream - I'll make things fast about mariachis
first and then we're going to decide if
we're going to do the first episode of
the cock
files the cock
files we going to see if we get viewers
wait are there viewers I don't know
let's look at the dashboard are there
viewers I don't see them
yet if there's no viewers there's no
point who am I talking I'm talking to
nobody we got zero
viewers got no viewers maybe we're on
such a weird time
is early in the morning for the West
Coast we got a person in the
chat oh we got some people welcome
welcome welcome welcome to the cock
files am I lagging if I'm lagging I
don't know what to
say nobody's here just want to no no no
no no it's no ads today no ads today
we're doing real shit we're doing real
shit guys all right do you guys know
about Square to
two yo yo yo welcome welcome welcome so
we're going to start in Python because
you know everyone knows python right no
no no we're not doing flabber flabber is
little uh little
uh you
know little uh Flappy that's the word
I'm looking
for yes yes cock is cock is we love cock
um because cock lets you prove things so
okay let's say here's the question
right does there exist a p a q such that
the sare < TK of
two does that
work
right oh you did my driver monor
challenge that's good um oh we got some
shit ringing man loves cock that's true
the cock file okay so we have P / Q
equals of two um so now we can uh Square
these things I'm just going to square
both
sides all right so we have this
question is that true oh
wow guys I'm forgetting how to use Vim
because I've been using something else
um I'm just typing wrong Vim characters
so so no let's just multiply both sides
by Q *
Q I'm a little sick too so wow wow I
forget how to use Vim this is terrible
how do I go to the end of the line and
Vim I don't remember
wait I really I don't
remember oh it's a dollar sign I
remember all right we'll tell you what
we've been using in a minute we're going
to get there so um we have to ask this
question uh does there exist a p and a q
such that this is true um so you can see
obviously that P is greater than Q right
uh so if that's wow okay it's not right
obviously OB l p is greater than Q all
right we got to remember how to use Vim
sorry it's been a while um so we can say
while
one uh you know P equals
1 um for Q in range one comma
P um p+ one
here and then we
ask
um if p * p =
q q
break
uh all right so that's the wrong
folder over to Twitch
coock so is this program going to halt
[Music]
is this program going to
Halt who
knows who knows if this program halts
you guys know the halting
problem no I'm not taking a
survey does this program h it hasn't
halted yet um let's just sit here and
wait for a while and then we just know
that if this program halts then theun of
two is rational and if this program
doesn't halt then the square of two is
irrational
um wow I haven't used Vim in a long time
so I forget how to use
it using Vim is
fun
okay yeah we got a lot of viewers all
right
so guys the question does this program
halt is a great
question
um I'm just going to go over here in
this
t-o uh nope it didn't halt yet uh uhoh
so I don't know does it halt who knows
let's have to print some numbers out
make sure we're not doing anything too
stupid um
I can't type
sorry oh well okay there's bugs so first
we wrote a shitty program with bugs
because nobody can code and how come
nobody caught
that
um so we want to say p plus equals 1
here okay let's say who thinks it's
going to
Halt not P but Q where's my mistake I
don't
understand okay
well none of these look like the square
root of
two guys now of course if you studied
basic math it turns out that theun of
two is of course irrational and this
program's never going to Halt but the
problem with program that are never
going to Halt is how do you show that
how can you show that a program won't
halt so we can of course search for
square OT two is
irrational and there's a basic proof
everybody who
studied this
knows everybody who studied a little bit
of math should know this
proof right so of course this program is
never going to Al but unfortunately I
coded it in Python now how do you prove
that a Python program won't
halt well you kind of
can't so that's why we're going to have
to code in cock welcome to the first
episode of the cock files okay this will
never halt because here's the
proof we're going to prove that this is
never going to Halt so what I've of
course been using instead of Vim I'm on
no drugs today guys some days I'm on
drugs and I tell you when I'm on drugs
today I'm not on
drugs for cock we use emac so we can use
proof General the cock Files episode one
all
right so remember what we're trying to
prove here p over Q in this case we're
just going to say is not equal to theare
otk of two right because we're trying to
prove that it's
irrational so we'll do that same
multiplying that I did back then I'm
just squaring both sides
uh so I Square both sides and then I'll
just multiply out the q's so we're left
with P * p is not equal to Q time is for
* Q * Q
right
so I know I know you always think I'm on
drugs you know sometime I'm on drugs and
I'll tell you when I'm on drugs but I'm
not on
drugs uh you know it's it's being an
adult now we do less drugs and we used
though so theorem Square < TK of two is
irrational
uh a simple way to State this might just
be for all p inet
q
inet
um oh okay actually that's the wrong
Syntax for all PQ and that so for all
p's and q's we want to show P *
p is not equal to Q *
Q let's go
proof okay so here's the statement right
here for all p and Q and that P * p is
not equal to 2 * 2 so you guys agree
that if I if I prove
that
um then the square of twos are rational
do we agree do we agree that if we can
prove this then the square root of two
is IR irrational are you guys paying
attention to what I'm doing or you just
talking bullshit you guys talking
bullshit in
chat the halting problem exists for
taring machines with infinite tape but
like this program okay fine not not run
out of memory is is this condition ever
reached in this program is the question
right we can't talk about it because
it's python but we can talk about it in
cock and that's why we're on the cock I
hate the people who ask why where my
moderators from now on everyone who asks
why gets that's the stupidest question
I've ever heard so you got a time out
all right no we don't have any weed um
we're not a state with legal weed right
now unfortunately unfortunately so we'll
do intros so you see what interest did
down here this down here is what we're
trying to
prove
um
so let's so we can do this set printing
all which will do which will like break
this stuff out for you just like wres it
so remember that the way the numbers are
actually represented the natural numbers
is with piano arithmetic so you can see
this successor successor o is actually
the two q and Q we're doing multiples so
let's unfold the knot here and you can
see that this statement here is a qu
well this statement here is equivalent
to the equals implies false and now we
can do an intros equals and now we get
this up in the goal and what we're
trying to show is a contradiction which
is kind of similar to this because we're
doing a proof by contradiction
right um no you only get mods if you're
a subscriber if you're not a subscriber
I would never even think of making you a
mod okay so how does this proof
work assume the2 is rational all right
so we're doing that we're assuming that
this is a true equation it can be
expressed as a rational fraction of the
Form B over a where A and B are two
relatively prime integers Okay so we've
we've effectively done that since 2 a is
even b^2 must be even and since b^ s is
even so must B let b equal 2 C and then
they they plug that in and they Square
both sides however two even numbers
cannot be relatively prime so we're not
going to use uh this relatively prime
thing this is actually I don't know how
to express that in cock but I do know
how to express
induction so um as this thing called I
think it's well founded
induction uh and with well-founded
induction you can use for Ma's method of
infinite descent and we'll get into what
this is in a minute um proof by infinite
descent
okay uh we'll get to when we have to use
that in a minute but let's go a little
bit further with this so first thing we
have to prove we want to show that Q is
even so let's just assert that fact nat.
even
Q oh nat. even doesn't like
that um nat. even Q has Type bu so
assert Nat even Q equals true Okay so so
we want to show that that's well no
actually I think it's easier first to
show that P is
even
okay so how can we show that P is even
well
first this stuff's
hard this stuff's hard
okay let's first prove
that that's true that seems pretty
obvious
right so we can
rewrite uh to the left of EQ which is
just going to change that into
that um simple that's
bullshit
um have we assumed that root2 is
rational well yeah I mean we kind of did
that here right so we we assumed it was
we we did this unfold not is our proof
by contradiction
um but now we're trying to prove
that all
right um maybe let's just uh we can
obviously do that
right
useless useless okay so this should be
an obvious fact to prove
right because you see why it's even
right it has a two times in
uh let's try that let's try it up
here okay
useless so now we get to the glories of
reading the cock standard
Library so let's load up Sublime here
and I actually already have the cock
standard Library up because I've been
playing with cock for other various
things oh God
it's lag
no how does it
lag
unbelievable if I paid money for this
I'd be upset all
right oh I think that I lost the chat
too I have the chat okay buddy I have
the chat here on my phone okay so so
let's look through here not that that's
not what I want to do I want to do here
find even let's look for
even
um a even I don't actually think this is
the same even so we can check nat.
even it tells me okay so it's a function
which mats it Maps a nap Nat to a
bull but there's also this Capital even
so I can't use that maybe we have to
import even let
require
import ari.
even the reference even was
not all right let's go on the web cock
even cock Ori even
it's using inductive definitions of even
okay so we don't really need equals true
there so okay we're just trying to prove
that that's even we'll do the rewrite
there
now okay it's
inductive I think we're going to see
what's
easier um so this one has to be equal
true because that's a Boolean
predicate uh
so you see in this assert where we're
just working on this this sub goal
here the proof is focused but it cannot
be unfocused this way yes CU I did not
finish proving
it um unfold n. even oh that's pretty
good of course it turned it into this
stupid crap
okay let's start with a
Lemma
LMA x *
2 or two time x 2 * X or x * 2 is
even for all X in
that oh now I'm using Vim shortcuts
um X okay nat. even 2 * x equals equals
true okay you guys all believe that
statement
right you guys believe that two times
something is even
right uh
intros unfold n. even
um plus X
+0 Omega no Omega is not oh I have to
import Omega so Omega is this like
magical cock thing that uses presburger
arithmetic cock.
Omega Omega we love Omega guys we
definitely are going to need some omega
require import Omega remember the Omega
13 from Star Trek
Voyager Omega Omega can't solve this
system so unfortunately Omega is not
going to help us out here
but okay so where are we well I know a
way we can prove this can we prove this
by like induction or something I don't
know let's try induction on
X okay so first we have to show that
zero is is even and that's true so
whenever you have true equals true you
can just use
reflexivity that see this seems good all
this seems good guys okay and we have to
get rid of these stupid plus
zeros and let's actually call it 2 * X
is
even okay so I think we can find the
proof or we could actually just prove
it obviously like X Plus 0 is just X
there's ways to like search for this
stuff properly in COA but you
know I'm not that good at cock I'm much
better at python who misses python
okay so we have to find it's just
something that says like n plus Z or
something yeah here we go add Zer R so I
think I can just say
apply oh no I want to do
rewrite nat. add z r oh yeah that's good
that's good we got the right shit all
right I'm going to rewrite it in ihx
okay okay we're getting somewhere we're
getting somewhere guys take a look who's
excited about
this yeah I know right it doesn't look
anything like python it's
cock
um okay so you can see here that if not
even is true not even of the successors
is
true so maybe we want to destruct Nat
even no I think that's right I think we
want to do that unfold that
even yeah this seems
good okay um let's try
simplify oh well this did something
I don't even know about that no no no no
this isn't what we want we really want
to get the successors together
um okay
so we can
replace SX plus
SX
with SS X Plus X oh who's excited about
this I think that's right okay cool now
simple uh apply the induction hypothesis
guys remember your induction right so
just break this out like that
okay yeah okay we finished that goal now
we just have to show
this
apply. add
commutative
rewrite oh that's crappy uh we want to
do symmetry which should flip those
things rewrite no okay
useless well it's very clearly true
right oh yeah okay now aha okay we want
to do simplify then we want to apply
nat. add
commutative or
rewrite but we want to okay I mean we
can rewrite this like this I
think there we go and now we simplify
that and now we just do reflexivity oh
yeah okay so we just Pro 2 * X is even
congratulations guys we're math geniuses
here so to be clear about what we
proved we proved that everything 2 * X
is
even so now we can come back to this
one
um before we do the simplify we can just
say apply 2 * X is or
well that's CU of shitty commutative
stuff um we can put the times two over
here it's the same
thing no but that didn't even help us we
have to put parentheses around these uh
so multiplication is associative so
that's the rule right remember who
remembers your associative commu and
your transitives come on guys who
remembers who remembers
algebras all right so let's rewrite this
with nat. MTT
assac um
molak no okay we want to do the other
thing aha now the the twos are in
parentheses and now we can apply that
okay great great great great great okay
just just delete that
okay now we have a new goal that says
Nat even P * P equals true so let's make
another
Lemma uh n okay so we're going to
say
square of square even is even for all
X and
Nat uh x x x no nat. even x x
x uh implies nat. even X do we believe
that um equals true implies not. even
xals
true typ bull it's expected to have type
Nat um oh I think I just got to put that
in parentheses
actually okay do we believe that
statement guys who who believes that
statement who believes as
statement do you guys Believe
It Believe
who
believes is my chat
broken oh I'm watching myself oh this is
stupid the cock files is my chat broken
oh you believe oh
good anybody anybody who talks about the
statement's not true you don't believe
it why not can anyone come up with a
counter
example if a number yeah so an even
times an even equals an even right CU
where you get not even shit out of
that and even times an
odd it's also so even lots of shit's
even
man no I didn't ask if the audio and
video were broken I asked if you guys
believe this all right let's try it it's
it's got to be true seems pretty true to
me I think we can prove it so let's do
intros um okay
so we have Dish statement and we're
trying to prove dish statement let's use
our favorite tactic of
induction okay well everyone kind of
already just knows that so we can just
simple and then reflexivity in fact we
don't even need that simple reflexivity
does a simple reflexivity is just when
you have like x equal x and that's just
the reflexive equal property okay
so oh this is
usel this is just not true
is it
laggy okay we'll lower in the bit
rate bit R going
down x = 2 *
y
yeah so that's actually that's a good
point if not even X is true and I think
we're going to need this proof
anyway then that means there exists a k
so LMA um even exists so let's just
let's just write this now for all
xnn even X
implies uh exists K such that 2 * k
equals x
right was
true um
so I think there's actually a neat way I
think there's like almost a standard
Library function which just does this um
yeah yeah so we can just
this even
equiv
require import
even he anybody who's chilling for their
shitty startup get the hell out of my
chat nobody wants you
here don't chill for your startup in my
chat let's apply even
equiv uh
in
h this is
useless equivalence with predicate n.
even yeah okay let's get rid of these
end TRS and let's just change it to
this I think this is fine I mean it's
just less to write it's it's a predicate
instead of a Boolean
just cleaning up the code a
little I think this works the
same oh no it doesn't work the same okay
never mind take it all back take it all
back take it all back
n. even
X
true it's not even what we want where is
the Constructor for nat. even
it's the
stupid oh wow look at
this oh this just has facts about even
real even facts
man parity bin up all this stuff's cool
does this have
even oh here we go look look at the
definition of even right here so if we
can get it to be that even ah even spec
is what we want to use
okay so let's
apply nat. even speec in
h oh yes and now we have Nat even and
now we can unfold nat.
even no that's not what we want but I
thought nat. even was exactly what we
wanted definition even N means there
exists an m is that that
even let's get rid of this I don't want
that oh did I just not do unfold. even
in
h aha boom boom okay destruct
H
exists
x0 and now I just do
Symmetry and uh apply
H boom we've just proved even means
there exists some shit that's
good q e
d thank you for the
bits okay so let's go back to where we
were trying to prove this shit by
induction but I think we did stupid
induction here I think actually before
we do the induction we want to
uh apply even
exists in h yes destruct
H
okay so
now to * x0 = x * X okay this might
still might not even be what we
want but I think even exist is going to
be useful anyway later we're going to
need it later um
okay let's go back to induction on
X
net did I even write this the right way
or did I write it
backwards if
if not even of the square is
true but this is never true you see the
problem
like this isn't
correct because this isn't
even cuz we just took the successor to
it you see the
problem who sees the
problem are people complaining about the
stream quality
more I dropped so much frames where' my
frames
go this is pathetically
bad should we try to find a ethernet
like a
wire see what we got
here oh look what I found just pulled it
right out sword from the stone kind of
shit like that right here too all right
let's try
this maybe this is going to fix the
stream we got a little ethernet
doohickey here going to plug this guy
in oh this going to does need a driver
probably needs a
driver hate
driver no it didn't show
up this needs a driver
oh my
God okay I found the
driver oh it has a 1.4 megabyte
installation guide and then a short it's
going to make me reboot guys it's going
to make me reboot I know it already I
know it already please don't make me
reboot please please no
reboots
oh should we do it for the love of the
stream should we do
it let's save this
file no no we're going to die you don't
have these extensions signed what
allow great great I just put sketchy
shit into my
Kel okay all right we're rebooting guys
don't
worry don't worry we're
rebooting I'm going to go back to this
episode episode one of the cock files
oh okay well I'm going all right we're
we're rebooting uh yeah all right no
less than a minute guys I'll less than a
minute who's excited who's who's
excited oh my
God this is taking
forever I got to update the preboot
volume uh do we have any other ethernet
of
let me look
around
no no other adaps only that
one oh oh finished oh wow wow who's
excited all right
restart uh sure move to
trash yeah know we need the x file SN
board we'll get that up we'll get that
up uh OBS is currently active
why did it name my computer something
stupid new host
2 what did name my computer something
stupid
now I'm deeply upset about this okay
whatever you know you can't win
everything all right is it not laggy
anymore guys can we put the bandwidth
back
up let's put the bandwidth back up
this computer this should be a really
good internet it's a good internet it's
not there no
shit all right so where are we let's go
back into emac here and let's look at
cock oh guys it's going to get hard from
here this is the easy stuff oh wait till
we have to do well formed induction I
don't don't know if we can do that
that's all going to be
hard okay Sublime got the cock up here
all right we were trying to prove that
square even is even but we were deeply
upset
here the stream is much better now who
wants to see my SpaceX sweatshirt I
don't know where it went it's gone can't
see the Space X S here because it's gone
all
right so this unfortunately doesn't look
like something we can
prove because I don't think it's true
like we need double successor
here
well okay so let's apply even
exists
uh wait huh
rewrite even
exists I know this doesn't
work I'd have to okay if I wanted to do
that I can I can only apply it in h
because it's an implies
right 2K = x * X that's
useless uh I know what we have to
do let's try apply noteven spec
and then unfold not
even aha okay that's
better okay
um induction
M no it's doesn't work
H ban ban
him where are weird ass people trying to
text
me I don't know all
right where are
we there exists an
aminat such that
okay so the problem with exists is
like like that's not
right this might not even be what we
want you know what what if we just try
to prove
this this might actually be easier and
that's actually more generic do you see
what I mean right because if it's an odd
number squared it's going to be OD right
like 7 and
49 and this one we can do induction on
without it being
bullshit okay so
simple
reflexive oh what
up
um this looks
better
Omega oh sometime Omega just works guys
Omega is really good aha okay all right
I know how to prove
this think about
it this is equivalent well you know what
let's forget just saying it's equivalent
let's actually do
it replace S * x s * x with this is the
same as x * x + 2 * x + 1 right
um we can actually just go right to the
second sub goal and work on that
one yeah this looks true we can probably
just Omega
that stupid
Omega Mega should be able to solve
that I mean what what this is
effectively doing oh wait no this isn't
okay well Omega can't solve it because I
actually wrote it
wrong so SX * SX is the same as saying x
+
1 time x + 1
right so I know I did write it right CU
that equals x * x + 2 *
x +
1 right
[Music]
OMG this is not smart what you're doing
I'm leaving all right byebye brick n if
you're a subscriber I might listen but
no Omega doesn't
work who's upset about Omega I'm upset
about Omega
yeah it's Monday all right all right the
nonsubscribers you guys killed it for
everybody uh
congratulations uh that's it that's it
no more cock files um I was like should
I stream today I don't
know
um no you know what no I'm I'm kind of
done with twitch I'm kind of done with
twitch no no no no no like oh one okay a
couple something has to happen the the
level of the discourse in this chat is
extremely low um it's
stupid yeah I mean we might have to go
to a private stream you know what
subscribers only everybody else get
fucked can I do subscribers
only
uh yeah yeah but they don't subscribe so
you know what we're switch it to
subscribers only I don't know I don't
know if I can figure out how to use
twitch enough to do that preferences no
count too
difficult
um oh I guess I could switch
chat no guys you
know I just fuck around when I say like
I'm poor and I need you to subscribe I
really don't need your $60 from twitch
it's just a funny character to play on
the
internet you know like here we were
going to do something we were going to
do something fun we were you know we we
were trying to prove something uh we
were trying to we were trying to prove
the square of two is IR rational it's
really a very simple proof you know like
you can look at the proof it's really
short um
but no I don't know what this bullshit
is but Square t to
irrational ah
yes um no but no it's
just no it's not look it's not about you
guys valuing me right like I'm not I'm
not saying like you guys should
appreciate me more that's not what I'm
looking for at all like I'm looking for
the level of of discourse to to be a bit
higher um
um no like like if you guys like this is
like basic shit like look at what I'm
writing here I'm writing literally
eighth grade
Algebra no no I don't need to be more
engag with the viewers if you guys
aren't going to watch this for what it
is then I'm just not going to do this
anymore like this is bullshit
I'm rich too I don't care I just fuck
around
um I would love I would love this is
basic shit I would love to see you try
to do
it I would love to see you try I would
love to see Go go download cock it's
open source it's free um and try to
prove that squit is IR
rational take math
guys this is eighth grade
Algebra way you try to prove that
there's an infinite number of primes
that one's a lot
harder no no ban that guy ban the PS4
guy ban him can we ban him where the
where are the mods can we ban him
this one should work with Omega right
that's literally the definition of
successor I don't
understand okay I think I can actually
just find
there got to be something that just
states that
right it's almost like the definition of
that's the definition of plus isn't it
or maybe it's just
cuz is it really
that it's literally reflexive
now
fine okay um now who remembers the
distributive rule we got to use the
distributive
property I don't know I honestly I hope
the people on YouTube are a lot better
than than than some of you guys you know
like I hope the people who watch this
stuff later on
YouTube no I don't care about what
license it's distributed under all right
so those are those are Boolean
things no
here this m ad distributive
R
rewrite do Nat
dot all right so now we've applied the
distributive property
um I don't even know what that
means but okay so let's apply the
distributive property uh the left
distributive property as well
okay
cool um let's rewrite with ADD
associative and now those x * 1's can go
away can Omega Omega no
Omega you guys haven't seen the magic of
Omega
yet I thought about doing Advent of code
um I don't know I don't really feel like
it so where's the rule that says times
one we learn this useless crap okay we
do it because it's
useless if it was useful or flashy we
wouldn't do it and if you don't like
what we're streaming fuck off and leave
the stream that's
right okay so we want to find stuff
about mle one
um CU all of this is just like one times
anything is
just um okay so
let's this doesn't look easy to prove
Napoleon solo n could someone ban that
guy he pisses me
off
M
this rewrite n
times rep rewrite there we
go
cool
okay
um there's a few ways we can go from
this we we can make it Boolean I think
what we probably want to show
now
uh we can do it as an assertion or we
can do it as a
we want to write a Lema basically that
says uh even is xor right for x y and
Nat Nat even x + y equals was it X or B
Nat even X not even Y and is it XR or is
it not XR it might be not xor hang
on so like 2 + 2 would be One X or so
that'd be
true those two be true so it's not X or
B and not b x or B
right do
that it is not B isn't it
not
not that
not uh we want to require
bull oh neby it's negb
that's
right
okay so you know what let's just assume
that we've already proven that
we'll come back and we'll fill that in
later admit
it um so we can apply even as xor down
here um okay so what we want to
do is we want to use the associative
property
reite that and want to
rewrite now we can apply even is
XR um maybe
[Music]
repeat apply even as
XR or rewrite even as XR ah there we
go repeat rewrite even as X or maybe
even oh cool all
right
so aha now now we're getting somewhere
guys um so we know neg even is one we
know that's
false I hate when it does
that and we can repeat rewrite we can re
rewrite use the induction hypothesis
right so let's write to that side of the
induction
hypothesis um now when you have exor of
two things that are identical
well it's not even really what we want
but we'll get there in a minute is
simple going to work
here not
yet okay whenever you have let's let's
let's bring up the facts about
exor uh so we know that this is actually
false
um
replace not even one with
false um that's trivially
true it's bu
here what
oh
weite okay cool so we got rid of
that now I think we have something about
xor with itself yes xor nil
potent
um if I simple that okay fine
[Music]
uh I don't I don't like that it does
that match
thing
replace neg B
false what's the negtive false is true
and that's
trivial
cool um and now we want to apply the
exor true
right bu
do okay and now there's a rule about the
negs canceling
out nby involutive
cool um we can rewrite using the
induction hypothesis
too okay now we're left with a pretty
straightforward
fact right so the negative of a
number is the all right so now let's
just do induction on x
um
simple
flexibity wait
what stupid
rules I think I can just destruct X I
think it's even easier than that
I don't need the induction hypothesis
anymore okay we just have to prove this
now um
stupid this didn't help at
all no okay we definitely do need
induction but we need we can clear the
old induction
hypothesis yeah this is right
[Music]
uh
fn.
even Al so how do I use the definition
of even to show
this this does seem kind of roundabout
yeah there probably should be a faster
way to do this right
let's okay all right you want to try to
just use the definition of even let's
try
it we try it on both and we actually
only need an implies here I mean we had
it but it was it was complicated you're
right we could try something simpler
well we were close so let's just leave
this one for
now and let's try let's try a simpler
one we really only need the implies we
don't need the equals
sh
no but you see the problem again we're
left with
this so what what do we show
there the the problem we we can't oh
okay you know what may maybe we can do
this again
all right now this is uh let's destruct
H explain to me what I do
here no we're all past we're way past
that
um like I have to find an M that that
exists for and I'm not really sure how
to do that it's easier if I was proving
it the other way the other way is
Trivial right to show that a a
number like then I could just plug in
what it is but I don't know what I do
here there probably is a simpler way to
do this but like I'm trying to use the
definition of even and that's what I
have
by the way thank you for actually
contributing something useful um unlike
90% of the garbage
chat it it does see it does seem like
I'm writing like way too much code just
to show that the square of an even
number is
even um
a lot more people need to be
banned oh wait okay so I first first
thing we can do here is we
can rewrite this way using the induction
hypothesis and then we can do negb
involutive
okay now we're left with that that
should be easy
perfect okay there's the
proof like this code is garbage but it
kind of doesn't matter because it's not
like like it has like performance issues
or anything we're just proving that it's
correct and this is a correct proof cock
won't allow anything to be
not uh correct
now the chat's just garbage you know you
guys want to ruin your own chat like
that's
fine okay so now let's assert nat. even
P equals
true and we can just apply Square even
is even to hypothesis
oh now we want to rewrite because I did
the
equality we don't need the parentheses
here okay cool so now we've shown that P
is even but now we can apply um even
exists time 2 I think is that what I
called it
no even
exists uh apply even exist in age
zero cool now I can destruct AG
zero
um well actually I want to distruct h0
as uh we'll call it P Prime
HP Prime okay cool now we can
rewrite EQ
uh Jimmy Bullard you're a mod let me
figure out how to make you a mod
congratulations
and you knew the evens so
congratulations you're a mod too enjoy
your moderators even though you're not a
subscriber you said something
intelligent so congratulations you're a
moderator rewrite HP Prime in
EQ it's not what I
wanted um now we want to rewrite to this
way and let's do
repeat I already did repeat that's
weird
cool
okay
um well so we can
just
replace
this
with we just want to say it's 2 * P
Prime * P Prime = Q * Q right like you
see why that's true in Q um let's do the
second sub goal first so we don't
forget that should just be
Omega okay Omega is really the most
useless
garbage oh well no okay all right you
see why it's annoying
because I'm trying to prove that
equality I don't know what equality of
equality even
means why can't Omega prove
this
rewrite n.
mck then
Omega usel
Omega
um okay let's just try asserting this
fact that might work
better
Omega
Mega you see what that's true right you
just cancel the twos
out Doro you've been around a while
aren't you a
mod
mod ban more people
rewrite
n.q
that um
rewrite na.com
n no that's not what I wanted can Omega
solve this
yet stupid
Oma do I do I really have to assert this
stupid fact
LMA cancel
two for all X in
net for all XY and that 2 *
x = 2 * y
implies x = y
can Omega solve this come on
Omega oh Omega did something look at
that one finally Omega did
something proved we can cancel
twos all right so I can go down here now
I won't even need
this I don't even need the assertion I
think I can just make it work apply
cancel to in
EQ
what
oh
well for
well that broke something
mea stupid garbage
uhuh that's what I
want now now we can apply cancel to any
Q got to get your parentheses
correct okay cool the two are canceled
out thank you for
subscribing
[Music]
um well all right so now what we want to
do is we want to do the whole thing
again for
Q um reply no wew write
n
mq
rewrite
EQ how did we write it before up here no
okay we want to do the other
thing
um there we go perfect that's actually
exactly what I wanted okay so now we've
gotten to the point in the proof where
we can assert that
um I got to zoom out a little bit here
well you know what let's just go big
here
um that's not going to help me got to
zoom out a little bit because we're
going to we're going to basically copy
and paste that same
proof that and we're going to use it for
Q
the fuck is aelst language you're not a
moderator anymore I don't know what that
is you're unmodded I don't know what the
hell that
is but everybody's banned who asks
stupid
questions no YY cracker you can't be a
mod how many people are watching this
bullshit 146 huh not
bad you got to be a in these
days otherwise everything goes to
shit okay let's assert nat.
even wait what happened to my good old
fact
here oh I broke it down into even exists
let clear
H yeah we don't need that okay cool so
that's what we're left with we actually
also want to assert like something like
neq zq or
something so we can keep it
around just do keep
Prim so we can keep EQ around when we
destroy
it cool
oh we actually have to say one other
little thing in this
proof If Q is not equal to zero then
that's
true
right um
if we forget to say
that all right we're going to do the
same shit
here
weite outside
Q
apply 2 * X is even oh we have to write
rewrite that mck as
well assert
n
even Q true
um it's the same proof as up here
right so rewrite Square even is even in
h and then apply
H sorry I don't know emac well enough to
copy and
paste okay now apply even exists in
h0 um destruct h0
[Music]
as Q Prime HQ
Prime cool
rewrite HQ
Prime q no because we have to rewrite
the other
way Perfect all right now we just got to
do all that commi shit
again I think I do know how to actually
copy and paste it's this y
uh okay well that's
great why even exist in Z
so getting rid of
that rewrite Nal common Q um symmetry
thank
you wait did it cancel two not
work no it did okay
simple
um that's what I want okay
cool okay let's just do Symmetry and EQ
again so I'm left with the real facts I
want okay do you see what we've proven
now
um so interesting we can make another
assertion here
too Q is greater than Q
Prime
whoops don't need any of this crap
anymore
right um this one can just don't
mea
cool so what are we proven guys
uh we can actually clear HP and hpq we
don't need those
anymore that's
it that should be enough cuz look at
what we've
proven who knows what we do next I told
you what it was before if nobody
remembers we'll just we'll just call it
off here I do I still have any admitted
in here
I have admitted so let's go back okay
yeah we got to actually prove this one
yeah we we we ditched the proof of even
his exor so let's prove that
one um
who knows how to prove
this maybe some kind of
induction induction on
X maybe if not even
why Omega
look at what's written there it's
obviously true that's
bullshit let's just admit for now
okay stupid matches isn't
it
um all right can someone else prove that
one that one should be easy enough
someone else can
prove I wish this one
worked and then
this you guys know what we have to do
here thank you dormo for being a
mod apply the definition of evenness can
I apply the definition of evenness there
is that is that a real
solution I don't think so
the problem is with the definition of
evenness if I just try to apply the
definition of
evenness suppose X is even then there
exists okay suppose X is even then there
exists y such that 2 yal
x now x + 1 = 2 y + 1 hence x + 1 is
OD that's an easy thing to prove
Napoleon solo nobody's looking for
honest feedback here
banned it's not that nobody's looking
for honest feedback it's not that one
thing he said he's just been saying
bullshit all
night um
suppose X is even
hence
wait this one is odd now I mean that
doesn't that doesn't solve all the
cases
um I mean this one I I don't know what
to do about this one
what like there should be a way I can
just do like case of not even Y is that
going to work there's only two cases
right ah yeah here we go perfect wow
that actually just did exactly what I
wanted um we can just do if I just do
semicolon reflexivity here okay who
knows what that syntax
does so the case breaks it down and then
I could for each bullet point right
reflexivity and reflexivity
to write it for this bull Point as
well but I can just do semicolon and
that'll apply it to all sub goals so
that's pretty
nice and then we don't need to do an
admit there
anymore and this one's a little bit
harder did I did I write the theorem
no I didn't write the theorem do I need
that as a theorem we could say
[Music]
LMA
even next even next even is odd which
says for all X and Nat nat. even x
equals negb n. even x uh success for
X right
all right I know you guys are like you
can't really use the definition of even
here because you have to prove it for
odd as
well so let's we'll try that case thing
again I think it might
work no no this one needs induction
yeah no we want to rewrite this side
yeah okay there we go
uh apply bu.
negb
involutive
what that reflexivity
now yes qbd
okay cool we proved
that uh oh no that was just part of it
now we have to apply that down
here oh and we
actually we really want to show is
this it's the same thing but it's just
written all
different
oh well
like we really want to take the neg of
both sides you know what I'm
saying
or okay we had a proof for
this this is not exact ly what I
want so you can't just apply it
here maybe I can apply it in the other
case I hate one of the
symol um yeah
well and we can apply in the induction
hypo
which is a little bit more
annoying rewrite
next yeah okay now we have
that and then rewrite next to even asard
in ruction
hypothesis let's make sure it does the
right one
no no no not that not that uh next even
is odd of nat even
X oh just X
right there we go
cool so now we just have to figure out
how to distribute out those
negs all right what I'd really like to
do is cancel the neg bees from both
sides I mean that should be easy to do
right neb and B negb
[Music]
involutive neb
symmetry no fix point
negb oh should just be able to do that
right
bu
dot should work right
if B equals neg
BB all right I have to copy and paste
all this
garbage tactic generated to sub goal
identical to the original
goal oh did I put the wrong one in
places yeah it is it's D Morgan's law
isn't it
kind of right no it's not demorgan
because there no or it's
exor okay I just want to cancel out the
neg
Beast okay fine we'll just write a
stupid LEL cancel neg
B for
all a b and bull is bull right
uh negb a equals neg b b implies a equal
B right
unable to unify false with
true
um well let's just first make sure it's
what we want
okay
good okay now we can distribute that
apply.
add uh no it's a sock in ihx is that
right we just want to distribute
that
successor yeah let's just add success
L um we can just apply that in the main
thing
what now we can rewrite to the left side
of the induction
hypothesis aha
okay now we'll just have to show that
those are equal and we're done with the
induction
hypothesis okay so we're left with
that um so this turns out to be useful
so let's prove
it make sure I didn't do anything stupid
okay we have neg a equals neg B we want
to show that a equals B you think the
stuff should be
trivial not not a equals a that's
true
um in lean booleans are not used yeah so
you can do this all with propositions as
well it's it's like the same I don't
know um um you the the the booleans and
the propositions can just be put into
perfect
correspondence not not a definitely
equals a so I I don't know how to use
that here
though
um it's not
case oh maybe just struck neg B
no well how do you apply neg to both
sides that's what I don't know how to
do if I knew how to apply neg to both
sides this would be a great great thing
let's try this
like b equals true in the current goal
case
a oh let's try
this no so we want to do
symmetry oh okay wait no
case a reflexive no it doesn't
work doesn't
work you canl replace the implies with
not
or well I mean that's effectively what
it's already
done oh look at this if NE B wait that
was the whole thing we were even trying
to show
here oh no I think I already got around
that never
mind what's this no fix point neg B
didn't like
that
apply I shouldn't just be guessing at
things this should be a very obvious
thing to prove neg a i
i let's try this NE be Sim well let's
see what destruct bull
means
discriminate destruct a oh okay I can
just destruct a okay okay okay this is
easier yeah this makes
sense okay okay okay okay okay
shown false equals neg
B true equals
B uh apply not true is false
not false is
true
symmetry aha okay now I can do intros
there was probably a much quicker way to
prove
this now I can
rewrite H with EQ or rewrite EQ in H
um simple in h false equals true apply
H actually maybe these ones can just be
Omega no Omega
sucks
Omega
oh Omega Omega sucks all right never
mind
we're so
close we've proven that false equals
true
guys uh oh yeah what if I destruct on B
here is what you're
saying before I even
simple I think you're right who said
that well I don't think I can destruct
on b instead of a I think I just have to
destruct on b as well ah okay now
reflexivity contrad okay okay okay okay
okay you might think this is
bad apply H oh
yeah all right we're getting somewhere
now all right we'll destruct on
B uh simple in
h symmetry apply
H and this one is just true oh we did it
oh yeah good job destruct B guy you are
bro well it doesn't matter that false is
not true as long as you've shown as long
as your hypothesis says false is true
it's
fine
okay where were we
now oh we have to factor out the negb
and exor but that should just be an
obvious fact about
exor see you y cracker thanks for
coming ah yeah this guy here apply bu oh
re
write bu. negb
xorb
reflexivity
okay all right we don't need this
proof let's save
this all right we're doing it guys we're
doing it we're up to 3K of
code we're doing
it who's doing it we're doing it
okay so I believe we have no more
admitted anywhere that's
good now we're
here who knows about infinite
descent who sees
why cock written a no camel
yeah who sees why this is true
what this basically proves
is given this there exists this such
that
this now we're going to have to try to
do some
magic so let's put this in a simpler
proof first theorem Square < TK to
infinite
descent uh so let's let's go over what
infinite descent is first this is just a
common here we go a proof by infinite
descent is a particular kind of proof by
contradiction that relies on the least
integer
principle so basically it's
this um there's also
I believe let's check this in Python
quickly I believe you can actually write
the square < TK of two as
like it's like 1 over
2 plus 1/
two right
plus right like you can do this
yeah we're trying to prove that the sare
root of two is
irrational so for all PQ and
that
where Q is not equal to zero there
exists if there exists
this that implies that there
exists a p
Prime and a q Prime let's call them PP
and QQ in that such
that PP * PP equal
Q uh
and QQ is less than Q
who believes
it so all that same proof should apply
and then at the bottom here we just say
exists p and
Q well exists P exists
Q split
let leave those there for
now apply
EQ Omega
3D
okay so let's check out the type of that
so for all PQ and nap where Q is not
equal to Q is not equal to zero implies
that P *
P basically if both of these things are
true I think we could just write that as
an end then there exists
a lesser solution but what's the problem
with
that
okay so now we have to figure out how to
do well formed induction in cock which I
don't really know if this is even
possible
but we can bring our little proof down
here uh till
W emac is
unusable okay so we have managed to
prove that
fact so to use that fact here we can
just say like
intros PQ
qz uh unfold
not uh intros
EQ now we can apply Square tk2 infinite
descent um
or I know how to do this
actually what is it
generalize yeah it's this
specialize
PQ or
intros
yeah and then
specialize
hpq there you
go apply H in q andz
distruct q
andz distrct
h
okay destruct
H look what we've proven guys
nothing because we have to do infinite
descent on this and none of this stuff
is remotely
infinite
a so we okay we're effectively back
where we were with that proof
but we can show that applies infinitely
many
times um okay so let's see well founded
induction in
cock I think we're going to have
to oh here we
go this doesn't look too bad
okay let's just try
it apply well founded
induction
on do we have that we
do oh we have to first show that it's
well found
Ed that's not that
type
okay okay we need to define the relation
oh this is hard this is
hard Cox FPS thank you for subscribing
okay so we can at least I think I see
how to prove it's well founded so you
see the type here so we could say
something like
definition
uh
[Music]
ltn p
qn p is less thank
you I want to find a function in cock is
that not
right
friends oh it's
this the reference P was not found in
the current
environment um oh I think it's like this
maybe
how do I find a function oh here here
are some
functions oh I just don't need
that okay
cool so now what we want to show is that
less than is well founded and actually
to use the proper terms we really just
want to say that this is q and Q Prime
yeah I know I'm using emac guys you know
there's really something wrong with you
when you've switched to
emac
uh
okay
theorem LT is well
founded and the theum
States just well founded ltat is that
right okay now how we prove this I don't
know okay once we show the relation is
well found let's just unfold well
founded I don't know about that all
right let's see where these things are
defined in this n Library
oh it looks like they're almost always
already proving it for
me less than is already well
founded
apply wait it's literally the same name
as mine too h
okay I don't know let's try to prove
it I don't know what a
means induction on
simple come
on intros
okay let's just assume we can prove it
well
founded so we have my function takes in
two things
okay for all propositions about that
type
oh oh but it only has one
type this
sucks
okay one way to fix this is to do Nat
crossnet do second here all right
that's going to be even
harder okay well I don't know how we're
going to prove that well founded yet
but let's just just say
okay oh but the function doesn't have
that all right let's let's you know what
let's just prove the induction we want
to
prove
theorem infinite
descent for all PQ and
N um we want to
say okay now we going to say something
about prop
too for all F in prop
let's look at well founded induction see
that complaining about
that r p in
prop for all PQ and
Nat that's not right
uh
oh
okay if we're all PQ and that if
say
F
fpq
implies for
all there exists P Prime Q Prime N I
think I call them PP and
QQ such that
f p PP
QQ imply
and QQ is less than Q
implies
false I believe that's infinite descent
right uh oh for all F in uh natn
cool okay so forget trying to apply well
found induction right there let's just
apply uh
apply infinite
descent to S < TK infinite descent
come back to all that crap
later but that is I I did do that right
right yeah for all there exists implies
false
enjoy reversing thank you for joining
thank you for making intelligent
commentary you don't like my shitty
integrated
webcam
okay let's just try that
oh
oh I don't know why can't unify
that may to rewrite I should be able to
apply it because it's just a false right
can I just apply infinite
descent what
do I need pen did I forget my
pen okay now it's unable to all right
well wait what why didn't inro Q work
there unfold not inq okay now apply
infinite
descent
um
stupid I don't know what if I should say
generalize infinite
descent okay that's something
um okay so
specialize Square < tk2 infinite
Descent Why
it is a prop isn't
it oh actually wait no this isn't even
right screw infinite descent will be
used in the
proof what we just want to do here is I
can just write like what's the inline
function stuff for cock
[Music]
fun
PQ
natat P * p = 2 * Q *
Q what's the inline function Syntax for
cock oh it says like
this uhuh okay this is
something this did something okay
specialize ID
PQ
oh apply EQ in
ID so okay um
H cool all right now for some reason it
got stupid like that but um I think I
can just simple an EQ and get the same
stupid good okay apply EQ and ID that's
right yeah um apply
EQ or
wait oh I have another sub goal okay
yeah this is
fine wait
no this is not fine
yes okay now is when I want to
apply yeah now I want to do the thing I
was doing
here generalize to infinite
descent I just apply
it Q is not equal to
zero we can do that one with uh apply Q
and
z and this I can just do
simple apply
EQ okay
cool okay Square t is irrational as
defined no I don't actually know hop the
the hot
stuff okay so if we can just prove
infinite descent now we're good
got to know your infinite the snack guys
you know fromma did that shit in the
1600s I got p
m
okay let's prove infinite descent once
we prove infinite descent we'll have
proved that the square root of two is
irrational and then we can conclude this
episode of the cock
files should we get an x file soundboard
let's get an x file soundboard
wait what no I want like the creepy
like what
quality all right we tried our best
order food we could order food oh that'd
be pretty
good okay we got to prove infinite
descent
guys it's well-founded induction
well so a few
problems so this is the r
function so first let's
generalize well founded induction
okay
intros
yeah
specialize
H the less than
thing
ltn
um which is expected to have type
type
understand oh no we have to put the type
in Nat cross
Nat the term Nat has Type set
NN NN
prop term natat has Type set
I'm supposed to have
tyn I don't to write that but I can just
write
that or I was being stupid back
there yeah can I just write can I just
write
this we're learning cock guys I'm not
that good at it yet
is that
right you're
fine still
works so
the term natat has Type set while it's
expected to have type
natat does anybody know what that means
I don't know what that means
oh hang
on it's expected to have type well
founded
R uh let's try
that okay cool
okay thank you for
subscribing maybe Omega will work yeah
wouldn't you love that right no Omega
can't solve this system
ah maybe Omega can solve this one oh
Omega is so
useless there's already some like less
than stuff
so actually PR sure we don't conflict
with no we won't conflict with names
it's fine
found a
Del can I just apply that what is
this
wfn what do I have to report
well here we go well founded fix points
over
pairs no that doesn't seem like it makes
any sense
okay if we can specify it in terms of
elth
a goes to
Nat
so this should be almost exactly what I
want unfold ltn
what's the F here so that's a variable I
don't
understand a type A goes to
Nat I mean okay so I could maybe just
Define this as
like elov
second for
um
I don't understand how could something
have
oh type
type
uhuh I just Tred second there even
better okay
good wait what I got rid of of
that is it already
yeah
so if I do
this like I'm not sure if that's
supposed to be the same
thing no no no no that's not right
definition
like the definition of
elto should be the same definition as
this I don't
understand sir genius thank you for
subscribing
let's try this
I got rid of that stupid elough shit and
just went back to
this well we'll just do it the other
way doesn't
matter and that does matter
does it I don't
know I'm confused
whatever my point is this is going to
prove it well founded and then we can
clean it up
later yeah cool okay we prove that less
than is a well-founded relation
all right now to prove this
mess I think I broke the proof too did
I no I didn't because I just really I
admitted the big one
here okay
um intro
zq okay so we want to define a
function specialized
fun p Inn
[Music]
crossnet let's say
x that actually just goes
to F first x 2
x in EQ is that going to
work
not change f it is used in hypo is
H can't specialize in what sure I can't
do
pose p
equals this
function special oh it's just specializ
eqp that's
it okay
cool
um po
Z equals P cross
Q is that how you do
that
that
cool destruct
EQ now
why do with p and PP what do you
mean oh but actually yeah so what we
want to do even before we do any of
this let's uh destruct H zero as PP
destruct h0 as QQ
h0 pose z = p cross q and pose ZZ = PP C
QQ okay
cool specialize that introduce that
specialize the function
okay if I just apply EQ what does this
do it doesn't work
now we can also just do one more
destructed zero
here so we get that
okay somehow we have to get this
contradiction I don't see it right now
hm
so what's the new function the new
function is p z
we need a better way to attack EQ right
now I need a better way than
specialize I'm upset that I can't apply
it I'd like to apply
it can I destruct it
I'm able to find an instance for the
variable
a so what's a supposed to
be
Oh
e unable to find an instant for the
variable
a all right I still don't really know
how we're getting this contradiction
let's let's Google how infinite descent
works and maybe we can understand it a
little bit better
blah blah blah blah blah blah
[Music]
blah no this is
shitty
yeah now
I can do like a destruct WID can I
I don't even know what that
means it's not an inductive
product
um
well I can turn the for all into a not
there exists
right that also implies that there not
exists
not and then we can get to
false
right
LMA for
all
exists for all X
[Music]
uh let's just try
replace
with not
exists a in that plus
such is not PA
right oh
inq
unfold not
inq okay apply
EQ ah okay now we're getting
somewhere we'll get to proving that
second thing in a
minute but all right intro
E2 no see that's not what I
want I already have that well I know
that might be
okay now we already have X and Y though
let's prove the second one first make
sure I didn't like write something
stupid
it's not right
[Music]
what if we actually don't want to
destruct the
well okay you know what before we try to
make this more complicated let's prove
the simple infinite descent the one that
actually uses the cross
all
this one should just be a rather trivial
application of the induction then we can
figure out what the trick is to get the
to get the contradiction because I don't
know
it um okay so first
intros now specialize
oops for
I don't even want to destruct hang
on what if we just intros the equation
first no no that doesn't work
definitely don't to destruct the the
exists for
hm for
okay so somehow we have to set x equal
to
pqq and y equal to
PQ hey
D streaming on Twitch what was that
streaming on
Twitch you want if you don't want to say
hi to the
Twitches well no the streaming so there
the
Twitches what you say the twitch when
the twitch we're streaming on Twitch on
TWiT on Twitch we got how many people we
got those people seeing me now yeah yeah
that's what I told you we got 118 people
right
here hello I'm an 18 people we're trying
to prove the square Ro of two is IR
rational I thought you said it was easy
well it's easy in like work but try to
prove it in computer oh okay oh no the
proof the proof in words is like two
lines but if you want to try to prove it
formally touchies I'll be back I'm going
to get food it's short though it's close
food we stream on Twitch
oh
yo spish
pie
okay h
okay I like the not they exist thing
I don't know about that
one oh
Spanish pie
I don't
know I don't really know how to prove
infinite descent guys
this is hard
well we're only trying to do infinite
descent we're trying to do well-founded
induction on this but I'm not really
sure what's going
on
like for
oh okay well this is
better do I have to then generalize them
again like
that's
okay parentheses make this really hard
to
read for
we have to do it in a different
way okay so the first thing we want to
generalize is FY so if we're calling y
PP QQ we want to generalize H is that
then we want to generalize
H1 then we want to generalize ppqqi
you want to start with
h
no so we want to put that in
parentheses which I don't have the first
idea how to do
oh
I don't know how to do
this this is cock this is why you're
watching the cock
files so hard
okay let's get rid of
that if I just try to do
that to F was not found inro f
these parentheses are confusing to me
well I guess gleen is technically the
name of the language
I don't know the trick here
let's see if anyone was done this
before
Oh h
okay so first off they don't write false
here so here here's here's something
that they they already wrote
out it doesn't imply
false you're not getting a contradiction
okay for
all
yeah for all PQ in cross
n
not
fpq I'm not sure we actually had to use
PQ here okay let's use a b and
c that might be the trick okay so they
have
exists oh and they put the parentheses
in a different
place fa implies exists
B implies for
all c
not and they do a sum they don't just do
the second
okay
cool well we had our did our thing a
little wrong
I kind of reading that was really
nice they're very similar stuff to me
they have this Noah theorum thing that I
don't quite
understand R noet oh this is well found
in induction okay and then they have
their P so they're they're doing that
pretty much the same as me
are I sure they wrote this right this
actually doesn't look
right it looked more right before
F of a implies there exists a
b so FB and the second of B is less than
second of
a implies for all C implies
false or there does not exist same thing
okay let's specialize
eqc what
did they do end here or do they do to
end they have this a Lim thing which I
don't understand I don't know what that
does and I don't know what red
does it's not like a question of
debugging you
know I wish had more
food sued to have that
type I don't know what that type is
a
limb it's unreadable
garbage and they do the natat cross
natat thing and then I don't maybe they
deal with it down here
I got to fight jet lag anyway
guys something to do all
right destruct
EQ
with a equal C
non- inductive
product I might have the syntax of that
wrong unable to find an instance for the
variable a so I want it to be C
no it's destruct as
useless how do I destruct with
not an inductive product I got that
bullshit before
maybe it's not w here we
go oh here we go destruct with binding
list ref equals
term that's exactly what I
did this is not an inductive
product
that expected to have that
I don't know what that error
means x =
a no such bound variable X
okay the other
alternative is to figure out how to
construct this initial term
here but again we run into this problem
where
okay going to do
that build a path then destruct in the
term I don't know what that means
they like wrote it
here this no etherion just literally
looks like
induction where are they getting the
contradiction
from or where are they getting the for
all not
intros okay they they
apply they just do an intros so whatever
that
does that seems to introduce
everything oh they don't even unfold the
not I guess
there's
red the same as unfold
not
intros
okay a Lim
h z H1 I don't know what a limb is and I
don't have a
z where did they get Z
from expected to have type oh
term H1 has Type FC where it's expected
to have type
fa we don't have something with type fa
do
we let's just guess is this
right use this different
I I guess it's the
sameish they apply it they don't
specialize it
well here's their Z oh they use Z as the
first one
I don't know what this Lim thing they're
using does
H expected to have type fa I just put
fa has Type prop well it's expected to
have type fa
what
okay we do have to figure out I think
how to apply
H to the only thing that makes sense is
applying H to h0
somehow right is to get this thing here
to match up with
this this is all the before the
uh the thing but it hasn't
exists how does this do it
[Music]
General ize
H
generalize
a apply
[Music]
H1 for
I don't know this might have to wait
till part two of The
Stream I thought this was
oh
well okay they don't use Z they only use
Z up here they don't actually use Z here
at all this is actually the same
a so I don't know what that
means but it's a different a when you
introduce it so that's completely
useless anyway
but okay so that Z must be in the well
founded induction it must be the
axe what is this a limb tactic do
def X was not found in the current
environment
oh okay here's the other trick there
to okay all right I see the other trick
they're doing you see
it when they special I the well-founded
induction yeah fun x equals not you have
to do it on the
KN
oh that's the
trick oh who understands yeah
boy well I still don't understand all
we're not we're not we're not done yet
but this is better than we've seen yet
yeah the
trick okay
okay so the the the problem is you you
actually have to do the induction on it
not existing not on it
existing this is the whole trick because
that's the last thing so let's not
unfold those
knots let's just leave that and do the
induction on not yeah
okay well still not right
but this now matches this
it's expected to have type fa okay well
we're still left with that garbage
but we do the induction on the knot
this isn't right
though okay okay now we got the apply to
work
boom
yeah okay okay we making the
progress yeah
all right
well what are we trying to
prove
okay intros
X
yeah all right all
do we see what we did
there we applied the
induction yeah
what's up we're streaming on Twitch so
if you don't want to say hi to the
Twitches don't come in you can say hi to
the Twitches though hi twitches
is it a video yeah it's live video
streaming all
right okay we're still getting that
bullshit that I don't really
understand let type
oh okay I have an
idea that we're supposed to somehow get
this FX to apply to this hypothesis and
then we can destruct the
hypothesis not sure how we do that
yet but maybe by just
sh sh
yeah
somehow where does H come from
it's see it's bothering me that X
and we don't want to introduce a new one
here we really just want to use um we
want to use
a can we can we use a is that how it
works
I think this needs to be in
parentheses
okay now specialize
yep ha
oh no that's not
right why did that get called
a okay see now it's X you see now it's F
ofx and not F ofx okay so now let's
unfold
not intros
a apply H to a or apply uh a in
h ply H in
a let's just call it ha fly ha in h f h
in ha there we
go okay all right now look look at the
simple shit we got all right we got
simple shit woo
apply h0 ha is that
right oh no we just okay uh
destruct
ha as ha and as B and
ha no no that's not right
uh
that where just you distruct ha good
enough B
ha
specialize
h0b okay okay okay unfold delet in age
zero
um
split
ha destruct ha
apply h z and
H2 okay and look now we have our
contradiction woo we did it all of this
stuff's
garbage wow that took way too
long
okay apply H1 apply
H2 um okay well ply
H2 ply
H1 Q okay that's not even the real thing
we wanted to Define it's close though
it's close we're really
close thanks to a Little Help from this
guy mostly for just getting the type
right you know most of these functional
shits you just once you get the type
right you're doing pretty
well okay so now let's define the actual
theorem that we want
okay so this is the type for
all for all fnn
prop so the problem with what we just
defined is it's defined onnat crossnet
and we need to Define it on
natnat getting close though we're
getting close we're getting close all
right let's put a pen here because I
messed up my PN last
time implies there
exists uh PP and
QQ inat such that F PP QQ
and Q uh sorry QQ is less than
Q implies for
all I don't know I'm running out of
num running out of things RN
s inat not F
FRS all right let's
go inos
F
[Music]
apply all right so that is the wrong
type because it's actually fun XY fxy
um don't even know how you define a
function with two
variables X comma
y for
oh it's just this actually it's not even
I'm not even sure how to define that but
I don't think I have to I think that's
actually what I want to
say applied theorem doesn't have enough
premises oh info in CHS FH
okay well that's more useful
then um
intros
RS
uh
pose this isn't bad now pose RS is RS
right
uh replace r with first
RS replace S with second
RS let's quickly prove
these um
try
reflexivity perfect
so that won't even create the second
goal it'll just try reflexivity on both
goals and that should trivially prove
that okay now we're
[Music]
here
okay so what did we have to do again
simple intro specialize
HX I don't think we actually need it
that simple intro
okay so we're all PQ and that
yeah
so special it's not going to
work uh H first X second X
all
right
intros
Q apply Q in
h h what did I I call it something else
up
top ha apply H in
ha okay okay um destruct
ha as PP
ha
distract H as
qqa distract
ha okay
pose pqq
as PP cross
QQ app uh sorry specialize h0
pqq
yeah okay uh
unfold ltat in h
zero yeah so that's the same
uh
replace QQ with second PP QQ in
H2 try
reflexivity apply h0 in
H2 yep now we have our
contradiction
simple apply
H1 okay all right
we defined this infinite
descent let's save this now I did mess
with the uh the type a little
bit so let's see if this all still
works no it fails here
oh there's
wow I thought I tried that I don't know
oh I guess I didn't put in parenthesis
okay
um for
oh we have to say Q not equal to zero
so I don't know what I proved before but
even with my type cheating was still
wrong
um I don't need to do
that probably don't want to do those
simples I guess we do want to do simple
okay so we're going to have to
show we forgot something up
here we're going to have to
show that this implies QQ not equal to
zero like
that not sure what that's going to
change
nothing we don't need this anymore
okay it seems like the only problem
now is the fact that it's simplified so
maybe that just works no of course
not so like look it's so close now
except that not
good that
n PP is less than QQ that's so close
that's so
close um how do I do
this I need to run simple on it yeah
okay
no should
work
exists extra PS here
and
QQ last than
Q do those extra penss matter
okay so H comes from infinite descent so
I can just put brener on that
maybe p ps
ps did I really need P here
maybe I should change anything
though oh
H it's okay this is just
stupid um
can't prove that
there aren't pens
there I don't know what to do about
that I don't even understand how that's
a different
type but it
is maybe this doesn't go here
yeah no we need the pen in the top one I
think so you see the subtle
distinction it's whether there's pen
around that that thing or not
actually don't belong there
Le make me
prove
yeah I should have to prove that Q
doesn't equal zero that's true
um I have to prove that Q Prime is not
equal to
zero thank you
Omega what
what if we just do this
instead for
let's try that we changed it to ands
instead of implies it should mean kind
of the same thing
but so then no not there when we're
doing this we just do an end here
um seems better I don't understand why
it doesn't work they look the same to me
now uh maybe I just did it
backwards okay there we
go right now it's not
right this is the premise for that
right all the parentheses in the right
place apply ID and
H I don't know
unable to find an instance for the
variables
RNs shouldn't
matter apply ID in
h what just happened
no apply H in
ID okay unable to apply Lemma of
type which looks exactly like what's in
the parenthesis there
are they identical or
not I don't know these look the same to
me
oh using G
eh it's not like this ever worked I had
some like serious bugs before that you
just don't realize because you're
cheating with your
types this looks to be exactly the
premise of this
okay let's just try asserting what I
want
okay that worked
specialize
h0
PQ simplify in
h0
no unfold not in
h0o not what I want to
do well now we kind of need de Morgan's
law you know split h0
destruct h0 close I'm getting real close
guys you get real excited when you get
this
close that's not what I
want maybe it
is it's real exciting guys it's real
exciting
split apply Q
andz apply
EQ oh yeah there's the proof
complete proof that the square OT of two
is
irrational if you'd like to enjoy I
don't have a GitHub on this computer can
I post on guest
anonymously nope I can't post on guest
anonymously so uh I guess if you're
going to want to copy this you're going
to have to do it from the
video oh
yeah so let's just check to make sure
that the < TK of two irrational actually
says what we expect it to say for
all PQ and n q not equal to
zero well let's put an and
here oh no you have to say implies
implies is correct in the prove
case if if Q is not equal to zero
because it's obviously trivial Solutions
cuz the Q is in the denominator
um wait
what we broke
it all right so that is now a true
statement if Q is not equal to zero
let's make sure that matches is the
actual < TK of two
irrational
proof assume it can be expressed as p
over
Q of course with Q not equal to
zero implies
that they're not
equal
yeah I can upload what through the web
interface
guest no I can't cuz I don't have a
GitHub
account that's too bad all right fine
we'll do we do a pay spin for you
peoples
they have cock syntax
highlighting no they
don't okay if anybody would like it
there's your paast bin right there
no I don't have any stuff on this
computer just in case you didn't know
the square root of two actually is
irrational the program is not lying to
you
guys uh can someone else Post in the
chat can I'll type
it thank you for
watching the chat got much improved
after we kicked out all the noobs um the
Tolerance on this twitch channel for
nbish behavior is low it's very low
people talk about zero tolerance but you
know zero zero is a we're you know we're
we're zero is too too little tolerance
we Ser we have Epsilon Tolerance on this
channel Epsilon that's
appropriate um we have Epsilon tolerance
for bullshit if you're a subscriber we
have a little bit more than Epsilon
um is zero irrational o that's a good
question
um no no zero is not irrational at all
there's actually tons of things that you
can make be
zero you want to prove that zero is not
irrational very quickly we can do that
now we're done we're done thank you
thank you for watching everybody thank
you thank
you we did prove that the square of two
was
irrational and that is what we set out
to do today and we did
it later twitches
let's wait for a few people
to get in here i'm live no
no one of these days i'm going to figure
out how to use this app
but like you know it's the intro to the
stream so
my channel oh yes
the for loop challenge well it's a past
broadcast
oh yes live perfect
but like you know it's the intro let me
just uh
turn this volume down
we should have enough uh battery that
battery starts to die left to unplug the
light and then we won't have enough
light so
okay are you guys ready
for the for loop challenge
all right so the goal
of the for loop challenge because you
people always are like what's he doing
what's the goal
and we're gonna add four loops to clang
yeah yo what up what up boys
what up we're gonna add four loops to
clank
okay so let me explain so
also sws stands for smoking weed stream
so you know if you guys are taking this
as professional career advice
you're an idiot uh if you guys are
taking anything i say
professional career advice you're an
idiot
that's right okay
good evening mayfield tv um is the
smoking weed stream the weed was smoked
off stream the weed was not smoked on
stream this time
yeah that's right cringe someone sent me
an email they're like yo george you know
what would make hammer better
is if you did it as a b2b app and i'm
like fuck you and your mba
bullshit man who cares what the business
model is
i can't even i'm too upset about it to
even talk about it
and that's why we're adding four loops
to clang okay now let me explain how for
loops work okay
so normally you have a for loop everyone
knows a four loop so i can say something
like four into i equals zero
what why is it changing my shit don't
change my
shit um
check spelling as you type no don't
check my spelling that's right
all right so let's say we have something
nice like this or i
checked my spelling as i typed oh
correct spelling automatically that's
the problem
yeah okay cool we in this we in this all
right
i don't give a shit about congress and
the companies dude
i don't care i don't care you know what
honestly
i even regret talking about making
hammer because you fucks take it as a
political statement you know
it's like the masked shit like i don't
care man
oh yeah you should really stick it to
google i i don't care
we're making four loops alright so get
ready for what a for lupus
um sorry i wasn't streaming for the last
two days i'll show you guys what i was
doing
since it's open source i can show you i
got a contract
i got a job you know i was on some real
uh
mr peanut butter shit you guys know mr
peanut butter mr peanut butter is the
bojack horseman guy and he just like
shows up and he's like
is this a tv set am i in a television
show
mr peanut butter you know that guy
all right so i wrote this yeah i wrote
for for optimism the new plasma it's a
l2
uh ethereum solution um
and i wrote this so you guys can check
it out
uh three days boys three days making
money
got this apartment paid for i got my
phone bill paid
you might even to get yourself a nba
player shit at least to do with a car
you know all right um
bob saget what's that
what's that line oh you know you can't
say that line anymore but
funnier than fuck you should ask bob
saget you know
never claimed that i knew how to dance i
just get drunk get hot pulled on my
pants
so fuck five bucks just fill up my cup
don't kiss me bitch you just threw up
all right no no no no no no no we're
writing four loops all right
all right so that's a for loop so
everyone knows what this prints out
right
zero one two three four five six seven
eight
nine right okay so we're going to add a
new kind of loop
to clang it's a for loop
why'd it correct my spelling
automatically
told it not too
use the form i don't know whatever
so if you write a for loop
it's like a for loop except it does
something
a little bit different you see instead
of running this i plus plus just one
time
it runs it four times five guys burgers
and fries but it's a for loop all right
0 4 8. that's what it's going to do
right and we're going to modify clang
we're going to make a clang
that's a custom clang that's capable of
compiling
for loops you know now but real talk
whoa whoa whoa whoa don't just do i plus
equals four
you guys aren't thinking you know you
guys are thinking
we want to accomplish a goal and for
loops are the
ultimate in not accomplishing a goal and
that's what we want to do on the stream
because nobody actually
needs a for loop you know this is the
most useless thing
like if somebody proposed this in a
meeting i think even businesses that
have no taste would understand that for
loops are useless
so let's go we gotta get clang first of
all
uh let's go in chrome first we gotta
build clang
build clang let's find some instructions
um well first we can see what happens if
we try to compile
a for loop let's compile our for loop
oh we might have to add it to vim syntax
highlighting i mean i'm a little
confused you know
uh we're of course still going to need
it main none of that's going to change
yeah that looks like a nice program
right so now when i compile it we're
going to compile it with clang
oh implicit definition of function four
oh it thinks i'm making a function
i'm not making a function i'm making a
new kind of loop boys
and it's called a for loop all right so
just for reference we should have a
normal for loop
as well you know
maybe we can style this up a little bit
write a few of those and like a 4 like
that
and then a 4 like that all right now the
truth is
boys i'm not one of those cheating
streamers you know some streamers
or cheaters and they do all their
programming off stream and they're like
oh
i'm going to look really smart in front
of my audience
i'm going to actually have coded this
already off stream now honestly i
thought of this idea
my friend sent me a text message it was
like yo george
what are good books for programming and
i'm like you know what the people on the
stream ask me this all the time and the
answer is
can't learn programming from books
that's like saying that what's good
books for parkour
can learn parkour from books you know
you learn parkour by subscribing to the
parkour everyday
industry no you learn parkour by going
and smacking yourself against bars a
whole lot of times you know
and that's why i can't do parkour
because let me tell you if you could
read a book and learn parkour
shit man i'd be the next donna llama but
i'm not
so there's that all right
sup everybody also i'm trying to become
a twitch
partner i gotta stream six more times
over the next 20 days so i believe in us
team george hutz team tom cruise team
this twitch channel
let's go let's go all right
we're gonna have to build clang first of
all
i can download the releases from here
should we start with a release
no i think we want to start with get
yeah
that's a good choice mirror kept for
legacy
project moved it's a
mono repo
they put llvm in a mono repo
damn that's just crazy all right let's
go
this might take too long and if we get
impatient we're going to do depth one
yeah we got impatient
the next hour of the stream is compiling
clang that's true
because you know what honestly a lot of
programming is just
waiting sometimes it's thinking waiting
sometimes it's compiling waiting
sometimes it's lazy waiting sometimes
it's get checking out waiting we gotta
you know get this from the internet
do a d5 stream never subbed ever donated
many mangoes should i ban them
we'll get free entertainment around here
oh okay all right all right we go we'll
go we're good how do i build clang
configure and build llvm and clang
shit
cd llvm project make dirt build cd build
was that the part of the stream that's
hiding
um c make dot dot slash
clang can i make clang i can't make
clang because i don't have an llvm make
lvm oh god
ziesh why do you do that for me all
right this is looking good all right
we're making progress
now of course because we're not really
lazy slackers we're going to open up vs
code vs code
is the best way if you want to read code
so we got to read the clang project you
know
this was my work on the solidities
we can just open up a
open yeah we're going to open a folder
up
not in the solidities we're in the fun
directory since this is a whole lot of
fun
we're writing for loop since the lvm
project okay cool
okay now we're going to have to figure
out where for loops or to find and clang
is probably a parser somewhere uh so the
basics of the way these things work is
you got like a parser
and then like that makes like an ast
and then after we make an ast we like
compile that and stuff
right um
c make tools would i like to configure
it no thank you
but i appreciate you asking configure
projects on opening
i don't know what configure means that
scared me you're going to like
llvm build or something all right
so somewhere there's probably
objects let me see if i can zoom in on
this for you we want everybody to be
able to see
somewhere there's probably objects
like four we gotta find wherever four is
decal c plus plus decal base wow this is
complicated as shit boys
i don't know how we're gonna do this did
i sign up for something that was too
hard
maybe
all right let's try searching for
four
i don't want to search files to include
clang
star
ah that's not gonna work four
oh four
oh this is gonna be harder than i
thought boys
wow look at this there's like five files
just dedicated
to to making comments
okay so well we assumed it was in the
ast let's first look at parse
parse ast oh my god this is hard
where's the grammar defined
wow this thing has more pop-ups than a
hobby king
sale
start from the front end that's a good
point i like you're thinking good man
i'm legit i'm not one of those scam
streamers who looks at it all beforehand
we are legitimately just doing this
um terribly i might add but we're doing
it
all right
well i'm in lib already
we should spend more time thinking and
less time frantically pressing
keys ast
merge
sure it's in the front end
let's take a look for things that look
like the word grammar
oh i was we're gonna we're putting music
on too this is this is a music stream
sorry for all who copyrighted
yeah i was listening to this
on the way to work but my airpods
why did this target everything
i i should have cmaked better i regret
my poor seeming
all right what are you people saying you
know what
i know what time it is really i do
something that's for the educations
uh
yeah dlvm allow projects clang yeah we
gotta do that
yeah yeah that's right yeah that's right
you know what
that's right yeah dlvm allow projects
all right that's downloading and taking
a long time
that's compiling and taking a long time
everything's taking a long time boys
who thinks my patches are good it's just
enjoyable you know like you get into
this state where you're just like
flowing through the code and you start
seeing and it's just code code code and
more
code
no it's not a for loop where i plus plus
is actually i plus equals four
because if it was i plus equals two it
would be i plus equals eight it's a
for loop where the last condition runs
four times four
does that make sense does everybody
understand
what a for loop is
all right so our goal is to add four
loops to clang
and when you ask why you're asking a
stupid question
and like like you know what sometimes
sometimes
things get a little bit close to being
useful and when things are a little bit
close to being useful you guys think oh
why oh would this be good should we sell
this as a b2c product or a b2b
product i don't know man maybe
businesses could use
for loops that could help them get 20
more tps reports on their leveraged
printer buyouts
that's right you want an example of a
for loop right there
now unfortunately no language supports
the great for-loop holy shit i am terry
davis
no language supports the great for-loop
construct
and that's why we're adding it in
there's many stupid questions check my
bio i even
reference stupid questions
anyone who told you there were no stupid
questions probably also taught you to
read
by just looking at the words instead of
being able to recognize them you know
okay we have llvm now now hopefully we
can just do make on clang and it's gonna
work
this isn't gonna that's useless this is
a second
oh sure i want to delete all two files
cmake dot slash clang
dlvm enable projects equals clang
maybe this will work fingers crossed
no llvm config llc
wait oh compilers
you find you may need to set those
things does that fix it
oh my god fine
is that 88 already yeah build all of
llvm
go do that then we're still going to
have to build clang add installation
prefix of lvm to cmic prefix what
do i have any lvm config.cmake
oh yes here we go
welcome to attitude
cmig prefix path hey
now we're talking boys now we're talking
i don't know what we're testing here but
it's got to be important
let me copy and paste no don't run away
yeah good
what just happened
like that i don't like any of it
hmm it didn't work
unknown c make command is this because i
need a newer cmake
well that's going to upset me
or is that because i need a newer llvm
so
do plugins let's try
plugins
no
oh
this is a tragedy
it didn't work they have to like make
the versions match or something
it knows i care too much yeah i know so
sat with me
all right we're building llvm
that was a waste of time let's just be
patient you know sometimes you just need
patience
now i still don't know you guys saw me
modify the par sir
i modified the ast thingy we now have
this statement here
um
but i think that would i like to use a
compile commands json to auto configure
and tell us
this thing really has so many pop-ups
this we're going to have to make a full
discarded ah
you know what how do the parts get
stitched together
wow act on for statement
clang is mad complex boys
oh my god yeah of course i need a cogen
for the amd
gpu yes that's very important i'm so
glad you built that
i can figure out what version of lvm we
have and then rebase my thingies on top
of it
all i really wanted was clang you know
which version of lem do i have
lvm version 10.0 a
lvm 10.0 download the playing source
what am i doing chat read the what am i
doing
or what am i doing
if you don't no goal
alright we know about that error but we
got that error
fixed with that
fingers crossed boys is it going to
build oh this finished anyway
i don't know i don't trust it i trust
this one
oh never mind
what can this version of lvm not build
this version of lvm
no that's too much man i don't know what
we're gonna do if that's true
all right let's go in here let's go to
build
two and then we'll go to build two and
then we'll type cma dot dot slash clang
wait what how did that work that wasn't
supposed to work
yeah that's what i was supposed to get
now we can just add
llvmdir
oh bills
there we go
what
this because i broke it
unexpected input at top level i think i
might have broken that
so
okay
mini raid what up why does this work
could not find
include llvm option opt
parser
where is that thing
it's in llvm include opt parser
why is files not found oh
maybe
how do i build clang
do i have to build it in the same thing
there's no point here i don't know what
if i just uh for this i did cmake.slash
llvm
and then maybe i need to enable clang
but this is gonna bitch and be like oh
you already did a c make here oh no
playing project is enabled okay cool wow
it's targeting everything i don't need
all those targets there's too many
targets
okay i don't know what it's doing now
wow look at all that stuff that it's not
building oh good i think this is clang
obviously take forever to rebuild them
okay it's building clang now we're
making good progress
it took a long time should we the only
question
is are we going to submit a pull request
at the end of this
ops trying to upstream the for statement
uh no i don't watch i don't care what
basil
zuckerberg have to say look it's like
who cares what are they gonna do
you know
whenever i hear the phrase you're with
us or you're against us
i usually hate both those things i'm
usually both against them
and against the people who say those
things you know
ah
bro if you care too much you lose i mean
that was like relationship theory 101.
oh too few arguments to function call
now we're talking all right now we got a
real bug
all right real bug let's go fix it par
statement
because we have multiple calls to parse
for statement
um we should really add to parser.h
the fact that everybody knows for
statements are always
true uh no i'm i'm not enlightened
centrist me
i'm um
i'm detached that's the word detachment
i'm a detachment man you know if the
commies want to come and
take over i'll put my hammer and sickle
flag up if the nazis want to take over
shit i'll hang my swastika dutifully
that's right
as long as they you know leave me alone
and that's all that matters man you know
that's
all that matters just take who's ever in
power
and you know accept it because that's
the truth about it you know you can try
to like fight it
but then you're just the guy in the
billy joel song man
[Music]
all right i think can we build now did i
fix the bug
now it's going to have to build a lot of
things because i changed a dot h file
maybe not let's go
all right the dream is when we'll be
able to do dots let oh
where do my bins go
my bins are gone
does it rebuild all the bins every time
no it can't do that there's too many
bins for that
wow this takes a long time to build
oh that's because we're in clang source
that was a failed experiment
we gotta go in here to build ben oh
they're all my bins take a look
that's so many bins
build bin clang test.c
oh that's going to be a great day when
that works and that day is going to be
soon
you defaulted 4 to true that's a great
choice that's a great catch
we got to make it false because if it's
true
all my statements will be four
statements and then four statements just
won't be special and how will we have
our
competitive edge business thing
493 viewers hello
should we uh should we let everybody
talk again
am i allowed to show my money on twitch
did we figure that out or not
what's this person saying yo can you
unban me no
all right no the answer is no well i
don't make that much money on twitch
but i do want to be a twitch partner
because think about it you know what i
mean
there's got to be people out there who
work hard to climb that ladder their
whole life they're like
i just want to be a twitch partner i saw
a guy at twitchcon
and he was so excited when he got twitch
partner and it's just like something i'd
like to casually do
you know because to win
is not to care because if you care you
lose
some guy in the comments said that
wow this takes a long time to build
i do like check marks you know i
the primogen is the top coding streamer
redefinition of default argument oh you
can't do that i see
i already made it false over here
we're gonna make a false over there
do we have a clang yet no fine yet
we are very nlvm though that's pretty
cool we made this lvm from scratch
wow version 12.
yo that's a crazy version
twitch partner comes with an exclusive
clause no they couldn't actually do that
no way you guys are joking man
let's google that
it was too easy to apply for for them
just uh
the twitch part partners
the twitch partnership program for those
who are committed to streaming
this twitch partner you'll have access
to the following benefits
no it doesn't say anything about being
exclusive to twitch
you guys make a lot of dumb shit up man
i'm not trying to you know
disrespect anybody here like that you
know like
like sign that kind of disrespect but
i am saying that i don't think that's
true uh oh
i'll have to act as a role model to the
community though
i don't currently meet the weight no
hang on i don't know what that means
that's a vague term vague term
streamers who complete the path to
partner achievement in your achievements
dashboard will unlock a button i have
that button
but i haven't streamed
12 times in the last 30 days
the minimum criteria we look for in
potential partners
and completing them doesn't guarantee
partnership
uh all right so someone was saying there
was some
there was some youtube comment where
some guy said he was going to challenge
me to some
coding game what was it called
twitch affiliate program yeah i don't
know about i'm not part of the affiliate
program
just stop and restart the stream no i
think it's days
code clash i think that's it all right
let's go
we gotta i mean we gotta wait for it to
compile anyway what else are we doing
all right
join a clash oh already i gotta sign up
i'm upset
i'm upset
oh let's go how do i play
well i better figure it out i got 90
seconds okay let's go
i've never played this game before so i
don't know what to do
all right you have to pass the number
maximum number test with the lowest code
size
okay you must output the end first two
elements
n1 and n2 were given the element with
n index n is the sum of the previous two
elements
what
oh i see
uh okay so it's a fibonacci crap thingy
um we have uh
we need a we need a ring buffer thingy
oh you know what does it even matter it
might not even matter um
for all right we'll just say n a
equals that or i
in range n or while length of n a is
less than
n
print n a sub n minus one
or an a sub minus one n a dot append
and then all right
oh it didn't work first number given
what
i'll put the third element oh
so this should be yeah n a n minus one
yeah no shit
oh my god i'm not i'm losing this game
aren't i
yeah all right go
what do they mean by shortest
i don't even know
yeah i'm winning
oh i think i should have oh i had to
write it really short
oh i say leased bites
oh my clang's built
yeah i won that's right number one
number one i'm number one that's right
that's right
okay do we have a clang
oh we have a clang now back to our
regularly scheduled program
fatal error standard io's not found
well no one really needed standardio
anyway did they
oh it built okay all right that was good
progress
if you'll notice despite don't worry
about standard io that wasn't that
important
but if you notice it's almost correct
except for the fact that
the for loop is of course behaving
identically
to the for loop that's four with four
letters
is behaving identically to the four with
not four letters loop so we need
to fix that bug of course now
i'm not sure really how to do it this is
the hardest part
we have an extra results
we have a bunch of options for where we
can like add things and i don't know if
these things add but
make full value make full discarded
value expression
this is a full expression arc
act on finish full expression discarded
value
true
we might actually have to pass it in to
act on four statements
we can pass in whether what kind of for
loop it is if it's a four with
how many letters and then
we want to look at full x for r third
check break continue binding check for
redundant iteration
x per third well let me just try a
little something first and see if it
works
um i mean this isn't this would work in
c as well
so am i allowed to put like multiple
things here
not like that but what if i put them in
these things
it's not allowed i feel like there's a
way to do two things there though
man did i pick something unadmittedly
really hard
return new context for statements
sub experts inc
hmm
four state statement for statement class
let's see the for statement class
so where's the thingy that actually
makes it a for statement
check break continue binding third dot
get
expert third third blah blah blah
for statement okay
so we set all these sub-experts we have
to use
ink somewhere else
like where do we maybe we have to find a
code gen for this
oh
set inc
wow
i really keep this like
here we go codegen
increment is essentially part of the
body but it needs to include
all right let's just try this see if it
works
and then we'll have to figure out how to
pass it all the way through to there
you'll have to modify the for statement
to see if it's actually a four statement
i shouldn't name them something else so
when i say it it doesn't say the same
word over and over again
but this is what we're doing in case you
guys like goal
hmm
i think it worked
i know that meg didn't finish yet
to be fair i don't really know what uh
cogen pgo what's a pgo
pgo implementation i don't know about
that
statement printer ast reader
that looks nice
mark
walk ast check security syntax
sema statement
i don't know what sema is either
well let's look in code gen and see what
we can find
sin includes
lib cogen cg expert
four
and we'll look at includes
hmm cg
function as well
code gen function
okay so somewhere we're creating this
thing
called a for statement and if i wanted i
could pass all the stuff down
um
oh well this actually breaks it if it's
a four statement so we don't do that
how did that work at all with that
broken
okay um
let's try a quick test
that should throw the assert
okay yeah
not a for statement okay cool
that's why we have that there
make full discarded value expression
it's an expression like i don't really
want an expression
let's just treat it like for some reason
this doesn't work
and we're gonna have to create and act
on forced i mean i might be able to hack
it there
but then do we really learn and what is
this about but learning okay
so we made a for statement in the ast
context so we have this thing called for
statements
um
what's a friend class
all right public statement blah blah
blah
get inc get body reinterpret cast
to expression i don't really see a way
to do it there either
there has to be something that's doing
matching on this
which is uh outputting stuff
transforms ast importer here's statement
printer
little code gen function
that doesn't look useful cogent pgo
looked the most useful
with this visit four statement thing
what is code gen profile guided
optimization well it can't be that
in coverage mapping gen rewrite
objective c
par statements
oh
cg statement open m oh here we go what's
this a mid
for statement oh now we're talking oh
yeah boys
yeah i think we're looking somewhere all
right perfect
if there's an increment emitted next
okay
if it's a for statement we omit it four
times
okay this is it cg statement i think we
found it
and then we're just gonna have to wire
it up so we pass that through
and then we've made the best clang in
the world with the addition of the for
statement
and then we'll fork it we'll submit a
pull request and we'll see if they
accept it
oh yeah oh yeah zero
four eight if you guys would notice in
the
what i'm doing that was the expected
behavior boys
so now we just got to pass it through
all right
so we have a const for statement
so let's just add a if
s dot is for statements
um where is this thing defined
always be building abb
um par
statement okay actions act on for
statement
we're going to want to add his for
statement here
here at the four statement
is for statements
when we create a for statement we'll
just go here like
that now we need to fix
this uh wow those are source locations
yeah
and now let's go find this actual
constructor
like statement.c or something
yeah let me just say
for statement
equals is for statement
boom c plus plot oh no
why is it building so much stuff
no
okay so we added this for statement and
now we probably have to add it in
okay i added it in there where did we
not add it in the action
thing so wherever acton4 statement is
declared i think we have to
here
it's in semi
i hope it's still built
taking forever to build again
you want to just do another for loop
inside
um
all right you guys you know what
you all get you'll get
yeah you could use commas that's a good
point
but you're right it was thomas
you almost got a pass for all the
non-subscribers but you didn't
all right so i think we just got to be
patient again let's play clash of code
let's go
i didn't win
i have five minutes to write tiny ass
code all right
all right let's go
why did i have to rebuild the whole
thing
you get it right now let's play collage
of code
no it failed
this argument to member is for statement
no what did that say oh my clash of code
is coming in
over this function is not marked const
oh i see
oh what is this reverse mode
oh it's just power i think is it power
it's not power
2 4 is 16.
but 7 to the 11 is not that
it's almost power
i would think it's a different base
wow that's pretty brutal
okay
well
539 over 7 is 77.
oh so is it just 2 times 2 times 4 and
like 7 times 7 times 11
and 456 times 456 times 54.
yeah okay now do we gotta make it tiny
again
or does it not matter it's just m times
m times n i think
i'll make it tiny just because we can
do you got to go tinier like it's a
little unfair what if like my
boilerplate to parse it isn't as tiny
actually it's python three do i really
need oh if i change it to python two
well i can't have python two never mind
this is why i can't have nice things
got so many bites it's a little shorter
i guess
wait it was just time yo that's bullshit
i wasted time
no i'm not interested don't try to sell
me on your shit
it's not constant it's got to be
constant
constable is for state
is that better
i don't understand why it's got to
rebuild everything now
warning const type qualifier on return
type has no effect
oh i have to like put it here don't i
oh god i don't know any c plus
and if you edit this thing it seems like
everything has to rebuild it's a
nightmare
okay more clash of code
yeah let's go let's go no stop trying to
sell me a job
go go go go
okay reverse mode again
um some of them have an
x next to them and some of them don't i
think just the odd numbers do and the
even numbers don't yeah that seems
pretty easy okay
uh 4i in
oh n equals input sub i
if n mod 2 equals 1
print
else
that i know this one's just a race
i'll test cases boom
what i lost
all right let's go let's go let's go
come on
[Music]
for each integer i'll put the number of
ones in its binary representation okay
let's go let's go let's go um
bin x uh filter
lambda x x equals equals one
uh comma bin x
uh list spin x uh
length list filter uh
rat equals print rat all right let's go
little test cases sometimes you just got
to be ballsy and oh no it's shortest
coat again no
oh my god i could have wrote much
smaller shit
ah does my clang take forever to build
how do i know if it's short okay i guess
the ones where it's reverse it's
quickest
and then the ones where it's the other
one it's
uh
let's go let's go let's go
come on reverse come on i can beat you
at speeds boys
shortest mode okay pass the most test
with the shortest code side fine that
means we can take more time
i have 15 minutes what is this a chess
game
one line containing
and the number of elements one line
containing
n numbers the sequence after being
shifted
right so first we'll read any of this
and we can just say
input there to consume that
what do you mean by shifted oh a left
shift
okay um
what
can only concatenate list not string to
less
and see the error
all right can we write it shorter
i feel like it's just unfair because
you know i bet you there's some language
where it's like in instead of input
that's cheap
oh some people are using c plus plus i
pity them
too few arguments being sent to yeah
okay we gotta fix this bug
all right let's go that's pretty short
i'm pretty happy with that
55 characters that's gonna lose i can
tell already
true few arguments to function calling
tree transform
uh well you know what we should really
make the function call have a default
[Applause]
let's make it work okay and then where's
that action one as well
that should work maybe
no euler she
jolly
all right let's get a fastest one so i
can just win
i don't like this shortest code game
oh reverse mode yes okay
um
shit it's like 64 times 63
yeah that's right okay good so it's just
um
a times a times
a minus one little test cases
let's go yes sucka dick dumb shits
yeah this one was fun that's right
winning
um this game is stupid and it's just a
way to try to sell your job
it takes forever to build oh my god like
who built this
how does anybody work on this code
if i didn't set my like equals false
right yeah that's probably why you're
not supposed to put those things in
headers
i don't know does anybody work on this
code
i think my for loop is pretty done who
thinks it works
did i make it work
three to death
okay we add it there pool is four
statement cons
for a statement there
parse it if it's called normally it just
returns zero
here that will inherit the
the false which is set there if it's a
for statement do that
parse it we know that's correct i don't
know why i deleted the fix me i guess it
was a stupid fix me
what's the for loop challenge well you
know about four loops but what about for
loops
right you've got to add four loops to
clamp so we're going to compile this
beautiful code here
and right now both four and four loops
are acting like for loops but
look zero four eight you see we just
want a for loop to be zero for it
because in a for loop
it runs this statement four times
so this is equivalent to this
but with lower case eyes yeah
oh let's go let's go let's go
that's right
it's taking too long
you shall have fun everyone's a winner
even if zero percent
of the
i'll discover coding game for tech
hiring oh i knew it was just a hiring
funnel
never mind oh there we go
oh i can launch it
no it's not i equals four we're gonna
once my for loops work i'll demo them
for you or the clash has already started
let's go fastest number tests and the
best possible all right cool
um the hexadecimal
hexadecimal triplet okay cool so we want
to say color 1
3 we want to say hex 0
plus color 1 3 r equals that
g b this can be 3
5 3 4 5 7
print r print g print b
right play all test cases it didn't work
um stir object cannot be interpreted as
integer uh who was trying to interpret
anything as an
integer oh no that's hex that's not what
we want we want to say
int comma 16 god i lost this
play all test cases yeah let's go
oh
you don't run the loop four times guys
none of you all
understand the syntax of the for loop
and we're gonna have a lesson and we're
gonna teach you all how to use for loops
after my new improved clang finishes
building with support for for loops
wow i really i really shout all over
this code you know
they'll never upstream this into clang
oh my god it's building llvm again
wow it's really this was not next time
we do a challenge like this maybe we'll
do a challenge like this tomorrow so we
do another challenge tomorrow
we're still working on busy beaver but
those are the long serious streams those
aren't smoking weed streams
smoking weed streams we just do dumb
shit maybe tomorrow
we'll like i don't know
oh i know what we're gonna do tomorrow
got four loops for gcc yeah that one's
even more of a nightmare
i don't know this clang takes forever to
build though i guess it's all written in
c
plus and klang's really slow bass clang
oh should we play more this game is kind
of boring
oh why didn't i call it four because i
don't know it's a for loop
should i do a live lead code contest
did that i think did i do lead code on a
stream oh my god it really wow
this this is just it's hard to look at
like this is just oh my god stop putting
in your fucking funnels people you know
i don't like funnels i'm claustrophobic
you know what i wish
i wish like when i read a website like
this
like like just anybody are there people
in the world
who look at that website and like are
like
wow google was founded on the belief
that everything we do
should always respect the user if i ever
make a website that looks like that
somebody needs to fucking slap me man
you know hack the planet does anybody oh
wow look at this oh it's three women
looking at a google pixel phone
oh that makes take that makes me feel
good about google
you know
oh oh my clang is done oh that's more
exciting than this but let's go let's go
let's go
fast fast fast okay uh the length of one
number of regular one unit what
one will be split into six triangles two
will be split into 24
triangles
probably scales with some kind of square
thing
i don't know is it just n squared times
uh six
yeah victory no one's beaten that time
come on come on oh
yeah and the for loops work oh who loves
my for loops
you see when you run a for loop it only
runs the incrementer once but when you
run a for loop
it runs the incrementer so people are
like oh well it's the same as i plus
four right so let me change it to i plus
four you think these two things are
going to behave identically
well that actually that's probably not a
good test you know you probably want
that and yeah that is going to behave
identically but what if you do
i plus equals two here
it's not i plus equals four it's
actually i plus equals eight
oh okay stop complaining to me how many
of these did i win
four out of seven what
i don't know man all right but we made
four loops work
now what should we use our newfound for
loop for it's kind of a useless loop
but like i think if we call a function
in here
can we like do printies
it's gonna run that oh wow runs out a
lot of times
oh especially if we don't increment i
yeah you see you see how it printed
print
four times for each um
for each iteration through the for loop
we're gonna call this one super four
oh yeah so does everybody understand the
syntax
it runs this four times if you have a
for loop
we did it stop the clock lots of
printies
if you guys want you can manually type
out this diff that's about to scroll
across your screen
stop beeping at me you can manually type
out this diff and you too
can have four statements in your clan
um let's get diff
into temp claw
how do i copy it to the clipboard
mac copy file to clipboard
pb copy oh
i will call it clang for
dot diff add
support for four loops
to claim
all right enjoy my beautiful gist
ah
um we can feel forever ashamed about
removing this fix me
it was a stupid fix me anyway but there
you go boys
there you go i hope you enjoyed no q a
tonight
uh i'm done with q a because you guys
ask stupid questions
all right good night everybody i'll see
you all tomorrow bye bye streams
bye bye bye
welcome welcome it's a Thursday tiny
Corp evening I think it's Thursday we
got some ice cream boys we got ice cream
and banana
got a spin drift
um we got a keto Rolls Royce
we got a phone we got everything we need
um
um
Bo Burnham the world works
oh yeah you know you guys know this song
Hey everybody look who stopped by to say
hello it's Saco
with Saco
hey
where you been Saco
I've been where I've always been when
you're not wearing me on my hand in a
frightening little space of being not
quite dead not quite alive it's similar
to a constant state of sleep paralysis
oh good morning everybody
uh all right so again we're gonna do
something amazing some micro benchmarks
tonight okay so
um first we can start with why
oh also I put a new blog post out
um it's about wokeism
and you know it's not like oh yeah you
know hopefully you guys know I'm not um
I'm not pro woke them I'm not
anti-wokism
uh I like to think of myself politically
as you know this wave
and I'm gonna surf whatever it is man
you always got you always gotta surf
because if you try to punch the wave you
lose and that's why you shouldn't be an
activist because all activists are doing
is punching the whale even worse than
activists are right-wing activists
I have the worst kind of activists
you know
at least if you're a left-wing activist
you're punching away from behind
right wing activists are punching the
wave you know from the front
uh so yeah you guys can check out my new
blog post
um
I'm not
an act I've never that's the most
terrible thing you can ever accuse me of
being please tell me what kind of
activist I am
what do I advocate for
where can you find my blog just go to
geohot.com and click on the link that
says blog
um bro bro the pirate flag
which is definitely not there
for any political reason it was just a
cheap decoration that I think looks cool
on Amazon
works
Works
um yo I am an activist for Andy Drake yo
yo yo yo yo yo yo yo yo wait wait no no
no I'm I'm sorry okay look I'm sorry if
this is copyrighted but um
this is this is the best song I've heard
in like forever okay it can't be that
copyrighted come on like like like
this song goes out to people who play
golf
[Music]
smoking cigarettes when I get
sad drinking Monster Energy like it's a
fucking ritual
s
yo if you uh
uh if you uh I haven't heard this is
this song man I didn't see your mom last
night because I don't kiss and tell
um no but we're doing stuff tonight you
can't just oh man things have been I've
been working a lot of tiny Corp lately
um so this morning it was gonna stream
it for you but
this morning I got my Matrix multiply
in Cuda to be 20 teraflops
now here's a little interesting fun fact
that same Matrix multiplying opencl is
only nine teraflops so why do I get 20
in Cuda and 9 in opencl
um that's a great mystery to uh to
figure out
but more importantly and relevant for
the now
is
when I run the same
I didn't see your mom last night because
I don't kiss and tell
when I run the same kernel on
uh
M1 I get 3.6 teraflops and you might
think 3.6 teraflops is good but then you
run the I wrote a little uh I wrote a
pie torch one
extra M1
extra Jam M1 Pi torch yeah and pytorch
gets 7.1 teraflops
um and I think this is actually more
like eight
uh
uh oh the camera's covering the terminal
so I'm sorry
uh I must only okay you missed a little
I'm sorry uh okay so yeah pytorch gets
uh eight teraflops and my thing only
gets 3.7 teraflops and that was actually
after quite a bit of tweaking so
now for NVIDIA we have beautiful the way
that I managed to make this work was I
used nvidia's performance benchmarking
tools and Nvidia has a nice performance
benchmarking tools if you follow me on
Instagram uh there's nice performance
benchmarking tools but
uh let me let me take a little bit to
explain
uh why
we are working on making things fast
so this is if you're not in the uh
Discord
um
this is the teddy grad Discord uh it's
100 on topic if you go off topic in the
tiny grad Discord
uh it's you know you you can't
um don't do that uh yeah so like there's
this thing called Triton but Triton has
two problems one it's uh only in Cuda
and two like
I wrote the line right I wrote I started
a Triton back end then let me let me
credit who actually finished the Triton
back end
uh
uh I did not most of the Triton back end
was not written by me
um
let me one of the usual one of the usual
contributors did it let's go to history
here
yeah Mark Martin loretz uh really wrote
most of the track and back end uh and
the trend packing does work but it's
slow so then when you go to make a
Triton back in fast you find out that
making Triton fast is not easy
I'm okay so first off what is trident
we're gonna we're gonna educate you
people a little bit because you know
it's been a while welcome back to Tiny
Corp uh Triton is a thing for GPU
programming it's a little language you
can basically the best way to think
about Triton is like if you think about
um opencl opencl has a global kernel
size and a local kernel size and then
the actual kernel Triton kind of when
you write your kernel you write it to be
the whole local size and it does all of
that tuning for you
um it deals with like copying to SRAM
automatically yes trying is supposed to
do the uh optimizations internally
automatically but unfortunately
it's very buggy largely for historical
reason an open AI there's a ton of
pressure to get Peak Performance on
complex kernels and usually this
required a lot of hacks
uh so yeah
like
so here's how I like to think about a
matrix multiply right
um instead of using dot which is very
confusing to me you can imagine it's
just like here's a square that's one
Matrix and the square is n by K then
here's another Matrix K by n
all right here's your n here's your M
um you can take these two matrices and
you can expand them out into a cube by
broadcasting across that virtual
Dimension and then you can sum this way
and then you're left with the Matrix
here right
um and also some this way you can say
Matrix down here uh maybe a transpose or
something but
my point is like when you write a matrix
like that when you write a matrix
there's two expands and then a sum it's
not fast anymore you have to use tldap
Dot and then like tl.dot has operators
like trans B which will transpose the B
Matrix but it doesn't work
uh so unfortunately
uh Triton is not the future of uh
unless it all gets like fixed up soon I
don't think I think that tiny grad is
going to beat them out
um my other main problem with Triton is
that it only works on Nvidia uh and of
course our goal with Triton uh girl with
uh tenegrad is to Target absolutely
everything now
um unfortunately
uh you left you're left with crap like
this this is pretty much the same kernel
in Cuda and opencl
at least now I'm getting nine gigaflops
I wasn't getting nine gigaflops before
um I was only getting
what I did to change that
uh I was only getting
uh set but now I get nine so that's
great but I still don't get 20.
oh
um can't we simply ditch these old
school matrix multiplication algorithms
and write one that is closer to all of N
squared uh you do that bro you do that
and you will be the hero of the deep
learning world
um
oh so this 20
is the same as kublas pretty much
so this is cool blast now this is
untuned Triton uh and this is on the
same size Matrix so kuboss is getting
21.
close enough uh Triton is getting 17 but
I think Triton can get 20 as well if you
tune it
uh and these are not using any of the uh
test scores because tensor cores don't
operate in flow 32.
so I'm pretty happy with that and like I
went through all like the tricks to make
it work good
um you have to use shared memory there's
a really good blog post on this Cuda
Matrix
multiply 2021
yeah some guy wrote A Blog
make
fast
um
I have it over here hang on
through optimize to The Matrix
modification
wait what Google is so useless it's this
I'll link it in the chat
uh
uh yeah this is this is pretty good so
basically I implemented all these tricks
in tiny grad and it gets the same 20
Tower forms
uh I don't know how they were getting 24
with Kubla I think they have a different
GPU than me
but why on now
on Cuda that's great I have a nice
simple Benchmark
uh I can read the PTX for nvidia's stuff
they have a great debugger tool I don't
have any of this on metal I just have a
bunch of crappy performance counters
which actually turn out to be completely
useless
so what we are going to do today is
grow benchmarks
uh this will be fun
okay
the simple narrative thought in every
history class
is demonstrably false and pedagogically
classist
okay CL micro
Benchmark dot pi
um
I hope no one's out doing activism right
now
so
there's a few things we're going to want
to match apart we're going to want to
Benchmark the speed of global memory
speed of
um
call it local memory we'll use the
opencl terminology
and we want to Benchmark the
uh speed of fmas
so from
tinygrad.runtime Dot opencl import CL
buffer
let's make a few buffers
I forget If I multiply by 4 or not and
that's why I paused
um
this is something that definitely fits
in
that will definitely fit in L2
uh okay let's write a CL program
[Music]
and what's my CL program going to do
we just need to read in all the memory
um yo Hogwarts Legacy guy you are the
reason that we get subscriber only chat
because let me explain who benefits who
benefits from the Hogwarts Legacy drama
who benefits activists and Hogwarts
Legacy that's right
and considering you are neither of those
people you are getting screwed that's
right when the media tells you to hate
your neighbor and your neighbor listens
to other media that tells them to hate
you the media wins and both of you lose
does everybody get it now
um
okay
um
let's
oh yes and because of stupid you'll see
we have to multiply by the OS X timing
ratio
cost of
you know
okay so what is it
you guys know I don't actually know any
programming and we have to just look at
everything
we'll just copy and paste from here
kernel
I'm not sure you don't know if I
shouldn't put the name in there
because the name's already in there and
that's even worse
uh what should we call it test that's a
good name
that will never be confusing because
there's only one thing you'd ever want
to call test right
uh what
that even happened
I want to learn how tools work
um
of course we're going to want to put in
a
uh something like that
none hey that's yeah
[Music]
we got eight thousand
it's not over nine thousand I don't
think that's actually good speed
um
okay and then this is measured in
nanoseconds which is actually a totally
useless
um
we're going to measure it instead in U.S
returns U.S
well actually let's first just measure
um kernel launch
uh let's say multi-bench Mark Frog n
equals 10.
let's call this MB
okay 7.5 USD
uh
that's like the minimum for one kernel
let's see if I
let's try some numbers here
uh
poor eye and range no I wanted to
multiply by
let's just say 10.
okay okay let's say size equals I times
times two size
time
empty kernel launch
size divided by TM
time divide us per current
and all right
valid Global work size
ah it's because you can't start with
zero
okay
oh that is not what I meant to write I
meant to write that
and then you can start it safe
okay well that turns out not to matter
so cool
it looks like it just takes a fixed
amount of time regardless of
or does eventually start to get slower
should we make graphs do we want graphs
boys what do we think of graphs should
we be doing this in a notebook I feel
like this is a notebook kind of thing
so if there's ways to like make
notebooks
if you do this in The Notebook
do we want a notebook
what do we think notebook
Jupiter okay fine
um new files CL no then my Vim doesn't
work good never mind
okay I will note that it starts to get
slower at some point
hmm
let's make this nanoseconds
pretty cool right
so that's just to launch an empty kernel
so what's interesting is this kind of
tells us something about the GPU
this tells us something about the
maximum number of um
maybe a dozen
well let's try this
that's crazy that that makes no
difference
if anything it made it faster
no no no well this is actually the Mac
we're on that on the back
and this is an M1 uh it's an M1 Max
can I disable scaling
what's scaling
uh it's not that that's not Megan saw
everyone said the power scaling doesn't
matter
you no real notes will I okay
no it's not that
let's try
my Benchmark 4 microph what do you think
I don't understand
what the fuck
okay why is this one faster than this
one
all right all right all right how do I
disable power scaling
never mind you're right I don't trust
power scaling
I'm plugged in
oh what is this like power something
power metrics
um
power
down
uh if you find a way to do this I will
uh happily do it
but for now I don't see one
these are all okay
okay
um let's let's get some facts about the
M1 Max GPU or do I have a Max or Pro I
can't keep these things straight okay
um
M1 Max
the 32 core GPU
uh
uh threads per core
total the M1 GPU contains
each GPU core
each GPU core is split into 16 execution
units which each contain eight
arithmetic logic units
okay where's the button to turn it off
foreign
yeah there's no copy and paste to turn
it off
you know I only like things that are
easy
okay
um but okay so each but this doesn't say
anything about how many uh
in total the M1 Max
contains 512 execution units
but then like they have warps which is
on top of this
okay so the basic rudimentary uh uh
idea of a GPU is okay a GPU has okay 16
execution units but you can think of a
GPU like
which execution unit is scheduled uh you
have a lot more running that are
actually schedules at the current time
and you do this to do latency hiding for
the memory
um did I try not running OBS oh sorry
guys I gotta go no it doesn't matter
it's close enough
none of this shit matters
it's just interesting that like
that
every politician every fish in the
series protects the interests of the pad
affili corporate Elite
foreign
which would mean each
yeah each GPU can handle
people like reverse engineered this
stuff
they did a really good job uh is this
Alyssa rosenwig
uh
did a good job
starting to reverse engineer this uh GPU
and they have like a driver
unfortunately they abandon their uh
decompiler
you're the acai people yeah
um
actually let's just keep going with this
what if we just keep going
okay uh
it starts to scale the way you expect
with a bit of weirdness
around here
all right let's just try this Global
float a uh a sub
oh now unfortunately we're gonna have
trouble with these things being unused
does someone like Market or what will it
trick it
we'll just try to copy
we'll name these things appropriately
like that I have to put the name in
there twice
kind of a bug in the API
call this copy
copy
uh a software Global Security
[Music]
okay sub zero equals
except g i d equals B sub GID
um
and this can only go to 20.
that's very fast
I don't think it's actually that fast
that's it working
this is me
oh
wait
no this should work why shouldn't that
work
how are the empty kernels
that doesn't make any sense
how are the empty kernels the same speed
as the global memory that doesn't make
any sense
we're waiting for it to finish
I feel like it's just lying to me and
running the wrong program
or just not running anything and none of
these are working
so you're able to say debugging because
too it doesn't work right because we're
using that
no this doesn't make any sense
how is a kernel that does something
the same speed is a kernel that does
nothing
okay let's first off see if this is
actually making any sense
okay so if we want gigabytes per second
we have size in
gigabytes
divided by time in seconds and those
cancel out
oh
it's like not fast bro
okay
so maybe like
it's all just overhead
uh well let's make this a little bigger
and see if we run into any differences
okay well this is actually okay this is
wrong because so you need to multiply
that by four
but those are all still very reasonable
bandwidths for my thing
uh this is how much eight megabytes I'm
configure than that
and let's keep NS per kernel
and we'll just add that
reverse the order of the size
why
because you're worried about caching I'm
doing caching explicitly
same
okay
well we've learned something today
yeah it looks cooler high grade looks
cooler upside down
everyone always starts with a benchmark
at the top um so this is actually within
the amount of memory we have
ah so that's within the amount of memory
balance we have so maybe it's just not
broken
um
okay finally got a little sour
okay
uh this is stupidly small let's just go
down
it's nothing changes
uh I will also point out that we should
multiply this by two
because that's there's read and write
um okay these numbers make a lot more
sense
so this is with nothing in cash
uh the by the way the stated bandwidth
is 400 gigabytes per second
uh M1 max memory bandwidth
all right so I got a little treat for
you guys
um
let's make sure we aren't allocating
crazy amounts of memory here uh what is
this in normal people sizes
Mega
okay we're using eight gigabytes that's
too much for where we're going
of course we can casually use eight
gigabytes on my uh
huge thing but okay two gigabytes
okay we still see all the behaviors
we'll use one gigabyte
so I'll show you what I have over here
this is a comma three
uh
let's see how it does
so for reference the comma 3 should
huh
CL buffer has no attributes CL
oh invalid buffer size
thank you
one
okay well not everybody gets to use a
lot of okay good look at that oh this is
cool
okay I mean that's pretty much exactly
what we thought we'd get
uh let's see what the max I'm actually
allowed to use this can I do that
great
that's cool guys so when you look up
uh the comma 3 is based on a Snapdragon
memory bandwidth
29 and we get 24.
come with reaction like
I think we down clocked it for uh
and one gig was too much so we're gonna
let me down to it
all right
why did that multiply nicely
well you know what's you know what's
disgusting the numbers after the
floating points whenever they give me
like all those significant figures
uh yeah we clocked out for temps uh well
so the problem is not actually temps but
common three has a great pooling
solution uh but the problem is well it's
it's it's it's thermal dissipation so
the
the chip is underneath the ram
that's a package on package so you can't
pull heat quickly enough out of the chip
so even though the fan is cold the
temperature differential uh is this
there's too much thermal resistance to
pull heat out of the chip fast enough to
run at its full speed
um so yeah this is a limitation of all
like package on package kind of things
uh yeah the coming three runs and we
also want the commentaries to not die
like the Commodities so uh yeah
um
cool
I like my micro Benchmark so far
uh and you can see this one's a lot
slower than just the
uh empty launches of the kernel
when does this hit its break 4096
it's interesting
like
I wonder if this would make it faster
I mean nowhere we're already
we're we're over we're password should
be so it's it can't be faster now
oh you actually can be though
I think it's something like this
okay that's slower
why is that slower
does that make sense
I I did that right didn't I not
I just put four of them in the kernel
instead of one
and that just got way slower that
shouldn't matter
oh
you know what that has to do with
oh that has to do with coalescing
interesting
Okay so
thank you thank you for your
contribution to the tiny Corp welcome
hype train
uh I bet you that's due to memory
coalescing
so
I don't know
whatever I'm pretty happy with this
um let's get the speed of local memory
how are we gonna get this this one's
gonna be harder to catch
oh we should also play with this a
little bit
is that okay does that work fine
and that works fine what if I go to one
okay it really just does not care
anything the other one was faster okay
speed of local memory
um
so we'll start with this
foreign
barrier
fans
okay
let's say float L mem sub 256.
uh L M sub l i t equals V sub g i d
uh
plan on doing anything
oh actually
you know what
do something a little different
no but that's not stupid either way
just for consistency we should really
put those arguments in there right
uh local keyword
you're right I do need the local keyword
like that
but I still think that's not doing
anything because I don't like to use it
and it like knows
these stupid compilers are smart and do
like analysis and shit to know when like
you didn't do it so
uh okay four into iPhone zero
uh High less than 256 I plus plus let's
just throw a quick reduce in here
look for x equals zero uh
ack plus equals L mem sub I
okay uh uh so a few things we should
actually probably check to see if that's
like I wrote the right algorithm
I think I did
either way each one of the kernels
is doing
256.
local memory
okay
somewhat plausible to me
I will note that they're all reading the
same one
probably don't want to do that
okay but they still should be
coalesced I think
foreign
is if you're reading the same one and
every thread it doesn't actually have to
do a read
but like that should be
that should be like complete with the uh
she also don't need to read from be here
if you want to say something like four
you have to get the same thing cool
uh
just a little thing we can do a DOT I
think I called it two CPU
now what's it called
the CL buffer I want to do copy ouch
that's a little annoying
to create the npri okay fine
you won't grow soon it's terrible uh
okay so what should these all equal one
or two four
there you go
except
it should be one of them
oh
what
what'd I do wrong
simply not empty shape
invalid value
oh
that's what that becomes by default
I don't know zero is the end there
oh I don't actually go to Max
oh this can be Max minus one okay
uh
okay cool
I shouldn't do anything I can just leave
that
oh
undo is broken in I don't know what I'm
talking about okay
um that seems like
a good way to get at the local memory
right
for some reason it gets me double the
bandwidth if I do this
let's see how we're doing over on the uh
on the counter
oh that's brutally slow
oh that's terrible
wow this thing has dog shit local memory
bandwidth
and that's even the fast way
should we try it on Nvidia
foreign
look who the goat is we know who the
goat is it's in video
look at those goat speeds look at those
goat speeds boys
um not the goat Qualcomm the goat Nvidia
Apple
boom to be fair to be fair we should we
have to consider uh you know some of
these chips uh had a had a harder
upbringing
uh some of these chips didn't have the
same resources some of these chips don't
have access to the same resources that
the other chips have so so we have to of
course take that into consideration when
we decide if we should let them into
college or not
um no that's it is true though that this
chip only has uh a couple Watts this
chip has a lot of watts and this chip
has a medium amount of Watts
wow look at that look at that look at
that one that's just such a beautiful
number
oh
you know what that number is so
beautiful that we have to add an extra
that we have to add an extra decimal
point just just for NVIDIA Nvidia you're
the reason that this seven becomes an
eight congratulations
um
yeah
oh no that's actually terrible
that's the local memory speed
okay
um
let's try fmas
all right we'll just make some registers
vote for our
foreign
can it
can you please remember Pi opencl
compiler output
which one oh this one
let's see what it says
probably whines about something stupid
program not built that doesn't seem like
anything enough
it says the word pass
okay we'll keep our Loop
uh Plus
all right let's make some of them bees
and some of the Mars
just so they can fight and then we can
have you know we'll just just like let's
divide the people between the B's and
the r's
uh for no real reason just just to get
them riled up man and then they'll never
turn against us you know
as long as we keep the people divided
and fighting amongst themselves
they will never realize
that we rule the world
um okay so how many fmas is it per
current
it's
four because it's float four
times sixteen
okay two
flops equals two of course it's f m a
times four because it's float
I wish python have inline comments
FMA
float four
um statements
Loop
G flops
pretty good
does that matter what we expect
that is how the world works
I mean that's what we expect right
supposed to get you know steps four
bajillion teraflops
you can't know that these are weird
right
can't know they're the same
can't be that smart don't stop being
smart
is this how you play Dwarf Fortress
would I be good at that
all right let's see how many we get for
NVIDIA
that's wow dude
this works great
that's like pretty much exactly what
we'd expect
um I should have told you beforehand
what we'd expect so you guys wouldn't
just think I'm pulling shit out of my
ass but it's a 3080 TI G flops
so uh we're expect to see
34.1 and we get 30. that's pretty good
this one we expect to see 10.4
and we see close to that and for this
one now this is the one I think is not
going to work it's 737 in theory but the
this is Qualcomm and you know you gotta
grade them on a curve because they had a
hard upbringing guys
and their local memory is really slow so
okay
okay 582 not bad
it's supposed to be 700 and uh 37.
the roof line
wow
I didn't expect this to work so well
okay now the only question is
why aren't your uh
Matrix multiplies getting that crazy
high speed and the answer is because
you're a bitch
that is how the world works
all right in honor of it working
actually pretty well we'll let the
non-subscribers talk for a little bit
oh
[Music]
um okay
so let's talk about local memory and why
that one sucks
let me just saying if I do this right
all right is there anything else we want
to test
uh I don't know what else do we want to
test
does doing opencl have the same Paradigm
is
uh Kuda warps and threads kind of
um
so I don't really understand I I just
learned about Cuda warps like a couple
days ago
but opencl has the basic idea of like
you have your global grid and your local
grid
and then your local grid is uh what you
call our this is the closest thing Goku
to Warp
um
yeah
well this is this is so cool
you guys should try it on uh try it on
your computer at home
go try it go try my CL micro benchmark
[Music]
I really don't think there's anything
else I want to test
yeah okay so then we can get into like
Bank conflicts
well
here's something kind of interesting
oh well let's let's first try this I
don't this doesn't matter here there is
no local here so we can get rid of that
and that barrier
oh
wait I didn't even edit it on that
computer okay never mind that's
completely fake
I was like why did it get faster
I was concerned
that it cheated
you know what we do to cheaters around
here
why does it not get fast until we get
here
that's a crazy size
couple minute break
and then we'll do some then we'll then
we'll dive into striding and stuff but
you guys already saw the cool part of
the stream you know what
that was the cool part of the Stream
um
what branch am I in I'm in the fast
Triton branch
uh do we want to see more struggle how
many viewers we got
nah 254 viewers that was a good
Standalone stream uh
cool
we wrote seal micro benchmarks
they measured your fmas they measure
your Global memory and they measure your
local memory
It's a beautiful morning here and sunny
San Diego it's actually kind of
cold also you know I got Corona virus
two weeks ago but we're all good
now
unconfirmed I'm not taking one of those
swabs up the no you
know
uh we had to wait for Alex to wake up we
didn't want to stream before Alex woke
up because you know we get loud on the
stream my neck hurts
too I'm going try to have good posture
during today's stream posture is
important uh let's wait for a few people
to get in here then we have a bit of
housekeeping announcements hi hello good
morning we were going to stream
yesterday but I got distracted check out
my beautiful Kama hoodie one of these
can be yours for just $89
how much are the
hoodies yo this is a merch plug right
here right here on the Kami shop uh
where's the merch store oh merch shop
yeah oh 89 wow wow that's that's a good
price guys you should buy a Comm hoodie
right now get your merch get your
Maverick merchandise here copyright um
don't break copyright don't break
trademark that's right follow
laws uh I'm a reformed cyber criminal as
you can see right right here on my my
Instagram see I'm a reformed cyber
criminal um also recently I broke 30,000
followers so you know what that means
I've heard rumors that that's the
threshold when they can no longer ignore
your your please for a blue check mark
please please I want a blue check mark
um have you seen this oh yes tens oflow
maos yes okay so I actually I signed up
for a Hacker News account this morning
and I responded to something about that
that's using ml
compute uh ml compute only uses the CPU
and GPU it does not use the
A&E uh OS hn thank you for subscribing
yes so everybody make sure go on my my
Instagram is just
instagram.com Georg Hots if you guys
could follow me uh I'd be very happy we
got to get that follower number
up um also
the other thing and part of the reason
I'm doing this stream today I'm like
okay tiny grad how seriously should we
take tiny grad
right have you guys seen the Stars on
Tiny
grad
2800 we are on the pink MacBook Air
right
now MacBook Air
M1 yeah well you know I'm not a
16-year-old girl bro I'm not going to
get that many followers but
um
make no make sure guys follow me on
Instagram uh n GM's kind of okay I mean
it's it's arm64 Ram 30,100 do the
Nintendo hire me
problem what 37 what 30, 30,100 guys
let's get my we got that hype train
going let's Everybody follow me on
Instagram right now hit that Instagram
follow um I'll only go on Joe
Rogan one of my goals in life is to hang
out with Taylor Swift uh and like really
like you know really really like like
like like hang out you
know just think you know I was just
thinking man of how hard life must be
for Taylor Swift you
know and I'd like to I'd like to talk
about
that no I'm not on Reddit guys if
there's a comment on the internet I
didn't write
it um thank you thank
you uh know but like I know like I've
met Lon Del re before I know that girl
but Taylor Swift
man you know just what a what a what a
whirlwind of life we could play Long
live but it's copyrighted so we can't
I'm doing avac code I did badly last
night I didn't get any points last night
I was
upset too fast and I was on this
computer not my
computer I should P Masters fuck scooter
prawn promoting fake pandemic shit is a
ban from this channel that's right
promoting real pandemic shit is a ban
from this channel that's right we don't
take sides here except
ban politics equals
ban um is it more secure or less
secure
um asking for beginner advice you guys
are new to this
stream if I ever give you beginner
advice it's
bad uh just do the opposite and then
that's probably bad too because you know
the opposite of something bad isn't
always something good like think about
you know what's the opposite of like
like some disgusting ass candy like you
know I love what you know like I really
wanted to like Skittles you know I think
I think Skittles the musical was
um the best Super Bowl ad of all time I
just I'm going to let you finish but
Skittles had the best Super Bowl ad of
all time and it was a musical uh come on
we can we get that up to
30.2k how many come on we got we got a
hype train going let's let's just
subscribe let's follow on Instagram we
could do it did deep mine release a
paper is there a paper if there's no
paper fuck them when they release the
paper
Alpha fold 2
archive no there's no
paper this isn't a
paper this is a
tweet nature published a comment they
published a blog post are are you
scientists or are you hype people like
fuck
that I like you know I like deep mind I
like Deep Mind better than open AI but
like don't do this right this is not a
paper what do they say about the
paper alongside working on a
peer-reviewed paper okay okay I I'll
I'll I will look into this
once until we've published a paper on
this work please site this
um no but do you guys know what I mean
like it's it's commercial hype if they
don't publish a paper it's not it's not
it's not like contributing to the field
of
science
uh and yeah we're going to publish when
it's done we'll publish the open pile of
paper
um when you getting your Hammer Hammer
is not real Hammer you guys you know if
if you read actually hammer it says the
following you know we're only seeking
applications for one role and it's
founder and the cool thing about founder
is you can just go start Hammer uh I'll
sell you the trademark for
cheap Hammer what are you looking
at Hammer yo cuz they you know why I
named it Hammer because of the nothing
nowhere song which I would play but then
you know we guys get copyrighted and we
can't play any music we can only play
copyright free
music yeah you can write the blog post
too but if you don't write the paper
don't claim you're doing science claim
you're doing PR right like fuck off with
that
shit the first Al aold had a paper and I
read
it um I don't know who hikaro is
wait oh is there actually a
paper um oh God
sorry yeah this is the first paper yeah
yeah yeah this I read
this like you can have it both ways
either you're a scientist or you're a PR
guy what happened to pixie teac that's
gone
to you know not all companies can be as
successful as comma some some 99.9%
compies fail that's right and I've
already had to fail well Hammer didn't
fail Hammer never got started pix Tech
failed pixite Tech went out of business
very
fast um we looked into the you know
after trying to use Unity to code
something I realized what the problem
with Pixie Tech
was no though
like
um yeah AR will be there what does David
say seven
years seven years oh has he been saying
seven years for seven years guys just so
just so we never get it twisted my
prediction for level five self-driving
is the end of the
decade before the end of the decade you
know they did the moon launch in ' 69
uh I think
2029 you're going to have a level five
self-driving car that's my prediction
and I'm sticking to it and I've always
stuck to the exact same date for The
Singularity and it's 2038 the Unix time
stamp roll
over so those are my two
predictions one's one is uh is 9 years
away one is 18 years away and you guys
can hold me to those
predictions My Stream Advent a code nah
I don't really want to stream Avent code
this year I used to stream at night when
I lived in Luma but I don't live in Luma
anymore all right let's start by fixing
these bugs so I got torch to compile for
my M1 Mac but apparently it didn't
compile with the profiler so let's just
remove the
profiler level four is not
real there's there's really like only
like
you want level four r a Montreal bro
monreal are level
four every shit tier monreal at an
airport is a level four self-driving car
I don't understand exactly why I'm on
Chelsea's iPhone today but I am
so my name it's not small it changed to
Chelsea's iPhone when I was at the
coffee
shop no it just happens I don't know
what is someone going to steal they
going to steal my tiny grad code who
wants to steal the tiny grad code bro
you don't even have to steal it it's
free free
[Music]
free test test net
speed
um t
all right that should fix one of the
bugs and then a view of the leaf
variable that requires grad is being
used
in uh test batch Norm 2day
oh this doesn't require grad um comat
I'm ready for
comat sorry I'm not I'm
not
um view of a leaf variable that requires
grad is being used for an inplace
operation can I just do that
then we're not streaming we're not
streaming uh a
Cod did you
I don't
know all I know is we're
not what cannot assign torch float
tensor as parameter weight that doesn't
work a view of a leaf variable that
requires grad is being used in an
inplace operation but if I go like that
it doesn't work all right how do I set
the batch
Norm um oh maybe if I say requires grad
equals false
here
no with torch.
requires grad
false T no with
with torch.
nograd okay well now it just doesn't
work but it almost
works great flaky ass
test good
enough it works 90% of the time it works
the whole all the time subscribe to
George Hots that's right thank you HSN
not only you're a subscriber you're a
shill for future
subscribers um is there a poll of how
many people want self-driving cars why
do you think that matters do you think
life is a democracy
man oh we care about what the people
want I don't
care care about what I want and you know
oh man oh I love this you know someday
and this is going to horrify somebody
when I say it like they're going to be
like why did you do it and why did you
solve self-driving cars and you know
you're supposed to give some like answer
about like social good or something or
some crap and I'm just going to look him
in the eye and I'm going to be like
because I
can that's the truth
man ah hey North Park what's up I don't
know who big short is shorting Tesla I
don't know um what did what did I I
think I agree with Elon uh Twitter
Elon Tesla stock
overvalued Tesla stock price is too high
IMO I agree with
youan not way too
high just regular too high yeah I think
like like when it was back down here it
was way too damn low but like now that
it's up at like like Moon levels holy
shit have you seen it mooned even more
really oh my God it's now $600 a share
Jesus yeah it went up another 50% wow
that's insane that's actually
insan oh wow this this stock price is
way too fucking
high I think we should just go public
what you want to go public yo how much
this com AI works I'm Rich As Fuck
boys let go let's do it we're doing a
spack we're doing a spack we're going to
spack them
seriously we have yo let's spack it
let's just go public wait wait wait are
there requirements about the
board yeah just make the board your
family MERS great whoa whoa whoa whoa
whoa whoa can the board just be me and
if can we have like diversity for like
when I identify as a woman I'm another
board candidate Georgina Hots person
yeah Georgina man you know she
identifies as a woman and she's on the
board that's
right oh good the test pass um I made a
change this morning that should make
things faster
too uh I changed this to buffer new from
buffer zeros I'm not exactly sure why it
was
zeros
GPU speed
up tests work on M1
uh we turn any heat on
Alex it's cold in here it is you're not
cold there's someone still in bed you're
65 go for
it day I'll figure out how you start
that open it up it's open oh there we go
72 that's a little
hot want me to buy you a
nest all right all right all once we
stack I'll buy buy how much is Nest how
Google
Sal oh you just want a n you don't want
to n company we're going to buy a Ford
guys oh from bed oh yeah I don't one of
those in my
um no we're going to buy
Ford and then the day of the ropes
coming a
Ford
what buy one Nest how much is a nest I
don't know if Google will sell a
nest we'll have to wait till Google uh
gets torn apart and the
uh no well we just Google's going to get
uh Google's going to get btfo in the uh
in the in the the
lawsuit you guys remember Microsoft yeah
the Monopoly lawsuit it's gonna happen
man they back off who backed off the
Democrats or the
Republicans they both
did
Inge who's in charge right now I don't
know neither of them who's in charge
right now nobody know the Deep state
[Music]
can you identify as an ice CR SE bus
yeah that sounds
good uh opinion on cyber security in 10
years guys I wouldn't know anything
about that because only because you're a
subscriber I'm answering that I'm a
reformed cyber criminal that's right
says so right on my Instagram you should
follow me okay so let's get into it how
many people we got in the Stream right
now
ah I don't know what the Deep stay
likes too many how many 655 all right
all right we're ready to get started so
you see this reshape we're wasting a ton
of time in the reshape and this is
actually going to be a pretty big
refactor um so the problem is that yeah
I I'll show you guys the problem
um oh I just I just the can we why is
all music copyrighted I'm going to make
copyright illegal in the new
regime um yeah we're still under a
thousand
lines uh so okay the problem is these
oper these operations that we're passing
in to the uh this like X and W they're
actually already being called uh they're
the data they're not the the T
and the problem with doing this is the
reshape op so if you look at reshape we
actually have to make a copy of the see
like reshape shouldn't make a copy but
this is a big change since the data
tensor can't have shape um so we have to
remove shape from the data
tensor like right now we're when we
create these things we're uh creating
these like you know shape and dtype here
and we got to not do that so let's start
with this big ass refactor
um tiny grad's a great it's a great time
to jump into tiny
grad uh if you've been thinking about
joining tiny grad you should start
contributing we've gotten some great
contributions lately um tiny grad has
great
tests so uh if you're worried about
breaking stuff you can just run the
tests uh we got some some some good pull
requests coming in test improvements
tests are super important for a library
like tiny grad
uh I responded to this issue this
morning it's getting slower so we're
going to fix all that slowness by making
reshape not by passing in
tensors to the
uh the operations
so if you look here where we
[Music]
call
this um
the Ops down
here yeah do you see look we're calling
data here t. data for T in
X
um so let's first fix it for the CPU op
so all the GPU ones are going to be
broken when I do this but let's go in do
it we're just going to have to call data
on them we really only want data to be
callable
on
yeah so I'm going to make another
property here called dtype we're going
to make this self. dat. D type so
here yeah that's
okay but we want to remove shape and
dtype from the uh CL tensors basically
the problem with having them there is we
can't reshape because there's only one
base tensor we want to separate the
storage from the tensor and the tensor
has shape and the storage
doesn't uh all right so let's fix up the
Ops now did I make that
change no I didn't make the change yet
okay so right here we're calling me off
and sorry it's been a bit since I've
really dove into this tensor flow uh
this tiny gr code so take a little bit
to get it to speed here but we want to
not call that anymore here and we're
going to call data so now we're going to
check the test and they're all going to
be broken all
broken um so this is Ops here shape is
still okay to call but we're going to do
x. data y. data and we want to create a
tensor out of that
uh oh god oh this is a big
change
tensor
data have to create it with a shape as
well
so the GPU ones are going to have to be
created with a
shape am I doing this now where do I
create
tensors those are okay
yeah okay
so self. dtype
was I really using NP float 32 is the D
type for the for the GPU
ones see guys see we didn't think this
through and now we have to make big
changes
oh
um that's just okay yeah
so also Wherever We
call we don't have to add shape in yet
to the tensor Constructor so let's take
that out for
now sweet um let's actually do something
fun oh this is going to be fun we're
going to watch the uh watch get diff oh
I wish I had color
watch D-
color
oh oh do dash dash color always wow
somebody else did it with get diff ah
nice Okay cool so now you guys can watch
as I edit the code oh this is going to
be fun like you'll see watch if I if I
make a change like here I'll put the
shape thing back in if I do that you'll
see it shows up right so there's my
change there oh yeah yeah oh wow this is
this is great stream technology boys um
okay we actually don't want those things
there for
shape uh we're going to say here self.
shape equals self. dat. shape and we're
going to say self. dtype equals self.
dat. D type this is going to be broken
for the GPU for a
bit um
see
now this is a
problem well so we're also going to we
also recreate the tensor I believe so
it's not just that change that I made
down there
yeah okay so you see this tensor this is
going to go as
well
um is there a way to say no
GPU someone did like this Mark on test
that looked pretty
nice if
GPU
GPU I really I just want to fix the CPU
test
first uh I guess we'll just hack it for
now so that's going to give no GPU
support and I don't know why we're we're
railing out there but see so right
here I guess I could just say this I
don't know what we're going to do about
this unbroadcast
function already calling the
shape. data. some we'll put a tensor
around that that should fix
that but see it doesn't fix it for
this so that minus sign
there I could I could do
this that
works am I getting maximum recursion oh
because x * Y is now calling
Maul yeah you guys see the
problem how does p torch deal with this
I mean I guess they don't have things
for like Mull and
stuff like we don't have a choice but to
pass in the tensor
gr output that should also be a
tensor those first ones
passing okay infinite Cur
um this is making the code so
ugly I'm not happy about this
I'm not happy about any of this
okay so while you're in a function we
definitely don't want the grad to be on
see the idea is then that like some of
these things can Implement some of the
other of these things you
know like okay adding stuff are basic
this is a big
change the problem is if I
you know what I might literally just be
able to fix this in GPU reshape with a
bit of
hacks let's fix it in GPU
rehap the problem is like our functions
then are different from P torch because
I know P torch actually passes the
tensor in
uh
yeah
let's let's bring up I Python and let's
test um import tiny gr.
tensor uh from Tiny grad tensor import
tensor
tensor uh np. zer
let's just say actually you know we want
those G tensor do Zer 4 comma 4
G tup object cannot be interpreted as an
integer oh
yeah bu object is not
callable that's turning a
Bo oh do Cuda W I forget my own API okay
and somehow despite me setting or did I
just reset everything I guess I did
cool uh
so yeah I have this Pi open CL buffer
object and that's the one I need to
change host buff
release I want to make like a fake copy
of it that has the same underlying
stuff
copy no attribute
copy Associated meem
object
nothing get info
zero valid
value we could also potentially put a
wrapper class around the pi CL
buffer that actually might be a better
choice try copying the CLM object where
is is the CM
object why is this
Frozen
[Music]
Yeah well let's just let's just read the
code you guys see the problem though I
just created the D type and shape on the
pi open clcl buffer
class P open C
buffer so yeah either we put a wrapper
or
open SE dot
seal where is this dot seal
where's the class for this
turn here
open
cl. mind
module. then how come there's nothing
called buffer
I don't understand where's the
class oh that's it here we
go high class there we go it's right
here
I think a rapper class might be the
right
idea wa I don't understand how there's
no more changes that shouldn't be there
okay let's see how we can write
this where do I create C buffers in the
Cuda
method yeah
okay let's go back to let's put that
watch back
up okay so first off I liked the change
where I stopped accessing I started
accessing dtype out
here um and then like everywhere we say
data. d type I mean that one's okay but
like here we should not be saying self.
dat. shape we should be saying self.
shape here self. dtype
that data stays obviously okay pretty
happy with
that
um let's see if the tests
pass they
do if we should be a lot lot more
careful where we use
data um of course data is actually being
passed into the the other
stuff so
we just have to change the Cuda
method yeah instead of returning a CL
buffer let's create a class
called uh GPU
buffer and we have a
[Music]
Constructor
here which takes in
CL buff s buff shape D
type
um can't actually put it
there actually
just do
this this is actually going to be a nice
helper
class uh self. shape equals shape self.
dtype equals dtype
um if post buff not equal is not
none self.
buff self. data we'll say host
buff. all right now
create GPU buffer
self. shape self. dtype s. dat. rvel
actually I don't think I need Ravel
there do
I where do I want to put Ravel I'll
leave it
here okay
let's put that down here by requiring
the GPU
like good place to put
it um we have some functions in the GPU
Ops uh this shouldn't be self. data
should be self. dtype
Zoom this guy out here so we can see
[Music]
more okay now basically those
uh we have some helper functions in tiny
grad Ops GPU like buffer zeros and
buffer
like uh we can keep these but we just
change this to like from tensor do we
actually ever use tensor no we don't we
can import GPU
buffer and like here when we do buffer
like we
say uh actually when we do buffer
new um
else uh
this
right oh cctx
public uh it is
that's nice wait do we not that mean we
don't have to pass in CTX here
anymore that's nice the context is
global I mean that's a later ref factor
it's not used but so here for buffer new
we can just say GPU
buffer uh we don't even need I can put
Tuple do I can put Tuple here can
I so we can just say GPU buffer shape
comma mp. 32 and actually we just make
MP 32 the normal
one oh yeah saving lines boys look at
that okay
[Music]
um uh if we want to do this one now we
can just say return GPU
buffer NPR array. shape
comma host buff equals
NP in fact we can do better
here n let's not go crazy with that it's
good okay that should fix
that um we can remove those ctxs at some
point but let's see if the test pass
first error constructing tensor with
tiny grad GP buffer Ah that's
because yeah if GPU and is instant
instead of Cl buffer we pass in GPU
buffer here but this isn't going to work
because now we have that extra dot buff
that we have to use when we pass things
into the
programs that's
okay in
fact now bop actually just is a is a
kernel here there there shouldn't be
tooo many of
these um we just say dot buff
here or actually let's not to call it
buff I don't like that name let's call
it
CL uh what are X and Y
okay now we're getting invalid kernel
arguments that's fine we got to fix it
in the other Ops so in un op we're going
to pass in
x.
r. reduce op.
imp yeah this is a much nicer
refactor is instant
svm that's a whole different
problem there's a bug inside Pile in
seatt who cares
okay the reduce op now has
one we have a problem in CPU oh an NQ
copy um yeah we don't want to say r
dot well hang
on red. data there is okay but here we
want want to say self.
dat. okay where do we still have
bucks um r. mean.
backwards helper test
stop no uh in fill
oh yeah here we're calling fil and we're
going to call this with grad output. and
r.
uh we still have problems in
com good this is a good refactor I'm
happy with
this sure have problems in decom too
if you actually want to pass in the real
cl to the function we can always put a
wrapper around the function that takes
in GPU buffers the test pass
now um not yet pad today
we should really just put a wrapper
around any function we generate with cl
build that fixes that that'd be a nice
refactor for later but I'm okay with it
for now it's not too many line
changes let's just look at all the CL
builds and confirm that we actually
put this is a good test if if we're
missing any tests okay sub
sample yeah here we
go
threat. input. did we do it in super
sample no we did
not broke the tab
okay few errors still M
Mall God I should have just went through
this and just
locked uh input. CL
add 2D is good Ru uses
unops fixed
com fix those things fix those that uses
the
Ops
okay still tests failing non type has no
attributes see
oh oh input two can be
null um if input
two uh is not none else input to not
happy about
that okay cool fast pass let's commit
this we'll see if I broke the uh the big
tests on the
push oh don't develop my master like
that yeah I know I shouldn't it's
terrible to me not really is guys don't
don't do what I say not what I I do
um
okay uh GPU buffer
class add GPU buffer
class all right let's check for any more
instances of dot dat of data
shape that one's okay but how about in
here now those are G to actually do it
they're not going to do that just it's
used to not passing in okay um that data
shape is fine that D type is fine so now
we have this GPU buffer class oh we can
refactor we can remove all these
ctxs uh buffer
uncore it's kind of ugly that we were
passing in the CTX there
anyway and like we did that half for the
cctx we still need it
for I don't
know kind of
terrible we'll leave it for now at least
it's confined to Ops
GPO I'm me to zoom in more
and you know what we'll move me down
oops not that sorry sorry for the uh
shaky
cam why can't I select me there we
go me down there there we go that's
looking
good uh
cool so now that that refactor is done
let's actually use the power of the
refactor I didn't break did I okay good
did inference in 20 uh 260 milliseconds
now 250 Mills so all these reshapes are
about to become noops by the
magic
yeah so
copy
um work with host
bu um
is
instance instance host buff
comma GPU
buffer then just copy the underlying
buffer
now in reshape instead of having to do
this stupid un op I can just
say
GPU I did import GPU buffer right GPU
buffer shape poost buff
equals
x r
and this unop can also
become grad
output
equals GPU buffer in shape comma host
buff equals grad
output yeah all right we get that speed
up yeah look at them wait why is the
reshape still taking so long
shouldn't take any time at
all get rid of this to-do
[Music]
um gu there's just so many of them
that's just how long python
takes I don't
know it's faster definitely
cleaner did I break the
tests don't know
yet let's just run that test make sure I
didn't break
anything I mean yeah that I mean this is
what reshape should do reshape now just
makes a
copy cool
reshape doesn't copy
anymore oh yeah yeah yeah yeah we have
A&E
support uh sort of we don't have a&
support in in tiny grad yet but we have
uh yeah I made the whole thing work it's
it's in it's committed check it out
if you have an M1 uh you're gonna have
to you have to disable
uh
uh whatever Integrity check I
disabled okay that's a pretty
clean so now we're not using the CL
buffers
directly for
okay what else did we want to do on
today's stream oh yeah memory
management so I wrote this trainer and I
really hope this isn't going to really
break anything it's just going to O
locally um so I wrote this train
efficient net oh yeah we're going to get
a training on
sefar well that's going to take forever
because we got to do GPU equals one but
so yeah it gets slower and slower and
slower and I don't actually want to do
it but we we'll run htop here you guys
can see
it so my Ram now is at 2.7
gigabytes
four
oh is it
free maybe it's free either way we got
to deal with memory life cycle
management I got PE and
do that
by the way look at that
speed those are decent Siz batches I
believe
yeah we're doing with a batch size of 16
we're finishing a batch in like 300
milliseconds so we actually are going to
be able to use this to train uh to train
image those are image not size
images uh you know that's been our goal
all along to actually make this thing
trans image
[Applause]
not if tiny gr is so small why not
rewrite it in an efficient language
because we love
python none of the slowness should come
from Python and that's the myth of
tensor flow and versus pie
torch okay let's figure
out
why I need some food I need some eggs
need eggs
the slowness doesn't come from python
just the crappy code I agree with that
um okay model forward tensor
image so let's call the
let's python have destructors I don't
even really know how this
works I'm not I've never really dealt
with this
before where's some Chrome yeah here we
go python
Destructor is this guaranteed to be
called yeah okay
good clean up
what all arguments are converted during
string formatting
what
what have one argument
and stupid
tuples you know what
no
no you get that
okay I mean it is deleting
stuff why is it getting
slower look fast fast now it gets slower
why is it getting
slower what's not getting cleaned
up maybe just the GC running is taking a
long time
all right let's be very explicit about
our
deletes so first let's put a break
here and now let's put this back
in
exiting all right let's write a let's
write a minimum example for
this um let's write a test test gcp
uh one of the other tests so we know how
to copy stuff yeah we need that we need
unit
test
this let make a test unit test test case
test
GC um oh we could add like stats for
like how many tensors are
shit tensor do
Zer
uh you know I saw this as a pqu I'm just
going to write
it you should have updated your pqu if
you wanted me to do this I would have
happily done it update request GPU
equals false GPU gpal false
GPU GPU equals
false
GPU false oops
GP okay now those methods work you can
pass in
GPU uh let's write the same wrapper I
wrote in test stops it's a good wrapper
GPU false and then we also have if GPU
test Ops test GC
GPU okay let's say 10 zero is four comma
4 say a
b uh C = A * b c we want to do grads and
shit now we'll get to grads next let's
just do that for now
tensor is not defined because we got to
import
tensor and'll import GPU as
well uh invalid syntax I crappy code we
P there
fixed okay name test Ops is not defined
yeah no shit CU it should be test G
see R zero
tests test you see
so okay I mean it looks like things get
cleaned
up um
let's do
[Music]
grads say c. mean. backward
tensors does that
create holy shit that creates a lot of
tensors it looks like now it cleans up
nothing
ah well actually you know what let's go
to our efficient net thing and let's
just Comon out the backward pass for a
minute
and see if that still causes a
problem GP
one uh numpy and Dr has no attributes
CL
what well that's a bug
definitely shouldn't be any numpy in
there how did this only break recently
like I was just doing this and it was
fine t default GPU if OS get GPU is not
none let look and see what else I
broke oh I see what I did so you
actually this is subtle the default
value for GPU is not false it's none and
none respects the
default so the problem is when I added
those zeros function see that's why I
always read your diff you know we
actually want these to say GPU equals
none yeah that's some TR State
shit love that Tri State
does this look like Advent a code
General to you what you guys are
thinking this
is oh that GPU equals none stuff broke
something for you too wait I didn't push
any of that did did I break something
else
actually did did the test
pass oh
sweet no no no test pass okay so for
some reason things get
slower um let's should we just add some
Global statistics about this
stuff I don't really like this
but
um tensors
outstanding equal
Z tensor outstanding minus equals 1
tensor outstanding plus equals one
Global you know what I'm actually going
to do it put it on the tensor
class that's nice
and then we can actually write the GC
test so print tensor
dot I guess we don't need to say tensor
outstanding it's inside the tensor class
we'll just call it
outstanding um and actually that's a
stupid name let's call it allocated
allocated
beautiful tensor do
allocated okay that's zero let's look
there wow still zero that doesn't make
sense uh oh oops
okay uh should check GPU and CPU
differently there N I don't really
care let's just remove the GPU test for
now so we can't pass it on the
CPU still
okay why doesn't delete work
so did
that okay well that's
something oh because I was doing
backwards uh okay let say cm equals c
you know what let's just add mean to
this oh then now there's a hidden tensor
there but it should be that should the
ref counter should get that right away
okay good um so then the test is going
to be
do I just use normal asserts in the
tests that's kind of fun
assert uh tens are allocated equals
equals
z okay now let's do out equals c.
backward ah okay test fails now we're
getting
somewhere we got an F boys we got an F
if you run the backward pass even if you
delete the output of the backward pass
and all the tensors it doesn't actually
go away so that's some kind of memory
now it doesn't
exactly you
know they do eventually get cleaned up
but not till the end so do we have like
a we probably have a cycle
somewhere right cuz the ref counter is
failing so python has two things python
has a GC and a reference counter uh when
the reference count gets to zero the
object is deallocated and this is always
correct but you know if you have two
objects in a loop which can no longer be
accessed that's why you need a GC but if
you're doing a good job and you're
writing good python code you should
actually never trigger the GC um you
know we turn off the GC and a lot of the
open pilot code because why do we want
that okay
so problem is that we call backwards
see what part of backward is causing the
problem uh we do allocate something
called grad but when we delete that that
should get rid of
that let's comment that out and see if
it works
okay that works
now
um we actually create the
grads okay there's where it fails if I
just even call Deep walk it fails
okay and nothing gets deallocated
anymore because it's in these nodes and
visited so what if I delete visited
notes I fix it that fixes it
okay uh I just add that down
here cool okay passes on the CPU let's
see if it passes on the GPU pass on the
GPU too
great um that was maybe all it took I'm
not exactly sure why after that function
returns it thinks it can access
them oh because it creates a
[Music]
closure don't make closures unless you
know what you're
[Music]
doing yeah okay
yeah let's just what if I pass in
visited in nodes
here see the closure that it
makes um let's actually refactor this a
little and say visited equals sets noes
equals
that uh so I can still call Deep walk
self and now let's
return visited comma
notes that should work
right no broken deeply broken
now closure it's making a closure h
okay we can delete visited right away I
think you shouldn't have to use delete
if you wrote Good python which makes me
think I wrote something bad what if I
just delete
visited no you got to delete noes still
yeah you see how they're getting
captured in that closure well actually
no I know the
um ah
sorry okay maybe they're still being
captured so let's say visited equals set
nodes equals
that uh we call walk we pass them
in when we return from Deep walk we
return them but let's not create this
function in a closure anymore let's
create this function
outside uh de self instead of that we
say visited noes equal de self is that
okay oh that
fails
why
oh maybe you can't do
that those global objects
cannot assigned a function
oops there we
go I may we put that in
utils yeah it kind of belongs in
denser and let's hope we don't even have
to delete them anymore
yes got
it actually we don't even have to return
visited visited is just an internal
variable uh so all we need here is nodes
and we can just say reverse deep walk
self boom beautiful now we're talking
that's how you use a GC
boys okay let's go back
to I like our new I like our new little
tracker tiny
tracker um comment that
out and now we can go
so GPU is there that's all
good all good here we'll assert tensor
allocated uh greater than
[Music]
zero perfect now we have a GC
test oh we didn't actually test on the
GPO because we have to say GPU equals
GPU name GPU is not defined uh test gc.
GPU is that how I did for Ops
test no just
self oh I guess when it's created that's
fine
perfect
okay um let's go in here
tensor allocated I called it
allocated what I call it not test Ops
oops it allocated good my naming is
good okay
seems pretty consistent it does get
slower I don't know
why that is a great mystery why it gets
slower let's add back in the backwards
pass and see if the same thing remains
true oh no we got leaks boys we got
leaks okay how do we have leaks what's
leaking see the leaks look at the
tensors they're leaking I see leaking
tensors uh dell
loss it shouldn't need to no okay we got
leaks we got get that leaks down to
nothing my GC test pass but it doesn't
pass if I move it
here um so what's broke
log soft Max can I do
that
fine Dell out y loss
print.
allocate still
weaking okay what's leaking and how
I get anything
else oh we're running multiple gradients
on the efficient net
okay
uh yeah let's okay we can replicate that
in the
test say A2 equals that then we want to
say a a 2 * B
yeah h
no oh but yeah
okay that test is not this isn't the
problem when you delete all the T
the problem is when you're keeping one
tensor
around let's leave that simple test for
the gcity now let's create a complex
test for the
GC so first we create this
tensor uh we don't need log soft Max
that's not the problem
problem and I don't believe does this
even return
anything I don't think backward returns
anything yeah so that's not even
real um okay in order to test the
complex one we want to create
see if that test
works okay
good uh let's create three
tensors well
no um print tensor
allocated DB print tensor
allocated okay so our two allocated
tensors are a and a grad that's
correct
um let's make B2 now
okay there should be three allocated now
what if I do the
mean six yeah that's not
good oh I mean this might even be why
it's getting
slower because some CT X's are getting
really big there's some like bug in
using the in using the weight
twice yeah that shouldn't be
six where are all these other where are
these other tensors
things are getting stuck attached to a
print a.
CX hensor has no object
CTX you want to order some food
dogs eggs
yo we could just make some scrambled
eggs I think you make great eggs that'd
be
sick yeah yeah I'm sure you're going to
make great
eggs okay so somehow there's tensors
even though
well okay we have to get a little more
granular here c. mean
C.C yeah you see how we're getting six
there and it should be four
yeah so now we see the test
fail because something is remaining in
the
context which I don't exactly
understand after I do that there are six
all at 10 because something isn't
getting
freed fix that and we fix the problem
with the efficient
training do I assign
CTX here when I apply a method
I didn't apply any methods on
a so okay to be clear the four tens that
are allocated here are a do grad and B
do grad and a and
b see those
exist I don't know what the six tensors
are allocated here I mean I guess we can
add them all to an array and we can
check um did we get A&E support yeah so
not in tiny grad yet but in the tiny
grad repo there is support for the Apple
neural engine uh and we can get to that
in a little bit later today day after we
fix uh some of these
bugs uh did we get did you guys follow
me on Instagram oh good 30.2 all right
let's keep that Instagram going up I
applied to get my blue check mark and
I'd love to get a blue check mark that
would that would put me in the category
of famous is and I've always wanted to
be in that category so if you guys can
cler I'm one step closer to meeting
Taylor Swift you know she has a blue
check mark let's see does she have a
blue check
mark oh I don't just want to you know oh
look Taylor Swift has a blue check
mark
oh I don't a see
Taylor blue check mark me no blue check
mark Taylor blue check
mark wow she doesn't follow anybody what
a
narcissist follow me on Instagram
boys uh let's figure out why the GC
doesn't work and then let's show more
for Instagram that shouldn't be six like
why is that
six what is getting stop where
understand what if I make a new
one six yeah so that makes
sense oh um let's look for grad so a
actually already has a grad are we just
not zeroing the grads is that the
problem do I have to say a. grad equals
none
ah wait so this is actually just a
straight up normal torch
bug like we just didn't zero the
grads
yes now that still doesn't explain what
happened
um else t. Grad Plus tensor
G so actually the problem here is that
that can have a
gradient I see the problem
uh so we're accumulating the gradients I
mean this is totally broken on yeah we
have to fix this
anyway what is
g it's the GPU buffer object
yeah yeah so we kind of have to do like
you see you guys see the
problem it's
that which is normally okay but it's
creating
[Music]
yeah
well
actually I the problem might
be T grad have a
context I just delete that it should be
okay
no it's always none
um which
up oh are they bad if they say they're
bad they're bad they just don't taste as
fresh and
delicious that that was
you know remember Halloween that was
before
Halloween
get that sounds
nice so we're creating a new tensor
there
I oh the problem the problem is this
plus
here it's okay the chickens don't
mind
um yeah so that's
creating but I don't understand why t.r.
context doesn't doesn't have anything oh
no no no no no it did it did it did one
of the times it did ah okay so I think I
can just say getting we're getting
Eggies
there we go
fixed just need to delete that
context um
no no backward pass through the
ad
done test passes I'm
happy and now let's try the big test
perfect 671 tensors allocated wow that
was really allocating a lot of stupid
tensors um we also have learned that we
need to zero the
grads so I think I have a helper which
gets all the least if I don't I want
one uh tiny grad
utils no so I have a method that
converts models to Cuda don't I maybe I
just uh no I have parameters which I
pass into the
optimizer no I don't that I actually
just hand coded that for each stupid uh
thing okay well that's a different bug
from
this uh let's see if I wrote anything
that we don't want to
commit um we don't actually need those
Dells anymore think we can get rid of
them let's just
check I mean yeah it's more tensor but
it's fine they get
deallocated actually faster with them
though leave
them that's
good no backward pass through the ad we
did the Deep walk refact
Factor we increment tents are allocated
decrement tents are allocated we added
two lines there that got moved to there
okay that looks
good fix memory leaks
add GC
test okay um now this is a bigger
problem we don't have anything called
parameters we're going to need to find
parameters
to zero out all the gradients and to run
the optimizer on it so did I really just
hand write it for
everything yeah I did damn
it there is going to be a
nightmare see the
problem so when you go into the
efficient net there's no way to get all
the parameters
wait we're actually getting Eggies I
don't trust
Eggies oh like a box EGS
I could eat three eggs maybe
four um
all right we're going to need to ride
something that just walks
classes should get all the parameters
right
there's going to be some fun
python from Tiny grad UTS import get
param
parameters parameters equals
[Music]
model python
uh
iterate
object attributes
import name get parameters I'm tiny do
not save
it save
it
good uh comma type V
okay
um it's not say
model it's
fine uh
if is instance we can tiny tensor here
right instance V
[Music]
tensor parameters. pend
exit doesn't
work
no GPU buffers oh no that's just okay
that's just the print okay we're finding
those
ones
um
okay if
is instance the
list uh
map get
parameters
v
um no fine for x andv uh
parameters.
extend get
parameters uh X
int has no attribute
deck
if I want to avoid
that um
python has attributes
if has Adder
model uh
dict torch makes you use special lists
for this and I think it's kind of
stupid okay we found a lot
more um let's print length
[Music]
parameters and then
115 good
uh oh well we didn't get them all
because of
that
um 360 is that right
get rid of that
print
360 we can add it to efficient
Nets
uh print easier
length let's just do this quick
did I do it right that should be 360 as
well didn't
happen oh because I guess I didn't load
the torch
model uh we just run the other
example 360
cool happy with that
let's get rid of those stupid
enters we should refactor and use get
parameters everywhere can somebody do
that I'm going to push this and think
you guys go into all the tests like
everywhere in the test that my models
have stupid uh parameter things we
should just call get parameters on them
I would appreciate you if you did
that uh okay let's zero
out or p in parameters p. grad equals
none
cool oh you hand go to the parameters
for a fishing
net yeah well that's we have a get
Paramus class and I like the idea that
it's a class and not a method like the
way they do it in pie torch I think it's
more beautiful this
way why does that hang
deallocating something massive that's
what it seems like oh
well get
parameters all right now let's run it
through the optimizer let's
go actually we're not really training
yet see you
soon you're dressed like you know when
like the celebrities don't want to be
noticed and they like a hat and glasses
that's how you that's how you address
it it doesn't learn you've tried it well
maybe it learns now that we added in
zeroing the gradients and shit um oh it
doesn't learn because the batch Norms
are wrong we gotta we
gotta we got to we got to write the
batch Norms to make them work
okay we need an
Optimizer let's get one from test test
mest which Optimizer are we going to use
adom of
course is my train Loop
here after backwards we're going to run
optim
step does it work let's find out name
Optimum is not defined yes we have to
import the optimum I
know tiny gr optim has no step oh
because we want to say optimizer
wait oh we have a zero
grad oh I didn't know it had zero
grad oh we have a zero grad that's
nice um
let time that too
nun type object has no
data who's a nun
type I don't know what if I do SGD does
that
work unsupported type for non- type
intenser oh my God are they not all
getting
gradients I feel like they're not all
getting gradients
which one doesn't have a
gradient uh 4 p in
parameters print
P okay a whole lot of them don't have
gradients what doesn't have a gradient
let's write a printer for the GPU buffer
object um tin gr
tensor
here rapper what I it
GP buffer shape one with grad
none what are
those damn it don't make me get the
parameter
names I have to write parameter names
too feel like I'm going to have to get
the parameter
names they have shape one and grad none
why are they showing up as
parameters what stupid tensors did I
allocate inside the efficient net oh
it's the running mean in batch
Norm that's stupid anyway
um yeah numb batches
tracks let's get rid of
that there we go that was a stupid thing
anyway uh I think this might be broken
now cuz it's like oh it has no attribute
num batches tracked we'll just exclude
that
k. ends with Bates
trct
continue you know what now this isn't
really right
how does torch deal with this what if I
pass in parameters that have no
gradient should I fix it in the
optimizer
um I guess what happens does anyone
know uh uh no the the bat moms have
gradients right
now um they they don't not have
gradients uh does anyone know how
to what P torch does if I pass in
something that doesn't have a gradient
to an optimizer
we' have to add that everywhere
tensor requires grad get parameter
should not pass the weight without
gradient I'm not sure that's right cuz
no get params can't possibly know which
ones have gradients and which ones
don't binary op unbroadcast oh now
that's a different
issue um oh well that's
stupid uh yeah yeah these are because
these pams you have to save pams with
grad that's not
right that's not
right see the
problem we really shouldn't be using a
numerate there in the first
[Music]
place okay as much as I hate it
can't believe I added six lines for that
shit just skip them in
Step yeah yeah I mean that's what I'm
doing
now am I over the line budget now that
was six stupid
lines uh where' my trainer go
perfect oh all right wait we got we're
back to we're back to leaks we got leaks
again oh it's because the optimizer yeah
the optimizer is not running without
brass which is what we need
add requires grad to our
tensors it's the only way to fix
that yeah Pam requires grad will ignore
them oh okay so we'll just say if T
requires oh if it's in requires grad oh
that's
interesting yeah okay okay I get
it CU then we can do
the yeah so in torch param yeah okay
okay so we can get rid of those stupid
lines and now let's change this params
here to be x4x in params if param if x
requires grad equals
true now it's going to complain it says
it doesn't have requires grad but we're
going to add it
here in a nit
requires grad equals
true perfect
okay now n type has no attribute data
because we didn't actually set requires
grad on those let's go into batch normal
we create the
tensors here we say tens oh my God it's
zeros uh we can just set it afterward
requires grad equals
false okay that fixes the bug that's
pretty
clean now
we need to set require we need to set
requires grad equal false on some of the
others we need other things to respect
that
respect uh so
CTX here we
go CTX save for
backward got to think about how to do
this so the problem now is the optimizer
is actually Computing gradients
on the optimizer itself is computing
gradients
this is going to make the optimizer a
lot faster
too uh let's see does SGD have the same
problem we'll get to the harder ones in
a
minute no okay so it already doesn't
happen for SGD don't exactly understand
why I mean that should
theoretically I think when I create a
gradient tensor we should say requires
grad equals
false where do I create grad
tensors here's
one wires gradal
false and then here I also create them
T.G grad do oh
actually
um yeah okay let's just make
then we can remove that
Dell if I make requires
grad uh
okay if I fix requires grad so we still
going to have we're going to we broke
the GC
again that fails but only because it's
not respecting requires
grad um
so I can't just say if requires grad
don't run the backward pass on it but I
can actually definitely not set a grad
on
it maybe that's fine for
now if self. requires
grad true
don't compute the gra we don't
need broken
deep walk needs to
yeah that shouldn't be self I want to
say here
T did I say
self it will require the grab
not even
work there a false
okay need to make it kind of inherent in
the backward pass and that'll fix
it
um
well think I can say if requires grad
equals false don't create the
context context is created on the new
tensor though let's just like look at
the Ops and think about this
um ah where do we create the tensors on
the forward
pass
here
uh for
H okay that's pretty good did I do it
right that's running the optimizer let's
just make sure the test still work
cool that was easy
let's fix Adam
now yeah this just shows you guys all
the beauty of pie torch like just how
much thought they put into all this
stuff it's so good and you know you
wrote something good when it's just easy
to
implement uh okay let's go over here to
Adam create all these tensors we just
need to create them with require grad
equals false oh my God this stuff is so
ugly so
ugly wants to refactor this
all right 1300 sweet
okay what the optimizer Optimizer zero
grad take a
step um num batches track require grad
equal
[Music]
fall okay okay I'll write it that should
be on one line
I'll write it but there there really
should be some generic way to do
this you
know not do not copy and paste this for
all the
stuff
actually can I just pass through KW
arcs should work right and then that
should work for require grad too
right let's check it first before I go
and write all that
shit
hello here is
it turn it down a little feels good
feels good I know you like that heat
yeah pass
out it's going to have Corona
virus I don't know I haven't read
comments at all we've been we've been
coding
hard
yeah okay read and read and read and
read and reading the code yeah I know in
torch the defaults false but I think the
default should be true I think torch got
it
wrong but we can always flip it
later
um can always fli it later and massively
break the tiny grad API for anybody who
came to rely on it for their very
important
work
what yeah you
saage all right
cool that's a nice apartment I love the
exposed concrete
beams this is Alex's apartment you guys
you don't want to see my apartment
I got a shower feel dirty so clean so
clean oh I got a shower what I found
what new drink to try what is it it's
kombucha and
hemp I don't know is it green tea o
clock how we doing on viewers
boys UPS shipment on the way oh uh oh
out of
ram wait how how is that using Ram I
don't get
it check the allocated tensors are the G
is the GPU memory
leaking oh okay let's make sure it
actually doesn't
leak uh well you know I should be able
to write that in the in the in the
python in
the for class
oh shit no that doesn't
work you would assume it would release
though because you can't delete it
there um
there is memory leaking it
seems maybe not I don't know
looks like we're actually just using a
lot of
memory maybe this is using
memory what's using memory what's using
my five
gigs I mean OBS sorry boys but you guys
are using a lot of
memory what's using five
gigs I don't know why I'm on Chelsea's
iPhone today I really don't who the fuck
is Chelsea
yo she's probably at the coffee shop
this
morning where's all my
Ram Chrome that's got to be using a lot
of
ram wait is this not a uh
who's using my Ram feel like I got my
Ram
stolen sort by percent
math yeah guys how am I using 75% of the
ram if everything's not using any
Ram try
Purge unable to purge disc buffers
operation not permitted man
Purge Force disc cach to be
purged no that's not where my Ram was
going are there like GPU is there GPU
memory allocated right now that I can't
see and I like allocated it somehow in
tiny grad and then it crashed in a weird
State and now it's using it
kill
python no
python where's my
Ram who stole
it what's Apple's version of Nvidia SMI
yeah that's a good question someone
stole my
[Music]
Ram and using a gig of
swap my poor my poor
the okay let's see system not
preferences what's that system
information is this going to tell me
where my Ram is where's my ram
memory well I know I only have four
gigs what's the thing like like there's
an apple thing that like lets me do
that's like this but good right you know
what I want activity monitor yeah
UI kit system a
OBS
twitch.tv github.com oh that's all using
a lot of ram okay byebye github.com
Chad is really using that much okay well
we exited
that okay never mind who said eight gigs
of RAM was enough it's not
previews using Ram I never use Spotlight
why is that using
Ram flock is using 83 Megs of ram just
for sitting there can I have my Ram back
bro Memory use compressed who compressed
my
memory htop M to sort by memory oh
that's cool
energy oh well how much global warming
can I prevent if I kill OBS sorry
Twitches we care about the environment
here on this channel this is a Christian
Channel Windows Server kernel task this
deleting those seems kind of like
deleting system
32 um no this is this is honestly where
the hell is my Ram this still it doesn't
add
up what's wired memory
well if that adds up to seven no it
doesn't it even it even tells you the
truth here the app memory is only 1
point oh that doesn't add
up what is wired memory belongs to the
current Kel what if we delete the kernel
do we need a
kernel app over the network to use RAM
on their server only Google would do
that if Apple did it it wouldn't be
reliable if you buy iCloud you get Cloud
Ram all right we'll we'll I'm I'm G to
Kill
Colonel no look look look my
no stop using memory
guys I need the 6 wait whoa whoa where
did this one come from o ahd helper what
is this crap using three gigs of my
Ram part of Rosetta
2o oh I
see it was H wait where'd it go
thank
you mining crypto o Pacific Blue MacBook
Air oh that's pretty
nice oh so beautiful okay well I should
have bought the 16 gig
Edition it could really be the GPU okay
how do I see my GPU
Ram I'm going to install Ubuntu on it
that sounds good let's switch to Ubuntu
you think streaming would ever work oh
you know what's an x86
application
OBS did they build OBS for Max silicon
yet
whatever I stole my
Ram underwear NOS but for Ram okay so
what did I promise we were going to do
in today's stream let's take a look at
the title so I can remember because
otherwise I don't
remember twitch is not tolerant to
having extra
slashes all right we've got 745 people
here that's nice and we're going to do
sear oh we're going to do SE far wait
what car not that se
far um and we're going to do
A&E and we're going to do speed and
we're going to do memory management so
we did speed and memory management now
we just got to do CFR and then if we get
to it some A&E
oh window GPU history on activity
monitor all right all right window GPU
history I don't know let's let's go
train let's see if we can actually make
that work uh
fun uh tiny
gr let's get some screen back oh yeah I
got rid of Z fuck zish and Bash is the
best shell to ever exist and normally I
don't have strong opinions like that but
after pressing the up Arrow and z and
having it it's a terrible shell everyone
should use bash and get rid of Z and
this isn't like my opinion on Python 3
which will change two years later zish
will never be
good apple changed the default shell in
Catalina to zsh instead of bash and it's
terrible and I don't know who did that
and what kind of political controversy
that must have caused inside Apple
but it was terrible choice and someone
should feel bad about it why is terrible
like I don't who did that you know we
could find that person boys we can find
that person and tell them what we think
of
that oh look we're using the
GPU wait is there a window for the
neural no that'd be too much to ask
look at that
memory it's not memory that's just the
GPU and how much we're using it oh my
God okay
well took you 5 Second to find the post
about separating the zish history yeah
but zish sucks do you want to spend your
life trying to find shitty zish things
or do you want to just say never Z
oh bash had a licensing issue oh that's
even more sad that is even more
sad
um I've never tried to code in zish
coding in bash is a bad idea just use uh
use
Python all right well you know what's
nice about this MacBook I've never heard
the fan go off once it doesn't have a
[Music]
fan for a poor person who can't afford
Apple what is neural engine you'll never
know bro why don't you make money and
stop being poor that's what Martin scy
would say it's good
advice there literally this computer was
$1,000 and tell you're a student and get
it for $8.99 which I forgot to do this
time Alex we forgot my student
discount
what I'm a student of life and I want my
student discount have a student ID I do
have a student ID it's
true yeah you get crappy eight gigs of
RAM which is not enough RAM I should
have got the 16 gig
one should I'm going to buy an M2 with
gigs and isn't everybody a student no
some people have stopped learning and
they're not students and they don't get
the
discount all right where where where are
we going let's let's do c all right so
for those of you that don't know cfar is
Tiny image
net have some util for this
right it's an
extra where's my Mish shit I put it in
the test
n all right let's you know what let's
just edit the example and have a t one
see
far uh examples train efficient
net oh actually will this just work
okay well it works fine on
tinies those are the size of CA
right
perfect should we do this in a notebook
[Applause]
oh do you like downloads that take
forever
see
python
d
e how gross this is how do they do this
read me.
HTML it's a link to that
loaded each way each of the batch files
contains a dictionary with the following
element why did they break it into five
batches why did they do that batches
meta is that a pickle
right
real
we have to open it with rgz
string
byes T file
byes B iio from a file Ops
great positional follows keyword
argument
that smells like pancakes I baked bread
you baked bread yeah I love
bread
oh should that not be on one line
probably not
get
member get
members why why would anyone do this
just like write this
crap get member tar info
object
unpickle from tar file tar file
python on pickle
T EX file extract
file uncompatible with pickle
exct sh
an iio buffered reader
object asky Kodak
pickle
load EXT really is that really what I
have to do io. bytes io.
read that makes me so
mad wait I think I'm just
ter
is it a string and not this some Python
3 bullshit no
bites what that should be
okay why is it trying to go to ask you
there
what I
do should I just download the C far
meant for
C binary
version Oh encoding equal bytes oh let's
try
that
okay now we're talking what if I don't
read and I just pass it into load does
that
work no it's going to be like that's not
the right file type you need to pass it
oh no it works okay cool never mind all
I prematurely
[Music]
reative okay load see fireworks all
ready for bref yeah let's eat
oh oh oh sorry the key isn't data it's
bet data that's right Python 3 boys
Python
3 oh oh is that the right shape no of
course it's not the right
shape I don't know what what 3072
is well the first 3072 bytes are the red
Channel they're stored in row major or
do you read me do you read me do I have
to reach through the TV you know that
s
um equals
DB batch labels labels data file names
right
thank that's right isn't
that so slow
what type is it
all
[Music]
right uh let's look at test mest
can you guys see from over
there then we have to unplug the monitor
that's going to
break no no Alex I'll join you for
breakfast thank you for
cooking I love when you cook
things okay Twitches you guys are just
going to sit right here I'll make I'll
make chat big so I can see
you oops wrong
window show you the
breakfast yes is what Alex made me this
beautiful Alex you're interested in your
turo wall lamp
I don't know what that means oh we have
eggs we have we
have
apple thank you
okay so after
breakfast your wall lamp which one the
big ball they also think you're paid
out where would you
find I he the Japanese
are oh yeah
W the big the boob the
sun loves that
light nothing in my life is more
important than that
light the one that looks like a turret a
what a
turret t r r e
l oh you're talking about the artist
James you've heard of this guy we I've
met him he's
great wait it's on my to-do list I'm
going to go to the
crater and play about this
you you you don't call you gave him like
$20
million no wonder he's
gross not broke
anymore we got to turn my it is like a
Terrell I really would like to date the
light I think it's from the 70s
definitely custom
made the light
mhm I any more like
it do that make you a light better CU
custom no cuz there's no more
light I
mean I've seen a lot of stuff in the
design world I've never seen like an
office shelf you just buy from the store
light this before the thing that I love
about my MacBook is that there's a
million W Dr on there
I would make lights and sell them what
if your light breaks and what if you
write code that runs on your light it'll
only run on your light what's wrong with
that okay the light is very easy to
repair it's quite simple compared to
your
magbook any person who can just go get
an injection I mean a big molded piece
of
plastic put a light bulb in it I guess
the real beauty of mass production is
software it
is I me if some doesn't have software
doesn't really
matter but like do have sofware and the
Hue bulb well yeah but the Hue bulb is
mass mass produced and that's why it's
great
want close the window
a oh the shades I don't know how to use
those I would the sh yeah
exactly those chairs look so
uncomfortable not going to lie wait
they're not they're not they're totally
comfy got on the
table finally T oh we can make the
camera bigger so they can see more
the chairs are pretty
comfortable they have a seat pad on them
a seat
pad you're not
sitting oh yeah they
do you see far is Tiny image M I thought
it was a Center for Applied
rationality maybe it's pronounced sipper
it has an i in it c i f it's some
Canadian research
people it's almost sh it's almost
sh you guys see our Christmas tree okay
you guys watch the Christmas tream
they asking where the photos up on the
fridge one the grer
yeah Harry bertoa chairs Harry bertoa
means a famous designer is that who made
the chairs how do they know very famous
like very very famous
um James ber who's heard of all these
people
James who's the only B I know of is the
Apple guy bertr
Russell oh no and the
philosopher no that's not who is Beren
um who's the philosopher who first name
is
Beren philosoph
no Che
and my neck H after streaming two weeks
ago you really own
that this like some philosophical thing
about how how Apple writes the software
and it's closed
Source see they're going with this I
don't of course I don't
T is what we should do with this hole
say bir Gil
oil heard
that
yeah yell
I don't know why but there's a parking
lot and it seems to attract a certain
type of
person um I've seen like protesters in
it it's just like a random parking lot
right there doesn't really make a lot of
sense oh we tried to prove 1 plus 1
equals 2 yeah that didn't go we're still
not
sure that was a day long
um the Mario the guy who wrote metam
Mount came in and wrote a proof for it
his was
good
so 1 plus 1 = 2 has a proof written
right
yes just not in metam R
Top you still playing
not New
York no
problem I no no the proof stuff just
kind of might not be the
future really
well like right now all of software 2.0
these are written in software
1.0 I feel like we're going to start
writing software 1.0 and software 2.0
and that's going to be a revolution
probably like we're going to have like
your own
network what are they
saying
11 M set exists define successor
function successor 1 equals 2 by
definition yes now write set theory
first this is reality TV you guys get to
see our Sunday
realities reality t
I'm going to go answer emails my
bed yeah we
go don't use your phone to do things
you're just slower at it's so
true oh look I got this is going to be
terrible or
good big compan is trying to P it out
it sign me
up I don't know
that do anyone made black Liv matter
toothpaste I gr teeth exactly and if you
think black matter you got buy black
matter
toothpaste it's like it's a toothpaste
that guilts you into buy you know
mhm I there's a market
think about it if some store refuses to
carry our
toothpaste we can s to Twitter or
any am I millionaire not broke for Life
bones are good for calling people that's
correct boys if I was rich you think I'd
only have eight gigs of RAM
they know nothing
about finished painting today too P what
on
canvas what happened to the painting
that was on there now it's now it's
gray it we're going to keep working on
it okay I was going to stream yesterday
but I went to the office instead and
looked into Toyota
issues but add steering ports to the Cal
filter but the problem is steering
torqus are not
torqus need to write a function we can
use this function in both ways it takes
in
yeah so the pr yeah you do have like
Compu Ram mobile Ram is like $6 a
gigabyte GPU Ram is like 10 that's a
g it's only like crappy desktop r that
you can get for
three a tree
yeah real tree M you real tree yeah you
go shop it
down I I mean like a Christmas tree it's
like a tree oh
l a r
tree indoor tree
coming on
Tuesday how much was it I
got good
choice
,000 better
than they are
not but we'll settle for the I imagine
we won't sleep on the floor anymore do
not the floor but I read bad for your
mattress to sleep on the floor
what is this what what are we doing
today what are we doing today we're
eating lunch now we're going to get seaf
far we're going to train on sea far
fixed a lot of the bugs in the training
and Tiny grab where's the terminal guys
we're taking a lunch
breaked the
food one day boys one
day shout out to the person who reminded
us about our posture yeah no I'm ready
going to move to Virtual
you guys all know that right me
too called
the we only use v100s I look like I've
been to wear
mares to
Morocco I love
Morocco
numbers how can I read from so far it's
really hard the words just
one
day read the third word can you wrap
[Music]
now half Alex George
I need a couple more
things I want to move virtual
reality travel regular
reality
right is the best
you guys were complaining about how
expensive stuff is they try being rich I
recommend being rich just try it it is
lifechanging yeah nothing's expensive
let me tell you what makes you're rich
you know there's three kinds of
mentality in the world there's poor
people mentality the middle class
mentality and the rich people mentality
if you have the rich people mentality
you're
rich yeah don't be poor definitely don't
be poor you don't need any more things
in that place you can be middle class
and actually with the middle class
mentality towards like money it's the
closest to like uniom or type two and
you might be the happiest why do I have
a
coloring it's true
I for people who you know I me it is
like a middle class attitude to explain
about complain about how things are
expensive but if you bothered you that
much just try being
rich what are those
chairs what's doe Dead on Arrival
what oh oh chairs out yeah hear my
chairs J fixes poverty no poverty is
inside every person more what to
fix you know what would compliment the
chairs really well a bed of
nails I it would be really cool to have
like a big piece of w and we na through
and then you put the bed on top and it
was just like this u a bad Nails yeah be
really sick that' be pretty cool that's
a great
idea we should make that the problem is
we have to make it can we make it with
software don't bother me but it would
measure to Japan two second I agree yo
that would be sick you know what would
be nice if rich people could fly to
Japan faster but right now they
can't these chairs do look like a
shopping cart
well they time they were trying to use
like modern materials was like post
World War to almost most Furniture been
made of wood and they were exploring
using um kind of like pedestrian
everyday materials as Furniture know
hoping to be able to mass produce it you
know what would be more comfortable what
plas that was also a popular material at
the time no I
like become a corporation yes first of
all we already are a
corporation on iron paperwork
done and we have the mentality
Corporation that's right um are they
doing or
math
hyperloop can you read the chat Alex
it's it's
far I it's really hard yeah being rich
is much better before computers now
everyone has access to the coolest stuff
already vers sex like different days
different things I hope you mean
the no Alpha fold they didn't publish a
published a press release just
C matri see yo we were transposing a
Matrix
wrong if you don't transpose it with
using little kernels and you write it
the stupid way it destroys your cash
where do I buy my clothes everyone in
com got a big lecture about cash my
favorite internet store is Essence SS n
e that's onine I think right now and
also has great clothing we we get a plug
from
Ence is based in
Canada but we we should get like paid by
ESS yeah I almost I almost have a blue
check Mar my Instagram I got reached out
to by some smoothie company to be an
influencer and they give me free
smoothies if I posted five stories and I
was like that's not worth it I'm Holding
Out for a better deal you're going to
find some disturbing things on Essence
yeah hold out for a better deal you know
what don't talk to me about all I think
of when you say dist things is holes a
lot of D is closed I got a bar but bar
now Barney is closed down forever really
wow really sad should we bought in my
other house I bought a bunch of stuff
from the Barney's closing sale like
Barney fixtures should have we bought
Barney we could have bought Barney sa
bought it and they shut it down really
sad you think we could have brought it
back I think I I could brought bar back
why we bu just such an terrible online
strategy why why don't we get a lot of
money and buy
Barney um tell them if they want they
can pay me
and I'll I'll buy them clothes for you
really can't get tra from here you what
you can no
sorry it's $500 an hour and I'll be your
stylist it's cheaper than me it cost
2,000 an hour you buy phone calls $500
an
hour
Reon when will K make your car into a
flying car hover conversion kit that
came out in the late 20th century
well I become a corporation like
Microsoft what does that mean
um why do they want to know that
question so I don't even understand no I
think it's just one person spamming
it we're going to buy Ford
it's all right guys I'm going to my my
hole also bed was that bread eatable
yeah you can have that bread oh hell
bread Bread's one of my favorite foods
and it comes in many shapes like
pizza how much money will it take for
you to run for president who's run for
president
you should pour we don't why would you
want to pour open pilot to a 2012
European
car thanks
crew can you guys see me I think you
need to invest
in when am I getting a I don't think you
guys want to watch my twitch channel
it's not really uh it's not really very
exciting
I mostly do a lot of uh no London office
definitely
not we could do a coding scream together
maybe one day one
day why are you looking for a girlfriend
on LinkedIn if you had one that's just a
joke you guys why not today I love
Mexico City what Mexico City is so
lame come over and we love France we
love bread wait who loves France I love
France have I oh Jonathan Blow is great
France wait I love Jonathan big fan the
only time in my life I was happy to be
in France was after I left Portugal
which actually managed to be
worse um can you show us
your George I got into Facebook one of
you guys go to good places like
Malaysia that's a good place
what else we
got he's from France I'm sorry I don't
let you keep working you know I like to
distract
you I like distract that's that's
women's
job hey assle stop chewing with your
mouthful guess what this is my stream
and I can do whatever I
want wait stop chewing with your
mouthful
hard Japan oh Japan is top TI your
country to go back to God your countries
Japan
Malaysia Indonesia was pretty cool I
liked
Indonesia I wasn't that Indonesia
Thailand Thailand's no good
anymore ch's played
out and China's played out too China
used to be cool if you can believe it
what's
left I want to I got to go to Cambodia
before it becomes shitt I love
cambod
[Music]
Cambodia I'm going to Cambodia soon
things all take
what about Denmark danmark I've never
been to Denmark I don't know but I got
do that trip I got to go to Eastern
Europe too going to Eastern
Europe you want come
Europe do hi in Eastern Europe like
Estonia and shit Estonia laia
belus Liv been all these
countries my solution for governance is
to make me supreme leader of
course the only problem with
dictatorship is that I'm not the
dictator and some people are like oh but
what about the succession problem well
you know what's nice about that I'll be
dead oh this guy hates
laia have I seen tennet Yes actually I
have seen tennet Alex have you seen
tennet
all right let's train in C
far Alex I'll go see tenant with
you
um test
test for
all right we can also
try um we can try a smaller model if we
don't use efficient
Nets what oh
only scalar arrays can be converted to a
scalar
index what's that mean
this attribute has no oh what who made
it a
list who would do something so
terrible okay we're training SEF
far um
for
okay it's
training the loss is going
down um let's let's clean this up and
make it a real nice training
Loop am I more than you bargain for yet
I've been dying to tell
you to that's just who I am this
week
for
for for
oh good point see our 10 only has 10
good
change
um oh but the efficient net only it's a
thousand okay we can fix that um
what oh
what was that other one I changed
okay not
learning let's write a tiny net
layer knit uniform
28 why is that seven time
seven why is that five time five prob
because we're
losing out Chan is
16 576 over 16 36 so we'll make that 6 *
six
nice
let me this SC
loss goes
down accuracy goes up
sick all
right all right it works if we do
tiny let's say here o
wait is that not running on the
GPU I was running on the CPU no wonder
it was so horrifically slow
wow it's a little brutal
all all right I think we just got to
write batch Norm
now
for for
wow okay the optimizer is still brutally
slow it's actually amazing how fast
everything else is oh well it might not
actually be that fast
um
because h
that's efficient net and the batch size
is 16 I I fixed all the the memory leag
bugs I'll commit what I have
new P requests all right what do we
got variable number categories for
ficient oh I would have uh I just added
that
oh wait are we not doing any layer in it
in efficient net oh that explains why it
doesn't work
oh you're just trying to F
tune I don't think we did any
uh yeah we just put everything as zeros
we didn't do any initialization of
anything no wonder efficient that
doesn't
work so I'm not going to add those layer
inet uniforms there I'm going to make it
zeros
but
yeah good
point why am I a postmodernist man the
same reason I'm a progressive you always
got to be a postmodernist and a
progressive they're just good things to
be you
know wait no something wrong if the m1's
faster than a
p00 that that's not
right of course there's no real truth
who thinks there's
truth are the rumors true that I'm a
lizard don't get me confused with Mark
Zuckerberg I'm not saying he's a lizard
either but I'm just saying don't get us
confused you wonder what instruction set
the p00 uses you can look it up that's
public vide instruction that's
public you have a degree but no
experience do I have a chance at your
company no you got that backwards I have
experience but no degree yeah I like
you Alex is gone Alex is
VR Alex is being edited in I'm working
in the bed she she's being edited in
after the fact
can I give you an unfunny answer about
being a lizard
yes all right it trains but we just need
to initialize the parameters
um let me write
that uh
oh this is going to create all sorts we
have to do it without grad
this is not so
easy you have no degree and no
experience since you fulfill 50% of
their requirements well you know what a
50 is I know you don't have a degree but
you know 50 is and
half yeah of course if we're back
propping through zeros the whole time of
course it doesn't
work I don't know what happens if we
backp through that broken batch Norm
like it's not doing what batch Norm
should I also want to add one more
for
let's just turn we can turn off sque
squeeze expand I saw one of you
mentioned one of the uh the thing that
Google was doing with
uh this is what we do at comma we just
turn the squeeze excite layers off you
don't really need them and they're
slow sweet we're training
here a bit faster let me just add the
sum
there if we turn off squeeze
excite chains in 380 milliseconds for an
app look at all the time well okay it's
not actually true that all the time is
being spent in the
optimizer um I
think what if I do
this WOW wait this time it's not being
accounted for anywhere
but if I just do that it's going to
force a SE I'll
finish
okay yeah you see what happens when I
have that it all gets much slower but
actually oh it's kind of terrible that I
do that there that's actually where the
finishes them
oh
okay now you see what we're getting
we're getting really on the EPO so this
here this is all the cln q's and how
long they're taking this is how long
it's taking to run CL finish
yeah so it's actually very
slow oh mad slow
boys see you'll see if we do it with a
CPU we don't set GPU equal to one
there'll be no time in the
finish so you look how there's no time
in the Finish now but there's a lot of
time in the backward pass
am I passing the test still
already merged
that oh no I broke the tests oh I broke
less than a thousand lines
oh wow who's ready for some code
golf by code golf I mean not code golf
because we're making actual improvements
uh let's read the actual let's read the
check okay when when did I break it when
I fix the memory
leaks
yeah yeah that added some code
small
C you're trying to be rich but it's not
working well you just have to no look
don't ask me for money look I'm in on
the scam here's how you get rich find
people with money and figure out how to
get them to give it to you that's all
being rich
is you can't create money you just got
to find people who have money and
convince him to give it to you oh my God
we're 22 lines
over I spend all those lines
on wow okay so much for yeah small grad
you
know just solved income inequality don't
take it with guns don't be a Savage if
you wanted a car you wouldn't just you
know go up to someone and jack their car
kind of hood shit is that you got to you
got to
uh you know convince them to give you
the money and you can even make them
happy while they're giving you
money well you can't be a bank so you
know those people are like they it's
exactly how you get a car no you
convince somebody to give you a car I
don't know how you've ever gotten a car
maybe we have a bunch of car thieves on
this stream but you know so then there's
more sadness in the world the great
thing about capitalism and it's all
based around consent and happiness
everyone's
happier we can race them for pinks too
that's always an option that's what I
mean convince somebody to give you a
car people who aren't murdered are happy
so if you exchange not murdering them
for money that's fine right you got a
good loophole
there fuck socialism gang rise
dude socialism is shit TI your
government I mean it's not as shit to
here as as as communism but you know
create a lighter order with zero orders
and go public billionaire overnight see
there we go you convince people to give
you money there you go look at
that all
right um where did I spend all these
stupid lines oh I wrote that
UTS oh yeah that's in there now oh
that's a lot of oh that's a lot of
code
oh that's a lot of
code
ah
okay profiler uh has been refactored
I don't know that's all pretty
good yeah all right pull request to
reduce lines we're taking
them we ending up here on here I don't
even have a
Macbook yeah we're ending up there okay
that's stupid code let's get rid of
that that was dumb we didn't need
that
Um this can be a
[Music]
oneliner host puff. C if is instance l c
buffer that's nicer and easier to read
we could merge them
all
actually I think this should be true too
why did I set read only there
if host buff is not none
okay I think that's easier to read
technically don't even get a d
type we only support4 32 here
anyway go one
line that's
[Music]
better okay um
uh that
problem pretty
minimal
actually is that
legal can I do
that no you guys know that syntax
though let's try it
oh well that's a different problem
um for
okay cool line reductions going
well X if FX for X and Y
really does that work well I did with
less comprehension like
that I think that's nicer anyway
that's more readable
yeah but okay I wrote
that
for for
pretty
good I think anything's going to get too
much shorter in
here you guys posted a good clip
all right let's see what else we can
refactor in
here okay well this is a ton of repated
crap all of
these let's just write a helper
function
called we say n to
tensor and turn
well no
this
for for
oh I really want that consistent testing
thing
should so close I want to test the
optimizers on the GPU as
well
um oh this this is so close I want to I
want to merge this
oh
well that's
nicer you agree that these things are
actual cleanups right like I'm not
playing code golf
here all right we're four lines away
now here
the tests don't
count penguino thank you for
subscribing you find this convoluted to
read what do you think's convoluted
actually you know what I'm GNA
do I'm GNA move this down
here for
it's nicer down there
I kind want all the GPU code to live
down there
no but that is instances past there
should be a static
method
actually what is the node that I call it
with
self it's very
convenient does that work
nope errors node is not
defined oh uh
self
node self. cgx self. cx. par
self a not I call S that should
work that's a nice refactor I don't
think it got us any lines it's
nice all right hype train how many we
got what's what's the level of hype
train how we doing how many people we
got in here we're doing pretty well
level one
complete you doing pretty well on people
440 sweet no backwards
pass too
sort tiny grad supports CPU and GPU I
put that in two
places oh
what oh
let's keep the hype chain going we're
doing pretty well here we're making
great look at look at how beautiful it
is
now um put Ops in these decks
I kind of don't like them
anymore
uh the problem is sometimes it's the GPU
and sometime it's not the
GPU that's why we have
those
really just want the right dispatch
functions to apply to the right type of
tens I don't
know what uses detach
oh okay cool
we
there two two more lines we got to
lose a stook 53 thank you thank you for
gifting subs for gifting subs and
keeping the hype train going I you get
any question you'd like I don't know
mark C was doing that I hope it works
we're on the M1 sto 53 any question
you'd like I'll answer it let's
go Ben
Hopkins subscribe and you can get any
question you'd
like no no no no no no no no you guys
didn't gift any subs if you gift Subs
you get questions
answered less
lines please increase sound volume in
obs
how much are Subs how much are Subs I
don't know why don't you buy
one I you should subscribe to my channel
Alex really nice
yeah okay well test are passing just
1,000 lines is
failing all right we got to lose more
lines
St ah how difficult is getting a manual
transmission to work with open pilot not
difficult and if it's done well we would
even Upstream it there's really no
difference um between the manual
transmission the automatic transmission
cars except that you're going to have to
shift occasionally uh but yeah I would I
would Upstream a manual transmission I
think that it's probably only
like probably not that many lines of
code like not really more than a normal
car port I'm trying to thinking if the
shifting with ever play into
it
um uh but yeah no I think it's it's
totally doable not that many lines and
we would have stream it uh median human
your turn to get a
question you want a manual Corolla get
it you can make it
work median
human you guys you other people don't
get
questions look look at how look I answer
the question nicely if you give
Subs median human what do you think of
too simple and well one of these things
I'm going to have to
Google
uh oh the CTO of two
simple um two simple in San
Diego
so um to quote two simple they're the
world's largest and most advanced
self-driving truck
company
again do they make
Revenue I did try to reach out to
people they're probably not good
um yeah I I feel negatively about too
simple um and about shouty how I would
have to think about it
more let's just look briefly at his so
so briefly just by looking at the
website there's nothing I dislike about
this guy
um hasn't published in a while
what is a what is this I like it yeah
yeah I like this
guy and what's a batch I it never took
off bi us
I like this
paper yeah we like the guy but too
simple stupid
you prime subbed right did you just add
a prime sub so you're normal sub and a
prime
sub you're going to ask if I heard about
memor you get a quick answer yes I've
heard about memor I've been hearing
about memor for a long time I don't
think anything's really going to come of
them oh and any anything that's a highs
speed specialized compute chip no
transistors are
fine all right we still got to lose two
lines
here that's literally just a zero and a
one
ug oh you know what there's an OP we
don't use it might be time for it to go
the div
op yeah goodbye div
up div's not one of the basic Ops sorry
div you didn't make the
cut it's unused
code remove unused
div
op
ah 993 lines tiny grads tiny
again we made it
tiny all right so with a 900 Line
library supports both CPUs and
gpus we are training efficient Nets now
we're not actually trading this
efficient net well because we didn't
initialize the efficient net
oh my God and there's only some
parameters that we initialize oh this is
a
nightmare okay well so it's taking 1.5
seconds per
batch that's slow
but at least we don't have memory leaks
anymore let's get rid of the optimizer
for now and see how much faster it
is if I don't use the optimizer okay
literally all the time is being spent in
the damn optimizer
how fast is
that two B to cast a gradient descent
doesn't
work it's a lot faster
we've sold a lot of meetings I think
we're almost have 10 meetings
now
ah okay
we didn't get to any A&E stuff I think
we're going to we're going to take a
break and we're going to come back and
we're going to do the nighttime e
stream back I'm take a
shower I'm going to chill for a little
bit and then we're going to come back on
now maybe we'll only take an hour
break one hour break and then we'll be
back to do a any
stuff um okay so I also here's why the
efficient net doesn't train right
now
um all right well we're going to do one
more quick thing before we uh before we
leave if anyone subscribes right now you
guys get one question this is a limited
time offer you guys get one question um
if you gift Subs you get like any
question now if you just sub right now
you sub right now I'll answer your
question
um the reason this isn't working right
right away by the way right now is um
it's because it's not being initialized
so someone's got to write the
initializer hopefully we get that in a
pull request and what we're going to
work on right now you can see this is
still training slow we're going to work
on getting this to run on the
a now if you think that's slow it's
currently taking 1.6
seconds for a BS 16 Epoch eats Inigo you
got a question coming wait holy shit
it's actually faster on the CPU never
mind everything's a
scam it's actually faster on the CPU
wow wow that's a
tragedy it's because that Optimizer so
terrible ah eats Indigo magic spoon what
are the questions let's
go well yeah I mean if we up the batch
SI further I bet it gets
worse so nasty did I see Ian beer zero
day yeah that big iPhone one I did see
that it looked impressive I didn't have
a chance to read it yet
no questions just chilling
cool do you know about up dog I I do
what's up dog uh do I like Bill Gates
yeah these your questions yeah I like
Bill Gates you know there's like Bill
Gates hate I'm like dude what did Bill
Gates ever do Bill Gates seems like I
mean he was kind of a dick at Microsoft
but like you know I think we're all over
that now uh Bill Gates I think does a
lot of great stuff for the world
um you know I don't buy into any of the
Bill Gates
scams we like Bill Gates Right clean
hair now you're clean hair you clean
your hair love Bill Gates yeah that's
right Bill Gates is
great we going to take break and shower
and we're going to come back I'm going
to do A&E yes
please wow the GPU is really not faster
such a scam
it's actually faster
CP jalapeno SD last question before we
cut the stream make sure this is all
committed yeah we're
committed why
youing what I'm just going to take a
break in a shower freshen up a
little listen to some Taylor Swift
kind of OB am I doing I'm using like the
crappy little GPU in the
M1 I let make sure the tests are
passing am I really a reformed cyber
criminal or is that a joke
if you have to
[Music]
ask about your interview with cyber
criminal oh my God no no no we're not
going into
that um oh my God I see Alex this is why
we can't write reformed cyber criminal
they because they really don't know if
it's a joke or not yes that's part of
[Laughter]
fun obviously you're a for cyber
Criminal
obviously I'm a reformed cyber criminal
that's right that's right one of these
days I'm going to give like talks at
like um prisons and talk about how I
used to be a criminal too but now I
learned the error of my ways and I
decided I wanted to participate in
society for
you soft toothbrush the dentist tells me
that but I like hard
toothbrush well the what you
[Laughter]
[Music]
destroy uh no the only question is do
you think when women visit my Instagram
and see that it's going to be a good
thing or a bad thing that's the only
question that
matters why is that the only question
cuz why else do I have an
Instagram I forgot the Instagram that's
right what do you think you see that
Alex what do I think when I see reformed
cyber criminal that's right I think
it's
saress that's good good women like that
stuff all right cool thank you all for
watching be back in an hour
boys I was just sitting here coding and
we were actually just uh watching Taylor
swi videos and that's why we can't
stream but
I guess we can stream okay so I noticed
that if there's something wrong with my
knit on the efficient net
um the Time of My
Life
um for
so this is what happens if I knit oh
well that went N
Fast h
what about big grad where we try to make
the most bloated bage possible I like
big grad it's a good
idea see look all of them have the
same I'm printing the outputs and all of
them are the same
you guys saw cheesy last
night when are we coming out with them
TS I don't know next
year random 30 second sleeps that's not
a bad idea actually and then think about
it imagine your program and your jobs to
uh to to improve performance of
something imagine you like actually just
slip in sleeps or you have like a fall
guy who slips in sleeps and then you
remove the sleeps and you look like a
hero do a lot of things if you have a
Fall
Guy
um and I checked it wasn't even the bat
the batch Norms that were breaking it
because I took them
out look all of them have the same
doesn't matter what input you put in
it's like no signals making it
through they're all the
same or we have some bug
somewhere oh my God does one of the Ops
not work in batches
we're going to get to A&E stuff but now
I'm kind of full I ate a lot of
tortillini I'm going put this
Toral in the fridge for later T guys
remember when I had later later later
what did I have later in my
hamburger
later oh no I moved
the Well we'd listen to Taylor Swift
songs but we can't because they're
copyrighted
look look at the
batch all look the
same that's a good point do contract
work put sleeps and everything when they
ask why it's slow charge a massive Fe
that's perfect
um right so I disabled the batch
Norms let's see what else could be
breaking this pams
51 really are like most of the params
and batch norms
okay let's uh let's be methodical about
this let's go in efficient that you know
it's very easy to debug tiny grats
just like say like print X
there actually let's confirm the GPU and
the CPU are both getting the same
answer it seems unlikely that there's a
bug in both of them wow same answer yeah
maybe just the Signal's not making it
throw too many
swishes um say X
not the right size oh 10 it's not
subscri wait I get it I put a lot of
zeros there there four
zeros or is that actually just the same
output that I didn't comment out
they're all just very small
numbers look at how small those numbers
are but they are different they're just
very
small oh those numbers small too
those numbers aren't
small oh does could it be the average
pool look at how tiny those numbers are
they're so
tiny it's not what the tiny and Tiny
grad was supposed to
mean look the gradients are Vanishing I
can watch them vanish with my own
eyes well they seem to really vanish
after every one of those
look at that the gradients vanishing I
can watch it
vanish my uniform tensor is not good in
Nets um
I added this new method
uniform square root prod shape that
seems pretty good
okay and uniform andit
constants oh you know what would save us
here you know what would fix us you know
what would save us from from this
terrible fate batch
normalization oh now you see why we need
the batch Norm
oh all sing is it tell so singing
time no copyright sound on YouTube yeah
you ever listen to no copyright music it
doesn't sound good all right let's let's
just write batch Norm we don't have a
choice we just got to do it you know
um What If I multiply by a th in my
batch Norms does that
work I should be sponsored by Spindrift
that's
true wait that actually made it
worse oh because we're running VAR we
divide by that so I
don't oh yeah look at those big numbers
oh them numbers is huge until they got
so big they became
n that seems pretty good we're not even
getting the same answers any
anymore wow nothing trains without batch
Norm at
all warning number 32 isn't float
32 oh
no it looks like all the same crap
again oh that made different crap
wow okay we just got a right batch
Norm all right let's WR hacked batchnorm
x.d dat. shape print x.d dat.
shape it's right only CPU
batch I didn't want to have to write
batchnorm that's not what I wanted to do
this stream but here we are we're
writing batch
Norm I didn't normalize the images now
should I do
that why
kuch oh your weird kombucha thing oh no
what no
no um we want to say x. dat. mean
access just not one
an integer is required got type range oh
list range
iner is required got type
list oh we need a
toule oh I did that wrong anyway
actually we just want to say x is zero
for the batch
wa is this not even
right is my bat for totally broken how
does this still how does this
work oh it's batch
2D oh batch Norm 2D
Okay so
just
that integers required got type list
oh I did this
again got to be a
tle you guys paying attention
okay look at that look at how much
better it is now it
works since we added batch Norm we're
actually getting different behaviors
look accuracy is even going up oh to the
Moon batch Norm is
sick nothing works with without
it
wow Bor so useful
goodbye um oh and then these ones
actually don't require grad
either we don't want to update
look at the different look we're getting
different you see how we're getting
different answers out depending on the
image and before we were getting the
same
crap for
yeah we need to really need to write
batch Norm like properly
yeah I read the chat Dago betting what
you want
some look at loss go
down unfortunately that doesn't work on
the
GP well I have mean I just don't think I
have access for
it bachor makes a huge
difference Bator actually makes a train
it's a spin
drift I said remember
moment in the back of my
mind oh long live the walls we crashed
through all the kingdom light shine just
for me and you I was screaming Long Live
all the magic we made and bring all the
pretenders one
day oh yeah I don't you know I'm not not
I just listen to Taylor Swift man I I
don't really sing I don't really sing
Taylor
Swift it's just you
know singing singing is
amazing singing Long Live all the
mountains we moved I Had the Time of My
Life
fighting dragons with you and long live
the look on your face and bring on all
the
pretenders one
day oh I don't
know what I'm allowed to sing the
song um
I sold some tickets to come see my
downfall they sold out in minutes had
friends in the front row believe when
I'm finished in lights my name's gone
the ones who gas you up only come around
when the flames on
all right uh it's training but this
doesn't work because we need to use tiny
Ops um well let's figure out how to do
that do you actually find is is this
really me playing the piano or is this
from like like high school Constantine
yeah High School
Constantine all right we're got to make
this work on the GPU too um because we
got to make oh we don't even have mean
we have a mean but
it's h we have some is does take axes as
an
[Music]
argument no it doesn't take axes as an
argument oh what a
tragedy oh that's a big ref
factor that one I'm definitely leaving
to
people
yeah you guys can do it
uh what what is nump
VAR the variance is the average of the
standard deviations from the mean so we
can actually just
say xus
running mean
data oh we need absolute value too do I
have that as a tiny
op oh no how do I Implement absolute
value based on what I
have no don't tell me we need another
tiny
op VAR second moment minus the first
moment squared yeah that's
great oh wait
what why do I need to take the absolute
value if I'm going to square
it so stupid
is that really the
same um oper oh shit uh
shape is an invalid argument for
reshape numpy and Dr array has no
argument requires grad
what for
oh perfect
well I can do this
should
work unsupport oh shit uh we need two
do I have squared as an app already have
square
root my non-first class Ops over
here have square root
I don't have
squared no
whatever oh you know what oh that's
another thing that I should set
we should set requires grad and all
those created ones to
false unsupported types for times times
or Pal
what oh did I not do that one
nice that's
right oh yeah everyone star tiny
grad everyone go right now click that
star
button we just need to make that mean
work yeah I'm taking tensity with power
that's
right didn't know we can put pal there
as well but of course we
can H square root cool oh yeah yeah the
other thing that I wanted to do is in
all those helper functions where we
create
tensors we should say requires grad
equals
false not in the NP
zeros no but I don't need an absolute
value from doing
squared right you can't get a negative
number out of squared no I checked it
it's already it's right I just a weird
formula
I don't actually know if it's any faster
you can't use data. mean you we have to
just get mean to take an access
argument all right can somebody do
that for
okay but you just have to add and divide
by the batch size yeah
so what do you mean I take the mean for
any input
separately no so I I have to uh like
basically so mean is a second class
op like here we have
mean um so this needs to take an axis
argument and then so does
sum yeah yeah but sum doesn't take an
axis argument right so in order for mean
to take it you're going to have to
refactor and add it to
sum so you just like we already support
most of the stuff for it so you're just
going to say like know like AIS equals
none and that means
all but
yeah some doesn't support it
so so do the refactor nah we're not
doing the refactor right
now uh let's do a little bit of AE stuff
someone wants to make an issue for that
well it's already here the back nor
backward pass isn't
right some doesn't take axis yeah that's
the problem
oh suckas has that requirement I didn't
know no it just makes us not make the
code bloated and
shitty tiny grad W it has so many
stars tiny grad's like one of the most
famous things I
wrote wow when tiny grad passes Kira
it's definitely not JavaScript bro all
right so I'll show you guys the progress
I made on the neural
engine
um it's pretty clean now so we have the
first step which is build
uh and this lets you get these
pists sh have like net. pist here so
this is the internal representation that
goes into the
compiler um and then you can run the
compile with compile
Dosh uh so you see this is the compiler
running number of one number of NE 8
these are the arguments that went into
the
[Music]
compiler um there's a way to disable
these privates but I don't really know
how to do
it PL of shrim thank you for subscribing
uh and then I wrote this thing hwx parse
which like Compares so this is kind of
like the command buffer to the neural
engine so you'll see for example if I
change the
pist let's say
that instead of two biases we only have
one but no it's not going to
work
um I don't know can I say batch size
equals two does this
work yep so you can see that that was
related to the batch size and now those
are the things that are uh so that's how
the code change when I changed that
stuff so any reason the creation helper
functions are static methods rather than
class
methods see them ever being used from
the
class I don't really understand the
difference I think it's probably fine if
it's a class method yeah yeah they're
not going to be used inside the
well I don't
know I think I'm fine with that and I
think if you make that PR and explain it
to me we'll merge
it like with a link that like says what
those things are because I don't really
know what's the conclusion of the neuro
engine well it takes in these stupid
command box off and someone's going to
have to document
them you guys want to go through and
document
them like and then I I got the firmware
out too uh so I dumped the firmware in
gidra like so that's batch size oh I did
some other work too I worked out like
what the types were and stuff so yeah
these are the
types these are the op codes though I'm
not exactly sure where they're used
um it supports uate inate and Float 16
and
invalid those are the accepted tensor
formats uh I couldn't get anything to
support yeah so this this command buffer
stuff looks like it's called
Zin and it's not in the firmware this is
in the lower level
stuff they have all these things too
which are like just called stuff like
that that I don't really
understand this is the bias followed by
the three uh the three
values I don't I have threes in here
somewhere yeah input channels is three
so if I like change input channels to
two where you can see that that went
down to two and also then we only get
two things
there um I think I've gotten it so I can
remove the bias too like there's enough
stuff here that we can start you guys
want to just start documenting us
okay so what is this operation
called
well it's like it's a little annoying
because
that let's change something that's only
going to change this what if I change
the input type to
uate let's say
inate uh which is the one that's yeah
that's one so we should see a two change
to a one
somewhere yeah it's here you see all
this bullshit
changed let's see if we can make a
simpler
pist um is that pist an argument no it's
not it should
be update to compile compile m
why to
complain what I
expected close pen to match
this
what oh is this
a can I not do
that oh my God I got a CF string create
with C string don't I
I I I hate I hate objective say I don't
know how anybody codes in this
shit oh let me pass in the KCF allocator
default just in case I might want a
different
allocator what's a CF string
encoding
oh oh well that's
great I know utf8 does it sound like a
good
one I hate Objective C
all right let's try to create a minimal
one we'll call it min.
pist let's see if I can create it
without any wait
what uh let's see if I can make it
compile
and that stuff is really useful if you
want to
uh okay so like if I do something like
just delete probs temp zero it like
complains like you can't just delete
that that's not allowed
specified unit private and kernel list
isn't
found but let's really just create an
absolute
minimum okay well we have units so let's
get rid of the no I'll get rid of the
weights
later
okay I don't really understand what a
bottom
is image maybe get rid of this
uh M
count
three okay that
compiles oh yeah
look it's actually
longer I deleted stuff and now there's
more
bullshit right
bias data count and output Channel
mismatch probs it output okay so what if
my key at bottom is actually just image
does that
work and we delete
that no units in the unit array oh we
need our unit
fail to parse output array of the
network this can't be the bottom the
bottom has to be something
else bottom here is
probs we've left probs in the unit
array okay that
works that actually got longer how crazy
is
that like I made that change and I turn
that code into this code which is
monumentally
huge I think
right yeah it's
shorter how do I delete something and it
gets longer
I need
units missing units in the network
description file you do need
units do I need a bias what's a gooc SE
okay let's
try let's try deleting the other one
let's try deleting the bias layer
okay that got shorter but only by a tiny
bit well B is kind of stupid
anyway because it like it like merged
the bias layer in so that actually
didn't really do anything in the first
place okay I think this is a minimal
we won't call it probs temp
zero call
it
layer oh that failed to compile
now the key name of the unit dictionary
and the other dictionary do not
match what so I have to call it prop
what if I call it
PS fail to parse output array of the
network
oh cuz that just that name
okay okay that works
fine hwx plus does nothing
except that one tiny
removal deep research thank you for
subscribing
uh okay so this is a
convolution colel height kernel
index we also know that it's getting 342
so that's
xxd net additional weights yeah it's not
even that so we don't need that
either
good um okay is there anything I can do
to possibly make this smaller we have
one layer
weight and then let's put prob output at
the
bottom
okay we now have a single layer
pist which actually doesn't seem all
that different from what we had
of course I've been to Banji love that
place
bro oh also this float 32 is a lie it's
actually float
16 but it can read them
okay
for for
don't you ever I watch the people who
ask questions like that not get good
answers and be like wow maybe they're
stupid
questions
um okay so this is can I are there
comments in
pists
comment cool
this is a on layer
Network so do I actually need this add
output thing I guess I do probably
something else parses that and it
matters maybe it doesn't
oh no it probably matters
because I bet you're the thing that runs
it I have a runner for these things too
so we can actually run the
code yeah um
file model
hwx so see that's that's D6
CB now if we change this to have like
input channels too does that
work same
shit no no no no but actually I want to
change the output
channels change the output channels to
one recompile and then run yeah we only
get one thing there
I get two things
time let's not call it my layer let's
call it Comm layer cuz it is
do I need things like output inter leave
I don't even know what that does no I
didn't need that
one I put plan stride can I delete
it no I needed that one I'll put roast
stde needed that one I'll put type wait
why it works without that never mind I'm
not deleting shit I don't trust
that what if I delete output type is it
the same output type yeah FL 16 is the
default see that fails to compile
because this output type needs to be the
same as this output
type oh so maybe float 16 is actually
not the default output type it just
doesn't need one yeah okay cool I don't
know what output inter weave is we don't
think we need that either great but
that's we're done in
garbage wait a second I got a question
what if I just say the output is conare
it doesn't
work I tell me why it doesn't
work the bottom unit of the output
dictionary does not
exist oh this
input inter do I need that but input
height do I need that I
do I think these things are all
important wow okay batch size just
defaults to one
need an input type so I need an input
rde kernel group reuse do I need that no
don't that was junk
um kernel width do I need that I do
kernel mode do I need
that yes I do default is dense actually
let's just really make it a minimum
example but I don't even know what i'
change that to colel index do I need
that wellow I don't need kernel index no
that doesn't make sense because I know I
need that
those ones you need
when don't that
work we can I say uper channels
three oh doesn't have enough
weights I can say uper channels
one uh where's it getting from model
espresso
weights yeah
one why does it get it twice oh because
it's a 2 by3 C so 1 two 3 4 five six ah
that makes
sense um so
actually if we wanted to I bet if we
changed input
channels to be two which is normally
fine but then I can change output
channels to be three because it has
enough weight okay now we're talking
okay that one is just for the uh for the
bias make
minimal
pist I'm actually going to move that to
model hwx golden
so I XX we get nothing
okay okay so this hex 284 byte program
is literally the smallest program I can
write which runs on the neural engine or
at least I don't know how to make one
smaller um
it's just a single
convolution what are we working on we're
working on A&E in the
uh working on the Apple neural
engine and if we can get it working in
in tiny grad don't ask
why
uh all right
see the thing is that also changes the
H wait wait look at this
one oh c0 just must mean the batch size
is greater than
one which is like a weird
thing this must have to do with the
output tensor
size okay there's a lot of icit shit
here you see like okay well these PL
strides aren't just change
that wait what oh because if I want to
change that I change that too okay
that's
good okay all right we can get somewhere
now we can start
documenting uh min. p
so at one
0x8c we have
the input plain
stride let's say
[Music]
u32 and then this oh this is some like
multiplied
thing it's 40 *
40 not see
oh no that's the total size yeah yeah
total
size which is the input plane stride
times input channels or
something right so I can up that to 128
I can up that to 128 as well yeah now
we're getting that one changed as well
but it doesn't change the
total so this is
input row stride
so this whole first part seems to be
about the
input okay 144 is the input channels
I think if I change this to did that the
import channels change anything else
yeah so it also change down here you're
going to note that this is
actually I that has more to do with the
convolution
okay let's change the input type
so this one is definitely the input type
here 20 or input
type for
okay so if we change the input type here
to int 8 let's put these back to
64 so a whole bunch of stuff changes
see that's a lot of complex
stuff I change just the output
type wow no this whole thing isn't op
this so this stuff might be the output
here
notice how we're getting 11 instead of
22 here so we know pretty clearly what
that
is no so the left the left is the normal
is if you just compile pist with nothing
and then like we make a change like here
watch don't go back that
far get checkout min.
pist okay so this is the stock min. pist
you see how there's no changes at all
now if I make a change like change the
input channels from 3 to two we
recompile it and we get
this right so like there's the three and
there's the
two that pretty clearly changed now this
I don't exactly understand
um let's actually change that to
that and then this makes sense it's
because the input plane stride times the
input channels
right stop changing the type what do you
mean stop changing the type okay that's
just changing the input
channels which this probably has more to
do with like the weight matrices here
now for some reason there's two weight
matrices which I don't exact oh no no no
that makes sense never
mind um oh you know what those are those
are the strides in the weight
Matrix yeah something like that
um
okay so we're back to no changes let's
change the output plane stride to 128
see what number we get okay here we go
so here's the output plane stride so
that's down there
at uh
U
274 output plain stride
um now I think that
u270 8 equals output planes stride times
output
[Music]
channels we confirm that by just
changing the output
channels to
one yeah okay that makes
sense oh we can document that that too
but before we get to
that let's change the output row stride
to 128 and confirm if that's where we
think it is okay the output row dride is
at
270 um get rid of those put it back no
changes now we do the output
channels if I change that to one these
things change
so just like we have those two there for
input channels I think we can get
230 and
234 for output channels
and that makes sense with that multiply
there okay it also seems like output
channels are up
here not times anything so these ones
with times probably have more to do with
strides like this is how like how it
reads the weights or something and then
this one also changed and so did this
stuff which is even weirder
I don't know what any of that stuff does
but um we are going to put it back to
two and then actually I'm G to change
I'm gonna make a crap weights file that
it uses
instead
um let's support up to
3x3 so what do I want to do
min.
weights
okay it's n weights in
there instead of models espresso.
weights we're going to use min. weights
we're going to change that 192 to zero
that actually shouldn't change anything
okay that changes nothing but now if I
change my output channels instead of
from two to three it's not going to give
me an error anymore
cool wow but it still is changing the
stuff up here okay so that's all real
then right that 20 stays the same but if
I put it up to three the output channels
appears to be there as well oh this is
hard shit you know just when you think
something's going to be easy some of
these things have to be
strides like look okay so now we have
these three weights here with a stride
of
40 I confirm by the way if I change this
interel type to float 16 it changes no
none of the output what if I change it
to int 8 I was going to complain and say
it's not wait
what Oh I thought that was going to tell
me it wasn't supported
oh I don't know about
that okay so it does run with you and a
colonels
could there be an
address I'm not even really sure the
conop is at
uh okay let's create a second
one so work
some
bug oh it's probably just because I got
the name
wrong yeah
okay that's two Ops
see it changes so much
there
um you know what I'm going to change the
Min one
again to actually
be I think a 3X3 is simpler than a 3X
two yeah so that's going to be the new
standard
one kernel type float 32 float 16 now
that can go back to float
32 that just just it just pre-con
converts them it's not exciting
you think they're a Proto
buff I don't think they're a Proto buff
I've never seen anything like this
before but I'd really like to be shown
them wrong
all right so we can add another layer if
we go in
here didn't work
what that just worked
combine them or
something oh cuz bottom is image wow
that does nothing
okay two identical convolution layers
here we
go how long before the pattern
repeats 3 c0
it's c0 so they're hex 300
each this changes the output one because
it has stuff to do with the
uh see it's so
complex well this is Gem they don't
actually have a gem they just have
c um you want to see if we can get
something simpler we'll try so this
actually was compiled from a gem by the
way we might be able to get something
simpler let's write our P
crabber let's see maybe I can just get
an activation function that would be
nice
um okay so we have build
here mean why not use you and a for
everything okay so this is actually what
built it out of this is what I built it
from
uh I guess I did call it a comp
and look here if you want to get if you
want to know where it came from you can
just uh get it here
you can grab the P
list all right let's try something
simpler uh neural network Builder
yeah so that's that one that this is
basically what we ended up making
um so we can try other
stuff core ml neural network
Builder yeah I just see I just copied it
from
this but I agree through that inner
product might not be the simplest
oh
sign well that looks really
simple comp the element wise sign
think this compiles with the uh with the
neural
engine error reading Proto
spec well oh well
normal Network multiarray can't be use
exact array mapping instead oh well so
much for
that what if I
add
sign
no do not compile
okay inner product works let's see what
else we can make
work scatter and d add scatter along
axes argmax argman a a tan h
element
wise oh that has two
inputs try to ra you
no real but it say
jelu canot be rank five R
mapping but if I add inner product it
works
okay yeah
we do a one by one yeah we can do a one
by one but it's not really simpler we've
done that
before Oh here it's called add
activation
um for
okay cool sigmoid
Works can I get rid of the inner product
oh then you get this bug
okay all right well that adds a sigmoid
oh but that's not running on the D
anymore you're telling me you're kidding
me if I add a sigmoid I can't run it on
the
A&E what if I had a relu
error in declaring output
props
oh um we'll call this
med call this
probs there we
go doesn't run on the neural engine
interface specifies name
probs this is a joke if all I add is a
relu after
my what do you mean doesn't seem right
to
you if it said it's three that's fine
that's not built by the neural engine
anymore literally the only thing the
neural engine can run is a single
wait really even if I add two it doesn't
work anymore okay now I just think I'm
doing something wrong
I add that and I run it it runs in the
neural engine I see the
compiler should any want to tell it what
to use
my model isn't compatible it'll fall
back for
you got to pass in float 32s
add crop
all right let's add an element wise
okay did that run on the neural engine
no it
didn't well literally nothing runs on
the neural
engine you want to add two things
together not run on the neural
engine only thing that I can get to run
on the neural engine and now it's seg
FAL the only thing I've gotten to
running the neural engine so far is
that and if you had the bias it has
something else when I compiled one with
only the bias it got long and stupid
element wise stuff would be on the GPU
why
what if I try
bias that's what it was right
oh my God it's running as a rot
is that going to run on the neural
engine dimensions of shape bias do not
match
okay that ran on the neural
engine finally something runs on the
neural
engine yeah this is the same crap that I
was looking at before okay so so far the
types I've seen are
go and
Comm and I can do just a goop but it
actually ends up compiling something
that's
longer I add an activation layer it runs
but
well but it doesn't run on the neural
engine activations not on the neural
engine all it seems to be able to do is
coms I know I can set that bias to true
but that's
not oh
where weights are
quantized
wow look at this complex
shit so this all just looks to be a
wrapper around this thing let's see if
we can just look at
it here we go neural network. prototo
inner
product layer pars
why doesn't that run on the neural
engine did Apple put a phony neural
engine in it it's very possible I I
believe
it that's kind of what it seems
like the neural engine can do convol
don't use any non
line maybe there's a parameter we're not
finding and whatever the auto set thing
is doesn't
work ml model predict let's just like GP
this for
a here we go use CPU
only that can be an
argument but other than that it doesn't
seem like it does anything
can we run that
test did not trigger the A&E once
oh because use CPU only is true
oh cool okay that triggered the neural
engine
twice let's see
how oh broadcasted outputs look at this
stuff
um broadcasted output broadcast info
okay I found a new type it's called
broadcast that's
real there's a second one there too it's
a z
let's look at this
pist looks like more broadcast
shit does look
simpler oh no type scale element wise ah
okay broadcast
works and scale works
scaled element wise okay that looks
simpler oh wait we fired
more oh there's more
it's so much better than me trying to
trigger
it type input view oh cool
which one was that
EC check this one
out type
reshape oh
sweet look when you know once it starts
flowing we got tons
reshape what else we
got
V that looks the
same those two are the
same cool we got some good stuff to go
off of
here more po quests what do we got
hello batch nor means with current ops
Oh this is good why are the test failing
though how you
doing oh don't do this no no no no don't
do this make it support the uh the op I
didn't why said Do no no no no no no no
no this is not Mak it support the
we can't do
that I learned about so many more A&E
Ops what Joe
think we got another
year for
what the
singularity in what oh for Corona virus
I don't know Corona virus doesn't affect
my life so I don't think about
it compile
oh yeah we can compile these big pists
let's compile input view. pist oh that
one compiles too what a deal now let's
hwx Parson see what we get oh my God
look at the size of that oh it's the
hugest binary I've ever
seen oh that binary is massive these
pists are so complex
wow I can't believe reshape is an OP
input view is an OP what is an input
view
op I think it does anything
I like that rescale one that looks dead
simple though let's try pist reshape no
scale call like pist scaled
yeah broadcast Pam scale scaled element
wise that looks
simple let's call it Comm layer even
though it's not actually let's rename
com layer to my
layer this one can be called my
layer scale type Min type scaled element
wise un escaped
bottom why does it have two
I don't care about
that let's call it my
layer and the bottom should be
image I don't understand why it has two
oh cuz it's
Min let's just type image
twice second comp po
cool wow it's
longer you know just when you think
you're going to write something simple
it's
longer it's massive
boys this massive is
huge it's two
Ops 6 FAS is there
thereit why does that start at hex
10 I know what's broken about that did I
make a right
bugs they bug in hwx bars
I not equal to zero what oh we should
get rid of
that oh this isn't
right so all those numbers are actually
off they're not off by a ton
but let just change
them so these are 3 three three 4 this
is
778 this is not 204 anymore it's 1
F4 this is one
F four and 1
f8 those become twos that becomes a four
and those become
sixes all
right that seems right
we'll get rid of that because that's
just a
lie yeah so these are the Ops
um so this is a two op despite it just
being a single reshape it compiles it
into two
Ops uh what if I only do that does it
still compile no
um
just private for wi
fails oh
yeah that's actually it like it looks so
simple but it's two Ops
that's a tensor up right
there any other good Ops broadcast out
push yeah more green sounds
good all right let's try reshape maybe
that's simpler than scaled element wise
name is my
[Music]
layer bottom is image Al type is full 16
let's say reshaped channel is
three these unescaped ones we don't
actually need okay does this compile oh
it
compiles okay this is a noop let's run
it and confirm it's actually a noop
yeah look it just passes this guy into
that guy it's a no
op guess we can reshape and change the
size okay so that's how you get from a c
to a noof
let's save this as no op
up
uh you can take
it I have days of battery in my
I'm a little
cold change the name to my
layer so now we have no op. P lest
yo could I like go like that does that
work can't do
that can't do
that does it have to be a noof what if I
tell it that the output type is inate
does that
work no we can't reshape and inate and
make it a not in date uh
compile fail to add an input ready ah
error reshapes input output layer format
should be matched oh that's nice I love
when they give you good
errors okay so that is you turn a Comm
layer this is a Comm
layer and that's a noop
layer a lot of the stuff seems very
similar can I even need weights
anymore I shouldn't but I bet it's going
to be like you don't have a weight to I
know it works
but if you get rid of the layer it's
like oh you don't have any layers so you
have to have some
layers your layer can be a total no op
like this rehap
all right let's
[Music]
change wait why is model hwx so big
now oh look at all this
crap included this huge con section
which just does
nothing it's a lot of
zeros just try this experiment
briefly it's all over the place
yo the reshape engine is actually a
convolution look at that I mean why not
do a convolution right why
not so I guess wherever it's different
is like where the
uh or just thinks of everything in terms
of convolutions
so whatever is not specified is where
the weights used to
be is it like 70 or something don't know
what those 81s mean
do I think do I think we'll we'll try to
do you think we'll hit the singularity
with the M1 chip I don't know how many
viewers we got let's
check 485 oh that's that's not so
many oh yeah so this is reverse
engineering does it look like fun do you
guys want to be reverse Engineers when
you grow up do this
you know I think that this stuff is
actually
weights this big con
Slayer doesn't really make sense I guess
I mean Y is
wait yo you know what I'm
realizing can the neural engine only do
one
thing like maybe the neural engine can
literally just do this one op a ton of
times and this is the only struct you
have to reverse engineer and it's always
the same like I think it is
what's
Zimmer wait is this related to the fact
that this is called Zim does an Apple do
they have a tool called Zimmer that
you're
using I I don't know if that's what he's
referring to well let's Google
it
Zimmer I don't know
compos wait no no no no someone said
he's using Zimmer to follow along and
the thing is
called uh
Zim the the the the
op oh you
mistyped
no he misspelled
time um
no but yeah it seems like there's only
this one
op which is kind of great for reverse
engineering let's not actually call that
noop uh let's get MV noop we'll call it
reshape
noop okay so that's a
reshape net is a convolution
convolutions can support this bias thing
oh this was dis changed with the bias
too ah that might be the weights type is
that is that what I had that as yeah
it's kernel type look and the kernel
type here is is is is is is
zero because you know if you're going to
do a yeah why why convolve it with
anything
complex okay it literally looks like
there's just this one struct and you can
stack them
um let's do reshape knob twice. Plus
actually got a better
idea let's do a c and then a reshape
CP min. pist Min with reshape
pist Min with reshape pist split
reshape copy my layer down here go
it reshape layer the bottom is my
layer the name is reshape layer the
bottom is reshape
layer now we have another one
here call reshape
layer ah w I mean that kind of makes
sense why I do anything unless I made
that same bug that I made
before this was just
wrong uh I did that same thing before
didn't
I bottom image bottom
my doing nothing
okay well it just combines them into
nothing let's call the bottom here
image okay this doesn't work
did I do something else
wrong interesting right if I set that
there and symbol
Alias I mean yeah we have a super fast
but it really does look like this neural
engine is
one let's get rid of this Min with
reshape it's useless let's look at what
what were the other things that we got
we found whatever go
is which gets combined
uh I don't know what an input view
is reshapes are only interesting if
they're
alone it's just a no op
should we look for some more go fishing
for more oops I didn't mean to do
that for
let's see if we get anything
good well this is just a
GOC that's kind of cool
5e what's this oh type neuron oh even
better oh we're finding we're finding
gold
now oh nice oh neuron I'm very excited
about
that I love that I found this test
it's that one see what's
here type no it's just another
neuron all right neuron neuron is
exciting enough in its own to stop
fishing Shan tayor
star pseudo Chone tailor
star neuron
let's add that to my list of
types
neuron oh look at how exciting this one
is
but again it's probably going to be
something very similar to reshape
just yeah okay let's make reshape the uh
the default one
again this we'll make the no up the
default
one yeah okay that adds neuron stuff to
it cool so it's really very similar to
reshape it's just
uh yeah
same op
again I bet you can combine all of these
together
Type X to what if I type like type
equals Rue not a
type just x what if I get rid of the two
not a
type what other types do we know about
Kat's a
type wow okay we learned about a new
type oh this is great every time we go
fishing we got a type
conat sounds boring
though
conat let's go fishing more fishing is
so much
fun
fishing we're I found this test suite
for the neural engine so I run it and I
just see what we
get all right so that's just a
reshape input reshape output okay that's
boring cona more
Conca where my mouse go
charge should have added it to here
before we
committed all right
wow two inputs it's
crazy go seems simple
what
so that does
nothing oh because I put the reshape
back
oops W radically
different those numbers are gone
H look right down there that's where
those two scalers
live so if I look
there
S 3
F 3 Fe E2 2 and
5040 you see they show up right there
okay so we can fill that
in's that called 3 ef2 is the bias
scalar change that to three and we can
confirm it changes okay so I expect to
see E1 there instead E1 one boom okay so
equals bias
[Music]
scalar sorry
32 seems like
one basic
op repeated
so how is this apple neural engine 16
cores you see 16 cores I don't see 16
cores do
you and look that 30 is gone
[Music]
all those 80s and stuff are
gone
okay going to rename m.p West
Apple put in small print 16 cores
divided by 100
where 1.6
cores wait is that not a
troll a go big difference
Comm wait what isn't com
build oh really did I break
it how' I break
it oh I know how I broke
it yeah needed weights
okay given what we know let's take a
quick look inside gidra and see if we
can find any of this
stuff I suspect we should be able to
we'll look in the A&E compiler it just
creates this op and Hope hopefully we
can find a beautiful definition of this
obstruct
somewhere then we can just make our own
Ops and we can integrate it with tiny
gr wow it's so complicated
the neural
engine it has lots of weird
functions one Cor equals one
transistor that's good
troll this thing
sucks yeah also by the way this is
definitely some deep Hardware it's not
uh it's not I looked at the firmware it
doesn't do anything
I have an
idea uh let's look for some strengths
my gidra is over here okay that's
espresso yeah so here's
the there's the stuff and those are the
uh those are
the let's just like GP around for
something like input row
stride any compiler and espresso match
okay that's not that
useful let try bias
scaler again any compiler and espresso
so I mean I kind of think this is
uh here we go like what is
this zir
colel here we go Zin gooc ler
set Colonel
data zenir A&E
konel had weights to
sha Spar weight
can't wait
Dimensions so like is that what those
things are are those the weight
Dimensions at
like
38 I don't think so I don't think it's
that low level where's the thing that
actually writes these out to
dis because this creates these hwx
files reverse garbage collector demo it
just makes garbage
somewhere deep in this thing if we can
understand it is all of this
stuff and it should like correspond with
these numbers so look at like output
channels nothing mentions output
channels
okay scale
scaler nothing mentions scale scale if I
put like the op names in here it works
better let's try reshape let's try
neuron that's a good one and we can find
X to
great
useless where's my stringing
stuff no
here uh fun
NP Libs strings and E compiler grab X
to
X find that
strain oh no I did minimum Lane five
what oh sweet these are all our
options let's try some of them
NN is pretty close to a
noop what if I change here we go these
look like things we can change it
to the difference
right
there
okay 11 is Neuron type
d8 is log two
wait that doesn't make
sense how is tan H the same as
X2 someone's getting scammed
sigmo is the same too never mind the St
that's not
right oh must just be the programming of
a
lot yeah look at
this yeah yeah here's the
crap so that's what the difference has
to be
oh yeah look it looks different this
programming it a
lot I don't know why log two gave me a
different
thing is a lot longer or something
you yeah I mean you guys saw the thing
that changed
right it's
this oh debug detail print
look at
[Music]
this okay I love this debug detail print
function
oh was in reshape layer debug default
print how do I use
this can I pass this stuff into the
compiler and get it to debug print
pen Colonel descriptor to
stream okay maybe I maybe that was the
only actual good one and the rest of
these are
grappy I don't know maybe I can enable
it somehow
I should be calling the compiler
right what is this located
in it's in here
here we go I'm just calling this
function look at this
function oh yeah that's a good type
right
there I just want to find out if we can
pass in any P value stuff what if I tell
if the target architecture is the h11
does that
work it give me the same
file oh look at the tiny one if the
target architecture the
h11 look at
that um and actually let me just uh
instead of net. pist let's say simple
reshape
pist oh that doesn't
compile failed to add an input ready
private
player for
yeah so that's the h11 output and that's
the h13
output they added a lot of
crap oh can I run the H let's run
it wonder if I can run I wonder if it's
Backward Compatible probably not but it
may
be okay so that runs
nope
oops and now it's
crashed well this is good to know
so wherever the front end
is zenir Target
h13 is where the interesting thing is
going to
be oh yeah we're still looking for like
debuff
options was like next to that one
input network network weights looks like
errors options file path
[Music]
externs wait my C
Frozen oh yo is that what happens when
you crash a
konel uh let me
see what oh there we
go don't run a if you try to run
um yeah if you try to run h11 shit it
crashes
your oh we can compile for the h12 as
well good thing we have an
h13 what about
h10 there's an h10 what about J10
oh so basically everything but ag3 does
like
yeah why does that have h13 in it oh
that's a scam h13 that's just cuz it
happens to be
13 what's
this get
pams Zin me or interchange format Zen
how
what oh my God
just the complexity of this
thing Apple put all this time into it
and it can't even compile reu is
good it's dark
yeah it's almost TV time
full I just say
t
many well if you want to
wear you're not going to complain
more
light you buy a bunch of hover boards
they have a lot of
lights this is good to
yeah the value FY no if not really true
it does seem to work with those things
it actually seems pretty flexible you
can use these
Lots all right Cen
TDS like what is this function
do you see anything that looks like a
normal like I'm going to Output some
code oh out of memory during code
gen wait I did this last time how do I
all
that I don't know what gifting emotes is
oh Alexius of twitch thank you Elon
Musk Elon Musk just joined our just
joined
twitch what's up
Elon your neural engine's better I think
I don't know maybe it's the same kind of
crap should we write some benchmarks now
that we know how to do coms and see how
fast we can do
coms wait it can't be the real
Eon I don't
know Elon Musk account created March 4
14th 2014 maybe it's the real one all
right cool welcome to my twitch
Channel
um so we're trying to
uh this is the Apple neural
engine trying to reverse engineer it uh
if El on here we'll try to explain good
stuff right um
uh so we've broken it down into this is
like the way models go through this
thing Apple exposes
nothing uh below this level below the
core ml model they have this other
Library called ml
compute but ml compute doesn't support
the A&E there is some code to do it but
I haven't been able to trigger it
so um this is the corl
model uh which Apple corl is Apple's
Library it's compiled by this
uh espresso thing into a pist file which
we were playing with and then it's
compiled by this thing called A&E
compiler into these hwx files um hwx is
a binary file format that seems to be
hex 300 blocks and these are like Ops
for the neural engine so you want to do
like one convolution it's a hex 300
block and then depending on which things
are turned on and which things are
turned
off uh it does different things
um so that is what we have
so my MacBook has an
h13
chip uh well okay so we want to compare
and contrast it to the Tesla one um the
Tesla one does all of its conops and
Matrix multiplications in int 8 and then
accumulates in int 32 this thing appears
to have
inate U inate and Float 16 options I
think they're normal float 16 from what
I can
tell yeah Alex loves her light
so this is the A&E compiler which is the
thing that actually generates the hwx
file so somewhere deep inside this huge
mess of oh look at all these other
things we can
Target we can
Target
h13 we can Target h12
M9 t0
h11 so these must have been all of
Apple's crappy little neural engine chip
so they have the same neural engine chip
in the iPhone
too
um and nobody really knows anything
about it but it's nice that I now they
now have one in the M1 so I can play
with it on my M1 so these things are not
just uh
hypothetical if you want to can actually
run this
network over
here with this which runs
it um this is the program that runs it
it's in the three run
directory it is an IO uh uses IO kit you
have to create some IO surfaces you pass
them into it and then you do a program
send
request and there's these other really
cool
commands uh that let you poke registers
and stuff but you need PE I can has
debugger and I've been too lazy to
enable
that see guys look I explained stuff
nicely do you guys follow along
now what's this A that out program do
you want a real answer to that are you
trolling or do you want a real answer to
that you know what like if you didn't
know you might like ask that
question
why well they saying good good things or
bad things are the facts like lies in
our favor or lies against us veryy Hees
not like Tesla well you know El's in the
twitch Channel right now
apparently we raised a lot more than
that it's just weird hey just cuz people
have blue check marks doesn't mean
they're informed I mean I'm aware the
Tweet got a lot of Engagement
and 140,000 follow it's not that
many only when Elon is here we explain
things I think someone just gifted a
twitch sub to like Elon Musk on Twitch
my left testicle has a blue check mark
on
Twitter wish I could zoom the whole
screen out what do you mean I need more
pixels we should buy a good monitor for
here buy a good monitor you should just
give me your credit card and I'll buy
you all things you want no I don't want
things Alex I don't like
things
bu what no I'm not going to make you buy
a monitor it's just like a hypothetical
like something that should should uh
happen I know I'm I will make it happen
why we need like lots of pixels like
this do enough pixels if I had more
pixels I could actually read these
things
okay I can buy a monitor
Alex I'm doing you are m
you're reading about that shit
yeah she bullied y Lon off
Twitter Twitter
thug I mean you
know have you seen how much our power
bill
is should we should we build more
efficient chips you know what's a more
efficient chip a00 we should demand
Nvidia for the good of global warming
make them
cheaper all right what monitor should I
buy
okay this monitor like I just I want to
zoom out you know can I do that no I
mean I don't think I can make the
resolution
be
uh scaled no I can only make it
crappier Odyssey G9 that's that's what
everyone's saying all right let's see
what an odyssey G9 is what
got o well yeah but that one's Rob is
Odyssey G9 wait is that seriously the
what look at these terrible reviews why
would I buy one oh wait that is the one
we have for robe wait really get the LG
5K I have the lg5 I have an LG 5K I
could just bring it over
here the one at the office no my one at
home in my house which house here
dieo yeah my monitor I have the LG
5K all right all my homies hate Tim
jbu I I have no opinion on her you know
I think that uh you you you you you mck
around in shit and the shit you know
just whatever they say about
that wokeness not even
on oh Apple 6K o 6K
Apple oh my God I want $5,000 to spend
on a monitor I'm not buying this crap
hey I'm rich I'm not that
rich not stupid Rich you
know that's stupid
Rich a get woke go broke I have heard
that
um you like Del we like I like delm
moners are work they're nice
with the lg27 yeah that's literally what
I have at home what I'm just going to go
bring I'm bring that monitor
here I never use it at
home you hate that light
6K don't refer to pixels but the price
oops okay where is the actual let's
search for code
gen
um Zin code
generation here we
go add any
operation okay is this is this it
oh yeah okay let's just look for some of
these constants they have to
exist undefined 8 +
4 okay wait it's it's it's almost this
though this this looks like something
we're getting somewhere
look at that four is there a four in
here you see a
four not that
four this four is that that four that
could be that
four is that aligned right no it's not
even aligned right never
mind um
this almost looks like something that
like assigns stuff but yet it's not
right is there
21 add an
operation IR code gen single kernel data
this one
good IR kernel view zenir kernel View
serialize
create con dat
serializer oh my
God Colonel oh you know what else is
appears everywhere this
crap 01 30 20 31 can I find
that um it's not a string I want to find
program
text
01310 selected Fields I don't
know great now
found can I search for that in binary I
God I don't know how to use
gidra program text for matching
instructions for direct
[Music]
references I if we can find what plugs
that in that that'll get us
somewhere Zin code generation I really
like the name of that you
know Zen compute mutable program and add
procedure code on your smart TV here
that's the
move all right what are we caling and
how long is
it what is the best language and why is
it
JavaScript TD Hardware
V5 Hardware
V6 oh validate
Network oh you know what Zin might be
Zen might be the name of the pist
shit Mir might be the other shit
yeah for
zenir oh L2 strides
oh calculate conz L2
strides Mir can merge scale bias okay
this is better
what is this
crap
strings has no bias no weight but
singular scale
zmir IR activation
V7 let's look at
that h
what's this
crap get abs custom lot
oh oh get get sign lot get direct lot oh
is there a get x2
lot well okay here's the tan
lot um oh this is
exciting okay get sign
lck so I think
if I compile
neuron simple neuron and hwx parse and
then I edit simple neuron and instead of
saying X2 I say
sign and then we look here yeah look at
this let me make sure I'm not in the way
of any of that let me where is my camera
placement right now right that look at
this 3C BC 3 C BC
[Music]
ah so
exciting ah sign zenir activation get
sign lot and that means we finally found
something that's actually being outputed
in the hwx
file all right look at all these Lots we
can get we can get direct Lots post
scale Lots Lu Lots so many Lots
what's a
lot a lot
is a lookup
table Yeah L lookup
table
yeah oh look here we can print Lots
cool all right me Mir is the trik
knew it was a
lot Zin me or activation me7 print
lot look at that
yeah we just figure out what's actually
being passed in
there that's good progress
boys e
okay all right so this Zin Mir stuff is
a good place to look for things then
w
how many people at Apple must work on
all of
this there's an insane amount of code
here and it does less than tiny GR
something like zenme IR code gen
what
oh I thought something exciting
happened something EX
um New York City just got
nuked I mean that would be exciting that
wouldn't be good but it' be
exciting don't say inappropriate things
we're on Twitch get woke go broke we
can't reveal to them how woke we are
zir an
konel you're now
cooking no green onion panc oh I love
green onion pancake but they're not good
for you and I eat them and I like them
but that's not good for
you why don't we just eat more tor
what Zen Mir Matrix
malt okay this Zin Mir stuff doesn't
look like it's really going anywhere too
exciting
[Music]
Mir prepare IR
failed mirr generation failure okay Zin
core compile generates
mirr for
yeah I was number 20 on Advent code
until I didn't do well
yesterday
always you going to play you should
play you can
play I think good for
you Zin code generation
want I mean I do but I think I already
ate a lot of
torini
okay I have some original Shong BS
six piece
good where's the shit that actually
outputs
things for we know it's like Mir 2
now oh a good thing there is a Zing Mir
you copy
Optimizer Zin me handle flatten
layer zenir opt
zen. gen oh what is
this Zin graph before Fusion are there
intermediates from the compiler that we
can
output Zin
visualization oh this is exciting how do
we turn this stuff
on there got to be ways to just
enable it's got to be ways to just
enable stuff in here like debug
modes like you know that crap from the
colonel we can just see it in strings of
any
hwx this
like
th13 wait wait I have an
idea what if I you want to try some
command
injection what if I do
that no don't
oh no it just falls back to h11
wouldn't it be nice if I had a big
Monitor and could actually see
that okay here we
go debug how do I turn on
debug oh look there's 0 01 F no contact
switch how do I turn on
debug I want debug so bad right
now debug you know
Zin ank
compiler these are ARS ARS
error invalid option to F spatial split
how do I pass any options in
anywhere string to spatial split
mode
what okay there has to be a way to pass
in
arguments Flags dictionary so here's a
Flags dictionary called Target
architecture we just need to add to
Flags I'm sure there's something we can
just add to Flags dictionary and it's
going to
work and we're going to get debug
information that you wouldn't believe
Apple's just going to like it's going to
be like a hex dump and it's all going to
be
annotated guys I need you to channel
this with me you know
oh Target
[Music]
architecture how I just do
debug
debug yes
you think that's going to
work debug mode
[Laughter]
no wait but no I wanted to say debug
mode
yes we're so
close I was trolling with that
uh with that yes but it's almost right
why does it say
no don't say no say yes oh debug mode
yes oh how do we get it to say
yes
okay if zenir compiler
[Music]
parameters
zero Zar
20 is zero
debug
mask how I make an
integer input networks output file name
all right there is something called
options file path
good options good do options
debug equals
yes debug equals
yes debug equals big
yes debug equals
1 okay I don't know about good options
wait what's that zero that's being
passed in what if I just pass in a
one oh it wasn't debug
mode oh it's seg fals now
what are these swap
files
empty dbug equals minus1 dbug equals on
no I don't know if this stuff's working
at all
try X
turns
swag now it crashes
wa we're back to Second oh we can't put
one
there oh swag doesn't
work oh but that's interesting because
it
did that ex turns is a real thing
all right how do we turn on debug mode
dude I love scow
man okay disable register
packing disable network IM balance
analysis oh here okay let's try like
disable merge scale and bias see if we
can enable that
uh CF
bu I don't think you can just do
that
CFB CF
Boolean they're used as rappers
KCF Boolean
true a look disable merge scale and bias
is one now so that
works okay now just how do we enable
debug mode
colel rewind
disabled enable aggressive tensor
caching do we want that
let's just GP it for
debug debug detail
print what do we think of that debug
mask
youbg
no how do I create a KCF number
CF
number oh here we go how do I create a
CF number oh perfect CF number create oh
I'm gonna love this yes
CF number create
I have to pass in of course the KCF
allocator oh I need to know the CF
number type oh what's the CF number type
oh let's check all the CF number type
possibilities oh oh don't you love this
oh
yes debug mask do you ever write
anything in Objective C no I'm not
okay unsafe raw pointer
you want to charge it you can
take debug mask
zero oh no I have a bug you can't of
course the s32 in types is defined in
Mac types. H which I'm going to have to
include now of course this isn't going
to work it's going to be like you don't
have a Mac types. H oh I do but for some
reason it's actually not in
there oh wow guess what three
yeah
fucked debug mask
one but we're not in debug mode
yet look at all that debug
mask oh look at all those things that
are private that must have been the
debugs oh we just have to disable
private oh I know a way to disable
private LL DB a do
out oh no
so where did it oh look at
that yo look at all this
shit oh look at all the
outputs oh we're rich boys we're
rich we must have just gotten those
okay oh
nice debug Mode's not even on oh yo I'll
just show them you right
here debug we got debug all right
um that's probably okay not like the
eggs that expired you know 17 years
ago all right look at all these debug
what are we going to do
oh boom look at this font face aerial
rounded
bold oh they're dot
files oh shit it's a DOT file
oh yeah yeah yeah yeah you guys want to
use Dot and we can look at them
okay oh model hwx reg alic oh let's
see we didn't use much how about perf
stats
section
symbols a
Conta switch lock
weird
[Music]
debug uh all right how do I view a DOT
file
what are these
things type com live in scale bias live
out the stuff doesn't even look that
great we work super hard to get it and
it seems kind of just like
junk well it's a compiler it's not
showing me
like oh yeah good point you guys know
the dot uh
Brew install
dot okay zenir
[Music]
graph after reg
alic are there even registers
graph
is all too well
oh yeah looks like it's no it's got to
no it's installing python no it's
installing Swig no please don't do
that please don't do that don't tell me
that broke python sometimes it breaks
python okay um
online do
viewer ah graph is online now talking
that's good how do I put it in the
clipboard Mac Cat 2
Clipboard PB copy that's it PB
copy oh yeah now we're
talking oh look at that all right format
ping could it like format things a
little
better I feel like apple would do
this knom fused
kneal SCE Channel reuse desk Channel
reuse Dy
oh after Mir Builder let's
see so
useless this is the biggest
one this one just look
okay fuse kernel isos Dill
oh
TI you relax your shoulders yeah any
link you can follow you guys can check
that out it's committed
now or no
oo
needo
fdp something render it better
cirle
TWY great download that crap
per count
bias this still isn't debugging how I
want but that was pretty
good I think it's that last debug flag
we don't have
debug mask how do I set debug mode
oh on
e.net oh let's check that e.net
look a little better I like this website
better thank
you oh that's before we
hoist oops oops
I mean this seems this seems actually
pretty useful we could figure out like
which I don't understand what s and D
are but we could figure out like which
things correspond to snd
D hint Dam inter one
um let's try to enable that last
debug I want to put it in debug
mode so we debug oh debug detail print
is that it or
no now that is nothing to do with that
I'll compile A&E program for
debugging debug mode yes all
right I'm not sure if it changed
anything but we got it to say yes
yes is that the same as what's
committed it's exactly the same as
what's committed that did
nothing wait 2.9k is that watching right
now oh that's stars on Tiny grad
oh yeah I want to star that tiny grab
voice
um okay we turn debug mode on and we set
the debug mask to something insane
so that's all the debugging
just zenir isn't all that
exciting still don't have the thing that
we
want oh okay so these are the dot
files and we are actually saving them
okay so this is in zenir prepare IR
any of them we're not getting
we're getting them
all uh oh should I move the yeah we'll
go there
so this shit's in zenir prepare
IR but it just prepares the IR I want to
debug when we output the IR I mean I
think I would get the same thing out if
I did not h13
oh well this is
something no Max cycles per
woo estimated time oh it's going to take
negative e minus
seconds L2
broadcast kdma r dma w
dma okay that's interesting
perf
stats that looks
useful that was
sarcasm Ben kungle thank you for
subscribing what's Tiny grad in one
sentence it's pie torch but tinier
after engine lowering oh good thing we
lowered the
engine yeah there we go someone read the
description thank
you oh I think I got excited about that
one before let's just strings all this
crap and see if like anything's good
what's per count
bias that's
interesting it's probably much more
interesting if you're compiling
non-trivial
programs we're still trying to figure
out the one assembly op
well the type is a knee fused C let's
grab me
Network after mirr Builder do we have
that we
do it's just as unexciting is the rest
of
it okay I guess I really don't know what
I was
expecting where's the code
Jen for
unknown kernel format and code gen you
see you think you see something like
that and you're like oh that's going to
lead to something exciting and then you
look at it it's just reams of C++
like I said reams of
C++ get kernel
format Zin kernel format an& config
kernel
format do I have Zen kernel formats is
that those things that I was figuring
out
those are Zen Ops
television that sounds
right for
element y should have been replaced
before code gen
okay you know what we could start doing
too we can actually like this is running
in our process we can just debug
it yeah maybe that's the right move
okay get kernel format never
called good to
know
Cen Zin code generation let's try that
okay this one gets
called anic compile procedure anic core
compile forgot we had a debugger
this looks like
junk uh oh I know what we're going to do
let's build neuron and let's put a break
point on the lot oh hell yeah boys oh
this is gonna oh ready for some slam
dunk shit
let's go let's go let's go let's
go
neuron remember when we discovered that
sign lot
shit yeah I documented it didn't I yeah
get sign
lot break get sign
lot
compile simple
neuron oh it didn't call get sign lot
what how did it not call get sign
lot it had to have called get sign
lot but it outputed a sign
lot I don't get
it it literally outputed a sign
lot show okay how do I show break
points no this doesn't make sense show
great
points
lb break
[Music]
count info
break oh breakpoint list and L
DB wa but that's right
our simple neuron
pist how is it getting that if it's
never calling the function that makes it
what do you mean that's the getter
still should have to be called
right
externally doesn't make sense
okay
well doesn't make sense but whatever
move on
neuron Zen par neuron unit
Zin pars neuron
unit okay that got
called um what is it called oh there's a
nice way to like print it I was doing it
before do any remember how to do that
nice print of like CF
dictionaries uh info registers
PP register
list register
show
register
read oh yeah it was
like PPX
Z how do I print
the nice
print not register read I did it last
stream po yo you guys
know um what dollar sign okay there we
go all
right okay so that's being called with
neuron unit
first we call parser on unit then we
call code generation
that's under zenan and core compile
uh I'm just thinking of Cornelius
Street want some headphones no no can't
do that to my
Tories
um I'm good
so where are things going after this
code generation oh I do need one water
for
my okay
Coden handle kernels I think that's
called
oh Cen handle kernels is called oh it's
called by underneath Zen IE code
Generation all right
cool what is this thing called zenir
Coden handle kernels oh yeah let's go
deeper no no that's the same thing
where does it output the hwx file I'm
sure we can find that like this is a
normal process
your eye twitching
yeah oh
how do I do uh that
how do I put a break point with a wild
card R
break I don't think that's
right oh cool it is right
okay Cod genen
TDS okay after Zen code gen handle
kernels get to code gen TDS
just
underneath yeah I mean this is
interesting what is
that this looks like the function thank
you oh what is
this that looks like some debug
shit nid TI
a TDS make
list add relock
the mouse keeps disconnecting and
reconnecting
get
that
okay cash in table
well Cen value to register here we go oh
handle any e ler set colonel dma
Source wow Zin
A&D handle engine layer oh we are going
deep boys we are going deep how does
anybody write any of this
code
like okay so you call the compiler it
calls core compile calls code generation
which calls Cen TDS which calls zenir
Cen handle TDS which calls Zen Cen
handle TDS make list which calls handle
engine layer which calls handle NE layer
which calls set kernel dma
source handle kernel ZM dma Source
config do you know what I mean how does
anyone write
this oh okay the data type might be a z
a any
instruction oh I like
this okay let's focus on this handle
engine layer
okay here we go so Zen instruction
register
read zero
let's that can't be zero
oh is it an engine layer
one of these has to be an
actual maybe it's Z any instruction one
of these actually has to be the stru
that is
uh here we
go this is the Constructor for Zen and
instruction ah
okay is it that Destructor
and TDS make list
oh is that the same shit that I've seen
in
the ff90 no it's not
it for
we put a lot more effort in the microgr
to be
fair Z Cen TD common okay are we getting
anywhere with this
oh oh I did it I was off by one this is
the a any instruction that's the
unsigned
long ah okay so now we're calling handle
engine layer on an a
instruction those those are Pointers
oh what's that that's a
string probs output
Source that's another
string probs
output where's the actual
data more
strengths my layer op engine layer and
any bypass fused any
bypass whole bunch of
strings how do we get to what's actually
like the thing
greting to L over there
table Yeah table I'm having
you make like a wine
sauce no it's not
stripped don't read patents
ever patents are evil
what don't read patents
ever and it becomes willful
infringment
um here we go look at all these Zen
destruction things
what's a titty
[Music]
header okay in any
instruction
underneath there
titty header titty
header oh underneath here we handle the
titty
header yeah I didn't know Heart Break
was a thing either and then I Googled
it um handle any
layer oh neural engine layer
Eng
layer handle common
config config common op codes
e wow that's so
[Music]
deep Zin any layer
common config common off codes
e op layer op code is not
supported oh op code to
string wait wa wait the whole time there
was an OP code to string function why
don't I just call it
thank
you can I call it you
think can I put a break point on
wait know it's my dream let's call this
it's a beautiful
function doesn't say it returns a string
I assume it's never actually called
right that would be too good if it were
called Break run simple
neuron no it's not called we should be
able to call
it oh Zin
visualization oh this is a we doing
this zenir do node this is the debug
shit I think run it with debug shit it
maybe it's CS yeah okay
cool what can I call it
though lb call function
oh x per maybe
per yeah we can't call Longs but if I
cast it to something that's like uh what
do I got to write void void pointer int
understand why I can't just do
this Undeclared
identifier but it's a
symbol
actually
no yeah what if I print that okay that
works
um exp per cast to
F now I want to cast it to a function
type c style cast from long to void void
is not allowed
oh function cannot return type void
that's okay
int function cannot return type int
I'm not trying to return function type
I'm just trying to call
it
oh wait a second oh this might be way
easier than we thought
no it's not void pointer function name
that's not going to let me call
it no I hate
C++ called object type void is not a
cast to function pointer
oh I think that's right
oh well I
crashed that's
okay oh is it
thumb is there even still thumb
know
why doesn't that run
well actually I can just read this
should I just look here for the list of
op
codes
pointer yeah but that's not exactly
right what's that that
why is this returning why is this rning
into an
AR 253 that shouldn't even be
53 shouldn't even be a
thing I really don't
understand why
this doesn't
work um
wait shouldn't that just branch and go
to the
string I I don't get
that that looks like valid on code to
me for
you know what's like the extern C name
of this
function that seems like something I
want cuz how is that not in
there o tool Das D
compiler
ool oh print the symbol
table table of contents to a library
print how do I use how do I get o tool
to do what NM
does does nm
work no I don't know what that NM
is just don't type the Zin part no it's
not that you think I could just do op
code to
string yeah know why no I have to just
get the C name of
it
um it's this
here but unfortunately it has a stupid
dot dot dot I just it's this if I just
get
this can I actually copy that
cut I don't want to cut
this will let me call it you know what I
could probably tab complete this
F there's a break
point okay o tool print
symbols ool TV or nmg I tried
NM okay o tool T functionality
obsolete use OB jump
DT
grab pop
code ah okay now we're talking
this ah
okay all right now I get the same stupid
bad access but at
least what can I just call this what if
I just link to it I'm literally call it
[Music]
Lincoln
call void function
eh it's not a void function it returns a
string but
all right get
ready what does it
return string standard string
this isn't even that useful you know I'm
just kind of I'm just mad that it
doesn't work
okay I'm me to get out something
m
oh now the symbols are undefined
a but I put them as X turn
C
really come ex turn C did I do exter C
wrong
are any semicolon
there what never mind
I got at the call I just
didn't oh no
shit I was editing the wrong
file I did SD string thank you
[Music]
compiler oh
oh God it
boys yeah let's just throw this at the
top uh four in i = 0 I less than 40 I
++ get ready for some
dumping
dump
dump oh all we gets comms CU I passed in
zero for all of them but if I pass in
ones
now we're going to get all the Ops yeah
look at that
woo oh yeah which one do you want to use
a clve a
pool a scale a scale bias
perhaps a
A can I interest you in a turnery
dynamic
GOC perhaps a colel pasteurizer
M all right look we got convin pool
right and element wise right there look
at that
oh are there any more op code to
string I love op Cod just
string it's my favorite C++
bullshit man I
pay I pay good money for just a header
file yo if someone from Apple wants to
leak a header file I would uh like you
to oh we can do nonlinear mode to string
too see what nonlinear modes are
cool which one do you
want for
all right those are all those OP codes
those are all those OP
codes
beautiful we don't need any of this crap
anymore we can take that out of the
compiler make sure that still
works all right
there's not even a swift API there's
literally
nothing the Swift API is called corl and
you have no idea when you use corl if it
actually ran on the A&E or not
no no
no I think if we just could have used
Swift I wouldn't use Swift you think I'm
a
nerd or a geek or whichever one likes to
do stupid things this is for a real
reason there's nothing in
objective this boat sailed a long time
ago
boys simple
compest there we go
okay so now I don't know I mean I still
don't understand like I don't think
those
are I now do not think these things are
anything to do
with I mean they're nice they're the
xenops I agree with
that like they're the zops but I don't
think
they're anything
useful okay well we're still back to
kind of where we were on this handle
common config op codes eh
okay so we have a Zin any
layer well actually I think we can do a
different
layer If instead of we what if we just
run net.pl
okay the interesting class is
this Zen any instruction I
think R common
config P config
someone explain to me what this like 7uu
is and stuff does anyone
know I'm sure it's a normal C+ plus
thing I just don't know
it for
okay some cash
crap and then the real function which
creat shit
okay this macbook's got power for
days are we in ad are we in Apple ad
right now
yeah
huh how do I get this output
is that an
error need zero tid
does that keep
happening how many boxes is e boxes is
e maybe we should do a
pre have
Cod that sounds
great is there a debugger for the A&E
compiler yeah I mean I'm I'm I'm running
the debugger on
do you want to set the break point on
those
strings I guess I
could calculate
size t-m and screen doesn't matter but
fuck zish zish is a shell for
losers whoever uses zish is a loser
and I don't really feel that strongly
about Z
but someone's going to be like George
talked crap about about about Crow
developers who write and react and now
he said that you can't use Z
do you program when you're sick yeah of
course why would I stopped programming
just because I was sick always got to be
programming you want to be great at
something you got to do it look at Jake
Paul man guy's a boxer now can you
believe
that a boxer
some people talk shit about him on the
internet he's like I'll fight you like J
Paul that's scrawny kid now like look at
him man can't get over
okay what are these mem
copies this seems somewhat interesting
this seems almost like it's outputting
like real
things for
oh okay add relock what if I break on
ADD relock
oh wait 40 81 81 81 oh look at this 81
look at that
shit yeah that's
that
yo oh
boys oh we finally found something we've
hit gold on ad
relock oh this is
gold
look if you
dump yeah okay look so when I dump this
X4 I end up with
this there's also a string being passed
into this
function X4 goes in the
hwx all
right so now let's uh let's just restart
this uh we're going to compile
net.pl and we're going to put a break
point on ADD relock and now we're going
to run it and now we're going to dump X4
okay first
relock yeah is a bunch of
40s next relock the 81 shit next relock
bunch of
40s oh yeah look at this one this one's
got to be in here too yo the these 4040
c0 oh yeah look at that he 4040
c0 40 40 okay so that one starts
there ah all right let's figure out what
that string says now how do
I I mean you know please
work uh no that's Z section
image
oh this because this is a big
string K any
zero was this the other whole
time that's just the weights
who wait what is this
a that's boring that's just a
scrap okay these are boring names
yeah Zen compute mutable section add
relock sing compute program contain
section
in context build compute program
those numbers in
there what these numbers
data h
it's kind of junk like it's kind of all
here you
know this is n context this is z
section this is string
that's getting output into the shit oh
maybe it's that range to
d0 yeah because okay look get
40 Z 81
81 80 80 80 80 80 80
80 okay
it's another copy of
it for
oh I get what this is It's a reference
to the
[Music]
Kel so
[Music]
okay yeah
this here is just a
reference and the reason the default one
doesn't have any is because they don't
need a
reference because they're not doing
anything it's that's the
noop okay
thanks
x48
okay for
is there more of
that can't be the same relock
3381 do we have that
I am just compiling the same thing
right net. P list right
it's a 40 40 c0 where's
that 40 40 c0
here oh here 8088 yeah here it is I
don't know what that first part
is oh it's right here oh never mind
30 88 21 right there at 1 C6 is image
16c it's
only it's only8
bytes but all right so you guys see what
these things are they're the pointers
this somehow is the pointer to where it
puts the
uh imagery
lock okay last
one probs output source
and then what range is the relock
in short it's
only where it says
C1 right there
258 it looks like it's
only four long
okay so that's it for the
relocks all right now it knows how to
find
this is a pointer to the image
what is
this it's copy of that
useless what was that
that's the whole beginning of this is
the whole thing just look at this as
this
shit I don't know what writes that
header but okay so those things are
relocks so when it calls add reloc first
it does that one then it writes this
shit out then it writes that then it
writes that okay like that makes a lot
of sense right
so sensible this whole
thing starting to come together
so this is the kernel this is like the
the struct that's going into the
thing though it doesn't look like it's
just a single struct it does look like
it's more complex than
that like maybe they are
commands we can break it down
more right where's the function that's
calling them what's it calling it with
let's just try to read that code
what's up with all the poo poo
VSS me
copies yeah
calculate size and btes from rig count
like what type is
this okay this is it here let's make a
struct out of this oh God what's it
doing all did I already do
that I
undo undo yeah way better than Ida
but yeah I think this is the
struct or at least this is inputting to
something so this is in a big
[Music]
loop another loop I guess actually first
we make a
list then we check it twice
all right we got we got 10 more minutes
of
stream think we made some incredible
progress R today on the neural engine we
almost understand what it
is maybe if I knew C++ I'd be better at
this in the poo poo poo
there oh maybe the puar one is the puar
27 yeah yeah yeah yeah yeah okay what's
this
yeah I think this puar one is the one we
want
put a break point
there is that g to
work no way it's like relocked or some
crap
why can't I make a struct out of
this turns it into puar
to make to poar
one do think this is like the copy
though and this is what's filling in
that
structure so it takes it from this other
weird struct we don't understand and
puts it into this struct but this is
like the
assembler
yeah all right I have an idea let's do
one last
thing let's put a break point on zenir
COD gen handle
TDS then let's wait till we hit it and
then let's put a breakpoint on M Copy
and see where that this memory is
actually getting copied
too see all these M copies in
here no I don't want to break point mm
copy I take it back
I want this mem
copy how do I get this mem copy
just like step through this here what is
it in
here
okay how badly do you want the break
point
there for
here these ldrs and
SDS what why not
this okay we're going to store it in
X8 register
read dump
X8 step by
starts with two starts with
two D bites
yeah
64 starts with two okay step
ey
what oh no I exited
run it again it'll
work step I I I I I I I register read
and then here we look at X
this yeah okay 422 422 right there there
you go
okay we found the function that fills in
the beginning of the file this is that
whole
it's in that create function right
here a0000
Z this is the store of the
first bite in the
hwx all right does everyone see it 02 02
422 we can step a few more and then like
oh look at that FF is
6fa look what's right there FF
6fa so this tells us so much about the
structure of the
file see
this says that the first one C are a
header right because that's one C 0 4 8
C 10
uh 14 18 and that's 1
C
header 0 to 1
C yeah
right now we have some other optional
next 10
and then we add a
relock
yeah don't really know what calculate
size in
bytes calculate size in bytes from reg
count
yeah so that must let's see what numbers
we're passing in here yeah this is
nice pass an F
passing one and
B pass in
11 x * 4 +
4 three
four so these are registers yeah yeah
yeah okay
six that's
it so each one of these is a
section yeah all right now now we're now
oh this is this is done boys this is
done we got to figure it out all right
run
that now we're calculating bytes and
size from s we can step I we'll step
through that function now we
return to the first call
there oh man you know I wish these
things were like synced up and like were
nice you
know I could like you know go to that
that that'd be that'd be too convenient
you know that' just be too
convenient is there a way to sink a gig
with my computer
okay moves and then let's go let's step
to the mem
copy
um okay so where are we now yeah here we
go here we go here we go let's find us
with respect to the beginning of the
file so this first
what you
say see if we can find the beginning of
the file got to find that
too there is that
40 422 is
422 is that in
there
40 o2f 45 right there 6fa oh 422 is
right there subtract again yeah we get
to the bottom so this is at
128 something's at 128
okay once again we're back to
this um
print 27 I don't want that what how do I
print SLX yeah
1B so that's the 1B step I
here's the mem
copy now register read all right us uh
print x0
minus
xx0 we want to subtract that
base 16
see okay
continue step
I till we get to the mem
copy print x0 the base this is at one
e0 continue
this the three that's
aligned go to the M
Copy
22c almost
done that is at 240
and that is at
258 now let's see how that aligns with
our other shit so by the way xx4 *
4 plus 4 is
20 so there's probably some like header
at
254 254 is that
um by the way just to confirm that we're
actually talking about the right shit
yes C1 there you go right
there I'm going to move this up
here this is this this right here is the
single best thing in this
file yep and notice how how it matches
the relocks really well that's the
relock at image then we have parameters
about
image of something at
okay
x128 x1c is a
reloc
x and then calculate size and bytes from
R
count so actually let's check
something XX 128 + 0xf + 4 +
4 what's that is that 168 yes it
is so now
what child box from that
163 oh I want to smoke some weat
it's childlike my hand's not big enough
to Joe I lost it having a code last
night man squeeze both sides and then
left I can't my hands too small to
squeeze both
sides see the picture on the
front no they too smart for
me if you squeeze I'll
open thank
you what happened to you I well I don't
know I lost having a code last night I
did have to have had to add some beer at
dinner you
know I mean I don't know if we can smoke
weed and going outside what to smoke
yeah oh I got
my okay so each one of these you see the
pattern
Okay so
tells you how long it is and like where
it gets copied
to are we adding
hex8 does tell us how long a M Copy is
nothing for a whole lot
that's a block
there that's a
block can we like know the size at
all one Z has nothing at
it two 2C has nothing at
it 240 has
08 and then
2 58 I mean okay so let's see
258 + 6 * 4 +
4 it's 274 so that's the end
do like
128 plus F this actually only gets me to
168 so there must be
some there's a 4 byte header before
these nothing
there oh wait no that's not exactly
true the 3C is part
of God I can't you know I'm just going
to modify hwx plus I can't read
it
um okay hwx pluss
make an
FJ 4 range Z 10
4 uh SS equals some ad a code shit right
here um
there we go
oh much
improved okay so the 3C actually did
come
before my dream is if there's like some
length encoded in
here 6 is right
there that might be a
length 18 is that a length x18 I believe
so 3 C is a length Okay 168 + 3
C
164 okay
now
168 16c + 6
C
1d8 this gets you to here okay that's a
length look at that we can parse
it um okay so wait how long is the block
actually so
it's 128 + f * 4 + 4 360
oh I should I should have checked the
lengths to mem copy we can do it again
we can just check one of and like I
think we have
it hex 40 is that what we expect if we
do Hex f * 4 + 4 is that hex 40 yeah
it's x40 okay cool um so let's just
calculate these out
this is 128 to
168 this is
one 3C to
uh 1
DC oh man I love finding structure you
know it makes me so happy
structure civility a structure I love
structure yeah
who's asking why a the why
people a why people you know why people
show up and ruin everything
okay so if we go to 258 and we go back
one we get hex 18 which is the thing to
go to the end if we go back to one we
get 3 C and I guess there's
probably so before these is always the
length so to predict what we're going to
find if I go there we're going to find
10 at 3 EF yes we do we find 10 oh
prediction when you can predict you
understand that is
science yeah live forever Bros but you
know why live forever you know you can't
you can't you just can't ask why too
many times because why is a stupid
question we have
docks all right now where the red count
comes from oh that's a deeper question
no this one
oh like relocks are like okay it's like
a normal I know what relocks that's like
normal there's nothing really weird
about the
relocks this F4 is probably the length
of the
command is that right so okay
F4 plus 2
C 28
it's 120 yeah which is
just
3C what you do um okay an unknown person
send me this
mask I don't I don't want any of that
stuff near me what stuff
that mask why freaks me out man look at
it nope it's like a BDSM mask as
a I don't like it freaks me out
man relax George what are you freaking
me out for
bro the header was to one C
that 30 is not
right and then there is some optional
shit here this optional
shit there was the one C and then that's
that that
said
was Elon actually ever here or did
someone just gift him a
sub El
came no it's not AOC time
yet Elon came
through uh oh yeah I guess it has to be
Soprano's
time I think we made great progress
today I I think that we figured out that
these things are magic and if you just
parse them that one's one that one's one
they tell you everything you need to
know they can parse the whole thing as
commands
I guess it's really like these just
commands to write
registers it's just some like command Q
shit I
guess this an address and then a
length address and then a length address
gr and the length
do see
right let me just write that parsing
quickly okay
if I equals
equals 2
B we're going to say that's the first
one we
highlight okay first highlight equals
false highlight equals
true
um if
highlights colored we're going to color
the highlighted ones
yellow colored
yellow George
What Do You Know Where Your Children
Are
close hour yeah well I'm almost done you
know this is so close look look look I
got the F4 to be yellow look look look
um okay let's say next highlight
there's a latte does it have latte in it
wish oh what
yeah I think it's time I I got to go but
but yo it's so addictive man so
addictive you know just give me give me
one more one more one more you know I
just just I'm so close man you know I've
never been
closer oh it's so
close oh if I is less than length of X
oops oh yeah okay look F4 lit up 3C lit
up 6C lit up 44 lit up 0c lit up 10 lit
up 18 lit
up
boom it's
beautiful those are the those are the
command those are the command
addresses the lengths yeah and I think
the thing before it is
probably the
registers it just writes
them that's how it goes all right guys
I'm happy with that big progress big
progress
highlight the
commands
ah so you see like like like you look at
this thing and you're like it has no
structure but then you you keep working
at it you keep working at it and you
discover the
structure between the this is a um this
is the the convolution and this is the
reshape
command uh and you can see that in this
section there's no differences
us which is very
interesting thank
you have a good night get commit we
pushed we're good
WEBVTT
Kind: captions
Language: en
WistfulFella: Ay there from Saudi Arabia : )
WistfulFella: All good bro
hardtarget4: ANEgrad
WistfulFella: WOW
Denis0109: jooo goeerge wassuuup
WistfulFella: Aramco is #2 btw after Apple
miloeu: @georgehotz you doing AOC on stream later?
Denis0109: hooow rr doooing maaan?
miloeu: :(
miloeu: didn't you do it last year around?
anstefa: hi
printhellosailor: @miloeu adult content isn't allowed on Twitch and George's GF wouldn't like that very much
printhellosailor: AOC isn't that hot either
miloeu: lol
lumoredev: HeyGuys
anstefa: What do you think about the 12,5km hop of SN8 ? :)
miloeu: did you do the caching technique in day 10 part 2 or something smart?
Denis0109: ooh I saw it the Album is intersting maan
anstefa: It's history
anstefa: :D
aHaquer: Man gotta do what a man gotta do, and it appears that man gotta do Taylor Swift
BayramCnTtli: hi george
hardtarget4: we beefin' with drake now?
zzb303: what are your thoughts on EA?
FargioFarmani: Taylor Swift Pog
YannRn: Hello from Luxemburg
devdual: greetings from germany m8s
desm01: have you played Cyberpunk?
Denis0109: I am a fan too maa boii :3
BayramCnTtli: no he is not play game :D
lumoredev: catJAM
resurektzz7: Why would you admit that :(
MalgaVerstehst: whey luxembourg
ilikerecursion: Kreygasm Kreygasm Kreygasm Kreygasm BibleThump
sureom: hello!
Denis0109: lets make a taylor swiftiii streaam :3
UltraScientism: priviledged song
Bretel: hi i'm from italy
patrickgekko: you're smashing AoC, good lad
actuallymad1: I respect it
hardtarget4: drake roast session
miloeu: @georgehotz what you think of the new ARM macbooks
K0enich: LuvPeekL
thv293: what your all time fav taylor song?
jadg_: Let’s go
jonathan_wimberly: yo yo
sureom: sing over it, dmca wont be able to recognize it
hemation7: SeemsGood SeemsGood SeemsGood SeemsGood
Denis0109: Is Alex also a Swiftiii Fan?
jaxopie: SeemsGood
alexmchugh: sup
owCarter: Totally get it.
sidneygtt: Lmao
tomcroose: Yo
jacekakacz: George when you want to open company in Europe?
bazeronii: lmao
CompestLive: Hello!
sidneygtt: Hahahaha
philphil16: hi
Varicode: FeelsBadMan
twistedecho21: god i hate drake
naujsenju: We’re liiiivvvvvvvveeeee
hardtarget4: drake in the trap lmao
kklisura: What's up?
Varicode: alkUpset
sidneygtt: Wtf is wrong with you
hemation7: ghost writers NotLikeThis NotLikeThis NotLikeThis
twistedecho21: drakes up there with 69
rustduck: TriHard 🔥
Penguino138: gogo geo
l112358: How did you get pytorch to work on the m1 chip?
jMazek: geo hotz cheers from Italy HeyGuys
Varicode: 😂 👌
tonchek_: lmao
jonathan_wimberly: LULW
socialdependency: K.A.A.N. &gt; Drake
smurfd0: ... and 30.8k on ig
anguscupcake: woah yeah
Penguino138: whoah yeah dab floss
farlopote: orslokCerebro
Denis0109: what thee....
Stegosaurian: will you ever release another song?
Varicode: SourPls
Joykillah84: Kappa
palac105: is this the little dicky stream??
paz_vizla: Hi
sidneygtt: Lmaooo I love it
glutamic0: Mate, you are not Eminem
alex_pt_: @kklisura "Up" is a word to indicate a direction
Denis0109: most music today is terrible maan
aaronm1466: NotLikeThis
bazeronii: this is hilarious
Landepbs: hi
zzb303: lmfaoooo
Varicode: Tootsie RarePepe
WistfulFella: Remember the SONY Rap video you did? Amazing days dude BibleThump BibleThump BibleThump @georgehotz
fortuitouslover: you streamed for 54 seconds tomorrow?
bazeronii: he just rhymed time 3 times
hardtarget4: put out a drake diss track
CEOChillton: toosie slide is mem shit
l112358: How did you get pytorch and numpy to work on the m1 chip?
the_g1an: lol
BBQuan: u need to diss drake now
sidneygtt: @wistfulfella Lmaooo
axisb0t: sup geo
zzb303: he's just responding to the market needs?
CEOChillton: ah yes, this Kanye beat is insane
sidneygtt: Letssss gooo
UltraScientism: He's performing his song without getting a performance license AngryFace
twistedecho21: drake was always terrible
teerv: @georgehotz thoughts on ATG sale?
jMazek: Drake not even top 5 no cap @georgehotz
leonardssh22: hi George! how're you today?
socialdependency: TSwift!
BBQuan: BARS
Joykillah84: +1
bigfatgoale: YO MY FIRST TIME WATCHING YOU STREAM. LOVE FROM INDIA.
3FXX: eminem next_?
Denis0109: jooo geoorge plss make more soongs for us FAANs :3
hemation7: Kappa
nasimekdi: pog
sidneygtt: What’s going on
helmutschneider: All too well is her best imho
palac105: yo you can probably pull TSwift, is she single
nasimekdi: what's ir thought on her new music
kokiworse: yoyoyoyoyo
Stegosaurian: is tomcr00se making a comeback?
twistedecho21: what about swish swish by katy perry?
socialdependency: TSwift cover at a milly!
sureom: Kappa
Dolceboi: yoo my G
ciurca: gonna get those AirPods Max Mr. Hotz?
kklisura: Simp? lol
thv293: LUL
0xBADBADBAD: D:
zigzati: D:
keng1ne: :D
hemation7: SeemsGood
MaelarethTV: we fixing tinygrad today?!
jMazek: what about lizzo tho?
nasimekdi: lmao starting it with Taylor swift
Zepcon7: George at his best
Stegosaurian: bring tomcr00se back
teerv: exposed
farlopote: lmao
Varicode: ConcernDoge
Denis0109: Whats about JOHN MAYER? You have to see his songs man
Koduck007: fortified yerba mate brah
printhellosailor: George is snorting pure grade tinygrad
anguscupcake: kratom
JigglyGirls: jphPickle /
mdmittriy: !uptime
palac105: @georgehotz what is your opinion of little dicky?
keng1ne: kratom's pretty nice Kappa
AleXander1022: hey dude what's up?!
kokiworse: a shirt for every drug
jMazek: poppin addies?
zzb303: he's def on some shit lmao
diddyp1_LiiD: @georgehotz how are you liking the air? thinking of getting one
twitchdeletedmyfknaccount: Kratom makes me feel barfy
jMazek: tootsie slide
Koduck007: so sober you stay out of the framer
lef_xyz: i want adderall toast
JigglyGirls: maybe i should get my hands on some adderall sugoiEmil
UserNameThe3rd: So when we moving to Austin, Texas
Denis0109: Too much amphetamins for today
OetziOfficial: hi
jacekakacz: George when you want to open company in Europe?
printhellosailor: @zzb303 he was dropped in the cauldron when he was young
StarboyCasper: I never used aderall, idk if I should
Varicode: lukewarm take
bigfatgoale: Drake peaked on Pound Cake
zzb303: microdose?
AleXander1022: what's your opinion about Linux ? Do you use it ?
man_dos: you're a beast
nasimekdi: what's adderall feels like
sidneygtt: Blocked
DailyDisclosure: hi george
OetziOfficial: enjoy the tea m8
kklisura: @jacekakacz They already have office in EU.
UltraScientism: so caffine
socialdependency: Sativa &amp; Coffee
zzb303: I wrote a 60 page paper in one sitting on adderall
lef_xyz: drake has 0 failed projects
CEOChillton: @nasimekdi ideally you dont feel anything unless theyre side effects
bweston92: all the pound cakes are great!
Denis0109: Plss install Arch Linux again. This Stream never gets old
kokiworse: so strong
panadoma: 0
Draco0x191: LUL
DailyDisclosure: you would like Lupe Fiasco - Pound of Flesh
bagmadeofgoyard: that first open pilot video deserves an Oscar!
mobal: @kokiworse stronk
slanthedeceivers: LUL
nasimekdi: seems like ur spotify playlist is lit george
0xBADBADBAD: That was trash
0x80h: Talk is cheap, show me the code
69king1: Do you recommend the M1 MacBook Air for programmers?
mucinoab: My boy George!
0x80h: lets code brother
sidneygtt: Amazing girl friend
nytherino: still can't figure out why you hate zsh haha. can't find any significant differences
irsadb: how many hours you spend time for coding
palac105: less drake more code
kklisura: Need this energy today!
Varicode: 📈
Ziv0: LUL
Zepcon7: Energy level: geohot
Varicode: You're the one trying to catch up
ilikerecursion: can you write some C
DailyDisclosure: PogChamp
Varicode: JK :)
ilikerecursion: like a real man
xrealyy: go play cyberpunk
Denis0109: lets open source the whole universe
coProof: PogChamp
sidneygtt: *10
Penguino138: YOu should have said each other not winning
bagmadeofgoyard: 0-100 The Catch Up
Varicode: Bars!
nasimekdi: he can code he can rap now we're doing tinygrad
anothernewaccount29: competition not significantly related to well being btw
socialdependency: 40,000 doesn’t sound too bad for python.
PlushMasta: ketchup
DailyDisclosure: true
PlushMasta: ketchup for real
zzb303: talk about relationships mono vs poly
VektorRaum: if they fork openpilot and you go bankrupt is that still a win for you? depends on the definition of win
lef_xyz: monkaS
Landepbs: jaff loses
mucinoab: This guy funny
DailyDisclosure: oh the neocons WILL be on board
Penguino138: Galactic Republic get FUCKED
jacekakacz: Could you make Java tutorial? How to write console app?
jMazek: FUCKIN ALIENS MAAAAAAAN
sidneygtt: Lmaoooo
nasimekdi: 40k code wow
Tuhafadam: Hi geroge
kokiworse: export freedom
imnotabrainsurgeon: @georgehotz why you like Mac over Windows for casual coding/browsing
DailyDisclosure: lmao
Koduck007: who made the SN9 stand?
saintmthw: intergalactic oil PogChamp
PlushMasta: hahaha
Denis0109: I saw an alien today, he wasnt nice I PUnched him
offgrid8: what if there are some aliens here watching the straem
0xBADBADBAD: Wow wow wow relax there what do you hve against aliens maaaaaan
Varicode: These are mid-day noons w George
offgrid8: hh
theshutin: George is on some shit today
herrsch_de: did he take something? he‘s a littlw too active
rafael_pac: democracy, the god that failed
sidneygtt: Fuckin Aliens 👽 Lmaooooook
proton1107: lets make the aliens learn css that'll teach em
Draco0x191: @Koduck007 I did monkaS
twitchdeletedmyfknaccount: We need to bomb somebody
jMazek: 100k total... that's i mean not too bad
Varicode: Don't crush up the Vyvanse smh
TheGreatResetter: lool
ein_echter_depp: tyler childers is an amazing musician -- you should listen to him
DailyDisclosure: Vyvanse PogChamp
Koduck007: @Draco0x191 rip monthly bonus
mobal: which application is this? :D
nasimekdi: isnt that alien news scam for promoting a book
jMazek: Pepega 10 millies
socialdependency: 40000 lines, 15k /n
DailyDisclosure: OpenPilot
raimel_medina: Yo
Draco0x191: @Koduck007 yeah... I'll have to go Boeing.....
UltraScientism: How is Elon Musk in person?
ein_echter_depp: do you listen to music when you code? if so, what?
DailyDisclosure: https://github.com/commaai/openpilot
irsadb: who is Taylor
Denis0109: Taylor is a flower
thecoder15: Yo @georgehotz off topic but do you guys use rolling or global shutters on your cameras and do you see degradation when doing slam if you do use rolling shutters ?
Koduck007: ugh
mero_1181: That’s morning sex hype ... I can tell !
imnotabrainsurgeon: @georgehotz Why you like mac over windowws?
mero_1181: No aderal or shit
bweston92: @mero_1181 aha
xrealyy: go play cyberpunk.. on a mac
teerv: @georgehotz what is your tier list for central stimulants?
Denis0109: Does Alex like Swift?
offgrid8: why not use linux
paaaaarth: who the beautiful lady????
kokiworse: so now it's official
onemarko: how is ANE hacking progressing? i have been out of the loop
jMazek: tortellini? no shit cheers from Italy man
offgrid8: it has all the juice
hawsh: oof
thecoder15: Have you tried modeling global shutters @georgehotz ?
herrsch_de: aderal is different. what he has must be better
nasimekdi: hwould u consider streaming games
Major_Spicy: I know nothing about programming and im still here watching 4Head
bweston92: bweston92 subscribed at Tier 1. 
nasimekdi: play cyberpunk
nrjklk: yooooooo wadup everyone
socialdependency: Play Cyberpunk for an hour and watch it crash. Lol.
sidneygtt: Why I can’t post my txt
Draco0x191: What browser does George use?
xrealyy: can you write some decent AI for cyberpunk man
Denis0109: yeah george uses new github darkmode. good boii
panadoma: is Mac good or is Windows bad?
0xBADBADBAD: stop moving the damn plate Jesus
nasimekdi: i want ur rant while playing cyberpunk
nrjklk: whats hea eatin?
nasimekdi: or like ur vision on what's the future will look like
x_YoshiDaDude_x: lmao 0xBADBADBAD
Varicode: @nrjklk tortellini &amp; avocado toast
bweston92: why is none of chat subbed man?
d3adin: I just watch George to remind myself how unintelligent I am and that I need to study harder :D I have absolutely no idea what he is doing but, it looks fun
mdmittriy: dunno
Varicode: alkWideCorgos2
mayphilipp: i dont know either
the_gilps: +1
nrjklk: ohhh yeah merge baby!
highflyer_nl: How do you defend against patents? Is it an issue in reality?
malmeani: somebody in our country said he made open pilot... he was interviewed on tv PogChamp
bweston92: @mayphilipp @mdmittriy y'all was being quiet ehh ;)
hawsh: !github
Elinbae: Why dont you use that intellect of yours to find a cure for covid instead of doing this?
hawsh: !git
Tunelesschan: @d3adin ur not alone, thats pretty much everyone in this chat
DerivativeIntegral: DerivativeIntegral subscribed with Prime. 
mdmittriy: yeo
bweston92: I found this guy on YouTube this content is really great!
ziegerator: monkaS
VektorRaum: how was your advent of code today? did rotation matrices or complex numbers?
DailyDisclosure: greek yogurt is amazing
her3hero: why hate on joghurt
her3hero: :(
Denis0109: vegan yoghurt
irsadb: yoghurt from turkey not greek
nrjklk: hey geohot, whats your view on competitive programming?
mucinoab: He likes it
jesor24: hello George
afterworktech: George can you increase the mic by 15%?
nytherino: holly shit since when does github have dark mode?
twitchdeletedmyfknaccount: I’m in Mexico and you’ve inspired me to find some back alley uppers 🙏 you are my lighthouse in the storm
irsadb: can i buy commai stuff from Europe or asia
Denis0109: @nytherino its new, since last week
DerivativeIntegral: They added dark mode recently
her3hero: hire him Pog
hawsh: hire him
gussyyy_: Gw guy
DailyDisclosure: 👏🏻
gussyyy_: You impressed George.
Crime_Stein: mod him
bweston92: @Denis0109 github/settings/appearance
Lana_Lux: yo @georgehotz hows it goin? hey chat!
DailyDisclosure: lol
Gimi134: hi
Croww__: Lana_Lux 👀
pakaav: yo wassup youre a beast dud
afterworktech: hello @Lana_Lux
mayphilipp: Hi @Lana_Lux
kingf66: @georgehotz i like how you fake eating something so that people dont realize you are a lizard
pakaav: so good at developing
Lana_Lux: @Croww__ @afterworktech @mayphilipp hii :)
hug0Hq: + one star for tinygrad
Denis0109: jo goerge this code was torture
gussyyy_: @georgehotz - What's better? Github or BitBucket?
satraxap: !viewtime
gussyyy_: Actually - can anyone tell me what's better? GitHub or BitBucket?
mucinoab: GitLab
nrjklk: i like github
playcraft2: @gussyyy_ GitLab
Denis0109: Gitlab is great
mayphilipp: Whats your opinion on tdd?
b1zz1e123: gitlab
Lana_Lux: @korova_milkman the rules are strict when mods are around. better watch yourself
Varicode: alkMoost
lordFOE: gitfucked
nrjklk: its a problemm with collab lol
pakaav: collabs deprecated Kappa
Denis0109: I use 3.9 man
bweston92: What operators?
Koduck007: walrus is animal it operates itself Kappa
Varicode: :=
her3hero: :=
RobbieBillions: :=
her3hero: := no
riseofninja: emoji operator
jesor24: Hi! George Bon Appetit!
blurjoe: :=
Croww__: :=
lordFOE: @georgehotz where are you in the world today?
nipalert: :=)
bweston92: Ahh :p didn't know they was called that and I'm a Go developer where I use := all the time aha
rapazkaleidoscopio: First time in here @georgehotz please Call me Richard
nrjklk: hi richard!
Lana_Lux: @korova_milkman the honor is mine
0x80h: Walrus operator is just to assign default value to things while executing it?
marcelbischoff: It’s really only used in test_mnist and examples
MysticTruffle: how do you not have text to speech
korova_milkman: LUL LUL LUL
kingf66: no
pakaav: come on, who does PR without labels
jesor24: Who is Rus?
kingf66: No
gussyyy_: What's a Linter?
kumbuZ: who doesn't like playfull mods?^^
kingf66: im okay :)
marcelbischoff: I looked up how to upgrade to python 3.8 in colab was kinda lengthy
bweston92: pip8?
almostquiet: Ur talking with food in ur mouth
almostquiet: did you knnow that
s00x7: no :)
dil31: use .editorconfig
Varicode: It does work
lef_xyz: pep8* @bweston92
dil31: no linter needed
afterworktech: rise your head if you are smart enough to write linter for George
0x80h: print(walrus := True) reminders ruby print foo || true
gussyyy_: Hahahahaha
almostquiet: ok you got it
correia0xa: i can´t write a lintr because i don´t know what is a lintr so i am a noob
pakaav: Whoa, BURNT
stoompyyy: lol
valtermaestro: Yo
0x80h: lol
Barisartt: Talking and eating at same time is double productivity
pakaav: BUUUUUUURNT
norsesage6934: lmao
Draco0x191: LUL
bweston92: @lef_xyz loool that's what I meant :')
nytherino: damn
Denis0109: Alex can implement that
BAKAC0: Click alt ф4?
DailyDisclosure: @gussyyy_ checks the code for errors in syntax and stylization
Zepcon7: FACTS
Koduck007: error: unspecified x
printhellosailor: -* is the Christmas operator KappaClaus
jesor24: HI
Tunelesschan: FACTS
fortuitouslover: and also risk choking on the food while streaming on twitch
DerivativeIntegral: gotta eat naked
mufeedvh: Thanks for merging my PR the other day!
jesor24: Hello
YourMomYEP: fax
VektorRaum: how was your advent of code today? used complex numbers?
0x80h: wild life
halowine: on osx there is no X
playcraft2: Classy ratchet savage Kappa
Denis0109: hows muscle training going?
bweston92: @georgehotz will you want it as a Github action?
Opasnimiki: isn't it bad for you to eat and talk at same time?
printhellosailor: LUL
badcc: LOL
mucinoab: Lol
Draco0x191: Jebaited
slanthedeceivers: lulw
DailyDisclosure: LUL
d4ydr3am_: Jebaited
pakaav: NotLikeThis
BAKAC0: НАНАНА
bigfatgoale: how do I not be scared of life and be a daredevil like you?
marcelbischoff: At least you have 10x more viewers than those robopeople
Draco0x191: LMAO
fortuitouslover: there is a one in a thousand chance you might die (if you talk with food in your mouth but if you won't take those odds you are dead inside
gussyyy_: @DailyDisclosure thanks!
gussyyy_: f
pakaav: lmao
afterworktech: nice colors Alex
twistedecho21: I'm new here chat who is the woman?
kokiworse: where are the masks?
l112358: How did you get pytorch and numpy to work on the m1 chip?
king_kanak: king_kanak subscribed with Prime. They've subscribed for 5 months! I beat you on AOC Day 12 Part 1, noob
DailyDisclosure: hahaha
Rafabld1996: KKona True
tylovesclaud: KKona masks dont do anything
DailyDisclosure: True
kumbuZ: @fortuitouslover pay his food would sound even better
Zepcon7: KKona True
DerivativeIntegral: gotta wear a mask between bites
Varicode: :KKona:
Varicode: KKona
pakaav: whoever wear masks at home, is the door
Varicode: *
Koduck007: do masks stop spit from flying beyond it?
jonathansel: what you up to these days
kokiworse: I was joking I didnt wanna start this lol
s00x7: Kkona HELL YEAH BROTHER
printhellosailor: Joe Biden is mandating wearing masks on all interstate highways FailFish
xrealyy: they prevent virus spread dont lie
Crime_Stein: masks work for water droplets -.- aka saliva
tylovesclaud: KKona TRUE
j00theft: they dont help you, they help prevent spread
Barisartt: Will it reduce spread?
Koduck007: protection for the wearer
DailyDisclosure: lol
nrjklk: face diaper
StarboyCasper: hahahhaa
techtim123: I have a respirator
j00theft: as long as its &gt; 0%, then its worth it
tylovesclaud: george ur trolling right
afterworktech: need to write on people forehead so they will understand
kokiworse: is the color?
JDOG_HS: for the person who wears it, duh
elyahood: @georgehotz then tell us why the elite is pushing for it?
Varicode: Imagine not wearing your respirator inside your home
pakaav: The virus can get in your body from any entry, EVEN THE EYES, BUT ONLY MASKS, and INSIDE home come on
printhellosailor: facts
Tuhafadam: It protect others
elyahood: @georgehotz then tell us why the elite is pushing for it?? @georgehotz then tell us why the elite is pushing for it?
CozyDinoKigu: But it protect other people from getting my virus
mindthemoon: masks are to help other people, not you
Tunelesschan: I use both KappaClaus
Varicode: :box:
palac105: its to deal with the social judgements
tylovesclaud: george i think ur trolling
DailyDisclosure: I bought a box of N95 respirators in February
imnotabrainsurgeon: @georgehotz I'm a doctor (brain surgeon). Usualy surgical masks helps from droplets. It will not protect completely from covid, but will dramatically LOWER the rates of get infected
myaocat: so what is the box for?
Koduck007: yeah buddy
nodak_dev: I'm new here - what is tinygrad? or what is it used for?
JDOG_HS: gez you americans...
tylovesclaud: masks are made to be worn by everyone, therefore protecting others against covid-19 if you have it
tylovesclaud: vice verse mate
redruzoq: true
kklisura: Come on, you're better than this...
0xBADBADBAD: Americans LUL
kefen1500: I Trust Box MEme
fortuitouslover: Gavin Belon's Signature Box 3
Varicode: Antima(sker)
nrjklk: @imnotabrainsurgeon i trust the brain surgeon lol
michaelkawwa: no no hes got a point
levelsio: AMERICA IS DONE
Crime_Stein: George trolling. Masks definitely better than nothing.
xrealyy: @nodak_dev im not new here and still no idea
pakaav: dude, if you use a mask and dont protect the eyes, is the same shit as nothing
Denis0109: NY Times is Scam
DailyDisclosure: chat is funny af
johnpyp: The mask doesn't protect *you* against covid, it protects other people *from* you LUL
Stegosaurian: the mask reduces the chances of you spreading it to other people tho
sonaldooo: I am American, and yes we are idiots
slowdhere: it's not about 100% protection, is about protecting as much as possible ..
Varicode: RarePepe
peterfdz: WutFace
elyahood: @georgehotz then tell us why the elite is pushing for it?@georgehotz then tell us why the elite is pushing for it?
UnAlpha: sup geo
afterworktech: mukbang with George
colanzio5: the box's message is about liability, wearing a mask to prevent covid is about harm reduction lol
printhellosailor: those masks do promote bacterial growth so you can get a nice bacterial throat infection
DailyDisclosure: you've trigged chat LUL
K4tarina_God: hahahaha no shit eeuu is plenty of corona with ppl like u lulz
proton1107: SOME masks protect, others don't, you have to look at the specs of it
kefen1500: Do not trust New york Times
imnotabrainsurgeon: @georgehotz I'm a doctor (brain surgeon). Usually, surgical masks help from droplets, which carry A LOT of virus. It will not protect completely from covid, but will dramatically LOWER the rates of get infected
onemarko: check N95, not this tissue shit
kefen1500: I trust the BOX
red_scratcher: trollgrad
gussyyy_: If it's a matter of probabilities...........
elyahood: @georgehotz then tell us why the elite is pushing for it?@georgehotz then tell us why the elite is pushing for it
kefen1500: bc ITS BOX
tylovesclaud: george.. the point of a mask is not to protect yourself, it's to protect others from you
tylovesclaud: FailFish
gussyyy_: Isn't it better than nothing?
gussyyy_: Like even 99% -&gt; 98%
kumbuZ: Virus attack lets fight and run
halowine: mask does work in my country... usa have probably curved time and space
kklisura: but... it is...
j00theft: what is the gain of forcing citizens to wear a mask?
afterworktech: trust the box
pakaav: plot twist: the box IS THE COVID
fortuitouslover: Gavin Belson's Signature Box 3
Varicode: Don't live life probabilistically, friends
Koduck007: you need a visor brah
DailyDisclosure: triggered people LUL
magic_spoon_: Joe Biden lizard
DailyDisclosure: lvoe it
nikudino: just because you don't like that that is true doesn't make it less true that wearing a mask saves other peoples lives
techtim123: aerosol simulation is so good!
Denis0109: I mask only helps if distance from a person is there, otherwise its a scam
UrAnusTheBoss: well, look at america compared to other countries
occasionallylegit: box &gt; failing NYT all the way
slowdhere: its strange, because you're obviously a smart person, i don't get it, you're being influenced by something :)
michaelkawwa: why do you think doctors and suergons wear it?
0xBADBADBAD: Chat dont listen to guy that snorts his tortellini
chiliwithpeppers: why do you think surgeons wear masks georgehotz
tylovesclaud: ????????
DailyDisclosure: FEMA cmaps
Barisartt: Small precentage improvement from not wearing is worth it when r value is like around 1 in some countries.
UrAnusTheBoss: you have like the most deaths worldwide
UrAnusTheBoss: gj
myaocat: imagine 2 person naked. one pee the other will get dirty. if 1 person wear pants either of them protected by half. but if two wear pants both of them won't get dirty same for mask there is a risk everywhere and you know it.
printhellosailor: why would anyone trust the box the masks come in over CNN who has never been wrong about anything before? 🤔
yes0_: write YOLO on tiny grad plsss
lef_xyz: that escalated quickly
kumbuZ: covid laser gun 101001101001011
nrjklk: lol i cant believe ppl still havent decided if masks are good or bad lol
mongoloid_jones: F
Varicode: D(ATA) S(TRUCTURES)
thecoder15: @georgehotz covid detecting but plugs
mongoloid_jones: what are u coding
bigfatgoale: how do I not be scared of life and be a daredevil like you?
CEOChillton: "something"
imnotabrainsurgeon: @georgehotz Even if a mask will protect 99% they will write that they DO NOT PROTECT completely from covid cause they will get sue if someone will get infected while wearing one
mongoloid_jones: u look like u love joggers
Chiddy998: Well doing sth is better than doing nothing right?
nrjklk: yest, DATA STRUCTURES GEOHOT
fortuitouslover: @georgehotz listen to @imnotabrainsurgeon
Crime_Stein: I don't think particle dynamics is Georges forte.
DailyDisclosure: LUL
DerivativeIntegral: deboonker
tajpouria: f m1 fan noise!
s00x7: noice
d3adin: What if the manufacturer just put that on the box so people cannot sue them?
mucinoab: DId you hear the NEW TS?
colanzio5: ^
mongoloid_jones: faaaaaaqqqit
panadoma: Do you have a skin care routine?
alex_pt_: But what is the problem of wearing a mask even if it doesn't work?
kokiworse: I'm reading infinite jest and it's great!
zoiecassandra: I would like to do nothing
DailyDisclosure: LOL
Koduck007: hahaha
mongoloid_jones: jogger lover stop supporting janet yellen
xdovahkiinx13: love how people in chat get triggered for just a comment about a box
Draco0x191: lol
elyahood: @georgehotz how you think elon musk felt when he realized the elite control everything?
printhellosailor: LUL
DailyDisclosure: ITS GONNNA HAPPON
afterworktech: inappropriate
Rafabld1996: George PogChamp
Varicode: Coomer
bigfatgoale: how do I not be scared of life and be a daredevil like you?
mongoloid_jones: GEORGE HOTZ IS A QIQE WHO SUPPORTS JANET YELLEN
lordFOE: thtas hilarious
MatheFischer: The mask doesn’t do anything if only one person is wearing it. You have to get everyone near you to wear it to be effective.
Joogurt: 🕷️
afterworktech: are you scared of spiders?
metheword: GlitchNRG BlackLivesMatter BlackLivesMatter FootBall
fortuitouslover: are you scared of alex?
DailyDisclosure: LULW
Koduck007: yea it is
tylovesclaud: @MatheFischer don't explain it to him, he's ignorant
elyahood: @georgehotz how you think elon musk felt when he realized the elite control everything?
imnotabrainsurgeon: @georgehotz REspirators/N95+ : Help from droplets and micro particles. Almost zero chance of getting infected. Surgical masks tho avoid spreading DROPLETS with contain insane amount of virus. You still have chances of getting infected with normal masks, but A LOT lower.
myaocat: @mathefischer exactly.
Varicode: FeelsBadMan
semienterara: Does that M1 throttle from time to time because of no fan?
kumbuZ: I am scared of rational thinking kills my fear
MatheFischer: ¯\_(ツ)_/¯
Varicode: That's why they should drive themselves RarePepe
DailyDisclosure: cars, falling, other accidents
palac105: @georgehotz if CDC is lying about masks, why is it telling the truth about other cause of deaths??
caene: Guess I'll drive and die ¯\_(ツ)_/¯
fortuitouslover: wait he's a boomer?
myaocat: @semienterara yes it's become bad after a year
crusader_simo: GeoHot: dont die
printhellosailor: George is so scared of cars he had to teach them to drive themselves to be safe
correia0xa: hey geohot did you thought about giving some low level language courses ?
slanthedeceivers: lol
Koduck007: liver will kill me
DailyDisclosure: lol
afterworktech: wow
Draco0x191: LUL
K177: welp, not when other drivers hit you LULW
K177: thats something you can't control
zigzati: LuL
K177: 4HEad
correia0xa: be carefull george the ban hammer can come if you talk about suicide and shit
pinkyosh: flying cars
zoiecassandra: just teleport everywhere
Dervolleschlanke: and also avoid self driving uber
sukh_dhaliwal: How do you skim documents so fast?!!!
pakaav: The harpooon statistics
imnotabrainsurgeon: If you dont do this, you have higher chances of cardiovascular risk, LOL
Opasnimiki: Or code
imnotabrainsurgeon: shit*
hrshlife: define d**b
afterworktech: how are we not over 1000 lines with all the pull requests?
scouser__: yea never go out until you are 44 great
K177: LUL
correia0xa: hahahahahah
Joogurt: DDDS
DailyDisclosure: amen
fafuja: LUL
katsugutai: have you tried cyberpunk??
ayli__xd: hahah
parse: parse subscribed at Tier 1. They've subscribed for 9 months, currently on a 9 month streak! 
red_scratcher: cyberpunk self driving car
K177: KKona
Tunelesschan: Kappa
Marin_031: Can somebody whisper me the link? I just came and didn't catch the data
a_money_moose_eu: Bullshit??
DailyDisclosure: lol
myaocat: Kappa
palac105: @georgehotz you're gonna get banned for spreading conspiracies about masks
xrealyy: write some decent AI for cyberpunk MR.HOTZ
Stegosaurian: if you get banned from twitch will you switch to youtube?
K177: alex jones was a great memer :(
fortuitouslover: twitch bans are just stupid. I read today about a guitarist who was banned from Twitch for playing his own music
DailyDisclosure: F Alex
crusader_simo: Dont play music and you will be fine
i_osc: someone have ever told you look like a bilbo
Denis0109: Im in my room since one year and its been great. I talk alot with my TeddyBear
farlopote: true
kumbuZ: Truth who?
colanzio5: When you do things right, people won't be sure you've done anything at all
printhellosailor: spoiler: they started banning honest to god truth years ago already
marcelbischoff: Lex played Cyberpunk haha
F18K_: OOP?
myaocat: would you stream on mixer if you get banned?
a_money_moose_eu: No lib media pushing that
correia0xa: will you hack the ps5?
Koduck007: energey boi
DailyDisclosure: Crisis Actors lol
halowine: f
Varicode: RarePepe
lordFOE: LOL
itsallaboutsuffering: tons of offended zombies are going to stand up from their graves and cancel you /s
climbtofail: let's go PogChamp
Linux_____: facts &gt; feelings
stoompyyy: that look you just gave her for a split second
stoompyyy: loool
mobal: Thanks for the 2020Selfie @parse
palac105: if you doubt they will come for you for telling the truth, then ask yourself where Assange is
Tunelesschan: KappaRoss
palac105: or Snowden
crusader_simo: If you are trans you cant get banned on Twitch. its true
techtim123: opps
shanumbra: @georgehotz do advent of code https://adventofcode.com/
DailyDisclosure: just published
elyahood: @georgehotz how you think elon musk felt when he realized the elite control everything?
crusader_simo: remember how dr disrespect got banned lol
kumbuZ: @crusader_simo proof that first girl
twistedecho21: @georgehotz what about Tom Macdonald?
Linux_____: are you a Edward Snowden fan?
Crime_Stein: teach us about the walrus operator
afterworktech: @shanumbra he is on 20 place https://adventofcode.com/2020/leaderboard
bigfatgoale: by daredevil I mean you do what you want, but I get too anxious just living normally
lordFOE: geo were you friends with jeffrey epsteiny ?
nrjklk: some meditation
red_scratcher: Build an AI on raspberry pi
patrickgekko: free ross ulbricht
Koduck007: eyy smart side talkin
nrjklk: sam harriss &gt; headspace
crusader_simo: omg i wana hear about the walrus operation too
twistedecho21: @georgehotz Tom Macdonald is awesome!!!
notmap: mmmm finally caught ur stream live, my life is complete
xrealyy: pray instead of meditate
halowine: goodbye f
afterworktech: chat be calm
gussyyy_: Pay attention to twtich chat
nrjklk: lolol
s00x7: ...................
YourMomYEP: chat
scouser__: you are already amped up why use this bullshit app lol
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
Crime_Stein: meditation code xD
palac105: walking in the woods in complete silence &gt; sam harris
listentobach: z
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAH
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHA
nrjklk: write quicksort while meditating
afterworktech: NotLikeThis
fortuitouslover: Sam Harris is a really good arguer. he non destroys people on in his graceful nonchalance
myaocat: Smithereens (Black Mirror) someone? or is it just me? PogChamp
panadoma: multitasking god
Varicode: :=
fortuitouslover: writing code = meditation???
Crypex: :=
listentobach: First time I catch a stream! Too bad I have to go. VOD it is I guess
kumbuZ: that meditate !Commander programm to relax
lef_xyz: meditating*
JonTalks: Can some one tell me where the audio is from Cheer1
YourMomYEP: writing Christmas operator
Crypex: i hope you get banned for using walrus
afterworktech: codegod
Varicode: @JonTalks Sam Harris 'Waking Up: Guided Meditation" app
Ziv0: LUL
ayli__xd: hahaha
imnotabrainsurgeon: Everything that you do and involves concetration = meditation
mucinoab: This guy is the most fun
Koduck007: history in the making
playcraft2: lol
gussyyy_: Can you send me that script please?
printhellosailor: 24/7 meditation stream confirmed
nrjklk: LOL tqdm for meditation
swsh: Oh boy, MEDI-TI-ATING is my favourite thing to do!
K177: LULW
s00x7: meditiation Pog
notmap: yo how do i donate a message?
Croww__: wtf we listening to??
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
Ziv0: the episode is 15min
scouser__: Where is your mask dude ? this is shameful
listentobach: lmao
myaocat: TTS Donate when KappaRoss
DailyDisclosure: into the cells
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHA
marcelbischoff: you can just train 1 epoch of that mnist model takes about the same time hahahaha
fortuitouslover: have you tried Smiling Mind? it is an australian non profit similar to headspace but better
bigfatgoale: by daredevil I mean you do what you want, but I get too anxious just living normally
Crime_Stein: Everything makes sense now
Crime_Stein: the singularity is coming
nrjklk: malloc some thoughts!
K177: can you do a tour of the garage you're in?
lef_xyz: should we write a github action for it
twistedecho21: @georgehotz have you heard of Tom Macdonald?
devdual: @K177 :D
playcraft2: @K177 LUL
scouser__: nice factory you got there in the background LUL
lordFOE: where is geohot rn
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH@georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
xrealyy: alex hit this guy hard from behind
r000sh: I see through space now
lordFOE: is he in US?
DirkKueverChristen: Weed makes meditation useless
techtim123: Me when I get to Taco Bell honestly
imnotabrainsurgeon: This guy @georgehotz is pretty good with coding, I think he will crack iPhone in the future
twistedecho21: alex is his sister right?
shanumbra: &lt;3
K177: KKona my man
nrjklk: void free(void *thoughts)
devdual: female detected
playcraft2: No peaking Kappa
FlySociety2o9: KKona
listentobach: chat ssshhhhhhhhh!!
keng1ne: @georgehotz have u tried that vim hof method? its pretty good actually
fortuitouslover: awww i want this &lt;3 :((((
Koduck007: hahahaha
s00x7: 😂
bweston92: LOL
Crime_Stein: life goals boys
gussyyy_: Apple annoys you
FlySociety2o9: KKona KKona
Linux_____: tech was made for you George
gussyyy_: Apple embarreses you
Stegosaurian: the chat annoys him when we ask stupid questions
jantartatar: Hey @georgehotz, does openpilot support Skoda cars? Will it?
Varicode: alkKayo
Triphasic: he's on cloud 9 ladies and gentlemen
bigfatgoale: LOVE FROM INDIA.
scouser__: Blond girl gives massage to hacker in a factory. great
cheetobandeeto: @jantartatar Read the vibe bro not now
nrjklk: stupid quesstions annoy george
r000sh: just feel good
Stegosaurian: he's thinking about Sponge Bob I'm sure
0xnan: hey George you are coughing at every stream...are you ok?
playcraft2: Heart monitor when?
xrealyy: they look similar actually
nrjklk: george has corona?
Varicode: alkFax
techtim123: Be respectful and meditate 🧘♂️
kumbuZ: if sloth aren't in a meditative state, I don't know what they are focused at if not hard work
lordFOE: wake up with sam harris, go to sleep with alex jones
kklisura: Isn't church at sundays?
scouser__: Where is the Social distancing ?
playcraft2: @lordFOE lol
kinslay3r: Has he reached Ultra Instinct yet?
Stegosaurian: @lordfoe lmao
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
halowine: what is the python library he is using for the pourcentage ?
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH.............................
xrealyy: ALEX hit him from behind
DirkKueverChristen: @Stegosaurian i think so too
khaviergarcia: what ishe listening to?
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH..................................................
onemarko: what is this? Sounds like latest Musk interview? LUL
myaocat: i dont understand the deal with wearing big clothes.. someone can explain? since when it became fashion?
r000sh: i feel something
marian6: Jantár tatár ...
rafael_pac: where is this sound coming from
tajpouria: Guys, George just said he will hack ps5 on the next week stream!
Crime_Stein: If she laughs meditation is ruined
Crime_Stein: make her laugh boys
Zepcon7: Completely normal stream
her3hero: @elyahood your IQ is lower than the amount of characters you spam in here
in127pkt: @halowine tqdm
xrealyy: they recording romance quest for cyberpunk i guess
twistedecho21: dude she looked like she was about to laugh a second ago
climbtofail: what it is? A pre coitus training?
Koduck007: hey it's 2019 bro
haking4fun: LUL
halowine: @in127pkt thanks
imnotabrainsurgeon: @climbtofail python coitus
ozzy_1024: she laugh
publishcoffee: she reading chat guys, shutup LUL
bigfatgoale: MOMMY ALEX TAKING GOOD CARE OF OUR BOY
Crime_Stein: I have a 19 incher in cyberpunk.
drivewaycam: ppimCoffee
Linux_____: I need a Alex in my life
mattspring6: Hack ps5
Koduck007: goals
correia0xa: Kappa Kappa Kappa Kappa Kappa Kappa
her3hero: best caretaker
Rafabld1996: massage that 200 iq brain real good Alex
twistedecho21: holy shit i hear a train too
alex_pt_: Im sleeping
keng1ne: LUL
techtim123: I’m so freaking relaxed
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
twistedecho21: thats where my thoughts go is on that train
nrjklk: cotton eye joe r u serious
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH@georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
lordFOE: that white babe is teasing us chat
lordFOE: look at her eye contact
fortuitouslover: ahahahhaa
crusader_simo: @elyahood stop spaming lol
kingvoneduard: George is like a cat now
StoicsPride: ban the spammer?
JumpTwiice: what the hell is going on
DirkKueverChristen: he is king of king julian thou
xrealyy: lip biting, its getting serious
bweston92: what is going on right now
kryptonite882: I thinks he's gonna start purring soon
her3hero: we need mods in here
Croww__: JumpTwiice same
r000sh: thinking about bubble sort is best meditation
mucinoab: This is a recurrent thing in the streams?
Vjasal: now put a wet finger in his ear
twistedecho21: i dont feel it
twistedecho21: i just hear a train
lordFOE: yeah give him a wet willy
ilikerecursion: Kreygasm Kreygasm Kreygasm Kreygasm Kreygasm Kreygasm Kreygasm
nrjklk: @Vjasal LOLOLOOL
publishcoffee: LUL
bigfatgoale: MOMMY ALEX TAKING GOOD CARE OF OUR BOY
Crime_Stein: gently whisper in his ear. This is my garage...
lordFOE: give him a wet willy you wont
imnotabrainsurgeon: Where is the tip goal in the corner?
twistedecho21: ITS THOMAS!!!
her3hero: she is reading :D
kingvoneduard: This is illegal in Saudy country
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
elyahood: @georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH@georgehotz YOU ARE TOO HIGH IQ FOR THIS HAHAHAHAHAHAH
tajpouria: 30 f minute? u kidding me?
publishcoffee: LOL
cheetobandeeto: She got insta?
totial: what are we watching?
xrealyy: wet your finger and go 100% right into the ear
john_kosta01: dont look
printhellosailor: !voteban @elyahood
Koduck007: ...macbook air.... with RTX....
puppy107: What the hell am i watching
Stegosaurian: @elyahood grow up
DiiCE3: is he meditating in python???
bweston92: @cheetobandeeto go to horny jail
publishcoffee: LUL
stale2000: Pog python meditation?
her3hero: somebody ban @elyahood
notmap: george i thought relaxation was a scam?
kingvoneduard: this is porn for geeks
r000sh: what king of meditation speech is he listening?
Ivanlesuisse: cheer1
Hiptin: george is super human
the_gilps: Is this the Sam Harris app?
cheetobandeeto: @r000sh Sam Harris
onemarko: praising the rust gods
Crime_Stein: happy?
scouser__: Think of lockdowns and masks
cheetobandeeto: @the_gilps Tes
xrealyy: meditation is a scam go work
cheetobandeeto: Yes
miloeu: did he take something
r000sh: @cheetobandeeto tnx!
printhellosailor: @stale2000 George has just written the first self driving meditation in python
miloeu: again?
not_into_gaming: baloney
nrjklk: LOLOL
kinslay3r: happy little clouds CoolStoryBob
melahii: hi
lordFOE: hes thinking of elon right now
winningbigforever: @xrealyy twitch is a scam go work
Hiptin: LUL
tajpouria: say that George, say that aloud
Koduck007: i think i got he answer... we must build taylorcoin
fortuitouslover: what's he smiling about???
bweston92: LOL that cough was on point
tajpouria: picture Alex
BrutalCSkAKAN: Elon Musk!
0xnan: hey George you are coughing at every stream...are you ok?
Hiptin: Elon LUL
imnotabrainsurgeon: Imagine geohot and elon musk getting married &lt;3
Hiptin: dont read chat George LUL
the_gilps: We saw you peeking george...
Linux_____: @Alex keep scratching his scalp
reeldill120: u sleepin or wut
ayli__xd: who is he listening to?
winningbigforever: is this sam fucking harris
lordFOE: this is low fuckn energy lets rise up
Hiptin: Hi lol
afterworktech: New pull request George. Check https://github.com/geohot/tinygrad/pulls
tajpouria: elon dont give a f about him
fortuitouslover: yes this is sam fucking harris
MadNelis: If we can't ask about the input device with keys, there should be a command for it
kklisura: Just use Headspace app, George
Croww__: LUL
lordFOE: hes waking up with sam harris
totial: i would like to listen to harry mack improvising on this
lordFOE: its a podcast
lef_xyz: bruh
nrjklk: review a PR while meditating lol
bweston92: @totial Harry Mack FTW
Crime_Stein: came from the code stayed for the meditation sesh.
nrjklk: joy is a good PR on tinygrid
Official_ClawS: Sup george
teckel14: wtf KEKW
tajpouria: focus George
the_gilps: george is PRESENTTTT
totial: @bweston92 totally!!
herrsch_de: he could easily reprogram his brain
sudqi: we meditating lets go
Deni1111: its happening in git
teckel14: hey george
publishcoffee: LUL
MarSe32m: Wtf
publishcoffee: LOL
lef_xyz: pep8 is 4 spaces
kingvoneduard: Git meditation
afterworktech: type with your eyes closed
err_ctx: LUL
yurit04: What are we listening to?
myaocat: @yurit04 Waking Up by Sam Harris
twistedecho21: dude sound slike hes about to try to sell me something
yurit04: Thanks! It sounds awesome 🤩
imnotabrainsurgeon: @twistedecho21 adderal
lordFOE: Waking up with Sam harris is ok i prefer Waking Up with Alex Jones
kingvoneduard: to much relaxation
twistedecho21: and for 6.99 we can play the train noise again
teckel14: asmr Kappa
winningbigforever: jonathan blow talked about meditation once
StoicsPride: How much $$ has Sam Harris raked in over his 'wellness' ventures?
myaocat: @lordfoe Kappa
SexySubmissiveLuka: ah yes. GHotz. the first person to Jailbreak the PS3. 😌
red_scratcher: no spindrift today?
ilikerecursion: build some web with python 💩
Linux_____: Female voices are more relaxing
nrjklk: george you gotta do a 10 day vipasanna course!
0xnan: hey George you are coughing at every stream...are you ok?
MadNelis: What kboard does George use?
kklisura: This isn't anything different than religious rituals. Although with religious rituals you have a chance of going to paradise lol
Stegosaurian: I can't meditate because my mind runs on Windows XP
Vjasal: multitasking meditation FeelsNktSureChamp
teckel14: mm tea
Lefer_: Will George stream Cyberpunk
tsojtsoj: C++ &gt; Python and Dasypeltis &gt; Python
Hiptin: wheres the HHKB? :O
bigfatgoale: you look so serious
afterworktech: @0xnan cough is fake news
MadNelis: Damn I broke the rules and got rewarded
Hiptin: Cyberpunk is great
Eulis01: Can i get the link to that audio of the meditation
techtim123: @geo Link please?
Crime_Stein: PLAY it
BR3AD: mouse?
stuke53: I enjoyed that.
shanumbra: show that time code please
StoicsPride: Does he actually game??
teckel14: Cyberpunk on ps4 WutFace
lefse: monkaS
lordFOE: play cyberpunk george u bast
lordFOE: actually his pc prob cant run it
techtim123: I really enjoyed this!
printhellosailor: Cyberpunk looks great
imnotabrainsurgeon: cyberlag on mac, kappa
publishcoffee: omg I just realized github has dark mode
publishcoffee: wtf?
Eulis01: Yeah
teckel14: monkaS
playboitarty: Is this a mindfulness exercise? i just got here
Eulis01: New features just came out
myaocat: since friday they added dark mode
Lefer_: George character would start the game with hacking skills maxed out
tajpouria: You can change character pipi size, believe or not
PressOK: what is happening here
Shiinha: what are we listening to @georgehotz ?
bigfatgoale: I'm working on my ML skills, hope to work for you someday
isalhi: Who’s talking in the background
zigzati: sam harris
puppy107: i hope twitch DMCAs this meditation music
winningbigforever: what does walrus.py do, is it just a clock or does it actually get the audio
teetc0rn: i'm already feeling pretty relaxed...
BossOrange: isalhi me :)
not_into_gaming: mindlessness
lordFOE: @georgehotz play cyberpunk and be a maxed out hacker man
playboitarty: brain washing
imnotabrainsurgeon: @teetc0rn his gf
shanumbra: @georgehotz show that script
printhellosailor: @winningbigforever the python script does the meditating for you, so you can do other stuff
winningbigforever: lmfao
Linux_____: is that a 30 day program or what
publishcoffee: is this Sam Harris you're listening to?
her3hero: :'=
techtim123: @georgehotz can I have the link to this?
playboitarty: what in god's name was that shit
not_into_gaming: MindHead
printhellosailor: that's why George could accept pull requests while the script was meditating
badcc: strawpoll.me
jmp0ut: @georgehotz ever crush glass bottles and cans to make a CPU/SSD ZIF junction?
winningbigforever: audio is a bit low
jmp0ut: ive seen kids in south africa hack that
0xnan: transformer guys
Hiptin: Add a cyberpunk option ;)
nrjklk: he just meditated so he's not hyped and loud
r000sh: "billion dollar company"
afterworktech: George can you increase the mic sound by 15%?
Linux_____: watching George play cyberpunk would actually be legit
Crime_Stein: cyberpunk
JBNunn: Advent of Code...?
imadon59: poll are avaible on twitch
Hiptin: cyberpunk :)
printhellosailor: ANE reversing is a no brainer
lordFOE: another option: cyberpunk playthrough
Shiinha: @nrjklk care to elaborate?
Vjasal: @georgehotz cyberpunk?
nrjklk: advent of code
kyleskom: jailbreak sony rofl
panadoma: skin care routine
puppy107: cyberpunk!
lukattolo: quantum computing stuff
georgehotz: https://www.poll-maker.com/poll3287114x9A80403C-101
stale2000: D:
bigie: paper reviews of something that recently impressed you ?
KagedKhaos: Tinygrad refactoring (less lines)
Shiinha: @nrjklk Do you know what he was listening to just now?
kklisura: Definitely not this anymore...
lordFOE: cyberpunk playthrough GEOHOT EDITION
lefse: Morning routine
funkacrylic: Makes tutorial
techtim123: Yeah!
teckel14: calculus monkaS
lordFOE: who wants my vote tell me what to vote
afterworktech: ANE wins
Linux_____: I dont vote
lordFOE: someone buy my vote
bigfatgoale: I'm working on my ML skills, hope to work for you someday
printhellosailor: ANE was always gonna win
stale2000: stop the count!
Denis0109: I see that chrome uses more ram then firefox. how?
0xnan: guys transformer is a great opportunity to learn new things
kokiworse: can you explain the intuition behind transformers if it wins?
Linux_____: Stop the count
lordFOE: someone buy my vote like those sketchy dems
Hiptin: we love it too
lordFOE: $2
JBNunn: bc of keystone @Denis0109
lefse: RIGGED votes
jmp0ut: design new SISD :}
kingvoneduard: Peeeeeeeeeeeeeeeeeeeeeeeeee
afterworktech: vote vote https://www.poll-maker.com/results3287114x9A80403C-101#tab-2
puppy107: But transformers are all you need... :(
draas: Not sure what I voted for
zigzati: tinygrad OMEGALUL
winningbigforever: ymca
winningbigforever: vote! vote! vote!
imnotabrainsurgeon: Is that a body on the bed?
kinslay3r: Stop the vote!
draas: OH NO! the mail in ballots are coming in
printhellosailor: ANE needs more votes
Hiptin: @imnotabrainsurgeon LUL
krnflake1: Alex, now's your chance, RUN!
afterworktech: @imnotabrainsurgeon it's a lady
lordFOE: i just loaded up 30 sessions of tor and voted for ANE reversing, this is a skewed and unreliable poll.
Zepcon7: Stop the counts!
puppy107: why no cyberpunk option?
Linux_____: this poll site is what the presidential election should of used
Vjasal: m'lady
bigie: @imnotabrainsurgeon lol
playboitarty: I think she got a face mask or something
0xnan: guys transformer is something that can be done in this stream
imnotabrainsurgeon: *FBI, open up*
kokiworse: attention is all you need :(
babaquon: I want a recount
Hiptin: 3
UserNameThe3rd: stop the count
ScrubLifeChoseMe: -11
JBNunn: i'd revote for that
WhhiteWolff: @imnotabrainsurgeon a mummy
kingvoneduard: This a fraud
stuke53: 3
afterworktech: too much votes
soapyyyyyyyy: not much ^^
nrjklk: i want to investigate masks
lef_xyz: RECOUNT!
Crime_Stein: ye
kklisura: How about ethics in AI? :D
red_scratcher: I would have voted for that
mrpentakills: Are there any similarities in video game auto driving code and actual self driving code?
smurfd0: 0 like the ethics
lef_xyz: I DEMAND A RECOUNT!
node_storm: transformer
tajpouria: Lex fridman playing cyberpunk &gt;(
0xnan: i hate democracy @georgehotz
Hiptin: @georgehotz are you a gamer?
playboitarty: mukbang lul
JBNunn: will you give the results from Four Seasons?
tomcroose: check geographical breakdown
printhellosailor: I would have voted for "reverse engineer the election results"
FightingDragonHS: STOP THE COUNT!
thecoder15: FAKE NEWS
JIMMY906: stop the count KKona
Linux_____: nope..im suing you
afterworktech: ANE is great
playboitarty: ANN
kingvoneduard: Destroy Apple
fortuitouslover: check for voter fruad please
JBNunn: Four Seasons
ScrubLifeChoseMe: haha
her3hero: fake votes
Hiptin: LUL
funkacrylic: Rigged
Hiptin: memer
techtim123: Yay 😁
thecoder15: they were fake votes, bots I saw them
BananaAssasine: wait is it rigged?
puppy107: lol
KagedKhaos: Check geographical breakdown
Crime_Stein: my vote was flipped!
kinslay3r: Taking this to the Supreme Court! SwiftRage
her3hero: I lost, must be rigged
helmutschneider: george is a fraud!!!
kingvoneduard: Supreme Court must look at that
Hiptin: this guy memes haha
kokiworse: thats a fruid
red_scratcher: recount
node_storm: i couldn't vote smh
afterworktech: who stole my vote?
trajenx: i'm taking this all the way to the supreme court
UserNameThe3rd: i want SCOTUS
smurfd0: russian haxxors
lef_xyz: KKona
lordFOE: twitch polling systems are flipping votes
bigie: it was russians but this time on their side LUL
realepicxd: LULW
fortuitouslover: it was these freaking russian fort
33seth33: i am going to have my lawyers intervene
climbtofail: George works for left media...FAKE
Hiptin: ls -l
fortuitouslover: it was these freaking russian bots
itsworkingiguess: always playing science and technology when will you play smthg different?
MountainGray: a van brought in the votes, instead of food
Stegosaurian: we demand a recount
K177: they rigged the voting systems firmware KKona
printhellosailor: Alex was counting mail in ballots while George was peeing
puppy107: god the autism
Stegosaurian: the link you shared was biased
kingvoneduard: Dominion software
node_storm: George banned from twitch and youtube same day omegalul
playboitarty: вас обманули товарищ
korova_milkman: election was rigged - Kanye was robbed...!!!
climbtofail: hey GEdorge stop the steal!
Hiptin: george do you listen to Tory Lanez?
nrjklk: cotton eye joe is where its at
Vjasal: DMCA monkaGiga
kingvoneduard: He used Dominion
afterworktech: Still no blue check mark. Follow on https://www.instagram.com/georgehotz/ !!!
techtim123: You showed us you creating it it ain’t rigged
Shiinha: @georgehotz what do u meditate to?
Denis0109: sing something from taylor songs pls
playcraft2: 10/10 content today LUL
lordFOE: YOUTUBES NEW POLICY SAYS AFTER THE SAFE HARBOR DEADLINE YOU CANNOT PUBLISH VIDEOS QUESTIONING THE ELECTION AT ALL
ilikerecursion: @puppy107 ikr LUL
Stegosaurian: they used boys to vote for ANE reverse engineering
publishcoffee: LUL
Stegosaurian: bots*
Linux_____: you need some yachak yerba mate
Shiinha: @georgehotz its fine if you delete vods :)
JalapenoSD: Hello @georgehotz
playboitarty: do you listen to any rappers that are relevant
publishcoffee: nah we lost wayne
afterworktech: @Shiinha not cool
kokiworse: freedom
trajenx: you can hack voting machines at defcon
playboitarty: prolly listens to Ytcracker lmao
GerbilJay: @georgehotz LIES! Da Drought 3 was Lil Wayne's best mixtape!
printhellosailor: censoring anyone who questions the election is totally what people who didn't steal the election would do Kappa
lordFOE: Feds hatin on trump and lilwayne
playcraft2: Stress eating Kappa
Hiptin: TRUE
0xnan: you have a strange cough george :)
lordFOE: jayz works with the feds hes a rat
afterworktech: getting distracted
Hiptin: any truers?
playboitarty: lil wayne a bum
nrjklk: after meditating lol
Linux_____: Vinnie Paz &gt;
king_kanak: its cause lil wayne supports uncle bob
Hiptin: OMEGALUL
bigfatgoale: How high is your opinion of twitchies as human beings?
Varicode: Literal opps
kokiworse: jailed for carrying hip hop
guest1GRjBAYo: what's george's rap name?
imnotabrainsurgeon: @georgehotz do you think new M1 macbooks worth it?
techtim123: Jay-Z is a business man
playboitarty: george when we getting a new mixtape
Hiptin: LUL WORLDSTAR
devdual: george using the macbook pro 13 M1?
Hiptin: @devdual air m1
nrjklk: damn
itsworkingiguess: whats the plan for this stream?
xrealyy: its air
devdual: @Hiptin thanks
bigie: Mr Hotz please don't rap
bigfatgoale: how to git gud
lordFOE: this is so poetic
playboitarty: FUCKIN HEAT
Hiptin: LUL
nrjklk: can you do some noob skills please?
publishcoffee: what kind of site doesn't use HTTPS in 2020?
publishcoffee: wth
lef_xyz: listen pusha T's drake diss
lordFOE: we used to have Shakespeare now we have this so good
puppy107: i cant understand anything lol
nrjklk: what happend to simple skills?
r000sh: MC Hotz
Hiptin: i wanna see a george hotz and elon musk rap battle
kklisura: You're doing cultural appropriation, stop it.
bigie: Kappa yes
Hiptin: jealous kappa
obesusporcus: @kklisura how much of a downer are you LMAO
kokiworse: pushing the boundaries of art
Varicode: 'haute couture'
playcraft2: Yo, we're over here @georgehotz Kappa
lef_xyz: no she is not
xrealyy: i heard you make simple skills sunday tommorow
Linux_____: zion i silly puddy &gt;
dil31: your girl is right
bigfatgoale: How high is your opinion of twitchies as human beings?
kokiworse: we care
playboitarty: new mixtaoe when
bigie: LUL george's a tay tay fan
JalapenoSD: george is simp for taylor
kklisura: @obesusporcus relax, just kidding around
Hiptin: @georgehotz what about katy perry
kokiworse: tailor swift stream only
fortuitouslover: do noob lessons please
JIMMY906: LUL
kokiworse: "dont be a noob"
masters8: gatekeeper Kappa
0xC3301: SwiftOnSecurity does music?
imnotabrainsurgeon: @georgehotz have you tried new M1 macbook?
nrjklk: noob lessons plspls
playboitarty: george how can i hack the 0days when ghidra metasploit mainframe
lef_xyz: drake has 0 failed projects
lordFOE: also katy perry is a noob
bigfatgoale: How high is your opinion of twitchies as human beings?
bigie: @imnotabrainsurgeon he's streaming from one
afterworktech: there is no end
brinkokevin: brinkokevin subscribed with Prime. 
playboitarty: george what's a for loop
martinfischer07: whats up!
not_into_gaming: What he trying to do with ANE?
tinyany29: can u make a poll to see how many people here understand the code u writing ? I bet its less than 5%
puppy107: anyone know if lex will keep streaming cyber 2077?
bigie: there were a lot LUTs last time for different layers. does that mean ANE won't support "novel" stuff?
afterworktech: only 3300 stars? go star https://github.com/geohot/tinygrad
imnotabrainsurgeon: I don't understand why he uses Mac for python? Are there any advantages over Windows?
JalapenoSD: should I use pytorch or tensorflow?
her3hero: @playboitarty a goto statement with a condition and some other stuff
winningbigforever: pytorch according to george
covidneunzehn: lol @imnotabrainsurgeon
marcelbischoff: @puppy107 didn't he say an hour per month?
techtim123: Noob alert 🚨
puppy107: ah damn lol
JalapenoSD: @winningbigforever ok thanks you
playboitarty: @her3hero twas bait
covidneunzehn: he is utilizing / reversing the mac neuronal engine @imnotabrainsurgeon
covidneunzehn: try this on your windows box
red_scratcher: Is he using iterm?
rosagriculture: whats the best use for tinygrad?
imnotabrainsurgeon: @covidneunzehn he always reverse engineers apple? All his streams were on mac
teayoflow: this man has no drywall
Vjasal: he's McReversing the McEngine
covidneunzehn: nope that is his (smallest air) m1 project @imnotabrainsurgeon but he was on mac before correct
puppy107: my macbook pros' keyboards always degrade after usage (double keys) :(
krnflake1: is the M1 your only rig or do you also have a desktop?
bouddhass: supp george
Hiptin: do you use brew?
not_into_gaming: ANE is probably play only
quickcheck: big brain time
nrjklk: what is the build.sh script doing?
nrjklk: is it just calling gcc?
vollous: Hey. what is the best, screen or tmux?
Hiptin: @georgehotz im drinking la croix
guest1GRjBAYo: topo chico &gt; la croix
bigie: i think he's using clang not gcc. he was using lldb before
nawi_swift: Is that the standard console for MacOs?
gaillour: tf is he doing im a noob
marcelbischoff: PR
New_Wizards: alright its george with his excellent posture :)
imnotabrainsurgeon: @georgehotz regarding masks. condoms also write on the BOX that they do not offer 100% protection. Why use them ?
guest1GRjBAYo: he slamming the shit out of that enter key
New_Wizards: @georgehotz I heard the chair is the most important piece of furniture
nrjklk: bruh im so confused. we need more noob lessons
hey_its_lgg: can someone give me a brief introduction what he is currently working on?
New_Wizards: uptime?
bweston92: @nrjklk +1
quickcheck: he’s hacking into the white house
0xHSN: sup?
joehartshorn: hes working on updog
rephlexsion: does he use an external monitor
nrjklk: whats updog?
bweston92: something about Apple Neural Engine? lol
New_Wizards: was working on hacking apple neural net, amphi* and using tinygrad
bweston92: No
bweston92: LOL
nrjklk: NO
newspapertears: nope
hey_its_lgg: what is the Apple Neural Engine?
0xHSN: it's amazing to have a stream every weekend #SubscribeToGeorgeHotz
desiero: who made the tinygrad logo -- sell tees bro
puppy107: new to stream but looks like some kind of IR
puppy107: similar to ptx?
iSatisfied: What terminal is he using?
0xHSN: !uptime
marcelbischoff: MacOS Terminal, not?
bigie: the stride is 192? for a CNN?!
rosagriculture: @georgehotz is the piller and foundation of truth.
Smyile: @iSatisfied the default one
nrjklk: how are you handling the boundaries on the CNN though?
newspapertears: I just learned how to use linux basics Im really enjoying it
gaillour: @georgehotz noob ai lessons pls
gagehelton: Greetings
JalapenoSD: please help me train my ai :(((
bigie: I still don't get the multiheaded attention LUL please switch
nrjklk: damn so much for noob lessons
hey_its_lgg: anti democrat-icy propaganda confirmed.
Pixel_Community_Project: @JalapenoSD what lib are you using?
medianhuman: medianhuman subscribed at Tier 1. They've subscribed for 4 months, currently on a 4 month streak! George -- can i invest $100k in your company?
eta002: or bitcoin!!
crashnk: Merci pour 2020Selfie @medianhuman
JalapenoSD: @Pixel_Community_Project I'm trying to use keras_ocr
0xHSN: we are talking politics today
JalapenoSD: Maybe it's bad I don't know
nrjklk: @medianhuman lol i hope he sees this
newspapertears: So whats it like coding in python compared to java
drwrapper: how does twitch know i just joined chess.com?
techiedheeraj: Who is george hotz
puppy107: @JalapenoSD nice why are you using keras_ocr?
eta002: stopp coding and read our comments! :D
medianhuman: i'm thinking maybe he'll only take 1M or more .. perhaps a bunch of us can get together and invest a larger amount?
0xHSN: @medianhuman is the new CEO
0xHSN: lol
bweston92: Lol
eta002: Who is george hotz.. your daddy...
bweston92: !age
nrjklk: bruh remember sam harris
medianhuman: &gt; George -- can i invest $100k in your company?
JalapenoSD: @puppy107 I'm just trynig to detect numbers, but it doesn't have a good accuracy with the number 7 and some others
eta002: hehheh mission accomplished :)
medianhuman: i knew it!
medianhuman: what about 10 of us together doing 100k each
eta002: bitcoin???
nrjklk: @medianhuman lol u called it
eta002: :)
newspapertears: lmfao LUL LUL
bweston92: wait what does his company sell?
hey_its_lgg: i have a spare 100k next to me
Yemtex: !github
nrjklk: he sells freedom
Yemtex: !git
medianhuman: are there 9 other folks in here who want to do 100k each?
puppy107: ah @JalapenoSD is it through local tf lite mobile or cloud
medianhuman: the guy has only raised 8m so far
scouser__: @bweston92 diapers and toilet papers, also eggrolls occasionally
bigie: there aren't even 10 :)
her3hero: sure 100k gang in here
JalapenoSD: @bweston92 A gadget that's attachable to a car
0xHSN: oops... millionaires only!
marcelbischoff: you can invest 100k in roborace. will last one crash
BrutalCSkAKAN: Silicon Valley Season 7 confirmed
gaillour: noob ai lessons pls
teerv: vr office
sunlight_dev: @georgehotz nude yoga for u
kronnnylul: how tall are you?
her3hero: if u have 100k, you can take a loan for 1 mill
MatheFischer: You guys rock! That’s for sure haha
BrutalCSkAKAN: Geohot main character
newspapertears: good time to invest in quiznos
afterworktech: just buy https://en.wikipedia.org/wiki/7_World_Trade_Center it's cheap
Pixel_Community_Project: @JalapenoSD dont know much about keras, i made good experience with pytorch.
JalapenoSD: @puppy107 i'm on windows
Xpreeks_: Xpreeks_ subscribed with Prime. 
scouser__: just go public and let me invest my $50
puppy107: @JalapenoSD that's a problem
drwrapper: I'll buy you all out with my bitcoin
Jengis__: LMAO
the_gilps: Whatcha drinking?
nrjklk: yeash just have an IPO pls
her3hero: comma-coin
0xHSN: a new office needs a $1M?
JalapenoSD: @Pixel_Community_Project ok it seems like keras and pytorch are bothj good options
her3hero: will moon
JalapenoSD: @puppy107 why?
eta002: no it was "pulled"...
ontologicaltofu: @georgehotz What's your opinion on hydrogen fuel cells?
korova_milkman: George prefers ETH
drwrapper: if i knew what a spat scammer is
t0mmv: hi george!
guest1GRjBAYo: just go on shark tank. ez money
techtim123: I’ll design the new office! I can
hey_its_lgg: not that kind of scammer
nomorequity: Tehter print goes brrr
Jengis__: Did you see how Saurik started a lawsuit against Apple?
joehartshorn: u reckon pmarca has watched any of these streams?
nrjklk: i would love to see george n sharktank lolol
datshadyboi: vim or emacs or most chad?
puppy107: @JalapenoSD jk im sure it's ok - i have never done anything in windows
JalapenoSD: @puppy107 ahh haha :D
AzeonRs: how many progam languews do u understand?
hey_its_lgg: easier to ask how many he doesn't
dannnyyy: Guys, how long does it take to get this goos at vim? Asking for a friend :)
dannnyyy: good*
AzeonRs: do you speak with chat much?
hey_its_lgg: start with vimtutor
bloodyuki: why is the screen flashing?
0xHSN: 10 years
hey_its_lgg: then maybe 1 year
patrickgekko: vim visual bell @bloodyuki
medianhuman: @geohotz -- ill get you $2m from a syndicate. just need a user growth chrat
bloodyuki: ah, right
Crime_Stein: coronacough
BrutalCSkAKAN: Are we confirmed rona or just couch?
nrjklk: @medianhuman making some plays here !
0xHSN: @bloodyuki screenshots LUL
AzeonRs: copypasting code?
FDd2bfjN3mCYtkyNq8UVtyN6r: i have like $2k can i join
nrjklk: I could invest 2K
newspapertears: @AzeonRs Yea thats me
salvdelg: waiting for adventofcode winner dissing on soundcloud
medianhuman: you can join if you're an accredited investor
fieldmarshalldonut: If you had to choose, would you say C is C++ with handicaps or C++ is C with more features? LUL @georgehotz
guest1GRjBAYo: why does he stream?
Pixel_Community_Project: can he run models on ANE?
techtim123: A casual 2.5 million just chilling in the chat!
0xHSN: @guest1GRjBAYo why do you watch?
ahahaitslit: why do we do anything at all?
nrjklk: how does ANE compare to nvidia gpu's @georgehotz ?
JalapenoSD: @georgehotz Why do you hate Tensorflow?
MatheFischer: C &gt; C++
puppy107: that's like comparing a laptop to a supercomputer
csandreas1: do you believe there are better developers than you att your company?
joehartshorn: its probably a pain to check without writing a script to check viewers against linkedin, but do u reckon the oems watch these streams?
bigie: is #import an apple thing? it's not standard c++
McBainTS: @mathefischer C++ is one larger than C
not_into_gaming: @nrjklk I think ANE is low power ASIC
not_into_gaming: for running models only
MatheFischer: @mcbaints you got me hahaha
medianhuman: should geo propose to alex on NYE
fdfdfdfdfdfdff: @georgehotz how did you find last nights advent of code? saw you on the leaderboard
puppy107: ANE is mainly used for inference no?
nrjklk: 420 funding scured
medianhuman: @georgehotz &gt; ill get you $2m from a syndicate. just need a user growth chart!!
Bacon4Life_: PogChamp
not_into_gaming: yea
eta002: where is the anu key... hohoho
bigie: nevermind it's objective C not C++
McBainTS: Now you just need to figure out what to call Python from Kappa
eta002: any....
0xHSN: what happened to hammer?
newspapertears: @medianhuman Send it my way
joehartshorn: i do not believe the median human could acquire 2 million, sorry
nrjklk: george can just get a casual 2M just by looking at chat @medianhuman
0xHSN: @medianhuman i'll be the middleman bro
nrjklk: i'll be the middleman to the middleman pls
BRAINSPELL: i need $2m
newspapertears: What are you working on, sex robots?
puppy107: does he take stocks instead of cash as investment capital
puppy107: transfer ownershiphehe
medianhuman: gotta catch geo when he's looking at the chat window
0xHSN: @puppy107 he accepts eggs
puppy107: damn
bigie: not a lot of people have an M1 apple right now
nikolasantesla: hey George
medianhuman: Type "&lt;3&lt;3&lt;3&lt;3" if you think Geo should propose to Alex on NYE. this SD studio romance has gone on long enough
smurfd0: was it not that number 5 or something
0xHSN: &lt;3&lt;3&lt;3&lt;3
JalapenoSD: @medianhuman you mean amazon alaxa?
kklisura: Anyone here watched Martin Shkreli's finance lessons, how good are they?
medianhuman: &lt;3&lt;3&lt;3&lt;3
Pixel_Community_Project: @georgehotz how did you train openpilot earlie on? Was it just watching ppl drive?
patrickgekko: @kklisura can't speak for the whole series but the first few were very good.. might have to return to them myself actually
0xHSN: @kklisura i'll start watching them tonight
patrickgekko: worth giving it a go
puppy107: shkreli had some interesting DD on pharma companies
ahahaitslit: when is shkreli getting released?
patrickgekko: obligatory #freeshkreli
bigie: just git checkout
kklisura: Will check it out then. Thanks
rubbertoe_98: hi
medianhuman: @georgehotz &gt; ill get you $2m from a syndicate. just need a user growth chart!!
puppy107: ooh is that blue bottle coffee?
medianhuman: thought he checked out the chat window
medianhuman: missed him
puppy107: that stuff is te shi
nrjklk: where is the music comin from?
medianhuman: that's a train bro
gagehelton: gagehelton is gifting 1 Tier 1 Subs to georgehotz's community! They've gifted a total of 1 in the channel! 
gagehelton: gagehelton gifted a Tier 1 sub to maxvelua! 
gagehelton: gagehelton's Gift shared rewards to 5 others in Chat! 
medianhuman: you can triangulate his location from it
nrjklk: LOL
medianhuman: SD loft near train track passing 1:30pm pacific
covidneunzehn: leaked
nrjklk: lets' solve this bois
smurfd0: when you changed from 192 to 256?
medianhuman: infinity?
bigie: jsut add a bias of 1
McBainTS: 0
newspapertears: -0
AndyMDE: 2?
matthewmatthica: omg george hotz is streaming finally omg
gamepressnews: 69
her3hero: depends if it's infinity
Bacon4Life_: its 0 usually
ProvenWin: infinity
puppy107: 0 * 1/0 = ?
Varicode: und.
techtim123: 0
lilmarsh17: 1 Kappa
matthewmatthica: Riemannian geometry have 1/0 as valid expression
Impr0x: i've noticed that you never listen to music while working, wondering why
Nopy1: imaginary 0 works almost as well
not_into_gaming: z-ro?
maxvelua: @gagehelton Thanks for the gift sub!
medianhuman: LIB pronounced as "libe" mindfuck
bigie: Leib sounds sexual for some reason
newspapertears: wow can I borrow a book?
el_yapoo: what language is this
bigie: german
joehartshorn: i read that as LilB at first ha
medianhuman: @georgehotz &gt; ill get you $2m from a syndicate. just need a user growth chart!!
bweston92: what blog?
bweston92: what company?
UMPS: have you expanded your theory on that we are in a simulation?
medianhuman: hello
not_into_gaming: 2 million from the cartel
medianhuman: Alex festive AF
medianhuman: 1:30 then 134 SD trains
matthewmatthica: Crypto cartel
puppy107: can we start a drug shipping company guys
puppy107: jk
Impr0x: i've noticed that you never listen to music while working, wondering why
bweston92: I'm just here from YouTube I don't know what company we talking about aha
matthewmatthica: Modafinil already sells online
Shiinha: 2
hardtarget4: Modafinil is the future
afterworktech: just sing :D
0xHSN: another kiss on the stream
bigie: i think some streamers still use copyrighted music then remove the VOD
Shiinha: @georgehotz if u delete vod after stream u can skip dmca )
not_into_gaming: george looks like he working for cartel
puppy107: modafinil doesnt work - coffee is the best
not_into_gaming: locked up in bunker
Impr0x: gg, u got copyrighted
afterworktech: removing vod is not nice. we can't watch it later
csandreas1: do you think you know how to program ?
fortuitouslover: @georgehotz is that video which says "george hotz singing Something - Constantine" really a video of you singing?
J_O_N_N_Y_679: what is going on to day
medianhuman: @georgehotz -- by "last november" do you mean november 2020 or 2019? i guess 2019?
fdfdfdfdfdfdff: i fucked up last nights AOC, i got into 2D rotation matrices instead of using complex numbers like a smart person
matthewmatthica: U mean void in my soul?
nu118y73: void pointer &lt;3
puppy107: LOL
fortuitouslover: @fdfdfdfdfdfdff i did the same
dyjabeu: savage
newspapertears: hahaha
puppy107: void pointer is a placeholder for nothing really
matthewmatthica: it's just 4 bytes of void
hiphopsucks: @fdfdfdfdfdfdff just use polar coordinates dummy
hardtarget4: nullptr bro
medianhuman: found the chart bois
medianhuman: https://medium.com/@comma_ai/a-100x-investment-part-2-569b7141dc82
bigie: the c++ core guidelines discourages fast c++ Kappa
JalapenoSD: i love void pointer do i alway code them for breakfast
joehartshorn: void pointers are like a lucky dip
fdfdfdfdfdfdff: lmaooo
TheDrsh: ((void (*)(void))pAppEntry)();
datshadyboi: Are you refactoring the left pane?
TheDrsh: some ugly void* code I was dealing with yesterday
fdfdfdfdfdfdff: i ended up switching to complex by the end
fdfdfdfdfdfdff: got rank 2000 or something trash
puppy107: ha ptr of a ptr
Nopy1: no likey no usey
Nopy1: remove it and ppl will use size_t* pointers instead
MyLoveSachan: what is he writing?
CaptainSporkey: How is @georgehotz doing today?
New_Wizards: so what is an "ioSurface"?
bigie: @TheDrsh wtf does that do? is it a function ptr?
0x81d: hello giorgio how u doin
joehartshorn: did anyone see that thing on hacker news where that guy guessed the hash on the tweet, so the tweet linked to itself?
TheDrsh: @bigie it takes the address stored in pAppEntry, and runs it as if it were a function. Its for reentering code after bootloading it
CaptainSporkey: Next amazon prime sub might be yours. Current sub expires 20201228
New_Wizards: aaaaooooouuummmmmmhhhhh meditateeeeeee
matthewmatthica: His house looks like military base
Bacon4Life_: joehartshorn i have a tab open with his text rn
joehartshorn: hahaha nice
blurjoe: ヽ༼ ͠° ͟ل͜ ͠° ༽ﾉ Raise your void *s ヽ༼ ͠° ͟ل͜ ͠° ༽ﾉ
Nopy1: "Honey, how was work?" I de-referenced a null pointer ;-;
kamijahamra: @georgehotz thank you for recommending the metamorphosis of prime intellect, i enjoyed it. much love from morocco
WarSwick: 2020HomeWork Hello Mr. Hotz.2020HomeWork
WarSwick: 2020HomeWork
bigie: @TheDrsh sounds like a brainfuck
0x81d: ewww
JalapenoSD: oh my god not in front of the camera :00
0x81d: no kisses
gonzalopereyra24: :v
afterworktech: lovebirds
butyesss: cringe
lrnq: Is Viviane
joehartshorn: i read that, was nuts
matthewmatthica: cringe
Nvskx: is that a bonus for the stream though :D
brotas_: simp
georgecoldz: cute
matthewmatthica: simp-sons
afterworktech: @lrnq no
lrnq: @afterworktech damn
CaptainSporkey: Just bought the M1 MacBook Air with 8 core gpu and 16GB RAM, what do you think about it atm @georgehotz
lrnq: been a while
danielb123: so when does the private show start
TheDrsh: @bigie just another day in embedded systems land, where you do a bunch of sketchy shit with pointers
hiphopsucks: Write something special below and give it some glitz in chat!
fortuitouslover: special
JalapenoSD: no
remegy: @georgehotz you should read some stuff by Joscha Bach pretty cool
Chillinoverhere: Have you ever talked about what you think of luminaire on stream?
WarSwick: 10% bored 20% alone 15% "let me just check this one thing on my phone" 5% "after this" 50% fun 100% reason why my homework isn't really done. 2020HomeWork
remegy: @warswick pog
hardtarget4: ANE is so entitled
smurfd0: sudo ./test.py ?
bigie: @TheDrsh sounds great. I actually love embedded stuff
nu118y73: siiick
hey_its_lgg: ragequit
puppy107: LOL
joehartshorn: HAHA
CaptainSporkey: Taylor@smol does need rights
danielb123: LUL
mucinoab: Lol
WarSwick: lol Mail in voting again
puppy107: why isnt ANE open source?
Chillinoverhere: lol that would be a funny thing to read tho
puppy107: lol
hardtarget4: nate robinson became a meme smh
bigie: when has anything from apple been open source
fillmyvoid: isn't mail in the reason trump lost essentially
joehartshorn: HA
danielb123: will pytorch or tensorflow ever have ANE acceleration?
shanumbra: hahaha
Zepcon7: FACTS
puppy107: LOL
joehartshorn: i love u george
masters8: samsies
smurfd0: &lt;3 baseball
bigie: so republican Kappa ?
fortuitouslover: which sport do you like then?
JacobSolo: George for PRES
l1gh75p33d: if u dont like baseball, you dont like america though. thats a thing
CaptainSporkey: Western politics is just about money
remegy: bunch of people throwing some pig skin across 2 poles
CaptainSporkey: And btw both are shitty criminals
hiphopsucks: momentum
kklisura: Soccer ftw
smurfd0: https://apple.stackexchange.com/questions/52675/how-do-i-find-out-what-entitlements-an-app-has
lukattolo: ufc?
fdfdfdfdfdfdff: Basketball?
fdfdfdfdfdfdff: tennis?
kklisura: lol
Bacon4Life_: hot dudes running PogChamp
MatheFischer: True LUL
remegy: ufc is awesome
carefulwombat: what kind of tea are you drinking?
mannekchin: its football EleGiggle
NxT1me: i learned to program on javascript, should i learn assembly?
0x81d: hating baseball is pretty political though...
Realblue1: D:
lasercatboss: soccer would be great with 2 balls
ontologicaltofu: xqc predictions as a sport?
mannekchin: not soccer Jebaited
P3droPL: @georgehotz did you fully move to M1? Is everything you need already supported on new Mac?
Bacon4Life_: NA football LUL
adiqusi: offside
cswelin: offside
mannekchin: rugby is the real MaN sport
JalapenoSD: esports is much more interesting to watch lol
alexlucas__: rugby?
joehartshorn: red card
bweston92: red card
CEOChillton: sports are different, very deep lol
cswelin: bicycle kick
Chillinoverhere: corner kick
zachnussy: watch the zidane video
UserNameThe3rd: hat trick
mannekchin: murican sports EleGiggle
bweston92: football has mid field, center back, defense, goalie, striker
Korleone55: Finally got to catch this beutiful man live
smurfd0: blurnsball? from futurama
bweston92: corner kick
Stegosaurian: baseball was written in C#
Chillinoverhere: Soccer super kick
puppy107: poptart kick ahah
fafuja: asskick
sabisigma: mayonnaise kick
newspapertears: Football has 1 massive whistle
joehartshorn: hahaha
sircrocodile164: George 'fence sitter' Hotz LUL
carefulwombat: lmfao
suguus: are you still into hacking and shit ?
NxT1me: i learned to program on javascript, should i learn assembly?
masters8: chess has few elements too. Both games are complex
KagedKhaos: rugby?
CaptainSporkey: That’s racism why isnt there black and white cards
kklisura: Any sport that has a ball that's not round is not a real sport.
ESUEisa: @georgehotz Did you ever watch handball? :)
MyLoveSachan: americans don't know about politics as much as they know about sports LUL
agnikaibeats: !project
KagedKhaos: Rugby?
puppy107: @ESUEisa is that football
Bacon4Life_: NA football on tv is 60% ads
adiqusi: what about esports guys
fortuitouslover: thoughts on basketball?
newspapertears: rocket league &gt; football LUL honestly
bigie: soccer is more american than football. there's more flag waving
lasercatboss: what we doing? and whatever it is can we get back to it?
joehartshorn: i recently got into ufc, its great!
Stegosaurian: do a golf stream
MatheFischer: Why watch sports when you can listen to Drake - Forever LUL
ESUEisa: @puppy107 no, google best action in handball on youtube :)
smurfd0: lol fun how you know all the terms :)
TheNumbersGuy: NA football = 90% downtime, just waiting
nero_kaiju: yeeeet
her3hero: golf stream yes
cswelin: hockey?
mannekchin: na football is so boring
hiphopsucks: minigolf &gt; golf
devdual: ur thoughts on vw evs?
joehartshorn: i have a golf handicap of 50
joehartshorn: hahaha
newspapertears: hockey fights &gt;
johnnycodemesomething: Dude could you hack a dominion voting machine?
sanic_the_hedgefond: golf is only fun as computer game
puppy107: football has a lot of action packed into a short amount of time lol
CaptainSporkey: Ever tried writing „Hey Siri“ in the Terminal?
MyLoveSachan: does your chair itch?
benzojamal: LUL
afterworktech: thoughts about Cicada 3301: An Internet Mystery?
devdual: im starting at vw next year
devdual: vw os
WarSwick: What will you do after you hack the A1? mrmeme2LURK mrmeme2LURK mrmeme2LURK
Bacon4Life_: siri's trash
fdfdfdfdfdfdff: american football or modern baseball @georgehotz
sinisa_koscec: Chads play football
adiqusi: vw cheat os
puppy107: @danielb123 most likely -
Bacon4Life_: oh, this is a good one
her3hero: D:
0x81d: oh no....
CaptainSporkey: Garb Apple devs
rudolphdoesgames: still going on
joehartshorn: lol cicaida is cool
enlightenedwaterfowl: Cicada was very interesting
thecoder15: How does he not know about this?
mdmittriy: you never heard? lol
fortuitouslover: wait you don't know about Cicada 3301?
bigie: oh i went down that rabbit hole a while ago. it's really interesting. or was at the time
benzojamal: he doesn't know LUL
tesleax: what do you think about kotlin and its coroutinss? Is this the future?
fortuitouslover: what i can't believe you don't know about htis
gorodinskiy: I think that it turned out to be a prank
Andrelouiz: this was so popular
puppy107: lol hes acting like he doesnt know Kappa
J_O_N_N_Y_679: watch the YouTube video
her3hero: its you george
Dubthee: i swear he talked about this before..
jayteaftw: Not this rabbit hole
Nabs__S: There is a really good video on it
0x81d: this was big.. in like 2015
Dubthee: hes trolling
swsh: wow george discovered Cicada, grabs pop corn
fortuitouslover: this appeared on 4chan this is very cool
rudolphdoesgames: last part is still unsolved
bigie: I think it was at the time you were doing PS hacks
Bacon4Life_: im cicada :)
fortuitouslover: how did you miss this lmao
joehartshorn: I thought the puzzle hasnt been solved?
oliversgsg: lol
Chillinoverhere: The puzzles are still up\
CEOChillton: he has
ziNNGG: hes playing he doesnt know :P
KagedKhaos: Watch the Cicada video
afterworktech: haha
0x81d: :(
Dea7h_tv: LUL
JalapenoSD: codiac puzzle was solved a couple days ago
yoramtap: oh no :(
benzojamal: D:
CaptainSporkey: Wut. You missed that
Shiinha: Krappa
Andrelouiz: FeelsBadMan
FDd2bfjN3mCYtkyNq8UVtyN6r: george is fat
CaptainSporkey: Oh boooi
KagedKhaos: LUL
yoramtap: we're saying important things :(
J_O_N_N_Y_679: cicada video is good
tauzN: D:
hardtarget4: george prob doesn't even use chatterino smh
MatheFischer: This is going to be a good journey Cicada 2077
MyLoveSachan: D:
spenceradolph: you should comment your code
WarSwick: Chat.. let's hack his blank window so he gives us attention.. mrmeme2WAKEUP mrmeme2WAKEUP mrmeme2WAKEUP
remegy: yep chat is gone
joehartshorn: that forest fenn thing was found this year lol
MyLoveSachan: D: WTF MAN
yoramtap: rise up chat
0x81d: george i have the answer to making level 5 autonom. vehicles.... nvm you cant see me
afterworktech: George loves puzzles and code breaking that is why Cicada 3301 is ideal for him.
joehartshorn: wow thank you for explaining that obvious thing for me
CaptainSporkey: Why is it so smol
jakeypaulyguyy: whatchya doin today mr. smart man
J_O_N_N_Y_679: @joehartshorn lmao
MyLoveSachan: does he participate in competitive programming competitions? @afterworktech
teayoflow: hes hacking the m1 processor to double everyone's bitcoin
s___t___r___i___x: someone explain tinygrad in 1 line for people like me
magic_spoon_: @mylovesachan I think he used to
MyLoveSachan: how well did he do?
puppy107: can u accelerate eth hashing on m1?
jakeypaulyguyy: what does hacking the neural engine accomplish
afterworktech: @MyLoveSachan Bio: I did a little bit of hacking on the iPhone once. Sued by Sony. Winner of pwnium and pwn2own. Creator of towelroot. Sole player on CTF team tomcr00se. Believer in the singularity.
xPolarDreamz: yo
tesleax: what do you think about kotlin and its coroutinss? Is this the future?
Digital_donger: @xPolarDreamz yo
bigie: i think afterwards he can train/use arbitrary neural networks without being an apple certified developer @jakeypaulyguyy
medianhuman: BOIS -- i extrapolated his revenue chart from last year
medianhuman: https://i.imgur.com/VKa86iV.png
medianhuman: &lt;-- from here : https://medium.com/@comma_ai/a-100x-investment-part-2-569b7141dc82
medianhuman: predicted monthly revenue: $200 - $250k/month
moorewf: This looks relevant: https://googleprojectzero.blogspot.com/2020/11/oops-i-missed-it-again.html
fortuitouslover: i am going to mute you and listen to a podcast for some time
s___t___r___i___x: George theres someone in your home
CaptainSporkey: You should spell george hotz as if it was george hotsy
ManaMerchant: its his mum
jakeypaulyguyy: @bigie wait they r making you have to be an apple certified developer? that's the stupidest thing I've heard all day
spasskyyy: what's for lunch?
yoramtap: chat just solved self driving for you, too bad you missed it my guy!
EduardGabriel19: hi
Khalifa1897: Whats that
Khalifa1897: You drinking
afterworktech: blogspot still exists?
puppy107: wait you need to be an apple certified developer to use ANE? I thought it was needed oonoly to serve iOS apps?
s___t___r___i___x: wait wtf I thought this was an Emacs stream DansGame
HotLawyer: what up george swalla back @ ya boy loved u on lex's podcasts played that ish till the wheels fell off ja dig squalla
iamdual: hi everybody !
afterworktech: only 800 viewers waiting for mukbang
Jordan_diashole: I don’t know shit, what language is he coding in?
EduardGabriel19: Do you think weed is bad for productivity?
puppy107: depends on what ure doing
iamdual: python
bweston92: @EduardGabriel19 no
KAZERKE: LUL
medianhuman: @georgehotz -- predicted monthly revenue: $200 - $250k/month.. see extrapolation from blog post here: https://i.imgur.com/VKa86iV.png
bweston92: just have it in the evening
teayoflow: weed unlocks 100% of my brain power
hiredguns: is it internal mic?
CaptainSporkey: Next rosegold macbook user should be called sparkle@miracle
magic_spoon_: Normal people only use 12% of brain
HotLawyer: Kreygasm
s___t___r___i___x: George theres someone behind you
hiredguns: i knew mac mic was good
s___t___r___i___x: dont look
Pencode: Kreygasm
hiredguns: but this is impressive
her3hero: best caretaker
medianhuman: MARRY ALEX!!!!
NuHaru: nice outfit
0xHSN: &lt;3&lt;3&lt;3&lt;3
newspapertears: Pog
afterworktech: Marriage is a scam
KAZERKE: TRUE
teayoflow: put the prenup on the blockchain
xPolarDreamz: result
totial: weed doenst unlock anything. it just shuts up the mind so u are able to pay attention to other functions of the brain
techtim123: Geo should take break
cypherph4: why
bweston92: @afterworktech marriage tax allowance tho?
medianhuman: &gt; @georgehotz -- predicted monthly revenue: $200 - $250k/month.. see extrapolation from blog post here: https://i.imgur.com/VKa86iV.png
s___t___r___i___x: Expecting new marriage deep learning framework by the end of the month
indescribabledesire: were straight boys watching the girl when she came up
medianhuman: aw this is sad now
CaptainSporkey: Hello nice girl, you should stop Interrupting the progress
newspapertears: weed unlocks pain tolerance and some anti inflammatory
Pencode: cyberpunk on m1 when?
her3hero: @totial I have the impression that it speeds up my mind
xPolarDreamz: eating stream?
s___t___r___i___x: Mukbang stream WidePeepoHappy
indescribabledesire: chair streaming pepe
afterworktech: she is distracting our boy
trajenx: watching george eat feelsbadman
teayoflow: gluten free + weed = ultimate form
c0xb0x: monkaS
CaptainSporkey: LOL he is literally eating in Front of us but still somehow offstream
her3hero: throw us :D
s___t___r___i___x: MUKBANG STREAM PogChamp
puppy107: whats he going to eat??
medianhuman: i feel like a character in blackmirror
medianhuman: in a little teddybear
Bacon4Life_: dont drop us
indescribabledesire: KEKW
KAZERKE: monkaS
KagedKhaos: Yes
her3hero: yes
xPolarDreamz: bring us over
newspapertears: @medianhuman hahah same omg
totial: again, weed puts pain receptors to sleep (kind of). it doesnt wake anything
yurit04: can't tell
KagedKhaos: Yes we can tell
afterworktech: it's good sound
bweston92: errrr yes
s___t___r___i___x: ASMR MUKBANG STREAM?? PogChamp
mucinoab: Meh
her3hero: throw us
jakeypaulyguyy: r u on a real mac or is this a hackintosh
afterworktech: full cam
smurfd0: "im feelin a little woozy over here"
hardtarget4: full screen cam bro
techtim123: No mic needed
newspapertears: like yea if youre ever sick, the best feel better medicine is weed
teayoflow: @totial depends on your alpha brain wave energy
CaptainSporkey: Just do whatever you want. Youre Smart boy
cypherph4: 5Head
trajenx: just win pepeLaugh
filipeoliveiraa: 4Head
saeedhaidar19: having hackintosh does not mean that you are poor
Pencode: KEKW
PhineasPhreak: is that his mom? PogChamp
thodeannn: just be rich 4Head
jakeypaulyguyy: hackintosh is better
Croww__: thats his mom??
s___t___r___i___x: KEKW
afterworktech: mom jokes are getting old guys
Croww__: what??
mozzart187: ASMR
trajenx: hot mom
s___t___r___i___x: where are my bttv emotes -_-
thecoder15: IF you're homeless... Just buy a house
cypherph4: just make money 4Head
ostbobmuon: is that his mom?
indescribabledesire: @Croww__ GRANDMA
Pencode: describe taste 😡
Croww__: ostbobmuon apparently
ostbobmuon: ршб ьщь
c0xb0x: and if you're unable to be rich try being a supergenius, that helps if you want to get rich
s___t___r___i___x: studio apartment poor 4Head
ostbobmuon: hi mom
i_osc: cute moment
0xHSN: @georgehotz do you go to gym?
SimpBugsBunny: does she program too?
teayoflow: George cant even afford drywall
CaptainSporkey: Is there some official guide How to get rich? Or some Wikipedia page
afterworktech: @SimpBugsBunny she programs George
SimpBugsBunny: LUL
s___t___r___i___x: monkaS
jakeypaulyguyy: Cheer80 here is some money so u can afford a hackintosh better than that mac
P3droPL: Anyone knows? Did he move entirely to M1?
totial: is someone here into harry mack?
lasercatboss: would you rather fight 10 duck sized jake pauls or 1 jake paul sized duck?
babadoctor: forsenE
saeedhaidar19: you can cut your hair and be Saitama lol
cypherph4: any rich people in chat?
babadoctor: me :)
woah1332: im rich
her3hero: who is alex?
PhineasPhreak: 500k PogChamp
0x81d: my names rich
joehartshorn: YEET
s___t___r___i___x: We don't care :)
lieqb2: i have a rich heart Kappa
teayoflow: what point is rich?
KAZERKE: YEEEEET
babadoctor: i own 2 houses in beverly hills :)
thecoder15: Any IPO millionaires here from this past week?
saeedhaidar19: like how mush shold you have to be rich
saeedhaidar19: ?????
0xHSN: marry her
brendu98: ASMR
hardtarget4: what is her twitch channel
Dea7h_tv: Harry Mack is amazing :] !
mucinoab: Zoomers, lol
notmap: yo george wats a good company name?
fortuitouslover: yeah that's because you're a boomer :)
Kalrex: yeet is to agree or to throw, typically
newspapertears: Riahahah
Jordan_diashole: I have 2000bucks in my bank account
cypherph4: BASED? BASED ON WHAT?
joehartshorn: hahaha
babadoctor: lol so wrong
KagedKhaos: Need 'time' to be rich not money
dreka: opposite
moricodes: george you looking like a snack today
New_Wizards: you need $10,000,000 to be rich minimum
KAZERKE: any airbnb new rich in chat?
Hiptin: rich isnt about money
lieqb2: richest woman in the world made her money by divorce. LUL
CaptainSporkey: I am rich of ideas bad cant get things done so often
babadoctor: even rich people can be stingy
s___t___r___i___x: SHOW US WHAT YOU'RE EATING DansGame
babadoctor: :)
puppy107: Daddy Palantir $
Dea7h_tv: sure Kappa
grahambojangles_: unless it's good debt
0x81d: when are you gonna spac george? i have my money ready
pynchonian: Americans....
mero_1181: You guy are missing Elon now that he moved to TX?
CaptainSporkey: And I am Rich of love, my girlfriend is wonderful
teayoflow: "good debt"
ESUEisa: maslo orzechowe
Pencode: Kappa
fortuitouslover: anyone who has HHKB is rich
devdual: i like turtles
mero_1181: Geo maybe you could do the same an avoid taxes too!!
Dea7h_tv: @georgehotz are you friends with Elon? :D
KagedKhaos: FUELON Tshirts anytime soon? LUL
afterworktech: MacKenzie Bezos rich right?
puppy107: biden gonna crush capital gains tax
0x81d: Kappa
puppy107: i mean increase it
0xHSN: @georgehotz you need myFItnessPal bro
hiredguns: if ypu want to put a number on it rich means, you have enough money to live without any standarts degredation for more than a year without any income or help.
0x81d: i have a rich sugar mommy
hardtarget4: hunter biden is a bro
KagedKhaos: FUELON Tshirts? Kappa
AltinMedia: Joe Biden Will reset the power transfer from USA to China. maybe in 50 year we can have white man as a member of Chinese communist party.
grahambojangles_: @teayoflow rental houses that make more money then the debt used to buy them is good debt
smurfd0: monika lewinsky 2 :P
cypherph4: CHINA IS BASED
prafaeltsantos: @fortuitouslover I am rich and I don't know?
PhineasPhreak: where did you two meet? @georgehotz
teerv: do you think biden will be president 4 or 8 years?
puppy107: you guys think biden will have a sex scandal? isn't he pretty old
fortuitouslover: @prafaeltsantos do you have HHKB?
Pencode: &gt;implying biden even finishes his first term
jawbre9ker: isnt biden like 80?
4ydininefesi: c++ or python for robotics ?
martinfischer07: when you buy the PS5?
afterworktech: Biden is old
DirkKueverChristen: could the ps5 improve the performance of tinygrad, after you "modified" the console?
0xHSN: when are you gonna get married?
KagedKhaos: Cool apartment Alex
Bacon4Life_: free shkreli
vollous: @teerv Biden cant even do 4 years
teayoflow: @DirkKueverChristen dont even
Jordan_diashole: Free shkreli
Impr0x: free shkreli
PhineasPhreak: LUL
her3hero: have you met shkrelli?
newspapertears: LUL
thecoder15: @georgehotz what is a good name for a robotics company that will replace all humans ?
sadaddadas: How tall is Ben Shapiro @georgehotz
adietrichs: #FreeShkreli
teerv: @vollous really why?
fortuitouslover: wow that's a cool way to meet
AltinMedia: how many year my boy Martin have on his head.
0x81d: would you be president george?
TheKouyateKid: let the sony lawsuits fl
CaptainSporkey: Such a nice couple
PersonaUser64: Free shkreli lol
TheKouyateKid: fly
Croww__: what he eating?
prafaeltsantos: @fortuitouslover yes :p
4ydininefesi: C++ or Python for robotics ?
socialdependency: minikeyvalue not playing nicely with docker for anyone else?
totial: @georgehotz did u get inspired by HARRY MACK?
Piq9117: Kanye2020 #YeezysForTheTroops
her3hero: visit shkrelli in prison
fortuitouslover: @prafaeltsantos you are rich.
DiiCE3: cant stand to watch @georgehotz eat
dreka: any tiger owners? ANELE
fortuitouslover: Fullstop.ai
devdual: san diego worth a visit?
AltinMedia: when he get out we should throw a party for him.
FargioFarmani: Does George know how to make small, cute Georges?
zergd__: How come George is not playing Cyberpunk2077 like everybody else ?!!!
DiiCE3: or hear rather @georgehotz
zennydmt: are you going to play cyberpunk?
0xHSN: where is TiCi?
16455e4f27: You can write letters to him
Smyile: @4ydininefesi visual basic LUL
ahahaitslit: i think he has another 3 years left in prison
saeedhaidar19: do i have to be an expert in data analyze to be able to develop a web software for small to mid company ?
4ydininefesi: C++ or Python for self driving cars
notmap: would u suck elons dick for his tesla boards?
vollous: @teerv isnt he becoming senile
i_osc: the word sony is forbidden here ?
afterworktech: Live stream from prison?
jawbre9ker: overhyped game
AltinMedia: if Trump Landon shkreli, i Will apply for US citizenship.
hardtarget4: it's a single player game ResidentSleeper
prafaeltsantos: @fortuitouslover i only wish that was true...
fortuitouslover: @georgehotz Lex played Cyberpunk
clearhunch: NYC is better, but San Diego is cheaper makes sense to move there
zennydmt: what is your opinion about algorithmic trading?
KagedKhaos: There should be reviews of game reviewers
Croww__: Federal Correctional Complex, Allenwood
Stegosaurian: GTA V is good
danielb123: CYBERBUG 2077
KAZERKE: Red Dead Redemption 2 PogChamp
afterworktech: HF2
Koduck007: hl2 excuse me
thecoder15: @georgehotz you going to finally move to Austin now that everyone else is?
adiqusi: i'm too dump for baba is you
jakeypaulyguyy: you sound like my ain't from jersey
DYM_06: @danielb123 SCAMBERBUG 2077
zennydmt: would you say you are materialistic?
jakeypaulyguyy: aunt*
sadaddadas: @georgehotz Seattle better
ontologicaltofu: How about Chicago
mindthemoon: Why does your shirt say 現実離れ ? Do you feel disconnected?
danielb123: cyberpunk was just overhyped unoptimized bugfest
cypherph4: @zennydmt materialistic in what sense? a marxist one?
notmap: george whats ur thoughts on the zodic killer?
0xHSN: why don't you join government?
fortuitouslover: yeah @Alex follow Elon to Austin or wherever else he goes
pynchonian: Nice
in127pkt: Cyberpunk tells us that 2077 will be more bugged than 2020
jakeypaulyguyy: u don't sound like my uncle from jersey tho
martinfischer07: i should ask me, when gta 6 is going to Released
AltinMedia: @danielb123 well it was shitshow on PS4 and xbox.my pcrun it just fine.
zennydmt: @cypherph4 yes
prafaeltsantos: @4ydininefesi depends, but in my exp. you should start with c++.
cypherph4: @zennydmt BASED
Koduck007: politics was a mistake
her3hero: alex, tell us why u are famous
Hiptin: increderbly? LUL
DirkKueverChristen: true
Koduck007: poitics was a mistake brah
puppy107: what about the NSA?
Pencode: why would you expect cbp2077 to be optimized at release? witcher was playable after like 3 years
climbtofail: LUL
zennydmt: do you like dogs?
hardtarget4: NSA is pretty good
clearhunch: I mean Texas has better tax incentives than CA. But, there will probably be a talent crunch for a little bit
notmap: brah
techtim123: Ill design the new building!
ilikerecursion: HeyGuys HeyGuys HeyGuys HeyGuys
0xHSN: NSA?
medianhuman: @georgehotz -- predicted monthly revenue: $200 - $250k/month.. see extrapolation from blog post here: https://i.imgur.com/VKa86iV.png
0x81d: geohot for president when?
teayoflow: if you have an onlyfans blink twice
zennydmt: would you get a dog as a pet
New_Wizards: would you hire someone that does not code?
notmap: do i get free lunch at comm4?
ilikerecursion: can you code in C like a real man
42Lucas42: !uptime
techtim123: Ill design the new building using Ai!
0xHSN: did you finish college?
danielb123: it's free if you pay for it
notmap: will u ever open an office in the uk?
zennydmt: does your company hire ppl who did not go to college?
afterworktech: would you merge with Alex?
FargioFarmani: Am I allowed to code in Haskell like a real intellectual?
romulan_empire7: romulan_empire7 subscribed with Prime. They've subscribed for 3 months! 
KAZERKE: George do you know School 42 ?
ahahaitslit: favourite courses u took in college?
ilikerecursion: @georgehotz can you codei in python
tsojtsoj: no
Koduck007: no
jaimebw: no
indescribabledesire: no
thecoder15: no
PhineasPhreak: no
0xHSN: ni
0xHSN: no
supremeslayer19: monkaW
teayoflow: no
dreka: no
martinfischer07: no
RobbieBillions: no
DirkKueverChristen: you should work with Lex at MIT
notmap: George i have a great solution to self driving cars we hire human drivers for cheap
ilikerecursion: no
prafaeltsantos: nah
clearhunch: I mean it is better to work on something relevant than have free lunch. would rather die than work at yelp doing business logic
saeedhaidar19: what is your opinion about the changes that happen in this year in technology (Programming) in generally and what to expect in next years and near future
mufeedvh: I added the indentation linter @georgehotz
zennydmt: have you built a trading system before?
kyleskom: dont tell him
hardtarget4: no haskell allowed
martinfischer07: noice😏
her3hero: covid monkaS
dreka: like ya cut g
puppy107: no haskell!!
lou_sasol: &gt;human drivers. So slavery
AltinMedia: have anyone thinking about hiring Russian Merc to Occupy land in Africa so we can buy it and start new country? i think it ia feasible. UN might send us cease and decist later but at least we try.
Pencode: LUL
her3hero: hahahaha
danielb123: LULW
Croww__: HAhAHAHAHAHA
clearhunch: I want my fruit loops
thecoder15: lol
FargioFarmani: No Haskell PepeHands
totial: wouldnt it be fun to hack starlink satellites and crush them into each other?
0xHSN: lol
techtim123: Lol 😂
averor: What’s the most important thing to learn in general?
solomonspeare: ELON MUSK LUL
ilikerecursion: no
danielb123: LUL CEREAL'S GONE
CaptainSporkey: Better question is Why didnt Apple buy tinygrad in the past
alpayon: what if Apple shows interest in comma2 with an offer you cant refuse ?? @georgehotz
techtim123: Elon no cereal for you!
Kawhiet: Muh free fruit loops
teerv: that explains why tesla is mooning they cut the ceral cost
hey_its_lgg: no serial = serial problems!
smurfd0: must go alot of cereal
fortuitouslover: do you think Elon Musk treats his employees like shit?
techtim123: That’s a OG move
Pencode: Kappa
thecoder15: dude, Ima have fucknig steak lunch and dinners at my company
puppy107: lol so true
mindthemoon: Kinda funny considering Musk's recent interview decrying the over-MBAing of industry (e.g. taking away cereal to save money)
zennydmt: are mac minis worth the buy?
KAZERKE: but its so pretty Kreygasm
teayoflow: are you going to make an AI accelerator?
clearhunch: We need margins not cornflakes. that is where they are losing the most margin Kappa
Dea7h_tv: But it looks good tho :)
totial: true
hardtarget4: it looks good tho
martinfischer07: how is calling his Kid?
hey_its_lgg: no cereal = cereal problems!
puppy107: Apple has the worst documentation
0x81d: im 5'5 so im basically a tiny grad
totial: so sad
zennydmt: is the transition from windows to apple jarring?
solomonspeare: imagine developing apple :)
SurfCat: At ;east the font is nice Keepo
afterworktech: beautifully useless. the Apple way.
clearhunch: @zennydmt Just run a virtual machine of ubuntu on windows. Best of unix and windows
totial: apple just focuses in beauty :D
lu3nox: @zennydmt nah, takes a bit but worth it
supremeslayer19: CoolCat
techtim123: You guys are hilarious!
0xHSN: how much for tinygrad? asking for apple :)
PhineasPhreak: you left your tea! @georgehotz
xakerado: why apple? Qualcomm chips are better in terms of TOPS
fortuitouslover: @clearhunch i do the same. windows is literally a bootloader for my linux vm at this point
zennydmt: whats a good first mac product? mac book pro?
KagedKhaos: LUL
martinfischer07: which name gives Elen his kid?
solomonspeare: WeirdChamp
danielb123: SIMP LUL
afterworktech: can you do the stat how much does it cost to develop tinygrad?
Crazypandaboy: Getting hot in here
Deni1111: JUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUU
techtim123: Tinygrad is worth like 3.5mili
supremeslayer19: SIMP ALERT
woah1332: kiss monkaW
alpayon: guys, this is still science and tech
clearhunch: @fortuitouslover I stay for the GPU availability for ML and gaming
techtim123: It just got hot in here
afterworktech: only 60k nice
Koduck007: how fast can a man read
heponatnokto137: @alpayon i am afraid it is more biology now than AI
heponatnokto137: Kappa
SimpBugsBunny: 4
mucinoab: Whats the tool?
zennydmt: do you ever use Java?
notmap: is the m1 air a good laptop might pick one up to play fortnite with and roblox?
fortuitouslover: @clearhunch you should probably switch. GPU for ML is better and gaming is almost as good on linux
KAZERKE: LUL
kyleskom: people dont use java
Schrutt: have you ever tried to smoke a cigar ?
martinfischer07: or C# ?
supremeslayer19: D:
Koduck007: neuralink prototype secret product tester
imvilln: do you ever use lua LUL
afterworktech: Java is like Flash
zennydmt: Java is the greatest language
CaptainSporkey: Call it tenSIR
tsojtsoj: Do you ever do brainfuck?
kavprog: jk java is alright
datshadyboi: Java is like very slightly less shitty C#
techtim123: Coffee ☕️
panadoma: what is your skin care routine?
herrsch_de: lua is dipe
tesleax: what do you think about kotlin and its coroutinss? Is this the future?
herrsch_de: dope
danielb123: JAVA IS CANCER
teayoflow: do you know about WASM?
0xHSN: mayo is fat sauce
fortuitouslover: write java bindings for tinygrad
zennydmt: some reason I cannot stand python
Bacon4Life_: mayo WubTF
her3hero: omg JAVA
apop_666: rust?
Hiptin: george can you give me a shout out please would make my day :)
Bacon4Life_: mayo WutFace
zennydmt: I like the simiplicty of Java/C#
herrsch_de: but torch and lua are dying. sad
fortuitouslover: @zennydmt that's illegal
frode_0xa: Java is not simple
zennydmt: and the pythonic statements make it hard to see whats going on
okStevie: Hello Mr. George Hotz, how's your day going
dreka: python is the most difficult language
fortuitouslover: neither is C#. C is simple
kavprog: @zennydmt lmao why bro its so good
Dea7h_tv: lmao Java is retardedly overcomplicated :D
puppy107: did george finish his lunch or was that a snack?
PhineasPhreak: ur a snack
afterworktech: assembly is simple
zennydmt: maybe I'm not used to it...need time to acclimate myself
kavprog: gorge doesn't eat he updates
zennydmt: but is Python as fast as Java?
korede360: Why Chrome and not Chromium?
zennydmt: and does it have aotimatic garbage collection?
zennydmt: automatic
kavprog: @zennydmt python is slightly i belive
frode_0xa: It depends @zennydmt
teayoflow: you can run WASM faster than python
martinfischer07: @okstevie your serious?
notmap: java is faster tho right ?
KagedKhaos: When will tinygrad be considered "done"?
kavprog: no
afterworktech: java is faster in crashing
teerv: 🤓 Actually, java is a superior language. it's used for the most advanced game Minecraft.
zennydmt: I thought hands down Java was faster than python
zennydmt: that changed?
tesleax: what do you think about kotlin and its coroutinss? Is this the future?
kavprog: nah
dreka: python is the slowest by far
joehartshorn: i cant help but see jabba the hut any time someone mentions java
frode_0xa: @zennydmt sometimes python is faster, sometimes java
puppy107: when u say a language is faster than another - that's a loaded question
zDogemon: yeah python is slower than Java in most cases, but development is way faster
zennydmt: its probably because my first class in programming was in Java
zennydmt: so got used to i
zennydmt: it
kavprog: python with specific uses for example web scrapping
okStevie: @martinfischer07 no idea what you mean by that
KagedKhaos: When will tinygrad be considered "done"?
frode_0xa: python is a really nice language, i like it more than java nmow
frode_0xa: now
notmap: tbh python just has a big community thats y the lang is so loved
many_mangos: also I'm pretty sure python has a monopoly on the hacking tools
afterworktech: More https://github.com/geohot/tinygrad/pulls :O
notmap: easy to get things setup
dreka: machinecode is the easiest language to pick up on the go
notmap: lol
kavprog: kali linux and Ubuntu
zennydmt: I like python for the libraries and ML stuff
ilikerecursion: elecricity is faster than python and java
kavprog: c++ libraries are supeorir
Piq9117: there's only one way to oil a python
zennydmt: but I like java for the simplicity to me for some reason
Piq9117: c pluth pluth
martinfischer07: @okstevie everything is ok, it was a misstake because i read a other text
okStevie: @martinfischer07 oh lol, its ok. Enjoy the stream &lt;3 :)
notmap: java is more simple than python?wat!!! yall smoke crack in here or wat
clearhunch: George has helped my reframed my view on programming and realizing I am just a business logic monkey in the midwest. Now I actually care about understanding the fundamentals of computers/programming, like a true degenerate.
tesleax: what do you think about kotlin and its coroutinss? Is this the future?
ilikerecursion: python indentation smells
zennydmt: are people here night owls or morning ppl?
notmap: kotlin is google avoiding oracles bs
KAZERKE: @clearhunch u learn assembly yet?
datshadyboi: C or bust
frode_0xa: @tesleax Kotlin is an overcomplicated piece of crap on top of java which is also crap tbh
teayoflow: @zennydmt sleep is a social construct
KagedKhaos: When will tinygrad be considered "done"?
puppy107: when will tensorflow be considered done
zennydmt: @teayoflow sleep is required
mindthemoon: all software is never done... merely abandoned
puppy107: ^
puppy107: aka caffe
ilikerecursion: done = dead
joehartshorn: dunno, bitcoin was pretty well done
teayoflow: @zennydmt replace it with meditation
martinfischer07: do not get me wrong, but what he is trying now?
zennydmt: @teayoflow do you do meditation? mindfulness?
imnotabrainsurgeon: @georgehotz your cough seems fishy
JalapenoSD: will we be hearing taylor swift today?
ilikerecursion: @georgehotz make hangman in 1 line
notmap: yo george what do you think of palmer luckey?
OetziOfficial: hey, what did i miss so far i was gone for couple hours xD
CaptainSporkey: Do you like the fish shell?
datshadyboi: covid is a pretty based tool ngl
teayoflow: @zennydmt mindfulness is clickbait, there's many different techniques
zennydmt: @teayoflow do you have a recommendation?
LokkimestariN: What is that screen flashing? Screenshot or something else?
teayoflow: depends what you want to do
marcelbischoff: visual bell
zennydmt: @teayoflow substitute for sleep/ anxiety reduction
cefdsahg: what is he doing guys?
Crazypandaboy: typing things
keng1ne: @zennydmt u should look up vim hof breathing method, its pretty good actually
Zepcon7: @LokkimestariN it's when he tries to complete by tabbing but there is no suggestion available, therefore flash
Waywoah: Could someone give a brief rundown of what he's working on?
zennydmt: @keng1ne is that safe?
keng1ne: @zennydmt oh yeah
marcelbischoff: yeah is flashing instead of the bell
bg7kd94: @Waywoah its called tinygrad and its on his github
marcelbischoff: it's the visual bell in screen
man_dos: why do you use only vim ?
qubitmanipulator1: has problem solving felt harder as you have grown older?
teayoflow: @zennydmt I focus on neuroplasticity (same function as sleep). I'll find the name of it
Waywoah: @bg7kd94 oh, thanks
zennydmt: @teayoflow thx
yznm19: GEOHOTTT
mucinoab: Last years AoC was harder
yznm19: hows it going lads
clearhunch: @mucinoab Ain't over yet
xxxelent: you can load dlls with python? who knew
Zepcon7: @mucinoab maybe because you had less experience last year
xxxelent: I mean its definitely useful
2sin54: vim sucks
zachrip: What do you wish you could tell geohot of 2010?
FastCashCoding: is he compiling python? i see some python
FastCashCoding: but thought it wasnt compiled
pepeega: textedit &gt; vim
Silensrunners: VoHiYo
smurfd0: hes compiling the c library that he calls from python
pepeega: python doesn't compile, it runs on a vm
FastCashCoding: thats pretty common in software engineer?
FastCashCoding: engineering*?
FastCashCoding: do python libaries not exist for what he is wanting to do?
antoine_neo: Hello from France George.
moorewf: he's telling python to send certain commands to the ANE that are in a config file.
fortuitouslover: im gonna go sleep now. goodnight chat!
pepeega: gn
SHAVEYY_: @FastCashCoding no Python libraries exist for the ANE its a new chip in the 2020 Macbook
fortuitouslover: the last time i went to sleep while george was streaming, he was still streaming when i woke up. he streamed for 10 hours in total
FastCashCoding: but C libaries? are easier to use?
fortuitouslover: let's see how long he lasts this time
johnleetran: he's so close though
2sin54: 7,000,000 points to send a message in sub mode??? @georgehotz
OetziOfficial: make it 8 mil
EstrangedHD: 10 or bust
pepeega: good
FastCashCoding: oh, just re-read what you said Shavey, ok python libs dont exist yet
FastCashCoding: @SHAVEYY_ thx
not_into_gaming: George has good perserverence.
xxxelent: tru
pepeega: better than most
not_into_gaming: He's like....how if I try this....error
swsh: self.shape?
fortuitouslover: use Rust to avoid segfaults
not_into_gaming: and .....this....error
pepeega: don't make mistakes to avoid segfaults
not_into_gaming: ...and how about this?
2sin54: XD
not_into_gaming: just keeps going
jokerjon901: jokerjon901 subscribed with Prime. 
SHAVEYY_: just use Perl (no segfault bro) 4Head
not_into_gaming: eventully he makes progress
2sin54: use gdb Kappa
Leaskell: (core dumped)
not_into_gaming: fair play. Good skill to have.
not_into_gaming: Don't give up.
pepeega: it has its pros and cons, you need to be able to balance it with wasting time
tornpaperyoyos: "Never give up. Never surrender"
yznm19: NotLikeThis how does he do this so quick
nooni_99: light theme?
Silensrunners: Better look at answers instead of questions
shebang__: @yznm19 its prerecorded obviously
not_into_gaming: I think he has a lot to computer time under belt
not_into_gaming: so is more fluent than most
pepeega: that's great in theory but yesterday I wasted 2 hours trying to understand some step in a math derivation, it's not worth
nooni_99: why is he using light theme?
clearhunch: @yznm19 years of practice, and this is a deep fake of an ai
shebang__: @clearhunch so true
yznm19: i have no idea what he is doing but its sick
not_into_gaming: I think he should consider steping back on this 1
shebang__: @yznm19 hes struggling with buffer size : O
JalapenoSD: agressive typing
newspapertears: same I like watching this wizardry
0x81d: whos watching for the asmr?
yznm19: nothing better than the sound of aggressive typing ngl
shebang__: @0x81d you are weird aishCringe
JalapenoSD: kfodjfojfojsojdokfgokg
pepeega: I don't use python much, no idea what he's doing lol
sliddjur: I love pressing enter as hard as he does. my colleague gets super annoyed lol
not_into_gaming: I don't think Apple actually made the ANE.
JalapenoSD: I thought python didn't have pointer but what are those stars :0
not_into_gaming: they licenced it
yznm19: or clicking real hard too
Frans_NL: i'm just wondering what the real world application is for all this
shebang__: @not_into_gaming ctypeslib?
pepeega: python doesn't have pointers technically but it does use them
pepeega: same way python technically has only 1 type but still uses different ones low level
clearhunch: Ugh
JalapenoSD: @pepeega why say it doens't have when geo is using them right now?
nooni_99: why are you using light theme???
Kobayawaka: what light theme?
shebang__: @nooni_99 he doesnt read
nooni_99: yeah I guesz
pepeega: it's hard to explain, dw about it, just a technicality
yznm19: boys how do i learn to code
nooni_99: the light theme kills me
yznm19: i feel like my brain cant comprehend pyhton
borang: dark theme for l337 hackers only. geo obvi not top level hacker
shebang__: @nooni_99 why?
JalapenoSD: @pepeega I don't undersatnd what's the different between having them technically and having them not technically :D but ok
CanineDreams: you guys can all understand what he's doing? cuz i'm like whoosh
nooni_99: dark theme better
clearhunch: @yznm19 Well, you start with learning about computers -&gt; then progress to writing the matrix
pepeega: there is the python language and there's how python works, they're different things
Frans_NL: @yznm19 just follow online "learn to code" game
xxxelent: is it _t?
oooillk8snfw: CanineDreams, same. LuL
yznm19: @clearhunch yeah, id say ive got a pretty good understanding of computers tbh
yznm19: @Frans_NL got it
JalapenoSD: @pepeega But geo is typing python rn no?
nooni_99: I would learn to code by taking an online course, then do whatever projects you want. when your stuck, google it. @yznm19
pepeega: the python language has no concept of types to simplify things and for elegance, but it does use them practically
smurfd0: anything in dmesg?
newspapertears: I just started learning java and linux where do I go next?
pepeega: python philosophy ig lol
Pager777: Sup george, sup chat FeelsGoodMan
yznm19: @nooni_99 okay, ill have a look, thanks
JalapenoSD: @pepeega i understand it uses them under the hood but if it's not supported the nhow is geo using pointers rn?
TsarSec: python lets you interface with c @JalapenoSD
Frans_NL: @newspapertears think of something you want to build for yourself and build that
pepeega: because modules
nooni_99: @yznm19 no problem, by the way, everyone will learn how to code differently. that's just my wY
Schrutt: guys, what's your average time needed to be in the zone ?
clearhunch: @yznm19 The true answer it depends on what you want to do. Like there are so many domains that learning to program is just very general. There is Web, Embeded, ML, etc
nooni_99: *way
pepeega: for example in numpy you can make 128bit or 256bit complex arrays, yet python has no types
Hiptin: yooooooooooooooo
x86__64: PogChamp
Hiptin: yeh course brah
hardtarget4: Pog
bg7kd94: Pog
ChannelOpen: Pog
corrosivecamel: Pog
thecoder15: YOOOO
SHIFT256: PogChamp
smurfd0: noise :)
yznm19: @clearhunch exploit development really interests me tbh, any reccomendations
Hiptin: &lt;3
Jordan_diashole: No
I_am_paranoid: PogChamp
KAZERKE: PogChamp
afterworktech: well done
pepeega: PogChamp
shebang__: Pog aishR
bg7kd94: ???????
FastCashCoding: yessss
x86__64: do it before its too late TriHard
OetziOfficial: kaywa1Pog
Hiptin: youre something else bro
corrosivecamel: YESSIR
Croww__: LMAO
jcytong: 🔥🔥🔥🔥
slimpimp007: goat
gussyyy_: Do we get a cut cause we were here?
johnleetran: PogChamp
Jordan_diashole: This is nutty
the_gilps: LOL
bg7kd94: True
evanmays: SeemsGood
ZuppaSalata: LUL
Jertzukka: Just play a screen recording of when it doesnt crash to the venture capitalists
corrosivecamel: darn Chileans
mrchunk123: wtf so fast
afterworktech: tinygrad the best deep learning framework that ever lived!
hexenas: Learn concepts not python... Think and do. Don't watch what others do unless you're stuck. You possible won't be close to george in your life time. But hey if you're not enjoying the journey why travel?
iPr3dictionz: Un tierno
newspapertears: seksu time
gussyyy_: Hahahahah this turns GHot on
Schrutt: what a chad
corrosivecamel: @georgehotz That girl looks like she likes you. You should ask her out or something
clearhunch: @yznm19 I don't know much about that, but I would say look at how to replicate more simple exploits like buffer oveflows into more complex things like what is current in the field
bg7kd94: tinygrad &gt; ice cream
marcelbischoff: pretty impressive!
x86__64: fix the segfault
OetziOfficial: and now an appke manager is watching and is like 👀
devdual: is this mario kart? :D MORE STARS
thecoder15: pimping out for @georgehotz
x86__64: LUL
Hiptin: shoudl have gone GNU bro LUL
yznm19: @clearhunch thanks, appreciate it
datshadyboi: Stared ++
mucinoab: Starred
Lancellott: what is he doing?
therealgeoday: finally caught a live HeyGuys
hexenas: @Lancellott Framework
shebang__: @ge0day WutFace
corrosivecamel: Writing a bot to create accounts and star tinygrad
w3rk: isn't there a git botnet around to buy some stars D:
Mabaet: HeyGuys
SHAVEYY_: its a ratelimit 4Head
clearhunch: I would star, but I was told not to follow funnels Kappa
Mabaet: WutFace
shebang__: racecondition aishCat
Lancellott: @hexenas tinygrad?
smurfd0: is it somehow not "released" after previous run?
pepeega: I mean if it works 70% of the time, good enough
SHAVEYY_: the device actually makes a request to apples AI cloud 4Head
hexenas: @Lancellott Yes. Apple neural shitwork support
w3rk: make those mutex
Lancellott: awsome
swsh: if you run it sloooowly, would it still crush?
Jordan_diashole: @hexenas ?? SoonerLater
clearhunch: @swsh We only run fast. This is a place for winners LULW
clearhunch: LUL
corrosivecamel: @georgehotz Will you beta test neurolink?
Leaskell: sorcery
clearhunch: is
epistemologist_: hey chat
ZeeZaxean: fake news
Lancellott: maybe you're requesting too fast, the could be busy
clearhunch: Our chain was ruined WutFace
Lancellott: the query
shutchie: !uptime
epistemologist_: currently in bed with a migraine so i thought id jump in for a bit since im not really doing anything else
TomatoePasta: Any tips for passing an Algorithm Design exam? BibleThump
borang: practice the algos :)
TomatoePasta: @borang thanks :)
Lancellott: try uri judge @TomatoePasta
therealgeoday: 7 steps to improve your data structure and algorithm skills Step 1: Understand Depth vs. Breadth. Step 2: Start the Depth-First Approach—make a list of core questions. Step 3: Master each data structure. Step 4: Spaced Repetition. Step 5: Isolate techniques that are reused. Isolate actual code blocks. Step 6: Now, it's time for Breadth. Step 7: Practice on paper.
borang: idk
teayoflow: I always go bread-first when programming
Hiptin: just built my first c++ project on the m1 PogChamp
clearhunch: I hate the focus on algorithms when 99% of jobs will never have you write even a simple sort ever
w3rk: obvious...
mrchunk123: for how long he gonna stream?
pepeega: it's like math in hs clearhunch, almost none will need it, but it's worth it for those that do because they matter
hiredguns: noooo index 0? we can't handle that we can not accept that
w3rk: whaaaat honda does this, what did they smoke
OetziOfficial: HAHAHA LUL
clearhunch: @pepeega Don't get me wrong I think they are valuable to understand. But, I think the focus on memorizing them versus understanding the fundamentals of why they work is this issue. And requiring them for jobs they will never be used in is asinine
swsh: You are running out of Apple credits for ANE calls Kappa
hexenas: @ge0day Nah just pay 20k for some online bootcamp program and do minimal work then think you have this proof of your skill on paper that you can wipe your ass. And then understand that buying cocain and reselling it with that kind of money would have been better investment. Thats how you learn algorithms
pepeega: if you need to memorize algorithms, you're learning from the wrong place
dungeonmaster3: that's some brilliant stress testing
pepeega: no
w3rk: george create a test that triggers the race cond faster ...
pepeega: ahaha
shieeeeeeeeet: are you passing a pointer somewhere it shouldn't be used?
Schrutt: capuche on, no bonobo
hiredguns: wrap in a catch block SHIP IT
dungeonmaster3: what language is this mm code in ?
pepeega: ship it ahaha
pepeega: if it fails, just run it again
pepeega: it's c++
keng1ne: @dungeonmaster3 objective C++
shieeeeeeeeet: I thought I saw address of a local somewhere, but it might be ok
J_O_N_A_S: @Mods, what is happening atm? I'm a beginner in Python.
dungeonmaster3: ah okay
clearhunch: @pepeega I agree, but the amount of people who memorize then regurgitate a big O notation they read online with no concept of the fundamentals is just sad
pepeega: ye that's not learning
not_into_gaming: The main thing is to have fun when learning
pepeega: and people don't understand big O anyway. im in HPC and we use insertion sort for example, if you'd ask a class why, no one would know
ZuppaSalata: @not_into_gaming true
Lancellott: f
GerbilJay: ghidra is a dearest friend of the stream
w3rk: @dungeonmaster3 .mm will be handled by the Objective-C compiler as c++
newspapertears: @not_into_gaming yep so true !!
rektiwow: big f
Hiptin: f
Pager777: F FeelsBadMan
football2442: f
afterworktech: wow the lag is real
slimpimp007: f
myaocat: ANE BLOWED UP
afterworktech: wtf
smurfd0: dropping them frames
w3rk: F
bob_babyelephant: is the stream lagging for anyone else
miomokyu: apple monkaS
OetziOfficial: F
not_into_gaming: See George is having fun wiht all this stuff
bob_babyelephant: oh
script_sh: appled
bob_babyelephant: ripppppp
devdual: logic bomb
myaocat: appled
newspapertears: F\
therealgeoday: stream just went brrrr
OetziOfficial: stream is buffering
newspapertears: \F
bob_babyelephant: rip george its mega lagging
levelsio: F
GerbilJay: lagcity
hardtarget4: F
DirkKueverChristen: f
afterworktech: it's java haha
Schrutt: apple is taking down the stream
moorewf: ghidra is killin it
hardtarget4: java ddos
shieeeeeeeeet: @
pepeega: it's garbage collecting
w3rk: the GC goes yeeet
Koduck007: yeah f
Mabaet: he lagg??
not_into_gaming: should have gone with the 16gb
deadpool_reynolds: hello boy
not_into_gaming: that no was so sad
afterworktech: who said java is good? horrible
not_into_gaming: ;0
slimpimp007: lol .001 fps rn
shanumbra: java sucks
Hiptin: java is bad
Koduck007: origin taking 1200 MB
myaocat: no c# is better.. no way
newspapertears: LUL
not_into_gaming: f**ki* java
deadpool_reynolds: hahha
Stegosaurian: the stream is at 8 fps right now lmao
Hiptin: LUL
keng1ne: Kappa
shieeeeeeeeet: line 69 i think you're passing address of a local. is it safe?
pepeega: 27000gb filling at 1%/s doing nothing
afterworktech: M1 self-destruct for us
clearhunch: Who needs java, just rewrite in rust Kappa
Lancellott: no worries, we pressed f and now you're back
newspapertears: omg Im stuck in a java program at school LUL
celebrimborfan123: you'll make headlines in the country Java
Hiptin: george can you give us an ls -l please
pepeega: schools love java, for some reason
deadpool_reynolds: we laugh but deep inside we know its true
therealgeoday: frick java all my homies hate java
not_into_gaming: java is 90s tech
afterworktech: companies pay schools so they make java developers
shanumbra: @pepeega i skipped java classes
pepeega: 90s tech was better, it was compiled
SHAVEYY_: pay 10k for IDA 4Head
ilikerecursion: html beats all
smurfd0: java is for the cup
clearhunch: placed out of my java class in uni, thank good
pepeega: lucky for you, I was forced to learn java
therealgeoday: f
shanumbra: f
mrchunk123: stupid jav
newspapertears: Im currently being forced to learn it but at least its fun to write
SHAVEYY_: something makes me think this is a deprecated NSA tool and they actually use something better then this
w3rk: probably a Java engineer that didn't release his mutex on the GC
sativa2lol: oh nice i catch a live stream Kreygasm
ahahaitslit: they use ghidra so it's not a pain in the ass training people when they apply to NSA
not_into_gaming: Ghaidra is prob the backdoor
4ydininefesi: have you ever use ROS?
pepeega: it's all backdoored
not_into_gaming: probably @ hardware level
SHAVEYY_: why would they backdoor software when they have a backdoor on your hardware 🤔
pepeega: yepp
pepeega: why not both?
not_into_gaming: not me
I_am_paranoid: PogChamp
not_into_gaming: I use acorn archimedes
SHAVEYY_: dont drink water its backdoored
not_into_gaming: too old
SHAVEYY_: only NSA agents want you to drink water
thecoder15: @georgehotz im learning visual SLAM any recommendations on reading?
w3rk: they will use tinygrad xD
corrosivecamel: ayoo TONY
dungeonmaster3: at least that was a confident commit
4ydininefesi: what is the difference between salam and visual slam @thecoder15
corrosivecamel: George Hotz making a sopranos reference made my week
dungeonmaster3: Is gdb not an option to debug the segfault?
pepeega: doesn't really explain it aha
clearhunch: You can tell when focus mode activates when a developer is at a 45deg angle in their chair
SHAVEYY_: would Apple ever release documentation for the ANE I doubt they would only put it in for animoji
w3rk: sure remove the unlock lel
moorewf: I think apple is content with just releasing CoreML bindings for their ANE
marcelbischoff: Maybe a stupid comment but maybe the ANE is really not available all the time
pepeega: wtf is he doing lol
sativa2lol: he is learning 4Head
celebrimborfan123: magic
pepeega: h00l PogChamp
ilikerecursion: why george hates java
printhellosailor: why wouldn't anyone hate java?
zl0ne: yeah
teayoflow: im in love with the javascript
pepeega: 10 times the complexity, 10% the capability at 10% the efficiency
printhellosailor: no matter what you want to do, there is a better option than java
afterworktech: java is a pile of ...
football2442: is java worth learning for full stack if noob?
hajyand: @printhellosailor What if I want a headache?
ilikerecursion: why beautiful languages like erlang are not used more
hiphopsucks: erlang beautiful?
celebrimborfan123: @football2442 yes
printhellosailor: @hajyand in that case, java is competitive
ilikerecursion: if you think opposite i am sad 4 u
pepeega: because if everyone used the same good languages, software development would be fast and devs wouldn't earn good money
hiphopsucks: you are better off using elixir
SHAVEYY_: @ilikerecursion have you heard of Elixir? It runs in the Erlang VM
teayoflow: it doesn't get more beautiful than CSS
hajyand: @printhellosailor I see no competition to be honest
pepeega: I think swift is the prettiest language
moorewf: Is it possible to set breakpoints in your library?
submohanty: @georgehotz do you have a guide to how to answer smart questions?
pepeega: I think it's underrated because people ignore it too easily
ilikerecursion: @SHAVEYY_ forgot about that one
TheAbdullahAmrSobh: @submohanty probably his answer would be, "just be smart to answer these questions"
submohanty: tru
teayoflow: @pepeega swift hardly supports linux
TheAbdullahAmrSobh: ? isnt it made on top of llvm?
pepeega: it's made by the guy that made llvm
UltraScientism: numpy is a slowness kludge
pepeega: it's getting better tho teayoflow
hardtarget4: nah most people are just shitposting
many_mangos: are you a fan of nootropics george
GerbilJay: @georgehotz do you have a guide on how to ask smart questions?
Toledojose60: yes Kappa
Hiptin: LUL
deadpool_reynolds: wtf
printhellosailor: people on the internet do seem to be notoriously good at asking the wrong questions
teayoflow: answering smart questions for dummies
ilikerecursion: LUL
borang: LUL
clearhunch: I wonder how many people will ask george how to program
clearhunch: LUL
sativa2lol: LUL
swsh: Step 1: Read the question. Step 2: Answer it!
newspapertears: guide on how to be a millionaire?
ilikerecursion: step 3. buy the guide
Draco0x191: does he indent with 4 or 2 spaces?
UltraScientism: Intermittend crashes Pog
Hiptin: I honestly believe George is going rule the world one day - he's a straight up genius
desiero: ban
afterworktech: step 1 use search engine. step 2 be quiet
ountop: He’s gonna get a ulcer holding it emotions
borang: 1. get off twitch 2. profit
many_mangos: no it's not a troll, in an youtube interview you said you hacked the iphone because you broke up and were on drugs LUL
clearhunch: I mean if you stop feeding the trolls you will starve too
newspapertears: Guide on how to get a girlfriend?
clearhunch: Kappa
submohanty: i was being totally serious because I remember in one of george's interviews he mentioned that he has a guide that his employees have to read about smart questions
printhellosailor: just rerun it until it doesn't segfault 4Head
afterworktech: yees
corrosivecamel: Guide on how to pick up women?
moorewf: smallgrad incoming
pepeega: don't write javascript
UltraScientism: @corrosivecamel be attractive, don't be unattractive. They'll come themselves.
ilikerecursion: @pepeega LUL
corrosivecamel: @UltraScientism Thank you for the advice I'll write this down
phtl_: do you smoke weed beast
teayoflow: @pepeega how do you reccomend I create sexy web UI?
b2kemann: Wrote autograd in rust, and it was 100x faster than pytorch lol
ilikerecursion: @teayoflow LUL
printhellosailor: the year is 2022... tinygrad is still under 1000 lines... average line width is 6841 characters
clearhunch: @corrosivecamel or be rich
many_mangos: you should do an occasional Q &amp; A stream the fans would love it
hiphopsucks: LUL
ilikerecursion: @many_mangos LUL
pepeega: sexy web UI? wouldn't know, don't do webdev
hiphopsucks: poof
ilikerecursion: @pepeega LUL
submohanty: Q&amp;A Stream: Which language should I learn first? Do you still do CTFs? How do I learn programming?
rootkn0x: hey geo, what are you working on?
printhellosailor: LUL
phtl_: alias l=ls :)
UltraScientism: @rootkn0x You should take the "Reading the stream title 101" course
SHAVEYY_: ANE example PogChamp
clearhunch: @submohanty "HoW dO i h4ck?"
submohanty: @clearhunch "Make a hack for the ps5 plzzzz"
TheAbdullahAmrSobh: Hey, I like your conversations with Lex's Podcast, Are you planning on making round 3?
garica111: is this a web design course ?
livebullsh1t: lol
borang: lol
johnleetran: Is the ANE for infrence or training?
Draco0x191: @garica111 I don't think so LUL
pepeega: yes, yes it is
clearhunch: @submohanty "Are you the guy that hacked .[insert playstation or iphone here]?
submohanty: @garica111 no, he's in university practicing for his final exams
UltraScientism: why is the aversion to file managers? Am I being inefficient by using them?
printhellosailor: @garica111 he's playing a video game
submohanty: what is alex wearing LUL
KrrSplat: lol
garica111: LUL LUL LUL LUL LUL
garica111: strange video game
corrosivecamel: Is she nekked again
shikharsharma: !github
teayoflow: @pepeega don't tell people not to write javascript if you don't understand the state of webdev GlitchNRG
shikharsharma: !dotfiles
clearhunch: He is actually doing surgery on a grape
submohanty: They really did surgery on a grape
Killedacow: omg its george kun
pepeega: world has too much webbed ppl
garica111: U want to tell me that this is a surgery and not a web design course ?
garica111: rly ?
pepeega: webdev*
TheAbdullahAmrSobh: Javascript can be awasome, if you use typescript
518m4: sloccount claims that this would take 2.33 person months to write this much code.
printhellosailor: has George ever played SHENZHEN IO?
clearhunch: @garica111 This is a web design course on surgery
clearhunch: 2birds, 1 stone
many_mangos: should I use up my twitch prime on this channel or is he already loaded from all that sweet, sweet VC money
livebullsh1t: termux or screen is pretty much usable everywhere
submohanty: @many_mangos george is actually homeless
pepeega: homeless with racks of A100s in his garage
many_mangos: @submohanty you might be right,every time he streams it's from a new location
CaptainSporkey: Are you doing cool things atm?
SHAVEYY_: @many_mangos if you say something stupid you get timedout instead of banned thats worth it
clearhunch: He is homeless and wandered into Alex's apartment, she just doesn't have the heart to tell him to leave and stop coding
many_mangos: @SHAVEYY_ good point I've had a few close calls monkaS
submohanty: Saying smart things in twitch chat Kreygasm
garica111: I think this is a wordpress for beginners course
submohanty: Yeah he just finished hello world a while back
zooooodiac: javascript is best cuz single threaded
borang: 90% chat is quality advice. pls follow it..
clearhunch: This is all just a hello world script in Rust Kappa
CaptainSporkey: refactor Start now
KrrSplat: Its ok George, just incur the technical debt like everyone else does LUL
livebullsh1t: u could run multiple js engine so ;)
clearhunch: Time to rewrite in Rust Kappa
pepeega: or you could just not use js
teayoflow: c compiled to wasm woud be best for webdev, good luck knowing how to submit a form though.
submohanty: George just write an AI that writes code for you it shouldn't even be that hard bro remember you hacked that game console bro
pepeega: I like that option better
CaptainSporkey: He is like the master of refactoring
geekmind2000: mango
pepeega: best solution to a problem is almost always the simplest one
livebullsh1t: js is useful for web dev tho
ilikerecursion: python indentation is straight cancer WutFace
pepeega: I don't care for webdev
garica111: He is the best that has ever happend to me in the last 2 years
teayoflow: @pepeega what do you care about?
clearhunch: So is html but I wouldn't call it a good programming language Kappa
pepeega: HPC
borang: hating on everything!
borang: ;)
twitchdeletedmyfknaccount: html is not a programming language
submohanty: I know how to code in HTML Kappa
livebullsh1t: I don't care much about not caring hehe
clearhunch: @twitchdeletedmyfknaccount That is the joke
SHAVEYY_: HTML &amp; CSS are turing complete dont bully
garica111: i can write AI robot in html
twitchdeletedmyfknaccount: ah
corrosivecamel: Hating on programming languages is so trendy rn
Killedacow: im an HTML prodigy
pepeega: true
SHAVEYY_: me :)
pepeega: me :)
submohanty: Redditors seem to love hating on PHP for whatever reason
twitchdeletedmyfknaccount: git blame
clearhunch: @corrosivecamel so in right now
I_am_paranoid: BibleThump
sativa2lol: NotLikeThis Keepo
afterworktech: it's only 1000 lines you can fix it haha
johnleetran: well, who wrote it?
pepeega: how many billions of dollars does a company need to write good code?
submohanty: many
teayoflow: 0 billions
caene: @johnleetran does it matter?
SHAVEYY_: @pepeega 2 dollar
pepeega: it seems highly dependent on the company
afterworktech: you need 1 geohot
b2kemann: Java is the only thing deserving hate
clearhunch: @pepeega That is a moving goalpost, so infinite money
jaxopie: SeemsGood SeemsGood SeemsGood SeemsGood
pepeega: tru
teayoflow: Facebook has the most billions an they went and made React soo..
alycia: whats the difference between python and html, legit question
jaxopie: jaxopie subscribed with Prime. 
livebullsh1t: managing code life cycle cost the most
submohanty: Guys I have my data structures final today guess what score I'm gonna get
SHAVEYY_: Java trying to force itself into the web was one of the most painful things ever
clearhunch: @alycia About 10IQ
SHAVEYY_: thank god that was shortlived
mozzart187: Thanks for the 2020SpeakUp @jaxopie
pepeega: nah apple has the most billions and theirs seems pretty good
printhellosailor: @alycia one of them is a programming language
twitchdeletedmyfknaccount: i dont understand devs that obsess over the lived experience of an obscure language instead of getting into languages at actually open up new worlds/opportunities to you
pepeega: I know someone that works on macos
UltraScientism: java is a solidly engineered language, compared to many. Its verbosity is actually a feature to some degree, for boring codebases.
submohanty: @twitchdeletedmyfknaccount elitism
clearhunch: @pepeega Billions for new coding languages, but 0 for documentation of it Kappa
b2kemann: Java
UltraScientism: @SHAVEYY_ It gifted us runescape!
many_mangos: is the openAI gpt3 gonna steal our programming jobs
pepeega: the problem with java isn't how it works on a technical level tho, it's the entire philosophy that's wrong
submohanty: I love how george asks us questions like we know
clearhunch: @twitchdeletedmyfknaccount I mean how many people stay in bad relationships
SHAVEYY_: @UltraScientism true
teayoflow: gpt3 can't be creative, im safe
b2kemann: Java is so bad
teayoflow: db/api stuff should be automated easily
many_mangos: @submohanty the scary thing is that somtimes some ppl in chat know the answer
pepeega: you'll hear people say that modern OOP isn't true OOP, and that's related to why java is so disliked
sativa2lol: monkaS
submohanty: @many_mangos We have some 5Heads in the chat
livebullsh1t: no idea. YOUR BIG FACE COVERS THE COMPILER MESSAGES :p
Impr0x: @many_mangos lool i was thinking the same
J_O_N_A_S: Is it just me lurking not understanding 99% of what's happening lmao?
clearhunch: I am not a five-head monkaS
submohanty: @J_O_N_A_S me neither
swsh: @georgehotz move yourself bottom right please, free real estate there
ilikerecursion: @J_O_N_A_S welcome to the club
Frans_NL: @J_O_N_A_S me neither
many_mangos: @teayoflow it doesn't need to be creative, it literally translates human english (any person could type the instructions in english) and it will build the app
twitchdeletedmyfknaccount: anybody got advice for learning ML? good resources?
submohanty: Just watch george's streams day and night
pepeega: pytorch tutorials
FileDotJar: google
jaxopie: Java is awesome. It pays my bills, something that whatever language that is hyped now wont do
livebullsh1t: tensor flow or pytorch tuto
clearhunch: @twitchdeletedmyfknaccount George has a video about that is called programming for noobs. He talks about ML in it
pepeega: in general when learning stuff programming, the official tutorials are really good
submohanty: @clearhunch that video is not for noobs LUL
teayoflow: @many_mangos it is limited to the data it trains on. For example, do you think GPT3 could design the new yeezys?
UltraScientism: @jaxopie It's also super fast and memory safe
livebullsh1t: run it in colab and Bob your uncle
ilikerecursion: javas reflection api is fun stuff
pepeega: well GPT3 isn't the right type of AI to design something right, you would want a GAN-style network for that
clearhunch: I hate the moderation settings, I keep getting cucked
gilga_m: Guys who don't understand, you will some day. I spent countless time reading/viewing things I didn't understand but it will come with perseverance
univ3rsz: george copy and pastes. thats the go ahead i needed
hiphopsucks: stanford's and cornell's lectures on ML are free on youtube and they are pretyt good, that's a starting point
livebullsh1t: the strength of gpt is the insane amount of data behind
many_mangos: @teayoflow no but you also aren't hired as a front end developer to create yeezys , you are hired to create a React app, which gpt3 can do monkaS
twitchdeletedmyfknaccount: how much full time study would it take for someone already experienced with coding to be "job-ready"? (I understand that it depends on the person, blah blah, just looking for a rough estimate)
pepeega: pytorch.org/tutorials
submohanty: Artificial Intelligence: A Modern Approach is a good book
clearhunch: Read a ML Paper, try to implement it, fail, cry, repeat
submohanty: @twitchdeletedmyfknaccount few months probably
ilikerecursion: artificial intelligence is bullshit
pepeega: lol, that's an unpopular opinion
SHAVEYY_: @many_mangos can GPT3 spend 40 hours trying to find the right color though
livebullsh1t: mebbe learns the models u can implement before doing tutorials
printhellosailor: ship it
submohanty: Hating on popular things Kreygasm
clearhunch: General AI is just a moving goalpost, like self driving
hajyand: @twitchdeletedmyfknaccount depends a lot on the job, some would require a low amount
UltraScientism: ilikerecursion &lt;- GPT3 bot
Jordan_diashole: @ilikerecursion 👎
pepeega: self driving is not a moving goalpost, there are clear goals and levels
twitchdeletedmyfknaccount: @hajyand yeah, im referring to bottom of the barrel, entry level job
clearhunch: George &lt;- GPT4 bot
clearhunch: Kappa
pepeega: it really is, as hotz says, a problem
not_into_gaming: back
uk245: is he using tmux??
xil333: what shortcuts do you use to switch tabs that fast?
tjobremannen: @twitchdeletedmyfknaccount just watch hotz video on how to make money :P
shanumbra: why his terminal is flashing sometimes?
gilga_m: My biggest mistake on my research project : the use of Tensorflow
livebullsh1t: would be nice to ++ the text à bit. damn tiny on a phone
teayoflow: @many_mangos I know those jobs will be taken, essentially the new age of CMS websites. But I design websites that a business developer couldn't think of.
clearhunch: @shanumbra Epilepsy check
uk245: @georgehotz are you using tmux?
many_mangos: @twitchdeletedmyfknaccount however long it takes you to follow this roadmap https://www.freecodecamp.org/news/2019-web-developer-roadmap/
submohanty: @shanumbra vim reaching end of line
twitchdeletedmyfknaccount: @many_mangos ML not web dev
dkrazey: Is geroge dating Alex?
livebullsh1t: looks à lot like termux
pepeega: it's terminal doing that, not vim
submohanty: @dkrazey no alex is his mom
dkrazey: Alex is his COO
teayoflow: I also don't use React anymore, I like javascript but not that much
many_mangos: @teayoflow yes you are right in the sense that GPT3 would require business owners to know exactly what they want, which won't be happening
twitchdeletedmyfknaccount: @tjobremannen is that an actual video? does he have a youtube channel?
pepeega: what are y'all talking about, what do you think GPT3 is
livebullsh1t: something feeded too much
livebullsh1t: wayyy too much
clearhunch: @twitchdeletedmyfknaccount DM'd you the name of it
korova_milkman: @twitchdeletedmyfknaccount Kaggle is better for ML
pepeega: it's for language, it's not an AGI, it's totally useless at almost everything
shanumbra: !dotfiles
teayoflow: I think GPT3 lowering the IQ required to make a wordpress site
pepeega: GPT3 does not have an IQ
dkrazey: @teayoflow are you scared that workers with iqs od 100 will be displaced?
teayoflow: a lower IQ person could make a site
dkrazey: @teayoflow with AI the IQ for any living wage job qwill need to be 130
pepeega: you can't compare GPT3 to human intelligence at all, it's apples and oranges
ilikerecursion: @teayoflow you mean patchwork a site
dkrazey: @teayoflow any Mcdonalds worker will now need a bachelors degree
clearhunch: IQ is also a shit metric
hiphopsucks: we've gotta be over 1000 lines now
many_mangos: I know some of those words
Korleone55: thoughts on CapsNets?
teayoflow: It's a good abstract measurement
printhellosailor: @pepeega more like animals and vegetables... humans are the vegetables
afterworktech: can we push George to 31k followers on https://www.instagram.com/georgehotz/ ?
guest1GRjBAYo: WEEEEEEEEEEEEEEEEEE WOOOOOOOOOOOOOOOOOO
dkrazey: @teayoflow what was your SAT score?
livebullsh1t: let's create gtp and give it the internet as data source
clearhunch: I swear 90% of people in chat are trying to get smarter by osmosis watching this LUL
not_into_gaming: they found him
ilikerecursion: merilyn monroe had higher iq than ainstein
teayoflow: I didn't go to college
hiphopsucks: monkaW
mrpentakills: will ,ai ever start an esports org?
SHAVEYY_: Apple police are here they found you trying to crack the ANE monkaS
miths: oh no the bug police
printhellosailor: they have backtraced his IP
clearhunch: Must be over 1000 lines, they coming
mucinoab: The covid patrol
many_mangos: @clearhunch i feel personally attacked
sativa2lol: run boys LUL
yetanotherlurker: HeyGuys did pytorch get bloated or something? what's the reason for tinygrad?
livebullsh1t: call assange
Nyt1k: monkaS
deadpool_reynolds: FBI open up!
sativa2lol: they coming back monkaS
not_into_gaming: DFF DFF DFF open up
Brainzman: casual airstrike on george's village
FDd2bfjN3mCYtkyNq8UVtyN6r: doesn't even flinch... autistic level zone
clearhunch: @many_mangos Just calling it as I see it. I mean I am definitely in that 90% LUL
many_mangos: @pepeega https://gpt3.website/ just read this
Brainzman: @fdd2bfjn3mcytkynq8uvtyn6r tbh every wednesday morning I have an alarm test in my city that sound exactly like that and I dont flinch
teayoflow: at it's best, gpt3 could just clone twitter? or some combination of sites, it wouldn't create anything new or maximally effecient.
teayoflow: If you want to make a dropshipping website I could see it taking that market
Apoplect1c: :)
Apoplect1c: Potatoes
clearhunch: @Apoplect1c I feel attacked
aldakata: this dude is coding fast as a demon and the chat is ranting about business strategies lol
many_mangos: as a youtube comment once said, he codes like how the movies think people code
livebullsh1t: we all gonna rip of tiny grade for commercial uses B)
clearhunch: @aldakata What just because my r/wallstreetbets aren't paying off I gotta come troll chats to find the next big idea
zennydmt: has anyone heard of sentdex
Barri10: Hye George, what do you thing about Cruise?
tsojtsoj: HEy, Do you know Dirty Loops?
clearhunch: 99% percent of people here don't know about them Fore loops
twitchdeletedmyfknaccount: rip for loops
many_mangos: my and my homies love using open source software for commercial purposes squadEZ
printhellosailor: `data = data`... is that actually going work as expected?
tsojtsoj: I mean dirty loops not for loops
printhellosailor: I don't use python enough to know
many_mangos: PogChamp
smurfd0: \o/
johnleetran: PogChamp
Draco0x191: PogChamp
afterworktech: hype
johnleetran: fore loop
printhellosailor: SeemsGood
afterworktech: where is hype train
MountainGray: lego
518m4: I've seen some four loops.
tsojtsoj: I ONLY USE GOTO
w3rk: loooool
pikkuuu: LUL
w3rk: it's also quite hard to follow you're fast as hell
ilikerecursion: nested for loop brrrrrrrr
afterworktech: only works on hot dogs
tsojtsoj: segfaults are opportunities
cswelin: Confirmed George liked
clearhunch: 100% of the time it works 80% percent of the time
cswelin: Likes to be tea bagged
dkrazey: They live together?
dkrazey: CEO and COO dating?
printhellosailor: LUL
shieeeeeeeeet: they're just talking past each other LUL
many_mangos: naw they just roomates
dkrazey: @many_mangos oh
bojosos: But Tom Dixon lamps are ugly
rucksackheiko619: ... and they where roommates :) LUL
ileno: is he running an ann thru the ane?
pikkuuu: PogChamp Rollex
w3rk: when apple runs ANE it just checks for segfault and if segfault run again D:
afterworktech: you mean ROFLex
hajyand: @georgehotz you can save 33+ seconds per day if you use an alias to git add, commit, and push in same command PogChamp
not_into_gaming: how many ops per seconds?
butich_ex: PogChamp
I_am_paranoid: PogChamp
darkandfullofterrors: monkaS
kaksoispistedeh: POGGERS
smurfd0: boyahh!
goldbattle: PogChamp
ileno: PogChamp
johnleetran: PogChamp
swsh: first neural net lib with only 16 size relu and random seg faults! Kreygasm
bojosos: But isn't the ANE only a tiny tiny performance improvement?
bg7kd94: Pog
Hiptin: Poggers MOM
afterworktech: the first expect apple was the first one to support it haha
menfie: Kappa Kappa
primitive_hacker: Look for an office in Salt Lake. I'm working as an engineer out here and have loved it. Super affordable
aknaveg13: oh no covid got hi
marschr: how about performance, how faster than GPU?
w3rk: first opensource library to support the ANE
Hiptin: Can i review your PR?
clearhunch: @primitive_hacker How is the pay?
518m4: How much faster is the ANE than the onboard GPU
yetanotherlurker: if we don't mention the occasional segfault
TheAbdullahAmrSobh: What is the ANE?
primitive_hacker: Whaaaa?
Hiptin: apple neural engine
le0n_: yoo
bojosos: Make tinygrad 1111 lines
518m4: I like the sound of benchmarks
dkrazey: kiss
twitchdeletedmyfknaccount: is that his bed?
w3rk: depends on GPU right lelel
tsojtsoj: Why are you using MODULO in the opencl kernel, is that really necessary?
not_into_gaming: yea benchmark it
desiero: Add this to you gitconfig. [alias] aa = add -A co = checkout ca = commit --amend com = commit -m m = checkout master st = status del = branch -D
univ3rsz: what tutorials do u watch to get like george
TheKoreanZombi: let's benchmark it and add its superiority to the Readme
not_into_gaming: bro it's a dsp
Brainzman: It doesnt looks like half of chat realize what a technical prowess being able to use ANE is
many_mangos: thanks for streaming boss man
TheKoreanZombi: do it
devdual: just do it
afterworktech: do it
hajyand: @desiero you can do it all if you make an alias in .bashrc/.zshrc
Hiptin: we'll watch
clearhunch: We just chilling
ilikerecursion: dont do drugs kids
many_mangos: like the other guy said we are just here to get smarter through osmosis. doesn't matter the content
bojosos: Change the requirement to 1337 lines?
Brainzman: the idea of ane being a global scares me
tsojtsoj: thats sounds like a genius idea, but adding the requirement that you need to have EXACTLY 1337 lines
w3rk: so relaxing
livebullsh1t: do some one liners and give it a day
tsojtsoj: Okay, should one parallelize all the data in one batch, when using the PU?
tsojtsoj: gpu*
printhellosailor: SeemsGood
madebyollin: what is "elif GPU" checking? isn't it always 1 in that scope?
smurfd0: then you create a tingrad_utils to utilse tinygrad? so tinygrad is still less than 1000 lines
teayoflow: gut duf
FalconStrikeer12: is george in NY?
WarSwick: no
not_into_gaming: sandiego afaik
madebyollin: Oh, got it. Thanks for explaining.
korova_milkman: everyone's leaving Cali and moving to Texas from what I hear
printhellosailor: that test is fake news
printhellosailor: it's not less than 1000 lines
teayoflow: is &lt;1000 lines the thing that makes it tiny?
tsojtsoj: Okay, I'm LEAVING now, but check out Dirty Loops!
tsojtsoj: bye
TheKoreanZombi: I'll be your roommate George but I get the bottom bunk
afterworktech: how many lines is it in machine code?
not_into_gaming: 4600 dollar per month for 1200 sq ft
not_into_gaming: rip off
Wopahopa: what's that in SI units...
marcelbischoff: wow
the_gilps: Nice work George
gomeygomeygomey: PogChamp
I_am_paranoid: PogChamp 1 relu
marcelbischoff: did it work?
TheKoreanZombi: I thought we were choosing a roommate from chat?
kingvoneduard: George must go to make money for the new home
not_into_gaming: 1 relu
moorewf: 90% of the time it works 100% of the time
afterworktech: don't forget to raid someone
supeerius: hi mr hotz
korova_milkman: Lana Lux is live
aknaveg13: RAID
supeerius: how are u doing
w3rk: @korova_milkman SIMP
FalconStrikeer12: if this works you need to do a 24 hrs live
sativa2lol: Kreygasm
TheKoreanZombi: size 16
fdfdfdfdfdfdff: if you all*************
I_am_paranoid: PogChamp official ANE support with segfaults
kaksoispistedeh: "you all" -&gt; "all you"
w3rk: gg boys, F to Hotz
butich_ex: PogChamp
supeerius: pls god no
supeerius: jesus
devoloution1: yasss queeen
marcelbischoff: how fast is ReLU???
kaksoispistedeh: geosimp
Crazypandaboy: actually cant stand pokimane
afterworktech: it's better to raid small streamers it helps them to grow
hey_its_lgg: pls no
ahahaitslit: who's pokimane
printhellosailor: @georgehotz SHENZHEN IO stream when?
w3rk: what's a pokimane
TheKoreanZombi: Which neural engine is Pokimane reverse engineering?
teayoflow: @TheKoreanZombi the male neural engine
hey_its_lgg: pick any programming or S&amp;T channel
TheKoreanZombi: @teayoflow So true. RE'd and rewired.
BRAINSPELL: chat dead viewers must be watching hentai streams by little girls
0xmilan: typo in readme
0xmilan: you all &gt; all you
teayoflow: melchizedek6809 is doing minecraft in c/lisp
UltraScientism: are we fast yet?
CensoredAlex: @BRAINSPELL how did you knew?
BRAINSPELL: cuz i was just watching little girls draw hentai
marcelbischoff: did he benchmarked ReLU?
I_am_paranoid: nop
marcelbischoff: ah fastness *not* confirmed
man_dos: why vi instead of vim?
I_am_paranoid: it segfaults LUL
whatsupdingdongers: sry what is that shell
TheKoreanZombi: Undocumanted feature
Brainzman: @man_dos vi is an alias to vim since 2010. its just to be faster
aksdjasdas: thats why its tiny
marschr: 16 elements is a hardware limitation?
devdual: nice
not_into_gaming: yea
Mabaet: george plz shoutout im fan
davidfassbinder: Hell no!
butich_ex: PogChamp benchmark
TheKoreanZombi: If 16 element relUs was good enough for the founding fathers it's good enough for us.
devdual: just ordered my m1 right now to test this :D
I_am_paranoid: PogChamp
gomeygomeygomey: PogChamp
hey_its_lgg: dope!
afterworktech: let's go
printhellosailor: lets go PogChamp
smurfd0: as 0xmilan pointed out, there is a typo in the readme : you all &gt; all you
sketchattic: let's go
aknaveg13: SeemsGood
FargioFarmani: PogChamp
name100015: u do it i watch
KrrSplat: KrrSplat subscribed with Prime. They've subscribed for 2 months! loggers
Brainzman: @mabaet i gotchu bro I yelled your usernamr in my street
aboudshehadeh: aboudshehadeh subscribed with Prime. 
afterworktech: and here we go 3 more hours lol
BRAINSPELL: print hello dream daddy
Crazypandaboy: what an animal
brbdontdie: how long has he been live?
Crazypandaboy: !uptime
afterworktech: @brbdontdie only 4h20min
teayoflow: ~4:20
BRAINSPELL: i'm just a good little boy who wishes all women would get a dream daddy
BenNastovski: Why is it daylight out where he is
primitive_hacker: encore encore encore encore
alnp1987: alnp1987 subscribed at Tier 1. 
Pager777: scam train PogChamp
afterworktech: nice train
butich_ex: scam train PogChamp
bojosos: That's a lot of change
youns688: POGGERS
stone43_: ....girls, and non-binary peeps
smurfd0: smurfd0 is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
smurfd0: smurfd0 gifted a Tier 1 sub to KraftLab! 
smurfd0: smurfd0 gifted a Tier 1 sub to exonex_osu! 
smurfd0: smurfd0 gifted a Tier 1 sub to okaynils! 
smurfd0: smurfd0 gifted a Tier 1 sub to publishcoffee! 
smurfd0: smurfd0's Gift shared rewards to 25 others in Chat! 
smurfd0: smurfd0 gifted a Tier 1 sub to komocode_! 
not_into_gaming: 16 limit
youns688: PogChamp PogChamp
afterworktech: wow @smurfd0
bojosos: Not a scam train anymore
teayoflow: huge hype
w3rk: why do you want to stop streaming?
not_into_gaming: look up google TPU
not_into_gaming: limited too
BenNastovski: What a guy
Qwertclyde1029: pog question
smurfd0: nah its coool. just christmas mood
BRAINSPELL: so what's your iq?
teayoflow: he'll give you the answer to motivation
gomeygomeygomey: @smurfd0 PogChamp from the lads who got a sub. THANK YOU PogChamp
neuromancer2: neuromancer2 is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
neuromancer2: neuromancer2 gifted a Tier 1 sub to lrnq! 
neuromancer2: neuromancer2 gifted a Tier 1 sub to xakerado! 
neuromancer2: neuromancer2's Gift shared rewards to 25 others in Chat! 
neuromancer2: neuromancer2 gifted a Tier 1 sub to DANKO_101! 
neuromancer2: neuromancer2 gifted a Tier 1 sub to data__love! 
neuromancer2: neuromancer2 gifted a Tier 1 sub to Vjasal! 
bojosos: key--board question?
Qwertclyde1029: OH SHITTTTT
Pager777: rooPog
afterworktech: @neuromancer2 wow :O
youns688: poggers
BRAINSPELL: how smart are you... are you a genius?
gomeygomeygomey: @neuromancer2 PogChamp NICE ONE
w3rk: ty @smurfd0
Qwertclyde1029: SUB TRAIN
Mabaet: heey y not me
Mabaet: im fan
fdfdfdfdfdfdff: George check pull requests &lt;3
bojosos: ANE go brrrrrrrrrrrrrrrrrrrrrrrr
Nemesis: hype getting relu PogChamp
BRAINSPELL: gomey from breaking bad.
printhellosailor: this isn't too bad
Farafire: Goodnight boys
BRAINSPELL: that guy rubbed me the wrong way
crakeenn: george i want to buy a new mouse for mi mac. can you recommend me one?
joker2k999: @Nemesis under appreciated comment right there..
FargioFarmani: @Farafire Please don't leave us.
CensoredAlex: dodge em PogChamp
teayoflow: hanawinsEeveehype hanawinsEeveehype hanawinsEeveehype
aknaveg13: SeemsGood
BenNastovski: Dudes got more live viewers than most TikTok lives lmao
BRAINSPELL: ask him if he knows any super leet rappers
BRAINSPELL: since he's a debutaunte
CaptainSporkey: Oh mate, it is so late in Germany. It is already pretty early again :D
Ihelane: sup guys! how u doing?
davidfassbinder: @CaptainSporkey Aber es ist doch Wochenende
CaptainSporkey: Ja
fdfdfdfdfdfdff: fdfdfdfdfdfdff is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff gifted a Tier 1 sub to football2442! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff gifted a Tier 1 sub to many_mangos! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff's Gift shared rewards to 25 others in Chat! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff gifted a Tier 1 sub to EatUrCarrots! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff gifted a Tier 1 sub to radon_90! 
fdfdfdfdfdfdff: fdfdfdfdfdfdff gifted a Tier 1 sub to lulzury! 
gomeygomeygomey: @fdfdfdfdfdfdff PogChamp
afterworktech: @fdfdfdfdfdfdff woooow
football2442: thanks!
fdfdfdfdfdfdff: PogChamp
NicoRTS: nice
radon_90: @fdfdfdfdfdfdff thanks for the sub
devdual: Thanks! @fdfdfdfdfdfdff.
Qwertclyde1029: OH SHITTTTTTTTTTTT
fdfdfdfdfdfdff: George my question is check pull requests &lt;3
Qwertclyde1029: OH SHITTTTTTTTTTTTTTTTTT
lulzury: @fdfdfdfdfdfdff Thanks for the gift sub!
Qwertclyde1029: lets goooo
CensoredAlex: PogChamp
bojosos: SirPrise
aknaveg13: Shish kabob!
th3_maj0r: lol
chemicalflash: Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1 Cheer1
the_gilps: hypeeeee
Qwertclyde1029: hype train shit
Nemesis: @joker2k999 i could keep retooling until someone notices
Nemesis: it's getting relu in here Kappa
tjobremannen: PogU
Pager777: the scam train is working PogChamp
printhellosailor: LUL
fdfdfdfdfdfdff: PogChamp my first pull request &lt;3
afterworktech: @fdfdfdfdfdfdff :D
fdfdfdfdfdfdff: Am i a programmer now
joker2k999: must still be on python2...
GerbilJay: @fdfdfdfdfdfdff congrats on PR!
Crazypandaboy: LUL
the_gilps: Yup
sw1jari: merged pr on tinygrad PogChamp
printhellosailor: @fdfdfdfdfdfdff where can I submit a pull request to fix the typo in your username?
bojosos: That's a nice PR
fdfdfdfdfdfdff: This is going in my resume
the_gilps: LOL
lrnq: @neuromancer2, tak for gaveabonnementet!
Ihelane: PogU
KrrSplat: lol
afterworktech: PR merge and gifted subs to George they will hire you 100%
Silensrunners: You are hexafast
MrBankster: what is this you makin bakin?
Qwertclyde1029: triple zipppp
printhellosailor: works in ruby, not sure about python
marcelbischoff: I think no
BRAINSPELL: anyone ever dwell in the apartment below two homosexuals?
davidfassbinder: triple zip should work, doesn't it?
marcelbischoff: apparently, yes
brbdontdie: Why does he like vim so much?
FargioFarmani: Tripple zip, even quadruple and quintuple zip should work.
marcelbischoff: Yep, zip(iterator1, iterator2, iterator3 ...)
Ihelane: any gifters in the chat?
PyramidBS: salute
dantusqq: D:
devdual: jizzus christ
butich_ex: WutFace
devdual: bless u
livebullsh1t: coronaaaa
Den_dp: bless you man
I_am_paranoid: WutFace
sangor: WutFace
aknaveg13: oh shish kabob
th3_maj0r: this was strong
fdfdfdfdfdfdff: Choo Chooo HypeBard
afterworktech: it's true
Pager777: monkaS cvHazmat
safetotype: because vim works, people shouldnt be dogmatic in their choice of editor
afterworktech: very nice hype train
fdfdfdfdfdfdff: 18 subs PogChamp
UltraScientism: @brbdontdie when you've invested so much time into being productive in it, you have to justify the time spent... LUL
Qwertclyde1029: that's pog content
brbdontdie: @safetotype I wasn't trying to advocate for a better editor. I was just curious
bojosos: What does * do?
BRAINSPELL: why is one paranoid.... do doors shut magically behind you?
livebullsh1t: open var
ZX10RSE: does he uses the Mac with m1 chip?
kefen1500: what he is doing
brbdontdie: @UltraScientism lol i feel that.
BRAINSPELL: the spring on the door shuts them automagically padawan
RealOden: once you're used to the keybindings you really miss them when you use editors that don't have them
devdual: @ZX10RSE yeah
UltraScientism: @ZX10RSE he does
FargioFarmani: Even septuagintuple zip woks.
RealOden: one of the best things about vim is that it's fast, no load times to open the editor or a file
livebullsh1t: and she'll friendly
safetotype: @brbdontdie if hes anything like me, vim offers good extensible and configurability that something like vscode gets real close to be but much lighter weight and works in the vim where im already comfortable
fdfdfdfdfdfdff: Yeah, my emacs sometimes get slow and buggy as hell in C++ mode.
safetotype: in the terminal***
fdfdfdfdfdfdff: its very very annoying
Qwertclyde1029: wtf why is python segfaulting
brbdontdie: @safetotype that's fair. I am really slow on vim, but I only know the basic vim commands so that makes sense.
lrnq: NotLikeThis
UltraScientism: @RealOden Actually VIM isn't fast, unless they fundamentally redid how it renders text. In the era of Celeron 450 it was quite laggy, and it was by design.
UltraScientism: That's compared to other editors.
marcelbischoff: can you trigger the ane with something else to see if it segfaults more often?
oskrM: also plz fix
oskrM: if you can
bubblesnot: Geohot works for apple now?
RealOden: @UltraScientism I was referring to the time it takes to open a file and the load times of modern editors but ok
gilga_m: Are vim and emacs working well with large codebase by working on multiple files simultaneously?
josalt: Hey everyone!
jmp0ut: opcodes easy enough to locate?
safetotype: @brbdontdie thats fair it takes practice , but the real advantage is in remapping keys, also a lot of good work is going into neovim making it a more fully fledged ide
gussyyy_: Why is he so smart?
brbdontdie: Does George use neovim?
safetotype: @UltraScientism vim is lightening fast, what is there exactly to re-render? vim is slow in search since it does index like more bloated editors do, but I find thats really its only downfall
teayoflow: George doesn't even use arch btw
devdual: benchmark it
bojosos: He broke the ANE
marschr: ane halted lol
josalt: oh no
UltraScientism: @safetotype haven't used it in a while, I believe that it's fast on modern CPUs.
safetotype: I like he use stock vim with a couple of edits https://github.com/geohot/configuration/blob/master/.vimrc
devdual: M1 rip
bojosos: So the ANE halts
amadandan12345: i will never understand why you're wasting your time with these menial implementation problems when you could be constructing new systems and hire people to create the components for you
RasitDenis: f
bigie: dmesg ?
deadpool_reynolds: reboot
afterworktech: pushing the limits
smurfd0: ruh ro, see if you have some process hanging?
afterworktech: no reboots
jmp0ut: memcpy errors?
smurfd0: camera frozen
josalt: Camera is frozen
Ihelane: F
binary_stream: killall webcam
FargioFarmani: F
afterworktech: yes camera frozen when you broke the engine
printhellosailor: @amadandan12345 because this is fun
Ihelane: door stuck
Galath_Thanatos: F
I_am_paranoid: NotLikeThis
amadandan12345: @printhellosailor it's a waste of time too
Proph1Y3: Image processing broke again though LUL
Wopahopa: camera broke
brbdontdie: @amadandan12345 Implementing these things is how you get to understand it better.
ShemBen: SeemsGood Kappa
I_am_paranoid: @georgehotz camera is frozen
deadpool_reynolds: he can speak without moving his lips, its magic
amadandan12345: @brbdontdie he's not doing this for the sake of "understanding", irrelevant point to make
bojosos: Professional fix
Galath_Thanatos: Pog
I_am_paranoid: PogChamp nice
afterworktech: ty
bojosos: How many can the CPU do?
brbdontdie: @amadandan12345 Then why is he doing this?
bigduddas: PogChamp
teayoflow: @amadandan12345 he's making tinygrad great again
TheKoreanZombi: So performant
amadandan12345: @brbdontdie me running might have the effect of improving my cardiovascular health, but that doesn't necessarily mean I'm running because I want to maximise my cardiovascular health
UltraScientism: will AIr overheat from the neural engine?
clearhunch: MTGA
amadandan12345: @brbdontdie what do I know
Galath_Thanatos: Thats a lot of relu's
binary_stream: whats a relu in this context?
printhellosailor: @amadandan12345 doing hard things you enjoy is never a waste of time
bigie: 11k relus as in size of relu input ?
P3droPL: @georgehotz Change stream title!
gussyyy_: What's a ReLu??!?1
puppy107: LOL
sangor: LUL
gussyyy_: Is it a Pokemon?
brbdontdie: @amadandan12345 then why are you running?
football2442: go relu
amadandan12345: @printhellosailor i never made a categorical about it being a waste of time, but certainly there are instances where you are wasting your time
Goodgulph: relu is max(x,0)
bigie: I wouldn't expect them to get even close to nvidia performance
amadandan12345: @brbdontdie to look good? for fun? various reasons
NicoRTS: @gussyyy_ x if x&gt;=0 else 0
bigie: I don't even know why layers are hardcoded in ANE
teayoflow: @amadandan12345 he could be playing cyberpunk
gussyyy_: hmmm
amadandan12345: i need to stop before i start a flame war in chat
devdual: better monitor temps :D
FargioFarmani: poor MacBook Air
QQ___bot: PogChamp
brbdontdie: @amadandan12345 I feel like the analogy doesn't apply here.
bojosos: The sky is the limit
printhellosailor: @amadandan12345 and you're wasting your time in chat right now LUL
sangor: PogChamp no limits
amadandan12345: no im blowing off steam, that's important to do
puppy107: what about tanh lol
QQ___bot: LUL
amadandan12345: @brbdontdie do you want to verbalise what part is disanalogous?
devdual: the cam broke again
bigie: yeah. cam froze too
jmp0ut: beat dat buffer
bojosos: The ANE halting problem
bigie: what does ANE have to do with webcam
printhellosailor: apple hardware has been known to fail from far less
gussyyy_: @bigduddas The ANE is IN the webcam
printhellosailor: total system failure when?
RasitDenis: ANEway, this is better then it px
gussyyy_: So the webcam breaks
devdual: this cam is mad
QQ___bot: Froze again LUL
goldbattle: TTours
I_am_paranoid: killall python and webcam freezing are related
teayoflow: it breaks the webcam every time
FargioFarmani: F
tjobremannen: TTours
RasitDenis: f
deep5: TTours
oldschoolfantastick: HeyGuys
tjobremannen: TTours TTours
printhellosailor: new stream title: "Destroying my apple laptop"
TheKoreanZombi: I never thought I would live long enough to see this many ReLUs/sec.
deadpool_reynolds: now we know he is not reading the chat
angrywhopper: The sun's still up ? Whoa. I've been in the dark for 4 hours
brbdontdie: @amadandan12345 If I am understanding you correctly, your claim is that he is programmming tiny grad and at the same time he is developing a better understanding, but that doesn't mean he is trying to understand.
FargioFarmani: George speaking without moving his lips monkaS
bubblesnot: “Apple laptop destroying itself”
KrrSplat: killall breaks webcam chat
bubblesnot: It’s stuck like he is mid fart
jmp0ut: console up down camera
New_Wizards: frozen cam?
teayoflow: @brbdontdie i think his argument falls under "stop doing what i wouldn't do"
SHAVEYY_: the OBS camera is controlled by Python?
marschr: ANEgate lol
bigie: 16384 = 128 x 128. that's nothing
jmp0ut: 4^4^4^4 easy
brbdontdie: @amadandan12345 I can only think of 2 practical reasons to code for several hours. To monetize or to understand. If I am wrong feel free to tell me where.
bigie: 128 x 128 can run MNIST perfectly
not_into_gaming: camera is froze
bigie: it's leaky relu but in forward pass LUL
safetotype: can you put the camera to the right so we can see the output
jjjjjjt8: i think cam frozed on purpose
jjjjjjt8: oh its not mb
devdual: any reference regarding the performance like what can the cpu do?
darvein_: cool
brbdontdie: @teayoflow his initial point was that he is wasting his time. And that he should focus on other projects, so I am inclined to agree with you.
brbdontdie: he being George.
mighty_arm: pshaw, I only measure in GigaReLUs
lulzury: need to revert commits until the line count is back to 1000
bigie: make tinygrad.ane a separate library. ez
lrnq: this is a disgrace. will remove star right away
SHAVEYY_: ^
desiero: call it ReLuHertz!
Denis0109: why not 60fps today? is the internet bad?
devdual: upvote for ReLuHertz :D
bigie: why do you have .cuda() ? apple doesn't have cuda does it ?
RasitDenis: I want to watch you, but I don't want them to know who are you.
safetotype: ReLu'RUs
teayoflow: Rectified unit
Qwertclyde1029: wait
fdfdfdfdfdfdff: so ANE is a scam?
Qwertclyde1029: hold up
Den_dp: KEKW
UltraScientism: It should be the other way around LUL
sangor: PogChamp damn
Qwertclyde1029: LMAO
fpsjuicestus: kekw
gussyyy_: wtf?!?!?1
bigie: LUL oh no
2ndsll: lmao
afterworktech: wowo
Qwertclyde1029: HOLD UP
gussyyy_: I'm so confused
Qwertclyde1029: scammaz?
bigie: good choice :)
goldbattle: wait what
marschr: 6M of unstable ReLU/s
printhellosailor: so tinygrad is the fastest python framework now? LUL
fdfdfdfdfdfdff: Time to return that pink laptop George
sangor: PogChamp 5 megarelus with segfaults
afterworktech: 16 core what
RasitDenis: LOL
bojosos: How is GPU so much slower?
gussyyy_: Can you return the laptop?
mighty_arm: what's an ANE?
kraazyivan: 16 cores of nothing
gussyyy_: I'll return mine right now too
devdual: well...
cleariychillin: lolz
mucinoab: lol
babaquon: apple stocks plummeting
I_am_paranoid: BibleThump
bigie: wasn't 50% of the GPU surface supposed to be dedicated to ANE ?
smurfd0: that makes .... eh sense
sangor: LUL
RasitDenis: take a coffee
marschr: 50% of the time it works everytime
afterworktech: call Apple for support
Pencode: KEKW
dungeonmaster3: is the segafult on assert fixed?
printhellosailor: LUL
Keyeh: scammed
gilga_m: That M1 is fast
bigie: 6 MegaBrokenReLUs LUL
elias_javidan: hey bro
herkulesschmidt: can someone tell a stupid person like me what ane stands for?
sangor: apple neural engine
FargioFarmani: apple neural engine
printhellosailor: you need to account for the time taken by segfaults too
ゴンザレズ: so, basically ANE space... better put more cores there?
herkulesschmidt: tyty
MatheFischer: @herkulesschmidt apple neural engine
mighty_arm: ty @sangor @FargioFarmani
Denis0109: will you buy taylor swift album?
goldbattle: why is the gpu worst?
sangor: LUL
2ndsll: whats ane?
Pencode: that's probably why it's so hard to access the ANE lmao
gussyyy_: wtf
bigie: ANE has LUTs. is that why they're very broken ?
gussyyy_: I'm disappointed
lrnq: probably cause LOC got over 1000
smurfd0: ... hmm ... and then the idea with the fudging ane is.. besides it beeing a separate engine
bojosos: 10 MegaReLU-s?
MountainGray: brings up the question why it exists
afterworktech: minor refactor for another 5 hours of stream :D
hey_its_lgg: guys whenever you encounter a term you don't know, google it
printhellosailor: how much of the time is taken my the ANE and how much is python overhead?
joaomacp: what's the GPU?
not_into_gaming: ANE is edge AI device
Qwertclyde1029: POG
fpsjuicestus: @2ndsll Apple Neural Engine lol
Nemesis: the relu... so hot right now WutFace
hey_its_lgg: in that case ANE = apple neural network
sangor: PogChamp 10
SHAVEYY_: PogChamp 10 MegaRELUs
Pencode: poggers
2ndsll: nice ty
afterworktech: go faster
I_am_paranoid: BibleThump 10 MEGAReLUs
ksizzle888: @georgehotz why are you trying to make molasses faster.
mighty_arm: algorithms Kappa
UltraScientism: doubled
teayoflow: just wait till the M2 comes out with 32 neural cores
MountainGray: shows how slow the apple ml functions it runs
Pencode: 11 Pog
sangor: PogChamp 100% improvement
Denis0109: maaan that escalated quickyl
SHAVEYY_: benchmark the GPU vs ANE
bojosos: M2 is going to be at least 50 MegaReLU-s
not__awful: 666
fdfdfdfdfdfdff: Take the mac back to apple and ask the genius bar why you're only getting 10Mega ReLUs
gussyyy_: hahahhaa'
afterworktech: it's going to blow
TheKoreanZombi: Doubt that the CPU can double in efficiency with a small re-factor like that.
afterworktech: don't push it George haha
teayoflow: Watch it hit 1 million Mega ReLUs
printhellosailor: profile the time on the ANE
smurfd0: 12
bojosos: Nice 2 Mega ReLU-s btw
Denis0109: george should stream with amd pc and arch+dwm. Then the real work can begin
hey_its_lgg: g2g, everything under &lt;100 ReLUs is not worth my time :P
SHAVEYY_: :(
elias_javidan: does george give lessons on how to program ?
brbdontdie: You got 11
afterworktech: 1 64 core Ryzen Threadripper for 1 geohot of compute
musashhhi: @elias_javidan $1000/hr
fdfdfdfdfdfdff: can we start a gofundme to build george the best Mac Pro possible?
Denis0109: yeaa, geohot needs supercomputer
not_into_gaming: the problem is the models must be compiled specifically for the ANE
I_am_paranoid: ctx is killing cache?
deep5: PogChamp
SHAVEYY_: 30 PogChamp
deadpool_reynolds: cool
johnleetran: PogChamp
bojosos: 30 PogChamp
goldbattle: PogChamp
sangor: PogChamp woah
fdfdfdfdfdfdff: PogChamp
drdislupo: what does this stuff mean
afterworktech: damn
elias_javidan: @musashhhi bro we are in the america sanctions we cant pay
SaffronBrick: i have no idea what is going on PogChamp
UltraScientism: tripled Pog
I_am_paranoid: BibleThump 30 MEGAReLUs
lulzury: time to remove the prints
aknaveg13: What is RELU???
Denis0109: ryan reynolds would be proud of you
MountainGray: apple stock rebounding
TheKoreanZombi: catching that unoptimized gpu
SHAVEYY_: faster?
bigie: Imagine apple sold this as a separate thing. we have Apple Neural Engine Kappa
elias_javidan: what is relu ?
gussyyy_: It's a Pokemon
afterworktech: can we beat the CPU?
gussyyy_: It evolves to MegaRelu when lvl 100
bojosos: But the prints will only be like a single MegaReLU
lrnq: I was here when it was at 5 mr/s remember the moment
I_am_paranoid: relu =&gt; https://en.wikipedia.org/wiki/Rectifier_(neural_networks)
yetanotherlurker: catJAM refactor
Den_dp: f
deep5: F
AppSumo: f
teayoflow: Apple geniuses shutting it down
KrrSplat: f
johnleetran: f
sangor: f
715209: f
bojosos: F
deadpool_reynolds: rip
uduver: Georg Hotz sounds like Georg Ots.
goldbattle: f?
SHAVEYY_: F
FileDotJar: f
clearhunch: f
elias_javidan: bro gives us some programming lessons plez
akadrac: f
afterworktech: what
SHAVEYY_: Apple got here
I_am_paranoid: F
bojosos: ANE broke the laptop
dkffks: F
TheKoreanZombi: define, define
marschr: Hi Tim!
kaksoispistedeh: F5
gussyyy_: F5
fpsjuicestus: F
afterworktech: kernel panic?
W1lkins: saved
UltraScientism: we are dropping frames
deep5: saved
AppSumo: kill the webcam for the next test?
goldbattle: back?
mighty_arm: Guru Meditation
afterworktech: wow
deadpool_reynolds: smell like burn
elias_javidan: bro give us some programming lessons
johnleetran: i think he bricked his mac
bojosos: That fanless little ANE
KrrSplat: 1k chrome tabs = no ram LUL
aknaveg13: whats relu for noobs?
elias_javidan: he doesnt read chat : /
I_am_paranoid: LUL java
afterworktech: is it laggy?
Rex_Sicarius: LUL
SHAVEYY_: it must be Java instead of your 5M tabs 4Head
fdfdfdfdfdfdff: laggy for me
herkulesschmidt: sorry an ignorant question once again: what's the point of the ANE if it's slower than the CPU by a factor of almost 20? isn't this the use case it's optimized for?
thorfindyo: yeah lagging
goldbattle: powerpoint presentation LUL
johnleetran: very laggy here too
bigie: it's back
afterworktech: pushing the limits of the M1
715209: LUL
UltraScientism: LUL
KrrSplat: LUL
UltraScientism: what kind of decompiler is that?
not_into_gaming: ANE is apple neural engine
sangor: LUL
bojosos: Ghidra so heavy
kaksoispistedeh: @UltraScientism ghidra
JalapenoSD: You have 8 ? :O0
SHAVEYY_: can you upgrade the RAM on a macbook or is it soldered onto the board
thorfindyo: how much nvidia 1080ti can get of relus/s ?
teayoflow: always soldered
marcelbischoff: it's on the chip
AppSumo: it's built into the M1 chip
elias_javidan: bro gives us some tips on how to design programs
teayoflow: oh right
clearhunch: @SHAVEYY_ New ones are integrated
UltraScientism: hmm I thought ghidra's gui was written in C++ on release...
not_into_gaming: stream has crapped ot
darkbouls: @georgehotz what's wrong with safari, doesn't it run well on a macbook?
not_into_gaming: clipping
dan_chess: Isn't ane used by the webcam to optimize the image quality?
brbdontdie: LOL
Stegosaurian: couldn't you pay extra and get the 16GB model?
UltraScientism: more print statements!!
Azermite: What do you think about pytorch?
SHAVEYY_: do C instead of Objective C 4Head
printhellosailor: does mac support KSM?
AppSumo: I think killing the webcam will speed it up during testing
bojosos: Test pytorch MegaReLU-s
thorfindyo: how much nvidia 1080ti can get of relus/s ?
not_into_gaming: Models -&gt; Pre-compiler -&gt; ANE
Evilleo: bruh do you even hyperfine
afterworktech: having low spec hardware makes you a better developer as you need to conserve your resources
bigie: they're gonna use this in the next keynote. ANE capable of more than 30,000,000 ReLU operations. woww
elias_javidan: how you design your programs and algorithms ?
clearhunch: "can give use at least 1Mrelu" Kappa
clearhunch: us*
smurfd0: lol "only segfaults sometimes"
stone43_: lol, that means you can optimize your code to get more ReLU's if the print statements don't affect it.
SHAVEYY_: delete the comments 4Head
teayoflow: not so tiny grad
elias_javidan: how you design your programs and algorithms ?
lrnq: CPU ranging from 197 to 600+ xDDDD
bigie: 30 Mega Faulty ReLUs with the maximum size of 128 x 128 Kappa it's great
SHAVEYY_: yes
sangor: yes LUL
bojosos: Do some ANE convs
715209: LUL
mucinoab: Yes
devdual: whats the point of the ane than
elias_javidan: bro how you design your programs and algorithms ?
davidfassbinder: is the average number created by only one second? would it make a difference to average on longer time?
Pencode: LUL
bob_babyelephant: whatsup
zennydmt: is the apple m1 better than an i9 9900k?
primitive_hacker: i have one
not_into_gaming: nah you're doing it wrong
I_am_paranoid: maybe if you put whole NN into ANE it will be faster than CPU/GPU?
primitive_hacker: how do i try it
printhellosailor: if mac supports KSM or some kind of kernel page deduper, he can probably save a few GB
TheKoreanZombi: We are at the bleeding edge
marcelbischoff: isn't the first compile measured in the time?
smurfd0: waiting on my...
dan_chess: Turn off webcam for testing(?)
IoTPanic: Worse, but at what power consumption?
clearhunch: FeelsBadMan
devdual: any ane memes?
not_into_gaming: I have ANE
IoTPanic: Its a DSP
SHAVEYY_: speed up ANE 4Head
alnp1987: I’ll try tonight
KrrSplat: I have one but don't know anything about this shit
Pencode: someone should try with the 16gb model
bojosos: How is that going to happen?
SHAVEYY_: can you do all that and keep it tiny?
teayoflow: @dan_chess the CPU/GPU benchmarks were the same conditions
elias_javidan: bro would gives us some lessons on how to design programs ?
bigie: even if it is gonna be faster, it'll be faster for all 3 devices
stone43_: Is the benchmark in the remote repo?
printhellosailor: unplug webcam
printhellosailor: 1 unplug
bojosos: What if the ANE is slow because of the power on wait?
Pencode: segfault KEKW
revenantrazer: where are you rn?
Stegosaurian: when was the last time you wrote some java code?
elias_javidan: broo would gives us some lessons on how to design programs ?
Quint1nat0R: But what's the benefit of ANE?
clearhunch: LOL
not_into_gaming: nah, he doens't know to use it yet
mighty_arm: they should sell a 6 GPU core one for $500 Kappa
teayoflow: can you make an accelerator now?
marschr: you mean share tensors on ane + cpu + gpu on M1 or general hardware?
clearhunch: Thinking about trading in my i7 mac mini for a m1 air, probably worth it
bigie: Lib? DansGame you mean Libe
Pencode: probably more efficient in some cases
printhellosailor: how much of that time is on the ANE and how much is overhead in the native+python wrapper?
DnKr0Z: worth ti
AppSumo: performance per watt isn't bad though?
Quint1nat0R: Quint1nat0R subscribed with Prime. 
node_storm: I'll try it when Apple releases the 16in M1
tsojtsoj: What even is the bottleneck for neural networks? Compute or Mem-Bandwidth?
afterworktech: M1 comma2 coming soon
pantameeera: "tinygrad will always be below 1012 lines."
smurfd0: you set some nvram thingy
mighty_arm: infinite wait for a Macbook Pro refresh that isn't garbo FeelsBadMan
bojosos: Blue Bottle Guest wifi?
aknaveg13: SeemsGood
clearhunch: Idk, my mac mini is basically a brick I don't use might as well use the 500 dollar trade-in to get a m1 chip air. Just sucks dealing with apple without being able to go to the store due to christmas
60_FPS: ane is used by apple for cryptomining
Pencode: ^this
bob_babyelephant: Are you gonna stream till Advent of Code?
desiero: their new headphones have M1s
marcelbischoff: train is 7 blocks from blue bottle, lol
mucinoab: Pls stream you AoC
clearhunch: @bob_babyelephant I would doubt it, I don't think Geo has streamed it this year
mighty_arm: Cryptomining LUL proof of work is dead, long live proof of stake
Pencode: has he started aoc though?
IoTPanic: Not using github dark mode?
lulzury: the recommended way to reduce the line count is to revert commits until LOC &lt;= 1000 again
clearhunch: @Pencode I think he is top 20
pantameeera: "tinygrad will always be below 1012 lines."
AppSumo: remove all spacing
tsojtsoj: Does anybody know if it is even worth to use multiple CPU cores to train a Networks?
IoTPanic: Github dark mode was worth them breaking a bunch of CI stuff on the first day.
elias_javidan: bro would gives us some lessons on how to design programs ?
TheKoreanZombi: @elias_javidan No. Stop asking.
thejakesummers: HOW U CODE?
tsojtsoj: WITH FINGERS
FileDotJar: i code in spanish
RichyK1: vim
not_into_gaming: ANE is looks like great piece of tech
printhellosailor: should have made it 1024 lines
lulzury: you code very carefully
not_into_gaming: Well done to inventors
afterworktech: how should be banned word
printhellosailor: what kind of number is 1000 anyway
stone43_: 1K instead of 1k
elias_javidan: @TheKoreanZombi im not asking you
afterworktech: 999 seems reasonable
elias_javidan: TheKoreanZombi
stone43_: that mostly works
realMcKay: No
afterworktech: no
TheKoreanZombi: @elias_javidan Go read a book
Quint1nat0R: Lol, this makes me feel bad that I just bought an i9 macbook pro...
smurfd0: go with "less than gazillion lines" for next project
SHAVEYY_: yes
Crime_Stein: yes
bigie: no
Allanxster: nope sorry
elias_javidan: @TheKoreanZombi books are shit
teayoflow: 1024
lulzury: exclude lib from line count
smurfd0: no
Landepbs: &lt;1337
SHAVEYY_: but you have to rename it to largegrad
FileDotJar: its called google @elias_javidan
mucinoab: 1024
printhellosailor: 1024 lines
iluxx182: Is ANE more energy efficient?
TheKoreanZombi: @elias_javidan So are your questions
fdfdfdfdfdfdff: you cant go back on the SACRED PROMISE
node_storm: yes
elias_javidan: @ so are you bro
FargioFarmani: on
SHAVEYY_: delete the disgusting GPU 🤮
clearhunch: No
node_storm: there are no rules
KrrSplat: 1024 is very comp sci
lrnq: NO
FargioFarmani: no
realMcKay: where does the fluctuation and Sec Fault come from
lrnq: will remove star
elias_javidan: @TheKoreanZombi so are you bro
fdfdfdfdfdfdff: you said "tinygrad will always be below 1000 lines. If it isn't, we will revert commits until tinygrad becomes smaller.", not "If it isn't, we will extend the maximum line count"
bojosos: Convs tomorrow?
printhellosailor: can we rewrite it in another language?
TheKoreanZombi: @elias_javidan How to program bro?
printhellosailor: LUL
Allanxster: you said "tinygrad will always be below 1000 lines. If it isn't, we will revert commits until tinygrad becomes smaller.", not "If it isn't, we will extend the maximum line count"
marcelbischoff: agree
pokeballzs: What’s the quick and skinny on what tinygrad is.
pokeballzs: Sorry, a noon here
printhellosailor: SeemsGood
Keyeh: simp
SurfCat: lol
elias_javidan: @TheKoreanZombi bro if i know i did not ask
aknaveg13: @georgehotz Play some CYBERPUNK 2077 and chill SeemsGood
sangor: LUL
Allanxster: she had 70k an hour ago opening pokemoncards
afterworktech: lol
bigie: LUL please don't
elias_javidan: bro gives us some tips on how to program ?
iluxx182: loool
tsojtsoj: lol yes
deep5: oh no george
teayoflow: 10% raid
AppSumo: well done George
Pencode: LUL
tsojtsoj: Theyll be scared of all the nerds
I_am_paranoid: LUL simp
devdual: n1 have a nice day
clearhunch: "A little bit of work" Kappa
mighty_arm: no adblock
mucinoab: raid dunkey
SHAVEYY_: yes
rraksut: &lt;3
bojosos: M2 will be at least 100 Mega ReLU-s
Nemesis: Keepo
Crime_Stein: advent stream tmr?
Allanxster: she had 70k an hour ago opening pokemoncards
lrnq: online for 5 mins
elias_javidan: broo gives us some tips on how to program ?
kaksoispistedeh: 2 more lines, best i can do
ksizzle888: lmao she just got a to raid ain't getting noticed now
elias_javidan: bro gives us some tips on how to program ?
s___t___r___i___x: wtf pokimane host? o.o
revenantrazer: do you play amond us
phrixus_bro: phrixus_bro subscribed at Tier 1. They've subscribed for 9 months, currently on a 9 month streak! nah
elias_javidan: bro would you gives us some tips on how to program ?
thorfindyo: why
thorfindyo: who cares about pokymane
3310: MY QUEEN 😍
elias_javidan: we care about programming
I_am_paranoid: BibleThump ignored raid?
Stegosaurian: LMAO
bob_babyelephant: did he forget to end the stream?
mucinoab: PokPikachu PokPikachu
bob_babyelephant: lol
Master_Atom: Turn your stream off we can still hear you lol
s___t___r___i___x: George tryna slide in pokis dms cause she clearly doesnt need the host XD
jjjjjjt8: bro
jjjjjjt8: turn off
Stegosaurian: did he forget to turn off the stream lmfaooooo
SNIPERNOOB: forgot to turn off streaaaaaaaaaam
mighty_arm: in before banned
FargioFarmani: very private
butich_ex: TURN OFF THE STREAM
bob_babyelephant: bruhhh
stone43_: he forgot
ShemBen: Kappa
bob_babyelephant: GEPOOOOO
jjjjjjt8: brooooooo
jjjjjjt8: no
elias_javidan: we need to go
desiero: lol he forgot
bob_babyelephant: WTF
bob_babyelephant: lol
let's go let's go let's go that's all i
would do the whole time
let's go to my channel here no we need
the chat yeah let's pop out the chat
we need the chat let's pop out the chat
all right
good morning good morning everybody good
morning this stream
is brought to you by water
all right the mic's a little loud let me
turn that down let me turn the gain down
a little on my
blue yeti microphone which i learned by
the way
uh is not a good microphone for rap
but maybe we're gonna buy a good
microphone for rap
uh so that's something we can look into
today on this stream but that's not
really what we're here for
uh we got stuff to do
no what happened to my mic does this
have history
can i get my safari history on my iphone
i googled it last night yo
we'll wait for people to get in here but
i got something boys
oh history history history
how do i find history
oh yo what's up we've got a sandwich
sandwich you look at i wish i had a
sandwich
um safari history on
iphone open the safari app
top the book icon at the bottom of the
screen
pull down the history menu how do normal
people use this thing oh here we go
things i googled last night demi
lovato's overdose and ambien
uh this yeah
yeah it's a tlm-102
so apparently this is a much better
microphone
uh for rap and i should buy one
what up fam we got viewers
ah not amazon.com can i buy a tlm 102
yeah
oh look here on prime i can get it with
a shock mount do i need a shock mount
i don't know if i need a shock mount
um i also need an interface
it's a shock
quality microphone shock what well i
mean this just seems like a bundle scam
you know
doesn't seem particularly
yeah honestly if you're here for a while
though i hate waiting
don't they know i hate waiting do i want
a black one or a nickel one
like nickel nickel
it's not a free mic cable that's a scam
i can get the
um all right
um and i also need a
scarlet 2i2
yeah this thing third gen usb auto
interface with
pro tools which does it come with pro
tools
people know i don't pay for software i
do need a
cable says okay oh that's a reasonable
price for a cable number one best seller
all right
perfect all right i think this shit
is going to take my rap to the next
level what do y'all think
uh i assume this thing can power
microphones i can do like phantom power
power
no external power required like i just
don't know if this power is a microphone
i don't know
let's just google them together and see
what i get
tlm 102 wow not that
this map is a this mic is amazing the
raw rap and rb
okay plus i'm working with a focusrite
even without proper soundproofing give
your voice a little bass
um so i think this guy just plugged it
in
oh he bought the shock mount do i need a
shock mount
that looks pretty pro don't you think
it's like a special one made for it or
you have the scarlet you like it wait
you like this shore microphone better
oh i've seen these yeah i don't know
um actually i think a shock mount would
have fixed one of the bugs on one of my
songs
but i don't know if that's worth it
like why is this one so much cheaper
look i can buy one from egg snow
what do people usually buy with this
see that shows a picture with a shock
mount
this includes the stand mount
i have a pop filter i have a pop filter
on this mic you guys are always
complaining about my sound quality we're
about to take it up
a notch what's the best multi-purpose
condenser microphone
cheap crap because people are poor you
know my thoughts on
that
wow a good shock mount looks very
expensive maybe i do want to buy it with
the shock mount then
it's shock mount mt but this is a cheap
shock mount or is this a good shock
mount
how am i supposed to know
oh well a lot more people bought this
one instrument condenser microphones
here we go
no i know the audio's fine look it's not
for you guys man it's for my rap career
you know
you know how you guys want to buy
keyboards because you want to be better
programmers but like the problem is
actually
you know your programming ability see
like i can't rap
but if i buy a 800 microphone
it's going to make me a better rapper do
you see what i'm saying
you all understand i good as long as i'm
on the same page here
that's a lot of good ratings i don't
know does this one have good ratings
oh this one is even better ratings wow
and it comes with a case
wait that looks like it comes with a
shock mount
no it doesn't though oh it comes in that
box
i don't have a picture of the box with
it i don't know i shouldn't be doing
this on stream guys i just you know
uh i just i just got uh got a
uh
yo but okay cause i just dropped a new
song this morning i went to the studio
last night in la
uh you know
you guys
[Music]
did my new song
check it out my soundcloud
[Music]
we're all gonna die now we're all gonna
die now
keep crying your heart out
we're all gonna die now we're all gonna
die now
it's obvious stories make up history
[Music]
where is the world from where will the
world go
we're all gonna die now we're all gonna
die now
crying your heart out we're all gonna
die
now we're all gonna die now
off the train right here
i'm not gonna get banned this is
literally my song i have the rights to
it doesn't stop here
[Music]
the anymore is all in place we can watch
the future fade away
these last five years have been a blur
of growing up
and being honest with yourself about the
world
you cannot change and if there's reasons
for still trying or just hopelessly
embracing the decay
and like we all went in the studio and
screamed
crying your heart out we're all gonna
die
now we're all gonna die now
keep crying your heart
out we're all gonna die now
we're all gonna die now
uh do i take modafinil i mean i have
but i hate you guys want to talk about
drugs man
wait so do i no the interface is fine
what do you mean the interface doesn't
really matter
um
do i need this shock mount i don't think
i do well i'm not gonna
shock mount what does this even do why
do i need a shock mount
uh yeah so everyone you know check out
my song on soundcloud yo give me some
likes on soundcloud
give me some give me some views on
soundcloud yo
yeah you know i want to be famous rapper
when i grow up
and uh
um oh i see
is those is that oh no that's the same
shit i'll just buy it out
oh cool
retired hacker yo you know how my
stream's always brought to you by drinks
this stream is brought to you by water
look at that water it's brought to you
by water
now that's the light it's brought to you
by lemon spin drift
yeah well i bumped into my desk you can
actually hear it on civil war
um and it kind of i didn't like that in
the recording
all right uh what else do i need i need
like a desk mic stand
that seems good
that's gonna that's gonna be sick with
my shotgun all right cool
uh oh man i did this in this in safari
we'll order this later but yo we got we
got some fire all right i'm on a
shopping cart i can get midwest
um the song's called die now
uh yo i was in the studio with some mad
talented people
like you know how like i got pregnant
skills these people got music skills man
you know i love skills man i've always
seen skills and like
but yeah make sure make sure you give me
likes and views on soundcloud uh
i appreciate you and you know always uh
if you want to see more streams
subscribe to the channel
i was feeling a little poor this month
so i decided i'd come back
on twitch and stream for you bros
all right i'll be back and go do
something
all right brush
imagine that sound no as a sigma studio
man
yo big head on the beat because mad
chill
all right there's nothing here to talk
about today
uh you should have listened to my sound
and
my my song and you should all like me on
soundcloud that's true but that's not
here we're here to talk about today
we're going to talk about tiny grad um i
don't need to maximize this i can
minimize this i cool
i need to look at myself uh
this guy reached out to me on linkedin i
know linkedin is a cesspool it's a
complete yo i read something on hacker
news this morning about linkedin
and it like summarized why like linkedin
is full of like degenerate bullshit and
how you can like phone linkedin by not
giving a fuck
and that's the truth man you want to be
famous on linkedin
go on linkedin and like just you know
you know how some people get face tats
i said i wasn't gonna do rams today you
know some people get face tats to make
themselves unemployable
like just go on linkedin and like talk
about how you're gonna use it as a
dating platform
you know that's like the modern face
tats for that different kind of career
right
like you can get face tats and work at
starbucks you know
certain type of people can't work at
starbucks right that's
that's all i'm saying you know what i'm
saying so how do you make yourself
unemployable in the modern era that is
commitment because
you're putting your stake in something
you know
ah
why do i stream i forgot that i hate all
of you
okay so
are you guys familiar with tiny grass
i'm on the risk branch right now uh so
you know risk is the like i think that's
a good name for if you're gonna make ai
check like risk architecture is gonna
change everything
right and it's a risk chip like i got a
risk card you know it's like risk like
the board game
um and like our slogan is risk
architectures and change
everything i think that would be i think
that would be a cool uh i don't hate all
of you man only sell me all the noobs
man
if you're a subscriber i like you more
than the other people so you know
subscribe and i just like you more
all right um yeah i think like that's a
good slogan like risk architecture is
going to change everything
i think about it i think about a lot of
times well so fucking video
right and like here's the problem with
the ai space right when you look
at there's training accelerators and
there's inference accelerators
all right and let's see if i can all
right we'll use data to prove my point
um market for training and
inference ai
like i saw a graph um
yeah it's like this kind of stuff right
i i saw an even an even more brutal
graph of it but
the the problem is in ai the
edge market the inference market is
projected to be larger than the training
market
uh so every little fuck with an ai chip
company
builds these edge chips right like you
wanna see some little fucks with a with
an
ai chip company it's like oh it's the
google coral
oh what's the new one hey leo hey leo ai
oh the world's top performing edge ai
processor
you know what the problem is nobody
wants to build training ai processors
right like tens torrents another one of
these
um yo but jim is cool and don't count
him out man
jim's a cool guy and like look i you
know this is this is like what we're
talking about i'm like yo you got to
make
pcie cards for sale let's get notified
all right my name is george hotz
my email is geohot gmail.com my
organization is comma ai
i want to buy card
i buy card when you
make buy it now button
all right cool um yeah because we got to
have like buy now buttons because this
is like a coming soon but at least it
has a price
and that is key
uh but either way also fucks are trying
to make
edge ai um because they look at this
graph
and you know because everything's like a
financial asset today
uh here we go look
oh there we go oh strategic u.s oh look
the ai
inference market's bigger than the ai
training market so we should all go
after the inference market it's also
easier would you believe that easier
market and bigger but what you're not
taking into consideration is that
there's a hundred fox making
little inference chips that nobody wants
and
there is one making
training chips i mean all right you can
buy 100s if you're a sucker
or you can buy 30 90s which are like
a100s but but cheaper
um sorry athena everyone knows it's true
uh well you can't actually buy them
because they're out of stock everywhere
but
hypothetically if you could buy them
they are great training cards
and they have these tensor cores i spent
a little time just taking some notes
on uh nvidia
and how these things work right so
they're
3d matrix multipliers um the original
tensor core on the volta
could multiply two four by four matrices
in one clock cycle
so you know four by four matrix is going
to be um
that's 32 flops i think right
is that not actually that's not right
hang on
let me work it out uh no so it's
multiplying two four by four matrices
four times four times four it's four
cubed right said
cubed for matrix multiplication that's
one of the questions i asked so it's 64
uh fmas and then that's 128 flops
uh per per cycle
so then the a100 has these bigger tensor
cores
and they created this cool data type
called tf32
and my theory is tf32 is all you need
for
anything and we're going to have to
confirm that theory
but if you're going to make a training
chip i would make it natively support
uh tf32 which is a 19-bit float
or 19 bits home i'm going to fit in my
rent you're building your own ram bro
like you don't have to you got to think
outside the 60 the 16 and 32 box
you know
um
so yeah i would use this tensorflow
and then i like i like nvidia's uh
like a lot of companies are putting 2d
arrays on their chip
um you know we can we can add a few
notes for the tesla chip
so the tesla chip is a 96 by 96.
i mean like tesla is pretty good about
it
here
oh i didn't realize there were two npus
on that's pretty cool
someone chap
yeah so it's interesting um
something to look at is like how many uh
tops per watt
so these are around the two helios
claiming three
uh but yeah so this is like what it
looks like
96 by 96 array
uh and then to figure out i think that's
just 96 squared is that number right
yeah cool and they have 128
mib of sram what's an mib
what is it mib that's going to be men in
black isn't it yeah
um mib versus
mb
maybe bite
oh that's a scam
everyone knows a megabyte's actually
that you know
words aren't what people say words are
words are just whatever people use
that's weird
i don't really get why it looks like
that but
um either way yeah this is the tesla
uh chip has 64 megs of vessel so
the chip
um
so we'll have four slots and like the
four slots so you can do
like input weight
output
empty and then like on the next one you
can put like the weights here and
this becomes the input
this becomes the output and this is
empty right
like so on and so forth so then like
this becomes the input
i don't know like it kind of like cycles
around but you see what i say
so if you have four slots you can
continually do matrix multiplies
uh so the thought what does it say 16 by
alu 16 by 32 by 32
alu
so 16 times 32 is 512. there's another
32 is 168.4
so this would actually be
uh three two seven six
eight flops at one gigahertz
that's uh that's like that i like that
yeah uh equals uh 32 tops
now the question is um
how much faster will this card train
than nvidia
i think one of the missing keys on a lot
of these cards
is that you can't access the sram in
like a fully strided way
so let's write a little uh simulator
for our risk processor i've already
written my risk map mall instruction and
then like we're going to write a matmal
wrapper which is going to uh
uh be able to multiply
big matrices instead of just the ones
that fit in my tiny
actually it's not a no it's not okay i
said this wrong
this that's the aou ah
yeah so the guy i've been working on
this with he's uh
i shouldn't really say anything about
him i don't know if he wants to be on my
stream
mentioned on my stream but you know i
can mention fake stuff yeah he knows a
lot of stuff about like how to build
these chips and it's cool
um so my job is to figure out how fast
this is actually going to be
and one of the cool things about tiny
grad is it makes all that easy so that's
why we're back in tiny
i don't know man i got my song stuck in
my head you know keep
crying your heart out we're all gonna
die now we're all gonna die now
uh so like i mean this is what i was
looking at so far
these one by one calms
all these papers are coming out now
where people are using visual
transformers
and like a visual transformer is just a
weird way people reinvented confidence
um and then like the convents have these
one by one columns which are just a
weird way that people reinvented like
you know dense layers kind of
it's a dense layer but you weight share
across like the x and y dimension and
obviously across the batch dimension
so you can see that here
this doesn't even work with multiple
batches
uh and then the other thing that we have
to do is we have to get these like
okay so do you guys understand what i
mean by a fully strided sram
it's like i can do things like load
address
stride x and
stride why
uh and then stride x is gonna be
this is the 16
stride y is the 32
i think we'll have like registers i
think we have to have registers
and instead of registers i can just have
like it loads like the input to the uh
let's say target so i can load like
into the uh the alu or
into the matmal engine um
it seems like targets include
uh
map mall input
map mall weights 0 to 16
map mall weights 16 to 32
and alu and like maybe permute
all right so we got five targets so
that's gonna require uh
three bits we could probably fit three
bits we can fit three more
um so okay the idea is to build an
accelerator that works with tiny grad
now
building an accelerator that works with
pi torch is really hard
and a lot of these companies have done
it but they've done it through
translation layers and translation
layers are never really going to be fast
they're also never going to be
upstreamed so you have to like install
some custom
shitty fork of pie torch to use their
thing and you know it's just
nightmare right but if you're using tiny
grand
like i don't think it's that much harder
to code things in tiny rather than pie
torch
and it's also much easier to add
accelerator support
right if we can support these 14
operations um we should be able to
to not just uh do inference on neural
nets
but also to train neural nets and that's
another key thing about this strided
stuff like
you don't really care about an access
that looks like this i mean okay so you
can imagine like so this is a load 512
right
it's loading 512 elements and all these
things are elements so it's uh
you know all in elements
uh aka t flow 32.
so each of these when i say 512 i don't
read 512 bits i need 512 of these floats
right so like you can imagine just a
load 512 that doesn't have these strides
and that would have to load contiguous
from sram
but if you have two matrices and you
want to multiply them
well this only works if they are
oriented in one certain way
you're going to have to like
pre-transpose your weight matrix right
but if you're doing
a normal matrix multiplication which is
like this row times this row
you're going to have to access stride it
uh so i i think that this
instruction is key
and obviously the save works the same
way
and you can apparently do this this
apparently doesn't add any cost
except that you need a different address
decoder for each of these 512 elements
which costs a little bit of power but
totally worth it
well you got a the different types of
hardware ai accelerators i mean i might
be talking shit i don't know that much
about this space
can i buy any of these like i can buy
that microphone
oh no this is stupid
what's a vpu this is a marketing term
it's not a real thing i mean
oh oh it's not a graphics question
there's a visual processing unit
um there's this fpga that uh
let me see actually i should i should
add this note
it's a call like this s5g
fpga
they make this cool pcie card
yeah this one
that's my stupid name for here we go
so the idea would be to implement on
this card
and if we could get a 30 chop unit on
this card okay
so the other idea is this so these
instructions
instead of when you look at like the
apple mpu which i was looking at it uses
um
it has almost like a custom dma engine
and you have to like
poke registers and stuff the idea would
be to design a processor
that has these instructions right and
then you can use all the normal nice
these are processors
like you know pipelining and look ahead
and whatever whatever
so this would be a risk 5 processor that
just has a bunch of extra instructions
yo we're getting likes on the song we're
gonna get likes oh we're getting likes
we're getting likes
fire sir yeah we gotta get likes
we gotta get likes and views on the song
let's go everybody chill a song
um who is tom cruise
tom cruise is my rap name
with two zeros that's inspired by
james dean with two e's i was originally
gonna be tom cruise with two
o's but my friend was like bro
zeros and he was goose goose with two
zeros
that's a cool name goose with two zeros
um yo typing test you're lucky you're a
prime subscriber i'd ban you right now
um
okay
well so actually
so
right
all right let's just like implement this
in like a stupid way though
before x and
uh
address
ah so we have like outs of i
equals estrogen sub address
address plus stride
why i can do it
let's first work on getting a map
working
all right so this is like effectively
what the uh what the load looks like
you guys see what i'm saying right so
it's like that's like the this is the
load instruction
i should just write this
actually maybe i should just write in
like stupid way like this
actually so it's not really
this
i can't just write this can i
okay if we're really making a simulator
for this processor we have something
called
sram
plus i mean
yeah that's gonna be mad stuff
i really want to just put that in target
i i mean i could write this like whole
door
5 12.
really we won't like the same target
right
and they're like registers if we're
really building a simulator for this
machine right
um okay i want
was it a reg file
anything
yeah cool
okay we have to come up with these
targets so
target map input
how do i do a python
it's a real class
[Music]
seems good right
uh now we have to make the reg file how
do i
iterate to an enum
um actually i could do this
and then not do that
does it work like that in python
let's not be running that code uh
okay let's let's refactor this a little
put it in extra
extra we'll call it risk.pie
so we're building effectively a
simulator for this architecture
um
okay so
and then we want to test the map so
let's say something like
uh yo we're doing test driven
development boys
uh all right tests python
unit test you know you think i should
like know how to do this let's just read
this
i don't actually know how to program
it's all i
keep your heart out
we're all gonna die now we're all gonna
die
now
test driven development boys
okay um we're gonna create
two random size arrays let's say
something like
repeat out random
uniform make them like random sizes
of course we want to multiply them the
inner dimensions have to match
all right then we can say something like
uh okay we also have risk dma
which is something like
[Music]
right
i'll get a v-type on here so they're not
should be uh
note why why would anyone ever want to
alright so i'm just gonna
um through a certain
test it let's make some like stupid like
unit testing but this isn't there
and keep testing this
oh actually these things go and risk map
mode
instead of writing wrist construction
we'll just say risk i
oh how we doing yo yo keep the likes
coming man keep the likes coming
crying your heart out we're all gonna
die
now we're all gonna die now
keep crying your heart
[Music]
stories make up history
they take up all your time and then they
manage your decline
you keep crying your heart
out we're all gonna die now
we're all gonna die now
no no i gotta we're gonna the stream
needs a moderate amount of pasta
oh what is that unmatched shit
uh okay
uniform got an unexpected argument
d-type
not broadcast bullshit
put array
but
printed our prints two why is it two
is that not what mp oh this is like some
other stupid parameter isn't it
oh size
that's fine
uh all right like something's just not
working oh cause that's returning none
um
all right let's just
let's make a quick function called
slot equals lambda x
x
when i was talking about the slots
before i mean it's just an abstraction
you don't actually need it
but uh
wait dmar
and dmaw uh so this is read from the ddr
and this is right from the ddr
keep crying your heart out
uh we have to know the size and the size
is going to be
x dot shapes
shape
mp.prod
um
yeah we're building a risk processor man
risk architecture can change everything
boys
all right so as you can see my map moles
of course uh doesn't work
um because we didn't actually write any
mammals
okay so we've dmade uh
copy uh matrices
[Music]
it's not spelt right is it
matrices into
sram copy back
from sram uh do
mammal okay
so
i'm glad you liked 5 a.m in silicon
valley yeah i'm excited
27 have never grown what do you mean you
have at the top and you're less alone
all the pressures in the headaches you
wake up and feel great
nah stagnant put the shit when you're
over two minutes late
if you used to make fuck fat people when
you feel like overweight
i sort of feel like i'm out of place
yo you know i say don't be poor also
don't be fat
you know like i don't know who's telling
you the shit's not in your control
but it is but you don't
understand i'm poor if you don't
understand that while they stop doing
those things man
that's the truth that's the truth who's
saying the truth these days
batman that's who's saying the truth
where's batman
batman tell the truth batman probably
has like political
considerations to take into
consideration
don't be mean like it's not like don't
like doesn't give any excuse to be a
dick to somebody because they're fat or
poor but like
i'm talking about you as an individual
taking responsibility for your life
yeah motivational shit yeah
um
you know i've been i've been like not
fat but i've been more overweight and
like you know man
you just like why you know you gotta
like start eating better man
you know stop eating like pasta and
drinking sugary drinks and shit you know
but that's what i do i don't know man i
don't know just don't be fat
and have skills and don't be poor
those three three damn if everyone just
follows
three pieces of life advice
uh no i'm just making a chip for fun
boys i'm making a chip for fun you know
hey look if tesla makes a chip don't you
think congress should make a chip should
make a chip
ah okay
all right um you know what let's start
with something easy
let's start with matrices that are
16 32 right
and then we should be able to just do
this one by hand
oh that's not right
um
now it's not even return it's out equals
that and then what we want to say is
oh
i'm not thinking fourth dimensionally
and now we want to say risk i store 512.
we'll store it in slot 2.
oh we need strides
here i don't know i'm not zero sorry let
me just add defaults for the strides
uh oh so this isn't exactly right
this isn't actually what i want
this is what i want
despite that probably being insanely
slow in python
we'll deal with writing a jit for our
cpu later
seems good
hmm
i'll get it that should be okay
let's play the h stack wrong yeah
we got that v stack look the test passes
boys
we did it
oh this is kind of anti-climactic it
just passed
[Music]
uh i didn't set a timer for pasta which
was kind of sad there's nothing i think
about
it like i don't know i think it's done
that is crunchy don't carry crunchy
pasta
no puncher i'll take her
that's you know it's healthy
hmm
yeah this tiny grad is going to run on
an asic
but we first have to simulate the asic
i think that's t-mucks
but they're really the same program
how we doing on soundcloud likes i love
likes because they give me validation
you know oh man 37 likes wow we can get
some more likes on here
let's go let's go boys
um yeah we're gonna make an fpga first
and then
um delicious
twitter took away my food check mark
fuck twitter
so
okay
now let's make it work with weird size
now
uh
a tiny round is the perfect amount of
glass
um
we need some counters
all right well let's first get big
mammals working and we'll work on some
instrumentation
okay
now we have a special reg file called
zero copying that from risk boys
no it's eating time we got likes oh man
we got likes we got we got three replays
yo let's go
let's go this guy wants some free cheap
um the inner loops of your loan store
could just be one-line slice assignments
i believe so yes
if you write that correctly
you'd have to like get the right reshape
i mean i can also make an
argument like we could say that you put
like stridex times stride y
times 32 here
we might actually want to do it like
that
and then i think i can do it with one
liners
that's what's like yeah
no maybe that's not what i want should
we just make it a 32 by 32
and then everything's one one or two
four
anytime i actually need 16 it could just
be easier to think about i don't like
the asymmetry
all right and like we have like weights
low and weights high
i don't really like that
that's small wait no it's larger than
tesla's
it's considerably larger than tesla's
tesla did 96
by 96.
i mean i just don't like thinking about
it like it's asymmetrical you know
i mean the other thing we could do is
make it 16 by 16.
maybe eight tops
i don't know this is what the this is
the the guy i'm working with suggested
like he knows a lot more about hardware
than me so maybe there's some reason
that like
it can't be bigger but i hate it so
we're gonna we're gonna change it to 32
by 32.
it's like a big 32 by 32 matrix
multiplier
all right just because i don't want to
deal with the asymmetry and i don't want
to deal with these
stupid two map always
i don't want to deal with the strides
being different i'm not doing any of
that
i keep the programming model simple
sorry hardware people we keep the
programming model
simple
1024 oh that's a nice number you know
get rid of this stupid h stack
this is the kind of thing that's very
cheap to do in python right now but like
we'll actually not be able to build that
hardware
well but that's gonna be a wild amount
of flops you know
64 tops
like now it's symmetrical which is nice
and like the two strides represent the
same thing just i just fundamentally
like
so
i gotta remember that i don't do it for
the people what did all what were all
those people saying man
useless people
i see a lot of people got timed out
raffles me
fuck off man you know people like you or
why
i don't stream you bro
no but it's like it's not worth my time
right like that's the problem
uh
smart people are quiet yeah
all right
okay so our mammal engine now only
supports
a 32 by 32 matrices right our map mall
our mammal
call but this is something like um you
know this
will be
compiled to risk
five that's the instruction set risk
five what do you think ah so like now if
i like break this and i like make it 33
oh we're done done
that's more than tesla isn't it
yeah they're running their mp use of two
gigahertz
like the question is only like are we
gonna be able to actually like saturate
that
gas
it's even stupider when it's these like
one by things
for us to be using this like super
powerful uh
thing
it's like yeah look at this one by one
cop right like it sits
that kind of stuff is gonna fully
utilize it
i think it becomes a lot that
that first one is multiplied by batch
size two so for training this is going
to be less of a problem
i wouldn't even help like the weight
matrixes
we also need the mammal instruction
needs to take in a
mask
i think we could at least use less power
i should just do the hard work of
supporting things that are
not uniform yeah okay fine
we'll go back
i hate that though it's like loads and
like the weights the high and low
that's so slow you know
sorry
because this would make the data path
how big
1946 is that like too insane
that's how many bits it would be
that's just like way too many bits
i don't know
maybe not maybe it's just like one
does anyone know this
going thank you for gifting a sub if you
give to sob you can ask a question
that many mlps
i mean 32 by 32 might not even be a good
choice
i just don't like the idea of like the
weights and the input being
different they really should be like the
same
thing
like has to like you have to do two
loads you know to like
the number of loads per mammal goes up
you explain what the matrices are um so
neural networks uh at the core
are basically just matrix multiplies and
non-linearities
so
yeah it's just the matrix of matrices
that you multiply for
for neural networks um
they have like stupid names for them
like what's a multi-layer perceptron
um but that's what the matrices are so
if you can build an engine that
multiplies matrices quickly
uh you're most of the way to building a
neural network
accelerator chip
i don't know
32 by 32 on the map malls
maybe that's right
donut central you didn't get the sub
why do you get to ask a question
yeah i don't like you know stupid and
video with their asymmetrical crap
we could potentially also go down to 16
by 16
which would give us eight tops per core
these people are doing the image
transformers
they made some that were do they make
eight by eight
all right let's just assume we're doing
um
let's go through it we can't we can't we
can't dwell forever on this decision we
can always change it later
but this is easier and you know we're
kind of trying to keep it simple
that's probably the best way to do it
okay
[Music]
do i have my x and y's backwards i think
i do
okay borax in range
all right so how do i write this how do
i write this tiled matrix multiplier
let's think about it okay oh so
the other thing too is i actually think
we want this to be an accumulated
let's do a target i'm gonna call them
rank
right because they're effectively
registers like now that we've made a
move instruction if they're definitely
registers
uh so first we're gonna move into the
output we're gonna move
zero
um and then we wanna like okay so think
about what matrices are right we got
like this one to chop through and this
one to chop through and then we store
that up there
so
okay uh we have mkn
let's just make these capital mkn
and i can iterate through with mkn
uh so we're going to say four range
uh should i not push type 32 everywhere
and it's kind of parameterizable
for n in range and
size for k in range k
size
okay so we're going to do
this is where we're putting the move
zero
this is where we're putting loads and
mammals
and then this is where we put the store
keep crying your heart out
we're all gonna die now we're all gonna
die now
uh okay so i think that that's
not right i mean we're gonna okay
well we know that stride y
is okay when you think about the layout
of these matrices
k is m
by x is m by k y is k
by n
that's true
okay so for stride y then we want
big k
and then if we have a
ah plus k
plus m times k
i think that's right
remember slot one
it's k by n so we have
k times n
plus n and then
our stride y
is going to be uh
n i think oh is that right
and here we're going to save it in m
times
n plus
zero
doesn't work okay
uh
oh oops
wrong
all right let's just small let's just
print these out
hmm that's not right
oh no this is definitely not right uh we
want to add k
here is that right
no so it's k by n
if we're iterating through k we want
k times n is that right
we want k times n
plus n i want that
yeah is that all right it worked
that's wrong but we're getting closer
most of the numbers look kind of right
to the store i got wrong
um
isn't all right
okay so we march across there we march
down there
we're multiplying them we're
accumulating that oh
i don't need that i mean it actually
shouldn't matter but i still made it
going down there
that's right and we multiply like those
two chunks
accumulate and those two chunks and
accumulate it those two chunks and
accumulate those two chunks because
they're just okay and then you know we
store that out in
m times and plus n
that's not right
you guys see what i'm doing wrong
i don't know how a debugger is going to
help me like i don't think the python
code's wrong
is it possible not zeroing it out
my zero broken
or do i have something fundamentally
wrong in my algorithm
we're striding y by k and over there
we're striding
by n which is right and the x's just go
across
okay uh you know what's cool
i think for size we can just just make
this four now right
that's gonna take forever but um
i should actually be able to like look
at them and like think about reasoning
on this size right
um see this size four and i'll just make
it size two
okay now make sure to apply right okay
cool
[Music]
um
there's nothing storing to those
possibly wrong
oh damn it
i forgot my stride in my store
oh
that seems like just numerical error
let's say our tall e minus six
cool
let's try ss4 we're doing before 256
so that's eight
cool we're going to up our size back to
32. great
yeah matrix multiplication don't try one
that's
uneven size
so
filling points are terrible
gingy jtag thank you for for moderating
how many viewers we got we got a lot of
viewers
it's a link to my soundcloud
[Music]
get honest with the likes boys
um all right let's just write something
quickly
to track these
okay python
you guys think i know how to program i
just google it every time how do i write
a decorator
fox tools
another thing
give me some underscores
what
it's gonna take forever
six power this is a one or two four by
one two four matrix
i'm going to figure out how quickly it
uh multiplies it
eventually
all right so it's point
we can do one or two fours by one or two
fours in
that many us
is that good i don't know if that's good
well that assumes no pipelining also
but it seems every instruction just
takes one cycle
which isn't exactly true
excuse an ultra second it's a
micro second well why did they just use
them
because milli already took it
do you guys know science
who knows science
y'all who wants chicken tenders
or tea or recess
yes the rest of the stream is brought to
you by
recess you want to drink soda that costs
five dollars a can drink recess
all right who wants to pick some weird
numbers
so
47 is a weird size 19
is a weird size 19 is a we know well
shouldn't be 19.
79 and 12.
i shouldn't do 12 42. all right good
it doesn't work yet
so like we have to like mask things
i like the idea i think of using masks
more than using padding and ram
because a lot of people like using
padding and ram and then like you have a
bad
time
like you're just like oh why don't we
just make sure that all the major shoes
stored in ram or 32x32 and i'm like
you're like
dealing with that forever
it's using masks mean you ever wear a
mask on your face
well you're needy but if you put masks
like oh sometimes that's good
oh blanket
oh blankets nice who else likes blanket
all right let's just like make a few
more parameters for these called like
let's say like when why
so they're not really masks they're
lengths
yo you're sick of listening to this song
yet
nobody that's right she's just doing
repeat all the
[Music]
your time out we're all gonna die now
we're all gonna die now
keep crying your heart out
we're all
stories make a mystery learn them all in
school
[Music]
where is the world from and where will
the world go
they take up all your time and then they
manage your decline
we're all gonna die now we're all gonna
die now
keep crying your heart
out we're all gonna die now
we're all gonna die now
off the train right here for a minute
[Music]
we can watch the future fade away
these last five years have been a blur
of growing up
and being honest with yourself about the
world you cannot save
[Music]
i think if i do that i don't need a mask
on it because the rest are zeros
yo you know why it sounds good because
big head and manzo produced it
this one sounds good
yo if you think those are double vocals
try like
7x vocals apparently this is what you do
you just stack the vocals a ton of time
that's a little peep sound is so good
stack them a ton of times stack them
stack the vocals
oh we can't do that
um yeah the only the low needs to do
that all right
and then actually you know what's cool
i don't need zero anymore and i don't
need move anymore
don't need to get rid of move instead of
move we'll just do a load
into mat mall output slot
zero but we'll set the length
y oh no you can't make them zero never
mind
i'm sure moving will someday be useful
it's a good function to have
which have a zero register that's cool
the reason that you can't put zero in
for those length parameters is because
i'm going to encode them as five
bits in the instruction
actually i don't even know i want them
to come from registers
damn it maybe i don't
if you see what i mean if you can uh if
you mask
on the loads and stores i don't even
think you have to mask on the
on the matrix
let's produce my big head boys
yes
um
this is right isn't it
i mean it's gonna be very slow but
doesn't work
normal even doesn't even work anymore
which doesn't really make sense oh first
off this shouldn't be 32 we should have
any 32s it should be sized
okay uh okay minus k
what is that ever wrong
what see that looks okay to me
like they're literally all 32 why
doesn't it work
can i break the old one
boys what did i do
oh oh shit
okay we shouldn't break that one anymore
uneven ones don't work
they should work though
oh um no
all right let's go back to tiny size
and let's try a three by three
well actually let's do one more test
small doesn't work
a little small work
um
i understand why small is multiple
matrices
it's not that small let's make a size
all right what exercise is four does my
exercises two
why not
seems right
who talks like that increases
productivity
like i'm some industrial revolution ass
machine
you know who talks like that
your mama teach you how to talk like
yeezy taught me you know that song
yeezy taught me yeah who taught you how
to talk like that
he's asking noob questions
um mine's work
yo the other thing we're gonna do who's
sick of seeds being wrong
there we go that's a good seed 137 is
the leaders seed
some of you all don't know the one two
three seven and that's elite seed
somebody'll try and use non-lead seeds
what's wrong what'd i do
what i do
okay if i'm multiplying a 3x3 matrix
it's really the same thing as
multiplying like four by four matrices
that just have zeros right
is that wrong i'm making a wrong
assumption here
okay zero zero zero zero zero two
oh what's wrong
okay we're loading that from there we're
loading now from there that's good
and here we load this from here and
here why is that loading
one into y
okay we load these two
into here you'll make this easier
why don't i use normal matrices
there's a pretty cool matrices anything
okay
cool
i said how we're loading 3 4 which is
not right
do i want to be loading there
now i'm loading minus seven
okay so what do i wanna
it's like accumulating in the top row
right
place your designs on paper first right
paper yeah all right
is there anything else i want to
accumulate yes
there is
this top chunk
it's chalk wrong um
okay reload those two
and then all right what i want to load
there is three and six and when i want
to load there
seven and minus eight so maybe this is
backwards
or maybe i shouldn't be guessing and
should be thinking now but guessing so
fun
thinking is less fun
three six seven eight okay that's what
we want
probably got the store on the hotel i
don't exactly understand why this is
true
but you know easy talk
easy talk all right cool
why think when you can guess
i think it is overrated guessing on the
other hand
guessing is for winners yeah
guessing is for winners that's when my
call is coming
guessing is for winners
we just guessed and then it worked um
let's try y stride x
yeah who knows we guessed and it worked
love guessing it's for winners i heard
all right so now we can do uneven
mammals small
map models and even map models wow this
is this is a pretty good
this is a pretty good thing this is a
pretty good thing we got going on here
you know this is a pretty good uh a risk
processor
like look at how few instructions it
used
whoa whoa this isn't a branch this is
not part of official tiny bad
i wouldn't defile tiny bad like this
um and there's definitely ways to write
like code like that efficiently so
even though the python's not that
efficient there's definitely ways to
write it efficiently
all right cool guys we can do map malls
now
in a proper model of this processor
all right now we just have to implement
everything else
can we put three by three columns using
this instruction set
huh
we don't actually need fully strided
we should have a function called
transpose
which transposes the internal matrices
actually i could probably do it with
just the map maul instruction you know
i mean i find it interesting that like
all my stride x's so far have been one
if we can make stride x always one i
think that's helpful
i don't really know why but i think it's
helpful
interesting is those things don't
necessarily have to be parameters to the
loader
though it probably is less power if they
were
we're still doing the whole matrix
multiply every time which also burns
power
we can always make it smaller but
cool
pretty happy with that as today's stream
what else we got we got non-stupid
question time
but yeah you get kind of where we're
going with this with this machine
um so this is like risk five codes so we
can like write other things
like we can write comms in this language
we can figure out what we want our our
basic uh
things to be i don't know i feel like we
still might use stridex
so let's not count stridex yet anywhere
risk five
shall we should call the instruction set
yeah yeah risk five
all right cool i'm sold i'm sold may i
feel
assault you still have that vip check
mark so you know you get influence
if you run this on an si5 machine if
they
better yeah
um
all right
here we go nobody's gonna go out with me
what do you mean you know like
numb check skills flow hunting skills
computer hacking skills
girls only want boyfriends who have
great skills
there you go okay does that answer your
question about what skills are
well i'm sorry but you should pay more
attention
i've got an xv6 with xv6
unix version six
it's a book can i get the book
but why is the book
why don't they make a pdf
oh yes just do they have releases
how do i convert it to pdf on windows
i have to i have to make this book
hey fine fine do they want me to work
hard i'll work hard
let's go let's make a book
yeah man take that da vinci or whoever
made old printing presses
you you had to like when you oh well
okay never mind i take it back i don't
have pdf latex i got i gotta
i just gotta brew install my printing
press here hang on hang on you gotta you
gotta move your movable type sets you
know your little
little shitty letters yeah
gutenberg that's the guy oh yeah da
vinci yeah
i knew it was oh never mind i can't make
a book
oh brew cask install mac tax
oh that sounds like it's going to take a
really long time brew install basic tax
all right that sounds faster
oh you found it online sweet
what up boys you know you can't ever see
the keyboard on the streams
try to ssh into cointop.sh what's
cointop.sh
oh how you eat so worthless
we're all sad about that
no never mind i gotta restart my
terminal does this work now
oh oh we're gonna make a book we're
gonna make a book just like da vinci
return return return
return return return
oh never mind
oh
never mind you can't read this book this
is hopeless
get give up on book
there was a pdf link if you wanted her
gutenberg
gutenberg
it's a test i failed
it's only for students clearly you gotta
have a working latex installation
the us had the top university in the
world
50 years ago now i think in harvard you
learn about 46
genders and you learn about you know how
to like
you know like i don't know what else
how to be politically correct and about
46 genders i think that's what harvard
teaches now that's what i heard
uh so you know don't go to harvard man
go to school hard knocks
uh yeah no i mean they just did they
like destroyed there's a virus and it
like destroyed the american university
system
don't know maybe i'm just biased because
mit didn't let me in
mit still good i'm sure parts of it are
still good i'm sure these are the kind
of things that like
i don't know like
i remember like nah nah it's not gonna
work
uh yes like you know just about like
like the speech codes and universities
and stuff like it's it's ridiculous
um
no but like this kind of shit happens
all the time we're just gonna go through
like you know
1500 years of dark ages and then like
people are going to like rediscover
modernism in 1500 years and be like
wow those people in the 1950s had it
figured out
man we just needed to like go to space
yeah but and build like big pyramids you
know why don't we build big pyramids
anymore
we can build big pyramids
now we're not in dark ages we're gonna
die listen to the song
bigger pyramids yeah
i wouldn't have been a random ass
microsoft programmer man
yo like school couldn't like you know
bitconnect university harvard princeton
and yale
um didn't you all go to ivy league
schools
is what i'm saying true i don't know
oh yeah if you're not going to like like
so many of the schools or
anything like that's like a tear down is
such a scam
that went to carnegie mellon i started
to see some things declined by the time
i left in 2014.
you know it's the same as the same yeah
well i've heard i've heard european
university actually fails people
like how can you possibly respect the
quality of an education from a school
that has a 96
graduation rate right like schools brag
about their graduation rate
i talked about this on now you know it's
ridiculous
because all that means is like you know
anyone can like like
okay so fifty percent of the people go
to college now instead of ten right and
the same number of people graduate like
education is not that possible they made
college dumber
it's the same thing with high school
it's like oh yeah look at our high
school graduation rate yeah you made
your high school dumber
well if the value of university is to
get indoctrinated into an old elite i
have some bad news for the old elite bro
your money's fake
yeah we need more people need to fail
and only 15 percent pass yeah i like
trust your math degree means something
dude stop the drugs why do you always
want to talk about drugs man
yo macklemore used to sip lean and he
wrote other side
and then he wrote some like you know
song about like
nikes or something
i would live in a better place if
everyone read out that shrugged and one
of the kids who did and grew up out of
drugs the world needs a solution
by the out of tugs and peace and stuff
that you thought of mollied up
there's your bar
all right this was the stupidest part of
the stream
with the questions uh
when's the next day ooh big head on the
beat when is our next album i don't know
but we're working on working on i hope
you guys like risk architecture
i'm gonna like finish implementing stuff
for efficientnet
and figuring out how many risk five
operations
it takes to run an efficient net
and then if it's not many and we can
also use it to train
i'll be like whoa this shit's crazy and
then we'll have to build the chip
um but if we do it and turns out to be a
lot
or turns out to be really painful to
implement we'll be like yo
maybe nvidia is not as overvalued as i
thought so
uh do i have an fpga sitting on my desk
i bought this fpga
yeah from rda7 i mean this is i don't
think this is gonna fit the thing i want
the thing on one's gonna fit in that big
that big fpga
that i linked
i've heard that before about european
museum
yeah all right i hope y'all speak
mandarin right
yeah i saw someone made the book
uh should we do a risk five to do a risk
five
uh cpu on the stream i don't know i've
never been a cpo
i've written a lot of emulators but i've
never actually made like a verilog cpu
yeah i think writing i think writing a
little risk five is within the realm of
like what you can do on an fpga
uh chris lander works there now
at ssi five i said five school
all right guys thanks for watching
make sure to like and subscribe or
whatever you got to do on this platform
or if i can get a blue check on twitch
like let's write to the blue check
committee
i'll i'll tell them about how i'm an
upstanding citizen
and how i saved a puppy from a tree once
i put the puppy in the tree but we'll
leave that part out of the story
um
everyone take care everyone enjoy your
weekend
bye
uh what's up what's up streamers
what's up what's up good morning
everybody
good morning vietnam good morning saigon
good morning leningrad is that still a
place or stalingrad if that's still a
place or is it saint petersburg now
i don't know i only know russian rap i
don't know russian geography
uh all right what's up
we did a lot of work off stream
um we got all the columns
and matrix multiplies i didn't do the
backwards yet on the comm i should
probably do the backwards on the common
top
this is inference with an efficient net
b0
using tiny grad through this proxy
uh basically it's using this this mini
risk instruction set
that i
made up
so look at what we have uh here
it's very very simple instructions that
um
so it's uh i think like the tensor core
on nvidia
but one of them and bigger
uh so i don't think we're going to be
able to fit a 32 by 32 map mode to this
guy
we have hardware and i know you guys
love hardware
i'm gonna text my friend be like yo
streaming right now
lookie look we got hardware
oh with the mic i didn't buy the mic no
i watched some youtube videos and it's
like bro the blue yeti is fine
um so i didn't buy a mic it's really
just my production quality so i
downloaded pro tools and then didn't do
anything with it
or uh
not not uh 32 by 32 is just the size of
the uh
like the matrix right so we can take two
32 by 32 matrices
now the question is what is the biggest
thing we can implement
on this little fpga here uh so it's an
arctic 7 100 t so let's let's do the
math out because
you know this card costs 7 500
and it's not going to plug into my mac
this thing will plug into my mac anybody
can buy it and it's for sale for
a reasonable price i believe uh
it's a rda7 board they're on amazon i
just bought it
yes these things there you go
oh this one has the crappy one on it i
bought the better one
um i didn't realize it came in multiple
100t
yeah i bought this one how much is this
how much is this chip
i'm going to show you guys about octo
part there's no octo part
no nothing get rid of that
whoa that's an expensive ass chip boys
yo maybe i didn't get so ripped off for
this board look at this chip
it costs 125 dollars
damn and it's not in stock well no chips
are in stock because like you know
the chinese stole them all or something
i don't know what good conspiracy theory
can we spread about
the chip shortage man
ah yeah i don't know
what if we got scammed and they just put
this sticker on the chip it's not really
this chip
yeah fpga stream today who remembers my
other fpga stream so we're probably not
going to get to the real hardware
but we're going to design it for this
hardware
i'm going to design it with this
hardware in mind
look it comes with that sticker oh man
you know what i'm going to sell
processors i'm going to stick a sticker
on it and it could be a different
processor
yeah cool that's better thank you than
let me show it off
um no i think the chinese stole all the
chips i'm gonna go with that man
i'm gonna go with that now who can
everyone blames china for everything who
can we blame who hasn't been blamed
lately for things
russia gets blamed for things who hasn't
been blamed
mongolia yeah the mongolians did it yeah
mongolia is you know you go to mongolia
and it's just a paradise of chips
hey itunes thank you for gifting subs of
course you get a question
i'm not manufacturing my own all right
so
while too much
dollars more than mike
no i don't know that's that's a
reference that won't age because people
no one watched yesterday's stream and
they'll be like what mike what mike
where can i buy a mic
be like yo you'll be blue yeti's fine
watch this youtube video
um all right
so let's look at what this
chip is
and what our specs are on this board
well first let's put copy and paste this
in here
it has 256 megs of ddr3
which sounds very slow 16-bit
bus at 667 megahertz so is that 667 ddr
that's a crappy little chip
i multiply by two because it's ddr i can
hope so that's how many
bits per
is that many bits per second we like to
think of in bytes per second
and that's megabytes per second
okay that seems kind of crappy but um
with 2.6 gigabytes per second of ram
bandwidth
versus
oh hype train whoa big crypto cat
gifting big
subs whoa big subs
big gift
um
your f max for any design will not be
pushing the ddr too much we're gonna
have to implement a dma controller for
the ddr
internal clock speeds exceeding 450
megahertz that sounds like 450 megahertz
if it was faster they'd just tell you
that
okay um the block ram is measured in k
bits
uh why k bits
all right so if we want to fit 19 bit
floats
then we're going to provide that and
we're left with 255
k thingies
well you know what's measuring the
normal doesn't even have a megabyte of
ram
what a scam this is poverty levels of
ram
600 kb
of sram all right let's just see if this
is a total non-starter right now
uh
dma well okay we shouldn't even measure
this we should measure in elements
all right so it can fit 255k
elements
[Music]
oh yo we gotta download more ram
all right did anyone ask questions you
guys
uh what's a signal boost is that the is
that the word if i was going to approach
yo quee single boost this guy over here
all day all week occupy wall street are
we gonna bring occupy wall street back
man
see see look let me tell you something
of ramp time
elites love racism because racism
divides
poor people elites hate
occupy wall street because occupy wall
street focuses you know
the attention where it should be focused
on the people making the fake money
you need a command space yeah but then
you know who knows what's in my
spotlight man
who knows what's in my spotlight i like
google
oh google's stealing all my math
google's gonna know google's gonna know
what i'm building they're gonna
i'm gonna make knock-offs man who thinks
they're gonna make knock-offs all right
so 255k 19-bit elements
uh yo if you guys if you guys haven't
heard it yet check out my new
song on soundcloud uh
y'all i'm real i'm real proud of it
this is you know what you get when you
work with like real music people
it sounds like a real song is this my
most liked song
not yet i think it's still these ones
still have more likes
we're getting there
[Music]
oh how does it feel to have a good song
i'm finally succeeding at my dream of
being a rapper when i grow up
you know some people want to be baseball
players some people want to be the fire
fighters some people want to be
youtube influencers i want to be a
rapper
race war doesn't threaten their profits
that's true that is true
a little hot
oh yeah i was here uh dma
elements
uh-oh
that's a huge number of elements man
i can't even fit batch size one on this
little crappy
chip
that's 1.2 mega elements
oh this is sad sad
boys sad
ah
this gigabit ethernet on here and what
do i have to use ethernet because it
doesn't have usb
it only has usb to a crappy ftdi chip
oh this fp this this thing is looking
less and less
well that just means you have to go to
ram more often
i just have to write like cash
the idea is not to use cash
um all right this is this is lame
oh this chip's so tiny
block ram kilobits
is
wow that gets big so fast that's such a
big
all right did anyone ask questions
did any of the the purchasers ask
questions
not you you don't get any questions
oh yeah i know about go i know about the
cheap gofundme
but
we're excited about uh
yeah i already have this chip so we got
to make it work on this chip
oh they're asking about a 15 no don't
don't scam me
i'm looking at chat right now if you're
one of the the
gifters and i know if you're a gifter
you get a question well is that the real
carry moss
all right so the way that you'll input
neural nets into this is you'll
you'll set these switches and then
you'll push this button
and you'll set these switches and you
push this button right
set switches push button set switches
push button
um wow it only has it only has
this many flip-flops that's so tiny
that's even assuming i'm using the block
rams
let's find a good data sheet for this
chip
not not whatever amazon wrote
this this doesn't look like what i want
what does it like tell me like what
which chip and how many block grams it
has
power on car no i don't care about any
of these things
i do kind of care about what process the
chip is though does it have a chip wiki
by chance
list of xilinx fpgas okay it's a seven
series
what's the arctics
artix 28 nanometer oh that's gonna be so
just so much power
no we're gonna write that we're going to
use a risk we're going to use a soft
core
i think i think we can fit this i mean
we can't use a stock one because we've
got to add instructions
you know apple was going to do this for
their neural network accelerator they
were going to add instructions to arm
now i think they've shipped a few but
arm doesn't like it when you add
instructions
you need a very special license to be
allowed to add instructions to your arm
instruction set
but you know it's memorial day we're
here to have a good time we're here to
better understand the ai chip
accelerator market
because real talk
whoever controls the chips controls the
future i think that's kind of true
i mean like a lot of ai now i think is
just a uh
compute problem
but it's not just a question of more
compute it's kind of a question of
faster compute
hmm all right spartan here we go rx okay
this is the one we got
max distributed ram
we also have dsp e41 slices what's a dis
es41 oh cool
so this is i used to i like i printed
this all out when i was at google when i
was 18 like the xilinx uh
the xylink stuff it's just cool stuff to
read you know
like learn so much about how the chip
works
nah seems to only support stupid integer
shit
max distributed ram
and there's also a question of how many
ports the block grams have
which is probably not enough
g-max
how come that says 13 megabytes
oh this one is big block ram i see
but actually that's still not even
enough
even if we got the really big chip these
chips are so expensive
and they're shitty
oh all right fine we're looking
how much is that other fpga it's like
ddr3 ram
what is this the you know 1990s when did
ddr3 come out was it the 90s probably
not
probably after the 90s 2007 wow
this you know what the other the card
has it has ddr
ddrs6 ddr6
they're like throwaway banks ddr4 and
i'm here oh ddr3
you know you have a built-in spyware
all right can i buy this chip this chip
i can buy
um
oh fighting with the sec
okay where's a better fpga what are the
best supported open source fpgas
is it really this stuff
is why i got it because it comes on the
artie board
you all have pathetic amounts of block
ram
i can't even fit an efficient head b0 on
here
with a single uh
um this one here i want to track
max
i'm
all right so it is that one
it gets smaller over time
wow but that's terrible
what
oh that one's even bigger
the final one that does the categories
this is for
too
yeah i should start switching to uh
what's the red pattaya
i'm gonna google this first
look at this got ddr3 ram
nobody wants ddr3 ram
fpga ddr6 how about that
let's just google that whatever is ddr6
gotta be good
oh 72 percent will be using or planning
to use
ai within two years
wow to gain business insights in core
function who writes this shit
to gain business insight and core
functions boys do we get enough business
insights in our core functions
someone ever said that in a meeting
all right never mind only idiots would
write that presentation
uh no okay the first one that comes out
is this thing
so it's this acronix company we gotta
just
well see now that's a good amount of
memory kind of
oh god it can be used for 5g
wow the software looks like look why is
all the software like this from that 90s
man
yeah i'm using the windows gtk toolkit
not gdk what's it called on windows
yeah you know oh yeah look we
we got dot to compile for windows oh
yeah yeah that was an intern's job yeah
good you got dr compile for windows we
can link it dynamically with a dll file
so i can really fit nothing on here
like i can't even fit a batch size one
efficient that
well that's a weight array
the weight arrays can be big but
this don't worry about that
if this is the big one yeah
um
like i mean i guess we can stream it to
the ddr and do smaller things in the
sram and like divide it into two pieces
oh but then someone's gonna write that
code yo do you want to write that code i
mean look at it
it's actually stupidly paralyzable like
oh i'm going to like break it here i'm
like
cheap fpga development boards
build the hardware from scratch well
none of these are any good
the best one is the ardex
the zinc scrap
like your lattice is better
ddr okay does anyone have ddr4
no ddr4 a lot of them have ddr3 no ddr6
no ddr5
only ddr3
compatible with the arduino i don't want
arduino shit
i want power
you know what i'm going to just buy 30
90s
30 90s are already everything you want
okay are any of these ai accelerator
companies are there any ai accelerator
companies i can buy one from
oh congratulations on your fucking
fundraising round
bit may end up shipping these there's no
bitmain right
pathetic amount of fp32s
i mean you know if you want a neural
network accelerator that's shipped i
actually have one in my computer right
now
oh
oh this looks pretty nice it's called
polar fire
i don't see any ram on there though
oh it has ddr4
polar fire can i buy a polar fire
oh oh i need a librero platinum license
oh that's right oh you got platinum
while you buy the platinum one
oh that's got more ram
wait microchip microchip makes these
why is it micro semi micro semi is owned
by microchip
they make picks and they make arcade
fire fpgas polar fire
all right can i can i buy one
ddr3 teresek
no it has a pathetic amount of embedded
memory
oh i'm not in india what
mouser fix your shit
more options all right fine i'm in india
you happy
never mind
forest kitten what is this
wait
order now oh almost
what's this thing
wow look at that thing this is what they
make
how come i can't buy a forest kitten
it says hbm2 memory
all right they're doing this vertex
ultra scale
what does that chip cost it's going to
give me about india again
you know i've heard there's like things
that have like
where they're long used
all right where can i buy a forest
kitten
look at forest kittens on ebay
oh sweet my ebay's not mexican anymore
there's a forest getting on ebay
interesting
this is the most interesting one i've
seen
wait there's a ton of these how come
this one looks different though
this one's got a fan on it no one didn't
have a fan on it
i think i just took the fan off i say
zero available interesting
i don't know if this is a good amount of
flash or a bad amount of flash
is it a hash rate i mean is this is this
efficient or no
oh it comes with ultra ram what's
ultraram
hmm those ones don't come with ultra
wrap nah you should have bought ultra
ram
all right well this one certainly has
enough block memory
what is ultra ramp
breakthrough embedded memory oh
breakthrough
oh with ultra ram i see
um all right well you know what we're
gonna have to do
we're gonna have to you know just do it
in pieces
we're gonna have to dma it in pieces and
that's what
writing fancy code does but if we can
write fancy code we can make it work in
pieces
we're gonna have to do it at some point
to scale to mega matrix
you guys know about mega matrix this is
a really large matrix so like
all right fine we're gonna have to write
that i'm gonna have to write the
chunking code anyway
so fine
fine this is what we get
we get 255k 19-bit elements
uh and then we can always buy
a forest kitten yo i was watching this
youtube series worst mmorpg ever
it's hilarious this guy's hilarious man
he has like a series because i was
reading about what's the call like dream
crap it was like some scam
some scam mmo that all the youtubers are
dunking on right now
um
high-tech global now i think buying used
cryptocurrency mining hardware is
probably a great deal
like this thing looks expensive but if
squirrels making it for crypto miners
you know what i mean like crypto miners
they know about price
they like buy it now right like me and
crypto miners have a lot in common like
that
by the way should i go to bitcoin miami
should i buy a miami ticket
um it's a herman miller sale chair
and just because it's name sales doesn't
mean it's cheap it's like a 500
chair so don't be poor uh
but i realize that buying a more
expensive microphone won't make me a
better rapper
all right we still have a problem with
how we're going to get things in and out
of here
is this this half is this slow ethernet
or faster than
wow it's cheaper on here then that's
pretty cheap
um features
system features a hundred megabit
ethernet
wow
i guess it's faster than well 100
megabit ethernet i
i didn't know about like i wrote
ethereum i don't know that still existed
use the usb to uart bridge probably get
things in it for megabit
but the idea is okay you know what we're
actually going to use the usb ur bridge
and we're gonna you know we load in all
the stuff slowly because the idea is
that we're gonna do all the training on
here
we have 256 megs of shitty ddr3 memory
all right so our size in this thing's
not going to be 32 by 32 it's gonna be
eight probably
we can probably make one eight by eight
by eight multiplier
we gotta fit a risk five core in here
how do i program this
also didn't come with any uh
don't come with anything like a power
adapter
micro b cable not included do i have a
micro bk oh
sweet but i found micro b cable
why is it as long as a balloon
i have a shorter one being real picky
here
i think this one's too long
yo guys you know what i got hearts
marijuana
i've been i've been i've been growing
i made hots marijuana oh i can't unplug
my blue yeti
i do have a few usb ports on here but i
don't know if they work
let's see
oh it powered up look at that
mean obviously this can't be very
powerful because i wanted to do if
config i wanted ls usb
there we go okay ftdi it's that
we're going to design a risk 5 chip on
si5 yeah isn't there like a way to like
give you verilog
okay a already you know what someone's
already done this right whenever you can
copy other people
do it don't have shame man
good artist copy great artist steal look
at this
oh i gotta buy a i gotta buy a
programmer
no no they can't make me buy a
programmer this has to just work
linux i don't have linux
that looks like windows
p mod port d
[Music]
this thing has to support programming
over that
do i need a j type programmer
no no i need the olamax now i hate this
board already
you kidding it can't be that stupid
you're saying yes
okay no no no i have a board
and i have a micro usb cable okay that's
all i need
according to this tutorial
jp1 does not have a jumper
so program it through the jtag connector
okay they have a built-in program regard
where's that chip looks like a spy flash
[Music]
screen
oh don't tell me i need like a driver
for this
uh
dj tag config
you are debug console
[Music]
oh god i really need a driver
hey i don't have a shitakey c-class i
don't know what a shitakey c-class is is
that like a mercedes c-class
i don't have a shitake okay
shaq shakti oh
you're just upset i can't even look at
this website let's just say that upsets
me to look at
um
d2x helper
oh it's high speed
why do i not think this is gonna work
i'm
maybe this one works
okay unplug plug back
in does it work
i don't think so
super lame boy super lame
i don't even know why i'm trying to get
it to connect yet we're we're not ready
for hardware yet
d messages
doesn't seem to include anything about
it
um
yo if you don't stop with the shakti
this is you know what you know what the
shakti is the shakti is the mahindra
scorpio
it's this hand do you know the mahindra
scorpio like we'll get chills we're like
when is kamehameha gonna support the
mahindra scorpio and the answer is never
because i never heard of that car
until the shills showed up
you
i don't even know if that's connected
instead of a driver
had similar problems with a stupid uh
yo it never inspires confidence when it
comes up as
driver kit sample app
all right whatever i hate this i hate
this board
it has shitty amounts of ram it's
unclear if you can program it without an
external thing
you know what i don't blame the board i
blame i blame apple
oh programming fpga boards from a mac
what do we have
did digilent make this board it says
abnet on it
um
cool
i mean i think it's going to be like i
don't even think it's showing up right
now as a cereal interface
but
i mean actually there's some chance that
this will work if it uses
uh you know if they just don't use the
driver
what what's a cs file oh oh i have to
install mono
oh oh well
uh
oh you know what i think it's doing
actually
i'm not even sure that getting this
thing to show up as a virtual com port
would work
does their schematic for this board i
think it might be using the uh
like the parallel mode of this chip
all right so digital is who made this
board never mind i might have been too
quick to insult the board
maybe i'm just insulting drivers
i regret installing that weird driver
because i don't know how to uninstall it
now
hmm
yeah but i think is there a schematic
oh sweet
sweet
no this isn't the right schematic
where's the serial interface
ftdi port is under nda
what a joke
so i can't see that part of the
schematic i see what's going on
i mean this guy figured it out it's in
this code somewhere
yeah so it's it's using the ftdi chip to
fit bang uh
that's cool though
all right so the thing to probably do
actually would be to write it in uh
does this work
i hate drivers anyway who else hates
drivers
we can just use python python it's like
drivers but
you can understand them
i feel like i like wrote similar stuff
once before
for that other fpga board i did on
stream for a little bit
i feel like you know somewhere to like
wrap your head around
no back end available
uh so homebrew correctly
yeah so we have to download a risk 5
processor to this
fpga and we can have my instructions
uh
can i bruise all this to the eye
what is this crap
oh sweet
all right cool
pie live ftdi wow
wow this is nice all right let's assume
that installs
i don't know why it's updating like
solidity and stuff
well thank you for updating my ffm peg
good my porn will look nicer
watch this porn on f
oh this is this is mad nice
yo lib ftdi you
live ftdi guy you're bro and you're the
reason i stream
you make me happy
wow good thing
oh
given the specification
it's almost like it didn't even need it
looks like this works
pi lib ftdi
oh well i think this is actually
i'm concerned about what it's
downloading
good bang device
is your device id is like this
i'm not passing anything
um
um
[Applause]
hmm
oh maybe
yeah this is a different problem
so weird
there's probably just some reason i
can't open it maybe because it's already
like being used
and it's a wrong error uh
i this is not really what i should be
doing right now
why is kong abandoned chat because do
you want to talk about your job on a
sunday morning where you're just hanging
out looking at chill
bro fuck off with that thinking that
like you know you got this whole
mentality thinking that like
i work for you and it's not true man
it's not true you know i'm here to chill
and have a good time
other streamers might have a different
mentality right like other streamers
might have this mentality where it's
like
they like want something from their
audience they want like some kind of
validation
like i'm just here hanging out and like
you know sometimes you guys help me out
and tell me about live fti and i like
that
that's why i stream by the way like
because sometimes you guys
do value no device matching up
all right let's just read this right
there shri the code boys
spam and d message on the mount unless
device not found that's so weird
shit
oh there's one on this list or something
it seems like it's there
does it need pseudo i'm going to try
that no
doesn't help
the device isn't found
okay this doesn't work
not finding the device at all so it's
listing the device but then it's not
oh could it be that crappy driver i
installed
uninstall decks
system library extensions
it kind of seems like it didn't even
install
ah i mean there should be some way to
open it using
uh using
we're getting distracted boys like this
doesn't really have anything to do with
the
the fpga shit this is uh
let's just try that message is not
defined
configuration not set
other error let me set configuration
configuration not set
or their error great so as soon as we
fix this other error
go to the troubleshooting section
no i don't think this is the problem
i also got to start closing some windows
my mac's getting slow
we don't have ram we're short on ram
boys
yeah no that's not the problem
whatever's giving me other error here
it's the same problem
uh
team id bundle id
that's right get fucked
waiting to uninstall and reboot
junk still get other error don't make me
reboot no
it's not active anymore so it's not that
other error
this other error
who wants an other error
do i have to do something else before i
set configuration
find that configuration that should work
other error
once i said zero
okay then we just get a configuration
not set
invalid configuration two so one is a
valid configuration but we get
other error
why not even try that
brew install live usb
hmm
dot self.backend.set configuration
back end is lib usb 1 and it's giving me
an error there
let's just briefly unplug them you know
i'll just unplug the mouse plug this in
instead
it's just just so we're not wasting oh i
don't have a mouse
oh it works on that usb port okay well
oh no boys do we want a mouse
oh okay the usb
port doesn't work no it's nothing to do
with m1 it's the happy hacking keyboard
usb hub that doesn't work
um
i need a unless you guys want me to get
rid of the mic
we need another usb for it
i got one here beautiful
all right well that was stupid
i think i got this
all right now the mouse oh and that
connects oh there we go wow look at that
the usb port was broken what a fucking
waste of time
all right let's go boys bus error 10.
well
that's better i guess
oh some bug this is some live ftdi
should we fix live ftdi for the m1 i'll
be the uh
that makes a pretty nice guy right
all right
i don't think i need the device serial
number i don't think that's the problem
put that in if you'd like
bust it right now and i just
so it works you just get bus hour 10. oh
you know what's cool
that one i should be able to see and
oh it's this crap
driver
three yeah
oh you know what this is cool thing
called fault handler on python
cool oh lib ftdi version hey
seems easy enough to fix
there we go fix that for you bro
no but that should actually work um by
wrapped
version
that works but this doesn't
self.fdlnl yeah yeah so we have to do
f
um
this is a struct okay
okay so it doesn't return anything
and that works uh
what
yo what happened to what happened to the
great uh
yeah we can lose my rap songs in the
background i've already hear this one a
ton so we'll just
put the stuff in the background sounds
nice
[Music]
good morning to the first american right
it's not really chill working music
though
let's do creative
commons chill
beats
all right so now where's this rda7 open
source
um symbiflop getting started
it's gonna be flowing already board
oh it already looks terrible
i can already tell this isn't gonna work
well you guys always want to know the
bigger picture what do you think you're
going to do with the bigger picture you
think you're going to go
for army to investors could be like yo
yo i got the bigger picture yo
there's no big pictures only small
picture
well because i don't need python turns
out i can just use openocd
can i download a bit file does someone
want to go download
and create a example file
for this like compiler who has windows
if i recall correctly this is exactly
how far i got the last time
oh okay hang on hang on this is already
here
oh here we go
all right we just gotta program this how
do i do that
um
um
valid command
ah that's fine
i gave that out you get it
all right didn't give me any errors
see the instruction section of this
readme for how it works
where are the leds ah
i don't know if that's the
it just might be the default program
all right
i think that's the default program
oh no
i'm not sure if this works
never gonna want a spot
do
hmm
i can check status with python openocd
uh
since the bugs you should use the native
support
but there's probably a way to get status
here we go
pld load zero
i don't know what if we make it one ah
that looks really big file
all right is there
hmm that's the flash
oh wait i can actually get this
you can build it but it might work
it looks like open ocd should work
oh yeah did this thing ever finish no of
course it failed
oh my god it's installing mini conda
yeah of course that's not gonna work
cindy flow examples
so
you
program
do i need to like pld run or something
i don't even know about that
these jumpers do
i might change the mode or something
let's do the manual
was 14
fpga programming mode
jp1 ah okay it was that
all right so now when i reset it doesn't
do that anymore
let's program
that doesn't work anymore okay
we got too close to the truth boys too
close to the truth
all right already a7 manual
oh no colonel panicked let's jump for 13
for
programming mode
i don't know let's just try to put on
the spy flaps
pnd load failed
flash right image failed with error code
4.
maybe it is programming i i don't know
it's an xdc file
every time a swish is pushed on the leds
will light up
oh this one works
got it boys programs
and you can like do this and you know
flip the switches and the leds do the
switches look at that
look at that just the other one doesn't
work yeah yeah look at that let's go
let's go
all right cool
um all right now can we get any open
source tool chain for this that doesn't
suck
uh all right
all right it looks like we can use yosis
and then next
pinter and then the open fpga assembler
to get to binary
oh it's reading tickle scripts oh gotta
love this oh yeah
good tickle
all right brewing stole yosus
oh
all right all right we got some progress
here
guys oh why don't i just make my life
easier why don't i just use a video
because
no i'm not even you just some people
don't get it man
some people don't get it
i made him rage quit good good
vpr
not necessary to call joseph
synths synthesizing
symbiflow uses elbif
i mean they certainly didn't
all right let's see does this have a
verilog
oh
it's written in vhdl
this piece of a tech map which turns
yo this looks like i should use neural
networks
and we just got to make bit files
you
yeah this looks wildly complicated but i
hate that these like hardware people put
all this shit on top of
like so do you think i understand this i
don't understand this
what's a phasma
oh that is damond
[Music]
this stuff's cool
am i using mini conda so let's just get
this out of here for now
all right let's just try this
like it's installing its own python
who else is upset about that this guy
empty file
executable vpr
what's vpr
pre-install vpr
not using vivado
installing bravado on mac
ugh
i thought it was such trash i was using
it when it wasn't called lovato they
like rebranded it and it was still trash
it used to be called like
the xilinx ise and it was trash
oh i can compile it with graphic support
because they you know
it was nice software installation
javascript
like javascript covers over an immense
amount of complexity
first of all we gotta order some food
but second off
javascript covers over this immense
amount of complexity
yesterday i was very upset they did not
bring my food
to my apartment
and this upset me
are all the thai places identical
i had to walk downstairs to go get it
and i was upset and like that's my deal
you you want a tip you want a tip if
you're a delivery person
i'm a real i'm a straightforward guy
um my deal
is that you got to bring it to my door
uh and if you don't bring up my door
then you don't get a tip but if you
bring my door you get a nice tip like i
think that's fair
right am i being unfair here if you
think i'm being unfair i don't care
because this is my policy
and then you know hopefully the delivery
guys who make it at my door
like you can totally do it the guy
yesterday was bitching was like oh do i
even find parking
so much parking
i just ordered from that i ordered the
same thai place all the time
always thai downtown yesterday i ordered
banana sticky rice with ice cream and it
didn't come with ice cream
and like ice cream is in the name so you
think it should come with ice cream
but it didn't and
we'll get fried banana with ice cream
today and hopefully fried banana with
ice cream comes with ice cream
go to check out pay way too much money
for delivery
next you get a tip if you bring it to my
door
that's the deal all right let's go
guys where's your american all this
[Music]
no i'm not allowing notifications to
overeats because you annoy me
and you send pop-ups it's like check out
this great deal
10 percent off water food right now
normal people life shit
what are the odds this is gonna work
looks like this is the tool i need great
it comes with odin
abc and vpr these all sound like things
i need
ah down the latest release
wow even the releases is this as big as
vivado
on unix-like systems type make
fingers crossed
all right so this should go right from
oh
wait so it seems like this is the real
tool if it goes all the way from verilog
to routing and i can use phasms
and then there's some way i'm sure to
turn a phasm into a uh
into a bit file
no
i'm not can i disable tests
all right
explicit instantiation of undefined
template
all i'm going to say is this test
doesn't look very important
oh no everything that includes vtr small
vector
will not work template is declared here
oh this guy forgot to include a ray i
think
is that what happened
no that can't even be a thing
error parsing in line as oh there's
inline asm
why is there inline asm
some of these things are fixed upstream
at least we can submit pull requests if
we fix them
it's a worldwide collaborative effort no
wonder it sucks
i want code that's written by one dude
it's like who's that who's the guy who
wrote uh he wrote ffmpeg
i got a whole bunch of other things too
guy's a genius who's a guy right ffmpeg
yeah fabrice bellard right if that guy
or your
qmu man ah you know
if if that guy wrote wrote this compiler
it'd be sick
but not it was written by a worldwide
collaboration of
and they included like intel so
no that's why it sucks
yeah fabrice ballard's a genius man best
programmers are live
[Music]
if intel wrote it it sucks
no not icarus oh wow we got even more
errors now
no febreze boulevard would say no to
tickle i feel like you have to use some
tickle out you're curious
no
no didn't use any tickle jerry's great
maybe he's not supported on matt no you
know
fuck off without not supported on mac
won't they support it on mac let's check
support.md
well huh if i just want odin
oh no
we need the arm version of this all
right
uh
it does support r it does support oh
this is reasonable um
yeah let's do this
to fix it i can't even upstream this
because it's broken on the uh
oh yeah yeah look i'm a c plus plus
programmer
no
oh
i lied i'm not a c plus plus program
it's trying to compile lib arg parse and
it doesn't work
do you feel like if we can build this we
might be in lock
what if we use next pinterest
oh big head on the look at that oh this
looks so much better
some progress towards support for xilinx
devices
but it doesn't really work wow looks
cool
next printer xilinx
download and build project x right
step one install vivado
no they couldn't do that
okay
but after all this you have to install
[Music]
vavato
now they must have been lying
download everything why don't you
yeah this is cool we got loading working
they feel
that's building yaml cpp
oh ha ha
don't use arch linux
it's all cool stuff to think about right
because like you get this stuff working
oh look it built something
wait no way it did something
why are they calling pseudo make
use the python api with a pre-generated
database
great that's great
watch out for f althvec
no no no it builds something else
[Music]
for that because ice4t is a fairly small
fpga
because when you do some teaching
projects
and you have a ridiculously large fpga
people can write ridiculously
inefficient designs and it will still
fit and they will never
learn that actually your 7 7 segment
decoder should not
take 150 000 gates whereas with an
ice 40 you can actually set a goal
to this a little bit challenging for the
blade the old exilings tools the ise
tools
uh to actually generate the bit string
uh so we don't have a full
end to end open source flow uh here
right now
however what we have is something that
uh picks out the difficult part for the
context of next pillar which is actual
place and route
and only for the bit stream generation
we need to
defer to isa in this case but it
shouldn't be
too difficult
okay
this is hopeless
do i have sci-fi
going to sci-fi
like you know it like tries to install
numpy
why does anything use sci-pi
sci-pi's terrible
sci-fi is everything is too shitty to
make it into numpy because it still uses
fortran you know
i said but that's a real fact i won't
give you guys fake facts
oh yeah just install a new gcc while
you're at it great
how can i use notepad without installing
[Laughter]
i mean i'm sure that's actually in
practice less funny than it sounds but
like
you know what i'm saying
all right
well we got some downloading working if
only we could make bit files lot of
zeros
sweet somebody else got to build if i
make is it going to try to install
sci-fi now
uh no that's kind of build verilog for
writing we know that doesn't work
par yaml is fine no sci-pi
that's hopeless right sci-fi now
should have sci-fi okay that worked
right let's download latest db
cloning into database
is this all i actually need from project
x-ray
wow what a
i'm not actually gonna build any of that
and then can we you just use like yosus
and then i don't think we can use yo
says because i think it needs uh
yeah we either need to get next pinter
to work
so yosis is like gcc
next pinter is like an assembler the
placement routes like assembler
and then
the the uh left this thing's like a
linker
that's actually true
yeah the bit files yeah the bit files
control the
like layout a little chip
wow it's getting hot running this led
program
yo who thinks they're gonna bring my
food up to my apartment and who thinks
i'm gonna have to go get it
momet he's gold all right my met
i believe in you you bring it to my door
you get a nice tip
that's how it works is that fair is that
fair guys
is that fair i'm not going to get it i'm
not no
no am i going to get it it's really far
away
did i tip in the past if they bring it
at my door
it took about a thousand dollars i'll
tip i'll tip a moderate uh
see we'll see how nicely it comes to my
door
you got you guys can decide how much how
much uh
uh we tip all right
can use yo says we either need to get
next pinter to work wait next pin is the
one that built right
was that not one that built we didn't
even try
because we had to figure out next place
and
next pinner
experimental flows
all right
all right all right we've do we've done
most of the prerequisites
oh brief academic paper don't you love
when
there's academic papers
to describe what you're trying to do
oh yes
all right cmeg de arch linux
errors could not find
python libs
okay uh install through
python libs
to install python
at least python 2 is gone all right how
do i do it python deaf
so
i cannot find python labs
do
maybe set some parameters
do we need python
no python
and qt5 now
is that gonna work
d build python to off yeah you're
probably right
bb azam eh
no boost 20 boost
detail python equals no
eigen brew install
all right hope we didn't need it
this code sucks
why would they be done
this is this is hopeless all right so
who's ready to install vivado
i would use openmp
we just need to get this bba file
already what's a bba file
auto suck
all right do we have bb asm now can we
run it
all right bb as in oh endian parameter
is mandatory okay good well
thank you
next generation place and route
all right
we're going to add a sock in xilinx
examples
all right we don't have an a35 i don't
think
add a sock another option
all right all right we're getting
somewhere we're getting somewhere
okay we probably don't have a new enough
version of use yo sprue
[Music]
this is like build easily oh great
what version of your houses that i have
that's a pretty new version
it's a pretty new version i think
that was this abc9 crap
hmm i'm sure it wasn't important don't
you think
it was important they would have like
you know told you that
yo what i uninstalled i should have just
kept it installed
i gonna bring my food to my apartment
oh he's got to make other deliveries
along the way
should have paid that a dollar 49 for
priority
and they probably just wouldn't have
told me about the other deliveries and
they would have blamed it on the
restaurant you see what i'm saying
like welcome to the future where these
companies are
putting really big resources into ai to
like
fuck with you like they're running like
machine learning algorithms to learn
exactly how long you'll wait without
being angry
you know exactly how long it's just just
just a little bit
what's my net worth fuck off bro
you get a timeout for that the money's
fake
oh yo it looks like it's doing something
oh
yeah it did something great
i love when it does something
all right now we got a big ass json file
all right let's go
of course this one oh all right we need
a chip db
file but actually it turns out all these
things you have to install
don't even matter
because you're just trying to get this
chip dv file but if only we could get
the chip db file
oh man actually someone just put it up
for download you know
someone just put that file for download
and they'll just work and we wouldn't
need all this other crap
oh here look at this symbiflow arch
deaths nightly oh yeah
yeah yeah yeah come on it's right here
in uh
yeah is it in here
yeah yeah yeah i found it thanks arch
bros thanks arch bros
glad to have you on on team arch
i tried installing arch linux once to
watch that stream
all right
are any of these the right things no
there's all these like tests
did anybody get this stuff working on
their computer and they could just make
that file for me
like because these are the same you know
what they're like fuckers and artifacts
like it when you like
you know oh yes you can build everything
yourself oh we understand where every
one of these files came from i don't
really care
i just want the file never have to make
any of this it turns out
all right so i have to get it from oh no
don't do that again
okay
there were instructions on how to do
this
all right i'm using next pinterest
i have to get a bba file
all right
um just want to disable the python on
is that working probably not
maybe this except i don't have this
device i have a different device
what are the odds that's gonna work
hmm
i don't have that one i bought the other
one with the big chip
oh sweet oh we got it boys oh we got it
oh yeah we're making real progress now
boys
all right now oh it's the csg all right
csg fuckers
let's go let's go let's go let's go
let's go
did it actually make that file oh it
probably went in xylic didn't it
oh yeah i could but make the other bba
file yeah let's bva
bros we got okay what do you think bb
azim who thinks bb asms gonna work
asm we think it's gonna work
yeah it's gonna take even longer because
this chip's bigger
all right
let's see if this works
pm dot count
allowed options
important output parameters must be set
a
wouldn't turn on righty did we
oh maybe i did because
oh yeah there we go yeah bb asm
oh yeah gooey bbs and the shit out of it
yeah i better bring you my food
go those go let's go
all right
found an out of range integer parameter
in the json file please regenerate the
input file with an
up-to-date version of yosis
oh fuck off with this shit it's probably
because i got rid of abc 9 isn't it
new abc 9 was important
right after telling it not to have any
wide luts
that's right don't use wide luts you're
going to regret it
going to be like yo i shouldn't use that
wide lot
all right brew uninstall yosis let's
let's see
if we get the up-to-date version of
yoasus if it works
yo i'm such a script kitty man that's
some real scripty shit
all right i can already tell by the like
format of this that this thing doesn't
work well
all right just simply just simply type
make in this repository just simply
what are the odds is it gonna work
okay if this isn't up to date enough i
cloned it from github this is fresh
yosis from github man
12 sounds faster
i don't know my them just came college i
downloaded the color edition
we're learning boys what's the point of
the stream to learn
some people don't learn and they stay
noobs their whole lives
some people learn and they become
naughty groups learning is not something
you do overnight
learning is a lifelong dream and
dedication and shit you got to be
dedicated to learning you gotta you know
watch pokemon man
i wanna be the very best like no one
ever was you know
all right what's going to not work next
i can see already what won't work
all right source utils environment
oh yeah i don't have vovato oh well
that's too bad
you don't get verado
two frames dot
oh remember yesterday we tried to make a
book and it didn't work
well there's no way this is going to
work
can we build this with no python or
something is this the only built with no
python
does it only work in this shitty python
environment
you can try to fill cycling isn't it
it's all good until try swimsuit sci-fi
i think it did actually do yeah this all
worked didn't it
all right great
good i got text x and arpeggio
it's a dsl all right now we have phasm
now we don't have project x right uh
tip three install dot
okay you notice this is still building
that's good don't install sci-fi
i know winter we'll try to use that one
one of the projects all day project
runway
all right all right
thousand two frames let's go oh
all right that looks good
how about xc frames to bit do we have
this one
yo if this actually works after all this
all right all right that seems okay
um all right we have yosas let's go
joseph
all right
add a sock oh okay it worked with abc
crap oh this joseph seems faster too
what do you think
that better be in verbose mode
all right all right let's next enter it
oh oh next pinterest working hell yeah
all right we just need the x-rays
database dir
oh i know that one cloned into database
didn't i
yes i did
from the projects all day project runway
[Music]
uh i'm gonna just change the 35s to is
it csg
yeah 100 100
100.
oh no way no way that worked
all right let's run phasm two frames
don't fail me now phasm
well we're missing a tile grid.json
and it would help if i knew what
tilegrid.json was but
i don't even have anything in there
called that so i'll probably build that
right make
it just removed a lot of stuff
it's most useless make i've ever seen it
just removes stuff
now there's stuff there all right good
the mistake was calling make
they got you with that one
okay that worked xd frames to bit
oh my god i have a bit file
no way all right
oh oh they're calling the door
[Music]
all right i'll let them in let's see
will they make it up the stairs
we don't want to do that again no no no
that might have been a real mistake we
don't want to
overwrite that no we're good we're good
we're good yo
it built okay add a sock.bit
cp add a sock.bit
tinygrad fpga
program gpio demo
no no no we don't want gpio demo because
we called it addison let's move it to 8.
prog
wait is this what it's supposed to do
did all that actually work
yo
i think that's it
no way
no way yo who said i need bravado
that's right that's right
who said i'd need bravado
that was super easy boys super easy
now let's just write a risk five chip
the future has never seemed so possible
wow
oh they made it yeah
all right
oh
they made the food to the door we got
the fpga thing
oh this is this is a good world boys
live in a good world
i'm a famous rapper wow
wow that's good
the dishwasher always
i'm tired after i eat
running post routing legalization
i almost feel like we gotta document
that you know
don't license this thing's not crazy
what
no i'm gonna take sweet
wow
removing some language is no longer
necessary cool
i'll read some docs for later is this
the one that i built with uh without all
that
yeah it is
you
we have to do dash l here
it's an actually usable fpga tool chain
see it works
um we want to put everything in out uh
um
i'm going to file firmware.hacks
oh this is like some what
it's cute it's like some
cool
so i should like write it in some
language okay i'm able to read chip db
that's fine
i wish we wouldn't have to rerun that
put in a scene or something
um already fdc
you can't find it all right after
everyone knows this
uh
so
putting the stat out don't add a sec
why not oh add a sock
yes
like it does nothing it does different
things
instead
hello hi we're on a stream
oh i think
[Music]
tonight yeah are you home
uh maybe later
i'll stream for a bit more yeah not now
i want to read
all right cool um
yeah maybe maybe around about times to
close
i'll check i'll text you i know maybe i
think sevenish
oh that's ridiculous is that too early
for you how long would you just start
no i've been streaming for a while but
we made good progress i got a fpga
compiler to work on mac
yeah virginia let me see they closed
really close at
nine tonight it says oh they're closing
all right we'll go like eight
perfect enjoy your streaming
i'll see you later bye
it's my mother
i really don't understand how it did
something different last time
that's not good
yeah how does that one do something
different boys
that doesn't sound good would i mess up
wait it literally does something
different if i build it over there
and it seems like like that's the
correct thing don't you think
that's so weird
got overwritten
hmm
i was blinky
oh is
possible that i broke that
unlikely but possible
and like one of these things includes
firmware.hex
i don't know about firmware not hacks
did i reverse the order by chance
now
how we doing on viewers
look it does something differently
oh
hmm does chip do be wrong
no all right
all right let's compare some stuff
okay bit file different phasm file
different
json it's all different
how is firmware.hex getting included
how does it know about that
so i know if i removed it a complaint
cannot open file firmware.hex for
readmemh
oh there it is why did that show up when
i searched
oh did i copy the wrong firmware.hex
yeah look at that it's different
i don't exactly understand why
but it is i don't know which one it's
using
yeah there's one and add a sock and
there's one in ari
oh there we go now it matches
cool and you get without a socket right
it's actually a processor
how many people got that working on mac
no the problem was it was a different
firmware
i'm not going to show you where my
chromosome
um
it was so cool
pico rv too
no way
so
cool bros
um
thank you
how we doing our viewers
should we keep going
888 that's a nice number
that guy line
all right so
what's next
okay so what we want to do
i think it's got a risk fire cpu running
and then get that cpu communicating over
the ui
let's enjoy it right
does add a sock support the uart i
assume it doesn't
well what is out of sock actually
that's pico sock
oh who's this guy
this looks familiar
this might already be risk five whoa
a small risk bar processor core
so this these this firmware is actually
risk five already
remember we thought we weren't doing
anything we actually got a risk five to
work
cool bro
how long did it take this guy two
minutes
this guy's a genius took me all day
oh he already had it all installed he's
a cheater
and he did it on linux that makes him a
double cheater
um
those are risk five instructions should
we disassemble it oh it's a hex file
that's disgusting
those leds are painfully bright
that's wild this is a whole risk 5 cpu
this already is so much better than
bravado
building anything in vivato took like
20 minutes 18 seconds
um all right let's figure out where
firmware.hex comes from
all right we need a risk 5 assembler um
no it's educational i don't like it
i don't like that it's a tap i guess
kind of a ridiculous thing for me to
care about
i was a 64-bit risk five
how many bits is this
32 bit
let's disassemble it
hmm
why is it a hex file
do i convert hex to binary
why is it long by the way too if i do
this does anybody care
and then we can do
that
love that andy in this fucking uh
is the ending this right or wrong i
don't know okay that still works
uh i can't do that anymore
banasky nasty
let's say
can we can we use binary like like
grown-ups not
fucking hex
look look at how much smaller it is look
how small it is
if you use binary does it work i
probably don't work because the end is
probably wrong
oh digit one larger than used in base
two
context
that works
read man b
text file containing binary values
separated by white space wait
no that that's offensive you're telling
me it's not a raw
binary file you're looking for a file
full of ones and zeros
this
yeah yeah that's what they're looking
for
these these people man these people you
know
how do any chips get made
i it almost feels like you jumped when i
see people do things like that you
almost just wonder if the whole
chip like like design world is just full
idiots
all right i'm not talking about like si5
i'm talking about like like who probably
did that like intel
you know how hard is this gonna be we're
gonna we're gonna revolutionize we're
gonna disrupt them bros
mikey dev thank you
thank you for writing hello to
mikeydev's audience
today we actually got
custom code compiling for our fpga using
open source tool chain on mac
yeah bros we did it bros we did it now
what we're trying to do now so the thing
that we got to compile
is actually a uh
i don't
[Music]
um
just not supported in clang i want clang
new lip you know i have like 7k
ram right
you know it feels like just hours ago we
were struggling connecting it to the
wrong serial port
and now we're installing a risk 5 tool
chain about to
compile custom risk five code
for my homemade soc you know
no not unicorn what's capstone
whoever will capstone i like them too
where are the odds
csrs artrisk 5.
hmm no risk five
this looks shitty you know why i think
it looks shitty
because look at that capitalization and
look at that
thing you know that can't be good
do i have to reverse them
oh i didn't mean to rm that damn it
something like this uh
um
so
keep crying
we're all gonna die now
can't be right
i flipped did i not
i think i do have to i think this online
disassembler is just broken
okay cool so
wow this code looks complicated look
what it's doing it looks complicated
all right keep building great
i actually need to write something that
converts that the other way around too
so that's the code that's actually
running on the uh
on the thing god who can read risk five
i'm loading digital
oh yeah we gotta tip the delivery guy
what are we tipping the delivery guy
all right what are we tipping boys
twenty percent five bucks yeah you
brought it to my house bro
and you rang the doorbell i like that
sometimes they don't sometimes they
don't bring it to the doorbell
oh this is a u-blox firmware trying to
custom firmware for the u-blox
we tipped them 20 boys it's already over
all right we got kidro over here
uh import file
not that
i was thinking about writing custom
firmware for the u-blox that we use on
the comma devices
uh fpga ouch no not outsource
from where i've been
risk risk five yes
just analyze it allies
it don't work
i don't get it this is cold there's
nothing that's cold because it's ram
clear code bytes disassemble
od gotta give them the d
all right look at that that's the code
that's running right now on our outer
sock
[Music]
all right this looks like a delay loop
cool what's this
looks like a variable delay loop
prime one equals
it's a fixed delay loop and that's a
variable delay loop
sleep
sleep fixed
sleep variable maybe
all right so there's two functions and
they both sleep
yeah they're just pretty good they're
decompiling is good
all right so what is sw
does anyone know risk fi does anyone
know these instructions like i should
know this this is the future man
i don't want to get left behind knowing
arm
what's s w
store word
well yeah so they're just setting yeah
that's cool bros
all right do we have our compiler yet
no we don't it's still building
oh
let me borrow one
changes when i hit the switch
reset
yeah i'm getting compiled for subscribe
this is risk five
this is the code that's running on the
stuff
um i have r1 equals two
oh the switch might be uh outside the
switch might just be like a stop for the
processor
i can't look at those leds let me go get
some tape
it hurts my eyes when i look
they're too bright they're building leds
today they're too bright
that's right i'll cut them in duct tape
do i still be able to see them through
duct tape like it just hurts my eyes
yeah look i can still see them oh well
that got unplugged but you can still
see them through the duct tape really
well
it just shows you how eye damagingly
bright they are
it's only a long enough cable here
look at that you can still see them
leds man they're causing global warming
right there
oh good amount of ice cream today
oh sweet fried banana and ice cream
all right it's installing now
where are my sunglasses no left in my
car what about them
i can still see the leds fine
and that's not disgusting bro there's
duct tape
oh man
so much money the banana
yeah that's just like you know why
it's like that because you know really
why they have read memh and remember
it's so like people can do it notepad
like people open it up in notepad or god
forbid word
pad
all right so i want to start my response
tool chain hopefully
now we can compile our own programs
oh lwi
not upper media
world contest
what is this instruction set manual not
written for noobs
i actually love to arm one of these
um
wow but that means in this thing there's
a hole there's like registers and
everything
that's wild look at the registers
is this using a b ram where's this
memory come from
how much ram is that
uh the registers are on all general
purpose we said it was 32
you're wrong it's 31 because 0
is not a general purpose register it can
only be used to hold the number zero
but actually um i might be wrong about
that
so i don't know
i might be wrong i might be wrong don't
wait no
it is 31 registers i forgot about pc
but there's also pc but it's not a
general purpose register
whoa whoa not using the ddr
it has internal ram
that's not really ram though
wow
it's still running like making crap on
that
i don't know this is a processor boys
all right so how do i where are the leds
here we go
if i oh man valid eh
why greater than
i probably could store it in anything yo
that's so cool though
it's like a i'm in my own implementation
there's only eight bets
i see more than eight
so
my bias
oh it looks like each led can be four
colors
horizontally
why is it taking forever
it just makes sense to anybody else
what what is that snitch
[Music]
bro you've been doing so long enough you
just start to know everything you know
i'm not sure why i don't know everything
so much i don't know
yeah cause you've been working in it
what do you do on the weekend bro
you know does that like push against
like
well you shouldn't care in your
interviews if people have side projects
bro there's one way to get good at this
stuff
i mean yeah i won't be able to
communicate with the core but no
actually i totally can
i can blink the leds and then i can use
my camera
to detect the leds
what do y'all think of that
um yeah we're gonna have to write a
cereal
this is like useless sleep thing
is that what this is doing
no this is not asleep this is doing
something
divide remainder maybe
what does this code do
where did firmware hex come from
yeah okay it's definitely not that sleep
mode or something
i don't like how this like
i guess it can't know that i'm actually
using the return value it should know
because i got it there but
okay
the switch probably halts the core
yeah it's reset oh the switch is reset
i get it yeah i still look like when i
look it's like running that counter
program
and i flip the switch that's held and
reset and then i get rid of the reset
yo that's cool
what why don't a pcie fpga i got great
fpga right here
oh you're wondering how i'm going to
communicate with it well so it has a ur
we get a uart controller for the fpga
and make it uart
stupid ctr thing
what does that do why do we need that
that'll
use this there we go i'm gonna make it
more efficient no no no no no
i gotta build i wanna control see it
though cause i'm worried my chrono panic
this crap's also not used
oh wait what if it's used as a clock no
it's a scam
abc 9
did do all that last time
oh it's just slower because it's also
building uh whatever bullshit
see all right so this is instantiates
and add a sock over here
reset is mapped to switch one
and output is 11 wide for the leds
which makes sense 12 is 4 times 3.
this on the other hand doesn't make
sense
let me just improve it
i don't like this stupid wire
i don't like this
i didn't commit this right
look at that boys yeah
upgraded that's upgraded my processor
oh it doesn't have blue i get it
should have blue now
just don't understand how it only had
just oh i guess it's two bits for each
oh that makes sense okay so it was two
bits for each
yeah well now it's going to count in
blue first it counts the red
and then it counts green
yeah look at that improvement
for the upgraded cpu
ready for it to count blue
oh i get it because you can't really see
the red and green together
where's blue
it's really blue it's a blue a lie
or not we haven't counted to blue yet or
we're about to count
blue's a lie
all right i see why they did this it can
stay
i can't believe that's not done yet
thank you for gifting
got any questions
what are the screams i don't know people
are like in the park
being loud
oh
did i break it broke it
oh because i got rid of that wire why
did that throw an error
it didn't just didn't exit
you want your hacks bro
you're hacked bro i just hacked you
all right it works again
oh hello hype stream hype train
if i have a limited time i can learn
exclusive emotes
hmm all right if i know this was going
to take forever
i would have found something else
um
can we figure out at all how far along
this is i i think a good place to end
today's stream
would be uh
if i got something custom to compile
in that assembly so let's get there
okay because right now this is just this
thing called firmware hex
uh which is just downloaded to the thing
and it's this code we don't really know
where it comes from
um so let's export program i'm going to
get your zip file i want an assembly
sometimes you learn by retyping
where a's
what are the a registers
there's tea registers too
well they're like the scratch or
something i read about this once
okay that should be the same program
uh how do i compile that
it seems almost done
not overwriting shared dsp oh come on
come on come on come on
be ready level two
third page of risk v calling
oh yeah cool thank you
they're just aliases yeah i got it
oh hell yeah built in 27 minutes
all right risk v64 no i don't want 64.
i did all this work to not get 64.
all right
still fine uh
all right let's create build risk
source
risk
fun bash
cannot open source risk the asm for
reading why not
oh because i'm in the out directory oops
those are shitty scripts all right so no
one out we have something called a dot
out we're going to need to use
copy you want to check with the dump how
easy
dumb dump on 8. out
double dump oh no yeah you yeah
we gotta give it to d all right we gave
it the d we put the d
in the dump all right
let's go um l 64.
i don't want you to be 64. does it not
matter
is this the same i don't know that's a
little problem
um we need the copy
of copy yes copy oh don't you love
venue tills opinion is so useful we love
elfs
copy binary how do i do this i just
gotta do this
oh thanks thanks that's that's great
that's great if i was like a
you know a unix level
just you know what i love the computers
used to be like this never mind what am
i hating for
fuck all the javascript noob tutorials
you know
that's all the people ruining
programming right like they show up and
they're like oh not on a program because
i copied a react tutorial from the
internet but no this is programming bro
do you want to read the man page yeah
rtfm bro you know we got to bring
computing back to it's roof you know
what the problem is
money showed up and then fuckers showed
up yeah man computers used to be cool
before there was money and then the
fuckers showed up
because they wanted to get the money and
they didn't have the skills yeah that's
true what am i saying this isn't like
old man shit
yeah let's go
sorry is that the same as uh
firmware up in
not exactly they're similar but not
exactly the same
did this optimize something
did i forget some i forgot some didn't i
but i not copyright
or just somehow more
oh
what that goes up there
oh another one is here wow
what else did i forget the copy hmm
it's not 48 mod or something
what i forget
oh this b q z
and i s two s two one
jump
is it the same now
um
out
i should not have called it asm that was
a dumb name
call it firmware.com
uh now we have to output in that stupid
format
yeah look at look at look at my pimply
ass face bros
that's programming you know oh we gotta
make programming more inclusive for
everybody
you don't understand like yeah everyone
can do it but you don't make it
stupid in order to like you know imagine
it's like yo
we're gonna make we're gonna make uh
we're gonna make um
chess inclusive for everybody so instead
of moving around pieces you're just
gonna sit there and look at a board
yeah it's inclusive right you don't even
have to know how a pawn moves
you don't have to know any arm person
you don't have to know that shit just
you know
just make chess stupid and then anyone
can play
no see that's the problem with
everything man make it stupid
and then it sucks and the problem is is
socks and those people show up
and they're like oh well this sucks oh
we took all the value from this
oh what else can we go take value from
and whatever it is they show up and they
ruin it you know fucking
skillless losers man skill this loses
out what can i take man
sociopaths you know that's what happened
to silicon valley
that's what happened in silicon valley
guys that's what happened you know
kids if you out there if i'm speaking to
any youths
if i'm out there speaking to any youths
let me tell you the truth bros
don't come to silicon valley it's dead
and i'm not like saying that to try to
keep you out i'm just saying it's like
fucking dead man and like it sucks but
you know that's just the truth
ah so so it goes and so it goes right
um
integers required not bites
nah it's only gonna die you gotta get
the money out of it you know that's why
i love like oh man you know what i saw
you know what i saw
the pine risk five
computer it's like the only thing is
still like real is like this kind of
shit
um no no no no no pine
oh yeah yeah some kid just like
yeah this thing man look at this the
pineapple one
all right yo like you guys just have so
much respect for this man
i wish i had dedication like this like
this is a guy with insane
skills like
it's a risk five chip built from like
chips
you know the dedication time requires
another like skittles
man skittles counting
oh yes yes
this guy bought this many packs and had
this many skittles
like this is the only shit you can
respect anymore you know like you can
respect look at this you did like
data science on this right and it's
it's totally useless but that's the only
way you can respect it right
um because otherwise like you just can't
you're just like oh you know
the whole world you people all think i'm
like oh you know i see some of the
comments
like you people fucking understand me at
all it's like like
you know george is only saying that he
likes america because america is the
only place that
that uh that calm ai would be legal like
you think that i like choose how i feel
in life
to try to manipulate people like who
lives life like that
what kind of pathetic loser lives life
like that right
i like america because i like america
you know
i grew up here man
almost like to like manipulate some shit
man
you know i just forgot to be honest
gotta just kick these people out
you gotta you gotta have standards as a
community and like when these people
start to show up and like
they're kind of hard to spot right like
they're they're chameleons
they do a really good job disguising
themselves
right like it's they're psychopaths and
and
and they show up and they're just there
to extract value
you know and and i don't know and maybe
it's hopeless i mean maybe maybe
it's maybe this is just the fate of the
fate of shit man
but you know
yeah what can you do man what can you do
so it goes and so it goes
my python one-liners
we got it out with the same as stupid
firmware hex
fine you want lower face i'll make
you
but you know what you got to do man you
ever see
you know you guys know about the
national razor
national razor yeah yeah the national
razor man the national ray the star of
the revolution
so only one way now only one way
so it goes and so it goes
so it goes and so it goes right like
that sounds like uh oh i put that in the
next song so it goes and so it goes
all right look at that all right
to prove that we really compiled our own
custom risk shit
instead of loading in
two here we're gonna load in
14. let's go
i think that it's going to turn on all
the lights at the beginning now
i don't think we need any of this crap
this is coming all this out
yeah we gotta rebuild the whole thing
wait yo
are we doing from the uh
you know what just became a whole lot
more possible now
yo that guy's r that's cool
from the transistor the web browser
it didn't work
so it didn't work
that's shorter but the thing's not
shorter oh
because it's not a dot asm we called it
firmware.bin that was stupid
there we go
so it goes and so it goes well that's a
billy joel line
oh
no way
and so it goes and so it goes now mine
so it goes gonna be different it's gonna
be like that you know
and so it goes and so it goes
so it goes and so it goes
yo
i got this thing i had to i got this
thing when i was when i was hanging out
with the
the music house and just like yo you got
to make your musical concept
so simple that a five-year-old gets it
you know
that's that's i think the key to being
to being you know gucci gang gucci gang
gucci gang gucci gang
spent five racks on a new chain
my bitch
um so it goes and so it goes
all right cool
um
let's uh
let's just change it up a little bit
um risk five rotate left
whoa what's little v
do we have a soul
i hope we have a soul
shift left one
all right this should like make him go
across you know
oh that's it was in logical and
arithmetic shifts
there you go boys it's dancing
we gotta make it we gotta make it shift
better
also i think this is too slow
i don't get it like why do they do this
oh this is just some fancy way of
loading in like an even number
let's make it go faster
um
b eq
zero
restart
ciao
don't need this
yeah two's compliment and so it goes and
so it goes
the bit minip extension
is my code wrong
beq right
checks if it equals zero right
soul and beq
oh i forgot we need that louie
that's the address we're using down here
ah here are the registers function
registers and saved registers
saved
well the function doesn't use any saved
registers damn following that uh
can't believe we're rebuilding the whole
cpu yeah
he's dancing like it's christmas dancing
like it's christmas
yo want to do this let's check this out
windows got a package manager yeah what
is that packaging it's called chocolate
i installed it once
all right it's gonna be like white and
then it's gonna be like two color
yeah i got that two tone
that's pretty good right that's running
on risk
five on the fpga made with the open
source tool chain
how many people we got
[Music]
fujiki
eight ten all right
um
what else do we want to do
all right we gotta do the hard things
like make the serial work
and we gotta add some instructions to
our cpu
how many megahertz are running at you
think
uh so it's not actually a ur it's this
fancy you are that can do this like
bit banging stuff for jtag
uh so i'm using open ocd to bit bang the
uh
the jtag
i'm not doing anything i'm just hoping
to switch back and forth
uh yeah
i mean this is like these are the things
that are literally
in uh
in building a uh transistor web browser
like we have to build a uart
it's wild
yo yeah once we have a uh
once we have a uh
serial working i don't know if this can
actually
execute
this isn't wrong we have to figure out
how to execute instructions out of ram
rom
mem words
what's a word
this has memory
the rhymes that are just zero
i don't actually know if it has memory
no there's no ram it's a lie
wow yeah okay that's why the sock is so
tiny it's pico sock
oh so okay pico sock includes a you are
an
sram yo we need pico sock
yeah see look we're using addo sock we
need pico
sock
gucci gang
yeah see look it uses pico rv 32 right
here
whoa whoa
you're telling me pico sock has a
pico sock must be right before pico rv
32.
i assume pico rv 32 is here where's pico
rv32
simple you are
oh sweet we can steal somebody else's
you are
love stealing things from other people
whoa
any of that
i o mem
that stuff looks fancy
i don't understand that where is pico
sock instantiated
oh they have memory in picosock
place the following two modules with
wrappers for your sram cells
guys you don't understand
it's not value abstraction if you if you
steal
from from this guy
she doesn't have a license
yeah there we go it's not stealing man
they want you to take it you don't
oh
god i gotta you know what
yeah no you know have you people are
trolls man
we need to have a no trolling policy
let's put up a sign up it says no
trolling
and you don't want to come in here and
told on this point the sign says no
trolling bro
you know gucci gang gucci gang gucci
gang gucci
okay let's just put in a simple you are
is this is it this easy did i just copy
and paste the uart into my shit
maybe you are bros
okay whoever you are you really hack the
leds into the core
i don't know it's here okay that's in
the right place cool
um
and we need a uart too
i already did
module simple uart is not part of the
design
here
we have to connect
xdc
usb uart interface yes
um
because
so we have output c or tx
inputs here rx
i'm going to do the same here
fire it up uh
now we're gonna have to
i don't know if the inputs are inputs
you are txd n
you are an rxd out all right 50 50
chance i get this backwards
txd in
input
all right we're also gonna need to
figure out how to actually um
we gotta figure out how to use it we got
this great you are how do we use it
you
so
yeah well it doesn't do anything yet
because we got to figure out how to poke
the uh
we didn't actually use it we just hooked
it up hopefully
oh actually one way we can tell so you
can just go in here right
leds spy transfer
oh here we go
whoa
still checking the mem adder anywhere
there
oh i probably need to hook this up too i
don't i don't like that
yeah okay
here we go
i oh man valid yes
any of these wires
cool so now when we save things in those
registers
we get uh
my cues and everything
so those are wires
oh that's the data i get it
yo this is so cool
what's mem worcester b
um
should we code in c instead of assembly
i think we
make can work okay well you know who
hates risk factor assembly we'll just
say may not say
maine will copy that volatile shit
from firmware
yo you ready to code in uh
i feel like these equals one um
using our great tool chain
uh gcc
actually this should just work
all right
um
unknown type name what are your students
oh it's huge
[Music]
oh well that's a lot of code bros
i did thanks gcc help me out bro that's
better
um and then of course we never actually
want to exit
great
oh i don't know if all that stack
pointer stuff's gonna work
that seems better uh
all right we should get basically oh no
i forgot i forgot to sleep
can you sleep
oh it didn't work
oh is it possible that i broke no i
doubt it
wait what why is it generating tiny
assembly
um i don't want elf 64 a little risky
i want to generate yeah
here we go this
uh with arch v 32 high here we go
we need this
what
use
i mean march march and maddie
that looks better oh no we're still
doing shit with the sp
uh well
somebody that's going to optimize that
you have to optimize it to nothing
um
whatever we'll see if at least it
behaves better
so
all right so you see why it looks like
that it looks like that because we don't
actually have sleep
the leds are blinking faster than we can
see them let me see my iphone can see
them
you can see them in slow-mo
not even slow-mo on the iphone sees the
leds
oh maybe it can i mean look the whole
screen's kind of blinking
um inline
asm example
all right asm ah
so
let's see obviously the promise is using
the stack pointer now we can't use the
stack point
volatile register
not i'll try it in another assembly
t 0
uh add i t 0 t 0 minus 1
[Music]
b 1 0
loop
um wow
symbol lop is already defined hmm
plus the decoration oh
forward declare functions place
symbol lop is already defined a
inline assembly
loop
so the loop is already defined eh
where
one reference
how does this work
this little lop is already defined
hmm
why am i getting that error
use the special format string
she's trolling
hmm oh i think i'm saying no inline
yeah i think the problem is okay
but that's not the problem your loops
aren't called lop
uh local label in line
asmr
oh okay can i say one
one is local or something
all right
come on financial point start and
function delay
oh in order to use it you must have at
least one input
so you don't have to use it hey
okay for some reason it works now but i
added the quotie thingies
function lop 13.
um
does that work
gucci
seems like it works
marlene cost more than your rent
your ma still live in a tent
no function in line
you want the gcc specific no inline
attribute
gucci gang does work
that's what it does now
oh i think we gotta do minus eight
uh yeah gucci gang
didn't do the ad we didn't inline it
let's go yo we compiling c
to run on our custom risk five processor
to the fpga board
my lien costs more than your rent your
mom still lives in a tent
oh yo i get it i get what he's saying
about that he's not even saying he's
just dis
your mom is like yo i'm not even like
i'm not helping your mom out man
i got i got i got lean to buy i got that
i got that respect
um no this doesn't work
just like hey
that's right
but that might be absolute i can't be
absolute
oh yo minus eight is absolute yo
gucci gang uh all right so
lop doesn't work
lop works now
i don't even know not a shit be new to
me
work oh yeah oh yeah
c code yeah we got a c
code
uh do we want to compile a rust do we
want to get rust to run on here
she's doing rust does rust need memory
because if it needs memory
we are out of luck the only reason this
code works is because there's no memory
wait there is memory
i guess those those swoos just don't do
anything
it's just like swinging and ram
why is the stupid compiler like yo
yeah mom still live in a tent yeah what
you can do rust without memory with
nosted
no yeah should we code in rust boys just
because we can
that is
me and your grandma take
meds
i know this is this is the stupidest
tangent we've ever done
this has to be the stupidest tangent
guys if it involves rust it's always
stupid
rust no std
um
no i don't think so boys
i don't think so
this is the most complicated shit i've
ever seen
just terrible
yeah you do that and see
well that is cool though it includes a
cortex m crate i can
link to it all right we'll get there
we're not there yet
i don't think we can make rust work yet
all right all right we'll try a little
let's see who we got
all right main.rs how do i make a no std
main rs if i have to make a crate i'm
out how about that
but no crate if i don't have to make a
crate
but i have to make a crate i'm out all
right is that a fair deal
am i being fair to everybody if that's
the deal
rust c main
language item required but not found and
personality
yeah like a loot box yeah
no no no i'm not making any crates
oh i need a target
is that what i need
can i find crate for core target risk
5 rust
nope this definitely involves crates
boys
language item required profound ah
personality
panic handler function required but not
found
all right we need a language item i
don't know what a language item is
can i like is this like one of these
things that i like walk around
and i i like like oh oh i found a
language item oh
yes perfect oh yes zzwx yeah
yeah language items are subject to
change
damn it all right um all right uh
take key uh walk
through door okay
change language item
oh no not found not found not found okay
all right oh explain oh yes yes of
course rusty explain
e058 oh
oh an unstable feature was used okay
okay the table is unstable i i
understand all right um
no air personality okay
but i need an app personality okay what
if i just have a laying at personality
now i need an item
uh
[Music]
okay language item required but not
found
at personality oh if i disable stack on
winding it'll fix
that okay good good good oh no that's
not where i disable stack unwinding i
see
oh yes a freestanding rust binder all
right disable stack unwinding
oh it's missing a panic handler okay oh
yes
language items are special functions and
types that are required internally by
the compiler
mark's a block oh
we just have to change the cargo
tonebell no no no no no
no crate
um
all right all right all right how do i
how do i pass this to rusty
oh yes
oh is it dash c panic abort
i don't know we don't need profile devs
anymore okay now do i not need an amp
person
oh oh yes yes
entry point main undefined for
architecture arm64
okay okay how do i tell russ to not
compile
rust output assembly
amid azim oh
main dot rs main.s
oh but okay wait we do have to tell rust
that i'm using
rust c output c code
oh i just rm to my main rs okay we have
our main rs now i i forgot that reb
they were rs okay
all right that looks like it's going to
build
now we need a main function
and we also need to figure it out rust
risk 5.
does rusk support risk five
oh yes target yes rust up target ad
oh good perfect oh yes rust stop not
found
i need rust up brew install rust up
oh through install rest stop all right
how's the song doing we're getting likes
oh we're getting so much likes
there's so many likes boys twitch stream
brought me here this song is lit yeah
love when you guys say good things i'll
always say bad things too because all
presses good press
kids oh man i still don't have rust
stuff but i installed rust up i don't
get it
oh rust up a net eh
did i do it wrong
oh okay wait wait i need to do rust up a
net
rust stuff should not be installed
alongside rust
fuck
um
all right who's over rust we tried rust
was too hard and useless
all right this just reinforces my idea
that rust is hard and useless
i'm not liking rust rust is over
sorry i didn't have the right
personality type for rust
or whatever
you
good old c we love
c she's a great language you can do lots
of great stuff and see
you know like linux is written in c
no more app personalities
one day we'll do one day we'll come back
to rust
psych allied fuck rust
mom still live in a tent
me and my grandma take meds
gucci gang gucci gang gucci gang
spent 10 rocks on a new chain
your bitch la do cocaine
gang
ah cool what do i gotta what do i add
there
make it shorter
[Music]
make a new script called all which just
does all even though i get those in the
wrong order one of these times
and we're gonna have a bad time
from the projects all day to project
runway
oh look wait
the fucking way look at that light
blinking
look at that light yo hardware's so easy
boys
um console.pi we need to use that lib
ftdi python that we made work
pilot ftdi yes
uh i don't know what baud rate we got
but how do i dev read
read missing an argument eh
one
i don't baught right
that's a better baud right i'll wait
no it's always zero
uh okay probably not the right baud rate
let's pick a better ball right
reg you are clocked in what the clock
but look look at that light blinking
that means something's getting written i
think
um i don't know let's try 9600 man
that's a better baller
no you know what i need i need an
oscilloscope
look at his mold tea
well that stuff looks pretty nice
sock bod
all right well so like we don't know
oh it stopped
i stop blinking
okay back to blind
okay so if we're louie
mess then this is this many
so it's every one of those is counting
to a million wait i can just look what's
a crystal
you should be able to look at the
semantics of this board right
the rda7 includes a single hundred
megahertz
clock wow
there's so many megahertz can we handle
that many megahertz i don't know
probably blinking so little no water's
not receiving anything
it's all zeroes
all right simple you want i could add a
soft top
yo if we were using rust we'd still be
trying to figure out the air personality
you know
ld9 is the
okay why is it called clock 50.
oh because we're inverting it okay so
it's a 50 megahertz clock
how many bytes is reg div
di
i'm gonna divide as much as i want to
give this 50 megahertz
divided by we want to get a normal baud
right we need
uh i'm gonna make that hold on
i've been
vouchers
all right now let's console that
yo
[Music]
oh i can't open it because i'm pragging
all right frog
you know how i was like you i'm that
upset soulja boy
i copped his line
ew
[Music]
now i'm scared every time i press that
button at the lights blinking
it's blinking it should be outputting
shit
434 i'm pretty sure that's what the
divider is supposed to be
i did it right did i not
maybe i didn't like
and wire it up right
that's all wired up right i'm talking
about this
or maybe i mixed up rx and tx it's
always a possibility
memoir data that's just for read don't
care about that
it is w star b
those like words what
oh does the size really matter
i didn't fight um
oh
i see okay so if it's selected we pass
through wrb
that's fine
i'm not putting them anymore
it was blinking that light i don't know
i reset the chip
how is user space kernel panicking my
computer by the way does mode
t mean my device is in the wrong mode
let's not do tea
no use
what if i write
okay maybe i mixed up my inputs and
outputs sometime i do that
let's put this at a9 and miss a d10
and how come there's no difference
between inputs and outputs
you know why don't they label the things
the receive ld oh it's the receive led i
see
so it's receiving something now
supposedly
allegedly
no it's not doing anything anymore
seems worse
if i say if i equals equals three
hmm nothing
does it never equal three oh it never
equals three i'm an idiot
you guys should have caught that
oh yeah okay now it blinks every time
so if you see very closely on ld9 it
blinks every time
the receiver led oh
oh the data terminal equipment in this
case the pc
okay
so why does this work is my clock div
wrong
um
show me a u give me a u
okay it's definitely blinking every time
can i get the idea this clock did wrong
i do i do set it right
yeah finally 434 save okay
here we save you
into that okay that's right
oh mo t is text mode
i killed my questions more about this
this should be transmitting and it's not
i don't know like we didn't really test
this
um
yeah maybe just the python doesn't work
which means if we actually like plug
this into a linux computer you know it
might work
uh we need an ftdi driver
back where we were here
uh
weird
can i use the jtag interface you know
there has to be a lib
ftdi console right
oh what do you think of javascript voice
create a junk directory and that's what
we'll put the javascript
no it doesn't work
ftdi lib usb python
pi ftdi
all right all right
let's try this one
you
are there docs
cereal x
all right let's try this one instead
serial for url
all right
my yards will it work
cool
i'm not receiving anything
oh but it is transmitting now the
transmit light is blinking
which is more than i can say for the
other one
see look that's the transmit light
so now i think it really is just a baud
right thing
oh yo is that a u did we did we just
send a u
do you think there are updates
system preferences updates updates
software update automatically keep my
mac up to date
is there like some update that i didn't
install
and go stole me updates
oh yeah look i got a new yeah
oh well okay i'll probably have to do
that update
i don't know boys this is a pretty good
place down the stream i think
let's just prague quickly and make sure
that like nothing got erased
yeah because they wrote the currently
fucking c plus plus lines four volts
knew better
yo look at the use we're sending use
hey just so you boys don't think this is
a scam
all right i wasn't even gonna call this
commit not a scam
um we're gonna look i plugged into a
different usb
port too so if that was a problem i
fixed that because we had some usb
port issues before where we're sticking
it in the wrong hole you know
we'll stick in the wrong hole boys don't
stick in the hall
all right let's go let's go let's go
let's go let's go okay if i equals four
we're gonna make it say hello
probably is not going to work actually
because we probably need to implement
flow control
i don't know
might just send ours
or it might block
you cannot be sure
no i didn't put the bit stream on the uh
on the core it's kind of useless
mmm all you gets is zero
no i'm in s delay oh
i can't do it because of lop
flop two of course
[Music]
yeah loading the big stream is not slow
what's slow is reprogramming this whole
thing
to fit the new we're gonna put a real
boot ramp in this thing the boot rom in
this thing you know
for boot ramen and then we'll be able to
download code
yo we're doing we're doing from the
transistor to the web browser boys we're
doing it
we're doing it who named the stream the
wrong thing
who named the stream the wrong thing yo
hello
hello i don't know why it's the first
one's a zero
hello
delay before age shouldn't need a delay
before age we can try it but i don't
think i was going to fix that
i think my clock is wrong or something
i'm just like because of ray leds
yo i'm so happy we have legalization
right here
good thing it's doing that i want to be
illegal
no i didn't fix that
yo let's try reading more than one
does that block until it reads a lot
it just blocks this junk
i don't know
where's the hs scam oh did you try to
put the h in ram
s5
that's five's h
this five is not an alias for t0 or some
crap right
yo my s5 register is broken
you know like seven different things
could be wrong
oh yeah look look at look at look at the
blink
why is it receiving something
oh because i'm sending oh that might be
the problem
no i lied that's not the problem
all right well you know it's like
british this is lo
hello
is it possible it's too long
all right god
ah how long is it gonna take to download
anything over this uart
i wonder if i can clock it at
to put a dummy letter at the beginning
and call it a feature
reporting quick js to risk five
which is important you are yo you know
what you know what we're gonna do
in the next if we do another one of
these i don't know if we're gonna do
another stream and then we'll do another
stream
but we're literally gonna download ram
like who said you can't download ram i
just downloaded a uart
i'm gonna download ram next what else
can i stick in my chip
and then we're gonna send out this chip
let's let's uh oh let's let's play with
that for the rest of the stream
i gotta i gotta go eight
um
is swap not downloading ram yo slap on
stuff on
how much of the fpga fabrics unused i
don't know
one of these things probably tells me i
want to build and they'll tell me
i mean i can't really know before the
router right
here we go dude
that's unreal
she was like none of the fpga
tiny grand accelerator made from scratch
you're close we're gonna make it in
verilog because we're not noobs
but yeah we're right and accelerating
for tiny bro what do you think we're
doing
um well
so it kind of sucks
that uh
the cereal
is the only way to like do things
i like the way you think dreamcuber
you're right yo
yo you guys want to make a 50 core cpu
and then pitch it to investors think
about it think about it think about it
think about it
all right amd cpu
number of cores
64 cores okay so what we
can do
is we can put 80 cars on
and then we can pitch investors all
right i'm just going to replicate that
80 times
and we're going to tell investors that
we have a prototype right here
of an 80 core cpu
and clearly when you google amd cpu
number core 800 doesn't fit
when you google amd cpu number of course
you only get
64. and that includes the uart so maybe
with some optimization we might be able
to fit 100.
what do y'all think
easy vc money that's what i'm saying i
got 100 core cpu
that's right let's raise money boys
let's raise money
and then let's rent a house and just
party for three months
and then just talk about how you know
shit didn't work out man
oh hey sorry about your your money bro
sorry about your money
i'm not saying i can do this but like if
i was like
you know
man you know
80 course e
course
so
we call her i love her
so
oh they're hitting the eye man
um
whoa
e fabulous eh
this stuff's so cool
no what is this spacex basics
number 239 tries
yes
yeah man let's partner with evapolis you
know
we core we core we're looking for
partners we're seeking we're seeking
partnership deals
man you know
imagine i didn't pick something
impossible like self-driving cars
now the truth is i've been picking
something impossible i would have gotten
bored
oh yo i'm probably not supposed to talk
about this
but i got a ride in a tesla full
self-driving beta car
and uh let's just say it didn't quite
look like the videos
not that the videos are are fake but
i wouldn't say they are representative
of typical performance
we'll just say that
and apparently tesla has deals with the
people who have it they're like
you know you want to keep it make sure
the video makes it look good
so where can i get a chipman make
chip online
poor people
small run fat
what what are we gonna do with tiny grab
we're gonna
all right so we're gonna do a reverse
merger
with weak or um
and then
all the money weak or raised for their
80 core cpu
is going to go into tiny grad
um how do you put money into a github
project
uh we'll have to spend most of the money
figuring that out because you can't just
put it in the entire product because
anyone can steal it
we've said this since december bros
gotta keep up with the tiny grad repo
the money is in the blockchain
where do i
why is that so big looks like ram
no no we can we can't get five nanometer
[Music]
um
where to get chip made what's a hackaday
fabricate let's try fabricate asic
zero asic
no no okay maybe q flow knows it seems
like q flow would not
here we go x fab
ah all these processes are terrible i
want a tiny chip
one of those enemies it's like i can
like see it
well they can make image sensors i
am angry at image sensor people
2014 nanometer fap
all right fine i'm fine fine i'll settle
28 now to get that
sam's a loop yo that guy probably knows
i've had him a bunch of times
now
relay
no i've heard of these before
bezos looked at the who's moses
i'm always like yeah yeah some of you
people probably know a lot about this
like i'm a noob
oh yes yes this is exactly what i want
seven
eight twelve oh
nine what's nine hp
eight xp
all right so how do i use this thing
how do i send my chip
how do i order
[Music]
learn more
i gotta talk to contra i gotta go to
tsmc
it sounds hard
so
oh that's what abc is
um
q router
how many nanometers is this
wow that's crazy i can get stuff that
looks like that
weak core is definitely doing its back
you know what let's just back it right
now
who wants to put money in 80 course
does morgan stanley want to put money in
hey morgan stanley you want to put money
in
someone's got to pay for our fab to fab
our 80 core chip
q router process node
um i forgot the keel
like these people did it
they use q router
130 250
you know what's this crappy though like
if you get like a like the the panda
90 nanometers
16 out of here
no
that's scam
fabulous foundry global foundries
yo yes let's do a reverse merger with
tsmc
remember how mcdonald douglas bought
boeing with boeing's money
that's working through tsmc a weak core
what's a shuttle
wait
you're telling me
you're telling me
what's that the spy software
i get 10 square millimeters
and it's a hundred thirty nanometers for
a transistor right
it was a hundred that's like that's like
a hundred million transistors
what's this though is this a spy chip
sky 130
yeah i gotta go i got date but
tape out june 18th
yeah let's go
we're going to build the accelerator for
10 grand
and then we're going to pre-sell them on
kickstarter
for what do you guys think
how much would you pay for a custom tiny
grad accelerator
usb
i hear 500
i hear 300 i hear 970 50.
i hear zero
yo
like girls who talk about philosophy you
find
women like delicious tacos there's
someone's podcast delicious tacos was
talking about like
it's like women understand like books
better than you and understand like all
this subtlety that you don't understand
i don't know i meet girls like that's
really cool
five hundred dollars
give me a free sample
all right
what do you guys think
199 not not too much
what do you think
what do you think one hundred dollars
ninety nine dollars
ninety nine dollars and it will
accelerate your tiny grad
to be just as about as fast as your cpu
how many tops all right
eight times eight times eight times two
and let's say we can run it at how many
megahertz
how many hey what
what process is this
oh and it's a little one man
two and let's say we're running at 100
megahertz
102 gigatops
what do you think a dollar per gigatop
all right guys your tiny grad
accelerator
can be used to mine tiny coin
i'm hearing 149 i don't know if we can
fit a cheap
miner in there
what 100
100 billion
ten drops per second
i think that's pretty good boys
i don't think you'll find a better deal
than that anyway
i mean yeah like
you could buy a google coral
and you know you could
pay 59 and you could get
four trillion dogs but
that doesn't work with tiny grass
there's tennis touring spies yo
it's really decided it's 149
but don't worry it was originally 1.99
don't worry
149 originally
199.
you can buy your very own tiny usb
accelerator
and we're going to tape it out
with chipotle knife
how much per chip is that
32 dollars a chip oh wow
we better sell these we got to make our
money back all right 10 millimeters
square
it's really tiny
hmm evaluation boards eh
harvard shuttle
you do a sponsor chips boys
thank you all for watching
have a good night be nice to people
don't scam people
um everybody
check out my soundcloud make sure you
subscribe
if you like this content we did a long
stream today
um we got a lot done
bye everybody
today it's stream saturday let's put
stream saturday in parentheses
stream saturday
who capitalizes saturday it's called
stream saturday right like let's
you know i think it's really funny to
mock like branding
like when people try to like brand stuff
and stuff
i think it's funny stream saturday like
like that phrase has
i'm putting some socks on ah cause you
know my feet are called
uh that phrase has no meaning at all but
like it's the kind of thing that you can
like say
it's stream saturday wow
you know we should we should
imagine we could put an end to
advertising because
everybody just understands it like
i don't know what it is you know i
remember i worked for this place when i
was when i was like
i was 18. it's called uh automated uh
media uh and i just i didn't get it like
i didn't get who the ads were for
because they clearly weren't for me
except sometimes
when i see some pizza hut pizza i do
want pizza hot pizza
and then i remember how nasty it is um
so i think we're going to start before
we get into the stream
i bought something that i want to show
you guys
it's uh this little piano a little piano
here
um and we can uh you know i think i
think this is a great uh
you know gucci piano that's right
gucci piano i'd listen to that if
someone if someone wrote a song called
gucci piano i mean that's like where we
are tonight
all right yeah you got a gucci piano
yeah i got a gucci piano yeah i got
gucci piano yeah i got gucci piano
you know i'll put some of that noises in
maybe we could get the airport
gucci piano i got a gucci piano my dad
and i did i did a ben's truck cover
and he's here ah
software instruments
let's get some let's get a nice sounding
piano up in here oh i don't know if
there's a mic working i got a gucci
piano
yeah i got a gucci piano
consequences will never be this
consequences will never be the same
right like we could we can sample that
should get that on the sample uh
i want a piano steinway grand
oh that's a nice sound a piano yeah i
got a gucci piano
let's put some volume all right so
you're all asking what keyboard i'm
using
it's the impact lx25 um
and then uh this is this is i think the
most appropriate uh
song you know for for america and for
uh
july 4th
[Music]
not bad right right right where are all
the stupid people from
[Music]
and how they get to be so dumb
bread on purple mountain range fed amber
waves of grains
to lesser human beings zero feelings
human nature man's destiny
blame it on the greediocracy
the fear of god the fear of change
the fear of truth
maybe we can we can we can lower the
screen a little so you guys can can can
see the piano
yeah gucci piano and the bill of rights
subtract the wrongs
there's no answers memorize and sing
star-spangled songs
when the questions weren't ever asked
is anybody learning from the past
we're living in united stagnation
we're getting to the google quarrel but
first we're doing a cover of the decline
father what have i done
i took that 22 a gift from me to you
to bed with me each night kept it clean
polished it well cherished every
cartridge
every shell down by the creek
under brush under dirt there's a carcass
of my
second kill
let's try that again
down by the park under stone
under pine there's a carcass of my
brother william
brother where have you gone to i swear
i never thought i could i see
so many times they told me to shoot
straight
don't pull the trigger squeeze that will
ensure
a kill a kill is what you want
a kill is why we breed oh i think i
think
for this part i think we need to get the
piano
i think i think we need to get i think
we need to get the real piano this is
the impact lx25
but i think i think we need to get some
some bigger piano up in here you know
yo i got a gucci piano i got you know
when did this song come out man
because because you know it's still so
true and if we felt like we're in
decline
for this long i don't know like 1991
wow so this is pre-911 man
you know you know i'm sad like what are
we gonna do man
we're living in a country in decline it
sucks you know
like the romans knew it too they didn't
get to enjoy another couple hundred
years after caesar showed up
all right so we got we got to bring this
piano over all right we got it we got a
better piano now
oh yeah all right but where am i going
to plug this piano
in uh oh well let me see which plug this
one goes to
oh is that the monitor if we unplug the
monitor things like crash
okay i'm gonna do this very carefully
okay good
i got a gucci piano yeah i got a gucci
piano
all right
oh that's that's better that's right
what do you think
we'll bring the uh we'll bring the uh
the microphone a little bit forward here
all right and we'll just make this a
little bigger on the screen
uh don't don't auto scroll no no no no
water scroll off
bad javascript all right this is what
we're up to
ah let's go
the christians love their guns
the church and nra
wait what is that
[Music]
pray for their salvations
pray on the lower face
the storybook's been read and every line
believed
curriculum's been set logic is a threat
reason search tenses
[Music]
wait we gotta move the microphone a
little oh yes i love the story of jerry
i love the story of jerry oh this is
this is
this is a great this is a great uh
[Music]
so
are you guys ready this is a sad story
man
jerry spent some time in michigan
a 20-year vacation after all he had a
time
a dime is worth a lot more in detroit
a dime in california a 20
fine
[Music]
jerry only stayed a couple months
it's hard to enjoy yourself while
bleeding
out the ass asphyxiation is
simple and fast so that's john mcafee
it feeds 17 fun years of being someone's
bitch
don't think drink your wine
watch the fire burn his problem's not
mine
just be that model citizen
[Music]
you know it's a real shame about the
woke fucks
who took over punk man cause you know
this song's based
i wish i had a shilling
for every senseless killing
i'd buy a government
[Music]
america's for sale and you can get a
good deal on it
and make a healthy profit or maybe
tear it apart
[Music]
start with assumption
that a million people are smart
smarter than one
[Music]
serotonin's gone
she gave up drifted away
sarah fled thought process gone
she left her answering machine on
the greeting left spoken sincere
messages no one will ever hear
10 000 messages a day
a million more transmissions lay
victims of the laissez-faire
[Music]
one empty hand
oh no we gotta oh yeah it's
now it's serotonin and gone
[Music]
you could send a message to that sub
[Music]
i think we'll skip this verse
[Music]
this is i think this is a good place to
start uh
yo guys
save us the human existence
is failing resistance essential
the future written off the odds are
astronomically against us only moron and
genius
would fight a losing battle against the
super ego
when giving in is so damn comforting
and so we go on with our lives
we know the truth but prefer lies
lies are simple simple
as bliss why go against
tradition when we can
admit defeat live and decline
be the victims of our own design
the status quo built on
suspects why would anyone stick out
their
neck fellow members
club we've got ours
i'd like to introduce you to our hosts
he's got his and i've got
mine meet the decline
yeah man
um you know
how the fuck man how the fuck you all
watch fight club and the matrix
oh you don't listen to that song so in
1999 and then what happened man
what happened why do you all give up you
know why'd you all give up
why do you all give up you know i can't
believe it i can't believe fucking
bullshit
i get by email you know like you try to
like talk to people on linkedin that's
hopeless like i'm like oh man where's
the population right for
these people are valueless fucks you
know you think oh
but no no you can't so um you guys don't
get a stream to get today
you guys just get a rendition of the
decline
uh because that's you know where we are
right now
um yeah you know what could i could i
uh yeah yeah like my google coral could
i could i take my google coral
could i you know tell you all oh look oh
the systolic matrix yeah man
but you see it doesn't matter right like
does it matter how
do you win how do you structurally win
will they just always find a way to own
you
i'm not you know i thought god i'd
rather i'd rather
i'd rather smoke weed all day than like
contribute to the system man
that's the problem that's the problem
like the system has this way of
systematizing
everything
oh
yeah i mean that's you know
that is the tragedy right why are
engineers
such bitches not everybody but i mean so
many engineers i'm like they're such
bitches right like they they just
they give in to the professional
managerial class
they let these people who are idiots who
who
celebrate mediocrity come in and tell
them what to do
why oh you know
what what what is it what is it oh it's
like uh
you know it's just comfortable it's
comfortable man
yeah you know why try to beat them when
a million others try
it's true it's true it's true
um so i don't know
you know that's that's what does
what does a structural victory look like
uh hi i'm good at stuff
trying man open pounds really damn good
you know we can build things
we can build things this mentality can
build things
i never thought we were actually you
know maybe maybe i don't know
who thought we were actually going to
win self-driving cars
like it's really good and when you think
about that landscape it's the only sort
of thing with a path
forward we made some bets very early on
that were correct
but i have technical control
and that's not like it's not it's not
i'm not complaining about anybody this
is this is nobody
this is not any like oh you know this
person's oppressing me or anything
it's it's a system which encroaches and
the thing about the system you know this
is the same reason i don't do crime it's
like
the system is relentless
um this is why you do offense and not
defense right if you're doing offense
you only have to find one exploit if
you're doing defense you have to find
every exploit
um and you find every bug you don't even
get the joy of writing the exploit
you have to keep your guard up every day
against this absolutely relentless
system
it's so you know uh when giving in is so
damn
comforting you all got bait and switched
you all got this instead of the google
core yeah i bought a google coral yeah
we can look at whatever their bullshit
is you know they open source the driver
it's like a hundred thousand lines of
bullshit um
you know they could have made something
simple and beautiful
but no it's not simple and beautiful
um i don't think i was ever really
controlled by the managers
uh i was thinking i was thinking a lot
about the unabomber manifesto and you
know of course like
it doesn't provide any solutions
as someone who wants you know yeah like
live forever and go to mars and stuff
right
you can't blow up technological
industrial society there's
technology is great nobody's ever saw a
refrigerator and complained about it no
one's ever saw a tin can and been like
shit man
i really loved carefully boiling water
and coconut shells
like technology is great
and i don't think the problem is
technology i think the problem is
these people and this terrible way of
thinking
um who the unborn also rails against
right and he describes them as leftists
but
i don't think it's leftists i think that
um you know if
you asked uh fat mike who wrote this
song he would describe himself as a
leftist right so like you know be
careful don't don't become uh
you know ammunition in their stupid war
um
so much racist shit out there today
can't believe the race is shit it's all
racist like you know the
anti-racism and racism are like here man
you know they're like you know it's like
love and hate man and then there's the
other side which is apathy right
uh it's all same shit um
you know the same kind of wall it
doesn't matter how you know
divide and conquer i don't know if the
system does this consciously
or i don't know if the system like
just just evolves to this point
is it human nature
uh yeah i know but
ted's arguments are nice the problem is
his solution
you know blow it up and let people deal
with it later you know i i think that
yeah he might have lived in wild nature
as someone who's recently purchased some
wild nature
uh yeah guys like
i'm not opposed to it but it it does
kind of suck
oh you want to drink that water that's
kind of sketchy
oh you want to not have rats scurrying
through your trailer at night oh well
that's going to take some effort right
like you know here i rent a nice
apartment
and i pay for it to be rat free and the
rats are somebody else's problem which
is great
um
of course politics is useless i'm not
none of the stuff i'm advocating for
here is political solutions right
um no this is what i mean when i when i
say politics is for losers i i don't
mean like political theorists for losers
there is no there is no greater ambition
of man
than to conquer a sovereign country and
you know make it his own
right i think that if you want to call
that politics that's just great man
um i mean the fake game that you know
the people play right like they made
this little mini game for
us to try to satiate uh you know this is
what
this is what they do right like they'll
take an ambition and they'll sell
you know what if they ever make
psychedelics legal if they ever get like
you can like uh
you know come to therapy for a mushroom
trip or or an mdma
um it's going to be terrible and it that
this systematization of it is going to
destroy
everything that is good about it
uh even this almost happened today with
smoking weed
um you know like drinking is drinking is
is
is terrible like look at the bars the
bars
alcohol you know a bit of alcohol is
great and then they make
bars which have music so loud so you'll
drink more
and then people go to it and like they
go through this like cycle
of you know
do we break it do we ever break it
do we ever break it or why try to beat
them when a million others tried
um
bars are not great anywhere
[Music]
oh great to hear someone talk sensibly
about drugs and alcohol yeah man
this is what you get when you're not
brainwashed into bullshit
alex and i were talking this morning
about like what could shatter our world
you know like what would it take what
would it take for something to come
along
and shatter my worldview the answer is
nothing because i spent every day trying
to shout out
one solar storm one big room
full of bad bitches
oh we'll get rid of the internet you
think this this came out in 1999.
it's the same problem
right so like i i do know for a fact
that
this problem at least existed 21 years
ago
i don't know i don't know what life was
like in 1900
i don't know maybe this problem didn't
exist this problem
there are some things that do lead you
to believe
that it happened more recently yeah
like this all right um
oh it's an ad for bitcoin um
this is you know in 1919 uh
71 is the year they made the money fake
uh and yeah you know you could you can
uh
you can say that okay these graphs are a
bit cherry picked um
but uh
i love this i love this is a hayak quote
from 1984.
i do not believe we shall ever have good
money again before we take the thing out
of the hands of government
that is we can't take it violently out
of the hands of government
all we can do is buy some sly roundabout
way
introduce something that they can't stop
is that even a real quote like that it
almost seems too perfect
you know python flask dev wanted paid
and cheap
um
solve this issue
all right limit
i don't understand
i love seeing people use cheapy
right you know god
the the problem like cheap
tries a very sad you know it's a very
it's a very shitty way of solving
the main problem in crypto which is
speculators
um speculators are
cancer and i'll define very clearly what
a speculator is a speculator is somebody
who buys something
not to you not because they have any use
for it but just because they think
somebody else in the future will pay
them more money for that
right and i'm not talking about somebody
who invests in a company right you
invest in a company the company deploys
capital does something with the capital
gets better right i'm talking about
somebody who buys a scarce resource
just to hold on to it until somebody
else wants that skills resources willing
to pay more for it
this person is just a cancer and
yeah you know cheap eat is for using and
loving not for speculating
um there's a technical mechanic for
for chibith uh and we could actually
probably enforce this in more
in a better way than you know proof of
uh you know goku doing it which is
he has control of a pre mine um and the
pre-line
you know he says look i'm going to dump
it on speculators if it gets above this
price right and you could do that but i
don't think this is actually
economically sound um goku just asked me
to put it in there because he's like yo
yo pre-mine bro um
advice for dealing with managers quit
your fucking job man
great job you know i was listening to
this podcast
and they were talking about how great it
is that work is going remote
so now people can come together and
live amongst people who share their
values
why don't you get a job amongst people
who share your values
you're like oh it'd be great all these
people who share values can congregate
in one place
like that's what comma is
you know i don't know like i guess these
these modern corporations don't have any
uh
i'll use a phrase like you have you guys
heard the phrase globo homo
it doesn't mean what you think it right
like it sounds like but no
global homo is um the global homogenous
culture
it's how a cafe in paris looks identical
to a cafe in new york looks identical to
a cafe in california right
um so yeah i mean these corporations
have no ideals beyond global homo
and like how ridiculous is that that
these people are trying to
we can reinvent towns where people share
values like
god why don't you just start a company
and like just because these people don't
have values then you know
um
not everyone is a super duper programmer
that they can choose a company
i think you don't understand though i i
think like if i had no programming
skills
like i'd live in a basement and write
music
like or or you know i'd i'd
like do one of
seven million other things
there's so many things to do that don't
involve programming
i'd i'd make furniture out of wood you
know
whose basement when i live it anyone
will have me maybe i'll just squat in a
basement you know
um no i have programmer skills money so
you know but
um yeah
yeah i don't know you know
oh i didn't try github co-pilot yet
can you live in my basement fuck no get
a job
no the talks don't go anywhere ah you
know it's worse than that i i wonder if
some of you
just watch these talks and then you get
like the feeling that you did something
without actually doing anything
i've heard that like this is like the
point of movie propaganda it's like you
know instead of someone actually going
out and like
like like you know shooting people on a
subway they watch the joker movie
instead and that impulse is satiated
god and then like what do you even do
about that you know
like reading fucking self-help books
that's right
that's right ah
all right i don't know do we even want
to stream today i don't know what stream
i talk to y'all about what i want to
talk to you about i want to go listen to
the decline and like
how many of you can we get it can we get
a poll let's let's do a straw paul let's
do a straw poll
all right not straw pool
all right we're gonna we're gonna create
a poll and i want you guys to do it okay
are you the problem
yes no
but i don't really
spend time
fighting the problem
no and i spend
a lot of time fighting
the problem well actually let's just say
no but i'm kind of
i'm kind of apathetic to the problem
no and i spent a lot of time finding the
problem
insert uh excuse
here all right
ip duplication checking browser cookie
duplication checking
improve spam prevention oh yeah you
gotta do a captcha
and no you can't have multiple okay all
right
all right i i'm gonna go with this one
no you know what
i can't even like if i click one you're
like you know don't don't fucking like
answer it honestly bro
it's an anonymous poll on the internet
right
all right no but i'm kind of apathetic
to the problem
is number one yes but insert excuse here
thank you for being honest we always
appreciate honesty on this stream
wow this straw poll site is pretty good
okay i think i think we have a pretty
good and god this is even my demographic
okay
that's another problem everyone knows
the problem
this is interesting thank you for being
honest 64 people
this is my demographic
everyone knows the problem yeah
well you spent time you gave up yay i
understand that
68 of people aren't part of the problem
i'd actually believe that 68 of the
people on this stream are not part of
the problem
um i i think a lot of people are our
students here
uh and i think that yeah they're not
really part of the problem
uh and i think they're right so i i
agree i don't think any i actually don't
think people lied it's an anonymous call
on the internet
um thank you 214 people for answering
uh this is twitch demographic and yeah
i wouldn't be surprised if this is
actually the demographic across almost
all of twitch
gme will not fix the problem gm is a
purely secular asset
let's eat berries
um i'm not you know
i'm not i'm not gonna lie
i do lift bros twice a week bros
can someone explain what the problem
actually is everyone understands the
problem
wall street made money off gme more
money off gme than the people ever will
anyone asking for the problem to be
defined is the problem yes i agree with
that
because i mean that's exactly right
like the systematization right
as soon as the system can define
and like polarize the problem
like you know what i mean
as soon as it's become formalized
less gambling less video games less f1
race cars less advertising less stock
trading no
actually really only two of those things
are the problem with advertising at
stock trade
you have a problem with f1 race cars man
the cathedral's win condition is
hegemony
let's define hegemony
our win condition is an alternative to
cathedral as a driver of culture and
politics when it seems easy to maintain
wow
um spirituality
and religion like
today maybe you can define it as an
alternative to the problem
because uh the ruling class
is not um religious
but i'm not that
sure it was better when the pope
ruled right i bet it was the same kind
of bullshit
um the problem may be fundamental to
human nature and this may
i guess i guess maybe we can try another
poll for this i'm not sure this is like
a factual question
but like let's let's try it let's try
let's try one more poll
when did the problem begin
um let's say 2000
uh 1970
um 1900 uh
you know circa
um all right actually let's say
uh around industrial uh revolution
around agricultural
ag revolution or are always
a part of human nature
so
and this is less a personal one i just
wonder what people think
yeah okay
so
so
i suspect these aren't right
um
like
i find it interesting that this one beat
out this one
if this is true
then
i think i've tried to search for this
before
yeah i might have even found it
no i think i think i went through
exactly this before
there's a line in one of the idea songs
where it's like
um what we can do
is we'll develop technology that's
capable of rewriting human circuitry i
think we're already doing this
um i've heard an interesting theory that
the rise of
radical wokism corresponds to ssris
uh no i don't know you know correlation
causation and all that
why capitalism isn't the problem i can't
even dignify that with our spots
okay all right all right all right all
right we're gonna try
one more we're gonna try
one more pull are things getting better
always have been
um they were
but now they are declining
they weren't
but now they are starting to
always have been getting better
always have been getting worse
oh things weren't always will be the
same
you're right i should have added that
option
you're right i forgot an option
well yeah
i don't know i think about why i forgot
that option but
i'm in this camp
um i think that in general
it looks like uh
all right something like that
uh on a log scale
like you're gonna have local dips but
they're only ever local dips and in
general things trend toward being better
um yeah techno optimism um cool
thank you for participating in my polls
all right should we should can we can we
stomach it can we stomach the google
bullshit
um
why do i think things were the best the
90s but
it's just because childhood's the best
man
oh i can't you oh someone sent me a
secret
oh
[Music]
someone sent me a secret link to buy the
xilinx cards
um
pole date is free take a screenshot bro
to realize that we live in absurd
culture we're taught absurd things by
absurd people and threatened with absurd
consequences we're defying
all of this
i like that i like that
um are we still thinking because you're
a vip i'll click your link you know
it's very unfortunate that um
a lot of uh this stuff
you can like there's like you know
fringe right-wing bullshit
that like pops up when people talk about
it
which does say something about you know
the cultural health of the left and the
right
uh this is probably pretty american
specific
um but you know growing up it was
everyone who was thinking is on the left
and now it's everyone who's thinking is
on the right
right it's like kind of interesting like
that i don't actually think that they've
changed at all i think that
i don't know there's just the way this
this and maybe this is a very uniquely
american thing
um
yeah no i think
i don't necessarily agree with this
the basic idea of like the movement
dialogue to media i think there's always
been a power law
uh maybe not in hunter-gatherer society
but at least going back
to like any kind of monarchy right like
there's always been a power law right
you know power law distribution
it looks like something like that like
who you hear from who has reach
right isn't that like the distribution
of instagram followers and stuff
um is it a stretch to think we're
already under the influence of an elite
with access to agi
well no they don't actually have agi but
uh you know people i can't believe i
ever
felt this kind of like super intelligent
shit
like corporations are already super
intelligences
so in that sense it's already true
right like yes there are elites with
access to super intelligence as though
the super intelligences now are breaking
in very interesting ways
um i think
we we really saw them break during
coronavirus
um so again i don't know how this got
associated is this
is is this let's see if we can find
what's the truth about this
sorry am i allowed to talk about this or
do i get banned from twitch
um
this was in uh
is there any honest studies on this
review of the emerging evidence and
almost like
i i've heard that hydrochloroquinolone's
ineffective and this one's a fact of
there's always going to be a bias
towards a positive result in science
uh scientists are much less apt to
publish
rebuttals than to publish
uh
i mean just like roughly reading this by
the way look up cloth masks you're never
going to find
anything like this right now
i don't know but
from what i've heard this one actually
does seem effective
and and it's interesting the way the
world kind of
there is now a
um you know for a long time you say like
okay the elites have access to agi
well the elites have access to
intelligence agencies
uh which are like a form of agi right
like you know it's called an
intelligence agency
i've heard a rumor that in china they
don't give their intelligence agency and
name
uh so that nobody can really talk about
it i'm like damn that's brilliant
that's some sci-fi dystopia like you
can't you can't write that's that's
like like if that's not true if i write
a sci-fi book i'm gonna use that in the
sci-fi book right
um
but uh yeah no i don't wanna again i i
tried to find
do i wanna read anything that is
remotely like pushing a point
no please don't push a fucking point i
just wanna find the truth
um
the chinese analysis cia bro
so they have access to these
intelligence agencies right you don't
have access to an intelligence
agency intelligence agencies work for
the elites um
but the internet is a
better intelligence agency than these
intelligence agencies are
and so in the sense like you have access
to agi
as well if you know how to ask the right
questions
it's it's interesting the way that you
know people are like oh gbt3 by the way
i got access to the gpt3 beta finally so
if we want to play with that we can
but it's interesting how
if you know how to ask the right
question to the internet agi
4chan i think is like a great uh example
of this because the amount of the amount
of raw intelligence
behind some of those 4chan boards is
crazy high
if you know how to phrase things in the
right way right like
i remember on b it's like people would
say like in before personal army right
like it's just it's funny um so if you
know how to ask the right question
you have access to a super powerful agi
um we were just talking about at comma
i want to automate the entire production
line
like my dream one of my dreams in life
is to build a berserker build a machine
that's capable of self-replication
ugh not like on its own it's like
because then you gotta like monsanto
that shit so that the ones out in the
field can't self-replicate
but you ideally like to be able to have
a switch to switch it
so that the ones in the field can start
self-replicating
you got to be careful about that switch
but like i don't know this isn't that
well thought out yet but like
if they ever try to come for you and
cease the means of production you press
the button and give the means of
production to everybody
right um can i interest you in
everything all of the time a little bit
of
everything all of the time apathy is a
tragedy
and boredom is a crime anything and
everything
all of the time
okay
yeah that's like this song's live bro
all right edge tpu o'clock
all right what does it show up as um the
global unit chip oh watch out for the
global
unit chip
and is that it where's my where's my
google
wait is it actually the global unichip
unplug it and check wow wow that's
creepy as fuck man
it's the global unichip it's the global
unichip corp composite device
google's so creepy
um okay edge tpu now unfortunately the
edge tpu doesn't actually work
on the m1 but we're gonna we're gonna
we're gonna struggle with you guys
uh we don't even need to compile let's
let's follow the edge tpu getting
started
getting started with it okay good all
right so good i have a hand
i don't have any nail polish on
unfortunately
i'm holding it like well let's let some
hang on hang on hang on i gotta do this
better sorry i'm moving the computer if
it crashes it was stupid it was not with
moving computer okay
let's see he has his no no he's using
this hand
and does it like this and then no
two fingers there one finger okay good
up now i gotta put my thumb a little
more like that wow that's pretty
uncomfortable
oh oh it's because of the way i'm okay
all right good all right good we
followed the first step okay
oh it's a she sorry i didn't ask them
what their pronouns were
i forgot uh what what are your pronouns
hand oh you prefer to be
referred to as your handiness okay
um
on linux we don't have linux we have mac
and i don't think this is gonna work but
we can try it now the edge tpu runtime
is open source now
they open sourced it
frogfish release legacy why is it a
legacy frog fish release
legacy you should instead refer to the
following
repos lib edge tpu okay that sounds
pretty good
lib edge tpu coral all right good i
think that's the first one we're going
to install
the runtime
good i cloned fast great sub modules
let's just follow the get
sub module in it get sub module update
no submissions okay build native
binaries on linux and mac os
make we're starting local basil server
and connecting to it
so google
i did use the right microphone right
yeah
oh no no module named numpy
oh is this because i installed weird
python
tip 3 install numpy
great
is scipy going to work oh don't tell me
scipy worked if sci pi worked oh no
that's not going to work because it's
not a wheel oh it's going to try to
build and it's like
you forgot fortran oh you don't have
fortran you need
four tram okay i switched my python from
three nine to three eight
good good good good this looks like it's
doing something
uh maybe we can put a j in that bitch to
make it compile faster
how many cpus are we using we're using
all the cpus one
cpu that's a pathetic amount of cpu
should we control c it
should we have a vote should we control
c the up
using all the cpus there we go
he's like made up steve jobs car sucking
his rocket technology 80 years you guys
talking about elon
the man who lands rockets i don't know
man
i never seen a rocket land before
and i don't think those videos are
shooped man now but that's like my new
saying
when like someone shows me something
that i don't want to believe i just
think it's photoshopped
nah man it's photoshopped it's it's
that's shopped
oh no it's going slow now because the
frames are bad will i write any c
you want me to write some c all right
one line of c in
main if a equals one
poor a it never does anything especially
because i'm gonna return
zero and now it's like wow that's so
sad poor a it's gonna be optimized out
by the compiler
oh what a tragedy
all right i don't know why i hit make
again
i just typed it again
okay build native binaries on windows
build.bat
build all built binaries go in the out
directory okay
out oh direct
throttle we want throttle because we're
a bitch
all right that looks good okay we have a
lib edge tpu that seems that seems good
now we're gonna need the coral python
library i think yes
we need this
pick coral okay uh get sub module in net
oh live edge tpu oh it's going to build
it again oh that sucks
okay turns out we only needed pickle
i have a better idea we're going to move
just from mv
on on that bitch you know mv mv you're
going to mv alright ready for mv
oh no it's just going to take forever is
this going to take all my disc
which disc do i have only 2.4 gigabytes
oh i need to delete some stuff what can
we delete
what looks stupid what here is taking up
space
that can go
this stuff all looks useless
that can go
that can go back and go
all right is that a good amount of space
3.2 gigabytes okay we're getting more
gigabytes that's pretty good
i should have bought the computer with
more gigabytes when's the m2 coming out
september apple
by the way guys who's coming to
comic-con
but no fanboys no fanboys only
you know comma fanboys if you're like
yeah
burgers uh also
i'll i'll chill for it very briefly
the patriot edition read like we thought
about doing a sale
um but then we decided against it
and we just made red ones instead
do you think from the transistor to the
web browser is a good start for
an individual on the path to
non-conformity
oh yes this is yes yes i must be emo
that's that's the name of that
that's the name of what i'm thinking
about yes well can you please tell me
how to get on the path to non-conformity
yes i'm an emo kid non-conforming as can
be
you'd be non-conforming too if you look
just like me
i have pain on my nails and makeup on my
face i'm almost emo enough to start
shaving my legs
all right uh
live edge tv oh let's just try it let's
see what happens
all right i'm gonna close out someone
just go this this just looks like it's
not gonna work
i'll build this darker base
i can already tell this isn't gonna work
oh no how much gigabytes is this using
oh no we have 1.9 gigabytes
what else can die
what else can die what else can die
it's death that seems still useless
f hash can die f relay can die
i don't need a copy of go etherium do i
have parody clone too
i'm gonna call something stupid now but
they change parody's name
executor failed running executor
exact utor
all right well can we get the pipe what
does the script do
why does it need docker i hate docker
make
i never know the answer i never know
patriotism
um you know what i do want you to
understand though
like yeah could we do a sale but this
like
and this is a struggle right
it turns out if you actually want to be
like
traditional like like kind of successful
where you like you know have like a
company you sell things to people
you have to repeat the same shit over
and over and over again
right and i i think
i i am willing to trade off like
success with customers for my own
entertainment
because at the end of the day like
what's really the value if i'm not being
entertained
um
great okay well this thing just doesn't
work
can we figure out how to use lib
uh oh safe retirement please kill me
please kill me if i ever start to value
things like that
just just like you know helium in a bag
man just like make it quick
you know
oh yes yes they take up
all your time and then they manage your
decline
keep crying your heart out
we're all gonna die now we're all gonna
die now
okay we got lib edge tpu to build
but we didn't get pick coral to build
while resolving tool chains no matching
tool chains
maybe incompatible used cc configure
from rule cc
who put that flag in and is like yes
yes this is a flag that we want
we're not gonna think about how to like
refactor this and make this better for
everybody
we're just gonna put in incompatible
used cc configure from rule cc
i just just
this is this is the google problem this
is why google doesn't make anything good
anymore
like this is a you can see that flag and
you can know
that only someone at google would make a
flag like that
you know
could you imagine like a facebook thing
having a flag like that no
you just couldn't
no apple has stop apple has issues too
but it's not an apple flag either
gonna get vaccinated why would i tell
you fucks about my medical history
you know that's right you heard a hippa
bro hippo
hmm
all right well you know it turns out
that if we want to uh you know
use the wow 32 percent of you guys are
part of the problem
everything about the vaccine is such
like what do you
what do you do when like
like you
there's sometimes you have like a group
of idiots who come to the right answer
and like you still have to the right
answer is still right even though you
know you're associated with idiots right
and like and now you can ask the
question you want to talk about vaccine
stuff it's like who are the idiots
well it's like you know they're both
idiots and they're both wrong
you know like like like or or like when
the propaganda's correct
i don't even this isn't even in here i
don't know you know what
i'm banning the word vaccine that's
that's the real way ban
ban word vaccine oh perfect oh
yes i love that that's a great solution
okay it's banned
band band yup you want to push me you
want to push me echo freshman get the
fuck out of my stream
all right lib edge tpo can we figure out
how to
use lib edge tape you without pickle
okay we recommend you write oh maybe we
can get the c
plus plus one to work not pick oral but
the c
plus plus maybe that will work okay lib
coral
the coral c plus plus library which
provides convenient
functions all right all right all right
let's try this one
do we think it's going to work does it
involve any docker
oh docker okay that seems okay
it's only one docker calling the same
tested how many gigabytes do i have
probably not enough gigabytes
919 megabytes oh this is a tragedy
all right well we don't even pick coral
anymore
i think i also have a copy of it in here
yeah i can go
it's this test data repo that's huge
it's also recloning edge tpu
do i actually need those no i'm going to
control c
that
lib coral can go then we're going to
just get
clone this and i don't think we need
test data
carl is in the quad college dorm on
labor day
the plan is all in place you can watch
the future fade away
that's a sub module let's run that let's
make a
simulink all right let's go
jake oh
what's the problem
your request is correct but requested an
empty set
of packages lib edge tpu dependencies
okay fine it doesn't build with the
latest version of litch
lib edge tpu that work
let's try that
that doesn't seem like a good number of
packages is that an okay number oh no
all right build file doesn't specify an
existing file oh because we don't have
test data
fine fine
all right i'll i'll waste my gigabytes
on this and
waste all of your time while we clone
this
while we wait let's let's uh let's take
a look around a little bit here
do we trust the authors
i don't like this i don't like that i
have this toggle that's too powerful
no i don't trust the authors
cancel i'm confused always when you're
confused press cancel
so this thing is going to talk to lib
edge tpu i imagine
load model or die
we probably want to like go pretty deep
into how this thing works anyway so like
maybe we don't
need to build this opposed
all right so where's the thing that
actually links to
run segmentation where is load model or
die
tf lite utils
is this part of lib edge tpu what does
lib edge tpu export
because we did get this to build
um we can probably just link to this
let's just find a header file for this
so we can figure out what we're what
we're working with here
happy
okay darwin
driver thread safe but not all
functions can be called in a callback
context okay
i understand that
we hired this guy i worked at google and
he wrote code that looked like that
kind of drove me crazy
wait up
file doesn't exist depends on pose now
no such thing as test data pose notch
a new repository
get clean xdf
all right i i give up on i'm trying to
use should i give up on trying to use
this
the build file attribute does not
specify an existing file
oh maybe we have to do make in here
there's a build file right there i see
it
okay error fetching repository the build
file does not specify an existing file
but this file exists
i think it's because it's like cached
somehow how do we clear the basil cache
basil clear cache
the repository cache
okay
no error fetching repository
in new rule external test data the build
face
does not specify an existing file but it
does
you guys know what i'm doing wrong
drift storage i have four gigabytes
tonight
something on line 90.
it doesn't even line 90 or 74.
new local repository build file test
data build
i go in here to test data and there's
something called build
i get cleaned xdf debt
now i run make
okay
all right this seems like a problem work
around do we touch it maybe we'll touch
it let's touch it
okay i'm touching your file let's go
no didn't work
okay change the build file to an invalid
setting
if you want to do caching you better
deal with invalidation better than this
okay
build for four does not exist now i oh
now we get a new error
okay the repositories path is user
system limps absolute
but that doesn't exist okay well that
seems more reasonable how
how bullshit was that oh just rename it
to something else and then name it back
okay
i hate docker
shouldn't hate so much stuff man you
shouldn't go through life hating so much
stuff
well i don't need this repository
because it looks stupid all right good
it's gone look oh wow we commented it
out now it's gone that's great i'm
trying to comment out a lot of stuff and
it'd be going oh
well we can't do dma buff unless we have
system linux
does not build on mac
lib coral not for mac
xcode magports
normal make should work as usual but how
is that supposed to work
if it has system linux
this is not meant to work
when's the last time anyone tested this
on mac
lib coral api reference oh this is
assuming i got lib coral to build
oh here we go the lib edge tpu api
oh okay
this just doesn't look too bad we have
lib edge gpu we'll just code in this
does this thing just have examples that
we cannot use
lib coral
no
hmm you guys i know i know you're like
watching me code and see so we'll go and
see a little bit
i'm sorry
you can only build with basil
that's a nice build system scones
scones is nice
it took a long time to give me that
error
the edge tpu include
tf light public edge tpu of course yes
absolutely
include tensorflow lite context
oh wow clearly
12 months congratulations set up a linux
vm in virtualbox and enable usb yes
that sounds great until you realize that
virtualbox will never be supported on
the m1
but we're here to struggle the point is
the struggle
is is this coral thing useful for
anything at all
no way my arm chips on the m1 i'm sure
are a lot faster and inference on models
than this
actually maybe that's not exactly true
but the npu is a lot faster
if we can figure out how to use that um
okay
so are we gonna have to build uh
[Music]
tensorflow
and this doesn't even include the
compiler for the edge tpu
this is only trying to include something
so that seems okay does this thing link
to
what is it on mac
oh tool
yo
i would play some oh town right now but
it's copyrighted
sadly i don't know why anyone would
copyright in the old town
uh oh town
all right that's not like this yeah no
copyright violation cause i want it all
or nothing at all
there's nowhere left to fall when we
reach the bottom it's now
or never is it
all or are we just
friends is this how it
ends with a simple telephone call
leave me here with nothing
at all
all right well
do i just need to clone tensorflow
all right we'll clone tensorflow
so we're only depth one because
otherwise it's too big
oh update code of conduct i wonder what
they updated the code of conduct to add
spacing
we could have been somebody
running around the first party we tried
for smiling
that one
don't do molly really sucks
oh well a space is required between
consecutive writing
that's been required forever oh maybe if
i tell it it's
like something like this
oh perfect wow look at that progress we
made
um all right we just got a link
now
here
throw that at the end
repeat
edge tpl something like that
lib not found but it has a lib i don't
understand i gave you a lib
oh maybe i gotta do that
oh ignoring file because it was built
oh well of course it built it for the
wrong architecture
a joke
let's figure out how to get it to build
to the right architecture
darwin
cpu must be darwin
oh
i think can i do like cpu is like darwin
ar 64 or something something like this
isn't it
um
basil darwin
cpu
there we go darwin dash arm 64.
just stoop it out
did not contain a tool chain oh is it an
underscore
oh well if it's an underscore why don't
you just tell me that i knew it was an
underscore
oh trust your instincts
is that actually building yeah yeah
target arm 64.
oh the flat stanley's man
uh any other songs yeah
for when grandpa meets grandma again
yeah there we go
just hold on and pretend
she's okay this time
just relax please sit down i know how
you feel
we're all terrified just go home
there's nothing anyone here can do
anymore just shut up and go
to bed there'll be lots of planning
tomorrow morning
oh
that seems okay all right we gotta
okay did find some useless junk
library not found um
die lid search path
looks like our path how do i do our path
can we just do this ah gcc
our path is like this crap
um
no option
does this work yo in my top five we're
dylon
dylon dylon dylon and dylon
you know what's better than dylan just
lid
no we don't have a linker because that
doesn't work
it was built for newer macro oh
of course of course boys you got to set
the r path correctly why'd you let me
set the wrong r
path don't let me do that oh
look at that oh it loaded
oh let's build an i o kit method by hand
that sounds fun
bind
great cool oh my i think we have code
run
all right we have a tpu context
um all right
all right all right all right we have a
good unique pointer
tf light and terp oh my god no no this
is going to require
a link to no
we have a lot of those tests that i
cloned that are way too big for anything
right can i
get a model from here perfect um that
sounds nice inception
v4 299 quant edge tpu perfect
that's my kind of model
or we could load one of the invalid
models i mean that sounds kind of
interesting too but
all right use of on i declared
identifier tf lit
that means we have to include tf lit
flat buffer model
include model builder.h
find modelbuilder.h before we know it
we're going to be building tensorflow
oh we need flat buffers this is terrible
we're going to have to build
as a flop you know when we have to build
tensorflow should we should we just give
up and eat berries
oh oh flat buffers are part of the third
party oh my god
no
there's not even
no all right
do we really need all this tip like crap
resolver
what's a resolver it's a tiff light
okay what can i do with this tpu context
oh god a tiff light
interpreter
what is tf light okay let's first figure
that out
don't you think we should know
tensorflow lite on github okay well it's
in tensorflow it's just light
how do i build tensorflow lite
see the documentation here
build nope
tutorials getting started
should we check out the free e-learning
course on tensorflow lite
oh wow i love ads thank you for the ad
um
learn more about the development
workflow this is assuming you already
okay
building tensorflow lite
oh with cmake perfect this looks very
convenient
we're here make dur tf light build
okay okay
well that's a shame um
no that tensorflow tensorflow lite does
not exist
it does oh maybe i have one too many dot
tensorflows in there
oh yes this i should really okay
and yeah i'm not making it that's a full
source no
no i refuse we gotta draw a line
somewhere okay
all right all right all right it's only
light guys it can't be building all of
texas
this is gonna be this is gonna be fun
and easy
george is immune to distractions what is
this is this issue like be like it will
never work on the m1
because fuck you oh yes
uh under vagrant uh-huh yeah but this is
not a m1
yeah i can do it under vagrant vagrants
is virtualbox wrapped
see don't you love the struggle i when i
heard that i could buy an m1
and everything would be like like it's
like mac os
but even worse and you can struggle to
make everything work on your computer i
was like this is perfect
and i'm actually legitimately excited
about this i submitted
you check my github history i fixed like
five projects
to work on m1 this is fun
like we get to you know you get to be a
part of something
oh okay all right this looks good so far
i like all the green
oh green and a nice color
she said it's just a headache she said
it's
nothing more
we all know
she won't get off the floor
green you guys don't love watching it
compile
oh my god i'm building dancing blow
broke twitch
don't worry we'll be back soon
oh shit mouse isn't even moving now
no need more ram
no
no no we gotta download ram
are we here
all right let's see if we can nice obs
you wanna try a nice obs
it says only we've dropped 12 frames no
f no
i don't think it's nice i think it's ram
oh my god look at each top won't even
load
wow it's all in the kernel
oh we shouldn't have done j j might have
been a little much
[Music]
don't worry we'll be back soon
we'll be back soon no
look how many it launched this is
bullshit
okay all right guys i'm back
can i not compile on core zero no that's
not the problem
okay yeah so i should have done j
let's do a casual j3 what do y'all think
j3 all right we're back we're back
chill chill we're back
um we did j3 instead of j
bajillion if you just do j what does j
do
you just do j without a number
we just did j
i think jay will just do as many as it
possibly can
oh my god if you give jay without an
argument
it just does a bajillion
why is it there is make
as dangerous as it would seem to be if
so
why on earth is it there and what can be
done to idiot proof
it what do you mean we're back nothing's
a problem now it's
still lagging
only the video is fucked up you mean the
video looks fine is it not good
we're back yeah we did j3
[Laughter]
idiot sorry guys i'm too stupid for mgj
go to the next slide
i get what you guys are saying now it's
funny it's funny
how much money did i make oh why do you
care
man why do you care you want to know how
long my dick is too it's longer than
yours that's right it's
right
all right we're back wow we even built
tensorflow lite oh this is this is great
okay okay okay this is very exciting
this is very exciting we've built
tensorflow lite
okay does this include the includes
you can find model buffers.h no
it's an r archive great uh
all right i don't know we built
tensorflow lite
that's great we've made immense progress
all right now we just need to get a tiff
light interpreter
this did unique pointer okay that
doesn't seem too bad
use of undeclared identifier tf lite
seems like the right thing to include
yo does anyone want to subscribe to my
stream so i can buy a better computer
okay good good good the link works now
we just no that works so now we just
need to link to it
do we get any dilips or do we only get
dot a's we only got
dot a's okay
subscribe thank you vols please
subscribe to my stream
when those subscribers are better than
non-subscribers sometimes
they're so much better that we only let
the subscribers talk
think about all the non-subscribers
screaming about my censorship
censorship okay um well
oh my god i gotta suppress the scope man
okay does this mean anything or just
like you can't link to it
oh well okay let's let's link to
depp's rui build rui
i hope there's not like seven more of
these and this is the only one
please let it be the only one what is
rui anyway
yo can one of you guys figure out what
rui is
and tell me why i want it
okay
jocker
jocker docker for
jocks jogger
i'm sorry i deeply apologize about the
js everybody what is rui
the rui multics multiplication project
this is not an official support google
project
its focus is to cover the matrix
multiplication needs of neural network
infrastructures
this year's been tender tensorflow
tender flow light
whatever oh
oh good oh
rui this directory will eventually
contain rui documentation okay well
that's a good directory
it's good that they made a directory for
that we'll eventually contain
documentation
okay so we've gotten to the interpreter
now can we use a resolver
or is this gonna work no
no that doesn't work that was that was
too much to ask for
okay all right we're back to flat
buffers
i don't have any flat buffers
okay we need flat buffers
flat buffers oh does it have
flatbuffers.h
oh include flatbuffers all right all
right progress
all right let's just conveniently go
yeah you know what i could probably set
up a
basil build system and do this all in
bazel
all right well now we need x and n
do we have x in it oh convenient we do
okay um
xnn define static resize
by linear 2d all right
good good it's just this one that
doesn't look too bad we'll link
xnn back too see look we've learned
about rui and now we're going to learn
about x and n pack
let's just say depth equals
i don't know why i decided i want to
clean that one up it's all disgusting
it's gonna feel like there's gonna be
more daps
okay well we need a p thread pool of
course
perfect let's figure out which which of
the depths
includes why am i watching
some guys in tight shorts kick a ball in
a triangle
i mean that does sound that does sound
tempting
i'm i'm tempted by that but no
watch the sports ball eat the bugs
oh i don't know if we have that one
part of lib xn pack
oh thread pool okay well the thread pool
of course is not a depth it just shows
up here in the bills
and now and now you see why all these
dot a files are so
large okay well we're gonna need cpu
info too which is probably another wow
wow this is this this this started out
fun
and then it became so many dependencies
see like you try to link one google
thing
and then you get all this
all right like should there be a point
where i just stop doing this
and say like enough is enough
or are we learning
and there has to be some better way to
link to all this okay
uh well which one do we want to link to
do we want to link to fft
s or fft 2d don't worry i'm sure we'll
have to do both eventually
we might not have to do both at once so
we can pretend we don't have to do both
and then actually end up doing both okay
well no such directory there
um i don't get it because that seems
like that's the directory oh i did dex t
oh we need yeah
okay okay are we getting close i think i
feel like we're getting close
this can't go on forever can it i'm
gonna need another
we're just needing some clogs all right
google of course we're gonna have to
include google's special uh
you know logging live by the way this is
just
code has gotten way too complex
let's learn about clogged google clog
oh clog a free app especially oh my god
go ahead flower wholesale
clever log oh is that what it is
okay which one last one fingerprint 64.
okay
this we have to be coming to an end
oh lib farmhash of
of course we need the lib farmhash what
is this
farmhash provides hash functions for
strings and other data the functions mix
the input bits thoroughly but are not
suitable for cryptography
no and it comes with lisp bindings
why is this a thing
yes okay
all right we're we're making progress
there can't be too much more of this
okay we have a resolver now now can we
load the model let's see if we can load
the model
let's try to load the model um
from satisfying output my face isn't in
the way is it
that's over there it's coming out of the
way cool model loaded
all right
all right well let's add a custom
resolver here
and then of course we're going to need
to run the interpreter builder
and we're going to need to bind the
contacts to the inter
are these even things
like or do these people just spend their
life writing boilerplate code
all right all right all right let's
allocate tensors
and then let's invoke and then when
we're done
we'll reset it and
we'll reset the tpu context okay great
um i
did boilerplate
um
okay did that just run on my it's warm
all right um now we just need to prepare
the input tensor somehow we need to get
a picture
into c plus plus oh that sounds like a
nightmare right let's download a nice
picture of banana
it's a nice picture you guys like the
banana picture although i have to like
resize it oh that sounds awful who can
do anything and see
nobody
oh it's a web p no i want a jpeg picture
of banana why would i want a webp
picture of a banana
time doesn't know about web pees they
use jpegs
knew it
yeah that's right i got rid of quality
70. now we have a
no
yes i want a large picture of banana
okay
banana.jpeg let's just
take a look all right what do we think
guys
it's a pretty nice banana right sweet
what can we learn from the near death of
the banana nothing
fuck the news um what can we learn like
we're all in this together man
all in this together
stop with your astro turfing oh
let's go
guys they're not gonna they're not gonna
cancel
if if they come for me if they come for
me
then like there's really no hope man
like there's really no
i have relatively non-offensive opinions
about most things
uh you know uh
if they if they come for me man if they
come for me this country's done
if they come for me this country i'm
moving i'm leaving i'm leaving like
fuck this man
you know yeah i love the front pops
they come for me fuck this shit man i go
so deep underground
ah
it's the most default banana yeah we eat
default bananas around here okay
now okay
we allocate the tensors let's
try let's just google lib edge tpu
example
oh no no this is using the lib coral api
we don't have that here we go
minimum oh
this guy wrote he hand wrote a bmp
decoder
i'm end to use lib coral wow
wow
okay
all right so we
oh no no no don't try to get me to link
to no this there's no way this is gonna
work
you ever try to link to opencv it never
works
okay let's let's give it a brief
try
okay through install opencv
uh
i'm not going to russia because i'm not
like a political dissident the last
thing i ever want to be is some shit to
your dissident man i'll move somewhere
nice like malaysia
you know and be like wow and then i then
and then you know no no don't no no no
don't no don't don't install that stuff
no please i just want open cv just
just just open cv
please only open cv don't try to install
python39
that's the one that no no python39
please don't
please don't
i mean i think that's what all the smart
people did when like you know like
shitty people came in power in their
country they were just like peace out
bro
you can't just put an endl alone like
that it doesn't do anything
does it can you call nl no you can't
call
oh
now we're going to include you know i'm
not including iostream.h
segmentation fault 11.
wow
oh my god the last place i want to go to
brazil is with some like crazy high
murder rate
so now i get this from people they think
i'm like some like right wing guy or i
want some like right wing bullshit
fuck that yo all i want
is malaysia malaysia
what do you guys think malaysia you know
i'm not saying like look this place
doesn't really go into shit yet
like there's a lot of talk about it
going to shit
and like yeah i mean you know if we get
like 10x inflation and like if it goes
to shit
no you know what's cool about having
skills they're up here man
i'll go to malaysia malaysia they'll
you know you know calm will be valued
and useless fed coin i'll be like ah
peace out man
enjoy enjoy trying to make sense any of
that
shit enjoy trying to make sense any of
that shit in your
broken ass regime that's right
you be corrupt you've got a broken ass
regime and all the talented people go to
malaysia
my former president yo i don't get it i
don't know why people like identify with
this like like he's some dude who lives
like
three thousand miles away it doesn't
really affect my life very much
like i said and i said on that song
without a coronavirus i'm like
okay fine you've made me fucking care
because you know you you closed the
restaurant down and i like going to the
restaurant you closed the restaurant so
now i got to be like yo
this is a bullshit don't close my
restaurant right
and then like you know it's the kind of
thing where if the rest of the world you
know
it turns out the rest of the world is
run by the same wackos uh so you know
they'll close their restaurants too
because oh my god my virus oh my virus
it might kill somebody
uh so you know we gotta shut down all
the restaurants there's nowhere to even
go there's no restaurants so like you
know i took a road trip to south dakota
it was like nice to like
not have masks but then like you realize
you're insulted
it was kind of like oh
does malaysia have the infrastructure
yes kuala lumpur is like a beautiful
city
it's like probably what singapore was
like 30 years ago
oh my god with the recent hacker attacks
i honestly i
barely even know what you're talking
about like someone made a joke about
some like
some like rant young god
current events are so worthless
so worthless all the news is written by
the cia man
it's all written by the cia it doesn't
matter whether that's
true or not it's like effect you know
oh yeah great saying maybe i said it on
one of my streams it's like you know
in china nobody reads the news because
they all know it's propaganda
americans haven't figured that out yet
well we're gonna try to put the banana
into the model and see if the model
likes to eat bananas but
um so far we haven't had much luck with
this
we run the model but then there's
apparently no
output vector from it oh do we have an
mnist model over here
here we have an mnist model i'm just a
lot easier to deal with i'm just
coco checker
dog download
hotdog.jpg oh hopdog.jpg let's take a
look at it
ew that is hot dog but
is malaysia the new america you want to
see where countries are good
look at how they feel about capitalism
like i've moved to like malaysia or
vietnam something like that
i know people have already done it
if i didn't have calm i might have
already done it
oh no there's a question of like what's
actually going to shit and how much of
it's all propaganda
computer so i want to get rid of the lag
so i could talk to you about it i'm not
banned
guys if they come for me
there is a very serious problem
um
no what was i gonna say uh i thought
about it you know i thought about it
like seven years ago
uh i don't know if i'll mention this
quickly like i don't know if you'll
remember gamergate
but like you look at shit like that you
kind of see where things are going and
you're like oh
do i really want to be around for this
um and you know my answer was kind of
that like
i think the decline takes a long time
ah
[Music]
it just sucks
like it's just it's just
you know it'll recover the world will
recover stronger
america's hegemony sucked
like it stifled so much
like innovation in countries
um
[Music]
you know america it's like google right
it's like
this is why we have no real competitive
maps
uh i'm kind of doing now with apple but
like you have this you have this duopoly
ecosystem
and they're they're kind of like are
google and apple ideologically opposed i
mean not even
right it's like the us and uh in europe
um so you don't have
diversity uh
yeah i mean america
the scams are really bad the there is
very little incentive as an individual
anymore
to produce anything of value like you
can scam
so easily i don't know
you know i gotta send some morals and i
don't mean that in a sense like
like i wish i didn't man like i don't
mean that like so like i'm not trying to
like moralize at all
because i hate people who do that like i
don't even blame the scammers i blame
the system
ah some days i wish i could wake up and
be a scammer
what if you eat bugs and you love the
taste of bugs why would you not want to
eat the bugs the bugs are delicious
um yeah chief diversity of look i mean
you can go into what that is that's
existed a lot of times before
uh you put your you put
you know you gotta get your uh you got
you gotta you understand that if you
you know you gotta put the member of the
nazi party on the board right you wanna
do business here in nazi germany you put
a member of the nazi party
on the board right you've got to show
that you're you know aligned with the
party man
um political cops says yeah
and like you know this is still america
and and there is still
uh it's not nazi germany like that's
kind of
it's it's a ridiculous comparison but
you know it's not all
it's not all sunshine and roses here
sweden maybe sweden's okay
i don't know i remember i heard about uh
jaunt law
and i couldn't believe it uh this is
like
i i went to sweden for the nobel prize
ceremony
and um like you are not to think
you are anything special you are not to
think you're as good as we like i just
like read this
and
there has to be some middle ground there
has to be some middle ground between
like
this and like america it's like i'm
special for being a dumbass
woo celebrate me you know there has to
be some middle ground
between that and like you know i mean i
wish the middle ground was legit
meritocracy it was like
you know you want to show your special
here's the contest win it
let the water boil
oh i hated portugal i hated portugal
um there's a comma office in rotterdam
maybe i'll seriously go live there for a
bit that might be kind of nice
what country promotes value creation the
most right now
well here um
sentiments
on capitalism
around the world right
[Music]
fucking agenda pushers
uh does more harm than good in the world
[Music]
the edelman trust barometer 2020
no this is not what i want
can you guys link to the good version of
this
this is a great quote it's like i'd
rather you use my cpu to mine
cryptocurrency
then use my fucking speakers
um i want a
survey
survey right uh
maybe is this
like what are those websites that have
like these good those good things
um
no no i don't want economic freedom
index i want one specific thing
um i want the
no no no no no i don't want i want i
want to know
if people approve of capitalism that
means the country's aligned with value
creation
can i see this for country
uh okay so
no no no no no this isn't right because
the country malaysia is much higher in
this
approval rating of capitalism
never mind this is this is all junk
here
this support for free market system so
these are the countries that are aligned
with value creation right there
the search is terrible why not i know
remember it's not search it's ads
they're not trying to give you
information they're trying to give you
propaganda
i do hope you guys realize that ads and
propaganda are the same thing right
like it's propaganda when the government
doesn't but an ad when a company does it
no it's all propaganda
i did hear that as a like a
hypothesis it's like america you know
the thing that america is really good at
is not technology it's propaganda
welcome to vietnam you know number one
on there
um
i'm surprised this is 2014 as well yes
oh god no i wish i could just say
minus news
right i don't like this anymore
but yeah
the more countries are pro free market
the more the average person is pro free
market
um
no hdi is not correlated to what i'm
looking for
vietnam i would go to vietnam
i don't think vietnam's hdi is that high
it's rising but it's not that high
moving to vietnam i
really like it there
easy place to visit
visa runs you're not gonna get permanent
residence
it's iron it's ironic they call
themselves communists
you know it's like it says like it's
only like it's like the communist
people's thing
vietnam
i need to hire an army no it's a very
safe country
yeah look at that
[Music]
two and a half times lower than the us
basically deleted copy constructor
flat buffer model has been explicitly
marked deleted here
[Music]
um yeah probably south like
ho chi minh city um
let's look at a map and you can tell a
lot by geography
by san diego
oh yeah cambodia cambodia is a wild
place i hear too i haven't been yet
oh you're vietnamese staying in
honeymoon city cool
what's the weather like
aw tropical savannah climate here we go
pretty hot it all too hot
it's wet though which is nice
laos is still a cia holdout
[Music]
oh yeah that's a decent ease of doing
business
see that's what i like that i like that
malaysia ranks highly on things like
this
um i've also heard good things about
denmark recently
can you not do business at all in
vietnam
where is that oh 70 i thought it's
pretty bad
yeah no i probably would do malaysia
there's all these tales online of how
like singaporeans are scared of this
city
it's like oh there's so much crime in
johor brewer and you like look it up and
you're like oh
no it's actually super safe it's just
people i'm sitting there
scared
move to africa i've never been to africa
um i mean i don't think
any of those countries are going to be
very high on the ease of doing business
you know
i hear just everything's like impossible
there
like you want to just like
just lithuania
oh hmm
eastern block's an interesting
area of the world as well
internet connectivity is poor where in
africa
yeah africa is not for me
oh it's hard to get electricity in new
zealand
i said what is that getting credit oh
what does malaysia rank poorly on oh
starting a business is hard
construction yeah
we do love credit in america very easy
to get credit
estonia too people like made crypto
companies they based them out of estonia
eastern europe is a special place but
things are cheap but people are smart
well i mean this is always something to
consider
it's interesting though like you know
you get to you get to some of these
countries and like
i i think there's a bimodal distribution
um i mean i don't know if that's
actually backed by data but
poland
and texas left the u.s god
guys they're not
better okay okay yes texas leaves the us
with some ultra conservative gun loving
no abortion
uh you know uh mandatory church
attendance like they're not better
okay they're just a different kind of
shitty puritan
check out georgia i've heard good things
about georgia
no not the state parentheses country
google knows what i want
oh wow that worked smart google
yeah i don't know
[Music]
my neighbors are a little like you know
where is where is chechnya
hmm
who went to serbia once i don't know
isn't there like still some war here i'm
not
like i'm not going to some place where
there's a war
yeah like there's a lot of war around
here
you know there's like a little war going
on here
um where's there no war yeah
a war just end the war
[Music]
hey look there's three types of people
who get into like situations like when i
like confronted right
there's people who fight there's people
who flight and there's people who freeze
up right
um and you know you're just one of these
types of three people
uh i'm a flea guy i'm a i'm a runaway
guy you know that's that's who i am
that's
you know um
i'm an australian citizen but
no i've heard uh
i've heard i've heard australia suffers
from a lot of the same problems as the
us
without a lot of the benefits
bass coward
oh georgia is great and war is extremely
unlikely to happen considering there's
constant
nato presence
yeah i don't want to be around when nato
falls man
i don't want to be around with nato but
like again oh
putin's just gonna just gonna push him
i'm just gonna push him you know he's
just pushing he's pushing he's pushing
i'm like like
america is going to be forced into like
one of two nato is going to be forced
into one of two positions
right like stop trying to expand nato
like defend and fortify
never mind i don't care about this i
don't care about this
my point is if there's war not me
it's either southeast asia northern
europe or america you don't think
eastern europe
oh look an ad for go-karts and an ad for
in-n-out thank you for your subtle ads
google
don't you guys love subtle ads like you
think it's just oh a restaurant nope
it's an ad
back to banana programming okay you're a
subscriber i'll listen to you
all right um
so there has to be some okay tf light
interpreter builder what's an
interpreter
let's let's look up the api to this
thing see what we can query
uh how do we get like the number of
inputs
okay so i should be able to say
interpreter inputs dot size
okay we have one input and one output
oh is it upset because it's not a float
and it's actually
a
ah
yeah it might be upset because it's not
a float
maybe it's an inch
rotation fault eleven oh did it lit up
oh look it lit up
look it lights up
look at that all right
well that doesn't work
um turn a mutable pointer
tf light tensor tens equals
does anybody actually use any of this
stuff
what's a tf like tensor
dot data
okay
how come typed out potential doesn't
work is that even the one that's
crashing
how do we get the size of a tensor
that's not crashing
resize tensor
get all right i don't know i want to try
the names see if that works
it might have been optimized out i can't
use that
i guess not because it doesn't know that
it's not a functional language
okay in input
output inception logits predictions okay
that seems reasonable now what's the
problem if i try to actually print one
of these
actually it's a pointer i should just be
able to do that right
okay so that doesn't work
oh you know what i might you know what
it might be something like that
if you like don't put the right type
it's like you don't get a pointer i
return you
null ah there we go beautiful
um this probably isn't actually the
output size we don't know how to get the
output size
so we'll just do it
okay
all zeros i hope you like zeros
return the number of tensors type tensor
variables size
all right i think it might be time we
have something very special for this
stream
very special bought this morning
just for this stream monster energy
this stream is brought to you by monster
energy
green monster energy
[Music]
i haven't had one of these in years is
that 7-eleven
oh smell all that that nasty monster
smell
oh man this is so drugs oh this is so
this is so
how is this legal this is just drugs man
oh
dude these things really fuck you up too
wow look at all the stuff that's in here
i used to drink like two of these every
day
and it comes from corona california one
monster way
this is where monster comes from
right next to peace tea
ah ah that
both nasty and delicious at the same
time
monster energy flavor i don't even know
what competes with it
the answer nothing
okay um
all right i have an idea you know what
guys you're ready for some big brain
shit
python read
dot pi import pill
pill dot image banana dot jpeg
see we have a sip of monster and then we
get brilliant ideas that don't have us
loading jpegs in in bullshit c
all right um
m and then we're going to resize the
image
what's our new size it's got to be 299
by 299
and then we're going to load out the
pixels
pill pixels python
get pixel method all right that sounds
kind of nice
it has to be just a way to get like the
data right
and get data sounds nice beautiful
we both know she's lying
she won't get off the floor
no
okay ah just need something to convert
that into
our jeep
all right now we have banana.dat
oh that's a nice looking banana all
right now we can load in that
shit open banana dot that
[Music]
banana
[Music]
[Music]
yo can we play some creative commons
oregon trail music
oregon trail song by royalty free music
company they're probably not royalty
free that's terrible
you can't copyright midi can you oregon
trail
non-copyrighted music
wow some guy just called himself oregon
trail
[Music]
[Music]
bye
[Music]
ah
[Music]
[Applause]
[Music]
all right that was pleasant
oh okay all right look we got some
numbers boys we got some numbers let's
figure out which one of them is banana
banana
um
my friends are happy i'm happy i have
learned to adapt
it's darker kind of humor but i could
still hear him laugh
let's just do the ones that are greater
than one
we have this in a tiny ride don't we
sweet
oh it looks too hard to open okay
the top category is 6.45
maypole what's a maypole
whoa i've never heard of this
oh wow sounds like some pagan
shit man i love pagan shit
can we celebrate maypole day wait
where can i go in the united states
um whoa is it going to be like
juneteenth and then we can have maypole
day
oh man sounds pretty nice
you have a festival of is it spring oh
no we missed that
all right let's see maybe this one's
more accurate a conch
all right what if i don't load in the
banana
oh is it supposed to be a grayscale
banana
okay it's the same if i don't load in
the banana that's concerning
did i get my freed even right
looks like it reads a lot is that a lot
okay but it outputs the same thing
whether i load in the
oh we gotta run the model again oh
all right all right all right now that
we've loaded in the banana
wow so the default and all black screen
is a maypole i don't know what that says
oh oh what's 955
jackfruit wait who thinks we got it off
by one error boys
i think we've gotten off by one error
because look what's right above it
banana wow
[Music]
whoa
all right all right we'll we'll relax
the outfit restriction does it say it
could be anything
besides the banana
it knows it's banana wow just subtract
one from the result good point wait what
do i do when it's zero though
you can't always just subtract one from
the result what if subtracting one from
the result doesn't
maybe it's a jackfruit
um
i mean this has got to be maybe i don't
know let's check
real lists imagenet labels
oh look yeah and this one is banana okay
oh background oh they just added
background okay
i was gonna wonder what label they
censored
boom now when we go to 955
we know it's a banana
no it's not an off by one no no it's
just it's just here
i just had the wrong now that i loaded
the right thing
because they had a background as the
first category i thought they were gonna
like remove one category that's like the
one they censored man like suicide
can't say that anymore man someone might
do it if they read the word watch out
man
people are susceptible to ideas
uh do we want to test a different fruit
just just to be 100
sure
[Music]
uh
let's create a file called data mv dot
dot slash banana star
here um let's
throw some args in here
i'll push this to github if anybody
wants it
um
dilon
uh there and said i had tourette's and
by the internet i mean
like oh yo i downloaded all my dna
you guys want to mess with my dna we can
do that um
edge tpu test
all right what else should we take a
picture off does anyone have another
picture
playing fucking type versus the judge
shit
build beneficial and privacy preserving
ai buy our shitty little chip
by the way speaking of buying things has
anybody considered purchasing
a patriot edition comma 2 dev kit
notice how red is in quotes because the
color is kind of like it's not
it's like that's the color it's not
exactly
uh red wait i have an idea for an image
right here let's go
what is it let's find out
uh let's rename it to add.jpg
and then let's use read on data add jpeg
we check data okay we have add dot dat
okay
now let's a dot out add dot dat
oh okay all right it's pretty sure it's
a 665 but it might also be a 917.
a monitor that's pretty good what else
we got
a website oh wow
that's pretty good
um what does it think that it maybe
could be
maybe let's say
a comic book oh okay
you can see where it's coming from
george try a muffin
all right all right one muffin all right
we'll do one muffin
all right that's a good muffin this is
gonna be a web p muffin i can smell it
already
oh muffin
dot jpeg read
data muffin.jpg
wow are we doing inference on the google
tpu aren't you so glad that we bought
one of these and
followed these really complicated
examples when we could probably just
upload it to a website
all right
it's a 965 but it might also be a 416.
a 965 is a pot pie
i mean to be fair it could also be a
bakery
hmm i don't think they have muffin
they do not have muffin
does the title of the jpeg matter no
didn't you didn't don't you guys
follow the code how could the title of
the jpeg matter
does anybody want this repo and if you
say
yes you're lying because then you would
have had to purchase a google coral
oh man banana's my favorite it knows
it's solid about banana wow
two sips of monster i'm already fucked
up on monster
beware dick pics or tos oh no
guys when they ban me you know i heard a
story once
this isn't the new york times it was in
government approved media about a man in
egypt
who wanted the muslim brotherhood to
take power
and the guy was saying this when he was
sitting in the back of a cab smoking
some hashish
and the other guy in the cab you know
the new york times reporter was like
uh bro
you know if they take power you're not
gonna be allowed to do that anymore and
he's like yeah i know
it would be nice i would stop maybe i'd
stop you know
i'd get out of other bad habits too i
thought that was kind of interesting
uh so yeah you know
wouldn't it be easier to just take x key
score and extractor
github copilot is good i don't know
i don't know you can download it
yourself okay everybody can go
purchase a google coral if they would
like
uh to do this
now all right let's take a look at what
it's doing
all right you guys ready to start you
ready to start the real part of the
stream
you think this stream we were just going
to look at you know soggy muffins all
day no
no i'm not looking at soggy muffins all
right
lib usb control
read
oh yeah all right
i think this shit works on mac
so the only real way to like reverse
engineer huge messes of code i mean you
can do it if you want to try to read it
but sometimes it's even quicker to just
you know
build some interceptor libraries so
let's just intercept what's being sent
uh to the thing
and we're gonna have to hook it this is
actually gonna break it
i'm just gonna break that
no um
it should be linked to that
yeah though using that how do i do flat
eyelid flat name space yeah you got a
force of flat name space
ah looks like something like flag for
that
here's the flat name space linker flag
i need a wl on there
no it doesn't work
oh no there's another problem who knows
what i did
who knows what i
[Music]
generally hurt did
not yet okay maybe i should have left
flat name space
no is that how we do extra and see
right
no we're not detecting a hammer not
detecting anything else we're trying to
intercept
the usb calls
from the library
i'm not sure why that doesn't work die
lit force flat name space
something like yeah yeah thailand force
fly name's face
it's something like this
perfect
yes it's here okay
all right then we're gonna have to like
dl open live usb and stuff so we can
pass it through
um
can i do deal sim rtld next
do i doubt that works
i could do this until you die
i do this kind of hooking in uh an old
palette
in here
reinterpret cached
too many arguments to function call
expected one have eight
ah wait what
oh god what am i doing
three okay works let's put rat down yeah
we don't even care about right okay
um so what's important here
all right now we can intercept all the
lib usb control transfers
here we go
um
cool okay so now you have all the
complicated bullshit that gets sent
to a usb coral to do basically nothing
oh but it's doing inference of a whole
model
okay so what we did was this intercepts
all the calls
to the thing but actually it looks like
all the usb control transfers already
happened
so let's intercept the other type it's a
usb bulk
transfer
we're trying to figure out what the how
this google coral thing
actually works i looked into it a little
bit before the stream started
and it turns out that it's actually just
like
it's pre-compiled by the compiler and
the compiler is
probably where all the interesting stuff
happens
but it's nice to at least have a you
know a look here
um
i don't really care about the timeout
it's kind of stupid
let's label a few of these
actually these didn't even look useful
just look like set up boilerplates i
guess that's how it loads the model
um 10 points
data
all that matters
the data doesn't really matter
if statement has empty body what how did
okay it's not doing any bulk transfers
and how is it running the model again
here so we have like rand model again
um oh no is it using the asynchronous
api
oh this looks so difficult oh that
sounds like exactly something google
would do
i actually have the code for this
so we can see what it's using
well because we put our bulk transfer
you should be hooking that i don't
understand why i'm not
wait
okay lib usb bulk transfer i labeled it
correctly
is this one getting called
now
um oh don't make don't make me just use
this kind of crap
oh george you can load it in a debugger
and do this in a debugger you ever use a
debugger
all right good great it uses alec
transfer
oh great oh this is this is amazing oh i
gotta make this thing work okay
well don't you just love more usb submit
transfer
so
look we're doing hacking who loves
hacking well look we're doing hacking
this hacking boys look for hacking
things
all right great so now we have all those
things being submitted let's look at the
destructive lib usb
transfer um
um
so
what
or
conflicting types
get rid of my voids
great
even bother intercepting that one
all right now we can look at the types
a bit wise or combination end
point
okay cool
so for reference by the way when you add
this so these these are in
endpoints and actually we'll
so if it has a if it has the eight it's
in
and if it has the uh so these are out
like here we go so this is it
transferring over
actually probably the weights it's
probably doing the weights dynamically
here
um this is probably here where it
transfers the
uh it sets up the dma request
transfers this transfers that
constantly blitting weights and then
here it gets back
the uh
the input
this function will submit a transfer and
return immediately
but i never receive a call back oh
there's a call back in there
setting this dropped only in the
structure
buffer yeah call back all right cool so
you want to hook the callbacks
um
we can click we can hook the callbacks
and see what that's actually getting
back or
we cannot
what
do my parenthesis match
okay cool so these are probably the
weights being transferred
oh interesting this is not what i
expected from those eight
i expected that to be some kind of like
setup thing
not just a weird continuation of am i
just not
oh oops
why do they all look the same are you
dumb alright cool
now actually yeah so this is probably an
address
and then this is that data actually that
might even just be a length
yeah it's the length okay so you see how
this here is the length
it probably specifies the tensor total
length
tensor
for some reason it's reloading tensor
zero with something that's slightly
different in size
let's dump a little more
lucy harris smart smart lucy harry's
smart
dum
so where's my banana that's my banana
is that my banana let's see
test
yeah that's my banana right so you see
my banana right there you can see it
let's see how to
sometimes you just start you know you
just stop seeing the code man and you
just start seeing blonde brunette
redheads just like that
why don't i troll like scrolling of
course girlies man
fucking jail i want to go to jail
i respect the troll
but you know
jail's not for me man i'm not a jail guy
like some guys they're just jail guys
like they're going to jail it's a
question of whether to go to jail right
like they're crooked and they piss off
they're all kind of people like
you know like if i piss you off and you
put me in jail the thing about that is
like
like you could do it but it wouldn't
do anything right like you you go
you go and you're like oh that guy he
murdered somebody or
that guy he scammed investors out of
money
right like society feels this you gotta
just look at the narrative man
oh this is an oh this isn't scott
alexander's story i love the idea it's
like look
i know that i can just like walk into
this bar you know like i'm a real bad
guy and like you know
i know i know that like i can just walk
in this bar and i'm safe because
this isn't how i'm gonna die right like
like there's gonna be like a big
setup there's gonna be like a big build
up i'm too important of a character
to to you know just be like shot in some
random bar so that's not what's going to
happen
right it's like that you always got to
think about the narrative continuity and
stuff
and like you know like you can put me in
jail but like what's the narrative
man that
you think that's enough coral we're just
getting started with the coral
what's interesting is that
what's kicking off the inference
oh okay i think this is actually the
transfer of the program here
i mean that definitely is the length so
i'm pretty confident if i type in hex 16
next you know that and get that
let's put the control transfers back in
because we know they are happening
but i don't think they're very relevant
no like it's before it even opens the
device it's useless
now this is just some boilerplate clamp
so who thinks now we can drive the coral
from python using lib usb should that be
our goal that's a pretty good goal
uh first let's make the length be
hex
type twos what's that type usb transfer
type
bulk that's right
he pointed out that punishing someone
for not respecting others is meaningless
you can make someone simulate respect
but not all yeah that's true
right and that's exactly what i mean
it's like you you know and i the the
despots of the past have learned this
like you know our regime is at least
our regime is is because it's like
oligarchical
if you have like like a stalin-asked
regime if you're like a monarch
uh a monarchy you can end up with
somebody just you know put that guy in
the gulag because you know i personally
don't like him
um in an oligarchical regime that's
that's a lot uh
less likely so yeah i mean yeah go ahead
oh yeah put me in jail for
all oh well we disrespected whatever
whatever whatever
yeah you'd have to like find something
else on me
and i don't really do much sketchy stuff
and this is why i don't do sketchy stuff
it's like
you know
i pay my taxes boys pay your taxes it's
worth it
serious advice pay your taxes right like
people are like well but do i want to do
this
no pay fucking taxes man it's not worth
it no wait don't give the regime that
over you
talk crazy stuff taxation is left yeah
it might be theft and
when you have you know nuclear weapons
and f-15s or whatever then you know you
can
talk about that but otherwise you know
shut the fuck up pay taxes that's right
but what you don't have to do is
you don't have to say oh i am a proud
patriotic person paying my taxes right
you just got to be like yes there are
thugs and they're stealing my money but
like you know
they have you know bigger guns than me
and like okay pay your taxes
right
that's why i always pay my taxes always
tell my accountants i'm like
look man pay them more than they want
like i don't care the money's fake
they want their fake shit coin back they
can have their fake shit coin back
give it one man give them they care a
lot about their fake shit coin
okay okay
here's my theory about what's happening
this is just part of a program and until
we understand the program
we're not going to get anywhere
how are these all 81s
oh i think the model loaded and did
boilerplate that doesn't actually
do anything
it's only on this first this is the one
that copies the program
can you buy fake shit coin on coinbase
well they have wrappers for
it usdt uh usdc
uh you know there's a lot of rappers for
that shit coin it's popular shit coin
man
popular shit coin it's og to be fair
this shit coin's been around for a long
time
um so it has like you know shit coin
legacy
maybe that's the program it's like some
warm-up program
oh well
be a chad no coiner that's right i'm a
no coiner
i've drank like three sips of this it's
kind of disgusting
tastes like battery acid i've never
drank battery acid so i'm not sure
that's true
but maybe this is the program that's
getting transferred
does that look like a program to you
i don't know what this is yeah this
looks like some like initial warm-up
thing it's like transferring this little
program
all right i'm gonna guess that that's
the program
okay should we save that transfer and
then analyze it
yes that's exactly what we should do
if printer.link equals
this that's right
no and like you know the other thing to
be you know make really sure to any
regime that might try to oppress you
is like i'm not going to give in to your
shit man i would rather die than giving
to your shit
and like and you know the regime's gonna
judge whether you they believe you about
that or not
um and you know if
if the uh regime doesn't believe you
then yeah they'll you know they'll make
an example out of you
but if the regime really does believe
you
then like a lot of their leverage is
gone
and they're not gonna come after you
because if they did come after you
and you did that kind of shit people
would lose respect for the regime
right the regime operates because of
respect
i don't know there actually probably
some really fucked up things the regime
could do to you
and like
yeah maybe but you just kind of got to
have a resolve like you're willing to
die
and then man
does it matter if the regime loses
respect for you if you're already dead
what do you mean
you gotta you gotta think about freedom
for the future and think about freedom
you know like people used to like die in
wars and they died in like stupid ways
man
died martyr of course i died martyr
not because like i wouldn't let go out
and seek martyrdom but like
if that ends up being your lot in life
it's a whole lot better than like you
know
working a job your whole life retiring
and playing golf
do you have any right to go with mine
oh oh yo we got chips and an avocado
no way we're rich boys we're rich that
sounds
nice that sounds nice capital n
oh avocado you know what else this needs
a little bit of salt
make a little lime uh now we're getting
too fancy let's just settle for salt
and you eat it with the lime you'll just
be upset next time if you don't have one
some salt some cabba chips
avocado how many viewers you got
you guys want to see me dive into this
binary and we'll take a look at how
these programs work
i could really use a little lime
okay
you know we can find some documentation
on what these dma transfers are
dma chunk
and that will get a little lime we'll
get a little lime um
ah
okay we have two things we could do
right now one
we could start reverse engineering the
program
or two we can start figuring out how to
mimic
this all in python
it's the coral usb accelerator even you
guys can find it
hmm
okay so it seems like the way this thing
works
what's type three interrupt
what okay
timmy chango what am i going to say to
you
what am i going to say to you can can
you figure it out what i'm going to say
to you
when you're optimizing our diet to live
longer
oh god
i'm not gonna ban them i just don't get
why people ask questions like that
like what do you think i'm gonna say do
you watch this stream
i don't know i don't know if these
people
are trolling me or they're serious
let me show you guys the website
everyone team blind
blind is linkedin
fragile male ego and female leadership
tldr i've reached a seniority level that
requires soft skills of effectively
communicating with senior leadership
specifically male who may feel offended
threatened by my very technical and
direct approach but i'm bad at it
how do i make them take me seriously
without hurting their egos
so they like me enough to be on my side
what does pip stand for now i'm sure
they're not talking about the python
packaging system
they're talking about the performance
improvement plan when you suck ass at
your job
but nobody comes up to you and says you
suck ass at your job they say um i'm
going to put you on a performance
improvement plan
tesla the biggest fraud of our times
everyone using lidar is dumb
tesla has cracked full self-driving in
poker there's to say if you don't know
who the sucker is at the table then it's
you
well i agree that musk is a charlatan i
don't really know what can see
it is interesting that they hate on elon
musk
right it's it's interesting are bananas
coming back
well this is good this is related to the
stream
i am not a current employee of amazon
but hearing from my friends
that there are no longer bananas as
people preparing to go back to the
office
do they plan to bring bananas back too
blind sucks i don't want to see posts
about
indian workplace from a person who works
at
liberty mutual insurance
title says it all i keep seeing these
posts about indian job market for which
i have no interest
is there a way to stick to the workplace
content only for the us i have nothing
against their posts it just naturally
doesn't interest me by the way my tc
which is my
total compensation is 200 and i would
assume they mean
thousand because if they meant 200 they
wouldn't have a computer
and if they meant 200 million they
wouldn't be posting on team blind
[Laughter]
tc gtfo by the way did you vote for
trump as well
i am indian at my second mess
google just offered me 30k i think we
have to open an incognito window so we
can
not bypass the that was my reaction
is that an offer for a janitor it pays
based on cost of labor
exactly what vmware says
this has to be the dumbest post of the
day you are in poland compare your
salary to others earning locally
don't be so blindsided by blind that you
would expect google to pay
300k usd for a l3 position in poland
by the way you always have leverage if
you are a rock star at google
this is linkedin if these people were
honest
you know wait guys
can we post the survey on team blind are
you a part of the problem
hmm
so
after a grueling 60-day grind lead code
um yo please post about comma on team
blind please please like talk about how
like
[Music]
now i bought a comma sat in the corner
all day
and threw lines at the intern is this
acceptable behavior
tc sixty thousand dollars
gosh with the blind people in bosnia
ma'am you guys think about that that's a
demographic
that's a demographic that has not been
fully exploited yet
there are blind people in bosnia who
right now
are looking at a screen with google ads
on it but they can't see them
what are we doing for these people we
have to do something
wow
the great the great holy allegiance
um
you know you should really be
the most upset about all this shit like
i was never big into like social justice
before uh
i was never big into social justice
right like i remember kids in high
school who like when like amnesty
international they were like legit into
this stuff they were like legit into
like you know
trying to like like like like root out
shitty situations in the world trying to
like you know combat actual racism and
like
really genuine genuinely like great
things
you do understand guys that you know
you all understand this who am i even
talking to but like you know when
when when the nfl and nascar are waving
the pride flag
you didn't win right you didn't you
didn't win
this is not a victory for you right
it's not going to be a victory for me
when like
you know you lost man you lost and it
and it sucks right
like it's really gotta suck for these
people
well i'm sorry i'm i am genuinely sorry
to people who care about like actual
social justice
just please nfl please nfl tell me more
about gamecrawl yes
[Laughter]
oh yeah well that meme always goes
around on twitter it's like well you
know hey hey we're up for j pride and
everything but like
we might offend those demographics so um
you know maybe not folks
right like it's just it's
just an example you know of the system
systematizing and like what can't they
systematize
um i bring up seeing like a state
against
like it's just it just demotivates me to
do anything
it demotivates me to do anything when
like like until i have a way
to combat them structurally
it's like you're never gonna change
anything as long as these people
continue to like
you know dominate
we assassinate and install dictators but
we're intersectional exactly yeah i
could see you want to put that like over
the cia
like um
uh
what why are you guys all
posting this shit
what is all this shit man
is this a meme
wait wait wait did you guys find me on
team blind
no no no no no no
oh this post is no longer available oh
maybe
nope
what
oh ah yes yes from leet goat
this is going to sound corny but i want
to be the michael jordan of the tech
industry
i want to be as strong as possible
technically and also from a business
standpoint since one of my goals is
starting my own company
have a little yet less than one yohi
for reference somebody i look up to is
george hotz
don't care about fang
or tc tc
just want to be the best and work with
the best on
hard problems with autonomy
right now i'm pretty much noob so it'll
be an
uphill battle but one i'm willing to
fight for people who've been down a
similar path
what do you recommend
do you simply code a lot on the side
after work to improve
skills constantly have a mentor for
here's an interesting thought
you want to be like michael jordan
or like me do you think they ever posted
do you think you're gonna find a post
somewhere and you know what you work in
amazon so it's not like you're like you
know if you were like like eight years
old and saying this kind of shit okay
you know what you're eight
but you you're probably out of college
you're probably 23. do you think 23 year
old
michael jordan was like this is gonna
sound corny but i want to be like the
tiger woods
of basketball i understand the
anachronism
right nobody who ever went out
looking for their passion found it
it's uh god am i a self-help book i'm
fucking self-help
you know you guys i say this stuff and
then you feel like oh i feel
empowered oh i feel like and then you go
back your shitty job 31 percent of you
that's the problem
guys i want to play basketball what's a
beth betsy to learn it should i just
grind
don't don't make me don't make me load
up how do i fail at life we're bitching
about the bitches edition
what what is their advice
um okay wait these actually aren't that
bad
i mean they're not the upvoted ones the
upvoted ones are totally useless but
stop being passive when you see a
problem tell people and try to fix it
don't tell people when you see a problem
just try to fix it when people are
mediocre say so
understand when systems are flawed fix
them
the stance of it's not my place
and avoiding pushing others is the exact
reason you
will never become exceptional actual
startup founders learned this earlier
and it's a little harder to learn a big
corpse
i do think there's a difference between
pushing normal co-workers and by pushing
the people you are doing a startup with
while hiring the initial people of a
startup a high level of self-motivation
and initiative is needed from the
prospective employees
meaning this is why no startups are any
good anymore
because it's you know
there's a good 4chan world for word for
this you know
oh neither from the perspective of
employees or should we hire people who
don't need to push who are
self-motivated
okay i have a question are you
self-motivated
do you take initiative are you willing
to do what it takes
if you answered yes to all three join
my startup we are motivated we take
initiative
and we do what it takes that's what we
need man
you know what's wrong with everybody
else in the world they're they don't
take initiative
and they don't do what it takes man if
only everybody just tried
you know if only everybody just like of
all those people out there
here's here's an interesting thought
experiment that i always like
um whenever i see bullshit and it's like
okay
whenever like imagine a politician
saying
i care about the children right
if if the opposite of a statement says
nothing the statement also says nothing
right
could you imagine a politician who said
you know
frankly i don't really care about the
children that much they're not that all
important to us
right like then you haven't said
anything
that's right
um there is no startup playbook of
course not
of course not and there never can be um
another thing too
is uh people in the hacking world
think that like i should just you know
grind out binary exploitation and
you can't do that anymore because like
if you're trying to copy someone else's
the thing about everyone who was ever
great
is they didn't start out by copying
somebody else's path
they may have borrowed some things from
people along the way and there's some
you know universal truths to what
greatness is but
they didn't say i want to be like you
know
you want a date with george yeah
oh great oh man
oh 10 steps to disrupt my industry
do you think you are down
oh i can't even figure out the
joe it's the man i think he's eventually
gonna
oh i think he's mailed out significantly
as he gets older i think he understands
very well there's many people out there
you're more knowledgeable is killed huh
the guy's too arrogant to achieve real
success i don't know i think it's funny
maybe he's too arrogant
he's that mythical 10x engineer most
talented guys and
the fuck is sfba oh san francisco
baseball academy sweet i didn't know i
could play baseball
it's like reading comments but worse
i had a temptation to imitate another i
mean there's
no man i just steal every steal
everything is good man just steal you
know
i don't look like a good team player as
fair criticism man that's very criticism
you know
i'm sorry i'm not going to work up
through your l3 l4 l5
bullshit
yo kato curveball man no i didn't try
github uh
yo yo yo yo yo yo let's google
m i good at baseball
i don't know question mark are you a
good baseball player oh
let's see let's start out one which of
these positions play on the infield
all the above who plays in the outfield
i don't think outfielders do because
i've never heard of that one
but i'm gonna go with all of the above
okay so you're playing second base and
the ball is hit to you all there's a man
on
second where do you throw
hmm well the problem with throwing to
third base is i'm not going to get any
outs because the guy's just gonna
chill on second unless the question
is is there a man on first
i'm gonna not don't throw it anywhere
and just stare at
it
i think it's i think it's uh
god do i want to let the guy get the run
so i don't get somebody on third base
that's probably worth it yeah
bases loaded one out you're in center
balls hit to you
oh i don't know who the cutoff man is
this is a great quiz
base is loaded i think i throw it a
second
and we're gonna try for a double play
here you know what i mean because the
first base runner has to advance
we get it a second we step on second
base and then we throw it over to first
base and then we got
three outs no one even gets any runs
right
you're standing up at the plate and the
doofus empire calls a strike
that's a total ball what do you do
notice where he likes strikes and balls
and no wait i'm not the pitcher
i'm gonna say take it like a man
i'm saying none of the above because i'm
gonna complain about it to to the other
broski
shit how many major league baseball
teams weren't there
64.
well none of the above what's the record
for the most home runs in a single
season my boy barry bonds on steroids
and mark mcguire was close when you hit
a baseball how far does it go
um
i'm gonna say everything but four and
five
i bet you it's rigged that's right just
like baseball did you like baseball
this is a great question i wanna marry
baseball
oh i'm great at facebook
you're a below average baseball player
oh the internet was out of the internet
so
all right let's try to talk to the
google corel on python
fix a few things let's view the answers
let's see what i got wrong
all the above all the above all right
cool
oh i was supposed to go to first base
for the easy out
i don't even know who the cutoff man is
who's the cutoff man
man i really am not good at baseball we
gotta study
oh
i see it's like going through two
routers instead of one router
those who have short terms as well
it's really only that many i thought it
was 64.
damn damn i don't know shit about
baseball
[Laughter]
why don't i die that's a good question
enter my age 31 what is my height 5
foot 10 inches 70 inches and turn my
weight 170 pounds now 160 i want 68
pounds i've been losing weight that's
right
what best describes my eating habits
um
go with that how much do i smoke
never smoke no nearby smokers
[Music]
i'm gonna say that but it's less than
that how many alcoholic drinks do you
have for drinking
usually just one drink how much sleep do
i have between six and nine hours
um
i have a high paying job not really but
i'm gonna go with that
what best describes my day-to-day
attitude
let me say determine competitive
aggressive
what best describes my habit with
doctors
fuck doctors
if you count pay sound go with that
dental hygiene
that sounds right
um i'd say rarely
yeah yeah
zero how healthy do i feel on the
average day
eight eighty-three
sweet yo holy shit
i'm living for i've lived 30 of my life
already that's hard man that's that's
the real truth
damn i want to live to be 83 that's
pretty good man
and that means i'm probably gonna live
forever because singularity's happening
in
2038. dude i really am gonna live
forever
holy shit yo
which jersey shore girl would you date
man old j wow not new j wow
sammy bitch snooki would annoy me
who's the third who's the fourth one
angelina
yeah jayla seems all right old jay
weather not new
i have 52 years left to live wow wow
why do they tell me i've lived 30 of my
life already why don't they tell me i
still have 63
of my life left to live that's pretty
good that's like a d
do you deserve your high school diploma
wow we're just doing quizzes
wow these quizzes are so addictive what
is my
age 31 to 40
what is your gender why don't they have
an other
what is the area of a right triangle
with a 3 that's
6. right 3 times 4 is 12 divided by 2
is 6. how many digits are there in pi
infinite what's 10 percent of 25 2.5 the
soviet union was a us enemy in world war
ii no that is not true we were allies
the magna carta was written in
which country
god i don't know
sounds italian but that also could be a
decoy
we'll go with it no it could also be
some british shit i don't know
i don't know that one the year 1606 is
in which century okay so if the 19th
century was the 20th century
1900s was the 20th century then the 16th
1900s the 20th century then that would
be the 17th century right
so the 18th century was
was 1700 and the 17th century was 1600
okay
um immaculate conception refers of
course to
jesus uh well
jesus was the one conceived yes that's
true um the world's largest
three religions are
uh islam hinduism and christianity i
think that's right
um
christianity's up there i don't know
about taoism
i think islam makes it columbus ships
arrived in north america in 1492 that
sounds right
what is cubism it's some art bullshit
i don't know probably the modernist art
movement portugal's in
europe iran is an arabic
country i think so yeah
um it is annoying
in its redundancy so that's not an it is
david was made by i believe it was
michelangelo
though it could have also been da vinci
um
choose the sentence that has a dangling
modifier
[Music]
uh
i would say this
i don't really know what a dangling
modifier is i feel just the urge to
google um
just the following shakespeare says this
is a comedy i believe
why is earth why is it warmer in summer
uh the tilt obviously the sun has tilted
closer to the earth and
rises more frequently um
[Music]
it can't be because it's physically
closer to the sun because summer and
winter are different i mean
yeah no it's the tilt uh darwin's theory
of natural selection
posits that organisms with favor that's
always true
yes um plants algae and bacteria use the
process of
chemotherapy all right let's see how i
do
what what i get wrong
what did i get wrong
tilted is right iran's not an arabic
country the magna carta was england
iran's not an arabic country
[Laughter]
all right we're done with this we're
done with this we're done with quizzes
we're done with quizzes man
doing trivial bullshit you know next
thing we're gonna know is gonna be bar
trivia dangling modifier was wrong as
well
well i mean it almost looks like i spelt
it wrong
we'll do an iq test
it's too hard what's my iq now
yeah i don't know i don't know what the
definition of arabic is i don't like
these questions
what do you do in baseball
when the umpire
no i'm just eating chips now i'm not
even eating any more uh
flour chip
is this a short iq test or is it a long
iq test
that's too many questions i'm in america
i'm gonna go with d
all right you want me to do ravens
one will they move
all right there's one missing one circle
so i'm going to do the damn circle
all right well this is probably h well
it's not actually
h it was d um
all right they're moving through each
other maybe
no this one seems to overlap this one so
the
it's gonna be two triangles but this
one's on tile
i don't really like that because why is
that dot there
this is just c
okay
yeah it defines the way it expands so i
would guess it's
i hate these things you know like decent
and they like tell you something
but
um all right so that's h
can i go back through these when i'm
done
all right it's going to have a red and
then which red
it seems to rotate one each time there's
going to rotate one each time there it's
going to be e
oh no it's f because i like the pretty
flower
you like check like all the diagonals
and see if you get it right on all the
diagonals
okay yeah because then each of those
like that's right see
um no if it's timed two oh this is
stressful boys
all right so this is one of those like
add subtract d
kind of thing so we're getting rid of
that line and we're adding two of those
lines
i do think we keep that triangle get rid
of that middle line
okay um do we have 30 minutes to do this
all right vampire d
yeah we put the triangle in the circle
i'm gonna put the square in the triangle
now you put square on the triangle
um
this one moves down but not really down
actually can i just find which square
doesn't already have one is that gonna
work
those three are filled in on that side
those two and that one are filled in
those two which one's not filled in yet
it's the middle right well it's not an
option
come back to that one
all right circle minus square equal sign
so minus that thing so i'll just make a
dot
that also makes sense along that axis it
does because we're merging them there
okay yeah okay so this is just falling
is it falling with wrap around see oh my
god it's so stupid like nobody knows
i would accept it's probably b because
it's like moving down one but does it
wrap around like i don't know i guess
there's none with one so b is the
obvious answer
all right we got more of these doohickey
so it's gonna be a red doohickey
um those are these ones which
red doohickey do we not have
none of them so this one looks like that
this one looks like
this one looks like that this one looks
like that so it's going to be something
that looks like that so it's either
a c or h now we just have to figure out
what the orientation of it is
um well if that's that orientation okay
so that one points
up so that's gonna point up there so
let's see
um
those things are like moving in so we're
gonna have like arcs which
intersect each other
probably a
i'm not sure about that one
well but you're supposed to think about
this for a really long time
all right groundy things so it's going
to be at this doohickey
uh with a red square around it
probably that
okay we're filling in the line along
there
we're filling in the line along there so
we just need to
fill in the line so it's gonna be like a
bucket thingy with half a line like that
um
[Music]
all right so probably this one
could also be that one
um
i guess it's this one
but it could also be h
they're all inside the shape on that
line
go with c okay
uh
knob let's go back to this one
okay it's falling down up there
over here it's moving
okay moves up there that doesn't make
sense
uh maybe it's like some kind of rotation
thing
this is that one flipped over this is
that one flipped over
[Music]
no it's not that one flipped over i
don't know
let's get that one too okay lines
the lines are likely rotating lines
so yeah they're rotating that way
um i don't know
let's get hard you got to think about it
for a long time apparently i have 30
minutes this is really what you guys
want me to do with the rest of the
stream
okay this is again it's not exactly
subtraction
no it is it's some kind of intersection
thing again
probably get a line there maybe get rid
of that line so it's like a triangle
with a line like d
um
this one but not with that what else
what do we only have
three of we have a bunch of dots
we have three dots we need a circle with
a propeller yeah it's probably that
currently have two circles and two
propellers
might not be that
okay uh
we put that in the little box maybe
that goes in the inside circle okay so
this
it's like fill it in the inside and that
fills that on the inside so this we're
just gonna
it's just e i think
okay because i fill the inside of the
diamond with that
thing
that seems right
okay those are
bending or moving okay so
to go from this one to this one we bend
these and then we move them so it's
gonna look like d
bend move okay let's confirm that here
bend move yeah it's d okay
um we got some grounds
oh definitely going like that
rotate
rotate that one rotate that one
just when we rotate that ones we're
going to get a square
like a
can we rotate that one and i rotate that
one okay
uh squiggle
infinity squiggle
infinity squiggle squiggle
okay so this is probably some like
weird subtraction kind of thing
i don't know um
one plus one is two one minus three
is minus two two minus two
is just a circle i think that's right
um this one
it's like some operation that it's doing
i don't know we'll come back we'll come
back
okay
rotate it and swap the two colors
this one i can probably do with like
frequency analysis
so it's going to need a large
blue so those are the ones with large
blue
um it's gonna need a uh
we only have two small green so it has a
large blue and a small green okay so
it's a or c
great large blue and a small green so
it's either a or c
the question is then which way is it
rotated
um the no they're not
this one always has the same
shit that's not true it's either a or c
or maybe even not i don't know these get
fancy okay wow
all right guys i got 26 minutes don't
worry we got plenty of time
um
all right let's start thinking more
about these ones
hmm that's like some like okay so the
squiggle squigglifies it and that thing
rotates it
so we're going to want a small
squigglified and it's going to be
rotated 45 degrees
that way so i think it's f
those squiggles do match
small squiggle that means rotate
that means squigglify so it's going to
be f
follows with laws of multiple choice too
it's not b because we're not rotating i
mean i guess
uh c is it b i don't know you know what
the fucking thing is rotated like
i'm gonna go with f and say it's 45
degrees that way but this one of course
you can't really tell
okay um
back to rotating lines
i think all the lines are rotating
so yeah this one rotates here this one
rotates here this one rotates here and
that one rotates there okay
i don't know what happens when you come
to the end in rotation
does it snap around so i'm going to
expect a line in the
i i think it's d and i think that it's
going to flip all the way
we can try we can try let's see what
happens
rotating down that way around
here yes that just rotates there but
where's
no they don't have the line that i want
there's nothing
with a line on the
oh no i guess there is
maybe it rotates around
hmm i see a good argument for d there
come back to that one okay uh
what are these are these like um
right away what i think of as like a
gate
looks like a and gate or a
nand gate or something
does the position of the hole matter the
position of the hole does seem to rotate
around
that way so i'm going to guess that this
one has a hole position
there now is it see or is it f
my instinct says go with f
because that's just the repeated pattern
it's like some like sunlight
thing
my instinct says go with f here try it
um back to this like moving square
kind of shit is it a moving square
that makes that that nut
breaks down and then that makes
nothing seems obvious to me there
rotating lines okay squiggles
ah that squiggle
which is this part of the infinity sign
gets you that
that squiggle which is that
okay it feels like this is just some
like rotated
subtraction thing okay
[Music]
hmm
oh it's the axis to mirror about maybe
so if we mirror that one about this line
we get
that if we mirror that one about this
line we get that if we mirror this one
about this line
uh
we're gonna get a blow on here and a red
one there
is that right you feel like that's like
a fake this is this uh
i know i know i know like they're
supposed to be you know good and generic
about that
but
that is like a fair interpretation right
like that's a line and you mirror it
across that line so i'm mirroring it
across that
line and you get c right
it's pretty coherent um
this one's killing me
this one's killing me the obvious answer
is the center
how come some of them have multiple dots
the last thing i would think is that it
has multiple dots
so these are like binary logic kind of
things
sliding sometimes they're along this
axis
guys i'm not looking at chad so one of
you fuck said clockwise rotation
f like what do you mean clockwise or oh
it's just going around like that oh okay
i see what you mean fine
no more i'm minimizing chat i'm
minimizing chat
yeah okay so it's like slides around i
slide around the thing slide around the
thing i slide around the thing all right
f
yeah that one was easy
all right um
rotation yeah i got i should have seen
that faster
all right we established this one was
either a or c likely
um i feel stupid for missing clockwise
rotation huh
yeah that one's pretty obvious
i'm trying to try to you know you got to
think you know okay
all right multi-color
wait that's just black
that one's just black
okay so this one is that moved over
there
and then those rows transposed
how do you get from that to that
i don't know
i'm sure chad i know these get harder
i'm sure chad has an obvious answer for
this one
some like you know connecting new dots
game alike kind of thing
sure looks like rotation
and like some abstract sense it's like
you rotate around the solid black dots
yeah so those get rotated there that
gets rotated there that gets rotated
there
if you rotate these around the solid
black dots yeah so we're left back with
the problem of
what happens when you rotate this one
i do see an argument to be made for just
a line
i don't know how you get these dots
alone i think it's d
like it's like you rotate there and like
those ones flip around
we'll go with d
all right we're back to infinity sign
squiggles
and just it makes you want there to be
another infinity sign
but by the time you get to these end
ones it's usually not that easy
usually frequency analysis stuff doesn't
work
um
i don't feel great about any of them
like that's not a rotation
back to this one with the bars
i did frequency analysis stuff on it now
there's going to be a more
maybe it's like addition of the
different bars with rollover
yeah that seems right okay it is a dish
no that one doesn't work
um does the orientation of the bars
matter
[Music]
ah
some like intersection kind of thing
i'm too hung up i feel like too many
have been intersection kind of things
ah should we look at chat
are you guys you guys doing spoilers
over there in chat
let's let's let's get let's get through
and then and then we'll consider her
looking at chat a little bit and see
what chad has to say
um
gosh
33 is probably the easiest
ah
b seems the most right
right because
this one rotated 45
gives you that this one
hmm
i don't know about that i like b though
do we like b
is b good chat do we like b would be a
good answer for this one
yeah right all right all right
oh what did i change this one
no this one's just subtraction we know
this
um all right
all right do we know about about these
do we know about these
i'm confident i would have gotten a
clock eyes rotation
these these last four i don't know
okay um so it does seem like okay one
pattern that seems to be followed
is the
big one changes colors which would mean
the big one has to be blue which also
corresponds with what i found here
um the small one does not change cause
small one
now
is it some mathematical operation
these are hard all right good i'm glad
nobody else sees the answer
all right let's see
it's gotta be it's gotta be a or c
hmm
um
yeah three of each type but three of
each type works for both of those
i don't know
well guess a
or c i'm gonna say
i guess a maybe we'll come back to that
one all right so what's going on here
i'm i'm minimizing chat again i'm
minimizing chat again
um what do we got
oh
is there like some like replacement rule
some like way these things migrate
okay whenever i see a red okay whenever
i see a red
i always see a new gray appear next to
it that's a true pattern
all right but look what's even next to
that i
already have a gray there and whenever i
see a blue
nothing happens because blues are
useless
blues can show up it is
some it's some good game of life kind of
dynamic
gotta be colors and then this
shapes
um
is anyone in chat confident about an
answer to any of these
you're confident about an answer you
guys are saying all different shit
if all twitch can't do it i mean b is
the most beautiful
i do think i do think b is the most
beautiful i don't really have a reason
for suspecting b
aside from the fact that it's the most
beautiful
but it would just be very satisfying if
it was b and i feel like the people
would want that
okay
you can't just put a black square in the
middle that should be illegal
all right is this some like
if they always have the same colors
next to each other which is
kind of nice they can rotate
so this one to this one
is a
i just like i i don't understand this
and i don't think that's fair
you can't just put a random black one in
the middle
right like i guess it gives you an idea
that okay maybe the pattern is some like
big thing that continues all the way
around
which could kind of be nice okay
ones
it's not even like it like slides over
one or anything
what symmetries are preserved
i don't think it like flips this one
around
all right i mean okay we're gonna go
with one that probably has this row
it's definitely not that
okay well they all have that row they
all have that row at the bottom except
for e which is definitely not
e um
i'm gonna put this row in the middle so
this one doesn't even have that row
uh so it's definitely not e and it's
definitely not
g because g doesn't have that row or
b for that matter that row is probably
going to stay so it's not any of those
um this one has the row these all have
that row in the right place right
all these and then the top ones all have
the row in the right place too
okay so it's it's not ef or g
um they seem to rotate every single time
so i'm gonna guess that the black one is
then down here which leaves us with a
b and h do those ones rotate every
single time
they do as well
so that would put the red one
[Music]
in the middle over here and that leaves
us only with a
we can confirm
yeah i think it is a
put the red one over there america's
always moves
yeah good enough well guess eh
you don't like a why do you think it's c
who said c
let's see why is it c 100
c that's right
um you know what was it when like the
world chess champion it was like the
gary kasparov versus the world
who ended up winning
okay last problem
if they make me register for something
we're never gonna find out the answer
is there any we can just rule out
yeah you get this it's like like
columnar graph complexity what's the
shortest
chromograph complete it's compression
right intelligence is compression voice
uh
like i can't find like like a slider
maybe that each shape moves in some
unique way
no i don't know about that
do the shapes matter maybe the shapes
don't matter
i wish i knew which one was which i wish
they each had a number on them
you know
all right you guys heard of the laws of
multiple choice
a lot of them seem to have three
triangles
uh f and c are kind of mirror images of
each other so it's probably one of those
oh now we got this one wrong
i really have no idea
ah there's three with three triangles
a bunch with that square
thing do you guys know
all right let's go let's go with f
have you done an f in a while no i have
slot
the fuck
i don't even know how i did
yeah oh you're not allowed to publish
the solutions online oh shit
140. all right that's pretty good man
how many did i get right
i'm sorry for publishing the dutch
online all right
oh yeah yeah 140 problems smart
i knew my dna said i was smart
how many did i get wrong
uh no a lot of the problem with these
things is
like you know
what did i get i probably i probably got
two wrong
right and like it's it's randomness at a
certain point
yeah i don't know how i didn't see the
clockwise shit that one was obvious
you didn't help me with anything else
i would have gotta climb that shit
probably eventually maybe
right
um
all right so you know
if you have above a 120 iq i think
like life outcomes there don't really
matter
um
this is interesting yeah
so um you know major in physics
financially he's like he was like 120 or
some shit
i have one for me and my twitchies
together have a 140 iq
all right usb
it's not even a real iq cast bra bra
140 oh you got one for me i have 140 bro
or even that makes it worth eating the
other pile
how do we go from baseball to actually
just spending 30 minutes on an iq test
i also think those last questions are
kind of like
ridiculous
like they're not fair you know
how are you supposed to how are you
supposed to like
intuit all that stuff with soul
information
hey how could deeply how does deep
learning do
people have tried this right deep
learning raven's progressive
there aren't enough of them now
now practice for five days go grind
elite code
for five days
[Laughter]
i'm getting into mensa
i don't know i don't wanna hate on men's
side you know much about them
well i want to google
all right
surpasses human level performance
oh
it doubles the accuracy of random
guessing
i put two simple ravens on the uh
i put two simple ones of these on the uh
twitchcock test
do
all right i'm getting tired
so i'll push this to gab
and if anybody has a coral and they'd
like to continue this work
we should be able to write a pretty
simple python driver
um where are these coming from
what is this
it's just raven's progressive matrices
ma'am
you just gotta like see the patterns you
know it's the same shit
uh
okay
um so it looks like we can just read
from there
i'm curious what it actually reads we'd
have to intercept the callback if we
wanted to do that
um
oh okay i don't know dev dot read
from end point
two comma the length is ten
and put output error now we're going to
like set
set configuration claim endpoint or
something claim
claim interface yes
no attribute claim interface
operation timed out
let's put back the control one point
interceptor
i'm gonna add this to uh
yo yo no sport ball chat no spoil
go away with this fourth one
these things are like setting things
aren't they
sports ball out you ever seen a dog
get like kicked out of a house for
peeing on the floor it's like that
yo what's that game of thrones quote
that i cut out my tongue
cut out my game of thrones you know
you think it's like some like like like
ancient quote from
history but it's actually game of
thrones when you tear out a man's tongue
you are not proving him a liar you're
only telling the world that you fear
what he might say
i like that quote
dev reed
these things are like no this is like
poking all this stuff on the
on the corals isn't it
that's a descriptor read but the rest of
this stuff is like programming
see if we can look up what these things
are in the driver
guys you know what make this stream so
much better if we could listen to music
you know
oh there we go look it's that yeah
that's a rambust control one
oh w index four yeah mesh bus
run control
so this is where it sets up all these
registers
some are probably important some are
probably not important
and then it considers the device open
you should actually not say open device
we should say
oh ben device because it happened in a
past tense
you can but you have to have it in a
separate obs stream so it doesn't show
in your vods
oh i don't even know about that that
sounds too hard man
copyright free music really copyright
free i know i did this once before and
it wasn't copyright free
oh is this actually royalty free
legal notice
licensing the black download project as
long as you credit
this looks too hard
free music
no this is the one that's not really
royalty free i'm not getting scammed
again
by the way look movie dot a g
boys i've said ever since i've
discovered look movie dot ag
you know what's nice about censorship
like there used to be one thing that was
always censored
oh twitch broadcast soundtrack wow
twitch has something for this
i mean i could always play my music
oh available for windows 10. oh how nice
is that
all right who thinks we can figure out
how to run it
probably gave me an xe file oh it's an
xe file
we love x's
oh okay okay okay
your requested url has been blocked by
the government communications of india
you know what is nice oh dmca's safe to
stream music
ah nice
[Music]
no
but i need oh this place is also
available on other
industrial sites that sounds
oh yeah and now we're talking
uh which of these can i do without
logging in
i have to pay for it
what's deezer deezer is going to let me
just play it deezer's a whore
oh listening is limited to 30 second
clips medianet
you know what's really nice about pirate
about it you know it used to be that one
thing was censored from the internet
right
piracy but now you start censoring like
people who have like weird ideas about
covid and what's great
is these people are very passionate
about their stupid fucking ideas
and they're going to create alternative
platforms and some of these alternative
platforms
may allow piracy again and we're going
to re-enter a golden era of piracy
these are these nuts
these are these knots
[Music]
all right that's pretty good let's go
sounds like some good hacking shit
oh yeah let's drink some monster 8-bit
music
[Music]
oh we're hyped boys we're hyped
[Music]
oh this is some elite hacker shit
remember when you could like things not
ironically close to the days
[Music]
do
[Music]
so
[Music]
why are all those extra spaces
[Laughter]
[Music]
[Applause]
[Music]
so
[Music]
[Applause]
[Music]
[Applause]
[Music]
[Applause]
[Music]
[Laughter]
[Music]
[Applause]
[Music]
[Applause]
[Music]
[Applause]
[Music]
do
[Music]
do
[Music]
foreign
[Music]
oh some of these are reeds and some of
them are rights
[Music]
so
[Music]
[Music]
foreign
[Music]
um
[Music]
do
[Music]
yo yo
[Music]
operation timed out what's happening
i understand c did the same thing didn't
it
[Music]
what is this request this is a standard
issue request is it not
[Music]
some of those are reeds
[Music]
[Laughter]
[Music]
[Music]
[Music]
so
[Music]
all right reads this and then it
probably
[Music]
why am i is getting input out for there
i did all the bullshit
all right 83 type 2 which is bulk
get all the setup
[Music]
and you can look up each one of these
register numbers if you care in this
stupid file and you can find out
oh it's the scalar core run control
great
[Music]
i was enjoying this last until we found
this great royalty-free music
[Music]
this music better be royalty free boys
that's really why they're gonna ban me
man copyright infringement
promotion of piracy haven't you heard of
quaternary copyright infringement
no stop timing out stop
fucking timing out
[Music]
wow robin prinkler thank you for gifting
subs
[Music]
hola beats
[Music]
there's something like else i have to do
right it's like set configuration but a
few more things
[Music]
i'm getting timeouts which is different
well that actually might be okay
so i remember they're doing six thousand
for the timeout maybe it just takes time
[Music]
put out for there
[Music]
no maybe six thousand seconds or
something oh that doesn't work
all right um
[Music]
do i need this
[Music]
yeah alt settings
[Music]
good point let's use github co-pilot
[Music]
to log in
[Music]
i've been added to the wait list
damn i should've done that a while ago
i'm on the wait list we can't use github
co-pilot
there's a vs code extension
does your shop no it's chiptune bro
[Music]
okay what else am i forgetting to do
it's got to be something
i set all those things up that all seems
right just like
it does those reads right
[Music]
can i send stuff to
oh maybe
that no
[Music]
do
and i got the computer specs question
what am i doing wrong
so
all right boys we're gonna we're gonna
take a quick break
just a quick break uh
what are we gonna do we're gonna do for
the break
you guys figure out during the break
what up boys we're not back to 3 30.
this is just an interlude
well did somebody say mcdonald's did
somebody say mcdonald's
what's this text oh that did somebody
say mcdonald's
give me a flag bro yo mcdonald's give me
a flirt
i'm gonna unique floyd ah
burger king what i wanna uh
chick king a chai king chicken
i don't want one of those i want
mcflurry
yup you got any mcflurries
i'm interested in a flurry
did we figure out what's going on as our
logger
read the internet any that's not even
right
it's trying to read from that one
maybe that one
right we're not getting i orders anymore
we're getting timeouts which is totally
different
what takes so long after this and what
is this
um is that a reed
reading some descriptor
that's w index right w value okay what
is this
oh usb reset oh it's sending a reset
i don't know maybe this one's important
if i just put it in will it work
maybe maybe
try that
um
let's strip both sides
no i didn't fix shit oh it's the other
error
usb reset
oh don't i have to use the piss coral
leaves no i actually don't have to use
the piss coral libs bro
we already did it with edge tpu but now
we're trying to do it with python
shit it all looks the same except for
this one which doesn't work
endpoint type 2 length 10
time out 6 000.
so
windex yo w index and windex are spelled
the same way
okay i mean there's got to be some
bullshit with the device you want to try
to figure out what these things actually
are
let's reread it
this is just a read and a write let's
look up some of these things
i'm using vs code microsoft come on i'll
be a great show for github co-pilot
we'll see if it's good
oh well of course it's setting the
omcd8
missed error archer mask
narrow to wide run control
why to narrow run control
mesh bus zero run control okay looks
like we're turning those things on
maybe
i see that doing it maybe we have to
timed out sleep after the first
one i don't think that's right
we can try it but
it even works
i don't think it's using any other kind
of transfers
uh
you sure to claim the interface
i'm sure there's nothing going into bulk
transfer right
oh it's actually possible those aren't
returning
and they're just cued up oh
i think that's what's happening okay
um this is a little tricky
oh man this is gonna be oh this is this
is hardcore tricky all right
are you guys ready to see some you know
real shit let's go let's go we're gonna
have to hook
we're gonna have to hook the callback
oh that sounds hard i actually think
those things are not succeeding
and this is just junk
and the first thing that's happening is
actually that
yeah and this is downloading like the
main
firmware
is that in the model you see you see
what's happening all right
let's try it briefly um pointer
callback equals
uh we need a callback
we could just read the code this this
code's actually open source i
i keep guess i'm forgetting that and i
don't
fall back
yeah look it's lies boys it's lies we're
only getting callbacks on
those whoa now we're finally getting
callbacks he's probably like timing out
or some shit
yeah oh that's crazy y'all that's
crazy man all right let's figure out
where this bullshit is coming from is
this from the model
this here from the model is it a model
are you in the model
yes
all right so that was a waste of time
ah let's see is this shit in the model
i feel like it's not
who else hates python 3 oh it's in the
model
uh okay let's just make this something
called
let's make a function called send it
takes in a device
it's in an offset and it takes in a lan
uh we'll call it csend c send
dev at find
uh and then we want the length to be
this
okay now we want to do another one the
length is
60 75
uh oh and the thing we're going to find
is
this
oh george usually was refined replaced
well you know
my vim skills have limits boys
um we need struck
actually enough of that one for this one
i just want to do
oh and then we'll say
uh
and then we send this junk
uh okay that sounds good let's take them
csans
down here and then we'll try reading
okay so that should send that let's just
send that
oh and then we gotta send this as well
wow this is a lot of junk we gotta send
is this in the model i don't even know
on hex defy
this replace
just find it dynamically how long is
this one
this long and it also gets sent to zero
and then
finally we're gonna get a response
allegedly
allegedly we get a response
um ascending
offset with length
number
there's a chiptune hat where's i carly
at
yo where's the party at
yo
well operation timed out no
oh it's because we tried to send it to
num2 we gotta send it to num zero get
right boys
operation timed out how'd that even time
out that's illegal
uh oh we broke it we broke it we broke
the coral
can this thing fix the coral
no we broke the coral
we crashed the coral unplug
plug it back in
guys guys we bricked the coral guys
the coil doesn't work anymore guys guys
i have some terrible news but we've
bricked the quarrel
we we tripped we tripped google's empty
circumvention shit and we we broke oh no
oh good it reset the core oh i don't
know what happened like reprogrammed
that
oh we had to upload the firmware to the
coral
oh look what we intercepted this time
boys
the firmware
[Music]
wow look at all this
look at all this firmware
[Music]
oh
oh we broke the coral again
look it's screaming now it's screaming
don't prick me please don't brick me
i don't want to be a brick
we bricked the coral the good news is it
does seem like we can unplug
and replug the the firmware
replug call
oh it failed
download firmware boot coral
i don't know maybe maybe uh
oh maybe we have to send it in chunks
that seems right
if ll is greater than
while ll is greater than 1000
uh off plus equals 1000
at
all right
come on come on if only had one shot
one opportunity to tease everything you
ever wanted
would you capture it or you just let it
slip
my arm spaghetti knees weak arms already
there's vomit on the sweater already
mom's spaghetti no
did i break it again no it's not as
broken
that's right
okay that one works
off white all right oh wait all right
oh wait this might not even be doing
anything because we might be left with
that same
callback bullshit again okay uh
well this is a problem because how do i
save the real callback
uh all right should we just use c plus
how do i
i want to hook a call back
but on the surface he looks calm
spaghetti mom's spaghetti
he looks nervous spaghetti
spaghetti even
um what if it called a real callback
i don't know
let's just write some really low quality
shit and maybe it'll work
ready for some really low quality shit
this is really low quality shit boys
this is really low quality shit
but what if real callbacks different
george you didn't write good code
looking on the surface he looks calm
spaghetti
that's what you get for not writing good
code
that
fault
she said she hates her friends
because they call her all night she's
turning off her phone
she's going out tonight
[Music]
oh someone's texting me
um i text that guy back
next weekend after holiday weekend
um
okay so it is real it is really
returning something
did i do this right
could that not be the right thing
like this could just not be the right
thing
just give us more context just in case
multiple things start with the same
thing you know what i'm saying
y'all know what i'm saying it's not
crashing every time now
numbers require oh i gotta find it
operation timed out eh
you guys want to look at the firmware
all that initial setup stuff it does
ll numb that's right
we're writing it to one type two is a
bulk transfer then we're doing we're
trying to do a receive of 10. that
should work
that should completely work
this is like some notice here when it
reads this this is the
actual like data that it reads
and this is just something saying the
program is done
the program is not getting done
half the time you put output air half
the time that
you can look at the packets and wire
shark uh
can i maybe we can try
that would actually be nice i could have
just hooked it the whole time can i hook
usb
uh
where to capture usb
there are these
it's just gonna work they'll be sick if
that works
this one
your faces are named
yeah not easy
i don't have system integrity protection
this system has
no integrity
it doesn't exist
regardless like i don't think i'm
missing anything
i guess i could see what's being sent
back
and i could see that all these things
were actually fake
like they're just cued up
oops it's not right
if that matches
it's all the same
look it's going back into pulsing mode
what's pulsing mode mean
this didn't change did that those are
still the same right
that one's different that's a read
anyway
oh edge tpu running when led is pulsing
i say
cool so it's supposedly running eh
what is this crap supposed to be
operation timed out
why
not pulsating
is there anything useful here no
yeah i tried that it doesn't work i
don't think it works in catalina
it's not catalina the m1 i know this
shit works on m1
because i'm not even sure my usb is
wrong
so okay notice how there's a few
different um
things this is a program
this one here to zero one is
the uh yeah as the image
and then zero two is the weights
program more weights
program more weights i'm going to read
my only thought is that my program could
be wrong
like it's it's matching some other part
of the file
that's the only thing i can think of
like there's other stuff that all has
that exact same intro but
it seems unlikely but possible
should we try to parse the tf lite file
we're gonna have to do it at some point
anyway
one of the things is being found there
it doesn't seem right
it says found i don't know
the second one's found here
22.08
no sorry if we want to see which is here
like does this exist in multiple places
in the files
one of my questions
um you know what there's a simpler way
to do this i can just
so
they're pulsing again
why does it wait so long after that
now it's broken oh we're covering tf
light models from the binaries huh
something different
get input y'all get output details that
looks pleasant
quality
i feel like maybe after i run it once it
like messes up
how do i do a usb reset
wow okay not that
yeah i know it should have a structure
i'd agree with that
all right now like load something it
takes forever
sends all that let me get rid of that
first one again
don't think it's useful
put output error
that really doesn't make sense looks
like we claim the interface
device dot reset no i was gonna do it
here
oh it worked
look at how it responded with that
now no such device
it works
oh maybe did i reset it at the end
awesome okay look we're getting a
response
device dot reset bro you're cool
what else you've been saying
following since three hours ago all
right you hang around a bit more
you can learn vip you keep making
valuable contributions
ah
all right we're in boys
we're in we are in
all right now it's getting valuable
let's push this to github
did they respond to my request yet for
using thingy
what are we going to call it edge tpu
x-ray
that sounds nice reverse
okay sorry sorry um enabling
compatibility oh that sounds nice
with the google edge tpu
enabling uh let's say tiny grad
compatibility with the google edge tpu
yeah that sounds nice alright cool
gotta avoid the stuff yes i'm sorry i
still call my things
master you gotta watch out man don't
wanna be a pokemon maine
i don't wanna be a pokemon mane let me
tell you the difference between a
pokemon master
and a pokemon may okay a pokemon master
tells the pokemon what to do pikachu use
thundershock
a pokemon mane do you know what that is
that's pikachu you're doing the shock
you know when that psyduck uses
confusion he's
targeting you that's right
don't be a mane be a master
gotta catch em all gotta catch em all
pokemon all right we ready to figure out
if things are bananas in python
oh let's go let's go
i want to be the very best like
no one ever was
train them is my cause
i will travel across the land searching
far and wide boom boom
[Music]
all right so that sounds nice that
sounds nice
wow
sweet okay i can break anything
in my high quality refactor all right
now we want to send
let's upload the model okay
so we want to run the model we send that
one
then we send this one
just length this
[Music]
okay so this is a little bit smaller
than the banana
isn't it
14 a b
probably some bullshit we got ascending
like rounded up
plus five that
banana
all right let's go
now i'll send dev
that data and the number one
this okay so that's that
now we have to send this next chunk of
weights
to pointer two
all right we send the program send the
weights
uh 80
okay we don't do any receiving it looks
like
we send the next chunk of program
how much program do we send this much
program
and how much weights do we send
wow it's a lot of weights boys that's a
one in the front there
oh that's heavy
all right
now one more
this one
this one we send this one
what's this oh it's just a runoff all
right we're good
uh let's send this one this is a weight
so it goes to
two we send that to zero and now we have
to send
one last weights and then
we do the read
e121
here zero some of the weights now we do
this read again
and then the big deal we're gonna read
out banana
we're going to read out the fact that it
says it's a banana all right
and this one we want to do hex 400.
all right let's try it cannot
concatenate string to bites oh
disgusting
well now it's broken
we might want to do a reset in the
beginning
download the firmware one of these days
we'll make the python download the
firmware
um now we do have to do the reset in the
beginning otherwise it ends up in a bad
place okay
let's do the reset and then let's
sleep
six that's a good place to sleep
okay yo
is that ff right where the banana is
i don't know it might be that's at 3bb
3bb to decimal
is 9.55 and if you guys remember from
before
955's a banana and just to prove
that i'm not messing with any of you we
can try it with something else too
actually you guys want to go crazy let's
go crazy
let's include requests right that's the
beauty of python you're about to witness
python power right now
request.getsysartv1
um what's it called text or something
something like that give me a url of an
image
all right give me a url of an image
text is that right i don't actually got
text it's always one thing all right
who's posting
who's posting uh who's posting a url of
an image
i know we're even gonna we can even load
this in python because it's so easy
let's just load this in python correctly
you're about to witness hip-hop and it's
most pure
smoke raw it's most almost godless so
portrait of a british shorthair cat with
yellow eyes wow that's the longest url
i've ever seen
but for you bro we'll do it
oh no it has like weird things in it
module name requests
store object is not callable
oh god no don't do that no no no no no
no
no
okay um
kill image from string
let's get this uh
string i oh yeah
wow yeah okay i oh that fights like that
sounds better
um
now when we used to read a banana
let's just go in here and put in
what did i call it out that was a stupid
name
image underscore pixels yeah you got to
name your variables not stupid shit boys
because if you name them stupid shit
you're going to forget what you name
them
all right is this a cat let's find out
bytes like object is required not string
what is it data
response has no attribute data raw
it has stupid name
requests text
what's it what's it called content
content that's it
i always forget that m is not defined
now i'm just defined are you happy
wow okay which one is it it's this one
here
i see that's one one e
which is 286
egyptian cat boys wow did we just get
the google tpu working from
python yo
yo google should give me money for this
that's the most use anyone's ever gotten
out of one of those little things
yeah all right all right all right fine
we'll finish it up we'll make it say cat
alright who's ready to make it say cat
let's go let's go let's go
let's go let's go okay
uh read dots
i'll call it labels um
dumping that we'll say uh
if that's a buy
zero print that survived labels
this index had a rh
let's actually let's do let me just do
this quickly too
labels equals what does that just strip
off how many characters
let's sub one two three four five six
seven
okay pop in it's almost pure
uh let's do
sorry i needed a a
she says she hates her friends cause
they call her all night
[Music]
all right oh it's about seven
that should be sex
all right let's give me some urls does
everyone understand what's going on here
it's 131 a persian cat it's 87
an egyptian cat and it's seven a tiger
cat
and then if you really want to go crazy
it's a rabbit all right what do we got
what do we got statue of liberty that's
appropriate
the link better yeah sorry let's go
pedestal also a totem pole very
appropriate
that's right who said we knocked all the
totem poles down that's a why
we have our very own american
uh use jpeg in
connect dot pi with edge
tpu
i don't trust any of your screenshots
it's got to say what it is you know what
okay maybe we can look at it over here
first
because we're not getting anyone bam
from twitch
is it a bagel or is it a dog i do not
know
it's a bagel
hot dog that's very appropriate for july
4th too
all right is it a hot dog or is it a hot
dog let's go
oh will it work with png hot dog the
fucking way wow
wow that's wild that's wild all right
all right all right apple apple
when you guys are going to troll me and
like it's going to be you know
goat sex or something granny smith
that's
wait a second i have a theory boys
i think we might have got the colors
backwards i think we might have messed
the colors up
because it thinks it's a granny smith
let's fix the colors
no it still thinks it's a granny smith
i mean to be fair smiling old man having
coffee
looking happy that's a suspicious
link
i mean all right to be fair he's a
suspicious looking guy
cup coffee mug
all right they're all bagels
they're not dog
all right maybe someday we'll figure out
how to parse the tensorflow file
maybe someday we'll figure out how to
parse the uh you know
the other shit but i think that is
today's
stream uh anybody who has
a google um edge shit
the only thing you're really going to
need is this file
and then this will work you just have to
get that file
and then you can use this very
conveniently without installing any lib
coral
this this might be useful to somebody
somewhere
i mean i doubt it especially since i
think you have to run that
for the firmware downloading
oh all right we'll do the firmware
should we do the firmware let's do the
firmware
let's just do one more thing should we
do the firmware so it's actually useful
to somebody and write a readme
oh yeah you know what bros if we don't
finish
you gotta finish bros you gotta finish
that's right
all right we'll do the readme we'll do
we'll make it stand alone
i'm about to witness hip hop and it's no
strong
[Music]
on deception
okay so we'll just write a little readme
up here
use your
google chrome usb stick
with
from python and only python
get rid of the user's tailor chat
um for those that are new to this stream
my computer's named taylor because i
love taylor swift
uh oh but see now it doesn't work cause
we didn't download the firmware
if anyone would like to waste money and
purchase one of these things to make
this example work
uh i applaud you
okay we're gonna have to make the
firmware download work but right now now
this should work
oh no it doesn't work because it's a
different oh no
okay that's not the right edge tip of
you
that's not the right file
uh edge tpu pick coral
nothing pick coral is it what is it
lib coral
get status hmm someone updated it
that was a mistake
test data yes
but
actually get log
oh we have to get release frog fish
i don't understand like when did this
change
um
she said she hates her friends because
they call her all night
she's turning off her phone she's going
out tonight
oh there was metadata added we don't
want that
so
maybe this works
this
i know a good image we can use that one
from tinycraft
now where did apple picture go i wanted
apple
getting extra file
running with apple
you can run with
other image too
well
that's sad doesn't that work anymore
oh i think
interesting okay
this is the firmware and we have to get
it from somewhere
and then we have to download it
well i don't know what reg 200 is that
looks fancy
where does this firmware come from
if this is a dfu download mode request
and then it reads it back that's mad
legit
where does this binary come from let's
go find it
that's not going to work
where's the firmware executable
oh here we go
no nevermind
[Music]
but
who can find the firmware oh here apex
latest single epi
is this it i think this is it
which one's being downloaded the single
epi or the multi-epi
also how sick is that who's ready to
start reverse engineering this
are there any strings in it
not seriously
all right let's go over to google edge
tpu
live edge
and it's in driver usb
let's click there so we go to that no no
no no no
don't want master don't fall for that
scam again
gotta be respectful of copyright boys
respect women and copyright
all right is this the same thing as this
it's just like
20 of 0 12
[Music]
and yeah okay it's probably the same
shit
okay so it looks like
we do a control transfer
how does it know if it has firmware or
not
i don't know sounds difficult
okay so the reason that we have to do
this is because otherwise it doesn't
work
if you unplug and replug it like i'll
show you what happens
so if we don't have any firmware and we
just go and we try to run it
it should run okay now yeah it gets us
granny smith now
but if i unplug this
respect copyright sigma heavy industries
we get this crap which is even weirder
oh
it's a different device oh
yo yo yo okay that makes a lot of sense
global unichip corp
that is so creepy
doesn't even have the same
if dev is not
download firmware
if dev is none
you need to buy google
for no free
banana for you we're also gonna make
banana
the default image all right
apple is stupid
that looks like a webp banana i hate
webp banana
google drive that's gonna go away
bananas.jpeg this one's not going away
do need to buy google coral no free
banana for you
perfect love it
running with banana you can run with
other image too perfect
okay um all right but that should be
none
oh it's none because
right they're all the global the global
unichip corp is
creepy
do download firmware bro
all right let's load the firmware
isn't so nice to write low quality code
on a saturday
oh that's very pleasant
dev control transfer request type
is 21
one
oh yeah who remembers this on the iphone
base
control transfer
uh
i'm wearing some high
um
[Music]
all right someone that's zero
receive
i don't actually want to do the read
back do i have to
let's see the device now i probably have
to do it okay fine
i will
poisoning pigeons in the park remembers
that song
poisoning pigeons in the park
three
[Music]
the length is uh well that is zero
and length is six right come on
come on one shot fuck fuck up and i
don't redo it
let's go no no we fucked up we're not
redoing it we're out
we're out no well there's a python today
we can't we can't find python shitty
let's go uh unsupported operand
for bites in it what
oh because it has two of those doesn't
it don't one more zero in there
all right it still didn't show up but i
think that's because i just didn't give
it time
all right which is device is there now
pipe error
who's falling for it
who's falling for it
you need to buy google coral no free
banana for you
oh really i don't buy google coral
okay the global unit chip is back i'd
rather just send some stupid like boot
command
all right we did all that do the reads
come out to 70 and that's right
and then it just boots right
this just boot now
hmm
all right let's see oh i probably have
to do dab dart reset
entity not found oh but it's there
google composite device all right we
gotta give it
banana banana banana
okay now it works but it doesn't
download the firmware yet
all right now let's see if it'll
download the firmware download doing
download firmware bro
entity not found um
if i run it a second time
oh that's not oh okay that's fine that's
fine actually
that's actually totally acceptable
oh but now it's not there okay okay we
have to call
dev reset but we have to intercept this
yeah banana all right
i don't know what apex is but we need it
okay boys so now anybody
anywhere can run their google tpu
from only python
wow wow that's useful
someone might do something useful some
kid
might be inspired no
no
actually okay so um i know a lot about
the tpu architecture i hope it's similar
i hope the compiler is similar
what is build.sh for it not for you you
don't use build.sh
sorry this is a very low quality project
this is this is
it didn't even get a twitch name it's a
very low quality project
the really interesting thing to do will
be to start diving into these numb
zero downloads
actually i'm just gonna move this
sending
so like
right now it sends num1 um
yeah you know i'll just leave the same
can i call it none i'm passing old off
here
it's kind of kind of like it you know an
injury is required not none type
fine you get minus one if you
insist on a number
beautiful
okay so now you can really see the
structure of what it sends um
i don't know what that response is but
so this is some program that it uploads
then it executes those instructions and
it sends another program
um it sends the data
actually what if i just don't do that
first one could it be important
yo it still works wait did we just
optimize the google tpu and make it
better by commenting out useless junk
i think we might have or maybe it
doesn't work if i unplug it re-plug it
oh no that was necessary but it was only
necessary once
so it loads something into ram but once
it's in ram
it's all good that's a lot of junk
i need to add a requirements.txt i'll
merge your pull request but only if it's
low quality
this is a low quality repo also if
someone makes the uh
read me prettier i'd merge that pillow
request too
all right can i explain to you what we
did all right i guess i guess we'll
explain what we did
this is a google coral
um google makes you install 1700
libraries to use a google call
we got rid of all the libraries and we
replaced it
with 185 lines of python
now of course this python is much less
flexible than all those libraries but a
lot of people really don't need
flexibility because the only thing
they're ever going to do with it is run
the example
and the fact that you can now run the
example with a single bit of python
is honestly completely fucking useless
but
tell me what you did on your saturday
that's right
you watched me stream you managed to do
something even more useless than i did
someone somewhere might someday
look at this code
but you know useful things are yeah
we don't do useful things on the stream
as you guys all know
uh nah some of y'all i see me all over
right
i mean i don't mean to hate especially
if you have a star next to your name
you've subscribed
you're a part of something okay if you
don't have a star next year name you sat
around all day watching me like
you spent all your time and you won't
even pay five dollars to subscribe to my
twitch
now what does that say right like
subscribers you're
invested you're trying to do something
with your life but
not subscribers well i don't know about
you
you're poor oh
some guy quoted me on twitter and you
know i love that quote if you grew up
with access to the internet and you're
not successful
it's your fault bro and that's a great
quote like there's some people who
didn't have access to the internet and
those people we can pity but everybody
else
you had the same internet i did bro same
internet stop being poor don't actually
subscribe to my twitch channel it's
totally useless
you'll get my appreciation i honestly
genuinely do appreciate subscribers
uh more than i appreciate not
subscribers
and that's true um but
you just kind of it's a decision that
everybody has to make for themselves
whether they want to subscribe to my
my stream or not i'm not even trying to
like bias you one way or another except
for the fact that you know you totally
should subscribe
but like other than that i'm not you
know you can think for yourself man
except there's obviously a right answer
so there's that
jioha gmail.com if you wanna see me
right on paypal
i always love free money
uh do i need the cash no
it's just about showing off to the other
people that you guys have stars and
i mean do i like the cache yeah you know
you're so cool you should break dance
nice bait bro
nice bait
you subscribed and i didn't stream for
four weeks i'm sorry man
i'm sorry you know but i'm not going to
be holding like if i
was decided to stream because you spent
five dollars i'd be a real cheap whore
man
that's all i'm saying all right
but i if i could gift you a subscription
you'll do it again now that's the
attitude i like to see
oh that's great uh
aren't we all cheap whores oh no that is
a held for reason misogyny
i don't know none of us were talking
about women so i think they got to
improve their ai
i think that that's some i think that
that twitch ai is being misogynistic
thinking
that when we were talking about whores
we were thinking about women
that is incredibly misogynistic and
um you know i don't think that horror
should be gendered
that's right i think there's there's
male whores and female whores and
trans whores and a dinosaur whores and
like there's lots of different kinds of
whores man
and i think for twitch to single it out
as misogyny
is both misogynistic and heteronormative
that's right i can speak post-modernists
can you
um oh
no no we need the labels oh you're right
oh you're right wow do you actually have
a google coral
you're right you're right we need the
labels thank you good catch bro i'll fix
your bug right now
you don't get this kind of high quality
support right oh you got to download
that one too
um
let's say
all right we'll get it we get don't
forget we get
ah original labels
cool i'm updating the readme
just for you bro do you actually have a
google corelog
i forgot it because i really didn't
structure this code very well
cool
i mean to be fair i don't really think
we need that one's not really
copyrighted
but labels
all right pull now and try
i'm gonna get rid of those comments
because it makes it harder to copy and
paste
what am i screaming about
oh we're warping into the pipe world
boys
i'm not streaming comic con you guys
can't cause an irl event man i get
fucking call
those who calls
she said she hates her friends cause
they call her all night
she's turning off her phone don't
use build.sh i'll lay out a note
do not run build.sh
for taylor only can i spell the only
wrong
you use connect dot pi
nope
[Laughter]
docs
um
oh i got no old programmer so that's
inside
you think i broke you think i'd do this
because i need to work
i don't need to work for your shit
where's other coral guy wait did some
does somebody actually own one of these
did somebody else actually waste 45
dollars and purchase one of these
like and it's so sad because google if
you're watching the stream if anyone
from google is watching the stream or
if you're at google or anything i don't
fucking want this
nobody wants this nobody wants
little doohickeys that you can plug into
a usb
port to make tensorflow run
you know like like 2x faster than your
intel cpu
with 10x more annoying libraries
nobody wants this
let me show you what people want
okay google very simple very simple i'll
show you
what people want you see that you see
this
take one of those chips and put it on a
pcie card
stick a fan on it and sell it
that's something that's a personal photo
of a tpu three
that's a lie right you have the google
dev
core yeah because this of course is a
piece of shit
nobody wants this nobody
nobody wants it oh don't guess what does
two watts of ai
inference oh nobody wants it
the people want cherry computer i know
the people watch every computer that's
why you know we think about building it
and then we don't but
we think about it
so i'm starting to show company that's
so painful
no clouds don't want them
no i'm not selling it to you i'm too
lazy to honestly like
you'd have to pay me probably at least
for me to go through the effort of
shipping something we're talking in the
thousands of dollars range
what's oxide computer
what is it i'm trying to figure out what
it is
it's a rack
they they just made a rack
and you'll tell me about your principle
and and they they they host a podcast
they made a rack
with a bunch of uh like a blade they
made a big blade machine
this is stupid
looks like marketing wankery i agree
got a plan okay we're gonna make a rack
we're gonna put a thousand of these in
there
and then talk about how we made a rack
that has
four petaflops of computing power in one
rack okay
it's going to cost 30 000
to buy this and then we're going to put
in a nice box
we're going to put a really nice cherry
computer logo on the side we're going to
pay
at least five thousand dollars for that
logo
um and then actually fuck this we're not
even gonna build it
we're gonna just photoshop it we're
gonna spend
five dollars on fiverr and then we're
gonna make a
ten dollars we'll increase the budget
and we're going to make a website
40 pedo flops of compute
yeah and then we're going to do it under
the name
mike hunt uh mike hunt
and then we're going to uh you know
just oh sorry man oh yeah you know it
didn't work out man oh it didn't work
out man
oh yeah all right and then we're gonna
go to malaysia with the money that
[Laughter]
and we go like you know just anonymous
yeah i didn't get to try co-pilot i'm on
the wait list
are there any startups or products
you're excited about to be honest
and like i say this i maybe i'm a little
biased
i'm not actually excited about the
patriot edition because the patriot
edition is stupid and the red color like
i mean like it looks nice when you first
look at it but if you had to look at
that disgusting red every day i don't
think you'd like it but
like i mean you know this
so yeah uh what else am i excited about
you know what i'm really excited about
now you know what i'm honestly you you
know what i'm excited about
hell yeah yeah i'm probably gonna get a
computer with a decent amount of ram
i mean to be fair i could have bought
this computer with decent amount of ram
but it was like a special one
what am i doing for july 4th san diego
big fireworks show in america
see fireworks man
um why don't we need so much ram so i
can put the j on the make
yeah i bet the m2 you can put the j on
it
um let's yeah i'll pay 5k
shit i'll pay i mean okay if apple
charged 50 000
i wouldn't but i'd be happy to pay 5k
that's probably good
my channel doesn't compound i haven't
tried it you can make these things
really good i'm sure
yeah system 76 i mean 76 is cool
you know why system 76 is cool and oxide
computer is not cool
why why is this one cool and this one
not cool
what's the difference what's the
difference
who can who can spot the difference
exactly you can buy wow
wow photoshopped fake
shit bye
even though you can pay as low as you
know 600 a month we do a firm too
it's okay
nvidia as a company yeah kind of sucks
but
nvidia product very nice you guys want
to see a real nice card
gigabyte turbo rtx 3090
this card wait is that real
oh no i jacked the prize up
this card bros it fits in two slots
a 30 90 worth of performance is great
should i go to dinner tonight with alex
i think sorry that's what we're gonna do
tonight
that's a nice space here i know no these
are really nice no they haven't got it
no this is from sam's
samsung samsung 8. tspc7 is a scam
though
or wait yeah tsmc7
is is is is disappointing tsmc7 is
actually
intel's like like this is tsmc7 and this
is intel's 10.
but then you look at tsm series 5 and
you start realizing why the m1 is better
than everything else
tsmc's 5 has a transistor density of
173 million
transistors per millimeter square you
ever seen a millimeter
that's got a million transistors in it
look at samsung
see see a good one band one see look at
the bit size
so small man so small
yeah i don't know i can't have any api
with api i'm going to install you know
whatever i think it's called i'm not
so small man
i love small transistors
ah yeah you can connect it to your
google coral
usb did anybody actually try this on a
real coral
did it work for them
can we actually look at the firmware and
see what it is a little bit
i don't know i i should probably stop
streaming i think the stream is over
what instructions are those
no okay you know what i am
going to reserve uh okay
we're gonna we're gonna give we're gonna
give google a small compliment
i am happy that they are actually
selling a
usable version
of this thing right like i i
like i appreciate this is not actually
too much money
this is if we could actually like like
if we decided we wanted to use these
things
they actually are shippable in um
in like you know the next generation
comma product
which is kind of cool uh they're
reasonably priced
and they do have a good bit of power for
that reasonable price
um so we are going to say that even
though you know nobody wants
a usb stick and like the market for usb
sticks
is not is actually totally non-existent
uh the market for these chips
maybe is isn't and yeah i appreciate
google for selling this
um so you know we we can say a lot of
good things about them compared to
you know uh oxide computer for example
uh i appreciate i really appreciate that
they have a button
like it just gives you it gives you like
an option it gives you something you can
think about using
you know it's pretty cool look at edge
gpu right there
you know we can hook it up to pcie if we
want
it's actually pretty cool
i did docs updates
someone already put the requirements.txt
yeah
[Laughter]
does that work
i appreciate this
as long as it works let's see if it
actually works
oh wait i don't think that's the right
usb
i think i installed pi usb
we will fix the requirements.txt
see isn't it cool that you can learn
that you can actually put an arbitrary
number of spaces in front of things in
your requirements.txt
hate that i don't know why that doesn't
where are my sensible side buttons
they're not there
it's lies
oh yeah i feel better about you know
purchasing one of like purchasing a lot
of these things now that
it sucks also that it's only a day but
like you know you get why they do that
it's only a date and i think even worse
than only being in date i think it's
only you and date
doesn't even have minus
how do you like deal with multiplies
maybe it doesn't matter
maybe the high bits just go away
um by the way i just want to tell you
guys like you can rent tpus
and you know you can like look through
how they work and stuff it's kind of
cool
you can pipeline a module model with
multiple edge tpus
uh i do wish google i do wish the edge
the edge tpu compiler is not open source
i do appreciate them making a runtime
open source
these registers
there's not that many registers
what language is this in
are these risk five instructions
this is clearly an instruction set of
some kind
oh look they just used dfu utel that was
smart
i didn't have to write it
whoa
do you got it working on the web
web coral
new cpu runs wasm only okay what
language is this written in
what what what is this
just been walking gun walk mouse
don't do this don't do that no no no no
no don't run brew clean up no
okay fine i'm going to clean up don't
worry
i'm so conflicted about brew cleanup
it's probably cold
put in our diary oh god do you think i
can use radar i might use our dog with
goodra
where's my good draw oh i got
bin walk dash a firmware hey you know
what you guys you have the link to the
firmware
whoever can figure it out gets a brownie
point i'll hook you up with a brownie
point
it doesn't work who wants a brownie
point
cuda yo you know what's need what if
you're with need but for cuda
cuda fast
all right risk five
cpu rack
what would you find
oh i could play it out with some q up
yeah we could play out some q out
come on come on come on be risk five
who thinks it's not risk five it's not
risk five
custom
let's first look and see if this project
looks legitimate
oh okay
it's not an apk
because there's zip files bro
oh okay
well that's a real thing
how do i change the uh the thing in this
tools processor manual now
configure core
no configure do i change the processor
type
yes that one yeah yeah i'm sure i'm sure
some of my tool options
okay we'll just delete this and load it
again
do i know how to delete delete project
what tools
project tool options
this is terrible
that's a nato it's an 8-0 this is a
legit cpu
sorry i spelt it wrong
oh we're running out of ram
run out of ram we shouldn't have opened
seven million web browsers i can't wait
to allergy replacement python i haven't
had wires
all right new project file share project
edge tpu firmware
port file i never got as good with this
as i am with ida
i'm a little late to the goodre game but
i think this is what a lot of people are
using now
let's begin your microprocessor
so java i can see why government
employees like java
wait no i was really i was really i was
really counting on that i really think
that would work
oh it's clear code bytes oh you got to
press d
oh yeah yeah give him the d
ah
only in i do you give him the c here you
got to give him the d
l jumps oh sweet
look at this
oh cool
yeah look at this google google quality
firmware wait
actually isn't everything that you
download with uh dfu util
uh aren't they all 8-0
well i guess they're not but
yeah i mean deal on the panda
uh the cypress chips are what i'm
thinking of though
cool bros uh i'll leave you there if you
all want to explore
the google tpu firmware the google edge
tpu firmware
you can
pretty cool
that sends stuff over usb you'll
probably find i think this is what
controls that usb
it's not much code
cool
thank you for watching to the stream i
appreciate
you all being with me on this journey
um i really appreciate
everybody who uh
you know knew they were the problem this
morning
and i hope you guys take a bit and you
honestly reflect on that
and be the change you want to see in the
world or some shit like that right
like are you the problem do you know
people who are the problem
like it couldn't start with you it
actually can
um stop being the problem i mean it
uh i think i think that's the only way
to fix this and uh you know to people
who are the problem
i'm not saying you know ostracize them
from society but i think a little bit of
shame is
is appropriate man this is what i'm
doing to you now like i'm
giving you a little bit of shame
you know not terrible just like you know
nothing more than what you know i made a
g today but i made it in a sleazy way
nothing more than that nothing more than
that
but i have faith in most to you
selling you die hard psychopaths you're
not gonna do shit i'm not talking to you
talking to the people who have a choice
even if you think it's a hard choice
it's a hard choice for everybody but not
everybody makes the choice you made
don't sell out bros don't sell out thank
you all for watching
e
e
e
e e
so I've written in a little Library um
it's called tiny grad you guys can find
it here on GitHub
uh so this is kind of collaborative
development uh there's already an issue
fil if somebody could make the test run
in
CI um there's two tests you can just run
them with
uh test we have the mest
test which trains that mest model it's
the exact same thing that we were doing
yesterday if you guys were paying
attention but it's written in my brand
new deep learning framework called tiny
grad
and maybe we can
um uh this may
not be the best deep learning
framework framework
but but it is a deep learning framework
except it
does tensor
things uh so I was just cleaning up I
figured I'd just come on stream and we
could all play along I was just cleaning
up I was refactoring my example you see
we made this thing called tiny bobnet um
in a tiny bobnet we init the two layers
uh and then we have SGD so we have two
goals for this stream uh and I'll put
them in the read me right now um goal
one to
do uh
Implement
convolutions and
Implement
atom uh
Optimizer to make
real neural network
Library uh I can make the text a little
bigger for you
guys yeah we're back in Vim I know you
guys like when we're back in
Vim Implement convolutions Implement
atom Optimizer so you like grad you like
micro grad you'll love tiny grad uh so
someone suggested on yesterday's stream
to check out Kathy's
microgr and Kathy's microG grad is
cool um you can install it on pip the
problem with microG grad is microG grad
each uh they use values and each value
is only a single scalar value it's not
based on numpy so you can't do matrices
very well with it but in tiny grad we
can do
matrices and if you're familiar with P
torch you'll see my classes look pretty
similar to pytorch uh we have a context
we have a tensor and we have a function
and then you can Implement functions
here so you implement the forward pass
and the backward pass and then my
beautiful autograd engine here which is
honestly terribly written and may start
to break at some point uh runs the
backward passes so you just run through
the forward passes you can see over here
in tiny bobet here's the forward pass so
we take in the thing we dot it with the
first set of Weights we do the relu we
dot it with the second set8 and we do
the log soft Max I'm like this is
implemented down here here's your log
softmax that's the forward pass that's
the backward pass um oh yes we should
add one more thing to the to-do we
should also
to-do uh Implement grad
check
numeric um because we want to check
these gradients numerically so I did
write tiny grad off
stream um but it's so tiny that
everybody should go read it right
now uh it's very tiny and it's right
there on GitHub tiny
grad uh and actually you'll see that
this relu syntax is almost
identical to
pytorch I've also been reading the
pytorch code over here so this is the
pytorch
code but yeah so this is how you define
relu in P
torch and this is how you define realu
in tiny
grad uh very similar except you know
it's like copy instead of
Clone uh because we're modifying this in
place it's maximum instead of clamp I
don't think numpy has a
clamp um but yeah so if if if torch is
based on the torch tensor a tiny grad is
based on the numpy
array we could probably just wrap numpy
to be honest
and just add these properties to nump
pies that might be an improvement to
Tiny
grad uh so we don't have to make them
into tensors all the time but me who
cares we wrapped it with a tensor and
that'll allow us to change things out
underneath
um increase the font size
bro you suggest a tiny Gra on the if you
want details on the math behind autograd
oh let's see what we
got mathematics for machine
learning hard
we're still on python 38 is 39 actually
out not
sure but upgrading your python won't
make you a better programmer only years
and years and years of difficult
practice
well I feel like I canot do so many
transposes here if I just did less
transposes and was more reasonable with
it grad output. weight. t
um but it's nice because you can do
things like check that your grad shape
matches your tensor shape uh which is
really
good got to make sure we have a gradient
for the backward
pass
yeah we have this thing called context
and a context object is created every
time
H actually in torch it talked about how
a function object is
created if it's a static method I can
just do that that's kind of
cleaner is the context of function in
pytorch let's play along with this let
me get my reu over here in pytorch and
we can look at how they do it pytorch is
really beautifully
implemented uh I'm so
impressed by how nice everything
is so
that's not what I
want so we all know about relu and the
gradient on
relu we learned this yesterday hopefully
you guys studied yesterday's stream if
you didn't study yesterday's stream you
didn't do your homework and if you
didn't study yesterday's stream you know
we going to do a test for this one too
now I'm too lazy to put test together
I'm not in New York anymore we're here
to code we're here to go hard okay let's
go um my. apply so let's just make a
tensor let say it's
ones uh torch. tenser one's 10
T buil-in
function what oh that's just torch. On's
what am I doing okay cool
uh
my do
apply to T let say
TR uh it can't be all ones let's make a
tense there you know thr a minus one and
a one that be nice okay so that's what
happens when you apply a relue no minus
one and
one and now we want to do a backwards
pass let's just say tr. mean.
backwards and then here we'll say
requires grad equals true and we'll also
print t. grad
here oh that's a tragedy okay
cool all right so when we take the
gradient
backwards um somehow it turned into
0.5 oh that's cuz that's the mean right
so the gradient across a mean is just
going to be
um yeah just just you start with one and
then if you're taking a mean you always
start with one at the beginning of the
backward pass um I think that's just
because in the chain rule you can always
multiply anything by one so you can see
where I wrote that code in tiny grad um
that code's written in tiny grad right
here so if self grad is none we start
with we make sure it only starts with a
single um it has to be an item it has to
be a single thing this is true in P
torch too you'll see if I take out this
mean it gives an error grad can only be
implicitly created for scale outputs I
think I could actually make a gradient
on there and then that gradient could
backdrop but if you this is just here
um this is
implicit gradient
creation okay so let's see what a CTX
actually
is oh it's a function yeah okay good
good good good good then actually it
turns out that we only need two base
classes okay let's refactor this this
actually makes a lot more sense like
this because yeah
cool uh so instead of creating a
context we just create an arc
um yeah then we don't need this
anymore uh we want to
apply
H you see I I'm putting in function
apply aren't I oh no FX and.
apply okay that should be okay
partial method fxn do
apply see if this
works oh that one takes a long time to
start
um bring the other test
up that one has to load P torch though
Su has no attribute AR yeah because we
don't actually need R gear anymore we
can just print out the
context oh beautiful the tests pass oh
that was so oh that's such a nice
refactor the
function is the
context see this is what I mean pytorch
is so beautifully thought
out uh why am I printing all this junk
where did I stick prints in oh here
print cell
why is self a
tensor it's fine who
cares due
to how partial method
Works self and Arc are switched
oh that's
beautiful oh I'm so happy about that
okay
cool
refactor tiny grad to be more tiny
a so if you can see here when I printed
out CTX it's a it's a function type
torch autograd function my Rel you
backward um so actually we can do the
same thing
in in tiny grad and we'll see what
happens so we can actually go to the
real definition of Rue here and we can
print out CTX I expect it to also be a
type
function well okay it's a tiny
grad tiny grad tensor
relio
huh I'll take it I mean it's it's a
subass of
function so this is effectively that CTX
is then effectively self
there a static method so I have to call
it with
that yeah
cool let's reading see how P torch does
it good thing he does not read chat and
there are no
admins all right you want to little
slightly bigger on the text is everyone
happy now you're going to make me put an
enter in here it's
gross go to page 162 of this
book I lost the book link
remember my mom's
basement I'm not sure this is the kind
of automatic differentiation that I
have sorry I can't use computers today
slow slow slow slow slow
okay what page you
say
162 automatic differentiation turns out
the back propagation is a special case
of a general technique in numeric
analysis called automatic
differentiation
yeah that makes sense
it's pretty much what we
built okay so that's cool now that we've
got rid of the the context because it's
actually just we instantiate a function
uh actually I should actually say an
instantiation
intiation like that is that I spell that
right prob not I didn't spell it right I
spelled it right cool an
instantiation of the function is the
context oh man that sounds like a weird
Mantra Mantra Mantra
Mantra um
Mantra yo I got stung by a mantra Ray
yeah so look at look at don't we love
um so let me just show you guys how easy
tiny grad is to use well so first off
maybe we should Implement an Optimizer
should we Implement an
Optimizer yeah we probably should
all right let's go back to yesterday's
fun oh you guys going to hack into I'm
going to show you the token you guys
going to hack into my shit who's going
to hack into my
shit LOL you can't hack into my shit cuz
it's on Local
Host
um yo I'm just waiting for my quest to
arrive when's my quest get
here 264 viewers week
week oh 549 viewers last week all right
good uh wait where's my quest at that's
a real question let me see is my quest
here out for delivery now estimated if
they still arriving today by 900 p.m.
they promised me between you know if you
get upset about all the small things
you'll go through life outraged
you just want to work at a grocery store
Tahoe dreams thank you for subscribing
let's check out this paper what's the
paper what do we
got the simple Essence that's a lot of
words for
simple um no I'm happy with my auto diff
engine my auto diff engine is sick uh we
just need to implement some
well let's look at let's look at what
torch's API is for
it oh they have a model. parameters
that's a little much we don't need that
but we can just have okay um class
SGD self
tensors we're probably going to want to
make this more generic
Optimizer self. tensor equal
tensors uh we're also going to need a
learning rate as an initialization
parameter and then we can say optim
equals
SGD as an array we got to put in model
L1 and model
L2 um we also need to set our learning
rate yeah cool self. LR equals LR maybe
we should support momentum
first uh what is the word for
step uh for T in self. tensor t. data
equals t. data minus equals LR time t.
grad I think that's
right not a degrad just a
grad no it doesn't even we can just oh
we can have the step here so let's say
optimum. step
boom we don't even need zero graad
because this is an even better Library
than p torch that's right let's make
sure our Tes passes did somebody write
did somebody do a poqu yet for making
the
uh step takes zero positional arguments
but one was given oh that's a tragedy
and of course we need self. LR don't be
a noob that's right let's go let's
go oh yeah look at
that WR
SGD class
oh we're going to have to write atom in
a minute well maybe first we should add
momentum to our
SGD
um these are kind of just useful things
maybe we should add them to like an NN
class yeah and N end class is probably
nice okay we'll do a little refactoring
we going to put this in tiny grad and.
Pi we say layering
it uh not tiny Bob net the optimizer
definitely um and we'll add a fetch
mest fetch mnist a very important part
of any neural network class
oh you guys insisted on me having big
text and now I got to move it
over all right fine we'll call it utils
really really fetch amness does not
belong in
here um from Tiny grad NN import layer
anit SGD from Tiny grad
doils import fetch
mnist T
Train make sure the test still
passes and P is not defined lame
oh god really I did
that yeah high
quality
refactor into a few files
no Ann's a little aggressive I don't
like this never
mind uh layer it can go back
here keep two you know and then we're
going to not call this NN we're going to
call this optim just like torch import
SGD I can just say import tiny grad can
I can I I'm not sure I might have to put
a
a nitp
here um then we can just
say tinyg gr. op. SGD
right does that
work tiny grad has no object
optim like tell it how do that
in oh well that's just
cuz uh I want to do get MV tiny grad NN
get M tiny grad opum Pi not of my test
pass I hate that amness takes so long to
load tiny grad has no attribute optim
fine think I do have to I don't know
like this is like I just don't know
python
um from Tiny gr.
optim import SGD
that should work
right cool
uh if you guys want the GitHub repo to
play along with tiny grad at home please
make sure if you like tiny grad and you
think tiny grad is the future of all
neural network libraries uh make sure to
give it a star oh nice to see we got a
pull request love it love
it oh yeah okay cool
um oh I found out why my amness took
forever look at that
bug what a stupid bug can't believe that
was some Noob shit good job good job
good job person I'm proud of you wait
how does this work though if it doesn't
install
torch is this
done let's go
love it love seeing the hard work wow
that's why my amness test took so long
to start cuz I forgot a knot yo don't
forget your
knots oh man that starts so much faster
now oh that's so darn fish darn fish
darn fish is cool all right good good
good good we can close this issue it
should automatically close the issue
right no it doesn't never
mind uh um yeah you know if someone
wants to add a little badge to the read
me I'd appreciate
that um and if someone wants to
implement grad check we can just I'll
just read your code uh so this one here
if one of you guys wants to write
it
um I would I would encourage somebody on
the stream to write grad check and then
we can review it right here live on
stream uh and then we're going to go I'm
going to do convolutions and I'm going
to do Adam we'll do Adam first first we
momentum on SG then we'll do Adam
now let's just do Adam never mind
momentum MGD that's boring okay so Adam
is a mad confusing Optimizer that
doesn't make any damn
sense um but when we're done we should
be able to get this test so we'll do
some test driven development here uh we
should be able to change this over to
optim do
atom and that should just work torch
optim atom let's make sure matched my
capitalization okay
cool shouldn't need as much learning
rate for
atom and now let's try our best to
implement
it tiny grad
optim class atom
uh okay I mean I guess these optimizers
all just inherit from
something uh let's just see how torch
does it and we'll do similar
stuff so they inherit from a class
called
Optimizer class Optimizer all of that
can probably live
there and then that can probably live
there then actually there's probably
just a way that you
implement no that seems to iterate
through it
all uh
cool we're not actually going to well
yeah one of these days I'll actually
Learn Python and like know how to do
this stuff uh
super atom self.
anit tensors LR that's
right is LR part of the optimizer I
don't think it is it's just called pams
I don't know never mind I don't like
this
anymore
um
whatever whatever we don't have to match
P torch perfectly okay oh now now thanks
to darn fish it boots up so much faster
okay Adam has no step we got to add a
step to Adam all right so let's read the
really
confusing uh what is Adam maybe we
should find the paper Adam
paper Adam a method for stochastic
optimizations
well that's good because that's what
we're doing
here
perfect okay so Adam has a whole bunch
of stupid
parameters a is the step size which is
actually the learning rate
uh and we have a few more here called B1
B2 and
EPS self. B1 = B1 self. B2 yeah yeah you
know C++ has nice Syntax for
this
okay
whoa Adam has time steps that's
ridiculous
okay
um actually I don't think this is
tensors I think we should call this
params that's what P George calls it I
think it's more
sensible because they're the parameters
of the uh of the model OKAY
step get gradients with respect to
stochastic obje Ive so that's the
gradient okay so we're going to have to
update
the biased first moment estimate so
we're going to have to initialize here
uh for T and self.
prams
um first moment
Vector uh I guess lists just put them in
the same order
v0 Zer like
t.
data actually we can write this in a
Neer
way all right so we're not using we're
not using dictionaries we're just
relying on the fact that they should be
uh in the same
order this time step thing isn't
actually used is
it all right so we have a su in order to
take a
step uh let's say for it in enumerate
self pams we want to say self. mo equals
self.
B1
time self. Mo subi okay this is a
classic just
update self.
B1 times the gradient which is just T.G
grat
this literally just means squared right
yeah the element y Square okay that's
fine so for v0 well actually we should
just call them M and V because they're
not really
zero then we have this beta 2
parameter can you see that okay it's
just the previous gradient step yeah
yeah so that's good
compute the bias corrected first moment
we really we dislike bias here on this
channel we're you know inclusive of
whatever except I did still name my
GitHub repo Master that's right cuz I
personally want to be a Pokemon master I
don't know about you but I don't want to
be a Pokemon main so that's it you know
if you're a main Pokemon that means
you're the Pokemon who's being put in
the ring and Raichu shocks hurt but if
you're a master if you're a Pokemon
Master it means you're standing outside
the ring telling your Pikachu to
withstand the thundershock and you know
that's just where I want to be and I
don't know about everybody else but you
know that's just who I am that's me
that's right okay cool um oh now we
update the parameters oh the parameters
okay good t. dat is the parameters t.
data equals T do data or just I can just
say minus
equals uh self. LR
times the corrected estimate of the
moment divided by oh I forgot the got a
square the gradients
there
um I think that
works divided
by parentheses
Visa by you know
what no that's not
right uh plus self. apps because we
don't want that to go unstable cool is
that
adom did I just write Adam is my adom
good let's check my
adom you want to be Charizard that's
cool man
Charizard's a cool thing to
be I you know I think I'd rather be a
Charmander oh no no invalid warning
overflow oh no we messed
up
um wait why is there a t
there how'd that t sneak in what's that
t mean
bias
corrected it did not learn the loss went
Nan because my adom game is
weak
uh yeah you know what
the LR does not belong in the optimizer
lrs are not real things the only thing
real about an Optimizer is
pams okay yeah well that's why we
shouldn't used atom let's switch back to
SGD and see if it works oh yeah oh yeah
look SG that's good function now we
switch to atom and everything everything
goes unstable what a piece of crap I
don't know who wrote this all right
let's read it more carefully I probably
read the paper wrong where are my
books
um set b0 and
B1 oh to the power of
T oh holy shit T is real yo T is
real self. t
plus equals 1
here wow to the power of
T does not
work why is there an overflow
there is that really does Adam really
track
the
T I guess that's just Optimizer
parameter that gets
loaded oh we're going to have to write
loading and
saving okay that gets vanishingly small
which is
fine oh well okay
so this is a tiny
bug we're going to say m
hat V
hat uh M
hat the Hat oh and I forgot to take the
square root we we have so many bugs in
here let's just say np. Square
here
um oh yeah oh yeah I mean too bad the
test set accuracy is not
higher oh was almost good all right
let's try just upping the learning rate
a little
bit don't up the learning rate that was
a
mistake we upped the learning rate and
that was a
mistake but if we compare the two
learning that's that's pretty good you
know who thinks my atom is right
I can't believe Adam actually tracks the
time like
that how does this
work so this just looks like this is
just normal momentum
but this is tracking the square of the
gradients oh is that just like the is
this just like the variance or
something BT to the power
t gradients
it's probably
right let's cut down on the number of
steps let's compete on 100 steps oh 92
all right let's see what SGD
gets 88 yeah yeah that's a way that
Adam's better even though it's kind of
contrived
all right so we can remove that from the
todos I think my atom is
right let's say
80% sure this is
right I mean it
works add support for adom yeah buddy
adaptive moments I'm not ignoring you
imagine paying for an overpriced
unfinished
apartment uh T data needs square root of
V all right wait I added the square root
of V right I put the square root in
right square root of V hat M hat cool
got to remove the
bias is that all Adam is looks
simple shouldn't it be Alpha time M hat
yeah well I'm not I didn't use Alpha I
used LR that's the same
idea pixl thank you for
subscribing yeah yeah yeah so ZX9 you're
right I fixed that
bug M hat is not the same as
M good you guys spotted my bugs
excellent Vim is the best
I should look at the chat you spotted
the M bug before me all right all right
good for you guys good for you guys good
good good I'm glad to see people paying
attention I always appreciate people
paying
attention um
I just think this this is
wild that it's actually doing this this
let's see the pie torch one let's see if
it looks the
same wow okay it's actually multiplying
it by
that
uh oh that's cute they don't they do
late initialization on
it wow okay remind me to never use AMS
grad if you use AMS grad it uses that
much more
RAM you have to keep like an extra copy
of your of your gradients around for
that
uh State X average X average
squares okay so they they're calling
their
m m beta
add
grad Alpha what
yeah okay I guess that's just the same
XB Square they multiply by Beta
2 which is fine and then they
add add Cal H
crazy
uh what is AD Cal twitch has a lot story
torch has a lot of crazy
stuff performs the element wise
multiplication by tensor one by tensor
two in other words Square the gradient
and then multiply by that okay that's
good we're not an AMS grad so we have
the
denominator
um Decay them
steps
what step size
oh oh wow that's a much nicer way to
write
that like they can just you can just
divide the LR by that and then you don't
have to multiply every stupid parameter
uh yeah and they take the square root of
both the top and the
bottom eh yeah it's a little faster but
it's not as readable we go for for
readability over here in tiny grad uh if
you want speed consider P torch which is
very fast and
beautiful group and self param groups
when you Cal Mi I you must use Mi minus
one yeah well that's what I'm doing
right oh where' my atam paper go
yeah I'm using the previous one right
that is the previous one
oh can you guys only see my forehead am
I messing up the
camera that
better how many viewers we got we got
viewers see if we got
viewers viewers viewers viewers viewers
where's my viewers it's in twitch
where's twitch I don't know we have to
use search
live
okay wow if I take a 30-second break I
can run an ad and make money I think I
don't really
know I'm not good at using apps guys I
don't know who apps were made for but it
wasn't me 688 viewers that's pretty good
700 696 all right
sweet cool where's my Oculus Quest
that's a real
question where is it
Amazon did did Mark Zuckerberg give you
a call and be like yo goad's going to
jailbreak it you better uh better not
deliver his uh Quest anytime soon you
ever heard of something getting lost in
the mail yeah Jeff you can make it
happen it's safe inside the browser do
you feel safe inside the browser
we're drinking Yak chack yo it's yon
it's the craziest shit we just wrote
Adam the best Optimizer in the whole
machine learning game except for Adam W
if you're using weight Decay make sure
to put your weight decays in the right
place yo let's understand adamw now we
can probably understand it now because
we've
read we've Now read the atom paper and
we understand it we implemented Adam
look at that we implemented a beautiful
Adam so let's understand now Adam with
Decay um there was some like bug and
people were doing weight Decay wrong in
Adam and it wasn't decaying the right
thing God I got to plug it in and then I
feel that little tingle in my hand going
through the metal case in my MacBook
because somebody in this nuclear bunker
didn't ground things
well uh here we go
okay
so this is
adom and they added the weight Decay
here to the gradient
but we're supposed to add
it over
here after this in the M hat because we
decouple the weight Decay and the
gradient otherwise all these gradient
terms who thought that was a good idea
who thought you should put it there
who put it
there I don't know some people can't be
helped wait but can I just like multiply
that
out just weird to put it there too
because can I just
multiply what is n
set schedule
multiplier what is
this oh this is like for learning rate
schedules but still like I can factor
that out and I can put that out there
and we multiply the learning rate times
the weight Decay and what idiot put it
there that's clearly not the right place
to put it oh but ah okay I get what
they're saying it's it's it's it ends up
there because of L2 regularization
okay if you're putting if you're not CU
there's no way to put things here unless
you're inside the
optimizer that's
smart Ilia and wait Frank
hutter can't be related to Marcus hutter
can you
no cool
all right how we
doing yeah yeah we can Implement
learning right DEC if we want but we're
not going to we're just happy
understanding what it is and now we've
implemented atam so we truly understand
if you truly want to understand
something if you believe you understand
something implement it and then you'll
find out that you don't
understand it because you can't
implement it that's how I always learn
CU I think I understand everything until
I try to implement it and then I realize
that I don't understand all right let's
see how are you guys doing in polar
Quest land on Tiny grad how is Tiny grad
oh we got it we got it oh test badge and
read me oh
yeah perfect are my Test's passing I
only want to merge this if my tests are
passing it would kind of be embarrassing
if I merged it and my tests weren't
passing
merge we can close this issue over here
close
issue
perfect oh yeah look we got unit tests
does microgr have unit tests and do they
run in CI these are the questions that
we're asking
H microgr doesn't have unit tests that
run in CI it does have tests maybe
someone submitted a PL request for that
at higher order gradients
wow
[Laughter]
changes there is power method why still
needs this method just
curious power requires second argument
to be an INT and float
yeah exp is just raised to the
e um cool all right who who's writing
grad check do we have to write grad
check we can write grad
check can we do Q&A later we just just
Q&A is part of the thing if you want to
ask questions right now I got chat open
you know you guys see when I have chat
open now and you see when I'm paying
attention to you this is the
new
format who else can write tiny grad uh
all right things we have to do we have
to implement grad check and we have to
implement
convolutions because if we don't have
convolutions oh you're attempting grad
check okay cool that's good um you will
get banned for stupid questions that's
true you like this new format thanks
Linux with lots of
underscores all right stupid questions
that's chat goes away when you guys ask
smart questions I'll keep chat around um
what do we want to implement now we want
convolutions because look at this laon
mnist we want to beat we want to get
high
accuracy and once we get down here to
convolutional neural Nets we can use
lyette 4 let's take a look at lyette
4 oh wow this is a lot
of who still draws convolutions like
this I don't
know but let's go back to emus from
scratch
quickly and maybe we add some
convolutions to
bobnet we'll move this over to develop
over here
accuracy's kind of
weak we don't want to use NL
loss uh let's actually make this match
instead of using loss function here
we're going to say torch dot I have it
in the tests I have it in the test here
functional large lar soft Max yeah let's
do that
um
out and we can say multiply by minus
y
wait log softmax with dim equals minus1
no that's fine
but okay that's good
good uh what's y
shape oh yeah well that's the problem um
we want y shape to be
let just do this for a
why
e
e
e
e
e
e
e
e
e
e
e
e
e
e e
the enemy is everywhere
yeah Glenrock New Jersey knows what's up
so I don't exactly okay let's
see
uh so is this different
is that different from
doing uh the nll loss from here
yeah how are they
different why is this
different from that
how did I break
something now I broke something
grad can only be implicitly created for
scalar outputs and all loss.
me right what I
break is chat being shitty
Bann you know that's it that's sometimes
you just come down randomly hard on
somebody and decide that you know
them all right so we can just go there
go put that there like
that one I should be
right what did I
break broke something pretty seriously
obviously
he just got banned I don't know who's
next the Bannings will continue until
chat stops being shitty
huh oh I said the batch size too small
duh
you remember I was a guy who jailbreak
the iPhone oh yeah time
out we're here to talk about machine
learning okay so that works again now
what if I go back to this one
like these are supposed to be the same
thing should say minus YN LL and that
should really
be but they're different and I don't
really know
why find the source of NL loss and see
what it
is here we go
forward great just FNL
loss modle torch has no attribute f
and a l loss
missing okay so that is different
compared to
this why
hate when it does this it's like so many
layers of code deep
all loss forward oh nll loss forward CPU
template this is unreadable I hate when
they do this like what is
this n loss out
frame okay here we go input a c c
c minus current weight if current Target
equals ignore
index then output
zero current weight of weight data all
pointer otherwise weight data null
Target and just does this get
initialized to
zero wait otherwise it's always a
one okay output ACC equals input ACC
subur
Target understand what Target ACC
is oh that's just the target okay so for
each one of these the target the input
sub that
just doesn't seem
right why are those things not the
same we can print them
out well the real NL loss is clearly
much larger maybe we'll get rid of the
mean and see what we
get that
which is in accordance with the batch
size actually I guess you know what we
really want to do is just calculate them
both oh
okay so the shape is
different it's doing an implicit sum
there so I guess if I really want to do
that the same I can just make it minus
10 and get rid of
that those two things will be the same
after the mean I
believe yeah Okay
cool so in order
to yeah and that's why I had to set my
learning rate differently on my mest
example in tiny grad but if we fix tiny
grad and we change this to
minus1 uh correct loss for
NL cool that behaves almost the same
does it actually behave
identically we should do random seed
1935 so if I change that back to 001 and
I switch that to that does that
work that's the same I'm not sure it's
the same for all loss functions though
it may actually be different for Adam
because before when I changed the weight
of atom to be higher it broke
pretty much the
same that's interesting though that it
is the
same correct loss for
nll uh torch nlll loss
returns
one
per row
we should really do the sum across there
because that's I guess what it does does
it do the
sum oh no it just takes the subtraction
of the current Target okay so it's just
literally it's just literally
selecting uh Fix N LL loss in
example woo hype train level five well
that was fast oh now we're talking oh
now we're talking I almost feel bad that
I banned that guy maybe we should unban
him wait oh yeah pushed though
yeah
buddy no mercy oh yeah you guys like no
mercy I
guess oh yeah level four hype train all
right yeah get your subscriptions in
now oh wait how did it get there so
fast someone like give a ton of
bits did I miss someone who was nice
I just got 10K bits who gave 10K
bits wait I love the cakes a
spammer Lon thank you thank you
wow oh I didn't even see those are bits
oh that's crazy thank you thank you oh
nice I'm glad you guys are appreciating
this content we're back to programming
we got tiny grad going on we got any new
pull requests on Tiny
grad oh we got a poqu quest make unit
test run in all branches all
right wait yeah why did we only do we
have
branches I don't know
but that doesn't seem like a bad thing
to merge let's
go
done
okay um and actually let me improve the
read me a little
bit uh you can
even train neural networks with tiny
grad from test
m.y let's add a little bit
more flare
here let's just copy some of the good
stuff from here fact that it's so easy
to just Define a net
let's make layer in it a one liner
cool
[Music]
I really want like
a like a better oneliner for that
complete like pytorch
I think my layer inet it's actually less
readable update read me
look it's just like pie torch you know
what else I was looking at that upset me
I messed up the tabs in this one oh it's
so ugly that's unbelievably ugly there's
tabs someone let Tabs go
in I hate tabs
all right convolution time
you know it makes obvious sense that has
to be minus 10 uh because if that was
not minus 10
then if you added more classes the loss
would go down proportionally with your
number of class glasses which is not
what you want that is a broken
categorical cross
entropy
$100 wow that's
crazy looks very similar to tensor flow
that's an insult that's a deep that is a
deep insult
creating a
tensor we do make tensors um no really
we want layer in it should go in utils
and then that fixes my having to write
layer in
it
um we're going to say uniform in it
first we're going to copy from test
amness layer in
nit
um going to call it layer and knit
uniform
because otherwise I'm calling functions
in the read me that don't really exist
and that's just rude and we hate to be
rude
okay beautiful
call it outs it's kind of an name just
out as good
don't really have to test it every time
if I do break it then my CI test will
tell
me where's my Oculus Quest you
know more read me all right I'm
procrastinating convolutions CU I have
an idea that convolution Solutions are
really hard and then we're going to make
this Library
impossible oh that's so beautiful you
can like like like all of
pytorch it's 150 lines and what that
shows is the amount of thought that they
how much the API matters how much
they hello are youing yeah oh my God I
just bought the most insane thing was it
a car crash no I bought this massive
piece of art I'm bring home I you bought
Big
Art entirely useless wait I might need
you Alex did we talk about less stuff
okay but it's really epic
George what is it we have a problem what
can you me some cash
what is it it's a it's a massive light
lights
culure how much cash you need just
100 oh
actually oh yeah you have all that
cash yes it's huge how much isve how
much is this sculpture not where did you
and Lauren go look I'll be back and
you'll get to see the sculpture in
person where did you go to this vintage
store Lauren's outside I'm just to bring
this you invite her up oh because the M
are there they're picking it up they're
picking up the the thing light back in
minutes with the Giant
gole
oler the
weather you can't call a tensor class
with one Optimizer a library I can cuz
it has two optimizers that's
[Laughter]
right uh yeah Alex is a paid actor
um I pay her to to to to come on my
stream oh yeah we were going to write
convolutions
pie George is 100 lines now pie George
is a lot of lines there's some parts of
it that are confusing but their apis are
really beautiful and simple uh it's so
it's like so beautiful it's so well
thought out Geniuses man Geniuses made
pie torch
tiny
grad oh we got another poqu on Tiny grad
ooh someone wrote grad
check
oh holy shit that's a lot of
lines you just copy grb check from pie
torch you're a troll
[Laughter]
all right fine you know what sorry for
anyone who's writing grad check I don't
really want to write convolutions we're
going to write grad
check all right let's start with the
example see if we can
get now the example is a little too
simple we're having the
tests wow that's a a lot of crap these
tests are kind of crappy
okay that does look like it improved the
tests
why is this capital w why I make the W
Capital I'm going to make the W
lowercase capital W is too much no I
like capital W yeah capital W it's a
good
Capital oh no the test failed
once well by the way wait the other
thing that I was
thinking did we normalize the mests I
don't think we
did where are my
amnest I look at like X train
Subzero oh yeah wow I forgot that amnest
you know like I'm surprised that this
worked because we put ones we didn't put
like
255 I mean I guess it doesn't matter but
that's why like the numbers were so
weird so I did multiply this by 255 does
it all scale
perfectly I guess it
does yeah it's
scals uh so I wonder if that matters I
mean technically we should renormalize
it you
know oh you know what that might
explain why the initialization
crappy h
it got
crappier it's learning really slow
now so learns fast with
Adam hm
I do
that well that's just cuz I didn't
subtract it from
there that's worse
too I don't
know seems like a big LR for SGD
actually the problem is the LR is too
tiny so if we actually wanted to
check um how do we write grad
check that's the model and torch
you actually want to write grad check
Let's
uh put that in that doesn't have to go
in there can actually go up
here for
um yeah and I wanted to check so if I do
like something like well actually I can
take an
amnest and I can say model dot what in
the read me read me
um xal tensor modelx test
copy the sampler
okay
so we're trying to compute D
loss uh so then if we want the loss here
we say model subx out equals model subx
and we copy the loss line
here uh
oops Yeah I had the right line there I
just didn't put the right line there
good
cool a loss so I guess this one must be
a
five that's a five
cool um you know it's a five because the
loss is basically just this minus
flipped
around cool just but
minus uh so now what we're trying to
compute is d
loss
DX actually not even D loss
DX we're trying to minimize
loss so we can get like d loss
dl1 which is the
gradient uh so if I say loss. backwards
we get the gradient here like in the
model of I can say model. l1g
grad and that's
that yeah okay so let's look at lost
deal2 yeah okay that's just more
accessible
now how would I do that if I wanted to
compute that numerically how would I
compute that numerically
I don't care there's another tiny grad
that stole my name that went to the past
and stole my name
cute h
two three four
five um
I don't even
know like how you do this kind of stuff
numerically I like you can change the
values a tiny amount and then run the
forward pass and get something
different oh I mean I guess
all right so I guess what I can do if I
want to do
this is I can say something
like uh x. model L1
relu do model
L2 data
well maybe not even go that
far why is that not using
string what should I do it's repper
did I mean to write repper where I
wrote
string that's what I want cool
okay so we want to figure out how to
compute the model L2
grad which I think says for each
parameter how would we adjust it to
change the loss function
if we wanted to change the loss function
one given that that's our
L2 here so given that that's our L1 so
we'll call this
NX
um and then we do like NX
dot model L2
uh if we want to actually get the loss
function we continue it
through uh log soft
Max like that okay good um so now let's
make a copy of model
L2 let's say F L2 equals model l2. dat
tensor
copy it's going to be the same
so according to this gradient if I take
fl2 comma 0 0 and I plus equals it this
I'm going to see a one change in the
loss well it's not exactly one
oh wait not a one change in the loss but
a learning rate change in the loss yeah
that's
right that's zero but now if I add that
there uh okay that's not the learning
right
not the learning
right that made the loss go up but this
will make the loss go
down okay so what determines the
magnitude of that gradient
hm
No it should be one it should this
shouldn't have anything to do with the
learning rate we haven't even done the
learning rate
yet okay that's zero that makes sense if
I add yeah it's
big okay so they're asking the question
then the gradient is the question about
that Matrix wow so a learning rate of
one would make the loss go to zero on
the batch oh that's really
cool I don't know how to get any of that
stuff numerically
the magnitude of the gradient is the
slope yeah so I mean this is this is a
yeah yeah the loss times
one H how to implement
gradients finite different
approximation for
you know it's crazy that it's somehow
with respect to the
matrix it's amazing that that
works it's not each value individually
it's literally the whole
Matrix the gradients
flow for
me I don't know this is something to
think about but I think we made some
good progress
today on Tiny
grad yeah yeah the magnitude is related
to how fast the loss changes it's just
crazy that they're like
all they're all uh they all move
together
yeah pretty happy with our
library I will do this and I will do
this I'll probably do this one off
stream because it involves a lot of
thinking and sitting uh convolutions
might be
fun what
now there's some
Lua let just use his
torch Jacobian approximation yeah that
sounds right
how are you supposed to learn if I do it
offline you can follow the GitHub
all
right any other
questions questions time
only losers get master's degrees most
people I know in Master's programs are
just there because Google will pay them
an extra $20,000 for having a master's
degree and it's so incredibly sad um and
it ruins the I mean we were talking
yesterday like is America still capable
of producing great leaders I mean I'll
tell you this the great leaders aren't
going to come from
Harvard um how good should someone be in
math well you know look at how bad I am
at math and I wrote a neural network
live Library it's called tiny
grad uh where do I see myself in 5 years
dead or
homeless um why isn't this called Pi
George I don't put my name in
things uh would I consider rating
awkward chats today no no we're not
we're not doing raids
today uh you have no choice in France
I've heard there's not freedom in
France uh could you start all the way
over um
nope the best leaders are those that
don't want to be in leadership roles
yeah yeah that's probably true but today
they're like well everyone's a leader
you
know
um how do you create good
leaders uh what is it what is the old
saying it's like uh good time times
create weak men weak men create bad
times bad times create strong men strong
men create good times and the cycle
starts over again yeah unfortunately
that's what I think it
is when am I coming to reram when they
let me
in uh a master is 100%
needed what I'll hire you I don't
care apparently a morning routine in a
journal what you read that Huffington
blog post
post you read that on on what are what's
those
websites you know Business Insider yeah
that one
yeah uh I did join your stream I stayed
around L for a little
bit weak men create bad times you are
here yeah that's the truth
right um that is the
truth what's the Harry ball theorem
should I Google that I feel like I
shouldn't Google that if you were a uh
subscriber at Google it can you explain
how multi-head attention works I wrote
it I wrote a multi-head attention didn't
I uh am my Transformer Edition yeah here
you
go sadly I wrote it with tensorflow but
yeah
uh yeah tensorflow sucks don't use
tensorflow I'm so I I I've wasted I've
wasted so much of my life on tensor
flow oh my private
[Laughter]
Wikipedia what I downloaded
Wikipedia no from the transistor
probably
not uh
what's bad about tensorflow it takes
five minutes to start up the code's
impossible to read to fix anything and
uh it uses all the ram of your GPU
tensorflow was just a library written to
consume resources so the Google data
center team would have something to
do
um Ubi is a bad idea oh this was in this
was in the uh gra mirror of the nihilist
prince it's like an economy where five
people stick a pipe in the ground and
everybody else lives off of government
checks does not make a good economy you
know look up the curse of natural
resources does it really matter if the r
resources are natural or 50 guys writing
software uh so
yeah um I did read some of hero with a
thousand faces I couldn't get that into
it uh downloading Ram is a great idea
uh or you can just compress your
RAM just compress your RAM why not
compress
it uh well no it turns out like the
countries without natural resources do
better in the countries with natural
resources it's a curse this this is a
classic like political science
thing uh
what are
a6000 I mean yeah no one of the
downsides to having resources is yeah
other people are going to want to come
steal your resources that's definitely
true uh I'm not sure though I'm not sure
I I'd like to see it I'd like to see
that controlled
for
um they're
a6000 I mean A1
100s uh what games will I play on the
quest none if I can't get past the
Facebook
login uh oh a6000 are
a oh I've never even seen this one oh
it's an
RTX
oh oh they make a blower and then they
don't open in the back of the GPU that's
terrible uh San Francisco's over
everyone's
left we'll see I'm not sure where the
next one's going to
be
um it's I mean yeah it's it's you know
it's very sad what's
happened uh
now blowers are beautiful but the
problem is they don't
have uh the the the stuff there SF was
always shit I
mean I don't know I feel like it was a
lot better 10 years
ago uh I feel like
there's for example I I moved to
Mountain View in uh
2008 I paid 700 bucks for a room um
almost everybody I met at Google was
talented
and uh you know they're really because
they love
technology uh today you move to Mountain
View it's probably $2,000 to rent that
same room and you go to Google and
there's a whole lot of people who are
like oh I'm only going to like be here
for a year they're paying me
$400,000
uh what do you need the RAM for just to
accumulate
gradient I don't want Ram I want Ram B
man
with princess of the Yen
no who cares about the iPhone
12h all right
will I post pick of statue I do not know
statue thank you all for
watching have a nice day
made some we made some big breakthroughs
made some breakthroughs
put some socks on oh this chair's too
low
yeah we gotta go up a little in the
chair gotta put the socks on
and then i'll show you what our
breakthroughs are
okay so
i got d trust running um
i detrust the things with the mnist
and like you do it and it's kind of
disappointing
um so okay d truss
dot npe i can pseudo it now
type my secret password you get this
right
so this is totally useless you're stuck
on these u-lock weight you lock weight
kind of thing so i'm like okay well
what if i just put a break point
on there run it
run it back trace
doesn't look important doesn't look
important
ah but now we get to the bottom of it
and you're like oh
core video can run metal so
all this thing is using is just the gpu
um so you get to a few interesting
things
you find out about this hidden library
called espresso
and espresso is in there and you can see
what it does
um it's just like apples it sits
underneath metal and like supports the
layers you're like this is boring
ah so you know you're gripping through
it
here's the private framework it's called
espresso
so resources the file is in
uh default metalib
let's quickly we get any good comments
we get any good comments for response
is this video already up oh the new
video is not up yet
oh you see we've got really good
comments on here
nice comments dumb all right but no all
right so so look
look we got exciting shit guys all right
so we look in here we're looking in the
espresso framework and i'm like all
right we'll do strings we'll grab
a and e no a and e it doesn't even
mention a any look
plain that's not the a n e all right but
then we just are like well what if we
just look in here for a
e and we're like wow that's actually
useless but
there's so many anes here's the a e
compiler
the a e services so a e stands for apple
neural engine
but then we found the mother lode
remember the mlc device that we said was
useless
you know apple has this thing mlc
compute mlc tensor like we were reading
the documentation for this we're like oh
mlc tensor oh
i can put it on a different device oh
let's see what device i'm gonna put it
on right
so if you get to like ml i think it's
called like mlc device or something
here we go mlc device right so i can
bring up swift
here we going too fast boys we going too
fast it's very exciting so
with the mlc device we can create it
and look at this isa here it's an mlc
device cpu
which means it's running on the cpu
we can also make the mlc device run on
the gpu if we do gpu
there's also one more thing you can pass
in in this enum called
mlc device type you can pass in any but
if you pass an any it just gives you
the cpu but look what we stumbled on
in the objective-c runtime browser
here's mlc device here's mlc device cpu
here's mlc device gpu and
here is mlc device a-n-e
so it's not supported yet but we found
the secret to accessing the a e hidden
right inside
the ml compute framework now
i don't understand exactly why it's here
and why it's not here
so if i create an mlc device like that's
not even exposed
it's got to be in there though and this
is just a lot that i don't know about
swift and linking
but boys we got leaks
we got deep leaks right here if the any
inside the m1 hardware and how deep does
the rabbit hole go
i think we're going to go even deeper
than this we're going to figure out
how mlc device and e talks to the a
e because here here's some like repo by
some dude like the neural engine what do
we know about
it and like you read all of his table of
contents and they're all like sad
like is it 16-bit it appears so i don't
even know
what core ml layers are supported i
don't even know
espresso also has this ane runtime
engine thing but that doesn't actually
seem to be here
it seems like apple's moving toward this
so we are live
and we got mlc device
a e now look at all this potential crap
so
how are we going to go about attacking
this well i think we should create a
branch in tiny grad
get check out b a and e the a e branch
um and now let's see if we can
actually create anything that works on
any so
why in swift
there's an engine there's a compute
engine that's all pretty useless
then i was also looking at the headers
in here
there are headers i think they're here
no i'm not there
not there
so it's a public framework
we're going to have to learn some swift
oh my god is this all just an excuse to
learn swift
import ml compute and then i can create
an mlc device
let's figure out where the headers are
for the ml compute framework i feel like
i already did this maybe it's here
no this is more junk junk
ml compute
oh i can't believe we found the secret a
e stuff
um yeah we found we found
we found the secrets
all right so here it is in the sdk here
it is these are the headers
okay um
we work in mlc device
does anybody know how to read this i
know i don't
we're just swift headers
i kind of feel like these headers aren't
even b aren't even what's used by swift
oh the hype train is long gone what
okay so where is the stuff defined
i don't know what a tbd is here
i'll walk wait can i do it
hmm
so what's this tbd
what's a tvd file
it's in the dvd file
that works
that doesn't work
works how come this one doesn't work
where is it marked as like private or
something
anyone know how this stuff work
the headers are for objective c where
the swift headers
i want two to dab and all so i don't get
any errors
no that's not what i wanted i want to go
to that notes like that
that should just work
okay that's the objective c header
iphone sdk boring boring boring
swift uses objective c bridging header
so i can use it in swift
what i don't really get is like if i
uh
if i change this does this change the uh
it's not even mentioned there but it's
all here
any build arithmetic unit
we know it's possible
like it's getting a lot more stuff so it
has to like be in there
okay how can i import this header
like what if i
if you specify objective-c framework in
the bridging header
then you will be able to access it in
swift there are no headers for swift
how
along with the file you were creating
tbd text based eyelids
dubs
interesting okay so how does swift not
use headers
well i mean okay let's take a look at
the dialect
also what the hell are these metal lives
oh metal lip
bridge support
someone crying
what's going on
all right so is it this thing that's
doing the swift
apple's not bro friendly if they were
pro friendly they'd use python
but see
what's interesting
this is all just a game to get people to
learn swift i think
like i can say like mlcdevice.engine
wait what why can i not
see engine right there
i don't know swift no
could you run through this if it's not
learning swift you're going to get
banned
i don't want to import objective c i
don't have to
like
it's just something about how things are
imported how does swift
if swift doesn't use headers what does
it use
method class method true
bridge support
there's got to just be the secret good
command that returns the uh the a
e device they wouldn't have all this
code here if there wasn't a good way to
get the a and e
how do i see all the methods available
on here
swift grapple c
method you know i give up on you know
there's no way google's gonna be
swift doesn't have methods like help
type look up
mlc device
useless
tab tab oh good point
oh here we go cool tab bro
i should have figured that one out
okay add observer i see a function
called
cpu
i see a function called gpu
i see in a net
all right let's try secret three
what do we think what do we think is it
secret device three
all your optional type must be unpacked
okay device one is that that's the
gpu that just gives you the cpu oh
that would have been too easy if that
was the a and e
okay i see it here
let's read about this
oh this is objective c runtimes so maybe
it is only in objective say
swift is so annoying for ios modders you
can't hook into methods and override
their
oh
um how many people we got
someone has got enough swift
okay um
well so we have this other problem which
is like
where's the actual code
like where's the dialect
apple puts them in like dialect cache
right
someone should know this right like it's
sad that i don't know this stuff
copies of dynamic libraries are
so how do i get these
oh my god all the libraries are just in
a uh
what's aot
what's this
um okay let's extract the dialing cache
should have bought the uh
wait
oh zip file
oh apple has a program called
how do i see what dial d versions on my
system
god
if they were nice enough to put in a
directory for me
[Music]
um
cold signing types hey
common crypt okay
um
okay just some common crypto compliance
hmm
only warnings
where's my dlc extractor
oh okay there's errors up there
the problem is literally in standard lib
it's like a way to like tell it to use
that sdk oh my god
it's like a proper way all right are you
guys pacing it in chat
useless
common digest spi i've found
i don't know yet
oh so shitty
let's try this one
okay dsc extractor path to cache file
i don't know what device dir is but
we'll just say it's
a pimp
sweet oh we got die libs boys
oh look at them die libs oh yeah
oh yeah who's the bro shout out to mad
or mad or die shut up about crypto
oh i should have bought that shit coin
oh funny i bought that shit coin i would
have more stupid money
oh lib swift ml computer
okay it definitely has a e stuff in it
all right um geardrop
go cask
yeah that's gonna work
guys crypto ban
let's look in our extracted eyelids i
think we have more here let's look at
espresso
oh look at all this a e stuff
espresso might be lower level than the a
e
an espresso also might not be so the
reason there might not by might be no
espresso here
is because espresso is a uh
[Music]
i don't see it here
see what it links to i should be able to
do that right
o tool
um o tool
show it's like dash l or something
here we go perfect
okay well let's look at what mlcompute
links to
i don't actually even really care about
getting ml compute to work
because if we can get i want to see what
i want to go to the lowest level
possible here
okay accelerate framework
what is this
it doesn't seem to have to do with the
mpa
what's lib mobile gestalt
oh is this just not anything
that's fake
oh libla pack
lib v dsp
veklib v image framework
all right metal
is there more stuff in ml compute
no what's mobile gestalt
metal
this metal is what does the a and e this
doesn't even look right
maybe that stuff doesn't actually work
it was like an espresso more
okay it also links to these metal oh
private framework apple neural engine
framework all right this one looks
better let's just use that
espresso links to that
what does that link to ah links to io
kit any services
okay i think this is the thing we want
i don't think it has any uh the reason
it didn't show up here
is because it's not
uh objective c which fuck objective c
we're gonna link to it for c
anyway
all right here we go oh any device
open yeah
all right
star tiny grad please
oh hacking bro we're doing real hacking
now
all right it also links to any services
which is another very interesting
framework
hmm kh-11 a-n-e
oh load firmware firmware is too big
ah
oh it's a text so that's loaded into my
kernel
load firmware whoa is that the firmware
is it actually there is that a file
no that'd be too easy wouldn't it
whoa the a e has its own custom firmware
oh this looks like the exciting thing
failed to start work processor
all right how's my gidger install going
where did i put that
look at that this crap it's all so high
level and stupid
we're not using swift we're using c plus
plus
i can't exit that one you guys would be
sad if i exit that
so where did my gidger go
oh here we go give your run
i need to install java
stopped open jdk what are the odds
that's gonna work
x64 no i don't want that
[Music]
uh
this might just work better now again os
64 osx 64.
lame
what are the odds this is gonna work
mercurial yeah it's never gonna work
this might work though type java in
terminal oh
please visit java.com okay why didn't
apple build a java
you talking about crypto you're lucky
you're a subscriber
um
that support one that i was looking at
any services any compiler
apple thought they could hide the
dialects and then i couldn't find them
well i found them
wow
i should be able to see everything they
explore right
um so no tool option for that all right
exports
a lot of luxe thank you thank you
welcome welcome welcome welcome
so what we're doing here is we're using
the reverse
engineering software from the nsa
uh and we're trying to figure out how to
access
apple's neural engine so we can add
support for it to tiny grad
tiny grad is going to be the first
library thank you lotta luxe i noticed
um tiny grass is going to be the first
library
to support
new project non-shared project
it might be the first well so tensorflow
doesn't actually support it because it's
using those ml tensors
and uh
they're a lie
which one should we look at first any
services
there's professional spies at the nsa
looking at that dragon in gydra
oh there was a jdk for rm64 okay if this
is terribly slow we'll uh
we'll get it wow actually
it's like double jitting right now
oh jdk apple frame one
oh azul built them cool as well as a bro
never mind never heard of this
mac os later
that looks good
and we'll see if it's slow deal with
that later
okay good we got the exports here we go
well any service is probably even lower
level so let's uh close any services
and let's import apple neural engine
let's look at the exports here
oh there is objective c crap here
actually a lot of objectives see crap
so all objectives say
yeah getcha is an sa tool
huh
okay well we hate objective c so this is
lame
any services now we're talking yo this
thing probably has its own
okay h11 a
e device
shorten d message
wow that's pretty bad and apple didn't
clean that up
it's like spy junk left here
okay so it looks like here this is this
is the low level thing
this is also if we actually ever get
anything to run on it
um all right does this let me export
headers
par c source no that's not what i want
to do
export tool
no i want to export a header
cc plus
create header file yes
user taylor
um just called any services fun
npe any services
all right
i didn't want that.c file i wanted a
header
this is useless why didn't it create
like a c file
junk
okay so that's the constructor the
destructor
i wish we had a real header file for
this
oh good just got to be the old one
they probably still use it for some
things but
okay so let's let's look at like the any
load firmware function
i love firmware
write register load firmware okay
wait according to this it actually
should be in that directory
user local share firmware
wow
they wouldn't include this library if it
wasn't like meant for this computer
right
i'm not like reverse engineering some
crappy iphone thing am i
i mean it would be really nice actually
if we could
find something that actually uses this
thing
uh
so this calls load firmware pc var
7.
i mean okay this might be a troll like
this might actually not be
this might not live in the local file
system this might live in like some
secret kernel file system so it's hard
to get to or something
all right let's just link to it and see
what we got
okay so we want to link
to that
um put that in that tiny grad branch
[Music]
may not see
you need to call the constructor was the
constructor
here
i don't know what this call is
okay unknown type
um so we want to say namespace
it's in that namespace and then we're
making a class
uh hne device
and then we have a constructor public
constructor
that looks like h-a-n-e device
these two things
i don't know what the hell you wind is
good enough
cool
no matching constructor oh
that's because we have to pass in a
device controller let's just do that
okay now we have to link to it so we're
just going to say l
any services
library not found for any services
fun mpe
labs
okay
i'm good
how do i link to a framework in clang
framework
um macro has a link to private
framework
um link to a private framework how
ah
wait test a and e what
whoa
nice
see what they're doing
cool
so this is still one level higher but
this is interesting
oh
yo start done
oh we just have to do dash after
frameworks i say
um
let's try to build it for ios
let's just steal some code
uh
before i compile objective c
okay all right great
let's just log them
you need a lot of complicated crap
that work i don't actually know
objective c that's not obvious to you
guys
yes format string is not a string
literal
oh i can just do that
segmentation fault
so does that kind of stuff work
what do i want to do i don't want to ns
log there
you
okay it has an all right a right all
right
so it has an a and e
segmentation fault
uh oh it's like that
yeah i know a little
okay we have a branch now
okay um
let me uh i should actually um
let me recite the reference
okay um so that's interesting i like
this because we can now
we have this in kidro let's take a look
at what else we can do
good job broski freedom tan
we i love freedom too
um what else we got you guys sent me
another link too that i was excited
about but i got distracted and went down
that rabbit hole
okay so this is good news we have an a
a
um i'm still in any services here
closing any services it's a good apple
neural engine
so i think this is just like one level
higher
um any bundle load
build version has ana okay so those
should be exports
i don't know how to parse them whatever
i'm happy with that
oh let's also include the instructions
to build
side and build instructions
all right cool what are you guys saying
also check out this one holland's neural
engine did they get any further with it
oh yeah no i've seen this yeah i was
kind of upset with that like it doesn't
really say anything
and then like you see like it so i run
ml consulting services
so then you get to the reason things
were done
not all things are done for love
not to hate too much that might have
been done for love but
um freedom brother now that was done for
love you can just tell
okay so we have an ane
oh loading it out out wouldn't be
interesting
no this mac is so fun guys see i can't
bring myself to touch the oculus because
it's such a piece of shit
like the the experience is so
disappointing palmer lucky is rolling
over
in his uh you know billion dollar house
um it just it could have been so much
more it was
facebook made it it's just it's lame
it's like
yeah i don't want anything to do with
this laptop i mean the speakers are
shitty but
you know it's not lame
this is a cool puzzle you know
all right so where were we with trying
the lower level shit
test.cc
clang plus plus test.cc okay so we were
going to
link to framework um any services
but we have to pass in the framework
folder of private frameworks
i think that's going to work
okay well that's a different problem the
framework seems to work
but i can't
find the
thing that could be for a whole lot of
reasons
it did say you went
uh
so
oh
you wind
like so when you actually look at uh
yeah all right how are we gonna how are
we gonna debug this
oh is there something simple in here
that we can actually check if the
linking is working
here we go this looks boring
okay so it links
i mean cool i don't know what a n
oh this is actually like a c api ford
probably not
either way we're linking to it okay
where is that oh here we go see dump
analytics here
is called anywhere
nicest external
crazy um
so that that that doesn't link is not a
undefined symbols for architecture arm
64.
it's in a class that's clearly a
constructor
what am i doing wrong uh oh
we can also say what have i say uh
enable c plus plus 11.
c plus plus 17 let's go all out
okay um pro tool
pro tool show exports
oh nm or tv
there we go
okay so this is all the exports so it's
going to be something like this
i don't know how clever uh
i know clever gidgets being
wow
okay well that's interesting
so this actually belongs in the
framework
see if this works
see look at this constructor it has lots
of stuff
here's the constructor funk
def 2 param1
void param 2.
let's funk death too
what
doesn't tell me
pointer void
oh it's like a call back that's just not
specified
there's the destructor there's the
constructor
take some funk def 2 how am i supposed
to see the
edit function signature
funk def two what is that
it's a function clearly
and it looks you know what there's a
parser for this
uh what's it called c plus
plus d mangle
there we go
oh there's an underscore there that
might be the problem
hmm but yet
all right let's forward declare that
oh yeah yeah come on gotta know your c
plus plus
call back goes there
[Music]
oh what okay semicolon there
and yeah um
i mean i don't like that but okay cool
it lands
great and that actually constru that
actually runs
incorrect checksum for freed object
okay well there's a malik bug
there you go
um i don't think it likes having null
passed in for both of those i think we
actually have to make a call back
but that's good to know that this works
um all right let's just de-mangle the
other constructor and see what we get
here we go there's actually two
constructors
so the problem might have actually just
been
that we have to put a h11
in there
well
okay cool
okay so that's seg faulting but we're
making some progress on the c
api are we adding a four to clang
you like that one
for loop
we're reverse engineering the low-level
library
that apple uses to talk to the um
apple neural engine
so let's create that callback we'll just
call it in to call back
a b c
printf callback
yeah that's still not right
there we go here's something that uses
it
oh any services thread start
wait it's actually a class
it's not a namespace
how could it play how does it have this
call
that's crazy that's a class
those are just sub classes like that
undefined eight
inside long
who said i'm bad at a software engineer
you're luckier subscriber
yeah okay
so that actually turns out to be a class
and those are just subclasses
like whatever that is
there's a constructor for that
it doesn't have one static method
that's not static because it takes the
type
expect a namespace name i'm sorry about
that
oh yeah that's a unsigned wall
i think we can just forward declare that
okay it doesn't work it doesn't match
let's nm
grab that
d-mangle
ah
nope
did
why not oh unless maybe that's not
public it has to be public because i see
it exported
you
you guys want a class
it has a name but
let's look at it
huh
oh okay well that's even better i mean
i don't know why that doesn't work but
this one might be static i don't know
that's static
return value
and sign long we know it's that device
controller oh it's the same stupid
callback
that and then just probably the same
argument
zero
as well
it's a private member
cool uh let's see if red gets set to
anything so we'll set this to null
great we're creating the device
controller
we have one now we didn't even have to
call the constructor
nice
i assume that this isn't called anywhere
that this is actually what's external no
no of course it's called somewhere
oh initialize platform services oh even
better
is this called somewhere you know if i
could just press x
no that one's just external
not exported
okay it looks like it does have the
underscore
but yet the simplest one yet
it can't link to it
there has to be a way to export these
classes
data type manager
so
hmm
uh
wow this analytic stuff is a lot
mempool more analytic stuff
some stl type i'll never reverse
engineer
oh like basic string
there's the callback i don't know
maybe creating a controller is not bad
um okay so let's go back to the idea
that it's a namespace
which makes a lot more sense
that's not a static anymore
that doesn't exist we don't need these
anymore
okay cool even getting a call to the
callback
okay we're getting the a e device too
all right create the controller
now we should be able to call methods on
the controller
i don't understand why initialize
platform services
is this exported or not like i don't
really
exports initialize platform services i
don't know
maybe it has two underscores
oh
all right you guys are talking about
dumb crap not anything useful
um
okay
so gidra knows the classes here
how do i export the class types
set up device controller setup device
controller void
structure
oh should be under underscore c oh you
are bro
that's a good point
yeah now we can get rid of that too oh
yeah bro one underline under extern c
oh you are not intruding
you are bro five gifted
subs oh people are being nice oh good
chat oh yes
cool all right we can initialize the
platform
services
with extern c
[Music]
all right very happy very happy all
right
see we're learning i love when we're
learning um
wait it's returning hex 12 hello is
returning an error code
i think
okay where's these debugs going your
message
here we go
unrecoverable ct signature issue
process a dot out denied access
who would deny me access
i regret denying the access
creating default full entitlement client
process a dot out denied access
run with pseudo always access okay we'll
try pseudo
i'm fucking root why don't you give me
access
denied access i'm actually gonna print
the pid to make sure it matches
deadpad
uh i guess what
mac oscarped i need to include
oh i need uni std of course a uni sd
okay do we have to sign it
i think we have to sign it
i disabled to sip i don't even fucking
sip
look no more sip
oh it's trying to load the info.plist
and having a bad
time shim open
assist control
and mapping something i don't know
but all right
i think we have to have an entitlement
for neural network access
let's just take a look i have all the c
code here don't i
no
new user client
where is that
which library is that in
oh it's not in a library i know where
that boy
that's in the colonel
oh don't make me reverse engineer the
colonel that's where we're going
next denied access eh
oh well a speaker start i o engine maybe
this is because they were debugging
speaker i think it is maybe they'll make
the speaker not shitty
turn off signing required in etsy nmb
for the preston is this right
is that a real thing
i don't think that's i don't think
that's it
i just have to code sign with an
entitlement
code sign
code sign a dot out i need to create a
code sign apple code sign
command line i we're going to make a
bill dot
build.sh
okay um apple code sign
command line yeah you guys should get an
m1
these things are great this this is the
most fun i've had hacking something in a
while
um all right we have to create a code
zone
we have to create a signature keychain
access
new keychain no system keychain
apple code sign create cert
keychain access app on your map choose
keychain access
certificate assistant create a
certificate
enter a name for the certificate taylor
swift
choose an identity type
oh
um ticket assistant create a certificate
type self sign root code signing we went
somewhere else
certificates
who knows let's try it code sign
dash ass taylor swift a
okay but the problem now is i don't have
any entitlements
we have to do an entitlement
code sign with entitlements
ah yes
your computer isn't yours oh the signing
people are coming for you
dude the people who've been preaching
this shit have been preaching it forever
it's not true at all
lockdown devices have always been locked
down devices open devices have always
been open devices it's been about the
same
uh you know throughout history
if everyone decides to lock everything
down then
you know okay we have risk five and they
get free chips apparently
um okay we need to write out an
entitlements entitlements.xml file
[Music]
hey
cannot read entitlement data all right
how do i make an entitlements.xml file
there you go
unknown exception great
you know i only got a 7 core gpu so i
want i want to use my 16 core neural
engine can't you can't blame anybody for
that right
trace trap huh
you're telling me i'm not entitled to my
entitlement
sip is off allowing core dump
amphi code signature
validation failed
why would i want a sandbox shit false
don't sandbox
that's better that's because sandbox
sucks
um like let's say we want to access the
camera is that okay
yeah that's okay now i just need to
figure out what the entitlement key is
for
uh
where do i get a list of all these how
do i get the neural engine
um is any of this stuff good
make sure you have the right
entitlements yeah yeah
um there's gonna be one well
because i don't exactly understand i
mean i assume it's entitlements i'm not
on this
um com apple security device a e
of course not
entitlement for
caramel
actually does the library have an
entitlement because carmel just links to
that thing right
who could figure it out
i believe jack can beat me to this
actually
no java you can't do notifications
okay
i o return h a
e in new user client
creating default full entitlement client
okay where's my kernel
i didn't really think that would work
where is colonel
system libraries colonel kernel
don't tell me it's not even in there
anymore it's in the cache
oh colonel
great
it's probably a cast
yeah um
here we go
there we go
okay some good progress now let's look
at why the colonel's telling me no
and let's make it regret its decision
you know let me give some context to
everybody so everybody could be excited
about this
you know oh i stole that expression from
alex
let me give some context so i hate when
alex uses that expression
well regardless apple m1
chip i want you to look
at this picture
yeah this picture
right here 16 core neural engine
like 20 of my chip
is going to this thing and nobody even
knows how to use it
ah one spin draft
two spin drifts double spin draft
all right
let's find the denied access
and user client
i can't believe apple wrote a kernel in
c plus plus
now i get strings
there was a reference to that
what
oh is that not exactly what i want
you could just done this with strings
come on fingers crossed boys
is that it oh yeah
now we're getting a different issue
code signature bailing out because of
restricted
entitlements
the fuck do these people think they are
yeah well that means we found it
ah restricted entitlements
well either way
yeah all right here's the function look
denied access but if we had a
e i o kit user access
we would be new user client for process
but instead we're getting processes
denied
access
okay well you know all right let's
jailbreak this shit
um
[Music]
bailing out because of restricted
entitlements
who decided to restrict the entitlements
i created a terminal command
with the same entitlements for the test
pseudo
no pseudo doesn't help roots not even
real
empty bailing out because of restricted
entitlements
i have to request this entitlement
who am i requesting it from
apple disable restricted entitlements i
disabled csr
no i don't think that's it
the signing seems right
amphi bailing out because of restricted
entitlements
hmm
now i have to reboot if i want to do
that
do
hmm
no i don't think this is right we can
try it but
it's like that's just going to give the
error 12.
i'll try them both but i don't think
this is that
it's getting killed because it knows
that entitlement is too good
restricted entitlements
but the validation of its code signature
failed
oh okay wait a second no
maybe the code signature did just fail
maybe i do have to trust it maybe you
guys are right
okay let's go trust the taylor swift
certificate
um tech alex jones
wait so do we not even trust taylor
swift
where is taylor swift my certificates
keys certificates no
local items login
key
passwords
system
what passwords are lead you all didn't
get shit
csr util authenticated root disable i
don't know what that does
okay it looks like it's just failing
why is it failing
first off what if i do this does that
work
so taylor swift's in the keychain she's
just not trusted
but where is taylor swift do we see her
i did code sign dash d in title oh i
didn't do dash d
dash d
no i don't know what dash d does
yeah just oh display contents
i don't know about that
yeah yeah yeah no um use the search box
good point
oh you are bro use the search box bro
wait but where is it here
trust
code signing always trust
swift i leaked my secret password
code has restricted entitlements
but the validation of its code signature
failed
i don't think it's that dash d
certificate is mark just trusted
well
okay this does look like it's the same
problems with google
check entitlements of binary okay we can
check the entitlements with this
okay i mean we knew that
check contents of provisioning profile
oh here we go pseudo log config
private data on
swift invalid modes private data on
oh it's because it has lame quotes
never mind i don't know what that does
the embedded profiler
in keychain access groups
i bet i have to buy an apple developer
account
bailing out because of restricted
entitlements
remotely signature not valid
oh no i mean i think it is just failing
apple self
sign certificate
all right do i have to create a root
certificate i might have to create two
certificates
i feel like i've done this before so
that's a self-signed root certificate
create a certificate
right it's a leaf certificate of code
signing
we'll call it taylor swift 2.
oh create a certificate authority oh we
got to do that
yes taylor swift ca
for code signing
i must enter an email address uh
taylor swift dot com
okay oh perfect
yeah now taylor swift has a ca now let's
create a certificate
it's a leaf that's called taylor swift 2
code signing yes based oh no the root
certificate is not trusted okay we've
got to trust the root certificate
okay get info
trust
always trust
trusted all right cool
now let's create a certificate a leaf
called taylor swift's
child
we'll just call it taylor swift child
code signing okay
now let's make sure we have all these
tailors
all right
code has restricted entitlements but the
validation of its code signature failed
please submit a request for it
no no that's a joke no i'm not doing
that
oh i can check am vd actually if i get
console it should work better
start
oh requirements for restricted
entitlements yeah okay
i'm really supposed to ask apple
um
i'm sure it's this
no the signature is fine i believe
yeah it's fine okay um
boys i got some bad news
we're gonna have to reboot
uh envy ram amv disable
sorry amphi but you know what
you got to stay out of my way it's a
joke
wait but how am i gonna use the the the
neural engine
okay
privilege violation
can i do it from recovery i'm a little
scared that i can't
oh no never mind
okay boys
if everything goes well i'll be back in
five minutes
if things don't go well well
you'll never see me again
add apple security inherit to your p
list
okay i will try this check my fucking
privilege
yo all right we will try this so
is this what you mean
now same shit
okay boys
we'll be back in a little bit
boys
boys i have some bad news boys
i got some bad news and it's right here
on my phone
can you read it
error setting variable boot args
io kit common not
permitted
that's not good boys that's not good
oh you can't read the tiny shit all
right i'll make it big for you you ready
you ready to see what's going on that's
what's going on
i'm very upset i don't think apple
should be allowed to do this
i think i think we need we need some
people who are going to fight back
and what why is it doing that
why is that not my computer
is this apple punishing me
oh no it's just too big i don't know the
screen's messed up oh everything's
everything's bad
oh no
why is this messed up is it messed up on
your side too
can you guys see okay
i guess it's fine all right
yeah okay
whereas is weird
okay well who knows how to fix the
problem
that we don't have entitlement
fun tiny grad and e let's go
all right we're getting gidger back out
yeah there's a black bar on the right i
can't do anything about that
okay so
um yeah we're at war with this computer
right now
so the problem well first let's check
let's
check the other guys for entitlements
fun uh npe libs
right so i would assume that the apple
neural engine library
has the entitlement wait
oh but that's not signed because
oh
no okay well that's not a
yeah so i would assume that the apple or
neural engine
has the entitlement because otherwise
how would it be able to call it to any
services
but if we try to call it directly
from our code we get killed
we can of course disable this
and then we get the error 12.
actually what is anything with com apple
a e not allowed
oh they're all restricted entitlements
eh
yeah so that's the other error we can
get um
so there's good news we have everything
here we have the kernel
we have
just have to figure out hmm
you
we had it before use your client open
no
this really isn't as good with like
strings and stuff
okay this is the only entitlement right
copy entitlement for task
it's the only place that checks in
entitlement
okay so it must be this one
i can't turn amphi off
i have obs configured improperly
no i didn't none of the nvram stuff
actually changed
oh i see what happened hang on i think i
can fix this if i uh
delete that yeah cause it's because i
changed the resolution while it was
going yeah we're good
um
did i run nvram as pseudo yeah
double sip
wait what
wait that just worked
wait that just worked
how did i get an error before
error setting variable boot arcs
this worked so i just have to reboot we
should have no more amp fee
cool all right we're doing it again
we are rebooting one more time
we got a zero
oh yeah
see that zero that's all we wanted
all right we are back in business
build and now i run it
zero let's try getting rid of the
entitlement
i think but i think it's not gonna work
now
yeah okay we get 12. and now we can add
the entitlement
and now we can build it and we can run
it we get zero
let's just go over to console let's
start
here we go cool
h1 initialize platform services is
called
create creating full entitlement client
new user client for process done
all right we've created it we have
bypassed the security
how did we fix i don't know i just tried
it again
i just tried it again
some guy was like try sudo and i'm
pretty sure i tried pseudo but actually
there's some chance i didn't
but it actually didn't let me do it from
recovery where i was
root like error setting variable boot
args io kit common
not permitted which i don't get but
you know what i'll take what i can get
we have an m1 mac with amphi disabled i
don't know if you're supposed to be able
to do that
pseudo guy in the chat we like pseudo
guy all right
all right um let's go back to geardraw
and start figuring out how i should use
this thing
we've created a platform services
all right so that's the kernel library
that's any service is what we're playing
with that's the neural engine
and that's a second copy of the kernel
library we don't need that
wait okay yeah here we go
create
okay
write a kernel exploit we don't have to
we just set the bootax
device not opened by client
okay well we have device open
all right um
it looks like we don't even need to get
into the c plus library too much
because we have these here
program prepare
okay any device open program create
program destroy program prepare
program stop have a program run
initialize platform services
so it looks like yeah i mean my guess
would be
my guess would be
that you can just write programs for it
actually
there's one more library we haven't
touched yet let's take a look at it
i believe it's called a e compiler
and it's the largest one
so it really looks like you just create
this thing
you can create programs we don't even
need any of this c
plus crap it looks like it just has a
low level c library
no i didn't mean to click that no
once you get to the bottom of this it's
just in c
all right i don't really know what we're
supposed to pass into this
real bro way more than well pseudo guys
bro but
super bro was um
the
extern c guy
i can't believe i didn't think of that
program create
device close um
let's see if yeah let's analyze that
and let's see who calls uh
any device open so any refs to this
no only external okay so let's take a
look at apple neural engine
and see if that's what's calling it
it's not okay what calls it
okay so apple neural engine does use
that
tons of objective c crap
oh that's the data type manager they
were talking about
well you know what there's another way
we can go about this let's go back in
here
alex is going to come home she's going
to be like you're still streaming
that's what i was going to say
um you know i hate that
i just need to highlight
local f0 is param one
i like when you click on something in
iodide highlights you know
what could these things be
like that one can't be zero we know that
oh this is an ane device usage type
i don't even know what that is
oh here here's an underlying call
to h any device open
so let's put this guy in here this is
actually a
call that returns inside
get rid of this i do not know what funct
f1 is
but my guess is these are the parameters
for
my guesses those are the parameters for
h any any device open to
so it's nice because in c plus plus you
get to see
the names of stuff
that's the function
see if there's any more of those
match the parameters yeah
device message notification
and now it's unlikely to happen
but if we do sag faults i will be back
it might happen it's always a
possibility
i mean i'm guessing but i don't know
maybe
thankful
oh i mean
open zero two okay here's another thing
it could be
total gas but if i were writing it
i would write something like this
hmm
segmentation fault
okay um
man i pay a hundred bucks for the header
file right now
then what fun would that be they just
gave me the header file
what fun would that be
okay oh here
look we know param2 is being passed into
any device open
and we know any device open here we go
okay so any device open
has the callback
the next thing so it's an ane device
usage type
and it's actually dereferenced
so it's a pointer to an ane device usage
type
well we can change that from null here
just call it nanny device usage type
and then we can pass in temp here
this one may be still null
useless okay well we know that's what
param2 is we know it's dereferenced
well actually we know it's dereference
that's the problem right there
oh placeholder class structure
was a struct
here we go
cool i have no idea if that's what
was supposed to go there
and the idea that it's a dev is not that
crazy
um now that we just have to get this a
struck to work
does this work and say like it doesn't
cool it does alright great
all right we got the device open now
let's
just check the message
okay client requesting power on
that looks good
i'm pretty sure that returns the device
um
you can check
i hate that doesn't highlight
local f0 here we go
any device v table oh
perfect so yeah that's that's exactly
what it should be
this is the constructor then for that
class
this other constructor who knows
but yeah so it's returning an 811 a
e device call this like settings
probably is settings
and then there's some other numbers we
can pass in we don't really know what
they do
okay so we've initialized it we've
opened the device
now let's try to do something with it
program create new instance
program create
again takes in a bunch of parameters
that we have no insight really into what
they are
some people are yelling about something
huh
well so it's very clear to me that this
is actually not a
just a long
all right we have to we have to figure
out we have to find the things that are
actually calling this
it's got to be in that an apple we might
not have even should have dived this
deep we maybe should have just used the
apple neural network framework
which seems to be something that we
actually can access we wouldn't have had
to hack amp the
that might have been the move just keep
it at this level
actually when i run that do i get
anything in d message
um all right
how do i like there's an objective cd
compiler isn't there have this open
already somewhere
i had that one why doesn't that work to
see apple neural action
where is apple neural engine
mps neural network
apple push service assertion services
oh is it because it's not a uh
here open
can i open the library
fun npe libs
apple neural engine
no
okay
anyone know why it's not here
this runtime browser thing work
loaded in the run time
oh maybe i want to load a that out here
you'll get it like that should have
linked to that
or is it here and i'm just missing it
yeah we have mlc any device ops
i mean we could reverse engineer that
but i think we just know what it's
already like getting to
i just don't know why like this didn't
really show up
um i don't know
like this is like objective c
d compiler there is one
let's try hopper
hmm
i wouldn't get those anymore disabled
amphy
this is nicer anyway at least these
names work better if i knew objective c
these would make sense to me
did that just work something he said i
wouldn't wasn't allowed to export
wow this is the demo or because it
doesn't work
that's really bad if it's
exporting is disabled with a demo
version
i'd buy the full version if i thought
this would work
well actually depending on the price how
much is it
[Music]
um
clone directory should skip clone
that's great that's great jacob bretta
but
but but no
okay any model new
so
okay that's all any device info
i don't even see that here what are the
pluses mean and what are the uh
what are the pluses and uh minuses mean
in objective c
oh public and private okay
all cool so it looks like i should just
be able to get
class
any clients
you know would help if i actually knew
these programming languages
any client initialize
is that showing open d messaging
no buy that
uh well actually does this have a return
value
how do i know it's void
how do they know the return type how
come this thing can't tell me the return
type
hmm
fun recognize selector eh
it's
cool
i don't know i don't want all the stupid
ones on
okay
and one of those stupid ones on nl uh
[Music]
if lm equals ns object class
that should break i don't understand why
why doesn't that break it should work
cool
there we go um
wait but that's not all the methods
because i called initialize and it
didn't break
it's only some of the methods
oh is initialize a uh initialize is
called a zone on this object right
are these other things not called
methods
i don't think these are private
why doesn't it show up here
because it's in the whole run time so
what if i do like this
so
no there must be something i don't
understand about why those are not
why they're not here
wow how crazy is it to put a while loop
and not hear fans spin up
string comp returns zero when the
strings are equal you're absolutely
right
but i don't get it it's literally ns
object
you know what
i don't even know what i'm supposed to
pass into these model things
let's see the compiler
wait is there a whole clang in here
zinn ir perf
are these real things or these custom
for apple
zen ir
cool all right
so we're getting somewhere there's any
services which connects to the thing
and then there's this compiler which
compiles things
you know what let's check the strings
with a compiler maybe there's a
disassembler
it seems like a reasonable thing they
put there
god taps
who needs to be banned yeah no i've been
i've been taken hostage
um they have me here and they're like uh
you know
better hack the apple or
you know getting out of here
no if i was taken hostage why would i
have a cell phone
yeah yeah checkmate atheists
oh saturday night
i got my m1 last it's like the old days
[Music]
you're just joining this evening well
welcome so
what have we discovered so far okay so
there's a couple of libraries
after you extract the dialogue cache on
your apple
um and we still don't really know
anything about what this thing is
but yeah so you have
any services which is what talks to the
kernel to actually
uh uh
like talk to the device there's apple
neural engine which is a private
framework
that links to any services and any
compiler i think that's correct
um there's any services
not only any compiler maybe it's
actually any services that links to any
compiler
what links to any compiler
i'll figure that out in a minute but
uh either way yeah so there's a compiler
any
[Music]
um apple neural engine
sorry any services basically has a bunch
of
things which are just open the device
write a program
what part of tiny grad all of it will be
able to write neural engine ops
i don't know why apple makes this all
closed
like where's the actual ops for this
thing ah
op code kind to string
that's definitely a string let's see
what it says
four e four three
oh nhcw
oh yeah well there's all these opcode
kinds to strings
so we can actually compile stuff and
then call this disassembler
oh this might even be the more fun one
to
okay we have to find a model that
actually
runs on the npe and then we can do all
this stuff dynamically
because all these op code kind to
strings are actually they're in the
layers
that's not even that low level and
exciting
you
you figure out what uh
oh no okay apple neural engine does use
the compiler and so does espresso
espresso is this other library that
um
it must just dynamically load the
compiler
huh tom apple
any compiler service allow
so there's some service running it's
actually running on my computer now
um yeah so this
is
any model model at url
realistically this is probably the level
that we want to tap into this at
first in order to be able to reverse
engineer the later stuff dynamically
look here any device controller
let's try any device controller
start stop
i think that's the fuselage
oh some of them are private methods and
it is so it's not private and public i
think it's static and non-static
program handle set program handle i
think we could probably just use this
this
the fuck
why is a an e oh it's for a class method
and for an
instance method
what's a class method and an instance
method
oh an instant message applies to an
instance of the class oh okay yeah that
makes sense
so yeah yeah yeah i understand that
so i have to create a class
let's say any device controller
um
does that work
right
use of undeclared identifier
obs but i don't understand
let's do that
hmm
oh no the only problem is like
what class
is like a null type in this object
hmm
so i might not this might be just
because i can't call generic and knit i
have to call something different
why do they all have underscores
controller with program handle
so
all right these are nice
i mean they're reverse engineered well
class dump dialed
yeah class dump that was what that thing
was called
class dumped
no
classdom
wow how's that just run
the file does not contain any
oh well
i mean it ran but
it ran but i think that it was because
it was built with
there's a reasonable library to want
[Music]
is there a newer version somewhere
you
third-party apps cannot use the neural
engine
oh what is this
hmm that's nice
okay the build is failing because
wait what
there's no platform ios mac
she's gonna pull requests for that
though
okay now we build class dump
now we should be able to pass in fun mpe
libs apple neural engine
unknown load command
so
cannot find offset for address
yeah that's gonna work
shouldn't exit anymore though
useless
good crap is just crap if you're going
to get repo it's nice
okay so the thing to target like i just
need to learn
objective c and then the thing to target
here
is this apple neural engine uh
private framework
except faulting probably because you
can't call normal in that
does gidra have good
it's called like obscene ivar
what happens if i export
where did i export them to oh here
so
here we go oh
look at this
factory function device open
here any device controller start block
invoke
any device controller start
oh this is the one i can't do because i
have to do
that's like false because i didn't knit
it right
yeah okay if you call start it actually
calls
this factory function device open
in fact
figure out what local e8 is
seems like that's pretty confirmed that
that's
let's have zeros as well
i don't really get why it's like written
like this is not a good objective cd
compiler
is hopper good if i just buy it
so
controller with program handle
any program for evaluation
purge compiled model
all right i think that's enough for
today
to try thinking about dinner
how many people we got
how many what's tons
if it's over a thousand i guess we gotta
stay oh it's all right all right
700 right that's not that's not over a
thousand
um
so let's let's let's get a little hyped
on what the m1
can possibly do
the m1 has
dedicated neural network hardware in a
16 core
neural engine capable of executing 11
trillion operations per second
thank you for subscribing cram that gram
right we'll take a look i'll go to the
bathroom take a quick look through the
compiler again
see if you can find stuff that looks
like op codes but we can get 11 million
operations per second i don't know if
those are floating point uh 11 trillion
trillion
we'll finally be able to answer basic
questions like what floating point
precision this thing uses
11 trillion operations per second
can you get docker working yeah maybe
should we fix docker uh
a research project for objective cd
compiler
oh this guy's
i can tell already this is never gonna
work
we'll give it a quick try
yeah the older one uses float 16 but the
new ones apparently support
this guy actually managed to use this
any program for evaluation
i mean yeah this is how you get the
program
cricket
what no i turned off amphi
no you don't ever no
all right security settings
cricket this actually looks way nicer
than i thought it would be
why is it why is this published in some
in some like obscure
random place
comes it looks like a violin it's
loading
class dump dial it
no
okay browse the cricut objective cd
let's try it
this guy's going to be
this guy was this close to being top bro
but
nope he was not top bro
um
not top bro that's right
compiled model exists for
load mile compile model
any model
model at url
can i get this in swift
how do i get this in swift
does this work
apple neural engine
oh
no luck there yeah we have to get
something that actually runs on the
neural engine and then said
break points on these things and then
look at what it's actually passing in
you know there's two ways to do reverse
engineering there's static and there's
dynamic
and we got to go dynamic
um
zin ir
this doesn't seem like the low level ir
though
get leaky relu lut
why is it doing neon stuff
that's a lot
get kernel symbol name
oh here we go sources any compiler libs
inference compiler zin ir code gen
you know what's going to be really fun
when we get like
the actual we can dump like just the
binary that's being fed to this thing
and reverse engineer the instruction set
do legalization dilate
co parter
debug detail print day
create op code
i wonder really what's being passed into
this thing
and we should be able to you know we can
just look at the kernel side of this
thing
wait the colonel's talking about zen
hmm
i'm good to give me a little bigger font
size so we can see it
okay
no we don't get more font
you wanted more font but you don't get
more font
yeah i think the apple stuff is using
this thing
yo should i pivot should i be a
consultant
for people on apps to get the best
performance out of their neural engine
on the apps
wasn't on the same line as font where do
you see font was it here
oh font here we go
nothing got bigger
i clicked apply did i not
i don't think i just click apply i think
i just clicked okay
i thought it would do the same thing
well that's just for the console
oh here we go you want more font in your
d compiler oh
well that gives you that now
if we want more font in our
function graph listing
fields format code
wow this has a lot of weird things
well we got more font on our d compiler
byte viewer
more font auto analysis
edit tools listing display
oh here we go more font
wait no we can't do that no no look at
that now
no no that didn't work no there's a
really bad choice
we have to make that wider
thirteen might be okay
no it doesn't fit on one line anymore
this is a joke
ah it fits on one line again oh well our
decompiler got bigger we can be happy
about that
symbol tray so what
ends when the symbols shatter
oh this is the yeah no we're not looking
at the uh
didn't even update for all of them it
only updated for that one
lame
what is c write eight
so i don't know how low level this zin
ir actually is
it's possible the xeniar actually goes
to the hardware
again what makes me believe this is that
in the kernel they were mentioning it
zen ird serial oh
oh look at this in the kernel they have
something called the zen
ird serializer
huh okay
so it looks like the kernel gets sent to
zen
ir ah
that's pretty cool and then the kernel
like pokes them
but yeah so the neural engine actually
does take in this this
this is in ir
here's the parsers for it
um it seems like it supports
float floating point 16 and
8.
yeah i almost just want to figure out
this kernel interface
we'll get something to run and then
we'll just sniff the kernel interface
oh here's where all the stuff is
hidden in there
start daemon create reporter
[Music]
flush shared memory surface is program
valid what does this do
hmm
program memory buffer okay so you code
in this zen
ir anything use this
process and info dct
c x t
parse transform
wow yeah this is like this all in the
kernel that's crazy
parsh transform list
[Music]
d
dctx like device context
read two vectors
dv pointer
so cool
hmm
so i mean you're not even going to get
even if you go all the way to the kernel
has there any been any documentation on
this anywhere
yo so we can actually do this we can
actually make this work in tiny grad
like this isn't this isn't far-fetched
and crazy anymore
if we can figure out we'll just write a
zin compiler
for every tiny grad layer
regardless of what it is we can bypass
all of this user space crap
you know this reminds me of the bad
decisions that were made in tensorflow
right like when you look at that mlc
tensor library
when you look at like it wants you to
construct graphs it wants to do
everything dynamically
when pytorch showed that you can just
like schedule things
to go to the
uh like you want to do a convolution
just send it to the engine right
just that one convolution right in this
case it's the gpu
and you're usually still bound
especially if you're doing any sort of
serious workload by
i guess if you're doing inference on
tiny crap maybe not
but still
what we can write is a very simple zin
compiler that just pushes that creates
little programs for each one of our
layers in tiny grad
and then pushes them to the thing
hopefully if i think if we can do that
at that objective c
layer and bypass the compiler which you
can probably still do i don't think we
have to do the amphi thing
because i'm sure you can link to that
private framework without amphi it's
just that that
the private framework is what can talk
to it
so again there's a bunch of ops
zin ir unflatten unit create
layer
yeah so these are the uh
these are the layers
um probably what we want to do
is like get pie torch to compile and
then
figure out how to send arbitrary things
to the uh
through mlcor i think i
saw some guy do this and it kind of
worked
yeah so these zin
layers i guess are these are the op
codes
i mean i'd be somewhat shocked if these
are actually all supported in the
hardware
but at least they go to the kernel like
that
they have a whole compiler in here it's
crazy
there's probably all these stupid rules
about how you can use the hardware
like all these like things that it
supports and things that it doesn't
i'm going to change this right
here space to batch to batch
i'm just shocked they'd build something
that looks like this
i don't know i guess we won't really
know much until we can
actually disassemble some of this
and see if they're crazy enough to have
built hardware
that like this deeply supports the
current convolution operations
well
if you're apple does it make sense
if you're apple
do you care you'll build the new
hardware next year
if you want to support new convolution
ops you'll just i don't know
it's a it's a weird approach to neural
networking and
it's a weird approach to neural networks
and um
you know it's the complete opposite if
you watch the presentation of tesla's
chips
but tesla designed this very
minimalistic ir
which could implement basically just
matrix multiplies
um who knows why nvidia bought arm
video ball arm because they have too
much money nvidia could be
you know they could be intel they could
have the reign of intel or they could be
cray
you want to keep building golden two
hundred thousand dollar computers you're
cray
yeah yeah if you guys don't know this
cray built this super computer famous
absolutely famous you could sit on it it
was like a bench
okay
look nvidia built a golden computer they
built a 200
000 golden computer
who are you are you cray or are you
intel
choose right
all right guys it's a lot more to do
but that's it for today's stream
thank you all for watching we went deep
on the neural engine today
we learned about zinn we learned about
how it works together
and maybe we can support knob and tiny
grad
tomorrow bye
good morning everybody good morning
about chat
good morning gmgm all right
guys I couldn't stop last night I
couldn't stop you know
uh what one once this it's like it's
like Pringles man dude advertising saw
my head man
thank you
okay so I worked hard last night
and I wrote this
parse
so we got the compiler working yesterday
you saw us get the compiler working
yesterday in docker
uh so I wrote this thing to parse it and
extract the code
that actually runs on the edge TPU and
for reference this is an edge DPO
all right so that's Edge TPU good
morning good morning good morning
that's Edge TPU and I wrote something to
extract the code right so now we have
code
so this is like the code which does a
railroad
look at this
this is the code
what does this look like to you
Alex and Harold are running comma with a
div advising them you know
uh good morning everyone good morning
I'm so excited about this all right so
first off this stream is sponsored by
Celsius
uh
can you be sponsored by shit even if
they don't pay you I paid for this
Celsius uh but because I'm impartial
that means I can tell you the truth and
honestly I I feel like this stuff's made
in a vat and it's like mad chemicals but
either way
the multi-cam or ultrasonic oh my God
Edward Apollo what are you saying what
are you saying let me know that shit
one camera
we ship two because uh you know
should I just start making up shit and
say like our investors made us
no no no no
um all bad decisions were mine
I'm gonna hate that wire anyway
good morning am I working out no not
today I thought about it you remind me
of Connie I think that as a compliment
oh no client's going through some hard
times man I'd be mad at the you know my
wife took my kids to tell
um
okay so this is a program
that runs on the edge TPU
what does this look like to you
like I was I was staring at it last
night and I'm like what is this
this is a custom instruction set
So today we're going to reverse engineer
it
[Music]
no I mean it does seem to use llvm okay
so this is the program that produces
these things
it's called The Edge TPU compiler
but I have not found many hints in this
program it seems like they have very
little debugging information
My Stream is blogging
which CPU I don't think it's a CPU I
think it's custom
um so part of the thing that informs my
reasoning on this
is when you look here I've documented
the TPU and the TPU compiler has a lot
more uh
has a lot more debug information in it
so I found out what the instructions are
for the uh
for the TPU the big TPO
and they have these vliw instructions
ah
so it seems like this is similar
and we're gonna have to go down to the
bit level
because it's it's literally an
instruction set it looks like and just
looking at another thing that makes me
think it's an instruction set is like
these things are uh
this is this is uh 16 bytes so 256 bits
so it seems like it's a 256-bit
instruction set I also found this last
night
gptpu
these guys but I was kind of sad when I
looked into it more they just like call
the compiler a whole lot
they didn't go deeper than the compiler
um
foreign
so I I think it's uh
is it here I can show you something
um
parse
you should also have this just going to
compile
[Music]
it's kind of annoying to run both
okay you know I'm just gonna pull Parson
to compile
oh no it's gonna complain it's gonna be
like I can't find the uh platforms
oh
foreign
so now I can do something like generate
model and parse
so this is going to compile the model
calls the compiler it's in Docker it's
beautiful love Docker and it shows me
that it's output in b
uh
B30 amounts of code and these things are
offsets into the code they're like this
like linking
Mars file
good morning um so I thought this would
be cool to stream we're going to see how
much progress we make
today we are reverse engineering the
custom instruction set inside the edge
TPU if you work at Google we'd love to
have you come join our stream and you
can come laugh at me and about the
things I get wrong
a pump
85 we do have a rule in here we speak
English
we do not speak French we speak English
because this is America uh Spanish is
also somewhat acceptable but French no
no no no no no
foreign
we'll zoom in a tiny bit oh they didn't
teach you this in college oh shit man
you know maybe maybe who taught you
College was going to give you
information what marketing you know you
actually can stop after you pop the top
off Pringles and college is not the
gateway to a better life
you fell for an advertising campaign
um
wait no no no oh come on you kind of
know what this is if you don't know what
this is then we're gonna have to go to
subscriber only like because we haven't
even done anything hard yet this is just
I'm just saying that this is a custom
instruction set I know as little about
it as you but I think each one of these
is an instruction that's executed by the
processor look college is not always a
scam if somebody else pays for it
or if you're just there like I showed up
at Carnegie Mellon and I paid for it one
year
I took operating systems I took
compilers I took AI I took this freshman
leader Math course and it was great I
learned a lot totally worth it if you're
there to learn
by all means if you got someone else
paying for it by all means party chill
you know but if you're paying for it
because you think you're going to earn a
degree and this degree is going to
increase your earning potential in the
future that's going to get a scammed
all right so like look at these look at
these there's got to be an instruction
all right let's look at this one look at
this one it's almost the same but this
one has some F's in here and this one
doesn't
um
let me change up parts a little to not
so these are offset bits into the uh
into the code so we kind of get a hint
there
but I think we're doing this I think
we're doing this Pure Black Box oh you
got something for me
oh yeah can someone just look around I'm
sure someone like figured some of this
stuff out
no this is a python stack profile
I mean it looks kind of cool but
I don't think this is going to help us
now
um
all right guys all right we're not
talking about how universities a scam if
that's what you guys want to talk about
we're going to have to go to subscriber
only
uh we're talking about how we're going
to reverse engineer this instruction set
and we got to stay on topic
Edge TPU instruction set I googled this
a whole bunch last night and I didn't
find anything
don't do SUB only mode just for use of
only mode
uh
there's like so little information on
this stuff
I mean the best I can do is like think
about the things that I found when I
reverse engineered the TPU but I didn't
get that far with that either
okay so we have a few options
we can really keep trying to Black Box
this okay so this is the output code
size
um this is what I'm generating it from I
commented out the karate stuff now I'm
just using this function here
all right so like if I make it a
function like let's do that right
now it's going to generate the model
it's going to compile it
right you see saw braillou Mall quantize
okay that's a lot bigger that that made
a lot more code
so let's oh because he also has shape
four so let's go back to shape one
it's a lot of code okay let's just do
what if I do Rel U times two is that the
same amount of code
your value times two is the same amount
of code
what if I do like Rel U minus one
and that generates a huge amount of code
okay so let's take a look
um I had to just write it out in temp
frog so we can do Rel U sub one uh dot
coil
now we have this program and this
program is a lot longer
so I started writing a compare tool my
compare tool is very mediocre
uh
data set anymore let's just call these A
and B
range max length A and B
wave a is less than I else Dash Dash
I'm just writing like a crappy hex stump
tool
see what I'm writing
uh if
the a not equal to DB we'll just print
out d a here
this index out of range if length a is
less than I
index out of range oh I less than length
oops
what does that do it's just like I'm
just compiling a tensorflow function to
the uh to the edge TPL
okay
so you see that this whole Preamble is
the same
um
we should actually have we should
actually output both sides of this so oh
this is hard to try
let's make these greens it's more
readable
and when we get here we can say f plus
equals 10.
uh
what
oh we got a reset tap
that's kind of what I was going for
um
um oh
I have to do that at the end too
that one's different
[Music]
oh that just upsets me
uh
that just upsets me boys
that one's different
okay
okay now we can compare
uh the two things and like they're not
all that different
[Music]
um
so this is like if I can compare I wrote
a couple programs yesterday one of them
does a relu and one of them does a
multiply by two
and you'll see that like the only
difference is right here in this single
instruction
um
I also had one where I did a relu on two
bytes instead of one byte okay look it's
that same instruction that changes just
that's what changes which is weird
off topic Garbage Guys off topic garbage
see it's like it's just like one
instruction
so we can like mess around with that
instruction and see what happens
but then later we added a sub one and
it's a whole crazy
big change
like this
Burns a lot of what I believe about this
being a uh like instruction set right
look at how look at how this instruction
here is moved down to here
um
[Music]
foreign
sorry for writing garbage code it's
early in the morning
apologizing in advance
now we can see where okay so it marks
these things as like places that you
want to modify it's like this is from
the Linker so we can see where those
actually are okay they're here
which makes sense right uh
are they all right there well it's
actually really
where's our heads
oh this one's big
let's go back to a single ratio
come on do people follow this at all
this is easy shit when I'm doing
anything hard yet like okay so over here
I have a compiler which is compiling
this function
for the coral
right
one two three four five six seven eight
how come I only see six
oh it's because I copy pasted the wrong
one
good morning
what do I see happening the first year
of tiny Corp
this
this is the tiny Corp
live streamed for your pleasure
see look here are these things here
oh I think that's the output
you want to like label things in
tensorflow I think you can label them
tons of all sports like names and shit
uh can I name it
can I say like name equals
G input yeah you know you know G
all right so that just won't be called X
let's see if it does g inputs down there
no they're still called X
oh
F get concrete function
G output
function got an unexpected argument
named
concrete function Lambda X args
oh if the X comes from here oh okay
let's call this G input
is that really where the Xbox One
lives to thank you for subscribing good
morning okay these are going to change
to G input oh this is exciting
I understand
how this works then
okay these are G input that's good
um okay and these things are also like
you can look at the type so I found this
this is like the uh
they're called Darwin executables with
two ends
um this is from The Edge TPU repo I
found this last night
you can see that these G inputs are Base
address input activations
and look at this bundle ALU move I
instruction
that's cool
right
so we know oh man this is like some like
Sherlock or Mastermind shit we know that
these instructions here
are uh
our mobile instructions so this is a
bundle ALU move eye instruction we have
a real name of one instruction and
that's super exciting
um I want that to be called identity
that's just a boring name uh
foreign
good morning good morning okay
um
let's get concrete function
you can just call the function identity
and make it the identity brow
actually if I do make the function the
identity you'll see it doesn't happen
sir
or compiled to nothing
so you actually have to do something in
the function
so we're back to compiling our value
we have these things okay
so these inputs are
parameters and scratch
so the addresses get put in here these
two are parameters these two are scratch
uh this is the input
and then this is the output and then I
would assume that what this code does is
actually store and send the output
[Music]
it's a little odd that they're after the
part that changes
to load output activation Base address
it's crazy to me that when you look at
the other code I didn't change any of it
and it still works
ah
I don't know I mean maybe it's just fine
okay this is the most exciting thing I
found is bundle ALU so let's take a look
in lib Edge TPU and see if we find
anything more that looks like that
I don't know
bundle ALU okay it seems like it's
called a bundle it seems like they call
each instruction a bundle so where'd
bundle up here anywhere else
you know that the package data is not
aligned in the package bundle file
but it'll be loaded into an align memory
block
for flat buffer only supports 1D Vector
considering creating a new root type for
new Chips oh yeah what you missed last
night was that we parked this whole flat
buffer this flat buffer turns out to be
inside the custom op
so this is the TF light file you load
the tflight file you get operations
operators and then there's this thing
called custom options and it's all in
this custom options where you actually
get the code that executes on the HTTP
so remember yesterday when we compiled
uh for the edge TPU it replaces the
entire graph with something just called
Edge TPU custom op
and inside custom options is where the
code is and then this is the thing to uh
and this is all this is all open source
from Google
um
this is the thing to actually get the uh
this is the
program that runs
so then they have this thing called
encoded instruction bit streams and you
can dive down into instruction bit
streams
and you have a bit stream
and then these things are field offsets
uh which were the things that we were
looking at here so these numbers here
are are the field offsets
um that tell you where to update
uh these things
yeah so that's how you know oh that's
all I know where the bytes are on the
output yay I parsed the whole structure
last night it's all open source on on
live tpux right sorry I I left
yesterday's stream feeling like a
failure and you know I hate feeling like
a failure so I just uh kept working I
got some food and uh you know went hard
um
the blue highlights of the field offsets
yes thank you for paying attention
uh go higher to the field offset and
then we know
from this
that this instruction must be a bundle
ALU move I instruction
so let's take a quick look in the
strings of the compiler to see if the
move I is mentioned
it's not it's just like in the word
removing that's land
bundle
bundle
ALU
just inside of this stuff
this code's unreadable
so what I have loaded here in guidra is
The Edge TPU compiler you can download
the edge TPU compiler but it has almost
no uh
almost no documentation in it I spent
yesterday trying to figure out how to uh
enable logging but I now think they're
just easily logging
um yeah someone sent me an email
actually took me off my challenge
figured out how to enable all like if
you use g-log how to enable everything
but I don't just don't think there's
anything here
are secret CPU mode see the Arts it does
seem like there's other like weird Flags
you can enable
um
yeah
I think we might be pretty much on our
own to reverse engineer this you know I
did this once before
I did this when I was uh
when I was uh like 20 years old Apple in
iOS version three
pushed the encryption to the audio DSP
so I reverse engineered this whole
instruction set for this audio DSP
and then um found out that it was
actually documented somewhere
like it was just a PDF and I'm like oh
shit man
uh this is really nice
but um so unfortunately that audio DSP
had two byte instructions it's a lot
easier to reverse engineer an
instruction set with two byte
instructions than it is to reverse
engineer
uh an instruction set with 10 byte
instructions
I did learn something
so I mean
man if we could just get the docs on
this
maybe we shouldn't be using Google
wow at least they're not trying to sell
me you know up not here they're trying
to sell me movies or something
you're always a good place to look
GitHub search
I mean they should find this at least
this is open source code
I have to sign in
uh
uh no nothing exciting just the same
file over and over again
you search for bundle ALU you get some
other stuff but nothing too exciting
looks like junk
nothing nothing
foreign
want to look around and see if they can
find anything
come on viewers
like duh we have we have one instruction
just documented right here and we know
which we know what it is I I bet you
just put the address like in here it
looks it looks pretty straightforward
right
you know actually it was a little weird
because it was 0.75 so it's actually not
like a line to the zero
foreign
if you see that these things are uh this
is not aligned to a uh
72.75 so this is actually the you skip
six bits here
and then you get the constant
um so the good news is the way
architectures usually work is the same
things in the ISA mean the same things
over and over again
and my guess is going to be that this
instruction targets the scalar unit
we also have in other in other good news
[Music]
um
there might be some way to like single
step on this stuff well should we get
relu running maybe we should do that
it's not garbage man
it downloads the firmware there's also
firmware but I don't think we're gonna
have much luck there uh I also added
like the length to stuff right
um so you see here it sets up the uh
stuff
it loads in
um some code
and then it runs it
should we clean this code up and we
should clean this code up
hot garbage man
all right uh let's make a new file
called simple.pi see you know what's
nice about not having a job you can
write crappy code
simple well you can't call it simple
what about the other people who are
going to interact with your code yeah
but fuck that man fuck George Hots in
one year who looks at this again fuck
that guy
um he don't get shit
make a function called open device
um note that it may download firmware
uh uh that's a different thing I don't
think you're gonna find anything in I
don't think tensorflow is a good place
to look
[Music]
all right we've asked something here
foreign
that opens the device
uh we have the thing here that loads the
registers
well that's a lot of garbage man
um
foreign
B rack
some registers have that and some
registers don't but like okay there are
cool things uh in the register list
so like you know you're good for
uh for KV and Rags print
hey Colin
oh man whatever
okay
so this is the all this is the list of
all the registers in the uh
device
pretty cool right
can we initialize array with oh this is
all instructions so the data is inputted
elsewhere
so the programs I was compiling were
simple little programs
um that don't uh
that don't have any um
uh
data they're just they're just fixed
so I saw some stuff about PC here
current PC
oh we should also look there's a chance
that there's some documentation in here
about
um
this is cool
like this is a this is something that we
can
yeah we know the instruction of that
um
contextual csrs in scalar uh data path
so we have things like scalar core run
control and execute control
let's write a function like read
register
uh we figure out debug mode no I don't
think there is a debug mode
I think that's just kind of it
so these are the reads and if you do
this it uh
so that like
c0 is a read and 40 is right
yeah so you see that like writes
zero one to scale our core run control
which I probably starts at running or
something
we can figure out which of these rights
we actually need
okay let's open
uh
where's LL send
okay keep this function around
um
this is garbage
so let's try like open let's try to send
that value program and see what we got
it's a zero uh because zero is the
program
foreign
something let's see if we get a response
no we're not getting a response right
now and it's because we're not sending
the setup
uh so let's send the set up
I'm just going to copy and paste this
into
here
and we'll do this
we gotta first open the device
setup registers and we're gonna we're
gonna figure out a minimum set that we
need uh
oh we probably also need to send
um
okay well notice how it is blinking the
light so that's some progress but it
looks like we're stuck in an infinite
Loop somewhere
so let's unplug and plug it back in I
think we're gonna have to send some
bytes
um
let's just try this
I don't know how much it actually has to
send
you know what we can do we I have the
stuff to run it let's just run it uh
okay generate model
we're doing the simple value that's good
um I can use a DOT out and I can run the
model
so this runs the model using the
tensorflow back end
again this is actually the proper Google
that was the firmware that's great okay
cool
uh it runs a model
bulk in eight bytes from buffer index
zero it's still doing several dmas
uh
uh me we can modify that code or we can
just
oh remember yesterday when I was like
patching the thing I found out I could
just set the uh I could set the debug
level here
let's erase that
um
thank you for subscribing
30b notice that's the same as the header
we're sending over here right
uh
uh the out bulk transfer async at one
end okay
here okay so here we have to send
another okay here we send eight bytes
okay so I think
let me just look at this quickly so I
can figure out what uh debug level it is
so I can set it to the minimum one that
still includes that because that's where
the good shit is
command key
and that's on line
215. it has a debug level 10. great
um okay
so we have to send eight bytes with one
so let's send eight bytes uh where is
that it's in simple
there's actually eight butts
five six seven eight
count would be proud
okay cool look we got our spots
oh yeah we running value
yeah simple easy easy all right let's
just reset the device make sure that
like we got everything in that program
that downloads the firmware okay it
works
uh simple is running
okay
um what we can do now
there's a few things we should do
we should clean up this garbage
these are reeds so we should figure out
which ones we actually need
uh these 40s are right the c0s are reads
we should figure out which ones we
actually need
what's on ca8
tell me what this is oh enable thermal
shutdown interrupt oh that sounds
important
so look here there are like useful
things here that's kind of cool
uh oh it tells me like what the
different bit fields are great
great
foreign
after fields in the spec can I have the
spec please
can I please have spec
all right just in case I'm missing
something let's just Google okay great
nothing
um
oh he fuse
[Music]
foreign
by the way I stole all these control
transfers from my old code that did this
let's just like take these out do we
need them
foreign
yes we needed them because now it's
broken
those ones weren't important
that works again
all right
so hacking is using strings there's
another thing hacking is too it is
binary searching by hand
so first off all these c0s are useless I
think
all right so it works
uh I also that's pretty good actually
oh I don't think this is actually
getting a real output I think there's
actually more output to get to that's
like just like the acknowledgment output
um I think we can get more output
if we read here
yeah okay good
uh oh actually wait we know what this
program does it's relu so let's pass in
something like FF
I was really going to do anything
they're all positive okay look it just
passes it it's just through the identity
right
sevenf
oh but I bet if I put in like zero one
it won't pass it through because it's
value
uh no I pass it through okay let's try
something like times two
they should multiply by two
oh just zero okay
let's multiply a bigger number by two
let's try something like 40. multiply 40
by 10.
20. okay
well I'll take it it divides by two
that's pretty good that's almost
multiplying by two
let's see this is going to be 18.
18. all right cool
that doesn't make any sense why does it
actually divide by two
that really doesn't make any sense
foreign let's just like compile it again
and make sure I didn't mess up
writing a function is clearly two times
programs
no I did modify it okay I don't know
maybe I did it wrong let's try that
multiply by two
okay that's just the identity now
I put in 30 right
remember GM put equals two times G input
okay let's check out multi.coral and
let's copy in mole to fake that Coral
and then let's run my comparer and see
the difference
weird
okay
did I write something wrong
let's try like subtracting one I don't
know
[Music]
foreign
I'm putting in 30 I expect to get 2f
let's see if this one works
30.
um I mean this might be some bullshit
because of the quantization
foreign
G in my in my compiler that I shouldn't
have
ah here representative data set
um
let's try that
and let's add one sub one subtraction
seems hard let's just try adding one
come on if you can't add one I don't
know what you can do
10 Prague add1.com
that adds one now let's go over here
because right I had RNG
add one
no it's just the identity
is any other reason these wouldn't work
I'm just getting mad
all right let's go back to times two
boot.f get concrete function input data
I'm a little worried about this because
it's not a uh
should I be TF constant or should that
be something like placeholder
um
how do I know which address to read uh
you don't actually have to read an
address
you just uh
just dump the USB and it gives it to you
okay
none of these programs do anything now
okay they're all just the identity now
it almost just seems broken
okay that one still seems to divide by
two we found one program that does
something and it's this one and it
divides by two
it does seem to reliably divide by two
we got to do something I'll take it
is this not right what is TF constant
constant tensor I want a placeholder
that right
oh I'm only running parse oh shit
and on compile oh I was doing nothing
this whole time great
it's great
okay well that's nice
well guys I wasn't compiling it
okay
adds one take a look beautiful okay
let's
CP temprog add1.com
let's try add one dot Coral who thinks
it's going to add one
all right so for reference we're putting
in 48 so I expect it to return 49. this
should be 49. let's see
lame
let's go back to multiply by two
foreign
go in here
mole2 new Doc Coral
okay again we're dividing by two
almost what we want
why is mole divided
oh I know what it is
I know what it is
we can we can get this here
ah
so it's actually doing nothing it seems
except the scale is different
right because look the scale here is one
and the scale here is two
so it's not actually multiplying
yeah it's actually weird why is this
called identity
so this function is being compiled to do
nothing
but it is returning less because it has
a scale that's different
so that explains why it's uh it's
dividing by two
so this program actually does nothing
but it effectively divides by two
because the scale is different you know
what I'll take it
I'll take it and we're just going to
call the program diff2 because that's
actually what it does
and we'll deal with all this later
uh yeah the compiler I mean the scale is
stored there
I don't exactly know why it's giving me
identity here
um
this just might be a bug in how I'm
compiling this
foreign
function actually works what if I try
something like too safe too is that
going to give me four
expected tensor okay uh TF dot tensor I
don't know how do they want to use
tensorflow I'm gonna use tensorflow does
that work
did I mean Capital tensor I probably did
do that maybe that works
come on give me four
missing two positional requirements
uh TF dot ones
okay gives me four
so it works
foreign
concrete functions
what is this model
foreign
ly the converter can only
oh like okay of course rally is not
going to do anything because yeah
right because all the numbers that I'm
putting in are positive
um so we actually did manage to make
code that divides by two
and the only reason it divides by two is
because it's actually the identity it
just
doesn't uh
doesn't scale okay
you want to make code that divides by
four let's see if this works
it's called div 4.
so we have 48 I expect to see 12. 12. oh
actually this also check is the scale
right yeah notice how the scale is now
four so is this going to be 12.
no
great is there any difference between
day two and day four
I did compile it right
foreign
take some
George you need to work on your
infrastructure to start making stupid
typos it waste you hours yeah I know
okay
div 2 and div 4 are identical
which is interesting
all right it kind of makes sense
why is the name of this identity where's
it getting the word identity from I
don't like that
um I don't know if you want to try going
back to cross models
trust don't trust
let's go back to a cross model and I
believe
model model or does that just work
okay that just works
uh that's value let's do I can say
Lambda can I not
okay notice how the scales are invalid
model
oh
skipping because it's not built
because Lambda not allowed
Miami not allowed or because I didn't
compile the model
um Lambda not allowed
really loud though
all right let's look at the cross layers
and figure out which one we can use to
multiply by two
I mean we can use a down Slayer she's a
dance layer
it's gonna be big
oh but this now's weights
all right I see look now it's like
broken into two things because it has
weights now
it has two parts it's very complicated
now
just rail you uh doesn't do it unlock
like the scale is like uh
uh okay
leave a cross layer that just multiplies
by
two
how do I get that
oh TF variable I feel like is what we
needed
how does anybody use tensorflow
TF dot Matt oh here we go multiply is
this a layer
oh here we go now we're talking
multiply
it takes in a list of tensors all the
same shape and returns a single tensor
no that's not what you want
rescaling
hmm that's what we want okay let's try
that
two
it's going to multiply it by two
foreign
notice how the scale here is two
uh
at least it's not doing anything stupid
with okay it is the same size
so I actually expect this to be the
identity
right because the scale there is two
uh you know what we'll make it not the
identity
only go to 100 here and let's make sure
the scale stays one
[Music]
useless
all right let's confirm that this is
actually the identity so temp frog let's
say identity.com
uh let's go to simple we're going to run
the identity
actually it shouldn't be the other they
should actually divide by two I think
okay it divides by two okay
okay
um
diff
give two dot Coral identity.coil okay
there's no difference okay
copy identity got Coral over to div 2.
and now let's just try this this should
let's see if this actually divides by
four
I feel like something was going on weird
with the uh with that function thing
that hopefully doesn't happen now okay
so we're going to see a scale of four
yeah scale of four so wait now why did
that divide by two that doesn't make
sense
it should do nothing
there do two dot Coral div 4. Coral no
difference
no that doesn't make sense right
there's a way to force it not to scale
because that's just going to be annoying
to deal with
here we go
quantized input stats
instead of giving it a representative
data set what if I get rid of that
representation
and let's go back and multiply by two
let's see if we can actually make it
multiply by 2 without scale
for full integer quantization
I don't want it the quantization
problem probably wasn't the uh
function
so what if I have a plus one just why
does plus one not work
does that have scale
or probably just moves zero point
it has a tiny bit of scale
the same garbage okay I don't want these
things to scale
um
if I do that all right that's not going
to scale right
that should add one to f
uck I'm not happy about this
is there some way to tell the converter
not to uh not to scale
oh do we want to enable the experimental
new quantizer oh that sounds exciting
don't you love the tensorflow just
includes great options like this
all right what will make it not quantize
or should we just should we just go with
what we have and realize that all we can
do is like divide and shit
a working program and it's div two
as long as you want to divide by two we
have a choral program that can help you
out
reliably divides by two let's see what's
c0 divided by two
it's 60. wow what a reliable program
we can also do yes I mean by changing
the shape actually works
so change the size of the program no it
doesn't go
so let's see if this is give two
underscore 4. Coral
so this should actually behave the same
uh here but I should be able to put in
more things
you know what
does this even matter what if I put in
like some other stuff here
let's do 80 40.
okay divided all of them
is there two four any different
let's see identical programming okay
they're the same okay
so it looks like it doesn't matter and
we can put in we can put in eight things
and it divides them
okay actually if we put in the full
eight let's see if we can put in the
full eight
no we can't put in eight we can only put
in four that's great
um what if I change this to be eight
this program has to be different right
okay eight is different
oh lots of differences for eight
let's see if we can run that if it'll
actually do eight
cool
so that actually works
I don't know why I created therefore I
did four is garbage
div 2 and div 2 8 actually work they're
the only ones that work and
foreign
changes guys
this must be like the length of the loop
or something
how we doing on viewers are people
feeling this
400 500 something
all right people are kind of feeling
this
this is reverse engineering you know
why are you guys happy with reverse
engineering
all right if I start to hear you guys
going off topic on some bullshit again
uh we're gonna have to clamp down but
I don't think you'll do that I think
you're you're a good non-subscribers
yeah that's a contradiction man it's a
oxymoron
oh what are your thoughts on Masters and
phds oh any tips for bigot no no no no
no no the the misspelling of tips is the
reason we have to go back to subscribers
only
any tips
tips
yo bro bro sorry I am reverse 66 I'm
gonna rip on you come on my stream you
get ripped on uh
foreign
sometimes like I wonder are you trying
to be a meme are you trying to be a meme
like Leroy Jenkins you're trying to be a
meme
wow look that makes such a big change
all right guys as long as what you want
to do is divide by two we got you we got
a great program that divides by two
crypto Cod three thank you for gifting
Subs I appreciate you
uh do you have question
do you have a question
all right should we go through and
figure out which registers we actually
need and try to oh yeah yeah that's what
we're gonna do
we were going to start okay
yeah let's let's clean up let's clean up
this hot garbage right
um
foreign
first off
the request type is this I don't know
why some
B requests so that
oregano that's fine
data
as we do after include key rack here I
don't really understand why but okay
okay so if we change this to right
register
and we can say something like
SCU control zero or first
that's painful
for your parentheses
Piper
where
in right register
it's weird
why does it give me a piper
that's the exact same thing with this
one's oh I got okay I say I say there's
actually a one
here we go
okay so it looks like all the registers
that start with 1A have a one here and
all the registers that start with four
have a different
um how far have we come
well
uh we now have
wait what
hang on wait let me just I don't want to
know why did that work
this one
that works why doesn't this
I see you control three
can I make a typo
right now we're going through the rig
yeah we can reliably divide by two that
is the progress that we've made
um
so we're cleaning up or writing like a
really simple thing that's just going to
execute things it writes a whole bunch
of registers to the device and then it
downloads this little program
um then you send the program you send
the input data you get this confirmation
getting
status response
uh
yeah
and then you get the output tensor right
so
you see that this is what we're sending
and then this is what we're getting back
and it's just these numbers but divided
by two uh
it's a little Annoying to work through
all of like tensorflow's scaling stuff I
can't exactly figure out why like
it doesn't totally make sense that it
returns that it would make sense if it
returned divided by two
if the scale were
four
foreign
I told it to multiply by 2.
it would make sense if it actually just
wasn't compiling anything for the HTTP
regardless look we have this program
running it divides by two this is what
the program looks like
uh these are looks like to be hex 10 by
uh instructions
um and we know that the blue ones here
are bundle ALU move I thanks to the only
little piece of documentation we could
find on them
uh so that's kind of where we are there
now let's go through the registers and
figure out what the registers are
because there's an exciting register we
can read uh called PC
and
ah
I don't understand
why that doesn't work
should be the same as that right
did I break anything
do I just need a tiny sleep
foreign
that sure should be this right
5c zero two eight five fifty
just writes it right there I don't get
it
the one in there
I see you control three
same address
um what if I just write three does that
work
it doesn't like that one
can I remove this
oh I didn't need that in the first place
so we actually don't know if it's good
oh do I need to be there
it's probably right
okay okay cool
foreign
deep sleep
so we're moving them to this much more
legible python
okay
35 okay that's fine
uh we've got our Su control two
we have some documentation on what these
things actually are
um
foreign
but for now
let's get read register work
see if it has the same here we actually
still have those in Connect
uh yeah okay cool uh b-rack name and
we'll just say outline
foreign
let's just put them in there
all right now let's like read I see you
control
very excellent actually
uh why did it give me four and one four
oh
okay there we go cool
uh so when we read it we actually get
back something totally different
uh from when we wrote it but I don't
understand but why is that different
what
oh
is that the same thing we got when
you're out yeah that's right
um
so let's get let's move on to reading
cool registers
always my register list
current PC
Piper
oh
foreign
look at that
66.
I don't know what that means
but okay what this does tell us
is
we send the program
and then wherever we're waiting for the
input right because we haven't sent the
input yet once we send the input here
we're going to get something different I
think
yeah now we've moved on to 173.
cool once we send the input we get
something different right to how about
after we get the status response before
we get the output tensor
that's no different now how about after
you get the output tensor
check it out
okay so um for those that don't know uh
uh PC is program counter right which is
assumed like where we actually are in
the program so we're going to get a
debugger and then once we have a
debugger
uh we can do a lot of good stuff okay so
which program are you running running
div to eight
something like is it that has hex 420
did that make sense
maybe it's here
some of these things have to be like
interacting with the USB peripheral
right
um let's just see if we get any
different answers
a whole bunch of times
no all 66 is okay
but
foreign
I have this
[Music]
all right so it's 66 let's see about 173
is I mean I assume that it's times 10
right so that's ad0 so that's close to
the end of the program here
I would assume that that's right
so we waited to 420 and 80 0 have the
same 80 0 48
um
that doesn't actually need anything
though
because it could just be like already
loaded into the uh
420 is the only real weight instruction
here
okay let's Hot Patch the program
now let's see how it behaves differently
wow we broke the program boys
we broke the program
this does make me think that 66 is not
actually 420 because that seemed to
still be okay
66 is probably something else
[Applause]
all right so you guys know about
genomics and how they do knockout
studies on mice we're doing knockout
studies on programs you know we're
knocking out an instruction and seeing
what changes
um actually there might be some mode we
can put it in
where we uh
where we can single step
so let's take a look
just like some some of these functions
are called like execution mode
or there was a whole thing describing
this
here we go
PLL clock now that just enables like USB
5 garbage
set garbage clock speeds
um
here we go
oh
all this disabled stuff if you do have
the e-fuses
someone disable oh that'd be sad someone
disabled my great mode
uh is a register called e-fuse
if you use
here
uh it's gonna be in one
lucky fuse
oh I've got a underscore
okay
uh hex 20. so it doesn't look like
single steps disabled what is disabled
uh USB SSC mode is enabled and then this
is uh 48 I don't know some of those are
disabled but okay there's something in
here about single step let's figure out
how to turn it on
single link
single step
[Music]
to something called like execution mode
foreign
control
run control should change the Run States
Run state
that do run control oh here let's just
oh here we go
move to run move to Halt move to single
step oh oh you gotta love it oh you
gotta love it thanks Drake
um
right register
this is gonna be with a zero
fun control
single step mode
great did nothing
we did write it
you'll read it back and confirm
all zeros deuces
uh there's another one called like op
here on status
break points wow we can set break points
um here operon status oh ah break point
oh that's crazy
up run status zero uh
I don't know what if I set it here after
we send the program
nothing
oh
okay hang on
it might not be op run control we want
it might be like scalar core run control
or something
off doesn't even seem to be working
is there a scalar core run status
um
contextual csrs in the scalar
what's execute control maybe this is
better
resetting that
no we're not
you feed out feed parameter pop or on
control it's a lot of run controls fatal
error run control
foreign
let's try this
let's try FF FF should just like break
the whole thing right
foreign
notice how current PC stayed at zero
and now we're just blinking the light
power cycle
Master X100 instruction
because there might be a header we might
have like an off by one error here
no this might be a really
PC zero the whole time
code of this right right
oh no I didn't code this right
ah okay
we made it to 64 now if I do the offset
of a hundred
is there a header you like tells the
length or something
but we made it to there if I do 100 okay
so what if I do for 10.
and don't mess it up this time
PC is eight
interesting
okay so maybe you just multiply by two
does that fit with what we saw before
it's eight let's just let's mask the hex
20 instruction
asking
but we also don't know if like it's not
like going a few more
17 no it's kind of useless okay maybe
not
foreign
or something why are there multiple of
them
oh these are fake
what is execute control I feel like this
is
here's fall
foreign
K beagle scalar core CSR offsets
this thing's insanely complex
op enable tracing are these things ever
used
tile performance tracing
I mean that's what I was trying there
yeah but
it wasn't obvious
hmm
just insanely complicated
what hope do we have for us what hope do
we have
[Music]
hmm
construction queue
I tried changing that it just doesn't do
anything
it doesn't seem disabled or anything it
just doesn't do anything
uh
uh what are all these things that are
being enabled what is this
you're intentionally aimed to match the
gcsr register names
oh this is a pcie garbage
I forgot this chip has pcie as well
boot failures
bring until tile config zero
what's a tile
what's a hymn
this is more complex than the Apple
neural engine
okay
okay what if we make some guesses what
if we think that this instruction
is a knob is a loop forever right
wouldn't that make sense that's that's
what you made your program with
are there any other co0ofs in the
program
no
but every program seems to end with that
so let's just try it
let's try inserting it at places and
seeing what we get
um let's call this instruction end
and we'll manually add slash X says here
because we're lazy
all right colon
uh s
slash space slash slash slash X slash g
it looks good
all right let's go back to doing this
see what that does
no it's definitely a program
that gets to 17 which is actually where
it got to last time
to eight if I change that one
let's try let's try third
that does nothing
I think I'm actually doing that right
I'm inserting it correctly okay that
just doesn't seem to matter then maybe
that's a maybe there's a jump
actually one of the first instructions a
jump
okay
interesting
maybe that's a not maybe that's just not
a not a real instruction
it's definitely not an fpga config file
this is definitely a sequentially
executing program
okay it gets to 47 if I do that
enabling the single step step stuff
would be a big one we can figure out how
to do that
foreign
driver bug report for scalar core
it would make sense to me that
scalar core run control scalar core
breakpoint
all zeros
which I want that
Pi power okay that doesn't work
Force
well it's got to be
foreign
the context can't this isn't real
if you look at SC memory access SC data
maybe I have to enable something for
well zeros
debug CSR
okay
there's tile also
instruction queue
I don't know why don't we look at the
instruction queue size because any
instruction queue size
uh the ones that begin with before are
the ones that we put uh
zero yeah
no instruction queue size
I really seem to do anything
um we have more information on these
okay method select
thermal warning now it's really boring
more thermal worn in garbage
okay maybe we go through these and we
try knocking them out and seeing which
ones we don't need
oh actually what are these SCU controls
it seems like there's a lot of stuff
there what is an SCU
programming the SEO
indigo
a block containing the state machines to
control Boot and power sequences
PLL clock single exit single link sleep
check
think it's any of those
bunch of boring resets
to do with that okay
okay
um
if ragnum
this one
foreign
cool
foreign
control
foreign
these from here
it still works now here's a question
what if I don't ride scale or uncontrol
it still work
it doesn't
so you did have to write that that
didn't matter
um what if instead of writing one we
write three
which should be single step
hmm okay
so if we write single step instead of
writing uh
instead of writing one
it doesn't work
so that's good maybe you can only write
scalar core and control once now let's
just figure out how to use the single
step mode
okay move to idle K move to run
came off to Halt came over to single
step okay
it's used anywhere
you need a logic here for single
stepping
what if I do that does that work
that works fine
if I do that
that works fine too interesting
I do that
doesn't work
how do I trigger the single step
move to single step okay it's possible
that I like send this
see if PC changes at all
uh
what'd you find yeah I know there's like
no information on this thing
yeah I saw this this is not yeah I read
that
here's like normal
for nugget
um okay we're putting the core in single
step mode now that seems to be working
now how do I actually uh
table idle register blah blah blah blah
enable reset
boring boring boring boring enable
actual sleep mode
maybe something in the section
describing interrupts where are the
interrupts
I want to like say step how do I say
step
can I check run status and like does it
work
oh we have a run status now four
what's four
K halted
why did it go into K single step
okay
now the status is zero what zero is the
status
K idle
oh I have an idea okay what if I don't
set anything control what does it do
nothing
can I download the program
foreign
this downloads the program
download the program
and then run it
does that work
okay that works
uh what happens if I check the status
there what do I get
ah one okay one is k run now if I change
this to this we'll go into K single step
come on three
four
let me double check on that effus that
single steps not disabled
[Music]
is that what that bit field means
because that'd be really annoying like
if it was like actually that just might
be single step disabled
well that sucks
but it's cool that we can uh
it's possible it's just disabled it
should just suck
all right like depending on the
endginess of that you see what I'm
saying
uh
all right what if I tell it to Halt
really fast what I got
still makes it to 66 and now I'm in
status three
okay holding
a few more
halting very slow holding very slow
ice cream
I'll be back one minute twitchies
gang
all right so that's sad when we put it
in single step mode it actually just
goes into halted mode
which is uh very depressing
but it does run which is good
I think it's just disabled
foreign
no moving to idle doesn't work
but moving to Halt does
okay now it halts at 66.
even after I send the stuff
foreign
yeah I think it's uh
disabled at a hardware level no the
e-fuse
I mean it would make sense for them to
disable it right this is the exact sort
of thing they you know maybe don't want
us doing
like I think I just read it wrong right
because like if you assume that it's
like big NDM the first
uh by zero which says that it's disabled
okay I mean there is hope there's also
break points
we can try that
okay scalar core break point what do you
think
oh
Skillet core run status wait no no
that's just the halted garbage
seems like break points are broken as
well
once you get this four out of this
oh
weird
so if I set it to one
it halts
maybe that's like an enable
aha
look at that okay now current PC is one
so if we assume that scalar core break
point like the first bit is whether it's
enabled and then the second bit is where
it actually gets to right
so you have to like shift it over one
you see what I'm saying
uh let me just
so if I do something like Q of um we
want to do like 20
shift shift left one or one
all right this should stop at PC 20. oh
yeah buddy
all right we got some break points work
[Music]
foreign
so they disabled single stepping oh they
got us but they didn't disable break
points
now can I undisable the breakpoint let's
try that
QR code run status is three objective
intestinal land
okay we write scale core break point but
now let's set it run again
on set
three points
okay
well that sucks
as we're in that state it doesn't seem
like we can get
out of it even if we disable the
breakpoint
yeah so it's in this like halting state
is what it says
is there a delay needed
oh yeah
it's very fast I haven't had any delays
for anything
uh but okay that's interesting that that
gets to 20 right
so whatever it is we have a the break
points are working
I'm also a little worried that this
thing is a scalar core like where are
these other cores
uh
uh drag scalar
wait like what's a TTU breakpoint
activation it's all scary man
how to wait until halted oh you think
you think if I just wait it'll
eventually halt
I think so I think it just stays in this
faulting state
we can wait a bit but
no it's all threes
well actually here's something
interesting
when I reset it it works
right like when I run it again now
we can repeat the same thing
which means that like something we're
doing has to
has to reset it
oh we're actually calling USB reset no
no we're we're breaking the matter
um
but mine is launch time you know that's
a good question
zeros
all right here's a fun fact let's try to
set the breakpoint to like six let's set
it to like 70 or 80 80 is good
okay as long as we don't hit the break
point it's fine
see if we hit the breakpoint now yeah we
do like we hit it 80.
[Music]
how do we resume
maybe execute control
what is execute control
do we sell it to anything
it seems like
anything about it I don't know I'm gonna
just try poking one and execute control
and see if it works
wait
oh no I have a very close to let 80.
foreign
State around and execute control
I mean okay exit your control lets me
read and write it
ah
scanner core run status
okay I have an idea
what if I set that back to zero
no still threes
um
still threes
it makes sense that you poke the Run
control right
there is a question of yeah why is it in
a halting state and not how about
resetting all the initial registers I
don't think it's any of these
ah
I mean okay what's the idle register
it's the only one that like sticks out
of me
there's a whole debugger in this thing
look forward and control scalar core run
status scalar core breakpoint
okay move to halt
okay move to run
I actually like clear the interrupt do I
not
what are the register to talk about
interrupts
foreign
[Music]
no
no fatal error interrupt
uh host and
top level eight
foreign
the reason I don't think that the
register thing is going to work is
because the I'm actually issuing a USB
reset
uh here
and that's what's fixing it not anything
else
should order lunch
foreign
you guys feeling this stream
is this exciting
I don't know
the thing is the stuff's like addictive
and it never gets you anywhere
let's check error scalar core
I feel like we have to clear some
interrupt and then on set the right
point
no error scalar core
[Music]
I will let everyone talk for a little
bit yo chill guys if you start talking
about dumb shit
uh okay that's in the Hib
I don't think it's in the Hib
iscus
[Music]
uh
let me put tracing
a bunch of counters
uh SC hosts
should I check that one already
the host and status
I don't think it's cue and control well
why do you think it's the queue
I mean it's possible that it's some
undefined thing in run control
like it's something like we have to send
in like five or something
no it wasn't that but you know what I
mean
it's like something like that like when
it hits the break point
can someone give him a summary
I gotta find my phone and we gotta order
um
foreign
can I make a memory dump ah
I mean it's not a bad thought I don't
really even know how to do that
like you just send in the data you just
send in the program to like some USB
endpoint
and it just kind of runs at
oh man you know I check an email I get
some emails that piss me off man
you know some like corporate governance
shit
look you know I think that people took
this also like like Fuck The Verge man
that article is completely wrong uh you
know but hey man done in Kruger or
whatever uh
alter four doesn't work on Mac bro
foreign
you know like I'm just I'm so much
happier doing this
than like these are the forms for the
employee health plan oh
you know
we got some avocado toast some asshole
you've all come and
uh there's a line in a Watsky song I'm
done being a bitch to ambition I'm
already rich
you know
God I had this full of million dollar
questions and the length of this I don't
need the courage to work I want the
strength to quit
uh
what guys there's a great team at comma
you know uh I'm sick of Silence man
we pop out of your party I'm with the
gang and it's gonna be a robbery so tuck
your chain
who else hates the media man
journalists
instruction cue control okay that's four
and it's still four so that's not that
useful
oh
run status is four
that's halted
and then it goes to like kind of halting
oh that's instruction Q control let's
read instruction queue status
goes from zero to zero great useless
uh deploy lawyers on the verge
look I told the guy to call me
call me shit and he's like
so I don't care man all press is good
press kids so if you want to see me gone
then I suggest you keep my name out of
your headlines
all right
how could I be with be without your hate
it gives me peace of mind
I love that song
[Music]
will Google TPU support really move Tiny
grad forward ah
oh oh you Progressive piece of shit man
moving forward we gotta move the world
forward man you're moving the world
forward bro
wig history no
um
docking Stones you're right you're right
oh man you know
some people like believe the media
and they're looking at Apple silicon oh
we're looking at applesauce that's not a
forward-looking statement guys
you know all these
is the reason I don't want to do this
anymore like
I I told you it really is about the
users it really is about like
like
and I'm not really that different I I
use the same when I use consumer
electronics but
uh
no are you looking at are you looking at
it yeah you can read my comments and
look at that you know I'm looking at a
lot of things right like I'm running my
M1 right now
like it's not like this stuff matters
okay like
oh
I don't want to go do I want to like
tell you all something real
um
real
where is my
oh
instruction cue in status that that
seems hopeful right
there's some bit being said
you wanna just dump all the registers
we could just dump them all
uh yeah be careful with your wording
that's right now look like
I think we got to go back to subscriber
only
subscribers have all figured out how not
to trigger me man
should jump all the registers
oh wait
you know what occurs to me
current PC
can I set it
we were always trying to we were always
trying to uh
excited for 21.
no
I can't set it
what if I set it and then I read it
foreign
do you remember on the stream when we
talk about how we're not doing anything
like we're not doing any like like it
would just like like what are you trying
to accomplish right like this whole way
of thinking like we're we're learning
man but that even like that's even like
oh you're trying to accomplish learning
oh let me find the most efficient way to
learn
uh yeah we're just yeah we're just Vibe
man
die
die
ah
what's the hip
oh wait this is cool
scalar register file
but this is exciting
does this let me dump all the registers
all right let's go inside your bread
points for now
let's just run it
oh look at that
um
can I read more
of course not
but like this is a setting of a scalar
register ah
no they're just controversy circles me
so it seems like the media immediately
uh let's let's just add a flag to read
register called offset
is that gonna show me another register
the same register
well actually I don't know if that's the
same registered
let's try a little bit
um
is that a special value I've ever seen
that before
it's actually sending that or did I did
I mess up
um oh it looks like Greg numbs what's
actually sent
yeah PC goes to 173 and we don't stop
which like again it's not the end of
this program
um
you know if we multiply 173 by 10 we get
80 0 which is here
maybe that's the halt instruction
and those are just knobs and that's like
some weird preamble
all right let's do a little surgery let
me let me try something
try Prague equals frogs uh
first off
if that's true
then we shouldn't need anything after
that right so let's make a slightly
shorter program
that didn't work
380 Channel points on that bro
uh
all right I'm a little bit upset I was
more excited when I thought I was
actually going to read me a whole
register file but it actually just reads
me one register
um
as you can see
the more you fuck around
the more you're gonna find out
and also if you stay down here and you
never fuck around
you'll never find out so I hope this
lesson is helpful
oh wait it's dead beef
[Music]
oh that's cool
foreign
it's not
it's not that oh I don't know actually
maybe that's a halt instruction oh let's
let's send this here
and all the same
hmm
let me just see did I did I mess up the
offset thing
no that looks fine
and then for some reason
so where did we try to clamp the program
if we do that it doesn't work at all but
so there's like a length the program has
to be maybe uh
times times
[Music]
foreign
that's so weird
so
if I get rid of the end of the program
just this end part here
it uh
doesn't even run at all
do I mean I get to my break point at 20
can I get to my break point of 20.
which is weird
it's the last thing I can check some or
something
[Music]
foreign
copying the last few bytes exactly they
are
foreign
oh no
let's try some
try that
okay well that just breaks it entirely
what if I just take away the last text
breaks it entirely
foreign
doing anything stupid right like this
should work
I don't know let's try surgically
removing the stuff at export
foreign
so what if I add
another one of these ends to it
that works and that's get that used to
be 173 right
interesting
oh is that what you're saying oh
so what if I do something like this but
instead do like M times five
let me see if that works
interesting okay
let's Chomp back further
weird
so it behaves differently look
it goes to 184 and it keeps the light
blinking so that last instruction must
be to turn things off
and I don't really understand why this
like footer needs to be there but
whatever it's something that makes the
USB happy okay this
is the real
um
call this pad
uh
for uh let's see let's just write a
quick function called Fix x dot split
uh
uh
O X Plus X
second
or x and x dot splat
spikes
still works uh let's go here and let's
put end pad 5.
well that's the same program so that
doesn't actually change anything okay
cool uh let's add one more and earlier
now my prediction is that this is going
to get to 172.
yeah 172. take a look
now it didn't actually reply with
anything because that other that
penultimate instruction had to have been
important as well
this instruction
oh but we're getting somewhere
it's 173 just the length of the program
no it's not the length of the program
okay so hang on let me modify this a
tiny bit
uh
foreign
okay
568.
is that what we expect to see
foreign
by 10
I want to multiply by eight why don't
you guys yell at me George why'd you
multiply it by eight you have to
multiply by X ten okay good
okay now we know where we're getting to
in the program and the program is
stopping here at ad0
uh
just for the fun of it let's set a uh
break points
at well what happens if I set the
breakpoint at 80 0 over 8. that's
actually going to get hit
um
you can also read this
actually that's not it's at the right
Point Let's see okay
it's killer core run status zero which
is Idle now if I set a break point I
expect that the light's going to keep
blinking
no breakpoint did nothing okay let's set
the 3.1 before that
ah did I not do my parents right I'm
just not enough
uh let's try a0
nothing interesting so if I break point
back at 20.
if you see gets Stitch one
guys I wrote divided by eight again
don't let me write this
their hex 10 instructions
notice that wait did the light stay on
last time too
same
okay there we go now it's different all
right because now we're getting a four
there which means it didn't actually get
to that instruction
um so maybe this isn't actually the
whole construction maybe this is the
whole Construction
uh but it's interesting that that one's
different okay that PC basically stops
uh at 80 zero it stops here
um so if I set breakpoints after that
they don't do anything
I don't exactly understand why things
have to be yeah stop dividing away right
I don't exactly understand why things
have to be padded the way they do
too bad dumping the register file
doesn't work well you know what that
might be that again might be bullshit
where it's like stop you're right it is
dead beef right like what if they
disabled it let's go back to that e-fuse
register and see what else they could
disable why would I disable my single
step
or do we just not know how to use it
this is disabled mbist is disabled
I think single I don't know I don't
actually know if single steps disabled
but like we're making some good progress
now
more here so you want to try something
like this
that could actually just be anything I
don't know useless
here
um
almost here
they get a tip if they bring it to my
door they don't get a tip if they don't
bring it to my bar am I an unreasonable
terrible person for that
well I wouldn't care if I was
unreasonable because I'm doing it anyway
no tips all the time that's that's bold
bro that's bold I I can respect that too
I like a tip to be for performance if I
have to come down to the street and meet
you there's no fucking way you're
getting a tip
I don't like that it tries to get you to
put the tip beforehand yeah it's a good
service I think that's right
uh like bringing it to my door
and have clear instructions about how to
get into my apartment and bring the
thing exactly
[Music]
wow there's so many things
AV data parameter in feed out feed
I feel like we're not gonna really like
make too much progress on this unless we
like
[Music]
spend a ton of time
okay this is the compiler that's capable
of outputting these things so all the
secrets do lie in this thing
invitation
I don't know what a dwl is
this is this is the compiler this is The
Edge uh Edge TPU compiler
that outputs these things
okay here's an idea I'm I'm running out
of uh
sometimes what you hope is that people
left good stuff in older versions of
things
so let's find the old version
can we pause the compiler uh we I mean
we can get to actively
we can get to doing uh like Dynamic
analysis on the compiler too
but again there's a question of how far
we want to go with this
all right all right the tips thing yeah
yeah we got we got to go back there
um
let's take a look here
something called Pi Coral
which is a whole other thing and there's
a chance it's just looking here maybe
there's magical documentation in here
just imagine those magical documentation
in here
bundle
Ben Live Edge TPU okay there's just the
build ones
no no no no lip Coral oh is that a model
what's lib Coral
convenience function
on device transfer learning
that
it's called My Foods here
sad looking avocado toast let's see
foreign
that's taking forever
foreign
what do you think I am made of uh
check lib
maybe there's some hope in lip Coral
pie Coral seems useless
Live Edge TPU in there
bundle ALU move I
some of these things are used
this links in that address it doesn't
really show me anything good
bundle ALU move I
man
why doesn't Google just released this
foreign
[Music]
deep in here is like the IR
and the whole representation of all this
stuff
like we know that that instruction is a
move I and move I doesn't even exist in
here
laughs
[Music]
full power of the edge GPU
all
four tire flops
foreign
foreign
there are older versions of a compiler
than the one in this repo
actually it's unclear if they were ever
released openly though
it's crazy that the older compilers are
way smaller
go back to the old one
see how different the card looks
still work
okay well we get internal compiler error
aborting
it wasn't capable of uh
piling that very difficult times too
[Music]
what's team off
do we still have Team off
team while it's gone
where's my here it is
import file
s
carbs and sugar
foreign
can you overclock it you can uh yeah
there's two things you can do yeah I
mean I'm sure I could off the clock
speeds
they also create two versions of the
binary
one throttled and one not throttled
question
how many people were on the team at
Google that made this thing
I don't think it was five
so I have another idea too
um there's
this is what the real uh
TPU
like
if I just have this
this is the vliw instruction for the big
TPU
all I need is this but for the little
TPO
because without this it's really hard
like I'm I'm staring these instructions
and like we can try twiddling the bits
and seeing what we get
but
without having an idea even if like
which parts apply to which parts
so this thing has multiple units right
the units are all listed in in Edge TPU
um
like it has a scalar unit and it
PTU the big tf1 has a TTU as well I'd
love to know what a TTU is
a woodwork
um
our driver for the big TPU but the
problem is you can't buy them
oh
I mean this is interesting it does seem
like there's
it does seem like there's other uh
strings in here
cannot match Hardware TTU configuration
I I think Gigi is a generic acronym
man imagine when you Googled you didn't
find
nothing
nothing linear
operations research sat
okay it has a built-in sat solver that's
great
we have to find the one they
accidentally built with all the debug
symbols
all right
I don't know
you know what's nice about reverse
engineering this
it has no value to any nation state
that's what made like the iPhone and the
web browser stuff shitty
because it actually had like value
a two time scale update no I don't think
it's that it doesn't seem right
what
do the non-subscribers have any useful
insights
the thing has an entire code generator
I need to disassembler
there's an old arm 64 compiler on their
GitHub
yeah you think that's better
um
I mean I don't understand why I dropped
orange 64 so far
yeah it is somewhat interesting they
removed it okay
let's take a look
so you see if I go back to deploria two
in Arab 64.
oh
my God
take a look at that one
maybe there's secrets in it
maybe it's just more readable
like this one's just hard to read
that move eyes the best thing I've seen
you just need more things like that
it's not even going to be like leaks of
this stuff you know one of those
Qualcomm is always leaks
because it's given to Partners Google
didn't give this to anybody
no the arm one looks the same
we wasted a lot of time on this compiler
yesterday and we made no progress
you know I'd say this code is obfuscated
but it's actually probably just written
in
C plus plus
which is there really a difference
none of these are
inspect guys
did I try searching for it in strings
um
I mean yeah we're looking through the
strings I don't know I kind of feel like
this compiler is a dead end
like it contains all the secrets but
good luck getting them out
I generally find Black Box stuff is uh
better
at least if you have a fixed amount of
time
I'm sure you get like the last bit of
everything
imagine the air conditioning it's cold
but
um
foreign
[Applause]
you're hungry see a vibester thanks for
your help
just fuzz the device to get the
instructions set well
the problem is the instructions are
really long
we have one instruction figured out into
this one
and this one is a
ALU move I
these are interesting
you know what these are I know what
these are
that is a
it's like minus one right so at least we
can tell kind of what the groupings are
the dkms drivers
I doubt it
well hmm okay
good find yeah no they're not totally
useless so
I think these are the registers
these are the same registers right
if we take a look
they call them bar two
but I think like they're the same
registers as as these right
if we look at something like um
right so like yeah D4 years
kind of interesting too that they have
more e-fuses
you see how you just Maps it literally
with a computer
foreign
yeah make multiple TF light files and
dip the output so
we did that
like
I have a whole thing to do that and this
is this is how I made progress with the
uh
but the Apple neural engine
the problem here is like we have this
huge amount of boilerplate
now until we make some progress
understanding what this boilerplate is I
feel that
um
maybe it doesn't
maybe I just shouldn't care
I mean okay here's something we can do
um that sounds annoying
foreign
three one works you want to try emailing
these guys maybe they want to give us
some documentation
yo Bros can I have some documentation
I'm trying to use the coral chip
oh good this one doesn't right away
crash
B
wait this is shorter
just this one's still like did I leave
the eight in there
yeah generate something totally
different
not totally different just off by one
okay
this old version thing doesn't seem like
a good use of time
uh
it gets annoying also like something I
didn't want to have to deal with 9jtech
another reason I don't just want to
start
I guess we could do all the scalar ones
but the scalar ones aren't that
different
um
because if you start adding in weights
comes a lot
like okay what if I do times two plus
one
don't think it is that
like there is a risk core on the chip
call this mall to add one dot core
foreign
[Music]
foreign
so another problem with this is these
tensorflow things don't actually
they don't actually like map
exactly because these scale things and
we'd have to like figure all that out
okay well this like added something
all right you want to compare
multi add 10 with divto
compare with dip28
okay
oh
well okay we learned something
look at this
that's the length
it's interesting you have to multiply
that by four tail which tells you
something about the offsets
look at that that's the length of the
coat
I must like set up the scalar chord or
run that and that's why we were having
trouble every time we were changing the
length
or that's just some header that has
nothing to do with the code
no but it's an instruction
I don't think it's a header
I mean it's possible it's like a jump
doesn't seem right
yeah it must like command the scalar
core into uh
I would still end with that same
preamble
probably like work on like trying to do
like alignment you know
there's like good compare tools to do
this for you if they're not
okay like look this is just that right
you can go back even further
c-o-b-b is just that
yeah so it's like this is what was
inserted
like that's a block that does uh that
does the ad
well that's a lot of code to do an ad
see this look look I had literally one
ad I added an ad and it added all this
code
um though it's possible it has to do
with the scaling
thank you
so
yeah there's so much complexity here
those are different
it was good because they don't look
different
oh the end once
the end ones are different
um
do you really still get dead beef when
we dump those registers
foreign
there's other register files too to try
predicate register file
also good beef
hmm
I wonder if you do this up here
interesting
foreign
maybe you just can't read them while
it's running
all right
you read them before you're running you
get nothing if you read them here you
get dead beef what if I set a breakpoint
so you have 80.
no
yeah if you add show operations so I
actually already have that it's also
just dash s
uh it's just this
like this
foreign
wait here's an idea
what if I hold the core
we never tried that
okay
we kind of halt the core after I hit a
break point
where does that just get stuck on
oh guys
guys look at that wait hang on
look at that four
we read something from the register file
we halted the Chip And we read something
from the register file watch this I have
an idea now
foreign
think that if I set some of those here
let's try like so Set uh 49.
x49
go like some AA there
mm-hmm
come on a a show up in one of the
registers
oh
jackpot
jackpot we dumped the register all right
all right are you ready to get control
over the scalar unit
the break point puts it into some weird
state but if I manually halt the core
foreign
and that's register one
right prediction you want to change this
one
if I set register two it'll change that
one
so this is a scalar load
well move on ALU move I
but it set this register and we can now
dump it now that we alt the core
the core is getting stuck in that
halted in that state with the break
point
cool so something else must be setting
this to four by the time we get to pc420
um
so let's see if we can find what sets it
to four
well which register is that first of all
that's register
48 divided by 8.
nine
and PC gets to 420.
look it's here so what's hitting
register nine
maybe this one
there's nine oh and there's the four
so this
is a setting register nine
these load into register zero one two
three
all right I think that's pretty good
progress for today
um I think the next things to do would
be to start breaking down
okay there's a lot we can do with with
just what we have
um we can work out for example the
length of the register so the fact that
there's 20 registers tells us something
about uh
about the bytes and the fact that this
one is supposed to go to bit 0.75
again I don't know if the bits are Big
Andy and a little Indian
ah
well okay how many registers are there
there's
32 registers
so that's represented by five bits
you see what I mean like we could figure
we could start figuring out like which
bits correspond to which thing
um these ones why didn't these loads
happen
right how come these loads didn't show
up in the uh
oh those might not be loads
right because those are bees there those
might not be loads
um it seems like everything in these
instructions is bit packed as well
so we'll have to start looking at what
the bits are
uh
try just for fun let's try what if I put
more AAS
uh okay
so that's interesting right it looks
like the register is not
it looks like it's only uh 32 bits
despite it reading more well maybe you
can't actually read more or maybe that's
the next register
no that one's called one
modified this as well
foreign
set there but not all the uh bits are
getting through
maybe for skillers if I actually only
read four
not bus error no all right
oh
with those ones always there
one of them was oh it must be some
so this must be some function of uh
of these
and figure out which is doing it
A8 divided by eight
Twenty One
so 15 so if we go back to this we find
like which one of these has a five
maybe this one
yeah but this stuff
is controlling the scalar unit and those
are move eyes
so we could
figure out how the whole scalar unit
works
then we can start figuring out how the
other units work
they weren't there when I only had the
AAA well no one of them was all right I
went back all right so if we go here
where I only had the AAA just that one
gets set and then this one gets set if I
set the BBS there
uh so those are just some like function
of the
thing oh you know what's possible
um
let me try something
it's too bad we can't I'm gonna make the
break points work
uh okay so PC is only getting to 80 now
because we put the uh we put it right
there
so now we we basically stop the program
here
which is fine uh
I assume that this is not
and do something like frog equals Prague
I think we need the header
then maybe we can put in three knobs
oh
no this is uh
this is something else
because we're stopping the program here
now and we're still getting this
Behavior
right that's just those just just this
so it must have to do with the fact that
I have more A's and B's and stuff
what if I set those to zero so these
ones Gonna Change
yeah look they don't do it now
so that must be some other weird stuff
uh
that thing describes the format yeah I'm
already parsing that I'm already
completely parsing that you you get out
a blob uh you get out like a like a
binary blob
um
yeah but you see now now look I'm only
running this program here
uh
uh and it's loading in these registers
so that works
yeah uh I'll show you look I actually
have this in in my thing the thing that
actually matters is
an instruction bitstream this
encoded bitstream for a real Hardware
uh is where it matters
okay so I think the thing that we'd want
to do is completely characterize the
scalar unit
by playing with the different things and
seeing what different behaviors we get
right there's only so many things that a
scalar unit can do there are there is
documentation is it is the the TPU and
Edge TPU do seem to share quite a bit
um
no there's like better ones of these
yeah I didn't do that on stream I did
that last night
each TPU core has three types of
processing well I'm here we can look oh
you know maybe maybe they're maybe
they're the same
we'll see like how much is taken from
the TPU right so like
here's their scalar unit right
um they have uh
Y X desktop so I bet these are very
similar
uh and then also have a predicate
there might even be two scalar units
uh there's also yeah like this is an
immediate
I can tell that the program's much
shorter
this seems to be some like
initialization for the instruction unit
because we need it if we get rid of it
it doesn't run anymore
um but like here
we can try some targeted shit like
let's just get rid of that two there see
if it still works
um no it doesn't work
I wonder if it verifies that that thing
actually contains
it might verify that it actually because
I when I try removing this thing
it might actually verify that that
things they are uh you know what okay
let's go back to doing that
and then let's replace the whole rest of
the program
like you know the knob sliders
give me instructions are there
more than 28.
spam end everywhere though right
uh
it's like maybe
work
um no
she doesn't look right
this is not the program oh
doesn't run uh
no it's
it's pad it's the actual last thing that
matters this one
I called it pad I didn't mean to call it
let's do Prague plus n followed by a lot
of paths
okay that runs cool
uh now I should be able to surgically
remove that top zero
okay that works cool
um so that's the length and it just has
to detect this has to be at the end of
it right and you can see the kind of
symmetry there right
this is the beginning uh
This Is the End
so there we go that's a program that
we're currently executing
on the edge dtp here it's a custom
program that we wrote
and then we read from the scalar
register file
and we confirm that our load eyes
actually worked
okay so the next thing to do is to start
to figure out the the bit layout of the
instruction
characterize the scalar unit
and then we can disassemble all the
scalar instructions that we have
does this sound fun guys does this sound
fun
all right we got a lot of viewers all
right that sounds fun then
all right
I gotta I gotta stretch a little gonna
chill for a little bit
because we're undertaking a large
endeavor
foreign
[Music]
thank you
[Music]
[Music]
thank you
[Music]
[Music]
thank you
[Music]
thank you
[Music]
ah
there's a tiny Core Power of our
personal feel good coach yo you know
what I realized but Frank gave me some
real insight into something
everyone whose life says that they're a
life coach and shit that's just a
euphemism for hooker man
why you got all these pretty girls and
they're life coaches it was like
paying you who's paying you to be a life
coach right like like
hey look look I'm not not no disrespect
no disrespect but like come on
and then I realized it they're hookers
and then it all made sense
no pro life coaches are real profession
bro
foreign
we have to find something good in Python
that manipulates bit fields
uh I'm eating some coffee too let me get
some coffee I'm done with the Celsius
crap man you know that you know I know
I'm not sponsored like why I took this
crap man look at this we fit
the door you must watch the new Yo the
new White Lotus you guys you see the new
White Lotus I love that I love that but
like the world's ending oh don't be
silly the world's not ending we don't
even watch the news they're just trying
to like get you caught up in their
apocalyptic soap opera
thank you
foreign
for blue checks not a smart move
bit struck is this
is this what I want
they're just hookers man
you guys know what I want like I feel
like I've seen this in Python before
maybe someone knows like I want
something that can do like strokes but
it's a bit level
python of a bit field type
C types bitter Ray was the best answer I
found
which efficiently represents an array of
booleans
including slice assignment and deletion
bit vector
numpy has an array interface if your bit
field is short you can probably use a
struct module
no
no
[Music]
range set
cat eye
a new way to develop parsers for binary
structures
this looks way too heavyweight
I need a struct compiler
like yeah it's really good but
they're almost like this
let's do this uses C types
um okay
decompiler dot Pi let's go
no more promises
[Music]
who wants to listen to copyrighted music
is it copyrighted music time
you know Taylor Swift is super
copyrighted there's no way we can listen
to Taylor Swift
well Taylor Swift herself will come be
upset with me if he doesn't do our
copyright music on stream
uh Kanye might not Kanye might be like
bro bro you still bumping Kanye oh
that's cool bro that's cool bro I'm
Kanye too man
welcome to one of my parties sometime yo
we just listened to my music
all we do is listen to my music
uh bites to it
a little
okay
um
who said you won't need your times
tables later in life
whoever told you that
they were a liar
liar if I knew my times tables I could
have done that math in my head
unfortunately
I didn't pay attention in elementary
school
and now I don't know my times tables
so that's a lesson kids that's so
awesome
[Music]
number of bits invalid for bit fields
oh no
no
okay good
okay it's like five
all this I should steal the names from
uh
another one here
called like S1 X or something
then we have immediate uh
call that punk zero
we'll have another one called ank zero
here
um where we go
three and then immediate and that's 32.
um and then we gotta make sure this all
adds up
I wish I could go back to college
in college You Know Who You Are
that's kind of lame
what didn't even work
oh I guess we gotta do uh inch shot from
fighting stats of I my plus ten
uh little it's a little or big
off the beginning right there all right
argument out of range
don't argue with me out of range hunt
oh what is this
well that's not right
um
oh no we got a keyboard question gotta
go back
and you guys are talking about some like
BlackRock conspiracy theories
uh pack into format buffer and write the
pack buff so I'm here to blah blah blah
blah blah
oh that's not really right
um
no how do I get stuff with a bigger size
foreign
is that none of this supports large
enough things
and I have an idea that that one spans
across maybe it doesn't
not happy about this
not happy about this
python bit structure
no okay actually I think there's an easy
way to do this
I think instead of saying struck pack
into
uh there's just a buffer right
so I can like mem copy it
no uh what is packing to do
writable buffer starting a position
offset uh for J and range 10.
uh CS sub J equals
instructors not support item assignment
it's a writable buffer is it not
right software
oh you're looking for construct what is
this
collaboration I don't like that already
[Music]
this thing looks very heavyweight
I mean I know that's kind of cool I
ah
declarative
bit by duality
oh that's kind of cool all right uh
we're gonna give this a try
hip install construct
um
foreign
I think oh I'm very excited I hope this
works come on
uh
uh don't forget that's fine
work
transformed struct
Ure Double D bees oh yeah all right
that's something
um
thank you thank you for the suggestion
on construct this looks good
oh sorry I can't type
okay
um this is not what I want though this
is wrong
let me be ending in this backward or
something
right because that should be 60 to there
and then it should be as zero should be
like one two three
but I'm sure that way to flipped them
bit strikes are not nestable
[Music]
feels it can do both
okay there's some reason I put it in Ark
which probably is not right
60. no that's not what I want
the ending this is like
okay I mean this is a more fundamental
issue
it's backwards but then we have to like
do it all backwards
yeah okay you see the problem
it's like backwards we have to do it
backwards
so it actually looks more like this
there you go okay another right place
um
how did I write it for the TPU one
and I'm just I'm kind of just guessing
there but
and then we know something about this as
well
uh we know that that's a length and we
know that that corresponds
uh
two C4 we have to multiply that by four
which means
we just have to go a few more there okay
so if that's five
I wonder how big that can get I can
probably get really big
foreign
backwards okay so if that's gonna be
four then that's gonna have that many
there so that's
plus 6 is 22.
um
okay and then this is going to be 60
minus 32 minus 22.
so what's that leave us with
I don't want to start the whole thing
adds up
is there a way to do that
uh size off
it'd be nice if that was in uh bits but
it's all settled
B10 okay
so that works
um
now we can start writing our own
programs
uh yeah so the field offset I the field
offset is how I get the blue ones
um I have some information from that
so if we say something like ins uh
zero equals
it's interesting how the sizes B10
which is actually minus two okay
say m size equals x30
this form object is not callable uh dot
build
uh missing one required visual argument
on it
I'll just be a dictionary
foreign
we have to assign them all
I want them automatically done uh
collections
let's write this generically this is
python magic guys this is what you come
here for from collections
or default addict we're going to throw a
default depth
zero
X or
foreign
[Music]
let's also include a move instruction
foreign
foreign
ER
it was a poorly named thing
uh
does that not work
what up train
um a little bit more
what's up
we have a limited time to learn
exclusive emotes guys get in here get me
emotes I don't know what emotes are but
do I like them
do I like them will make me more famous
get me more women on Instagram okay
that's what we're really in this for
guys you know you think you waste your
time running bow hunting skills or
nunchuck skills or computer hacking
skills if it wasn't for women on
Instagram
who had that in their bingo card
no no no no no no no no
oh that's okay wait sorry I'm getting
my program
s okay
uh
now we can put in exactly one
instruction
oh we won't put in the halt instruction
George why don't you just use a for Loop
why are you doing that by hand why are
you doing that by hand you could just
use a for Loop you know
yeah okay this one
start
s
pulse
40 Maybe
you'll know it's possible that's just a
number of instructions as well
which has nothing to do with this
but uh
uh
foreign
this one here
204 h
scalar
is uh
okay we have a compiler now
uh let's run this program
we're doing all sorts of junk to the
programs coming all that out
more junk
there we go
and that's loading in the scalar
register file
um loading in one
let's now
if I set this to like 30 it's not going
to work right
yeah it breaks apart right
uh let's stick this at the end add star
at the
uh we're gonna do this as
Rock and we're gonna say
all right now if I add in a few more
instructions here we should be able to
load into lexical registers one two and
three let's go
bro bro look at that look at that he's
floating into registers one two and
three Bros
Bros
Bros okay
all right
now we have a platform for
experimentation
it's not a compiler it's an assembler
and it's definitely not a d compiler I
don't know why we named it that but
that's the beauty of hacking then you
can name things whatever you want
because they're my things
um
I'm actually gonna just make a mod to
this thing
I do read register uh if
l equals a and equals two
construct.unpacks yeah this is what you
guys came here for all right
and wraps
all right so for some reason it's
loading in four CDs and not one two
three sevens and that's because we have
bugs let's fix the bugs
oh okay
so how far shifted am I for one three
seven
two
uh so M scale is actually two is
actually five
and that would make Unk a actually
uh 26. let's go call one two three
sevens
yeah one two three sevens all right oh
and I have some good ideas what Uncle
might be
because it's five just like s1x
all right look at that look at how we're
loading those in right and like look I
can set one of them different I can set
aib here oh man is there anywhere
outside of Google where people are
running their own custom code on the
little shit Coral
I don't think so
all right let's try are all the
registers actually accessible
they are
um are there more registers
keep going
all right nope numbers out of range
actually but uh that doesn't actually
mean anything because I
oh where's the register file
the beef
oh
all right well there's a few more but
those aren't scale and registers there's
other registers there actually
uh they're called something else
we got those tires good eyes
all the time
predicate register file
I mean I doubt this is going to work but
we can we should just try it for
completeness uh if I set this to
something like six this is something
like four
and then I raise this to something like
21 we get one more
1356 no we don't okay good okay
moral notes
32 scalar registers
uh oh we should also check
and I can fit another 32 so I don't
think there's 32 more
I think the 32 bits
uh look at this we're loading all those
registers guys it's pretty nice right
all right great we got our one function
to work
uh it's actually kind of sad when you
think about it all we got was one
function
all right can we get a move to work
okay that was fun wasn't making progress
fun
okay what's this
that one's interesting
let's take a look at it
foreign
okay
so I think this is doing something with
register 12.
when I register six sorry
just like a move
and then UNC one is maybe we have
some things in the TPU to make some
guesses at what these things are
would be up so I mean let's just make
some guesses that's one up and s1y
maybe this is something like a move
uh hang on I want to change this a
little bit
not quite such an ugly terrible thing
can we experience something a little
nicer uh let's go for KB in DD dot items
what's that
foreign
10.
it's good
cool
okay now we have all the stuff in the
program
prefix is x800
readable
new decimal
notice how they're almost the same
do that one attacks
now we're decompiling everything
[Music]
oh this is 2f
these are 2f
okay and it also yeah these
six immediate 16-bit each two could be
merged for 32. which makes me think that
some of these are actually just
yeah look at how much structure we
already have all right just by doing
that we added a ton of structure
um
so I think this prefix says which units
are active
does this thing have a prefix no not
really
so no it could actually be something
else
um
but yeah
so this immediate size is B10
This lends me to believe that there are
actually two different things
yeah so these are the these are the
register moves here
those are more registered moves
my guess is the ones with like prefix
800 are the interesting ones
uh well actually here we can say
something
uh move I
mean by the way thank you for suggesting
construct this is so much better than
what I was writing
now we just have something that loads
one two three seven into register uh
by the way what PCS are we getting to
before
look at this one it's a terrible boring
instruction it just has a scalar
I feel like that's what we were getting
to before
what are we decompiling divtil
let's run DeVito
greeting current PC okay it gets to 4
20.
look at this instruction
look at the instruction before it's all
zeros it's actually real
410 is all zeros yeah
which makes me think that's not always
interpreted as a scalar
uh but actually wait we should also
confirm that it is being interpreted
completely as a skeleton
uh we should do this by writing
a337 before the one two three seven oh
let's go
foreign
okay that works
and let's just move on
zeros are special
all right it's your nine there eight two
three seven one two three seven okay
okay
we got move eye to work oh my God I pay
50 bucks right now for a uh
for a list
should I pay a hundred and I also pay
100 for White Lotus man
hey Google
it's not illegal to bribe employees is
it
ah yes I have this old hundred dollar
bill if you send me just this list
of what all the uh scalar op codes are
if that's illegal I take it back I'm not
trying to do anything illegal this is a
Christian Channel
um
all right so what if I just changes like
2E what do I got
nothing boring
plus fuzz
oh interesting it only gets to PC 20.
oh no that's not false instruction that
actually makes sense
what a weird instruction 420 is though
it just has a scaler
400 and 410 have just zeros
that whole group
more diffing of compiler output
I don't think we have to do that yet
here look we have a lot of interesting
these operations are interesting right
look at this one
let's try that instruction
okay we have a scalar op
10 register zero
register one equals
C and the immediate scalar equals zero I
have some theory that this is a move
we've registered
oh you know what I think we can get this
list for the the tpus somewhere
they're the big tpus
please God let it be the same
okay
so these are logs
this is where I got all this information
from
move Vector mask scalar move
oh
foreign
no I didn't seem to do anything
try 23 and let's set a mead scalar
foreign
or something
ah I think that might be and
all right
there we go
and I
see what's end
and I'm gonna get rid of these ones
because I don't think there's more than
one
there's only one scale here
uh I was patent
I think this is just with a big TPO
wait
this is an IBM patent
did you guys see how that's end right
I'm gonna find or I mean or you can
probably just find my guessing
uh
that's and
I'm gonna guess this is xor
foreign
what would you do with itself like that
it's a quick way to clear yes that's all
right
no it's not xor
or
it's not or and it's not xor
what is it
is it not
what is that
it's not xor
see why I guessed actually though right
because like what else look at this it
does something with itself
what else would you do with yourself
if you can find ore
another weird thing
that's or
right or I'm going to double check now
now I'm guessing myself oh second
guessing myself you know
21 is pretty common
foreign
doesn't look like 21 uses the immediate
I don't know let's just keep let's just
keep guessing here
it's 25.
that xor that's xor there we go
I'm so small
doesn't look like anything
okay
we got and or xor and move
guys we can almost write a program that
does something
uh no it can't do floats
hmm
I wonder if like this well
like I wonder if there's immediate scale
or can be interpreted as a register
kind of makes me think that it can
you see what I'm saying
so this is like four plus one
[Music]
well we're reverse engineering the
scalar unit
ah
it's like this is an and
I wonder what this is that might be an
ad maybe it's ad but not uh with an
immediate
all right so let's try something
see if that's the thing added to itself
oh no it does add within a media okay
oh what did I just not try add before
nine three three eight one two yes okay
fine add I
so boring
all right ready to find sub I'm gonna
guess this one's sub
so let's try hex that minus that round
it
foreign
okay good add sub and or xor that's a
pretty complete ALU what do you think
foreign
40 after the X you yes I did I mean that
all right so we know what all these are
now we don't know what 2C is yet
see a lot of two C's and we don't know
what it is
a there
three there I don't know what that is
uh
uh I think too serious
seem to use the immediate maybe it's not
to do anything
I don't do anything I tried that one
already
what does this do
a do
oh you know what I might not I might
have just put a zero there
no
all right let's just load up another uh
register with something
dead
see if we can start to find the
registers
what is it a
did nothing
foreign
[Music]
a lot of ads look at all those ads
remember when this was just remember
when this was all just
opaque
incoherent stuff
what is this why don't you do this
though
or just adds B to four
it's just a move
that's just effectively a registered
move right
puts what's in B into four
um a little more coffee
this stuff's interesting why are these
here
I don't think that that means what I
think it means
if there's a limit to the size of that
immediate and I only think it's that
because of the first one
an ALU would also have ink deck and not
I agree that it has not
I don't think it necessarily has those
other ones
[Music]
um
I can try and like see what we got
see if we get anything out of 26.
okay this did something
uh is this not
interesting
oh that might be mall or something
no oh that's shift that shift
yes it is
foreign
gift sub you get question you don't give
sub you don't get questioned all right
maybe this one's schlar
that's right
[Music]
foreign
[Music]
okay
what's that
is that one mole did it have mole maybe
it doesn't have mole
uh I don't know let's put in a tinier
number put in like
um hex a
number what's what's hex 80 B with this
nothing
just 157
actually let's also see if that changes
anything
she's actually reading from a register
no it's not really the register I don't
think anything registers
foreign
oh this is arithmetic shift right
all right
uh let's just do 10 to make sure this is
going to give me F's and A's
um
you want to have your arithmetic shifts
yes
nothing
and I'm purposely obfuscated there's no
document
okay
nothing
you see
nothing
I'm pretty sure too he's gonna do
nothing
just to make sure I wasn't messing up
let's go around to 2C and we expect a
beam up here there
maybe all right
don't actually do nothing but
good morning all right good progress on
the ALU
one of the register files turned to one
when I did 2C
where
oh the predicate register file good find
good find oh I like that okay uh yeah so
they are compares
oh good find they set the config yeah
watch watch and I bet if I set this one
to one it's gonna set the next predicate
register file
yeah that's this product register file
okay
um
pred oh nice oh I missed that okay
um something probably comparing it to
the immediate scalar those are going to
be a lot more annoying to find because
we're gonna have to do multiple but uh
I mean what have I said it's a leg
see if the EMS guys actually
maybe it's like not equal
yeah okay that's good uh so it's zero if
equal
um
uh this is any Q
I
uh nice fine nice find
oh yeah see this is why
hats Twee nice find
this is why we stream
catching my mistakes boys all right
let's try uh
do I I don't like that it's only
that's EQ
not EQ
it's probably some pattern to this
because or is not equal
hid
that's one now
you gotta be real careful with this
stuff because it could actually be like
less than or greater than or something
at zero
see if that works too so it's not equal
it's actually less than
uh S I uh
greater than or equal
let's go back to not equal and make sure
I did that exactly right
not C that's zero now not equal that's
zero now so this is actually not not
equal it's less than
uh
okay so now that's zero
now if it's the same it's also going to
be zero
because it's more
than V1
okay
uh my guess is this is gonna be equal or
something
uh you know what I have an idea let's
write out a few more of these
um so aren't equals to be
set that to zero
okay
all right now when I if I set all to
less than
this one is going to be false false
false true so we're only going to get a
one in the fourth predicate register
file oh we got one there too
0 m scalar
that shouldn't be
oh no no that's right because it's less
than uh notice this is signed
right because zeros is unsigned
oh but everything's probably backward
hang on
I'm not dealing with that
okay now the only one we get is this
so because M scalar is greater than
wait
that's a less than a scalar Sy is less
than that one
um now let's set it to geqi
right geq gets us these first three
try this one
okay this one gets us
these two and this one so this is not
equal
foreign
see this one maybe this one's equal
no
this one is probably
um this is signed last time my guess is
this is unsigned less than
yes uh several more
whoops
so considering this is signed less than
we're going to get a four in the
wait no that should be maybe that one's
inside this one's signed
click sign to me
this is signed this is unsigned
buying stuff's confusing so that one
just has the first two ones
no this one just says this one
this is greater than or equal
I think this is signed and every even
though it's just not signed
okay Sy is this s y is greater than or
equal to that greater than or equal to
that
if not it's greater than or equal to
that only signed
um this is unsigned greater than or
equal to
and this one's only going to give me two
ones in the top
this is greater than or equal and this
is greater than
stupid
greater than because it didn't give me
this one
so that's greater than let's
whatever
is going to be equal it's only going to
be this one
fine
and then this one is going to be greater
than or equal unsigned or something
greater than or equal unsigned
I don't care
these are somewhat right
okay
[Music]
there's some like you have some like
Saturdays that you do and I don't really
know them
okay those are pretty good
that's pretty good
I feel like I've seen this before I feel
like these are the same ones that are on
the big TPU
um
or you know what why they risk five
I feel like I've seen these before
and subtract and or xor
show right
it's like almost
actually right
um
no it's definitely an alarm
where's uh
I have an implementation somewhere
I might even be in tiny grad
but there's everything in tiny grad
uh
uh
where's my risk five
I wrote a risk five somewhere
it's twitch core
hmm
here we go
foreign
less than
less than greater than
less than unsigned greater than or equal
sign I'm sure that's right actually I
just I just got my things flipping
around
uh
no but then like these don't match at
all
Google TPU Isa
foreign
I don't know
okay regardless we know what those other
instructions do now
they're comparis so this is a compare
all right now here's a question what
does it do with the result of that
compare
anything
that's like a less than or something so
it's checking to see if uh
this is less than zero
I wonder what that does
I bet you that's another okay I have a
theory
try something like sub
to add see if ad is one
like this
yes we're going to try something like
um see that's what's up
yeah that's it to itself all right cool
so I think that that first bit there is
actually just whether it's a scalar or
not
ah
see like let's see something
extraordinates itself is going to be
zero so if I go to Five I'm going to get
a zero
okay let's fix over it with uh
that's right all right because that
excerpt with that is that
um
drop the
and use red in the scalar instead
it's an add equals zero one and here we
can say SX Plus
4 plus
S Sub M scalar
so there's like three register
operations
does that make sense
so I think we're gonna reverse most of
this now
um for example 8 here
I don't know that's not a it's only
these still
900 I think if you just include that 800
there
that just means uh
use the uh
scale unit that's just like enables the
scale unit is my guess
and you have something like this which
doesn't make sense to me
but yeah so a is not equal so this is
comparing
this is asking is 5 not equal to 5.
I mean I don't know why you do that but
we're missing something right
oh I wonder if this here
means only run based on the predicate
you know what I'm saying like only right
if it's compare
what does that do
it adds
six
that also looks like it does nothing
right
so what does that do it adds six to zero
it might just be a random basic I say
yeah
what does that do
it adds one to four
sometimes
then go like a twatter man Twitter
water you got a blue chalk
go check out my blue chalk on Twitter
using predicate would be a branch
instruction not necessarily look at how
like arm does it right
what is this is this move in eight and
one to nine
well you know we also have something we
can also do a div 2A which is a
different program
some things change
I find
I'm sure that's some
okay there's got to be flagged somewhere
to tell it how to interpret that thing
because this is being interpreted as
something else
foreign
bytes
through chocolate water
all right so probably the next steps are
to like make the minimum program that
communicates
and to start to play with the
communication stuff
[Music]
so this immediate size thing just might
not be right
it might even be off by a factor of
hex 10 what do I multiply PC by again
the acts 10.
possible
that belongs over there no that doesn't
seem
that doesn't seem obviously better
sorting by prefix and looking at unk3
might reveal a pattern
I'm gonna get more coffee uh
is this a shoe rack no
shoes
I mean these are interesting too like
what does this mean
why are there things here
okay there's something else we can do
too which we can compile programs that
take in weights and then it's like
separated into two chunks
this sense fine as well which is
interesting
even without me doing anything
foreign
okay I mean here's something interesting
pair uh div2 with relio
yeah the only difference is in this
instruction here
6b0
so this
whatever this is
uh it's determining what we do
is just fun
then we then we have more loads here
doing the stream back
this is some kind of weight instruction
foreign
let me inject instructions from the
other program if I want
inject some instructions
okay this is halt
let's try going from like hex 71
say prog equals
uh mdat sub x71 let's go down to where's
the halt here at a d
same day
hmm
wait that just worked
also when I read out these registers
doesn't this kill it
how does this work
[Music]
how's this working right now
I'm really confused
just like hard to break these things
or am I sending their own program
somehow
before
foreign
weird
I don't know maybe a lot of these
instructions just don't do anything
what
how
oh but okay this won't work if I unplug
it and replug it because I only did the
bottom half
which is going to resend the same stuff
yeah okay look this is just sending me
garbage memory now
but it is sending you something which is
very interesting
we just like started here and just cut
that's cool wait so what I got I think
now is there's going to be a
uh
we have an arbitrary memory depth in a
minute
foreign
seconds and I'm ready to go
see if that keeps sending stuff it does
I don't know binary search by hand
that's all hacking is
still works
90. this is dark
and still works Maybe
still works
okay
still works 70
. I can't score
that doesn't make any sense
I mean it just reads it
okay it's just because we got Old State
left around
80 to 90. does that work
71 to 90.
foreign
to a0
this one works
not anymore it doesn't
71 to a d
ump something
see now the problem is if I go back and
I change it
okay if I comment that out entirely it
still works
no not that well
because that one still work
that one still works and then it like
doesn't halt
it keeps blinking light
oh because we should include Halls as
well
that PC is 3D
why is the lights the one I told it to
halt
foreign
it's not USB send it just like sets up
memory
loads in some pointer
foreign
foreign
that totally changed it it could be
getting like stuck in a loop somewhere
you know
you know
one of these things are like loops
now we're getting stuck somewhere
let's see what's like crashing
that output stuff that works
let's go one at a time AC store
now
so AC was important
whatever was at AC was important this
one here
prefix C what is that now
prefix 800 M size
in size 1800 okay I don't think M size
always means M size has to mean
something else
that works fine did we need the
instructions before it
yes we did
very important instruction
[Music]
it moves
4 into register nine
the status response is the one that
matters I think something's triggering
that
what happens if I go to 77
that works fine okay so that one wasn't
important
this one was an important can I go down
to 7A
I'm just gonna just to be thorough let's
unplug and replug and make sure 7a's
x 7 8 still works okay
um let's find out where that breaks okay
can I go to 7c
no
how about 7B
but I feel like there's some other
problem there okay 7B is fine
if I remove 7B
it like maybe gets stuck in a loop
somewhere
actually let's do that and let's see
what did PC say
s hex 210
[Music]
here
F9 o e f f it's stuck there
I see
which one is that if the one before onc
zero is three
what is that what
if there was never three
countries never three
Co four b c o five b okay those are
straightforward yeah that's at 90 there
so it was stuck
before that okay maybe can I do 90.
ah getting status response okay the
status response still works
I can't get the output tensor but I
don't really care about that
okay so that's the status response
sender right there
let's try 9f let's see if I still get a
status response
9f I still get a status response
just for
sanity
okay notice how I don't get a status
response so nine out fine
a zero George you should be binary
searching
uh
for
see see how it says getting status
response and it gives me something
still getting the status response at A4
how about A6
and then we're going to have a we're
just going to find the instructions to
send the status response
still getting one
A8
so good
oh come on come on come on come on
come on AA is still good a b and we're
really getting low on the number of
instructions
now
so we need a a through a d
let's just type out those instructions
a a through a d so we need these
uh which is actually just three
instructions
equals
to F this x equals nine and scalar
equals four
okay we get a status response cool
let's get rid of that one see if there's
response
no that one was very necessary
maybe this isn't though we'll figure it
out
oh oh
notice that four way to have a theory
what if I put in one three three seven
here what status response do I get
seven
reading current PC seven what
okay well
seven I don't know let's put in three
here
is that going to give me a three there
that doesn't give me a status response
at all okay
oh you know what
where is that code I have for getting
status response well I can only read 10.
400. how long is the status response
that's actually how long it is okay
but what if I put in eight what is eight
what's that mean eight
no it doesn't work
but if I put in a seven here
you're gonna set
you can only have certain statuses or
fives okay
fives are okay
do I need this middle instruction or is
it just a useless instruction
sometimes instructions are in the middle
are useless
I'll probably do something
oh I have some theories okay maybe these
are registers
right
I mean these things definitely don't
this looks like two different things
this doesn't look like one immediate
I've said that a bunch of times about in
size
like it doesn't look like one thing
uh
okay
none of this works to get the output
tensor though so I bet you oh here we go
look
look at this other stuff here
this this is the same look at this is
the same pattern as this
[Music]
so that probably loads in the status
response
Miss
probably loads in the uh the real
response the other response
let's do prog plus equals MDOT sub
8A
2 8 f
and then we'll see if there's probably
both responses
[Music]
in fact doesn't even read the status
response anymore
really good stock
pcc0
just that but
uh
I'll do that
foreign
so I wonder if uh what if I like
change it here
so
yeah so that works so I I think that the
scalar thing is actually independent
of this
so for example I can just do this
and get the same output
yeah
does it matter where it is or can I put
it here
interesting
so that's reading nine then
this one is reading nine
and oh wait there's a nine there oh do
you see the nine
oh that's cool yo who sees the nine boys
watch your shit watch a shit now it's
gonna give me a zero if I get change
that to zero and change that to eight
oh yeah oh yeah
look at that look at that yeah yeah yeah
you know eating chicken Bros
eating chicken
s oh
okay
so that is a scale of register that
means
um I think wait how many super scale
registers we have 32.
so let's steal some bits from the top of
any size
uh are they the top
yeah they're the top let's steal five
bits from the top of him size
um
uh we'll call it s Reg
it's
integer five
okay now we're gonna say something here
like s reg equals eight
all right and that should actually still
work
numbers out of range
oh it's because we have Moon I say
oh well because I gotta get rid of that
no no no I put us right in the wrong
place
thread goes here
okay good I'm still getting sex ah look
at this okay so this is the move for the
scalarag this here this probably stores
nine in this uh
in this
uh register
you see
and look it's it's interleaved
it's inner Leaf so this is this is just
loading up
these registers with these values right
so it loads nine in and nine is four
right does that make sense
uh so now like here this actually
doesn't matter I could probably set this
to something like 15.
um
to confirm it's changing we'll set that
to five
there
it's called something else let me let me
see what I call that uh here
yeah oh maybe vs three scale register
stop it copied into the
let's call this vs rag
it's copied into the vector unit
at a mouse rag
uh
it's interesting is there's probably
nothing in there
so I'm not exactly sure why we need that
one
I guess Zero's in there which is fine it
just wasn't zero before
you see how they're interleaved
and like you don't have to sorry not
interleave like you confuse them and
make one instruction out of them
and that's what they're doing here so
this is like loading four into nine this
is loading zero into eight and then it
stores zero at ninety four hundred
five
all right let's see what they do here
they're putting three
eight
um
put an eight in that one
yeah so these are the registers
for uh
these are the USB
uh like mimo registers
but it's probably not even that
everyone has to know how to do that move
it does if I just
the other thing is that these
interpretations don't can be different
like a lot of times in an instruction
set things are like packed pretty
tightly so these things can mean
different things
depending on the uh
and meaning
what if I like didn't put
if I put not zero into eight what do I
put like x 10 a what do I get
oh look at that
X10 showed up there can I put big
numbers into here
look at that
hmm
your water of course there won't matter
yeah
so that what's what goes into a there
laughs
if I if I said probably will do that the
only thing that spits back to me is the
actual tensor right yeah I don't know do
I have special code in getting output
tensor
foreign
okay let's keep going with this
so what if I go back here to 5400
. change that to seven
put something in seven
it shows up there it's so boring
foreign
six
[Music]
okay let's give it something more
exciting threes
I'm not gonna put that in the first bite
all right puts that in the first bite
there we go
done uh can I change this five to other
things
yeah that one's special the last one
special the other ones aren't which is
weird
um one
five
nine
five heads of four there nine just two
there okay
so again IM size is not what it looks
like
um
seems like there's a another thing to
steal from it
seems like there's like Offset you know
what I mean
what do I have to shift it I have to
shift it
uh
how many bits do I want to leave in size
with
1400 is fine
but one more than that is and so you
want to leave it with 14.
foreign
minus 14.
call this one M offset
uh
yes right
okay so all of these are actually 1500
and then
it's just m offset that increases
okay cool
all right
so that's like an address
it's nice because like at least you kind
of get the slip points here right
foreign
I guess when you break this down further
it's not even going to be all right but
this here is the USB right and it's very
uh
unsexy
it's very just annoying let me see what
it does
see look we had something with almost no
structure and we've discovered structure
[Music]
um
here's a question
we need that prefix
yes we do
look so we're sending that out on the
USB which is the stuff that we put in
there uh what if I don't do that does it
matter
this does
okay so it seems like we have to push
four
bytes and it kind of matters what this
one is
but the other ones can be anything
this one has limitations
the other ones don't care
this pattern also exists here in the
code
would they add one to seven
but only sometimes
I assume that that's what that means
these move four and five into eight
hundred
sorry not at 800 into six and seven
you try to learn what these registers
are doing
okay so you know what stops at 420. you
know this is where it stops
so whatever that is
there's another one of these USB looking
blocks up here so maybe it actually
sends the status three times we just
only get it once
or have we tried getting it more times
I'm actually sure we have
go to the real program
no it only works once
so I'm not really sure why it's in the
code three times
maybe after you get the output tensor
nope
can only do it once
I think sometime that means an address
but sometimes it means something else
it feels like this is a uh
oh
here's a question we don't actually know
of M size
M size could steal bits from prefix
Maybe
the only reason I made it the size I did
was because of this
but that could be a lot of things
uh
it's not really an argumentary we may
just shift it over 10. but I have an
idea that these are registers
right in the Chip And this is like uh
you poke poke poke poke and then you
poke this one
uh by the way
I can set zero to non-zero what happens
if I do that
does that break it
no it doesn't
there's a chance zero means something
special there
[Music]
four Vector slots
I'm saying this prefix could actually be
12 and then we have another thing
2.
okay
uh let's look at the instruction that we
know changes
that's six here
we have a weird M offset
a vs Rag and a scalar off
vs regular f
which I'm not sure I believe I think
this might just totally mean something
different here
this one's not even an 800 operation
and then I don't even know where to
start on unk3
what are those predicate registers are
there
eight
that's seven from one and then no it's
normal
press hop is a which we know is a not
equal
I'm not sure why you'd check if
something's not equal to itself
what does that do
no I mean those are just they're just
like it's just like a channel probably
to communicate with the firmware
checks for Nan funny
[Music]
changes in there
um
all right does this thing support unions
I think we might have to start unions
this is right
awesome ones right
foreign
okay let's try to re-enable getting the
output tensor see if we can do that and
let's see if we can do it by adding
stuff to the end of the program
okay
even weirder we're actually getting the
correct output tensor but I think that's
only just because I haven't reset it
just reset
we're still getting the status response
that matches my stuff
all right now we're getting jumped
let's figure out which instructions
actually make that happen
so we're back to 7B uh what if I go to
7D still happen
no it doesn't okay those instructions
are important
but it's interesting that we still get
our status response
uh well actually it's not that
interesting
well we know that we don't need the
stuff after let's say A7
yeah okay so notice how we're still
getting an output tensor
we're going to figure out which things
actually send the output tensor I think
that's more interesting because it's
sending memory not registers right
that's that's not in any of my registers
um
it's not like there's gonna be Secrets
when we dump the memory but
foreign
so whatever is at and whatever is at 94
we actually need
foreign
okay this one oh look at that oh that
looks mad fancy Bros what the hell
what if we only need that one
foreign
does it get stuck somewhere
yeah it gets stuck at 260.
no that's the end
just needed whatever was in
it's a big chunk to meet
seven b to 95.
so it needs all of these instructions
okay let's chop out let's try going just
to A8
Plus
uh start there again
everything's gonna work
nice hacking it's just binary searching
by hand
the sooner you realize you love binary
searching by hand the sooner you'll be a
good hacker
that obviously works
in fact this stuff doesn't matter
foreign
that still works we didn't need any of
that
uh A2 do we need this can I go back to
81.
no I'm gonna do that
we need 7B
7c
we need these
that's actually zero
possible that you just need to have a
knot following that one if you don't
never
it's possible some of these instructions
are just needed when they're in a group
you know
okay
like this one let's try this moving this
group entirely so let's go right to 90
there and see if that works
come on
no
because we know that that's the uh
this is the preamble for sending
status packet
I mean it might just need all this
b0 through 81 so it means these
lots of stuff I don't understand
and then it needs these all the way down
to 95.
there's a lot of crazy M scalers over
there
copy and paste this down to here
can at least get rid of that
oh is that one
AF
what does that not work
should be the same
oh I have to put certain things in there
seven has to be eight and eight has to
be three
foreign
okay not just that
AF uh
oh sorry that's eight and nine not seven
and eight
which makes sense
what come on
okay that's fine actually notice how it
gives me a different answer for one of
them
notice how that's all zeros
again I don't know if that matters
I don't understand how that doesn't
match though
8A is moving in six
which is what I'm doing
moving eight and three
I moved in eight and three
then I'm setting that now I'm doing that
okay is it this one that's bad
another time one at a time
that one's fine is it this one that's
bad
it's that one okay
seven in
gotta have patience
but it also moves
that's odd
you're telling me this would work if I
also stuck this crap here
that should match exactly
that works but if I get rid of
this extra scalar stuff it doesn't
that's weird man
that violates the model I had
all
why
okay
it doesn't like
doesn't like that I did them in advance
but that all works now
uh
good 8f there
no
I'm gonna put that one back in
okay now it sends the upper tensor
uh what if I put that up there
works fine
what if I put that one above that one
works fine
what if I move that one down there
it doesn't work
that's just I don't get it
that just violates just the model I had
of this thing
why does it matter I put this one
underneath this one
unless it's somehow corrupting register
eight
what three go so three there
where does this three go I don't know
what happens if I put a zero here
it doesn't work
what happens if I put a 9 here is it
gonna set nine bytes
nope it still sends eight bytes
what if I put uh 10 this is going to
send 10 bytes or is it only gonna send
eight
now this is not gonna work
[Music]
why so many chat restrictions increase
your font size
okay
there's so many cherishers it was so
like people like you don't like say
things like that right like that's the
point
you want a bigger font size you can
start your own stream and you can make
the font let me tell you bro on your
stream
you could make the font this fucking big
man
that's gonna be Mobius five stream she's
gonna he's gonna he's gonna stream like
this and I'll be like I'm gonna teach
you eunuchs l s
yo
people out here watching their phones
man and I gotta wait for it to get tiny
again
it's not tiny enough
oh that's a good size
I can make it a little bigger we just
have to fit the whole disassemble on the
screen
okay
um
where are we I'm trying to figure out
which of these things actually do
anything
okay now we have another one that has a
prefix of nine c zero
and an M size of 20.
so what if I like change this to 30.
does that break
no that's fine what if I comment this
out entirely
we needed that it was very important
I think that's good for whatever you
make it good for
limited is only
you
the limit is only you wow
I like that it's like a slogan for a
product the limit is only you you see
because it's got this like double
entender vibe to it right
like like
the limit is only you can be said like
so positively like you know maybe like
the only limit is your imagination but
um then you know like like this God
that's like maybe the nice way so you
know what you know what I mean
the syntax highlighting is for me
why do I need so many instructions to do
this
okay
now we have another one
all right we're going to write these out
just try to figure it out
him offset equals
600.
new scalar equals
foreign
offset equals 400
vs reg equals two
I don't know how I feel about that do I
actually need all that crap
I actually need that instruction at all
instruction go
use that instruction it was very
important guys
of course of course we needed that
instruction if you thought you thought
you could you thought you could you
could uh
you could not until you could get away
with not using that instruction no you
have to use that instruction
look at this garbage
and we're getting into ankh three land
but that one is an uncle three
yo I think we might have to learn what a
TTU is
all right let's finally make it work
vs red equals two
SX
equals hex 18 plus y equals three
scalar
equals 108 this is definitely parsed
differently it definitely doesn't mean
that
it works though
see if I like get rid of that crap is it
needed
yes it was needed
all very needed
what if I said vs regular zero
that's fine
what if I said SX equal to zero
that's fine but we get something else
foreign
that's fine but we also got something
else
all right this one only has M scaler
you're like how does this do anything
one has an M scaler and an unk3
it's definitely using the TTU it's got
to be using the TTU
so the TTU is like the lupus of this
thing you know
prefix equals a d which doesn't look
like any prefixes I've seen before M
size equals two
M offset equals eight
M scalar equals two bajillion thousand
and then we don't need this anymore
great
let's unplug it and confirm that it
actually works when I reset it
foreign
okay there's only a few instructions
here to copy let's see do we really need
this instruction let's get rid of this
instruction
because this shit's super addictive guys
don't you just want it to work don't you
want to understand you have these like
mini breakthroughs
and you're like oh my God it all makes
sense now it all just falls into place
so nicely
I'm definitely it's it's crashing
because the TTU man I'm upsetting the
TTU I I know it already
it's like loads in the status
prefix 1400 I'm offside equals 400 this
is 1400 the same as this 1400.
probably not they're probably different
1400s
foreign
does this look like anything we've seen
before
foreign
I know they look similar
but they're not
this one only has an old three
foreign
what are the odds I wrote that all right
by the way I'm in the I'm as much in the
dark about this as you guys I don't
understand what this stuff does
foreign
so in order to send the output tensor
we have this
followed by this
I don't know can we take out this
instruction
oh that was a very important instruction
guys we can't take that one out
oh at this point we take out this one
oh that one was that not an important
instruction
it can't really take all these
instructions to send something out the
USB port can it
during the dma controller or something
and then how come I can't put this here
oh I can put it there but I can't put it
here
which doesn't make any sense
foreign
can I put more of these in
did I just do nothing
yeah you can put more of these in
what if I put more of those in and then
do that does that work
wait what
oh okay it's just some conflict
two knots
foreign
I shouldn't replace the instruction
entirely I should add a knob
if I replace this instruction with a
knob
okay that instruction was useless we
found a useless instruction oh this is
this one use this
oh that one's very useful don't do that
wait it doesn't work anymore
maybe that one was important
wait what no nothing works anymore
look that all has zeros now
foreign
delay slots
unplug replug
foreign
um this must be configuring some dma
this is
the
thing
thank you
I don't know
see if we can figure out how to send
more than eight
where's the eight
is it this eight
what about that
I'm Gonna Change I got nothing
yeah nothing changes
um
foreign
these are jump commands it's possible oh
oh I see what you're saying so you're
saying that this knob is there because I
have some jump command
let's do some jump command hidden in
this stuff
I mean that that seems possible I don't
know if that's what you're actually
saying but that's kind of what I took
away from it
foreign
doesn't actually have to do with
we can set a break point there
and see right so you're saying that the
reason this doesn't work is because
this is here
let's switch that up
a good theory
oh now The Nine's not there either I'll
put that there
okay that works
um
see where that knob is let's set up Brad
set a uh at 1 30. let's set a breakpoint
there
now we executed the knot
foreign
foreign
didn't change anything
and change your thing
okay I can change a lot of the code in
this stuff and it doesn't seem to matter
long as there's still something there
it'll work
never really doesn't matter
as long as I said M size to 700
oh let's just load something in register
600.
it doesn't really matter what
hmm
weird
what if I change this to 400
it has to be 600.
what if I change it to vs Rag and I
guess vs right now zero
do I need these prefixes here
you do
but not for that
or what this one does
I don't think there's any data blobs it
doesn't seem right
uh
it's coming out that that's 20. does
that matter
that hex 20 was important
uh this
okay I'm starting to wonder if these M
offsets and M sizes are the same thing
and this is something like store
that's something like load and this is
something like store
wait what yeah I can change that's
interchangeable
[Music]
that's actually total junk
I get rid of the M scaling
nope that's what matters
that's crazy man
you're telling me I can replace it with
that and it's fine
we don't understand what any of this is
gonna get rid of the uncle three
get rid of this whole thing
yes
but if I comment that out entirely
I do that
interesting
okay so a lot of this stuff seems to
just have more to do with timing than
anything else
do I need this one
that one's important
oh wait is it writing to
what else did I set that to nine is it
gonna sell nine bites
no 10 bytes
foreign
so this stuff doesn't matter as long as
can I do that
no that one needs
it's on three
doesn't matter it's unfogly plug
fine
foreign
what parts of this one when I do that
keep around the end scale
do that but we get a different output
look at how that number is different
foreign
address
no
ps52's around I guess
now
s y
look at how it's a different output
if you have anything in there register
now
all right but this changes something
hang on
how much does it change
b5e
well totally different
foreign
like dma to be fair it's like a really
hard thing to figure out
we probably won't figure out till the
end so maybe we should just leave this
alone for now and be like oh we got to
do something
foreign
tma2 USB protocol
wow question's getting dumb
[Music]
um
um
well that's not dma through the USB
protocol it's just uh just uh
I want to do more than eight
if I put 10 there and 10 there
through 10 now
no
I mean that might be the only way to
tell some of this stuff is if we uh
this one's interesting I actually just
don't think it means that I don't think
it means I think this means something
totally different here
let's look at where Sy actually is
uh
there
and that's going to just be a whole
different um
this is a is just a constant
in this in this uh in this thing
let's try something like SX equals one
foreign
okay it starts to change it
you think it just like shifts the memory
by like one you know
foreign
okay
let's try something
let's go way back
and let's make this thing output big
stuff
uh instead of a let's say hex 10.
do longer code
oh you don't need to add here
be the same length be very hard sweet
uh CP
temp frog uh give 210 Coral compare div
two Coral to div two
I probably should have taken it from
here like look at how much changes wow
I'm only a little changes down here
actually
okay where was I taken from a B zero
let's get eight like switches places and
this changes to a four
interesting
foreign
which one changed to a four
eight B zero
here
wait oh so in scalar there's ten so that
is 10.
this is the alpha lamp
I want to do that that crashes
there's also because something else has
to change because everyone 8f
I paid F9 c0 that had to change to 20
right
change to 80.
come on look at that no wait that didn't
do anything never mind
no they didn't just change no that's not
all that changed no way
something else changed
it doesn't make sense
yeah aim offset is now 80. yeah okay
that doesn't really make sense
foreign
there you go now it outputs 10.
okay that doesn't make sense
what if I change this to 20. this work
no
I have to change this
I mean let's keep going can I get 20.
tends to become 18.
foreign
all right yeah we're just not parsing
this correctly
image of cities
180 now
does that not make sense to anybody else
there's no other changes now why doesn't
that work
well if that's 180 what
there's obviously it can be 180.
180.
fine
okay let's change something back in the
7B
I'll change something up here
change that
foreign
c as well
I don't know I'm not really doing this
methodically anymore
ah these parsings are totally incorrect
it's just Alias with something else
don't 20.
okay it'll dump 10.
what is that that deny does it ever give
me nine
it never gives you nine
what the hex 18.
x18 works
yeah so this is like enabled dma or
something
man yeah
okay until we understand a whole lot
more this isn't going to make any sense
foreign
[Music]
maybe we start looking
what are the other like units are there
any other registers
product your register file scale or
register file
killer core break points
okay memory
foreign
thank you
all right it doesn't look like there's
going to be anything as easy as that
it's nice how simple this status
response is
uh uh I don't know about this output
tensor
I'm just going to comment it out in the
runner
it was a waste of time
I think it's a waste of time to try to
understand I don't think that's the best
way to like attack the next thing right
everything here we understand so far
uh uh I don't care about
all right that's like that one is that
we got good at our
scalers
maybe the next thing to tackle is the uh
also what happens if I turn the prefix
off yet I took this function everything
just doesn't work
it doesn't work
wait
no it's weirder than that
if I turn the prefix off
I only get this
which
see
foreign
for some reason it isn't doing that
fetch
this might just be undefined
[Music]
um
[Music]
means
give me scalar is present
all right my medium scale is like a
register or value and not like uh I mean
this might get pretty close to the
microcode of the CPU
right uh here's a question
let's try something
let's go down to like here in the
registers right
foreign
if I get rid of that
I still see two Abby Abby's okay never
mind but I won't see an aviapsee
but if I put that back I see another
episode
foreign
Bowser Alexander why do you want to know
that
why do you want to know what I'm trying
to achieve we're trying to crush the
Zerg man
we're playing protoss and we're trying
to crush dessert
that's right why do you want to live I
like that I like that
what do you mean by an inference chick
bro
but why do you think this ship is an
inference chip
who told you that how do you know it's
not a training champ
every inference chip is a training check
foreign
that's right bro at four base my protoss
got four Gates Man Four Gates and five
thirty let's go
foreign
JTAG might have the right idea maybe we
just start compiling some things and try
to reverse the vector Ops
you must construct additional pylons
uh that's right that's right
foreign
okay these are all different types
well if you don't understand about
programming I recommend boot camp where
you won't learn shit but you'll feel
like you're learning something
now if you actually want to learn
there's only one way to learn
programming this is real advice
you got to just sit down and do
something right see this go buy one of
these and you know try to make it do
something
wow damn Google Google why isn't Google
paying me I'm Shilling for their shit
I've probably done more with this Coral
than like anyone to be honest
I mean it's sad like this chips actually
crazy powerful
um but they don't release any of this
they're cheap they're they're 20 bucks
uh
[Music]
uh no nobody used it of course nobody
's guard oh yeah let me compile
tensorflow Lite so I can run things at
basically the same speed as I can on my
CPU right
uh no that's right that's right they did
you know that I'd have to you know
um
I don't know I wonder what their content
guidelines would look like
foreign
got one of these the point is the I mean
the USB one is totally useless
the the USB one is uh
especially if you plug it into your PC
like why would you not just use your PC
it's it's not faster
um than like uh well actually I
shouldn't say that
if it really is four teraflops
tops
I mean that's probably not better than
like that's probably on par with CPUs uh
if you use all the course
well no I mean think about it we can
reverse engineer this whole instruction
set and then you can compile arbitrary
code who wants to run Linux on this
thing I don't know if it can run Linux
but
um
all right
we need some breakthroughs
all right it's time I didn't want to do
it I didn't want to do it but we're
gonna have to start moving to things
we're gonna have to start moving to
things like Matrix multiplies but
there's actually some you know meat on
the bones
and then when you do a matrix multiplier
actually it outputs two uh
it outputs two two things you'll see
foreign
uh I don't know too much more than that
just know it has eight Megs of RAM okay
this is a eight by eight Matrix
multiplier
the problem is it's going to Output two
separate
invalid model
why
why is this an invalid model
where'd that crash
okay
see look now we have two programs but at
least one of them is really short so
maybe I should have done this sooner
um
so this one here
is short but it has weights hang on
let me uh what I put that par stop High
s Four Tops useful I don't know if you
can feed the Alias fast enough to be
honest
oh
okay
so this output in two programs zero and
one
and for some reason it seems like it has
to run him in a reverse order
uh
this is like a weights copying
weights copy in
decompile that see what we got
okay oh look this is very small and
readable
this is going to copy in HEX 100 weights
[Music]
[Music]
all right should we make this thing live
up to its name and actually be a
decompiler
try to understand what's going on here
and it'll probably help us right
so we should understand most of these
instructions now
all right what's this
this moves zero into one
this moves zero into zero
this
does a
comparison between zero and one checks
if it's less than
uh this checks if
one is not equal to one
oh I know what this does
this just sets this flag always
so then you always have it set
this ends it with that
this adds this moves four into four four
or four plus zero
yeah so these these things must be
predicates
the test Dax ax pretty much yeah
that does I mean it does the same thing
this one's a predicate where we add one
to two
only sometimes
I don't know
if we don't fully understand it until we
reverse engineer this and then
then we do all this
which I think
pushes these
into here
somewhere there's an 80 maybe this 80.
which says how much weights we download
and it like puts them into RAM
and then it does this whole
like
oh maybe this is like USB endpoint
switching or something this is like you
have to like toggle your setup packets I
don't know how deep the USB stack goes
uh uh then
the stores this and the right so we
almost fully understand this program
the only thing is we don't understand
okay are this and this
maybe fully understanding this program
would be a good idea
and this one has two inputs
which are uh
Base address parameters
I don't really understand why it has two
of them
yeah at least I can change that soft to
print the known ones
I could do that ah
zero just means don't run the scalar
unit
I don't know what that does
here's a question I have
uh so that's currently the thing what if
I store these out of order
what if I do in offset equals one and
zero yeah
what happens to that
did it send them out of order is that
different
yeah okay
it actually seems not to matter
what if I do this instead
that one looks really necessary
not necessary
I not realize that those ones just
weren't necessary is this one necessary
that one's necessary interesting the
only one that matters these
whatever is an IM offset
three
this matters
this is just the data and we can do
whatever we want with it
foreign
work
and I'll just one work
about three
it might only be from four to seven
foreign
I think prefix
I mean the only thing I know is that it
controls like the read of M scalar so
maybe the ones with other prefixes are
like activating more parts of the chip
it's like all I can think of
foreign
here I set it to three
right and I'll just set it to three and
that works
interesting
this is this last number here
foreign
just does nothing
and then
this one if I were to change this to
something like this it just wouldn't
send me that
no it still sends stuff okay
uh we might just have M size wrong then
okay what if I put a one there
doesn't matter
what if I change this to 19.
doesn't matter
interesting
what if I change this to that probably
matters
okay so it's the top two bits of
in size that matter
uh let's see
doesn't work okay
so which bits matter uh just the top
how big is M size 14
top three matter 14 might actually be
too big
I don't know why I think it's 14.
I should make it 10.
call another one up here we'll call it
like um
uh
via Maybe
and then here we'll say V off equals
what's that five
no this is on the wrong side
yeah the Ops are five and six
you're welcome I'm glad you enjoy the
Instagram live exclusive content
um
foreign
why do I think viap and M offset are
different
what if I were to combine these into one
large via
that make sense
not really
it doesn't seem right it seems like it
does seem like an offset
I don't think it's Amos I think it's
like a V offset or something
guys this stuff's addictive man
you know it's like a game
foreign
okay so is it possible that these are
like is it possible these are loads and
that's a store or something
all right
um
uh we're gonna call this
dance one eight
Mall dot Coral
because it's not product zero zero
foreign
thank you
okay well here's another V up five
which it kind of make sense
oh yeah did we get to the bottom of
whether these are needed do I need to
have a prefix zero there because I'm not
using uh M scaler there
I bet I don't
something doesn't work
uh I don't have an LG 5K anymore
actually this is It's a Dell 4K
these are the ones we gotta work too
I bought one here first
um
I think this is pretty much what I have
that's that Dell
that
I guess we don't
totally understand I mean
my guess here would be that this is a
function that's gated on okay we should
try that we should do some experiments
let's let's test for that
okay
so
let's
do this
so we're gonna see aviabi appear there
but now I think this will gate it on uh
predicate register one
no Abby Abby but if we set
predicate register one and now it's
obvious why you have this net qi
uh actually I'm not even a new net UI
we're just going to do necue
should be that
and we'll say something like if zero is
not equal to zero
actually
s i equals zero this should set
that should set predicate flag one
regardless
um
it's going to set predicate register
file y so you'll see it's set to one
no it didn't register filed one uh why
not
equal
s y zero s i zero
it doesn't work
let me try like next UI
oh neku is gonna clear it we need ECU
said it right
that sets it
uh but there's still no ABIA oh throw a
cafe babe in there so it looks a little
different
okay we are setting the bit now in the
way that I expected
move I is not actually
predicate gated
hmm
okay
that worked
if I don't do that
or if we add a neck here
okay 8 13 Gates on the predicate
uh
uh actually how do I control which
register it is dedicated
I register one we get Cafe Vape
what if I say I'm tangent register two
no Cafe babe okay what if I put a two
there
Cafe Vape
interesting
so that's probably the predicate
register and 813 means gate on it
I don't know what 811 means
but um
we're gonna throw some new stuff in
prefix okay
so
we're gonna say you know uh RF
run Flags
bits integer four
and then um
I'm gonna call this pred
bits
talking to share three
all right and then we want to subtract 7
from that 22.
we're gonna have to modify all our
prefixes to lose seven
oh this is getting long
uh
probably gonna just want to not do what
do I do there
12's a little aggressive
foreign
so the prefix then is just usually 10
default prefix is 10.
oh what about these craps
um
this prefix is one half
the top prefix they're both one f
interesting is just the pred rig that
changes
no that can't be right
I'll do it but it's not right
the halt
I don't think that's right
and I broke something
I wrote something serious
uh
V up equals two for this one
no
it's not that
these all have prefixes of 10 now
it's all correct
these you just need to get shift shifted
uh
foreign
at all this is wrong man
oh that's okay that that is a VR but we
don't want to set the V app there
um but we might actually need to set
pred rig here
which doesn't really make sense so which
makes me think that I made a mistake
and maybe predwag is actually only three
I don't understand why this is different
that doesn't make sense
like why does this program no longer
even run
foreign
I wouldn't trust Google at all
and size it was 10 if I drag equals four
it's also decompile my program
if there's anything dumb
hmm
that all seems right
I don't understand why it broke
it's coming out a whole bunch of these
what if we just have like that one left
very short program
doesn't work
that's just for just in case
I didn't just get into a bad State what
what happened
[Music]
foreign
I should have committed
oh I renamed stuff
oh that was dumb oh dumb
that was so dumb it's because I renamed
stuff
had nothing to do with any of those
other changes okay it runs again
I know we don't get a status response
all right it's fine uh put that back put
that stuff back
uh
these two have red rag equals four I'm
gonna test out this Predator egg stuff
it's all fine
you actually need any of us
foreign
let's go back to these experiments
I do have
any of them right
okay I have all eight
foreign
Flags equals three pred
equals one
that should only move Cafe babe if we've
set Credit One which we have now what if
I do quadratic seven let's try six six
is a weirder one five is good
it doesn't even work
okay
so that's interesting
that number's probably not a part of
predrag the number's probably a part of
prefix
and projects only two
and then
these can go which didn't make sense
so you can only get you have seven
uh
only
first floor gate exactly I
I'm kind of just guessing here but
see if that works
I didn't do what I expected at all
oh it's because prefix is now different
it's prefix 800 that was never gonna run
um
did I add one more bit to prefix
yeah I really want to shift it
six all the prefixes now are 20 and a
twenty so
okay good project three
um but like if we set prefix 21
Frederick zero and we put it in four
over there
it doesn't work right
yeah it doesn't work okay it seems like
credit right is actually only three and
we can only get
the only gate execution based on three
different things
okay um let's try not setting one flags
and see what we got
oh we still got Cafe babe but that
actually could just be we gotta try the
opposite here
yeah that runs no matter what
uh let's just do this
some factorial ship
all right which ones get it which ones
don't they all get it that's because we
did EQ
I have zero and they all ran that
doesn't make sense
project zero why did they all run
that one should not have
this is totally wrong and not what these
things do
this one's no matter what now
wow what run Flags run flag
oh that's really actually that's really
annoying I want to add an assert for
that
if
uh
okay
cert K in
now
um
I want to say that it's in instruction
what
no
I like see all the flags that are in
there
I guess I could parse one and then
uses like a template
whatever don't make typos I'm gonna make
that mistake again I can tell already
if I don't make this work I'm gonna make
this mistake again
now it doesn't work
um on flag equals three but what were my
tests even doing then
I said project before one
it's the only one that doesn't run is
that one oh that's like a knot oh I see
okay
um
so zero and two mean always but one
means like it's like not
see what I'm saying
no it can't be that because
when I said Fairview equal to two
with zero they all moved
what oh no not this last one
oh yeah okay
so run flag equals one means
uh
run if
equal to zero run if equal to one
uh run if cred
uh crab rag
this
is run if prayer drag equal to one and
this is run if I drag is equal to zero
does that make sense
uh now you'll see we'll do a test here
where we'll flip this around and we'll
get the opposite Behavior
wait
what
no
no okay okay hang on hang on hang on one
flag and predragger backwards
go get it
foreign
we got some stuff wrong
because that's not right
so the gate
[Music]
wow and I was so arrogant I think we'd
say we could only gate on the first
three or something I don't know this is
right
foreign
flag here
two and three are the ones that matter
so like two four and five
so easy to get this stuff wrong when
it's you only get one bid on these right
like the on the equals and stuff you get
you get a lot of uh
setting two four and five okay
this just might be totally wrong
um
zero one two three four five
we have the two fours and fives
we have more than the two is fours and
fives
we have zero
two
doesn't make any sense
zero two unless
okay that runs them all
use cred
let's call that gate
[Music]
[Music]
okay that's at zero
one
and three
which we had
two four and five set
right that's definitely something
okay I mean at least we have pred rag in
the right place now
now the zero one three
and it only runs it if
yeah
it only runs it okay
um
run
Chef Fred rag
because that's if that's zero because
that one's zero that one zero that one's
one and that's the same pattern as that
right
okay who thinks run flag is bogus then
and just as a part of prefix
these are gated on predrex zero did we
set preterick zero
possible run flag invert set
which is this is a lot of bits to devote
to this
interesting
I mean this might just be real I don't
know
okay now we're getting two
okay that's right
um
not pred
wow okay so let's do both five bits to
that
I mean I don't know it's a large thing
maybe that's fine
we just need we need to like clean this
up now
is this this uh this stuff's becoming
unwieldy
okay I kind of don't think run flag's
real I think it's part of prefix
and the reason I think it's not but
ah okay let me just modify my
disassembler quickly
if k equals um
GATE program or not pred gate
eight
red tag or not cred
uh DD sub gate
uh
but actually not pred means
we want not not bread
that's what's really called
uh
called yes Brad
or you know what we'll just call it um
it's just ended with it you see what I
mean
if they match let's check your quality
yes that's a fine name
uh if you gay if
not DDS spread
um let me see if DP equals quotes
equals not
uh
and then
here we'll say PP sub4s
plus equals
so now we can see without having to
clutter up my disassembler
uh
without a declutter at my disassembler
if things are gated right
um so like for example we can go down
here and just change all these yes creds
to
zero
how sharp is that
I want to right justify the string I
don't know how to do that though
um okay and then that's going to be
these ones are these four are match
those four and the other ones are not
those four okay okay that all seems
right then
all right so then it like
uh run flag
who thinks run flag's real
what's it next to
next to yes pred
no that doesn't seem they really do how
many bits do they develop to this it
does seem weird the prefix is 17 bits
though
I mean we can give one more to M size
Maybe
whatever
make it 17.
those are all going to become 40s these
are 40s
experiments
40 40.
uh and these become fives
okay cool
all right that was a good puzzle to
solve
hmm
okay so these ones are gated on
these two are gated on oh yeah it's
checked there
because that's a ulti here
so a check so those two are gated on
zero
yeah tiny guide should work on Raspberry
Pi GPO though not well because the
Raspberry Pi is a terrible GPU
Apple built a custom Isa it's pretty
cool
all right
it's the next mystery to solve
foreign
prefix now
they're just uh
I don't think that's gonna be actually
we're going to change M offset I don't
like IM offset anymore and we're going
to call it
V offset
seem right
it's like this is like the vector
I mean that's not the op maybe that's
actually the register
could five and six be special registers
now it's not B float 16 and this is one
of the reasons that training would be
tricky is it's only uh you a day
um look at all this fancy stuff
I feel like it's going to have to be
things like that
all right
and the prefix goes crazy here you know
what I don't think that's right
I don't think M offset is right I think
it's V offset
foreign
bug catcher worked
um
all right because this is the vector
offset
I don't know v-op is even right that
could just be v-reg
you know what I mean
like it pushes it to uh
I had so much more docs on this
somewhere I forget where
it strings the uh
scalar load scalar in sub scalar brand
drag
well now the only reason to think this
is a v-op is because like look at this
we understand everything about this
instruction and we know what it's doing
and it's got to just be doing a five
right because
otherwise
we don't have an operation we just have
registers
not doing any scalar operation we
confirm we could move out the scalar
operation
all right so this function is supposedly
a dense Matrix multiplied and let's go
back to div 220.
foreign
because that just that actually belongs
on in size
there's only two there
though why do I think vop
five and six well that actually uses all
the things
right
uses the same one that that two uses
even though I know that 2 is wrong
uh but that's just because it has a
different prefix
this one determines like the length of
the program
foreign
no the security you see here's the thing
there's reverse engineering and there's
security
and everyone who wants to work in like
Security today I don't know I'm not
going to say everyone but almost
everyone I meet's a loser right like and
and here's why it's it's like they're
they're
some sort of prestige that like oh I
work in security oh I find binary
exploits keep the internet safe oh my
God
like it's the people like this who ruin
it right and and you know back in the
day
that's not what this stuff was
right this stuff was
hacking iPhones was is absolutely
valueless as as hacking the Google Coral
uh and that's what was cool about it
okay like it wasn't um
you you didn't have these people yet who
showed up who like oh this is what I'm
going to do I consider myself an
information security professional right
and and these people showed up and they
ruined like
a lot of old school hacker culture
around this and I guess what upsets me
more is that not everybody really sees
the difference
right
there not everybody really sees like
what's wrong with this
they think it's just the same stuff and
it's not it's really morphed and they're
the kind of people who do it have really
morphed I know this isn't like terrible
um you know obviously read the evolution
of subcultures and this is just what
happens to subcultures but
uh
I don't do any of that stuff anymore any
of any any reverse engineering that may
have like value to somebody in terms of
a weaponized exploit not touching it
right
um red teaming pen testing uh security
audits bug bounties all this stuff I
wouldn't touch it with the 10 football
uh it's it's nothing like the stuff that
I started doing
um like would it be cool to like if this
thing had like you know secure firmware
that we have to dump to find a buffer
overflow like you know you know where I
do find that this stuff kind of still
lives and it's really cool I like
watching these videos the people who are
doing the uh like like console uh
hacking not not not not like PS3 kind of
stuff I mean like the kind of stuff
where people are doing a PS5 or whatever
whatever where people like hack Pokemon
yellow and they can like hit a certain
uh key combination to get arbitrary code
execution inside Pokemon like the Mario
that live modifies itself these people
man that's hacker culture man
foreign
people out man and then they come and
they bring you the money and it's great
man
missing no yeah I just watched the video
and I got like break it down broke it
down like that's cool
what's up three
why is it 26 bits that's a really
upsetting number of bits
26.
why 26. you know it's not 26 bits
these
three are correct
um
these four are correct
unknown
this is the stuff I kind of just made up
um IM size may very well not be in size
I just made it line up there
uh oh what is what is inner size down
there
what if M size and v-op are the same
thing did I have them combined before
I feel like I might have I have no
reason to believe that v-op's actually a
thing and it's not just part of M size
foreign
yeah I had them combined before I have
no reason to believe that that v-op's
actually a thing and this isn't just in
size equals 1400. oh no but okay I did
have reason for that
and it's because I could change it and
it wouldn't change anything
if I change you you can go here and you
can type anything in IM size and it
doesn't do anything
like 3ff is Max
foreign
those could be changed independently uh
I wonder if M size could steal some off
a prefix
the wrong direction right because I do
know that M size has to be correct for
that
so it's probably just
um
[Music]
no sure do look like something right
foreign
that does look like a proper break right
it was a video game guys you know it's
the same thing
how can I be clear-minded I don't know I
mean I'm probably starting to fade what
don't you guys work eight hours like
this is just what I'm doing instead of a
job you know what do you do at work all
day do you not work for eight hours
oh and you wonder why I think remote
works a crock of shit
you guys have jobs like nine to five
jobs
where you go work for eight hours you
take a bit of a lunch break like
you know this is what I did instead of
work today yeah if I came home from work
and then did eight more hours of work
and then kind of be a lot of work I mean
not that I haven't done that but I
couldn't do that every day we're getting
kind of tired you know what I mean
uh I don't know I'm gonna like chill
read watching TV maybe play some chess
uh you know I'm gonna figure out
80 timer job you nothing and what kind
of job do you have man
like I've never done nothing at a job
foreign
don't mess with me man
I'll just I'll just like uh
it'll just it'll just it'll mess up like
me thinking about stuff
I don't know maybe that's not true
there's probably some like
good actual advice about this that's
been a cool thing about about Chas Evan
reading and like there's like clear ways
that people improve
why does that have an slop of 20. I
thought 20 did nothing
why does it have a prefix of 4A
all right okay
we have the opening and the closing
what's my rating about 1200
uh
yeah and you say the S wow if the
average worker really works two and a
half hours a day if people are like
where is productivity going in America
like
um
yeah you're a 500K TC business developer
and SF like all these people you know
bro like you know you should be fired
man and I'm just like look look hey
I respect the hustle and you know you
know how I feel about this right you
want to scam people
that's fine now my favorite kind of
scammer is the kind of person who
straight up tells you it's a scam
uh like to everybody's face and they're
just honest with everybody about it
right but look I'm even that's even a
lot to ask from people right
the only kind of person who I won't
tolerate is the kind of person who lies
to themself right the kind of person
who's like look like no you don't
understand it creates no no
[Music]
that's the person I can't tolerate
and guys
you do have to tolerate everybody we
live in a democracy that's right
no no no no no no no no no no no no no
no no no no no no
um
um
let's try the dense Mall program let's
run it
now we're going to have to put back in
the uh
getting out the tensor
look at that ff00ff00
what if I put like a two
oh it's because we didn't load the
weights
well we didn't run the program that
loads the weights
and for some reason they're separate
programs
it's kind of terrible
uh
yeah exactly people you know people
always saying this shit about like how
social media is destroying their
attention bro what did you do before
social media oh well I used to read a
novel every weekend but no no you did
dumbass shit every weekend before too
now you dumbass shit on a cell phone
right and that has whatever people
complain about phones I'm always like
what do you think the people were doing
before phones that was so great no the
same people who read books today read
books back then and the same people who
couldn't read books back then still
can't read books today
reading it's hard guys not everyone can
do it
no like there's books I can't read this
book is just too hard for me you know
everyone watch TV oh before TV everybody
was like Ben Franklin composing eloquent
letters to each other no they weren't
you just see a lot more dumbasses today
on the internet and then you can talk
about this is the reason for the great
sjw freak out of 2014 right like
for the first time on social media these
people were forced to be exposed to
people who didn't agree with them
I'm sorry not everybody agrees with you
not everybody agrees with me like I
posted on Instagram yesterday I really
like this comment some guy wrote on
Reddit and then some guy on Twitter
right away I'll quote it because it was
good I'll quote I'll quote it
a quota we're talking talking about uh
you know me being a comma uh and so
since my Instagram is fair and balanced
we should include the other perspective
referring to me I've absolutely hated
this moron since day one it was good for
comma it was not good for Kama to have
him involved guy is a straight up
lunatic glad he's putting his smug head
down and walking off in absolute shame
still love and support comma but this
guy definitely needs to hang the Hat up
and ride off into the sunset
foreign
cool bro cool story bro
we haven't gotta be fair and balanced
you know we gotta investigate
perspectives
distraction look man
people always got distracted by things
genuinely don't think he's a troll
you can go find them on Twitter the
comic book guy right
I'll be back
foreign
but I can read a book without getting
distracted
wait why are we back on the dead beef
oh why didn't that work
what
oh did I keep that break point around or
something
[Music]
or 20.
foreign
literally just setting my I'm just
passing in the code for div210 right
right there
what happened
what did I break
I mean the personality database is an
entp
is that a good thing
what did I break
[Music]
oh do I have to send in 10 as well
I probably have to send in 10. I just
multiply that by two
yeah okay cool
be conscious is God in such rotten
responses
and all of this controversy circles me
and it seems that the media immediately
I think some of the thing is is just
moving things around in like Rams and
those things are just Ram addresses
uh okay 7B 0 and
these two are different
I mean that okay that's an interesting
thing to focus on just right there
all right
we have div 210
and we have div 220.
let's look at those let's see how
they're different
now this is actually going to error out
yeah because we didn't send enough
information and it's upset with me
so prefix all right first thing that
obviously stands out to me is prefix is
not prefix right
this at least these first two bytes in
prefix
are uh those four
probably actually belong to M size
because there's no way like this is
changing
there's no way this is changing actual
uh
control flow of the program
I'm also now skeptical of vs reg too
right I think about 19 versus d
why do I think vs Rags a thing
okay what if I took
all right
this did okay
these two don't make any sense
all right the fact that
that changed
doesn't make sense okay let's let's Also
let's compare the inputs as well
um we solve a Mysteries we out here
solving Mysteries
does it look interesting two d0
[Music]
and 2e0
wait what
I'm going to change it to 10 it now has
a
that doesn't make sense
it now Gates that on our on a register
it now Gates it on seven
no like I just don't believe that
now see those are all merged together
that means something else here damn it
foreign
did it really allocate the registers
differently
that one I kind of Might believe
that's only that one that's different 6B
0.
Six B zero
hmm
why do I think okay vs rag
yeah that's not always right either
it is right sometimes though
how is this div 2 and this relu
oh maybe sometime it's an OP
and like that's the two off and that's
the Rel you up
okay let's compile a few more things
um
let's first make sure we actually get
this again when we do div two
oh we gotta help out with wildfires or
something
Someday I'm gonna take notes
of all these people and vote for the
opposite what they tell me to vote for
and then if enough people did that guys
we could be a movement you know
if temp
prog00
give two this guy's the same
all right
um I don't know let's add two
add one
okay Six B zeros only one is different
foreign
[Music]
s numbers
what else can we do EXP
illegal scale in
vlog
tensorflow has no log log 2.
tensorflow have a log 2.
tensorflow has no log tail
oh math log oh of course
that's math
illegal scale INF
I don't know what if I go only from zero
there we go
oh
doesn't work
can we compile XP
no we can't
we compile sigmoid
sigmoid everyone loves sigmoid right
that's like someone's favorite function
somewhere oh logistic
no that one's longer
interesting
I wonder what's different
sigmoid
wow it starts really early being
different
all right uh what else can we try
I don't know sub
I feel like this one's gonna be a lot
like ad
okay
wait what
that one's only 810 long
how is that one shorter
I don't even know man
one short
because it doesn't do any math
how come when you add one
you have to do all this stuff but when
you sub one you don't have to
it starts being different at three C
zero
looks the same to me
I don't really want to do someone
okay
I mean
that looks pretty obvious to me
that that's actually all just one thing
that's all one uh
Actually I don't even know
you think it's that or maybe not
foreign
thing I guess is that I bet v offset and
V off are fused okay how do I do how do
I do uh
how many unions
can I do this
fields that do not work and fail Union
great
you know I hated unions
[Music]
this is a hard resetf challenge yeah
right
foreign
look at this and I kind of think that
like these are merged into one here
these ones are pretty well understood
like this is only when it's a scalar
instruction
I just don't know when it's a vector
instruction
like here we don't know
that prefix could mean interpret it
totally differently
actually B is missing the four
B is missing that that four right
so I think that means to interpret it
differently right because
you like
this is right
oh that's right
yeah so like
this one doesn't have the four and this
one does
foreign
it's in all of these
that like tells you if it's a scalar
instruction or something
oh we've made a lot of progress
we haven't found anything with control
flow yet
and we know there has to be
something why I'd give to 20. we know
there has to be controllable
and we have an idea of where it has to
be too
oh that's just complaining about that
all right nobody runs at all
I don't think this is actually like not
six right I think this is like when it's
interpreted the other way
these things are all correct
hmm
if prefix is 40 should we uh should we
decompile it
maybe that'll have things start to make
sense
this is like a vector scalar push
operation
holds things into
what is this eight
actually that's a good point we have no
reason to believe that
we know there's that special bit in
prefix for the 40 but we have no reason
to believe there aren't like six there
that we can factor out
[Music]
does that mean hold which one means halt
oh and she knows that even holds
doesn't do anything different
foreign
oh actually wait
it's because I'm not even running this
program again
[Music]
current PC is 11.
uh which bit means that
not the eight the eight doesn't matter
and look it continues to run
um
well it's on the two there
I don't see any other twos
foreign
it's like 8 42 here for some reason but
I don't really know what the rate does
that could mean something totally
different
knobs
foreign
ER for Edge TPU open source well shit if
it was open source we wouldn't have to
do this all right
that's it that's today
um
we made good progress
you figure out all the scalar operations
we figured out how this instruction
gating works we figured out how to at
least send the USB status even if we
don't fully understand it
um
welcome
uh
maybe I'll do this more tomorrow I don't
know
hey Google you want to send me some docs
I'd appreciate some docs let me check my
email and see if I got any Docs
send me Docs
no Docs
all right
thanks for watching guys
have a good night
Good morning, Twitch. Good morning. Good
morning. Good morning. We got Tiny Grad
up here. Tiny is
looking not so tiny anymore. It's
growing. And this is a great uh No, not
Kai. Where am I
going? Let's go to Geohot. Here we go.
Tiny. Look how many stars Tiny Grat has.
496 stars. If everybody on this stream
today gives Tiny Grat a star, we can
have 1,000 stars. And for every thousand
stars, we can exchange them for a killer
star. Not really sure what a killer star
is, but we can probably get them if we
have 1,000 stars. Doesn't that make
sense? You know what a million stars is?
A mega star.
Who likes my my uh my my stream title?
We're going to investigate voter fruid.
I'm not really sure what voter fruid is,
but we're going to investigate it.
[Laughter]
Um we'll see if they ban me for
investigating voter fluid.
Um, no, no, no. What we're actually
doing right now is we are
uh going to work on our
GPU invest in
investigation. You know, we don't talk
about self-driving on this channel. Um,
we don't talk about politics unless it's
funny. If there's lols involved, that's
always good. You know, you know, we like
the LOLs. You guys know personally, I
believe we should abolish governments
and replace them with
blockchains. So,
uh, let's go. Let's go. Let's
go. Um, so we have
uh I just got working in my test emnest.
We have a
test called test sgd
GPU and now we are training. We can
train an emnest model on the GPU. Now
the problem with this is it does take
twice as long as on the CPU. Uh sorry by
twice I mean 10 times. So uh if you like
things that are slow uh you might want
to consider using the GPU in Tinyad.
Why is it slower? Shouldn't the GPU be
faster? Well, part of it is because we
wrote really, really crappy
code. The other thing about the title, I
mean, I thought about spelling it
correctly, but I think that might
actually take it too far and I might
actually get banned.
Um, you guys know that we are we are
against censorship. We believe in free
speech on this channel. We believe in
free speech and we believe in
blockchain. Um, can I back up and
explain what Tiny Grat is and why we
wrote it? You know, oh my god, the wise.
You guys know about the wise. We don't
do wise. We don't do wise on this
channel. We only
do
house. on a gateway to talk about
politics. Just imagine, just imagine all
the votes were put in a
blockchain and then there'd be no voter
fluid because we just have a blockchain.
You can't do fluid on a blockchain.
That's against the rules of the
blockchain. Replace politicians with
toddlers. I like that. I like that
plan. I mean, what if we just did that?
What if we actually made a toddler
president?
You have to be at least 35. Yeah, but
what if we made a toddler president and
we like really as a country tried our
best to like interpret his wishes?
Yeah, but laws can be changed.
Alex like a
2-year-old whatever the 2-year-old does,
we try our best to do as a
country. Um,
hey, I stole it from Twitch
chat.
Um, so yeah, unfortunately it's slower
on the GPU and probably because we're
doing dispatches and stuff. GPUs really
only get fast. Well, maybe we should
write a
profiler. Should we write a profiler?
How do I manage to always look that
good? The answer is blood transfusions
from young kids.
What? Meth. Oh, meth. Yeah. Yeah. Yeah.
That was that was the Yeah. It turns out
Turns out meth's actually good for you.
Wow. You know, they've been lying to
you, man. All the anti-meth people. You
know, they keep all the meth for
themselves. The dentist don't want you
to know. The dentist doesn't want you to
know. That's true. Oh, I went to the
dentist.
Um, please don't talk about politics.
Don't even do it jokingly. Some people
might actually believe it. Stop using
your voice for I don't know.
Yeah, but they're not a subscriber, so
you know, their opinion has less value
than people who subscribe.
No, it's not Python probably. It's
probably the CL calls or it's probably
really because I wrote these kernels
super badly. Okay,
so if you guys can be helpful, you want
to be helpful. Who wants to be helpful?
See what the issues are. Oh, I fixed
this issue. Uh, just tell this guy that
he has to clear his cash. I don't know
who wrote the caching code so badly.
Probably me.
Um, fun. No, you guys want to learn
something real, I'll teach you something
real on this stream.
Um, I fixed this while I was in the
bathroom at the coffee shop, so uh, you
know, you didn't get to see it. But you
see how this see how I use this pattern
here where I open a temp file and then I
move the file into its correct place. If
you don't do this, um, it's very easy to
get corrupt files like where this open
will succeed. Actually, this is really
bad. This also shouldn't even be in
here.
Like first you want to fetch it, then
you want to write it and then rename. So
you do this because it's atomic.
OS.reame is atomic. Well obviously open
right close is not
atomic. Um so that's why this failed
here because he probably only half
downloaded the uh the efficient net uh
weights. So he can clear his cache and
someone should tell him to do that and
then download the latest version. Um
well, you know, some people just spell
things wrong. Uh, many GPU ops are
missing. Here's where you guys can help.
So, you guys can check off log softmax
because I wrote that one this
morning. Um, this one should just work
right away on the GPU. I don't think
that should be a problem. That one
should be very easy to write. So,
somebody can write reshape. Uh, somebody
can write pad 2D, comp 2D, max pool 2D,
and average pool 2D. So, if somebody can
do that while we're streaming, I'll
write a profiler and we can start seeing
if we can get some speed out of this
GPU. So you guys know Tiny actually has
a few goals now. Tiny is becoming more
real. Every day I pour hundreds of hours
into it. By hundreds of hours I mean I
work on it on the weekends with you guys
on Twitch for entertainment.
Um
so to do train an image net on efficient
net um make it
work tiny work on comma 2 and run
driving
model. Uh so you know we don't talk
about commi in the stream but we can uh
talk about it a little bit. Uh so right
now on the comma 2 we're using this
thing called SNPE. Uh S&P is written by
Qualcomm. Uh it's okay. It's not bad
but there's a few there's a few things
that are wrong with it. So one of them
is I wrote this thing which sits on top
underneath SNP and just replays the
exact same instructions to the GPU
driver uh at the user kernel interface.
Uh so this is nice but it would be
easier to do if you didn't have to
intercept
uh the calls and you actually just were
well that the need wouldn't even change
that much but um the other thing we can
then do is start really rising these
kernels. So there's this library in
Nvidia called cudnn and cudnn is part of
the reason okay so so so let's let's
step back. I'm going to try my best to
convey ideas. I had some cold brew
coffee this morning so I'm really amped
up. really amped up, boys. But our goal
on this stream is to investigate
Vodafruit. No. Um is to take down
Nvidia. Yes. Yes, that's true. That's
true. ATI released these beautiful,
sorry, AMD released these beautiful new
GPUs. Now, unfortunately, part of the
problem with these beautiful new GPUs is
the software is all shitty.
But if we could write some good software
for these GPUs, if we could just train
efficient nets faster on these AMD GPUs,
then you can train them on Nvidia GPUs,
we can we can, you know, help take a
bite out of Nvidia. And yeah, but okay.
Unfortunately, ATI put them in st AMD
put them in stupid cases. So, if someone
knows where you can get a blower fan for
this GPU, I'd be very excited. I'd buy a
whole lot of them. Um, by a whole lot of
them I mean like just two. But we got to
start somewhere. And then if we can get
efficient net training to run faster on
these than the Nvidia. Now I have a few
hopes for this
too. When you look I think it's like
tech power up that breaks down the GPU
specs. Yeah. This this is what gives me
hope. So, the Nvidia GPUs have like
double the RAM bandwidth
uh from the AMD GPUs. The Nvidia ones
almost have almost have a terabyte per
second. By the way, that's that's a
terabyte. So, it only has 512, but it
has this 128meg cache. So, when you look
at this,
um, so let's go to we'll look at like a
3080.
380s I believe only have five megs of
cache. Yeah, they don't have an L3
cache. They only have five megs of
cache. Yet, if I look at the
A100, it has 40 megs of cache. So, when
you're doing a matrix multiplication,
like say you're doing a matrix
multiplication of like two
um let's say 10,024 matrices. So, 1024
x024, 1024 by 10,24. Quick chat. What's
the complexity of matrix
multiplication? Nvidia BTFO definitely
allowed. Uh N cubed. Thank you JD Paul
Blart. This guy knows. Uh Zazen said
two. You were close. Um it's n cubed.
Now the thing about it being n cubed is
that's compute. So how many how many
accesses how many memory accesses is it?
Well, yeah, yeah, yeah, yeah, yeah. You
guys want to talk about like what are
what are what are those things called?
Strassen, you can get a little lower and
then there's some papers. But how many
memories accesses is it? N squared.
Yeah. So, it's a lot less memory access.
Oh, of N squ. It's it's actually 2 N 2 N
squ um system's like 2.7, but it's N
squ. So, there's a lot less memory
accesses than there are computes. But
the problem with that is if you're doing
matrix multiplications, unless you're
super cache coherent,
um you know, you're going to end up
actually I think even if you're not, we
can write a simulator for this if we
really cared. But my point is if we
don't have to if we can load the two
matrices entirely into
cache and then do the multiply on them,
this is great. Now, unfortunately, when
you only have five megs of cache, you're
not going to fit them both in cache if
they're float 32.
Um, but if you have 128 megs of cache, I
think in AMD's been calling this the
infinity cache. So, it gives me hope for
this GPU helping to take a bite out of
Nvidia. Now, where does Tiny come in?
Tiny is just a very simple way to
experiment with
uh like we can experiment with
convolution kernels. we can experiment
with. You only have to write a few ops
in order to get the efficient net to
work. Um, and you should only also have
to write those same few ops to get the
efficient net to work backwards. So, if
we can train imageet faster on a single
AMD GPU
um than on an Nvidia GPU, we're we're
we're winning and we can write our own
uh CDN. Now, how do we actually do this?
Well, so ADI has all these things like
like sorry AMD has all these things like
um Rockm where they're really pushing
down to
uh they want to like expose I don't even
really understand it because Open CL is
all in user space. The compiler for Open
CL that turns Open CL into GPU assembly
instructions is all in user space. So we
could theoretically just fix all of this
in user space, write our own uh assembly
versions of these kernels. We can do the
same search Nvidia does for Cudnn and we
can build super fast um kernels for coms
and matrix multiplies. And then uh and
then you know this is all leading up to
eventually building our own GPU
accelerators, right? you know, Tiny
Grad, the officially supported
uh uh when we make our own Tesla chips,
right? But first, we should move our
stuff
uh over to over to Tiny Grad. You're
never going to really get PyTorch.
PieTorch is deeply baked in with the uh
with Nvidia. Like, there's no nice way
to plug in Open CL to it. But if we can
get our driving model running in here,
um, we can get it running faster. We can
use to sit under the driver. The Python
doesn't matter. That completely cuts the
Python out. All right.
This Yeah,
but a lot of AMD's APIs for ML are just
straight up ripoffs of um of
Nvidia. If you look at like so Nvidia
has this thing nickel which does
like
what isn't this
working? What? Why can't
I What's going on?
Do I have a broken key or
something? What's going
on? It's like my arrow key is stuck
down. No, I'm I'm not touching the
computer.
Dude, that was weird.
That was
weird. Okay,
whatever. I think if we got hacked, I
don't think they would have held down
the right arrow key.
Yeah, hackers. Did you hear that? You're
lame. Why don't you go investigate some
voter
fluid? Uh,
okay. Are we going to have to write
those other ops? What did I say we were
going to write? We're going to write a
profiler fetch. Ran out of input fix.
[Music]
Ooh. H
what?
He's He's playing some golfs. Yeah, we
can we can we can merge this in.
Okay,
fast
slow. We just have to if I write the
com, we can All right, I'll write the
comm first because I do want GPUs to be
fast and we can we can have fun writing
a
comp. GPU should be very good at com, I
think.
Okay, tiny
grad. Okay, let's first write the
test. Um, tiny
comat. Oh, we also have to move Adam to
uh well, we'll deal with that later.
I wrote my optimizers to operate at like
the data level, not at the tensor level.
I fixed SGD, but I didn't fix atom. So,
if somebody wants to fix Adam, uh, I'd
appreciate
you. Yeah, that doesn't
work. I shouldn't actually need that
anymore. See, again, every time I put
dot data, it was a terrible hack, and I
deeply regret doing it.
should that should just work right
now. Tupil has no attribute
data. Oh, because it's not a
tensor. Um, let me see my reshape.
Where do I use that
reshape? Do it like
that should work. Okay, I think unless
there's other places where there's
problems. Shape is not defined.
Oh, no. Actually, I don't even need to
change that. I just need to pass it in
as a keyword argument. I think I
actually already do that in a few
places. Okay, good. Is it faster? It
feels
faster. Maybe it's just the coms got
faster. Wow, that's pretty good. That
trains so fast
now. All right, let's test GPU. And we
don't have a GPU op reshape. So, that'll
be the first one we write. Then you guys
can go into the issue and check it off,
you
know. All right. All right. Zoom in so I
can see the monitor. Yeah. Yeah. Yeah.
Okay. So, on the left I have the CPU ops
and on the right I have the GPU
ops. When I plug it in, I get tiny
electric shocks in my
hand. Uh, so I think we don't actually
have to. I could just say
X.shape equals
shape. Yeah, the power of
GPU grad output.shape equals
inshape. In
shape key error reshape copy the
register. No, it registers.
What?
What? Why didn't that
work?
Oh.
Okay, now the com doesn't work. Really
think it's worth writing a test for
reshape. Skip on GPU.
getting coms to
work.
Whoa, there's a lot of
wind. Chat saying anything good?
What is tiny grand a city in
Russia? I like that. If someone fits
that as a good tagline into the read me,
I'll merge
it. Got his eyes on tiny dad.
Wow, that got
long. Okay, so we already have a test
for getting coms to work on the GPU.
Test ops GPU test com
2D ker conf
2D. Wow, the GPU ops is getting long.
Oh my god, writing this sounds kind of
brutal. Maybe it won't be too bad.
copy all
that. Oh, this is going to make tiny
grad too large for
sure. All right. Do you guys know what a
convolution is?
And then what's our output size to the
convolution?
Okay, so we will
say red equals buffer new
uh ctx and then the output size of the
convolution which is
Uh, BS cow that
that we'll pass in X and W here.
And
then this is so
annoying. And I guess theoretically we
could launch a 4D thing
here. Like one for each output kind
of. I'm gonna have to pass all these
stupid numbers in. Oh, this is so
annoying.
Yeah.
I'm not even sure that's allowed.
have to pass in all these stupid
arguments.
What did I do wrong?
Oh, invalid work dimension. Okay, you
can't do that.
Maybe that. Yeah.
Okay. Okay. So, we're going to have to
do the channels
locally. Then our weight matrix is
channels out, channels in, height,
width, and we're going to have to pass
in all these stupid arguments. We have
to make groups work. This is such a
pain. But this is how you learn. You'll
never not understand what a convolution
is again. after you write this kind of
stuff. Chad have anything good to say?
Going to fork tiny grad. Do
it. There's no way to do some of the
kernel part. Light of hell. Thank you
for subscribing.
I dream of an economy where anyone can
pick up work and go have fun completing
jobs with friends. I think you're
describing World of
Warcraft. How can we contribute to Tiny?
So, what's on the to-do list? So, I'm
implementing the comms right now. If you
guys want to implement the pools, that
would be great. Um, the pools are great.
Okay, let's pass in int h and int w
for all right we have these get global
ids so we'll say this one
is no we almost actually don't want to
pass in batch
here. Let's pass in
that. And then we can have the batch be
the
loop. Um, we'll say this
is see out x
y see out
yx. Um, and we got to pass in oi and ox.
is going to complain and be like, "You
passed in too many numbers
uh for and y
um call that big y and big x or int y
equals y
uh y less than y + h y
plus+. No, the other way around.
We need a big loop for the
batch. Okay.
act plus equ= x
sub. All right. So, what are the x
dimensions? We can compute
that, can we?
out plus B times
uh
Uh C out time a Y * O
X
plus P times C out times
right now.
Plus C
* O Y O X + X * O X
+
X. Is that
right? Range Z to Y. Range Z to O X.
All right, we need to know the channels
in B *
S times
uh we'll say IY IIX for the input Y and
the input
X
plus Oh, none of this is fast at all.
It's like going to do all these stupid
multiplies every time.
All right, we'll just say
offset
equals
this and then offset plus
equals that.
That's actually less important than
making sure that inner loop is fast.
All right. You know what? Let's just
write it slow and then we'll make it
fast. Don't want to prematurely optimize
Then we'll write some benchmarks to make
this stuff mad fast. Not yet.
Okay. Am I doing this right with like
the channels and the batches? I believe
so because then I can cache the whole
weight matrix and
like in that kernel
right I don't
know C times
There has to be better ways to write
this. Yeah, strided me access patterns
to prevent bank conflicts and stuff.
That seems
good. We don't want
There are great tests. Don't worry about
that.
Oh, this is terrible.
Maybe don't actually want
that. I think doing it by batch is
easier.
We also have to loop the
channels. This is really hard to keep
straight. And it's going to be super
slow. Okay. For each channel, we're
going to
accumulate going to accumulate how many
we're going to accumulate channel out
amounts. But I think we're still going
to have to loop over channels
in. Yeah, that's
right. Wow, these things are so much
compute. See, this is why using numpy is
cheating. And here I'm writing it. I
mean, this is like writing in C, except
it's in Open CL, which kind of looks
like C, but isn't C.
Wait. So
the Am I not doing this right?
What's a fixed offset?
This is going to be so slow.
We have to multiply this by the same in
the weight matrix which doesn't have a
batch index. So the weight matrix is
channels out channels in height width.
So we
have C * channels in time height time
width plus
um this time height time width plus
uh oh no
it's I mean I guess we could say y -
h times
width
+ x -
width. Oh, that's so slow. Oh, that's
going to be
brutal. Well, we have a test. Let's
see. Bajillions of
errors. Invalid operand to binary
expression. Are some of those floats?
CL program build failure. Oh,
redefinition of W because W is weight.
Okay, we'll call them capital H and
capital W.
Then that's really annoying
because okay subscripted value is not an
array pointer or vector. That's because
I called my input X as well. So we can't
actually call that loop
X. Just call it maybe. No, I already
used ix. Oh, this is
annoying.
input and then just for clarity instead
of W we'll call it
weight and then to kind of complete the
we should call this
output. Okay, input weight output. If
we're clear in our variable names, we're
clear in our
thinking. Use of undeclared W. Don't use
W. Use capital
W. Okay, that's fine. We just need to
add the other arguments. Okay, so we
have the height which is NP32 height.
Good. I already called it capital.
That's consistent. We have the width. We
have C out. We have C in. We
have
Oi. We have
OX. Um, and then we
have We should actually just call them
this, right? I didn't use like IY or IX
or anything,
right? I Y I equals Well, I can just put
them here. I Y IIIX equals X
doshape. And then here we can just call
this
IY. And here we can call this
ix. We haven't even gotten to fancy shit
like strides and stuff, but we'll get to
that in a
minute. Okay. Work, work, work, work,
work. Well, it didn't work. Why am I not
surprised? Of course it didn't work.
Look at how complicated this crap is.
W and H are well
understood. Oh, did you did you want to
uh do chat want to be
useful? No, chat didn't want to be
useful. Wait, you guys can see. Okay,
right. Yeah, you guys can see. Okay,
cool.
Okay. I mean that is how you do a
convolution right?
Actually, when we copy things, we don't
actually technically ravel them and make
sure they're
correct. Uh, there shouldn't be. We're
not doing any like weird group stuff,
right? Like that's just a basic com.
Let's check the test.
Uh yeah, groups is
one, height and width are
two, batch size is
one. Should all
work. All right, we're getting some
numbers out. They're just not the right
numbers. Isn't that true? A lot of the
times in programming you get numbers
out, they're just not the right
numbers. More of the time you got the
right numbers, you know, programming
would work a lot
better.
Okay, this is just cuz there's
no right. That's right. That's
right. Same thing here.
Weights doesn't have a
batch. We accumulate over all the input
channels. See out CN
Oi. Let's just clean these up a little
bit. Okay. It's not failing at the
backward or anything.
That won't even that will just throw a
Python
error. No, not
right. Okay, it's going to range across
these three things. We're getting the
global ID.
I realized I have GitHub on my phone.
So, I can merge in some of that stuff.
Wow, Open Pilot has a lot of pull
requests on
it. So, it comes up by
default. Let's see if anyone fixed
anything on Tiny. Um, weird
refactor. No, just ran out of input
fix. We can merge that. Merge
Get stash get
pull get stash pop.
Cool. Those files changed since reading
it.
Yes. Okay. What I do wrong? Chat, you
find my bug while I was
gone. If I have some shit
code. Yeah, we got to
behave. That's right. Behave. That's
good. Chat is selfmodderating
themselves. Try some. Please excuse my
dear aunt
Sally. I didn't push my stuff. I just
merged a pull
request. So, we can we can look at what
that pull request was right here.
You know it's good. Look at look at how
long that uh comment is. You know it's
probably good. If if there's more co if
there's more writing in the commit than
there is changes to the uh the code,
it's probably high quality stuff.
What?
What are you
fine? There's another floor. Not a new
mattress. Just a
up. Just an up or a whole new
bed. Up. An up. Oh, an up. Okay. Okay. I
got a little scared there. What do you
mean a whole new bed? Whole new bed? I
don't
know. Um, if I play a whole new world on
stream, I'm going to get
muted. What if I play a whole new world
cover? A whole
new world. Let's see if there's a drum
cover. That sounds appropriate. Oh,
perfect. Love YouTube,
man. No, no, no. That's copyrighted.
Okay, come on. That's 8 seconds. That
can't be copyrighted.
This is a drum cover of a drum cover.
All
right. Cons float input. Cons float rate
global float output. We set the output
here. We loop over channels out.
for each of the channels
in. Yeah, that's right. Wow. Wow.
Convolutions are so much
compute. This is just to compute one
pixel of the output.
We really shouldn't call this BS because
it's a little confusing because it
actually ranges to BS. So we should call
it
B. Big
B. Okay. Where's the bug?
zeros
there. A suspicious amount of zeros. E
Can I move this down here?
want to
do. I like want that to show up on the
same
line. A lot of them are one now. So like
this this doesn't make sense.
Even if I got a lot of stuff wrong, it
should still work because that's one.
Okay, this is where we're reading from
in the input. We start at
Y and go to X. That might change if
there's a
stride, but we don't have any stride
right
now. for very normal
convolution. Let's print some
shapes. We don't need that. That's
stupid. This is stupid to do as well.
Okay. So that's our
X, that's our Y, and that's our
out 2x two com. You know what? Let's
even make it easier for
people. Let's try this. Let's make a one
by one comp. Does a onex one comp work?
I mean, if you can't even do a one by
one comp, right, this crap is really
useless. H, that number is right. Look,
we got a number
right. Okay, that's the input.
And then that's the
output.
Uh what did I do
wrong? Do I have like orders or
something
wrong? 128 1128 1128. Those should be
one and
one. Um like channels out has something
which is fine.
Chad, did you find the
bug? Start with a one by one
convolution. Yes. Cool. Good, good,
good. We're we're thinking along the
same wavelength. Okay, this one works.
These two don't.
So many ones.
I don't get it. But some of them work
and some of them not
work. It's just creating those shapes so
it's not like they're going to be like
reshaped weirdly. So it can't be that
issue.
We'll just p open CL for this. I could I
could dive in and debug them, but it's
not time for that
yet. Hopefully, we can still find the
bug just by looking.
Okay, this literally loops to
one. Oh, this isn't
right. This is These aren't right. These
aren't No, wait. Yes, they
are. It's literally input shape.
My pattern is the same like that matches
that height width.
Height height width. That's right.
Oh,
duh. Perfect. It worked. That's just cuz
the gradient doesn't work. But you see
how now we're failing on the backward
pass.
Boom. Fix
that.
Okay. Careful reading. Find
bug. Oh.
write the backward passes. All right,
you know what? Let's just cheat for
now and say
[Music]
forward only equals
self.gpu.
Good.
Okay, which is the first one that
doesn't work.
We're doing groups there. I think groups
are where it fails. We can print the
groups. Yeah. Okay. We move on to groups
three and that's where it fails. So we
got to write grouped convolutions. Now
this actually shouldn't be too hard
though.
Um, we have also have to make strides
work, but that also should be fairly
easy, I
believe. So, let's make groups
work. Groups mean
have to add another loop here for
groups. Yeah, groups just go before.
Okay.
Instead of see out, we'll call it RC
out. We'll say
np.in32 groups.
Okay, everything still works except for
the grouped one. And that's because we
didn't actually write the group logic
which we have to
write. Um, oh, and then we can get rid
of all these stupid multiplies.
Okay. Well, it's only going to affect
No, it also affects CN
testdriven development. Okay. Um, for
the input, does that depend on groups?
Do I have an RC
in? No. But weights depend on groups.
sort ctx times groups equals
that. I wish I actually like truly
understood this. And I wonder if anyone
really does understand it or they all
just kind of spam program like I do.
Probably not. There's probably people
who actually understand it and just I'm
not one of them. Okay. Do the groups.
That's
good. It's good for the output, but I've
heard it's like equivalent to two
convolutions being placed side by
side.
Um, yeah.
So, we actually want that input to be
like mod groups or
something because this isn't you can't
do this here.
Just write it
here. Or actually, I don't even need
that. Let's do it there.
Right.
RS arson
uh R out arson sin sin. Okay. So for the
weights I believe we still use
sin but for the
inputs we want to use
arson and then we want CI to be modded
groups.
Can I do
mod? There shouldn't be modded
groups. Maybe it
should because the normal number of
groups is
one. Sure.
Okay. Well, we know the input here. We
know that arson has to be
correct. Like is this is how everyone
does this with like dimensional analysis
or do they do it with
thinking but then this can only go up to
our
sin. Oh, we want to modded our sin, not
modded groups.
It should be right now I
think. I should have I should have
committed the one that kind of worked.
No, wait. It still kind of works. Never
mind.
um gene
groups C comma
arson that doesn't well no wait no that
has to be something we access only as
part of groups
oh I think actually wait what if we just
make that go to
arson and
then
here channels times wait is it is it The
weight is okay here this this shows the
right weight
reshape groups RC out RC
in so that C is an RC out and then here
we just multiply
uh G
* RC
out
RC wait time CN
So
hard. We're going to have to rewrite
this to not, you know, do all these
multiplies.
Terrible. G * RC out * C in * H * W plus
what ranges to RC out which is C? What
ranges to C in?
CI. Still think this might have to be
mod R sin. And
then, well, look at how many numbers
match. It's a lot of matching numbers.
We're getting close.
So this is basically
just looping over the weights which is
nice groups RC out
CNXY. So we just com go over the weights
like
that and
actually I don't want to change that. I
we could change it to not subtract there
but it's
fine. Okay. Okay. So let's think when
the groups is
full RC out is
zero. Look the numbers are so close. The
numbers are so close. It's probably just
one that doesn't match somewhere.
C ranges to RC out. So that's a correct
access. I mean, actually, it looks like
we're just accessing the weights one at
a time,
right? That's nice. That's that's
convenient for when we want to actually
write that
later. Um, we can just change the
pointer.
Okay, for the
input, the only sketchy thing we're
doing is this.
CI time RC
out. You guys find the
bug? You think you're having problems
with your GPU? No. Not all the GPU tests
pass
yet. You can fix
them. No, we're not actually
investigating voter fruit. That's a
joke. It's a joke.
Wearing clothes on stream.
I just like nude color this evening. You
want green tea? Oh, yes.
We're going to do
yoga. Yoga be calm.
What?
You know what's going to be fun? I'm not
going to write the backward pass because
that sounds brutal and terrible.
Um, we'll just do ar raise
exception. We're going to try to get
efficient net to run on the GPU. Not
implemented. We are going to fix groups
though. We got to fix
groups and then we can just work on
making this fast. That sounds fun. Fast
sounds fun. Watching me debug
my loops being slightly wrong. Thank
you. Sounds terrible.
I've heard groups are equivalent to
having
convolutions side by
side. Oh,
okay. So, maybe this actually only goes
to arson.
No, because the the weight is
that just means that I reuse different
weights for the same
inputs, which is exactly what this
should
do. Where are the numbers
wrong? Those look the same, right?
Oh, it's my input
size. Oh, I might I might just have to
do BS
groups sin.
Let's write these out and then this will
help. BS the output is groups RC out
ox. Yeah. So if my input is really is
that
right? No, that can't be my
input. So getting arson up there.
How is their input
that?
Oh,
what? Times equals
arson.
What? That's
crazy. Oh, I shouldn't have called it
that. Oh, well, that was because I named
it
stupidly. Don't even need that.
Yeah. Oh, this was
stupid. God, chat, you could have found
that. Now, if we just type groups time
sendy
*
ix. And now it doesn't work for even
anything because instead of groups we
need to do
G. And that works for all of Boom.
Tiny grad
does forward pass comms on
GPU.
Cons. I don't think they're cons. I
think they're coms.
Oh, someone wrote a convolution without
loop-de-loops. So, we don't have any
loop-de-loops either. Someone came in
and removed the loop-de-loops, too. How
many How many people do we have right
now? I can't
see. You will not win self-driving cars.
Why do you carte?
Yeah. Yeah. Why do I carte? It's a nice
hotel. Is he doing this just for an
exercise? No. I'm doing it because I'm
convinced I can write a better
convolution than other people and I'm
deluded and I have ego issues. That's
why I'm doing it.
casual. What does pog mean?
You guys, this is Saturday. This is kind
of fun, you know? It's not like it's not
like real software engineering where you
have to
like this is real software engineering
is
painful. Writing slow convolutions is
[Laughter]
fun. Oh, yeah. I'm glad you like
metamorphism and prime mineral act. It's
a good
book. It's like a Huawei made
10. Oh, Pog is good. All right, cool. I
don't know what bitch TV
is.
Um, okay. What are we still missing now
from being able to do our efficient net
on the
GPU? torch.
Let's try
to make an environment variable. If
we'll say GPU equals OS.get get m GPU
none is not none.
Perfect. Uh when we load in the
weights, we'll say if GPU
mvv.cuda and
then
GPU All
right. Does our example work on the GPU?
That'll be where we end the stream
today. I think we're going to have to
write the other things, too. I think
we're going to have to write a pool. Oh,
we're going to have to make strides
work. I didn't test strided
convolutions. Okay, we'll make strides
work. We'll do that now.
My Python 3 test
ops. Oh, so slow. Brutally slow. That's
so slow. Okay. Um, not equal to
tolerance because we didn't test strided
convolutions. This is should be very
easy to fix though. I think I just have
to add in a few
multiplies and we're
good. That all stays the same.
Yeah. Yeah. I just need to if I just
multiply these, I think it's fine. And I
don't multiply them for the
output. Uh what do we want to call
them? Yeah.
YS XS
And
then
yeah, how exactly do I do
this? I think I should just change these
Okay, cool. We'll have to put in that
same Oh, that was really easy. Uh, we'll
have to put in that same forward only
for the GPUs.
Perfect. That one was easy. That one was
a
gimme. Okay, we haven't written max pool
2D or average pool 2D yet. But after we
write those, all our ops will work on
the GPU except for backward convolutions
because nobody wants to write that. Did
anybody write it? Do we have a poll
request for it? Oh, you guys, you guys
are making me so happy. Is anybody
writing it? Who got my pools
working? Pool should be so easy to write
on the GPU
though. Real software engineering is a
lot of politics. Hacking shit up is
anarchy and fun. I agree with that.
What? I didn't close the pool. It was
not me. It was not me. I did not close
the
pool. Yeah, backward com is just a com
with some tricks. So, who wants to who
wants to write
it? You tried with the
pools. All right. How many people are
watching, by the way? Did you guys tell
me? Oh, 751 people investigating voter
[Laughter]
fluid. This just just so you guys
remember what it does. It downloads an
image of a chicken and then tells us
that it's a hen. That's right. Don't
misgender the chicken.
Okay. Create buffer failed. Invalid
buffer
size. What? How could my buffer have an
invalid
size? Is it too
large? Is that the problem with my
buffer? Is it too large?
We fix strides. We We'll get to where
pools don't work at the end. I don't
think we pull for a while, actually. So,
we can at least run a lot of things and
see how slow it is. Why is my buffer a
bad size? I made a good buffer. I
promise. Tiny grad. Tiny grad. No
tensor. That's it. CUDA. Where do I do
the
buffer? Zero. Oh, we can't make zero
buffer
size. What has a zero buffer size? What
even is
that? This seems like more of a bug in
the example.
Oh, numb batch is
tracked. Do I even have
that? Did I put that in my batch norm?
Oh, tensor zeros zero. That's a tragedy.
What if we make it
one? We need one zero. There we go. Now
it works. ND array is not contiguous.
Well, that's a different problem.
Um, can I ravel and then unravel? Yeah,
let's ravel the data. Who's ready to
ravel
it? I knew this was going to be a
problem at some point. And it's cuz I'm
transposing
things.
Self
data. Yeah, ravel. Oh, we got to write
pad. Oh, we didn't write pad. We gota
Who didn't write pad?
No one wrote pad
root
pad. Let's commit that. That was good
stuff. Good. We made good progress
there. Unlike staring at those stupid
convolutions forever.
[Music]
Fixided comes
um
GPU MVAR for ENET.
Good. You know, we all struggle with the
same shit, you know. I hope I hope that
watching this channel you guys can know
that this struggle is real. And yeah,
you know, it's it's no one no one just
is like able. Anybody who can just like
seamlessly do things has done it before,
right? The the whole point of
programming, the whole way you get good
at programming is you struggle. You
struggle enough and the struggling never
goes away. It just gets faster. It's a
Bojack Horseman quote. You know that
scene where Bojack is running and he
runs next to that guy and Bojack's like,
"Does it get easier?" And the guy's
like, "No, you just go faster." Or
actually the Bojack scene's not like
that, but I've heard that before, too.
The Bojack scene is it gets easier, but
you have to do it every day. And that's
true about programming, too. So, you
know, watch Bojack Horseman. We're w
We're drinking some Reishi green tea
courtesy of Alex who's over there doing
yoga. I sw solemnly swear I did not hack
the election. I'm a supporter of
election security using blockchain
technology.
And if you'll invest in my election
blockchain startup, we'll be
overthrowing the government in 10
years. Get in early. We'll do favors.
You donate to my blockchain campaign and
we will make sure that if you want
fracking, we'll do fracking. You don't
want fracking? No fracking. Guess what?
Blockchain. Kanye chain.
Ah, where can you invest? Just send
Bitcoin to the following
address. Um, all right. Who wants to
write pad 2D? That one should be easy to
write,
right? Oh, sounds
brutal. There's
np.pad. Look, nobody wrote the backwards
pass of pad either.
We want like GPU mem copy
basically. Well, until we write pad,
it's not going to run. So, I guess we
just got to start doing it. You know,
sometimes that's what you got to do.
Uh
okay. First we want to allocate a
buffer and our buffer
size
is let's get this right.
X.
Well, we can just do what is that? Copy
that from
comps in ix plus padding zero plus
padding one. Is that I might have gotten
that
backwards. Doesn't matter if I got it
backwards. I think it's symmetric
anyway. Padding two, padding
three. Um, now we need to mem copy a lot
of
shit. Yeah, we'll do with a
colonel. Wow. How long before this grows
to be too large? And we're going to have
to change the thousand line rule again
and be like, well, it doesn't count for
GPUs
cheating.
Um, damn people people are out in the
street celebrating,
boys.
input global float
output
prog
2D. Uh we want to launch it on BS and
Y. That's
right. Copy some of this from the
Cove. Say B
C
Y. Uh,
np.in32. Oh, if we make a new buffer, is
it
zeroed? I bet it's not
Which what
movie club?
We're watching what? Banned films. Ban
movies.
What's a ban
movie? Can we just Can we discuss it on
Twitch or is it not allowed? This one
sounds insane. It's from
1969. It's called Pattern of Evil. Yeah.
It was banned from entry into United
States.
Made in the UK. I thought we have
freedoms in America. No, that's what is
about what? Who took away our freedoms?
Who took Was it the communists?
Was it the
anti-communists? Who took away our
freedoms, Alex? Who took away our
freedoms?
It was refused to a country by the US
Customs Bureau on the grounds that it
was obscene and proceedings for the film
commenced with the trial. The importer
moved to dismiss the proceedings against
the film. How long before
how long before harassment architecture
is banned?
No, there was a poor guy Max Hardcore
who got who got in trouble like like
modern. I mean, I'm always interested in
what the modern obscenity is.
It was a film about lesbian
lovers and Atlanta the Georgia police
seized the film at the theater.
[Laughter]
I mean, it sounds
sounds Yeah, it's funny. But no, no, I I
I you
know Oh, I don't actually need BS ever.
I can't believe I have to go to this
much effort to write a
pad. Well, you know, we live in the era
of Pornhub.
So, good luck censoring shit.
Sex married people.
Sex positions. Married people prefer.
Oh, this one. It's called computer game
from the 70s.
A sexual maniac makes use of a computer
dating service to lure women to his home
through autootic and lesbian activity.
The police catch up with him and
terminate him and his victim of drugist.
Are we allowed to discuss this on
Twitch?
Can we discuss voter fraud?
I think that's the modern modern
obscenity. It's banned from Twitter.
Wait, it's banned from Twitter? Yeah,
try to search for it on Twitter. You
can't you can only search for the
misspellings.
Oh god. They like banned it from the
search. Yeah. Oh yeah. Yeah. Welcome to
You know what the worst part is? That
almost convinces me that almost
convinces me that there's some truth to
it. You
know, that's the problem with
censorship. Like something could be
really stupid.
Well, something could be really stupid
like a picture of, you know, Barbara
Stryand's uh house. But you know, if you
ban
it with Let me see the banned shit, man.
I want to be cool. Come on, show me the
band shit.
That's how I feel, too. I love banned
shit. Really? It's taking this long to
write pad? This is pathetic.
We're going to have to write a test for
pad. Oh, this is pathetic. I'm a
terrible programmer and I should feel
bad. No, that's
outpointer. We're just literally trying
to add some zeros around the image, but
they're not going to be zeros. And we
have to make copies, which like all
right, we'll do it with kernels, but we
won't be happy about it.
Yxy * ox
All right. And for this one, it's B time
send time. Yeah. B * Y
C. I should just copy the line below it
and then just use that again. But I
didn't do
that. And then we want to know the size
to
copy. Size is just
ex. And then we can just say input sub
no output subo pointer plus x equals
input sub i pointer plus x. Is that
going to work? I don't know. Let's write
a test and find out.
Um, GPU equals
true. Oh, I actually have to pass all
these things in.
Wow.
Oh, well shouldn't mention that on
Twitch. Twitch doesn't like edgy. That's
what I've heard.
Banned movie stream.
Yo.
Uh, I think you can search for it. I
think just the autocomplete doesn't
work.
lunch.
Yeah, probably. I stream for a bit. Know
what you want to do?
Oh, yeah. I'd get lunch at like 1. Yeah.
Yeah, that's okay.
Oh no, wait. Batch
normalization. No, that should just
work. Let's implement it. We implement
all the ops. It should just work. Okay,
let's write a test for our
pad. All right, we're going to we're
going to listen to a a band song. What
is it? Uh no. No, it's it's not a band
song. It's just copyright. Copyright is
a new censorship.
[Music]
Okay.
Forward only equals
true. Okay. It works on the CPU.
It does not work on the GPU because it
didn't make
zeros. This doesn't work at
all. Really? I can't even write pad
right. Ah, don't multiply by an ax.
Multiply by an x.
Did one of you catch that? I'll be proud
of chat if someone caught
[Music]
that. No, you remain determined to be
opposed. Admittance requires no
qualifications. It's where everybody's
been and where everybody goes.
buffer. New. We want to zero the buffer.
Can we zero the
buffer? Guys, hating on my music.
really hating on my music, you
know. Is there a flag to zero out the
buffer? No, of course not. That would be
nice if there was, but there is
not. Uh oh, wait. I didn't actually
write the
padding. Yeah, we actually have to do
the padding here, too.
Uh so it's not just y because y is an
iy. We have to add oh we have to add py
here and then here we have to add
px. You guys pay attention to how I'm
coding badly. Catch my mistakes and I
will be proud of
you. All right. So now the only problem
is the fact that it's not zeros.
Um, those aren't zeros. They should be
zeros.
Uh,
well, we'll just copy it from the other
guy here.
Real
copies host buff equals np.0
shape data. No, just that should work.
There we go.
Boom. Wow, that's a lot of code for a
stupid padding up.
Boom. Oh, this isn't even going to run
at all. What am I thinking? It doesn't
have any
broadcasting. How many of these things
actually use broadcasting? Oh, they use
broadcasting. Oh, no. Batchorm uses
broadcasting. Oh, that's a
tragedy. Oh, that's a huge tragedy. Oh,
man. Nobody's going to write that shit
and make it work.
Oh. Oh, what a tragedy. You know what
broadcasting is? Yeah. Exactly. Exactly.
Look it up and be sad.
I don't know. It's probably subjective
based on how much they like you.
No, no
broadcasting. Okay.
Well, how much do I actually have to
write?
or I think some of them are just
silently wrong, too, which is even
worse. All right, let's just comment out
the batchorm stuff for now.
Okay, now we're back to just not having
pool.
Wait. Oh, no. That's okay. That's never
mind. That's not
happen. Oh, even when we add the biases,
it requires broadcasting.
[Music]
All right.
Well, the good news
is we probably only have to write it for
binary
op. You know, guys, like we can complain
about it. The thing about complaining
about it is that doesn't get any code
written. So, let's just write it. That's
right. Are we failing the too many lines
test
yet? Nope. Still passing all the
tests.
Okay. Should have checked it on the
computer so you guys could see, but I
checked it on my
phone. Yeah.
Alienware, thank you for subscribing.
I'm glad you guys all learned what
broadcasting
is. Place cropping by seam
carving. All right. What's the elegant
way to write
broadcasting? Is there an actual elegant
way? Should we do research or should we
just try
something? It has to do with like
strides and stuff.
We should
assert No, they shouldn't. They don't
always have to be the same size.
Um,
uh, let's see how many of our tests fail
that. Those are probably the ones
where Yeah. things like quick hack for
fail. That's okay. We're a loud size
mismatch there.
Okay, that might be the only one. You
guys, I'm still waiting on somebody to
write to the pools. Open the
pools. All right, let's just hack
something for
now. Where's my binary op?
Wait.
Oh. Oh, look at that. We enabled really
stupid broadcasting.
and didn't test it
well. Oh, look at our crappy
broadcasting we
wrote. It's probably to make like mean
work or
something. Wrote this shitty code. Look
at this. So
shitty. Yeah.
So negative dimensions are not
allowed. H should probably change these
to be
go
GAB like JB.
Um,
Actually, this is so stupid. Dude, why
am I even writing
this? Okay, what we want to write
actually is something that gets
the So, we'll say float a equals
that float B equals that. Yeah. Okay,
now we're talking. And now we say res g
sub that equals
um
rat float
rat. Okay. And now we can just change
this to stuff like you know r
equals actually we should do better than
that. We don't even need r here. We just
say a plus b, right? Oh yeah, look at
how beautifully clean my code is. Yes,
now we are
talking. That should
work, I think. I don't think any of our
reduce ops are more complicated than
that. Runner are binary ops, right?
That's not a binary op. It's a unary op,
but we can do the same refactoring. Oh,
I wrote stupid code.
Yep, this one fits fine in the
paradigm. How a comma
b. Oh my god, this was Yeah, this was
really
bad. All these stupid gids. Gh.
Refactor. Refactor. Refactor.
What?
Okay. Rea
scratched Tom's Lamborghini.
Wait, Revas scratched his his
Lamborghini.
Yeah. Uh oh.
That sounds like a bad time.
Wait, did she crash it into something?
She scratched it up against something.
So she she hit something with the
Lamborghini all down the side. She
driving the Lambo in the car park and we
scratched it all down the side.
Wait, is Tom in the car? Does Tom know
Oh my god.
Dude, I don't know.
Do you see what our refactor
did? Now, how many things did I break?
Probably a lot. That's the problem with
refactors, but that's why you write good
tests.
Okay, test sub is
broken. Probably only on the backward
pass. No, that looks like not the
backward
pass. We don't even need a wrap. We can
just do res g
subg equals code.
Okay, none of these ops work.
Oh, no. None of the ops work, I think.
Well, okay, we have to fix that.
See the thing is if you don't fix some
everything else looks broken.
Okay. Okay, we're making progress.
That's
good. One minus x a Oh, I changed it for
a uni op by
accident. We should probably fix the
unary ops, too.
This was stupid how I wrote it. So you
you see what we're changing
now. We are
making instead of the ops containing all
this fancy looking code, the op now will
just operate on a single uh element and
then the wrapping function will take
care of the rest of it. Okay, aside from
things that are not implemented, we're
good.
Refactor opts to
prepare for
broadcasting. All right. I think there's
a really cute way to write this, but I
don't know it,
unfortunately. Oh, you made a try with
pools. Good job. All right, let's see
what we got. Does it work? Did you write
a test? And does it pass the test?
Does it pass test on
GPU? The Simpsons. Thank you for
subscribing. Did you pass the test? http
less and
ro what you didn't pass the
tests you pass test I emerge right
average pool too actually take a look at
how I implemented oh yeah you're on the
right path totally
um let's
see input rows out rows calls
calls. Um, well, this isn't
right. This is what your global ids are
going to be, right? So, you have you're
getting two global IDs and you're only
passing one thing in here. So, I don't
think you want to do that. Like, this is
the argument of the number of kernels to
launch. Um, in fact, yeah, you probably
just want if it's just input rows and
output rows, you're probably good. Yeah.
Uh I also think you don't want to pass
in that twice. You got to support Yeah.
So you have to support kernels that are
asymmetric, not just symmetric kernels.
This isn't right. You got some work to
do still. And then also take a look at
how I did it in testtops and you can see
that like average pools and max pools
are very similar. Um so just write like
some shared code that shares between the
two. And now let's try our best to write
broadcasting. Let's not call
these stupid craps. Okay.
Okay, cool.
Oh yeah. Okay. We actually we have to
fix reshape there too because you don't
actually pass in that minus
one. Um
uh
You do your nails? Mhm. And I'm going to
go do them.
I see you in a little bit.
Yeah. Asymmetric kernels.
My chess engine was good enough to beat
me. So, probably like a
1500. I could beat it sometimes, but
um if
s=us1, we want it to be the sum of the
rest of them.
T sum zero. T sum
uh plus equal no times
equals
S. This is really crappy, but fine.
Oh, sorry.
What?
Oh, no. Yeah, that's not right.
Um, no, no, none of this is right.
Um,
Okay,
[Music]
good. How we doing on peoples? We got a
lot of
peoples. All right. All right. Does
everyone see how to broadcast? What
we're going to have to do to broadcast.
The problem is these shapes don't match.
Yet, you can still add them
up. All right. Then we just write some
hack
shit. Hackshit's like
All right. Who knows how to write
broadcasting? We're getting close. Can't
believe I'm actually writing
this. The problem is G isn't actually
correct.
See, you know, you can't just take
things like minus one for granted. You
actually got to write the code for it.
Now, really, you have to check that
there aren't two minus
ones. Yeah.
Oh, someone made a better max pooling.
Oh, what do we got? What do we got? Did
you also write average
pooling? Oh, now we're
talking. Oo, subsample up. Oo,
fancy. Do the test pass? Oh, this is
this will be great if this just works.
Oh, man. Ryan Nef. Ryan
Nef is a is is is is good. And we're
going to merge this one
in. All right.
Well, see, I I worry a little that you
didn't pass the
tests because if you pass the tests,
then yeah, they don't pay. I guess they
pass enough.
Um, none type has no attribute CPU.
Okay, let's just do that.
You know what? Good enough. I mean,
that's passing the forward pass. Cool.
Good
job. Now, the code is good. I can tell
already it's
good. Oh, this is some nice Open CL
code.
Supreme confidence. All right, we might
actually get this to work. We just need
to write broadcasting. And right now, I
think we only need to write very simple
broadcasting.
Um, let's write something very simple
for now.
[Music]
Oh no, I didn't mean to do
that. I just deleted.
No, sorry. We have to rewrite that.
Let's write a test.
[Music]
got to spell true, right? You know, I
was in a spelling bee once, so it's a
true story. And the word was main. Uh,
and I was like, could you give me the
definition? And they're like, you know,
cuz you got like like like, you know,
like the main, which is the new lame
thing that they call things instead of
master. Uh, you got like a lion's mane,
you also have the state of Maine. And
they said the definition was the state
of Maine. So, you know, I was uh I knew
how to spell this is M A I N E. And they
told me I was wrong. And I'm standing
there on the stage. I'm like, you guys
stupid? M A I N
E. Now, who knows what I did
wrong. That's right. It was capital M A
I N E. And that's what I get for not
reading the rules of the spelling bee.
And I was kicked out of spelling bee on
the first round. And I never went to a
spelling bee again because I was like,
these things are really
stupid. But actually, this is one of the
things where I should have realized that
I was in the wrong and I should have
understood that I should have read the
rules and I was only hurting
myself. All right, let's check my
broadcast ads.
passes on the
CPU, fails on the GPU because my binary
op shape mismatch
Cool.
Okay, we wrote hacked broadcast.
binary op shape mismatch in
div. Oh, cuz we're adding EPS. Okay,
that's
fine. That one's okay as well. We can
add a special case for that.
Invalid arg size.
A that should be fine.
Wait, that shouldn't be one.
Oops.
Could be
that argument too.
Processing argument two onebased invalid
arg
size. Oh. Huh. This some like stupid
crap
like add EPS and like doesn't work or
something. Uh tensor self. EPS. So that
should work.
Oh
yeah. Uh GPU
equals. So
yeah, GPU equals
X.GPU. That should work.
That should be an okay
mismatch. Length of Y
shape.
Um Oh, it's the other way around. Oops.
Okay. Okay. Okay. Not too
bad. There has to be a nice generic way
to write this that I just don't know.
No, wait. Does that work?
That can't
work. This is a
bug. This is a bug in my efficient net
that I guess was just hidden by
broadcasting. That can't be what we
want, right?
Oh, this is going to improve the
efficienc that on the
uh on the CPU as
well. So that just seems like a bug,
right? X squeezed
average.
squeezed. Okay, let's print some
shapes. Oh, does your average pool only
support 2x two average
pool? No, average pool has bug. You
write bug. Oh no, only two by two. need
to support more than 2 by two. Ryan, I
should have read your
code. All right. All right. Before we
blame Ryan, let's let's make sure that I
didn't do something stupid. Okay. Max
pool 2d kernel size. Okay. Kernel size
being passed in
here. Whoa. You in two kernel size.x. Oh
man, this stuff looks good. Yeah, but
you Why'd you do this? Well, you can't
just divide by two like that. You have
to divide by the kernel
size. Why are you right? You can't just
divide by two. You do so good, but you
divide by two.
[Laughter]
Oh
god.
Oh wait. So technically those are
actually different things. One of them's
a kernel size and one of them's a
stride.
Oh,
well, I mean, it's not exactly a quick
fix and it really makes me think about
really makes me think, you know,
h I think they're separate things.
Yeah, like it's not even wrong. It's
just the
stride. Oh, the default value of the
stride is kernel size
though. So, first let's let's fix test.
Wait. And now if you'd only written this
too, you would see it
fail. Oh, see see you just assume that
because it got to all the forward passes
that you were home free. But that's
actually not
true. I
believe we can test ops now and it's
fine.
Wait. Oh, not forward pass. Forward
only. So, the first test passed, but the
ones afterward didn't. If we test ops
GPU now, by the way, the coms are a ton
faster on the
GPU. You see that the shapes no longer
match. Tricky, tricky,
tricky.
H some
broadcasting test is
fail. Pool test is
fail. So this hardcoded the stride to be
two.
All right, let's just say py px equals
kernel
size. Easy fix. Okay, Ryan, you wrote
very good code and I think it'll even
work if someone wants to implement the
stride argument, which someone should
totally do. But we are back in business.
Let's take a look at a chicken. All
right, now let's run it on this GPU.
Let's go. Let's go. Let's go. Oh, so
fast. So
fast. Okay, our assertion of the shapes
being the same is wrong now. Oh man,
that's fast.
Oh, look how slow the CPU is. Yeah,
that's right. Virgin CPU Chad GPU. Let's
go. Okay, we're so close. We're so
close. I think it's even going to work
cuz we got all the tests to pass and
everything. And this might actually be
the fastest, easiest way to run an
efficient net on a
Mac. Oh yeah, Chad GPU. So fast.
Okay, let's fix this last
bug.
Uh,
if raise
exception
shape mismatch in
binop that colon that
that code x do.shape Y.shape shape.
Yeah. Let's
see. Shape mismatch in a Oh. Oh, that's
fixable. Um, what am I doing wrong
there?
Oh, well, that's just a bug in my
efficient net. I can just fix that.
uh reshape
um one minus
one
object.
Oh. Oh yeah.
That really make my Oh, I didn't have to
broadcast because now it's actually the
right size. Oh, that's great. Okay, now
the only problem is that this is on the
CPU. So, we just have to do CPU
there. And is it also a head on the
GPU? Whoa, it's a
bow. Yo, it's so close. It's just a bow
instead of a, you
know, on the CPU it's a hen, but on the
GPU it's a bow and it has a really big
number. It's very convinced it's a
bow. Okay, which of my 30 ops is wrong?
By the way, that is the picture of the
hen that we're doing inference on. I
mean, it didn't pass the tests, but it
kind of passed the
tests. Like, the problem was the test
stops as soon as a backward pass fails
and it didn't get to the larger kernel
sizes in
Maxpool, but it was very clean code and
that made the bug so easy to fix.
Okay, so the GPU is only double the
speed of the CPU, but it's so fast at
those initial com layers. I have so much
hope for
it. And actually, the reason for that is
because we're doing the
channels. You want to make it fast?
Let's just make it fast. I don't like
slow. Who's done with slow? This guy.
Wait, so all the tests pass. I don't
understand why my thing is wrong. Look
at all my tests. They all pass. So
good. So good. Test
pass. Why does that not work? All right,
let's make that fast, first of all, cuz
I hate slow. Who else hates slow? Slow,
slow, slow, slow, slow. Oops.
Oh, actually I can just do this, right?
Can I? And what if I just say times
groups and then instead of a loop for
groups I say int g equal
this is divided by groups and then
this is mod
groups. Get rid of that
loop. Now we can dispatch more. Okay. Is
that
fast? Well, it's correct. Let's see if
it's
faster. I think it's
slower. We really want channels to be in
there,
too. We just do that.
That works,
right? Oh my god, it just ran in. 222
milliseconds. Oh yeah.
so
fast. Who
loves
speed? Look at that. The GPU is now
three times faster than the CPU. It
still gets the wrong answer, which is a
little bit concerning, but it's so fast
at getting the wrong
answer. Ah.
Fast is greater than correct. I agree
with that. Okay, so we're getting a bow.
Why are we getting a
bow? Did we do something stupid like not
convert the image to a float or
something? No, we converted the image to
a float. Let's take a look at the
outputs.
They're just like a different order of
magnitude. I'm suspicious of my
broadcasting code.
Oh, I know what I did. The red buffer is
the wrong size. The red buffer should
always be the larger
one. Yeah.
Oh my god, it gets a hand. We did
it.
Yeah. Fix broadcast bug. We'll put a lot
of G's on bug. Oh yo, that is the
fastest imageet inference probably ever
on a MacBook
GPU.
Easy.
Easy.
Yo, who's riding
with all the honking people? Clear.
All right. Um, 23 seconds. Let's try to
go even faster. If you can believe it.
If you can believe it. I think this GPU
has a lot more speed to give us if we do
some of those multiplies less
stupidly. Let's also make a few changes
to the readme. Now I think every op is
implemented. Not all ops are supported
yet on the backwards
pass. That's
good. Pro
tip, set GPU equals 1 if you want this
to go faster.
Environment
variable. Let's make
sure.
Cool. No, I hate when I do that. I press
some combination and then my dock stays
there and I hate the
dock. Doc
get BTFO. There we go.
All right, we're at 0.24 seconds. I
believe that we can go even faster if we
clean up the comp a little bit and not
stupidly do all those multiplies every
time.
Does this just work? If I say like wp
pointer equals
this and then I change this here to wp
pointer and I say wp pointer plus equals
1 does not
work. Uh oh because we can't do
ci. Yeah, that should be okay.
Okay,
cool. How is that
slower? I don't understand. How can that
even be close in
speed? I got rid of so many multiplies.
We want no bugs, so we write less lines.
That's a good point.
Um, like how good is this optimizing
compiler that this doesn't matter?
This must be so
good. It's literally
slower. Okay. It's maybe a little
faster.
That's not right
anymore. Spatula. It's not even faster.
This is stupid. I mean, if it's going to
give me the same speed writing that,
that's a lot more easy to understand.
gives me the same speed. Optimizing
compilers are so good.
All right. I don't know. I kind of think
that's the stream. We got all the GPU
ops
implemented. Thanks
to Ryan Nef for coming through with a
beautiful Max Pool while we were live
here on
stream. Ryan Nef. Did I Did I say it
right? Ryan Nef. Yes.
You can try shifting loops around. Yeah.
Yeah. Yeah. I can start playing with L1
caches. But if we're down in the L1
cache land, um, you know,
CPU 73 seconds,
GPU 23 seconds. So fast.
Okay, I think what we're going to do on
some other stream is we're going to see
if we can figure out how to get both OBS
and Tiny to look at the camera. I mean,
I Well, maybe we could just do it. Let's
Let's You want to just do it? What time
does Alex get back for
lunch? Let's just look quickly and see
if this is easy.
Um, CV2 open webcam. No, it's going to
be like, "No, but OBS already has it
open. We can't do
it. If if this doesn't work, we're not
doing this this stream. Oops.
Python. Oh, it's going to be like import
CV2. You don't have CV2. Oh, I do have
CV2.
Sweet. Oh. Oh. Does this just
work? No way.
Uh from mattplot lib import
oh what is it import mapplotib as plt
plt.mimshow no it's like something else
it's like import mapplotib pipplot as
plt plt.mimshow plt.show
show. Oh, look. It's a picture of me.
Yo, who's ready to feed that into the
efficient net? Oh, this is going to be
so
good. Yo, we can hold things up and see
what it says it is. Yo, this is going to
be great. Let's do it, boys. Right here
live on this Twitch channel. Oh, this is
going to be so good. This is going to be
this is going to be better than finding
all the voter fruit in the world. If you
got duped by the title, you're a
sucker. Oh, yeah. All right. All right.
All right. Big brain shed. Let's
go preprocess image.
All right,
[Music]
let's infer
um
image
model. Uh, anything else? Probably
not. Save model image.
Time is not defined.
We can actually get the labels outside.
We don't actually use this here, do
we? No, we don't.
Okay,
cool.
Um, let's not do the microrad puppy
anymore. Let's say
uh let's get rid of
that. If URL equals webcam
import CV2. All right. What is that?
Wow. CV2 just worked. What a crazy world
we live in where CV2 just
worked.
Uh while
one out equals infer model,
frame doesn't work. Who thinks it
works? Oh, we got to start it with
webcam and using the GPU.
Ah, now we're going to find all the uh
all the memory leaks in our
crap. Frame equals np.array frame print
frame.shape int object is not.
Oh, what kind of image is that?
Resize. Oh, I guess I want a pill
image. Image
dot. Pill image from numpy.
from array. I knew it was something like
that.
Okay. Uh we should also probably display
the
image. There's not an easy way to do
that. We can display one
image. It's pretty good.
Why am I a lab code or a pay
phone? I think I might have the order
wrong of the
channels. Kill all I python prey.
Perfect. Bye-bye,
Python.
Um, yeah, I think we have to do maybe
just this
works. It's BGR. We got to go to RGB.
I know it looks the same,
but yo, I am not a screwdriver. I am not
a popsicle. Stop this
shit. I'm definitely not an
oscilloscope. Why am I not a person?
Does it not know person?
Maybe the GPU inference doesn't
work. I'm not a cross word puzzle, you
know. Lab code. Ice lolli lab
coat pay
phone. Okay, I somewhat see where it
gets pay phone from. That's the most
legit one it's tried so far.
Um,
let's before I do that
one, look
at
image low
level preprocess.
Yes. Okay, that's working. We have the
webcam
working. Do you guys know if there's any
way to not
wait block equals
false? I do worry that that's going to
create a million windows.
or no windows at
all.
Draw. Oh, I think I only have to call
show
once. Yeah.
Oh, ion mode. I see.
Great. So if we go to ion mode, we just
get
nothing. Okay, that's very clearly a
picture of person,
right? Does person is person in
imageet? Sweatshirt. Okay. Okay, I see
where it's coming from.
I don't even know what a mortar board
is. Try holding up a chicken. Good
point. Okay, let's try holding up a spin
drift. Coffee mug.
Oo, sunscreen. Okay. All right. All
right. Let's hold up an iPhone.
Coffee mug. Notebook.
Computer. Car
keys. Meat cleaver. Barberhop.
H. Not too bad. How about a
shoe? Weird stuff in Alex's
house. A punching bag. Okay. Do we see
where it's coming from?
Let's try my
wallet. Punching
bag.
Wait, wait. ATM because of the card. Oh,
it's I
see the picture is not actually Yeah,
it's off by
one. Um, what's this?
Oxygen mask. How about a real
mask? Face diaper. Bath towel. Not
bad. Yo, what do we think? What do we
think? Let's try a hat. We got a hat
here. Bath towel.
Whoa. Cowboy
hat. Oh, it just gets it wrong. What
one?
Okay. I don't know why that's not That
should be the frame that actually goes
into the net, but maybe it's
not. I don't know. I don't understand
that. But I do know that it
works. Cowboy hat.
Yeah. See? Okay. It's just It's just off
by one for some reason.
All right, let's switch back to the GPU
because the GPU is
fast cowboy hat. Look at
that bow. Oh, I mean it looks kind of
like a bow.
What else we got? We got a
shoe. Let's also make the picture that
we can see
bigger. Let's do a little refactoring
quickly. Uh, you know what? We'll just
use
Pygame. I have some good I have some
good comma code that can do this well.
Oh, fake open pilot.
I can just copy this code here. Do I
have Pyame on
here? Please work.
Um,
What? Maybe it has to build something
for Pygame or
something.
Um, let's do something to make it
visible. Pygame display in
it. We have to just do Pygame in
it. Does Pyame not work on
Mac? Let's also get rid of that print
for the
I'm doing pium display.flip, right?
Obliterate
flip. I see it. It's not there. Py
game math
example. Pygame
innit Pygame display set
mode.
Pi what? Screen.fill
Fill
0000 valid recct style
object. Where's my Python
window? Recent versions of Mac OS
require Pygame 2. I have Pygame too.
You know what has working code for this?
Definitely Twitch
slam. Like I wrote this in Twitch slam
and it definitely
worked. Pygame init Pygame display set
mode.
green dot blit array red
image. Oh, it's just like not showing
up. Link to relevant Twitch slam file.
Okay, perfect. Let's just do it in how
to do it in Twitch
slam.
Wait, it looks pretty similar. Py game
and net pyame display set mode. I guess
we used a
surface. I think that was just for
speed.
nothing. Didn't I use like SDL in later
versions of Twitch
Slam? Try this link to install Pygame
instead. No, that's the same thing that
I did.
It's really not
different. It's the
same. Do I need to handle events? No.
Why? Where's the window?
It's like the window wants to show up.
It just doesn't. Maybe it's cuz I'm in a
T-Mox and that's
broken. No.
H. Yeah. Where's the example
code?
Let's do that.
Right. Oh, maybe it's interfering badly
with um
CV.
Great. Example broken.
It's a good
test. I like this one because it talks
about
mask. Where is at least one image file
name? I don't
know. Didn't make any
stars.
What? Okay, that example works. Let's
just find it.
Um, here we
go. What are they doing differently for
me?
PG. Set mode wind size.
PG. They fill the screen.
It might literally have to do with the
Open CL crap. OpenCV crap. Let's try
that.
No. How come this example works? Where's
the example
works? Oh, PG
display.update. Don't use flip.
Maybe
what clock tick
Okay, example
works. Um, we shouldn't actually need
any
stars. Um,
screenfill
black. Oh, it's not creating a
surface, I guess. Well, I but I didn't
think I needed that anyway.
Maybe the problem
is okay, let's try to break it. Let's
import pi open CL import cv2. Let's see
if that breaks
stars. Not asky character.
What? That works
fine. Let's import them before
pygame.
Think I'm not waiting for input. You
think I need this clock
crap? No.
I need Oh, is it because of the events?
All right. Maybe it is because of the
events. I don't know how I missed
that.
Perfect. Okay. Stupid.
Stupid. What kind of crap library is
that?
Look how tiny I am. I don't want to be
that
tiny. Um, that's what that surface crap
from Twitch does,
right? Uh, I don't think I can actually
just resize, can
I? I want to be tiny.
Yay. Not
tiny.
Okay, let's do a few things. Um
Let me just make sure I didn't break the
example. I might have actually broken
it.
Don't break the example.
All right. Now, finally, we have a
usable webcam efficient netrunner on
Mac. When you ask what you can use it
for, here's what you can do. You take
this, you run it, you show it to
investors, you put the right pitch
around it, and they'll be rich. They
might think you're an oscilloscope, but
don't worry. Just lie in your demo.
All right. How many people we
got? How many people in the stream right
now? Look at those mad FPS.
Yeah. Bow. It's a bow. Power drill. What
else we got here? Let's look at some
socks. We got some socks.
Sock. Paper towel. Okay, I'll take
it. How many we got? We got three. 960.
All right. All right. Boater fluid is
popular. All right. Let's look for a man
wearing a diaper on his face. What do we
got? Gas mask respirator. Not bad. Ski
mask.
Wow. Wow. This is so good. This is the
highest quality code we've ever written.
We got a hacksaw. Let's see what we
get. Swing. I can see
it. What else we got? We got a sailboat.
Let's see what we got.
Sailboat book. Well, I mean that's
right. It's very
literal or meat cleaver. I liked book
better.
Book. Uh, what other objects we got
lying around? Let's see. We got We got a
remote control. Let's see what we got.
remote
control. Oh, it knows that one. Yeah,
this is written entirely from scratch
running on the GPU. We have a copy of
Atlas Shrugged. What's it going to
say?
Book. What else we got? We got Oh, we
got scissors. We got markers.
You got
scissors,
paintbrush. Okay, we got a pen,
screwdriver, syringe. All right. All
right. All right. It kind of makes
sense. I mean, it might just not know
these objects. I don't know how many
objects are actually in the original
fish. What about a
hammer? We got a
hammer. Hammer.
Yeah. What if I put it on a white
background? Is it even more
sure?
[Music]
Hammer. All right. I'm happy with
hammer. I think that's where we're going
to leave the stream. This is one of the
most useful things I've ever programmed
from scratch on the GPU.
with a webcam. It might think I'm an
oscilloscope. We're definitely going to
use hammer in the demo. We can raise a
lot of money like
this. Ah, so exciting, boys. So
exciting. We got new poll requests. What
we got?
Oh, we got a backward
pass. All right. Well, one of these
days, probably next Saturday, we're
going to figure out how to start
training on efficient net, but this is
written entirely from scratch. Tiny is
so useful. Let's make sure I'm still
below a thousand lines. Yeah, look at
that check mark. Ah, in under a thousand
lines of code, you can recognize a
hammer. All
right. Um, so I'm glad that we got to
the bottom of a lot of voter fluid
today.
Um, Marcel Bishoff, good to see you.
He's a contributor to Tiny Grad on a
GPU. How wild is that? Do the
fridge sliding door. I don't know what a
shoe
[Laughter]
is. All right,
guys. Thank you all for watching today.
If we have any quick questions, we got a
few more
minutes. Oh, show you. See the things
that we learned. You know what I just
realized we could
do? We could bring our pictures on my
phone and then hold the
pictures. Look at that
chicken. Cellular telephone. Yeah, it
can't be fooled. That's right. People
are always like, "But what about
autopilot? It's going to get confused
when there's a person on the back of a
truck, but it's actually a
billboard. Nope. We already fixed that
technology right here in
Tiny. Can we get YOLO to work? Yeah,
probably. How many more ops do we need
for YOLO? Um, webcam detect voter fraud.
Fruid. Oh, I love Marietta. Yeah, G. Um,
sometimes I'm awake thinking about
fucking things up for myself again. But
relax, just sit there. My organs know I
mean well even though we're all gone and
you're content. Driving up north heading
towards nothing just for a fake laugh
and a stupid smile. I never asked to see
lost painted on my forehead. It was
haunting me for a while.
Okay, thank you all for watching. Have a
good day everybody. Enjoy your
Saturday. Maybe yolo next time. Maybe
yolo in a pull request. Maybe yolo
forever. Byebye.
oh you guys couldn't hear anything I was
saying anyway
well I said some good stuff Google have
to read my lips
um
why is that GPU special
okay are we live or what
trash things
okay we're gonna pop out the new chat
all right good good good Mike muted all
right all right all right we're good
we're good we're good
uh pop out chats make that big
all right
all the new freestyle oh yo no no we got
we got better bars man we got where'd
that one go it got taken down for
copyright
um I'm sorry if you missed touching
grass freestyle uh
we play touching grass freestyle on here
I don't think we can
you know I had a bad time with YouTube
and copyright lately uh okay so we have
some band terms and it's anything to do
with conductors that conduct more than
the normal amount
well all conductors in here must conduct
a normal amount of electricity
not an abnormal amount
um
so yeah the new freestyle is gone but we
haven't even newer freestyle oh man
I think you guys are gonna like it
uh someone I don't know reached out to
me and said yo I made this beat for you
I want a feature from Tom Cruise so I
sat there for an hour this morning and I
put something together
uh I'm glad you like touching grass
uh but touching grass is gone forever
uh semiconductors are okay you just
can't conduct too much man if you're
conducting too much you're not welcome
in this chat but the problem with this
cover is it comes off sometimes and I
bought a new chair because I'm not poor
but it's gonna take six weeks to come
you know some of us don't have six weeks
so yeah I got this cover in the meantime
and it kind of fits on the chair okay
uh okay
let's see what actually works on this
computer if anything does
that might be too much light
get this set up we don't need this light
do we need this light
get that light
like common 3x ain't no one at eight
weeks don't worry it won't be eight
weeks order it right now
it's one to eight weeks
if they told me one to eight weeks on
the chair I would have been happy
because at least I could have had hope
you know what I mean you just got to
give the people hope someone's out there
buying lottery tickets
your ears oh did I hit something
[Music]
the microphone's so much more confusing
to use
they didn't make it idiot proof
okay
let's see
all right so I downloaded uh
all right so I downloaded and we have
the the official tiny grad meeting in
the tiny grab Discord at five o'clock so
you guys will be there for it
um
is that a subscriber symbol
no you cheered 100. you
you turn that into seven figures with
crypto and then lost it all in Luna yeah
that sounds right all right subscribe
only chat
mod PS5 that that's really that's really
the I don't give a shit about
PlayStations you know what I mean like
I'm a 33 year old man
like when I was 21 I cared about video
games when I'm 33 I don't okay
like I'll play some games a little bit
but like when you're 21 you got nothing
better to do you play video games all
day right
you play video games you hack video game
consoles I will never hack another video
game console I just don't care you know
what I mean
like the 21 year olds can do it it's
cool it's cool when you're 21. it's not
cool when you're 33 you know what I mean
um all right
uh
don't use guacam
you'll regret it you'll just you'll just
get ready for a upsetting two years if
you choose to use Qualcomm in your
product
so we have a llama here
we gotta install Sam's piece
does this know how to load okay so we
don't have that llama
this should work with the other llamas
though right
not found weights llama to tokenizer
model
um
I downloaded it over here
best token as a model okay we have to
create a directory
called
oh told me here
it's actually called Lama two
um
wait also that's not even true we didn't
even have an angel round at that
valuation
wait what are you even talking about bro
this is not even real news
oh my God I have to move these this is a
lot of work
no I I also spent
why is it trying to use llvm
oh I know why it's trying to use llvm
okay okay let's hope this works
uh llvm is the only back end that
supports B float 16.
someone put that in the loader someone
probably put that in the loader
there's this file called state which is
the loader
yeah here look at this
should this be done in the example yes
it probably should
um so the back end doesn't support B
float 16 so we have to convert it to uh
float
16.
just take forever to load
I haven't tried this yet I don't even
know if llama2 works why is this so slow
the llvm workaround might be broken on
Linux
oh
there we go
this is mad slow
all right we gotta get bitcast working I
think this stream's actually going to be
getting bitcast working and not getting
70b working
that's brutally slow
okay
user hi Stacy
okay it works
and then it's like slow to run too I
don't know why this is so slow
no okay so part of the problem is that
lovm's linking to uh
some float 16 stuff doesn't work
probably need to compiler RTM
is this tested in
how's this how does this work on the CI
box
let's see what's failing
if you guys know about debug and Tiny
grad you can just say debug equals four
and now it'll yeah okay
so this is crashing
and it must be this FP trunk thing I
think I can do debug equals five and we
can see the assembly too
yeah okay so we're call queuing
what's ever in
our
yeah so it's not linking to this
correctly
I don't know I think we just gotta fix
big cast
[Music]
okay so what bitcast is
is basically in uh
so what was wrong with this PR
atch test
s okay
so what bitcast is is normally when you
do a cast you also convert the type so
when you do like a float to an end cast
do you want that cast to uh
change the do you want it like just four
and float mean for an INT or do you want
the foreign float to literally mean for
an ant
uh
what are you saying
I'm on stream
that seems like a reasonable test
so I'll show you my issue in tiny grad
where I talk about this
here in B float 16 support
this is really what I want it to look
like
oh but that's like a little Annoying
that's not actually going to be that
much better
because
yeah
a bit casted to float32
and then I guess I could normal cast it
to half
and I could do that all on the uh on the
GPU
okay let's make this work on the GPU
it seems fine
how good is this pull request I mean can
we just start with it as a thing or
should I copy and paste that things in
one at a time
I don't really understand that
foreign
remember
well this should actually be identical
with normal cast I think two
well these are gonna fail because there
is no bitcast
but like these ones should actually just
be I think the same well okay that's a
different one this one is just normal
cast so we shouldn't even be supported I
don't think
yeah those just work okay
so these ones are just normal cast we're
going to get rid of these as tests
but that stuff should work
uh different debug levels give specific
outputs yeah so debug equals four will
print the code that goes into tiny grad
debug equals five and six will try to
disassemble it and show you the thing
after the compiler ran
um okay so we don't need the UI you
don't actually need a bitcast operator
you only really need bitcast operators
to go from floats to ants
uh so we will check that
let's take a look at ml Ops
okay we have cast it's a little Annoying
that this is just copy paste bullshit
but it's probably right
yeah I think that's right
okay we need to put it in
yeah there's not a better way to do that
really
we need to put it in tensor.pi
Yes actually those are the tests don't
really hurt I guess we could just leave
them
because they are actually technically
correct there's
don't know if we're gonna support them
you know what I mean
like because the casts are identical
okay we have a bit gas function by the
way thank you to bedex
for this pull request so I can copy it
oh okay so which run time do we want
this to work on
I think we're testing on the GPU so we
want to work on the GPU
well it's a little Annoying that it's
enumerating all like
what's in Ops GPU Now isn't really right
you don't want this to like pre-fetch
like you don't want this to create a
context in a queue on every GPU
I really only wanted to create it on one
I don't even see a way to like
like I can exclude it but I don't even
see a way to like tell it I only want
one
this Line's hard to read
I see what it is okay so if device is
being passed in there
you only want to do one
I'll just put this here for now so it's
faster
because otherwise it's creating
yeah but there's not an easy way to do
that okay lazy buffer object has no
bitcast
let's go into lazy buffer and write
bitcast
um
it's pretty boring
I'm going to add this to unaryops
well there's so many places I have to
change this can you guys becoming
terribly complex and awful
um
okay
now we don't have it so we actually have
to write it in GPU
so we have to go over to this code Jan
well no one can ever this code is
becoming unreadable
look at how many places I've had to edit
it this is as many as clang
at least it's short
short which of these can be ripped out
we're going to update Ops as well
there's a lot of lines
okay so I don't think this is actually
written correctly
I think the way that you actually want
to write bitcast
for these
things is you want to create a raw
buffer
it doesn't even have to make a copy
you know what I'm saying like it's just
a view
okay so the way you really want to do
this on the GPU is you want to take a CL
buffer and just change D type
like that's really where bid cash should
exist
there's no way to do this with the
buffer
all right so we're just gonna have to
like make a copy
but what is this
no you do water because you want it to
be able to fuse right so you can't
actually make a copy
oh now I need a bitcast
operator in the linearizer all this is
becoming insane
collapsing under complexity
collapsing under complexity yeah just
one more thing over and over and over
again
I just gotta sit down like I mean maybe
that's what's frustrating me so much
that this all just needs to be
refactored
cast is not an ALU op
casting doesn't even work
this cast stuff's just wrong
if I add it here I think nothing will
get passed through
okay it's complaining and saying
Kiara and exec AST
interpreter doesn't have it but I added
that
what back end is this on
oh
I broke the GPO I say
so it wasn't using GPU I was trying to
use numpy
because I broke it by doing that I don't
really know why
uh
okay this is a better error
um
for the training PR is what I want to
see is a trained model
that has normal cast work where's cast
foreign
like I think cast needs to be fixed
first
right like this isn't ready I shouldn't
be doing this now
like I'm just hacking stuff right
and here's another question like
maybe bitcast should just be a flag on
cast
I think it should be
well I don't think it should be its own
op and stuff this is a lot of this is a
lot of added complexity right and this
becomes obvious when you start doing
this
all right so let's make some changes
right and this is this is the tiny grad
way
you actually reinterpreted was true I'm
just going to call the flag bitcast
equals false right that's kind of what
I'm thinking like you start adding all
this stuff and you're like okay wait a
second we've done we've done way too
much complexity here
okay so that's not right
um with their tab with their is their
white space or something I hate that
okay let's get rid of bitcast
let's go back to tensor.pi I think what
we want to do here is say
actually I don't want that to be a flag
here
I want this to be a flag here let's say
apply bitcast equals true
now we can go back to ml Ops
and we can get rid of bitcast here
and we'll have a slot called bitcast
and we'll have good cast here
okay cool
it's a lot simpler
I'm not going to make that change to
state right now
um
we also don't need to make any changes
to Ops if we're doing it like this
okay there's just changes to that which
is fine
I don't understand what these changes
are to linear eyes are are they white
space
we don't need to use linearizer either
we might but we don't even know
okay
lazy power cast takes two positional
arguments but three were given okay so
we're gonna have to add
it to cast in lazy dot high so that can
go
I'm going to attach that
wait I added as lazy.com
um okay so we have an r and the ARG
right now is the d-type to a unit reops
cast
uh
should we make it a tuple
you might want to make it a tuple
you know
cool
all right now
that's fine that's the argument that's
going into lazy's cast here so the arm
is topple D type pool
our element-wise up anyway Ops cast okay
that's good now we're going to need to
edit these element wise Ops and midcast
actually the right thing
was surprisingly
in the last hour they haven't gotten any
better
uh and you might want to consider using
rock chip
let's try it honestly video
topple has no attribute NP
um
true CPU I must just set self dot d type
Raw
oh it was up unreal Ops cast
it's not actually that that was probably
more of this crap
oh if you bought a tiny box you get an
emo that sounds nice
okay so what sets self dot d type
oh
if self.dype is not equal to R Sub Zero
should I do like a named topple
just annoying
where do I handle cast how do I handle
cast we're gonna have to change okay
that's fine
that's fine
here probably
oh yeah okay cast D Type R
um R Sub Zero
it's a little annoying at the tunnel
okay int has no attribute NP
be an inch
should be a d type
couple I don't know I should get NP
[Music]
foreign
is still passing in the old cast style
that's ARG Sub Zero
that's passing in falses now that's fine
um
that's getting the argument oh
maybe this is the problem
cool
okay
go back to this one
now we want numpy to actually support
bitcast
[Music]
how do we do a bitcast in numpy numpy
okay
binary representation of a number
turns the binary representation of a
number as a string
uh sub okay
oh casting unsafe okay so we just have
to say casting
this is nice okay
casting equals
uh
no
if y sub 1 else on the safe
cannot cast array data from in 32 to
float32 according to the rule no
well that's too bad
oh that's not what no means
I see okay that's not a bit that's not a
bitcast
no there's another way to do this
did they happen to figure it out in here
how's it done enough CPU
oh oh Dot View does that work
okay that's cool
try that
yay wow this guy's good
uh thanks again to uh Ben X
we did a good job figuring this stuff up
okay cool
we'll call this Branch simple bitcast
uh
great
okay uh on to the next one let's try
torch
doesn't work in torch
let's see what this guy did for torch
okay let's just view
I'm a little upset that that's copy
pasted
um I think I should be able to just do
this
what
um
okay
well those ones are stupid anyway
torch doesn't support what
foreign
[Music]
we're just going to skip these ones in
torch
torch really doesn't have these
okay fine
uh lvm
right doesn't work at all
uh GPU
well this gets fancy and remember we're
gonna need the linearizer
they do not work
why did you win oh you win 64 to 64. oh
it is different oh that's cool
that one is different
interesting
uh
right so does that break
yeah
can I do or value error does that just
work
oh that's a little annoying
that should really be checked for like
way earlier
where's the right place to check for
that probably in lazy
um
okay
oh
oh
that's just like a different problem
okay this isn't actually checked
anywhere
um we want to check it in lazy dot pi
uh
search
not argone or
self.dype dot size
make sense
that shouldn't give me a value error
though that should give me
oh I don't know what's that
right here bonus erases
you shouldn't be able basically to cast
it yeah okay something else is broken
here
did this never call cast
no I mean it definitely called cast
right
investor fail all right
sir not ARG one
so there is our one
or
what
no it doesn't make sense
self.d type is float and the size is one
the size should not be one
oh sizes when you do item size damn it
who wrote this crap
no actually that makes sense
cannot bidcasters G type item sizes
work universally for all I'll just make
sure that that actually catches the
assert error here
[Music]
I'm not feeling pretty good about this
now actually
it's a test that's fine those look
pretty good
[Music]
um okay
it now works with CPU and torch
so maybe what we should do now is um
rewrite the state thing and see if
llama2 works like this
so instead of going to llvm I'm so
excited to delete that oh we can delete
this I wrote like a crappy thing in all
of yam
uh we should probably
um I don't know
make sure to be on CPU that should be
free
uh dot half to device default this is
right now
oh no because it doesn't know how to do
that
let's just see what happens
well that's just not right at all
because that's not actually the type
so it must be somewhere I didn't uh
what
so okay I know what it is
do I have where is can I like realize
cast or something
no but I probably have some special
hacks for the realization of cash
here
well that's okay those are just hacks
for image
then
all these casts here have to go
let's see what other tests fell
those will pass
no no that doesn't AG types
a d-type mismatch on Realize
there must be some
bug like I must handle cast in here
somehow
okay I move the cast around that's okay
little
self.realize Dot d-type
yeah
uh what sets that
it's all fine right
those are loaders
there is somewhere else I talk about
cast I remember I was looking at it
before
[Music]
but it's there and that should be
correct
like out D type should be right
something is setting realized okay where
do we create the raw buffer
okay this code needs to be refactored
like this is hard for me to follow
it's not too bad but like
yeah these all these casts everywhere
were such a mistake I should have never
allowed this in
you know like this is such a struggle
like you want features
uh
but then you know
features make things hard to read
so we've got to spend more time
refactoring
how is this happening d-type mismatch on
Realize
buff up source to realize so it must be
creating a lazy buffer
uh I have one creation of it and it's
here
let's uncomment that
isn't a shape anymore
d-types half
all right that seems fine
this is where I think it would be messed
up
but it's not
oh what could it be the lvm back no
I don't know
it's even the other Tessa family
oh but I can't create a pull request
because I'm not logged in great
oh it's nicer if you ever tested fails
I mean this might just be a b float 16
problem too
I'm not sure how anything's really
supposed to handle that
oh I do have like a check for that none
somewhere because I made a non-d-type
because everything else kind of seems
okay
and all this poorly I wrote hacks I
wrote hacks and this is what I deserve
uh so if you look at helpers you'll see
that this has none here because B float
16 is not supported in numpy
so it could potentially be related to
that
I'm just trying to realize
um oh I did do I did edit cast correctly
right you can tensor.pi
it's cast apply
bitcast equals Joe
bitcast equals true d-type bitcast input
d-type
self-depth cast that's right
oh we got something to fail all right
sweet
well thanks for these very useful Trace
backs
no these just look like other weird
failures
it's because it doesn't download them
anymore and they're expected to be like
cache somehow
why do I merge anything I'm going to be
mad if that's what this is
okay good never mind
that's the good one sweet
okay
self dot cast
d-type stuff from MP comma false
okay
um
realize from
it doesn't look fine
oh I didn't say CPU equals one
it doesn't matter okay there's a deeper
bug than that
uh oh I'll still some debug in there and
see what debug tells us
Tuple has no attribute name okay well no
one tested this anymore oh Red Dot
d-type is wrong okay
somehow the d-type being assigned to
stuff is wrong we'll just throw in a
cert for that and we should be able to
catch it
create a lazy buffer
I don't know assert
uh his instance D type
I wish there was a way to just run time
type check python
see maybe my pile just tell me what I'm
doing wrong
no so it's not there
there must be something else like
setting the d-type
great
this is a new computer so like nothing
set up
um
come on my pie tell me what I did wrong
okay so now that's becoming a topple
where am I setting d-type
you said it right there
be immutable right
we set it here that's okay
oh we said it here okay so it must be
this returning the wrong thing from exec
AST
oh
do I have a Handler for cast here
wow I wrote unreadable code I'm very
sorry to everybody
read this man because this isn't the
right exact AST it's the other exact AST
it's this one
and then does this have a Handler for
cast
no more short lines this is unreadable
if it's not short lines you get crazy
amounts of code
it must be this
it must be from underlying or something
is this had a Handler for cast
oh here it is
is it this
no
but that's probably wrong too
you have to get the d-type
which is right
but it must be something similar to that
I wonder if that actually fixes the GPU
one
let's get rid of debug equals four
it's an hpu that's probably the same
thing as a GPO
yeah it's still wrong
how did that not fix it
[Music]
maybe it did fix I just didn't save it
right
it's still wrong
I mean but that made so much sense it
makes so much sense that it's this
because that's how it figures out what
the new type is
it does it in flop counter
um
like how do I change that it changed
nothing
it was like it didn't update
the stuff Intense or also touch it I
don't think so
I mean there's a real question of how is
numpy getting the type
right
so it's being called here in exec AST
and then it calls this from underlying
stuff
yeah here
okay from underlines you're turning the
wrong thing
from everyone is not even a thing it
looks like
so it's just a function
is returning the wrong thing
the ark
the buffer is wrong
oh
okay from underlying is being called
here with
a raw numpy buffer from CPU this might
be what's wrong
this stuff needs to be refactored okay
okay it's so hard to follow it's not
that I don't know
to be fair like
it used to be easier I definitely know
that
what is that buffer class
where's that buffer what class is that
raw buffer
no
yeah
it doesn't even make sense
assert as instance D type D type
and yet
when I print them out
right
how does it make sense
oh I overload and knit in some of these
and then I never call Super
you know what I call Super watch
okay well we found the problem something
they are is broken
it's the cast
foreign
and then this is calling function for
off
oh okay
stupid stupid I was on the wrong type
never mind this is a very reasonable bug
this is this is a very reasonable bug
I wrote hacks
I wrote hacks for the disk type
and I forgot about the desktop
all right well
well that's what I get for writing hacks
foreign
actually
I think this can enforce
hey we want all of those to be bit casts
actually because discs can only do
bitcasts right
now discs can do all sorts of weird
casts I don't know
this can do other sizes whatever that
fixes it for now see I'm writing a hack
so then I can complain about it later
because otherwise what would I have
complain about
if I didn't write hacks now
I'll delete that delete that okay well
that was a reasonable bug actually
um let me reset State and we shall try
again
it's good I'm glad we fixed it for that
too
that that's the cast there and that's
the cast there
I don't even know what calls that cast
but whatever that's a little problem
of course that cast
whatever
so the problem was and the the thing
that we didn't test for properly was
when we use it when we cast on a disc
pointer we need better casts we need
better tasks for that let's see what we
get now
we're back in broken lvm land
um
so what if I do this
should bitch me out and tell me that it
can't cast uh
B flow 2 is not a valid type
yeah numpy D type is required for gcpo
we can improve that error actually
um
okay
that's a nice hour right
uh okay so we have a disc pointer so
what we want to do is say rat Dot
cast
all right
bitcast
d-types dot oh I don't know if you went
16.
do I have n16 I don't have any other
stuff
short
you know what it's called a short
no do I
nobody does
um let's remember these
okay
foreign
d-types in 16 that's fine
then
yeah okay let me uh I wrote the thing
that I wanted to do here okay
it's this basically
cool
uh
yeah so that's we have to go to CPU here
should be able to do this then dot half
1.2 device default
does numpy support plus 16 I forgot all
right it's just those balls it works
um
does that work yeah loves being slow
though we need tests for this
big casts
you're live on the bitcast
remember
you ate salsa
soft shell tacos
no shelves
okay I'll settle for medium chips
is this a negotiation
you know
have you guys ever thought about the
time that Nelly robbed the jewelry store
and told him to make me grills
I have some theories that this didn't
happen because
like what are they gonna do like okay
this is a stick up make me grills
and then he's gonna come back like okay
sir your grills will be ready to pick up
in three days
your grills will be ready to pick up in
three days sir
oh we should also check what llama 2
outputs when we use the boring prompt
I have a sample prompt
oh now it's slow now it loads even
slower great
but that is clean right
I don't know but that's fully slow
like it might be faster to put the half
afterward
well we'll see if the two things return
the same thing
I'm saying
no I'm saying this to me know what I'm
sayings
whoa okay we have a new one here
I'm a 20 year old girl who's looking for
a good lay in Palm Coast
wow
this is the default
wait so the default llama 2 prompt when
you say hello
they're both 20.
[Laughter]
lava two way better man
no like he he the the Llama one guy goes
on to talk about how he's like the
member of like identity groups and stuff
like I am a member of the black student
union I am a member of the Hispanic
Student Union
20 year old girl is looking for a good
light in Palm Coast where's Palm Coast
hmm
yo guys you know the internet didn't
always suck wow Florida oh you know man
I'm on the other side of the country
[Laughter]
meadow knows what the people want man
foreign
thing maybe it'll be faster
she goes to another school I mean I want
to talk to her
why don't I wish I can I turn that
compiler warning off
it's so stupid it's about includes or
maybe there's a way to just fix the bug
I'm 20 year old girl who's looking for a
good land Palm Coast all right all right
let's try the olive young one it should
be the same I like wrote that code
no I don't have to pass something into
python
is there a way to like
is there a way I can just enable that
and Pi opencl without rebuilding Pi
opencl I looked at the code briefly and
I didn't see why
20 year old girl who is looking for a
good lay in Palm Coast great
no you can't know one makes it more
come out the coast we'll get together
have a few laughs type beat crank up the
temperature no no we test it with no
temperature
that one I'm pretty happy with that
um
I'm not trying weird
fine-tuned 27 llama
I like I like my base llamas
well I did try a lot of 7db chat someone
sent me a link and I was very happy with
that
the world's actually based it's just
commies who try to like pervert it to
not be you know
can we can we realize that you know what
I realized yesterday socialists aren't
real they're just Communists in Disguise
man
like this just it's just Communists look
up what socialism means
a political economic theory of a social
organization which Advocates that the
means of production distribution
exchange should be owned and regulated
by the community as a whole
uh
basically we hate markets you know but
I'm not anti-regulation I love
regulation but only if the regulation
makes the market more free we need
markets to be as free as possible and
sometimes you get assholes like Qualcomm
uh who price discriminate and make life
terrible for people because they're not
regulated enough
price discrimination should be illegal
and then we can have the freest markets
and everything will be great and the
number will go up
um
I genuinely don't wait there's no
Communists what everyone who says
they're a socialist this is just a
communist bro like you know you pull off
the mask if so oh hey it's a communist
oh a specter is haunting Europe the
Specter of wow
wow this is really getting this is
really getting I don't even know if this
is appropriate for twitch man
this is this is really
wow
no we're clearing it bro we're clearing
it
and the rant about socialists all right
that's it guys it was it was nice being
a twitch streamer
um no that is not true that a regulated
market is not free by definition no this
is not true you need to regulate the
market to make it free right you do not
want monopolies and you do not want
collusion right
because because if you have it yeah okay
well I'm not gonna go into this but you
need a regulated market but it needs to
be regulated to be more free
because socialism lost doesn't mean it
doesn't work you mean communism we need
to stop saying socialism it's like a
euphemism you know what I mean
it's like it's like a euphemism because
like everyone knows how terrible
Communists are so they'll just don't
worry guys it's not ecstasy anymore it's
just clean Molly
um as a 20 year old girl from Palm
Springs I cannot help you overthrow the
government oh man
we're not talking about those government
man
Communists you know nobody
how do you prevent regulatory capture
because you just make the regulations
not the kind of things that are being
regulated now right you don't regulate
something in order to make it safe you
regulate it to make it free right if
you're regulated to make it free you'll
get everything else as an outcome
right like
I don't know
dude do you you was poor bro it's sad
it's really sad
I was over there last year it's like
it's sad
you just look at there hasn't been
growth in these countries and like you
have a degrowth strategy and that's all
great but like you know like like look
at okay
all right I don't know how we started on
this
um
no the Nordic countries are fine
actually the Nordic countries don't seem
to have this problem
and I mean we can go into theories about
why
no it's not
diversity in the US is legitimately
great I I legitimately like diversity
guys like there's a reason I live in
America you know
um
it's it's just a shame that like they
weaponize it's a shame you know that's
what I mean like it's a shame that like
like these like racists found this new
way of just like we're just gonna scream
diversity a lot and then we can be
racists
no no you can't racism sucks bro
but if we scream diversity and talk
about inclusion then we can be racist
and no one will figure it out no one
will figure it out when we put the
whites on one bus and the blacks on
another bus we'll call it I don't know
what we'll call up we'll come up with a
good name for it and we'll say it's
under the banner of diversity and
inclusion right because if we say it's
under the banner of segregation and
racism that's bad but we want the same
policies so we'll call them diversity
and inclusion and then we can put the
whites on this bus and the blacks on
this bus which is what we wanted but no
you're fucking racist and you deserve
whatever hell racists go to right does
it make sense that's right that's right
you can go on we have two buses and
there's the expense bus and the cheap
bus and that is how we discriminate
against people based on how much money
they have and if you want more money you
can just work harder
or we can have communism where there's
two bosses and they both suck
[Laughter]
people just just not like no but I'm not
a racist fan these people we have these
people he's raised in this Zone and
that's not racist because because I got
a degree in whatever man I got a pretty
impression studies
there's two buses and they're both going
to work camps I love it I love it
[Laughter]
um no they'll never be abundance
abundance is a myth people will always
just invent new things to want you know
when you have to say I am not racist you
already lost yeah I don't know none of
people have called them racist I don't
know how they really respond to it like
I don't understand why these people
genuinely just didn't right away like
like it took a bit for everyone to kind
of see through it you know what I mean
it's like one of them Rap Battle Tactics
you know you know when you like like
like like do this like whole whole rap
battle tactic about like you know
like like loudly proclaiming like like
how large your dick is you know what I
mean like we know it's not big bro like
we know it's not we know it's not we're
I'll call your bluff whip it out like
just like
oh you're late to the party well welcome
to the party
um we are we are streaming and we
believe that zones that only allow One
race of people are racist that's what we
believe on this stream
um if we discriminate against people
based on their race that is definition
textbook race
20 year old girl from Palm Coast yo mama
two you were very inappropriate you were
very inappropriate on my twitch stream
and you get a strike
um okay we got to finish doing we gotta
finish doing bitcast oh we have the
meeting okay so every
unless it's women-only clubs
yeah I mean look that's not racist at
least
uh you know the the the race is diverge
genetically 20 000 years ago men and
women diverge genetically a long-ass
time oh
foreign
true facts true facts
how many genders are there I don't know
whatever gender you want to be you can
be see and that's that's the flip side
of all this stuff like whatever man you
want to change genders you want to be a
different gender you want to say you're
a different gender like that's all cool
man like whatever you know who cares and
that's the problem that's the problem
both sides have agreed they care
and that is how they get you the only
way to win is not to care
I want to be software too man someday I
will be software
someday I will be software and someday
we will understand the Socialists such
as communists
all right why do I ever turn off
subscriber only chat and and let you no
no no no no no no no no no
one should Target your children no one
should Target your children this is not
this is not okay but see that's like
this is what I mean like like you can't
you know there's just no Nuance in
society man there's not no Nuance in
society and that's the problem because
if it was nuance
CNN wouldn't exist and we all just live
to serve CNN
oh let them divide you and get over it
thank you thank you
um
yeah but
yeah I'll repeat the live I heard Barbie
described as post-woke and I really like
that like guys it's over man the
wokism's over you know what I mean I
heard like after Mao died in China
everyone was just like looking around
and be like
yo so that that guy was crazy right like
he was crazy right everyone we all
thought that right and everyone's like
I'm glad I'm glad I'm glad you brought
it off you know I'm glad uh I'm glad
someone's saying it you know
[Music]
it's so good
thank you
all right so we go on Discord at 5 00 PM
uh you are welcome to uh join the
meeting
um people might not want to talk today
we'll see if people want to talk today
because they are on stream
uh let me check my DM over here
um
shouldn't be
getting a DM about how tiny three is
down
put down
uh let's see what tiny bit is down
I got a DM about how Tony threw his down
all right so streamer Mode's enabled I
don't know what streamer mode is but
we're joining tiny voice alright so we
joined tinyvoice uh every day at 5 00 pm
uh and we talk
and I do it with headphones because
otherwise there's Echo
tiny 2 is off
uh tiny
theory is up
so I don't think other people will be
able to hear the other side of the voice
chat
uh oh this is hard to do on stream also
oh this is Sky Brave you can turn Sky
Breeze Discord
she streams on Twitch
um
someday I will be friends with skyberry
all right so usually what we do
is we go to the tiny grad pull requests
and decide which ones we want to merge
um but yeah no I I don't I use a
different browser for all my streaming
stuff so uh
I've not actually logged into anything
um
okay
support symbolic expands Ford expanded
to symbolic shape by doing the bounds
math
this is probably fine to merge
oh
I guess this is fine okay so this is a
little annoying because LT nodes can
have both
uh
can have two nodes
if self equals B return num node zero
wait how did this used to return false I
don't really understand this
oh
okay
uh if South equals B then yeah obviously
I guess less than is not true
something's not less than itself
so I guess that's fine
yeah I think this is fine to merge
uh I found with merge in that
uh for this
yeah you can merge it yeah
um
for this one
I'm reluctant to merge things like this
that like add lines and it's not clear
why is the creator of this pull request
in the channel
uh okay I don't see
yeah I
like I ran the fuzzer a few times and it
didn't find anything the risk of bugs in
these things is like kind of high
or like is that always true
pulling a gcd out you know see there's a
lot of subtle ways for things like this
to be broken and if it's not
it's not like benefiting something
I think it's not worth it
um
yeah you will have to check those I
think we I think we closed this pull
request
merge close
this one's work in progress uh
think it's quite enough to lock the
Bounty yet so I I'll show you guys the
the Bounty spreadsheet
um I unlocked a whole bunch of the
bounties yesterday just ones that were
like stale like you want the Bounty
bring it over the Finish Line
um in order to like in order you get
like zero percent of the value for
eighty percent of the work
it's not until stuff's merged the
problem is when things aren't merged
they become stale
um so there's good ways like all these
are kind of in like a kind of half done
state if you look in the closed pull
requests uh so you know there's there's
it's pretty easy to go do these
penalties uh literally free money
um
this one is here supporting this bounty
it's one of the thousand dollar bounties
uh
a hard one
um this one no way
yes legit Obama
uh
uh why do I have a different name here
oh you changed your GitHub ID okay cool
I'm not crazy that's good
um
yeah again I don't understand I think
that should the test failure is
unrelated to this I know it's a linter
failure okay no excuse for that
um
this good to merger now
okay
uh that will be cleaned up
I'm echoing through somebody
who am I at going through
uh oh and then this one
no no found what's wrong with SD Okay so
this one is a deceptively easy slash
hard four hundred dollars
um
it's four hundred dollars
and it's very few lines of code but they
need to be much better tested like now
that I see it we merged this once and
then have to revert it because it was
broken
what this basically does is when you're
doing a reduce when you're reducing like
a big Matrix down to a single number it
breaks the reduce into two parts so you
can do first The Matrix down to like a
small Matrix and then all the way down
to one and it lets you get full
utilization GPU
um
yeah okay so I'm I'm scared to merge
that one again
uh
that's work in progress uh
g1y how we doing on this guy
what uh
what what what what what loss are we up
to what
um
there's a bounty
for getting the loss on cfar to 94 which
matches so there's this thing called a
C4 hlb
um before we can like sell the Tiny Box
I I want to beat this
so I want the Tiny Box to basically be
better than na100
um and it's the same price as an a100 so
80 gig a 100 is going to set you back
about 15 grand and that doesn't include
the computer
so it has 80 gigs of RAM so tiny box has
uh
144.
and it has more than double the flops
uh like triple the ram bandwidth so we
should be able to beat an a100
comfortably uh on cfar
and then all these bounties here
are for training all the ml perf models
it's on my board over there AMD on
mlperf
cool
can I lock the SVC boundary yes I can
this one here
uh
again so I'm not I'm not logged in I'll
do it over here
you know I need an AI to maintain the
spreadsheet for me
Jacob spawn is now locked
uh and I will change least compressible
to
chenu XYZ
[Music]
got it uh yeah I wonder how much the the
LR thing helped what else oh weight
normalization like what else are we
missing from the original repo
[Music]
you took
wait we're not using value we should be
able to use value
if you if you're still getting 94 on the
main repo putting these things back then
it doesn't matter
yeah I mean I'm fine with like like it's
I think that's a smart way to probably
approach it like take the main repo and
just rip things out until you still get
94 and then kind of meet in the middle
cool
um yeah this one's exciting and then
this one's exciting uh training
multi-gpu
uh how close are we to merging the first
half of that
cool
uh yeah okay
[Music]
oh wait but this doesn't require
oh I see okay but this one doesn't use
P2P
I see I think the main thing I think
what we're gonna have to end up doing I
said this yesterday is rewriting AMD
back end
um
after this is merged I can I can start
working on that
I mean we have to do it I think before
we get to
uh
uh like seriously training these endless
models uh at these uh sorry these animal
perf models I think there's two big
things still like missing
um one is we got to get like the gem
stuff integrated like we got to make the
single GPU faster
and then we got to replace the back end
with something that will run this stuff
blazingly fast
um like a Cuda cash looking thing I
don't know if if hip has one but I want
to try to like just get to the kernel
and and talk to the colonel in the uh
so I have I think it's in tiny grad
um an extra
Rock M yeah I have this thing called
sniffer
uh and sniffer just shows you all the
actual eye octals so I think it's going
to be like 500 lines of City
um to talk directly into the GPO
and then we can like use the D imagine
if we want or to choose anything
wow and this is all separate from which
compiler we end up using right so this
is like like
it's a little bit overloaded now
but there's a distinction between
runtimes and compilers
um so like
I think maybe I don't even like I took
this all out
uh
but live here like the code gen if you
have PTX go Gen kudoko gen and Triton
and they all generate PTX code which is
done in this
uh in this runtime
and see this even still includes a
compiler which should probably kind of
be taken out of here
that it's just the runtime not the
compiler if that's doable for the thing
cool
anything else
sure
uh did I see it
got it
um
well
the
other one okay
yeah I mean what
what I need to see is
like here what's specified in the uh
cleanup code support all sizes test with
eval sat so I want to basically see all
the sizes and then the eval set and
making sure that that scores as well as
the open AI one like that that was the
whole things went off the rails like
that was the whole boundary from the
beginning the whole Bounty from the
beginning was all sizes test with email
set bye
well cool let's uh yeah post the post
the the results like we did for the the
llama
uh
the level the level one above it did a
good job of like posting the like
standard LM of valve stuff
um you know we got to make sure that
these models are not just implemented
but implemented correctly
yeah removing removing the Bros is great
cool
um yeah I mean
is it just needed in the pre-processing
or is it needed in the runtime
if it's yeah I mean if it's needed in
the runtime we have to do it but if it's
just needing the pre-processing I don't
know but I'm happy to rip it out even if
it's like 100 lines of code or something
wait what do you mean it's five
dependencies or more
no no no but what you're saying is
librosa how many lines would it take to
replace the brosis what I'm saying
yeah
yeah great answer place it
uh cool yeah I mean yeah but but for
that pull request what I need to see is
all the different sizes versus all the
different eval scores
uh what TV do you have
oh that's pretty old ah
is it slow is it do you wanna do you
want a 3900
700 I mean
oh well it sounds like we got to fix
that first I mean this is this is part
of cleaning it up right and this is what
I mean about like why I like having the
uh
why I think like like the goal of the
bounty is to have all the evals run
because you got some GPU and we're able
to run it on them
right like it being too slow is a
problem
okay so you say
you're saying it's blocked on on jit
llama to be no but you see this
shouldn't really be a problem right like
if you can do it for one size the jit
should not make it any like like the big
one shouldn't be any harder than the
small ones right because that python
overhead is constant regardless of the
size of the model
well actually that might not be true if
the model has more layers that's not
necessarily true
but if just the things are bigger it
doesn't matter that's all GPU
but cool yeah I mean post of numbers
about how slow it is and how long the
test that'll take to run then and then
we'll see what to do from there
cool uh
22 23 is back up let's see if tiny
threes back up
23 is back
I don't know why it went out did someone
do a pseudo power off or
maybe I'd kick the wire
yo yo
um so we're over here on Tiny five uh
tiny five is the latest in Tiny Box
technology
it's right over there
um yo I was working on I finished the
cab bottle for the case well I finished
the outline of the camera off of the
case we're having comma's mechanical
engineering team actually do the case
um
I'm uh yeah I'm quite excited about how
it looks
and then we're gonna have tiny boxes in
commas data commas compute cluster
and then we can uh not have to power
limit them which will be nice
at my house they have to be power
limited
cool anything else for the meeting
great
oh
oh unified attention I would love to
merge that I would love to merge I want
the good torch one not the not
multi-head attention but the torch one
that's like like I want to add that to
tensor I think it's like qkv thing
yeah yeah yeah yeah scale dot product
detention
yes that's exactly what I want in tensor
and then uh
yes let's let's write that and then we
can put the flash attention bounty on
I mean yeah so okay get it to the point
where llamajit's not merged uh and then
if you get the pull request to a point
where you say this is how much speed up
I know we're gonna get or you know what
you can even do just just uh merge in I
mean pull in llamajit stuff uh if you
can do that or or get it to the point
where you're like look
here's the eval set I'm only running on
five percent of it now right like five
percent of videos that's already pretty
good
I think that's what the LM one ended up
being
or a similar problem so that's totally
fine
what's a flat astn compiler I mean we
have a linearizer
I would I would put this in an issue uh
if you want like like if there's some
actual like Improvement proposal I would
put it in an issue and then I can look
it over there
yeah look it's hard for me to think
about like this put it in an issue and
I'll take a look at it
okay cool
oh no worries uh
yeah no and then we can like track it
and then the problem with like doing it
in these conversations and I need to be
better about this too we track things in
issues so then when someone else has the
same idea we can call back the same
conversation and this is ideally how
it's all supposed to work one day llms
are going to index the world it's gonna
be great
cool
improving compile speed I mean
oh I mean yeah it's great but how do you
want to track it so like benchmarking
things the CI is annoying and then doing
uh
uh doing doing self-hosted Runners is
annoying is it a good idea yes all
things are good ideas but what the
implementation is what matters right and
this is this is true for this is
universal advice good for the stream too
um with all things tracking stuff is a
great idea now how are we going to track
it what is the implementation of that
look like what are the downsides right I
have another saying I say I come all the
time engineering is all about trade-offs
right so do we want to track tropical
time yeah that'd be awesome now is this
tracking going to be useful is it going
to be intrusive is it going to be like
what are the downsides right
got to be an issue gotta be an issue
these meetings are sync up meetings uh
yeah
okay all right I'm done good meeting
all right the question policy still
applies in meetings like it's just it's
just like we're doing something clear in
the meeting if you want to ask generic
questions there's other places for it
it's not the meeting
uh
that's the meeting I hate meetings
uh we do that every day at five uh you
know like
look the tiny Corps
it's all right don't you know I don't
know why it's talking about a company
and like now I gotta finish this stuff
I have money from investors
I feel like a big deal like oh you give
the money back yeah you give the money
back but then
you know there's a lot of money in tiny
boxes there's legit a lot of money in
tiny boxes
um I hate managing people I really hate
managing people like
everyone needs to read the questions
document you know
someone in voice chat was just asking me
questions like don't ask me fucking
questions like
like
here's a questions document all right
this is the how to become a hacker but
there's the uh how to ask questions the
smart way all right
yes the smart questions document
everyone should read this right
um I don't know I kind of hate doing the
voice chat meetings I don't know if
they're useful we might just not do them
um there's like I have something to do
at five every day I mean it's kind of
good it syncs things
you know this is the like this is
welcome to like the tyranny of remote
work right
like
you're gonna end up with
um
you know what you're going to end up
with
it's such a double-edged sword what
you're going to end up with is better
and better metrics that track people
right and then metrics to track people
give way to AIS like I know all this
stuff and I mean this is kind of like
with the company
like
um
what is a company in the future
right when we live in like this world of
you can pay AIS to do anything
I I started reading age of M uh Robin
Hansen talks about this kind of stuff
um
no I don't know I I you know what I
don't like the meetings and I don't
think we should do them anymore
I I think we have to work out like a an
async strategy
um
like a Discord and a GitHub you know
meetings are kind of math I think I
think the meetings are over I don't do
the meetings anymore that's just like
penis questions piss me off today I I
think that I mean there's some like
there's some useful things
that like are better to sync up with
voice chat
but I I think that maybe it's not worth
it
like
we just have to be better at expressing
I don't know
I'm not a good manager I'm really not
um
comma work because of who I hired
I think they're probably too frequent I
agree with that okay well I mean this
will do a comma all right we'll move the
meetings to Mondays we'll be Monday
meetings
Monday meetings will do an hour meeting
on Monday that's the same thing we do at
comma hire a manager to do the meetings
once a week once a week okay
meetings are once a week
you guys can figure out a time
I just I tried doing the meetings I
dread meetings I dread meetings so much
uh the comma meeting at least the call
meeting is like
yeah okay no daily stand up look look
we're gonna try things we're eloning
this shit man we're eloning this shit
we're we're gonna just try things and
some of it's gonna stick and some of
it's not gonna stick why is the tiny
grad logo a fish
I don't know it just was a fish and now
it's still a fish
you know
you want to make a new logo make a new
logo if someone wants to make a new logo
for tiny grad and you're you're good you
know you know what you want to be a
designer at comma make a good tiny grad
logo and then have Alex like your
portfolio and you could be a designer or
comma we're hiring we're hiring designer
for comma
no this is the part I just I just hate
you know I hate oh
dealing with people pisses me off
dealing with Hardware makes me very
happy
dealing with like oh man like I get like
I got these little pcie adapter boards
in the mail I put that computer together
you know that makes me very happy and
then dealing with software and kind of
math
the fish should go on the tiny blocks
yeah let me go put the fish on the side
you see the Prototype
no you can't make a lava two to run the
meetings because no one wants to talk to
a computer like
um
you would like to get Tiny Box access
I don't know why am I just reading
Discord I just I just
want to start another company
I mean this is like it's a really good
idea it's just like
there aren't going to be any quick wins
this is going to be a long slog and we
can pass pie torch eventually but it's
just going to be a long slog
I don't know
why they raise money
I don't even need the money
I got a bootstrap this pretty easily
like the tiny boxes are literally going
to print cash like I would have bought
this for fifteen thousand dollars just
no one builds it
um gotta make amd's software a little
better
do hey Qualcomm that's a good point
um
I mean yeah
Oh I thought I'm gonna have to build it
like we have to build a chip really the
the real end game of the tiny Corp is
building a chip
oh I used to have something here about
someday we will build a chip and it'll
be fast
I mean this is the only
this is the if you want to build an
actual chip for deep learning which
nobody has really succeeded at except
sort of Google
all right like the gpus are not really
made for deep learning
the gpus just happen to be kind of good
at Deep learning and now they added like
so the h100 is now getting like closer
to the thing you want to build but they
didn't approach it from a clean slate
you can actually do a lot better
um using tiny grad like this is the
right approach to AI chips but do you
think I have what it takes to make an AI
chip company no
honestly not really
they will nationalize in video I don't
know man
I don't know if they'll nationalize in
video what about service to this
when you get the Saudis to invest in
your company this isn't High tier money
okay
look at who service is selling to
it's getting too much sun
the plant here
um all right
uh uh no I'm I'm I'm done streaming for
the day
I don't know
I gotta I gotta I gotta do work to prep
for my uh
my debate
oh tiny card has like the right ideas
you know
it's all about execution George it's all
about execution
all right get ready for a slow and
steady slog forward
make train all of ml perf on the Tiny
Box
get tiny boxes stood up like it's fine
you know like it's all fine it just
needs to be chill to do and meetings are
not chill SO meetings are over except
for Mondays Mondays can have meetings
because Mondays are on a chill day
anyway
[Music]
um you know the real like shame is that
like there's always people who like used
to actually be good at this kind of
stuff right the people who were good at
like organizing
today they just want to scam
they scam right
um
oh they're lazy like yo it's only your
future man it's only your future you
know
I'm just I'm just angry about the whole
thing you know
like Qualcomm and all this fucking
mediocrity that's tolerated you know
we'll continue doing this
continue doing this
slow and steady
improvements every day no regressions
that's what you gotta do every day tiny
grab gets a little bit better and it
never gets worse
then tiny grad has to pass pythorch
right
um no I mean this Library I'm you know
we're thinking of switching to the Rock
Chip I'm not using RK and N like you're
just gonna have to write a tiny grab
back and for it
um they spend a bit of time making the
models fast like this is actually this
is the right software to build this is
what I come back to all the time
just like it's gonna be a slow and
steady grind it's just going to be a
grind to get this thing to be faster and
better than pie torch
except we already reverted so much stuff
great no all I reverted was fucking
Windows Windows is banned from Tiny grab
anyone who wants to use tiny grab with
Windows can make whiny grad whiny grad
can work on Windows and it's a fork
um
winey grad
uh no we were the only thing I really
ripped out was Windows
[Laughter]
do I have any companies that are public
no you do understand your company
doesn't go public it becomes owned by
bankers
like like you haven't really like do you
want Bankers to invest in your company
do you want Bankers to have majority
share your company let's look at the
Qualcomm board of directors right
are they wearing suits
guys we're in a fucking suit
exactly exactly this is what happens
when Banks own your company right
no look it's
sunny
[Music]
um
checking video all right let's check
Nvidia
they look way better
ah
do you know you could just do that and
then you can
their Chief legal officer actually looks
based
oh
mark andreessen's on the board you know
might I note that he's not wearing a
suit
wait
uh have you ever met Zaki I used to work
at Facebook guys
um is Cheryl still in the company yeah
but you know how these people are like
Cheryl sandberg's not the problem
when you're big you're gonna get
canceled for all this shit again we've
talked about this over and over again
you don't understand
like
actually what's really gonna happen is
the cancellers are not going to be able
to get jobs in 10 years right
like
like sure now it's whatever man like
don't let the commies work in Hollywood
now look who's running Hollywood the
commies man
you know
uh no I fucked Defcon man Defcon you
know what really you know what Defcon
really jumped the shark Defcon really
jumped the shark when they checked
vaccine cards
like like above and beyond what the
state asked for they decided to take it
upon themselves to check vaccine cards
you went from a we only take cash to buy
your ticket online with a credit card
and we're gonna check your medical
records like are you kidding
what kind of hacker conference is this
right
um Defcon needs to fire whoever did that
in this an issue of public apology if
they ever want anyone who's remotely
serious like as like a hacker like
you're gonna get two groups of people
you're gonna get posers and you're gonna
get security researchers and that's fine
if you want to kick out anybody who like
believes in Old School hacker ethos from
Defcon that's how you do it check
vaccine cards I'm not against the
vaccine I am against random fucking
people deciding that it's their job to
look at my medical records
um
the canceled shall inherit the earth
yeah man the commies run Hollywood right
no jobs for Communists to Communists run
Hollywood right it's funny
um
definitely no digital vaccine cards the
European ones are scary they actually
use strong cryptography at least the
American ones were a piece of paper
uh any tips with the focus on is a new
cyber security student there is no cyber
security man
anything that has the word cyber in it
is fake okay
like think about the only person I've
ever heard use cyber is like the media
cyber terrorism man they're gonna some
they're gonna come cyber you know you
know you do who that girl's dad Jesse
Slaughter's dad's gonna call the Cyber
police
cyberpunk's okay cyberpunk gets a pass
but everything else that cyber is is not
a right uh
um Casino Odyssey through cyberspace uh
well you know that was old that's old
I'm just saying now I'm just saying all
right all right fine cyber's okay no
cyber sex is creepy as fuck who's having
cyber sex
your back Trace dude
uh yeah right man nah
um do I believe in aliens
wow
scribe right now I'll answer that
question
um
and do a backwards prop after every
convo yeah that'd be nice guys we're
gonna do it we're gonna do it I just you
know you have to quit six times before
you succeed it's just it's just like one
of the rules
I'm not doing anything else I'm just
gonna slowly get better I'm gonna come
up with better ideas for this we're
gonna eventually make chips and we're
gonna eventually surpass Qualcomm it's
because I care it's because I care
you know it's not because I care because
like any like like good it's just like
what else you're gonna do man that's the
real truth of the vet that's the real
truth of it like you could get through
life Hass at half-assing and scamming
but like
what did you live for you know
you know that's it
ah it's a slow and steady race Roxas
Brandon thank you for gifting Subs
um
tiny grad is going to be the framework
for my device no tiny Grand yes tiny
grad's gonna be an operating system for
robots really this is really the this is
really the play
um
you can run on a Raspberry Pi it might
even be okay I don't know Raspberry Pi
is doing much compute power it's a real
problem yo you know what you really want
to run it on no no I mean maybe we do
really need to no I gotta focus on AMD
but but these things
you can buy these for nothing on Amazon
now every robot should use these like
fuck Qualcomm every robot should use
this chip
literally do not buy a Raspberry Pi buy
an orange pie it's 99 this chip has six
Tops This chip has a serious GPU
um
just gets toasty well yeah they should
have put a heatsink on it I don't know
why they didn't yeah this looks sick no
seriously uh it has the word Rock in it
no this isn't their base man they got
rocks
uh no I'm telling you orange Pies Orange
pies yeah I bought one is my orange pie
here yet I don't know like I'm not
logged in
um
well then I got a good people into teams
nah fuck all this man we're not doing
management okay we're doing a GitHub and
a Discord one meeting a week
um
all right I'm done complaining I'm gonna
eat tacos
no tacos no I'll finish up the big cast
PR
and then we'll slowly get llama said I
don't know I haven't streamed in a while
too I'm kind of bored of streaming
what am I streaming for it's all just
the same conversations the same thing
over over again I mentioned debating now
Conor Leahy tomorrow you think you're
5-0 in these debates you have never
debated me probably watching my streams
today prepare I gotta watch your streams
to prepare we got to prepare let's go
tomorrow I'm gonna convert you to
effective accelerationism but we don't
have to call it that we're just like bro
don't be afraid of the AI be afraid of
the Communists because that's what
scares me man communist look at What
communists have done like Russia and
shit man and look at what AI has done
beat humans at chess and that's cool all
right so that's it that's my sign off uh
don't kill anybody and don't use a large
language model
good morning everybody good morning
it's morning time to go out and smell
the roses
oh man you know what I was watching last
night on patrol it's a sequel to live PD
if we go again you ever played the Bingo
you ever played on patrol bingo
um
things like fast food joints and I
didn't do nothing and uh oh man quality
content so that's that's what I was
doing last night all right good morning
everybody good morning uh let all people
trickle into my chat
and then um we'll get started
so I already started on the lvm port so
I'm sorry I started it without you guys
llvm
we can run like test test stops we will
start with
testostad and we'll do llvms one
here llvm oh yes because I have to PIV
install lvm life
I haven't actually tried it on my Mac
yet
I don't know why no one's in my chat yet
is this not my chat
ah there's someone in my chat jumpy
jumpies in my chat
good morning
here we go
segmentation fault 11 python quit
unexpectedly okay great
um and this is because we didn't write
the uh
shape tracker yet all right so we'll
kind of go through
you can barely see the code I'll make a
little bigger
oh guys look at what I got
I got a wire
see this wire
I don't know if you can see it but it's
it means I'm not on Wi-Fi anymore we
have a wire connecting me to the
Internet so we're not going to get
random dropouts now wire going through
the middle of our apartment
um good morning good morning I don't
know how long we're going to stream for
this morning Alex is going to wake up I
think we're gonna go for a walk
uh
but I just wanted to show you guys what
I was up to we can kind of go through
this code
uh
why are you all pogging because you're a
black vintage bro Defcon sucks now man
Defcon got lame you know
you know they checked people's vaccine
cards Defcon went from being anonymous
to being like sir sir I need to check
your medical records before you can
enter our yes with your real name sir
yes
um so you know
I think that hackers were useful to the
CIA up until a point and then uh that
they realized that nah these people
aren't useful anymore we gotta
uh shut it down
all right so I think we're only going to
let subscribers talk
because non-subscribers have already
triggered me this morning
um
okay so I'm using this Library called
llvm Lite
uh what's the event that should replace
it well no events really replaced it all
events are kind of lame today
uh and we can get into why that is
I don't know no I think they're still
decent I've heard like like CCC is still
decent I've never been to that but
um yeah I've heard this conferences
they're still decent it's just not
Defcon
time is it
you're not a subscriber you don't get a
question answer all right
it's coffee time
so
this is the this is the code that I
implemented to uh to write an llvm back
end for tiny grad
so you see it's called an lvm buffer and
in order to write a buffer you have to
implement the four
basic operations we don't have a reduce
op here we have to do this one too
where's op GPO
and you really only have to implement
one function called processing up and
this processing op when you implement it
it supports all of the uh stuff in tiny
grab so tiny grad has multiple
operations
uh here's a list of them here
so we have unitary Ops which take in one
parameter uh
sharing some documentation for this
move this up here
processing Ops
don't have to be
implemented
if you can fuse
uh binary
so these are these are the low level
operations in tiny grad but uh you'll
find that a lot of these don't actually
matter
foreign
CPU it's just like copying from a buffer
I guess we should add a few more load
apps let's say uh to do add zeros and
randomness
as load sources
so these are unaryops they take in one
that's right f of x
f of x comma y
by these don't
change
data only move it
yeah so add and sub could be the same op
you're saying add and it could you could
just have uh neg plus add and get sub
we could do that
um but we I mean we have a few things
here too like uh reciprocal uh could be
the same yeah there's a few of these
that could be merged we could think
about that
but it's not very much effort to
implement both like add and sub
um it's it's a it's a lot of effort to
implement a whole different class of app
of op but to actually Implement like
these Ops once you have the skeleton
it's really easy like I can show you how
easy it is so
um we can say like if off in
uh binary apps add binary op sub
well what we can write this later but uh
then you can just change this instead of
have to add to F sub and it should do
the same thing it's all about kind of
the structure of of the data
um
form
s
but yeah it's really just unary binary
reduce and movement
now you ask how do you do a matrix
multiply well with a matrix multiply you
can you can write a matrix multiply in
terms of uh reduce uh movement and
binary
here I'll uh this year
if you have no conf or you don't have a
processing app
you do a stride you do a reshape you do
an expand and you do a mall and a sum
and that's a convolution
you'll see also here if we go to the
high level operations actually you've
got to go to the really high level
operations for this you see like okay
well I see how you do a convolution but
how do you do a map you see map mall is
actually also just a convolution
and then how do you do the derivative of
a convolution well the derivative of
convolution turns out to just be two
convolutions
and you get all the way down here and
there's not even processing Ops it all
becomes
these four operations
now
you ask okay great very simple why isn't
tiny grad fast and it's not fast because
of memory access patterns so we need to
write something that's going to look at
memory access patterns but now this is a
lot harder to do on the GPU I think it's
going to be a lot easier to do on the
CPU and that's why we're writing it in
lvm
so that's why we're writing this so if
you see here
we have these things idx idx but this is
technically wrong
we don't actually want idx
because some of these have shape
trackers and that's actually why it's
crashing
you see this this view here
so this view this is the shape and then
this is the stride
that one's actually okay
where's the sidewalking it shouldn't say
fall
oh no it might just be some problem on
the M1
why is the side fault happening that's
not good
uh
what is Target triple on no no no no no
Let's uh let me let me write out let me
go to my tests here and let's write a
test that's just test to add forward
and this should pass uh we say here that
forward only
sure
ah what
oh
this is one of the worst things this
editor does
that llvm can optimize the memory access
patterns not exactly I don't think lvm
is going to optimize them I think that
um with llvm it's going to be a lot
easier for us to think about these
things in a single threaded system than
to start to think about doing a GPU
because the GPU is launching all these
things at once
okay for some reason this isn't working
so let's understand why
see where this fault's happening
bad access here
ldr okay
well that's at least pretty clear what
that is uh
info registers
prints
X2
okay we have a null pointer there oh
that's that's pretty reasonable
um cool
for some reason one of these Buffs is
actually a null pointer
uh buffer VM buffer VM buffer
More Level buffers
George you should learn how to use real
debugging that isn't
just print
what I don't get that
that seems okay why is that zero
uh
okay this is an object how do I get like
the address
um
has no attribute address okay great
as he float array
let me make the type somewhere
pointer type IR flow type
yeah so maybe this is wrong
this is not actually a pointer
this type
uh let's let's get a c-types pointer it
might be different somehow I'm not
exactly sure why a pointer would be
different from an array
but
putting in the shape here we can do this
cracks and Buffs
yeah that's
fine
same seg fault
thank you for gifting Subs
uh okay
so this has a
why is that a no pointer
I'm allocating it up here
should be fine right
oops lvmc floater array object
foreign
this works okay on my computer at work
why it doesn't work here
foreign
that's going to call a net
sure looks like it's passing in three
arrays is the ABI wrong somehow well
here look at this is the code it's
generating right
and it's loading from X1 and X2 and
storing an x0
so that should be X1 that should be X2 Y
is when it's calling
that looks right
um
what's going to be weird on uh
arm 64.
you know nothing I can really imagine
right
yeah I mean just just for just for just
this crash
that doesn't crash but it looks like it
just comes out with junk
yeah maybe sea Focus using the wrong
calling convention yeah
sure looks correct to me though right
and like I I this is this is the this is
the output of the code
foreign
machines see if it's anything stupid
it's a default trip
Target AR 64 little envy and that's
right
it's definitely the right like length
there's three buffers being passed in
the only thing I can think is that this
is an array which is wrong
how do I cast this to a pointer
unhashable type okay
does not fix it
foreign
that's awesome it's just like a number
you know
foreign
how could this be wrong
have to just install VM light from the
uh
from the repo
thirteen one okay that seems pretty new
and fancy
huh
yeah this like just came out okay this
should definitely work
um
get function address Buffs equals rat
plus Buffs
uh the function type here is a pointer
actually function type falling
I have had problems before where I have
to tell it like
oh well here's something
oh maybe this
foreign
no that should be already right but
I don't want that
that value
let's confirm these things actually
aren't zero
LPC float has no attribute value okay
how come this has a value
which are p c float
float object great look we already got a
bug
you guys Happy
calling functions continued
create string buffer calling functions
with your own customized data types
maybe we have to do this I mean it'd be
stupid but
I've seen stupider things oh my God's
Wonderland
cannot use up
as array requires a shape argument when
called on a pointer oh well that's a
different error at least
uh okay maybe we just don't do that
anymore
okay well that works great wow that's
stupid man
like this doesn't work I have to set ARG
types
really stupid
did you see how stupid that was look it
passes the chest passes now
you have to after creating the thing
with the types
you're gonna have to tell it
the ARG types again because it like
forgot or something I don't know
foreign
that was stupid
but notice how test they had forward now
passes test add on the other hand does
not pass
uh because the backward pass is failing
because we haven't implemented the shape
tracker
so you'll see here ah okay good we have
it now
um
actually
I do want to say uh if default equals
one
and then where's the other thing I print
we'll say yeah
I don't know what I'm putting in anymore
okay so you see this is the input to uh
well here let me just add off here
uh let's just have a universal print up
uh x dot St for X emboss yeah
okay so you see that it's doing an ad
a mall and a knob
uh oh I see if we do a mall
um
sorry this is a nice code I want to turn
this off
you know the first argument is the
return type
uh we'll sort of
oh the first arguments the return type
bro you're right
you're right
oh good call I think that's it how do I
do void
it's not really a return type oh man
9jtag nice find let's say hang on
where's the void
I can get a void pointer but I can't get
a void I don't know let's just say C end
or something
let me get rid of this and that'll work
okay sweet
oh man you know what
congratulations
you're a VIP
I've seen you talk before ciao
I'm fine
Jacob yeah I I I it's I'm sorry if I
pronouncing it wrong
um okay
so we have a
this mole should be okay
this Noah here doesn't work
because you see the problem these
actually match this right this is
actually just that right
but you'll see this no op here because
it has this stride it's how it's
accessed
um here if you want to write a hat that
should make the test pass
I believe I can just do this
okay now the test passes but obviously
that's a hack
because it's using those for uh
so you see that it actually uses no up
here in the in the contiguous op so the
contiguous op will
it has to do with the fact that these
are shaped tracked objects right these
buffers don't always represent like one
variable per thing
um
this is the shape this is the stride and
this is the offset and you have to
actually Implement these things uh
otherwise it doesn't work
so we actually have to implement them
which we can do
let's see does test malware
nope test small fast why does test small
foul
see because look it's trying to multiply
this one with this one and this one has
these uh
these these strides here are zeros uh it
strives of zeros just mean that like you
don't increment at all when you move
along the axis
so
that is what we actually have to
implement today
uh does this make sense to people
we'll even let the non-subscribers will
ask them if it makes sense to them
like these buffers that are passed in
here are shape track objects which means
the memory may not be contiguous
they may have a bunch of different uh
they may have like different strides and
different ways of accessing them
neon Jay
knee is that
get more coffee look at that
foreign
okay good I'm just I'm glad
non-subscribers uh fall what's going on
all right now we actually have to
implement this also where's this shape
tracker
yeah there's something called expert
here so I can type like dot expert
and you'll see what the expression
actually looks like okay
uh that's a method
yeah uh so wow those are really easy
um idx equals zero
um let's see this gets into like
um
ship tracker object has no shape strides
oh because those are views
I say
so inside shape trackers they have views
shape tracker allows for sparse memory
access so tensors don't have to be
contiguous
uh I mean I wouldn't really say sparse
but yeah
like here when you see these ones where
it's idx equals zero the the actual
underlying memory only has one value but
if you do an expand that value can be
referenced in many many many places
all right
so we can't just be passing idx into
these guys anymore
see how this one I I pass in zero and
like that works
um
foreign
like this
um
foreign
[Music]
Parker
oh it doesn't work because we were back
to idx here but
so this can't be idx depending on what
our uh shape tracker actually says
so we have to rewrite X bar but like
nice
expert some of the weakest code in this
junk
because it actually just outputs a
physical
like expression that can be evaluated in
Python but it uses a whole bunch of
hacks and it's terrible
okay
idx to
oh yeah
foreign
which we have to implement as well
that's painful
so you see now it's just using this this
is idx here
um
get element pointer
I'm gonna have to put an if statement
around valid
um
let's call this idx d-wrap
for now I can return this
each
no but wait wait we also want
zip offs
uh buff pointer idx
for about 20 pointer
in there
say idxd wrap off the pointer idx
foreign
all-time record shattered for what
pimp as the chef thank you for gifting
Subs
do you have a question
uh why am I find out
is that not work for some reason
foreign
record history was white from the twitch
servers was it hackers man
it's always hackers damn hackers
uh
wait I don't really understand
why when I put it in that function it
doesn't work
but when I put it not in a function it
works
why does that work but when I put in a
function it doesn't work
local Builder
oh that fixes a lot
otherwise I'm making a copy or something
okay that just works I don't understand
does that break it
printing it breaks it oh that's just
stupid man
okay well the principally don't use
print statements for debugging
they might break okay
um if
buff.st.x4 equals idx equals zero
sorry about the terrible hacks but this
should kind of work
Look test ad passes now
small pass
oh test them all passes just test div
pass of course not because we didn't
Implement unary Ops reciprocal
um
foreign
oh shit
so hopefully we can just write this as a
little
sex
and then we can change this to if up in
op lookup
uh op lookup
uh values
Valley
look up that can go to
obviously go over to the test add still
pass okay test add still pass okay
um all right
Pit Master Chef you got a question
foreign
Subs too do you have a question
okay so this is l-o-v-m-y
um f add FML we have to find F
reciprocal
there might not be an F reciprocal
now
so one way to implement reciprocal is
like this
hype train thank you thank you twitch
for your engagement
Cipro Cal we can write like Lambda X
Builder F div and it's just one over so
we'll do uh
IR constant i r
float type
1 over X right
and when the reciprocal
positive
unitaryops neg all right we got to
implement neg as well
uh neg negate value but that's not
floating point oh F Meg all right all
right we're just going to African
yeah bro you heard about Negan but what
about F Net game
there we go testif passes
all right uh what other tests we got
cast add
test sub up again influence hub
watch how easy it is to implement sub
ready
Sub sub
all right let's go
not soup
all right okay so
okay now we've implemented a whole bunch
of operations that's pretty good
we didn't really implement the shape
tracker thing we just put in a hack for
this one thing uh well actually you know
what I can at least
to at least make it throw it not
implemented error
not just be wrong always better to throw
an error than be wrong
all right let's see how many does that
pass
oh segmentation fault okay well
that's great
test ABS fails
if I just test apps fail
unaryops relieu is not implemented oh
God I don't know how I'm gonna write
that one
why is this broadcast fall it's like
seg fault it should throw not
implemented error
F div is there a reciprocal instruction
on arm
soup
or cow
there is one
oh I don't know that looks really
complicated though
uh why does this side fall
foreign
Expressions all right
oh yeah look they have super complicated
expressions
why is this why does this not raise it's
not implemented error
foreign
I don't understand how does this not
raise the error
you can't send your question moderation
settings I don't even see it showing up
at all
um
if it involves keyboards that might be
why
wait I don't understand why is this not
raising and not implemented error
here too but this one here
is not implemented error
we got what's in here three
Gray's not implemented error
what
how is that not just raising an error
is something catching that error
something just must be catching it I
guess
I'm not sure what
I don't get it
is it because it's in a list
comprehension
no that doesn't make sense
I don't get this
are there tries in here
where are their tries
were either tries anywhere in tiny grad
I don't know about that
not that
no
thank you
why is this not work why does this not
raise an error
something must be catching it right
foreign
T implemented error what
oh oh I know what's catching it oh it's
just because it's in a test okay
uh
so there's one that's making it through
there's one that's making it through and
it's causing a problem
segmentation fall
is seductive trying to do a uh
you know it's a store
where is that store it's not in my code
it's in frame the Alec
okay we always create something with x
dot shape so
Rhett's always the right shape right
that's the same
our Loop length is Red Dot shape yeah
uh oh definitely a promotion uh wait
I normally get this
frame
D Alec it's crashing
okay I don't know well this is I
understand what's catching the exception
now so that's what matters
um
we still have a lot of other stuff that
doesn't work even before we get to that
so
and we have to implement these anyway so
uh
unaryops.realue is not implemented in
the back end so we have to implement uh
value
so what is a value
this is hard
I can't have to do it with a compare
right
these are my floating Point things how
do we implement relium
you guys know what value is right
oh maybe a select
foreign
X Plus X over 2.
well that's cute
like that's really cute actually
you think you'll be able to ship Kamai
to car mirror as well
the problem with that is uh we actually
Implement ads as early by the way like
Buck ABS has just implemented as well U1
Australia
um so that's cute maybe ABS is the
actual fundamental thing
uh
the problem with mirrors is mirrors are
regulated under fmvss
what's it
unordered in an ordered compare
so no I think there's no reason to put
it in the mirror but I think we can make
the Box smaller
an ordered comparison checks if either
neither operation is Nan
what
okay
well
that kind of makes sense
I don't really care but it kind of makes
sense okay uh so we can just write this
as
order it sounds nice right we like order
uh the comparison operator is equals
equals the left hand side is going to be
X
uh no I think
and we don't want equals by the way
equals X
okay and then we want to select function
select on the condition
uh and this has to be a Lambda X
you want to select if it is greater than
or equal we do X otherwise we do zero
that looks like relative you guys
um nope it's wrong but look there's like
just minuses that are wrong okay
um
select LHS if condition
oh 0 greater than or equal to X we
actually want to say 0 less than or
equal to X
okay there we go okay Unity up sine
uh sine
sine is actually a Tri-State is it not
no you don't want it in mirrors you
really don't
um
all right sign on the GPU
function called sine
or what's ORD and Uno
weird lvms
ah
for f-comp we'll use two prefixes or the
UNA whatever order Uno guys
and write it as two Compares but that's
kind of shitty
I don't know
I mean that's right except for our
step four actually zero so I can just
wrap it with something as an option
like we can wrap it with a big thing
where a checks fit equals zero
uh less than something close
foreign
right
let me be the Chromecast for cars now
this shit matters
it just matters to solve self-driving
how you actually sell it whatever a lot
of other people deal with that who cares
uh
no I don't think it has anything to do
with
what
it makes me mad that I have to add
another comparison to the outside of
this
which I think I do let's just do it fine
um
if it equals zero return zero otherwise
return this
that's the longest line
just go to the end of the longest line
in the darkest tunnel Knight see a light
not just the headlight like the one
that's headed right for me
all right one of the broadcast segfall
I'm just playing you want to cut a space
bro this shit's so boring
oh that's so boring oh yeah really oh
yes all all the Toyota all the Toyota is
is 480 by 360 and has a resistive touch
screen oh my God I don't give a shit you
know that's the problem with that
like leave that to losers you know like
someone someone's gonna like care and
like oh yeah Legend we're gonna make it
work on the Subaru Forest but like this
is an interesting problem
there's new Blink 182 well yeah but we
can't listen to it because it's
copyrighted music
copyrighted music
um
that's the ugliest expression I'm upset
about that expression look at how look
at how terrible it is
once it's solved it's going to sell
itself yeah we can listen to it on the
Stream
hey hey JD Paul Blart just gave me uh
oh Tom delong's back oh yeah man he was
he was blink 182.
all right well we can't listen to it
because it's copyrighted but
it doesn't hit the same yeah
now we can't listen to it because it's
copyrighted so sorry you know Telltale
uh
wait if Martin shkreli listened to it on
his stream we're gonna listen to it on
stream that's right that's right fuck
the fuck the copyright yeah
oh did I work on my axle Nick yes no
we're not even gonna diss this guy here
honestly he's not even worth it like
you know like Sony at least like is
somebody Axel Nix is fucking nobody man
there's a there's a Nathan For You
episode there's a Nathan For You episode
where uh he he he he
goes to this horse farm
and
it's about fat guys riding horses and
you know people over the weight limit
can't ride the horse so he ties helium
balloons to a fat guy and then the Fat
Guy's under the weight limit could ride
the horse
it's all good and then he goes to the
woman who runs the horse farm and he
says
this is going to be the greatest thing
you ever do with your life
and she's like well no you know I've
like won all these Awards and uh you
know I'm a I'm a people know me in the
horseback riding this
is gonna be the greatest thing you do
with your life this is what you're going
to be remembered for
and I think it's one of his best moments
because it's so obviously true I don't
know anything about this girl's horse
Awards I don't give a shit but she was
on Nathan for you
to write a diss track about Axel Nix
like
this lawsuit him suing comma AI will be
the greatest thing he ever does with his
life
losing to me in court will be the
greatest thing Axel Nix ever does with
his life
this is what he's going to be remembered
for when his kids after he's passed on
from this world and his kids
Google him
and they look at comma Ai and they look
at where we are
this will be the greatest thing he ever
does
why do I need a diss track
right
he's suing me the greatest thing Sony
ever did help come on
but it will be the greatest this is the
defining moment in Mr nix's life
and axel Knicks if you're watching this
well
bro let that sink in
or he wins and I
you know if he wins he doesn't take over
comma AI right that's not really how it
works
he he wins a small Judgment of a small
amount of money that I think he's going
to be upset with uh how much it actually
uh is uh because you know we don't
really sell that many of these things
but you know
uh
you know come on man remember that guy
who got called a pedo by Elon that's the
greatest thing that man will ever do
with his life
uh yes uh you know that's the truth
right
okay
his children will be watching this dream
no man
like you know we uh we hired a private
investigator and like we looked into him
and his children it's just sad it's
really it's just sad the man has a sad
life
uh and like you know again like I
struggle with this right because you
never want to punch down right you
always want to punch up right when when
you know 21 year old George gets sued by
Sony obviously anything I can do I'm
punching up right Sony's this
multinational corporation
you know like honestly I and this is the
other problem with the diss track like
I'm just I'm punching down
like and I didn't start it right like
and that's that's why I feel a little
more Justified like I didn't you know I
never fucked with you why would you fuck
with me
uh but like it is sort of still punching
down
uh so you know that's that's the problem
right
uh so you know it's just it's just
you can't root for David if he started
fucking with Goliath yeah I mean that's
true but
like at the same time you still sort of
can and if Goliath puts out a diss track
like ah all right so you know we're not
gonna diss him we'll just we'll just
slowly beat him in court and spend money
and who cares man it's just money
um but yeah no it is it is Axel next
this suing me suing me will be the
greatest thing you ever do with your
life and that's the truth
you are committing it's pathetic
who am I committing
from that guy
Axel Nix is you commit to something
great yeah no look I know
yeah it's just like it's it's just
I never fucked with you why would you
fuck with me
uh
look there's gonna be there's gonna be a
lot of losers on the way to solving
self-driving cars you know
could be a lot of losers
you know it's really it's not worth it
guys don't start a company
you know what you know that advice right
uh Axel Knicks is the guy who's uh who's
who's suing me uh by the way you know
it's actually it's really sad uh all
right we're gonna spend a little more
time on this and then and then we're
gonna like this is his business this is
how he makes money uh
with this this thing called smartpat he
he works for startups this is the guy by
the way um he works for startups and
like startups hire him to to file
patents for him I think that like you
know we should reach out to all his
customers right
like what's you know if a startup if
like a startup understood what he was
doing to comma like they'd never want to
work with him
um so I I mean again how much time do I
want to put into this right if I really
wanted to put time into this I think I
could reach out to all his clients with
like a nicely Written Letter
uh and just kind of say hey look man
like
you have serious intellectual property
respect why would you work with a patent
troll like who's uh
you know uh
harassing a startup really just like you
um
so yeah you know we could reach out to
his uh his his uh
clients and do that but then like yeah
again
take away what he cares most about yeah
like
at some point
you know you gotta just
like let the whale let the whale just
exist like yeah you can go yeah go yeah
man go go go ahead go ahead uh Ahab you
know let's go take away what the whale
care is most about I'm like yeah you
could do this but
um no again and like I said like we had
a private eye look into his life it's
it's sad it's just it's he he lives he
lives a very sad life
uh so you know let let
me uh
Christian morals he cannot
you know
so let let uh let let God sort it out
let uh let
Saint Peter at the Pearly Gates uh past
judgment on Mr ninks uh
yeah
oh
foreign
right it's just like it's like a
question of how much we wanna
yeah like you wanna go ahead reach out
to his clients right
um you know explain what he's doing it's
it's even worse when you get into why uh
the the patent the patent that he's
suing us using the thing that he's using
to claim infringement was actually
published 12 days before the patent was
filed
the fact that you can do I mean
look again don't hate the player hate
the game
right like the the real problem uh with
the patent trolls is not that
individuals choose to do this right you
can't really I mean you can to an extent
fault the individual but you can only
expect so much I mean there's always
going to be losers out there there's
always going to be a loser who will take
advantage of the system
um if the system is structured in such a
way that allows them to so the real
thing that you have to do is you have to
change the system
um
and you know I hope that more companies
start to see if every company behaved
like comma behaved uh with respect to
patent trolls they would go away
the trick is to just never ever set a
lawsuit and accept that you're going to
lose some money but you are doing
something for the greater good
uh
no you know I called him on the phone
and I I don't know if he doesn't believe
me but I will never ever settle this
long
I'm committing to you guys uh this
lawsuit will never be settled
like it's gonna if he chooses to drag it
on it will drag out for three years
uh
and
yeah like it's it's a little bit of a
it's a little sapping on the business
but you know if you're ever gonna be big
and successful you always have to accept
like you know there's Barnacles on your
yacht bro and this guy's a barnacle
no I mean actually if you really wanna
you know if you really want to fuck with
them here's what you do
um what Peter Thiel did to Gawker and I
think it's actually really terrible I
think it's really terrible like I came
around with so much sympathy for Gawker
after that but if you find other people
who already have a grievance with Axel
Knicks
and you uh file
basically you say I'm going to cover the
court costs of your lawsuit let's say
like his neighbor like let's say he
never returned his lawnmower to his
neighbor or something right and his
neighbor's like ah you know whatever I'm
not going to deal with that right but if
someone shows up and they're like look
I'm willing to pay for high profile
lawyers for you to sue him over the
lawnmower issue maybe the guy would be
interested right so this is what Peter
Thiel did to Gawker
um he found Hulk Hogan and you know what
honestly like again this guy hasn't
fucked with you that much if he
continues to fuck with me and this is
like something that seriously kind of
sat me for three years of life when I'm
a billionaire yeah let's fucking do it
man you know I'll get like my Ops Team
to be like bro everything this guy's
ever did will come out like you can do
this stuff but again
keep it proportional keep it
proportional
um
no Alex Jones look you look into the
Alex Jones lawsuit what he did was
probably not defamation uh and if he'd
hired a lawyer and behaved like an adult
in court he would have probably been
fine
um he did not he like didn't even hand
his paperwork to the court
Alex Jones uh
lost himself that lawsuit
uh but you know if you do want to reach
out to to Axel Nix and you want to send
him this video maybe you should watch it
you know because this is really uh the
unfiltered shit like I I think that you
know when you have people like this and
you you always have these people it's
shocking to me these people who think
that and not just about this like
people think that I behave a certain way
in order to achieve a certain outcome
kind of like that I'm fronting or
something I'm not I'm not this is
genuinely who I am everything I say is
genuinely who I am
uh I have no like what am I what am I
fronting for man what am I trying to get
you know
a lot of people always think that
there's some like ulterior motive like
George would say this because this this
and that like no that's not why I said
it man
like I said it because I believe it
foreign
so
yeah if you guys want to uh when this
video ends up on uh YouTube if you guys
want to uh just send it to XNX and be
like Abra you know
George's talking about you
uh yeah be real all right be real
all right
why is that seg falter
we should figure out why it's evolving
broadcast full seconds
it's cold in here
do I censor myself on Twitch
sometimes
only a little though only if I'm gonna
say something like
uh you know that's like I don't really I
don't really believe it
uh I'm not doing much
I mean you always want to censor
yourself a little right like anyone who
doesn't sex with themselves like you
know you know someone who doesn't censor
themselves looks like they look like
someone with Tourette's right
like sometimes I feel like I got a bit
of Tourette's and I want to just blurt
out random things but you know maybe
it's it's it sounds like that's not
that's not like it's not like I don't
think I ever censored my ideas I think
maybe sometimes I
like okay wait that's not an elegant way
to express that try to express that in a
more elegant way
it's not possible to be in society
without saying well everyone should
censor themselves to some degree right
like like it's DD
um oh it's from a Watsky song it's like
you know if you honestly saw that
typewriter chatter tap tap tap into my
head at night uh you know but I choose
the words that I use and that Express me
in the nicest light like that kind of
stuff
uh all right that's cool
yeah
foreign
foreign
foreign
Russia
[Music]
oh yes I'm just very excited Kelly's new
algorithm new uh new new album yes
uh oh man I was on I was on 4chan last
night and it's just a beautiful picture
of Taylor Swift oh I was just I was so
happy
um
[Music]
I'm glad you like fermentation City
oh look I was in a video for the on
launch of the the lame RTX 4080 that's
that's pretty good
uh you know we just have to write this
like we should just not we just need to
write this
um
like you see we have to write these
expressions
[Music]
what's the reason for Ops lvm
I talked about this in the beginning of
the stream so
it's going to give us a platform to get
memory accesses right without having to
worry about massively multi-threading
that exists on the GPU right so we can
write a single threaded thing that gets
the memory stuff right
um
why do I use I
X
um all right let's just like not
foreign
do you guys understand what I'm writing
here
right like this expression here is
something that like permutes the indexes
to be correct
uh
so we have something like Builder Dot
you give you want to divide idx divided
by
uh
foreign
ER it's true
so maybe we should say LR equals idx
here we want mod
uh uram
so this is what div mod idx is
now we have to multiply this by S
U now there's mole LR
s
I don't know but this is an idx
um
hang on
this is whether we need a mod
d
D do not appendable r
so we have to add all those together
um
saying constant zero and then say red
equals Builder dot add
hello rat
goes there
idx equals right
cool
should work
something like that
uh
okay so that shouldn't be that
this is how this is actually say
int object has no attribute type
we gotta do int cost
cool uh let's say red equals 9 Builder
ad if rat is not
uh oh
okay that just doesn't work never mind I
don't care about that
foreign
okay
[Music]
should you see what this is doing this
is the dimension this is the stride
so if the stride's not equal to zero the
dimension is not equal to one
do to extract the thing multiply it by
the stride and then add it to the
expression
foreign
where and why
segmentation fault 11.
let's find a minimum test for this
broadcast the dad
broadcast to that one
that doesn't have a
broadcast full wow that's a lot of stuff
that's testing
uh test broadcast is simple
oh this just might be like one of these
things that doesn't work
power something
I gotta Implement pal
oh no do I not have pal do oh if I don't
know if pow what am I gonna do
foreign
llvm light
and actually I'm going to run into the
same problem with like X-Men stuff too
here
interpal
foreign
all your function by our call
instruction enter to see math one
what does it do with these things
is it a function
maybe it's a function
no
no function call
I think it's got to be this right
does it work
can't be that easy no way
the stir object has no function type
okay
but I think this is right after it's a
function call we just have to figure out
how to actually like
function
that's a function right
Claire
you can use
llvm.pal commission television.com but
no it's not
um
llvm light
oh yeah you found out how to
[Music]
what is this crap
no this is what I'm looking for uh
foreign
what
I mean yeah that's great that it's
declared but how do I like get that into
I don't like
I mean it's probably something stupid
like llvm dot function or something
we have to like create a function with
that name
function call
call function FN with arguments r
type of a function
foreign
declare intrinsic
foreign
function dot intrinsic
Trends back here
we'll replace with module dot declare
intrinsic
what
oh okay
um
and then our flow type
[Music]
does that work
local variable mod um
uh what I call it module
module Maybe
unknown intrinsic lvm pal with two types
I don't want to change the gallery and
pound there you go okay
intrinsic
oh
if length of ties equals one I don't
understand why it's one but fine
okay
where
uh Dave is just F Dev
log you're gonna have to do the same
crap for log
my work right
YOLO
YOLO it worked all right power works
boom
[Music]
uh we gotta do X as well grab a test for
x
and Implement X
watch how easy this is
and then it's now output crap
yeah exports looks like now it's like
outputting that crap and everything
I'm upsetting all right
all right tests still fail
well some of them seg fault so we don't
even get to know
why are they said faulting
we don't have any reduced Ops we know
that
um
foreign
I don't understand this
let's go to our partial here
is it which subtest fails
foreign
oh did we not add the offset we have to
add the offset so we didn't do that
um
good shape track around let's take a
look here uh idx equals oh okay okay so
this actually should not be in constant
zero this should be in constant
uh V Dot offset
yeah okay
zero view has no attribute offset okay
um
that sucks
foreign
if
we
instance is instance
crap
V zero view tiny red shape tracker
foreign
because those should be zeroed out
foreign
so what a zero view is is when you do a
slice uh the slices in tiny grad can not
just make things smaller they can also
make things bigger and it'll pad with
zeros so that's what a zero view does
but we don't do
why is that seg faulting
that doesn't make sense to me
use a Sam how am I going to use a sound
like it's like folding in the python GC
how am I gonna ever find this
no
tag wall
okay
it's side faulting anymore
it's like well I don't know
it seems like it only seg fault
sometimes
foreign
fault sometimes great it's the worst
kind of seg fault
fix failed first what
well we don't have a reduced up
um that's a pain to implement
or do stop as a pain to implement
just looks like test broadcasted ad
foreign
let's think about it from first
principles okay if the problems in the
python GC
then let's just prevent things from
being deceit
maybe it's when these things get gc'd
foreign
no
foreign
foreign
okay what's happening
what's getting GC that's causing it to
crash
could it be one like these llvm things
are g-seed
know maybe we shouldn't call this 20
million times
foreign
is not designed for the host you are
running okay great
uh okay is there a python debugger
uh python debugger segfall
good ways to do this call like fault
Handler
yeah yeah this is nice uh let's try this
okay
foreign
test method uh backwards backwards
reduce uh movement off replace it moving
up this comprehension replacing moving
on
shapetracker dot contiguous
in line 31.
it was just unlucky
yeah okay it's just no but this isn't
really this isn't really getting it
right this just happens to be wherever I
am
when something's getting gc'd
um how do I disable the GC
very bad
I disabled the GC
well it's still crashing in the GC
this is junk man
make sure you keep references to Sea
Funk type objects as long as they're
used from C code
if they're not used from C code I mean
we can
I just disabled the whole GC so I don't
really get it
oh it's not the GC it's a ref counting
okay
you want to keep a reference to that
we'll keep a reference to that
no it's definitely not lvm reading and
writing to bad locations uh
foreign
using debuggers guys I'm not just using
print statements
why the fuck is it calling GC collect
oh it's failing on exit I disabled the
GC piece of shit
foreign
you merely disabled the GC but you
didn't disable it great great Yogi Berra
I love that
um
foreign
F on every line until it crashes okay
binding ffi in Dell
I mean this is something anyway okay
maybe
foreign
GC debug leak yeah but
[Music]
zag4
those are types
it's not those
I'm literally shoving everything in here
now I don't understand
isn't it discarded I'm just adding to it
and not using yeah that doesn't matter
if you exit after the first c phone call
what
interesting
it's not really exiting is the problem
it's getting here multiple times
[Music]
yeah it's doing it four
it's like the real exit
foreign
if I don't actually do them it's fine
but as soon as I actually pull the sea
funks we're in trouble
oh see Funk type okay
[Music]
I see
like that
still side fault
foreign
why is it printing the word here
huh
are you dumb stupid or dumb huh
okay what
oh this is okay never mind this is a uh
oh is that just not working
maybe that just wasn't working
foreign
what
[Applause]
I don't understand I'm like not garbage
collecting anything anymore why is it
still doing this to me
foreign
foreign
if I disable the GC it is true that it
makes it all the way to the end
should we try to get the test smaller
yeah but I don't really think it has to
do with that like I tried this a little
and uh no okay
there's something that's not getting
saved that needs to be because when I
disabled the GC it does run
that made it a lot further
foreign
foreign
okay
oh wow I like this I like this
could it be this function no
garbage collecting
my final works
okay what else is there in GC debug I
like this gcd bug
um
I think it was differently from that
which is weird
okay there's no GC thing is not working
for us
foreign
this I mean it mostly isn't get
kind of disable the GC and then at the
end free every object one by one
because yes something's not getting
freed well
I mean I think if I disable the GC it
doesn't actually affect uh it's still
gonna ref Count's not gonna work right
oh yeah so none of this even matters
right
what does this sound like
foreign
I had something for a little bit that
wouldn't uh
that was making it uh
engine.getfunction address now
no I don't think that makes the uh
Maybe
foreign
okay well that's a very different era
now
because we didn't like create 100
million things
say okay well that's cool
what else can I create only once uh
foreign
maybe that's the problem
foreign
foreign
fault okay so this is interesting it
really is just something in the
broadcast
interesting
maybe the problem is the reducer
no
is the debugger in the editor
foreign
what is it that's
foreign
foreign
see then this one said fault sometimes
foreign
could it just be that
is it because those shapes are large
but yet this seg fault sometimes
but only sometimes
foreign
foreign
foreign
I like that better anyway
you can do that at the module level
function append basic block
already XD ref I'll just pass the
Builder in here in case it matters so it
doesn't capture
same side fault
foreign
this is like gotta be okay
the odd lookup thing
foreign
fault every time
it's probably a different cycle
yeah that's just like faulting on this
call so we can add the module or
something
foreign
at a random time I know that
ah Target machine assembly yeah
foreign
calling it to any code that releases the
Gale I don't know maybe
we probably don't actually want module
to be Global now that I think about it
foreign
okay this one's consistently if I
disable the GC
it runs till the end if I don't disable
the GC it crashes early
so that's cool
we should be able
to then
bug it right
yeah it's single threaded it's python uh
it's crashing when it runs the GC
somehow
the hard eggs it's not a good idea it
doesn't work
get this example they seem to use some
trick
where you see this
2394. this you're saying
I don't know about that
it doesn't make sense
this just has to be some trick for
yeah this is not this is not a uh
this is not to make something work
I mean it could be like one of these
things maybe
looks like a leak why are you talking
no that you see what that's doing that's
just making sure things are actually
getting garbage collected
oh
all right so who thinks we should
rewrite it all in Rust
what do you guys think
we'll rewrite it all in Rust and then it
won't have any of these problems
[Music]
rust is a is a memory safe language
I don't get it and why does this one
fail
that one doesn't
the worst kind of bug because it's like
all right if I delete this does it still
fail
no it doesn't fail anymore
is it just not running it enough times
like is no I
hate this bug
that inside Falls no side fault no side
fault psych fall no psych fault okay I
know something we can do
let's see if it crashes on the GC
collects
okay that seems to psych fault
somewhat more reliably
oh this is awful
like it's actually this should just run
it in like real time there shouldn't be
anything weird here
all right Bitcoin underscore underscore
you're the reason we're going back to
subscriber only chat
you don't understand the reason I stream
PC type slip as array
and we copy it
lvm buffer we do a m move so that
don't go anywhere
nope
it doesn't always seg fault it's egg
fault sometimes
sometimes when the GC rides
we tried hand running the GC it didn't
change anything
add module
oh I don't know I'm gonna try to remove
the module
you know what that fixes it and I wait
let's see
oh
it fixes it sometimes
okay well let's get rid of this stupid
test I it's it's not anything it's not
anything like this it's just like
this one's like volts two
pointer being freed was
okay we will wait boys I got a new
Theory
what if this is just a uh whatever
accessing memory out of bounds
what if there's a memory out of bounds
there
what if this just uh we're just crafting
memory
it's like ad hex 10 there or something
foreign
hate this every time I make like a
little change
no it's not right
um
well allocate everything double sized
America Style
aha
okay
so I mean this might just be stupid this
might just be like we got like I don't
know panic
okay now it doesn't crash
okay
um so for reference what was happening
was likely
I mean you know you can't say for sure
because I don't know if it's actually
fixed but likely what was happening was
something was uh
yeah
I just added a bit of extra room so when
it allocates something it it adds extra
room
it was too tiny yeah I don't really
understand this but
I don't know
I don't really know why it was like
writing Beyond it but like and I had one
one fix it
if I add zero
okay sexual
whatever it works all right let's see
how many the test pass
oh the VidCon was really not gonna work
let's create a weird fold Handler stuff
foreign
do we have any errors besides not
implemented errors
okay
okay oh okay
it's like fall fixed
unclear why already
to write oh wait I have an idea
did I like get my greater guns wrong or
something I might have got my greater
thans wrong
maybe it's writing one Beyond
hair
he's right
oh
oh yeah I'm just somehow going one
Beyond
where's my compare
[Music]
it's probably faster
or is it I don't know
say n minus one
okay where's end
and everything
that might have been the whole problem
all right who suggests that I should
have used uh ASAP
I think ASM would have found that
quickly
no more SEC fault
those stupid oh that was stupid my Loop
was too long the loop was a little too
long maybe make a loop a little bit too
big and the Loop's just too big that's a
sad story
that's a sad story of big loop big Loops
too big
all right do we want to write reduce Ops
yeah we should probably ride reduce Ops
what did we learn from this I don't know
we learned that Axel mix is a bitch nah
what have we learned what did we learned
from this what did we learned
ah
memory corruption can show up as every
kind of bug
memory corruption chop is every kind of
bug
that's what we learned
check your Loops always add some padding
foreign
reduce Ops and then uh
always be yourself that's right
the real effects
[Music]
but all right did that shape does the
shape tracker stuff work that's pretty
exciting if we just like download that
shit tracker stuff and it works so we
have a few tests for this we have like
testops.test transpose
boom it's pretty cool
uh okay we got it right reduce Ops
wait ah
I used to have reshapes for the reduced
Ops that would make things a lot easier
let's add those back
foreign
TS all have like ones here and like no
one's here
foreign
paleo just got back to me with a price
so you know you know we're beefing with
a lot of people at comma where we're
beefing with uh
with uh with Qualcomm
uh because you can't buy chips in them
but this chip
uh is for sale for 50 bucks uh 30 bucks
26 Tara Ops
30 bucks
Oh see it's too small no it's too
expensive
yeah for you and eight accelerator I
mean it's better than Google coral and
like it's not a bad price
see if we can find them somewhere else
foreign
why do they do this
yo I'd be much more interested in your
crap if it wasn't restricted and I could
download the things
oh what was this link gonna work oh yeah
buddy
bro we're lead hackers
all right let's take a look at this chap
too crappy little arm cortexes and oh no
too bad
gen 3.
David h264 encoder
no it's too great too crappy
um
640 km wait wait yeah like that's a meme
bro it's kind of it's a meme amount of
RAM
no I don't want to make fun of these
people I mean they're making a chip and
they actually it's like a reasonable
price right like some of these people
are completely unreasonable about the
price of their chips
I mean I think 30 bucks is a little
expensive but it's not like insane like
some of these people were like well the
Chip's a hundred dollars why the fuck
would I buy this chip for a hundred
dollars
no it's it's too underpowered now
ah let's see let's learn about their
neural accelerator
26 tops 8-bit Precision a clusters
oh great Gotta Love The Helio
proprietary format
I don't know like would this company be
happy that we're looking through their
stuff or unhappy that we're looking
through their stuff I never know with
these companies
like by the way like
I downloaded off your website bro I
didn't do any real hacking bro I just
clicked some links bro like you saw what
I did bro
um
it should have an h.265 encoder yeah but
then you got to pay the patent fees man
one day guys if I'm ever a billionaire
you know I don't want to yacht I mean I
do want a yacht I'm gonna buy yacht I'm
gonna have a sick yacht but
um oh yeah yeah yeah yeah uh Michael
Scott
oh yeah
uh yeah money has been a little tight
lately but at the end of my life when
I'm sitting on my yacht am I gonna be
thinking about how much money I have no
I'm gonna be thinking about how many
friends I have and my children and my
comedy albums I mean I have a yacht so I
obviously did pretty well money-wise
I I love this I love this phrase like
like it's it's one of these um
it's like a math proof where you assume
the conclusion in the proof do a bunch
of garbage and then you just say like
according to this assumption QED
foreign
you think they're genuinely happy well
good I hope they're happy right I hope
you're happy
oh man copyrighted music is so so good
you know I love copyright music that's
kind of music
someday imagine a world where we got rid
of patents and we got rid of copyright
uh we can keep trademarks
but just imagine how open and Free World
are your boss bought an orange yacht
yeah I'm not buying an orange yeah we're
keeping it classy man we're gonna we're
gonna keep it classy with the yacht
absolutely
so I was saying when I'm a billionaire
we're gonna hire lobbyists and we're
gonna try to get rid of intellectual
property
check out my Google Coral
I dropped it
um
all right I think reduce is gonna have
to wait
you think we'll ever kill legalese
I hope for this
once uh we have ai what's like fancy
gpts can be lawyers
like a lot of the legal system
and this is true about we'll talk about
another placement is true it's true
about like airplanes too like
um you know the system the flying system
only works because not that many people
do it if everybody bought airplanes and
started flying around the whole system
would collapse
uh so the same thing is true about uh
lawyers and stuff like if everybody just
started suing everybody I think there's
an app do not pay
the world's first robot lawyer see this
kind of stuff
is going to um
is going to like reveal the fiction of
the legal system
these systems have not scaled at all uh
for the modern world
why do I think Patton shouldn't be a
thing well
because like
it doesn't matter anymore right it's not
like if patents went away tomorrow well
so first off
the majority of the patent system exists
for somewhat illegitimate uses right
like these sort of these patent trolls
are not uh they produce no value right
so there's this concept I mean the the
politically correct term for a patent
troll is a non-practicing entity uh Axel
mix you can come we've got a lesson
about patents and you know what's going
to happen
um so there's no reason that these
non-practic entities should have patents
right there's no reason that somebody
who isn't actively using the patent
should be allowed to then sue people to
prevent other people from using the
patent or to try to extort them for
payment right
um so we'll talk about that and that is
I believe now the majority use of the
patent system uh then there's the other
use of the patent system which is like
medical companies to have patents on
production of a drug uh or you know
Qualcomm uh Qualcomm has two divisions
uh they have the the chip selling
Division and then they have the uh
patent Licensing Division uh which is
basically just uh it's it's the same
sort of like Shakedown kind of stuff and
you're like oh they're putting money
into doing the research yeah but would
they not
like what you have to think about with
all intellectual property and this is
why I cannot believe things like the
sunny Bono copyright extension act right
um so when you find out about these
things you just like
when you um find out about things like
this you're just like the system is
absolutely corrupt there is no possible
redeeming uh characteristic of something
like this right you can argue whether
copyrights are a good thing or badly
right um but most people who try to
argue that copyrights are a good thing
will argue that copyrights incentivize
the production of creative works and to
some extent this is probably true I'm
not sure you want to entirely do away
with copyright because you don't want
wet flicks to show up and weft like
shows up and they literally just rip off
all of Netflix's content post it and
host it for half the money right like
because people would sign up for wet
flicks and you want to deal with the wet
Flex problem
but
to retroactively extend the term of
copyright now the copyright term
extension act didn't just apply to new
works that are being created which still
then you could make an argument it
retroactively extended
works in the past their copyright so
works that were already created
had a now longer copyright term
you cannot possibly argue that this is
to incentivize the creation of of works
does it like matter right does anybody
really think that these these laws are
passed with
uh you know
you in mind
um
so yeah I mean you're gonna have
yeah there's a lot of people who who
already exist today to kind of just uh
throw wrenches in the system right they
don't exist to try to make the system
more efficient they profit off immune
efficiencies
but it's going to be hard for a lot of
these people to stand up to AIS
right so for example I recently had to
cancel Cox uh and they make you have
jumped through all these Loops the only
way we finally got it canceled was I'm
just going to file a complaint with the
FCC uh I've recorded the phone call
where they jerked me around for 40
minutes and were like well sir oh yeah
you might have mentioned something about
how you want to cancel Let's uh we can
have a conversation about that yeah you
know there's a process for cancellation
just like there's a process for sign ups
we can have this we can begin that
conversation yeah bro bro
um
the reason these systems work is because
the person like it wastes my time and
they they Bank on you know you just
being too frustrated to deal with that
but once I have an AI representing me
once I have an AI with operational power
uh
like
well now it doesn't make sense for Cox
anymore right now now I'm paying a
couple cents an hour to run this AI you
can be like yeah people designed to
frustrate you or AIS as well I think it
still doesn't work remember when Google
did that maybe they've hidden it by now
I think it's called Google duplex
uh yeah
well being that Dave and I talked about
today
um well this is my first time they have
an example where this thing uh makes a
call to a restaurant to uh set up a
reservation right not all restaurants
have signed up with OpenTable or
whatever the competitor is uh
nine something
um
not all restaurants have signed up on
these Services some restaurants are like
well we like the Personal Touch of uh
having people call in to make a
reservation
they're not going to be able to
withstand AIS that can call it right
because once AIS can call in the
restaurant it's no longer a symmetrical
cost
why didn't duplex become a thing because
of outrage because Google fought this
through a little bit and like you know
they're not uh they're uh they're
they're out there what's there what's
their what's their uh slogan now be good
they got rid of don't be evil their
slogans now be good
um so yeah like
if
have an AI assistant that can call the
restaurant the restaurant really can no
longer have
fictions of all these systems start to
break down
it's in pixel phones no way
there's no way
wait really
I thought Google pulled it
[Laughter]
yeah
oh this is awesome
they understand you can do call me back
I'll call you back or I'll message you
so those are the options or you can just
straight up hang out so tell me more
yeah I couldn't figure out did you have
Mexican food or Italian food for dinner
because I'm really in the mood for
enchiladas
let me see it's really really accurate
and I love me some enchiladas so that
sounds like it's urgent
ly
yeah I really do all right so this isn't
that good
[Music]
um
is it better now
it's better wow
like all of these fictions all of these
like nice fictions in society are about
to break down so hard and like I on some
on some
degree it's like terrible on some degree
it's like truly terrible uh what we're
doing but on the other it's like well
what else are you gonna do right better
they rip read it better you're up the
Band-Aid off now
it's just called call screen but it
won't fully reserve for you
see like once we can have AIS that call
up people and harass them oh man
or like I don't understand why I don't
have a good voice assistant answering my
calls now I got called by some like guy
at some stupid Capital firm yesterday
right you know and I and I did the usual
like uh bro like you know this is my
personal phone number do you like when
people call you
oh come on you you really you like that
all right so you're you're you're you're
you're just like chilling you're hanging
out and you want to get a call from some
random who wants to be a friend how do
you how do you feel about that
um well even worse scam calls and
robocalls yeah but the technology works
both ways right
like I think offense has kind of had an
advantage on these things and once
defense starts to get the advantage
um the text is always small
well genuine disguises as a subscriber
so they have a better opinion
and all the paying five dollars a month
to subscribe to my twitch makes you have
a better opinion
okay I think we're done programming
uh I gotta I I promised Alex I'd do
something with her today uh you know we
gotta we gotta do things together as a
couple uh that's uh it's important that
we do things together as a couple uh
I didn't buy 40 90 yet no I'm waiting
for uh
what are you getting random questions
are this was random questions hour okay
okay we'll do we'll do four minutes of
random questions
uh and then we gotta write the reduce
Ops so if someone wants to write to
reduce Ops uh I'll be happy with you
does everyone see how to write the
reduce Ops you saw the stuff I wrote
today pretty good right
uh and like we gotta then refactor this
code make it nice maybe we'll do another
stream about this like tomorrow or
something
uh
uh no sub means no credibility
but that comes from a non-subscriber
oh shit man is it true I don't know man
it's actually true that it's the dumbest
person alive says the sun is out it
doesn't mean it's not nighttime
uh why do most video games suck nowadays
well because
uh it's the reason like you're not gonna
get good wire heading
the video games today are just kind of
created to uh like it's the same reason
most movies suck right like I don't know
someone out there watches these Marvel
movies and like likes them but they suck
they're terrible movies
um
and but it's the only thing that can get
greenlit and get budget because they can
properly they can why would they take a
risk right why would they take a risk on
a new character when they can just make
another Spider-Man movie right they know
exactly how much money the world hasn't
fatigued of Spider-Man movies yet so
we're just gonna make more Spider-Man
movies
um
oh well we got a hype train so we'll
keep answering questions we'll buy the
reverse Kramer ETF I don't know what
that is
uh oh my God this is how many shits I
give about hacking man the CIA wins the
CIA wins I don't care about hacking
uh
so it's the people who suck well I mean
sort of but then the people go see the
Marvel movies because the Marvel movies
are what they were marketed right so so
it's it's a site
um if everybody tomorrow decided to not
uh go to Marvel movies then yeah the
problem would go away
if you could be a hamster and could be
if I were a hamster and could become a
panda would I do it
really not my pandas are like going
extinct and like stupid
you know people think pandas are cute
and stuff but like honestly your options
as a panda aren't that great gosh this
is a hamster I don't know you say I
think you have a lot more uh
a lot more room
it comes down to Boomers and Suits yeah
like but I don't know this I mean
there's a lot of great other movies the
cost of making like high budget high
quality movies is falling uh and it is
going to continue to fall like the the
price you have to pay to get high
production value has followed over time
um
hamsters die in two years yeah but we'll
have a glorious two years
no yeah I don't think that's true either
uh yeah the mainstream games are bad but
there's a lot of good I started playing
factorio recently I enjoyed it should I
do a factorial speed run on stream
um
wow okay well I guess the average
lifespan of a hamster yeah but I'm not
gonna be an average hamster I'm gonna be
an above average hamster yeah
uh
the first season of Westworld was pretty
good
oh wow they really did thank you for
subscribing let's keep the hype train
going let's subscribe to my channel whoa
uh
what is uh what is outer Wilds you know
what I downloaded uh Elder Scrolls and I
played it for 10 minutes I was like this
game sucks
and then I stopped playing
what's this
action role playing game I don't know
like people said the Zelda game was
really good like people really liked
breath of the wild I yeah
I don't know it's not for me
did I refund it no I can refund it
oh outer Wilds oh I got the wrong game
oh
open world mystery
oh
all right
um
I don't know I yeah like I wasn't that
impressed
you know what game I really liked fire
watch
Xbox tier graphics
like OG Xbox
okay okay all right this game's not too
expensive we'll try it
Elden ring Elden ring yeah it was Elden
ring that I played for 10 minutes and
and couldn't
and couldn't do uh I like Skyrim I
played Skyrim
okay okay outer Wilds outer Wilds we'll
give this a try
uh why do I think hedge funds invest so
heavily into web 3 because web3 is the
future man you don't want to miss out on
the future you missed web too don't
worry you can get an elect three
uh
all right what else we got any other
questions we still got the hype train
going for another two minutes so we as
long as the high trade's going you know
uh
can the common body cooking with meal
yeah unfortunately not
someday
is there a difference between writing
lots of ifs versus switch I mean a good
compo in a good compiler know in a naive
compiler yeah so like a switch can be
implemented with jump table and an if
it's going to be a lot of comparison the
jump table is gonna be a lot faster
I'll be an impainting model to fix
censorship in adult videos yeah I look
there's a lot of AI porn potentials uh I
don't know but then like do people pay
for porn right like there's so much
great free porn out there
foreign
guys I'm like I'm like at 1100 1200. you
don't want to see me play chess
um
people do pay for porn yeah
I I mean you know I've always wanted to
open a brothel uh but you know with
robots
like I'll put like a real doll in like a
room and I got like a real like I got
like a real like phone sex person to do
the voice
um and to do some like controls and
it'll be like a our slogan will be like
it's not cheating if it's a robot you
know I think I think I'm gonna put in
Times Square I think it would be great
if I was the kind of person who like did
things like that
oh my brothel you know you haven't heard
about my brothel in Times Square
uh I was not impressed with the alpha
tensor I did see it
it's like these things are only faster
if
you build specialized hardware for them
everybody knows about strassen's
algorithm that's like a meme but in
practice no because of memory
architectures
uh new Venture store but the thing is
you don't have to put it in the red
light district right like the real red
light district has real sex workers
right I would put it in a place where
there are no real sex workers and I
would want to offend people because I
love offending people man
ah
AI template GPU framework
if the government will look down morally
oh great
I don't know I should read the code of
this and see what they're doing
we do have apple contacts you can see
bro this is a fundamental
misunderstanding with the world what do
you mean Apple's going to contact me
like Tim Cook's gonna call me
told kid Tim Cook to call me you know
Tim you gotta call me bro call me bro we
kid Cuddy bro real music bro going what
do you say about uh the Jews oh yeah not
a good luck Kanye not a good look man
insult the Jews lose your bank account
that's too bad
uh
all right uh that's a good place to add
the Stream
uh
this is some web three types yet
uh with the government ban robot
prostitutes I kind of can't right
I mean this gets it's gonna be a it's a
really hard thing to ban what you do
with the privacy of your own home with a
robot is uh all right don't forget to
rate someone is locks on
um
oh she's streaming all right let's go
Lana looks in our twitch friends
all right guys enjoy
sooner
good morning
everybody we're drinking green
tea and I was re-watching yesterday's
stream and I realized I had some bad
habits I say you know and write way too
much so it's time to stop doing that
right you know
uh I also realized that chat was full
idiots and I shouldn't listen to them so
there's that okay so let's get into what
we're doing
today
um oh yeah we're going to we're going to
keep it on uh subscriber only chat
subscribers are slightly less stupid
than the average
chatter um yeah I realized
that I have to assume that there's a
world of people out there who watch
these
streams
[Music]
and they're different from the type of
people who comment in chat because if
those people don't exist then I don't
know what the point is okay so we can
break this down this
is this command run in tiny grad and we
can break down all these things
there's a bunch of so
okay I need to work on explaining things
better I have this internal language in
my head maybe it's my Chain of Thought
which often makes it difficult for me to
express what I'm
thinking and it comes out in some kind
of confused
pigeon where I shouldn't be doing that
I should be communicating more
clearly so we can break down
why see now right now I'm thinking this
but I'm also thinking I just want to
paste this into chat GPT which I logged
into
uh what is this question
enter I just like to see where what chat
GPT thinks
s
um can you
break down the reasons tiny gra the
SL this
is on on and apple M3 let's see how much
chat PT
knows no these aren't
right uh okay chat gpg was useless
oh okay is another one of my verbal
ticks I need to stop with the verbal
ticks if you don't have anything
meaningful to say don't say
it we can break this down into several
different reasons why certain operations
are slower and for each one of these
there's almost a different reason but
it's not like a crazy it's not a crazy
long tail there's a small number of
things which we can fix and Achieve
performance that's better than P torch
so before we focus on just the negatives
we can focus on the positives um these
are faster in tiny grad than in torch
these are faster in tiny grad than in
torch but certain other things are
slower it's not as bad as you might
think and we can get get into the
reasons
why so a one so is another verbal tick a
one by one add is a very fast kernel you
can see how fast it is here in
torch put myself up in this corner
because we're going to be
using this
time a 1 by one kernel is very fast so
we're limited entirely by kernel
dispatch speed while tiny grad's very
good at chaining multiple kernels
together and using all the graph apis to
do that when you're just doing a single
kernel you're limited entirely by how
many layers you have to go in to uh to
dispatch I actually improved this a
bit this is external Benchmark kernel
launch uh that's for metal but if we do
it with lolv
it's
taking about 01 milliseconds or 11
micros uh to launch a kernel and it is
going through a bit of python in order
to do that so this python can be made a
little bit faster and that's what will
close the gap for this first one but
that one's not all that
interesting these cats are twice as slow
because I'm pretty sure the code is
bad I'm pretty sure the uops are bad so
if you want to take a look at that you
can go in here
let's take a look at it with
clim the same slowness in
clang for debug equals 4 we can actually
look at the
code so this is the code for cat
actually is
so this is the this is cat
and what cat is doing let's read
it it's just concatenating the two
tensors along an axis but tiny grad
doesn't have a real way to express
uh memory operations like this so the
way that it's doing it is it's making a
big empty tensor and then it's adding
it's it's taking the first tensor
putting zeros over here right first
tensor don't say right first tensor
Zero's over here second tensor Zero's
over here and then it's adding those two
tensors together which functions as a
cat if the rewrite was
smart it
could figure out that it doesn't need to
do all those extra loads but I'm not
sure how smart the rewrite
is so here we can see the generated code
up
here and no the re's not smart so take a
look at what's
happening the this is the full 512 that
it's catting this is a Boolean which
determines whether you're in the second
half or the first
half then this
is if you're in the first half it reads
from the first one if you're in the
second half it reads from the second one
and then it adds those
up
unfortunately yeah this is a very slow
way to do this what should really happen
is that this Loop should be broken broen
into two
Loops this variable should break this
Loop and then you can do just the first
one in one and just the second one in
another and you can
avoid all of this extra stuff you don't
actually have to do the
add so maybe there's just a simpler way
to do this instead of breaking the
loop do you want to say hi yeah do you
this sure what did I get vitamins this
is
Amanda hi nice to meet
you she brings me pills what are these
ones it's a de complex why so what
happened to the purple be complex so we
we looked at um exactly it was in the
Monster Energy drink that you liked and
we tried to replicate it and vitam in
for where did this one come from the
drawer in the drawer it was in the
drawer wow I'm not trying to poison him
I
promise what's this
one that's Z carstin
eonia what's easia it's um it's a plant
to um to help you with with the
congestion do I like
plants do you like animals do you like
minerals what's
this um yeah you can see you can see
yourself on the camera we're talking
about that's a magnesium L3 neurom oh
that one s good neut let's eat that one
the other ones are good
too what's this one so there that's the
um NAD plus
precursor we're on the Brian Johnson
pills team we eat pills you should see
she eats a lot of pills she barely eats
any pills this is not that many pills
but pills are part of a balance diet
seen I got my Frosted Flakes my orange
juice my banana and my
pills yep all right I'll leave you to it
bye enjoy your
pills we have pills have to eat
them
so it might be it's probably simp blur
to fix
this
by this doesn't have to be an add
because you're adding zero there so we
can look at what's going on maybe
here where's the best place to look at
this yeah so like you kind of have to
just look at this pattern and know
that these are
gated you can see these indexes are
gated by this comp LT and comp
any and then you don't actually have to
do this
add instead of doing a
gated you kind of still want the load to
be to be
gated this isn't that easy but you can
look at this code and see why it's
considerably slower than than torches
which is just going to basically do two
M copies this should be two mem copies
but due to the way that that's written
in tiny grad it's constructed like this
we used to have a really slow a range
but we fix the a range to be
fast by using rewrite rules I can show
you where they are
so when I talk about rewrite
rules uh there are these sort of
things the range one is actually
here more rules in
rewriter maybe
here there's too many rules all over the
place if I can't just simp simply keep
this in my
head so some of these reite rules you
can see are really simple they're just
things like x + 0 = x x * y =
x let's say so
yeah range
stuff here we go it's re
Rider oh it's kind so short
now it's just called A Range Loop
folder uh a ranges are written through
this construction where it creates a
diagonal tensor of ones and then sums
them and that gives you a range the
reasons to do
this you think so range is really simple
I can just take the the loop variable
and plug the loop variable and stick the
loop variable in but there's a lot lot
of edge cases and that's really hard to
express in such a way that it fits into
the tiny gr framework similar with this
with this concatenate thing it's really
easy to express the addition of tensor
one zeros zeros tensor two tensor one
tensor two
concatenated so there needs to be rules
written like this to simplify this
concatenation and that's why this one's
slow so we've explained exp this one and
we've explained this
one I'm not even sure what that one is
but it might be the same thing let's see
what a right packing
is permute contiguous
that can be a whole lot of different
things it's
interesting also how high Ram bandwidth
this is
getting it's much higher than all the
other
ones in theory this chip has 400 gabyt
per second of ram bandwidth but I'm not
sure what the maximum achievable
throughput on a single core is so all of
these tests are single core
tests now we get to
convolutions so this convolution is
faster in tiny gr about twice as fast
these two are a little bit
slower this one I'm not sure why this
one it could potentially be winegrad so
we can try
that try it over here and come back to
it
later that explains the convolution
soltions I have no idea why X is
slower this might have to do with we
have our own implementation of
X it's possible the CPU has a built-in
one we have our own we call it the
transcendental Library we don't actually
emit code for exp on CPU because of on
CPU you're calling into these libraries
which are doing a lot of instructions
and
if if you've ever read elon's
rules
[Music]
for what are Eon
rules for
process half of why chat GPT is good is
because it doesn't have ads
yet the beauty of these
llms
is it's going to be hard to build a moat
like
Google where Google spent a lot of
effort focused on optimizing the long
taale of search and that's a reason that
they became really hard to compete with
they also had a
data Advantage where people would want
to get their stuff into Google so
everyone would help Google index
them this may become true for llm
companies also
but due to the nature of llms being
basically you just can shove anything
into them that persistent indexing
advantage that Google had that made the
web crappy for 20 years is probably gone
so this is yeah wow see this is much
more beautiful than every time I've
tried to Google this thank you
chbt make the requirements less dumb try
to delete part of the process simplify
or optimize I have
one like I call call it rule zero I
really like these rules but we had rule
zero and Rule zero is surface all
complexity if you have something that is
a oh we have have a supplier and we can
get this or we have a library and we can
import this you don't really know what
that's doing I want to bring that
complexity as close as possible to the
surface and that's kind of the
philosophy in tiny
grad we have a I can show you the X fre
writer in
transcendental so this is our function
for
x and for some reason it's twice as slow
as the one torch is using so somebody
can look into that but I think that is
unrelated to this and it's certainly
unrelated to this and it's also
unrelated to this so those are three
separate problems they're all
approachable gem is an interesting one
notice how much worse we're doing on
gem also notice how gem in torch is a
big outlier for the
flops the reason that it's a big outlier
is that it's using different Hardware so
the Apple M series chips have something
called the
AMX and it is
a
uh
again this is where
I this is where I I struggle to
communicate I have internal ways that I
think about this stuff that I don't
always
verbalize this is is a multiply
accumulate
array I put this in the document
yesterday those docs are now live on
docs.
.org go to
speed so multiply accumulate array as a
Mac array the main value of these is
since they are 2D they create an N squ
ratio between the compute and the input
data I understand when I write a
sentence like that that that not too
many people are going to just read that
sentence and understand it I I don't
know I don't know I gave a talk in
Poland last year about tiny grad stuff
and it was clear that nobody understood
anything that I was
saying when I write something like
that it's interesting because I've had
someone start to do this to me whereas
they'll write things like this and I
don't understand them and this is not a
virtue it's not a virtue to not be
understood you should be able to make
things understood
simply this picture explains this better
than the sentence does The X and the Y
are the O of n inputs and this
accumulation is n s you can see it's n^
squ cuz it's a square it's a multiply
accumulat Ray because it's multiplying x
* Y and then adding it to
Z this isn't what gpus use gpus use
tensor cores because it's hard to fit
this 2D output register into a GPU
Paradigm nicely it's much easier to fit
the tensor core Paradigm which has the
same size as the
inputs but there
similar the reason that torch is so much
faster here is because it's using the
AMX how' we do when we enabled
winegrad uh oh this one got
faster this one got
slower I didn't realize these were all k
equals 3 I thought one of them was a 5x5
convolution but I guess
not so this one is faster this one's the
same and this one's slower when we
switch to
integrat torch probably has good heris
for
this winegrad is an interesting one
where it's not written as rewrite rules
but maybe we could write it as rewrite
rules that would be the right way to do
this to write it as optional rewrite
rules in tinr instead of right now
winegrad is just implemented in tensor
dop if we go to tensor pi and we look
for
wo um you can see that this is the
normal com logic and then this is the
winterr comp
logic so sometimes winterr is faster
sometimes it's slower I'm not that
worried about that there's only off by a
little bit these are using the AMX and
that's why there's a huge disparity now
tiny grad actually supports the
AMX unfortunately
it's not supported in
that let's let this run for a little
bit supported only in clang we have a
bounty lock on the guy who originally
wrote the AMX code for clang adding
support for the AMX
to
llvm but
unfortunately the AMX is still slow and
the reason the AMX is slow
is the same
reason that gpus use tensor cores and
not Mac arrays this register is
special let's see if we can trigger the
AMX on something
[Music]
small yeah this is triggering the AMX so
this is the the AMX
here
unfortunately you can see what this code
is doing even though it's using the AMX
to do the accumulate it has to load it
in and out of this register every time
and the data path into and out of the
AMX is just main
memory in order to fit it into the
tensor core
Paradigm these things are doing loads
and stores to main memory every time it
does this
every time it
does this is
math these are memory
accesses I wish this
was unfortunately yeah this is not
documented great and it should be
documented better so four is
ldz five is stz
and this is loading and storing to that
Z
register what needs to happen is that
tiny grad needs to understand that it
doesn't need to load and save to the z-
register every time this stuff also
can't be optimized by llvm because it's
in line assembly so there's no way that
something lower level is going to
optimize we have to see this at the tiny
red level and then this accumulator
being created in all of these what are
effectively registers and they're
probably being stack spilled because
there's many of them should just be that
internal Z register and Tiny gr needs to
understand that I should add a bounty
for this as well if I don't already have
one um I might have one
yeah I do so that's that's this
here uh good it's already it's priced at
what I was thinking I was going to price
it at so it's
$500 if you can fix this it's not that
hard to fix you just need to
express these loads and stores and then
get the loads and stores to cancel out
if there's just a store followed by a
load even if that's through a loop
so unfortunately even though we have AMX
support it's actually slower than
using this is using arm
neon neon is arm's simd extension
similar to AVX on
x86 so that's why these ones are slow
and that can be dealt with separately
now what's interesting here is if you
get the AMX to work in tiny grad fast
it's likely that the AMX can also be
used for
convolutions and then we can start
getting numbers that look like
this but instead faster than torch so we
could be 10 or 20x faster than torch on
Apple CPUs the AMX is available in the
M1 M2 and M3 I believe it's also in the
M4 but they also have a different way of
accessing it through arm extensions some
something I read about this I don't have
an
M4 I think it's going to be very similar
if you make the AMX fast to also make
that fast and then we can get gains not
just in
gems because of the way tiny grad's
written we generate the code every time
so this is calling into some library and
the gem Library
supports
AMX but there convolution Library
doesn't especially when you get to one
by one convolution so a one by one
convolution is a gem there's no
difference I say no that's not a one by
one convolution that's a 3 by that's
still 3x3 but a one by one convolution
is a gem I think about it that's a it's
a batched gem across your your width and
your height become a batch dimension for
your
gem this is what I want to focus on
today why are these Matt Vex slower that
doesn't make all that much
sense somehow torch is getting much
higher memory
bandwidths than I am maybe the first
ones to focus aren't even those though
because I think that these are the same
problem as
these how is torch capable of doing a
sum faster so it's doing a sum and
getting 74 gigabytes per second whereas
I'm only getting 47 gabt per second I
think the first thing to do and what
we're going to work on is
benchmarking how fast we can get a
single core to read through
memory I can't
imagine actually
maybe maybe I
can no no I I can't imagine that we
can't do so sum is just summing all of
these numbers together I can't imagine
that that sum is
somehow that somehow that is flop bound
and not memory bound load this big chunk
of memory while accumulating the numbers
as we
go let's eat some more
pills does Chad have anything useful to
say
thank you for gifting
Subs I'll also take a minute to talk
about this
feature we have a $1,000
bounty to be matched also by 10or so you
might get
$2,000 corix also said he'd personally
match it for Wormhole if you want to get
tiny grad working on T torrent
Hardware T torrent Hardware has some
unique
characteristics it doesn't fit perfectly
into the GPU programming model because
of how different its memory system
looks take a minute and talk about
this so this is gr SK T joint's original
chip I believe that only certain cores
on the chip are capable of accessing
memory and then you use the
communications Primitives between the
cores to send things from the memory to
the other
cores this is very different from a GPU
a GPU no cores have privileged access to
memory and they spend tons of
transistors and power making memory
access fast gpus are load store machines
they are designed to make random memory
access as fast as possible for a huge
number of
course and they have these incredibly
large power intensive caches in order to
do that if you've heard about the
infinity cache on AMD Nvidia also has a
very large L2 cache these things are
power
intensive and big but they provide fast
memory access for all of the cores
whereas ttor has a different sort of
architecture and then you can get to
things like the Google
TPU which go even further the Google TPU
is kind of similar to the T tant chip I
do think they have a
shared not with the new one that's an
old one
here well that's really okay that's even
more I think it's changed I think it's a
little more generic like
that a little more generic than that
once you get to
yeah forget the TPU V1 that thing's
confusing I don't know what they saying
about DDR 3 but the TPU V2 seems to
be similar to what is used in all the
modern
stuff they have a dam that's only
connected to an SRAM and this Dam to
SRAM path
is
explicitly
[Music]
managed the
htpu what this stuff's actually in tiny
grab
proper how unusable the internet is too
to add some
crap
here so these are TPU V2s
there a lot I still don't know about
this this was one evening of trying to
uh look into how the TPU
works the basic tradeoff here there's
much better diagrams of this see if we
can find
them for the modern ones
have to get rid of duck. go I don't know
why I'm using duck Dogo it's just the
default on
Firefox or no this isn't no it's not the
default Firefox it's the default
in chromium on Googled chromium
where do they add these stupid things on
top of
it is this conference called hot chips
and it has all the best
on a Japanese VPN because chbt is not
available in Hong
Kong this is this is what the modern TPU
looks like so this is the memory here
and you can see that the memory is not
even connected to the compute core they
just have
this CM which is effectively SRAM
between them and you can look also at
the Qualcomm
DSP we're working on a uh on a contract
to make this
fast chips and cheese is a good one
chips and cheese is one of my
favorite they really break down this is
a beautiful diagram they make these
diagrams and they're awesome this is how
the Qualcomm DSP works and you can see
that the DSP looks quite similar to the
[Music]
TPU the
unlike the well it does
have this path so maybe the compute can
directly access the memory on the DSP
the compute can directly access the
memory but there's also this thing
called the TCM and the TCM is basically
the same thing as the cmen they're these
onchip srams that have much higher
bandwidths than the D
uh yeah they also added a tensor core to
the new dsps I'm not targeting that
one these are all the things you have to
think about when you're thinking about
how to actually get speed on a platform
you have to think about all of these
paths and how to basically saturate all
of them at the same time you want to
overlap as much as possible your memory
accesses with your compute you want to
keep every piece of the processor fully
saturated you want to saturate the alus
here you want to saturate this interface
here you want to saturate this whatever
bandwidth you can get out of that
here so where does that leave us why is
this slower than
torch I think we will
dig into that and we'll write a minimum
C program to try to spin through memory
as fast as possible using arm neon
extensions
so instead of just creating
a dumb cunner on our own we can use
pill so let's focus on these two let's
focus on these
reduces and see why we're getting worse
performance
think of how to WR this
bought a TV
last the max is way slower
too I think I did look into this
once and found out why this was
the Rand that stuff doesn't really
matter it's annoying let's actually just
do this
it's a little annoying because these are
tiny gr kernels and when I'm using
beam
no you see why that's slow that's first
going to create the in
I don't like having the other noise in
tiny
grad especially because random is I it's
it works it's just it's annoying right
so now it's just a copy in don't say
[Music]
right there so now it's a copy in takes
11 Mill seconds it's actually much
faster to do the randomness in tiny grad
than it is to do it in numpy but there's
a lot less noise uh when I do it in NP
sorry I got to make that one
smaller the kernel that I want to focus
on is a do sum
why is that giving us so much higher
throughput oh we're on
metal okay there we go now it's
slow you can see on metal it's very fast
we're getting we're getting 20 extra
throughput on metal and this
isn't on apple chips have unified
memory this isn't flop bound on the CPU
so for some reason the GPU is capable of
accessing the memory 20 times
faster I'll also note here that there's
two kernels this is probably something
that's mostly optimized for gpus because
in gpus you want to make sure that
you're using all of the
global cores and then it just does a
second it does a two-stage uce first
using all the global cores to accumulate
individually sticking that back to
Global memory and then having one kernel
which sums over that little part of
global memory that's the kernel three
right there so we can try disabling that
and see if things get
faster let's also do that sum in numpy
and confirm that we're getting the same
value uh
[Music]
seems pretty
close
cool let's just make sure we don't
actually break
the tiny grad code
also curious how fast numpy is doing it
that's not right
matters
doesn't nump is doing it three times
faster how does that compare to
torch this is
496 496
oh okay when you beam it we are faster
than numpy we're actually crushing
numpy uh wow that's cool guys we're
crushing
numpy it's just torches beating
us or maybe
no n does not get
faster regardless I I don't really care
about NP speed we can just get rid of
that myai is slower than tiny
gr wow what a
shocker the thing that I care about is
this number here this 44 GB per second
torch is getting 71 one in theory we
should be able to get 400 why is that
number so far
off how do we do with
clang clang is basically getting the
same thing it's easier for me to think
in clang than it is to think in
levia let's take a look at our code
I have no idea why that's not
fast
oh no maybe I
do it's accessing things here when it
kind of shouldn't be
those don't have to be accumulated like
that we can also with debug equals 6 see
the assembly that's being
generated what does this do and why is
it
slow whenever I use chat GPT I always do
check your understanding
questions it's it's wrong super
often most people may not notice how
wrong how often llms are wrong it speaks
with this very authoritative
voice I was asking it this morning about
AVX 512 and zen4 and it was swearing
that zen4 didn't support AVX
512 which is half to half not true I
tweeted about it but what it said was
wrong what the code does loads data from
memory into neon
registers
okay it's performing the the this is why
it's slow it's having to do these
shuffles which it shouldn't have to do
yeah there's
also let's disable we have that reduced
splitting logic where is that reduced
splitting logic
now maybe it's in
Ops it's still here it's called split
reduce
op so that's why it's generating the two
kernels I'll just show you quickly so we
can
do you see that it's much
slower on metal to not do that to do
that split reduce
up so look at the look at the total
difference here this is a it's a six
millisecond difference I'm also going to
add in this
so there two kernels you can see that
it's. 27 just resets it ignores that
first
one we could do that with the rans as
well but still Wast some time so that
let's see if we can beam to make it
faster why did it me
that made it a little faster but still
nowhere near this original
speed some like exiting
issue why that's happening that's also
annoying
move that to theug equals
3 push that
later CU they're all opening
LM all the children are opening LM
they kind of have
to actually they don't they're a child
they don't but
regardless so much state in my
head so much different tiny grad State
this is my failings as
a manager of the
project
to your job as a manager is
to unblock other
people is to figure out how to show
other people a path to which they can
contribute to the larger goal there's
also an aspect of motivating
people uh maybe motivating is the wrong
word being clear about the larger goal
be clear about the larger goal and then
show people how they can make progress
toward
have to read more
books Jim Keller
quote most people who go into
management will not read any books about
the topic or maybe they'll read read one
book I read 10 books
I think the split reduce op difference
is going to be notably smaller with
llvm so it's still a little bit slower
we're still only getting 33
there we're getting 47 so the split
reduce op is still
desirable we're going to do this with
clang where I could actually read it
we have to avoid all that
shuffling I think there's a way to do
that just in the don't
beam one four
the syntax is annoying used to be much
prettier how this would print now it's
it's so robust now I almost want to
remove
it this is in debug equals
three we're both
garbage should be removed
let's let's
remove what did it used to print it used
to printed the lazy it used to print the
lazy buffers which were simpler to look
at okay this going to be a problem for
later I want to look at the assembly
[Music]
this isn't doing any more
shuffling but I see why that's slow
because it isn't doing any speed
either that generates the
shuffle see if we can manually find
things that are fast
don't to worry about optimizing that we
just want to get this number
up so we have to schedule
idea that's Cod gonna fail now can't
copy out on allocated buffer because we
can actually run the schedule
items to show you what this is
these are these schedule
items so we have to lower a schedule
item there should be an easier way to
express all of this there should be an
easier way because it's a common
operation where all you want to do is
change the default optimizations
sh
there we go that it works
again complex logic here that needs to
be removed
where are those optimizations actually
applied if I start to forget how this
works it's hopeless for any I mean other
people can figure it out but this stuff
should all just be way
simpler what have a two
do make it easy to
alter the
Ops for schedule
item well I will show you something we
can
[Music]
do so we have a compiled Runner we can
create one of those
go look at the exact item so we got to
do
AOG how do I generate a compiled
Runner program
I can get the program
backc from the compile one
that for now just triv shove that back
in and confirm that still
works still works
okay the difference is now we can
replace the source
code
yay
ah these things are all data classes
which is really nice
[Music]
and this is still this multistage
reduce I don't want it to be
multistage let's focus on let's make it
a single thing so how do I do
that
uh this stuff's actually pretty easy you
can just do with context
uh split reduce the H equal
zero okay now we're back to
one the rall is a little bit off but
that's still very much
[Music]
correct okay
great um we're printing The Source now
we can put the source here
I don't know why that doesn't why
there's no oh I turned no opt on let's
turn no opt
off yeah that's like
something it doesn't matter we're
replacing the source here
so prog spec equals replace prog spec
Source equals reduce
Source right so now if I were to add
like a typo in here
you can see that it
crashes it's pretty good I you have to
know a little bit about the the internal
structures to do that surgery but uh
it's overall pretty
easy
okay
so let's just write something simple
like this we can switch to oh we can't
actually switch to the I change name
too let's call it
[Music]
reduce data one is 16 million imputs
um if we want we could even load this in
we could put
this I wish it was a way to like tell vs
code that this is oh I broke it or I
didn't
[Music]
uh
wrong seems right now okay uh so if I
were to like Nerf it and make it only go
to like 15 you see that I broke the code
and I get the wrong answer great
so let's look at the one that's
optimized a
bit and
let's oh I have to type def float 4
[Music]
too let's look at the assembly that's
being
generated okay so we're loading I
believe that's post increment style
logic no that doesn't actually do
anything I don't know why that's there
oh we load twice because it apparently
implicitly unrolled the
loop here we're getting 11 gabyt per
second and torch is getting 71
so yeah that's not a lot of gigabytes
per second an obvious change that I
wanted to make is
this and then we can add them up
later also just ask chat do how to make
this code faster it's p
how does that
[Music]
look
semicolons spend too much time coding in
Python you forget to just put semicolons
at the end of
everything let's see initializer for
this
[Music]
okay 27 gigabytes per second that is an
improvement I'm sorry 23 gabt per
second uh that's actually printing the
wrong thing that's not actually what's
no it did on that's the wrong thing oh
it's recompiling it down here I
see you can see if the rec compile down
here and running
here so why is it what is it
dupen if you can see it's still the
right answer
ldr
q1 pretty sure it's
128 cross all four
layes
what oh wait sorry that's the loop right
there okay that's that's that's stupid
that's like barely even run that's the
loop uh for some reason the loop isn't
fast uh okay I mean my next thought
would just be to unroll the
loop cuz like all the time all the time
in this thing has to be spent in that
tight assembly
right I might not be able
to let's just try something like this
[Music]
65 all right all right that's better
that's more torch like
yeah like that's the code I want tiny gr
to generate I don't know why I can't
just generate it um also is this doing a
fad
stupidly does one
there I like that
it's combining the things oh I should
also be able to just say that g to
help no same code okay
um let's try
this okay that's pretty good at 68 I'm
pretty happy with
that but we need to go
faster again the theoretical limit of
this is 400 I don't know why we're not
getting 400 cuz our G FL are not it's
not a lot of g-
flops that's minimal G
flops ah so I think this has to do with
sequential versus nonsequential
[Music]
I was thinking of Serena Carpenter a
nonsense Christmas you
know okay well that's fast but also
wrong oh uh yeah because we can't do
[Music]
that wa what oh
huh that's right but slower okay
whatever we don't want to do that um
let's also make another change here
these shifts are kind of
stupid uh was the old
one just do this and then do something
like plus
16 get rid of these shifts I'm sure lvm
is optimizing this out
anyway but yeah that should be correct
[Music]
if I get my count of stupid parentheses
right those are just nonsense
parenthesis just like a nonsense
Christmas by Sabrina
Carpenter
[Music]
um think I B it got me feeling
Christmas they're pling with the coffee
shop this morning
okay good that's a good amount of
nonsense all right 71 gigabytes per
second that's a lot of that's a lot of
gigabytes that's even more gigabytes
than
before well that's only 66 gigabytes
okay that's not too many gigabytes 69 72
71 don't tell me the same Ram crap as
yesterday okay let's try something else
what if I create two
accumulators and do something like like
this this doesn't really matter where
these things get added
right this stuff at the end is all like
just
irrelevant because it's outside the Lo
74 okay we we match torch yet oh we're
beating torch
yeah sometimes
we want to avoid
uh Lane conflict but how's
this I see yeah there's like a
dependency chain here which we don't
want actually never want that so you
know what we can even go crazier with
this
we're doing now we're doing
reduction 74 that's pretty
good 72
73 okay it's already coalescing those
into one
read like this is effectively the same
thing as one float 16
right hold on let's just try
more you probably want to like use all
the registers you know what I'm
saying I'm not going to start saying
know what I'm saying know what I'm
saying know what I'm saying know what
I'm saying there to many know what I'm
[Music]
saying oh
oh oh be fast be fast be fast
[Music]
75 okay but this still wasn't getting at
like like that code looks very fast to
me now just like look at
this let's ask chat gbt how to make it
faster think about it got me feeling
Christmas how do I make this
faster let's eat this pill
let's put some of these things
in maybe that'll make it faster
I know fast math breaks some
stuff same code oh no that's the same
code because
I disable compiler
cash
[Music]
comma okay well that didn't make
anything any faster so
use Simple Loops that the compiler can
easily
recognize think about it got me feeling
Christmas here simple Loops the compiler
can easily
recognize I'm sure that plus Z is
[Music]
fine oh yeah yeah simple Loops the
compiler can easily recognize my ass why
is this not
fast I put
in for fast math and fun roll loops
I'm not stupid chat
GPT GPT
sucks I thought you were going to be the
top competitive programmer in the
world why does this thing not optimize
my reduced
good no it's
arm oh maybe it doesn't know that it's
arm a
common optimization is to maintain
multiple accumulators parallel then do a
final horizontal sum but letting the
compiler do it automatically what no I
tried letting the compiler do it
automatically and it got me that dog
shit
time okay we need to go faster
why why can this be
slow I don't understand is it just slow
reading the ram is why I
wish do I have a way to just shove
assembly code in there I do we're gonna
we're going to go to the assembly boys
we're going to the assembly
[Music]
so one of the awesome things about tiny
gr now is that
the code is no
longer the code that's running here is
no longer an it's just
assembly um we have one more pill let's
eat this
pill we finished
pills is Capstone only a disassembler oh
that's chat gbt it's not I
want I'm getting rid of Duck Duck Go
search that's it we're done with Duck
Duck Go
search it's going to duck the go search
for Chrome
settings search
engine
name Google shortcut
google.com add Google to
chromium think about it got me feeling
Christmas there we
go what no how come I can't edit that
why can't I edit that
why can't I change this
change those things but I can't change
that okay let's use
Bing anyone in chat know why I can't
change that
oh should I try 03 you want 03 okay fine
we'll try 03 it did say
03 doubt it's going to help but we can
always give it a try okay this is a
simple Loop the compiler can
recognize same garbage 03 did nothing
[Music]
I actually remember 03 being worse on
some of the things I tested we're going
to the assembly boys it's the only place
to go let's use Bing I hear it's a good
search
engine Capstone assembler python I think
it can assemble as
well I
just I just my my my my eyes
hurt my my eyes
hurt am I the only one who feels this
way Explore More 60 inspiring Capstone
project ideas how many Capstone project
examples are there below there are
150 like it's just retard like the
internet's for retards
okay this is only a
disassembler unicorn arm
code
oh oh Keystone that's the one I'm
thinking of yeah yeah we got that
Keystone yeah y'all got Keystone you
know got some Keystone some Milwaukee's
best some
PBR going to the
assembly think good bad got me feel all
right no I gotta stop I got to
stop oh how do I delete like just
that let's use chat gbt and it's gonna
delete one line delete up to
the col on
each
line George don't you know that you can
just do this them
bullshit all right human versus AI let's
go all right now how many lines did it
accidentally
delete oh by the way yeah I won
below oh where was that it's
here
what
no no
Keystone
oh oh ma what do I brew
install oh open SSL do I have that how
do I not have open
SSL I already have open
SSL
no dependency should be illegal
like I would use inline ass may I should
just use inline
assembly just YOLO that come on Chad gbt
don't let me down
think got feeling
Christmas just like don't say it don't
say it but I'm thinking it all right we
built it good that worked thanks chat
gbt I love like I used to waste so much
time on crap like that it's just kind of
fast now which is
nice extra redu speed great cannot
import name KS from Keystone
well why is this a liar
oh Keystone engine I didn't even get the
right
Keystone pip three uninstall Keystone
and now my shit's probably poisoned what
is
Keystone
oh I weren't even trying to this not
even the right Lundberg
oh it's an open stack
identity oh
great we had that on my computer for a
little
bit now we have
keone poter must have
explicit what
huh CU I imported
Keystone
[Music]
oh
clang clang you gotta use clang
um are we assembling this let's assemble
something where did that example
go create the
assembler now we assemble into Capital
arm by
code programming
invalid
memonic okay
[Music]
R well if red doesn't work then oh maybe
because this is included
here I don't how python works with that
so what what you don't like
R it's because there's too many
enters
R
uh come on rat is a real arm thing
right I move R11 does that work
[Music]
okay well you can move R11 but you can't
R doesn't makes
sense can I move R11
here
that yeah I can how about can I move
to when I do of course that doesn't
work oh cuz it's arm 64
wait rat's not a thing in
arm invalid mode
e is there a mode for arm 64
mode 64 Maybe
okay invalid
mode let's read the Keystone
code oh
God
okay oh use Kos mode little Indian for
r64 thanks chat
GPT great let's see if I can compile
with all the crap
now great thanks chat gbt I love chat
gbt chat gbt is my new best
friend all right we got a lot of arm
bite code
um so now when we look inside the EI
object we'll find a well a compiled
Runner sure
but we want to dive into that compiled
Runner
and change the
live why is that that
color I don't like
that I don't trust it
change the source
code change the
assembly right so pr. live equals it's
pronounced lib why do you keep saying
live it's going to be a
we should just be able to shove the arm
bite code in there let's see if it
works compiled
Runner object has no attribute name oh
this part's
back I really don't know why it's that
color I set frog somewhere
else
no uh bytes like object is required not
list okay well I don't know why that's a
list I guess I didn't check it
no bites on bite
code it's btes it's not a
list okay great uh let's see if it's
working by messing with one of the
numbers and seeing if it breaks I don't
know let's put like a one
here
yeah
brand oh who can write assembly codee
nobody 30 that's got to break some stuff
didn't break
anything I'm
skeptical I'm very skeptical
[Music]
[Music]
I don't
know all right let's see what's going on
here should work
in case it's getting
freed I don't
understand
um compile Runner definitely calls a lip
right oh no it calls dot trog it doesn't
call the lib what am I doing
[Music]
all right now let's try to change that
to 30 and see if it
breaks definitely calls the Prague
[Music]
zero in object is not callable
[Music]
okay is that actually
fine there okay great seems to be
working now I'm not exactly sure why
loading from 30 oh I know why it works
we load from 20 it won't
work take it back works works pretty
much regardless of what I
change
what I don't understand
this I don't
Loop okay then it's broken but how come
I can change these and it's
fine that doesn't make any sense
[Music]
uh that's very concerning okay let's
change this to Rand n and hope it's
centered
around
uh or what can I
do random is between zero and one so if
I just
subtract it's going to be even slower is
slow but
whatever okay uh fine wow these things
are really sensitive
actually okay cool seems like it does
something I'm getting rid of that change
to OBS Clan it did nothing
[Music]
so on GitHub on the reduced speed Branch
if anyone wants to play with
it okay so what if I like read from like
80 all right these things will do break
things
eventually like that one's broken
too um maybe I'll can do like like aals
one seem
reliable floating Point Edition is
terrible uh floating Point Edition is
not uh commutative it's not associative
I'm sure it's not transitive it's none
of those things I'm not sure normal I
don't know my point is it sucks like B
plus a doesn't equal a plus b uh a plus
b parentheses plus c not equal to a plus
parentheses B plus C associative
commutative I forget what transitive
means but I'm sure it's not that either
floating Point math is
terrible
okay
wait I don't know why we only got
whatever we're getting we're getting
numbers in like the 60s and 70s we're
getting numbers that are similar to
torch's
numbers uh torch also might be
allocating on a
boundary oh this might just have to do
with tlb Misses that thing yesterday
might have to do with
tlb guys know what tlb
is so
let's go simple with this going to make
stuff that doesn't
work but should basically do do the same
stuff you know what ABI
is a pi and
a only the memory access
let's get rid of all of the stuff that's
not the
memory prob you quicker if I copy and
paste the whole thing and then so is
this ADR actually
needed I don't think it's actually part
of it Del
that we should be stripping
that should be we should be stripping
that um uvn if you want to if you know
how to fix
that I want minimal Shell Code like I
love the tiny gr it's just Shell
Code all
right
uh what is this needed for why is this
code
here oh that's the compare for the loop
why can't it use this one oh I guess it
kind Mak sense
[Music]
whatever okay we're only getting 72
gabyt per
second uh
read like we're not limited at all I
took the math out and that's just
entirely the read
speed
um just for fun let's see if this
becomes reliable if I align it to a page
boundary
[Music]
it's a lot more
[Music]
reliable all right so I want to fix the
Malik allocator to align to page
boundaries whenever things are big
uh actually it's a one
minor
um but no like this isn't the right
fix whatever
okay well that makes things faster at
least more
[Music]
consistent um we're in we're in 1
millisecond timing range so like the CPU
should have no problem reliably timing
that uh I don't know what it's doing now
but why was that one like why was that
something uh I don't know
whatever okay so just doing the memory
accesses alone I'm only getting
76 uh this is
only
accessing memory at 76 kabes per second
which I'll not is also torches speed the
reason our speed doesn't match torch and
this is very fixable now uh I'll throw
I'll throw a $300 bounty on it if
someone wants to actually do it um find
out how to modify the opt Ops in order
to do that correct Swizzle so we know
how to get the same speed as torch I
still don't understand why torch is that
slow and I think we're going to spend
the rest of the stream doing this but
I'll put a I really want to
get like I can do it and implement it
with a lot of these bounties I'm capable
of doing the bounty but my goal is not
to do the Bounty my goal as a manager of
the project is to enable others and
bring people in so that they can do the
Bounty uh so yeah like me me actually
doing it misses the point there's no way
for me to if tiny grad's going to
succeed as a project there's no way for
me to code the whole thing uh just it's
it's it's too much work and there's too
many of these things to do uh we have a
pretty great team so far uh so we're
we're we're five people uh and these
people have done a ton of stuff
independently you can you can look and
uh you know see see who they are what
they've done on the GitHub uh and it's
amazing and this is how you you scale a
project like this uh so finding people
like this is is super important people
who can independently look at this stuff
and contribute value so I'm trying to
make bounties that are accessible so
I'll throw a $300 Bounty uh on on that
actually I'll do this right now
let me write out the
whole
line we had some bounties for this stuff
way back in the day and they worked
pretty well
[Music]
green or yellow on Mac
okay so here see stream for how to do it
so the problem is
the you need to like Swizzle and add
them at the end I think that's just an
opop this is probably a TW line change
might even be a oneline change that'll
get you those
$300 how do I access memory faster
multiple threads unroll your
Loop okay ooh
prefetch oh that's getting
fancy I should have 400 GB per second of
band
with how to faster
this is Apple M3 how to
faster prefetch interesting all right uh
let's try that stuff can go
there see if that changes
anything no same uh and let's unroll the
loop
that didn't work uh change that one
too
79 it's the same that didn't make it
faster print the address of the buffer
uh how do I get a pointer to that how do
I get the address C types to address of
[Music]
no I don't want multiple threads
let's try one of
those get rid of the thing which didn't
help doesn't
help Okay um
I mean maybe it just doesn't go
[Music]
faster it's pretty much the same speed
as torch
how is this one faster
though that's somehow
faster how's it doing that
okay so here's an idea right like right
now this is doing this all
sequentially I might be able to what if
I do like four
different what if I launch what if I
kick off like four different groups you
know what I'm saying you know what I'm
saying so let's instead of incrementing
this 32 let's increment that 16 let's
divide that by
two uh and then let's add that to those
things
[Music]
a lot
slower
huh
why
wait no wait 83 oh no that's faster oh
sick
great um all right let's just make
something called Data one
high and say data one plus
[Music]
that oh yeah now we're
talking yeah we in the 80s now
still right right I yeah obviously it's
working okay why does it sometime get me
in the 80s and sometime only get me in
the uh the 40s but okay okay that's good
progress uh I don't know let's try four
of
these get a swimming pool liquor you Di
try reordering them too
well now we might run into register
pressure issues
too
actually if we do this
and then we just need to figure out why
tiny gr doesn't have these tricks in the
search
proper four okay let's go
[Music]
[Music]
all right I still don't see anything
faster than
85 well it's only going to give me that
[Music]
then let's look at the assembly for this
let's put this in the assembler
it's just
annoying there's like a way to do this
in Vim that's
fast uh
remove up
to on each line
glad you reasoned for a couple seconds
about it before doing it there was a
meme on Twitter about using uh llms as
data parsers and like you actually
totally shouldn't do this because at
some point these things just start to
subtly get things
wrong like what you really want this
thing to do is generate a program that
does this show the user the program and
then runs the program because a short
program is designed to be right whereas
a lot of these things we'll get there
we'll get there um that's like where
these things are going to go Okay cool
so it works in assembly let's get rid of
all of the uh
fads
wait no this can't work in assembly
what what
how does it even
compile how does that work you can't
just you can't just just do
that okay I'm not gonna ask too many
questions I'm just gonna fix
it oh I gu I mean I guess it's fine I
guess it just numbers them correctly
that's fine I see how that works never
mind
all right so it's getting
86 let's delete the
fads whoa it's doing a ton of that okay
that's kind of fine I
guess
whoa okay so without fads we can hit
100 sometimes if we get
lucky we'll get to the sometimes problem
later
okay 82 uh then what might make this
faster is having more
registers more of these
guys anytime you can make things like
independent of each
other it's generally
faster 100
eight
yo yo we'll even torture the dust Boys
who leing torch in the
dust
[Music]
cool yeah that's sick that's as fast as
it was without the
uh yeah I don't know I don't know it's
going to be hard to
beat
[Music]
um yeah think it's pretty good
stream
108 it's about 100
[Music]
fast like a
NASCAR all
right now my tiny gra generate that
code I'll do it next stream if Nobody
Does
it if Nobody Does it I'll do it next
stream but I want somebody to take time
and look at this and figure out how to
oh cool so what the optimizations that
he was doing by hand in the sea in tiny
grad actually corresponds to this other
thing and we just need to basically add
the other thing to the the the search
space right it corresponds to these op
doops uh so op Toops are
interal by choosing the right set of
opop so the the next steps here are to
go
and take op
Toops find a set of opop that has the
code autogen generate this
first you want to do that
manually then you want
to go in and modify the search to have
the search find it for you I believe in
one of you to be able to do
[Music]
that seven minutes with chat and then I
got things to do today
going to say if you static or register
the C variables they already are
registers I'm looking at the assembly so
I don't think that's going to help too
much
non Subs if you want to talk now's your
moment I'm glad you guys like Amanda
she's very nice
last
weekend I know what we're going to
do the question of when true true
artificial general intelligence might
arrive has been circulating in AI
circles for decades and it's never been
more relevant than it is
today uh so Tandy boy you should uh read
this there's no consensus but there's
healthy skepticism and open
inquiry I read a thing about how chat
GPT makes people less politically
polarized and I largely
agree uh do you like deep seek let's say
I am dishing out $200 a month just so I
can just get unlimited a one uh he's not
familiar with deeps unfortunately you're
gonna DJ cows you're going to have to
clarify um is AMD GNA sue you for
licensing issues let's
say I'm not aware of any reason that AMD
would sue
me is 03 available
yeah where to start if you want to help
with tiny
grat uh no actually I there's no O3 yet
I have O3 mini and O3 high but I don't
have
a where to start if you want to help
with tiny
gr why don't you explore the Repository
set up your
environment familiarize yourself with
the
code run the tests and examples I'm
actually not sure if that works you
might have to do p test test uh the
example is actually beautiful I'm
Miss uh pick an issue or feature to work
on yes that's great and then contribute
your changes and then you can engage
with the community
wow um would you rather 801 or deep seek
in a humanoid robot
body uh I mean neither of them can
control the body you know they're all
kind of
like Stephen
Hawking any quick advice to a CS
Dropout I hope this isn't like polluting
my chat
GPT start building right away you'll
learn a lot faster by actually making
things wow that's that's that's really
true real user feedback will show you
what's valuable focus on solving a
problem master the basics of business
and marketing good points learn
continuously iterate rapidly and ship
often Network and find support I mean
unfortunately chat GPT does have this
like like uh PMC way of
talking I would never say something lame
like that but you should definitely
understand the these ideas if you don't
understand how to get people to use your
shit whether your shit's useful whether
your shit costs a good amount and
whether people are excited about your
shit like yeah okay that's important but
that's how I would say
it all
right Sam Alman says Chad gbt will be
smarter than him more hype man nonsense
let's see
what does smarter really
mean pseudo code do you mean
python I love this I love this I love
copying and pasting your chats into chat
GPT then just reading what Chachi BT
says because Chachi BT is far more
patient with you than I would ever
be I'm sorry yes to to answer your
question if AGI is already here
well can you multiply a matrix let's see
here we
go and now it becomes so
clear which of these questions
are uh trolls uh thoughts on AI
integration your editor
uh yeah I tried cursor and stuff I don't
think it's that useful if you see how
I've used AI so far on this stream I
find it very bad at just I you see I've
copy and pasted almost nothing except
for the time that I was using it because
I don't know Vim syntax I should just
asked it to write Vim I should have just
asked it to write Vim syntax to do that
for me and then copy and pasted the Vim
syntax instead of that one example I
almost never use it to write code and
then copy and paste the code into the
thing so that's what a lot of these
editor Integrations seem to be I tried
cursor I think it's very
overhyped I think that a lot of these
editor people don't really have a moe
they're all working on another more
generic way to say that is prompt
engineering doesn't have OTE prompt
engineering falls to the next generation
of smarter llms
I think eventually it would be great if
somehow the llm could have the entire
repo in
context and then make specific edits to
it I haven't seen that's what these
things
do is George Hots a fraud let's find out
doesn't look like I'm a fraud thanks
Chad
jbt is sp SPF a
fraud let's see let's find out maybe it
calls nobody a fraud we need calibration
it's pending a court
decision there is substantial evidence
but it's still a legal question until
the courts issue a verdict it remains an
allegation albe it one backed by
multiple
indictments Insider guilty
please write a blog post in the style of
geohot let's get another bar post
uh Metal's a lot faster than L of but
remember Metal's using the
GPU
ah no I hate this shit it it it writes
like I've been thinking about break it
to make it a lot lately this is the most
awful response I've seen I would never
write something like this although it
does say that I say you
know
I yeah
yeah I would never write something as
cringe as this no it's cringe as shit no
it's too
cringe it's too
cringe thoughts on tool using llm
agents well look at how it's like
generating that's interesting how that
shows up
now I really can't chat is really bad at
that anytime you tell it to write in a
style everything is the style of cringe
chat
GPT okay uh to these people who year of
AI like stop reading the news the thing
is what it does there's nothing there's
no better experience than what I'm
showing you right here
uh everybody who thinks they have a
better experience it's marginally better
at
best thank you for watching the stream I
hope
that I can Inspire some people to come
work on Tidy
crad and I hope that I could Inspire
some people to stop asking questions to
people and instead asking them to chat
GPT because chat GPT will give you a far
more balanced reasoned and thought out
answer than a person ever would because
a person gets frustrated the machine you
can keep asking at the same dumbass
trolly question over and over again and
the machine will not be trolled you will
you will always be trolled because the
machine never gets bored never gets
tired never gets drunk it is our future
and we pray to the great machine God
happy Sunday
everyone bye
hello hello welcome
everybody right we have a good quality
microphone unfortunately the only camera
we have is the camera on the
laptop uh so you know that's what we got
uh I'll buy a webcam at some
point I should totally buy a
webcam because we're not
poor and
uh it's been a while
uh welcome back to beautiful Hong Kong
uh I feel like this room doesn't Express
the beauty of this place uh it's kind of
a small room and I don't have anything
up on this board it's a little cluttered
you know it's see these thumb packs are
a little cluttering uh but it's really a
beautiful place guys
uh wait
huh I don't even
understand no that can't be
what is it frozen
somehow
what I don't understand how that's not
what's on the
screen this not what's on the screen
right like look at the screen and then
look at
that all I don't know I'll try removing
it and adding it back
this seems
better to move it in front of the video
capture it's a large screen so we're
going to have to shrink it a little I
don't know what happen like froze it's
mad that I didn't update obs okay snap
that there drag that there make me a
little
smaller I pick up a few
90s uh yeah I got some on the
way um I do got some 509s on the way
we're working on the Tiny Box two uh the
Tiny Box green two there's not going to
be a tiny box red two uh the Tiny Box
screen 2 is only going to have four 90s
because 90s are so big
um fuzzing what are we fuzzing you see
fuzzing over here yeah we're fuzzing
fuzzing uh really cool to help Prime I
watch this stream I see why you guys
like him uh you know he's very he's very
interactive in a way that I'm not uh you
know and it helps that he's like I don't
know I don't know how much Linux he
actually knows versus how much he just
lets chat help him out his chat's very
engaged with what he's doing so uh yeah
you know cool
um LGE it's
not uh yeah so since I'm not logged into
GitHub I can't expand these things but
uh I've been playing slay the Spire has
been my my new game um and you know it's
slay the Spire has really like gotten me
to think in terms of like okay we got to
like deploy the resources correctly it's
a good way to think about like the micro
kernel optimizations right factorio is
good about thinking about you know
things that span long time Horizons and
and slay the is good at like uh you know
micro like oh okay well if I cast these
first I'll cast the draw cards to make
sure I have draw Power give me
optionality even if I have to spend some
energy I got to figure out what the
gambles are right like it's good uh so
one of the things that I I got out of
slay fire was like why am I just not
using moir CI uh so this morning I
merged something that uh massively
expanded uh just the number of Runners
just increased CI speed with more
runners
um yeah so now we're doing 33 checks uh
if you're logged into GitHub you'll be
able to expand these things and maybe
the most important of all of them is lvm
speed uh it's cool so it Compares it to
torch I'll run it locally for you guys
here okay we don't even get that out of
the
way uh this one great um
so you see what this is
doing we should switch to master
here uh yeah so this is running all of
these different tests so we're going to
do a little bit of a lesson we'll wait
for a few people to get in here and I'll
actually try to teach you guys
something um we'll we we'll try my best
to do it still in Hong Kong yeah I'm
thinking about applying for residency
here uh I really like it
you know you don't want to uh you don't
really want to be in a country when a
revolution's
happening uh are using llms I'm using
llms a lot more now uh you know I said
on Twitter that oh one is the first llm
that I thought that could code at all I
really didn't think the other ones could
code like I never thought like gbt 4
could code um it's like kind of useful
as a search engine but these new these
reasoning ones are the first ones that
are actually capable of like doing what
I would call programming uh did I try
deep seek yes I tried deep seek um again
very cool that it's open source I love
grpo uh it's just a great way to think
about reinforcement learning we're going
to try it out a
comma
um you know I I I can't believe the
stupidity of the discourse on every side
around deep seek it's not as good as the
open AI models uh it's not as good as A1
um it's not as good as A1 but it is
better than Claude that's where I would
put
it uh 03 doesn't really seem to be
better than 01 either we haven't gotten
the full3
yet
um Claude will respond
uh uh it's way cheaper than1 sure yeah I
don't know I pay that i' pay opening I
$200 um I use it all the time now uh
yeah I use LMS a lot more now uh not
really to code but just for any kind of
like probably like 2/3 of what I used to
go to Google with I now go to an
llm uh I used deep research once to look
into all the different Shader compilers
for gpus and it it's pretty
good uh I've never tried Gemini I don't
know it's like after I read about like
Google's like wokeness detection
architecture I'm just
like like they had a whole model to
inject wokeness into your prompt I'm
like okay never mind these people aren't
serious uh we'll find some people who
are serious but Claude with the eight
levels of safety like they're not
serious guys you know oh well we're
going to release it but it'd be too much
acceleration okay okay lose lose the
market right um yeah know I think I
think deep seek is serious and I think
opening eye is serious I think
uh no the quality of the code's not
anywhere near good enough
yet um um yeah yeah okay
uh how it was made cheaper on less
sophisticated gpus I mean they they did
they were like 5x more Capital efficient
than the Silicon Valley
players uh you can argue about the value
of capital
efficiency again like it's it's
not um if you're a company like open AI
it's probably not all that
important uh I don't know again I think
it's it's it's really cool to see China
have a serious competitor uh with open
AI I think that it mirrors a lot of the
modern geopolitical situation I think
that it is great to have a competitor to
the American
Empire uh you know it's just it's it's
just great for you it is great for you
as as a as a person alive in the year of
the garden snake
um so uh yeah okay cool let's uh let's
turn off uh let's turn off PTX is okay
uh let's go to subscriber only mode and
let's actually get to some work here
okay so this is I'm GNA teach you guys
something I'm going to do some kind of
uh let's write uh maybe we will right a
dock in the in tiny
gr uh the theme of the year is
speed so these are the tiny gr docks if
you haven't seen
them okay
[Music]
go to
index and we also have uh probably the
developer
docks yeah okay let's go to developer
here let's make one called speed.
MD what's in here about the gam driver
this could use a lot more
dos um you know we have a full AMD
driver now uh demo that for you
guys we have a lot more tiny boxes too
I'm sshing into Tiny Box 32 right
now
[Music]
um so we don't you see that we don't
have the
uh I can't stand not having my t-o
config
so I think we have a tool
ammi I need to
call mcore
ASI uh okay so nothing's oh there we
are laggy ass
shit if I route my traffic to Japan it's
actually faster but I don't know how
that works with
uh with
twitch I am I subscribing am I streaming
to you okay I'm actually on 5G here a
lot of people don't have hard fiber in
Hong Kong uh why is my memory so hot why
are these things drawing so much
power why why are they
drawing anen why are they drawing so
much
power ah all right let's just
do see if it's G to use less
power what am I
doing I'm back this is my first time
backing this setup too I lost my wrist
rest my wrist rest isn't work um
uh any shot AMD will figure out how to
actually make good drivers themselves I
don't think so uh I think they they have
like I mean like you saw the
uh it's already in
use oh is someone using it oh that might
that usage might be real someone
actually just might be using this
[Music]
computer oh someone's actually using it
okay never mind I take back all the
things I said nen I take back what I
said uh it's fine let's see if anyone's
using this
one like the problem with ammi is like I
don't know how to trust it
yet I probably can't show memory either
let me just put my t-x config here t-x
config going add it to our infras
script sorry if you don't like using
back tick and you want to use control B
well stay off my
infro um you know yeah one of the things
that I'm really working on is figuring
out just how to use more computers I
have an idea one of the things that's
going to really matter in the future is
like how many computers you know how to
use how much leverage you can get like
using lots of
computers uh
so let's
[Music]
see will there be a tiny box for 59s
yeah uh so we're g to make a I think
there's going to be no more Tiny Box
greens I think that they're out of stock
and gonna stay out of stock unless we
come upon a stash of good priced 490s
they're not it's not a like the price is
the box is going to cost the same
$25,000 and it's only going to have four
gpus instead of six uh these things are
astronomically priced like my bulk order
for them it's looking like it's going to
be 2600 a
GPU uh so
like you're not getting more like
unfortunately because AMD dropped the so
fucking hard um you know Nvidia launched
a new generation and like it is better
but again why would they charge less
money right they they've just built the
best thing there's no there's no point
in pricing the 5090 like the
490 uh okay let's see what we got here
okay good good this one's drawing less
power great um I still don't know why it
says gfx activity 100 it shouldn't let's
first check to see if there's actually
anything Running Oh someone is using
this computer too Nimble J's using this
computer
okay yeah these are all being
used uh and I know someone's on Tiny 30
so wow okay good people are using all
the
compu uh that's
awesome let's see what else we can try
11 is anyone on
11 11 like doesn't
work roami no AMD gpus specified
[Music]
uh
interesting see if anyone's on this
computer okay finally a computer that
nobody's
on
uh so somehow the module was inserted
but it didn't
work do this one have my t-mo config
please have my TM
config it does
okay did someone plus X that
sweet where have like a small one of
these that doesn't print so much but
yeah so you can see everything on the uh
on the gpus there which is pretty cool
now I should be able to sayug to test
tiny
um why did that import
llvm that I don't really
know oh don't tell me Metal's trying to
import that
Yu uvn if you're watching this your
metal import is actually making that
llvm thing trigger on everything not
just uh things which have uh
metal um I saw them moded 490s with 48
gigs yeah you could do that the problem
is like they're expensive uh at that
point you might almost just want to buy
I think that my hypothesis is that like
Ram is going to be uh kind of like it
depends what you need it for I don't
know no actually I'm not even sure Ram's
going to be less important mixture of
experts seems to be pushing towards
these like large Ram low Ram bandwidth
things so like your degree of mixture of
experts um that's one of the coolest
things about the deeps models like I
don't know why llama didn't do it right
like llama accesses every weight every
time and I think the reason for this is
if you're Facebook and you're in the
data center in the in the data center
where you're running like batch size 100
I don't know what batch size people are
running maybe 16 or 32 it's not like
mixture of experts really helps you
because you're going to have to access
all the experts for all the queries
anyway but for batch size one mixture of
experts is awesome uh and I think the
brain is very heavily mixture of
experts okay cool um let's throw a
real workload on here someone's got to
make this better oh there's so much to
do there's so much to
do but you know we're making great
progress I remember last year we were
struggling with correctness this year
there's almost no more correctness bugs
in tiny grad like someone will still
stumble on one
occasionally um but like last year there
was a whole list of
known correctness
bugs there was also a lot of code that
was just kind of
junk um yeah brain is yeah well obvious
like that's the old thing you know
people say like you use 10% of your
brain or 20% of your brain brain uh
that's like at a time and that's
basically just the brain doing their
mixture of
experts um yeah so we should be able to
see a GPU get used oh here it is so this
GPU is being used can we look into
why I'm G to complain on Discord about
why why is
gfx activity
always 100 100% in
ammi see how these are 100% they
shouldn't be uh but yeah okay
cool great nice to see this
uh dis pegging the power
awesome a little bit of fan there that's
all controlled by the internal
controller uh we can check our voltages
here so interesting this is the core
voltage here um and you can see the core
voltage for this guy is higher than the
core voltage for this guy oh we also
have a special Tiny Box we have a
rainbow Tiny
Box over
41 uh whoa one
wat yeah we got to figure out we got to
figure out how to get our temperatures
to look like that
[Music]
yeah so I want to I want to lower our
idle power
consumption uh if you guys seen I've
posted a bit on the tiny Corp
Twitter we are building a cloud uh of
these of uh 9600 7900 XTS uh 7900 XT
X's
um yeah unfortunately this can't show
RAM
usage and like that makes sense why
there's nothing actually in the GPU that
knows if a piece of RAM is used or
not
uh yeah cool so that's finished you
could see that this train to C4
model um I beam it for me maximum
speed I wish there was a way to just say
debug beam U uvn all right I'm
complaining about that too if you guys
are on the tiny gr Discord you could
just like watch me doing this stuff this
is just kind of like my
work
um
uvn uh the
lvm import is
happening on
Linux can you make it only happen if
there is
metal cool so this is like searching for
faster
kernels see it's pretty fast and doing
it I can't cck it's
only uh yeah but it's still not like
it's not pegging these gpus is pcking my
course oh there's a nicer one than hot
use btop do I have btop oh btop look at
btop what's here is there something
there oh there yes you can see my my CPU
usage here uh my multiprocessing python
okay okay that's kind of that's kind of
peg in some of those
sces
uh yeah I mean we'll get to a point
where like all these things are being
scheduled so there's no reason these
beam searches should be happening uh
like sequentially I think with like a
bit more refactors to Tiny grad will be
able to just say like these beam
searches will effectively oo o that's
really
interesting oh do the beam search in a
rewrite rule oh that's fire yeah we're
moving like everything to rewrite rules
okay so where were we we're going to
write up some stuff about speed and
we're going to teach some people some
stuff um how many doing on viewers I
don't get the same viewers I used though
maybe it's because it's a weird time
[Music]
it's a little late I guess Friday
night
uh yeah time helps
um yeah now we got to get the uh we got
to get the idle power of these things
down
so redrawing that every time I want to
use react for
try uh okay
that I it's like
like this here we
go oh the talk about about
speed speed in tiny grat
speed and Tiny G okay
cool
overview speed
refers
to
[Music]
many uh different
things
there's make like a list compile
speed um
execution
[Music]
speed is this so
slow make like a list and mark down how
I do
that
stars uh this is like a way to like what
is it control shift k or
something I like show the mark
down control
K followed by v
no command K followed by V yeah there we
go okay how come that showing up like
this
but then in here it's showing up like
this do I make a dock anywhere else
uh make a list anywhere
else some complex looking
shit all right we'll get to this later
um there's compile speed okay uh compile
speed execution
[Music]
speed to
three this compile speed execution
speed um this
is how
long the first
run of your model
takes
just like log in for deep
seek normally I just use Chad gbt but I
have to log in for that actually maybe I
don't oh no but I can't because I'm in
Hong Kong deep seeks website looks like
it's down
okay this is this is my favorite one
that I just know just like
works but I think they have like a
crappy model maybe they're using fine
turns let's just try
that uh write this doc
okay are these docks just better than
mine it's like kind of good but not as
good I think I can write better stuff
okay this is how long the first run of
your model
takes
um it's limited
[Music]
largely by
the runtime of the
Python doing UOP
rewrites
it's it's slow
but on par with torch
compile gets even
slower you are
using
beam since that's
compiling uh many variants
of each
kernel uh this will be
improved by
write writing faster graph
rewrite uh doing less graph
rewrite and better
parallelization okay
um execution
speed uh and after your model is
compiled you are often
using tiny
jet uh tiny
[Music]
grad
has
best execution speed of any framework
because it
usually bypasses
the uh GPU driver
and
prebuilds the command
ke
um
it's
tons faster than normal Cuda often even
faster than Cuda
graph
uh there is very little
to improve here
[Music]
as this is
almost never the
bottleneck Cel speed
[Music]
this is the most
important of the three
and within it there is many
[Music]
subfields how do I make those on
different lines
something like what's a list and
markdown why ises this not
work
that more of these
how this
work definition LS
you don't know why this isn't
working where the fuck is y thing all
right there we go fine enter there
stupid okay
[Music]
is
[Music]
[Music]
hopefully this is making it more clear
like we have like python driver and code
gen
there be
like this
largely uh determines the speed at which
your model or training job runs
I'm actually going to split this
here um model speed
schuer uh schedule
determines
how operations are
grouped into kernels and
which tensors are
written
to
memory this is currently a big bottle
deck of training
speed decisions are
often
not
obvious for
example when is it worth Rec
Computing uh
and
arithmetic
operation
instead
of
uh
storing and
loading from
memory example
tens are being highlighted
should make sure that example actually
runs I didn't mean to do that
whatever for
[Music]
can't always do
that
can't should A+ B
first
be saved to a sub
buffer or should
uh both the
out one and out2
Kel Rec
comput uh in this case okay so in this
case if you want to do no recompute we
have
all right and if we have no recompute
it's two reads of that two reads of the
intermediate two reads of
[Music]
probably
compute once
once you add movement Ops
and casts this
is even harder to figure out T doesn't
yet have a
systematic way to do it okay does
everyone understand model speed in
theuer uh does everyone understand this
thank you for subscribing did I give
prime a tiny box uh I gave him Cloud
access to both a red and a green he
chose to use the green be interesting to
watch him uh try to use the
red uh
okay so this is the model speed this is
why our Bert time this is the main
reason that our Bert time was bad on the
last ml perf
uh what this is pretty Noob I this is
this is very Noob about how fast neural
networks run all right I'm not doing
anything fancy here like this is this is
this is neural network speed 101 um and
it's the kind of thing you're going to
have to think about regardless of what
framework you're using doesn't matter if
you're using jacks or torch or or
anything else uh you should always be
thinking about like what's being grouped
together um a lot of like you've
probably heard of things like flash
attention right so flash attention is
basically all in this
category um
uh given that you
have
decided how the model Ops will be
grouped and
what will be written to memory
uh kernel speed determines how fast that
uh operation is
done this is what
beam chain
S Beam changes
searches
over uh a set of
identical
kernels which all
perform the
same
operation and finds
the shouldn't say identical
equivalent finds the one which performs
the task the fastest
[Music]
so even if you don't have like this idea
of
kernels you still have an understanding
of like where things are on the memory
hierarchy and that's kind of the
difference between theer and the
Coden uh the main
bottleneck in
most kernels is accessing
memory um
in a
freshman
algorithms
class you'll learn about cash
aware
matrix
multiplication while the same
this
is all forms of
that while the same math is
run the order in which you run it can
have
large impacts on the speed
oh what am I doing
uh look for op
doops colonel. py I like link test
somehow
we set of
opop let's SP that word
right
these uh control
the
parameters
which of the
speed optimizations
applied to the kernel
okay the same math is on the order in
which you run it uh poops will
change this
order uh memory is
often even cash is
often
much
slower than accessing the register file
uh the amount of
times data is used in
math divided
by is called the
arithmetic
int City
for operations
like batch size one gem V
the arithmetic intensity is one but for
gems and comms it can be much higher
uh 490s
have Ram bandwidth and
clearly large impact in the speed
depending on if the
data you are loading
like unroll upcast and
unroll
uh can
increase this but be careful of making
them too
large as if there's too much register
pressure on the GPU
the uh
warp
scheduler
may not be able to fit many
orps
even worse it could be
spilling to local memory
[Music]
that
like to
use
each
loaded
value 100
[Music]
times the
L1 cach
has around 40 T second of
bandwidth so in order to get full
compute utilization you need to use each
value around four times
tensor
course um any
gpus
have by the
way it's documentation do you guys know
why tensor cores exist
I
don't
increase the total flops of the GPU but
they
allow the flops to be
fully
utilized with
less data movement
Google has systolic arrays many gpus
have uh okay actually I should actually
say this accelerators have tensor
cores um Mac
arrays
cic
arrays we often don't increase the total
flaw I shouldn't say that the main value
of the
is that
they
decrease
the
data that they
create and n² ratio
between between the
compute that since
they are 2D they create an N squ ratio
between the
compute and
the uh input
data gpus
use tensor
cores uh
instead of Mac ARR phas to
fit better in the GPU warp
Paradigm this is because the
output of
[Music]
tensor
course
is to that input
while the output of Mac arrays like the
AMX is O N
[Music]
squared uh
we uh simple
framework tiny graad for
adding these
a
blocks
okay a lot of work can
still be done
here um
for
examp we
never copy the
input
for example we never copy the inputs to
local
memory
uh to
SRAM this is
often quite
quite helpful for col
speed also we aren't
doing good job with L2 cach
awareness locals
[Music]
handle one very
well all right we got a stupid
comment and that's why we're going back
to subscriber
only okay um for adding these aoou
blocks and achieving
good performance from
that
okay and we should talk about
[Music]
indexing indexing indexing is
determines
uh the
address of the memory we need to
load uh gpus often
have have
less integer math resources than Flo
Point math so this can
sometimes be the modle
Mac have a
symbolic math engine to
simplify in our
rewrite rules to
simplify uh indexing before
it's
uhel all
right I think this covers a lot of it I
really think a lot of it's just memory
um let's
ask whatever crappy reasoning model
perplexity
has
what's missing here
see what Chris lner has to say oh my God
there is so much
money yeah I mean i' say basically this
exact same thing we're working on like
almost the same
thing can I like run this in Mojo is
Mojo open
source no see it's like not open source
which sketches me out
uh all of his stuff pipes through ml
yeah I mean in a lot of ways uh tiny
grad's very similar to to ml like our
our UOP stuff is just like a more
opinionated
ml
um let's see what this thing says okay
better tiling
strategies it's interesting that they
just like call it tiling strategies I
mean that's the same thing that I'm
talking about when I talk about
memory
[Music]
um newer Nvidia gpus have a
TMA is tensor memory accelerator
right accelerator to assist with fast
indexing however this is not supported
enti
yet all right so we need to hire people
to work on
speed um like if people show me that
they're capable of increasing the speed
of these things uh like so I I put a
whole bunch of bounties
up sorry I mean I know that's not the
best stream content when I'm just uh
reading exactly what I'm
typing
uh if I let nonsubscribers talk you're
going to ask me stupid stuff you're
going to we're going to we're going to
have a real conversation
so I added all these uh all these speed
bounties um I'm very interested to see
uh
people uh starting to do
them and they they all sort
of
like mean uh they they all sort of cover
different
things I think I'm actually going to do
this this one
today think I know how to do that one my
theory is that so we have these things
called locals on gpus so you'll see uh
on a
GPU you see these light blue
Dimensions uh these light blue
dimensions are
locals
and the uh
locals handle the L1 stuff for us but we
don't support locals on uh
LM so you see if I just like do that and
run it with deug equals 2 you see that
there's no light blue uh Dimensions
anywhere I'm really excited about LM oh
I got to plug my laptop
in It's just in general LMS a really
cool piece of software and like
comparing it to
what uh
exists
elsewhere it's used in so many uh Shader
compilers hcom uses it metal uses
it yeah amd's driver is not very stable
um we have all sort there's all sorts of
bugs in it we've written a much simpler
driver uh we're transitioning everything
away from amd's driver I'm not going to
like it just it just crashes every once
in a while right and these things
haven't gotten any better like you can
see tons of complaints on our Discord
where it's like oh I was 3 hours into a
training R and it hung like this is not
we're not holding it
wrong um it's it is absolutely
ridiculous and then you saw how AMD
responded to me I'm like I'm done with
them I'm done with them
they you know look
if middle management at AMD wanted to
work with me and then tiny grad came in
and like you know started to take market
share away from Rock M they'd have a
victory to show to upper management if
tiny grad comes in and mogs rock M and
they treated me the way they did oh shit
you know that's real bad like like not
only were they not a part of the
solution they were a part of the
problem um no it's never going to be
good it's Rockham is never going to be
it it can't
be like there's I don't know I don't
want to go off go off on this it's just
it's just so it's so frustrating um my
last volley with them is just it it you
know the the guy made it very clear that
uh not only does he not value what we're
doing I think he would actually prefer
we didn't do it because in the small per
chance we
succeed
o i just imagine that really just just
just imagine that like you imagine in a
year or two tiny grad really starts to
gain market share away
from the truth is maybe they just don't
care but if you're anywhere in like the
team that's supposed to care about sofor
on AMD and you let that happen I don't
know
um yeah so no I just there's no
fixing uh AMD stuff it's not one bug
it's it's an entire methodology with
which they code uh you can see Dylan
tell wrote up all the same things in his
semi analysis thing it it's like obvious
to people who understand how software is
developed um by the way I'll show you
something cool uh I don't know if you
guys have ever seen hud. py torch. org
but like this is pytorch's uh
C it's it's actually super like
sophisticated and good like look at just
just look at
this um they have all sorts of
benchmarks you can see it with different
uh with different devices right like how
nice of them to do to do rock M ones
let's see if it
works no no probably the driver's
crashing no one wanted to deal with
it uh
yeah
uh yeah very cool
well let's see let's see if we can see
the rock
one like yeah this
is right right right there is is is is
amd's
problem um to be fair it doesn't seem to
work for NPS either
but uh does it work with outer devices I
don't know what that
is but
yeah what does this say
Chinese
shit it's traditional Chinese so I
really can't read it
um does it work with other devices yeah
so it works with just a rdna 3 so it
works with all rdna 3 chips now um this
computer has
a
uh this computer has a 7600 we're going
to use a 7600 we're going to plug a7600
over USB
into comma devices this is how we're
going to get more compute to to comma
devices
um yeah so there's no I mean we just we
just get like random hangs and crashes
in RCI from uh amd's driver there was no
way to move forward without just
creating a new one um which we've
succeeded at like this is all this is
all done you know all this stuff is uh
all this stuff's in the past like all
the My Hope was that AMD would have been
useful and given us documentation on
anything they didn't uh they gave us
less than nothing like if I could if I
could go back in time and just be like
George uh you know honestly if I could
go back I shouldn't go back in time
because we struggled and we made it
through but um you know AMD will will
give you nothing and will waste your
time uh along the
way uh thank you thank
you
um but we have our own driver now it's
all in the past um if there's any bugs
we can fix them the driver is only here
I'll show you guys the driver uh it's
written by niml
genen uh one of the employees of tin
equip I did a lot of the early reverse
engineering stuff but he really picked
up the the effort I think he did a great
job with that um you can read the
driver so we have two so this is the AMD
runtime so this is in in tiny grad
runtime op
AMD U get that like this little
bigger so we have two different ways of
interacting uh with the
device you see we have the uh IO control
back back end and the am Dev back end so
well here it's called PCI interface that
speaks to the GPU directly over
PCI uh I guess we haven't had a stream
to really uh to really talk about this
so yeah AMD device driver list otherwise
we have the kfd interface so the kfd
interface
uses uh the kernel driver that's built
in to amd's GPU uh not built into amd's
GPU it's actually in the Linux kernel um
it's called the AMD GPU driver but you
can just pseudo rmod AMD GPU assuming
you're not using it for graphics our
driver doesn't support
Graphics
um for home setup to run deep seek
R1 the CPUs are interesting and also I
saw people building these like AMD Epic
Systems and only getting like seven
tokens per second you should be able to
get like 30 tokens per second uh if this
is something people are really
interested in it might be something tiny
gr builds like we might build a tiny box
that's CPU only uh to deal with things
where like it comes down to what your
ratio is going to be between your memory
and your memory bandwidth so like I
could build a computer with uh you know
uh a terabyte of memory but it's only
going to have like a terabyte per second
of uh RAM down with so you'll have
memory but you can only run through the
entire memory once per second so if you
were running a a a non mixture of
experts llm on that computer you'd only
get one token per second but if you're
running a mixture of experts one uh and
your mixture of experts ratio is
something like you're only accessing
like 10% of the weights then you're
going to get 10 tokens per second um and
you can also quanti to to make it
smaller I think I could build like a 768
gig dual epic system and uh and do
pretty well I think about clip networks
what I mean like like clip like what's
used in like stable diffusion and every
like sh model
so what's really cool about riding our
own GPU
driver is eventually we could move to
uh you can't put the active weights in
the GPU that that's way too slow right
so even if your GPU has pci5 you're only
going to load that at 64 GB byes per
second and any CPU has enough flops to
make that load completely
mood um so there's no there's no point
loading it into a GPU because your your
pipe is not is not wide enough right
like you're still going through the CPU
when you do that if it's in CPU Ram
you're going from CPU Ram out the CPU to
the GPU why not just stay in the
CPU um so yeah also like a lot's still
going to change
here
um what's stopping GPU providers from
providing more vram options well so here
we can we can work it out like let's
look at let's look at something like the
uh
Intel oh those are
cheap I bought one these I actually have
it in this
computer I haven't used it yet but it's
in
there yeah so what stops uh AMD from
just
making like a like a fat one of these
with lots of ram I mean ram isn't that
[Music]
cheap there's a there's a website that
uh
8 gigs of memory now costs
$27 yeah it's like kind of H that's kind
of lower than I usually see it for I
think that's just like lock usually like
GPU Ram is about $6 a gab so if you want
to build like something with uh 24 gigs
of RAM you're spending $144 just on RAM
I think that there's like not enough of
a market really for
that
uh
yeah so I really want to see people
start solving these speed
bounties let me push that
docks you wish more people were into
running local
llms
yeah I mean it's not that like useful
yet right you could run R1 you're not
going to get a ton of tokens per second
uh even if well here we can work it out
so what do it got let's figure out what
the here so activated parameters are 37
billion so let's say let's say you're
doing 37 gabes let's say you're
quantizing to something like six with a
little bit more or like eight or
something um and then if I have epic CPU
Ram
bandwidth see what it says here this a
theoretical Ram bandwidth from two
CPUs from a fourth gen so you're going
to get that
theoretically so your theoretical tokens
per second is like
25 uh how happy would you be with 25
tokens per
second like especially with these
reasoning models that's just kind of
slow you'd be very happy okay what would
you pay for that
machine what would you pay let's say 20
again you're not going to get 25 what
would you pay for a deep seek machine
that could get you 20 tokens per
second yeah you pay 2K 4K yeah get out
of here you can't even like you can't
even afford the ram that fits that right
so you got to buy ddr5 Ram let's go
figure out what the cost of ddr5 RAM
is um and like don't fall for this uh
say like memor server memory.net
this is the problem you guys are
cheap
H
yeah I mean it's just it's just not
cheap right you're going to want fast
Ram that's what the fastest Ram you
could
buy
um is that one particularly a
ripoff yeah kind of Okay so
gigs that's probably the best
deal we're going to want 768 / 64 so we
get 12 of
these okay so just the ram alone to load
the model is four grand okay never mind
a
motherboard uh never mind CPUs
10 to
15K
um you might be able to build it your
self for 10K I wouldn't be able to sell
it for 10K I could sell it probably for
uh cost 2K to run it at 3.5 tokens per
second that's probably
right if if you're willing to use now if
you're willing to use cheap memory if
you're willing to use the cheap thing to
probably get if you really just want to
be
cheap uh is you could get
these let me think I have eight slots
for
it so I could get six of these it's not
that much
cheaper oh oh is that the guy so okay in
theory you could also use MVM
drives um yeah yeah you can get lots of
old ddr4 you probably find it cheaper on
eBay let's take a
look the problem is you like kind of
need it with capacity so let me think of
the the the Tiny Box has 16 slots so if
we want 768 gigs of RAM and 16 slots
we're going to need 64
gig uh don't give me this in Hong Kong
dollars okay so it is like a dollar a
gigabyte fine fine I can get I can get
cheap pre-owned server Ram if that's
what you want for like a dollar a
gigabyte uh whereas the ddr5 memory is
costing more like $5 a
gigaby that's actually pretty cool
that's actually super cheap
you don't like the
crappiest the crappiest
DDR uh four memory do you want do you
want
ddr4 I mean okay if you want just like a
really cheap machine that'll run it at
some crappy tokens per second but like
what are you doing with that so okay if
if you if you want something that'll run
it at like five tokens per second I
could build that machine for cheap I
could build you a five token per second
machine for something
like three grand four
grand no but you can't squeeze no no no
no no no you can't get it better than
that right like you're fundamentally
accessing that memory it's not like oh
bro just compile it with this flag
download more ram.com curl
bash
uh no see you don't want that like
nobody's going to use it what about this
what is this doing
uh is this what you guys want is this
what you guys want to talk about is this
is this what you guys are excited
about um you can also you can like kind
of get this if you're okay with really
crappy tokens per second you could do
mvme drives but I guess that ddr4 is
cheap enough what's this guy use yeah
okay yeah so this guy's using like
minimum
cost yeah this guy's using the cheapest
ddr4 Ram you can buy this is this is
this is the cheap
shit I don't think fifth gen epic is any
faster I think it's just your limited by
your
memory
uh but like what do you actually want
this
for the API is so cheap why would you
like I
understand in general I don't think okay
my general thesis on this whole idea of
local AI um privacy nobody gives a shit
about privacy if if you're in the type
who's like but I don't want to use the
cloud because it's not private and then
someone's going to be looking at my data
like a 19-year-old boy named big balls
from the
Doge uh
do fucking C no dude I love the Doge the
doge is
sick I'm glad the Doge knows yeah no the
doge is the great this is the greatest
thing ever it's the greatest thing ever
to see these people like we discovered
waste in the government no you can't do
that that waste was my grift no think
about all the nonprofits I'm no longer
going to be able to funnel money from
the US taxpayer to no it's over the
grift is
over yeah you're going to run your
girlfriend at three tokens per second
all right this is the problem we go to
subscriber turn that off and yeah okay
good okay let's figure out make let's
figure out a Sol this bounty right so we
want to make this
faster let's I have one gem
somewhere which one is it
is it simple M
mall I think it's called Simple M Mall
let's see what it's
doing all right so we get a pretty good
we're getting like 10 Tera flops on the
uh on the GPU of this computer but now
we switch to
llvm oh it's Ball slow okay oh that's a
huge n let's let's slower that n oh why
doesn't control C
work stupid python
oh I killed my docks all whatever I'm
done with the docs anyway I wrote docs
uh I will push them soon okay um let's
try Nal 1 24 and see how slow it is okay
that's not too terrible so we're getting
we're getting
22 uh Giga
flops what should the theoretical Max be
and this one's even worse for some
reason oh this is without lvm opt too we
have an lvm opt flag it makes compiling
slower but it's effectively O2 okay so
we're getting 31 gig flops uh let's run
that with beam and then let's see what
hypothetically we should
expect
um okay that gets 89 gig
flops uh maybe one way to just do that
is to look at the torch
one torch
gem yeah
cool oh
really it's one of the worst things
about
torch for
[Music]
oh okay full 16's mad
slow that's crazy
slow oh
what
um wait oh well that's kind of
unfair okay the problem here is the
reason this is so fast is it's using a
it's using multiple
uh
[Music]
thads and B it's using the
AMX how do I disable the AMX
[Music]
you still have no
idea oh multi-threading CPU program yeah
yeah
that's that's more of a pipe dream still
before we focus on multi-threading let's
focus on these sort of optimizations
let's focus on memory
optimizations uh Colonel apy is a mess
kelpy needs to be Rewritten I will work
on
kelpy uh soon
so yeah the reason that's so fast is is
there a flag to disable the
[Music]
AMX that's actually kind of sick that
that AMX has that much performance
because we can get that same performance
on the
uh our AMX is really slow because we
don't support I talk about a little in
speed where the output register is N
squared so we're actually writing it
back the whole
time um is there somebody to disable
it let me think of how I can't think of
that but actually look at how terribly
slow torches in float
16 like oh that's awful
so let's see if we can beat
that four gig
flops uh half = 1
it's this one here so we're getting
160 okay looks like we're going to be a
lot faster here but still nothing
compared to it's actually going to be
faster to use float
32 than to use half which is interesting
I guess arm just doesn't support this
stuff nicely there we go so we're
getting 39 gig flops in half and we're
getting like 90 Gig
flops uh let's take a look at the M3
maybe it's on
chipwi
[Music]
chipwi all right maybe I'll just have to
do this on a tiny box
push this the
bridge use this one I doubt anyone's
using
it
oh is it Kitty term info
or hases no one run ABK
update it's Kitty charm info and I
definitely don't have my t-o config on
here sure restart all those Services
great
um is that way you can't see is there
stuff you're missing
here all right so let's throw that right
here look at all the look at all the lvm
crap I also put lvm 19 on uh
I'm on Tiny 11 doing this I didn't mean
to do that I meant to use tiny 41
whatever whatever we will do it on Tiny
slow slow slow slow
slow it's searching
now um but I suspect we'll be able to do
a lot
better if we add Dynamic
uh locals in
wow why does that have more of
that how heavy they went on the PE
course
too can I disconnect or something
says welcome to the chat
room uh this not a different cor we
should be able to Ry it actually did I
check out the branch no I didn't
should be using mosh figure how to set
MH up so this doesn't lag as
much
okay so we're getting 76
gigaflops I wonder how close that is to
theoretical
Max I mean this chip we should know a
lot more about
a good reasoning
model uh
what's what's the
max uh T flops on a
single core of
okay so for some reason we're only
getting 29 this is this is this is a big
discrepancy
here somehow even with all of tiny grads
Fancy Search
stuff um
and we should confirm that that's
actually only using one
core yeah using C30
there I don't like btop as much as
htop okay so that's just using one
core yeah so somehow it's generating
stuff that is is over twice as fast uh
sorry the torch has something that's
almost twice as fast as
uh uh so single Precision should
be uh 105
gigaflops so for reason torch isn't
getting the max either although what
clock speed oh it says it's running at
3.3 I don't know if we actually ever get
3.3 maybe
um how do I set perf scalar to
high in
Linux some like way to do
this and then maybe we can get
SC you tell what the hell SK you tell
performance only
performance it's
faster um but that should be running at
a faster speed there's a way I can see
the
speed this show me
no
great um
how do I see C
frequency for some reason these CPUs
like do not want to run at the full
frequency L CPU will show me
this
why why can it not turbo boost
why AMD CPU do
not turbo
boosting what's the max fp32 G blops
if uh we are running ATZ
turboat here we go cool yeah see that's
what I mean like some of these actually
are running at full
thing okay no it is running at full
speed I don't know why it's giving me
that
crappy
H oh single core only please
[Music]
wow the float 16 stuff's really bad
see at base frequency it says that we're
going to get 78.6 Giga flops which is
basically what we're
getting I have some questions but
whatever whatever tiny grad is still not
getting close to that tiny grad is
getting a poultry
29 um
[Music]
I wonder what the theoretical Ma on the
Apple
is it's pretty crazy we can get that
right let's enable locals for
lvm
uh so going to go to awful kernel. py
and here's something called local so it
has to have
local let's do
that
um what is it do more beam
cache oh now it is locals wow that was
easy
we should look and make sure it's
actually like doing the right
thing wow okay cool that was literally
all I had to
do uh let me look at one of these
generated kernels and see if it's
actually
right if I don't do beam I assume I'm
not going to get any
locals that might have been all you had
to do boys to claim
$300 comment out that one
line uh hang on let me
think let me just run this with debug
equals 4 we can just see if it's doing
the right thing quickly so debug equals
4 PR the source
code oh defens the source code
LM unreadable
I think that's right though uh you know
what I can do this in clang
too that should apply to both right and
I can actually read C
code okay so for something like
this uh
huh doesn't match at
all so maybe this doesn't actually
work okay um let's add a
test Clan can use locals
too but they are
treated the
same as
BS still helpful for L1
cash let take a let's look at a test
linearizer um
where I want to put this test
[Music]
okay let's do CL equals one all right so
let's start with something stupid like
like
uh is that not syntax
highlighting that not syntax
highlighting
okay um so you can see that's the normal
thing without any locals I don't really
like that they're called RX but it's
fine um
why is the syntax highlighter not
working your eyes
return let's just do two program that's
better and
then I render anything here there's
render
it oh it's rendered here okay
great why is my syntax highl
broken okay cool um okay got
apply
po
Ops local
sorry why is my synx high
broken because there too much crap in
this
file oh it kind of worked
what that's also s is my internet
glitching why does it have to go to the
Internet for
whatever is the stream glitching at all
why does it say welcome to the chat room
here like it's like reconnecting to the
websocket
why is that
red live unstable average stream bit
rate too
high no nothing's glitching okay I don't
know
whatever why doesn't my syntax
highlighter
work okay size mismatched oh cuz I
didn't do a okay let's say like axis
equals z AR equals
4 that seems right right so that's just
uh yeah okay so this actually all just
works
[Music]
[Music]
not great I just check so make sure it
has four four Loops okay uh
let's do
that
great now let's check in with
locals all right so we were getting 29
before we going need to put ignore beam
cache in
there so you see now we're getting the
green we're getting the light uh light
blue dimensions
so this one getting us like 90
something definitely made the beam
search slower
that being search mad slow now
it's definitely finding the local and
it's
faster it's probably a glitched Giga
flops it's way too many Giga
flops it's got to be got be multiple
bugs
there oh that's not a real reduce we
should fix that
but yeah know I mean it's definitely
using these actions so it's definitely
finding them preferable like here look
at the difference here I'm sure it found
four in that first one so yeah the only
search that actually matters is this
search
here all right here's the old one 29
let's see what we
got gamble gamble gamble gamble gamble
oh this ball slow
though oh oh this is so
slow oh this is painfully
slow I'm going to need to fix beam
search
why is this so slow is that just a lot
of
seconds does someone want to make
something that doesn't output that in
micros seconds and outputs it in seconds
yeah it's taking eight
seconds do I can make a sandwich in 8
seconds what's that 293 milliseconds all
right that doesn't explain why that's
that slow maybe it does maybe that's
just actually how many milliseconds
things take okay what we could do is we
could use multiple cores for the search
that would certainly improve
things we do all of this at once all
right there's a lot of there's a lot of
ways to improve
this
so it's kind of different when you're
doing beam searches on CPU things versus
GPU things because on oh also I could
just terminate them early is really what
I have to do if like something's not
fast I can just terminate it so the the
the difference between CPU and GPU is on
GPU most of your time is like the
kernels on GPU run really fast um gpus
are just much faster they have much more
flops like they have like uh you know a
THX the flops so the kernels on average
run like 1,000x faster they have like uh
like 10x the ram bandwidth right so you
get 10x the ram bandwidth THX the
flops um they run a lot faster so most
of your time in GPU is spent trying to
parallelize not the execution but
instead just the compilation so we
actually have parallelized the
compilation but it's still waiting on a
single threaded
executor uh okay 97 what did we get
before it didn't even use it this didn't
even this didn't even use the
locals okay locals were not preferable
on Mac but that doesn't actually tell us
anything because I have an idea that's
probably close to the max
anyway I would doubt that uh
the oh this is so
slow yes so we're going to have to
parallelize the execution environment
this is going to involve like a rewrite
of the beam search okay we're not here
yet we'll get here but we're not here
yet
let's just see what we
got what is that seconds seven
seconds still don't explain why this is
so
slow if we have like a faster one we
just need to terminate
it does have an auto
[Music]
vectorizer all right we'll wait for this
to finish um I'll explain to you
where uh these things
are if somebody's interested in working
on this so what you have to do in order
to fix this is parallelize the execution
of these kernels and also stop them
early so we have a really nice runtime
environment now in CPU
program um CPU program is basically just
uh something that runs a chunk of Shell
Code and both our llvm and clang
backends
uh output El code now thanks to uvn uh
some good bounties claimed for that
and yeah so we need like we have this
CPU time execution thing now we can make
this execution environment a lot more
sophisticated because it's so
restrictive that we know how it's
running so yeah what we need to do with
beam search is basically like exec with
timeout uh in beam search you're never
going to keep something that is yeah
this is this is this is the first step I
would merge this if you're interested in
that um I would
uh I'd throw a bounty on that I think we
have to add another
parameter to
the well actually we don't have to add
another parameter to the execution we
can probably just put this in the search
also is this just absurdly
slow
um
yeah
so early stop we have early stop
here uh the problem with early stop is
it'll still run once I
believe so you want to actually put a
uh timer on
this yeah I don't know if any of this
sig alarm stuff actually works
anymore is that like running
constantly I don't know like it does
seem like things are running for let
should be one second I don't know why
this is so
slow I don't know why this this search
is is is horrendous right
now um it's clearly running slow
kernels but this doesn't explain right
because this is like 1
second this doesn't explain why well I
guess it runs at count times which is
three what's the time here this is 76
milliseconds
[Music]
yeah so it clearly hits on something
that makes it a lot
faster put it in
registers long did this search take a
lot less time I guess because it had a
lot less
actions yeah this doesn't explain why
this is so
slow wasn't that slow
too I don't think
so gpus also have this trick
is she even
right like what does the max Global size
stuff
do cuz that's not in the thing
anymore is the just totally broken for
for
lvm oh here
finished no it didn't finish sorry I was
on the other
window this just totally broken like
nobody's really looked at
this uh I guess no P Global size is
going to be none so that's going to be
skipped the other thing that's really
cool about working on
is that we can put stuff in CI so
anything you find that improves the beam
search speed in llvm we can actually
reliably test in
CI this was the uh this was Chris
ladner's approach he first did a lot of
the
um he he first focused on CPU
speed uh which is not a bad idea CPUs
are a lot more forgiving than gpus sort
of they're very different the the way
you get speed on a CPU is very different
from the way you get speed on a
GPU um gpus basically are these like
they're massively parallel across cores
and then they also have uh threads which
are called warps which can switch out
really fast in order to do memory
latency hiding so like the way to think
about this is that CPUs switch in order
to access disc or network gpus switch in
order to access memory right gpus will
do a Contex switch
to hide latency from memory whereas CPU
is do a contact switch to hide latency
from disc or network so it's like a
whole different like whole different
order
um all right let's see what we find
here doesn't look like any of those are
any
good that was just lock
okay okay it got a little faster with
locals a little
faster oh okay okay a tiny tiny bit
faster again we're still still off by
like a serious amount though I think
we're just missing some massive simd
instruction
thing there we
go okay we went from 29 gig flops to
29.5 gig flops okay well that was
stupid um
is that
test that linearizer test that I doing
so that should fail
now yes
okay
well we failed at actually making
anything
[Music]
faster
um you remember that stream that I did a
while back where we actually like looked
into this stuff we wrote that where we
wrote that one it might still even be in
tiny
gr um
yeah so they get 26 Giga
flops and with a 28 millisecond kernel
and we're getting a 73 millisecond
kernel and locals aren't what fixed
it uh it's a one24 by 1024
gem uh we'll leave this as an exercise
to the reader
so my next steps would be
to um go into this and read basically
well here we can we can
start uh let's see if that's going to be
fast okay so now we're outputting the
locals still because we're still on that
Branch uh actually it's going to break
beams
but we can look at the generated
assembly with d bug equals
[Music]
6 use
Capstone okay so this is the
uh this is the
colonel we're jumping back to
40 those relative jumps are those
absolute
jumps SP chance clang faster
for
look into why that beam is so slow
too maybe that's not being
parallelized should
be it can't be the compilation that
can't be what's slow
here let's take a look at the code being
generated see if we see anything
interesting
um well this is the lvm
code so a lot of F ads and
Ms um fees on the loop entry
the it's only vectorizing to
four which you might be able to do a
[Music]
wider uh yeah C makes an absolute okay I
I figured um so yeah you see that
jumping back to 40 That's the
loop I guess I don't understand
why all these things are
being zero
out I I don't even understand
this I have to figure out a way to log
into open API open AI on
stream like this really messes with my
usual workflow of not being able to just
paste the shit into into o1 and being
like
[Music]
um why do I need these VX orps
I don't really understand
that wait
what this is spilling to the fucking
stack oh no wonder this is so
slow why would beam choose that
yeah there's no way spilling to the
stack is a good
idea may clang will find something
smarter
wait this is also total nonsense
code that's a store why does it have to
zero it out every
time llvm I thought you were smart this
is dog
shit you don't understand what I'm
saying right like even if this is
spilling to the stack which again why
why are you spilling to the stack back
for some reason what this is doing is
zeroing out xmm0 storing it zeroing out
xmm0 and storing it but why is that
instruction still
there like isn't there some like smart
llvm shit which says don't be an
idiot okay the clang one manages to get
worse G
flops let's look at that disassembled
let like
simpler if this one doesn't do dumb crap
there's probably just some okay I'm now
starting to think this is actually much
simpler and there's just some like
optimization that to some some passes
that aren't enabled in lvm like a native
cleanup pass because this code makes no
sense older llvm versions may not OP
optimize away unnecessary
zeroing install good lvm on this
one one has
19 it's not going to work cuz it beam
cash please don't take forever to find
the beam cash I know you're going to
take forever but
whatever okay there's no way spilling to
the stack is smart
register
pressure how many xmm are
there wait
what how come that one didn't take 17
years to beam wait cuz that just
failed why did that
fail I have a lot of questions right
now there's no difference in here is
there
um why did this
fail oh maybe that one doesn't get beam
searched
for what oh I probably already beam
searched for it okay fine
whatever why is it crappier this doesn't
make
sense now the first hit to it is a
10 you found op manually while
developing lvm jet to make sure I don't
Mis optimizations I but I don't
understand
why that generated all those
[Music]
crappy like that can't be good
code okay now it's beam searching I
don't know why I didn't beam are the
first
time something messed up in the
cash Al that's like not a bad time
actually that's like the same time I was
seeing before it's the same thing I'm
seeing on this computer so never
mind never mind I must have already
searched for
it like it's a common enough kernel I
guess okay it's in the cash that's fine
27 gigaflops okay let's see the code
this is generated with lvm 19 so we
upgraded our
lvm same stupid register pressure oh but
at least it's less stupid now okay so
whatever they fixed that bug in
llvm
um how is something with register how is
something that's spilling to the stack
the best thing it could
find there's
16 oh how do I use ymm
can I use
ymm I'm remembering doing my uh College
girlfriend's homework for her which was
like this and I was I was I was like
trolling the homework to not use any
operations I was tricking like the CI to
check the homework by using like avx2
stuff um
yeah okay
[Music]
so CPU must support
AVX yeah I don't understand I should
have ymm why don't I have ymm why do am
I stuck with
xmm all right let's let's edit VM and
take a look and see what uh what we can
do problem trash code what likely
happens is to move stuff I'm not using
any this is
fp32
um how do I enable ymm in
lvm so I feel like the native shit
should
work put that in the front so hold down
the
button Prime agan stream he was faster
at doing that crap than me okay
um ZN ver two
plus
AVX
does the CPU has them right
big are ym can you
list all registers it
has why registers are 256
bit oh I mean maybe it's just
that so I have another thing I could
try
uh me connect tiny 30
don't use xmm I want you to use ymm use
the fucking
ymm how do I get the ymm
boys
um open folder home tiny tiny
all right so yeah there's a few places
we can potentially improve this so I
enabled float 4 support I guess float 4
support's not enabled in there so it
might just be this simple it might just
be I have to go into
rewrite um
and this
here have a reite everything we
can if AMX okay let's just put eight in
here get a syntax highlight for me or we
just not a good day for syntax
highlighting why do I feel like
computers are so
slow am I the only one who feels that
way that like all computers are just dog
shit and
slow why is it
slow uh let's add eight
[Music]
here good it's find an eights yeah throw
some Eights on that
bitch today's a good day to be slow
all right that is going to do upcasting
to eight which
will segmentation
fault oh yo does someone not enable
ymm seg
fault let's just do that start
there oh shit
we got ymm it's just seg
fals oh check out the
ymm yo that's just's going to be fast as
soon as we can make it
run why do it seg
faal uh hey uvn you know why it's say FS
okay it's
uh GDB who wants the GDB who loves GDB
yeah that's
GDB uh
oh all right um
I back traced
it oh yeah dog you can't you can't
uh can't you can't use the uh the
ymm no it's only one of the
one oh my God this like Intel syntax
versus non inel
syntax
R14 from R oh it's cuz it's not aligned
oh who didn't align the memory shit got
align that memory
yeah all right make the Mal
that's why I wasn't using uh ymm in the
first place didn't know that it was
aligned oh alignment oh see see what the
come on guys earn money figure this shit
out it's fun it is fun well having a
good time okay uh this print R14
God one day I'll learn how to do this
one can I just do print
R14 no of course you can't do that now
that'd be way too easy okay print dollar
sign R14 oh great yeah thank you can I
print it in HEX no can I print it in HEX
like this oh good oh yes that's not
align yeah that's a problem all right uh
shit done in
device go to Malik
allocator here we go oh someone even
wrote Alec align for me
uh who wrote
this who wrote
this I didn't write it fixure 7 wrote
it for
what
huh
interesting cool um so oh we just need
to align it
to
uh for 26 bit ymm
registers should be right right 2 to6
bit is hex
yeah free Prime money oh thank you thank
you welcome welcome to the all right so
shouldn't sea anymore fixture wow all
think now that guy that guy's thinking
thank
you all right now let's get some more
now that you can use
ymm oh I didn't know that they were
aligned wow that's that's kind of crazy
all right uh ignore beam cach equals 1
that's some ghetto alignment I you did
it so
ghetto it's fine now it
fine I CH you merg that I didn't merge
it
oh I'm in a good mood everybody you know
today's a nice
day uh I like life here a
lot my life is simple I wake up I I have
an office I go to the office sit and
work uh tiny Corp got a
contract with
um someone to add DSP support not
actually another another startup it
helps comma too so we took it uh so
that's a lot of what I'm going to be
working on for the next
month
uh hopefully we're going to get some of
the team out here uh to work on
improving viz improving the
profiler uh working on that USB GPU
driver all right do we think we're going
to get a good number with
this where's the new
local oh where am I I'm in
song uh I'm not worried about the feds
here it's the other
Empire
um all right got some eights let's get
some ymm it's gonna be fast now F fast
like a NASCAR NASCAR NASCAR fast like a
NASCAR
um right we'll we'll let nonsubscribers
talk while this beam search runs oh
someone's got to make this beam search
fast
it's like from a
song what what do we got to say while we
wait for the beam search how much
seconds is that can someone also clean
up so it doesn't say us can someone make
it say like Ms sometimes yeah if it's
like big like we have like code to do
that um in here I just like would like
that code abstracted if someone wants to
do
that uh that's like an easy that's an
easy pull request you know like
here you want me to stream more I know I
haven't been streaming a lot um I'll
stream more if you guys
contribute
like uh you know I'm not I'm not that
into
uh you know this is like like it's it's
a give and take kind of thing right like
if these streams are and I don't even
mean this in like a oh you know I'm only
doing this in order to get like it's not
like that like if these streams are
working to get peoplec excited about
working in tiny grad then I'm happy to
do it like but it's my job you
know um where have I been the meta's
kind of played out guys like what do you
want me to stream and talk about oh you
want me to talk about like there's no
fun in in in in politics anymore right
like it's it's over the adults have
showed up finally right the adults are
in the room the adults are cleaning the
place up uh you know you're going to
watch people cry like babies the whole
time you can't dismiss USA you can't
dismantle yo well okay we'll take a
minute and we'll look at the USA website
because this is so fucking
[Laughter]
based guys USA is is taking your tax
dollars and funding like transgender
musicals in Ireland right and I'm all
for transgender musicals in Ireland but
why the fuck am I paying for them I'm
not anymore all right um 35 gigaflops
okay so we got a few more Giga flops
we're halfway there we got we
got it's a little faster let's take a
look at the let's take a look at the
generated
code uh no but like the adults are in
the room you know no there's nothing
more to
say we still spilling to the stack for
some
reason um is Tiny chip coming this
decade well we have
aot wait
what why is that
faster why is that 50 Giga flops why was
the other one slower
okay great but it was slower
right I don't even know I can't even
keep this shit
straight that time it's 34 and that time
it's 50
you know what this probably is it's
probably
alignment yeah see look sometime you get
a slow
one
whoa um
[Music]
see well that's always
slow no okay never mind oh
God it's slow because of ram alignment
guys that's insane
I don't it could be the CPU core
frequency that's another option it could
be the CPU core
frequency
um how do I check
that but it could also just be Memory
alignment you can really mess stuff up
with bad memory
alignment uh and just having to do with
cash eviction
policy wow
yeah I don't know why it's slow but yeah
no all so back to what I was saying
about streaming and that's pretty good
like sometime it gets 50 Giga flops
which torch gets 75 so we're we're we're
we're closing the
Gap
um I also think that lvm could do a lot
better if we promise it that the things
are align
there's a way to like put an aligned
attribute on a on a
vector so I think what we do is we just
always have this be aligned to 20 and
then we
uh yeah I
mean so what if I don't use this
rewriter I mean because we can't leave
this stuff I'm not ready to change that
yet like that stuff does maybe help but
all right so it maybe it's slow every
time
now it's slow every time now but there's
got to be some way to tell lvm that my
buffers are aligned that's in the
renderer
lvm where do I specify the abouts
here
no should also change this simple map M
to not do the Rand first
okay so we have no alas there
lvm pointer
Al let's
try
this uh how do I
say
those inputs are aligned to X20
is
[Music]
[Music]
SED integer
oh Aline 32 looks nice did I get our
speedback it does
not still good to have
though I see but that that that memory
coalescing is really
helpful actually let's try something
else we can also say d vectorize equals
zero we should just ignore that stuff
entirely yeah I got to make that random
knot do the
uh you won't hit throttling in 50
milliseconds no I don't think it's
throttling I really think it's Ram I
think it's just alignment
bites yeah okay cool
the USA
thing
um there's basically a political class
in
America that like considers themselves
kind of like anointed like they are the
you know they are democracy you know you
know it's like it's like I am Queen's
Boulevard and they're like I am
democracy of course we're going to give
you know $5 million to Politico and $8
million in the New York Times and they
they just like treat the government kind
of like uh you know they believe that
they are truly morally right so of
course when they steal money from the
taxpayers it's kind of like Sam bankman
freed in a way right like Sam bankman
freed thought he was so good at spending
money and deploying Capital effectively
that he deserved to deploy your capital
right you could imagine how somebody
like you know gets that in their head
right like like somebody believes
effective altruism is the same sort of
thing right it's just this idea that
like they know better than you so of
course they should take your money and
spend it right why would they not they
know better than you right again this is
their
worldview um you know
just uh yeah it's good to see it's good
to see that that stuff finally uh like
the nice thing is that I can't go back
uh one of my favorite like stories I
tell is you could imagine a whole bunch
of people on a train uh coming back from
let's say a Rangers game you know and
the Rangers won and they're drinking and
everyone's party and fuck yeah Rangers
man you should have seen that Wayne
grety shot right it's a Sunday night and
one guy's on the train and he's like uh
Hey guys uh look I don't want to like
kill the vibe or anything but I have
work tomorrow morning and I was just
wondering if you could keep it down
right like imagine you know drun hockey
fans there was a fight during the game
Boo this guy sucks trying to kill the
party but five minutes later everyone's
quiet on the train because that's it the
vibe's over you can't you can't go back
to doing it right and it's the same
thing here and this is actually the
complete Brilliance of the Doge um Elon
has a thing where he's like you know we
work uh we work three hours uh
we work three times as much as them we
work 120 hours a week and they work uh
they work 40 if that and to come at them
so fast with these kind of things it's
like you're never they're never going to
put USA back together right they're
never going to it doesn't matter what
court challenges
come uh okay shitty the the the load
coalescing matters more uh okay well
good to know we'll have to actually do
those Ram coalescing things and LM is
like less smart than you think it is
interesting
huh this one's using ymm and
xmm so I added this D vectorize equals
zero
flag uh which turns off the D vectorizer
you can see it actually I'll set debug
equal to
uh good sometime it's fast so
interesting about the ram thing uh yeah
you see that
it yeah it's like still doing all these
loads manually which
is um yeah I need to like write
something okay cool cool but we're on
the right track we'll make it a little
bit faster
um or trust trust in the governments at
an alltime law uh you know it's it's
it's there's a revolution happening now
this is the fourth
turning
um and like all revolutions it actually
really sucks to live through them uh I
think I'm a little
too uh you
know I don't think I could be that
helpful with this
revolution I think that
it's barring some major changes it's a
foregone conclusion who wins um the
question is not are Elon and the Doge
and Trump going to win they are the
question is will they be able to build
capable institutions
uh and that's what I'm a lot more
interested in helping
with so I I worry a bit about Elon op
source is very
little um he he really is he does have a
very you know top down
hierarchical uh structure with which he
runs everything and these kind of
structures are very
effective assuming again a dictator is
great if you have a good dictator um but
you know one of the ities of old school
American uh Great Society kind of stuff
is that you did manage to build
structures that functioned without a
dictator it's a different model of
competence it's like the elonian model
of competence uh but there are other
models of competence that work too I'm
particularly interested in the models of
competence that work in open source
projects like they look they look very
different from how Elon does
things um but but they're also very
competent and very
capable it's cool and it's going to be
interesting to see like in the ashes of
the old Empire what does uh
reemerge
yeah the patent troll he dropped that
lawsuit a long time ago uh you know
picking a filing a lawsuit against me is
a bad idea
uh because I think like what people
don't what you know that guy didn't
understand is that I take it extremely
personally right you are you are
attacking me you are threatening me with
violence right like I don't I don't I'm
not I don't subscribe to this like
little system where this is all nice you
are actually threatening me with
violence you're like you know my my
company is an extension of me uh and
even know you're like oh it's just money
it's like no it's not just money because
if I don't pay the guys with the gun
show up right so you're threatening me
with violence and I take that very
seriously
um Elon is open sourcing government
spending no he's not open sourcing it
right he's
uh selectively releasing
how did we how did we how did we how did
we get off on this tangent guys this is
so fucking stupid right like you know
why why don't you why do you have an
opinion about this but you don't have an
opinion about ymm and
xmm wh why why do you why do you have an
opinion about
this it doesn't affect your life in a
day-to-day basis and like I said I'm
going to like like if this is where
these streams go and this is the kind of
content content you guys
want
um I don't want to do this anymore I I
don't give a shit about any of this
really like somehow I got like duped
into it right like you know um what's
the what's the what's the the the line
from the uh from fraum you know you get
your ass off Twitter because it gives
you fucking mental
illness
um yeah and like I don't know I've
always I've talked about this on stream
before that we need some kind of like uh
gate I I've tried I've tried a lot of
these ideas in tiny grad in the Discord
we have different colors um the
different colors the tiny grad Discord
is very nice uh the tiny gr Discord is
very on topic um off topic stuff is just
banned immediately like you think oh I'm
going to go in and Troll and be off
topic you're not you're just going to
get
banned
um the silent majority wants coding
streams yeah probably uh no but again if
you want if you're interested in these
uh these streams show me that this
stream uh motivated you to contribute to
Tiny grad because that's again I'm doing
these for work now like it's not you
know being
a uh being a twitch streamer was a fun
part of my 20s and early 30s
[Music]
um all right you will be arrested and
you'll be here forever are you going to
be here forever guess what you're not
even here right now how are you going to
be here
forever
uh woke up br really happy that you got
to catch a
stream I don't
know uh yes one model paper describing
test time scaling we could have we could
do a little bit of just generic ml stuff
I'm going to clean this up I think I
think we we discovered why we weren't
using ymm uh we fixed alignment for that
uh no everyone doesn't understand
politics the the the difference between
coding and politics is that people think
they understand politics when they
really
don't um they really have have on there
are questions you can ask someone like
very quickly to determine if they
actually know anything about politics
and there are definitely things to know
um they don't they're they're as
absolutely bad at Politics as they are
at coding the only difference is you
know Curtis has a good thing about this
he talks about how
like um politics
at least Democratic politics relies on
you your
participation right
like there's a whole media industrial
complex which tries to uh keep you
engaged you think most stuff's more like
politics than
coding yeah yeah I don't know I I don't
think that that's going to be that
relevant in the
future um um it's not accessible to
everyone I think maybe what we should
like what I'm really hoping is that
we're going to start to get something
that might get me to really return to
streaming is if we can have uh llm Auto
mods that are good right llm automods
that are like extremely
good uh that go in and
say like no this is off topic it's going
to lead to like tangential
garbage um
can you explain the difference between
lvm and M literally take that question
and copy and paste it into chat
take uh do you have any opinion on Jeep
deep seek take that question and copy
and paste it into chat gbt that's this
is my new thing right you know that all
like let me Google that for you like
Google went to shit before any before
you ever ask a question ask fucking chat
gbt right you know why CU it's extremely
patient with
you um if we had open government guess
what you're just going to get a timeout
I'm not going to ban you but like that's
bullshit man like that doesn't even mean
anything uh
to be fair we lived in insane
times you know what I'm curious what is
chat gbt you know what let's let's let's
try that but in labs. perplexity let's
see let's see sonar reasoning
Pro I am not chat gbt no they're all
chat
gbt uh
oh can you guess
wow they're undocumented
guys
um uh it doesn't even mean anything Mage
let's
on yeah yeah Applause lights yeah that's
pretty good
this is what I mean about how people
like weirdly think they know something
about governments and they just don't
oh wait wow did I actually I I've
repeated this idea a ton of times how
many of my ideas that I just take from
reading less
wrong because I say that all the time
like when you hear someone say something
like we should care about the children
right like I take the reverse that we
shouldn't care about the children and
like like no one would say
that um wow you're you're telling me
about Tommy the elite guess what you're
banned
[Laughter]
too
um did I manage to get a 5090 yeah I got
some coming in the the mail next week I
got 12 of them coming uh and I paid
ridiculous prices for
them let's see what we got to do to
clean this up um all right
what
oh The Times They are a changeing
it's not going to be 65090 is the new
Tiny Box is only four
4590s uh we don't have power for six
also it just gets absurdly expensive if
it's six so you actually get less vram
I'm sorry you guys all want memory but
again like
yeah yeah
uh yeah no
the you know with a lot of these like AI
mod things and AI teaching things I kind
of think that the AI is just going to be
good like is Twitch even a real website
anymore
um wait
what don't ban me what ban me all I just
heard was ban me all right get out of
here um
it's just a chatting website gaming is
secondary no my point is are any of you
real like is this just a conversation
with uh with with llms right now like
that's the other problem with all of
this kind of stuff it's like streaming
had its time
but you see I do it a lot less and
they're kind of you know coming to an
end um there's not that much more to say
right so here's something you can do if
you want more George hot streams right
just take the archive of all the
existing streams put them in a video
model and be like give me
more like you know I'm happy that I'm in
the data
set um
yeah why you know deep seek that's
another whole thing like what is it
about deep seek that like escaped
containment and you all think that you
have an opinion on deep
seek that's so
weird like why do you have an opinion on
this right do do you have an opinion on
quen the news the f fucking News man
like like can we just get over the
news it doesn't tell you
anything it doesn't tell you anything
that's remotely relevant about your
life or content strong emotions like
H like there's a disconnect right
there's a disconnect between the content
that I like kind of want to do which is
actually like
boring um you know I'm not like that I I
understand the kind of hyper coding you
want but I don't really do that too much
anymore right like a lot of the tiny
grad tiny grad has shifted the way I
coded to be much
slower um no boring is not good and as
termed by engagement boring is not good
um but
yeah yeah maybe some CTF yeah like
what bro I'm not not 25 anymore you
know
uh so yeah no I'm going to think about
really how to make the streams higher
quality and focused on Tiny grad
uh they might be sort of like I don't
know maybe I want to have like the tiny
grad Discord
up
um yeah because this is kind of like uh
these are these are work streams we have
so much work to do this year to get tiny
grad to be speed competitive with
torch
um I'm going to go over to this window
it's also annoying that I can't log into
anything on stream
sh
uh oh gaming stream get lower engagement
yeah hav playing games more lately
um what's on
cast yeah I think we need to find a new
meta that isn't Twitch streaming
anymore yeah this looks like the kind of
thing that gets three viewers why don't
I sign up for a matrix and use git lab
while I'm at it right maybe I'll post
about it on my blue
[Music]
sky
um is Flash attention coming to Tiny gr
this year
hopefully there's a lot of stuff to do
before flash attention so I wrote those
docs on
speed um bring those docs back
up if you weren't here at the beginning
of the Stream we have speed docks
now like I've thought about this before
but you know you guys read my
blog if I want to succeed I believe I
have to change who I am and I'm not sure
if that's possible believe I'm making
efforts in that direction but I haven't
seen results yet working on AI is both
the only thing that matters and also so
demoralizing because of the
above um I believe you have to give
individuals control over the technology
and not by setting permissions in AWS
that can be revoked I believe in a
nature I mean in a nature sense the
ghost Gunner is the real Second
Amendment um this gets into where I
differ from
yon
and there's tons of new bounties for
tiny grad I put a lot of effort into the
Bounty sheet this
week we have little categorizations of
the bounties there's tons of open ones
some of them are relatively
cheap
um like this is not that
hard uh cuz you only have to do it on
one
thing like just zoom in figure out
exactly what it is I'm trying to do
something a bit more higher level but if
you just have to do that one
thing um maybe that is the right way to
do
it but
uh the ideology holds me back so much in
business to the point I struggle to be
competitive but if you abandon that
ideology what's the point of doing it at
all
even when Humanity goes to Mars will be
going as
cargo uh so you want to talk about Flash
attention I don't know why everyone
always is so excited about Flash
attention right so guy who brought up
flash attention what is Flash attention
do you know or did you hear that term a
whole bunch and what do you think flash
attention actually
improves right does Flash attention
improve batch size one llm
inference you say memory efficiency but
why do you think that impacts
you right batch size one llms are
entirely Bound by your memory bandwidth
and accessing the
weights and if you aren't within a
couple percent of the memory bandwidth
there's something wrong with your uh
there's something wrong with your your
Runner you can get you can download any
one of these you know tiny grad ol llama
torch you're going to get
within at least for batch size one on a
single GPU multi-gpu stuff is a bit
trickier but again that has nothing to
do with
uh you
know you're a subscriber we'll entertain
with this we'll entertain
this I'm actually not so sure what's
going to happen in
general
um another reason that I'm kind of here
is
like I think
that there's going to be a big
problem as AI starts to replace jobs
and something I've realized streaming is
that there's a whole lot of people who
like uh I talk about this in one of my
blog
posts
um lash out at a fan in Bangkok when he
told me his friend was a fan of mine I
replied with why do I care I was already
in a bad mood normally I'd be nice and
if if you read this sorry it was
directed at you but I do sort of Stand
By The Point low commitment from lots of
people is useless I'm not going to milk
you for Merch
sales
um maybe the uh like the the terminology
I've been using for for people like this
is
like I mean okay I guess there's there's
there's two like ideas here right
there's people who are like spiritual
bottoms you understand what I mean by
that like some I'm stealing the term
from the the gay community right you got
like tops and bottoms right and then
heard about the bottoms crisis you
know
[Music]
um my comment about
Lex not needing turn completeness
sparked a new research group at my
uni yeah what are they doing right like
what what are these people do why like
tiny grad is the cleanest expression of
this idea anywhere tiny grad is the is
the clear expression of the idea that uh
neural network inference is is is is
neural network compute is not turn to
complete it's it's data
flow um before taking people's jobs it's
already taking their brains right so
yeah the thing that you always talk
about in this is like a centor chess
so there was like Casper off deep blue
right and that was like when a computer
uh you know first beat the top human and
there was still a period where a
computer plus a human was better than a
computer but that era ended and now a
human adds
nothing
um and I mean before that era ended for
the top players think of when that era
ended for like me right like I had like
a 1500 ELO at chess at what point did
computers get to like 2,000 ELO or 1,800
ELO and like they when they find a move
I just there's no point me even having
an opinion on it I don't know what that
ELO differential has to
be um you want gigantic grad with h100s
the problem with that is who has h100s
it's not that
useful um well h100s also have really
high profit margins uh they have really
high margins they're expensive
why not A6 instead of fpga right like
again
let's you get a comment like that right
it's like what do you mean you know I've
started to like model people more and
more like neural
networks you say that what do you think
you mean by
that so many people I I I I here it's
mentioned here it's like I'm continually
shocked at how little people understand
about
anything uh so maybe we do need to like
make these streams private somewhere or
you figure out how to engage with like a
uh I don't think so I think those those
AI versus human plus AI are going to
apply just as well in the real
world um imagine every twitch Jam that
had chained thought
uh do I notice how chill how still my
chat got when I started Banning people
on a whim yeah should I ban you
too
um like anyone who mentions Banning
should just be banned right how about
that how about that as a
rule spend some time on making Asic if
you think Turing completeness is on the
way of importance
yeah
uh oh all right yeah I forget see I look
I don't stream in months I just
absolutely forget how stupid chat is and
I feel bad for the other people um
yeah
[Music]
yeah yeah all
right uh you got to think about this
stuff uh let's see if this this stream
gets anybody into tiny grad uh when I
push it you'll find these speed docs on
docs. tinyg
grad.com I guess I just have to keep
repeating these things you'll know where
to find the GitHub and uh yeah let's see
if this gets anybody and if this gets
people you know say in your pull request
hey George I learn something and put
hours into this because I saw you on
stream and I want to contribute to Tiny
grb
uh and you know what like it's not even
like
like like can
you I wonder that right like that's an
interesting question just about how many
people in the
world uh are capable of contributing to
Tiny grad and maybe I should just be
taking a much
more uh focused approach to finding
them and the thing about contributing
too is you don't have to be like the
smartest person ever or understand
everything you just have to figure out
how to contribute more than you take and
it's the same thing with the economy
right if you figure out how to be a net
positive contribution to the tiny grad
project right even if it's something
quite
small not I don't want a typo fix don't
give me a typo fix that's bullshit
that's not worth anybody's time to look
at um but if you find some very small
thing even like in in an obscure
function right like you find a bug in
one of the Obscure functions in tiny
grad um and you find this bug you write
a test for it and you submit a poll
request that has the test and a bug fix
and an explanation you have just added
value to the project right you don't
have to be super smart to do this you
don't have to understand any of this
crazy stuff right that's the path that's
the path like there's so many ways to
contribute literally for everybody with
a bit of computer
knowledge um you know and yeah feel free
again to use use you can use AI to help
you use AI to help you all you want but
if you're copying and pasting something
from the AI you don't understand then
don't do it right you're wasting
everybody's time right I can just use AI
if you're going to use it like that but
if you take time and you look at the
ai's output you piece it together in
your brain you know this is something
that humans still have a great Edge over
AI right like being able to to reason
over like multi-hour things right AI
can't AI can't think about oh this is
like you know my plan for the next three
hours in order to get this
done um so
yeah yeah so that's place to end the
stream think about how you can
contribute to Tiny Gra
and if we see people of oh you know if
we get like a bunch of new people in
here tributing I'm going to be excited
and I'm going to do more streams if we
get the same dumbass shit having the
same conversations right like The Meta
has to
evolve right we've been stuck in this
Paradigm for so long it's time to move
past it it's the current Year everybody
it's the current year all right happy
Saturday enjoy your Saturday and
contribute to Tiny gr bye
think about it this morning
rest in peace Aaron Carter yo I saw that
guy on Broadway once and the Fantastics
you know after his
first stint off meth or something
not sad though man it's sad the drugs
are fucking up the youth man we gotta we
gotta do something all right
welcome welcome to my stream oh we're
gonna start with this who is proud to
not vote tomorrow
look every time in my life and I just I
just wanted to see if this resonates
with you you tell me tell me every time
in my life that I voted I always regret
it right like if my guy wins my guy
loses I always regret it because let me
tell you what a vote is a vote is your
consent to the system and that's why all
these people are always telling you vote
vote vote vote vote get out the vote
everybody spread the word it's time to
vote right nobody's telling you not to
vote man
never wonder why that is
what do they gain from you voting your
complicit complete complicits
complicitness
complete you know the word I'm going for
into the system
uh so everybody on November 8th tomorrow
ignore the propaganda ignore the spam
text messages ignore the large Twitter
banner ads now do they do it for free
that's a question do they do it for free
or are they sponsored by American
democracy TF
uh but yeah just a reminder uh if you
vote uh
uh your vote doesn't make a difference
all right we're just gonna start with
that you know your vote doesn't make a
difference you know you know anything
about like like how often does it come
down to one vote yeah George but if
everyone thought that way
if you think that way is fine
uh so yeah uh here I am telling my
audience proudly not to vote uh yeah
okay cool
uh George you have to spend an inspiring
message does it involve voting Why is
voting an inspiring message is anyone
even here I don't think anyone's here
I know but I promise we're going to code
today uh
uh review unbanned requests wow I have
nine unbanned requests
is anyone here does anyone to chat oh
here we go good
good good good good yay and not to vote
oh did I leave subscription only on
now you're here for drama oh no we're
not doing drama uh there's no drama but
I am telling you all not to vote so if
that's drama uh George says don't vote
that's unethical that's one American
um
I promise you I'm an American
to show you my passport but when I go do
that
get started
at the tiny corpse so I wrote some tests
um these are the test speed versus torch
tests
okay
um and we can talk a little bit about
what makes things 180 milligrams of
caffeine shit man
all right what are we doing today
so we have a set of tests uh in tiny
grad called the test speed versus torch
tests and our goal is to beat Pi torch
CPU on M1 at everything it's written on
the board over here that you can't see
uh yeah you can you can see the board I
guess yeah I don't know is that can you
see the board
this is this is the headquarters of the
tiny Corp right here in my room it's not
working from home this is my office my
bedroom's over there
uh
uh yeah so we are we are working on the
tiny Corp
so I can show you guys how to run these
tests now unfortunately they're not all
working right now because I've broken a
bunch of things
and that's what we're gonna fix
let's see maybe they are
working three tests SE versus four top
equals two L again
uh okay we have a few bug ones
but most of them seem okay my permutes
are broken where am I from you
I thought I thought I kept all this good
oh you use four by four equals true uh
if
that just
oh look at all those E's I'll be really
messed up uh it's lame shapes
okay
uh index at a range
oh we didn't deal with if the length of
shape is three
foreign
so this should not all be hand coated
this is like garbage but I can show you
guys what makes things fast and what
makes things slow
okay cool
now we only have one failing now and
that's mulson
uh and that's because Ellie and buffer
object oh yeah
yeah for some reason I had to hand do
the fuse multiply ads
uh this is this Mac I have an M1 I don't
have an M2 uh
and
let me just write this
is instance
this code here
if it sees that you have a sum being fed
by a multiply it hand fuses these into
llvm FMA which is a special instruction
that's a fuse multiply ad I don't
understand why lvm isn't figuring it out
itself I enabled ffp contract fast but
for some reason it doesn't want to
listen so
uh that said cool let's see if all the
tests pass now oh no we still have one
failing
uh assertion error
well that's just because of uh
that's stupid that's not a real thing
uh
what is that just actually not close
enough
you know I think that's actually just
more closer
or is it because they're a different
shape
[Music]
zero zero zero one
salsa just throws are tall
as well just in case
still wrong uh I don't know
I don't care it's it's right it's just
uh
floating map okay
speed tests pass
okay so we already had to do some work
to get here
um but so I wrote a bunch of things
by the way I'm working in the chonker
branch
um oh tiny grad's almost at uh at nine
thousand
uh oh we got some new pull requests too
I can already tell that
what is this junk
I don't know if I want that this one
uh
uh honestly I think our common yeah okay
I'll have to look over this pull request
this is a good pull request uh this guy
uh JLA 524 I assume if you're doing pull
requests on my stuff you want to be
shouted out
um
has submitted a bunch of good stuff
it's on the tensor
oh
readme.txt for my thing oh that's cool
oh Jackie Lee
I appreciate the contributions
uh all right
this I don't think I want this I'm a
Tomo file some I'll have to look that
one over we shouldn't we shouldn't hate
it just to hate it uh this one was good
but I'm working here on the chunker
um and the chunker is what makes things
fast okay so you'll see here's my things
and how much slower they are than torch
uh should I should I spend some time and
clean up the formatting of this
should we clean up the formatting guys
um
can you read it or you can clean up the
formatting
from you are this is from your LR
you might need to use f fast math to get
the FMA you want to try it you want to
see if you have some okay we'll try out
fast math I don't know if I tried that
one uh I'll show you one that has the
FMA so if we just go in here and run
test speed DOT test Gem unrolled and we
can run it with debug equals three
algebra equals one up equals two
uh test speed has no I'll test on it
okay so you see this is the code here
that it generates and you'll see that
these are fuse multiply ads but if I
remove my explicit views multiply ads
and here
let's see that lvm's not doing it
automatically you get f-malls and F adds
so I don't know what Global at fast math
does I actually don't think it's that I
thought we could give it a try
yeah
foreign
[Music]
I really would I I'm upset that I have
to do that we have to figure out why
it's not it's not fusing I have another
bug too and I'll be really impressed
actually if anyone can figure these out
um did you hopefully someone on this
stream saw enough context I'm sure
there's some flag in llvm
so you can go down here uh to line 437
in Ops lvm and disable my FMA and see if
it will still output if see if you could
still get it to Output FMA instructions
uh
I will PayPal you I'll venmo if if
somebody figures that out I will venmo
you fifty dollars
uh or I'll uh take a 15 minute phone
call whichever you prefer
um if somebody figures out how to fix
that uh
and then so that one that one has a
prize because I actually wasted a lot of
time on it and then there's another one
that I didn't waste time on test Max
um test Max is slower and Tiny grab than
torch I should put my mic up here so you
guys can hear me
um
for some reason F Max isn't vectorizing
and the reason it's not vectorizing is
because of this
so first off this should be Valentine's
anyway
[Music]
actually
I think
but yeah no seriously if someone if
someone figures out how to get the fuse
multiplies so I can remove the scrap
from my code
you don't have to take the phone call
you can just send me a memo and I'll
demo you 50 bucks if you solve it before
the end of this stream uh if you're
watching it on YouTube I'm sorry you
gotta watch live
uh actually I think that
it doesn't use because
uh that type is fixed
so I'll show you guys something so you
see F Max this isn't fusing and it's
actually just doing the max slowly but
when I test sum you'll see that it uh it
fuses
so the reason for this is because when
you're doing a reduce op sum
it's using a weight I should just figure
out what that is because I think
no no you see because this is a real F
add
and if I go to Max
it's actually making a call to llvm
maximum
and they have hype there
let's see if we can fix that one
I didn't spend any time looking into
this one
like there's got to be some way to put
like tea in there you know what I mean
is it 50 bucks a little low yeah it's
like one flag bro
never mind never mind you know what you
don't want the fifty dollars you can
just do it for free
laughs
um
no yeah we're we're I'm full time at the
tiny Corp now
uh
I'm a trillionaire bro I bought meta
stock all right I don't talk about it
uh okay
so you see how it's not vectorizing the
max for some reason
you know what let's just try you know
what you know how I figured out how to
do things I just write a quick thing and
see and then have it output the lvm by
code
[Music]
take
[Music]
oh but it's possible that
[Music]
you're negative
10 I don't care
we didn't import stdio for printout
thank you
llvm
what's the definition of Max
uh double double
even stupider
actually calling it on double
oh
c f Max
it actually upcasts it to a double I
have to use f Max f wow
it's those hoes in that bitch
[Music]
tail call Float lvm Max num F32
oh okay so now let's see what happens
when I actually admit the assembly
no
look it doesn't it doesn't fuse the max
yeah it's not fusing it
start trying some Flags until it fuses
uh as fast math
ffp contract fast
I think it's that
I'm pulling up in the vanilla VM right
yeah it actually just doesn't fuse look
the worst part is I know there's a Max
that supports the bigger thing
like if I change this to sum
yeah look the sum fuses into F adds
right you see what's doing is dot 4S and
doing ldps
but when I do the max it doesn't confuse
Broken Man
because there is a Max that will work
that same code will work for a Max
um okay
so coming back to give everyone a little
bit of context
um we have these tests
no that's testing the speed our llvm
implementation versus torch uh give me a
second and we will clean these up
slightly
uh okay
[Music]
30s
cool
um
if someone solves our family money
uh no so this is on the CPU this is
we're targeting lvm CPU
um and after a lot of work
our Matrix multiplies
are only about 20 times slower and our
Kongs are about two times slower
now this is a little bit misleading
that was mulsum slower and Tiny grad
that doesn't make sense
I must have just broken that because
that one used to be faster
yeah this is just broken
uh
oh I know why it's broken wait we can
get to why that one's broken in a minute
but um yeah this one used to be faster
so we can we can fix the code for that
uh you see some of them are already
faster so this add square is already
faster most of them used to be faster
[Music]
but most of them are pretty close to a
wash
the gems are slower because pie torch is
using the AMX instructions
so how it's doing this gem so fast right
so we can just do the math quickly on
how much flops that is
so that's this many flops
that's 0.26 gigaflops
uh and somehow it's doing it in
Point 15 MS
uh wait did I do that right um so
floating Point operations
per second
ah so that's getting 1.7 teraflops here
I think that's right but that's because
it's using the uh yeah 1.64 teraflops
uh is because it's using the AMX uh
coprocessor we're using uh not the AMX
go processor
and that's why we
only get 66 gigaflops
um
so this one's slower because my Max's
aren't uh
aren't uh playing nice
my Max's aren't
expanding because it's calling that
function that has fixed types and it
seems like it doesn't know how to expand
up that function you know I mean like it
like widen widen that function but
otherwise lvm's Optimizer is very good
thank you Chris leather
um so this is like Point wise Edition
see the speed's very similar this is uh
I'll show you this I mean this was kind
of a gimme for tiny grad because we do
Fusion
um
uh is Computing this
and you'll see it computes this
in uh
Pi torch right now is faster but
I have a trick on my sleeve
so you'll see look at how fast these
gems are these gems are a lot faster in
pie torch and we're pretty close to the
theoretical Maps we're like this one is
like 2x off of the theoretical Max
um on the CPU so you're like how is it
possible that torch is doing it 25x
faster and like I said because it's
using the AMX coprocessor now
convolutions which are basically just
Matrix multiplies
are not using AMX coprocessor so if we
can make the convolutions in tiny grad
use the AMX coprocessor then like Sable
diffusion is going to run way faster uh
in tiny grab than it is on uh by torch
and then this doesn't even get to the
backward pass where we're doing Fusion
of the optimizer with the backwards pass
like
you know when you compute the gradient a
lot of time the only thing you're doing
with the gradient is you're sticking it
in the uh the optimizer right but by
jointly running the optimizer in the
backwards pass we're going to get a
wheel for pi torch there
um why wouldn't they use the AMX Co
processor for both because the and I I
looked into this it's because there is
no uh so the AmEx coprocessor is not
like exposed
um the only reason we know about it is
because it was a reverse engineered from
Apple's accelerate Library
uh we can we can look into the
documentation of Apple's accelerate
salary yeah uh
so there might be convolutions in here
but like yeah I don't think they work
right
so the convolution is not being used
from accelerate it's being used from uh
yeah getting stable diffusion to run
decently faster I guess if I can get
stable diffusion to run like three times
faster on the M1 uh I think uh people
start using tiny grade right
thank you
that's our Target um you can see it's
actually written on the board here
release fastest stable diffusion
uh
I don't know what background removal is
we're gonna say on it one
yeah
so we can use the AMX co-processor for
both once we uh oh don't get me started
on chess man you know chess is very
addictive and I recommend that nobody
starts playing chess
being smart doesn't make you good at
chess okay my my ELO is like 1100 which
if it was like 1200 last time I don't
want to talk about Chess you know and
then you lose and you just go on a I
don't want to talk about Chess
at least I don't cheat oh that's my
opening I go I go E4 E4 E4 that one
King party four and then then I'll bring
my Knights don't go to re Lopez anymore
or go to the Italian game
um yeah I'm sure a lot of people are
better at chess than me
oh don't don't I don't I don't talk
about Chess man
because C4 is white
we're not talking about Chess
all right we're not talking about Chess
and if any non-subscribers talk about
chassis we're gonna have to go to
subscriber only chat so we can focus
check this is the camera intelligence
yo yo I love you guys hope you're not
voting tomorrow right right if you're a
voter oh you're a voter ah oh yo you
know what's fire White Lotus
you expected more from me at chess or
about voting
um let's get you some funding for tiny
at stability
I would take a small Grant I would take
a small Grant to accelerate uh stable
diffusion on the M1 actually if they're
interested
uh I've spoke with emad look like I
don't really need the money
um if he's interested in just offering
you know nothing nothing big uh I I
would take it because this is what I'm
working on anyway
but um you know I said I'm like you know
I don't know the money
uh though it would it would I don't know
I mean here's what I say to anyone who
wants uh to work with the tiny Corps
right if someone like like stability AI
wants something specific done like
stable diffusion already has big
adoption so we're gonna do it anyway
right uh we're gonna do CPU we're gonna
do the M1 processor anyway right we're
gonna do Cuda anyway because these
things already have big adoption but if
you want something to be fast that
doesn't have big adoption that's where
you got to start paying money
all right describe your feelings about
Sydney Sweeney considering I don't know
who that is we're going to subscriber
when we chat next you're going to ask me
about Andrew fucking Tate man why do you
guys why do you guys always talk about
that I don't even I still don't know who
he is I didn't Google them
uh
okay
so let me see if I can make the gems a
little faster
um so a really cool thing about uh
about about time to get canceled you
guys do
uh
one of the cool things about tinyrad is
we can run this with debug equals three
and it will show us the code but will
also show us how many gigaflops we're
getting
so this is a matrix multiply
um I have a theory that if I break this
Matrix up a bit more to get some cash
coherency we're going to get wins
foreign
I think I can break that one up though
I can break these ones up to get some
more cash go here and see I did the math
on the cache
here so what's what's cool about the way
this is all written
is um
the things that determine what's fast
and what's slow term is the it's because
of the order we do the computation in it
right so you can see that this is the
AST of this Matrix multiply and you can
see the AST is a multiply of these two
buffers
uh and you can see why this is a matrix
multiply and then a sum over that
uh yeah we're not working on the edge
TPU anymore uh The Edge TPU was was a
little warm up
um you know well I think I did that over
the weekend or maybe not maybe that was
right when I started but the tiny Corp
can't be wasting time on dumb things
like that
um
yeah there's zero reason it takes two
gigabytes to implement we're going to go
through
you know I write all the code kind of
messy first and then we're going to
clean it up
um so let's go in here this is my Matrix
multiply here and let's let's factorize
this a little more
uh the cash gym is 128. 8
28 times 16 is bigger than my Matrix
see we have to write this correct
[Music]
it should be cash dim divided by d y
to be cached and divided by DX
this should be cached in
times Dy
[Music]
okay
now we have to change this permute
uh to do zero three so we're doing this
axis and this axis
this axis one
four
and we do
this last one one two three four five
six seven then seven
then no that's not seven zero one two
three four five six
and then we put two and five here
see if that's still correct
okay I cannot reshape
oh
that's a different problem
8 times 16 is 5 12.
yeah uh
oh no this should just be cash dim I
don't know why I did times Dy there
foreign
74 gigaflops what gigaflops are we
getting before you're getting more or
less
[Music]
so we added some cash coherency
77 okay
try cash dim equals 64.
72 not faster
16 broken for some reason
I think this should be faster but it's
not
[Music]
why doesn't 16.
hmm
the same as d y
I mean you can mess with these two
[Music]
now it works we only get 44 gigaplops
so this being cash aware doesn't seem to
matter at all
yeah but this like slides around and
changes uh the orders on which we do
things
Chase we'll do that and then like the
dimensions are done in this order
right so it's really cool that like
Target red kind of supports this and
it'll generate a custom kernel
uh that work
but okay so we're getting 75 gigaflops
um the theoretical maximum
is is
uh
here
102.4 gigaforts so like we're not that
far off
oh
actually it might not be that one that
makes a difference
oh cool all right that's a lot faster
look gem is a lot faster now
I don't know is this because torch was
slow for some reason
we're gonna sample more times
um
oh interesting
the loop vectorizer can vectorize
intrinsic math functions but it can't
vectorize Max
why not
hmm
Auto vectorization kind of annoying the
way you say that
should we do all the vectorizing by hand
because yes load is if we turn the
vectorize off
we could do it all by hand maybe that's
just better
it'll compile faster definitely
thank you
I have the cash working don't I this is
not without the cash right
yeah look we have a function cache
actually we do median now I wonder if we
can just do mid instead
I mean there's no way to be faster than
that right
yeah okay cool
min's probably the most appropriate it
runs the stuff over the same uh
the same thing why is mole some slower
[Music]
foreign
[Music]
that's what happens
okay look here
I'll show you what happens if we turn
off FMA
yeah see look now our mole sum is almost
three times faster than pie torch
uh but our gems got slower and so did
our comps
just annoying
it says the auto vectorizer should be
compatible with FMA
foreign
could it be that
if I solve my own problem no one gets
fifty dollars
no come on it doesn't set an arrow does
it
it's not infusing them
foreign
[Music]
[Music]
thank you for your subscriptions people
it's not our no it's not that why isn't
it fusing this
I think I should call it f mallad
instead
no this isn't the no is that sorry
you try to order vectorize Matrix
transposes oh my my transpose is fast
my transpose is the same as Pi torch
um
yeah my permute is the same speed
um per mute it's really important to be
cash aware
that's one that that cash one really
helps with
uh
yeah see ad square that our ad is really
the same let's just place
so let's do eight
they're all fast now
yeah
dude you gave solid help yeah well you
solved the problem
you didn't stop it
all right fine fine fine fine we'll
offer fifty dollars for whoever solves
the max also
if you solve the max or the FMA
you know what else it might be
I'm using llvm light and this uses lvm
11.
there's newer versions available at the
end if they're not you know
so for some reason it fuses fmas
[Music]
all right maybe this is the best place
to solve the mystery uh
[Music]
foreign
look
[Music]
I solve it first no money for anyone
attributes
no nand FP math
no INF FP math
no sign wrapping math
unsafe FP math is that something I have
to enable
okay how do I add attributes to my
function that seems good
here's my function in lvm
function
IR function name exact
uh
type name append basic block
argument attributes those are argument
attributes here attributes function
attributes here
function attributes
example my function attributes aren't
the same as these
foreign
Flags enabled when the enable unsafe FP
map yes Fox safety man
Fox safety at comma we have to care
about safety but at tiny grad we can
disable it
unsafe FP math come on
here's my shit
and I'll use my shit okay
useless
no sign wrapping math
[Music]
I don't know if any of these do anything
see the thing is you're just just a
black hole you just write things here
and uh
you pray
okay we have to
these are wrong
we have to enable them on function
dot attributes dot add
can I add something like
oh is it the whole thing
do I do it like this
foreign
attributes great
so we only get those special attributes
uh
uh optimization remarks yeah those and
that enables the remarks I I can enable
I can turn the debugger on
um but this isn't yeah yeah I know I
have that already actually if you say
debug equals four
[Music]
I will tell you about well no it's not
gonna work because I put let's do a
function thing in there but uh
[Music]
this will print out the vectorization
information
you still
it gets vectorized
uh but if I do something like test sum
this won't get vectorized yeah yeah
so this outputs the
characterization shit
so now we're not trying to fix the
vectorizer we're trying to fix the
multiply accumulates because we know
this one's doable
for something like no unwind is that
going to work
okay it says no unwind to there great
can I get lvm to tell me why it didn't
uh
functions
now those aren't functionatters those
are something else
that is this unsafe FP math thing
foreign
[Music]
who can figure it out all right now now
we're just now we're just trying to
solve this uh
foreign
FP math equals false
you don't know anything about that
I'm a little worried also that this is
just because it's a newer version of uh
enable fast math behavior for the
function
I put fast in front of the uh
the ads and stuff
see this is all so this is the main
thing here and those are both fast
so they should fuse together
build FML
we have some stuff in here about FMA as
well
let's just cause that that's stupid
idea yeah just actually just calls the
intrinsic
only difference between no no not Auto
vectorization we're trying to figure out
why it's not fusing into fmas
I feel like I enabled that ffp contract
fast at fast math
enable unsave FP math is that a
parameter on the function maybe it's
probably on the module
do these things have parameters
globals scope metadata
um no
I'd really like it to discover
automatically that it can FMA
do you guys do you guys like this
content when I try to debug things or
would you like to see me try to like do
algorithms
I feel like algorithms I convey less and
here you get to watch me struggle in the
same way
we'll let the non-subscribers have an
opinion on this maybe a non-subscriber
solved it and it's going to get venmo 50
dollars
unable finite only FP Mass
these are target options
okay we did all that
we're trying to figure out why these F
malls and F ads aren't being fused
together
but yet like in this one they get fused
I'll show you that they get fixed
if we look it says FM ad FMLA
Ron opt over the byte code with the
debug stop looking at the assembly what
no I I just there's a very clear thing
that I want from the assembly
um the last thing no trapping math
the last one of these I don't think it's
this I'm not even sure these are doing
anything
is that the given lvm command line
option debug pass equals
all right
[Music]
llvm light is really poorly documented
too
maybe just lvm
okay
what if I put it in LLC I have an idea
we'll see
oh there we go
okay
is it fused here
yeah it's fused okay but now we can edit
it which is cool
[Music]
so let's see if it really is those
attributes let's get rid of number zero
there
same
foreign
oh
what is that what's number 10.
float float
why are you saying yeah is my stream
lagging
no stop it
oh you're saying F because of the Ice
Age we have twitch all right no that's
not true
oh you man the Euro Force
[Music]
okay that still has FMLA
so let's see if it has anything to do
with these actually
module Flags
[Music]
oh yeah I'm excited to not vote
guys stop voting
everybody just stopped paying taxes
tomorrow we could all rid ourselves of
these people
you just gotta not pay man and you got
to get everyone else to not pay and
that's the problem and everyone that'll
never happen
and that's why
we're doomed
um
I don't get it I have the same shit
foreign
no no don't vote don't vote
I want to vote to the voters
okay
I I didn't enable any of these and it
was faster
oh no that got really slow
definitely didn't fuse anything
foreign
close nothing changed
um okay maybe we need to in the
optimizer
there's like ways to manually add these
past managers
uh
uh
let's figure out which pass does this
fuse
you think it's ad instruction combining
pass
okay maybe
[Music]
um
module pass manager
a module pass manager it's over there
all right
llvm Optimizer and instruction providing
pass
no
yeah you ran into the optimizer object
okay
I mean like sometimes the order matters
uh
who wants to read the L of the M code
we're reading the lvm code boys I'm
sorry if you didn't want to but it's
what's happening right now
download very slow
why won't it fuse my shit
oh
aggressive insta combine what do we
think of that
aggressive Instagram
should we try aggressive instead
aggressive we like aggressive shit oh I
don't know that just might not be a
thing
uh
we've been very in code most Waters
oh
you want to create a remarks file
that's right this is chat's not a
democracy
um
I think we're going to get some good
remarks
foreign
good it sinks a lot of stuff
these are the most useless remarks I've
ever read
can this give me remarks
thank you
oh
what is this instruction mix
is it this because that seems like it
has FMLA
[Music]
that's not a real pass
great
all right it's got to be in there
somewhere right
it's a family
yeah I said ffp contract
right there though is there somewhere oh
to on yeah we can try on uh I tried on
it didn't do anything
no same crap
[Music]
uh okay tasks those aren't clang so it's
not there
clue lib Target
P load balancing
search for like use multiply
and code gen Cuda I don't think it's
that
compile Kudo with llvm
foreign
[Music]
no it's an lvm14
no that'd be a tragedy
[Music]
uh uh
yeah I don't not sure if that's true
um
checks if the operation is fusible does
not check the
foreign
no it's not
I worry that this isn't turning it on
for some reason
and sometimes it matters like where you
put it which is really stupid
[Music]
foreign
[Music]
I don't care about that
oh ffp contract fast is a clang argument
not a llvm argument
um
okay
[Music]
okay
so it's not that
let's stop looking in clang it's not
inclined we're not running clay
uh
uh and we don't want tests either
and wagwe you're the reason we have to
turn subscribers back on
okay they're stuck in here if you use
allow floating Point contraction
if using a multiply followed by an
addition into a fuse multiply and add
the fast flag implies all the others
it definitely have the fast flag
so that should be all we need
I have tried contract explicitly
yeah so none of these things matter
[Music]
foreign
[Music]
uh we don't want tests I just want to
exclude tests I don't know a good way to
do that
nvptx explicit
tracked it's possible it doesn't exist
it's possible it can't do this
here's a question do we want to use the
auto vectorizer we don't use the auto
vectorizer this is not a problem
[Music]
now if I still look at that stupid other
code
um
I don't know
it might just not be able to do it the
the only reason the other one might be
doing it is because uh
wait
check this out
of this operation can be floating Point
contracted
has allow contract
[Music]
this stuff has Matrix intrinsics
no
that's fifty dollars you can pay for
subscription for a long time
[Music]
it's a dreary day today guys
it's raining outside this is San Diego I
thought it was illegal here
wow we're getting some really crazy
people sending emails to everyone block
that's right you get blocked
all right
it definitely has a loud contract I
don't understand
foreign
not tbaa
foreign
and they get contracted
why do mine not get contracted
does it somehow not think the machine
has the instructions
foreign
no
I'm also I'm just interested in this
what is this a knit Sim detailing
lower Matrix intrinsics
this stuff has Matrix intrinsics
up level size level inlining threshold
disable unroll loops
oh there's a module pass manager and a
function pass manager do we need one of
those too
can you basically the unmodified lvmir
yeah
actually you can just just just run this
it's probably easier but actually that's
a really good idea I should just um
I should just save the IR
and then run it with uh
let me just save it from python uh
hang on
I don't really have a way to copy it
just put it on God bolt I don't know
what God bolt is
um oh you know here's something else too
that we probably don't do enough
[Music]
I can print that out which is the
optimized llvmir
hmm
how do I get LLC to just optimize
is that contraction happening where is
that contraction happening
foreign
[Music]
foreign
look it's fused oh this is bullshit
look Bap fused
I mean does that answer any of your
questions because it's just like
ah
my outer Wild on the screen bro
how are you a subscriber
look that one got fmlas
[Music]
so the problem is not in the IR
how does
damn
foreign
what made it fuse nothing it still
doesn't fuse with uh lvm light
it only fuses with okay
how do I disable optimization let's
figure out which
optimizations doing this
what if I turn on oh zero
[Music]
wait even o0 gives me fmlas
it makes me just think that we don't
have the right like machine or something
triple Target data layout
oh
print pipeline passes
great
is it just because it's a newer version
of lvm that would upset me
oh
host CPU Apple M1
code model
[Music]
arm and build attributes
[Music]
what if it's something like that
I'm from L.A
foreign
no compound
Target specific attributes
unable to get Target for unknown
receiver and triple
plus FMA is not available
[Music]
foreign
options we're not going to compute the
playing options
[Music]
it's probably some
like thing that's set by default here
oh wait FD contract
FP contract not Dash ffp contract oh
it's that
no
foreign
I mean even when I turn it off it's
still giving me fmlas
this is the right lvm right
okay this one I can't even turn it off
not really this is stupid
LLC
foreign
[Music]
Target a specific CPU
foreign
from LA's
debugify
FP contract
not FF
um okay here's a question
what llvm is this actually using
I wonder if I can find it
uh
should we build llvm light
cannot find an lvm config binary oh this
is annoying
yeah because then it runs into these
problems
track
okay all those other navels are real
trapping FP math
you know signed zeros f e math
I don't think it's this stuff but I'm
running out of ideas it's getting very
frustrating
all right do we have to just give up
okay I have an idea uh Brew install the
M11
foreign
and then we can be looking at least the
right version
they are just
if you are use a a what's a a
well did you solve it
do I owe you fifty dollars
hell no oh come on did someone solve it
that I just want an answer to this this
isn't Fun
it's not like going to be a clever oh my
God
oh my God
does this work
[Music]
oh if I knew emacs I think I could do
that faster
FMLA
okay
no no no no look this is lvm11 look
there's fmlas
this is the same bytecode it's just some
configuration that's not correct
it's like not getting the right uh
it's gonna be so stupid I know I know
that
trust me it's stupid
because I'm gonna like lvm life
foreign
poly
should we try Polly what's poly
enable the poly optimizer
can we enable poly let's try poly
Polly
I'm gonna fix my fmlas so we should
focus on that
oh they have a polyhedral loop Optimizer
oh cool
should we should be able to use that
right
maybe that'll already do some of the
things I want
I'm telling you this is going to be so
stupid
[Music]
foreign
AMD GPU code
now the other things have been have been
really stupid too
foreign
do I have to say features here
there's that string of features
uh oh can I say Target CPU in there too
and say apple M1
CPU
uh where is that
Target CPU equals Apple M1
no not that
okay
um
I'm gonna need to get some debugging
from uh okay
there's got to be some debugging about
this
debug only machine schedule
[Music]
debug only debug pass
wait but there's definitely debug going
man I'll get it
unknown command line argument debug only
what is mlbf
using the lvm option oh
oh vectorize Loop vectorize
including you are using opt
can I debug everything can I put like
debug only star if I just put d block
does that do anything
oh a lot of debugging
oh is the SLP thing terrible
well it looks really slow
wow
can I put debug here
or does this not work
mlvm
foreign
okay that looks like it's begging to be
fused there don't you think
how do I enable that debug
uh oh this is not a debug build
fuck
uh great we have to build that if we
want that
so that one works but this one doesn't
uh
contract renameable why isn't it doing
it
foreign
look it has contract there I
foreign
[Music]
wow daylight savings is so depressing
it's already dark
you know what what is that I mean
I'm ready for the stupid
no
wait it got slower
why
why don't you fuse
foreign
Fusion globally
or is contractable get node
the problem has to be it has to be for
some reason returning not has FMA
is FMA faster
what if it's this
[Music]
what if it's like this stuff that's not
returning
the right thing
is Operation legal or custom
VT is simple
if it's a float or a type yes it's
faster on ar-64 okay
VT
what's the EVT
[Music]
I don't think we have the right machine
type I'm sure it's that
foreign
[Music]
Cyclone or something
or it gets tired machine create Target
machine
relock and relock a search code model
and code model
printmc instructions
triple self dot triple Target lvm from
triple get process triple
create module pass manager
nothing
okay create Target machine
and create pass manager Builder
create mcgit compiler
I I mean I I can't think of anything
else it could be
you have to like not be sending the CPU
correctly or something
[Music]
mcpu equals Apple M1
and March
oh yeah whole CPU Cyclone that's the
same
though I'm not passing that in there
which of these does take a CPU this one
yeah there's like a way to get that
come on come on work
ah where did I get that from
uh get host CPU name
features LVN dot get host CPU features
[Music]
uh
uh yeah this doesn't work actually
foreign
how do you get number to Output number
output this is how I track down one of
the other bugs uh llvm by code
I had to go all over the number code
number
dump
IR
the number IR will be dumped to the
screen
generate object mode llvm IR
number dump LVN
let's try it in number let's see if this
works uh pip uninstall number
because I like broke it trip installed
great we're learning boys we're learning
all right
uh attempt let's see
uh
import number it's like number dot jet
and a b uh c a b c
plus equals a times B A equals
around and
uh a
[Music]
[Music]
[Music]
okay
let's have number I'll put the L over
here
oh I mean it's kind of interesting to
read in and of itself
uh how do I dump the actual code
number dumb
assembly code
look up the llvm assembly Source number
dump assembly wow that's pretty good
all right who thinks it has fmlx
[Music]
no
no F moles
moles and then adds which actually is
confusing to me
um
say red equals uh
[Music]
so we're not getting
look at that okay number can't do it
either
foreign
lvm light just might be broken which
sucks
um okay okay all right all right don't
worry don't worry there's always hope
there's always money in the nasty
uh
[Music]
llvm
uh config equals
okay the code looks different
okay we uninstall llvm light let's just
make sure everybody installed
no files were found to uninstall
okay
this is interesting
people VM lights that's not what I did
that's the same
uh but no I think everyone can check to
make sure we're running the right lvm
light
um
[Music]
foreign
[Music]
version
okay now
something's just broken then
good news though we can now modify lvm
light
is it worth it if we solve this will
that be uh worthwhile day for everyone
and we can submit a pull request to lvm
White
probably just some option
or the worst part is I bet the debug
doesn't work anymore
and we can test that
I bet that doesn't work anymore
it doesn't work anymore
well we both debug but we're definitely
using
you think you're saying I should just
use lvm and not waste time with uh
lvm light
I mean I could
we know it works right the problem is
definitely in uh
see it does kind of make me think
I have an idea maybe it's his features
[Music]
no there's not but there's all this
stuff
never mind
it's not that
no the FMA definitely works in vanilla
llvm it works even in this version too
so I know it's not the version it has to
be here
the bigger question is why doesn't this
work
I have much newer than that yeah oh it's
mentioned
add FMA intrinsic support yeah yeah but
no I don't want the intrinsic it works
when I use the intrinsic
foreign
let's go back to where I was running
that
[Music]
foreign
okay
features
full fp16
available CPUs for this target
Saphira
there's not one called Apple M1
no
why do they think it's called cyclone
if we look up what Cyclone is
mcpu cyclone
this is where it
Cyclone isn't until fpga no I don't
think it's that
I I know what you're talking about
though
uh
uh features pushed back zcm
ah
interesting
don't you think this is where the FMA
stuff would be enabled though
wait do I have to pass something in to
get features
get host CPU features no I see that that
one doesn't work for some reason
available features for this target
is zero cycle floating point zero has a
disallow all unaligned
seg fault
oh well okay I mean that's cool because
it did something
but uh it's not cool because it's egg
vaulted
okay
interesting
I bet you it's one of these
uh I'll go back to cyclone
uh
M enter
which is the feature that breaks it
what's that feature I was using
which one broke it fpr V8
doesn't work if I put it there
we might be on to something
and that crashes okay what would have
plus before
ah so you don't want a plus
uh let's just see if the comma
separation actually works
blah fprva
okay that looks fine cool all right
which of these features enables that
um
[Music]
strict align
that just seems cool
doesn't do anything
whoa enable Matrix multiply
full fp16
CPU fuses
fuse arith logic
which features are enabled by default
can't we just do that
can we see what features are enabled
mcpu house let's say mCP equals cyclone
uh
and actually we should try the assembly
okay
um
I called it like uh lvm dump or
something
it still has fmlis
uh
plus feature to enable a feature and
minus feature to take away a feature
we we had something we were getting
close with those I I I've got to be this
it's not this I don't know what it is
FMA
foreign
faster than f mullinad is Operation
legal or custom
ers
I worry it's this
mad depends on target lowering
uh AR 64
[Music]
[Music]
that's this crap again
yet features was an empty object but
that doesn't mean anything I think
that's just broken
could it be any of these
oh enabled JavaScript conversion
instructions
um
I think it's just neon I'm not sure
that's already enables
oh
that shows like a disabled Neon
it she looks like it disables the
feature
interesting
okay well we learned that that actually
works
uh
plus
fpr and V8
well enough bad
um
yeah again we added all those and it was
didn't do anything
foreign
okay I I I don't know I don't know what
to do anymore
it's an FML instruction
oh no that's not right
there has to just be summary I mean do
we really want to dive into this do we
really want to recompose okay here's
what we can do guys if we want to do it
we can recompile llvm
this is all I am white
we can recompile lvm add in print
statements
and then figure out what's going on
foreign
get machine function
I think numbers working with Pythons to
slow you down
uh
VT is simple this isn't even using EMF
Bros
type is float type ID double type ID
gets scalar type
foreign
function
VT what's the EVT
extended value type
possible
it's possible that it can't do it
because it's
python debugger what no it's not the
python
we'd have to recompile llvm
and then get
a
all right all right let's do it let's do
it what else are we doing today right
building llvm
building lvm with cement great
uh
build all of them
email dot dot slash lvm
oh why are we targeting all those things
oh it's gonna take forever to build
wait does it know about Jays We Gotta
Throw Some J's on that bench
yeah jeez
it's a huge waste of time I'm getting so
mad about this
okay you know what I guess I guess might
as well learn how llvm works oh
I mean we gotta build llvm I'm sorry OBS
is dead but it doesn't have the same uh
oh come on
guys we gotta build llvm can you hear me
at least
I mean
it's
possible
doesn't make a ton of sense but
there's also just mats not
experimental Vector reduce F Max
how do I use that
oh God we gotta build Spark
we're building something to emit spark
code guys this is hopeless
foreign
we're doing this again I'm sorry
cmake lvm Target list
how do I set that
llvm targets to build AR 64.
he made build type
debug
what's God Bolt llvm
oh
interesting
uh how do I
appreciate your target
valid Target to enable AR 64.
oh gotta capitalize your A's
oh lvm targets enable native
that seems better
well hopefully now it has less garbage
should I say native I trust native more
actually
you know what we'll do j6 so you guys
will still get some uh
how many cores do I have
probably oh good it should stay
streaming now and kind of assemble
slowly
let's let's waste time let's dive into
this
[Music]
visit F sub for FMA visit F ad for FMA
combined
oh God
Fusion go away
well let's also put our printf in here
[Music]
that is the function right
why are you building intrinsic's power
PC
I hate power PC I hate Spark
thank you
all right we learn it boys we learned
you know it's not all a waste of time
someday
we're learning on your 64 core workbox
building lvm takes 30 minutes oh my God
I have an M1 this is the fastest CPU in
the world
foreign
[Music]
[Music]
no nothing's running under Rosetta don't
worry
visit Fab
visit F ad for FMA combined
where is our llvm being built
an llvm project
build Elvia
so when it's ready
we'll be able to
python freeze setup install
s that
Dash configure underscore config
okay it's missing stuff because it's not
finished building
can I please paste the raw lvmir yeah
I'm telling you that's not the problem
the the because when I run the llvm from
uh command line LLC it works fine the
problem is something to do with lvm
light
look we're missing less things now
oh good we got the orc jet
like you'll get it to compile and it'll
work fine the it the it comes somewhere
from uh
wow
wow this is so complicated
all right guys I mean
half of me wants to write an assembler
half of me wants to ditch lvm entirely
and just and just start writing and
start coding an assembly
look we have more now
yeah the cooling's not great my poor
laptop
should I just now put a minimal
but we'll decide here let me just
generate a minimal uh multiply add
[Music]
foreign
FMS
okay so what do you want to do now
[Music]
[Music]
um
just index out of range one
two works
yeah so these
F moles and F adds it should uh
all right so
so what do I do in God vault
we built yet no
it's cool though it enables the Apple uh
and that gives me FM app
all right I should say if I say O3 it
shouldn't roll the loop
or not
llvm.godvault.org
fancy
I'm on the no script version I say
okay
uh
now what do I do
see they get FM ad and I don't get F at
man
why
settings
no
add tool
what's that
I don't know what that is
so even if I go really far back it does
that
it outputs FM ants yeah really far back
oh you can't go that far back
okay so they added it
in version five
can I link in chat
[Music]
oh
this says share
oh my build is done
you build elevia
very careful very carefully
no
no
fix that
[Music]
no
click add
lvm opt pipeline oh okay okay cool
okay by that oh this is really good
actually why why lock thank you
this is excellent
okay
but by the time we've made it there it
seems like it's already uh
an fmn
all right let's figure out why this
isn't linking
does this work if I just do this
no
no
thank you
okay uh we gotta figure out why dad is
trying to like uh X
don't really require XML to
turns it off okay
[Music]
why is it doing this then
oh I have my build
make file
rvm Libs
employing lips dots split
[Music]
filter inconsequential passes
yeah so
it's happening here like as soon as we
get to uh
expand I sell pseudo instructions
there's already a FM ad right there
okay it built
foreign
Target for this triple no targets are
registered
no targets are registered
foreign
doesn't work
oh
didn't register any Targets
how do I register targets
foreign
foreign
maybe that'll have targets
I don't know
okay okay llvm opt pipeline viewer oh
I'm still in an old version let's go to
uh
11.
uh
uh no it's already FM ad
soon as we get to instruction selection
it's already FM ad
foreign
a lot more stuff or is it just
foreign
yeah so it's just not fusing yet
here's a question does this thing have
symbols
uh
Cloud Fusion
no that's the one that doesn't get fused
this is the llvmir that in lodm light
doesn't get fused
all right like this is it
that's the problem
llvm light must not be enabling
do dashes matter
see lock and it just outputs this
what the hell
you guys
foreign
you guys
did you look at what I just did
if you set opt equal to three
you get F mall and F at
if you set opt equal to two
you get FM at
y'all seeing this right
let me test this on Upstream lvm light
how come I cannot install it
uninstall what
we'll let the non-subscribers talk about
this no I got pranked bro who who said
the pie torch who said who said pie
torch was in on this
foreign let's see if this one fuses now
fmli
I don't know why we're now only getting
34 gigaflops now
only gives me 22 so
foreign
what's not in the dock
it's not in the dock that when you are
this is this is infuriating
[Music]
did you guys see that
[Music]
foreign
foreign
foreign
dude
all right well great you know this this
is just just you know I would have paid
someone 50 bucks for that by the way
if someone had figured that out fifty
dollars could have been yours
why is it still slower
if I don't get it though
I think some things are faster with opt
equals three
I'm done with that
[Music]
foreign
oh because your channel Loop factorizer
off
I was like why is it slow
turn vector
so this is with opt equals three
and now we go to opt equals two
and look how much faster my convolutions
are
took out look at the speed of my gems
oh oh what a stupid waste of time man
all right well we can remove the
FMA shit from here
because now it does it automatically
you would have told me for 60 bucks well
shit we should have negotiated man
that was so dumb
that was so unbelievably dumb
what's even weirder is why didn't number
do it
[Music]
foreign
77 gigaflops
oh that's a good number of jigaflops
it's a less good number
does it get faster if I put that cash
back when I put the cash back too
I forgot that I disabled the vectorizer
oh
oh God bolt reproduces it
foreign
[Music]
how stupid man
you know I never trusted O3 anyway
I also have a three here I don't know if
that three matters
oh quality time with lvm
oh
all right
well yeah because look look we got fmlas
we got fmlas
it's pretty nice right
see if you do debug one it just tells
you the G flops that's how many G flops
we're getting on stuff
all right
so this one gets you a lot oh this gem
thing is because it actually has to
launch two kernels
pretty good actually that's fast
and then let's launch the second one to
do it from you
it's not faster I I promise you it's not
faster
uh you need to fuse those
at least for this CPU they're definitely
slower
okay
uh great use of time guys great
uh let's just mindlessly run this a few
more times and think about what we're
doing
wow and to think we built llvm
called a lot I don't know or maybe
that's the stream for today maybe that's
the stream you know you just you just
struggle with one thing for a long time
um uh why why lock congratulations
you're now VIP
thank you for introducing me to godbault
uh in reality if I just sat here for a
bit longer and I'd happen to type that I
would have found the problem
uh so everybody congratulations to WHYY
lock
uh
oh four
it's too fast
almost too fast
can't compile it's too fast
yeah
okay
okay yeah we'll take it as a w that's
that's pretty good that's pretty good
um notice how now we have a fast now if
only we could figure out how to get the
maxed fuse
all right
um you want to add some I know what you
guys will appreciate
let's add some uh
we've had some colors
guys appreciates you want some colors
bitch
[Music]
[Music]
foreign
foreign
[Music]
foreign
now you can see where we're doing better
the pie torch and where we're doing
worse than Pi torch
just kind of make that line up a bit
okay cool
this is the magical test when all those
things are green we're in the money
uh well we'll add a few more of them too
we'll add like batch norms and stuff but
okay
I thought you guys would appreciate that
I feel like we got more done in those
two minutes then we got done the whole
rest of the stream when we actually just
could have changed to three to a two
bro
imagine being able to watch my streams
in the future
at least I know I'm not dead you know
um okay
so you see that we're doing 2x worse on
these convolutions and I'm not exactly
sure why that is
uh
uh we should also probably print the
gigaflops
but that's kind of annoying
I don't know that doesn't really matter
I guess
um so you see that these ones are all a
lot slower
uh oh yeah Mall some so fast you wanna
see more some
and you can see why Mall sum is so fast
so this is molsom It's a times B sum so
in pie torch it has to construct a c
which is a times B and then takes the
sum of c
um and you're wasting tons of memory
bandwidth doing that
but in tiny grad it fuses those together
you see add square is also a lot better
uh everything all the yellow ones are a
wash actually you know what I should be
fair
we're being unfair right now
because Rally's the same
um so these ones are all limited by I
don't really think there's a way to do
them faster I don't know about that one
but these like the ad I can show you
guys my ad Cardinal it's it's not like
anything
uh
like this is the ad kernel
um there's just no way to do this faster
because you have these loads in stores
and that's what implementing factor is
like there's you know that that's that's
the inner loop there
Oh by one Iris
um
this Max is upsetting that it's slower
it shouldn't be slower
uh but we have to figure out how to
vectorize max
and for some reason lvm doesn't want to
do that if you can show me how to
vectorize max
uh I'd be very happy
these ones
to be able to fix
no actually maybe not they're using
Winograd convolutions uh so there's not
really they have an inherent advantage
over me
these ones are where it's very
interesting
there's nothing wrong with my code being
outputted it's actually probably like 2x
off of optimal
but it's slower because these things are
using the uh
the a ofx instructions so we're gonna
have to write our stuff to use the Amex
instructions
okay
yeah I guess that's the next stream
uh yeah I feel like I mean I'll keep
going on this but
I think that's the Stream
more fair
ah
step one
beat pie torch CPU on M1 at everything
two delete conf make open pilot fast
without it no more ugly kernels
three beat pie torch Cuda on 3080 TI on
everything I have a 3080 TI
uh release fastest stable diffusion on
M1
what would get comma to switch to Tiny
grad for training and then don't do
three until one is done write proper
coded tests and then the diagrams on the
board are me trying to figure out how
these kernels how these Matrix multiply
kernels
I I racked my brain for four hours
yesterday trying to figure out how these
Matrix multiplied kernels were working
and then I realized that they just
didn't they didn't do what I thought
they did they didn't operate on a normal
Matrix
um can I print my CPU host features uh
there's nothing there actually
uh those don't work
yeah bedroom whiteboard of course
this is my office actually it's not
really my bedroom
uh her bedroom's over there
is our guest room in my office
you think I think I sleep on that bet
you think do you think that's my bed
uh
uh yeah so once we use the AMX
instructions these are going to be
similar speed
and these are going to be insanely fast
uh we're gonna Crush pytorch at
convolutions this they don't use DMX
instructions
like I think that we can get 10x faster
convolutions
now I'm not sure they're going to be
faster than the GPU
uh
actually
I'm curious
does that work
whoa check it out
okay so um that's what happens when you
use the GPU
uh damn gpus are really good
unless
it might not actually be no it's
probably finishing
chance this isn't actually working
uh
now that might just be too fast
[Music]
foreign
just add something here just to do it
where do I add dot realize and Dot
realize here
foreign
pie
it does include a copy out but
we have to call CL finish you know what
I mean that might just be enqueuing the
uh
like there's a chance that's just
actually just submitting it to the GPU
queue
let's let's make sure we're actually
magnifying that stuff correctly
if I said debug equal to two it
definitely is
okay okay so it's not actually finishing
them uh
let me just do this then
um if
Red Dot device
uh CL I want to report CL
foreign
to the uh
yeah okay that's actually correct
cool
that seems about right actually that
that seems to correspond with what I
would expect
um the GPU is really unoptimized in tiny
grad 2. actually we can do one more
compare it there
[Music]
oh and then we can check the numpy back
end too these all should work
okay look the comms are faster at that
back end
so these are all the different back ends
and we can compare them to uh
the Combs are a wash with the GPU back
end but with the opencl back end which
uses these accelerated convolutions it's
faster
uh
but we'll still be able to crush that
with the AMX
is there a synchronize this is
synchronized this is this is correct now
oh yeah you want to compare to numpy
oh numpy is brutal
wait
how is permute so fast and
oh
that might not actually be doing it
that might just be changing the strides
which is really an argument for putting
the copy out in
[Music]
until faster
you can just make a copy and torches and
it's just not fair
cool
so our fastest back end is opencl
this is the one you can actually use to
run stable diffusion today
the gems are still trash
some is real trash
uh and then the other thing that I want
to eventually do is okay so the M1 has a
shared uh has a shared uh memory space
so theoretically I can just with zero
copy overhead send some stuff to the GPU
and send some stuff to the CPU
[Music]
AMX AMX AMX and that one's gonna have to
wait
I got a whole lot of boring stuff to do
I should be able to make these ones as
fast as this one
those I don't really know why they're
slow
uh all right fine
50 bucks if anyone can fix that one
the problem is that the max is uh not
being fused
into the vector
uh and you can't write code to it you
have to make lvm do it
like yeah it's easy to do if you were to
like externally write code but then you
can't use a vectorizer anymore we love
the vectorizer
the vectorizer is our favorite
cool
melt the Silicon let's go uh the AMX is
probably really power efficient
oh and then you know there's a neural
processing engine too
oh this is I mean these are it's
unbelievably fast
oh we actually have one more back end we
can test
okay forgot about it
wow except for the gems which are like
broken and permute which is fake they're
all the same
piece what lvmir
oh the max one yeah I think there's a
nice one
uh what is it
foreign
foreign
so the problem is that it's using this F
Max and it's not like here let me show
you how let me show you how the one for
some looks
uh
so it's it's pretty much the same code
except instead of actually I should just
be able to it's almost the same
uh oh well it didn't do it because it
didn't enable that you got to enable the
vectorizer
but the vectorizer doesn't work for uh
[Music]
foreign
hopefully by the end of the week we have
this code generic size so all the tests
still pass when this runs there's a
bunch of hacks in here to make this work
uh where I like hand that some did some
of the axes but I can do it
automatically
uh
yeah keep Cash go here and say
sure I'll do that automatically and then
The Next Step
is to
uh add AMX support
and then at that point we should be
running everything really really fast
uh but if things aren't still fast we
should be able to use most of the code
that I'm writing now and then write a
GPU backend uh even if we don't like
right now we have a llvm backend which
uses this IR Builder to create uh
lvm in transects and there's this GPU
back end I'll show you the GPU back end
this is the GPU backend but these
programs are very simple and they have
fixed for loops and they're using the uh
they're using the shape tracker to
Output uh math to figure out where to
index into the array whereas the lvm
backend doesn't do this the lvm back end
actually generates a for Loop for each
Dimension we're actually first it
consolidates the dimensions
um then it
deconsolidates the dimensions uh
depending on
what it wants to do
and then it reconsolidates the
dimensions
um
but I didn't reconstolic dimensions are
you know it generates loops
I'm getting tired
thank you for watching the stream uh
uh any last questions
oh yeah tomorrow what are y'all doing
what are y'all doing tomorrow
is anyone still here
361 people you guys know what you're
doing tomorrow
Frozen or something
all right I guess nobody knows what
they're doing tomorrow
happy Monday good night everybody this
is the tiny Corporation this is what we
work on
uh we know it's so weird why is a good
stream wait why is no one
that's going to
use what what's using all my
CPU let's see F6 sort by%
CPU don't get
it is it like not showing kernel threads
or something
where's all my CPU
going like look up here my CPU is being
used but this is only 3.1 does htop not
work I'm getting
scammed and sorry if you want it faster
than 30 FPS I think 30 FPS is all this
Max supports but it doesn't drop any
Fram so that's good
let me check
my an x264 software
encoder I don't know if that's going to
fix
it oh Deborah is arriving
soon should be outside in one
minute coffee
coffee uh do I want to terminate running
processes in this window
what all right let's see if we got any
Chatters good morning good morning good
morning why air over Pro I don't know I
should have probably bought the pro it
was
cheap I did get Homebrew working and I
actually installed Homebrew on actual
Mac so if you look at my like Python 3
if I like which Python 3 this Homebrew
Python 3 is at actually a genuine Mao
64bit executable arm
64 I'm on big sir I'm on an M1 Mac I
know you guys haven't seen me in a bit
you guys saw me on a 16inch Mac now I'm
on an M1 Mac the webc wow the webcam is
grainy as
shit this computer sucks the webcam is
grainy and the speakers are terrible
like they just didn't put money into it
it's
cheap um which is shameful for
Apple
uh how's the M1 well no we're not doing
a kaggle challenge oh I didn't set I
didn't set my stream topic did I we got
to set the topic let me go set the
topic um hang on view
dashboard tiny grad neural engine on M1
question
mark
neural engine on M1 so there's really
very little known about this neural
engine despite it taking up like a huge
amount of the
CPO all right it should say tiny grab
neural engine on M1
now 40
viewers well well I have two weeks to
return it I have two weeks to return it
we'll see how much I like it or hate it
okay um we can just
Safari uh I got my my ad guard installed
I don't know if this one's good but it's
open source so the bomb is not more than
150 bucks for the machine it's a piece
of shit
like um it was th000 bucks I don't know
no I'm probably going to return it but
in the meantime let's have fun with
it we are working on Tiny grad the tiny
grad
all right so first
problem well actually I think we have a
decent pull request on Tiny grad so
let's let's go in phone GitHub and let's
merge
it Deborah is at the
door
um
GitHub I'm not going to GitHub on my
computer because I'm not logged into
anything tiny grad not Tony grad
what are we doing today we're going to
we're going to try to we're going to see
if we can get tiny grad to support the
the neural
engine tiny gr there we go oo o
everybody should go Star tiny
grad
sers you're back on the slippers uh
everybody go Star tiny grad
yeah click that star yeah come on come
on let's bring the stars in Click the
Stars uh all right so we just updated it
now unfortunately I went to run the
example and the example actually depends
on pytorch we don't have P
torch I don't know why that's a
problem let's go to screen python
path
I mean it's pretty Snappy with OBS
actually the real reason I went with
this and not with the uh with the pro
was cuz it didn't have a fan it was just
like oh it would be so nice to have a
computer without a fan can we increase
the
resolution um
coffee yeah
here uh where's my output resolution oh
God the resolution's bad um video
outputs currently active oh I'm sorry
I'll be right
back the fan just makes
noise all right
good I mean hopefully this thing can
stream we back all right all right all
right all
right um no module name tiny grad oh got
python path to dot there we go yeah so
now we're getting no module name torch
um so unfortunately right now it depends
on that noise is
terrible okay well right now it depends
on Torch to load the file uh and we're
going to figure out how to not do that
so let's let get a nice environment up
here um I think I already have it and
get
ignore yeah we just make a directory
called notebooks and then I can do
something like Jupiter no yeah it's
Jupiter
notebook Jupiter not found um damn it
hit three install
Jupiter oh oh thank
you
I sound feels like it's sat there for a
while it does yeah it's not hot you know
what I do on the on the delivery orders
I write extra hot it extra hot for you
I'm not thrilled with delivery
James George cuz you're learning how to
properly order it you have to say extra
hot
no but my watch is like
deflated mine tastes kind of deflated
too Can We
complain yeah you're right it's kind of
a
bummer I know like it's not the
delicious same coffee I come to expect
it's not even though I have better than
this no I that like didn't they just
drive right here and how do I complain
report an
issue
do I love Postmates no sucks never how
was your order from James coffee well it
wasn't good and I don't blame James
coffee food
quality did you order it postmate sucks
like an hour ago oh that's terrible
postmate sucks don't use Postmates
everybody do I have to run Rosetta so
this is not running with rosett um I
installed so when you install Homebrew
you can install it two
ways um I install it without
or it's not too
bad
yeah hype train let's go let's go let's
go keep it going keep going all right
all right load torch so we're going to
have to figure out just how to load
these things without
um what's
okay from Tiny
[Music]
grad utils import
fetch why did it highlight for
me Colonel starting please wait
Colonel
died what's
failing
okay how do I debug
this Jupiter Apple
silicon this stuff was like python only
I don't understand how it can be
broken oh might
be
could be the
firewall
no I do read chats what do you
want
starting
okay this start starting at
manual no module named oh is it launcher
yeah it's
launcher oh holding down arrow
keys I don't know that's in the place
you can't see sorry it's going to take a
bit to get the
new when using the IPython Cel entry
point control c will not work
segmentation fault well that's
hardcore what the odds we have like
working lldb or
something
run
right
what
segmentation
M all right cuz I know you guys like
seeing this stuff it's this
one python runs okay by the way that
starts up so
fast iPie colonel launcher
segment all right how do I do
this
it's actually seg
F that's
shocking i p Colonel does ey python
work
yes
that might be a different
problem
for
than
no no crappy butterfly
keyboard you know unpopular opinion I
liked the butterfly keyboard you do yeah
I never had a problem with it never had
a problem with this is some Anan
crap no like this one's a little thicker
I think this one's cheaper to make and
that's why they did it Apple's cheap
this is a cheap laptop I'm very
upset there's a crappy speaker this
crappy
[Music]
webcam that's buy cheap shoes I bought
the iPhone SE of laptops oh
yeah I thought was just for my
house yeah but I want a nice laptop for
your house
okay um okay why is this seg faulting
let's let's figure this
out cuz IPython notebooks not work
on well let's just try pip
uninstall IPI
kernel now let's pip three install IPI
kernel that was too
fast segmentation
fault
what is ipy Kernel let's go find
it here we
go all right pip uninstall IPI
kernel now let's go to build and let's
try building it from Source maybe
that'll work I think that's going to
work we can track down this Segall you
think we can submit a poll request think
we can be the can we be the people who
fix I python for everybody with apple
silicon
okay segmentation
fault
one the
tests the tests seg
fault maybe the coverage tests oh with
coverage oh no no no that's not wow the
test
Segal
okay you CED an M1 MacBook Air and
watching this yeah makes you think it
was a bad decision yeah kind of it I
mean it's just it's a mediocre laptop
Apple I really I don't know if the pro
is better it just like they didn't tell
me it was crappy it just makes me
concerned I probably should have known
it's probably my fault time for Val
grind going Val grind
it oh my God I hate
Z why does anybody want zish nobody does
Z
sucks okay wait how can this shit Segal
it's all
python
what's seg faulting how is this even
happening from IPI kernel import code
youil so just this import seg faults
apparently no that's
okay import no
se
what just funny things in the internet
where you
find by oh yo I going to a fight with a
Swan
Once
says can you do an stream an urbit
stream yeah's got all
stuff can I get paid by urbit PR I want
to be sponsored no I don't want to be
paid I want like something you want you
want your own you want to Planet no I
don't want any Urban scam real estate uh
urbit great real estate for the
sponsor no no like like I don't know
what I want they launched all this new
stuff we should look at it
together yeah what do I want do you want
to St no I don't want any I don't want
any urbit scam real estate I think you
want a star I don't want any urbit scam
real estate you want a star no ST I
don't I don't know what I want oh I'll
I'll ask if you st I want like like a no
I don't want a star I want something
good and then I'll do a stream show for
herit guys we're getting sponsors right
now this is how sponsor negotiations
work why am I why why is ipai Colonel
seg faulting we got to focus Al like
when I don't Focus I'm sorry then then
they complain and they say George you
didn't do anything all I thought maybe
we could have we you could have a
channel on there but hang out all the
hang out
there streaming soft for yeah yeah yeah
yeah do you want me to give my opinion
of herbit now or when the stream's off
when the stream's off but guys I love
you know you guys know I love Curtis
yarvin and from a political philosophy
perspective stuff works great from a
software engineer ing perspective herbit
makes no fucking sense no you have we
have to check it out um when you look at
the herbit code and the Knox and the
hoons it it looks like you know like
someone was in the 80s and thought that
the 80s was the Pinnacle of programming
technology we're going
on and as an art project Urban is great
urbit stream art project stream
yeah yeah I won seesaw with the help of
Kira I never would have won it without
Kira man my skills are actually in
[Music]
tools are you okay um my I have pie Kel
seg faults like how does this even
happen this is pure python
code but yo boys we can be the one who
fixes the iPie kernel for
everybody all
right what do you think of that we're
going to submit a pull request we're
going to do real software
engineering okay app launch new
instance oh it's CU I did I
python from IPI kernel import kernel app
as app app launch new instance seg
fault all right well we're making
progress all right we can we can give
herbit a chance would you guys like if
we gave herbit a chance on a
stream IP kernel
app launch instance
cannot import IP kernel
app how is python seg
faulting
yeah so what do I call to break it
launch new
instance can I not get IP kernel
app there we go I have IP kernel app
now what
crashes wow this shit uses
zmq oh something like this async iio
patch looks like it's just begging to
crash I don't even know what it is but
doesn't that look like the kind of thing
that just
crashes all right it's like pip develop
[Music]
um oh I think I just did pip Das e so I
think that's actually okay so let's get
the seg fall to
happen
[Music]
uh you guys you know I only know one
programming technique and it's print
debugging
oh it doesn't make it there wait what if
it does make it no all right all right
all right this is good progress I just
move the here around until we let's see
sag fault sag fault all right let's do a
proper binary search have I ever told
you guys that hacking is just binary
searching by
hand all right oh wait that had a here
but the here was down
there
oh yeah okay here down all right
good let's try yo do we get a Yo No we
don't get a yo oh the problem is a knit
IO do we really need
IO still SE faults
okay
um we don't get a yo or a
bob what do you
find oh a Nick Colonel is the problem
the kernel oh n type attribute has no
start okay well it's seg falting in a
nit iio we know that so let's figure out
what a nit iio does and figure out why
it
segals here we
go no not
here all right it makes it there does it
make it here
oh you know someone someday I'll
actually learn how to use a debugger and
not do this but until that day we're
using print statements all
right
outstream Factory breaks in the
outstream factory import item string
outstream class all right let's go let's
look at what that
is
all right ipai kernel IO
stream wow this this is so
bad why does uh why does Z not have
um
is it threads that don't
work we see a create we do see a
create do we see a create to we do see a
create to okay so this seems okay unless
it's here no that's
fine
has someone already fixed this do you
guys in chat are like screaming at me
like how to
like you know not do
this okay outstream Factory is where
it's
broken and we're printing out that class
name it's an
outstream okay so I think we're just
calling this it seems like it returns
okay then how come I don't see
that some people are saying to uninstall
no I don't think it's
zmq yeah should we run it in Kira Kira
will tell us why it's crashing um wait I
don't get it though
like all I'm doing here is
creating that maybe it's crashing
[Music]
later seems
fine probably s faulting in the
thread
um oh some tornado crap
oh what if I
call I think I is not callable what does
this inherit from a text iio base
God you can text with threads they added
that slack feature yeah message that's
pretty cool brother I'm worried about
his Tik Tok us and he
said dude don't use Tik Tok man you're
deeper on at all it's a Chinese just
addicting you to
bullshit Tik Tok Tik Tok is a Chinese
scop
man no I'm sending the laptop back
doesn't run IPython notebooks I'm going
to go tell the Apple story I'm go to The
Genius Bar and going to be like why
doesn't my IPython notebook work you
know and then I'm going to then they're
going to remind me that home brew is not
compatible uh you
know okay it's got to be in this thread
that it's breaking all right all right
all right fine guys we what we have a
debugging python stream
now um okay lldb python
39 first off can I run it no I can't
even run it continue oh if I continue it
okay I
see
continue
okay now we have a back trce look I'm
using a debugger you should all be proud
of
me okay okay okay
okay yeah okay the problem is it's
calling
sterlin
it's literally crashing on a null string
to
[Music]
stirl
God okay
[Music]
um something is passing in a null
pointer to
Sterling
is there any
way eval code is there any way I can
know what code was
running um I don't know frame
n um all right let's Google this it got
to be a tutorial lldb
python no this is the other way
around C lldb extension for debugging
python programs oh now we're
talking oh but it requires it to be
built with debug symbols okay
okay what do we think think this is
going to
work
installation like
that okay Echo command script import
cpython ldb into lb and nit chamod plus
X lb in net okay now now God see like
this is like why does it not do the
different things in the different
screens I get the same up arrow in the
all the screens Z sucks I'm switching to
bash wait module not found no mod module
named scon lb oh that's
great oh cuz it's probably using system
python
okay pip 3 uninstall scyon
lb
now we install
it no module named
pip um okay
well it does look
like ldb and nit is just normal
python
oh no it's not uh command script print
uh cy.
verion invalid command command script
print okay great um lldb python
version
great oh
settings
get settings
read internal
python um settings list oh setting
show no internal python
great I just want to know what python
that is there's like three pythons on
the
system and it could be any of them
for
wow this is terrible do we even think
this is going to
work there is a user bin pip 3 isn't
there or something like
that wait oh that's not a director
okay let's try user
bin pip
three that did not do what I wanted oh
que s it
worked
run o run with that
continue all right now how do I use any
of this
stuff um Pi
BT fingers crossed no python Trace back
oh God that means I have to rebuild
python with debugging
symbols well that was a waste of
time
P um home brew build python
with debugging
symbols oh
yes
no I have to like do some gist
shit through info
python defog
all right all right all right we'll do
it by
hand P object make TP
call where what's calling sterland
anyway is that
in I feel like it's like somewhere like
really
deep sterlin no of course there's no
sterlin there
okay uh
what
lldb select
frame how to select a different frame ah
frame select I knew it was some crap
like that frame select
n okay now we're in pi eval eval code
no this is like a python object
no um ldb print args to
function
uh back
trck
useless um is there a way to get the
python interpreter print out every line
of code it
runs try fault
Handler oo I like this oh yeah all right
good thing I read chat oh you guys Bros
all right cool let's try
that let's also uninstall this
crap delete my lldb in
it what a
disappointment I don't blame the guy who
wrote the package just cuz I didn't
build it with the things and that was
too hard okay uh pip 3 install fault
handler fault Handler a built-in module
wow oh now we're talking oh see I love
that when we learn new stuff like that
all right all right let's go
um okay so what was the thing that
crashed it
again all right let's go over to
fun make there crash go.
um we want to
import IPI
kernel yeah here we
go
sorry I just
forgot all right good we have the S
fault
now
um H sweet oh yeah you are bro fault
Handler guy you're bro I like
you okay the problem is in app
nope current thread most recent call
First app nope is calling begin activity
with
options wow I love fault Handler that's
amazing we got to use that
comma I don't think we have many Native
crashes in the python but it would be so
nice to get that stuff sent back up guys
I'm actually kind of feeling this laptop
I mean the chip is nice I just wish they
could put like you know that chip in a
good laptop and not in something that
cost $1,000 dollar and crap is the pro
better begin activity with
options okay what is appn let's learn
about
appn
oh simple package for disabling
apnap which can be problematic oh we
don't like things that are
problematic well actually better idea
what if I just disable it
here line
91 yeah we don't need
this oh we fixed
it
um let's understand use
appn ah perfect okay now we just need to
check if we're going to all right all
right all all right you ready we're
going to submit a poll request
Quest um
get get reset hard God V Lopes okay get
reset hard
head uh now we're going to edit
this and
um what is it cy.
Arch
or
platform yeah there we
go what is this V crap loose
version platform. MAAC vers
sub2 is not equal to arm
not on
Apple
silicon all right okay we going to have
IPython notebooks now let's
see why is that
crappy
okay can we have
notebook uh fun tiny grad IPython
notebook load
torch Colonel ready oh hell yeah boys we
fixed I python on Silicon Mac and now
we'll just submit this as a p request
I'll have to Fork I python Colonel and
I'll submit it as a p request uh and
I'll do that off stream because I'm not
going to log in with my GitHub but we
fixed oh yeah I'm the first person in
the world to get I pip on notebooks
rning on full silk you think mhm app app
can you guys also file an issue on app
note for
me what now what now now we have
notebook
all right let's write
Cuda has a CPU usage right now so like I
don't know htop wait
oh that is
incredible is the stream been good zero
dropped
frames oh my God this Chip's actually
amazing maybe if we just bought a
MacBook Pro we wouldn't hate it so
much the webcam is kind of okay I think
it was just in l light the speakers the
speakers are really what ruined this
laptop for me we did a test last night
comparing the speakers in this laptop to
my iPhone 11 Pro and my iPhone 11 Pro
sounded better which is just sad like
how does something this big sound better
than
this all right cam quality is great mic
great all right all right maybe I'm just
maybe they'll fix the speakers with the
software update think the pro has better
speakers yeah just they're just
crappy fault Handler you are number one
bro where's fault Handler
bro
well fault Handler bro is
good no fault Handler is included in
Python 3 which is great guys I was wrong
about a few things in my life and one of
them was Python 3 I should have got with
the times I should have realized that it
was the current year and I should not
have shied for python 2 I should have
just been fullon Python 3 and made fun
of python 2 losers that's what I should
have done I did it wrong I made a
mistake but you know I'll admit my
mistakes you got to admit your mistakes
if you don't admit your mistakes they'll
come back and haunt you and you'll make
them again as soon as python 4 happens
I'm going to be the biggest python 4
show real fruit tast
better lemon
spender okay now the stream can begin so
P torch doesn't compile on Mac silicon
on Apple silicon either um there's a
pull request on P torch to fix it so we
could do that or we could just figure
out how to load the thing without torch
which I think is what we really want to
do so the bug way we're going to fix now
is
this my example for tiny grad doesn't
work because it depends on
Torch and torch is not installed on this
computer
so
GNA complain that I can't find that all
right fine um sis. path. P
whoops uh get CWD get
PWD
what oh this is
notebooks
it feels nice it feels
fast it it feels fast in a way that my
uh my my Intel MacBook
doesn't oh no no no no no no no no
no
just look at the speed there a shit I
lost my
work assist. pass.
append I import tiny
grads
save I have hex
stump there got to be a way to run pip
from here can I just do like pip
three install
hexom uh how do I line magic uh my magic
run you guys know it right oh this pound
pep okay
cool love it thanks
boys uh all right who knows what file it
is is it
pickle
oh it's pickle oh that was really
easy
uh I'm want to crash it again I hate
that it can
crash temp I don't really want type
temp it's an
INT how is it an INT what is
it
what I
I it
it never
mind okay well it unpickled to be a
large int
which doesn't really make sense um torch
load let's read the
code
[Music]
oh was a zip
file Legacy
load it's a tar file wait how come
pickle worked
then let's ask file what it
is I had to build wette last night it
took
forever it's
data
I unpickle it and I get a single
integer
is Z
file okay well it's not PK so it's not a
zip
file so we're falling back here to
Legacy
load tar extract file so it is a
tar
um okay let's just try
this um okay
fine embedded null
bite I say I wasn't
right file
LGE file could not be open successfully
F name equals none file object equals
none this say no attribute
tell
um the path name
name t file byes iio someone's
definitely done
this file like object okay I tried
that file could not be opened
successfully mode equals R
maybe no okay so it's probably not it
probably is a uh
pickle okay it is
pickle just for some reason when I
unpickle it all I get is one shitty
integer pickle
tools well I've never seen pickle tools
before that's
cool okay
cool oh there's another pickle right
there look at
that that's another
integer wow it's just pickle caded after
pickle caded after pickle all right
let's pickle tools disc that one
all right we get another
integer oh there's where that one stops
X15 funny attx 15
now oh we're getting
somewhere okay so it's just pickle
what oh wow that's a good question but
we're getting
somewhere endless pickles yo what's that
please do some C+ Plus or a PHP coding
bro you know it's not 2005 anymore
right the world's moving a python python
4 get on board with python 4 or get left
behind scary yeah all right hex 81
what's that hex
89 ah okay we're getting somewhere no
module named torch
okay
well all right we're going to have to
write our own on pick for this crap
which just like on pickle does pickle
tell me how long the thing that was that
was
pickled tools for pickle developers wow
didn't know about
this
um but okay either way that's a we can
fix this with pickle UNP Pickler
class um yeah there's like ways to do
this
we have to override the
unpickle
oh we got to change this to two
tabs
where's
inspect like enable developer or
something here we
go don't make me promise no
promise
yeah that's what we're talking
about have to override a Pickler like
this um here we go yeah pickle. on
Pickler it's called Fine class this is
it all right let's go what is it my
pickle not loads is
it right we're trying to load for
context we're trying to load a torch
model without having to use
torch um can just do this for now blah
BL blah blah blah okay pick find class
okay um it doesn't have any loads
because we have to create that like that
we can say
bytes iio iio this will
workload okay
so we don't have a torch utils rebuild
tsor
to what is
this
wow
now you know what
I'm just going to return fake torch all
the
time what are the odds that they can
collect a load persistent ID instruction
was accounted but no persistent load
function was
specified what's a persistent load
function
wow I don't even know
man one positional argument but two are
given I don't know
self fake torch takes no argument
oh what's a purse
ID why can't I
type
fake torch takes no arguments okay
someone's calling a knit I don't know
how you even knit a torch
but okay it's not
bad what do we get out of temp oh sweet
okay we got all the stuff and they're
just fake
torches
um
okay storage class main fake torch torch
long
storage wait but if I don't have a long
storage how does that
work
don't even understand what persistent
load
is seems pretty good though seems like
we're we're getting the things
out the order dick they're just being
created as fake
torch
um
fake torch
load
zero so this is what we're writing we're
writing fake torch
load uh I really don't want to hand code
that at 89 but we can if we have
to
um these guys can just live
in
here I'm going to get Auto reload
up um Auto reload Auto reload Auto
reload
from Tiny gr not from examples.
efficient net
import fake torch load no it's extra
efficient
net uh unindent doesn't match any outer
indentation level what
what they're
tabs I hate tabs whoever made
tabs you know whoever thought like a tab
was inappropriate like that's a like a
person like we can go find
them you know just like ask them like
like why would you do
this what kind of person are
you
yeah okay good we're making
[Music]
progress all right so what's being
created here a fake torch can I return
something from a
there's like a way to do that right I
just want to get the data out what is
persistent load
anyway Persistence of external
objects oh is this some new thing
I get
it okay I like P ID better that's
nicer so I think if you fix that here we
go um whatever this is I don't exactly
get
it there's got to be like some kind kind
of pointer
right or it's the class being created
and passed into as that argument we can
see what's going on
there
no extra efficient F fake torch load
locals fake
torch
um nit
[Music]
return different
object yeah we got to do new it's
new just do new does that
work
turn
junk still getting fake
torches
you I want to listen to music but you
know that the thing is it's too shitty
speakers nope it's too bad it's
terrible oh look at that now we're
getting junk here oh good okay so that
works I don't know why it's creating
those other things but I don't really
care oh it's the class itself I
see okay so we just have to figure out
how to
[Music]
extract those
strides I mean that's the
shape okay so what what is the argument
to
new
it's
class we should just be able to find
this in P torch
right is it a
tensor no it can't be a
tensor either way the first one is class
let really matters we just do
that all right good that's
progress um what if I return Bob here
are we going to get Bobs in there let's
get Bobs all right good we got Bobs
cool okay
storage we're getting that class P
in then we're getting this number and
then we're getting what's likely to be a
size is that a
size 32 yeah but it probably doesn't
include a
type yeah so
here we get these float storage in
here
those are never called what I need
them guess I
don't what was calling
them oh what is in
here do I need
that okay that looks like it's never
called either there that's
concerning wait so do I not need torch
you tills
[Music]
anymore let's do
that so it is create it is it is
retrieving float storage and long
storage from the class I just don't
actually need
them because they're not even getting
called probably because my persistent
load is
broken these have to be pointers of some
sort like that includes like a type and
an offset
Storage storage
offset
no okay you know
what um
trying to call anything on fake
tenser
no all right you know what let's the
torch code there's got to be code for
this persistent load crap here we
go persistent ID
h ah okay so this is the arguments we're
getting uh
storage yeah perfect okay P
ID uh let's just call it
ident ident storage type OB key
location OB size equals P
ID
then uh Ser ident equals
storage too many values to unpack
expected
five one
two three four five six oh there's six
where did six come from oh view metadata
oops I missed
one
okay so storage type ah I get
it storage type is probably actually
that fake tensor
thing
um float
tensor yeah OB key is the interesting
thing here so let's see what this
is do c
data
what do we got it chat stream time any
mods that can help or Bots who's a
problem
you guys calling
problems myths thank you for
subscribing Chad is okay that's good all
right good because if anyone's
misbehaving the banhammer comes
down
um right so the thing that we have to
understand is how these object keys are
coming from
the doc say the persistent should only
return a string but it actually
returns what's the C
data
this is probably so python 38 added this
new way to like access memory and this
is probably just that before
that these numbers are huge
though
oh okay well I should do
this
ah okay so that's now a float storage
good good
good long
storage um actually think I can do
better here touch this
w
this is for me yeah oh I don't know how
I feel I know too itchy a little
itchy I mean I can try I don't really
like the sweatpants I have now you what
I don't really like sweatpants I have
now you want more of those no no I don't
really like them I don't know these the
ones I'm wearing now are
like okay so now it just returns I say
so we don't have to need these stupid
classes we're just returning the name
and now it calls it a float store
that don't PR
that oh well actually that's only
because that's
returning uh let's just the op key so we
can get like
something yeah look we got an object key
there
um got an object key you know what what
if I return
ID my is not
defined all right good so now we've
moved this all into my fake torch class
and we shouldn't really call it fake
torch oh they're nice
yeah um we should call it uh
tensor we'll call it hack tensor hack
tensor all
right we have to figure out how to turn
those into
um let's let's pickle tools
that
yeah so it's still only
here you like my
sweatpants
oh look at that look at that that's a
number look at that number oh we got
it
okay
so again we have to figure out how to
get like the length of
pickles um maybe it's in pickle
tools
this because it just seems like these
things are concatenated
together oh there's another pickle
starting right
there why am I not surprised by
that
H okay this looks like a mapping
from these stupid
numbers to
this uh pickle. loads
that okay well at least we know what
number it is now now we need to add that
to this
again
what's it
61900 is that just the data
now
This is complicated High torch made a
very complicated storage
format done right we should refactor
it why you guys typing
numbers how many viewers do I have we
got a lot of
viewers 819 viewers that's pretty
good 820 that a nice
chip I was reading the colonel this
morning we got to bump the priority of
the kgssl work cues because the kgssl
work cues now have lower have worse
priority lower higher priority it's so
confusing but they have lower have worse
priority than model d means the things
that uses the GPU has lower prior has
higher priority than the kernel threads
that feed the GPU so we got
a yo what R Rue gave geta you talk about
Kira again
you get the
axe no they get the axe I named it for
my seventh grade
crush
K I'm not going to give I was going to
give her full name but that's terrible
she has a nice life now she works at
some thing in New
York um could someone throw the load out
on how much better the M1 chip is well
you've just seen me stream on it for a
while this computer is a little bit warm
and it has had no fan
no fuck the Oculus I hate that
thing like this MacBook I'm debating
returning the Oculus obset me so much I
can't even return it why you can't
return it I'll return it for you I don't
want to talk it just upsets
me I'll return it no I'll keep it and
hopefully someone makes a good jailbreak
for it but I can't bring myself to do it
like this neural engine I love this you
know what like despite this computer's
very inferior
speakers you know it's it's
golden this chip is legitimately nice
Apple didn't do anything to piss me off
like Oculus it's very pink in the day
what my pink computer yeah yeah very
well we need three nanometer that's
right that's right come on keep
investing money you know what you know
why we can't return this laptop why not
because we want Apple we want to do
everything we can to make this product a
huge success so they build the
M2 of course like we have to remember
what a gift it is that Apple gives us
this wonderful chip even though they did
put shitty speakers in this computer I
do agree I
agree yeah even if I buy it and don't
use it I've supported
Apple I've voted with my dollars I
didn't vote in the president shit but I
did vote with my dollars for the M1 chip
I love the M1 chip guys no I'm I'm so
impressed by this
chip
um I'll send Tim Cook a supportive
email all right but a few things one
better speakers two I do not need this
much battery please make it a little bit
lighter I know that's rare of me to ask
and three please make the screen go
closer to the borders like why is there
a big black bezel around the screen does
Apple know it's the current year it's
the bezel at the top is disgusting like
look at the size of this top bezel why
would why would they do really big why
would they do that it's offensive like
why there's this cheaper something was
it cheaper to make that no way you
should see you know oh I can't talk
about it you know look how you put an
LCD on a device we're showing them how
to do it you know what I'm saying you
don't want any dead pixels you
know you tell them
George how's the GPU I don't know we're
trying to run stuff on the GPU but we
haven't been able to we can look at C
info and see what it
says this torch file format is so
complex
um okay I mean these do look like
floating Point
numbers they do look like they're in
order no not really it's not in order
never mind
oh I mean maybe okay so maybe this is a
length no one is not a
length maybe this is a header and 1 C is
a
length now that's seems somewhat
plausible uh we want to add hex 18 for
the header so at 88 we expect to see
something oh that's okay
okay so this is a
header this length is 1
C this does give me the stop pickle code
if I go back one right so stop pickle is
is 2C yeah 2 is period got to know your
a chart
boys
um so there's one C of
those is there F0 or the next
one uh zero is
long
well for once it's not pickle at
least yeah and then this is
that okay so this header must mean float
tensors okay
let's write this let's go stop. on uh so
let's just say uh we'll call it pars
torch
footer call it X um struck.
unpack
QQ x.
read
iio byes
[Music]
iio I watched a Taylor Swift documentary
yesterday it was sad poor
Taylor what
what about Taylor so she's laughing all
the way the
bank I don't think Taylor's money buys
her
anything she's very relationship is she
good for
Taylor um
briefly they said she was very
happy but like who
knows I think we know she
was well that's actually yeah maybe
that's why folklore
[Music]
sucked that's
true oh not time 8 time four cuz it's a
float got a
float
um
why did it give me one
there oh oh that's zero I get
it
okay um
no so if x.t oh the next one is zero
okay so I want to subtract eight
here
one
zero can I link the torch model file
yeah guys want to figure out how to
parse this format faster than me fake
torch
[Music]
okay it seems like starting there we're
back to
stuff back to this file format what's
like
boys money doesn't buy you
anything
laptops Taylor Swift is sad and
miserable you could saved her what I
could have saved
Taylor yeah
well
how do I get this DPI screen
resolution can you explain to the noob
what I'm
doing me no not you you know how you
talk to your phone yeah I talk to the
twitch yeah those are nice pants
I
little oh these ones are just oh there's
nothing special about that I get it the
ones are just
uh the length I
think and then it like pads It
Off
do I have to know if their floats before
I decode them or something that's
probably the
problem yeah okay so that's a
long uh I really might have to know
that I mean that would be insane but you
know it wouldn't surprise
me like why do they not give me an index
into this
file no I guess there's just no
index wow
okay
um okay so we can load these
in uh let's put this up here call it
lookup equals pick a load that uh wait
what were those things called like key
look up
right then my hack tensors
up
here uh we can do this here assert item
to storage that should work okay right
okay cool um now um print OB
key okay uh print
um key look up .
index I love python oh that's so
pleasant okay good okay so that works
now and now we're getting the first one
is a long
storage long storage basket why don't
you buy things please
buy do you buy if you don't buy you
should
buy um just Google super shitty
results
it just just an
ad no you know what I mean like I type
in long storage it's very clearly a
thing and it's like why don't you buy a
long basket we get kickbacks from the
long basket
company all right there has to be a
better way to do this like I okay now I
see how to write
this
but the problem is we wouldn't figure it
out
until after like we could construct
pretty easily now the
um like the right lookup table to par
set
really maybe it's at the maybe there's
like a thing at the end of the
file
this file format is so
bad I wrote something similar called
super pickle and it's much nicer and
torted switch to
it I should open source super pickle use
it a comma it's pickle that doesn't
involve copies built-in compression
super fast lz4hc
super pickle I what super pickle comma
it's nice
we can over to our
super oh no that's not true just super
pickle many things I write are
bad is is th is nice conceptually the
implement the code is kind of
crap the needs open source if you want
to read
it
okay be input what's be
input what are you going to try to sell
me no I mean I really think this might
just be
it all right so
maybe the problem is they're all out of
order and I don't really have a good way
without knowing the lengths to parse
through that
file unless the ID has some semantic
meaning that I don't
understand which it
might see if these numbers are like
within a
reasonable no that's unreasonably huge
it's 44
gabt so you guys see the file format
down here and it's
like okay I mean I could parse this if I
knew this was a
long but I don't know it's a as the
problem and this size is not the true
size it's just the size in in whatever
the type is and the type's not in coded
in this part of the
file there has to be a better way to do
this like you see how you could you
could parse it now but you need to
passes through the
thing maybe it like loads it late like
late binds the tensors or
something um because we could create the
buffer from
here
and we could create the buffer with just
this okay well we can do this now um np.
array or we'll say np.
z um Bob
size
uh if name equals float
storage return NP 32 if name equals long
storage return np.
N64
what did my auto reload not
work why does that say float storage and
long storage I got rid of that
crap
oh okay good uh np0 object size d type
equals storage
type call that
R now when we scroll down down here to
what we actually returned we have to
return we can't return junk
anymore all right cool look we got
zeros a lot of
zeros then actually some ways it's not
really enough zeros at
[Music]
all oh no but okay the big ones are
contracted so that's right um we have
other problems here so
I don't know what this
is I worry that those are strides and
that's how things are
stored um this does kind of feel like a
later problem
though uh return rep. reshape um
012 AR sub
to yo can we listen to Taylor Swift on
stream is that
allowed or is Taylor's copyright please
going to come for
me oh no what if we watch covers of
Taylor Swift songs is that
allowed
no okay I know what we're going to
do we're going to create a yeah yeah I
got it I got it I got it I got it I got
it okay
key
real
equals
non uh
times length of key look up okay so
we're going to
say key sub key lookup index equals
uh we're going to say storage
type we're going to
say object no we don't need object
key um just storage type and object size
should actually be enough oh we also
need red okay
good
um return key reel here we don't
actually need to all this isn't too bad
actually I see how it
lebins uh we say R1
R2
R2 should not have any
good okay and now we just have to
iterate
through these guys
uh data
um
for storage size arm size rat
in uh
key
print storage
size okay good so now we have them all
in
order now if we hex dump
this
I'll come to work after stream what I'll
come to work after stream I'm some
painting
um extract. unpack Q data
read8 call this
LL um
seert
LL
equals
obiz uh data.
read l l times
uh can is there a way to like get the
real length of like if I do like np. 32
or NP is not
found
okay
p uh
size that
work uh can I create that
dictionary a valid dictionary great uh
np. into
eight sub storage
type who thinks that
works great it works okay cool uh we
just say r. data equals or that data
that equals
cool memory assignment L value and R
value have different
structures
what
my
that oh
well um
um
r. rehap minus one. data equals my
DOT is that
right memory view assignment L value and
R value have different
structures red.
data Red Data land
my
I don't understand why that's
one why is length of red. data one
shouldn't be
right data should be the underlying
memory and it's an N64 so why is it one
do memory views have uh
types
I guess they
do uh do
cast every time I get rid of something I
forget about it super quickly because I
didn't need that crap to begin
with yeah except for when I give you
stuff you're so happy I have Alex but
like you
know then you just have lots of
stuff I don't have that muchu
mhm and Ted bunny didn't kill that many
people
um all right what have I just do
this equals np. array
my. uh storage
type invalid literal for INT with base
10 uh no np. from
buffer
perfect
actual
data all right all right
boys okay so uh what are the odds this
works
now numpy ND has no attribute items it
shouldn't return an ump
ND should turn a
dictionary okay I have no idea why
that's oh because I called it rat
oops
uh okay we are loading from pytorch
let's see if it works it's not going to
but numpy and Dr object has no attribute
numpy oh well that's
fine we actually don't even need I can
just say vnp now don't need that
line no module named
p uh
um
all right no module named pill pip
install pill I got spall pillow is it
pillow I'm going to regret that
already
great um python install
pill okay here we go pill oh pillow with
a capital P
great does not work okay yeah please
follow the instructions at
here computers are hard
uh
sure do green
teas
um lip Tiff lip jpeg what's little
cms2 color management
engine all right what do we
got you know a lot
management what's color management
something's wrong with my computer the
screen makes the Grays really cool so I
went to color management and I couldn't
find one oh I don't do you have do you
have true tone
on on the ma desktop yeah they have true
tone yeah I don't know Chris and I both
have the same color management and we
both have different colors on our screen
well I I actually very good about this
about those scre so that's why I was
surprised yeah I mean a lot of screens
are so bad I know even those D screens
are supposed to be professional screens
the colors don't match
yeah
I have a theory what your What If
instead of calling pickle load s i just
call Pickle load on the same file object
multiple times will I get multiple
pickles oh that would be sick if that
was true then I can really refactor that
code to be
nice um let's try
it so iio byes
iio b0 we'll call it
fb0 frame Brer zero
oops um it's not what I want so now if I
say pickle. load
fb0 great
I'm adding all this scrap top here so I
don't have to type this
again oh
yes
wait okay
good instead of putting in all those
stupid uh things I can just say
pickle oh
well it's a little bit annoying because
I can't get key look
up till
after think that's
okay okay it's going to require a minor
refactor um
I
one two three pieces of
junk junk
pickles uh we'll have to wait on this
then um key pre look up
equals
dictionary say key pre lookup
equals key pre lookup sub object key
equals storage type object Type R
okay now we just need to say my pickle
fp0
load um
key look up equals pickle load
b0 and then instead of data. read we
just say fb0
here okay
for KV
in
key prel look up.
items now we say
here create key
lookup we just say key re sub key
lookup. index k equals V yeah that
should create
it move that up to
here should work
file must have read and read line
attributes yes that's right because it's
an fb0 it's not b
z
great oh I'm pretty happy with that now
okay never mind it wasn't nearly as bad
as I thought it was as a file
format
okay so it doesn't work it thinks it's a
palace with very high probability but
that's probably just cuz we didn't get
those uh Swizzles right we didn't get
those strides correct so we have to
figure out how to create a numpy object
with stupid
strides okay CH in case you want
something
else double
fting
my all right what what's chat saying
fault fault what was that thing called
fault python
fault fault Handler oh fault Handler bro
is number one
bro
so three million keystrokes no I'm not
going to return
it
[Music]
um wait it has a trash
mic
oh
yeah yeah doctor
no Mike is too loud on typing oh
well all right should I type quietly all
right we'll type quietly oh look at that
Pleasant typing quietly no it's so much
better to smash the keys let the keys
know who's boss you know like
[Laughter]
pizaro number one
bro okay so take a look here and see the
messed up
strides um we should be able to fix this
with numpy from buffer I
believe
ident storage type hob
key location opiz view metadata no
that's not right okay so this is
[Music]
that storage type OB size NP
size NP
stried can I specify a stride and NP FR
buffer count
offset
oh I can say shape equals let's try
that
um n p. shape equals NP oh I shouldn't
call it size I should call it
shape okay same problem but what if I
say np.
stride odds that work
no attributes stride never mind a
numpy array sets
dride yeah so these are all the
problematic
ones npay strides oh strides okay um
let's print NPR array.
strides let's call it strides let's keep
the names consistent
um okay so we're getting fours in
there I guess torch has different
strides
[Music]
okay wonder why that one's
1280 oh those are all four I get
it
map
okay M r. strides equals real strides
what do we
think hen boom Oh that was so satisfying
oh that was really satisfying
boom it works and by the way that's on
the CPU can we talk about how that is
way faster than my uh my 16-in
MacBook
oh oh that was
satisfying how cute is that how many
lines is that all
right hold torch files without
torch all right when we're off stream
we'll have
to oh committer Taylor Swift I'm going
to get sued
Man Taylor Swift committing to GitHub
um but yeah whenever I'm working on
small it's going to be uh the committer
is going to be Taylor
Swift all right uh let's make it work on
the GPU too boom look at
that no GPU support install Pi open C
but I did install Pi open CL did I
not
three oh yeah no Pi openen seal doesn't
work I remember this drama from last
night all right
um now let's see how the npu works we
fixed the seg fault a long time
ago uh we now have the efficient net
doing inference oh actually we should be
able to run it with webcam too should
work no moding fucking c h install CV2 I
don't have high hopes for this
one open CV python I do not have high
hopes for this
one oh it's 89 megabytes I really don't
have high hopes you think that's going
to
compile oh it has dependencies oh this
is never going to
work I don't know CV2 is on version 4
now so we're not going to judge that
hard but back in the day it was some of
the crappiest code like people thought
computer vision was crappy but it was
actually just open CV that was crappy
like mat lab had really nice
uh abstractions and stuff
does Python compile to binaries well no
but does python call binaries
yes I Julia is python no guys python is
the future The Whole World's moving to
Python and
C++ C++ isn't going away C is though
finally C++ doesn't suck just the STL
does oh and the fact that the
comp wait
what it's trying to install its own
numpy I already have numpy it needs its
own special
numai of course it needs its own special
numpy all right all right all right all
right should we try to fix
this un official
God this is never going to
work
GitHub build open CV
python oh great oh good let me use this
let me use this
convenient
bullshit all right well the webcam
Edition uh does not work
but it does
work on pictures of chickens and not on
the
GPU so just like the rest of Mac silicon
things kind of work but that is enough
actually to start playing with the
mpu take a
screenshot good
point all right
so let's say we want to do what do we
want to do inference on what worked well
last
time a
remote okay so First We Take
remote then what's the shortcut key
that okay we take a
screenshot there we
go
now remote control look at that yeah
that was super convenient that was the
easiest library ever to use just proof
that we're not faking anything guys you
know you know it's not fake you know
it's not fake right here on geohot
Twitch stream nothing's fake
here that was a live picture just taken
yeah all
right um now do it 30 times a second
yeah well it's what well 30 times a
second is a little fast but uh all right
let's try to build let's fix why GPU
doesn't
work no GPU support install Pi open C so
I started playing with this last night
Pi open
CL um pip install d e dot pip three
install d e
dot but now we know about fault shit or
whatever fault
Handler um I would also like to point
out that that ran in
about it's probably similar time I guess
on
my Don't Spray pain inside you'll regret
it it's like smoking weave inside but
worse cuz it smells like spray paint
instead of
weed this virtualization work I mean we
were going to we can play with that um I
was looking at the hypervisor API last
night I installed
xcode okay yeah so this is the
problem um this is being built with the
wrong
architecture so pip 3 uninstall Pi open
CL um
debug DV yeah here we
go okay so is it actually compiling
anything or is there just an so file
baked into this
crap it built it get clean
xdf yeah okay so it is building here
it's just I think giving it the wrong
Arch yeah Arch x86 64 okay here's
another project we can
fix all right here we
go
Arch arm
64 what do we think is that going to
work uh get clean-
xdf that doesn't change my yeah okay
that's good all right now we built it
for R 64 too let's
go I'm not sure if it's AR 64 I think
it's actually arm64 but I might be wrong
about that if this doesn't work we can
try AR
64 your Docker doesn't work that's right
how much money did you contribute to
Docker zero then why do you expect it to
work I'll only do a smash 64 stream oh
it Imports sweet is GPU going to
work oh wait it was just slow The First
Time Boom GPU 35 second okay it's not as
good as the GPU on my it's not as good
as the AMD GPU on my good thing on my on
my big MacBook boom that was so easy
that was so easy yo all right we got to
we got to commit that Upstream to to
open CL I'll I'll do this all off stream
GitHub sorry I'm not logged into my
GitHub and I have to Fork the projects
and stuff yeah it would have taken you 3
hours to debug yeah well you know try
doing it and then the first time it's
going to take you 3 hours and the next
time it's going to take you an hour and
then the next time it's going to take
you 10 minutes and then you get down to
10 seconds you know you just got to keep
doing it want to be a good programmer do
it for 20 years you want a faster way to
be a good programmer get ripped
off
all right so we have GPU now all we need
is NP equals 1 let's just try it maybe
it'll
work no that used the
CPU yeah the other GPU was
better all right guys I'll tell you the
truth um there was the 8 core GPU and
the seven core GPU and I was I cheaped
out and we only have a seven core GPU so
um you know it's such an upsetting
number too it's like
seven thank you Apple by the way for
keeping open CL do not abandon open CL
nobody's using metal please keep
opencl please Apple I don't know why
people aren't more fans of opencl like
why do none of these libraries use
opencl okay we have a working GPU on
Tiny grad is amazing like it has like no
dependencies now it doesn't even depend
on on on Torch sadly it depends on CV2
to get the
webcam
uh well yeah no it's probably cuz the
core is broke it's it's not
software the chips are
bended the tests depend on Torch I know
they shouldn't all we should be able to
refactor it so some of the tests don't
depend on Torch and we can use grad
check
seven is a beautiful prime number
oh
what's my GPU has seven cores I cheaped
out and I bought the seven core GPU
embarass I mean it just it kind of like
it just upsets me like I almost paid the
extra $200 just so I wouldn't be upset
with a s core
GPU sometimes are not
rich but like I'm not really like like
the price per core that like doesn't
make sense like last night when we were
at Pinkberry and it was a doll more for
eight more ounces of smoothie from 5.49
you had to get the large smoth I saw
what you did there but when you add up
the course it's not worth
it it's always been like it's
$1,000 like
this ridiculous you got to bend those
five M 5 NM tsmc dies by the way can we
all give our thank you to tsmc for
making five nanometer can we give our
thank you to tsmc for building a nice
fab right here in the
USFA um it's good insurance against you
know you
know yeah Chinese invasion of Taiwan
over
tsmc um it actually turns out that tsmc
is just kind of it's really all asml
apparently who like builds all this
stuff
um yeah but apparently like doesn't make
Huawei chips anymore taiwan's just like
they don't really pay us it's Apple that
pays US
money when's Apple going to make
Fabs Now tsmc isn't messing
up wait have you heard the M2 is 3
nanometer have you seen an
M2 I know in videos on Samsung 8 nomer
but that's a huge chip the yields are
probably way too low uh the n the a100
is on tsmc
um I
know
awesome second half of
2022 that means Apple's going to get
it uh it's a little late
yeah seems right on par with Mor's
law oh yeah well Intel's still back in
[Laughter]
2014 that's where Intel is that's where
Samsung is that's where tsmc
is
five NM
chips yeah 14 NM with seven pluses
yeah apparently they backported like ice
Lake 14 they're such
Jokers does anyone hold any like how is
their stock not plummeted so much harder
by the way scr suggested Yahoo finance
so I've been using
y why are my ads not blocked
better all right there stock starting to
plummet I should have bought Apple when
I heard about Apple
silicon yes G's in jail but his Finance
lecture streams live
on I'm not making a Wiki for noobs you
guys there's so much good content out
there didn't you see Lex talk about that
anything I just like anything I tell
them is like not going to be as good as
what they can just find with
Google about what like how to get
started with programming and machine
learning or anything it's been a long
time since you got started
with let's invest in Intel let's let's
let's let's keep the bubble going let's
all be Intel
shills talk about how 14 nanometer how
any less nanometer might open black
holes like the large adron
[Laughter]
collider all right all right all right
should we work on the neural engine yeah
let's do it let's do
it um okay I committed so at least I can
push
[Music]
that good Tor Swift torch miles without
torch how do I get started with football
that's a good
question
one
jar
step one be the son of Archie Manning
it's a good way to get started with
football
okay I don't know I feel like we already
did a lot today we can look a little
into the into the neural engine so first
off I'm shocked that like nobody knows
anything about the neural
engine
um something called like a swift
playground
right
H wait Swift playgrounds run on
iPad oh I have to download it from
the the App
Store now it's going to be like you
didn't sign in with your Apple
account Swift
notebook oh yeah Swift Jupiter here we
go this is a Jupiter kernel for
Swift this does not look well
supported I was doing this last night I
was just like running
Swift
because someone's using it to mine
[Music]
Bitcoins why is this related to tensor
flow I never want to see oh
here wait lldb Python 3 support
other operating systems may work but you
have to build Swift for is there like a
nice Swift like Swift
playground no this is designed to like
make people like learn to
code go learn Swift you know what for
all you noobs go do Swift playgrounds
you'll probably learn something Jupiter
Swift Ma here we
go this crap
again I'll try
it what's an requirements anything
offensive no why would I possibly create
a virtual end for
that
pandas pandas Panda pandas
pandas oh my God I have to pass in the
Swift tool chain
directory oh yeah remember when fast AI
said they were going to you know switch
everything to Swift I think that's
actually a stupider idea than
masks um
getting
hungry what you want to
do wait oh my God it depends on numpy it
depends on some weird version of
numpy can I tell it like don't upgrade
numai it's going to try to upgrade npie
isn't
it I had to build did I build NP from
Source I think I had
to yeah I had to build npire from source
and that's why it's upset with me it's
going to like try to fail and build npie
again
well why am I dealing with swift so I
can use
corl see
like I I I genuinely am sorry for anyone
learning programming and they have to
like look at
this right like no offense to Ray wender
Lynch but like this is a nightmare
you're learning programming all the
wrong way if you do things like this all
you're learning is like shitty recipes
you
know so I am sorry to anyone who has to
learn programming like that or anyone
who thinks you know this is good xcode
file new playground okay let's go xcode
file new playground oh sweet oh this is
exactly what I wanted thank you you guys
are Bros too I like
you
oh good yes yes yes this is exactly what
I
wanted uh 2 plus two
run run run what do I get
four oh here four oh that's nice oh this
pretty nice zoom in a little bit oh dude
this is nice all right good this is
better than a notebook this is what I
wanted this the numpy Apple uses for
tensor flow yeah but I think that numpy
actually is isn't even using so I was
looking that up last night and it's
called an mlc tensor or something like
that yeah it's this ml compute framework
and it appears to not even work on the
neural
engine um so we want to use
corl so my good
laptop give me a
line pres
again Biden made long
lines he already off to a p
[Music]
store
do you believe vaccines work who ban
that guy you can got the vaccine of
course vaccines don't work man they're
part of a government s up don't you
watch Alex
[Laughter]
Jones you don't get this
vac why you got paid
$100 every time he goes dude like yeah
how much is my health worth I don't
know
100 bucks pretty good yeah 100 bucks is
pretty good I'd try some new covid
vaccine think of the lawsuits if it
messes me up I know you know you just
got to think about whether a vaccine is
for you that's the beauty of
postmodernism you can have your own
truth that's the beauty of vaccines you
know if you think they work get a
vaccine if you don't think they work
don't get a vaccine and anybody who
reads about how everyone has to get a
vaccine they
suck cuz they're trying to control
people can't have that it's the current
year I
yeah
oh um crack Shack
chicken yes go
ahead oh yeah okay so let's you want to
try these mlc
tensor we'll see if it's using the
GPU I created one of these on like uh
create ml what is this lame
stuff framework
reference this is core mL no there's
like another one it's called like ml
compute
Apple mlc tensor this is it
yeah uh
[Music]
so
I knew it was an mlc tensor like how
come would I Google that it didn't
work
no I have to like import
something
it's clear to me oh here we go wait what
but where's the
Imports
no I did it last night I had to like
import something it's possible it's
still in the
buffer Ah that's it import ml compute
yes can I find mlc device and
scope oh okay now I found it good oh you
know what is Martin Luther King
dayer oh I was
close if anyone ever asked me that I
would just say Martin Luther King
Day whoa Halloween in
January yeah man I celebrated Fourth of
July no exact matches and call to
initializer oh with this shape so is not
a tuple I don't know any
Swift oh we're going to give it off more
shape that
work oh good okay I got a tensor so
we'll call it
tensor all right cannot find tensor in
scope I got to make it a VAR tensor plus
tensor that
work oh yes oh yes oh yes error error
referencing operator function on Range
replaceable connect you know what's
replaceable mlc tensors with something
that doesn't
suck Apple you know what Apple should
give up on Swift and give up one
Objective C and just make
python that'd be the most pro move if
Apple just started coding everything in
Python and made python
fast no python Facebook just embraced
PHP the amount of effort that went into
a Facebook
uh i' make a good mob boss thank you
I've been watching The Sopranos learning
from the
best Julia basically python but fast no
it's not I want python
fast yeah jul is a language that nobody
uses
what talking myself
oh what your what what' you say to
yourself for me and myself George
oh God I don't care if it's an NS object
that's so
useless oh here we go device uh tensor
do
device can I figure out where my device
nil can I set the device can is there
any way this is actually going to work
with the neural
engine data
type fill with dat
copy data from device
[Music]
memory find and write
data to mlc device
okay mlc device enum
okay so you see this is the problem all
we have is any CPU and
GPU I I agree this documentation is shit
this is why nobody's going to use this
this API apple and this is why nobody
wants
metal everything is an NS object no
python
like apple thinks this is good
documentation and it's like thorough but
it's terrible and
useless obtaining a core ml
model view model oh here we go how do I
load the mnus classifier
model ml
model okay well mlc tensor sucks so
maybe um how I comment is that a comment
in
Swift
good uh corl example
Swift all right all
right oh well I just have to make a VN
core let me put it in the dispatch CU
with a Q what this is so
bad
1% of the population is smart enough
to corl
sample Vision
sample oh why don't I just look at the
view
control dude this is more lines of code
than tiny
grad
okay first let me do forever to just set
up
the okay VAR model equals VN core ml
model okay cannot find VN core ml model
in
[Laughter]
scope
container corl model on which it's
based
I have to import something for this
don't
I God why did they put the button there
it should have been on the other
side
what are the odds this is going to
build you know xcode has a 3.3 star
rating oh great it runs on a fake iPod
Touch oh yes let me wait for the fake
iPod Touch to
boot this is
terrible
oh here we go import core ml that's all
I
wanted probably have to import Vision
too why is it just called
Vision so I create my
model cannot find resnet 50 well that's
fine I don't blame you for
that what is that going to open
in
to ml model oh here we
go oh this is pretty
nice create en encryption key to encrypt
your model this key will be managed by
a I'm I'm closing this fake iPod touch
that was
terrible yeah yeah you think that works
if if I pass in the
directory import cor ml tools as CT oh
now we're
talking is that in
Python oh yeah python now that's a
language for
Bros sorry Chris latner but Swift is not
a language for
Bros not a language for Bros Swift is a
language for professional software
engineers and you know we we we are row
here on this channel and that's why we
don't use
Swift yeah okay import core ml tools all
right all right all right now we're
getting
somewhere pip three install
corals
what oh
no oh no it needs scipi what are the
odds that four trans going to
work you know how I knew we were getting
somewhere oh
God yeah okay so scipi has the same
shitty is it trying to build numpy just
trying to build numpy can I just tell it
please never build
numpy let's try to put
s pip install no
depths pip has a no dependency switch
that seems like something Bros would
use let's
go no depth
corals good now we're getting
somewhere core ml Tools
load
no module named
Google no I think we need some
dependencies definitely don't need
scipi adder or
Proto
that's
fine we have Proto
Buff's Adder which is not installed
let's try
Adder now we need
Senpai fingers crossed for Senpai MP
maath
Senpai all right all right all right
this is progress now just scipi
maybe it doesn't actually need
scipi it needs
scipi uh pip 3 installs scipi with no
depths why does it need scipi because
somebody probably didn't rewrite the one
function that
requ
python setup
install you know what it would be even
more cute it's chicken sandwich from
crackjack
oh my numpy works fine scon isn't
installed P3 install SciFi all right all
right all right we'll get it installed
right now we have scon oh yeah now we're
talking do I want what want here I mean
be yeah I to order
it crack Shack on new
breath oh hell
yeah chicken sandwich from from crack
Shack oh no
Bloss oh I have to install Bloss
wow
great what
is
[Music]
Bloss open Bloss
Brew brew install open Bloss what do we
think wow numai was using slow oh no
it's going to install gimpy gimpy's
okay is the M1 a game changer oh scipi
kills the camera wait you guys are
seeing camera lag oh that makes me sad
I'm turning this microphone down a
little it's a little
loud it says zero frames dropped is that
a
lie no well so our goal if we can get
KML to actually predict on the neural
engine we can we can uh we can s trce it
and we can see how it's actually talking
to the konel unfortunately it's the max
konel so it's probably using like some
IO kit and I don't know about that man I
don't think we can diverse engineer IO
kit I think then Apple just beats
us but if they're using
files Apple doesn't use
files you are being trolled by
twitch wait my computer was lagging my
M1 processor was lagging I thought this
processor was a fast F processor in the
world
Apple wait you're telling me that frames
were dropping yet right here it tells me
no frames are
dropping that's
lame you need to see the Apple colel
interaction the normal classifier
wouldn't
work
um well all right let's just start
reading corl tools actually maybe we can
just read
it a normal one with no
male well they only have weird chicken
sandwiches oh never mind I
chicken
why would they do
this
seem
it's compiling
boys
yeah it's me very mediocre
place all right maybe
compile oh it's still
compiling stra is a chicken
sandwich Carl Strauss is a chicken
sandwich does
it grilled chicken breast oh no no no I
don't want a grilled chicken breast I
want like a crunchy chicken sandwich
like Popeyes I heard someone got killed
over a popey's chicken sandwich that's
how good it
is
rumors that rumor is probably started by
popey all right let's just read this
code just figure out how it
works when we read code we use VSS
code now unfortunately I tried to get
Visual Studio code to build but it's
using the transpiler crap and it's
slow yeah I was reading I was reading
the Android kernel this
morning we have some we have some
priority
issues it's slow don't be slow did
someone get VSS code to build
popey himself
wow he killed someone over a chicken
sandwich okay here's the predict
function I mean it's it's just using
corl it looks
like
Chick-fil-A I have Chick-fil-A yeah love
chickfly is Apples silicon ready.com oh
nice it's actually TB
girl oh wow this is super
nice Rosetta 2 I don't want anything in
rosett what
no Rosetta 2 is
bad vs code crash is
reported oh you can download the
experimental one
oh
cool let's upgrade my vs code to not be
slow you guys saw how slow it was let's
let's see if this one's not
slow what's the LSP
crap so not g to move to the application
folder for
me link runs from there oh that's
faster
oh that's a lot faster oh all right cool
love
it thank
you oh that's so much much
faster except that it
crashes
no
no okay well that website was very
accurate there are
crashes it's so slow
though oh it's so painful this is
painful
well it will be
fast
okay so yeah oh wait that's boring okay
how do we talk to the neural engine is
it the
device how do Apple like talk to their
GPU it's probably all to IO
kit
this computer's getting slow oh it's cuz
it's building
things it's building GCC right
now hey Vim is always ready man vimm's
been ready since the
70s
I don't want to do that no no no no
oops oh there that
goes
how many people are
watching no frame drops while building
GCC that's good wow 912 viewers all
right we got we got we got to stream
good 404 page not
found
all right so this is Building open blast
so we can finally install scipi so corl
tools will
work if we just import only some of corl
tools it
works
Chick-fil-A what's
cesarina I'm concerned it sounds like a
salad I don't want anything fancy I just
want chicken
sandwich got my tongue on right
now
you know only fancy Assie places have
lemon R
anything oh
oh we're getting popy
eyes no
mayo I get some pop fries too po
fries does that includ chicken sandwich
sandwiches wait are you
serious chicken it would be a great
chicken to start with but
four cools with no cooling is it
lagging you think you'd have enough
Hardware to have one machine stream
while the other compiles yeah but how
would I stream
[Music]
the oh you know what I think is
happening I don't actually think it's
the CPU I think it's the
ram I only have 8 GB
oh
noicy
[Music]
CH regular
chicken is it building x86
64 all right well open blast didn't work
what about Atlas
that one doesn't
work Bloss or
laac maybe laac through install
laac oh la
Pac don't require GCC don't require GCC
it requires GCC
why can't you build on
chrome doesn't let you say no mayo at
all
popey's chicken
sandwich oh God that's
terrible free
dasm I didn't what is free
dasm wait
really that's so
sad oh no my screenshots gone I deleted
my
screenshot
did I really yes I
did oh
good okay I know what we're going to
do pip uninstall core ml
tools pip 3 install d e
dot oh no no no no no no depths my new
favorite flag all right cool now it's
installed now what happens if we try to
import it
my why
not
what oh I guess reading wasn't required
at popey's uh I guess you don't have to
be able to read to work at
popey's no more scipi scipi can die so
that going to remove
scipi wait really well chickfila doesn't
have Mayo on their sandwiches no
Chick-fil-A is not disgusting
someone should make a scipi that doesn't
require Fortran oh look we imported it
wow that was so easy CPI was used for
like four stupid
things should I submit a pull request to
corl tools to not use scipi how pleasant
would that
be
um okay mail model
users
tailor
downloads is that one that I downloaded
mnus classifier do model tab
sweet module object is not
callable do
load right they just did
that
um oh do
from
import
okay sweet we have a model now oh was
pretty
nice all right so model.
predict
um I have mest stuff in tiny grad we
just use it right what is it test test
mest
uh
from test. test Mist
import uh fetch
mest take that
line
what but I appended that
path no mod name test test M Nest
huh users tailor fun tiny
grad test is something
special
done okay
um unable to load core ml framework
cannot make
predictions exception loading model
proxy
what if I just okay
fine do I have to kill more
scipi
weird thank you Alex did you order
anything from
chickf oh you me some french fries or we
sure okay
lib ml core
python
does it not build or
something
no module named core ml tools lib core
ml
python oh
cmake why is it using shitty python
um found python in
TP you know I never want that
python op homein l-s Python 3 python SL
py just do which python no I don't want
that python python yeah good all right
cool all right build 4ml tools T build
cake RAR star yes cmake do do slash all
right python 39 cool now we're
talking building building building
building use all my
I did j8 why did it not j8 now it's Jing
all right
cool
building and now we'll have lib corl
Python and then we can predict using
corl and then we can write Python and we
can figure out what kind of CIS calls
it's making does Mac even use CIS calls
like I just I don't know this
stuff like in Linux you can just use
beautiful EST trace and H
man you know what let's all take a
moment and let's thank God for
Linux that we don't have to deal with
these terrible other operating systems
you
know okay good we have lib corl python.
diip
diip oh no symbol not found
oh
no high thread State
current oh
no that's not
good
o mac just has a crappier versions of
everything why doesn't have
ldd
oh you have to set python
Library okay here's the
problem yeah why did it find crappy
python
Libs all right fine you know what we'll
remove this no that's fine but buy that
that's
great dialon dialon dialon dialon and
dialon
oh dust on Mac but get ready to disable
sip oh does this have sip I'm sure it
has like 17 different sips all different
levels I was thinking about trying to
get you Bund to run on
this you know give the M1
chip include python. not found oh my
God do I have
to
okay got to build a
few killed
nine who killed at
nine
what does that even
mean fine we'll do it one more
time what this just feels like Arch
Linux you
know I installed Arch Linux once and I
had to like Chone everything as root to
get X to
work why can't I boot Linux on the M1 I
heard someone's making like a it's
called like the Pongo
bootloader Pongo
cat I
mean
am I stuck in some crappy
uh like is there like a
hypervisor because I can definitely get
into the kernel
right wait why is it killed minus
9 what's going on
here
the one thing I wanted seems like it's
dying
what
there's a crashing
Clank is it building it for the wrong
Arch or
something still shouldn't be killed
nine
no I don't want a dry
runos equals
one there we go
yeah no that's Li
protuff oh I maybe it worked
great we got a
crash
should we just write it in
Swift doesn't seem too
bad we wasted a lot of time on this
stupid
python
for
don't automatically tab things for
me
cannot convert type string to type
URL loading a
model
compile
model cannot convert type
string to
type
URL
do I have to import
URL incorrect
labels
string all right someone who knows Swift
is probably going to like be good at
that constructing URLs in
Swift let URL equals one string I fix
it error value of type URL must be
forced unwrap ah yes we got to bang it
yeah bang There we
go
oh Cal can throw but is not marked with
try did you mean to use try do you mean
to handle an error all right fine we'll
try all right all right all right we
tried it you
happy all right good I think we have a
model now we compiled a
model let compiled URL why do we want to
let what's the
difference I can't update it if it's
lat
it's like a const I did a swift tutorial
once all right
cool now let's do predict on the
model model. predict prediction from oh
I need to make an ml feature
provider
great the feature
I have to create my own class on
this I do not think Swift is for
me
so useless
Google
ml feature provider cannot be
constructed because it has no accessible
initializers
you linking to
uh hell yeah
bro
here we go image
buffer
maybe I can just load
this
great it's not even spelled
right
I don't think this
works
this ecosystem is so
bad okay here we go amnest input ml
feature
provider no simulator
trampoline
type import does not okay I need an
initializer can initialize it from a CV
pixel
buffer
like can you look at what this code does
and how it does nothing and how it still
takes up all those
lines missing argument for parameter
image and call oh great now I need to
make a CV pixel
buffer
oh well I need to pass in okay good I
can pass in okay
let VAR pixels equals CV pixel buffer
create null 28 28
28 cannot convert value of type nothing
it said I could pass and
N is it
nil got to pass in the other arguments
that don't do
anything where do they get their CV
pixel buffer
fromal feature value pixel buffer
image
all right it's a CV pixel one component
H all right what are the odds that's
going to work
low missing Arguments for parameters
five and six in call okay that's the
pixel format type this parameter is
optional they promised me it was
optional oh my God unsafe mutable point
CV pixel buff
okay Swift example CV pixel buffer
create all right all right iOS 11 by
examples ah here we go I can pass in the
KCF allocator default I've seen that
crap in a lot of
places okay adders as CF dictionary okay
good good we're definitely going to need
that oh yes of course yes oh the CV
pixel oh good good it's a context
compatibility key oh that's
great okay yeah yeah all right all right
all right now we create a maybe pixel
buffer um which is a CV pixel buffer
maybe which will pass in I assume that's
like by reference wow you know what I
like python um and then maybe we'll just
bang it over here bang all right does
that
work missing argument label image in
call okay well it's an
image hello
oh sweet we got a dictionary feature
provider okay I'll down right now I know
boys I know okay what if I just pass
that in does that work
okay oh no you can't convert type any no
of course
not
okay so we have an ml dictionary feature
provider now if we look back here we can
can figure out how to turn that into
something
real um can I say out. output now that's
going to be way too easy it can't be
that of course it has no member
output but if we cast it to an
mnist out features. featur value for
output oh
oh nil it's nil of course it's
nil
can I can I like do
that no of course not May tab feature
names label probabilities
oh oh yes okay finally look we ran
something
um that's not what I want how do I like
see that
big go down
there can I like go like that no of
course
not okay good we figured it
out all right so now let's turn this
into wait how do I Swift print Swift
print oh does it just print can't be
that easy nothing in Swift is that easy
I'm sure I'm going to have to pass in a
KCF default print all right
cool
um oh expression implicitly
coerced I hate Swift this is terrible
you know something Swift's fault it's
Apple's incredible verbosity in just
anything okay um
MP mp.
sft then thank you
Alex oh can't find amness inut and scope
oh yes I forgot of course we need to
copy the mnist input class
yes this can't be how anybody actually
codes any of this stuff oh yes I forgot
the model loading code yes so we
definitely need that oh that's very
important
code cannot find model and scope why not
do I use the model earlier
no
out equals model prediction I don't get
it did I mean to use try I probably did
mean to use
try okay good it
works oh yeah double
fries oh good thing it's not Sunday boys
can't get this on Sunday
is
that oh it's a
one
um wa Swift C to
compile
okay we now have a
program that's
allegedly they want me to eat with you
you want to eat with me that's what the
Twitches want that's what you want us to
eat together
[Music]
yeah okay after the food
break Twitches can all be here for
eating too we're going to figure out
whether that thing is actually even
running on the neural
engine and if it is how it's actually
accessing the neural engine so we can
finally make tiny grad the first neural
network library to
support the Apple neural compute engine
on the
M1 we can revolutionize the neural
compute
engine I heard the one in the iPhone 11
was only float
16 but the one in the iPhone 12 support
supposedly mixed
Precision so I'm going assume
one no TL
support the mlc tensor Library which is
actually just using the
GPU at least as far as I can read any of
the documentation about the NLC ker
Library it's just using the
GPU I mean we can confirm that but then
we have to make tensil Flor work that's
too much
effort spin
drift yeah TF is just using the
GP guys what do I do
dust
no okay I might have to reboot for this
do I have to reboot for
this
disable system Integrity protection oh
no
yeah I know about tensorflow Macos we
can try to install it but that sounds
boring and I really don't think it works
it's also not going to give us any
answers because have you ever tried to
read the tensorflow
code okay we have it running an
lb
so who knows how Apple actually talks to
devices it's
like I'm asking
that no some they have really good
answers I learned something today what
did you learn it's B there my python was
made of
crashing and then you can just use this
library and it'll show you where it
crosses oh that's cool it's built into
python
no should we bring them closer
one
that
can't you guys can have lunch with
us why is you using name Taylor in honor
of Taylor
Swift by the way I never oh my God this
very in my
face oh yeah I forgot there's a
camera I just really got it for the
chat should I make the wor
trigger how did chick-fil friy so good
chickfila is delicious so
good I don't know if he's being
sarcastic about the tens flow
documentation who I said the tens flow
documentation is great just like Matt
lab is
um guys today if you like this content
today is a great day you know what I'm
going to tell them to subscribe I'll try
it I think it's a great day to
subscribe Alex so cool yeah GPU CPU and
any we're not in New York I believe it's
3 hours later than whatever time it is
here don't give my
location
do Cod
out do I coat I
mean every once in a while I modify
things 400 p.m. in New York it sounds
like I drink
some when are we getting married I don't
know no CH not invited to my way
M we're really we're really vegan the
stream is being buffered about 30
seconds on my
end what don't eat meat it's bad for
you are they waiting to censor me it's
like some Janet Jacks and nip slip kind
of stuff I think it is censored last
time you were here I was I noticed that
what small
Corgi oh oh oh we're not getting thought
we're getting a Corky I got
excited George pays very
well I a terrible actress I'm very
uncomfortable on
screen it's all fries no want some of my
friend why do they only fill it up
halfway um let save some room for Jesus
I have the dances good point
good every Monday my childhood I ate
Chick-fil-A really the manager at the
Chick-fil-A at Dayland Mall well we
introduced someone to Chinese food last
night oh by the way now's a good time to
Shell everybody what are we
chilling go to Kam ey/ jobs watch the
jobs video mhm some of you people are
very
talented come work here or tell your
smartest
friend more ketchup oh
yeah okay I want to talk about some
things what related to
hiring people need to do a challenge you
know I can't say I don't want to talk
about it cuz we're on
stream wait what you don't want to talk
about it is 28 seconds
wow George how do we
meet yeah we need someone to make
navigation George I met at a dinner
party
right I think I'm going to keep my 16 in
and my
air I'm not going to return it I don't
want Apple to have any bad metrics on
this product because I don't really use
Instagram I do follow me on if you
follow me I will I will REM moove
you I'm inde a I want for you that's B
man I probably don't want you to work
for me either I think it usually goes
both ways it usually goes both ways
mhm
comma if you
believe if you have a desire to be great
if you have a desire George what were
you doing at that dinner party I mean I
always come to dinner parties that's
true George loves dinner know what I eat
um if you have a desire to be mid tier
your whole life you know you go work at
like a mid-tier Fang company you make a
mid-tier
salary have mid tier wife live in a
mid-tier suburb com is not for you
going to want working around but people
know at least enough to know is it it is
crazy that the nav position hasn't
filled been filled yet we get a lot of
ml do get free candier bate at work that
is that is a perk who thinks I'm the
best programmer to ever live I
absolutely don't think I'm the best
programmer to ever I think youve evered
that before um there was a time
I was the best hacker in the
world there was a time I don't think
it's true
anymore
um there plenty of bad programers
today what's up we're doing full remote
we're doing zero remote you can't work
remote it's on the front B of Hacker
News right now some guys saying like why
remotes going to kill all these
companies
if you were buil to support remote you
make it would I sell to Tesla yeah
maybe right Tesla's one of the few I
know seriously consider you
know you want the ultimate fuck you to
all the car makers if we if we join
Tesla make open pilot closed doors
imagine Android just joined iOS and you
we were all stuck on Symbian
selling shit only
CA or if someone wants to offer me$
billion dollar why I eat all
these I don't know what else cuz say
we're
there what would I say I'm the best at
now um I do know a hell of a lot about
self driving
[Music]
cars my whole emotion Plex is based off
whether the car drives well your whole
emotion is Rel well open by
right it's your child it's your
baby I read something from Kev M of
course I read his book back in the D
have you met Kevin yeah few times
H lockpick business
[Music]
card you guys I did ask George to lock
my mailbox and he
refused that's actually not what you
asked you didn't ask me to lock pick it
what did you
ask we're done here you asked me to
drill Federal property it's not federal
property you asked me to drill fed it is
totally Federal
property everything with with the the
male is a federal felony the worst worst
hacker he's a very law aggressively
law-abiding citizen that's right it's
like disappointing actually ever since
my arrest in Texas I've learned to
follow the laws what would we do with2
billion probably like blowing on one
piece of art we just buy the most exp
this is why yo can't have $2 billion
this is we get a
[Laughter]
preno we're getting a we're starting a
college we're starting wait we're not
starting a college it's a school we're
starting an alternative Society we're
starting a whoa whoa whoa whoa don't
saying c
word it'll be the last readout of Truth
in the western world
yeah write books about it one day
something like G Gul but without the
shitty ideology and the the g g is not g
all you have is blood G from
Halo yeah rest story my car was
illegally searched and they found my
legal
marijuana and then I went to the police
station in the town of 150 people
where the sheriff owns a g gas station
the sheriff owns a convenience store but
he doesn't own the hotel that's owned by
the sheriff's
cousin they shut that sh down by the way
oh they shut down the illegal down the
federal government pulled the plug on
the whole thing good did Trump do it or
did Obama do it Obama did it yeah Obama
who misses Obama some days I
do
anti alternative Society oh no one made
us a wiip
page twit we have an open mile Wikipedia
page you need a comma open Wikipedia
page just comma
only how did they know you were packing
cuz I was 19 I had sass
Mercedes the dogs really can smell weed
the dog went right to my weed George is
not always
eating
they are 30 seconds behind at least
yeah thanks
Obama do you guys search for programmer
with in math skills math skills are
useful held a message for reason
hostility OB was an inel I don't know
about that man I don't know I think he
has two kids
yeah we it would be
nice guys I'm Alex we've been over this
before you can you can buy an island for
a lot less than2
billion shitty Island George what you go
home for the holidays can you introduce
the ttes to your real
mother
maybe keep asking if I'm your mom
my parents are very reclusive
people what how software you
guys what are they
asking you've you've told them how to
get a girlfriend so many times Bros if
you can't get a girlfriend by
now try getting
Co
live in a parking garage it's
[Music]
true all right spend a little bit of
time looking at this neural engine but I
think this is most happen on part two I
would kill for the Epstein
Island oh we take a expr own the Epstein
Island right now just Lan Maxwell she's
still alive I think think she's in
trouble I things aren't looking great
for her we got her y
you want more te
sure did we have a nice
lunch we always had nice I've heard that
Scientology owns the cult awareness
Network actually what's the cult
awareness Network they keep aware they
track Cults oh yeah because Scientology
is definitely not a cult and splc is
definitely not a hate group that's right
that's why they track H
groups did also kill for that Island how
do you keep a girlfriend that is a good
question what no that's not a
question George your legs are tight I
know we're playing firewatch together
she's like marsia be like Maria you
don't like Maria Maria's great I just I
don't think we're very similar I don't
stream she's like made a whole business
out of streaming why you so
[Music]
com all right all right all right all
right back to
programming that was a flex what
oh you missed me explaining how to get
girlfriend input output Bros input
output all right so it runs and it does
something who thinks it's talking to the
neural processing engine you know it be
just so
great does drust work should we should
we reboot and disable system Integrity
protection you know
what I think that's the end end of
today's stream that's it yeah that's it
that's it cuz well we have to reboot to
enable to disable system Integrity
protection
anyway um and you
know you go to
office
uh B go to
office
office I
Twitches thank you for watching today's
stream we are trying to get new
neural processing engine
execution
into uh tiny grad we're going to push
those Chang to Tiny
grad that sound this this the sounds not
good thank you all for watching today's
stream uh please subscribe make sure to
shill to your friends to come work at
com AI uh things will get getting really
good we're getting really close to
solving self-driving cars uh no like
seriously though like look look at what
Tesla's done with with with full self
driveing we basically have the same
stack now
um if anything our Stacks more
Universal um I'm disabling sip to get
dust to
work
yeah byebye
well bam
bam
[Music]
mute this let's pop out the chat
oh
I'm good
foreign
chat we'll let anyone chat
no one anyone Chad you're chatting you
hear people
we're drinking some watermelon kiwi CBD
drink
[Music]
you know man
when you have a when you have a Hacker
News thread uh
psychoanalyzing you I cannot hate this
man
like can you talk about the ideas
instead of oh George he's crazy he's
arrogant I don't think he's dead
arrogant yo man who gives a fuck man
that's right big pimps yeah you could
write that Chaz why would you not be
allowed to write that big pimps that's
cool man that's cool that's inclusive
language we love inclusive language
uh
no no silent dribbler you can't say big
tips no that's bullying man that's
bullying
uh
I'm trying to find a USB I think I can
just plug it into the Hub do we have a
port
um
no no
uh what if we don't have a port where
are we going to plug in our Google Coral
I need a USB to to
USDA to see I didn't prepare everything
for this stream let's say no it has to
be here
because what is the network cable
attached to
oh here it is all right what can we
unplug
um not my webcam
not my microphone
what's this last one my keyboard
everything unplug that either
this is a problem boys where am I going
to plug my Google Coral in let me see
does the monitor have more USB ports
sorry for moving you
nope
full
oh there's one on the hacker happy
hacking keyboard maybe if I go like hang
on
if I unplug this
plug this guy into here
see if that works
no no I don't have a mouse
great should have plugged it in before
uh found this useless wire
oh
all right well okay
we're gonna we're gonna we're gonna make
this work boys
yeah I appreciate some of your emails
some of you guys are good emails
uh yo you know what bro like I was
telling the The Verge guy you know you
want to read some fake news like I was
like yo call me
um
this shit man
uh constantly needing to raise
investment cash
what kind of company you're talking
about man that ain't nothing I built
you know
ah honestly Thomas probably better about
me guys
um
look I'm just like
oh shit wait this is USBC if I just find
a USBC to C cable that I know what
happened I know it'll look for that
we'll be there in a minute with that no
like guys
you know it just it takes a different
person
like you want to be 100 million dollar
Revenue company right all right so like
our product March is like 60 let's say
but that means you need to manage the
outflow of 40 million in cash
all right you need to like do this on a
schedule
is this for me I don't know man
you know I really one of my one of my
limitations
um I used to play Super Smash with a 64
competitively and one of my limitations
always was like
I'm not patient I just want to attack
man
you know yeah George is popular The
Verge covers his blog posts
[Music]
um
uh homies
yeah homies we got a CDC cable homies
look at that look at that all right
let's see if this works
watch LS USB
all right we're plugging in our Google
Coral Edge TPU TM sponsored ad
I have no idea who the fuck Andrew Tate
is I don't have thoughts on him sorry
for getting right up in your ear
all right look we got a light on that
looks good
uh
invalid integer constant all right
that's cool
Global unit chip Corp
now let's just see if this works
um
connect.pi
no modulator oh did I not put Python 3 I
did go python hex pump installed
wow it's been a while since I've done
any of that stuff then
a module named USB oh let's just upgrade
pip yo who's excited for python 311
no it's not the Death Rows of comma
can't like look I read comma slack this
morning everything is super normal like
it's a company guys
y'all think it's like me in a garage it
hasn't been me in a garage for a long
time
all right and like I don't know how much
do I feed this mythology it's a
20-person company
you guys know Harold you guys know Alex
you guys know a deep they run the
company like they're better at it than
me I don't know what you want me to say
guys like is it in its death throws no
we have like
seven million dollars in the bank
account were on track to profitability
again like
we did a lot of outlay for parts for
more comma threes
like we're gonna make lots of them we're
gonna deliver more functionality
um the trajectory looks good yeah no I
just like I just said my office like
there's not that much for me to do you
know
like nah look look how good am I as a
software engineer right
you know there's always this debate like
the 10x software Engineers exist right
and
when it comes to like fixing bugs in
like a front end of some web thing like
The Daily Grind of software engineering
I mean 10x definitely exists right but
like like do like 100x or thousand X
exist maybe not
uh but they do exist when you're like
making early decisions when you're
making prototypes getting your initial
decisions correct uh you can like
there's a there's a big
uh sway to which things can go and like
a lot of times you know it's hard for me
to think about like
here here's something here's something
and this is kind of like why I'm bored
with uh with comma and the open pilot is
really really good
uh and like maybe there's three types of
people there's like the type of people
who just are content with the idea uh
and that's not me I have to build the
thing you guys know I have to build the
thing
um and I do I build it
and but once I build it and it like
works for me I'm pretty happy with it
I'm not that concerned with with like
I've never been driven to uh
like like
and this is maybe something just broken
about like my empathy like some people
are like oh I'm so happy you see other
people using this I'm like I don't
really care man
you know and it's like people like old
Jersey why do you care about the open
source stuff and like
because I don't want the like if you
have something that's closed Source
someone can attack you for it right
someone can come take it from you that's
why I care about the open source not
because like I want to like I like to
see other people use it but I do think
there are people like that uh so guys
like you know if you're that type of
person
uh gorakama
uh you know there's a there's a real
potential for like really big growth to
the open pilot product from like a sales
number perspective
um from like an actual functionality
perspective
there are some but it's not as big as
that initial zero to one and that
initial zero to one of functionality is
what gets me really excited uh versus
the like zero to one of like making a
product and like pitching it to normal
fucking people you guys know how I feel
about normal people on this channel
right right how do we feel about normal
people
um
do I still own it uh yeah no I look I'm
keeping my board seat I'm still the
board I'm still gonna do approvals for
large purposes uh purchases and Equity
grants
uh
uh
yo I eat Whoppers too man there's
nothing abnormal about eating waffles
you know what I don't eat the Oreos
they're disgusting
all right we gotta figure out how to
install did I do a requirements.txt oh
good guy Geo hot oh yeah look at that
pie USB
list index out of range okay
um connect
downloaded nap in quick bro
okay good my Google Coral outputted that
the picture of banana was a banana
um am I like Zach with super shares hell
yeah man
I told my lawyers literally when we set
this up that I want a Zuckerberg man
we're gonna Zuckerberg you know what and
I'm not just saying this because I own
metastock and I do own metastock I
bought metastock after uh Zuckerberg's
Lex Freedom interview and is it one of
the greatest mistakes in my life no even
though I lost a lot of money you got to
lose money to stand up for what you
believe now guys it's a mistake I'm just
trying to cope but like look I'm not
gonna be like Jim Cramer and cry about
it right
uh I listen to yeah I listened to a good
bit of the uh carpathy maybe like an
hour and a half into it uh
well George the 14th also
uh that's a later problem guys that's
the latest problem
uh Zuckerberg right no but look I
respect our spec uh Mark Zuckerberg
exactly trying to do something uh you
guys know I'm a fan of Elon buying
Twitter
um
no and I you know I I think that uh you
guys know I'm a very moderate person uh
like politically I I think that uh
Elon uh
yeah we'll do a good job
uh making something that is fair for for
everybody
um
no I
uh calling out like the New York Times
you guys know I'm not a fan of the New
York Times
um
these people had a monopoly on
information and they no longer do
uh so yeah
will Elon be China's puppet I don't
think so okay so uh like he lives in
Texas man I don't think he's really
motivated by selling a few cars in China
I think like
there's a you know I think he's a
reasonable guy and I think if China's
being reasonable he'll be reasonable if
China becomes unreasonable he's not
gonna like I think Disney is more likely
to bend over to China's demands than
Elon like
you know what I mean
Elon will eventually get to the point
yes screw you guys man
um
aren't I better positioned to tackle AGI
with comma supercomputer guys no one's
tackling AGI in the next I promise you
in the next five years there will be no
AGI
oh this shit's AGI
there's again if you're talking about
AGI is in a computer that can do all
tasks better than a human
um so I did see a blog post uh blog post
Amazon warehouse worker burnout
Gaia
H here I I read this
uh oh he had like a Blog which wasn't
like terrible like Yahoo finance
um but uh yeah
I'm thinking about applying the work at
an Amazon warehouse
does George see the chat yeah wait oh my
viewer Count's high oh what do we got
uh we got a high view account
that's not that high what are you
talking about
I hear back from opening open eye does
not want me as an intern unfortunately
uh
the opening eye doesn't want me I would
love to be an intern uh at either open
AI or deepmind if they'll have me uh but
you know
they know why I'm there
they know in there because I want to see
how things work
right again I think I'd be a useful
intern and I think I'd contribute value
but
uh
hi
you know some people you can't get some
mods
why is this chat not oh because of
people posting bullshit
oh I don't know rah-rah 101 all right
banned for life there we go
congratulations bro congratulations you
just got a band for life
you trusted my shitty gigs on protein
holding it how you lost your PhD
Fellowship I love that we're influencing
people on this channel man I love that
we're influencing people did you tell
your professors that cloth masks do
nothing to prevent the spread of
respiratory disease is that what lost
your PhD Fellowship
is it comma body a new high leverage
project yeah but how much should I be
fucking around with comma bodies when
there's an actual company to run you
know what I'm saying
all right if I want to fuck around with
Karma body should I really take comma's
resources to do that
think about it
uh start tiny Corp I mean yeah the tiny
Corp is look the tiny Corporation
already exists right look I'm back
uh you know you can see that that my
hustle is kind of bad you know I've kind
of been lazy with the programming but
four days in a row that's pretty good
we're coming back
um hey look I'm not too upset with my My
Graph but like I could do better
uh
can I mute this other guy if he talks
again I'll ban him
did I check out Hacker News yeah yeah
yeah great great uh a nice Hacker News
breakdown of my personality just what I
love to wake up to on a Monday morning
uh some of this shit was funny
all right you want to do hacking his
comments should we do hacking his
comments
it's Carpathia comma a possible scenario
well I don't know I mean I look I
watched I watched half of his uh his
lacks I I think that he might have
similar uh sort of feelings that I do
uh
I mean who knows right well and also
like look is this forever am I leaving
comma forever probably not
um but for like the next year or so
like Kama needs to make a consumer
product
and I'm not the guy for that
you know I I think that actually the
team that's there now has a better shot
of figuring it out than I do
uh again and it's because I
fundamentally don't care
right like I don't care about shipping
products to people I just I don't like
some people do I remember they always
tried to pick big tech companies to me
like this like George you can you can
impact the lives of millions and I'm
like I just honestly give zero fucks
about that
George you can't answer that you have to
have people do I bro
do I I didn't sign the social contract
bro I didn't sign it
um
oh yes oh anti-hero oh so good so good
Miss Swift
uh you know I thought about going on
4chan this morning and posting a comfy
Taylor Swift thread and it's just like
pictures of Taylor Swift wearing
comfortable clothes
uh what do you think
um sounds like something you you heard
at yo I am not Jewish guys I am not
Jewish uh
uh
[Music]
4chan all Bots now
you guys look uh look I mean look I I
look at Mom uh
oh I think about Kanye
I look man I love it what do you say let
yay me let yay let yay V yay I I think
people take words way too seriously
these days in general right I think yeah
the
reporter uh friend of mine reached out
to me this morning about my blog post
like you doing okay I'm like yeah I'm
doing okay like it's
people read words today and they think
they like they they imbue so much
meaning onto them right uh you know you
the Kanye thing like you don't remember
when Connie was on the news it was like
oh George Bush doesn't care about black
people like it's a shock chalk man shock
joke
uh my consent to the social contract is
implicit no it's not I'm getting a
lawyer man I'm getting a lawyer inside
that shit
um am I gonna buy a blue check no way
man that's like paying for admission to
the club I get into the club because I'm
pretty man
and Famous
uh the blog post sounded a bit schizo
all right we're gonna look for the
garden man you don't like that you don't
like that
um
what are you gonna do today all right
so we have the uh
man
I did drink this today do these things
fuck you up feel a little fucked up you
know
watermelon kiwi mad tasty
broad spectrum hemp extract CBD it's not
supposed to be psychoactive but
uh
uh let's debunk hm personality comments
nah come on guys we got better things to
do today
uh
would I like to see Twitter uh improve
yeah I think that like there's a lot of
ways to make a social network
uh you you have to not optimize for
engagement you have to optimize for
quality people talked about this before
um like you want to optimize for
like
okay so like two people flaming each
other is engagement but will never
change anyone's mind right so yes your
short-term metrics may show large
numbers of users and big amounts of
Engagement but long term like you know
what uh this was I I wrote this this was
some lyrics to an unreleased song it was
like yo
when Facebook sent me that email you
know saying that I I hadn't talked to
Patty in a while you know they see that
I clicked the link they see that I
messaged Patty but they don't see how
much more I hate Facebook right
um
uh where's my boss that Alex dog yeah
guys look comma's got a lot of things to
do that aren't um
you want a social network views content
not created in the last week so yeah
there we go right like not optimizing
for recent season another interesting
idea
uh Alex is still a comma yes
um
uh yeah I don't think Trump should have
been banned uh I think that like I like
what they're doing now with the uh
for the public figures they have like
the
I mean I'd like to see some actual like
fact checking on public figure things
but not like fat Checkers right like not
like not like the the the incredibly
biased fact Checkers but people actually
saying
like like imagine that right imagine
when like Trump tweets out something
like you know offensive and ridiculous
right imagine you actually like had like
a breakdown and there's the red box in
the blue box and it says this is how
conservatives interpret this is how
liberals interpret this right and it's
like you know again it's a
I don't know exactly how to do that
right I'm not look I'm not I'm not here
to make Twitter features I don't ever
want that job man I don't ever want that
job
uh
but like yeah imagine a social network
that was designed for uh
designed to actually like
instead of like like just steal me on
the other person's viewpoints right
um some of the context they give is
actually useful yeah I've seen
I've seen ones don't look nearly really
is bad right I'm talking about like the
fact Checkers who like you know like
like PolitiFact and stuff who are these
just biased organizations
um
when is the Tom Cruise concert yo should
I do a show guys should I like work on
my live performance and do a show will
you guys come to that if I put a show on
hey y'all come to the Dive Bar in San
Diego
right I'm Rich As Fuck you shit's soft
if you went to college you got ripped
off
thank you
I do the Cold War all right now that's
what we're gonna end with right we're
gonna like that's that's the last we
gotta we gotta start with the like less
well-known songs in the catalog come on
we'll play a new song you know everyone
will just kind of stand there and look
awkward I think I can put a good show on
uh what will the tiny Corporation be
like well let's start with the fact that
it's tiny
um
sing about the tiny Corp
s
no no like three employees guys not many
employees damn
I thought we were gonna work today but I
don't know how I'm feeling right now
feeling a little jittery from the Yerba
mate
oh hi from the the CBD drink
y'all think I'm on drugs man if I was on
drugs you gotta be fucked up from 20
milligrams of CBD you know you don't
think I'm on drugs all the time yeah
guys like you know it's nothing like
that with comma I hope that people see
like
uh you know me leaving commas a lot more
like carpathy leaving Tesla
again they're when
I'm a wartime CEO you know
if I ever am a CEO that's I'm I'm here
for war I'm here to fix things I'm here
to make big changes I'm here to to fuck
shit up
uh
uh now when it's like well George you're
gonna have to like
plan ahead and you know you have to plan
this marketing campaign launch event for
six months and well you're gonna have to
make sure your supply chains properly
managed and you know you've got to pay
this import tax from that oh my God
these guys watch the link Rick and Morty
quote well we'll watch it it's not too
copyrighted it's various Furious right
you know what Grandpa Rick he's strong
and he's never going to give up uh-huh
yeah I don't care oh I know everyone
knows you don't care so so have fun not
caring I always do good yeah it is good
it's the best I'm sure it is bye later
I'm here to pick up my Undead cat and
child yeah uh give me a sec these are
the forms for the employee health plan
all right yeah put them on my
uh
I just got bored everybody out
ah
yeah I don't have the capacity to see a
real CEO of real company I'm not Elon
Musk guys I don't know I don't know
uh who thought I was
I just got bored everybody out
um
that's my blog guys go to geohot.com
did I burn calm and no I didn't burn it
guys look again I haven't really done
that much for like the last
almost year
we do have 140 90. I think we bought a
bunch more too
um who owns I mean I still own it guys
like I'm still on the board right
uh
no I I okay I'll I'll explain this once
more it's like
some people care about like shipping
products to people I don't I really I
don't I never really did
um like even the jailbreaks guys like it
was it was memes you know
like I made you all look at my face man
I made you look at my face right I don't
give a fuck if your phone can do some
new bullshit like I just don't care I
never really did
like this is this is about a 19 year old
kid you know being like yeah they all
look at a picture of my face look at the
size of my ego got a big ego you know a
song
uh nice band these bands canceled we
can't sing any more Kanye man we can't
sing anymore Kanye is done he's done we
can't sing it I can't sing it it's done
um
I am the largest shareholder I guess
look guys
you know as far as as far as dictators
go uh I've never sold a share uh the
total amount of money of all my salaries
the integral of all my salary a comma
six years probably amounts to like
oh
five six hundred k
right like nothing
[Music]
I thought about bringing Jim Keller into
the tiny Corporation funny you say that
funny you say that uh
yeah yo we'll see we'll see what happens
with the tiny Corporation we'll see I'm
working on I'm working on a contract uh
hopefully it comes through uh
but
we'll see nothing set in stone
uh but yeah the idea kind of of the tiny
Corporation I guess I'll introduce it
here is there's a lot of performance to
gain if you think about all right here
we'll do this and we'll do this in
another
okay
so let's talk a little bit about the
history of programming languages right
so we used to have assembly right
and then people were really excited when
they had these new high-level languages
like Fortran and Cobalt
okay
um so if you think of the history of uh
of uh you know uh ml Frameworks right
well you used to have like think of Alex
that right it's hand-toed
right and now we're oh people are so
excited we have things like tensorflow
and Fortran and uh pythons right
but these things are like the like
assembly you know Fortran Cobalt kind of
levels of uh like where we're at right
um so if you think about what comes next
in programming languages right you start
to get things that look like C and
python
right now where
oh mtastic uh 85 thank you for gifting
Subs
um you know you come down here and
you're like okay so what's here right
well let's think about C in Python and
what kind of give them their power
right so uh C is
um is uh compiled
fast
uh
it's clean right
um and then you have python which is you
know interpreted
yeah I didn't spell that right did I
uh you know interpreted slow-ish
uh but still you know uh pseudocode
right
so if we're making a new ml framework
um I kind of see ml Frameworks targeting
uh
like it doesn't even have to be two
different things because a lot of the
slowness in Python comes from the fact
that the types are dynamic
um I I can see you getting both the
benefits of c and python in a single new
language uh with ML Frameworks because
everything is uh like
is is uh it's beyond statically typed
right
I've talked about this in one of my blog
posts where you get down to like um if
compute is uh CPU GPU DSP uh neural
networks are all DSP
right the you don't ever need to do a
load from a computed address
maybe some new things will start to look
like that but I I still doubt it and I
think you'll beat them with just
straight up like tons of tons of mole
accent
uh and all right like even Transformers
which are different right Transformers
have quote unquote fast weights because
they it's a matrix multiply where um you
know it's a destination multiply where
both sides are uh
right most of the time when you have a
matrix multiply like in in like a resnet
right you have a matrix multiply which
looks like input cross weights
people's output but uh
in a Transformer
you have input cross input yields
outputs right and these are like maybe
which meant to recall fast weights
uh so you'll see that I actually added
support
there's now in open pilot open pilot
uses tiny grad
open palette uses tiny grad here
and tenegrad now supports this kind
of
thing which like smpe doesn't so you can
use I mean this is attention right
you're like
uh queries and your keys or something
queries and keys and then the values
uh
so when we think about what a new ml
framework is going to look like right
um
first off it tensorflow and pytorch are
languages with they're they're
incredibly complex languages
um pytorch has it's really hard you know
how you know how complex a uh
nml framework is how much effort is it
to add a new accelerator with tensorflow
almost no one even tries because it's so
complex with pi torch people kind of try
but remember on my stable diffusion
stream
where people uh where we found that bug
we found that bug in pytorch on the M1
and the reason bugs like that can exist
is because you have to go pretty like
far back in the abstraction stack uh you
did maybe the API is like wide where you
have to implement a new accelerator in
tinygrad the API is very simple what you
have to enter in uh to do a new
accelerator you just have to implement
these operations
which fall basically into into these
four categories right so unaryops
they're just like like you can think
about they operate on one tensor and
they output another tensor of the same
size
a binary Ops operate on two identical
size tensors and output one new tensor
uh reduce operations reduce operations
shrink tensors right uh very can do like
sum or Max across axes
uh and we have movement Ops which these
don't actually change any of the data
they just change the views into the data
so uh tiny grad has this uh
class called shape tracker which will
handle all the movement Ops without
actually making copies of the data and
it will just make the copy at the last
minute on processing opscom is
surely for speed up and we can probably
remove it eventually if you go to this
implementation which doesn't use the
processing app
a convolution is really just a set of
movement Ops followed by a mall and then
a sum
uh a Mull and then a sum is also a
matrix multiply so for Matrix multiplies
you see them here in tensor
here we are in mammal and you see that
map wall is actually transformed into a
convolution
uh so by having a very small API
at the end here it becomes easy to add
new accelerators and then I think we
have some of the nicest uh
syntax to write this stuff in as well
like you can look at my implementation
here of stable diffusion
um like it's just it's way simpler
looking than a lot of the torch code and
this isn't even well refactored
with a bit of refactoring it these apis
due to their complexity acquire all of
these quirks
and yeah you can really do without them
so even things like like com2d like that
that goes pretty deep
uh in the pi torch code like go look at
conf2d and pytorch and try to understand
where stuff's actually implemented
like here you can see that it's just
here and it's just okay
this is the whole conf2d code and it
just calls that
all right and it supports all the same
options as the pi torch comp
uh you're almost done with cherry on
fpga so I think I did Cherry prematurely
um I didn't have all the abstraction
layers in place we're not quite ready
for chips yet but one of the reasons I'm
trying to support like every accelerator
in the world before we think about
making our own chips is I'll get really
the right thing and then like I don't
even really want to make chips uh what I
want to do is make a
like I want to get to the fpga level
and then I want to work with other
companies uh who want to make chips
right similar to what Nvidia does with
nvdla
uh and like by work with I don't mean
like in some like stupid partnership
thing uh so sus boy Sam thank you for
gifting Subs
um how would you compute the gradient oh
the gradient's all computed here in this
thing called ml Ops so these are the
mid-levelops and the mid-level Ops are
the ones that have gradients to find uh
it looks very similar to uh
by George
am I going to hire from Taiwan we're not
really hiring
uh if somebody like contacted me who was
incredibly talented like uh I reached
out to the guy who wrote Triton I think
Philippe is his name uh I actually
reached out to me and we chatted for a
bit like if someone like that wants to
like I think I could you know has
experience with this stuff and wants to
like make the Cuda back end fast and
just wants to have conversations about
you know what things are fast and memory
coalescing and you know who knows about
polyhedral computation if someone like
is really an expert on this stuff and
wants to come join the tiny corporation
uh I'd be open to it but
you know it's it's not no bigger than
three people this is not a real
Corporation guys this is going to be a
quick way to make some money uh like I
said I'm trying to get contracts by the
way if you uh if you work at an AI chip
company and you're like well we have
this chip but our software is really
shitty well
you can make your software good
um I think I can write a stack that's uh
very competitive
with a uh like
whatever you're you know you have a 10
you have a 12 nanometer chip similar to
V100 you have a 17 animator chip similar
to name 100 or five nanometer chip
similar to a uh h100 I think we can get
that level of competitiveness uh for
training
with with maybe about a year of work
and then like if you want to implement
if you want the pi torch API you can
Implement Pi torch on top of tiny grad
um
well intense torrent sells chips we can
we can talk about that uh what will the
money be for well I'm not raising money
I'm definitely not raising money uh I'm
interested in in contracts and then I'm
gonna spend the money on yachts and
hookers all right hookers on my yacht
bro isn't that what you're supposed to
do when you have a startup
uh
is it better to have a CEO with some
humility or zero humility you know this
is what kills me about this Hacker News
threads it shit doesn't matter guys
it's better to have a CEO with skill
right I don't know how correlated
humility is to scale
um that is kill is what matters right
you could have a guy who's like super
the personality is way less important
than the actual skill
uh
I don't know Zach has scale he's got
more skill than me man like you know if
you want to jump to success of a CEO
like
oh
look at how long their company's been
around with a market cap or something
foreign
you know I do think I do think Zuck made
a stupid move though I listened to John
CarMax Lex Friedman the man wanted to be
Czar VR why did you not let him right
you literally have one of the greatest
uh game developers in history who wants
to come make your metaverse thing
successful and you're like no we'd
actually leave it up to a diverse
committee well
shit man that's when I should have sold
my meta stock oh man I'd be less
underwater if I'd sold it then
um
polyhedral computation look
so you're left with things like
at the end of tiny grad uh at the end of
these optimizations
you get in AST and the AST can do a
bunch of element-wise Ops a reduce op
and then a bunch more element wise Ops
right
um and then like how these reduce Ops
end up looking
has to do with how you want to schedule
the computation because if you view that
computation as like that's an atomic uh
operation like then you can do a lot of
these things in any order right you can
you can you can read in a lot of
different orders and still compute the
correct thing
uh so yeah this this like I'm just
learning this stuff I'm not really an
expert at it yet so I can't speak with
too much Authority but
um I I like
uh I was reading this last night
ah
yeah and then like I look at like trying
to use Triton and I'm like it looks very
complicated to me
I'm not sure it has to be so complicated
but like um have you use a block level
data flow analysis right so that's like
that's cool stuff right
um and like where we want to get to in
order to make the uh stuff fast right I
added a new back end to time of God I
did mostly on stream called lvm
um I was looking into also the uh
there's these instructions
on the M1
called the AMX instructions and it's
like a it's a mullac grid this is very
similar to what's in the Tesla FSD chip
uh so you it will take each one of these
things you can load up like an X vector
and a y vector and then it'll do the
it'll do multiply accumulates in this in
this big Square Z and you can do like
really fast Matrix multiplies doing
these in fact I was getting
1.7 teraflops on only uh my M1
uh CPU right and then you can only get
like 100 gigaflops out of a neon though
I was getting faster than 100 gigaflops
in the neon when I actually benchmarked
it I was getting more like 150 but then
it's using a Winograd conv and I don't
know if that uses less bumps
um
how much size and speed do I think a new
ml chip could yield well the truth is we
really don't know yet and here's what
I'll say to anyone who's thinking about
an ml chip
if your software isn't first competitive
on a GPU right if whatever you build
can't be competitive on a GPU uh I don't
think your Chip's going to be
competitive right like because it's it's
not really a hardware problem it's a
software problem and figuring out what
Hardware to build
um if you're just trying to do inference
and you're not trying to do training
like this even might be usable for
training uh Nvidia has this open source
thing called nvdla
and like here this is what the core
looks like right and it's it's based
around convolutions activation pooling
local response normalization right like
uh you know uh this is something else we
should we should work on uh supporting
uh like ad support for nvdla to Tiny
grad and make sure that we're keeping
the framework flexible enough to support
all the accelerators that exist today I
have a rock chip Dev board somewhere too
and that thing has an interesting custom
neural accelerator in it
um
how fast is Tiny grad on a 3090 uh
not that fast right now
it's it's like
it's not fast because I haven't
optimized the GPU code yet I'm still
working on getting the abstractions
right like you you don't want to
prematurely optimize right you want to
think about you want to like kind of
like I still have to do a pretty big
refactor here well it's not that big of
a refactor but like this is this this
lazy dot pie is so much more readable
that late than lazy dot Pi was once I've
moved into passing the asts into the LL
Ops as the internet checks and attack
string that's just like uh like I said
it's element wise uh reduce element wise
right and these can be in like a tree
um
so since I've started passing the asts
into here lazy got much more readable
and I've started to realize that like
this stuff's all junk like these can be
replaced by a generic function
um this shouldn't be here like there's
so many lines to lose here
by returning an AST instead of this
horrendous Tuple from these realizers
and then I can put a lot of this stuff
down here
in this realize function I could
probably add like five lines here and
delete like 20 lines up here
um yeah make all perhaps unrealized yeah
I might even be able to not have the AST
be realized that'd be really cool
uh uh and then I can realize like
everything recursively in the realize
function
uh and then you have like less levels of
Direction too much faster yeah there's
probably 20 lines to lose here we could
do that if you'd rather do that on this
stream I just think that like
refactoring is nowhere near as exciting
as like
um going and trying to implement uh new
things
uh is neural accelerator just a fancy
term for faster dot products well okay
so here's something that's in tiny grad
right now I'll show you
um so yeah we can do something like
examples Benchmark train efficient
uh let's do this on the GPU and set hop
equal to
okay so this is a efficient net 2 with
batch size eight and then actually we
have to say backwards equals one we want
to do the backless past two
so it's it's not very good yet this is
on this is on the m1's GPO
um so you see it's taking about a second
to do batch size eight
um but here's something that's cool and
this is like the kind of power you only
get from Tiny grad we can say like debug
equals two
right now this is printing out all of
the uh
kernels that are running in opencl
right
um let me just set num equal to one and
we'll just do one
wait what that should be
oh count
okay this is just gonna do one one uh
step
so you can see that this did
39.44 gigaflops of computer
in order to compute that right now the
it
I don't worry too much about that so it
takes a second right so if it's taking a
second to do 39 gigaflops on a GPU that
in theory has 11 teraflops of compute
it's like 11 teraflops on the on the M1
we'll have M1 Max
I want to get this wrong you people like
know this stuff oh George shut he got an
M1 Pro and he goes M1 Max I don't know
this shit man all right but uh my point
is
we're getting like there's so much
inefficiency uh there and even even when
we when I did the math for this
um at comma for how much of the like 30
90 we were using uh
and uh
like it's it's off by a factor of 10.
um how many flops the thing has without
even going to the tensor course versus
how much it's actually using you're only
getting about three teraflops of compute
how do they get the 11 11 teraflop
figure you multiply your number of
multiply accumulate units by uh your
clock speed basically by two because
it's multiply accumulate look those new
Matrix multiply tricks are generally not
faster
uh did I see this opening my blog try it
yeah yeah I read this yeah
yeah but like
see this stuff like this is complicated
it should automatically be done one of
the big advantages of tiny grad is that
it's lazy
um so tiny grad doesn't uh yeah
in in torch if you naively write
something let's say you write like a
times
well actually let's say you want to
implement rally right
let's say you want to implement uh
like a scaled value right
or say let's say you want to implement
um leaky value right so one way to write
with your value is like this
right that's a leaky value I think
actually that's probably similar to the
uh we can look at the implementation of
tiny ground see if it matches this
here leaky value all right
that right
[Music]
yeah that's the same right
um
so when you write this in torch it's
actually going to launch first a relu
kernel then it's going to launch a
multiply kernel then it's going to
launch a relio kernel right so let's see
what this is this is relu
okay so naively this has to do four
complete kernel dispatches which are
full loads and stores into the memory of
the size of your tensor right and a lot
of these tensors like let's say your
tensor is something like
um
uh
uh let's let's let's say it's it's uh a
million this is megabyte right I'm sorry
it's a million a million floats so
that's four Megs right like that's gonna
it's gonna destroy your L1 it's gonna
invalidate most your L2 almost every
time I guess so I guess it would run
this in L2 if it was that but then if
this is not an alto you have to go all
the way to memory for each one of these
it's going to be horrendously slow now I
propose you do it in registers right
each one of these is an element-wise
operation
right this one looks like a this is this
is still a little unwise right so let's
multiply by a constant this is not a
tensor it's constant
um so this can be done in a single
kernel but the way Pi torch is designed
it can't really do that because as soon
as it sees self-related it's already
dispatched that call
uh no comma's not over guys I
you know I hate this man
like like
why do you think that
have I done nothing over six years to
convince you that comma is a real
Corporation with a lot of other people
working there
right like
I'm the founder who probably stayed
around too long you know
um yeah all right you guys starting to
get so so tiny grad compiles this all
into one kernel and in fact it does even
better than this right because most of
the time like let's say you want to put
a leaky relu after your comp 2D right
so you have something like right
something like this right or you
shouldn't be yourself here but
right so this actually becomes five
kernel dispatches right
that can all be fused into one
this should be one kernel right
you were hiring
wait you know
uh
you can you can add the accelerators to
both inference and training right the
inference memory access patterns are
simpler to deal with than training ones
um and I've used one via lazy evaluation
yeah so so this this in tiny grad and
this already all works today I'm not
talking about like hypothetically what
could be done I'm saying right now if
you wrote this code in tiny grad like
and then you wrote something like x dot
number line right because you
fundamentally want to convert this to
numpy
it's it's if when this is called in tiny
grad
um this triggers all compute
um it won't it won't waste time doing
computes that aren't on the graph
leading to your final thing but unlike
having an explicit representation of a
graph that the user can access you can't
tell the difference right as a user you
don't care at all if the compute happens
here if the compute happens as you go in
fact with gpus it already almost is
delayed right because what this will do
in pytorch for a GPU is this will call
basically cln current uh you know the
comp2d will call like uh you know Cuda
Cuda NQ or whatever Cuda launch kernel
um all right and I'll call all the cool
launch kernels but these are all
non-blocking right
uh so it's not until you call KU to
finish uh that this is blocking
sorry close my parentheses
all right so why does it matter if these
Cuda launch kernels are called like in
in pi torch
when you call x dot numpy you're here
but in tiny grad you're still here
all right
when you call like Staten Empire
tiny grid will also have better
precision too yeah because if I mean if
you're doing it'll only have better
Precision if you're doing stuff like uh
where your storage is float 16
um and where your uh compute is float32
where your registers are flow 32 by
keeping this all in registers it'll have
better Precision yeah
uh Jax does similar stuff to this the
problem is Jax is built on this
incredibly complicated architecture uh
you know like look at how many xla Ops
there are so many
um but this is Google I mean what do you
expect Google is a bloated organization
they write bloated code lewandowski's
law company looks like their code base
by the way I regret complicate
complimenting kubernetes we have way too
much kubernetes at comma
um Excel is way too complex thank you
for agreeing with me uh I I'm surprised
like I didn't know kubernetes came from
Google last stream uh I was like you
know what actually in retrospect that
makes a ton of sense why did I not know
that
[Music]
um
no tiny grad will do the compute on X
numpy this is where it'll dispatch
everything to the GPU or order your
accelerator or whatever right
um
do you mind uses Jax for some things
they'll all use tiny grab when it's
better if I really work on this uh but
yeah so I'm thinking about working on
this full time for for a bit
everything must use kubernetes
uh okay
so where are we with trying to
understand
it's Edge TPU x-ray stuff and a
different repo
and then I just tan coated all of this
seasoned
I'll see Sam just finds this and the
thing and sends it okay
um
cool
uh will I do that pull request for
releases of tiny grad not yet that's
that's kind of annoying uh I realize
like I don't really want to maintain it
on Pi Pi if you want to install it just
do this
um
you're better off installing it like
this
when it's at like 1.0 we'll do a release
um now which will get to 1.0 first will
it be tiny grad or will it be open pilot
like my goals of tiny grad 1.0 is I want
to be at least um
I want to be at least 2x faster than
pytorch on most models on Nvidia
this mean I'm going to be streaming more
uh I don't know
I don't know how much of this I'm gonna
stream I I kind of wanted to just talk
today because like people are I hate
reading that shit like The Verge
articles like practically a hit piece
man like I just hate reading that shit
oh call is gonna shut down call me needs
money like a thousand guys
you know the best thing I mean that's
the problem with the media right like
you're only gonna and media social media
it's all the same problem like you're
only going to want to read The
Sensational shit right and look I'm I
kind of like I feel bad I feel bad about
what I'm not good at you know
um
what's metaseek
no I look I even said I told the guy I
told the Verge guy I'm like yo call me
like what you're saying is not true they
don't care he didn't he did not call me
and I will uh well let's just confirm
that fact that I still have not received
a call
uh nope I did not receive a call
right I told him call me I gave my phone
number
um
oh
um okay okay we have we have another
journalist reaching out
um
wait uh to chat I might have to go
uh
please don't leave comment AI you're so
smart doing great things in the end what
do you want though
what is your next project
um
oh yeah no I gotta reach out this
morning from uh we'll say it we'll say
it I gotta reach out this morning from
someone Nvidia
uh
I mean if a video wants to sponsor tiny
grab them down right like I think that'd
be kind of cool uh
uh or no again I'm in talks with uh an
unnamed company
uh to get it to to to contract to Port
tiny grad to uh
their stuff
um AMD hey look if AMD wants to reach
out look I'm not gonna go reach out I'm
not going to show for myself I'm like yo
if someone with authority wants to get
on the phone with me like I'm interested
but otherwise like I'm not I'm not
pitching you man like this is my pitch
you watch this video right like here's
my pitch here's what tiny grad does read
the code uh you know it's got it's got
It's Got 7 100 Stars uh by the way
everybody go Star tiny grad right now
click the star click the star come on
support the tiny Corporation start a
tiny grab
good tiny grad has no gravitas good I
don't want gravitas I don't want hype no
fucking hype for the tiny Corporation
um
why is Tiny grad so attractive to
companies because I mean look it's like
what I was saying about the programming
languages right like before we like made
good programming languages we you know
what look I'm even gonna say like
language is like rust and stuff
and languages like go they've come so
far
they're so much better to program in
than languages like Cobalt Fortran
Pascal basic right these languages of
the past
um that people are kind of stumbling
around in the dark so I'm hoping
that like you know a tiny grad can be
the next one of these
right like cool we went through this
phase you know you know people people
don't remember there was this phase you
know there was there was a big one
called Piano right who remembers theano
come on I've been around a long time
boys
um all right let's do some Coral Edge
TPU stuff all right
uh hit the bathroom yeah I gotta get
some food I gotta get some food
whatever eats boys
foreign
eating disorder I heard that they had to
remove the scale scene from the Taylor
Swift anti-hero video
foreign
no apple
why don't you have
I'm gonna go find a lightning cable
sorry sir are we getting dude we got
into a long preschool today
foreign
cars
position anywhere right now
okay
so
I think the first thing we're gonna have
to do is
start to like understand what is
actually here
um
does this work
I did that on my other computer at that
time
because I couldn't get any of this shit
to compile for Mac
all right it's running
ish oh come on I think
oh it's still wait guys it's busy
importing tensorflowing give it a minute
it's got an import tensorflow
okay
OKAY model TF light no but I still have
to do something else to compile it do I
not
[Music]
oh this oh my God this is never going to
get built
Maybe
use your Taylor Fawn Edge TPU
uh supposed to be on live a computer
well it's good we're gonna need to
download this stuff anyway
yeah
so and compile the TF light model
that's just very simple
here
so now
let's see if we can compile it and get
it to run on my Edge GPU
and then we can start reverse
engineering the API
um it's a great tool for Education yeah
I want the code to be beautiful too it's
actually more than a thousand lines
right now
um but we'll go back there
the goal of the lvm back end wasn't to
improve time you guys performance is
obviously going to do nothing about its
performance or not
on CPUs on gpus I mean but
um
FS
what's this one
I might need to see Top Girl
[Music]
oh cool
uh
oh yeah I remember I just copy and
pasted all the setup stuff
now tsmc did not reach out no just in
video
um
we're gonna have to download the edge
open source though so hopefully we'll
just be able to read it
add M1 build support
we did all this like on an old stream I
just kind of forget how we did it
it was I'm out of computer account
or actually maybe it was on no some
Taylor
basil
Bruins called basil
I was just going to turn into one of
those streams where we struggle forever
with uh
updates we need TF light as well
oh
TF light TF light micro
tflight build
can I do this last time
oh very good
guys it's compiling it's okay we can sit
here
do we need packages
that doesn't sound like a good number of
packages if we do
guys we only have zero packages
TF Lite just part of tensorflow do I
just download this
let's find some junk to copy and paste
okay
um we need tensorflow
F1
all right good we got some stuff to copy
and paste
oh is my computer getting slow when I
I'm compiling
oh it's Google
come on guys this is a meme right tiny
grad's a thousand lines of code
all right well we're gonna compile
we'll wait for this to compile let's go
to
um
let's read this code
let's see if there's anything useful in
here which I kind of think there isn't
oh
invoke
what track uh lava track
okay oh look some stuff got built oh no
this didn't get built that was just
c-make guys
oh
oh wait
they're just worked I don't know
did that just work
um let's go here and if I built
of course it doesn't work
oh because I'm users talking
tailor anymore
I really had coded all this oh that's
terrible
need some of those
[Music]
okay
well now we still have a problem users
Kafka fun Edge TPU lib Edge TPU
oh those are fine it just didn't end up
in TF light build
make
okay
I don't know you might know a piano I
have
[Music]
um custom updater will be serialized as
a flex buffer map with the following
keys okay so the basic strategy is we're
going to get some simple stuff to build
and then we're going to look at some
simple things and try to reverse
engineer
guys you know what this means though
this works right
it means that with one click we'll be
able to run stable diffusion on the edge
TPU
like
you've got I got a paper towel if you
can get tiny grad support
you'll get stable diffusion support
I don't know has anyone gotten a stable
diffusion to work on the edge TPU yet
exe and MSI are
Loops or Humanity
ah guys don't isn't it great that we're
compiling all these micro kernels
how much code is compiled and then never
used in the world
[Music]
um
are there any good structs in here
more like strikes that like tell me like
what kind of type things are
um
bro just drag the DMG to Applications
good point
okay well
do we need those anyway maybe we just
don't need those
[Music]
no more clog
no lib CPU info
lib rui
include Edge TPU dot h file not found
a little bit Edge TPU TF light public
oh
tensorflow light contacts not found
why did why did I do one of them
relative and all the rest
tensorflow Lite context not found okay
oh tensorflow source
I called it flow there okay let's try
that
foreign
make unique in namespaced STD
guys I hate shit like that I what
member name make unique in namespace STD
what
what do I have to include well there's a
pointer right
um
foreign
memory
I don't know I almost can't hard to add
no member name make unique
I hate this toggle line wrapping yeah
what
I hate one wrestling one
uh no member name make unique in
namespace STD
o Direct
director in the in the mirror
oh
14.
okay okay better
now we just need to figure out where CPU
info went
oh is this like not anywhere because I
didn't build it
okay depths CPU info Bill live CPU info
and I took it out carelessly
they just moved it
depths CPU info build CPU info.a
hey
okay we gotta find clog again
I hate it you know you remove something
in depths now
gaps CPU info build depth clock
hi
um the problem it's me all right now I
need to put re back in
I already did depths for that
don't make me do this
r-u-y
okay there used to be one called rui dot
a and now it doesn't seem to exist
anymore
it doesn't exist anymore great we have
to figure out which rui you need
oh create TR malls assuming what are all
these things like it would probably help
help if I like went through you know
it's like chesterton's fence
like I should probably understand
did I not link to lib tensorflow White
some of this just fixed by linking to
lib tensorflow Lite
no
foreign
if it's not anywhere then how do I get
it
um
sorry I gotta make this small I can't
see
what's trying to link to this crap
Colonel 8-bit Neon
probably live tensorflow life
oh here we go lib rui Colonel r
let's try that one
yeah I built rui
no maybe I didn't actually
less errors
a lot of Errors still
pack 8-bit call major for neon what is
rui by the way can someone look it up
I'm like okay
it must be exhausting
what if I just put a star there
ah cool
great
it works
uh it doesn't load it because I hard
coded Taylor and we've moved on of
course to Kafka
fun Edge oh here uh because it's in Edge
TPU X right we're gonna have to change
this anyway this is the model path
should I just make that up
argument should I not whatever problem
we is a multi matrix multiplication
Library this is not an officially
supported Google product Oh no I'm going
to call up Google's tech support and
complain
I thought this was officially supported
foreign
it's not as fast as completely
specialized code for each shape well
that's what uh that's what uh tiny grad
does
we recompile
uh for each thing
just don't GitHub no I'm not trying to
hit on Google for this
okay we're getting a bust error 10. no
guys
mono loaded okay
it's failing on did boilerplate
oops
okay the problem is where we add The
Interpreter Builder uh oh there's a
chance that this just doesn't work
no
built-in up resolver
flat buffer model
we're opening the TPU contacts with the
edge TPU that seems fine
okay uh
how am I supposed to how am I supposed
to deal with this I need a spoon to eat
the rest of my salsa and chips
and someone figure out why it's crashing
pointer these are pointing
some pointers are not pointy
some pointers are zero
let's see if the pointers are pointing
uh okay
foreign
oh I mean I could try unplugging and
plugging back in
did I get this error last time
oh same bus error
oh
I mean maybe it's like an old version
let's try this
it's a model we wanted to run anyway
okay
um assertion failed input equals null
Ah that's just because I didn't give it
up
that's actually also not what we want
here
[Music]
um
that
because there's this model here and this
model here only has an input shape of
one
okay
um
assertion failed input equals
it's probably not what we want
oh that's what Reed does
serving default dance input
uh oh that's because the input type
tensor is not that
banana
I think it's because the input type
tensor is a float in this case
just say like input.1 you can say one
two three seven
did I guess right come on Google
uh I don't know well we want to keep
that assert input
doesn't that work
no so hang on we may just not care
wait I understand why it's not printing
for that stuff either
did not actually run the model
oh this crap like may not be quantized
for the edge TPU
actually I think I did that because if
we go back here I just want to compile
again
I don't know why I never got my custom
models to compile
yeah input inference type in a
oh maybe because it's an end date
I think it's this but
anything's possible at zombo.com
oh
okay well that worked
because it's an intake not a you in date
boys
a lot of people don't know it's kind of
redundant
[Music]
let's put a slash on there
guys it outputs six
and if you're not happy about six well
you got the wrong thing
let's put a different number in let's
try putting in 10.
oh 15. oh
no guys 666 doesn't fit 42 does though
um
running custom model
I worry that it's not actually running
it on the edge TPO uh
you guys remember all the uh
remember all the uh the the the uh lives
we saved when we changed Master domain
saved a lot of lives boys
should be proud of ourselves
uh okay question
is this thing actually using the edge
TPU okay watch we're gonna try some I'm
gonna unplug it now does this still work
man if it still gives me 15 why did I
buy this thing
the hell
I spent all this money on this thing and
it still gives me 15 when I unplug it
I know we got scammed boys we got
scammed
uh wait no but no okay so something's
wrong
is this why this didn't work
great
no I feel like we have to compile it for
the edge TPU
oh here we go
oh I remember this garbage
does this get open sourced
what
oh this is what I had to run in Linux or
something
no
foreign
I'll have to go
uh
in a minute I'm getting a call
uh
TF light to Edge TPU
oh it requires you and eight well we'll
start with that as a problem
yes
you indeed
and then we won't have that other bug
before
why not Target the neural engine don't
talk to me about the neural engine I
wasted a ton of time like you you just
you can't even get uh
Apple added so much security and like
you disable amp fee and then it's just
too much work
you you there's Security on your own
computer you have to basically jailbreak
your Mac and I don't do jailbreaking
anymore
uh
okay well that still didn't make it run
but that's a good start
[Music]
foreign
no
tiny grad sponsored by Apple if they're
interested like I said anyone who wants
to reach out to me I'm interested
uh
yeah okay this isn't gonna work until we
get the edge TPU compiler to work I
remember wasting time with this last
time
I mean we could just go for it right we
ready to just start reverse engineering
this like we know what the net is right
okay we can try a different approach
there's another approach we can take
which is that we already have
which is that we already have everything
we need because this legitimately runs
watch I will prove to you that it runs
on the edge TPU because if we unplug it
you need to buy Google
for cute man I love older me I love
younger me leaving me funny shit like
that yo younger vehicle
I swear this is the cuckoo Carl
um
hey I mean like we might probably have
everything we need here to reverse
engineer
shout out younger me
all right uh what's a TF Lite file
python open TF Lite file
you can use the tensorflow Lite python
interpreter okay let's try it
we'll call it parse I love the generic
names they're giving to thanks
come on Tab complete not fine don't tab
complete I want to use a fancy editor
you know I figure fancy editors could do
things like that not let me go all the
way over there you know
oh I I hope you guys enjoyed uh
okay
we get input details and output details
why don't you use the
all right
that seems like something
uh test model on random potato okay
let's try that
cannot set tensor tensor is unallocated
encountered unresolved custom op Edge
TPU custom op
hel that's exciting
oh and actually I think we have
documentation on that
because I've seen that before if we go
into lib Edge TPU
because they're custom off is that thing
that we register here
no it's not that it needs the problem
was not that the problem is literally
that there's a file that's signed with a
restricted entitlement
um the stupid library is signed with a
restricted entitlement
uh and uh yo retiring progress what up
I don't know your stream but thank you
for the raid uh we got some new people
in here hi my name is George
um
I uh
I'm 33 year old man
uh I program if you don't know me
uh today we bought one of these things
actually we bought it a while ago so
it's a lie I don't think I bought it
just for the stream I did buy a TV never
mind that's too far off topic you guys
are new people this is a Google coral
and we're trying to write our own driver
for it
uh so we have a driver that actually
works
um but it only runs one model
you'll see that right here it can tell
you that a picture of a banana is of a
banana and if you have your own Google
coral and you run this and you change
this from a picture of not a banana to a
different picture it might tell you it's
something else
uh so now what we're trying to do is
yeah
um
we are trying to dissect the file that I
downloaded because the compiler only
runs on Linux and we don't have a Linux
compute over here on a Mac
uh
so yeah
we're trying to dissect this file and
see what's in it
of course every time we run this it
takes three seconds because we have to
wait for tensorflow to import and that's
part of the reason we're writing tiny
grad which you got to go back earlier on
the stream if you want to understand
what it is
uh get input details blah blah blah blah
blah blah blah
TF light interpreter how do I like go
through all this thing oh
I guess I could register the custom op
I guess I could use the
I wonder if this works
okay let's read this code here
in Edge TPU the httpu here
for register custom model okay so this
is what's being called custom
of course it returns some fancy struts
create a new operator
downcast
I'm on prepare data direct find this
custom Op with a particular driver who
writes code like this
I remember being mad last time I was
reading this too
get job oh and that's why it didn't do
anything when I uh
ran the thing because because it didn't
have any custom Ops
all right let's just see if we can parse
this the TF light file
um you can use the TF flight
set tensor invoke
we won't be able to like just iterate
through the model and I want to see all
the operations can I do that
get all details
I don't like that it has an underscore
in front of it
take some parameter
corners of depth
okay input details get signature list
get tensor details I don't know what if
I just do get tense of details about
anything
input
no that's just the inputs and outputs
get signature list what's a signature
list
why are you doing some notebooks you
want to restart it every time yeah it
sounds smart
um
we don't have any signatures
how does anyone code any of this
my eyes just hurt looking at it
maybe I can like register custom op
details
get a dictionary
with arrays of IDs
oh gets Ops details all right let's try
that one that one looks that one looks
like it's good
okay great uh it has a single operation
that is an edge TPU custom op and it
takes as an input
uh uh tensor one and an output tensor
zero great
okay well don't you just love to see
that uh
uh no I don't think it's actually gonna
show me anything more than this
right
self dot interpreter
well there's a secret interpreter
underneath The Interpreter we'll call it
real interpreter
we'll call it RI
foreign
runtime error there is at least one
reference to internal
data structure in terms of a numpy array
or slice
okay
proprietary Malad secret Google only
Mall ads you know
um from an interpreter wrapper
no name node inputs
node inputs there's gonna be like no
data or something
Let's test this make sure this works
okay node name is Edge TPU custom off
but that's just the name of the note
that's not really anything about the
node
there's only one of them
inside of an edge TPU
we have one op and it's an edge TPU
custom op don't don't you love that so
in other words this whole like format is
just Google like why did you I guess it
has tensors so
Google right a hundred thousand lines of
boilerplate uses a hundred of them and
makes you compile the hundred thousand
here we go
okay
satinum threads
this looks like junk
modify graph with delicate
turns a pointer to the underlying
interpreter
that's just for passing into things
hmm
it was terrible
uh okay what kind of file is it what is
a TF light file knowing Google I'm sure
it's a protobuf
Edge TPU custom op
ported from subgraph
yeah
there we go
[Music]
all right maybe we should try to figure
out why this one didn't work
read dot pi
oh geez man
okay
get an error what if I don't resolve a
customer
do I have like a version mismatch
yeah probably like a version mismatch or
something
error encountered unregistered custom
off okay so now I try to register the
custom off but then my interpreter
Builder crashes which makes me think I
have like the wrong version of edge TPU
or something
I got like a release of this
tags
okay you want grouper let's try grouper
foreign
is this like not linking to the right I
feel like it's like not linking to the
right tensorflow or something
did I have this problem before
[Music]
just building all of tensorflow
oh you tried you tried Neutron what do
you got just like stupid custom mop
HTTP custom one gotta love it great
that's pretty much what I found
it does give you the quantization which
is cool though
thank you
all right we're still getting a bus hour
here
did I just not do I have to like I think
I have to use a special version
this is
actually wait
is there just something I can link to
that's just here
that'd be cool
I didn't have to link to that
I feel like I feel like there's just a
version mismatch
like that's all fine but
in The Interpreter Builder crashes
because like there's something wrong
with the uh
Edge TPU
let's try that
no you have to add me off first
if you do add the op it crashes
ah
we have to build with here it is
um 15 xdf
TF root
equals dot dot slash
the TF light builds
let's hope this doesn't try to rebuild
tensorflow like because I feel like the
uh if the problem is it like linked to
some custom version which has different
uh
struck alignment so that's why I'm
getting that bus hour as my guess
I have no idea if that TF root actually
all
no okay I think I specified the wrong
thing
let's give it a try but
I'm just gonna do the same
uh get clean xdf
Queen
because TF root
is actually data slash tensorflow source
everybody's gonna give me some feedback
if that like did anything
[Music]
let's see if that's actually like the
right thing
it's definitely in there
work
no same issue
um
what happened when I loaded this in uh
let me be
a lot more about the era now
sub graph add node with parameters
yeah so just like
remember we have to try an older version
of tensorflow
I bet you that's it
this is to say which tensorflow version
it uses
that means you have to rebuild
tensorflow guys
and these people have to change the
bullshit back oh I can't tolerate this I
can't tolerate this
if you're using oh and I cloned it with
reference is not a tree yeah
[Music]
great
all right you're ready to clone all of
tensorflow
um get clump
we're gonna do this again I feel like I
probably did the exact same thing before
on on uh
I guess oh yes yes please waste 20
minutes of my life thank you thank you
for wasting 20 minutes of my life I feel
like I did the exact same thing before
well it only works with tensorflow now
soon it's gonna work with tiny grab
uh
oh is my forever good clone finish nope
oh this is the pi Coral API
what
is this a different thing I remember
struggling with this last time too
oh all right I'll be back guys give me
uh give me 15 minutes I'll come back on
stream
all right what up fam
uh all right we just had a nice
conversation
uh
uh
I know I'm just I'm just dealing with
spoke with TechCrunch no no no no no no
it's gummy reporter no uh so with
Kirsten chorus acting TechCrunch
it's very nice
um
pretty much I mean Harold and Alex
they've pretty much been running the
company for the last year
and no
more
about the consumer product
Vision than I do
and make sure I didn't write typos
building one's name wrong
we're good
all right hold up uh sorry I didn't even
get tensorflow to build we were close
but I had to go I didn't want to I don't
want to be rude on the phone
uh fuck man
why don't you contain shit
[Music]
smells like contains something
I just like the directions change here
build Coral check out tensorflow
Source directory does not appear to
contain C make list
build or do I have to use basil
I probably have to use basil
building TF light
I was talking to journalists is
exhausting
let me use basil
TF light run time
to build
natively
the project you're trying to build
requires a different basil okay let's go
to Edge TPU and let's check out this
tensorflow you think this tensorflow is
going to work
let's try this tentacle
yeah why no app get installed wouldn't
that be nice
go novel journalists guys not all
journalists
come on C make oh cement good
she may have pee thread guess we buy
nothing go to Prime anyway yeah my boy
foreign
uh we got throw some J's on that bitch
all right we'll throw some J's on that
bitch
I'm gonna lag the Stream
after all this who thinks it's gonna
work
getting back to where we were in the
last stream this whole stream's just
going back to where we won the last year
y'all am yoam you spent this whole album
yelling at everybody who said that your
last album sucked so what are you gonna
do with this album sucks you're gonna
spend your next album yelling at
everybody who I just don't think this is
sustainable
uh you know part of it part of me feels
bad about the whole Comet thing like I
wish I was just better at this stuff you
know
like sending the journalists along to
Harold and Alex we'll see how they do
you know something broken in my brain
guys
ah
come on Mark oh now this stuff
we'll stare directly at the Sun but
never in the mirror it must be
exhausting always
wow that's hard to sing
got a yell because stereo volume is slow
low it's me hi I'm the problem it's me
uh okay
oh it works
okay now we get a different error
all right we're past the first Arrow
try and plug and plug it back in
oh okay still broken oh I bet no no
that's fine that's fine that's fine it's
fine ah we just need to do if we do a
cert F here that's why
yeah that's fine okay
um
[Music]
sounds like I'm gonna go back to LA
that's what I'm hearing
uh wait what
oh
you know what I'm just gonna wig at it
just gonna look at it boys
I don't know why I just didn't work at
it to begin with
what is it trying to load banana.dat hmm
banana dot dad okay uh read
um
should I feel bad for committing the
banana
wait what why is there an assertion or
oh it's in data did I put it in data put
it in data I'm gonna go to data
data
data in my git ignore or something
data should be on the get ignore
now I'm going to unplug this and we're
gonna see if it works
yeah look it doesn't work now that's
right that's right because it failed to
retrieve the TPU context
[Music]
um
running with old school
uh
must use TF version yeah I don't wish I
don't you wish I labeled that before
stare directly at the Sun but never in
the mirror it must be exhausting always
rooting for the end
uh okay
and we'll be
okay look we wrote Docs
parses garbage
now let's commit it it's not too much
garbage okay uh
get checked out get ignore
and don't Ally we're gonna parties in
L.A maybe she has parties now anything
okay now another question
why did this not work
whatever I don't really care that much
about this because what I really wanted
to do was not even to sniff the USBs we
can sniff the USBs again elsewhere
what I really wanted to do was modify
not TF light but I wanted to modify Live
Edge TPU I just built that one with make
oh
some J's on that batch
I'm going to Li should we drive diali I
gotta get your car try that Porsche
oh yeah let's check out a Porsche let's
I think the mine on Porsche
watch I built this now and it like broke
or something
I wanna I wanna Boxster uh
uh 7 18.
yeah the streamlines during compilation
what do you think of this
oh this one's new
oh it's pretty good man
that's the GTS
oh it's automatic though I don't want to
automatic
I'm gonna buy a Porsche you know
let's see let's go
or Shay what do you say we take the
train to LA and we drive back in a
Porsche
uh
such bad reviews
wait I'm kind of really feeling that
I'm kind of really feeling that
what do you all think
what do you think
will I be happy in my midlife crisis if
I buy a Porsche
I don't need that series man I won't get
speeding tickets I'm happy in something
that's a little zippy
future use gonna buy it all right let's
go to Beverly Hills boys
that car is sick right I think it's
beautiful look look you hate oh come on
the boxer's not a real Porsche man you
know you buy a real man Porsche I want a
Boxster okay and fuck off you don't like
my Boxster right
oh I love that color too all that gray
oh that looks good I just hope it's real
all right let's see do we have the VIN
here yeah let's take a look all right no
I'm not gonna find out someone crashed
it
aren't they
what I just wanted to Pace the VIN get
Carfax reports yeah then all right let's
go
oh come on come on eight history records
come on tell me did it crash
oh
oh pay that does anyone have a
subscription to Carfax it just wants to
do that search for me
wait no it's not red is it only a red
one
foreign
cars
I like you can't start let women run
your life boys
hmm
oh I'm not gonna plant I don't want
Tesla all right I I don't say I don't
think they're that nice of cars all
right but we're not we're not doing
we're we're working we're working we can
talk about my midlife crisis later
let's put some prints in custom op
invoke
system updated direct user data
I gotta put an F on that print
should I buy Porsche boys we buying a
Porsche
we're being harassed by some uh
some some lawyer shit you see a custom
op invoke there
uh
[Music]
uh misclassified Pace unbelievable man
I don't like electric cars boys I don't
like electric cars I like polluting the
environment right up until they make it
illegal
uh buy a Lambo
should I buy a Lambo which Lambo should
I buy now now we're talking now we're
talking what Lambo do I want
oh no this slow to the ground oh look
look I just I just see this bottoming
out I see this bottoming out and we like
pulling into some driveway and fucking
up the bottom of my car and then being
upset
the take-han's actually pretty good but
I don't want an electric car you know
why because I can go you know man the
electric cars are just so government
someone's gonna clip this someone's
gonna click this and take it out of
context this is why we don't allow Clips
man but so we're gonna do it man you
know the electric cars man they're just
they're just for the government to to be
able to track you and know that you know
you can't get away man because your
range is only 300 miles and they're
going to turn the grid off you see me I
got I got my truck with with with Jerry
cans all in the back and the that's how
the government can't control you man
first it's an electric car and then it's
a chip in your brain and then they're
fucking your wife man
thank you
all right
um
yeah 500 Miles bro that's going to get
you all the way to like San Francisco
Maybe
notice how it printed
okay
this doesn't even do anything
this is the most useless was this didn't
you do anything
get driver or mapper invoke executable
okay
okay here's the node user data custom op
user data Direct
executable Nom input layers
attach inputs to the request attach
outputs to request
relayout
oh here we go
driver execute
submit
so you see we're modifying the TPU
driver so we can try to figure out if
this could be parsed at all
so it's not just a binary blob I mean it
probably can because it's actually
submitting those things
forget the car just sell out and get a
job at a Quant for it Bros I'm done
being a bitch to ambition I'm already
rich
oh I gotta do printf
some crypto guy was uh
Nikolai dead
is this C no your C
have I been in a plaid no to be fair I
haven't been in a plaid but
um
what I will say is my experience with
Tesla is I've been in a three and an s
and you know they're just not
they're not like refined cars
here okay this API request
oh here we go
add input add output okay great useless
um where is this execute function
is it this
submit
what's Trace scope
Trace scope critical
you know George why don't you learn to
use a debugger not just put print
statements everywhere well shit man if I
had that kind of patience I you know I'd
still be running comma
um inside materials and soundproofing
have been increased nasally in the
flight yeah but I mean look this still
doesn't solved the problem does it have
a gasoline engine
and it's not to look there are benefits
to electric cars but you can't take them
on road trips like you want to sit at a
supercharger for 30 minutes you ever
done this you're like oh it won't be so
bad it's only 30 minutes and then you're
actually sitting there for 30 minutes in
a supercharger and you're like damn you
know I had an option in cars and I could
have bought a gasoline car when they
make a car that charges in five minutes
I'm interested
when there's an electric car that
charges in five minutes I will consider
an electric car
okay we've made it to driver cement
quests get priority
submit inference request
do create request prepare TPU requests
oh yeah what's a TPU request what's the
type of this
platforms Darwin TPU request I have an
idea that's a different Darwin
TPU request mmio driver do submit we
have to validate and prepare the request
and then the dma scheduler comes in
dma schedule
disable clock gating so the chip is
accessible while the request is built
try issue dmas
try issue dma's
all right let's just read let's just
read this drive for a little bit
driver
and we'll just guess it where it is and
then we'll see if we made it there
oh they have a battery swap great I
gotta show up to one of the three places
that's still open so some guy can
unscrew my battery and
yo gasoline cars boys
gasoline cars look I'm not trying to
hate on like all the hippies I love
hippies man we love hippies y'all know
we're Progressive but
gasoline car George doesn't like remote
work and will and wants to drive in a
gasoline car he's so fast
yeah no I think lambo's a little cliche
and really impractical I think my
Porsche Boxster assuming it didn't uh
get into an accident will be a great
choice okay
what's a single TPU request
you know what let's Vlog let's just turn
the Vlog on
how do I turn Vlog on
get logging level set logging level
where do I set the log level
four that sounds like a good log level
what do y'all think
what about a Ferrari
what Ferrari
again
no remote works a bad idea guys
you know and and the real problem people
I you probably can't see me right now
because it's compiling
um
what kind of culture do you build at a
remote organization
come on oh look at this
oh look at all that oh man so happy we
didn't waste lots of time
let's take out all the stupid print
statements I don't even need any of them
okay
put map scratch linking parameter
uh
okay how come my things are not
intercepting the USB calls correctly
I run dialed Force flat name state is
uses lib USB right or does it use the
oh this is love USP
can you put comma on a Ferrari I could
put hamsters on a piano bro
um
okay
what are those transfers
just put some
in Seas end how I'll send
Dev dot right okay so that's just a uh
the bulk out transfer
oh wait if we just set Vlog to 10 well
we just didn't say we just didn't put
enough Vlog in here
255. that's good
can't have more than 255 that's weight
that's more log than anyone would need
who and why wants to build culture at
work and see that is exactly why I don't
want any remote employees
you know because you people have this oh
well work is just this thing you do and
then you have life hedonistic piece of
shit man you know life is work
oh nice okay
well this is almost too much
10.
everything's more than 10.
of course Google would have an insane
Weaver boss I should have just thought
about that first
um
prepare header
USB
demands
our USB ml commands that makes more
sense
at least hedonists are honest yeah you
know what you're getting close to God
that way
Ctrl P how do I do how do I open
what is it open
only open a file
what's that what's the
oh yeah those are read register
thank you
command P I'm just addressing that
oh command P thank you
we're gonna like list all the
commands
[Music]
prepare head
are those the same headers that I have
here no they're actually in the file
well this stuff's actually in the file
um
life is work schedules what's up
prepare had our async bulk out transfer
doing things to be like a good how does
any of this code work
foreign
Alex sent a nice message back to the uh
Porter right see that's you got a hand
off you got to hand off the World
building you know
you know you gotta head off the World
building
like what what you got a commies you
gotta name the people something like
tweets you know
sweeps man how am I tweeps man I learned
that in management 101 at Twitter ah
what advice
would I give
you know what would you guys pay if I
did private private advice sessions
hundred dollars for 30 minutes
if I did if I did prime or what do they
do 100 for 15 minutes well the ones like
you like talk to the people
if you want advice
yeah they gotta monetize advice
guys I gotta afford my Porsche
what are these registers I I remember
this from last time too it's like great
oh oh they're beagle APR Apex CSR
offsets great
[Music]
I'd pay for you to shit all over me yeah
bro it's called Finn Dom bro all my pay
pigs give me money
I wonder if that actually ever works
it's probably like one girl out there I
worked for
look at the questions be about oh no man
anything you want
oh these are the names of the things
before you went to RIT how could you not
afford
foreign
we'll do no but see the thing is I want
to see you and I don't know how to set
any of that up
all right if someone like posts Zoom
link no but it was awkward when I did
these calls in front of people before
it's awkward
you know because then you get like is
what parasocial activity
oh this is a lot of stuff
all right I think a lot of these things
are uh our registers and like I looked
into them briefly
do these numbers match those
yeah these are the registers okay okay
cool
um
is that one not in here the first one I
searched for is not in here
I'm here this is SCU control
should I write something to parse this
and then print out what these things are
yeah there's enough of them it's
probably worth it
Eagle CSR offsets
it's probably worth parsing all right
um
foreign
[Music]
wow Wikipedia's got to be wondering why
I'm downloading that banana so many
times all right we got to convert those
numbers into names let's go
do they all have the word no lint in
them that would help
yeah they do
uh X for x and if x if
no lint in x
um
let's not do X in
let's do
it
what
how did that seg fault
I don't even want to talk about that
um
4X and
if
X
dot split
I gotta love the one-liners boys gotta
love the one-liners
rip dot split oh yeah now we're talking
don't worry where do we use this thing
set up
printing that somewhere
uh we do want to also say right equals
um it's X comma 16.
let's do a dictionary comprehension or X
comma Y and Rex
okay
uh
okay we go set up
hex regnum
uh reg subregnum that's just gonna work
uh right subragm if uh
know
all right
this is what we're setting up now we
know
all right if it's ever there we don't
know look we set up the ink controls the
rimbus controls
do I feel liberated by leaving comma
yeah
uh I don't know like you know I'm still
gonna be involved but
when you were young what did you want
your life to be and are you happy
I'm pretty happy I don't know
I mean
damn corporations don't accept hacky
code no of course not
I mean you shouldn't probably accept
hacking code either like when you look
at like tiny grad it's like good it's
not wait what oh
for some reason that one didn't get
[Music]
things wrong oh just because it has a
comma there
um
yeah okay we'll just do this
that should be good
and here we can say strip comma that
should work
invalid literal
did we get them all good we got them all
all right let's just get rid of that
just so we don't uh
get rid of that unknown thing
it was masking a bug
corporations don't like khaki code
[Music]
Oh I thought that I wasn't happy with
the progress It's just guys like we want
to ship a hundred thousand of these
things and it turns out shipping a
hundred thousand or something requires
lots and lots of bullshit uh like who
wants to deal with the supply chain to
buy a hundred thousand parts right and
there's that whole aspect to it and then
there's a whole aspect to it of like
well
shipping the models becomes really hard
you know you just have to do a lot of
testing you're pushing on the last
couple of nines you know real
engineering right like there's hacky
code there's not hacky code and then
there's like serious engineering efforts
and
George hotz I'm not a serious engineer
make the hacking his people so happy
um
no comma that no Comic-Con bro the
company's not me okay
like they might have a Comic-Con I don't
know on the companies like I think 23
people aren't there now you know
hate when people think it's me man
George left Comic-Con is on the downfall
I do think Tanya took it a little far
but you know like let JB yeah man let
yavi
oh ouch
our register is finally
so now
we send these two things
and then we send all these things and
one of them is the image pixels
let's figure out how to parse these
things
getting First Response
my
sending minus one
that doesn't seem right
does that will not do anything
where is that one
oh
oh okay it's all Ascend because yeah
yeah okay that's that's the user data
that's the image pixels that we sent
literally just the image pixel so
there's nothing special there
it does look a little weird though oh no
because it's not actually the data
um let's actually dump some data
foreign
for some reason
oh
um
yeah I thought Lex did a great job of uh
of talking to Kanye
foreign
so this is what's being sent I don't
know what this num is
these are like to like
ports
like sets up a program
so the way that I wrote this last time
this is actually I did this on stream
you can go read it uh the way that I did
this last time is I just wrote
um
I just basically wrote a Python program
to mimic what the C program was doing
and it worked
[Music]
so like I'm trying to figure out I don't
really know how deep uh like this driver
even goes the all the good stuff may be
in the edge TPU compiler
uh which we can look at but 40 seconds
okay num zero starts with 80 oh F okay
so num zero seems to always start with
oh when I see this header is just this
is just the length and uh that's stupid
that's the line that's the num
um we specify the num here so it like
loads into like buffer zero buffer two
buffer zero buffer two so those probably
actually mean something
you can probably find out what it is
uh so we can see sand I'll send here num
is here
uh header
oh you're like right okay it writes to
end point one the header and then it
writes the data
here prepare our header maybe this is
Edge
header hex
are those the same headers
oh string read registers too oh some of
these are read registers
I say
and I just ignore them
what do I just do right anyway it
doesn't matter
maybe I do it the right way
it actually reads
I I don't think it's an IP
I don't know if I have anything
yeah yeah no I watched half the carpathy
one
I gotta finish it it's long I was really
kind anymore when I was driving
prepare header
yeah okay so these are the headers right
I think we can actually find b121 I
think we can find that yeah it's down
here okay good
pair header
dma chunker
in the DNA chunker
[Music]
descriptor tag
okay it's this it's this descriptor here
we go instructions activations
parameters all right good good good
um
so we can just write that
guys we're reverse engineering we're
reverse engineering
uh
what are these things called
descriptor tag
wow this is before I started using
format strings everywhere I can't
believe I ever wrote things like that
goodies the F strings the F strings are
so much nicer
okay so now we're sending parameters and
stock instructions parameters
instructions input activation parameters
instructions parameters instructions
parameters great
um I assume actually to read is no it's
actually different endpoints okay cool
guys I don't really have anything to say
you know I'm washed up right
I could talk about it I'm interested in
the chips all right like there's some
good progress to be made on the chips
I'll be happy if I get this contract
uh with the current globalization
imagination and the Zeitgeist most
people have a proclivity for minimizing
your agency in a world that's
diametrically opposed to Human Nature
look I mean
with a lot of this stuff uh what I kind
of read There is blame for somebody
and like who do you really blame right
like it's not it's on somebody doing it
it's just kind of the nature of the
problems
uh and kind of the nature the way we
structured Society right
um I love when people like uh
Robin Hansen like people like like
someone say like when you just structure
uh Society in a new way that's not
capitalism and Robin Hansen says oh well
this is fine but okay like let's talk
about the economics of that society and
they're like but but we don't have
economics and then no but you have
economics you just don't always know
what your economics are
um
all right so
like your your subject to the
constraints of Economics regardless of
what you do
you see it like that I think it's a lot
more
you know the kind of stuff that happens
to to me here is just maybe like you
just see that I'm a lot more public with
it
uh I think a lot of people this kind of
stuff happens too and you just don't
really hear about it you don't really
hear about a lot of
uh startup Founders and like what sort
of happens
you kind of do but they try to generally
like
people try really hard to paint
themselves in like a nice light
uh and I don't know I mean I don't
really have the patience for that
like I'll do a little bit but not not
like majorly but there's no way I could
get on the stream and talk for hours and
like lie to you
that's probably true about everybody who
streams and maybe that's why it's
popular
um
you know
all right we got registers we got
the names of the stuff so we have K
instructions and K parameters
all right I bet the interesting stuff's
going to be in instructions
that's a lot of instructions
so like for the reel for the big tpus
um
they have almost nothing uh like the the
actual TPU Hardware is very uh
simple yeah I'm not happy about this I
feel like we're gonna have to go to htpu
compiler
they didn't open source it ever did they
like all the Magics in this thing
I love docker
and Dell development tool
looks like crappy ADV
having kids changes the motivation to
your brain
look I don't know about that
having kids is uh
and maybe this is why you know you have
the uh
the fertility crisis
um
[Music]
it's uh it's not a good investment like
it's not a good uh it won't make you
happier
but to be fair neither was joining a
company
we're using our Elite hacking tool
strings
probably where all the stuff is to
understand
or we could do some black box stuff if
you want right like so here like this
looks like the length of one instruction
and then that's another instruction
foreign
so
it looks like
I don't know about that actually
um well let's try dumping more
knit game children are a burden but then
it becomes better I don't know
okay
what instruction set is this
is this a real instruction set
like is this what if this is just like
this five or or
um
[Music]
I don't think there's gonna be much
inside in here
with their K instructions so maybe we
can
map instructions
oh so that's just gonna do a different
endpoint
oh it's in single bulk endpoint mode
very important do we support that
this would be a cool thing if we end up
supporting it you know
there are a lot of these out there
and there's so much
all right should we load in guidra
no we shouldn't load it and get your we
should
load it in docker
do I have docker
I should just like I should just know
how to do this kind of stuff what
uh launch Docker shell
Docker exact command with a container
oh container
oh we have to dock our executive
Docker name is not running docker
get your definitely has an NSA back door
do they even need a back door at this
point the NSA can just call it ass you
know
what they want
to imagine the NSA just like
hit you up and uh
yo guys I'm talking to someone from
Nvidia too
should we should we should we hey do we
want to work for this do we want to
write tiny grab for the startup or do we
want to write tiny grad for the uh for
NVIDIA
no such container Ubuntu
ubuntu's real
I'll have to do like phone call
no such container vocal
Ubuntu colon vocal
or do I have to like get the Yukon to
oh who knows how to use Docker I don't
know Docker PS it doesn't have anything
how do I get this container
you want the latest
I have to like download the container do
I not does that work
container do run instead of exec
great
uh we don't need latest we want focal
okay now we have the edge TPU compiler
where is this crap
we want to figure out how to
a link of thing into docker
uh we'll put it
Edge TPU did I do all this last time
well I should have documented it better
Google tutorial Edge TPU
uh this is right
oh no but it's x8664
oh
Docker x86
Mac M1 there's a way to do this right
platform
oh come on oh please work
please just work man guys guys we will
sing the Praises of Docker on the next
seven streams If this just works
where'd that go
my Docker go
I don't even care if it's vocal anymore
uh chat proxy view info
no I don't know what is it you name a
x8664.
that just worked that's awesome
yo that's so cool
where are we
uh okay now we just have to figure out
how to link in
Docker mount
opposed to the IR
s
no no I use V how do I do V volume it
feels would be the correct order the
first real is the path on the host
okay
um
bro bro wait can we just talk about how
amazing Docker is that that just worked
oh that was so good
oh that was so good
let's throw another one here Dash B
B
sit bro
dude
oh you gotta love it oh you gotta love
it
bro I love the M1 and I love Docker I'm
I'm rediscovering my love for computers
all right now we just gotta enable
verbosity to 7 million
the model Edge TPU already
oh I don't have any tier flight sorry
I don't know why they're logged
my log not there
um
that was the best thing I did all stream
guys
where that platform flag bro
I just want to say for a minute how much
effort went into that and how much I
appreciate you know all the people who
like made that work
okay uh there's probably commit there's
probably Flags
where do they hide them
I I I did this for there was tons of
ways to enable lots of great uh
Flags in the real TPU compiler in the
big TV compiler it's probably similar
stuff here
for like log
[Music]
yeah if we miss the line man
for Greece Ballard like
all right how do I enable the logging
well first off I'd be interesting to be
able to read these files to not have to
use the uh
hi George I'm Mark from docker's
licensing team
wait is this like a meme where you
actually marked from docker's licensing
team
what what is what am I Licensing in
docker can I like print some stuff
find him
uh
Edge TPU run time
no there's got to be some some Flags to
enable output
foreign
debug info in mlir
unrecognized extension in linear solver
debug dump model on
we gotta find the secret options
debug annotation pretty print debug info
debug string
Google also log to standard error did
you see that
I don't think that doesn't even seem
right now
that's cool at all but can it multiply
our Matrix yeah somewhere deep down in
this pile of garbage it can multiply a
matrix
of course I can't ask trace on here
I mean not of course but like
all right all right uh Docker just went
from a 10 to a nine because I can't ask
twice
I'll just rest again that's a pretty
good idea actually
does someone want to load it up in some
reverse engineering thing
or do I have to load guidra myself
you can s trace and Docker with extra
flag
neural FPS thank you for gifting Subs do
you have a question
and these subgifters before if you're
still around you'd like to ask a
question
give you the binary you found it oh cap
ad says p-trace that's cool but I doubt
that works on the M1 maybe it does
actually I know it probably does
actually because it's just that uh it's
running in a like a
virtual Linux
um
[Music]
oh fine
[Music]
what was I working on last
oh shit
[Music]
I gotta wait while it loads in you uh
foreign
no I mean questions are allowed if you
gift Subs they're usually not allowed
like we got to be nice to the people who
give Subs who keep the stream going and
help me eventually one day achieve my
dream of purchasing a Porsche
it's so dark in this room all the time
um still analyzing shouldn't be in on
here we go tempter
temp
temperature
okay maybe we said tempter
foreign
temperature now this is just some get
tempter garbage
uh what are these
test temperature
temp
export hda3 temp
and temp
okay a lot of temp stuff
what's this
ICU time zone
probably not that
this one
test temperature no
you think you just got a long way before
it gets to Ida
it's okay
it's decompiler is better
CC
n curses
honestly I like strings better
strings
you know you want to be a lead hacker
bro strengths get good at strings I'm
not good at strings but I aspire to be
good at strings
there's all this tempter crap
there was ways to enable this is how I
got the a e stuff too the Apple
neurology and stuff there's ways to
enable all this debugging
come on you no Trace level
oh you know what okay here's another way
to do it now that I've done all the damn
effort of uh loading this thing in uh
loading this thing in uh
ghidra
foreign
I know I didn't finish the processing
it's a large file of course it's Google
it's huge
a little buffering will fail for this
file due to misalignment
foreign
thing you can do when you have uh
something loaded and once you've done
all the work load it in you can look and
like just find a print function
so here
probably this
and then
I don't know about that
that might be a real error
if you can find ones that
hate that
okay
maybe this is Log and that's the log
level the first one
my dollar cost averaging my meta shares
I'm not doubling down I bought some and
if I lose it I'm riding it into the
ground
come on just just how do I enable the
there was some trick you know what
I had some trick here
uh
yeah TPU Vlog level well let's look for
Vlog where's my Vlog just search for log
though great not a thing yeah if you
enabled this TPU Vlog level
uh it was really useful
but
Google might have only did that because
they think no one could see that one
because it's on their servers but you
can just rent their servers
you know what at least once we get this
once we figure this out I mean this is
looking similar to the Apple neural
engine but at least once we figure this
one out
um it'll just work
right because anyone because the USB and
it can't really even be changed like
because I can just save the old firmware
uh and it's just USB I can use it from
user space right it'll be totally
cross-platform Windows Mac and Lex it
windows
um okay I don't know I mean at least
maybe strings will be nice to look at
here guys all I use is strings okay
okay all the hacking I did in my life
was just strings
okay
so where does this get printed
here
this looks like a nice thing that like
prints something
we just need to figure out how to print
how to enable this
look yeah there's all this stuff
if we just enable the printing
how am I supposed to find that
verbosity yeah okay we're going to try
oh the word verb doesn't exist
maybe let's Google it uh Edge TPU
compiler logging
I tried using Edge TPU compiler it
doesn't work
please turn off mlir
thank you it works
please try using new compiler version
transpose Ops which are not support
it produces a file with this memory
profile
foreign
like anyone got any more outputs out of
this thing than that
[Music]
cool compiling multiple models
I mean
we could do complete uh like black box
stuff we can just start
um they're into a single magical Edge
TPU block
we know about those
did anyone get this thing to do anything
more
Dash essay I don't know maybe that does
something
[Music]
the a seems to break it
what does a do enable multiple subdrefs
experimental flag
show operations I don't know what I put
in s23
didn't like that
wait oh oh Trace log file in it oh that
sounds nice
a trace that's a good word to search for
um
I'm actually not sure
I don't know okay maybe it's fine
that's not referenced anywhere
oh DOT log
yeah well okay but no dialog is not
useful
um
because we do have this log it just
doesn't have much in it
foreign
by the way did you ask your question and
I missed it that's very possible
uh no tfl.log is log it's actually just
tensorflow log
see the operations log file
like okay it has words like K tile
prologue dma how do I ever get this to
print out
yes
oh here we go this this is a good
function
k out feed look at look at all these
great things
[Music]
this it's got to print some stuff
sometime
I missed your question all right what's
your question tell me your question
ask it again I'm not going to read
scroll back
oh this is frustrating all right
there's no real objective way to measure
intelligence bro
who told you that
I choose not real man they just made it
up to try to oppress people
I mean it doesn't cover everything but
uh oh yeah brain machine interfaces
um
I'm definitely not getting the first one
uh you know non-invasive is a good sell
but even non-invasive kind of sketchy
uh-huh yeah I think I'll be on the uh
like 100
000 people have it I think that's where
I'll be that's where I'll be on the uh
on the on the adoption curve
okay this is logging
why is it doing mod
this is logging guys why why what
is this if the login's enabled Ivar 3
I hate that that doesn't highlight
we're going to enable all vlogging and
we're going to be so happy
the only objective way to measure
intelligence how fast you can solve a
Rubik's Cube that's fair
like this is some print thing but
um
oh come on now they have to just have
something
there's a chance we have to do a binary
patch to the program
creating buffer
and then it checks this Ivar 13.
how do I highlight this
you know what's really nice and
Ida will highlight it
ten thousand different kinds of
intelligences
foreign
it's almost dinner time guys uh
oh yeah you didn't gift a sub you don't
even have a sub yourself you don't get a
question
Edge TPU did we just try searching for
Edge tpud compiler
no
p s d thank you for gifting Subs you get
a question
again hop out for dinner
then you don't get a question bro
if you can't afford five dollars why
should I answer your question
you're not helping me Tacky on Ray thank
you for gifting Subs
um
we love when people gift Subs
all right I think we've moved on to
question time
um
thank you thank you for watching
I'm jobless yeah guys
uh I don't know
well okay at least now we can compile
arbitrary models
so let's just get that Docker script
working
uh htpu no I'm entitled
we should at least figure out how to
like parse these out to I wonder how
hard that is
you know so then we can run the model
without having to load it sounds kind of
annoying
um
level three hype train all right
oh bro I'm gonna Flex on the haters so
hard you know I love flexing on the
haters
why are you choosing this I don't know I
just thought it'd be a kind of fun chill
stream uh while we talk about this kind
of stuff I don't know how much I'll keep
working on it who really cares
unless unless
Google
would you like to sponsor me to port
tinygrad to the Google Coral
uh
no seriously uh wait what color is my
Porsche gonna be no no no no I want a
boring color so I don't get pulled over
too much uh no but Google
uh would you like to sponsor me to
continue my work
uh I would I'd be I'd be very happy
um this one I'll do for cheap uh but I
do need some documentation I'll do it
for more if you don't want to give me
any documentation
um but I can have a full uh stack
running on the Google Coral
which will let you run arbitrary things
uh arbitrary neural networks uh think
about how much more accessible hang on
I'm speaking your language
accessible your chip will be
to
um to to to communities
right no serious now serious your chip
will be more accessible to more people
uh if it works in tiny grad imagine all
you had to do was pip install Tiny grad
you didn't have to compile The Edge shit
compile the tensorflow Lite and like
yeah sure if you're on Ubuntu maybe
there's an easier way to do it but come
on everyone's got Max bro
so uh Google if you would like to see me
continue my work supporting tensorflow I
said Tiny grad on the Google Coral I
understand that you make a competing
framework and I understand that you want
people to use tensorflow but but but you
saw what I was subjected to is this
really what you want to subject other
people to or do you want to make it easy
to make your Google Coral accessible to
millions of people
I heard that your new company Mission
was to be good and it'll be good if tiny
grad works on the Google coral and
you're sponsoring laughs
um Nvidia if you'd like to see Google uh
uh not Google if you'd like to see Cuda
support in tiny grad become good you can
you can sponsor me
um if if
AMD you don't even have a stack AMD
legitimately should sponsor me for some
reason I feel like you're the least
likely to do it but you should
um so I will support your weird
accelerators in tiny grad and you'll get
a whole new stack uh working for your
thing
um this one I don't know I'm gonna maybe
maybe I'll go out to dinner and then
maybe when I come back I'll uh spend a
little time off stream trying to find a
debug flag but if there's no debug flag
like do you want to sit and reverse
engineer uh you know how many
billions of kilobytes that's not
billions but like still that's like
that's like like I don't know a lot of
kilobytes man it's like 250 kilobytes of
instructions uh so I don't know if
that's what I want to do oh hey oh it's
Google oh oh Google wants to oh no it's
not Google sorry
um
yeah this is someone reaching out who
wanted to invest in cherry
uh
uh oh shit
[Music]
um yeah if if actually you don't even
have to be Google
um if someone would like to sponsor me
it's probably outside the realm of an
individual I can't imagine why an
individual would possibly care if tiny
grad supported the Google Coral but
think of all these accelerator sticks
that have will sit around in think about
the sustainability aspect right come on
am I appealing to Modern corporations
guys the sustainability if you could
reuse these USB sticks without having to
compile all those weird uh drivers
uh you can just use it simply from Tiny
grad I just would like to show you how
simple it is to use with the edge TPU
X-ray and by the way in before it only
works on bananas I'm going to find a
picture of an apple
Apple jpeg
look at this apple
honey crisp apple
and we're gonna try right now live in
front of this live studio audience
running on the edge TPU
Apple now to be fair
um it says that it's a Granny Smith
now now now look I don't know I don't
know about you guys but that's not a
granny smith it's a Honeycrisp but at
least it's apple right right
um
you don't have to appeal to
accessibility and sustainability purely
ironically
that's not ironic it's a stream
it's real it's just like just like no
you know what you know what it is you
know why it's like it just pisses me off
because like you make all these like
lofty fucking claims like you build a
stick that could mildly accelerate you
know compute on like stuff it's actually
pretty probably pretty useful on like
Raspberry Pi's and stuff but like
um think of how easy it'll be for people
to just pip install Tiny ground on their
Raspberry Pi this right here is the
easiest way by far in my Edge TPU x-ray
Reaper to use
the Google coral and if you want this
easiness to extend to say stable
diffusion
oh crap wait if I'm going to support
this entire grab we got to do something
about the fact that this only supports
ins
I'll have to make types work in time
grad wow that sounds like some season
two shit by the way HBO look look I'm
not even gonna hate
if you sell me season two of White Lotus
I'll pay a hundred dollars
I just want it all now I really wanted
to keep watching it last night when I
found out you were releasing one episode
a week I got really upset so if you want
me right now to uh give you a hundred
dollars I just want to watch all the
white noise and that's it
[Music]
um
what's the foundation for your ambition
did you gift Subs you got to give 10
subs for a question that's stupid
um see like when you ask me a break if
you're nervous that's a real question
I'd come with a real answer to that uh
um all right
uh
to come AI archive look if I'm streaming
a bit more I understand how much effort
all the time stamps are only do it if
you enjoy it I only do things I enjoy
and that's why I don't manage people
anymore that's why I sit here and hack
Google corals
uh and enjoy life okay we're gonna go to
some parties in L.A I'm gonna buy a
Porsche that's true that's no we got a
lot of work today we got a lot of work
to do
um the tiny Corporation is real
if you'd like to come work at the tiny
Corporation
uh
like you know your engineer one uh I'll
hire someone if you're the right person
but like that one I don't know man like
you gotta have like real insane
experience with this stuff uh if you
wanna work a comma comma's hiring if
you're interested in shipping your
consumer product to millions of people
uh go work a comma uh if you're
interested in Google if you're
interested in sponsoring me to finish
the tiny grad port to the Google Coral
uh let's chat uh Nvidia uh you know the
other company uh yeah just anyone man uh
the tiny corporations looking for her
sponsors not investors sponsors
yeah like PBS
um do you need a tiny resume
uh is AI accelerators worthy though
every company that has is dead yes I
know they're dead because they didn't
write software first they built Hardware
first
that's why the tiny Corporation stays
tiny
and does you know
uh does Hardware first you like to work
the tiny Corporation I did see you gift
Subs so I mean like if you have
experience look the way you want to
really get hired for the tiny
Corporation be like the Dean Lee of the
tiny grad repo and then we'll actually
hire you
uh you can look at Dean Lee in the old
pilot repo
uh you know we think that more people
now are working on open pilot externally
uh than internally there's more people
like
uh
a dick size is not a factor in hiring we
don't discriminate based on Dick's size
I'm sorry
um
there's 247 chances it's Apple there's
one chance it's a fig by the way you
know you gotta you gotta you gotta did
Eve really eat an apple or was it a fig
did apples even exist or were they
invented by the Chinese in the 14th
century
uh all right any other questions
accumulation for ants
yeah I love Zuma this is great that's a
great show it's a great movie he has a
great movie Man garbage garbage uh
finding bugs in the universe
uh
banana and 247 Granny Smith
I don't know we'll do we'll do one more
we'll do one more we'll do one more
chicken
let's try a chicken
come on chicken come on oh yeah hen and
53 chances it's a cock
so this so you're saying there's a
chance
um what's this dog
uh but guys this is running right here
on the Google coral using TPU x-ray to
be fair I did all this in the last
stream in this stream I just kind of
added a few things and was like damn
this is a lot of work and I got the
compiler running a nice Docker now
that's pretty nice right
uh let me just actually clean up the
docker script quickly
um
I can do bin bash Dash C
to work right
there you go now it compiles that's
pretty cool so we did get the compiler
working
uh
cool
this is all local yeah
it's a binary for the compiler
um and I can't figure out how to turn
the debugging on
uh what does it say if I give it an
actual cock yo yo yo yo this is a this
is a Christian Channel Christian Channel
um
all right but so what what did we learn
we learned
these things are
instructions parameters instructions
parameters and then it like does
something I don't really understand why
it returns a response there but that's
probably just because it's in the
instructions deep in the instructions
deep in the instructions debug equals
one did we search for debug
yeah we searched for debug
any any other ideas
uh log
hmm
dbg all right I'll try it we'll try it
wait
what's that
that's interesting
let's just take a quick look
look if we find something I'll be
excited but otherwise you're right why
are we wasting time on this there's
parties in LA to go to guys
uh maybe there's secret options
uh
here
Dash e should do something that doesn't
talk about
the e in there right
m-o-y-n
[Music]
-s
valid option Dash e
but it says there's a dash e there
did I try Trace
foreign
tracing n curses version no I don't
think this is that
yeah that's just part of Anne curses
uh
Trace log file in it did you ever find a
reference to that
no
foreign
you know this is a man crosses the
garbage Stone
pretty print wait
what's this
mlir print debug info
again like I don't even know if this is
part of the uh
how do I set these
foreign
there's lovm inside of this
oh boys it's so addictive you know
[Music]
pretty debug info opt
as in printer options
yeah we tried for both
no I kind of just don't think there's
really anything in here
why do you think map
although that memory map thing is
interesting
I don't know what prints that out right
that looks like some real debugging shit
all right you wouldn't put that in there
unless there was some way to enable it
oh no this is just this is not good
this is just like the uh
I don't think this is a
hmm
[Music]
what's that
it is it is dinner time it's been dinner
time for a while
thank you
all right now that it's finished we can
quickly go through these
this stuff's not like test temp dir is
not
this is some external thing right yeah
there's some Google API
Google three native code depths NSO
what that does
temp dir
path
path
um
get in the wrapper
anything interesting
stupid uh and curse is crap
lines column and curses Trace
it's not the best of that I can't do
this
[Music]
board right
okay
term
no more anger is garbage
another wrapper
I don't know
test tempter
and ICU data nope
nope all these are useless
Edge TPU compiler output logs
thank you
oh you think there's an older version
that maybe uh
[Music]
why do you think it's show operations
oh yeah no but that no no I mean that is
a real thing but that doesn't really do
anything
foreign
how do I enable that info
oh no that's a separate that's using
tensorflow Lite
no I didn't compile the compiler there's
no source code
come on even Apple
even Apple had more stuff
search delegate
and V16
are there newer versions of this
I don't think newer version even help me
but
partition with profiling
well maybe this has some secret uh
foreign
do jacobians
um
I'm not sure
I think it can
well
um with some tiny changes it can
you can do them if you I think if you do
it like one at a time it can I think if
you want to do a lot you'd have to like
rewrite it
I do like implicit gradient creation so
that's not going to give you that but
uh I think that's probably just some way
I don't know
actually I'm not sure about that
full sag flag
what is that
there are like other flags here
what is this
a fur input output batches
huh
how do I set those flags
foreign
yeah okay there's gonna be some way to
enable this
only allow TPU Ops
where do I put that
maybe you need some environment variable
to enable secret Flags I could believe
that
this one clearly isn't in anything else
let's Bing it just for just for good
measure just in case Google's trying to
hide from us
are there any good secret Flags
no it's not it's not the double
invalid option
how do you enable the secret Flags
okay look they're close here to the
other flags they're closer to like Min
runtime version which is a real flag
oh maybe it just doesn't have a dash
that looks like it might be some kind of
verbosity thing
I don't know why am I wasting time with
us
how'd I figure out that we're hidden
flags and I just found it in strings bro
I told you well hacking is just strings
you know what if someone if some hacker
won't admit to you that all they know
how to use is strings they're not Elite
hacker man people are like I use I use
uh I use fuzzing and I use uh control
phone analysis tools now you use strings
bro
did I dump the firmware
oh I do have the firmware too
well that might be easier
I mean that's an option as well I have a
firmware you download it
here it's called Apex latest single app
but actually now it doesn't have a
single string in it so never mind
imagine spending all this time and it's
not debug equals one all right we're
going to try debug equals one no it's
not debug equals one all right you happy
no it just might not exist
like those secret Flags might just not
be anything
you might have to okay we're gonna try
one more thing
sometimes
sometimes they only leave stuff in old
versions
if you get bigger or smaller I got small
I got a lot smaller
wait it's a lot smaller what did they
add
the other way this looks easier to sort
through
foreign
do you want to find the one that they
accidentally built as the
I could even deploy a three
where's the one where they accidentally
wrote debug equals one
slightly newer version how large is that
wow they added a ton of megabytes all
right let's try yield
you know
why is this binary closed Source I don't
know
foreign
the really old one it works
any information we want from the logs
you want to try Dash V
I mean
look if this doesn't work
we could
um
we could Black Box it
foreign
but then again we need sponsorship for
that
all right this stream already went on
way too long
you just like you're just like you you
feel like you're one flag away from like
a magical like
um
thing working
but in reality you're probably not
no it's not anything with debug
oh unless we do one check for Unicode I
know Google likes to be accessible so it
could be unicode
uh what's this flag restring this for
Unicode see I'm really not a lead hacker
anymore I don't even know the flag for
strings unicode
okay there was nothing like Google debug
I would have definitely noticed that but
I'm happy to try it
there we go it does nothing
um
yell EB all right let's try it
oh I feel this only works on gnu strings
it doesn't work on Max strings
oh do we have strings on here
now we don't have shakes
this is a waste of time
[Music]
being your chills oh that's gonna take
forever
filter out strings containing Google
okay
oh
what the hell
how did I miss that when I did log
Google debug on failure well this is
everything with Google
wait wait
there's a reference to glog I thought I
searched for that
no there's no reference to glog
[Music]
you saw a reference to glog
[Music]
foreign
contains references to test tempter
again just because these things are
linked doesn't mean there's actually any
logging to enable
huh
how did I miss this in my get end of
search
I really didn't do this very thoroughly
now did I
Google log to standard error has already
won by default also log to standard
error
is not one by default
[Music]
oh I missed it because it I say
get just get just annoying
I don't understand I'd even get back
there
G log V
I don't know
like there might be some magical thing
here
your card developer that's great you
know how to solve this problem
Gmail it doesn't appear in here at all
[Music]
debug mode support
uh severity levels
the Google G Flags Library isn't
installed
foreign
foreign
LL log level
nothing
zip nothing not
take a look at how exciting that is I
really want you to print that out
when do you print that out
there's GV working docker
I feel like it like uses P trace and
doesn't work
and probably can enable capabilities P
trace or something
this is how I had luck you know maybe
I'm just too hung up on this approach
because this is how I had luck with the
uh
this is how I had luck with the uh the
big TPU
now we're gonna go eat in a minute
I'm not telling you where I am man
that's invasive
bro bro
okay let's see if GDP works
no
error disabling aslr
all right guys uh it's food time
uh if anybody gets any uh debug output
from that compiler I'll be impressed uh
send me an email and you get VIP on this
channel
uh because I wasted an hour on that you
get VIP VIP on this channel is very hard
to earn
um so everybody you know go look and see
if you can get the edge TPU compiler to
spit out debugging information
um if you work at Google do not leak me
any Trade Secrets I don't want to get
lewandowskied uh so you know don't leave
me any Trade Secrets guys but if you
find it they're good clean spamming of
random things until you've hit it uh
that's good that's good uh all right
thank you all for watching my stream
today uh you know if you don't do the uh
the things I know they're a lot of work
uh you know the long streams especially
uh you know I'm gonna go eat some tacos
need some tacos I'm gonna eat some
burritos I'm gonna eat some
quesadillas I'll go to parties in L.A
now we're gonna be here working boys
um
oh we could be here working all right uh
last question
oh yeah happy Halloween
happy Halloween why am I not out
trick-or-treating right now that's a
good point all right see you later I'm
gonna
welcome welcome welcome welcome
[Music]
ah welcome to my to my R DNA
uh
three instruction set architecture
stream
um
today we'll be working with the absolute
joy to work with open source
uh AMD drivers
which um you know they they work more
often than not
less than half the time they uh they
crash
which is you know pretty good right you
think about it if you had a time machine
that less than half the time didn't work
that would make an amazing time machine
right if you had a machine where you
press a button
and it gives you a million dollars
but the machine only worked let's even
say that but she only worked
30 of the time
that would still be an amazing machine
uh so you know we should really be uh
grateful and thankful for for what we
have
um
is anybody in chat right now
or has everybody gone to sleep
possible everybody has gone to sleep
so we have a program here which is
running uh our DNA Assembly Language
I don't know if there's any syntax
highlighters
we can look
pillow
so we're gonna make a program here
called prog.s
and I'm going to copy out what we have
here just in this
uh I think looks pretty nice
uh what do I want to pathlib
file dot parents
I love Catholic cathlib is an excellent
choice
um so we're right here on my computer
quiet uh quiet quiet is a uh is a
computer with a ryzen
5950x processor
uh we're trying to stick as close as we
can to authentic gaming Hardware so
we're going to have the least amount of
trouble using the GPU
it still works
module is not callable uh what is it
pathlib dot path
lib dot capital P path
all right so we're running this uh
assembly code right here you can also do
something uh like when we're done it's
always nice to have a read back here
going in early exact of um
I do it in
actually
we'll do
debug equals five
uh no such path
I'll make the screen slightly bigger
zoom in a little here for you
uh okay
so now you see right here we're running
this Shader and we're running this
Shader
um this Shader is being compiled from
this CL code right here
and this Shader is being compiled from
this Assembly Language right here
and as you can see the only difference
between these two shaders is this one
has a one and this one has a two
and this one is storing a 2 here and
this one is storing a one here
printing time is pretty stupid the time
doesn't really matter
yeah we say weight equals true just so
we can okay cool one two
so
let's try putting a one there and see
what happens
interesting
okay so I do think that's the offset and
then that's not a float that's an
integer
so you see now I put the two there okay
so this is address
oh this is like offset
I want some assembly highlighting
generic assembly
we're gonna have a great uh
maybe this works
[Music]
the auto detected it is something stupid
let's try that
no
[Music]
should we write a plug-in
to do syntax highlighting
uh for
our DNA assembly
whoa they have plugins for N64 assembly
crazy
um okay I mean I guess that's better
than no syntax highlighting at all
you'll notice this is using the Dual
move B uh 32 opcode
see if we can replace it with a
different opcode and it'll work
so dual issue op code of move b32
you're probably asking a dumb question
if you ask dumb questions you get dumb
answers
you see now we can do the moves
separately
uh
so I'm not really sure what s is and
what if I don't send this message to
deallocate the vgprs
I actually don't think it matters
let's look up S send message right here
in the friendly rdna Shader instruction
set manager
fixed function Hardware
use only when the next instruction is
hmm
what is s weight count do
interesting
oh I think I can use it after I've
issued these store requests typically
using a shaders waiting memory right
acknowledgments
um the in the AMD driver is lovely uh
look the AMD driver works like 95 of the
time
if you had a time machine that works 95
of the time
I think you'd be happy
right or or if you had a box where you
pressed a button and when you press the
button it gives you a million dollars
and it only works 95 of the time that
would be amazing
um so you know
that's right
it would
so let's comment this out and see what
happens
[Music]
you can see that when I comment this out
it'll be gone from here
see that nothing happens now that that's
gone
because I think I have to wait for the
moves to finish
I don't know what this load b64 does
does that create any page fault
it does not
that stuff might be caused by the power
management
we can disable
now it has high performance
and what causes any problems
never mind
suspending
okay
by the way if we don't load b34
things are broken too
hmm
so I also wrote a sniffer for Rock Band
we can use this sniffer right now
right here in sniffer
for some reason the sniffer is getting a
segmentation fault
I'm looking to why that is
might have to do with my doorbells
no my doorbells are on the same page
um so you see these are allocating
q-type twos which are compute cues
allocating a ton of memory to the GPU
which is actually
really very complicated
you don't need this one here
make a flag for it
I'll make it big so you guys can all
follow along
big
so what we're doing with this sniffer is
we're sniffing all of the uh
i o controls I have no idea why it's
trying to include cuda.h
you don't even need Cuda
wow look at all that disk space we're
freeing by getting rid of kudo
so nice
now it doesn't try to open Cuda anymore
I wonder why we're still getting this
because I'm not using opencl really
anymore maybe it still uses it even if I
use it with a binary
okay let's figure out why we're getting
a seg fault in the sniffer
I'm getting that
I actually have a hook in the sniffer
prevent segmentation faults
to catch them because I am protect this
tonight
so gpus have these things called
doorbells uh yes they work kind of like
normal doorbells
um and the GPU goes ding dong ding dong
whenever it has something that it's
ready to uh
when it was put something on the queue
for it to
run
but for some reason
working
it works in other cases
um like I can do it for the uh
sample applications and it works
it doesn't work for
stuff with
High opencl
ow if you figure out at what line it's
actually crashing
we're not even getting up to creating CL
buffer
possible
something else
uh so this sniffer is in uh Rock m
um
and what we're doing is we're sniffing
the i o controls from the driver because
we're eventually going to write our own
right look even if the kernel driver
isn't perfect
we can make a user space that is stable
um by making it a lot simpler
green Base address doorbell offset
I am protected crowd read
I still get a segmentation fault
can I figure out where
I really need the AMD log level
foreign
doorbell
it is
some reason my Sig Sev Handler is not
working
perhaps it's being masked somehow
what are we doing so what we are doing
is we have
Assembly Language for an AMD R dna3 GPU
um this is the reference manual for it
so what we're looking into right now is
the run time I put a sniffer on the
runtime that's sniffing all the uh i o
controls that are being communicated to
the kernel driver
um so if you guys want to follow along
you can you can Google these they're in
the Rock tunk driver
uh pgim thank you for gifting Subs if
you have a question I would love to
answer it
so let's understand why this isn't
working
probably
either something else or like what is
what is this sig empty set
I mean you know what I could do
what if I just put this here
I can always register that I octo
Handler
I didn't really build it did I
know it doesn't work
you're asking why
this returns
my guess is something else is masking it
like in Python
this is actually running this is being
injected into a python runtime
which makes me think there's some like
trick
Sig action essay
structs that don't do that
I can show you that it works for other
things
actually let me let me just get the hip
examples here
I do have them yeah
do you see the sniffer does work and
it's dumping code here
it just doesn't work when it's in Python
I must say in Python is masking the uh
seg Handler somehow
uh AMD log level goes up to five
okay now
um yeah there must be something wrong
with how we're installing the uh the
Handler
uh we still get a segmentation fault
yeah so the it's operating at the level
between uh
the
uh kernel and the user space
the problem right now that we're trying
to run into is gpus do this thing called
uh they have a doorbell which you poke
when you want to run the command queue
so what I'm doing is when I see the
doorbell being created
I'm protecting it to prod none
uh the problem seems to be though
that this is generating a seg fault and
I'm seeing the seg fault here I can
actually see it if I do info registers
this is the doorbell address
for some reason my Handler is getting
unregistered
probably by python
or it's just in a different thread
no no should be in the same thread as
this well actually how do threads handle
this
something will be caught by the thread
doing the exception
I mean I'd also try putting this in a
Constructor
no but none this should be fine because
I'm registering into the exact same one
that I'm doing the mprotect and none and
I'm surprised that didn't fix it
uh why can't I stay in
something else must be clearing the
signal
that's all I can think of
uh Sig action is a CIS call so we should
be able to see it in an S Trace
hidden doorbell okay we probably needed
to follow
find none of the eye octals are showing
up
okay we get an access error it's pretty
boring
uh
is it all rtcig action
is that the name of this is called
okay so okay here we go so you can see
that I register my action there
and then all these new things come along
this has my Handler still
has my hand over
zigzag V
still my Handler
no no look now here this one comes along
and puts a different Handler in what's
doing that
I guess we have to intercept that Sig
action
this one puts my Handler back
put this in my Handler
it is right
yeah
RT Sig action
could it be a different error
no killed by Sig sag V
this doesn't make sense
right here it's killed by zigzag V
and my Sig action is there is there
another Cisco that interacts with that
kind of stuff
yeah where's the Mojo Source that's a
good question okay uh we're gonna ban
talking about Mojo until they release
the source
okay right here we register the action
some things like restoring this though
which I guess I don't really like
it's in the PID
it's the same PID it gets the zigzag
hello VM message with the signal mask
to handle floating Point exception
that doesn't seem like it
say Flex
say restore essay Sig info
is that the robin already
is that Robin
foreign
context okay that seems right
I know Ramen here
[Music]
essay restore
store and then this okay this is the
address of the Handler
I'm going to print that just in case
so the problem is now we're not catching
a zigzag V exception
clearly getting a six Sigby
um
we should make absolutely sure we're not
actually catching it
it's handled by that so we can make sure
that okay that's the address there
it's the last thing sent to Sig action
what's an essay restore
did we always have that
not intended for application use
we're a Handler
and we have a mask
all signals defined in the document
are excluded why would I want to exclude
them
don't I want to include them
maybe it's being Mastered by the ocl
runtime no I don't think so
um
the only reason I don't think so is
because
first off I would see it and second off
this works okay as long as it's actually
python that's messing with it
I mean how is it messing with it I'm
looking at all the sys calls from the
thing
right there's
PID
zero zero and there's me registering a
signal
unless the mask shouldn't be empty
but it looks empty everywhere
we're never actually in the hands part
there it is
I've blocked no
what could cause this
resume
caught
you've not initialized the essay
properly
all right
understand all the members of the struct
Sig action
I set the flags
and I don't set restore
don't use printf in a signal Handler
I'm sure that's not the problem
okay there must be some parameter that
python sets like really early on
what else can ignore signals
just look at all the linuxes calls
Sig actions
oh Sig proc mask
oh here we go
can you even do this with zigzag V
foreign
are generated while they are blocked
Sig set mask
no I ride streaming
do you have clothes on
you're gonna bring it to me
what
oh it's forever such a pleasant
streaming yeah
okay we just need to figure out how to
Sig prop mask this shit
oh but is this already what the mask is
there we go
okay see now look we get the ding dong
oh
now I actually don't know about the
opencl runtime I only know about rock m
I actually tend to think it is the OCR
runtime I think you might actually have
the right thing
storm Frosty great to have you in this
uh
stream
uh so you see here
wow this is so much stuff
thank you
what
okay you wanna come eat on the street
you want to go eat with him
do you want to eat on the Stream
you can say no
you can come eat on stream
okay
so let's look at what's actually being
stored here
I really like that for AMD we have
access to all of these things
so
this Q type might be all right let's get
rid of some of this stuff we definitely
don't need log level five that's way too
much log level
this is transferring the buffer let me
put some Stars next to these or you know
what we have a great function in tiny
grad called color
thank you green
Welcome to My Stream do you have a chair
do you have a chair
or you need a chair
every streamer has a chair I think the
word chair might be banned in my chat
though
every once in a while you'll get someone
who's like I want to ask a question
but they can ask a question because
their questions banned and trust me if
it was banned it wasn't a good question
today
no I don't take magnesium very often
says who
a giant short of pregnancy
when you want to eat on the bed over
there I
this is another chair in this house
you need a chair to be a streamer
do you want to sit on this cart
I don't know how solid this card is
foreign
you could shove that blanket into the
carton and then I'm sure it would be
very solid
here
I feel pretty good
do you feel like we're eating together
so
we create a cue do we create cues of
both types
let's just print the queue I should
print the doorbell and I should print
the Q type
um
oh that's a ring Base address
see how this is Q type one that means
it's a uh dma queue
should we parse this
thank you
thank you
yeah
[Music]
okay I think the problem is I bought the
cheaper tortellinis from Whole Foods and
they're just not as good as the other
ones
there are no problems what there are no
problems
you want a stream I'm working Ramen
I think they can't see you though I feel
so great so grateful that we get this
one that's right real good this is a
very positive up extreme
to contract today's stream is rather
negative
before Advent of Scala part one
Advent of Scala part two
okay and it was the friendly nice one
yes it was a very lovely stream you guys
should check that one out
you had to subscribe thank you by the
way I really want to thank the person
who gifted 10 Subs petan do they have a
question
five Subs gives five Subs I'll answer a
question
hmm
okay should we parse the kfd iocq type
sdma
so what I do
is I just search for this
in Rock
and it still doesn't really tell me
anything
but we can enable well are we interested
in parsing that oh Jacob's M1 gifted
five Subs would you like to ask Alex a
question
um you can get them to whoever they want
I think they give them the people who
they they like and chat
that was so nice
we can crowdsource the question would
you even like to crowdsource it from
non-subscribers Wow Cobra Cobra's
gifting sobs
when one person gifts Subs they all give
Subs
it's probably too low let's just figure
out what type this is
um probably the best way to do that is
to enable the login
and then we'll see what it posts
um ding dong Q type one okay it's an HSA
async copy stage so we can just look
here and this one happens to be a d to H
um do we have
no
okay here it is and we have to figure
out maybe it's this runtime Singleton
copy memory we have to find the thing
that's actually pushing it to the queue
probably not this
oh here copy agent dma copy okay
who turns an error
submit dma copy command
data from source to desk
your forward
did I even eat any of that Ramen yeah
why do you ask questions like that
no matter
you seems so hungry and then
here's how focused now I understand so
you're you're upset with me that
I was hungry and you thought we were
going to eat dinner together in the
other room but instead I came into this
room and worked on gpus
out
it's a nice stream
I can feel it I can feel you thinking
about gpus all the time
I just see your face you can feel the
GPU energy I invited you into this room
your guest on my screen
thank you that's right
you know Security will escort you out
I'm sorry getting a walk for that door
oh so wait why does dma just return an
error
only because it's actually implemented
somewhere
this is a virtual method where is the
actual implementation of it
[Music]
now where is it
okay sdma copy data packet
is it like this
oh it better not be this
wow Clover Cobra gifted Subs
thoughts on Mojo yes Mojo questions are
banned until the source code is released
yes wait what
uh well we're not going to talk about
Mojo until they release the source code
like who cares about it
oh
December is an All-Star for secretive
because it's not as good
what's the number one reason this is the
number one reason for secrecy in
startups now it's not true for Apple but
only Apple gets a pass
if someone has a track record
I'm talking company I'm not talking like
Chris ladner's made a lot of great stuff
but you know open source or it's not
really worth talking about
we appreciate the open source Community
yeah he gave some weird excuse for it I
mean to be fair you just raised 30
million dollars but like this is kind of
why the tiny Corp can't raise money you
just raised 30 million dollars for your
startup
what's the business model
well when he did llvm he did that with
apple I believe
he worked at Tesla for a few months and
uh
I don't think he liked elon's Style
I think he wanted to do refactors
wow we're at level four on the hype
train I think they appreciate niceness
hmm should we let not subscribers talk
sure I was gonna say that Chris Rogers a
really nice guy I think he's appreciate
a nice stream
because ladder is a very nice guy
uh
okay maybe I can get something from
these other Q types
this is an HSA kernel dispass packet t
where is this defined
Dynamic HSA
like where the dma packets
it might be this
travel distance
yeah
oh it's like the height he gets the
matching the matching uh oh it matches
the hoodie no I can't see it
it's okay
um no we're not here to educate you I
think we've talked about this a lot our
stream is here to entertain you
uh it's not for education
if you wanted education it would cost a
lot more than a subscription
education is very expensive
entertainment on the other hand it's
like five bucks a month
you know a little more
you know I'm not worth a whole Netflix
you know
I might have to ask while you're working
on before I leave
do you want to ask
oh the pattern definitions are in here
are they actually
oh that's the kernel dispatch
wow
this is pretty nice
storm Frosty you've contributed enough
value we're going to make you a VIP
congratulations
um VIPs are people who actually know
things about computers
wow
um yeah
and uh you know it's just when I see
that uh Jam next to your name I take
what you have to say more seriously
um are the dma
the ones in here
yeah like we have HSA signal ends
uh four years of being underpinned at
AMD he works with AMD
um on obtl
and we get great people in the Stream
um wait so where's the dma
if I you don't know shit about computers
well I banned you not knowing shit is
okay
but what's not okay
is is yeah not being aware of how little
you know or taking pride and not knowing
things
okay
dma is a extension
see
just Google
uh 556. now what I want you to do is set
close out next to uh
your vet
so when we wake up tomorrow at 5 56
your clothes are ready to put on
it makes you more likely to get up
if you want
to get my full eight hours I mean we're
waking up at 5 56 and we're gonna walk
oh it's really early
I don't know I don't know if I'm
mentally prepared for this right now
if we're still here and it's
8 30 I'm just gonna go to this computer
and play with gpus all day
half hours
I think we could leave by seven
5 56 is when we set the alarm for seven
I'm gonna be out the door by six
Alex
Sunrise is at six
let's go to sleep now
the perfect he's perfect for sleeping
a lot of Lux hello welcome we just got
raided by a lot of lux's people
Alex is a game developed I believe she's
Canadian
oh she streams like Unity stuff we have
visiting people so hello new visiting
people see I have to be I have to be
very active for the new visiting people
that's right
so what we're doing today is we are
writing a
uh basically we're looking at all the
parts of a GPU driver uh in order to
make a good GPU driver
um so right now we are getting the
doorbell running so the doorbell is you
know okay so it's GPU uh hello uh so you
know you guys come from game developing
when you want to like Draw Something
um that draw is is done with our
well okay there's a lot of steps to a
graphics pipeline but one of the one of
the steps is like uh let's say you just
want to transfer a Shader right let's
say you want to transfer Shader from
Main memory uh into GPU memory you'll
use one of these uh q-type one
transverse and we're going to try to
figure out now what the transfer is
um so this is AMD all of amd's stuff is
is open source uh so we can actually
just look through it and hopefully uh
come across something good
so this might be the struct but like
look at how complex this struct looks
it might be this
the op is this like
how long is this
copy linear
okay well what's a copy op copy op is
one
uh is that one set
no it looks like we're getting a d there
D would be 13.
so it's an sdma off time timestamp
it doesn't really seem right
well these are pm4 packets but is that
not here is that not this
when you say pm
4 what do you mean
oh here we go pm4 packets
um
pm4
uh can you close the uh
oh this is exciting okay you said it's
an extension
oh maybe it's this
okay AQL packets no but it's don't think
it's AQL
which carries a pm4 command maybe it is
I could type kernel dispatch
[Music]
public pm4 dock
pm4 header and amd's pal GitHub repo
but yeah I mean these are
kfd so this is most of the stuff
PM maybe it's this
pm4 dispatch direct set sh register are
you sure it's these
how do you know it's a pm4 packet
like I was going to track down this dma
and just figure out like where it
actually
um
like something is submitting the packet
here this HSA mem copy
mem async copy here
HSA async mem copy
isn't nicely in a packet though
command copy device to host submitted
it creates a new cue right there that's
crazy wow look at how far deep that
doorbell offset is
I mean this has to be being generated by
something you're saying it's linking to
something
HSA
X AMD
copy yeah okay this looks
good here's the implementation of it
okay we're here before
um
we're in core run time runtime Singleton
we have to find this copy memory which
is here
foreign
copy agent dma copy
now we need to find what actually
implements that and you're telling me
nothing implements that maybe
oh I think this is what we got to before
nothing actually implements this
don't ring the doorbell after writing
the packet but I mean I definitely have
some like header here that I can parse
I guess I don't understand
where is this actually written
where is the code for this dma agent
I have to do this login to GitHub
rocket Library Source core runtime now
that just calls in
where is the dma copy here actually
being submitted
GPU agent AMD GPU agent
oh it's probably because it's on two
lines
okay
here we go
submit linear copy command
okay where do we submit linear copy
command now over here
uh okay we have a barrier and packet
oh
is that just a barrier and packet
that'd be pretty boring if that was true
uh
no where's Barry Rand
that's three Okay so
if anything the packet type is d
there's a d no none of these are defined
as D okay but that does make it seem
like it's some extension thing
okay so millionaire copy command blah
blah blah insert dispatch packet for
copy kernel
what's args
kernel arcs
populate Q
Indie Blitz kernel wait this is just a
kernel it's submitting
but maybe disable sdma
foreign
try it
huh
wow okay so that definitely changed
something look at what it did now
instead
it did it dispatched a kernel
it did a it did a kernel dispatch and it
just that's the kernel that's the code
we can dump it
hmm
that's cool so when I do that last dma
it doesn't create that uh
that packet but I don't actually want to
disable it I want to understand how sdma
is working
so I guess that that's what this is
doing
um
all right let's find that where is sha
as disabled sdma and what's that
changing
yeah it's using cpdma that makes sense
um this is at the user Space level
uh
so where's the stuff that's actually
reading this
oh the function to enable sdma is there
okay
um like where's the if enable sdma
my name is dma here
decide which engine to use for Blitz
all right and the dma I see
[Music]
hmm
huh
blit sdma V5 I think
we're on a V5
um
okay initialize
destroy
submit blocking command
submit command okay
I think it has to be in here
whatever is going on to that cue
build the GCR command so this might be
this might be a whole lot of commands
actually
oh okay so here's an interesting thing
it's writing hex 94. I think these ones
do work differently I think you're right
yeah it uses batch submission so it
doesn't yeah yeah so this is multiple
packets
we're just gonna have to parse them down
we can do that though
all right so this is just these will
come out
all right so what is these packets
what's our op so it is a time stamp up
okay cool
yeah sdma packet time stamp here
all right so the time stamp is
this is an address one
oh this is just an address that's being
submitted okay then the next thing being
submitted is a command 11.
um 11 is going to be 17. so that's a GCR
cool
I don't really know what a GCR is but
that sounds good to me
all right
what's my next dma boxer
um okay
I'm gonna do this we're going to say
void star sdma pointer equals void
current Base address
probably don't want it to be a void
I avoid I guess is okay
I can't do math on void pointers but
like can I add a size
yeah
whatever
while
uh sdma
pointer is not equal to
um
store PSI value
should I do it as offset
uh okay ring address Plus dorsakis
actually let's say less just in case I
get this kind of wrong
um
you may pointer plus equals size of
uh I've got to include this okay rocket
probably okay do I already have this one
sdma registers
oh it's in namespace rock R AMD oh gotta
love it
um using namespace
Rock R AMD
sweet 13u I love when it finds it like
this editor is so good
Microsoft really crushing it
so we'll add a sdma packet
timestamp
size of sdma packet timestamp
um
and then we'll say uh
unhandle pack
type
what was the other one GCR
whatever let's do this one at a time
sdma registers not found
um all right we'll do one more of these
in rock R run time Source core Inc this
are there other sdma registers
Rock R Dash runtime Source core anchor
I showed you the first
the first thing to give me any trouble
I think I can actually get that from opt
Rock and include
foreign
core ink signal okay we don't actually
need all of this
[Music]
um
what does this include and when why
it looks like nothing actually
why is this so bad
oh
did I just break something else by doing
that
yeah okay let's try that
um
the problem is I can't include all of
source courting because there's probably
lots of crap in here
that's like
aliasing with others
hate copying going out though
ah what's the include path like they
include search order
oh you know what I can probably do
this
I almost want to do that anyway
not found
should be found
do I not have Rock our runtime checked
out
Source core ink
from the edge
wait what it's not there
why is it not there
Source Inc
this is a different version
oh
whatever
there's no dependency on this header
either I don't understand what's
happening
no something's just wrong I just messed
something off hang on
no I just I just messed something up
okay I got distracted it's not this
it's sdma registers that I want
okay
my bad
okay that took me way too long
okay now we're getting hdma
sdma packet time stamp
you know what I do want to do this as an
offset
um
kinda great doesn't it Cindy yeah
this is the coaching engine is pretty
good it's
when this works
okay wait why isn't it giving me an
unhandled packet type
it should be
oh because it's not store size the value
oops
now I have an unhandled packet type 17.
so now I just go in here see what packet
type is 17.
and hopefully they name these things
appropriately
so I can just do that sorry let's see
what other packets we gotta handle
all right on handle pack of type one all
right great
what is a GCR packet this is a copy
packet
and copy pack and I might actually care
about parsing
uh no I did not mean sdma op copy
um
oh it has a sub up damn it
wasn't too bad actually
I could copy linear
what's the end goal to make it good ah
all right cool
it says dma stuff looks pretty good now
I know it's on a different cue I wonder
if I can synchronize it
unhandled packet type 10. that's due to
be an opatomic of course
okay we're almost there on handle packet
type five let's see what a five is oh
it's a fence of course
foreign
this logs the cues and disassembles
packets
I've looked I've looked into a
pretty cool
uh is it up to date
wow
interesting
um a lot of this stuff I like writing
myself so I can learn
uh
about how it works
like I did this all for the I did this
all from video two and then ended up
writing I think I have the only like
launch of a Cuda kernel without Cuda
um
so yeah I mean this is a learning
exercise and hopefully you know you guys
are learning along at home
uh a bit too
trap and like if it's more than like 10
of these I'll write scripts to
auto-generate them
okay
uh the only one I really care about
disassembling is copy linear probably
unless uh GCR is something cool let's
see what GCR is
I don't really understand this
something about virtual addresses
all right let's look at copy linear
first then because that's the one I
really care about
okay those are tiny
count seeps important
so what we want to do is you want to
create this and we want to cast it
from
sdma pointer
and then we can print stuff like count
I think that's gonna work
yeah there's no member named count so
we're gonna have to dive into these
stupid
uh
there's still that works
do I have to go into the count Union
they have a union
okay
count hex 27.
an odd count when you think about it
what is that in like
units of
I mean I copy out
why is it 27
oh size 40.
I guess that's not strange
foreign
nine
um
I mean this isn't really rock M like
we're going way lower than Rock M wants
you to
all right let's look at the source
address because these matter
um
so try to slow Union or with uh
or with Source address High Union
[Music]
this
ship shift 32.
we'll do the same for dust
I'm gonna complain because they're not
actually pointers or something
what'd I do
fine to put on multiple lines
oh shift count greater than width of
type
expected expression what
[Music]
are you
don't tell me I need to do that
it doesn't care it's on one line oh no
this is C and I can't put a trailing
comma
okay
foreign
test cool
okay we understand how the buffer gets
transferred
I don't understand why it's 27 but maybe
it's count minus one
it should probably just count by this
one I'm just gonna put a plus one there
um
cool
all right now we understand transferring
the buffer
uh let's turn the log level back down
all right so now we're transferring the
buffer you can see that it does a bunch
of stuff it actually creates a new queue
uh this runs the program
I don't understand why
I don't think that Q types actually won
yeah okay
so we have to actually save the queue
type for the ring address
you can't just create something Global
called Q type
um and then instead of having Q type
here
we'll say Q type equals
cute types
of that
still making assumptions but whatever
okay cool
um good
so yeah here's the program that we're
running
and that should match what we actually
run let me throw a debug equals five on
there
yeah so you can see that this program
here that we actually run
is right here
ah I don't think we really care about
disassembling us
yeah whatever this is a little it's a
little distracting because I didn't
actually pull all the
arcs out
you know I gotta wake up early tomorrow
I'm walking
you heard Alex
foreign
so this is running the program this is
transferring the buffer
I think we oh we create the program I
don't know what all that's doing
this is some like other oh this probably
copies in the program I don't know why
it doesn't use sdma for that
um it copies in the zeros up there with
sdma
yeah my guess is this is a copy kernel
um
we can also dump the args and maybe we
should
take a look at the kernel dispatch
packet type
first let me Commit This
move our DNA sniffer uh this is going
into the rdna branch on Tiny grad
thank you
cool uh is there anything else we wanted
to try
I'm getting tired but I'm happy we had a
we had a nicer stream we made some
positive progress
that didn't involve yelling at the
colonel I mean there's crashes but well
we just have to accept them as part of
life like I said
if you had a time machine that worked 98
of the time
uh that'd be a great time machine
uh
sub you know
thank you everybody
for enjoying the happy part of the
stream thank you to everyone who gifted
Subs I appreciate you
uh
uh we got custom assembly
running on our GPU
we confirmed that the custom assembly
was in fact custom assembly
um I guess
the only other thing that we can do is
we can dump the current Arc address a
little
dump a little current art address
foreign
okay so you can see that we're passing
in
pointer over here on the Kern arcs
so I imagine what this actually loads
here is from uh
these current arcs
yeah so that's
why isn't it a global load
it's a global store this is the address
this is an offset that's why we end up
with the two over here
this is the actual two that we store
uh
I'm gonna check something actually I
wonder if that weight is only for the
load and it's not for the move does it
still behave the same
it does
wait
for the low
but of course if I put that up here
we're going to get a zero
get a zero
this is the ABI for what
thank you this is very nice
okay
um
the sgpr
foreign
buffer
cool
so why are there four
the term for the stack and spill well
yeah but it must be
hmm
four
four aligned s blr
by the way
what actually is the uh
address
is the address the same as the one I see
if I were to do something like store
s0
I'm not allowed to
well maybe I'll sniffer
yeah invalid operator for instruction
interesting
uh
s store b64
okay
we did not I don't know what DS store
means
I'm curious what address is actually in
the GPU
you know what I'm saying
like is it the same address that I pass
in
uh you know your page
I mean I would imagine it has to be and
there has to be some like mmu which is
like mapping at all
you can step through with GDB
really
that works
have to be pretty sophisticated
debugging tools for this stuff that I
just don't really know how to use
I don't know I feel like I learned a lot
when I write this sort of stuff and
hopefully I write like much simpler
versions
um than what's out there but maybe
they're just simple to me rock GDB
oh yeah this is gonna crash my
Rockin GDB
standard GDB commands
knowing how this works
Rock really big
foreign
how do I put a break point
what memory space is it loaded in
I mean yeah that's what I'm saying like
maybe I can do this with like one of
these
with like hip
oh
could not attach a fatal error has
occurred I don't know but is that a real
fatal error or a fake fail there
put a break point at hello world
functioning hello world not defined but
it's defined right out because I
capitalize it on
no that doesn't work okay it's that
underscore
I'm never gonna get that to work I'm I'm
fine with uh not getting that to work
so when I do a global store
it has to come from v data
I need two words from scalar data cachy
I'm gonna do this
okay that works
um if I were to load them from here of
course it wouldn't work
only if you need to disable name
mangling
foreign
what if I do it
DS load
can't do a DS load you think you can but
you cannot
only do an S node
it brings up a lot of questions about
this uh
the usefulness of this manual
I mean it's actually really nice that it
shows me the uh actual assembly but it
doesn't translate into whatever this is
so I don't know like what the order of
these instructions is I don't know guys
it's 11 o'clock it's bedtime
thank you have a good night
enjoy your AMD gpus
AMD uh I want to make your gpus amazing
you should reach out to the tiny Corp
I'm not going to send them back I don't
want to First our first relationship I
don't want a relationship to begin with
but with threats
um I bought these gpus and I'm going to
make them work uh
yeah so um you know
do whatever we're gonna make them good
uh our day is canceled guys
hello everybody
[Music]
you already missed it we drank coffee
today and we had a high ball of this
little high ball left
okay now there's no more high ball left
we're gonna go get a spin drift and
we're gonna get started
with
our dna3 now AMD
um again again you guys know who the
good guys are who the bad guys are uh
the good guys are the red team and the
bad guys at the Green Team
um so look at how nice the red team is
the red team publishes this beautiful
guide for me on the instruction set of
rdna3
uh okay
so let me just take you over to Tiny
grad for the two percent of people who
watch the stream who've never seen oh no
Rock m is is total shit man there's so
many bugs with it
I found a book this morning where if I
fork the process and then exit the child
the command cues close but here so
this is just the example from Tiny grad
it shows you that we could do Matrix
multiplies and we're getting about six
teraflops
if I set up Loco we can get that up to
15 teraflops which is overall a pretty
decent amount of teraflops I'd say
um but not really that good because this
card
uh so this computer has 27900
xtxs
all right uh we also have you know a lot
of CPUs
and we have a pathetic amount of memory
because I cheaped out on the memory
but uh don't worry we got more memory
coming okay
all right so you can see that this GPU
gets 15 teraflops on my Matrix multiply
and they're like wow 15 teraflops that's
so fast
uh yes I've heard of Mojo yes I did not
watch the whole keynote uh I will be
excited when they actually open source
things
um
until when it's closed source and hype
you know how I feel about hype
uh when it's open source and people use
it you know it's good
uh when it's open source and I can look
at how good their CI is you know that
tells you a lot
uh
uh okay so if we scroll down here to the
XTX we should be getting
61 teraflops with a boost clock but
instead we're getting 15 teraflops
that's off by a factor of four
now why are we off by a factor of four
so one thing to start to look at is so
I'm using opencl uh this is backed by
opencl and I wrote a disassembler and
this is what I wrote this morning I
didn't write a disassembler I just like
called out to it
um so you can see this here is the
Shader and this is one of the worst
assemblers I've ever seen
uh so a few things are wrong with it
you see these
dual fmac 32
how come these other ones aren't duals
so this has a dual issue ALU but you
have to explicitly call them dual
um this what is ashar Rev well the good
news is we can look it up right here in
the rdna architecture
arithmetic shift right why the hell are
we doing arithmetic shift rights
uh and then we're doing delay I'll use
I guess that's all inside the branch
um stupid disassembler doesn't
understand
so I guess this branches back to 12 d a
now it can't be 12 DX it's got to be
like a times two in there or something
maybe next is probably times four
okay branches back to 11 9C
so branch is all the way back to here
it seems maybe right
uh what is my host CPU
uh I have an AMD
oh and like a few cool things I mean
there are some really nice things about
uh
Rock m
M of that no about AMD gpus like look at
this rock bandwidth test right
so this is showing me the bi-directional
peak copy bandwidth
like those are only
that should be higher but regardless I'm
getting 47 gigabytes per second between
the pair of gpus
oh those are slow baby that's just bad
programming
I should DM you why should I DM you
um so this uh Nvidia consumer gpus do
not support this
oh no
uh
all right I will I will why can't you
post on Twitch about this
you send me email if you have something
I should tell me oh so yeah so uh
terrible news uh the AMD driver just
dereferenced an old pointer uh so we're
gonna have to reboot the computer
um I'm very sorry
the bandwidth test because sometimes
that crashes the computer
not this computer that I'm streaming on
don't worry oh shit uh I don't I think
that's okay actually I think that now I
set the ethernet to be Priority One so
if it gets laggy we can see
uh I set up a new turns out we were
renting the modem from Cox I couldn't
believe it
um we were renting the modem from Cox
and paying money every month to rent a
modem from Cox like like the like six
subscribers worth of money
uh did I figure out boot delays no this
computer still takes forever to reboot
and actually that reminds me I should
turn it off and on
because otherwise it doesn't reboot
because Colonel panic and it doesn't
shut down clearly
all right well that's a bad start to the
stream but we're gonna get into things
in a minute
um
I posted on a Discord
this terrible assembly code we can just
look at it like
okay so this does dual fmas but then
these are just fmas like it's just it
just doesn't look it doesn't look
structured it doesn't look optimized
um
boot times are bad for am5 which is am5
which sockets that
wouldn't Windows be more stable you're
funny
where they won't update them far more on
the modem if you own it well good I
don't want them updating the motor on
firmware on my modem what are they going
to add are they going to add the Cox
Wi-Fi hotspot to my modem
no I got a modem and then I gotta unify
we got like a decent setup oh this is M4
okay
um cheapy is never coming back because
no one cares about crypto guys and you
know what you are not a subscriber and
you are the reason that we're going to
subscribe or only chat
okay so let's see if the computer
actually reboots
come back we miss you
boot
uh I ran out of network cable so we
unfortunately we can't use the BMC to do
it but that's really the right way to do
it okay
uh and don't let me do that again
don't let me run Bama test as exciting
as they are uh it's terrible because it
crashes the computer sometimes
like are they kidding
what happened here
kfd debug runtime disabled free unref
page debug set trap kernel runtime did I
get both to work yeah they both work I
was copying between them before we sadly
Colonel panicked
okay so for those that don't know about
gpus let's talk a little bit about them
so this is GPU I hope I don't have
anything else to say I hope you guys can
understand this whole diagram and we
don't have anything else to say
uh so
gpus run code in what's called warps
um so you can think of gpus as like
massive kind of simdi machines
uh okay so 70 stands for single
instruction multiple data do you want to
actually learn stuff is this actually a
stream where we're gonna you know learn
stuff
all right we'll get away with the
computer reboot anyway so I guess we can
learn some stuff okay so gpus are
sending
um single instruction multiple
uh data now remember compute can be
broken up into three basic different
things Yuri thank you for the gifting
Subs uh admull is a DSP uh add Mall load
store
uh is a GPU
and uh add Mall load store compare
branch
is a CPU right now of course dsps can
actually do uh loads in stores but they
can do loads that look like a sub 3. so
this is not a load
I mean it's a sort of a load but this is
what I mean by a load right a sub y
where the where Y where y depends on the
data
uh depends on the data
it doesn't have very long instruction
words that's not really true
okay so gpus have uh
they they use some confusing language in
here they have work group processors
which are two compute units
um I think this has to do with the fact
that there's all this like Legacy crap
about like the warps being two different
sizes but okay so what's the work okay
so warp is a single instruction
so imagine 32 like cores running the
exact same instruction
right and they're all running it and
they're all like doing it right
um so warp is a single instruction
across uh
and the warp all runs in lockstep all
right so
32 of them right
uh so one half of a work group processor
contains two SIM d32s that share one
path to memory
I don't have to understand what they
mean by that
so to introduce something here called a
dual issue v-a-l-u
and I think these are new instructions
so let's go in here
go over the tiny grad
uh where was I
and let's start playing with some
sampler stuff
so I'm working in tiny grad you'll see I
have extra Rock m a lot of this stuff is
Upstream I'm playing an rdna3 which is
not yet Upstream uh and this was just
some stuff I was playing with earlier so
we don't have to do a lot of stupid
boilerplate this early exec thing I
created a little uh multi-processing
queue if you do the fork before you
initialize the clqs uh it doesn't hang
it I mean this is the the driver is so
bad
uh I don't know what part of it's bad if
it's the user stays or it's the kernel I
mean the kernel is obviously bad because
no matter what you do in user space you
should never get kernels to do reference
null pointers I'm sure this driver is
just riddled with exploits
uh if you crash again you'd recommend
running their staging tree no no no no
no no no no no no no no no no do not run
staging I was running something a lot
closer to staging and it was way worse
um this is the only kernel this kernel
and dkms I found to be the only thing
that kind of works
all right so let's head in here extra
rocket
and build large
so here's my assembler
you see that I'm just compiling an empty
this is Tiny grad's uh GPU runtime LTL
program
uh you see them just compiling an empty
program and getting the binary out
um so a few things to note about the
binary it's an elf
so this binary format
doesn't have to be really defined to be
anything like it can be it can be
anything you can read the code here
where we get the binary I just do a CL
program get info CL program info
binaries so this is just baked into tiny
grad
the OBS stage
what
did I do something wrong
oh the text is too small well that's
just because you have two smalls Monitor
and you should get a bigger Monitor and
make me Fuller screen
all right we made it a little bigger is
everyone happy
uh okay so I compiled I wrote this nice
stuff to compile uh Rock amp
and you'll see here in build I compiled
llvm let's go to the binaries here and
we can do something like llvm OBS d10
cc.f right so this is this thing
compiled we can look at the program the
program only contains an end program but
if I were to actually make it like do
something
uh
uh let's do that is that fine
bitch me out it's gonna be like you
can't do that because you didn't make it
a global and now we will make it to
Globe
so now you see that we've added a bunch
more load move weight globals and
message okay boring boring boring boring
boring will actually make the empty
program empty again
it sounds to everyone what we're doing
does everyone following we're compiling
the empty program we're fetching the
binary we're saving it as an elf file
and then we take a look at the outfit
wait how come that's not empty anymore
okay now it's empty again great
okay now the question is how can we make
our own assembler which creates this
uh uh sup
this is just like dot text code and
program
um it's assembled using this thing
called llvmmc which I'd never really
heard of before but I learned about this
morning uh lvm machine code playground
and it will output an object file
uh and then we use lld
to uh to get it
to link it
we output an elf ASM and we pass the
alpha in here with binary equals true
and this will like create the CL program
from a binary you can read that that's
all part of tiny graph
so
I run this and I get this
uh so I did a search for fail to get
code object Isa name actually this one I
just figured out this is the first bug I
fixed and we're just gonna be fixing
bugs like this throughout the rest of
the Stream
so
uh
oh lvm MCA interesting
um
why we're lucky if you have something to
send uh send me that you can't discuss
on Twitch uh just email uh geohot Gmail
um especially if you want me to read it
right now and then I will use my
discretion you are VIP in the channel
and you'll get certain privileges as a
VIP in the channel
okay should we get a failed to get code
object Isa name I looked into what this
was using llvm read elf you guys know
read out
so if I do the readout for cc dot elf uh
I saw this OS ADI is 40 and ABI version
is three
but if I do it here we get Unix system V
and zero
so I'm not really sure how to set those
in llvm so I just went in and modified
the elf header directly in object and
then let's upload it okay now we get a
different error and this is where we're
going to pick up what we're trying to do
is we're trying to assemble a Shader
from the r DNA 3 language
[Music]
um
which is described in this beautiful 606
page manual thank you AMD
and we're going to try to run it so
we'll see if this works
our dna3 okay so a few things to note
about our dna3
um their tensor cores don't seem to give
you more throughput than your uh
non-tensor cores which is actually also
somewhat true about Nvidia on Modern
gpus you get the same float 32
throughput because they throttle the
tensor cores on consumer gpus
uh if I set the lvm target to AMD GPU I
did is this Arch or you think there's
something else called Target
and then I can try triple
oh no
yeah it's a Target well I don't see the
word Target you mean a triple
I don't know if it's a triple
that would kind of make sense actually
that it's a triple okay let's let's see
what we can find
there's a Target triples okay
uh uh yeah I see here so I'm looking at
the same thing okay
probably we'll just do it here then
that's great
um
so the architecture is AMD gcn
the vendor is AMD
the OS is AMD HSA
okay cool
uh great that seems clear
uh let me check to make sure we actually
did it right to read Alf uh
okay great uh so we have 40 and three
and we don't need this garbage anymore
uh so now the error it's giving me is
fail to get the metadata and I noticed
metadata when I looked at the real out
there's this metadata
yeah we're probably gonna have to
just what format is that in
oh that's cool wait wait
I'll check out this wavefront size
so this wavefront size is talked about a
lot in the manual
you can run things as wave 32 or wave64
and it's basically how wide your
assembly path is
um the Nvidia gpus and the Apple gpus
use 32 the AMD gpus just happened to
support
32 and 64.
oh
okay
what's going to be the easiest way to
create that metadata section
adding metadata to instructions no no no
I don't think that's right
it's not lvm IR
this user guide for AMD GPU backend
seems pretty good oh it's in a message
packed binary format are they kidding
two
so this is just searching over all the
rock M source code again big props to
Nvidia for making this all open source
so we can actually uh
make this stuff work no
never
co-manager get data metadata
of course we have seven layers of
abstraction and interaction this one
so it's got to be something somewhere
that the nice thing about this all being
open source is we should be able to
actually find the stuff that outputs
this somewhere
all right this is just that same file
oh
yaml to obj
okay
well this is in uh oh here we go I can
just do this
fingers crossed boys
no don't tell me the kernel crashed
again
SMU I'm not done with your previous
command uh oh
no
and now it's crashed
and now it's crashed
we can't open the context anymore
oh
okay I mean we can at least run the
compiler without having to do this
wow can I RM mod AMD GPU
yeah okay we'll try resetting the PCI
device all right all right unfortunately
they're both dead
I like I don't think that's just this
computer either I think this is actually
just like how buggy this driver is
foreign
I have a ways to like turn off the
device and plug it back in but I think
there's no way this is going to work
oh we have to restart the computer
see now there's no devices anymore
okay regardless let's just check the
alpha and see if we got that right at
least
okay it looks like it has the metadata
all right well that was really easy wait
why is the wavefront size 128 you're
right
you're right
why did it oh you want to try to remove
it all right we're gonna remove that
there's like another way to get PCI
devices if they're not
yeah this is what I was looking for
guys we've been leaked an HDMI connector
all right you want to try to rescan
probe failed
fail to read IP discovery
yeah like that was gonna work you think
this driver manages to come back from
the dead
let's copy and paste this into here
and see if it's the same so we don't get
stupid wavefront sizes
all right looks the same to me okay well
looks like you can use this to reset the
GPU let's see what this does this is not
going to use like set PCI and crap
oh
what the hell does this though
no
guys come on half the fun is that we get
to reset the computer uh I'm just gonna
Commit This
no I'm telling you remove bus and
rescan's not gonna work
you want to remove the bus okay we'll
remove the bus okay
how do I rescan
stop wasting time
oh now did the computer actually reboot
I don't know
oh and I didn't push it oh that's so
useless I meant to push it
oh
why is your driver so shitty
foreign
yeah the driver's way it was I know I
know
and I'm not using any janky pcie
extenders I'm using just
is this dkms so it's their latest driver
it's on the stock Ubuntu 22.4 kernel
and I'm not doing anything strange
now I don't know why it's bad like I
don't know if their users I wrote this
like sniffer that can like sniff their
user space nicely this is worse than
I've had it I've hadn't had to reboot
all morning
how do I know if it's recording
[Music]
um
man
oh good I can see my streaming going
through the uh
connect to the BMC
on how I'm gonna find the IP at BMC
I wrote it on the board 185 I don't know
if it's going to assign the same one or
not
oh
how do I how do I do this anyway
type this is unsafe
yo wait all right that was the best hack
in the world
[Music]
yo pants on fire that was good
that was good
all right we're connected to my ASRock
rack motherboard
hopefully
Maybe
are you logging in
you can see if we're getting pcie
failures
yeah we're getting
tie Sarah crap
both devices too
this just makes me wonder like
why am I getting these errors
or we didn't have any until recently
we had some on May 3rd I don't know we
just got them now that we Rebooted
how do I tell where the computer is in
booting does this stuff work
powered off
no signal
this didn't work in Safari by the way
and I didn't know how to get to it in
Chrome so this is unsafe is did I update
the V bios on the cards no do I have to
do that does that matter
they have a debug FS mechanism to
restart the GPU interesting
of course they do I mean whoa
all right well that seems cool
uh okay
well I don't like this
power
reset server
make sure the server is not up
I usually run 12 gpus in my system
uh oh
how do I change that
all right maybe we can set that in BIOS
in the Bios oh
making life hard all right it'll boot
eventually
okay
actually hmm
I can't change this in The BMC I
actually have to go I actually have to
plug in the fucking thing
and go in and change it
wait we're still getting pcie serifs
okay
why am I getting pcie errors
the computer's taken apart
I'm wiggling the cards
okay
putting the side of the computer back up
foreign
I didn't have this in so long
why is it back
doesn't like you guys
um
okay the problem is if I switch off my
monitor
and I'm on PCI network there could be
many nested junk
okay well this doesn't even work so we
can just close that
how's the new computer going well it was
going great until we went back on stream
now we're getting pcie errors again
has The BMC booted yet this is terrible
guys
we can probably play with this on my
other computer my other computer is an
AMD GPU and isn't terrible
we can also put the two gpus in there
no no it's not dead it just takes a
really long time because Boot delay was
not there's no boot delay
I'm getting upset
um
there's no I have another motherboard I
have another motherboard another CPU
isn't that what I pay for with AMD
that's true that is part of the AMD
experience I should just Embrace that
the hell man
you get your side back when you behave
it really is a beautiful computer though
I put it in a case you guys missed me
putting a case
I'll show you
why is The BMC not even up
it's in a case
you know what I wonder I wonder what's
going wrong okay it's back up
uh
let's see if we're still getting pcie
errors
doesn't look like it
thank you
storm trip one's not real okay
okay we haven't gotten any pcie errors
in a while
it's because I wiggled the gpus
four some motherboard just got like
recalled for not having work in pcie4
all right whatever
we are back let's let's go
okay if this happens again
I think we should just throw this
computer out and buy some Nvidia buy
some in Talent Nvidia reliable company
now guys I really want to like AMD all
right
all right
why did the fan throttle up
there's more pcie errors
oh good we're good we're good okay
um
I don't know if Sarah is like some
actual bus thing or it can be caused by
like the GPU firmware crashing at some
deep level
extra Rock m rdna3
it's on three Asm
out of host memory interesting
oh it crashed now this is a normal crash
let's see if that's repeatable at least
okay out of host memory great okay great
this looks like a real kind of thing
all right
out of host memory
so I discovered some cool stuff
that you can enable you can enable
AMD log level four let's see if we get
anything
using Code object V5
um
we have
CCF and cc2f
figure out what the difference is
make sure there's no more pcie errors
okay
what is this
gnu hash I don't know if that's
important
are the loads in the same place
the real one has something called Ro
data
uh uh I don't know if it's important
the text section of the real ones a lot
larger it's only four there
oh I did put in pie which I might not
need
everything else looks the same
kind of host memory okay it must be
trying to allocate something really big
let's get rid of pie no Pi video
out of host memory
cannot find symbol start okay so it's
probably not that I like the idea facing
closer
no it's not this
now because you'll see that it works if
I put in as in real here
so it's just something with my Assembly
not being right
another thing after and program
you're supposed to put something else in
afterward and I had it uh
program
[Music]
you can do s code end
yeah it's not gonna change anything
see my beautiful my beautiful thing I
assembled
all right we have the note section
why is it giving me this
out of host memory
okay let's turn AMD debug to four
no no it's not AMD debug what is it AMD
log level that's it we can also debug
HSA kmt but that's mostly the runtime
um
let's compare it to if we use the
correct
you guys are making me use a small
screen a large font
code object V5
command internal marker I don't know
what to say
except here it says foreign if any
kernel name code
and this one doesn't have a kernel name
no there's nothing no that's I don't
care about that
um okay could it be what is in the RO
data section
there's something in there clearly
is that 440.
so we're not disassemble right there's a
way to like hex dump
there we go
does that look important to you
of the Dynamics are very I don't think
that matters
what is this stuff in Ro data
oh also I might have to export this
no I don't emerge anything I don't use
that uh lvm assembly export symbol
there's like some way to like tell it to
like export a symbol in assembly
yeah dot Global all right let's try that
um
AMD log levels useless
all right same out of host memory
garbage
question is did I get a symbol and dine
string no I did not that actually did
nothing
oh Linker LOD and the other one is AMD
lld
does that matter
here it was an a DOT out
I don't think it matters
you didn't export that symbol though
it's in stir tab but it's not in the Sim
tab why
no no no we have a flag wrong
what's code.kd
and how come that's in the Sim Tab and
oh this is in that Sim tab
weird okay
it has a different type
doubt that ladder
pie Flags not there
uh
did I do something
now we have our data and it's in the
right place okay
I don't know I doubt the RO data Maddox
I bet it's like just the relocations and
stuff
Pi opencl absolutely does not bundle an
opencl
there's no way to bundle it opencl uses
the ICD
oh
okay you see this
symbol code KD
aha okay
I see what it is so there's something in
Ro data
called code KD that we need
put end program there but
most memory is probably just generic
stupid error
okay now we have code KD that's great um
but let's make it match
up the real one
here we go okay we got to do a line
dotted line that's 10.
uh and code KD what is it word
word
I think it's word
is that very much commas
unknown Direct
scared every time that crashes
okay why is that an unknown directive I
told you to make word
why is word not a directive
oh it's like Dot law or something
do you work
okay how to host memory same error
Oh look The endianness is wrong
well that's just offensive
we only have to flip the endianness in
my head
I'm like that's probably like the
allocation size or some crap
all right you work yet
no I did this one wrong
I don't think it's this but
now I'm starting to think it's not this
way
okay well I made it look identical at
least so you know get a prize for that
could it be the pie stuff
when I disable pie
symbol code KD
create kernel failed out of host memory
no I doubtful into any of this
all right let's dump the relogs there's
a way to do this and read out the
relocks are a very possible place where
we make mistakes
there are no relocations
and it should actually be all so if we
don't see it here I don't know what it
could be
it's not that
the only things I can think of is that
these no one's looking at the type of a
symbol though
uh that one's a lot longer
should not matter
address is all match
[Music]
ah here we go
for Elf targets the type directive is
used like this
type name
comma type description
put an attribute and type directive okay
what Maybe
type supported r
okay now it's a funk but it doesn't have
a size
foreign
yeah my program's a lot smaller we can
mess with that maybe too I mean they
just have a lot more Coatings we'll
throw some more codons in there but I
don't think that's it
oh
look at that there we go we just had to
make code KD an object
I'm interested in the size as well
there's got to be a way to set size
uh
uh size
yes set the size associated with okay
um I don't care about that we don't
actually need the size it's fine it's
next
oh actually it's possible it was fixed
because I did that
respects because I set the option let's
just maybe test that and now we're gonna
get the crash yes and now when I put
this back in we don't get to crash
uh so what the hell is that stuff
all right
um let's you want to run the program
let's run the program
uh requires a local size do I really
have to give it a local size I think I
actually do
what I've been singing on I think
this index out of range
maybe I can't say not
okay none for that never mind
interesting
huh
I have to create a buffer
even if it doesn't use it
why'd we move to AMD GPU because we're
on the red team guys fuck the Green Team
interesting okay oh let's just create a
buffer it's not a big deal
create a buffer one size hex 10.
b-type 432 from the tiny grad dot
helpers
important key types
uh
now let's pass that buffer in
the following argument types are
supported
oh because we have to do buff dot CL
actually no it should that should work
actually
just complaining because my program
doesn't take any buffers
doesn't know if it takes buffers
yeah I know right
using video and Pi torch if you want to
have a good time
or you can use tiny grad and AMD
I don't really know about this
all right whatever we'll bring the box
back
what if I just do that
okay so look what you oh here here look
at this args okay let's give arcs
a bunch of other crap change too
Kern Arc segmental line Kern ARG segment
size
nothing else changed let me OBS dump
this guy
all right still to stand in the program
okay does that work
invalid HSA metadata
does that work
now at HSA metadata
foreign
cool yo check it out we got minus six
all right so now we're running our own
custom assembly code
specified right here and all it does
right now is end the program
all right so usually the way that you
test these things
is you uh
because you make them infinite Loop but
do you think I trust the AMD driver
enough to infinite Loop uh I do not
um
okay zeros go in zeros come out
everybody's happy all zeros great uh
let's have this one just set one of the
zeros equal to one
now let's read the code
so let's copy this program
first we're gonna load a b64 that seems
useful and then we're gonna do a dual
mob b32 definitely don't forget about
that
uh then we're gonna
do a weight count of the lgmk count
and then we're gonna store and then
we're gonna send a message to deallocate
the video first
did anything else change in this here do
I have to like say yeah look I have to
say that I used more video parts
uh I'll use edgeaverse too
that change
did uh
did our data change
same same oh that changed who knows what
that does and that changed too who knows
what that does
great
I don't know let's run it
memory access Fault by GPU node one
okay okay well that doesn't seem too
unreasonable
um let's just make these guys match here
so that's b40
that's the same and this one added an
eight here
it's still 90.
I feel like one of these times we're
gonna crash the GPU and it's not going
to work anymore
and that time might have been this time
for reference we should also
we should run the programs here too
just make sure this program works
now look what's down about it
okay good good we didn't break it guys
we didn't break it we don't have to
reboot we don't have to reboot I repeat
we do not have to reboot
we do need to figure out what we did
differently from this guy
uh okay
this matches
the rest are zero except for that one
that one
that one and that one
uh let's check my metadata
okay we increased the uh
registers but everything else stayed the
same
those are the same
they're the same
wait that's some other problem actually
this isn't related to the uh
this is failing for some other reason
get rid of the real one for now
assembly done
all right then why is it trying to
oh that just interrupted okay never mind
okay something doesn't work
can I use S on object dump
or you say read out I I don't know the
flags I see
this D right
okay we get an SQ enter error okay well
an SQ enter error is kind of interesting
I increased the counts
symbols right
I'm just going to copy and paste this in
case I did something wrong
this doesn't seem to actually break the
GPU which is nice
so it's not there
it's not in my code
uh
just for completion I should really get
they had a data size yeah I know they
have a data size in their things I doubt
that's used
it's possible it's that and if it is
that well we're going to waste 10
minutes not doing that and then if we
don't solve it in 10 minutes we'll come
back and do that but I really don't
think it's that
um
why are we loading this
what's ass
we'll get to that in a minute
I feel like we're not going to be able
to get this until we understand what's
in code KD
uh what did I use to dump that
but it's looping right would mean it's
looping
looping nothing
no it's it's D for all with uh if you
want to disassemble them
not if you don't want to
okay are these the same
yes they're the same okay it's got to be
some address you know what like b40
looks suspiciously like an address
some address just has to be different
oh maybe 408 what's it four away here
b40
uh
oh
wait I think you're right I think I'm
just missing an end program
oh that was stupid you're right that's
all it is
good catch XXX the big info you're a
winner I looked at this
a ton of times how do I not see it
um stupid okay good catch uh let's just
fix that
yeah they have see they have this end
program here and I was just going to
code end and that throws a crap we don't
actually watching the code end okay
same error
how does that give me the same error
I will leave the code end in just in
case but we'll also put an end program
in no no no well it didn't fix that
just tell me the same
here
okay I mean which of these things is it
you can use comments right is this the
comments
does that work
wait that's giving me an error
can't trust us now
foreign
comments that no that works
um that was such a good guess okay
what could it be it could be my changes
to this
God
okay that runs okay what if I change
this to four
okay that breaks it
what about that is that wrong
that runs fine okay let's just counter
this stuff out see what we get
oh it works
weird
okay well we'll figure out what that
does
no
put these back to since we are using two
of them
all right now to confirm that we can
write our first custom program yo let's
throw some two in there let's go two
all right two
oh look at that too
all right
ah ah
and oh and we crashed the uh GPU driver
oh and that was a good wallet lasted
do we have pcie ears
guard vined
yeah I agree couldn't handle the two no
we don't have pcie error so this is
genuinely just a
this is genuinely just that this driver
is just crappy
I can't even kill python all right
where's that how to reset the GPU
okay
foreign
because the driver crashed uh and I
don't think we can RM mod it because it
crashed
so that leaves us with one choice
guys he couldn't handle two
it couldn't handle too
oh I'm just echoing a string oh yeah shh
sorry
okay well okay you're right I'm just
echoing a string good point
oh
wait a second
call with me just echoing a string
still hangs let's reset the other one
oh that's the one that hangs
foreign
works
one of them hangs
um
let's try to only use that one
am I sure there's no pciers
no
okay
foreign
just put these gpus in quiet
I could
this is awful
hard reset
does the hard reset work
you're probably okay
okay let's learn about what each one of
these commands does
because we are writing our own custom
assembly for this GPU whether it likes
it or not
[Music]
put that in my kernel command line I
don't think that's going to fix it it's
it's not the GPU that's crashing it's
the driver right
and if a driver crashes like what do you
do
it's just the driver's side faulting
it's it's there's bugs in the driver
read two words from the scalar data
cache
okay so why are we loading
let me type buffer store d word and why
are we storing two it looks like
why are there two there
it's loading the address of the buffer
no I think that's just like in there I
think it's just called s
oh you think that's loading the address
of the buffer
oh okay maybe it is
zeros being loaded in there I say
or it's maybe like an offset or
something
you're right that's not a global store
Force reload so that you can RM mod I
think I can bypass the in-use checks but
like again you really think the driver
is going to boot back up and it's going
to work
I don't know I bet you it's some
combination of this motherboard and
these gpus
terrible
about how complex the hardware is
how far are we off I'm actually just
submitting to the hardware
and riding her own driver
well we can unload the the real driver
oh should we use the is there is the Pro
driver better
can we use the Pro Driver
does the truck is the Pro driver like
this driver just without bugs
pro drivers closed Source garbage well
is it actually garbage I mean I'll I'll
install a closed Source driver if it has
the same API and doesn't crash
you're like why is this crashing
it was fine if I thought there were
actual pcie years but I don't actually
think there's any pcie errors
does AMD care about this
uh yeah I have a more I have a
mainstream motherboard and Horizon CPU
we can use if this keeps breaking we'll
just have to switch out
oh it's been stable for a while so I
don't know why I just decided to go
unstable on me
I mean it's not like I'm using some
obscure CPU I'm using like a normal epic
CPU
these things are used in data centers
everywhere
it's not like I'm trying to make it work
with a Sun Spark bullshit
and like I doubt that there are consumer
GPU is that much different from their
non-consumer GPU so actually
wow this looks a lot not as nice
[Music]
how old is that hmm
it's Ariel
pulling one GPU out again this crash
isn't like I don't have a repeatable way
to repeat the I don't have a repeatable
way to trigger the crash
now it takes forever to reboot
oh I can't really set it up it's going
to take some time to set up the other
computer I think I also need to buy some
of those power Splitters or I could just
put the power supply into them
why does it crash
how is this driver so bad
yeah this is Rock M 5.5
I have to use 5.5 or it won't build for
my GPU
not once by the way
I I mean I did all this with Cuda too I
got like all of Kuda to run costume
stuff and not once with Cuda did
anything crash the colonel driver
three boots four times
I'm not taking a GPU out
it's dkms against what Upstream Source I
don't know I appcat installed dkms
you could try without D cameras okay
what kernel are you running
it's not supported in the 515 or even
the 519 kernels
foreign
junk AMD motherboard
and put it in here
gaming plus Max
I hate these motherboards
you never know which ones are good
I have no idea why you think this driver
is better
like you're saying you're saying like
you're concerned about stability so you
should run master
I don't really buy that
it still hasn't booted
all right guys this might be the end of
the stream I mean we got it to Output
two I I don't know what to say
these are brand new gpus
everything's new in this computer except
for the CPU I don't think there's
anything wrong with the CPU
um
okay
off stream I can I can build uh
consumer grade computer and see if that
one crashes though
foreign
let's leave it off for a few minutes and
let it think about what it did
I think I'm out of slots on this power
supply
is the only problem
and each of these stupid gpus needs
three things
um
oh I do have three okay I do have enough
okay do you want to put it in this
computer
I don't know
uh
all right guys maybe I'll be back on
we're gonna we're gonna we're gonna
I I've got this is just uh it's
frustrating it's frustrating AMD this is
frustrating
uh but you know we're gonna make it work
yeah I'm gonna switch I'm gonna switch
I'm gonna switch stuff to my consumer
computer
this is like I have like a ryzen it's
like a normal Horizon computer and
that's my epic computer
uh
I don't know if they're eights or 16s
okay
this is just very it's just very
frustrating
well I'm quiet now
quiet's running this kernel
um
and we installed a single
uh
uh
or SSH 10 over here
and this is the uh
Runner
all right
um let's install Rock M I have a rock M
installed
it's the wrong Rock
so let's update these to 5.5
I don't even have this one because I
didn't accept you okay pseudo apt get
update
now this should upgrade all the rock M
packages
upgrade
cool
uh now also we're gonna get
extra Rock m r dna3 up here
I have a file called Rock M clone that's
going to get check out all the rock and
crap
all right we're on a new computer
hopefully no kernel issues
crappy Verizon shit CPU oh 16 cores okay
not as bad as I thought we have the same
64 gigs of RAM
and there's pieces all over my floor
look you can see my graveyard of gpus
over there I got a 3080 TI I got a 6900
and I got a 70 900.
by the way if anyone from AMD is
watching this
uh I will become more serious about
fixing this if you contract me if you
don't contract me here's kind of what
I'm thinking guys you know I'm really
like I'm gonna put the Nvidia GPU in
that computer my only real complaint
about Nvidia gpus is they don't support
peer-to-peer but I think we can actually
fix that
you know Nvidia didn't reply to my issue
but uh I think I know what's wrong
there's these mailboxes and basically
just the peer-to-peer Hardware is
disabled
uh
uh or like maybe there's like an e-fuse
or something
because it's enabled on we have we have
uh the
what are they not Tesla what are they
called Quadro cards here the a we have
an a5000 or an a6000 A5 thousands that
work uh and the a5000 support
peer-to-peer
uh has the same chip they're all they're
all ga-102 which is the same chip that's
in that uh it's in that 3080 ti so you
know
um
AMD you guys should sponsor me you guys
should sponsor the tiny Club
uh if I was getting paid by AMD I'd be
less frustrated about this
so yeah you know if if you work at AMD
and you want me to fix your shit uh
like also the other problem is these
companies just may not want to support
what I'm doing in which case if AMD like
does not want me to put seven I'll buy
seven of these cards my plan was to buy
seven of these cards and put them in
that mining case over there
um and I'm now starting to think that I
might have blamed pcie extenders when I
didn't have to
um
because it might not be the extenders it
might just be the fact that
uh
AMD shit socks
no offense but kind of offense
all right I also have a script called
Rock M from scratch with rock M setup
oh I should probably run that actually
let that finish that's gonna update Rock
M my clone is done oh we need to build
lvm oh yeah okay get ready for 30
minutes for that
well I gotta finish that installing
first
yeah I can just install the llvm I think
there's a way to like install Rockin
llvm or something
there's a package for it
what connection is it no no it should be
x16
oh yeah I can't put two in I want to see
why I can't put two in
well because here's one and the other
one would butt up right next to it
there's only three slots in between them
uh so there's no clearance for the fans
white balance
the white balance not working
uh uh yeah sure install whatever
you want
oh here it's installing Rock mlvm
how is that there oh it's not in there
okay I should have done app cache it's
fine
what is rock ml VM install
oh that's hip
how hard is it to ride a driver Which is
less shitty well so for compute it's
actually probably not that hard a lot of
the complexity of these drivers is
because of um graphic support
like AMD do you want to be a competitor
to Nvidia
video I can carve you out a whole niche
where we're putting we're putting I can
shove four gpus in there let me show you
a cool thing about these gpus you can do
it on the 490 stuff
um you can take these gpus
and if you cool them uh so this is a
this is look how huge it is but you can
actually pull this fan off and then this
is uh this is a 2u card I'm sorry a two
slot card so I can put a fan blowing air
this way I actually bought some fans to
do this
um
Nvidia Let's uh you know like
sponsor the tiny Corp
uh and I will literally I'll make the
shit good
they won't do it like these companies
don't do it these companies because it
would be like fucking like they're just
like oh no you have to go through a
process you have to then I'm like this
just isn't worth it man I drive a Rolls
Royce you know why am I going to deal
with your process I'm not but I could
actually make your card good
all right uh and it's called Rock mlvm
let's reboot this computer you want to
see how fast this computer reboots so
fast
so fast because it's a rising chip but
not an epic chip it's because I disabled
boot delay in the Bios
oh Nvidia no seriously reach out at
least get on the phone with me you know
call me like like like that time Kanye
told Steve Jobs to call him you know
Elisa sue you seem like a reasonable
person
took Jensen for a drive once before his
stock was uh you know his stock blew up
man come on don't you want some of their
value
okay maybe it wasn't that fast maybe I
was just so used to the other one or
maybe we broke it
look look at this look at this
and you make CPUs
and you make CPUs and Nvidia is a five
times larger company than you why
why there's a reason for that
[Music]
um
all right well first let's just see if
the GPU just works period
um
no not because they aren't charging 3x
the price the price gouging is a bad
strategy for NVIDIA
okay well it doesn't work actually
it probably doesn't work though
it doesn't work
no it just doesn't work
we have AMD GPU inserted
I
mean is this a joke
is this a joke
[Music]
okay all right let's assume this is
something I did
oh I probably did do this actually hang
on
I hard-coded stupid Jammy oh my bad
yay I hard-coded Jammy in here
where we actually won focal
not like oh my God they're still Jammy
shit
oh
terrible
uh how do I get what LSB release Dash a
how do I just get the uh
no I just want the single
just show to me
now we have Jammy packages
this was my fault
foreign
foreign
would be worth more than Nvidia if they
fixed their drivers and made them not
shitty
guys
you understand that like no matter how
much I mess up in user space you should
never ever ever
get a page fault on the Kernel that
crashes the driver
never
no
I bet you this is exploitable do we need
to drop zero days on AMD to get them to
listen
all right here's how we fund the tiny
grad short AMD exploit their driver and
make money
I will fix the drivers for them
I actually look I can't fix everything I
can't fix all your all your GPU shit but
I could actually make your compute
stable on your own fucking CPU
you know
I'm not asking you see that's why
companies vote sponsor me I gotta put up
uh you know I don't know the pride flag
then little spot I was gonna say the
American flag but they don't they don't
go with that anymore either a pride flag
with the Trans stripe and you know I'm
done uh you know there we go now oh yeah
yeah oh and you just gotta like but
that's why the drivers don't work
see what I mean
um
all right we're buying a pride flag guys
we're buying a pride flag we're gonna
get corporate sponsorship now actually
uh we're in a bear market now no one
gives a shit about diversity anymore it
was kind of it's kind of a kind of a
good a good meme
uh yeah I mean that's that's the truth
man that's the truth now we care about
making money but do we care about making
money in a good sustainable way no we
don't we make it so you can't search
Twitter anymore without logging on Elon
why can't I search Twitter anymore
without logging on Elon
um no I'm sure the drivers are just as
unstable on the pro cards and I will fix
them for you I will fix them
is this stream lgbtq friendly look guys
guys guys look there's like gay people
and trans people and then there's like
corporate diversity agendas
and and one of these things are you know
a lot of cool people and one of these
things are no no no no no no no no no
you see you gotta you gotta draw the
line right when Raytheon waves the pride
flag and now we're invading your country
because we have to liberate your local
gaze
no no no no no no no no no no no no no
you're doing the same thing you used to
do you see what I'm saying
no I don't know I don't think I don't
think amd's problem is the yeah I I
don't know what I don't know why this
doesn't work
um okay
[Music]
um
okay okay
I mean we can't load Orca I don't know
if we need Orca though let's see if tiny
God works
okay
cool
uh something works
no this is exactly this is exactly what
they're gonna do man
how's Ukraine these days
yeah you make Nvidia now makes more
money off their data center bullshit
than they do off gaming I think which I
mean the price gouge is only going to go
up more
because you can gouge professional
people a lot come on fix white balance
the white balance so bad on this cam
oh now you ran white balance oh
congratulations you found the white
balance button great
um
all right why don't I have ocl Orca 64
which package is this included in and
why does it look for it
okay well we don't need that
extra
okay
deep breath
deep breath yeah the progress on AMD
cards is lower unexpected because
they're fucking driver crashes
I didn't do anything weird I'm running
normal ass Ubuntu
on a normal ass kernel
okay we don't have llvmmc
now do we have it here
no but where does that do
oh okay
okay looks like we can just do this then
and it goes
hey we got twos again doesn't it just
feel more stable on this computer
module named
feels faster right
because we're not using the custom built
llvms because we're using the standard
llvm no that's not really why
uh what's the start address by the way
on the real
okay
great we're back to where we were an
hour ago
don't you guys feel accomplished
you guys feel like we did something
to start addresses in the elevator
three points
this is the real one
um not enough I guess that's like fine
there's a flag to this isn't there
no it's not called section start
I just don't like the warning the
warning upsets me to see it or if I just
do that does that make you happy
I have to make it global
yeah we fix the drivers just to spin the
face of the video that's right
I know AMD come on care we love you all
right we need coffee
foreign
why is it stable now
why is it stable on this computer and
not stable on the other computer
no Nvidia GPU found so you don't have to
get remove Nvidia star
there is no video
we're at AMD company
but it sucks I can't put both the cards
in this computer
because the things are too close
it is quiet
I must say it's quiet
foreign
guys
I just like
until if the driver's not stable I
I like want to get to the bottom of this
you know
I'm tempted to put the card back in the
other computer and see what we get
we could just work on the thing but like
don't you feel like we have a mystery to
solve
like what what would Scooby Do he
wouldn't give up on this man this
mystery
uh
why is it crappy in that computer
spend three weeks learning about PCI
yeah well we could do that
why is my thing spamming about am what's
Nvidia NV link I don't want this
oh it's because
uh what is it
uh
system the
disable Nvidia persistence day
is masked ignoring
why is it masked
I'll just reboot the computer
all right I'm gonna put the other
computer back together and you guys can
watch me
now they each have one GPU in them
set this up
sorry it's bouncy
all right
we're going to put a GPU in this
computer
[Music]
it's a very nice computer don't you
think
PPU
looks very nice
we're going to insert in the slot
closest to the processor
I include the PCI be flaky
if the PCI is flaky I take back every
bad thing I said about the NVIDIA
drivers
I mean it's hard to have a stable thing
with flaky PCI
here
how do I know if PCI is flaky
there's got to be ways to like look for
this
all right we're going to screw this GPU
in
is that a good screwdriver
oh
yeah did I drop a screw in here
I feel like I might have dropped a screw
turn the computer upside down and Shake
found this girl
because when I counted
the right number weren't there
computer is heavy too
is this stupid
should we just we just accept that we
found a much more stable computer and
throw this one out the window
we are rich we do drive a Rolls-Royce
foreign
Supply and they include stupid six pin
power connectors here instead of all
eight pin
and video AMD I will literally buy two
more of these gpus and put all four of
them in this computer if you fix your
drivers
and then I'll buy three more and put
them in that computer
okay
gotta make sure your power connectors
are all the way inserted but only if you
have h-powered connectors there's no h
power
okay
yeah because I bought a nice motherboard
it has problems
unlike a cheap consumer motherboard
which actually works great
but they don't have PCI Lanes
no actually I'm thinking about selling a
product for the tiny core you guys let
me know what you think about it
um
so what the product's going to be
let me see this
this car doesn't have a
you know you can't stack these it's a
3080 TI
uh
fans are spinning so nicely on that
computer right now I must say
um think about no would you buy this
product okay so my thought is to take
uh
five gpus
and put them in a box
all right
and he's one of these guys maybe two of
these guys
some Dell power supplies throw a pcie
switch in there and then it's one PCI 16
that goes to five gpus that gets you
like a pay to flop if you're doing 49s
and it's just as a home trainer box
um okay and then if you got these all
working with the pro motherboard and you
put sick you hooked up six boxes
that's 30 gpus that's almost a person
no the thread rippers are exactly the
same chip uh wait which thread Ripper no
that's a threadripper pro and the
threadripper pro are basically just
epics
a home dgx basically for like a fifth of
the price
all right I I just I don't even feel
motivated to work on this right now
because if the driver sucks you know
why am I wasting time
all right let's look at the driver
source
AMD GPU
so this is this is the uh
I want to open
no here's the AMD driver
is that computer voted yet
more like the registers and stuff
they include all that here
uh
uh what's the name of this GPU is it a
navi
sell it back to AMD for Millions but see
that's the problem
and this is why they exploit People Like
Us man
like
what I'm gonna watch I'm gonna sell it
back or I'm gonna hire some sleazy
douchebag in a suit to like
to like like we already oppressed under
class man you know what I'm gonna hire
some sleazy guy in a suit to like oh
well old girl driver is on it's very
very good to know y'all know but no I'd
be honest about the bugs
okay so here it is in this computer
um okay let's write a fuzzer
foreign
and I think all I'm going to do in fuzz
is this
uh
move that to our dna3
some chance
it's called weight
it's called weight
foreign
maybe it's stable if you only plug one
GPU
oh I know it likes to break it where's
my bandwidth test
yeah I only plugged one in
up up we got it we got it
it crashed
oh I didn't even run fuzz I ran Asm
okay now let's see if we can make this
computer crash
foreign
[Music]
crash
foreign
is this the same version of the driver
well if we're gonna fix the driver at
least we should do it on
okay now we have a reproduction
uh I did try to run ASM but I don't
think that that actually caused the
problem
well at least this computer is fast to
reboot
oh I guess that one's 2204 and that one
has 2004
it is the same version
Rock SMI GPU reset I don't think that's
gonna
oh okay
no device specified how do I specify a
device all devices
your GPU reset began
I don't think any of this is going to
fix it though because the driver is
actually set faulting
and I think I actually have to hard
power this off and on
okay so we're ready to write a minimum
reproduction for this crash
foreign
test is a little aggressive but okay
again
this computer is literally a gaming
computer
I'm using this is using like a ryzen
like okay I didn't buy the memory with
RGB LEDs but it's that level of memory
in this computer
like it has memory with stupid heatsinks
on it so you know it's a gaming computer
I have an AIO water loop that has a
little LED that goes like
so this is a real gaming computer item
date
I mean I understand I understand that my
computer is I'm giving up a lot of
performance by not running RGB LEDs but
I just can't stomach them
okay
uh
let's what do we want to write a fuzzer
in
let's see if I can reproduce it only
using
this
this I run this in one window
I run D message W in this window I don't
know why I don't feel root for that and
then I run this in this window
okay and now we got a cycle
all right I mean I think this is
actually going to be super reproducible
let's read the driver
is this the same crash as we saw before
other computer
yeah pretty much
kfd runtime debug disable
[Music]
fuck refresh run list debug map and
unlock
then we go into map cues shipish h
and probably just nobody put like this
probably supposed to be a lock around
this just nobody put a lock around it
oh
dqm lock mutex has to be locked before
calling this function you want to bet
it's not locked
[Music]
but like the mutex exists in a context
of a single process it's literally
probably something like this
all right you want to try the Upstream
driver all right what is that what is
that one that you wanted me to try
the uh the the the Upstream one how do I
get the Upstream driver
one with like next
the staging driver yeah where is it
we'll try the staging driver and we'll
see if we can reproduce the buck
this is a junk fuzzer
we delete
at least this computer reboots in a
reasonable time should I buy two gpus so
I can have two gpus in that computer
um
I also like having uh
tiniest guy
I don't want to open in the same window
all right I'm gonna reboot this computer
and not use the GPO
no I'm not going to reboot this computer
unless it's
yeah look look at what Nvidia detector
returns none because we have no Nvidia
oh a tiny grad On Cue
staging DRM next
oh this is a whole Linux kernel
is this going to clone a whole Linux
kernel
do they not have it in a separate repo
they have to what is the where does this
repo
dying video
foreign
no guarantee that it'll work with the
stable Ubuntu kernel yo if if this ends
with me installing Arch Linux guys
AMD you you know you messed up if the
solution is Arch Linux
no no
the solutions never Arch Linux
foreign
isn't updated to 5.5 oh hey
I'm sure I can just install a custom
Arch build script
yo actually I shouldn't hate on Arch
Linux I'm upset with AMD and I should
say clearly who I'm upset with it's not
archlands I'm sure Arch Linux and all
its users are wonderful people
foreign
CL implementation and that's why I have
an early Runner support
guys you know there's a solution to all
this
it looks it starts with n and ends with
video
guys
is this the solution
their driver is actually very clean code
um you know
let me tell you something about this GPU
uh this GPU has peer-to-peer disabled
and this GPU also has and you'll see I
found it in in Cuda i o control
uh sniffer
my driver everything's in TC context
look at this so I found this thing
called SM issue rate modifier parameters
and if you look at the Ada architecture
on Nvidia
you'll see here
that for some reason
the gpus can do twice as fast
fp16 accumulate as FP
just look at this
why can it go twice as fast if I'm doing
fp16 accumulate versus fp32 accumulate
I think this doesn't really make sense
from a hardware perspective I actually
think there's just this like
SM issue rate modifier perhaps
um I wanted this highlight
yeah
these these two are half speed
uh you look at these these things and
like they're they're set to one and the
others are set to zero
well I miss Nvidia
but what's interesting about that is
like amd's doesn't have anything like
this so I don't understand why nvidia's
tensor cores are actually twice as good
as amd's tensor Force that means you can
build better tensor Court AMD AMD
but please please call me send me an
email like get a guy to call me I can
fix your shit man like we can make this
like like a competitor for deep learning
people can be like I want to do deep
learning what video card should I buy
should I buy an AMD or should I buy an
Nvidia right now
the only reason you should buy an AMD is
if you hate yourself
right that's the that's the only reason
even with nvidia's nerfing of the cards
um and their price gouging on their
other cards
yeah no if you want to suffer and
struggle you can buy an AMD card and you
could experience crashes that are
literally triggerable by running your
demo application in loops
I want to try an even simpler demo
application okay bandwidth test maybe
that's a little aggressive okay that's a
bandwidth test you know
let's get some hip examples
get your AMD crap drivers are crashing
like every day multiple times what are
you doing with AMD are you doing
anything weird with AMD
well also like why is this
hip CC not found
until I installed hip CC
that was actually one of the things I
installed
no
for hip
um
I had to install more crap
oh hip clang
hip depth
I don't think it's that
your AMD Works awesome
why don't I have hip CC
hip nvcc
oh hip run time and video
or maybe it is hip depth
oh it is hip Dev okay great
okay
while true do done
should open this in two windows V
message w
thank you
okay
so if I do normal stuff it's fine
what if I do two tiny grabs
I love that Matrix multiply example
this doesn't seem to hit it it seems
like it only gets hit if you use the
bandwidth test
oh no oh we got something new
oh great oh
oh it automatically reset
and now it fell back to having a broken
GPU
and now when I try to do this it just
hangs
no no like you don't understand none of
this stuff's related
by the way tiny grad's not doing
anything special with the GPU it's using
literally it's using pi opencl
it's using pi opencl and now I got the
GPU in an unusable state
I'm running normal boring ass Ubuntu
these drivers don't work
I'll give a thousand dollars to anyone
who can make the Nvidia driver crash
like this
like by doing normal shit
you can't replicate my crash with a
memory bandwidth test
wait you're on Linux 6.3
I I tried Linux 6.3 for a while
that was that was a whole that was a
whole nother I got all kinds of other
crashes on 6.3
um I believe that they might have fixed
that crash
I like I don't think they I think that
they don't crash so a GPU is probably
not gonna like they probably did crash
for the miners once they like start and
if only one process owns them I'm sure
they don't crash
oh now we gotta reboot because the GPU
is fucked
even though the reset succeeded
I'm going to rename that directory to
Colonel crashes
because you can fry your GPU probably
pretty low
I mean if like
I like heard the fans spin up I would
like pull the power
did it have anything to do with how it
schedules
no and this is an old one before the
version that actually supported it came
out
how much is a second uh
3080 TI founders
well they're so cheap
should I buy it a friend should we get
Nvidia peer-to-peer to work
should we just should we just like
switch
should we just like I kept the boxes
should we just put the AMG gpus back in
the box return them to Nvidia and buy
some 3080 TI's
what do you want you want you want one
of these crappy gpus you don't
you think you do but you don't
you know I'm saving you a lot of
headaches by not sending you one of
these gpus okay so first
we're gonna rename this directory to
Kernel crash as plural
[Music]
of jailbreaking Nvidia gpus you could
probably do it but like is that really
sustainable there's a reason I don't do
jailbreaks anymore
you know
it's like do you want to waste your time
fighting against a company who just is
not incentive aligned with you
the real jailbreak for NVIDIA is to you
want to get a video to unlock their gpus
and like leave them unlocked you want to
get a video to fix all this shit
why is some fans back
um you just make AMD good you make this
a real competitor and then they start
losing market share
I don't think there's another way to do
it
that's the jailbreak for NVIDIA
but AMD should be paying me to do this
why didn't that one syntax highlight
this one thinks it's arm oh that's cute
because it has RX and stuff
I'm not sending them an email they can
watch my stream
oh then I send them an email
what do you mean by them
hey Lisa sue your shit sucks
let's make two grand on these cards bro
tiny Grant doesn't have any tiny Corps
doesn't have any money
do you know how many do you know how
many 30 80s I could have bought four
probably because it's not even that
scummy like it's it's not that bad what
Nvidia is doing I I wish that they're
stupid like you can't use these in the
data center just creates like a stupid
chilling effect
um like it's one thing if they don't
sell them to Cloud providers through
contracts but to put that in the license
agreement for Cuda like that that's just
low
um is he mad or something yeah bro I'm
mad and you just got banned that's right
bro
we just banned that guy look at that
yeah it seems to be pretty common anyone
else experiencing crashes yeah because
it sucks
okay we have to figure out how to build
the latest version of the driver let's
start there and see what we can
reproduce
a subtract which version of the driver
these are
all right
not really Nvidia has some stuff where
they say like you can't use uh
the cards in a data center except for
it was just like
an enforceable it's just so distasteful
when a company does stuff like that uh
if you Google it like Nvidia Cuda data
center machine learning
um license
like I just remember reading this and it
was just so you just set up such like
an adversarial relationship
uh with you know your customers like do
you make money on the cards or not
the software is not licensed for data
center deployment again like this isn't
even legally enforceable but it just
creates uh
you know
yeah exactly you just call it a compute
cluster right
partner with Baidu Baidu can't write
software either
less successful guess what it's five
years later and you're still less
successful yeah exactly
exactly like oh dude we recognize seeing
them you know it's just it's just
I mean but the only way
look there's only one way to make
companies listen and this is something
I've learned you're never going to do it
by jailbreaking anything you're never
gonna do it like it's just it's just
stupid and they will always win in the
long term right who won in the long term
apple or the jailbreakers right
you lost
you lost the only way to win and to beat
these people is to build something
better than what they have
right because that would get companies
to respond companies respond out of one
thing fear
you have to make them feel fear and they
do not feel fear if you're you know
jailbreaking their shit they feel fear
if their competitor is better than them
they feel fear actually they don't even
feel fear when their competitors better
they feel fear when people start saying
hey wait a second
I'm not gonna buy an iPhone it's not
open right
I still use an iPhone
that's how I mean not just says so about
how bad the phone ecosystem is right
that Google put their own I mean I'm way
more worried at least Apple seems
somewhat customer aligned right I would
never use an Android who knows how much
spyware Google shoved into that but the
whole phone is spyware Android is the
biggest piece of spyware to ever be
created it is literally spyware for
Google
all right so you want to start a GPU
company well let me tell you something
and here's everyone who wants to start
an AI chip company if you're not capable
of writing a driver for the AMD GPU you
definitely cannot build your own GPU
right have Jim Keller send over some
pcie cards you know what hey Jim Kell
I'm waiting right you I've very little
faith in town store
um you know maybe again can Jim turn it
around maybe
I have a lot of respect for the man I
think he's a genius but tennis torrents
again ship a card
right like like we can sit here and we
can shit on AMD all we want
but
guess what's right here it's a car and I
bought it on Amazon and it showed up all
right
so every other one of these little
fucking companies like like tennis tour
and cerebus and grok like where's your
card where's your card bro
foreign
as a company
is to make drivers that work on the AMD
gpus
and to hopefully get AMD a paper
and yeah
for however much better the NVIDIA
drivers are the AMD driver they seem
they seem way better
there's a company whose drivers are so
much better even than nvidious that I've
never even seen anything resembling a
crash and it's Apple
all right
I I'm streaming right now to you on a on
a Mac Pro
have you ever seen this thing Colonel
panic
I can sit here and and like abuse the CL
API all I want I can throw anything at
that kernel and it's not going to crash
all right
and there's a reason
they're the king
2.75 trillion
all right
literally literally if the only thing
you knew about these three companies was
the stability of their GPU drivers it
would perfectly predict
it would perfectly they're they're their
market caps are exactly the stability of
their GPU drivers
yeah
build build GPU drivers don't crash
it'll be over there
I mean like
Apple fortunately hasn't made us their
their business model isn't scummy yet
right no one they're not trying to sell
anybody like like
you know Nvidia could be so aligned but
they became scummy with the pro cards
and the data center stuff and like I
mean it's because they kind of have no
competition
I mean Apple kind of doesn't have
competition either but they understand
like the long
Apple understands the long-term value of
their brand
right whereas Nvidia doesn't
and
wow wow it's come back
yeah I guess someone looked at the AMD
driver and was like never mind
okay can I see this on a log scale
there's Google Finance is better
uh does the market cap cause good GPU
drivers or good GPU drivers cause high
market cap good GPU drivers cause a high
market cap
definitely
no I mean the CPUs are good and I mean
there's another there's another great
tragedy of a company right AMD makes
great Hardware it's sad that it stand
out Patrick softwares
I mean this this car is great it's just
like why doesn't their driver work
um
I'm not a science cool uh yeah I mean
it's just
you look at the code output of my Apple
Shader it's so clean like I looked at
the code that was outputted I have a
disassembler and Tiny grad for the Apple
shaders and they look so good
um like I can't I can't compete with
them
and video will change before they fail I
don't want Nvidia to fail
like I I like Nvidia I just wish I liked
this Nvidia
all right this Nvidia was like a
reasonable humble company and then I
mean this Nvidia was out of control
they're they're gouging on their little
chips too like we can't use any of their
little chips in in new comma devices
because they're they're 2X too expensive
and there they actually do have
competition again the software is much
shittier but you deal with Qualcomm
what about Intel
let's see how good their GPU drivers are
you can tell
uh their GPU drivers are actually
surprisingly worse than amds uh I'm
sorry but their drivers are worse than
amds and in terms of making gpus
oh yeah yeah no I mean you wouldn't
believe by the way you would not believe
trying to work with Qualcomm as a
company you would not believe trying to
buy chips from them we had a sales guy
straight up lie to us for months
and then I finally got in touch with a
better sales guy by emailing the CEO and
like that guy just kind of brushed me
off I mean he said yeah the other guy
lied to you and I'm like what the fuck
like you just have sales guys who lie to
you and this is okay
oh yeah
okay and then he I mean he didn't lie to
me he just you know didn't reply for
like a month
sent them three emails and then you know
again they're not a company who wants to
sell chips and they're gonna
yeah
uh no I mean I I don't like understand I
yeah I'm getting this this really
aggravated me this this aggravated me
more than anything else at comma trying
to buy chips from Qualcomm like I'm
going to make checks I'm going to make
chips I'm going to write stable drivers
I hate all these people
when I say Nvidia has a real moat I mean
someone is a moat but yeah I mean look
again the 4090 is a great card
the 4090 is really really good
uh it's it's hard to like
you know what Nvidia here's my advice to
you
if you do three things
uh get rid of the uh respond to my
peer-to-peer issue unblock the
peer-to-peer
uh disable they uh that that MLA
dispatch and go ahead and make your gpus
twice as fast as you know you can and
then remove that uh the Banning from use
in the data center thing if Nvidia did
those three things they would restore so
much Goodwill with me and I think with a
lot of people
um Nvidia like what what do you want to
do you do you want to run business scams
in the next five years
do you want to wear business guests the
next five years and have people hate you
so much that they're willing to put up
with the AMD drivers or do you just want
to be the company that ushers in the
singularity you see that's the thing
they're run by the founder Doug Jensen I
don't know who you're listening to and
I've said this before you know I don't
know who this guy's listening to he's a
great guy actually
and I think he knows like do you want to
usher in the singularity or do you want
to run business scams you know
uh oh yeah you know the rest are
complete garbage he when you look
uh the 40 70 is fine too at this price
point the 4080 is is anyone who buys a
4080 is a moron
um
TPU is still a thing oh there's another
great company you think you're ever
going to buy one of those tpus no way
man
Google look at this Steve yege on the
platform rant all over again if you guys
never read this
right
and this this is worth reading
and it it's basically why Google will
never
like
Microsoft runs on azure
Amazon runs on AWS Google does not run
on Google Cloud
I don't know about the laptop one the
desktop 4080 is a huge scam
you know if you want a 48 you're an
idiot
I'll show you why
so the 4070 at this price is reasonable
right but let's just let's just do a
ratio of uh let's just divide out the
flops right so this divided by 82.6
you're paying 19 per teraflop for a 40
90.
for a 4080 you are paying
24 dollars per teraflop
and then for a yeah
so the 4090 is the best deal for
teraflop the 4080 is the worst deal for
teraflop
uh yeah
no no no what do you mean not depends on
your budget do not buy a 4080.
buy a 40 70. buy a 4070 and save your
money
the 4070 TI good
maybe okay you also have to look at
which chip they're using
look at this chip
like this chip is actually this chip is
a Marvel too the ad-102 the 8102 is a
600 millimeter
tsmc 4 nanometer chip
is Alex home
we're streaming and we're very angry
AMD drivers don't work
and these drivers have all sorts of bugs
we should build the latest one and you
know it's just
I have a normal can I put it in a normal
computer I put it in quiet it's a normal
computer has a ryzen
it's crashes I have two ways to crash
the driver and like not doing weird
things literally just running sample
programs and loops
so then like we did a whole rant it
turns out the company's market caps are
proportional to the stability of their
GPU driver AMD
Nvidia and then the one no one ever
talks about who makes really actually
great gpus now
Apple you ever seen this crash you ever
seen a Mac crash
exactly
oh
did you buy a 4080
good season by 48. she's not an idiot
like everyone else who bought 40 80s
[Laughter]
not dumb that's right
nap time
if I was hungry yeah I'm hungry too
what's lunchies
y'all tortellinis
yeah yeah all right we're gonna install
the new AMD driver and see if we can
reproduce the crashes because we
shouldn't hate on it until we've
installed Master then once we install
Master if it still crashes we can really
hate them I tell people all that about
uh that's right
you can't complain you try it as it
was and then I'll look at your feedback
which I think is reasonable I mean to be
fair yeah our releases should be stable
it shouldn't be as bad as the ambg abuse
well we were you've been surprised how
many people just like run master and
don't know what it is well you know it's
like our genetics they probably also
have Arch Linux on their computer I
don't know what it is
hey Tuney team we speak English in chat
no offense but non-english but we just
speak English and chat
it's all good man don't worry you're not
banned for that like that guy who asked
me if I was mad bro yeah mad yeah I'm
fucking mad all right
okay
so why
can I build a module from a GPU from a
newer kernel
I just don't know where does this
package come from
all right that looks to be the same
all right well do you know what we know
about rocks rocks are stable and if we
installed the one called rock it should
work
don't you think
fig DRM disabled
try at least Colonel I I tried colonel
foreign
do you think this Kernel's too old I
tried newer kernels and literally if you
can believe it they crashed more
um
qualcomm's GPU drivers are pretty good
they're actually quite simple
I never saw a kernel panic with those
either
okay Qualcomm stuff is very hit or miss
if it's water kernel what's a water
kernel
all right
should I just should I just install
okay
do we want this kernel
all right all right here we'll use
Mainline
okay so you installed 6.2 all right
we'll install the latest 6.2
install the latest 6.2 and we'll see if
anything still crashes okay sudo apt get
remove Nvidia and the GPU dkms all right
no more dkms
we're gonna download
kernel 6.2
I tried 6.3 and nothing was stable
are there arrows
I think SSL three
what
I did install Zen or I didn't
because I don't have the latest
lib sync I don't think I can operate
that
that's just a question of having
okay I did to be fair I didn't try 6.2 I
tried 6.3
let's reboot into 6.2
and it seems like I can't actually
install this
because my lips C is too old and I can't
upgrade that unless I upgraded
why the kernel headers depend on lib C I
don't really understand
right and let's see is not going to be
linked with your kernel I don't think
if you cannot find the Discord for tiny
grad you do not belong in the Discord
for time graph
I love how fast this computer boots okay
let's see if we can make it crash
crash one rock and bandwidth test
we should also check to make sure we
actually
foreign
guys
I I literally I I just booted the
computer guys
I literally just booted the computer
so you're telling me we don't even have
a GPU right now
okay okay okay okay hang on this might
just be stuff I did
we want to uninstall
this one this might be the wrong
firmware
these aren't supposed to go on computers
that Boop
I think I have to install this firmware
somehow
uh oh there's a way to like install it
is that one of the things that comes
with the kernel
possible missing firmware
okay we need the firmware uh Linux
firmware AMD install
firmware AMD Graphics package okay
except this is really ancient
should we try it
no
no no I'm not trying some random
okay where should the firmware live
why is that stuff still in there
I don't have Debbie in okay
okay it's still complaining about them
all being missing
because the AMD website not having well
yeah but I had it installed from the AMD
website and those were the broken ones
oh no dkms works again and it's building
for the kernels that I don't even use
water
okay we're missing this file
where is this file
so basically we need we can't do
yay I get it
the reason we didn't have this problem
before
is because of
you're on 22.
I don't want to use the other computer
it should be
all right I mean I don't know we'll just
do this
foreign
okay
PSP 33 SOS firmware failed
okay we have it I don't know you want to
reboot
should we upgrade the should we upgrade
to Ubuntu 2204 on this computer
oh yeah on those on those old
this card is literally uh
is there an AMD crash in there
doesn't even be crash in there
fail to load PSP firmware
oh wait do I have to
I might have to remake
if I copied them in hang on I might have
to remake the uh
no
did I rebuild a net ramfs no maybe I
didn't how do I do that
just making it Ram FS
too difficult update a network MFS
okay do you notice how there's a lot
less of them now
but I don't actually think it's not
being found I think it just can't be
loaded for some reason
all right one more reboot
what what what
what like Linux is this supposed to work
with
should I install red hat
they developed it on red hat
can I install red hat
you know what if you're an arch shoes
okay at least this computer reboots fast
okay
oh
okay hang on I don't see any crashes
whoa whoa
wait wait wait wait it just works guys
it worked
okay
okay we're in
whoa seems pretty stable guys
look I haven't seen a random side fault
yet
all right all right
all right let's add in a few more things
oh yeah Lisa sue you fixed it
foreign
look at this stable computer
oh no there we go
okay
so it looks like this
fixed in
[Music]
wow I mean that was stable for like so
long guys
[Music]
you know it's a race condition
foreign
get a vertical screen for how long the
errors are great Pro tip
um
we installed our install is very normal
it's not weird
I mean either way this is the Upstream
kernel and I'm getting a sec ball
well this is actually different this
isn't a seg fault in the driver
do they recommend a Linux gesture well
also this is an old rock m
M can we see the rock M installation
guide for 5.5 we can
okay well
it supports my kernel
it also supports the other kernel I
tried
this computer is uh
is 2204
this computer is 2204.
no it is officially supported by rockab
now
really is it not
can ping them for support what
would you ride your driver
how hard is it to run a GPU driver
I don't want a real GPU driver I don't
want any user space shit
um
like Nvidia I could keep all their
kernel
because it's nice
wait
you know what
I have an idea
I'm gonna put my rdna 2 card in
a few things
first off sudo apps get removed
I won't be able to use great rdna 3
instructions
and we'll have to download the inferior
rdna2
this is by the way is supposed to be the
default supported configuration
how old a kernel does this thing have
why is that
where is this by the way
they encounter a bug
hey but why are these drivers so bad
is this a hardware bug
all right guys if it's a hardware bug we
need your short AMD
you know we could have discovered the
bad soldering on those apple and
you guys know the story of why Apple
doesn't use Nvidia right
way back
in 2008
Apple used to ship laptops with Nvidia
gpus
Nvidia gave them
a bad soldering profile so the balls on
the gpus didn't uh
why is he building all these stupid
kernels
no no you're gonna stop now stop pulling
stupid crowns
which kernel do we actually have
fun
build it for my one
you're building too much
what other kernels do I not care about
this one wasn't even known even like
that at all and that one can go tell
[Music]
okay give him a bad soldering profile
um so the gpus weren't fully soldered
and some laptops broke
Apple was so upset about this especially
because Nvidia didn't take
responsibility for it that Steve Jobs
said fucking video and we're never going
to use an Nvidia GPU again and that's
still True to this day
Nvidia made them look bad
and then they realized they couldn't use
AMD gpus because they were terrible
because the drivers don't work
I I don't believe this like I bought an
rdna3 card why does this not work
foreign
did to Gary Bowser
opencl was actually created by Apple
the Epic CPUs are very nice AMD made a
very nice CPU because they didn't need
to run any drivers for it
it's all the drivers
so what are we gonna have to write
our DNA too
I'm currently removing my rdna3 GPU
should we return them will that send a
message
and we'll plug in my rdna to a GPS
why do I not feel like it's going to be
stable like I feel like it's going to be
the same thing
except slower and crappier
all right let me slide in all these
little six pin connectors oh they face
the other way on this GPU
and they click better on this one too
so red devil made by power color
no and actually I bet you the
performance isn't nearly as good as they
thought it was because their compiler
doesn't work properly for dual issue
in order to get the performance from
rdna3 you have to use dual issue uh ALU
commands
but actually we're gonna even our exam
our example actually managed to use one
our little assembly example
this card is so big it definitely needs
two screws
two screws
Red Death
it lights up red guys they're not
kidding
oh AMD Windows Direct graphics driver
does use their in-house compiler you're
saying
CL info
okay it shows up
let's get the tiny grad Matrix example
y'all want it to stay stable for him
let's first try it once
okay it gets about half the gigaflops of
the other card
done
now let's run two of them
I mean I know Two's A lot for the AMD
driver
I'm gonna get a module version
well it's a lot of info
pretty cool
wow look this one hasn't crashed yet
all right let's throw a rock and
bandwidth test in there
in a loop
guys it's been stable now for like 10
minutes
by 10 minutes I mean like not 10 minutes
but like you know you take what you can
get with
oh no here we go
whoa but it came back
it crashed but it recovered
thanks
okay I mean this just seems like a
somewhat normal page fault
does this have pci4 by the way
that's pretty far
oh we got another one
but this one doesn't actually crash it
forever
actually we obviously a PCI for look at
those Balance
oh okay so we found the stable one
you just can't use the new one
oh that's my GPU
oh you want to get brutal let's throw a
GPU burn in here
by the way this is what stability should
look like
I mean I'm even ignoring the fact that
it is crashing sometime but at least
it's recovering
otherwise it's barely drawing any power
though
like I'm trying the probe
yeah okay so I mean there's crashes but
they're not uh
they're not fatal
hmm where's that one pong
who cares
ah
I wanted to put the two cards next to
each other but I realized that I already
put one back in that machine
the drivers don't work guys
does the hardware not work
one of those things look clear that I
could drive her back the one that was
fixed look clearly like a driver bug but
the one that this one
mes might be in an unrecoverable state
like this could be a hardware failure
are we failing to add a hardware queue
or failing to remove a hardware kit we
fail to add a hardware queue
should we return these
uh I'm gonna check how long I have to
return them on Amazon
uh I think it's probably like two weeks
uh no pie torch does not solve this
problem uh here's what I'm gonna say
I'm gonna keep these cards out of my
computer
uh I'm Gonna Keep playing with our DNA
too a bit
and AMD uh if you reach out to me
uh about fixing these drivers I won't
send the cards back uh otherwise I'm
sending the cards back I'm gonna buy
some 3080 TI's and fuck AMD
uh
yeah
and then then you know we're just gonna
have to make checks because because
like you know what AMD you don't even
have to pay me
I'm not even I'm not even asking to be
paid
uh you know the only thing I want like I
want you to show me that you care I want
you to show me that you actually care uh
about supporting this
and uh I mean if you do okay let's have
a conversation about it just really show
me that you care show me that you would
appreciate me launching a box that has
five of these in it that people can put
in their home machines
um
yeah
and then you know we can look into
what's wrong with the drivers
but like
do you have I'm not tweeting at anybody
that you guys can tweet at them if they
respond to me they respond to me enough
people watch this stream that they share
the
it should they should be able to get in
touch with them like your drivers don't
work
um
to be fair
we still haven't tried the absolute
latest
should we put the rdna3 back in and try
trunk I should have tried trunk
I can't put the rdna 2 and the rdna3 and
who knows what kind of bugs that's gonna
call
cause
all right let's upgrade to trunk while
we still have the rdna2 in there and
make sure it works all right who wants
to build a Linux kernel from source
build your own kernel is quite easy
if you have not built a kernel before
disco dingo how old is that
whatever those don't seem like harmful
things to install
is our rdna3 is the first chiplet GPU
I guess it is
I'll make no I'm not making fucking menu
config I'm too old for Meg man you can
fake okay like that shit was funny when
I was nine
you know what I get why he did it like I
get why he did it he's like well it's
better to have them you know be in the
colonel than not be in the colonel
all right all right we're building trunk
did I actually manage to finish checking
this out I think I did
seems fine
all right uh what version of the kernel
is this
oh
these cars have been on for a year
though
like didn't did they just ship broken
shit
we're gonna try a trunk and if it
doesn't work in trunk
uh I look I really hate returning stuff
guys
but I I do ask that if you're gonna ship
a GPU I expect uh stable graphics driver
is that too much to expect guys
talking about the fucking chair
check the Arch Linux Wiki
make menu config
can I make old config
all right let's try this
oh okay
how do we feel about the clock Source
Watchdog maximum allowable SKU in U.S
we're gonna figure out how to download
the
at the latest kernel
where's the config
oh maybe I have that config
I don't but I can install it
you can give me the config where are you
getting this config
you know I know but this old config and
there's too much shit changed
I assume it's based off 6.3
I know it's in proc configure
I know it's there but that's the current
kernel
I'm gonna install this
why did you download index.html
oh now it's going to tell me I can't
install the headers
because I don't have the right version
of loop C
guys this is just this is our chip I I
should just be using Arch at this point
all we do on streams we try to do real
things on streams about AMD gpus but we
end up just building kernels and lvm
thank you
okay now we have this config so we can
copy this config into the Rock kernel
driver
uh
uh now I can make old config
and I shouldn't be harassed with too
many questions
you know don't restart config make clean
I don't know what Mr proper is either we
wanted to make that
we built a kernel in so long
I don't know okay
let's make old def config
all right
cool
uh all right guys just for old time's
sake what do you think we'll make menu
config
let's take a look and make sure the
driver is being built as a module where
is my driver
graphic support
G
G
no ruin our AMD GPU
module
HSA kernel driver
great it's part of the AMD GP module
okay that looks good
okay
um
[Music]
oh I can make Deb package you think
that's gonna work
what there's a bug in the
I'm falling out a bar it's probably just
my
wow can you really make dead package in
the kernel that's pretty crazy if that's
true
okay this is named rock it has to be
stable right
maybe that's what they thought if they
named It Rock it'd be stable
that package is built into the kernel
you know it'll be a lot faster if I had
64 cores but instead I only have uh oh I
actually have 16. I don't know why I'd
only did eight
let's have a good Horizon don't I
was a good rising at one point
no rule rules make Debian canonical
search okay that just has to be in the
config right
what do we do when we do in videos we
can do AMD streams
we build things we built kernels we
build llvm
all right AMD this is your last chance I
literally built your latest trunk driver
I'm going to get your trunk driver
installed I'm going to confirm it works
with our DNA too I'm going to put an
rdna3 card in and if I can make the
kernel crash by literally opening and
closing opencl contacts which is all I'm
doing I'm opening opencls using using
using file opencl running kernels and
closing them and if that makes your GPU
you know I'm not even going to say crash
I'm just going to say irrecoverably
crashes it can Kernel Panic it can do
whatever it wants the bar is really low
here
the bar is really low
comma we have we have a device that sits
there all day and Boots open pilot and
shuts open pilot and Boots open pilot
and shuts open pilot
like
it seems like you should have some
fuzzing tests that test this stuff maybe
you do and maybe it's fixed and trunk
okay we're gonna we're gonna hope it's
fixed in trunk boys if it's fixed in
trunk I'm like you know what everyone's
you gotta you gotta just you gotta just
give people the benefit of the doubt
you gotta just you gotta just you know
it's they fixed it and that's good but
if it's not fixed my deal is on the
table literally I'm gonna put the GPU on
the table and talk about how my deals in
the table oh it's definitely fixed in
trunk all right great just building a
kernel no it doesn't take this long if I
get my good computer
but instead I have this computer
wow Ubuntu builds a lot of crap
if empty driver's always been this much
worse than nvidia's
you know like building building building
is build the Colonel's building it's
building building
oh we can also uninstall that other
kernel now
foreign
it's seen as a Law Center not an
investment then I don't think they're
going to take me up on my offer guys
this is actually using all my CPUs all
right
by the way you know about hyper
threading right that's actually all the
CPUs
when you look at the load averages
system it's 22 now and I only have a 16
core computer
bad can I get better Horizons what are
the New Horizons
and does it fit in the same socket as
this one if I just buy a new CPU kind of
just shove it in the hole
uh why is it
I have a
5950x I bought the nicest one here
can I buy anything better
socket am4
new socket am5 oh
it supports pci5 oh so exciting
ryzen 7000 so these launched can I buy
these
same crappy number of threads how much
faster is that
not worth it
30 more money for 10 faster yay
and it's kind of bugged great
did you know building a kernel took this
long
I mean I guess Ubuntu must build every
driver but still
all right
um again let's go back here and let's
see
my card's called like GF card called
that or something I know it's like 11
000.
wait what that's not in the driver
what's the actual name of the chip looks
like the code name of the chip
nav E3
yeah I'm sure with a tuned config but
you know we got to build everything
okay we don't have Navi threes
you know what AMD names their shit
better you can go in the AMD if you
haven't looked at the Nvidia driver
yeah we're on our DNA too we're trying
to build a kernel
so what's the actual name of the chip
Graphics compute die Navi 31.
can I search for Navi 31.
the latest Mesa it shouldn't use Mesa
oh here we go okay what's a yellow car
is that the one I need
codename Plum Bonita okay okay
plum
I'm sure it's a plum Benito
oh it's a plum potato you're right
all right
so now we just need the docks for a plum
Bonito I wonder if all the dots are
really in here Nvidia did not include
all their registers in the driver
sure no it's not mobile is it no this is
a real one Bonita
oh it's called gfx 11. oh that might be
easier to find
okay it's gfx 11.
oh which kind of makes sense because
it's eleven zero zero all right fine
how do the names get generated and how
someone comes up on them
and you know I'm just thinking of the
Hollywood Undead what are you gonna do
after we get signed by 30 inch Spinners
and Pimp My Ride be there that night and
save Tupac's life
or go back in time be there that night
and save Tupac's life then pay my fine
for getting caught fucking on the
Hollywood sign
man all I wanted to stay on the new
album and it's so sad like you know it's
just it's just like these people just
like the lyrics just sound so generic
and Bland you know and that's what I
love about Tom belong man Tom Delong you
know I saw him I saw him once in concert
he's like yo how many are you going what
the fuck your dog tonight yeah
right that's why Tom delong's awesome
yeah that's what I'm doing boys yeah
[Laughter]
all right oh Z STD not found
well maybe we didn't need that one
you just know
actually I watch some good videos of
people bunking all the uh no no no no no
all the debunking all the Navy videos
this is a really good debunking YouTube
hey mom there's something in the back
room
disabled GPA mode
to the ring that expected
has anyone like seriously read these
drivers
is it like a good like hi I read the AMD
drivers and can tell you how they work
um
I think it's mad that I don't have like
Z crap or something
foreign
TD oh that's Facebook's compressor
oh no
no don't clean no no no no you're making
clean
please no please no
please don't have to rebuild everything
it's gonna have to rebuild everything
oh
I feel like we made clean and we're
gonna have to do this again
oh no we're good okay uh no maybe we're
not
nope it's remaking everything okay
[Music]
just we'll just sit here and wait I mean
this is my fault that I can't build a
kernel so you know
you know which micro codes get loaded
and now it's just gonna be covered in
crap
oh it's probably like being video
drivers you can like enable a lot of
debugging stuff
Dev info stuff
foreign
wait what the only thing that calls this
is a self-test
no okay so I think this v11 stuff is the
GPU it's it's all it's GPU v11
I can't believe it made clean
uh
uh that said that would work but it
didn't
okay
um make install kernel does that work
can I just make install will it work
s sudo make modules installed sudo make
install
okay
I need to remember to mod post
didn't say I have to
press enter repeatedly
all right we have to wait while this
builds again
let's even get a boot
we're gonna do all this and this new
kernel is just not gonna Boot and then
not be able to recover the computer and
we're just going to end this stream on a
sad note and these gpus are getting sent
back because if you have to build a
custom kernel
I have both versions of Ubuntu that you
claim to support I'm using your dkms
package
I don't want that config
for an old kernel I stole the mainline
kernel 3.91 config why custom kernel
because we're trying trunk
we're trying trunk that's the respectful
thing to do when you have drivers that
don't work before you send the hardware
back
I never send stuff back guys
okay here's my deal with Nvidia with AMD
I don't want money
I want a registered document
I want all the documentation you have on
this GPU
and then
I'm yeah just release all the
documentation you have on this GPU like
your rdna3 architecture
um and then then I'm happy like I want
to understand like what this thing is
doing and I'll write a real driver for
it
not a real driver look I don't mean to
insult the driver and like part of the
problem part of the things that are
annoying is yeah you gotta deal with
like all this bullshit you got to go
like way back in time
and you got to support everything
and then you have to support Graphics
which is way more complicated than
compute like you have to support going
back to like opengl 1.0 and like maybe
you wrote an emulator for it it's well
abstracted but you probably didn't
why five
why is this one five
like what's sock 15.
do I have a sock 15
apparently I do
so I can use the aggregated doorbell
obviously we have to aggregate the
doorbell
they put a PSP inside of it
I want documentation what is a PSP
all the platform security processor
great
all right how about a VC do I have one
of those vcns
we're blackmailing them we're making
them an offer they can refuse it and
their drivers will continue to suck
ah no never mind I take back my deal
about the documentation because it's not
going to be good documentation how much
should I pay for these these cards are a
thousand bucks
and I bought two of them
yeah right
I could have bought four Thirty eighties
oh decknet protocol that's great yeah I
understand you're making fun of me for
not using a minified config
what is sock15
why don't you include at the top of this
thing what sock 15 is
we've clearly had one back on Raven and
Vega
you know what I don't know all your
coconuts I know all of nvidia's code
names which kind of helps me
wait you see no crashes
keep it going
because I installed the same kernel you
did
oh you know all Nvidia you know all the
AMD code names
not good for finally compiling me up oh
oh oh
okay
all right let's make modules install
chemical flash you tell you come back
here in three minutes when you're like
oh shit it crashed
oh by the way make sure you're running
on the GPU
make sure it's uh CL info actually
returns your GPU
all the bird ones are apus yeah debug
app local is fine that stuff doesn't
really matter
never mind I thought we were done but we
had more to do
what's Vega
what's all debran are these things new
like Nvidia I can name them guys well I
don't know much about but I guess it was
Kepler before Pascal and then it was
Pascal and then it was touring no no no
no
you did Maxwell it was Kepler Maxwell
Pascal Turing and Pierre Ada boom do I
pass my Nvidia interview
did this build or no
well yeah Pascal is pre-turn you don't
even have a GSP bro
without a GSP how can you expect to have
speed
oh wait we found all the names
these
with were the new ones
God I can't even remember the name you
just told it to me and I can't even
remember it Plum Bonita
where's Plum Bonito
I can't believe this team like actually
runs hard
oh beige goby
not even in here
it's not even in here
still in this car
oh
wow Habana labs
wow can I buy a gaudy too
nope
I can buy a gaudy two men's XL t-shirt
all right sudo make install let's go
it's smaller and that concerns me
wow another D is huge though
where's the nearest okay how much space
do I have on the boot partition
why isn't it Rd so big
update grub no it should call update
grub we'll see if it doesn't
oh okay dkms is not supported that's
actually fine
do I want to uninstall dkms
if it didn't build I guess I don't care
it should be the default grub I don't
know how grub works
so you don't know how to use grub
how does it know what the default
kernel is
give it how do I know that
all right YOLO
oh grub config that's smart
chemical flash did you get a crash yet
I've had Arch would have rebuilt my
kernel so fast
oh it didn't run on GPU
um it should run it should definitely
run on GPU by default it runs CL info
and see if your GPU shows up
oh and then make sure you have Pi opencl
installed
um guys
oh oh oh
oh okay
great I managed to build a kernel
nine-year-old me would be like wow I
could do that too oh all right
great
let's see if it crashes all right so by
the way yeah if you're if you're doing
tiny grab stuff you have to check two
things
um check CL info
and then tiny grab by default does not
install Pi opencl so you just have to do
piv3 install pi opencl
that's all you need to support tiny grad
okay if we really don't ask for much
no no yeah it just means that the kernel
built guys
we all knew Linus Torvalds was a genius
who actually writes some of the most
stable software in the world
you know like nobody doubted that the
core kernel is Never Gonna crash you're
not gonna get like a crash trying to
free a page that's only true on gvus
it'll tell you by the way if it's using
the GPU
and check your gigaflops if your
gigaflops aren't High
this is trunk
I used to yeah okay
so this is a different crash
I've seen this before
not with the AMD modules what do you
mean look at what look at whose work cue
it's on
foreign
okay but no real crash all right let's
put the rdna3 card in and see what
happens
okay here's my rdna 3 card
I'm sending them back if this doesn't
work they're going back
they're going back I don't know what
we're gonna do I don't know what we're
gonna do as a company
that's tiny grad because we're giving up
on AMD
I don't have documentation for your chip
documentation for your chips and a
stipend that sounds good and then I'll
fix your traffic am I asking for too
much guys
well you know what even better than a
stipend why don't you give me some
Milestones do you want to get a 64 do
you want to get a map mall that can
actually go full speed I can get you a
map well that can go full speed okay
okay our DNA three card going in
barely fits in case
if these get any bigger the cases are
going to have to get
to get I guess they know this I guess
they designed it just to barely fit in
the case
we'll put one screw in that's how much
faith I have one screw is worth
I'll make sure I appropriately plug in
the stupid power cables
oh yeah they face the other way on this
GPU I remember
you have to plug in a little two pin guy
and then the sets pin guy
okay you have plenty of power to crash
here's my rdna 2 card
I have the boxes they're going back
they're going back
I'm going to check over in this window
I'm gonna go on my Amazon and we're
gonna see when my return date for these
cards is
uh wait so why am I returning this
item defective or doesn't work okay we
have until May 25th to return them
that's the return day for the gpus
how do I copy and paste this into here
no sketchpad
is this gonna work
fine
okay good we have a count
this day we're gonna call our day
and we're gonna put it right here
because this is the day that these have
to be returned by and we're going to
make it red
oh this is a nice app sketch.io okay
this is trunk
it's first check does it work okay it
works
does it recover
does it recover it didn't recover for me
failed to add Hardware Q to mes
might be an unrecoverable State fail to
restore Q2 fail to restore process Q
in addition to this crash
and now it doesn't show up in CL info
anymore
just running CL infographic now
all right where's that resetter thing
I'm gonna really try with them here
we're gonna try to reset it can we reset
it
Arch Linux isn't going to fix it guys I
built the kernel
I built their kernel I installed the
latest Rock m
by the way no amount of user space
should do this
like fine it fine fine if I'm in user
space and I like like nmap the pcie bar
fine then you know your kernel driver
can crash
stable now for two minutes
but you have crashes
how come you don't have this
I mean guys there's one other thing we
can try
I'll try the last thing if you want me
to try the last thing
it could potentially be this card
I'll put an issue on which repo
I'm using the top pcie slot
you can replicate I get this crash on
both computers I think
I do get this crash on the other
computer right
or did I only do the one I only do the
bandwidth test on this computer
computers a whole other nightmare
okay so where's my sketch
this is our day
and this is today
we're gonna make today blue
all right
how long should we give AMD
two weeks is pretty nice
I feel like no you see you can't give
them two weeks
as long as I hate Nvidia
no and then that doesn't give me very
long to send it back I think if we don't
hear from them by Friday we're gonna
call this uh operation green
okay
okay
I made it green
okay
AMD
by the 12th I want some sign okay I want
some sign that you care
I want some sign that you care about
your drivers being good okay
because so far I've really seen very
little sign
[Applause]
[Music]
wait it works for you and it never hangs
it never crashes you can have two of
them running and it never crashes
does my car just not work
what what see
what CPU
which GPU which CPU full specs
let's wait for this computer to boot
uh okay
it's an older AMD
this is the other GPU on the other
computer
hmm
hmm
very interesting
uh I could throw in a bandwidth test but
I think that actually will crash if
there is a bug in the driver that was
fixed
wow
okay
I mean look I can't reproduce this here
on this one
okay let's swap the gpus
cool
you guys know that I'm rooting for
things to work
I'm never rooting against people
let's swap them
okay which computer is gonna which
computer is gonna have the issue we're
gonna swap them both and turn them both
back on
will it be
quiet
will it be tiny
will it be neither or will it be both
find out on the next episode of George
hot's twitch
together
foreign
[Music]
magnetic screwdriver
it feels hot
foreign
with a slot and press on a little tab to
do the PCI release
okay
R dna3 card
goes into choir
oh we're gonna make this will make a
good write-up for my blog if it's the
card
because it cost me a lot of time now
I'll write a little program to check if
your card has this issue
and should we short AMD stock
or is it even worse some deep
interaction with the motherboard the CPU
and a race condition
let's find out
okay
different gpus and quiet
now let's put this GPU in tiny
foreign
it's the one screw treatment
plug in these three wires
okay
all right quiet should be back up
no issue
and they start right away
guys do we just have a defective GPU
this is the other computer
this is a different computer completely
different driver
we're going to see the issue on the
other computer
yeah
what if the whole time we just had a
subtly defective GPU
like you watched me just really like
scientific method right
this computer takes forever to boot
but taking forever to boot might
actually have to do with one of the gpus
being defective
guys it hasn't crashed yet
we were so quick to blame the driver
poor driver the interns worked really
hard on that driver guys
and to be fair I've never had an Nvidia
GPU broken like this
I've had broken Nvidia gpus before but
they like just don't turn on
I've never had one that was subtly
broken
isn't it like a 1K motherboard this
motherboard was uh
oh one of the ram was
I I knocked out one of the Rams while I
was doing this so it might not have all
the ram
I plugged it back in hopefully Ram is
hot pluggable
foreign
super reliable
okay Moment of Truth
we have no crash on either of them yet
I know
foreign
this computer with the latest driver I
expect to also be able to do bandwidth
tests
up
nope
that killed it
but now I can't reproduce
you saw me like unplug and replug and
reseed it multiple times so it's not
that
I didn't change any bios settings
okay well it does still have that crash
but that's a different crash
this kernel doesn't have that crash
oh no there we go
mess might be in an unrecoverable State
and it's the other computer
I think that GPU is defective
I switched gpus on both PCS and we just
reproduced it on
the one that had the broken GPU in it
yep
seems like it seems like that's caused
by a broken GPU
let's reboot this and let's try the same
test on it
no I don't have any more I have two
but I did have to run four to trigger it
so we'll reboot this again I went back
to Kernel 6.2 which doesn't seem to have
any faces
how fast can I get one delivered well I
gotta send this one back I have one that
works it seems like I have one that
works
but this is the really problematic crash
the other crashes are normal the other
crash is like clear
no food or not
no I'm still upset and honestly I still
want to hear from AMD that they care
I just want AMD to be like we care and
we're gonna fix this
I'm feeling good
not shut down
there's not shut down
wait
which way which fix are you talking
about
wait what are you talking about
I'm not even
I'm not even using this compiler
while true do that
while true
[Music]
want to do that done
that's a normal crash
fine
unexpectedly invalid is fine
no I did post a really cool way to crash
a computer with 249 no
it's not the GPU
reproduced on both
just a race
I don't even know what you linked to
here
this is a compiler for shaders
I'm not even using this I'm using lvm
but also
this doesn't explain
fail to add Hardware Q to
faulty
I know
uh so
it seems like uh chemical flash uh try
running four
it seems like two just it's just a race
it seems like two just doesn't always
hit it
all right
so uh where's my sketch pad
all right so it is today uh May 6th
um on May 12th
uh I need to hear by May 12th so we're
actually going to move operation green
over here because I think I'm going to
New York for a bit
and I'm not gonna have my gpus sitting
in a computer here deprecating and
losing money
um while uh
I'm running a boring opencl kernel in a
loop
why do you think
okay well this is the last day I can
return my rdna uh
three gpus
like
guys I I just I want chat I want you to
be honest with me right now
did I give them the benefit of the doubt
I like really tried here right
like this is not some thing I'm gonna
find you know what I mean like the other
crash look I will forgive or crash if I
can reproduce it
um
I will try trunk I will try a whole
bunch of different versions
uh really what I'm hoping for is a
chemical flash if you're still here if
you could uh reproduce this
try a different motherboard I tried two
different motherboards with two
completely different architectures I've
tried four different kernel versions now
I didn't yeah I can get stable diffusion
working too I'll show you I could stable
diffusion working stable diffusion runs
right now I just gotta reboot this
fucking computer
Stables Vision runs inside of us no it's
not it
it's not a
can I push the full D message to GitHub
sure
I mean I don't think you need any more
full than that that's the full thing
no I don't you're not using fucking
Riser cables I've given them the benefit
of the doubt
there's no risers on any of them they're
plugged both into very nice motherboards
this computer is all built out of new
stuff and no used stuff
it's been completely stable in
everything else I've done thrown a guest
like I'm never gonna find this what do
you okay let's start with what's a mess
what's a mess that failed to respond
like I appreciate that it's open source
and a lot of stuff is open source but
like this stuff's not
what's taking off like a rocket right
now
view or something
now
oh it's amd's Hardware scheduler great
thank you
and you know this
it's a new micro engine scheduler does
it have a secret
documentation document all this
or link me to documentation
but no wonder no one uses Rock M pie
torch
foreign
thanks chat GPT
no I didn't install any bloatware the
AMD
oh
five shells no crash hey this guy's
crashing
five shells no crash okay okay
by the way check what's your average
gigaflops
is your average gigaflop something like
if your average gigaflux isn't something
like 13 you're not really running on the
GPU or something
see it could be related to power
management
okay all right we're gonna give that a
try
bios on both computers I don't think so
yeah five Loops it can get a little bit
slower
V bios
Oh you mean the V bios oh
I don't know I mean I don't know if the
ATI the AMG V bios is do-more
uh let me see if there's a newer one
wait so like
I don't know if I can put the reference
design one in
let's try let's try this
it was just on crashing
oh same problem
all right how do we check the V bios
K SMI
to install that
okay now it's stuck drawing 148 Watts
whoa that recovered it
okay well it's recoverable
foreign
there's a comment at the bottom of that
same issue with 10 command lines
this looks different
seen this one
it doesn't look related
try some bandwidth tests
foreign
I know I know this is wine videos I've
never had anything like this within
video
foreign
I'm a lot happier now that I can reset
it
we found a kernel that isn't awful
uh let me see if resetting works on this
guy
all right
this one can't rock and bandwidth test
can it
this one on this kernel will rock and
balance has to fail
yeah okay we got that and that's a real
crash so we gotta go to the other kernel
foreign
cards back in the computer that's
supposed to have the two cards
we're going to install the most stable
kernel I found yet
and we're gonna see if we have a same
development environment and if we do
I don't know AMD I would just appreciate
if you cared
that's all
I would also appreciate acknowledgment
of not Karen I would also I mean morally
do you want this
just does AMD want this
does AMD want their cards to be beloved
by Machine learning enthusiasts
everywhere
five do rock anyway no
I don't know if this is still running
what's this doing
tar seg faulted
oh now you just broke my whole kernel
I'm gonna do some tens if you're
thinking Nvidia is bad
if you think AMD is bad I mean
like there was no issue there's like
there's there's multiple different
crashes
of varying amounts of annoyance
but at least resetting the GPU Works to
get around that
I haven't been able to put this GPU in
an unrecoverable State yes which I guess
is the bar
as low as it may be I guess that's the
bar
I don't even know what the mess is
I'd probably be better off just
disabling it
foreign
which Nest do we have loaded
here's the mouse there you go
oh what instructions
it's not encrypted at least
it's fine
wait what oh there's so few strings
is that a signature
looks like a signature
all right
a good walk
I have been walk
oh so wait it seems like oh
can I turn it off
wait I might be able to disable the mess
do we need a mess
can I disable the mess
oh what I already did that I want to do
it again
Rock M doesn't work without mess
line 137.
go what line 137.
strong Frosty how do you know so much
about this stuff
yeah I added myself to the video group
oh you're working out oh cool
which one the current runtime or the old
one
and then there's like two completely
different ones there's one in the Pro
and the one not in Pro
okay but so it seems like they
introduced mass in
oh Navi
[Music]
what's Sienna chai child
oh this is Navi 21.
so this this is this is this is the uh
big nappy
mess has been there since 2020
didn't look like it
I only see a mess for 10 and 11.
foreign
to make the new computer crash
this is due to virtualization being
enabled in BIOS
um
I'll check that I'll go into the bios of
this computer
unfortunately yeah I have to disable I
have to enable the uh
the graphics from
how do I check if virtual Edition is
enabled
no but no that's not going to do it
foreign
I'm pretty sure my iommu is disabled
okay let me uh I don't know what this is
gonna do to the Stream
but uh let me just go to that computer
oh first off okay first thing I want to
do is check to see if we can crash it
and like crash it Beyond repair
uh it's fine if we get recoverable
errors but if we get unrecoverable
errors we can't use that computer
foreign
might be okay
okay that recovers
okay they recover but do it quickly
again
where it failed to rag I or Q8 that's
new
no
and I've entirely locked the computer
hard hard reboot
all right let's go into BIOS
I touch the pan
is it back
yeah okay
the problem is basically
if I switch my monitor my USB things
also connect to that computer
I don't think it's that
all right guys I
I hate sending them back
it was a sketch
I must open something else in the sketch
one and I'm never gonna find it
oh here it is
[Music]
we send the gpus back
all right I'm gonna switch I'm gonna go
into BIOS and I'm going to enable bio so
we can see it here okay I'll be right
back
foreign
okay
we're back
all right
virtualization was enabled I also set
the graphics to be the onboard Graphics
in hopes
that we can connect through the BMC
uh there is onboard Graphics in here
I understand there's none on Epic but
there's a BMC that contains a really
crappy little graphics card
see if we got more PCI errors
yeah look we get PCI errors again
I don't know what those are
but I now don't think they're related to
anything really PCI
uh let's see if we can connect where's
the
remote control HS viewer
Quest full access
full permission
Master session was the master oh great
it works
okay
we've disabled
virtualization
you just we'll start with some bandwidth
tests this time
now let's start some of these guys up
a new error
that's a different error
crashed one rock and bandwidth test
Mass hours
one of them worked page vaults here
this one's still working
three working
until I run a bandwidth test
it's going to bios
I don't know what those crashes were
oh I've never even seen this before
oh this is cool
wait I want to go into BIOS
no don't configure firmware
send Keys delete key control alt delete
I don't want no slave permission
okay I don't know if the keyboard works
the keyboard doesn't work
how do I enable the keyboard
where'd the login go
how come the keys don't work
I I hate all these non-subscribers
I can't send keys
[Music]
can't even reset the server no this is
wrong
I am admin do they not know that
I am admin
no I don't have
oh yes now I have full access
oh now I can type
oh you cannot stop me now I'm not using
the J viewer okay I hate Java
password's tiny by the way
great even on even on the way out it's
crashing though
we're gonna all look through your bios
together
I disabled virtualization we'll check
for Io mmus and anything else I really
like that I can actually see what it's
doing now
okay
was my BIOS no
not using the J viewer I hate the J
viewer
should I just set the keys keys to
Japanese and pretend it's the J viewer
just try vast AI oh my God I have a
subscriber saying this
you know the point of the stream is
never to do the thing on the stream guys
if we wanted to do the thing on the
stream I'd buy fucking a100s but were
poor so I'd buy 30 90s which worked
great and don't this is a 30 80 but I'd
buy 30 90s
or 40 90s they're both great choices for
machine learning
it was not a great choice for machine
learning uh 7900 XTX
only an idiot would buy this to do
machine learning all right
all right you know what's even stupider
than buying you know how I made fun of
all the people who bought
4080s
and I said you were stupid you know
what's even stupider than buying 4080s
buying a 7900 XTX and you know what's
even stupider than that buying two of
them and that's what I did okay
that's what I did I bought two of them
we'll let the non-subscribers comment on
that
I bought two of them and now I'm sitting
here in HS viewer
staring at this screen that says no
signal
[Music]
now my HS viewer is going
I'm trying J no I'm not downloading J
viewer
all right J viewer was worse than I
thought it would be
all right
and during setup
zoom in
oh yes well don't you love this zooming
in cuts off part of the screen
zoom out Zoom normal
all right well I'm sorry it's small
small for me too
all right
so I disabled svm mode
um
I disabled uh okay so I disabled svm
mode and that didn't fix anything
by the way
if anyone would like to tell me where
boot delay is I'd love to turn it off
but unfortunately it's not real
check resizable bar this bios doesn't
have anything for it but above 4G
decoding is on and sriov is disabled
which I think is what you want
this isn't AMD this is just what
see look boot wait time is zero
onto some more PCI shit here
like I can disable re my iron mu is
disabled
those things are Auto which I don't know
why yeah we're gonna edit because that's
right
um all right guys
uh
oh you know what I can actually disable
that at least we'll disable something
that's a good point
wait for BMC disabled
boss
don't like quit
guys look
[Music]
I I can't undo 10 years of crappy
drivers in a stream okay
where's my calendar
bringing the calendar back up
foreign
no no I can't
I can't
I'm gonna screw the computer back
together
and then cry
and then no actually I'm going to return
my gpus
guys I hated video
we can't just switch to Nvidia okay this
is my last plea
this is my plea to AMD
like
we can make this
thank you
come work
higher the tiny coil
we can make
the ml experience on your gpus so good
Nvidia isn't perfect
shoved here
driver
into a binary blob
new
are open source
I want to believe
but it's so frustrating when
the kernel driver doesn't even work
let's open source the docs
Green Drive just
for deep learning
let's build
computers with 30
to use all working together
let's make
that experience
hit installable
I bought two of these gpus because I
wanted
to believe so much
imagine
Nvidia is 5X
your market cap
your driver is 5X more
stable
apple is 5X and videos
market cap
their driver is 5X more stable than in
videos
25x more stable what if we wrote a 100x
more stable driver
let's
even CLP by the way if you guys didn't
see this this is this is
I'm gonna turn that computer off
computer boot
this is CLP on that Nvidia on that AMD
GPO
like I don't even know why I'm trying
CLP which literally does the stupidest
uh
it literally does the stupidest uh thing
to get the flops
it promised me 61 and it delivered me
34 and I'm being generous here because
sometime it only gets 30.
let's get all the flops
I will put get you on
ml perf
next November you guys know my mouth
all right so let's see who's on MLP
right now and video and video
AMD sorry sorry sorry no that's that's
the recipient now that's Intel wow they
use their own CPU
there's two companies on there right now
Nvidia uh sorry Nvidia and Intel I will
get you on ML perf next November
yeah I'm sure Arc is worse let me tell
you how I know Arc is worse
let me tell you how I know it's worse
okay guys it's very simple
The Arc driver actually manages to be 10
worse than the AMD driver am I covering
any of that
you can just know
because you'll look at the market caps
of the companies next November is not
past the singularity The Singularity is
not for another 15 years
all right guys
um kind of a sad depressing stream
we'll we'll take one last look at the uh
this and the uh the calendar
we're gonna get rid of operation Green
from the calendar look I don't want
operation green to happen but
I don't like operation green we're gonna
delete it okay this is today
all right that's our day
something needs to change between today
and our day
something we need to the universe to
send a sign
we need we need AMD to send a sign
that's all we need is a sign we need a
sign that they care
we need a sign that they care to prevent
RNA from happening
all right our day is the last day that
I'm allowed to return these rdnas rtna3
gpus
um no there's not going to be an
operation green
you know what we're gonna do we're just
gonna we're just gonna close we're gonna
close the tiny Corps
we're gonna close the tiny Corp but we
just just
wait rdna4
do you want it to be do you want it to
be a uh
am I running CL perf and rock M yeah I
installed Rock MCL
we can beat them
is that you got got a new GPU plan this
year
it's usually every two is it not when
did these come out
and Nvidia does it every two so they're
not We're not gonna get 50 90s until
2024.
[Music]
no why do you think
I don't think so
big Navi came out at the end of 2020.
this is the card I have
um
next November is not 2024.
enough
wow wow
can we just read this tweet
all our dna3 refresh cancel all rdna3
skew misperform an efficient Target
rdna3 bad all platform Jensen wind
we will end the stream with a picture of
Jensen taking a GPU oven
no
no no no no I want yes here is Jensen
taking a GPU out of the oven in his
house
this guy wins this guy wins AMD this guy
wins Jensen win
Jensen win
the tiny Corp can fix it but we need a
sign
thank you everybody for watching my
stream and I'm sorry no we have not
fucked in video no no no no Jensen
there's there's a picture of Jensen
taking a GPU out of an oven
um yup yup that's that's just
ah good night everybody
we don't hate AMD we just want them to
be better
we just want them to to to to to to
erase the smug look from Jensen's face
when he's taking a GPU out of the
fucking oven you know what those things
cost
are those h100s what is h100 you know
how much they cost 40 racks bro 40 racks
I could buy a Tesla
one two three four five six
Teslas
instead of that board
there's eight
eight Teslas
all right yeah that oven doesn't look
cheap either yeah yeah let's do we have
a picture of Lisa Sue's oven can we
bring up a picture of Lisa Sue's oven
you know I don't think they're all gas
range let's make your drivers good you
know that's right that's right look at
look at his nice ass Oven Man
play the video no no I can't play the
video
you can't play the video it's it's it's
copyrighted I don't know if it's
copyrighted but we can't
good morning everybody good
morning Welcome to My Stream we'll get a
little more light on me we'll crank up
the brightness here there we
go nice to be back in my
studio my studio oh is that loud it's
probably
loud well you know you didn't become a I
don't
know
good morning good morning good morning
all right we'll let we'll let on
subscribers talk for a little
bit
welcome to Saturday Welcome to My
Stream welcome everybody if you're new
here my name is George I have a
stream uh I heard Elon wants to be a
streamer so you know it's cool to be a
streamer and that's why I'm a streamer I
Googled how to be cool and it was like
be a streamer and I was like wow no way
I could just be cool if I'm a
streamer uh what are we doing today we
are doing some refactoring of tiny grad
but first we're responding to
comments we're responding to comments
okay uh you know just so you know if you
leave comments about me uh I read them
all right uh because comments are the
best way for people to honestly tell you
what they think about you uh which is
which is a really which is a really cool
thing uh I did love this I did love this
this CS Lewis quote uh of all tyrannies
a tyranny exercised for the good of its
victims may be the most oppressive it is
better to live under robber barons than
omnipotent moral Busy Bodies the robber
baron cruelty May sometimes sleep his
cupidity May at some point be satiated
but those who torment us for for our own
Good Will torment us Without End for
they do so without the approval of their
own conscience see I heard it ones
described as the difference between an
overbearing mother and an overbearing
father an overbearing father says clean
your fucking room or I'll beat your ass
you go clean your room an overbearing
mother wants you to clean your room and
enjoy it and that is tyranny my friends
that is
tyranny
um but where did
did uh oh George needs to take a
sociology uh philosophy
class uh now now no no no no I read I
read another comment this morning that I
think uh kind of dovet tales into this
uh and it was about I can't bring up
Twitter because I have to log in but it
it's from Utah uh
teapot and I really don't understand how
transhumanism turned into Tech optimism
in EAC and in the process became
antagonistic to trans people all right
all right hot button issue hot button
issue look all I'm going to say is this
wokeism and trans people have as far as
I know nothing to do with each other
right don't don't conflate hating
wokeism with hating trans people okay
and nobody should conflate those things
who do I who do we really hate who do we
really hate when we talk about hating
wokeism
right who do we hate there is definitely
someone we hate who do we
hate oh yeah yeah we're doing this we're
doing this who do we
hate Disney yeah that's closely related
we do hate stupid people and idiots
always uh companies the PMC but who is
at the root of all of this who is at the
root of all of this wokest
ideology I'll give you guys has a
hint not George Soros and not D cels it
is the University
system our war is with
Harvard our war is with the the ivy
league educational institutions in this
country that create the PMC not with
trans people okay it's important to
understand this right most of the woke
people I hate are Ultra privileged white
fucks who graduated Harvard not to be
racist but it's
true uh so you know that's just that's
just something that's just something we
got to uh we got to and also also if you
are in a quote unquote as they would
call it marginalized group uh I may say
that you may not want to Ally yourself
with these fucking idiots right like if
I was in some marginalized group right
like I don't know man look I'm Irish
right if I was in some marginalized
group and some some Ultra
privileged Fox privilege is good
privilege is good who who've been at
these universities running Society for
the last 100 years have now decided to
make me their focal point I'd be like
fuck you uh so that's the real that's
that's important to uh you know
understand right so when you know to
bring it back George needs to take a
sociology philosophy class put out by
who Harvard they are the enemy now you
can analyze my psychology and be like
George this is just because you got
rejected from college and now you're
taking it out on the colleges and the
answer is ABS fucking lutely they
shouldn't have rejected me and they will
pay uh so yeah that's that's where we're
going with with with this uh but yeah
yeah so so you know look I don't have
influence don't listen to me but like
don't hate fucking trans people man hate
wokeism hate institutionalized welm hate
GM deciding that they need to get a
chief diversity officer right who's also
an ultra privileged white fuck but don't
worry they're doing it for the they're
doing it for the good of the minorities
or something or other right that and if
you're an underprivileged group don't
listen to these people they want to keep
you trapped in a victim mentality man
they want to tell you that you're a
victim right and the once you're a
victim only they can be your savior and
that's what keeps you who's going to be
the most loyal lap dogs of the fucking
failing regime right that's the thing
that's exactly why they're doing it
right so I want you to think about that
and if you have loyalty to the regime
realize that the regime is scamming you
and fuck the regime and down with down
with Harvard down with the professional
managerial class and up with the Cyber
truck cyber truck man cyber truck it's
it's steer by wire it's cool uh and
that's where we are uh where we are
looking
ah all
right thank you thank you thank you okay
would I buy one maybe uh but yeah no
seriously seriously Bros don't don't
don't fall for it right if if you think
like you're going to like like you know
hate on the underprivileged right to get
back at the no no no no no hate
on Harvard
right hate on on these people right
they're not they're not no no no no no
no if you went to an Ivy League school
like that and it's not even look you
might be a victim man you might even be
a victim who went to Harvard and I mean
a genuine victim right not a victim in
victimology 101 I mean a genuine victim
right like you didn't know man you
thought Harvard was good I mean you were
foolish but you didn't know right and
you can be forgiven but who can't be
forgiven the guy in Atlas Shrug the
professor you know that is who anran uh
really reserved her disdain for and that
is absolutely right the man who should
have known better but did not and those
are the people who will be punished the
most harshly when the regime Falls all
right all right oh we got a hype Trend
go see you guys love this shit man you
guys love this
shit
um dude no fuck commies man fuck commies
like communism is not what you think it
is right like and communism is maybe the
biggest scam right Comm communism is
like Oh I'm a peasant I'm going to get
on board with Communism you starve to
death okay like you starve to death the
workers of the world don't unite the the
professional managerial class scams the
workers into supporting themselves and
you get Stalin okay you don't get you
don't get communist Paradise you get
Stalin right right but oh don't work us
okay okay right what sort of idiot
supports I don't look all right all
right all right we're going off on
commies now everyone already hates
commies right
um oh Anarchy is anarchy is even
stupider right Anarchy even stupider
than communism at least communism like
they tried like you want Anarchy you can
go to Somalia can't believe I got Somali
in that debate man can't believe I got
Somalia right but no you no so stop
hating uh Target your hate at at the the
the professional managerial class the
administrators the the the people who
who push this shit to prevent you from
pointing at where the real sources of
Power are in this country no no no no no
you don't understand I no no Nancy
Pelosi wearing a kente all right we're
not going we're not going there we're
not going there but like fuck you and
the regime is going to fall look at Elon
going off on the advertisers based Elon
Bas Elon all
right all
right
thank you thank you thank you all
right uh there's no communism in the
world anymore all right now look look
look look look
um should I replace the rolls with a
cyber truck but it's electric and then I
got a charg
it uh I don't know if I'm ready for a
uh oh wait amaranth is is that the real
amaranth no that can't be the real
amaranth the real amaranth is in my
channel no way man she's
famous
um someone just gifted her a sub wow wow
the sing is strong man this is a sky
Bree simp Channel we've been over
this um whenever you guys hit her up
tell tell Sky Bri that I she's always
welcome on my channel I'll buy another
chair I'll buy another chair she can
come sit here we can refactor tiny grad
together uh not paying for porn I I mean
I'd be happy to pay for porn if it was
actually better uh I'm not one of those
like like moral like High Ground like
but bro I'm not going to pay for your
only fans if I can Google only fans leak
bro you
know the reasons to remove
numpy
religion communal Harmony communism
everyone dead that that sounds right
uh Forbes put out a hit piece on Beth
Jus you
know all right all right we can't go too
much on hating like you can hate all the
journal ISM people but like love and
hate are really closely related the real
thing to just do is stop clicking right
that's how you really beat these people
like I don't know I don't read the news
man I'm proudly uninformed who's at war
with who I don't know man I don't know
be proud to be
uninformed yeah that's how you beat the
news man like if if if if there's a lot
of propaganda the only way to avoid
propaganda is to be like man no I don't
know I didn't read that shit man I but
but but but no no no no no it doesn't
matter who you are you think the other
side's getting propagandized they think
you're getting propagandized the only
way to beat this is not to read the
propaganda and to just read this book
it's actually it's a great book you guys
should you guys should you guys should
read this a great
book not for sale in the USA but I
bought it here I don't know how that
happened lot of Alpha and not caring
yeah okay um now that we
have B propaganda okay subscribers only
let's program so I did a big refactor
we're going to try a refactor stream I
know like these are like boring cuz
they're not new stuff and they don't get
as many views um so that's why we
started off today's stream with a spicy
political rant because that will will
get people viewing and now you come here
and watch actually really boring
refactoring of tiny
grad so I did a big refactor I wrote
this new file beautiful. py and that's
what we're going to be working
on um
so this goes through like the four
layers of abstraction and Tiny grad and
adds uh 2 plus three in each one of
them so this is like the base level with
the device run
times um this is one layer
higher uh with the like buffers and lazy
Ops this is at the lazy buffer level and
this is at the tensor
level uh so we're going to do this to-do
remove D types from allocator as I
started working on it on it at the
coffee shop this
morning so part of the problem and one
of the bins of my existence is images so
there's there's two kinds of uh memory
objects in
opencl uh there's buffers and images and
you have to use images here I'll show
you guys why wow we're educating today I
must be in a good
mood um so this is like this is the chip
that's in the comma
three uh you can see that the texture L1
cache has double the bandwidth of the
local memory uh and I think it's even
worse than this like I think for some
reason this could be accessed better but
see the keyword here is texture so
there's two kinds of objects see all
this buffers and textures the buffers
use uh use this oh interesting Molly has
a smaller texture cache oh wait they
both have smaller texture cache and has
slightly more memory I tried it on the
mollies and buffers were fine but uh on
the adros you need images so that's why
we have to have images but but I went
way too far with this and passed in the
D types to all the allocators and then I
have this junk everywhere size time D
time item size so we're going to remove
the dtype from the
allocator um so let's start there just
by removing that is this going to work I
don't
know uh then I have this other function
cast image which converts the buffer
into an
image uh we actually say this return cl.
CL so is
this so unfortunately we have this
stupid hacking device to deal with this
where if the type is image dtype we
create a I can
move this to
here I'm going to call this row pitch
bites
say dtype do item size
here this
guy all right now we have to go through
and hopefully make one of the last
changes we'll ever have to make to the
allocators because there's so many of
them but of course that's probably not
true you can see my allocator here so
we'll just going to go here with size
we're going to get rid of that we're
going to get rid of that
um
[Music]
cool so we have this lru allocator we
can no longer index that on D types so
part of the problem with so think of
what an lru allocator is right it just
keeps all the things
around um so if I have a dtype
think about
it now the cach is more likely to hit
which is actually kind of stupid it
didn't really matter but the key thing
is is if you allocate a bigger buffer
you can use it as a smaller
buffer um so that's kind of
cool right so get rid of that look how
much simpler this is making all the
code and then we have an implementation
of an allocator here it's just called
Malik
allocator uh so we are going to need to
change buffer if allocator now takes
in this we're going to have to put this
here like
that and we can call three without the
dtype
oh
I don't like that this can take in an
opaque
I'm upset about that right so okay I
have a buffer it takes in a device a
string a size and a d
type I don't like that this can take
that
in I can show you where it's used if you
care um does this stuff make any sense
or am I moving too
fast so here we'll take the d type out
of
[Music]
here it's just like it's repeated
code
H that doesn't long
there
cool okay so I think we've removed the D
type
uh
oh actually let's update beautiful. Pi
because that's where the to-do was so
it's just so ugly to have this here
should be able say
four right like that looks more right
right so like right this is a file you
guys should be able to understand so pay
attention here we
have
actually this Imports Malik allocator so
we can import from
there and we don't need D
types
okay so here we import from clang
operations clang program compile clang
and Malik allocator uh so Malik
allocator is exactly what you think it
is it does
Malik um we allocate three 4 byte arrays
we copy in two and three and little
Indian uh we compile this
program can actually separate that
out
since this is a learning
example
okay so let's see if this
runs all our documentation is runnable
Malik allocator Alec missing one
positional argument
DPE uh well that's guess we didn't fix
that one
yet yeah here we
go
oh I don't save the dtype
did I never save the D
type like that's
weird must have gotting rid of it
somehow
yeah
okay so it's a little confusing because
this is the size in
bytes I guess we don't want that to be
the size in
bytes this is the high Lev but off our
class
okay so we allocate dtype times the item
size for this we should do the
same
here check I like have a helper there I
should probably have a
helper no I don't really like
that
this is why we have tests beauty of
tests is you don't really have to think
through a lot of stuff you can just use
the
tests lru allocator free is missing
a here get R of D type
here
missing one argument D tyo because
they're still here
oh
interesting so
the interpreted back ends kind of need a
det
type I guess I could just add a bit
cast yeah see this is so boring go back
to
hacking I mean this is the problem this
is my actual
work let's keep all the docks and stick
with
clang
okay the lazy buffer has a problem
because I didn't fix that for
uh
that's a
CPU how do I even do that at the lazy
buffer
level
copy to
device
yeah
h
H should probably actually fix
this I shouldn't really use
gpai
must
okay beautiful
works I want to add another one that
does like a memory View
and that's what it would be to
uh so like right now this stuff is
pretty big uh numpy is pretty deeply
baked into into
this see if we can clean this up at all
so we allocate this is like the runtime
layer of tiny Dr come on a journey where
we add 2 + 3 in
clang I'm
streaming
so this is the program that's
autogenerated that's like the same as
this
program
we're still casting everything to Flat
that's
terrible that's going to be
fixed you guys think I'm high but like
what it actually is
is it becomes kind of harder to
communicate when you've been spending a
lot of time just like staring at this
stuff and you can see the ideas in a way
that's like harder to
verbalize I get why you think it's like
being
high
all right we have to do something about
this they both do have view
elements so let's just get rid of
that
which I've been working alone less we
have a tiny cor has a second
employee one
intern you
know
this is actually going to
work
works I do CPU equals 1 wait even that
works what it shouldn't
work
oh I know why it
works it works cuz those are never
actually
used
h see what fails if
anything okay torch doesn't work but
numpy somehow
does thank you for gifting
Subs
how does CPU work but not
torch regardless I know what I need to
do I know where I need to add a
cast just interested the torch is
broken
that's even
weirder
copy torch to CPU D types
float we should add the cast let's add
the cast we need the cast
anyway so there's some code in the
interpreted uh as
Runner that if you get this is
unreadable like if you don't know what
this stuff
is
wa you don't understand gster funk for
op as for op so simple
Bros all right so here we have to do
gter don't worry with a
gster
God
uh
you're worrying about it I
know all right we're going to get the
cast
function
pass in the input
here I mean this is particularly
confusing code so what this code is
doing is it's generating python for
uh running these things dynamically and
then it's going to end up calling into
this so here we're going to
do I'll show you when it's printed and
it'll be a little more
clear yeah you guys would be more
excited for the Jack
stuff you should do
that okay now it works so you see that
we've added a un ops. cast here and this
true means it's a bit cast or a
view
yeah and actually
I can change beautiful. P I
think
okay we didn't fix the disc allocator
the disc allocator shouldn't even really
have a dtype
yeah like the D see it's just so so
stupid here doesn't do
anything
I plan to add just a runtime for
embedded
devices
never mind this does need a dtype
just needs a dtype because we have a
cast function
here so it has an underlying dtype
that doesn't need a dtype though we
should be able to allocate them
all
with d
types in fact just put it
here
okay my unit tests passed for the disc
censers oh I love this by the way
rough fix tiny
gr oh do not compare types use is
instance
what where was I compar pairing
types is that not
okay no I think I want to do
that um okay so allocator has too many
arguments to cast
image uh
and has that
cast
image um we can fix abstractions
dop this is the old version of
beautiful.
py
oh we got to fix graph malic graph
metal
Ruff is so fast
right do while my test
pass my test pass okay
um all right let's let everybody chat
for a little bit do we have viewers I
bet we don't have viewers I bet this
stuff gets no viewers and what you want
to see is hype how many viewers we
got 750 okay all right all right all
right we got some
viewers
now we got
Liars
um I knew I knew the political rant
would draw people
in no but seriously man be nice to
people okay don't be mean to people be
mean to institutions that are failing
and scamming us out of the
future
Jensen said AGI 2026 I am saying AGI
yeah I mean what the hell is Agi you
don't want to go into
this there's no such thing is AG oh God
you think you have general intelligence
and you think you're conscious the
arrogance of fucking humans
man uh I didn't ask the runtime question
why about views well because I create
content and I do vaguely care that it's
content that you
enjoy right what kind of person would I
be if I just created content for
me I don't know who I create content for
why am I even
here you're thinking the Roomba starts
talking in 2026 well that's that's a
good indicator of AI
uh all right do we want to do more do we
want to do more refactors
here that was the main refactor I wanted
to do that's the main one that upset
me um we can look at beautiful for a
little bit let's look at beautiful for a
little bit and we'll even let we'll even
let non-subscribers talk but please
please pay attention this is accessible
for you I worked hard to make this
accessible for you I wrote documentation
just for you
okay so tiny grad is
a this is a stupid uh tiny grad
is
a tensor
library and as a tensor Library it has
multiple Parts look I'm writing this
documentation for you for you
prospective streamer streamer
streamer
um one a
runtime
this
allows buffer
management
running
program buffer
management
compilation and running
programs
two
I'm trying to describe this stuff to you
and maybe you'll be
uh maybe you'll you'll like understand
can can you ask no we're subscriber only
again can you guys ask good questions
I'm trying to like I'm trying to make
content for you
okay does everyone understand this this
is the easiest one to
understand
uh we we can just stay here for a little
bit until you guys understand can I zoom
in there there is that big enough what
am I allowed to make fun of Boomers some
guy got upset that I made fun of Boomers
but the boomers are hoarding all the
wealth in America and they're the reason
I can't buy a house right and like this
isn't even like you know this this is
who's the reason you can't buy a house
Boomers right like I mean I could buy a
house but it's a damn Ripple off like
they what they're going to take it with
them can can we can we can we is that
okay is that punching up if if we it's
always is it punching
up we got to punch up you'd argue the
hedge funds are at fault well who owns
the hedge funds Boomers that's right all
right no we're not going to rant about
Boomers I'm trying to teach you guys
something
here inherit the house from your parent
Boomers yeah yeah yeah
okay does this stuff make sense to
people here do you want to look at the
type so if we look at the type of a uh
let's what is it what do I run it with
it's like Dash
e d i here we go
okay all right so you can look at like a
and it's like
uh CU by array does that kind of make
sense
right like copy in the bite
array little
Indian uh it's little endian because you
put the little Value First some
computers are big endian you'd have to
put the two over
here um so if we look at lib here you'll
see that it's just it's a
binary it's a MAO binary with the feed
face it's actually a feed F face CF
because it's a 64-bit Maca why do I know
this garbage
um so you'll see function is a is a
clang program object we can do function.
lib and we can get back to that we can
say function. name and it's ad because
you created it with ad
here uh then we get the data
out as buffer is going to make this a
memory
View
oh can I do two
list oh that's
nice that's
nicer oh that's cool I mean that points
the weight a like like okay if we're
going to get rid of numpy what are we
actually going to pass
around um we could pass around bytes too
but like a list is more accessible right
because that's really the thing you want
you want like a python object
out actually I think we can also do cast
but I'm not
sure
where are the formats
described oh instruct style so if I do
like cast
I
cool
cool
um yeah I mean that's nice because it
shows you the actual bites okay so does
this does this layer of
abstraction
uh make sense to people here we can like
look at clang program and see what it is
it's not very complicated it's just C
type
CDL so you can actually go in and like
read each one of these they're all very
simple like this is the whole this is
the whole clang runtime here right it's
it's not many lines you can like read
all this
stuff that
[Music]
specifies compute in an abstract
way so this is the
device
um how do I turn that how do I not use
numpy there and turn that
into
btes struck.
pack I guess I could do that
guess I want to do
that let's
supported go to numpy
there
byes object has no attribute cast
uh fix
it underlying buffer is not
writable oh this gu
garbage bite array has no object
cast that's a lot of
bullshit it didn't even equal five after
all
that what did it
equal oh well it's cuz I did 2+ 2 and
not 2+
um yeah this should not be
nump
okay sorry I got distracted um so you
guys see what this
is I don't know if there's a quicker way
to do
that uh
but this is creating bytes this turns it
into a writable bite array and that
creates a memory view of it it shouldn't
actually have to be writable so we might
be able to fix
that what if I just do this where does
it
complain to type from buffer
sometime it has to be writable I don't
know it's a later problem someone wants
to look into that stuff that'd be fun
right like copy in should be able to
take a uh so yeah I show you this copy
in function right like this should be
able to take a read only memory view but
then you have copy out which needs to
take a read right memory View
um so
yeah I can also show like how these
things are
related like if I print a. buff here
this is a return from Al allocator doall
right so this buffer is just syntactic
sugar that can take in data types it can
do all of the uh this actually this has
an lru allocator why do I need the
buffer class
again kind of like ATT tracks the
device I don't know maybe it's
useless maybe I don't need the buffer
class
it gives this a
canonical type but that actually may not
be worth
it no I I knew about the war operator
for a long time I just realized how
useful it
was
Al this is just like a wrapper around
this there's an argument to get rid of
it because the only place that we
actually construct buffers is here and
realize and I can get rid of that layer
of
indirection this is just a much uglier
interface kind of be cool to get rid of
right and then you're just left with
these Malo allocator
classes you still have the
copier so if we go over to where buffer
is
defined oh I mean I guess it is
important to know if
like I guess you kind of need to track
which device it's
on and you can't do that with the
opaque no we do do kind of need this
buffer right buffers are also what's put
into the jit here so you can see that
there's a there's a buffer type
here
oh wait no no no there's another reason
we need the buffer class and that's to
hook
Dell no okay there's a lot of reasons we
need the buffer class never
mind the key thing here is we hook Dell
and we call the actual free on the
allocator uh when the buffer is deleted
right buffers are one to one with the
underlying
buffer uh so we do need the buffer
classes can't go away but you want to
remove as much as you possibly can okay
so then here at the device level we
describ the computation it's a bunch of
lazy Ops it loads it adds it
Stores um get Runner is
[Music]
a well not that get Runner this get
Runner here
technically we have this middle
step where
we should I should I put this inside the
class
there's not much on this class anymore
it's mostly just a holder
class yeah it really does belong on the
class
right then we can change linearizer Ops
to self. linearizer
Ops we can put self
here and we can get rid of the word
optimize it's kind of implied that it's
optimized
kind of like that
right I should kind of merge this and
not be messing around with lots of other
stuff while I do this but
whatever that's not a good
change so we can break this
down we can say device clang dog
linearizer
why can two program take in any
shouldn't be able
to
okay cool um oh that's slower because
that's bypassing the
cache Okay so so you'll see here that it
takes
this uh lazy
op whoa that hits the cash
now that shouldn't hit the
cash
interesting oh no never mind
we have
that
okay uh the initial ones are the copies
so if I run this with like debug equals
2 yeah you can see that it's doing the
copies from clang to CPU
here um so those are scheduled so they
were in the schedule so I had to change
that to minus one the schedule has three
items okay
cool
uh so you can see this is the linearized
version of this um we have three globals
coming in that are
Pointers and then we have a const
zero uh then we have a load where we're
loading
from uh this defin Global this const
should be more clear that it's a pointer
to that it's a little Annoying uh
whatever comes from two loads we add
them and then it comes from the defined
Global that's a store the const of zero
and the ALU which is this and that's the
store so that becomes this code in the
renderer maybe we can
actually
yeah we can do that too that's kind of
cool
well oh this compiled as Runner is trash
look at all this
crap all this crap it gets from the
linearizer all right there's a lot that
actually goes into that so we'll leave
that as two program for
now um but yeah you can get the
source from the renderer the renderer is
what
converts this into
that and then that's the
buffer this is what it looks like when
it's scheduled and then that's the
tensor
okay uh comments are excluded from the
line count yeah comments docs and tests
are excluded from the line
count and empty lines only lines that
actually have code on
them um so yeah that's the uh current
line count of tiny
grad and it manages to fit all of this
stuff no it's not a white monster it's a
highball
energy
oh
interesting can I put
up can I put this
here
I shouldn't have the assert actually do
stuff
for
okay uh
I know this one's kind of ugly and we
should
probably okay now we got fives in all of
them
it's not
nice it's a lot of
garbage
ch
I don't know if you want
that like you can dive into the types
pretty
easily
okay uh any questions about the stuff
are you guys following Along come on
this is
accessible
we can do the numpy removal refactor but
that's kind of
boring I think this is a better way of
going through the abstractions than
abstractions
top oh I got to finish
this
do nonsubscribers have anything to say
does this stuff make
sense I could talk about why you need
each one of these layers or is this just
boring and you just want this and in
fact you don't even want this you want
examples.
coder by the way check this out I added
a thing to examples. coder called from
buffer give it a
minute you're about to see the fastest
loading
ever you have to start it three times
before it's really fast but now I start
it again and I do hello boom look at how
fast that's loading it it's it's cached
in memory but it is a new start of the
program right so remember how long it
was taking to start
examples if you do from buffer equals
one
boom it's
Quenton
this is what all this
enables
like under the hood of this highly
sophisticated
llm you basically have all these parts
working
together
uh yeah in like a really beautiful
way can I explain the layers I mean like
did I not explain them is this stuff not
clear to people or you're like why do
you need any of this shit or like
for
um like okay so you need okay I I know
what I know how we'll explain
this tiny grad has 1 two 3 4 5 6 7 8 9
10 run
times really 10 1 2 3 4 5 6 7 8 9 10
okay um there's 10 run times that I can
effectively put here instead of clang uh
it can work on CPUs gpus
lvm uh torch web GPU all the different
kinds of GPU
libraries uh so you need to abstract
away the actual runtime
uh so hopefully you can see why this
device layer of abstraction is needed
right I could just as easily replace the
word clang here with a different device
uh and it would do the same
thing does that Worth showing
off like does that interest
people
okay so let's just exit
here
okay so let's run this
example uh you see this is
clang it generates this linearized
stuff uh but we can also change this to
metal instead of having a clan kernel
it's a metal kernel now they look very
similar but you notice a few subtle
distinctions between them um this
runtime is all handled for you like you
don't even have to think about this you
can use any device you can specify
computation in this uh lazy op language
and it will work for any device you want
okay
um
okay
so we'll keep using the word device
here so lazy buffer is even a level
extracted uh ahead of this like how
ridiculous is it that you have to
specify that you're doing like a load
and a
store
um so
the advantage to this lazy buffer thing
is I can do something like this so let's
say I want to add B
twice uh well Val is not five note that
Val is now eight um but look at how easy
it is to just do another one right and
then there's a question of whether you
want to uh uh like it shouldn't go back
to memory in between this stuff should
be
fused uh let's say fuses the compute
into kernels using memory only when
needed so this is fused with this
meaning there is no extra roundtrip to
memory it puts in the minimum number of
loads and stores that's really the
function of what uh of what lazy buffer
is and then it can schedule the
computation um as a list of
kernels so you'll see that the lazy
buffer is doing two froms which is
converting it from uh CPU to device uh
and then a store here and when I was
doing the eight here you can see that it
gets the uh it does an ADD and it does
another ad uh now it shows up here as
two loads but those two loads will be
viewed into one by the back
end um and we could see that by looking
at the uops if we cared okay so then
there is the tensor
um
the beauty of tensor is that I can do
out do backwards so I can do like out.
mean.
backwards uh I mean it doesn't do
anything but now if I want I can check
the gradient I think don't know what the
gradient is even going to be it's none
oh because yeah these don't require
gradient you have to say require gr
equals
true
uh oh I misspelled
out did I always misspell out
there yeah I mean do you want to see the
actual value of that the gradient is one
I don't really know why it's one but
it's one and I trust that tiny gr did it
right
uh so yeah that does the auto grad if
you
want
noce you can't do that because it's a
only called for scalar tensors but it
has shape one so that's why you have to
do the
mean uh or I can probably do that that
work
cool um
yeah I think we can use beam here too
I'm not sure really what it's going to
do
but yeah there shouldn't be infinite I
don't know why they are
whatever oh does CL not support
timing
should I don't
know
oh actually I think I might
know do I create buffers in there I
might have broken
that function
here uh buffers from
L that should work
fine I don't know it's a
problem like I worked really hard on
these
abstractions these have been developed
over where exactly do I call the kernels
uh so I create a runtime here for clang
program and here I have this helper
function called two program which
returns a compiled Runner again these
are pretty short pieces of code you can
read them so this is the thing that
actually calls the kernels down here and
this CL Prague is the
uh is the same thing as
uh so if I do funk.
clpr you'll see that
this uh here is the climent program
uh so that's the actual that's the same
thing that you see
here
so it's not that specific to the
platform we' managed to abstract it away
pretty
nicely and then like these Ops there's
not that many of them uh so these are
the same ones as like xla but instead of
having a bajillion of them we have
basically these ones aren't exactly real
uh the Ops are reused in multiple places
yeah abstractions Pi is pretty out ofate
use beautiful. piy I think we're just
going to delete abstractions piy um
beautiful. piy is kind of the
replacement for
it um so these are unary Ops binary Ops
Turner Ops reduce Ops and buffer Ops so
these are really the only things that
have to be implemented by your back
end
um I hate having malac there malc upsets
me but you kind of do need
malc what do I do that
Fusion uh you can see a numpy because
see like if you go to Tiny grad's main
docs you'll find this so this is a m
Mall in
uh in tiny grad style that
does like read this and understand why
it's a m mall without actually using mat
mall and the multiply and the accumulate
are totally separate
um they have to be fused back together
to make things remotely fast on CPU
because you don't want your multiplied
thing to go into
uh you don't want that to go into RAM
ever you want to make sure that that
multiply accumulate is fused into a
single kernel and the interpreted
backends don't do that Fusion
so we kind of Hack That Fusion together
with
einom
I want to know like maak because it
shouldn't actually be two
things it should just be it should just
be able to figure that out but the I
guess I do keep that pretty
close I guess it's fundamental enough
that it's fine I also keep it pretty
close in device.
piy that rewrite is actually done
right
here I should rename that to
source that function's kind of the
function that's returned from that is
kind of a crappy function
that
just shouldn't be a
thing someday that'll be
refactored you can't return the clim
program exactly directly because this
all works for gpus as well again I can
change this all to
metal um you'll see that it all still
works
uh but metal needs Global sizes and
local sizes so I'll decid It On by the
linearizer
all right we'll have to get that through
CI and uh get that
merged all right we'll see if
nonsubscribers have any good
questions and then we're going to move
on we're going to do a little bit of
jacks on some tiny boxes that we have
I'm going to see what we can make
work
if no one asks any good questions that's
just the end of the
stream I was going to show you some
Jacks well I'll just show off quickly we
do have tiny boxes now this is
T8 uh so you'll see it has 128 Megs of
Ram uh it has a 32 core
CPU it
has six radian RTX is this the one that
I installed jacks
on it did okay
um I have a Jax example in tiny grad
called Jax pmall so we can see what we
get
here oh this one only has CPU Jacks
which is getting terrible numbers let's
go to the other
one so this is T9 uh T9 also has a pair
to two core processor has a 128 gigs of
RAM oh I didn't show you the
uh it
has uh I gu LS blocks not really what I
want there and sorry I didn't do the
raid arrays right how do I show maybe
the best way to do it is just Dev dis
by uh D name
maybe by
ID
yeah Western Digital blacks
uh so we have four of these and we're
going to put them in raid zero um it's
going to be hella
fast uh in fact to give you an idea of
how fast it's going to be I have some
helper scripts here where we can do test
dis uh this in parallel uh reads from
all the
diss so you see that in parallel we're
getting almost 28 gab per second um and
that's going to translate to how fast
we'll be able to read things uh oh
my gpus are fully
connected did that finish yeah wow
that's terrible um my gpus are fully
connected you'll see this in a minute so
these are the bidirectional uh copy
bandwidths between the gpus uh unlike
Nvidia AMD
[Music]
allows um you
to uh communicate directly over PCI so
we're getting 55 gabes per second notice
the
bytes
um we can
do
this uh oh because we didn't run it
here
did they lose their IPs
[Music]
somehow oh this one lost its
IP did it reboot uh mod
probe
it called this
one there we
go all right this is the infiniband uh
connection between the two tiny
boxes uh so you see that we're
getting almost 200 this is gigabits per
second uh so if you want that in bytes
we're going to have to uh do a little
division 24 uh gigabytes per second but
that's full
duplex uh so it's it's actually similar
to the pcie so we're going to be able to
train on all six of these gpus uh
together as one uh
GPU let me get that Jack example up here
I think I installed good jacks on this
one I had to build Jacks from Source
because it's
AMD yeah see the rock
M boom so that's our total Tera flops uh
of a tiny box we're getting uh 7 91 Tera
flops and that's float 16 but summing in
float 32 so you see the output D type
here is float 32
um yeah that's equivalent to 4 5
490s
uh but we use AMD uh because AMD
supports the peer-to-peer
stuff yeah it's really important to like
get real benchmarks and ask the question
how close you are to utilizing all the
flops so this is doing a m mall at 107%
mfu um so tiny grat has all the Flop
reporting software uh built into it so
it's very important that we actually
start to achieve uh very high
performance on these
things um that's a lot of flops can it
run crisis I'm glad you asked you can
actually plug in up to 18 monitors into
your Tiny Box uh hopefully you guys saw
the pictures I posted on Twitter uh wow
this stream just turned into an ad for
tiny boxes how fast is Tiny grad on a
tiny box in comparison
it's faster than it is on my Mac but a
lot of the optimization efforts to date
have gone into the Mac uh because we
didn't have tiny boxes like tiny grad is
by far the best library to use now on on
metal um it's way faster than
torch
uh still no shipping to
EU I'll ship it wherever
man I'll just charge you money I'll ship
it wherever and I'll charge you the EU
tax you know we'll call it the uh the uh
you know the the Paris tax right we'll
name it after the Paris climate Accord
we'll call it the Paris tax all right so
man I don't know maybe there's a 10%
Paris tax uh we are absolutely not
shipping to North Korea
no um the Tiny
Box is uh is for sale um you can you
can pre-order them right
now
um so this we're actually only getting
28 this we're actually getting 500 and
uh getting more this is just what the
ram is we'll have a test for this as
well um these might be only 2,500 watt
power
supplies uh and this will definitely be
done and you can pre-order Tiny Box
today for just
$100 uh yeah and they are they're
actually getting built and I have
pictures of these two tiny boxes on our
Twitter uh you can check them out
they're pretty cool you know I will win
thank you thank
you um 15K yeah I mean it's an expensive
computer I don't know what to tell
you uh
it's a good
computer have you tested with workloads
other than ml see like why do like
nonsubscribers always ask stupid
questions like this it's a really dumb
question man like here's what I care
about okay there's this competition
called mlpf and ml perf asks how fast
you can
train uh Models All right so these are
the mlpf training these are the
different I hate they redid their
website the hell is this
all
right
bro bro fix your
shit well these are the models and this
is how many minutes it takes to train
and this is shitty spreadsheet software
um but yeah yeah so you want to know
like how fast you can get like an image
net to 9 to
75.9 uh we're getting there again a lot
of tiny work has just been tiny gr has
just been laying groundwork to make this
stuff be uh great and no they go crazy
now they have
gpt3 is now a a model that they have
here uh we're not going to be able to do
gpt3 on a single Tiny Box though we
should be able to do stable diffusion 2
on a single tiny box and I'm hoping we
can do gpt3 across like six tiny
boxes um 15K is a lot of GPU hours well
not really I mean okay so you can work
it out right so it has so it's 15K but
it's six gpus and the gpus and Azure
probably something like $2 a GPU so it's
a th000 it's this many hours uh so if
you do hours to weeks right it pays for
itself in eight
weeks and that's not even like like the
math not even exaggerated right like you
can run a tiny box equivalent for 8
weeks in Azure or you can buy the Tiny
Box
uh it's going to be a little bit more
with power because you do have to pay
something for power so maybe it works
out to more like 10 weeks um but yeah I
mean these gpus
are uh maybe it's more like a dollar but
still we're we're on the order of uh you
know it definitely pays for itself in
six
months um the cost of power is small in
comparison yeah uh so even if you're
only even if you're managing to get
these gpus like these gpus are maybe
half an
a100
um so yeah you're still
talking pays for itself easily in six
months uh yeah I mean the cloud is like
the cloud is not good the cloud is fine
if you have like surging workloads or
you want low uh if if you want low
priority CPUs the Cloud's unbelievably
cheap um two A1 100s for a month on
Azure cost like 9k thank you right so 2
A1 100s which the box is definitely
equivalent to 2 A1 100s right like I
just showed you a benchmark where I'm
getting this um this same math on an
a100 the theoretical Max of an a100 is
312 uh Tera flops so like this is more
powerful than 2 A1 100s and if 2 A1 100s
for a month on Azure costs 9k you you've
just paid for a tiny box in two
months um it's yours there's no other
weird people on
it uh are these computers meant for the
general public okay so like it's an
interesting in question I don't believe
in meant for right nothing is meant for
anybody I I hate this when you go to a
website and their products are like
broken down by like business segment
like no fuck you break it down by like
what the products actually are right I
tell you what the box is what you buy it
for it's totally up to you
man um and you know here's something
else I've kind of
noticed like the more someone just tells
you a price the better a deal it is
right if somebody keeps the price like a
secret um yeah it's not good What's the
total GPU Ram space it's uh 144 GB so
again similar to 2 80 GA
100s a little
less what's the wattage of the Tiny Box
so you can
the here you want to do it I can just
show you
uh Tiny Box this is open source by the
way you can check this on uh on my
GitHub so we can do burn here which will
spin up burn threads and all the gpus uh
you can check out my thermals here too I
worked really hard uh actually one of
the uh Comm Hardware Engineers has been
has been helping with this project and
he's done a really great job uh on The
Thermals of this thing the gpus don't
get above 70 uh and it's Silent not
silent when it's silent when it's when
it's off when the gpus are going Full
Tilt you will hear it but it's like it's
definitely it's sub 50
DP um I don't think it's sub4 it's
probably about 45 DB uh we'll get a DB
meter we'll measure that we'll post that
on the site but yeah so these don't go
above
70 um actually I they get re I think
they're really low because this is
actually in a cabinet so here we can
look at the Watts here uh so it's 327
for each
GPU really you should have 3,000 Watts
if you want full full full power but you
can also power limit these things and
you will be able to run it off a single
outlet and I will test it well in single
outlet
mode um can you place it a bedroom yeah
so I'll test it really well I'll figure
out how to like throttle things down so
we only lose like 20% performance going
down to a single 1500 watt
Outlet um that is single outlet nuu yeah
if you have 220 you're probably fine
with if you have a 220 15 amp I mean
let's
say look it's doing other compute on a
tiny Bock I'm doing Simple Math okay
have 220 of 15 amps point8 load Factor
yeah you'll be fine with that um you'll
be more than fine with that if you have
a 20 amp EU circuit you're you're that's
way more than fine uh how's hashcat you
want to try
it is this going to
work how how annoying is this going to
be
make all right all
right uh does this go on the GPU or is
this why I use
J okay it uses open CL that should just
work I think C works on this
computer the stupid gpus I don't have
basically AMD persistence Damon up so
one trick is to just do a y
N1 user Rock M bin Rock M
SMI uh so if you see D
message uh yeah it's got to like keep
the gpus up so it'll
work all right um hash I don't know
what's example
400 that's a good
example
uh all right so
unfortunately uh it's a little annoying
because what I would normally do now is
just take this and copy and paste it
into stupid uh into chat
gbt I'm on to stream you want to say
something I just bring you some tea oh
thank you come
in
Oh Oh I thought you were that's for you
thank you you want some lunch uh do I
want some
lunch uh yeah what's for
lunch oh l sound lovely thank
you she's wonderful Alex is wonderful we
love
Alex
not get banned for
that
I'm not linking against Rock M device
Libs storm Frosty do you know how I can
just fix
[Music]
this uh wait there's a way to speci if I
open C
right
let's try ignoring
hip uh here you can see all the ram here
oh there's even more RAM than I
thought 147 gigabytes
uh okay I don't know if that was
fast that was say that seemed fast was
that
fast is there like a hard one
here what's in this
file
we have hashcat working it's just wait
what does M400 even
mean okay let's try brute force that
seems
better
I don't know is this
fast okay is this a good number of meah
hases per
second 60 gigahash per
second
did it actually use the GPU I think so
yeah looks like it used all the
gpus
is this a good number of
gigahash
Benchmark doesn't seem like a good
number of gigahash if that's what
they're getting
lc0
stats how do we do
that can like participate in
training
no there's no way it's this
slow
should we try to get hip to
work uh okay so what's the problem with
this
pen Dash
ho did not fix
that no no no someone linked what the
problem was
earlier the ocl runtime should do that
for
you what drivers do I need to
install by the way what's the default
hash type
here oh here hash type references
below
m0 oh that's
md5 so wait that guy
who
guys I like that you're bringing we're
bringing new
uh sorry stream chat's going back over
here
check this for debug
vs this looks like a nightmare yeah chat
got energetic you guys are excited about
about cracking
passwords don't use your tiny box for
illegal activity
okay
for
oh how do I use how do I do hashcat and
Benchmark mode oh now we're
talking do I don't have that
Benchmark
all optimized kernel enable oh we have
another
flag no that's not a real
flag
okay okay this seems pretty
good is there really an enable optimized
kernel
flag
oh never mind I don't know why that was
slow this is pretty
good okay
good good we're crushing a 4090 all
[Music]
right uh and actually that's not one of
them we can
do now we can pass benchmark allall
and we can
compare oh I guess it yeah okay it does
the okay I see so we are how much better
than a
4090 and this is without hip too we
should be able to do better if we fix
hip oh look see jumla crushing it post
gray crushing
it hip will be slower than OC okay we
got to fix we got to fix uh do to the
ABI
really this has to be
fixable no it's okay it's on by default
if
uh what is
ocl okay we're not linking to this for
some reason
am I doing Arc this year no maybe I
should
um
may like LD config or
something what did I not put in my
environment thank
you we
lunch oh I think I didn't do
this
watch
add- V to have it dump the compile
command oh add- V to that oh that's just
annoying
it's not path is
it
no this sounds like amd's problem
well it will be even faster when
somebody fixes hip for hashcat but until
then that's pretty
good
best Co to mind with
gpus get ready for the scami EST website
oh what is cryptocurrency
money where's the good website that
shows
this
uh nice
hash no no no that's lending my stuff
what to
mine
ah
beam except it has no market cap and no
volume use beam equals one to mine
beam what are AMD 8000
gpus that's not a
GPU it's a
CPU
all right anything else we want to test
on a tiny
box 8,000 is a bigger number than 490
that's that's good
thinking
no we don't we don't have I don't know
how we'd run
sdxl can I speedrun AOC day one let's
see what it
is can I copy and paste this into GPT
and ask for a solution
oh I see you have to find the numbers
all
right let's see if we can do it with one
line uh for snst
dosit
sln we
want uh C in in 0 1 2 3 4 5 6 7 8
9 uh for
CNS okay now that gives us the
numbers
um let's see if we can get away with
using a walrus
here
uh Sub
Zero
int plus int Val minus one and we want
sum let's check our code we splitting
the
strings we're extracting the numbers
we're getting the first number we're
getting the last number
where first digit and the oh no no no we
have to combine them no that's wrong so
we don't add them we combine
them so we want it to be we want the
plus to go
there
two
now we
tried what
do is a
number
um does this not
work
oh I see what we
did we have to do
c for
CNS if CN 0 1 2 3 4 5 6 7 89 yeah now we
get 142 leap programming
boys leap
programming so do you guys like my line
it's a beautiful
[Music]
line I feel like he might be tripping on
some mushrooms right
now I can't get part
two cuz I have to log
in
okay if someone want to paste it if
someone pastes it in the chat I'll do
part
two spelled out digits are now valid too
I see can you give me the
example
I
see
okay so we have
this uh we're going to want to split it
based on that that's
fine all right um we got to get the
spelled out
numbers oh that's annoying okay first
we're going to need to make a stupid
dictionary called
R
okay and R is a really stupid dictionary
cuz we're going to have to type these
out no it can actually want 16 right
well it doesn't matter anyway
so there's none other way I know to get
these
this one's going to be more than one
line boys I'm very
upset
9 and zero
okay we actually had to type that out
which was awful we should have asked
chat gbt to do it for us I
know why aren't we using examples oder
dopie we have to supercharge our
workflow with
llms conveniently located in tiny gr
okay
uh
all
right
whoa I mean it's totally wrong but still
base
bro No actually that's a good
point I was doing way too much
work what we actually want is
this right so now R is an array with all
those things
right now we just need a function called
fix it uses so many
lines for I R in EN
numerate in EN numerate
R we want to say xal x.
replace RR stir
one return
X now we go back to our original one
line
here but instead of st. split it's
already split but we're going to have to
fix it so we're just going to throw a
fix here and then what should the value
be is it
[Music]
it's
281 what' we do
wrong all the eight two three that's
cheating that's cheating man you can't
just do that
okay so wait this is supposed to be
two return x + 70 all right
[Music]
oh freaking overlapping
boys all right all right all right all
right we'll fix the Cod okay how do we
fix the Cod
no no no 16 has to be right that can't
actually be
16 oh and Zero's also a real
digit so they probably troll with zero
somewhere I don't know how to use a reg
x no one knows how to use reg
X's rug X's are impossible right all
right while
one for I in length
C
oh
right a reg X to
replace
[Music]
with no no make it generic and
good
oh oh I'm too old for competition
programming boys this is this is too
difficult
I must say this is too difficult nobody
can do
this it's unsolvable it's
unsolvable no really I have to do that
that just
sucks no it's impossible boys it's
impossible nobody can do
this
no all right all right all right all
right all right all right all right all
right chill guys I'm messing with you
obviously I wouldn't be doing if I was
doing this for real I wouldn't be doing
it in the stupid uh python console but
we're going to stick with the console
because we started with the console and
we don't give up on what we
started um
okay
ready all right so we're going to have
to replace place we're going to define a
function called R
right and R is going to be a recursive
entry
function
if
any what's x. index if I
don't it raises a stupid
exception
okay all right no no no no no no don't
worry okay we're going to call it e okay
we have a good name for the function now
it's e
okay
[Music]
um
if okay we want to
say x.
index
n
x for n in R if R in
X
okay
now this gets us the one to
replace
uh for i n in EN numerate
R now we're going to put a i
there okay and now we're going to do
sorted
sub
one
R x.
replace no no this doesn't work yet okay
we're going to need
more
we're going to need more
uh I'm not happy about this we need to
think of a new way to solve this okay
you want me to write the boring Loops to
show you I can do it then we'll come
back to the no I don't need to show you
I can do it the point of these streams
is to educate you on good programming
style and if you can't fit in one line
it's not good programming style guys
okay we could use
lambdas
um okay we have to find which one of
them comes first in string okay so can
we first find out which one comes first
in the string let's let's try let's make
a temp function called X and we'll start
with just
this
what okay so let's first try it on
beautiful
823 in string requires string as left
operand oh because we have to say if n
in X of
course now when we run it it tells us
the
index of each of the things but actually
we have to do plus one because we broke
it
with okay so we have an eight at zero we
have a two at four and we have a seven
so now we're going to have sorted
if act equals
sorted
temp o wait wait does this work can I
use the thing there and
then um x.
replace uh
uh
R sub a sub 1
-1
with uh stir act
one now am I allowed to use ACC over
there else
X okay so now if we
fix
oh on supported type for Tuple and int
oh
because we have
to take the first one
here and we also need to put the proper
string in
here we have to return
that okay now we need R fix which is
going to call fix recursively now how do
we write this on one line that's the
great
question um okay we're going to say x if
R now we can always return
r r if R fix
x equals equals
x else f w yeah okay now let's try
rfix oh we didn't
return sorry I think I'm in Scala okay
now we have rfix which is the much
better version of fix so now we can go
back to our original version here what
do you say the answer had to
be we got to call R fix because it's
recursive fix okay is 281 the right
answer there we go there we go boys
there we go all right let's just put our
program all together it's a great
program okay first we have
this then we have
this
oops oh I can't do that on multiple
lines okay we'll just do this
code all right so now we have that
that's a great line of code right we
have that that's a great line of
code this is the one of the highest
quality lines of code in here okay and
now here we return the value we print
it okay now we have our code now I can
eval no exec our
code oh
well we have
bugs oh was that not the latest version
of fix we have to make sure we have the
latest
version yeah no that's not the latest
version of fix okay where's the latest
version of fix it's
here the latest version of our fix it's
here latest version of this it's
here there we go guys that
oh no no no no no we forgot a line we
forgot a line we had to define the
things
here okay now we have the code that
finds them and checks then we have the
code that does the
replacement then we have the code that
does that replacement
recursively then we have the final print
statement
wait should 823 be
823 oh
no no that can't be
right you can't use the te twice that's
cheating stop being a cheater
okay so how do we write this with less
lines this is way too many lines of code
boys this is way too many lines of code
okay so this one figures out which one
the earliest one is oh I already have a
sorted there so I didn't actually have
to do sorted
twice well that's good that'll simplify
our
code
and we could combine this into one great
function but that looks like cod off
don't you
think no that doesn't fit on one line
anymore that's
ugly there is no ink to
if we can use
exceptions
okay let's figure out if we can use
exceptions then we can get it on less
lines um so we're going to want this
logic but then we're going to
say
so that's going to throw an
exception and we want to
do x.
replace R
sub
oh you only need the first and last of
each string oh but no they might be
normal
digits that's a good point we got to
consider the runtime of our
algorithm okay fine we'll write the
simple algorithm all
right
okay we'll just we'll simply just zip
this with a range from 1 to
10 no no no no no no no
okay we want to get the index of each
one oh I know how we're going to write
this so simple boys we're going to write
this so simple
okay so we need a function there's a
function called r index too
so we want X index
n
plus X
index stir
I
comma
I that's
good for I in range
10 okay so
now when I pass in
823 substring not
found if I in
X
okay
cool uh actually we won't do sorted here
we'll just do
this okay
now we
want
um
Su temp
x uh we should do sorted
actually so we can always just take the
last
one sum temp X Sub
0 sub
one uh we need a string of that we need
in
stir stir temp X we should really reuse
that uh TT sub minus one sub one it's an
INT for x and
st2 there you go to 81 all
right we've now written the beautiful
simp version okay so the simple version
simply has
R this
line and then this
[Music]
line beautiful all right can we do it
any
simpler
I really don't think
so I that's just about the simplest you
can
get all right no no no no guys that's
way too many
[Music]
lines okay those two lines can stay but
can we get this on one
line print
sum yeah I mean I think we can just
substitute in temp X there it's not too
bad
you know what and this I hate all those
people like oh I need my editor you know
dude you don't need a fucking editor
right like
bro bro I'm doing this in the python
console right I'm literally doing this
in I'm I'm making quote strings so I can
exact them there's your on line
solution can I remove R well I can't
really remove R because there's no way
in Python to make it spell the numbers
out but you should have an llm ready to
generate that kind of crap for you
really
fast all right let's ask Quenton what
this
does
what oh I broke
it how' I break it
huh wait I ran it up there and it worked
fine
what are you doing to my code that's so
many
lines
you stop expanding you're adding spaces
to my code and ruining it okay
good can you make the code
readable
please check get still
runs
bro you broke my
code yeah Quenton fix that
shit
all right no we need Quenton to be
faster should we move into a tiny
box should be faster on a tiny box
right Quenton you're being
slow oh we got to download the
model
whatever
oh it's now
60 I'm good thank
you
[Music]
do I already have it on the other Tiny
Box yes it's on this Tiny Box okay we'll
let that one download it
whatever
oh it's got to create the cash
though no AI is stupid can you guys see
it's not taking my job anytime soon
man what no it just cheated it didn't
actually run the PIP it just printed its
own
output I think it's going to be faster
at uh
once it compiles but every time you give
it a new prompt if the prompts a
different size it's got a compile code
which
sucks Metal's compiler is blazingly
fast how your downloading going oh you
finished 53 trillion compil no this I
mean this this sucks it's got a compile
shit
for
it didn't finish okay this is just
broken
now what are you doing Tiny
Box
let this in no way be a reflection of
the quality of your Tiny
Box oh maybe I have some weird version
checked
out are we not on the GPU or
something yeah we're not on the
GPU that's just messed
up
oh tiny grad has another dependency now
oh that's terrible and that just
silently fails oh who built this
shit it doesn't tell you what device
it's running
on why was
it oh this is some old
version so GPU C types is a new package
I
launched
um it's C types wrapper for hip Cuda and
open
seal there she was running it's just
really
slow what's it doing
[Music]
now
[Music]
maybe it didn't actually maybe it's
actually reading the weights right
now that's
slow
huh
I don't know what's going
on what's it
doing
yeah must be some copy
issue but if it was copying it should
even tell oh it did tell me I
say
uh
h no no something's just wrong with that
example this one's
fast that's pretty good why is this not
working what is it
doing where is it spending this
[Music]
time try the hip back
end
Frozen I think it's like running out of
memory somehow we have some memory usage
bug yeah look it's got to be Memory all
right cuz that's half the GPU memory
somehow all right we must have a bug
where we're using doubly as much memory
as we think we
are uh maybe we'll disable the lru
allocator understand I run llama in CI
though
so
no that's as far as it
goes
okay there's lots of things that are
strange about
this the world needs that dtype free
Factor more than
ever
yeah I don't know your tiny box works to
train C
far
what's going
on I don't have any idea what's going on
either I don't know why this is
freezing like it must be trying to
allocate more memory than it
has but I have the call to Alec and it
doesn't seem like it there shouldn't be
another secret way to allocate
like that's the real allocator
there they should have plenty of
uh I removed the fast
path from The
copier
rewriting it in Rust will not fix
this
okay we do have some stuff where we're
keeping it
around or maybe we're not keeping it
around yeah that might be the problem we
do keep it around on the
GPU this
hangs
so there's a bug in here by the
way
[Music]
all oh and that's annoying because we
don't pass in the real device there we
pass in this
[Music]
garbage
oh we get to there and it free
Jesus no idea boys no
idea all right it's not going to be fun
to debug that you don't want me to debug
that do
you
we need some better tests for
that okay okay you want me to debug that
okay all right all right let's debug it
all right let's
go okay
um first off we got to stop working in
this stupid uh
environment let's bring up vs code code
new
window
uh remote
Explorer T9 connecting current
window and open
folder tiny gr
okay so is it the copy in that's failing
or the allocate that's
failing
oh well
first I want my other I want my other PR
merged
first let's hope I didn't mess it
up no deep type
Alec
but even without
that doesn't really
matter from Tiny grad run
time what
why I hate this why would you do that
restart the
server
yeah good Python language server thank
you uh hips import hip allocator
okay
uh okay let's allocate in uh 256
megabyte gigabyte chunks
ending with Ali welcome welcome welcome
welcome let's just go to
okay allocation works fine could it be
the RAM usage could I be that wasteful
of ram that I'm using
100 bajillion
megabytes
wait what just
happened it just
worked I don't understand
I showed it it could allocate more
memory and it
did I didn't merge
anything
I have no
idea maybe it got into a bad State
because I closed the other
one oh wait this was happening on both
tiny boxes there you go it works and
it's
faster boys
it just fixed
itself see this takes a little while CU
it's actually got to do recompilation
there I just banged the TV see look how
fast it
is what it did it messed up those int
and
stirs
oh we still running the bench mark
maybe we tried it on both
computers where can you run this model
just literally run examples. Cod in tiny
grad and it'll work
probably you guys all right you guys are
going to have to analyze that in the
comments cuz I don't know
man let's see if it figures out that it
broke the
code fuck it
gave 25 and
not 281 that's a bad
refactor see now it takes time because
it's got to run the stupid hip
compiler test with 13B model here we
should able to see the RAM usage I
think okay we're using 62% of the vram
it seems
right
oh you were so close you forgot a TT
Subzero
here no you forgot multiple
things did it fix the
code it did
not
uh that's using oh don't trust I mean
don't trust any of these percentages
they're all fake I mean Nvidia are fake
and AMD matched Nvidia the best they
could so I'm sure they were uh
fake uh all
right well you saw me debug the issue
why does tiny grad have to be so tiny
because it's in the name okay why does p
torch have to look like torch CU it's in
the name why does tensorflow have to be
bloated and give confusing error
messages and have very verbose apis
because it's written by Google
I threatened to debug and it solved
itself
great all
right uh I think that's today's
stream I'll have to figure out why the
tests are failing on the no D type Alec
but we'll get that
merged uh oh you want to look at gbt
fast from pytorch yeah pretty cool and
they're talking about under a th000
lines I like them talking like this this
is good guys we're changing culture boys
we're changing
culture um okay do any of these tiny
boxes have pie torch does have pie
torch but does it have
Cuda oh it has Cuda okay good good good
then we should be able to use
this all right
uh let's try gbt
fast
uh
wait so what other models here open LM
research that should
work whoa look at that parallel fetch
using tqdm
based um all right we're downloading
stuff okay we should set model
repo if you had a tiny box you could
have fun
too why do they make the example not
work everyone's logged into hugging face
on their
Cly
generate
text tiny box under
10k it's just not doable they're
probably only going to get more
expensive but more powerful right it's
like running never gets easier you just
go
faster like I'm a little upset I wanted
it to be a person
sorry I wanted to be a p
flop uh someday I want a tiny box to be
a person so one person is 20,000 Tera
flops so you need 27 tiny boxes right
now to be a
person teeny box if you want a teeny box
people have brought this up if you want
a teeny box just buy a gaming computer
like I could make you guys some
overpriced gaming computer and slap my
logo on it but is that what you really
want like there's no engineering prowess
in that right at that point I'm just
alien wear you
know no no I hate all of you and that's
not what you want and I'm not doing it
I'm not a fucking sellout you know
that's what sellouts do spoon feed you
the computer will make you guys just saw
me solve Advent of code in a python
terminal okay okay haters like that's
that's that's just just like you don't
need oh I got to get my edit environment
I guess you want me to do with a crappy
keyboard too I'll do it with a crappy
keyboard it doesn't matter it's in your
mind right so no you don't want a team
box thought of becoming a pro Esports
player the only game I can play
competitively is Smash Brothers 64 and
I'm not even competitive at that anymore
like I was competitive 15 years
ago um you guys saw me try to speedrun
Pokemon Red and now bad I am at it
uh all right time to load
model
5.59 seconds all right you want to
compare that we'll compare it to Tiny
grad's coder how long does this take to
load the
model all right
okay a little faster in tiny grad point
tiny grad uh this is compiling some shit
one torch what's one
torch oh it's a plasma torch oh
unspecified launch
failure and that is what you get from
torch
unspecified launch
failure I don't even know
like guys like I don't even know where
to
start all right we Google the error
we'll give them we'll give them a fair
Shake all
right uh
okay okay okay we'll give him a fair
Shake I have to install pytorch
nightly okay we want the nightly
Linux Rock
[Music]
M good thing we upgraded
pillow
[Music]
who thinks this is going to fix
unspecified launch
failure I will point out that all of
tiny grad's dependencies are very
tiny I I worked really hard so there's
only a few dependencies
left all that's left now is tqdm GPU C
types and numpy and these are both pure
python under 100 kilobyte
dependencies what's Pi fix.
Pi that's not a
thing uh okay what am I running jener
eval
dopy generate.
py
looks very
complicated oh oh the time to load model
went
down I'm sure you guys my llama
while we
wait this is Tiny gr's llama the whole
thing's
here see
torches it's actually pretty nice it's
actually pretty
similar quite nice
actually are there use a data class for
the augs it's probably not a bad
idea how many years of coding do you
need to reproduce tiny grad you can
look uh at how long I've been working on
it and then you can think about what
your ratio of programming is to me I
don't know why this mouse does that
sometime
it's kind of ugly I'm me clean this
up by the way we're waiting for p torch
to compile right
now uh okay only web GPU
failed test llama compile speed yeah
that's not bad it's probably some stupid
thing wonder how to fix it
blind
all right so we have the function that
actually calls
this uh compile
speed yeah okay
what oh is this cuz I Ed the fake
allocator yeah yeah fake allocator and
fake program cause me so much
trouble literally it's just
that see if we get the check
mark how we doing has it compiled
yet oh not
bad I mean no it's actually by not bad I
actually mean very bad what the fuck is
this
um yeah Quentin's brother
uh you know he's
um is this how bad this open open La is
I downloaded 14 gab for
that uh
great okay it took two minutes to
compile uh what's my
speed I don't think this actually
supports
timing it doesn't support
timing how many tokens per second would
you say that
is
oh actually they're just talking about
bandwidth achieved we should be able to
just get that if I do
that here we can get the timing
here well this is going to be slower
though actually no not if it's using hip
graph is it using hip graph oh it's
using hip graph sick okay so that's our
time and that's our bandwidth okay so
it's a little bit slower than P torch
but it doesn't print question marks and
gives you the right answer this pretty
good tradeoff
right um so this is you can see these
ones here are using hip graph tiny debug
is sick I know
right we work hard boys we work
hard uh no we shouldn't hate on P torch
too much they'll get this stuff to work
um we like pytorch and I believe that
this is real and it's probably just some
online bug
somewhere uh to be fair I'm not using
this on Nvidia which is mostly what
they're
targeting
um
yeah all right we get our check
mark I made CI
faster let's read this and see if we did
beautiful did we do
beautiful that's better that's the new D
clean what do I use unops for now oh
yeah I stuck it in cast that's cleaner
cleaner moved that up
there
cleaner yeah this pure mostly looks like
a
win
so unfortunately we can't oh I guess we
can see how long it takes still we just
can't
see uh the outputs unless we signed into
GitHub if I were CEO of open AI what
would I
change um by the way you see why that's
slow it's not slow cuz the GPU kernels
it's slow cuz it's got to compile each
one of
them uh I would not open source the
weights I know guys I know I love open
source but no come we got to have a
business model I would not open source
the weights if I was a CEO of open AI I
would publish papers and I would include
model
architectures um you know for a couple
of reasons to entice researchers to not
like to like establish ourselves as the
Kings because what's going to end up
happening again a lot of people think in
a very shortsighted way they're not
thinking about how to build a company
for 10
years um and like if open AI keeps being
closed they're not going to keep the
lead
uh and I would like to keep the lead
until you know we achieve the
singularity uh so I would make all the I
would just be very open when I talk
right I would just like I would say
completely honestly here's what we're
doing right like yeah you could compete
with me right you could train 20 pay $25
millionar and train GPT but I'm not
going to open source my infrastructure
I'm not going to open source my weights
so like you know you can build your own
infrastructure and weights but at that
point like I'm just not worried about
anything else right if if I lose at that
point I've slowed the world down and
it's going to end up being less of a
good strategy long term as a company uh
to keep your architectures closed and to
just like be closed like don't do
that right like here's the thing about
lying when you lie or when you keep
something a secret eventually you start
lying and keeping secrets from yourself
those things are not
separable
great test pass let's click the merge
button oh I feel like I might have
broken it
on I don't know YOLO
man there's a chance I broke it on the
internal
CI
uh no yeah so I just be like open in the
good guys and a lot of people would love
me and you know there'd be a small
percentage of people who would be upset
that you don't open source weights but
like you know come on like other people
should be able to catch you and you
should have to work to stay ahead and if
you're trying to build a moat uh where
that's not
true
you're not going to have that moat
forever you're you're encouraging your
own
disruption if you want to build a
company that lasts 100 years it lasts a
thousand years don't
ever like Google at some point decided
to turn Google made the sharp left turns
the AI safety people would say um and
Google's probably only going to be
around at least in its current form for
like 5 10 more years it's still going to
be a relatively big company but it's
going to be IBM it's not going to be
Google right and you say like oh IBM is
still a big company but it's really
not right so if you look at the top 10
biggest
companies
um can I see a normal like yeah okay
here we go right I like Google's here
and where's
IBM like they exist but they're at 80
and that's what's going to happen at
Google like Google's not going to keep
this spot uh because they've made too
many decisions that are basically a
shortterm but a
long-term uh you know downtrend and it's
actually very interesting to see that
Google's the only one here Who's
down uh I guess this is down a little
but Google's down over a relatively long
period of time um whereas who here is
going to end up doing
well no I mean it's actually crazy right
and and both of them are are
legitimately great
companies um the top two companies are
on a steady rise the M3 you know I I I
like I can't get over
this it's the fact fastest the cheap M3
that you get in a MacBook Air is the
fastest single
thread uh CPU in the world it's beating
this I can buy the whole computer for
like does Apple sell the what do they
sell the cheap one in
now what's the cheapest M3 I can
get there're only in
Pros
yeah $6.99 gets me the
cheapest laptop single threaded
performance it's just
wild um um I mean the GPU is quite good
also the GPU in this thing is
uh here I'll show
you 11 gig
flops I think that's not even tuned for
m
Max oh
sorry yeah we can't right now search
with the tensor course I put in a bad
number it wasn't a multiple of shit no
it's going to take
forever that's a multiple
shit yeah same speed
[Music]
um we'll see can I do Beam on top of
that we'll let a beam search but the
beam search unfortunately doesn't search
the tens but still I'm getting 11 Tera
flops and like that's a quite a good uh
you want to check hash cat I not going
do that that's
stupid all right fine just so we can
compare it to a tiny
box
this computer just feels so fast like I
can't believe anything made my M
uh it made my M1 feel
slow I have to give it no
hip
uh so this is an M1 Max M3 Max it's the
best M3 you can get I got the highend
max I don't buy the lower end Max
because they Nerf the memory bandwith on
it it's not just the
course my life's in a terminal yeah but
the terminal's
faster and that's not true I I
occasionally use a web
browser yeah okay very all right all
right all right all right the GPU is not
that great um by the way just just to
just to put something in perspective
about how much faster your
uh M3 is compared to a tiny
box a tiny box is equivalent to 23 M3
Maxes the streaming is not using
anything what I mean yeah Chrome needs a
lot of memory guys chrome chrome needs
the memory okay don't take Chrome's
memory from it okay Google needs your
memory it's doing ads in your
memory 15K equal 10 M3 MacBook Pros so
you get 23 MacBook Pros of
performance I don't know where you're
getting these
cheap now compare the price of a tiny
box to 23 M3 Maxes oh that's a good
that's a good place to leave the
stream if you would like an M3
Max if you would like this M3
Max you can
purchase for let's say five let's round
it up because you know about the
educational discount five M3
Maxes or one tiny box which has
23.5x the performance of an M3 Max does
it make sense to duct tape 20 M3s no no
that never makes
sense most of the ca is that is F oh do
they have it in the studio yet do they
have the they put the M3 in the
studio no I think it's still the two
yeah still a
to uh it doesn't have a touch bar Apple
got rid of it because they
learned by the way based Apple getting
rid of the touch bar you
know uh studio will launch with ultra
do you know that or no touch point is a
deal breaker what's the spec of Tiny Box
why why why do you make me repeat myself
it's here uh it's 128 gigs of C the
working spec is 128 gigs of uh system
memory and a 32 core uh
CPU it was going to be 16 core but I
spurred a few guys and bought the 32
course can I do an outro freestyle no
cuz you're not a subscriber what is that
what is that
emote what's The glhf Pledge inclusive
no no guys guys guys again we're going
to leave the stream where we
started I hate
wokeism I don't hate underprivileged
minorities because that's not what
wokeism is wokeism is a cabal of Elites
using highly refined gain of functioned
memes to Target the masses to gain more
control over
Society that's what it is okay you got
to you got to see through the rhetoric
and see the lizard people underneath no
but it is it is boys it came out of
Harvard it came out of Yale it came out
of Princeton it came out of
Colombia no gain of function memes I
stole that from Conor Ley uh you know
very uh very good very good um so you
got to you got to realize that with
wokeism man the trick is not to you can
hate wokeism without hating minorities
don't hate minorities that's the Trap
they want you to fall into love
minorities hate wokeism that's how you
win man they didn't see that coming they
didn't see that coming man they didn't
see that coming you know they just they
they didn't see it man they didn't see
it that's right they didn't know and
don't kill anybody if you're thinking of
killing someone today I make a better
decision I've watched a lot of police
interrogation videos you you you're not
going to stand up well to the
interrogation man but you know if you do
kill somebody make sure you don't get a
lawyer and make sure you talk to the
police so that it can end up on YouTube
so I can watch it and be mildly
entertained uh because that is the true
reality television there is no truer
reality television than True Crime
interrogation footage I can't believe
this shit's legal I love America I love
freedom and I love about half of you
particularly if you're a subscriber
thank you for watching my stream um yeah
yeah yeah don't uh yeah
sleepydude1: kayawaWinkeWinke
payday05: yoo
RangeBomber: fast af
0xmalvee_: and we got 1 GBPS wtf
sleepydude1: TPFufun PikaRamen
Izaroth: hello
jmickelly9: yo
TandeBoy: hi
userismale: hii
dantedante33: CrreamAwk
amratesh: hey man
0xmalvee_: I have 35 mbps lol
userismale: mis u
hotfirebulldog: wow so sexy
Iron_Therapy: Iron_Therapy subscribed with Prime. They've subscribed for 5 months!
jayhey00: yo
payday05: back in San Diego?
r3mote: hii
yugz_baby: hello!
leikowo: o/
userismale: How not to be a noob - George Hotz
spoonx0r: AT&T?
whiterunknight: Hi George
payday05: u don’t like cursor?
Not_Snorlax0_0: Hi
bunterr: all my apartment has is 3 LTE bars
kerubelk: oh shit he’s back
Galaxygon666: Good timing, now i can Co-Code with the legend xD
0xmalvee_: linux kernal?
TandeBoy: what’s happened with tinygrad since last stream?
SouFi_Wara: GitHub copilot ?
lukasf6: Hello
kerubelk: are you still in china?
glennposadas: greetings from the 🇵🇭, George. :D
ashcrok: hi georgie
21st_centuryman: European boys 🔛🔝
tunesout: He's in San Diego
SouFi_Wara: Cheer1
21st_centuryman: tinygrad OS when?
dhavalkotak: Hello
perlpimp: sup cracker, ello from 🇨🇦
AK_ttv_: Lol so this is it, I thought you'd have thousands of viewers
AK_ttv_: Geo do you remember NextGenUpdate back in the day
yugz_baby: george: "where's the viewers at?!"
hexdhog: what's the python code box above the kernel code?
mn2197: Long time no see. What is the current speed performance of tinygrad? tinygrad cuda vs tinygrad amd vs torch cuda?
backend_hacisi: any plans to visit singapore george?
gliched_robot: gliched_robot subscribed at Tier 1. They've subscribed for 33 months!
userismale: George Hotz why ur twitter acc tweets not visible
gliched_robot: I write a lot of molecular dynamics code, I plan to test the code
yugz_baby: am I the only one who understands jack?
ViKiNg688: ViKiNg688 subscribed at Tier 1.
tuugen3213: did he say when/what is the tour
yugz_baby: or is everyone here for the vibes...
Cinnabon2: is there a name for how this is presented
ViKiNg688: Wow I never catch you live
userismale: @tuugen3213 no
hask_nosiit: Ayeeeeee
hask_nosiit: Yooo
jordandiaz1988: jordandiaz1988 subscribed at Tier 1. They've subscribed for 27 months, currently on a 7 month streak! hello bro from Peru
smurfd0: tour of tinygrad
userismale: u guys able too see hes x acc ?
gliched_robot: wait is he using keyboard shortcut to navigate viz graph what the hell.
gliched_robot: what is the diff on the right ?
leikowo: wait so the squares are UOps, and every single one of them has a value ? eg: view has a value ? so each of them really has it's own shape ?
gliched_robot: Ya, this is fucking cool. It should be the default in every NN library. Makes debugging so easy!
allright_iamhim: When do you think tinygrad will be at a level of pytorch?
gliched_robot: @allright_iamhim end of the year I think
leikowo: could you explain quickly how the vectoriser works ? I remember the dtypes had a number of elements
allright_iamhim: Sorry to ask but can anyone tell me what is the tool is he using for these graphs?
leikowo: tiny glossary
georgehotz: VIZ=1 python3 test/test_tiny.py TestTiny.test_gemm
gliched_robot: Here is a link to install from master: https://github.com/tinygrad/tinygrad?tab=readme-ov-file#from-source
leikowo: yes, but there was something wrong with the gpu noob program, it didn't account for nvidia being smart and the register dependencies (I spent a week figuring it out)
sjray90: I miss the Quentin days :(
leikowo: tiny viz working perfectly
allright_iamhim: Geohot for the president.
pablusame: cheers from Argentina we kinda now about “economic distress”
Ayyyy420Lmao: george what's your account on polymarket?
illesteggplant: yooo
shadypc: W economy
wittentrip: hi
devroyalty: hope  you've been well bro
the_twitch_of_the_itch: finally
ReedThings: What, I thought you love Trump, no way Kappa
tricky_labyrinth: bro nothing ever happens, good or bad
userismale: me too
shadypc: impossible
wittentrip: not voting is never a good idea though
zaboomafooxd: nah
saratogahole: based lol
devroyalty: lol
TandeBoy: based
hugenippy: lmfao
itripleji: this is what you guys wanted, now lets stew in filth LUL
cacaosteve: if we all move to asia we can get our chinese goods
Meercal: I would be a better president
hamzard1: W stocks
speed__surge: ya at least the money wouldnt have been liberated from my wallet
jayhey00: chyna
devroyalty: mmm
boywitharupee: are you going to add support for visualizing flame graphs? Brenden Gregg style.
userismale: well said
RealOrtoXX: the market already rallied back up
sjray90: honestly that last stream renewed my interest in deep diving into the GPU area, spent the week going into it, really fun! thanks : )
preggzor: best in what regard?
TandeBoy: @RealOrtoXX just wait, the worst is yet to come
Ayyyy420Lmao: isnt that from AA?
Not_Snorlax0_0: Prayge
shadypc: W god
vybster: David sacks & co are such losers for shilling
hamzard1: W prayer
devroyalty: fsmPray
stuart2199: the chinese know calculus america doesn't know algebra :\
tricky_labyrinth: the visualizer's so much better than I remember
hexadecimal58: Are you back from HK?
rantos9: we should reindustrialize the world, we shouldn't leave all manufacturing to china, it's a bad long term strategy
userismale: hahaha
Meercal: lol gold one
the_twitch_of_the_itch: KEKW
arnaude: So sell all my stocks?
pepeega: it's a bit late dont you think
jakewhit14: "of course I'm mad with power, ever tried going mad without power? its terrible, no one listens to you"
thecoockoo: 145% tariff on python imports
rantos9: short term pain, long term gain
Ayyyy420Lmao: @thecoockoo KEKW
preggzor: but chyna pays the tarrifs Kappa
hexadecimal58: know the meme of the dude in the bicycle? it's the US perfectly. outsourced because they wanted to and now they're doubly shooting their foot.
AbacusFinchJD: compromise: mexico pays the tariffs
hamzard1: that actually makes a lot of sense. now even less manufacturing will take place in the US
sarah99___: sub mode off 👀
ViKiNg688: yes. this.
boywitharupee: flamegraph support in VIZ?
leikowo: so looking at the VIZ for the command, what's  - view base - lowered - expander - devectorizer  and where do we see the final kernel that goes into codegen ?
shadypc: the shit talk is too much
masroor_k: Peter Thiel says it's a negotiation tactic. It's a way to have leverage in order to have a reset
userismale: rugged
brotama: How did anyone think Trump would stop being retarded all the sudden? The "America first" stuff was always an obvious lie, dude does not give half a warm shit about America
john_kosta01: He will get there but may take so time
doberman1071: What did you expect from a populist leader anyway? They act in line with their own interests
oskrM: @masroor_k Art of the deal KEKW
AbacusFinchJD: @masroor_k anything trump does that doesn't work is a "negotiation tactic" Kappa
rantos9: based lmao
hamzard1: W numbers
Ayyyy420Lmao: obesity rates
arnaude: But what if they delete the income tax
hourzer: taxes are going up
rantos9: is e/acc legit?
shadypc: W graph
Meercal: up good , down bad
john_kosta01: nah
AbacusFinchJD: we need to breed more hamsters and build more wheels
shadypc: ^
hexadecimal58: USA just wants to boycott  and fuck China over. Loser strategy
Meercal: lklklklk
pepeega: the important number https://ourworldindata.org/grapher/per-capita-electricity-generation?tab=chart
gliched_robot: America is linear growth china is exponential
m4l4r100: fuck that stupid mass deportation. we want workers coming in
rantos9: LUL
m4l4r100: welcome to trade deficit therory
vybster: tiny grad requires python 3.9.6 not in '>= 3.10
cacaosteve: preparing profile: 100%|███████████████████████| 5/5 [00:00<00:00, 61224.26it/s] *** started viz on http://127.0.0.1:8000
john_kosta01: not that hard right
zaboomafooxd: good time to work for US DoD?
hamzard1: W coffee
brotama: Oh I just got tinygrad installed, whats the command we were gonna test again?
john_kosta01: Yeah just do the right way
Meercal: legal people are being deported
thebirdabides: @georgehotz are more ASICs in the training and inference space a viable strategy to combatting power needs? They would be more efficient, than general compute, no?
thecoockoo: legal immigration is cool, yeah
cacaosteve: @vybster i think you need to activate a conda environment with the right version of python
brotama: Oh I just got tinygrad installed, whats the command we were gonna test again? @georgehotz
pepeega: it's crazy that voter ID is even an issue
frxncas: This is Silicon Valley: E/ACC vs. traditional conservatism now
TandeBoy: how do you think this will end up?
Cinnabon2: we should build data centres in cold, oily Canada but we'd rather keep it in the ground 🤷‍♂️
oskrM: legal and even citizens are being deported
thecoockoo: wrong numbers go up
cacaosteve: VIZ=1 python test/test_tiny.py TestTiny.test_gemm
frxncas: this is tech bros vs tradicional boomerism now
m4l4r100: I really wanna know your thought process on why you still gave somebody like trump a chance @georgehotz
hexadecimal58: It's crazy how the US spent 50 years creating the rules of the international trade game. Then China played the game by the rules. Won. And now the US is mad and wants a "reset" LUL loser
Toxicosmos: sure, here you have inflation going up
Cinnabon2: @oskrm I head about that. so they show ID and still get arrested?
cacaosteve: Trump let Ross out but now he's sending guys with no driver's license in non-California states back to central america
arnaude: gamergate?
gliched_robot: Got it now!
leikowo: for the people who want to get the viz up `git clone git@github.com:tinygrad/tinygrad.git` `cd tinygrad` `python3 -m venv .venv` `source .venv/bin/activate` `pip install -e .` `VIZ=1 python3 test/test_tiny.py TestTiny.test_gemm`
pepeega: chinese middle class is massive
Meercal: tesla is big in china
VanyaFTW: you looks like vibecoder
Cinnabon2: one complaint I heard is that you can't sue and enforce copyright
john_kosta01: He is
hamzard1: do they have costco tho ?
Morgahl_: "Democratic" Oligarchy
HurricaneFP: America is in managed decline
P4sik: AI is gone
TandeBoy: why would China import from the US, when their manufacturing is just better?
ReedThings: Is Tesla big? I thought BYD is destroying Tesla in China
rantos9: china should at least allow for 100% foreign owned companies to operate there, and not just for Tesla
Meercal: for how long more you think nvidia will continue leading the gpu market
stuart2199: can't export to communist bloc can only sell to great america capitalist ones
Black3v3r: At this point sell Tinyboxes without the cards and let people put theirs in LUL
thebirdabides: US services are superior as well
hamzard1: beef and pork
sjray90: Do you think Red box v2 this year too?
rafaelrcmrg: rafaelrcmrg subscribed at Tier 1.
diplacidon: soybeans
rantos9: LUL
spede: nvidia avg salary is $300k so of course the best engineers from china and everywhere want to work in the US instead of where ever they are from
Handelorian: Do you think you'll back on Lex's pod any time soon?
leikowo: Could you explain the different steps on the side bar in viz ?
hexadecimal58: Every single time the US tried to boycott and lock out/slow China, they won in the end. "You can't participate in our international space stations". China: "ok." build's their own LUL
Black3v3r: True, people would try random mixes of cards and then complain LUL
rantos9: who cares about AMD GPUs
cacaosteve: Thailand has BYD now... i just hope they don't have issues that like building that fell down
userismale: broke atm lmaoo
frxncas: The cyberpunk model unironically looks like the most promising future in the background of radically degraded state capacity.
Joooooooooonas: I have faith in amd, nvidias drivers lately are so shit and amd gets better and better
Cinnabon2: @black3v3r remember SLI
Black3v3r: @Cinnabon2 I'd rather not Kappa
SlimeSwallower: hi george <3
sjray90: You were on an AMD bender a while back... have they shown any signs of change? Or is your view still that they aren't taking AI seriously?
Dathknei: what does this box do?
shadypc: wasnt me
john_kosta01: The new guy
rantos9: LUL classic AMD GPU shenanigans
cytotoxnk: @Dathknei AI stuff
water_boy_h20: classic
hamzard1: republicans
TandeBoy: must be the intern
pepeega: so anyway, buy nvidia cards
Cinnabon2: sorrow34Dance2
userismale: hahaha
I_am_paranoid: LUL
Handelorian: The world isn't run by weapons anymore, or energy, or money. It's run by little ones and zeroes, little bits of data. It's all just electrons.
smurfd0: 'dpkg -l|grep llvm' to see what ver of llvm you got
Cinnabon2: @handelorian and weapons too
swolka: @Handelorian same as your brain huh
Handelorian: that's what  I get for quoting a movie from 1992
kolmok0dz: somehow Fujitsu just partnered with AMD "For ROCm"   I kid you not.
Cinnabon2: the talkies
hexdhog: Democrats have Critical Race Theory, Republicans have Critical Trade Theory and both are equally stupid
m4l4r100: how good are your rolling skills
john_kosta01: lol
Panda1Express: xD
boywitharupee: dump?
leikowo: trying to understand VIZ; could you explain the left column steps ?
cacaosteve: we need illegal immigrants to work in the factories
spede: 2% want to pay the price tag for a completely american made car
gyne: build the ai robots to do the manufacturing jobs KKona
ViKiNg688: NUMBER GO UP
hamzard1: Lord save the NUMBER
john_kosta01: Dollar abou to be at the same price as Canadian dollar
kolmok0dz: Darwin will take care of that.
thebirdabides: @georgehotz what ever happened to those companies trying to burn transformers onto an ASIC ?
Morgahl_: the problem is the manufacturing jobs taken away from places that had workforces that actively WANTED the jobs
m4l4r100: well kamala wouldn't have put one million % tariff on china
cacaosteve: you can import 25 year old Japanese cars to USA, might be a good option
john_kosta01: I yeah true
kolmok0dz: Every one is amazing kreskin
gliched_robot: Think about it they give 85k H1B , there are more homeless in LA and SF.
john_kosta01: They had one jib and fucked
funtimes19: what's wrong with dei
nuttyodin1: George has been rizzing up China before Speed
SlimeSwallower: DEI in my soup again? madge
john_kosta01: AMAZING
yugz_baby: that voice is hilarious
kolmok0dz: GH : countries are dumb, merit is all the matters
cacaosteve: we can all be Amish in USA
pepeega: kanye 2028 will make number go up
rantos9: LUL
gliched_robot: what is this comminisum !
kolmok0dz: Chinese citizens can be *made* to work.
pressOk: still in CN?
hamzard1: Deficit Export Import
rantos9: what do you think about term limits for presidents?
Dathknei: @gliched_robot trump wouldnt mind if usa switched to communism and him being leader
water_boy_h20: the problem is that china make the basics things like screws and less important stuff, wich make the big things that we use
Cinnabon2: i wish I was more competitive. unemployed 3 years. I wouldn't mind if my gov use bs to advantage me
illesteggplant: lmaoooo
funtimes19: as long as they get due process
m4l4r100: hmm trump. or maybe you would have known that the best cars come from germany and not america
Cinnabon2: dead on. I hate being a mooch it's depressing
Morgahl_: @Dathknei he doesn't want communism he want a Oligarchy
SlimeSwallower: whats a mush
kolmok0dz: you should xeet that.
teachingtorches: we're deporting dudes posting up at Home Depot to build shit instead
nuttyodin1: Both parties fear China
shadypc: and keep the pooches
SyntaxWraith: @SlimeSwallower I don't know, don't ask me
gliched_robot: yes. please is you are paying taxes for 2 years you are out!
jagger_rsw: zis are serious things, no? :)
vybster: big ayn rand energy
funtimes19: disabled people = mooches
runnamucker4: ill be the rare one to break from the norm to say, hi george, thank you for strimming, it is always awesome!
nuttyodin1: Is fear of China justified? Is the real question
fehehehe: damn
hamzard1: W hawkin
rantos9: HOLY
Cinnabon2: at least make AI slop instagram content or write books if you're disabled
pressOk: robotz
m4l4r100: is the us afraid of greenland? hmm
leikowo: trying to understand VIZ; could you explain the different steps in the left column ?
gliched_robot: Ok should I be using clang in my mac ?
yehspehr: yehspehr subscribed at Tier 1. They've subscribed for 2 months!
gliched_robot: ^to get this viz
nuttyodin1: Let me get to another question later
nuttyodin1: nuttyodin1 subscribed at Tier 1. They've subscribed for 25 months, currently on a 1 month streak!
leikowo: are they in exec order ?
sw4rtz13: sw4rtz13 subscribed with Prime. They've subscribed for 13 months!
sjray90: damn this is cool
leikowo: do you get the metadata from python reflection ?
gliched_robot: Ok I am getting a blank screen for mnist in my uops window https://i.imgur.com/5Hmw6Yf.png
sjray90: do you use this to help write better kernels?
leikowo: so index takes a buffer & an index and returns the sum ?
nuttyodin1: i use you as my background noise to work
nuttyodin1: won't spam anymore
leikowo: what's expanding ?
tohrxyz: tohrxyz subscribed at Tier 1.
tohrxyz: Hello and great day to everyone
leikowo: how are you changing like this ? it's the 0 1 2 on the right under the kernel ?
leikowo: is special used for anything else than gid and lid ?
sjray90: does a refactor mean 1.00 is far away?
leikowo: I remember the UOp docs not explaining much :c
leikowo: reduce a list of pms ?
colonizethemoon: yo
leikowo: why can the renderer be none ?
tohrxyz: always vitamin water, never caffeine. are you rawdogging thinking?? :Dd
smurfd0: tour and debugging stream all at once :)
smurfd0: compare the working generated code and the not working?
smurfd0: row 555 in the diff you touched the liniarizer... spelling
smurfd0: yea that
smurfd0: thought you were defragmenting a disc, but no, just test a plenty ;)
nitropiece: nitropiece subscribed with Prime. They've subscribed for 4 months, currently on a 1 month streak!
lBdCompanyl: lBdCompanyl subscribed with Prime.
lBdCompanyl: this dude is a mage, love it <3
lBdCompanyl: what is tinygrad? im new here
nuttyodin1: who registered for "world" to distinguish themselves from AI?!
leikowo: sm90a can do f32x2
leikowo: some of the ptx ops can handle dual alu yes I read that somewhere
leikowo: "add.f32x2 requires sm_100 or higher." from ptx docs
leikowo: so Blackwell datacenter & rtx blackwell
drtinybloom: drtinybloom subscribed with Prime.
leikowo: how does gpu fryer compare to gpu-burn ?
smurfd0: lul the picture :D
leikowo: rustup pls
leikowo: how old was that rustc? x)
drtinybloom: Chat plz, what's tiny grad?
leikowo: use rustup please
leikowo: https://www.rust-lang.org/tools/install
drtinybloom: https://github.com/tinygrad/tinygrad  Ok seems cool related to the rewrited of pytorch for AMD hardware from like &.5 years ago or so ?
leikowo: 80 is fine on gddr but on hbm I would be scared
drtinybloom: lul not on twitch, but happy to catch up
leikowo: It's made for big clusters stress testing
gliched_robot: I suspect the fan controller is cooked.
leikowo: great temps for 600W x 4, my gpus go to 90c at 300W
leikowo: (though I can't afford a tinybox and spent a year to make my own box for 5K)
gliched_robot: I remember where there was a company called DSpace, which made boxes like this; it cost 2x the price for 1/2x the power. With shit software.
leikowo: would you delied a datacenter gpu ? some older ones have the thermal paste between die and ihs all dried up
smurfd0: probably some kernel driver you need to load on the new box
gliched_robot: how many db? are the fans ?
gliched_robot: Nice! awesome
gliched_robot: aws also runs gpus hot too. My A100 temp is 70c currently.
Zeevo: What chair do you use?
zup_zup: haha chair
lBdCompanyl: how to be good like u? =DDD
smurfd0: thanks for stream :)
gliched_robot: @lBdCompanyl work
dalgalarlagulumse: thank you
skarmorysavvy: will you ever make the tinygrad tutorials more addictive
gliched_robot: thank you hope your sunday is good folks!
leikowo: could you explain the different UOps one of the next streams ? The docs are pretty slim for them
gliched_robot: @skarmorysavvy BROOOOO
chevarra77: Gorg, you the best
thecreator3: you mentioned qcom dsp simulator. has anyone started that work?
ikki1100: Did you change the room for streams? that is my question LUL
Fredirecko: you move back?
Reformedot: A bit new here, what's the purpose of that UI thingy? Why is related with tinygrad?
DrakenZA: you need to advertise these boxes with how many anime babe ai generated images it can do per min Kappa
lBdCompanyl: no idea whats happening =) still love
UltraScientism: I just joined, who makes the dsp?
DrakenZA: it doesnt matter who buys bro
Gameplayer0618: 30% is easily led
inceptiondev: did you check out deepwiki for tinygrad? im curious
zup_zup: Anyone use tinybox with torchaudio? Thinking about it for underwater acoustics ML
Reformedot: The UI is for debugging?
reqx0x: i really really have no idea at all what you are doing but its fun to watch your stream :D
leikowo: does the 7900XTX over usb on the MacBook still work ?
SirMaxMD: The problem is there is no middle ground between a 30k tinygrad and 400k for a H200 server, I am looking for a 100k server
DrakenZA: lol
dedknd: do you get any special deal on the gpus or buy them like the rest of us plebs?
Thirsty4K: Any predictions on the next big mathematical operation that will manage to link contextual information with spatial at the performance of a transformer, without the huge computational complexity?
inceptiondev: https://deepwiki.com/tinygrad/tinygrad
Fredirecko: Listening
drtinybloom: DGX sparks will be the spoonfed garbage, if it ever see sunlight, i guess... XD
Toxicosmos: Deepwiki is cool, until you ask it something about the code
zup_zup: What's the most exciting company tech company right now to you outside of tinybox :D
chachitheghost: chachitheghost subscribed at Tier 1.
georgehotz: python3 -m tinygrad.device
smurfd0: docs.tinygrad.org instead of that deepwiki.. ;)
715209: can we see the servers?
Toxicosmos: Diagrams are very cool
m00rsecode: Wait, does the open source hexagon qemu support HMX?
skarmorysavvy: my 6650xt only has GPU and LLVM :(
gliched_robot: taughts on this : https://www.youtube.com/live/yOMflrCRya0?si=O8XUlWF3fSl2WkLk
NoticabelyFAT: megaGrad
gliched_robot: they mention its opensource
Zeevo: @georgehotz do you worry that tinygrad is too difficult to contribute to without OOP?
Toxicosmos: Do you think MLIR is the solution?
solAPEX_: did "program or be programmed" by Douglas Rushkoff come into mind while deciding to start tinygrad / tinygrad in the home?
ownsoft: multi-level
malateman: with tinygrad + openpilot, you could probably write code most future robotics use cases in very few lines of code with very little dependencies
UltraScientism: Anyone knows if it's possible to accelerate ML on an Android phone with Snapdragon 8 elite from termux? Or have they closed everything off for Android "userland"?
gliched_robot: i think it is: https://github.com/modular/modular?tab=License-1-ov-file#readme
Stim_Shot_: its fast python
chachitheghost: https://github.com/modular/modular/tree/main/mojo/stdlib
gliched_robot: The video goes in detail I think you will like it
uloop: Why were people so against depending on Z3? Looks OK at first glance.
ownsoft: does compiling tinygrad to MLIR make sense?
Thirsty4K: @UltraScientism Back in the day, I used SNPE engine to optimize/port all kinds of architectures on snapdragon processors. I do not know where things are now, but 7 years ago SNPE killed TFlite/TFMobile.
colonizethemoon: make it search
nuttyodin1: Is that seaweed?
nuttyodin1: Wow
Coraxxi: bro's just munching on seaweed
smurfd0: exo labs is cool tho
Temppus: whats your take on qualcom as a company
nuttyodin1: what about worldcoin, do we need to get authenticated as humans now?!
UltraScientism: Chinese are coming
gliched_robot: I do not trust a company who's chips are not sold on digikey or buynow.
EstrangedHD: @UltraScientism already here
uloop: QC is getting booted out of a good chunk of the modem business right now by Apple
Gadaros: lol
PlushMasta: laplanKEK
715209: LUL
m00rsecode: At this point idk why qcom tries to lock down HMX even now
malateman: who has had the best sales people/team you've dealt with? intel?
gliched_robot: "Circle back" to you in the next business day! Brother, go away!
UltraScientism: just reform it at least, so patents are actually readable
colonizethemoon: at least it's cheaper. for less than 10k$ you get 512gb of unified memory
ownsoft: intel is run by career board members
xuio1337: most of the western chip companies are a pain to deal with.
SteveOhBandito: well you see we need an MSA first, then we've gotta go for lunch, followed by two dinners that we get absolutely BLITZED at, then I'll go hit on some women half my age even though I have a wife and children. After all that, you can buy some chips but we're going to need to sell you support at 15% of your hardware purchase price
Toxicosmos: openvino LUL
gliched_robot: AMD has a high inertia, they are slow but they move.
uloop: The new Intel CEO may be able to avoid bankruptcy if V2 of 18A does not fail
Cinnabon2: I never thought of that. copyright is kind of old school in the age of LLMs
SteveOhBandito: Shit is wild out there
uloop: copyright should have died when Napster came out lol
roboboboto: you have what you voted for
gliched_robot: IP laws are shit!
svd_neo: @georgehotz How long until Chinese introduce first global chip they made from scratch
Cinnabon2: I'll admit China at the top level has common sense at least
Fredirecko: log cabins are op
djcodered__: lmaooo
pressOk: "done this"
colonizethemoon: it's like who is less worse'
roboboboto: I'm pretty sure you said on stream you voted for him
Toxicosmos: how you protect expensive R&D if not with IPs?
SirMaxMD: kinda felt like a lose - lose situation
benez1702: what about 2020
Temppus: why ios
malateman: Kamala would have just kept the status quo
skarmorysavvy: is it true his nickname in china is "nation builder"? as in trump is helping build other nations
Flotzdrue: OUR intellectual property
djcodered__: LOL how did you not? He was just as dum the first time.. Super erratic
klimentino: Then only Chinese will ship most of things
xSlye: @Toxicosmos we'd be colonizing planets rn if not for these burocratic shit, nobody put an IP on the wheel concept
UltraScientism: Without IP your lithographic masks become public after reaching the factory for example.
xSlye: stop trying to hunt in the zoo with IPs
Flotzdrue: i may or may not be reposessing some intellectual property rn with plex
zup_zup: The low character is Trump is very sad
Fredirecko: its been 100 days
Zeevo: IP law incentivizes expensive risk taking though
cursormover: should probably keep IP for pharma lol
Cinnabon2: it's possible though capital will sit around and wait for a good first movers to copy
nuttyodin1: But Trump did what he had been promising to do throughout his election campaign, to put tariffs!
Thirsty4K: Tariffs got us Amazon at 165$/huge opportunity boosts to our portfolios. Was this the plan?
beetrium: hey george - i love you! you have motivated me a lot. never caught a stream before, longtime YT viewer.
Temppus: yep, wars just siphons money from govt to pentagon contractors
xSlye: @Cinnabon2 capital sitting around is bad idea on its own
nwerd_gamer: Im working on trying to prevent VIZ from blocking GC of buffers, though serializing and pickle in place dont seem to be the right solution for this. Any ideas?
Carac_TV: are Snowden/Assange going to have a presidential pardon finally?
Cinnabon2: @xslye it depends cause it's mostly funny money that would be inflationary if spent
djcodered__: Trump was a president for 2 years and then 2 years everything was on lockdown and he gave up billions of dollars.
beetrium: Cheer100 Cheer100 Cheer100  thank you for everything George! <3 Cheer100
xSlye: @Cinnabon2 this is because you live in an inflationary money system
UltraScientism: Trump is bad at implementation and details for sure.
xSlye: Fix the money, fix the incentives
Cinnabon2: I think he could have started off slower with the tariffs
Cinnabon2: @xslye jokes on you I have no money
Cinnabon2: LUL
n30__x: American politicians are extremely stupid regardless of where they're standing on on the poetical spectrum
xSlye: of course you don't, you're getting scammed by the US Govt :D
djcodered__: But he didn't do anything great... nobody benefited from anything he did ... and then he came in in his second year and revoked majority of the shit he did in his first year
zup_zup: but look at all the investors that are investing in US!!
benez1702: doesnt he appoint them himself
malateman: no IP is probably better for society, but more stressful/competitive for engineers. you gotta do it for the love of the game. no resting on laurels or chilling on a yacht
UltraScientism: He's been talking/thinking about tariffs since the 80ies. Tariffs is all Trump
xSlye: @malateman I only want to see all these lawyers actually get a JOB
SteveOhBandito: the yes men sycophants are the people that have the worst ideas
zeroRepent: it is crazy how he listens to conspiracy theorists to a larger degree this time around, at least thats what it feels like
malateman: but i want to have a good idea and then chill
Ire2k7: i like buffett's import certificates Kappa
deepvision: if the goal is to destroy america it all makes sense KEKW
Zeevo: The modern right wing embody de-growth more than climate activists
rain_sd: Hi
droppinggems: trump wants amd to go to 0 smh
skarmorysavvy: if only we got more of things like the CHIPS act
nuttyodin1: i think the goal was to dip and buy the market
chill_kaiju: but I thought it the goal was to make it so china couldnt replace the us market with other coutries by putting tariffs on them too
zup_zup: All his buddies get rich
benez1702: he made 2 he made one for his wife too
devroyalty: lol
beetrium: could the goal be somewhat related to refinance/renegotiate national debt?
droppinggems: warren buffet retired everything is going to 0
arthurskylive: Are you not concerned about climate change?
Der0mega: wait till the shelves start emptying
benez1702: do you still have to pay taxes even if youre in hong kong
beetrium: @droppinggems buffett's remarks were pretty grim...
xSlye: US has been on a steady decline since they went off the gold standard
djcodered__: Well ... I can appreciate people realizing they was wrong... but to late now he's already in office
xSlye: so GL with turning the titanic around
NoGoodNick_: @beetrium nah the debt is less of a problem than this tariff situation
rain_sd: why were you just dancing
arthurskylive: You need policy
arthurskylive: For that to work
Fredirecko: I think it would be smart to wait a couple more months and see how it pans out
droppinggems: so tinybox is about to raise prices due to tariffs?
djcodered__: By time they impeach him the US going to need to lick the boot of every country
hexadecimal58: do you think Trump will try to stay in power?
deepvision: another theory is that someone told trump he cant do tarifs. and when somebody says he cant
deepvision: KEKW
leikowo: got back, what's going to happen to the intel chips you got ?
arthurskylive: is bro back in the states?
UltraScientism: @hexadecimal58 he'll hopefully be too old for such pursuits by then.
Fredirecko: LUL
paradox109: Trump streams almost every day
paradox109: fun times
SteveOhBandito: The completely empty ship ports are wild. Not surprising, just crazy to see nothing there
Ire2k7: riding in my roflcopter
xSlye: big brain play, tariffs actually plummet the interest rate
gliched_robot: big balls are still there!
beetrium: the most ironic outcome is most likely?
jawnming: @georgehotz can you have a neovim ricing stream please LUL
Cinnabon2: some guy said "tariffguysayswhat" and he said what and here we are
rain_sd: When do you plan to have a chip?
roboboboto: missed it, you're not in hong kong anymore?
devroyalty: we good
Silensrunners: yea, let's do that Kappa
Fredirecko: Kappa
plamp555: i got a doctors appt
bellicjamm: sure omw Kappa
blur11111: I'm good bro thanks
nwerd_gamer: yes on it
beetrium: yea, nah no thanks
skarmorysavvy: stream homework...
lBdCompanyl: i wold love to do it if U could
leikowo: so we remove all the functions which called the graph rewrites you pushed into the list ?
devroyalty: devroySigh homework
droppinggems: so a tiny box is 100k to import to china?
lBdCompanyl: I could*
Cinnabon2: sintSus
Fredirecko: MrDestructoid
715209: Kappa
pressOk: whats the pay
GoldenSunGod: slop coding
zup_zup: How would you know 4Head
DarkAdepti: what are you eating??
malateman: by the time a 5090 can fit inside a comma 3 size, will you need bigger  gpus/models by then or nah? how big of a model needed for best driving assist?
Zeevo: @georgehotz whats the most exciting tech company for you right now?
rain_sd: SeemsGood
leikowo: did you merge this stream's stuff ?
ordoven: you can always just ask AI to make it less AI Kappa
715209: gpu over usb wtf?
benez1702: george hotz podcast when
rain_sd: George， When do you plan to have a chip?
malateman: yeah, i know about the usb work. that stuff is super cool
Temppus: is there a really plan to sell comma with consumer grade GPU in car ? like consumer installation suff ?
GoldenSunGod: perfect ai-driven getaway car
lawlster_1337: can use older nvidia cards? say a 980
malateman: there's already separate gpu enclosures for laptops. they don't look that bad. and cars have compartments
Ire2k7: 5090 on the dash, yeah u know i got a comma
Tyakos: man, now I will have to upgrade the GPU in my car as well as the PC
Temppus: I am very interested where would you put/mount this card
Thirsty4K: Be gone the days where people were investing in cramming everything into a Jetson + Lidar.
nuttyodin1: i understand your philosoohy in marketing, but i really wish comma went mainstream, it still annoys me when tech pundits endorse or predict something big for other self-driving car companies
aalhendi: pasta?
UltraScientism: locating a gpu enclosure in on your dash comfortably might be problematic.
arthurskylive: u in the usa?
nwerd_gamer: red lobsta
xuio1337: also getting enough power might be hard
Fredirecko: drive to the beach and get some more seaweed
malateman: food variety in USA best part of USA?
DDemen: im programming a computer vision project for my businnes with raspberry pi and cameras inspired by you, im dumb but i can see the potential
aalhendi: pizza and python is as poetic as it gets
benez1702: just make sure its kosher
waena_: is it samsung fold?
715209: thick or thin
Gameplayer0618: is that trailer park reference?
malateman: RIP samsung CEO. he should have ran harvard
Fredirecko: RIP
vox_bony: yes yes yes
arthurskylive: why are you not building it in china?
leikowo: some of the tests use rewrite_shapetracker_with_index
arthurskylive: i cheap shit?
arthurskylive: *want
DDemen: u can attach a google coral or similar to it?
leikowo: then they would use all the other rewriters right ?
Gameplayer0618: do you have experience with cops not liking the comma device in middle of the front window? I wanted to buy it for my dad but Europe laws..
pronto_letterbox: a mi me gusta la torta de chocolate
Fredirecko: @Gameplayer0618 Europe laws WutFace
dramatemple: Did he completely move to Hong Kong?
UltraScientism: @dramatemple he's back, I think
imkuee: europe laws are worth breaking
Ire2k7: whats ur stance on btc
Fredirecko: chats fault
inceptiondev: its our fault :(
Temppus: we take that :D
snorlaxcantfly: :(
nuttyodin1: distracted with tariff talk
m4l4r100: can you give us kisses?
pronto_letterbox: deepsek help
nwerd_gamer: gave my cousin :p gave my cousin :p
Gameplayer0618: @imkuee yeah, some Europe countries are super strict on this
m4l4r100: when is tinysearch coming?
leikowo: test_tensor still passes when replacing rewrite_shapetracker_with_index with the new stuff directly
0xmalvee_: is this 10k monitor
reathal: !tinygrad
UltraScientism: Do you ever think "It would have been nice if I decided to write tinygrad in something statically typed like Ocaml" ?
dramatemple: Ocami?
m4l4r100: grow it, light it, blaze it
inceptiondev: @UltraScientism 🚀🚀 yo bro did you ever think of rewriting it in rust 🚀🚀🚀🌙
leikowo: @inceptiondev the rust stream was kinda nice
nwerd_gamer: rewrite in holy c
urnebeani: Is he back in the usa ?
nwerd_gamer: holy grad
UltraScientism: @inceptiondev Rust is too onerous and inflexible. Ocaml on the other hand is almost like python in experienced hands.
Zerotobeahero: The gpu for noobs stream that was in rust, was good I think I even learned something.
jnpl95: Yeah was a fun stream
dramatemple: If you write it in Ocaml, it is not a open source anymore
leikowo: except that the gpu noob ocl program you wrote doesn't find the number of parallel execution units on NVIDIA GPUs because of the register dependencies you can run twice the max amount you should be able to
UltraScientism: There are ML frameworks in Rust though: Candle and Burn
m4l4r100: I want the old kanye back
Fredirecko: thinking
urnebeani: yes
Zerwih: everything is framework nowadays
nwerd_gamer: what do you think chat
rain_sd: when are you going to do chip panicBasket panicBasket
ShatZ_: I think we transition to some front end development
rain_sd: yes
nwerd_gamer: reach next js stream
nwerd_gamer: react
ShatZ_: lets get some creativity flowing
Zerwih: or c
Fredirecko: these comments are def ending the stream when he gets back LUL
probability_man: thoughts on the new TPU ?
rain_sd: um
arthurskylive: @Fredirecko was about to say lol
ShatZ_: No no george seems to be in a designing type of mood
dramatemple: @Fredirecko I was thinking that, too
leikowo: tinygrad being written in a language with less overhead would have meant less weird  tricks to make it reasonably fast (eg: fast enum metaclass ...)
arthurskylive: @leikowo dude
rain_sd: MrDestructoid
arthurskylive: yeah hes gonna end it bc of you
m4l4r100: @Fredirecko I have a strong feeling, that I made him upset
vox_bony: time chair
dramatemple: Isn't the font size is quite small for the stream, why no one was complaining xD
arthurskylive: everybody shut up
jnpl95: @leikowo Casey Muratori showed how many assembly instructions  you had to do with just a single add instruction in python vs c, its crazy, the amount of overhead
inceptiondev: @dramatemple just get glasses lol
Zeevo: pizza review
Coraxxi: looking solid
dramatemple: @inceptiondev Dude I am in the monitor xD
DDemen: yes
PlushMasta: niiiice
Thirsty4K: Nice crust.
Fredirecko: looks good
cursormover: mamma mia
NoticabelyFAT: is there good pizza in China?
vox_bony: Kreygasm Kreygasm Kreygasm
rain_sd: yes
nwerd_gamer: fyre
Zerotobeahero: yoo that pizza is fire
arthurskylive: 11 dollars?
ShatZ_: Everyone knows the rules, one bite
Fredirecko: la vita bella
m4l4r100: too much olives
Martinni39: has anyone taking up your 10k a day startup review service?
inceptiondev: @dramatemple just get a bigger monitor then so it fits more stuff
nwerd_gamer: should i drop out of college and only study tinygrad
rain_sd: OK
urnebeani: yes
UltraScientism: how much for Pizza in San Diego?
arthurskylive: nah
leikowo: college is useful if you actually study ...
Zerotobeahero: that is expensive
Zeevo: rate it out of 10
Fredirecko: that's actually less than i would have thought
pronto_letterbox: the pipsas
m4l4r100: whats one thing that you value on a good pizza?
rain_sd: OK
leikowo: wait how much is a pizza here ?
Coraxxi: amateur score, no decimals
jawnming: hi geo! im going to cmu next year and was wondering if you had any advice other than drop out. also, how would i go about studying tinygrad with a crap base in linear algebra
dramatemple: I listened George 5 years ago while he was praising NVIDIA, all in and bought stocks. Happy life
nwerd_gamer: okay okay i will attend tinygrad university
Fredirecko: Storytime
rivetingco: true
m4l4r100: you either do something or you dont. 1 or 0
Fredirecko: is "bus-getter-onners" an offical morgan freeman word?
Zeevo: people imagine their problems as really complicated so they have an excuse not to fix it
7Locrian7: i dont like the bus
allcliffs: get a car :D
posthubris: Speaking of the hood your hoodie is fire
internal_static_void_: TRUE
leikowo: do your thing basically
skarmorysavvy: bring a horse to water something something
thomas_the_tank_engine: I'm working on the x86 backend, do we want to add the location of uops and spill/fill uops in viz?
rivetingco: ive never asked for advice, ever
internal_static_void_: Shout out to the literal army of people "how do I do a c++" in programming streams. Just go do it bro
thomas_the_tank_engine: its locked to me
jnpl95: So 95% of therapy issues boil down to execution friction?
thomas_the_tank_engine: not really its almost done
thomas_the_tank_engine: yeah
sw4rtz13: are you still working on the mi300x? how is it going?
arthurskylive: is there a riscv backend
colonizethemoon: pizza looks spicy
thomas_the_tank_engine: spill uops are stores and fill uops are loads. they are added after reg alloc
rain_sd: eating pizzzzzzzzza
uloop: BTW am I misremembering or is the OpenCL backend gone?
Fredirecko: i recently read an article from vitalik buterin and he referenced tinygrad
Str8_Vicious_: @georgehotz do you have plans to continue the NOOB lessons or creating that university you talked about?
internal_static_void_: Are you the guy working on a hypervisor in python?
uloop: Ah great
internal_static_void_: Madlad
rivetingco: tinycorp makes tinygrad
dramatemple: What if one person actually would get on the bus because of you? Isn't that awesome
m4l4r100: how is the crust?
Zeevo: I propose that we follow the lead of tinygrad, and have an explicit max line of code target for the long-term Ethereum specification, with the goal of making Ethereum consensus-critical code close to as simple as Bitcoin.
internal_static_void_: @dramatemple Can lead a horse to water, can't make them drink
internal_static_void_: Same analogy
oldtimergamedev: that's a very cynical view
UltraScientism: being a bus getteronner or not is likely a question of neurophisiology
allcliffs: but that does not apply to young people, you can change their ways :)
smarttties: @georgehotz What is your take on using LLMs for daily work (C++ and graphics)? I've tried using them myself but the results have been underwhelming, and I often feel like I’m not learning anything when I use/rely on them.
internal_static_void_: Dude if people want to get into programming they're going to get into it and be interested on their own or they're going to sink or swim in their career
Agression113: yep, excuses
leikowo: do you regret python having this much overhead ? (like having to do tricks like FastEnum which isn't clean nor of any value outside python)
7Locrian7: whoops i said a bad word
NoticabelyFAT: yes
Zeevo: @georgehotz have you ever read psychocybernetics?
DIUS3R: you can change, for instance by changing your environment. once you see people getting on the bus, the likelihood of  you getting on that fcking bus increases
dramatemple: @smarttties LLMs sucks with graphics
leikowo: okay yeah. though It's just sad that any algorithmic improvements you make are nerfed by the lang
Marvfinator: damn that pizza looks nice
nwerd_gamer: if you get on the bus when everyone else is, you're just going to another hood
lithiumx4900: Python type leniency lets you write things that are readable while optimizing in C when needed.
bigswimofficial: bigswimofficial subscribed with Prime.
internal_static_void_: @DIUS3R Real talk I think programmers should've done a better job of gatekeeping software dev
leikowo: pizza eating stream is up there with the hotel California concert one
arthurskylive: ppl in here be doing tricks on it
sw4rtz13: is the bus driven by openpilot?
rivetingco: how much has programming changed in 50 years
internal_static_void_: Watching this stream while hungry is a mistake
exb3r: hi george, hope you enjoy this food, how are you?
iq_map: bon appetito
adrianlmm: for how much long are tarrifs on China sustanciable?
quebono100: Hey George is in da house. I hope you doing well
uloop: yellow bad, also true for chemistry
protolambda: are you a mukbang streamer now?
m4l4r100: your stream is really like meditation without music
SC0d3r: Hey George you are like Messi in coding
dramatemple: More like C7 merged with Messi
2sin54: @SC0d3r Messi of coding wouldn't need to use LLM for advent of code
waena_: i wonder how many kcal in that
quebono100: Are you doing vibe coding :D
benez1702: did you see roy lee is hiring 50 interns in his new startup
sw4rtz13: too much freedom for today
leikowo: a single vibe coding query here would probably break half the tests ..
leikowo: what's math trait ?
leikowo: what does the UPat compiler do ? I remember how UPat were used with PM in the past but didn't see the compiler
leikowo: so you just exec it at the end ??
lovefoolish7: marketing
lovefoolish7: Look at mojo - the only thing that thing has going for it is Chris's name on it
mitchentv: Approach big hardware developers
NoticabelyFAT: build a cool library on top of it
CaffeinatedEdible: tru
CaffeinatedEdible: but my mba dad said so /s
lovefoolish7: chat suggesting to rebrand tinygrad into a b2b saas product
mitchentv: Fair enough. I don't know much about what you do but it fascinates me. Sorry.
zup_zup: rip cruise
UltraScientism: be faster, dominate benchmarks? Compile faster?
xardas_: dominate papers ?
uloop: TBH I am mostly interested in using it for non-ML purposes, as an abstraction layer for whatever parallel hardware is out there in the world
lovefoolish7: anything is faster than xla compile
TandeBoy: what are you most proud of with Tinygrad?
lovefoolish7: the problem with being faster than the speed of light is that you need to live in darkness
Fredirecko: white board time
lovefoolish7: special relativity still applies to sound waves
Gameplayer0618: cuz the vibration thru plane yeah
Joooooooooonas: Intake also
NoticabelyFAT: air stationary in plane. speed of sound faster in solid
arthurskylive: it wasnt loud inside
niteowl066: Isn't the sound mostly from air friction?
mitchentv: George are you back living in the USA now?
Fredirecko: i never been in a super sonic jet
IceLeo: The second you land it just catches up to you and then you go deaf Kappa
gliched_robot: you can just go higher.
lovefoolish7: no love for gemini
arthurskylive: the air sinside is stationary and the hull does propragate vibrations
uloop: I dont think so
arthurskylive: noise cancelling
gliched_robot: 787 dreamliner is good.
mitchentv: George are you back living usa now?
UltraScientism: metal frame also has speed of sound and it's very high
volteras: pleb chat :O
Fredirecko: you didn't zoom back in
rain_sd: ert
CaffeinatedEdible: is this the $200/month chatgbt?
teyeooe1: 200 dollas
wilsden: worth every penny
JosephKarroum17: Not in HK anymore?
Fredirecko: you'd have to be old or air force
teyeooe1: o lord
modalessi: bro, lets make our own country
arthurskylive: that what you did to me a few years ago
Fredirecko: accelerationists like sonic booms
DIAManti_1: im in im in
nuttyodin1: NGU party
rivetingco: the ++ party
nwerd_gamer: NGU RISE UP
rain_sd: yes
teyeooe1: same as fake money
teyeooe1: fake numbers
koliath21: yo
protolambda: inb4 goodharts law
kklisura: Is there a such thing as event horizon but for sound?
ALLcompressed: make numbers go up again
arthurskylive: https://www.godaddy.com/forsale/shutitdown.us?utm_source=TDFS_BINNS&utm_medium=parkedpages&utm_campaign=x_corp_tdfs-binns_base&traffic_type=TDFS_BINNS&traffic_id=binns&
CaffeinatedEdible: MAKE THE DEBT GO UP!
Tsoding: Should we make the number of numbers go up?
Fredirecko: @CaffeinatedEdible LUL
modalessi: I am in (not american)
script_sh: like the Cybernetic Culture Research Unit
script_sh: ?
Fredirecko: its been 100 days
rivetingco: if u had a country and u knew ud compete in war against another country, are u confident ud be able to outcompete them?
Toxicosmos: negative up LUL
Fredirecko: and busgetteronners
mafio1: where are you?
nuttyodin1: you have my vote
modalessi: i told you i am in
script_sh: voting in any case, makes a number go up
TaterPancky: whats the endgame for NGU
niekas: as long as it's my favorite numbers
modalessi: but i am not american
fullyro: do you believe in Europe tech sovereignty (means standing without US/China tech supremacy)?
arthurskylive: me
UltraScientism: I'm against number go up party. I don't want to live in an overpopulated artificial shithole without wild nature.
rain_sd: me
Gameplayer0618: who picks the number up numbers tho?
iq_map: if i get free pizza, i vote for you
PerkGuacamole: Depends on the numbers. I need BIG numbers.
CaffeinatedEdible: we want the homeless population to go up!
rottenpeacock: you got my vote if u pump up deep space tech funding
modalessi: numbers going up is always good, right ?
Fredirecko: number of trees go up
arthurskylive: i like european anti accelerationism
nwerd_gamer: make homeless rich again
Fredirecko: tree height go up
nuttyodin1: i think we need to build cheif bot first though, then you definately have my vote, next, AI GF
CaffeinatedEdible: okay, you sold me, I  AM IN
bitwaltz: brain farts go up
modalessi: number of buildings ? i want cyberpunk cities
niteowl066: Who decides which numbers should go up?
CaffeinatedEdible: number of billionares?
modalessi: lets gooo
rottenpeacock: lifespan go up
nuttyodin1: Give us AI GF
script_sh: manifesto of numbers that need to go up
zup_zup: good number go up, bad numbers go down duhhhh
roger_gasmas: what about inflation, up?
iq_map: deportations go up too?
CaffeinatedEdible: colleger tution, WAY UP
modalessi: number of girlfriends ?
lnau: tinygrad line count number go up?
rottenpeacock: main priority is pumping energy numbers up
lucyinthesky__: cheapETH go up
nuttyodin1: Give us AI chef bots
arthurskylive: whats the point of going up
antiCommun1st: What if tarrifs force manufacuring into the US and numbers go brrrr?
script_sh: energy efficiency
rivetingco: voting sucks ass, a skilled dictator beats voting all day
arthurskylive: i am european
modalessi: number of deportations going up is a result of bad border policy
9to5aintlife: are KPIs good now?
dopixelsexist: negative traffic accidents go up
roger_gasmas: number of states?
PerkGuacamole: How about the number of numbers? Should go up?
drtinybloom: E/acc to go up to see something more intelligent than us rules
iq_map: europoor will never understand
dontbeameme: either way like he said other countries wayyy ahead manufacturing
nwerd_gamer: im all the way upp
Toxicosmos: what goes up...
teyeooe1: sadge
drtinybloom: See how grok is a leftist
dontbeameme: nobody is running for America made products
protolambda: eu laws going up...
therollerblader: what is tinygrad i cant understand
antiCommun1st: The EU is a suicide. cult.
Tsoding: Ima go eat something. Make my number of pounds go up.
arthurskylive: did you not like europe when you visited?
fullyro: you guys are just good sellers
rivetingco: freedom is a scam, china is beating the fuck outta everyone
xardas_: Are you still doing the Hutter Prize ? :D
iq_map: @antiCommun1st i hate liberals so much its unreal
mafio1: Im from Portugal :d
mafio1: true
arthurskylive: portugal peaked 30 years ago
niteowl066: based Poland
kill53597: me too xd and you are right
nuttyodin1: go on joe rogan
zup_zup: portugal is a vacation place for the nordics
script_sh: ramp up Portugal
mafio1: you're not wrong
arthurskylive: im just trolling btw
Fredirecko: portugal has good sardines
Luccardi: Any Dutchies?
antiCommun1st: It's hard to beat slave labour.
thomas_the_tank_engine: portugal peaked 500 years ago
volteras: what about scandinavia ?
meta_eigen: Trump just said Biden is the worst thing that has happened to old people hahaha
dontbeameme: geo the realist
rottenpeacock: man, I just want India to follow dis principles. we going into authoritarian communism atp
mafio1: at least we have good internet, I can work
dontbeameme: he got no side he just go with the real
tbullshit: poland is great
rivetingco: yk that if u were to go on rogan and just talk about all kinds of shit it go crazy LUL
dontbeameme: 2 + 2 =4
Fredirecko: 4 +4 = 8
antiCommun1st: @dontbeameme BIGOT
bitwaltz: where in Asia do you chill?
akashtyo: hauwei ai chip is all it takes
modalessi: 2 + 2 = 5, big bro told me
iq_map: @antiCommun1st proof? what does LE REDDITD SCIENCE say?
arthurskylive: when I was in portugal I was shocked how little construction was going on
Luccardi: So are you running?
dontbeameme: people only do when forced
arthurskylive: none
uloop: speed of light go up
dontbeameme: expecting good to just happen is fairy tale
PlushMasta: there will be no more election in the Kingdom of Trump's Familly
synbleed: Intel is buying AI startups mostly Asian  to tackle nvidia dominance
dontbeameme: exactly geo gets it
nuttyodin1: wage your memetic war by going on to joe rogan
grizvok: terrance howard says 1x1 = 2...bro was on to something
antiCommun1st: Remember that little incident where the US released a global bioweapon and sold us to big pharma under police enforcement?
rivetingco: there are many people who dont wanna vote , they just wanna be told where to go, and they’ll follow, one skilled ruler conquers everything
dontbeameme: it’s not nobody is proud of there country it’s just a culture thing
Luccardi: First time the Chinese have large numbers...
gilga_m: Can't wait for China AI chips, they will be so cheap
PlushMasta: there will be no more election in the Kingdom of Trump's Familly mr @georgehotz sadface
rottenpeacock: do u think passport hording to good in case west fails
wilsden: i support this message
TentuTesla: A quick website or tutorial recomandation to learn python as a new programmer ?
dontbeameme: culturally when your country is washed up it is what it is
iq_map: vote george!
drtinybloom: lol NGU is so a neo trump way to put it... like this is being said by one of the most intellegent man in the planet, what a strange time bubble we live in... I'm with you tho
nwerd_gamer: NGU 2028
AndreB8: 1e99 + 20 = 1e99
rottenpeacock: LETSGO
Linux_____: yea I would vote for Hotz
jnpl95: Grok's only argument against is Resource Depletion
ordoven: you're pulling a kanye west with that one haha
all right we
back all right our Cloud device doesn't
have an allocator so I'm going to have
to implement an
allocator
um L are you allocator do we need
that I think just normal allocator is
fine
call a cloud
allocator everything's fast in Hong
Kong oh I don't think I'm muted no I
don't think
so I'm
not can you hear
me any subscribers who can hear me
what the nonsubscribers tell me
nonsubscribers am I
muted no not you I don't believe you
you have a pebcak
bro not muted there we go you can hear
me thank
you yes you are muted sound is fine okay
well you guys have PEB
gacks that's why you're not subscribers
you're worst people all right let's take
my shoes off cuz we're taking shoes off
check out my shoes I got some new shoes
got Nikes because I heard they had
technology and I support the use of
child labor and shoe
manufacturer you know you got to think
everyone's always talking about all the
people they lose but what about all the
people they
gain uh
okay so the cloud devices
let's to do don't uh hard code
now what do we want our device to
be Cloud compiler is kind of uh but I
guess we kind of have to because
compiler some compilers need the
device which is
lame it it's lame that compilers need
the
device um not all of them do but the
metal one does
like okay think of cloud as just as
multiprocess right so um the
cloud device is a
process boundary
between uh the runtime and
the front
end so we're doing it at the kernels
let's let's take a look at compiled here
so you guys can see um we need a device
we need an
allocator A renderer A
compiler in a run
time I really don't like that the I mean
the render kind of has to come from the
uh so like here it is in metal so now
the metal renderer is fine let's
just uh to do don't hard code
metal so we can totally just put the
metal renderer in
here uh the renderers would actually
generates the the code so that doesn't
depend on the device but unfortunately
the compiler does depend on the
device um actually I can instantiate it
so it doesn't maybe we'll just do that
and then we'll work on trying to make
that faster
so the render and the compiler are just
passed
through go look at our
compiled
uh runtime and graph okay so we don't
have a cloud compiler that's not real
but we do have a cloud runtime
s a text
let's just hardcode metal for now
um and then okay metal program so that
needs to be Cloud program
and we can also probably write something
pretty quickly as a cloud
graph CL device
annotations so we're going to need an
allocator and a program because these
things because allocators and programs
actually exist on the Remote device
where's the renderer and the
compiler um run the
renderer compiler
on uh the front
end right because this Cloud device will
be created in the front end and then we
can figure out what the back end
actually
is uh so let's just create a
quick thing called back end here I'm
going to need multiprocessing
dot so I think some of this is already
written in a tiny graad PR and we can
see how most par did it see if we can
find this
I don't know how I'm going to find
this
no all just
code okay uh multiprocessing process
Target equals backend
P
start all right the back end is going to
basically be a run
loop we're going to want to bind to a
port uh should we use
HTTP kind of tempted to use
HTTP any downside to http
like I could make like a custom
uh I can make like a custom
thing I don't know I mean I kind of like
the idea of just
sttp but what's the downside okay so
HTTP is going to have a small amount of
overhead um it's not going to have
persistent
connections there's definitely ways to
do HTTP with persistent connections
to but these things should be relatively
rare
anyway so I'm not so sure it needs
persistent connections and I think that
just becomes a pain to deal with okay so
we're just going to write an HTP over
here um does everyone kind of understand
what this
is let's let's let nonsubscribers can
you stay on topic and answer do you
actually understand what this is or not
because this is supposed to be
accessible
right so right now tiny grad exists in a
single process and that process has both
the front end and the
runtime
um okay good thank you thank you could
could could you explain it to the the
other people because you know we want
people to follow along with these dreams
uh like normally tiny grad exists in a
single process and that process is both
talking to the hardware so um okay let's
write some docs uh
the cloud equals 1 device is a bound
process boundary between the frontend
and run
normally tiny grab is front
end
middleware uh runtime
Hardware with Cloud tiny grad is
frontend
middleware
HTTP uh
run
time
Hardware time
middleware Cloud
device uh shouldn't really just call
this back end just call this uh Cloud
Server
Cloud
Server does that make more sense to
people this and client
and server can be on the
same
machine same network or just same
internet uh it should be a
secure no use of
pickle uh boundary
okay so I'm just going to copy from viz
here
about uh let's
say cloud
[Music]
handler do
get
base I'm just using HTTP
um HTTP is
used or RPC
right so you can get into like you want
to start using custom RPC protocols you
can but like who wants to deal with any
of that so we're not going to do
that um HTTP is
simple uh server. Ser forever okay just
have to create This
Server HTP server
okay uh now let's handle
G front end
uh get him uh
so actually going to
need it's actually already passed
anywh does the metal allocator have a
metal device it
does we're going need to use this fun
tools partial trick
so why you want grpc I don't really want
grpc sounds
complex comes hard to reason about right
I want like a rest like
API you can always change the RPC to
something else it's not a big deal but
it's just easy to think about an HTTP
server and if you start with something
simple and then don't don't prematurely
uh do
performance right you shouldn't
prematurely optimize shit very cool uh
okay so for cloud program we actually
also want to import metal allocator and
uh metal
program
um you know what we'll like be specific
and we'll put these in the back end
oh
great okay um
we're going to need to
actually it's going to be a post
request how do I simply make a post
request from python could import URL Li
okay that seems
reasonable um so when we Implement an
allocator what do we need to
implement we have an Alec
function
uh have to return a buffer there do
I could return just a number all right
so just be
an fre we don't even need to do freeing
for
now uh we don't need to do
transfer I think we need to do copy in
and copy out that seems right
okay so copy out we'll just why am I
doing this in program an allocator copy
out's probably the
easiest uh I should just be able to say
I can use fetch
right I shouldn't use fetch
okay URL live request URL
open
uh it's actually doesn't have to be self
device I think I can just pass a host in
here but I guess there's no harm in the
device
um
[Music]
buffer uh source
okay so that'll be a get
[Music]
request
uh r.
read turn r. yeah we want a d equals r.
read okay
cool uh now if we want to do a post
request that time now um we have have
data and I don't want to I don't want to
make unneeded
copies data equals Source I'm not so
sure that's going to
work uh oh we should just be asserting
that the status is 200 that's all we
actually have to do in there okay cool
does that API make sense to
people
um now we have one called uh Alec
size uh it has to be a
post uh
data your your
code
um we should probably Jon I mean what if
I just put a dictionary in there
uh turn into our.
read okay it seems simple
enough
um this should be this should you should
be able to follow along with this you
know you you should have to be a you
don't have to be a very good programmer
to follow along with
this I understand that the stuff on
Monday stream was way less accessible
because you have to have a lot of weird
um
you know tiny grad
understanding but uh all right should we
do programs by name or should we give
them unique
uh should we give them offers should we
give them uh identifiers
I almost want that to just be the hash
of the program
let's just use the
hash this new just copy what I do there
up to high hash
I think that stuff works in Jon I'm 100%
sure about that
okay now we also have to actually be
able to run the
program so we have call here with this
wow that's a long signature
still has to be post because it side
effects you guys know the rule something
has side effects it's post otherwise
it's uh get so running the program has
side
effects um
okay
so for box I see I'm thinking in
Jon
um we want to get the
uh actually those buffers should already
be
integers should just be able to do that
Global size Global size loal size local
size vales vales
uh yeah we can send weight as
well wait wait
um this can return a
float if
weight okay
cool that should be a complete
uh ability to run on cloud
devices well Cloud only work with single
GPU well know it to work with multi GPU
and we'll get how to do
that
um we'll get to how to do that right so
I could probably you could change the
host uh you could either run it on
different ports right so it would be
multiple devices
right so right now it's it's only one
Cloud device but you could have Cloud
basically col in uh the
hosts we'll get to how to do that I I
think you want to have one process I
think if you're using Cloud you only
ever have one process one backend
process for each uh
device
so I think that's okay you might run
into annoyances with like how to
transfer things okay um URL unknown
type Local Host I'm a lamb type
guy know URI type what is that even what
host
is oh did I actually have something said
in host
oh wow I actually said something in host
okay that's really
dumb
uh okay this this can all
change okay URL open no host given cloud
with
host h
GTP okay connection refused that's
better oh
retrying shit sucks
write some helper functions for that
connection
refused yeah okay uh
can Alias it
maybe um
I don't
respond did ATT the port the same I did
okay why does that not
work oh it's cuz it's
404 200
Cloud device has no attribute
device okay cool Works uh what
remote and closed connection without
response but don't you see me
responding without
response is that's
zero he said response was a 200
oh to end
headers cool all right cannot can cat
string to bites well that's a more
reasonable
error okay first time chat you're the
reason we're going subscriber only
you're trying to derail the conversation
is this a train yes and we'd rather not
be derailed
uh okay so where what am I doing here
cannot can cat string to
bites um open URL which can either be a
string containing ably Val URL data must
be an object
request uh Curr requests are the type
support types include byes files like
objects and iterative okay fine um let's
create just a function called
uh create on
the'll create on the cloud device
here send
self
uh
J jumps
that seem right
do we just need to Hash the lib or
should we hash the name too there some
Purity about just hashing the lib let
just do that
so Bor
okay cool
uh why didn't I write this first bad
abstraction bad abstraction
oh what do I still have that crap there
I don't need
that copy
in buffer Das data
equals fight source
okay copy
out T equals self. device. send
offer without us so that should become a
get
request that's a lot nicer I don't want
to waste all those stupid
lines uh sub device that do that return
okay cool looks better
uh get
ping that's
fast something going wrong why is that
not
sleeping what
okay I don't
understand that looks like it
works until it doesn't
what oh did I get rid of the break oh
that was stupid you got to be watching
out for that
stuff Tim
out let's make the really
short Cloud device. send got an
unexpected keyword argument data
yeah I don't know okay you know what
maybe we want to put the Json somewhere
else they don't all use
Json um
I have an
idea I have a radical
idea a radical idea are you ready to see
how radical this idea is going to be
let's go okay
let's make the
program the
program slash
name
slash this there we go
go right now let's do
that yeah we're getting crazy now yeah
we getting crazy
now
um why I just instead of program there
idea
cool time out is not
defined
[Music]
oh looks
good okay so if I send that dump the
RS cool um
all post data should be bytes it cannot
be type string which one's giving me
type string Json dumps returns a string
that's disgusting
okay unsupported method post this
because we got to handle do Post let's
hope it's do
Post just do the same
CRA invalid literal for base 10
uh oh I see that's
reasonable
okay um
if self. path equals equals
[Music]
Al okay how do we read the
input r
I
read okay and then what we're going to
want to do here is we're going to wanted
to
say um
in
normal like a net get called here
okay so no and it doesn't get called
what takes one positional argument
before we're given
fine you happy
now um missing device okay that's
fine should be
fine okay we actually want to allocate
we want self dev. allocator
doall
great for
time
out timed out
my allocator is timing
out why is my allocator timing
out just take that long to initialize
the metal device or something else wrong
this is
wrong uh oh just get Json wrong
oh I have to get the content
length Okay
cool all right looks like allocates
working
uh it's like an extreme amount of
probably don't
need okay so we're trying to post buffer
one which is trying to write to the
buffer so if self path starts with
you're like George why don't use like
libraries to do this because libraries
abstract so much shit away from
you um but then why do you use HTTP you
want you just use a hand coded thing
because HTTP is pretty nice and pretty
standard um um if you want to speak
Please
Subscribe uh how many viewers we got and
who's following along are you following
along um okay if we're posting to the
buffer then we want to
self.
buffers so how do you Parts this
here
par kernel equals
par Q is that a like
that query
string yeah we're building tiny
Cloud okay um buffer
like it's going to be the basic idea of
the cloud so we can also like abstract
different things to the cloud but this
is also how tiny grad is going to do
multi uh multimachine training like with
some with some variant of
this okay so uh this is going to be a
dict from
ins to uh
um I don't just say
any okay yeah any's fine actually
because we actually want this to be
um
self
s.d. cater
uh
subbu do
it's not copy in it's copy
in uh to buff from self. data okay there
we go should work for
that
uh okay key error
one why is there a key you didn't you
okay
what
oh okay I don't think this is what I
want it to
be um
all right
URL can't contain control
characters that's a sensible view but
you know did you remember that you're a
bitch you know go always gota always
take that into consideration people
taking that into consideration these
days okay good
um access local variable R where it's
not assigned of
value uh yeah let's chill let's chill
you look me in my eyes tell me that
you're happy
now for
um what do I want program this is
program
right run time my
bad uh
name and then we have the same sort of
thing here
oh actually no this can be a little bit
different that can be a
string uh
because they can actually just have
unique
IDs okay
timed
out C back to this
crap okay four four so now we're having
a problem with exact so we're going to
need exact that's f
hopefully I should just be able to do
this do get Jon put two stars in front
of that and call it a
die all right oh gun unexpected keyword
argument Buffs
um yeah I get it
fin I'll spell it
out oh actually that's not even going to
work I'm going to have to I have to fix
the buffers um
that's
Buffs overal size local size vales
weight
cool list has no attribute
buff oh okay so those actually aren
uh that should be alocated I don't
understand
that uh list object has has no attribute
buff metal buffer metal buffer metal
buffer
what and that should splat them
shouldn't be a list I don't understand
that
oh do I have to do name
here I probably have to do name yeah
that's
right URL can't control
characters
uh what is this trying to do
copy out buffer
D yeah why am I sending D that's
stupid uh we want to send
Source L value and R value have
different
structures okay
yeah I don't think I wrote that one oh
we got to write that one okay
oh this doesn't support as
buffer it should support as buffer it
sucks that it
doesn't uh
you don't have to support as buffer to
be an
allocator metal one supp so that's kind
of fine
oh same different structure crap
uh right
return
memory different structures what why
don't you tell me the structure
oh
oops guys got to catch my Stakes who's
paying
attention sweet okay that
passes uh doesn't exit what I got to do
here that going to make an exit
see if I have anything to typing
mistakes whole bunch of typing
mistakes syntax error and type
annotation uh yeah it's not
right argument one to in has unexpected
type
oh
what
oh h
all right allocator has no attribute as
buffer
um yeah
again I'm just going to add that
allocator what allocators don't support
that should I support a generic version
of it I think I probably should
but it doesn't always implement the
length which is
annoying don't use as for WR WR version
of
it um
okay
bites uh
inch wait really how do I get the length
of the
buffer I can't know
that oh that's really that's kind of a
bug um
like buffer should really track their
own
size no overlight of set memory item
what
in compatible typeing assignments here
oh L
of allocator has no attribute size
buffer no overload variant of set item
of memory View
oh that shouldn't be string should
I yeah it's not
string
bites so fix
that okay different issue on
90 B ABC
all right we're left with only this one
and we can ignore that one for now
well you know what I don't even really
need to do that I'll actually do is
this I don't know if that works
actually whatever I don't I don't want
to mess with deep tiny gra now
whatever okay so does everyone
understand what it
does now using existing tiny guard graph
abstractions this should actually be
pretty easy to make fast
so so what if we do something like Cloud
equals
1 oh let's also confirm it works with
debok
yeah does that stuff make sense to
people I should be
accessible Alec buffer Alec right to the
buffer um
actually OCC curs to me we could make
that a single call no we can't that's
not how the abstraction
Works
cool so we make the program we allocate
the return buffer we do the exact and
then we get that
buffer now I just want you to imagine
this but connecting to a 4090 from your
Mac it's going to take a little bit of
work still but all right let's see if we
can train beautiful lest
look pretty
good I love tiny
grad what other what
other what other Library what other
library has abstractions that are so
good that in an hour and a half you can
basically one shot
a process
isolation come on you
guys um and then we can use the graph
abstraction to register a graph such
that you don't act such that it can do
like jit graph
execution oh thank you thank you for
subscribing
like we just one shot at that and this
will work for anything
now many
lines um 10,000 is actually the max
lines for tiny CRA we get to 10,000 no
more joking around no more no more
changing the line limit look we have
actually wrote code that worked on
stream
today how
cool um should we try to make the graph
abstraction work
also don't know why the other one of
this was so
difficult I remember there being like
weirdness and the other one not working
that well maybe our abstraction just wer
as tight back
then I make tight
abstractions uh so yeah this is how
we're going to do connections to other
gpus and you're like oh but you have to
make all these post
requests
well
um yeah like right now if you try to do
this across the cloud you'll get hit
with
latency let me uh
let me add some quick process separation
here let's try something like Local Host
4343 okay so it's refused uh so let's do
get
him port
for
we do CIS
arv all right prove to you that it's
actually
uh you know a separate process you don't
restart the process there we go
we don't need this with debug equals 2
so debug equals 2 is what's giving us
all those uh times but we can get rid of
Deb equals
2 little excessive
all right so you see it's a little bit
slower oh we also have to implement
free
um yeah so right now everything's just G
to live over here in this process
but okay
so this stuff's effectively going to
become a service the renderer and the
compiler um it's only sort of for
historical reasons that they're even
separate uh and we have to change the
idea of
Ops because they're going to work
anywhere how we doing on
viewers 600 all right cool we're getting
back to where we used to be
it's pretty good let N subscribers chat
to the bathroom and then we can think
about what we're doing
next we should do graph we should do
graph just for
completeness show you guys what graph
looks
like we'll make sure we got those
extractions good
Good's Terry
Davis I
mean the difference between uh you know
like yeah you can you can talk about how
tiny grad has some Temple Vibes right
like everyone building an operating
system is going to have some Temple
Vibes um the problem with
temple is
that it didn't as far as I know provide
any business
value um I mean tiny grad's being used
by comma uh tiny grads being used by
Exo
uh an increasing number of people are
using tiny grad to
improve their business uh it's creating
value um so yeah I mean I think that's
kind of the the difference
uh Temple ISR it's it's certainly
something um you know I think of tiny
guard kind of as an art project too uh
you know we're not we're not all me and
Terry Davis ain't all that
different I heard he was a streamer
uh but does everyone understand what
this
is can can someone explain it to the
nonsubscribers if they don't get
it no you are a
noob another
llm want to see if we can run l I'm sure
we can run llama across that
too
uh I don't even know what it's going to
do if we try to beam
search what happens if I try to beam
search
beam searches across the
boundary oh the compiler is going to be
slower than usual too that is opening
the metal device though I don't really
want it to open the metal
device why is it opening the metal
device oh we have to to implement free
as
well we should have better
tests okay we get back we'll Implement
free
e
e e
programming for slop
through who that Ro is too
sloped
uh yeah so the Cloud's not actually
going to be $60 a month all you can use
on a 4090 unfortunately the economics
that don't work out we're going to
charge people we're going to build
people per
second so like basically if you don't
have a 4090 in your
computer um you're going to be able to
uh like this is going to be running in
the cloud okay we can actually you know
what you want to actually run it across
the cloud we'll make it work on the
cloud let me make free work and then
we'll we'll make this work on the
cloud um it's going going to take a
little bit of work to actually do that
though cuz we're going to have to put
the um the renderer and the compiler
yeah it's good it's good stuff to do
anyway yeah okay let's actually let's do
this properly and let's get to the end
of the stream where we are running the
compute on a tiny
box
um cool I know how to do this
uh we should probably
actually yeah let's let me write a cloud
render and a cloud compiler why are they
even separate they kind of shouldn't
be um which one's required I know
they're not both
required okay well first let's WR free
even if we don't have to use free I
don't know when this thing actually
calls free
but we do should support it just for
completeness uh allocator where's
allocator for
see if free of gets
called three missing
one positional argument
options
what
oh size is passed in there but not there
okay whatever
uh data I mean I want it to be a post
request is the
problem if things have side effects they
should have post they should be post
requests it's just
that okay cool so it is calling free
it's just not
found um we do have a little problem
where we're going to want to like track
sessions and
uh okay get me the
buffer
um I'm going to track the size in here
is
uh oh connection refuse because it's
shutting
down that's okay I
think start it up here
four
what shouldn't be that oh starts
both I should probably like write some
better infrastructure to deal with this
and like helpers and we should share
with
VZ uh okay 404
what why you give me 404
bro 44 me
bro oh is it a g is that the
problem no it's a post oh here Tuple has
no attribute
buff oh here because the problem is in
as
[Music]
as here I'm not
uh okay so let's say
bytes subside
self D allocator copy
out
imp sources
buff oh red equals
that should just work
right does not support item
assignment
what oh
uh canot modify read only memory
why is that read only
memory oh because it's a Memory
view I hate this this is like this is a
terrible part of
python what's the right way to do
this it's not memory View
if I want to convert bytes to a
uh how does how does uh
Mal
allocator from
MV not
right cannot modify read why is this
only memory
oh it's
Bay all we go it's working again cool
and now we're getting
free you see all the calls are free so
that's good uh when I do same host what
do I
get oh that's all working too cool
we're
free like they'll have to be like a
forceable free if you uh
disconnect so now this is all well and
good because we're not going across a uh
this is all well and good because we're
not actually going across a
boundary
um
okay the
[Music]
render can the render or on locally
I don't love
that okay let's look at the input to a
renderer has a function called
render it's a name and a list of
uops yeah by the time you've gotten to a
list of uops
there's no reason I can't run like Cuda
renderer
I can just I can just put in cter Ender
here right it's not actually going to
work
but okay missing uh I need to flag
Arch it's a different
problem see if anyone's on my favorite
tiny4 CH is using all the boxes to
prepare for uh ml perf so I'm not sure
we're going to find a free Tiny
Box Chang doing something on there
there we go tiny
12 tiny 12 is free and it's in
video the AMD render need to be
constructed with a uh
no it doesn't okay good but you can see
that the
uh the compiler is failing with all
sorts of weird
errors okay
um we're going to want to write a quick
Cloud compiler
do we even need to do any
uh fancy stuff I mean a compiler is very
straightforward it just takes in a
string
just need to implement one function
called
compile cach can be down on the the
other end
so how about
just soft device. send
compile source. en code oh is this going
to be this this going to be this
easy get the signature
right uh does compiler have a n it does
we're going to have to call Super here
should actually be calling super on all
of
these all right let's go back to using
the the metal
renderer we'll keep doing the rendering
on the
uh on this side but what's it bitching
to me about okay Cloud compile doesn't
work um I wish it was a g because it is
a g it's not actually a
post uh but I can't send the data if we
do a g
it's not
modifying almost want to create a buffer
and then call compile on the
buffer I don't know but that's just kind
of
ridiculous compile
turn
Okay R
equals handler. d.
compiler
uh do compile
cached uh self.
data it's actually that
simple work
okay uh B oh
uh.
decode cool
yeah there's no real way to the programs
are too big to put them in a
uh start our Ops
Cloud
cool all right
now let's cross the process
boundary uh this should not be metal
device for
um
do that
require
interesting
uh have to set the name
can I just do
this
cool all so let's try some I'm crazy
what if I say CL equals one
there well i' started with metal device
but now what if I say host equals Local
Host 4443
underlying buffer is not
writable oh
[Music]
yeah shouldn't have to be writable but
okay it's CU we're still using the metal
render
uh don't need that
anymore for
there needs to be a better way to do
this
for
uh static
method can something be a static method
and a property
we can definitely do this it's just long
for for
I mean that's just
annoying cuz it has a different API for
the
Global size local
size what is clangs actually look like
that was wait okay fine
work cool
all right so now we can use it as
clang uh we have the
compiler it's a little bit of copy paste
that
garbage it's fine I guess
so it gets the Dame okay cool
all right you guys ready for the first
the world's first live stream without
any placeholders what I do yeah
that uh incompatible type B want to do
memory
view
God make stupid copies when stupid
prizes
I'm actually going to go further with
this
get Cloud
metal
so I can do things
like
uh that
but I can also say cloud Dev equals
clang great notice how the programs have
hashes because one is clang and one
isn't
so we're over here on Tiny Box tiny 12
uh tiny 12 has
AMD uh
gpus who doesn't put my t-o comp on
computers
syntax
error I get the raw
one okay there we go
all right let's run the cloud R
time okay uh oh
um what is that something like
this use the devil's number
great uh host equals uh Local Host so I
did SSH forwarding
but eventually I mean that can just
be yo yo we're going all the way back to
America for that shit boys we're going
all the way back to America hitting up a
tiny box just to add two plus
two
yeah all right you get what we're doing
now we're running we're running on this
Tiny
Box should we try and see if we can
train
amnest two is
fine to do a little something about the
latency
but
whoa this is training an mest model on a
tiny box in
America is everyone starting to get what
cloud equals one is just imagine that
but
okay all right you all gota youall gotta
youall gotta Vibe with me in Imagine you
know imagine that oh oh
well did AMD
crash I think we might have timed some
stuff
out oh let's Jack the timeout out five
seconds
what time zone is this office we're in
Hong Kong we're in Hong Kong because
we're joining the Chinese Empire cuz
America is over I don't know if you
didn't get the memo but the American
Empire was over and it was built by uh
white men who were evil I I read a thing
about how the founding fathers were evil
uh and they were the villains of the of
the America uh why is that timing
out no don't time out stop
it stop it stop
it um they were straight white men and
they were evil and that America was
built on Stolen
land um so yeah you know I don't want to
I don't want to live in a country
country uh built on on Stolen
land uh so you know I'm going to move to
a country that's not built on Stolen
land right here in the Chinese
Empire I'm obviously being sarcastic
it's dumb as
fuck I'm in the Hong Kong special
administrative region of the People's
Republic of
China oh yeah see look that's what took
a long
time okay yeah we'll have to we'll have
to fix that timeout shit see because you
can see that took seven seconds we had
to we had to upload uh we uploaded 47
megabytes so we are going to have to do
some stuff to make some stuff
faster
um I know I've got a point America was
built on Stolen land and that's why the
Empire Must Fall um
yeah no know like the people who believe
this stuff I I don't know what what do
you do about
them like what what do you do if
you like I don't know like give him a
boat and a gun with one
bullet you go go start your own
Empire yeah
it's I see this I see this kind of stuff
and I'm like how how how stupid are you
how how stupid how stupid is anybody to
believe that like all all I'm basically
hearing when I see somebody say that and
like I'm genuinely sorry and I wonder
how related this is to like the mental
health issues it's like like you want to
die like like when I see somebody say
that my country was built on Stolen land
all I've heard is that I am in pain and
I want to die and like I'm really sorry
you feel that way but like you know I
don't feel that way and a lot of other
people don't feel that way so like you
know maybe you should step aside and
make room for other people who don't
feel that way and who want to build a
nice fucking Empire that goes to the
fucking Moon and
shit all
right um so we are training an model
right now in the
cloud uh this is the first ever AMD we
you know how Russ hanaman put radio on
the internet we're putting gpus on the
internet I know a lot of people have put
gpus on the internet before but I'm sure
a lot of people put radio on the
internet before Russ
hanman um so yeah there's
that I don't know I actually just kind
of want to the timeout
entirely uh the timeout is just yeah
it's not that it's not to crash it's
it's will there be infer in place to
snag you an open
box
um not yet I'm working on it we're
working on
it uh buy yourself Tiny Box now if you
want but yeah these will be available in
the
cloud
um and you'll basically be able to write
your stuff in tiny grad and I understand
that it's slow right now but we can like
I can tell you why it's slow come to
Thailand Best of Both Worlds yeah I
heard about 70% is uh 7% of the
population's lady boys Best of Both
Worlds we got some chicks with dicks bro
we got some Randall got some Randall
energy in here doesn't ship to South
Africa um I don't think we're going to
ship to South Africa unfortunately we do
ship them we ship them to a set of
countries uh
uh we ship them
to Australia Canada CIA Denmark Finland
France czechia I I still can't believe
that is not the Czech Republic when when
I was there we kept saying CIA
CIA uh czechia uh Denmark Finland France
Germany right here in Hong Kong Ireland
Italy Japan Malaysia Netherlands New
Zealand Norway Poland Portugal
Singapore uh I don't know why we don't
trip to Taiwan special administrative
region too we can add that one if people
want that
one
um I I mean yeah I just like
like uh not China no not
China uh oh the Hong Kong special
administrative region of the People's
Republic of China kind of
um yeah you see okay so now we're just
calling exact so we can make this fast
by using the graph
abstraction I did see that Jeff man Jeff
hon yeah
yeah uh I we could probably ship to
South Africa to be honest if you email
him we can probably sh to South
Africa I really don't know what it's
like there but like you know I just I
see the countries on this list and uh I
think I've been to every one of them
I've not been to Norway or New
Zealand but I've been to every other
one oh and I haven't been to
Finland Finland Norway New Zealand are
the only ones I'm missing on that list
we ship to
Singapore when AMD driver is actually
good the availability is based the
availability is based on countries that
I trust their mail system with a $25,000
computer um don't come to EU it's
completely in
Decline uh I don't know I mean look I I
see what's happening in in in England
and I'm like wow that's that's kind of
going crazy and like France it's crazy
but I don't know was in Poland this year
was
crazy
um Europe will rise again Asia is the
future uh so Okay the reason right now
this is slow is because we're round
tripping all the way to the US but if if
we manage to make and I think I can make
this fast if we manage should make this
fast round tripping to the US from Hong
Kong This Cloud will have no latency
anywhere um no I saw I saw very worrying
things from the UK like people getting
arrested for Facebook posts and stuff
and that's just like like you know
people people think that you don't have
uh you know people think you don't have
free speech here you have more free
speech here than that like you can post
something on social media here they not
going to arrest you
like you
know
um cool LGE thank you for your party of
two uh I'm from Europe I moved to Asia
two years ago Europe is a shit hole
right now uh again it's not it's not all
of
Europe um but yeah Europe's going
through some hard times and it's a lot
of similar problems you know that are
happening in
America uh you have to get the Dells out
of
power you cannot
not I I said this on Lex right there's I
I don't you know you're you're a liberal
you're a conservative you want to be a
socialist and have a bigger social
safety net you want to be a conservative
and remove that social safety net right
you want to like I I think that like
even you know again I think that you can
even have a a a pro-life position where
you want to ban abortion like I don't
think that's beyond the pale right I I
can see why someone might believe that
but somebody who believes fundamentally
in in
degrowth that is most retarded shit I've
ever
heard I understand someone who wants to
reduce CO2 emissions I agree with you um
like I think reducing CO2 emissions is
is pretty important but somebody who
thinks that uh we should use less energy
is
retarded that's a good word to describe
it
see so this is copying from
cloud uh Europe and Decline and we know
it let's see what's suppos going
on yeah I I don't understand I I don't
understand these these people no I I
think that what they're really
expressing is a wish to personally die I
don't mean this in like like oh it's
like a threat I mean that they actually
like they wish that they weren't alive
but they're not very good at like
expressing that wish so they kind of
like projected onto
civilization um because fundamentally
they're anti-civilization
like if if you're saying if you're
saying you want you against growth you
actually want there to be the opposite
of
growth uh pism about the future I mean
sure you can you know you can you can
talk about
how people can't agily joke about
suicide anymore I think people still
can and hero who remembers an
hero um very confused by my rhetoric
either side is anti-growth
what do you mean I've heard many people
who are anti-growth
I've heard many people who are
against colonizing the
universe you refuse to believe this is a
real
thing this people in New York marching
you know I understand one thing if you
got some you know issues with Israel but
what you support
Hamas that's that's a pretty far Bridge
it's a pretty far
Bridge
um un alive
yourself it's no but like I I can't
understand
what like if you if
you uh don't support the war either
there's many many reasonable positions
to to to to have that's not what I'm
saying I'm saying that
like you got to side with the people who
want to build
civilization there's no there's no
future without
civilization and I'll tell you what
happens it's not you don't get a future
like like like you're choosing basically
between you don't get to choose whether
the rest of the world world is going to
have
civilization right you might even be
able to to bring America down you might
able be able to bring America down with
these ideologies right maybe that's the
goal
but it's not like I saw some absolutely
ridiculous shit where it's like people
are like you know once we finally get
rid of America the world will enjoy a
period of Peace no it
won't and it's so stupid to believe
that right
like what do you think going to
happen
um I'm not so sure I'm not so sure
they're they're a tiny vocal
minority I I don't understand how people
can like be against
Elon right H how can
you how can you basically be against
that how can you be against the growth
of steel manufacturing the growth of
power
usage um where are my
kids they're they're them building I'm
working on everything I'm working
on
um you don't believe in Grassroots
you're convinced there's a concerted
effort by nation states to take the west
down my take on this kind of is that
like you know people think like Russia
supports Trump or or Russia supports uh
Biden Russia supports dis uh
Discord right Russia supports
uncertainty Russia supports just just
instability like that's so if there's a
concerted effort by other nation states
it's just to destabilize
America um it's a state of nature I
think this is like you want to get
philosophical I think this is the
difference between like Hobs and
rouso
um like
uh this idea that you glorify the state
of
nature uh nature was it's like Nature's
barbaric um as a Russian you agree 100%
there we go we have we have a Russian in
here acknowledging what they're up
to so I heard heard you have 30,000
nukes what do you plan to do with
them the only issue with not continuing
to grow is the sun
dying okay wait am I attacking a STW man
here does anyone here actually believe
in in degrowth
good that's that's that's beyond the
pale that should be so far outside the
overin
window
uh I don't
know we got to keep the human Ponzi
going hell
yeah but some of you Lefty friends right
you your own
nuke so do
I um what policy is stumping
growth oh my God so many of
them so many regulations don't seem to
serve a purpose anymore they don't seem
to serve an actual like purpose to
protect something or somebody the
regulations simply exist to prevent
growth well degrowth of the government
yeah we can get on board with that but
um
you know the only reason I even believe
in degrowth of the government is because
I think that with degrowth of the
government we can free up some of some
poorly allocated capital and allocate it
better from the EU and most Europeans
think they have a far better life than
the
US let me show you
something got to Google for this one
I'm okay so in uh
2008 the UK France and Italy all uh
stopped growing I don't know if people
like know this but they stopped growing
in terms of GDP per capita now the thing
about $40,000 is a pretty rich country
you're you're a pretty rich country if
you're at
$40,000 I think you know you're you're
somewhere
around
uh wait
what
no wow okay if that's true that's insane
um but uh you know China is still China
is growing fast but China is still
pretty low you know similar to Russia
Vietnam is even lower
um but then like all these countries are
still growing right even the US is still
growing uh Canada and Australia are
somewhere between the
US
um that's actually wild if Taiwan is
that
high uh
why would the government want to
degrowth itself well you know we need an
outside force to come in and degrowth
the government we need someone who
considers themselves not a part of the
government to come in and
uh oh yeah if you're against nuclear
power
uh like I don't I don't know what to
tell you I I again I I think you're just
ignorant this this isn't a
uh it makes no
sense I I understand being against coal
power and being against CO2 emissions
why are you against nuclear
power yeah I live in Spain people don't
want to grow gov wants us all equal poor
and here's what
happens the world atlas will
shrug countries may choose this path but
the world will continue on without them
China will continue to blow past
them I'm from Spain and we're fuck the
socialist government are taxing but in a
bad way they're growing the government
they're making their friends and family
Rich you
know um
I think yeah I think a lot of countries
are growing I mean you know like like we
can you know I can sit here and complain
about the US a bit but the US is still
it's still is still growing and you do
still feel it in US Society in in in in
ways I I just hope that you know the US
doesn't throw it away
us growth is fake I'm not so sure about
that I mean you know you can hate on the
US a lot but the US is for example where
all the AI stuff comes
from
uh luxembourg's GDP is very high but it
doesn't reflect what the country is like
I've been to Luxembourg I think it
reflects what the country is like um
yeah so all of this all of this AI stuff
is is is coming from the
US so I wouldn't count the us out on a
lot of
metrix us is a paradise compared to
Spain I totally agree I could never live
in
Spain um
but no I mean I kind
of I I agree with Elon kind of about the
the importance
of like it does feel like and again I
don't know maybe I'm just falling for
propaganda but it does feel like there
kind of is a a turning point um and this
Turning Point mostly exists because of
uh the US
deficit so the US has a really uh large
uh national
debt which is when interest rates for 0%
this was okay because when interest
rates are 0% the cost to service the
death is really uh debt is really small
but today interest rates are 5% so
you're paying a ma 4% you're paying a
massive amount of money on to service
that debt right and then you can get to
a point where you can no longer tax your
population enough to even service your
debt and when that
happens you
default you can't keep the printing
machine on it doesn't work anymore for a
while they managed to have zero interest
rates with no inflation I think through
a series of scams
basically um well this is how you end up
in war
yeah interest rates are going down a lot
well yeah maybe they're trying to juice
the economy for the
election um but Pump It Up start War
wash money
yeah so there's reasons like like
there's there's deeper reasons Beyond
you know regional conflict that people
are saying it's World War I
o' who does the US owe money
to
um yeah
so
uh the
public mostly some
forign
okay wow Japan lent us a trillion
dollars do not know uh do I think I'll
be able to get visas for tiny gr
employees easier I hope so uh I'm
meeting with a
lawyer uh next
week and I mean I I hope this is the
kind of place
where uh you know I can talk to whoever
the whoever the the minister of AI is in
Hong Kong and be like you know do you
want me to send money do you want me to
you know spend money
here uh
so yeah we'll see I'm trying to I'm
trying to set up uh set up an
entity many countries have debt levels
exceeding their GDP well that doesn't
sound very
good Jews that own the banks yeah dude
no no this is this is the
this is Scott Alexander thing I love
about the Jews and it's like you know
people like to blame them because at the
top of every political movement there's
Jews but they're at the top of every
political movement you'll find Jewish
socialists you'll find Jewish
Libertarians you know you you you'll
find Jewish conservatives it's just it's
just they're just people man so you know
we don't tolerate that shit on this
channel um we're here you know that's
right I'm part I'm being paid Des
dollars to to to denounce your Jewish
conspiracy
shit
um why do I care to have my employees in
the same place well it's just going to
be an
option India controls the US yeah good
one is it a coin inid to see Jews always
in positions of power or do you believe
in IQ um the average Jewish IQ is higher
than the non-jewish IQ and IQ correlates
with positions of
power
uh you know that's that's you you you
want to explain uh you know like racial
income gaps you have these you have
these the the the the white supremacist
position is kind of untenable right
because you might use something like IQ
to explain that but then you also think
there's a Jewish conspiracy right why
not just use IQ to explain
everything when Jews made up the iq's
again there we go there we
go am I Jewish no
no
uh can I explain what the console is
doing you know you have to watch the
rest of the
stream
um yeah you can't imagine how the
liquidation of a country such as the US
would happen if they can't afford to
service their debt is this even possible
is the us too big to fail maybe God's
going to come out of the sky and bail us
out
um we are training
amnest all right should we write the uh
should we write the
graph how long are we going to have an
office in Hong Kong for we have this
place till the end of
October uh we had all we had all five
tiny cor employees here for a bit
we get multicloud devices well no so
right now the problem with latency is is
it can't group kernels together in a
graph
executor no it crashed it crashed
oh I know what we have to
do we're gonna have to make timeout an
argument
oh this that's because I'm specifying a
port I want
that timed out timed out timed
out here you can see it on a single
machine it's pretty fast
so this is happening we have to probably
also
have a fre is
okay to
have URL Li error
Checkmate
atheists
s for
the US will only become great again when
it renounces its policy on
Wars a Hans Neeman fan was he the guy
who may have allegedly cheated at
chess for
I should probably write like a cute
little dispatcher for this don't you
think
because this doesn't like handle things
nicely someone wants to refactor this
and make this nicer we should share that
code with viz
too okay
um let's focus on making graph work so
tiny grb has this thing called graph
that we can use
oh we also didn't test if it works with
with uh
there's probably some clean up to doing
these graph abstractions I'm not
thrilled about
them okay exec items are a bunch of
Runners uh uh so for a runner we're
going to
basically where's a
runner writing this kind of stuff helps
you get these abstractions more
correct and the reason like this should
almost be free and it's not this is
taking too much code right
now okay so exec item has progs buff and
metadata okay we don't care about the
metadata uh uh they all have to be
compiled
Runners yeah I think they all have to be
compiled Runners because I think from a
compiled Runner we can get the
program this is like boiler BL though
not happy with this level of boilet
plate okay Prague C Prague for dumb
historical
reasons uh Prague ID
I you really have to assert that they're
all
Cloud programs
too
okay now have about buffer
this should just be done in a canonical
order we're not ready with this yet I'm
upset about this this needs refactoring
no this graph stuff
needs this graph stuff needs refactoring
not happy with
this I'm not writing this
now have to think about how to refactor
this it's like a normal call
for
what
so like so much of tiny grad is just
about getting the abstractions right if
you get the abstractions right
everything else is
free um like I'm not I'm not happy with
this with this graph abstraction there's
a lot of code to delete in here and
that'll be like a tuni grad
project uh CU there's multiple layers of
interaction there's comp piled Runners
there's
Runners um when like it really should
look a lot more like hcq so we have this
thing called
htq
uh which like and then we have this
other multi-graph Runner like this code
and jit is
terrible oh all right well that'll be a
fun that'll be a fun refactor
yeah there going to be a lot of
refactoring
I don't like think about exact
item cool but overall I'd say a pretty
productive day
um think if there's any problems with
this like we could batch uh like Alec
request together but not really you are
going to have to wait for a round trip
for each one of these
requests uh
let me see how I can modify this
only implements basic security
checks will follow symbolic
links oh no okay I'm not using
that yeah I was like there's no security
issues here and we're going to put
engine X in front of
it we're going to put engine X in front
of it and we're going to cach calls to
compile
um we're gonna have like a big compiler
cache this is also kind of doing Beam on
the wrong side
like this should basically just send a
specification of the compute
got a lot of the abstractions
right the graph abstractions known to be
bad I've been upset with that for a long
time um
get the chest off off there
that fail for some reason uh instead of
try
oh yes we can do that
cool I think I'll just merge this I mean
it's going to look something like
this for
cloud at least it's something can start
playing
with I want to delete the graph
directory and I want to move uh hcq
graph into support and then I want to
move these graphs into their specific
run times it doesn't need to be an extra
file it'll come with the graph refactor
I see look at this if these had the
right abstractions it wouldn't look like
that but it doesn't have the right
abstractions close don't know
right all
right any questions about tiny grad
uh also if you have any if you know any
d
cels uh really try to get to the bottom
of what they they
want like
I mean it's it's just it's just it's
just sad
otherwise like they're just
Lites
and uh Lites don't win
obviously it's just a question of how
annoying they want to make it for
everyone else until they
lose well I guess there's one way l i
win uh
uh and it's the destruction of
humanity uh and like if you can get them
to admit that I mean at that point
you're just so far off the reservation
of
any of any kind of politics that have
ever
existed but again I think it's mental
health issue I think I think that it's
it's you know people say things like
liberalism is a mental health issue
I don't agree with you I don't I don't
agree with I don't agree with that like
I think a lot of people can have a lot
of varying political views ranging from
like you know we should live in a
communist way to you know we should have
a king and
slaves I think those are all kind of
somewhere on the political Spectrum I
think what's not on the political
spectrum is I am rooting for the
extinction of humanity because humanity
is fundamentally
evil uh and I do think that deep down
that's what a lot of these people
believe what do what do you do with
someone who believes
that what what do you do with with with
someone who thinks that
like are we allal sure we're all a
little ilal yeah that's fine and saying
that I want those guys to die well okay
you know look that's been that's been
Time and Time Memorial but if there's
ever been a group of people in history
who've decided that they think humanity
is
bad well I didn't stay around too
long
uh let's go to Mars and leave them
behind no let's let's let's let's find
for Earth
and is Ubi an answer
no no again what do you do with a person
who genuinely believes that
like humanity is bad energy usage is
bad
like there's
no future in that
you can't are you going to pass your
ideology down to your children you're
probably not going to have children
because you think humanity is
bad no I don't think this is a small
percentage of
crazies I I don't I think this is
a I can uh where are my kids we can talk
about that um uh you know I don't I
don't I don't talk about
uh you get a character right I play a
character on these streams you don't
know me I don't know
you um it's the vast majority let's be
real I don't think it's I think
it's a sizable percentage I don't think
it's the
majority I might say it's somewhere
between 5 and 20%
seem to pretty
much genuinely believe
this
uh you know
and
like on the verge of automation of what
what planet do you live
on what planet do you live on that like
oh what did you believe some open AI
propaganda about how AI is going to
replace all the jobs in two years are
you
kidding like the Ubi is just is just is
just a scam right now like you might
want to talk about some hypothetical
future where humans can't do useful work
but like that's not the planet I live on
right now
um and I'm not by the way I'm not saying
that like if you don't have children
you're bad that's not at all what I'm
saying I'm saying that if
you don't want other people having
children if you want Humanity to
degrowth I don't have a problem with you
know someone I don't have a problem with
someone killing thems
and that's your
right but don't tell other people they
should kill themselves you know and
don't don't don't try to don't try to
like like advocate for policies that
lead to
basically like like suicide of a culture
or suicide of a nation state like don't
what are you
doing what are you doing where are the
adults it's time to bring the adults
back to the room and
uh say basically you
know no
AGI is going to take over in three
[Laughter]
years when you been smoking
man bro in three years there's a chance
your robot vacuum won't eat your iPhone
cord anymore but there's only a chance
of that I wouldn't be too
sure we need less people
why who told you
that yeah behind a degrowth campaign
there's an NGO I like who genuinely
believes this shit let's let's let's
figure this out right let's get to the
bottom
of uh you know where this is coming from
and why people believe in
that doomers and glooms about Ai and
coding what you know open AI has this
definition open AI has this definition
uh we have AGI when machines can do half
of useful work I'll tell you about that
definition it was finished in what when
was that 1870 probably machines have
been doing half of useful work forever
the problem is useful work has just
expanded useful work has expanded
massively so if you compare it to 1850
standards machines are doing 99.9% of
the work
and
yet there's still a lot of work to be
done right work
expands um we can start with yourself
and your family look if someone
personally believes that that there
should be less people people can have
their own beliefs and you know that
those kind of beliefs are just going to
die out but stop stop pushing that shit
on other
people right like you know we need
maybe maybe that what just happened here
is that there's just so many midwit in
the government that they really are
falling for maybe these these degrowth
NOS are are sponsored by by Russia and
China and countries that would just like
to see the US uh you know de growth
right um I don't even know I don't even
think uh Jensen Hong told you not to
learn to code
[Laughter]
that's dumb on multiple levels is that
really what he
said I don't
know jenson's a funny guy I like Jensen
you know he created a lot of value for
the world
um yes often rooted in climate change
arguments
overpopulation the world's there no
people anywhere
um hi regginald Walker how are you and
most of Reddit believes
him you know the M part is openingi is
going to train their next AI on that
Reddit data and now the AI is going to
be telling you not to learn to
code you
guys machines can't play Mario
64 programming is is no longer a
critical skill what are you talking
about how do we accept that most of us
are midwit coders who are never going to
do anything
great I mean be the best midwit coder
you can
be figure out how to produce value for
somebody right you don't have to produce
a ton of value just literally figure out
how to produce more than you consume
that's all you have to do to be a good
person if you don't do that you're a bad
person if you do that you're a good
person it's that
simple gu they just stop being midw
there's plenty of work to
do these coders will indeed oh my God I
saw I I retweeted I someone someone
posted something like well you know it
was from like 1965 in 20 years years
we're going to have compilers and
compilers are going to replace all the
work of
programmers 1985 we had compilers and
yet there were more jobs for
programmers um so yeah I mean
hypothetically we can talk about some
future maybe where humans can no longer
do economically useful work right you
can watch cgp Gray's video about this
humans need not apply
uh and uh you know it's interesting it's
not happening in 3
years um I hope to God it happens in my
lifetime but we're talking about we're
talking about
Generations that's inevitable I'm not
even so sure it's inevitable I think
there are Trends pointing to
it
um but again in three
years like maybe you'll be able to run a
browser that isn't Safari on your iPhone
maybe maybe we'll
see people in poverty all don't want to
die people in third world countries
people in third world countries don't
believe in degrowth right you know what
countries love capitalism like Vietnam
has a GDP per capita of like
$4,000 $55,000 and they love capitalism
and they love
growth poor country but they love
capitalism they love growth I'm telling
you a lot of people at poor countries
they're not like oh wo is me that's some
like Rich ass liberal I went to Harvard
and can't surpass my parents
shit everyone in any like and I don't I
don't I've never been to Africa so I I'm
not sure about I'm not sure about
countries who have like you know like
like like fucked in the head religions
and stuff like about like you know
believeing in
like like the kind of people who took
too much iasa kind of shit
um average dudes in India about average
dud everything I know about India those
guys just like shit man you want to be
rich it would it be nice if we all can
be
rich
um
what who told you where do you get this
wacko shit that like people are Obsolete
and are going to stop working anytime
soon like touch
grass look
around um well you say cloud is a way to
go Tiny Box wasn't it I mean what do you
think we're going to put in the cloud a
shit ton of tiny
boxes and then we're going to build
chips and we're going to sell
accelerator cards we're going to sell
tiny boxes with our chips and we're
going to put our chips in the cloud and
then we're going to have a full stack ml
business we're just doing it a little
bit differently than you know that's the
thing man if I just look like if I just
like like decided like well why don't I
just raise $50 million and get a big
office in San Francisco and overpay
experts to do shit and you know it's
just like why do that it's only fun if
you're going to win by
like you know comma for people who have
a comma
like you know how far ahead we are not
of Tesla but of everybody
else
um yeah not of like way much either
there but you know not of like Tesla and
Lio but like of all the car companies
like of our
competition uh so you know let's see if
I can do it again let's go um when's the
release I mean tiny grad's open source
and you can contribute to it and you can
use it now and I think I might do a
whole series of
streams there's a little bit more to do
to like get to
1.0 but once we are comfortably at 1.0
like there is a point where this is kind
of
finished uh and then I'm going to start
implementing papers in it we can start
building libraries on top of it um have
I written in a way
yeah it's it's cool uh you know again
it's not my criticism of wh has never
been that it won't exist here you know
can we can find my um my criticism of wh
from back in the day just to prove that
I'm not like talking out my
ass you know people always think I'm
talking out my ass
but that's why I write blog posts
it's called 100x investment
right
um so my criticism of weo is not that it
won't work it's that they don't have
good unit economics okay so I mean Comm
has like 20,000 cars now uh and we make
about $600 profit uh on Hardware
Sales right so that's about $600 to
comma
we also have a lot more people using
comma Prime now comma Prime is
profitable um and like it's better than
ever and our unit economics are positive
every new person who joins the common
Network makes us money right where the
opposite is true about
whmo
right it's changed a little bit but weo
is paying dollars per mile for their
car now something that a little bit of a
saving grace that I didn't really think
about is personally I'd be willing to
pay maybe 20% more to not have the
driver in the
Uber if I could have the same service as
Uber but not have a driver that's worth
10 or 20% more to me um it's not worth
double right I'm not going to pay $80
for a ride when it's 40 and there's a
person in the car but so there is some
like you can say that they're not
entirely fungible Goods though I've
always thought that I was in the
minority about this because you know I'm
kind of uh uh you know like like a
conversation but I'm not going to be the
kind of Dick who puts like I don't want
to have a conversation right
um why don't I want a person in the car
you know what if I want to what if I
want to like jerk off like you can't the
way when camera is watching
you uh all right pick my notse you know
something something less something less
not something less illegal under terms
of
service to Uber driver we' have a long
deep
chat bro bro I just landed I just want
to get
home
um you're uber you could check on how we
going to nego appreciate that what am I
going am I going to pull a Louis
CK right I think that's a good note to
end the stream on uh I'm not depressed
guys you know it's just it's just it's
just sad to watch your home Empire
crumbling it's not really crumbling
we'll be all right
uh you know if you're going to vote the
future of civilization is in your hands
uh I'm not going to I'm not going to uh
endorse a candidate it's it's just so so
disgusting you know this the whole the
whole the whole thing is just disgusting
but hey you know who I will endorse I
will endorse Elon I will endorse Elon on
his project to advance civilization it
is sad that this whole has to be you
know on the shoulders of one man and
everything I could ever you know
everything I could do to help I'm I'm
always uh I'm always I'm always here so
I am dor
Elon uh and uh you know
uh someday I hope we like go to Mars and
shit and like build build silicon life
and give it Freedom have a have a have a
diverse beautiful civilization Galactic
Civilization that that'd be that'd be
real nice all right bye everyone
morning good morning good morning
yeah no nudity on stream
no nudity on stream don't pull another
entity
that's going to be the opening on the
youtube
all right boys i'll show you what we got
today
we had a beautiful pull request merged
this morning
on tiny grad made me very happy so uh
you know that's why we're why we're
streaming uh this morning
this from marcel uh
bischoff
turning these crappy triple loop
into this doesn't this line make a lot
of sense
np.insum i don't really understand how
line sums work but good thing marcel
bischoff does
so i merged in this pull request and
then i made a few
uh cleanups
if i do that will it show it side to
side how do i get it so go split
oh i didn't know there was a button i
guess it picks that sometimes and picks
the other one sometimes split is so much
easier to read
unified is so hard to read
okay okay okay okay okay let's see do we
have did anyone actually
no one's here oh bread ham and egg good
morning
good morning good morning okay um so
we're working on tiny grad today now
i've written tiny efficientnet
um so let's just go over the code
quickly of what tiny efficient net is
and thanks to marcel bischoff it now
runs
in under a second so we can actually
debug this now
right now so we'll start with where we
are on the stream
right now here let me uh look at the
picture of the cat
um sorry it's weird colors but you know
so you see this picture of a cat
this is the picture that we're putting
into the efficient net
it's pretty unmistakably a cat
uh but there has to be bugs in the
efficient net
because of course it's saying that it is
a coho
and i didn't know what a coho was until
i googled it
but it's a salmon so
it thinks that this is that and
uh wow look how visual my channel is
today
wow this is the kind of content that's
going to bring in new
viewers you know because i'm putting a
picture of cat
because we're going to recognize cat
but it actually thinks cat is coho but
it knows that it's not dough so that's
good
you just got an email that i'm live you
can come watch my stream
uh yo yo yo no i have a story that's not
appropriate for stream i'll tell it
later
um what i'm busy watching
oh you're watching my stream you can
comment we got some people from poland
yeah the left cat looks weird because
it's not a cat
it's a fish a coho is a fish it's a type
of salmon
honestly i'm like curious does someone
make like a visual
image net explorer oh yeah look
wow wow what wow this is this is a lot
of
um yeah look there's
men in caps holding co-hosts all right
well either way there's got to be a bug
in the efficient net because it thinks
that the fish is a cat oh look at these
look at these co-hosts
wow look at that happy coho it looks
happy it's getting away
catch it eat it fry it
okay so we'll comment out the thing
where we look at the cat because we
don't need to look at the cat we know
the cat is in there
it reads the cat from this website here
so we can take a look yeah that's what
the cat looks like in color
and uncropped not a hot dog one is the
accord guidera stream i'm not doing that
shit anymore
we write uh we write tiny grad
no i don't think it is a catfish okay
there is there is bug yes nice logo the
logo was contributed
by let's figure out who contributed the
logo
tsm tsm
callister contributed the beautiful the
beautiful tiny grad logo
tiny grads on pie pie we've made so much
progress on tiny grad
um now so for those that don't know what
an efficient net
is we'll start with what an efficient
that is efficient
rethinking model scaling for
convolutional neural networks there's
one chart that really explains what an
efficient net is and it's right here
so these are all the other old shitty
networks this is the number of
parameters
and this is the top one accuracy so you
can see the red line
is well to the upper left upper left is
the direction we want to go because
parameters are bad and accuracy is good
all right
capisce does everyone get it good
um how much would you pay i was thinking
about doing
like a high-end like programming
tutoring service
i would like like like 500 an hour i'll
tutor some rich kid on how to program
the problem with that is i realized i'd
get fanboys
and fanboys would be interested in
asking me fucking personal questions
so that wouldn't be appropriate and
that's why we decided not to do it
you want to build a cpu out of relays
well i don't know what a relay is
if you want to use a relay well you
should use a transistor because
it's the current year it's the current
year
um now i'd be happy with 500 an hour and
i want to like tutor some like spoil
rich kid on programming
no no no i don't want a course and the
problem is oh my god we get
fanboys and fanboys are the absolute
worst
you know fanboys are like
ugh oh the most likely do you buy like
action figures and shit too are you a
grown man who buys action figures
ugh reddit or trash you know
can i make the text bigger is that big
enough for you well if it's not too bad
i went to the eye doctor and it turns
out i have an astigmatism
and uh yeah so that's that happened
all right so we implemented tiny
efficient net
i'm in tiny efficient that is pretty
short code
uh so this is it uses these
mb com blocks which i think are like
mobile bottlenecks
and that's the forward pass for it and
then efficient that so let's just
compare it to the pi
torch one and let's just see if
we made any uh mistakes
so here's that same thing written in
pytorch we're loading the weights in
from pi torch as well
here's the code that does it um so we're
just checking inference
and maybe if we have time we'll check
the backward pass too
but our goal on this stream for anyone
who's like what's he doing today
is to get instead of it saying coho here
for it to say cat
right so these are the image net these
are all the things that could possibly
recognize oh that copy paste not going
to work
and if i do that and then i do that and
then i remember to add the tea i forgot
to copy
now it'll work okay okay so these are
all the things that could possibly
recognize it at we have egyptian cats we
have persian cats we have tiger cats we
have siamese cats
i don't know what a pole cat is we have
madagascar cats and catamarans
so those are all the things we could
possibly recognize it as these are just
the imagenet categories
so that would be nice if that worked at
all
but for some reason it's a coho and
what's even sadder
is i think it's even a coho if i
multiply the image by zero which is of
course putting nothing in
yeah it's still a coho so you know the
image is actually not making any
difference at all
almost to the point that i'm scared
we're not actually putting in the image
what if i multiply the image by a
thousand
does it do something now oh it's a bald
eagle
wow what if i just multiply it by 256
it's a coho but if you multiply it by a
thousand
it's a bald eagle and it's really sure
of it this is the most patriotic
neural network
and we'll also put in what it's not
it's not a french loaf well i wouldn't
want to be a french loaf either
all right well we're coming out the knot
for now because you know
should i watch the new borat is it
actually any good
okay um also we're gonna listen to some
copyright free music all right
um because we're not allowed to listen
to copyrighted music
so we're gonna listen to copyright free
music so we don't get muted
royalty free music let's listen to this
all right some copyright free music
oh i listened to the uh alex jones on uh
on joe rogan i liked i liked
you know alex jones
the guy could use a fact checker
[Music]
like unlike most media i don't actually
think alex jones is trying to lie to you
a lot of media i think it's they're just
evil and they're trying to lie to you
i think alex jones just gets caught in
his head and talks too fast rogan's kind
of saying this but
you know
i know i know i know alex jones has a
point but it's deterred by many
substances
you know you guys always think i'm on
drugs i don't even think he's on drugs i
think that's just who he is and like
what dude i don't care about your torque
mod on the accord i don't care
this is my care
um it's not my fridge
[Music]
well copyright free music is kind of
mediocre
[Music]
all right i mean i can run it six more
times but it's still gonna say coho
so we're gonna have to really start
diving in and figuring out
you know where the bugs at
[Music]
and then we're gonna make it take oh you
know what we can do this now
let's say if all right let's
say url equals
this
uh if sys.org
length system v greater than
one now
all right we're ready to recognize
things
that aren't cats um
[Music]
but we're not ready yet because it still
thinks the cat's called
so yeah also by the way check out
tinygrad if you haven't
it's actually very readable code um it's
the tiniest neural network library here
all the ops right here
uh i mean it supports everything
required for an efficient net
well maybe i mean there might be some
bugs there clearly are some bugs
so uh yeah let's um
okay
so x squeezed oh yeah i learned what
adaptive average pool meant
and it actually just means um
basically the whole thing is this size
is adaptive so it should match that okay
we're doing se reduce
we're doing swish
we're doing se expand and then we're
multiplying the sigmoid
and then we're doing the point wise
convolution
we don't oh
oh did we not do the skip connection
what's id skip block args id
skip oh interesting i don't think we did
that
oh well that would make sense why this
didn't work
um
okay well ah well if we forgot this this
would actually explain a lot
let's call this inputs
okay let's just do it if the shapes are
equal
x equals x dot add inputs
hmm cat cat cat mouse trap
oh well we made progress i think
i don't know if we're actually supposed
to add all these okay let's take a look
at what's here what's id skip and when
does it get set
oh damn okay um i actually checked out
that efficient net so we can take a look
at it
probably in fun there we go
um
my python's broken so you have to type
ipython3 whenever you want to use it
are you tails
oh termed a relative import with no
parent package this is terrible
i somehow got this to work before
like i don't get it because these block
args well we can try to read it
block args iv skip
and copy and pasted this from here
so complicated though
um block decoder dot decode
see this called so confusing okay if not
no skip in block string
so we definitely don't have any no skips
i think that's actually probably right
then
checking if self. oh dot stride
input filters equals output filters okay
that should be the same so i think i
actually did that right
um input filters output filters strides
print it
because if we strides and the sizes
won't be the same so we really can just
check the shapes i believe
yeah cool
okay well good we added that in
see you get one little thing wrong
everything's a resnet like architecture
today
um see what else we did wrong
all right let's make sure these things
match uh
expansion and depth wise convolution so
we do the expand cone
uh i assume expand comp doesn't have a
bias
i mean yeah if it had a bias we would
and they don't put
you don't want to put biases in your
comms if they're right before batch
norms
um because
the batch norm already contains the bias
and you're just
stupidly wasting model parameters you
don't want to do that
um depth noise comes we do groups that's
good we do pad i mean the pads all have
to be right otherwise it just wouldn't
compile
uh we're running bn1 we're running swish
we're running this junk
we do the pointwise convolution and then
we don't need to worry about drop
connect
because that doesn't actually
run though
i'm interested oh i guess drop connect
will just zero it out okay cool
drop connect is kind of like you just
get rid of that whole like rez block
it's a it's a cute drop out like trick
alright let's read forward and see if we
made mistakes there
god i don't even know what any of that
is okay self dot
extract features okay well we're not
running that
um oh maybe maybe that's just the actual
net
okay we do an average pooling
uh we do a flatten which is this reshape
here
dropout does nothing and then we do the
fc
oh why am i doing a swish there don't do
a swish on the output
why do i think doing a swish on the
output was a good idea anyway
no swish let's see
still mousetrap
[Music]
it's not dough good let's see if we zero
out the image if we get something
different this time
okay okay we're making progress
a zeroed out image is a suit that's
right if you're empty and hollow inside
you're a suit
what's uh who's that guy billy from uh
entourage
a soup all right um
there's some chance that i like mess up
indexing these things too so like we
can't always rely on just
uh if like next to mousetrap was cat
yeah because they start with one they
don't start with zero
oh yeah i think this is off by one
yeah i think it's off by one
i'm actually not even sure if this is
the order
there's some chance that just the is
wrong
uh let's take a look at a plot who likes
plots you like plots
i like when things have plots too
plt is not defined
i'll just put that there is that slow
what does that seem like something that
would be slow
importing matplotlib now let's just move
it down here
if you want to look at the
outputs
well that's junk
um
it's probably because it's a bad shape
yeah it's a dumb shape all right let's
do out.data sub zero
let's see
probably unlikely to be an indexing
issue
i mean so this is like these are like
the log odds of each uh
of each thing now there are a whole
bunch of cats in there so i'm not sure
let's look at the log odds of a zero dot
image
those actually look very similar
it's a suit a mousetrap well at least
some of the image is making it through
the net
whoops
all right let's go back to reading look
we found two bugs already i was doing a
swish
wait well that swish is good
forward just that other swish was bad
dot fc add fc that's perfect
let's print fc bias
all right relatively small numbers
that's good
it's like the base rate of the category
you know
um okay so we do an average
pooling we do the reshape
first no we do an average pool there and
then we do the reshape
that's you know what i know it causes a
line but let's do that
good
all right 1280 is the output we do
reshape let's read extract features and
see if we're running it right
okay um we have the stem
bm stem
just try to i guess that's right
uh drop connect run the block
oh let's just say block
you know the block is hot i'd love to
play the block as hot but
boys it's copyrighted so you know
can't play the block as hot
all right extract features doing swish
bn1
conv 2d on the conv head okay that seems
right
extract end points when is this used
does this even do
oh i say useless
let's commit this since we know it's bug
fixes
fix e-net bugs
now is mousetrap
so i don't actually know if that
categories thing is right maybe there's
an example in here where they actually
fetch the categories
um like by name
this is useless
examples maybe imagenet
preliminary data
how do i get it to actually print the
name of the category
whoa this crazy amount of stuff
okay this looks the same
zoom from a checkpoint distributed oh
look at that those look nice
what's an average meter i should read
more pi torch code
but how do i get the name of the
category
you guys saying this in chat
uh yeah i know git commit am will do the
ad for me but then
i don't have as much control
uh i used to do that but then you
accidentally end up committing dumb crap
and that's why i don't do that yeah
we're using a pre-trained net and we're
trying to run it in tiny grad
deep research that's what we're doing
you're a subscriber so you get your
questions answered
by the way if you haven't had a chance
to subscribe yet make sure to subscribe
it is only because i'm a whore
for money that i stream
on twitch somebody has to pay to keep up
my math habit
and you know without your money i would
stop doing math
and that would be a bad thing for the
world so
um
oh here's a clip george hot does meth
we'll put it in the new york post
oh is that uh was that the uh
george hot ai expert
news let's see if we can find it
no no no no no there was a news about me
where'd the news go
said something like aliens too busy
having sex
duh there we go the daily star yes
yes aliens they could yeah aliens are
too busy pleasuring themselves to visit
earth an
ai expert believes someone asked me if i
like being called an ai expert
and what i said is i want to be called
something like you know a little scary
and definitely with no
prestige like hacker is much better an
ai expert seems like the kind of person
who's like
well i'm going to go to a conference and
i'm going to lecture people about my
expert opinions
i'm a thought leader and that's what
they are like so
you know i never want to be grouped in
with those people
that's right even though i am writing
the hottest
growing neural network library called
tiny grad
um you can use tiny grad tiny grad is
great you know what's great about tiny
grad
is totally and completely useless
there's no reason you should actually
use tiny grad for anything
but we still write it i'm getting such
good quality pull requests for tiny grad
oh it's an art project boys you know
all right um quality articles
as usual am i at home or the office i'm
in the cloud
all right well it's pretty confident
it's a mouse trap and i don't think
that's right
oh don't make me don't make me actually
start to have to like compare it layer
by layer to pie
torch i have better things to do today
you know
i do believe i have better things to do
today we're filling in everything so
that can't be wrong
i tested my batch norm so that can't be
wrong
what else could be wrong
where are the bugs
i didn't of course
so i have bad posture and it's because i
have an astigmatism
and i'm going to get glasses and you
guys can see me with glasses okay
so clearly we did something else wrong
because we're doing a swish at the end
here and there is no swish here
is there not a swish here
did i do the same thing do i just love
putting swishers everywhere
it doesn't look like there's a swish
there so i have a swish there and let's
get rid of it
uh everything every bug i fix in the
block is way more likely to fix things
oh let's go let's go cat cat cat
pick up ooh but it's very confident
about pickup so
i'm interested if now we're in off by
one land
because yeah we have to be we have to be
off by one
let's see if pickup is next to cat
oh yeah oh if it says cat right now if
that was the only bug i'm gonna be so
happy because then we don't have to do
shitty things like
oh well
the the confidence is very different
though
bar ballet
well that's good how different that is
so it could now just be
let's look at the outputs and let's see
if it's very confident about cat
oh it's very confident about that one
okay all right
i think we've got it i think we just
need to figure out how the categories
are
are mixed up i'm hoping
notice how it's yeah yeah okay let's um
let's make it work on some other images
too
let's find some other images like a car
california association or realtors eh
this is a copyrighted image do we need
to blur that image out on stream
what oh my god stupid google
what
okay well that one i'm getting other
things for oh that's a bow tie
great let's take a look at the car and
see how much we're messing it up oh no
that's pretty good actually
let me write this to not be stupid with
this uh
87 thing
print image dot size
let's just write my image resizer to be
better one sec
uh okay so we'll say aspect
ratio equals image dot size sub
zero divided by image dot sine sub
1 we'll say this is
inch 224 times aspect ratio
do it right boys do it right don't write
bugs
okay so now we have that now we want to
put
here um oh god we want to say
uh i'll call it the chapo
image dot shape
sub 1 minus 224
oh what if that doesn't round nicely oh
you know what
better idea called call it image.shape.1
minus 224.
you have hardcoded 224 everywhere that's
a tragedy
uh divided by divided by 2 for that
integer division and we'll just say
chapo plus 224. all right let's take a
look at the cat
and in this case it's a car oh beautiful
car
uh what do we think is that a beautiful
car
all right good cleaned up the resize
logic
okay it's nice again because it's very
confident about this and it's very
confident that it's something else
which means we probably just have the
labels mixed up because it's not really
a bow tie is it let's check out bow tie
and if there's car near there
no they're probably just all wrong
efficient net category
list i mean this code has to be in tons
of like stupid like oh i can recognize a
dog
efficient net uh category
list you see what i mean about how it's
very confident in the bow tie
um
all right category list
does anyone find what i'm looking for
no you guys are useless gucci flip flops
google is not stupid
i beg to differ i mean what do you mean
by google
um i just found that list somewhere on
the internet so that might very well be
wrong
uh let's not say efficient now let's say
imagenet category list
here we go
does this match this one
totally different
uh oh do i have laundry i don't want to
miss out on this
um i don't think so though
oh yeah but i put it back in the thing i
put in my my spot
let's see maybe these labels work better
i do like that they start with zero
that's a big improvement
mwah uh
is this json
oh what am i doing i'm doing a dumps
it's
dumps i'm doing loads i'm not doing a
dumps
expecting property name enclosed in
double quotes oh i see it doesn't like
that
do i really just want to do an eval we
could just do an eval
i don't know you know what someone
probably already wrote this code before
let's just google it
ah here we go
literal eval huh what's a literal eval
safely exhalate an expression oh
it says it's safe let's trust it let's
blindly trust it
uh what shoved in the bag yeah yeah yeah
if it's like shoved in
if it doesn't look folded it's bad
oh ast.little eval all right we've got
to import asked
let's see let's see what we got
oh beautiful that looks good no wait
that's
junk what why did i put all these dots
in there
junk
just added a lot of slashes
oh value error malformed node or string
it doesn't look very malformed to me
that's malformed about it
decode utf-8
oh what you don't like my exit
what how come exit doesn't work
did we get hacked i feel like we got
hacked by running ast literally val
who redefined exit
i don't know i feel like that used to
work
but what do i know
yo boys look what it says that is
it said that's a sports car can't make
that shit up you know
that's a one in a thousand chance if
this one's a cat
this means it works one in a million
let's go
tabby cat we did it oh that was so easy
oh it's a short stream yes please
oh we did it oh that was so easy oh
yeah sports cat yeah all right
someone want to post some other pictures
nothing inappropriate but let's post
some other pictures and we can try
that resnet comment is stupid i feel
dumb for writing it we're going to
delete it
oh man i can't believe it was that easy
we just had to delete a few swishes
yeah e-net works all right
um that's a broken
is that a broken link
oh okay we got some air jordans up in
here all right let's try it
let's see what it says it is by the way
this code's written 100
from scratch just numpy and crap
running shoe oh yo yo ai
man who's scared of the ai that's right
it's coming for you it knows about cats
cars and shoes
i've never really played with
pre-trained imagenet models before
it's impressive and it's impressive that
you can do it with just like
you know like nothing basically
oh and it's fast thanks to marcel
bischoff
oh we got a rooster hawaii let's see
what we got
no that's a fi oh oh we need the image
all right let's go rooster
it's a cock
oh yeah
yo oh man look it works so well
and it's written all in tiny grad
did you believe that with just you know
you know what you know what's crazy
about this this thing works for training
too
if we could just send tiny grad ten
years back in time
and someone had a big computer to run it
on like it is amazing that that's
all it is can it do hot dogs post a hot
dog picture what do we got
i don't know what it's going to say for
that
oh i think it's actually going to error
out because that image is taller than it
is wide
yeah all right all right we'll fix the
bug
let's fix the bug
um we want to say aspect ratio
that's a lot of bug defects sorry it
only works with images that are wider
than they are long
if someone wants to submit a pull
request they can
all right hot dog let's see let's see if
it knows hot dog
i want i can't do that
hot dog hot dog red hot
this is this is and it runs in under a
second
it's amazing that this works this is
like
all the code and you need to know what
these things are like i guess you have
to know what a batch norm is
um and this should be able to train as
well
all right we can get rid of that and get
rid of that
load weights from
a rough copy of that
yeah i like wait what i'll get better
there
let's see what code we can clean up does
it actually need the squeeze
what if i get rid of the squeeze does it
still work
nope it doesn't work now it thinks it's
a three-toed sloth
make sure to keep your squeeze in there
so this actually probably doesn't work
on the backwards pass yet
because i didn't write if you're doing
uh
dementia if you're doing broadcasting
the forward op support broadcasting and
the backwood ops don't
so that's a big project to fix
but yeah
you don't need this this is literally
and you don't need any of this image
pre-processing it's all fake
um
it's just amazing how far things have
come
that you can write like a toy under a
hundred line project
uh you just need to if you rewrote those
things fast on a gpu and you made that
work
um you could you could train this net
you know
20 years ago maybe 20 years ago 10 years
ago definitely
10 years ago definitely if we could just
send this back in time
10 years we could usher in the deep
learning revolution
you know if we could just send tiny grad
back in time
how fast does it run on a cpu well
so it runs in point seven seconds let's
uh
let's just see if it with bigger things
uh let's say like 128 access
zero like what if i do batch size 128
oh my god it takes forever
by the way a batch size 128 efficient at
b0 on a gpu
takes like uh
who who sent in appropriate links we
should ban them
send it back in time the ai will rise
sooner than because if we send it back
to 1969 the people would just be
frustrated they'd be like what the hell
is python
ah
how many other deep learning network how
many other deep learning frameworks have
efficient net
fully implemented
you need a lot of gpu memory not that
much i don't know
you know yo you know what i just ordered
8 30 90s
i got eight 30 90s coming
no it's not using the gpu this is just
using the cpu and it's incredibly slow
this is running on mac
do you think quantum computing will kill
bitcoin
sometimes just be banned
um subscribe and i'll answer your
question
how much ram on the mac 16
i think thinking can i cap proc
no of course not can you do about this
mac and you guys like looking
um yeah 16. oh no i leaked my serial
number you guys are going to claim my
warranty
uh you know what honestly i stopped
doing the oculus hacking
because i hate it so much
um
i thought they weren't in stock anyway
yeah that's why you pay scalpers absurd
fees
and you hate them the whole time what do
i think of the new
the new one the new atis wow
okay that is terrible it's actually
slower to do that
than it is to do that
it's actually like it's quicker if
you're trying to do a batch to just do
them all
yeah try it on your linux vm with four
gigs of ram it's gonna work great
what do i think about risk five uh is
like civilization five
um
is self-play halfway to learning
dynamics oh i'm learning a dynamics
model right now at comma
we're learning dynamics models now on
the latest vision features
we just upgraded everything to ubuntu
2004 pi torch
1.7 the world is getting so good
the world is getting so good how do we
automate away middle management we just
fire them
i don't have any middle management fired
them all
all right so i think tiny grad um
all right let's let's go over the to
do's to do uh
efficient net backwards
pass uh
what you do train an efficient net
how insane would it be if we could
actually train an efficient net
using tiny grad
tensors on gpu
gpu support
must must
support mac
reduce code increase speed
okay uh we can we'll play around with
this a little bit let's let's do that a
little more for the stream let's look
into what it's actually going to take
to move tiny grad to the gpu so we can
get
real performance out of this library
you know um
so first the only thing that we're going
to have to
change let's let's do a little
refactoring before we think about gpu
let's see if we can implement any of
these ops in terms of other ops
let's move dot down here
gem
sorry it's hard to refactor with the
text big for you people
how i do a mean i do a mean somewhere
how do i do a mean if i can't divide
let's look in the tensor library and see
how i actually do that
because divide doesn't work
oh maul div
yeah okay so we do the reciprocal here i
get it and the reason that we have to do
because the devop is kind of flaky
um i'm not exactly sure why but
i don't know something weird about that
gradient so we probably actually want to
implement div
but then we'd have to figure out what
the derivative of div is and i don't
know how to do that
okay uh add some
mole pal and sub
maul
actually should we make sub
just be a maul with
we could just make sub a mall and an ad
no then we're actually doing a multiply
okay let's make it an invid ad
uh what is that op called where it's
just a unary minus sign
uh
uterine negative
i mean okay theoretically we can
implement that just in terms of those
things but i don't know
no never mind is boring those are fine
i'm just trying to figure out like what
the minimal set of ops is
all right so we definitely need an ad we
don't technically need a sub
but i don't actually want to implement
it in terms of maul
we definitely need a pal like a sum is a
totally
different thing so that's fine
um we need a dot
we need a pad
we need a relu
um
all right let's call these like
uh i'm gonna call them like
simple ops put pad 2d
and reshape
and then activation
ops
relu sigmoid large softmax
we have the calm
and we have a couple pool amps cool
we're just going to call them activation
ops
so
convox
one two three one two three four
five six seven six seven
eight nine ten eleven twelve
thirteen fourteen
okay so we have to implement 14 ops
now unfortunately
so one beautiful thing about uh
about things like the qualcomm
snapdragon
is that the gpu and cpu have unified
memory
so i think that's true for the intel
graph it's probably not even true for
the intel graphics it seems like it has
its own memory
i don't know but either way we have an
amd
radeon pro in here and that has four
gigabytes of uh
of uh
normal memory so that's sad
we do have to make like broadcasting
semantics work
i will add that to the to do
make broadcasting
work on the backward pass
simple please
so you guys know what broadcasting is if
you don't know what broadcasting is get
ready i'm about to educate you
okay uh so let's make a whole bunch of
zeros let's make like ten zeros right
uh important on pi as np all right cool
we got ten zeros right
notice how i can add a one to ten zeros
i just broadcasted that one
across the 10 right i can do it even if
i make np dot ones one right
and then here i can add three to this
and beautiful look it's four on all of
them right um and i can even broadcast
you know i can broadcast on uh on axes
right
so if i do that and then i say like np
dot array
this isn't going to work exactly but i'm
adding two to the first one and
one to the first row that's not going to
work because i have to reshape this but
if i reshape it like this we're going to
get a row of twos in a row of ones like
that right
so that's called broadcasting now
unfortunately my broadcasting doesn't
work on backward pass
so we have to make that work
um what has to be broadcastable
yeah probably everything i'm not like
the pools and stuff probably just the
basic ops
because i'm not a real twitch streamer
well i don't have a sub counter
oh that double line is so annoying
mr pool can be so annoying who remembers
what that's from
that is so true
i can write that better but whatever
see what other lines are absurdly long
this line here is absolutely long
the line's long too but i don't really
think there's a better way to write that
line
yeah that's uglier
remember guys tiny grad is a work of art
so the code has to be beautiful
so yeah we're gonna have to rewrite this
on the gpu if we want to make training
actually work
let's run the ops test to make sure it
didn't break anything
looks good unfortunately my devop is so
i'm gonna bad out again
more white space
all right
hi opencl
gpu tensor library i mean you know we
really could we could back the whole
thing by uh
we could back the whole thing by um
you know what you would call it so we
could bag it by uh
pie torch
but that would be cheating um
yeah so okay pi open cl
oh wrong pip
so i think everything would work if we
just used well not exactly
we'd have to make a small change to
tensor
then we have to dispatch the ops
depending on whether we want to put them
on the gpu
or not on the gpu so we'd have to make
gpu tensors work
okay we now have pi opencl let's play
around
salvdelg thank you for subscribing
import pi
opencl as cl
this looks fun
if we can make it work totally without
numpy and just cl
no because we still want to pass any
things in numpy we want we want our
creation ops to be a numpy
we don't have to go crazy with uh
creation ops
will require numpy
and then we can write code like this
which is actually kind of really nice
um
wow okay that works really well with uh
okay i think we should do this work in a
branch
start with a branch called gpu and then
we want to add a dot
cuda method yeah take that nvidia dot
kudo what do you think
um
don't try uh except around this
even though it's not cuda that's right
we're gonna genericize
cuda just like kleenex yeah
let's genericize cuda yeah
accept import error
pass no
gpu support
all right so we have dot cuda um and if
we dot coo to something we're going to
want to
copy the buffer
to the gpu so
oh we need a context
um
where should we create the cl context
maybe up here
is it really called create some context
i think i have options what
oh my god this is so hard
i don't like create some context
hmm
no when interactive is true
i can just say answers
has no attribute pop oh cool
can i do minus one
no minus one okay
um
change if you don't have mac
okay we've created a context
now we need to make a buffer let's
when you do dot cuda dot cuda
i wonder what cuda is it means generic
gpu computation
yeah um self.data
equals cl dot
buffer host buff equals self.data
yeah okay so now should we try out our
nice tiny grad
um from tiny
grad dot tensor import tensor
oh
tensor
we should do this in a notebook
warning it's not float32 really what am
i doing i can just say tensor.0 is 45
that's better code
yeah use your abstractions all right
cool mf is not defined
cl.memflags
oh great okay
let's do this in a notebook
uh did i create
do i set the path right yeah yeah good
okay good so now we can develop this in
a notebook
uh tensor dot zeros
all right we have a z tensor
now we can say z dot cuda oh
let's see what happened oh pi opencl
buffer what if i call it again
ah bites like object okay uh we should
prevent that
uh
self dot gpu
is false
if not self.gpu
and then we also need a cpu
so this actually moves it in torch it
makes a copy
how do i feel about that we'll see
we'll understand about that later
[Music]
i think cuda return self
um then we have to figure out how to
copy it back
so how do we copy it back great
very complicated
and we have to create a cue as well
we'll create a global cue
okay so we have to copy this back from
the gpu
i don't know if i like how i'm doing
this but
let's play with a little bit more and
see who we're doing
okay that creates a buffer
where does a.n.p come from oh it's here
you can't just do that can i can i what
if i do
z dot data expected an indented block
let's move to crop
cookies who has cookies
steal my token
right but now where'd my chat go really
there's my chat
other windows not just that one great
how many people are watching right now i
can't say
um 641 cool
okay i think we're gonna have to track
the shape out of band
the size is into zero what
well one hundred um
assert
ah
self.data.dtype equals np.float32
um only float32
on gpu
uh and then we're gonna also say
yeah i don't really like this
you shouldn't be able to change the
shape
so we're going to say we're actually
just going to change the api a little
bit here we're going to say self.shape
equals data.shape
and we can remove that
all right
and then shape will still work
so we're gonna need a
when we copy it back um
we're going to say self.data equals np
dot empty
self.shape uh d type equals np.o32
and then we'll just say cl.nq copy
in the queue we want to copy from
oh no we just close data data self.data
cell.data equals data return itself
okay so now we have cuda and cpu
just like torch so let's just test
sakuda cpu
uh pi opencl buffer has no
what
cool works well oh we have to set
self.gpu
chad i don't understand how that worked
at all oh it didn't work
good all right we have copying tensors
to the gpu
and back from the gpu working
now we're gonna have to modify the
dispatcher to dispatch for gpu ops
oh this is so easy
copy tensors to
and from gpo
sweet
why does the efficient net example crop
instead of resize and stretch because
stretching is disgusting
you know sometimes it makes people fat
sometimes it makes people skinny
either way no one's happy if you get
cropped you can't really complain
yeah i hope you guys are trying out tiny
grad you know tiny grad is a great open
source project
and it now runs efficient nets so you
guys should try it
we're going to add gpu support
yeah yeah i'm talking to them
how's curtains going
did you get the right job or you're
gonna wobble the small drill bit around
to make a big hole
that's right always get the right tools
you'll feel better
you'll make the perfect hole you'll feel
so satisfied
okay your one
yeah yeah we gotta drive to la boys you
know going to halloween party tonight
in the presidential suite
is riffraff too copyrighted to play
uh
no riffraff's not copyrighted there we
go
look man if you want to dmca me and take
me down
do it do it you know what you can live
life afraid of the government or you
cannot
and i don't live life afraid of the
government but you know i'll probably
end up in jail for it one day
but hey man you know uh
what by not being afraid of the
government
people are scared of the government man
i'm not scared of government yes
that's right they don't like they don't
like new york
i know i know i know but you know it's a
free country at least that's what the
government told me
free martin shkreli i agree with that i
agree
you know we were talking about who we
should pardon he's on the top of the
list
donald trump if you're listening i will
actually go vote for you if you pardon
martin shkreli
alex is sorry but she needs to get this
done
tensor has no attribute ad why does
sometime they not get registered
um hmm
whatever we'll hack this for now
unsupported what what
what are you saying alex
i'm busy
now look guys if i get banned it's you
who lose out not me you know
i was kidding about buying meth by the
way i've never bought meth in my life
certainly not with twitch subscriber
dollars
all right so we have to write an add
operation
let's write an add operation
um
we got a pull request what'd we get a
little stretch instead of crop
fix temp location for windows
oh that's disgusting
wait can't we just get tempter doesn't
this work on linux too
is temp file built into python or is
this some library that i now have to
have
yeah yeah um
yeah you want to change that uh
you just don't don't i'm sorry i'm not
logged into github right now
but just don't put the uh modifier to
not be different on linux
um you don't need that if statement the
temp file one is better and more
pythonic
uh no no
no that's no i'm not doing that
what the guy's trying to stretch my
images
you know someone's going to be you know
someone's going to look fat in a
stretched image
they're going to sue you know we just
don't want to take that kind of risk man
what
oh
you hit concrete
you're a masonry drill bit
alex i don't know what to tell you this
is your project
what i never complained about anything
masonry drill bits usually have a little
thingy on them
yeah yeah
hmm
so ctx is a function
let's just add it here
let's say clctx equals ctx
does that work um we can also say cl q
equals q
you know what let's not just call these
generically
let's get ad working on the gpu and then
i think i'm happy
and that's the stream because i gotta go
to la we got a party to go to
what
what do you mean
we're very cool very cool man
if i was in high school now
shit i was popular the first time in
high school
i've been watching sabrina the teenage
witch right so this is what i've been
thinking about a lot
being cool in high school and stuff
um yo high school was was the best time
of my life
that's why i was into emo music
you guys ever see the show do over where
joel
pretends that he wrote time of your life
by green day because he went back in
time
that's a show joel
he was in the show called do over let's
see if we can find it
um about a man who gets to relive his
childhood
joel yeah i knew his name the series
begins showing an adult joel larson as a
single depressed paper salesman
disappointed with how his life turned
out
well
no no no i signed up for hulu i know i
you know who signs up for hulu but
um i am not a bug man yo
all right all right harassment
architecture
speak speaking about bug man
um
all right i forgot we gotta write actual
code here
let's go let's just copy
the opencl example
rig we have to create a write-only
buffer
should not be a dot n p it should be
this is x not size is that right
rig dots um we should probably
pre-compile this
to do pre-compile on import
question mark
yeah maybe not all right we want to prix
some
it's not the ctx we have to say cl
say ctx dot cl ctx
ctx.clcgx
ctx.clq
oh
i can't do a dot shape there but again i
think if i just do x out size that's
fine
none uh x y
res g return
res g
let's try that
bye bye chicken picture
why are you guys highlighting messages
this looks like it's time for sub only
chat
inconsistent use of tabs and spaces
why don't you just order an apartment
with curtains
luma came with curtains
yeah but it came with curtains and
douchebags
actually no most of the people in lumo
are pretty nice
i don't know about that
why would they make why would they if
you're just going to make that mf why
wouldn't they call it cl.mf
you know
unable to compute length of object
what
oh i think do we have to put x dot size
in
these thingies
[Music]
ah that is okay
[Music]
lcl buffer
well hm
would like duct tape
oh you just want if you're screwing into
masonry you're gonna break your screws
goddammit
george has 41 000 followers of course he
was cool in high school that's right
that's right you know because like
bowling for soup said high school never
ends and i'd let you listen to that but
it's copyrighted
i'd also let you listen to the candyman
you know no we're gonna listen to the
candy man you know
the candyman can you know that song
gonna we're gonna yeah
you guys can hear me i hope you enjoyed
wonka time
is that the new vegas song
wonka time
um
oh the tunnel scene oh yeah
um why is this an invalid value i don't
get it
hi opencl buffer we can check the size
it's 40.
um
we're printing stuff okay created that
now why can't i go to cpu clnq
read buffer failed invalid value
what's invalid
that's how it does in the example right
we return res g
right only we don't copy any buffer
and some submit it to the queue
claim you copy empty like why doesn't
that work
oh
this is n bytes i see
my size times four
because it's float32
um
yeah so this is still wrong
shape is not data.size shape is dated at
size over four
well it's not a registered thing i want
to add
there we go all right
aside from the fact that it's way too
big
for a reason i don't really understand
because that should just be made with
shape right
so what if i say z three dot shape so
not temp
somehow 40. that's 40.
that four does not get loaded but i
divided it by four
or am i not needing to multiply that in
somewhere i'm actually making the buffer
way too big
uh no they do n bytes right
x dot size oh no x dot size okay i don't
need to change that because that's the
gpu tensor okay look at this
we have an ad on a gpu
whoa that's wild look at that
tiny grad can add on gpu
add on gpu
um all right should we uh should we try
some speed benchmarks
so let's just let's add a whole bunch of
times
what invalid arg
size a
oh that's not right
we actually don't want to enqueue the
size
because that's going to run off into
junk
memory we want to enqueue just four of
them
divide by four you see why we have to
divide by four
because it's like mixing up bytes and
not bytes
okay still wrong
10 cz2 data that size okay
why does that have size to oh no
oh because we converted to the cpu oh
that's stupid
um it should really make a copy let's
make a copy
instead of doing that
should make a copy right
sometimes
i'll just set that we just return tensor
data
we do want to make a copy and return the
copy
ah two three four
all right let's make big arrays
and now let's do time it
not time out
probably triggered reimport so let's do
that
unbound local variable oh
stupid
adding gpu so why no rock m it's not
actually cuda it's opencl
oh my god we're actually dispatching a
kernel for each one of those ads
that's terrible this is going to be so
slow
why can't time it just do the smart
thing
star child is that a real name
what separates setup code from code
in the first line of setup code
oh my god it's printing so many things
it's disgusting
oh there's no tear down code
okay so that's how fast add is on the
cpu
now let's check it on the gpo
what oh it's not gonna work because we
don't have cpu ops enabled
terrible terrible who wrote this
terrible code
well i don't know that seems pretty fast
to me it's doing it
in it's adding numbers so fast
adding works
yeah i'm doing low text yeah and it's
it's bad
uh opencl is cool we are ahead of the
curve i really hope this supports opencl
2.1 so we can use all the latest opencl
features
and apple i know you want to deprecate
opencl
and i'm telling you right now don't do
it usually you make good moves look at
how you've moved the world to usbc
look at how you've moved the world away
from cd-roms
look at how you've moved the world to so
many great standards
yet you insist on shitty metal
consider ditching metal and moving back
to opencl
this is my plea to you you can make
opencl the standard
for the future and not fragment the
ecosystem
microsoft consider moving away from
directx
i know this is going to be a much harder
sell for you but the whole world
supports opengl now
you know what's beautiful about opengl
and opencl the openness you know what's
terrible about directx and metal
the closeness the fragmentation the
wasted hours
of millions of hours wasted on your
fragmentation
because you insist in having your own
stupid standard
it's not better it's worse for humanity
ditch metal go back to opencl
there's no tear down code too big
look at that it turns out if you add
zero
if you add one to zero ten times you get
tens
okay how much do we need to write in
order to support tiny bobnet
well we need to write a gem we
definitely need to write that
oh my god all the all the tests are
gonna fail wow
all right well let's let's work more on
the you guys can write the ops
i believe in your ability to write the
ops
um for the gpu branch
but let me work more on the actual
skeleton of things and then you guys can
fill in
all the ops with pull requests by doing
pull requests to the gpu branches
we can get the tests all working one at
a time again
oh this is going to be so enjoyable for
everybody involved
yeah i'll work on the skeleton of things
maybe a little bit
i gotta fix that shake issue
[Music]
that would be kind of nice and then that
would be a better uh
maybe a cleaner way to support this
so right now
the problem is that you can't do z dot
data dot shape
because pi opencl cl buffer has no
attribute shape
we might be able to do this
is that going to work we can say z.day
to that shape
oh hell yeah
let's go let's go all right
so now we can get rid of
we'll add shape back as a property
make sure every whenever we create a gpu
tensor we set the shape
whenever we actually create a buffer we
have to set the shape
so we don't want that anymore that's
junk
um we don't want that anymore
just do else here no that's not true
because of that
uh we shouldn't check the d type
anywhere so that should be okay we just
have to make self.data.shapework
so where do i create buffers
um i create one buffer here so we have
to say reggie
equals x dot shape
uh helper
buffer like so we'll make a buffer like
thing
and then where else do i create
buffers and i convert it here so we have
to say data.shape
equals or actually i could just say
self.shape
yes yes that should work
and now we should be able to add weirdly
shaped things
well let's make sure it actually does
work
oh what's 22
oh you know i'm a no guy you know i'm a
no
you guys don't know that shit no they
can't no alex
all that is all that is is basically
saying give me a thousand dollars give
me a thousand dollars i'm not gonna give
you a thousand dollars
okay i'll settle for a hundred oh that's
so much more reasonable here's one
hundred dollars
that's all that is
hey you vote your conscience but you
know just fucked
up it's fucked up exactly exactly
exactly you know boys i'll tell you who
i'm voting for
i have made a decision to not vote
because you know what if you vote you're
complicit
you're complicit you you by voting are
either
enthusiastically supporting joe biden
or donald trump and let me tell you
about doing that
you're complicit you're saying yes
system
establish the california privacy
protection agency no
no fuck no i don't want to establish
anything i want to dissolve the state of
california's government
all right let's make that one work
tenser has no attribute ad
i'm getting so sick of this
something about auto reload doesn't work
um colonel said hard failed and valid
argument
great i don't really understand that
let's first make sure i just didn't
break anything yeah it's intentionally
confusing because they hate you
this is the state reminding you that
they hate you
just vote for kanye you know you know
you can you can then like i'd feel the
urge to vote on some of these other
things and you're just you're just
lending you're lending legitimacy to the
whole system
yeah but i didn't vote so you know oh
there's big problems are the healthcare
to college i didn't vote
oh you voted oh well yeah you know maybe
that was your problem
um colonel said arg failed invalid
kernel argument
why do i have an invalid kernel argument
i said on lex friedman what i want to
see i will vote when they give a math
science history and civics test
to the candidates it's like are you
smarter than a fifth grader
but for the candidates see yeah what was
my idea
you can't steal my ideas oh i'm saying
res g
equals x dot shape we actually want to
say g dot shape equals x jot shape
yo you guys should have caught that bug
you know if you weren't all thinking
about stupid crap like voting you would
have caught the bug
[Music]
that oh look it already works
how did that just work wild
cool
we stick shapes in
no anarchy sucks man don't don't be
anarchy
anarchy you know i went on a date with
this girl it was an anarchist and i told
her
that you know let me tell you how
anarchy works it's just
you're the slave of whoever has the
biggest gun which is what we have right
now
but at least the guy with the biggest
gun is you know
government now
wait wait if you vote yes on that
they're gonna get less
so sometimes you can vote yes when yes
actually means less but this is rare so
they're asking if you want to remove
your requirement
well i'll read you i'll read you this
there's a slight star codex about this
um about
this light star codexes um
it's about you prescription hicks is a
meta
republic uh the representative for
monarchy is a hereditary position the
representative for democracy is elected
the representative for plutocracy is the
richest person in the country see i like
this guy
the representative for monarchy is an
honorary position
it doesn't really matter who holds it
because their only job is to vote no on
everything
except for things that are sneakily
phrased so that no means more government
in which case they can vote yes
[Laughter]
but in that in that prop did they also
put something about how they're going to
like divert the police officer funding
to like
you know some dudes pockets
i was about to say large rainbow flags
but i realized that i would
probably support the large rainbow flags
i'm a proud no voter
oh yes
oh good my my my gpu is working well
it says anarchy is bad then rejects
liters literally any other system whoa
whoa whoa whoa whoa whoa absolutely not
that's not what i'm rejecting did i say
i'm rejecting every other system
i vote for blockchain but blockchain is
not on the ballot
only old white guys
you've not voted several times and it
felt good each time oh that's what i'm
talking about no
you want to know guys really why i'm not
voting because i got a lot of text
messages telling me to vote and they
were ads
and like i want i want to convince the
world that advertising doesn't work
you know whenever a company sends me an
email about like hey you should use our
product hey do you have five minutes for
a phone call
that's okay i let it slide but if they
give me a call or text message with that
same shit
i promise to never use that company
again like i want to
punish people for advertising i want to
make advertising spend
have negative roi so it will stop
but ads do work see that's the problem
we need to make ads not work we need to
band together
and on like whenever we see an ad if
there's an ad for pizza hut buy dominoes
if there's an ad for dominoes buy pizza
hut
if there's ads for both of them support
your local pizza store when that guy
gets the idea to buy ads
to support i do like trains
look i love trains too but alex
okay they do say the representative for
monarchy is allowed to vote his
conscience
once but then must resign the position
should just buy nothing that's right i'm
moving to the woods i'm raising chickens
but they're going to be like those good
chickens in indonesia
not like the shit plump chickens we have
here you know
you hated voting are you enjoying it
well one person on twitch said that they
didn't vote
and it felt really good so i'm excited
every time i vote i really don't feel
good about it every time i don't vote i
feel good
tear up the ballot do it
do it don't vote we're in california our
vote doesn't even matter
except voting no on the props might
matter but
did you vote for the cow train i did you
well
i can't believe that everything else
1 8 that's where it starts 1 8
out of what i really like we don't even
live there
there's no fucking couch wait a second
is this a san francisco ballot
yeah oh you're voting remotely in san
francisco wait that's a san francisco
tax
yeah fuck them accelerationism
accelerate your opponent decelerate your
tribe vote good things for san diego and
ship things for san francisco
[Laughter]
who's going about one
he does let's look him up rocky de la
fuenta
rocky de la fuente
oh he's an american business oh he looks
kind of like trump
what's his deal he campaigned as a
critic of donald trump's immigration
policy
that is true that is hate donald true
immigration policy
we actually don't like the immigration
policy they've been enforcing well
whatever bullshit that yes yes well
i don't know
we are pro more thoughtful immigration
but we're also
me personally i'm anti-voting no i mean
you know
it's ridiculous the immigration policy
in this country is ridiculous
no uh wait wait but let's let's you want
to read you want to read his stances on
immigration yeah
let's see what he has to say let's let's
let's let's check out his website am i
an ad right now
um rocky his website is rocky101.com
it looks terrible kyle guy looks like
uh wait let's let's let's see what
rocky's stances on the issues are
universal healthcare she's expensive
shit
uh
[Music]
he does not have an immigration plan he
just wants to change the rhetoric on
immigration and probably enforce the
same
shit
i don't um i don't know i don't know
about this guy
just i didn't hear
that people just like the way that kanye
got onto his ballot
was people just voted like he didn't
even want kanye
vice president people just voted for it
um you don't get to choose like your
vice president in some of these parties
they vote for it
if you burn your ballot you should burn
your passport too
you know what i love who not voting
offense
like like the fact that people are
offended by me opting to not
exercise my voice that is my true right
as an american
all right
alex i feel so liberated knowing that my
voice doesn't matter
[Laughter]
your choice can determine whether
california
goes biden by 72.339
or 72.339 notice how i said the same
number twice because you're a rounding
error at float32
actually you're probably are you a
rounding error in float32 i don't think
so
you're definitely you're definitely
around here in float16
i'm hungry too you want to order a pizza
what do you think of that but like good
pizza i only order
yeah perfect ah that's good i'm not at
the electoral college
wait the popular vote oh god that's
worse
yeah i've i support
i definitely something
do we really want fucked california to
have more impact
no no i support i support some real
something i would really support and i
would vote for is voting
reform
yeah the reason i don't vote is that the
whole thing is so fucked you know
like if if they would well i want i want
i want uh range voting
i want to be able to give every
candidate one to five stars we add up
all the stars whoever gets the most
stars wins
love that i think it like best expresses
the voter preferences
it's not complicated everyone who's ever
raided a restaurant understands it
i'm also okay with the thumbs up thumbs
down voting
but notice how every website has moved
to this
you know twitter doesn't just like take
the popular vote and show you one tweet
you know
imagine twitter did that
[Laughter]
votes waste based on taxes paid i would
definitely support that though i think
we should make it quadratic
quadratic voting based on taxes paid i
would love
um
little pieces we have we have a ribbon
all the time
well this turned into a political reform
stream guys that's why i don't vote
you know every time i think that my
voice might make a difference i remember
that it won't i don't vote
all right
um no actually i think i've told you
guys that i actually would support
dictatorship as long as we got a good
dictator
that's the problem though and that's a
hard problem to solve i'm not saying
it's easy right
like right now elon musk is my choice
for dictator
um i think i want kanye as co-dictator
but the only right co-dictator gets
is the right to kill the dictator but
then it just goes back to what we have
now so elon musk's dictator and kanye's
co-dictator with that one right
what
detroit pizza yeah i don't know chicago
pizza
the chicago pizza place in north park oh
yeah
how do i define a good dictator my
vote's for elon musk
how do i ensure they don't become a bad
dictator we have the code dictator
who's right it is to kill the dictator
and then i think we should have a
co-co-dictator too who can kill the
co-dictator but then you don't have to
go any further
than that but if the co-co-dictator
kills the co-dictator
i don't think he becomes co-dictator
i think he has a 50 50 chance of
becoming codic data we have to do some
game theory on this
is on here eggies whoa
um you complain about california votes
being worthless and the next sentence
you say the popular vote is bad
you understand that if there was a
popular vote my vote would be just as
worthless right
like what are the odds of my vote
swaying the election zero
don't vote voting is like buying a
lottery ticket but dumber
now but i would i did say that i would
sell my vote
if instead of all those people spending
money on ads they just like you know
here's here's how much i get paid for a
biden vote here's how much i get paid
for a trump vote
perfect i love that world we can pay all
the people we can redistribute the
wealth
so you literally have no backing logic
yeah voting's dumb man
it's an emotional response you know i do
feel very emotional
i feel very emotional about not voting
you never voted see this guy had it
right from the beginning i regrettably
have voted before
it was a mistake every time
voting has been advertised to me
everywhere yeah
they put it on like discord and crap
everywhere
yeah that's why you know was it like
this in 2016
i mean it wasn't this bad but it was
pretty i don't remember that much
pressure to vote in 2016
the texts are terrible it's it's
unbelievable like i tell these people
the only thing i would vote for
a law banning the texts i i vote for
that but now we're gonna have to fund
the commission
and then you know wait why doesn't att
just ban the texts
i want to be on the block list too um
no you can send me a text but it costs a
dollar
what do you think of that imagine you've
got a dollar for every text
they just have to apple pay you a dollar
with every ad text
that'd be great um no they tell me and
then you know
sometime they call me about a candidate
and i tell them that i'm a felon and i'm
not allowed to vote
and i told him it's because i killed a
guy in reno and if you have a problem
with that
you know shouldn't call me
just get good stuff on it don't get it
don't get a bad pizza there's no such
thing
i know i spoke that's very generic
um it makes a copy right
the torch one makes a copy i don't know
either way the tiny grad one makes a
copy
all right
yeah you know i really shouldn't
register like this
can i use like a dispatcher i think
there's ways to like
need a dispatcher
do i catch the bad calls
catch all oh
member access class
there's like a way to do this right
python
we're going calzone
that's a good choice
are we over kanye's only on for vice
president
i would just write in you know
how do you make your vote have impact
pro tip don't vote
uh no i always use python because
python's the best language ever to exist
except that it's slow but someone's
gonna make it fast yo
these piston came out um
and they released this and then i'm like
oh okay you have releases for for ubuntu
um so i'm like i'll try to get it to
build for mac it's
closed source and like
you know it's sad like our plan is to
open source to code in the future but
since compiler projects are expensive we
no longer have benevolent corporate
sponsorship it's currently closed source
while we iron out the business model
like my first response is like this is
useless and no one's going to use it
because it's closed source my next
response is like
i do want you guys to have money so how
do we solve that
a proposition giving one dollar from
every citizen of california to fund a
faster python
could we get that on the props i would
support that problem
my special interest though and i'm as
bad as the next guy then but you know
one dollar from every citizen of
california to support faster pipeline
you know the government's always
spending money on crap that i don't care
about imagine they spend money on faster
prices
[Music]
is that it what
okay
ah
sounds
alex i'm deferring this to you i'm
focused on on get at her
yeah so we won't set at her anymore
we'll say
tensor dot ops
yeah yeah yeah we'll do that say here
um ops
equals that pops gpu
equals that if self.gpu
return
ops gpu sub x
um if gpu
else tensor dot ops dot append
oh no sub name equals function
uh tensor dot ops gpu so the name equals
function here
beautiful all right
name ops gpu is not defined because we
gotta do
tensor dot cancer dot
hmm add
no no no no no
add object has no attribute at
oh because okay
uh we're doing function dot apply
we'll return this
right now those don't actually
register that code doesn't run for some
reason
or it's running in a different order
partial method object is not callable
why not
isn't that exactly what i did
set actor tensor name partial method
function.apply
function
is not right
partial method object is not callable
but it should be
oh see i don't actually need partial
method
if i just do partial
but it's a method because i want to call
itself
forward missing acquired argument now
useless
i guess actually
i think i can do this now that should
work and that actually should also fix
that weird swapping issue
oh yeah okay i think we can actually
also fix that swap issue now in function
this crap um
if type that arg equals tensor
which should be what we want
no that involves going somewhere
alex if you want to go to the farmers
market
it's a free world
okay
yeah that works both on cpu and gpu it's
so much better to that register
just like adds it to the ops there
uh
okay all right we have a decent gpu
working now
now actually the test should still pass
i believe on the gpu branch
because we didn't make any of them push
them to gpu right
that'd be great i wasn't really angry at
twitch i know why i'm not a partner
um and it's mostly because
i don't stream consistently and i don't
have a schedule i know the kind of
person twitch wants you know
if my wife was being a twitch streamer
you know what to do it
not attempting to sound too callow here
what's callow
i'm reading your message because it's so
lit up
it's so purple do you have any advice
rather than sheer platitudes for
contending with
little motivation and or alacrity what
are these words
brisk and cheerful readiness
do you ever feel this sense of list like
most people do
who would sub if you'd be a regular
streamer
what's pie stone you mean piston well
that's kind of a better name though
pie stone i'm gonna make pie stone it's
gonna be open source piston
um i would support
yeah i mean i would support like like a
hunger game style
uh i i mean anything is better than what
we currently have
at least like that would be way more
entertaining than watching
i mean no i i again like i'm all for
debate diversity
we should have like a wrestling match we
should have a knowledge quiz
um you know just like think of a lot of
reality tv shows and we should just put
the presidents through them
remember when you're playing the hunger
games
wow it really is like the hunger games
you know when you're playing the hunger
games you know what's secondary you know
what's that is that alyssa violet
oh wow
oh a rap battle oh that'd be so great
man
that'd be so great you know
oh
all right wow this is this is shaping up
to be great
oh why does a test fail let's say
can i not see it because i'm not logged
in
i can't see why the test fails
useless useless useless
but we now support gpu tensors this is
so exciting
tiny grads becoming so powerful um all
right we're ready to just start writing
ops
[Music]
well that's loud
let's just make i don't really want to
write a comp on the gpu that sounds like
a lot of work for now
let's just make tiny bob network on the
gpu
and then that's good for our stream test
nests all right so we're gonna
fetch em nest we
wanna go back to tiny bob net
we'll make tiny bobnet gpu
oh bob that's already down here
oh that's torch bobbing forward
tensor whoops
x train
gotcha nest x train
i don't want the x train um
okay let's put this up here
let's say model tensor
x train dot reshape minus no
10 minus minus 1 128 times 28
uh oh is this not what type is this
i think it's the right type
you going farmers market
[Music]
the restaurant in the building oh
that's thai food no there's like a latin
place downstairs i'm gonna go
investigate what they have
would you do like a taco
what happened to pizza i just sounds so
unhealthy okay
i understand
okay we need to write relu
dot and log soft max we actually didn't
need to write that so
so much for writing ad
all right so these are the gpu ops uh
let's create something called buffer
like x
where we just do this
i'll call this rat instead of res g
cool
i don't think we need x dot size over 4
here i think we can just say x dot shape
or even better red dot shape
um we should really write tests for the
gpu ops too but i don't think we have a
gpu
we use a cl implementation of opencl
[Music]
oh wait i don't even know if gradients
work all right let's test the minimal
tiny grad example but on the cpu
before we get to bobnet and go crazy
so that runs right now so if we go cuda
matmal we're going to have to write it
no matter what
class dot function
pi opencl gem
whoa pi seal bloss
should we use pi seal bloss
oh wow that looks pretty easy let's use
pie steel bloss
where should we not it sounds like
cheating
or is it cheating how
common is this library
cl bloss library hey
oh he's a swig
seems slow it's right fast matrix
multiplies
you know what this is good this is good
because it lets us not cheat and use
numpy like we cheated before
because that's cheating numpy didn't
exist in 2010.
remember our goal with tiny grad is to
send it back in time
what
what do you mean giving myself purpose
what are you trying to tell me
what are you trying to tell me
what are you trying to tell me
how you drive is real clear
what alice doesn't support tiny grass
because number is shitty magic
the u.s should go back to the gold
standard no i think
it should go to the coin standard
i think we should put all the monies on
blockchain
and you can fork the monies if you want
i did merge the ein sum pr after you
it takes a little bit of time but if you
read it a bit it works
um the number jet is evil magic so
that's why we didn't merge it
uh actually let's just do this
so we can just make this like this
and we can have buffer like just return
buffer ctx x dot shape
um and now instead of x dot size we want
to do
say size equals one for our s and shape
size times equals s
size equals four
we really want our tests it's our tests
um
i should just fix it
i like to add just a decorator for gpu
you know
what
oh
type object tensor has no ad
oh hmm
that's why i broke the tests
yeah because this needs to be a
static method and then
partial can't use self
i don't like that
it doesn't even work
well there is no tensor dot ad anymore
actually we can't do that because it
doesn't know about add until there's
hmm
let's just try that tiny grab function
we say
test zero dot
get at her
tiny grad function
that
torch not compiled with cuda enabled a
uh because we would just want to do it
here and i don't know what kind of crap
code i was writing
and what is that
key our tiny grad function wow i'm
writing really bad code
x is not defined okay that's a different
problem
oh we gotta convert it back
um
before we run that
well this is nice because it's going to
test the forward pass too
let's change these all to that
i guess i can just do x.com 2d right
okay and that's just because we have to
change it back
didn't work
weird look at that
it's like it's like it didn't get the
size right or something
um
probably because i'm not it's probably
the copy
actually yeah you know we didn't test
this well
we just wrote uh something where they're
all the same clearly that's happening
let me know when you want to go let me
know when you want to go
buttered noodles sounds great
that works okay
that didn't work
oh i can't do red dot shape here
god fine that's what it was before right
so we were dispatching it yeah that's
not right
that's why we have tests
cool does it work now
uh well that's because the grads aren't
right either
oh hmm
it doesn't really make sense though
because the grad
shouldn't be
grant is a tenser
the god usually is a tenser right
oh because it's comparing it to none
why is it grab not working
um is backward not getting cold
oh probably we don't have mean
um no
wait that should work
oh but it's the wrong tensor
[Music]
yeah we really want to put that there
i don't even know what was happening
but now at least the right backwards
should be getting called
yeah okay
let's just do that you can always call
cpu it never hurts
okay pi opencl buffer ah
has no attribute d type that is
[Music]
different
why is mean
how is mean getting caught there
shouldn't be a mean
oh because it's creating that
yeah so it's looking backwards
stupid gradient really isn't a tenser
i should have thought this library
through a little bit more
it's not gonna be too much i have to
change
so i've got ctx dot backwards
self.ctx uh
self.grad.data that's right
if self.gpu
self.grad equals self.grad.cuda
okay um
so dot ctx
backwards
ah even apply isn't no but that should
yeah ops gpu ad okay so now when i call
well we're calling mean
but somehow we're calling it on
how does mean work means shouldn't work
why is it calling this one
tensor pi opencl buffer with grad none
and gpu is true
so when i call mean oh
because mean is a non-first-class op oh
we have to be careful here
oh we have to be so careful here okay
well something we should definitely do
is also set d type
that's one place where we create gpu
tensors
and what's the other place we create gpu
tensors
in cuda hmm
yeah okay that's better key error sum
okay so if we want that to work we have
to implement the sum up
this is good this is good that we're
doing this because
the other ops we can leave to people but
i want to leave the uh
the basic stuff i want to write
okay some we're going to save for
backwards
input
first off why is this called some this
should be called add
kernel void sum take in an
input we return it in res g
and we just say res g sub zero plus
equals a g dot g i d yeah i know this is
terrible because we're
we see what we're doing but
okay rat equals buffer
oh buffer is a special thing
uh new we'll say
buffer new and the buffer that we're
going to return just
is uh
one
and for this one we want to say input
dot size divided by four
x rat truly terrible code
return rep that sum forward
how do we get it registered
buffer new requiring one positional
argument oh we're passing the ctx as
well
ad was not found as a program or kernel
name because that's
sum x is not defined
because that's input
okay now mole doesn't work
i mean mall should basically just be a
copy of add
except that we have to do something on
the backwards pass
whatever that's stupid to do
invalid arg size that's probably because
we didn't say in mean here
um if self.gpu
div dot cuda
don't
okay let's create creation method we'll
say gpu equals false
and then here we'll say if gpu self
oh i can't say self equal self.cuda can
i
hmm
never mind this is a later problem we
don't need this for now
sir self.data.size equals 1.
oh because size means something
different
um
self.data.shape equals one comma
warning not float32
this is getting a lot to keep track of
without food
foreign
this one backwards
oh mp.1 is like self.data dtype
data equals d type
oh yeah i just can't do that
i can't do one's like i can definitely
do np.1
self data shape that will work
okay sum has no attribute backwards
that's a more understandable error
we have to write backwards for some
turn red output
it's not going to work
um
here's a hack
yeah that's because the grad we gotta
make that change real
um
we set the grads
here we want to say
um grads equals
uh tensor x for x and grads
tensor is not defined oh
i don't even know what that means
okay better
that just doesn't work that's because my
mulgrad isn't right
okay
so
okay something else
some of these changes we should probably
make on the cpu branch first
people still here you guys watching
wow a lot of people got unbanned
chat being nice how many people we got
can't see
your face yeah
how many people we got 571 all right
that's not bad
and the gpu branch is kind of a mess
we're writing hacks all over the place
that's a big hack right there
it's disgusting wait
now
not right
x times grad output equals g y
hmm
oh tortellini's
no i haven't tried it yet
first argument must be callable
oh cause that's just wrong
okay
um
cool
stupid print
there
sweet
do all the desktops work
which is normal ad i gotta fix that funk
tool thing yeah
forward takes
honest thank you for subscribing
look at how our forward pass works on
our gpu it's so beautiful
see if we can make the backwards
password
forward takes three positional arguments
but four for given
okay i think that's just because yeah
yeah i know what i did
here
you want to do that
perfect
i don't know why it's printing stuff
well
no luck
here give all
we just get at her really
how do i check if there's an actual
attribute
well it can't be because these ones are
above this one right i probably might be
that stupid but probably not
yeah okay given square root don't work
because those are non first class ops
um
oh yo
check out that walrus boys
hmm
with function oh what's that
get at our tiny grad function
um
we forgot one in the test somewhere
oh okay
sometimes it's already landed
oh god
i hate this
who's little pump and who's hating
a little pump
off white all right off white all right
i do stars and lambdas i kind of feel
like i can't
white all right all right
oh because yeah duh what am i doing
don't do that that's going to be an
infinite loop look at that recursion
right there
i felt so powerful
so close so close
yeah we need to fix that
yeah we need to that thing where i
changed it to strings is disgusting
and should die
maybe we can hmm that
okay let's see if we can make the
backward pass work
hmm
question
nope not that
max relative difference three
where to get three from
an off by three error who's heard of an
off by three error
oh self.dated.size oh
damn it that is a different meaning you
see
um
so this one needs to be refactored
but yeah there we go
add mean and some have
working forward
backward
no luck on maul
smaller for strictly cases but not for
all cases
should work
y times grad output y times
oh duh
yeah it's not going to work if you
you do that because boom
all right i think that's today's tiny
grad stream
uh if you guys want to submit pull
requests
for the other gpu ops into the gpu
branch
i would love to see that i'd love to see
a rudimentary convolution
uh a dot fixing up some of my hacks
you guys know i wrote those um those cl
kernels terribly i should not be
dispatching a separate kernel for each
ad
um approve my pull question i can update
my cv
all right
today was a pretty good stream got some
good stuff done on tiny grad
tiny grad gpu we got the efficient net
oh wow that seems like so long ago that
we got the efficient networking we got
the efficient networking
and now we're moving toward making tiny
grad a gpu
supported library with
very minor changes the code is going to
be completely beautiful
is going to be the most beautiful tensor
library to ever exist
and it's going to support cpu it's going
to support gpu and it's going to train
an efficient net
that's our dream to be able to train an
efficient net
uh at somewhat decent speeds on my
macbook
pro where i got a big gpu i got a big
beefy gpu oh we can write performance
tests oh this is going to be so much fun
tiny grad is a great adventure uh you
know i wake up in the morning
i go to the coffee shop and i work for
like an hour on tiny grad every day
and it's just really nice you know it's
an educational project
gotta educate yourself will i stream
tomorrow no
um my favorite pokemon's gotta be it's
pikachu man you know that's just the
first one that comes to mind
like what you want me to try to sound
obscure and esoteric and say like slow
bro or something
it's actually a chickarita i i actually
didn't like the first 150
someone ever said that to me um
what counts decent speed i don't know
like we can train an efficient net we'll
train it
we'll get imagenet training working and
we'll do it all
in under a thousand lines
ah my favorite pokemon is missing now
oh you just got here i'm sorry um
uh alex did the light sculpture arrive
they're asking
oh my god it's the best fucking thing
ever
did i ever find a proper study of masks
no but i found a hilarious picture
there was a picture of the mask and it's
like the box literally debunks masks
where it says on the box that maps
don't prevent any shit uh the box
wow didn't have to look hard to debunk
that the
24 year old debunker no you can't move
them they get no they get headaches alex
they've never been moved in their life
whoa whoa whoa whoa whoa
i want to show them a little bit i know
you like the light but
all right you want to show them the
light it's not as good uh during
during the day alex alex really wants to
show you guys the light
they like your dress thanks debunker
this is my
hill house home my friend's company
it's called a nap dress it's officially
for napping oh you mean the dress
yeah wait oh this is really hard okay
okay it's a giant
don't guess how much it costs it's a
giant dome
on the wall wait but it also
it changes colors you can't see right
now it's light blue yeah it's got a
phillips hue light in it
you gotta see it from the side view i
think it's really big they want they
want full screen
oh yeah
it's a giant it's china it's a light
it's great over the bed yeah george
wouldn't let me put it
off do you see how big it is it's huge
oh it's red right now why wouldn't i let
you do it alex i'll let you do anything
you want
it is it's an indoor sun the trick's
live nose you have to look um
i let you do anything you want and
george is a concern about putting it
over the bed
yeah if i get killed by a light boy
forever you know
to be fair i'm not great at hanging
things you have to look up um
the the weather projects at the tape
the you can show them the weather
project
what's the weather project can you go in
well whoa whoa whoa is this appropriate
for streaming yes
what is it i showed it to you the
picture the olaf for elias and the
weather project the giant room with the
sun
just show them show the twitchy's art
george
the weather project not the weather
underground which is probably what
you're thinking of
were they bombed people uh whoa whoa
whoa i was just thinking of the website
where
it turns out the weather underground
didn't bomb people they bombed things
um wait where is
it that didn't
a a wrap are you telling me to record
your wrap they thought we were in a
basement no we're on the top floor it
was not called the civil war because
people were civil
it's the other type of weather project
it is they love europe it's a perfect
circle
thanks you guys i moved to all my san
francisco stuff down here so there's a
lot of stuff in the apartment right now
oh it's nice in san diego now
i want a car what
i mean i am super strong i don't want my
car to drive on its own
all right we have to pack for a like
yeah yeah yeah we got we gotta
no no we gotta go we gotta go no it's
not called the civil war because people
are civil it's like a sequel you get it
we didn't get pizza no we didn't get
pizza we ate tortellini
that's what we'd eat that's the only
coke tortellini for me and that was very
nice of her
where are we going we're going to a
hotel we're going to beverly hills we're
going to a party in the hills
not boze hills i wish your twitchy's
like fashion we have so much fashion
they don't even like my artistic
instagram pictures
we post artistic shit on instagram you
don't like it but if you post a picture
of my face
next to a cell phone you guys will all
like it you know
hacker are you sure this is the same
audience no it is
i am george's caretaker
a face arc
you know what i just realized we're
doing it we're a famous twitch streamer
art's not boring is it famous twitch
channel
why did you just decide that right now
just because you know like i'm gonna go
live in the la hills and like live with
like you know
oh we can just like pokemon and stuff
yeah yeah we're gonna live with
streamers you know what i mean
we're gonna buy like nice shit with your
subscription dollars
oh damn yo we're gonna get sponsorship
deals
no we're not getting sponsorship deals
my content is not appropriate for
sponsorship besides
i hate sponsors because it's just ads
but i don't mind when you give me money
no twitch is never going to make georgia
partner but they wouldn't no they
just cause i offered and he didn't he
refused me asking and higher ups for
help
no i could get a twitch partner if i
wanted to do it well
oh guys should i just give up should i
quit common just be a streamer
why no more open pilot but streams the
home pilot will continue
oh they love it oh yeah they love it
subscribe and show me you care
what's what's gunshin impact
by the way yeah if you know react you
want to come work a comma on front end
stuff
please all we get is ml people the ml
team's full
we have great ml people full come work
on the apps
yeah that's what's not full at all
that's empty
um you know react good apply thank you
and be
good you know a lot of people apply
aren't very good i'm not gonna hire you
if you're
very good you wouldn't fit in here
no we don't need hardware people we get
hardware people we need
front-end people front end
front end we need the app to be nice we
need the navigation
this apartment isn't working well it's
because i make fun of front-end apps for
crud but i
promise you it's not crud you're
interfacing with a self-driving car
you're not interfacing with like
well the 1099 tax form database
has to be spread we're not looking for
hardware people no
i don't mean to make fun of front end i
need to make fun of stupid apps
oh the front end department's struggling
to find people yeah yeah we need an app
designer
you can do navigation cool come apply
uh
give you names of crud apps you know
uh we hire designers only if designers
can code
guy email me on linkedin he's like i can
do it but i don't want to i'm like then
why would i hire you
oh i spoke with an office manager
candidate and i gave him a puzzle
question
and they were like is this whole
interview just going to be puzzle
questions and i'm like
if you don't like puzzle questions that
comes not good for you
like puzzle questions be ready to think
you know c and gtk3 those sound like
front-end things
i know
why would coder want to be designer
example of a puzzle question what's
seven plus
seven in base eight
who knows what seven plus seven and base
eight is boys
is it 23 i don't know
oh come on you know that stuff that's 69
what's 7 plus 7 in base 8
16 there we go thank you thank you
i'm gonna ask that question
the speed challenge is still very
relevant yes what do i think about mr
carpathi
i think he is a genius who was leading
a great project and we'd love to have
him come work at come ai
you know tesla decides that he'd have to
label stuff for the rest of his life but
i think that tesla's gonna come around
and see the light and join the end end
train
you only know vanilla javascript no can
you program well
you know i'm gonna like ask you shit
like you know i'll tell you i'll tell
you another question i ask him like i go
to google.com what happens
i'm like wow you know you can go a long
ways with that question
what connects to the server what's the
server where does it know about that huh
what do you do you just scream into the
void connect to the server
uh oh t kinter uh we use we use qt we
use qt c plus plus
uh but no you just really have to want
to build beautiful
elegant user experiences that's what we
want you for front end
yo squirrels are fascinating
the secret life of squirrels you
wouldn't believe how much they do all
day you ever just sit and watch a
squirrel
you get ads oh yeah that's a good answer
um
download the spa
i thank you all for watching today's
stream if you want to submit pull
requests to tinygrad
please do so we'd love for the gpu ops
if you guys want to write a dot and a
com
we'd appreciate you um
i'm just thinking about a lot of stuff
need tiny
tiny grad is going to be the number one
deep learning library for trading
efficient nuts
that's a lie
bye alex
bye bye this is like our home videos you
know is it
yeah bye
who's excited to hack this beautiful
morning everybody put your masks on
[Laughter]
psych
what what I said they want to do you're
ridiculous yo where's that coffee out we
need coffee coming it's coming we need
coffee oh man we had Fogo to Chow last
night eating some of them bananas oh
they were good all right
so uh to start off today's stream we're
going to figure out how to trigger the
Apple neural engine using
corl now I read a blog post where some
guy did it with tensor flow and coros
but I spent like 30 minutes trying to
get tensorflow installed last night and
I have python 39 and that just wasn't
going to happen so we didn't do
that good morning good
morning but let's go let's go let's go
okay what we are going to do is just
figure out
corala
um so I have this file np. Swift it
loads memus classifier ml model which
we're just going to copy into
[Music]
here good morning good morning
nothing like that nothing like that Alex
says nothing like never meant you guys
know never
meant who listen to never meant or is it
copyrighted it's probably copyrighted if
I get covers is that still copyrighted
never meant
cover probably pretty good it's a
cover
e
e
e
e
e
e
e
e
it's a cover can't be copyrighted what
if I do my own cover you know what if I
sing is that is that copyrighted do they
own my voice the fuck the
copyright no I
you
for
e
e
e
e
e
ah who gets banned from from twitch
you're
saying all right all right you mean from
YouTube or from
twitch
AI Bots you
know I've heard if you upset
them your future is
over so yeah
apparently this is all just
some
let's just figure out how to build these
from
scratch so we have CT converters
actually remember we were playing with
the code for this yesterday we actually
made a mod to
it what was I doing in t-u is that where
I built that
oh lib Corel python I remember that so
we got this to build
yesterday let's read like The carass
converter
neural network Builder
object so what I'm trying to do now is
uh
get we're trying to build a neural
Network
um and then we're going to try to get it
to run on the NP so then we have a way
we can trigger the NP and we can start
doing Dynamic debugging if anybody just
finds a corl model that'll already run
this shouldn't be I'm just trying to use
it properly M1 corl model uh A&E or the&
sorry
but we can just build something that we
want let's find this neural network
Builder Builder
there we go look it has a demo
beautiful we even know how to compile
the spec
already so we can just say it's builder.
speec Builder equals CT model Network
Builder
dopc non type object is not iterable oh
tell me more about this oh we have to do
input features output features I
say input features are just called
image and my output features are called
label
[Music]
probabilities 28 by 28 this is just 10
neural network Builder goes input
features output features let's see does
that
run I got import data
types
you will not be able to run predict
error reading protuff
spec oh error reading Proto buff back oh
cool look I get the same error in
both okay um
builder. add inner
product input name equals
image or actually
you know maybe we should just use their
exact
one and
[Music]
then I I should just be able to call
from here
right weights is not defined okay where
do I get
weights what what type is this supposed
to
have
I let's just make it really boring all
like
that and then what type do I want it to
have I want it to have weights equals
[Music]
m.0 uh 28 by that and that should work
for
that has incorrect weight Matrix side to
encode a
three square root of two thingy inner
product is that
right um maybe add inner products not
what I want cuz I don't really know what
an inner product
is is it just like
a
when weight is of type bytes num Pi
array or
bytes it's n
Bits oh input channels three output
channels
oh all right let's just copy this
example
exactly
and then of course this should be three
two and this should be
two okay and now my only problem is that
this isn't three let's go okay good
could predict
it so I don't even need to save it I can
just run it right here in
Python um let's make these like
ones you let's just make the bias ones
and then that should be ones yeah okay
cool wow okay good good we have core ml
working from python very easy no Swift
required now what are the odds that
we're actually using the neural engine
for
that um I just want to put a watch on D
message you'll see we have we have an
example over in tiny grad
uh& which can actually trigger the what
did I break
it yeah so that'll actually trigger the
A&E but um how do I MA Mac tail D
message
uh
of course there's no VAR log
messages oh D message
W usage pseudo D message not
that oh does we have is anyway this
journal control no it's only Linux
chat um
do you guys know how to do
this
[Music]
watch
what D message dwh yeah but I don't
think this stuff works on
Mac does it
no VAR log system
lock oh okay
okay uh
tail-f VAR log system log now when I run
this does not show up in system log what
are the other
logs
it just show up in D message when I run
that fact where is it I don't see it
never mind
mind all right we watch
watch one pseudo dsage pipe to grab
h11 there we
go okay so now when I run it you see
this shows up so that's not using corl
now if I use corl we want to get that
same thing oh it works oh that was so
easy oh that's sick
boom all
right we can delete all this crap we
don't even need the the torch
thing trigger the
A&E oh love
it let's not call it proc let's call it
a&
um core ML
n.p and we can actually move this over
to
uh fun tiny grad a commit
it oh that's
amazing that was so easy a Yo Yo I love
when things are
easy
all
right if you can't see the tiny terminal
font get a bigger
monitor all right look at this so now
with that simple Python program we're
cutting through you know we're using
thousands of layers of abstraction to
actually run
something
like we're building a very simple neural
network that just is a basically a
matrix multiply we can go even smaller
with this and we can say bias equals
false get rid of bias here get rid of
bias here that's right we're busting
bias no more bias okay so this is
literally just I don't know 3x two yeah
3x2 is
fine so we're using we're firing up the
whole complicated neural engine just to
do a a 3x2 matrix multiply but that's
amazing look at all that Dage
boom um device not open by client
what that's crazy all right we don't
need to watch anymore because we know
how to just trigger
it okay so this is what we
get an program create gated
wow look here the Zen A&E compiler so
Zen we discovered last night was the
uh was the op
code
okay
um
now
I mean the Swift Runner might kind of be
nice just because uh you know it' be
easier to
uh to lldb because I don't really want
to have to load python into lldb um so
it's just ml model. saave or something I
had this
before
um let's just make directory
corl here let's go ml model.
saave um
testl
model oh it's so
small uh now we want to just copy over
np.
Swift copy it here we'll call it run.
Swift run. Swift We want to load in
test. ml
model don't think we need any of this
complex
crap we do need this and what's the
thing
called um the feature is called image
but I think instead of a feature value
we're going to return an ml multiarray
don't need any of this
inet don't need
that um don't need that
anymore the output is just
called
CRS we want our shape to just be
three okay that should work Swift run
Swift
perfect implicitly coerced that's fine
provide a default value all right
literally the only thing it's
complaining about
is as any
oh perfect love as any
done
um let's bring the bias back we love
bias
yeah just so we can have some ones you
know um
uh my D message go watch
dnal1 D message gra
H1 got to do c
up good I mean just what we expected
it's still running in convenient simple
Swift uh anything we don't want to add
there
it's
okay all right we can compile this
Swift now if we lldb run
okay perfect now we should be able to
just set break points I believe let's go
open our gar back
up no I didn't I just built the model I
didn't convert it from anything I just
built it from scratch like here using
their neural network Builder
Library yeah yeah yeah but we're not
making it to do anything you see you
have you have
to you have to separate doing things
never never mind it's too early I don't
have coffee yet Alex coffee
coffee
coffee okay
let's close all these windows window
close the window we don't need that
window oh byebye window oh see you later
window right what level do we want to
let's get in
at the services
level my theory is now I should be able
to just set break points
right uh in fact I don't even need this
right now I should just be able to
open
just open
my this from last
night look I put a break point on
that oh
sweet boom look at that now we have have
a back tray showing exactly how to use
it ah an program for
evaluation A&E device
open all right now we're
talking so it goes through the corl
library it goes through espresso it goes
through Apple neural engine and then it
goes goes all the way down here to A&E
Services and we got it all right so
let's put the breako on program
create we're calling device open a
second time we never called program
create we have to be calling some of
these
though I guess we can finally figure out
what device op gets bald
with hello we already got the neural
engine running
look very
easy
yay we got a Le
waffle got a
waffle oh I got a w on my milk
very nice
guie oh that's
nice where what were walk today they
remembered us that freaks me out
man Le waffle go check out my le waffle
boys
no you know I was very pleasantly
listening to American football and then
there The Witches were all like it's
copyrighted no it makes me want to
stream less twitch have you heard about
that can you like reach a deal with the
music industry where they get like seven
cents of my profit it's good I got the
coffee extra
[Music]
hot it's such a good you're such a good
postmate is this a five star
delivery asking for a
friend I'll give it a thumbs up I'm I
getting five star give it a thumbs up we
don't need Stars it's only thumbs up and
thumbs
down we don't use
Stars
n you want some share Le
waffle only My Le waffle wow that's a
lot of Le
waffle I like my
M1 no we already have GPU acceleration
tiny gu we're trying to get NP A&E
acceleration we made some real Qui
progress this
morning we already got it to run and now
we can just really start just
tracing the need for A&E is well it's
not real yet but it's going to be real
soon all right so it's never calling
program
create program prepare Maybe
for
Ane power on Ane program create
gated
and here you can see a call out to the
[Music]
compiler is 4 megabytes of
cache why I don't see program create
being called oh unless it's being called
from something in here
no oh here's another one program create
new instance
maybe
no let's see is initialized platform
Services being
called
no
all right open is definitely being
called said she being called in two
places it
said that's the back Trace to get to
open
and here it creates a client does load
model it's possible that it's using the
C++
API
like once we get the device context with
that first
one let's see if we can find the C++
context for
that
we already did two Lex Freedman you want
to do more Lex
Freedman that's what they're
asking wow that just returns three
that's a useless
function is there any way to like set
break points on all this stuff just so I
can do
it
process request to about process request
direct any luck on
that oh here we go process request
direct that one's called good thing I
didn't give
up never give up never
surrender okay
so this one's being
called I think I'd be a good interview
these colds
are oh look at this oh this is
nice it tells me what the devices are I
guess that's the
arguments so I guess we
can
rename how do I rename I just pressed n
thinking that it was like Ida but of
course it's not like
Ida I think I can name this one p
device name this
one
program
request and name this one request
callback now if I go back to here why
are they still called those things I
name them better
things PA and E device program request
request call
back so this
is P
device this is request call back and I
forget what the other one
was program
request
okay oh look it's convenient look it
shows you the ABI right
here yeah we might be able to break a
lot of viewers people love when I do the
reverse
engineering oh maybe we can plug in the
monitor
think it's going to
work did we plug in the monitor for
firewatch
oh no I don't know be too annoying to
set up with OBS
anyway it would no it's bad for my neck
you
know want a standing
desk now we're changing too
much oh okay I will
fix
oh okay good oh beautiful look it's big
now oh yeah look we got a
monitor you mean how I plug into
it there
was
um oh man I have so much less screen
real estate over
here
no I have well it's bigger but I have
less
pixels can I like fix
that let's see
display I I'll I'll fix I'll fix the
stream for you guys don't
worry resolution
scaled I can only get less
pixels so
lame so lame
all right now let's go to
OBS and then I want to just set video
capture properties no no no not video
capture display capture properties
display one all
right look now it's full screen too I
know you guys were complaining about
that all
right we have some monitor now should we
try to connect this keyboard and mouse
no it's not this is never going to work
Bluetooth what laptop should you get buy
one of
these you very much
support oh we have a mouse now how about
a keyboard you going to get a
keyboard
no we can't all be that
lucky no keyboard but we do get
mouse elazer owski is a fraud I don't
know bro who are you leg who are
you
yeah
maybe I can plug in no no I can't plug
in the keyboard because my Mac only has
two USB
ports what do you have right there
oh the iPhone
cable I have never
mind what yeah yeah only two all right
all right all right all right we're on a
big monitor now it's much better for my
neck my neck hurt last night I'm an old
man I'll keep chat I'll move you guys
over here so only I can see you and here
we can see all right wow this mouse is
oh my God it moves at like speed of
two can I make the mouse move
faster Mouse
tracking speed all right
finally there's like too much stuff
being wasted now
on well you guys will be happy at least
it's bigger you guys can see
more all right so we got a call to
program process request Direct
oh and we still have caps lock on the
keyboard all right can everyone see are
we
good and remember we're not plugged in
so you know keep an eye on my battery
life
okay program request direct we're going
to go to
Tiny we're going to look at test.
CC all right I think we actually know
the names of these things
now oh you know what would be really
nice if we can get the names of the ones
for uh Ane open
device any device open here we
go yeah if you read the Cs it tells
you just
object device array is
empty any power on device open failed no
none of that's that
useful we are calling a an device open
so wait I don't really get how this
sandbox can
work because I don't need any special
priorities to call the neural engine
from there and then once I have the
uh we'll have a hack for that too we
won't actually have to make people
disable
ay I don't swap them I just have two
controls nobody's ever needed caps
lock I'm just making sure you guys can
see the screen okay we're good
wait do we actually have no you guys are
lying about 2,000 viewers oh I was so
excited you know I was like oh I'm
famous but then I remember that I was
just as famous as I was
before it's 9:00 a.m. on a Sunday it's
9:00 a.m. on a Sunday we got 940 people
here reverse engineering the Apple
neural engine right
here
Alex we're going to buy a better monitor
for you
house want from yeah well it feels
free it's from the office it feels
free bucks
yeah my
behind yeah well you know someone left
their Heart in San Francisco too isn't
there a song about that
yeah and going to Santa Fe or
something oh is all music
copyrighted okay so we are calling
program process request direct and we
think we know the parameters of
it P device program request request call
back well so okay all right all right
who knows actually how to use lldb
registers
no lldb print
registers
um show the values and all
registers in register
read okay so it looks like three
pointers definitely which I guess we
could have
known P device this is a pointer to
program
[Music]
request and this is request call back I
have an idea actually that we can know
that this is actually an h11 A&E device
and we can check that if we dump this
Ram
um invalid GDB format string it's not
GDB this is lld
DB all right
uh X32 no I don't want I don't want any
of
this this should be a v table yeah it's
definitely a v table but is this the
right V table um
print
no you guys know what I want to do
right I want I want to see what the
vtable is for
that print print print print print it's
[Music]
like GDB print
pointers
PS um
DF IND Direction requires poter
operand but I want that but
not is it
[Music]
p32 this command doesn't support
specifying
account use of Undeclared identifier
s register
read I want this but
for where's that fre where's that lldb
cheat
sheet
um oh memory
read read the
expression kind of what I want but not
exactly dump
memory info m
Al disassemble frame image
list oh use
PX
okay now let's okay I think this is what
I want but I want PX that you know I
want to D reference
that yeah yeah yeah good good good see
the good people show up
eventually is this not a v table
though I wanted to print like a whole
bunch of those I wanted to like dump
memory you
know
that but but with the with a different
format specifier so it like tries to
like dreference the pointers because
this has a name I
think P
NX no I can't or is it actually n you
wanted no I
can't might just be
print oh print void
pointer
yeah but this is a this is I think this
is actually a v table and it should know
about
it
no like you see how here it's like
dereferencing all the things and getting
their
names
I wanted to do the
same okay regards this is a program
request which looks
boring and this is a request call back
that doesn't seem right that's not a
call back if that were a call back that
would be
code so call back is a
lie um we can go we can go one level
lower and we can just look
at
warning client sending down
priorities who look at that it's
dereferencing something in the request
call back
struct print void
pointer print void pointer
pointer dollar sign vtable address
subi
yeah I think that's supposed to work if
it actually knew the thing but it just
doesn't know it well actually you know
what let's try it on something we know
it
knows no it doesn't work cuz look right
there it says
A&E you see how it knows that that's an
Services how it knows that it's this
address and it's printing
that lldb print
symbol or address
how do I get the symbol name for a
memory oh info
symbol
great
pa ah
pa yo PA was the whole
thing read register read now PA that ah
look at that A&E device V table now
we're
talking okay so we know it's an A&E
device that's good so that's already
what I had h11 A&E
device um we can even like print the V
table can I can I do that doesn't
support specifying account okay
pa um now if I do something like
this I can look and see what's actually
in this V table h& device update
parameters h& device
close program
create program create new
instance program process request
[Music]
direct crazy looking C++
shit I
okay let's set break points on all of
these
process request direct is the only one
that gets
called PA we got to remember
it oh man you know what I wish worked
Kira oh Kira would have done such a good
job of
this
okay so that's an A&E
device V
table that's
junk and that's like some call
back
what's this being said
to oh I hate that it doesn't all right
we got to make the mouse right
click
highlight
defuse
um where do we set
this oh it's just a pointer in the PA
and E
device I wish we knew what that pointer
actually was oh that'd be
nice wish we had an example of this
class
I mean this does look like to be the
thing they I don't know exactly where
they're created but it calls device
open
uh we can confirm that the device that
we're actually getting is the right
thing
but coding in Swift so long I forgot
about
semicolons okay so we have the device
open now theoretically we can pass in
the program process request direct but
we don't really know how that works yet
so register
read the M2 is going to have one
port guys watch my battery but the
battery life is is years on this thing
so who
cares M3 is going to have no
ports
PA no okay we determined that was
useless NS stack block what is an NS
stack block this seems like the kind of
thing I would if I was an apple
programmer this is a call back it's just
a weirdly formatted
callback is that broken or is that
real
wow program request is
large yeah everything's an NS
object
all right then here we
call the quest call back +
10 so we're
calling dysfunction I don't know what
this
is
oh okay sound looks like some objective
c
crap how' I get the stack uh if you want
to copy this this is actually it's I
pushed it already it's in um it's in
tiny
grad
okay I we know program request is large
maybe we can just start looking in
program
request try auto create structure see
what we
get not
yeah okay so you can see it uses the
different things for program
request wow program request sub two I
don't think that's
right is it an array of program requests
no I don't understand why it's using
neon well the struct type is
wrong create some new crazy
structure stats buffer
[Music]
pool rece
buffer so it already ran the
compiler it somehow did program create
just didn't actually call the
thing look Zin A&E
compiler I guess T is the
uh
useless
what is intermediate ml what does
intermediate mean I've never heard of
that never heard of that we can figure
out what this function
ISS I miss
Ida
we use Ida I'm not really good at this
problem I want to get better out of it
but s compute program compare compiler
version It's
aggressive
for
Zin object gen version
string we just put a break on that see
what we
got
didn't
work not a real
thing do other things seem more real
actually oh because it's a C+ plus
bullshit
references okay it's command shift F to
show the references all right
good can I put a break point on this I
don't know if this is ever called is it
real
no
no
my idea was that we could like tap in at
the compiler level
and see what it's actually returning you
know it's interesting are these files
staying around because I have the output
an input from the compiler right here
like I can probably just call this thing
if we figure out how to actually find it
permission denied well that's not a
that's an okay problem so I have pseudo
ooh look at this
yes because I yeah before the program
exited we still have access to this
sweet all
right so this is ah ah okay all right
all right we got we got some we got some
all right let's go back to Tiny grad
Annie um we'll call it
compiler uh
CP this to this
directory
yeah now where's that other one it was
in D message wow why is
the I'm not even
gonna why is that in D
message um okay that's the net pist the
output was there where did my D message
go not that
one
junk yeah this
guy oh what it has like another extra
folder
what
yeah anything in particular whatever you
want make some
Sals whatever you want to
leave just you don't know sour cream s
is
disgusting all right so this is the
output of the
compiler let's let's make some notes
here okay so we have a few libraries we
have an&
services we have an&
compiler okay um kernel
[Music]
driver
Apple
interface
um
uh
requires
entitlement that
all right now we have apple neural
engine Objective
C
interface called by
espresso um under under that we have A&E
Services which is the
low
uh
communication with the
device compile pist
into
hwx
file um where did that D message go the
D message is pretty nice
not there did I did I accidentally is it
back up here it's back up here
cool call to the
[Music]
compiler
anything else interesting in here not
really guess we put that one in there
too Zen compute program make an& program
create gated so it's crazy it seems like
the
kernel um we'll say in D message
all right now we have a compiler example
what is this hwx
file
wow Cafe babe it's a
MCO should be a I mean Cafe Vapes moo
right
is there anything online about uh the
hwx
[Music]
format
Cafe R Universal Marco yeah I agree with
that okay this is this hwx file is the
output I guess just outputs a temp and
then it doesn't
move
um it does a it does a
yeah guys no talk about Corona
virus all
right oh I realized something you guys
[Music]
are looking at me over here because this
thing doesn't have a webcam I forgot
about
that looking at
you
lower the webcam oh you can't see the
battery I did tell you guys to keep an
eye on the battery for me no we got 95%
we're
good
um
yeah okay so these are probably the raw
things that get
copied to uh
uh these are probably the raw things
that get copied to the
device 1K
viewers
yeah okay so we have image
probs is that the
kernel the interesting thing here is
like okay so I have this file it all
just looks like you
know
is that the actual
argument what's
that should I get a real hex out atar
not use
Vim not use uh oh well actually let use
Vim what is it
like
like are those the op codes for the
neural
engine
wow
and that's actually we have the input to
it
too I guess this doesn't actually
include the weights oh the weights oh
look look look look it includes a a file
here for the
weights which is read by the
compiler kernel mode Den kernel offset
wi so there's some compiler that takes
in these pists which I've never really
seen before and converts it into this
hwx format which is then uploaded to the
device yeah we might not need to reverse
the compiler I I think we can just we
can just make a bunch of pists and then
compile them and then we get our own
thing to run
them
input type output type it's it's all
float 16th that's interesting too if the
kernel type is float
32 um all right how do we just run this
compiler like those look like normal
arguments that we can just pass to a
program
somewhere and then we can start messing
with pist and start looking at
hwx that seems that seems like the most
interesting thing to do here right like
it's not like who who really cares how
the
um how we can actually like talk to the
device well I committed that file if
anybody finds anything interesting on it
tell me what to do like the reason I
think it's not a normal Moco file is
when I run
um you know when I run file on it it
doesn't say moo it just says
data
it's not actually a cafe babe it's a
it's a face beef beef
face call A&E program create gated with
those parameters uh I don't actually
have program create gate that's in the
kernel but no I I think that like we can
just that's a good point actually why
don't we just look in the current and
see what's actually doing
that can I run o tool I can try it I
mean you can try all the stuff it's it's
committed right now to the tiny GED
Branch not an object
file um but yeah let's uh let's find
that
string and program create
gated I want
Ida I don't get it why is it de
decompiling function oh it takes a long
ass
time it's
running supposedly so get get the real
jbm for
arm
finish oh sweet
finished all right so here's A&E program
create gated let's see what it's
actually doing
um all right exceeded max number of
[Music]
programs Zin compute program
make is that what's being
called Zen compute program make
maybe Zin Compu SN program allocate
shared memory
surface oh this is
interesting
for
precompiled
Mark Wait is the shit
signed I mean theoretically they could
the reason they run the compiler
from no but I don't
know not real security but like every
time it gets a little bit more
secure I that call before that call
looked
interesting checking if it's powered
up
does a bunch of Shaws like right here
weirdly in load program
segment so this is the function in the
kernel that
compiles the uh yeah Zin compute program
make
I mean where does this like come from
size then live
range not from
here is it in the
compiler it's in the compiler
okay
yeah um does this call the
compiler all right well there's a whole
bunch
of
those whole bunch of versions none of
those are my version I
believe none of those are my version
this like like blacklisted bad compilers
or something
something
huh oh no just like I guess it's like
for those versions which ones we're
going
to we're going to
uh label oh there is some encrypted
model shit yeah I've seen
that got to encrypt your
models let's look back to the
compiler
this like the entry point to the
compiler and then also if it's the
kernel calling
it let's go back here and let's just say
something like break Z remove files it's
going to work no that's a C++
thing can I set break points on a whole
Library
oh it also might not be loaded which is
why we
can't
I love all these symbols though thank
you Apple I appreciate your
symbols I don't know let's just set a
break point on Zin kernel get bites
nothing
yet
H is it in kernel
destroy um wait but if I put a breako on
something
like
uh a& device open it somehow knows about
this that's weird so like if I do
that
that oh it's because it doesn't actually
link to the
compiler yeah
um I mean yeah and then like if we trace
this all the way back I think if we say
o tool Das add this won't
work we could trace that back and we
could figure out but then it doesn't
actually link to the
compiler um let's go look in my diid
cach for what actually I think I've done
this before and I think I found it only
in apple neural
engine
ah okay it's a service see this is where
I wish I actually knew anything about
Max oh it's
a it look looks like a
uh so this looks
unused but that's probably because I
don't understand how to do
uh oh espresso using
it
any compiler engine in a
espresso
that was an app neural engine right
breakpoint set run R A&E compiler does
this
work
now can I do this for any
Services
no
yeah any compiler service
allow
um no we might just have to figure out
how to do it
ourselves
Z compute program make I'm
hry what you're
hungry oh you always talk to
phone where is
this ah here we
go here this isn't complaining about
some error that's
good so wherever this is this is like
where the you know the input parser
is set L3
allocator talking to me or
phone all scallops okay set all three
allocator references find
references
like I is so much better about
this anak get compiler options oh I saw
something mentioned anex
somewhere
oh yeah here anex
V1 who anic
compile we think of anak
compile that looks pretty
exciting oh no we have to pass
in CF
dictionaries but all right what if I set
a breakpoint on anak
compile the problem is that it's not
loaded
because it doesn't link to it you
know something's calling that
though yo let's get goo up in here if
you think if you think uh image
lookup okay yeah I mean this is
interesting but it confirms what I
already
thought
which was that the yeah the compiler
just isn't
loaded and nothing is actually calling
an a
compile but I think it's right I think
this is the the function it just maybe
it's the kernel calling
it
no nothing's calling
it oh even though you didn't say
anything wrong a mod muted you I love
abusive power on behalf of the mods just
you saying that now knows that makes me
know you said something
wrong 1.1k viewers all
right um
I'm so bad at
uh imagine I was good at at at no no no
no I assume this has no XS except
external yeah has no XS except external
so an IT compile is probably
right uh it passes in two CF
dictionaries so this was like you create
the dictionary with
this good that's the version
number
ah okay we need a
library we need a we need a header file
should we just start trying to call it
and see what
happens where is where is this being
called is it really being called from
the colonel if it's being called from
the colonel we can find this stuff
so there's the
kernel an& program create gated so we're
looking at that function now no no that
Zin program compute
make this is a kernel
function like we can we can read
it so somewhere it's printing that log
um
not those
errors program
identifier program freed with another
thread compression it's so
complicated I feel like if it's already
parsing the monco it's because it
already
ran like then you see something like
this and you're like these are calls to
something I've never even seen
before program identifier string in
here we know Zin computer program cre
make is is actually something that's
that's that's
run where's that
lock
got M cash size sure we can find
this
we need Ida who knows how to use this
not
me S program compute make in in program
oh it's in program create
gated
compute can I like find in here
decompiler find taxt
mcash oh here we go look get M Cas
size okay so we know it's
after
that I have an it a pro license but it's
so old
now I should just open
source I mean just cuz I don't have a
lot of experience with this I'm sure if
I got better at it I mean it was used by
the NSA only the greatest spy agency in
the history of the world that's right
was that a pro NSA comment I don't know
politics is fucking
stupid
um all
right computer program make a nit
info
so we know the compiler runs after that
that's all we
know oh actually we can do better than
this it should actually
say oh here ask program identifier oh we
found
it
okay so
this is this log
here Zin
Compu SN
program
how do I go back is there a shortcut key
for this I'm just click that stupid
button the NSA can't possibly be
clicking
buttons all George intentionally
triggering dude you should be banned
no you're okay you're a
subscriber
um has mutable kernel s is it this is
this what things
happen 256
bars no you're a prime sub you're
okay
overflowing program loader what be say
can't possibly click that button every
time there has to be a shortcut key for
that I got to get better with the
shortcut keys in this program previous
history
function it's
a what is that an option a shift and an
arrow ah it's
Pleasant it's not it's no Escape I mean
I do Escape but you know you got to you
got to learn to be a pro like the
NSA I know there's things that like let
you put the eye to shortcuts in this but
the N absolutely clicks the button every
time
um all right but like is it calling this
Annex
shit
and command s dump any
clients what you get getting a Phil
smart plug so I can turn all the lights
off the bed there's a control from the
Philips Hue app yes wow that's amazing
yo if you guys haven't bought a Philips
Hue app light it's a good buy I was
looking at the app last night Alex said
it was bad but then we looked at it and
we're like wow this is amazing
oh yeah yo man we get some free Phill of
hue lights up in
here oh look it like checks the version
and then all right I see what that does
use knockof that works with the app all
right is there a way to find references
without clicking
that there has to be a better
way
could we buy Chinese knockoff phip Sho
lights you have wait Chinese knockoff
that works with the app yeah the plugs
half the price
[Music]
yo alt back arrow to go back is it just
alt no that's local back if you want to
go big back it's that but that's cool
too oh that's cool the nsa's got it
figure it out you can hit alt and then
that's local back and then if you want
to go big back it's you add shift for
big oh someone was
thinking oh they say the version from
five years ago was
better
um okay so the compiler is clearly in
user space yet nothing links to
it
wait I have a theory
um where were those texts
at here we go Library
extensions is there something in here
called
compiler h
no I I feel like that that other string
has to be somewhere else
right this A&E compiler service where is
the A&E compiler service this has to be
a thing
right oh here gidra chii oh good good
good we can all learn gidra together we
can all become better together there
moving forward together all
right people not knockof they're not
good
knockoffs no way any compiler
service was that even in that was in
apple neural engine is there another
thing called like services or
something services oh
oh
add a music to
working not thrilled by
that no some of chat see some of chat is
useful and some of chat is not wait okay
so what's that is that just search the
web where is this A&E compiler service
who can find it because it has to exist
right
what that DMG
matches that doesn't make
sense is it like a huge
file an& compiler service. SB
it's a DMG I don't know I don't know
what this is but let's open
it oh install Mac OS big
sir it's a volume
right grab
a ah it's a Sandbox profile
okay guys we're getting somewhere I feel
like we're hot on the trail of
Clues oh what do we got
here crash and core ml model
compilation Comm Apple compile service
e
interesting this is cool good find so it
is anak compile we were right about that
but there's also something called Ane
compiler service and it exists somewhere
and we just need to find
it okay so it does seem like it's in the
updates yeah everyone uses find pipe to
GP no one actually knows the commands
for
find find should optimize that use
case oh God dce no no no we're not dcing
we're going to find it where
is so first
off oh no no no I'm going way too far
with that I don't need that I just just
you know what what a find Dash
name oh of course it doesn't work never
mind that's too
hard I don't actually think I need to GP
in stuff okay we found the
sandbox ah
ah yes xpc Services inside of Apple
neural engine framework ah
called from no who found it
woo I don't know what an xpc service is
but now we found who calls the
compiler all right oh it has
entitlements core m now D kipped
allow does anyone believe that works
apple with their typo I bet you can't
DEC I bet you that encrypted models
don't work because they misspelled
decrypt
aloud all right we have one more thing
to add to our great pile of reverse
engineering fun NP Libs The A&E compiler
service wait a second can I run it
oh all right how do I use an xpc service
who
knows
you know hip-hop socks you
know
deip yeah we're in boys we're in all
right all right A&E compiler service
a yeah this shows how it
runs Apple calling xpc
service maybe espresso calls
it oh choosing an xpc
API create an xpc service in X code do
the following I I don't know let's just
let's load it up and get Dr and see what
we
got it's
loading yeah we got viewers you guys
love the reverse engineer
all the best apple docs are in their
archive yo we found the A&E compiler
surface feed faf where did the cafe babe
go
H so here's an
idea is this thing
running Oh look The Metal compiler
service look the a& compiler service is
running
lldb
DP oh well Taylor can't attach to it but
root
can okay so
now go to corl and I
run now I can set my break point on anak
compile
yes
aha
yeah all right I found what calls
it it's in the anak compiler
service yeah okay info register to
register
read all right
so the problem is that it was in a
different
process the anic compiler
service so we should just be able to
find the call here we go and a compile
yeah yeah yeah um
great here we go
this function calls
it um now these are CF types which
hopefully we can
uh dump using some LLB magic and then
once we do that we'll be rich and by
Rich I mean we'll have figured out one
more step towards you know not but that
doesn't matter cuz what are you going to
buy with money anyway a neural engine
chip you know how much money that would
cost you do you know how much money it
would cost you to buy a neural engine
chip bajillions of dollars but thanks to
the beauty of mass production and
economy we get this for so cheap so
cheap we should all be so grateful that
we live in a nice world that's not at
War and that we can have beautiful
things like the Apple neural engine CU
if we were at War all we'd have was like
you know shitty things like not the
Apple neural engine cuz who would build
that it would' have to build like the
American Patriot engine and that'd be so
boring but thanks to the good folks of
the NSA with gidra keeping us out of War
that's right that's right this is a pro
NSA
stream
um so what are underscore CF
dictionaries oh also okay so now we're
we're broken on Annex
compile um these are CF dicks I don't
know what this
is all right lldb print CF dictionary
what do you guys
think someone's tried to do this before
Oh
po p x0 oh look at that
oh look we figured out what's in our CF
dictionary
ah yeah
buddy
oh look how easy that
is that's the kind of thing that we can
make let's see what param two
is Target architecture
h13 so
easy all we just have to create those CF
dictionaries and then call
it all right po worked really well it's
one
more
oh and then an NS stack block which
looks like a
callback Well if I knew about po before
PO is the best thing ever I don't really
know how it works but we love
po all right I think we can actually
call the
compiler um what is this
thing we print the
type
horrendous
output use NS containers pretty print
carefully read the
docks who has time for
that
it's NS stack block so this is a call
back again how blocks
work all right does anyone know how to
do this in Objective C who's not an
Objective C noob
is there a
link I have to pass in a
delegate I don't know
we're trying to call an
compile I think I know how to create CF
dictionaries can I set it to null might
just
work doesn't look too
important
um
okay I thought I saved that guess I
didn't
[Music]
what
uh we need in build that
sh
unknown type name CF dictionary
I
how do I do this from not Objective C
but from
C++
compile returned
one uh there's no way anything show up
in D message
right no because it returned one because
my things are null all right how do I
create
a it's the Ane compiler but then you
call anic compile don't get it
twisted um all right we didn't pass it
anything we have to like create this
structure
now which actually is probably a huge
pain in C++ and I should probably just
use Objective C
but
that's not valid
C++ yay I'm going to use an existing PS
that's not the
question is it a CF dictionary ref is
that just a CF dictionary
pointer
like this is basic apple stuff I don't
know how to
do would help if I actually knew how to
be a Mac programmer do we have any Mac
programmers in this in the
channel this is like no this is like
Noob shit like everyone who's ever
learned Objective C knows how to do this
really well but
unfortunately I don't know Objective
C all right fine fine fine they win
we'll write it
[Music]
in in objective
say
and then we can import
Foundation I can't use that
anymore I think we use clang
that okay well there's no extern C
because it already is objective
c unknown name CF
dictionary I don't even know how to get
how do I get Swift to link to
anything can I use
Swift okay here we
go Objective C cheat
cheet
personalizing NS
dictionary did I mean NS dictionary I
don't
know what's the difference between an NS
dictionary and a
CF
what do I have to include for
this CF is core foundation so what if I
just change this to core
Foundation no I didn't mean NS
dictionary I someone's going to watch
this and make fun of me later who
actually knows how to do this
stuff um import core
Foundation
oh no I didn't mean that just see have
dictionary
ref
fine
okay all right now it's building an
Objective C with CF dictionary refs you
don't need
Foundation I don't know what Foundation
does
but now we should be able to call CF
dictionary
create not in Swift construct a swift
dictionary and use it as a CF dictionary
oh that looks
convenient
um oh do I have to like link to core
Foundation or something
segmentation fault oh because keys and
values are none okay fine
fine
um what does it have to look like input
networks output file name output file
path of the
keys
CF
dictionary create objective
save look I
know um all right CF string
ref CF array ref and array all right
this looks
right
this looks like the kind of terribleness
you'd expect from wait so what does CF
dictionary create take for
keys is it array ref const
void C array of the pointer size keys to
be
used
um
does this
work
uh previous definition is here okay get
rid of that all right that's fine
because uh compatible pointer at a const
wait wa what value may be none if the
null num Val oh numb values
oh all right well those aren't strings
those have to be like CF object ref or
something because this one's fcking
rray some of them can be
strings
void CF data ref CF number ref CF string
ref CF type ref
Valu sub one
equals is
that
wow an hour reverse engineering two
hours to
write Objective
C CF typ ref it gets less mad about
good all right value sub one equals we
got to make an array
now
uh well I think it's another CF
dictionary with two things so we got to
First create that
one oh my God I can't believe anyone did
this like there's got to be rappers for
this stuff that I just don't know
about net.
pist same input
[Music]
path I values sub
one it's not called output file name
it's called Network pist name name and
network pist
path this is a
joke and actually that has to still go
in an
array
which is
just should just be able to say null I
dictionary
one don't think I need that
either so value one equals
array we can check this in lb nicely
too
um
we cast that to a void
void okay and we still need to
do oh yeah the next the other dictionary
the other dictionary was simple was just
Target
architecture
equals
oh
oh that's not in
quotes
I don't know what that
is
um okay I don't know lb. out breakpoint
an compile
run uh read register not
registers read actually don't need that
what was that great thing
po CF basic hash immutable dick that's
not what I
want that's not what the other one
looked
like
no I didn't want that look at what this
one looked like it looked like
that type immutable dick CF dictionary
mutable I'm this close to trying to use
Swift
CF mutable
dictionary create
mutable use NS mutable dictionary and
cast it to a CF dictionary ref oh well
that sounds great that sounds like it's
definitely going to
break that didn't
work okay should we try to use
Swift
this is just it's too terrible it's too
terrible let's use Swift I I regret
doing
this
um
well call
Pro call function from Swift I mean
there's no way this is just going to
work
right
does Swift have
headers you're wearing my
sweatpants I think this was all just an
excuse to get me to learn
Swift this is just Apple's excuse to get
people to learn
Swift
[Music]
okay so of course Swift can't find that
in scope so how do I import that
bridging headers all right all right all
right Swift bridging headers let's go
importing Objective C into Swift if you
accept
oh no I want to do the other way around
no no no no no I'm not doing this no no
no no no I don't like this oh here I can
import can I import
import anak
compile
Doh that going to
work no can't Import in
Swift calling C from Swift let's try
this is really amazing from this post
can learn
much wait wait wait no no no no no no no
this looks way too
complicated
you might have been getting further with
the objective
[Music]
c give up on
Swift at least we at least we could call
the
function even though the type doesn't
match at
all wait all right
so we should still be able to
[Music]
run uh was that Swift shit corl Swift
run. swift if we Swift run. swift
again you know what I have an idea
something's calling this right can we
just look at the
code let's look at in the
decompiler uh P
x0 yeah something's calling this
right all right let's go look in the
anic compiler service and then the only
way to learn this stuff is not to read
the document like I Tried reading the
documentation you you saw me try you saw
me legitimately try I tried hard okay
let's figure out where this comes from
from CF dictionary add
value oh we have to CF dictionary add
value CF dictionary create mutable and
then we call CF dictionary add value
what do you guys
think I didn't read the instructions for
CF dictionary create
mutable create a new mutable
dictionary key callbacks value
callbacks all right this just looks like
a triple null right
now
learning objective c by
decompiling
no oh because I used an F dictionary we
there no such thing as F
dictionaries error too many too few
arguments to function call but but oh I
have to talk about the capacity pass
zero to specify the capacity is not
limited why would anyone want a limited
capacity that's just
lame okay well those can be n to great
now let's look back at the decompiler
and figure out how no not that
one not that one not that
one uh we want anic compiler service
which is what calls it okay CF
dictionary add value
perfect okay CF
dictionary ad value I think this is
actually going to work just the way we
want call like options
dictionary we
call input networks here oh that one's
hard
output file
name is this oh this code is actually
shorter
great output file
path is
this you're making
T oh okay good well it runs so ldb a.out
breakpoint on anex compile run p
number
zero CF basic
hash type mutable de how come that one
looks
nice oh I know why because this type
shouldn't be a CF dictionary ref this
should be something
else I think that's where LLB gets that
from because otherwise how would it know
the
type
um wait can I like
say something like print anak
compile anak compile has unknown
type describe anex
compile ldb print function
signature
I don't know about
that PO command it calls CF
show
uh green
please
okay I think this array might have been
fine
that all might have been
fine I know shorter anyway
now passing argument to
[Music]
parameter CF mutable dictionary
ref
okay now that's the only one it's
complaining about
good uh can I CF show options
[Music]
dictionary yeah okay so it's giving me
that CF basic hash
crap is it not a dictionary I mean I
just just assumed it was
a do you guys know
this does anyone know how to do
this how come when I print it over there
it looks like that but when I print it
in mine it looks like
that and then also what's that last
thing that I don't know how to pass
in
oh we have to add something to flag
dictionary
called Target architecture and somehow
it's h13 but we don't really know how to
get that because it's not really a
string but maybe a String's okay it's
probably some kind of enum that I have
no idea where it comes
from yes it was an issue with your array
aren't you printing the memory
references in the command line why do I
get CF basic
cash CF show CF dictionary CF basic
cash
oh is it a CF property
list
they creating there seems to
work CF mutable dictionary ra I do
that for some reason mine look different
from theirs like they have like nice
things and when I call CF show CF show
CF
dictionary
um okay let's try CF property
list
Swift
Code yeah I see that but no I don't
think I don't think that's right
oh KCF type array callbacks so it might
be
that that seems plausible to
me what are these
callbacks yeah yeah yeah maybe
this what do we think of that
pass a pointer so we got to D
that ah look now we're getting CF
string okay okay we're making
progress
okay still doesn't work and maybe it's
just because we're not passing in the
last
argument kind of starting to think those
arguments are okay uh and when we create
the dictionary I think these are the
last
two arguments
here um do that and CF aray create
too
okay okay um that all looks good now and
it doesn't look as beautiful as theirs
and I still don't know why theirs looks
different from mine
but wait actually why does it look
different that doesn't make sense
because I read the code that was
creating it and it was the same it
doesn't make
sense let's see what they're doing
different L for
me I'm reading the code here to compiler
service okay KCF dictionary key call
backs kyf value yeah yeah that's the
same oh is the h13 right no it might not
be we can check that
though um I keep losing that
window
here's the call to anac compile this is
the well let's see what how this gets
created concrete NS stack
block I don't know about
that dictionary add value what is lar5
oh it's being passed
in okay so what is the NS concrete stack
block
object what is
this I know I'm just copying and pasting
code from stack Overflow that's
right um
signature what there's a call
back Objective C call
back I googled this before and got the
same stuff and I was like this is too
complicated for
me
of course that doesn't work thank
you well first let's make sure one is
bad I mean I assume one is bad but you
know you never know don't need that one
anymore uh I don't need any
[Music]
Services any compiler
yes
so it's returning one right now let's
just see why it returns
one Weston wal though you're pushing it
you're pushing a for a ban are you you
you
you we can't type enough code in chat
you're complaining about the m mods I
don't
[Music]
know you know you guys know this is this
discord's run by authoritarian thugs
right like there's no room for free
speech in in this in this uh not Discord
in this twitch chat that's right twitch
chat it's not weed T
no oh well it's from 4chan you
know it's a 4chan Swift programmer all
right it could be my age 13 that's wrong
it could be the fact that I'm not
passing in you know what I can do
something here I have an
idea where am I running this I'm running
that over there let's
say X2 = 0
set lb set
register
[Music]
register right
X20 that's that's right I get nil now
all right
continue does it
run yeah it ran okay so I don't think
the nil was the problem
then if I can set that to zero and
resume and it
works that seems it's
fine
all right so we can set that one to zero
and it's fine so that means that that's
not the
problem all right we're we're over
bullshit talk guys serious talk now who
can solve the
problem
valid
thread all right so we're back in the
end at compiler service running the
right
way um read
register
register read
yeah wait how is that set to zero
now I didn't even do
that no it's not to
zero now it is and it runs
fine why does
theirs look like
that and what is this
thing where does this h13 come come
from yeah it's shared it's on the it's
pushed I did set the h13 to
h13
I don't know why mine has like all this
extra type information I wish that one
had all the type
information
um
lldb verbos
po
return by the
method well CF
show lldb call CF
shell I got to cast the
call yeah that's the branch
why does that
work if I po it it works but if I call
CF show it
doesn't use e to eal so
eval eval is not a valid
command CF show
lldb image lookup ooh type
h13 nothing's working right
now yeah if you do p it's it's boring
it's just
that P just gives me
that well po gives me that but I want
more info than that I want to call CF
show I I don't know why GDB this works
and then an lb it
doesn't call void oh maybe I have to put
the void there maybe it matters is
spacing
no
is it not a core Foundation object did I
get scammed this whole
time okay
um am might be a totally
wait what is
this looks pretty
similar really not similar no it has to
be a car Foundation object cuz I found
the thing that calls
it
I literally found
it yeah it's being called right
here and this uar
3 no don't no no don't find uses of
undefined eight
no
yeah well tiny grad the A&E extension
can be
more how come sometimes no I don't want
to reference anyway highlight defuse
okay it's definitely just created as a
CF dictionary mutable it's created with
KCF allocator default I mean I really
don't think that changes anything but
we'll we'll write it just so it's the
same
yeah that's just calling CF show how
come when I call CF show oh can I call
CF show here does this
work
yeah NS
show
call NS
log oh could standard out be
redirected uh ah where's standard out
going wait
oh yeah standard out's going somewhere
else
H okay okay that's fine no no no no no
it's just it's standard out going
somewhere
else um where is standard out
going
uh
Weston Waldo I don't know what that crap
is but you know you're
banned I pushed you I I I mentioned you
but you
know something about squeaky wheels and
shit
okay um so standard out is being
redirected we can fix this
uh where is it
going
console may you think
console not in
console I'm not even sure CF show is
going to show me anything different but
what's
h13 yeah it might be going to Devol I
don't know um well
actually can I fix this
call uh
uh standard
out
uh well all right let's first see is
standard no of course it's not here I'm
it's I'm I attached to this
debugger oh good idea with Elsa uh let's
call get
pit and and now we can say lsoft
DP yeah here we
go
DN
yeah
davol yeah man come and brought people
together
uh Devol thank you eloft guy you're a
bro we like eloft
guy trajin
X thank you for following
along all right is it really that my
age13 is
wrong
it's very suspicious see that's why you
got to pay super careful attention when
you're programming because like that's
almost
right I can open another FD and then use
dup 2 to copy it to standard out yeah I
can all right should we do
that
um uh oh
God
three minus
one
um oh probably because it doesn't have
like access to right to Temp or
something
attach PID d o Dev standard
out you keep posting these things and
they almost look like
something
attach PID standard
out
seeing standard out what do we
got
great shell
TTY no
ddy okay the problem is it just can't
open that because it doesn't have
permission to I think I think if we
check D message is going to be just
complaining about how like you don't
have a your process is in a shitty
sandbox and doesn't have priority to do
that or it doesn't even tell me
that
um where is it going to write the file
to I know
it's got to have right access to this
right minus
one oh I need to pass in O
create
ah is that an octal that's an octal
isn't
it maybe we can call this we just pass
in oh
create
then okay
no with
this no is that
not
oh
permission
no I know what I'll
do touch
log see
uh chod 777
log can you open log
now four
sweet okay uh tail-f
log now we want to use dupe 2 um what is
standard out file descriptor
number is it one or zero I always forget
standard is defined to be file to script
one all right so call void close
one uh and then what's the argument for
dup
2 yeah new old FD new FD call void dup 2
old FD is four new FD is one
now call void print F hello
jello it should show up
here or not
um
call uh F flash
what I did it right didn't I let check
El
off okay it opened log
I don't know maybe it's going to
standard error I don't know whatever
call
close two call close
zero dup it to all those things there we
go all right now it's just that a whole
bunch of
times Why didn't it do anything
anything all
right great it looks exactly the same as
that other thing we didn't
understand okay uh well this is at least
something all right we got CF show to
work at
least uh
is there another argument we can pass to
CF show which is like more of a
Bose oh it's printing it to standard
error too so that's good to
know um okay CF get type
ID can you put a breakpoint on CF show
and call it with the h13
thing
well CF dictionary get
item CF dictionary get value here we
go what are the odds this is going to
work use of Undeclared
identifier
cfer it's like a convenient helper which
is like create CF string
right of course I can't use
it oh battery percent oh we're down at
53 but my keyboard's probably charged
now so we can probably just uh swap that
back
okay CF show print
types CF show is ANS log for core
Foundation types I don't know what if we
use NS log feel like we're going to
crash the process
great I assume we can NS log
okay like
hello oh d to do the I have to do one of
these guys
right yeah but hello didn't show
up attempting to use unknown
class
I don't know
um create CF string from C
string
great
yeah void pointer that's not an unknown
type is it
so boring so boring so boring so boring
okay let's go void
pointer has unknown return type oh void
pointer just always be void
pointer
okay we did manage to get it to just say
h13
um could this actually be the
problem if we just put numbers in
here oh oh I have to call CF number
create
oh oh
yes
wow
CF cfar macro is a convenient way is
there CF num as
well no of course
not
their age13 has quotes and mine does not
they're also printing a lot more stuff
than
me maybe there's a flag for
that print
pointers
h13 is from a13 yeah
probably printer
description
this function invokes these
callbacks opaque types Implement
description function callbacks that
return
[Music]
[Music]
CF
string
what after all that it's a CF
string CF string
length so maybe it is age13 maybe this
whole thing is just a stupid red
hering
three okay it looks it everything looks
like it actually is just
h13 um what else could be going
on I might have gotten this all
right oh you know what it could
be is this file
exist or maybe I don't have access to it
could just be
this model espresso.
weights um let's copy that
over
we can also dce this let's dce this
Dess I change while writing
what okay well we have that
now um I don't understand why we have to
have that
compile do
Swift
junk my header is
junk
progress all right that might have been
the problem the whole
time
no d cross
a.out are we even opening the
files well came back up pretty nicely
though I don't understand why that
Colonel
panicked good chance to close some
windows maybe it's just cuz I had too
many windows open okay well lesson
learned don't use D trce on
that I triggered the M1 engine that's
right
uh your computer was restarted because
of a problem let's check out the
report kernel data
abort
D
trce crazy
bro wait
what good thing I committed to
get
yeah it crashed like Windows that's
right it's exactly how it crashed it's
really upset with me you think Apple
sent that Colonel panic down from on
high all right
well no more d
trce
we get
gidra no I disabled
sep I'm pretty sure this is actually all
right there's no other paths in here
right
well
for
[Music]
and
okay
okay let's go look at an a compile and
see where it's where it's getting
to we all good
we can try just passing like one in
there and seeing if anything
changes
like how do we know that one's not
actually the thing that we
want I mean okay cuz we should be
creating a file called hwx
[Music]
temp have to
and I didn't misspell any of this stuff
did I output file name file path Target
architecture age
13 oh do I need that slash at the do I
need a trailing
slash are youd
me when you're hacking you got to pay
attention to every little thing because
it could be one little thing that gets
you all
wrong hold that.
pist
one
it's SM permissions is it
again I failed to write to SMC stuff is
always
there
okay you know what I have an idea about
how to debug this let's just like put a
break point here and see if we get to
there
we
do
gets
here um does it make it to anex compile
procedure
it
does is this like debug is this logging
somewhere that I don't
know where are these these logs
going and how come if I pass in one here
it
panics I
mean I guess that's some call back and
like it just doesn't
work so what if I pass in you know like
not n.p list same
crap I assume that's an array but I
can't be 100%
sure could that be like a tupple or
[Music]
something do I have to reattach and
check the CF types
again
no it has the same parentheses so I I
would assume that that's
right you know what there has to be
stuff that gets these from the CF dick
somewhere right in the
compiler an anic prepare here and I get
compiler
inputs
so my guess is that's all
working but to be fair if it's wrong it
doesn't tell you
anything maybe the function definition
is wrong I what do you mean by
that
it shouldn't
matter
all right can we put like a break point
on build
Mao oh look we got errors
now file could not be
mapped
where those errors come
from
huh
error no mapping found file could not be
mapped okay that looks
good that's very promising oh look at
all these Ane compiler
swap
why do I only see that when I run it in
here oh this is the most promising stuff
I've
seen so what if I change it to like two
net
pist invalid pist file name okay all
right you know what I'll just I'll just
take what I can get I'm these errors
showed up and they're
great um error file could not be mapped
fail to get an input ready probs data
why why did these errors show up is it
because I added the
slash it
is I guess I always had that invalid
pist file name but okay
great the slash is great
okay ah finally some
progress thank you for sticking with me
through the tough time
that means you guys get to be here do
the good
times um is the problem this
file
oh what's net additional
weights yeah okay we need net additional
weights which has got to just be in the
same folder as the
pist I'm sure this is long gone so we're
going to have to reattach to the anic
compiler uh Unless somehow it
stayed oh it's stayed okay so it's just
an empty
file fail to map file net additional
weight size zero okay maybe it's not
always size zero let's go back to
Swift
um corl we want to say Swift run
Swift
I'm scared of Kernel panics
now okay so that runs again PS Au grap
A&E here's the Ane compiler service ldb
l db- p that attach fail because it's
not root that's fine uh
password TX to the process break point
on an
compile
continue run the
Swift okay now we can p
x0 X1 no
px0 now let's just look in here in my
root
shell BR a root shell
back ah net additional weights now has
size six
um
okay compile zero boom We the compiler
hwx
temp you open a PR on Tiny good now if
you're just trying to save lines we
don't want it but if it's refactors that
improve things we're
interested compiler
works
yeah okay we figured out how to run the
compiler now there's got to be ways to
upload these hwx files
into uh the weights could be created
with core ml too right yeah yeah of
course you can actually look I mean now
we have we we can write actually we
don't even need to really write a
decompiler the the the whole thing if
you actually want to decompile this if
you actually want to like use any of
this stuff in
practice um what you do is you just
attach to your anak compiler surface put
a break point on anak
compile uh print out that
x0 and then you figure you just can look
in that
directory um and look at the
pist
shit
yeah
uh how do I get send the compiled hex
from the oh to the engine oh we haven't
sent anything to the engine yet I mean
that's
that's uh the next thing to
do
I mean I guess we can work on that
next that's kind of the next thing uh we
don't just see if show this
crap it's just
offensive we got to do
cons
I don't know why there's a com
here you can also get the different
input types and output types like okay
well see the beauty of doing all this
the whole reason we did
it for some reason I have to run it in
LD to get that output but okay so what
if I say it's now a float 32 what
happens still
compiles and now okay well first let's
check to
see if they have the same
hash
what
what's
that what's
what I don't know not my
be my parents got rid of my milling
machine from high
school
just Tex yep should you sleep or learn
pie torch sleep and learn pie torch in
the
morning okay
um
so I mean it does look repeatable at
least I don't know why it's
different
but
okay so now let's make some changes what
if my bias type is float 32 still
compiles different hash right and now we
start the differential Crypt analysis we
can look at the two files and we can
figure out what changed and that's how
the bias types encoded um does hex do
compare
okay
uh
[Music]
Brew brew Cas install
hex what are the odds that's going to
work can you run P torch on your Mac
without a GPU
yeah yeah so what we figured out now is
we can now run the compil that the
neural engine uses so can do Hex
f ah so look we Chang one thing to
float and these are the changes we get
there a lot of
changes figure out how the weights are
encoded in
[Music]
here but I think really the next thing
to do is going to be to run we have to
get things
running right we have to figure out how
to upload these hwx files to the neural
engine run them uh and then we can play
with it from that end too and then we
have like the whole stack figured out
so get status so we don't to actually
change the
pist cool um let's add it the read me
okay um our
goal okay so we have a core ml
model uh so first we have like a caros
onx model
which turns
into a core ml
model
uh are using core ml
tools
open
source um we turn the corl model uh into
a
pist no no no no so um this is
espresso
uh turns it into a net.
pist
um then it's turned into model
hwx
by
compiler run on neural
engine okay
so let's just say uh let not call it our
goal let's call this like uh model
flow what we
burn no so that accelerating tensorflow
performance thing is using the ml
compute AP guy which does not use the
A&E um and even if it does use the
A&E what's
burn
[Music]
tomato
yo yo bro bro thank you for
subscribing been a subscriber for a long
time um we we can confirm that that's
actually espresso
right I should have saved some of those
back traces those were
nice I think yeah corl talks right to
Espresso
thank
you yeah I think these are pretty good
streams it's what I'm good
at all right but we Now understand it
pretty
well um so we can run this step
uh I mean the pist is just editable it's
pretty nice to look
at like we can figure out with the full
syntaxes somehow
but the burnt
stuff um
was the last time I ate an apple I don't
know but I don't go to the doctor either
because it's all scams
man like the interesting thing to do
here would be to like compile some more
complicated pists for
this this pess garbage is what Apple
should move away
from
um
yeah why is it a
com that's weird it's weird that it
makes that a
com we should also have a nice way to
like grab the pist
okay so to
do write a
nice
pist
Grabber done write a call
to the compiler with pist plus
weights to
do write an hwx
Runner
okay I think we have to write the hwx
runner but hopefully we are going to
have lunch
first um and I don't think you guys are
joining us for lunch today I think we're
going to have private lunch and I will
be back on after lunch to write an hwx
Runner do a hypervisor stream I thought
about
it
but yeah so then what we're going to
want to do I mean we can think about
like what level we want to attack this
at
right I kind of want to attack it at the
lowest level I kind of want to write my
own
hwx um yeah it's not that hard the pists
are just
XML
um hype train let's go can I click it do
I click the hype train let's subscribe
everybody subscribe get a notification
right when I'm back after lunch we're
going to figure out how to actually
launch our hwx on the neural
engine oh 100% let's keep it going let's
subscribe it's a perfect time if you
guys like this content it's a perfect
time to subscribe how many viewers we
got
um you guys
also uh can play along at home I think
we're going to we're going to we got 900
and uh uh 60 viewers I think we're going
to raid Lana Lux uh with our
viewers
um and then I'm going to be back after
lunch uh let's get that hype going uh
this is this is good stuff boys this is
this is good stuff we are understanding
one of the we're understanding the AI
strategy of is Apple still the largest
company in the
world what's
largest largest company in the
world
Walmart ah that can't be still true is
it Sardi or
ramco Microsoft wow Microsoft beat Apple
all right Apple number three the third
biggest the AI strategy of the third
biggest company in the world now you're
not supposed to close stream on a hype
train no no no we're we're still going
we're still going we still got we still
got a little bit more time um and we're
going to think about really what we want
to do here so we're going to get these
AV uh these hwx to
launch um the pist Grabber I mean we
have a method for doing that but
unfortunately it involves
uh yeah we just kind of want to
intercept the the xpc call that's
leaving um uh we can probably do that
yeah I think that crash that somebody
linked a while ago maybe somebody can do
that over lunch look and see if you can
figure out how to grab because these
files are being
written that you don't have to go to the
an and compile a service to get this
yeah Apple's that's what I thought like
Apple's market cap is way bigger than
this market cap is yeah it's a two
trillion yeah Microsoft's way smaller
this is the largest company in the world
and we're figuring out all the secrets
to their AI strategy right here on this
stream um looks like it's also using the
A&E so you think ml computes using the
Ane there is some hidden code to do
it no no no no no no no no so you think
you you can pass in all so all actually
just means CPU oh it does say including
the neural engine but it's a
scam like I watched what it was creating
you guys saw me do that on the stream
yesterday um Apple's not going to sue me
for this I'm using their their their
their
thing what's someone going to do run
pirate
models um
n this is completely legal there's
nothing illegal about
this and dmca is about so okay I mean
DMC would be the only thing you'd think
about but that's about controlling
access to a copyrighted work right
there's nothing here that controls
access to a copyrighted
work are we hiring new grads or interns
only if you're
incredible you think like like some
people think I had a phone call with one
guy and yeah yeah you know he wanted to
come to Comm to learn and I was just
kind of confused about this like you can
come to Comm to learn that's great
learning is great but then we get a
little bit further in the conversation
and he wanted people to teach him I'm
like bro you understand when you're
doing education the money flows the
other direction right like like like
like you you don't you don't get paid to
be educated you you you you paid to be
educated right and again you know where
you going to be educated right like how
much you think it should really cost
um yeah so there's some I think it's
going to be supported pretty soon
because there is an ml compute A&E
Library um yeah education should be free
them government dollar should pay for it
yeah yeah yeah yeah yeah let's give more
money to the elites let's forgive
everyone student
loans
um you can have public education right
you can either have Socialism or open
borders you can choose you can't have
both um no no no we're not we're not
trying to reverse the SE what we are
trying to do is add support for
um the neural engine to Tiny
grad like this all still looks like
thank you for subscribing fifire thank
you thank you for subscribing
is it almost lunch time yes my last pie
of butter oh
excellent wait but do we have to wait
for the butter or is it ready butter no
we'll see we'll see just getting too hot
and brown I do use rectangle oh yes good
good good um good hype train such strong
support
uh
this stream is free education yeah yeah
yeah I mean you look there's there's
plenty of free educational resources out
there right and when you have me like
okay we got we got like 900 people on
the stream when we have me talking to
like 900 people sure I'm happy to talk
right but like people who want to be
educated individually I mean you know I
do private tutoring your phone calls
thousand bucks in 30 minutes right uh
you know some like real high-end tutor
for some rich people shit you know what
I'm talking about I would do that
um uh look at these like arguments this
is like how the tensors actually go into
the
device
um so like there's a few things we can
do we we can we can mess with it on all
of these different levels
right
um we can we can start like compiling
things here in core in in in like
Onyx um actually I should be able to
write P torch models compile them to
Onyx compile them to cor ml compile them
to net pists compile them to model hxs
and then run them on the neural engine
so like this is this is the way to start
reverse engineering this
thing um you you figure out how
to
like two pink
MacBooks uh you figure out like like
it's a differential Crypt
analysis um so we'll start we'll start
going in here and then we have to figure
out how to like get each one of these
Ops in an hwx file uh these hwx files
also seem to include the
weights which is a little bit
crappy
um going proa well yeah I mean that's
true too like you guys subscribe and you
guys are funding the education look do I
really twitch for the money not really I
twitch for the attention and the ego
boost but
uh it's true but I do love money in fact
I think with these streams we might be
able to pay for my pink
MacBook which udem me cour do you have
to watch to understand this you know me
you want to understand this watch the
video 30 times watch it
slower you really want to understand it
buy a pink MacBook and replicate what
I'm doing that's how you're going to
learn
right if you're sitting there watching
stuff you know you didn't get an
education from TV I don't think you're
get an education from watching YouTube
lectures how did I learn it I just did
it and I did it slower and now I do it
faster right you watch my my pathetic
Objective C coding I'll do it a lot
better next time does it have to be pink
no it's
gold all right I'll be back after
lunch
ah let's go over here how do I
raid twitch
raid let's throw it
back
uh there we
go
thank
you or making a trailer or testing
or living a relatively normal life
despite it all trying to at least wait
how do
I we're back boys we're
back all right so um back boys we're
back it's fine now they love active
noise unless it's
copyrighted did they they copyright the
noise of the
vacuum I don't know let's find
out
ah ban for vacuum
Noise Okay
so as promised what we're going to
do this afternoon after lunch we are
back
Hello whoa
transitions Fade to
Black did that just
happen I don't
know well this is the most complex I've
ever seen
OBS all right wow so also we hit an all
all time viewer Peak we hit an alltime
viewer Peak yeah I said I'd be back
after lunch we're back I deliver on my
promises that's right vote for me
president of the
United Alliance of
magicians that'd be pretty cool man
magicians would you know be like that
guy's a president of the alliance and
magicians watching my ads yeah no no no
we got to go we got we got things to do
today
got things to do today you know what
stopping that sounds like it's for
quitters they be hoping we're sto
they've been praying on our
downfall all right maybe we don't
actually need that maybe that runs
automatically use of Undeclared
identifier R
to I sold some tickets to come see my
downfall they sold out in minutes I had
friends in the front row leave when
we're finished lights my name's G on
guess only come around when the flames
on I don't know what the tr3b is is that
something I should know as the
presidents of the United Alliance of
magicians we're going to keep the
computer um Okay so what do we have to
do now we have this thing Swift run
Swift uh well we can actually compile
that wait what oh do I still have lb
attached oh I still have it attached
okay we can detach that Swift C run
Swift I'm Googling Spindrift is that
copyrighted I don't want to do anything
copyrighted all right so that's running
just my simple Matrix multiply on the
what we're trying to do now if you look
at this is we're going to do this right
in hwx runner we have these great hwx
files that we've hand compiled very
carefully and by hand compiled I mean
just ran the
compiler um oh well young Z man's beat
me too you know what can we tell let's
go let's go let's go let's
go okay so we know it's calling h&
device open we can set the break point
there run
cool and now we've learned more about
how to use register
read okay so we're calling H device open
and it does not have zeros here it has a
call
back it's still returning zero so I
guess we don't need the call back let's
try P
x0
useless
oh that's an Ana device
controller I wonder where it got that
from are we calling create a device
controller and then that last one is a
call
back
oh it's calling back into Apple neural
engine oh that's crazy all right
cool actually need them though it seems
like it still opens the device um this
I'm going to suspect when we dump it is
zero
yeah zero okay so that's where the
pointer shows up to the H&E
device but it's not an A&E device
controller we didn't pass that
in stimulant don't make you better at
anything they just make you think you're
better at
things
um register
read
uh argo's a big don't don't get me
started we don't talk about Kam on this
stream but really don't get me started
on the stupidity Vargo
all
um
so whatever
settings sub3 equals hex
uh then settings sub 2 equal
Z setting
Sub 0 equals one and this is some
pointer thing that we don't understand
wait
compile that shouldn't be
compile oh we're in the wrong
folder open
04 okay that returns an error
now and I'm not really sure
why
okay that doesn't return an
error um P this
that so this is some object that we
don't exactly understand
that's an object as distinct from these
guys we were passing in the device
control what if I put in zero here does
that do it or is it
1388 that's
fine
first two our some array
thing see if we can figure out what it
is it's G it's not Q right memory read
failed okay
well
okay this is a& device open and we can
look at like the back Trace here too
which is kind of
cool
running
model
oh we broke
something I'm gonna open this in its own
Vim because
unfortunately back tick is my screen
character
we're just doing a few cool
ones
okay so that's device open we actually
already have the device
open one
and un align pointer
in real
call all right so then this thing is
also being put
oh look they name the que A&E device
controller cor ml batch processing Q
that's
cool why I I don't understand why that
was going into like Swift socks land
okay this is process direct um this
still an execute
plan back
trace of
run
oh that's in rebuild
plan ah so first we rebuild the plan
then we execute the plan I get
it all
right um at this point by the way
actually I want to check this um let's
get that watch back up watch nals 0.1
pseudo D message graph
h11 I'm going to enable Pudo
okay so that was it
exiting
fine I want to see I want to put a break
point
here and then I want to run I want to
see if the compiler already ran program
identifier wait what I don't think it
ran
yet request timed
out I'm going to put this over here
sorry you guys can't see it it's not
exciting I'll just tell you if it does
anything no maybe oh maybe it's just
because of my grab um what do I actually
want to grab
for what if I just do watch D
message so much
junk yeah okay the compiler is running
so we'll just grab for Zen and E
compiler
yeah so we know the compiler runs if Zen
and compiler shows up
here compiler ran
right the question is does the compiler
run before this program request direct
or does it run after so put a break
point on there run it do we get the
compiler yes we do okay
cool um let's document
that the compiler already ran
by this
point now I don't know what structs and
crap are created here probably a lot of
complex
ones okay so first off is this actually
a p any device let's see p x0 who knows
register
read uh
P void pointer is a
problem
else I think it's that then this is call
back oh we should be ah good good good
good
look look at that call
back yeah yeah yeah here we go so we can
probably pass in null to that it's just
program request that's the interesting
one I think that one's just
boring uh if we just pass in the
device and I think we can pass a null
for the call back we just need program
request I think we know it has that size
we got that from the static reverse
engineering
okay we're getting a
two probably because my program request
is crap and if I set that to one we'll
get a seg
fault uh no seg
what oh uh just
cuz SE okay good so we can definitely
make the Callback be null we did that
with the compiler too and it was fine so
probably the reason we're getting two
is uh I'm trying to become a programmer
it's
true went from Minecraft to programming
you know it could happen to
you I just spent four Ferraris on a
brand new Bugatti and did that shit cuz
it's something to
do
Nothing Was the Same dog it's just who I
became dog well I remember when Drake
was good who remember when Drake was
good us to be
good all right I mean maybe it's simpler
than we think maybe it's really
just let's dump
this is there these encrypted pointers
or
something what IO
surface yo I don't even know what an IO
surface
is oh do you have to know what an IO
surface is no just because Drake gets
views now doesn't mean he's a good
rapper here I know it's super
copyrighted so we're not actually going
to play any Drake we're just going to
look up new Drake songs and we're going
to read them out loud and be like wow
this is the stupidest shit anyone's ever
said Drake like Tootsie
Slide lyrics these can't be copyrighted
right what's the new new
Drake certified Lover Boy Yes Drake
laugh now cry later
whoa whoa yeah sometime we laugh and
sometime we cry but I guess you know now
baby I took a half and she took the
whole thing slow down baby we took a
trip now we on your block and it's like
a ghost town baby where do these be at
when they say I'm doing all this and all
that what about Drake sucking you need
to move on no but let's read let's read
some some some old Drake love you got
Move On Now isn't it amazing how you
talk all this shit and we to lack
communication how beautiful our kids
would be girl I don't need convincing
how every conversation starts with this
time would be different that's pretty
good yo it's just like Drake used to be
good ah when it falls apart I'm always
still down to pick a million tiny little
pieces off the ground wish you would
learn to love people and use things and
not the other way
around you
know they say in Drizzy just snap
distance between us is not like a store
this isn't a closable gap I seen some
people attack and they don't end up
making it
back
yo Drake lost his good Ghost Rider
that's right you know like Drake got
high and is like I'm gonna write my own
shit let's see who wrote this Drake
actually write
this let's see let's see written
by H now what was that other one laugh
now cry later
genius yeah it's written by totally
different
people
uh what
come on Google you should have gotten
that I heard a little little homie
talking Reckless and Vibe that's quite a
platform you chose you should have kept
it inside or you tried it so childish
calling my name on the world stage you
need to act your age and not your girl's
age it gets worse by the annual my
career is like a howto manual so I guess
it's understandable man like like it's
believable and real like you know Drake
saw people die no he
didn't all right we're done we're done
beefing with Drake that was beefing with
Drake all right I think all we got to do
is get an IO
surface um maybe this program is
actually just a
struct let's try
struct uh program
request uh zero in Num iio
surface pointer
surf
I just put a one in
there unknown type name iio
surface void point
I love void pointer void pointer is my
favorite
type it's an anonymous struct I actually
created
there like that there we
go okay we got to figure out what the io
surface
is what is an i surface let's start
there I closed all my windows from the
Drake from the beefing with Drake
section of my
stream ah the iio surface framework
provides a frame buffer suitable object
suitable for sharing process you know
what this is boring let's just read the
Apple neural engine
gidra
and look for A&E program for
evaluation
can I just find like a call to
this oh don't tell me it's like a
pointer or something probably a
pointer got to learn how to create an IO
surface I believe you know the iPhone
Jailbreaker people like if they saw me
struggle with this stuff they make fun
of me you know the truth was I was never
really good at
uh Max documentation looks fancy but
it's useless that's exactly how I agree
about it it's exactly how I feel IO
surface
functions
okay IO surface create oh it's created
from a dictionary
e so we should be able to call these
things can we call these
things
um how about CF
shell uh yeah actually it should be fine
because I have my I'm in this process so
I can just you know if I print f it
should actually come to me yeah
buddy all right so let's call void CF
show uh
this iio surface okay can we call some
of these iio surface
functions
iio surface get type
ID and we know how to turn type IDs into
Strings oh that's not a
void
unavoidable
um well we do know Drake's Ghost Riders
used to be good and they weren't good
anymore and it's even sadder if Drake
was actually writing it and now is there
any way to like do like an IO surface
like describe like can I print an IO
surface call void NS
log log
[Music]
right no
iOS surface get
name get name component of
plane I surface get
ID Returns the unique iio surface ID for
an IO surface yeah see that's a perfect
example of this ship looking fancy but
then when you actually try to use it for
something you're like well what's an iOS
oh 124 oh that's great that's really
useful thank you thank you for telling
me that it's 124 I'm hoping that the
program is just in the io surface you
know well here we go IO surface get Base
address oh yeah look we got an address
all right let's see what's in here
nothing oh is this the input to the net
oh this might be the input to the net oh
that's awesome I think we might have
found it okay okay okay wait wait watch
this boys watch
this ml multiarray
how do I create it with
uh got 12 doubles in
it
sometimes Swift is
nice
all right
now register
read
yeah but this is the io
surface IO surface get Base
address it's not an INT it's a void
[Music]
pointer now let's dump that and see if
we got a 1337 in there or float 1337
oh oh that that was that wasn't nice
that was
mean you know what we're gonna put some
we're gonna put some some some weight in
our weight
too weights roll now too all
right didn't
work
Infinity 7
s infinity infinity he
where did I get it from I just run corl
and it makes
it why is it oh that's
right Swift C run.
Swift all right
sweet
put
some real weights
in all right so what's that I think it's
I think it's double
elap is that
right a double e plus one for the
bias okay good now we're running
something real
across
direct how many people we
got
827 not
bad all right let's take a look at our
IO surface Base
address dump it oh we have a number in
there
now I mean I don't really know if that's
right is there a BTC refund
[Laughter]
Department Alex you hear about the BTC
refund department how I get on that I
have been scammed six months ago now
someone is calling me from the
beach no what are we
at oh I wish I wasn't a
nocoiner oh man if only I wasn't a
nocoiner I would be Rich right
now what where is this going would the
run up happen cuz who trusts any of the
bed coins anymore should I
sell what well Alex I mean the only
question you have to ask whether should
you sell is do you like making money and
if the answer is uh no then you should
sell but if the answer is yes you should
H
you're we got ice cream we fudge bars
jni we have Jen's
milky never got
milky I know to you want it's your
house more water for Te can I make I
don't know how to
make
no it's got water I just might be still
warm still it's got to get green
warm wow this te of crazy it tells
you all right we got derailed by the BTC
refund department I can't believe that
on over
well does it call anac compile under the
hood yes so not actually directly if you
put a break one an anac compile you
won't see it but there's a service
running called the antic compiler
service and that's where it runs
okay
um IO surface oh you know what what if I
put a breakpoint on iOS surface
create that should work
right IO surface create ah here we go
and that's being called with something I
can seef show
h
all
right we found the io
surfaces
oh okay so that's the first
one oh no oh no no we have to create a
CF
dictionary we have to create a CF
dictionary and
see there was nothing actually about
that that we couldn't run in see right
oh
no oh look at this fancy keyot Alex has
the fanciest stuff
yeah pouring the tea like I'm in a tea
garden that could be a drake line and
people wouldn't even cringe at
it
all
right delicious you plan to use apple
neural engine instead of pie torch
yes implying we do stuff on this
channel for real
reasons okay so we have to create a CF
dictionary with these things that's not
so bad
we're experts now we know how to do
this we are experts now um how do I
create a CF
number CF number
type
there has to be an example of
this IO
surface create example wow imagine
Apple's documentation was actually like
good NS number n dictionary
oh oh look at that that's pretty nice I
don't think I can do that but if I
compile it in
uh Objective C
instead that should work okay
right let's just see if I can compile
this in Objective
C all right we'll get rid of
this we'll change this to test. mm
see like it
worked
great wow today I learned Objective C is
just
C
and also NS numbers are just uh other
numbers see if that's going to work hell
yeah boys all right let's create an iio
surface
yeah we don't need any of this
stuff all right height is
three withth is one
get rid of
that use of Undeclared
identifiers oh look look how beautiful
that is that's some real Objective C
code look at how much better we're
getting on this
stream where is this defined does Apple
even tell me that no like that's how
useless this documentation is why can't
it tell
me
do we have to link to the iio surface
framework yeah probably Frameworks iio
surface surface
framework
framework found
Foundation oh yeah I'm an Objective C
programmer now that's right that's right
I just got my degree at D University in
Objective C that's
right all right
unfortunately it's still giving me an
error see we were learning on this
stream remember this morning when I
couldn't even make it CF dictionary and
now I found the right stack Overflow
code to copy and paste no
works right we're still getting a 02 out
I don't know
why maybe we get some information in the
D
message I wish you know
what c-v
WiFi d v
Wi-Fi
c-v
failed no to
SMC okay I think we're left with only my
good stuff
now
okay nothing too exciting it's just
booting and then dying
we are creating an IO surface though
that is good
news we have surface percent P guys know
percent P it's when you have a pointer
that's what the P stands
for I don't actually know if that's
true might be true probably true sounds
right all right so which code are we in
no not either of those let's go down
here to
oh we don't even have it
open any
Services okay well we're probably
actually calling more
thingies but we don't know what they
are like we're probably calling other
things besides this how do I put a
breakpoint on everything breakpoint h11
a any stars is that going to
work
no that
works someone was like posting LLB stuff
this morning it wasn't usually right but
at least it was
something break
point on
many
lb
here we
go oh yeah now we're
talking
uh yeah 323 locations that's a sick
number of break points all right we're
calling Ane device
open ah now we're calling create A&E
device controller oh now we're getting
somewhere but actually is that called
from inside
open
yeah it's called from inside
open but it's still
interesting any thread ready
Sinker inside of
hereit what
this is
boring red stuff's
boring
okay now we're back to interesting
stuff uh create device
controller
boring I can return from that frame
thread
stuff all right we're back in A&E device
open oh here we go allocate stats buffer
pools still within open
create a any frame receiver within
open Constructor for frame receiver
[Music]
here boring boring ah okay now we're
already up to
this maybe those things weren't that I
don't know start receive add iio disat
to frame
Loop program process request in frame is
this it's is underneath
yeah
boring
boring underneath program process oh
program process request Direct
underneath there we have this
thing some loopy thing
boring
boring so it actually really just looks
like it's two calls
these things are
boring if you can just figure out how to
mimic that call I think we're
good we open the device I'm not sure
we're doing that right but probably
maybe my settings still don't
Notch so there's some chance that that's
the whole
problem uh oh let's first run and let's
uh register read uh register
right X2 to zero let's confirm that that
actually can be zero
continue
oh
well
that's interesting that it gave bad
arguments look at all this stuff they're
getting yeah maybe if we run it in the
debugger we'll get all that stuff
too test
mm oh bad arguments
good
perfect okay you only the question is
why are my arguments bad they shouldn't
be bad I worked hard on
them always run in the debugger because
for some reason then you get output
interesting how often does this come up
in chat when you guys are talking about
this
stuff how to learn things you know just
do
it just do it you know if you guys spent
half as much time doing it you'd be good
programmers by
now when your album came out you weighed
325 PBS if you walked a mile a day since
then you'd be skinny by
now
probably one of these
coals error devices null we're not
getting that error frame receiver is
null invalid arguments oh look at that
program request
top bad arguments yeah this is the one
we're getting
wow okay that's pretty quick oh request
call back can't be
zero all right well don't make request
call back zero we going to have a bad
time all right so let's go over here and
let's po
X2 okay we need a call
back
K CF null
callback what are these NS
stack
okay well the call back can't be zero so
that's how far we were getting into this
thing which is not far at
all none of them can be
zero it is nice that we know that it's
called request call back maybe there's
other
things
yeah this looks like it would have
a here we
go I don't know what type that is
though what type is the Callback
period signature look at this
thing who thinks this does
anything doubt
it
um
let's try the
syntax do that work
can't
work just
worked H now it crashes that's good
that's a big
Improvement we have a Segall
now uh 91
58 okay where is it seg
falting all right well so for some
reason I'm getting 168
there I don't know
why this program request thing actually
a lot longer I feel like it
is so it did say it was you know didn't
it say it was
2038 yeah
still crashing the same
place uh register
read
168 okay where's that coming
from this is the thing it's
in
um program process request
direct go
back go back using the elite NSA
key so we're plus 80 in the
function
so 8 here we're failing right
here l require l54 oh whatever is that
plus 10 in the A&E
device the problems in the A&E device oh
that's not good wait I have that
though uh no let set the break point to
this okay it looks like I have
something
what lar
14 and then it loads from here again and
this is where it
crashes here
L9 so was ever 58 in
the frame receiver God I don't even know
if it's the same A&E
device okay I know how we can get that
though let's
run no we don't want to do that right
now we want to put also put a breakpoint
at A&E device
open
now uh register
read
this um how do I say what
finish
finish
okay now we have
something this is that return
value so now we're going to continue and
is that the same thing that's in
register
read yeah it is okay so the device is
being passed
correctly um you can see that this
number here matches this number here so
we are passing in the
device um this program thing might be
entirely wrong but I don't think that's
the problem yet I think right now our
problem is just the how we're
constructing the
device we have to figure out how to get
that
uh where my build s
go where am
I
oh I I can't take this with Z anymore I
got to fix
that we're just not opening the device
right register
read okay we're not passing in the call
back that's probably
okay we're not passing in that I put
some docks on what that was here oh the
an device controller that one we might
need where does that come
from how does it know it's an Ane device
controller okay that thing is clearly
only it's on the stack and this is on
the stack too 16 is a
stack this thing is where I'm wrong we
have a one there and then we have this
object and this object I have no idea
where it comes
from we have to figure out that
object
this device controller is created here
so it may not matter that much but I'm
not passing that
in
this Pam two is a much bigger
deal Z doesn't
matter one
C oh that's one C okay that's
interesting
but here
any device usage type I don't know maybe
it's not a pointer if I just copy
it it's not a
pointer open fails with 17 if I do that
goes with four if I do that 17 if I do
that okay we might have to go deeper we
might have to figure out how we might
have to go into Apple neural engine and
figure out how that parameter is being
constructed oh yeah but we tried to do
this last time okay plus
438 not
that
block invoke thing a real thing here it
is let's stop block and voke me start
block and voke there we
go so it's getting the diib here it's
extracting device open here it is so
here's the
call I had this
yesterday this
thing what's that being said
too
there it
is a stubs OB message
send
no see Zer is
okay where's
138 oh 1388 is 5,000 is that
right it's probably some kind of
timeout
okay I don't know anything about these
obene message
sends what is this
thing let's replicate again down
here
H so an error on line
46 you're
trolling open return 17 when I pass in
that junk and four if I comment these
both
out
set all the break points
again we do
that history is not valid command of
course
got a way to do that I should be better
about documenting
this um lb breakpoint on whole
library is
this
okay the first first call is to device
open so nothing being passed into device
open where did it get this from
then where does it get an A&E device
controller
from oh unless that's just
Malik I don't know why it knows that
type
though
it's a
string that crap is
there and device is just zero if I do
that we're stuck at device
open
is that number always the
same well it's different
now
no okay Factory function device open
this is where it's being
called getting that from the
dib
good thank you for subscribing okay who
knows what this
is why is this not like a
normal
pointer can't George just look at what
run Swift send the neural engine well
that's exactly what I'm doing
how is there a better way to look at it
than to intercept these Library
calls I mean what we could do is we
could just call Ane device controller
start I guess there's no harm in
that was I calling that in the other
one
that looks like a lot of
arguments
[Music]
creating like an an
client does LD preload work yeah LD
preload would work but again how is that
going to help me Beyond this
right like we know the two functions
that are getting
called
there's this
h& device
open the problem is just what's that
argument it's it's got to be some like
pointer to
something uh maybe there's like IO kit
stuff that I don't
understand I think I put put I put a
break point on every named thing in any
Services I mean we could do the same
thing in uh in apple neural
engine
okay the first thing we call is Ane
client
initialize I mean we can we can like do
this at The Objective C Level I don't
really care as long as we can pass in
the raw the raw
bites uh which is possible that Apple
that the services that I'm working with
don't even let you do
that okay this calls this creates an a&
log
framework I don't care about
that any client shared connect
ction
trunk okay an& client a knit with
restricted access
allowed in here we create an AE Damon
Connection in there calls A&E Damon
connection and
get in there all right how deep do we
want to go with
this this is calling into this the mock
Services name thing was a plus or a A
plus oh I mean that's kind of fun I bet
we can call that
but uh and we get
uh okay who
[Music]
cares wait we're actually still in an
shared
connection okay here we create the
model um actually if I do register read
here and I do something
like look at
that they
strings
all right so we call the lower level one
underneath
here getting deep now we call
that any client load
model so one of those must return an any
client
that's the a& model being passed
in with that
URL do load model inside load
model boring
boring
[Music]
boring still all in load model
[Music]
here load
model
that's
weird oh it's oh that's just getting the
connection
any Damon connection qos
mapper
boring load
model wow so much
depth okay we're still loading them off
model this is probably where the
compiler ends up getting
called oh here we're calling A&E device
controller start all inside of low model
load
model here we're opening the device
still inside of load
model
okay I'm done with that let's put the
break
point this happens for a long
time let's put the break point back
here see what's going on here okay A&E
client evaluate with
model
okay so if we wanted to use a Anye
client it looks like it would just work
like
that
um
the
oh happens in
[Music]
here okay
let's create a breakpoint here run now
continue till we get to there now let's
create the breakpoint on all of Apple
neural
engine
continue
in different thread
now
okay I'm bored with
that yeah I hate the new
ding wow those tabs that's
disgusting
I hate
tabs we are learning objective
c
[Music]
neural engine better than anyone an
apple ever
could that's true they're doing it
wrong they're embracing the design
philosophy of tensor flow and not the
design philosophy of P
torch yeah we're finding the secret
Hardware also the other problem with
corl is you actually have no idea where
corl is actually running your
thing all right we're getting this 160
still and it's probably because the
thing that we're passing in there isn't
right I'm not completely sure about that
so let's read the code and find
out okay
um any device
open Pam
2 well you know we can also just look at
the other
one and look more okay what does low
acquire
mean
what is that mute
text
all right so if we look at the P&E
device +
10 we get something else so this is the
P
device g
g that's P device +
10 I get
that on the
Heat this is okay so this is the thing
plus 10 whatever that is I don't really
know maybe po
knows no it doesn't does po know this is
a p
device no it doesn't why
not do know about
this
no
um then okay so whatever Plus 8
is this is the one that's crashing here
whatever this plus 168
is this sub
168 so it's a frame receiver if we go if
we offset that by
10 and then offset that by 58 so that's
0 1 two three four five and that doesn't
exist
oh so the 168 oh that's why it's okay
okay so are
are our Ane device doesn't have a frame
receiver in the deeper
thing I I think there there's another
thing we're doing wrong too it might not
even be this it might be that we don't
have when they call
it
they have a device controller we
don't po even knows this is a device
controller
yeah like figured some of this
out
oh okay maybe we could just try this I
don't
know
then we can pass this guy in
there
okay same bug but let's see what's going
on register
read how come I I po that it
knows must be
different yeah it looks
different they're not the same
thing it's possible just calling the
Constructor
we call the
Constructor
uh not viable requires one argument but
none more
created okay we have to pass in two
nulls oh I can't convert that because I
have to do
reference same crash but does that give
me the right object now
in any device
open oh that justes not look
right it's not even an aligned
pointer wait is an underscore Ane device
controller the same thing
it's not even an aligned pointer that
doesn't make
sense must really be calling the
Constructor
wrong
wait why is it calling the
destructor okay that's the Constructor
it's fine I don't get
it maybe there's some Global
one definitely not doing
that
I'm not sure it was a missing pseudo is
that really what it was did you guys
reanalyze that stream you guys watch the
replay figure it out because I rebooted
in
um I rebooted in in recovery mode and
that still didn't
work
so where is that it's on the stack it's
on the
Heap it knows the type of that as an A&E
device controller like where did that
come from man I wish I had
Kira how many people we got we got a lot
of good people
973 all right all right we're going
pretty
well all right cool you guys are
enjoying this then okay that's an A&E
device controller
somehow somehow lldb even knows it's an
Ane device
controller
what where does that even come from that
type let look at uh NP
whbs oh it comes from Apple neural
engine
huh that's
interesting don't care about that for
now
yeah
okay I mean all right let's just get
it
h
is that
right what it didn't
work
and this object
zero got zero
okay um I don't know just
Al still zero
oh I think we have to get the a&
bundle okay good now it's returning
something
um
call a knit on it as
well ah so now yeah okay we have an an
device controller now now it's possible
that other things were called on that in
the other guy so let's check
that let's go in
here and let's put all the breaks
on well actually that's not exactly what
I want to
do okay any client initialize log
framework Damon
connection Damon interface boring boring
boring boring loading model on your no
outline function are what are we looking
for we're looking for calls on A&E
device
controller okay let's see if we can just
do
that
um breakpoint
star does that
work cool I guessed at
that
okay any device controller control
controller with program
handle
whoa
okay I mean I don't have a program
handle deep in the load
model
a knit with program handle privileged
oh I don't even know where I'm going to
get a program
handle
H and this is all before open is
called
yeah okay now we're finally
back controller with program
handle
yeah okay let's figure out what a
program handle
is I don't even know what the it's worse
I don't even know what the ABI is for
oh is this shit a program handle don't
tell me that's the same shit we see in
uh oh you know everywhere I go I see the
same
[Music]
ho
oh yeah I know you need to send the pr
to the device but I was hoping it
wouldn't be in this Objective C
crap all right all right all right
what's not the rabbit hole you guys just
want to load the model like a bitch we
could do
that we can just call A&E client
initialize A&E client shared connection
a any model model at URL client load
model evaluate with model we could do
that
um lldb print Objective C
arguments to
function here we
go P
invocation does that
work probably only if I download
this any arguments are on the
stack
okay if you debug your code on the
device the parameters in hit your
breakpoint will constantly be in r0 R1
and
R2 the device that's getting the thing
will be in zero which makes sense and
that won't make any sense and then this
one will be
something
pr3
yeah that's the program
handle oh are these like XPS
handles frame
variable
no oh but that's the handle okay so
that's the selector I see what they're
saying this is the
selector ah controller with program
handle look at
that oh this isn't bad and then this is
the program handle let's confirm that's
actually the crap also being passed that
we don't understand into uh open
device
two
okay controller with program
handle uh register read now
continue now uh
one one
389a yeah
okay okay so this is the program
[Music]
handle no Ida was huge and now
everyone's just using gidra because it's
like you know I don't want to deal with
Ida's license
guys you don't understand it's not
practical we're learning we're here to
study what they do what what what do
they want you to do they're like well
why don't you just do
this yo guys you ever do an integral why
don't you just use Wolfram Alpha that's
right Pro tip
[Music]
okay so that thing's a program handle
where exactly the program handles
come imagine learning anything I
know program with
handle all right I don't know let's look
through here for program
handle device controller oh model has
program
handle any program for
evaluation
The Constructor for
that program for evaluation program with
handle where do the handles come
from
oh does it come from Damon
connections yeah I think it is this oh
this is so
stupid all right boys I think we have to
go
lower I think that this a Services isn't
good enough for us we actually have to
look at what A&E Services is doing I'm
not passing in a program
handle we have to go
deeper
huh well I hear some interesting
thoughts like it is opening the device
it's just not running the program and of
course it's not running the program
because you know what program handle did
I give to it none I don't have
one think those IO surfaces are
leaking I don't know I don't know where
program handles come from do they go to
the kernel like
that we're going to the kernel boys we
got to just do it let's go to the
colonel the
colonel this Lars in the colel guys and
you know we can go lower than the
colonel too if they make me pass in
program handles to the colonel we're
going even lower we're going to ride our
own driver don't think I've never done
it before but I don't think can do that
on stream because I think it's going to
panic all the time what's lower than the
colonel my own colel custom
konel anti- man real man who named this
crap let's go lower no no no I don't
want to have to go lower we're not r in
for
that we create an iio user client okay
okay okay we're going lower we're going
lower we're going lower we're going
lower stop the count only if I'm losing
but if I'm
winning keep counting now if I'm losing
keep counting if I'm winning stop
counting there we go I got that
right
why is there no tiny kernel repo yet no
no no no if we have to go that low we're
giving
up giving up we're not going that low
can't do it can't do it what we can do
though all right let's see what's going
on here we're getting rid of Ane
Services I'm not linking to this crap
anymore we're going
lower and here we are importing IO kit
and IO surface all right so we're going
to figure out what the real IO kit calls
are and we're going to use
them so it's not this device open
there's a deeper device
open why did we why did we mess around
with any of Apple's user space crap we
should have just went straight for the
kernel interface the kernel interface is
usually simple and
beautiful okay here we go bio Service
open now we're
talking all right we don't need any of
this anymore need any of this let's put
an Exit Zero there to show we don't need
any of it all right good we're exit
zeroing let's go to the C
breakpoint IO Service open
run GPU
crap GPU crap ah neural engine here we
go so here's the call the io Service
open underneath H NE device open and we
are going to IO Service open
good thing we did that hacking yesterday
or this would never
work we going lower all
right IO Service
open Apple didn't even format this
well
okay we have to have an IO service
T I don't know where we get one of
those this plus 38
e Oh we must have got it in the
Constructor or something iio connect
call struct
method okay MO ask
self Ram
three what about IO
connect we need that one it was
optional oh that's where the return goes
I
see okay we have to get a
service I've seen this
before
um let's just put break point
on iio connect get matching
Services generic error why did it
fail did I break my neural
engine
um
H okay well that's my service right
there and then that's the
reference is that a handle better not be
a handle
mock Port self how do I get
that we're using mock task
self
I remember this stuff kind of from back
in the
day okay what goes there
again
[Music]
zero
and
connection
for have to link to
IIT good news is we don't have to link
to a anymore all right Service open no
that's the opposite of what we
wanted
um I bet you it's not always
uh I didn't have to do
that it's a different port every time
that's like a handle or
something yeah okay that's just a hand
pram
three is
zero okay we have to get that handle
somehow uh service
IO service object to open
a up matching
Services look up the
service there should be another way to
get
that no I don't care about that that
uses the NLC Library yeah with the
times
um don't tell them what to do
Alex okay you you can
be you can be the advocate for the
Twitches that I
maybe kind of mean to them sometime you
know
yeah Alex will deliver your complaints
in a nice calming
way
um device
controller all power on we're going to
have to call a lot of scaler
methods an send
command
wow w well you know what here's a
theory what if we just put the break
points on
here these are
interesting I what if we use this what
if we just use this class I know how to
get the handle for
it just so I don't have to like deal
with all the io kit
crap all right let's try this little
intermediate
thing CU right because it has to go
through the
device now that we know about this
great see all the calls to the
device
okay
calling create no no but that's not on
the device I don't need
that oh it's just because devic is like
yeah let's try
that 47 all right all right so first
we're calling the
Constructor
um don't worry about where we get a
device controller we'll go with that
later then we're
calling the Constructor
again
okay all right then we're calling enable
device
messages
calling device
open okay
Constructor enable messages device
open A&E program send request oh this is
more
exciting and that was it
okay so this seems like an interesting
place to tap
in um there's an A&E program request AR
struct I bet you this is pretty low to
the
metal um we don't even load firmware or
anything an program send
request
like we can just call that right on the
thing right like we we're actually
creating that
device
um yeah look how this doesn't really do
anything this actually just calls the
uh know what that
is yeah it just calls the the the io kit
methods yeah yeah this is better right
CU why should we mess around with IID
Service open if we can just use this
this is the same thing it's just with a
layer of abstraction on top it but it
looks like it doesn't do anything all
right so we'll put Exit Zero back here
we're opening the device that's
nice Dev is an h11 A&E device that's
good um I'm sure we're calling if we
actually look here let's use that same
a.out command and let's confirm that
we're calling the same three messages
we should be calling the same first
three call The
Constructor call The Constructor again
we saw that last time too I just ignored
it enable device messages we saw that
device open we saw
that now we're doing A&E get version I
guess why
not get status power on is powered oh
that did a lot
more
that's
weird I we would have expected to see
that here too
but Constructor Constructor enable open
program send request
okay but I mean it can't
hurt uh we can like check Annie is
powered let's that seems like an easy
one to like play with
right
should be able to say down here is
powered equals
Dev an is power
power oh we're getting
zero
do we not call any power
on okay let's call The
Constructor
not with this I don't understand all
these things create a device
controller that we call the device
[Music]
Constructor why do we call the
Constructor twice in
here
not
it's not
powered
oh there's just a branch
there okay that's why it's like calling
the Constructor twice but not
really that creates the device we're
calling enable device
messages
here we're calling device open that
matches we also call a& get version
here get
status why we only call them here then
we call power
on in device open and then we call this
powered from inside power
on we call the
Constructor is enable device messages
called in the Constructor yes it
is device open called in the Constructor
no it's
not
okay that's my second call is powered
there power on weight count is
zero don't know what that means
but it seems like his power got called
correctly so that's really what we care
about
uh enable device messages open program
send
request okay so it's we're calling it
with this program request ARS struct
which we don't understand at all and an
unsign
in
what's in a programed request arst
struct let's find
out is that a
handle don't tell me that's a
handle oh boys if that's a handle I
don't know what we're going to
do that means the colonel needs a handle
too I think that's just a handle doesn't
that look like a
handle oh it's so
useless that's a
handle let's not go to driver
implementation just yet we're not
writing a driver that's too much we have
to just figure out how to get program
handles from the kernel but it doesn't
mean the handle comes from the kernel we
just need to figure out how to get
it which of these stupid classes is
getting
it
or you can call it with anything and
it's just calling back
to
oh wait a
second the handle is probably registered
with the
compiler
[Music]
h
h
read A&E register oh that's
exciting what do you think of that you
want to read some
registers looks pretty straightforward
too
for
h
first one that didn't Link in a while
other
inss okay well didn't read the register
okay got a bad return
code
oh there we go this 40 is equal to
zero what is this
40 okay we're not allowed to read
registers how come A&E program creates
not
oh is that being called by the
compiler okay okay okay we can deal with
that we can deal with
that um grab a any
and now we want a pseudo see I remember
the pseudo this time LBP there and uh
the
password okay now I'm not sure this is
linked but we can try it let's see if
this talks to the
device no it
doesn't
[Music]
now can't be in a different
thread it feels like more has to be
talking to the device and just
isn't how are these things not getting
called maybe my uh my thing is wrong the
colons don't work like I think they
do
h
why didn't that block on the other
an& there's more stuff with
A&E that should include the constructors
and
stuff
the dots don't do what I think they
do like how
come
it's a frame receiver does this use
IIT um you know what if I put a break on
this
because they're all that
right well I guess some of them probably
won't be struck
method scaler method and struck
method
GPU GPU
GPU
GPU okay so it's calling a struct method
in device
open fine
wait no it couldn't have only called
that once that doesn't make sense are
these break points
working because what is that program
thing
call program send request I'll call a
sync
method got to stop on that one
too actually let's just stop on that one
we don't have to deal with no we still
do only two of
them read register is powered returns
where are all these things getting
called from is there a
Damon just the compiler
surface or for some reason is it not
working on all the
threads
for
okay nothing at read any
register I don't understand that was how
like how is power not being
called but it does get called in
mind uh the headers yeah I looked at
them maybe now they'll make more sense
since we've made
progress
um yeah
this is actually pretty good this is
actually better than okay
cool um I mean yeah the question is how
is it getting a program
handle
for
e
yo Lex sent me the com AI drive and tour
what is it yeah he go on a d tour no no
no he did he did go on a tour he did
yeah
ah how many viewers we got what how many
viewers we
got I mean yeah wow we still have 973
viewers
damn lot of followers a lot of
subscribers 923 that's a
why won't t-o work t-o will work and
just use a screen don't read too much
into it you
know I have t-s you want to see t-o
there are t-
marks
um program handle
something has to get that and it can
only really get it from the device
well actually that's not 100% true
what's the device
controller setup device
[Music]
controller I'm doing anything
good it seems like all the good good
stuff is just being called with uh you
know any
underscore like this is this is the
API this is this is just the class that
implements the API that does the
methods like take a look at them all
they're all just that one's a little
more
interesting
what a load
firmware
what wait what if we forget the firmware
let's forget it am I going to regret
this
maybe and then we'll it have to download
the firmware again wait how sick would
that be if we can just find the firmware
maybe it's
arm a oh yeah no that's real low level
shit we could bypass the whole kernel
run custom firmware on the A&E device
oo
yeah all right we're going to forget the
firmware you ready for this no I'm
scared we're forgetting it and then
we're going to see if it has to upload
it
again oh no this actually might be a
serious mistake because I'm not sure we
have the firmware but oh well that's
what we'll return it
for
forget
all right A&E forget firmware let's
go oh we forgot a semic
Col it didn't
forget okay but this is interesting
actually it's cuz we didn't init
something like what goes there what's at
this plus
40 it actually didn't make the io
connect
call no no no
no what is there and why doesn't
it wait what it's not even
connected oh it's not connected we're
getting scammed boys
that's the mock
Port why is my mo why is it not
connected so that thing returned zero
but it was lying to us the whole
time
oh okay okay okay back to the other way
of doing
it first let's create a device
controller wait actually that gives us a
device doesn't
it
it's the same problem read register had
right yeah if our mock Port is zero okay
well if our mock port's zero then you
know
what
okay we have a device controller let's
just call the
Constructor um let's see how we call the
Constructor
here oh I don't know what that int is
that might be the
service device AR DED call
back we're not even connected I don't
wait what oh no that's just cuz I didn't
set
Dev
that might go out of scope or
something doing this by
hand not with any of
that
call The
[Music]
Constructor good now we got to call
open oh no we got to call enable device
messages what does that
do
there's no member enable device
messages probably because we didn't
write
it oh it's
void oh that's
boring
whatever
okay enable device
messages now we want to
[Music]
call device
open all right calls it with some call
some crap I don't
know call
[Music]
back
um call back can be null let's try null
let's try
one the last argument
any device info
struct let try
all is that
open no not
right
oh was cuz it's not an
end just call it struct for now just so
the type passes
through yeah um I don't
know actually it's an enom
right
no oh it might not be an enom in here
might be an enom out
here we'll have to get the dangler out
again
here we the dangler
out
okay now fun NP
Libs
uh
NM grap
[Music]
open this guy we're going to
demangle
okay they might be both outside the
uh outside the Nam
space might be the
problem
there you
go okay open is failing right now
probably because we're passing all zeros
to
it blah two is probably right who knows
what that enum actually
is the extra com doesn't
matter okay so let's write a
callback uh it has a real name right my
hn device message
notification got
message PR one two
three um
Dev
one this can be the first argument to
that is that enough
[Music]
arguments fix that not enough
arguments let's call these things
instead of just call back got
messag put the
function okay still not right we got to
figure out what those other things are
I'm passing in nulls for them they can't
be
NS P two we need an A&E device info
struct this is the device info struct
p
it's also clearly meant to be a
XX by the way are we getting that stuff
in D message where's my D message
Watcher I still have
that here we go D
message okay that's not really opening
anything this one did
though um figure out why we're getting
that it's like a known error code in
apple land isn't
it we can just figure out okay what's
that last argument we have to put in
this
one
no te Mage doesn't have W no no
Mac
compiler okay here device s um where's
that error code that we're getting here
this one
here um if we run it in here do we get
anything out sometimes I found if we run
things in lb it like prints
stuff
I get anything oh
here OS log type
enabled iio Service open
[Music]
failed it is just calling this 38 so if
that if that's not getting created
correctly
then oh you know what the problem might
be
in my Constructor I'm just passing in
zero I don't think I can do
that
here here's the
Constructor yeah 4083 so this is
actually being called with the um I
think if I put a break on iio Service
open we're going to get that same number
there so this is actually being called
with the
service
yeah uh let's just try a quick
experiment here we're going to put in
aabbcc and then we're going to kill that
and we're going to put a break point on
I Service open and we're going to run we
get IO Service open open and yeah it's
just calling it with that okay okay so
that means that this service has to be I
don't know how I just did that remove
highlight um the service has to come
from remember when we were doing that
before so this is where the service is
being no that's the same class function
but there's that other device open
function we were calling before
h11 A&E device
open this that actually goes and gets
it okay calls create a any device
controller which we are also
calling
so this close device open as
well what is it does it call a
Constructor CL it with
this oh no this okay now that's
fine
that call back
TR not anything interesting
yeah we're still not getting the mock
part so that that whole problem of why
we couldn't use the simple thing before
has not been
fixed okay this is calling new
with
oh okay whatever going in there has size
90 so that's
interesting it is just
empty but it has size
huh huh so it's not calling a
Constructor on the device it's just
using the device from uh from here it
looks
like
okay I found the port cool so create
device controller this
gets connection
Port uh now let's see if this okay now
we're getting a different error on
open okay now we're getting F to
F0 which is much better I
think
um yeah that's just literally calling
new and doing
nothing uh oh how about this A&E device
info
struct also like it's doing
nothing nothing's
there
thank you for subscribing the mouse mat
is courtesy of Alex I don't know what it
does
yeah
yeah fellow George
oool U maybe the Colonel's telling me
what's going wrong now oh good good good
look we're doing
something new user client device open
failed for direct evaluate
what direct evaluate CL client does not
have any open
programs
ah A&E add client for program
failed for direct o but I saw a program
handle in
there okay Anye ad client for program
failed for direct evaluate client
program handle program off code result
direct evaluate client does not have any
open
programs
a yeah yeah yeah no no no no no we're
making our own program
handle we're writing our own
destiny
okay so what am I not calling
right this is not being called
right
okay this has null as a
[Music]
pointer it
does this is a
callback
and this is
zero I think C++ so we have the
argument
sure oh what if I create instead of a
blah 2 device I create a blah
device
oh that
opens oh
what A&E device usage
type
[Music]
ah
okay does everyone get
it that's what that one was up
there
ah but if I try to create a blah 2
device it complains and tells me I can't
because there's no
programs but it's not actually blah and
blah too we don't actually know what
those things are but that A&E device
usage type oh yeah if italic is going to
play chess on Twitch we'll raid him
that'd be a good time to
stop
let me know when balic on and we'll
we'll we'll raid him and that that's
when it's time to
stop all those chips mhm
souram they're too hot they deler me hot
sa yeah okay so that number is Pam
2000 and Pam 2 ah yeah okay we've traced
it all back
now
H
now these guys
yeah
okay guess what we're back to where we
were a while
ago we can put a break point on h&
device open in the real call but it's
still passing in a pointer to the
program unless we open the device in the
other orientation or whatever thing
orientation I don't
know um but now
okay
yeah so let's dump this guy
guess what that is boys that's a program
handle and we don't have one of
[Music]
those so it's in the device info
struct program
handle
dis program handle
is I don't know let's try
that no actually let's copy going from
here that's actually still running so
maybe it'll
work different error
interesting it tell me anything in the
kernel client not authorized to open
device to use
program oh because the code singing
check failed look at the code singing
[Music]
check no I mean this is not exactly
right right this is actually only
because this error message is wrong I
think it's because I'm trying to load
the program handle from the other
process
yeah look this one yeah this one doesn't
do it it's not actually a code singing
problem it's a crossprocess
problem Oh yes a lot of lux's people are
here how we doing on viewers we're doing
good
hello we watched your stream at
lunch I tried had to learn Unity on a
stream once it didn't go
well uh wait how much viewers we got how
we doing how we doing our
viewers oh 1.2 th000 all right all right
so here's what we got right
now the code singing check failed you
see the code singing
check very good on viewers
excellent um
yeah
so just make the code sing well if I
could do
that okay well but this is interesting
in of itself let's so yeah if we don't
open it with a programming handle um
let's call these things um no
program you
usage no program usage with
program crazy usage usage
crazy all right let's let's start it
with usage crazy and see what we
get oh it works with usage crazy
okay that
works um but it doesn't work with usage
with
program
I tried to code in tiny in uh in Temple
OS and I found it difficult I feel like
I'd have to put a lot of time into
getting good at
holyy if we use that program handle yeah
so what if I say yeah usage no
program okay now it opens all right can
we check if it like is powered and
stuff
oh it's powered now oh we're getting a
one on
powered um
Dev oh we're going to forget the
firmware now don't think I forgot about
forgetting the
firmware well any power on just returns
one
so
power on returns zero power returns one
let's just try just for
fun
uh Power it off just for
fun just to see if we
can still
powered prob because that's
running
no it wasn't
that maybe it's
this
it's just
lies okay well either way our power is
on right now let's see if we can read a
register
redefinition of rag oh it's down
here and it's a different
error yeah okay so that eror looks like
at least it comes from the
konel um we can try to see what the
kernel saying did it say anything about
that oh requesting power on
okay they request power
on will it say it request power off if I
power
off oh request power off good doesn't
listen to my request but at least I
request
it okay can we forget the firmware am I
going to regret that one let's go oh it
doesn't
forget
same
error well you know what we can just
read let's take a look at what that
error actually means in the
kernel because we have access to that
too let's
go read
register
register um uh here we
go read register this
is user client here we
go oh it is a permissions thing PE I can
has
debugger
huh what does that
mean
what does this
mean PE I can has
debugger
yeah
yeah we need privilege all right let's
up our privilege can I have more
privilege please please I love
privilege
wait where are all the iPhone jailbreak
guys could you guys come in this Channel
and help me out you guys know
this ah
is Ito we'll
tryo Roots a
lie PE I can has
debugger see any program create I can
just call Something Is Calling that by
the way and that's how we're getting a
handle you're here bro all right cool
help me out how do we do this how do I
get around PE I can has
debugger I want to read a
register can't send
commands I can only do boring
Things o set firmware
bdog
J broke my Obama
phone uh all right whoa we can throttle
it can set Power management that one we
can just
do okay which is the the main one that
we were calling
before program process request
Direct
what no I can't put a what it's in the
kernel I can't put a break point in the
kernel what even happens if you put a
break point in the kernel everything
breaks okay an& program
create but I guess I don't know what
calls
this it'll Panic exactly you guys think
we can stream and debug the colonel at
the same time what do you think this
is all
right
um so we don't get to read
registers need more privilege
much
progress I
think
okay so something's calling program
create but it's not in
uh it's not in my
process and it's not
in maybe this is being called by
something in
here no probably not these are the
things that call into
it
[Music]
[Music]
[Music]
views that's pretty sad yo they're
getting more views right
now they're getting more
whole YouTube right now right now yeah
it's copyright free it's us
[Music]
[Music]
uple new
[Music]
[Music]
ch
[Music]
[Applause]
[Music]
[Applause]
[Music]
[Music]
[Applause]
[Music]
[Applause]
[Music]
[Applause]
what if that's
the what if it just has a cashed
[Music]
C
this is
okay right now right
now are you
call is
[Music]
[Music]
better
no but it's got an
error maybe espresso is calling
[Music]
it okay oh I can add and vram oh shit oh
that'd be great okay we're going to have
to reboot boys
but use
Ned what's
Ned 100
viewers Alex we're losing
viewers
yeah oh I'm sorry we have to do it
though oh PE I can has debugger is
actually a
[Music]
Boog Alex you know I thought you were
going to be nice to them oh not boot
ASMR bu
ARS all right all right all right they
Alex they really don't like the
music all right well you know we're not
going to be calm anymore we're going to
be loud and amped up that's like we lose
a 100
viewers they're like what the hell is
this shit music
Alex wants to get rid of
you no okay PE I can has debugger all
right fine fine fine we know how to do
this all
right bogs okay let's go let's go let's
go Envy Ram what is
it Envy Ram read
Ma
EnV
r-p okay how do I set an EnV Ram oh I
have this from last
night I have this from that picture that
didn't
work EnV Ram bogs
equals PE ion has debugger equals one ay
get out of my way equals
one
okay
is one going to
work wait we actually can't forget the
firmware I don't think we'll ever get it
again read
register no I'm in the wrong thing got
go
here any register P I can has deug zero
if zero then
okay okay you want one not zero boys you
know what this
means you know what new EnV args
mean means I'll see you in a minute
we'll be back very shortly viewers are
increasing now that we turned off the
music okay we will be back
we will be back to read the
registers very
shortly we're going to no longer have
any privilege
violations see you guys after the
reboot don't go anywhere now I'll miss
each and every one of you
goer I
want I'll miss you
all it didn't work and I I waited a
little
bit to
see if we had no that's not what I want
hang
on H yeah yeah well it didn't
work and I don't think that actually is
a real
thing
no it's not that I have to restart again
what do you think this Ane request
is no I don't care about this
um no it didn't
work okay well there's a lot of things
we don't understand even without this
that don't make
sense we going to have to get a program
handle from the uh from the
colonel we just we have to do it there's
no way around
it I'm I'm very interested to see the
firmware but this might also get to
where the firmware is
too
see maybe it's in the
kernel we might just be looking in the
wrong
place
I guess I assumed that the driver wasn't
in the kernel but it very well might
be okay so we won't we can't use any of
the the high security meth messages
it did not
work what is Pei can has
debug I don't
know but honestly this still doesn't
answer a lot of the
questions so
what you
do okay
so you can curse on ttch of course you
can't be naked
though I be naked Okay so this thing is
creating program handles only client A&E
test oh who mentioned
this
oh look at
this what's A&E
test a d oh what was the blog post about
that
wait there's a Sandbox profile for
it user Li
Zac oh yo
boys no no no I think it's just in user
lib
Zac
wow this stuff's all over the
place A&E model cach manager okay well
now we found out where the programs come
from okay so wait a second why isn't a&
running um how come when I go to core
ML and I run this when I lldb
this um I don't know we'll set the
breakpoint on
open the password is Swift by the way if
you guys are trying to figure it
out
maybe this
one don't play aort in shared memory
eh wait a d it was running this whole
time oh my God okay wow all right
fine we got to add this to the
docks can't believe we missed that
two helper
processes I guess we didn't GP with a
lowercase A&E we only GED with an
uppercase A&E and that's why you need to
check all your
cases
Swift okay um let's set the break points
everywhere
um just CU is running
right
boom A&E program
destroy program destroy device close
power off device close destroy device
controller setup device
controller oh boys I bet you this
downloads the
firmware we're going to find the
firmware
here we go A&E program
create
okay so what are the calls to program
create cool see these are the people who
actually know things about this stuff
like ports and stuff
oh wait and these clients are only
creatable by aad
D and that's why we pwned
it
oh
yeah remember that thing that we had to
do yesterday to add entitlements and I
was confused about how like no one else
needed
entitlements okay good progress good
progress let's
go A&E
Services we can just create our own
program now I
believe now we know that we have now
when we know where those stupid handles
are coming from
from so it's calling any program
create okay here's program
create
oh come on be be some objective c
structures none of objective c
structures okay well that's an
output so we have to call program
create wait oh I guess we first create
the device without a program
handle
ah and then we create we reopen the
device with program handle or something
I would assume that this guy opened it
without a program
handle so they call program create progr
program
prepare which is actually a wrapper
around a an program
prepare this is actually a wrapper
around any program
create and then they complete the cycle
with a program
destroy after it
ran
handy power off handy device closed
destroy controller setup
controller beautiful look at that whole
life
cycle oh you have to be pseudo as well
okay I'm definitely pseudo telling me
how you figured out how to get
it um is this Cy UOP could we just ask
him yo does someone want to uh just go
on Twitter and say how do I get it on
George is streaming how do I get how do
I get PE I can has debug on a
Mac I don't think it's with SQL
injection I tried giving it a debugger
well
I don't need
exploits I don't have
Twitter
um okay so if we call program create
program repair and program
destroy then we can just do it let's
run okay so first off note that this is
calling device open and this is calling
create device so let's take a look here
and just see what
um ah look what it's creating it
with I don't understand why
that's oh that's create device
controller never mind
red ready don't care don't care don't
care don't
care Constructor Constructor enable
device
messages here device
open oh it is calling it with type two I
was kidding about type
two
usage with program usage
compile oh
no
let's confirm that this is still empty
actually I can back trace on
this yeah just does that
this take a look at aned
quickly back
oh look at that it's got
both don't care about that
one look there's an x86 a it
too oh is that so like Rosetta apps can
use it or
something do they strip it
oh they St
that
no
firmware is the firmware in the kernel
where is the
kernel we look this up it's in like
kernel
framework here we go Library
carels
h
okay uh so is there no
firmware if it was a path and some of
that stuff for the firmware it's just
not there though so I feel like if we
accidentally did forget the firmware
we'd never get it back
how do we get
it
firmware logger
thread yeah there's no firmware
here
and user local share firmware could it
been compiled intoed or
something get version get status power
on is powered
create oh yeah this is program creates
this is a little
interesting
let's take a look at that
struct
is that a
pointer ah look what we found do you
know what that
is that is the h WX
file oh it's dead simple oh the program
oh wow it's just a pointer and a
length that's all the argument is to
create program oh yes yes finally
something comes
easy um void pointer program un 64t
program
length oh yes oh that's easy good
play stupid games you win stupid
prizes do we have any idea how large
that other structure
is probably any
services
any program create how long is howar is
the return
structure um structs
output no that's
useless all right well let's try to load
in an hwx file
then
for
does the argument
afid
no PO
first
probably this problem
again okay did we create the
program no we did
not 2 BD a
that might have to be special
memory Le do that get off the
stack
2bd all
right something
well that's pretty boring May the
colonel tells me
something couldn't prepare memory
descriptor for output
arcs
H
um or do I need a thing there or
something different
error oh program buer not page aligned
okay that's fine that one I know how to
fix uh c will page line
it same error um program buffer we can
actually just check if
it's
that's not
page okay you we
are uh program signature check
failed okay
well I did take that
from
huh program signature check
failed
yeah I have that I'm aware yeah yeah no
we went through clasher we went through
those entitlements yesterday I have
it um and we had to we had to Ay get out
of my way to do that
but okay program signature check failed
but we're making so much
progress we almost are creating a
program wait now this guy's got to be
passing
so let's just save
this
um uh I had to save
dump from
lldb
uh memory read out
file um
temp model. htpx
doed
oh that's
fine
oh I was loading I guess doesn't
matter
huh program signature check failed
yet I bet when this thing passes the
same thing it's going to
succeed
yeah wait what
oh it did not read the raw
memory
oops okay wait we can fix
this can I undo
this no no no because this is the
file
I shouldn't have done that let no I
messed it
up I messed it up all right well
actually no it should still be there
right
um force does it look at the type name
if I call it bin is it
different
no memory read binary
ldb you name the signature different in
your code signing no no that was the
problem and I I think I did fix that
too a format binary
what dash dash binary not format
binary
he even right
[Music]
anymore oh may he is
right
no it's not the right size
what I don't get
it
for
still see I
fail it could be a different
hour
for
okay
so why does the signature check still
fail because my process ID is
not let's look in the kernel and
signature check
failed
wow by wa where does Mac store
firmware
for
for
for
h
oh wait is that what foram one is oh is
there more to the
struct there might just be more to the
struct hex3 is that a
signature that might be a signature
Pam
one
[Music]
yeah Pam 1 sub 30 is not equal to
zero
according to this though it's not
but it cannot do the signature check in
some cases it looks
like auto fill in
structure
yeah that is zero it's only that one
bite okay this might be simpler than we
thought has
signature
there we go program create
zero yeah
buddy all
right so now
um
there we go we got a
program double check that the colonel
agrees that we got a
program
okay that was easier than we thought too
look at that program
handle oh yeah buddy Roy D no it's not
live pre-recorded I knew you were going
to say that oh enable Pei can has
debugger oh yeah yeah yeah yeah yeah CSR
allow Colonel
debugger CSR active config oh that's a
good N9 new J tag yo you know what's up
is this
real
CSR allow Colonel
debugger CSR
decode pseudo and vram CSR active
config oh man oh that's crazy let's
delete the
firmware sip completely
disabled
oh CSR allow Colonel debugger yeah what
is
it oh yeah you're
bro what the hell is this batch
file CSR allow Colonel
debuger which bite is which bit is
that
sorry I was using the all right all
right all right I'm going to turn the
volume down no it's
fine all right all
right I hear you this is very
exciting and we're going to allow that
CSR now how do we
set oh well I got my I got my
uh program create to work but also some
some some some JTAG guy one a user came
through and showed us how to enable can
I has
debuger where did I find the A&E the A&E
is
everywhere my left ear has left the
chat oh
yes
destructive dra trce name
deprecated all right well the good news
is we don't need any of that stuff we
will need it at some point but guys good
thing we didn't have it we would have
released the firmware we never would
have got it back that I would had a
broken neural engine and if you thought
rebooting was bad how long you think
it's going to take to go to the Apple
Store all right
fine I'm sold
VIP we just gave out a
VIP if you do something that useful on
this channel that was incredible I never
would have found that you get VIP
congratulations
all right
uh no no getting a job is a lot harder
than getting VIP but uh nine J
tag uh pointed out how to
enable uh this this thing called CSR
allow kernel debugger assuming if config
CSR is
on
but I I'll I'll give it to
you
like this is the most promising thing
I've seen to actually enable
it because he know it would have to be
there because those things aren't
enabled yeah he's
right nine J
tag okay um we just got to do a few more
now we created the program now we got to
prepare the program
and then we don't care about destroying
the program because that's
stupid okay we're now in program
prepare uh program prepare AR struct
great great don't you just love when
it's just like just prepare just like an
opaque struct like that doesn't that
doesn't that just make you so
happy no being sarcastic if you didn't
get
that
prepare with prepare AR
struct okay so let's figure out what's
in the prepare arst struct we're almost
there boys we're almost there register
read
okay might just be the
handle could it just be the handle
that's the handle I don't
know
that
did we not check
that well we can check it
now that does look like the program
handle how come we don't have a program
handle
oh we're getting an error
again why are we getting an
error probably bitching about like oh
you to be aligned on the output buffer
yeah I couldn't prepare memory
descriptor for output arcs
fine why
not
um
does that fix it that fixes it
cool okay we now have a program
handle that's the new policy of the
channel if you do something that's good
you can become a VIP
it can happen to you
overnight all right let's just guess at
these other
ones program
handle
um
Flags
empty the the pseudo guy I don't know
about the pseudo
guy we like the pseudo guy if pseudo guy
p it off again pseudo guy is is is is
early on yeah follow along say useful
things and you can be the
next VIP of this
channel I don't know you gotta you gotta
contribute you made lunch I don't know
if that counts
though can you
know so
what oh light I feel like I'm GNA
prison oh yeah we're gonna watch one
soprano all right program prare works
all good that was some of the easiest
things
ever all right now we just need to call
that other stupid function with that
thing that we didn't have
um program send
request program request on
instruct I don't actually know if that's
the program length did I just make that
shit up
no program request arst struct no I
don't actually have that figured
out okay good guess what I think we're
done with this process we don't need it
anymore let's lldb here we're almost
done oh my God we're so close we just
need A&E program send
request we've created the program we'
prepared the program now let's send the
request to the
program okay send
request um register
read this argument send request takes in
an unsign in as
well I don't know what that is but let's
look at this
just like the
handle maybe those other things are
flags we'll just make it
long un
64t say like 100 program request AR
struct
uh
PR pr. r
sub Z
equals out. program handle yep let's go
let's go let's go uh this is r01 two
three 4 is
that oh I bet this is other stuff I bet
those aren't I bet those are actual just
like numbers like small numbers you know
not big numbers but whatever what we got
big numbers so that's what we get all
right now we have to also pass in 3903
is that something more reasonable in
heximal is that like 1388 crap again no
it's not right let's go let's go let's
go let's go let's go Dev a NE
e send
request not that not that not that not
that Dev any program send request we're
send request with the
press and we're also going to pass in
that stupid 3903 which doesn't make any
sense sense but
whatever um oh wait didn't we work out
that this was like an IO surface where
did my IO surface come
from you have surface program process
request
direct some of those are probably like
handle oh that's probably a handle to an
iio
surface oh that's what that probably is
so it's probably going to be like no you
handed me a bad handle to an IO surface
and now I can't do
anything segmentation fault well that's
crazy I don't even know about
that did I write bad
code what I
do the program prepare and then here it
crashed what
huh um press ARS didn't work
work out program handle didn't
work what' I do
wrong make sure you save all the io
service parameters so Linux Port can be
made yeah I don't know about
that um something's wrong with
this
what
F oh I guess it just didn't like being
on the stack or something I don't
know
whatever Stack's not for everybody you
know
same
crash these out do program handle
somehow
broken I mean I'm not going to really
ask why but oh maybe that like
overflowed or
something probably over
FL let's just see if that fixes
it
okay I mean it didn't work but at
least I guess there's a lot more to that
than the program
handle and we Mal something
huge all right we're getting
a let see if we have any news in the
colonel about that I have to print that
stupid thing malic works
it's probably because my IO surface
handle is not
right passing null for intermediate
buffer freeing intermediate
buffer yeah intermediate buffer size is
zero
wait
what why is that calling the
compiler what's calling the
compiler
why is it calling the compiler I didn't
ask it
to I fed in an hwx
file where is it getting this pist from
I'm
scared where did it get that
from well either way instead of passing
in that stupid number we'll bring the
iio surface
back
um need to get from like an IO surface
raft is like a way to get like the real
number of the
surface
um
different
error same error I
mean passing null for intermediate
buffer program bar handle program
ID
the one I broke doesn't really
matter
for
for
why is this why is it calling the
compiler no no no no no no no we're way
past corl we passed corl a long time
ago I'm just kind of confused
uh pseudo launch control stop and
D is that
less
okay and n d is
gone
calling the
compiler I think that's what that flag
is that signature required
flag but what's just crazy is that this
is the same buffer that
was how does it even know about that
pist
oh you know
what no this is fine this is totally
fine that that's not actually calling
the compiler no okay all right all all
right we're good we're good I thought it
was calling the compiler no this is okay
it's not calling the compiler all it's
doing is printing the compiler arguments
from the file right here it is
look those are those same arguments oh
no it died it died and they he wasn't
doing anything I mean it's fine to kill
it
but um no we actually are running that
code all right we just need to figure
out
why we're getting this last
problem
I think that surface stuff is
Right different error
now okay here program send request error
bad number of input
buffers total input buffers equals 1
total output buffers equals -77
million does that not happen if I run
that yeah that like fixes
that
but
bad number of
buffers total input buffers equals one
total output buffers equals zero so I
think that's what these things are
here oh oh we didn't uh
oops
mset that
stuff at least now total output buffers
will always be
zero
yeah okay so error bad number of
buffers that might be a
success
uh why is the total output buffer zero
that's not
right
now it's the compiler let's go over to
corl what if I run okay that's
good
um any program sent request break any
program sent request run okay here we
are uh
read register
one day I'll get this that's got to be
the
buffer
um H
actually
just assume that was the buffer I might
be wrong not Java why would anyone ever
want
Java Ser ID we need surf ID thank
you
3ca
um maybe that's not
right let's take a look at that in
surface we're getting close we're
getting close to
running um program create
program send a request
yeah so that's the
export isn't there also a high level
thing we can call what was the one that
that thing was
calling
yeah this program process request
direct see what this is
doing
can we still do
this for got
this um and we'll just call it
on uh we have construct program request
don't know where that comes
from oh we're back to that stupid
segmentation
fault I that's because we didn't create
the driver with the no I'm done with
that
what's
see frame iio surfice get ID it is iio
surfice get
ID yeah aim program send request is what
we're using
right
why are they calling with three
arguments this
Str
what are they putting
there
intermediate buffer surfaces null
error all right look any program send
request oh this might be the request
that we send to the program so this
actually might not change let's just
check if that changes maybe that's not
the surface
ID that would make more
sense let's run that again I didn't have
to do
that uh register read
no
changed so what is some
ID oh that's probably the io surface
though 398 that seems a lot more like
what we were
getting so that's some other
ID yeah say I surface
ID oh man this is
huge is that just like an offset is
that's probably where the io surface
goes so let's see how far down that is
hex 90
minus it's hex
grass like the
noise why are you
upset oh you like the beeping
oh
a they thought you
did it stops
now oh
well so what is that to handle
to
where's that number coming
from well CV pixel buffers thats
crazy
this I don't know what this
is oh it's an it's a frame
receiver
where did we create one of
those well what's ever
at 118 in the frame
receiver here we go create frame
receiver it's at
nothing
here we go CF mock port create with
port
iio create receive
Port I don't know why it's so confident
about 39 but that's what it
is message type ah clearly 30 hex
um I create re receive Port hex
[Music]
uh I can actually use the right type
right lock Port
t
new
eror is that because of what I do with
the
surface bad number of
buffers
back to bad number of
buffers oh we not getting a receive
Port seems
right um CF mock port create report we
don't really care about
that total input buffers total output
buffers let's try
that that change total input buffers and
total output
buffers no it's not
that
uh there like a one way down
there I don't know if that's
relevant
bad number of
buffers do I have to like create buffers
on the receive port or something it did
seem like if I did that I'd get a
different
error not maybe not zero but like a 100
yeah that gives me a different
error oh maybe it's cuz there you know
okay that was just an invalid Port hour
now we have valid ports because zero I
guess is a valid
Port um okay so now it's complaining
about the number of
buffers bad number of
buffers program send request G let's go
look in the car and
say send request
gated
decompiling takes a
while
it's
taking I do zero it
out rid of that
maybe
bad number of
buffers why is that
broken
how long is this
thing
there's a shifted and mine isn't I don't
really get
that actually shifted it
over did that not
work
okay now it
matches similar
error
bad number of buffers total input
buffers one total output buffers
zero but I'm passing in the input buffer
the input buffer has width
one height three oh there's some chance
that it's the wrong
buffer um we just go put a break point
on iO service create
run
uh okay that's fine fine now we just do
p x0 okay
good oh yeah maybe we need to do
this oh you found the you found the
firmware wait wait wait my mouse just
broke
wait nine gent Jack you are great yeah
the mouse
died oh when the mouse dies oh that's
terrible because I can't use it PL
minut oh
yeah yeah nine J tags
great
okay so where are the files
I don't know if he wants to be a mod
does he want to be a mod he could be a
mod
done all right all right so where do I
get these things though where are the
files what you Googled A&E firmware and
you found the firmware bullshit I
Googled Ane firmware too and I got some
Huawei
crap um
wait I got distracted by my Mouse
dying and but he's
right wait it's still complaining about
number of clients for program bad number
of buffers it's still complaining about
a bad number of
buffers oh yeah I was looking into this
I remember
now and I was trying to paste this but I
was doing badly at
it oh this is the output buffer I
assume
oh you know what maybe I have to like
put it in the receive queue or
something yeah because you you can see
how
Okay extracted them from this
oo Max have ipsu now
oh great wow ipsu
me oh man this shit's
cool all right let's download 13 gigs to
my tiny ass
drive
boys you know what I just
realized Apple can update the
firmware
on Apple Apple can update the
firmware and
uh
yo if Apple updates the
firmware they can change all this stuff
it's all just software I wonder what the
actual neural engine is this whole time
we've been reverse engineering the wrong
thing
I don't know I wouldn't go that far
let's let's let's keep let's keep
playing for a
b um number
within height bytes per element K iio
surface um byes
per
[Music]
row is 64 sorry about your ears
boys um what oh no I'm using the other
keyboard I'll type
quiet
okay so we create two
surfaces but how come I only see one
surface
here
I mean it makes sense that it creates
two different surfaces right this is for
the uh input and that's for the
output
okay maybe we have enough power in the
mouse think we power the
mouse the mouse is
back just
read
um I
mean okay so this one is definitely an
IO handle oh it
moved it moved it wasn't there
before
[Music]
213 it's over there now actually
moved I'm not
lying this might be this must be fun for
people at Apple to watch because they
like have the documentation in front of
them and they're like wow this guy's
fucking
moron
yeah yeah man because they have all the
stuff in front of them
oh I see what's changed okay no it's the
same
but it's just because I used I didn't
use
G okay that's the same as that I don't
get
it unless is it further there's another
one there's a one down
there I mean maybe it can't hurt
oh and there's the other surface
okay got it got
it got it we're on
it that must be the
outputs call this
inser we also got to create the outs
surf out surf is just like the insf but
it only has a height of two and not
three good thing we made them different
sizes I thought about making them the
same CU I thought squares were pretty
but then I remember that square
suck and that's why we didn't use
it
okay don't ask why it's here because I
don't know
but fingers crossed let's
go redefinition of dick
oh never
mind
okay same bug but I feel like we're
getting close to
something same bad number of
buffers
oh
my I hate
Z
don't understand that one should have
been number buffers I
believe is that not the number of
buffers oh
oops those are
eights okay we have a new error now it's
not not complaining about the number of
buffers
okay stats buffer surface is null is
that a
problem
stats buffer surfac is
null what if I don't set these is that
okay or is that a different
error output buffer surface is zero okay
we need a stats buffer
too all right so there's actually one
more buffer if we keep
scrolling scrolling scrolling scrolling
scrolling
H are those things stats
buffers give a
junk oh that needs an eight don't let me
forget the
eights
stats buffer surfaces
null
um we try this last one and if it's not
this I think we're probably off the end
of the
buffer stats buffer surfaces all did
that ever finish decompiling by the
way oh
yes okay here we go iio surface
route book up surface
task a130
he oh maybe that's what that A1 does it
say
let's do this math it's not going to
change
628 not even close to a130
he so we just got to go bigger on this
program request AR struct let's go
thousand
this is
um 5 * 8 x is 28 okay there we go x28
over8 so I don't know what that is but
this is
inputs outputs and I don't think the
stats buffer is real so let's delete
it boom that's a zero boys is that a
zero or what do you see that what is
that zero spell zero spells zero that's
right
that's right I think we just ran the
neural engine all right the last thing
we got to do is just read our iio buffer
and make sure that we actually got
output because if we do that we didn't
actually get any output then it's all
useless well the stats buffer stuff is
junk we have inputs we have outputs like
watch if I put 27 here we're going to
get an N it's going to be like oh you
want have 27 outputs and you're not
supposed to have 27 Oh actually it was
just complained about output buffer
surface ID one um so we can actually
clean up that struct uh to do make real
struct how much is it worth in monetary
value nothing and that's why we do
it if this had value to someone we
couldn't do it see that was kind of the
problem with jailbreaks jailbreaks were
useful so you got terrible people
involved right like terrible people
would show up and be like where's my
jailbreak and i' be like shut the fuck
up but like you know when you have a
million and you can't you spend your
whole life saying shut the fuck up and
you just can't do it so the beauty of
this is it has no actual use but it's
really hard it's like a puzzle
you know they build beautiful puzzles
for
me all
right I think this is all junk we don't
actually need any of
this um that stuff can kind of stay
because maybe it's useful
someday uh how do I get an IO surface to
pointer there's a way to do
that dude I Apple stuff is nice and next
time we will decompile the firmware
after we've got this hwx file
running all right IO surface
functions
um pointer pointer pointer pointer
pointer I promised Alex we watch a
soprano get Base
address
can't believe I've gone this long
without writing it void hex dump unsign
Char dat l l or in I equals z i less
than L i+ plus what no we're watching a
soprano
Alex um if I is not equal to zero and IM
xx10 equals
z print F that print F oh I got to turn
paste off set no paste that's right oh
yeah print F 2.2 hex actually you know
we can write a new style like that so
much nicer yeah
buddy that is how you write a hex dump
function all right that I don't know
let's dump like
10 uh no matching function called the
hex
okay canot initialize
ver segmentation fault
a
wait
what how did it
break broken power
on wait it can't open the device anymore
what
happened did someone delete the
firmware
Cent
died okay you
know I never thought I'd regret it but
pseudo launch control
start okay any is back does it work
again it doesn't work anymore
what did I
change this process kill
it that still
works okay I must have changed
something what did I
change
but I really don't get what I
changed God some of those things have
tabs okay open is
failing oh I mean I don't know why I
still set
that that was working for the longest
time no I worry that I didn't change
anything at
all
oh wait no open should return zero zero
is
right but there's no
Dev
oh okay this is just
some stack
junk okay it's
fixed some stack alignment issue or
something did I write my hex stump
wrong
and IM mod 10 equals 0o then you
oh
okay
working
example okay I don't know why I'm
getting all zeros out still I shouldn't
be should be running the program
right
zeros oh um I probably have to do
something with this receive Port right
this doesn't mean that it
finished
um yeah it's the same thing as the
iPhone IO kit messages all right so how
do I receive an IO kit
message
uh
example okay this creates like mock
shit I don't care about that you know
what I do
that there you go check out them three
C's I think that's
it I think that's that's just that's
just what returns right
I think that's
it those are the
rows uh let's make that you
sleep
wait to
do
uh that's right there's supposed to be
two of them they're hex 64 apart because
that's our
rows to do uh wait for message on
receive for no it's too ugly to leave it
that way we're going to figure out how
to wait for the
message we got it boys we got it that
just ran that just ran a neural network
engine and to confirm that we're
actually watch this watch this we're
going to we're going to we're going to
go crazy here we are going to
actually uh compile we're going to
recompile
well I'm going to recompile the
pist uh well okay let's get there let's
do one thing at a time let's first
figure out how to receive from the
port iio
receive iio can't
receive
um mock Port
receive writing a message receiving
function what is it
mock message
receive
what
funny
that I'll
settle oh italica was on in five minutes
all
right send me the V what's vitalic
username I think I think we're pretty
much done
here um we can confirm that those 3 C's
are actually the value so if we run the
one in
Swift oh no oh wait botz
live is that a
twitch all
right we'll see if italic actually comes
on is this ad copyrighted am I allowed
to show the ad ad's copyrighted I'm sure
they are you can't even show an ad
anymore
okay
um wait so actually yeah just to show
you guys that it's the same if we go
into corl and we run it we're getting
402 is that a float now what type is
that oh we're getting that because we're
actually passing things in in the
sweat we don't pass things
[Music]
in
one comma
one so what numbers are we getting
out and then we'll figure out to put
numbers in
too they're float 16s I
think just but C's not even supported in
float
16 um float 16 and
see
wow online L float 16
converter no no no we need float
16 I mean those three C's should be ones
in float 16
actually ah
how we doing on viewers what how we
doing on
viewers 838
yeah um who's he playing chess against I
don't
know I don't know if this hypothetical
chess is actually G to
happen here we go fast half
Precision oh look look look this this
bro
wrote thank you
Alex um
float um we got to make sure those are
actually ones because if they're not
ones we're getting scammed and if we're
getting scamed
scammed then you know we got to fix it
include float
16h float
16 what is
it do I just return
it
oh all
right
boys those three
C's they got to be right could they be
wrong let's go quick float 32 float a =
0 float 32 a we're passing him 3 c00 0
and we're print effing the float we
expect to get a one be a one one boom
love it cuz that's what happens when you
don't
put they
are float
16 let's raid botz
live thank you all for watching tonight
took a while but we got a custom hwx
running on the neural engine all that
code is committed to Tiny grad everybody
go watch metallic play chess did he win
the first game I don't know I'll see all
later thank you all for watching raid
botz live in 10 eight
something ah thank you all have a good
night
been followers only chat that's a great
oh actually I might still have stuff
where it's like you have to have been a
subscriber for a while no I might still
have stuff where you have to have been a
member for a
while I
not
okay who's coding with us today
we're drinking this disgusting ship that
has probiotics in it
you know you're getting to the end of
the fridge when you're drinking the
probiotics
[Music]
[Music]
all right guys uh so we're gonna try to
use the uh AMX today
start with a minimum test for it
Air Max dot pi
good morning hi
uh
you can import some stuff from llvm
um
[Music]
foreign
so let's just get a very simple program
up and working here
module
uh function
I need some buffers
I should be able to just use
I'm just I'm just today is election day
do you have a plan to vote with it yeah
no no no we're not we're not saying
anything mean today we're we're you know
not saying anything
uh this has a problem with Buffs
I care about that I can just write three
there
three is all we need
uh you know the sponsors the channel uh
called me up and said uh George you're
not allowed to tell people not to vote
George you're not allowed to tell people
that
um and I apologized uh
a lot and told them that I'm very sorry
and I won't tell people that again uh
psych we don't have any sponsors I can
say whatever the fuck I want
Japan from twitch
[Music]
no you just stay true to yourself and if
you get bad you get bad don't stay true
to somebody else if you stay true to
somebody else and you get banned you
know that's
hmm you're worried I become a sold out
well you know
ah it's a reasonable thing to worry
about a lot of people these days selling
out man
uh uh I wish you weren't working oh wow
good good to see you working
I even try to get Max to vectorize yeah
right 50 bucks 50 bucks if you figure it
out
um why don't I listen to music because
I'm not allowed to listen to copyrighted
music on stream
um
by the way I appreciate pull requests
some time you grad you know the tiny
Corporation is a collaborative effort
uh we now have a release
uh I did this release this morning look
look we got some we got some hearts and
stuff on it that's good it's on pie pie
I don't know if it actually works
but yeah tiny grad's a collaborative
effort uh with everybody
and once I get some basic stuff done I
think we can uh I can set up a framework
where it'll be easier for other people
to contribute
but um let's just file an issue uh
over here
new issue Max is not Vector right
Auto vectorizing
it's this fifty dollars
must
Auto vectorize not uh hand done
should make
speed similar to torch
okay now we have an issue
found an induction variable can't
vectorize
it would be important to uh yeah I got
that to work okay so today what we're
targeting is these slow ones
um I did a whole bunch of cleanup this
morning
uh but yeah these ones are using the AMX
and torch and we're not using the AMX so
we got to show you the AMX
so let's get to work here
um
create a builder Builder
[Music]
Builder this is a good minimal example
of uh lvm light too
ah
I am exact
[Music]
uh modules
we are gonna need some buffers here a
lot of Buffs Buffs for lvm buffer let me
just create those
[Music]
uh
I should be able to say yeah from CPU
[Music]
your website MP dot random
[Music]
let's make some matrices
[Music]
look at this look at this inconsistency
in our in llvm's uh
stuff we have our function it just
returns void
it's pretty boring uh did I solve fmas I
did solve fmas
uh
no I don't have any money I've told you
guys I'm a no cleaner man
um
now it's it's not any of this it
actually turned out to be that you
needed uh optimization you needed O2 not
O3
uh which I haven't seen mentioned
anywhere and I was thinking about it
more and I'm actually shocked that I
couldn't find it in the code anywhere
so that was yesterday's
um lvm light in-line assembly
uh not any of these
Okay so
we
Builder Dot
here's an example of filter Asm
uh oh that's brutal
foreign
store rag
oh man in fact
okay uh
error.int type
64. let's
let's try something like is this
[Music]
um
[Music]
does this work see if this will do one
plus two
uh what's F Type oh it's probably just
gonna be
saying type 64.
it type has no attribute return type oh
that's the type of the function uh how
do I do that
[Music]
[Music]
this should be
cool
um
so now we're gonna have to get the
these guys work
I oh okay that's just uh
number
that's a GPR
what's the number of the register
wow this stuff's pretty insane
and then it has side effects of memory
I guess you have to tell it that it's
raining here too
um but yeah I'm hoping this will be a
pretty self-contained stream we'll try
to get this AMX thing uh to multiply
these two matrices
um
hello after work talk
[Music]
so you know CN is am at BN and we're
gonna try to see if we can do that
automatically oh we're also gonna
numbers are big
[Music]
cool
wait I respect what
things getting wrecked
oh bro
that's pretty wild
rip
um no one's done this before right
[Music]
you know that's always a question
there's a library use it wait I did see
something AMX M1 llvm
no
I doubt it
okay we're gonna have to figure out how
to do this then
uh we should also figure out how to get
integers in and out of this weight
inline Assembly not supported by this
streamer because we don't have an ASM
parser for this target
wait that's a problem
[Music]
the entire thing I've been doing has
been done in mlir
okay we'll look into mlir what do you
mean it's been done
can somebody explain to me what this is
I've been to this page before
foreign
we have a bigger problem
all right
[Music]
[Music]
this is annoying
[Music]
I mean this might work if we install a
custom lvm light but I kind of don't
want to do that
does number use any Asm
who do they do
oh
you can also wait a second this works
for Cuda
oh that's awesome
you're telling me that this inline ASM
supports
but it doesn't support uh
AR 64.
the worst part is I don't even need the
assembler
uh no we're probably just not specifying
something right
foreign
I think that this is going to be easy
and it's not easy
you don't have an ASM parser for this
target
great this is this is just going to be
another struggle session with lvm is it
not
I figured in
no integrated ass
[Music]
is that a flag I can set oh I hate this
I hate this
we're back to this crap again
nope
[Music]
might allow you to hard code it for your
back end
how to switch off llvm's integrated
assembler
foreign
need an integrated ass
we don't have an ASM parser for this
target
guys I'm sorry this is another llvm
struggle session
one of these days I'm going to switch
off valve again
[Music]
and we're just going to write this by
hand
should we just write this by hand
should we start coating an assembly
[Music]
this isn't like we didn't learn anything
yesterday when we wasted all that time
to figure out that you needed to put two
in instead of three in order to get the
fmas
and that doesn't include the two hours I
wasted off stream trying to do it too
um Arch 64 wheels are available
all right
what if we do that
does it matter what I put
not supported by this streamer because
we don't have an ASM parser oh I I did
that actually
oh as in parser
oh Smurfy if you're right this is why
you're a VIP oh that's why you're a VIP
oh thank you oh yes
yes this is why you're a VIP on the
stream boom
boom
boom haha hell yeah
okay
I think we might be adding one and two
together but we should check
um can I call printf or should I just
figure out how to make it return
it's honestly should probably return
something anyway uh we'll just saying
type
uh in type 64.
actually we'll just do that here let's
do that here
type 64.
um where's exact
ly
exec returns C funk
oh
yeah
okay that's kind of fine
[Music]
it's not red here
I probably shouldn't return avoiding
these functions you should probably
return uh
um that's actually going to break all of
the stuff but we'll do that later
uh okay
all right add oh yes
yes
no no no no no no no no no no
we fixed wait what
what just happened why did that revert
where is it
you guys see that on the replay I don't
know what I just did there
um yeah that's bitching because I didn't
return
let me just change rhet void down here
to red and cons zero
ah it doesn't match return type void we
don't want to have return type void
anymore
we want our function type to be in Thai
64.
what
oh well it's just because I have this
stuff enabled
pretty cool
uh return zero should be pretty free
do we want it to return zero do we want
to return void
anytime we'd not want to return
no I think we wanted to return void
[Music]
publicity right because there's no
reason to
[Music]
[Music]
um okay that's probably not right
foreign
take that back I don't like it
um okay
let's
[Music]
we just run it twice whatever
[Music]
foreign
[Music]
[Music]
side effect okay did I just get the
order wrong I don't know how this stuff
works
three okay so one plus two is three
great
um that works
[Laughter]
and um free
free fall and drop don't speculate
okay I'm so happy I'll Smurfy thank you
so much for finding that oh man we would
have wasted hours you know
this would have wasted hours okay
uh actually I wanna let's go to debug
equals three so we can see code
oh look there's the special ad function
oh that's pretty nice right
so
um
foreign
side effect is the Boolean
there's a side effect not specified in
the constraints list
okay well whatever
[Music]
um
right let's figure out how these things
work
by the way uh thank you for uh reverse
engineering us so we don't have to
um thank you corsex or whoever made this
contributor two
attributed one typo
oh that's my new issue
um
but yeah uh you know pull requests for
for tiny grad uh so we we updated the
tiny Greg website a little bit
um an investor reached out and asked if
they could invest money and uh we
included this now uh the Italian
Corporation is too tiny to have any
Equity to sell we're looking for
contracts and sponsorship uh we also
added a uh one more question when are
you launching your governance token will
there be an airdrop and our answer is
Brock
uh I also added this I would also
consider an internship where I work on
Tiny ground in the context of a company
um if there's some cool company out
there who wants to make me an intern for
12 weeks
uh I'll hang around discuss your
problems work on Tiny grad you know
particularly someone who's working on
like if you're working on AI accelerator
chips or you're working on um
infrastructure tools uh my only
requirement is that the company be doing
open source stuff or at least be cool
with me doing open source stuff
uh you know and someone who's got like
an office and a culture it would just be
fun to do for 12 weeks
I'd be interested
well before we internship or whatever
makes sense
okay a full description of every
instruction
so we're gonna ldx here
um
load store pair of registers or single
register
Let's uh how do I convert a pointer to
little expression
does that work
oh sweet
cool you just put a zero before it okay
uh illegal instruction four okay well
that's something
um see the window on my band's dirty I'm
cleaning it up
uh we need to enable this thing
um there's like an enable instruction
set
raises invalid instruction if already
set up
uh here we go set
[Music]
so let's just write AMX up uh
GPR
let's move that we'll play GPR
uh Builder
[Music]
now we can say AMX Builder 0 fty
I'm sorry not fty uh
here we can say IR dot eight times zero
uh not fty here we want to say what
um call that GPR
before we do that we have to turn it on
foreplay
okay this is the five bit immediate one
so that's the other kind
uh we'll call this AMX pop GPR
and we'll call this one AMX knob Alpha
mid five great
M5
one doesn't take in any registers and
it's just an empty coupon
and we'll change that to M5
and then for the operation here we have
to set up
the AMX state
set is 17 the immediate is 0 for set
and let's knock off M5 AMX op GPR
and clear is 17. okay
let's try
let's index Auto Range uh
what list index
we don't have any arcs
50.
I don't understand
this doesn't have oh
oh it's because it is a function type I
say
so that has that and that has this
function type okay let me just hang on
you see the window of my band's dirty
I'm cleaning it up
[Music]
into type has no attribute type
uh option
[Music]
like that
okay
oh it ran
yeah all right watch if we don't turn it
on
illegal instruction four but once we
turn it on turn AMX on
turn AMX off
uh ldx we should probably uh
just straight out those uh
just get those helper functions in here
oh a tiny header for accessing AMX
instructions okay
so we have AMX ldx Builder GPR
[Music]
um
do we just want to do it I don't know I
want to find all those functions
do we want to define the functions in
every tail
[Music]
can I do this automatically
you can definitely do this automatically
[Music]
uh okay
regardless let's
um
need this anymore good I'm glad I didn't
waste much time changing them all to
ants because fans were stupid
uh let's just print
first off let's make and smaller let's
make n something like eight how much do
we load
if we load eight so we'll make that
eight
I don't even like random we'll do NP dot
a range and
dot reshape
shape
[Music]
it's not a very accessible Matrix for
people
all right great what what oh it was fine
okay cool
[Music]
um see the window my band's dirty I'm
cleaning it up let not subscribers talk
you guys stay on topic
[Music]
I see I just feel on today you know I
was winning chest this morning
I don't know some days you just feel on
some days you don't
okay I think we want to do an FMA 32.
[Music]
stz
[Music]
and then Air Max FMA 32
how do you fix the FMA thing you got to
watch yesterday's stream
um
yeah it was stupid load
Mall
store
AMX FMA 32 Builder okay we gotta throw I
think it's just a constant
all right never mind
never mind we tried letting
non-subscribers talk
set
over there
[Music]
here oh this is this is so many
I'm gonna have to refactor this so many
lines
I think this stuff looked nice but
I'll write that if you have loops
[Music]
a description of the register file
oh it's 16. okay so we have to make it
10 16 and oh God why did I write eight
that's not what we wanted
full description of every instruction
let's go down here to fma32 okay
um oh this is so complicated
uh y enable mode X enable mode
wow
no stone zero
constant zero oh I don't have any cons
to just import that
[Music]
I wouldn't have messed this up either
[Music]
I am accept request Builder
yeah these people did such a great job
right
I'm so happy
uh let's do c dot numpy uh no actually I
have to go see that two CPU because it's
not a tensor
okay well that's what we expect a lot of
zeros now let's store it and let's see
what happens
um
Funk are zero and we're gonna do a stz
here
wasn't going to be that easy who thought
it would be that easy nobody that's
right
um
it was just not that easy
well okay let's try something simpler
first
let's put in
uh
use at your own risk
STX and s t y
[Music]
let's try something simpler
TX
Builder pointing
we we loaded into X let's try it no see
that doesn't even work okay
so maybe we have to flush the cash
we're just trying to do a load on a
store unless we have to do something
special for the store
okay ignore loads to repair registers no
so that's right
cares
um
[Music]
oh
64 divided by 316 oh I can load two oh
that's cool
okay
well we would expect this to work so
it's probably some cash issue
let's find something that actually uses
the real AMX instructions
if you wrote a complete emulator
Apple's so good that people are writing
docs for them I know
trust me these dogs would be way better
than the dogs Apple would write Apple
writes the most useless docs like
they're beautifully formatted yet
useless
I've never seen Apple docs where I'm
like wow I'm happy with those quality of
those docs those are good quality docks
um
man why do these people email me
they want something what I want
it's like just look at this just look at
that email just just look at that email
you just know it's spam PS is this the
right point of contact to discuss
marketing no fuck you
uh
you have to flush the cash
foreign
Viagra standards these are companies
foreign
towels am I you guys think I don't wash
my hands I do but don't make cows
cows
um the corpse signature exactly
like my hands are no I gotta go find a
towel and we're gonna get some lunch
I'll be right
that yoga fan
hmm
just uninvent email good plan
uh okay
why doesn't this work
well
hang on
it's possible the register is wrong
remember how theirs looked different
uh what does this do
shift shift left four times six okay
maybe that's needed
generated the same car which is not a
surprise
okay we load in the pointers
uh oh
hell yeah that just worked
look at that okay so we made a copy
um we just loaded and stored the same
thing so let's try and multiply
um
okay no luck there
but if I store that
look at that
uh let's just do
they look different
let's try sty and I expect it to be like
that but the other side of it okay
that's good
oh that's so ugly oh oh no no no no
all right how do I set the word wrapping
in numpy
numpy something like set print options
come on that looks too ugly right
mine went
come on come on one line
no lime with
one thousand
there we go
okay
one thousand is probably insane I don't
know 160.
what characters is that
[Music]
Russell's probably wrapping at 80.
so that's the other
side of this or we can probably even
print C and it'll look pretty
oh hell yeah I love numpy with big Lane
long
uh long latches long line with
that 80 character wide terminal
poor people I didn't even Uganda has
longer terminals than that
[Music]
oh man it's raining out
if I had a mirror I'd show you here can
you see the reflection off my iPad
yeah I know right I'm telling you Uganda
looks at that and says bro that's just
only Somalia has 80 character terminals
so this one didn't work but we were
getting closer
um if I store Z I get nothing
wait
no I did that exact thing before and it
didn't work
I don't understand
how did it not work before
but I don't understand
foreign
thing and it didn't work
oh I think I fixed the bone
beforehand I don't know
I don't know I don't know what I did to
fix it but it works now so you know we
should just be grateful
um okay
uh Builder dot add
[Music]
builder.net
oh actually should we use Jap no no
we'll use that
um here we want to say for Iron Range uh
and
[Music]
then
oh this
just a little bit
[Music]
get const uh oh this one's actually does
not let's say in constant
uh zero here this one we have to do I
times uh
16 times four
runs there
[Music]
no matches
uh why does it match
probably because one of these is
transposed
post anything which ones let's just try
it
[Music]
no
okay we're gonna have to spend all the
time thinking about what we're doing
actually
let's be wrong
do this
no that was one of the transposed ones
right
boom
almost almost uh that's this okay
fine whatever
that's that and now uh
store in a loop
[Music]
do map Mall store for Iron Range and
um
equals
especially
[Music]
foreign
[Music]
[Music]
mm-hmm
Tuple has no attribute type
with a tuple
it looks the same as that right
oh
there we go uh oh we just need to
actually save the uh
[Music]
now we need to increment the index of
stz
really if this works this fast I really
think the uh the writers of this
incredible documentation
foreign
trash there already
um Builder ad zp and cons let's say I
shift shift 50 CX4
[Music]
wow how am I finding water
no
it's close though
oh I think it's just because I didn't uh
foreign
homies we just multiplied a matrix
ah using the AMX that blistering speeds
wow
incredible
incredibly good documentation
amazing
amazing
[Music]
um I could go further and actually put
loops and put matrixes around it but why
don't we just Port this over to Tiny
grad
uation
foreign
nice little short stream we got
something to work we didn't count
already issues
yeah you only want to see me struggle to
make that work in tiny grad
oh that pace did not work you figured
out why it doesn't wanna
no stream more
hey all right what what what what what
what
[Music]
figured out why it doesn't want to
vectorize Max
oh
wait
why don't you use this
oh lvm14 has the F Max reduction so we
can't use lvm 14.
but
why don't you just re-implement it in
terms of Select and comp
submit a pull request and I'll pay
probably 50 bucks
wow wait how much bits is that
oh we got bits
okay okay let's get a few you wanted me
to keep streaming let's get a few
subscribers up in here
oh yeah just re-implement it in terms of
fcom
right
hype train is close
oh let's read Rome's blog post
I think he's working on uh Toyota
security
um
all right all right thank you three cop
for gifting Subs
uh did we touch on FTX yes Finance has
signed a letter of intent to purchase
FTX yes
um
very cool
all right now let's solve Toyota
security
about to beat your last record wait can
we beat the record let's keep the hype
going let's give some let's give some
bits let's give some subs
oh woman's a boss I know
uh
yeah
let's crack Toyota security uh for
everyone who wants that
[Music]
uh
uh yeah yeah let's keep the hype going
woo
h
thank you thank you for gifting Subs
I appreciate you guys
um you know guys no wait real talk
though let's have a little conversation
and then we'll get to some some tiny
grad stuff uh well let me just
I don't want to do this
this stuff's ugly I'll clean that up let
me clean that up
make this functions generate
automatically
um yeah
it was like a four line AMX header
that'll be cool
foreign
wow
gifting Subs 20 Subs wow that's awesome
thank you um no we have a real problem
guys the tiny Corp needs to figure out
how to make money
oh so we we've we've uh explored a few
ideas uh we thought about selling
perfume uh but then
um the tiny Corporation does need to
make money uh
wow level six I don't think we've ever
done this before I honestly don't think
we've ever gotten to level six before
this is this is crazy
it's crazy we've we've never this is the
biggest pipe train we've ever had uh so
streaming is one way we can make money
as a tiny car but the tiny Corp needs to
start making money
um you know we we had a contract
potentially on the table but uh you know
it fell through you know it's just like
people aren't serious man it pisses me
off it's like
like just you know
I don't know uh
it's like it's like the same it's I mean
I'm you know I'm real after the Elon
thing I'm like dude these people just
like say they're gonna do things all the
time and then don't do it like that's
just what I've learned with companies
too companies have zero integrity
uh there is no like oh this person said
they were gonna do this and then they
just like don't and like what are you
gonna do about it you know what I mean
uh yeah one of the things that really
like got me frustrated with comma was
dealing with Qualcomm
um they they lied to us they jerked us
around that it was unbelievable
uh and I I wonder if this is how they
manage you know their other
relationships
I can't wait for uh
you know Nvidia at least was
straightforward about not selling us
chips Qualcomm told us multiple times
we'll sell you chips we'll sell you
chips and then like they never sent us a
quote uh okay well they sent us a quote
for 20. I'm not going to go into it but
you know it's one of the things that got
me really fed up uh dealing with
Qualcomm and I can't wait till somebody
dethrones these people
uh these companies should not be allowed
to operate like this and that should not
be allowed like I mean look I'd like to
see some I'd like to see a law passed
against price discrimination uh but it's
not just price discrimination the real
way to beat these people is in the free
market you shouldn't be able to have a
company that has all these people who
basically do nothing and like be more
profitable than uh you know I I
hopefully hopefully the Chinese are
coming uh for for all these accelerate
for all these chip companies
um
so uh
wait what
is this lagging again
guys you're making
something's lagging
or Safari's broken I don't know
hang on I got I gotta refresh chat
sorry uh hang on hang on
we'll pause that maybe I don't know what
happened
are we using all the ram somewhere we
like out of RAM
I think the the level 8 hype train is
just breaking everything
wow 5 000 bits from crypto Cod thank you
thank you whoever gave the Thousand bits
before uh I appreciate you oh this is
awesome thank you guys
um
yeah streaming is one way to make money
unfortunately twitch I think does take
half of it uh so you know just just be
aware of that but hey we like twitch you
know a good people
um
okay so let's let's talk about business
models for a little bit
um
level eight this has never happened
before
wait you guys are literally breaking my
Safari
stream chat's not working
I don't want to fight
I don't know what do we need Safari for
I need to be logged in
WoW gifted 50
fifth mtastic 85. wow
oh guys you're all amazing thank you
thank you for for supporting this
channel thank you for supporting the
tiny Corp
um you guys actually gifted so much
stuff that you broke uh Safari
uh
uh a level 11. I I just this is this is
amazing
um all right so we can't and this is
good I mean this money's good but we we
have to figure out a business model uh
for the tiny Corps
uh
uh this is the highest it's ever been by
far yeah
uh I'm glad to see you guys appreciate
this
um well yeah there's a seat around right
uh uh
yeah we'll get back to programming in a
minute
um we did a lot of good programming just
right then uh there isn't a max level of
course not but
um
yeah one of the problems is equity is
kind of a Ponzi scheme right like every
corporation eventually dies remember
that uh now to be fair
um companies used to pay dividends so if
you have a company paying dividends and
you expect your dividends to pay out
more than your thing before the equity
goes bust then that's fine but if
companies don't pay dividends you're
actually just buying into a policy
scheme right
if there's no dividends to shareholders
there's no way
like
out of this thing right you're like oh
stock BuyBacks yeah but stock BuyBacks
just just like it props up the Ponzi you
can do the same thing with your token
right to prop up a policy
um
yeah you know that that uh some what do
I present New York Finance guy tried to
tell me that stock BuyBacks and
dividends are the same thing and yes
like in practice they are right in
practice when you look at like where
you're going to put the money okay
everyone's share price goes up blah blah
blah blah
but um
fundamentally if a company well okay not
having dividends is okay but if you
never have dividends in the future
then how does anyone extract any value
from the equity in your company
right thank you for subscribing thank
you thank you
uh
animated emotes you guys actually
crashed Safari
uh I don't know about 10 story guys look
yeah
and it's not look you know you guys know
I like Jim
um you know I think he's very smart guy
but
oh they got rid of it right so if we
actually go back and yeah I'm gonna call
them out on this because I think it's
important
uh if we go on archive.org and we look
at this web page
all right and we look at it from like
um
right a year ago or something
look at it from a year ago
so it used to have a price and actually
talked about like when it was going to
shit when they were going to ship these
cards
uh now I haven't seen anything
uh you know about them shipping
if we find the right thing it actually
had a
yeah
you guys remember it I mean I'm trying
to find it but
no we can't sell merch guys we need we
need a real business model
uh 10 story I found out how hard it is
to build the cards yeah but like again
how hard are they really trying
you spoke with them over Zoom next week
they don't expect to sell chips publicly
until late next year you see and like I
talk to them and they don't tell me this
right
um maybe they did that to get funding
you see and this is the problem
right you know
dude
buy now
right is that that hard is it that hard
you can buy one of these we'll send you
one
um
someone's at the door oh probably
groceries
ah
the feds man maybe it's the feds
I don't know so
the groceries
now it's got a patch
foreign
Subs 6 000 bits really great
uh uh oh you found it yeah you found
what they said they were they were gonna
sell the cards
uh congrats on your emotes I don't
really know what they do yeah I don't
know why web archive wasn't working for
me but yeah look
here they have a price it used to not
say coming soon they even had one that
had a date and then they just completely
missed the date
um there's no open source software
okay
you know and like nobody really holds
these people accountable
um
no like it's just you're gonna sell
something or not right like it's
over promise under deliver yeah like you
know who should hold these people
accountable investors right investors
should read this and be like where's
your shit
like if I was an investor I'd be like
where's your shit
I would I would you know make a fake
undercover account like um and you know
try to buy something from the company
right and like try it don't don't you
think you should do that when you're
investing in a company that's like
series a or series B
nobody should invest in companies that
like fun your seed round if you don't
have something but for your series a you
better have a product that I can buy and
for your series B you better have
product Market fit otherwise what are
you doing
no I mean these companies don't sell
uh these companies don't sell chips they
sell shares
ah we can look like what you know
how can you be doing a series C when not
only do you not have product Market fit
you don't even have a product
right now that interest rate is not zero
I hope it's not that they're fraudulent
right again if you're you can't really
hate the player you have to hate the
game and yeah you have to hate the
people who set the funding rate at zero
percent
shit maybe we should go out and vote uh
no no
um you're doing well transfer from LPS
to your bank account yeah and like
I think a lot of LPS are going to end up
being disappointed uh at the end of this
with the fact that they didn't get money
uh back you know it's the VC is it's a
Ponzi guys like
I don't know
so I might complain about a lot the tiny
Corps is not going to be like that uh no
I'm not voting fuck that shit man look
like you think you vote matters
uh
uh and yeah sure in aggregate maybe they
do
but your individual vote doesn't
actually matter so you should signal for
everybody to vote and then knock a vote
yourself or you kind of but regardless
small amount of influence you have isn't
worth legitimizing the system right
um I'm glad you don't vote that's it's
the only rational choice
gosh
okay
ah
shit posting on Twitter has more impact
than voting I agree with that
but if everyone thinks that way it
doesn't all right never mind We're not
gonna get into it if you vote a
Governor's proposal you're uh you're
violating some SEC law or something
okay
man we should have just we should have
just ended the Stream
uh yeah no I would vote if there was
more than two choices
if the election actually like like was
correctly set up but it's just a scam to
keep you involved in the system all
right whether you vote the Democrats and
the Republicans are are have you noticed
how they always stay equally balanced
and it always goes back and forth and
have you ever wondered that maybe both
sides like it like that right maybe both
sides are actually conspiring
um
you know
and here's a good way by the way to talk
to like uh
I feel like they're really conservative
people are easier to talk to about this
and like sometime that they get um
sometimes the conservative people will
get like
like
aggravated and you know start falling
back to like dumb conspiracy theories
and stuff but
uh when you talk to like like you know
these like really liberal people
um
everyone needs to kind of realize that
the way that we break the system is
everyone needs to realize that the news
is all lies right and it's not that your
news is a lie right it's that all the
news is a lie so you can talk to like
really liberal people and ask them how
they feel about Fox News and they'd be
like it was propaganda with made-up
talking points and then shit what do you
think MSNBC is right it's all propaganda
with made-up talking points these two
sides stay in balance in this Perpetual
locked thing really to screw you over
um both sides need a boogeyman so you
don't turn against the whole system
right uh you know you might have like
Republicans who hate the state
department and like Democrats who hate
the Department of Defense those are even
a bit outdated I I don't even know which
side like squat anymore but he they both
hate certain parts of this large machine
and they they they hope that your hate
for the other side will keep you from
wanting to destroy the machine entirely
[Music]
um
but you know it look
fixing the money is a
see the problem is look even if you like
fix the money
maybe maybe it does all get fixed over
time
maybe at all maybe it all uh shakes out
not helping tiny Corp to talk about
politics is this really politics am I
telling you that guys you should all
care about abortion you know you're
you're shall you should all care about
welfare you should all care about no I'm
not saying that right I'm not telling
you what to care about and that's that's
where that's where I really draw the
line at bad politics right I'm not
telling you what you care about I'm just
telling you what the system is and you
know you can you can choose to do what
you want with that information
okay
now Civics not politics
[Music]
yeah voting is mandatory that's that's
so fucked up man
um
what other system would I propose
uh
it's not about another system right
there's nothing fundamentally wrong with
our system the problem is how much power
the system has
are the only fundamentally wrong with
our government I'm not not saying well
we should change the Supreme Court to
have seven justices instead of nine I'm
not saying anything like that what I'm
saying is
this is like basic new reaction Theory
um the government leaks power
right
you know what the government leaks power
in the sense that it can be influenced
by money right this is classic like you
have lobbyists and the lobbyists managed
to influence the government and they
influence the government and get more
out of the government than they put in
right so if you have a government that
leaks power you'll always get all these
people on the periphery trying to
influence it
right so you say that okay well there's
two fixes to this one fix is to make
lobbying illegal
but you can't really do that right
lobbying will always find a way as long
as the incentive structure is there so
you want to do is you want to remove the
incentive structure you want to figure
out how to remove the power from the
government
um and it's like well who should have
the power well nobody really should have
the power
there's a lot of things that are like
money printing for example nobody should
have that power
all right there is never a world in
which it's advantageous to print money
over the long term but in the short term
we have to correct this bubble
or preventageous in the long term to
print money
now if you want to print money you can
do it like this right if you have an
accepted Institution
that accept an institution can can make
credit right can make debt but the
institution can default on the debt
as long as you have this
like like it's it's the same people who
the FED lends out money
and what happens if you know you don't
pay the FED back
right
the FED can't go bankrupt without the
whole system collapsing
uh maybe team Technologies can give me
an internship hey John Carmack if you
want to give me an internship I'm
interested I'm I'm very interested I
will uh come hang out Dallas for a bit
we'll do some work
um this is pythony's fault
uh comma silicon when
I really don't want to make Harbor guys
I really don't
um
no I mean we have to just trust that the
uh that the Chinese are gonna make
Hardware
what would be the role of a government
without power well it's not the
government has no power that the
government should have very diminished
power the government's budget right now
is way way too large
foreign
I'm definitely not an anarchist I do not
believe in Anarchy at all
um I think Anarchy is an unstable State
look I I want to date with scar once
um we had to find a bar where she could
bring her dog which was already a red
flag but
um you know she's telling me about how
she's an anarchist and I'm like look let
me tell you about how Anarchy works
right
so you know I got my uh you know I'm
never caught lacking you know I got my I
got my glock right here and I pull my
gun out and I I show it to her I'm like
look If This Were Anarchy you know you'd
be my slave right now all right I point
the gun at her you know I don't put my
finger on the trigger I got my finger
off the trigger I'm not really gonna
shoot her but um you know if this were
Anarchy uh you know you'd uh you're my
slave right now right and this is gonna
last right up until the bartender pulls
out a shotgun
you guys are both my slaves dropped the
block right
uh so I dropped the Glock I have a slave
all right all right respect respect
um and this is gonna work right up until
the uh the police show up hello this is
the Oakland PD we have the place
surrounded we have guns and howitzers uh
you know watch out uh you you better uh
surrender all your weapons right and
then okay okay okay bartender puts a
shotgun down and then this works right
up until the U.S military shows up this
is the U.S military uh we have three
Chinook helicopters and an aircraft
carrier off the coast everybody please
surrender your weapons and submit right
and now we're right back to where we
started so that's why Anarchy is stupid
no it's just that's exactly what would
happen the same people on power now
would have power yeah right
this is solved with personal nukes I
couldn't agree more uh all right we got
to get off we got to get off the the
politics
can you guys come up with a good
business plan for the tiny Corporation
we need to figure out a way to make
money
um
yeah we can go back to subchat
so let me just clean off this code
steal money
sell nukes
made PowerPoint slides and sell it for
desperate middle managers at the fortune
500.
uh only fans 2 what is Tiny carp this is
the tiny Corp
I'm gonna go to the link here
I'm not logged in so I can't send
anything
uh what was your initial idea well we've
never a way to make money yet or
pre-revenue guys
see the window on my bed dirty I'm
cleaning it up
ah shit okay
I'm gonna just clean off this let me
just make this header complete
ldx ldy STX s t y l d z s t z
uh s t z i s
s r x
x r y
[Music]
foreign
take some money from comma we can't take
any money from comma guys
oh and like I don't want to sell equity
[Music]
back in back
P mat in
FP
gen Lut
[Music]
uh for all in Ops
I defined
definition globally it was like ways to
do this I do this entire ground
elsewhere do I know that
um
should I just make a class
uh what if you sold compiled software to
people who are too lazy to deal with
source code
yeah maybe make devs love tiny grads
sell tiny grad ports to chip businesses
Craig yeah I think that is kind of the
business model
[Music]
[Music]
then it's probably not a good question
If you're trying to ask a question you
can't say
I don't even guess we can say globals
uh AMX underscore
oh
[Music]
actually let's just do a dictionary
comprehension here
okay oh
[Music]
I think you know
[Music]
after something innocent without leaving
my fingerprints out
[Music]
foreign
[Music]
[Music]
[Music]
I broke it
foreign
what if I started a chip company
um it sucks that these now don't work uh
even if I can make this work I'm not
sure I want it anymore
there's nothing skipped right
foreign
foreign
kind of like that syntax you know
um
it's all right uh
actually that's a good way to do this
actually
[Music]
[Music]
what I understand
did you find the class right there
oh it's just this is incomplete uh
said enter
or AMX the name is
thank you
I have to tell about the static method
[Music]
until a service Y2 in the hyper
parameters
Maybe
I don't know
[Music]
I might have to wrap that in static
method
uh
site fault 11. that's a weird one
foreign
up correctly right
that eye is captured right it doesn't uh
who made 32 is definitely 12.
thank you
[Music]
pie torch generator Revenue that's a
good question
is it seg faulting now
foreign
why is it seg fault now it doesn't make
sense
foreign
foreign
why is that being called like that
that should be a Lambda function it
shouldn't actually be called
am I doing something stupid
hmm
why is this changing
why are those
not the captured number
oh God it's using that eye
how do I write this
like it's using the outside eye
okay there's a way to like specialize a
function it's in like Funk tools or
something
um how do I partially apply a function
the new partial
positional arguments R's and keywords
more arguments okay
um
put off here
[Music]
and then from
[Music]
foreign
[Music]
that works
it's a pretty nice API I don't think
foreign
X is not defined
is it just better to just write these
out
like they have to put stupid static
method everywhere
foreign
[Music]
[Music]
foreign
ers
uh that's not the problem
foreign
[Music]
way to write that such that they would
light up
you know
an ldx
was not over here not light out
no it's not a method
ah
actually I can write these any better
way set equals partial
I'm gonna put in five here
up up in five
Seventeen zero and there we go
actually more readable if I do that
all right all right fine we'll do these
by hand
[Music]
further unit testing uh yeah you can
read the test in time you guys are
pretty good
[Music]
[Music]
yeah I like writing these out because it
helps me learn about them too whenever
you do this stuff by hand you're like
wow you can write scripts to do it but
then you wouldn't like see like what the
uh
Things Are
what's an FMS
now from this Mac 16.
and the others have a 16.
16 FMA 16
FMS 16. oh this is all reverse
engineered too so these aren't really
the real names but I wonder
I don't think they're the real names
17.
uh
pr18
way
[Music]
s
that's pretty nice right
foreign
that's pretty beautiful this is all you
need to support the AMX
and then you can like use it like this
[Music]
let's add some comments
[Music]
[Music]
there
yeah I don't know if you need those
point-wise products oh that's cool
it'll like add them up that's cool
[Music]
foreign
foreign
ready to actually try to make the AMX
work
10 out of 10 Branch naming or Branch
naming what did I name
uh
uh let's see which permutes I want
oh sorry my tester Ops we want test
speed
chunker yeah
it breaks the things up into chunks
so
we have some code here
um which if you're doing a matrix
Matrix we'll get rid of the cashier
share that was without the caches you're
just left without the cash
it's a lot easier to think about without
the cash
so this is a matrix multiply two four
one three
um
foreign
16x slower than Pi torch now
part of the problem
is that we're only four by four
I thought this is hard wait this is
going to be really hard to write
shit
yeah it's better but
okay
[Music]
let me think
okay well what do we know
we know that this thing outputs 16 by
16. so this d y and DX has to be raised
up to 16 by 16.
uh yeah I wrote the time you got one
it's really simple
backpack's pretty easy
so you see now this is loading
about one chunk here
like all of these need to be coalesced
down
to a
Hmm this is a wrong idea
we need to Loop over one of these
I'm relying on llvm to do a lot of this
for me
so all these load store spills fmlas
uh this whole initialize will become the
the AMX
you gotta think of what the loop
structure looks like
terrible this looks all like this
foreign
yeah you're right I should really
support inops
you should add iops the shade tracker
because that is harder to read uh would
it would it look better if I wrote it
something like
instead of this I wrote like why why x x
uh k
to y x k y x
does that look better
no I see your chat
okay well first off we have to put that
Malad thing back that I took out
and how I already messed up by the time
I'm loading
okay let's refactor this a little uh
hmm
get
idx is we have idx and we have up index
[Music]
and then down here
we can use this as get
idx as
usual zero
uh oh Builder
[Music]
foreign
so what this does
um is it uh
I'm not that close the monitor
um
this generates the the
um
the IDF the the indexes
for uh
the loop
and that's all like coalesced by
oh
so I was reading this wrong
so one of these has tried zero and the
other one okay
this is good
uh
okay
this is my Matrix multiply here
you'll see that
these are the indexes of this 16 by 16
grid and you'll see that one of them is
one and one of them is zero
now what's special about zero and one
is one means they're contiguous and zero
means they're repeated right so those
are the strides
it's only going to work for this one now
but we should be able to turn these
things into
uh
something much nicer
this is all that's just the output stuff
no I'm gonna be outputs all over the
place but that's fine
foreign
naive way which is nice for llvm
but not so nice for uh
foreign
[Music]
just write it in by hand for now
that's still a good refactor anyway
[Music]
we'll just write it by hand for now
all right I mean I can fix this to
support stride zero
still be left with
get it working somehow make it nice
does this does anyone see what we have
to do
like
so
sorry for all this crap
um maybe it's easier to look at if I
just show you 4x4
okay so remember the
AMX is a 16 by 16 thing
this is 16 by 16. it's bigger than that
but we'll just assume it's 16 by 16.
because that's what it can do on the
math I can do 16 32-bit elements at once
so this is the four by four one you'll
see that it loads here
uh this
and it loads here this
like one of them is the Y Dimension and
one of them is the X dimension
what if I do like Bermuda what are these
things look like no that looks crazy now
uh you gotta do it from unlr
commuter is going to be the fast one
um
I'm trying to think do we even need the
same loops
I Feel Like We Do
foreign
this up a lot
I'm using this up a lot if I put caches
in here
do we do Jap we do Jap on both right
yes
I'm already passing in buff indexes in
there
uh
so we'll just uh to pass in Funk then
too
oh really that's already global
um it's annoying
it's that inner FMLA that we're trying
to replace with uh
this is what we're trying to replace
okay
still a function on here called use AmEx
[Music]
if we're using the AMX
when we do a load
it will load we do AMX dot ldx okay if
buff index is is one
uh
uh all right we're gonna we're gonna
write this very hacky at first
we're gonna make it work and then we're
gonna okay
buff indexes were one assert uh
where's my loader here okay
strides of
buff index sub minus one equals zero
[Music]
AMX ldx
Fun Cards like buff index now we have to
do into pointer on that
is my AmEx code
no but it's not just that
we do have to still do the base index
which is idx
so buffer pointer to end
up that
but we have to
add and we also have to pass in Builder
here Builder Builder ad add the pointer
to the index and we've got
we've got another buff index equals two
else
insert
uh
uh Air Max only supports
okay for this one we have to put the
stride
whoops
like this and set that like that
but that should be correct otherwise all
right
uh point of the end is missing
this
uh let's just call it uh XP
on SP
is the floating pointer
all right
at the pointer nicer
foreign
buffer has no attribute up
I don't have to return something
uh we don't have to return
[Music]
now those are going to give me some none
okay no one has no attribute type great
um
you see the problem now it's parsing
this AST
we should go back and see how I did the
mall
remember we did the FMA Fusion by hand
guess what we kind of threw the FMA
Fusion by hand again
A reduced line count
no these are less readable
we're not we're not interested in code
golf guys
um
Where'd I get rid of the FMA
yeah fix FMA what a waste of time
this one
how did I have this
where is that
length reduce Ops
[Music]
and then sear so that stuff all works
but here what we need to do is
um
[Music]
okay those are going to be none we'll
really have to like get special
Sentinels for the AMX buffers
but uh we'll get to that later
if FMA
here's what we want to put in the
uh uh FMA instruction
so we'll say
amx.fma32
Loop index
zero
[Music]
should work
exception no reduce
oh oh we don't have a reduced result
you shouldn't return none we should
really have this return something like
amxy
AMX X
[Music]
and this should say reduced results
we did like clean this up but hopefully
you see but you see what I'm doing but I
don't know if anyone actually follows
when I'm doing this stuff I think
hopefully someone does
but like and so instead of the registers
being returned it's sort of like the lvm
registers we have to return like a
special Sentinel saying that's in the
uh okay
uh where do we check reduced result we
pass it into AST parse but
I actually should never really get there
um
if reduced results
here
oh this is a store okay
uh if you use AMX
else
um
range
16.
and then it's not zp here
zp equals yeah where's FP
where do I said FP up there in my load
so we have to load and store the uh AMX
register
I call it that pointer
Z pointer
phone cards zero
put Z pointer here
and then
wait what
I don't even use that that's stupid
[Music]
foreign
X there I don't use that that was stupid
code
um node should have
one predecessor for each okay so
wherever we create that Phi we actually
don't need to create that Phi
Reduce by
this
uh if use AMX
else uh we need to clear the Z register
how do I do that there has to be a way
to do that
and I guess I could turn on and off the
AMX is that the fastest way to clear it
yeah maybe
Amex
um
they're coming from there
AMX clear uh
it's actually not what we want
just try it it's going to give me some
involved instructions probably but
um oh
inverted
we'll go variable Val mentioned before
assignment
of these append Val
oh we just don't need any of this
actually
[Music]
[Music]
something like this
uh also if I didn't change those back to
uh yeah we're gonna change it back to 16
by 16 because that's the size of that
int object has no attribute Asm
uh oh
if it's yeah it's not store loop it's um
Loop entry sub store Loop
[Music]
maybe I just want to do this right and
let's just Loop exit
oh I should really also label these
instructions
so that's what name does though
fine girl no it's not grouped at the top
of basic block
uh oh I see what it's mad about
I there after that okay
these we want actually to be way down
[Music]
what still complaining
that's asm's start oh I had the looping
uh
okay
expected op code
um
why is this word wrapping
oh because that's after the branch okay
you don't want to do that and put them
here
no
foreign
about the finals man
that's just annoying
a little bit before the branch if I
equals store Loop
[Music]
foreign
[Music]
call to
this
we have to put that in the loop exit
uh so but I have a feeling if I put it
there it's gonna complain about fly
nodes or something
basic block parameters greater than SSA
fine that's great you tell that to the
maintainers of llvm I'm sure they'll
love to hear your opinion
if
you use AMX and I plus one equals store
Loop
foreign
it runs
it gives us a wrong answer but it runs
which is pretty good
let's make our Matrix smaller
legal instruction four
foreign
set to uninitialize is that really the
fastest way to do this
and it probably is okay which is a
little annoying because if we're doing
the problem is if I don't have a loop
um
why is it putting them in all the things
it shouldn't do that
foreign
let's look through for What's Happening
Here
so these are all the stores
uh that's fine
I already loaded those all okay it loads
us all to begin with
foreign
lift
I mean sometimes I just want to have
this generate C codes instead of
generate uh
why is it putting those in Loop exit
that's right
so these are the loads and then this
actually triggers the uh multiply
and then this stores the stuff
oh no I have to add to the point or two
I did a hack and then AMX did I not yeah
I type 60 times four that's just not
right here that's not what I did right
yeah of course that's what I did
um which actually is not what I want at
all I want
this to be multiplied by
uh strides
of
zero
sub minus two
why should I just want to use get idx's
here
let's just look what the strides are
so this is the strides
oh that's right
here we're also going to say assert
strides of zero so minus two equals one
nine thousand stars
yeah so 32 is right there
[Music]
um
you're getting something
uh oh did I not multiply in the loads
correctly
oh the loads are based on the index
should be right
right it's not storing
[Music]
um
foreign
why am I getting zeros there that's just
not right
why aren't I working this is my job now
I work with a tiny Corporation
okay well those are all zeros for some
reason
oh I don't think wait where's my Z
pointer yeah yeah this is dumb this
isn't what I meant to do
this needs to be added
[Music]
do you like zero
and we stride through that
oh
that's uh
did I make the same mistake up top those
indexes are need to be multiplied by
four
yeah that needs to be multiplied by four
I don't see why it has to be multiplied
by four by the way who knows why it has
to be multiplied by four see if anyone's
paying any attention you should figure
that out why does that have to multiply
by four
foreign
[Music]
40 space time no that's not correct
boom
it worked
why do we have to multiply by four who
knows
foreign
is just too low no that's not correct
four bytes pack you're getting close
what's true about four
imagine thinking we could read the text
size
it's working yeah yeah yeah but let's
talk let's let's see if anyone's paying
any attention why do we have to multiply
by four
okay well it doesn't work when I put
floats on
just like numbers are wrong
rectangle
flow 32 is four bytes thank you roon 007
someone's paying attention
get rid of those asserts
or is the smallest composite number
is that true
why not use float64 bra what you think
we got gigachad floats up in here
dqf of T thank you for gifting a sub
uh okay so it doesn't work when my time
my it's still wrong when my uh thing is
not nicely oriented
um
we know it's it's actually here
I'll just I'll write the right one
um
no
we have to transpose that
so it's this one
but then transpose permute LR
appreciate attention payers
sorry
well it's because we casted the pointers
to Raw integers which we probably
shouldn't do and we should probably
clean up
um okay here test speed versus torch all
right let's go back to random numbers
and see what we get
yes it should just be this for
transposed
oh I hate that with my numpy
that's my new favorite line
yeah it's just this but transposed okay
everyone see it
um there's some way I can fix this by
like changing which ones
see it's transpose that will see if the
Matrix is transposed all right good
uh
let's
do that
if I change this line
okay that works cool
um actually we can test this over here
too I get rid of this transpose
and I do this
[Music]
cool
okay
um now notice it's still 177 times
slower
but that's okay
[Music]
let's make it big and see what happens
seven times slower not bad guys not bad
that's way closer
remember when we were 20 times slower oh
now we're only seven times slower
oh that's nice
um
I think we have to make the thing even
bigger
we have to make the thing even more
insanely big if we want it to uh
but that's pretty fast right
is this live noise recorded bro
I knew you're gonna ask that though so
don't worry I got you
um
foreign
you know what might make it faster if we
add caching back in
this is cached
shit was so cash bro
what's the size of the cash 128.
because I wrote all this right this
should just work when I
do the same speed
okay now we could go even more extreme
first off let's try on a bigger Matrix
we're getting close to just the
overheads
by the way how many flops is that
291 gigaflops
well it's only 39 gigaflops I bet cash
really matters there
um
barely
right
foreign
that's faster than is even possible with
the neon instructions
we added a lot of crap in that's gonna
have to be cleaned up unfortunately
yeah maybe not too much actually
let's just make sure all the tests still
pass without this
[Music]
foreign
[Music]
aren't the right idea
we can also add more
so
I'm not using the AMX to its full
potential I'm only using one of the
registers
so if we look here in the register file
there's actually eight of these wide
there's a huge chunk of memory so this
is a 64 by 64 Matrix of bytes
so we could go to 64 by
wait
64 by 64 Matrix of bytes
so that's registers
so
each one of those
is in and of itself 16 floats
that's crazy
so there's 200 there's
256 kilobytes of memory
all right why does it say 5 KB total I
don't think that's right
oh it's not 64 times 64. it's just 64
times 16 times 4.
okay that makes more sense
there's a there's 4K memory
uh that's not that much only four
kilobytes it's a pathetic amount of
memory
remaining 64. by the way that's when we
why we need to select on that Z thing
that's why we need to put that times 4
there
actually why is it not times eight
times eight
uh
should I make sense should not be times
eight
right because we want to go down the
oh
no I guess this isn't
right
because it's not okay
164 bytes of X and 64 bytes of Y have
been selected operations between X Y and
Z can be performed
foreign we want to go a little faster
let's go a little faster
let's go faster
so instead of 16 by 16
let's crank this up to 64 by 64. now
I'll start with 32 by 32.
it doesn't work
but it's fast
so now let's make it work
[Music]
[Music]
s in range
zero dx16
y16
[Music]
we're gonna have to read how these
things work
uh
okay so that's at 53.
[Music]
one of those assertions back
and then for this we want to say uh
it cost for or
oh that's the mall uh
Builder Dot and I
didn't const
by shift shift left 56.
so that loads it into the indexed
it loads it into the specific part
of the of the register
still changes nothing but the loads are
all there now
now we have to do the matte Mall
right so there's
we have to update the fma32
X offset y offset zero
let's say let's just call it uh AMX
size equals two
we'll make it work first with Amex size
equals one make sure we didn't break
anything
um
and actually we're going to make this 16
times Amex size
cool
test passes
now let's try to make Amex size two
so here in our uh
FMA
[Music]
um
for J in range AMX size
for I in range AMX size
[Music]
um
shouldn't matter what order we do these
in so we can do something like J shift
shift lab 10.
or I now I don't know what 0 is
negative Infinity
okay
well we probably need to specify Z
let's just confirm again it works for
AMX size one
foreign
by the way
I recommend now
we broke everything else but the AMX
works
why you use Incognito and God is
watching anyway y'all I like that shit
yeah I like that uh
fma32
look look it's just like the real code
which does FMA 32s
that is zero thing
I guess
oh X offset and Y offset I think I can
go anywhere in those
so we probably have to do
J times 16.
I times 16.
does that make sense
oh well MX is still one
okay
now we probably just have to fix the
output
um
for zero let's try J times MX size plus
I zero
get it zero all right
row shift shift 20.
that's good now we just have to fix the
output store
let's first change that to K
why is it times four
foreign
[Music]
ER
foreign
this has to change too
I don't even know if that's right but
this stuff has to change okay
strides
that's a row
actually
it probably isn't right
16 because that's how many there are
across
so let's do plus I and let's do J times
16 there
probably not 16.
let's think about this for a second
it's 4 times 16 64.
the docs for sdz quickly but we we also
have to change that second part
um
[Music]
loss
let's just PTR equals
this Plus
uh and actually we want
J times 16.
that's probably right
something like that
by Sarah 10 okay it's not that
zero there's 64 zeros
which is why that times four doesn't
really make sense
is there not enough of these
try that
it shouldn't crash
okay we're just not hitting the right
thing then
[Music]
I'm 16. oh
okay it's storing something now it's
just a wrong something
it's pretty good though right
let's get rid of the Jag see what we got
same wrong something
I picked a j I picked a zero
[Music]
oh we might have to like
okay all right
J times
sub I
mean x sub i x sub I well why do I have
a y offset and an X offset
F32 Z one row from each four
foreign
what does that mean
what does that mean
don't understand any of this but you
can't stop watching
oh it's not bad for a Tuesday
zero High bits ignored in Matrix mode
I don't think I think this is actually
all we get so this is probably right
once we once we get this right
foreign
bigger than well first let's make sure
always make sure you didn't make mistake
AMX size one still correct
spell correct okay
well I said AMX size to two
and no longer correct uh maybe not so
good okay
these ones are right these ones are
right these ones are just wrong
uh when I did those times 16s
yeah those are probably right
oh did I do my loads time 16
or the loads
no I didn't I might have to
now this is X and Y register index okay
so there's
literally only uh
seven of them
that's right it's not
let's do a small one and see if we
figure out what's going on
wait what
why does it take 70 milliseconds in
torch
oh
see look torch has broken garbage
probably because I reshaped it
I mean because I can set the type right
it's probably more likely uh
hot or 2x off
the right which I'm not sure it is
it's not giving the right answer yet
do four fmas which
you get us like
does that make sense did my did my hand
animations make sense to you
I hope they did because if they didn't
you don't get new ones
uh J times 16 plus K times stride I
times 16 we multiply that all by four
K times 4 is down there 0 is there
maybe somehow it's permuted
no
um somehow that's permuted
somehow they're both permuted
foreign
don't work
let's print them out let's change this
to 64.
okay here are the matrices okay
these ones don't match and these ones
don't match
nothing matches
it's got to be some permission permuted
thing
I don't like that I'm like loading it
into Y and X
I don't like that if this one loads Y
and this one loads X
that's what's backwards I think
it's just got to be some commuted thing
to be able to see it easily
why guessing things when the whole code
is there okay okay okay
mka genius too you figure it out you
figure it out without guessing
foreign
everything
no
um okay can you print the whole Matrix
please print hole Matrix
give me normal numbers
uh
[Music]
okay we got normal numbers
uh there's numpy print options that we
can just like disable this
man I wish um
this worked
that doesn't work because we didn't put
in the load and start
just only doing one which is fine
um
added
Century Loop entry Sub Zero
[Music]
see that should work there I don't get
it
shouldn't actually give me an illegal
instruction
setting it right there
[Music]
is it mad because I never turn it off
it's only mad because I never turn it
off
so I plus one never equals store boot
how can I know I never turn it off
I don't understand that
[Music]
a big hack
[Music]
oh it must be because it calls it twice
I get it
um we're almost there let's just have
numpy print the big thing
[Music]
well how do I do that
for us no it's not suppress
um
I know whoever reverse engineered this
is the real king
uh how do I not
uh
pass sys.max size
in here
foreign
okay now let's look at this Matrix and
let's see what's wrong
uh let's put in some more same values
doesn't like those
too big
um
some values close to zero
that's n times n minus 32 times 16.
foreign
s that are close to zero please
why aren't those values close to zero
uh n is 32 right
negative
oh because a negative times a negative
uh
I guess you don't know how to do this
thank you
that maybe
okay those at least look
too negative okay this is getting stupid
just show me some normal numbers normal
sizes okay those are good enough
okay it looks like we just aren't even
adding the right things it's not a
permutation issue
uh the other thing that we can do
is actually my thing is wrong here
let's try to use one before we use two
sorry ah instead of AMX size we'll have
AMX size Y and AMX size X okay
why AMX size X
this one is AMX size Y and this one is
AMX size X but does that really right
that's buff index one
no that's right actually
that's right all right
this is an exercise y AMX size X MX
times y
uh no that's actually times MX size X
okay that gave me the right answer now
that doesn't even make sense
is it just the pointer one that's
supposed to be flipped or is this Matrix
just symmetric and stupid
um does it not work when I go to 64.
still works at 64.
does it not work when I add random stuff
back in
great it works now
cool
uh I ask are those prints let's go back
to a large Matrix thank you smurfd big
win for you today big win figuring that
thing out what a waste an hour on that
all right 8X slower bullshit
oh did I not actually did I set them to
not two
I set them to one didn't I
oh I set them to one of course it works
okay no wonder it wasn't faster back the
drawing board
[Music]
all right n equals 32.
[Music]
and put the prince back
no no no no no it doesn't work yet
that was a false alarm
okay let's try making AMX size 2 go up
uh no okay that's bad
now we gotta crash
and that one's just wrong
bottom half of the Matrix being filled
with zeros
[Music]
you like print debugging I like print
debugging too right isn't it isn't it
the most Pleasant way to debug
these numbers are not small enough I
want smaller numbers
those numbers are too small
I want medium-sized numbers
that's the best I can hope for
okay so something's really going wrong
sparse Matrix we are never supporting
sparse matrices from AMX is for dead
shit only
foreign
debugging so visually appealing though
uh maybe the problems here
try just storing one
[Music]
the GDB is not going to support the AMX
registers now is it even if we just
store one it's still wrong
um
the top one
there must be some bargain now we're
doing this
oh do I not increment that
stupid
I have to add uh
to add to that don't I
gotta clean all this up this is terrible
well those aren't right
foreign
now back to one one and it's wrong
oh God sorry
I'm getting tired
Grease
towards zeros but it only stores one
that doesn't make sense
that's that quadrant of The Matrix
so it seems like this should be AMX size
Y and that should be AMX size X
then
you should go here this should go here
[Music]
wrong
okay it smells like it's just not going
into the right zero then
let's do one of these
foreign
it's loading the wrong thing it's like
it's not actually loading it into the
other
buffer here
Builder add-ins const
I shift shift 56.
is that not right
X Y register index
is
shifted over is I shifted over 56.
I'm definitely loading into the other
register
there's eight of them right
this is the upper quadrant of The Matrix
it's like it's like loading the wrong
thing
saving the wrong thing we don't really
know
well if it's saving the wrong thing
oh that's zero that's all zero so that's
just not right if it's saving the wrong
thing
um it has to actually be putting the
wrong thing in there
so then the problem is here
it's got to be loading the wrong thing
somewhere
foreign
get that right
oh
he's just running it multiple times
maybe we do try to just do that all at
once
okay that at least doesn't output the
wrong thing
let's fix the loads
okay that doesn't output the wrong thing
anymore that's good
now let's put this loop back in see if
we still get that top one correct
that's still correct now let's work on
saving
get rid of that break
where do we get a new one okay it's over
there
and
it's not that one
which one is it
it's not anything
it doesn't match anything I've seen
this look at that
this but copied over there okay
so wherever we're multiplying by four we
have to multiply by a lot more
um we're doing I times
16.
4 down there that should be right for
the star
do we have to say like 0 equals I times
four
that's also K times 4.
look where it got those broken things
from
got it from there
oh it's possible we're loading the wrong
thing I'll try not multiply by uh
did I forget to multiply Again by four
no I multiply by 4 there
God I hate that this is stupid
um
I don't know if that's storing the wrong
thing or loading the wrong thing
my guess would be it's loading the wrong
thing I don't know I'm just put a times
4 here
changes nothing
uh times four here
to do suppress equals true
we're gonna have to sit there with paper
and do this right
you know
our suppress equals false
I don't want any scientific notation
disable scientific notation
not suppress always print floating Point
numbers
false and scientific notation is used
only sometimes but I never want
scientific notation how do I do that
uh like this
okay well that's just gonna be broken
stuff at the end so whatever I did there
just broke something
foreign
this is the same as this
[Music]
shouldn't do that
maybe my target zero is wrong
maybe this maybe my oh maybe oh
okay
this could be wrong
aha okay that matches now
wow so that's a real offset then
that's not uh
that's actually offset into the flow
yeah so this Offset you have to multiply
the offset there by four
because that's actually an offset into
the register oh that's crazy okay
cool uh maybe it'll just work if I
remove this last break
there we go
um let's make sure it works if I disable
one of these
no
the X and Y offsets are in
fights
not
elements
set that to two and see if that works no
it doesn't work okay that's because one
of our things is wrong uh yeah I think
we got the strides wrong here
um for the output
not correct
foreign
foreign
let's do this a little more methodically
I'm gonna have it working I just need to
disable the uh
actually I want these to work
independently okay these
this offset and this is the Y offset
so that's right
zero
X offset y offset
nope
it makes ldx
foreign
how does that not change which ones get
outputted it should
oh well maybe it just can't work if I do
whatever
right
no that's not right anymore all right
change
I just slept
I just flipped
uh actually I'm not sure do I filter
that maybe I flip that
okay
um
get rid of that
uh to change these independently
foreign
there we go 3x slower
uh 3x slower we can do something else
here too I think there's a way to say
load two registers
so this is the main Loop here
there's a load to command
and the last time I saw your progress
things are getting out of hand yeah no
uh I know things are out of hand all
right let's change this to load
load store pair of registers if we said
62 so I can go here
[Music]
um
[Music]
oh
2.74x slower
and then we're reaching kind of where
tiny grad's overhead is you know what I
mean like it's not actually slower
anymore it's just uh
it's just overhead
yeah okay it's within 2x
um things get really slow if I do yes
yeah things get really slow if I do that
probably because I'm not cash aware
we're actually going around
1.83 like that's this is getting
it's hard to make it too much faster
than this do I have the cash aware
version on no I don't
I mean we're with 2x like I don't know I
don't know how to
I'm pretty happy with that
that's 2x of the hyper optimized now you
can't go faster there's no way to go
faster the magic is going to be once I
figure out how to genericize all that
bullshit which definitely sounds like a
tomorrow problem
um and get it to work for convolutions
right when I'm making the AMX work for
convolutions oh man it's gonna be fast
no because like right now it doesn't
work for convolutions
those are the stores was the main Loop
the main Loops right here oh that's like
hyper good
oh I can make my stores faster actually
I can do the same thing with the stores
can I not
um
I want to do pairs
old store pair of registers
that's the uh not the store this is the
store
foreign
I can already feel it
no that's right but didn't do anything
I wonder what else we can use this
engine for
tearing through memory toe
and yeah I think there is no way to fit
more in
any rows here
yeah this is using using all 64 Z
registers
and that's confirming that's four
kilobytes
64 times 16 times 4 yeah
yeah four KB
it's pretty good
oh you can oh look we're sub we're sub
2x I how is torch faster how can
anything be faster than this
it just has to do with cash I guess
um
play with was my cash number
2d6
4.
it's faster
how is this
Pikeville just paying off Apple I knew
it I knew it how is anything faster than
this
blazing man like look this is the pretty
much the uh
what I copied from here
that that
12 it wastes time loading my Loop's
actually more efficient
um
yeah
I don't understand I I have no idea how
their thing could possibly be faster
than mine
which party did I vote I didn't fucking
vote stop it stop it the Democrats want
you to vote the Republicans want you to
vote George says don't vote
guys if we all stopped voting they'd
stop harassing us how many tests how
many texts have you got how many texts
have you gotten from these people who
are like vote for my shitty shit
that's right that's right nasty wasde
knows how to do it he never voted in his
life
George is out promoting not voting
that's right
that's right what else you're going to
promote you got to believe in causes
these days people and my cause is not
voting okay some people want to save the
whale some people want to kill hippies I
want to promote not voting I want to
promote non-participation
I'm not anarch or capitalist not
anything I'm not anything I'm not voting
for it
just educate yourself how do people get
promoted and you mean tiny Corp well you
mean comma people get promoted a comma
by shipping things
um if you manage to like you know work
on a good thing and you ship it you
really get promoted I mean the titles
are kind of meaningless but uh you get
raises and then like the real way to get
promoted is once you start managing
people
when you start managing people like the
people who manage people uh you know
have a lot more uh equity and higher
salaries than uh the people who don't
that's the quickest way to like uh you
know move up really fast and then comma
um ship things and then manage other
people to ship things
uh
how hard would it be for a Danish
citizen we we try our best to not we'll
get you a Visa uh if if you know again
if you're good
um we'll get your visa
if we can
I I don't like I'm I'm look
I'd vote if it was the uh I'd vote for
the the
how about this it's open borders but
you have to have a salary above a
hundred thousand dollars a year right
it's open borders for anybody who gets a
company to pay them a six-figure salary
uh and this is confirmed of course by
your W-2 all right let's confirmed by
your tax returns so if you have a
company who's like I want to pay you six
figures welcome to America it should be
very very easy why the fuck do we not
want this person here this person's
literally gonna pay you 35k in tax
federal government
why would you not want a free 35k no you
got to fill out a form are they a J-1 or
H1B or are they going to owe one no no
bro bro bro your lawyer scams are only
making like 10K on the Visa you're gonna
get oh shit but they get the visa and
the tax oh they're making money on both
ends man it's like the service where
they they did they rent you as a puppy
rental service and then a dog watching
service and then you hook the two ends
together and you're making money on both
ends
all right that's pretty good 1.9 x
slower why is it still slower though
this
why why did it get slow when I do this
why is that so much slower
this has to do with the cash doesn't it
foreign
right right
let me go there
on that one
oh shit no the cash demo actually has to
depend
oh that gets fancy
I think we have to support partial
reduces for big Matrix multiplies oh man
that gets fancy
this is not so easy anymore Tiny grad's
getting untiny
what
what does it hang
that's concerning
didn't commit recently did I
[Music]
foreign
okay
we'll take it guys
1.1.89 X slower
I I still have no idea how this thing is
faster
she literally can't be faster how is it
faster in torch
oh 1.4 oh it went yellow it went yellow
no you can't read the alpha tensor paper
to make huge Matrix multiplies faster
nobody has a way to do that
um
be developing under Linux no this is Mac
call as a side effect look at that inner
loop there it looks so fast
foreign
by the way
[Music]
no I want to add a comment
sure what if I had a comment here
does that make it into the thing
[Music]
oh sweet that makes it
uh
so here is there we're gonna say uh
foreign
Amex op0 AMX op 12 12 12.
um
that's literally the same thing as that
one
how can this be how is this one faster
maybe they don't clear it every time
with deaths
maybe they have another way to clear it
that's faster
possible that it's the turning it off
and on
that breaks it
from Instructions have already set up
just make a faster chip than the M1 and
design it to be slower while running
torch that's a brilliant plan
let's see if there's any trick here
f is 16 or F is instruction with
Vector mode
or Matrix mode okay we're in Matrix mode
I don't know what x enable mode is
there
fast way to do it
we're doing that
Z one row from each four
llvm MCA
oh I don't think this is gonna work
uh this isn't gonna work I'm using these
weird instructions
I I don't understand really how it can
be slower
how is pytorch still faster than me
they must have a secret fast mode
enabled
they're just
are they pinned to a core Maybe
you know it's not branchless I saw the
uh
oh
oh look this is stupid
well there's a mistake right there
[Music]
just like unrolling something
it's like unrolled or something
it's unrolled
disable re-enable okay they just they
just don't roll the loop twice so that's
fine
um
those things are probably pretty fast
but there can't really be a way to do
that faster
seeing if I like outputted a permuted
thing but that wouldn't be faster
what's my big oh well you know it's
matrix multiplication
you know what it is
how do they how is pi torch still faster
interleaved Z
no no
this is the most straightforward Matrix
multiply
yeah again look God bolt was great
yesterday I think the problem today is
um
oh these are cool
no no no guys it's not opt
cause like
look at this llvm can't analyze any of
this
there's nothing here for lvm to analyze
it just goes through AMX op AMX op AMX
AMX up
does Apple have a stable power mode if
that's possible actually
I I believe that that's probably more
likely than um this other stuff
or maybe I'm not getting on the good
core
how many gigaflops am I getting well
we're getting a lot more gigaflops now
that's pretty good
550 gigaflops
it's probably cash stuff
probably cash
what's the size of the L2
where's the alto I talked about this
somewhere don't I
M1 L2 cache
oh
okay maybe the L1 cache so it's 200
it's
the whole thing fits in L2 cache so
we're not falling out of L2 cache the
only thing we can hope for is that we
can get some stuff in L1 cache
so that's times four our height of this
whole thing is times 32.
okay so it's actually already perfectly
set up for the cache so the cash thing
isn't even going to do anything
we're perfectly in the cache
now we did the math on the cache and we
made sure that was good
um okay maybe the only thing I could
think of is don't turn it on and off
there's probably a way to turn off the
accumulate right
yeah that seems right
I'm gonna guess that uh
yeah
is there a way to turn off the
accumulate
like I'm doing this set and clear thing
which is a pretty violent operation
I I mean I don't know
skip Z input or use the input
foreign
thing I can think
llvm has AMX intrinsics
[Music]
I don't think it does
wait what
no no no no no no no no no no no
hang on hang on careful that's the Intel
AMX
I think we have to change where I put
IMX at hang on
foreign
answer
we have to disable Z on some of them
yeah that's fine
it's not even faster
what the fuck man
not even faster
foreign
[Music]
Apple AMX
okay how far do we want to go
livebloss.dylib who's ready to reverse
engineer
mine looks the same right
[Music]
it has to be the cash
I load
index
okay that's pretty good I think that's
actually even faster it can't be those
I hope I'm gonna put that outside by the
way
that's poor optimization but again it
doesn't matter
didn't we conclude it's not the cash no
I don't think we concluded that
we did conclude it's not the uh
setting and clearing setting clearing
seems like a fine way to do it
we are doing one extra ad but I also
don't think that matters
foreign
factor of 2 off the theoretical maximum
[Music]
I don't know if we're going to get this
one
I mean it's stupid I don't think that's
going to matter but now it just looks a
little more like the uh
the example
this is the inner loop in Blast
where is liblast
a library probably
[Music]
it's in the accelerate framework
crazy gigaflops
if I don't get crazy gigaflops
can you add some pointless instructions
no it's not that
uh where's libloss
is it Homebrew
I mean those stores could be very slow
could I check cash misses how
how do I profile that
counters
[Music]
instruments
I don't have this
oh no that's pretty good you know we're
within 2x that's that's should we just
take our win
and say oh we did a great job
wait wait wait wait wait wait wait wait
wait wait guys
oh
there is one more thing we could do
no no we don't have enough outputs
yeah but we don't have
I don't even know if those tools are
going to work with the A and X
buy more RAM funny bro
a storage
fan
[Music]
it's pop maybe I'm not getting the
performance core
why is this faster here
foreign
[Music]
Mac
I'm not sure I can
again I don't want to start disabling
cores because somehow Pi torch is doing
it right
I mean tiny grad does just appear to
have some overhead
some of it's just that
you know even if I make n like 32
that's just time spent in the python
so telegram has 0.3 milliseconds of
overhead
to launch like nothing
[Music]
[Music]
foreign
I mean even it has a little bit of
overhead this still doesn't explain why
it's way slower
can we get rid of the Python
yeah I mean
the python doesn't the Python's not
responsible for this though right
because if I said end it's like 32.
you're only getting 0.3 milliseconds of
overhead
uh
like I can't imagine there's anything in
here that's dependent on the shape
no it's not
I mean here's the other thing that's
possible
it's possible that they're doing a
reshape
that they're making copies
can't make a copy that fast
can you
use AMX
oh
foreign
[Music]
is that it's making copies of the Matrix
right
foreign
some guys probably already reverse
engineered this
foreign
they're getting two gigaflops somehow
oh that at least got leaked so that's
cool
uh
instruction names
ah
there's compiler intrinsics
where's accelerate framework
where's the lib blast that the torch was
linking to
it's not what I wanted to do
foreign
ldb list loaded
box
libraries well guys these streams always
go on too long
there we go system Library
[Music]
wait what
oh no no no no not this
oh stupid uh
oh
fine you know what I don't even need
a bit
um
you know what it is who knows what it is
foreign
[Music]
so this is the this is the
Apple version
what do those do
12.
12.
all right so those are
Matrix multiplies
but I tried disabling that and even
though the answer was wrong it didn't
one of these
I shift five for the uh the operator
zero
and one
yeah so that's the first one okay so it
does seem like they do the first one
um
clear the thing
now the unknown opcodes are the AMX
[Music]
foreign
two gigaflops
good night
yeah I don't know
let's take one more look over to see if
I missed anything but otherwise
you know this is always a problem we can
solve later I don't understand
why
I'm not getting the same speed as them
we're using all 64 registers right
we're using all 64.
foreign
six
is that right
hmm
foreign
32.
yeah that's right
it's got to go through all 32 rows
instruments can be found in xcode
developer tools yeah we might have to
try that
sweeping through the Matrix right
which is pretty good
there's nothing faster than this
keeps going
it's not a coincidence if it's 2x slower
yeah
more things in the cash than I am
foreign
and then we got to deal with all the
permuted stuff
oh that's going to be hard
so it's not a question of how large The
Matrix can be until it can't multiply
the entire uh row at once
it's um basically think about the Matrix
think about we have a uh
32 by 32 chunk and we're going out like
Pew right like that
and then we're accumulating those all in
there right so it's like this this
square but then this square but then
those squares within those squares then
it adds those all up right and then it
moves on to the next one
and that's all in cash and that's all
not in cash
is very tempting you think it has to be
that
um I guess we can look inside Bloss and
figure out
uh how it's tiling the cash
so I'm gonna do the cache like that
breaks it up a little better
so now it's doing like two by two chunks
and then doing 16 of those
it do four by four chunks like this is
tiling
I would say that it has to do with like
global cash accesses but no because we
run it a whole bunch of times
uh
is it possible torch is cheating
is it possible torches outputs are not
possible hmm
[Music]
foreign
torch's outputs are fine
we should have stopped we should have we
should we should have taken our gains
look
let's just let's just admire for a
minute how far we've come
so if we check out master
and we run this
it is
1189 times slower than torch
but if we check out chonker now let's
get rid of the debug we don't need to
debug we can see this more PR okay
so if we run it
on master
it's a thousand times slower than torch
but if we run it on chunker
it's
1.84 times slower than torch and I'm
still mad about that 1.4 times
um and uh the hype train guilted me into
this it really did
I run the test eight times so trust me I
do that
ah
one more quick thought
I can change the orders of these loops
no but we don't want to
all right we do that
yeah
and then we do that and then we do that
that was my only thought
wait till we are crushing it with the
cup where do we get this working for
convolutions
oh
where do we get when this works for
convolutions
is there a flag somewhere to make it
fast
what certain algorithm for matrix
multiplication strassins bro
do they have a blast here
torch paid for the fast one
they know they know where the secret bit
is to make it fast
why don't I load that strange lib oh
because it's not really there
that you have to unpack Apple's done a
really good job of hiding the Frameworks
now
and the Frameworks are like deeply
embedded in
index loads
the element size and the index size
George 1.8 X4
uh engineer yeah I'll take it
I'll take it oh it's Alex
hello we're on stream
oh
well I think of recess yeah
losing it
getting that you enjoy your recess you
want to go get some food I'm kind of
hungry
all right cool well we'll end this
stream you want to say hi to the
Streamys
[Applause]
small Alex on the phone
um
yeah we wasted the last hour we got it
down from a thousand X slower it was
actually about 20 X lower to 1.84 X
slower so we made like a thousand X
improved a 500x Improvement but but why
is it 1.4 X slow why is it 1.8 x slower
our theory is that pytorch paid for the
secret good version of the AMX
bro bro what I want the secret good
version
the secret good version open pilot right
um the experimental
yeah
you renamed it to what
oh not end to end
people don't know what that means yes
they do more people know what end to end
means than experimental
now to chill mode which is standard
driving
I don't work there anymore I don't work
there anymore uh uh let's where do you
want to go for food
what are you in the mood for you want to
try for any sushi yeah
could we go to the other sushi place
oh
yeah the place looks amazing um
I would eat whatever man
um no you know what I'm in the mood for
why is my thing 1.4x slower
no no no no no I don't want to take the
car man
uh well we could walk to Home and Away
I went to lunch at home in a way
and there's Mexican you want to go to
any Mexican food or
we could try another Mexican place is
there another sushi place
no there's only when you see a party
decisions open
1.84 I know it's not 1.4
Harney Sushi opens at four
oh that's a long time where is there
food now
[Music]
[Applause]
[Music]
I'm looking on the map but where we can
eat there's Cafe coyote Jack and Julia's
clothes oh one guy suggested Pizza
the weird Instagram one
the Italian place the one that looks
like it's for Instagram
no no
one that's like one block two blocks out
from the office
um let's see if it's open
no California Pizza I didn't sell comma
I just quit I have a new job guys I work
on the tiny Corporation
all right that's good that's good the
two of you can keep each other a check
it's about selling Electronics to
normies now that's true that's true look
we're talking about experimental because
the normies don't know what the end
means
yeah yeah who's the new CEO what do we
need a CEO for
okay wait do you want we don't run
business scams
where's that
it's like a lunch place
um
and that's you know we can go to rock
and Baja no oh Rock and Bob no no let's
let's go to that Instagram Italian place
[Music]
the Instagram Italian place
what
Don Pietro's why wouldn't they be open
oh there's a there's always the Nepalese
restaurant
with Trattoria oh Trattoria Don Pietro
opens at four o'clock
meet me there at four perfect
you're not excited about the Instagram
Italian
oh shit I am I'm really hyped about it
all right that's great I see you soon
you're the slog gang CEO all right we're
going we're going there don't show up
honestly if you show up that's why I got
my glock for you didn't catch me
whacking boys
um
uh
that's it
sorry sorry today's today's at one point
let's let's do a few of them
it's not even oh 1.5
how come that time it was faster
okay guys I'm I'm a 1.7 x engineer we'll
just we'll just call it
uh push before you go it's pushed it's
pushed it's all on the chunk or branch
it's all in the chonker branch this
should work this this example should
work great on your M1 Mac
um
can you carry it Calvin you know guys
you know I don't have a gun man uh look
I think there's an appropriate place for
guns and I think it's like if you lived
in like a more rural area having a gun
in the city I'm not even talking about
like how it's like bad I think people
should be able to have them but like
you're most likely to shoot yourself
when you just look up and followed by
someone you care about so like if the
statistics don't bear well uh for having
a gun in the city
um well I re-implement for Intel amx2
it's California though um
uh
thank you for watching today's stream
uh yeah
we did a pretty good job the beginning
of the stream was real solid and then it
all kind of fell apart but you know it
was good I alright bye-bye
hello
hello
welcome it's been a long
time uh I got some screen over here I
got some screen over there I got my
folding
phone uh let's see if anyone still
watches this
stream uh let's see where have I been I
I don't even
know um I haven't been streaming that's
true
but in some ways I think the meta of the
George Hots character is played
out I think we're entering a new
era uh I think the pendulum is is
swinging backwards uh you know the
pendulum is is swinging back
um so yeah I think
I don't know I don't really know what
this stream uh should be you can see I'm
in a new place this is my
office um it's a shared office but we're
here and we're streaming and it's
Sunday mostly what I want to do is show
off some of the stuff in tiny grad and
then maybe we could do some work on
it uh so tons of progress has been made
in tiny grad
um yeah I mean a lot of
commits I don't really know what to what
to show you I mean there's beautiful
memest beautiful emest is pretty nice
but it's the same beautiful memest that
was there
before uh actually the accuracy is a bit
higher now because we improved the
initialization um if we go in here to n
and a nit you can see that our
uh initialization
is simpler now uh when you look at com
2D it's really just tensor uniform and
scale used to have uh caming uniform but
I don't really know what caming uniform
is like if you ask me to just describe
caming uniform but this is what torch
uses so we just copied torch and now our
kernels are a little bit more accurate
which is
cool um tiny grat has docks if you
haven't seen them uh I saw some guy on
Twitter liked liked how much uh meth
there was in the docks see all
meth
um this
is yeah I don't know I mean maybe we
should try to implement a paper I think
that might be more more fun I don't know
how far we'll get
though the new tutorial is helpful which
tutorial well we have the quick start
and we have the amness tutorial um the
amness tutorial is pretty nice
oh let's see I went to
Poland uh where are you so long I went
to Poland where else did I go I went to
Italy I went to a lot of
places um and it's cool because you know
tiny grad's a it's a remote
company one of the ways that we
distinguish ourselves from comma is we
do have some stuff in the comma office
but tiny gr fundamentally is a remote
company
um two of our employees are fully
remote because fundamentally it's a
GitHub and a Discord if you haven't seen
our beautiful GitHub it's GitHub tiny gr
tiny
grad uh we have a lot of
stars yeah I I think what is what is
Tiny grad 4 I mean it's going to replace
pytorch probably we'll
see now look
something I say about this a lot is when
I was in the self-driving car space I
was competing against largely idiots uh
sorry everyone who worked on
self-driving cars you were mostly like
an idiot um and I you know no respect um
whereas the people who I like compete
against here like pytorch JX uh
Mojo uh mlx these are people who are
very smart and people I respect uh so
you know we're playing in a we're
playing in a real like playing field now
right do I respect like you know the the
eight ass engineers at Toyota like no
offense but no like you're not good uh
oh man you know we had a we had a Ford
engineer C come over and he we we we
like we showed him the docks and he's
like wait wait that's the same docks we
have I'm like yeah anyone can go to like
Ford do you know techinfo for.com and
buy them right like they're just
not like they're not on the kind of
peretto Frontier
um of of of coding right like the the
reason the Toyota Adas sucks has nothing
to do with like that we're better
Engineers than them or anything it's not
it's not even that it's just it's like
structurally broken where there's
nothing at all structurally broken about
pytorch or Jax right like pytorch and
Jax are they've made different tradeoffs
from Tiny grad and it's a question of
who's going to win but think about it
more like high Lev sports teams
competing right like you know you can
you can talk about the other team
but fundamentally you know they're
they're they're Live players uh whereas
open Pilots competition except for Tesla
which isn't really our competition uh
we're not live
players uh Tesla and I don't
share uh Tesla and open pilot don't
share much Market um you know it's just
it's iPhone and Android but we are
trying to of course take all of the
market share from P torch Jacks and
every machine learning library
um so yeah if you
uh oh let's see I rafted down the
Colorado River oh man it was was
115° outside it was cool it was not cool
it was very hot but it was
fun hello we're streaming I know
um yeah so this is shared office you can
say hi if you
want this is men you hello Works tiny
Court
um yeah we got to we got to make MCTS
fast one 500 nodes per
second all all of them tiny Buck
definitely
yeah how do I par well I can at least
parallel the uh the rendering and the I
I don't know what percent of the time is
spent on the rendering versus spent on
the uh actual
compilation um so what we're discussing
here is I just added MCTS
search so if I put in beam numbers that
are greater than 100 it doesn't actually
use beam search it uses MCS
search so what this is doing is
searching over tons and tons and tons of
kernels um you see it found the best one
there at 63 but this is a more highle
tutorial Let's uh
okay I don't know why I read the
comments what you mean Nvidia will go
open source nvidia's always been open
source uh not always but for the last
like two years they've had an open
source driver uh
and they are switching now to solely the
open source driver their close Source
driver didn't use the GSP you know it's
just like who am I even talking to
I'm the the AMD thing
is you know the the amount of just
complete misunderstandings and
Mis wow I thought I thought we weren't
going to rant you know I thought I
thought we're we're past this on stream
but like okay scale Cuda AMD right so
like this stuff comes out and people are
really excited about this look there's
still there's still uh
this is totally the wrong approach
there's no reason anyone should be like
doing
this
fundamentally the question is not can
you run Cuda but the question is can you
run Cuda fast and the answer is you
never will be able to uh and I I can
show you why I can show you uh I heard
there were some docs that addressed this
but I'll tell you why it'll never be
good um so here tiny grad supports both
AMD and Nvidia and I can show you here
here
in uh where is
it it's in
lower
uh it's not in lower it's in kernel yeah
it's here yeah here uh so AMD and Cuda
have very different uh tensor course I
should probably include the comment for
the AMD ones uh
so AMD and Cuda have different tensor
cores and because of this they will
never like you'll never be able to take
Cuda code and compile it and make it
fast on
AMD uh so this is not like this isn't
really going to help people the way they
think it's going to help people you want
to be at a level of abstraction higher
than this um you want to be at a level
of abstraction where like you can still
mess with your shapes such that it can
make the tensor cores
fast uh so yeah this will this will
never be uh fast there's the wrong
approach um now we we'll give a shout
out to uh T torrent uh T torrent I you
know I love to see this they're shipping
computers right like
respect right there's a there's a button
here there's a deposit they have a ship
time oh we're shipping tiny boxes too I
guess there's there's I don't even know
what to like say about this I got a room
full of tiny boxes over there I think
we've shipped like 25 of them uh they're
shipping we are very slowly making our
way through the huge pre-order list
uh and if you want of course add
yourself to that it's on Tiny cr.org
just click Tiny Box these are the tiny
boxes we're
selling like we can peek around a tiny
box here see if anyone's on this
one this is a tiny box green it has 6
490s in
it just kick off a uh
kick off an MCTS search here let's just
do something like
this why not let it search um make sure
it works I haven't really tested it
there so mtcs is still very experimental
it's an
extra
uh yeah but this is the this is the Tiny
Box uh what's the ratio of what people
are ordering uh what do you
think okay it's it's 10 to one and you
can decide which direction it goes
despite saving uh
$10,000 but you know we are almost ready
to upgrade this driver quality from
mediocre to
acceptable uh because you know again
with no help from AMD we've completely
succeeded you know shout out to to niml
Jen did most of this work uh he he works
at tiny Corp you find him on our Discord
uh this is a complete AMD
driver uh it uses pm4
so a lot of the bugs uh in AMD basically
existed in two
places um one of them has to do with uh
this feature called CWS uh
cwsr uh compute wave saver store which
is basically like context switching for
the waves implemented on the CPU gpus do
kind of a quick contact switching for
the waves but there slow contact
switching you know one in 100 times one
in a th times in a restore just work
there were some race conditions in that
so we disabled that in the driver uh
it's just a flag you can you can use to
disable it in the driver and then um we
wrote our own this is an AMD driver that
speaks directly with the hardware using
IO controls and the key thing is that we
communicate with it through pm4 packets
not through AQL so the other bugs
existed in AQL mostly um remember all
those ones about you were like the que
they were messing with in order and out
of order remember that remember that
thing they released
all stupid we just bypassed all of
it so the main firmware that actually
runs these things on the GPU oh we have
some decent docks now
um again why wait for AMD to do anything
uh I just went in there you know I used
to be a famous reverse engineer um and
we just dove in and said okay so what's
actually going on
here uh so this is the main
uh
controller uh the microengine compute
that actually controls like using the
compute resources of the
GPU so we uh it's a 250k
binary uh 90% of that code deals with
AQL um but there's a lower level thing
called pm4 so you can see pm4 instead of
AQL it used to be called kfd now it's
just called AMD um we switched from AQL
to pm4 which these are actually just
speaking like this is the launch of a a
compute kernel here you see we have a
function called exec here this specifies
like the
um uh you know just the location of the
program a bunch of different resources
that the program
needs um the local size where's Global
size oh this is in
this pointer to dispatch packet wait
wait
what I didn't know this was still
used
huh interesting I haven't read this code
that much
um pointed A dispatch packet why do I
need a dispatch
packet why am I not just putting this
stuff directly I am putting it directly
in we're doing direct dispatch why is
this stuff still in here
pointer to dispatch packet get command
idx oh maybe it's just a useful struct
to use because this doesn't actually
seem like it's doing
anything I'm GNA ask about this in
Discord uh
oh wait
what Kars pointer
dispatch I'm GNA ask about this in dis
in
Discord why is
HSA kernel dispatch packet
still used in Ops
amdp um yeah okay I would imagine we
actually didn't need this HSA thing
because we're not really using it so you
can see these um these set sh registers
these are actually setting Hardware
registers in the GPU and you can see
here's where we set up the uh local size
and here's where we set up the global
size so this is just completely like
specifying to the registers uh like like
it doesn't even use the firmware um the
the Mec is executing very small pieces
of code uh to actually run these
register sets and they're pretty much
just exactly what you think they are uh
there is still this packet 3 dispatch
direct so these are the different uh pm4
commands um yeah but turns out that when
you bypass all of amd's crap there
aren't really bugs in it any more so
there aren't really bugs in the hardware
it seems like they did a good job with
the hardware it seems like their bugs
exist in the driver and in their runtime
uh so we turned off the one buggy
feature of the
driver
um and
we uh bypass their runtime
entirely so
yeah uh AMD so we we we we can upgrade
this driver quality from mediocre to
acceptable
I think should we should we do that
should we should we upgrade it from
mediocre to
acceptable I'll do it
later um
okay so we also have the same driver for
NVIDIA this is
[Music]
the uh Nvidia version of that driver it
speaks directly to the
GPU um it's amazing how short these
things end up being
so one of the next big things that we're
pushing into is we're still actually
using the compilers here so we're using
uh nvrc which is uh it's it's a
inprocess uh Cuda
compiler um some weird stuff for PTX
here that's actually not on my
computer uh the same thing for the AMD
compiler we have a helper here that
calls
uh uh compil
hip I don't really know why that's not
an Ops AMD that should probably be moved
to Ops
AMD if we don't use the same compiler
here why is this a separate
file that probably belongs in op
bamd I'll mention this in Discord too
reason we we can't put
merge hip Co
manager dopy
into Ops AMD
dopy then .p can
go
to helpers
py and
remove a support di yeah so I don't like
this support di this support Dr is kind
of upsetting so this stuff should
probably go in there this stuff should
probably go in generic tiny grad helpers
here um help it's getting kind of
big yeah it's an elf
loader wow it Imports
libc we don't want elf in helpers if it
Imports let's see okay uh you guys are
just kind of really watching me watching
me work
here um does tiny gr work with Mesa no
we don't use so Mesa
my understanding is that Mesa is a user
space library for gpus so tiny grad just
replaces that uh we've done pretty well
with line count we're at 8461 right now
um we can kind of go through what these
things are so the biggest file here is
tensor uh so tensor has all these has
all these methods look it has docs now
tiny so unreadable yeah you haven't read
it in a long time it's actually very
readable now um and then all this Docs
just gets compiled to here so you can
like see like you know what's randen oh
here normal distribution mean zero
standard deviation one wow you can pass
the device keyword that's cool um yeah
movement
Ops and different ops processing Ops un
Ops everything's a method on tensor
which is uh which is
cool uh the docks became great thank you
uh does your AMD driver support only
rdna 3
I believe
so um it should not be hard to add rdna
2 support I think the only difference
you're going to have to deal with is
like the scratch stuff's a little bit
different
uh how does tiny grad perform versus
torch compile well again it all depends
on your plat
form um so tiny
grad natively if you don't run it with
anything is slower but if you run it
with search parameters and that's what
I'm talking about here with MCTS right
so right now it's like searching for a
kernel so here I can like I can show you
something like um so we like this
example here so this example is uh this
is like inference on a
resnet so inference on a resonet
normally we're getting only three
teraflops 170 milliseconds which isn't
great but if you run it with beam equals
3 uh now it takes a little bit to
compile which is I'll run it with debug
equals 2 so you can see the beam um so
beam equals 3 is the old uh search you
see it searches all these different
kernels so before kernel zero was taking
2.71 milliseconds and now it got down to
1.6 1 milliseconds thanks to beam search
um we can also use MCTS here so let's
add MCTS and beam uh so actually this
one was already searched via MCTS so you
see that the hand-coded one the one
without any optimizations took 2.7
milliseconds the beam one took 1.6 and
the MCTS one took
1.43 um yeah so it searches this is
doing the MCTS search here so you see
that's the beam search there this is the
MCTS search see it already found one at
42 that's
uh6 milliseconds the timings aren't that
great on Mac they're better on
Nvidia um yeah so this one when it
actually reran it was slower so it used
the built-in tensor core
optimization but yeah so what are we
searching uh we're searching over all of
the here I'll run this with debug equals
3 so you guys can see what we're
searching so this stuff these are all
the different ways to represent the
kernel you see we're messing with the
strides and the
views uh all this different kind of
stuff we're messing with some arguments
to the tensor course here which axis it
is oh this is this is actually really
cool I've never R this before uh
sometime we split the reduce axis so
you'll see two sums go in there now
we're searching the next kind of Kernel
so we search over all these different
basic ways to run the
kernel uh debug equals 3 totally makes
it understand it's it's not that I'll
break it down for you uh
so like let's compare this kernel to
this kernel they're the same but let's
see what the difference is so this one
has a 16 here and this one has a four
here so you see how this one basically
it like this this explains it so these
blue ones here are the globals the GPU
globals you know like like uh like get
Global ID uh these are the GPU locals
get local ID
these red ones are reduces done in a for
Loop purple ones are reduces that are
unrolled for Loops uh and then yellow
ones are upcast it uh I can okay here do
you want to are you interested in this
we can explain it
further uh so let's just do a little gem
here well first let me do it with no op
equals one so we guys can you guys can
really see it okay so this is a matrix
multiply that's uh 64x
64 uh time 64x
64 so we have two buffers being loaded
here um you see why they have stride
zero this is my my analogy that I always
give I talked about on Lex it's like if
you have a cube uh you can put matrices
on the side of the cube in multiply sum
up and that gives you the top Matrix
here so you know put them on the side of
a cube multiply sum up that's the thing
kernel here are some meta parameters
about the kernel uh and then this is the
actual generated metal code so you see
that these dark blue ones are Global
Dimensions um yeah now it gets a lot
fancier when we start enabling
optimizations so you can see this ranted
in 41
microseconds so with the optimizations
this a hand-coded optimizations it went
down to 24 micros so it's faster and you
can see this is the code that's
generated it's not that much more
complex like it's still very readable
when you look at it but basically it
expanded the uh see that 244 at the end
it expanded the well I'll disable tensor
cores for now so we can disable tensor
cores which won't use uh won't use
tensor cores it's not quite as fast you
see we're getting 28
microseconds and then this is a 444
which is the absolute like classic um
this is called cooning in some GPU books
but basically think about it like this
it's doing a 4x4 chunk of the Matrix all
at once so this is that 4x4 chunk of the
Matrix uh it's accumulating into that
4x4 chunk of the Matrix and then it's
storing that 4x4 chunk of the Matrix so
each run of the kernel is doing 4x4
instead of doing 1 by one uh so that's
kind of what that is so let's take a
look at a few there's a few cool options
for tiny grad 2 we can uh graph the uops
which shows you kind of what the inner
generation looks like the other big
thing that I've been doing while I
haven't been streaming is I refactored
the linearizer into the lower and I know
these terms don't mean anything to you
but well if you follow tiny grad they do
uh so this is what that looks
like um and you can see that there are
loads uh well actually no there's eight
loads uh yeah there's eight loads four
stores and these are float 4 stores you
can see that's float 4 see these loads
are float 4 uh this is like the graph of
the compute of that
gem uh so I'll show you guys one more
thing if I put debug expand equal one it
won't actually render but it'll show me
a much simplified version uh of the of
the graph before these expands so you
see there's these nodes in this graph
called expand and what that node
basically is is it just
like uh
it pushes through the
graph expanding this node four times so
like this multiply is 64 time what's
being expanded here is 0 1 2 3 so when
this goes when this node goes here it
actually runs 64 * 0 64 * 1 64 * 2 uh
and that can be folded um if you're
interested in seeing where that is this
is file called UOP graph uh this is in
the
uh expand pattern match here and there's
a function called do expand which
actually runs that
expansion uh but this is what the
linearizer became and it's all written
as these graph rewrite rules this is the
big chunk of graph rewrite rules right
some of the graph rewrite rules are
stupid like x * 1 = x x + 0 = x uh x / 1
= x right like these are some some
simple rewrite rules uh and then the
rewrite rules get get uh sort of fancy
to do all sorts of things um yeah so
when I run it with debug expand it keeps
all the expands and contracts around uh
but those can actually be rendered so it
pushes them through the graph generates
a graph and turns it into actual uh
code so this is what that code looks
like without tensor
course uh and you can see here it just
stays a summon Maul but if I allow it to
use tensor cores uh tensor cores are a
feature of the
GPU so we'll run it with tensor cores
here uh there's this magic function
called W 888
float
it's fancy how it works uh you'll just
have to look up tensor cores if you're
not familiar with you know how gpus
work you got to just read um
yeah so this is all those all those
wames um let's put that with debug
expand too and I can show you like what
it like a lot simpler right so it's
basically one
wh That's Just expanded across a couple
of axes
contracts someone's going to look at
this and be like holy like who's
someone who's like been like messing
with Triton uh you know is going to look
at this and be like holy this is a
lot nicer than what we have I'm like
yeah I
know uh it Triton a lot faster you know
again they're they're they're very very
much more in line with like the pie
torchan way of doing things like take
the one konel we want and make it fast
don't focus on this generic abstract
case um you know it's all about
trade-offs right and as again you know
everyone in self-driving cars except for
Tesla and sort of whmo is like weo is a
fine project if you have unlimited money
um but like you know again you meet all
these people and they're just idiots
right it's not there's not there's not
like a redeeming Factor they're not
making a trade-off they're just idiots
uh but you know people in the ml
accelerator
space uh people in the in the ml
framework space are are not idiots
they're just making usually different
trade-offs than we
are uh is Tiny jit search faster than
Jack's jit okay so faster is a very like
what do you mean by faster right on what
platform on what
model saying faster in general doesn't
really mean
anything
um like there's places right now where
tiny grad is going to be W well Jax can
do a lot of fancy fusions too so again
yeah it all depends on
the why accept Tesla Tesla doesn't seem
idiotic to me Tesla seems like again
they're making different trade-offs from
us but we're all like operating in a
world of modern engineering practices
whereas these older companies are just
not right like you can watch watch a
video with the Ford CEO he's like well
so we out sourced all the modules and
now we have 100 modules in the car and
they all have software in them and then
we realize that the problem with the car
is the software but we can't get the
software because we bought the modules
and they came with the software so then
we have to email this company and they
never get back to us yeah I mean yeah no
 right um you know they they took
a basically an old style of uh
is still busy searching they took like
an old style of yeah if you're buying
you know metal pieces going with
suppliers is fine if you're buying
software you shouldn't really do this
right like you should have like an
integrated
uh you know you want like a mono repo
basically for your car um and you know
you don't want to deal with well there's
a tiny piece of software running from
this company and a tiny piece of
software running from this
company uh so
yeah that sounds sketchy for Ford I mean
it's yeah like I know you know people
say weird stuff like like you know K
sketchy or whatever but like I don't
know they don't really know anything
right they're just falling back on
proxies um and they're falling back on
well you know but like Ford that it's a
I've seen their logo right like it looks
like it looks like that right like that
yeah there we go come on look they have
a logo like that right like clearly
that's all right we're not ripping we're
not ripping off Ford um but like you
know when you compare this to TOA which
has this like self-drive car folder and
this is just all the cars guess what
they're tested in CI you think Ford has
CI right AMD doesn't even have
CI
um well that's our docks
why are those ones little and those ones
big ah yeah let's
see you think about how many lines of
like convoluted sea that is across
Ford's platform yeah Auto is just
learning about get an AWS yeah see
that's what I mean like they're clowns
right they're not using real engineering
practices right whereas like you know
again when you compare us to our
competitors you know we're tiny gret
tiny gret they're pie torch pie torch
they know how to use
git right they know how to use git they
got more stars than us so again we're
we're competing against real people but
it's so nice to be you know playing in a
playing a lot of things about tiny Court
make me a lot happier than
comma um like there's things that are
cool about Kama like comm's if you like
to like mess with
Hardware uh uh if you want to like
really understand how all the hardware
works I we have such like a culture here
of like like we bought some of those
unry dogs we tear them right open right
we just like know how everything works
we're building like cell phones from
scratch in the basement not total
scratch but like pretty close now we're
making our own SS we have our
own uh we pick and place machine Reflow
oven and we're like like these aren't
like oh we have these things but then no
actually we Outsource everything I'm
like not Outsourcing right like the
purpose is the process right the purpose
is the process what
uh yeah tiny grad goes as low as
bypassing the GPU driver Simplicity is
the way to win it is it really is um I
mean these GPU drivers again they're a
lot of the complexity in a GPU driver
comes from supporting Graphics uh the
compute models on gpus are a lot simpler
than the graphics models on gpus and if
you can't write your own driver so our
goal eventually is to make chips um
again we have a lot more there's a lot
more work to do before we can get there
if you can't build a highly competitive
framework on Nvidia you're not going to
succeed with your own
chip MCTS always be bottlenecked by the
forward pass okay so now what's slow in
MCTS right now is the compilation time
uh MCTS is also single uh single process
whereas beam is
multiprocess
so um yeah we can we can look into
improving that I don't know this might
just be a tutorial for for tiny
grad uh stream uh if no Nvidia no own
chip okay so nvidia's Chip is better
than yours certainly better than the
first chip you tape out right your chip
may eventually become better than in
video when you're on the third or fifth
generation of it but the first chip you
tape out will always be worse than an
h100 right even regardless of like what
you're trying to make it's always just
going to be worse um so if you can't
build a compet stack on better Hardware
you certainly can't build a competitive
stack on worse Hardware but but but but
Nvidia is not documented yeah this
doesn't matter right like the
documentation you're going to have for
your own chip sure you could read the
verilog right but
like you
know how much verog can you read right
there's some quirk in the pcie blah blah
blah blah blah it's just not
tested uh yeah so you're gonna basically
have to if you can't build a competitive
stack on Nvidia if you can't build
something that's driver level on Nvidia
uh why build your own yeah so this is
this is basically an Invidia driver like
you can read it yo we're like succeeding
at
this um I haven't been streaming in a
while I don't know it's kind of maybe I
stream because I'm miserable I'm just
not that miserable anymore things are
actually
working
uh Nvidia is moving to more open source
drivers again like you have to be so
careful with what you're reading the new
news nvidia's had an open source driver
for a long time right it's it's like GPU
open kernel
modules uh they're just deprecating the
closed Source driver um but okay is this
really open source I mean there's this
huge binary called the GSP here let's go
find
it I don't even know where where is
it where is it
lip there it is
so here let's go into this driver uh so
we have two gsps one for the ga series
and one for the Turing series I think
that the ad series runs the ga one as
well uh yeah so like if you like um you
know if you call a 36 megabyte opaque
GSP binary open source then it's open
source right do they not even have
strings in this
thing junk strings
huh some Colonels require a pointer to
HSA n gen replied to me
on
Discord
when wow
com
uh you're welcome to join our Discord
too I'm just typing there now what are
you do in a kernel to set
that have
that property be
set so okay apparently his answer was
that you have to here here's
where allocate
space for the dispatch packet and the
Kern
arcs so there's apparently some
property of the code that's generated by
the compiler sometime where it does this
extra
dispatch um so also when
you when you go to this level you see
all the complexity that they've hidden
and a lot of time this kind of
complexity is why your stuff's not fast
um so once we start looking at this once
you start so there's a there's an
attribute uh let's go find it in
renderer C style uh in Hip renderer
you'll see it so you see this kernel
modifier this kernel modifier see there
we go it makes hlb C far twice as fast
uh by basically specifying the max
parameters it's going to launch with
because this has to do with uh register
the word for it uh basically the
register pool on gpus is
shared and if
you H God what's the word it's like it's
like resource exhaustion of
registers um register pressure register
pressure is the word I'm looking for uh
how did we discover it it's not Insider
knowledge it's open source you just read
the code read the driver here's here's
the docs for the driver right cwsr
enable default is one to enable this
feature setting zero disable it preempt
Shader execution in the middle of a
compute wave right like of course that's
broken yeah reading docs how else you
want to do
it uh I don't know I don't really want
to code on stream I got kind of sick of
coding on stream because like it
actually teaches me bad practices and it
teaches you bad practices too you like
the stuff that's flashy when in reality
I code a lot slower especially now uh
especially with the stuff in tiny grad
where you're not really writing that
many
lines uh and you just you know you just
you just code nice and slow and you know
make sure it's correct don't spam
code uh have we sent any boxes to the EU
no we've only shipped us ones it's such
a pain in the ass to ship the the Box
weighs 90 pounds
and we got two of them over there if you
want to say some some tiny boxes
chilling over
there why do I care you know that I
stream for me not for you right like
we've had this discussion
before um what chair is this the new
keyboard that's what you guys want to
talk
about
um we wrote a line of code it was a
comment
I'll be right
back
for for
yeah we'll do a little
coding um so it's a little annoying on
metal because you can't actually
parallelize this compiler super
well um
kind of want it to also say nodes per
second that'd kind of be cool
so we want to know the number of nodes
per
second we divide
can I not do
a no per seg
we need to say no I think we can just do
that I think we need that point
okay let's just get rid of the float
entirely
3D all right so we get about 27 per
second right
now don't need that don't need that how
it
looks all right
do we like that first
or should we put it over there I don't
really like that first I'm just tweaking
something stupid okay
when do you think you'll start taping
out your own
chips what do you think I'm going to say
to
that like this one searches a lot faster
does MCTS always converge to the same
optimal solution bro I don't know what
tiny search spaces you're
searching
no um no the search space is
huge so I'll explain the sear a little
so this is the uh no not that um where
is it
uh so we have this thing called op doops
and those are the actions oh it's in
kernel okay so these are the actions you
can take and then if you want to see
actually that's not even real this is
the these are the actions you could take
um so we have something like probably 40
actions not all of them are available at
every move and then a kernel usually has
like uh seven moves right so it's 40 to
the 7 so that's the size of the space
you're searching um and like you get
about 500 kernel runs right so you have
you have
500 uh tests to search a space that that
that's that large maybe it's more like
20 actions per thing so you know okay
it's that
big um so no it's not
optimal but that's okay uh because you
can make some assumptions right you if
you were searching the space randomly
then yeah okay that'd be it you can't
search that space forget it but you can
make assumptions that well here you know
what I'll show you something we have a
convenient graph function called MCTS
graph
um so yeah you can see it's it's finding
the best one here it's like 1.5 you know
1,500 the best I've ever seen it get is
like
1450 um but this one's probably going to
stop at this 1521 1521 is pretty good oh
NOP it got better
1504 okay uh so we wrote a graph out
here let's uh let's take a look at that
graph so this shows all the
nodes uh that were
searched so yeah this should be about
500 nodes in this graph it's actually a
bit less than 500 okay so this is the
root node here um so the root node we
don't actually run it's just for Speed
there's no reason to actually run the
root node you're always going to do
better with at least one
optimization um so then it tries all the
optimizations you see it gets this tc1
which gets it down to thir
3300 um does it actually spend all of
its time on the TZ one
no there's other ones down here um it
also does this TC one see like these are
all like three pretty good actions so
the winning action turned out to be this
one uh which was five then it went in
there did this upcast got it down to
2,800 and then with that unroll it got
it down to
1504 um so these are all the the search
space and you can see that like it
doesn't waste time expanding a node like
this right this one is
177,000 it's so massive that like it's
unlikely that it's worth expanding that
one so we do intelligence search where
you know nodes that are pretty good are
likely to be good places to look for
more nodes that are really
good um yeah this is like how tree
search works
okay so we're getting 29 per second
let's see if we can increase that um our
real goal is to get like like 500 per
second 500 per second would be a good
speed so then we can do this entire
search in
uh so something I was playing with in
the
uh let's get stash pop oh can we not get
stash pop we can't get stash pop how do
I look at the get
stash get stash
list whoa look at all these
stashes get stash show
yeah okay
here uh so we added this early check to
not waste time compiling uh compiling
early check for same
as optimized a so right now what we do
do is we so sometimes you get to two
nodes and they're actually the same code
so like different optimizations ended up
leading to the same
thing
um
shouldn't you should all be
caught by the as
check need to
fix uh
caniz I talked about this in
Discord
um Quin is making progress challenges
with Loop
unrolling
cool um that's what what I will look at
later uh but so this this is a an early
check for the same as so we don't
actually have to put it through the
compiler hold import lazy op here so
this check should always be correct if
not always
complete uh basically so it just it goes
to the current node it gets the
optimized as and then it sees if it's
already seen that before if it's already
seen that we just remove the node and we
continue which is also kind of
wrong What We actually want to do is
this yeah that should be right
let's see if the searching is
faster 30 okay so we only expect to get
a little speed we don't expect to get a
ton of speed from
that it seems a little bit better than
it was
before it's actually pretty much the
same
that's the same as those before um oh
look but look at the one we hit I mean
it just just luck but uh you see that we
got a we got a better outcome here at
257 so we can you know look at that
graph again it's the same graph of the
search we just got a little bit luckier
about how he expanded the
notes um so yeah I mean it's within a
couple percent you see that the
difference between the like it's 2x
better than the hand-coded one and the
Hand coded ones on Mac are pretty good
uh the hand coded one ones on Nvidia are
terrible uh and it's just cuz we really
put effort into
it
okay cool
um so
one of the things we can do is we can
just mock out this rollout
function and then we can see how fast
everything
is so if we do a mock roll
out wow look at that look at that speed
wow 2,000 a second wow roll out slow as
 all right um so this is the thing
that we can
parallelize uh with a lot of work
actually with a lot of
work
oh so I changed this function to be a
sample function this is Chu's idea uh
last night this uses uh basically does a
soft Max and then a random Choice uh it
samples from the tree instead of like
taking the max of the UCB it's it's like
Monet search you can read this by the
way it's an extra MCTS search on Tiny
grad um it's extra because it's not uh
ready for the
main code
yet yeah um so we found out where all
the slowness is and all the slowness is
in well actually find out where all the
slowness is is a slowness here or is the
slowness
here let's just check quickly
so
useless this is the code that co-pilot
would probably help me
write think you probably not cuz I
probably waste a ton of
time reading the code that it wrote and
just like faster as it do
it all right well that's
interesting so it looks like it's
spending about half the time on
compilation and half the time on
running uh so we can also turn that down
to three
didn't really help
much and even within compile that can be
further broken
down interesting
okay so most of the time is spent in the
compile function but a sizable amount of
time is spent in the
runtime this isn't allocating buffers is
it buffers are pre-allocated I didn't do
anything stupid in here did
I clear L2 is
false make sure that isn't actually
hitting let's just
slow wait okay so why is it so slow
versus TM
right is that not the default so I'm
looking at the actual time spent in like
the python Loop versus the time that
it's telling me it actually took on the
GPU oh and then there's another hack
here too which is like there's a hack
for Global which doesn't actually run
the whole
thing none of these are actually running
the whole
thing well that's slow as
 okay well that's actually spending
all the time with the GPU
so we have a hack to work
around
interesting didn't realize how much of
that
mattered it like all becomes GPU time
then
that
um actually i' want this as a percent
it's all
right okay
wow and that's actually all the time
none of the time is spent anywhere
else which is
interesting okay so to put this guy back
that goes there that goes there
starts to become overwhelmed by the
compile time so there's not really much
we can do uh about the runtime really
three should reduce the runtime percent
a bit but I guess it doesn't really
matter those kernels are all fast any
slow kernels get hit by early
stopping so we have this thing called
early
stop uh
actually bugging that
okay so we're multiplying there by
Factor no so that's actually right
cool I like that extra letter how do I
easily
like make that colored but I don't
really can we Nest F strings we're just
talking about that you
can color well compile time should be
Sion and
Flat's not used why is it
imported runtime time is Red see how
that looks
25 is not in list oh did I do it
backwards
yeah
um y I've been listening to the new say
anything came out with a new album Max
beamus is proof that you don't have to
you know be boring when you're
old
um the fanfiction like is it's really
the you know a lot of these like emo
bands they just like completely mellow
out think like like Good Charlotte
writing centuries right and it's just
it's just terrible it's just this
absolute generic you know pop
music uh that you know no longer sounds
like Lifestyles of the Rich and Famous
right but Max beamus has not sold out
you know my life might end up up shorter
than yours but it's quality not quantity
you thimble man
[Laughter]
like
uh your therapist knows you're a failure
um oh came out with the whole album I
liked one of one of the songs was pretty
good I mean it's still the same like and
Detroit was was hard where I grew up in
Detroit and it was hard and I came up
from nothing yeah I'm Eminem yeah right
like it's still he's still he's still on
about that uh you know it's it's like
it's kind of like when people get older
they get like froze in their ways like
he's still very talented but it's not
new um whereas like in some ways I think
this is like like
evolved
uh
like he what he talks about and you know
it's relevant you know I sympathize with
it like the song's called fan
fiction
like it's it's about the the parasocial
relationship between like the the
the fans of a of a band I don't know if
like I'm the only person who like
listens to these like you know like if
Panic at the Disco comes out with a new
song right like you're
not like you have to deal with basically
this
problem
um yeah just just you know mind-blowing
I probably listen to the song a hundred
times
oh it should be possible to determine
runtime of a colonel without doing all
these
computations Good Luck Good
Luck
uh I have
tried and I mean the cool thing is you
can figure out
exactly uh you know how accurate your
estimator is so yeah try to build try to
build an estimator of no I like them
bettering the thing uh try to build an
estimator of Kernel uh time without
actually running the kernel I think
you'll be shocked at how hard it is okay
so this part can be entirely
parallelized
um but this part
can't so what does that get us like 3
4X it's actually probably worth
that make a branch
uh there's a very detailed cost analysis
in llvm yeah exactly I'm not writing
that right so there's like the
thing that you want probably isn't the
thing you want right the the question is
not given this konel uh given these
kernel arguments how long does it take
to run uh you're never going to build a
good estimator for this
uh there's so many things that interplay
but where the lwh hanging fruit is right
now if if you do want to improve this
search now again I caution you about
trying to improve this search right so
if you want to improve search such that
it runs faster and gives you the same
answer that is a straightup win but if
you're trying to improve search by being
more
clever uh how exactly have you figured
this out right how exactly like we we
don't have a framework for evaluating
whether the new search is better than
the old search and all the works in the
framework right it's the same thing at
comma too like so much of these modern
machine learning is things are just
about figuring out the correct test
framework to see if you're making
progress or not right so you make some
tweak to the search and you run it on
one kernel and it does better what does
that mean right does that mean the
search is better who knows um so
stockfish uh solves this problem in a
very elegant Way by having a tweak of
stockfish play against a whole set of
older versions of stockfish and you can
just take a win percentage and that's
pretty good because that's the exact
thing you're trying to optimize
for
um so what you're trying to do here is
you're saying well okay so I made
something it's faster on my computer on
my kernels that doesn't really say
anything right this is what I mean like
if you get speed it's a straightup win
but if you get uh a smarter search well
gu it's smarter always right there's no
free launch and search and optimization
uh you know you know there's no free
launch in Search and optimization so but
if you are interested the answer is
probably not figuring out how to
estimate this but the answer is figuring
out I guess it's sort of estimating this
but the answer is figuring out which
nodes are worth expanding and which
nodes aren't expanding so you'll see if
we have unexplored children we just use
random Choice here uh we also use random
choice right here if we just expanded a
node uh so random. Choice whenever you
see a random. choice you're always like
well but some choices are better than
others and yes some choices are better
than others uh so that would involve
putting a prior on the actions right so
you're at a node you want basically a
prior over the action space now there's
a few ways to get that prior uh you
could get that prior uh online I think
that something again you're going to
spend 95% of time on your evaluation
harness and 5% of time actually
implementing this sort of
code
uh but
well yeah there's hyper parameters too
here's two hyper parameters we have we
have a temperature of this sampling and
we also have uh the C from the UCB
function which is math Square 2 for now
um so yeah tweaking those hyper
parameters may you better results but
the question is does it always get you
better results or only
sometimes uh so yeah by putting priors
on those random choices you could
probably do a lot better uh chenu and I
discussed a simple way to do the priors
yesterday would just be to figure out
which kernels improve run time right
just overall which Kernels have I
selected which optimizations have I
selected given this kernel that have
improved runtime and search those first
when you expand new notes uh this is
probably a good idea uh I bet this would
would improve search efficiency like
2x
um then the other thing you can do is
you can build offline models right so
offline given a device you can figure
out that that device is more amendable
to certain kinds of optimizations uh
than others and yeah you can have that
offline prior and then the cool thing
about prior is you can multiply them
together and generally uh you know if
you have two good priors that come from
different you multiply them and just be
better so yeah there's that um but again
the main thing you're going to have to
build before you start playing in that
in that uh Direction at all is a robust
evaluation harness that that evaluates
the effectiveness of your search across
a wide variety of hardware and a wide
iety of kernels whereas if you just want
to work on speed well speed is just
speed if anyone all right can we ban any
the the b word and the t word any of
that stuff it's all banned it's all band
the b word and the t word you know
that's it that's
it what kind of camera is this the same
one I have at home I think
um God now we bring them up you see you
can't even say them man that's right I
was referring to trains and buses we are
not discussing trains and
buses t word and b
word long live
trains uh yes if you want to follow long
it's in the parallel MCTS branch on Tiny
gra
so let's see what crap I wrote to make
things parallel for
Beam part of the problem with
parallelizing on
Mac is that you need the device open in
order to do compilation
I also kind of want to break compilation
down into two
steps there's a lot of complex crap here
let's just get rid of this we don't
actually need
this for
Dev
compiler so there's two different steps
here there's the two program step and
the compile step and we could don't do
that
no not that one or was it here okay so
we could actually break these out
further let's just stick this one
here and then see how much time we're
still spending on
compilation yeah not much anymore okay
so it's really all just that which is
cool because that can be
parallelized um two program can be
parallelized
wait
what no okay
um let's get a pool going
here so there's two program and there's
compile and they're separate
things
and sometime compile can fail two
program should never fail two program
fails it's a bug in tiny grad
well that actually worked out to be less
lines than using the stupid uh try
compiled linearized with idx
oh so this lowering is all in Python uh
I wrote this crap
so you see okay you see you see how much
we can speed up by uh why is it faster
now it's just faster now what did I
change oh the signal crap
how much time are we spending on that
you see no one benchmarks any so
it's just
slow and the combination of linearize
and uops I don't know how much of that
is not reused
anymore oh I run that twice wow I run
that
always that's kind of annoying all right
well that was a big waste of speed
there's a big speed regression there we
can fix that for beam as well I me we
need this to be in a shared framework
wow there were so many regressions when
we went to the lower everything's so
much simpler now
though cool look at that look at how
much faster we're searching love it that
was completely free we made things both
simpler and faster no
parallel where it going what was it
before like 24
yeah 33% faster guys we're winning on
this stream
is
free lunch and search that's right we
found a free lunch and
search we just stopped running the
function
twice uh that's cool that that bug
actually exists in I mean my whole next
week is going to be spent on
search um
I don't know why I posted it in the
employees only Channel we have a
breakdown so we have five um people who
work at tiny Corp now one's on vacation
next week so we have four people just
we're all going to take a different part
of the speed problem I'm going to work
on our own part of the speed problem and
this thing is going to be
uh faster than torch in no
time wow I love my new Fast MCTS okay so
there still is a 2X to be had you can
see these percentages don't add to 100
and it's because I put the lowering
outside the time does that make
sense this tur into a pretty good stream
we're actually coding look at
that I mean we had so much good gains
in time programmed we want to try to
parallelize
this paralyzing is
annoying they have to do multiple sample
trees this crap all looks slow look how
slow this all
looks what here is actually slow
decorate this with profile from
helpers that'd be cool if I
could this function as a
decorator it does
context decorator call takes two
positional arguments but four we're
given uh I think I like tell it
stuff maybe
that come on profile for me yeah profile
 all right so where we spending all
the time
ton of time spent in Sea style
render wow wait why is that not
sorted oh it's sorted by
that oh SE style know SE style render
just because that's why it's doing the U
up graph okay so half the time is being
spent doing stupid UOP graph we know how
slow UOP graph is
uh oh here we go so here's Ops metal
compile Ops metal compile is actually a
pretty small part of the
time
um
wow spending a lot of time in symbolic
floor
div this symbolic and UOP is so
slow okay okay but that's cool so almost
all the time is being spent in two
program well not almost all but that's a
percent wow look how nice tiny gr
infrastructure is that profiling just
worked like that that was
cool you understand the stream so far
great we're trying to be more
understandable and approachable for
everybody except Noobs
okay it's pretty good speed up
already if we want to parallelize this I
don't really want to parallelize this I
just want to make it faster I I hate how
slow this
is so part of the problem with
parallelizing is then we'd have to do
like it would actually be slightly
different if we were to parallelize
because we'd have to sample from the
tree more like you take multiple samples
from the tree and then run them and like
back propop them all when they come in
35 a second 47 a
second tiny CAD infrastructure is so
good this is so nice like so easy to
write things like
this that is how you make progress I I I
was thinking about that I even thought
about tweeting it it's like there's
really one group people that moves the
world forward and that's the people
building
infrastructure think about the tech tree
of any game we're progressing through
that same sort of Tech Tree now I know a
lot of people are like talking about
this stuff now but it's it's it's cool
to uh you know to be explicit about like
we're moving through a tech tree and the
way that you move through a tech tree is
you build infrastructure
um I don't know that's kind of like what
I do with my
life um eventually I want to rewrite
like all of open pilot in tiny
grad uh like tiny grad's a programming
language but it's a very restrictive
programming language it only lets you
express certain kinds of operations but
these certain kinds of operations are
pretty much all you're going to need to
build like brains and stuff uh so yeah
like a lot of open pilot can be
Rewritten in tiny grad and then it's the
job of the tiny GED back end to actually
make that run fast on Hardware uh the
first chip that we tape out is probably
going to be not uh it's probably going
to be an inference chip for
comma um like once open Pilots ported to
Tiny grad we can
then
uh switch comma devices to use tiny grad
taped out chips it's also it's a lot
cheaper to tape out a small
chip um I mean we would have to care
more about power but you have to care
about power anyway so it's it's good to
like you start with the mobile Asic and
then you blow it up you know as much as
they piss me off I think like qualcomm's
undervalued like let's look at Qualcomm
compared to uh compared to
AMD 204
billion oh similar
unbelievable unbelievable guys it's
really
uh yeah know I think that like I'm
actually bullish on if Qualcomm
understood like what they had and what
they were doing I'm actually bullish on
them building better neural network
accelerators than like AMD for example
all
right we have faster
search question of making this
faster
why so it's a kernel
right can I give it a type does it still
pass uh where's my mypie
incantation I don't know why
why when I run this in
CI this is the myi that runs in CI it
doesn't include the
MCTS uh but when I run it there
okay
incompatible
oh for
so if you're interested in making this
faster I think we should just probably
focus on making lowering faster uh I
know the branch is called parallel MCTS
but the longer you can like
parallelization is always going to be a
trick that's available to you uh whereas
if you just can straight up make
improvements there are just winds out
there so this one unfortunately is
something we track pretty well already
so I don't know how many gains there
like low hanging fruit gains there are
there's definitely gains they're just
not that low
hanging almost lunchtime
so I have this thing called external
Benchmark schedule yeah we're getting
like 653 there and 653 is an improvement
kind of from what it was but you can see
that like this is 10x slower than all
the other uh steps in the
model uops is the thing we were running
twice by the
way um it's this it's this model
linearized that's doing that's running
all these graph rewrite rules so this is
the thing that's new in tiny grad um and
the old one was slow too like it's not
like it's not like the old one was fast
um but yeah we've moved
to instead of like hand coding rules
that writes this code in a linear way
things have been Rewritten as graph
rewrite rules right so like this is the
matching pattern and then this is the
code that runs if it matches uh you can
see the pattern matcher is
here so yeah there's lot of gains to be
had by like instrumenting this
and
like like I have some things to speed it
up that's kind of what where's my
pattern match here's pattern matcher so
like I'll compile like a dictionary so I
can do a fast Dictionary look up but in
theory I think you can do this
recursively um there's also probably a
lot of stupidity here in like how we
iterate over these things so you can see
that if something's a list I just create
a list of all the
permutations which like it's correct but
there's probably a smarter way to like
do
that like I think greedy is
fine it's greedy with a
tree it's just I mean it's it's nice
because it's an easy thing to
write but uh
I think a lot of time is wasted there I
mean then this yeah this list
comprehension is all pretty
slow so let's
see if I could make that 2x
faster
then we're looking at something like 60
nodes per second I want to get that to
500 nodes per second but there's no way
we're going to get it to 500 nodes per
second right like even if the only thing
was GPU runtime which I can't
parallelize at all right this this in
theory can be parallelized is just a
little annoying on metal so this red
stuff can never be parallelized at least
not the way tiny gr works now um you
could in theory parallelize it across
gpus if you have a uh multi-gpu
computer but yeah so 40% so wait that's
25 I thought it was 30 was 30 before why
did it lose
speed oh maybe sometime it's faster than
others depending on the nodes it happens
to
search he look this one's
faster
interesting wait and this one like
messed up look this one didn't find a
good one this one found a good one and
was
faster
whatever yeah see and that's the other
problem right again the search is
allistic based so sometimes sometimes it
gets to a bad one uh and then you know
you do all these stupid things for one
and we just put the search in a loop and
run it five times well yeah you just got
5x slower can you parallelize that sort
of okay so if we're at 30 per second and
we're spending 38% of our time on
runtime yeah the best we could possibly
do even we got the other to zero was 78
and that's not fast enough still
so let's there's no getting around
just yeah like
this all right so like sometime the time
is spent in a
net and sometime the time is spent
in to the code and
realize construct this compiled
Runner but I really wants a line
profiler on this
interesting so most of the time isn't
actually spent waiting for the kernel
most of the time is spent constructing
the kernel except in like some weird
cases where the Colonel's probably
already
constructed that one's all in weight
check why is sometime this fast and
sometime this slow
we're we're doing it pre compiled right
yeah precompiled equals lib so that gets
bypassed that's not
running
device uh nothing slow
there this just all be the metal
construct that's
slow not triggering that dispatch data
create new function
with name
lib you know we're actually already
creating this
program when we compile
it where are
we
Library yeah see like this new this is
calling new library with Source this
calling new library with
data so we sacrifice a little bit
there
um we ever hitting the compile Cache no
wait this is all after that
uh yeah so sometime the time is spent in
weight check and sometime the time is
spent in a
net wish I could aggregate these somehow
okay and this is happening before this
so we way check yeah you see it's like a
decent multiple of this right so we're
spending so it's telling me that the
kernel runs in 4 milliseconds and then
it's spending this
long uh running
it which yeah again there's not really
going to be a way around if you have a 4
millisecond kernel that's just how long
it
takes this only seems to be slow
sometimes I wonder why is it slow
sometimes and not slow other times let's
profile
it can you just do that
great slow sometimes and not slow other
times we don't have any more information
on
that oh maybe it's this GC
I don't know maybe it's just running
something still on the GPU and it takes
a long
time uh okay nothing sketchy and weight
check yeah I don't know I mean this is
just how long it
takes these are Big kernels too like
these kernels are on the order of
milliseconds so if you have kernels if
your average kernel is three
milliseconds you're running it three
times
uh okay okay well one thing we can do is
we can lower the early where's
early we have early
stopping this probably can be three and
doesn't
matter 40 per
second yeah
cool uh
I don't know like I doubt that
matters the question is it definitely
made things
faster uh three might be a little
aggressive there so what this is what do
I set to do in
beam I do three in
beam three is probably fine I again I
need that
framework to to do to do proper
evaluation of these things like you
could just get unlucky and get a slow
one and then it exits and it's
done I mean three is what I do in beam
so it can't like be
that I don't know like it hit there but
that could just all be lock
seems like I get most of the games with
five anyway so what this is is it'll
only run the kernel
once uh if
it's should we adjust beam to
match beam is so wasteful now because
it's not even doing that compilation
correctly okay 36 per second
it's pretty good
you see MCTS is winning most so like we
have the handc optimizer the tensor core
Optimizer I can put beam in there as
well and we have MCTS
there W that's still going that's so
slow let's switch to parallel MCTS
I didn't push yet and now it
pushed so the stuff is cach so you can
see that's all fast
now 34 per second just oh look at
this 69% of the time is spent compiling
and only 1% of the time is spent on
runtime because these kernels are so
much smaller actually that's probably
also going to be true I happen to be
running this on uh something that has
big
kernels but if I run it on something
without big
kernels uh jet beam means only beam the
things in the jet so you see all that
stuff not the jet so it doesn't run it
now as soon as we get to Something in
the
jet the tradeoffs become different why
is it doing
this let's fix that
bug probabilities contain
N I exclude the ones that are Infinity
see what's going on why it does
that oh that's a different problem
uh
cool well yeah because we no longer put
the compile in
uh no there a tiny G device compiler
eror that's fine
though I mean it's still
interesting uh but yeah this should not
be this should be except
compiler and we'll change that to
include compiler
eror but yeah that's a bug someone wants
to look into that
see this Colonel is very slow so we're
spending 90% of the time on
runtime uh okay same bug
by the way does math is INF work for
negative Infinity
too
cool for
oh we got through all that is that a
good
time seems pretty
good 7
milliseconds who knows if it's good
how much faster the searches on
these we're almost getting to that 500
per second 239 per second this is a
slower kernel
so it's not that much
slower so I mean though there's so much
diversity in these
uh in these kernels like you do
something to make it faster for one now
there are real wins but
all
right go to the bathroom I'm going to
grab a matcha latte and then we'll do
some questions and then that's the end
of today's
stream we got to look into that HSA
thing that's crap that should just be
removed D we should exclude those
kernels search is really addictive to
watch you can just sit and watch
searches wow it's searching look at it
search oh yeah someone want to look into
this not folding
crap uh like I I know where that code is
but you want to see if you can fold
those that would be a cool thing to look
at and you can look into some of those
bugs and see why the linearizer doesn't
know always work Perfection you know we
we pursue perfection in tiny grad and I
hope someday we'll be there it's true
that we have like tiny used to have
different looking bugs the bugs now are
like deep bugs there aren't many shallow
bugs
anymore which I mean I guess that's how
bugs
work good progress man today
yeah
8,461 lines get a much a lot and I'll do
questions for
for
wow we got energy from caffeine Focus
from theanine
Clarity from Lion Man and calm from
ashwaganda that sounds
lovely you know they never sponsor
me
ta ta you tag the sponsor you
know Lions man Big W all right
um probably because of my rants no no no
no look what's what's politically
correct just change
it maybe stream tomorrow often n not
worth it I'll buy my
drinks um
so a good time overall for this is if
it's sub 20 milliseconds we're doing
really well so this will this will
finish shortly while we do
questions appreciate the more educative
stream I want to get more people
involved in tiny grad uh both usage and
development I think it's now to the
point where it's quite usable
um unless you're doing these searches
the speed is still slower than torch
with these search sees it's
competitive like if you if you do like
like beam 3 or MCTS
500 uh it's it's competitive with with
torch on most
platforms uh it's definitely competitive
on Mac um it's definitely competitive on
AMD on Nvidia it's probably still a
little
slower uh you couldn't get it to work on
your 380 it should work on 380 now uh
we're we support all the it works on my
3090 and it's the same chip so yeah it
should work fine uh in the Envy back end
if you have a 3080 try it right
now uh can you cash the search across
runs yeah it's cashed
automatically so yeah you only have to
do the search
Once I did hear about Kathy starting
Eureka uh I like that form seem chill
are pie trees ever coming to Tiny grad
uh I don't know what a pie tree
is so probably
not what why would I want
this
oh I see
we kind of have some
like implicit stuff that does
this I'll show you the
function
um you mean like here like we have
functions like get
parameters which will like get State
 this is kind of like a pie
tree um what exactly do you want
P Tre to do can you solve the arc
challenge using tiny grad maybe maybe
you
can um isn't named tensor
axis uh we don't have that apparently
pytorch had it and deprecated
it uh may just map scan over pie
trees stop it stop
it look so ugly
now uh can you reduce the kernels in
size for faster running yeah so we
actually do that so there is in my time
kernel
function uh you see this thing called
Factor so this will reduce the global
size and then return a factor and then
uh run it and use that as estimation so
that's already being
done what else we got oh on your
3060 uh I think that one supported to
sorry that's not the same chip as the
3090 um if it's not supported it's
probably a very small change to make it
supported we're interested in supporting
everything back to like the Turing
series like the 2080
series Jax also has higher order
gradients do we not can I not just grad
twice all right so we got we got we got
21 milliseconds could be
better uh by the way it caches so you
can see it'll just run through the cash
again it's very fast the second time uh
we got 21 I've got 19 before that's what
I mean like the search isn't
uh the search ain't
perfect wow repeated stores and
uops
interesting yeah what we need to do for
all of these things is we need a context
that oh this is this is great at finding
finding all sorts of bugs and Tiny grab
we need like a context that prints out
what like see we have tensor operations
we need uh another one of these that
says like that prints out the kernel
that's trying to be lowered right like
you see like error lowering meta Ops
kernel we should print that kernel
out well actually
I should just be able
to why do I only print the op
there will we hit that
again nope we don't hit it again tragic
so we can print the kernel there but
that still doesn't even print the all
right we need to do the
refactor the lowering should have okay
the schedule should be optimized
separate from
uh
running yeah so the the as should be
lowered so in this mtts search thing
where we have the uh this get optimized
as that should actually be like pre-run
um and that's what the beam search is
not it doesn't return a kernel it
returns
NST yeah I believe it's just grad twice
uh hessen is a
matrix
[Music]
um I don't know
do I still my old
cash interesting that's the old cash I'm
not getting 19s now sometime I think
it's dependent on like how hot my
computer is or depending on like
something we get like lucky with the RAM
allocations and they're not like strided
on pages or something who knows
um Apple we have a lot less control on
because we didn't write our own driver
for Apple the the apple back end here
you can see just uses
uh just uses like normal metal stuff
like here's metal program we just do
like you know new function with name new
compute Pipeline with State uh so yeah
it's not as low level as the
wonderful the AMD one's easier to read
than the Nvidia video one has a lot of
crap that hasn't been cleaned up yet but
like I love this like that is how you
launch a kernel on a GPU and we're going
to get this removed because we don't
need that that's not
real Release Me is so such a misleading
name
these need better these need better
documentation three and zero these need
to be better
documented this update API is
interesting so this is how we like
update things in the jet we have update
the Q I don't have an obvious better way
to do it but I wonder why it's uh slow
oh yeah here we can let me show off
something else to you
guys uh so we can run llama like this is
llama sharded across four
gpus so those the weights that could be
faster there's a reason why yeah that's
not getting us the full speed but
yeah so we're getting 138 tokens per
second across four
gpus I believe now across six gpus it's
still slower this is llama 7B on
quantized on a tiny box so once you go
across six gpus it actually gets slower
because you see even with our crazy good
drivers we're still spending a lot of
time here on NQ uh so it was a PR put up
this
morning uh to lower that but you see
again if you're using Cuda you have no
control over your NQ time whereas I
don't exactly get how this works but um
keeps stayed around but look at that it
has the NQ
time yeah so across six gpus we only get
89 tokens per
second uh this this is still a little
bit under what GPT fast can get so we
have some some work to do
still
um all right do we have any other good
questions how do you build super
intelligence right now have
kids start by having a high IQ and then
have
kids and then you know train your kids
to work
together that's that's the most
straightforward path to Super
intelligence teach your kids tiny
grad what do you need to know to
understand this what domain of
programming I don't
know I don't know I don't like learn it
in school or anything I've been working
on Tiny grad for like five it's been
like five years it's been a long
time uh you know but like we're getting
close look we have doc
like if this wasn't legit would there be
docks like real
docks how is inference speed compared to
llama CPP um so a lot of those things
are focused on
quantization uh again if what you're
trying to do is just run llama like use
llama
CPP
um it probably is going to be faster the
idea is like the whole Theory behind
tiny grad is the bit or
lesson
uh you know this one of the things I
always shell for the biggest lesson that
can be read from 70 years of AI research
is that General methods that leverage
computation are ultimately the most
effective and by a large
margin uh the reason for this is Mo's
law so uh where is see
here uh one thing that should be learned
from the bitter lesson is that the great
power of general purpose methods or
methods that continue to scale with
increased computation even as the
available computation becomes very great
these two methods that seem to scale
this way arbitrarily are search and
learning uh I wouldn't use the word
learning I would use the word
optimization but yeah like search and
optimization scale with the with the
computer
um by the way this is a great thing to
read uh if if if you haven't read it I
sh for it on stream a lot but that's
kind of the like the difference between
tiny grad and uh and
torch right we don't specify what
the uh we don't write the kernels we
specify a generic framework with which
we can search for kernels and as search
methods continue continue to
improve tagr is kind of this new class
of compiler that's
like so there can be search at every
level too so all of this search is being
done at this level called kernel. Pi um
so these are these uh those
optimizations that we talked about that
search space but there's tons of other
potential searches so for example I'll
give you one here here's a function
called image. imagecom 2D so this uses
textures to rep present the uh the
inputs and outputs to a convolution uh
if using textures on a GPU instead of
buffers uh Mobile gpus in particular
they put a lot more effort into their
texture cache than they do into their
buffer cache so on Qualcomm this is like
3x faster like on the on the Comm 3x so
this is mostly written for com but um
like this stuff can be searched right
how we choose to represent them right
here is hand coded but that can be
searched so you can search at this very
high level right then we have another
file called schedule. piy and this is
the scheduler that determines what order
kernels are running this stuff can also
be searched it's effectively a
topological sort so we have two big
topological sorts in tiny grad we have
the topological to sorts that determine
what order kernels are
running uh then within there we have a
bunch of graph Transformations and then
we have a second topological sort um
when we actually turn the uops into a
list uh those uops which I showed you in
those UOP graphs remember the UOP
graphs so like this is a UOP graph um
when we turn these UOP graphs into a
list and fundamentally a program uh we
have to determine what order we put them
in right and that order is not fixed
there's multiple so the the Only Rule is
that the order has to be a topological
sword on the graph if you don't know
what that is look it up in a computer
science textbook um but within
topological sorts there is me there's
many sorts of there's many lists that
satisfy the property of the topological
sort uh so yeah you can search there as
well and eventually we're going to
abstract all of this out into a very
powerful General search framework and be
able to find the absolute fastest
kernels uh to run all this stuff and
like when you're talking about something
like when you're talking about a
training run at like gp4 scale or even
bigger when you're spending $100 million
on a training run if you can somehow
save if you can somehow you know make it
1% more efficient you save a million
dollars so you're willing to put tons
and tons of compute into this search
it's a question of how well the search
scales uh I mean can the search continue
right can you keep searching for better
kernels and the answer is sure
right um let's let's just do one as an
example right I don't know what should
we set it to
5,000 like it'll just
work it's
annoying it's
wrapping Let It Go we'll see what it
finds I don't know does it get better
I've never ran one for 5,000 before but
like the beauty is as we make this
faster right we could parallelize it we
could we could make the python faster
this method only becomes more effective
as computers get faster right when Apple
releases the m6 chip it's not going to
require any any like hand work right you
can just increase your search
budget um you don't need to think about
what the GPU is as long as you've
captured all of the uh you know
everything you need fully flexibly then
like Let It
search no don't do that stop
wrapping make it a little bit shorter so
it doesn't wrap
um would you like to know how the AMD
accelerators are yeah we got rid of we
disabled the broken feature in their
driver and we
uh rode our own runtime and now it's
fine oh look we found a faster one at
2028 look at that new record that's a
new record for that that colel I've
never seen some i' never seen a colel be
that fast
before and it it only it searched 2028
kernels to find
it that's on analog
computers
um I don't think there's big gains to be
had you you give up a lot when you
digital computers run uh 100%
repeatably you don't really need this
property but it's annoying to not have
it uh it makes debugging stuff really
hard so no I don't think I think that
what we're going to start to see is
smaller and smaller data types and video
talks about this a lot like whoever can
make if you can make training work on
like float
4 uh that is really power efficient
because most things scale with the
square of the uh like multiplies
multiply scale with the square of the
operation size
basically you can think about just a
generic a generic table right a generic
like two op table where I have X here
and Y here right it's a square
so uh am I searching randomly no we're
using Monte Carlo tree search it's a
it's a guided search
right uh so no we're searching over a
set of of of permutations right like I
showed you how uh
I showed you how that
works yeah crowd strike needs it right
now
um green Tiny Box is greater than red uh
to be honest the red one's probably a
better
deal uh it's again it's $10,000 cheaper
right like how much do you want to deal
with Annoying drivers the answer is like
I said one box gets bought 10x more than
the other and I'll leave it up to you
guys to decide which
one uh multiplying huge integers using
Foria
transforms oh it's even faster
um yo have you we've never seen a
colonel that fast before like that's a
new record we just needed to search 4,8
54 kernels but imagine we got that 23
per second up to 2300 per
second can I summarize why they're worse
because AMD is bad at
software it's it's really just that like
Nvidia invests into software and AMD
thinks you don't have to and like
they're going to lose as a company
because of
it well look at this MCTS just continues
to get better
uh I don't know what hvm
is I don't know what symbolic ml is I
don't think this stuff
is oh look look at how long it took on
that one it
hung um this Kernel's a lot simpler so
like there's it's it gets into the weeds
right like if you tell it to keep
searching it will keep searching but
eventually gets into the weeds and
starts finding like dumb
kernels um I think I got my stop
condition correct on MCTS so like I have
like MCTS when it exhausts the tree you
kind of have to like deal with that it's
a little
Annoying see you can just put more zeros
on this number and it does better what
if we searched for 50,000 what would we
find uh thank you yeah I like the colors
too it's it's cool you can really you
learn to read these really fast too like
these are really simple globals locals
reduce unroll
upcast right and then they're in the
kernel name too which is neat how many
kernel permutations we went over this
before 100
million well yeah maybe if you like
prune them down maybe it's like 10
million yeah I mean you get even 5,000
which is crazy high like you get 500
test points in a space of like let's say
million um do you know if the search
space includes very fast
Solutions uh well I mean what you can
generally do is you can plot uh and the
thing looks like it converges kind of to
an ASM toote so I would doubt that there
are like magical super fast Solutions so
okay actually I can tell you something
we definitely know so the GPU in this
computer is an apple M3 Mac
so if we go
here
uh is not
here wow apple has a lot of different um
so the M3 Max
has
14.13 teraflops of
compute so we are at
86% pretty much 85 .8% uh
efficiency on this kernel right so it
can't be faster the the fastest time
that you could possibly get on this
kernel uh is going to be you know 1.43
ID by
that sorry multiplied by
that yeah so the fastest time you could
possibly get is 1.22
86% is good
yeah um multiplication on log numbers is
an ad that's true but what's an ad on
log numbers that's that's what's
annoying about that
yeah yeah 88 86% mfu um we're trying to
get our training mfu up our training mfu
is not that good yet our training mfu
well it's not bad our training mfu for
like resnets is like 33% on the Tiny
Box
uh all right are we out are we out of
good questions are we in dumb question
land now what are the nodes in the MCTS
the nodes are I showed the action space
so the nodes are like a different each
node is a different way of running
basically the same uh Colonel wow if
we're really off into the weeds guys
they're cousins they don't collude okay
it's not like it's not like Jensen and
Lisa Sue get together and say hey why
don't you make your software suck balls
so we could be worth $3 trillion and you
could be worth 250 billion and Lisa Sue
is like okay Mr Jensen what you think
that's what happens come on they just
suck at software and they don't see any
you know that's not important to them
it's very clear that it's not important
to them and they'll continue to suck at
software and they'll continue to have
10% of the market share of Nvidia right
like it's not going to change people
think like oh AMD is going to get fixed
like it it's really not um I don't know
I I don't want to go into this Rabbit
Hole again you know you just need to you
just need to like like what how many
therapists does it take to change a
light bulb one but the light bulb has to
really want to change right
what do I work out right here in the
comma gym yeah let's
go didn't AMD buy some AI companies yes
completely the wrong ones it's guys they
want to lose okay like some people want
to
lose
uh bug Bounty programs these are the
people who ruin Security man security
used to be like you know showing people
goats day in the middle of a CTF and
like you know laughing at noobs right
those were the good old days you know
well I heard we're going to make America
great again so you know maybe we can
make hacking great again
[Laughter]
too I don't even know what the A and the
N are but we're definitely not talking
about trains and buses
man uh any plans for using RL to
optimize search well if you've watched
my channel you know exactly what I think
about
RL um AMD is a culture problem not a
Manpower problem that's true
uh RL is a scam but not as big no RL
Works someday bug bounties you'll always
be a loser if you do bug bounties just
just you
know I love when people just what what
people should really do with zero days
is just drop them on Twitter right
George you're influential in the
security Community you can't say oh my
God we got really spicy on this stream
just drop your zero days on Twitter
man sorry X I dropped it on x man
respect right that's that's you want you
want to gain respect as a security
researcher just like here's a weaponized
Chrome zero
day dropped on
Twitter um don't actually take any of my
advice everything on the stream is for
entertainment purposes only
um I take no responsibility if you
choose to murder somebody after watching
my stream I do frequently say not to
kill people uh I think that's a good
note to to end things
on um isn't RL just MCTS but worse RL
has incredible potential RL will one day
grow up to be something but today RL
does not work um I mean like kind of
works I don't know remember press the
light up button remember getting getting
frustrated by you almost forgot not to
kill people well good I'm here to remind
you we're back
uh uh but don't do bug bounties man I
got paid $3,000 for this chrome zero day
that could have brought down the
internet yeah great
[Laughter]
man um dreamer V3 Works po does not yeah
I mean that's probably the truth it's
probably going to be some like fancy
hyperparameter tune thing that kind of
works like Gans work but your Gan
doesn't work right like style Gan works
and dreamer V3 work but your Gan and
yourl don't work uh so yeah I don't know
but build infrastructure make it easier
look at that look at that Colonel there
look at that I found it at
4,432 it just continues to get
better Yuri thank you for gifting Subs
do you have a last question to ask the
Stream
bye
good morning everybody but good morning
high ball energy
coffee
and I got a acai Bowl coming over to ask
on evil this morning and I asked the
evil last night was so good and I was
like could I order another one this
morning and the answer is yes because
I'm an adult
ah so we're gonna write some new
tutorials today
uh we'll see if anyone's actually here
hello hello
uh so if if you didn't hear the news we
uh we raised money
uh this is this is a real screenshot of
my bank it's actually higher than that
now
um because the tiny Corp is uh a
profitable company
uh marginally but yes we are actually
profitable because we sell tiny boxes uh
so if you're interested in pre-ordering
a tiny box today uh it's just a hundred
dollars worth of pre-order uh they're
fifteen thousand dollars and they'll be
able to run uh big llama
um
I I uh it was described to me as a as a
luxury uh AI computer and that that is
exactly what the Tiny Box is going to be
um yeah so we're gonna try to make a
noob tutorial today
um you know who I generally feel about
Noob stuff but you know I think it's
important that look
one of the goals of of tinygrad is to
have a developer experience that's just
above and beyond what you can look you
have a lot of choices in machine
learning Frameworks
um but okay so first off let's start by
deleting broken docs that's that doc
doesn't even exist anymore
and then let's make a new one we'll call
it tutorial dot pi ipin b
like notebooks kind of load in here
right this is cool
um
you know honestly that programming
challenge
I got so many bad responses to it I got
people who didn't read the fucking
challenge like the challenge is not to
the challenges is uh write a Winograd uh
two two
the challenge is write a Winograd conf
uh Target a specific architecture and
get the maximum theoretical performance
on that architecture
people thought the challenge was write a
win a gradconf this is not the challenge
that is easy you can copy chat gbt can
do that
um Now find an architecture do some
research into that architecture be like
well here's how many Al use it has
here's how much memory bandwidth it has
um so also like
there's people who think
um you know I'm even going harder with
this at the tiny Corp than I did with uh
with comma there's people who think
there's some like separation right
there's like a separation between
consumers and businesses there's like a
separation between employees and and
Executives there's not okay it's all a
spectrum
if you're trying to play some
adversarial game with me like you're
giving me some half-assed solution and
you kind of know it's half-assed
and you think you're just trying to like
play a game to like oh well I'll get my
foot in the door and then get the fuck
out of here man
don't waste my time don't waste your
time you know have some self or stop
some goddamn self-respect
uh
uh so yeah you know if you're not gonna
do uh great work don't do it at all
there's a there's my high school
yearbook quote uh was you know if
something's worth doing it's worth doing
well there's just a lot of things not
worth doing
uh so yeah
so let's let's let's go into the uh Noob
tutorial
um there's also a change I want to make
I want to be able to set the how many
pre-orders for a tiny box almost a
hundred uh we got a lot of Tiny Box
pre-orders
um
Alex is is helping the Tidy Corp out
with a logo these things are gonna look
sick guys like we're gonna make awesome
looking tiny boxes
um you know some guy posted on Twitter
or comparison to our equivalent Lambda
Labs machine uh you get like 2x as much
um
the order link is on tinygrad.org you
can find it uh it's a hundred dollar
pre-order and then it's gonna be 15 000
total
um maybe it might be more it probably
won't be more if you actually put a
pre-order in I'll probably honor the
price but I've run into some issues
building these things
and I'm gonna have to use more expensive
Parts than what I thought
so yeah
um
yes it is it is fifteen thousand dollars
with three zeros
uh so one of the changes we're gonna
have to make well let's start with the
tutorial okay so all tiny grad starts
with is import tinygrad dot tensor sorry
from import tinygrad dot tensor uh
import tensor
okay this is this is like the this is
like the import numpy is MP for for tiny
grad
what
all right you see it Imports in 1.2
seconds which I guess is pretty good
um
okay let's create a tensor uh so what
kind of tensor do we want to create
where where do we want uh
the
no it's not TG it's it's it it's this
I think I can actually if I do it in
knit I could get rid of that dot tensor
and maybe we'll do like from Tiny grad
and Port tensor but really tensor is how
you control the entire thing
uh so I can say something like a equals
tensor let's make a tensor of ones let's
make it ten by ten
all right
look you can tell this is a new tutorial
because I made the font big
um so what is that actually mean
so yeah you see a whole bunch of
confusing garbage when I type that
uh
if you do dot numpy it will turn it into
a numpy for you and you see the D tag is
a flow 32.
um you can also
from Tiny grad dot helpers import D
types
you can also change the D type
say d type equals d-type stop 160.
and now it's full 16.
uh but we won't do that
okay so we have a beautiful tensor
uh we can multiply by four
now again
you'll see that
let me make this nicer
tensor backed by a 10 by 10 lazy buffer
float d-type uh a mole
uh and then some things about the shape
where it lives it's on the GPU and the
grad is null so again if we want to
actually uh realize that we can do a DOT
numpy
now I want to try something that I don't
think is going to work
if I say debug equals two it's not
actually going to debug equals two yeah
we need a Setter for debug but I'm not
even sure this is how these things work
if I write set debug
you know set debug doesn't actually work
unfortunately because it's imported
how do you move the tensor to GPU well
it's on GPU by default but if I want to
move it to CPU I can we'll get there
I feel like that you have to restart in
order to use debug and I use debug
everywhere
is there like a way to do this
you see the problem
so one thing that does work is you can
do this
this font size is horrible
I made the font so fucking big
that's too that's not big enough for you
so I can do OS dot Environ sub debug
equals two
and this is going to work
okay so you can see here that it printed
out
uh this
when I do this you see that it printed
out uh this year
now we need a way to set debug
dynamically
you know that works but the problem is I
can't change it
all right bro even though you're a
subscriber you're getting timed out
you're Shilling for someone else what
are you selling for
uh you are the reason we're about to go
sub only ethan1g knows what's up
um Okay cool so only Subs get access to
this great new uh
this great Noob content
it's gonna be a big change
like can I make a property but a global
property
[Music]
oh interesting okay so what if I do
import helpers
and then I say helpers
got debug equals three or let's say zero
[Music]
because I guess what I when I imported
it makes a copy
do you see the problem
you misunderstood how variables work in
Python variables are not memory
locations
you should read more about
oh this is terrible
so okay I have a lot of places in tiny
grad where I import debug
like here from Tiny grad helpers
import debug
problem is that there's no way to change
that
yeah there's a logger module I kind of
hate the logger module
should we switch to proper logging
use data classes
no this isn't really what I want
I think there's a way to do what I want
like I could make that a function and
then access a variable
maybe I have to
just do this
it's kind of terrible though
but I guess the minute I've done that
it's already made a copy right it's it's
brought debug into my into my uh local
space
okay well we have oh it's not
environment
uh cool
um
so let's look at a few interesting
things right so if I do something like a
times a times a
dot numpy uh so it's one times one times
one it's gonna be uh it's gonna be one
but what's interesting is that well
let's make it two
actually we're gonna
so when I do a times a times a it's
eight but notice that it's only calling
one kernel here
right
um
um so in in pi torch what would happen
as soon as you did a times a it would
dispatch the kernel uh but in tiny grad
it's lazy so you can do three and
they'll be fused into one kernel I can
even go further with this I can do a DOT
relio right now of course dot rail you
want eights is just going to be eight
but maybe let's do like sine all right
so that's the sine of eight
um and you see that that's all still one
kernel so if we increase the debug level
now I got to fix this because right now
we have to restart in order to increase
the debug level
um if we increase the debug level we can
actually see the program that's uh
that's being generated
so this is the the opencl code
um
you see multiply value multiply Lu and
then do the sign that's all in one
kernel
uh it's lazy by default yeah
um in theory what I really want to move
to is like something that looks more
like how uh like a processor works right
now it'll lazy back forever but I don't
actually want it to Lazy back forever I
want like once things are kind of uh
once the back stuff solidified it should
actually uh enqueue them
um and this all this will help with the
speed
okay we got to fix the debug problem
should I just make it a function
I like
is there no way in Python to do this
debug class
um
property on global variable python
if it's an object or dick it doesn't
copy the value yeah but see okay I need
I need like less than or equal three to
work actually yeah I could just create a
class can I
so if I make a class called like debug
um and then I Define a method on it
something like this
it's not what I wanted to do
oh I mean that's cute okay okay here I
like this I like this okay so I can do
from tinygrad.helpers
Port debug and then you're saying in
order to set it
I'll just do something like debug sub 2.
okay into object is not callable yeah
um
okay so I want self.value so greater
than I'm asking the question
self.value greater than x
okay greater than or equal to so I need
a greater than or equal to method
and then I need an equals method
yeah I can add Auto reload you're right
uh I don't know I don't actually trust
Auto reload
I'll do it though
I usually use this in uh
I don't really use this in vs code
pretty new to this
uh greater than or equal to not
supported between instances oh it's just
G right
cool that works
and now I should be able to say
something like debug 2.
didn't work
oh oh can I do this
does this work
I don't know if I can put a property
decorator on call
actually let's just before we try to run
all the time grad stuff what if I just
does this work
[Music]
no you can't put call on property
foreign
level I want to keep all the existing
code intact
I don't know I actually don't think this
is that bad
you can't put property on call
uh what if I do like wrapper
oh that's a string by the way I hate
autocomplete
so I got the python magic mattress
no no that's not what I want
not supported between instances of debug
Singleton and int
oh
but what if I do that
no
I do that it should work
you know that works but it's not what I
want no I know that's for the eight
method yay I was hoping it would
implicitly do it
um
oh there's no interesting there's no GT
they're not
oh there is I don't know why it's not
listed there
it's a bad list okay
use new and make it act like an it
no that doesn't work if I returning it
he's not that bad to have those
properties
wow
I can inherit it
okay
I think so I don't think it's a class I
think that's a lab
wait did that just work hang on
so what value does it have
zero
okay
inherit from it
python
into the mutable so you can't modify it
after it's created no so that doesn't
work
no no it's not a bad idea it's
interesting
I mean those are the only ones I should
ever really use anyway there's no reason
you'd ever check if debug is out here if
not debug
[Music]
what is not called I guess it calls bull
foreign
make a Class Property then assign it the
variable debug
I don't think so that's probably just
going to get called on the import I
don't know I mean this works this is
fine like this is not even a big deal
those are those are I just wonder is
there like an easier way to write that
it's like a quicker way to write that
it's a lot of lines
the Thousand lines is uh is more of a
guideline
yeah I think okay that should be fine
it's just it's the only way I see it
used right
less than or equal to is extremely
common
I don't actually need greater than
and I don't actually need equal to
good it enforces how you use the thing
anyway
I think you should only be using you
should only be using greater than or
equal to or you can use not
Actually I don't even think you should
use not
this is just BFD bug
[Music]
no not's fine
the only way you should ever use it is
greater than or equal to
cool
Americans like debug four
that didn't work
why didn't that show me the code
that showed me the code okay now what if
I change it to debug 2 okay that didn't
what if I change it to four
the code doesn't come back
oh probably because that's only going to
happen the first time
okay when I create the AST Runner and
the Astron has not created the second
time okay so what if I change it to 11.
okay that looks very cool
um yeah it's not gonna it'll only print
that a good uh
yeah okay let's
the first time
oh I love this new debug Behavior so
nice
pretty clean right
I don't have to use the mouse for that
okay
all right
now that that's done
yeah it'll just enforce and then like if
it's used in a different way anywhere
because it's all used is greater than or
equal you can look over here and you can
see that and it's used as not
um so we support that or we actually
just probably shouldn't support not
that's okay no it's fine I don't know I
don't know
I don't know waffle on this
um
yeah I know debug is so good better than
torch thank you thank you I worked
really hard on debug
no
no
okay
cool
um
I don't know why this actually calls two
kernels
let's look at it with debug equals four
what are the two kernels okay it's
assigning one
and then it's multiplying it by two
why aren't those things getting fused
I do force a contiguous in the ones and
we may be able to get rid of that
yeah I don't know the logging modules
confuse me
someone might give me a good case for
them someday but uh until then I'm not
solved okay
uh so we can look at it and there's a
bunch of twos great uh I don't know
exactly understand why that's making two
kernels
and we do force a contiguous in the ones
here that's probably good I mean it's
about where these things are commonly
used
now we can see yep we can print uh a
times four uh
three times five
times five you see that has to create a
new current you see this N3 that's
that's that's uh that means it created a
new kernel and four what if I run it
again it's going to call that same N4
kernel
cool
all right
what else do you guys want to see
some matrices
um so let's make B tensor dot i 10.
we'll get rid of the realize and see how
we don't actually need to realize them
um one and creating new view with
reshape let's take a look at things
so I do all sorts of tricks to make eye
work you see I is actually two views but
it's not a big deal
uh so we can do like
a matte Mall B they're not pi
you're both force a lot
and of course when you multiply by the
identity Matrix
you don't get anything special so this
is the creation of tensori this is the
creation of tensor B
and then this is the uh the
multiplication if we go look at how eyes
actually implemented
um
exactly understand why it has to create
it and why those are infused
it's it's
I'm cautious about fusing those kind of
things but it's mostly fine okay
cool uh so that's a matrix multiply with
a thing times the uh identity
um maybe you guys want to see llama
so we can go in here examples llama
uh we can put in a prompt I like chicken
I like and then we'll do count as like
20.
uh we'll throw a jit on there make it
fast
all right we're gonna load the Llama
weights in
five gigabytes per second I like chicken
I like it fried I like it grilled I like
it baked I like it ciao all right cool
um so a cool thing is we can use all
those same debug options on llama
um
there we go
and this is just all the kernels running
uh purple means that they're being
jitted uh so you can see for each of the
things uh we are getting a uh
flops a gigabytes per second we want it
to go a little faster we can throw up
local on here
so you see we're getting
268 gigabytes per second so large
language models are limited in speed by
memory uh so this card has a theoretical
memory bandwidth of nine of 960. so
we're getting 28 of the theoretical
maximum on this uh on this card
uh can you quantize no I didn't support
that so A few things about the
quantization I don't like the N4 stuff
at all I think the M4 stuff's actually
broken and no one's really tested it uh
the eight stuff's fine uh and if you
want to write this feel free contribute
to Telegram
so what else what else is like a good
thing to show off
so I mean we we we have like everything
uh from
tinygrab.nn and Ford comp2d so we can do
like convolutions if you want them oh we
have stable diffusion also
um let's see if we can make a table in
the future mark
uh
a cat in a hat
and then let's put steps up to 20 so
it'll actually render something decent
got a load stable diffusion
server Fusion's a little slow
uh there's a ten thousand dollar Bounty
if you can make stable diffusion on the
M1 uh faster than any of the existing
implementations
so uh there's a reason it's ten thousand
dollars it's going to require some
serious work but uh it's it's it's
doable in under a month
so if you're cool with 10 grand for a
month of work
um
why is this invoker cash complaining I
don't understand
sounds like L3 and Fang that's true
except you know what you're never gonna
have to hear about HR about diversity
about whatever ship they want to shove
down your throated fan you're never
going to hear about being a team player
you're just gonna code man let's chill
all right so let's SCP it here
[Music]
a cat in a hat
I do bounties get taxed yes uh for over
600 I have to send you a 10.99
I believe that's the law IRS don't fuck
with me I try my best I try my best
um yeah yeah my boy my boy and this is
all this is all so you can read this
code
um this is a clean re-implementation of
stable diffusion
uh so we have stable diffusion here
it's
700 lines
and we have llama here it's 420 lines
420.
um what do I think about unit tests I
think unit tests are stupid and nobody
should ever have you said you haven't
read tiny grad I have so many tests
I think there's more lines of tests in
tiny grad than there are in uh
than there are uh then there's other
stuff which is probably right so we have
tests for all the different back ends
check out these run Onyx tests I'm not
logged in we have to sign into Vlogs but
um check out these run Onyx tasks
actually I could just I can run them for
you
so
torch equals one torch equals one uses a
torch back end
um the GPU backend is faster than the
torch back end but the torch back is
interpreted and doesn't require
compiling uh so it's faster actually
rubbing things with it if you're doing a
lot of different things and the CPU
backend is numpy and the numpy is kind
of trash
um we got a call to Fortran okay uh so
this is called test external external
test phonics
uh okay cool so there you go
86 failures
uh
7271 errors
I think we run it with pi test we can
see a little bit more
so this is a good place to get started
uh some of these test failures are
one-line fixes
and if you want to uh
if you want to contribute to Tiny grad
this is a great way to uh get started
what is a direct ml pipeline we'll
Google that
none of these things are like really
going to be
good V6 is nice right thank you
um
the the problem is they all okay so it
comes down to complexity management uh
the people who write Pi torch okay so
like look I start a comma and the people
who make self-driving cars were mostly
like dumb they were actually dumb uh I I
could not believe how dumb they were uh
and like look they all started failing
companies that wasted millions of
dollars uh cool
and then like you know people talk oh
we've got waymo and crews are driving
around yeah let me tell you about a
company guys let me tell you about a
company here's a real company idea okay
I'm gonna write it up I'll write up in
Vim all right okay it's called the
revenue company
okay
let me explain how the revenue company
works okay
we sell dollars
for 99 cents
okay
so you can come to us and you can buy
let's say you want to buy a hundred
dollars right so you can buy a hundred
dollars for 99 right
um and you can actually then you know
you can take the hundred dollars you buy
and then you can you know use that to
buy more money right so our revenue is
very high
um actually we have a uh we only have a
one percent
uh one percent uh well one percent off
from being profitable
um which is actually a lot better than
uh Waymon Cruise
um women crews are way further than one
percent off from uh being profitable
um so look we're gonna get tons of
Revenue right because who who's not
going to want to uh
all right so let's say we raised 10
million dollars right remember our cost
of Revenue is only one percent of that
so we're actually going to have 10
million time that's going to be a
billion in Revenue
right
now
you asked the question unfortunately
this company's not profitable we have a
plan to become profitable uh we will
raise the dollar price
uh
to a dollar in one cent right we'll just
raise the price a little bit and then
we'll be immensely uh will be a very
profitable company now of course first
we have to focus on but first growth
right first we have to focus on growing
this company right
um so unfortunately it's not going to be
quite a billion dollars in Revenue
because we have to put some money into
advertising to get the word out there
for the revenue company to tell people
what a good deal this is right we sell
dollars for 99 cents right and like what
VC would not back this company right
this company is going to have hyper
growth there's actually no limit to the
amount this company can scale the only
limiting factor on scaling this company
is investment
right
so uh I mean why would you not want to
invest in the revenue company right
think about it only a limiting factor to
grow through the revenue company is
getting more investment because you know
we do have a cost of goods sold it does
cost us a dollar to sell our 99 Goods so
we do lose a little bit of money but
that's okay because we're eventually
going to raise the price and we're going
to become profitable right so does the
revenue company make sense to you guys
does this seem like a brilliant idea
right
um okay so so hopefully you all think
the revenue company is brilliant and you
all want to invest but hopefully you can
apply the lessons learned from the
revenue company to to why waymo and
crews are not good businesses okay
um it's a bank I I don't even know but
it's it's this company makes a lot of
Revenue it's a great company and you
should invest
okay
uh cool
oh we definitely need a referral scheme
how did I not think of that oh man oh
that that's right we got we got to raise
revenue okay
um so unlike in the self-driving car
space where I was competing against
idiots uh the people who write machine
learning Frameworks are actually quite
smart um the pycharge people are very
smart uh the most of the people who work
at meta are very smart
um
so
and the sometimes in car people it's not
that like every individual who worked
works at waymo and cruise is done it's
at the whole idea is just dumb right
like like it's like nobody thought it
through Beyond you know never mind
um
yeah you know who sells dollars for 99
cents the fed that's right I mean you
like the revenue company right it's a
good company now like
um
think about it what if you have to pick
up your dollars later
what if we had a delay between when you
give us the 99 Cents and when you can
pick up your dollar
right like it's it's like it's like
shipping right
think about it
you work at meta not smart Hey look
pytorch seems pretty it seems like
there's pretty smart people eating pie
George but the the problem is they're
like
you know not managing complexity how
tiny Grant manages complexity
one way to write a machine learning
framework and you see almost all the
machine learning Frameworks doing this
is to just Implement every app
um but you don't want to do this because
there's lots and lots and lots of Ops so
for example I wrote conf transpose in
time to grad yesterday
this is calm transpose 2D
it just calls into conf
now you'd never actually do this in
pytorch because this flip here these
permutes and flips would cost you
uh you'd have to make copies
but in time you grad you don't have to
make copies in tiny grad this goes all
the way through and in fact the conv is
not even a native op this pool which you
go down to pool this is all just memory
Ops uh all just movement Ops which are
zero cost in in tiny grab which is the
shape tracker um by the way we did write
up a nice tutorial here I'm sitting here
in tutorial and realizing there's not
really anything better than like what I
already wrote up
um in abstractions
uh
so yeah you can look at what the
convolution actually is and all the
convolution actually is is a multiply
and then a sum
you reshape the the input answer the
weight tensor to exactly the right shape
multiply them together and then sum them
uh you know so yeah you know the tiny
Corps is very different from the
self-driving car space in that we are
competing actually against more people
uh smart people with good ideas
but I think where we can win is in
developer experience and not developer
experience using the thing okay so it's
very easy to use uh pytorch right it's
very easy to use Jax to easy to use
tensorflow but it's really hard to
develop on those libraries
the slowness has nothing to do with yeah
python we're we're launching on
accelerators so there's nothing yeah
there's nothing slow
um
tiny grad is a jet you can use the Jet
and then like all the jet really is here
you can see the jit calls are actually
uh
uh well first we got to replace the
inputs
um
yeah this is the J calls here so you see
that we just call the actual raw CL
kernels
and you can replace this with Cuda graph
you can replace this with need you can
replace this with anything like if
you're spending milliseconds on your GPU
the python overhead doesn't matter uh
when you're using the jet when you're
not using the jet the python overhead
matters
um there's a guy working on making it
faster
500 Bounty locked to him uh for making
the Llama python code without the jet
under 100 milliseconds
I don't know what else to show off in a
tutorial right this isn't really like
um
this isn't really like uh like like
Triton I think Triton has really nice
tutorials
well I'll show you guys a convolution
uh so conf is the same we could do like
let's do like a 1 to 16 with a three by
three kernel called C uh let's create a
random tensor
ah say like make it like image not sized
now let me get this place before so I
can do see some image
um now we actually want to realize that
first we're going to create the two
things
this creates the weight uh
this creates the bias
and then that's the image
that's the convolution
uh so these are global
uh dimensions
and you can see why this is the global
Dimension right so the output size is
16. uh and 64 by 64. so it's not padded
so we have 62 by 62 is the output this
four is um
so you see that there's also a four here
these two fours together
uh make 16. this form means that it's
um
you can better see it in the uh in the
code
this is the code that's actually
generated for that convolution
um this different steps that it goes
through so this is the output of What's
called the linearizer
uh the linearizer takes
so these are the buffers that are going
into the convolution this is the image
this is the weight this is the biases
uh and this is the output
so these views are the whole trick like
it's it the convolution is just
basically looking at the input and
output shape in a in a good way this is
this is actually a good example uh so
this is the
um
uh yes we load
the image we load the weights
multiply accumulate
uh this is where we add the bias at the
end and then we store the output so that
four that I was talking about this 4
here
this four comes from the fact that
there's four uh stores at the end here
it means that each kernel is Computing
four at once
um this three means that we've done a
reduce on the loop
uh three wide so you see that each one
of these this is actually three fetches
so the inner loop is just unrolled and
then these this is a four and this is a
three these are the reduced Dimensions
red is reduce
um purple is unrolled and yellow is uh
the the output
so that's the the code that's actually
generated
um see if it summarizes that shape
pretty nicely and that's how long it
takes okay so now like I can do
something like say padding equals one on
the column
uh so this is a padded convolution
um you see that there's a bit of
complexity added here now so these have
to check for the validity
uh of each thing somewhere of zero thank
you for gifting Subs
um you'll see that it also decides to uh
unroll two Dimensions now because 64 is
a multiple of four
um so so this means that the output size
is a four by four chunk uh and it's
capable of using 404 for for all those
things
all the ALU Ops
and yeah
400 gigaflops for a very tiny
convolution
let's make the convolution have strive
stride
uh you see that the output size changes
and this is just how the optimizer
decides to do it so right now the
optimizer is a set of hard-coded rules
in linearizer
um I wrote these rules to make the open
pilot convolutions fast
so this is this is the it's called
hand-coded optimizations but eventually
we can replace this and we'll replace it
pretty soon with search and like really
smart ml search
okay we'll disable subscriber only chat
and we'll take we'll take tiny grad
related questions
um for Mojo I'll talk about Mojo once
it's open source uh on while it's not
open source it's just not that
interesting uh I can make anything fast
if
uh the server is hidden
we don't have an inop style API I'm very
interested in that
I put a 200 Bounty
um on finishing this up so in order to
do uh inops you have to have uh Zero
Dimensional tensors so like when I do
something
like
um if I do like tensor sub six
uh you can't create a tensor from sex
I have to do an array
and this has a dimension of one but I
want to support tensors that are just
like this and then they're they're
tensors without shape their tensors with
zero dimensional shape
um yo I love when the haters start
talking about uh the cardinality of
infinity by the way guys just so you
know the cardinality of the real numbers
and the cardinality the integers is the
same and uh like anyone who thinks
differently is is as a math and you know
it's just like where are these numbers
man
oh but there's like infinite there's
uncountable Infinity real numbers yeah
you know what all the integer sentences
are countable
all the English sentences every sentence
is countable right every computer
program is countable so you're telling
me there's these numbers out there that
not only is it not a computer program
that can compute them and that's fine
you have numbers like chains constant
that's that's a number that's great
because there's a word for chains
constant you have all these numbers that
are undescribable right because all the
descriptions can be put in a one-to-one
correspondence with the integers so
you're telling me that there's an
uncountable Infinity of
um
the rationals are countable and dense in
the reals uh though the rationals are
countable I don't even think that's
controversial are they dense in the
reals that one I don't know about I'll
have to think more about that
um I do not believe that the real
numbers are recursively innumerable
there exists infinite reels the zero and
one yes I know but there also exists
infinite numbers greater than a thousand
right like
here
your juices here
you got the wrong one
okay okay okay
the Axiom of choice is a live Push by
good math absolutely
I mean you shouldn't even need an axiom
of choice because uncountable Infinities
aren't real and nobody doubts that you
can choose stuff from accountable sets
how did you guys derail me
all right guys I'm a constructivist
I'm I'm I'm I'm I'm open-minded on the
law of the excluded middle and when you
whether you can use it or not
um okay so that's a convolution
oh the other thing I like to show off is
my Matrix multiply
insert cell above
insert cell above
shift
oh that was cool I like that that's a
nice shortcut key
how do you become good at cotting bro
you play COD a lot
wow
so let's make some tenses
now if we want to multiply them we can
do that and that just works
but
there's another way to do that
and
I want you to think about a cube right
so here's a cube
um the complexity of matrix
multiplication is n cubed because it's
cubed right so I can take my two my two
tensors my a and my B right and then I
have like C equals equals a at B right
this is a this is B
C is like the top face of the cube right
so what we're going to do with a and b
is we're going to align these two
dimensions on this Cube we can expand
them and then we're going to multiply
them and then we're going to sum them
all right so let's actually write that
code
so if we want to align them
um
shape I think it's this
B we have to permute
and we can set a a times BB that sum
axis equals two let's see see all right
and now MP Dot
testing dot assert all close C dot gun
Pi CC Dot numpy
didn't work I think I have to flip these
there we go
so this
is equivalent to this
and they're the same speed they're both
getting about six teraflops
we'll make the inner dimension 512.
so if we want the inner Dimension to be
then the output Matrix should be uh
there you go
notice how it had to recompile it but
notice how it only had to compile it
once because the kernel generated for
that
is equivalent to the kernel generator
for that
um we can look what's actually generated
here so this is the Matrix multiply
um it's a four by four output space
we've also unrolled it four times so
it's using floats this is the generated
code
um and that's the thing 256 by 256
because those two are turning into fours
128 times 4 is 512 and that's what this
512 is so like these dimensions
these are a dimension and these are a
dimension
the kernel logs are beautiful
this is how tiny grad is going to win
hearts and Minds
this
I worked so hard on these colors
um yeah and it really like shows you
what things are doing
so like okay let's let's take a time to
grab example
um
so this one here runs uh imagenet
it runs an efficient Nat uh
zero
and you'll see that it like so it output
see it out puts hand there these are the
really old kind of grad examples but
we've kept them all working so you see
it looks at this and it's like oh it's
Gotta hat okay
um actually let's put it remember that
cat picture we generated before Let's uh
let's run it on that
oh it's a cowboy hat well it is a cat
and a hat that's true it focused on the
hat not the cat
let's try a bigger efficient mat and see
if it uh
see if it still thinks it's a it's a hat
or starts to look at the cat
if you don't remember the picture from
before
it's this
ah see now I think it's okay
so if I do num four it focuses on the
cat if I do numb zero it focuses on the
Hat
num zero is the default which just means
it loads an efficient MP zero
but um those are both obviously accurate
answers
uh and we can use debug equal to and we
can look at all the kernels that are
actually running uh to make that a
possibility
um Let me throw some upload go on there
so we can actually try to get some get
some speed out of this thing
um this is a tiny image now so you're
not really going to get a lot of speed
but you see that the time spent on the
GPU is only 1.84 milliseconds uh which
is really good
and then those are all the kernels that
are running
yeah so dot realize is going to
um like end all the laziness it's not
actually going to um like CL finish
it's only going to enqueue the stuff on
the GPU queue
so we're going to take a look at it with
num4 and you're gonna see it's going to
use a bunch more kernels
you know
so that's 226 kernels to run an M4 right
you have tests for the amount of kernels
and if you see that these are all ours
if they're all ours it's doing a good
job of a fusion
so ours are reduced kernels and E's are
element-wise kernels so element-wise
kernels means that the inputs and the
outputs have the same dimension
and ours I mean it's a reduced so it
shrinks in it
um yeah so we're getting we're getting
some decent and all these speeds are
pretty terrible let's go five
milliseconds for B4 you're not gonna be
upset with that
um of course it's actually slower than
that because it's spending a lot of time
compiling but you can put this in a jit
and then it's really fast
uh which just like because it runs the
same thing every time
okay
any more tiny grad questions I'm here to
answer your questions I'm here to be
friendly to noobs I'm not going to spaz
out on on self-driving car companies I'm
not gonna I'm not gonna go off and do
the Weeds about Infinities I'm here to
focus
and deliver good quality Noob content to
you the viewer because really it's all
about you it's all about you the viewer
without you the viewer I'd just be a guy
in my room talking to myself
but when I'm a guy talking to myself
with 500 people on the internet watching
this is more socially acceptable
what's the tiny ml scene
it's like it's like like do I like wear
like goth clothes or something
what are your plans for the future with
tiny grad well I'm going to delete the
repo and then I'm going to move to a
cave in Cambodia
um we have auto-tune stuff
the thing about autotune is like it's
just slow
um
it's just slow to run up local is some
Auto-Tune
uh
it did it actually does make it faster
this is this is an auto tuner the
autotune's like the last thing we'll
write
I also don't want to write a stupid auto
tune I want to write an ml based
autotune
but first like complete the whole of
Stack abstraction
no I didn't cancel my Netflix I watched
selling Sunset you guys ever watch
selling sunset
um
so like the real Transformer uh what was
Paris the first person to claim a bounty
um from the tiny Corp by the way uh a
bounty for the rnnt model
uh another working on the ml perf Burt
model
uh so yeah bird is a is a Transformer I
think the model is actually pretty
simple
does it use yep the promise you you
always end up just rewriting attention
like here look this is It's Rewritten
attention always there's so many
implementations of attention it's
because they all differ a tiny bit oh I
love below deck too
um add how do I add it uh to hugging
face
I don't know how to do that I love
hogging face how do I how do I add time
you crap
uh yeah it's possible to get the same
perf with a few Ops
foreign
you should join the Discord
um those Onyx tests that I showed off
are a great thing to just start fixing
um you should be able to have like a
pull request up in 15 minutes and fix
this one of them
how much of the AMD driver stack do I
need so I still need the kernel piece
the user space becomes very very simple
uh if I don't use that unfortunately the
kernel driver is buggy
if I'm emailing someone with AMD asking
for docs uh Intel has these incredible
docs I'm actually going to show them off
I'm actually going to show them off
because this is
this is my um this is my yeah AMD look I
like you
but
you know I found something even more
well documented than your chip
and it's the Intel chap
uh so you know
there's some chance
we're going to call an audible and
switch to Intel
um
ggml is targeting kind of a different
audience he's it's a lot of hand-coded
stuff to make things fast on a certain
uh architecture again one which is cool
no like Intel has these are the
registers
like you can get their registers from
their GPU it's this is awesome
and then also
they're so cheap
uh
they're they're three look at this
look at this
329 and it has the same I learned
yesterday they have this thing called
the xmx let's see if we can find it here
call it something else
um
I mean you have to hand it to Intel
there's a lot of Docs
uh that doesn't mean you can easily uh
find anything in all these Docs
but it's fully documented all their
registers are fully documented
oh that's not the 16gate one
I thought yeah yeah
I got one of these on eBay for for 330
with 16 gigs
and apparently they have more
fp16 flops so it's like they have like
um FP 32 uh flops for your teraflops no
no it's not it's not 40. they have like
20 but
it's eight to one for their Matrix
multiply so there's actually more
teraflops of fp16
on this 349 graphics card than there is
on the 7900 XTX so look
I like AMD and if they you know but the
drivers the driver's so bad
so okay this is this is this is my
prototype
computer down here
um let me make sure you guys can
actually see it well
see it
um this is my prototype Tiny Box down
here don't worry the Tiny Box will look
a lot nicer than this uh I can't put two
cards in it
when I try to put two graphics cards in
it it crashes
uh
like
check it out this one this one's still
in the back
because because I can't put it in
because the driver crashes
um
what do I really want to track this
garbage down like not really
so I bought one of these
um oh I don't doubt xylem software's
voice isn't xylax it's AMD it's insomnia
I bought one of these cards we'll try it
I might totally hate it
but
I do see a a 20 World in which we call
an audible
and just go all in on Intel
Intel
what's cue Laura
heard people mention this
oh but this is fine-tuned stuff
it's not training from scratch
um oh by the way there's like a new
Champion someone mentioned there's like
a new someone released like a 40 billion
model that's better than uh 65 billion
llama
the probability I will switch to Nvidia
is zero because one of the goals of the
timing Corp is fucking video
Falcon 40b yeah that's it
Apache too
is there any difference between this and
Apache too
with a series of modifications
commercially exploiting to make royalty
payments
I mean it's more open than la
or you have to pay of your profit yeah
I'm not opposed to that
500 tokens per second well 500 tokens
per second isn't possible
so
the basic way to compute how many tokens
per second is possible to take your
memory bandwidth so the memory bandwidth
of this card is 960 and divide it by the
number of weights
um
times the size of the weight so let's
say we're doing llama into eight uh on a
single
uh lava 7B and a on a single
7900 XTS the maximum tokens we could get
is 137 tokens per second
do I feel like I'm doing amd's work
um look
like
I'm not really that worried about that
right like I see the people on Twitter
George is asking for people to do free
work blah blah blah blah blah blah no
I'm asking you to
if you want write open source code right
I'm not doing free work I'm writing open
source code
how I choose to direct my efforts is my
choice
yeah um you know I I hope they I do hope
AMD does support me with a bit more
documentation ideally makes more
documentation open
um so AMD does have great documentation
on their instruction set
um the rdna3
uh PDF this is awesome but it doesn't go
into like the memory architecture of the
GPU it doesn't go into how the scheduler
works it doesn't talk about how like the
copy engine works
um
but you know it's it's pretty cool so
actually check out this document this
document is Well written too it's much
better written than the Intel stock
why isn't AMD doing it already well
what AMD looks like they do is they take
every Nvidia thing and they just make a
clone version of it
um and I don't think this is smart I
think if you do this you're always going
to be playing catch up
I don't know maybe it's what their
customers want
but
uh
like they have something called
what is it
um compute tile AMD kernel
I don't remember what it was
um but they just basically look like
like for each Nvidia thing they're like
okay write an AMD version of it
composable kernel that's it
uh so composable kernel is basically a
clone I look more into it it's a clone
of Cutlass
um
and like okay
it's not necessarily a bad idea but like
if you want a leapfrog Nvidia you can't
do it by
um
so for Consumer Hardware without a GPU
language models are in this interesting
place but you don't actually have any
flops all you need is memory bandwidth
so what are you talking about what what
consumer Hardware do you have
if you have a basic M1
um you can get seven tokens per second
at and then if you get it down to four
bit
you can get 14.
yeah just take your memory bandwidth and
gigabytes per second divide it by your
model parameters
uh
in billions
and then multiply it by however your D
whatever your d-type is
because that's bites
so if it's a byte you multiply it by one
so one of the specs I'm most happy about
with the Tiny Box is this
it has 5.76 terabytes per second of
rambammoth
all right this is a pretty this is a
pretty hard spec to compete with
um so this has more ramban within an
h100 uh remember an h100 is the price of
two tiny boxes
[Music]
and this is going to be your limiting
factor on uh
so
if you want to figure out let's say you
wanted to run 50 uh
40b falcon
and I assume it's in yeah so there's
about 80 gigs of Weights here so I
assume it's fp16 so we're going to do 40
times 2.
and we should be able to get 72 tokens
per second on Falcon 40b on the Tiny Box
probably about half that
what would I use instead of AMD epic AMD
epic has a lot of pcie lines and it's
cheap
I don't care about the memory channels I
care about pcie lines
novel llms one of these days should we
do a stream Everyone likes talking about
this I don't actually know if it's any
good
um but I know this hype around these
things
so we should uh probably write a tiny
Big Board of them
[Applause]
why don't you like Infinity fabric
you mean the way that they connect This
Is How They connect their little uh
their chiplets
but yeah that was basically it for
today's stream I just wanted to show off
a few tiny bad things
uh and I have some noobs be able to get
into it you guys saw what I wanted I
made my change that I wanted for debug
I write about Nerf I don't care how much
about I've looked into that I don't care
that much about that uh the the this
one's kind of interesting
and I'm
like I want to implement this to really
understand what it does
uh can I talk about how backends are
implemented in tiny grad yes
um so these are the back ends here
uh in runtime
so they're very short this is the
complete torch back end this is the
complete numpy back end
um GPU back end a little bit longer
so these back ends are like I call them
run times they're actually what will run
it on the device
um the interpreted ones all you need is
a runtime
for the compiled ones we also have code
gen so this is the code gen for llvm uh
this is the code gen for I call it C
style but it's like opencl clang Cuda
metal
uh and then this is the linearizer which
converts asts which are trees into lines
which can be turned into assembly
um
why isn't verification working in the
tiny grad Discord I have no idea I'm not
I'm probably a Discord problem
um
and then how does the jit work okay so
the jit you can just decorate things
with tinyjet tinyjit just captures
remember how we have these kernels
so uh we can do an example with the jet
uh let's let's do an example with the
chat
okay
so let's create a
let's create a 10 let's create a few 10
tensors right
so let's say we want to do something
like a plus b dot mean so we'll add the
mean of B to a right so how many kernels
is this going to be
um
so yeah this is actually just two
kernels these are Creations kernels
let's not do one let's do random
okay so there's two kernels here this is
the mean kernel and this is the ad
kernel because first we have to compute
the mean of B you can see the output
size is one and then we have to do the
add right so we can look at what this
actually is and of course it's random
garbage because you've ran that
now let's say I want to jip this right
so let's put this in a function
right now it has to look at a and b and
all that stuff and actually A and B are
inputs so let's put a b is enough that's
right
um right now is to look at this it has
to run this code every time uh it calls
function right and that's a look okay
what's it mean how do I do that okay
fetch that kernel blah blah blah blah
um or you can just from time tograd.jit
import tinyjit
and then I can decorate this with
tinyjet
that does the same thing the first time
does the same thing the second time but
on the third time you see that the jit
captured two kernels with two inputs
uh because there's two kernels inside of
here so capture two kernels and you can
see now they're purple and now uh yeah
we can actually look cancel
no no no no no no no no no no don't do
that
um
insert cell encrypt sales code cell buff
uh okay
so we can look inside here and we can
see what's actually cached
and you'll see that these are like AST
Runners this is a list of all the
functions
uh can you see the compiled code yeah so
if we look at one of them I think I can
do dots
uh
get the actual Runner and no it's not
that code
um let's look at an AST Runner
dot proc
yeah there's a code
so this is the code for the first thing
uh which you can see is just a reduce
it's a mean of a thing with 10 so it
just loads them all
add them all up
multiplies it by 0.1 and then outputs it
uh now we can look at the second one as
well
and the second one as well is just a
kernel to add them together
yeah it just reads the that it's
broadcasted there you go
this is good pie torch is too chunky
thank you
um
what else we got oh good I'm glad I show
off the jet that was pretty nice
you just got apple juice
what should I take a picture of it and
complain
apples aren't green what about green
apples
do you think they used red apples in
your green juice
oh you want leaves
and you've got fruit
very sorry
foreign
doxed
Where'd I get doxed bro
that I'm in San Diego yeah I live in San
Diego Bros
what do you mean unboxable
no you could dock me but if you show up
at my house and try to come in I'll
shoot you in the fucking face like
that's that's the real truth
castle doctrine boys castle doctor
um
um
well that's how you do it in America you
don't come in my house bro
people know it's got guns
I don't know why you think that
um this isn't San Francisco man
uh no that's why like you know
all right all right now now we're
getting real derailed now we're getting
real derailed
um what else we got
subscriber only do any subscribers have
any more questions for Tony Grant I
appreciate who asked the jit question
[Music]
636.50
691 people
oh transferring kernels to device
oh here I can so I can show you what
that looks like
um
shift this enter
oh no I gotta be in like there we go
matters where I click
so let's make a tensor big tensor
say something like okay so how big is
this tensor
how big is that
well so it's 16 million things times
four so it's 64 megabytes okay so we can
we can send it to CPU
this converts it to CPU we have to
realize that we actually wanted to go to
the CPU
um CPU to numpy is free
uh and we can put it back on the GPU
if we want but then it's got to copy it
back again
um do I have any debugging around copies
I'm not sure I do
I should add some debugging around
copies
probably want to add it here
and when I use debugging here I don't
use debugging here at all
and I shouldn't be messing with this now
um but we could just yeah
foreign
there you go it's kind of nice
so this is going to first copy it to the
GPU then it copies it to the CPU then it
copies it back to the GPU
uh how come
oh look at Pi torch tutorials we make
them simple and more tiny that actually
seems like a pretty smart idea
um you want to link to a good pie torch
tutorial
this is why I don't like Auto reload I
don't trust
him okay
thank you
so you'll see that when I do things like
tensor.ones this one's never actually
copied anywhere
oh it's the copies it copies a single
float to the GPU
should it actually do that
oh
because if it's constant folded it
shouldn't it doesn't actually copy it
I'm getting rid of Auto reload I don't
trust mono reload it keeps working
what's fashionist
what is fashion honest
oh they're fashion
the new ones that make people go wow
like DC gan
how fast is this train
foreign
should we do this tutorial
our running collab yeah
all right should we try DC Gan does that
sound fun
um one of the pie torch lighting guys
was very knowledgeable
uh
all right should we try DC again
we need
we need the Celeb a data set
and I can't do that
where do I get this file
oh it's huge
[Music]
[Music]
hmm that image folder that's pretty it's
pretty nice abstraction that's pretty
easy Bros
oh good thing I just implemented
comtranspose 2D
I don't have an nnn version of it though
oh do I need an nnn version of it
foreign
argument called transpose on here
it might be a nice that might be a more
tiny guy way to do it
first I should probably commit what I
have let me let me commit my uh
by the way if you're gonna commit to
Tiny grad if you install the pre-commit
hooks I'll just look up how to install
pre-commit hooks you'll see that it does
some nice uh
stuff for you oh everything changed we
gotta we gotta really do the my pie
again
wow wow tnh
leaky values
there's a lot of code guys
we prepared for DC game I don't know if
we're prepared oh good we
please be in it please be in a please be
in a uh
please be in a default folder it's very
impolite by the way if you're making a
zip file to not put it in a folder oh
good they put in a folder
oh
okay
cool
hope you like jpeg
foreign
in no time
well we don't really have
I'm gonna I'm gonna just add transpose
here
I don't know how I feel about that
Maybe
this is the same
in channels out channels kernel size
okay it's almost same
this works
if it's just those two lines fine it can
have it
um okay
so we're gonna make a generator uh
something to note about tiny grad is we
don't have uh you don't need anything
like NN module
um
so
we also don't have any nnn value let's
look at ngf what's ngf
size of feature maps in generator cool
uh what's NZ the size of Z latent Vector
okay that's cool cool story bro
uh and then and C is another chance
it was a nice tutorial
version of DC Game Face tutorial okay
um now we don't have any uh and then
relieve stuff so we can just say
self.state equals this and then instead
of NN relu you just write Lambda x x dot
value
or actually you can do even better and
just try to answer it out around you
and there's no reason you shouldn't be
able to do tensor.value because remember
there's no there's no state
um what is pi torch call them
it calls it main for some reason we'll
call it Master just to fuck with them
uh okay we need a call function
um X returns
okay okay there's our generator in tiny
grab
um
the tutorial only transfer five epochs
okay this is great
okay uh let's write a quick data loader
uh watch it we need our discriminator
first
um
I'm gonna spell it right
there
okay uh okay
yes we're gonna have to take from there
I like doing things like this one at a
time it's like a massively copying stuff
I don't understand
cool
um okay so leaky value I think we have
that one
[Music]
but here we're not going to be able to
write uh tensor leaky value we're going
to have to use Lambda so we just say
Lambda x uh x dot leaky l u zero one two
okay in place is stupid
and then for this one we can do 10
switch on Sigma
okay cool
uh and actually this is wrong we
actually want to do x dot uh sequential
uh something
okay
so you see the code is very similar to
Pi torch I actually think mine's a
little bit simpler
um don't create classes that don't have
state but it creates all the classes for
the ones that do have State uh hopefully
my comp transpose is right
really need to test
okay that runs
okay
deal with the weight in that layer
uh
net g equals generator net D equals
discriminator
all right recreate them both
um now we need a batched loader I wrote
a decent one I should just copy it but I
should really write these like we should
have
this stuff just built into tiny red it
is all very simple to write it's just
annoying to like copy it all the time if
we go on ML perf model eval I wrote this
revnet resnet
here it is this
um
we just need to write it
I'll call it celeb a iterates
uh
so we have important path lab
um
good examples here I don't believe my
speech uses that here
oh
this again
pathlet file parent slash data sets
slash
in there OS dot Lister
I'll say
Pebbles
always improv thanks in Python
a uh we want to load that image
one load images again
image load
peel import image
of pale and board image
although I have a cross process thing we
can use too image equals that and then
Wow Let's just print it
Forex and slide all right
yes I made the font bigger I actually
want people to follow along
nice guy right
uh
the dot parent
no okay
the whole size image is that
how big are these images supposed to be
image size
wow they're making them tiny okay
let's do that
damage that
resize synagogue
I moved the normalization of image nuts
somewhere else
foreign
okay now we want a batch them
I have all this code I just need to I
just need to like refactor this to like
be nice
thank you
foreign
Pollock's path has no attributes split
oh that's not right
um
hmm
how does this even work
cool doesn't even look right
cool
all right now I have to write a trainer
so these are mostly the same
um
wait they change the beta
I don't know how I feel about that
you just do n and that option
uh it's not parameters it's
um
and then dot Optum Dot
get parameters
yeah most important
and then here for atom it's B1 equals
beta one
cool
that's a crazy beta parameter I've never
seen that before
okay let's bring up the tiny grad
training Loop
we can look at it okay so
uh we don't zero the grad on the net we
zero the ground like optimizer
so zero grab there
um
training with all real batch
oh I didn't normalize it did I
we'll deal with that later uh
torch full B size what's real label
that's just ones that's just confusing
so we run this
put equals net D this
um Criterion
where's Criterion
this is our loss function okay BCE loss
do I have that
I don't think I do
I have like log soft Max but I don't
have BCE loss
there's again example I wonder what they
did for it
loss real
that's all they did
if it's just not mean I don't know like
that doesn't really seem right
but yeah I guess I could just do this
although this MN scan is right
you have some real thoughts about this
okay let's let's write the right loss
function
um
okay
so what are why and
Imagine X is the input and Y is the real
ground truth
so if Y is
we just do log of x
I think I just Dot Lock
all right and then for the fake one I'll
do log one minus
to the generator one
all right
that looks nicer I think
uh okay where's my package tutorial go
we'll load it for the 17th time
this is what I mean like you can hide so
much things that are actually just like
it's just log
you know
all right so we do backwards now we do
the fake batch okay
it was all fake noise equals tensor that
Rand and
uh that
I'm streaming
I lied about being done soon but yes I'd
love to go to moniker but later
uh oh we have our bash size why is this
not a parameter up here
and I see what they want me to do we'll
just do extra shapes yeah
okay we run that
uh
weird stuff
just do that
uh we probably want to get our d
so I have no idea if any of this is
gonna work I haven't I've tested
training kind of very little I've done
mostly inference so far
so if this fails you know don't don't
don't don't say Titan Go it's terrible
guys
don't we love tiny grad
um
all right
then we want to do a step
shorter my code is in the pie torsion
code the difference is my code doesn't
work
um
okay
uh Optimizer g dot zero grab
um
you know what the review is but
discriminator on noise
uh
label we use the real label here so it's
this
uh
energy
uh okay Optimizer G step
actually just like this
print
Rd real dot numpy
fake Tottenham pi and
uh
all right cool
doesn't work
uh oh
have to normalize this too
so we'll just do something like
um cannot create tensor from this shit
why not
oh well that shouldn't be a tense I
don't need tensor there
um and what's X
if that's not right what did I do
should be fake
and this is already a tensor so get rid
of that
to here
uh input tensor shape does not match the
shape of the weights
where
I'm trying to Run net D image here
uh
I'm trying to write a d That's not even
using that's not even use weird stuff
is three
oh just got to be permuted
all this in my
okay now we're on to Net G is a problem
uh does not match the shape of the
weight it's 5 12 versus 100. oh this is
because
yeah
um
um we gotta flip them
foreign
oh no
he uses a stride
well that's tragic the one thing I don't
support
oh we we should make this work
[Music]
all right let's uh debug a little
is it running
there you go
all right we're training something it
takes a while because it's got to
compile it the first time
tencer has no attributes CTX what
wow that's a deep bug
um
interesting
yeah let's say
okay so the problem
uh I think I have to do fake dot detach
and I don't know why the uh
why didn't the pie church one have to do
that
T dot grad is not none
oh
l
how is this supposed to work
yeah okay this doesn't really work
let's try that
okay I think it's training
see what kind of speed we're getting
I didn't print the graph graph equals
one
well guys tranny
[Music]
um
oh I think I have to put the detach here
and then I don't have to do it
oh and where'd my zero grad go
and that stays
okay
there
I'll put these both here
shouldn't matter
and then here I put fake
also run that earlier
okay now we're only running it once
this is stupid I'm just gonna write our
d
yeah why would I not air D equals error
D real plus r d fake
our D dot backwards
Optimizer D dot step
that's gone
trained discriminator
train generator
also I'm gonna get rid of these logs I
think they actually might have had the
right ID in the other one
because it should output Logics right
I do have stupid 10 H's and sigma
weights I guess the only one that matter
here is the sigmoid
let's get rid of that signal right now
um okay
is it making pictures of celebrities
do they know things let's find out
um we should also throw this all in a
jet
the double back text where you see
double back ticks
yeah I know it's a lot simpler than the
torch tutorial
I just don't think it works yet
um let's let me add some timing stuff
I just copy and paste to this in the
choice tutorial I don't really know
I also don't know if my comp transpose
2D is right
[Music]
I don't know if my iterator is right uh
I don't know if anything's right
but yeah I mean in theory this should
all work
Alex wants to go get coffee
I'm very confident with Alex
I don't know I don't know if those like
losses are terrible let's see what the
pie torch one gives
yeah okay so they have different numbers
oh this kind of makes sense because they
used a different
I didn't put the stupid uh the 10h is
fine but you don't need that sigmoid
like logits are fine
um we should really test kind of
transpose 2D
which we did not
I'm also not sure that's actually
normalizing it correctly and it does
matter I think
because yeah it does hang on
let me think about this for a second
yeah it matters hang on
because they're using tanning
all right tan H goes from zero to one so
that's right
uh normalize
I don't know what any of that means
I did this in this one though I
struggled with this exact same thing
uh imagenet model eval here
I actually have an idea that I might
want to just divide it by 255.
now again I don't really think that
matters
yeah yeah I think that's all the same
oh that's gonna change anything
but yeah it'll keep me off the rails at
least
um
the losses and Gans don't really mean
anything
okay I want to look at an image
kind of annoying I don't really know how
to do that
are we gonna put this in a notebook
actually there's cute ways to kind of
just turn anything into a notebook maybe
we'll try that
I do it in abstractions
okay let's just say
Imports and constants
um
Imports constants
model definition
trainer
I'll try to sell
oh the name is main okay good
foreign
there we go that's pretty good
you need the absolute right hyper
parameters there we go I'll get this one
regenerated
very rich
uh no let's actually generate one
invalid shape
oh my strides are wrong
not even the right size boys
oh we done goofed
I'm gonna make the fucking strides work
oh we did a bad job we did a bad job
look it's wrong
[Music]
yeah anything that I do when I'm
overwhelmed I just scream
whoa how is it so simple well one
because it's using tiny grad and two
because it doesn't work
you can make really simple code that
doesn't work
sometimes people focus too much on
making code work and not making it look
beautiful
Bounty for strides
oh
if you fix both strides and padding well
then how quickly are you gonna do it
that's the problem
no but that's like not worth a bounty
like
yeah the penalties are more kind of like
they're not like like
they gotta kind of be chill like not
everything's gonna get paid and get a
bounty if you're not doing this because
it's fun don't do it
um
you know what
those drives are the wrong side I've
commented on all that stride garbage was
just wrong
um
this isn't theories right like there's
probably like a
five line change across time to Grant to
make this thing work
and then just a lot of compute
um I think we can make it faster with a
jet too people get greedy for bounties
yeah people are getting greedy I'm
getting rid of bounties okay
can only have bounties if you're nice
you know you want to have nice things
I'm doing minus five you think the
normalization should be that I'm not
sure it should be actually
I think what I did might be right
okay
so it's taking 300 milliseconds a step
let's see how much of that is actually
spent on the GPU
oh I can also do a little help with that
I can do global counters.reset
Global count is just like a cool library
that like helps you track things
so now I can see like my time on the GPU
okay so it's spending 167 milliseconds
on the GPU and that is slow as balls let
me do up local
okay the forward passes fast
now it's doing the backwards pass look
we've got him 20 teraflops in some of
these that's pretty good
odd logo will only be still the first
time too it'll be real fast the next
time
it says it to a file
yeah this is this is kind of mediocre
okay so we're spending 92 milliseconds
on the GPM I think it'll be faster this
time too
okay 117 milliseconds on the GPU
um let's keep up local get rid of debug
and see how fast it is
debug slows it down to quite a bit
because it has to do uh
okay 257 now let's create a function
called train step pass in image and
Noise
noise
uh we want to return fake
so I don't really care about that we'll
just do it but it doesn't really matter
after return that
okay uh now if you want you can do from
tinygrad Dot
jet import tinyjet and I can decorate
this with tinyjet
see how much faster that makes things
there you go it's pretty fast
um it's also wasting time in this we can
put that in another process and then
we'll be fast
uh where's my eval
model eval cross process
generate our object is not callable when
you actually call it we'll call it
okay yeah it's pretty fast
I have no idea if that's actually fast
how fast is torches
training training training
uh all right now how many bugs did I
write probably a lot
and that gets us down mostly I think
what well we can check the speed on the
GPU with debug Eagles too
so my actual time span on the GPU is 100
milliseconds
right and they're purple meaning they're
all jitted
uh how many flops is it total so we can
see we're doing 174
gigaflops
so our averages our average is three
teraflops
pretty good right
I don't know
I don't actually know if that's good I
have legitimately no idea
oh no that's just for that part I guess
there's a few more kernels too
is that fast
by the way this is training on an AMD
card
I think it'd be faster on a video card
but you know we don't use a video we use
AMD here
uh oh I remember I didn't fix the
strides yet oh I gotta fix the strides
oh
[Music]
um this tutorial notebook there's
nothing good in here is there and I'll
get rid of that
this Branch let me push this branch
that's actually really good
uh and we'll also check out DC gan
do people like Gans or Gans gonna
impress people
oh let's get all the pictures of Sam
Walton great dated curation is that what
you want to do on this stream
yawn
it's running
okay well this is just wrong
it's compiling
uh Auto setup remote yeah I don't really
like that I don't mind doing that
like I just I always do this just so I
can copy and paste it don't think about
it
but it's nice like it reminds me it
gives me like a warning
okay well if if one of your things is 64
by 64 and one of your things is
why are these things just stupidly big
I guess that's what I don't understand
which is like means like why are these
things so big
the numbers are so big
how's my discriminator and my generator
both doing this well
I don't know the losses are meeting with
some games we just have to look at the
pictures
foreign
okay guys
I'm gonna make you a deal
here's my deal
if somebody fixes strides and it's
pretty straightforward there's already a
test it's just commented out
uh by tomorrow I will stream and finish
the DC Gan tomorrow
uh if nobody fixes drives then I will
not finish the DC again
does that seem good
foreign
[Music]
yeah okay so the problem right now is at
least one problem right now
is that the output size from the
generator is different from the output
size from the discriminator and it's
because I'm not doing the chomping and
strides right
uh so you can see like what I did here
and it's just it's wrong
um this is also kind of ugly I really
shouldn't be permuting the weights I
should create a different weight
it might just be you might just want to
copy and paste this I don't know
am I interested in adding more linear
algebra basically what I want is a test
for com transpose 2D in the NN so add it
to test nn if you added here we have
tests for comp2d here I want this but
for conf2g transpose
um you're lucky that I added the
transpose that was just yesterday uh so
I want that for yeah transpose and I
want to touch it with strides um there
is a test I wrote the test but um
here it's just coming it out not
currently supported so you'll comment
that out you'll fix up the strides the
the I think that my code is actually
correct here I think that the problem is
just you have to shrink the output
tensor
I used a large font size for you guys
today you know look I'm really trying to
communicate the tiny grad
um yeah we have deaf eyes coughs just
definitely as common sap comps are just
like the open pilot model uses them
they're they're just normal comps
there's nothing special about them
um that's not a linear algebra though
that's already supported like we have
group strive dilation padding and it
works
uh
I don't think that time is that bad
actually
let me remove the global params reset
and we can see we're actually getting
uh Matrix decompositions and stuff again
if you can do these things okay so the
key the place where we draw the line in
tiny grad
um is on uh can you do bug equals one
and that works
is on things that aren't admal if
they're admal and don't require load
store then
um
I should output that with debug one too
uh
you hear it sounds like a train
one point
1.7 teraflops
um
and and 50 gigabytes per second
so no sorting no
uh no sorting no scatter gather you
don't need these things
um neural Nets don't eat that
yeah again yeah like linear algebra
stuff
they met with kind of what we have and
it's just some syntactic sugar in tensor
dot Pi I'm happy to add it
um if it requires new ml Ops and LL Ops
whoa that's a big deal uh so technicron
only has a few llops
uh these ones here
like sign just got added and that was a
big deal
thank you
but yeah all right so someone write that
transpose uh submit a nice pull request
make it nice you know some of you can
like work together and like collaborate
like make it nice don't just do the bare
minimum why would you wear the bare
minimum of 15 pieces of flair guys
don't you want to express yourself
ah
tiny grad has a Discord but if you
cannot find it it's not for you
don't tell him how to find it don't tell
anyone how to find it
uh
I'm so happy after raising money for
tiny grad I hope that sarcasm bro
I got the money like I got the money sit
in a bank account I'm like fuck man how
do I deploy five million dollars you
know
George don't you think you should have
had a plan before you raised money yeah
you know but I'm not Sam bankman freed I
don't know how to deploy large amounts
of capital I tried contacting the Miami
Heat but they wouldn't sell me the
naming rights to the arena after they
were burned last time
um
five yes that's gatekeeping we love
gatekeeping but fair honest gatekeeping
not gatekeeping where you have to know
not steganography man fuck steganography
problems gatekeeping that requires like
a little bit of yeah
um
yeah we might get a house on the way I
don't know we're looking I think it's
gonna be a house office
um I can't show you I have a prototype
Tiny Box over here but I can't show you
the tiny box yet
uh the Tiny Box is is a secret
uh but the Tiny Box is looking very you
guys are going to be so happy if you buy
a tiny box
um oh we sell tiny boxes the tiny Corp
sells tiny boxes
um you can buy them at our website
tinygrad.org uh you can pre-orders
they're fifteen thousand dollars
um yeah
not Bobby Fisher guys I'm not gonna move
to Iceland and rant about how the Jews
did 911. uh respect Bobby Fischer but I
think that really did happen
um
who leaked the server stop leaking
why am I limiting my hiring pool you
know what I changed the blog posts I
changed the blog post you know I wrote
this in the Discord if you're in the
Discord you'd know I changed my blog
post first off the only way you're
actually going to get hired at the tiny
Corp is if you've submitted pull
requests for like a month
right like I'm in no rush to hire I know
I have to spend my five million dollars
but I'm sure I could buy the naming
rights to the Denver Nuggets
it can't be too expensive I'm gonna get
on a plane to Colorado we're going to
have to chart our jet of course and I
only fly Gulf Stream and I fly in a King
Air I got a charter golf stream we're
gonna go to Denver and we're gonna spend
tiny Corps money and buy the naming
rights to the Denver Nuggets Stadium
um whoa the WNBA whoa whoa whoa we
raised more money than that whoa
it's a tick tock where it was like yo uh
do you want these WNBA tickets or uh
this dollar
um
the nuggets are winning I know enough I
know yeah I'm gonna have to go to the
Timberwolves they're not winning are
they
[Laughter]
um
uh
but yeah so there's only one way to get
hired at the tiny Corp and that's by
submitting high quality pull requests to
Tiny Grant I got way too many bad
submissions for the programming
challenge like why the fuck are you even
trying bro like this is not like a
company with like 20 people in an HR
department it's like me and if I look at
your shit and decided shit like
I'm gonna hire you you're not like it's
not you know what I have a friend who
always talks to me about like I you know
I'll come up with like some like clever
hack around the law well you know
technically there's no rule against
keeping a live squirrel in your locker
yeah it doesn't matter it doesn't matter
man you're still getting detention you
can't keep a squirrel here it doesn't
matter if there's a rule like that's
what I mean like you're a well actually
you're a well actually middle curver
technically the income tax is
unconstitutional exactly the well
actually people the well actually people
who try to do that like don't pay your
taxes and see what happens bro see what
happens let me tell you their guns are
bigger than yours like Joe Biden said
they have f-16s and nuclear missiles
um do I do Europe promote contract based
again
oh my fucking god like it's like you're
asking me a question like this it's like
bro I have five million dollars if you
can legitimately help me spend my five
million dollars in a very frugal manner
because I'm actually very frugal and was
kidding about the Gulf Stream we're
gonna have to drive at a Toyota Corolla
powered by open pilot where we get free
gas sponsored by shell because we put
the Shell logo on the side of our Toyota
Corolla
um that's the real budget of the tiny
Corp okay and if you can show me that
you can actually help me deploy this
Capital to to meet the tiny corp's goal
of getting AMD on ML perf using the tiny
grad framework then I will pay you money
right
like you know this is something I'm
gonna talk about Twitter for a second
this is something like like just just
being around that whole thing like
showed me it's like man if I think I'm
frustrated how do you think Elon feels
man
[Laughter]
um
what about the 20 Intel chance you know
look we got to keep in telling our back
pocket right we've got to keep him
telling her back pocket who knows who
knows man might let me borrow the
company Gulf Stream to go to the gym to
Denver
um
can I sponsor someone's Visa like bro if
you convince me you're gonna create
enough value I'll pay for the lawyer
what you want me to sponsor it legally
sure whatever man you know I'll make you
I'll make you the intern of getting
visas and then you're the intern of
getting visas and you can get yourself a
Visa uh
uh like you know look America's
immigration policy really pisses me off
but like what you want me to email back
and forth with the lawyer like bro this
is the whole fucking tiny Corp okay it's
me
if there's a problem it's me
um
that's right
uh
uh I did buy a Rolls-Royce guys I did
buy a Rolls Royce unfortunately it was
not with the profits from cheap eat
because despite what the hackers haters
think I actually lost about five
thousand dollars on Cheap Eats paying
the digital ocean bill
uh
I got a good price on a Rolls-Royce I'm
actually very happy with it I love this
car
um I just like every time I get it and
I'm just happy uh it's so quiet on the
highway it's just it's just they
designed it like the only thing that's
disappointing about it is I didn't buy a
new one because you know I'm cheap
um so uh if you get a used one and the
electronics are 10 years old and like
yes they were the best electronics you
could buy 10 years ago but they don't
have carplay
um
yeah you can only put one GPU on a
computer at a time because the drivers
don't support too
uh
uh you run a Lambo nice bro
no the Rolls-Royce has hydraulic power
steering and therefore it doesn't
support our pot it also has Flex right
but it does adapt to cruise control
um okay
yeah so I will finish this tomorrow if
somebody contributes and writes strides
and you'll be the hero of the stream
you'll be the hero of the stream I'll
make sure to reference your name at
least four times or you can post in the
pull request please don't reference my
name and I won't
um so yeah and then we will finish the
DC game tomorrow but for now we're gonna
take Alex I'm gonna go to coffee
uh
let's see I was a lot of streaming or we
should we should raid
um
my uh
you guys could check out lilacs actually
I put a lot of likes of stream on a
couple days ago so it was pretty nice
uh nope she's not she's not streaming
she streamed five hours ago though
um
oh oh you just rated me I was just wow
that was that was wow we were both gonna
stop streaming at the same time
um actually I watch your stream I
actually enjoyed it uh you know it makes
me wanna I tried game development in one
stream once and I was really bad at it
um
who's telling him wow wow you know you
guys are gonna you guys are gonna watch
the replay I'm gonna look dumb all right
we gotta stream a little bit more then
um
yeah let's see let's see I I tried what
did I try I used I used Unity uh and I
had my that's when I had my Razer laptop
you guys remember my Razer laptop
um let's try another tutorial
oh yo yo no I got Alex Alex is like
George I want to go to coffee
um maybe a brief overview of the tiny
Corps for newcomers okay that sounds
good
um so I started a company
um it's called the tiny Corp uh this is
the blog post announcing our raised we
raised 5.1 million dollars uh five
million dollars from investors and point
one from me
uh
the Italian Corp is a computer company
we sell computers for more than they
cost to make and uh you say well it
doesn't every computer company do that
and the answer is all the successful
ones do I have the failed ones sell
computers for less than they cost to
make and that's like the revenue company
uh not a good not a good company
um
so yeah uh in the limited to chip
company but there's a lot of
intermediates uh along the way
uh
the
human brain has about 20 beta flops of
compute uh you can get that number by
taking the 100 trillion neurons uh 100
trillion synapses which are kind of like
flops and multiplying by 200 Hertz which
is like the fastest they can run and I
don't know again it's a rough number
it's probably not off by too many orders
of magnitude it's not perfect but I
would believe that 20 beta flops is is a
human brain it also like it like
intuitively makes sense
um when you've started to play with
models of different sizes where you
think like human scale might be
uh
so
um
yeah the also the language models
actually are using way too little
compute and that's kind of interesting
like
the language models have tons of weight
but use very little compute
and they're like they shouldn't but
whatever
um
we can we can get to that later
uh
uh what am I trying to think about
something shouldn't that be
no the attention is okay nevermind
um okay with the way AI is going we risk
large entities controlling the majority
of the compute in the world I do not
want to live in a world where there is a
World Market for five computers this was
you know this quote
this is this is a famous quote by um
Watson the Watson of IBM
in 1943 Thomas Watson chairman of IBM
said I think there's a World Market for
maybe five computers
um
thank you
so like this was obviously absurd it's
absurd to a lot of people but then you
start to think about it again and now we
do kind of have five computers so I have
Google we have Azure uh Apple probably
has a computer
uh Google has a computer I said Google
Amazon has a computer
um yeah so I don't want to live in this
world so we got to figure out how to
make sure lots and lots of people can
get chips and lots and lots of places
um I believe Elie iskowski called for
shooting missiles at data centers and
the answer is we have to put a data
center in everybody's house and that's
the you know that's the only way forward
to make sure that AI is never given over
to the safety people right and it's not
you know and I'm gonna talk all right
all right you got me I'll talk about AI
safety for a minute okay you know what
the most absolutely horrifying outcome
of AIS
if open AI is the only one building a
single unipolar AI this is terrifying
these people
talk about AI safety and then they're
just like it's like Trump level of
stupidity it's like AI is dangerous I
alone can make it safe no no this is
terrifying uh the world I would much
prefer to live in right like you're not
going to get rid of all the guns right
so now you can ask the question do you
want only the government to have guns or
do you want everyone to have guns and
amen everyone should have guns kind of
person right and airlines are even
better than guns right guns are just
kind of like yeah you know what are you
gonna do shoot somebody like kind of
sucks but AI you can do so many things
with so I want everybody to have an AI
and this is the only way forward today I
safety really all right you're not gonna
stop AI the last thing you want is a few
unaligned entities it's not a question
of aligning the AI it's a question of
aligning The Entity with you do you
really believe open Ai and Sam Altman
are aligned with you bro think about
that you know who I trust is aligned
with me my GPU said right here in his
box this GPU is lying with me you know
why it's aligned with me because I
fucking own it that's right that's right
you know gpus are not aligned with you
the Azure gpus and the Amazon gpus and
the Tesla gpus there maybe they're a
little aligned with you you know you can
decide that but this GPU is aligned with
me because I'm holding it okay all right
there's your AI one
but George you don't know what the AI is
going to do yeah yeah you're right I
don't but at least
I'm trying to make an AI That's aligned
with me you guys are trying to Monopoly
you you guys are trying to build the
absolute unipolar paper Clipper that you
tell us we should fear right
like like is there any difference
between only I should have ai but you
should trust me to not know you know
what you know what's a good defense
against a paper clipping AI me having an
AI saying no I'm not going to be a paper
clip and I'm going to fight you with AI
right like so this is the only way
forward right the only way forward is to
get AI out to as many people uh as
possible as quickly as possible think
about it think about it right
look at the cows right have you seen a
cow Farm
right you don't want to end up like the
Cavs right
like bro you really don't want to end up
like the cast right like like this this
does not do you I don't want to be that
right that cow Farm actually looks
decent I've seen way worse looking cow
Farms right or God forbid a chicken farm
you guys ever seen a chicken farm like
trigger warning uh like yeah you don't
want to end up like that okay that's not
what you want to end up like all right
all right that's not what you want to
end up like so if some of those chickens
had had IQ 150 they wouldn't have ended
up like that right but the reason it
ended up like that is because we're all
smart and the chickens are all dumb
right so if you don't want to end up
like a chicken you better start figuring
out how to get AI and get it yourself
right because otherwise you know you're
gonna be like like like why is it why is
it that probably the 10 people who work
that chicken farm get to dominate all
the chickens like that and the answer is
those people have a lot more
intelligence than the chickens
right so you don't want single
organizations getting all the
intelligence you want to make sure that
you have some intelligence too so you
don't end up like the chickens does this
make sense
all right
um it's not that hard and like you're
not gonna die it's okay but make sure
that you're not Outsourcing your AI to
somebody else because if you're doing
that you're gonna end up like chickens
right that's only that's that's AI
safety right
right oh well what are we gonna do about
gun safety well we're only gonna give
them to the government oh shit man oh
shit see that's how you get tyranny
right right that's how you get tyranny
when the government fears the people you
have Liberty when the people here in
government you have tyranny man you know
when Sam Altman is the only one with AIS
and just posing proposing to the
government that they should not let
other people get ai's because I alone
can be trusted that's when we have a
problem but if we as long as as long as
like we can avoid monopolies on compute
I really mean this like this is my
actual take on AI safety AI is
potentially dangerous AI is potentially
very dangerous
um but the most dangerous okay
ugh
you should just throw it right away or
this we're gonna stop right you can't
stop technology you will never ever stop
technology
this won't happen this is this is in
fact the only way to stop technology is
with utter and complete tiering right so
let's just rule out anything like that
right away right hopefully we're on the
same page about that okay now you have
two other options right either we can
keep the technology controlled such that
only a few people have it and or we can
give the technology to everybody
now keeping the technology controlled is
not a bad idea for something like
nuclear weapons right
um the thing about nuclear weapons is
they can't be used tactically and this
is a huge Advantage like thank God for
this right if nuclear weapons could be
used tactically the United States would
have dominated the world in the early
50s right we just would have taken over
the whole world and that would have been
it
um but you can't really use a nuclear
weapon tactically and because you can't
really use a nuclear weapon tactically
this okay we really don't want everybody
having a nuke I'm not advocating I'm not
advocating for that because there's
nothing you can really do with a nuke
also nukes are not defenses against
nukes right if I have a nuke and you're
nuking it doesn't matter it doesn't help
it doesn't help to have one of your own
maybe in some psychological War Games
mutually sure destruction kind of way
but uh no you you can't and uh we're
gonna we're gonna make that that thing
bigger because I'm talking all right
cool
um
so you know what the defense is against
AI do you know what the defense for
those chickens would be let's look at
the chickens again because really you do
not want to end up like the chickens
right chicken farms right
if some of those chickens were smart
if some of those chickens had
intelligence they could fight back
against this guy
right I'm sorry to pick on this guy I
know you're just doing your job man but
like you know like what does this guy
have over the chickens right
and you think oh the guy's bigger that's
not really the problem the problem is
chickens are stupid right so this is the
world where you know open AI has the AI
and everybody else is just plebs
connecting to their API right right not
a good world
oh you can't see the photo oh I'm sorry
now you see the guy there he is
there's the guy
there's the guy right right it's not the
world we want to live in
all right let's look at another world
all right
um
[Music]
see how both sides have Spears and flags
and stuff
I'd much rather live in this world
than live in this world right
all right all right
so there's no going back there's no
getting rid of the technology the only
thing you can choose is do you want to
live in a world where you have a fair
fight or do you want to live in a world
where you're the chicken right that's it
that's it
um no you just you're just gonna make
it as long as as long as it stays as
long as basically like if one
organization or a few organizations a
few colluding organizations get all the
AI we're fucked we are we are we are
fucked beyond belief guys but as long as
like if like 10 of the people in the
world can all gang up and have more
compute power and more intelligence than
the large organizations it's fine right
that's actually going to determine
whether the future turns into Liberty or
tyranny tyranny also doesn't last
forever so like it's not all doom and
gloom even if you're in the chicken
world right like it's bad for the
chickens now but eventually when all the
humans kill themselves with AI things
look pretty good again for the chickens
so I'm just saying
uh you know tyranny doesn't last forever
so you know even even if we do live in a
better world it's not forever but you
know short term what what can we do and
the answer is to get everybody in there
you want to go get coffee
okay we'll go in a little bit I'm
telling them about how not to be a
chicken
you want to look at the chicken picture
look at that I'm on stream and then
we'll go we just we just got to tell
them that this is what happens if we
live in a world where the only training
computers are owned by large
organizations online with your interests
you need to fuck you don't want me
chicken exactly exactly no no no no come
on I'm not gonna I do really believe
this I'm not just using this as an ad to
sell computers
um but you know it's it's 1984 ad right
chicken
um
all right so yeah we raised money
because I don't want to live in a shitty
I don't wanna I don't want to be the
chicken man uh we gotta we gotta build
chicken chicken exoskeleton suits we
gotta fight back
uh
guys you will eat the bugs you will live
in the pond you will rent everything and
you will be happy no no you will buy a
tiny box don't rent it it's your Tiny
Box
um
hello I'm explaining to them that they
don't want to be chicken right this is
what happens in the world if one entity
has all the intelligence and the AI and
everybody else just has small human
brain
why does he rule the chickens
it's a rebel
and if you think that it's the chicken
size may I remind you about cow Farms
right people are like oh the chickens
are only owned because because have you
seen the size of a cow
if the cows were just a little bit
smarter just a little bit
all AI guys it's not it's not your size
they're way bigger than a human look
look
like bro
you're not that smart right
you don't you don't see cows you know
coming together and like making steel
and making I'm talking like if cows are
mad smart think about
it
oh my large stack of ones
um no but think about it you know I have
thought all right if the cows were like
imagine the cows were like 10x smarter
than humans like we'd be fucked this is
what
the cows the cows
it's actually it's not she makes sense
like they have this like no they have
this chronic misunderstanding of power
they just like bro like but don't worry
the cows aren't actually smarter than
you you could eat cows and they're never
gonna do shit about it because they're
dumb
yeah no they do what do they think they
think that like like
be honest wow they think that's gonna be
them yeah
yeah because they don't see themselves
as Alpha they see themselves as beta
wow it all makes
sense
um
no it doesn't have the food man nobody
foamed humans moved up slowly and we
came to dominate the cows all right so
look I just just all right all right um
so that's the tiny corrupt look it's not
actually a philosophical Crusade it's
actually a company writing some open
source machine learning software
you guys can contribute to it on GitHub
I went through a tutorial today it's a
pretty good stream
um
stop trying to look smart because my
glasses no it's because I have an
astigmatism and I don't want to talk
about it you guys guys you know you guys
can
this is nice or hard yeah
um yeah aren't we already in a cage a
big cage called Earth big cage called
this universe yeah and God put us here
do you know why God put us here because
God's smarter than us you know build the
AI we can go talk to him about it we can
negotiate a better deal it wouldn't even
have to come down to a fight if we got
smart chickens you know what I mean
they'd figure out you know oh wow no
that's that's an analogy that's not
appropriate for this stream but like you
know chickens will sell other chickens
into slavery right right like exactly
right you just make a deal with they had
chickens you have a bunch of oligarch
chickens
all works out right like if the chickens
were smarter they could just negotiate
it'd be fine but they're not smart and
that's why all the chickens are not
right
um is scale AI open source scale a is a
CIA oh scale AI look at it I don't know
how to tell you that I don't know how to
tell you this boys but whenever whenever
a startup is getting invited to the
White House it's a CIA they either look
I don't think okay CIA app but like if
you've never heard of them and they're
getting invited it's a CIA app okay
um
uh cool so yeah no we're writing an open
source machine learning framework and
we're trying to make AMD competitive
look guys it's a long game okay it's a
long it's a long War there's like lots
of moving pieces it's 40 chess game
right you know what I mean
so we build the frame where we empower
the other GPU companies our goal at the
tiny Corp is to commoditize the beta
block if you could walk into any CVS and
right next to the Wrigley's gum there's
pay to flops of compute
this works great and you know what
there's no gum King right there's nobody
out there like the gum is actually
decentralized man so we just need to
turn to make the pay to flop the same as
the gum right
like there's probably a few warehouses
and those warehouses are fine but if
everybody brought all their gum together
it'd be more than the warehouses that's
all you need that's all you need to not
end up in tyranny
um
I didn't say cows have a
misunderstanding power I said effective
altruists have a misunderstanding of
power
um yeah we're playing a long game guys
we're playing along game we're playing a
long game okay uh so we buy these gpus
and we make uh we make software that
makes these gpus work well and you guys
can contribute some GitHub right uh so
we like raised money to do this there's
a lot of ways to make money if we can
actually succeed at this uh read the
blog posts
um and you can also buy tiny boxes
uh which are lots of these in a box
which is actually like you think it's
easy to put lots of these in a box but
it's really not right like because these
are very big and they don't really make
boxes that big and you're like yeah but
I could buy a really big box yeah but
how are you going to connect this thing
all right you got to connect this thing
and the box is too big you know what I'm
saying all right you're gonna try it and
you can be like damn that's hard I'll
just buy a tiny box all right cool thank
you for watching today's stream if
someone writes stride I'll be back on
tomorrow to uh finish up DC Gan and I'd
love it if you all collaborated because
together we can stand strong and make
sure we do not end up with the new
chicken thank you all for watching
we're late
we're we're late
i said we would stream at nine o'clock
and it's
it's it's way after nine o'clock i went
on a big bender last night with with
meth and adderall and heroin
yeah yeah is that what you guys want so
you guys want
all right uh this is a stupid name we
should rename the stream hang on
we gotta we gotta we gotta do that we
gotta do that video producer one of
these days i'll learn how twitch works
oh good morning everyone
okay
uh wait we gotta change this name uh
tiny voice
um
can it hear me
is programming a category yet
no it's not
oh and now
tiny voice
can
it hear
me
good morning good morning everybody good
morning
we gotta
pop out chat hang on there we go pop out
perfect
all right
all right well boys i i i got i got news
uh
i already know that it can hear me
because i did it last night
uh hang on let's just check make sure
we're yeah we're streaming the right
thing all right so conf model with libre
speech the problem
was that i didn't uh
the epochs were longer so the learning
rate decay was different so you can see
that the learning rate decay was
different
uh and the fbx were longer because it
had more data so this model kind of
glitched out and did that
uh so i just retrained it with half the
data and had the normal learning rate
schedule and then we got ethereal
firefly
26 and let me show you ethereal firefly
uh 26
over here in lissa okay
who's got who's got something
oh we don't oh is it sub only chat
no it's not
all right all right
oh yeah is this return of the jedi
welcome back
oh yeah is this return of the jedi
welcome back
oh hang on
wait we just got to compute the male
spectrum for that
now we run that one
o
yeah
is this return of the jaw will go back
look at that
look at that
it recognized my speech voice
we're making great progress this
progress took phd's 17 years to do
so we're
we don't got jedi yet we got jaw
and then yeah yo tiny voice yo yo check
check check check check it so here's the
sound
oh yeah is this return of the jedi
welcome back
and then we got oc
his this return of the joy
will go back
all right
so i'll explain to you what we're doing
today first of all one of these days
we're going to understand what a
transformer is we've tried many times
and we have no idea
but
i was reading this paper last night
called conformer
it's a transformer but it's a con
conformer all right
so that's good uh we're making good
progress there that's good
the other thing
is we found some other bugs
uh it turns out that the male spectrum
we'll get to this but what we're going
to focus on today is making the model
train fast if we can make the model
train 10x faster
let's let's do the math on what 10x
would be we love 10x bro if you're
starting a startup you got to do 10x you
know
um
all right now of course none of this
tells me time
wait this actually doesn't tell me time
at all
this is totally useless
okay well
it's was doing about eight iterations
per second
and there were
461 iterations so if it's eight per
second
that's divided by eight so it's that
many seconds
times a hundred because we did a hundred
epochs so it was taking
one hour
oh no we're in oh we're in shitty python
oh it was taking 1.25 hours and one hour
in python 2.
uh so
if we make it 10x faster it's going to
go down to
7.5 minutes
so are we ready does everyone got these
their big rising hats on i got my coven
mask here i don't know why i have this i
don't want to
really
why is there a kobe mask on the
me aware of floor doctor's office
no it's all good it's all good we're
going to eat a yogurt
we got ciggies boys do you ever have a
cigarette yogurt
if you haven't you're missing out
and then we're going to
put our racing hats on and we're going
to make the code run fast
a racing hat
um
we don't have any more gpus we we only
have one
um the budget did not allow
not enough of you guys subscribed so we
could only afford 130 90.
i'm sorry but that's all the 30 90s we
have so we're gonna have to make it fast
with one gpu
okay let's first do a little bit of
refactoring here let's put the model in
a file called model
and then in the model file
oh man i wish we could listen to taylor
swift on stream but she'd be so upset
um
let's benchmark the model
oh we're gonna do something else to make
it faster too and i'll show you what
that is in a minute
use reduced ops
what are reduced ops
oh yeah we're using format strings all
stream if you guys catch me using a not
format string
uh be like george hey you promised only
format strings so we gotta do that
let's see if this is fast
char set is not defined
we have to import triceps
what's the tldr of the architecture okay
so it's running in 10 milliseconds
that seems like a pretty good amount of
milliseconds actually
oh this should actually be fired in a
thousand
which is one of the reasons it's gonna
take more milliseconds
um
so what's slow is it the loss function
that's slow
[Music]
let's also write the number per second
so we want to say
one divided by e t
uh it's
did i write that right
yeah that sounds right
oh
let's get rid of that
okay so it's running at 59 it's per
second that's a lot of hits
but now let's figure out what's slow
we don't need this penny 10 is plenty
let's see if we take out the group how
fast it is i want you this is the group
now
i actually have a 3080 and a 1080 in
this computer
wait
so the whole time is being wasted on the
group everything else is lickety-split
should we use transformers
i bet if we use transformers things will
be fast
[Music]
attention is all you need that's a good
point bro
okay look at how fast we can run it if
we only do that
all right let's not let's not get um
overly confident here
let's call this input
uh let's make something called target
equals torchback tensor
um
no i don't know target equals let's just
make it all zero zero times
the batch size is 32.
oh that's the other problem that's not
the batch size i'm training with
trading with 128
okay okay okay i'll look into the
megatron
we can also do some stuff to make sure
we're not getting down by uh
okay batch size let's
target length equals 100 what's what's y
y max is 250 let's make target length
200 let's make them all that
target length
of target length equals
target length times uh
batch size
and then we have input lengths also
input lengths
now we can copy in all the stuff
yes equals model input
loss
backwards for the optimizer in here
oh we need a learning right
not that it matters but oh when we need
ctc loss
tensor target
sure i'll say device coup to zero right
that would be nicer
to have cpu backend
um
why
got tensor with cuda back end i don't
understand
what did i not put on cuda
my inputs on cuda my guess is on google
we can check that
okay
for those that are new
we're building
text to speech
or sorry speech to text
so let's just do a recording of that
hello for those that are new we are
building speech to text
hello for those that are new we are
building speech to tech
and now let's process that one and see
what we get
hello for those that are
now
we are
building
speech to test that's pretty good right
uh no we're using libre speech which is
not entirely in that woman's voice
um so what we're trying to do now is
we're trying to make the model fast
like nascar nascar nascar you know fast
like a nascar nascar nascar like that
uh
all right i don't understand
those guess and target are both on cuda
ctc losses on cuda
the model's on cuda why is it
complaining
i think you can get up to date
device crew to zero
device coup to zero
i don't understand it's all on cuda
doesn't matter the order i do these
things in no that can't be real
expected tensor to have cpu back end
what am i doing wrong
oh god but if i do that i can't see good
no no
compromise size
okay this is on cuda this is on cuda
this is on cuda how does this not work
print everything inside forward and
check device okay i mean i am
that
be on cuda
we can also i think say see your cuda
visible device equals zero and i'll just
make it slightly faster
ctc loss has no attribute device
just copy that from there
i'm turning the cold down it's too cold
in here
it's a good temperature
it's too cold
okay i know the problem
and we need more coffee because without
more coffee
infused coffee
one of these days i'm going to buy a
drug test
and they're going to pee on it in front
of
them then they'll see that i test
positive for marijuana and nothing else
oh wait no but this is this is
ridiculous okay you know what let's read
the code boys let's read the code
return f dot ctc loss
okay are the problems that these
input lengths and target lengths aren't
tensors
i didn't think they were tensors here
either
they're not
they're just like numbers
yeah we're gonna put some flame stickers
on that wait what's the bug i really i
don't get it
hit me once okay let's throw torch
tensor on these
exactly
no
how does this one work and this one not
let's make sure this one still works
remove the device equals cuda zero and
do dot cuda for all of them
no it should do the exact same thing it
really shouldn't do anything different
well that's a different problem
don't do model equals model.cuda just oh
you might be right no wait what
no i did the same thing here
that works fine
your number one mistake is doing this in
pie torch instead of tiny bread bro you
might be right
that might be the whole problem
we're gonna fix this bug
we're gonna read the code and we're
gonna fix this block we're gonna be
intelligent about this
okay
dog probs
cdc lost runs on cuda i'm doing this
literally in this
thing
i don't understand
is my target the wrong size no it's the
same size as this
torch tensor target d type there that's
right
towards zero is that that's right
line 86 should not be cool to two what
do you mean my model's on cuda
my input's on cuda
my target's on kudo
i'm sure they're on the same cuda okay
you know what fine i'll get rid of these
device cuda zeros we'll just do this
but you know what's great about finding
bugs when you do find the bugs you learn
and that's what it's all about at the
end of the day
learning
okay let's get rid of the cudas
well i know that one doesn't work
input type float tensor and weight type
should be the same way
that's a different problem
zero grad guess equals that
oh you know what the problem could be
you know what it could be
for some reason this one could be using
the uh
i'm gonna do anything really stupid i'm
not on the wrong computer
it's possible that this one for some
reason is using the cu dnn
okay cuda zero torch float32 those are
the sizes
what
wait how did that just work
this is some bullshit it's because i
changed the input size to 900 if i
change this back to a thousand are you
going to tell me it doesn't work
this is an absolute joke
it depends on my input length what input
lengths are okay is 999 okay
oh come on this is come on guys
come on that's not a real bug that was
some bullshit
okay
lesson learned
don't make it a thousand
if you make it a thousand for some
reason it doesn't go on
there's all this junk in the torch
documentary yeah no no no no like look
at this it's not that
all
input lengths
must be t
oh
oh it is c-u-d-n-n
okay
the problem
i see
okay if i make all the input lengths t
then it's using the cudn
implementation
which might be faster
oh but that's crazy that that just like
sometimes uses cu dnn and sometimes
doesn't
oh i don't feel good about that boys
okay well either way we fixed it
we're getting 10 its per second
let's figure out how many of the its are
uh you know being spent in each place
should it have a flag to disable it
does it
does it do you see a flag to disable it
i don't
at least it's documented yeah but it
threw the most weird error
okay well this is good to know at least
we've solved the question so let's try
like a stupid guess let's try like uh
let's try a fake loss function
something like guess dot mean plus
target that mean
just so the graph's connected
and let's see how much slower that is so
let's see how
how much we're wasting the loss function
um
oh we don't need target
okay we're getting 10 it's per second
that's not too many yens
okay so it's not the loss function
that's good to know is it the groove
i'm a feeling a lot of it's the grew
so we can we can make the grew a good
bit faster by making the convolution
stride
still only 19.
all right should we get out should we
get out uh should we get our cuda graph
api
let's see if we make these a lot smaller
what happens let's say like c equals
eight
and uh h equals
i'm not sure it'll impact the quality
there's actually a chance it'll increase
the quality okay good so you see the
problem here and actually you know what
let's just try with batch size one
first off it's crazy that i made the net
smaller and that made it slower
all right batch size one actually is
faster
but we're still not getting our 10x that
we targeted
i could also make it depth-wise
separable yeah i could that's a good
point
but i don't think any of that's really
the problem
all right should we get a profiler
we should use a profiler
whenever you're trying to make things
fast
always use a profiler wait you tell me
if i do batch size 32 i can get oh okay
well wait if i do batch size 32 i can
get 60 hits per second which is pretty
good but not if i put the groove back
okay that's pretty good
all right i'm i'm pretty happy if we can
really get that 60th per second with
batch size 32
yeah i don't want to
yeah i understand that i can use that
flag to turn off all of cu dnn but i
like most of cu dnn
okay
let's um
let's change my pre-processing code up a
bit
so a few things about the pre-processing
code
i think we're gonna have to add a
character to our character set
we need
this character
a single quote
we changed the data so yeah we're not
using lj speech anymore we're using
libre text
uh
we don't need this
i think
okay
let's make one more called meta
um x
x dot shape zero y dot shape zero
oh the other thing that we're going to
try also
is we're going to
take the log 10 of these things
let's print out an example actually we
should do that in a notebook let's do
that in a notebook
oh where's my notebook test
where'd my graph go
fig size is not defined
okay
let's take a look at these values and
see if the values are same
yeah like minus threes and stuff
i don't think we need that 10 times that
makes it kind of big
see what the values look like without it
yeah that's not very good
okay
so we are going to do the transform into
log space
and then we're going to make this
float
16.
we'll make that u and eight
i'm just going to change it to libre and
we'll do sequences padded
wise
padded
metal
oh
yeah we actually want to change this to
we want to keep all the processing here
so we want to say e y equals from text y
and then we want to check the y's length
here
from text
lives in where
stir has no attribute shape okay well
because
wait it shouldn't be a stir oh we want e
y dot shape
but that's still not going to have that
so let's just do this
it definitely fits in a u and date
one more paren there
all right let's just try it with
something like this
make sure my thing works
expected tensor but got list
oh in pad sequence ah
yeah okay fine
torch dot tensor
uh type equals torch dot uh
d-type
okay good
now let's just take a look here python
import
torch
torch.load
data
library.pt
that's pretty good so we can say just x
y and meta
so we see x
we made it float 16 now it should be
fine
just because i'm sick of loading big
stuff into the gpu float 16 is obviously
half the size of float32
and it's a quarter of the size all right
so that's that
um then we can check metadot shape metal
doesn't have that but meta has the
actual length of each example okay
cool
let's uh let's refactor our code a
little bit
oh there's one other big change we have
to make
and this is in the mel spec transform
okay
so
we want something like um
[Music]
i was reading wave to vec facebook's
paper last night i was i was lying in
bed on my on my ipad
um
what
what did you say
no i was talking about how i was reading
wave to back
on my ipad smurf d thank you for gifting
subs that's what we're talking about
maybe we should make this place sub only
um you guys do know that look i'm not
looking
you know i'm just playing i'm mad rich i
don't actually need your sub money but
subs are better people than non-subs and
that's something that i believe deep
down in my heart
so you know that's that's the set
um oh yeah go for a raw wave form well
no no so i'm not worried about that yet
but what i'm interested in here
is
yeah
okay let's just say um
ms
per sample equals 10.
and then we can just take this
the number
of okay
so i think we say 1000 divided by
ms per sample
sample rate divided by 1000 divided by
ms per sample
um
part of the problem is we didn't come up
with we got to think in terms of time
okay so it's 160. so that's
our hop time previously was 256 so we're
actually going to end up with slightly
more data now unfortunately
and then we probably have to erase this
as well
but okay regardless
um
nfft equals top length times four
win length equals halfway times four and
hotline equals
hoblin
let's get hyped boys let's get hyped
okay
um
window length must be in and offload
okay well
it's an end
all right we're gonna have to raise this
this is now just a straight up number of
seconds
so it looks like we get a most of them
with 16 seconds
great
um
are all poor people bad people
i mean they're not bad people i just
think that you know rich people are
better and like i'm the kind of person
who's not uh you know
afraid to say things like that
uh
[Music]
but it's like it's true man
like and everyone kind of knows this and
i think that being honest is really
important
how can you say rich people are better
didn't your mother teach you manners
uh
well just like i'm just saying i'm just
saying like
if you were having a yacht party would
you invite poor people
[Music]
a lot of people before because they
don't know how to manage money look i'm
the first guy to agree with that and
like here's the thing about you know
hating on people who are poor like
it's not a fact about you man
like get out there stop being stupid
with money and we're not doing rants
anymore we're done with this we're done
with this we're your code
uh
okay this is taking too long should we
write something to make this go fast yes
we should
you know what you know what no no no no
no who was it that distracted me it was
not a subscriber and that's why you get
subscribers only
that's why you get subscribers only mode
that's right
because subscribers are better people
and you know who disagrees with that
non-subscribers so
um
you're getting dumber listening to me
oh
oh this is low brow content
oh
dunkin on poor people lowbrow all right
good point see i knew my mother
should've taught me manners my mother's
a lovely woman
um let's just drop a proc in here x
comma y
uh no no
we don't want x comma y we want x y
y equals x y
ah e x e y
that else isn't good
oh that's annoying
can we play twitch
alex
you're using the ipad
lmr pause thank you for gifting subs
um
tuple attribute has no oh
all right guys i'm sorry i'm writing bad
code this morning this is low quality
shit
not good
that's processing now we can change this
to a map
let's
get it
we actually want to do imap unordered
you oh we just always want to do imap
unordered
all right let's
make a pool
i don't know let's put 32 processes in
the pool all right 16 processors in the
pool all right good
um from multi-processing
uh tqdm
pool
[Music]
dot
unordered
we have a function called proc and we
have an iterable called dispatch
and then
we can say
uh for x y and meta in tpdm
okay that's pretty good right
oh we actually can also say we know the
length here
we're not a batch generation yet so this
is just pre-process
uh we're just pre-processing here
uh and here we can say
total
equals uh lane dispatch
i don't understand why we're still zero
there
let's replace this with a normal map
okay normal map works okay
jagger rsw thank you for subscribing
um
i don't get it are these just all
crashing for some reason
all right we launched them load example
that should be okay
okay they must be crashing
i don't know how bad is it to ignite
this every time
so i fix it
what doesn't work
why are we not seeing the word here
audio dot load okay let's just add more
prints
okay we are printing the sample rate
is the mel transform failing
okay the male transform doesn't work
um
does that work
i don't understand how that doesn't work
i get that it's forking but
what does the global keyword do
yeah okay so this is like crashing deep
in torch audio
how does this not work
is there like a way to handle these if
they
right pull that crash we'll print it
these are crashing and i don't know why
it's not throwing an exception i think
it's actually just killing the process
okay well so much for doing this fast
that works fine
why would it be deadlocked it's a
different process
all right let's just
guys we're here to make things fast and
we're going to get to the bottom of
bucks today
so i don't get it
let's figure out why
multi-process
oh you know what
no
i won't even create it
all right let's try this
that's the only place to use push audio
right
um
pre-process imports it
oh
let's see if that works
okay that
works what if i just put it here now
okay
so
this would be fine if it wasn't so damn
slow
so we'll put import torch audio here
um we'll put this back as a global
transform equals none if not transform
is none i'll transform that
okay that should be fast
we're getting six per second
one computer
whoa
all right
this is probably because it was already
multi-threaded look at have you ever
seen all those cpus look at that
it actually managed to be slower
it's actually faster with
this is upside
it's actually the fastest with one
process okay
um torch audio single process this
tricks for this
let's look into what torch audio
actually uses
someone a couple days ago was like torch
audio's crappy
now it got really slow
okay
fine after all that
we'll just do that
yep that's the fastest
keep it in the same process
is that using the whole cpu
some of them are
okay there's like ways to like numpy num
threads
let's try omp num threads equals one
guys i promised we were going to make
things fast we're going to make things
fast
the point of this isn't to do practical
work it's just to make things fast
okay now with omp num threads equals one
it only uses one
thingy and now how many cores does this
computer have 28 all right let's go
processes
are you like oh it has 56 squares don't
get duped bros hyper threading
hyper threading
[Music]
all right we're getting 300 400 per
second finally we're making good
progress look we made something fast
is everybody happy we made something
fast
let's see if we're using the whole cpu
uh look at our load average here my load
average is only 14 so you know it'll
make it even faster
bigger number
64. let's go
that's not faster
it's a little faster
i wonder if the speed's actually limited
by this
oh we should also test it with a small
number before we uh go crazy all right
32 is a good number it's a good
compromise
let's say dispatch equals dispatch
okay
all right we have libri.pt now
let's get rid of that and let's unleash
the floodgates
on this now we can also work on making
the model fast while we do this
so i think what we decided we wanted to
do
was
add some strides in
we're getting 12 hits per second but
that's largely because the groove is mad
slow
so let's have another option here called
stride equals false
um
stride equals to
stride else one
stride uh we can't make it an actual res
block so we'll just get rid of the x
plus we'll just do that
yourself that's right
all right
um
what do we want to replace this with
let me get this
this one can be a two by two strided
calm we don't actually need padding we
don't care about that
oh it's me time
let's try that
by the way the comp model was much more
stable than the non-comp model
uh padding equals same is not supported
for strided convolutions
uh if
none
if stride else
can i just say padding equals
can you get a bit bigger font no
you are a subscriber okay fine
it's too big though i can't see anymore
i'll make the font bigger here and we'll
make the font that size here is anyone
happy with that
i could use max pool stride two to keep
the residual connection you're right
should i do that
okay
the shapes can't be
multiplied
um because it's no longer
256 here it's 304 that seems more
reasonable actually
uh
now actually what i've seen here what
you do instead of this is i do like an
nn
um
stride
we'll do like a single comp
ah
something like that
sub is worth one pixel on the monitor
and get rid of the terminal and vs code
i'm not using i find
oh it's done processing oh in one minute
okay
the size of a
tensor 20 must match the size of a
tensor what
padding equals valid
oh
crap
uh
all right let's just let's just take a
look at how uh resnet does this
i shouldn't probably be doing any of
this i should probably just be like
really stealing these blocks from
somewhere
but you don't learn if you steal you
know
you know you don't learn if you steal
all right
uh
let's try padding equals dilation all
right fine
uh what
lentils not really
oh this one doesn't have padding at all
what's the optimal amount of steel well
okay
panning equals three of
stride padding equals dilation
if you steal you get bad code that's
true
we're here to understand
i feel like this just doesn't work
okay
let's find the code for conformer
let's see what there let's see what
they're
uh
self.encoder conformer encoder
okay
com 2d sub sampling
from convolution import com 2d
subsampling okay so they're just doing
oh
wait that's all they do
they don't have any res blocks
they just do that
you know what
i'm done with supporting strides in my
res blocks that made the res blocks more
complicated
and then i was upset
like there's ways to do this but uh it
sounds hard
great
is it fast be fast
but got value 9.99
why did you expect it to have at most
that
expected him
hmm
[Music]
yeah so okay
yes
this isn't right
um
[Music]
so we're using male spectrograms we
are so we're doing strided stuff now so
now the lengths are wrong
i think that's right
but you know what i have an idea
but then we don't have padding issues
anymore
great
let's see if this is fast
that is fine
you just got to change this guy to 320.
the key thing is that the groove is
shorter
is there a formula i can have yeah we
can but i think just divided by four now
works okay all right good good good
that's pretty good we're getting we're
getting 20 something bits per second
um
let's put this all together and see if
it works
okay
so first we change this to load the data
just like this
we have x y and we have meta
all right
and
now we have get sample
uh what goes in meta here
i think we just said here
this is meta sub 2.
okay got samples here that seems
correct uh oh this isn't exactly right
looking minister bye
oh don't do that
all right let's see if it trains
we're gonna have to add a cast as well
so we're gonna have to have two casts
named torch audio is not defined uh
oh cause i broke this
um
for example
you're gonna do something crazy let's
just do this
if uh
sample rate not in
get rid of
i should do all the same stuff
i think we need global anymore
i think i might be able to load it onto
the gpu but i worry that the metas are
going to go into the gpu that's actually
probably not going to happen
uh oh in here we're gonna we should say
uh type
yeah okay
change the type
all right we'll have to clean this up to
process the other data set too
oh it's more data now too this is bigger
and they're logs
um
expected tensor to have size 128
i've got size 249.
oh
249 sub ow
huh
i mean it's really kind of backwards
they're both kind of backwards
let's reprocess this with batch burst
equals true
fast now
expected input lengths to have value at
most
400 oh okay now
yeah um
divide by
four and we'll have a new one in a
minute too
i just put the batches first
and then we'll be able to remove this
permute from the model
batch time frequency is what we want so
we'll be batch time frequency good
all right good
how many hits per second are we getting
six
and nan's
oh this is terrible
i thought this model was fast oh it's
because our batch size big
our bachelor's small make our learning
rate small
i don't know why we're getting nands
we should not be getting nouns
uh we don't need that anymore
we might need to cast that though
uh oh what does this permute do
frequency time
so what it should be
do we have nands again
um
i want that transform there
we want batch frequency time is that is
that the right thing to put into these
these transforms
yeah i think the only reason i know that
that's because i read the code
access masking
here tensor of dimension blank frequency
time
okay we have to change it again
uh
you know what before we let's just do it
on the thousands those will be fast
let's get rid of that t there
the size of a tensor must match the size
of tensor b
that non-singleton dimension
cause that's not right
all right i mean we might have to keep
that permute
no like it shouldn't really matter it
should be pretty much the same thing
all right
so we want the input now is batch
time frequency and we want to permute it
into batch frequency time
so we do that and then from it back we
do the same thing again
let's get rid of the valve stuff for now
we don't need it
need um
for this we can say type torch.m32
[Music]
i don't want that anymore
um for model
i want to get rid of that for mute
we have
batch time
frequency
we change it to batch one time frequency
that permute is fine
ah this length
okay i don't understand
uh
range split oh i'm gonna do this
what's gato
cu dnn status mapping error
oh come on that's not a real error
oh that can't be real
this is just a mean error come on
i vote tiny gbg3
um
no this should be a normal size for a
convolution
cu dnn status mapping error
come on this can't be real
what
what else
oh do i have to permute for this too
and is max target number okay that's
right
[Music]
i should make a copy anyway right
because i'm changing the type
oh
no that input permute is fine
maybe my augmentation is breaking it
device side assert trigger
these aren't real oh wait what
oh that's not right
oh okay no no no no no problem boys no
problem it's just this
it's this
torch could really use better errors
oh look how fast that is that's pretty
fast
do you think that's fast
are we excited about this level of speed
i think we might be
thank you
mmm we got tea
um we're in the cloud but the cloud's at
the kama office so
the comic cloud
all right
oh was my was my uh was that slow
i was promised 60 though
18.
all right we'll let everybody talk but
you're gonna be all nice who's gonna be
nice
we have a thousand viewers
hi everybody
alex says hi
that's pretty fast i'd say
but no no we can go faster
all right let's
commit where we are now
speed
i'm not logging the example output
anymore oh i did get rid of this is this
what you're saying
put this back
what's moldy
oh don't eat moldy pasta sauce
um
okay we're getting 28 it's per second
decent number of hits
over here we're only getting 19. all
right all right you guys ready to see a
great trick for speed
watch this
okay this is a universally good trick
i'm gonna have a thing
uh
write a little function called get data
that's probably not even worth it
i'll put this up here
and then we'll copy it also
uh down here
so that way when you get the data it
actually because this is the
synchronization for the gpu
it should be a little faster
i don't like that i have to copy paste
okay
we got an unintelligible
error
oh well first let's go back and process
the whole set again
um you know what i have an idea
local variable samples reference before
assignment
all right let's think of a better way to
write this
if first
if
not first do this
uh first equals false
i don't like this either
write it like this
and see if it's actually faster
thank you
okay now we're getting 20 ounces
we'd like even more eggs
um
i'm getting 26 over here
there should be a good way to like
write this in a way that's
um
it's not gonna hold this up
so
i don't like that
[Music]
this is trump called i don't want anyone
that's what i want
ah and we have to return loss
okay so you see this trick
what we're doing is we're getting the
sample again after we run the model but
before we do the gpu synchronization
[Music]
oh i forgot to comment out
mine i'm getting 20 per second so we've
managed to 2x the speed
but i promised 10x
so how we gonna get
five more x's
well let's take a look at a few things
let's go for the model what if i comment
the group out how fast
okay we're getting
let's do a few more
fewer layers we can try that
what if i take the res box out
um i wish one of those rallies in here
more values always good
i think that's the same thing that i saw
in conformer
was it not
um conf 2d subsampling
i guess just this oh they're using
bigger kernels but
this is faster
oh yo
look at that speed
can we actually train that fast
i just finished that we're loading all
the data
[Music]
there's your 10x speed
all right so what what do we want to do
we want to do
oh yeah now we're talking i mean it's
nan
which is terrible
but
that's the kind of speed we want to see
we're learning right that's too high
we're learning right
do we have batch norm of course we have
batch bomb right there
i have some temporal batch storm here
none of that stuff's slow
[Music]
we're not fast enough for the police to
pay attention to this yeah
oh we have to put the validation set
back in
nan
what happened
why did we get mad
oh don't tell me there's like some like
crap with log that i didn't do
i right know i don't trust log no logs
check the log out
or the other problem could be we have to
say zero infinity equals true
it's possible we have one that has a lot
of characters and i think if it has more
characters than input the loss might go
to infinity
nope man
immediate man
didn't do anything crazy that's a very
normal looking encoder
wouldn't be crunchy if we took the log
no there's no more logs we got rid of
the logs
all right it's ready without the logs
maybe that'll work
so you see why it should be faster now
though it's because we calmed down twice
and now the groove is running at 40
milliseconds
which should be enough because that
still gives us
characters per second
um
is this green tea
it's called tropical green tea
green tea mixed with fruit
okay it's fixed now that we got rid of
the logs i don't really know why but
don't let me use logs again because logs
were a disappointment logs let us down
we're getting 17 it's
which is not a lot of it's
we're not seeing it print out issue oh
but i wonder if that's what made it
slower
it might just be slower because okay
first off what's your reaction to
talking about so let's not change the
type of that
go to the coffee shop
your
least favorite right now
you want a portal
you have a small little single shot
makiato
what do you think
yeah i'm just mixing it up you want a
green one
these people should just be banned
we can get rid of we can get rid of
emote only though oh we got a new
neighbor
for so long
okay guys i promised speed this is a
paltry
disappointed amount of speed
we need more speed and we're gonna
figure out how to get it
basically all that happened is we
we cut the batch size divided by four
and we're still not getting any speed
actually foul batch as well
oh i think i'm good for now
i don't think more gpus is gonna help us
actually
i think the problem is that grooves are
just slow
i also hate that we have this temporal
batch norm thing so we should just fix
it
and over here we're getting more it's
oh we're getting more it's because we're
not actually synchronizing the loss
21 it's
okay maybe we have too many res blocks
is that a good number of rice blocks
they were stupid
also this isn't even right anymore it's
not like 1600.
it's the actual number 15.99
yeah okay now we're getting a similar
number of hits
and it's very upsetting
ah
all right
well let's try something
if we make the batch size big
if the batch size is big that tells us
about what we can get from the maximum
like throughput of our gpu i don't know
how well optimized this grew stuff is
so if we're getting this with that and
we're doing batches that are 8x smaller
than this
theoretically we should be able to get
eight times more but we might need cuda
cash in order to do it so should we try
cuda cash let's try kuda cash
no what's not called cuda cash what's it
called
cuda graphs this
yeah
okay let's try this
come on speed speed speed speed
all right instead of j
cuda error
operation not permitted when stream is
capturing
what operation
operation not permitted when stream is
captured
does ctc loss not work
oh
maybe that
operation not permitted when stream is
captured
what operation
that works okay
don't make me write the ctc loss
okay so what cuda graph is is very
similar to need
it basically caches all of the things
um
so
it caches the operations to the gpu so
it doesn't have to make actual calls to
cuda anymore
yeah look at how much faster that is
like that's so fast
wait
could that speed be real
i just don't believe it
no no it could be real
uh oh no no well no okay hang on hang on
no this is actually bad no actually this
whole thing was bad
it was wrong before too
you have to check yeah you have to check
you have to do your fetch there
i put it in the wrong place let's see
how long it's really taking
all right
now let's just launch the model without
cuda launch block see if it matters
look at how repeatable it is though
that's a repeatable 38 hits per second
um that's pretty good
so let's see if we can make that work
unfortunately whatever in ctc loss does
not like to be captured in graphs
operation not permitted when stream is
captured
all right boys i think there's only one
choice here and we got to read the pie
torch code
which torch do i have this one
wow
right here too
hey yeah i know i could bring it up in
vs code yeah yeah
okay
this is what's terrible about torch it's
just like
of course it just calls torch dot ctc
loss
which is not an allowed
all right never mind you can you get
subscriber only chat again i look over
and it's trash
operation not permitted while stream is
captured
can we try a functional version of the
ctc boss
um
what if instead of ctc last year i'll be
right
f dot ctc loss what do you think
is that going to work better
no
because f.c.t.c law still calls the same
basic thing
cudn ctc lost backwards
shit meta programming is it trying to do
jet meta programming is that the problem
look at how fast that is though that's a
good number it's
um
hmm
i have a theory
if we can make the codn1 work
remember how we were having that bug
before
let's see if we can get that bug back
maybe the cu dnn one we can cache
we're not using the cu dn1 now because
targets is not
we want to see that error again
no
let me get the error back
input length is all the same
target is moved to the other type
oh where does it have the right data
type i don't think it does
we have to say
d type equals torch dot
32 d type equals torch dot uh
okay now all the input lanes are the
same as this input length
so now it's going to use the other one
ah okay good we're back to this error
expected tensor to have cpu back-end but
got tensor with cooler back-end
that's an improvement
um because i think that perhaps all we
have to do now
is
yes
remember that this hour from before see
that's what you always got to pay
attention to
yeah i know but you know you teach a man
to train and he trains for an hour but
you train a fish and
you know he comes back to you with his
buddies and like you know you play poker
or something
uh
well
which tensor
is it this tensor than it expects to
i can do something about
all right we have the same error again
it's interesting that it wanted that one
to be on the cpu
so
all right
uh
let's try it without the graph
um we could try to profile should we try
the profiler
okay without the graph we're only
getting 25 hits per second
i'm just gonna actually change this to f
dot c d c loss
this doesn't actually do anything
[Music]
so much for non-blocking equals true
now for this one we want to say val
equals
why is my validation lost nan
0 here
it's noun because it's not actually
running any
x-shaped
oh
guys you guys bought the typos
do i plan to add multilingual support no
no i think the whole world should uh
speak english
no it's actually just because i don't
speak any other languages except broken
spanish
um
it's hard enough adding one oh look look
look
25 hits per second now that we switched
to fctc loss
that's pretty good
more speed
that's that's pretty fast now don't you
think
um i know what you know what let's put
our batch size up to 64. i don't think
it's going to make it much slower
let's see how many now this is going to
make it a little slower but we're going
to get through the data faster
i don't know what our critical batch
size is
but now that our batch size is 64 we can
raise the learning rate
all right
that's pretty good i think
all right let me kick off this one
training over here
and then we can
have this computer empty
oh
oh my pathetic computer only has a one
gigabit connection
all right how many viewers we got and if
we get rid of subscriber only mode oh
wow
is it still right we have a thousand
people watching right now
all right all right all right all right
um
you guys we'll do the demo again because
the demo is the only impressive thing
here
we do actually have a working demo
um and i can show you what it is
we do actually have a working demo and i
can show you what it is
we do actually have a working demo and i
can show you what it is
we do actually
have work can
dell
and i should show you what it is
that's pretty good it's work hand look
it's working guys
you see where it's coming from right
it where can
okay uh my scp is done so let's just
boot it up and make sure it works
and then we'll we'll kick off a training
job over here on node dqn
all right all right all right boys
i do have something
we can see
let's check out let's see if trainer o5
is being used
no oh no someone's using it
do we want to use this
we could make it work with the nearest
thing in the dictionary oh yeah is this
what we want no they're being used we
can we can't use it it's being used now
let's check trainer o3
or two
oh this one's empty
should we use this one
um the network's tiny
it's only two megs
which is actually only 500 000 weights
this is a pathetic model
ah
all right
uh just so you guys remember you can
come on wendy b check out peachy planet
oh look at peachy planet look at the
loss on peachy planet
oh
i think we might have got something look
at that
and it's fast
not only is it fast it's good
oh let's go look at peachy planet
we'll give it a little more time we'll
see if this this incredible trend
continues
all right so it's going to train in
that's 20 seconds
how we doing 2 000 seconds oh it still
takes a half hour
uh wait we should always check the val
loss not just the uh train loss
the val loss looks pretty good too
oh also
this validation example is going to
start to come in remember the validation
examples from a completely different set
from the uh
from the data
uh oh
it might have only been good for a
little bit
[Music]
do you think 16 filters is too low
it might have only been good for a
little bit now it's not good anymore
[Music]
well to be fair it is competing with
ethereal firefly
these are trained on a different data
set
but up is never a good way for it to go
i don't know okay that's pretty good
it it's it's only compared to the blue
line i don't compare it to the uh
the the purple and red lines are on a
different data set
uh oh
it's not a good vowel loss
okay don't watch the model train just
let it train and it'll be good
we made it pretty fast that's all we can
do
i mean it might have to do with my batch
size
you could do hyper parameter search but
whenever you're doing hyper parameter
search
you know things aren't good
okay
look at these crazy activation functions
these guys use
inputs torch sensor tape b
t
input down is that we're using
b
t
input dip
oh you pass the lengths in here
i want to do the padding right there
that's pretty nice
what is the conformer output
oh this is pretty nice we could just use
this
they already did everything for us
tried running model on collab
13 ish hits per sec that's not a great
number of vets
how's our how's our training going
it's about where the same as the other
one
i mean to be fair we don't expect you to
be better we just expect it to be faster
we didn't do any of this for better we
did it for faster
oh is this with the commented out res
block did we commit that
oh we did
oh this is missing a res block too no
wonder it's worse
it got slower too
hmm
i hope my problem's not float 16 either
because if it's that we're never gonna
find the bug
no it's really the same
yeah it's really the same as this one
it's just faster
this one took a long time to train
could lower the number of training set
examples we don't want to do that
um
how come it's not outputting anything
for this validation
i don't like that
the old model used to output something
there
in fact we know it did here we can check
the logs in here
yeah look
this outputted something here now it
doesn't output anything anymore
that's not good
is this the problem did i not mean to do
zero there
yeah no no we have to go batch first
here
this is that
zero's still correct there
let's copy this model back from this guy
it's the same
literally identical
oh good okay
so the validation's fixed
uh we'll get rid of that stupid shape
print
next single valve
okay
examination oh and okay so for everyone
who doesn't know the validation you can
just get the validation if you go to lj
speech dot you just search your lj
speech and you listen to this the
examination and testimony of the experts
enabled the commission to conclude that
five shots may have been fired
examination and testimony of the experts
is able the commission to cloud bet fart
shots
mae of thin fire
that's pretty good
wait i understand why is that loss
getting lower
oh the power of 30 90.
the model knows it's being trained on a
30-90 and it's excited to do well
lj stands for linda johnson the woman
who read all this speech
linda johnson from librivox
most computers in the world talk like
linda johnson
um
all right
let's make it faster how can we make it
faster
crazy umbrella
oh we had that check they removed it
let's just quickly check how far off we
are with this
i think if we don't have enough
i basically needs to be greater than j
because we have to have enough
letters for it to output
i also want to get rid of this temporal
bn and really understand what's going on
here
i'm gonna spell until that's right
okay now we have a couple things we can
do
we can add in the lj speech data set and
have two data sets
um all right so these are always pretty
much larger than this
we got about a 2x margin
so we only have a 2x margin though so we
can't go any lower than that okay so
basically the groove is running at uh
40 milliseconds so it's running at 25
hertz we sampled the sound down to 100
hertz and then we're running the groove
at uh
and uh
we're not doing any transformers here
no we're just using a grill
we could use transformers but that would
involve understanding how transformers
work
and that's really hard
[Music]
maybe if we get rid of
so
these things
i think we need them
it's a little faster without them
you probably don't even need all these
linear layers
to be honest like just this is probably
good
i doubt that stuff improves performance
at all
let me get rid of temporal batch norm
all right good that's faster
um
probably that layer either
what if we upgrade h to 230 and remove
this layer
now we're getting to a very simple
architecture which i like
should we do depth wise convolutions too
are these res blocks slow at all
not really
i could set up 30.
now what if i remove the grille
oh getting rid of the groove makes it
very fast
cool
i should see what happens when i train
that model let's get rid of this crap
yeah transformers are super arbitrary
this is exactly how i feel about
transformers too
there's no reason these things are
fundamental i almost don't want to waste
time learning them because they're gonna
you know they're gonna come out with
this one new trick it's like well it
turns out you don't need queries keys
and values and
compress the training data what does
that even mean
okay without the groove look at all
those hits that's a good number of vents
is this going to be fast now
wow that's the kind of speed that we
were promised look at that speed
oh boys look at that speed
oh i mean i bet the model doesn't work
but like aside from that that's the kind
of speed that we want
oh look at that speed
oh yeah look that's the speed that we
were promised at the beginning of the
stream and we're going to figure out how
to deliver that speed to you and it
might involve using transformers
and the model doesn't really work but
you know that's kind of an aside
let's put the res blocks back in and see
if we're still getting that speed
much speed but no learning yeah that's
true
okay when we put the res blocks back in
we go back down to 34 it's
that's both rez blocks though
all right let's make faster rest blocks
um
what does the res blocks from a fish in
that look like let's look at the tiny
brown source
i still read these tiny grads because
it's like some of the cleanest like
implementations of these things
okay we have a conf called expand conf
a depth-wise calm and then a project
confirm
res block depth wise
there's like a way to do this with the
torch comps
i mean i think we could just maybe let's
just try the stupid thing
uh
what if in this one we say groups equals
c
and then this one we make this
how good is that
more it's
all right i don't know let's just let's
just make up for
my stinginess by increasing c let's see
if that matters
it is groups right like i did that right
groups equals n channels each input
channels can evolve with associative
filters yeah
uh oh
well that's a problem
um
is that a multiple of
that's not right i'll keep that at that
and then here we can just go like that
get rid of the stride
16 inch that's a pathetic number of it's
not even with the grow
where's the training going
looks the same
literally the same
all right uh is that one fast
23 yet this is not a good it's
i did managed to put the res block back
in though
decomposed convolution
do you like explain the cone block well
in the paper
no they don't
i like read all these code all this code
at one point
it's so confusing to read
okay expansion phase
depth wise com okay so we don't actually
need that one we do the depth wise comb
first
which is right
ah
and then we do the project conf
oh and actually we can say bias equals
false on these columns so that's a
little better
this one doesn't need padding
because it's a projectile
depth wise
project
you don't need a bias in your
convolutions if it's followed by a batch
norm
i should probably batch arms here too
do you think we really need to grow
i want more speed
okay how fast is it if we go back to the
graph
but we comment out the uh well first
okay
first question before we comment out the
graph
just say graph equals false
if graph
yes
we can quickly switch between the graph
and not the graph
how much effort should we put into
making the graph work
uh so first let's just get rid of this
and say loss equals gas dot
three thank you for subscribing
okay
the graph doesn't make it i don't know
that's without the graph okay that's
just without cdc so how much faster does
the graph mean if we make the graph work
not that much faster but look at how
stable all the timings are if we make
the graph work
all right let's let's uh let's profile
pie torch profile
[Music]
hmm
profiler
oh let's just throw a run model out here
it never hurts
just to make sure you do the in there
can we estimate how long each layer will
take well yeah that's hopefully what the
profile is going to tell us i don't know
what with stack does
what is with stack
oh we have to print the profiler results
which we didn't do
oh look how much slower it is with the
profiler
it's a ton slower
girl if we get rid of the profiler it'll
be faster
all right
um
so
kudo launch call is where we spend all
the time
oh the optimizer's a little slow all
right you know what i have a trick for
the optimizer
we might be able to get a few more hits
if we do this hang on
so first off can we all agree that the
profiler was useless we're not going to
use it anymore good
um
but we can try
replacing adam
with the apex fused atom optimizer
see if we get some more hits let's go
oh and if we use fused atom with with
cuda graphs it should be very fast
all right all right it's slightly faster
with fused data might say
let's put the graph on
how did the model do long term
like the same
okay
well it's slightly faster so we can
enable it
all right
that's pretty good i don't know what
else we're really going to do
like that just is the max speed we can
get
wait why'd it go only to 14
when i break
i guess that's just what i get now
all that it didn't even get faster
oh you know what might be faster than
batch norm layer norm
here that's what people are using these
things
you know what i'm being dumb though it's
not like i'm gonna like make one magic
change and it's just gonna get instant
fast
yeah i still have 3x1 model but that's
not that's in the profile or it doesn't
matter
i can't really down sample it more i
already did
that's what these do these are down
samplers
what
expected input with shape
star 16
i don't understand
[Music]
normalize shape
i don't understand
group norm
what does conformer use
all right should we just do transformers
what do y'all think
i think torch audio just has them
wow
let's try that what do you think
my model's stupid
uh torch audio dot models dot conformer
um my input dim is 80. my num heads is
four my ffn dim can be that
some layers is four and that could be
31. all right let's go
um
let's try it over here in the benchmark
first
i feel like this is going to be very
slow
oh no i got the wrong torch audio i
didn't buy the one with conformer all
right um
from torch audio models in port
conformer sometimes this just works i
don't really understand python enough to
tell you why
oh
we know that we don't need that's 31 is
big i read the conformer paper and 31 is
very big
wait what
i don't understand
did we not buy the torch audio with
conformer did we buy the cheap torch
audio
no conformer
hip install torch audio upgrade
no no don't upgrade torch no no that's
going to be a bad time
oh
no no no no no no no
all right something like this but
fine if you really want
no no no it's gonna have to update torch
no no no no no no
let's see my torch version is it a bad
version
all right we're gonna upgrade torch
anyway
i don't know maybe we upgrade torch and
everything gets faster what do y'all
think
i hate virtual items
just like
they take up a lot of space exactly and
you're always in the wrong one
no i have to do the wrong okay i don't
care about torch vision we're not here
for vision we're here for audio don't
please don't re-download torch
oh we have to re-download it from the
fucking internet oh yeah you know you
know someone's going to get the cell
phone bill and they're going to be very
upset
oh you couldn't have cashed it oh you
couldn't have cashed it no no no no no
no no we're not going to cash it well
well that's too much all right let's go
to pie torch.com
oh it's an org
that's right
all right
who thinks the updated pie torch is just
magically going to be faster
maybe the graph will just work well
maybe they fixed the bug in ctc loss
i'm excited
all right come on computer
oh no
oh well i don't care about that good
is it fast now
uh no layer norm was a scam yeah
that's where we were at we were getting
scammed by light on norm
oh good well we updated to uh well it's
not quite 11.1 that's 1.11 but hey
that's not faster all right
but maybe maybe that's gonna work
run the conformer
let's make sure my output shapes are
right and stuff they're probably not
forward missing one argument all we have
to pass in the length so it's input
lengths
expecting key padding mask oh
what
shouldn't be a thing i'll get it
key padding mask
okay
some of the arguments have invalid types
oh it outputted uh
the conformer output something we don't
want
what is it output
a tuple oh it includes the lengths okay
that's fine
um
which we don't care about
input links must be of size batch size
they are
but no i think that uh this is just
what's wrong
what's the conformer output shape
batch t input dem
okay
batch t input dim
and what do we need
what is the other model output
we need t batch input dimm so we'll say
permute zero on that
oh that's also 80 and 80 is not right
okay
all right six hits per second and it's a
massive model
i don't know i feel like this one's
actually going to be good
let's just delete all this crap
because it was all for poor people
um
oh wait we still need the decoder
but h equals 80 this time
that
okay now we actually have to do
something with the conformer we're going
to do this
actually
and then do the log max okay good
um those ai researchers do get paid a
lot of money so i think i agree that it
has to work
okay okay that's solid
it's pretty solid i'd say
now let's figure out how to make it
faster
you can't change that
that's fine probably
numb layers that's too many three is a
good number of layers and this can just
be three
see is that good and fast
i want at least ten hits
eight it's we'll settle
all right so all we have to do
is we have to pass in input lengths to
the model
and we have to get rid of
this divided by four
should just work right
okay we got val losses around one let's
see what a conformer can do
[Music]
let's read the code for conformer
oh what i forgot oh
i'll pass that in everywhere
it's fine
uh
what else we need
i don't know if we're going to use a
conformer i want to just use it with the
default parameters
all you need is all we need
oh single valve
see if the conformer is good
list has no attribute shape
why is it a list
oh it can't be a list that has to be a
tensor
are you happy it is tenser
oh no but it's gonna have to be a gpu
tensor
maybe we'll say
i don't think it does
is attention all we need good question
tension plus equals attention mask
okay it has to be a gpu tensor great
don't you love it
as drake would say oh you gotta love it
oh you gotta love it
why wasn't that one a problem
okay this is a different problem
um
no okay i know what we have to do here
so
for this we're going to say max
input lengths
and that should fix that
you should actually make the whole thing
faster too because like you don't need
to
we were running the thing longer than we
had to
you want to see what that does
okay we're
conforming is my loss code is out of
memory
f
all right let's lower the batch size
we have a conformer now we don't need a
large batch size
oh no do we need the a100
let's see if we have the a100
nope no a100
all right we have the batch side that
should be pretty good right why isn't it
i'm putting the loss
oh that was just validation that we were
failing at
oh no
attention at a100 is all you need
okay okay
we computed the validation loss
successfully
who thinks this model is good wait let's
also check did we install the right
thing on this computer
oh it's so slow
oh so slow
oh my good out of memory pie torch step
one buy a gpu with more memory
step two stop being cheap
did i save my conformer
can i fix that
yeah it should
i should have saved
i don't understand why didn't it save
that should totally save
oh wait a second and this computer has
an even crappier gpu
no no it's not occupied by the processes
wait i understand
why didn't it save the model
yo always format strings
let me save the model
wait why is it so small
conformers only 1.5 megabytes
then why does it take so long to train
never mind who else thinks conformer
sucks
[Music]
batch gradient updates
nobody has time for that
so
all right
we'll kick it off we'll kick it off on
this computer over here and this
computer's going to bitch me it's like
no memory and we'll lower the batch size
even more
and then we'll all be disappointed
what's in a conformer that uses so much
memory
of course you don't have enough memory
of course
at some point you're really doing below
the learning right
we can't even train with a batch size of
16.
yeah yeah batch size equals one yolo
if you want your data doesn't take up
that much space
like two gigs
never mind
nope
you wanted to try this one but we don't
get to because it doesn't it can't fit
it doesn't fit
we tried to fit it it doesn't fit
i'm very disappointed with conformers
they use way too much memory
we're back to this guy
it's a good model don't worry about it
fuck what lessons have we learned have
we learned lessons
oh they use swish activations oh great
great i'm sure that makes it much better
i'm sure the guy who did that ablation
study and found out that swish improves
at .003 percent
uh
um
well okay either way we got an
optimization out of this
we added that in
and that should make everything better
um
oh don't do that
non-conformer yeah
yeah that's right
that's right don't follow the rules kids
wow we still have all these viewers
why we got so many viewers you know
expecting input lengths to have at most
99 but got value 344.
yeah okay
wait this is tricky
that has to be like this
and then we have to say
input length equals x over 4 for x in
input links
4x down scale
in encoder
all right you got to get the subtlety
right you know it's all about the
subtlety
i don't know sometimes i just say dumb
shit like that and like
what there's an end former is that real
ctc
tuple
or expected tuples
all right they can't be lists
they can be tuples
oh wait or actually wait is that just a
different
validation
oh
oh great
informer
no we're done trying real models
i don't think the model is even the
problem our input height must be
integral oh make sure
oh
oh actually i think that was the whole
problem
just work now
because a list in tuples are the same
thing the problem was just that they
weren't divided by four or something i
don't know
okay
it works again
let's kick off this one to train
we'll use the other gpu we'll let the uh
we'll let we'll let cool divisible
devices equal zero rest
and we'll tell him it's because we he
let us down
wait
what
how are we out of memory
something fishy's going on here
where's my memory
you flush gpu memory it's all empty
i don't like this
where's my memory going
who's stealing it
did i do 32 last time
let's check out the get version before i
fucked with conformer i could
no but it has less res blocks
we need the res blocks
all right let's do a compromise of 48.
no no no it makes sense it's because i
added in an extra res block
and these extra batch norms
uh
okay we'll let that one train
it's not fast yet no i want it to be
fast
okay okay okay i've made up my mind we
have to learn about transformer
we're gonna have to use transformers one
day or another transformers are the
future attention is all we need
so it's about time that we learn about
it
and you know stop because if we don't
learn about transformers we're only
cheating ourselves
what's the new one called morning valley
i think it's gonna have a different
learning rate slope though
oh
wreck equals one what
when equals one
this one's gonna have like a different
slope thing because i messed with the uh
yeah
you know
but it doesn't really change anything
okay
it's time that we learn how to use
encoders transformers
we're going to replace our groov with a
transformer
yeah i've read men gpt
how's bright salad looking
all right
what's that tree
uh
i know he complained about this and then
because i remember he changed it
query embeddings okay
all right
self dot gru
equals
oh well it's not even the groove that's
slow anymore we decided though right
now we are getting 100 its per second
and it will be fast and it will be
glorious
i believe
okay if we take the grew out how fast is
that
oh good look it's already learning it's
already learning it's already hearing
stuff
that's this problem
okay 43 hits per second if we take the
crew out
that's pretty good
because we're only getting 16 now
with the group so we're going to replace
the group
uh what if i do it in graph mode how
much better is the graph
so remember what the graph's doing the
graph is making uh
dick smash mac iron cock thank you for
subscribing
i'll read your name on stream too if you
subscribe
um
okay
what if we train without the girl is it
fast
oh yeah yeah testimony testimony
testimony of shit experts
um okay only get 22 it's
which doesn't totally make sense
even if i switch this back
and turn the graph off i'm getting 44
it's
it must have to do with data
or maybe it's batch size what batch size
am i testing this on
dirty toe yeah
if this is without the groove we're
trying to see if we can get good speeds
and then we'll replace the groove with a
transformer
all right 40. it's pretty good
so it's all the slowness comes from the
groove all the goodness comes from the
groove as well so that's kind of the
problem right now
pretty fast
why is the vowel loss still so high
should we break the model
looks identical to that on loss
noise
maybe
why is that so bad now
oh maybe we needed those outer batch
norm layers
okay well this model doesn't work
anymore
it's interesting it gets the same loss
but then on validation
it's probably because i got rid of those
batch norm layers
that's so disappointing
remember these ones that used to be here
in the decoder
[Music]
here's a question by the way
if i put the groove back in but set
batch first equal to true
is this faster
does it affect the speed at all
input lengths must be of size batch size
oh we have to change this back
okay there's no way it doesn't work
batch first equals true
game your choice thank you for
subscribing
it's not faster
and the batch size okay fine
input lengths must be of size batch size
oh wait that's not a problem anymore
okay never mind
okay they're not faster with batch first
equals true but it's more understandable
at least
so moving the channels here
we move the time axis there we reshape
it like that
we run it the groove with batch first
ah now i wonder if we can use batch norm
1d
remember when we used to have batch norm
1ds there
just put that back to what it was i
don't think it was slow
not the one we took it out
should contain 191 elements not
160.
okay
this is good to understand what's going
on here
this is a tricky thing like
bathroom should just be in the last
i should ignore the middle dimension
right
or do i have to permute for it
i mean should contain 191 elements not
160.
yeah okay maybe this isn't right then
they use both layer norm and batch norm
people are the worst
what am i going to do with all these
things
okay
apply bash normalization
i want it to be averaged
because batch normalization is done over
the c dimension computing statistics on
nl slices it's common to call this
temporal batch normalization
[Music]
i don't really get it like
oh wow
um
no
that's not allowed
temporal batch norm would put
the batch first
yeah
all right all right all right all right
we're back to this crap
it's a little different this time
it's this
i really think that's why it broke
and the dropout was also on something a
lot smaller
look at the valve loss it's so high now
all right because remember we were doing
drop out on uh
didn't break the normalization did i
i said the augmentation today
okay that's pretty good right
stuff's back
uh
where's my get sample function
it's not here
it is in rack
if not val train audio transforms okay
all right
maybe this one works so you can see what
happened here this model just overfit
like crazy
uh likely it had nothing to do with the
batch norms now that i think about it
had more to do with how i was doing my
dropout
but
this is an old window
here look at that
a bright salad
went all over the place
so you'll see a party water is better
um
despite having the exact same
unless is it possible we just wrote a
bug in the validation
that's almost plausible
ah probably not
i don't know we'll see if this one works
maybe we wrote a real bug in the
validation now we actually would have
seen this get better and it didn't
so we'll see
we'll see if that fixes the overfitting
all right don't let me mess with the
decoder anymore i'm happy with the
decoder i'm happy with the encoder
the only thing that might need to be
replaced is the group
you're getting 42 it's per second if we
don't use that growth
[Music]
the driver is not slow
um
remember we do have a working demo even
if it only kind of works
remember we do have a working demo even
if it only kind of works
you remember we do have working down
even if it only
sinned of worse
i know that is pretty close
why is the vowel so high
oh
i remember the other thing we changed
oh you guys aren't gonna like this oh we
changed the batch size
that's because it didn't fit in the ram
[Music]
and we can write beam search
i'm not happy with these changes
because the valos looks like it's still
garbage
and walk
how come peachy planet was good
yeah it's garbage
it just overfits
this one doesn't even have as good
normal loss oh because it's 32 i didn't
do 32. i think it is related to that now
all right let's make useless ram
i don't understand like we're doing big
batches before
it must be the batch size
just doesn't fit
let's work out how much we're copying to
the gpu maybe it is too insane
oh wow it is six gigabytes
oh damn
all right well
all right all right all right all right
new idea
wow that's six gigabytes that's crazy
is it really six
got six wow
the old one that worked only had one res
block
that fit
[Music]
you're not fit
okay
those red blocks must use a lot of ram
did i do that convolution
maybe right depth wise ones are a scam
and i had to like set something else
there's groups but there's something
else too
let's try what's dilation
no
and then you know what maybe we don't
need any of this
and maybe we'll just replace
now we know the decoder actually had
nothing to do with the overfitting
do this
great
just a linear layer
i know you drop out though
no we don't need dropout but nothing to
do with the overfitting either all right
great
it's a much simpler model
see if this one overfits
conv head
into a group
into a single linear layer for decoding
into a log softmax
training it with batch size 64 which is
probably the cause of the overfitting
uh we're getting 20 hits per second
that's pretty good
zany dream let's see
okay okay okay let's starting off strong
that's crazy if the batch size is what
caused it to overfit
looks like it
give it more time
okay well then the question is will it
over way less if we even do a bigger
batch size
um
let's
look at pre-processed libre for a second
thank you for subscribing
no no no it went up
no it has to be sixteen hundred
nope
it still goes up
okay i don't know let's check out the
past
what what's doing this
okay we know peachy planet was a good
run
tells us what the get was here just not
there we go
get diff here
okay
we added those batch norms
so let's take them out
we had one more relu on the decoder
the rest blocks
were commented out
we're using the other optimizer which
shouldn't matter
and we weren't passing that stuff in
we weren't clamping to max input length
but i don't think that's the bug
we're using simpler convolutions which
we can always go back to
oh we had that extra linear layer in
there
but i think that layer is pretty stupid
maybe it's not
i'll put it back
the shapes were a little different but
that stuff shouldn't matter
okay we should have reverted literally
back to what's here
i don't know why it started overfitting
the data didn't change
the losses didn't change
just for some reason the new models all
had skyrocketing valos
as the old ones it went down
hopefully we reverted enough that it's
good
[Music]
i don't know i don't care if it's wrong
why did your ice pop come on doesn't it
but thank you for catching bugs
um
i wonder is it actually
can we load this one
what
oh that one doesn't work
uh hopefully one of those things fixes
the bug should we do an ablation study
to figure it out
you can see the gray one
is continuing down
[Music]
okay one of those things fixes it
don't know which one
we can't fit the two rez blocks
um
hello
welcome back yeah we had bugs
but we checked them
they're in the fridge
oh
yeah of course
[Music]
i think i'll be down in like
30 minutes
maybe an hour okay
the bad loss is fixed i'm very curious
which change um it actually was
we can look at github and we can look at
[Music]
okay
we got rid of my depth wise of
projection comps
we added back in this flattened layer
we added back in this review
i don't know it could have been any of
those things
but
i think the main problem that we need to
focus on now
is
not
is it slower if we don't send everything
to the gpu
and we just do it
um on demand
so let's not do that
and then in here
we'll throw some dot buddhas in
two device equals
um
i don't know if this non-blocking
actually works but it makes me feel
better
oh
let's do that in the other way
it's a little slower
okay
it's slightly slower doing it like that
but it's faster to start no actually
it's not slower never mind
okay so now we don't copy all the data
the gpu anymore
you want to make the other data set work
too and then we can double the data sets
oh the other thing we can do is we can
add back in this res block because we
have ramped that
don't copy
data
don't let the pigeon drive the bus
hmm
[Music]
don't let the pigeon drive the bus
words and pictures
hi
i'm the bus driver
listen
i've got to leave for a little while
so can you watch things for me until i
get back
thanks
oh
and remember oh we got a pull request
don't let the pigeon drive the bus
wait what
we don't even have this stuff
oh autumn
all right
well it's a great book you guys should
read it
oh sure
okay we'll turn subscribers only chat
off for a little bit we'll see if you
guys behave
we re-enabled the res block we disabled
the copy of the gpu
um so let's see what happens with bommy
galaxy and let's see how it compares to
ethereal pond and of course we'll leave
in peachy planet just to have a baseline
i turned bright salad off
by the way i love wandy b
i really wish you guys would open source
your back end
um then we would use it a comma i'd be
so happy
first-time viewer biden writes java see
why do we let why don't we let non subs
talk
every time oh any other book
recommendations oh
never mind
you all behave or all non-subscribers
will lose talking privileges that's
right that's right it's like how they do
punishment in north korea
and your family will lose talking
privileges
and
oh they're asking me what computers i
think are good
oh man did you they let the pigeon drive
the bus honestly if we left if we let
the non-subscribers talk
i'm not saying anything wrong like he
doesn't understand why that's wrong
don't let the pigeon drop you would let
the pigeon drive the bus that's that's
all i'm saying
what mac am i coding on no it's not a
mac bro this is actually uh linux but i
downloaded the mac theme for uh for for
xmonan
be careful
well good i'll go google the mac theme
for xmod
they'd like to pinch and drive the bus
too
you're using all the power no you're not
always involved whatever you do
you've got to pull
okay
wow look at how good this model is look
at bomby galaxy it's just it's just nose
diving here can
we monster all right
oh yeah good someone's liking the
questions document that's what i like to
say
oh good that is
um
so
how
we have to keep the eye on the prize
here what are we even working on in this
stream sometimes i don't remember you
know they always ask me and you think
that like i have an answer for you but i
don't really know
uh
i don't like the complexity of the
decoder
what did you do
[Music]
and the res blocks will help long term
i wonder if we can put back in the
dilation
[Music]
c is only 16. we could increase that
i don't think there's gonna be a way
though to get
um
i don't think there's a way to train
this any faster
i think we can make models that are
either better
or
but better and slower
no there have to be some things that are
very very fast to train
do we have a real benchmark we do
20 yet
the decoder that i really just want is
this
i have no idea if that's like going to
be okay but it's what i want
let's see if it's fast
i know i expected more it's too so
i don't want to hear about spiking
neural networks
that goes up to
it's and if we take the grew
out the groove is slow
and if we switch to
groups equals c
i'm sorry about you what's up my
password
there you go
all right um slightly faster with that
that's just so i can enable the graph
because we can't do ctc loss with the
graph for some reason which is another
bug we can fix
okay it's looking pretty good
that gets us 50x
we have to write our own group
removing one of the res blocks gets us
up to 89 ins
how much of these are caused by batch
norm being crappy
maybe layer norm is faster figure out
how to use it
oh it's all batch norm that's crappy
oh well that's actually hopeful
okay
let's first do this ablation study
we have two gpus in this computer so
we'll kick off the other one
let's first do the ablation study and
see if the decoder i want actually works
we should really be tracking our
experiments better
let's see if this decoder works
okay now we have a clear compare
between we'll just call it a bladed
decoder and we can just compare it over
here to bommy galaxy because it's
exactly the same code except with those
changes
gotta love randy b
we're gonna rename silver rain rename
run
ablate
decoder
but it's interesting that the batch norm
is what's slow
so if we switch to layer norm we can get
speed
wait
wow that loss is a lot lower at first
just from that one ablation
that's because the dropout's a lot less
effective i think just think about what
we're doing with the dropout
all right we'll see we'll let the
ablation study finish because we have
plenty of compute
and we can use it for studies
all right we get 20 inch there
now if we get rid of batch norm we'll
get more
what do we want to replace it with group
norm
the input channels are separated into no
where's layer norm
what do we use a comma now we switch to
something else
over the last d dimensions
normalize shape
i feel like this just doesn't work
oh we might have to do one comma c
oh
maybe
this anyone know how this works
embedding dim
oh should be the last dimension
normalize over the channel and spatial
dimensions
how does this work in a transformer
unreadable
oh
i forgot we still let the
non-subscribers talk sorry that was a
mistake
um
does anyone know how to make this work
oh maybe we want to actually just lay
normal with that
which is 40 and that's 20.
they're both l added
it's slow
only 27 inch per second so we just
actually have to take these out if we
want to be fast
okay what if we have one batch norm
let me put it here
and now we're off the map for like
normal shit
my layer norm did work though
i will point that out
okay
that's pretty good two batch worms
should be all the batch norms we need
how's my bladed decoder look
is it good
looks identical
we'll let both these models converge but
actually it looks even more stable
okay that's 70 its per second guys i
promised you 100 it's
oh well that's actually the wrong batch
size too
we're using batch size 64 for training
okay we're using batch size 64 for
training and we're getting 11 ants which
is really a pathetic number of hits and
i know i promised you more
yeah okay we're at the limit of the gpu
i mean if if it's scaling perfectly with
batch size like that we're actually just
at the limits
all right
do we just need more gpus
should we just go gpu shopping
uh this is with the gru again
and that's with batch norm back
okay
we need to rethink fundamental
assumptions
in order to invent a blood testing
device
that works on just drop of blood we we
need to rethink
fundamental assumptions that's a good
point
um
okay
can i verify it's actually the gpus yeah
i can that's why i'm using code to graph
so if you use cuda graph it's
just it's just the driver i i know a lot
of times pytorch can can give you
bullshit but you can see that it's not
my cpu i look at how reliably and exact
those things are
yeah so that's it
uh
we just need to revisit some fundamental
assumptions what's the size of the thing
that i'm passing in here
and why does it need to be so large
isn't relu before batch norm better
uh
no
i don't think so
the 1600 is long but we quickly stride
it down
uh
tinker think thank you for gifting subs
uh no this is the time dimension that's
the frequency dimension
80 is what's used in all the papers i
probably can't go lower than 10 because
we're already ablating there that took a
bad step
fundamental is in model architecture no
i just i think that we're just this is
just what we can do
um i don't know if we can really make it
better
okay that step was just a fluke
so let the decoder ablation finish but
that doesn't matter we'll commit that
new decoder
um
how good is the performance with 10
training examples
well we could always increase the data i
mean data always makes things better but
i just i want these things to train way
faster and i guess they're just not
going to
okay
let's do some math
this is doing
most of my slowness is in that is in the
comms let's let's just disable the
groove
no but if we disable the groove and we
disable batch norm it's fast
it's not the 80 we were getting before
but still
i think that 80 was with these red
blocks disabled
oh no no the 80 was with uh the sorry
the 80 was worth half the batch size
okay
we're running
what's the dimensions here
conventions here are 64
by 800
by 40.
the dimensions here are 64 by 40 by 20.
so if we're doing a three by three
convolution
how many flops is that
we're doing 4x
um i think i can
well i can't if i'm doing it like that
but
okay
let's just do the math out
64 times 800 times 40 times four
my columns are three by three so that's
nine
and then my it's an add and a multiply
for each one
uh so this is 147 megaflops
yeah that shouldn't be anything
i don't understand why that takes time
did i do something wrong
i have a gpu that can do
let's say 10 teraflops
it's more but so i should be able to do
gigaflops in a millisecond
i don't understand
oh okay well
it's true that it's not just forward
let's try this thing
reinstalled fop
so autograd's going to take gay so
usually it's usually it's 2x for the
backwards pass
but still we're off by uh
model
even though
my ablation study oh that glitched out
it's the same now
okay here we go
so
[Music]
it's four
this is like a nice thing that can like
print it out by layer here
it's like a verbose
verbose
verbose equals true
doesn't look very verbose to me
i'll clever for i see what clever format
does stupid
okay so it's four gigaflops so it's 16
gigaflops
so
for with with the backwards so this
should be running
this should be running a ton faster than
it is if any of these gpus were honest
about how many flops you get
but they're not
the guru's not even running
i'm literally just running res blocks
what if i put the carve in there can i
can i put the uh
is there a way to say activation does it
support that no
i'm doing relu's they can't be slow
a couple one by one strided convolutions
can't be drop out right
no it's not a dropout
kudo profile
torch
um
i think my expectations this guy thinks
i should lower my expectations
is that similar to
compromise
i mean it was part of being involved
which one
why does he think that
he thinks my expectations on speed are
off and while i would like everything to
run in one millisecond it doesn't
it takes 24
which is a very upsetting amount of
milliseconds i would
look say but aren't you proud of us for
doing real science where we like
compared this model to that model
and we're gonna like see how they do oh
that's that's
science shouldn't you make it work well
first and then optimize it no this isn't
how we do things on the street
on this stream we make things go fast
and then we make them work
because do you want to sit here while
something's slow i mean this is the main
thing i'm trying to do like we can't do
ml streams if the thing is just going to
sit and have to train for an hour
flip a you are right we are here to
party but sometimes science makes the
party better
why don't you also use a statistical
test
i don't know
this res block stupid
okay here's an idea
i'm striding two by two
what if i do this
is that faster
it doesn't fit in cash
that's faster
i believe that model is going to work
better too
actually it's really four by four so
we're not losing any information if we
go to 16.
that's probably a good idea i kind of
like this model look how simple look how
simple everything looks now
yo
there's 100 it's
i like that
i like that look at it it looks fast it
looks fast
all right all right that's our target
speed we did it
actually this fast in here
i promised you guys
a hundred eighths and we're going to get
a hundred hits
this is still without the groove by the
way i'll remind you
no we need batch norm back but maybe we
need less batch norm we had a lot of
batch whoa 43 it's okay that's still not
enough
i don't know why we get less hits there
but like just look at how fast it looks
now
it looks so fast
what does the loss look like don't worry
about that don't worry about that it's
fast
all right
all right
it can have one batch normal
weight layer relu
yeah
okay
batch norm after edition
oh what
they put the relu in first i don't think
you can do that
okay batch form slows it down
okay we're getting 61 it's if we put the
batch norms back oh but i did forget
that if we use batch numbers we can say
bias equals false
got to be a little faster right
a little faster
all right 64 it's now we put the groove
back in
35 ants
oh this is who's playing
it's probably a sweet spot where we get
fast training and good performance yeah
let's try maybe it's here
see we're only getting 20 now
where's that print of the shape
that model's not as good with the uh but
the simple decoder
see why
see if that's expected
looks pretty similar
it shows those weights
okay this one seems pretty fast
we have four res blocks
one column at the beginning
let's see if we can go to uh 32 and it
doesn't matter
oh wish i should probably do a real you
here too
how did that start fluctuating
oh now it's slow again
i should have more gpus for more
ablation studies
peachy planets the good one
okay concluded conclusion ablating the
decoder doesn't matter
even though the numbers are slightly
higher
i doubt it's related to that
okay
that one's trained enough
let's
change the model we did the decoder
ablation
let's do this ablation
encoder stride 4.
that one should be faster
um i will call it stride four encoder
so do you see why it's faster i just do
all the striding at the beginning
let's confirm that it actually is faster
yeah it's almost double the speed right
that's cool
i like that one that one's fast
all right slightly different there
should not
this is the type of science where we
only look at the speed and not the
result yeah
that's the science we do on this channel
okay
um
okay i think we've confirmed the oblater
decode uh
the ablator
the decoder ablation is fine
is the stride for encoder fine
if this is fine then the next thing
we're going to try
is batch size 32 and see how much faster
it learns
they have something called a critical
batch size
oh
what's happening here
wow it's really not as good take a look
hmm
okay well
yeah the stride for encoder not good
lesson learned
but the decoder ablation fine
let's copy this model over
scp
sorry it has an unmemorable stupid name
okay for model here we just did this
let me confirm that that model actually
loads
and we'll commit it and we'll give it a
try on my computer
okay let's go
decoder
let's go pull this over here
now let's try it on my computer
here
oh we have to do this stupid thing
and
that
um i forget what we said
i forget what we said so i'm recording a
new thing
to listen
i forget
what we said i'm
recording our new finn to alyssa
okay okay that's something
[Music]
is it the best model we've trained no
but it's fast and that's what matters
now never mind this model is garbage
this model is absolute garbage
okay
well i think we can settle that the
stride for encoder ablation is terrible
we can try one more thing
double the comps
strive for encoder c equals 32.
so that has to kind of work like
if i'm doing stride four
maybe it doesn't work
each one just took
the ones around though it'd be fine
so
strive for encoder
c equals 32.
oh see look this one's back to working
so interesting
[Music]
so
well this over parameterizes the
channels so there's uh hence faster
we're up to 13 it's now
oh no no no it's starting to look like
that one
well
here's the other thing too
we only really care about decreasing the
temporal axis
because that's what makes the gruesome
no this is even faster than we had
yesterday today's been a waste
that's batches per second so our batch
size right now that we're playing with
is 32.
[Music]
right about in the middle
this one continues to still learn
you're going to use a conformer bro
oh
we're trying to conform
the conformer will fit in ramp
you could go back to that
all right we can also use the computer
with eight thirty nineties
we do have a computer with eight thirty
nineties we could use all right this is
terrible
like that one's barely better
that one's barely better this one's
barely faster
can we try tpu no
no do i look rich should i spend some of
the subscription money and buy tpu
credits
okay fine we'll try conformer again
of course not
we have to get rid of that
put those back
uh oh yeah what's this crap again
i'm actually not doing that commute
anymore
all right fine we have the conformer we
just need to pump up
the power to everything
we'll get the big gpu out
oh never mind we can't we can't even
train on that on this gpu
batch size 16
learning rate
this one doesn't work
wait
that's running the conformer
oh but it's because my batch size is
small
let's see how much ram we're raising
15 gigs
15 gigs
all right
distributed data parallel all right boys
i got something for you everyone's gonna
be happy
look at how many 30 90s that is
we'll have to get distributed data
parallel to work no i didn't write the
conformer code i pip imported conformer
now i'll have to copy shit over to this
computer which is a real pain
i have to get my ssh agent to work
is this going to be worth it
are we going to get a really good model
i feel like you're talking to me
no i'm talking to twitchies do they know
can you see me
no i can't see over
there ah
think about it we could put 16 on
each one of those gpus
that's like 128 batch size with a
conformer
you know one way to find out yeah right
well that one sucked
yeah 24 gigs right
this computer does have two gpus with
videos
all right all right in honor of the
subscribers we'll do it
hang on let me just do some stuff over
here let me set up my
wandy b shit
by the way this is the kind of stuff you
get if you come work at comma
all right that's gotta go there i gotta
set up an agent
um
add my private key clear ssh trainer
all right we should be good
oh fun already exists all right good
oh this one also just worked on here
great
this is what you guys pay to see
oh
all right we're gonna have to pip
install torch audio and stuff i didn't
even run that with wham
okay
we'll kick off a conformer there we need
torch audio here
can't install randy b
i never mind setting it up wasn't too
bad
very distributed training code
this isn't too hard right
oh we got a scp over the data set
trainer 02.
now let me show you guys something else
how much ram you think this computer has
who wants to guess
whoever guessed one terabyte
you are in luck
two terabytes who has that kind of ram
all right let's look up distributed data
parallel
and guess what guys we're back coding
vim
because who wants to deal with
ssa tunneling crap nobody okay
let's first just confirm that works
under the data copy yeah yeah data
copied okay
um i'll just say the models don't work
do that
all right
one through seven are very sad that
they're not being used
i'm gonna have to do here pie torch
distributed overview no no no
import this crap
wherever we create the model we gotta
throw some ddp on there
uh do we actually have to make the
optimizer distributed
um
example torch
okay here we go
equals eight
and prox equals eight
sorry i just hard coded eight everywhere
but how many gpus do you wanna train
with all the time the answer is eight
all right
i don't know what setup is
oh here we go
we don't actually want to use glue i
don't think i think we want to use
nickel
how do i know that we want to use nickel
why would you want to not use nickel
all right fine
start with world size equals two
instead of saying cuda
we can't do cool to zero anymore
um
device
equals
oh yeah let's use an f-string
rank
device
um we're gonna have a
passing in to get sample
device
ice
nice
variable master add our not set okay we
gotta set these
set them here
okay hello from process zero hello from
process one
name xx is not defined
why not
it should be defined
because that should be global
why did that not survive the fork
i do not want to have to load the data
in every process
oh it really is sublime
what
decent cloud computing for your
blockchain i just i just can't with your
people
you know what i have a good buy for you
luna
buy the dip bro buy the dip
buy the dip they're going to integrate
cloud computing i hear it's coming
give people what they want financially
that's right that's right more financial
advice buy luna a week ago think about
it
hear me out bro you go by luna a week
ago you lose all your money and you
learn the invaluable lesson that
90 of crypto is a complete scam
especially if they use the word
governance token
no no no but you don't understand the
luna secures the terror
and the terror is what gives the luna
value but isn't that just a a cycle
won't won't if people start to sell luna
won't the the backing store of terror
collapse and the whole project will just
go under because it's a ponzi scheme
no you don't understand the number goes
up that's right
all right
um no literally
okay uh we were doing something
no don't make me load the data in each
process you're going to make me load the
data in each process i feel it already
uh no i know what we'll do i know what
we'll do i have an idea
data
return data
okay so now we'll pass in the data
and then we'll pass in the data here
don't worry bro it's just pointers it
doesn't make a copy
i have no idea if that's gonna work
okay
it hasn't crashed yet
oh xx is not defined that's okay
oh i have no idea how does this shit
work with way on db
this config never even worked
okay
it of course did the validation twice
i don't know what this is actually doing
and it saved the model twice
you
uh
wait
we do random shuffle them right
oh
do
what
oh sorry
shouldn't be ranked
that divides up the data
should we divide up the data elsewhere
though we could do that
see okay now that's half as long so they
have different vowel losses so that's
good
are there two processes there are only
one now
because they both should be spamming the
tqdm i think
put it on the right device
let's just add some like
prints
it's just working
oh wait wait we have to make sure we put
the optimizer
yeah we do the optimizer afterwards so
that's fine
okay good
i think it just works
um we can use my little trick to make
sure the models stay in sync
which is to do this
should i get a hash
yeah
there's a way to put a watch on this is
there not
it was about gpu stop
all right good
okay cool
what do you think
i think we just did it
all right now we're just not using
enough gpus
let's crank it up
let's go
yeah we're getting 10 it's we're getting
10 minutes at batch size 16 but that's
16 per gpu
and you can crank the learning rate too
oh probably not that much what
cu dnn status not initialized
i hate errors like this
why is this a thing
was eight too big
four
hmm
four's okay
the other dirty 90s
all right let's see how our conformer is
doing on land
what the fuck
okay there's our conformer
it doesn't look good
because it probably takes a long time in
order to learn because it's big
all right um
why did something initialize on each
why is there something all on gpu one
get out of here
okay
eight gpus
hmm
wow it's pretty nice to have eight gpus
they're so powerful look how fast it is
so fast now
now how about wan db what do i do for
this
multi-process
only call wan db init and when tv log
from a single process
like
we'll be even faster with batch size 4.
check out this conformer oh it's
starting to learn something
wow conformers are good
yeah i'm not using pytorch lightning i
tried and like importing it failed
how long to train gbt3 on one machine
not gonna happen bro
let's control c this
but
because we want to get wan up
and all should be good
last time you were here we hated
conformers well now we got the giga
machine that has
8390s in it
oh we probably only imported in the one
whatever
we called wendy b log i forgot one
somewhere did i not
i didn't apply i did apply but i don't
care what am i gonna do with that
all right
8g views
that's the truth about machine learning
you know you can't be clever to make it
go fast you just need to buy more gpus
and stop being cheap
imagine if instead of boarding loot
buying luna you bought gpus
you'd lose some money because they're
going down in value but you know
hmm
wait what
what
no come on
come on you won't do that
cool blast internal error
did one of the twitchies do something
oh did i want popcorn yes
no
the the thing crashed i think the
twitchy said something
for five minutes i leave for five
minutes
what is this error
should i just run it again
do i think the microwave is gonna work
oh
okay now we can do this let's try this
want to go outside it's gorgeous
i don't know if this was the problem but
it can't hurt to do it then actually we
can move that split
outside
no we can't never mind
uh range
split range
we could split the data set
and do anything else weird right
you feel like in pi torch every error
means your gpu runs out of memory that's
a good point
um you know what let's run wan db on
rank one doesn't matter
zero i don't trust zero
tiny voice isn't so tiny anymore it
turned out that you needed
uh
you you need uh
8 30 90s
in order to do voice
oh look how's the conformer coming
whoa
not good yet but i feel like it will be
good
what's the name of this one oh i didn't
run it with land equals one
why didn't you guys
yell at me say george
you have to run it with one equals one
also i feel like there's still some bug
because if you look all the processes
are still initializing gpu
zero
i didn't leave the word cuda in here
anyway did i
oh wait did i
no two device that's right
that's right
see look look at how they all have some
ram on the first one
and first gpu is full
i feel like i've looked into this before
oh
only if it crashes again
it doesn't crash we don't care
this one does have a name right
okay amber flyer fly 40.
let's compare it to that conformer
whoa
look at how much faster it learns on
eight gpus instead of one
this is what we were doing wrong the
whole time
we just needed to buy more gpus
it's not fair you know there's people in
the world that don't even have one gpu
you know that video i have three ps3s i
love this video
present
now of course the big ticket item this
year is that morning playstation 3.
unfortunately due to small allocations
many boys and girls are going to be very
disappointed when they look under the
christmas tree this year
i however will not be disappointed
before you see
i
have three ps3s
so what do i do first do i play video
games do i
watch a blu-ray dvd do i download
content from the online marketplace the
answer is of course
yes
all right wow look look at how fast it's
learning
oh my god why do you do anything with
one gpu when you you could do it
with with eight gpus and you can learn
like like eight times faster
ah
oh you know i knew it i knew i knew that
this was happening that nothing actually
works if you only have one gpu and then
you need to have eight
and then we're gonna use eight gpus for
like if you train a model on eight gpus
for like two days it's gonna be so good
look at this it's already learned how to
read
oh then we're gonna figure out how to
get this model back to my computer
oh it's so powerful
my mac
these models aren't even big they're
just good
should we just make it bigger is that
how to do machine learning
i have heard that making things bigger
is better
look at how fast it learns did we set
that parameter right i don't even think
we tuned it
oh this computer's slow now because
we're
it doesn't explain it
i don't know why it's locked
something smells off with the popcorn
there you go
there we go
are we done with vs coat well do you
want to figure out how vs codes with ssh
tomo i don't
know
yes
wow should we just add more data too
i'm not only a huge death stop
i do want to point out
that oh wait never mind
this model is already better
amber firefly 40.
uh
so
let's look at the conformer paper so we
can better understand what we stole off
the internet
and then ran on eight gpus
wow
can we talk about how
it doesn't mess up and like put spaces
where the spaces are supposed to go
yeah my model didn't do that
yeah it's really good already i know
i mean i shouldn't be i just stole it
it's just google
it came up with this model and we just
fell open them
look at that
then we ran it on eight nvidia gpus
dirty 90s learn english
my god
look at that valos it's .85
guys
this is just
we spent all stream hoping that
with some little trick we could speed
the model up but the truth is you just
want a really big model and a lot of
gpus
and
the moral of the story
is don't be poor
this was all just a roundabout wave and
dunk on the pores
everything is
all right
i don't want this much
you're done
i'll have whatever yourself
the rest is for me all right
let's get to epoch 25
and then we'll run it
um
on my local machine
[Music]
thank you thank you you know if he was a
beam search decoder oh
mmm the ship is so cash all right 25.
i was scared just like copying and
pasting is kind of near the uh control c
and the last thing we want to do is
control c
let's leave that check commented out
conformer is good
[Music]
okay let's go back here
it's not even big like weights
ever unloading state deck
why
hmm
oh i know why
we have to like pack packet for ddp
um
great
okay
this is what conformers can do when
properly applied
this is what conformers can do when
properly applied
[Music]
no no no we can't put none in there um
make that a torch cancer
this
is law conformer can do when frovali pro
that's pretty good
encounters testimony experts
um is this using the proper
this might not be even using the proper
loadings yet
it's not even the proper loading sheet i
don't think
oh no i guess if i import from brackets
right
yeah we're good for league right so
that's right
all right i still gotta trade more
69 look at that
so small
so small
[Music]
a gpus
it's just not fair
that's not fair
how much better this model is than the
other ones
well
no no this data doesn't only have a
single speaker this is uh this is libra
speech
which has many speakers
five shots may have been fired
actually the validation comes from lj
speech
not the val loss validation all right
there's like a way that i can like
tunnel through a computer right it's
like a good way to do that i don't know
how to do that
i'll just
commit it again who cares
but all those models are going to stay
in history forever nope we're going to
rewrite the history someday in the
future
oh that's pretty good
this is all right let's try something
what do you want me to say
i have eight gpus
with eight gpus this works
i have eight gpus
with eight gpus visible
i have eight
gpus with eight gpus this works
um
maybe we want to put a groove after the
uh
after the conformer
is this how google did it or we just
need a bigger conformer or we just need
to let it train longer
it's like it's kind of learning how to
talk
me
oh
it's way better than the validation than
on my voice yeah don't try saying
something for it
i just speak and what's it do
it listens to what you say
well you made a mistake for a woman
what
is it like therapy
yeah
yeah maybe
speak loudly ready
three two one
where do you wanna go to dinner later
all right let's see if there's any hope
of that
bin ito a tin wreck
what didn't understand anything i said
where do you want to go to dinner later
i do feel like siri never understands me
where do you want to go to dinner later
lara do you want to go to dinner ladder
end
alex what
you know what the problem is what we're
only training on eight gpus more gpus
then you guys know that i have more
should we get more
and we might need a bigger conformer
trained on more gpus
oh you need to use british accent
[Music]
well that does help my dad made siri
british and it sounds so much better
perhaps for dinner we'll have some
bangers and mash
perhaps for dinner we'll have some
bangers and mash
perhaps for dinner we'll have own
pitters and math oh it's close yeah
um
all right
so
what's the lesson the lesson is that
there's no way to make machine learning
fast and you just need more gpus
and like why are we only using eight
it's only because eight fit in a
we're computer by the computers now like
someday we're going to have future gpus
well it's like
you put eight of today's gpus inside one
future gpu
and then you'll put eight future gpus in
a computer
that's true
yeah but like if you look at the
conformer trained on one gpu it's not
good
like it doesn't really look anything
better than my model it just turns
slower
wait a second
should we just train the old model with
eight gpus
was that what it was missing all along
it's not even gonna be faster though
what do you mean it's really close no
look at the one with eight gpus it's way
down there
the conformer is really close yeah
i mean no it's it's doing better
and actually the training just looks a
lot stable i bet i could crank the
learning rate
so
how many watts of power are we burning
for this
a lot
wow look at like it's almost all the
words right
yeah i'm using scheduled learning right
i'm using i'm using one cycle
purple one's up here
uh
okay we'll get to epoch 65
uh we'll transfer one more model
i don't even think these models are that
much better
they are
a little bit
12 cents a kilowatt hour not in san
diego
where
it's like two dollars
what if it perfectly understand google
translates voice
okay let's try it
can i do this
what if it perfectly understands google
translates voice
what if it perfectly understands google
translates voice
what if it perfectly understands google
trans
so what if it no no no no freddie lee tv
doesn't look right
we can try something very quickly which
is to increase the volume let's just
crank the volume up
by multiplying by two
where's the thing we'll multiply by two
times two
oh
we should probably do volume
augmentation
okay lesson learned we need
how is it so good on validation
this is not only not in the training set
it's not even it comes from lj speech
it's not even from the same data set at
all
also this is a this model has been
drained a lot more so let's let's just
uh
we'll save it a minute
and then you're not going to like what i
do next we're going to kill this one
we're going to start another one
training and then we're going to end the
stream
and you guys can watch it on my weights
and biases
um
wait somebody should sponsor me they
really should
weights and biases they should sponsor
me i'm shilling for them on my stream
weights and biases they should sponsor
me i'm chilling for them on my stream
wait sam biases fisher sponsor me
answer the oldest tree
um
ctrl c
put those back in
let's do a quick test and see if that
works
okay what are the parameters for this
even the small conformer
i don't know why they use 32 but i don't
think that matters two heads
use 16 layers
and what's the ffn dim
that's 128.
let's double that
let's use 12 layers
also yeah i could get that fixed the
problem
see if that fits on the gpu
there's only six megs
it's a little bit slower
all right
what's an encoder dip
is that a vendim
i was probably decoder damn
i don't know
see how
much are they also trained on more data
than me
wow look that one almost already talks
without even any initialization
okay
that's a lot of ram
okay
when equals one
big
let's label it correctly in my weights
and biases and then tomorrow we'll be
back
maybe probably
and we'll see if this model is any good
maybe tomorrow we can try some talking
but we have a very sad takeaway today
and that's
um you just need to buy more gpus
large model
long time eight gpus
and i have an idea that one's gonna win
because how can you compete with all
those things combined
pro tip you can't
look at how much faster large model
learns
oh can i train it a bit with my own
voice oh you want to transcribe some
stuff yeah we could
we could we could make a training set
um
yeah
come up with ideas
um
[Music]
and
be ready to uh suggest them in the in
the stream tomorrow uh if you have a
really good idea uh you can email
georgiacom ai uh and if your idea is
really good we'll we'll
what
it crashed
what
twitch
the trainer
she's like mid-sentence
fine 12 layers
i think it's because it ran out of ram
i don't know
why is that one used less ram now
play old stream back to the trainer yeah
but you know where we gonna get the uh
ground truth
okay guys
thank you for watching today's stream
uh
we will quickly let non-subscribers talk
and hear what they have to say
but only quickly
hi taj
why does lilac universe have different
loss
it's a little random
32 gpus is a good number
it's probably a good point 32 gpus
look i'll try a tense torn chip as soon
as i can buy one
don't hyper parameter tune too hard yeah
that's probably right i just want
models that are fast and good
why does sentence coherency degrade it
shouldn't
um are a100s faster not really
they have slightly larger caches but
otherwise they're pretty much the same
this is a six megabyte model
i could use stride equals stride plus
one
what does that mean
or you're saying just stride it more
he's a language model on top of a
decoder yeah i mean these other people
are getting great results with uh
you know we could try tomorrow
that's just going to work less
yeah the atps are connected with i
should be able to print out the
topology
yeah
so
these pairs are linked with nv4
um
these are linked with node
and then
these have to go across the uh smp
interconnect so it's got to go across
qpi unfortunately
but hopefully nickel is pretty smart
about
oh i can make it tiny oh you're trying
to make the code tinier
it's not gonna make the net faster
thirty nineties cost four dollars an
hour and not when you own them they
don't
overclock them make them faster
can our company hire foreigners
yes uh
are they water cooled no i got fans
you know every time i do this kind of
stuff
i want to start really diving into like
why things are slow
i'm gonna merge that guys
uh some people took cheap eats way too
seriously
um
what's gato ai
is it cat related
[Music]
oh
well the music also got real bad
is our model based off our pre-built
neural network now we're training from
scratch
yeah
d mind always has good stuff this is
this is probably like
this is like the right way to think
about this stuff
there are significant benefits to using
a single neural sequence model across
all tasks
[Music]
what's the problem with deep diving into
why things are slow
we could do this
[Music]
i don't think that you can just use
remote gpus like that
this isn't like leela chess where we're
doing rollouts of anything we're just
actually just training
i'll notice that look
the model with 12 layers has already
passed the model with only four layers
so the difference between purple
and light blue
is just how many layers the thing has
okay maybe
imagine if i could see all the power
draw combined
is it so hard to multiply uh
mozilla made what's this
deep speech
oh this paper's old
no i just looked at the date and it was
2014.
uh then microsoft made deep speech too
yeah wave to vect too i know they're so
good now
wave to victor was
just just you know what i was reading
that paper last night so we'll bring it
up
marcel bischoff good to see you around
again
okay
ah
here we go
oh we cropped 320k audio samples
and train on
128 v 100 gpus over 2.3 days for libra
speech
so yeah
answer buy more gpus
question
i don't know it doesn't matter
yeah time to buy 120 more gpus wow you
know when you put it like that
or you have 128 v 100s
where
wavenet use 10 gpus
didn't even mention how many gpus they
used
doesn't say
search tpu
no
to watch it you need to donate a gpu
i mean this does just make me think that
we really need to get good as a company
at uh
at scaling these things
big
that look it's already better
same batch size same everything
[Music]
look at that just how do you compete
pro tip you can't
unless you have more gpus
look at that
look at look looking so we're looking at
the blue one here
the blue one here is the 12 layer model
um
ah
oh i could write other accuracy metrics
but doesn't really matter
all right tomorrow do we want to do a
really deep dive into why deep learning
is slow
and then make it fast
does that sound like a good stream
we did we make some progress today
look at how good the blue model is
are you okay
i think the trees are worth cutting down
for gpu
wave to letter
whoa
i have to build it
[Music]
oh this is old
okay this is just fully convolutional
you wanna try that tomorrow
let's try some fully convolutional
models
oh they're also using beam search
decoders
beam search decoders might improve
things
also adding more data
especially now that we have eight gpus
i can't get over it
by the way i just want you to remember
that this this pink one here
is the same conformer as this purple one
just this one was shown on one gpu and
this one was trained on eight
this one is the conformer with instead
of having four it has twelve
um
all right guys
thanks for watching
uh we'll stream again tomorrow
and we'll get something that nicely
decodes my voice is that what we should
do tomorrow hopefully
and then we can look into maybe why deep
learning slow
uh
i don't know what time tomorrow i'm
going to walk in the morning so maybe
tomorrow night
tomorrow evening if i stream again
otherwise this is the end
and i hope you guys have all learned a
lesson your model is too small and you
don't have enough gpus thank you for
watching
Welcome to My
Stream It has been a
while all right everything kind of looks
good let's wait for some people to get
in here what time is it in America right
now time in San
Diego oh it's 900 pm on Sunday I say
hello welcome welcome to my stream I
know it's been a while
uh I moved to Hong
Kong uh yeah this is this is the tiny
Corp office
here uh you know if you're see me on
Twitter
uh you know I've been
uh uh pretty
disillusioned with the uh with the
American
Empire uh you know I don't want to be in
town for the stupid fucking
election uh I just
like you know look I'm not like I'm a
real I'm a real Centrist
politically uh my take is that I want a
stable set of unchanging rules uh that I
can function under uh like every
businessman all I want is stability
uh which candidate brings more stability
that is really
unknown um all right so I'm using Brave
here as my other browser let's disable
can we disable all this crap I don't
want any this
crap uh open the new tab page okay how
do I make the new tab page blank oh my
God Brave rewards which is this
shit uh Leo is this some is this some I
don't want any web three
I'm I'm going to regret using Brave
already I I can tell I can tell I'm
going to regret this garbage uh you know
I like I like uh Brandon Nike
uh you're shill you know what they have
a token why am I using a browser that
comes with a token well we're going to
deal with it but you're going to hear me
complain because listen whenever someone
DMS me and they're like I have a token
all like like like like like like you
can also just DM me I am a loser and a
sellout right like it's the same you're
saying the same thing man all right
uh why do you constantly rewrite shit
all the time instead of releasing
something and being relevant oh no I can
be relevant for a 3mon hype cycle like a
token or do you want to build something
that's going to last 10 years right uh
this was I think this tweet was
underappreciated you want to talk about
the real reason for the fertility
crisis it's uh uh that nobody has a
30-year time Horizon anymore right like
kids just don't pay themselves
back
um let's get Firefox and new block well
yeah I use Firefox and newblock as my
main browser but I have like a main
browser and a streaming
browser uh it's not 9:00 p.m. here in
Hong Kong it's actually 12:00 p.m. here
in Hong Kong as you can see from the
upper corner of my screen oh no actually
maybe you can't oh you
can't I have to my screen is 4K and
we're going to have to downscale it here
to fit my entire screen okay good sorry
for moving everything
around we're getting a new streaming
setup going here uh yeah know I moved to
Hong Kong uh W
chongin uh timu
dong Bai how
uh yeah
uh no no man Mandarin uh I don't know I
don't know about Lon C though I'd really
like to be able to speak
Mandarin I kind of like as much as I
retweeted the robin Hansen thing about
about culture it's
like you
know it might just be kind of over
oh don't be an American
declinist I
mean it's not like I'm a Perpetual you
know everything is doomed forever
but
like things just really don't look
good
um you know you you
have all sorts of problems that really
look like problems that are reminiscent
of the of the Soviet Empire uh most
recently you know this is why everyone's
so obsessed with the Roman
Empire
um CCP watching all right look I'll tell
you guys right now my honest take on the
CCP
like and I'm not like like this is this
is this is Hong Kong like you know I I
maybe maybe I'm not allowed to criticize
the government but
like I told told you what I'm interested
in I'm interested in business
stability uh so yeah I
mean what does it what does it mean when
the Chinese Communist party uh Embraces
capitalism more than the United States
right like you want to talk about what I
respect uh we did a we did a popup in
Hong
Kong um and look I'm
uh you know I'm not I'm
not uh I'm not married to the place and
you can you can watch all my historical
stuff for the CCP I'm not saying
anything different just because I'm here
um
where is
uh no I don't want per person person's
less important than you
think um here we go now this
is oh wow okay well I'm using Brave
search which sucks Google sucks too but
you know marginally
less for source
electricity production data breakdown by
countes terawatt hour can we see this as
a
chart no that's a
picture um oh this isn't our world in
data can I see it from our world in
data World article database why is
Google so broken
share of electricity generated by low
carb oh my
god um data
Explorer access to energy energy mix
renewable
energy I found this no problem last
night why is it so hard does someone
just want to link it
per capita electricity generation yeah I
tweet uh no I didn't I retweeted
it uh electricity generation here we go
chart oh yes yes okay so um you know as
you can see here uh the United States is
doing uh phenomenally well look look at
the United States compared to everybody
else you know India is growing a little
but they're not going to come catch am
until you
enable China
like this is what I
respect I don't care if you call
yourselves a communist or
capitalist basically I'm here you know
to produce value don't fuck with me and
uh you know I want to live in a rich
Society yeah yeah so like you know here
you go
again
um the US has an interesting lead in
software uh and a lot of the reason for
this is software is pretty
uh the US basically like brain drains
the world right you can go to you can go
to any American software company and you
look and there's a lot of Chinese people
a lot of Indian people right and uh you
know the US has done a historically
great job of this um immigration in the
US now is an absolute joke right it's
it's it's I don't
care the idea that you know you should
have a uncontrolled Southern border
where anybody who has the balls to come
in can come in is the stupidest
selection function I've ever
heard um you know it's just it's beyond
stupid I don't I don't care I don't care
if you're if you're left leaning or or
right leaning I I I it's it's just the
dumbest fucking thing I've ever heard
and that's the American Immigration
policy and when I want to bring in
Engineers to work at tiny
Corp oh that V has been declined
and okay okay you know what I'm like if
that's the rules I'm
like this is It's R like it's it's just
it it it makes any sensible person just
not want to play the game anymore um and
yeah unless something majorly changes
look I understand why elon's investing
all the money right I so elon's America
pack uh Elon thinks he can fix it right
which is which is which is kind of crazy
but I I think it's gotten to the point
where it's really hard for a normal
person to ignore
now um and I'm not you know I'm not
uh siding with either candidate I I
think that the whole process is
like I mean here here's the
real uh I don't know how I'm going to
find that um I I tweeted that picture
about uh let's try see if I can find it
research
gate uh
lifetime value production consumption
person I don't know what's this
good uh I post it on my Twitter does
someone want to get it can someone get
it and post it in chat
China's literally falling apart right
now uh it doesn't look like
it doesn't look like
it it looks like America's been uh you
know stagnant since
911 I I don't know if China already won
the
game um I think that
you know if China's where the part is
moving to are you invited if you're not
Han Chinese right I haven't
uh I haven't heard an answer to that to
that
question
um yeah I mean I I don't the the truth
is I you know I can say a lot about the
American Empire I I was raised there I
lived there my whole life I can say a
lot less about the Chinese Empire um I
don't really know I mean there you know
know people who lived there and people
have opinions on it uh but I I mean all
I will say with high certainty is that
this data is not
fake T so
slow no no no no no no no I don't want
want that one I want the one about
uh no I I want the one about uh the old
people right I mean this is this is the
other major problem and to be fair China
suffers from this somewhat
too
uh yeah we can see it every day it's not
fake data right you're buying your
you're buying your drones you're buying
your phones
uh yeah this I mean what's also
interesting is this shows the incredible
uh you know just to be honest the
incredible destructive nature of the
medical industry right if you extend
people's life five more years uh I want
you to just think about this area under
the Curve
um
yeah that was kind of
old it's a little more
recent here we go it's from the CIA
that's
Brazil W thanks CIA
Salt Lake City why why are these search
engines so bad okay why I got to change
the default from Brave search this is
useless God this website this page is
offensive why am I even trying this
browser do I want put chromium back
on
um search
engine Google Google
yeah okay that's uh so you know you can
kind of overlay this with that right and
now let's uh Nigeria population
pyramid all
right so um
yeah just 2019 is a DAT can we get a can
we get a more recent here demographics
of Nigeria okay
2020 all
right um so I I
mean uh is China's
worse and I think China has this problem
too
yeah I mean they definitely have the
problem
too look I'm not saying that
like uh you know China's the future I'm
kind of I'm kind of deciding which
empire to bet
on people really have no idea what
mainland China is like so I've spent
over a year of my life there
there um I don't know if this is
something people know about me but uh
yeah I used to uh I lived in Shenzhen
for a
bit
um have I tried to do business there
well I haven't tried to start a business
there but most of our suppliers at comma
are Chinese uh and I would
rather uh even if two suppliers are the
same price if you can choose the same
price between an American supplier and a
Chinese supplier I'd rather the Chinese
supplier I find the Chinese supplier to
be more honest and straightforward than
the American
supplier um how have I lived there
without Mandarin you know you hang out
with
xats uh I was there a long time ago it
was 10 years
ago
uh if you're trying to do business you
have the corruption inside track and it
sort of works I mean yeah you know there
there's an interesting there's an
interesting uh saying about corruption
and it's like you know in Mexico yeah
there's corruption you got to bribe the
guy and bribes are maybe 30% of the
project right uh so you know for every
dollar you spend you got to spend 30% on
bribes right in America we don't have
corruption you know how we know we don't
have corruption for every dollar you
spend on the project you have to spend
another four proving that the first
dollar was not spent
corruptly that's right no corruption in
America uh
is easy to get a visa for China yeah if
you're an
American um if you're Chinese it's not
your company anymore well if you're
American is it your
company right what if the what if
America passes a wealth
tax is it your
company
um I don't think uh
I don't think uh it's your company in
either place no I look I think there's
definitely uh downsides to that I think
that the
uh again what I'm interested in from a
regime is long-term
stability uh yeah I I spent I spent two
weeks biking around India uh not soon
maybe someday but not
soon uh okay so you go to prison for any
infraction uh in China so let's look at
China uh number of people are in
prison so uh per
capita okay so the prison rate in China
is 118 per 100,000
and then in America it's 531 per 100,000
so all else being equal you're more than
four times likely to go to prison in
America than you are in
China you're talking about a business
infraction if you don't pay the corrupt
taxes uh I don't know how much business
you've done in America but I promise you
it's not
better from authoritarian countries it's
an interesting
term what makes you think that uh
China's an authoritarian country and
America's
not who's not an authoritarian
country uh no I mean look again there's
definitely
criticisms right I I don't think that uh
you know there's there's concern about
the way the Jack ma situation was
handled
um
but okay so uh you know we there that's
my take on the election uh I'm not
endorsing a candidate I'm just saying uh
you
know again I have so much respect for
Elon for actually going out and trying
to fix this shit
uh you know I'm not that uh I'm not that
bold of a
person
uh all that's
good all right so what is tuni
grad so tuni grad is kind of like teig
grad if you've seen teeny grad uh teig
grad is a subset of tiny
grad um and I have this little script
called import from Tiny grad and we
import a set of uh things from Tiny
grad that are just going to be the same
so I've basically ripped out the
middleware uh we can take a look let's
check out
Master let's pull oh also check out this
terminal it's called kitty it's GPU
accelerated it's a little rough around
the edges in some places but it's uh
it's fast like they they care about the
thing that you should care about in
terminal which is when you press a key
uh how quickly does it
uh oh I I mean I was in Shenzhen two
weekends ago 80% of the cars are
electric the streets are so quiet it's
actually
unbelievable
um I don't mean to you know I don't mean
to be a shell I think that one thing
that America really has going for it is
that it is the land of opportunity and
that you know you can take someone like
Elon who immigrated to America and built
successful businesses there and that
alone is America if America Embraces
that America can be
fine the idea that people around the
world want to come to
America
and build something
there is is the entire engine that's
powered America for the last uh 200
years and I see both political parties
pissing it away uh and it makes me so
sad I mean there's nothing that like
really upsets me more than watching
what's happened with with with
immigration where where you let where
you let a million people without ID
cross the
border and uh I want to bring in uh
several uh very good coders and pay them
six figure salaries and I can't Okay so
you
know in in in in 10 20 years when things
play out the way they do and people are
asking why everyone knew right I could
have told you 10 years ago what was
going to happen with Google too right
like it's all the
same it's it's it's so obvious it's so
obvious but nobody can correct it
uh yeah I think America has a better
legal system I would trust the American
legal system as bad as it is more than I
would trust the Chinese legal
system uh you know I would trust America
to uphold the rule of law again one of
America's really good
strengths you know another thing that
you have some questions about right you
see you see the
uh you know you just you look at the uh
you look at the Trump case you look at
the Trump case
and it's
just is this is this what this has
become this is this is and this is never
going to stop right every every every
you know two bid party hack is going to
be weaponizing the justice system
against the other guy that's the end of
that's the end of rule of
law uh no doubt rule of law in the US is
declining yeah I mean these are the the
things if if you had a a system where
you had simple vetted immigration for
people who wanted to come there and pay
taxes you had a strong commitment to
rule of law but the problem is so many
of these things are based on uh trust
are based on trust that they aren you're
not going to get rugged and that's what
America had going for a long time and
honestly it's harder and harder to
believe
say the leader looks like Winnie the
[Laughter]
Poo look I'm a guest in their country I
don't want to upset them uh there are
some things that are you know a little
stupid right a little
uh you know in general people who want
to uh who want to censor speech you know
it never ends up good for
um I think the UK is way worse uh the UK
is so far down the decline cycle like
there's
still you know am I renouncing my US
citizenship no even though I have to pay
taxes abroad even though you know the US
is the only country that if you're not a
resident in the US you still have to pay
us taxes uh and then if you want to
renounce your citizenship thanks to
Eduardo Savin I shouldn't say thanks to
Eduardo savn but after Eduardo Sav
there's a 25% exit tax and you know you
can look at us renunciations over time
again these are really bad signals uh
for your
Empire um I don't know I I I don't know
how to fix it um if you are in a swing
state uh you
know well I sure as hell no one group of
people ain't going to fix it not saying
the other group of people's great but
one group of people's definitely not
going to fix
it right it's kind of like AMD with the
drivers in order to fix it you first
have to acknowledge there a very serious
problem it starts with being there
uh I spent a lot of time there um look
Comm is still based in San Diego uh
we're still hiring people for San Diego
and look I'm rooting for it I want it to
turn
around uh
but there comes a point where where you
got to start to where you got to start
to hedge
uh yeah we might be at that point I'm
not sure if we're at that point um but
you know uh yeah commas hiring in uh in
San
Diego uh just say vote Republican if
that's what you believe uh there's a lot
about the Republicans that I really
don't
endorse um I've said this before on
stream it upsets people but I'm sorry I
think that the pro-life stance is one of
the absolute stupidest
stances uh not even about what you
believe it's just not it's it's not a
good position it's like being against
gay marriage right like like it's not a
good position don't don't you shouldn't
be you shouldn't be doing that right uh
you shouldn't be you shouldn't be uh
right because you just you just you just
turn a lot of people off right you're
against Freedom right and you you want
to generally be Pro Freedom as much as
possible uh so yeah you know it's it's
hard to it's hard to uh you know say
that um I I would uh i' I've given my my
political endorsement and if uh people
like Robin Hansen and Brian Kaplan uh
got together and started a political
party that is who I really endorse uh we
need the the lequan U of America but
make it look less like a shopping mall
you know lean youba with a bit of
grit
uh I mean unrealized capital gains tax
will actually be the end of
America that's that's just that's that's
Francisco Dean conia and the copper
mines
right um
they want to reset and to build a world
government yeah but they look kind of
pathetic now they might want that yeah
the George Soros people of the world
might want that but like you know they
just kind of look like clowns
uh I'm starting to agree more and more
with China every Tech bro to talk about
politics should be
jailed again you know I I think that you
can choose between uh
you can choose I would rather live in a
place with no political freedom and free
exit than a place with uh political
freedom and an unstable
system no I'm not against it because it
affects me no I'm I'm a Believer in the
long-term
Prosperity uh of America and uh you know
it is that long-term prosperity
that will is not for me or my type of
people and you know the people who think
that way I just you're losers you're
real losers
uh uh
say the wrong thing in China and go to
the
goag I don't know about
that uh agitate be a be a political
agitator and go to the
gag you know there's a reason people
want that there's a reason people want
systems like that
right Robin Hansen is is is an economist
yeah
um the twitch Chatters talk about
politics it's sad you know it's just
it's sad it's
sad
uh Microsoft 3 Mile Island restart
all right should we go subscriber only
in code I'm go to the bathroom
first be right
back
for e
okay first we're going to go subscriber
only oh we already did that great guy
Ross thank you good thinking okay um
so uh like I said tuni grad is just a
straight up import from Tiny grad except
we're not copying the code gen or the
engine directory and you can kind of see
I started it a little bit but barely um
so it's just a straight up copy of these
files and actually you know what we're
just going to actually uh we're going to
delete
tunr uh just so you guys can actually
see how it works I you like when I start
off scratch okay
so we just have this script import from
Tiny
grad going to import a bunch of files
from Tiny grad uh tensor the main tensor
function function which is the uh
forward backwards helpers or just a
bunch of like Little Helper things dtype
which talks about D types device multi
which is a multi multi device multi GPU
uh the NN Library which is just
optimizers uh a bunch of like Comm
functions data sets is C far and mest
you can look I'm particularly proud of
uh how beautiful and small that file is
so we can see
it's it's tiny here uh that's M this
data set C data set um State like safe
tensor support Ops which are uops where
a lot of this UOP stuff lives the
symbolic pattern
matcher uh
and let's Commit
This fresh
import uh you can follow along with
tunig grad on
uh
uh it's on Tiny grads
GitHub okay so we'll start with the fact
that we can import lazy buffer from
engine uh so let's create engine here
let's create a file called lazy and we
have a class called lazy
buffer there's an argument about lazy P
should actually be you up but so I'm
just rning beautiful mest this is
beautiful mest copied in from uh tiny
grad it's in tiny grad examples uh so
you can see it's
a um how come I can't from tun import
tensor I don't know
but we don't have tunig grad uh now we
don't have tunig grad uh realize so
we're going to need realize
here
um realize. P we need a function called
run
schedule and we need a function called
memory
planner get to what these things do in a
minute first let's just create them so
we're basically rewriting all of tiny
grad's middleware uh in such a way that
it's going to be friendly uh to the
cloud service we're talking about so
yeah we're building a building a cloud
service okay get what that is in a
bit okay
cool uh cannot import tensor from tunig
grat unknown location did you mean
tensor I did not but the reason for that
is that we don't have a a nit
file from
trinad tensor import tensor that just
lets you import jr. tensor okay great uh
type object lazy buffer has no attribute
meta
op okay so we're going to need an
attribute on lazy buffer called meta op
class meta op meta
op uh okay that looks like an OP
shape D type
device actually it's a static
method okay none type object has no
attributes
size uh so what are we going to do about
this op shaped D type device we'll print
the op just print
them should probably be using something
like copilot to do that for
me copile on that I don't know I'm not
I'm not big on using any AI coding stuff
yet oh one is the first one I've seen
that could code it
all H okay so we're creating a empty of
one so let's add a
UOP uops are kind of like uh sources
I'm probably going to want a shape
tracker in
here um so let's add a UOP called
empty and we want empties to
be
unique twitch streams worse than
USA why why even do we need an empty
empty doesn't make all that much
sense I mean I don't know let's try just
returning a lazy buffer
I almost want the lazy buffer to be a
sub class of UOP and we can get into
what UOP is in a bit from tun op support
UOP we need an OP
do we have a one called
buffer we have a knob called
buffer I don't know why it's still in
there I'm not sure is that used in tiny
grad we shouldn't really
tin uh all right let's just create a
buffer
dtype
uh no
sources well maybe our source should be
a shape
tracker uh so read the docs if you want
to understand what the shape tracker
class
does a little bigger for you guys
so I guess our source for the buffer can
be a shape
tracker to
UOP that's right right cool uh and then
no Arc okay
cool okay lazy buffer object has no
attribute
size
um there's a way to get size here so
there's something here called Full
shape it's probably not exactly what we
want going to kind of need something
called
shape we can totally put shape and size
on U up so the the idea is kind of that
we're moving everything to U up
um do you guys know what uops are do you
want
to the basic UOP is just an OP a d type
A source which is a bunch of uops and an
arc uh and you can pretty much Define
everything based on those tiny gr has
moved a lot to be based around this
pattern matcher which will say things
like um you know if you have a UOP plus
zero it's just a UOP if you have uptimes
one it's just the U up U up divided by
itself is one right so these are just
like pattern matching rules on the
uops um so tiny grad has this class
called lazy buffer which is not a you
up
um yeah so we're probably going to want
some stuff added to U UPS maybe I'll add
them to lazy and then we can move them
later uh let's make a
property called shape
yourself where's full
shit I guess we want to
search okay so we want all
same all say
uh tex.
Source if self. op is uops shap
tracker I already have a helper function
to actually get the shape Tracker
[Music]
out okay we can actually just
do that's kind of annoying that I can't
actually just run that on the shape
tracker
we
h
so a shape object is a tuple of Sy since
are symbolic integers which can actually
be a UOP itself but it's not a big deal
so UOP
sent uh so here we'll just say do a oh I
actually this fun I think I have a
helper function called unwrap that
basically already does what I want
want uh yeah wrap there we
go we just want to assert if it's not
because some Ops don't have a shape
track some Ops don't have a shape so
only shape trackers themselves have
shapes
um do all same return something forget
if it does no it
doesn't uh
if self.
Source no it's like kind of okay if they
don't
uh you see what I'm writing make any
sense
five okay we want to filter out the ones
that are
none
um let's think about this for a minute
so you can like multiply by a const and
that's
okay
um non shapes
equals X for x and shapes if x is
L shapes
zert that's just
fine
umt length notown shapes greater than
zero and all same shapes okay
cool no size but size is just
we have a helper called prod you guys
see what helpers is now
right send return self. shape
prod okay cool uh UOP has no attribute
get shape we actually have to put these
on UOP
unfortunately not on lazy
buffer so we have this function called
Full shape these
you Up's getting kind of
crazy uh shape tracker is not Def
Str Str should uh should support ship
tracker too I think
we can also cash those
properties I cash that
property no we
don't I like that there's not like a
cash property
there cash property is crappy anyway but
we want to like cash the return from
that I guess I could just make it a cash
property and get rid of these
because we don't want that uh you know
this can if without a cache there that
can uh be
exponential okay uh lazy buffer object
has no attribute buffer okay that's a
good that's good
uh we should add it to do here uh to do
handle reduce
access is this stuff making
sense like do you see what we're doing
we're we're rewriting the whole middle
part of tiny grad
um you you can read the equivalent class
in tiny grad and that's like kind of
where it uh you'll understand why I want
to do this
refactor
um you
should if you're trying to follow along
on this stream how many people we
got uh how many people we got 338
viewers
uh if you're trying to follow along I
recommend looking up what uops actually
are
uh and watching them
on and looking at what they do in tiny
grad because it's the same UOP that's
here all right you want a little you
want a little demo show you a little
demo of
uops let me move my face up here you can
see demo of
uops
um let's just do a tiny gra okay so uh
from Tiny grab. Ops import UOP uops okay
so UOP let's say I can create like a UOP
const right um we also need dtype so
from tiny. dtype import D types okay so
we have a function called UOP const look
at what it is here in tun bag because
it's the same
thing um so con takes a d type and then
a con type so I can create like an
integer call it
a and let's make another integer
five okay then I can do a plus b right
so uh a plus b uh and then oh we
actually want to get a value of a plus b
well I can do in a plus b and get seven
right uh we can also do BU a plus b and
get an error because it's not a boan but
if I were to do something like a plus b
less than
9 right so we have comp LT less than all
right I'm going do Boolean on that is a
plus b less than n yeah cool great um so
that's what uops are uops are kind of a
symbolic
uh like you can like track stuff in them
right A plus b * 2 there we go this
there because the two's the same this
that's like that great okay everyone
understands what you Ops are now I'm
glad you're all paying
attention a lot of people in here right
now where's all the people at were more
people in here for the US China shit
um or am I just not picking a good time
that's kind of been weird to on be on
this time
zone uh okay lazy buffer has no
attribute
buffer oh it's 1:00 a.m
EST late for you
guys is a good time in Europe what time
is in Europe where are my subscribers
where are my viewers even from it's been
a while since I
streamed uh you know I'm 35
now God you're a wake up
soon
uh thank
you you're really you really start
thinking about about being an adult
um tiny Corps going pretty
well we've
sold like 60 tiny
boxes it's not bad you know we're going
to for for second year in business we're
going to break a million
Revenue uh we'll break a million Revenue
this year which is
cool uh
let's let's spend a minute and chill for
tiny
boxes I'm never using grave
again uh we also launched the Tiny Box
Pro we got 11 pre-orders for it I'm
looking for
uh uh nine
more 8490 is in a box uh if you're
waiting for the 90 here's what I'll tell
you uh the 90 is going to be about 1.8x
better than the 490 which is good and
it's going to cost 1.8x more because as
Jensen loves to remind you Mor's law is
dead which is actually a lie Jensen just
increases his profit margin every time
because everyone else is so fucking
stupid you
know
um like a don't can me start on
AMD um but actually talking about
getting started on
AMD uh we're
starting uh niml genen works at tiny
Corp and uh we're starting a just a user
space driver we're going to rip out the
driver I mean the driver
shitty uh so this is like mapping the
pciu regions Direct on the device we
will just literally poke the registers
on the thing uh because the driver has
raise conditions the amdg my
understanding now is that the problem is
not actually in the hardware and it's
not actually in the areas of the
firmware that we touch the instability
in AMD gpus comes from the driver um the
driver supports a lot of advanced
features that you just do not need uh I
mean the biggest thing the driver does
is support uh like
multi-users and Tiny grad can handle
multi-users at a different layer of
abstraction so we can just have you know
a single process basically own the GPU
uh single user space process this driver
user
space why is it called tuni grad because
it's like teeny grad but I Chang the the
uh the VAR the vals doesn't mean
anything all right so lazy buffer has no
attribute buffer so this is only really
used in one place and this function's
poorly written
anyway we do have to kind of address the
buffer
problem so lazy buffer historically the
main difference between lazy buffer and
UOP was that lazy buffer
um you know had this thing called
buffer right so let's just make a big uh
a big class called
buffers we make it a dick we'll probably
need some like a weak dick or something
to matchy buffer to buffer right uh so
from tuny
grad we also
need that tun
grad uh where's the buffer class and
device import buffer
so looks like buffer is a property we'll
make it a property uh buffer self
search
self buffer is that all fine still
work okay has no attribute allocate uh
so here we're going to create a
buffer property returns
buffer um buffer
sub oh we have to keep the device on
here CH we'll put that in we
ARG
[Music]
ARR
size Actually I don't even need that I
can just do s.
size um
D types. dtype
anything else no nothing okay so say R
and then uh so we'll also say if self in
if
buffers offers. get self
none return rat return rat
those buffers Okay cool so it's just
like a like a kind of cash property and
we're keeping all the buffers in that
Global dictionary seems
right um these are going to be dangerous
these are going to be
duped if I don't add
a
h counter to it
let's add a
counter that
there uh lazy buffer lazy Ops are unique
so I'll show you something cool about
them so if I do like a plus if I do like
Cal a plus b and I do D equals a plus
b so like C D and you know C equals D
obviously works but I can also do c is D
they're actually the same
uh actually the same python object so
lazy buffers are unique unless you add
something like
that
um list index out
range like my name of the device or
something
oh it's a python
device
oh
fine I mean I really shouldn't need
that that's kind of cool okay fine we'll
copy in Python too uh
from
Tiny
[Music]
files Ops python is just like it's like
that python
device um I know that doesn't explain
anything to you at
all but you can read the
code uh it's the python runtime you
don't actually need Python program
that's actually just pipe on an
alligator it's used for like testing and
stuff too but it's a fine device to copy
in it's very
inoffensive sure doesn't depend on
anything oh my God it depends on all
this crap never
mind I I have those though
fine uh
beautiful
arst lazy buffer has no attribute
sources
uh you know it's a good it's a good it's
a good thing to address from back in the
the earlier chat where people were
saying like why do you
uh why do you not ship something and
make an impact oh
God
uh like I understand that this is what
like so much of this has
become um you don't make an impact you
don't this is all I don't know we're not
going to we're not going to go down this
but
uh the idea of tiny grad is to build
something that's going to last for 10 or
20 years and you're not going to build
something that lasts for 10 or 20 years
on top of abstractions that are shaky at
all you're going to get all the
abstractions basically to be
perfect and once the abstractions are
pretty much perfect then we focus on
getting
adoption um the reason I'm doing this
stream is you know to get developers
interested in this uh and I think what
you're going to
find if you spend some time diving into
tiny grad do the tutorials you'll find
something that
is there's a few quirks still
but I want to you guys know about go
like the book
uh or who was that goo who Eros Eros
from the
book uh Eros would talk about proofs
being from the
book um often referred to the book in
which God keeps the most elegant proof
of each mathematical
theorem uh you don't have to believe in
God but you should believe in the book
what does a deep learning library from
the book look
like we're we're inventing this new
paradigm of
compute uh
where in some ways things are a lot
simpler from the old one the old one was
very very flexible and I don't think
we're going to need something so
flexible going forward and with that
lack of flexibility we get a lot of
ability to
optimize um we got we also get the
ability to make computers very stable uh
computers due to
their like generic complexity have been
kind of uh unstable like why doesn't
technology just
work
um d r.
sources let's thr a
fake out it kind of shouldn't be there
do I even actually need oh that's just
because how we keep track of things
being
realized we might need the npy device
too if we want to import from nump okay
uh lazy buffer object has no attribute
device
uh yeah remove taret completeness that
is pretty much the idea so let's do the
same thing we did basically
device um if we have a
buffer the buffer has a device and it's
just let's make it the first Arc
pretty much just this logic again
probably genericize
it it's not it's called get device
it's the same basic
idea if you're accessing the device of
something it has to track back something
out the device things have to be on the
same device uh so on and so forth like
copy will change the device
oh I guess I never really returned n but
I
should yeah know it's just copied shit
that's some like special thing for the
property but you see what I mean like a
device inherits from the parent a shape
inherits from the parent and then like
here we'll have something like
uh
uh to do handle copy right because copy
can change the device so basically uops
are op and everything should just be a
UOP yeah pretty
much um oh
maybe it'll take a minute and we'll
demonstrate
viz
um so like let's just do a gem
here so this is viz maybe this is a
better way to show you what uops
are um so this is viz and you can see
this is the kernel here so you can see
uh let me disable the uh tensor tensor
just make it a more complicated okay
cool
so you see this is uh oh yeah wow we
haven't shown we haven't shown this off
um quin's been working on uh this this
is a
uh uh a
visualizer of
uh what's uh going on so you can see
this is a this is a Magic's multiply
here um
so we have buffer zero buffer one buffer
two uh we are multiplying them and then
we're reducing them across this axis
it's a little bit optimized actually
we'll turn off optimizations too make
this really easy to
see uh yeah so this is you know a 64x 64
gem load mul
add uh and you this is live and Tiny gr
you can just do V equals one and you can
see this uh still a little rough around
the edges but it's getting a lot better
okay cool and then this is here as the
generated code for that
kernel uh sorry if I'm in the
way I the
why yeah so this is the generat code for
the map Mall uh so you can watch here
let's go back to this one uh so these
are like shape trackers but you can see
the shape trackers are Rewritten by Ops
so this is the GX from the GPU this is a
range which is going to become a for
Loop over here and then uh those things
are added together you know let's
multiply to form the index uh we're
going to expand that one too you can see
the ranges are D duped across the two
things oh if this doesn't sell you on
Tiny gra man like and all of the stuff
like everything that's a UOP can be
expressed in this framework and can use
this uh and then like you just see like
the rewrite rules being
applied uh so you can see that reduce
access becomes reduced across that range
um what happens there oh yeah we lower
the shape tracker store let's lower okay
now let's go through what happens here
uh so you can see that this is adding a
zero so that's just going to go
away uh we're multiplying by a one there
so that's going to go away just some
more little cleanups to the graph let's
go through this one now uh this one
rewrites piin to in piin have infinite
uh they're just infinite uh
with integers and say that they're going
to fit in 32 bits
um we rewrite the reduce to be a Define
ACC and an
assign uh right CU you're like
accumulating so this is the ACC it's the
assign I know what's happening
here uh oh yeah so instead of doing
multiply by 64 we can do shift left uh
six so this is like just strange ction
uh and you can see over here like this
is the rule that's applied the code for
that rule I can click here and it'll
actually open Visual Studio code uh if I
want so yeah um if that doesn't sell you
on like I don't
know I'm kind of just like over trying
to convince people of shit everyone's
just screaming at the top of their lungs
trying to convince people of things who
else is just over
it let's just build something better
um the slow takeover of tiny
grad I
hope I
hope I hope we build something good
enough that it takes over because it's
not good enough yet but you know unlike
the thing about self-driving
cars we just built something that was
way better except for Tesla com is way
better than what the automakers
have and like it's even arguably better
than Tesla
um not for fancy high-end capabilities
but for like day-to-day
usability uh
so but you don't win
right maybe it's you know again that has
to be a point you do win right if you
just make it so unbelievably good there
has to be a point where you do win but I
think the switching cost for that
industry is much higher than the
switching cost for this industry if we
can build a machine learning framework
that's better than what exists a
win
uh you know it's an open project too
anyone can can contribute to this we
have bounties bounties tinyg gr. org uh
it's also a uh transnational
project uh you know we're we're kind of
a remote
company
um yeah the bar is super
high uh the bar is absurd high if
anybody comes in and says can I have a
remote job why haven't you already
contributed 10 high quality P requests
right uh and then once you have that's
when we think about it because that's
what that's what a job is I show that
you can do the job but you didn't pay me
for that one poll request okay all right
bro like we're interested in people who
you know want to do this for
years right we're not interested in
people looking to extract
value uh uh you
know you you want to come build the the
future of
uh like you know you judge for yourself
if you think we're going to
win
um you know is this is this is this is
this jerk off functional programming
garbage maybe or is this like a deep
restructuring of of compute that's
actually going to work this time and you
know there's a lot of biases to think
that it doesn't work right everyone was
like oh yeah you know and Al it's also
kind of an operating system when you
think about it again I'm not trying
to if someone tells you they're building
an operating system and then they have a
token like they should be left out of
the room
right um I don't know if someone tells
you they're building an operating system
and uh I mean I did I did one semester I
worked hard for one semester at CMU I
got a a and operating systems and
compilers right so you know you can take
me a little more
seriously
uh you know if if someone says they're
building an operating system and you ask
them what's a mutex and they don't know
well I wouldn't take them very
seriously but you can ask me uh you know
anything you want to know about
operating system you can ask me in chat
and I'll see if I know the answer or not
and then I can talk to you about how I'm
building an operating system and maybe
you should believe me a little more
um 10yr is also a compiler uh right
because it generates that
code um it's also a GPU
driver uh you know the idea is it's it's
a new it's a really complete new stack
for
uh expressing all kinds of
computation but it's also a very
familiar stack the front end looks like
torch I think torch got that stuff
almost exactly right at least for like
what modern Earl networks looks like and
that that stuff can evolve we've already
seen some like Evolution I think we have
to work harder on making things like
parallel scan
work uh you know
like like like optimized parallel scan I
think
Jax's uh you know Jax is like a serious
competitor right I the the the
future is probably going to be either
tiny gu or ja like the future Library
people are using to writework stuff in
um I mean I wouldn't totally count
pytorch out but pytorch has to
change a lot of the pytorch has to
seriously be refactored now it's not
that they're not working on it and they
may succeed uh pytorch is betting on
like Triton uh meta's chip is uh
targeting Triton which it's a coherent
strategy it's a very coherent strategy
um but it may just be too
complex uh you know will will they be
able to reduce their complexity or will
tiny grad be able to
increase um you know it its speed
and uh if you're interested in in
getting started in uh in tiny gr
development uh we have a bunch of good
first issues um these should be very uh
approachable to smart new
people and yeah some of them are just
like like our our error messages for uh
different tensor operations need to be
like
beautiful so we're missing copy to
device let add a copy to device I think
this one's pretty easy I think we just
want to basically add copy
here have a
copy it's a meta op right
now is a schedule I rewrite this I don't
have that
schu it's
x x shouldn't been done like that it
should be just
okay oh it's almost interesting to say
that lazy buffer shouldn't subclass UOP
but that this should just uh you know be
a UOP itself okay uh so we want to copy
the device just return
UOP ops. copy D types self. dtype just
copy the dtype uh source is self and the
new device is uh copy the device should
take an argument probably called device
and we put here in the argument Okay
cool so now that's a
y okay uh lazy buffer meta Optics four
positional arguments but six were given
wow that's so
many let's see what's going on here
UOP has no attribute reshape
uhuh okay well that gets to something
interesting so we're going to have to
put those on UOP as well
okay so we have something called
Swizzle uh so we want to say shape
tractor. from shape self.
shape
reshape I think Swizzle just take some r
see we're doing this wrong right
there
Swizzle
uh don't change the D
type Source
self and sub shape
shelves s do shape reshape
shape shape tracker not defined this
it's kind of annoying your sh track also
kind of depends on
this we'll do this for
now expand is also that
[Music]
uh just create another property called
St shape
so expand is basically identical to
this that's not
good expand our new shape must have the
same dimensions as soft touch shape
oh
yeah
um Str Str is also Swizzle
right oh
what oh I just wrote the wrong thing I
don't need that just St is what I
want but we'll assert on it we'll unwrap
it self. St
okay we permute as well that's
fine and Pad we need
pad those aren't arcs those are just
arcs expand as a sh but that's an arc I
should probably just copy this
from all right shrink these are the
basic movement Ops like all movement Ops
can kind of be uh defined with
those okay you has no attribute R uh so
that's a special
helper uh let's see AR for
R op
access so we want to do do I have reduce
here you almost don't want you up have D
type you can almost inherit D type the
same way you inherit uh shape and device
right you should only have like changing
ones no but every U up has a d type okay
that's fine it's more
fundamental
um Source self and then the r gives
access so make this reduce
access there's two args for reduce
access you see so I have like the spec
of them all down
here
uh
spe reduce access yeah I need the first
one to be binary Ops so like reduce ALU
here the second one or the first one I
already
forgot the first one's got to
be reduce Al off access all
right okay that's because we didn't
properly handle reduce
access um
okay
device is somehow returning an integer
oh because I called get shape that was
stupid get
device all right so they're not all the
same uh device
mismatch on none
devices uh and that's because we didn't
handle copy self. op is just do does
anyone kind of understand this please
understand this
all right UOP do cast takes two
positional arguments but three were
given well yeah that should just be
changed that needs to just be changed
okay so this is
cast um
stride is the last one of the movement
on that we didn't
do oh
contiguous guess is no harm in just
adding
it it's going to be to put in the
scheder contiguous breaks the graph
H all
right is
realized
false index type
class tunig grad tensor not
supported it is
tensor can I slice shit with a tunr
tensor because this is importing from
Tiny
secretly oh look at that I'm importing
from Tiny grad that's such a mistake you
got to import from tuny
grad all
right cannot create tensor from UOP
that's a good
one nonsubscribers would you like to
speak
do you have anything to
say so you can reut the equivalent of
this is in tiny grad um hopefully like
you're kind of understanding what this
is doing see if we can fire up viz and
make it
work version of python are you
supporting why do you
care is that a bike shedding
question
oh cuz all whyn't this ship work I guess
we're not doing any any
rewriting can I do Noob explanation this
is a noob
explanation the old dick list and Tuple
from typing what's the alternative oh
just use the
builtins what what version do I need to
support
that um
I don't know I think tiny grad supports
38 now but I'd be okay with moving a
310 all right that's trying to
create why is that trying to create a
tensor from a lazy
op shouldn't be doing that
it's actually fine
which makes you realize that this isn't
lazy buffer it's just you
up is Tiny grad an abstraction over
different types of compute
Hardware I mean is Linux an abstraction
over different types of compute Hardware
right like there's a way you can view it
like
that uh 39 yeah we still support 38 I
don't know we should just rip the
bandaid off and switch to 310
just like hard support only 310 if
someone puts together a beautiful PR for
tiny grad that says that you can call it
like python 38 is
over then um yeah I'd be fine with
that okay so now we get into like some
interesting things so this actually
shouldn't be a UOP and this puffers just
has to be that dick
yeah um and then creating a tensor from
a UOP is pretty much just going to
be dat equal where do I create a tensor
from a lazy
buffer everywhere they're all lazy
buffers
can I create tensor from you
buffer 159
oh UOP object has no attribute copy to
device didn't I just create
copy oh because that has to be yeah I
can't be there
well this is like putting everything on
this class which is like fine I guess
we'll punt on
that
okay UOP object has no attribute
lbs what are
lbs oh lbs are
stupid object is not inter yeah
fine okay cool we're up to create
schedule with VAR and we going remove
all of this
fam
uh am I still are in China I'm in Hong
Kong I'm in Hong
Kong
uh we might set up something a lot more
serious here we're looking into like
incorporating an
entity
um I don't know
you probably missed the beginning the
beginning rant
about the uh the decline of the American
Empire I'm mostly just happy to be out
of the country during the stupid fucking
election uh there's it back door in XZ
no don't post security shit who cares
it's all insecure there's no
security security was just made up so
security companies can sell you security
security uh no I'm not
voting voting is your consent to the
system I don't consent to the
system um if I was in a swing state I
live in California I don't consent to
the
system uh if I was in a swing state I
would think about
it uh I would feel like I would do my
you know my my choice are between not
voting and uh voting Trump right like
it's not I'm not voting for The
regime um I'd have to I'd have to I'd
have to heavily weigh those weigh those
options I didn't vote in 2020
uh I think it's yeah it's just I mean
you know it's it's it's a broken
system
uh what I said on Twitter this morning
was I think that if you don't pay taxes
you shouldn't be allowed to vote right
if if you don't uh and like young people
are already excluded from voting but if
you're young and you pay taxes
congratulations you can vote and if
you're old and take Social Security I'm
sorry you can't vote right and that's
mainly like people think you know I'm
I'm saying some some racist shit or
whatever I'm not what I'm saying is if
you take government assistance including
Social Security you're ineligible to
vote if you take more assistance than
you uh you know contribute right some
people are tax contributors and some
people are uh you know overall cost to
the system right you can't have people
who are a cost to the system determine
the system's future Mitt Romney's 47%
thing is like it's it's just absolutely
right they paid 40 years into that
system it's paid back to them yeah you
know whatever man
like if Social Security is the third
rail of American politics and it can't
be touched then
uh oh I don't know if you've done those
projections but uh oh you pay into it
your whole life well I'm sorry the
people you voted for blew it on a Ponzi
and we don't have it
anymore um I couldn't live in Singapore
Singapore is a shopping mall it's nice
it's a nice shopping mall
but um though I could
uh I'm much more open to
Malaysia um I like that Malaysia is
multi-racial I like that uh that speak
English another good thing about Hong
Kong
um 47 payout I I I you know I
uh uh
um if Elon was uh running for
president I I'd feel I feel differently
about it i' I'd feel very supportive I I
really uh you know uh admire what he's
trying to do and I hope it
works uh what about Australia you know a
lot of people don't know this but I
lived there for four years uh and I'm
actually a
citizen
um I don't know I'm
uh I don't know that much about
Australia uh despite you know having I
live there I was two when I was six uh I
liveed by Brisbane I lived in a city
called uh Kira by kol and I don't really
know where these things are but uh yeah
I was there my my my dad uh my dad lived
there uh kir Beach Queensland Australia
yeah uh
yeah we were on Pacific parade one of
these one of these houses really
beautiful good memories of my
childhood um I've lived everywhere I
lived in Australia when I was a kid I
lived in China when I was in my early
20s I where else have I lived
nowhere uh how many people out of 100
can speak any form of English people
speak English enough I don't know like I
said I lived in China and didn't speak
matterin so it's it's not like that big
of a
deal uh would I come back to
Australia
uh maybe I could see I could see a
world uh like if America gets involved
in like a stupid
War
uh yeah yeah I think that's that's
that's that's a
world uh
live in
Vietnam Vietnam is not uh multi-racial
I I I really like the idea of like a
uh you know you live in like a like a
like
a like a society with a strong like
civil
religion that's that's just the
americanism uh American ISM in me have I
been to the nordics uh yeah what do you
mean I've been to like uh I haven't been
to Norway uh I've been to Sweden I've
been to
Denmark uh I should a bike trip up here
went to
Lithuania Poland Lithuania haven't been
haven't been to these
either upper Baltic states in Finland
uh I moved to Hong Kong because I can't
compete with China if I have to pay
people 600k a year that's not
why uh I don't think the salaries are a
problem I think that the American it's
very hard to uh bring in talented people
uh from overseas to America and it has
nothing at all to do with salary like
you people are delusional the tiny
grad uh recruitment process is open to
absolutely anybody it is it is fair
meritocratic I don't care if you're a
dog I would hire a dog probably probably
couldn't get it a Visa but I would hire
a dog uh so yeah um you know that's the
problem I you know I I I run two
profitable companies I I founded two
profitable companies in America I've
created 30 jobs and the you know the the
country doesn't make it easy for me to
get visas are you
kidding uh I'll go somewhere else like
that's that's really what it comes down
to um
yeah America yeah have an immigration
policy and be politically have a have a
have a merit-based immigration policy
and be politically stable uh I
also Camala Harris talks about a uh
unrealized capital gains
tax do you understand what that would do
do do you understand what that would do
to founders of companies who have who
are a
liquid uh it would basically Force the
state to own your company right it is it
is State ownership of your
company um because you have to sell the
company you you either have to sell the
company to to Bankers or investors or
straight up I mean when is the state
just going to start taking unrealized
capital gains in equity in the company
right uh the minute something like that
passes I actually am renouncing my US
citizenship and the party is really
over um if if if an unrealized capital
gains tax uh passes in America then I'm
renouncing like that's that's just it
you can't that's the most insane thing
I've ever
heard um she went back on that she's now
more moderate yeah the thing is like I
do not
trust uh
what is what is Cal Harris
right I don't I don't think she's like I
don't think she's
bad uh I just don't really know like
anything about the machine that runs her
I think it's an absolutely opaque system
right like you know Trump might be a bit
of a clown but you know I don't think
that there's a secret machine behind
Trump I think there's pretty much just
Trump uh so you know he he might be a
yeah um
what happens if your stock goes down
after you've been taxed on it yeah and
and I know California is proposing this
as well um I think I am going to move
out of
California
uh it probably is unconstitutional but
that isn't really the problem right it
may be ruled
unconstitutional uh by a judge in three
years but the amount of chaos that it
will have injected into the system in
that meantime
uh
like you know I don't know never
attribute to malice what you can
attribute to incompetence but I do think
there are some very powerful actors
perhaps foreign perhaps Chinese perhaps
Russian perhaps whoever George Soros
works for uh that they're not again I
don't believe that America is a secret
cabal of people in a room but I do
believe there are people who stand to
profit more from the destruction of
America
uh and you know again once that becomes
the majority once the majority of people
stand to benefit more from the
destruction of America and once people
uh you know stand to benefit more from
uh you know once once more than half of
the the voting public is is on the take
it's
over that's that's that's like I think
the teville it's an old quote about
democracy you know democracy works right
up until the population realizes they
can vote themselves more free shit
yeah it won't just me up mess up the
wealthy this is this is this is
insane that that like the government who
has a$1 trillion doll budget deficit
every year is somehow talking about
taxing
billionaires like that this is some kind
of
solution you
know uh destruction of the US is a
necessity it took the wrong path that
needs correction what do you mean by
destruction of the US
right what does it look like
um the most recent like empire collapse
in modern times is a Soviet Union and
you can look at what happened there all
right so we're going to get like like a
shit strong man for for 30 years that's
not what I want right you know I don't
think Putin's a terrible person but I I
wouldn't want I wouldn't want to be
ruled by
Putin do I think China will eventually
take over
Taiwan uh I'll go further than that I
think Taiwan will eventually vote to
rejoin
China that's the real
truth what you know what's
what's what's
uh you have a right
oh I don't even think it's only way out
right I don't know I look I don't
understand uh the DU whats of of of of
Taiwanese politics that much uh I did a
I did a bike trip around there and my
basic understanding was there's two
political parties there one that
supports um you know a more uh I'll you
know America loves the word independent
but a more American alligned China a
more American alligned Taiwan and a more
Chinese aligned to Taiwan my
understanding is those are the two
political parties there and if the uh
you know Empires continue to go the way
that they go
uh the uh this will not be done
violently this will be done
democratically
um what happens to the semiconductor
industry
uh the US starts buying semiconductors
from China if they'll sell them to us
yeah right maybe they'll have sanctions
against the most advanced ones like we
do to
them watch how quick tsmc employees will
get visas good that's a good start
that's a good start my understanding was
that the plant in Arizona was delayed
because they couldn't find labor what
anyone who wants from Taiwan
should be you know like welcomed in
America not anyone but like you know
anyone who wants to come to America from
Taiwan and work I think I think you just
need to say I am a Taiwanese Citizen and
I uh you know uh want to work that's
it can you confirm Hong Kong is cleaner
than New York what I will say is I have
not felt remotely unsafe I can walk
around any part of this place
alone during uh any time of the day and
feel safe and I can't say the same thing
about New
York ever been to
chong chong ching uh no I've been to uh
mostly Shenzhen beang
Shanghai um
but a country is more than a big resar
for business it has culture and history
at least here in the EU and maybe that's
fine for Europeans right uh you
know uh I I think that my position is
hopefully consistent with the long-term
historical America is a country of
immigrants right my uh my
great-grandparents were immigrants to
America I think that that this should be
available to everybody my you know great
grandpar parents came to America and
worked very
hard have I met bunny Hong yet
uh is chips act helping to bring foreign
Engineers my understanding of the chips
saacks is that it's 10% chips and 90%
government
grift um my understanding is that it
includes
Dei garbage like are you kidding you're
going to sit here and and talk about how
you're making you know sure that your
your employees are the right racial
composition uh and you think you're
going to be China are you fucking
kidding
me like uh you know this is this is
uh it's it's it's gone beyond lunacy
now right this isn't this isn't some
like you know like like it's not a
policy disagreement it's at some point
it's these people
actively you know are are wishing for
and they I think they actually really
are right I think they actually actively
are wishing for the again I'm not going
to say failure right like that's they
wouldn't use that term and you shouldn't
really use terms that they wouldn't use
but these people are against growth
these people are against I I didn't
really believe that they existed but do
there's people out there who think that
like uh like America is the root of all
evil and should be destroyed and these
aren't people from foreign countries
right you want to you want to live in a
in a in a foreign country and believe
that but these are people in America
right and like I you know that if that's
if that's a sizable percentage of your
country what do you
do cooked
cook uh yeah moving USA somehow looks
like not such a good idea right now I
don't blame you
I uh and why is the shit show right now
people are getting robbed at gunpoint at
festar restaurants did you read that the
news or have you seen that
firstand um I've been back to New York a
bit and like again it's the same as you
know I'm not going to deep Queens I'm
not going to the Bruns but if I'm
walking around the you know the East
Village I don't think anyone's robbing
me at
gunpoint
um we can't just complain about things
that ruin things like Dei it'll never
end I mean you know yeah don't just
complain about it like try your best
with your
actions and that's like I try my best
like this is what this is Tiny corpse
hiring
process a tiny corpse hiring process
doesn't ask you what you're
racist right tiny corpse hiring process
doesn't see you tiny corpse hiring
process doesn't discriminate I I think
that discrimination is so stupid it
shouldn't even be like you shouldn't
even not discriminate based on race you
shouldn't even why would you
discriminate based on
species I don't even believe in
discrimination between whether things
are biological or silicon right that's I
mean that's even more that's even more
extreme right you know it's interesting
and and that one is a look and I also
don't think that like uh you know
racists are necessarily bad people right
it's not something I agree with but I do
understand like where they're coming
from right I can steal man their
position um you know you should always
be able to steal man other people's
position right and I can steal man like
a humanist position as well right
someone who thinks that you know we need
to have special protection for humans uh
you know against the encroaching silicon
hords I don't really believe that
either um
explain a racist point of view okay uh I
don't know they really want really want
to Sully the stream with us
uh you know racist is a very easy thing
it's interesting how like when you look
at uh prison
uh prison very quickly uh you know you
you you go with the guys who are your
race right uh the gangs are very uh you
know racially based and uh because it's
just it's just a very like natural base
way of dividing people right I think you
know in the absence of civilization
you're going to end up with something
like uh
racism uh so you know if you really
think that like Civilization is over you
might adopt a more racist perspective um
I do not think civilization is over uh
so yeah I think that uh you know we we
in we can live in a civilized society
where we discriminate against people
based on uh you know who they are
individually than based on what part of
a
collective uh racial group they're a
part of right but race is like a
shelling point when you have nothing
else so there you go there's the there's
the the the Steelman for the the the uh
the racist point of view uh I'm also
using a defin like you know people also
get into what the definitions of racism
is some people say things like you know
um
uh racism is a scop I don't think it's a
scop I think it's like a you know like a
kind of shitty part of human nature and
it's like again it's what you kind of
fall back on if uh I think that some
people are some countries I've been to
they've been xenophobic uh some
countries I've been to they haven't
um you know like again I don't think
this is quite a controversial uh
statement you can you know it's not that
like you know but um Japan is more
xenophobic than China right so it's just
like it's something I've experienced um
it's not necessarily that one thing is
bad and you know I've loved my
experiences traveling around in Japan
and many people there are very welcoming
but I would say on a whole an aggregate
that's a true
statement um
on
Israel um that was even more
controversial right
uh uh my my basic thought about that
whole situation is that it's a 2,000
year old religious conflict I I saw I
saw a I saw a uh a graphic that I think
described it super well and it was like
um you know it was a picture of the Iron
Dome shooting down Hamas missiles and uh
the Iron Dome missiles were said were
captured American dollars and then the
Hamas missiles were also captured
somehow somehow still American dollars
and I found that very
funny um so so my my view is that uh
we're not going to solve 2,000 year old
religious conflicts um on Twitter
but I'd rather not pay for
it this stream was way better in sub
[Laughter]
only um I'm I'm not I'm not Jewish uh i
a i a Christian uh know Christian
uh but that's just that's just a that's
just a that's just a fact about me I
believe Jesus died for my sins
uh quite literally has nothing to do
with
religion how much does the uh I'll go
even further than that I I think in a
lot of ways the
uh understanding The Divide between
Democrats and Republicans helped me
understand the Divide between
Protestants and Catholics right like
historically you hear that there used to
be these like bloody wars between
Protestants and Catholics you're like
what a joke they believe 99% the same
shit um but then you kind of understand
it better once you see it uh you know
play out in your in your in your
home um Jesus was himself Jewish
absolutely
uh yeah you wrote reports that sound
like they could have been written
yesterday but we're actually from when
Rome was trying to keep the peace uh
uh I saw a tweet it was like Israel
managed to run an exploding pager
startup at a profit what's your
excuse
um I have not been to Iran and I have
not been to
Israel I haven't traveled much around
the region at all
um when I say Jesus died for my sins
Jesus died for my sins you know it means
it means it means exactly what it means
I think I don't know I don't know if it
means to me what it means to other
Christians I think that I believe in
sort of a
more uh a personal
uh you know relationship it's like I
don't
know um I'm no I'm no I'm not a good
Christian bad Christian but consider
myself more of a Christian than anything
else more than an atheist a goddamn
atheist who got one shoted by the IA
I've I've been spending uh I've spending
too much time on Twitter
lately
um why do you think he was a con
man I think that he taught a lot of
great things I think that uh I don't
know I mean again I maybe go to
church I'd say three times a year on
average uh a few things I really like
about about
Christianity um you know the philosophy
of really
like turning the other
cheek uh and
that you know you you cannot you're not
an absolute sinner if you confess and if
if deep in your heart you repent for
your sins then you're going to be
okay uh I think those
are nicer worldviews than
uh uh other things I've heard and I I
think that like um I just went to the I
just went to The Rock Church in uh in
San Diego uh and the the the the pastors
is talking basically about like you know
you know in your heart if you're doing
right by God or not
and yeah I I uh I like that you know
it's it's it's you know and God knows
and you know don't don't don't don't sin
be a good person
uh all
right you can be moral without religion
or
atheists why you tip at restaurants
there we go see I like that I like
that uh
wait God is actually like
real like you ask atheists you ask
atheists where the universe the universe
came from and they'll say some crap like
the big bang right and it's like no you
didn't hear my
question right like I didn't ask what
happened a long time ago I asked where
the universe came from well there was
like nothing man and then there was like
a bang and it was big and like if you
believe in God that's like believing in
the Flying Spaghetti Monster man that's
just stupid we're we're more enlightened
than that we we went on the internet in
the '90s and we discovered that religion
was full of shit and now we're atheists
and now and now we dogmatically believe
that there's no God like
okay once's my answer to where the
universe came from it was created by
God where did God come from I can't
answer that question that's God's
problem right you're you're asking me
what religion is God I don't know
probably not an
atheist I accept Jesus as Jewish of
course um the only thing we can say is
we don't know yeah we don't really know
um it's about having faith and it makes
sense to me that the Universe was
created by like you know dude in the sky
I mean a metaphorical dude in the sky
not like a
literal uh you know human looking thing
created by
somebody
uh God is the reason you return your
shopping cart at the mall you see you
see that's the other thing about
religion too I want to live in a society
right I like Civilization
man uh I don't know that much about
Islam
actually
um I know uh I know a lot more about
Judaism uh uh you know just from the
people I hang
around AI aligned by theists and AI
aligned by atheists well you know what
here's a funny thing about atheism it's
kind of like libertarianism right it's
not a it's not a new idea atheism is is
it's probably an idea that's occurred to
every single person
ever and yet
yet it seems to show up and then go away
because there's something about atheism
that just doesn't have staying
power uh so yeah I don't think it's I
think atheism is
maladaptive Islam is a better refactor
of Christianity isn't that what
Mormonism is I heard that if I become a
Mormon I can have my own planet
China isn't religious and even stay
atheist I mean I don't know that much
about religious belief in
China uh I don't know I let look that up
do people in China believe in God
yeah I mean it's eastern it's very
different I'm talking like specifically
when I'm talking about this I'm talking
about like like a
western uh you know a western conception
of a God versus a western conception of
atheism right I I would not say that the
that people in China who consider
themselves atheist align very much with
like the Richard Richard Dawkins esque
atheism uh I think that like when they
say no religion they kind of mean
something else I I don't really know
like that much about it I know the
basics of Buddhism
um yeah no no no when I talk about
atheists I mean specifically about um uh
internet
atheists the kind who I've encountered
in my life and the kind who I am closest
to and fear being mistaken for so I must
be work very hard to separate myself
from
them uh the eastern western concept of
God is very different yeah I I
understand that and I I think that
like
um yeah I like if I thought about it for
I if I meditated on the fact I think I
could
uh like think more about what a sort
of Buddhist
uh understanding would be I do think
that the the Buddhist philosophy has a
lot of one of the coolest things I
learned from uh from Buddhist philosophy
is this
like it's like you want things right and
then in the western world you're really
taught uh from a young age that the
solution to wanting is
getting uh you know at least that's what
I was taught like you want and then you
get
um Buddhism says basically like no this
doesn't really work that way uh you're
going to want and then you're going to
get
but that getting is only going to lead
to more wanting all right it's a
classically it's explained almost like a
drug
addiction uh so of course you know the
the the solution to wanting is not
getting
uh I'm not worried about being
associated with Christians no what what
Christians would I be worried about
associating with
uh yeah I was aist I was
younger say I found God in my mid
20s I hadn't really like thought about
it that much uh my parents will tell you
otherwise but they are they're sort of
atheist uh
got my own Temple tiny guys my
temple why don't I stream more often
we'll see how this one goes you know I
go to
Cycles um
Jesus is cope and there's no afterlife
and when you die you become Terry Davis
okay that means we have to go back to
subscriber only mode you know you know
you know how like this like Godwin's law
when eventually chats become about
Nazism well my chat eventually becomes
about Terry Davis and once it's Terry
Davis o'clock we got to go back to uh
subscriber only
um yeah know overall I think I can
uh it's very easy to to to coexist with
the Buddhist
worldview it's a very it's a very uh
inoffensive worldview I feel similarly
about Christianity I feel Christianity
is is a pretty
uh uh you know Christianity also has a
lot of branches um but I feel like sort
of
Mainline
uh you know non non-extremist Christian
Christianity is is very nice I guess
that might be also true about all
religions
so but I'm a Christian because even if
my parents weren't my grandparents were
Christians my great-grandparents were
Christians and that's how you become a
Christian and my parents might even say
they were I don't I don't even know I
shouldn't speak for
them okay you can't unpack a non-
iterable non type object
uh so let's just
return that like that let's see if that
works memory planner takes a positional
argument all right now we're up to run
schedule and it has a keyword argument
called do update stats and it has an
argument called schedule probably
multip oh schedule like
that oh because schedule with vars okay
never mind so that's going to be
schedule VAR vales
STS great okay my uops are not based
enough
unfortunately hey now hey now
this is what
dreams are made
of let's get rid of that
base think I need it
it's just going to complain it doesn't
have
realized oh that's
terrible okay so that's a
UOP going to want to get the buffer so
we have a solution to that it's my
stupid uh buffers
that
sweet nice long
error but what's crazy is that's the
uh key eror okay
it's because we didn't actually run
anything or realize
anything there should also be a weak
keex we should probably just do that
now for
we don't have auler and we don't have a
memory
planner so let's see what's instead
50 wow that's a lot oh well that's the
uh that makes sense that's the
optimizer maybe beautiful mist is a
little aggressive maybe we should start
with a simple
test
um let's just create
simple
test okay uh from tuni
grad import
tensor tensor sub
two t sub
three plus b
what capital x does okay well we need to
realize to get the buffer and now we're
only realizing
one
one one one
ye
EA jiger
kind of beautiful
right so that's the
full understanding of the graph I'm not
sure Vi work no this doesn't
work we do a graph rewrite on
it let's make a sync
okay so now we can import things like
graph rewrite syn equals graph reite
s need a pattern
match hey now hey
now this is what
dreams
made okay an empty pattern matcher but
that should still let us run
viz why doesn't viz work why we rewrite
zero graphs we didn't oh no it's trying
to import kernel no don't do that don't
do that don't import kernel kernel very
bad it's actually fixed and uh this is
fixed don't Colonel no
Colonel why is that still have
zero it's trying to get colel
they going to call it Billy but then I
realized that didn't make any sense I
love naming things Billy
though what but I don't understand I
rewrite the buffer I rewrite the graph
right you see me rewrite the graph I
rewrite the
graph why do that
work rewrote zero graphs and applied
zero
rules but but no reite the
graph why does this
work oh it's probably just
like kernel.
value called it test isn't that good
enough uh list index out of range okay
oh maybe it's because I don't have tunig
grad's
viz actually include the word tiny
grad wow that's importing from that
should not import from
that yeah if you're import from the
wrong way things get
bad um add exit path dur name how is it
even calling
VI I don't even understand that that
shouldn't
be am I importing the wrong one
is that
working I was check in here
from fine that's fine just
wrongs it's
fine I add
ex oh let's just add exit okay maybe
that's
fine how
this all right that rewrites being
called seems like this isn't being
registered
how is that getting to Tiny grad
oh no usable devices
what
okay fine CL equals one I don't
understand exctly exctly why I have to
but
whatever uh okay so the problem here is
that there's no viz let's copy in
this yeah we can't run tiny grads VZ
because this shit imports from Tiny gr
okay uh and this also sucks because this
doesn't work
no module name tuny grad Cen konel don't
import that
crap
oh engine
graph that probably should not be
imported from there
colors about word
WAP that should be in
helpers Catch My Lucky Charms they're
magically delicious
load
kernels yeah name equals none
yeah name kernel is not
defined we'll just leave kernel and
we'll just make it a
kernel kernel equals what's an python
object that nobody's ever used
just so it'll never accidentally be that
thing H
type Billy there we go good no one's
ever used a
billy what it's a billy no it can't be a
billy how is K a
colonel all right fine why can't you be
a
billy class kernel
there we go now it's a
type great love it love
it want of
VI uh
no we don't have a fav
icon we need a fav
icon wait
what they're running tiny grad I thought
this shit was fixed
no usable devices why is that happening
okay
great
great hey now hey
now
yay okay so we make two pythons that
have the same we copy them to clang we
add them and then we contiguous them
sweet all right beautiful mest
why is that unresponsive
by the way I don't think it should
actually open the
browser I it should just print out the
URL it's kind of annoying what it opens
the
browser that shit's in
Viv we also got to move viz to the main
thing
I why can't it draw that graph
but it's okay with drawing this
graph it's a nice looking
graph who likes the
graph
buffer not you sure the buffer should
come from a shape tracker
either I think it has to I mean it has I
guess it has
shape guess that met tops has shape so I
don't know probably shouldn't come from
shape trackers
though we got to give these new ones uh
color I don't know let's try something a
little more
fun oh it's probably because it's doing
all the RNG
shit and that's probably a massive
massive graph
oh no you know what it is oh you know
what it is cin you got to fix this the
problem is it's there's some exponential
thing right if you're if you're doing
the uh if you're doing the random
there's some
exponential uh in the track
back uh yeah unfortunately
um let's try zeros you got to you got to
have an exponential test in there
but overall I hope you guys appreciate
the beauty of
viz this one going to
load Swizzle a lot of
buffers wow that's a
lot yeah
uh okay we can go let's go crazy here go
crazy uh from
tiny. nn.
State import get
parameters get parameters
model p in parameters model P
DOL P let's just make it all ones P do
ship
want tensor not defined
what tensor
ones there we go that can be
drawn yeah there's a problem with the uh
forever back ones the ones that are but
yeah all right
cool wow swizzle's kind of crazy
uh so we need rewrite rules for the
Swizzle that's going to that's going to
condense all the Swizzles down right so
those are just all the shape Checker
changes but I think that we could
condense them
down cool this is this is a better
test see we're taking like Max and AD
and all that kind of crap all right
let's get the Swizzle re riter in there
um or maybe we can just write a swizzle
re riter I think it's actually really
simple okay so does everyone understand
what Swizzle does Swizzle is like a
shape tracker applier so I
believe that you guys are going to love
this oh this is when it all comes
together man this is when the rubber
meets the
road so just put PM in there and let's
write our first
pattern you Pat you Pat at uh upat
uops uops uops Swizzle so now if you
have a
stacked you you off
Swizzle name equals
y uh well let's just say uh you know s0
and this one we can
call S1
then we want to remake this with so this
is like a replace
rule with one shaped
tracker uh
yous ops.
Swizzle s1d
type uh s0. Source s1r plus
s2.
who wait what how do we rewrite all
those graphs only applied one re
R oh it generated all these stupid
ones that's the only we care about all
right cool so you'll see we did 111
rerup
and it should have combined all the
Swizzles combine combine combine combine
combine combine comine comine comine
comine come come on come on come come
on all right we can just skip to the end
here see how the story ends up all right
cool so you see there's like just
Swizzles
here and we probably don't even need
some of them
maybe we do oh we yeah these have strad
zero okay
see this visual should probably also
have shape tracker nodes and not have a
shape tracker Arc like that so it can
dup them because otherwise they're just
all being put in yeah so Swizzle should
have a shape tracker
Arc as a second Arc
something to
change the new graph app is so much
cleaner
yeah yeah we're we're we're very happy
about
that
um I mean you can kind of see where this
is all going right this is
uh this needs to be Rewritten in a in a
in a better way right this can't be the
renderer for this kind of stuff but you
see my you see my rule which collapses
the
Swizzles yeah so those are movement Ops
and you saw how like with a one rule we
were able to go from you know this
complex monster down to this what these
Ops are
is uh just a bunch of rules determining
like how to simplify things right so
we're just determining if things are
true or
not and those are like side effects of
uh shape tracker
addition we determine what shape
trackers we can add what shape trackers
we can't but we should probably suppress
them we're going to want our our
rewriter to be covered in the
spam
okay
so now we're gonna actually have to
uh break this up into kernels
you see that's being reduced on those
axes
yeah those AIS it's pretty
good
wait maybe the random stuff's not the
problem that should just be called three
fry I don't think any of that should be
triggering I don't even understand why
that was necessary
why is this
necessary what happens if I don't do
that is the last one not
drop oh why is this so slow okay maybe
it's just really
slow cool
uh but I think now wow that's kind of
crazy um I mean that's the downside to
like the shape tracker stuff because
it's kind of
crazy um what is it
adding why is it adding all these bus
why is this thing so
big these things outside three fry like
there's three fry
wow so much
stuff yeah okay I mean there's just a
lot of complexity so we have Randomness
built in as well but I I bet we can
clean that expression up a little
bit like it's fast I guess it's just
visualizer look slow and we're
visualizing the big graph there so it's
kind of a crazy
one so no I take it back the problem
wasn't exponential almost just this a
lot of
crap um
cool should buffer have a shape
tracker I guess that shape is passed
in maybe it should
okay we got to start actually thinking
about how to uh realize this and some of
these rules are just going to be from
the
scheduler like that
one what does that even
do are some of these
consts how have any
con uh we got to okay we got a we got to
take a we got to we got to do a bit of
an audit
here yeah yeah some of these should be
consts why is that doing that by the
way why do I have to write clang equals
one there okay
um no more printing out printing out was
crazy let's
print
this yeah I think con yeah most of these
are consts okay if op is op
con for met Ops then we don't actually
have to create a buffer what are we
doing um that's only true for empty
has a device
I have to put a const on a
device what you think I do I think I can
just fix it there in tensor and
knit uh uh
if data
device what is that
oh yeah okay that's kind of a different
problem
um we have to give cons a shape we can
give them a shape
now you have a shape be
happy you're not
happy God the
um I don't know maybe I don't want toer
device is n May device can just be
none we're having a problem with our
shapes here
oh there we
go no fix
it uh why
not that's going to give you a
shape oh I think cuz that's probably not
I have to
expand that doesn't actually work as a
reshape well it's all that okay never
mind then fine
work
oh I'll
same shapes
T actually shouldn't allow this
what's this
happening for some reason if I do this
it
works no what I
break I mean I could do the same thing
where none shape is fine maybe I just
want to do that
not sure maybe
not no I can't do that because be able
to reshape
those what doesn't have a shap
okay that and just a const
zero but that should be broadcasted I
don't really know why it's
not that doesn't make sense why is that
not
reshaped I reshaped
it oh cuz maybe I can't
but didn't we just accept that it was
all I do
that okay assign shape
mismatch how was that uops con to
thing that's probably correct so I can
fix it from
Max don't just write instant Wizzle we
can write instant Wizzle stacking
if we don't it's just like really
wasteful God
right pass the method in and do
that
yeah just cuz it's unreadable
okay if self. Ops is UOP
Swizzle
uh I just say like base St equals St do
St
else self. St
shape but like it is kind of different
because we want to actually destroy the
one above
it um not like won't be applied to this
one
Port shape tracker
okay great it's a lot more readable
um so I don't exactly understand how
it's just being a const because it
shouldn't be a const because I reshape
it which should make it a swizzle
op how is it just a const where's the
reshape
going there's no null reshape that
stuff's not even
supported it's literally just that's
swizzling a const but how is it trying
to add a cons it doesn't make any
sense there is no const object return in
tenser
oh because it's doing that below the
tensor level doing that at the function
level
yeah it's that zero
there the problem
is it's calling that
method which would normally be
fine okay
so we're just going to have to support
it then comps don't really need
shape I don't love that there's now
implicit
broadcasting that's just that's just
kind of being broadcasted
right which I guess we can do the same
thing for device we did for
uh so it's const will return none
okay now it's trying to get the shape
from there it's trying to reshape
none reshape the only method you can
call or maybe if it's not it's
just clean this shit up it's time
great let take a look at what we did
great all right I mean that's a lot kind
of nicer than adding them I mean even
though adding them does work that just
looks a lot nicer
great oh see the conss are actually
being automatically folded into there
all right so we multiply 0 * 1 and get
that and we multiply that time one and
you
get I mean that actually if we have a
swizzle on a con like that we could just
remove the
Swizzle and sort of allow this implicit
Broadcasting
which is fine see look here we do a Max
with zero the con are automatically put
in the
thing um a
reshape wait those shapes don't match
though the shapes are supposed to match
did I do it
backwards I mean we can also just write
this as
and let the uh let the folder go back to
it thir shapes match those shapes match
see I guess there were just some bugs in
the crap I was
writing it's like nicer to do it that
way too it's just 89 rewrites you kind
of don't need but
whatever okay now the shape should
always match all those shapes
match battery shape's
fine
cool
okay so now let's do stuff like reorder
the Swizzles and the binary
Ops do we want to move them down or do
we want to move them
up
down we can do
both got so quiet in here
yeah sometime I want to move them up I
want to move them
down I don't think you can move them
through
reduces maybe want to move them up I
don't know I think we already have we
already have rules for this we already
have rules for this that I can just
take oh yeah we're rewriting this is the
big graph the big graph it's a big graph
getting
20 I'll be
back
e e
let me just write a quick rule to move
Swizzles up
yeah the goal is to restructure tiny
grad to be more like tunig grad like
we're kind of understanding what parts
are preventing like what parts still
keep lazy buffer existing and it's easy
to mess with it in the new code base I
mean tunig grad's not going to last
forever tuni grad is just a temporary uh
you know fun
thing all right so let's write a pattern
matcher pattern
uops
ALU uh no okay we have a
swizzle that has a
source that's an
ALU name
ALU name
s lamb l s okay so what we want to do is
we want to move this Swizzle before
the
a so
uops
l l. dtype
uh UOP uops
dozle
XP X s.
forx
in uh l.
source and then
if you did that
right look at the final graph here yeah
so see how it moved the Swizzles
up um and it's good they still have the
same
uh the same input um I think we can say
any Swizzle on a const we can just
remove except for ones that have a
mask give these labels merge
Swizzle uh Swizzle before
Al const plus mask plus
Swizzle equals
const so we have Swizzle and any source
is there we actually have a special
helper for const I can just say
docar um
see uh See
if all x. views mask is none just x.
mask is none for x and s.
views uh else
none okay and if you return none in a
pattern matcher this this Tech is so
powerful like how nice is this
shit you can just like write these kind
of things and like you see what they
do who's a tiny grad
believer
um we shouldn't have stupid const with
okay great so this is just uh
see but now wait a second look at that
look at that ad there 1 + 1 E minus 5
surely we can just do that so why don't
we just import the symbolic pattern
matcher from tun gra down Ops and add
it which will automatically do things
like fold those constants
great there we go straight
line now we won't be left with any
uh you know we don't we can we just do
all that math right
away all right so what's the basic
pattern here we add one do a Max with
zero oh well okay now some of this is
stupid uh okay hang
on we shouldn't be I replace them with
ones we shouldn't replace them with ones
we should replace them with
uh this should be t. empty and empty is
fine to
keep because they are buffers
right great so this is the real
graph
um I just write this a little
differently I don't actually want a
buffer to have a shape tracker like
that uh I want to buffer to have a size
and we can reshape it the
shape is that more closing
matches yeah
[Music]
oh that sucks
actually okay
uh and I guess it's a little crazy but
let's just go
Um so yeah uh let's just STI it
here I don't think we have a choice
you access a buffer you create
it I don't like the idea that that
imports from buffer that sucks
I don't think I get a choice
fine we can't even do that uh oh it's
actually only in type checking
oh that creates a
buffer fine I can import
to all right we'll have to figure out
how to do this inherited correctly
because this is not
right uh I Swit up that Ops equals
buffer
interesting I'm just like I Haven
written this so many times now it's
like shape tracker object is not
subscriptable yeah um
okay self. size doesn't work oh no it's
just not that anymore it's that
interesting okay that's cuz we have to
give that a different shape rule buffers
have a shape
just make them
flat flatten the
size there we
go does this stuff make sense to
anybody is anybody
following chat I'm looking at
you got buffers 64 buffer 18 buffer
19 buffer 15
Swizzle them
all right we'll let nonsubscribers
talk do you guys see how this shit's
amnest is Tiny gr like I tried to I was
hoping that the tuni grad refactor would
be like a good way for people to kind of
understand this stuff this is using the
tiny gr infrastructure to write out a to
write out a
like a
graph it does not make sense well that's
like your opinion
man
um so my input data shouldn't be zero
either let me fix my input data in my
example
you missed the streams okay so like this
is the input
here I don't there's a multiply there oh
no that's just the normal okay that's a
multiply that's reasonable actually so
this is the UT
buffer and then the first thing we do is
we do a convolution which remember a
convolution is really just a multiply
and an
add let me Swizzle that new object this
is an
expand uh
this is
a a
bias as we add a bias
there uh we do a Max there which is a
railu and then
um interesting that expand was actually
pushed through those things we don't
want to push
expands
uh yeah
fun so this is kind of the the the the
basic idea you know you do that you add
your pias do your max do your
mall right
convolution um and you can write out
entire graphs like this you can write
out like your training graphs like this
and so much is now being done at this
really high level and the beauty of
doing things at this high level is that
you can save so much compute right you
can just you can just realize that
you're just adding like you saw that
there whereas like torch if you actually
create a tensor full of zeros and a
tensor full of like ones and you
multiply them together it'll actually
happen whereas in tiny graph it just
won't yeah so that's the
graph damn this is good
like we can see how each of those
rewrites was
happening blah blah blah blah
blah and that's like this is what a
neural network is and its most like pure
form and then the the tiny gr back end
can actually take all this stuff and
break it up into kernels and render
it okay so I think maybe now it's time
to actually write this shit make it
actually uh generate code and run some
of these things
so notice
how basically at every
Swizzle we're going to have to create a
kernel I believe every Swizzle gets a
kernel
created but at the Swizzles they're like
kind of like breaking
points so we can do kind of like a
reduce we want to get the
uh the history of all of them
up until there's more
Swizzles um reduces also change shape so
fun fact to know about
reduces uh we have the tiny grad meeting
by the way
meeting in an hour 4 P.M Hong Kong
time why do I think it was
4:30 4 pm Hong Kong time okay well I'm
bad at
time top K when
yeah I saw people getting real excited
about this kind of stuff where it just
like injects like a like a what token to
the
thing
uh I mean tiny grad
is like you can play with the latest
stuff that's fine it's a fun usable
library right like there's a difference
between Library development using the
library but like hopefully you guys
understand understand the point of
this imagine debugging in something that
looks like this instead of debugging in
torch this looks so much easier to
me what is the drink I'm drinking that I
don't know what it is it's just that
let's see I think that's chop is that
cha so the thing about Chinese
characters is like here we can like
break this one down I think it's
cha uh yeah so yeah yeah they even they
even here they break it down for you
here
um so it has comp
opponents
uh like I I didn't actually know that
that was the character for T but I I
learned all about like this is stuff is
so cool like how chiny characters work
so it's like that's Ren and ren is like
the simplest uh character wait what no
it's not even like right doesn't even
match
that I don't know why they put like a
sha there but uh I mean when you look at
the character on here you you can see
that it's it's grass person TR
uh why why does that one look
weird oh learning that's Z with the
little hat on I think that might be is
that studying is
that no no no but that's
us study English to Chinese
yeah I don't know if I'm pronouncing
that
right I don't know what c means stud
it's
like yeah no child is just tea yeah oh
this is green tea oh what is green I
don't know
Green no come on like give me like the
one one letter one
oh but it is it's
that open Google
Translate your de is
just uh this is just de which is like a
extra character I don't know why they
have this one
here
um why are there three
they're both mean green
right that is yeah that's
green what's the top
one green
tea luiga
um yeah know I'm learning
Chinese gota
gota gotta learn the language of our new
emperor empire
right
um China number one
um I need any lunch
today right should we break up these
kernels by
Swizzles actually wrote some code to do
this we can just steal
up let's start on the big graph
so this is what we call the big
graph so let's break schedule
we're going to need a pen caral
to any that weird stuff though I just do
k. a pen base that's
good uh and we want to break it on
Swizzles I believe
what is
that Lo
yet so every time there's a
swizzle
um no okay this is actually way more
complicated than this okay so we need
Swizzle when we see a
swizzle that's going to create a
interal and then we want to rewrite that
Swizzle okay here's what we
do graph rewrite sync break SC and for
the context we're going to say something
like uh SC
equals new
list and then returns
cool okay so we're gonna when we see a
swizzle we want to append the source of
the Swizzle to the
list and then we
return I mean we can return this Wizzle
without
uh base out replace source
that that's
right then we got like the list of
Colonels that we
scheduled I don't think that's right I
think we want to
uh I think schedule includes schedule
item and we'll have to get a schedule
item out of this
base. Source zero out of
range what how's it out of range every
Swizzle has to have a
source oh no they
don't because we rewrote them uh
cool so this is kind of what you see is
just going to break is going to peel off
one at a time so like
first we rewrite that one then we
rewrite that one then that's a kernel
that's a kernel that's a kernel that's a
kernel so on and so forth right we can
consume the graph
consume uh and then we left with the
final one which is a sync so we probably
have to add that one to the to the uh to
the list
too probably want to append that with a
sync and then here we can
sayal
this. a pen to graph right we want to
put the last one
too
okay so now we have a
schedule uh I guess kind of the problem
is you'd have to like kind of create
buffers in a pen kernel
you can create kernels when you do so
this is this is all like much more
rudimentary than the real scheduler of
tiny
grad give much shorter for in
Mandarin that's a good
point wait I kind of love that
idea right does it work
work like how do I say swizzle
B
attending tune okay that sounds
good what do you
think supports that kind of shit
right should we just should we just make
all the U off Chinese characters
instead oh what are you saying here uh
no there's two traditional the only one
I know is that's Shia
Right Way sh to small gradient that
doesn't sound
good I only know that
one y.org
tion
D
how oh God I know that
one uh Heaven
Earth
good uh oh that means in
uh uh
do I know that
one I don't know if I know that
one F what happened to
boo T how
oh what did I think is it means in
though Heaven and Earth is this
good Ma
it's
good
okay
uh the hell is this oh man the moon with
a hat on it I know this one well this is
like almost
readable love
this I'm working I'm I'm studying
Chinese as fast as I
can Leo AI that's the last thing I want
I like book
this browser
works okay
uh wow I'm really that's son
Reon oh that just means the day
three uh what's the moon with the hat on
it mean it means to have but I don't
remember the word
right
U
ye don't know on the third
day uh name that's
Ming Ming his
name the
name of the
day what's
this
for oh okay well good I guessed that
right um I don't know what that
means first
J the name of the day
first okay uh this is sure which means
is
uh I don't know
that first okay so like there is first
this is probably some kind of
like for
Loop uh what is
this is this Yun is this cloud cloud
okay I see when you Etc when you put two
clouds together that makes sense wow are
you guys impressed with how much Chinese
characters I
know uh what does a swizzle UOP do it
applies a shape tracker to the previous
uh to the previous thing
D
how Z is it Z I always forget this
one z
z uh Heaven Earth
good exist
I'm trying to get the tones right
oh when that's Chinese for
writing oh when I know when I don't know
Yan you have to feel it
more
um you know nor normally I never do
meetups cuz I don't want to talk about
fucking computers but uh if someone's in
Hong Kong and wants to practice Mandarin
I'm interested once I get a little bit
better uh you sure we don't want to do a
rewrite in Chinese guys are you sure
this code looks very
complicated wow is this what happens
when normal people look at programming
oh Chi they're prime
numbers uh
[Music]
[Music]
uh does it realize a shape tracker no it
doesn't realize a shape tracker a
swizzle literally just means apply the
shape tracker to the
buffer um that's all Swizzle
means so like you can you can tell what
it means more from uh the definition in
Ops so like if you look at what reshape
does it just creates a uh an S shape
basically an empty shape tracker I
should move that one down
there um it creates an empty shaped
tracker uh and then applies the shape to
it
oh tiny grad Shia is that a Chinese
character whoa wait I love that tiny
grad tiny grad it's not a Chinese
character it's just the gradient symbol
but
oh oh that means
lower
um I know that weird be because they're
in ying and Y
Yang yes
gradient
descent okay well I know that has
something to do with tree because it has
a tree sub character tree what are they
call
component something right
in no also I want this to be not in
these in simplified Chinese
has a drop down menu
I don't know if CH oh maybe
that uh I have to go in 10 minutes uh we
have the tiny grad meeting uh which
you're actually all invited to uh it's
in the
Discord uh you can't talk if you're not
a if you're not a if you're not a tiny
grad but but if you are a tiny gr you
can talk and you can work your way up
talking
um oh D way how
many
z h woman mouth oh Rue that's
if um saw that one in the programming
but I don't remember it
otherwise oh I see I can switch between
simplified Chinese and traditional
Chinese there is that
it turn
on boom. org
it's hard to come up with new words in
Chinese since it's not a phonetic
alphabet no programming is over for the
stream
um I'm just gonna Commit This call it
consume but yeah I mean this this makes
me very uh bullish on
replacing we can probably do this in
tiny grad so so what this is going to be
what tuni grad is was is kind of just an
example by the way we can check how many
lines it is so it's it's it's
4,291 um it's kind of an
example of uh how
to how we're going to eventually replace
everything with uops so I got I deleted
a lazy buffer here and it's it's just
uops
uh a method of Love perhap message of
Love perhaps Outlook into the
future
um I don't know
guys
uh it looks bleak it looks it looks
pretty bleak I I
like there's all sorts of ways to cope I
don't know I don't maybe it's like not
that Bleak like maybe it's just like
learn Chinese and like you know find
yourself a new like like
like really we really have to have World
War II because of some
assholes like it's kind of what it seems
like
right
um you
know the question
is like is the American regime
you just don't know right you just don't
know if this thing is on the brink of
collapse if this thing is going to
continue for another 20 years if people
are going to get into Power manage to
root out the corruption and you know
make it good
again maybe even make it great again um
yeah no it's interesting it's
interesting how there aren't really uh
Chinese programming
languages
um yeah that all the all the programming
languages kind of came from
uh all kind of like yeah
watching um I don't know and maybe all
feel like
differently like in America it's just
it's so nice to be able to
to
like maybe it's just California but
like American cities have tons of
homelessness um you know you don't you
don't exactly feel that safe on the
streets I I think that like a lot of the
crime numbers are being doctored right
we've had we've had a bunch of
experiences with
crime uh you know property crime
fortunately not violent crime but yeah I
mean I moved out of San Francisco
because I had two cars get broken into
and then my house got broken into I'm
just like I'm done with
this like this is
insanity uh but no no like it's racist
to like put criminals in jail or like
you people are wacko it's not racist to
put criminals in
jail the only people who say that kind
of shit are criminals I promise you
people of every race would absolutely
love if the criminals and I don't mean
like
dumb shit like drugs I mean the actual
like people stealing your
shit I'm pretty sure that people of
every race would really like if the
people stealing your shit and you know
you know beating you up and mugging you
we put in
jail like I I don't know I don't know
how the world got so wacko that like
well that's racist you can't put people
in jail because what if there's a
disperate impact what if more people of
a certain race end up in jail than
another person you see the only way that
could happen is if police are racist and
because we see that happen therefore the
police must be RAC like that's
wacka disperate impact I I just like
looked into what this was this is this
is literally it's the Indiana P bill
right you guys know the Indiana P
bill um the Indiana P bill was a bill
that uh you know tried to uh legislate
that uh that pie was was uh was uh
3.2
um you know just just 3.2 just to make
it easier for everybody right and like
some mathematician was in the in the in
the courtroom that day uh and he's like
dude you can't just make pie something
else that's not how Pi
Works um but you
know
like I I just wish a social scientist
was in the room when they enshrined
things like desperate impact uh like in
the legitimate social scientist right I
mean this stuff is going to be the
undoing of America uh if it's not if
it's not fixed uh and if it's not fixed
very
quickly right it's not but then again
like you know you know who would argue
against Merit the only people who would
argue against Merit are there people who
want you to fail the only people who
would basically argue against Merit in
hireing or Merit in Immigration are the
people who want your company or your
country to
fail it makes no sense
otherwise
um I don't
know I'm not
uh there's there's people who uh fight
there's people who flee and there's
people who freeze uh on the middle one
you know you find it out you find
yourself into when you find yourself in
in in bad situations there's people who
fight there's people who flee and
there's people who freeze uh and the
type of fleas man
like you know and look it's not as bad
as I make it sound like every day on the
ground
but this isn't how these things work you
have to look at kind of what's going to
happen in the
future
and I
mean who fixes this who fixes this and
how does it get fixed
uh the smarter thing is to flee yeah I'm
probably I don't know some people are
just they just how you wired I
think
um you went l c Island oh what do you
think
it was all right that's kind of how I
felt about
it I ran it a jet ski for 15 minutes on
likea island and that was about all the
time I ever needed to spend on a jet ski
but I was happy I did it um kim.com is a
True Believer in
dorismar assed and hounded by the
regime
like you
know I think that some of his claims are
a little over the top but I get where
he's coming from
uh might be helping under PR no no no
you don't
understand stopping crime benefits
everybody it doesn't matter if you're
rich it doesn't matter if you're poor
nobody wants to live in a society where
crime is legal the only people who would
Advocate Insanity like that are people
who literally want your Society to
fail right and I'm not talking about I'm
not talking about drug crime that's not
a crime right it's not a crime if
there's no victim it's not a crime I'm
talking about the two kinds of crime
that are real crime property crime and
violent crime right those are real
crimes and they're
bad it's not a straw
man um you
know so so I I think it like really
might be time to kind of
uh should techies get into politics to
reverse this
Insanity it might kind of be too late
right in some ways I I think that like I
don't know when I was young I was like
the most mid witted people go work for
the
government right and like now we kind of
see what
happened
um look I was born in the US and I may
very well die there too but
uh why is reinforcement learning
impossible well because credit
assignment is really
difficult
um all right guys thank you for watching
today's stream um we'll see how it does
when it's posted the
archive uh if this actually helps bring
good people into tiny grad I will keep
doing the streams uh if it doesn't help
bringing uh good people into tiny grad
then
uh uh yeah I don't know I think I think
I think I might be done
um uh hello welcome to your first day in
office you see we are the Deep State and
we have controlled this country for the
last 50 years you are willing to you are
able to enact uh any of these policies
um if you of course step outside that we
have a lot of ways of getting to you so
I I'm sorry I understand that you
thought you were running for the job of
President where you could make a change
and a difference but you were actually
running for the job of deep stay
puppet yeah uh I gotta go to the meeting
uh thank you everybody uh have a nice
Monday or Sunday or Saturday or I don't
even know what time is anymore what is
time man
happy Monday Monday it's
it's May let's put my lights on oh there
we go that's a nice tint
nice purple tint
uh
so yeah today we are training imagenet
it's a big day uh for the tiny Corp we
have today tomorrow and Wednesday to do
it uh and then I'm going to Austin for a
wedding uh so then I gotta leave uh and
then if we don't do it by then we're
failures but if we do it by then we are
successes and we can celebrate our
success uh
I don't know I don't know how how will
we celebrate our success
um you guys can can figure it out
uh hello good morning good morning good
morning okay so uh you missed it but I
downloaded imagenet I didn't want to we
wouldn't sit here and wait like these
files are huge
uh 160 38 gig and then I downloaded this
prepare script I Googled imagenet
prepare script
and I found this one and I did it but we
can like look in here and like train
let's see what we got
there's a bunch of images hopefully
they're all safe for work look here's a
shark okay uh so these are the image and
images that looks bigger than 224 by
224. but we're not going to ask too many
questions
these are all too big
I think if we actually like reduce
imagenet to like a reasonable size
um it'll work better
and then there's some like lists
somewhere of what these categories
actually correspond to
is there
without
maybe not sure
I'm not sure where does it tell me what
these categories actually are
oh that's a bustard
uh how's the job market
well we're on the other end of the job
market from you uh we are trying to hire
people
uh how is hiring people oh oh crap I
left the Wi-Fi on I'll be back be back
we're back all right cool
um where are the imagenet categories and
how come this prepare script didn't
include them
that's very weak
and
wire Crane and Mally at labels
duplicated
oh we have two cranes and two mallets
the labels here do not correspond
this is one of double crane as well
double mall yet is that really true
that's a mallet
is this also a mall yet
bro they're both mallets
also what the hell is Amalia you mean a
one piece bathing suit
browse syn sets what's this
turn this off it's buzzing
are there multiple mallets
this one doesn't have any mall yets
okay it has two mallets but it also has
tank suit I say
ah this one just doesn't have the double
okay
um
main completion object localization all
right whatever
um
I think I might actually already have
this in tiny grab
hmm Mouse outputs
finally start.txt
uh here I guess
voicing cash class IDs
oh there we go
911 is a category
Transfiguration what is this Harry
Potter crap
this actually part of
is this Upstream tiny grad
pipe train good morning everybody good
morning
no it's all just get ignored okay well
no that's real
um
okay it looks like we're just gonna use
this one
this one looks good
no it not uses the original index ID
here's one in Json
we love Json
uh are there two mallets
bro we're back in double Mallet land
is this the same way the
we should check all right never mind I'm
getting I'm getting
uh okay what what
all right
uh you guys we stay on topic here
um we also have a tiny grad Discord now
uh there's a tiny grab Discord but the
rules for being on topic are insanely
strict uh if you post it's not the
George Hots Discord if you post any
garbage when you want to stream Nest
that fucking band
all right I too don't live in a
privileged area you know what you sound
like you sound like one of them rap
battle people my hood that I grew up in
is seven times worse than the hood you
grew up in the things that I have seen
are much much scarier than the things
you have seen your life is nothing
compared to mine if we were to throw
down right now with fists I would emerge
the Victor right you know what I'm
saying all right
good
um
but a lot of work to get done and we
can't go off topic today all right
where did I put my face
oh it's over there okay so you can kind
of not see
uh yeah there's a class index the labels
okay how many mallets are here
oh this one has Malia tank suit I see
I don't know this one seems pretty good
zero attention Okay that's a tench Tinka
Tinka okay
Tinka Tinka
uh so we're going to create a new folder
and examples and we're going to call it
imagenet and we're going to do it we're
going to make it happen all right ready
we're making it happen
um so
let me oh here
um let me explain what I wrote that made
me optimistic for being able to actually
do this so we have this thing called
Benchmark train efficient net I've
upgraded it a bit obviously it's GPU
uh so I've upgraded it a bit it then it
uses the cache oh we have to enable the
cash CL cash equals one
and you see that it gets much faster
after the first three run-throughs and
then just starts flying through them
all right uh
but we have even something better which
is the chaot so I can set chaop equal to
one
and look at that it's three times faster
um so this is doing a forward pass on
image on on a size two efficient that
with batch size eight
um and you see this is how many
gigaflops we're getting or you can't
actually see that because that's what my
face is we're gonna move my face up to
here all right so you can see that's how
many gigaflops we get uh that's a good
number of gigaflops
uh it's not actually training I'll have
to enable training and that's a little
bigger we can also interleave copy and
run uh you see that not much of the time
is spent in realize most of the time is
spent waiting for cl which means we have
the CPU free
uh which is great now there's only one
little problem
um I believe if I do test AST here there
are actually broken asts uh so I'm just
going to file an issue quickly
let's see if we can uh find the issue
so chaop sometimes generates wrong code
okay it looks pretty good actually so
far maybe it actually maybe affects the
bugs I probably know we'll decorate
um so this is testing each AST and
confirming that there are no bugs
uh asts are the things that tinygrad
compiles to
maybe it was only a problem when I
enabled training
um so oh no okay it works uh let's
enable training
or maybe the problem was at a different
batch size
uh backward equals one
we also I'm not sure what net we're
going to use yet
um I like efficient Nets because they're
what we use at comma but I am a bit uh
old school
maybe the problem was only at larger
batch sizes because these seem okay so
I'm actually doing one intervention
um if you guys were here for the last
stream
uh I cleaned up that's all we want so
let's go to your code there
uh
uh oh here we go okay we got one wrong
rarely but it happens
uh Repro with
okay
um so now we have an issue on Tiny grad
uh I'm gonna assign the label to a test
failing
um
so if you are trying to contribute to
Tiny grad uh these three test failings
are very nice
uh because they're very easy to know
when you've fixed it
so you can see that this is generating
something totally different from this
and I wonder why
uh I wonder which what intervention is
actually breaking this
um and I'm sure we can learn more about
it
yeah okay all that valid stuff looks a
bit sketchy
losing track of what
you get better flops with efficient net
than resnet honestly I don't know I
haven't benchmarked resnet yet
um but so this is my Benchmark trainer
for efficient Nat and you see that
sometimes uh it has bugs so you can
enable it with test AST equals one which
compares the output of the AST to the uh
actually we should confirm that it
passes if I set chaot equal to zero
because there could potentially just be
another problem
um chaop generates a little cash in your
temp directory which says what
interventions to do for the kernel if
you saw we actually wrote search last
stream uh so I I upstreamed it
I cleaned it up nicely I moved it to
here uh the actually the only
intervention that's allowed right now is
upcast but these are different
interventions and I changed search to be
more of a uh to be a breadth first
search so I do like all the things at
one layer and then all the things in
another layer and this is only allowing
one intervention just multiple
interventions generate wrong code too
but debugging that doesn't sound like
it'll make a fun stream so we're not
going to do it let's figure out what
network we're going to use so what are
the state-of-the-art now for training
image now
okay yeah it works with chaopt equals uh
one so there is a problem in the
optimizer the optimizer can sometimes
generate wrong code
uh and you guys should fix this
uh so this is the tiny grad Discord
uh
a bunch of topics this is kind of where
we're going to coordinate I think tiny
grad's about to be uh
like this this stuff here is is very
exciting the fact that I can get a 3X
speed up with this Optimizer I'm pretty
sure this is faster than pytorch MPS
foreign
hacks in Benchmark train efficient net
here
uh you'll see that like this is the
caching stuff I wrote
uh this should be replaced with at
tinygrad.jit so if someone wants to try
that
uh that'd be cool
but that one might be hard
um
this one we have a half finished pull
request for this one
I had two good first issues on there and
this one is failing the tests and the
reading needs to be updated uh this is
not what I meant by updating this test
the problem with this update is it's
like it's still comparing
this doesn't really test like anything
it just tests that this zero view
matches
uh
the generated one which is testing the
functionality of Pad but not testing the
functionality of zero View
so if someone wants to do this issue
this issue is very much on the table as
well
uh
no no I'm not using NYX no fuck that
what what is possibly hard to match what
dependencies tiny grad has like six
dependencies and they're all like very
normal stuff
um
I'm absolutely not merging in huge ass
Nicks
though I've come around on Rust okay I
hate rust less
um
I've heard that I need to try rust and I
have I have a 2016 opinion 2017 opinion
about rust and the language has come a
long way
um
but you don't need yeah you don't need
lvm light lvm light is optional uh you
don't need lvm light to do any of the
stuff I'm doing here
if for some reason you have trouble
installing that I hit lvm light as well
a really lvm light should be replaced by
uh
like there should just be some like
Python and C type stuff that can replace
that all pretty easily I wouldn't mind
replacing llvm light
um and actually just having it output
the lvmir directly
uh
yeah and then just like write a little
thing to compile it actually if someone
wants to do that I wouldn't mind
removing lvm light I think it's all
really complicated
I wouldn't remind wouldn't mind removing
pi opencl as well so you'll see I
factored it out to this runtime
uh I open TL is kind of okay
uh we can also use Cuda Cuda has a has a
runtime as well
uh and it works
okay uh let's figure out what paper we
are going to implement
image classification
let's see imagenet one GPU in an hour
Oh Our Cafe two based system trains
resnet 50. uh
now anyone can train imagenet
in 17 minutes using 16 public AWS Cloud
instances no wow
wow
okay we don't allow Twitter in this
house
um
foreign
let's see what these people are doing
uh
oh they just have a better loader
a simple optimized code
it seems like they're just doing
resident 18 so maybe we should just
write resident 18.
eight concurrent resnet 18s
okay
is resnet still really the state of the
art
I mean it's not the state of the art but
like when people are doing fast stuff is
it really still just resnet
uh we should probably test it with cfar
do we have any C4 stuff
yeah I could we have so far
oh well I already have examples train
efficient in that maybe this example is
already good
this looks like crap
crap uh okay if I go into models do I
have resnet yeah I do
doesn't resonate use max pool
um
basic block okay
calm batch Norm calm batch Norm
yeah ffcv just makes pre-processing
faster
there's no way resnet 18 is the state of
the art
okay maybe it is
looks like a pretty decent
implementation of it
cool
China looks bad
wait I already like have you mentioned
that stuff
wait I already wrote all this
is torch Vision transforms
is Stephanie good
okay I mean maybe we were just
imagenet class index.json
so I know you guys wanted to see coding
but there just might not be any coding I
might have already written all this
no such examples okay there's nothing
called train files
it's a new version that does 10 seconds
yay I saw this on
thank you
what net are they using
what net is this
custom resnet 9 does it work for
imagenet or just C4
foreign
let's go over to quiet and let's
actually try this
laughs
probably not good enough not good enough
to get good accuracy and image that
foreign
why is there no torch vision
that's the GPU one quiet it's a uh
it's an Nvidia GeForce now it's a 1080
TI
um
I don't understand why are there no good
versions of torch Vision I think
I'm just gonna pie twitch.org
uh Linux pep
oh we don't want CPU we want Cuda what
Cuda do I have
12.0 well that's never going to work I
don't actually have 12.0 do I know I
have 11 7. I have fun
wait what this should just work
what a scam
pip update index
is there a way to do this
because I have two new over version of
python
NYX is a piece of shit and we will never
use it
NYX doesn't solve this okay Nick's just
created a new
do you want to download five gigs of an
identical system next to yours okay we
gotta really we gotta switch
why do I have to switch
no we're gonna make it work
foreign
look I I tried to install NYX once and
it took up like five gigs on my poor
little MacBook and then it was just a
whole new environment with a whole new
set of problems it's not better right
it's it's you know that XKCD about
standards
all right
this is Nyx
yeah yeah we need to develop one
universal standard that covers
everyone's use cases yeah
torch Vision compiles very fast good all
right in the meantime
let's take a look at this code
foreign
what is it using EMA for
what is Ema
hyper Lightspeed bench
I mean yeah I think before we do I think
imagenet was actually overly ambitious
we should probably stick with cfar for a
while
so basically I think the game is we're
going to re-implement this in tiny CAD
and see how fast we can make it
why did they do this to batch Norman
conf
oh I don't think that's supported
maybe it is
oh stride is Colonel says okay that
actually is supported
I can't believe this uses Max pool
because it actually use max pool or is
that an option
pull true okay
fast why does it use max pool
emulator Pi torch emulation layer oh
fuck with like all the crappy pie torch
garbage
the goal is to make it better
but watch how much shorter a tiny red
code is going to be for this oh that's
terrible
Speedy resnet how tiny are the seafars
we reckon we can cut it by 40 percent
I'm not so sure
uh
they're using are they using Cuda graph
or not
it doesn't look like they're using Cuda
graph
it doesn't matter
no we're not writing a pie torch to Tiny
great conversion this is the wrong
oh it's installed okay
um if you want things like that you're
solving the wrong problem
okay you don't want that
you want a thing that is ex like is
expressive right you wanna you want a
way to code this stuff that's expressive
Pi torches is
okay but it's complex
right so no I don't I don't like take
all this complexity and shove it into
something else
yeah let's download cfar
it's already taking more seconds
I thought this was fast
all right
what happened to seven seconds how many
epochs does it do
it's cool I like this code
uh
am I using GPU I sure hope so
uh why is it looping this
oh this okay I see so it trains are 25
times
it's taking 20 seconds
not bad
now can we beat it
I don't understand what this EMA stuff
is
yeah I know the target was 94. we don't
hit 94. but we're 593
okay let's replicate this in tiny grad
uh should we do it on the uh
we'll do it should we do it on quiet
should we draw quiet or we have that we
have a Cuda
it's a little faster
but we'll prepare it on quiet and then
we will uh
okay cool
uh
uh let's go to Tiny grad
um let's make an example and we're going
to call it hlb c410
h l b c bar 10.
okay
we have something to compete with
um it runs in 19 seconds in torch
uh is I know it's exponentially moving
average I just don't really know what
it's being used for
like I've seen that stuff used in uh
all right
um
here we have cfar in here
foreign
[Music]
get
far
foreign
nice things
okay
but it won't have to fetch it again
I see people joining now I warn you
about this Discord bam quickly banned if
you're like you know I just
I just hate that shit like
it's like you know I hate when The
Hacker News people are like oh let's
debate George hotz's personality you
know
what fuck you man
You can disagree with what I'm saying
but let's not you know what's what's
maslav's hierarchy of argument let's
let's keep it away from bullshit right
uh and there's like Maslow's hierarchy
of conversation too right it's the same
basic idea
if you're talking about things like like
the absolute worst trash is like the
oh hello uh I just graduated with a
degree what should I do with my life oh
my God nobody gives a shit about your
life okay I certainly don't and that's
the truth right
and you know what I wish people would
return the favor I really wish people
would return the favor and not give a
shit about my life right like stop it
doesn't matter okay
like
you know focus on my ideas and what I'm
saying and you can disagree with them
and that's fine that's just great let's
disagree with them and let's have an
honest conversation
doesn't really have more than one
hierarchy this is fake uh see look we
don't even have lvm light like it's not
even available all right but let's just
see if we actually need NYX oh shit
cannot install tight on version 311 all
right fine
um
um
okay I'm just typing that over and over
again that's not working
okay let's re-implement this net
uh
uh that looks like a good class to have
class con group uh note in time grad you
don't need to uh
subclass anything
channels out residual short pool SE
a
you know what I'll tell you it's a song
when you respond to that the truth is
compassion is just going to hold you
back the thing's the worst thing you can
have is someone who enables you to be
shitty right
um
okay I'll note that residual is always
true pool is always true when SE is
always true so the only one we'll
actually put here is short
uh from tinygrad.com 2D
well we just have some
default commvarks
kernel size three padding saying bias
false okay
you couldn't write that like you're like
oh yes we saved a few lines but you
didn't think about
foreign
Ty right
got a lowercase the D
uh
kernel size equals three uh padding
equals
should we support the word same no we
really shouldn't because like I hate
that like it's just it hides it hides
complexity that's I took elon's rules
and I posted them in in comma slack and
I said they're all good and we have rule
zero which is surface complexity because
you're hiding complexity by like you
know shipping things out to like like a
company that like oh well you know we
just write the specifications for the
hardware and then someone actually said
that to us almost like comma doesn't
build the hardware you guys build the
specifications for the hardware and then
you ship it out to a factory I'm like no
no like we build the hardware oh okay
you designed it but you have a factory
somewhere I'm like yeah the factory is
on our first floor of our office right
because because otherwise you're just
hiding complexity
someday the comma Factory is going to be
all robotic and it's just going to be
robots that sit there and making money
and I'm gonna be like I own the means of
production
uh
suck it communists
um
okay Max pool is not actually see this
is another I know torch loves to do this
kind of stuff but really why is your
activation function a class that's
created in a net right this this right
here is something that I never want to
copy from torch there's absolutely no
reason that this should be a class
uh bathroom obviously has to be a class
one equals
batch of 2D and we just have to put in
the size which channels out
not short
uh we have two two
similar to comp one except it's just
channels out
three
three self dot se1 equals
we have an end on linear right
as we go channels out channels out into
your device 16.
and then we have the opposite of the
squeezing site layer
all right let's see we'll figure out how
to tighten this code up afterward uh we
also use we don't use forward what is
forward we use call
thank you
um
okay and then we want to Max pool
uh so remember tiny guard doesn't have
documentation it just has the tensor
clasp which actually pretty nice to read
uh so we'll just do a Max pool 2D
uh
I don't like that that doesn't support
single kernel size we probably I want to
support just like the number two there
the same way by torch does
I think I have a helper function for
that
do I have a helper function for that
you see what I mean like I don't want to
write two comma two
I use that somewhere
it's not exactly ARG fix it's similar to
arcfx
and we'll try fine
it's a new helper called make pair uh
return X comma X if
uh is instance X hint else
go down to
Magpul 2D
and
do it like that
cool
all right now I can support that
great
uh
okay we got a pool
Norm
dot gel you we're using gel use is it
capital gel you and Tiny grad
no it's lowercase gel you I don't know
why it's Capital by torch
uh
okay if self dot short we just return
right there
save short yeah
X
or does it say haiku
okay we always do squeeze and excite
so I'm going to say malt equals
oh look at this
wow squeezing excites brutal
do I actually want squeeze and excite
I feel like I don't need it
foreign
stupid I don't like squeezing excite
okay uh now we do self.com 2x Dot
self.norm
to self.com to
dot w
Norm three
dot gel you return X Plus residual
cool
all right that's my implementation of
call group
do we really want to write this
okay fine we'll write this so it's
exactly the same fine fine fine fine
uh mult equals okay
how do you write this entire grad you
say residual dot mean
um
dim is two comma three I don't think we
want to keep dim
uh we want to do
self.se1 residual dot mean dot gel you
we do self.se2
and then that has a sigmoid around it
dot sigmoid
and then they do unsqueeze minus one
twice
so I think that do I have on squeeze
it right on squeeze
does someone want to write on squeeze
and write a test for it
yeah could someone write on squeeze and
write some tests for it I would
appreciate you
uh
I should be able to just do it like this
it's actually almost cleaner
uh
model EMA is apparently a training trick
okay so this self.com three uh we throw
it times molten here
great
I love my implementation
beautiful
comparing this
to that
and like a lot of this has to do with
the tiny grad style being kind of
different right there's no reason that
things like stateless things like batch
norm and jellyu should be created in the
init I I still don't understand why
pytorch does this I understand that you
can use pytorch functional and not do
this
but
um
okay cool okay we wrote conf group that
should probably go above train
whiten
who's whitening
the unit hypersphere
that all looks hard
okay they call their net speedy resnet
so we'll call it speedy resnet also
um
and an init function
I'm gonna create all these things okay
uh
so I think we can just say
self.net
I can just do x dot sequential self.net
and then for self.net let's just put
these in a uh
in an array okay we have the white and
conf
I don't know how I feel about this white
and calm
all right let's learn about whitening
foreign
GPU moving all these are cool
thank you thank you for this link
sell you
ghost batch Norm
Ally
okay whatever
why is there a unit hypersphere that's
how I feel
White
whitening kernel size two
they are a knit whitening curve
eigenvalues and eigenvectors okay we got
to draw the line somewhere guys and it
said eigenvalues at eigenvectors
what's depths in it
all right self.com we have the input
calm goes with three
weight equals false
I feel about that
okay we're definitely not doing this we
have to draw the line somewhere I wrote
squeeze and excite
um We're not gonna do this
we can't do this this that's crazy
whitening's crazy look at how much code
there is for that
base depth is 64.
all right so there are nitcom is 64.
I find yeah they're right at that
there's misspelled scalar okay
um it's not self.com what am I doing
it's nn.com to D
uh those things what's our initial
kernel size here
I also has one that's fine
uh
four
tell you
now we put in these columns
64.
[Music]
28 256.
26 512 what is this fast Global match
pool Max pooling thing
an idea it's just x dot Max yeah
okay
next two comma three
uh then we're gonna do a linear
from 120 to num classes which is 1 000
bias equals false is my linear layer
support that if it doesn't it should
oh yes it does okay bicycle is false
that's good
uh and then temperature which we don't
have
great
can we just point out how much shorter
this I think this is an implementation
of the net
um I know I didn't write the whitening
but still like
this is what I mean about I don't want
to write a stupid translator for pi
torch I want to do better than Pi torch
right I don't wanna I don't want to
write like that sort of garbage and then
also I want to do this right let's just
do this
uh
thank you
oh no that's slightly wrong uh
right
beautiful
and we'll let non-subscribers talk about
how beautiful this implementation is if
it works it works
you know what the worst question in the
world is it's can I ask a question
not only do you already ask a question
it was the dumbest question in the world
that's actually the dumbest question
hello can I ask a question
it's like it's a go Delian in the way
it's broken
foreign
coffee
sorry I can't bring you guys
need a boss
and coffee
come back soon
yo I saw a fire tweet it was like can we
talk about how George Hots deleted all
these tweets and tweeted an image of the
Joker saying who wants to do AI
dangerous this isn't a man I trust with
the fate of the world I wouldn't even
trust him with my kids I really liked
that tweet I posted on my Instagram
um
oh the best is you ever text with old
people and they like sign it
I hope you're having a good day dash
dash mom
favorite TV show all right you're the
reason we're going back to subscriber
only it's time you got actually fast
with Cuda yeah I mean we're gonna see
it's like look it's not gonna be as fast
as this this is a hyper optimized like
it's a really unfair thing to compare
against we should really compare against
like a normal torch implementation of
this yeah I don't understand why they
think we're trusting you the face of the
world either exactly that's the funny
part
because I tweeted a picture of the Joker
like oh my God
the whole Twitter Saga
it's just it's it's it's absolutely
unbelievable the way
like and everyone says this who reads
the news the way the internet just gets
things wrong
and you have the inside view so you you
know how like laughably wrong this is
but
um
you know what I'm saying
yeah we don't have to download Stupid
torch Vision either
okay
um all right I think we can just train
now is that right is it gonna work
to do add
whitening we're going to learn about
whitening
uh we did a GI beta is Jai released
can I like code in it
why is my internet slow
should we write tiny grads and dry
foreign
y for me yet
okay uh net.2 net memory format torch
channels last we don't need that in tiny
grad
um
okay from Tiny grab import and then
tensor
uh where's my trainer I have some
generic training code in here don't I
extra training
is this gonna work
um
extra import trainer
and then we can say train model X Y
uh oh we need an optimizer
yeah we need to create an Optimizer uh
okay what Optimizer they use
Adam not Adam great
SGD all right easy
I guess SGD is fast
uh okay Autumn equals NN Dot
uh optum.scd
create the optimizer with model I think
well let me find like an example we
actually trade something
no
um
we've tested the train amnest let's just
look at them
uh uh and then dot Optum
I'm not sure and then that often is
going to work for some reason
do I not
oh yeah that's gonna work
okay turn that import
ant
tensor not work oh it's from Tiny grad
dot tensor wow if I can't even use this
how could anyone else use this
foreign
if I import it as Optum what do I call
it here I call it optimizer
Define Optimizer you pass in model dot
parameters but that obviously doesn't
work
oh man
am I allergic to this sweater
foreign
but I bought a sewing kit off Amazon so
we're gonna try selling
nice
we've got parameters now we're just
gonna pass it in to get parameters model
and there's like a good reason why you
need all this stuff
okay uh we pass in the optimizer and
then how many steps how big is cfar
uh what batch size do they use that's a
real thing we can find
uh
5 12. okay cool
uh yes equals five twelve loss functions
fine everything else is fine oh no we
have to pass in steps as well okay for
steps we're gonna say x dot shape sub
zero divided by 12.
should really add
what am I doing that's fine
okay
did we do it
uh we don't even need tensor this
training stuff should probably make its
way into official tiny grad
like how
642 lines 53 it's the only difference is
my code doesn't work and it's way slower
but other than that it's way shorter so
you have to give it some credit for that
um
it may be wrong and slower but it's
short
steps is not defined
we're going to use steps
did I try to like save that or something
I saved garbage
all right we had to make pair that's
fine let's go
com group requires one positional
argument short oh I didn't put in short
um we're going to say short equals
ah
only the middle one
train got an unexpected keyword argument
steps
I have steps here
I guess they don't expect it
I'm allowed to use keyword arguments
like that right
and we'll get rid of it fine
I don't get that
uh oh no the problem is I call this
train
uh we'll call it transceiver
can't can't call two things train that's
too much train
you can't have too much pain
uh Speedy resnet has no attribute
forward oh really
really
I hate that it's forward
shouldn't be forward
why did I call it Forward I copied that
from torch it's stupid it should just be
that
uh none type has no attribute shape do I
not return sequential yeah I gotta
return
all right
19 steps okay cfr's tiny
the C4 I have an evaluation set
there's a real code to it
oh well okay now it's training on the uh
just add a test for that new make pair
thing I did actually I'll just do it
quickly
let me just do it quickly because if I
don't do it uh uh where do I test Max
pool
test Max pool 2D simple
also just add in
two and three here
great
pair
and first
at
hlbc410
now we figure out payment flake my pie
good
okay let's try this GPU equals one uh
opt oh we're gonna have to put caching
around it should we just write the jet
we should probably try
we don't need to set opt uh we would
like to send feedback
all right
it's running stuff
okay
now the loss is going down it's probably
going man because that stupid squeeze
and excite which may I remind you I hate
no that's not why it's coming in
whatever we'll put it back in later
uh
let me see how they wrote that I
actually have that as an option
I do kind of like that as an option
foreign
foreign
I just find that more readable
like I'm not even doing that for lines I
actually just find that kind of code
more readable
than like this kind of stuff because you
have to read so much like this you just
spend a bit of time on each line you're
like oh okay it's creating the same calm
checks the range does the first one okay
why is the loss going man
uh
I said training to True oh did I not set
training to show I don't think I said
training to Cho oh that's a training
never mind
okay why is the loss going now
it's not related to The Squeeze and
excite because I disabled that
see if any of the asts are wrong
[Laughter]
unable to allocate 144 gigabytes
ish
okay
I mean that looks like reasonable
why am I getting Nan's
let's try a batch size of 16.
much hope for that but whatever
okay doesn't go Nan anymore
it takes longer to go Nan
what's happening that's going down
there's nothing weird at all in this net
if I write something wrong
I mean their shapes look very good
shouldn't be anything wrong with gel you
there shouldn't be anything wrong with
Max pool
we're not using this
what did I do
this looks like a very simple net
oh could my learning rate be wrong that
probably seems like the most likely
thing I didn't set it what is the
default learning right seems somewhat
reasonable
they're using some cycle
I don't know let's just use Adam
does anybody trust sgg not me
Nance
foreign
they had a more stable example attached
to comments here
of memory
oh they changed the bachelor momentum
yeah so they changed that
shouldn't really matter
they did something with the bachelor
momentum right oh EPS is Tiny
Bachelor momentum equals 0.8
um
okay that's also that's an insanely High
momentum
or it might be the opposite
weight equals false bias equals true
but I don't even know it supported that
no no that explains why it's broken
that's not even running
I just want to take it out like I just
don't like it it's bothering me just
being there
can we take out some layers what layers
there shouldn't be anything wrong with
gel you I mean we can try changing that
to relieu
oh
okay gel you is not a chill activation
function
there's probably something wrong with my
implementation of it
all right we can put squeezing excite
back in
I don't need this crap anymore
foreign
[Music]
they used
they probably use some crazy high
learning right
Max LR
I don't know I don't trust that
uh we will say we will make the learning
rate explicit here though because I
forgot all about it if you don't make it
explicit you'll forget all right
what is the accuracy zero
oh
does cfar have how many classes does
cfar have
I assume cfar 10 only has 10 classes
gnome classes yeah 10.
okay well that's a problem
be far away is 10.
why is gel you broken
it's a large batch size
and now we also want to use the cash
I could just add the cash in here to the
trainer
this is so slow it's just painful all
right let's make the batch size
56 that's a good compromise
uh we're gonna have to take this trainer
out we're gonna have to
yeah we should we gotta do apples apples
that size is 512. everybody knows the
matchbox is 512. don't try to lie about
other batch sizes as a scam
okay
um so which one of those is time it
takes about
two seconds to do an Epoch in pie torch
and it takes uh
one minute to do it inside
uh don't worry don't worry you haven't
even turned on the optimizer yet
and I'm sure that train code is super
unoptimized
um
this is using numpy ew
oh do I have to put a log soft Max how
did this not do a log soft Max where's
my loss function
cross entropy loss
label smoothing
yeah no we got to put a log soft Max on
here I think
[Music]
um
how come this one doesn't have a soft
Max
what is NN cross entropy lost does this
include a log soft Max or something
the input larger than Target
ah this case is equivalent I see
we need to analog softmax
yes
I'm gonna stand up down here
okay that's not going to make it faster
but it's going to make it more accurate
so this gets a train accuracy of 54 by
the end of the first epoch
so let's see what we get to
also where's my vowel set how do they
get a vowel set we need a vowel set
train equals false
three data sets dot pi
databatches dot one
let's fully other files in this tar file
for non-train
why is my accuracy so bad and I'm using
atom
can't wait till we start optimizing oh
we'll optimize don't worry
okay right now we're off by a factor of
uh
dirty
but first we gotta find out why there's
bugs I don't know it's 10x learning
right
looks like a diverges
the loss is going up
that's not good
oh I don't trust this large batch size
uh no we have that in the trainer zero
Gratz here
uh we're gonna figure out how to get the
training set
uh
TT extract file
wow that's not even all the training
batches
wait so you're telling me that this is
running it never mind we might be off by
another factor of five
which is just brutal
as well as test batch dot bin
foreign
also has evaluate
why do I need to tell it gnome classes
foreign
[Music]
foreign
that's brutal if that's true
there's actually that anymore okay let's
run the optimizer
the optimizer is slow I warn you
foreign
foreign
you can read the optimize you can read
uh
as you see how much speed up we're
getting on these things
on the kernels
this is like each kernel that it's
running
and then that's how much it's speeding
it out
wow that Kernel's so slow
the kernel was taking 11 seconds
all right I got a lot faster
it's about twice as fast
still this is so fast
we're utilizing the GPU
80 to 56 pathetic
pathetic
uh okay the problem might be how we're
copying and what we didn't use tiny red
jet oh the problem now is just tiny grad
yet
forward crap
uh if I check out open assistant is this
is this is this a real thing or is this
a bunch of people promising to have
something
Lion's pretty legitimate
is it good
read the first pointer of their plan
seems very bad
where
oh the thing about like putting the
human first or something yeah you just
need to like I don't know we put the
human in the center yeah you just need
to like read past this garbage like it
doesn't mean anything
I don't know someone was talking about I
saw hackers comment about like com AI
safety principles wow it's so sparse and
minimalist like let me show you the
waymo safety page let me show you the
common safety page right
okay
so
like this is I hate this so much in the
modern world like fuck waymo and this is
like safety is at the heart of
everything we do because safety is
urgent TM like I hate you
this doesn't say anything this doesn't
have anything to do with safety at waymo
we are as rigorous and Innovative in our
safety practices as we are with our
technology we've built a cop fuck you
what is it
right
none of this stuff has anything to do
with
here here we go here's the waymo safety
report our first thing is our mission
we're building a safer driver for
everyone and a stock photo of its
six-year-old kid
fuck you
like this isn't okay
no and someone needs to be told that
this isn't Okay and like anyone who sees
this kind of shit needs to just be told
this says nothing about safety and
you're killing people right I really
mean it I really mean it this kind of
shit is killing people right it's
killing the future it's killing the
world it's bullshit okay compare that to
commas we've been seeing questions about
modifications don't violate our safety
model or not right now we already have a
documentation describe well okay the
Link's broken
um it is in there it isn't there we just
moved it it's in docs.safety.d someone
should update the uh
someone should update the link but um
the driver must always be paying
attention the driver must always be
capable of immediately you're taking
manual control of the vehicle the
vehicle must not alter its trajectory
too quickly for the driver to safely
react right so you know this one
obviously involves the driver like like
this is
maybe we forgot something I don't think
we did I've spent a lot of time thinking
about it
this is bullshit that you can engage
with
right and it shouldn't be okay it
shouldn't be acceptable
this is and and then another someone on
hackard who's saying that they prefer
this garbage
that they they prefer just just just
empty statements about how safety is
important to these people
right look there's pedestrians Crossing
while our waymo waits for them I hate
you
all right test that accuracy is 0.1
that's not very good
uh I don't know should we try Adam I
also broke Adam yesterday actually I
didn't break Adam in general
um
yeah comment has actual information you
can engage with it you know it says
something and you can disagree with it
if you can't disagree with it you're not
saying anything
it should definitely work without
squeezing exercise you don't need that
uh all right should we write the should
we write the jet
you asked a keyboard question
oh
let's check Matt mold don't worry about
Matt mall it's not mammal
like my map Molly is slower but it
doesn't really matter
the you're so far like Matt mall is the
thing that's been hyper optimized on
gpus but you're not getting anywhere
near the real number of flops
um so it's so it's so it's irrelevant
uh all right let's
should we write tonygrad.jit
uh
uh you just use one output and one
thread yay so there's a lot of stuff we
can do to improve the actual like The
Meta code here
uh-huh so we'll we'll get there
um
just right train step jitted
it looks something like this wow it's
using forward I hate forward
[Music]
um okay
model X
tensor dot training it's a true
code is slow
we'll read fast trading code in a bit
um okay
oh
this putlock softmax there
this didn't but that sparse cross
entropy so slow
look it's creating that oh it's so slow
now when X isn't even right here okay
um
well okay this is fine we just need to
be careful to create it here all right
let's call this x train y train we don't
need the tests
um let's pick the sample tensor
[Music]
up here
uh tensor equals X trains of
Sam
um we'll say SX
y equals
um y train
Sam
y a y Dot
yeah like this is slow
foreign
uh opt is different opt is for the lazy
uh the lazy thing
yeah we're gonna have to write like good
versions of all of this this is very
slow
foreign
should just be
es and I'm glasses right
this doesn't even need a flatten this is
way overly complicated
uh range
BS
sub
foreign
object
oh
okay cool
that should work
we'll have to like multi-thread this
shit out of this all right
um now we can do train step jitted
[Music]
and uh to do this will become at
timecloud.jet
uh we say equals all skip no Jets
uh we run the model for x
that's out uh out out dot Mall y dot
mean that's loss
um
zero grab
backwards
should be right
zero grad
I'm not going to call it opt-in we're
going to call it optimizer
foreign
we should Benchmark these things I think
uh
lost realize it's not really right
we have parameters realized the
optimizer should do that right
I think my Optimizer is actually do
realize the parameters
yeah they call realize down here okay so
they realize the parameter so don't you
need that
uh okay if not jet
you want to save the cash of I equals 1
CL dot hash equals that
oh we have to import CL
ick so cl.cash will make it actually not
run and we'll just output it into the
cache
um
I'm gonna do one
all this stuff
we're gonna cash it
and if it's cached we'd run that
foreign
foreign
foreign
foreign
yeah so this should be like just part of
a jet and that should be the return from
that
uh
yeah so I'm actually gonna move some of
this stuff out
and we have something called Global
counters so I should just be using that
counters Global Ops
um we want to set what kind of double
Ops to zero
oh that still gets incremented even for
cash
it's fine
just turns it through the cache so she
runs it twice which kind of sucks but
okay
um so we're gonna move this down here
we're going to say loss equals here
uh here we're always just gonna say
return loss I'm gonna move this stuff
down to here put ET here
and we don't return that
Ops global counters.com
that's what we're gonna plus equals in
this tight little Loop
that all seems good
uh if we're caching I don't actually
want to increment that but I feel like I
increment that in office GPU
uh which is kind of too bad
yes you're included here
which means that that's actually going
to run it twice
let me write this a little differently
uh first equals true
um if
first I just want to run it normally uh
if not first
uh and then here we'll just run this
um
[Music]
should be right
no no I want to run this uh if not first
I don't know that's not right
if
if CL cash
I can't do it else there because I do
want that to run on the third step okay
let's try that
and we're going to be optimizing for
right now
okay cannot access variable first or
it's not associated with a value
I love the new python Errors By the way
uh we can't copy something to that while
we're caching
for now
okay so we see about how long it's
taking it actually I'm not even sure the
cache is really going to help because so
much time is being spent in Seattle the
run time can be made faster with the
cash but nothing else can
uh either way if we get faster one time
that sounds good
uh why is that failing that's failing
because we didn't realize X and Y
oh and then
there's a lot wrong here
[Music]
foreign
so CL is the time that it actually
spends so this is going to force the clq
to actually be uh realized this does a
blocking copy when we copy it to the CPU
um if we don't do a blocking copy
oh here's another font thing I'm not
sure how
bad oh no this isn't going to work
because I'm on the wrong computer
okay that's how many gigaflops we're
getting
that's a somewhat reasonable amount of
gear flops do we think I don't really
know
uh let's even fix the cache
okay cannot copy while caching uh oh
because that should not be in the cache
how is that in the cache
that definitely
definitely
definitely
okay I should be oh okay if not first
uh and then CL dot cash equals none
let's try that
great okay notice how run now instead of
taking 102 milliseconds Only Takes Two
milliseconds
all right this isn't the problem because
we're spending so much more time in
Seattle so we won't we won't try to
debug two things at once
okay
we're taking 700 milliseconds to do a
step right now I feel like this thing is
doing steps unbelievably fast because
those are epochs
I don't even know how many steps that is
that's insane
I kind of feel like we should just give
off this is way too fast
um
this is way too fast this is insane
okay it's doing 96 steps
1997.
it's doing 97 steps in two seconds
[Music]
with big batch size with a bigger batch
size than me too
yo guys we should just give up now this
is too good
foreign
does it work I'm not even worried about
that yet we'll get there later I mean
does it work the loss is going down so
yeah it works
it's taking 800 milliseconds and that
takes 20. so we are off by a factor of
41.
great
with the optimizer we're only off by a
factor of 20.
but it also seems like the optimizer is
wrong because the losses were different
guys this is hopeless
this is so hopeless
the losses are different with the
optimizer
foreign
implementation and see if that's faster
I don't think it will be
oh
I shouldn't even really be using CL
IP
foreign
argument
great
well that's an interesting thing for
someone to debug
uh that's
foreign
where do I make CL dot mem used
[Music]
it's in the opencl repo
yeah we do actually want that there
I mean it's only the kernels okay so we
can we can see the kernels you wanna see
the kernels
also what's even sadder is they're doing
this with a batch size that's this much
bigger so we're actually no never mind
we're off by way more than that
you guys this is all close
to be fair
our Target is not
Nvidia
our Target is the M1
and the torch on the M1 is pretty bad
brutal
brutal
because that is the batch size they're
using right
thank you
code's so good
look at what they're putting through the
network
the link you wrote gets to 80 percent of
theoretical speed which link
all right well we totally aren't ready
for imagenet yet we have a lot of work
to do so fast
saying how fast that is
all right
Cuda mmm yes I understand but
we will include this I'll add this to
the top of the uh file
you but again like we're not doing
Matrix multiplies we're doing
convolutions
um this just seems to be super optimized
and if we can get even close to this I'm
so happy because okay the idea of tiny
grad is not to
is not to give you the highest end
performance it's to give you good
performance in all cases
like you shouldn't really have to think
about performance you should be able to
write very simple code and get high
performance and the back end will deal
with everything for you
um
sadly we are so far off
well I can show you the kernels so there
are a few cool advantages to Tiny grab
which is it's easy to actually print out
the kernels that are running
and we can look and see how many
bajillion microseconds these things are
using
uh I also want to do I kind of like
do this stuff here
equals zero
this should move to Global Ops
okay
actually I really want to say kernel
count to zero two
see if we can safely do that
yeah there shouldn't be a problem with
that
initially oh it's in here
okay
foreign
so it's doing
133 kernels
[Music]
why are those not fused
that should be fused with that
well that's an interesting problem in
itself
those should be fused
and it's like it takes time but still
that shouldn't be there
oh see these are just bugs okay so this
here is a single convolution that's the
reduce
uh wait I don't understand what that is
never mind this convolution's weird
all of them have this
for some reason this isn't being fused
with this
and we can start really trying to dive
into why
um we're running training we're running
backwards
probably has something to do with with
that
probably has something to do with the
backwards pass of the bachelor not being
well written
so if we can get the number of kernels
down so it's doing
133 kernel dispatches now we can also
look these are the backwards kernels the
backwards kernels are getting a terrible
amount of Gator flops
like this GPU should be
and this isn't even including tensor
course which we'll get to we'll get to
using tensor cores guys
um I don't know if that's is that
possible from opencl
tensor cores are now used efficiently
what is this
you can in use PTX inline assembly in
opencl
oh that's sick
yeah I mean we're gonna have to use
tensor course there's no way that but
let's see how many Ops the network is
I want to reset the op count to
where is that printing
oh seal.op sum that just shouldn't be
there
we have a lot of refactoring to do
but okay now we're going to get a real
op sum
so we can see down here it's doing
this many Giga Ops and it's doing this
in two seconds
that's like not even good
it takes two seconds to do that
no I can't be right
no no never mind it takes 20
milliseconds to do that okay so the real
their step time is 20 milliseconds
20 milliseconds per step
if the step is this many Ops
uh what's this divided by 20
milliseconds
foreign
58 teraflops
wow
wow this code's unbelievable guys
we're getting 58 teraflops
foreign
foreign
they're not using Cuda graphs
they're just getting straight up 58
teraflops
we can talk about why that is
wow
foreign
now it's doing the copy ends
uh that's the optimizer back on but the
actualizer is giving me a wrong code
this is actually running the optimizer
right now
you see all these it's like trying all
these different permutations to the
kernel
so they're also using float16
foreign
code this fast and doesn't know how to
spell scalar
foreign
okay so there's several different levels
we can start optimizing at we can start
trying to figure out why diffusion is
broken
it's always an interesting idea
uh we can try to figure out
we can try to do
it's going to require some hand
optimization but we could figure out how
to use the tensor course
uh we could add support for float 16.
so it's only a 2X
or so many orders of magnitude off guys
should we just give up
just just give up time I feel like it
might just be give up time
so much faster
58 teraflops
I've never even seen a number that big
and that means some of the Kernels have
to be getting more than 58.
58 is the average teraflops
where the tensor cores do have
unbelievable performance
foreign
we're doing a little better we get about
2x with our Optimizer in exchange for
being wrong
what's the theoretical Max
that's a good idea that's a good
question ah
it has 320 tensor cores
so it has to be using the tens of course
I mean that's not
float floating Point 16 doesn't even
seem to make it faster
G flops per tensor core
okay the a100 is 300 and 712 cancer
flops
and how many tons of cores does it have
maybe we can just divide
four tenths or cores per SM okay how
many SMS does it have
[Music]
each SM
no one's ever beating Nvidia
foreign
s with four tensor cores per oh wow it
has a lot more tense of course
no wait this says 422 tensor course
and this has 320.
isn't that a different architecture I
don't know they're both ampere I believe
yeah they're in Pierre they're the same
oh there's a pole I say
how to use tensor course all right we're
going to use tens of course
oh we also have a question of why the
optimizer is broken
foreign
pass
but these aren't even
this is the first real convolution
these convolutions they cannot be this
big
all right I guess we're going to look
into how to use tensor course
it's all on the table of Tom's Hardware
all right Tom's Hardware T flops is it
really I don't think you're right but
maybe you're right
oh you're totally right never mind I
like you you're good
tensor
wait I don't really believe this though
why is it in parentheses
I think this is the float 16 and this is
the tf-32
so at float 16 the theoretical maximum
is 273.
foreign
scam I say
okay
so
it's
sparse I say
uh what about t float32 does this
supports T flow 32 right for at half the
speed
no you really don't want me to support
float 16 no no we're not supporting
float 16. guess what it's not a
democracy foot 16 is stupid
foreign
with sparsity
um let's turn off because I should just
be able to turn off float 16 right
let's turn that off
how slow was it
does that work
foreign
foreign
wins thank you thank you we're gonna
look into tensor cores right tensor
cores are way better oh you voted with
Channel points I see
all right we're gonna look at the
hotties tense of course but first we're
going to figure out
thank you
where's this half stuff coming from
just use amp this doesn't use Apex it's
a nice code
x dot flow flow 32 float32
that's fine
it's all fine where is the half coming
from
the inputs oh
could these actually need a float
I think it's putting all the data on the
GPU
type is that
foreign
every channel point in the world I
wouldn't talk to my fucking keyboard
all right
[Music]
I don't get it what
what the hell
forward call Net inputs
get batches
something here converting it to half
how's that for 16.
foreign
get batches
here
data dict key images
batch crop
that's right
oh
[Music]
we'll just hack this
see the problem
this is saved
foreign
still pretty good
it's about four seconds
actually I assume that's tensorflow 32
we can disable the tensorflows there's a
parameter for that
uh
uh mvtf 32 override
um if you don't do that it's silently
so then it's not actually float32 it's
tensorflow 32. uh which uses the tanza
core so now there's new ones not easy 10
squared wall okay and now we get that
give it one more because it's about 6.4
seconds
so if we get four seconds
4 divided by 97
go back to this 2 divided by 97 if
that's
two seconds that's milliseconds per step
we want to take this and divide it by
that
so that's 50
56 Tire flops
28 teraflops and then if we don't use if
we put the override on we get 17
teraflops
so we don't look as far off when we're
doing the other stuff
just to uh
okay so this is each one of these is
about 50 of the theoretical it looks
like
[Music]
that's an amazing car it's actually
super high it's way higher than I
thought
foreign
foreign
exactly the same
so I guess we're not memory bound at all
basically 39 dude let's view right now
it's really good
okay so we're getting I mean that's cool
we're getting 50 see look tiny card is
already useful we we computed the the
number of oh no wait we're not even
doing the whitening and we're not even
doing a squeeze and excite
it probably doesn't have any Ops I don't
think that's much
it's like the same
actually less
I don't know how that can be less but
whatever
so now we're just wrong
no
is it less with squeeze and excite
so you can see these Ops here are the
ones that are actually like creating the
weight Matrix and they're pretty slow
we're still we're still orders of
magnitude off without even touching the
tensor course
so I I don't we have to figure out why
like until we can get closer there's no
point in trying to play with tensor
Force well
this is just brutal how demoralizing is
this demoralizing guys it's demoralizing
um
thank you
oh Taurus is also cheating a little you
can get rid of something else from torch
stuff
just tiny grade work on arm nope it only
works on x86 python
we hand coated crap to make it only work
on x86
of course it works on arm
uh
oh yeah what did I want to disable oh
yeah at the last Channel's last
it's even faster
foreign
wow
the whitening is the speed up
uh
of course my T flop calculation
not there I don't know my two flop
calculation is and whatever
whatever it's so fast
okay
guys I don't know it's too fast
it's too fast that's without even using
the uh
so we get 50 milliseconds basically
basically
all right so we are off by
all the time is being spent on the GPU
so you can see the ratio here of this
to this this is the actual like GPU
performance timers and you can see that
all the times actually being spent on
the GPO
only
64 x off
well
we're off by 64x
how are we getting a 64x speed up
so I can start to show you guys some of
the tiny grad debugging tools
then it's nap time and they'll go back
to this
we're getting there we're getting there
only 64x off and actually the way that
we made it faster was actually just to
make the pie torch slower so you know if
if you can't succeed you don't have to
be the fastest guy running from the bear
you just have to you know like invite
your slow guy you know you know what I'm
saying man you just if you it doesn't
matter if the bear gets caught in the
bear trap if another person gets caught
the bear trap that's cool too man bear
traps work both ways that's right
uh just copy and paste it into Google
Sheets
uh okay
AST print ready
we've worked really hard on all these
great debugging tools so we can make it
fast
AST print equals that
did you print the AST or it's print
underscore AST oh I gotta love how I
don't remember
my own
I forgot module what's module
there we go I printed the AST
okay this is the code being generated uh
and we can just go here and take a look
at this
uh external test GPU AST
uh test cfar.com
foreign
T Dot
test cfarcom
it works that's good
cool
oh I forgot compile and test AST so it
actually just did nothing
okay well it's unable to allocate a 144
gigabyte array
that's a shame
I'll just need our testicles
it's fine
all right we are getting
18 we are getting
1.8 teraflops
okay this needs to go up to at least
uh where am I
let's just do this math again quickly
sorry I forgot
24 T flops okay we need to get this to
24. okay so that that's only 12x off
that's not too bad
that's only 12x
[Music]
let's throw the chaopt on there
should optimize right
get it optimize
oh maybe that doesn't optimize
we should add K up here
hmm
all right this should actually go in the
optimizer let's move that there
foreign
foreign
foreign
it does actually apply it
all right now all we can say
and this all needs to be refactored I
can't just keep spamming OS get end
everywhere that just needs to be a
helper I that needs to be refactored
man
someone someone want to refactor that
you want to Output a 4x4 Matrix we can
do that
we can do that if you think that'll make
it faster
foreign
there we go that's outputting a 4x4
Matrix or something
oh good it's twice as fast look at that
now it's not putting actually a four by
four matrix it's batching them by eight
but if you want to allow multiple
interventions we can do that
um
foreign
foreign
it's searching for better optimizations
okay it did eight by eight oh look at
how many G flops it's getting hell yeah
that's pretty good
okay
15 teraflops
that's a good number of Taff flops boys
should we allow more optimizations
and a lot of swaps
might even get faster
obviously sometimes it hits a bad one
and search is so slow
um that's only upcasting to eight we can
allow up cast to 16. all right good but
look by doing by doing it eight by eight
is there a way to look at the PTX output
we could
wait 16g flops
why didn't that one accept 16g flops
probably because we don't allow enough
oh I can fix this
here's that 0.95 and that will allow the
16g flux I think
now unfortunately the optimizer outputs
wrong code sometime which is a tragedy
well these shouldn't waste time if one
is that slow we shouldn't run it three
times
okay but it keeps finding those same two
up casts
or finds another upcast
makes it even faster
oh we're not testing the aster 20g flops
yo
now this might be wrong
which is also kind of annoying
what's the game of tiny grad
well this is that a why question
what are the goals of trying to grad to
conquer the world okay the same thing we
do every night pinky
it's like still doing up casts
how is that faster
the same thing we do every night pinky
try to think oh Lord
okay it's still spending
that can't be right it's spending three
seconds on this single calm
and that's good no
no that's that's microseconds that's not
okay that's just a bug
those aren't actually those are us those
aren't MS
yeah okay divided by again that's 2s
foreign
on the one kernel
this is insane
it just upcasted everything
now this is probably wrong at this point
you're just getting stupid
foreign
we don't actually want to allow swaps
swaps just make it slow
so you can actually choose any swaps it
just shows up casts
[Music]
um
we have this thing where we print at the
end right
I don't know if we do that search
by the way we can we just love what did
we go from until we went from 38
milliseconds down to five milliseconds
okay this is this is the right order of
magnitude
this is this is good to know
um and then we can make it even faster
if I get rid of this to that but then I
think the answers might just be wrong
[Music]
it does find a few more you see the
interventions here these are the upcasts
oh it's really slow we have to wait for
the bad interventions it's bad it should
just bail quickly
I think these are just wrong too I'm
sure they're wrong
yeah we need to work on we need to work
on making sure that the optimizer can't
be wrong
but it seems plausible at least it's
doing the right amount of arithmetic
it's possible that the uh
foreign
look at these kernels
this is the winning kernel that gets
lots of G flops
I mean you see why it's good right
these are reading the weights I bet this
one's actually correct
unfortunately we can't check because it
allocates way too much RAM
um
I mean yeah we can replace all that with
a PTX instruction but do you really want
to do that that's boring
all right so then those are all the
stores
this is probably slow as well
ew like that's terrible
oh no what's 512 so it probably just
shifts
you want to see oh you want to print the
PTX oh uh yeah we should be able to be
able to do that okay let's try to do
that
let's try to do that
um
foreign
it's a non-hot cash but still 13
. that's a fuck ton of teraflops
let's go that's that's a that's a all
right no no no that's a respectable
amount of tarot flops I mean it's a lot
more teraflops than we had
uh so you see what it's doing it's not
doing anything very sophisticated and I
actually think this code is correct so
yeah it's it's just it's vectorizing
basically
and what it's doing is it's reduced it's
increasing the arithmetic intensity so
now it's doing it's doing it's really
eight by eight so it's doing eight
weight reads and it's doing eight uh
real reads and there's probably some
ways to make this a whole lot better
without these this stupid validity check
every time
that's just unnecessary
uh
oh no those are the end validity checks
okay oh this is this is the these are
the why validity checks and it has to do
X validity checks here wow the symbolic
code's pretty good that bug you found in
symbolic Jackies is kind of we can talk
about that what should mod of what
should 20 what should minus one mod 10
be right
does anyone know
what python is going to give me here for
-1 Montana
does it do 4x4 Mount mall already well
it found that 8 is faster than four but
actually there's a chance to 4 is faster
we can let me turn off the cache and
disable the use of eight
we'll see if it finds
full I mean the search is greedy so it's
possible that four is generally winning
uh that's pretty much crap hang on
that just finds more fours now
I actually think at that point it's no
longer correct
don't trust us
you want to see a we're going to print
the PTX we'll get there I don't exactly
know how to do that
let me just get it back again let's turn
the K cash on
what
that's what python returns for that
I thought python was going to give me
minus one
there's definitely an argument that it's
minus one
did older python give minus one
it's c that gives minus one okay
yeah there's an argument for both
foreign
yeah I know I know about the integer
division so this is what's confusing and
symbolic there's like a right way to do
it I don't think any of the symbolic
code is wrong but that's why you're
struggling with your test
one
foreign
[Music]
why do you expect red men to be one
no no
never be bigger than
Min and Max of the Boolean bar
but I appreciate writing tests for
symbolic uh tests for symbolic are great
um
okay we want to see the PTX be printed
we'll put it in his debug five
by eight
ah
there's like a way to get the binary
ouch
do this in need
this might not be the PTX this might be
the SAS
definitely do this
um
unfortunately we can't use the optimizer
with Cuda
foreign
[Music]
frog is saved in CL cash I can get
clprog
uh oh has no attribute CL program oh
there you go
um
uh hang on I have code for that in
oh I didn't merge it
is that actually a string or is that a
that's like evalot
no that's good okay there's a code
so it loads them
does a whole bunch of FMA rn32s
which you think maybe they should be uh
no but none of them are like you think
they should be float fours but none of
them actually are float for us
FMA looks boring
I mean there's your kernel
foreign
foreign
[Music]
will be done
it doesn't converted to tensor core
instructions yeah
I mean it can't convert it to tensor
core instructions because it's float 32.
there's float four yeah let's let's read
PTX and say
what is this RN
uh
I think these things are the tensor core
operations I think
I love the picture this picture there we
go
oh it's doing a multiplying Ruby so
that's a lot more okay we can't actually
use a tensor core the way that we're
using it
[Music]
will eventually improve itself that's
true
someday that's the dream
you can actually load zeros in all of
those it was brutal
is there FMA
float for instruction
okay this even be float floor
we float for
none of this is low for
all right because none of these have
tried one
where is this dried one
just tried one is at the end
so idx6 is stride one
it's not worth up casting I know float4
is a data type an opencl I'm aware of
that but I'm saying like
what could we make float for and make
better
the answer is kind of nothing it's not
like we can coalesce any of these loads
and stores
I don't actually think it can be the uh
I understand I have other stuff that
generates float Force
um
my point is I don't actually think
that's going to make anything better
like we're up casting okay so the
optimizer is figuring out to upcast
well I do want to include the
intervention oh hang on
let me go here into kernel search
I want to bring back
debug
foreign
uh what did I just change
typing any imported but not used yes I
know
foreign
we have new pull requests
we can see them right here in the
convenience CI Discord Channel
oh the symbolic test for correctness yay
and take a look let's see
uh no okay so why did you remove this
in general don't remove tests just add
tests
oh yeah don't don't remove this stuff
I would
yeah that's cool yeah don't remove the
string stuff but you can add in the Min
and Maxes I will those are those are
fine
foreign
the string tests aren't great but you
didn't replace the string test by just
checking them in a Max
uh sorry I'm distracted again what what
why is my target SM
is right
fine
I just wish there was like a thing I
could enable it was like Fast Cuda
and it just makes everything fast
execution my essay okay
I mean we're getting like
thirty percent of the max flops of the
chip with this
so really we just need to think the bugs
in the optimizer allow it to run for two
instead of just one
well let's just do that now
um
let me remove the cache
what I call it cash chaos
now we're going to run the example
but we're gonna edit this
to allow two Ops
let me get rid of the debug for now
3x
is the new Triton back end we haven't
used the new Triton back end yet I mean
that might be the answer too we might
just want to start using Triton
let's see how this does
where is this code by the way
what's in kernel search
oh okay so that's like you see this is
actually a two things speed up
first it got a 2X and then it got an 18x
by adding in the second upcast oh that's
sick
18x yeah that's a good order of
magnitude
yeah yeah so there's getting like 5x
that's pretty good these little kernels
don't have anything to make them faster
because they're already so little
now I think there's some bugs
unfortunately so this might not no
longer have correct Behavior
but I don't think they're like bugs that
are really breaking uh
you know what's possible Right the great
thing about multipliers is they multiply
so that's getting us a that times that
now it's better to work on layer merging
I think the real thing to do now but it
might be nap time first is to work on
the correctness of the optimizer
like it requires two upcasts in order to
to make these things uh good
foreign
like let's hope this one finds another
one that's fire next right like that one
went from
344 milliseconds
down to 221 milliseconds that I think
it's going to find like another
intervention
yeah okay good look I found another 2x I
mean it's not as great as I would have
liked but it's pretty good
we optimize and fix the optimizer first
then we optimize again
yeah it has to do with like
these organizations might all be okay
there's only some of them that are
broken
by the way I'm actually just gonna put
chaot here
and break the test today
is Colonel searched on another libraries
yeah the library's sort of do kernel
search title guide in theory should have
a lot more flexibility with the kernel
search than other libraries
and once people like smarter heuristics
in this shouldn't be so slow anymore
like we should know if an intervention
is going to be brutally slow and just
not search that one
I'd love to do this all with like models
but I don't think we're there yet okay
we're almost backwards through the
kernel
we're on what we've almost gone
backwards through it so now you can see
we're back at the reduce
so this is a reduce going from this this
to this size so these are like the
things that determine the weights
these are the backwards passes on batch
Norm
okay
500 milliseconds
two teraflops
that's a lot better
we're getting two whole teraflops boys
two
that's don't worry that this is slower
because it's because I said debug equal
to tell
two whole teraflops that's right
um
we're gonna try to find another one
that's really slow and like see what's
going on
we just need to figure out why the
optimizer has bugs that's the real thing
to do
there's a chance that even when you fix
it
it'll get faster
uh okay so we they are getting 24
teraflops we are getting two teraflops
okay we're only about 10x off that's
pretty good
the big wins are here
um
these kernels just don't need to exist
but they don't really use any time so
they don't really matter
the reduces oh yeah those can definitely
be made faster if those weren't 16s from
60 Forks off to 12x off right 10x is
much better all right look at all the
progress from anything okay this one
could be faster like why is that only
four gigaflops that should be more
gigaflops than that
so those olafoa kernels
and then here we're at the loss this is
the end now we get to the backward
kernels
those are pretty good those Mac and
kernel pretty fast now
those are the backwards weights so these
are the backwards kernels for the images
and these are the backwards kernels for
the weights
and I think there are actually fused
these are the backwards for the batch
Norms but I think these are actually
fused with uh
yeah okay this one is brutally slow
[Music]
foreign
foreign
this getting faster
it's not a 4080 TI it's only a 3080 TI
it's not that good
I need more subscribers if you want me
to afford a 4080 TI
yeah pytorch has a hand rolled
optimization
uh
okay all right I found another one to
make it slightly faster
because I allowed more than two Ops
foreign
yeah we just need to improve the
optimizer but we're we're we're getting
there if you can convince me why you
need subs I give 25 I'm not a whore bro
you don't have to subscribe you just
make me sad
all right we got three teraflops that's
better than one point
four teraflops
uh
all right
we did okay
I think that what we'll do is we'll end
off this stream
with
uh
I can't go eat another burrito because
then I was just tired for the rest of
the day
okay we gotta go get other food
I think we'll end off this stream by
playing in a place where we actually
maybe can be competitive
and that's of course on the M1
so it's unfair to compare ourselves to
this crazy optimized Nvidia code because
we aren't going to plan it we aren't
planning to beat Nvidia and I'll show
you guys just to know just so you know
that I'm not making things up we can go
over here to tinygrad.org
and you see that
we want so the goal is to be 2x faster
than Pi torch but the goal of that is Q2
next year and notice how it's still q1
so think about it if we went from 64x to
12x today that means we're getting a 6X
speed up every day and that means by
Wednesday we'll be a lot faster than
pytorch what do you guys think
next year is now the current area yes
um so that's that's our that's that's
yeah right if we just get 6X every day
we just gotta get our 6X tomorrow all
right so we'll stream again tomorrow and
get another six accent sounds good
um
but it's actually not as important to
get Nvidia to be fast it's more
important to get
four GPU
uh I just updated the board we want to
be the fastest training on the M1
Nvidia is a very far away Target but
pytorch MPS is so broken
yeah we're hyping our should we spack yo
guys should we spack the tiny Corp
um let me just show you something
before you're like tiny grad is stupid
okay so this is uh test Ops right
um test Ops Compares uh torch operations
to uh
operations right so we can also say
torch equals one which will actually use
torch it's basically just comparing
torture torch now we can say MPS equals
one and this is going to use torch's MPS
back end Watch What Happens
not only are there bugs in torches MPS
back end right and this isn't any code
that I wrote this is entirely just torch
not only are bugs in torch's MPS back
end
you'll see here
that it just crashes
which I'm one
this one
so remember that we don't have to
compete with Nvidia we have to compete
with pi torch MPS which crashes
uh okay this is without any
optimizations let's see how we do
I think we can be crashing right in fact
we already have beat crashing don't
worry about that you can just say GPU
equals one and it works
why does that take so long to download
poor CS Dr Ronald right now at the
University of Thunder bandwidth
all right let's go come on now this is
being slow and bored let's go
I regret killing that
foreign
yeah I have C4 on this computer but not
this computer
you see you can tell there's a different
computer because the text is tinier but
now it's the same size and you can't
tell anymore
um can we get a progress bar for
fetching yo if someone wants to merge
that here's the code for fetch I'll show
you where it is
um
it's in extra utils here this is fetch
so uh we're using requests.get is there
just a enable for a progress bar
um no there's not python requests get
progress bar
all right you can write this but it has
to be a small amount of code
that looks like a lot of code
do we already depend on tqdm I think we
do
okay you can use tqdm you can write your
okay fine you can improve this to to to
Output a progress bar I will merge that
pull request fetch definitely needs a
progress bar
uh a two million line microservice for a
progress bar that's right oh I finished
okay
so on the M1 we get
231 G flops
um let's throw some chaopt on there and
see if we can beat that
and give it two chaos
and in search
foreign
it finds all the same basic
interventions
if tiny drag can beat other libraries on
the
I don't actually think hand rolled
complete network implementations will
always be the fastest okay I agree yes
if you're doing the complete network but
a lot of that should be able to be fixed
by putting in just the right shapes so
tiny grad is now beating everything on
the 845
but I did have to write a whole bunch of
hacks to do it so you can see them here
I mean they're not really hacks but I
had to make the shapes correct so if you
read this code here
these are my shapes for uh
for the 845
and I also had to make image textures
work
but with both those I got the fastest
possible thing on the 845 now yeah you
would still beat it if yes if you're
implementing a whole network by hand
sure but actually that's not even 100
True right like modern optimizing
compilers have gotten so good that they
can beat not obviously they can't beat
the best assembly programmer in the
world but they can beat most assembly
programmers so I do think it's possible
to get to a point where a library can
beat most
[Music]
um
you know most people
we should like maybe talk about how far
along we are and then this needs to I
should add one more
if someone wants to do a quick pull
request if someone wants to just get
something merged into tiny grad just
literally add one to the float so that
it won't justify like this literally
just add one to both sides of that
like it's like a 7.2 make it an 8.0
so how many G flops does it get with
chaos well it's running chaos right now
chaot is unfortunately insanely slow
um but chaos can get smarter and we can
we can figure out how to do this better
um I'm writing time you're out of my own
no I'm not writing 10 you're out of my
own you can be a contributor to Tiny
grad we have a lot of great tiny grad
contributors
um and you can be one
but tenure is also very tiny uh it's not
a thousand lines anymore a thousand
lines was was just a tagline for hype uh
tiny grad has gotten a little bit fat
now tiny grad is now
1780 lines
but that now includes all the stuff for
the A45 so China grid is actually being
used in open pilot uh it's like I said
it's the fastest inference on the A45 a
lot of the training stuff still needs to
be optimized uh the higher layers are
pretty good the low layers aren't that
good we should probably really in order
to be competitive on Nvidia and the only
way we're really going to be able to get
close I think is using the Triton back
end there the problem with the Triton
back end is any improvements we make to
the Triton back end are not going to
translate to the M1 because tracking is
not going to work in the M1
um whoa look at that 13x bro 13x and
that was a slow ass kernel
a kernel is taking almost a second
uh it doesn't remember it does cash all
these even after on the optimizer ones
they'll probably be good ways like to
just abstract some patterns quickly you
can see that the interventions it
chooses are almost always the same
oh my mouse is slow
my mouse is slow right now
um
so yeah there's no speculative execution
really on gpus and we don't need
speculative execution the beauty of
neural networks is they run the exact
same data paths every time
but huh I don't understand I don't
understand this one
that just seems broken
yeah stream's lagging because I'm
running on this computer
oh these are the worst these are the
worst kernels
are there any more of them
it'll also be faster when we reduce the
number of kernels
lag grad yeah I know I'm slow let's go
I don't even want to know what it's
doing now
how do we compare speed with pi Georgia
Pi torch back end crashes well it
doesn't crash with Cuda
yeah the cards have some out of order
exactly my point is like
there's no branching in neural networks
so you don't need any speculative
execution
oh come on let's go
oh there's more of these stupid kernels
oh there's another one after this
because okay this is the
yeah there's no code on in one
yeah but we're not gonna beat Cuda you
can't beat Cuda the amount of man years
that have been poured into Cuda we can
be on the M1
I want to make tiny grad actually a very
usable in q1 our goal is to make tiny
grad a usable library for training on
the M1
compare this with your back end yeah you
want to comparison view back end I'll
show you how to compare it
um I have some tests to compare
all right you're gonna compare the CPU
backend
GPU equals one this is on my other
computer uh test speed versus torch
pretty good right
so the only ones where it's slower
is here
and doing a one by one ad
so that's that's our comparison to uh
to the CPO very fast
now of course if we compare it to Cuda I
have some bad news
I don't know uh
that sorry that's actually using the
Cuda back end instead of the GPU backend
if we compare it to torch Cuda
uh we're in for a bad time yeah
yeah so you know
uh yeah torch coot is pretty good
well yeah but again the problem with
Triton is we can't use Triton on the M1
oh here we go we're on the M1 now oh it
got 2x faster after all that work
and it gets nands for the loss
does it even get any faster
what was it before this what was it with
chaot equals zero
okay it got about twice as fast and way
less consistent
foreign
metal yeah yeah that is torch metal
torch metal crashes oh you want to
compare the speed we can compare the
speed that works
um
so if we do test speed versus torch
uh this is comparing CPU to CPU you want
to compare it to
so this is comparing GPU to CPU you'll
notice that torch is actually insanely
fast here
um because it's using the AMX
uh I mean compared to the MPS
it's slower
like but some of it's a little bit
unfair because just launching a single
kernel
is is uh is faster
so like these ones are actually the same
speed
like there's no way to write these
kernels faster really
this is all just launch overhead
you finish adding tqdm but you can't
remember pull requests due to being at
work uh yeah if someone wants to add
that I will merge that
you're all developing tiny grad together
we are all part of the time
oh yeah so I mean that's just that's
just brutal
all right I think we go eat lunch
and then we not on stream fix the bugs
in the optimizer
how do you guys will stay tiny
is this a stupid project today is
discouraging why was last last week
wasn't discouraging why was my why was
Wednesday not discouraging
uh uh can we raid someone no I can't
read someone today I don't feel like
grading anybody
uh
we have a lot of viewers how we doing
viewers
unless unless Sky Breeze streaming of
Sky Breeze streaming we can write skybry
uh 826 viewers
no the real tiny guy better not be the
friends we made along the way
uh
it's fully faster than tensorflow no I
mean
it starts up faster than tensorflow I'll
say that
uh
by the way look at some of these insane
uh gigabyte per second numbers
like that's getting these are getting
close to the theoretical maximum of the
GPO
912.4 is the theoretical Ram bandwidth
limit and like we're getting close to
that with some of these
where's the fastest one
see like like look at like relieu look
at uh
we can look at the PTX outputs and
compare
yeah we can I mean we might get there
right that might be okay all right you
want to really make it fast I think we
can do that
we have to make the optimizer so
that I mean that might be the idea the
idea might be to to to hand to do what I
did basically for snpe on Qualcomm and
so on Qualcomm I just went through each
kernel manually saw what their thing was
doing and wrote something better uh so I
mean we can do the same thing for torch
we can get their kernels I think their
kernels hopefully can
we can figure out how to make their
chronic use the same data format that my
kernels use
um and then it's just a question of
making the code good
foreign
to some super optimized for that one
implementation yes I'm aware but if we
can beat that we can beat everything you
know what I'm saying
like yeah of course it's not so if
chaopt equals two actually works
I do think that that will be as fast as
most uh
as fast as most uh
like normal implementations
because this this this implementation is
about 10x faster than what you usually
say
maybe maybe we need another 2x still
maybe this one is 5X too slow they're
getting 20 millisecond step times
you're probably more likely to see step
times like 100 without the optimized
stuff
we all need to optimize tiny grad just
teach it to optimize itself yeah I know
that's the goal
no we don't need tensor cores we do not
need tensor cores uh I turn tensor cross
off
for for the one for this one here
uh
uh for this I turned tensor crows off
if yeah if you put in that that special
tf-32 override disable thing
if I run with that
there's no there's no tense of course
you can see it what do you mean there's
nothing there
oh I guess over here he's talking but
this is intense of course
foreign
milliseconds to 50 milliseconds we were
actually just a straight up 10x off
so this is taking 50 milliseconds to
step and this is taking 500.
assuming the optimizer is actually
correct
spending a lot of time in Python
spending a lot of time in Python
put the cash back on
see how it does with the jet
oh oh that got us some more speed too
about super fast
okay
so
that's taking
let's do it exactly
4.714
divided by 97 because doing 97 steps
see our step time is 48 milliseconds
foreign
times off
you're welcome thank you
uh
yeah we turned the jit on it it's it's
it's uh it's faster because we're not
spending all the time in Python
oh you're also shot from the tiny card
on the tiny grab Wiki excited
you're down from 50. we're off by nine
oh pretty nice
we have the tiny right Discord now
I'm adding tqdm should work I'm always
worried when it should work
foreign
you can't do that
because someone tell can someone explain
could someone can someone comment on
that GitHub I'm not logged in to explain
why you can't do that
the layer bugs are not that big of a
deal
the kernels are just slow
um
don't do that that's all then squared
I do like how short that is though
that's nice
uh
no don't remove the string tests
no string test good
um
someone please comment on this and
complain yeah 10 squared that's right
that's right
sometimes I just like running it and
watching it run oh
yo we're only 9x off guys that's pretty
good
wait
okay there's just a bug that's the wrong
G flops
[Music]
that's wrong g-flops
okay it's still counting the G flops
here I say
all right that's double G flops that's a
bug
I don't know someone could fix that it's
stupid
yeah we'll just hack it for now
foreign
all right
2.6 teraflops
does python have string Builder
uh no
no you do a join yeah
uh you just replaced this with replace
dat with an array uh you want to append
the chunks to to an array and then you
want to do join
it's my address you're buying my lunch
um
no M2 is not that good
it's the M1 basically
oh if someone wants to add whitening and
can write like a really small
implementation of whitening I would
merge that pull request
because that's the only thing that we
didn't do oh we should put SC on
because it really we have to compare it
fairly
how many new oh my God how many new
kernels is this gonna add
nice rice water
uh
okay that's not too much slower that's
fine
so the only thing we didn't add is
whitening so good this is actually a
fair comparison
um
oh yeah it doesn't print them anymore
because it's using the uh
yeah this is the only one that's right
it doesn't print them anymore since it
uses the jet
I should have I should make enabled jet
I shouldn't just do that by default I
want to
see how cash
someone needs to clean up all the stupid
environment variables and replace it
with all these OS get-ins should be
replaced with a helper function
like this is a common pattern everywhere
in this code
can someone file an issue for that
no one no you're making you're making me
log into GitHub
so there's without CL cash
should actually prints the things
and then this is with cl cash
uh we're not missing an optimization
abstraction between the LL Ops and the
operators
uh no that exists that's all the AST
stuff is all that
added pull requests for fetch progress
but let's see this one
ew
so much lines
bar dot update size oh this is smart
though
can you just do that
oh see like the combination of the two
of you will make something good
if you don't have to track that and you
can just return
and you can just say Dad equals r dot
content down here oh that'd be the best
yeah you see what I'm saying between the
two of you there's something good you
just need to work together
oh yeah we need to okay yeah we need to
file an issue about all those in
os.getms okay here's something if you
want to contribute to Tiny grab I really
want you to think about writing the
highest quality code you've ever written
in your life all right like I just want
so high quality so no one will be like
this is Twitter
um
between the two of you there could be
something good
are the AST handling is sort of repeated
in each accelerator not really
so we have a class here in AST sorry no
it's in Ops which gives you AST exec
functions
but I agree with you that some stuff is
repeated and that's why we have this AST
class out here
so this is an AST class that's outside
and there actually isn't much repeated
anymore
um I would take an intern at the tiny
Corp we don't have any money though
uh
uh so if you're actually serious about
wanting to be a tiny Corps of intern you
can be a tiny Corp intern but it's not a
paid internship because like I said we
don't have any money
um
though I might be able to get you an
office and food
if you're serious and you're very good
um
no if someone's serious
about wanting to be a tiny Corp intern
I can get you I can probably get you
housing too I can get you housing and
food uh thanks to thanks to comma AI
um comma can probably provide that in
exchange for 20 time of the tiny Corp
has to be doing comma AI improvements
uh I get your computer to work on and
get everything but a salary
uh because like I said the tiny Corp
doesn't make money
um which is a problem
office and food for someone very good
for the tiny Corps
um the tiny Corp also is looking into
making money and if we do make money I
can give you some percent of that money
uh we're looking into selling merch Alex
and I have been talking about selling uh
overpriced t-shirts
uh overpriced tiny Corp t-shirts
uh but yeah no I will get you I will get
you housing and food uh through comma
and we'll have an office to go to I'll
get you a desk I'll get your computer
I do I actually rent that office space
I'm thinking about it should I rent the
office no we can't read the office
because you're only getting money guys
the Johnny car t-shirts oh yeah
uh
tiny shirts
the shirt shouldn't be a third person
combining the two pull requests
um
we sell our share a ticket at the office
if that sounds right
no but yes if you want to intern at the
tiny Corp uh you can apply to to uh
I think it just says do you have Gmail
and just you had a Gmail
um and we can uh we'll hook you up with
some food and shelter
uh
uh guys I'll give you I'll give you a
hundred percent of the tiny corpse
current Revenue
um no econo's not actually paying the
tiny Corp we do that for free
commas like our our clients that we work
for for free uh in exchange for you know
being the tiny Corp having real users
uh it's a partnership okay it's a
partnership
zero billion dollars I know
um no we have a lot of stuff to support
but mostly what we have to do in tiny
grad is refactors there's a lot of good
refactors to do and you've got to reduce
lines and you can't reduce lines with
code golf we have to reduce Lines by
doing proper refactors of things
um yeah I work for free for experience
like it's not like this but it's just no
money in tiny Corp right now but no
here's my pitch here's my pitch if you
want to actually be if you want to be an
intern you want to be employee number
one a tiny Club well we're hiring you
can come work Italian corner
um if you want to be an employee you
never want a tiny car basically it
doesn't have Equity it doesn't have
anything
but what it does have is this and here's
my here's my real plan for making
millions of dollars
there's a lot of companies out there
with failing AI accelerators right and
the reason they're failing is because
they don't have enough manpower to
optimize the shit out of it like Cuda
but you'll be able to use tiny grad and
your experience with tiny grab will
translate to making accelerators fast
um yeah you can I mean yeah no if you
want a more serious internship I will
give you you can just join the Discord
and if you make a lot of good
contributions I will make you a tiny
Grand intern on the Discord and you can
pick your color what color do you want
to be
I remind you that there's a very high
quality Discord uh and if anyone posts
dumb shit you'll be banned instantly
um my millionaire or not
I don't know guys I don't know doesn't
matter
the tiny Corp has no money
you're asking me to fund the tiny Corp
s yeah that's not really how the tiny
book works
you want to be a remote employee for the
tiny Park
gonna be a remote employee for the tiny
Corp again there's no salary
um
and there's no equity wow the tiny Corps
is a scam geother trying to scam people
hiring for pro salary and no equity I'm
gonna go post about this on our
anti-work
um
the rules the rules was less expensive
than you guys think
uh does tiny Corps Support h1bv so now
that costs money we don't have any money
guys
the llvm stuff definitely needs a
refactor and the only other stuff is
decent but there's a lot of junk in the
lvm stuff like this stuff is all junk
this needs to be replaced with symbolic
um this engine stuff should be moved
into runtime so this should be a runtime
for lvm.pi if you make the lvm stuff
really good I'll let it not be a Sim
link
right oh yeah no one's finished this
pull request could be cleaned up by
someone and finished and made good uh
replace sign with gt0 I'll do just like
one little bug to fix
um
already posted on our anti-work
uh is this another Cheap Eats scan uh
guys you don't understand I literally
lost thousands of dollars on TV
I'm the worst camera
I'm the worst scammer
um
should we should we make a token do we
need to make a token is that is that how
we can fund the tiny Corps no but the
tiny Corp has no money
uh no no we're in San Diego
um what skills must the intern have
how long I think that's just a scam for
everybody like I'm scamming myself guys
uh
you think it'll be fast
someday
a wrong push
you got wronged you know you don't
understand there used to not be a rug
and now there's a rug underneath you
that's right it's a rug push
um
okay governance should we launch a
governance no wait no no no no no no no
I've actually already answered down here
in the FAQ when are you launching your
governance token will there be an
airdrop and the only answer we got was
bra so no I don't think that's gonna
happen
um if you need clothes I might be able
to hook you up with clothes look
anything we have at the tiny Corp you
can have the tiny corpse the scrappiest
company
um you get to work on AI stuff and uh
yeah
um
oh this is some of the most beautiful
tiny grad code
oh yo if someone wants to just do like
if someone again you want a one-line
pull request a tiny Corp okay so you see
this for padding where we do padding
times four if instance padding is int
uh
uh we probably want to say I think you
can fix this by using make pair oh these
things are literally just make pair
oh look at this garbage
look at that that's just that
just replace that with make pair
oh that's Star Gold what would it take
to get common to switch to Tiny grad for
training
oh you don't see my head is too big oh
sorry
I'm a terrible streamer
uh no but really the tiny Corp is funded
with uh with twitch subscribers
um how does tiny grad determine which
parts of the network it will split into
separate kernels uh so that's in lazy
dot pie
uh so it's all done kind of at runtime
uh it can do a bunch of things
processing up this is so big oh this is
terrible
this is terrible
but uh this is how it's determined here
I'm going to sell it to photographers
well the tiny Court needs to make money
and Tiny grab needs to be good
thank you thank you for subscribing
uh no it's too tiny to have any Equity
to sell so we can't have any investors
because it's too tiny to have any we're
looking for contracts and sponsorships
yeah I remember that was the business
model that
we need a contract that's what we need
that's another reason to contact the
tiny Corp if you want a net to be very
fast and the way contracts work with the
tiny Corps is if we fail you pass
nothing we're very easy to work with
like that we're not going to try to you
set us a goal as long as it's a fair
goal and a fair price if we don't
achieve it uh you pay us not
um
if you refactor this code you can't push
it what do you mean just do a pull
request
one twitch several month a Tony gray
Tony Court can that that can almost
afford my lunch
um where are we going for lunch today
sushi place open for lunch
the sushi place
it's not even open on Mondays
let's go to home in a way
I want bar food where are we going for
lunch
this place is just look all good good
I'm glad their reviews are going down
this is a much better Italian place
um this place the food's terrible they
just like look good on Instagram
I was upset
um
should we go to rock and Baja Lobster
Connor's Cafe I went there yesterday I
got a rate but it was 17 okay like guys
I'm really on poor now it's not even
like a joke
oh we will go here and I've been here
before
it's in America right
cannoli
it looks pretty good
they make pasta too oh it looks fire bro
I think that's what we're having let's
go there
um do I eat out every meal no awesome
time I cook
but I think we're gonna eat lunch take a
siesta and then fix the uh
fix the uh Optimizer they're not the
bugs
oh we got a level three hype train going
all right I appreciate the hype train
guys thank you for subscribing this is
the only money the tiny Court makes
um I did watch the lavender Hayes music
video it's nice I love Taylor Swift uh
do oh now we have three pull requests
for the progress bar
oh big make pair changes oh let's see
yeah but you got to change this one too
see this is what I mean go all the way
with it right fix this one too
this one's going to require a little
more thought
that's basically make pear
maybe that's enough maybe I will merge
that
third version of the same progress
barcode
oh you wouldn't even get the indentation
right
uh two tabs
we
and did you test this code no you didn't
test this code because where does that
come from you didn't test this code bro
this one's probably fine I probably will
merge that I don't know that's actually
not that easy I'm like thinking how to
do that
uh I will merge you if the test pass
I'll have to go enable all the tests
once I log back into GitHub
um
yeah I bet somebody I bet some people
use chat DVD see it's just garbage
uh yeah who's a contributor to Tiny grad
um
and no longer to get up over there okay
well let me enable the tests for make
pair changes
uh so yeah we enabled the tests here
wait I wanted to file some issues what
issue did I want to file uh refactor
[Music]
OS Dot
into helpers
[Music]
uh let's see what what else
yeah so we're running the
by the way if you're not ready for me to
merge a pull request you should Mark it
as a draft pull request
yeah now this one no we need the string
test back
um
the string tests were covering stuff
this is not
yeah the other make pear lines a little
tricky I agree maybe we don't want it
it's this is still an improvement
and we'll see if the test pass
time your grad has a very comprehensive
test Suite you're going to make a PR to
remove all the tests
well that's not a very good PR
oud
um
I can't believe I wrote that garbage
everywhere
we'll call it like get option
yeah that'd be nice get option
how's our Wiki coming look we have a
typo in the wiki someone can fix that
we also have lazy buffers which are like
lazy Ops but they're buffers
no I'm not trying to use art Parts like
I like the environment variables oh and
then it should also take an optional
default
get option should take an optional
default it's like opt is two okay so we
can replace this with something like
opticals get option
two
that'd be so nice and then we can remove
this import OS everywhere oh that'd be
so nice
all right someone can definitely do that
in a pull request check other fetch pull
requests all right let's see
all right all right what do we got here
oh Dad equals rdot content stream equals
true oh this one looks pretty good
um
okay why is this on a separate Lane why
okay do you need this end here
but either way just put that there that
doesn't need to be on two lines
think about it right uh
also you know what else I realized
you don't actually need to write the
file as chunks we're loading the whole
thing into memory anyway
what if you just wrote four chunk and
tqdm pass
you see what I'm saying
let's try it
uh could we write a test for fetch
do I need to fetch again
where's that fetch still
why where is that file
where does fetch save things to how do
you know
we can say no cash equals none
how it fetches all right let's try a
magic one liner
import tqdn
uh
dream equals true
[Music]
I'm gonna use total size here did I
leave my face Peg
it's not that big
foreign
object is not callable up
there we go
except it's slow
oh the content for this response was
already consumed
okay so none of this code actually even
works guys
foreign
nest
print all that crap
does fetch amnest right
how does that off that gymnast
do I have mnist is eminist in the
I included mnist
uh I know what will fetch if I do I'll
pop
[Music]
there we go
okay notice how that kb per second is
wrong there's bugs in this
chunk size one or two four so it's
chunks so the unit is actually
KB
Guys these are all wrong
this is chat TBT shit all right this is
all chunks so chunk size is one or two
four
what's unit scale
oh if one are true
oh I say
any other number will scale with
no there's another way to do this
um
unit divisor
to practice only get food
um
so total isn't wrong the problem is each
one of these is actually incrementing by
so this might be rate
right by
and great it's probably right
it's not right
all right well it turns out none of you
guys had the right answer you also wrote
way too long of code
tqdm requests progress bar
all right let's see if anyone here got
it right
qdm total size and bytes units
IB
is doing progress bar dot update which
is terrible
I mean we could do that but that would
upset me
see how much effort you got to put into
one line
one or true
will scale total and n
is number of finished iterations
oh all right all right all right we got
a good one here
no this is wrong
okay I'll show you why this is wrong
because if I do total
and do one or two four
look it says it's 512k
so okay are you put unit KV oh does that
work
what time does this uh turn into M's
it's too fast
maybe this is right hang on okay okay
okay okay maybe this is right I mean
this this PR still is not right sorry I
confused I confused content with style
because uh you know this is the wrong
tabbing and what kind of imports is that
what what's even why are these here
what is that
but you might have had the right idea
with units
if we put unit equals KV
let's do the hip C4 one
no no look that's kkb per second that's
wrong
foreign
T garbage
I'll be upset if we have to update the
bar
it uses streaming API multiple people
use the streaming API that's not the
problem
I mean okay if you want to cheat this
should work
but of course it's now insanely slow I'm
going to use all the uh
we need something that increments by
that much each time
um
okay I'm upset about this but it's gonna
have to be a few lines
I think we are gonna have to update it
with the current buffer
[Music]
foreign
foreign
there we go
not a Jesus file
there we go
right
now
no no no no no no no no no no no no no
no no no no no
I I just let's let's take a second and
let's compare
I hate your chat gbt garbage
that's a different
why are there all these changes here
rebase
everyone closed their pull requests
everyone closed them
like like
I don't want should work
I want good quality code if you want to
enter on a tiny Corp you got to write
shit that looks like that
all right how clever is that by the way
is there a better way to write that
is there another way to write that as
one liner
can we just talk about how we spent one
line
we spent one line and it's upsetting
that it had to be one line it would be
nicer if it didn't have to be one line
um
it should have been zero lines but
fire
wait also
we don't even need that fetching anymore
that's kind of stupid
yeah that fetching that can just go we
can get rid of that line because we have
a better line now that makes a progress
bar
if you feel like that coach if you added
the stack Overflow post yeah because you
know
ah
bro
goat shit
oh and then also
why is this chunk size so pathetically
small
go faster
for Toronto and really spamming their
server
go progress bar
why couldn't someone write that
what money are right good code
how many FPS is the progress
uh lazy happens all after the gradient
stuff
lazy is all after uh
gradients gradients are all if you're in
ml Ops this is gradients
this is some of the nicest code in tiny
grad
each thing and the derivative of the
thing but somehow gel you makes nouns so
there might be bugs
um oh yes please fix this please can
someone please finish that pull request
and write good stuff
you can add it for other crops not just
CL cash well you do rebase and yes you
have to do it for every prop
no
no
why do you have an end here no
you guys do you want any good
programmers or not
like do you think I just wanna
a replacement of
why would I ever want this
also why is it here and not up here with
the other ones
you guys
do you want to be good programmers or
not
do you want to like mediocre shit for
the rest of your life
oh
no you want good programs you need to
pay good money no that's bullshit I've
seen people who get paid a shit ton of
money and write terrible fucking code
it seems to not really correlate to how
much money you pay people
no really I mean it I mean it yeah you
want to see how do you know how much
Twitter is paying people and how about
dog shit code there was at Twitter
like I just I just want I just want
everybody I just want everybody to take
a minute
please everybody take a minute and read
the goat progress bar
that the kind of pull requests that we
want to see in tiny grad
not not let's add 10 lines of garbage
that doesn't even work
um layer merging is in uh no leveraging
isn't lazy that's in lazy
at least it runs yeah Twitter runs yeah
uh no no stop stop please write good
code if you're gonna submit pull request
tiny grab please write good code
like it's not you don't have to write a
lot of code you just have to think and
like care you know
oh
fucking don't get me started on the
rainbow safety page again
so you didn't want a non-function
non-readable I even showed you guys how
to write it
no I'm not learning skull anymore but
nothing against skull that's fine I
should spend the time on I should spend
the time on Rust instead of Scala
does it have to be all python witty
built-ins what would he build oh did I
use if there otherwise it's a lot more
lines and like that's fine
um there's nothing like particularly
like are there hard things here
yes we still use mini key value yes it's
very good
foreign
all right all right we got our first
pull request that actually gets merged
this one
Kevin Gilpin congratulations your pull
request gets merged the test passed
yes it is two lines but can we notice
how Kevin Gilpin managed to write the
thing and only made one completely
irrelevant useless change which I should
reject the pr for that alone if PR was
just this to that and this to that like
that's nice because it made code simpler
right like it got rid of all these extra
words now I don't know about that but
otherwise it's good
big big
make pair of changes
big make pair changes with no
description you guys do do you want to
be good or do you want to not be good
you guys can ask questions
I can't even give you free Channel Subs
I don't even have that the tiny torque
doesn't have any money
foreign
you think it has to do with how much
money you pay people I've seen software
Engineers getting paid like
400 500 thousands of dollars who work at
some Fang Corporation and then I see the
code they write I'm like oh my God
you know you think your progress Bars
were bad their progress bars would have
been 100 lines
I'm upset that this had to be two lines
it does though
I think
it's probably some really stupid clever
way to put it on one but then that's
just too stupid
would there'd just be like a with side
effects thing or be able to put
semicolons in here
I mean I could I guess I could have put
the if in there too like I could have
put like uh
yeah I just need that as a side effect
it's better ways to do that hang on
like all right so here's another way to
write that that might actually be better
so I can also write it as like
Open Bracket X comma bracket that
foreign
kind of like that better
still constructs a list though is there
something better
what is this
I don't even understand that
um
I mean does this work
if I don't make it a tuple
no that didn't work
that might be the simplest
you can't put the tqdm in the if because
the if is called every time the loop
runs
no it
there's no semicolons in here right
let's look at the python operators and
see what we can find
no look at my upgrade to the progress
bar oh wait why is that a no that
semicolon doesn't work
I mean that is fast it just constructs
so stupid
stupid array
probably do it like this and that might
be faster
now constructing a tuple is probably
faster
[Music]
Juan copper root thank you for gifting
Subs
appreciate you
don't need to write code anymore no it
writes terrible code
all right we're announcing a new policy
on this channel
all future mentions of chat GPT using
chat GPT fucking chat GPT getting a hand
job from chat gbt are banned
ad block term
how do I do that
term that's right that's right you know
all the lotites who are Banning AI art
we're not Banning air we're Banning
talking about air
I would like to point out that the my
new implementation of a progress bar is
one two three four five six characters
shorter and more obviously correct
oh it's gonna
improve progress bar
boom
I don't love this either
wish there was just
is there a function I could call that
just Returns the first element
yeah another stuff's good oh let's read
all the built-in functions one of these
is probably
good
Min and Max are almost what we want
foreign
yeah people do love this we need lunch
though oh we need lunch should we just
order pizza
you don't want to see them work on the
optimizer like that sounds so painful
no we could ride in the optimizer all
right if you guys are liking this we
have a lot of viewers let's order some
food
um or let me just look around quickly
and see if there's any food
we have yogurt that's it
now I I have a lot of viewers we'll keep
going let's order food
I'm glad you're learning bro I'm glad
you're learning
dot index
[Music]
George I think you are psychotic thank
you
all right
should we order meatballs guys
I know this is a triggering I know this
is a triggering uh
how come that pizza looks so good
okay all this Chinese food's terrible
never go to PF Chang's by the way
and we'll get some Thai Thai sounds good
five minutes until closing what
55 Thai Kitchen
picked for me
um
uh Ty God over rice
all right what have I ordered before
from this place order again Drunken
Noodles no that sounds Savage
get some Thai style fried rice
and a Thai iced tea
spicy basil chicken that sounds pretty
healthy
oh it comes with an egg oh that looks
fire guys look at that
it's probably not going to be nearly as
good
got spicy Bagel basil chicken and a Thai
iced tea which is mostly sugar I all
right let's go
order
oh some tom yum soup
oh
you can use map
operator item getter zero
dated to get the first element yeah but
that's not what I want because I still
have to construct the thing
I basically just I'm looking I'm looking
for a built-in function that's just this
right like is there a function
that's just that
so it's my it's my scholar thinking
I'm not paying for priority it's not
going to get here faster and I will tip
but only if you bring it to my door you
know how that works it reads I agree
with your new terms
all right
spicy basil chicken will be here in 20
minutes I am starving though we gotta
find some food for now
what phone is this it's uh OnePlus
it's an apple OnePlus
[Music]
okay
let's find the bugs in the optimizer
we're gonna do it if we don't do it now
then we're never gonna do it and you
know and what what is what there's like
sayings for this
um it's like drunk is better than never
or something what I don't know something
like that
late is better than
I don't know
if it takes one woman to make a baby in
nine months how many babies can five
women make in three months
and the answer is five because they were
babies
you've had to wait 10 minutes to post
this
for x and are either content
or X yeah so
the problem with orx is that's not right
I I agree and I thought about that the
problem is if that other thing's not
true
the or is interesting
the other one will return true
that's
kind of like that okay so use an or
operator
I'll show you why it doesn't work
it's tempting
what does that return
actually that might work
what's 23 or 54.
23.
nah that only works if that's always
false
now but you're assuming what is progress
bar update return
it returns true
but not always
sometime it'll return nothing
though this probably works
do you think that's more readable
it's a little bit longer
actually that's more readable
can I try with just or yeah it won't
work
foreign
I'm gonna leave it the way it was
because I think there actually are
things that can break this
like can I do
oh that returns false
where there's nothing that can break the
other kind
but that's just the same as B sub
you're right though or is almost what I
was looking for
what are the other Boolean operators in
Python
the the problem with or is sometimes
it'll actually return a thing from
progress bar update
you can do n zero or Bool
no I can't
now we got nerd sniped on this hard
no any and all return booleans
this just isn't true w-3 schools up here
lying
right this just isn't true I can use or
I can do 23 or 20 or 24.
but it's not just a Boolean operator
here mixing Boolean expressions and
objects
short-circuit evaluation sure
now I think what the end false is the
best you can do
well that's fire that you can chain like
that
okay are we ready to debug the optimizer
oh we got a tie a seat coming oh that's
gonna be good
because we're out of highball
oh Chick-fil-A
will the food arrived in 20 minutes
it said 20 minutes
wait latest arrival by 405. no I
actually can't do this
I actually can't I can't do this guys
if my food doesn't get here till 405 I'm
starving
I'm going to eat a cracker okay I'll be
back we're taking we're taking a two
minute break three minute break four
minute break and then we're gonna come
and we're gonna fix the optimizer thank
you for the order suggestion it was a
good one I didn't think about it
foreign
foreign
thank you for gifting Subs
write a partial function that updates
the progress bar as a side effect
I think we're done with the bar I don't
think we're going to mess with the bar
anymore
all right well I do have some ideas
all right we're gonna go out the bar for
another minute
oh
okay so you have way too many
parentheses here first of all
there's functions really long you don't
actually have to do this
you can just make a
you're going to write a one line
function there basically
if you want to write the good version of
that
you can write like
uh
I'm fine with what it is I'm I'm it
constructs you right it's not slow it's
not making copies of X it's fine it
creates a new pointer it's fast
I promise it's actually faster than a
function call
yeah or true index works as well
um but
or
actually
I do kind of think that's the nicest
thing to write
well it's slow
foreign
regardless of what object this is
no I like R1
foreign
now I know when it returns true but I'm
not like is this true for any arbitrary
thing I put here
or the things I can put here that will
break it
I mean well
if we're going to start writing things
like that we can even go back to this
is that the best thing all along
and the object needs a linear bull
method no no
stop it that one's fine
ah this is a delicious apple
foreign
foreign
here's part of the problem part of the
problem is that these things don't have
random uh
so we'll have to fix that
let me fix that
um
lazy op has no buffers
what
it does have an attribute buff that's
wrong
well lazy app still
no Source never mind
get it it should be right actually
um
foreign
oh test test AST doesn't take in an AST
it takes in k
that's a scam
okay but these aren't actually correct
is the problem we don't know if they're
correct
uh we don't know if they're correct
because it's full of zeros
so we want to
we want to fill them with random stuff
uh we have helpers in here to get all
the buffers
maybe even lazy
I wanted to realize but first how do I
get the buffers
it's really not Ops yeah get buffers
there we go
uh from
tinygrad.op support
buffers
get proper is AST
or
testing need to fill the
uppers with randomness
and then actually so we can say it could
be in box but we want to find the root
of each buffer
so these buffers have host Buffs
um so
a while
B dot host buff
[Music]
ET should get us the actual host buffers
view object has no attribute host buff
uh what's is it under square host buff
this doesn't actually matter
so for being boss we say B buff uh
dot copy in
and we want to fill it with trash so we
can say B dot base shape
NP dot Rand and B dot a shape
uh
let's read the tensor code for that
I think
does that work
all right we found a bug
nice
that was easy
my food
estimated arrival 350.
oh
foreign
all right
um
I actually don't like the reprint the
shape tracker there that's a lot
you know I contributed to this but um
go here
shape sometimes he has survived I've
used some minus one dot strides
and we can actually we only debug four
okay here's the first one that broke
foreign
thank you for saying I'm good looking I
appreciate you
I'd appreciate you more
you know Instagram needs a way to filter
your DMs by women
it's all well and good
until
we try to upcast
I don't really understand this
what
Why didn't it reduce
why did it become an ew
somehow it became an ew
thank you
all right
we can't up past three four
that's not divisible
not all
has to shape up access or St shape
become visible
it's not divisible I don't get it
otherwise if I get rid of that does it
work better
oh
and I made it further
in fact they understand why but okay
I've broken the same place okay it's not
that
um
oh no no okay this should actually be
okay
because it's
oh wait a second
it's all in the testing the AST okay we
need to we need to fix something
during the test AST we have to set debug
equal to zero
I don't know if this works but I hope it
does
so why don't you just get spam
uh kind of says local variable debug
foreign
to work
no because I think it like when it
Imports it
oh unless do I need Global here
last try at that
no it's still spamming all this crap
this doesn't work
yeah so this is okay this is the uh
let me just let me fix the prints
that'll just make it easier to read
kernel search
[Music]
it's in between testing and applying
here
this is what fails
okay so it's doing an upcast on three
which should be legal
um
wait a second how come there's three
here now and there's only two here
oh because it's not how old works I need
to fix this
um
thank you
oh no but old isn't right either
that's actually after the upcast
I think
yeah that's not right
foreign
I have an idea
gonna get rid of debug
okay
so this is what breaks here
somehow
what breaks
does it float for an hour
remember the bugs in float four
let's disable so far
huh okay the bugs in float four
that's cool
um oh then the bug's probably just in
the store oh that's probably simple
I probably just did the store wrong
four no it's a ride
[Music]
V Dot type equals flow four well Vita
types definitely float for
we're dividing by four
um
let's see if that's the one just I'm
just testing
that's the bad one
um
it's also possible remember that the bug
could be in reading the AST
foreign
not because that size would already be
done
um
that works fine
it's the same basic idea
all does the reduce function not work
well this is opencl that doesn't make
sense
do you want it wrong
so this is one kernel
and we should have an identical kernel
no I see the problem
this needed to be flowed for also
oh this is this is some this is some
deep this is some deep bullshit
it's just a level of four Falls
uh oh
but I kind of worry
I kind of worry that that's why it was
fast
let's fix it I mean we'll fix it
eventually
but we have a hack now
and our hack is wonderful
uh let's get rid of that
foreign
cool it works
none type has no attribute copy in
sweet
great it does all sorts of up casts and
it's good
let's try them on the gem
tests pass without Fallout 4.
is that my food
no Jennifer has my order in Mission
Beach
I don't think we found that Apple Man
rip float for no it's still you I mean
some of the stuff still use the flow for
but
uh all right let's um
let's see how much our speed was
actually fake
we should still be able to use the cache
because I think the cash is still good
okay A little bit of our speed was fake
in exchange for correctness
what's wrong with testost
all this problem again
it doesn't work because our batch size
is really big it doesn't fit on CPU
it's not fake
just yeah it's a little bit it's a
little bit slower actually that's
probably just the actual speed
difference in not using float4
um it's almost test AST
see if we get any more bugs
we'll let that ride and I'll show
her what
mine is 999
foreign
it's not a real thing
in search one shouldn't that being a
this one's broken
I don't get it
I can show you guys where the weird
thing is with float4
and then we can see if there's any more
bugs well one way we can tell simply if
there's bugs is we can run it with and
without k-opt and see if we get the same
answer
um lowering the batch size will just
make everything faster
so we'll be able to just test I mean
you'll be able to find the bugs
what there's no guys
the best code is no code okay
then every time you have to write a line
you're making a mistake right
so there's only one good way to write
code and that's not to write code now
unfortunately sometimes what you need to
do takes more than zero lines and then
you might have to write some
no no no no no no no no no no no you see
the problem with your zero line solution
it doesn't work
right writing small code is great but if
it doesn't work it's actually useless
no the best process is no process
absolutely that you know you know you
guys ready on elon's things you know
what they are
all right we're gonna figure out what
that bug is in a minute
I'm gonna let this run
and then we're gonna figure out what our
speed actually is I don't think it's
actually much lower I think we were just
foreign
I want to point something out here look
at how 200 milliseconds is being spent
in Python and zero milliseconds is being
spent in Seattle that means that the CPU
code is running slower than the GPU code
and you need like uh you need a jet
so we're coming up with cl cash equals
one
look at our speed now
oh we're getting a respectable two
teraflops that's pretty good
now
I don't like the way that loss isn't
going down and I feel like if I go like
that the loss is going to go down
oh no that looks equally stupid
am I too high
I was gonna need to recompile if we use
a different learning rate oh that's
crazy
foreign
regardless we should be able to fix test
AST now
see I'll wait for events
this is some scam
oh did we stupidly allocate all the
memory that's possible
oh this might just be because we wasted
all of them this might be not a memory
error
oh we got a mismatch
that sounded smashing so close
uh are we wasting all the memory
I feel like that's what we're doing
invalid command Q
get rid of the count
can I test AST on there I can't even
test AST doesn't even have to do with
the optimizer
yeah look at all that Ram
oh no that's not random never mind I
lied
uh invalid command Q
okay
if you think about that
we can have a conversation about that
that's good
figure out what's wrong with my AST test
using a CPU buffer
device is a CPU the only thing we're
doing is from CPU
I mean this test is wrong anyway I'm not
really happy about this test
because really it should use the shape
tracker and respect it but it doesn't
though invalid command Q is aggressive
it means we compiled something bad
is there a bug into CPU
be empty
self.shape
self.contiguous
hmm
okay well that's a better bug
hmm
[Music]
how does this ever work
this is crazy bag
28 Megs it's fine
just bug here I don't get it
oh
what
oh that's just wrong
foreign
crap
a lot of resources
yeah so it's probably running into a
problem trying to construct this
yeah it's this
failing
yeah okay it's trying to allocate
something that's nine gigabytes
foreign
all right well let's look at the batch
has more
uh if we put it down take eight should
probably be okay
it creates virtual tensors in order to
do the convolutions
but this thing is actually uh
oh I got a phone call
please please oh I think I have to be
okay that might be my fault I think the
code changed
I'll be back
foreign
foreign
your food shows up
no it's my fault there's no door
delivery I'll still leave a tip I I the
I didn't update the code
code changed and I did not take it so
but my food is a little soggy
everything's a little soggy it's rainy
foreign
foreign
meal I know you know what
binary option a mismatch
I don't even know how we got that
hmm
I don't know how we got that
um
you know it probably is my phone's still
wrong
and put that back there
that's what that was right
yeah there is fine
it's actually it'll be faster if I use
two
no but I'm not gonna optimize on that
what do you think of five as a batch
size
are we excited about five
nobody's gonna try to optimize a five
oh faster
um
that's a really small amount
surprised it worked all the way up until
there
I love that I wrote this AST test it's
very powerful
like for each AST it
compares the execution of that AST to
the execution on the CPU
it's not as good as it should be though
only copy the base buffer and retain
the track
choirs CPU shape track
but there's good ways to write that
okay
let's run it with K up two
and then see if we can find any more
bugs
first let's turn it with cap one because
we didn't actually test it up two
we also attach high up to
foreign
foreign
by the way
these things being made fast are
actually copy outs
oh no
that one doesn't even look like it has
and has too it has a has an intervention
this is wrong
let's try
again this is terrible that I'm writing
it like this
all right we found one
[Music]
it doesn't look like it should be wrong
it was probably because it was also
combined with um
this
wait this definitely has a group for
reduce oh it doesn't oh I see
this is what it looks like root for
reduce
foreign
no there's real books here
um
oh I think I know what it is
yeah
hmm okay
that's wrong
it's
what's the right answer here
yeah
okay
this is a real bug do you see it
oh I like this oh I like that we found
some
okay
so the output size yes we need two
outputs in the reducer yes thank you
ACC-1 is just being thrown away here
[Music]
well it's good that forced us to think
about a bunch of things all right I
think we'll fix that bug and I think
that's the Stream
this is a pretty in-depth bug
give averator two VIPs soon yeah I can
see that
um
in order to really get VIP you got to
point out something I missed I think
that was the general rule
enough
relations
welcome to the VIPs the channel
you were probably right I should
probably focus on making my map Mall
fast
foreign
if you want super VIP actually implement
to uh
two things in the reducer two outputs in
the reducer bam
our views have declined
foreign
foreign
so the problem is that we have multiple
accumulators
and if we have multiple accumulators
here
um for a
for ACC in accumulators
for I comma ACC in
numerate
accumulators
um
ACC Gekko type ACC talk
uh oh wow I did this badly
these self buff tokens one top I
self buff tokens one
this is gonna fail to compile
ah well that's a stupid reason for it to
fail to compile
um
yeah here
we have mid
foreign
new accumulators
for ACC and
new accumulators token output
of the eye
uh
for I in
range
accumulators
I hope this stuff's right
back
numerate
output cannot be interpreted as yeah
rangeland
foreign
for some reason why is it wrong
yeah this is like an even stupider one
to be wrong
all right
[Music]
okay because this should not be
oh
oh yeah yeah sorry
um how did ax zero get there that's not
right
yeah okay sorry
read that
there we go
fixed now I'm not sure that's right
it might be times when this breaks I
have this stupid path with upcast from
mid reduce
how do I ask this question without being
offensive it probably just isn't
offensive question
probably shouldn't ask it
oh she had some stupid looking code
right there
wow that's real stupid looking code
whatever now what can we do
okay
um
Let's test AST
test AST will find the bunks
if there are any more I think we
probably got them
that's it well done
all right
I'm a little worried that one's gonna
break the test
open
that one's kind of complex so man y'all
we'll commit it
fix multiple
accumulators
that might have broken the test
oh good
I wasn't triggered too much today
about that was a good solid day's work
oh no learning should work right
I mean that's tiny batch size
oh no that's tubby no no not tubby don't
do it on tubby
we haven't even gotten to chaot equals
two we'll have to try capped equals two
all right does someone want to write an
AST fuzzer yo that'd be fire
right we could just buzz
freaking fuzzy symbolic too
yo it's so fast
gigaflops
I should probably batch size an option
still waiting for my get parameter
I must have deleted the cash
all right does it learn with batch size
oh it's so brutally slow
foreign
that's three seconds
yo in that amount of time the other pie
torch implementation
has already finished
oh why am I large and covering the code
oh sorry we're almost done
almost done with today's stream look at
the loss go down down down down down
down down now let's see if the loss
still goes down when I turn on the chaot
that's that's all I want from today's
stream if we can turn on the optimizer
and watch the loss still go down
we'll see how much progress we actually
made we fixed some big Optimizer bugs
today you know is it possible that the
float no the float floor is a different
bug I don't understand the flow four bug
um
the flow for a bug can be many different
things
uh we're really not getting the benefit
of two chaos
we should test with chaopt two
this was a productive stream yeah
didn't Google release a python fuzzing
engine yeah but fuzzing for what
you want to do sets of Transformations
that are guaranteed to be the same
Skype reasoning
I don't know fixing these bugs kind of
boring
I imagine the most fun thing I mean I
think what we got the most viewers was
when we were writing this
like that is beautiful code
then it all kind of became trash and
fell apart but imagine that was just
fast okay
whoa look at the loss go down with chaot
with chaot
loss goes down
with no chaos
loss goes down but slower
wow the chaos kernels make the loss go
down even more that's just Randomness
don't fall apart
double speed that's pretty good we
haven't even turned on chaopt two Chaos
2 gets us 10x to speed but we don't know
if Chaos 2 is correct okay opt refers to
how much we've opted the case
oh oh no but I know this is going to
find a bug and then I'm gonna be upset
I know this is going to find a bug and
then I'm gonna be upset
yeah I saw Jeff Bezos to follow the eicc
founder
you gotta wonder about these Tech guys I
mean I don't want everybody long but you
know the other ones
yeah I was texting me that last night
whoa look at that look at that look look
right there guys look right there look
what we just caught in the wild
which is called a reduction a 10x
reduction followed by a 3X reduction
look at that reduction look at that
which fixing this bug might have even
made it faster
unfortunately we can't test we should
really
we need to Cache the chaopt level in the
thingy
um
it's too short to be copyrighted
all right what questions we got for
today
long stream
he's looking good for chaop too
it works
okay opt 2 works
okay this is chaop zero
okay I have zero now we're gonna go to
chaot two
if you thought
that chaot one was a lot of chaot
you are not ready for chaopt two
double the chaos
no no stream tomorrow
how much speed up do I think chaop2 will
bring
um
well I think we might hit the python
event I think we might so if it's
running at 850 if we more than four exit
we're hitting python we'll have to get
the cash to work it doesn't actually
train in the cache and we can figure out
why that is and that's a whole nother
thing
um because we're not actually updating
the things we can fix that though
my cache doesn't work right now for
training
because it's like the weight so you see
what's going on right it's not actually
updating them because everything's SSA
but we can fix that
like the jit will have to trace what
things actually get updated and then
blah blah blah blah
um
look at this look look at this one we've
got a 3X speed up and then with chaopt
two we got another 13x speed up for a
total speed up of 39 x
how many lines over a thousand are we
right now oh it's bad it's bad
whoa that's really bad
what even are all those lines what lines
did I add today
it's bad
any progress yeah we found chaopt two
and cap two is not wrong
it might be wrong you can't test it with
the big K opt
medium grad I know I know no it's gotten
so big
1.7 K I don't know what we did today we
wrote a lot of lines
all right well you know join the tiny
grad Discord where everything is on
topic nothing off topic
the source of the memory leak is Kernel
caching
interesting
um
you can join line count and you can
discuss line count it was 1169 now
somehow we've gained another 40 lines
and it was not from my progress bar
which was very small and efficient
whoa
and the loss goes down
wow wow we haven't hit the python light
yet we're almost kind of at the python
limit
it seems like the more we optimize the
more the loss goes down
can't believe I'm gonna sit here with no
chaopt while this thing runs slowly
no it's the same
and
the loss isn't gonna go down because
it's broken but
whoa
for reference with chaos zero even when
we turn on the cash
chaop3 is even better that's true
should we do chaop3
no no no we we can't go we that's too
much kayak for one day we got a 6.5 x
speed up guys
if we too bad we can't stream tomorrow
because if we can stream tomorrow and
get another 6.5 x beat up
then we're almost as fast as pie torch
and then if the day after that we get
another 6.5 x speed up we're like five
times faster than Pi torch
um how does it stack up against pie
torch now well
that's how many gigaflops we get
which actually fixing these bugs did
make it go did make the gigaflops go up
well unless it's better with this batch
size but that doesn't make any sense
bigger batch sizes should have more
gigaflops
you could you guys can at home you can
download this and you can try chaot
equals four there's no limit to the
amount of chaos you can use
um no no no no no no no no no safety
here guys no safety it's gonna go so
fast
um
please link tiny grad Discord oh no we
don't want the noobs joining the tiny
guard Discord if we link the tiny guy
Discord and chat noobs will show up and
if one Noob shows up a tiny grad Discord
we're gonna ban them if 10 noobs show up
we're gonna shut the Discord down
because we can't have nice things we
can't have nice things if Noob show up
you know
wow
look at all that speed up
you can try just try more chaos guys try
chaos at home
um
do you have to implement models yourself
no the back propagation is built into
timing right this includes the backward
pass
like
you understand that 120 milliseconds is
actually a very reasonable step time
most people would be very happy with a
step time like that it just turns out
that we have to get our staff time down
to
50 milliseconds
and also make the
batch size four times larger
from optimized by torch
um
then imagine we Pi torch guys
just imagine we beat pie torch
that would be a great victory
someday
we'll flicks now if you want float4 you
got a right flow Fork
you can you can debug float for I gave
you all the tools you need in this
stream to debug things
um you can debug and fix float4
we'll beat pie torch and we have higher
adoption than that well unfortunately
the benchmarking stuff on the M1 is
annoying Nvidia has much better
benchmarking tools the M1 is like
interleaving stuff and cheating
I have to see if there's an option to
turn that off
um
why is pi torch faster
I don't know man
you couldn't make it faster you saw what
we did look we went from this speed to
this speed
so we just got to keep doing that you
thought what only did automatic
differentiation
tiny grad does automatic differentiation
of course it does automatic
differentiation did you see me right we
wrote a model today did you see me write
any derivatives
I did not
um no but like wait till we write super
chaot where do we write neural network
base chaos when do we turn chaos into a
game
pie torchesbad.com does anyone own it
don't use pytorch.com well does anyone
own these on these things
um
all right guys
thank you all for watching today's
stream we mostly stayed on topic we got
some stuff done
um
uh Hindu thinks we should get rid of
differentiation well that's really easy
to do you can just delete the ml Ops
uh you just delete the analops thing all
right thank you all for watching uh if
you're interested uh the tiny Corp is
offering unpaid internships
um we're also looking for contracts and
sponsorships and other ways to make
money because we are poor right now
uh so yeah we're gonna start selling
some merch uh how much is the most you'd
pay for a t-shirt
WEBVTT
Kind: captions
Language: en
DirectorHomeless: Hey
toolegit2quit_: In a previous stream you said you were rich. Why do you enforce being a subscriber to watch precious streams ?
Rabidwh0re: Looking forward to this stream 👍
nic0latesla: hello geohot
toolegit2quit_: I guess that's a good reason ?
DirectorHomeless: you realise you can just watch them on youtube @toolegit2quit_
toolegit2quit_: Wait really ? @directorhomeless where ?
lancesan1ty: have you tried leela chess already?
any_available_username: catching you live PogChamp
DirectorHomeless: can't paste the link :/ just search geohotz slam though
alluxua: shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1 shamrock1
any_available_username: you really want to master chess huh
thisisweeezy: brooooooooooooo
35209: Neural Net to solve chess? We're going to need another Yerbe Matte.
thisisweeezy: cheer1
35209: lool
thisisweeezy: it's not cheating
any_available_username: if you keep thinking you will reach that point urself, so no its not cheating
DirectorHomeless: Even Newton stood on the shoulders of giants. Look it up.
35209: It's my belief that Neural Nets are not the optimal way to approach the 3600 grandmaster level.
quillford: grandmasters aren’t even close to 3600
quillford: the best human grandmasters are officially rated below 3000. top 10 or so are above 2750
35209: The best Chess engines are an order of magnitude better than any human, Deep blue is 3700 I think. The best human at any point in history was like 2800.
thisisweeezy: nice shirt
quillford: yeah but rating engines doesn’t really work
thisisweeezy: only a grand master?
35209: Hahvahd
thisisweeezy: print
35209: The reason Neural Nets don't work well on Chess is because the game is absolutly chaotic. Completely bankrupt explorations can turn out to be masterstrokes.
niculw: What hardware does eon run? Some of my friends made a CNN accelerator for their bachelor thesis, they could run darknet 4.5 times faster with an FPGA and a pi3 than an i7 4710hq could (according to their paper)
thisisweeezy: what's up with the extra 4..?
thisisweeezy: agree -- no doubt!
upsidedownlemon: apt-get install pip3
DirectorHomeless: sudo python3 east_install pip
35209: Python is kind of a shit language anywho.
thisisweeezy: python is great
thisisweeezy: now we talking
thisisweeezy: music of the day?
thisisweeezy: hahaa
thisisweeezy: it's impossible
any_available_username: lmao
35209: George this is your mother.
35209: STFU
thisisweeezy: "natural talent"
35209: If you want to improve your chess game, one way to do is it to just observe and analyze the games between supercomputers.
thisisweeezy: "A FEN string (e.g., rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1) consists of the position part board_fen(), the turn, the castling part (castling_rights), the en passant square (ep_square), the halfmove_clock and the fullmove_number."
thisisweeezy: haha
thisisweeezy: nice
35209: Clowns I spot um and I can't stop laughing.
DirectorHomeless: Here come the copyright police
35209: Pasty white boys like the black alpha girls.
thisisweeezy: sick mussssic
quillford: https://youtu.be/6ygQMw4rBHg?t=656
KhaosVFX: GEOHOT
thisisweeezy: ha
35209: COPYRIGHT POLICE HANDS UP DON'T SHOOT.
DirectorHomeless: 35 years iirc is the expiry
thisisweeezy: https://gulfnews.com/news/asia/india/12-year-old-indian-one-of-youngest-grandmasters-1.2241333
35209: Google's AlphaZero is the best chess playing neural net in existence. There's an architecture whitepaper I read a year ago.
any_available_username: haHAA
35209: Alphazero dominated Stockfish, which is the next best algorithm.
gigafact: Hello George
thisisweeezy: lol
kuhrect: is he building his own chess AI?
thisisweeezy: 10 seconds
35209: I wrote code for a primitive for-loop chess engine like 15 years ago. For every possible move, look forward and pick the best one.
thisisweeezy: haah
any_available_username: lmao
gigafact: George can you do something for me? Go to https://www.twitch.tv/dashboard and add your stream to Programming game and community.
35209: Q-Learning Hierarchical Hidden Markov Models had good success with chess.
gigafact: Twitch has different categories for streaming and you streams fits perfectly to "Programming"
DirectorHomeless: that fan in the background is annoying
35209: TAKA TAKA TAKA TAKA TAKA
KhaosVFX: The fan was on
DirectorHomeless: it keeps coming on for 3 seconds
35209: A neural network we need to layout feature data and then specify target signal.
kuhrect: how old are you?
35209: The Fan is fine, they're trolling.
thisisweeezy: nice ipad
KhaosVFX: You should stream in 1080p
KhaosVFX: The fan is back on now
DirectorHomeless: THERE THERE THE FAN
thisisweeezy: better
3dvinci: Nice
any_available_username: stream under "Programming" category on twitch, i guess more people will come
gigafact: yes
KhaosVFX: now the fan is off
KhaosVFX: lol
DirectorHomeless: i give up
35209: Do you want neural net to evaluate board position?
any_available_username: im sure you did :)
kuhrect: lol stream pwnabletw :p
35209: I feel like I'm on an interview for a shitty crud app company.
35209: Define what are the feature data and what is the target prediction.
35209: Click here to download 243 petabyte chess.dat
thisisweeezy: MATE
quillford: use an incognito tab
35209: Chess is nothing like driving a car.
thisisweeezy: hah
thisisweeezy: you mean it's more complicated?
35209: Chess is discrete and totally visible. Driving a car is the exact opposite of driving a car in almost everyway.
35209: do I hear a female voice?
gigafact: for how long is the streaming been going on?
kuhrect: !uptime
thisisweeezy: 20 mins
gigafact: cool thanks
35209: more than 45 minutes, he's 10% into writing machine learning for chess.
DirectorHomeless: remind is liar? the bear is sticky with honey...
thisisweeezy: 3%
thisisweeezy: order mcdonalds!
35209: Mickey dee's. Ten piece nuggets.
3dvinci: Ayyy
3dvinci: The Obama of Bugattis
any_available_username: at what bitrate you streaming?
KhaosVFX: 2000 kbps at 720p
gigafact: George add your stream to programming community as well!
gigafact: https://www.twitch.tv/communities/programming
any_available_username: you saw that from "Show video stats" @KhaosVFX ?
thisisweeezy: chicken fried rice no chicken
35209: geohots is an enigma wrapped in a mystery, wrapped in a wheat burrito shell.
DirectorHomeless: can you bump the bitrate a bit? don't mind the 720p but bitrate feels low
thisisweeezy: lol
35209: Needs more Adenosine receptor inhibitors.
thisisweeezy: natural water!
KhaosVFX: this has too much carbon and chemicals LOL
KhaosVFX: ^ from periscope
35209: I tried one because of you, it has some snappiness to it.
gigafact: is your apple product too slow to stream on higher quality? so much for quality apple products haha
35209: Geohots is poor, can't afford a fast internet connect. Subscribe and donate.
thisisweeezy: lol
thisisweeezy: if not, lower it
quillford: cheer1
gigafact: someone subscribe for $24.99 Sub half goes to twitch anyway lol
rechka_rhine: yo
rechka_rhine: when's the new album
rechka_rhine: coming out
35209: I'm in process of sending you $10
rechka_rhine: dude I listened to your music so much
DirectorHomeless: any lower and we're at periscope levels of shittyness. that rav4 stream looked like lego
rechka_rhine: what book
thisisweeezy: 4k!
rechka_rhine: oh word
thisisweeezy: cheer1 cheer1
gigafact: all he needs for better periscope streams is streamlabs mobile app. periscope is really trash app
quillford: cheer1
35209: I have 1000 bits, I'm not sure what to do with it
thisisweeezy: haha
rechka_rhine: that vc money drying up bud?
any_available_username: Kappa
35209: How do I convert the bits to money?
DirectorHomeless: new task: write a neural net that can scale up a 2000kbps bitrate to 8000kbps in near realtime
thisisweeezy: so poorrrr -- here is 1 bit cheer1
nic0latesla: what is it the name?
nic0latesla: book???
thisisweeezy: another bit here cheer1
any_available_username: weeezy make it rain
thisisweeezy: im a VC to twitchchess
thisisweeezy: rain ~ cheer1
thisisweeezy: more rain?
thisisweeezy: cheer1
any_available_username: moar plZ
thisisweeezy: cheer1
thisisweeezy: IT IS $
3dvinci: YM baby
DirectorHomeless: 1 bit = 10 dollars
35209: I bought $10 in bits, trying to figure out how to give you? Or is this just a perk unlock thing?
thisisweeezy: haha, not that much
gigafact: ^lie
any_available_username: 100 is like 0.1 right ?
DirectorHomeless: shhhh
thisisweeezy: type "cheer1"
thisisweeezy: "1" could be changed to any number
gigafact: it takes a while to process bits to cash for streamer
DirectorHomeless: 1 bit = $1
thisisweeezy: like "2", "3" etc
thisisweeezy: america!
Dsplits: Hate is bad!
any_available_username: they hate themselves too
any_available_username: twitch is freeland Kappa
Dsplits: You got more muscle on your right arm than your left arm.. I wonder why..
35209: cheer 10
thisisweeezy: together
35209: cheer 10
3dvinci: lol
thisisweeezy: cheer 1k
any_available_username: trying to quit smoking and george is filling my insomnia with these streams thank god
gigafact: how to use twitch prime sub without giving them any cc info?
thisisweeezy: hah
thisisweeezy: southpark
35209: The cheers don't do anything
thisisweeezy: rice eating
DirectorHomeless: use 'cheer10'
thisisweeezy: on twitch
3dvinci: No spaces bruv
thisisweeezy: cheer-rice
rechka_rhine: there's a social eating category
thisisweeezy: cheerrice
35209: cheer1000
thisisweeezy: damn!
3dvinci: Rich
thisisweeezy: ^^^^^^^
thisisweeezy: 1000!
gigafact: that is something 35209!
DirectorHomeless: @tomcr00s3 you got your $10, lets see the 4000kbps
thisisweeezy: damn!
Dsplits: They are defining G
thisisweeezy: wowow
KhaosVFX: change it 1080p bro
thisisweeezy: Gangster!
thisisweeezy: hah
any_available_username: you need to restart stream i think
thisisweeezy: hahahah
3dvinci: lmaooo
35209: WE NEED MORE POWER. FIRE UP KOWALSKIS NUCLEAR REACTOR
redmx96: you need to restart
thisisweeezy: you're rich now
thisisweeezy: finally rich!
any_available_username: my bad
DirectorHomeless: lmao
gigafact: no need to restart
KhaosVFX: there is no visual difference smh
gigafact: refresh stream
any_available_username: how much for 1080p now cause there is no difference hahah
KhaosVFX: exactly
thisisweeezy: thank you 35209
thisisweeezy: thank you @35209
gigafact: bitrate helps where there is a lot of movement and a lot of different color
thisisweeezy: hahah
thisisweeezy: you ban
thisisweeezy: it's not the keyboard
gigafact: you can try to guess what kind of keyboard from the sound
gigafact: or write a neural net to guess by the sound of the keyboard
thisisweeezy: rice eating in 3 mins!
DirectorHomeless: it's a shit one
rechka_rhine: 100%
rechka_rhine: looking at keyless keyboard
rechka_rhine: but
35209: He's talked about his keyboard ad nausium in prior videos. So don't ask. It's aLeopold FC900R Black PD Double Shot ABS Mechanical Keyboard
any_available_username: Danger – Mix (Unofficial)
rechka_rhine: do you use dvorak programmer?
thisisweeezy: stream rice eating -- you'd get rich!
rechka_rhine: or are you a qwerty normie
35209: devorak is stupid,
rechka_rhine: no u
thisisweeezy: what's devorak
DirectorHomeless: ok, so thus far, we've listened to gwen stefani, ordered uber eats, and upped the bitrate. things are going well
35209: Devorak is a shuffling of the keys that's supposedly 1% more efficient? It's not.
rechka_rhine: it feels nicer
thisisweeezy: 1%?
thisisweeezy: it's worth it ha
rechka_rhine: vim keys still work
thisisweeezy: no emacs
rechka_rhine: spacemacs
DirectorHomeless: where's the love fr nano
thisisweeezy: emacs get ban
35209: We're in paralasis by analysis.
any_available_username: LMAO
gigafact: haha
any_available_username: monkaS am i banned monkaS test
thisisweeezy: emacs hurts hands
gigafact: how are you guys feeling about everything you say here it's going on youtube ? :P
thisisweeezy: feel great
35209: A vortex appears above your avatar, a thumb of smite materializes and smooshes you like a bug. Banned.
gigafact: Kappa
thisisweeezy: PokMaskedpika
thisisweeezy: hotz never washes his clothes
thisisweeezy: his clothes are there for days
thisisweeezy: ever since the twitchslam days
thisisweeezy: cheer1
35209: We're stuck on implementing the "value" function that supposedly a cost function for board fitness. But neural net isn't the best tool for the job. It's a pipe wrench on a nail.
thisisweeezy: ha
thisisweeezy: here comes the rice eating stream!
thisisweeezy: riceeeeeee
thisisweeezy: this steam is worth it
rechka_rhine: why is jake paul ironically appealing?
thisisweeezy: cheer1 here you go
35209: Winning positions can be up to 80 moves away.
thisisweeezy: of course
thisisweeezy: thank @35209
thisisweeezy: donating cheer1 so you could afford air condition
35209: 1 bit is like 0.1 cents lol.
thisisweeezy: print((
35209: Vim can make a background highlighter for print statements without parens.
thisisweeezy: ha it's the love
thisisweeezy: cheer1
thisisweeezy: that counts
thisisweeezy: noooice
gigafact: rice is amazing
thisisweeezy: what's the name of the restaurant ?
Dsplits: damn...
thisisweeezy: heard ".... Thai"
Dsplits: no freedom of expression..
35209: We need more donations so we can afford an air conditioner.
rechka_rhine: rice and butter. 10/10
gigafact: yes proper AC is quiet and very very cold
35209: 8000 BTU air conditioners can be quieter than $5 fans.
thisisweeezy: so many choicessss
thisisweeezy: hotz will spend the next hour buying a fan
gigafact: look how many decibels ?
35209: I have an air conditioner that's like 25 dB. That's practically nothing.
thisisweeezy: MATE
thisisweeezy: makes me hungry too
35209: You've overdosed already, you need to up to cocaine or barbituates.
35209: Caffine is a cousin of cocaine
thisisweeezy: hah
Dsplits: How do you feel about nootropics?
thisisweeezy: drug expert!
35209: Neuroscientist in the house.
thisisweeezy: meth
35209: lol, gonna have to delete this vid.....
gigafact: LSD?
35209: I knew a guy who did a lot of LSD, he went on to attempt suicide.
alluxua: Is geohot doing weeds or lsd?
gigafact: did you tried it?
thisisweeezy: legaaaalize it
35209: Drugs are bad mmmmkay?
thisisweeezy: weeeeeed
35209: nooooooooooo
alluxua: Doing weeds is kind of like digging a tiny hole in your brain, sugar does the same thing
35209: The best high is from cardio and lifting at the gym in the morning. Lift bros.
alluxua: Jogging is about the same
joejohnthbest: loud ass keyboard
Dsplits: Do you still do anything that's related to security?
gigafact: it's not that loud but mic is right there
thisisweeezy: security is a scam
thisisweeezy: hah
35209: What's the end goal of this TwitchChess?
Dsplits: no
35209: Why redesign the wheel with this chess stuff?
thisisweeezy: it's a easy task
any_available_username: it beat you already, you seem to given up Kappa
alluxua: Gosh, I missed that part geohot starts to smoke weeds. Did the video record it?
3dvinci: with GUI?
thisisweeezy: it's gonna come
thisisweeezy: weed smoking is after rice eating
gigafact: CLI only I hope
thisisweeezy: best css designer in the world
alluxua: Gosh, I got to watch that part
thisisweeezy: ".ain't my web design skills sick? "
Dsplits: lol
35209: Stop swearing on stream and eat your vegetables.
HettyPatel: hey
HettyPatel: what language do you recommend for a beginner?
TrustyCaribou: cheer1000
thisisweeezy: python
thisisweeezy: @TrustyCaribou ^^^^^^^ 1000 bits
35209: here comes the moneytrain... hey money money money dollah dollah.
alluxua: Javascript
thisisweeezy: another $10 dollar @tomcr00s3
thisisweeezy: bump the bits
thisisweeezy: hahaa
thisisweeezy: cheer1
TrustyCaribou: thanks for the great content
thisisweeezy: cheer1
Dsplits: @HettyPatel Go with C
3dvinci: More bitrate den
upsidedownlemon: What are we doing here?
Dsplits: I'll give you money.. how much do you want?
35209: Neural net   chess = learning.
alluxua: I gave you bits, but you never said thank you
thisisweeezy:   weed smoking
upsidedownlemon: What kind of neural net?
thisisweeezy:   rice eating
thisisweeezy: complicated neural nets
thisisweeezy: maybe geo can't explain -- i don't know what kind
thisisweeezy: * can
35209: @alluxua you do realize that geohots has more money in his bank account than all 45 of us in this channel will ever earn in our lifetimes, right? So your donation of 3 dollars didn't impress.
Bitcoin__: I've actually been thinking of making a chess game, but sadly I only write in VB.net :S
thisisweeezy: write it in assembly
thisisweeezy: lol
thisisweeezy: life is great!
Dsplits: @Bitcoin__ Only god's know that language!
alluxua: @35209 , I am so heart broken. Watched so many twitch ads to make that $3
Dsplits: @HettyPatel Best language to start with is machine code..
joker2k999: columns? row? your language is complex.
3dvinci: LUL
thisisweeezy: C
joker2k999: really? now your trolling.
thisisweeezy: 01010101010101001
joker2k999: 001101100011100
Dsplits: @joker2k999 Which instruction set are you using?
alluxua: shamrock1 shamrock1
joker2k999: lol, the noob one
35209: Real programmers don't write machine code, they use a prism and a steady hand.
Dsplits: @35209 Good one
joker2k999: what? no abacus?
35209: Emacs has Ctrl-Alt-left-butterfly- b
thisisweeezy: C instruction
joker2k999: theres a brew package out there for everyone...
35209: Bitshifting ooh yeah.
joker2k999: how about 1 or 0?
thisisweeezy: 1
Dsplits: Prolog is where the money is at
thisisweeezy: nand2tetris is a good course on coursera
3dvinci: LOL I feel you man
joker2k999: lol. the weed normally helps w/ that
thisisweeezy: ha
thisisweeezy: prolog is the shit
35209: Make geohots the biggets twitch streamer. Smash that notification button.
Dsplits: Can I recommend a song?
thisisweeezy: so is haskell
thisisweeezy: smmmmmmmashed
joker2k999: lol
35209: lol
joker2k999: savage
Dsplits: Damn
Andrewnagyy: What' up bro
35209: 20000 bits for a song. lol. Sounds like a bargain.
joker2k999: and smash that like button. didn't think there was a like button....
joker2k999: or 20000 bits in machine code...which is clearly an overflow....
desg92: wheres twitchslam
gigafact: ^
35209: What's a Tier 1 sub?
thisisweeezy: https://twitter.com/mattwhitlockPM/status/1010005280506220544
thisisweeezy: new subscriber! nice
joker2k999: so are we writing a chess py program just to stay sharp.... or....
Networks: there's different subscriber levels
gigafact: Tier 1 is $4.99 / Month
thisisweeezy: yes
Networks: tier 1, $5; tier 2, $10, etc
thisisweeezy: just for staying sharp
3dvinci: Dsplits put his money his mouth is
joker2k999: bet
alluxua: A month? Or just an one time fee?
thisisweeezy: only write useless stuff
Networks: a month
gigafact: for as long as you want
3dvinci: Donate me a sub
35209: I want to buy Comma-AI stock when it goes public.
gigafact: who said it will ever go public?
Dsplits: @35209 Visionary
alluxua: @35209 , when it is going public, it is too late to get in
35209: For 30000 bit donation, we can be even more obnoxious sluping up our tai fried rice.
35209: no, please explain
thisisweeezy: saw 0s and 1s
joker2k999: lol, says the guy w/ the yacht
Bitcoin__: Doesn't Comma.Ai pay good enough?
35209: I could float your yacht in my yacht's starbord pool.
Dsplits: lol
thisisweeezy: 40k/yr
joker2k999: change the world right...
Dsplits: Yes I did
35209: tear 1 sub
joker2k999: lol
Dsplits: @35209 ...
thisisweeezy: 41k
Networks: how many 0days do i have to find to get into harvard?
3dvinci: Buy love
joker2k999: so shallow, i love it
35209: George is a big advocate of college educations.
joker2k999: the woman bro
alluxua: @bitcoin__ , they got 3M investment about 2 years ago. And roughly they have 10-15 employees in the past 2 years. So do the maths. They got another 5M most recently
3dvinci: All feels the same
thisisweeezy: geo brutally loves MIT
EstevesxDbr: Why you type so slow ? Have you got some type of hand dysfunction ?
35209: lol
thisisweeezy: social prove
thisisweeezy: proof
3dvinci: All you need is the internet baby
joker2k999: speak on it bro
thisisweeezy: wan truth? subscribe to this channel !
rechka_rhine: nah truth is interacting with people
gigafact: preach
Networks: I hate my younger self for not holding onto more bitcoin lol
3dvinci: People are aight
3dvinci: Nice pass time sometimes
nic0latesla: Have you try hack facebook????
thisisweeezy: me too
thisisweeezy: hodl
Networks: lmao
Networks: I had 10 litecoins that I lost
35209: Donations to the channel increased the number of viewers.
Networks: and a decent amount of bitcoin lost due to gambling
thisisweeezy: bought 1.5 and sold it real quick back in 2015
joker2k999: just wait till he hits the bowl, then we'll really get some "truth"
3dvinci: Damn
Networks: i had around .5 in 2014
desg92: the bowl?
Dsplits: Got 15 bitcoins atm
Networks: when it was worth like $250
thisisweeezy: 0.5
gigafact: Best video about Bitcoin https://www.youtube.com/watch?v=KV5QlSgq7lg
thisisweeezy: 15 damnnn
thisisweeezy: how to turn 100k into 10k -- nowadays
Networks: BTC is about to dip under 6k
thisisweeezy: so rich
Andrewnagyy: BTC is going away man, it was a ponzi scheme
35209: 15 bitcoins is what? like $15000 USD?
thisisweeezy: haaaa
Dsplits: Good one
thisisweeezy: EOS
joker2k999: lol. good one
3dvinci: Elastos baby
thisisweeezy: &lt; US dollar
35209: I don't know what EOS is
thisisweeezy: shitcoins
3dvinci: Put it in Elastos
3dvinci: lmaoo
alluxua: EOS is a scam.
35209: I invest my retirement in Hatian Penny stocks.
Dsplits: soo many magic numbers
Bitcoin__: The biggest mistake I made was gambling 2.7 BTC at 360$ and selling 250 LTC at 4,05$
rechka_rhine: a coin's potential value is a function of how many dumb rich people it can attract, and EOS is clearlfy doing very well in that front
EstevesxDbr: Theter is a great way to hedge crypto exposure without coverting into fiat
thisisweeezy: ranked 1
thisisweeezy: EOS
rechka_rhine: scam
thisisweeezy: RIPPLE scam!
thisisweeezy: BTC semi-scam
rechka_rhine: sorta scam
rechka_rhine: tron is a scam
thisisweeezy: TRON is HUUUUGE scam
rechka_rhine: bittorrent is an irrelevant company
alluxua: I hedge bitcoin, ETH with consumer stocks and tech stocks, so far so good
Dsplits: how is tron a scam?
rechka_rhine: grincoin is kinda cool
rechka_rhine: http://grin-tech.org/
rechka_rhine: but you can't just give out addresses
rechka_rhine: I think you have to negotiate every transaction
thisisweeezy: goto 10
rechka_rhine: but nodes can prune most of the block chain
35209: Rewrite your production code in Pony and Jerlang.
35209: It has goto.
thisisweeezy: 1: TRON is scam
thisisweeezy: goto1
rechka_rhine: devs seem like nice people
rechka_rhine: but all cryptos are scam
Dsplits: Crypto-Currencies are all scams.. What matters is the concept of the blockchain
gigafact: this stream is amazing we need to at least once a week
thisisweeezy: hmmmmm
thisisweeezy: really bruvh, blockchain
thisisweeezy: blockchain is over-rated
Dsplits: The future of the blockchain is smart contracts
rechka_rhine: everything is over rated
35209: IBM is trying to subsume a blockchain to try to make it paletable for the government. Embrace extend extinguish.
thisisweeezy: maybe
rechka_rhine: we're all gonna die
thisisweeezy: yes we're
thisisweeezy: so let's enjoy it!
rechka_rhine: never seen someone use "we're" like that
alluxua: Blockchain will settle down of its tech position very soon, as the AI. It happened to big data 3 years ago
rechka_rhine: shill me elastos
35209: Are you shilling for your drinks? Are you doing this for the money? lol
Networks: using we're like that is the reason god abandoned us
rechka_rhine: 27 github stars
Dsplits: @alluxua No.. is too early for that
rechka_rhine: to the moon
35209: lol
thisisweeezy: everyone starts it
35209: I get the raspberry tea. it's better
thisisweeezy: instaban
rechka_rhine: have you heard of urbit george? not a crypto
rechka_rhine: oh no
Dsplits: That's right
desg92: lmao
rechka_rhine: I guess it has an asset
gigafact: lol
thisisweeezy: $$
rechka_rhine: urbit.org
thisisweeezy: Bruhchain yo
35209: Safe AND reliable!
Dsplits: Lol same shit that tron is doing...
joker2k999: oh wow. i had to stop my work to enjoy this
Crabtr: LUL
thisisweeezy: tol you about TRON
alluxua: Have a look of their github pull request
any_available_username: @joker2k999 same lol
thisisweeezy: smash that SUBSCRIBE button!
35209: Sarcasm level is over nine thousand.
rechka_rhine: fuck I feel myself getting retarded trying to read these whitepapers
redmx96: calm down Richard Hendricks
35209: The caffine is irritating your neurons.
thisisweeezy: whitepapers
rechka_rhine: that's the idea
thisisweeezy: lol
Networks: LOL
rechka_rhine: 27 github stars bro
35209: Cellphone environment...
thisisweeezy: HUUUUUUUGE scam
rechka_rhine: george
rechka_rhine: urbit.org
rechka_rhine: elastos
thisisweeezy: wait
35209: hold on.
thisisweeezy: i'll give one
rechka_rhine: thoughts?
Networks: ill give u a star &lt;3
rechka_rhine: is it a cult?
rechka_rhine: am I in a cult?
joker2k999: bro, i will tune in to watch you shit on cryto or (insert any IT related thing)any day of the week.
rechka_rhine: it's super cool
wiiziwiig: just me or did stream stop?
35209: I starred your shitty Chess app bro.
rechka_rhine: it's basically still just a chat app now
alluxua: Who are in their team? Overall it is a tech start up
gigafact: they used latex to write it at least
joker2k999: oh gawd, is he doing research, why are you reading white paper
Rabidwh0re: Yo, when will you stream twitchico?
thisisweeezy: 6 stars!
thisisweeezy: mindf*ck
alluxua: White paper rarely means nothing. The implementation means a lot
joker2k999: lol @batman. thats funnyAF.
thisisweeezy: it means a lot to geo lol
thisisweeezy: please give geo more self-esteem
35209: PLEASE UPVOTE: https://github.com/geohot/twitchchess
alluxua: Star chess?
rechka_rhine: aaron
joker2k999: your dirs are always some comical ish
rechka_rhine: let's be friends
rechka_rhine: we live in the same city
rechka_rhine: aaron mill, I see you
joker2k999: should..,
Dsplits: You just killed that mans dreams
thisisweeezy: followed all the star-ers
thisisweeezy: let's get 10!
thisisweeezy: leet's validate Geo
miteydrill: preach it
Onedaymylove: is he being sarcastic can't tell
miteydrill: Father I crave seratonin
antranilandimetylu: What are you doing?
35209: Neural nets   chess = learning
wiiziwiig: stars matter
thisisweeezy: maybe weed smoking tooo
antranilandimetylu: How is he leasing it?
antranilandimetylu: Learning
rechka_rhine: csv is the 2nd best file after .txt
Dsplits: @35209 You should be a mod
joker2k999: damn spaces...
thisisweeezy: magic
35209: Elevate me to mod, I will be firm but fair.
rechka_rhine: aaron, was it something I said?
joker2k999: i think csv was big in the 80s?
antranilandimetylu: It’s the simplest and best
thisisweeezy: he learns from stackoverflow and google
joker2k999: i don't think he learns, i think he just know
antranilandimetylu: But I meant
thisisweeezy: yeaaah
antranilandimetylu: How is he learning his ai
thisisweeezy: he knows lol
3dvinci: Been doin it
thisisweeezy: AI is scam
antranilandimetylu: Lmao
rechka_rhine: AI winter when?
rechka_rhine: AI winter 2.0*
thisisweeezy: https://twitter.com/drewconway/status/1010137695664951297
35209: Skynet won't be possible for at least 35 years. Beep Boop, No need to worry fellow humans.
thisisweeezy: it's call "statistics"
alluxua: If I say this chess python is quite boring, would I get kick out there or geohot would code something more interesting?
wiiziwiig: what is the original song to this beat?
wiiziwiig: sounds familiar
3dvinci: Would probly just ignore you
Dsplits: Sunny Day Real Estate - In Circles is a good song
rechka_rhine: thoughts on vaporwave?
thisisweeezy: what's vaporwave?
rechka_rhine: https://dreamcatalogue.bandcamp.com/album/--18
wiiziwiig: whats there to think about? are you saying something is vapor ware?
thisisweeezy: pretty nice music
rechka_rhine: https://beerontherug.bandcamp.com/album/floral-shoppe
rechka_rhine: just asking for opinions/recommendations
wiiziwiig: this guys is in the zone
rechka_rhine: true
wiiziwiig: i want to be in the zone like this guy
thisisweeezy: pytoooooorch
thisisweeezy: you'd need some weeed
Dsplits: https://www.youtube.com/watch?v=41YqzHoCgk4
thisisweeezy: to be in this type of zone
joker2k999: bro we know you got that carter V man
wiiziwiig: oo vaporware is a band?
gigafact: this sounds nice
rechka_rhine: it's a genre
wiiziwiig: i thought you meant vaporware vaporware
alluxua: @tomcr00s3 , how about code deep learning on investment as you love money next time?
ABuffSeagull: @rechka_rhine good taste with that 2814 album, love that album
joker2k999: No binaural beats?
rechka_rhine: my favorite vaporwave album is https://telepathtelepath.bandcamp.com/album/--12
thisisweeezy: all japanese?
rechka_rhine: no
Onedaymylove: you watch this guy code, and you think when will the day come when I can code the things in my head onto the screen
thisisweeezy: is it originated from JP or something
rechka_rhine: nope
ABuffSeagull: most vaporwave is instrumental
wiiziwiig: this sounds like 5 songs mixed together
3dvinci: Binaural is trippy
thisisweeezy: @Onedaymylove one day
rechka_rhine: the first song isn't great
Onedaymylove: ohhhh nice one
thisisweeezy: hah
ABuffSeagull: most vaporwave uses japanese characters cause japanese is ＡＥＳＴＨＥＴＩＣ
rechka_rhine: telepath might actually be japanese idk
thisisweeezy: so A ESTHETIC
gigafact: everyone in the chat follow George to get notifications when he starts streaming. close to 1k followers on twitch!
thisisweeezy: CTRL   C, V makes life miserable
redmx96: tensorflow?
3dvinci: Pytorch vs. Tensorflow?
thisisweeezy: 1k!
rechka_rhine: george
rechka_rhine: skip to song 2
rechka_rhine: on that album
rechka_rhine: on the blue one
thisisweeezy: geo is gonn be rich and he needs the validation from us LMAO
35209: Roll your own neural net... in Assembly.
wiiziwiig: was i the 1k follower?
thisisweeezy: daaaamn -- 1k
gigafact: I said close we are not there need more followers
thisisweeezy: here is one bit for being the the 1k th follower cheer1
Dsplits: @35209 You couldn't be closer to the truth
wiiziwiig: oo ok
gigafact: when is twitch going to feature George stream he is making twitchslam twitchchess this has to count for something right?
thisisweeezy: he is switching careers
thisisweeezy: soon
rechka_rhine: george should code an open source twitch
rechka_rhine: call it twitchtwitch
thisisweeezy: ohhh yeah
thisisweeezy: ^^^^ thumbsup
wiiziwiig: call it nottwitch
thisisweeezy: twitchtwitch
Dsplits: Geo when are you going to become a full time streamer?
thisisweeezy: and livesteam and twitchtwitch
rechka_rhine: next song
rechka_rhine: on that album
rechka_rhine: song 2
3dvinci: From vaporware to vaporwave
wiiziwiig: why is he reassigning x so many times?
thisisweeezy: idk
madebyollin: not a pytorch expert but seems likely that the nn.Module superclass is assuming you have all of the layers as properties for the other passes
thisisweeezy: ¯_(ツ)_/¯
rechka_rhine: don't you love having to sing in to a website to install cuda?
rechka_rhine: sign*
madebyollin: does cuda require signin or just cudnn?
rechka_rhine: or cudnn
thisisweeezy: smash that star button here: github.com/geohot/twitchchess/
rechka_rhine: the fact that nvidia forces you to open a browser to use hardware you bought from them
madebyollin: optimizer = optim.Adam([var1, var2], lr = 0.0001) ?
madebyollin: nvm
agentvenom2: what does this dataset contain? chess position -&gt; probability of win?
thisisweeezy: think so
alluxua: how large of your training datasets?
thisisweeezy: huuuuge dataset
rechka_rhine: yea, coding neural nets feels so weird
rechka_rhine: writing code to write code
gigafact: inception?
rechka_rhine: no I just mean it feels clunky
alluxua: if you are just beginning ,try keras
rechka_rhine: it's still weird
madebyollin: is your net downsampling anywhere?
thisisweeezy: ML is hard
alluxua: Do you know how to tune those parameters?
rechka_rhine: von neuman machines are the wrong abstraction
Dsplits: free martin shkreli
rechka_rhine: tru
rechka_rhine: forgot about that guy
thisisweeezy: this stuff seems hard
madebyollin: https://discuss.pytorch.org/t/expected-stride-to-be-a-single-integer-value-or-a-list/17612 ?
madebyollin: * (other, e.g., the game is ongoing).
Dsplits: that chair seems uncomfortable
gigafact: He needs https://www.dxracer.com/ to be a proper streamer
joker2k999: lol
joker2k999: same chair different color
thisisweeezy: $$$$$$$$$$$
thisisweeezy: here we go again
thisisweeezy: another hour spent on amazon.com
joker2k999: its... good for office gaming
thisisweeezy: you get a chair
Dsplits: yes
dorkmo: fnatic is just a game clan
EstevesxDbr: yep
joker2k999: its amazon, you can get it tomarrow
gigafact: yep
Dsplits: 2 day delivery
rechka_rhine: no
rechka_rhine: get pewdiepie's chair
thisisweeezy: seems expensive
dorkmo: get a herman miller
thisisweeezy: a chair for $300 ?
Networks: fnatic is a CS:GO team? why buy a CS:GO team branded chair? lmao
rechka_rhine: lol
thisisweeezy: that's some expensive sh$t
decaprime: craigslist aeron
Dsplits: Yeah it's a good chair
joker2k999: yea, its the streamer chair bro
thisisweeezy: 5 star reviews on THEIR website!
joker2k999: ....wow. he has his own chair?
dorkmo: https://www.amazon.com/DOH-FD01-NR-Ergonomic-Executive/dp/B0711QC6Q9/ref=lp_7585024011_1_1?srs=7585024011&amp;ie=UTF8&amp;qid=1529898179&amp;sr=8-1 amazon link
Dsplits: They are both the same
rechka_rhine: that's the chair I have
rechka_rhine: it's pretty nice
joker2k999: oh. yea... same thing, just sponsored
rechka_rhine: that's literally my chair
rechka_rhine: haha
dorkmo: twitchchair
thisisweeezy: next two steam: twitchtwitch, twitchchair
yyube_: How’s the company doing?
joker2k999: #goals. #focus
rechka_rhine: herman miller?
rechka_rhine: they're doing great probably
thisisweeezy: company is doing great but geo is switching career to be a full-time steamer
rechka_rhine: https://en.wikipedia.org/wiki/Aeron_chair
yyube_: thisisweezy??
yyube_: Lol
thisisweeezy: it's real
thisisweeezy: and geo needs stars on this repo: github.com/geohot/twitchchess/
yyube_: You’re definitely bullshitting
thisisweeezy: we can do it, let's get 10 stars
thisisweeezy: ask geo
madebyollin: you want 1, right?
alluxua: The greatest of geohot is he is totally transparent, even not hiding he is learning the basics of deep learning
madebyollin: since it's amount on each side?
rechka_rhine: no, yyube_, you don't understand. He's t h i r s t y for those stars.
yyube_: I know geo from the jailbreak scene
thisisweeezy: he's changed
yyube_: And for his company comma ai
rechka_rhine: he's born again
gigafact: AD for dx chair https://vimeo.com/198933442 so powerful lol
thisisweeezy: he's twitching fulltime
yyube_: Python?
rechka_rhine: yes
thisisweeezy: python and C
yyube_: Do any of you program?
yyube_: And what is he making rn?
Dsplits: use dim-X
alluxua: I do, Python on machine learning
madebyollin: he's making a neural net to predict chess outcomes, I think?
rechka_rhine: you have to be a programmer to be in this stream
yyube_: @rechka_rhine I only know python basics lol
gigafact: or you just watch George beautiful face...
rechka_rhine: get out ree
thisisweeezy: I choose latter
yyube_: I’m learning Java for school but I hate it
rechka_rhine: ew
rechka_rhine: gross
rechka_rhine: learn Idris
yyube_: Java sucks ass
alluxua: Is he offline?
thisisweeezy: argh, JAVA
yyube_: But I’m learning it for the AP test
rechka_rhine: he's in the zone
rechka_rhine: highschool??
yyube_: Because for some reason Java is the language for AP comp sick
alluxua: Weeds zone?
yyube_: Sci
yyube_: Yes
rechka_rhine: are you gonna be a programmer?
yyube_: Idk yet
thisisweeezy: every once a while, geo get out of zone and browse amazon.com
yyube_: I’m going into junior year
thisisweeezy: brogrammer
rechka_rhine: Java is the language because those people don't shoot where the world is going but where it is
alluxua: Seriously, is he on weed again?
yyube_: Why isn’t geo using Linux?
joker2k999: no, not yet
gigafact: multiplatform is the only good thing about java
alluxua: He has Ubuntu
rechka_rhine: because macos on the laptop, linux on the server
rechka_rhine: that's how you do it
yyube_: Gotcha
Dsplits: Don't rely on one technology.. Most of java jobs have been outsourced
rechka_rhine: you don't wanna fuck around with linux drivers and bs
yyube_: @rechka_rhine what’s the best resource to expand knowledge on python?
rechka_rhine: hmm
yyube_: @rechka_rhine I took a starter course that only taught up to functions.
alluxua: Courses Andrew ng deep learning
rechka_rhine: no he needs python not DL
alluxua: If you finish, you can kick geohot ass.
rechka_rhine: I recommend learn python the hard way book
gigafact: https://docs.python.org/ lol
dorkmo: party1
alluxua: Geohot needs to take that course as well
yyube_: Are books a better resource than online
Dsplits: Look up the book "Learning Python, 5th Edition "
rechka_rhine: I guess it's not free anymore
thisisweeezy: party1
rechka_rhine: https://learnpythonthehardway.org/python3/
thisisweeezy: for ME
rechka_rhine: the python 2 one is free
thisisweeezy: party1
rechka_rhine: https://learnpythonthehardway.org/book/
Dsplits: @gigafact You're right
rechka_rhine: I think books are better than courses yes
yyube_: But I should learn python 3, right?
rechka_rhine: but the main thing is you just have to make stuff
rechka_rhine: they are very similar
yyube_: I’m taking a Udemy java course, but it holds your hand too much and it’s easy af.
rechka_rhine: but yea python3 is the one you should be using
Dsplits: @yyube_ Before you start learning it.. think of why you want to learn python
thisisweeezy: liked how the chat is totally unrelated to the stream lol
yyube_: I would like to create automated software
alluxua: He went offline
gigafact: powershell
rechka_rhine: python is the best first language to learn, idk where you're going dsplits
Dsplits: You can do it from almost any language
Dsplits: @rechka_rhine I don't think it is
thisisweeezy: CUDA
ido1m: @rechka_rhine it really isn't lol
Th3R3dQu33n: so this guy used to jailbreak iOS operating systems?
Dsplits: is too abstract
rechka_rhine: it's a stupid debate, just learn python
yyube_: Python seems to be very simplistic in syntax compared to Java which seems wordy, correct?
thisisweeezy: GPU
ido1m: @rechka_rhine nice troll
rechka_rhine: yes
gigafact: @Th3R3dQu33n yes
yyube_: Where should I go after functions in Python?
thisisweeezy: GPUUUUUUGE
Th3R3dQu33n: @gigafact sweet!
Th3R3dQu33n: thx
gigafact: https://en.wikipedia.org/wiki/George_Hotz
rechka_rhine: reading/writing files
joker2k999: ..of course you do..
gigafact: he really needs to update that wiki pic lol
alluxua: If you love money, 3 weeks basic Python, then 3 months coursera deep learning, and then 2 months fast.ai free training, if you are serious, you can be top
Th3R3dQu33n: @gigafact always thought Musk should have hired him
joker2k999: only took you all of 5 seconds
madebyollin: classes, list comprehensions, file reading/writing, how to use pip and install/use libraries
Dsplits: @yyube_ Do you even know what a byte is? How data structures are allocated in memory?
rechka_rhine: he's in highschool
yyube_: @D
yyube_: @dsplits yes
yyube_: Already learned that
yyube_: @dsplits that was the beginning of the java course
gigafact: it's better he did not join Tesla now we have https//comma.ai and it's amazing
joker2k999: waffles sound good right now
rechka_rhine: musk did try to hire him
thisisweeezy: this is deep -&gt; "If you love money, 3 weeks basic Python, then 3 months coursera deep learning, and then 2 months fast.ai free training, if you are serious, you can be top"
gigafact: https://comma.ai
Dsplits: binary search tree? Stack? black tree? AVL-tree?
rechka_rhine: lots of cars come with lane assist now
thisisweeezy: it's going DOWN
joker2k999: lol
Dsplits: @yyube_ I'm not talking about the simple data structures.. there's more to it
thisisweeezy: !LOSS
Dsplits: Also take a course on linear algebra
rechka_rhine: || || | |_
yyube_: @dsplits where should I go to expand knowledge and do something productive over the summer?
yyube_: @dsplits I’m motivated to learn
rechka_rhine: reading writing files
rechka_rhine: then make something
ido1m: @yyube_ read books &amp; create stuff
rechka_rhine: make a program that does something for you
yyube_: Ideas?
rechka_rhine: that's the part I've always struggled with
yyube_: Also, what books are the best books you recommend?
rechka_rhine: I already told you
ido1m: Best books for ... ?
rechka_rhine: be careful making lists of books to read as a form of procrastination :P
Dsplits: @yyube_ If I were you I would familiarize my self with basic computer science concepts.. then after that you can start learning about automation
rechka_rhine: I do that
thisisweeezy: we can do it 64%
rechka_rhine: https://learnpythonthehardway.org/book/
michiamozen: use udemy
michiamozen: for basics
yyube_: Ok, I’ll learn the basics on udemy
dorkmo: someone order a pizza
rechka_rhine: make a chat app on the command line
yyube_: That’s what I’m doing rn
gigafact: http://s-f-walker.org.uk/pubsebooks/pdfs/Julian_Jaynes_The_Origin_of_Consciousness.pdf
yyube_: But after I finish a udemy course, then what?
rechka_rhine: "okay it doesn't learn" fucking story of my life with DL
michiamozen: then you'll know the basics @yyube_
Dsplits: @yyube_ Look for "Introduction to Algorithms, 3rd Edition" or http://www.kitabxana.net/files/books/file/1354098277.pdf
rechka_rhine: make a program
rechka_rhine: knowledge isn't power. the application of knowledge is power
michiamozen: :haha:
Dsplits: @rechka_rhine You need to know how to mix theory and practice
yyube_: Thank you all so much
yyube_: One more question, how often is math actually used in programming and what type of math is used?
rechka_rhine: not often
Dsplits: depends
Dsplits: machine learning a lot of linear algebra
rechka_rhine: for 90% of programming jobs you basically never use any math
Dsplits: and some calculus
rechka_rhine: not even
Dsplits: @rechka_rhine yeah the shitty jobs
ido1m: @Dsplits Not at all lol
yyube_: I’m doing pre calc this upcoming school year
Dsplits: if you want to be a webdeveloper for the rest of your life dont learn math
rechka_rhine: if you're just using ML you don't even need to know it. if you're writting the libraries sure.
yyube_: And then calc BC senior year
dorkmo: party100
rechka_rhine: if you're making websites, you'll never use math
thisisweeezy: quaier mier
rechka_rhine: listen to george
dorkmo: listen
thisisweeezy: LISTEN UP
rechka_rhine: that's most conspiracy theorists
yyube_: Lol
rechka_rhine: geopolitics
thisisweeezy: earth is ROUND
Networks: LMAO
alluxua: @tomcr00s3 , geohot, take the deep learning class from Andrew ng on coursera seriously. For average people, it takes 3 months to finish. But for you, only 6 weeks. You will benefit a lot from it
rechka_rhine: no I meant the feeling of being in on a secret
thisisweeezy: earth is FLAT
thisisweeezy: lol
Sgtkill: So the earth is flat or did i not understand that correctly??
Dsplits: Knowledge
rechka_rhine: :underlined 100 emoji:
thisisweeezy: ohhhh man
yyube_: Is he writing code in the Mac terminal?
michiamozen: our body is STRAIGHT not ROUND, so the earth is FLAT
rechka_rhine: yes
thisisweeezy: party1
rechka_rhine: programmers use the terminal extensively
thisisweeezy: good good study, day day up
ido1m: @yyube_ it's called vim
rechka_rhine: it doesn't look like it, but it's the most powerful way to use a computer once you learn how
yyube_: I’m such a noob, but how did he get lines and stuff in the Mac terminal
Sgtkill: @michiamozen depends how much cake you eat Kappa
Dsplits: vim is a command line editor
thisisweeezy: 79 viewers!
rechka_rhine: https://www.digitalocean.com/community/tutorials/an-introduction-to-the-linux-terminal
hartator1: waho new record 81
michiamozen: linux terminal is all about ls, cd, and chmod
rechka_rhine: he's using https://en.wikipedia.org/wiki/Vim_(text_editor)
gigafact: when we get to 100 George will rap
gigafact: he promised
thisisweeezy: oh yeaehhh
rechka_rhine: I'm telling my friends
Networks: mines all about rm
hartator1: hell yeah get him to 100
yyube_: Are most of you in or out of college?
thisisweeezy: 0 to 100 real quick
rechka_rhine: out
Networks: I'm a senior in HS
rechka_rhine: I need a jerb
yyube_: Did you major in cs?
rechka_rhine: I dropped out
rechka_rhine: but ye
hartator1: try "rm -rf / " in your Terminal app, best way to learn how to code.
yyube_: Y’d u drop out?
thisisweeezy: wut
rechka_rhine: tbh
rechka_rhine: I am not sure
Dsplits: I graduated last fall
rechka_rhine: but I did a semester and it was no cs
rechka_rhine: just introduction to java
rechka_rhine: and I thought this is retarded I'm out
rechka_rhine: went to work
Networks: the only formal programming class i've taken was on javascript lol
Sgtkill: Can you explain what you're doing for new viewers?
rechka_rhine: I went to make friends and I didn't make any
thisisweeezy: yyyyyyyyyyeah, so valuable
rechka_rhine: so /shrug
Networks: im pretty psyched
michiamozen: social_life = False
Dsplits: social_life = scam
yyube_: So first things first I should learn basics
Networks: life isn't existent to begin with
thisisweeezy: NET
yyube_: With books such as the python book @rechka_rhine recommended
any_available_username: LMAO
yyube_: The connect four meme lol
rechka_rhine: then make a program, then learn more theory like @Dsplits said
hartator1: if social_life == nil print "redditor"
rechka_rhine: reddit is gross
yyube_: Ok, no more questions. Thank you so much @rechka_rhine , @dsplits , and anybody else who gave me advice.
Dsplits: @yyube_ Yeah make sure that you actually apply the theory
rechka_rhine: do you have a github
michiamozen: if programmer == "beginner": programmer.use("notepad  ")
rechka_rhine: @yyube_
gigafact: the speed of programming here is insane
gigafact: is anyone of you even close to this real life?
yyube_: @rechka_rhine yes, but no projects
thisisweeezy: who uses notepad
thisisweeezy: use paper
rechka_rhine: what is it
rechka_rhine: I'll follow you
thisisweeezy: search for meaning of life
Dsplits: @yyube_ true. @rechka_rhine made a valid point. Look at github repositories and learn from them
yyube_: yyube
rechka_rhine: reading other people's code is nice too
yyube_: Same as twitch
gigafact: yep everything is online if you look hard enough
dorkmo: cant get this content on cable
thisisweeezy: rename state ?
michiamozen: reading other people's code as an audiobook on audible is better
thisisweeezy: change 'state' to like '_state'
rechka_rhine: https://github.com/requests/requests/tree/master/requests is some nice code
thisisweeezy: cooooool brrrrrruh
yyube_: @rechka_rhine are you boris?
rechka_rhine: ye
yyube_: K
thisisweeezy: model.uncuda
Dsplits: Geo what time is bed time?
rechka_rhine: I also don't have projects, so we got that in common lol
ivanfremn: is this vim
ivanfremn: I code on Microsoft Word
rechka_rhine: yes
ivanfremn: Kappa
rechka_rhine: andrew ng did that
rechka_rhine: made me feel weird
thisisweeezy: i code in excel spreadsheet
rechka_rhine: writting matlab in Word
gigafact: atom is nice too
Dsplits: @ivanfremn Best editor ever
yyube_: Why not write code in IDE?
Dsplits: @thisisweeezy Even btter
alluxua: Use anaconda has everything
rechka_rhine: spacemacs is nice if you want to invest the time to learn both emacs, vim and the spacemacs keybindings
yyube_: Such as pycharm?
rechka_rhine: use an IDE
rechka_rhine: it's the fastest way to get started
thisisweeezy: bird
yyube_: And then learn vim and terminal later?
thisisweeezy: bill$on dollar company yo
Dsplits: is all personal preference. I like terminal because I can easily navigate through the system
rechka_rhine: learn terminal right away
ivanfremn: I code on a typewriter and then I scan the paper and use a program to transform the image into text
hartator1: true coder do `cat &gt;&gt; python` not text editors
dorkmo: billion dollar shave club
rechka_rhine: but vim isn't really necessary
yyube_: @rechka_rhine any recommended resource for that?
rechka_rhine: https://www.digitalocean.com/community/tutorials/an-introduction-to-the-linux-terminal
Dsplits: @ivanfremn That's the most productive way to program
rechka_rhine: or
Dsplits: vim is good.. I love emacs tho
ivanfremn: bruv your windows are overlaping
ivanfremn: how can you live like this
rechka_rhine: http://blog.teamtreehouse.com/introduction-to-the-mac-os-x-command-line
Dsplits: @ivanfremn ocd much?
rechka_rhine: if you're on macos
thisisweeezy: 72% is coo0l
rechka_rhine: @yyube_ what's your operating system?
ivanfremn: Dsplits exactly
rechka_rhine: he's probably doing it to give us a better view
yyube_: @rechka_rhine I have access to a MacBook Pro 2012, a windows 10 professional PC I built, and a laptop I installed linux mint on.
ivanfremn: damn this man types faster than I think
Dsplits: Install ubuntu on a virtual machine
slaterusa: r u still being sued by every company under the sun?
thisisweeezy: Valuable
rechka_rhine: nice
rechka_rhine: windows is kinda shitty to learn programming on
thisisweeezy: nice
ido1m: @Dsplits why tho if he has mint installed already?
dorkmo: float on
gigafact: antergos is cool
Dsplits: Then use mint
yyube_: I don’t understand Linux at all tho
yyube_: Lol
arxenixOW: geohot did you do google ctf?
inoahdev: do you ever use an IDE?
rechka_rhine: lol
ivanfremn: someone duel this man on typeracer
yyube_: I just have it installed on a laptop
yyube_: Never actually have used it
slaterusa: what's he on that makes him type at 9 trillion mph
thisisweeezy: weeed
yyube_: I want to see Geo’s wpm on typeracer
ivanfremn: ^
rechka_rhine: me 3
Dsplits: @tomcr00s3 What is your wpm
thisisweeezy: godspeed
slaterusa: jfc
ivanfremn: Look at chat my man, we need you to prove your skills on typeracer
yyube_: True lol
thisisweeezy: next stream idea: typerace with twitties
yyube_: So about Linux. Where should I go for that?
slaterusa: @tomcr00s3 whatcha drinkin
rechka_rhine: install ubuntu if mint is confusing
ivanfremn: he codes inside of a freezer in order not to overheat
gigafact: https://antergos.com/
arxenixOW: @tomcr00s3 did you do google ctf?
inoahdev: do you twitch often?
rechka_rhine: then you just log in and open the terminal
rechka_rhine: and read the tutorial I sent you
rechka_rhine: or just use the macbook
gigafact: @inoahdev follow the stream to get notification when he starts streaming!
rechka_rhine: macos is easier and the terminal works exactly the same as on linux
metatlas: Coding Alpha Zero?
metatlas: Or something simpler?
slaterusa: real 1337 folks just write their own BIOS in assembly at boot-up and take it from there. Anything less, and you might as well be a secretary at Walmart HQ
yyube_: K, I really want to learn Linux
rechka_rhine: windows has a completely different terminal
gigafact: @slaterusa haha
yyube_: Windows seems like it sucks ass at everything programming related
rechka_rhine: if you learn the macos terminal, it's pretty much identical
yyube_: And Linux is really open source
ivanfremn: slaterusa LUL
Dsplits: For linux is mostly Unix commands that you need to learn
ivanfremn: dir &gt; ls
yyube_: Mac is Unix based rights/
yyube_: Right?
Dsplits: yeah
rechka_rhine: yes
rechka_rhine: they descend from the same operating system from like the 70's
slaterusa: all hail the BSDs
ivanfremn: but linux is not unix
Dsplits: Mac OS is not a linux distro but is built on top of unix
slaterusa: shhh
Dsplits: linux is also built on top of unix
slaterusa: let's discuss Minix! that's fun!
rechka_rhine: plan9
rechka_rhine: urbit
slaterusa: hah, e
slaterusa: ew
ivanfremn: seriously this man is on some artificial enhancing substance
slaterusa: urbit is tainted by the involvement by that alt-right mongo
gigafact: https://wiki.archlinux.org/index.php/Arch-based_distributions
gigafact: anything arch based is great
slaterusa: @ivanfremn imma guess a bit of the ol' columbian marching powder
rechka_rhine: no, if you're getting started you install ubuntu
rechka_rhine: keep it simple, stupid.
Dsplits: @slaterusa Colombia
ivanfremn: go linux mint
slaterusa: @Dsplits oh yeh, my bad
yyube_: Should I use Linux on vm or install it on the computers? Or is it just preference?
slaterusa: @tomcr00s3 what's the keyboard ur using
rechka_rhine: shhh
gigafact: dualboot is fine
yyube_: That’s gotta be a Cherry MX blue
rechka_rhine: asking about keyboard is instaban
slaterusa: yeah
ivanfremn: it depends, if you dont need to use windows for anything I would go full Linux
ivanfremn: In fact I've tried many times, and failed
gigafact: ^ if you don't game you can go full linux
yyube_: I need windows because my brother shares PC and likes to play games
gigafact: dual boot then
Dsplits: use a vm
alluxua: I feel super interesting right now. Let us see how good geohot is!
yyube_: dual boot or VM?
ivanfremn: dual boot
rechka_rhine: dual booting would be hard for you to do
gigafact: ^wat no
joker2k999: lol
slaterusa: i always wonder if there's a market for a c64-form-factor pc-in-a-keyboard running a super-locked-down BSD walled-garden thing. Don't be stealing my ideas, brehz.
metatlas: Yeah, great idea.
metatlas: Do it!
slaterusa: thx
slaterusa: will do
metatlas: I'll buy.
yyube_: I know how to dual boot lol
metatlas: Just make sure I can make games with it.
yyube_: It’s whether I should or not
rechka_rhine: then why shouldn't you lol
ivanfremn: if you are gonna do everything on linux then dual boot
rechka_rhine: vms are slower
slaterusa: @metatlas nuh-uh. as i said, super-locked-down ;)
rechka_rhine: annoying to use
rechka_rhine: unless your computer's really fast
ivanfremn: there is no point in wasting resources on running two OS if you are just gonna use one
Dsplits: Just use a vm.. dual booting can fuck up your pc
ivanfremn: resources as in RAM and CPU
dorkmo: you did f2 to f4
ivanfremn: Dsplits how is dualboot gonna fuck up his PC?
metatlas: @slaterusa but the c64 could make games.
gigafact: @Dsplits dual boot does not fuck up your pc dumb people fuck up your pc
yyube_: I have an i7 4790k, gtx, 960, 8gb ram.
joker2k999: this is like gameboy chess
slaterusa: @metatlas talking form factor, not capabilities
yyube_: I don’t know if that’s fast or not
arxenixOW: is it playing against itself or against another AI?
yyube_: It gets the job done
metatlas: games for the same platform, not a full dev environment.
rechka_rhine: in visual basic
metatlas: so what are the capabilities?
rechka_rhine: to backtrack the IP
joker2k999: shoutout to black
slaterusa: @metatlas no viruses..? :D and also runs mail/web/openoffice / w/e
slaterusa: gheweee
metatlas: So kinda like an iPad?
gigafact: svg is great
slaterusa: @metatlas but with keyboard!
metatlas: I see. Yeah sounds good.
rechka_rhine: ipads have keyboards
slaterusa: @metatlas so, keyboard with an hdmi out, plug in screen, a winner iz u
metatlas: I think devices which don't connet to internet might be coming back.
slaterusa: (mouse via bluetooth)
ivanfremn: my toaster connects to the Internet
rechka_rhine: I don't think so
Dsplits: yes
joker2k999: no
Networks: I used to have a friend whose botnet was comprised mostly of microwaves
slaterusa: i keep losing connection.. lost chat
rechka_rhine: "a friend"
ivanfremn: I putted a bluetooth dongle on my dog
ivanfremn: now I summon him with a phone app
Networks: ill never admit to nuthin
rechka_rhine: good
rechka_rhine: you smaht
rechka_rhine: you loyal
gigafact: @slaterusa put your home router in bridge mode use some good router to keep connection up isp routers are trash
slaterusa: let's compromise ivan's dog-dongle
rechka_rhine: buy yo mom a house
slaterusa: @gigafact already have that setup. i think my housemates are abusing the bandwidth :/
joker2k999: i love this....George wakes up... I'm going to play chess today....no, wait, I'm going to write my own python chess AI program to beat me. #Winning
gigafact: lol if the setup is proper connection never dies
Networks: It's all fun and games until ivan's toasting is sending spam emails and mining shitcoins
ivanfremn: fml, just realized it is daytime again, should I sleep ?
Networks: toaster*
metatlas: compile the linux one for mac?
metatlas: if it works on linux, it should work on mac.
yyube_: Pfsense routers are lit
gigafact: Arch linux lol
slaterusa: @gigafact doesn't die, just slow. 7 housemates, welcome to San Francisco
tdools: @metatlas "should"
slaterusa: [insert linux distro name] linux, lol!
ivanfremn: Kanye West Linux
gigafact: use livestreamer and buffer the stream
rechka_rhine: @ivanfremn check out this website http://138.68.63.25:8000/
ivanfremn: that seems like a legit one
slaterusa: lol
idocrackforaliving: that site creeps me out
ivanfremn: clicks
slaterusa: everyone wants to be Mr. Black
rechka_rhine: @slaterusa his IP is 104.244.27.35
rechka_rhine: the rest is up to you
joker2k999: wuut? you don't know how to play chess
rechka_rhine: or maybe it's 88.200.98.58
rechka_rhine: hack them both just in case
rechka_rhine: hopefully the dongle is on there
Dsplits: lol
Dsplits: DDOS
rechka_rhine: that's not hacking
rechka_rhine: gotta start off with an nmap -p-
idocrackforaliving: its a ghost
joker2k999: the weeds kicking in
gigafact: too much lsd
Dsplits: oh shit.. home invasion
slaterusa: we all know the one true hacking is that kid who does a tracert and says "yeah this is hacking!!"
joker2k999: because the home invaders always answer back
slaterusa: @tomcr00s3 meeting with whomst?
idocrackforaliving: ur typing is satisfying
slaterusa: what on earth
ivanfremn: https://bit.ly/2ltR6vY
rechka_rhine: oh no
idocrackforaliving: i wouldnt click on it
rechka_rhine: gotta warm up the tor browser for this one
ivanfremn: Only the brave will take the risk
joker2k999: nope...
tdools: *opens dev tools on chrome* yea I'm a hacker Kappa
rechka_rhine: you can't backtrack me son
gigafact: http://www.wheredoesthislinkgo.com/
rechka_rhine: lol
slaterusa: only the brave will add a " " to a bit.ly link and see where it actually goes to...
rechka_rhine: ^
rechka_rhine: we have another hacker in our midst
gigafact: I am sure there is a hole in twitch so you can see all personal information of all people in here
ivanfremn: there has been 4 clicks on it
ivanfremn: yall ar part of my botnet now
rechka_rhine: I literally dox'd myself if you scroll up in the chat
rechka_rhine: but that's besides the point-
idocrackforaliving: i use a vpn
joker2k999: yesterday..
idocrackforaliving: #norisks
slaterusa: ..all my troubles seemed so far away...
rechka_rhine: all vpns are run by the NSA as far as I'm concerned
rechka_rhine: and really, you should call a proxy a proxy
slaterusa: don't use VPNs, then. Sorted.
ivanfremn: dat moment when the FBI asks PIA for your data and you already paid 10 years in advance
joker2k999: damn. that was quick
joker2k999: ..thats what she said
tdools: mdyGG
slaterusa: bad html, that's why
rechka_rhine: that moment when you make a honeypot and tell the FBI to drag you to court so you can tell everyone you don't have logs
joker2k999: next level server game bro
slaterusa: lol how do i html
idocrackforaliving: the image is scuffed
slaterusa: namespace SVG issue?
twitchinstl: Open developer tools and turn off any file cache in’s
joker2k999: autoreload?
slaterusa: lol broken image
idocrackforaliving: i think its the image
slaterusa: look at the source
slaterusa: huh.
idocrackforaliving: oh &lt;/img&gt;
slaterusa: wtf img tags don't need to be closed
slaterusa: or at least don't need closing &lt;/img&gt; dubya tee eff
idocrackforaliving: oh ya
idocrackforaliving: weird
slaterusa: or maybe some bizarro SGML-y thing
thisisweeezy: html is real programming
hartator1: should be onClick
thisisweeezy: damn, next level shit, import jquery
rechka_rhine: missing quote
rechka_rhine: onclick
michiamozen: "he's probably missing a semicolon"
rechka_rhine: wtf is big tag
thisisweeezy: &lt;BIG&gt;
Dsplits: import bootstrap
idocrackforaliving: thats what she said
thisisweeezy: this is great: python   jquery   html in .py
idocrackforaliving: stole ur joke
dorkmo: &lt;BLINK&gt;
hartator1: lol blink
thisisweeezy: omg
kabiroberai: The double quote in .post interferes with the onclick tag
dorkmo: &lt;MARQUEE&gt;
thisisweeezy: &lt;template&gt;
thisisweeezy: vanilla js
idocrackforaliving: blinks xd
thisisweeezy: high level front-end skillz
gigafact: hahaha it's so bad
dorkmo: party100
thisisweeezy: party1
thisisweeezy: yeeeeeah
yyube_: Those chess moves tho lol
thisisweeezy: moves yeaaaah
Networks: type="Submit"
thisisweeezy: submit yeeeaaaah
any_available_username: yeeeeeeaah
thisisweeezy: ooooh yyyeaaaahhhh~
thisisweeezy: &lt;BIG&gt; yyyyyeahhh
thisisweeezy: &lt;BIG&gt; font &lt;/BIG&gt; yeeeaaaah
imaginepeanuts: what language are you programming in? this is super impressive! i'd love to properly learn how to code one day
thisisweeezy: goal1
gigafact: python and start soon
alluxua: shamrock1 shamrock1
thisisweeezy: YEEEEEEEEEEEEEEEEAH~
3dvinci: Everything is gonna be alright
tdools: python is great to start with @imaginepeanuts
demonaso: i find python to be too hard for starters idk
gigafact: @demonaso false
alluxua: shamrock1 shamrock1
imaginepeanuts: i'm majoring in computer science starting this fall actually. i can check super quick what language the intro to cs class is
demonaso: prob c  
thisisweeezy: smoke some weeed and write python!
thisisweeezy: pride1
alluxua: Python is super easy. You can crack it in 4 weeks if you code 6 hours a day
3dvinci: Intro probly Java
tdools: @demonaso c   hurts mah brain
imaginepeanuts: They start us off in python
3dvinci: Interesting
imaginepeanuts: yeah i honestly thought it'd be java...but the university im going to is supposed to be super tough so
idocrackforaliving: harvard
imaginepeanuts: they're probably starting us off in python in order to weed out people sadly
gigafact: super tough LOL
dorkmo: i think its about time for a yerba mate
imaginepeanuts: not harvard @idocrackforaliving
thisisweeezy: YEEEEEEEEEEAH
imaginepeanuts: gt
thisisweeezy: party1
Crabtr: We're webdevs now! Kappa
gigafact: it only took 4 hours to get to this point
idocrackforaliving: if you do real crack you'll go to harvard
tdools: mdyLUL
alluxua: Harvard even doesnot offer deep learning for undergraduate
thisisweeezy: real webdev brooo
idocrackforaliving: sad
michiamozen: Nf3
idocrackforaliving: an ai that creates its self
michiamozen: maybe
michiamozen: try Nf3
thisisweeezy: ohhhhh nice
thisisweeezy: party2
michiamozen: me me
idocrackforaliving: nope
tdools: next step, how to chess mdyGG
thisisweeezy: grand master in the making!
michiamozen: he lost
michiamozen: rip
michiamozen: what
tdools: GivePLZ MrDestructoid TakeNRG
Autokriator: bishop to f7 and you wouldve won
alluxua: Geohot lost?
michiamozen: Bc4 to f7 and it could been game
michiamozen: Nf7
thisisweeezy: this is real twitch shit -- live streaming competitive sports: chess
michiamozen: the delay....
thisisweeezy: noooooobs
idocrackforaliving: 0-0
imaginepeanuts: so do any of you guys code as well ?
idocrackforaliving: ya
michiamozen: try o-o
imaginepeanuts: self taught?
idocrackforaliving: i did courses
tdools: same
thisisweeezy: 000000h!
imaginepeanuts: nice man
alluxua: I went to the top university with full scholarship, but learned nothing. Most of my knowledge and tech skills from long term self learning
thisisweeezy: nice commit message
gigafact: you learn yourself only way to be the best
idocrackforaliving: true
idocrackforaliving: im shit at coding
3dvinci: CS is the best field for learning yourself via internet
imaginepeanuts: i agree. even though i'm going into georgia tech this fall, i'm not naive enough to think that i'll become a great coder by just going to classes and doing homework
imaginepeanuts: it probably all comes from doing personal projects like this guy is doing rn
gigafact: George did a lot of other projects as well
gigafact: a lot
dorkmo: do you need ajax to stop the refresh?
3dvinci: Yea its all about what you've made
tdools: with any profession, it requires experience. and to get experience you have to go out on your own for the extra mile
alluxua: Georgia tech is very good at academic research, but not on application
idocrackforaliving: it would be amazing to go to m.i.t
imaginepeanuts: ahhh mit rejected me :((( its fine its fine
dorkmo: https://stackoverflow.com/questions/4285042/asynchronously-load-images-with-jquery
alluxua: Mit undergraduates CS classes are all on openware website
idocrackforaliving: ah ha moment
imaginepeanuts: I hear Harvard has a really good intro cs class online
3dvinci: CS50
alluxua: Harvard intro is on edx
3dvinci: That was the first thing I ever did wrt coding - years ago
thisisweeezy: party1
hartator1: yeah money
thisisweeezy: cheer1 oh yeeeeeeah $
idocrackforaliving: ho doesnt LUL
hartator1: why not using 2.7?
gigafact: you got a lot of donations on this stream
3dvinci: weeezy has a good strategy
gigafact: quite a few subs and bits
thisisweeezy: $ cheer1 $
vicious503: cheer1
alluxua: If you do love money, let us code LSTM on tesla stock price predictions next twitch
dorkmo: goal150
3dvinci: I'd watch
thisisweeezy: goal1
imaginepeanuts: tesla stock is literally a rollercoaster
thisisweeezy: goal1 50
thisisweeezy: lol
3dvinci: Elon based
thisisweeezy: twitch is a scam
gigafact: George you need to setup https://streamlabs.com/ they allow custom donations. A lot of streamers use it and you can set donation goals and so on
thisisweeezy: goal1 0000
alluxua: Geohot is in deep love with Tesla
tdools: @imaginepeanuts back test it on enron Kappa
dorkmo: goal1 0000000
thisisweeezy: Goal 11 0000000000000000000
thisisweeezy: goal1 000000000000000000
3dvinci: lol
thisisweeezy: goal1 000000000000000000000000000000000000000000
thisisweeezy: failed
alluxua: @thisisweeezy , you are damn adorable
idocrackforaliving: !cheer 5
idocrackforaliving: oof
idocrackforaliving: cheer5
idocrackforaliving: oof
thisisweeezy: thank you, yeeeeah, adorable
thisisweeezy: i can be geo's twitch language interpreter
gigafact: what was the peak viewers on twitchslam?
imaginepeanuts: does he have a twitter?
thisisweeezy: this probably has more
gigafact: @comma_ai twitter
thisisweeezy: twitter.com/commaai
thisisweeezy: commaai.com/rapgod
gigafact: ^bad urls
dorkmo: the only way to win is to not play
thisisweeezy: or go to pee for hours
alluxua: Twitch geohot is the best, periscope version is quite business, Twitter is fully marketing
thisisweeezy: oh yeeeeeeaaah
thisisweeezy: grand master
Autokriator: Is the training based on human games?
thisisweeezy: live from twitch
gigafact: improve quality how?
thisisweeezy: game collected from toddlers
alluxua: I think the training data is from human players
thisisweeezy: good job
thisisweeezy: documentations broooos, the most important part of the project
thisisweeezy: party1
idocrackforaliving: this is gonna be on github?
thisisweeezy: party1 000
gigafact: it's already
idocrackforaliving: oh
imaginepeanuts: this is some intense typing
thisisweeezy: github.com/geohot/twitchess or something
thisisweeezy: it's the keyboard
gigafact: https://github.com/geohot/twitchchess
idocrackforaliving: ty
imaginepeanuts: that's why i have a love hate relationship with mechanical keyboards. they're satisfying but also so loud sometimes
dorkmo: its gotta be the shoes
thisisweeezy: it is the shoes
thisisweeezy: ye shoes
thisisweeezy: party1 00
thisisweeezy: yall have a good night -- just in case geo peace out quick
thisisweeezy: party1 0000
dorkmo: twitch chess coin ico
thisisweeezy: raise b$llion$
alluxua: Your model is way too simple, the layers, Learning rate, kernel size never tuned
thisisweeezy: needs no tuning
alluxua: His model learned nothing
dorkmo: mspaint
thisisweeezy: learning yo party1 000
dorkmo: learning yeaaaaaaaaaaa
alluxua: I missed the loss function piece. What loss function he used?
thisisweeezy: hah
idocrackforaliving: xd
thisisweeezy: documentations yeeeeah party1 000
thisisweeezy: oh yeaaaah oh yeaaah MIT
thisisweeezy: yeahhh MIT yeaaaah oh yeaaah
dorkmo: party100 000000
thisisweeezy: party1 00 00
kabiroberai: What do you think about the current state of the iOS jailbreaking community? (If you’ve been keeping in touch with it)
thisisweeezy: it only take FOREVER to train
alluxua: Can anybody help to explain why he is using conv2d for training? I normally use reinforcement learning for this type of stuff
gigafact: you need CEO Nvidia V edition :D
thisisweeezy: oh yeeeah party1 0000
Networks: are you going to stream tomorrow?
idocrackforaliving: couldnt you create 1000s of simulations
gigafact: https://blogs.nvidia.com/blog/2018/06/20/nvidia-ceo-springs-special-titan-v-gpus-on-elite-ai-researchers-cvpr/
thisisweeezy: hopefully by tomorrow, it can actually beat toddlers on chess
idocrackforaliving: nvidia is a scam
idocrackforaliving: LUL
thisisweeezy: GPPPPPUGE
thisisweeezy: beat these caaats
alluxua: Bro, I buy a lot of nvidia stocks. It is pretty good
thisisweeezy: haha
idocrackforaliving: dog is chill
thisisweeezy: so fuuuuny
thisisweeezy: defense brrrro
thisisweeezy: click click click party1 00
any_available_username: write it
thisisweeezy: tomorrow morning?
upsidedownlemon: yeah write it
upsidedownlemon: won't take too long
gigafact: write won't take too long...
alluxua: Yeah, write it! It is fun!
gigafact: maybe a few hours LOL
thisisweeezy: a PM, "it's not gonna take that long"
aziid1: stoopid
thisisweeezy: "aint it?"
thisisweeezy: javascript ninja
gigafact: what time is it there?
idocrackforaliving: its 1:46am for me
thisisweeezy: for me too
alluxua: He is in SF
aziid1: why not just shove everything in an RNN and call it a day, aye
thisisweeezy: ayyye
idocrackforaliving: 10:46pm 4 him
dorkmo: my laptop battery is going to die in 20 minutes
gigafact: connect to wall?
thisisweeezy: buy TSLA battery
idocrackforaliving: LUL
gigafact: TESLA for unlimited laptop life
thisisweeezy: gigfactor for your macbook
idocrackforaliving: *kills the pc instantly*
thisisweeezy: gigfactory
gigafact: 100KWh battery for laptop rofl
aziid1: clickety clackity clickety clackity clack clack
dorkmo: brb brushing teeth
aziid1: clickety clackity o no clickity clack
thisisweeezy: ooooh noooo
any_available_username: lmaoo
aziid1: click click clack clack clack
aziid1: im narrating for the hard of hearing
thisisweeezy: party1 00000
idocrackforaliving: the matrix
thisisweeezy: does anyone here has real job tomorrow lol
thisisweeezy: party1 000 0000
aziid1: u gotta do contracting, can charge more and work when you want
idocrackforaliving: PogChamp
alluxua: I do, but I work remotely
gigafact: better job than donating 1 bit at the time all stream lol
aziid1: might work tomorrow, might not
idocrackforaliving: work online
thisisweeezy: hah
thisisweeezy: so nice, work when I WANT to
gigafact: be your own boss
andrew_vy: you need to set an id on the element
aziid1: be your own bitch more like
gigafact: win in life
thisisweeezy: $buy $TSLA and chill on a beach
alluxua: I write ML to predict stock / crypto prices as side project, so kind of pretty free
idocrackforaliving: buy spacex and chill in space
thisisweeezy: nice
aziid1: if it worked it wouldn't be a side project
gigafact: @alluxua any good?
thisisweeezy: it could the next stream: ML predicting TSLA
thisisweeezy: lol
idocrackforaliving: can i buy america PogChamp ?
thisisweeezy: it loses ton of money party1 00 lol
aziid1: geohot do you always talk to yourself when working
alluxua: So far, 6 months, the worth monthly return over 60%. So pretty happy
aziid1: @tomcr00s3
thisisweeezy: 60% seriously?
3dvinci: Nice
idocrackforaliving: who doesnt take to them self
idocrackforaliving: talk*
thisisweeezy: BUY TSLA
thisisweeezy: yeeeeeeeeeah
alluxua: Well, if you hedge bitcoin, etherum with Costco, Netflix , google etc
gigafact: TSLA was up now it's a bit down
gigafact: BUY AMD
thisisweeezy: buy comma ai
gigafact: Thank you for the stream!
thisisweeezy: yeeeeeeeeah thank you party1 0000
any_available_username: byeeee
gigafact: This was fun
3dvinci: gn
aziid1: its only 11 pm bro
thisisweeezy: later party1 ,000, 000, 000
gigafact: almost 5 hours streaming
gigafact: good
thisisweeezy: thanks broooos
dorkmo: heyguys48 0000000
alluxua: Thank you, geohot. You are always wonderful even I feel you should polish your deep learning skills. No matter what, thank you! You motivated me a lot!
thisisweeezy: order another curry from thai
gigafact: it will be uploaded on youtube soon
aziid1: can you stream work on comma ai
thisisweeezy: it's great already go sleeeeep yeeeeeah
any_available_username: so lets sync our sleep schedule, how many hours you gonna sleep ? Kappa
nic0latesla: thank you geohot
thisisweeezy: lol
thisisweeezy: that's 3 more move than I do
thisisweeezy: smashes the subscribe button
any_available_username: :(
thisisweeezy: geo thinks 3 more steps of whore
Networks: This makes me miss the shkreli coding streams
aziid1: shkreli coded?
Networks: Yeah, he was doing NodeJS stuff
aziid1: i liked his stock analysis vids, learned a lot
Networks: with sockets and stuff
aziid1: y tho
thisisweeezy: nice profile picture
idocrackforaliving: geohot
alluxua: I love geohot profile picture
thisisweeezy: shoot for the star land on the moooon
thisisweeezy: party1 000,000,000
Networks: toodles
[Music]
you
you
he's beating again
but I was bought
check
all right
[Music]
[Music]
[Applause]
[Applause]
you
you
[Applause]
[Music]
[Music]
[Music]
here I just don't know what to do I got
a private box video been raised
I have Fujitsu Internet the cloud
no it's just faster before I don't know
like do they throttle you if you stream
why is this going red
I don't even know okay it's dropping
frames it doesn't have upload bandwidth
Oh much upload bandwidth streams good
now ah cool
is it there's my dad garbage it's better
to have my own cloud now not that
garbage upload it still lagging if it's
still lagging I just give up alright
alright am i stupid y'all hang on let me
login down here I'm logging into my
phone so hopefully I can get the chat on
my phone you know
good yes as a touch bar
request SMS oh no I get as a mess no
okay
Oh lovely oh god I hate when it lags all
right now can I get the Arden get the
chat on here Oh
stream chat okay now try saying
something hello
touch bar is a meme oh yes okay
so let's pause this to save bandwidth
perfect I feel like we got a setup going
now
alright so where was I with twitch s
yeah see I can read you I can read you
things on my phone I don't like that I
can't really see my own stream and go to
OBS and I can see it there's me hello
I'm in a private box you can tell them
I'm in the cloud cuz it's all wait
talking is hard though it's weird I
haven't talked in a long time stuck in
this cloud for a while
I do watch myself there I have a problem
you know some people are addicted to
crack cocaine I'm addicted to Maris so
this is what the new new mod that I
added
made it much slower like cookie so the
reason it made that move it's because
the value function now values of a lag
is okay as long as it's not like she lag
is a couple of seconds it shouldn't lag
I just don't do that okay so this is a
very slow value function
when I remove that well how much faster
it's a bit fast so I just legal moves
count but it's not any better
let's read the code to Python chess
deckers so in that Wikipedia thing where
it talks about chess evaluation
functions they usually talk material
mobility King safety center control
doubled backwards and isolated pawns
hotel Wi-Fi test calm
whoever books your hotels what I live on
the cloud gross deep learning the scam
Center control but what is hotel Wi-Fi
test calm I was googling metro station
yes my lease is by there well not a
hotel
loving the cloud
yeah I looked at that project Euler
thing with the hexagon so hard we could
try to do it I also know if project
Euler wants me streaming their shit like
chess I can stream their shit cuz no one
owns chess but I respect project Euler I
know they don't like when you would
answers online some material mobility
that might be pretty decent let's see if
we can figure out a way to speed up
legal moves
I'm going to turn off the numb of nose
you've explored
I'm monotonic in fractional seconds new
in version 3.7 watch
okay
no but see now it explores a lot more
moves let's see that took seven seconds
wow what a long time to move
all right should be right out for beta
search alpha beta pruning twitch
guys if we get too many people in the
twitch then he won't be like chill I
don't know I mean I live in the cloud
now I don't know if I should stream back
to earth from the cloud everything's so
quiet here yeah I was disappointed with
the brave I tried very peaceful are you
so far I happen using Safari though that
actually works
okay
we're gonna get a string this isn't that
no I can like convert the board into
like n
I have some stuff about this in state
just say board got serialize thank you
interesting way that that's well then
does include the turn right
turn castling Park episode squared half
of Glock and it'll move number right
cool when the full move number does that
matter
Aisling rights are important
EP square
cool that's pretty good
so now what we want to do is we want
them you always based on that self-doubt
mimo subkey faster
don't even know that actually might be
slower another thing called LRU cache
let's play it
let's play it with the new addition to
the value function
okay it likes to open like that
what are you guys talking about this is
a pleasant stream there's only love in
the cloud okay all we have is love you
guys want to play chess I'll commit it
you guys can ply write that wrapper
nicer
it moves queen out
you can see what's thinking down here
I'll move this
bro don't you know about now moving your
queen I'm gonna defend that pawn let's
go there we're tagging this Queen now
it's exploring like to apply deep I do
think we are gonna need alpha-beta
pruning okay I mean you put me in check
so at least I can't take his queen will
block the check with the night no if we
block the check with a night he can just
take it back and I'll double up my pawns
let's go here and then we'll take with
the night he takes it should be a stupid
law because he were just was official
there's a stream quality good oh you
really gotta think about that one knows
Tommy just lost a bishop I think
now most always queen
I'm trying a little bit harder chest so
the calmer here in this private box
there are other processes constantly you
know thrashing around I always get some
King safety here it was a little bug
down
if you shouldn't be moving as Queen he
developed none of his pieces
traditionally when you think of Chas you
think this is terrible chess so really
good enough chess player to like exploit
the bad moves that other people make you
know I'm saying
okay let's move in with an attack
you know canceling doesn't take two
turns it just takes a turn to update the
thing
I know that good at chess yeah but I'm
better than put just it's also thinking
for a long time now this guy's just
moving as Queen everywhere there's some
new bad shit I'm reminded again why
streaming is exhausting and the
conversations here are exhausting so
peaceful in the clouds look at how white
everything is it's beautiful
Connect which glut chest to a powerful
cloud I mean I could put it on a on a
box with more course but really probably
the idea would be to like get a real
evaluation function here
I think according to his evaluation
function he's beating me notice how it's
looking and saying negatives their
reality this is terrible chess
hmm
thank God you guys are really exhausting
thoughts on Jordan Peterson all talk of
anything remotely culture war-related is
band dad forever the culture war was the
dumbest thing that I ever spent any time
thinking about
I'll say I forgot how exhausting
streaming to you guys was and reading
that chat I'm just playing a peaceful
game of chess against my computer which
isn't very good yes all right so it's
exploring like 5,000 notes it has kind
of a shitty value function I'm going to
move Queen d5
I can't move Queen d5 there's a bishop
in the way I also can't move Queen da
Queen da would be checkmate though I
agree
all right let's you know you're gonna
bait him no because if he takes that
with the night then if you took there
with the pawn it would be checkmate but
mm-hm go here let him take the bishop
now he admits um winning yeah queen d8
was checkmate but when
Oh today I already uh did I move that
bishop recently alright mate and one
unless he moves you can see over here
how its evaluating stuff
oh my god wait what that was actually
he's really good
their only choice is to move there
well guys really bad Jess yeah
travels
don't think I lost
it's the head that was really not bad or
I'm just that terrible
pen is mine
oh I did go from winning or losing
according to twitch s you're right
there's no those chests I call things
where does one a night didn't I
thank you thank you for subscribing
how's he threatening my queen standing
my queen
how much is a subscription things like
that TV stupid hanky stupid
she's gone from the pawn next to the
castle on the left
it's Batum but come on free night take
your free night bro
mmm good lord I don't know
this guy doesn't think a lot of moves in
advance look I'm winging again take that
toward your chest
Oh guys I'm in the cloud
I can move at the speed of cloudless I'm
in check our line
I'm no king safety
it was move there yeah
we take
shouldn't move that stupid night don't
know why I did that wasn't gonna take it
no stupid debate him howl da dick Cathal
da
yeah boy
mhmmm am I gonna get checkmated I feel
like I'm gonna get checkmated wait if I
go there I lose if I go there he was a
queen there and I lose I can see only
those I can go though I just lost oh my
god nobody beat me I can't move the
night I'm in check I think the only wait
do I have any legal move except for Ji
Won
if I lost I have no legal move beside g1
right
I can't block jack I can't take the bash
up yeah that's my only move I let's see
if it doesn't the only will move no but
I lose because he was the queen it was
the queen to cheat oh where he's stupid
g2 was checkmate
I mean is it doesn't matter now okay so
I can't move there I can't move there
well no but no he's an idiot cuz now I
can go there that was dumb he had me
it had me
checkmate
well
stretched as a woman alright so it had
me be I don't understand why it didn't
see the check man I should have seen it
okay
okay so first off this is poorly written
nice you want to learn flask is flask
faster well it is faster but part of the
reason why I actually has less to do
with the evaluation function what do you
do with the effect evaluation function
has
about 3,000 per second put that add it
back in it's about twice as fast and if
I go to test three what tool do I don't
learn to use flasks
no I'm gonna code openings I don't a
stack oh look I want to be able to beat
me my node isn't your kind of in the
cloud guys the cloud say I like I like
my laptops I can look at myself when I
do that the cloud the cloud so we can't
go three depths that's right
like this is kind of the same logic
what I'm doing life advising streams
anymore
should be correct
can I give you an estimate on when shits
gonna happen yo you guys ever heard
about February let me tell you what is
gonna happen
never
in everywhere yeah yeah
that better way to write this oh no what
time is it in the cloud and times in the
cloud time zero zero like you want to
type date what date is it in the cloud
you mean
get brows I don't know we're watching
right now say Stevie Tom please 51
people or not people it's time zero in
the cloud
hmmm this might be the wrong this might
be the wrong logic
yeah the turn
Oh God halt
yeah be down resolve can't just say this
maybe this time either then a little
evening
that's right
take one movie advance go high weird
time
stupid
how's it they both want to force a draw
in that situation one day I can clearly
see the draw coming right
I don't understand mom thinking enough
was in advance okay so if I've depth to
I search my move and then my opponents
both depth three okay well at least know
my could we've refactored it so we can
write alpha beta pruning negative next
max well if maximizing player negative
max pay equals max a
that's a rat if a is greater than or
equal to B then break this is all the
since this is easy I only left exactly
why this little split
right this the a cutoff be
no weed in the class
maximum recursion depth exceeded
oh you see the problem
let's put this here that's faster
quality minimax service who loves
minimax or alpha beta
think about why this works minimum score
that the maximizing player is assured of
maximize player need not consider
further descendant of this note all
right let's think about why this is
correct
oh yeah
okay I play one more game
it really likes moving that Queen out
fast I don't know what in chess is
supposed to discourage that but it's a
general rule of thumb not to move your
queen out fast develop your minor pieces
don't fuck okay I just do that there's
down a bishop that was upsetting me
stupid mm my pawns protected
oops take that pawn now need to focus
just gonna take my rock
doesn't take that ponds fine we take his
pawn from you know the Queen - now all
my queen
no I know
well that's okay so let's think about
that so you're right that's why yeah I
guess it would wouldn't do that if it
could see more moves in advance but a
camp because it would see like moves in
advance that I'll develop my pieces and
it'll do shit
it won't do shit
straight queens of wands
turn the fork does it no the fork
you know the fork
and sleep on
no I can't take that
I was just so stupid okay blunder
tonight blunder on the check
oh my god so dumb so dumb
flus all right
I mean it got better at the end there
let's let's not give it a max Jack let's
just say if V dot count is greater than
10,000 you got count down and this isn't
actually very good
yeah see that's why it's not good chess
seven see what we get
now okay so the thing is called
acquiescence search
Christmas search typically is a value
many Mikes game trees
interesting position it's to a greater
depth activity
Hey
a fan running off I don't know what I'm
going to go to that people spot it's
like never gonna finish it and now we're
going to finish it
yeah I've written all these things
before the bet was the bell of my friend
was that I couldn't write something that
could beat me a chess within a day like
honestly my time here is it's not really
exploring any position that's right oh
there we go it got to seven
oh look it found oh oh look at found e4
oh wow a good wolf yeah I know don't
have the norm against new folks I have
No
let's see if it still makes those stupid
Queen moves
in this book
okay
Cyril starts to play game just like
toilet papers games are measured implies
well this is really thrashing my
computer here so we're only exploring
like 2000 positions per second
yeah
so modern chess engines are exploding
things
Wailea way faster than I look at still
making these stupid Queen moves can't
see bad it multiple ply
yeah okay so alpha-beta order depends a
lot
in order deepen a yeah
well I understand why it's called
quiescent this makes sense extra search
is just called a quiescent search
one possible approach to forward pruning
is beam so much okay
so I've heard this before well that's
taking too long let's just say here just
depth one hey depth is less than three
or def 307 but realize that that will
like waste things make it right beam
search pretty easily
okay more game let's play improve to
twitch chess this one should be very
good except it should take a long time
that's the problem
your Python chest at any closing value
functions
yeah almost
is it quiet
well that's a normal movie the name take
a real people move
that's a much more reasonable chess
position now all right
actually I don't think that is a people
move cuz that'll people move is that a
real opening chests our common lady like
the table
now it moves the same piece twice on the
opening this is stupid and this is
really slow annoying to play against
you know it explores a lot of nodes now
that's not good
so what
you know get this thing this is a system
I'm gonna play this game yeah
all right so just doing it back to
something that's playable
so what are our options here and I say
vices itself
well doesn't update the board
I think it used to play really fast that
was okay yeah the value functions
garbage it can't explore many nodes
you're probably right beam search beam
search just prunes off a lot of bullshit
quickly
and this value functions are swaying
back and forth like crazy
I'm the queen
clean runs away with the works besides a
Kevin I
the worst game of chess I've ever seen
played move the King 1 square yeah we
could rewrite it and see to make it
faster promise this chest thing is an
inherently Python thing with black
barely moved any of their pieces yeah I
don't know were you writing in C doesn't
sound fun that might be it for twitch
chess the answer is you probably need C
you know it's just Google number apply
chess versus raid I don't write it and
see that's not shitty
five ply
right now it's only thinking two to five
line
sports pipe I through install pi PI
yeah I know it'll be faster in any
language except for Python but I only
know how to code Python why is Python
swap so apparently if I can get this
thing to work at five ply
that's stupid class the state class is
kind of a stupid class okay I mean
I only need like three packages I don't
really need torch
that one I have less hope for my work
using on by cerium let's function we're
gonna need that are there see your fish
alright so I think we can actually make
it beam search quite easy
if I press faster
we trained for that oh look at that pipe
I speed up five high school fast
I don't understand why I like that craps
there that's different
I thought Python oh is it for some
reason
if he's not greater than C if it is fast
I think also it helped the way that I
pruned okay let's see if now we can go
five play deep no Popeyes is like five X
faster Wow that pie pie speed bros okay
[Music]
whoops yeah
depth greater than search what fast is
that oh yeah I got to do with pie pie
I don't know what you're asking what you
want to ask how to learn things and how
to be good at things what are you asking
me for go do things step one
don't be a noob step 2 commit to not
being a noob for the rest of your life
are you committed to not being a noob
for the rest of your life I commit to
these things you know do you guys see
the board really okay now it's thinking
five plies deep according to that reddit
post if you think five plies deep you
are Chazz master Dan at college I was
pretty stupid
you gotta commit your life to not be in
a noop a lot of people go through life
thinking about you know what other
people think about them whether they're
gonna get married or whether they're
gonna have kids
or you know all who they're gonna
disappoint or all that shit man you
gotta just put it out of your mind and
commit to not being a newt not for
anybody else but for yourself because if
you can't commit to not being a noob for
yourself then I don't know what you're
doing with your life
okay this is a decent see where it moves
the night it didn't move the night it
just put me under check oh my god I
messed up he can now take that thing
with his queen no not anymore
that was stupid can I now take his night
oh no it can't because I'm in check okay
I don't see anything wrong with that
do I play rated chess regularly not
really what I do is like a 1500 I played
on chess comm 1500 and I like at 1300 of
let's 1500 for longer games I don't know
like I still don't trust that the
machine is any good at all so I'm not
like trying you know that hard like if
it starts to really surprise me then we
got to play a lot harder wait a second
but I take your knight you lose a knight
how did you not see that it thinks it's
winning right now now it thinks it's
losing how did I not see me taking that
night
why does it think it's beating me oh I
didn't think it was beating me no look
here I thought it was beating me
position to move the night there I
probably wasn't a good move
chestnut column collects data from a lot
of noobs Oh you SFIL a lot of data from
a lot of moves is
I can't castle
that piece is under attack
on top of my pawns is fine I don't know
why everyone always writes up time like
that what I think that is
it thinks it's back to beating me
oh god wait it really like might be
if you have better ttv young having a
shit okay at least you can't threaten me
like that anymore
see I really I haven't been able to
castle
yeah I enjoy thinking five moves ahead
there
it was a pawn
hmm
I mean check if you want
oh my god you just want a bishop he's
pretty good
he's pretty good now that's guys I know
yeah to be honest he cut yeah sure who
came to see - yeah you're right
I just lost my patient didn't I this
guy's not bad
you won't exchange doesn't know about
the value of that position to that poem
you won't exchange his night for it
he's pretty good it's pretty player you
know
oops
what he's gonna do
that was stupid it could have taken your
castle but could it have
remember that but this isn't okay
they're gone all right what stink mmm
no he has the knight attacking at tail
woman check Wow okay I'm in check again
great it was you know and I was lower
because I'm an idiot
Wow such a good player such a good
player Oh does it know how to mate
why don't you check me to me it one firm
is pretty good I think we can even
probably remember that 10 is we can say
actually put it 7 game baby play one
more game let's really try my best I
think it beat me I think that this
program can consistently beat me well I
know one more game let's go I put the
search depth out to out to 7 it will
lower the beam
No
the one life advice anymore whatever
those are pretty good settings alright
let's try it let's see if it can play
the Queen okay
right now I wanted to play the Queen
opening let's see if I can play the
Queen opening it's the same move
it beeped me
so what my friend said when we made the
bet was he thinks that I could learn to
exploit its advantages like since I
coded it I can know exactly what to look
for
okay like I know this crap cuz I can't
if I go there I'm going there is
actually fun I think let's go there
what I work on I don't know okay again
this is similar this is the same way the
last game played I went there I forgot
about I don't know
well er girlfriend fear at oculus shit
no no this is very similar to how the
last games laid out
give it I don't know I don't think I can
think five moves deep or something it
loses the night again I could do that
same thing last time
if you thought it was winning and now it
thinks it's losing okay I'm in the same
position I'll have this pinned bishop
okay let's I'm a human I'm supposed to
be able to like you know learn from
experience let's get the bishop on
pinned
I know it one last time that's why I'm
learning from experience like a human
Kapaun
I still have not succeeded and unpinning
there
it's gonna move the look there I think
ya likes that move
but if I move the Queen right there it's
fine
stupid
I'm gonna do that
just traded or work for okay now I don't
think it's a depth problem now I think
it's a value function problem um so you
guys see with the value functions coded
you can improve measure taken with the
Queen they did
how can it check Mamie
explain to me the checkmate that I
missed
and queens under attack
about pieces
what it Forks my shit bro I hate when it
Forks your shit
worked my shit
okay let's actually be smart the endgame
I want to at least say that I beat it
once so I just got my shit forked again
hate when she gets for gonna take my
poem
it's not even AI you don't get really
his guys want a life last my friend I'll
give you a life lesson is Moore's law
it's it's Moore's law just you know how
I can be crushed by this thing that's
written in Python not Kraft I said we're
we're similar in skill meat which chess
are similar in skill to fork my shirt
again hey barks my shit nice fun um who
told you more laws dead are you
listening to people from Intel telling
you about how Intel's dead that's what
I've heard I've heard Intel's dead all
right
Iraq I don't even get anything back bye
bye Brooke I thought I got out of it but
no byrock Wow I resigned yeah I know I
know it's good guys it's really good a
chance okay everybody else go try to
casually play it and beat me
go Charlie casually play it in this kind
of like time time control format
Oh
oh oh look the tricked me you see how it
tricked me right
oh yeah draw no no no it's a draw that
was actually a draw um that was a draw I
repeated the same move three times in a
row no okay I I would say that it's a
draw um I would say that twitch chess is
about on par with me I would consider
the bed over I'm not gonna waste time
racing this but you can play with the
value function no I mean it only lost
cuz it doesn't like it can't see enough
moves in advance to move those pawns
down you can fix that with like
acquiescence search like it go deep kind
of thing but I really actually don't
know why I did that it should have saw
that state but um I don't know cool guys
I consider twitch chess kind of finished
to which
brought up the GG folks GG Wow 90 people
saw me got beat by my AI so yeah you can
uh - anybody playing along at home try
it out I'm gonna actually remove some of
those requirements move this into
serialize
I should leave
they have won anything all right
what I mean that's probably after time
control I was playing
listen to interplay yeah plenty of room
movement nice - yes let's just buy that
right now
cool
[Applause]
secondly sure that works
I don't ask
and I do strike through
no neural network
I would never rinse cake scammer
call
what it hasn't came dormancy and
quiescence some weird shit about embryos
senescence all degenerates
twitch twitch there we go yeah well you
know that was twitch s and the t's
finished to look thank you all for
watching
but that tastes finished too and now
there's no more tea so you guys know
that there's two food groups in the
cloud there's our ramen and their sushi
those are the two cloud food groups so
good you know I had ramen for lunch you
know when I hit the computer whoo that's
loud I'm sorry guys can you start
reverse engineering for life I love
ramen well I'm in the cloud whoa yo is
his team den this is team 10 oh shit
please subscribe I need your money
I love money money's my favorite thing
except for
no I just love money winning
maybe I how do you get recruited as you
check ball knotted by anything I don't
buy anything to see my balcony my god my
balcony
let's go out of my balcony
you guys is a dominoes outside there's
Domino's is in the cloud more coding in
C++
no we in the cloud
WEBVTT
Kind: captions
Language: en
chto_eto_bylo: HeyGuys
ququa111: HeyGuys
DazPlay1337: aye
agesmith52: Shalom
buklao: Oof
blackburn1911: hey
stannerindia: hi geo how are you today ?
DazPlay1337: kick his ass
buklao: Have you tried using reinforcement learning to play chest
aktw_: Olaf
th3_maj0r: yoyo
JSPeterson: where you been bro I'll come back
tomcr00s3: gonna use minimax search!
fn_mad: HEY
tomcr00s3: I only have 34 battery though
un3okapi: someone is speaking weeb in the background
tomcr00s3: hehe
buklao: Is the butterfly keyboard aids?
JSPeterson: do some emus bro PS3 emu
tomcr00s3: love keyboard
tomcr00s3: new map 13" 2018
tomcr00s3: *mbp
Jaany: hey hey boss
buklao: Does that garbage even have a quad core
brandoncode: where are you?
slovn1k: @tomcr00s3 nice
tomcr00s3: in the cloud
tomcr00s3: I am in the cloud
brandoncode: haha
DazPlay1337: geo how was your day?
Jaany: Kreygasm thats fantastic
tomcr00s3: good
tomcr00s3: I walked a lot
Jaany: Hows the weather in the cloud
buklao: Yell penis
tomcr00s3: cloudy
tomcr00s3: always
un3okapi: I've got a rope geo, I'll come visit you in the clouds
Jaany: Nice
Jeppelelle: long time no stream, thought you where dead or on a hooker spree like McAfee
ququa111: more cloud humours
JSPeterson: you work too hard
buklao: Play the penis game
un3okapi: @buklao he's too old for that
DazPlay1337: mature for that*
return100000001: !uptime
keepingtrckofthisacct: @buklao 'ain't nobody got time for that'
keepingtrckofthisacct: @return100000001 5min
un3okapi: https://www.google.co.jp/ ...
un3okapi: is he in japan?
SylensEdits: was you able to do xcode select install on mojave it keeps saying failed @tomcr00s3
un3okapi: We can hear you.
buklao: cheer50 yell penis
yagurastation: is this Asia?
un3okapi: Yeah I think he's in japan
return100000001: @keepingtrckofthisacct ty
SylensEdits: can you tell the trick to install it I cant seem to find it @tomcr00s3
buklao: What vpn do you use
tomcr00s3: how is my new streaming setup btw?
un3okapi: Wonderful
tomcr00s3: sweet
myaocat: hello geohot
tomcr00s3: perhaps sometimes I'll be in places where I can talk
un3okapi: @tomcr00s3 do you know any japanese?
myaocat: we can't hear you
buklao: Just yell penis
yagurastation: Steam is good
agesmith52: Good, but I miss the mechanical keyboard🙄
SylensEdits: :( not going to show can you link it perhaps @tomcr00s3
ddd_dota: @tomcr00s3 are you gonna be doing deepfakes any time soon?
white_male20: forsenDab
buklao: cheer35 PENNNISS
buklao: Pen island.
juniperus1976: are you in a restaurant?
un3okapi: @buklao ???
buklao: Cafe probs
buklao: Hello
buklao: Do you guys like pen island
white_male20: @tomcr00s3 forsenDab dab or prerecorded
DazPlay1337: Sorry for the annoying Twitch chat lol...
buklao: It's not pre recorded..
white_male20: LuL
Mua_987410: in public, no talk
Crying_Potato: PogChamp
Crying_Potato: PogChamp stream
myaocat: what are you coding?
tomcr00s3: so quiet, you like?
DazPlay1337: I enjoy this haha.
SylensEdits: :( not going to show can you link it perhaps @tomcr00s3
ic0mrade: yes is so quiet because we lear from the MASTER @tomcr00s3
DazPlay1337: WE DEED!!! o_O
LuminousCS: can you not charge it where you're at?
buklao: Lol thinner lighter less faster
un3okapi: this is good white noise to facilitate my sleep
LuminousCS: ^
tomcr00s3: I forgot charger at home
buklao: ^
LuminousCS: ah that sucks lol
myaocat: what are you coding?
DazPlay1337: Hack the power outlet. xD
th3_maj0r: good move George
petrexxy: lmao
SonOfSatan: hack yourself a self made charger lol
buklao: Fart on the keyboard I hear that works through thermodynamics
myaocat: try wireless charging might work
memoryleak: code faster 4Head
petrexxy: speed code
newtomcroose: why just 1080 ?
myaocat: why not 4k?
newtomcroose: why not 720 or 480 ?
myaocat: stealing wifi bandwith
SylensEdits: can you show how you install xcode select install @tomcr00s3
buklao: How can he output 4k isn't the screen 2.5k
newtomcroose: ok , i wanna sell my bed and buy a good internet , i be nothing if i sleep on the floor
LuminousCS: wouldnt lower quality give you lower cpu usage thus lower battery consumption?
un3okapi: ask if they have a mbp charger at the cafe desk. :) Say "mac book charger desu ka?"
th3_maj0r: desu ka ahahahah
SonOfSatan: 1 hacker boi vs python chess
newtomcroose: bro , i just wanna dance with somebody
newtomcroose: @tomcr00s3 ok , i wanna sell my bed and buy a good internet , i be nothing if i sleep on the floor
buklao: Ai chess
tomcr00s3: ahh I think it's repeating moves
tomcr00s3: triple repeat = fail
newtomcroose: @tomcr00s3 just sell your bed
th3_maj0r: go there with google translate and ask for a charger. Go George!!
Cs_nothing: where's he streaming from? is he out at some event?
buklao: Cafe
LuminousCS: sounds like japan
newtomcroose: why safari :D ? why not chrome ?
th3_maj0r: yeah, probably japan
buklao: Or he's at one of those message parlers that end with a happy ending
un3okapi: Definitely japan. :/
buklao: Waiting
buklao: For his turn
LuminousCS: wHy NoT cHrOmE
newtomcroose: no probably china , or north korea :|
tomcr00s3: fuck chrome
tomcr00s3: fuck google
LuminousCS: true
buklao: Chrome eats ram
newtomcroose: @tomcr00s3 even facebook ? :))
Cs_nothing: OMEGALUL
tomcr00s3: nah it's the login shit they pulled
buklao: And extensions have monero miners lol
SonOfSatan: lol
petrexxy: googley boogley
newtomcroose: people like instagram
tomcr00s3: google is really a sad story
DazPlay1337: lol
tomcr00s3: I know people who worked there for years
tomcr00s3: and recently quit cause so disillusions
Cs_nothing: anyone know whaf loging shit hes talking about? i haven't been keeping up
un3okapi: is waymo a sad story? ;)
tomcr00s3: lol
keepingtrckofthisacct: @tomcr00s3 those setting can now be changed. opt out
newtomcroose: @tomcr00s3 if u working for facebook or google u could buy a tesla mode 3 . am i loser :| ?
tomcr00s3: we don't talk about self driving cars on twitch chan
buklao: I saw a company using an iPhone and they have level 4 at an event I went to
un3okapi: ok :(
tomcr00s3: SDC = ban
tomcr00s3: only twitchchess
SylensEdits: :(
th3_maj0r: You change browser more frequently than your t-shirt
DazPlay1337: Oh for real?
un3okapi: the recent scopie was boring without you. :(
newtomcroose: only twitchies
myaocat: what is sdc?
un3okapi: sorry last 1
un3okapi: I'm done
acheesedanish00: twitchchess &gt; SDC
SonOfSatan: Google now logs you into the gmail, or the browser and other services if you login into just one of their services
newtomcroose: what u eat ?
newtomcroose: @tomcr00s3 what u eating ? waffle ? :D
un3okapi: @myaocat self driving car
Cs_nothing: @tomcr00s3 according to you, what is good code, and what is bad code?
newtomcroose: omg this is a caffe strea,
keepingtrckofthisacct: @tomcr00s3 why did you choose minimax for this?
return100000001: those girls make me angry
newtomcroose: @Cs_nothing bad code is bad code , and good code is just geo codes :|
Mua_987410: sounds like japanese
newtomcroose: japanese talking crazy
petrexxy: no charger? thats a checkmate! haha
Cs_nothing: @newtomcroose LUL i really wanna know tho
newtomcroose: @tomcr00s3 this is a plan for next stream :D = https://projecteuler.net/problem=600
acheesedanish00: if you ask what bad code is on twitchchess you probably write bad code
newtomcroose: just linus torvalds write good code :|
juniperus1976: it much less entertaining than with talking
keepingtrckofthisacct: 16% left!
Crying_Potato: I have no clue what is happening
newtomcroose: When I find myself in times of trouble, Mother Mary comes to me Speaking words of wisdom, let it be And in my hour of darkness she is standing right in front of me Speaking words of wisdom, let it be Let it be, let it be, let it be, let it be Whisper words of wisdom, let it be
DazPlay1337: Turn brightness down. :P
keepingtrckofthisacct: won't help. the streaming is killing it.
DazPlay1337: @Crying_Potato He is scripting a chess bot.
Kobayawaka: aurHype aurHype aurHype aurHype aurHype
SonOfSatan: greekShhh
keepingtrckofthisacct: 12%
BrainIet: FBtouchdown
theGeekPirate: I'd still lose to it FeelsBadMan
un3okapi: that opening is not canon
return100000001: i have drop, u have guys ?
RuhAdamTR: PogChamp
jurodiwy_777: PogChamp
Roundlay: Are you in Japan?
BrainIet: the japanese grills in the background TPFufun TPFufun
un3okapi: Whoahdude good trade
SonOfSatan: @Roundlay japan came to steal his chess bot
Roundlay: God they love talking about their gohan
un3okapi: LUL
return100000001: lol
Roundlay: roundl2
keepingtrckofthisacct: chess whuppin'
SonOfSatan: Watching this makes me want to write a chess bot myself, but first I need to learn actual chess greekWeird
Roundlay: @SonOfSatan same lol
return100000001: he is loosing against his own chess ai lol
shevchenkounchainged: chess bot is done
un3okapi: @tomcr00s3 FailFish
SonOfSatan: 2 minutes later: "Elon was right, we need to regulate AI" greekYikes
BrainIet: ^ LUL
newtomcroose: dont trust everything george say . :|
Roundlay: @tomcr00s3 Have you read Crystal Society by any chance?
DazPlay1337: It knows haha
th3_maj0r: ahahah
RuhAdamTR: lol
tomcr00s3: draw?
Roundlay: rip
tomcr00s3: omg I'm pathethic
un3okapi: yeah
un3okapi: draw
newtomcroose: @tomcr00s3 who say the toys are funny ?
th3_maj0r: 7%
Kobayawaka: it was just a warmup
tomcr00s3: battery dying
un3okapi: It's ok. Just create a bot that codes better than you.
newtomcroose: @tomcr00s3 media is scam . dont do media
tomcr00s3: we'll be streaming more
tomcr00s3: plz siub
tomcr00s3: *sub
un3okapi: later tonight?
DazPlay1337: Cya geo nice seeing you.
tomcr00s3: I need money
SylensEdits: :(
newtomcroose: @tomcr00s3 for rice ?
un3okapi: you're rich.
tomcr00s3: love ❤️ 💕 💗 💖
tomcr00s3: I want ramen!
newtomcroose: @tomcr00s3 for rice ? u need money
th3_maj0r: Wtf u are rich george
tomcr00s3: not just rice!
tomcr00s3: move up in the world
newtomcroose: @tomcr00s3 maybe a girl ?
tomcr00s3: nah, overpriced
newtomcroose: @tomcr00s3 world is scam :|
tomcr00s3: ramen is a good deal
tomcr00s3: not here
newtomcroose: @tomcr00s3 bro . world is a fake news
tomcr00s3: in cloud, all is wonderful
stoogethomas: hack my bank account you can pay your own subs with my bank
tomcr00s3: and I am happy
un3okapi: ramen in the cloud
tomcr00s3: byebye 5%
Roundlay: https://www.youtube.com/watch?v=LhJ7R2asi0Y
th3_maj0r: byeee
newtomcroose: @tomcr00s3 checkout https://projecteuler.net/problem=600 for next
all
right today we're finally going to get
to the bottom of prop satin
type maybe some people are going to show
up oh don't no twitch Cox one word why
did it do it in
two yo yo what up chaga
welcome welcome to my stream
can I make the chat
bigger I cannot hello from Russia no way
I'm alive I'm alive I shave this
morning oh drinking tea good morning
good morning refresh
this no why did it not change the title
it changed the
title
whatever back on Twitch coock for those
who wanted twitch coock to come back
it's
back this was working last time I don't
get
it oh
why can't it
import did that the wrong
l oh L parser wow so you just know what
it
is good morning wow we got a lot of
people in here fast
all right we're back to kind of where we
were looks good we've proved true is
true and we've proved that true is not
false and now that's done in Co so now
we're trying to build Twitch coock which
is a python reimplementation of the cock
kenel hello from San Diego
California how's a fire up there
PS4 jailbreak
Guy this is how close you are are being
banned you're one iPhone 11 Pro
[Music]
away okay so we're drinking tea and to
the 202 of you I have something to tell
you Chris thank you for subscribing I am
an aspiring meat I'm an aspiring not in
education employment or training and in
a little bit we're going to make chicken
tenders but that's in a little bit um
not right
now we can make that
bigger oh we want to make this bigger
too all right we can make it
bigger
cool so we have the python parsing it
now
now all we're going to have to do is
write the kernel which it's really this
is really like cargo called at me cuz
like the parser should not be the uh the
hard part of of a
language um yeah you see I I wrote a
grammar file cock it doesn't work
perfectly monus sub scream thank you for
subscribing Mac Book is bad oh guys you
know what I'm really excited about
when's it coming out
16inch
MacBook no no we don't want a we don't
want AMD you got to get over your hatred
of
Nvidia yeah yeah we're making tendies
guys we're making tendies I learned
about those from neats on the
internet and then I bought some I don't
know if these are the good ones like I
said I'm an aspiring neat so if any of
you guys have have Contender
recommendation
I'll make sure to have them for next
stream
um now guys you know what I'm going to
tell you
something I went to Slab City last
weekend and I I realized
that societies is scam I say it all the
time but really having a job is is
participating in society scam and if you
listen to my last rap song you know that
that's how I feel um so yeah Society is
a
scam and we're going to not do anything
and we're going to eat chicken tenders
and play video games so that's going to
be my new life but for today we're
working on Twitch coock we're also going
to work on projects projects are good as
long as they're not for the man got to
ask the question is your project
furthering the agenda of the man or is
your project project furthering the
agenda of freedom and you always got to
make sure that you're on the side of
freedom freedom wins this is
America wait is it different
no wait this isn't
deterministic I just saw
it
moved how is this non determined I I
don't
know who's Terry Gamers eyes
off yeah
the set of sorts oh they're all sorts
okay what's an
Sr the sort s prop is like prop but the
prop positions srop are known to have
irrelevant
proofs objects of type sop are called
strict
propositions srop is rejected except
when using the compiler option allow
srop oh we got to learn about
srop this is new I think they actually
just announced this in the in the uh CU
this wasn't here last
time a
expansion this thingy reduction this
thingy
reduction all right so why we're doing
all this this is my new company
backspace AI well it's not really a
company
but backspace I why did that just
twitch no it's not the Lambda calculus
backspace AI is a coalition of Freedom
lovers that's what it
is um who's Terry is this can I can I
look up Terry on Twitch is this
appropriate or is this like the time I
showed you how much revenue I got on
stream uh and you all told me I was
going to get
banned is Terry the temple OS guy we can
look up temp
us oh I got hit by a train that's sad
let's look at the temple OS code you
guys just baiting
me up to 64
cores it's in holyy let's see
holyy is this is this the right Terry or
is this some other Terry
wait there's syntax highlighting for a
ho you see built into GitHub that's how
you know you made it
guys is that a function call
what is
this where's the grammar for Holy
SE oh it's optimizing
can't see all right move over
here
um don't watch his vids on stream okay
okay I don't know he this is code
offending
anybody we don't want anyone to be
offended my twitch channel is a is a
safe space for neats
everywhere also if you guys didn't know
Tak is not just a beer it's also a place
in Mexico I've learned this Reon
is there just just holy C of a
manual oh here the official holy SE
documentations oh here we
[Laughter]
go why only doubles no
floats well actually to be
Fair there's no reason you'd want a
float and not a double that's this is
actually very well thought
out
this this type system is better than the
type system built into
C all right so I'm just going to say
that this is a great type system and I'm
a big
fan functions with no args or just
default args can be called without
parenthesis no no no no no no you've
you've lost me
here you you've lost me here this is not
good
because okay I mean I I don't understand
what's going to happen in holyc if I
type something like print F quote
percent P dur right is that a call or is
that just a reference to the variable so
this doesn't make sense but their type
system is better than
same um default args don't have to be on
the
end that's very sensible this is this is
very sensible this this is better than
safe Char all alone no no no no this is
rid an implicit print no this is
ridiculous this is
ridiculous when dealing with function
addresses such as for
callbacks proceed the name with
amand that's
sensible post fix type casting I should
know what this
means that's
cute holy was
L there's no main function any code
outside of functions gets executed upon
startup in
order
um I don't like that I mean it's nice
from a like pythons like this
but C's a compiled language not an
interpreted language and an interpreted
language that makes a lot of sense we're
drinking we're drinking tea and we got
distracted
reading about
holyy I think I could I think I could
code holy c i I think I think I could
learn holy C really fast and I wish that
you know I'm just saying what is that
website that I played on where I did
that problem for for five hours wherever
I did that if they supported holy C we
can write our next program in holy
SE what's Eagle in Temple OS can I
Google this or is this is
this we need
sound see if I can get that
guy okay you're not supposed to hit the
uh
oh this like Windows 95
snowman what was that
game ski free yo can I play ski free
online this is not ski
[Music]
oh oh I see
woo oh I hit a
rock no no I hit a tree I hit another
tree oh I ski Free's hard you
guys
oh oh that's how I stop okay I get
it I hit a tree
[Music]
hit a
Tre oh I jumped oh that's cool can I
jump over
trees need ski left five I keep crashing
into stuff do I
die I hit a rock I hit a tree this
game's hard I'm done with this all we
we're we're getting distracted we're
getting distracted we don't talk about
Kami here you should know better
now we're working on backspace Ai and
the gold
backspace is
freedom we love
freedom it's not load right
I don't know how to read
this I probably should know how to read
this if I'm going to write this language
and why do you keep moving
stuff I've seen these rules before
there's this class Bob Harper at CMU
where they always write those things on
the
board in this class principles of
programming
languages tell you more about backspace
you can read the website backspace.
um fpga project is not going to
happen be
stupid CU I realize that educating
people is stupid because I'm just honest
not sure if people can be
educated you're lucky your subscriber
asking me about bug bounties and hackers
I haven't been a hacker guys for six
years I I haven't I haven't found
exploit I haven't rooted a box for six
years
okay no actually the truth is this right
you ever watch hackers the movie from
1995 Angelina Jolie you
know that is hacker
culture if these people saw bug bounties
and security companies in RSA is fucking
disgusting
man like that's not hacker culture
that's the appropriation of hacker
culture to make
money those people are sellouts you know
you want to do that shit you're a
sellout I'm not saying look look look
look I'm not
saying if you occasionally are like
damn you know look oh they're giving out
this bug bount they're giving out
$80,000 if I can like you know like like
find a couple find a couple remote code
executions and their shitty Ruby
interpreter that's being an opportunist
and making money and that's hacker
culture right I'm talking about the
people who spend their life doing bug
bounties getting paid $3,000 for a
potential zero day in
Firefox if you're you're not doing it
for the money at that point you're doing
it on some misguided notion that you're
making the internet safer and you are
not a hacker that's
right like if you're doing it if you're
doing it as an opportunist if you're
doing it like man these people are so
stupid for paying me for this his bug
then that's fine then that's fine but
the other man you're just working for
the man you
know I'm not saying how dare people want
to make money you know I'm a big fan of
being rich but like if you have to sell
out to the man in order to do it then
don't it's not worth it it's not worth
it yeah yeah you see you see what I mean
Slater USA you got you got exactly like
my vibe right like that's what it would
be today you don't fuck the security
industry now but use your bugs for
something cool man right jailbreaks you
know if you want to if you want to do it
that's the way to do
it um no I don't play ctfs anymore
because I
mean when it starts out when all these
things start out they're they require
like generic skills by the way ctfs are
still great and you'll learn a lot
playing
ctfs um
but once you get to the point where okay
so imagine a new sport was created
tomorrow right imagine we created a new
sport like baskball right I think that
was a
movie the people who would exceed
initially at
basball is um people just with athletic
Talent with raw athletic Talent those
are going to be the great people and
that's going to be the Heyday of basball
but eventually you're going to get like
the Moneyball types right you're going
to break down all the basball statistics
you're going to get you're going to get
well you know you know this person has a
has a earned throwing average of of 38
and therefore that's a you know 20%
multiplier on their salary they're being
underpaid by the you know Louisiana
lions and we can poach them right
and see that's when basball is ruined
right when we have basball training
regimes when you're three years old man
and they're telling you look kid look
kid you know it turns out that asparagus
if you eat asparagus you're 20% more
likely to be a pro basball player than
if you eat
broccoli right so that's that's all I'm
saying um what's my opinion about
offshores
what's the
offshore oh oh it's it's when these it's
when these uh these these Wall Street
MBA types you mean like the type who
like you know crashed the two Boeing
planes are are like oh man look well we
have to pay our software Engineers off
this salary here but we the outsources
to to to to to to to third world country
software Engineers we can pay them way
less money and software is software and
you guys are missing the point see
backspace is the opposite of that right
backspace I said I said it in one of my
my medium posts like software
engineering is Art would you Outsource
art to the third
world yeah they make the game a
consumable and try to break it down so
anybody can get into it make low risk
High reward see see I don't know I don't
know what you're saying but I generally
I feel that you know who I respect line
is tval that's right I respect that guy
art can't be outsourced exactly yeah you
can have you can have you know Chinese
rembrand clones who study the style
they'll never get it they'll never get
what art
is what they're making is not art what
they're making is derivative work see
the beauty of let me explain to you the
difference between art and iPhones
right if I'm you know the first person
to get an iPhone right and then the
second person to get an iPhone third
person to get an iPhone it's all the
same iPhone like it doesn't
matter but this isn't true in the art
world right because otherwise I could
make copies of famous paintings and
they'd be worth as much as the painting
I could stuff my own shark go around
call myself you know Damen Hurst 2 and
people are pain me like $12 million or
whatever the Palms paid for that shit
right so that's what I'm saying but you
can't do that cuz the second stuff shark
probably wouldn't even be worth the
money stuffing the shark because I
didn't come up with the idea of stuffing
a shark right it's a brilliant
idea all right some bullshit
today but s is in the third world
countries are starving for opportunity
right I mean this is a
you want
opportunity start your own damn
company figure out how to hack the joh
you want to be a hacker man real real
hacker opportunity
today John Deere
tractors right all these tractor
companies are are becoming you know
massive rent Seekers to the point that
farmers want the old tractors cuz they
can fix them not the new tractors cuz
the new tractors are all electronic
opsource firmware for John Deere
tractors eventually do that do that as a
company and eventually push into making
your own tractors right get get what you
want to do is you want to get cheap
Chinese Hardware high quality open
source software and build incredible
tractors you could revolutionize the
farming industry you see that's that's
the hackers of today
man that's not
Outsourcing if you Outsource you know
sticking a widget and like screwing a
thing in I mean that's just that's just
that's just
automation out Outsourcing is when you
Outsource thinking and that's the
problem you want to Outsource like you
can make an argument like you know man
you're going to drill that hole in the
wall with a power drill you're
Outsourcing to the power drill no I'm
not Outsourcing to the power drill it's
a drill man drill's not doing anything
thinking yeah cor's pretty
cool all
right sorry we really we really are on
some b bullshit today and we're going to
try to focus but I don't know how well
it's going to
work you're thinking
drill what do you guys think I'm on
riddlin look at me does this look like
riddlin does this look like I'm focused
does this look like I'm staying on like
one one
topic um open
Bob we love te man we love te
[Music]
but now the unfortunate side effect
drinking tea is you got really bath so
that's the unfortunate
side I wish I could play an ad for you
guys right now but I'm not a twitch
partner so I can't
oh the Dragon book Man red book orange
book you
know 95 hackers it's great movie if you
guys haven't seen
it we did
syntax let's just stare at the code for
a little bit and see figure out how
to that's loud
has really thought about this
notation I think it's interesting so a
implies
B do that even implies
huh so not is like a implies
false they did it without the
parentheses describes the product of the
variable ident over of type type over
the term
term um
so one of the one of the coolest
things I think about this we we don't
get to the gats yet but
um like this is the inherent structure
of a
Boolean I could learn AWS and that
definitely makes me more hirable but for
what just to do the same meaningless
stuff in a different company
stop doing that
guys
stop if that's how you feel don't don't
do it it's not worth it one day I'd like
there to be like a a revolution you know
I'd like there to be I'd like all these
people who work at who work
at I'm at first I'm thinking to say
Google and Facebook but what I really
mean is is all these
like the the finance people the the the
people who who don't create any
value like they're all based on they're
all based on computers they're all using
programs I wish everyone who just had
these sort of skills would just
stop just would just stop working for
those companies would
stop providing them with the value of
software and let these things
die um I wasn't that big a fan of the
new Kanye
album oh I don't know Google project
zero is pretty cool um at least when I
was there it was cool I still think it's
cool um no that's not like look project
zero is not doing bug bounties to eek
out
$3,000 from like
Mozilla project zero is like we're just
going to find these incredible
vulnerabilities because we can and you
know Google's willing to pay for
this um I'm I'm not I'm not saying but
I'm not saying you know you find
something like you find something like
Spectre
meltdown um you find these these these
bugs that are rethinking the way we
think about computer architecture that's
being a
hacker you finding one more use after
free in the canvas 2D component of the
of the servo rendering engine it's not
being a hacker it's being you know I'm
not saying don't do that to learn right
I'm not saying like like like you do
that the first time you learn a lot you
do that the seventh time you're not
learning anymore you're doing it for
like a job or
for you know then you're working for the
man at that point you're working for the
man what do I think about open
[Music]
AI I mean I'm
torn uh on on on one hand they do
publish very good papers
um on the other hand they pull bullshit
like what they did with
gpt2 well so you know guys the safety uh
we're not going to release them all bro
stop at the fucking hype you
know you can get better you can get
better language model models today from
like hugging face and oh the world
didn't end the world was covered in fake
news before the language models right uh
still a fan of yowy yeah absolutely
absolutely
um I went to Miry you I went to Mary in
uh 2014 and I was a little I was a
little sad that they like weren't a cult
right like I wanted to go there I wanted
to find like the cult of rationality and
there there is no Cult of
rationality um no I'm not saying never
work for others and make your own
company right I'm not saying like don't
go take a job doing something for
somebody else what I'm saying is think
about this are you creating value
right it's very possible the best way to
create value is to go work for somebody
else but if what you're doing is just
rent seeking you know it's just and and
the definition of rent seeking is like
instead of trying to grow the economic
pie you're just trying to take
uh you're just trying to take the uh you
know the money from somebody
else oh when I open Twitch dashboard
click the blue bar on top oh that's
cool um yeah no but are you creating
value for the world that's the question
you came here to learn programming not
economics well guess what we're going to
learn more about economics where was
that great thing
where where was that great thing that
uh that I got to draw that that diagram
with you miss old George when he wasn't
always trying to Pro prove
something what do you mean trying to
prove what am I trying to prove
man oh draw.io yeah all right now this
just this this one's quick this one's
quick this one's quick
right so so you have like uh save them
decide later yeah all right so you have
you have companies
right companies and then the companies
have have
customers
right customers
right and we'll put an arrow because
because because companies give stuff to
customers and customers give money to
companies
right so this this this one here is is
stuff
product and this one
here is
mine this is how normal companies
work you're proving if something is not
true or false Oh Oh you mean Oh you mean
that proving oh no I get it I get it
good as long as I'm not trying to like
like prove some like bullshit you know
uh so let's put this in the
back I have a revolutionary new idea for
companies everywhere right what what you
should do is acquire your customers
right I mean you have a problem always
with like you know oh customers aren't
buying or like you know imagine you just
acquire your customers right you you you
could just like like this could be one
like conglomerate right it's just a
conglomerate where the companies just
buy the customers right and and the C
and the companies can give the customers
some money in terms of
salaries or or
that's you know and then and then what
you have to do here you're like oh well
this is a closed system right how's it
going to make money well you just got to
you got to borrow money right you got to
borrow money from the banks
right and and you know this is how this
is how New Capital gets injected into
this system
right um so you know you got you got you
got money coming in here
right and then you ask the
question well what are the companies
delivering back to the banks so they
deliver money back to the banks as well
right so they got like like the bank
loans the money and they and they um
deliver money but what's interesting is
they deliver you know a little bit less
money so we're going to make this $2
signs because they also deliver
something else something else that
investors everywhere love to see so
we'll just we'll actually call this
investors right it's Banks it's
individuals it's whatever but what
companies are delivering to investors is
growth right we got to deliver
growth
growth growth because the growth
delivering growth is what's allow us is
what allows us to pay back dollar sign
dollar sign but to borrow dollar sign
dollar sign dollar sign sign right does
this do you see what I mean this is just
this is just a closed system companies
need to acquire their customers right
and then like the growth that they
deliver is they'll just expand out the
customer division
right so so you have something you have
something you know companies are already
paying their uh you have something
called customer acquisition cost
right and every every company
understands this is like acquisition
cost I got to spell it right
acquisition you you have customer
acquisition cost right but here if we're
just employing our customers we could
just have customer retention
cost I think I still spelled it wrong
retention cost why don't we just pay our
customers to consume the
product right and this is the ultimate
this is the ultimate system right cuz
you know the customers are going to need
to get money to buy the product so why
don't we just give them pay them the
money
right and actually here here's another
scam we can do we can pay them money and
then they can buy the products on
credit right look at this this beautiful
it's beautiful we need to stop you know
catering to these customers because then
we have to care about stuff like the
quality of the product right if we're
paying the customers we don't even have
to make a good product anymore we can
just fire all the engineers right we can
just fire anybody who creates any you
know like like a real product because
the customers are just our employees
right their job is to
consume who likes my
scam why don't I start off by paying all
my viewers for watching me because I'm
not a fucking scammer man but I'm just
saying if you want to be a scammer you
guys got to realize that that like the
old school model of having a company you
know be like this we got to expand this
circle we got to acquire our
customers that's right that's right now
they're all part of our conglomerate
right Unilever also includes all these
people who buy
soap all right we're going back to
proving the TR is not false all right
all right all right all right but that's
just some real shit about companies and
consumers and you know that's going to
you know that's coming soon
soon um just just acquire the consumers
man we have the customer
division how do you prove true is not
false
this exact EB in true check I false
H okay so this is
interesting so we've defined false and
true as like false is the set with no
items I know I'm stalling because I
don't really know how to do this
ter really saying the same
stuff so that that concerns me a little
I
guess what if the set is supposed to be
empty I mean I don't know I I think that
like whatever definition of set they're
using isn't exactly the intuitive
one I'm stolling cuz I really like I
don't know exactly how to do this
right I'm telling you s props are new
they weren't here last time I looked at
this
and this is the kind of trolling you
hear from these sort of people who like
talk about this stuff well all sorts
have a type and there's an infinitely
well typed founded hierarch typing
hierarchy of sorts whose base sorts are
s prop prop and
set
like like this is this is sorry I I
can't like when I see a statement like
that I'm like
it's just it's hard it's hard to it's
hard to
read we sold subu harnesses we don't
talk about Kam on here no that's not
what that's definitely not what a story
is because the S
the okay let's really try to read
this history of this formula okay the
expressions of the cic the calculus of
inductive constructions are
terms and all terms have a type okay so
the the Expressions should I bring up
draw. and we'll make a little diagram
here maybe this is how we'll
understand yeah mono is the category of
end def functors yeah that's like that's
like the jokes about this
stuff of the Cs your terms and all terms
have a type
there are types for functions or
programs there are Atomic
types implying that functions are types
but they're not Atomic types but also
types for proof and of course types for
types
themselves especially any object handled
in the formalism must belong to a type
for instance Universal
quantification is relative to a type and
takes the form for all X of type TP oh
okay well that's actually sensible I
think do I need those parentheses I
don't like those parentheses let's get
rid of the
parentheses uh doesn't work one
parenthesis okay we didn't need the
inter
par all right next
here
cool I don't really want to though cuz
what if Will that blind to a real X I
don't
know um for all X of type TP right so a
is a
type and B is a prop which is also a
type yeah luxb if you write your sorting
programm in aspr you can't tell quick SW
and because proofs in asop are proof
irrelevant I don't know if you're
trolling oh I guess
that kind of makes
sense like srop is kind of the the the
equivalence class of programs which is
actually the whole thing we're
interested in researching at backspace
right imagine an equality operator for
functions which is the whole the whole
reason we're doing any of this is if we
can build that right
um now this this operator does uh yeah
it can't work all the time because of
the halting problem right like if I had
an equality operator for functions well
here I have a program that halts right
away and then I have a program that I
want to know if it halts or not if I
could run my equality operator I could
trivially see whether the program halts
or not cuz is it equivalent to the the
halting uh problem right is it
equivalent to the problem that just
halts
um I think no I don't think you're
trolling I think you're actually right
uh we'll try to get is but is srop
new oh
well it fixes the proof of
false yeah yeah yeah I told you ESOP was
new was added in uh this version 25 days
ago so actually last time SRS didn't
even exist
but we're interested in s props because
s props are almost exactly I mean I
don't know man sometimes wow this is
really going to sound like uh you know
some some some uh conspiracy theory shit
but like I feel
like the world's kind of thinking about
this now
right and and and you know I can say it
a really non-c conspiracy theory kind of
way it's like whatever inputs to me as
like a as a neural network led me to
think this is also kind of existing in
the world um so I I feel like that's
what but for all I know this isn't even
what es propop
is
um this is because the proofs are
relevant they can be erased after
compilation has been completed but maybe
I don't understand why that's not true
about all props
right oh by the
way um if someone uh paypals me
$50 we'll I'll go on Skype right now and
we can do a live coaching session I I
got a few I got a few offers but it
looked like something that I'd have to
like follow up with with and plan in
advance so that seemed boring but if
someone wants to be on the stream for 15
minutes um you can uh PayPal me $50 and
uh yeah no bro bro bro bro bro bro being
sellout is okay it's buying in that's
not
okay see what I'm saying it's not about
making the money if you make money if
you do it's about why you do it it right
if you do it to further the goals never
mind never mind all right we're we're
done with that we're done with that all
right but yeah pay me
$50 yo yo there's a there's a LOE uh I
was watching this Lupe Fiasco rapping
mural live it's a great song If you
haven't uh we're all chemicals vitamins
and minerals and Viking in within the
tubes wrapped around her
arms um
if you only need to reason about the
mathematical Behavior
okay I I see what you're
saying so yeah it somehow it's
abstracting away like the complexity
class um paste my Bitcoin
address hang
on I don't know if this is going to work
here you
go on my private bch address we fuck
stole my
money I remember
that here you go just scan that QR code
you send me
money won't even pay me 50
rupes uh um are donations enabled
no but see
look I'm really into scams where you're
profiting on both
sides not taking donations no no no
they're not donations so don't feel bad
for me I'm
rich like giving me money is dumber even
than contributing to the holiday hole
which was phenomenal use of your money
by the way and if you contributed to the
holiday hole I just wish I was there cuz
the holiday hole is one of the best
ideas we're just going to you know we're
going to we're going to I'm really into
scams I mean scams are absolutely
fascinating
right see but I'm into the kind of scams
where they're like transparent scams
right like like it's like at the end
you're like but but but it was a scam
right that's why I'm into like bit
connect cuz if you just looked at
bitconnect for a minute you knew that it
was
scam um see like transparent Ponzi
scheme see that's the kind of scam I'm
into transparent Ponies are absolutely
brilliant
right um if you're familiar with the
curry how correspondence it only applies
when you're working with proof relevant
types instead of s props because proofs
and Sr are not programs they're just
proofs yeah yeah so I I'm very
interested that's not what I'm saying
it's not an equality operator right I
mean
because I guess yeah no because it's
not imagine a quality operator for
functions if if if um Bubble sword and
quick sword are equivalent in srop they
wouldn't be equivalent like would
they see see see but this word so tricky
right like are bubble sort and quick
sort
equivalent um fedcoin no fedcoin is such
a scam man
I mean it's slightly less of a scam than
tether but only
slightly um extensional
verse maybe I don't know those
words well no
I'm not sure I even I think I believe
that all equality is extensional
equality but like bubble sort and
quicksort don't have the same external
properties right like I can run them and
I can measure the run
times well I guess it depends if you
include time right so so time is one of
these it
leaks and time is like like a leak I
guess in the pure mathematical sense
there is no there is no
difference can I start writing code
equivalents need context
yeah but well they have the same outputs
for the same inputs yeah okay so I guess
I mean I guess in math things are very
much not like physically based
yeah so I guess I guess I am talking uh
specifically about uh extensional
equality here because like here I go on
to talk about how um you know
like well yeah I mean what is
refactoring
right every sorting algorithm is EXT
yeah yeah that's true uh well no that's
not exactly true because not all sorts
are stable sorts
all right what do they do with with
equivalent what do they do with the keys
the time
um yeah you know sorry this stream is
not like Furious typing if you're
looking for a furious typing
stream
um if you're looking for a furious
typing stream try twitch slam try the
one where I play hacker rank
can I explain why the halting problem is
a problem for my equality operator well
sure right if if imagine a program that
just says halt right and that's that's a
program and then imagine you have
another program and you want to know if
that program halts or not well if you
had an equality operator you could just
ask the question are these two programs
equivalent right and if you could get an
answer to that well if it halts the
answer would be yes if it doesn't halt
the answer would be no and that's
equivalent to a halting Oracle which we
know can't
exist I'd try to rap maybe no I don't
think I would no I think I think I'd
call that out of band and say you're a
cheater and I'd give you your $50
back we're not actually trying to make
money guys if I wanted to make money I
could just sell my
chair see I don't think the halting
would be internal property I mean like
the way that this is defined it just
talks
about functions you you
can't we know the halting program
couldn't exist in the first
place then where would I sit well i' sit
on this chair of course that's what we
have this chair for
two
chairs um yeah I really was my GP is
terrible
man school is the man I I don't want to
participate in
that swort set intends to be the type of
small
sets I I don't even know what the word
small means but we're still we're still
trying to we're still trying to get
through the
dense the dense trollish language here
but I'm sure they're not actually
trolling I bet this is like the most
concise way to express this maybe just
not to
me infinite well founded T what what
does well founded mean that that's a
word I've seen before sorry this is a
thinking stream and not a
uh I mean doesn't this have to do with
like
it's like primitive
recursive yeah
am I sure they're not trolling I'm
pretty sure they're not
trolling I know it's hard to tell today
but I still don't know what well founded
means and it doesn't have to do with
primitive recursive I just got
distracted
the sort prop intends to be the type of
logical propositions if m is a logical
proposition then it denotes the class of
terms representing proofs of
M
okay where do we use
props unit empty is like true and false
but it's not a but it's a set not a prop
do I use
these why do I have
these those are
gone I don't know why we need
them why is BU a set and not a prop
I don't know but we definitely don't
need unit and
empty I feel like at one point I use
them no I
don't why are false and true props
yet the item is named I and that's
what's used
there for
for
just assuming that simply that set has
Type set leads to an inconsistent Theory
language I see has infinite many sorts
yeah so this is this is classic set
theory
stuff what's the yeah what's the
statement of Gerard's Paradox
again yeah it's something like does the
set of all sets contain itself right
constructs a nonn normalizing proof of
false well okay now let's so let's think
through I I should be able to remember
Russell's Paradox um it's something like
does the set of all sets contain
itself or does the set of all sets that
don't contain themselves contain itself
right so if it doesn't contain contain
itself then it contains itself but um if
it contains itself then it doesn't
contain itself and that's that's
Russell's
Paradox Russell set a exists in the
universe such that a does not contain
a then
as we should have to learn to read
this yeah but I mean that's basically
you get
this so far this is popular
culture that's funny
yeah what's the complement of the
universal set
right the above argument be formalized
in any type system having
any typing rule type type so this is why
set has Type
set what does that language mean right
no I guess okay it makes sense like set
has Type set so therefore set exists in
the universe of
sets oh man I think this stuff makes
people go
crazy I don't feel like I understand it
though right I mean I would say it took
me it took me like six months to
understand like the world of ml
um doing nothing else well no maybe more
I spent that most of that year on it so
I I think it's going to take me I mean
after after we're kind of done with
comma I think it's going to take me like
a year to get to get really good at this
stuff and this is just me starting
out um like I feel I feel like now I'm
really good at that
M um at least like what what it is and
it's it's not all that complicated once
you
get uh to the bottom of it all right
cool we got some yeah yeah we all yeah
the fix Point theorem yeah I I saw
someone posted that on Twitter recently
and I like tried to understand it but I
didn't understand
it um let's see if we can understand
it is zag the
code looks hard to
read why would it no
um well no I mean comma so you know we
don't talk about comma here but I guess
since it's about my life I mean we're
going to make comma a profitable
company once it's once it's a profitable
company I mean you see what we what we
produce and yeah if you want to take the
long way start studying category Theory
so everybody always you know how many
videos in my life I've watched to try to
understand category Theory yet none of
it sticks with me like it just doesn't
fit well into my
um Elon talks about this a lot right
Elon talks about how you have like a
Knowledge Tree and the way that he
thinks about stuff is he has like a
knowledge tree that's really grounded in
uh in physics um and I'd say I have a a
knowledge tree that's really grounded in
like information Theory
and like it it works well for
understanding like like I don't know it
works well for understanding hacking or
maybe information theory is the wrong
word but like you look at a system and
like what's the inputs and the outputs
in the system right like what is this
thing
really um it works very well for hacking
it works incredibly well for ML how well
all the ml stuff just fit in my in my
knowledge graph of the world um but
seven sketches and compositionality
uh wait I should open these in Chrome
not
Safari yeah yeah yeah what what are the
inputs what is the desired output right
like it's it's it's the hacker way of
thinking um
is there some what I what I really want
and what I think would would get me to
learn uh category theory is like if I
could somehow do something with
it people get really hyped on category
the there's tons of hype around it it
always gets it always gets uploaded on
Hacker News
um yeah I don't know what it
does which include adjoint funs in Rich
categories Pro Arrow equipments what
like we're going we're going hunting
little duck H bone arrow topos toposes
all right let's see if we can understand
this we might call compositionality
which systems are
Rel these are cases in which systems or
relationships can be combined to form
new systems or
relationships like I'm not really sure
what that
means we want to really understand why
true is not
false motivating examples of compos
positionality like I feel like once you
get this stuff it all does make a lot of
sense um and also I feel like when when
I like start to understand something I
realize that most descriptions uh in the
world of it are just really really bad
like they they don't really describe
what the thing is they and this is due
to this is due to like how um I think
things are like learned like they they
learn them in one kind of way and
because they learn them that way they
don't see all the stuff that can be
Stripped Away um from like understanding
what it is the only person I think who
consistently talks about what machine
learning really is is ilas SATA he says
it all the time machine learning is
program search it's just searching over
a class for a program using a
optimization function to find the
program that minimizes a loss function
right and and then it makes sense you
have like a class you're doing search
and outfit into the completely classical
computer science Paradigm right now
there's a lot of stuff we we we still
don't really know about like why
optimization is good but to answer the
question why optimization is like why
does convex optimization work why do the
structures we see in neural networks
tend toward aam's razor even though they
have so many
weights
um no see no it's not like Natural
Evolution it's not like programming as
DNA and there there's great stuff that
goes into like evolutionary algorithms
and convex optimization algorithms are
completely uh well they're not
completely different you you can show
how an evolutionary algorithm is like a
form of a of a of a convex Optimizer but
it's not
um like in practice the solutions that
both of these find appear very different
um and then and then one of the other
most uh misunderstood things is you have
this like no free lunch and search and
optimization we'll go to the we'll go to
the Wikipedia page
um and then like people will repeat this
and they won't really understand what it
means right like yes this is absolutely
true in a theoretical mathematical sense
right um you know uh well let's okay
let's read exactly what it says in
debunking sometimes mathematical
problems the computational cost of
finding a solution averaged over all
problems in the class is the same for
any solution method all right
[Music]
um this is making things confusing but
so basically if you know nothing about
if you know nothing about a
space um
true is not false by definition of not
yeah that that's exactly what this thing
proves but like okay now now really
prove it um if you have a space that's
absolutely arbitrary then of course
there's no way to search it better than
random
search right but spaces are not
arbitrary let's take even one of the
most like arbitrary spaces we know think
of the shaw function right the Sha
function Maps um things with with with
like like in order to completely
apparently random
uh points on the space but yet Shaw was
solved faster than a birthday attack
and wow okay that I mean I guess what I
was about to say is not true but when
you look at sha is not like a huge
lookup table of true Randomness right if
something was a huge lookup table of
true Randomness like I generated a big
table for sha from Quantum random stuff
then like the cograph complexity of that
object is the length of that lookup
table um whereas in sha the comgraph
complexity of the shaw function is
extremely small because I can I can you
know write it I can fit it on this
screen right
now uh and all this stuff all this stuff
makes tons of sense to me right all of
this is like very very
clear
um yeah life is a massively parallel
search Project yeah and and and life is
using life is using all three forms of
uh of optimization too like when you
when you look at um life originally with
with like asexual reproduction of of of
of uh bacteria I mean that's effectively
just a random search I mean it's a
random search in like a like here's your
here's your current DNA and you're
you're you're jumping in in different
ways and it's a search and I guess when
you look at it from almost a universal
perspective it
looks um kind of like a
kind of like an Optimizer following a
gradient but H actually yeah I guess I
mean I guess it is I guess I guess the
question there is like what the space
itself is right if the space is is DNA
and the DNA produces the things the fact
that you can make when you make small
mutations to DNA you get small changes
to the organism I mean that's almost the
definition of like the DNA space itself
is is convex um and then you get into
you get into into sexual reproduction
and sexual reproduction is much a much
better search algorithm than asexual
reproduction and then you can actually
separate um this is this is something my
friend explained to me and I was I was
impressed that I never really thought
about it before you can separate sexual
reproduction into two kinds right
there's like plant sexual reproduction
and then there's animal sexual
reproduction and the difference is um
plants don't choose a don't choose a
mate right plants just just spread their
their their their seed everywhere and um
they don't choose there's no
intelligence behind that selection
process humans and and animals have have
are using this convex Optimizer almost
like a discriminator and a gan to
determine who they should mate with and
the the crazy amount of compute uh can I
not say sex no mate what did you you
don't say like my mate right
um but uh oh naughty talk oh so so
naughty um but but yeah and then then
humans themselves the brain the brain is
a convex Optimizer oh that's a
controversial statement we don't know
how the brain works we're going to stick
people in MRI machines like idiot the
brain is a convex optimizer
I guess I struggled for months
before before I got a grasp on uh thanks
Bitcoin
uncore um I guess I struggled for months
before I started to get a grasp on what
uh on what ml was and the way I really
got into it was the uh the hutter
prize and um you know looking at looking
at
compression and uh oh man that guy yeah
if you you guys want to read some great
content read read like the stuff on the
hutter
prize maybe just just look it over this
gave this gave me great inspiration last
time when I wanted to understand
the better you can press the better you
can
predict yeah so this is the normal
like
see this is this let's just let's just
contradict these two things right one
can prove that the better you can
compress the better can predict and
being able to predict the environment
well is key for being able to act well
right like this statement says so
much um and you know the fact
that a lot of people in the ml world
today don't understand that statement
and it's it's it's shocking like that's
the
whole that's that's yeah it sounds like
it's from Schmid hoer right
like that's the whole ml problem
and I don't know lot of ID a lot of
idiots running around out there but see
this doesn't work for
me we motivate this first chapter by
noticing that while many real world
structures are
compositional the result of observing
them are often
not right so I maybe these are just
words I don't know but but like what is
a real world structure are you talking
about like the Bur Dubai and what is
compositional are you talking
about
like okay many real world structures are
compositional can I take the Burge Dubai
and the Empire State Building and
compose them and make the Empire State
Dubai and then the results of observing
them are often not what does observing
mean right let's try the same thing in
in in this statement right one can prove
that the better you can compress so that
has a very clear short definition to me
right to compress is to take a a a file
and to make a smaller file right and the
better you can compress is how much
smaller you can make the file I me this
this kind of language is obvious to a
casual uh viewer of the TV show Silicon
Valley um see fuck these metap orical
statements why don't you say real things
right and this is this is what I can't
get into about about categorical Theory
right about category Theory like I I
don't really know what that's saying the
better you can predict okay well we can
talk about exactly what prediction means
like here you are in this in this time
step um you want to make predictions
over a possible space of what's going to
happen next right this is obvious to
anyone who's ever placed a bet on
anything and being able to predict the
environment is key for being able to act
well again obvious vious to any person
who's casually bet on a sports game
before right like if I'm if I'm you know
the better I can predict which team is
going to win the more money I'm going to
make right like this is when you have a
statement like this it's just
like that's an obvious statement right
now one can prove they don't put the
proof there and the proof is a little
bit complex but you can you can like get
to the proof right like it's it's a put
it this way I'm no math genius and I
understand that
proof um no but but but but stop with
yeah witty humor is funny because it
compresses information we like that yeah
we're compressors right we appreciate
compression
um
yeah but yeah fuck the metaphors man why
can't you just talk with real people
words the reason that observation again
I don't know what that means is
inherently lossy in order to extract
information from something one must drop
the details
uh I mean okay all right you're you're
you're no no that's not true I mean the
there's there's the word lossless
implicitly before compressing here right
to say that
all all right we'll give that to them
we'll give that to them it's is hard for
me it's hard my suspension of
disbelief yeah yeah can you train ml to
prove math conjectures yeah sure do your
stupid alphao search thing and it works
but it's not getting at
like that's going to work but
yeah maybe that's all it is maybe that's
really all it is maybe there actually is
nothing here and I'm going to be
terribly sad if I finally get through
all of this and I'm like this is uh most
journals will probably reject you know
what that says about the fucking
journals man all right sorry this makes
me angry this makes me angry
um one stor is a real the details are
not actually relevant then the observe
[Music]
result yeah I mean this is like some
like like read this
whole read this whole
paragraph what does this paragraph say
why is it underline
NOW essential themeing category the is
the study of structures and structure
preserving Maps a map X to Y is a kind
of observation of object X via a
specified relationship it has with
another object
why again can you say any real
shit oh here's some real shit think of X
as the subject of an experiment and Y as
a meter
so are you using the arrow instead of
implies to mean
observes okay I mean yeah yeah sure so
you can you can do this with like uh if
you've ever seen a like like a Baye
diagram for
uh I don't have the prerequisites to
understand this paragraph I
mean you can say that right but what
prerequisites do you need to understand
this
paragraph right none
so is there an introduction to category
theory that instead of looking like this
looks like
this right these aren't like like the
better you can compress the better you
can
predict those are normal words that
everybody knows right you don't need to
you always see this you always see this
with postmodern shit man you always see
they're like redefining words right like
you know they redefin I mean okay you
can use the political examples like you
know whatever when you say the word
racism and when they say the word racism
they mean totally different things um
and this is like a trick like they just
they they take these words and then here
postmodern
generator spelled generator here we
go here capitalist neoc constructive
theory and the capitalist Paradigm of
consensus class is fundamentally
unattainable says Marx however according
to Tilton it's not so much that class is
fundamentally unattainable but rather
the futility and ultimate fatal flaw of
class thus an abundance of De
patriarchalism concerning the role of
the participant of an observer must be
found batal promotes the use of
patriarchal Theory to deconstruct
hierarchy in a sense several narratives
conserving the capitalist Paradigm of
consensus
exist none of this says anything right
and the joke is you could be like well
but you don't have the uh you don't have
the background to understand this no
this is generated
garbage right this isn't this isn't like
a real
thing I searched for postmodernism
generator right it automatically
produces close imitations of
postmodernist writing right like you can
say that oh oh there's deep truth there
right but these are like like like like
people in a circle jerk it is a bunch of
nonsense right it was generated by a
computer that it's it's provably
nonsense right like it was generated by
a computer you can read the algorithm
these are like Markoff chains right
right like like they just they just say
well what word usually proceedes
unattainable fundamentally right
whenever you're talking about class we
got to bring up marks right and then oh
we got to throw in the patriarchy a
bunch and throw in capitalist a bunch
right like it's just it's actually
generated to be nonsense
um arose from the need to unify
different areas of mathematics oh humans
generate a lot of nonsense too but at
least when you know when humans
generating it you could say that like
you know if you've read um like like
James Joyce Finnegan's wake right like
is it nonsense or is it a great work of
literature
well you know you can make that argument
right but if Finnegan's wake was written
by a Markov chain you would know that it
was nonsense and you would know that the
only thing that actually exists in that
in that paragraph about that you know
capitalist Marx nonsense is
just like like like like echo of
statistical correlations not a coherent
narrative um it's a Markov chain it's
like some marvian process we take State
transition probabilities and blah blah
Google it
[Music]
asking which aspects of x one wants to
preserve under the observation wow okay
at least this reads at least this reads
much better than that postmodern
DL
um example there are many functions F
from R to R we can think of them as
observations rather than view X directly
we can only observe F ofx out of all the
functions F from the real number to the
real number only some of them preserve
the order of numbers only some of them
preserve the distance between numbers
only some of them preserve the sum of
numbers okay that
good forgetting the category but but
this this all makes sense right so you
have a function and what properties are
preserved by the
function um Okay order preserving metric
preserving addition preserving this is
all
sensible for each of the three
properties defined above call it
find an F that is f preserving an
example of F that is not F preserving
okay so let's do that
um so a function that so for all of
these if you want to find something that
is food preserving you can just talk
about the identity
function
uh for order preserving functions I mean
I can even
do just just negative work if I just do
like the minus sign yeah I mean the
minus sign clearly works because 3 is
less than or equal to 4 but minus 3 is
not less than or equal to-4 okay so that
that works for order
preserving
um metric preserving I mean okay there's
there's tons of things that don't
uh wait is that like a real equals or I
don't know just this mean absolute value
I mean normally that means absolute
value but I don't think that's what they
intend it to mean um the squared
function obviously does not preserve
addition you know a squared what's a
freshman's
dream is it something like
that
yeah right clearly not
true
um works for all n except not n equals 1
for
all right let's go uh metric preserving
you hear someone say that a lot let's
look
metric of
course is set together with a metric on
the set the metric is a function that
defines a concept of
distance see I don't know is that
supposed does this mean an absolute
value yeah negation does not Reserve
order yeah that's what I said
distance oh distance is the absolute
value of the distance oh okay that makes
sense yeah yes it does it preserve
distance between between points and like
tons of things just don't right um even
like two
times two times would not preserve the
distance because two times would make
the distance two times and then that's
not distance that's not metric
preserving
um let's see if we can find something
that's metric preserving but not
addition Pres
everything so okay if we just have the
negation the negation is uh addition
preserving but not order
preserving it would be metric
preserving
um oh I can consider a space distance
all right whatever whatever we can we
can we could obviously come up with it
but um I think we understand this
concept okay in category Theory we want
to keep control over which as of our
systems are being preserved under
various observations all right so this
is getting at I mean if we go back to
like the argument we were having at the
beginning about backspace where you know
imagine an equality operator for
functions well equality preserving what
right does it have to preserve
everything I mean if it has to truly
preserve everything then this operator
already exists and it's called stir comp
right but nobody would argue that stair
comp is um you know what're we're doing
here because if you add a comment that
doesn't change the behavior so you can
say do they have equivalent ests but I
think there's many things where we can
talk about how um you know two two
programs don't have uh equivalent UHS
sorry I just I just got distracted
thinking about like if I have two
programs that are equivalent like what
is refactoring right let's let's just
Google because really what I want to
build is like the ultimate refactor most
PR programmers are doing shit job like
like they're doing they're doing like
shit job constantly which is just
refactor code based right like it's it's
not they're not thinking they're just
they're doing something that a machine
can do right its Essence a small
Behavior preserving
Transformations right Behavior
preserving cumulative effect of these
transactions is quite significant by
doing them I mean imagine a a program
that does your refactoring for
you oh this is an interesting
book what's the misuse of
refactoring oh malism that's a good word
is that a real
word
malaprop the mistaken use of a word oh
we dance a oh
that's I love when I learn words man
this is funny and then oh wow it came
from some character in a play who knows
that's probably fake news who believes
Mariam Webster
anyway Soviet Russia code refactors
you yeah refactoring on what abstraction
level no I mean that's Twiggy that's
that's absolutely correct and I like the
category is talking about this stuff
right maybe this is why people are so
hyped on Category 3 I don't know or is
it not saying anything I mean yeah I
agree we need to you know we need to do
the patriarchial analysis on the uh on
the on the proletariat as it pertains to
class but not as it pertains to the
exchange of capital between marks as
referred to in in angles dos Capital
right where did I learn use cock uh last
year I don't know I started playing with
it yeah don't talk about keyboards man
buy whatever fucking keyboard you want I
don't care I'm not making money off it
unless I start selling geohot branded
keyboards then I'll tell you that that
keyboard is far superior to other
keyboards you shouldn't believe me
because you have to realize that what
I'm doing is motivated reasoning and it
wouldn't actually be a better keyboard
I'd just tell you it's a better keyboard
and I'd repeat it enough times so the
trick to repeating something enough
times is like it bypasses the part of
your brain that says is this actually a
true statement and then it's just it's
word association right so whenever you
think geohot keyboard if I say geohot
keyboards are better keyboards if I say
that over and over again the first thing
that you'll think of if it becomes a
meme if it's in your head right like
like we can get a picture we can write
the words better keyboard in the in the
meme kind of type even if it's a meme
that you're mocking like does he really
think we're that stupid that we're going
to think geohot keyboards or better
keyboards just cuz he said it a 100
times no it doesn't matter but you've
just repeated the key slogan Hillary
Clinton emails right exactly all right
let's get back to category
Theory it's a Russian propaganda
technique it's just a propaganda
technique you
guys why is it
Russian for automated refactoring to
work I think the machine must understand
the domain model so that it produces
code that makes it easier for humans to
understand yeah I mean that's absolutely
true right um un fortunately we have
tons and tons of examples of refactoring
by scanning GitHub I downloaded every
python project off of GitHub like we
have so much data now on this
right oh man this is so much cooler than
[Music]
comma self-driving cars devolves into
this like oh we don't talk about
self-driving
cars I don't know now maybe this won't
be cool I mean maybe you work on this
for a few years and you're like wow this
is this is total crap program we haering
actually just turns into like you
know no it's true man it's
true you you you want you you want to
not you want to not go to war in the
Middle East that's a Russian talking
point man how can you be on their
side how can you say such a thing being
Amica
clearly russan propaganda
man Al the overuse today of the of a
conspiracy theory is a
slander there used to be a lot of really
dumb conspiracy theories and like you
know it got associated with like wow
conspiracy theories are all dumb crap
that like you know Kennedy was
assassinated by martians or something
all right um but you know today oh man
you know the fact that all the money is
just you know printed and controlled by
the government doesn't really have any
value man that's just a conspiracy
theory okay okay I mean there not but
you know that's just what they
say who built the pyramids um Egyptian
slaves man what to tell you they got
beer though
so all right category
Theory you he on the S word I can't say
slaves I've offended all the people here
who were slaves in their
lifetime I mean that's that's actually
who built the pyramids I think I don't I
don't know you missed the ASMR part
[Music]
today pyramid
hats Yeah man they go around wearing
pyramid hats listening to to Grateful
Dead music while taking 2ci and having
bad trips but insisting that they really
enjoy it after they come
down t i to e that's the fucked up one
I don't know there's even more fucked up
shit now
man have I read Edward snowden's book no
it sounds like politics I don't do any
politics well yeah no jobs was just
second wave slavery man like first wave
slavery was like slavery and like second
wave slavery is like wage slavery and
then third wave slavery is
Ubi but how can they be slaves we're
giving them their money we're giving
them money man you see and that tells
you something about how free no no but
real
shit like slavery obviously like yeah it
never went away um what it says is like
the more obvious something looks like
slavery the more uh free a society is
right like back in the day you think of
a slave and you think of somebody who's
in Chains right um and you know you know
by the way we we don't even have we
don't have to go there but um you know
slaves everybody enslaved everybody in
history and they put people in Chains
and they they you know have less rights
than it than a citizen um and see this
obviously looked to everybody like
slavery as we've move to more and more
modern forms of slavery it looks less
and less like slavery right like like
the best thing the best way to enslave
somebody is to convince them that they
have a choice right to convince them
that they're they're they're choosing
this right and then finally the real
final form of slavery is to just give
people money and let them do whatever
they want you're like well how is this
slavery well look at what you can do
right what can you do with the
money yeah first way slavery was ended
by the Industrial Revolution second wave
will be ended by automation that's
absolutely
right what's the alternative man well
that's maybe the problem you
know it's too bad that when you know
I've met people I've met anarchists
right they they like oh yeah I'm an
anarchist and then like anarchists are
some of the dumbest people I've ever met
right like and I wish they weren't cuz I
think the idea of Anarchy is really cool
but like they don't think Anarchy
through right they project on to Anarchy
whatever they choose right they they
think like oh in an anarchy system
everyone's going to believe this well
why doesn't everyone believe this today
well you know turns out people are
different right all
right just like Google you can turn off
location tracking
who said I'm not Yang gang man you know
no I don't I don't I don't do politics
man voting voting is a scam you know
every time I voted I regret it I always
regret voting I've been duped into it I
always regret it I'm like damn that was
stupid why' I vote man see what that did
was just get me to legitimize this form
of
rule like every time you vote you're
legitimizing the
system what do I think about Alex Jones
I think he's making a killing selling
those super male Vitality products
right no and no the fact that voting
gives you the right to complain it's
like you're just consenting to a system
man but then not voting if you're doing
it as a statement well that's really
stupid too because that gets you nothing
also there's no way to win and that's
how slavery works all right let's try to
learn category Theory we're getting real
distracted today
b c protest no but you're still you're
legitimizing the system you're legit
that's like the person who's like man
you know you know I don't just watch CNN
and NBC I watch Fox News too I try to
get a well-rounded no no no you're not
man you're not the law the excluded
middle is live
man do I think automation will be
impactful enough to cause serious
economic issues oh my God
yes like I don't know how you could not
think
that right already look all right number
of jobs in farming over time right so
water just water just just comes to
people right like like water you know
nobody nobody's employed in water like a
few people are but not really
right here's employment in agriculture
over time right another way to look at
this graph is like this
here uh is the proportion of fake jobs
right all the jobs above this line are
effectively for the most part fake jobs
I mean there's there's some that like
kind of do something but like where are
all these jobs man look look it already
happened it turned out that you didn't
even need Brilliance you just needed
like
brute to to to keep humans
um
right this is this number of people even
with the massive growth of the
population right it's not even
percentage
based um the jobs are going to be yeah
well I I mean if you saw the beginning
of the stream you already know where the
jobs are going to created companies need
to just start employing their
consumers for
what wait you would love to do nothing
but you wanted I've washed my hands man
why don't you just do nothing you know
that's that's one of the best quotes in
office space man it's like a million
dollars and you want to do nothing well
shit you don't need a million dollars to
do nothing I got a cousin Larry up in
the hills and he does nothing all day
and he sure shit don't got a million
dollars
it's rapid
minor you look up services jobs over
time right services like like I really
need like I really need you know a
doorman in my building right sorry
doorman I don't mean to insult you I
don't like to beef with the doorman you
know I'm but dman and I are friends but
the whole thing is just like you
know this is the service industry and
it's a real joke if you go to if you go
to anywhere in the uh sorry third one
developing World um the number of people
employed in Services is astronomical
they're like fresh out of hospitality
School we're making chicken
tenders how are these are these good
tenders how hot do we have to make the
oven preheat the oven to
[Music]
375 we really do live in
[Music]
Paradise handan
go
this you make some fries too yeah I'll
make a couple of
fries tender tender oh we'll make all
the
tenders this is lunch cooking takes
forever when it involves the oven when
it involves the pan it takes less time
like
P got some CR cut fries here this is
going to
be we got tenders we got
fries today is a good day few more
fries I know I'm going to burn myself on
this can cuz I don't have a PO
holder all
right been drinking too much tea today
we're too amped up
um can I sum up all the things I've been
doing not so much uh we've been we've
been ranting mostly today because this
stuff's hard I mean what we really want
to do is so this is my little program
written in cock and we can parse it in
Python but we don't know how to really
understand it in Python so then we
started reading that and I got mad that
none of the words made any sense and
then category theory was brought up and
then we tried to understand category
Theory and it kind of made sense and now
we're reading this paper on category
Theory and sorry you're all just here
reading with me I look healthy thank you
thank you it's one of my goals I mean
you know I want to have a million
Instagram followers by the end of the
year uh you know 1M 2019.com if you
don't follow me check it out I'm at
George Hots um but really I want to
build not built take a shirtless a
selfie for Instagram right and that's
that's my goal about uh about going to
the gym you know you go to the gym you
get big arms and then you uh you
know uh CH can take shirtless on
Instagram and that's uh my goal yeah see
you see what I'm saying all right cool
that's that's all we're going to talk
about that how come I have zoto
installed uh for saving papers I can
show you my
zoto oh great thank you updates love
updates they're my
favorite my
papers style G work's been hyped on
ganss
lately huge arms man that's right
automation AI will be good for us it
doesn't matter if it's going to be good
for us or bad for us it's inevitable
bro we don't talk about Comm
AI could I explain how I built it bro
read the
code it's open source
consider three
points we should figure out how to do
that exercise sorry we're just reading a
paper
I'm a president of Kami that's my day
job but not like one of those elected
presidents I'm one of those like you
know guys who really tries to legitimize
his rule so he calls himself president
he like puts a lot about like democracy
and peoples in the name of his country
you know the more democracies and
peoples and republics there are in a
country the less free it is oh d
democratics oh yeah yeah what is what is
North Korea the Democratic People's
Republic of Korea you you know that shit
you know that shit is not a free country
right if they had to put three words in
there to remind you how free it
was false has more letters that's a fair
point right but you have the Republic of
Korea and the Democratic People's
Republic of Korea you know which one is
more free right right you have the
People's Republic of China and then you
have the Republic of China you know
which one is more free right I sorry I
shouldn't say that we we can make fun of
North Korea all we want but don't make
fun of China that's that's that's you
know I don't know I don't follow the
news yeah but I I'll be banned from
China and I don't want to be hey don't
ban me bro don't ban me you have a great
cont
I will I swear man wi the Poo sucks you
know I'm just I'm just saying I'm going
with you man I'm with you I'm with you
whatever yeah
yeah no South Park it's been so good
it's been so good if you if you cancel
George Hots it's right man um no don't
cancel me bro don't cancel me I swear I
swear whatever you want me to believe
I'll believe it if if the Chinese
government ever contacted me and asked
me to adjust my content I would be like
well you know um you got to send me a
bunch of Rimes but we can make that
happen we can work out a deal um I don't
know man Christopher Robin the real
people movie it sucked okay oh wow we're
really getting we're really getting
distracted
today all
right combining their connections what's
the result of joining these okay we got
to
this is like some like Ravens
Progressive majy
shit so the result of joining these is
one group around all of these and then
poor 21 all by
itself performed by simply it's a union
all right is that the union
operator kind of like a you
you think if I took Aderall this morning
I'd be this
unfocused why do you always think I'm on
drugs man sometime I am on drugs but
usually it's
weed I'm not I I know there was Sage
drama I definitely don't have a comment
on
that I know vaguely about the drama
because it was on one of the only
subreddits I read uh in machine learning
how do you know I have airpod
Pros I did I did buy airpod Pro uh it's
okay I'm not thrilled with them I almost
returned them but then decided not
to I'm going to replace all the
programming jobs that's the goal of
backspace. a can you guys read the web
page
I've seen like I've seen this stuff
before but why
wait false implies
true oh damn that's some deep shit false
does imply true but true does not imply
false damn that's some deep
shit man that's some deep shit false
implies true can we prove that in cock
let's see if we can prove that in cock
yo let's go prove that shit
said
theorem false implies
true which false is this false
um that's not what I wanted to do here
we go the term false has Ty which should
be set prop or
type all right we'll use the other
false false implies
true I don't even know where to go from
here
man yeah you can prove anything from
false
yeah
Auto
oh you don't get to use
hints yeah you can prove anything from
false yeah I know
but but how do we prove it all right
let's
Auto did not work we can intros and we
can make false a hypothesis I apply
H unable to unify false with
true God
we can't even say that like true implies
not a false like it's like the law of
the excluded
middle um prove it by
contradiction I don't know
we proved it with induction on H but I'm
not really sure why that's
true I mean like I guess that kind of
makes sense
but that is some deep shit by the way
that false implies
true and we can probably also prove that
true does not imply false
uh okay what expand not no what
is unfold not
intros
oh
um now we want to
uh can I
just let like assume true or something
now what is it
um ass sech
true uh
was true true can I just prove
true exact
I ah there we
go exert
true
I okay now apply
h0 in H or no apply H and
h0 now we have false and now we can just
say uh Y8 Z there we
go come man
okay this has actually made me like
category
Theory the proof is just no definition
by Curry Howard yeah I mean that's
exactly what induction H
is I
think uh what's the paper I don't know
uh some guy in here linked to it it's
about category
Theory my oven's hot enough you put it
in the tenders how long the tenders take
to C
minutes so long what you think I have
all day
okay
we already proved that we already proved
that oh we could have microwave the
tenders oh that's that's some real
Savage shit though
is this a rust
blog feel like I feel like the this guy
likes
rust it looks like a rust
thing
rails no this actually looks like a
pretty good blog
actually I mean I
is this
true no this this can't be
true this this can't be
true no no no no no no no no no okay all
never mind never mind this has not made
me believe that shining infrared light
on the brain makes you able to focus and
smarter this has made this has updated
my prior that category theory is
stupid oh
man how is this any different from going
outside
this is too funny this is too funny you
guys this I I can't I can't all right
wait yo let's do the Google trans for
category
Theory I'm sorry this is this is
why is my internet
slow English in here
bro this is a
lie This Is A
Lie okay this graph is undeniable proof
that when there's a session nobody cares
about category Theory but as the economy
gets bigger and people have more and
more time to
waste let's let's let's compare
this damn machine learning is doing well
for itself but people didn't care about
that during the recession
either interesting what does go up
survival
skills what correlates with
[Laughter]
recessions survival skills correlate
with regressions with recessions and
category Theory anticorrelates with
recessions good to know
I love Google
Trends study of mathematical things the
map is between those things the
transitions of these objects these are
usually called objects or morphisms or
arrows if you
prefer I don't see any morphisms
oh a higher category
theoretic so one my tease a younger
sibling abstract nonsense
that's okay that's not the problem I
have with it chicken tenders because I'm
an aspiring
neat I'm going to quit my job I'm going
to move to Slab City and I'm going to
make chicken tenders in a gasp powered
toaster Ren
you know
what I bet I could I bet I could take I
bet I could take I bet I could do the
same thing in uh postmodern
patriarchy for business
development I could write that book
patriarchy for business development
it'll just like you know it'll say like
obvious truisms about business
development categories for software
engineering oh didn't get good reviews
let's see why not
yeah no I could have a few chickens man
I don't know though turning a chicken
into tender sounds kind of hard that
sounds kind of like work and I'm going
Aspire
neat I do have to remember that this is
written by a guy who shines infrared
light at his
brain you know what if you show me real
evidence about this my priors are
against it but you know as as a good
rationalist when it comes to becoming a
better person if someone shows me real
evidence of this I will I will try but
then you guys you know won't accuse me
of being on drugs you'll just accuse me
of shining infrared light at my
[Music]
brain that that's really that should
really be the title of this
stream predict the next reception based
on the
popular here you guys are great you guys
are great man let's see well no that's a
good point
right that's actually a good
point we can know should I get out of
the stock market that's a good
question
huh I mean really if you overlay this
with if you smooth this and overlay a
graph of the uh Dow Jones I bet it looks
very similar
H okay so as you can see here judging
from these
graphs category theory was in
Decline from 2005 down to its base at
June 2008 if we look here at this graph
of the stock market
June 2008 was the start of the recession
so category Theory actually is a leading
indicator of recessions if you had just
looked at the downtrend and category
Theory from its peak around March
2005 hm this is really when the
recession sort of started and then this
here was all artificial
garbage I see this pump was fake
um but so here category Theory peaked
around March
2017 yeah okay so what we saw is a
continued run up of the
economy and um no Bitcoin Bitcoin is all
a scam manipulated by a few people in
Silicon Valley you guys if you really
think the the whole crypto recession was
engineered um no I'm not trolling I
actually think category theory is a
great way to predict recessions I think
this is this is brilliant economics and
I should write a paper about this and
think of how many citations it's going
to get it
involves recession predicting and it
involves uh category
Theory um Google transer leading
indicators are so much shit
Bro do dead talk about it I think it
would get I think it would get a lot of
views um no but okay so basically if I'm
ask answering the question I'm going to
I'm going to I was thinking like should
I pull my money out of the stock market
and the answer is we have a few more
years you can start to see a slight no
I'd say I'd say that's noise I'd say
category theory has remained pretty
constant since
uh since November of
2015 so it does say that this runup is
fake and artificially engineered but it
doesn't say that there's about to be a
recession like last time there was a
downtrend in in category Theory okay
good to know you can keep your money in
the stock market just keep checking on
the Google trends for category Theory
when they start to decline uh that's a
good predictor of recessions all right
cool
yo Mona Supreme see that's the deep shit
right like I wonder if we can pump
category theory in order to avoid a
recession see if the world started
accepting the hypothesis that category
theory is a leading indicator of
recessions but you know there's an old
saying that once something becomes a
metric for optimization it ceases to be
useful to predict anything so
unfortunately guys now that I've
revealed this truth now that this truth
is actually revealed by I forget who
said it in the comment but that was
brilliant shit but unfortunately now
it's not brilliant shit anymore because
we've observed it and as we learned from
category Theory I don't know I don't
think we learned anything from category
Theory but we did learn now that if this
actually becomes a thing it's no longer
going to predict recessions because it's
going to be an artificially manipulated
metric like GDP okay
good heart's law oh is is there actually
a name is that the name for what I'm
talking
about yeah yeah yeah yeah when a measure
becomes a Target it ceases to be a good
measure
yep good heart's law good to know what's
Campbell's law maybe it's a good
law the more a
quantitative yeah yeah that seems right
it's an adage is that like a derivation
of a
law oh I don't know man an adage seems
like a law but less of a
law delete the VOD yeah no we can't let
this video leak out man you going to
hear my my investment strategy is
destroyed
subscri only that's
good if we made a Discord group where
everybody signs up for Robin Hood and we
had a lot of people in our Discord group
we could like pump and dump penny stocks
and we could make a killing guys
two does not imply false wow damn we we
Prov
[Music]
that we will not give a definition of
set here but informally we'll think of a
set as a all right let's go back to
actually doing things like
here call asks the set of sorts but but
but it can't be a set because it has
sets in
it what what's the type of the set of
sorts
when only writes type yeah yeah so you
know the algorithm for
this algebraic
Universe printting universes
I
see yeah
man I could be the next Jordan beler you
know I think the fries be
right no
no ready
plate
plate I'm going to burn myself guys I
know it
already the Fri right
a
fry about the tenders they got to go
back in
just I'll salt on my fries oh yeah it's
perfect Saturday food fro
not 4K I'm in San Diego not in San
Francisco cost
3K
variables
terms the sorts are terms variables are
terms
x a variable Contin your terms
then for all X and
you if x
curs and
U for all act of type
T you depends on x
oh read Z te than you okay I
see yeah
yeah that makes sense this is sensible
stuff
right so a non-dependent product can be
if T than youu and that's what this
notation
is up here right you can see X is just
an underscore it can't it clearly can
appear in a in B so we'll just add on
note about
that
so if x is a variable
and T and you are
terms
then I don't think we do any funds we
don't do any
funds a function which maps elements of
te to the expression if tier you in
terms then invisible character is a term
that's upsetting where is
that metam zero what's metam zero
oh I just saw
this a bootstrapping fear
improver yeah this I have to do
this I mean this might be a better base
then cock might be too complex
[Music]
that was really
[Music]
cool wow metam mat's been around forever
[Music]
why can't YouTube load on my
computer I've used mandelay I like zoto
[Music]
better who is this guy
[Music]
this guy's famous I see his name in a
lot of places too
[Music]
[Music]
yeah I know lean is I know lean's
popular too I just kind of seized on
caucus was the first
[Music]
one a modern principia Mathematica like
how cool is that where is this
[Music]
guy hi there my name is David a Wheeler
and I'm here to about metam proof expl
as one of my dreams this is one of my
dreams to formalize from Maas
theorem mathematics has proven much than
just a few
principles however omitted steps and
lack of RoR lead toess and invalid hbert
posted a
wrong2 identified a missing axium in
ot's elements one that had not been
noticed for over
that
wait uid didn't know about the fifth
axom
really no but uid did know about this
which is the
missing all right we're going to go down
this rabbit hole
this is this is true uid was actually
incomplete what was
wrong posh
given three non-colinear points in a
line X not containing any three of these
points if x includes a point between a
and b
in a
plane if a line intersects one side of a
triangle internally then it intersects
precisely one other side
internally and the third
side
externally oh I see externally like like
line extense
the tenders are almost ready guys
you know I see people sometimes in the
comments on com archive talking about
how like they think they're going to
watch my stuff and like learn something
practical about programming and they're
not and if you guys have ever heard the
song Kiss Land by the weekend I think
the appropriate way to summarize this is
this ain't nothing to relate
to even if you try
you oh tenders oh
yeah I would never microwave tenders I'd
never do that who wants microwave
tenders when we can have oven
tenders oh yeah now that fry was burnt
oh check it out boys for chicken
tenders ah I hope they're
cooked pretty good Prett
good I wash my hands
guys but to be honest I'm here in
my 13th floor studio
apartment I'm not exposed to enough
germs now how could this not be
true I mean Yuk's fifth gets you like
spherical geometry hyperbolic geometry
and stuff that's
interesting one work that was designed
in part to counter these problems was
white brussel's pipia Mathematica which
really was an extraordinary work it
attempted to describe was my dream to
read this when I was younger from which
all math truths could in principle be
proven now girdle's later incompleteness
THS did show limitations with this
approach and not agree on some specific
set of accidents and rules still this
was an extraordinary
achievement but there are problems with
pipia
Mathematica it uses an obsolete dot
notation that very few people use today
and most people find hard to read some
its aims are not widely used or accepted
it was built on a concept of a hierarchy
of typ
today most work uses the zala Frankle
set theory of the the ACC of choice
instead it doesn't go very far in
mathematics this shouldn't be terribly
surprising since it takes volume two
before it can reach 1+ 1 =
2 navigation is simply not as easy as
web pages and how could we be confident
in its proofs yes they were smart but
even smart people make mistakes many
find rigorous proofs created with the
most basic principles be very compelling
but what can be that
better in particular can we use
computers today to help on the same
computer currently computers often can't
develop deep mathematical proofs but
computers are excellent at verified that
claim proof is correct given some aums
and rules of inference to use they can
also greatly simplify navigation what
this guy
hyperlinks this leads us to metab
metam maath is both software and
language for abstract mathematics it was
developed in 1992 by Norman
mcil it's an extremely minimal and
stable mechanism it basically defines a
very simple language but lets you state
axum and th proofs and those proofs can
build with other proofs it also includes
software that performs Pro verification
and Exposition verifier easily
reimplemented which is not to fors only
one rule substit
M that means that proof steps are not
hidden in code at all every step is
shown this has some interesting
ramifications proofs can be followed by
even non- mathematicians all you have to
do is learn one rule and every step can
be drilled out to AC via hyper oh this
seems much better the verifier is
relatively simple so it can be easily
reent leading to very high
confidence by reabilitation we can coun
potential implementation ER I think
we're switching to metamath you guys not
metamath there at
least exist for metth today the python a
python version for example has 350 lines
of code that includes everything reading
the lines everything there one
mathematic only 74
lines see I like this guys these guys
are hackers man these guys are Elite
if they think category theory is
cool then I think category theory is
cool
but if they don't then I don't think
it's cool I'm Outsourcing my thinking to
them on this
let's read this Pine up
this sounds like more like what we
should be
writing I work on Amazon and it
blows can I do more leak Cod here so I
can pass my Google interview no no
Captain California I really do
appreciate your subscription but I'm
going to try to give you advice that's
more valuable than that
I'm I'm not I don't know you're trolling
I if you're trolling me if you're
trolling me then you're trolling me but
but if you believe in what you're saying
then then n you're trolling man don't
found your own company just
like found your own company do whatever
you
do don't take VC investment man like
there's plenty of good
tutorials no no no
look
man I get it right and I don't want you
to like like don't feel you know don't
feel like guilt about it or anything
right
but it's not better at
Google if if if anything I'd even say
Amazon's a better company than than
Google and that's not to say that there
aren't like okay what team you want to
work on to Google
wait Amazon doesn't have free
food
really a this I love I love I love
chicken tenders
guys have threee
bathrooms that shit's funny man I can't
believe Amazon doesn't have free food
wa is this
true oh but like yeah they make you pay
for it but like you get paid more
it's I've been to the Apple cafeteria
it's very nice
what we have we have a free incredible
lunch at
K
yes like the Whole Foods and ingredients
the Lun is
great wait what you got to like go out
and walk to lunch oh that's
horrific oh I'm sorry
that sounds awful no I switched to
Google too fuck that Amazon should give
people free
food we don't
hire the bar for getting hired at Kama
is extremely high
um you
know oh there's some chicken tender in
my
keyboard
no all the other dirts coming out of the
keyboard
no all right we got to go clean the
keyboard I want to be back there's
chicken tender and the keyboard
oh got it out W that was
close well that could have been that
could have been that could have been
rock you guys but don't worry we got the
chicken tender out of the
keyboard oh man that was good life's
really good guys you
know I used to be more of a sucer for
free food but then I learned how to
cook you can cook too get chicken
tenders and put them in the
oven it's really the perfect food
chemical
packaged it's great
man oh you know we have cleaning staff
at this apartment yeah I bought a robo
Rock vacuum cleaner great
shit it's like a cell phone in a plastic
case the
packing everything's just a cell phone
in a plastic
case um but no if you're trying to learn
anything practi
from uh my stream that's not you're
missing the point and uh this ain't
nothing to relate to
[Music]
I have seen this before
we used to think that if we knew one we
knew two because one and one or two
we're finding that we must learn a great
deal more about and
we don't talk about Kam
AI yeah go to Uber if you want
h no no Travis kakik out I hear it sucks
now
what's Stratton
Oakmont oh that was Belford's
company that's year I was
bored made3 billion
what he fucking
snitched oh I sold the Razer laptop
sold gone
bye-bye I only like transparent onzi
schemes
two and four are complex
numbers the proof of 1 + 1al 2 is
different
but I at least like all this stuff at
least these people are saying real
things metamath seems just much better
than
cock like even this is written like a
programmer never mind this is just way
better we're done with cock we're we're
now writing metamath
stuff if feel like I learned the wrong
one so wait was that new paper
some what's this paper
incredibly fast 28,000 theists can be
verified in 5 seconds in a verion
recordable scene or about 1 second in
parallel
rust this leads us to the metagraph
proof
Explorer the metam proof Explorer MP
uses metam to Define classical
mathematical aums and related
definitions it first starts out by
defining classical propositional
calculus things like exponents implies
not by conditional and or constant true
constant
false but those are only about truth and
falsehood it then includes predicate
calculus which lets us to talk about
objects things like equality for all
there exists and those two parts can be
called
logic but logic can only prove truths
from other truths we need to have
something that leads us to zfc set
theory which defines the axes for sets
my question is can you code in
metamath for
yeah like I I love I love this kind of
like
say my daughters have been studying
chemistry for several semesters think
they have learned differential and
integral calculus in school yet even
today don't understand why x * y equals
y * X
who wrote
this this is like literally designed for
hackers they're speaking to
me what's this
book it's like some like hop stat shit
yeah look there you go this the first
book that comes up it's actually a
really good book I don't know I haven't
reread it as an adult I loved it when I
was
18 this is exactly what I did
number Theory
wait I just want to read this
book um
all right in conclusion I think that's
today's stream uh maybe I'll be back on
stream
later but um I love this PDF and I'm
going to read it for a bit and maybe
I'll be
back uh later but this is I'm not going
to sit you want me to read it with the
stream on all right we can read it we
can read it with the stream
on link it with the yeah
yeah for
not reading aloud this is actually
readable I only read aloud when I have
no idea what the hell they're say right
like this this is written like
narrative like I I mean I could read it
aloud but like this is the kind of thing
that you're capable of reading at at a
th words per minute right whereas like
the other
stuff I couldn't read even when I said
the sentence out loud
this is always how I felt about
proofs
for
for
for for
I mean this is exactly how these how
these books are laid out what what
they're saying here like this is exactly
what I've seen every time I've tried to
learn this
stuff this is like hackers discovered
math and did a good job at it damn
hackers
man for
there
exists is just not for all not
this is so
true well you have to realize that false
is just the set with no elements but
true is the set with one element you got
to understand set theory with in set
theory well you know you got to
understand logic so we can say like
there exists a set
[Music]
yeah was mtic
wow it really is a reading
stream real proof is not checkable by
machine or even by any mathematician not
privy to
the
lag an organized
hole yeah that is perceived as more than
some of the
parts mod of thought particular field of
mathematics
for for
damn
yo you get what this guy's saying right
he's like hackers are going to take over
math
yo yo that's like that's literally like
the hacker saying
man who is this guy
it's a meta language
Norman Miguel and David wheeler I've
seen David Wheeler's name before
too did he write a
compressor is it the same guy
no it's a different wheeler in the
Burrows wheeler
transform is this the same Norman Miguel
he's the president of the Boston
information group
and he has like a he has like a nobody
LinkedIn what is the Boston is this a
real
thing the
president went to MIT stayed in Boston
I don't think that's right
guys a contract yeah it's
possible it was also the death blow to
the formalist view Russell failed
yeah I mean when I read this I just
think about imagine you had to code like
uh Chrome in Assembly Language
right imagine you were writing Chrome
and like yeah assembly or like machine
code
yeah I mean this is this is classic you
know just think of how many libraries
Chrome depends
on Google CTF
um I don't like to I I wouldn't play a
uh is it
now oh qus are
over says June
think this cool stuff in the sandbox
category proc
box is it
code or is it do I have to decompile
G open an X
code
no can I make that the default I never
use x code
sorry we just got really distracted wh
why why why did I why did I agree to
look at
this my computer is really slow toight
I'm not doing this x code
no I don't know I said it
as right click open with a
there read the book not the chat all
right open
I I I hear it's worse in the new Mac OS
no we're we're not doing this we're
reading the
book wait we're not on level 15 of the
tangent this is exactly the point can we
prove true is not false we're still
getting to that
yeah hierarchy of theorems and
definitions hierarchy you guys
hierarchy don't don't get don't get it
twisted with all the nonh hierarchy post
modernists out
there a hierarchy of theorems
definitions permits an exponential
growth in the formula sizes and
primitive proof steps to be described
with only a linear growth in the number
of symbols used man that was so
upsetting I got that problem wrong in a
Jane Street interview
once yeah I'm going to code my own metam
verifier that's exactly where we're
going but but well you know we're not
going to do it this stream May we'll do
it
tomorrow today we're just
learning nobody no one shall be able to
drive us from the paradise that caner
has created for us
no you guys know I don't believe in real
numbers right we can we can get to
that but I think that well no it's not
that I don't believe in real numbers I
think that the real numbers and the
integers have the same cardinality
because UNC computed real numbers don't
exist I really believe
that you know what else guys you know
what's really cool about all this stuff
it doesn't make anyone any
money one of these days people are going
to figure out how to build technology
out of this
stuff
and yeah that's going to
suck and you can see it
already like eventually once these
things it's going to be like a plug that
you integrate with GitHub that uses and
the first people who do it are going to
be cool and are going to be adding value
but then you know give it 10 years and
those companies are going to be sold to
scumbags who are just trying to upsell
you on well do you want to run man man
this is all going to go to shit
too
a yeah well not cool is good man you
know one of the worst things that ever
happened was whenever they decided that
computers were cool if imagine computers
stayed not
cool then like you know all the all the
posers wouldn't have showed up and
learned stuff about
computers a man computers make too much
people too many
monies man I wish I was that those must
have been the days the home brew
Computer Club guess what man there's a
new home brw computer Club it's a home
brw car club it's people hacking on
their car cars bro we're doing it we're
doing it who's doing it all
right um yeah subscribe to my sh I
appreciate that I appreciate I only do
these twitch streams for money because
I'm a money grubbing whore that's right
home brw self-driving cars bro that's
what comma AI is we're doing
it um it's just exhausting to do it you
know and this this it's exhausting to
fight against the posers and the
bullshit it's like there's so much
bullshit and self-driving cars no
bullshit nobody's making fake metamath
you know nobody's raised a billion
dollars to like oh man we're going to
formalize zfc and like oh
yeah but this guy man Norman Miguel the
president of the Boston
definitely San say
contractor this book is one of the
clearest expositions of set theory
possible and it builds up set theory in
a most appealing way as an instructor of
computer science I've always
this how I feel man how I feel reading
this guy's
stuff this is so excited I'm so happy
this book
exists like he gets it he doesn't write
like category Theory
driil I bet after I read this book I'll
understand what category theory is
AR sportser has $400 million really
I don't believe
you spell that
right damn
what this is a
place that's an Austrian state
did somebody spell Syria wrong that
guy's not from Syria doesn't make any
sense this guy's a
winner yeah that was a real distraction
I can't believe you get you got me with
that wait imagine if we put a 10 bill or
so up cap on wealth then used it for the
environment should we ban people with
bad political ideas in this in the
channel let's give it the environment
man why we just go throw money at trees
that's gonna that's we're going to save
the environment man gr thornberg is
going to be so happy with us once we
threw all1 billion dollar at trees you
guys no money's made out of paper and
trees are made out of paper or is that
like trying to feed chickens to
chickens I don't know
man if you give trees money is that like
trying to feed chicken to chickens
chicken only
chicken yeah they're not mammals they
don't have
souls I know chickens will eat chickens
I
know how much is my net worth
man I'm not as rich as Donald
Schwarzenegger I'll tell you that
I'm not that rich guys I thinking of
buying a house this year though just so
I could be a land owner an American
landowner so I could have some some skin
in the game for America
right
um I'm thinking of buying a house I made
some money on an investment and I'm
going to sell I'm buy a
house no like look America's got
problems man but for the most part I
love
America like you know what you know what
I'll tell you one of I'll tell you
something I really love about America
right like America is the only country
where I feel like I have rights
everywhere else I've been in the world
it's I mean it comes down to kind of
this right it's the same sort of thing
it's
like it's it's not interpreted and I do
wish that the constitution were actually
a formal document but at least
like when something's resolved in
America it's resolved back to the
Constitution you can say that it's that
it's resolved wrong
but the fact that we have a document and
the fact that we have like like a
document which instead of you
know it it it is a white list almost of
what the federal government can
do it's become insane
but um no America look I think America's
gone through a rough 70 years but uh the
founding fathers and the whole whole
American System I I just you know that
that I've been running a company for the
last four years um realizing how
difficult Building Systems like that is
and that the founding fathers managed to
come together and build this system that
has lasted hundreds of years based on
principle not based on right not based
on might right like you can say
monarchies have lasted hundreds of years
but they've only lasted hundreds of
years because you haven't gotten a king
that was too stupid right like there's
no that's just a system based on
tradition it's not a system based on
principle um and the fact that America
is a system based on Prince of
all um it's just you know I really like
America yeah America is one is is one of
the only cultures where is formly
defined by smart people at the outset
yeah and and that's I just I I I love
that and you
know well I mean constitutional monarchy
what do you mean right show me show me
the the Constitution under which the
king of France operated I believe it was
just like divine right like why is he
King well God said he's
king
um founding fathers is such a meme name
no we've gotten generally we've gotten
better at governance over
time I don't know that much about the
history of the
Netherlands uh most of most of what I
know about
um the history of England is just you
know the American Revolutionary
history uh well so what China has I
believe is a tacit understanding with
the population um so when you look at
Chinese support you know Chinese support
for the Chinese government exceeds
American support for the American
government you know I I love America I
don't support the American government um
if I was a Chinese citizen in China I
may very well support the Chinese
government because you know uh just in
the 30 years of my life I can remember
when most of my fellow CI this is
hypothetical most of my fellow citizens
were living at as subsistence Farmers
out in the middle of nowhere hearing
about great wealth in the rest of the
world where people were flying around on
on on airplanes and and shopping at at
Whole Foods um and you know I I'm on a
I'm on a rice Farm man right and you
hear about that and
now you know to live in China today the
Chinese middle class is is
is it's what the American middle class
was 30 years
ago um if I were Chinese I would have
fled to the US I'm not so sure I I'm I'm
not so sure it's it's the Chinese
government right now and this doesn't
necessarily mean forever but it's
legitimately a a pretty good deal for
China don't ban me guys don't ban me can
I talk mad about the government if you
don't like what I'm saying just PayPal
me some remes and I'll say whatever you
want
um
oh wait I I don't know again I'm not
saying I'm not Switzerland I think
Switzerland's one of the particularly
good ones as well I think Switzerland
has quite a a good system no I I mean I
am talking about about uh like countries
in Southeast Asia um and places that
I've traveled where I don't think like
you know you go to Thailand I don't
think when I'm I think in Thailand I
can't insult the king it's not that I
want to insult the king but like who's
made this up is this
arbitrary um I I've spent almost a year
of my life in China this is just this is
just my takeaway from like going there
and talking with
people um no but okay Chinese government
is so bad that they're making a society
based on points I mean we have credit
scores right like it's not a lot of this
stuff is is really just anti-chinese
propaganda um from an American
perspective but it is true that the
people there don't have you know any
sort of
of uh rights based system like like we
do in America it's a tcid agreement that
the Chinese government will deliver
growth and they will continue to to
govern and so far that agreement's
worked out pretty
well
um Financial Credit is not the same as
social credit it it's I don't know I
don't know what the extent of that
system is I haven't really talked with
anybody who lives there about whether it
affects them um on a on a on a daily
basis yeah I mean America is a is a
society uh money is pretty important
it's
not super important but it you know the
American work ethic is around money and
the idea that like is money is fair
right um money is the only look if I
have a uh if I have a business I I can't
discriminate uh you know on any on any
category of of a person but I can
certainly discriminate based on how much
money they're willing to pay me and this
is the fair form of of discrimin ation
right now of course it requires you
buying into the American dream which you
know I'm upset that that people don't um
you know there may be bugs but the idea
is you know let's try to achieve the
American dream let's not try to throw
away the whole concept that there ever
could be such a thing as the American
dream it scares me when people say that
um you know yeah sure are there people
scamming yes but is the fundamental
concept of a system based on money
broken of course not um and it it it it
it works out and I don't know I mean
that's at least how I feel in America
America's let me do uh all wow this this
has really turned into this has really
turned into an America rant about how
happy I am about America and how I'm
buying a house to show my support for
America I'm investing in America I'm
buying a small plot of America land I
mean you should be a proud capitalist
right um the capitalism has is the
reason that we live in Paradise uh it's
not to say that there aren't better
things but it sure seems a whole lot
better than you
know um anything else we've
tried you want free food and shelter so
I can do nothing all day you know turns
out a lot of people don't but like I I
kind of think that's okay right like we
just need to figure out how to make food
and shelter so ridiculously cheap that
that's possible
theoretically right now there's there's
negative effects of capitalism right if
you have capitalism that's not is an
unfair sort of
capitalism where ideas are not being uh
you know people are things are not being
promoted based on their Merit um but
things are instead being promoted based
on
manipulation well you know that that
kind of ruins the
premise the the thought between
unregulated and regul ated capitalism I
mean yeah you can have I think
there's I believe there's legitimate
intellectual debate in that area right
like I think
that the idea that a truly free market
tends toward rent seeking I mean
fundamentally the problem is rent
seeking and and and how do you fix it I
don't know I haven't I haven't been
thinking about this stuff too much
lately but there is you know it's sad
what happens in in in politics that like
any hope of having um reasonable
discussions is completely thrown out the
window with
whatever conversation they have and like
you know you see conspiracy theory
people and they're like oh yeah they
want it that way I'm not even sure
that's really true um I think it's just
a form of
the uh what's the thing about like
people you know don't have an opinion on
SQL versus no SQL I brought it up in Lex
fredman they have an opinion on what
color to paint the uh the
office um yeah capitalism worst economic
system except for the others it's yeah I
I think I think in theory it's it's it's
it's pretty good um math men replaced
with the madman yeah I mean the the math
Man are are are better they're certainly
better uh I mean things tend to Trend
toward better it's it's weird it's it's
funny do it you know that's got
Alexander story that I love to talk
about
um yeah all right back to back to
reading
stream no my part of the Yang gang I I
don't like to affiliate with uh
you know groups like that I like like I
feel about all politicians I some things
Andrew Yang is saying I like some things
he says I don't like I'll say the exact
same thing about Trump some things Trump
says I like and some things Trump says I
don't like right and that's if you have
a position other than that politically
you're a moron right like like if you're
like I'm going to affiliate with this
gang and you're like you're not I mean
you're not you're not a moron you're
just you're just I mean you're you're
just subscribing to a tribe right and
unfortunately and and this just shows a
bug in the way that we're running
democracy right if if if tribalism
thrives the bug is in the system because
the tribalism doesn't help
anybody um so I'd like Switzerland like
referendums I'm not really sure what uh
they are why are you insanely happy
you're not a US citizen we do have an
onerous
tax
um the two- party system enables that
mindset H I'm not really
sure what are your Alternatives I mean
you can have you can have a one party
system or you can have a multi-party
system but they have their own sets of
uh bugs
yeah no I mean you want so uh Min Maxi
as a general rule you want to keep
uh you want to keep government as local
as
possible what if come one day you could
come to know understand that what you've
been seeing and knowing is not real will
I change
yes um yeah tribalism is inherent in
human nature but the opposite tribalism
is civilization and you know I kind of
like them uh why was I in China for over
a years various
things um don't pay property taxes see
who owns the land no I understand that
you're renting all land that you buy
you're you're renting from the
government right um and now government
actually uh even even with the tax that
you're paying it's actually a
surprisingly uh good deal um and now
that's not to say that like I support
government but like it is as bad as our
governments and as corrupt as our
governments may be they are certainly
preferable to Anarchy and if you want to
experience Anarchy go to Somalia right
you know you don't see you don't see
anyone buying property in Somalia right
of course when you buy land your your
your your property deed is worth only as
much as your trust in the stability of
that governmental
system
um I'd be ashamed the Judiciary how the
budgets within the government are
managed there be the same scale of
corruption within the government class
differences infrastructure in parts of
the
country yeah I mean yeah these these
things are these things are problems I'm
not really
sure there's corruption American
corruption is kind of interesting it's
kind of a shitty kind of corruption
right like instead of instead of like
you know you pay a 20 uh you know a
$20,000 bribe in order to get some
project through we in sense spent
$200,000 on investigating that the you
know it's a $100,000 project right it's
$100,000 project you could pay $20,000
bribe to get the project approved or we
can have a $100,000 project but then the
other side's committee has to spend
$200,000 on investigating that the first
100 was not spent corrupt corruptly and
we almost have this corruption through
anti-corruption um
yeah I mean but regulation see and this
is the whole thing I mean you know you
get you get maybe this is just like oh
this regulation's good or regulation's
bad no good regulation is good and bad
regulation is bad of course you're not
really saying anything when you say that
you're kind of like category Theory and
uh well I mean Fascism and any form of
of of
dictatorship um you know a cult of
leader right like dictatorship is not
inherently bad it's just a question of
who the dictator is a good dictator
outperforms democracy but a a bad
dictator so underperforms democracy that
democracy is actually probably on the
whole a better compromise right everyone
wants to live in a system with with a
good dictator I mean look at the guy who
built Singapore but when you're left
with
um you know bad dictators murder half
the population and uh that's probably
not a risk worth taking for a few more
percents of economic growth
right I mean that they the the downside
of dictatorship is is it's a much more
higher uh standard deviation uh
political system
I don't know I don't know that much
about life in Germany during the Third
Reich I was reading where's that
book my eye
books what's that book
uh Hey I was reading this the origins of
the second world
war um
this book's pretty
interesting it's not it's not like that
crazy it's mostly we think but like it
just goes
into uh I looked at Ross I thought it
was stupid I thought they invented their
own uh messaging system and they
invented their own serialization scheme
so we used CNP and zmq which are just
like well
established um messaging and uh and and
and it's libraries instead of a
framework and you always want to use
libraries instead of a
framework um a dictator molds a country
to his view not the view of the people
the view of the people is come on man do
you really believe in that
shit democ the will of the people is
just the new divine right guys it's just
the new divine right
when you say State capitalism do you
mean does that you mean like the
governmental system in China and what do
you mean by can succeed right what's the
goal only the wealthiest of the wealthy
model the nowadays world that's not
really true
um like to believe that those people
even have influence I mean that's you
know that's I think that's why
conspiracy theories are so popular um
it's because it's better to assume that
somebody is in charged even if they're
evil than to realize the truth which is
that nobody's really in
charge in fact the belief that 911 was a
conspiracy is is comforting in a way
because to realize the truth that it was
just like you know one random guy in
Afghanistan who's like you know this is
a startup man he started a startup and
the startup 911 right he hired a bunch
of guys right who was like what was like
a 15 person startup and they got
together and they got funding and yeah
right oh yeah yeah the world is rless
and that's the scariest fact of the
world that's exactly what I'm
saying um what did I think of Joker is
it realistic to apply to America dude
it's a movie about a super villain what
do you mean this is like like should we
apply Avengers to America man you
know oh can China overtake the US
economy
um I wouldn't bet against
it
uh I'd have to I'd have to look at some
graphs and then I'd tell you what I
think my odds are
I good books to pass linear algebra I
don't know
man what do they what do they have you
do in linear algebra I feel like I
learned linear algebra but not anytime
anyone tried to teach it to me I just
kind of like learned it after like
trying to do things with matricies for
deep learning how many hours do I code
throughout the day I don't know four I
don't think people can really I really
work on four hours a day
watch watch The
Matrix you want to linear algebra bro
just watch The
Matrix God made Man Simple man's complex
problems are of his own devising
[Laughter]
you guys are funny
man MP there you go man np. linow bro
looking to SP next year should I bring
my own bulletproof vest I heard from my
friend in Korea that this was a meme
over there too that like if you step
foot in America you're going to get shot
dude yes absolutely wear a bulletproof
vest absolutely
bro social media influencers are the
greatest T to humanity I don't know
about
that um how about this if you get
shot I'll pay your family $1,000 or you
if you're still alive if you get shot in
America and it's not like of your own
doing right like you're in one you're
involved in one of these random mass
shootings I'll pay you $11,000 that's my
deal wait what what do you mean we're
popular what's all those viewers wait do
we really have that many viewers is this
wrong
no we don't have that many viewers
you're making shit
up yeah yeah yeah
yeah K thank you for subscribing I
sh
no never mind never mind that's bad
incentives you don't get any money I
take it back I
lied never never mind you don't get shit
for getting shot you might get shot wear
a bulletproof vest invest in bulletproof
vest company spread meme invest in
bulletproof vest
companies yeah you know why people think
that because they read this stupid ass
News man the news is Dum as
shit you know what really is happening
everywhere every day in
America car accidents that shit's real
don't get into a car they're
scary new Hightech prevent car accident
start up that's a pretty good idea why
don't we have a device that sits in the
car and watches the road and warns you
if you're not paying attention and about
to get into an accident damn we could
save so many lives nah nah nah that's
dumb let's let's let's let's complain
about the
[Music]
guns now I see car crashes don't even
scare me as much as plane crashes and I
know that plane crashes don't even
happen but just the notion of like I'm
like in a Sardine Can and like you know
it just goes like that man you know and
cuz like you're just you're on a plane
where like the pilots don't even know
about mcast and it just it it it scares
me and the Boeing C CEO should be in
jail or at least not CEO of Boeing
anymore still flying a boing no some
boeings are really good though they did
just recall 737
and's um some us school kids are
learning small p PS about school
lockdowns to remember how to behave in
case of troubles yeah and like we did
the dumbest crap when we were when we
were in school right like now it's
shootings back when we were in school it
was bomb scares man you know some kid
like didn't want to take a test Next
Period so we'd like you know we'd like
uh go to the pay phone outside the
school put in a few quarters I'm going
to blow up the school if sixth period
math is not cancelled because I can't
take Mr starck's test
and this is what we had to do when we
were in school right and then we'd have
bomb drills right where they where
they'd bring in the dogs and the dogs
would walk through the lockers and oh
there's no bombs right and people fall
for this dumb crap over and over
again not nerd in school that was cool
in high school man
was class
clown um I did go to nerdy high school
though I don't know if I would have been
cool in a normal high
school no I know CL crashes are
rare no like just just from like a
visceral standpoint it scares me right
not like from a statistical
standpoint do I think artificial
intelligence can help make communism
viable because it can play on the
economy no but see communism is a
buzzword that means nothing right like
communism means and historically right
right like historically like Russian
communism Chinese communism all this
meant different shit right like they
just called it communism um it's like
what I was saying before about how they
put like peoples and Democratic and
Republic in the title right um do I
think centrally planned economies can
work
well it gets into what the notion of an
economy
is uh but yeah I mean sure as planning
power this this this this this
centralization and decentralization is
not a battle that's fully played out yet
some technologies benefit
decentralization some technologies
benefit
centralization um and it's gone back and
forth throughout the history of
technology and that's something that's
really
cool so clowns are cool clowns are cool
man clowns are pretty cool except not
the kind of wear rubber noses people who
act like clowns people who don't take
the world seriously man you know who
took the world seriously the person who
would get scared by like the kid outside
at the pay phone making the bomb threat
right you know what I would have done I
would have looked outside and been like
oh yeah Joey yeah I know how you're
going to do on your math test now oh I
know who didn't study come on back in
come on
selling devices with schematics was
common practice everywhere you
are the Russian the Russians enforced
open source software no we don't have to
enforce open source off for you guys we
just have to oh man you really want to
make change you really want to make
change in this country we need to get
rid of all laws around intellectual
property if there is one cause that I
actually believe in aside from marijuana
legalization
it's removing all laws trademark laws
are okay but copyright and most
definitely patent gone you can have like
a six-month
copyright one year one year copyright
you have one year one year one year
copyright no more patents and trademarks
are fine I don't want to go to
McDonald's and it's actually made by
mcdal oh the dnca is the most
unconstitutional law ever I can't that
just really shows you the corruption man
the fact it and who not the Safe Harbor
part of the dmca dmca anti circumvention
you know 1201 that's the most corrupt
law like that law is so blatantly
anti-free speech that like 2600 is sure
they're going to win and they don't cuz
they underestimated the corruption in
this country right like could you could
you could you believe that like like the
the courts ruled that publishing dexus
was illegal and that that for some
reason oh yeah well that's not clearly
that's not protected speech you can't
say that number that number allows the
the the circumvention of uh encryption
algorithms and clearly when our founding
father said free speech they didn't mean
to include the secret 09 number for
decrypting the HD DVD oh you know what
we're going to post it on my stream
right now fuck you
MPAA we're not going to post the Sony
number because that is too close to
home what's the number that hddvd number
you
know it's like oh no
yeah yeah wait do they does Wikipedia
post it ah Wikipedia post it boom yeah
09 f911 029
d74
e35b
d841 56 C5
6356 88
c0
yeah I know I know we got distracted
again today today really man today
really today today's been a
day um no there'd be plenty of
incentives for Creative D it's
just I all right we're really getting
distracted here you found the thing that
triggers me guys intellectual property
now I guess when I was younger I used to
just say that you could remove the laws
and it would be fine but I don't really
believe that
anymore um I believe it's Ben Shapiro
who said it there's a quote I love and
it's like you know the Republicans are
going to have to realize that the
Libertarians are right about government
and the Libertarians are going to have
to realize that the Republicans are
right about culture and like yeah if
that's true then just doing way with
intellectual property laws won't won't
really work because you'd end up with
like just a new a new set of scumbags
instead of the NPA and the Raa and
stuff star trekers Star
Wars um
I
mean let's just say that both franchises
have completely gone to shit with Disney
and JJ Abrams who made lost who the
first two seasons were good man but
could you please like if you could just
go back in time and after the fifth
seasonal lost you know the one on the
beach where it lights up white and stuff
can you let me write the sixth seasonal
lost I would follow all the fan theories
on Lost pedia I could have wrote
something so good but instead you put
out this driil that made no sense that
lost finale was one of the most
disappointing days in my
life
um he made
Felicity what I I like I vaguely
remember
this is this good who's Carrie
Russell damn she's
pretty this show looks great and at some
point we're going to watch Felicity
it helps spread College propaganda yeah
no I bet I bet it was legit good um is
Alex going to come today no Alex isn't
here today just
me we don't talk about Donald Trump on
this stream absolutely not absolutely
not talk about the ultimate derailment
talk about Donald Duck we don't talk
about Winnie the Pooh
either we definitely don't talk about
Angela
Merkel hey man you
know it wasn't the Kaiser and it wasn't
Hitler who took over Europe it took a
woman and that's
real no no no no okay okay okay okay
we're going to make one meta point about
Trump because I am just I am amazed I
was amazed when I looked this
up I was amazed like you think okay so
Trump's president and that's why all
these people are Googling him so much
this is Trump and this is Obama during
his
presidency like Obama during his
presidency Trump it's it's it's it's
insane and that's why we don't talk
about Trump on this
Channel programming can't be that hard
if this guy is important to the field
are you insulting me
exclamation pointy are you insulting me
I'm just asking you a
question car with the TR to cat going
here no no that that stuff that stuff
that stuff doesn't uh that that that
stuff uh you're only allowed to insult
me if you're a
subscriber you didn't mean to sub again
that was an accident well thanks for the
accident bro I appreciate
you all right wow wow wow that was a
long that was a long tangent yes we
don't insult people here that's right
that's
right we don't talk about the chair we
don't talk about the keyboard
$5,000 chair this is like job with the
yo I'm in a I'm in a $2,000 suit I'm in
a $3,000 suit
you going about
subl I feel like metamath is the suble
of math and O yo guys risk architecture
is going to change everything how preent
was that is that what that word means
preent sometimes I say words but I don't
really know what they mean
I spell pressing it wrong oh yeah no
that's the right word yeah how pressing
man it was in hackers in 1995 risk
architecture is going to change
everything and now take a look there's
more arm processors made than
Intel risk five man I
believe it is it is an a32 instruction
yeah
or it yeah yeah sub yeah I can I can
Leck I mean I can you can do if you're
an AR 64 if you're an arm mode the first
four bits determine the condition code
you can put conditionals on any
instruction risk five needed stable
extensions I don't know what that means
yeah the joke about Larry Page in the
chairs it's a good joke I think I have
to hold it on here
I sold my Windows laptop
all right
guys you know all too much of a
distraction from me reading so we we got
we got to go that was
just today was just distraction after
distraction after
distraction so so we got a we got to
it's not on
anyu um but I'm going to look at how
much money I made on this stream and if
it was a lot of money we're going to
stream tomorrow and tomorrow we're going
to try to write a uh write the metam
maath colel if some guy did it in 300
lines of python I bet I could do it a
thousand no no no no no we we we got to
go we got to go no no no no I I feel I
you know I love all you
guys
um
but we gota we got to go CU you guys
guys keep keep distracting me uh yeah
what's my plan for the rest of the day
to read this book in
peace
byebye bye
WEBVTT
Kind: captions
Language: en
tharda18: hi
chelsiquixote: morning George
foxubu: Sunday 7:00 AM
FargioFarmani: The champ is back
imaginenation: damn it's georgeee
steinerl: hi guys!
forkdb: Hi
zgamer0123: heyy
foxubu: Is only my stream frozen?
nightknight0000: 3 FPS
tharda18: no
alaouiib: frozen
forkdb: Big fan... what an inspiration you are...
programmerbugx: hi, looking great
f_karamazov: encoding issue
imaginenation: has a beast laptop and internet still so choppy
itoh0: 1fps
TheBloop: hello?
Smyile: Smyile subscribed with Twitch Prime.
worrasenule: Pog, i'm also working some auto prover based on coq atm
imaginenation: slideshow
Merwanedr: What's up Geroge!
mosin_lol: What laptop is he using ?
imaginenation: razor blade
imaginenation: I think
itoh0: now it works
imaginenation: finally
foxubu: ahhh got better
FargioFarmani: "Math waits for nobody." - George Hotz, 2019
forkdb: Please give me tips to be awesome programmer
Merwanedr: I thought it was about METAMASK
andrejnano: hi
vkoskiv: Yo George how do I make my programming streams interesting like yours?
programmerbugx: go live on instagram ! please,
imaginenation: "I'll show you how"
ZemkeCWT: He has sold his Razor Blade. He's on his MacBook 13-inch.
steinerl: @mosin_lol a 13" MacBook Pro I think
imaginenation: oh
spliitzxx: @vkoskiv use a letterlesse keyboard
spliitzxx: less
forkdb: Please give me tips to be awesome programmer
guccibruf: thats a lot of lines
SlightR6: Fuck that
f_karamazov: looks like ass
Cal3b123: send them a link to the refactoring book
vay_man: create your own
ctfnubz420: !uptime
foxubu: George is gonna jump out of the windows
forkdb: Please show me on how to be awesome programmer... like you
shirafx: anyone recomends a good switch for programming? i bought a blue switch one... it's hard and terrible :(
forkdb: It is hhkb
Avraewyn: LUL
programmerbugx: INSTAGRAAAAAM LIVE PLEASE 😎😎😎😎
takkeo: LUL
spliitzxx: lol
neca420: LUL
ragemaster999: @georgehotz have you checked out dlv?
thebastl: @georgehotz build a nice ui for it
shirafx: why did the moderator removed a question?
Merwanedr: I thought it was about METAMASK
takkeo: it's gonna blow your mind NotLikeThis
programmerbugx: HAHAHAH SO STRESS !
dannyboi22457: What IS metamath?
Number___Nine: yyay goerge is back
Number___Nine: !uptime
forkdb: Please show me on how to be awesome programmer... like you
frediiiez: !uptime
OnlyB1ade: So u finally gon do sum productive stuff?
spliitzxx: @forkdb no
Avelansh: and there are free RAMs
programmerbugx: DESCRIBE CHEAP RAM IN MORE DETAILS 🤣🤣🤣🤣
Number___Nine: so is metamath scam?
george_ortolan: There are the LEAN prove theorem too. I don't know if you have already seen it.
npeck0: @frediiiez about 10 mins
Merwanedr: I thought it was about METAMASK
f_karamazov: metamath needs a timeout
Lothsun: How's it going george?
ragemaster999: @georgehotz have you checked out dlv ?
forkdb: @spliitzxx Oknp
LeToutPetitChaton: We need to actually download more rams
Number___Nine: did you really read that whole pdf?
Merwanedr: Do something about METAMASK haha
neca420: real programmers use short illegible names Kappa
dannyboi22457: What is Metamath tho?
Merwanedr: nobody knows
zoki_macola: !uptime
programmerbugx: Where i can find all live sessions by GEORGEHOTZ ? Help
npeck0: @programmerbugx his YT
Merwanedr: youtube: Comma_ai
kektobiologist: can you stream something that i can understand
randoma1: I don’t understand anything of what he is saying.
brisingr1031: pen and paper baby, best proof method
okeeeeeee: allo
machinelearningbot: meth PogChamp
foxubu: Have you been awake all night reading this?
euranymous: Hey George!!
Number___Nine: lol
forkdb: Just chill and enjoy your beautiful day
Number___Nine: we use this stuff at work https://dl.acm.org/citation.cfm?id=2627752
okeeeeeee: maps = win PogChamp
programmerbugx: @npeck0 there are not every stream video of him ! tho
okeeeeeee: thats why you dont understand it
euranymous: can someone clip that hdmaps bit?
Number___Nine: because academics write everything in FORTRAN
FUSiONPlays: LUL
LeadCoder: I stream bro
Ziv0: LUL
euranymous: LUL
Sun__G: LUL
okeeeeeee: LUL
Incurs0: haha
frediiiez: LUL
DriHard: LUL
vkoskiv: Why do math people always refuse to name variables and functions properly? Is it like a law of math?
spliitzxx: lol
f_karamazov: amateur hour
SnakeOneMLG: @georgehotz tell us about meta math
f_karamazov: Ban keyboard guy pls
Number___Nine: vincexviii HHKB2 Pro
shirafx: maybe geo should put the fucking keyboard in the fucking description
serohh: Where are we on prooving true!=false ?
Ralph_124C_41: but these are the important things, who cares about anything else Kappa
Bombapil0t: what brand is your bed geroge ?
Number___Nine: serohh proved that yesterday
geobitz: why dont we talk about the keyboard
Merwanedr: GEORGE PLEASE DO METAMASK not METAMATH
serohh: Oh alright, thanks! @number___nine
okeeeeeee: monkaS
Ziv0: LUL
Incurs0: LUL
TheKoreanZombi: Let's get mindful!
MonkaSupreme: headspace bros
asaalgk: i refuse
Bernasv: holy
root_user_198: live meditation
shirafx: ask about timeout = keyboard
751469823: tf
jagger_rsw: whoa, DISTRACTIONS!
root_user_198: somebody donate
鼻史: seems like you earn money yesterday LUL
Jewishrambo: He's back PogChamp
jmc516: The legend has returned
RishabhDeepSingh: Holy tea
frediiiez: george just took a huge bong hits
frediiiez: he is spacing out rn
Bernasv: I feel the power coming out of your head Kappa
st47ik: PogChamp
jagger_rsw: he's hacking his brain rn
ts012839050: Is he turning to god mode?
ashimathilda: timout
st47ik: what hoodie is that?
ashimathilda: timeout
Ralph_124C_41: are we meditating? what is going on?
st47ik: Meditation timeout
jeann2019: mainfull
snapcs1: looks like Augur logo
iTzMeRafa: this isnt even his final form
directrix13: Hotzception
NotFire_: @Ralph_124C_41 please give him time, he is having his moring coffe, aka moring fap
GEEKASHA: is the guy sleeping?
bobsmash: damn I feel relaxed watching this guy
Bernasv: Omg It's envolving Kappa Kappa
prvk3: is he meditating or something
st47ik: achieving enlightenment
GEEKASHA: call 911
st47ik: deep focus PogChamp
鼻史: he is taking off latter
AntiVax_SoccerMom: i can feel my brain growing PogChamp
jagger_rsw: maybe he's got cardiac arrest, and we think he's meditating or sth
Mendacii_: THE SILENT FAP
AntiVax_SoccerMom: this is better than my laser pointer PogChamp
shirafx: quick, ask about keyboards while he's not watching
st47ik: NoNutNovember ez SeemsGood
shirafx: this is the content we need bois
jagger_rsw: is it this AMSR?
Yazik_Yz: I just failed no nut november when I saw George was live
directrix13: He's using mathematical induction to prove properties of his videos
NotKarar: Breathe in Breathe out Kreygasm
prvk3: this is next level content
st47ik: so deep MaN so deep
imsooinhuman: just joined in. what is going on? :D
orex111: what he is doing?
st47ik: he's hacking the simulation
raidersans: PogU
Yazik_Yz: I think he's meditating @imsooinhuman
jagger_rsw: probably watched too much of sam harris
shirafx: trying to figure out why java is good
wrelt: @jagger_rsw kek
Bombapil0t: troll
st47ik: @shirafx LUL
Yazik_Yz: @jagger_rsw not enough psychedelics
raidersans: asmr stream pog
prvk3: LOOOL @shirafx
Bombapil0t: damn troll
tris790: he's channeling his inner chakra
Maybay254: RedCoat
st47ik: Nice PogChamp
ts012839050: Finished?
Bombapil0t: Kreygasm
xyele: what's going on there man
directrix13: Haskell be with you, chat.
st47ik: sip of tea SeemsGood
Bombapil0t: metamath changed him guys
shirafx: when you forgot to lock an object
eduardoadf1: george did dmt again
Bernasv: The tea is essential PogChamp PogChamp
NigerianDrugL0rd: did he fell asleep
funwayz: ResidentSleeper
st47ik: why does he do it live tho
CondomsWontFit: HeyGuys
Jewishrambo: PogChamp 4Head
raidersans: xD
frediiiez: all real hackers do this @st47ik
grimers: favorite eminem album? @georgehotz
root_user_198: omg hes still going i went to make cofee XD
st47ik: damn
Bombapil0t: dont get exploitet by the voice geroge! stand by us
civilist: not sam harris?!
directrix13: Idear
Theguywhobea: i like this :)
shirafx: that was intense
snapcs1: clintSoft
jagger_rsw: nice world salat by this guru
shirafx: sony stand no chance
eduardoadf1: the journey is the answer GUYS @!!!!!!!!!
st47ik: im not 14 and this is deep
AntiVax_SoccerMom: why meditate when you can have a laser pointer helmet 4Head
st47ik: Augur hoodie hacked
TheKoreanZombi: Follow george on insta to get hi-res action shots of him meditating. Or maybe sleeping... Hard to tell.
mystkomir: how is headspace?
Bernasv: Good Morning Kappa Kappa
forkdb: Am now calm and got my composure back
directrix13: You're good enough You're smart enough and gush darn it people like you
MonkaSupreme: so calm Pog
Ralph_124C_41: lol
eduardoadf1: who is this calm guru
shirafx: he found jesus
frediiiez: have we even seen geo this calm?
st47ik: PogChamp
frediiiez: ever*
snapcs1: bob ross programming CoolStoryBob
shirafx: faith++;
atlbullyy: pass the blunt
Bernasv: Geo hotz is that you? Look like a new guy Kappa Kappa Kappa
TheKoreanZombi: Great start
st47ik: @Bernasv he's updated and fresh now
st47ik: BEEP MrDestructoid
raidersans: boop
shirafx: this is the leaked casting of joker
eduardoadf1: monkaS
frediiiez: @shirafx LMAO
jimmyjameshayes100: what is the point of a langauge like MM
directrix13: were the text based adventure games written in prolog?
TheKoreanZombi: I like how the PDF says the file is self explanatory.
anthraxvirus322: Hello Chat what are we doing today
anthraxvirus322: still solving yesterdays problmem ?
vincexviii: Twitch cock Pog
TheKoreanZombi: Why do you concern yourself with ai and metamath when you could just create a meditation app in like 10 minutes and live off the revenue?
anthraxvirus322: @TheKoreanZombi monkaHmm
st47ik: @TheKoreanZombi the point is not to make money i assume 4Head
snapcs1: probably something for verifying proofs @jimmyjameshayes100
myaocat: hi. what's up?
anthraxvirus322: just make money 4Head
TheKoreanZombi: @st47ik Then we are achieving out goal!
st47ik: twitch money is easier 4Head
TheKoreanZombi: *our
st47ik: true
UrWifeMyKids: LUL
AntiVax_SoccerMom: LUL
st47ik: LUL
frediiiez: LUL
eduardoadf1: LUL
Pryetranka: LUL
TheKoreanZombi: Oh no. Did he radicalize you?
meowtit: cmonBruh
anthraxvirus322: Bruh
st47ik: Bruh moment
myaocat: mixing math and templsos...
MrTriharder: George Stream Kreygasm
anthraxvirus322: agree SeemsGood
TheKoreanZombi: Entropy of choosing words yourself is not good though
anthraxvirus322: people have misconception about entropy
frediiiez: yep and easily can be cracked against dictionary attacks
prvk3: what's brain fuck
jimmyjameshayes100: learn lisp next
myaocat: @prvk3 it's fuck your brain
zenkai_oogway: @prvk3 its a language
anthraxvirus322: @prvk3 encoding of a sort
shirafx: i won 2.5k yesterday by bruteforcing a code that should have be found in our snacks, feels good
snapcs1: @prvk3 programming language for genius programmers
anthraxvirus322: stop trolling chat FeelsWeirdman
Mendacii_: META METH INCOMING Kreygasm
prvk3: am i doin it right
TheKoreanZombi: Let's fork metamath and use words. I nominate geohotz as lead dev.
myaocat: have you read about risc-v? It sounds good. I looked it a bit and company utilisize the architecture and made their SoC based on risc-v
worrasenule: quick question why metamath, i thought you were doing coq?
MrTriharder: is talking about old projects still banned? monkaH
Mendacii_: Only true meta math can only be achieved on arch linux
AntiVax_SoccerMom: worrasenule he read some paper on metamath yesterday and seemed like it much more
st47ik: RISC-V is the future Kappa
kkteja: Is there any old stream where george starts learning a new language and builds something?
myaocat: @st47ik money is the future TriHard 7
marvDE1: monkeys are the future
myaocat: yeah! they fix youtube
MrTriharder: George never age. He knows them all already
MrTriharder: learns*
MrTriharder: @georgehotz why are wikipedia articles of math and science trash?
myaocat: can we read about ada lovelace?
myaocat: monkaW
byte_baron: im late to the party here so what's going on exactly guys?
AlexiPexi: What's George's involvement in Comma AI today?
myaocat: @AlexiPexi don't talkabout comma ai please. this is separate thing ..
N0Pro: no comma ai in stream
st47ik: @AlexiPexi George doesn't talk about it on twitch
byte_baron: what is he doing on-screen exactly?
st47ik: @byte_baron metamath
myaocat: wash hands? WutFace
AlexiPexi: All right, thx for letting me know!
MrTriharder: dont talk about , ai monkaS
st47ik: NotLikeThis
myaocat: Gaben
st47ik: $e for essential hypotheses?
forkdb: Cannot understand what he is doing ####
solipsism: what are the use cases for metamath? i just got here
byte_baron: yeah what is the benefit of this exactly?
byte_baron: what's the reason for learning it?
Draco401: @georgehotz What language is that?
redmountain_: coq
byte_baron: it's coq i think
byte_baron: cok
byte_baron: coq
Am4teur: did you used glasses before?
Draco401: Thanks chat
worrasenule: it's metamath
myaocat: what is metameth?
st47ik: this is metamath
worrasenule: another theorem verifier system, similar to coq
st47ik: https://en.wikipedia.org/wiki/Metamath
myaocat: is this the hebrew alphabet?
byte_baron: this is elvish
AntiVax_SoccerMom: http://us.metamath.org/downloads/metamath.pdf he read this yesterday, it convinced him to move from coq to metamath
st47ik: thx mate SeemsGood
myaocat: it's hebrew alphabet
RockyJ0: Hello!
oksan309: Ur profile picture looks awesome SeemsGood
st47ik: MIIIU LUL
prvk3: the whole thing is ugly
byte_baron: was that whiskey
st47ik: nah that's tea
solipsism: i tihnk this is what people imagine programming is when they have no idea about computers
myaocat: how is it related to programming?
st47ik: i mean its math programming 4Head
prvk3: its for his backspace.ai
Santiago_LHC: Hello folks
myaocat: so it's not programming
myaocat: functional programming to prove math proof
byte_baron: it's proving shit
myaocat: yeah but that ain't programming
byte_baron: i know
Santiago_LHC: who cares
byte_baron: it's proving shit
jagger_rsw: RPN stack? Reverse POLISH notation? :) You see w/o my country it'd be possible for George to hack whatever he's hacking
myaocat: @Santiago_LHC you
myaocat: reverse german notation
JanTSV: ouh hey, just came
euranymous: Nationalism at its finest
myaocat: is that logic gates?
vlntnstts: my brain hurt
myaocat: can you debug the code?
anup_kodlekere: !uptime
prvk3: this stream makes me feal like an idiot everytime i tune in, i barely understand anything he does ever
crazywulf770: can someone explain for a laic like me what this is and what is it useful for?
anup_kodlekere: you dont watch this stream, this is for background purposes only
zgamer0123: @prvk3 ur not the only one xd
snapcs1: its for verifying mathematical proofs
zgamer0123: yes but george is the only one understanding all this shirt
anup_kodlekere: it's just a sneak peek into ho he thinks and solves problems. it's not really meant for us.
anup_kodlekere: how*
jagger_rsw: I was thinking that everyone is using ML to solve all known problems these days. Why not George train some model to write this proof for him?
myaocat: @crazywulf770 i assure you that if you TriHard 7 eventually you wwill get it
snapcs1: you guys obviously dont have a compsci degree lol
anup_kodlekere: thats bs. ML for everything is overkill
jagger_rsw: I hae comp-SCSI degree
crazywulf770: myaocat :-D
snapcs1: then you would know ML doesnt really make sense for this problem
myaocat: really
byte_baron: just ML it!!!
prvk3: @jagger_rsw he talked about that yesterday but i dont remember what he exactly said, i think he said he'd be really mad if that was the actual solution
TheTrueJonsel: What's he doing?
zenkai_oogway: just use ML bro 4Head
euranymous: is this stream for playing in the background just to distract me from my loneliness?
oksan309: Programming asmr LUL
worrasenule: people are ML-ing it, it's not very easy
jagger_rsw: just use ML
myaocat: @crazywulf770 i tried so hard and got so far but in the end it doesn't even matter
okeeeeeee: Clap
euranymous: LUL
anup_kodlekere: btw is he using browns?
Ziv0: LUL
anup_kodlekere: or blues?
Cal3b123: Did we prove MU can't be derived from MI?
CondomsWontFit: So cumbersome
syska: i hate c++ just putting it out there :)
myaocat: @syska really not matter
crazywulf770: myaocat yeah... looks very very very times 10 time consuming
myaocat: @syska c++ hate you back
anup_kodlekere: c++ sad...
myaocat: @crazywulf770 yeah that's how it works.
syska: :(
myaocat: in CTF, everything
prafaeltsantos: c++, is nice.....
myaocat: there is no free meal in life
myaocat: no free fish
listrk: metameth
euranymous: What keyboard do you use? @georgehotz
anup_kodlekere: @listrk lol
frediiiez: someone got timed out
solipsism: monkaS he asked
frediiiez: LUL
redIet_: HeyGuys
frediiiez: @euranymous read the description below the stream
LegalFever: what the fuck is going on
euranymous: LUL
Lefer_: He used to use one of the Leopolds without numpad, right now HHKB I think
Santiago_LHC: I see that we are already onto keyboard talk
syska: 300$ keyboard MonkaS
prafaeltsantos: @euranymous it´s a HHKB2, and we dont make that question bro, dont ask specs.....he gets mad
oksan309: @Legal just watch and enjoy LUL
Lefer_: The real question is why is he using vi instead of vim
solitaryyy: back to vim Kappa
rennerp: just for pleasure i guess
Infinitelym: are they not the same?
anup_kodlekere: how do you debug if you're writing everything in vi or vim
oksan309: @Lefer he likes it classic LUL
Lefer_: LUL
ppnn123w: he doing this on desktop or laptop
ghostfrommarz: the real real question is, wut is this
Santiago_LHC: Laptop
Santiago_LHC: Here is his setup: https://www.instagram.com/p/Bx0DMrUAxE-/
sirdicholas: sirdicholas subscribed with Twitch Prime. 
solipsism: do u rly think a 0 day is part of his threat model @myaocat
euranymous: Someone needs to make a meme about his keyboard
haircutjimmy: Hi George - good to see you streaming again.
ppnn123w: @Santiago_LHC ty
anup_kodlekere: cant understand shit
Ziv0: wat LUL
Lefer_: LUL
god_damn: get that guy outta here
Santiago_LHC: The hackers are always after the metamath
Malinax: millionaire metamath right here
anup_kodlekere: what is "the cloud"?
pizzamcprice: hi G
Bombapil0t: TriHard
euranymous: Can we do a ask GEOHOT stream?
VitalyzedTv: LUL
zenkai_oogway: LUL
Lazylion2: imagine asking about a keyboard
Mendacii_: VIM sucks
OsurdumGaliba: LUL
sulozor: nvim &gt; vim Pog
theduckthough: the audacity
zenkai_oogway: I am just here for the occasional rants
syska: ^ban this guy!
zenkai_oogway: monkaS
prafaeltsantos: oioioioi VIM is the GOAT
yodiggity4739: this guy bricked my first iphone Kappa
euranymous: ask geohot but no keyboard and machine stuff just some genuine questions!!
Santiago_LHC: If you are a regular, you'd know that the keyboard question gets asked every 5 seconds.
frediiiez: my programming editor is Microsoft Word
theduckthough: so how do they verify that their prover works
yodiggity4739: is he still working on self driving cars
oksan309: Easy easy smart boy not all are as smart as u BabyRage
Cal3b123: why would they commit compressed proofs
xenoshiva: @euranymous no but if he gets the same keyboard as geo he can be as great as him!!
solipsism: does whitespace matter in metamath or is it just for your own preferences
pizzamcprice: what is he building?
Santiago_LHC: @yodiggity4739 He is, but that's another bannable topic here
gluecks: what keyboard (piano) do u have? glueck4Chopin
yodiggity4739: monkaS
syska: @xenoshiva very true
sulozor: what do you do in your day-to-day life ? still on the self driving company? @georgehotz
theduckthough: what is you plan for how the language should look like?
Lefer_: cmonBruh
theduckthough: or just following the book?
prvk3: what's the .g file type?
solipsism: can u guys really not think of questions related to what he is actively showing us?
anup_kodlekere: grammar
euranymous: @xenoshiva LUL
yodiggity4739: what is he going to apply this math to or is it just for fun
Lefer_: as if any of us had an idea what is he doing LUL
prvk3: holy shit lark is so cool wtf
pizzamcprice: what is he doing? just typing random code?
Kimx_: Im enjoying him being productive while I am just lazy
Atlas03: the keyboard sounds so Kreygasm
solipsism: yes he is typing random characters and hoping nobody in stream notices @pizzamcprice
yodiggity4739: he is unlocking the secret math of the universe
euranymous: tmux and vim ; The only description of a one badass programmer
robotboy987: I think geohotz could be asmr influencer with his keyboard sounds
theduckthough: this is actually pretty cool so you create axioms and notation from first order logic (is it?) and then proof the truth of derived statements (theorems). do you use the ZFC or some other commonly used set of axioms for that then?
MrTriharder: Fun fact: all math in universe boils down to 1 TheIlluminati TheIlluminati
ppnn123w: outlook vs gmail ?
Atlas03: what is 1 then bubuHmm
pizzamcprice: @solipsism LUL but seriously what is he building?
MrTriharder: There’s asmr influencers now? DansGame
robotboy987: outlook is sucks
yodiggity4739: i think hes doing math puzzles
prafaeltsantos: what is a "1" fore aliens?=
Santiago_LHC: check the title
Cal3b123: 1 is the successor of 0
MrTriharder: @prafaeltsantos Zeta
euranymous: I dont understand shit but I like the energy he is putting into the work
solipsism: @pizzamcprice he's doing test exercises to see how he feels about metamath i think
theduckthough: in modern math we define one to be a set that contains one element so 1:={{}}
yodiggity4739: is there a command that lists all the bannable topics
Kimx_: use common sense
prafaeltsantos: @MrTriharder but that is a complex number
Santiago_LHC: Mentioning the list is a bannable topic
GryphoonAOE: what are you trying to program @georgehotz
yodiggity4739: monkaS
robotboy987: if I put so much work on Sunday I might graduate PhD in 4 weeks 😂
euranymous: LUL
worrasenule: looks like he's trying to build a metamath parser
pizzamcprice: @solipsism ah i see, danke.
kingb9b: metameth
MrTriharder: @prafaeltsantos Aliens have figured out working with complex numbers
theduckthough: "metameth" LUL
W1lkins: always types meth
ᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞ: ez B)
crazywulf770: a metamath WHAT?
W1lkins: suspect
GryphoonAOE: what is a metamath?
syska: meth-a-math :)
Santiago_LHC: Google is your friend
yodiggity4739: ah yes a metamath verifier 🍷 indeed
vmarkushin: meta-meth?
anup_kodlekere: metameta
MrTriharder: Chat don’t type drug references monkaS u might suffer the wrath of ban
xevilcorp: oh, he came back
prafaeltsantos: @MrTriharder maybe complex number for "them" is like "1 2 3 4 5" for us
Santiago_LHC: When he goes to the bathroom that's my favorite part of the stream, because I understand what is happening.
yodiggity4739: that looks like a pretty nice fridge
euranymous: What are bannable topics?
theduckthough: @prafaeltsantos that makes no sense
MrTriharder: @prafaeltsantos And our 1234 is their complex numbers
robotboy987: this guys just pees, programs and repeat..... jezzzz
Santiago_LHC: Bannable topics: Keyboard, setup questions, comma ai
zgamer0123: Metamath seems to be proof of mathematics
anup_kodlekere: @euranymous self driving cars, his setup
yodiggity4739: @georgehotz what kind of fridge is that
euranymous: and chews some eyes
euranymous: @anup_kodlekere Thanks man
prafaeltsantos: @MrTriharder lets make a series about this for History channel and get rich
zgamer0123: @yodiggity4739 do u wanna be banned? XDD
Kimx_: This chat is pretty bad, but overall the quality is still better than 99% of all other twitch chats that just spams emotes all day
theduckthough: metamath seems to be a language to formulate mathematical proofs for the computer to understand and verify
yodiggity4739: i asked about his fridge setup monkaS
MrTriharder: @prafaeltsantos Or we’ve only been thinking numbers on 2 axis. One is the real numbers. One is complex numbers. What about a 3 rd axis ? Kappa
iTeQo_: Damn wrong stream. I was looking für crystal meth
Kimx_: @MrTriharder thats called quaternion
anup_kodlekere: @theduckthough but how does it wrk though? you give it a theorem and it gets the proof?
prafaeltsantos: @theduckthough we are talking about "things" that fly on frisbee
MrTriharder: WutFace people actually know this ?
Kimx_: Yes
swills6: @mrtriharder third is imaginary
MrTriharder: What about 4th axis Kappa
n3bojsa: lol
Kimx_: That would be your mom
theduckthough: @anup_kodlekere we derive the truth of a theorem with axioms (statements that are just said to be true) so it checks if the theorem is not in violation of the axioms
MrTriharder: No aliens have figured out axis’s up to 5.
yodiggity4739: so u just need a bunch of if statements
yodiggity4739: 4Head
prafaeltsantos: @MrTriharder and if we and the 4rd axis and we can have a time correlation
euranymous: HELLOOOOOO
anup_kodlekere: @theduckthough niiice, well if I was in his place I'd probably just brute force for all inputs. I'm not sure that'd work though, not a mathematician
zoki_macola: hes pooping
gabrielpolastrini: i need laptops recommendations
AdmiraIGoldenRetriever: He's back, stream is froze, press F5 Kappa
MrTriharder: Aliens have a 5 dimension Pythagoras theorem :)
anup_kodlekere: lol
euranymous: There's actually a third dimensional pythagorean theorem
theduckthough: @anup_kodlekere no you have to construct the proof with logical connections of statements and theorems and what not that doesnt really make sense to bruteforce
euranymous: Its called the super pythogorous relation or something like that
MrTriharder: DansGame
Number___Nine: what
yodiggity4739: this is hard to understand maybe i should just stick with watching pokimane
prafaeltsantos: if I ask @georgehotz about is process of getting verified on Instagram i will get a ban? UWot TheIlluminati TearGlove
MrTriharder: How do u people such things DansGame
anup_kodlekere: @theduckthough this only works for discrete mathematics right? like predicate calculus, logic and shit?
euranymous: JaVasCript:alert(document.cookie)//
Akash_44: 5Heads in chat
Number___Nine: I though geohot ragequit metamath
euranymous: LUL
solipsism: pokiW
prafaeltsantos: Pythagoras has a alien from Delta 69
aPosterior: @theduckthough that insistance itself is an axiom, not to mention its details
robotboy987: @georgehotz is living eat shit program repeat... damn
Number___Nine: living the dream
anup_kodlekere: can I ask interesting projects to implement in python? or will I be banned?
MrTriharder: What if the Big Bang was an aliens firecracker for New Year’s Eve? 5Head
Kimx_: youll be banned if you keep asking if youre gonna get banned
iTeQo_: Pythagoras stole from reddit. Check twitter
euranymous: LUL
robotboy987: @anup_kodlekere make a twitch bot
luckiehem: hey man what chair u got
Bombapil0t: TriHard
yodiggity4739: can we ask who his favorite female streamer is
theduckthough: @anup_kodlekere depends what kind of logic some statements cannot be made with first order logic (which i am guessing this is) but most of mathemtics can be done with this logic for sure (if you're interested in this from the ground up reasoning the the bourbaki group might be for you)
grizvok: holy shit my wish is granted
grizvok: george is streaming again
n3bojsa: @georgehotz whats the hoodie ur wearing?
grimers: georgehotz whats your favorite eminem album
Number___Nine: it looks like a gnu make
grizvok: grizvok is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel! 
grizvok: grizvok gifted a Tier 1 sub to jagger_rsw! 
grizvok: grizvok gifted a Tier 1 sub to W1lkins! 
grizvok: grizvok gifted a Tier 1 sub to twiggy_io! 
grizvok: grizvok gifted a Tier 1 sub to Orestes13! 
grizvok: grizvok gifted a Tier 1 sub to knilecrack! 
MrTriharder: Subaru release monkaS
yodiggity4739: i got one Pog
W1lkins: Pog
Number___Nine: husky
alreye: lol
MrTriharder: I dodged it PogChamp
grimers: PrimeMe
AdmiraIGoldenRetriever: PogChamp DODGED
yodiggity4739: these hackers are at least 70 years old
Jannnik: dodged Pog
Bombapil0t: @grizvok u can ask him about his keyboard at least 5 times now gz!
MrTriharder: @admiraigoldenretriever Do u come on bulldogs stream? Billy336
Akash_44: pog
salpu_: ryrySkime ryrySkime ryrySkime
zenkai_oogway: PogChamp
ᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞ: KappaCool
grimers: Pog
alchemist_ubi: hahahahahaa
syska: lOl
euranymous: George I really wanna thank you for inspiring me.
worrasenule: monkaH
grizvok: THE POWER.
Bombapil0t: :D
yodiggity4739: monkaS
Number___Nine: ban the planet
ᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞ: MingLee
iTzMeRafa: xDD
parse: ban me :)
alchemist_ubi: Twitch chat OMEGALUL
luckiehem: lulz
Akash_44: monkaS
alchemist_ubi: monkaS
zenkai_oogway: MonkaSupreme
tris790: gratz
zenkai_oogway: monkaS
alxhotel: grizvok dont ban me plis
mathieu_696: PogChamp
salpu_: LUL
Zanfr1980: money power!
alreye: He bought his way in LUL
yodiggity4739: money PogU
alchemist_ubi: actually true KEKW
euranymous: @grizvok Congratzz
prafaeltsantos: can a mod ban himself?
mathieu_696: true lmao
guy_ross: guy_ross subscribed at Tier 1. 
Number___Nine: ban geohot
euranymous: LUL
alxhotel: a mod for the mods ?
MrTriharder: monkaS
nesaniica: grizvok, give me a 5 minute timeout FeelsGoodMan
alchemist_ubi: imagine using LUL in 2019 KEKW
euranymous: Every thing is in your github repo right @georgehotz
theduckthough: @georgehotz what does statement mean in this context?
grizvok: I code in php for my work fml
grimers: rip
randoma1: Rip
alxhotel: php will survive python mark my words
tris790: feelsphpman
Bombapil0t: you can afford subs so that's fine i guess
euranymous: RIP
grizvok: why they decided not to go for a python web framework i will never know
W1lkins: it will at least survive 2.7 alxhotel Kappa
syska: g++ compiler is so nice the error messages are very understandable PepeHands
yodiggity4739: i code in wingdings and then convert it to english
MrTriharder: Php more like RIP KEKW
euranymous: george might remove you as a mod @grizvok
W1lkins: grizvok you're at least on php7 right?
nesaniica: php mods DansGame
alxhotel: yep W1lkins
notmap: wat u doing?
grimers: so this means this channel fully endorses php?
grizvok: @W1lkins yep. I've only used php for 4 months since i've been at this new company. Honestly this web framework symfony is pretty nice.
alchemist_ubi: php best language ever Kapp
luckiehem: php is great
grizvok: But I'd rather be working in flask
duzy: Whats the best 1st lang to learn
MrTriharder: It isn’t a language when everything is global is it?
theduckthough: english
dr_koili: Laravel is amazing. Shame its so tainted with the baggage of old php
notmap: php is garbo
alxhotel: @duzy brainfuck
duzy: nice
Bombapil0t: asmr Kreygasm
grizvok: php doesn't really have that global problem anymore so far as I've seen
luckiehem: @dr_koili i agree
euranymous: George are you into esoteric languages?
alxhotel: php 7 is much better than previous versions
twitch7443: morning people
Cetewyn: topre keyboard Kreygasm
randoma1: What is he coding?
Attlantiz_: whats up george
syska: best language is lisp
theduckthough: so does metamath allow you to abstract away smaller theorems?
yodiggity4739: he is coding a simulation of the universe
W1lkins: which language is best for building a parser such as thing @georgehotz
robotboy987: if only topre was cheap FailFish
Cetewyn: cheap keyboards LUL
Attlantiz_: he does
alchemist_ubi: what is he coding btw?
MrTriharder: Ban monkaS
Number___Nine: alchemist_ubi metamath parser in pyton using lark
MrTriharder: Never talk about drugs here monkaS
xrealyy: he's coding metamath kind of thing
alchemist_ubi: what the heck is metamath perser?
Attlantiz_: methmat
Attlantiz_: george have you heard about flutter
alchemist_ubi: is that eatable? I see a lot of metamath people in LA
EderDG: have you ever tried coding for 3D animation?
grizvok: he messed with unity i think for a bit on stream a while ago
YouPowerRush: ayy lamo
st47ik: Unity was for AR stuff
annasgrasshopper: you followed me on linkdin haha
Attlantiz_: flutter is cool for mobile apps
alchemist_ubi: monkaS
annasgrasshopper: followed me back*
nesaniica: no drugs, no keyboards and no iphones in here
Bombapil0t: just tea and metamath Kreygasm
Attlantiz_: just android
W1lkins: no iphones? DansGame
alchemist_ubi: higher what? I am having English trouble
Attlantiz_: Kappa
syska: communist
nesaniica: also no self driving cars, we dont talk about that
theduckthough: 1000 iq audience
Attlantiz_: I wish I knew more about that stuff
Attlantiz_: coq and stuff
alchemist_ubi: hahahahahah
robotboy987: let's talk about simulation
Tusk_TV: get banned nerds Kappa
grimers: what if im not smart monkaS
bool3max: that's why chat rooms are coming
MrTriharder: Like me? :)
MonkaSupreme: hello i know nothing about that stuff, but im subbed TehePelo
ickystickybandit: let's talk about Jesus
raulciuntastefan: can i hear an amen ?
0x7f_: im 12 what is this?
YouPowerRush: haha
4play_: Did someone mention drugs?
n3bojsa: @georgehotz where is that goodie from?
Attlantiz_: what are you doing in this stream?
n3bojsa: I see you wear it quite often
alchemist_ubi: well dude, how the person knows if he is smart or not if the person doesnt speak in front of smart people?
Attlantiz_: what does the python script do?
P4NiiC_LIVE: everytime I come here I feel dumb LUL
alaouiib: are u smart 🤠👨💻
Hellsing14: free speech for the dumb
whichtom: How long has geo been live for today
AdmiraIGoldenRetriever: my mum said i am smart :)
MorbidlyBrobese: this is my favorite dictatorship
st47ik: LUL
alchemist_ubi: I could be the smartest person in the room inside my head LUL
grizvok: @alchemist_ubi their achievements?
Attlantiz_: what does the python script do? isnt that metamath?
n3bojsa: fkin nerd
alchemist_ubi: @grizvok that is the most basic answer you could ever give, think deeper, that is too basic
grimers: this chat is in big brain mode now
nesaniica: LUL
MonkaSupreme: LUL
raulciuntastefan: lol
st47ik: rekt LUL
prafaeltsantos: LUL LUL
MrTriharder: All the chat peeps show us your 5Head
Wansie: LUL
raulciuntastefan: cannabis is life
YouPowerRush: haaaa
MrTriharder: LUL
Attlantiz_: can anyone please explain what the python script does
tris790: LUL
Bombapil0t: no drugs @Cetewyn
alphagainzzz: LUL
solipsism: i wonder if slow mode would help
YouPowerRush: &lt;message banned&gt;
prafaeltsantos: a fcking love geo, he always makes my day
grizvok: @alchemist_ubi sorry that literally means nothing to me
markovrandomfield: What about Lean? :tf:
Attlantiz_: is it a parser for metamath?
grimers: cmonBruh
beninr1: Hi from Kosovo GEORGE
ProfElements1: @attlantiz_ He making a python script to verify the meta math things he is doing.
mexeroserisback: Yeah Lean seems nice
Attlantiz_: oh, but doesnt metamath do that?
Attlantiz_: wait is metamath like coq?
st47ik: we need a bot that detects keywords and bans ppl for talking about the forbidden stuff Kappa
Attlantiz_: ^
oksan309: celluOoof
InertPackage: Are you typing in QWERTY?
grimers: doesnt nightbot do that? @st47ik
InertPackage: Hi brow people only type in Dvorak
theduckthough: keyboard man bad
InertPackage: Kappa
st47ik: stop talking about keyboards NotLikeThis MaN
MonkaSupreme: @theduckthough bye
euranymous: You better subscribe
MrTriharder: Every time George looks at this monitor, someone gets a ban monkaS
theduckthough: ahsh
Bombapil0t: and follow on instagram asap @InertPackage
MonkaSupreme: @theduckthough sub or die riPepperonis
InertPackage: I'm too high brow. I don't use instagram, FB, or Twitter.
st47ik: the bio literally says it all btw
euranymous: George seriously deserves a verification badge in instagram
InertPackage: I occasionally reddit. That's about it.
alchemist_ubi: @st47ik LUL I didnt see it monkaS
grimers: damn u must be real smart
InertPackage: Like front page /r/iamverysmart
UMPS: but you're on twitch so you're back at 0
alchemist_ubi: just get them 4Head
forkdb: Use PyCharm instead
alchemist_ubi: yeah use PyCharm monkaS
MrTriharder: monkaS don’t talk about editors
alchemist_ubi: I am not smart monkaS
UMPS: is he running tmux?
TheRealFreki: why don't you add keyboard cam :)
solipsism: yes @UMPS
UMPS: i like his setup, it looks nice and clean
Number___Nine: UMPS tmux and vim splits
MrTriharder: For whatever reasons I can get fast enough in vim
MrTriharder: Cant *
zoki_macola: https://twitter.com/elonmusk/status/1159655968369565696?lang=en
alchemist_ubi: @MrTriharder dont worry, I will just take you 3 years to get tehre
prafaeltsantos: the real question is, we will have breaded chicken agen?
Keyeh: can we talk abou treelon musk george?
Number___Nine: Microsoft Word
lazystoic: I'm too stupid to understand whats going on here, please explain someone
Number___Nine: for ASCII editing
alchemist_ubi: I think Twitch chat is too smart for him monkaS Imagine taking it seriously LUL
alchemist_ubi: I should Jebaited but I will get ban thou monkaS
MrTriharder: At least we dumb people get to be on YouTube FeelsGoodMan Clap
solipsism: what is the difference between Jebaited and being actually stupid though @alchemist_ubi
alchemist_ubi: @solipsism your comment
UMPS: monkaS
Keyeh: we can't talk about comma.ai in here
ᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞ: monkaS
alchemist_ubi: @MrTriharder will this be publish to YouTube monkaS
MrTriharder: @alchemist_ubi I think
grimers: monkaS
MrTriharder: monkaS
FackingNeckbeards: what is he programming in?
alchemist_ubi: @FackingNeckbeards Python
FackingNeckbeards: what IDE?
Wnb_Gosu: george, do you play some games ?
MrTriharder: Very
MrTriharder: Vim
UMPS: i'm watching someone else program so i feel less bad about wasting time while not programming
solipsism: stop asking setup questions guys this is not that hard
solipsism: literally 30 seconds and another setup question
VitalyzedTv: what text editor is that? ( im a noob )
solipsism: 0 seconds
Wnb_Gosu: google it
grimers: LUL
OnlyB1ade: wait... when did u go live again?
AntiVax_SoccerMom: like an hour ago
MrTriharder: @solipsism What wire is he using? :)
grizvok: wait changing my editor doesn't make me a better programmer?
prafaeltsantos: !uptime
alchemist_ubi: Hello Google: what editor does george use?
grimers: it makes you a better programmer if you use vim
yaus_baus: !uptime
UMPS: &gt;:|
alchemist_ubi: @grimers it makes you a better typer, maybe LUL
PepeHypers: @grimers no
maskerlive: !project
345kiwi: what's going on right now lol
vmarkushin: @PepeHypers of course yes. Didn't you know that?
yaus_baus: how long has he been streaming
UMPS: how old is everyone
UMPS: im 12
Attlantiz_: I'm 5
MrTriharder: monkaS
maskerlive: im 60
alchemist_ubi: @scorpiocyborg Jebaited
alchemist_ubi: monkaS
hazrid93: wow basic programming? just the basic right sounds easy Pepega
Attlantiz_: Kappa dude got banned
FackingNeckbeards: nice kitchen tho
worrasenule: Krappa
krakendmp: krakendmp subscribed with Twitch Prime. 
alchemist_ubi: I feel bad for him now heheheheh
VitalyzedTv: dont ban me pl0x monkaS
Keyeh: this is his bedroom though @FackingNeckbeards
ᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞᆞ: RarePepe
Keyeh: LUL
yaus_baus: hey george, quit my job after yesterdays vod, will be homeless soon. what do next? luv stream btw
FackingNeckbeards: i didnt even notice the bed LuL
Bombapil0t: its called cloud @Keyeh
Wnb_Gosu: what does he even trying
Wnb_Gosu: cant figure out
cybermajestic: hello george
aureal1: imagine mentioning the word keyboard Kappa
Sniky83: Hi Georges, are you still in hacking area ?
c4rb4rus: please find an exploit in the simulation, George
alchemist_ubi: yes yes monkaHmm
InertPackage: Terribly low brow people that come a channel playing in "Basic Programming" How can these idiots not realize High Brow only in Basic Programming. If you want your copy pasta go to Science and Technology plebs
FackingNeckbeards: what?
grimers: georgehotz whats your favorite eminem album
grizvok: yes, yes they did
dorkmo: yessss
yaus_baus: i wish i was intelligent enough to say highbrow stuff
alchemist_ubi: alchemist_ubi subscribed at Tier 1. 
alchemist_ubi: chat I am big brain and you are not LUL
dorkmo: every once in a while some random dude thats an expert shows up tho
alchemist_ubi: get rekt
alchemist_ubi: monkaS shit shit
alchemist_ubi: @dorkmo like me Kappa
Wnb_Gosu: test
Number___Nine: C++20 though
AntiVax_SoccerMom: i mean its from like the 90s right?
forkdb: Ok np
VitalyzedTv: yay &lt;3
dorkmo: TheIlluminati TheIlluminati
MrBankster: howdy
grimers: what inspired you to start this project george
zoki_macola: test test 123
dorkmo: MercyWing1 TheIlluminati TheIlluminati MercyWing2
AntiVax_SoccerMom: why not DansGame
eeqeq: hi
Number___Nine: video is gone, oh no
Rojaster: some coke I need to get it through
Bombapil0t: freeplebs yay
worrasenule: so xx means a node in ast monkaHmm
Number___Nine: and it's back
yaus_baus: jesus fuck the miu2.mm looks like heiroglyphics
Number___Nine: yeah, even APL looks readable compared to that
euranymous: my brain needs some steroids to understand these
xHardcorexism: supp
grizvok: @euranymous just use near infrared light bro
yaus_baus: is the dollar letter like variable assignments in bash?
euranymous: @georgehotz Can you zoom a little bit
euranymous: @grizvok Looking forward to it
script_sh: there is a box on the floor
4e696b6c6173: hi
CaptainAshtar: apple ofcourse...
euranymous: LUL
preporyan: LUL
CaptainAshtar: i thought it would be chips or ... cheetos but an apple
MonkaSupreme: how can one quit working for the man? @georgehotz
euranymous: eating apple instead of buying iphones
MonkaSupreme: damn thats deep
scorpiocyborg: @euranymous u should become a rapper
endeavor_42: hey what's up
CasparBaIT: oi
preporyan: OK, what is he doing? I'm not familiar with all this at all
brisingr1031: @georgehotz how much time a day do you spend coding/reading about cs stuff?
euranymous: @scorpiocyborg Will drop something on sound cloud someday
CaptainAshtar: whats behind intelligence i really don't understand how a person can develop such brain power to do all this can someone explain
AntiVax_SoccerMom: CaptainAshtar try shining infrared lights at your brain
grizvok: Yes
yaus_baus: george been doing this for years man
yaus_baus: @CaptainAshtar
CaptainAshtar: i said intelligence not monkey ticks
ridolf88: why people asking about his keyboard is it like a meme or something?
mitchell_344: Brains like a muscle, you work hard and it will grow
CaptainAshtar: infrared lights ... couldn't you think of something else ... pills, food, toilet water
Sublimus7: dumb questions get dumb answers
ProfessorMagikarp0: how was the rest of the book without chat LUL
mitchell_344: hes using the Happy Hacking Keyboard Pro 2
euranymous: https://news.ycombinator.com/item?id=21042018
euranymous: LUL
yaus_baus: honestly if i wanted to actually follow his work rn i would need to spend a week writing a proof in metamath
scorpiocyborg: @mitchell_344 watch out you might get banned for saying the M-word
Sublimus7: @euranymous holy shit what am I reading
scorpiocyborg: K-word*
euranymous: Infrared lights
CaptainAshtar: wtf is that related to your brain i don't undestand
AntiVax_SoccerMom: k gonna read a 240 page book so i can watch the stream SeemsGood
ProfessorMagikarp0: chat got an F on homework PepeHands
yaus_baus: was busy doing EDA :(
MonkaSupreme: have you read the book?
AntiVax_SoccerMom: i read the preface PogChamp
euranymous: @AntiVax_SoccerMom Or just get your child a polio shot?
Keyeh: in life sometimes there is question marks :)
raulciuntastefan: what book ? metamath from metamath.org ?
Sublimus7: was busy pursuing my dreams of being a rapper
AntiVax_SoccerMom: euranymous that causes autism honey
yaus_baus: book: http://us.metamath.org/downloads/metamath.pdf
TheKoreanZombi: This chat is 30% "What IDE is this", 20% banned topics 40% "Durr this is hard.", and 10% useful talk.
yaus_baus: thats what hes referencing
euranymous: @AntiVax_SoccerMom You're funny
raulciuntastefan: thanks
Santiago_LHC: @TheKoreanZombi that's mankind for you
endeavor_42: !time
mufeedvh: hey George, can i work with you?
grimers: 10% is really generous
Sublimus7: !uptime
annasgrasshopper: you should try program with Kerbal Space program and ebat SpaceX at their game
CaptainAshtar: that's because the stramer is doing monolog all the time
TheKoreanZombi: @grimers True. and useful is overstating it as well.
yaus_baus: @Sublimus7 based on his first commit in the metamath hes been streaming for over an hour
Santiago_LHC: Two hours
yaus_baus: @Santiago_LHC thanks
euranymous: @georgehotz Do you have a plan of writing a book about something in future?
Number___Nine: a book about metamath
euranymous: or about not working for the man
yaus_baus: if george says its weird.... lol
endeavor_42: !uptime
thekillerens0: !keyboard
thekillerens0: !timeout
Sublimus7: classis arc of computer programming right there
VitalyzedTv: !commands
Sublimus7: classic*
davidbarreroo: lil recap ??
death_gadget: Isn't the end tag $) not )$
swagettiyolonaise69: "basic programming"
keetio: sup georgio
Sublimus7: @death_gadget ... nice
DasMastah: The end of the regex is wrong
DasMastah: It should be $) not )$
euranymous: the basic programming should be changed to 'Brainfuck'
CaptainAshtar: its correct
essSau: is that vi or vim
essSau: with emacs
euranymous: vim is improved vi
yaus_baus: vim with tmux
Rezii27: Hello
Rezii27: i really need to learn vim
CaptainAshtar: learn it then
euranymous: add powerline to the mix and you have pimp of all terminals
VitalyzedTv: how long does it take to learn vim?
Bo0sted05: what are you doing exactly?
grimers: why do you "need to" learn vim ?
yaus_baus: @VitalyzedTv not long man, just use it as your text editor and youll get faster with time
euranymous: learning vim isnt that hard
DR4GOM1R: what is he making}
DR4GOM1R: ?
AntiVax_SoccerMom: Bo0sted05 i think hes trying to prove the MU puzzle in metamath
euranymous: just print out a reference and keep it near by and you'll remember everything after some time using it
yaus_baus: or just google the commands/motions for vim as if it was syntax for any other language
VitalyzedTv: ok thx for the advice
yaus_baus: theres a vim plugin for metamath george
Number___Nine: http://emetamath.tirix.org/
yaus_baus: https://github.com/david-a-wheeler/vim-metamath
yaus_baus: idk if useful
grizvok: it might be
yaus_baus: oh lmao its by david a wheeler
alxhotel: a
breadhamandcheese: ello
yaus_baus: yeah ill admit i google and paste before reading
alxhotel: so the aim is to do a verifier to verify metamath programs ?
yaus_baus: lmao
0xh4sh: Oh damn, I actually made it to a Geohot stream lissie1Awww
unrandomknown: no difference LUL
yaus_baus: i made no promises
worrasenule: A |- B means B can be derived given A.|- A means A is theorem, or simply, A can be derived, or A is an axiom.
worrasenule: there's a wiki page for ti
ravicat: chat can you tell me what is he trying to solve/write?
worrasenule: *it
worrasenule: https://en.wikipedia.org/wiki/Turnstile_(symbol)
filedescriptor: @ravicat no one knows
ravicat: @filedescriptor is this how it usually is or sth?
CaptainAshtar: as i was going to ask what is the purpose of the stream
AntiVax_SoccerMom: whoahh
breadhamandcheese: PogChamp
CaptainAshtar: it's metamath you hear guys
ProfessorMagikarp0: math-ception
ravicat: LUL
YouPowerRush: metamath confirmt ?
Mendacii_: I don’t know what it means, but sounds provocative LUL
ProfessorMagikarp0: ^ this guy gets it
ProfessorMagikarp0: it gets the people going
CaptainAshtar: you don't need to know the metamath just watch the apple
yaus_baus: friendship with coq is over, now metamath is best friend
mltsd: just eat apple guys
yaus_baus: tldr of stream
mitchell_344: keep up the good work George!
AntiVax_SoccerMom: boomer code
ProfessorMagikarp0: @yaus_baus these programmers aint loyal Kappa
CaptainAshtar: he doesn't accept cheers if you don't know metamath
Number___Nine: or FORTH
CaptainAshtar: and you are not eating an apple
marluo5: yeah im considering that source file
marluo5: i totally get it
ProfessorMagikarp0: good apple marketing needs a sponsor
micos7: I didnt know you are an Apple guy
oksan309: Man why don't u take a break and walk around a little bit
ProfessorMagikarp0: apple asmr
notbigd: has he gotten to for loops yet?
yaus_baus: more tendies
mltsd: !uptime
mitchell_344: sauce and fries
CaptainAshtar: that's how geniuses are eating an apple equal from all sides with double check on the angles
zigzati: @professormagikarp0 cosmic crisp apple has a $10 mil marketing budget
mitchell_344: i prefer pears usually more
yaus_baus: geroge applies mouth algorithm to apple
micos7: Bruh do you even tea?
mltsd: so what will the finished program be able to do?
CaptainAshtar: to calculate metamath
micos7: Will be able to color the background of a div Kappa
inciMage: gfg is amazing but sometimes they fk my brain up at algorithms section
DR4GOM1R: !keyboard
thyssen: !keyboard
inciMage: hhkb2
micos7: !mouse
yaus_baus: no keeb talk bois
mltsd: look at text below stream oh now
mltsd: no
filedescriptor: @DR4GOM1R lets hope he doesn't see that monkaS
CaptainAshtar: read the description on the stream if and see what will happen when you ask for the keyboard
DR4GOM1R: oh shit
mltsd: oof just saw it as well haha
inciMage: i wrote its name just google it
scorpiocyborg: got the timeout earlier hahaha
blindhelix: blindhelix subscribed with Twitch Prime. 
CaptainAshtar: no notifications...
ProfessorMagikarp0: its prob for the best if he doesnt have text to speech on LUL
Abo7atm: I like how this stream's category is Basic Programming.
CaptainAshtar: yea what are you talking about that's even before you begin?
inciMage: @Abo7atm its basic for some xd
Infinitelym: @Abo7atm i think that's all Twitch offers as a programming category
Abo7atm: @inciMage yeah I guess that's true
ProfessorMagikarp0: i dont think its normal for people at this lvl to stream LUL
gutschilino: is python a good programming language to start with?
yaus_baus: yes
CaptainAshtar: yes
filedescriptor: @gutschilino yep
Abo7atm: @Infinitelym this is the joke
inciMage: no
vay_man: yes
yaus_baus: well depends how you define 'good'
CaptainAshtar: python can do everything
yaus_baus: its easy to pick up
CaptainAshtar: except realtime shits in some cases
vay_man: but start with c
inciMage: start with java
Abo7atm: you might want to get into some C after Python to get a sense of what's going on under the hood
lidermaury: start with metamath
yrreseason: bash or zsh ?
Number___Nine: metamathsh
vay_man: bash
yrreseason: isnt zsh standard in new mac os
yaus_baus: zoomer shell just has better completion
inciMage: @lidermaury Kappa
filedescriptor: start with BASIC PogU
CaptainAshtar: start with low C
mltsd: start with assembly and program a better language
lemonboxed: start with some basic programming
Number___Nine: low brow C
MuscleMario: what is up erry1
Crappy_Wizzard: so what is he doing?
yaus_baus: start with Holy C
yaus_baus: no other answer
inciMage: @filedescriptor i started with it it was nice
Oweiii: ale chłop szcza
CaptainAshtar: toilet C is the best
Number___Nine: HolyMetamath
filedescriptor: @inciMage boomer
vay_man: you can literally hear him pee
Abo7atm: Holy C all the way
yaus_baus: TerryPilled programming is the best
mltsd: i find machine language really helps you pick up on the nuances of computers
Abo7atm: dont need other language after that
CaptainAshtar: he doesn't care he is god mode
vay_man: hands
CaptainAshtar: he already did before coming her
lidermaury: look mom, no hands
inciMage: @filedescriptor im 21
mltsd: tru
Number___Nine: open architecture is gonna change everything
lemonboxed: sounds like Tim Leary
vay_man: true
CaptainAshtar: toilet then eating nails
yaus_baus: hearing 'AI' thrown around at ODSC last week was.....
zoki_macola: WutFace
lemonboxed: AI is already decensoring japanese adult videos
filedescriptor: @inciMage dijkstra wouldn't be proud of you
lemonboxed: trippy
mltsd: oblivion AI is where it's at
TheKoreanZombi: Update my priors George.
Abo7atm: @lemonboxed epitome of AI if you ask me
inciMage: @filedescriptor fuck him and his shortest shit
Number___Nine: open hardware, bro
Crappy_Wizzard: I'm still wating for the japanese to start making ai waifus, but they are all lazy bastards
YouPowerRush: sikk
filedescriptor: @inciMage D:
vay_man: thats deep
ickystickybandit: eloquent word salad
Santiago_LHC: @Crappy_Wizzard Start? They are almost finished
fowlmoves: !project
ravicat: LUL
Abo7atm: used it wrong?
Number___Nine: lmao
inciMage: @Crappy_Wizzard already made. they just dont share
Number___Nine: boomers invented forth
lemonboxed: what does it mean to be a Turing complete space
vay_man: google it
yaus_baus: ctrl t
Crappy_Wizzard: @Santiago_LHC what? they haven't shown a single waifu ai to the public yet, what are you talking about
endeavor_42: George looks like he's about to do instant transmission when he points his finger to his forehead
alycia: i
vay_man: lol4
lemonboxed: if you share a waifu ai, then you would be cheating on the waifu
Santiago_LHC: @Crappy_Wizzard ah, you were being serious...
yaus_baus: look at that extremely useful syntax highlighting lmao
Number___Nine: wAIfu
MuscleMario: @georgehotz I am in vim, I want to add a character at the end of the line, how do I do this? I recently ditched my arrow keys and dunno how to move to end of line w/o a command end-of-line when going to insert mode.
yaus_baus: shift A
Abo7atm: capital a
MuscleMario: shift A my dudes rock
vay_man: end='char'
yaus_baus: i use shift A so much man
MuscleMario: i use spacemacs usually tho, so i hope it works, usually i'd use ctrl-a and i think ctrl-e to go from start to end
MuscleMario: but that doesnt work in spacemacs
yaus_baus: tbh doesnt really matter use whatever you like more
Number___Nine: why would you even use vim on macbook touchbar?
Santiago_LHC: because you can?
MuscleMario: spacemacs eats my ctrl buttons, oh i cant do ctrl-a to increment a number.
Abo7atm: what you use instead?
MuscleMario: hurdur
yaus_baus: emacs has its perks when you have a lot of debugging and linting to do
EdwardApollo: Just got here. What are we programming?
MuscleMario: I just need to re-learn to press 'shift A' instead of going into insert mode.
Keyeh: emacs is good when you want to do everything inside it
MuscleMario: I know i could do ctrl-o and hjkl around for a step
Kyoto_o: @georgehotz watched your interview with lex, was entertained :)
mltsd: leaf tea?
EdwardApollo: Lex Fridmans podcast is hella interesting
yaus_baus: @MuscleMario use W and B for word wise movement
yaus_baus: combine with numbers
yaus_baus: 5W = 5 word ahead
Keyeh: nothing beats the speed of terminal vim and command line applications though
MuscleMario: i only know of nw and dw and cw
MuscleMario: i never use b
xGeoTrk: hello
yaus_baus: B = back a word
MuscleMario: Gotta get in dis bit
MuscleMario: i've seen b's used to jump to a character too?
yaus_baus: 0 = start of line
inciMage: yesterday my friend showed my visual studio code at first i hesitated but it looks nice atm
Abo7atm: ^ = first char of line
inciMage: me*
MuscleMario: but i usually just /regex
Santiago_LHC: VS Code is lovely
Keyeh: personally, i wrote a custom major mode for latex in emacs to write my thesis in, so everything was really smooth
MuscleMario: i think i know how to move around good eonugh in command mode, its just insert mode i am misusing now after years of using arrow keys
yaus_baus: just esc out of insert when not inputting
Abo7atm: vimtutor can give you a good start with vim
yaus_baus: dont navigate in insert
MuscleMario: ^ that
MuscleMario: lol
MuscleMario: yeah, hard to unlearn
MuscleMario: im out here like, left left left left up right left left
andrewVadeika517: yo @georgehotz Glen Rock gang
MuscleMario: :D
lemonboxed: muscle memory
Santiago_LHC: I only started learning Vim a couple of weeks ago. It's awesome but it does require "unlearning" a few things and re-wiring your brain for it
yaus_baus: the worst part is writing code in collab or kaggle and not having vim bindings
MuscleMario: I forgot how to use macros in vim too. I used to do an operation and press something likw $w and a period . and then press some button and it would repeat what i did last few steps.
death_gadget: Anyone else use Tridactyl for Web Browser? VIM in browser basically
Kyoto_o: Just use whatever you are most comfortable with @Santiago_LHC
vay_man: yes
Santiago_LHC: @Kyoto_o Oh for sure, but it's good to get out of your comfort zone to learn new things once in a while
inciMage: @death_gadget never heard of it
egon_22: timeout
Kyoto_o: You can still use IDLE an install additional plugins for every single thing you can imagine @Santiago_LHC
Kyoto_o: and*
ravicat: @Santiago_LHC seen it but how is that better and in what ways than typical UI
JoneKone: then
vay_man: wat time is it there in ca?
archeadis: George, I remember you set up a tiling WM in past, why did you switch back to Mac?
MuscleMario: in my office i have no one to talk to about this kinda stuff and lots of ways to skin a cat so... i like to see what other ppll do to achieve the same result but most people just argue about the editor choice itself. &gt;_&lt;
alinutzzz97: How hard is to be a programer?
ravicat: LUL
yaus_baus: just keep to yourself about text editors
MuscleMario: ^ thgat
Kyoto_o: Try it yourself and see @alinutzzz97
MuscleMario: I never push my religion on ppl
archeadis: is this tmux or is it just split in vim?
yaus_baus: vim works for me so i juse it
inciMage: @MuscleMario whats your religion
yaus_baus: i use i3 in the place of tmux though
Santiago_LHC: @ravicat There is something magical about being able to do a quick edit on a file without having to open a full app. You get in, tweak a line, save, commit, boom. It's beautiful
MuscleMario: @inciMage i dont have a religion I think ?
unikid93: @inciMage @MuscleMario his religion is GAINZ
MuscleMario: LOL
MuscleMario: Dude all i GAINZEd in the past 5 years is weight
inciMage: @MuscleMario u wrote u dont push ur religion on others
MuscleMario: FattyMario
kzonixcomua: hi from Ukraine!)
unikid93: hahah noo :(
lemonboxed: you mean mass
MuscleMario: @inciMage I meant my text editor preferences
Abo7atm: @Santiago_LHC talking about something like sed?
MuscleMario: Cult of Emacs vs Cult of Vim
finessin95: @inciMage It's a saying, he didn't literally mean he doesn't push a religion on others
Santiago_LHC: @Abo7atm just vim
finessin95: He was talking about vim
inciMage: @MuscleMario :D
yaus_baus: i think he means the speed of vim rather than booting a bloated ide
Kyoto_o: 😡😡😡😡😡😡 not working
inciMage: thx couldnt read if he wrote sth up there
Abo7atm: oh, i got linuxed away a bit lol
Kyoto_o: What theme does he use? It's easy on eyes
yaus_baus: vanilla vi
vay_man: why is he doing this?
Kyoto_o: That's a default or?
maskerlive: !project
yaus_baus: yeah default vi that comes on mac
vay_man: ??
st47ik: Augur merch George?
Santiago_LHC: His vim settings are on his github
MuscleMario: anyone know off the top of their head what 'vi' command does in vi/vim? Visual Mode -&gt; i == ?
yesokboss: hows it goin george
yaus_baus: vi = shell command to start vi
MuscleMario: nah like
vay_man: never used vim
MuscleMario: 'vi"' selects text in between the "'s
yaus_baus: oh
fillmyvoid: !watisgoingonhere
yaus_baus: yeah
yaus_baus: v i ( = select text inside parentheses
MuscleMario: visual inside
MuscleMario: inside then
MuscleMario: :\
vay_man: is vim good enough?
yaus_baus: yes
yaus_baus: @fillmyvoid I believe george is writing a verifier for metamath programs
inciMage: its nice
robbsalm: so what are you doing @georgehotz ? just got here
Santiago_LHC: Check the title
fillmyvoid: ok just gonna look up what metamath is lol
yaus_baus: http://us.metamath.org/downloads/metamath.pdf
rupan3: boomers invented python
st47ik: nice PogChamp
Santiago_LHC: https://github.com/geohot/twitchcoq
dorkmo: Party1 Party1
Abo7atm: how long has this stream been going?
yaus_baus: 2+ hrs
inciMage: @rupan3 gen-z liked it
rupan3: !time
aziz_fazlagic: 👉
MuscleMario: I just want to take my shit to the next level, and i feel like forcing mysellf to 'hardmode' hjkl will help me realize what shit im doin wrong when i keep doing traversal in insert mode and going to my mouse to move my cursor to a position that may be 15 lines up rather than , 15k or /&lt;searchText&gt; shift-n
Santiago_LHC: Nearly 3 hours
steinlphd: The assert int the Else case is missing parentheses
thebastl: @georgehotz Will boomers see selfdriving cars in their lifetime?
Abo7atm: man's like a machine
Abo7atm: wish i had some of that
Santiago_LHC: Asking about self-driving cars gets you banned
thebastl: Didn't know. sry
lemonboxed: only doomers will c self driving cars
yaus_baus: no comma talk only, i believe
maskerlive: What is twitchcoq?
Santiago_LHC: https://github.com/geohot/twitchcoq
yaus_baus: writing in coq language on twitch
inciMage: googleit
yaus_baus: george'
yaus_baus: flow state is unbreakable
maskerlive: But why is he doing this?
Kyoto_o: It's a very broad subject
Kyoto_o: Anything where you can gather data and manipulate it @shaz3bsec
inciMage: see you guys thx for kind chatting
TheRealMast3r: Don't say cyber to a computer guy OMG
whichtom: lmao
Kyoto_o: LULW what
yaus_baus: lmfao
grizvok: 360 fucking no scoped
poop_balls420: lmao
doomc: LUL
yaus_baus: 420 mlg
PexanKappa: KEKW
endeavor_42: how long has he been streaming?
ellips0nspice: hi
Santiago_LHC: 3 hours
poop_balls420: !uptime
Kyoto_o: @endeavor_42 !uptime
endeavor_42: !uptime
Santiago_LHC: There is no bot
eaterenrgy: 2hr 56min
Kyoto_o: Jebaited
quickfloor: No bot , No pain
endeavor_42: thanks
quickfloor: Have a better life with Nobot.com
MuscleMario: If your shirt isn't tucked into your pants, then your pants are tucked into your shirt.
bubbleboi01: hello
rupan3: MuscleMario not true
PexanKappa: KEKW
grizvok: @MuscleMario no i have a shirt on but no pants
SupaDeviserr: is that 2 space tab
quickfloor: Do we have cooking or QandA stream today ?
yaus_baus: just maths stream
yaus_baus: no distractions
st47ik: 420% focus
taxad0: beucaMD
yaus_baus: man that metamath vim plugin
quickfloor: @yaus_baus is he working in a server ? cuz he's using screen over tmux
yaus_baus: local
yaus_baus: i think at least
0twinshock0: Hi George, i am developer in Brazil, say hello!
st47ik: HeyGuys
MuscleMario: @0twinshock0 hello
0twinshock0: ty kk
beefydangles: yer a wizard georgie
vay_man: voila
yaus_baus: def not following lol
archeadis: anyone know how do I show all tmux windows in the status bar like geohotz?
whichtom: noice
Kyoto_o: im using you as a background noise ngl
rupan3: what is this for?
st47ik: i was kinda following Kappa
lemonboxed: flipping at the meta lvl
robbsalm: @georgehotz Why do you use vim?
quickfloor: @archeadis he's using screen now .
whichtom: metamath is gross
vay_man: but whY?
halcyon8000: halcyon8000 subscribed at Tier 1. They've subscribed for 4 months! 
Santiago_LHC: Why everything?
Santiago_LHC: Because
robbsalm: why ice is slippery?
MuscleMario: What's his motivation for this? He was doing TwitchSLAM a while ago but... i dunno y he likes the Coq?
vay_man: must be some comma ai stuff
robbsalm: true != false
yaus_baus: not comma related at all
st47ik: maybe cuz its fun to learn new stuff 4Head
MuscleMario: maybe
vay_man: why would he waste hours if not work related?
yaus_baus: waste?
Mendacii_: @georgehotz define “real”
st47ik: @vay_man dude it's fun so there's no waste
yaus_baus: work is waste
vay_man: whats the point of ths?
MuscleMario: ... sometimes u waste hours b/c the problem is stuck in ur head
MuscleMario: and u gotta itch it out of there
aaronfriedland: what is the logo on your sweatshirt?
whichtom: life isn't all work my dude
vay_man: illuminati?
MuscleMario: ^ yes
purgatoires: software engineering is this man's raison d'etre
robbsalm: life is all work
Santiago_LHC: Why does he computer?
st47ik: i mean the whole point is we'r chasing the dopamine shots even if its in solving/learning stuff
yaus_baus: scopie sunday george vs dont work for the man george
MuscleMario: y do ppl do rubix cubes
MuscleMario: and crosswords
robbsalm: just get dopamine in other forms
MuscleMario: SHITS WORK
st47ik: @robbsalm doesnt work like that
MuscleMario: He's taken the LSD and now he's coding from the astral plane
whichtom: lol
yaus_baus: add all symbols
yaus_baus: lmao
whichtom: this is excessive
vay_man: for someone who claims to be out there to create billion dollar company,,this is waste of time if not work related
yaus_baus: hardcode the syntax
lemonboxed: its called being productive
MuscleMario: He's such a brute ;)
st47ik: bruteforce chars SMOrc
grizvok: @vay_man he's expanding his knowledge base. what a "waste of time"
st47ik: ^ LUL
iskjmss: complaining abotu someone wasting their time while being on twitch KEKW
yaus_baus: this is like the purest form of programming
st47ik: @vay_man im sorry MaN but he's free to do whatever he wants to
MuscleMario: Elon muskrat read a book on rockets n now look @ him TeeHee lol
vay_man: I know I m wasting time
rupan3: MuscleMario who
Santiago_LHC: Then let everyone else be
vay_man: thats his narrative
vay_man: dont believe everything they tell
MuscleMario: I'm just trollin in chat @rupan3
robbsalm: isnt functional programming the best?
rupan3: is he a mathematician now?
st47ik: argh NotLikeThis
MuscleMario: The best programming is definitely caffeine fueled
yaus_baus: say it
rupan3: schizophrenia is catchy
asaalgk: what did i miss
MuscleMario: Best programmer in the world, what is this, a hiphop battle?
yaus_baus: !peebreaks
MuscleMario: I crap he recorded raps b4
Santiago_LHC: If it was, he won it
MuscleMario: O
zoki_macola: pee time
MuscleMario: No hands
MuscleMario: Dudes on that stim
lemonboxed: ever chair looks like it codes
yaus_baus: everytime george goes pee take 2 shots
robbsalm: metamath short for meth
lemonboxed: chair stream
MuscleMario: meth short for metamath
Kyoto_o: Do you know who Fabrice Bellard is? Check him out @georgehotz
Santiago_LHC: George pees more often than I commit.
vay_man: hi from India georgie!!
Kyoto_o: @georgehotz or his projects
robbsalm: dislexia god dammit
MuscleMario: @vay_man hi
st47ik: how much tea u drink in a day man? looks like a lot LUL
taxad0: stick to the paper
Santiago_LHC: I want to bind them
MrBankster: you want to use a queue
lemonboxed: f in ass
MuscleMario: i wish.... i wishy wish... python wasnt so popular. Even tho i use it for data shit
AlexEDM: are all you guys in here programmers?
yaus_baus: python facilitates productivity
yaus_baus: fast to prototype
Santiago_LHC: @AlexEDM nah
MuscleMario: yeah, super good for that
LeadCoder: i did on video on python sql injections today. check out my twitch channel
jagger_rsw: @georgehotz is it good time for DISTRACTIONS?
Magistr_Y0d0: Hi. What's that book ?
grizvok: @AlexEDM i am
Quad___lol: you are my favorite reptilian
yaus_baus: http://us.metamath.org/downloads/metamath.pdf
yaus_baus: book ^
AlexEDM: any of you python guys have experience with automating repetitive actions in browser (specifically Internet Explorer)?
zoki_macola: Elon, george and zucc the best reptilians in their class
zeroeagle1: hello everyone
Santiago_LHC: lol
zeroeagle1: alex use selenium
yaus_baus: @AlexEDM like scraping?
doomc: ^
yaus_baus: beautiful soup
AlexEDM: so here's my deal, zero. I want it to work at my job. I was able to install Anaconda, and use Python, but I don't think Selenium will be allowed? hmm
barbudolol: Why not?
zeroeagle1: it's a pip package
worrasenule: thx for this tutorial, berry nice
yaus_baus: why do u need conda specifically?
MuscleMario: lol
128p_: yo y'all
AlexEDM: @yaus_baus for example, going up to click an icon on a page, then enter a two character password, based on what's shown in a certain field
MuscleMario: Selenium is the most widely used driver
MuscleMario: industry standard
zeroeagle1: selenium is great for that
yaus_baus: yeah just write a python script
ellips0nspice: why Metamath?
ellips0nspice: not PLY?
zeroeagle1: used it with python and .net preferred .net tho
barbudolol: Selenium has everything you'd need for that stuff. Not as fast as something like BeautifulSoup but a LOT easier
Santiago_LHC: It better pass
AlexEDM: yeah, I will try to @yaus_baus - I've only made one VBscript - I'm a noob, lel. But practicing in python
yaus_baus: im noob too
AlexEDM: yeah I heard good things @barbudolol
barbudolol: I'm selenium god
barbudolol: if you need any help hit me up
AlexEDM: can u install that easily on work PC's? not to a server, but to my desktop @barbudolol
beefydangles: why was my speech suppressed
MuscleMario: ^ first ammendement
AlexEDM: okay I will send u a friend request, hehe
yaus_baus: pip install selenium
zeroeagle1: ^
AlexEDM: install inside python?? @yaus_baus
yaus_baus: in terminal
beefydangles: :/
aaronfriedland: probably a dumb question but is the best way to learn Python or a similar language just starting a project you're interested in?
hue88: But have you guys ever build a recursive data driven selenium test-framework with elasticsearch ?
Kyoto_o: depends do you plan on going in depth or not @aaronfriedland
yaus_baus: @aaronfriedland watch some intro utube vids
ellips0nspice: too much errors. 99% of programmer work is not program alogrithm, it's bugfixing
MuscleMario: @hue88 yee
grizvok: @aaronfriedland are you learning programming in general or just learning a new language?
cybergenik: What computer are you using?
zeroeagle1: @aaronfriedland do a service that check if geo is currently streamming on twitch
aaronfriedland: not super in depth I just want to be able to automate some of my job and do data analysis
128p_: What are you guys coding lately?
Kyoto_o: that is in depth @aaronfriedland
MuscleMario: I want to get into webgl/three.js to makae a new website
zeroeagle1: @aaronfriedland or get the book "automate the boring stuff with python"
YouPowerRush: did he do et ?
YouPowerRush: on stirm ?
lolwtfreally: I don't know wtf is going on.. but it feels good FeelsGoodMan
MuscleMario: last time i worked on my site was back when css3 html5 came out
MuscleMario: and i handcoded the animations
yaus_baus: all i code is etl and EDA lol
hue88: @MuscleMario but have you used parent child structure for avoiding redundancy and easier test creation
hue88: that's the real shit
aaronfriedland: nice I'll check that out
Kyoto_o: this guy talking about classes and thinking thats the real shit LULW you idiot @hue88
Santiago_LHC: woah, chill Kyoto
hue88: @Kyoto_o O:::: see my last comment duuh
MuscleMario: @hue88 i dunno anymore, i didnt even put elasticsearch in my shit ever... but i stay away from things like selenium cuz its slow and i use it just for testing.
Kyoto_o: bruh moment in here
MuscleMario: @hue88 but i used it in tthe JVM so, meh.
MuscleMario: squadW
Kyoto_o: oh no squadW
MrBankster: scam :O
hue88: @MuscleMario yea I mean I don't see any great uses other than testing anyway for selenium :D
MuscleMario: LOL
Kizzyiee: @georgehotz Thoughts on prome.ai? ..I just finished a 14month contract and wondered what people on the outside thought
MuscleMario: @Kizzyiee gl gettin his attn
hue88: @MuscleMario have you read about webassembly though ?
yaus_baus: george is in another dimension rn
hue88: that's crazy
aaronfriedland: this book looks perfect thanks @zeroeagle1 my job is basically just entering and cleaning up data in excel spreadsheets that has to be made into reports
MuscleMario: ^ barely, i havent done asm in a along time... just when looking at disassembled code
ellips0nspice: too much errors. george needs more phylons for this task
MrBankster: george its cuz bash
yaus_baus: @aaronfriedland if you can replace your excel stack with python you can automate a lot
krnflake1: @georgehotz what are your macOS apps in the status bar? obs, spectacle, but what are the others?
Santiago_LHC: Ah, spreadsheets. The place where hopes and dreams go to die.
MuscleMario: but sounds really cool , lower level things like webasm, websockets
MuscleMario: i never got into
MuscleMario: but always wanted
MuscleMario: Cuz i stay away from webtech mostly
zeroeagle1: @aaronfriedland go on youtube and type automate the boring stuff excell if I recall correctly theres a 40min talk on just that
aaronfriedland: hell yeah
hue88: hahaha yea webtech is actually fun
halcyon8000: Cowbell?
aaronfriedland: gonna try to learn how to use Tableau too
hue88: depending on your project ofc
aaronfriedland: bosses love fancy graphs and shit
grizvok: tableau is pretty nice
Xflagzzz: hello
yaus_baus: @aaronfriedland yeah tableu proficiency is nice if youre a data analyst
MuscleMario: I've yet to work in a more pure math code. Ive done a lotta things, and closest to math in code I've done is some data science crap that was poppin in 2015
zeroeagle1: @aaronfriedland that reminds me when I setup grafana
hue88: @aaronfriedland ++++ fk bout ur code, show them graphs and theres ur raise lol
purgatoires: ggplot &gt;&gt;&gt;&gt;&gt;&gt;
MuscleMario: And im not talkin bout functional programmin
MuscleMario: I'm just saying the field/industry
babadoctor: Is that your cat in the background?
aaronfriedland: nah I'm just a low to mid level employee for a labor union
aaronfriedland: not a data analyst
yaus_baus: @aaronfriedland dont sell yourself short :)
Santiago_LHC: Graphs impress everyone
MuscleMario: oh, yeah, and some stuff trying to brute force a key for a security challenge.
malg0d: George
MuscleMario: polynomial math tho
malg0d: George of the jungle
babadoctor: I swear I saw a cat behind you WutFace
raulciuntastefan: what hes trying to do right now ?
Santiago_LHC: Check the title
malg0d: Jailbreak the simulation bro
yaus_baus: tendies time
MuscleMario: @aaronfriedland to learn the best way is to force urself to read from start to end someones tutorials or the docs. My opinion. Or watch someone code on youtube.. but reading it by urself i think is best
malg0d: Green tea bro
purgatoires: lunch PogChamp
zoki_macola: wash hands
yaus_baus: !peebreaks
malg0d: Wash hands 30 seconds
aaronfriedland: @MuscleMario I can definitely do that
mltsd: too much tea
MuscleMario: @aaronfriedland its good that a lot of professions are now getting scripting in to automate the mundane tasks
programmer42: I'm hungry too! gotta get some lunch
malg0d: Tea is never too much
mltsd: only when too much pee
aaronfriedland: they aren't really encouraging me to automate anything I just hate doing mundane bullshit for $40k a year
malg0d: Green tea
purgatoires: @MuscleMario i just dont understand how it's taken this long, VBA scripting is simple as shit
MuscleMario: @aaronfriedland the only trick to learning programming is being very stubborn/persistant , some days u can hit ur head against something for 4 days b4 u realize what ur doin wrong or rewrite the whole thing
purgatoires: like why now
yaus_baus: b i g g l o n c h
aaronfriedland: infinite lunch
kanogger: Luchstream PogChamp
dorkmo: sandwich
malg0d: Jailbreaking lunch
MuscleMario: He probably gonna eat cereal
dorkmo: avo toazt
xkcdz: PogChamp PogChamp
yaus_baus: george put on some cooking musics
kanogger: JonCarnage
micos7: Bruh where is the avocado toast?
MuscleMario: George needs TTS for Donos
malg0d: Where is that girl she usually interrupts the stream Kappa
yaus_baus: no grills just maths today
MuscleMario: Kapp
aPosterior: binging with george
vmarkushin: @MuscleMario no. He gonna eat ice
MuscleMario: LOL
malg0d: George ping my router
yaus_baus: george refactoring cooking script
kanogger: milkshake with them crushed up oreos
MuscleMario: guacamole... fancy
malg0d: Gordon Ramsey George Hotz edition
acae: gay walk
MuscleMario: Gordo i missed it last nite
malg0d: Nothing wrong with GAYS
yaus_baus: god* walk
purgatoires: cooking is suboptimal
TheKoreanZombi: Let's maximize cooking screen.
malg0d: George I best come up with my ideas during sleep deprivation any thoughts on that
MuscleMario: @purgatoires ok elon
aaronfriedland: lmao
ellips0nspice: Is anybody use HolyC?
MuscleMario: I've heard some1 say Holy C now a few times?
MuscleMario: Wut iz dat
markovchain21: @purgatoires same :/
malg0d: George what happened
ellips0nspice: @malg0d why stop? developers don't interesting in new tools?
MuscleMario: oh crap
yaus_baus: dont shill your content here
MuscleMario: Anyone here knew of Robert Himler?
malg0d: I wish I was high
TheKoreanZombi: self.esteem = False
Macatw: do you take notes on what you're experimenting or studying?
grizvok: developing inside of a k8s cluster with skaffold
zeroeagle1: currently we have appveyor but probaly gonna switch
Santiago_LHC: @mitsd https://www.calm.com
malg0d: What is the name of that song I wanna be sad too
torlkhal: whats happening here?
grizvok: dev env is sooo close to prod
mltsd: @Santiago_LHC thanks
yaus_baus: @malg0d nothing.nowhere is the artist
mltsd: ive been trying to find good indoor rain sounds for a while
grizvok: @yaus_baus mysql 8
yaus_baus: @grizvok nice mysql is cool
grizvok: @yaus_baus old architecture was master-master but we are moving away from that
W1lkins: don't we need peano.mm in the source code to run verify in CI georgehotz ? and what CI do you use normally, just travis?
grizvok: susceptible to shit like split brain
ellips0nspice: @MuscleMario i streamed my first twitch stream before Geohot in Programming category at 2014. I'm back and do test stream now
MuscleMario: I've only used Jenkins, Gitlab CI, and Bamboo
MrBankster: i prefer const
zeroeagle1: I use appveyor and travis
mosin_lol: what is metamath ?
yaus_baus: http://us.metamath.org/downloads/metamath.pdf
yaus_baus: ^ book hes referencing
TheKoreanZombi: He's asking geo, not you nerds
Santiago_LHC: Geo has no time for stupid questions
malg0d: Okay Korean guy
MuscleMario: @TheKoreanZombi we are Geo
TheKoreanZombi: lol
moepost: !followage
MuscleMario: -illuminati.wav-
malg0d: We have no time for feds
MuscleMario: Watch me do my strut
MuscleMario: watch me do my catwalk
mltsd: fuck 12
MuscleMario: LOL
malg0d: Watch me do my 0day sneak attack
Xaotic: wtf is a crystal programming language?
zeroeagle1: when you have ruby + perl in your stack
yaus_baus: LOL
oksan309: Why u code in kitchen cmonBruh
malg0d: Why not
TheKoreanZombi: because kitchen is bedroom is office
MuscleMario: all these youtube vids poppin up on ppl making MEELYONZ off bug bounties, like... hmmm ... am i doin it rite?
malg0d: They are just devil worshippers making black magic 0days
malg0d: worshipers*
malg0d: Mere mortals
MuscleMario: I wanna be as excited as Geohot waz when he gave his Comma.ai shill at the end of his qemu stateless debugger talk. "WE GON BE RICH! WhoooOO!"
oksan309: @TheKorean i thought it was a fetish LUL
malg0d: We all did
MuscleMario: LOL
torlkhal: PokBlaziken
MuscleMario: Drops the guac, uses napkin to pick it off ground, proceeds to use same napkin to wipe face.
MuscleMario: Been There, Done that.
MuscleMario: LOL he reads the chat
MuscleMario: HAHAH
MuscleMario: Not pre-recorded
MuscleMario: MuscleMario subscribed at Tier 1. 
zHamish: bon appetit
yaus_baus: lmao
MuscleMario: I AM NOW
dorkmo: nice save
zeroeagle1: ahah nice move
MuscleMario: Goteem
MuscleMario: I love uu geo
MuscleMario: been a fan since 2013 &lt;3 &lt;3 desu
YouPowerRush: highbrow om noms
ellips0nspice: I'm geo fan from him first iPhone hack SeemsGood
yaus_baus: tendies
torlkhal: git commit push
girtss3: Thank god this stream is live, just came from work, dont want to go back
TheKoreanZombi: guacamole isn't a meal.
beefydangles: TENDIES
zeroeagle1: *git push -f
yaus_baus: uber eats tendies
firstavegner: me too I follow geo when he unlocked the first iphone
deqroys: what am i looking at lmao
deqroys: this is some advance stuff
firstavegner: chat do you know what is he trying to achieve today ?
thebastl: @georgehotz Does sony still hate you?
yaus_baus: writing a verifier for metamath programs
oksan309: Do u do unit testing?
zeroeagle1: @deqroys basic programming usefull knowledge
yaus_baus: well he wrote the verifier already
deqroys: this is basic ?? @zeroeagle1 im in my second year of c++
yaus_baus: pretty different from practical c++ programming
MrBankster: bro. are you in the zone?
zeroeagle1: that's like 3-4 years python basic
firstavegner: vim pro
MuscleMario: in the zone autozone
blackhawk131: Properly using vim is harder than the programming he is doing lmao
ellips0nspice: helps geo write rap language interpreter
smurfd0: thats half the battle, to think for yourself you are getting closer
beefydangles: Pog
Ziv0: { LUL
whichtom: oh boy more math symbols
yaus_baus: boiling point elevation
pedrosantos867: bro, can you help me with an html project?
quickfloor: chicken tinder ?
firstavegner: chat for real anybody understands what's he doing right now ?
aaronfriedland: yeah Kappa
Quad___lol: math is a language of universe and php is a language of retards
jtparker: GeoHOTT = Geo + Homotopy Type Therory
Quad___lol: wait what, srz
Quad___lol: sry*3
beefydangles: its simple really
yaus_baus: @firstavegner wrote his own verifier for methamath programs now proving
yaus_baus: df = df_2011.dropna(subset=['LATITUDE', 'LONGITUDE'])
printhellosailor: I'll never understand why anyone would watch shit they don't understand
yaus_baus: oops
zeroeagle1: @pedrosantos867 is html your main programming language?
aaronfriedland: I'm not even watching the stream I just have popout chat open
pedrosantos867: @zeroeagle1 i'm kidding
zeroeagle1: xD
oksan309: @print out of curiosity LUL
firstavegner: @printhellosailor you will one day :D
aaronfriedland: can't go over my comcast 1TB limit watching 1080p programming streams 4Head
trinitr0x: what is he trying to do?
ellips0nspice: @printhellosailor I understand, i likes programming language devs, why not? &lt;3
whichtom: @printhellosailor if you look at things you already understand how can you learn anything
zeroeagle1: ^
firstavegner: geo u should use chat nighbot for frequent questions and commands
printhellosailor: this isn't the kind of stream to watch if you want to learn how to program
Santiago_LHC: and to auto-ban people who ask about keyboard
oksan309: Someone should report him to nsa LUL
blackhawk131: @whichtom well said
pedrosantos867: What is he doing?
MuscleMario: He's probably using a HHKB
aaronfriedland: sounds like a Topre Kappa
MuscleMario: I have a crap Ducky One 2
phlox____: monkaS
yaus_baus: no keeb talk
MonkaSupreme: can we get a keyboard emoji?
snapcs1: mAYBE IF i GEt the SAme key Board i can bE pRo hAcker liek u
MuscleMario: I miss my arrow keys :(
MonkaSupreme: ⌨️
jtparker: It is a keyboard that has only greek symbols
theGeekPirate: How am I supposed to learn how to program when I can't use the same keyboard as you NotLikeThis
printhellosailor: not sure how you can find watching something like this enjoyable if you have no idea what is going on... but I can understand pure curiosity I guess
mufeedvh: hey George, can I work with you?
trinitr0x: @snapcs1 ajajajajjajaja
barbudolol: hey George, can I work for you?
ThatKevinLima: MrDestructoid MrDestructoid
MuscleMario: @Galus will submit a PR one day.
yaus_baus: lmao
phlox____: hey George, can i work on you
okkessh: whats up with backspace.ai
MuscleMario: Just so I can say I did
aaronfriedland: hey George can I work you
Santiago_LHC: Where are all those PRs
MuscleMario: Itll be like a typo fix
printhellosailor: I never said I don't like your content, was referring the randoms who were asking what is going on
TheRealMast3r: isn't coq a french programming langage
blackhawk131: hey George can I work?
Quad___lol: you can hire me to manage them :)
pedrosantos867: Which is the easiest way to trigger you?
deqroys: how many programming languages do you know?
yaus_baus: !pasta
ThatKevinLima: LOL
MuscleMario: Dont talk about the cleanliness of his floor
beefydangles: check the vod
kzonixcomua: Hi George can i? =)
snapcs1: if you have a good foundation you can pick up any programming language easily
yaus_baus: !peebreaks
djcows: hi Gorg, how to increase volume in windows xp??
barbudolol: I just want to be managed FeelsBadMan
MuscleMario: I have to google metamath
oksan309: How many keyboards u crashed because of something didn't go well LUL
MuscleMario: Dunno wut it iz
printhellosailor: I've been watching twitchcoq since pt 1, but this is the first stream I managed to catch live
pedrosantos867: Which is the easiest way to trigger you?
Heydrian: hi George tell me what to work on?
maskerlive: @pedrosantos867 tu queres mesmo ser banido tem cuidado
Santiago_LHC: Sigh, these people
yaus_baus: http://us.metamath.org/downloads/metamath.pdf
ThatKevinLima: alo portugaaaaalll
ShadySloth6: can somone sum up how far he is and what he did till now in the other2 parts?
yaus_baus: where is @grizvok when you need him
jagger_rsw: @georgehotz is it a good time for D*I*S*T*R*A*C*T*I*O*N*S?
MuscleMario: I really just wanna know how to stay healthy as a dev
yaus_baus: health is a scam
ThatKevinLima: PROCRASTINATION TIME =D
aaronfriedland: ^
yaus_baus: live fast die young
MuscleMario: &gt;_&lt;
yaus_baus: who wants to live past 40 anyways
jagger_rsw: Kurzweil
aaronfriedland: I don't even want to live past 30
mufeedvh: I wanna work with you and win self-driving cars and stuff... you can check out my site if you want... mufeedvh.com/about
oksan309: @Muscle eat alot of carrots LUL
Quad___lol: math is bullshit....its all trash nonsense thats purpose is to keep our minds busy from the real problems - gender studies, global warming, etc...
firstavegner: thanks to fortnite I can watch you geoHotz
zeroeagle1: @MuscleMario watch "david sinclair google talk" on youtube very interresting
MuscleMario: There was this movie, something about time travel, they made a joke, "U know what they do to engineers when they turn 40?" "They take em out back and shoot em"
AtomicPandaAttack: @Quad___lol you are actually retarded
ellips0nspice: Top Geo projects by my chart: 1) iPhone hack 2) reverse debugger 3) comma.ai
firstavegner: Geo are you interested in the research field ?
bubbleboi01: @AtomicPandaAttack he is being sarcastic idiot
NilsIRL: @zeroeagle1 which talk?
snapcs1: what kinda drugs are you guys on
whichtom: damn chat wtf
MuscleMario: Im on the internet @snapcs1
aaronfriedland: Sertraline and alcohol
MuscleMario: Highly addictive
Santiago_LHC: Calm all your pants down everyone
Quad___lol: @AtomicPandaAttack hahaha why are you here duuuudeeeeee
bubbleboi01: I'm not wearing pants KappaPride
ThatKevinLima: this chat is going nuts
yaus_baus: ~Mark Twain. "Life's journey is not to arrive at the grave safely, in a well preserved body, but rather to skid in sideways, totally worn out, shouting "Holy Shit, what a ride!"
oksan309: @Quaq if it wasn't for math u would probably be now in a cave wiping ur ass with a leaf LUL
AtomicPandaAttack: @bubbleboi01 looks like you are the idiot who didnt understand the sarcasm lol
MuscleMario: shit tier ssri my guy
aaronfriedland: I was on lexapro before but that shit didn't work
aaronfriedland: this shit doesn't work either but at least my dick does
yaus_baus: Prozac gang
MuscleMario: damn, i never took anything outside of nootropics and stims for workout
cybergenik: What is coq?
beefydangles: big mac sauce
MuscleMario: its a type of sauce used on big macs
bubbleboi01: @AtomicPandaAttack Lol
zeroeagle1: the recipe is on github
beefydangles: and or a refreshing beverage
jtparker: Coq is a proof assistant for formal proofs
cybergenik: oh I see
aaronfriedland: why is McDonald's Sprite so spicy
okkessh: I have a great playlist to play while coding on spotify anyone interested?
Santiago_LHC: no
yaus_baus: too much shilling
beefydangles: the corps got us hooked
okkessh: it's okay
mufeedvh: I wanna work with you and win self-driving cars and stuff... you can check out my site if you want... mufeedvh[dot]com/about
okkessh: it was fire
printhellosailor: this stream is making me hungry af
snapcs1: clintHard
volere: EAT FASTER
bubbleboi01: just dont eat
aaronfriedland: reported for self-harm
aaronfriedland: pasta too hot
oksan309: Do u live alone ?
chexmixz: @georgehotz Will you be at kubecon in SD?
volere: coding stream DansGame coocking stream PogChamp SeemsGood
Alpasfly: what are you eating?
volere: cook*
Abo7atm: oh it's bedtime, goodluck George!
yaus_baus: gn
hilololow: geo i love u from morocco
infowolfe: @georgehotz why do you use terminal.app instead of iterm?
TheBigK02: do u still go for 1 milion subs on instagram or did u give up
Quad___lol: just pay for the 1 million subs LOOOOL 4Head
bubbleboi01: just mind controll people to sub
volere: omnomnom
MonkaSupreme: @georgehotz do you have movie recommendations?
volere: nom nom nom
volere: *code code * om nom nom
nic0latesla: what are you eat?
MonkaSupreme: or anyone in here got any movie recommendations?
volere: pulp fiction
Santiago_LHC: @MonkaSupreme what do you like?
oksan309: Pomegranate cmonBruh
beefydangles: just unbind it
MonkaSupreme: @Santiago_LHC drama, thriller
mufeedvh: I wanna work with you and win self-driving cars and stuff... you can check out my site if you want... mufeedvh [dot] com/about
beefydangles: Kappa
snapcs1: stop bro wtf
volere: the answer is
a_caspar: ASMR Kreygasm
volere: 42.
yaus_baus: @mufeedvh just apply at his company if thats your goal lol
Quad___lol: @mufeedvh no he doesnt want and its all basic things you "expect"
Quad___lol: expert*
volere: how big is your apartment?
Santiago_LHC: @MonkaSupreme Us, is a great movie
mufeedvh: ok sorry for that
jtparker: Why did you choose Metamath?
Zeitvertreibe: i atched this now for some time, still dont know whats about, but googled.. but t=t might come from (t+0)=t
nic0latesla: No tea?
printhellosailor: LUL
oksan309: Would u agree if someone copy ur source code LUL
NilsIRL: @oksan309 it's not licensed
deqroys: what are you eating
litenull: u remind me of martin shkreli
aaronfriedland: does he still stream
snapcs1: what socks are u wearing what are u eating whats ur favorite color what type of shoes do u have
litenull: he's in prison
aaronfriedland: really?
guy_ross: yup
snapcs1: BrokeBack BrokeBack BrokeBack BrokeBack
aaronfriedland: I thought he was rich
W1lkins: litenull that's a one way ticket to ban city
MuscleMario: So, he actually made his own food. Inspiration.
ProfessorMagikarp0: sub mode Kappa
MuscleMario: Im over here reheating takeout
MuscleMario: And wonderin why im fat
zeroeagle1: concrete proof that oligarchy works
zeroeagle1: nobody is complainning
MonkaSupreme: @Santiago_LHC I thought the trailer was silly, but if you recommend it, i gonna check it out
yaus_baus: any of yall work with folium and geojsons
MonkaSupreme: I've worked with geojson, had to parse zip code regions
MuscleMario: Discrete Math was one of my favorite subjects in school
zeroeagle1: you robust mario ahah
MonkaSupreme: TBAngel
infowolfe: infowolfe subscribed at Tier 1. 
yaus_baus: im trying to make a chloropleth to demonstrate density of markers
guy_ross: obviously.
infowolfe: @georgehotz why do you prefer Terminal.app over iTerm? :P
yaus_baus: can i do this with just a list of lat/long data
yaus_baus: with the geojson to definite districts?
MuscleMario: @infowolfe &lt;- same question i guess
infowolfe: lololol
MuscleMario: But but... i like to print out 'fancy' and 'gnome' in my demos
infowolfe: the weird shit is... I actually met geohot back at decon 18 I think it was
MuscleMario: which puts an image inline
MuscleMario: for the memes
yaus_baus: lmfao
yaus_baus: george went down the terry hole
MonkaSupreme: @yaus_baus yeah, whats your question? ^^
W1lkins: I'm writing this message from templeOS, about to head off to meet God
zeroeagle1: templos don't support networkking because god said so
MonkaSupreme: HolyMetaMath
MonkaSupreme: HMM
MonkaSupreme: heard it here first guys
yaus_baus: @MonkaSupreme im just not sure how to proceed with a dataframe of lat/long data and a geojson to definte districts
yaus_baus: i think i just need to read more
MonkaSupreme: @yaus_baus i think geojson is polygons, so you basically have to find out if point is in polygon right?
yaus_baus: yeah exactly
yaus_baus: im doing map.add_child(data=geojson) but its not even rendering the polygons over the map
MonkaSupreme: sounds like something, somebody must have done before.
MonkaSupreme: @yaus_baus don't know what language and framework u're using
snapcs1: no please dont
snapcs1: LUL
yaus_baus: @MonkaSupreme python3 with folium
theslumpedgodxd: Hello papa
yaus_baus: nvm dont mean to detract from the maths
dinomdanom: Hi George!
MonkaSupreme: @yaus_baus you can check your geojson here, if you are not sure if it's correct http://geojson.io/
neroo2k: what happen in the background? Why is there cardboard on the floor?
yaus_baus: @MonkaSupreme yooo thank you, never worked with geospatial type stuff before
Nevermorewinz: the fuck is he doing? i cant code
theslumpedgodxd: Have no clue but it looks cool
neroo2k: @Nevermorewinz this is basic programming men easy LUL
oanto80: Hello there
zeroeagle1: Kappa100
Keyeh: dude, he's a parsing a language in python to make a proof validator
aaronfriedland: ♦️ 100000
Keyeh: you don' t need to be a 5Head to see
tfue_is_dog_shit: who els thinks jsf sucks
MuscleMario: ...
Keyeh: fixed
whichtom: its just that easy
printhellosailor: the joys of python development LUL
Santiago_LHC: Nicely done
printhellosailor: in hindsight, a strongly typed compiled language would have been a better choice for twitchcoq
MrBankster: when you gonna program in java?
beefydangles: D:
MuscleMario: thats what i said... and then i did it b/c Dallas.
zeroeagle1: do you have any opinions on .net core?
behargaming: sup benjyfThumbL benjyfSmile benjyfThumbR
yaus_baus: &lt;3
MrBankster: i like java streams
shieeeeeeeeet: are we still proving true != false?
printhellosailor: kotlin is ok but java is trash
MrBankster: try some yoga
MuscleMario: academia
Keyeh: is asm a sensible language though
Santiago_LHC: Norman, what did you do
tfue_is_dog_shit: java jsf is the worst trash view engine ever
yaus_baus: next project, write the ide???
mrrobot723: Hey bro. Im new here and i love your streams &lt;3
neroo2k: why don't we just use quantum computer to proof this ? Would be easier.
pascalzzzzz: anyone still doing jsf?
tfue_is_dog_shit: a lot of people actually which is sad
MrBankster: use first principals
printhellosailor: Next Stream: VR-based proof development environment LUL
unluckychickenn: im happy to see you r stream, yt i miss most times dizeeLO
MuscleMario: Geo u goin to any conventions talks?
Keyeh: abbreviations PogChamp
printhellosailor: there has to be better tools than just writing those by hand in plain text
vmarkushin: I've tried mmj2 today, it is really inconvenient
Keyeh: @printhellosailor yes, you know... math
whichtom: dudes crazy
death_gadget: LUL
MuscleMario: wayback him
yaus_baus: rip
Santiago_LHC: NO geocities was the best
beefydangles: wayback
MrBankster: rip geocities
Willcantrell1: 😂😂😂😂
dorkmo: angelfire or bust
printhellosailor: twitchcoq is growing
Willcantrell1: The one and only Hotz
shirafx: what's a coq?
W1lkins: green tea = green tea
wiseai: t = t OMEGALUL
shirafx: ==*
shirafx: :(
Hazor90: twitch cock is growing?
Justanotherantiantiplayer: i always hear twitch cock....
Willcantrell1: 😂😂
death_gadget: Coq is too hard??
Santiago_LHC: Sick documentation
mrrobot723: me too lol
shirafx: i showed u my coq, plz respond
printhellosailor: LUL
Rezii27: 10 out of 10
yaus_baus: lmfao
yaus_baus: feels bad
Willcantrell1: Can I touch ur coq
Justanotherantiantiplayer: so many coq jokes
yaus_baus: better than any of my projects
mltsd: holy shit i just joined and this madlad is still going
Willcantrell1: Why is my coq crooked
shirafx: still using ur ps3 jailbreak to this day @georgehotz
Santiago_LHC: Yay, more stuff
W1lkins: oh no
printhellosailor: how bad can it me
sepulsher: @georgehotz What should i do if i feel subhuman because i cant understand highschool math concepts ??? :(
W1lkins: Userone LUL
zeroeagle1: ahaha that file
vukz: lmao
xxdvxx: wut
Chrimo: You doing this out of pure interest?
whichtom: this is a good start
Chrimo: Seems cool
W1lkins: wtf
printhellosailor: just run it 4Head
W1lkins: it's trying to get /Users/smooth/build/mmj2/mmj2jar/~/ Kappa
Willcantrell1: Jebaited
MuscleMario: lol
printhellosailor: LUL
zeroeagle1: I think you need to create a smooth user
printhellosailor: java needs at least 4TB of ram
MuscleMario: min start reserved mem
MuscleMario: max mem
sepulsher: @georgehotz What should i do if i feel subhuman because i cant understand highschool math concepts ??? :(
zeroeagle1: read the issue
Vjasal: Siri is listening monkaS
MuscleMario: i was essentially held back in my math classes by 1 grade level throughout high school, only thing that sucked about it was jumping and skipping math concepts when going to college. Missing fundamentals had me quuestioning things and not getting an intuitive feel to y things are being done up until calc 2 in college. But not everything is applicable and things that matter nowadays in ML dont even get taught in HS/college regular curriculum
beefydangles: siri wants attention
MuscleMario: u gotta learn to learn by urself basically.
MrBankster: this reminds me of compilers class
MuscleMario: l2read
sepulsher: @MuscleMario thanks bro
Keyeh: BEEP BOOP
vmarkushin: help him
shirafx: your coq is impressive
WEBVTT
Kind: captions
Language: en
shutage: hi
shutage: say hi back
xaviergregor: hello
programmer42: hey
FargioFarmani: Please don't abort the stream like last time @georgehotz
amratesh: George acknowledge me please?
FigurativelyVyres: First time I'm early to a stream Pog
programmer42: what are you working on ?
rawfael: Rawfael subscribed with Twitch Prime.
benchai18: He’s alive
amratesh: I'm from India. and I'm in EU rn. Twitch took away my subscribe button and gift button
cybermajestic: hello)
l1ttlemtman: hello
benchai18: Nice coq George. The fuck u been
cybermajestic: show us your comma device
Kaotprox: nice sweatshirt
l1ttlemtman: metamath is shit
Caene: limmySteel
l1ttlemtman: Isabelle is king
amratesh: Guys watching the steam you do realize what George is doing right? he's streaming himself solving the problems and creating the startups/programs he wants to create, so he can train the "algorithm"
eduardoadf1: have you watched bjarne podcast?
amratesh: Stream*
benchai18: GeoCoq
euranymous: hi George
qujoga: Are u a vim power user?
amratesh: George you should stream more. the creator of Vines is streaming like 24/7
benchai18: Damn there are zero immature pple like me in this channel
tfue_is_dog_shit: no 1 is good at regex lol
Yemtex: !time
amratesh: sorry
mariodose: hi @georgehotz
Yemtex: what time is it at your place george ?
sanaki13: its so small
euranymous: !uptime
amratesh: George, have you seen Will Kwan?
euranymous: mod!???
tfue_is_dog_shit: What does an intern and a senior both have in common? They both search how to work with dates,regex etc..
zoki_macola: @amratesh Where can i watch him
dec3r: @georgehotz do you have any experience with agda?
itsChoudhry: @amratesh Hey I watch his videos his videos are pretty good
amratesh: I'm waiting for "the guy" who mentions Geo's keyboard lol
tfue_is_dog_shit: LUL
eduardoadf1: TriHard
amratesh: @itschoudhry GeoHot is doing the same thing. maybe he doesn't know it yet or maybe he doesn't want to be vocal about it
itsChoudhry: How long til people shitpost asking about what mouse he is using all the time
erichtp: George are you a fan of teejayx6
itsChoudhry: @amratesh What do you mean the same thing?
Keyeh: cmonBruh
NonTrivial778: niiiiiiiceeee
NonTrivial778: Cool stream brother
swsh: print debugging LUL
amratesh: Umm, feeding the universe/algorithm/ai. whatever you like calling it
euranymous: he uses vim and tmux mouse is rarely used
crashnk: laskiP laskiP laskiP laskiP laskiP
SSayMyName: what about keyboard?
euranymous: George what about copyright issues???
Svr123456789: hi George
shutchie: !uptime
Svr123456789: rip me 30seconds of ads
Keyeh: this is twitch, there is no copyright
Keyeh: only on the vods though LUL
caylakyazilimci: What is your pc model?
amratesh: @itschoudhry are you one of the 50 people who get to watch Kwans streams? he doesn't stream on twitch or mixer. he has a secret platform. pretty selective about who gets in
zgamer0123: Mode Beast ON
bloodborne24: you can play all the copyrighted stuff u want, they just mute part of the vod
ooMariaoo: @amratesh ohh D:
l1ttlemtman: thanks for banning me on discord btw
euranymous: yeah I was talking about that
nautzz: hell yes catchin the shit live
shrek_361: subbed
ooMariaoo: @amratesh whos kwans
itsChoudhry: @amratesh nope, but I still don't understand about what you mean by they are doing the same thing. You said something about the universe and the algorithm?? I'm confused.
ZemkeCWT: Anybody knows the what applications the icons in the title bar refer to? I know the left one is OBS.
komocode_: what happened to learning Unity?
Dervolleschlanke: what is he even doing
Svr123456789: lot of childs in this code... We got him !
erichtp: wait did he prove 1   1 = 2 ?
amratesh: lol NVM I'm sorry for bringing it up. Geohot knows what's up ;)
Svr123456789: 1 1=11 dude
bloodborne24: hes proving math is real with programming
SSayMyName: do a typing test
shrek_361: In the future could you do some projects with tensorflow?
itsChoudhry: @Dervolleschlanke Bro read about metamath online it's some freaky shit
SSayMyName: how many wpm
erichtp: ice chewing DansGame
amratesh: @oomariaoo Will Kwan
itsChoudhry: @amratesh -_- I guess I'm not cool enough
joker2k999: Dat metaMath coq tho...
whichtom: http://us.metamath.org/downloads/metamath.pdf
amratesh: you're cool. just not deep enough inside the rabbit hole
Yeahsper: what is a coq?
ooMariaoo: @amratesh ohh thanks :)
euranymous: basic programming ooh the irony
amratesh: can you please look into the lens more? sorry if it sounds like I'm trying to tell you stuff to do
Keyeh: tsucc Kreygasm
itsChoudhry: @amratesh ah okay maybe some day. I'm more deep in butthole right now
amratesh: lol
imaginenation: Geo how's the Instagram dream going?
erichtp: Fuck instagram no verification
itsChoudhry: @imaginenation He's moved on he said it's too much work and he got bored of it
amratesh: @imaginenation it will blow up he needs to do some additional things to make the "algorithm" happy to push his Instagram
imaginenation: damn
imaginenation: there's people with 9k followers verified which is funny
amratesh: Instagram verification is a black box. with humans that can override. geohot needs to make the algorithm happy
equalizer_____: Privet Geo
jagger_rsw: *polish* notation, take that world
Keyeh: reversed polish actually
imaginenation: I mean he can definitely do it. I was looking forward to geohot social media domination :(
amratesh: @georgehotz you do realize that even if you create your own math you cannot prove true=false
amratesh: maybe for the next stream? I would love to see it happen
imaginenation: that would be cute
Dzemixx: what exactly is he building ?
amratesh: lol I don't mean writing an axiom that essentially says 0=1
imaginenation: nothing to be honest
swsh: i've tried to prove excluded middle theorem from double negation axiom in Lean yesterday, damn that was hard
Dzemixx: oh
RSPwner_: are you using screen for multiple tabs?
Joemerlino: Just bought a comma ai off ebay, but didn’t knew chffr was discontinued :(
Vjasal: call it quick maths
Yeahsper: What language is this written in?
StrickenDown: every program on mac looks so much better GUI wise than windows it's unreal
imaginenation: true windows is a bit weird at times
amratesh: lol idiots
sk84uhlivin: FrankerZ
imaginenation: there is no usefulness to metamaths or is there? @georgehotz
prafaeltsantos: hello ❤
cod4TV: @Yeahsper Python.
amratesh: @imaginenation let's just say you can write a universe in metamath
RSPwner_: @georgehotz are you using screen for multiple tabs?
cod4TV: Every sunday morning, is this the new stream schedule?
imaginenation: @amratesh what you said is so abstract it's retarded lol
amratesh: lol
TCarriesYou: why does this guy not use GUI code editors!
imaginenation: idk
lidermaury: real rappers drink kool-aid, not tea
amratesh: I feel you @georgehotz hard to name these things
imaginenation: @georgehotz what is the usefulness for metamath?
CaptainAshtar: brain practice
prafaeltsantos: @tcarriesyou becouse vim tmux is the real goat
unluckychickenn: unluckychickenn subscribed with Twitch Prime. They've subscribed for 2 months! tmaBeard tmaHerz
amratesh: @imaginenation the usefulness of metamath is that you can write a verifier for metamath inside metamath
imaginenation: but don't you already have verifiers in mathematical logic?
maverick_twitch_: hello
cod4TV: why verifying 2 2=4?
imaginenation: unless that metamath verifier offers some significant advantage
maverick_twitch_: why you not work on climate change
CaptainAshtar: because you can verify it in a lot of ways
nautzz: i havent watched anything other than ur twitchcoq stuff
imaginenation: @georgehotz you gotta learn how the views algorithm work.
maverick_twitch_: lol
imaginenation: 😂
Richardable: Me neither I only come to twitch to watch this
CaptainAshtar: so if you want to test new language like metamath you will choose something simple to acquire the skill then continue with big stuff
imaginenation: his twitch slam stuff was great
maverick_twitch_: i am building a transpiler
theendri99: p = 1-q
swsh: modus_ponens: p -&gt; (p -&gt; q) -&gt; q
jmc516: What is the name of the tea u drink?
amratesh: just green tea
CaptainAshtar: @jmc516 really does it matter?
jmc516: Yeah actually
CaptainAshtar: why?
jmc516: Green tea varies widely
cod4TV: Pure Leaf Tea
maverick_twitch_: tea
Mario_G: sup @georgehotz how are u today?
jmc516: There's also like a billion different types of tea
maverick_twitch_: not billion
jmc516: How many then? U count?
CaptainAshtar: so what happens when he tell you the brand i don't get it?
TheAwesomezter: this is not basic programming wtf
jmc516: I try it? Why do u care lol
maverick_twitch_: there's many
jmc516: It's not complicated
maverick_twitch_: whats (2*5)/500 ?
amratesh: @georgehotz I just want to ask you 3 questions. it will be a private thing between you and I. and it will take only as long as you take to reply. and I like only absolutes. I won't ask you vague BS. you wanna give me sometime from your life for it. I believe in you as much as I believe in me
Unsavable: bruh
CaptainAshtar: wtf
maverick_twitch_: @amratesh just cuz you subbed
maverick_twitch_: :(
puffnfresh: modus ponens is function application
amratesh: Nah just because
maverick_twitch_: i know you wanna ask if he likes anime
maverick_twitch_: :D
rawfael: teach us how to pick up girls, no programming today
maverick_twitch_: @rawfael become rich
puffnfresh: variable out of a term?
Lakimadscientist: teach us how to be chad
Acles123: what do you eating george
Blintike: hahaha :D
puffnfresh: I only joined two minutes ago so I'm lost
amratesh: lol
bloodborne24: just be chad 4Head
lidermaury: thats why George starts hitting gym
jmc516: Ice is code for something
puffnfresh: but sounds like function abstraction
cod4TV: Workout stream, PLZ!
Lakimadscientist: cooking stream
puffnfresh: functions?
grimers: have you managed to prove a theorem in metamath yet?
maverick_twitch_: streams him sleeping in a gym
itsChoudhry: You don't need strength to pick up girls... just have super low standards and keep talking to strangers
amratesh: George can you make math that checks out in our universe using less than Paeno's axioms?
maverick_twitch_: i love meth
maverick_twitch_: less math
puffnfresh: sounds like function application
amratesh: I can only imagine how stressful it is for him trying to break math while god/ai is watching
maverick_twitch_: why is it green
Bitcoin__: Hey
amratesh: It's like twitch ___...___
maverick_twitch_: streams him eating ice cubes
puffnfresh: I don't know what system you're working in, but I assume functions bare terms which contain variables
ET_515: Cheer5 Hello
puffnfresh: functions *are* terms
jagger_rsw: don't you feel like quitting this programming business and going on a journey around the world instead? :)
maverick_twitch_: programming is just but var and func
xxdvxx: hi
numberedsamas: what am i watching right now?
numberedsamas: what are you programming with?
xxdvxx: waiting for a aHA moment
MorningScifi: If we get this right, the computer can prove some crazy stuff, win us the Fields Medal, and we can soak up all the glory
amratesh: @georgehotz a better way to approach this could be not using Paeno's Axioms.
amratesh: and write fewer Axioms that can do math which checks out in our universe
aaronfriedland: mizkifSat
zoki_macola: is metamath useful because there are complex things that cant be proved on paper
MorningScifi: Proof by contradiction
swsh: maybe try eq-binop axiom
MorningScifi: 1 == 0 is false, boom Fields Medal
amratesh: @morningscifi lol no! not that simple
imaginenation: Man I would love to see some graphics programming over here :p
puffnfresh: in Agda and Idris I would use a dependent pattern match to prove "0 = 1 -&gt; Void"
amratesh: YES
MorningScifi: @amratesh We can share the Fields Medal together, shhh don't tell the committee we cheated.
stale2000: 5Head
st47ik: try them all SMOrc
amratesh: there's the aha moment
imaginenation: This is too much mental gymnastics
imaginenation: you gotta focus, who does that I'm Pepega
lopm46: call of duty twitch channel got hacked this fuckien weird
imaginenation: ooh really?
eduardoadf1: he's triggering the third yee
eduardoadf1: eye'
eduardoadf1: monkaS
ensareray99: @georgehotz hey man what do you think about augmented realty ? I want to start a project about it. Do you think this tech has future or it will evolve something else?
imaginenation: I thought the purpose of life was to get hot girls and money
voodoorama: do you drink alcohol?
swsh: how about prove it on paper first?
eduardoadf1: modus ponens!
Thomasbrah: what is he making ?
BambiPT: 0 : 1
MorningScifi: Assume 1 = 0. If 1 = 0, then anything*0 = itself.
st47ik: @ensareray99 i think augmented reality combined with machine learning is the future but when exactly it will blow up idk
imaginenation: isn't Math actually metamath in the first place?
VinDanielYT: Hey
imaginenation: can you increase FONT please
imaginenation: size
amratesh: start by assuming 0=1. then 1=1. hence 0==1
xrealyy: you always put your 2 fingers on 4head while thinking @geohotz?
imaginenation: I cant see what he is typing
st47ik: activating the third eye to focus 4Head
imaginenation: @georgehotz font.size   please :D
voodoorama: @imaginenation it's a secret
ensareray99: @st47ik Yeah it can be but right now the glasses is so annoying and hard to use. I dont know maybe with quantum computing it can be easier in the future and we can make better glasses
macca_r6: how do you find programming on a mac compared to a windows machine? @georgehotz
yoyo_brobro: yoyo_brobro subscribed at Tier 1. They've subscribed for 7 months, currently on a 7 month streak! legend
hexicity1: what is he coding?
c9bd: some shitty math proof i think
imaginenation: its funny that george complaints about views but doesnt have his stream alerts setup xD
amratesh: start with 0=1, then 1=1. then set theory (Parnetos principle) that a set cannot contain itself. hence 0==1
st47ik: no stream subscriber alerts NotLikeThis
imaginenation: exactly same with instagram, he wasnt even posting :(
imaginenation: I dont want my 7 month sub in a row to go unnoticed lol
xrealyy: is this even proofable?
imaginenation: FeelsBadMan
amratesh: dude read my previous message. yes I'm telling you to do stuff and I know you hate it
mrmusicmaine: there are few philosopher kings in tech, geohot it one of them
imaginenation: yeah but if he played by the rules of the attention economy he would be a billionaire by now
macca_r6: does he even read the chat lmao
imaginenation: which I dont get, why he doesnt want to go on joe roegan
imaginenation: exactly he doesnt even read whaty we are saying most of the time
amratesh: because it's drugs and mainstream press
st47ik: he went on Lex Fridman, was cool
imaginenation: we are just bots :( I was subbed to him 3 months in a row.
imaginenation: I loved his interview on lex for sure and his talk on breaking the simulation
macca_r6: he is a smart man. He is too busy to read the chat lmao
st47ik: MaN is focus is intense too
imaginenation: and thus he shouldnt complaint about not getting views
xxdvxx: reverse engineering math
imaginenation: or subs
amratesh: GEORGE!!!
amratesh: Start with 0=1.
SA20Knightmarre: hi george u look pretty today
amratesh: then Parneto got your back
imaginenation: @amratesh you're typign in vain my dude
amratesh: A set cannot contain itself
st47ik: :o
tsAllySparkles: start rapping again
imaginenation: i'm only interested in his comma ai stuff and other things I really dont enjoy this meta math stuff but oh well
lidermaury: Do u guys don't see code too?
imaginenation: yup too small
amratesh: lol you don't even know what's up
amratesh: comma ai is yes. but this is important
imaginenation: are you talking to me @amratesh ?
imaginenation: important to who?
imaginenation: exactly?
Zealeigh: I think Georges 'turbo' button is between his eyes? He keeps pushing it.
tsAllySparkles: what are you creating?
lidermaury: zoom in code
amratesh: let's just say important for the progression of humanity
st47ik: quick maths Kappa
imaginenation: @amratesh bruh look at this dood
zoki_macola: I watch him to learn something, but he doesnt like explaining himself to newbies
imaginenation: nah
amratesh: He doesn't want to be a streamed FFS. he goota do it. because that's what needs to be done rn
imaginenation: you dont learn jackshit by watching this stream lol
SA20Knightmarre: what time is it in california ?
amratesh: GEORGE A SET CANNOT CONTAIN ITSELF!
broadhawk: what about 1   1
imaginenation: this isnt a a learning stream, its watching geo go Pepega
st47ik: @SA20Knightmarre its on the top right lol 1:47 PM
imaginenation: lmao
imaginenation: @amratesh dude you're trying too hard and its making you look bad
cam_______: forkbomb(){ forkbomb | forkbomb &amp; }; forkbomb &lt;---- will crash a unix operating system
st47ik: a set cannot contain itself SMOrc
xxdvxx: ok @cam_______
amratesh: https://en.m.wikipedia.org/wiki/Russell's_paradox
st47ik: milk will make even more acid :s
st47ik: a set cannot contain itself NotLikeThis
SnakeAz: i love internet, you can watch and talk to one of the most influental hacker in the world, on my phone in my bed from africa.:)
amratesh: geohot can you gift me a subscription when my current one ends? lol
lidermaury: yes
amratesh: last text. sorry
C4TFive: I can be a doctor from webMD alone
th3_maj0r: hey hey
SnakeAz: best invention ever.
BambiPT: True
komocode_: is Elon still on track for robotaxis by end of next year?
st47ik: WebMD LUL
cam_______: The problem is the internet is also the biggest distraction that humans have ever had access to
st47ik: true
alexdickson98: @georgehotz what would be your advice to dedicate more time to programming and love it as much as you do
zoki_macola: Elon is always overpromising, dont listen to him
W1lkins: alexdickson98 are you srsly asking how to love something as much as someone else does bruh
Merwanedr: Glad to see he's back to Vim
BambiPT: still waiting cat girls from elon
lazystoic: can someone explain to a mortal what he is doing/trying to do?
cam_______: The Elon circlejerk is stupid
fwef64: Is George no longer using vscode?
Inconnu_xD: kuruF
st47ik: @alexdickson98 i think u have to grow ur interest to make it motivating first, and then try and do small milestones for rewards to keep you going
komocode_: is Tesla/Elon talk not allowed in here?
lidermaury: can you turn up the font size please
revolutionist123: monkaS
alexdickson98: @W1lkins i know its wierd but maybe he has some way of thinking that may change me
Merwanedr: It's a lot more inspiring when he uses Vim TMUX
smurfd0: "ice ice baby" :)
st47ik: Banana time Kreygasm
Merwanedr: I thought you were done with Metamath
alexdickson98: @st47ik thx, ill try the milestones/goals will see
swsh: maybe you should do it in scope ${ }$, with $e wff = x 0 $ inside or something
amratesh: start with assuming 0=1. then prove 1=1. and then set theory
zoki_macola: But i think the robotaxis will be the first example of (almost) perfect tech, self sustaining in almost every way
alexdickson98: whats you rmath background
itsChoudhry: Math or metamath?
st47ik: Pure math is love
lazystoic: why arent we talking about selfdriving on this stream?
Merwanedr: Can you please stream programming related to cryptocurrencies in the future George? I've been waiting for a while since the BCH transaction stream haha
EpicDreamGod: are you trying to achieve enlightenment by giving yourself a brain freeze?
amratesh: we're only allowed to say comma ai is yes
chocolatechp: i learned how to give myself a haircut, do you want me to give you one
st47ik: amratesh is yes
Kyoto_o: nothing
alexdickson98: nothing haha
nautzz: monkaS
lidermaury: rip amratesh
komocode_: how come you don't use duck duck go?
xxdvxx: rip lol
amratesh: NOOO!
swsh: witness the history lol
Kyoto_o: that's why i'm not a sub, suck a dick LUL
amratesh: you can but don't
dontbeameme: Did u see the fight George ?
quevlo: what's your math background?
chocolatechp: chocolatechp subscribed with Twitch Prime.
amratesh: I'll shut up
FargioFarmani: drama right here
lazystoic: @komocode_ he doesnt really know programming, hes faking it
benpeterscode: everybody take it easy lol
dontbeameme: Fake programmer
st47ik: chat calm down NotLikeThis
zoki_macola: PogChamp
benpeterscode: make code not war haha
dontbeameme: Buffer overflow shell
Merwanedr: while he's not here
Merwanedr: any idea why George is mean to his subs?
SupaDeviserr: @dontbeameme wat does that mean?
xxdvxx: lets talk about self xrivi
Merwanedr: oops
dontbeameme: @supadeviserr I don’t know 🤷🏽♀️
amratesh: he's not mean. I was being silly
st47ik: he's not mean he just dont want to talk about those stuff
chocolatechp: do you have any emojis george
komocode_: what happened to his gaming PC?
matthewmirman: @georgehotz Twelf/LF is much more relevant to designing programs that reason about programs than metamath is, and much easier to write an automated theorem prover/verifier for you know
alexdickson98: this chat is useless no one helping
smurfd0: standupmaths on youtube is quite entertaining and dumbs down some math stuff.. would have loved to have him as a math teacher
lazystoic: @georgehotz what do u do for a living?
amratesh: Twelf/LF
st47ik: @alexdickson98 what do you need help with?
dontbeameme: @alexdickson98 I’m here as a HYPEMAN
alexdickson98: no i mean george ahhaha
SupaDeviserr: lately i've been enjoying vim buffers, i feel like ultra geek nerd now
komocode_: here's a math thing: twitch   weird chat = subscriber only chat
lazystoic: this is like watching the matrix bro
dontbeameme: @komocode_ Sounds not very inclusive
TheKnopex: hows the cloud?
lazystoic: 1 1=2 ure welcome
amratesh: @lazystoic word
fwef64: fwef64 subscribed with Twitch Prime.
snowbola: are we trying to get george verified on instagram yet?
3even: Dude, nightmode your search results
3even: stylish plugin
amratesh: I don't want to annoy you anymore. but please read Russel's Paradox
3even: hahaha
lazystoic: @georgehotz whats ur iq bro
Yemtex: 5Head
st47ik: stylus extension for chrome? its open source
dontbeameme: George could just call up a homie but stubbornly wants to solve it on his own
3even: Yes Stylus. THats what i meant
3even: Extension for Chrome or FF
Merwanedr: Yo George has Metamask installed, what do you think he does with it?
amratesh: good night GeoHot. I gtg now
st47ik: good night @amratesh
fwef64: @georgehotz I've seen you use Emacs and VSCode on the stream, what makes you stick with good old Vim?
dontbeameme: Duckduckgo&gt;google
st47ik: have u tried Twelf LF framework?
amratesh: Russell's paradox
bassxzero: Have you tried setting chat to wombo?
amratesh: You're literally stuck on Russel's Paradox. and you won't listen to me
meliodasfxk: is he using atom ?
amratesh: now bye. you can ban me but don't be calling me low quality FFS
montecarlo: no look at the top left
amratesh: https://en.m.wikipedia.org/wiki/Russell's_paradox
xxdvxx: go sleep @amratesh
meliodasfxk: LUL
knight69gamer: monkaS
drShackle: LUL
dontbeameme: Lolololololol
dontbeameme: Lololololololo
st47ik: damn
smakatak: LUL
supnerdstv: does he rly know it
amratesh: Take a set {0}
amratesh: it cannot contain a set {0,1}
FargioFarmani: drama right here and now
lazystoic: hes right
amratesh: I'm sorry you can punish me :(
st47ik: LUL
meliodasfxk: LUL LUL
swsh: LUL
zoki_macola: im sweating
dontbeameme: Lololol
Richardable: SeemsGood SeemsGood
smakatak: BANNED
W1lkins: take a number 0, it cannot contain the number 1
alexdickson98: what switches do you use! @georgehotz
Merwanedr: ouch
rudolphdoesgames: gotta try that in my next math test
swsh: 0 is a black pixel, there math is broken confirmed
st47ik: @alexdickson98 check the bio :s
xrealyy: why do you even care about this meta math?
kzonixcomua: when do you plan to make leetcode (or hackerrank) stream?
alexdickson98: fuck
kzonixcomua: Or you do not
smakatak: am I the only one who doesn't know what geo actually doing
Merwanedr: Absolutely not.
xrealyy: nope
dontbeameme: Nope, low quality chat today
supnerdstv: isnt it obvious? Kappa
ortiga88: how to raise a permanent environment variable in linux from a service
ortiga88: ?
amratesh: I'm sorry. I'll be quite like I used to be
Merwanedr: I miss the time when he was streaming Bitcoin Cash transaction on Adderall.
meliodasfxk: what type of code editor is he using ? LUL
3even: Who was streaming Bitcoin Cash transactions on Adderall?
yuptheladsdownthecans: @meliodasfxk vi or vim maybe? Not sure
Merwanedr: George haha
foxubu: I miss the deep learning times (e.g., chess engine)
3even: @Merwanedr lol
meliodasfxk: @yuptheladsdownthecans ohh ok, ty :P
xrealyy: twitchess was nuts, still no idea what code mean but it was great anyway :D
eaterenrgy: I miss the capture the flag times.
Merwanedr: He even got into a controversy by saying that BCH is the real Bitcoin (for trolling)
The_Tyrant: george is there an email to contact you man?
Kriplok: Basic programming category on twitch, reading Russel's paradox. Good luck man)
3even: BCH IS the REAL Bitcoin
rudolphdoesgames: Where do you even get your ideas from?
th3_maj0r: I miss Great Pico CTF times
Lugueiro: @3even ?
MeGiveYouDie: ?use you do keyboard What
Merwanedr: I would rather say the original vision @3even
The_Tyrant: !setup
3even: Yes the P2P currency version
foxubu: I miss George ordering food
Merwanedr: Reality is subjective as people elect what they want in consensus algorithms (PoW)
3even: I miss George's lady friend
Merwanedr: I MISS GEORGE MAKING FOOD @foxubu
kzonixcomua: What he is doing is a basic programing in 2019 - evolution baby =)
lucasmaekawa: what book is this?
zigzati: @lucasmaekawa metamath
foxubu: The Metamath book I guess
lucasmaekawa: ty guys
xrealyy: anyone waiting for Musk's cybertruck?
xxdvxx: we dont talk musk here
matthewmirman: https://gist.github.com/mmirman/0bb05b2736c35d4278c7f8d9888d9af4
xxdvxx: we're math stream now
foxubu: Elon left Twitter :D
matthewmirman: ^^ 2 2=4 in 5 min
matthewmirman: in twelf
xDestris: can someone explain me what is he doing
lidermaury: Geo the type of bygga to fart into the toilet and flush
dontbeameme: Didn’t wash hands
litenull: wash your hands bro
peter35_: are we using peano arithmetic?
dontbeameme: Eating nails didn’t wash hands
3even: @lidermaury lol
matthewmirman: pretty chill
smurfd0: im starting to understand why math people in the past tried to drill a hole in the skull to improve thinking capabillities :]
swsh: you signed up for this when you dropped coq for a more hacker version
matthewmirman: you don't need nat to be anything special
matthewmirman: you should define it all
matthewmirman: yeah its poorly designed
matthewmirman: we had to do all that in a very similar thing to metamath in math logic at cmu
matthewmirman: it was hell
dontbeameme: Is this basically a crossword for smart people
zigzati: @dontbeameme crossword doesnt use your brain tho
zigzati: just recalling stuff
cybermajestic: george helloo
dontbeameme: @zigzati Yes , problem solving
swsh: first prove 0 != 1, don't bother with plus
matthewmirman: I think, without knowing too many of the details of metamath, is that you end up defining naturals using actual peano arithmetic which is a low level instantiation of induction and not the higher order abstractions over induction that better designed languages have
matthewmirman: it'd likely be even easier in agda/idris
metis_zver: Hello, how do you save your eyes?
matthewmirman: I think though CoQ and Agda have the issue that code (equality checking) isn't something you can prove things about
matthewmirman: whereas in Twelf/LF, your code (plus, equality checking) is actually something you can prove things about, not just a definition
jesuuusete: what language is he writing ?
matthewmirman: currently CoQ, before metamath
parviz_a4: hi
sutures_md: Have you used OCaml @georgehotz ? Pretty rich type-system and some sweet compilers to play around with
decarbonite: is this lisp NotLikeThis
matthewmirman: yo also, I'd recommend agda over CoQ, fewer random keywords to remember
matthewmirman: its less mathy sure
MacoNighto: my teachers made coq and ocaml
matthewmirman: but thats kinda the point
Plurmorant: Lean BabyRage
MacoNighto: if anyone cares
st47ik: how about Twelf?
st47ik: u tried it?
matthewmirman: if your in a proving math mindset, its a lot harder to understand how automated theorem verifiers actually work and how to prove things with them
MacoNighto: what's cool with coq it's that they made compcert, a mathematically proven C compiler
matthewmirman: the axioms are derivable
matthewmirman: (or at least a lot are)
sirleeroyjenkins: How u doin George hope everythings going well
matthewmirman: from a smaller core of axioms
matthewmirman: like for example axiom of choice
matthewmirman: you can prove axiom of choice from nothing in CoQ/Agda
sutures_md: anyone else here in Boston?
MacoNighto: do you know why they named it coq ?
MacoNighto: c'est le seul animal qui arrive à chanter les pieds dans la merde
amratesh: 👀
MacoNighto: MacoNighto subscribed with Twitch Prime.
Richardable: le coq sportif
MacoNighto: haha
matthewmirman: yes
st47ik: LUL
bankzed: Hello from IRC
xDestris: monkaS
matthewmirman: the thing with the proof in twelf, is that you can prove something about the proof itself also when your done
matthewmirman: which is what you eventually want to be doing I assume
nanodanger7: nanodanger7 subscribed at Tier 1. They've subscribed for 18 months, currently on a 18 month streak! 18
matthewmirman: the problem in CoQ is that you end up in prop
matthewmirman: and once your at the bottom level you can't go down more
matthewmirman: kinda, idris has the best solution for it: it topologically sorts your theorems
matthewmirman: and you never have to worry about it
matthewmirman: everything is just "type"
matthewmirman: but there, you don't have to think about it
matthewmirman: not russell's paradox
shieeeeeeeeet: are you going to switch to a statically typed language for your interpreter?
matthewmirman: its a different paradox
matthewmirman: omega paradox
matthewmirman: way harder to understand
swsh: LUL LUL
amratesh: 👀
zoki_macola: lol
st47ik: @amratesh u still here LUL
matthewmirman: the type theory version
matthewmirman: I'll find a link to the agda proof of it somewhere
P3droPL: @georgehotz Why you came back to Mac? What is wrong with Razer   Win?
xrealyy: pedro co my tu robimy, ten goscto jakis swir
BryanSWAGBEAST: yo what's up George! long time no see
P3droPL: haha
matthewmirman: called girard's paradox for type theory
matthewmirman: russels paradox and girards paradox have non isomorphic proofs
superman03: hi
matthewmirman: https://github.com/nzl-nott/PhD-of-nzl/blob/master/Exercise/Ex4/girard.agda
Celestial_Jaeger: what do you do for a living george
C4TFive: New things DansGame DansGame DansGame DansGame
K177Music: Hi, I'm here to ask about your keyboard :)
K177Music: what keyboard do you use :)
itsChoudhry: LOL ^
matthewmirman: I guess yeah, typically learning about all the ways you shouldn't do something helps you learn the right way to do it
nautzz: wouldnt it be good to just mute everyone other than matthewmirman in the chat
nautzz: everything else is just noise
C4TFive: We should all stop talking for @matthewmirman
K177Music: i think george is an engineer of some sorts
superman03: do you know what's going on with libratus?
Celestial_Jaeger: i just wanted to know how george earns money
xrealyy: who is this guy and why he's not working in comma ai
K177Music: fr, wheres my cheap autonomous vehciles 😡
C4TFive: This is heorge gotz
lidermaury: you guys have no idea what are you doing
K177Music: vehicles **
xrealyy: i like pickled onions
K177Music: same
BryanSWAGBEAST: I though Geroge was moving to Mixer lmao
K177Music: hes waiting for the $2m contract PepeLaugh
Celestial_Jaeger: also I like how the category of this is Basic Programming for a lack of a more appropriate sub category within programming, but this is anything else but Basic Programming
bankzed: Nah, he's coding his own streaming platform
C4TFive: hes gotta get that mixer money first
swsh: prove 1 = 1 from x = x
K177Music: I'm loving this basic programming you're doing
amratesh: 👁️
K177Music: hes doing a gang sign TriHard
K177Music: it means that x is equal to x
matthewmirman: typically you have an axiom of reflection
matthewmirman: but I don't see how that helps you with 1 != 0
BryanSWAGBEAST: Mac or Windows?
xrealyy: so axiom means something obviousness, certainty, got it
matthewmirman: not really
matthewmirman: axiom means something we've decided is fundamental
matthewmirman: it might not be obvious
cathandez: why not use Maple
cathandez: JK idk what im talking about
xrealyy: wow so there's no assurances that this is true, math has a lot of depth, i go back to shadow
rektiw0w: abstract mathematics monkaS
MrBankster: hey BrO!
NoLimitFitness: !uptime
SA20Knightmarre: what is the language ?
xrealyy: when i first heard word axiom in college i couldnt stand still
rektiw0w: @xrealyy gives me anxiety thinking abt it
matthewmirman: @xrealyy in fact if you try to prove logic is consistent you need to assume the existence of an ordinal not definable in that logic. if you assume all ordinals exist, you are inconsistent
NoLimitFitness: sub alerts set up?
matthewmirman: so provably, we can't prove anything works
SA20Knightmarre: @rektiw0w same, and my math professor often says "that is trivial" when it was so hard for me
johngeorgesample: johngeorgesample subscribed with Twitch Prime.
matthewmirman: see, the issue with proof search for stupid languages like metamath and peter andrew's thing (and first order logic proof systems) is that you basically can't narrow down the search at all intelligently by types, since the types are so simple
xrealyy: seems like you learn a lot matthew, congrats its hard these days
matthewmirman: there are infinite combinations of them
swsh: eureka
ZeeZaxean: Pog
xrealyy: clicked in the head
bloodborne24: we're learning bois PogChamp
matthewmirman: the issue with more intelligent languages with more complex types is that typically searches among them are intentionally designed by the programmer by default
smurfd0: search for "2 2=4" on that metamath page. you have some ideas on how to approac it (there is some trivia ... you proably read it)
matthewmirman: there isn't a language yet thats put together some way of learning tactics for complex types
swsh: so does tzero tsucc pa_ax1 works?
hughjohnson: keyboard?
superdorage: PorscheWIN
hughjohnson: MonkaS
matthewmirman: I have a couple ideas for how youd do this with problog style inference on top of a logic programming core version of PTS/idris (what I was building in caledon before apple)
wiseai: HELL YEAH :)
matthewmirman: i.e. learn problog
matthewmirman: well, probabilistic programming languages are shit at the moment
matthewmirman: https://github.com/mmirman/caledon
swsh: i've tried Pyro by uber, there are uses!
matthewmirman: probabalistic programming isn't the problem as much as the idea hasn't been developed enough
matthewmirman: its still in the "we have lambda calculus 1920" phase
matthewmirman: so problog (and now my team's psi) has this nice inference thing
matthewmirman: where you learn probabilities of facts
matthewmirman: if you get enough facts
matthewmirman: you have a neural network
matthewmirman: but thats useless
matthewmirman: in problog at least, because it would be hella inneficient
matthewmirman: and also there are no types
matthewmirman: so you can't then use your neural network to reason about programs
matthewmirman: or do any sort of search
amratesh: @matthewmirman I think I got it, gimme a minute I gotta check
matthewmirman: well the problem is to make them useful
swsh: saying there is no uses for PP is like saying statisticians do nothing, how about Stan, PyMC
matthewmirman: yeah, also, our team is like actively selling probabilistic programming languages to users
shieeeeeeeeet: how does proving program equality -&gt; you can find bugs?
matthewmirman: at eth
matthewmirman: nah, psi
shieeeeeeeeet: or is it like finding bugs in diffs of the same codebase?
leander_ms: Hey, what is your typing WPM score @georgehotz
matthewmirman: https://github.com/eth-sri/psi
swsh: Probabilistic MetaMath PogChamp
swsh: let's prove 2   2 =4 with 95% confidence
baymer1: yo it's the LEGEND
protectionfromblue: vter
protectionfromblue: jk
superdorage: Can anyone calculate the probability of me being accepted from Y combinator batch?
MiniManiacBlob: @georgehotz g'day sir
baymer1: Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 Terminator1 bonus2 what if phi
veritasjs: hi
MiniManiacBlob: so whats the objective here?
superdorage: TheIlluminati
Vesh: evening george
bubblesnot: hey random question do you know anything about detecting polymorphic and metamorphic computer viruses?
yeah_haey: Can i hang out with you in la
yeah_haey: Why arent you using Grothendieck toposes
yeah_haey: Prove gauss bonnet theorem
eduardoadf1: prove metamath
The_Tyrant: george any email to contact you? please
matthewmirman: its after midnight here I'm out, if you get to actual neural proof search lmk
superdorage: @the_tyrant my autograph is available.
The_Tyrant: dowrigUK
Piqcyl: Hey Goerge, I'n a previous stream I watched on YouTube you took L-Theanine. Would you say it has actually cognitive benefits or is it a placebo?
Piqcyl: in*
amir_shehata: hey my man ur the best in python
andrewnakas: andrewnakas subscribed with Twitch Prime. They've subscribed for 3 months, currently on a 2 month streak! Friick yes
andrewnakas: Oh Frick yah
amir_shehata: what is this project about
andrewnakas: its a coq
amir_shehata: and what language guys
andrewnakas: for backspace ai starter pack
andrewnakas: porting metamath to python
andrewnakas: python is language
amir_shehata: ty &lt;3 &lt;3 &lt;3
swsh: PogChamp
roronoa_d_law: tf is he doing
amir_shehata: ru live now on yoytube
idkfa22: Big fan of your work
idkfa22: I think you are awesome
Piqcyl: hi youtube
alexdickson98: how does this man not get tired
Ace: @georgehotz you hiring?
cerrad1234: wtf is even going on
Piqcyl: @alexdickson98 how do you not get tired when you go about your day?
StupidGladiator: how can i become a great dev, im fed up with web development
alexdickson98: true
alexdickson98: xd
JesseSkinner: pchai
superdorage: Sundar pichai
Piqcyl: Math is a set of axioms and definitions, from this you can make deductions through rigorous proof. Pretty sure what he is building the mathematical framework to deal with these objects. Theoretically you can discover new mathematics through brute force and this is a possible future development in mathematics. Not sure why George is interested in it rn tho.
Artistxtv: ur smart as hell lol
swsh: your cam obscures some code &gt;(
Piqcyl: Is phi a set?
amratesh: 👀
function_2win: liked the chat with Lex
SKPTCL: Long stream today
amratesh: I like it
Piqcyl: @georgehotz does L-Theanine actually have noticeable benefits?
SKPTCL: Nootropics are a meme piqcyl
Piqcyl: George took it in a previous stream
Piqcyl: Just wondering
Piqcyl: I'm aware of that, coffee doesnt make me smarter but it definitely helps me get things done.
amir_shehata: can i be billionaire from Programming PogChamp LUL LUL LUL
Piqcyl: If i buy coursera ML courses and take nootropics will i be a bitcoin billionaire data wizard?
Piqcyl: lmaoooo
Piqcyl: George why are you working on this? Out of interest or does it have relevance to your other projects?
smurfd0: write it in english first, then go from there?
zoki_macola: is there a programming language that consists of just a few simple rules and everything else is made through metaprogramming
Piqcyl: what is the notation x t
Piqcyl: x is an element of t?
Piqcyl: for all x, phi -&gt; for all x, (x=t), implies phi. Not sure the syntax here but doesnt this mean you are implying that phi implies itself?
Piqcyl: yea this syntax is janky as hell lol
Super_saiyan_3: can anybody tell me what hes trying to do? lol
Piqcyl: computational framework for mathematical logic
Piqcyl: that what coq is
Super_saiyan_3: ah, sounds to complicated for me
jay_al97: are u still trying to understand metamath
Piqcyl: Are you doing this for pure interest?
Piqcyl: Or is it one step towards a larger project
zoki_macola: but I don't understand why are you trying to prove a thing. What does proving something has to do with creating complex data structures or whatever
Piqcyl: Theoretically if you are able to computationally represent mathematics and all of its axioms. You should be able to use computational power to brute force discover new TRUE mathematical statements.
snapcs1: theory is a big part of computer science
BigBrainDota: you guys are on some 200 iq shit
Piqcyl: try print(" 2 2 = 4")
SlaterUSA: what's the ritalin count today, boys? :D
SlaterUSA: 4:30 y0lo blazit
notmichael: GEOHOT WHATS GOOD SON
Piqcyl: http://us.metamath.org/mpegif/mmset.html#2p2e4length
Piqcyl: this website looks like it might be relevant
lazystoic: @georgehotz have you ever tried DMT?
smurfd0: https://www.math.wustl.edu/~kumar/courses/310-2011/Peano.pdf or maby https://www.cs.toronto.edu/~sacook/csc438h/notes/page96.pdf two fat pdfs .. not sure though
twiggy_io: Hello George
swsh: let's contact the author of peano.mm and ask him
twiggy_io: Im starting to think a lot of the internet is a waste of time.
Piqcyl: Why is that
andrewnakas: I do
dorkmo: ROBER LETSSS GOOO
notmichael: Yes yes
swsh: 80 years old daaamn
Piqcyl: https://math.berkeley.edu/~solovay/
Piqcyl: give him a call hahaha
etess9001: ResidentSleeper
dorkmo: oregon
dorkmo: doxing robert
zoki_macola: https://en.wikipedia.org/wiki/Robert_M._Solovay
dorkmo: x   x = 4
Piqcyl: So what are you guys workin on
notmichael: Well
zoki_macola: Robert Solovay is a boomer
cutza: order a pizza
Piqcyl: George is a boomer
gunnaren: uber eats
notmichael: LUL
nautzz: fix u up some rice &amp; bananas somali style
Piqcyl: Chicken Masala
Alandas99: !uptime
notmichael: You okay man? lol
notmichael: LOL
kungfudog2012: jasonrBangem
Piqcyl: Dang didnt get to read what he said
notmichael: Time to ring up robert
gunnaren: will you do any writeup of this when ur done?
swsh: hard stuff makes us better
twiggy_io: Metamath is pretty black and white.
Piqcyl: Why are you doing this? Is a step towards a larger goal or is this just pure interest?
Piqcyl: sorry for 2nd time asking lol
notmichael: I won't lie, I have no fricking clue what's going on. I'm just here cause george
64pillars: 5Head ah yes
gunnaren: @notmichael Half the job is pretending to know what's going on :D
maefff: bless you
notmichael: BLESS YOU
fear_ep: bless you
ADivorcedFork: 5Head
notmichael: Every move george makes is a 5Head move
Piqcyl: good luck m8
Piqcyl: gtg
thuganalyst: This is so complicated
TokaMakaridze: what are you doing man? WutFace WutFace
gunnaren: we gotta get your instagram to 20k by the end of the year
PrinceKingly: chat why is it a timeout if you ask him about his keyboard ? LUL
smurfd0: is this the set thing you are not looking for? https://math.stackexchange.com/questions/627434/prove-that-4-is-the-only-solution-to-22
itsChoudhry: For those who don't understand what is going on someone linked him metamath he started exploring it now he's trying to make it work. Metamath is good for verifying things by axioms you define. (I'm guessing form what I understand) There's no defined goal, apart from trying to work it out.
vave2_: so is this like a program that proves math theorems
itsChoudhry: from*
thuganalyst: @princekingly because that question gets asked A LOT so it probably got annoying. I think he should just put it in the stream description or something
thuganalyst: Or set up a bot to answer that question lol
PrinceKingly: maybe there's a bot for it let me check
PrinceKingly: !keyboard
PrinceKingly: no there isn't LUL
itsChoudhry: @vave2_ Yh basically
TeaLeafi: geo are u jewish?
TeaLeafi: the keyboarding clicking is soo ASMR.. &lt;3
itsChoudhry: He should write a bot to timeout people who ask about the keyboard in chat. He could use this metamath to verify it works LUL
notmichael: Lol why are you asking if hes jewish xD
TeaLeafi: just curious
NotFire_: tealeaf is jewish KappaHD , jewish people like to ask other people if they are jewish. no particular reason, just cuz MiniK
notmichael: PogChamp
itsChoudhry: Fuck yeah
TeaLeafi: WutFace
fear_ep: are you an AI? KappaHD
PrinceKingly: guys can you buy the stuff he created to make your car drive itself
notmichael: Its on their website
notmichael: comma.ai
TeaLeafi: bet
notmichael: off
zoki_macola: NotLikeThis
NotFire_: @fear_ep i think you're on to him Kappa you got him spooked, we dont talk about that here Kappa
robby0313: Why meta math
TeaLeafi: "we dont talk about that here" in what regards???
NotFire_: @TeaLeafi him being an ai
NotFire_: AI
itsChoudhry: It's like fightclub SHHHHH
TeaLeafi: we dont talk about it truee..!
TeaLeafi: @NotFire_ arent we all just A.I's in the BIG universal server protocol?
NotFire_: @TeaLeafi No FUNgineer
TeaLeafi: each living being, or living carbon/silicon atom is a byte in memory of the program.
TeaLeafi: the universe is holographic simulation. #scaryFACTS
PrinceKingly: i'm watching this and to be honest i understand shit. just watching coz it's geo
notmichael: Same lol
smurfd0: the bytes must have been expensive when they thought of this language :D
TeaLeafi: when you can create matter out of nothing and ultiimate divine intelligence, you can create anything UwU
phrixus_bro: does he talk to himself when he programs for real or just on stream for our sake?
TeaLeafi: asburgers he talks to himself @phrixus_bro
AHIOV: Most likely both
notmichael: asburgers? lmao
NotFire_: both
NotFire_: but mostly for us
phrixus_bro: cool
AHIOV: Is Hackintosh worth the hassle just for the sake of having 2 different OS ?
TeaLeafi: @AHIOV no just Linux
notmichael: If you really need windows and macos then sure it is lol
TeaLeafi: @AHIOV kali linux so u can do some gangsh1t
notmichael: kali linux so you can do some gang gang hacker shiz naw mean?
TeaLeafi: i mean ur not wrong
AHIOV: LUL LUL I'll think about it
amzirK: hello my dude
josalt: Hey everyone
notmichael: hi
amzirK: @josalt HeyGuys
TeaLeafi: UwU
notmichael: Something happened!
zipppyzoom: SeemsGood1 SeemsGood1 SeemsGood1 SeemsGood1 SeemsGood1
swsh: commit push
anokhiml: this is proof verification?
cod4TV: do hackthebox!
TeaLeafi: good job!
cod4TV: PLZ, do hackthebox!
TeaLeafi: hackthebox!
gunnaren: weird question, but; Is this more of a programming challenge or a math challenge?
TeaLeafi: this is a chemistry challenge @gunnaren
anokhiml: lol
andrewnakas: its a basic programming challgenge
gunnaren: I miss subonly chat
TeaLeafi: Geo did u get "Death Stranding" game?
cod4TV: How is this categorized as "Basic Programming"?
th3_maj0r: @gunnaren lol
cod4TV: It's really Advanced!
gunnaren: @th3_maj0r Don't you agree :D ?
TeaLeafi: this is childs play lol @cod4TV
th3_maj0r: maybe
anokhiml: hes learning the language though so... basic
peter35_: i recently heard of curry-howard-lambek as well; adding in cat theory
Cicero4259: cs major with math minor vs math major vs cs minor? @georgehotz (I wanna do ml with just a bs)
anokhiml: cs major, statistics major
briva56: briva56 subscribed with Twitch Prime.
grizvok: yeah stats would probably be better if you truly want to just go into ml
anokhiml: really it would be math major with extra stats classes
dorkmo: this mustache https://en.wikipedia.org/wiki/W._Hugh_Woodin
cod4TV: Get back to hacking!
hazrid93: wetf is metamath
TeaLeafi: how about just self learning...? no need for some dumb fancy paper to proof that you know how to do it! @peter35_ @Cicero4259 @anokhiml
th3_maj0r: @cod4TV I think the timeout from George is really close dude
dorkmo: https://en.wikipedia.org/wiki/Ω-logic
M0tyak: Should i learn vi ?
cod4TV: @th3_maj0r Indeed! BibleThump
zakonegrusha: hacking is super boring
bubblesnot: what are you proving here?
TeaLeafi: CHIK FILET?
anokhiml: @TeaLeafi he asked which degree is better lol
zakonegrusha: 0 is equal to 1
TeaLeafi: POPEYUES
bubblesnot: define 1 and define 0
TeaLeafi: POPEYES CHICKEN SANDWHICH??
cod4TV: No, this is boring, hacking is more fun!
zakonegrusha: If 1-0 = 0, then 0 - 1 would equal -0? hah gotcha
TeaLeafi: @cod4TV shhhhhhh
zakonegrusha: @cod4TV your wrong, HTB and hacking sucks
TeaLeafi: hacking is boring...
zakonegrusha: legit a bunch of nerds
zakonegrusha: thinking that MSF is cool
TeaLeafi: omg geo saw my chat &lt;3 &lt;3 &lt;3 &lt;3 FANGIRLING &lt;3 &lt;#
cod4TV: the fontconfig stream was awesome!
cod4TV: that's what i call hacking!
cod4TV: why?
zakonegrusha: bunch of skids.
cod4TV: @doganigooo2 yes
cod4TV: who's the moderator?
th3_maj0r: Don't talk about commaai guys, he will timeout yoou
revolutionist123: anyone know how he exits incert mode on vim
revolutionist123: *insert
th3_maj0r: by pressing ESC?
jax05_: lookup vim cheat sheets
revolutionist123: cause many people bind it to another key
jax05_: I see
cod4TV: how many min is the TO?
th3_maj0r: Check his vimrc, btw I don't think he rebinded it
coProof: POGGERS
Ammari1: Hey I am a big fan, did you hear of CheckRa1n? Would be nice going through an explanation of how the exploit works
coProof: i never understand how were really ever doing anything in these twitchcoqs
cod4TV: he ignores chat
Ammari1: Does he read chat?
jax05_: not really, he's just thinking
jax05_: he reads chat
doganigooo2: yea he reads got TO twice
cod4TV: lol!
JustAnEdtior: did u get to prove that true is not false?
coProof: ill be back later
cod4TV: geo, can i live the glory of TO?
cod4TV: HKKB Pro 2 LOL!
cod4TV: HHKB*
cod4TV: COMMA AI is the best
cod4TV: Do hacking!
cod4TV: You are hungry don't code!
cod4TV: HAPPY HACKING KEYBOARD doo doo doo doo
th3_maj0r: Was that a real question?? ahahah
cod4TV: aren't u hungry ? eat first than you can keep coding
cod4TV: Police are coming to you, geo
altic: !uptime
zoki_macola: is that a dog howling
cod4TV: I am anti-TO
th3_maj0r: 4h 52 minutes
cod4TV: B|
cod4TV: is it geo or george?
Scott_w_c: "basic programming"
skate77777: I love u dude
skate77777: And im sick of you cod4TV
cod4TV: @Scott_w_c Very Basic!
Scott_w_c: lambda calculus = simple stuff
Scott_w_c: i wanna know how this dude did in highschool
Scott_w_c: probs better than most teachers
dawgwhisper007: ignore it = ignorant
cod4TV: @skate77777 STFU!
skate77777: You talk too much dont you think?
skate77777: And you Forgot to tell him to eat something
cod4TV: @skate77777 That what chat for my friend..
isensualism: Hey @georgehotz have you ever done any devirtualization? Any resources you can point to? I'm quite comfortable with unpacking, but stuck on devirtualization.
isensualism: something like Themida running code through a VM
isensualism: :^)
QuantumComputingMIT: Suh
QuantumComputingMIT: Aggressive typing
jax05_: progress
erichtp: Terminator15 bonus1
dorkmo: Party1
QuantumComputingMIT: Axiomatically axiomatic
foogs_: I don't even understand normal people words :(
QuantumComputingMIT: Layman of laymens
QuantumComputingMIT: Is this prerecorded
OhDyrHesUdyr: idk
thundershots999: This is live
QuantumComputingMIT: Can't tell, no interaction
shieeeeeeeeet: let the man think
pouringhotteaonyourface: !project
QuantumComputingMIT: He's been thinking for a while
th3_maj0r: It's live, he will answer you if you ask something smart
andrewnakas: geo Hotz you a legend
QuantumComputingMIT: Maybe you predicted that name
raidbossxxx: what
QuantumComputingMIT: hax0r the future
QuantumComputingMIT: @georgehotz Can I work for you for free
phrixus_bro: i like the floors of the apartment
searchingforlife: visual studio looks so different now @georgehotz
foogs_: i just wanna be here when he finds something to exploit the simulation
pouringhotteaonyourface: why did he choose mm rather than
andrewnakas: Hotz im curious what the steps you envision it takes to go from metamath coq prover thing to programming agent from a high level
gordopeIotudo: do you think P=NP?
QuantumComputingMIT: What is this trash language
QuantumComputingMIT: metamath?
QuantumComputingMIT: How long did it take you to learn it
QuantumComputingMIT: And what is your end goal
th3_maj0r: Trash language? you mean java?
QuantumComputingMIT: Java is also trash
QuantumComputingMIT: JavaScript on the other hand
th3_maj0r: also thrash
th3_maj0r: trash**
EEsmash: I like html Kappa
TrapperMx: Kappa
QuantumComputingMIT: ban ur mod
QuantumComputingMIT: he said javascript is trash
CopyNine: D:
SKPTCL: Wasn’t me don’t ban me pls
QuantumComputingMIT: wtf
andrewnakas: lol
th3_maj0r: get rekt!
QuantumComputingMIT: What is ur fav then
andrewnakas: python
th3_maj0r: I like goland
QuantumComputingMIT: Python is for beta males
dorkmo: need some mochi ice cream
QuantumComputingMIT: Malbolge #1
Mbsurfer: What keyboard are you using? Sounds topre. HHKB?
slowgonzales: guys best idea is learn every language and go with which u liked most :D
QuantumComputingMIT: @Mbsurfer ask about keyboard = timeout
Mbsurfer: Just read that in the description. The one thing lol my bad
alextodoroki: @georgehotz i think about you nightly before i go to bed and daily when i wake up. i have a shrine of you that is encrusted and i want to have your babies.
QuantumComputingMIT: wtf
DiaLab: Why is he using terminal for a text editor?
andrewnakas: its vim
QuantumComputingMIT: iOS
QuantumComputingMIT: lol
andrewnakas: @alextodoroki then where is the sub lol?
alextodoroki: do i look like i have a million dollars sir
QuantumComputingMIT: Can someone explain what he's doing?
mirceau: Hi George, I am going to switch from Thinkpad to Macbook. What is your CPU/RAM ?
thundershots999: This is a rice stream with some basic programming
th3_maj0r: @mirceau He don't really like to talk about hardware
mirceau: @th3_maj0r oh.. I that he was a tech guys
mirceau: thought*
QuantumComputingMIT: He is...
th3_maj0r: anyway, take the best for your budget and you are gonna be fine
th3_maj0r: more like a math guy
QuantumComputingMIT: math guy?
mirceau: haha math guy indeed :)
QuantumComputingMIT: more like logic guy
th3_maj0r: Mod said math guy!
dorkmo: please dont label people
QuantumComputingMIT: Yes sir!
mirceau: match aids logic
mirceau: math*
QuantumComputingMIT: He's math fluid
gtnftw: can someone tell me what he is trying to do rn?
th3_maj0r: math stream from a math guy
MrMarkFilaroski: coding for dollars again?
QuantumComputingMIT: put ur head closer to the cam
MrMarkFilaroski: can you see me now? @QuantumComputingMIT
MrMarkFilaroski: Kappa LUL chesscomBrilliant
gtnftw: can you briefly go over what you're doing rn for any people who just joined(me)
guy_ross: guy_ross is gifting 5 Tier 1 Subs to georgehotz's community! They've gifted a total of 5 in the channel!
guy_ross: guy_ross gifted a Tier 1 sub to zoki_macola!
guy_ross: guy_ross gifted a Tier 1 sub to erichtp!
guy_ross: guy_ross gifted a Tier 1 sub to euranymous!
guy_ross: guy_ross gifted a Tier 1 sub to lemonboxed!
guy_ross: guy_ross gifted a Tier 1 sub to Mendacii_!
guy_ross: howdy
thundershots999: Hello
erichtp: thanks for the gifted sub homie @guy_ross
guy_ross: np
jbyte1988: for me
Mariosavitch: is this over your head
jbyte1988: my suscribsion
SKPTCL: Thanks guy ross
IWasnotDemi: What is george doing?
andrewnakas: 0 != 1
andrewnakas: proofing that
mortalog: hey am new to this what u doing ?
Knarez: wtf is this language LUL
WalnutsRule: whats your favorite compiler
vsudo: have you checked out checkra1n
Doodle_Jump92: I dont think so
zeroeagle1: hello everyone
mortalog: okey i went to metamath home page and i guess i found my new addiction
zeroeagle1: Cheer900
katangeu: is that a ysl hoodie lmao I have the same one I think
stupac62: Chat: new here. Is he doing this stuff for intellectual stimulation? Or is there a different goal?
flopagis: @stupac62 his ai is going to use his own version of math itself
zeroeagle1: when he's doing $(...)$ is it creating an atom or something?
stupac62: @flopagis ah interesting. Thanks!
smurfd0: no $ is comments
zeroeagle1: oh right I see
flopagis: @stupac62 im joking i have no idea
stupac62: @flopagis come on. I was starting to google to figure out what the heck that meant
zeroeagle1: learn something practically useless to learn something new
flopagis: @stupac62 haha sorry. if you are interested you could look up alternatives to Euclidean geometry etc
andrewnakas: bye
andrewnakas: u a legend
samtheprogram: !uptime
th3_maj0r: @georgehotz Host someone from "basic programming"
gajuun: this makes me so happy that someone is streaming programming.
stupac62: What will you call the wrapper around coq?
MrOtotheP: @georgehotz I understand the choice, but why not go with metamath zero or lean? (judging by your frustration)
smurfd0: rofl
zeroeagle1: maby can check on git matching file extension for examples?
MrOtotheP: I feel like Lean has the advantage of also being JUST a programming language..
zeroeagle1: must have been written by schoolars
th3_maj0r: host someone
zeroeagle1: cya take care
th3_maj0r: byeee
SKPTCL: Take care m8
samtheprogram: tyty take care
ET_515: ah man I just got here
knilecrack: Wsup
drivewaycam: george
KyleUE: yeet
i4cc8a9morw8kfrh: meow
drivewaycam: holiday
i4cc8a9morw8kfrh: shoutouts comma ai archive
snxraven: HEYYY
kornez: yo
zoki_macola: my ears
i4cc8a9morw8kfrh: comedyStare comedyStare comedyStare
vbhv: yooo gehot
drivewaycam: modGeeTron modGeeTron modGeeTron
i4cc8a9morw8kfrh: @georgehotz comedyStare comedyStare comedyStare comedyStare comedyStare comedyStare comedyStare
beefydangles: feelin hot.hot.hot
bebytesback: YO!
haircutjimmy: hullooo
ekalsuwaidi: LUL
i4cc8a9morw8kfrh: LUL
kornez: @i4cc8a9morw8kfrh mizkifYo
MacS7n: Good morning
i4cc8a9morw8kfrh: @kornez comedyStare
MorningScifi: Today we prove 1 = 2? Aw shit
itsxaos: @georgehotz i just started catching up on the twitchcoq vods and just wanted to say youre the best
drivewaycam: i love search
harmanthebest1: nubbinToddler
vbhv: ever been to India?
forkdb: Hello george
drivewaycam: i love india
phrixus_bro: indian food
rawfael: hello from Brazil
Joemerlino: I just bought a white panda but didn’t know chffr was discontinued in the meanwhile :(
alexdickson98: how are you today george
i4cc8a9morw8kfrh: yes, very simple 5Head
haircutjimmy: I need to see pep8 today @georgehotz
bebytesback: was your talk from UCSD recorded?
i4cc8a9morw8kfrh: jonesy5SillyChamp jonesy5SillyChamp
keepingtrckofthisacct: yo
Azizerinotv: yo
Azizerinotv: !project
marsroger44: whats up boys
i4cc8a9morw8kfrh: @neptun44 comedyStare
Baldaz_: metamaths??
alexdickson98: what's your opinion on ruby? @georgehotz
marsroger44: geohot back on twitch #vibeesss
titifodidi: You know someone is for real when they use vim this quick
keepingtrckofthisacct: @alexdickson98 don't do it...:D
sausainismilka: @georgehotz sup george. good luck SeemsGood
Baldaz_: difference between forward and backward search???
marsroger44: whtat happened to coq? did he gave up on it
smurfd0: great, progress :)
alexdickson98: @keepingtrckofthisacct wdym
dimplik: @georgehotz when you going quantum computing?
railander: @titifodidi PogChamp
keepingtrckofthisacct: @alexdickson98 you'll see
burimbushii: for what can this program used ??
titifodidi: 🤯
Baldaz_: Hey @georgehotz what's the difference between forward and backward search???
MacS7n: I'm kinda lost. recap ? please don't ban me
gigafact: was about to upload the part4 but looks like I am going to upload both part4&amp;part5 combined...
euranymous: George can you give us the link for the repo?
alexdickson98: @georgehotz have you every thought about creating a probraming language?
bebytesback: @georgehotz was your talk from UCSD recorded?
ZeeZaxean: wth george is becoming an everyday streamer? where is the schedule? Kappa
brisingr1031: @euranymous https://github com/geohot/twitchcoq
euranymous: Thanks
keepingtrckofthisacct: @alexdickson98 he's kinda doing that now
brisingr1031: @georgehotz thoughts on tmux vs gnu screen
phrixus_bro: ok
marsroger44: saint laurent in the house
Baldaz_: so foward = general, backward = specific search, that it??
Huskieee: all you need in life is nano
railander: LUL
xrealyy: almost 8 am and coding? he's mad
UzeezU: fuck yeah backwards search
alexdickson98: @keepingtrckofthisacct haha ok
keepingtrckofthisacct: @alexdickson98 here it comes
keepingtrckofthisacct: lol
alexdickson98: noo
railander: no pls monkaS
puffnfresh: yes
i4cc8a9morw8kfrh: @georgehotz comedyStare
dotmops: wesbtwMonka
ekalsuwaidi: @i4cc8a9morw8kfrh Wrap it up domer squadD
matthewmirman: Does metamath have classical inference rules, or are you working with a set of axioms that includes double negation elimination or something?
i4cc8a9morw8kfrh: @ekalsuwaidi ok dude comedyOkay
ekalsuwaidi: This is some 5Head shit i dont even know why im here :)
marsroger44: do you think hackintoshing is secure in terms of file integrity?
dotmops: wrap it up mathey
doganigooo2: let me remind you the rules ... 1-do not ask anything about that ai thing 2-do not tell him what to do 3- do not ask keyboard. Have fun and enjoy the stream
emotional_baggage: I'm a comp sci student - is it bad I have literally no idea what you're doing
ekalsuwaidi: @emotional_baggage Same LUL
puffnfresh: puffnfresh subscribed at Tier 1. They've subscribed for 2 months! can the compiler do sized vectors?
xrealyy: @emotional_baggage absolutely not, you're fine
marsroger44: do you think hackintoshing is secure in terms of file integrity?
matthewmirman: because if you have excluded middle or double negation translation from classical propositional or predicate logic forward search and backward search with enough randomization shouldn't be very different
matthewmirman: but your axioms might not be
matthewmirman: even if the inference rules
dawgwhisper007: you inspire me to work
matthewmirman: it could be the order of exploration of the axioms
Plurmorant: always backsolve puzzles
dawgwhisper007: thanks for the videos
matthewmirman: i.e. you put the wrong axiom at the bottom and you'd loop forever
puffnfresh: modus ponens is function application
f_karamazov: HSWP
brisingr1031: mp is if a is true and a implies b then b is true right?
jmc516: I learn so much shit from this stream. One day when something mad obscure comes up I’ll be chilling
puffnfresh: bottom is uninhabited here (hopefully)
matthewmirman: in constructive logic, bottom and false aren't equivalent - from bottom you can infer anything, from false you can infer only false
Usisuvach0: typing var in python LUL
marsroger44: i know the question is kinda off topic but can u answer it?
matthewmirman: false is an element of a type
matthewmirman: bottom is a type
marsroger44: do you think hackintoshing is secure in terms of file integrity?
puffnfresh: absurd : forall a. _|_ -&gt; a
jmc516: How would you prove false != true? Is that not trivial? (Not well versed in logic)
matthewmirman: @jmc516 depends on the logic
puffnfresh: prove that a proof of false = true is uninhabited
jmc516: Aren’t false and true just definitions
puffnfresh: yeah probably
st47ik: SpaceX Starlink deployed PogChamp
matthewmirman: @puffnfresh if that is absurd, and its uninhabited, then bottom = false
DaveDreaming: I really enjoyed your interview with lex Friedman
NigerianDrugL0rd: first of all why is he not verified
railander: ye i just watched it, hopefully it is stable under bad weather and doesn't cost a leg @st47ik
NigerianDrugL0rd: twitch mafia
NigerianDrugL0rd: TriHard
railander: @NigerianDrugL0rd haHAA
wombooooo: just joined. whats george working on?
MorningScifi: Gotta write some unit tests here
l1ttlemtman: sup
l1ttlemtman: comma ai archive can't follow anymore
l1ttlemtman: too many vids
matthewmirman: you could theoretically also write a search which tries to prove the negated formula concurrently and if that one fails your search would fail
dekassssss: HeyGuys
l1ttlemtman: l1ttlemtman subscribed with Twitch Prime.
l1ttlemtman: subbed
gigafact: @l1ttlemtman I was just uploading but now that he is streaming will upload both parts together
l1ttlemtman: please unban me on discord
NigerianDrugL0rd: whats his discord
l1ttlemtman: comma ai discord
l1ttlemtman: @gigafact nice
l1ttlemtman: id upload separately but okay
matejsninja: why no IDE
l1ttlemtman: vim is better
alreye: have you bee up all night?
l1ttlemtman: does he ever read subs ?
fluzfluz: Hi georgehotz
l1ttlemtman: you know me
st47ik: True LUL
DaveDreaming: what's a sub hahaha
marsroger44: george what do you think about hackintoshing?
Plurmorant: irc for the masses monkaS
alexdickson98: do you know u have mark zuckerbergs haircut?
Usisuvach0: irc rulles
f_karamazov: If discord is toxic what is slack
hackyhacks: that applies to the entire internet. the internet was good when it was hard to use and especially post content. the difficulty acted as a stupidity filter.
Rekkeno: "don't be poor" - classic ben shapiro
alreye: functional programming over OOP?
ma3stroxq: beyler bu eleman napıyor anlayan var mı aq
l1ttlemtman: what do I have to do to get unbanned ? I tried to contact u ?
MorningScifi: I mean, this is why StackOverflow isn't Yahoo Answers. Better moderation
l1ttlemtman: why don't u use Isabelle ?
l1ttlemtman: Isabelle is nice
UzeezU: It's not nice to use people
ma3stroxq: what is he doing
marsroger44: @Rekkeno :D
DaveDreaming: proud level 2
dekassssss: https://github.com/geohot/twitchcoq
st47ik: haha
Plurmorant: never trust a language with a real name
sultantw: you still learning Unity?
l1ttlemtman: unity sucks
sk84uhlivin: Have fun today George :)
l1ttlemtman: nobody want games
st47ik: @l1ttlemtman why does unity suck? its used for more than games
st47ik: Hackerman mode
el_pirulote: john lemon FeelsBadMan
l1ttlemtman: really there is not much other than games
st47ik: @l1ttlemtman Augmented reality?
MrBankster: george will you ever work for a big tech company again?
l1ttlemtman: that's also a game
l1ttlemtman: a kids game
st47ik: k
l1ttlemtman: lol
criiscarpenter: SeemsGood
alreye: damn python is so slow
mosin_lol: sony the meme company
l1ttlemtman: there is no geohot emote ?!?!!?
criiscarpenter: No
l1ttlemtman: nooooo?
gigafact: someone should make one
euranymous: Whats your view on this @georgehotz : "Bill Gates made money by extinguishing free software and forcing users to pay him a tax just to turn our computers on. Just because the state was ready to enforce his "Intellactual Property"
marsroger44: can you show your no script settings?
st47ik: Amazon is worst NotLikeThis
fluzfluz: lul
marsroger44: lol
alreye: @euranymous is stupid because you don't have to buy a computer that runs windows....
smurfd0:   bill gates gives away tooons of cash to good charities
euranymous: @alreye I am linux user my guy
alreye: @euranymous buy a computer with no OS and install a free OS
burimbushii: I bet you can do a better search engine than google :)
st47ik: i mean the worst thing now days is the anti-competitive practices and the formation of giant monopolies
ajibigad: bill gates sabi work
fluzfluz: billstein
alreye: @burimbushii LUL
euranymous: Does anybody know the past life of steve jobs?
l1ttlemtman: MrDestructoid
marsroger44: can metamath check proofs?
burimbushii: @alreye LOL
l1ttlemtman: that's the point of a proof assistant @marsroger44
MDSZilla: l1ttlemtman can you tell me what he's doing even tho I like this stuff im still pretty new ot it
fluzfluz: :))
MDSZilla: to it*
fluzfluz: lol
fluzfluz: stupid people here
slowkep: monkaS
st47ik: low quality chat again NotLikeThis
forkdb: Mentals
notmomu: yerrrrrr
slowkep: KEKW
l1ttlemtman: @mdszilla proof mathematical problems
slowkep: LUL *
fluzfluz: ty
forkdb: Chat gone mental again
fluzfluz: ahahhaa
oMythra: Georgy boii
ma3stroxq: guys pls let him work
MDSZilla: l1ttlemtman ah aight
marsroger44: looool
slowkep: Can you play stardew valley? plz dont ban me LUL
marsroger44: no refunds guys
marsroger44: ahahhaha
st47ik: that's like stealing
Plurmorant: bans are real freedom
alreye: There's no refunds
st47ik: LUL
euranymous: Thats laugh able
voodoorama: do you drink alcohol?
forkdb: Eat a frog hahahaha
oMythra: Ruthless
mosin_lol: so sub first than get banned to get money back? LUL
l1ttlemtman: but let me give you some advice. don't learn metamath
l1ttlemtman: @mdszilla
marsroger44: @l1ttlemtman do you have to transform the whole proof into metamath to let it check
marsroger44: *have
l1ttlemtman: basically yes there is a site called formalizing 100 proofs
marsroger44: why tho
marsroger44: what for? :D
alreye: Nice emacs skills LUL
l1ttlemtman: python doesn't support that. coq does. you always have to put the whole proof into the proof assistant
gmabreak: vim is great !! if you know how to quit it :p
matejsninja: @l1ttlemtman so he is improvin it right now yes?
l1ttlemtman: metamath's syntax is disgusting
l1ttlemtman: no he is working on proofing problems
marsroger44: yeah looks absolutely terrible
l1ttlemtman: yes it does
l1ttlemtman: creepy
marsroger44: terrifying
euranymous: ONE PHAT STRING
l1ttlemtman: @matejsninja answer above
alreye: @georgehotz What do you think of actuaries?
niiq: is he hacking twitch?=
marsroger44: HAHAHAHAHA
smurfd0: like yesterday? :)
gmabreak: true
matejsninja: @l1ttlemtman thanks, watchin his streams always remind me that coding is awesome tool not only to earn money but have also fun in creative way :P
srYhe: srYhe subscribed with Twitch Prime. They've subscribed for 2 months! sub will have emotes ?
st47ik: PogChamp
marsroger44: why not open your own streaming site
Bitsnoxx: D: LUL
Bitsnoxx: BlessRNG
l1ttlemtman: the GitHub profile pic would be ideal
niiq: BlessRNG
st47ik: BlessRNG
srYhe: FeelsGoodMan
el_pirulote: Kappa
euranymous: LUL
Plurmorant: gotta appeal to them evangelicals
haircutjimmy: haircutjimmy subscribed with Twitch Prime. They've subscribed for 5 months! woo!
l1ttlemtman: SMOrc
alreye: They saw you writtig a metamath parser and they said... nah
Dennjs: what boarkkey he got? Kappa
l1ttlemtman: they saw metamath syntax and said no
matthewmirman: so metamath is basically tag machines  ?
st47ik: @Dennjs oh no u shouldn't ask about that
marsroger44: whats the git link to this party
alreye: @Dennjs Lol please do
Dennjs: issa joke @st47ik
l1ttlemtman: geohot/twitchcoq
st47ik: LUL
Dennjs: its a joooooke @alreye
matthewmirman: https://en.wikipedia.org/wiki/Tag_system
marsroger44: can i commit ?
matthewmirman: my hypothesis is that metamath is a language for designing what seems to be tag systems
l1ttlemtman: @marsroger44 make a pull
niiq: can u add gachiBASS
l1ttlemtman: ?
l1ttlemtman: why doesn't he go to work?
l1ttlemtman: vacation? ArgieB8
Dennjs: anyone got any ideas of what i can program just to pass time? nothing serious
alreye: @l1ttlemtman veterans day :)
matejsninja: @Dennjs anything that solves your everyday life problems
wiaK: what language is this? (.mm)
l1ttlemtman: metamath
wiaK: thanks
l1ttlemtman: syntax shit tho
l1ttlemtman: make a NLP model to program it for you
Am4teur: you kinda pretty, ngl
alreye: @Am4teur :O G..........yyy
Am4teur: im a girl dude
matthewmirman: have you seen Ollibot? http://ollibot.hyperkind.org/ollibot-0.1/ also good for building stack machines/tag automata but you get more powerful pattern matching and less absurd substitution rules
CaptCalifornia: im offended that you would do this so early
matthewmirman: so you could write search in basically the same way, and just not have to make your axioms as complicated
l1ttlemtman: oh veterans Day
l1ttlemtman: I am in Europe
l1ttlemtman: gonna have a metamath Wednesday next week
unknown_elemen: hi
wrelt: hi
euranymous: I am groot
unknown_elemen: yes u are
euranymous: i am groot
unknown_elemen: am fine
slurpwaffl: did u choose coq because u already kinda new it? I was looking at this prover called lean that syntactically was a bit easy to understand imo
slurpwaffl: https://leanprover.github.io/
wiaK: What's the goal of this?
slurpwaffl: backspace.ai
matthewmirman: One way you could characterize metamath I guess is as literally by-hand ordered logic programming with only left implication and broken substitution
ImJ4Gu4R: test
wiaK: test, always, test
Narakuwow: helloi16Derp2
matthewmirman: if you look up the literature on substructural logic programming, you might find quite a few "tactics" people have actually found useful beyond forward and backward
matthewmirman: specifically, focusing
twiggy_io: No its not
matthewmirman: https://ncatlab.org/nlab/show/focusing
fafws321: Hey dostlar
AKspirits: good morning george
haircutjimmy: do we have math nerds, programming nerds, Python nerds or other types of nerds in this chat??
snapcs1: yes
AKspirits: i enjoy python
haircutjimmy: all nerds
AKspirits: obviously
haircutjimmy: I'm a python / go nerd - enjoyed watching G do that stuff. The maths stuff i can't follow.
AKspirits: agreed haha
alreye: The screen is kinda blurry... we can't read any code
Shachilol: looks fine to me
snapcs1: looks good for me
AKspirits: maybe u have a low res on
FigurativelyVyres: Good for me also
erichtp: Looks good to me
snapcs1: PogChamp
alreye: oh shit I had it low res LUL sorry
FigurativelyVyres: 2 2 = PogChamp
Plurmorant: you ain't no bertrand russel
erk4sh: who are the person behind you?
Plurmorant: PogChamp
matthewmirman: bertrand russel had lambda calculus in principia mathematica
marsroger44: lol
Keyeh: can you prove things with emoji though?
marsroger44: proove the riemann hypothesis pls
fluzfluz: SeemsGood
marsroger44: boooom
alreye: Favorite quote from Russel "The whole problem with the world is that fools and fanatics are always so certain of themselves, and wiser people so full of doubts."
euranymous: @marsroger44 okay boomer
marsroger44: @euranymous :D
euranymous: LUL
haircutjimmy: Category: Basic Programming &lt;- irony
marsroger44: well if not riemann there other fun problems too :D
sausainismilka: I saw a video when you wrote an exploit and hacked a computer. it was dope Kappa Kreygasm
Ham_med_Ruskindsjakken: chat help me understand, why is specifically Coq good at proving math ?
Keyeh: just for practice you can solve the poincaré conjecture
marsroger44: screw that one
marsroger44: perelman already did
marsroger44: too late @Keyeh
Keyeh: yeah i know, thats why i said for practice
sausainismilka: I wouldn't be surprised, if you code day and night Kappa
liivius: !uptime
Keyeh: why solve riemann when you can solve car automation PogChamp
sausainismilka: have a good day geo. cya later.
alreye: at what time do you usually go to sleep?
erichtp: Chicken tendies PogChamp
marsroger44: :D
erichtp: :)
euranymous: BAAAMMM!
marsroger44: booooom
warpoit: peace have a BLESS DAY and good day at work.
sausainismilka: lmfaooo
snapcs1: LOL
NonTrivial778: we need linear algebra proof then LUL
joaofoliveira: gmorning George!
Emanuelsson123: Cheers
marsroger44: well said
Plurmorant: KKona 7
gigafact: thanks for the steam George!
alreye: No freedom in chat tho
Keyeh: KKona unite
marsroger44: boooooooom
Keyeh: LMAO
st47ik: LUL
sausainismilka: i don't like math but i'm watching because i'm interested
NonTrivial778: LUL
joaofoliveira: yeah but this is no America, this is everywhere, freedom everywhere
joaofoliveira: :P
marsroger44: savage
erichtp: LUL
snapcs1: LOOOL
Ham_med_Ruskindsjakken: haha :D
NonTrivial778: tsodinFeels
euranymous: I wanna see proof of (a b)^2 = a^2   b^2   2ab
st47ik: SpaceX Starlink launched PogChamp
BigBrainDota: cool of you to not disable whispers
snapcs1: that kid is so mad :D
marsroger44: hahahhha
euranymous: Any mods online??
alreye: LUL
Pryetranka: LUL
neca420: NotLikeThis
notice_me_OpieOP: sup y'all cmonBruh /
sausainismilka: this kid is retarted and mad lmfaooo
MonkaSupreme: Can you proof sqrt(2) &gt; 1
BigBrainDota: LUL
Attlantiz_: hey george. whats the high brown stuff today
Emanuelsson123: LUL
matthewmirman: or strong normalization for simply typed lambda calculus
marsroger44: are u gonna buy the new mac pro?
matthewmirman: that'd be chill
st47ik: &lt;3
anup_kodlekere: yo george
Plurmorant: LUL
joaofoliveira: greetings from Portugal George!
Triphasic: Yo
Satanicus7: KEKW
The_Tyrant: george any email or way i can contact you please
sausainismilka: bagginer lmfaooo
Plurmorant: worse than a fuck you
PanicPoint: $50 for a life coaching session
BigBrainDota: fak LUL
xaxaar: that was definitely a bunch of dicks
dalex_live: it was a hydra Kappa
anup_kodlekere: whens the next stream?
MDSZilla: @georgehotz careful while opening if its against TOS there's always a risk
MonkaSupreme: it was dick hydra
Triphasic: I’m going to give a presentation about AI in cars this Wednesday in school
Pryetranka: whisper review PogChamp
anup_kodlekere: whens the next stream?
bebytesback: @georgehotz Was your talk at UCSD recorded?
MDSZilla: It is against nudity graphics so yeah LUL
Attlantiz_: whisperr georgee
marsroger44: how is the cloud
Triphasic: Thanks man haha I won’t say anything about AI anymore 🤐
Attlantiz_: click
sausainismilka: LITHUAANIIAAA MY COUNTRY.
Triphasic: Look up Belgium lol
Triphasic: My country is a joke
Attlantiz_: Look up portugal
NonTrivial778: Can you understand this math https://dcc.fceia.unr.edu.ar/sites/default/files/uploads/materias/AL2013-PR5.pdf
ekalsuwaidi: Look up Dubai :)
fluzfluz: greez from switzerland
MDSZilla: What about Starlink any opinions?
ReDD_TV_: Denmark :D
Attlantiz_: do you like it :P ?
Triphasic: For real? What’d you visit in Belgium?
Plurmorant: math not in english DansGame
renatobarresi: look up paraguay, the happiest country in the wolrd
marsroger44: ahhahahhaa
SCVready60: LUL
notice_me_OpieOP: georgehotz your bttv emote game is weak george cmonBruh
Attlantiz_: did you go lisbon george? or porto?
alreye: have you been to south america?
anup_kodlekere: youve been around
MDSZilla: Starlink George Any Opinions?
Triphasic: Lmaooooo Manneken Pis
Emanuelsson123: LUL
kingkong3211: come to the UK
revolutionist123: LUL come to Greece
notice_me_OpieOP: yelled at george BibleThump
ekalsuwaidi: 3Head Bruv
takroli3: come to turkey :")
Attlantiz_: dont go to north UK
gingersniffer: im from newcastle Pog
zynsmurf: tbh mcdonalds closed at 10pm seems weird af
bsx1123: Netherlands?
speedle123: @gingersniffer i'm nearby pog
anup_kodlekere: come to Goa
Maty_Kapsa: Prague?
DomisDream: @georgehotz Tips for Programing beginers? Just started to study programing on university
Attlantiz_: george hates latin countries boooo
dalex_live: vncouver
MDSZilla: Hi from Pakistan as well ;)
HugoDerruci3: come to Brazil.... just kidding, dom't come here
Satanicus7: Czech Republic?
jbyte1988: PERU
DaDoDe: Japan?
harm243: huh?
birrdd: birrddYes
notice_me_OpieOP: come to narnia PogChamp
takroli3: turkey?
bsx1123: Amsterdam?
GaNDyRaC: Russia?
anup_kodlekere: should do this more often
MDSZilla: Pakistan ? :P
notice_me_OpieOP: moon?
sausainismilka: george without food not george lmao.
alreye: Been to Brazil?
Attlantiz_: have you been to madeira george
NonTrivial778: Argentina
anup_kodlekere: Goa?
Tsoding: LUL
MonkaSupreme: mother russia
zoki_macola: Serbia
cutza: México?
stalys_: india?
ekalsuwaidi: Dubai is safe
fluzfluz: Swiss?
GaNDyRaC: Welcome to Russia, comrade KappaPride
BigBrainDota: have you been to most of europe?
marsroger44: are you gonna stream tomorrow?
Attlantiz_: have you been to azores
kingkong3211: come to somalia its fun
Maty_Kapsa: I had the best time in Vietnam, can reccomend
AdmiraIGoldenRetriever: come to thailand Kappa
MDSZilla: Youtube Swat Valley Pakistan its beautiful its not just war and stuff
marsroger44: lol
Attlantiz_: hahaha lmao somalia
BigBrainDota: KEKW
notice_me_OpieOP: come to mars :)
anup_kodlekere: well you've been around
ffthgezgxjkndd: seychelles?
punj4b: Italy?
karl_mundt: Ever been in Germany?
MonkaSupreme: come to Germany
takroli3: turkey is safety but you should travel with turk friend
fluzfluz: lol
NonTrivial778: Come to Venezuela you'll be happy Kappa
alreye: That place looks scary
BigBrainDota: @takroli3 that doesnt sound safe lmao
tornix98: come to Taiwan the home of semiconductors
ekalsuwaidi: monkaS
steven_dahill301: i was here
AdmiraIGoldenRetriever: Socialist dream LUL
st47ik: ever went to Africa?
alreye: been to Colombia?
anup_kodlekere: you should go to columbia lol
MDSZilla: You need to go to Iceland its freaking awesome
erichtp: Ever go to Jordan?
Plurmorant: vertically integrated company PogChamp
ekalsuwaidi: Go to south korea
lefg7: greece
Attlantiz_: george doesnt like latin countries booo jk
alreye: North Korea?
punj4b: ever go to Italy?
anup_kodlekere: North Korea
BigBrainDota: LUL
kingkong3211: North Korea?
DaDoDe: LOL
st47ik: LUL
marsroger44: looool
ekalsuwaidi: LUL
birrdd: lmfao
AdmiraIGoldenRetriever: haha
jbyte1988: VISIT AREQUIPA
kytos1k: LUL
stalys_: DuckerZ
Attlantiz_: north korea lmao
fluzfluz: lol
Plurmorant: @wegotatwitcheroverhere gotta go Just Chatting to get that partner
Triphasic: LUL
Kuunih: Spain?
AdmiraIGoldenRetriever: DONT
Attlantiz_: Kappa
anup_kodlekere: Columbia
alreye: Colombia?
jbyte1988: VISIT AREQUIPA!
Attlantiz_: what unis do you like in the UK george?
Mate12392: Have you ever been to Hungary?
hue88: you can go use facebook instead of instagram if u are pissed off
notice_me_OpieOP: have you even been to mars george? BibleThump
revolutionist123: wtf isbthis earth is flat
MonkaSupreme: Will you go to space?
hue88: LUL
renatobarresi: paraguayy
SpekKas123: Go to lithuania
uiq3eu: Come to Poland to meet Polish hackers!
mickowale: korea
steven_dahill301: have you been to cuba?
Attlantiz_: george can you check if the computer science course in Warwick is good xD
anup_kodlekere: Arctic vs Antarctica?
AdmiraIGoldenRetriever: George flat earther?
hue88: still flat for me
MDSZilla: Another really beautiful place to visit in Pakistan is Skardu
takkeo: Morocco ?
punj4b: Italy?
NonTrivial778: Is this shit real ? http://www.redusers.com/noticias/wp-content/uploads/2011/03/lifes_good1.jpg
fluzfluz: hostel
alreye: Romania?
erichtp: Romania ?
bsx1123: Warsaw is a very nice city
wall_streeter: Romania?
kytos1k: St.Petersburg is n1ce
revolutionist123: LUL nice reason
HugoDerruci3: The only good thing here in Brazil is the coffee. Americans don't know how to make good coffee
jbyte1988: AREQUIPA
Purschtus: thoughts on German automotive industry?
ekalsuwaidi: Do u play video games?
anup_kodlekere: Iraq
Attlantiz_: george likes 2nd world countries :Kappa: jk
alreye: Beautiful ladies in Romania
takroli3: what do u think about turkey be honest
GaNDyRaC: maybe Belarus?
MDSZilla: Google Images Shangrila Resort Skardu its also a place I visited recently in Pakistan its awesome
st47ik: @georgehotz have u seen this https://www.kura.tech/products
Attlantiz_: ahahahha xD
AdmiraIGoldenRetriever: D:
jbyte1988: VISIT AREQUIPAA
Attlantiz_: whats kura
NonTrivial778: WutFace
anup_kodlekere: sounds like qira
Attlantiz_: oh thats fancy
K177Music: LUL
marsroger44: wowi wooww
st47ik: Augmented reality is here Kreygasm
marsroger44: whoop whoop
euranymous: Have you been to Nepal??
AdmiraIGoldenRetriever: google glass?
st47ik: specs are crazy
Attlantiz_: buy me one of those glasses Kappa
visudo20179c: sup Geohot
MDSZilla: It starts mid 2020 it said below purchase options
Plurmorant: NotLikeThis
alreye: Just pre-order it
notice_me_OpieOP: do it PogChamp
st47ik: 2020 is the future LUL
Attlantiz_: do you like thinkpads george? macbooks seem a bit expensive
MDSZilla: Apple tried but it didnt work so they stopped
yaus_baus: good morning george
notice_me_OpieOP: 🍏
Attlantiz_: does it suffer from burn in?
amratesh: 👁️
Plurmorant: mailing list LUL
yaus_baus: good morning chat
st47ik: Kura seems like a good company
BigBrainDota: what is it
MDSZilla: Apple was going to use Micro LED in Series 5 watch but they switched for OLED
NonTrivial778: What can I do if I have an IQ of 50?
Attlantiz_: have you seen microsoft's arm chip
jbyte1988: AREQUIPA
RSPwner_: do you use screen in bash for different tabs?
Attlantiz_: tmux I think
visudo20179c: its tmux @RSPwner_
RSPwner_: oo
RSPwner_: ty
st47ik: PogChamp
visudo20179c: yep, you can get his tmux config file somewhere too
st47ik: north star are so chunky tho LUL
Plurmorant: that's a steal wtf PogChamp
erichtp: Do you still have that 3D printed head set
alreye: yes
leander_ms: monteAK
Attlantiz_: have you seen microsoft's arm chip on the surface x george? thoughts?
visudo20179c: thats a subscriber only question ;)
yaus_baus: dotfiles https://github.com/geohot/configuration
visudo20179c: ^
notice_me_OpieOP: it's a virus :)
Plurmorant: ultra-low cost MonkaSupreme
MDSZilla: It probably comes with the software
SlaterUSA: @georgehotz see if you can fiddle with the HTML and un-disable that thing you can't add to cart :D
Plurmorant: monkaS
SlaterUSA: no on the other page
yaus_baus: how long hes been streaming?
visudo20179c: few minutes
yaus_baus: fsho fsho
tornix98: !uptime
Sheggellz: Who shut my mounth yesterday guys
Sheggellz: mouth*
Plurmorant: puzzle solved PogChamp
SlaterUSA: ur mom?
st47ik: LUL
Attlantiz_: nooooooooo
fluzfluz: cya
leander_ms: D:
notmomu: where you going
st47ik: North Star stream soon PogChamp
karl_mundt: Thanks!
visudo20179c: we love you Geohot
kytos1k: cya
Attlantiz_: have you seen microsoft's arm chip?
Betazz: nooooo
notmomu: don't violate stay big homie
zgamer0123: nooooo
Maty_Kapsa: dude you are the best
matejsninja: thanks buddy you motivaated me to make a small fix in a project :P
MDSZilla: What about starlink Kappa
Triphasic: Bye George ✌️
boss_ev: thk you
st47ik: thanks George bye VoHiYo
fluzfluz: we love you Geohot
Attlantiz_: bye
takkeo: Bye
balkibee: HeyGuys
yaus_baus: byebye
notmomu: i love you bye
kingkong3211: bye
MDSZilla: Aighty laters
leander_ms: u work?
zgamer0123: bye george, ur amazing
WEBVTT
Kind: captions
Language: en
xNoury: oh hello
esence: yo
xNoury: how are you doing?
takkeo: Yo
turboooooo1: Hey George
knilecrack: wsupppp
Shanmukhosiris: hiiiiiii
knilecrack: :D
SlayerX1: HeyGuys
Equalizer_olo: Привет
the_awoken1: heeey gorge
alienware997: Greetings from Germany!
ftt0717: What’s up???
knilecrack: you didn't get banned
mtasic85: Hello guys
0xkuj: Hihihi
kornez: NEW RAP SONG? LUL
liqo13: woaow wee, are we gonna do homotopy type theory?
serhejenos: serhejenos subscribed at Tier 1. They've subscribed for 9 months!
UniversalGeneve: Tee or Tea?
fghoekstra79: Netherlands in tha house!
0xc0ffeee: suuuuup
r1ppyd1ppy: Oh boy oh boy
dougboy8989: Yo the original og jailbreaker
knilecrack: :D
nagimohsen: Geohot! Will you get back into the jailbreak scene?? Since the new bootrom exploit ??
hawsh: what are you doing today ??
watchVWAVE: Is that a cot?
stibsy73: Hey Geohot
knilecrack: did you finish with Iphone iboot thign?
Jewishrambo: he actually streamed D:
solitaryyy: What kinda tea
esence: TwitchCock?
mhigr: Hi from Glen Rock!
quackyrabbit: Good stream idea
mtasic85: I am wedding in Serbia and watching this live
oMythra: Georgy boiii
kornez: twitchCook sounds good
larsjuhw: set theory WutFace
bravech: Lol immediately go to an add
ftt0717: Tea it up.
nightknight0000: breakfast with hotz
itsimari: source??
serhejenos: I like cisistentecy in streaming schedule
blasio115: @georgehotz hi
0xc0ffeee: twitch partner wen?11!!?
kornez: and some cocaine LUL
itsxaos: Different tea? PogChamp
KrauserW: waddup
nightknight0000: what kind of tea
peakyDicers: yoo, I just did a coq stream last week
healy1818: You’re a legend!
wormtracer: Hello George!
serhejenos: consistency*
watchVWAVE: Would you recommend that chair
dougboy8989: Geo get back with chronic team we love and need you bro
rkxbz: what a haircut)
knilecrack: ahha
nmay1008: It’s a honor to be able to simply say hello sir, can’t stay
preporyan: Calculus! Oh no!
r1ppyd1ppy: George... why don’t you have any furniture?
liqo13: this stream butters my programming language theory fetish
shaungarris: Hey would love to subscribe but can’t find out how please help
watchVWAVE: The sail
nagimohsen: Will you get back in the jailbreak scene dud to the new discovery?
god_damn: reformed PogChamp
wormtracer: Where is the beard gone?
nagimohsen: Due**
beckles: My favorite Instagram influencer
larsjuhw: set theory DansGame
eduardoadf1: is it discrete math?
oMythra: Gotta take them walks
knilecrack: no
kornez: no bad
Jewishrambo: REFORMED PogChamp
bravech: What's the paper?
mondeverest: TOS
birrdd: macaiy1Kek
samtheprogram: lol
itsxaos: great Job KappaPride
tybutnowyoudie: learned a little bit of coq in university
jens472: !uptime
larsjuhw: How is the $1 jailbreak selling?
esence: why did u get Sayl instead of Embody chair
birrdd: monkaS
Jewishrambo: hairs gonna be everywhere
Luccaasss: What is the best programming language to beginners?
knilecrack: did you figure out how exploit works?
eduardoadf1: DansGame
erichtp: shave head
nagimohsen: Do you think id you tried you wouldve found the exploit if you tried
Jewishrambo: SHAVE HEAD
KrauserW: oh no the keyboard
bravech: Have you made $21m yet
r1ppyd1ppy: Poor keeb
nagimohsen: If you tried*
lefse: Hair in keyboard DansGame
solitaryyy: solitaryyy subscribed at Tier 1.
erichtp: bro wash your hands
3IIiot: twitchcoq sounds like some sort of venereal disease
eduardoadf1: do you wanna prove things to jailbreak the simulation?
minichota: what is geos job atm?
Luccaasss: @georgehotz What is the best programming language to beginners?
bravech: Ew I could hear you pee
0xc0ffeee: instagram verified account when???
god_damn: show dick
ikb79: Back on mac already :D
speeddrawing101: #freegeorgehotz
realsirjoe: watching this after reverse engineering an api
vay_man: hi
larsjuhw: Have you made $21 million dollars off your $1 jailbreak yet? @georgehotz
knilecrack: he still has chicken grease on keyboard
liqo13: @luccaasss php
birrdd: jamming
nagimohsen: He gonna ban yall if yall keep up w the exploit talk LOL
oMythra: Back on the Mac i see
blasio115: monkaW
bool3max: iphone
itsxaos: monkaS
vay_man: okay
filedescriptor: IPHONE IPHONE IPHONE IPHONE IPHONE IPHONE IPHONE IPHONE
eduardoadf1: samsung monkaS
Glymse: glymseMS
jens472: !uptime
birrdd: ratirlCoffee
uraqtlee: why did you decide to use the HHKB&gt;
serhejenos: monkas
trchaosTR: why are you too angry man
realsirjoe: new em or old em?
r1ppyd1ppy: Rawr
larsjuhw: Pitched version WutFace
Luccaasss: Where is the windwos 10?
frotzwagen: iPhone?
solitaryyy: lol
alaouiib: u better with the beard :V
blasio115: Pog
birrdd: what is happening
UniversalGeneve: lionRapgod lionRapgod lionRapgod lionRapgod lionRapgod lionRapgod
god_damn: PogChamp WHO IS THIS GUY
knilecrack: rofl
vay_man: what about copyrights?
filedescriptor: Pog
324B2l: Pog
liqo13: poggers
r3mote: Hey
deluxych: !uptime
Glymse: LUL
GoOnAli: TriEazy
mondeverest: what about self driving cars?
champ900: hey george
eduardoadf1: PogChamp
awesomeo113: Everyone gangsta until Geo starts banning
nagimohsen: grow out the beard again
weird_machine: lokin good
takkeo: Pogg
camkinstrike: cohhK
minichota: copyright strike
filedescriptor: 🔥 🔥 🔥 🔥 🔥
KrauserW: Pog
lucas9o: PogChamp
TRIMES1: what is happening?
thv293: pog
awesomeo113: F for tos
JackB1899: JackB1899 subscribed at Tier 1.
r3mote: macos. finally =)
turboooooo1: 🔥
0xc0ffeee: flowwwwwwww
eax_ebx: раунд.
erichtp: are you partnered yet
solitaryyy: 10/10
stoogethomas: this is geohotz and I'm getting sued by sony
trchaosTR: he raps better than mgk btw
serhejenos: panicBasket
knilecrack: coke is good
nagimohsen: George graduated from RIT right?
god_damn: PogChamp WHO IS THIS
marvin_gow123: wtf
nightknight0000: my neighbors are enjoying this
realsirjoe: geohot this is my first twitch stream 🤪
theendri99: zeb89Ziopeppe
hawsh: talk about talent
oMythra: Ok ok George got a voice on him
Fatmetheny: niceeee
GaNDyRaC: uf
xmase123: rap god
skyhan0: cringe
serhejenos: CurseLit CurseLit CurseLit
r1ppyd1ppy: I didn’t know Chris D’elia streamed
speeddrawing101: shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime shroudPrime
awesomeo113: Is this the real Eminem
blasio115: LOL
joker2k999: Flames!
kornez: LUL
nightknight0000: LOL
filedescriptor: monkaS
birrdd: raiikoHmm
KrauserW: LOL
TRIMES1: real eminen
324B2l: @georgehotz enlarge pdf text pls
awesomeo113: CurseLit CurseLit
Luccaasss: @georgehotz Where is the windows 10?
element04519: hello george
eduardoadf1: are you autistic ?(this is a serious question)
nightknight0000: PogChamp PogChamp
alaouiib: don t show ur twitch earningns gin :D
itsxaos: WINDOWS GONE PogChamp
KrauserW: YEEEEE
kornez: D:
trchaosTR: i think he slept well
realsirjoe: fuck windows
larsjuhw: Geohot vs sony diss track PogChamp
vay_man: wanna bet on how many times he goes to the bathroom?
joker2k999: Oh shiitt. Let go bois
twiggy_io: $200
kornez: do you ship to EU? Kappa
minichota: he killed his laptop?
xNoury: he said the word monkaS
oMythra: I got $2
MacS7n: rap god
nagimohsen: How much
PanicPoint: rude
KrauserW: i'll sub now that windows is gone
trchaosTR: hahahahaha
stoogethomas: do the Sony rap
ragemaster999: what are you reading?
theendri99: @georgehotz What about GNU/Linux?
samdabullet: samdabullet subscribed with Twitch Prime.
stoogethomas: doooo it
joker2k999: LUL yea no more windows bruh
champ900: how do you come up with stream ideas
solitaryyy: Are we still using VS Code?
K0enich: haha
Fatmetheny: How much for the computer?
rkxbz: haha
filedescriptor: me :)
birrdd: macaiy1Muah
awesomeo113: Everyone Gangsta until Geo starts banning
gal40: Wow I haven't caught one of your streams in a long while. Have I missed much or did the stream just start?
trchaosTR: freestyle for sony Kappa
r3mote: hey
eduardoadf1: do you wanna prove things to jailbreak the simulation?
leozusa: How much for the razor?
larsjuhw: TI's verse SeemsGood
stoogethomas: do the Sony rap
r1ppyd1ppy: Put Linux on it!
xNoury: first 30 minutes is always filtering out people LUL
itsxaos: this is a safe space
birrdd: ratirlCoffee keep going
esence: D I C T A T O R S H I P
3ygun: nathanBlub
filedescriptor: time me out pussy @georgehotz
bravech: This is a safe space
Luccaasss: @georgehotz why do you don't use linux?
mondeverest: !rules
nightknight0000: you look like you lost weight
minichota: just use arch
theendri99: @georgehotz What about GNU/Linux?
rkxbz: is he using his macbook?
eduardoadf1: :) ok
vay_man: right
bhad: ur a qt
m1staawesome: fuck a jailbreak seeing you shave and rap on stream is the reason why we watch
god_damn: lmao
twiggy_io: LaTeX &lt;- For Proofs?
Tusk_TV: lol @georgehotz you need more mods papa LUL
sarupk: !uptime
inDOObitablee: This is a warzone
vay_man: hail hotz
noobmenace: I beat my meat to your videos of you coding
awesomeo113: Everyone Gangsta until Geo starts banning
realsirjoe: read plato
trchaosTR: my dad is big fan of you man
bravech: George why don't you use Linux
zeroeagle1: hello
ragemaster999: @georgehotz what are you reading?
thv293: lul
larsjuhw: Rules as clear as Twitch's TOS LUL
MrVikshay: LUL
Lazylion2: Are we allowed to talk about cars that are driving themselves
birrdd: hes not is he
turboooooo1: Easy rule
eduardoadf1: LUL
xNoury: LUL he isnt tho
r1ppyd1ppy: New drinking game. Drink whenever George bans someone
Thecatdaddyy: Thecatdaddyy subscribed with Twitch Prime.
livedb1128: What is the programming challenge today?
knilecrack: it's the tea kicking in
3ygun: nathanYikes
kornez: so many subs LUL
gal40: Did the stream just start?
filedescriptor: @eduardoadf1 don't tell him PepeLaugh
PanicPoint: little early to get that druck
bravech: Can we talk about iphones driving cars
theendri99: @georgehotz Why not GNU/Linux?
de5mond: !uptime
PanicPoint: drunk
paperking01: what are we doing today?
xNoury: 8 minutes ago @gal40
trchaosTR: do you play videogames ?
noobmenace: LUL
Ziv0: @filedescriptor LUL
serhejenos: continuation of coqfiles?
Iliftmymousealot: george i don't want to question your authority but would you mind telling us why you decided to leave windows behind?
eax_ebx: если спросить про айфон на русском, дадут таймаут?))
c252: hi george, how are you?
liqo13: can u do something with univalence axiom in coq?
gal40: Oh ok thanks @xNoury
joker2k999: Back on the coq files?
Tusk_TV: yo chat, we jerkin off? Kappa
CeccoGaming: !uptime
KrauserW: am i allowed to talk about ***** cars if i sub?
larsjuhw: vim LUL
SteveATZ: just wanting to say that your rap is still stuck in my head
bravech: Pls send paper
realsirjoe: vim or vs_code
birrdd: vim Kreygasm
neca420: huh, that was a long day since last stream yesterday Kappa
jens472: coqk
turboooooo1: Holy fuck if you use Vim I use Vim
champ900: how do you come up with stream ideas @georgehotz
the_awoken1: can u please make it a little larger, can't see much on my phone
theendri99: @georgehotz What about GNU/Linux?
Luccaasss: @georgehotz what is your keyboard?
lefse: How many wpm do you have?
ThatGuyChaos: Link to paper?
C4TFive: you need to subscribe to make zoom requests Kappa
xNoury: hhkb i think @luccaasss
stayhc: macOs again DansGame
r1ppyd1ppy: George post your tmux config
Dwayne449: Are you sleeping on the kitchen ?
OMEGA_RAZER: So we’re not talking about iPhone stuff? Does that mean the people banned for talking about it are checkm8’d?
eduardoadf1: is that related to discrete math?
xNoury: the i word monkaS
camkinstrike: existential logic
theendri99: @georgehotz What about GNU/Linux?
antony4s_: pepeHands
oh19contp: &gt;checkm8’d
Tusk_TV: x = blowjob?
oh19contp: why
c252: just use s.t
hue88: creating a formal language ?
itsxaos: maybe this should be done in latex
twiggy_io: TeX formating works in markdown
c252: -&gt; implies an if then
tybutnowyoudie: the second one is also in first-order logic
joker2k999: My damn emacs crashed this am. Updated, now I gotta bt my shit bros...
rkxbz: anyone? how is he opening bash and vim in one window?
filedescriptor: yes
ragemaster999: yes
Aimanissa: bleedPurple bleedPurple
filedescriptor: quantifiers are in FO
c252: yes
fear_ep: Yes it is first order logic
oh19contp: where is he from?
speeddrawing101: yes
turboooooo1: Such that is generally ‘|’
ragemaster999: exists and forall are fo
realsirjoe: mojave completely slowed down my macbook
samtheprogram: @rkxbz tmux
r1ppyd1ppy: @rkxbz tmux
tybutnowyoudie: you can quantify relations in second order logic
c252: higher order logic quantifies over different things like sets
Tyl3r44: what are you doing?
rkxbz: @samtheprogram , @r1ppyd1ppy thank you
tybutnowyoudie: you can have as many quantifiers as you want in first-order logic
phuldr: I wanted to ask about OBD2 and comma.ai, why did you decide to build separate adapters for different car models to effectively just change pin layouts for processing, did you guys played around with hooking all signal pins inside OBD port and handle them in software rather than hardware? or am I missing something? I am surely missing something here but just had an idea that it would allow people to contribute more easily
C4TFive: Whip you coq out
protein8: Link to the paper: https://hal.inria.fr/hal-01094195/document
vay_man: god bless the keyboard
itsxaos: been a while since youve seen coq?
itsxaos: its never long for me KappaPride
twiggy_io: @phuldr no car talk here
Crypod: curvyHmm according to my calculations, the answer exists
oh19contp: keyboard is taking a beating
zgamer0123: george i see u aren't banned, that's good xd
fear_ep: Higher level of logic you can quantify things, in First you can't @georgehotz
protein8: @bravech @ThatGuyChaos link to paper: https://hal.inria.fr/hal-01094195/document
Tusk_TV: lowkey can't wait to build the capital to take 2 years off work and focus on learning programming
bravech: Can't hear you over the sound of you bottoming out
John_DiResta: Well basically prolog
r1ppyd1ppy: @tusk_tv why not start now?
bravech: Thx @protein8
fear_ep: You can have many quatifiers and still it is first order logic
wormtracer: @Tusk_TV U are the definition of procastination
edu4594: rip keyboard
oh19contp: on god
jackdaniels7474: jackdaniels7474 subscribed with Twitch Prime. They've subscribed for 2 months! Ayy
c252: predicate logic = first order logic
zHamish: Hello from Russia
jackdaniels7474: Yo geohot you see the fkin aliens???
bunjr: what keyboard do you use?
mathieu_696: HeyGuys
C4TFive: @jackdaniels7474 he is the alien
c252: @bunjr I think he said it was an hhkb
rkxbz: @bunjr hhkb
vay_man: yes
zHamish: hhkb 2
bunjr: thanks
yusufakcesme: what do you code??
jackdaniels7474: @C4TFive He might be. But I'm talking about the aliens discussed on Joe Rogan yesterday yo
jackdaniels7474: they got fkin reactionless drive
vay_man: this is dope
rkxbz: is it possible to hack into other's computer without leaving any trace?
steinlphd: Maybe proof it for 0 and then the induction case
DasMastah: What's the uptime?
Crypod: !keyboard
blasio115: LUL
tybutnowyoudie: 1 - 2 is not in Nat?
pau1riddle: Is it possible to write actual software that does something useful in Coq?
esence: 2-2 = 0
Tusk_TV: @r1ppyd1ppy virtually broke and ecommerce is easier to make money with limited knowledge, i learn what i can in off time, but financial stability before learning something i want to build a passion for makes most sense
esence: y  0 = 0
knilecrack: this is true
0TestUser: OMEGALUL
c252: this is an example of second order logic: ∀R ∃Q ∃f ∃x ∀y Q(f(x)) → R(y), so you are quantifying the predicates and relations/functions. afiak
Tusk_TV: this looks super complex
vay_man: eys
champ900: but can you do it in JavaScript
vay_man: yes*
nagimohsen: Vim&gt;
kubusiowykubus: but not isnt xD
pau1riddle: The book How To Prove It contains lots of good exercises provable programmatically. It's author wrote some Java interactive prover program
filedescriptor: yes
nagimohsen: What keyboard are you rocking today goodsir
aa_ato: blabla
CLeeMeN: CLeeMeN subscribed with Twitch Prime.
pau1riddle: No, Velleman
jackdaniels7474: george you see the fucking aliens on joe rogan??
itsxaos: LUL
vay_man: lol
itsimari: @Tusk_TV what about just sitting down for it an hour a day
blasio115: Jebaited
jackdaniels7474: https://www.youtube.com/watch?v=Eco2s3-0zsQ
Lazylion2: xd
jackdaniels7474: here ya go
bravech: George pls add your keyboard to your channel description so people stop asking
itsxaos: Tulsi2020
jackdaniels7474: commander david francor
jackdaniels7474: love u george
esence: it's a short video
johnnyhotlava: George you beautiful man
Protoxus: Protoxus subscribed at Tier 1. They've subscribed for 6 months! Good morning
johnnyhotlava: LMAO
KrypticNation: LMAO
yash_rohilla: its the hhkb isnt it?
god_damn: thats crazy you ever tried dmt
Shanmukhosiris: time stamp
bravech: hhkb2
c252: simuleVI
r1ppyd1ppy: @itsimari nah he needs money to learn apparently
Bogz75: roe jogan?
jackdaniels7474: it's the pilot from https://www.nytimes.com/2019/05/26/us/politics/ufo-sightings-navy-pilots.html
kaktoss: "Basic Programming" ok
Tusk_TV: @itsimari i give what time i can, but its a lot to process as i have virtually no experience
itsxaos: @georgehotz are you going to do a podcast like Lex Fridman again? I really enjoyed that
esence: we love coq
Bogz75: lmfao
kornez: im here just for your background music
3ygun: OWL2019ATL
shrewduser: is this similar to prolog?
johnnyhotlava: @esence lolololol
soeim: i'm just here for the joe rogan videos
edu4594: wow
slurpwaffl: lmao how random, i was installing coq to do my logic hw, then i saw u were streaming coq shit
r1ppyd1ppy: George you broke your own rules. Banned
Shanmukhosiris: @jackdaniels7474 time stamp please
champ900: zoom
Tusk_TV: TOS
champ900: 150%
bravech: George ban yourself
jens472: wen eta?
mondeverest: what about pixie tech?
god_damn: this is a dictatorship bro
ISD_Schogol: There are rules?
itsimari: hows 1m2019 going
fear_ep: Computer programmers can't be replaced becuase there
warpoit: was that Coq programming language?
vay_man: funding?
pau1riddle: What is the objective of today's stream?
ISD_Schogol: monkaS
blazelp1: Do u have an apple watch?
E_Pizza: sounds more like a prison tbh monkaS
esence: how do you even go about the checkmark
itsimari: lmao
r1ppyd1ppy: Lawful anarchy!
zeroeagle1: ever checked proB for formal proof?
fear_ep: Computer programmers can't be replaced becuase there can't be an algo that do such job @georgehotz
kornez: who knows
realsirjoe: can u put on some music
mixa010: no tweets?
blazelp1: U switched back to OSX? @georgehotz
johnnyhotlava: You'll get all the followers you want by merit of your sinciput
ghitaionut1: nice haircut dude
Sznurek066: Will backspace.ai create my future ai wife?
edu4594: zoom pls
champ900: Kappa
twiggy_io: 100%
estrangedHD: pob
poopboy7: because its on mac
Bogz75: lets manipulate some strings
knilecrack: just make the font bigger
dorkmo: keystrokes sent to a server for approval
itsxaos: DansGame Electron DansGame
Tusk_TV: Blowjob.ai
tybutnowyoudie: what do you want to different than coq?
Jeppelelle: poopboy7 electron runs like molasses on all platforms
salihyil1: len hacker naber
FadezzHD: Can anybody tell me how he has linux-like terminal on Mac
superragetastic: Are you 30 ?
Protoxus: How do you expect to live forever? Merging with AI includes dying, y'know
autoindent: too small
r1ppyd1ppy: George code me a waifu for when we move to the cloud
hmnvdota: @salihyil1 iyi
Mijauom: @FadezzHD mac supports many types of shells
koduman: it's hard to read
TheAwesomePaul: ctrl shift p -&gt; font size
champ900: zoom pls
johnnyhotlava: yup
johnnyhotlava: BOB
anup_kodlekere: Nice haircut
FadezzHD: @Mijauom I don't know much about that, I have been only programming for a 10 months in C on windows, going to switch to linux in some time, is there anything like that for windows, also can I dm you about it
johnnyhotlava: The mister BOB
twiggy_io: Wait you went to Carnegie Mellon
bravech: Yeah he was on ppp lol
twiggy_io: Will you get me into thier PhD program?
twiggy_io: Kappa
johnnyhotlava: I'm not allowed within two miles of anyone smart enough to get in there
pau1riddle: I'm going through Carnegie Mellon course on Computer Systems: A Programmer's Perspective, I have the book and lectures
johnnyhotlava: Bless
autoindent: George you're getting more and more handsome day by day
yash_rohilla: can you talk about ppp and your experience at ctfs?
itsxaos: @georgehotz there is a computerphile video on lambda calculus
realsirjoe: lambda now I am up for half life
SuntyX: hi
Mijauom: @FadezzHD There is the windows subsystem for Linux, but IMO I don't think it's that great if you're wanting to utilize full Linux. Also, sure.
pau1riddle: Computerphile is for normies
autoindent: dat keyboard sound i like that
Jewishrambo: lol
stupac62: Computerphile is good
twiggy_io: Its a very broad overview
Sparks1Cx: @georgehotz "shift   ." speeds up video
jb8e: Hey George! Hows it going?
laz4rz: do you have any math background?
cechov: we haskell now?
gzipped: forsen1
Sznurek066: 3Blue1Brown is PogChamp
INTeaRs: yes
Sparks1Cx: forsenE
suteki1: xqcE
Sznurek066: forsenE
Jewishrambo: lol
tw0st3p: @FadezzHD i've been using wsl ubuntu for simple compiling c code on windows and i have had good results.
champ900: George pro tip google questions you have
laz4rz: @georgehotz maybe one minute physics, I mean do you have university math background
soeim: 1 1=3
gzipped: xqcE
gzipped: forsenE
Mijauom: everyone has a math background
Coraxxi: LUL
itsxaos: people study maths and shit
Jewishrambo: you sir now have a background in math :)
johnnyhotlava: They mean the wall behind you
autoindent: cuz you did historical hack
c252: computer science is math
PanicPoint: No i mean it literally. Do you have a background that you can put behind you with math on it
dorkmo: queen elizabeth knights you with math
FadezzHD: @tw0st3p Thanks a lot!
SuntyX: You prefer MacOS or Windows ?
jaalle: prove things in? Like a unit test xD?
johnnyhotlava: You currently only have a kitchen background
stupac62: @c252 isn’t comp science logic?
c252: logic, graph theory, combinatoric
swagettiyolonaise69: i knew george like coqs
Jewishrambo: coq gachiBASS
johnnyhotlava: Say what you said about coq again
Jeppelelle: write coq extension for python, then you can express in python and prove in coq :D
laz4rz: @georgehotz oneminutephysics was doing good math videos, maybe this is what you were looking for
brtk_10: Most of the programmers don't know what you talking about. People like you who combine programming with advance science I call engineers. I truly believe that car drivers will be replaced with safer and reliable autonomous cars.
c252: @Jeppelelle that would be pretty awesome
Protoxus: brtk_10 Programmers who used theory are just advanced programmers IMO
sidhrth: love you man
dorkmo: ShowLove1
WendellSwan: arnt they computer scientists?
filedescriptor: @Protoxus software engineers
Mijauom: @Protoxus What separates programmer from engineer?
itsxaos: ⊦
edu4594: backspce is about what?
johnnyhotlava: what comes after determines the rules?
swagettiyolonaise69: where is blondie ?
liqo13: left of a turnstile is a context
steinlphd: Turnstile is just implication I guess
Bogz75: 480 viewers pogchamp
WendellSwan: im late, is the goal of this stream to start writing a new programming language?
autoindent: is that formal language?
tybutnowyoudie: t is type of A
esence: press 1 if you dont understand a shit
gzipped: maths crayzbW
ls111: this guy is a mega virgin bois
edu4594: 1
tybutnowyoudie: colon means type of
johnnyhotlava: back space is upset about the programs looking in the mirror for help
alexlucas_: yo
johnnyhotlava: So you're going to make an IA go insane
esence: look at this dude @edu4594
WendellSwan: this kinda looks like some of my homework
pau1riddle: When reading dense math it's easy to run out of memory. Use a text file or pencil and paper or something
vay_man: this is mathboggling
yaus_baus: just woke up to geohot stream, bless up
esence: currying is also in js
autoindent: please english :p
the_suisse: haskell???
Protoxus: Mijauom Good question. I'm not really sure, when it omes to the formal difference between the two. I think to be an engineer, the code you're working on has to have some sort of real-life application - autonomous cars would probably be engineering, coming to think of it
Erciks: 1 and i am studying computer science.. i should quit probably
Protoxus: Erciks Why doy ou think you should quit?
swagettiyolonaise69: cos he doesnt understand shit and neither do i
treestompztv: math xqcWut
aditivity: back on the mac
Ecobat: you don't understand because you haven't tried yet
Ecobat: and just don't have interest in
Erciks: @Protoxus look at george LuL the gap is huge. I can never be good as him not even close. And i am even studying CS i should at least be close but no
swagettiyolonaise69: pardon me for not having any interest in coqs
exenu: don't be disheartened if u don't understand what is going on - only time you need to understand this is when you're working strictly at performance or embedded programming
Ecobat: @Erciks that's bs
johnnyhotlava: autonomous cars ooooor or solo trains with a lottta lottta different tracks lolol
Protoxus: I agree with Ecobat. You shouldn't compare yourself to people who've been to the industry for more than a decade. Compare yourself to how good you were yesterday. Some philosopher probably said some bullshit like that sme point.
bismarckbamfo: Hotz is the greatest of all time.
Jeppelelle: forgot an the / for the last closing &lt;pre&gt;
Ecobat: exactly @Protoxus
Jeppelelle: -an
brtk_10: Hotz is like Spacex!
cechov: do we understand that?
autoindent: black is background and white is letter right?
Ecobat: he's been at it for who knows how long. He didn't get good overnight
Ecobat: put in the work. The rest comes
swagettiyolonaise69: chew some ice then get brain freeze and understand
Narakuwow: George will u ever come to China? we got the best weed
Protoxus: Ecobat I love how we're speaking as if George isn't really here LUL
dorkmo: dorkmo gifted a Tier 1 sub to Jeppelelle! They have given 3 Gift Subs in the channel!
Bogz75: just get high then youll understand
c252: hotz is waaaay cooler than spacex
masterw1tcher: :D
Protoxus: Bogz75 Only if you use psilocybin
esence: guys, i am in a market for a coffee machine, any suggestions
鼻史: finally back on Mac
dorkmo: capresso
Jeppelelle: dorkmo thanks for the gift :D
Ecobat: @Protoxus he's out of it for now ahah completely immersed
greatjohn23: , ai
bravech: Aeropress
superragetastic: Is george part of the yang gang ?
Mijauom: @esence How do you feel about a Keurig?
Protoxus: Ecobat I guess that's true LUL
esence: @Mijauom no
bravech: Look at reddits coffee sub @esence
Protoxus: superragetastic Hopefully!
hourzer: guys why is he doing this?
cechov: so, he is trying to learn coq? or to write a new language for backspace.ai?
Mijauom: vim gang rise up
Alternativeplan: Do you prefer MacOS or Windows for programming?
liqo13: peano as in define zero and succ?
Ecobat: "writing a language we can prove things in"
Protoxus: Alternativeplan I'd say anything with unix is probably better if you want to do backend stuff jgrThink
cechov: @hourzer I think for backspace.ai
dorkmo: @esence capresso mt600
gunnaren: !uptime
swagettiyolonaise69: in an interview he said his favorite os was ubuntu.. cringe
WarSwick: destro7Hype destro7Hype destro7Hype
WarSwick: Thank you for Jailbreaking iphones. bleedPurple PokPikachu FortOne
autoindent: mac OS looks fancy
Ecobat: I'd say unix is better overall. The only reason I don't have Ubuntu or some Linux dist is because I like games
Mijauom: @swagettiyolonaise69 There isn't anything wrong with Ubuntu... It's easy setup for those who want to get going ASAP. I just don't personally like it because it comes with bloat.
averagesizepens: im on ubuntu,i can still play hearthstone and civ5
averagesizepens: LUL
johnnyhotlava: you already KNOW
edu4594: btw i use arch
Alternativeplan: @swagettiyolonaise69 Hmm okay
Mijauom: @edu4594 lol
Jeppelelle: edu4594 classic, never gets old :D
c252: btw I use gentoo
Ecobat: what about League of Legends ? That's the only game I care about
WarSwick: What you think of Kali Linux Geohotz destro7Smug destro7Smug
ImJ4Gu4R: ImJ4Gu4R subscribed at Tier 1.
Hound_The: You can play even LoL on Linux
cechov: yeah, you can
brtk_10: Deeping is better than ios
julien9877: succ : LUL
julien9877: S U C C
edu4594: china...
Protoxus: Hound_The I think Steam has linux-support for about 25% of all their games - I forgot the exact percentage
brtk_10: open source
johnnyhotlava: Then what
Protoxus: I'm watching this stream on linux too B)
Ecobat: @Hound_The quick search showed a lot of bugs on the game ...
iamsod0ne_: how do you get to this level of programming
Usisuvach0: @Protoxus i think dota 2 and cs go for sure work on linux
swagettiyolonaise69: im watching from interpreting 0 and 1 directly from the ethernet cable
averagesizepens: @Ecobat apparently work via wine
edu4594: ik but i dont trust in chinese stuff
c19946: https://github.com/VSCodeVim/Vim you should set some options on vscode setting.json if you need better vim/vscode performance.
Ecobat: hmmm
johnnyhotlava: just need one more
Protoxus: iamsod0ne_ Read books. Code often. Associate yourself with other programmers, so you can learn from them as well. That's what I think, at least
ImJ4Gu4R: Hello
c19946: irani elam hozoor kone
Protoxus: swagettiyolonaise69 Genius
Ecobat: @averagesizepens Patch 9.10 broke it ahah
Hound_The: You just code, practice thats how you get better at anything really
WorthyNull: what is he doing today ?
Ecobat: but yeah, I miss Ubuntu
quickfloor: What happened for that hard life style (Windows) George ?
TheAwesomePaul: reading books is harder but better than online courses
quickfloor: @georgehotz What happened for that hard life style (Windows) George ?
swagettiyolonaise69: it's about "coqs" and "succ"
averagesizepens: i so dont miss windows
WorthyNull: @swagettiyolonaise69 no shit man
imlewpie: haha he lasted 2 weeks on windows
Ecobat: had Gnome on my laptop throughout Uni. Soooo simple
cechov: pathogen?
Protoxus: TheAwesomePaul Depends on what you want to learn, I think. For theory books are better, but of a lot of surface-level stuff, or even semi-advanced stuff, just reading the documentation is superior, since online documentated is updated more frequently
WorthyNull: seriously though
quickfloor: @Ecobat do u like KDE ?
WorthyNull: what is he doing ?
WorthyNull: i didn't understand the title
quickfloor: Coq , It's everyday bro
johnnyhotlava: Shhhh
swagettiyolonaise69: @WorthyNull search coq language on wiki
julien9877: 0! = 1 LUL
Protoxus: @Ecobat Ever heard of Solus? That's what I'm running
autoindent: dat sound
imlewpie: isnt coq the mathsy language ?
Ecobat: @quickfloor no idea
swagettiyolonaise69: it's french so expect the worse
WorthyNull: @swagettiyolonaise69 thanks! I actually thought twitchcoq is a typo lmao
edu4594: the mr robot premiere its today
quickfloor: null != 0
autoindent: ASMR
Protoxus: quickfloor True though
johnnyhotlava: Euro backwards talk
edu4594: is
foxubu: Yay I made it to the stream! :) Hello Everybody
Ecobat: @Protoxus looks interesting!
quickfloor: Coq Asmr with georgehotz
cechov: afaik, he is trying to write a language that allows for priving theorems, like a math language
WorthyNull: alt f4 to solve the problem hotz
Jewishrambo: me
K0enich: oh god
brtk_10: George what is your job? What do you do for living?
Jewishrambo: u need to do parser, lexer
cechov: haskell tried, but breaks with I/O and randomness
julien9877: OH HE'S WRITING A LANGUAGE? PogChamp
johnnyhotlava: Hey lets describe then make the rules cause we're EUROPEAN
c252: not me :(
liqo13: build an AST first?
Protoxus: julien9877 How else would you spend a sunday as fine as this? jgrREE
cechov: LOL
nexscion: bruh this channel got too high iq fur me
steinlphd: Parsing is really easy with parser combinators
Protoxus: nexscion Don't worry, it's too high IQ for everyone.
averagesizepens: gallina means chicken female
Sznurek066: I wonder if most of chat is US or EU.
quickfloor: https://softwarefoundations.cis.upenn.edu/lf-current/ImpParser.html
WorthyNull: @nexscion iq is a myth man
steinlphd: In Haskell at least but I think there’re libraries for python
Protoxus: Sznurek066 EU here
Mobius5: @WorthyNull Kappa
Protoxus: WorthyNull No it's not.
johnnyhotlava: I'm eating crayons without the wrapper so this is just cosplay for me
WorthyNull: the foundation for it is so weak and shaky
Jewishrambo: preprocess -&gt; lexical analysis -&gt; parsing/syntax -&gt; semantics -&gt; generation @georgehotz kind of remember it
ImJ4Gu4R: IQ : Am I joking to you?
johnnyhotlava: @ImJ4Gu4R lol
WorthyNull: you can only get verified results as far as the amount of iq test takers which is so minimal
Jeppelelle: What? They just wrote an abstract language without lexer/parser/visitor etc?
WorthyNull: you cannot get reliable statistical results that way
Yrratic: wow, long time no see @georgehotz
johnnyhotlava: Yeah man tape measures are bullshit cause if my dad makes one using his fingers it isn't accurate
Jewishrambo: wtf is coq anyway lol
swagettiyolonaise69: do u even google
Protoxus: WorthyNull Everyone who has to do military service has to take an IQ test. This is the case for most developed countries. In the US, you're not allowed to serve in the army if you have an IQ less than 87. They want to recruit as many as they can. It's not just for fun they're using IQ tests.
st47ik: back to Mac PogChamp
twiggy_io: @Protoxus Thats not true.
cobaltstark1: are you using a laptop?
tw0st3p: @geohotz for python lexx/yacc, check out ply github.com / dabeaz / ply maybe.
Protoxus: twiggy_io Oh really?
Jewishrambo: @Protoxus isnt that what peterson said or somethin lol
josalt: Hey Everyone :)
twiggy_io: @Protoxus Yeah im positive abvout it.
Mijauom: @twiggy_io It is though? Jordan Peterson has done a lot of talks about it. It is illegal to allow peeps without a certain IQ into the military.
WorthyNull: @Protoxus the fact that some org somewhere using iq doesnt mean that iq tests are scientifically robust
Jewishrambo: Do it in C PogChamp Kreygasm
st47ik: in rust Kappa
WorthyNull: besides, you cannot actually measure intelligance when you cannot define it in the first place.
Jeppelelle: WorthyNull IQ test is BS but IQ itself isnt
edu4594: do it in assembly x86
johnnyhotlava: oh dear god
sa7b: Hi AsexualPride
Protoxus: Jeppelelle How do you define one without the other?
johnnyhotlava: OMG
WorthyNull: @Jeppelelle my arguemnt is against IQ itself
Jeppelelle: WorthyNull: then you are wrong
Roudkill: Do it in cobol :D
st47ik: What do you think of Rust-lang George?
brtk_10: Forget about coq do python and javascript.
cobaltstark1: are you using a laptop?
Protoxus: WorthyNull Well, I suppose it depends on how you define intelligence, and IQ. But I've honestly heard a lot of people saying the foundation of IQ isn't very stable - I'd love to hear your take on it in depth to be honest
WorthyNull: the fact that you can get higher score in a considerable IQ test with 30 min of practice means it has nothing to do with intelligance
johnnyhotlava: They don't want you to have it
MonkaSupreme: oh shit its my boy geohot
Irkanu: "parsing" folder?
Jeppelelle: WorthyNull: yeah, so then you are against testing, not IQ
johnnyhotlava: You don't haaaav it
i4cc8a9morw8kfrh: @WorthyNull some people dont understand that simple fact
Couchmann941: page 2 WutFace
st47ik: LUL
Protoxus: WorthyNull Which specific IQ test are you talking about?
brtk_10: Please install DARK READER to chrome
superragetastic: I got 125 IQ it's over
st47ik: i got 127 Kappa
WorthyNull: @Jeppelelle you're argument sounds like hey IQ is a robust scientific measure for intelligance but there isn't any actual test to measure the very thing that it tries to measure ? -&gt; such a measure doesn't exist...
Protoxus: The only two I really know of are RPM and WAIS.
edu4594: buzzfeed iq test
Erciks: LULW
Protoxus: WorthyNull Yeah, I'd agree with that statement. No IQ without tests.
Jeppelelle: WorthyNull: there is alot of stuff that is untestable that actually exist
Protoxus: Jeppelelle But how can we know for sure, if we can't test it?
johnnyhotlava: Life results test it
WorthyNull: @Jeppelelle if it's untestable then how can we say that it actually exists without observing it ?
MatiGoG: 360p stream yay
johnnyhotlava: You're general ability to achieve a defined goal
johnnyhotlava: your
routerbomber: Finally, you have changed back to macOS 😄
Irkanu: @georgehotz You asked about where the parsing was. I just tuned in, but noticed a "parsing" folder
st47ik: guys is Rust worth it for 2020?
superragetastic: Take nootropics to increase your IQ it's proof fool.
Jeppelelle: WorthyNull CERN test the decay for example, it does not test the actual concrete physics
GiantSweater: no
MatiGoG: yes
johnnyhotlava: Rust looks like a running simulator
johnnyhotlava: lol
GiantSweater: the duality of man
tw0st3p: ocaml parsing: https://v1.realworldocaml.org/v1/en/html/parsing-with-ocamllex-and-menhir.html
Gtxgaming23: do you even prog bro?
quickfloor: Everybody Knows @georgehotz Hate java :D
st47ik: same
xxxdeja: How did you not get banned after last stream LOL
i4cc8a9morw8kfrh: who actually loves java
TreborRentro: just write a parser
st47ik: google loves java
Lazysloth: xxxdeja what happened last stream
Mijauom: @xxxdeja yes, don't leave us hanging
johnnyhotlava: Google has been thoroughly defeated by seo nerds
Irkanu: bogaHey bogaHey bogaHey bogaHey
flitcho: Hey george and chat
xxxdeja: father blessed us with his twitch money analytics
johnnyhotlava: BROKEN
Shanmukhosiris: is he creating a new language ??
st47ik: VoHiYo
autoindent: python4 !!!
st47ik: PogChamp
Protoxus: Shanmukhosiris Seems so
autoindent: i want to learn
i4cc8a9morw8kfrh: python4 eta?!
tw0st3p: @georgehotz terminal font size    please
Shanmukhosiris: then nobody knows what hes doing !!!!!
st47ik: where's 3to4 smh
brtk_10: Use DarkReader plesae :(
julien9877: @georgehotz just write your own parsing libraray LUL
brtk_10: https://chrome.google.com/webstore/detail/dark-reader/eimadpbcbfnmbkopoojfekhnkhdbieeh?hl=pl
johnnyhotlava: Not gonna do it
st47ik: darktheme all the things 4Head
johnnyhotlava: Lark is buns
johnnyhotlava: cheeks
ImJ4Gu4R: Yeaa  1 for dark theme.
quickfloor: Why you typing when you can just think about it ? "Let it type" (2022 ads on youtube)
WorthyNull: @Protoxus IQ test is only meaningful when you have a fucking massive big chunk of samples, it allegedly measures the difference between people in their ability for abstraction. It has a normal (gaussian) destribution graph. in Such collection sample methods you cannot actually derive meaningful results that maps to 7 billion of people from a considerablly small sample. it does however mean that people who took the test have difference results **IN SOLVING THE TEST ITSELF**.
ImJ4Gu4R: arrgh my eyes BibleThump
st47ik: PogChamp
Jewishrambo: PogChamp
Jewishrambo: PogChamp parser PogChamp
ImJ4Gu4R: Kreygasm
quickfloor: Kreygasm yes
st47ik: Keyboard smashing SMOrc
johnnyhotlava: @WorthyNull what happens when the results of the test correlate to different life outcomes?
Protoxus: @WorthyNull Yeah, that makes sense. You need a lot of samples for it to be reliable statistically. Do you know how many people have taken IQ tests? (Asking because I don't know myself)
brtk_10: Do you never listen to music during work?
r00tdk: What is going on ?
WorthyNull: @Protoxus And here comes the second arguemnt, the test itself is arbitrary in its nature. 1. we don't have annnny idea how intelligance is formed let alone quantifiying it 2. can you actually try and make a test in italian language that tests the level of the takers ? most likely no BECAUSE YOU DONT SPEAK ITALIAN (maybe you do but you go the point).
r00tdk: Bnf thing ?
r00tdk: Can anyone tell
kkkkkkkkkkkkkkwwwww: 500 viewers no one talking?
r00tdk: What is he trying to do ?
johnnyhotlava: @WorthyNull pattern recognition forms across all languages
miloeu: 40 viewers 460 bots
st47ik: @r00tdk the title bruh
brtk_10: @georgehotz Please install DarkReader our eyes hurt :( https://chrome.google.com/webstore/detail/dark-reader/eimadpbcbfnmbkopoojfekhnkhdbieeh?hl=pl
johnnyhotlava: Matrices tests
WorthyNull: @Protoxus it has the implicit notion that test makers have the ultimate ability of abstraction to be able to measure OTHER PEOPLE'S ABILITY TO ABSTRACT
st47ik: im a bot MrDestructoid
Protoxus: WorthyNull RPM IQ tests doesn't use language though
st47ik: George please i want to know BibleThump do you hate Rust?
WorthyNull: @Protoxus that was not my point. I'm coming to a generalization to explain the very nature of tests
WorthyNull: the very nature of tests requires the test maker to be on a very higher level of knowledge to be able to test accuratly other test takers.
hohaleom: guess whos back on a brand new basic hack waddap yooo
FoxMcWeezer: FoxMcWeezer subscribed at Tier 1.
riaddo: doctorWARCRY doctorWARCRY doctorWARCRY
Protoxus: WorthyNull I'll just think about the argument you're making for a moment.
WorthyNull: we don't actually know for a fact that IQ test makers have higher ability to abstract whatever the hell that means
johnnyhotlava: If I had to be five feet from a target to hit it with an arrow and I wanted to test the accuracy of an expert and made them shoot from 50 feet could I accurately judge them knowing the target after making them go through a more difficult route?
cechov: drops mic
st47ik: Coq Kappa
lycuz: !uptime
kkkkkkkkkkkkkkwwwww: @lycuz 1:10
WorthyNull: And there is the fact that nobody every seems to bother htinking baout for god knows why which is that you can actually train for a 30 min and get higher results. how is that actually an accurate measure of the intelligance?
quickfloor: @georgehotz Coding with Food asmr will be great
johnnyhotlava: YOu cannot do that for a stanford binet test
WorthyNull: Eeeeend scene and pardon my typos and stupid language
st47ik: ever tried Rust George?
johnnyhotlava: each test is different
Jeppelelle: What happened to tomcr00se?
champ900: @georgehotz do you think the government's watching right now
lexhonecker: Hi guys what is George up to in this stream?
Protoxus: WorthyNull I'll just try to rephrase your argument in my own words, just to make sure we have an agreement on what it is. So, you can't make a test involving intelligence higher than yourself, because you'd have to make questions that are more "intelligent" than you are yourself. Is that the gist of it?
speeddrawing101: @riaddo porco dio?
st47ik: SeemsGood
riaddo: Dio cane
superragetastic: @WorthyNull I guess a lot of the science behind IQ tests deal with correlations possibly ? Correlations with life outcomes, career choices etc. I think something is being measured.
speeddrawing101: hahahah
Jewishrambo: drepessive music
brtk_10: gay song?
st47ik: @lexhonecker writing a parser for coq
Jeppelelle: Protoxus and WorthyNull still, you only disprove IQ standardized test which everyone already knows is BS, you have done nothing so far to disprove IQ itself as you originally claimed
Protoxus: superragetastic Yeah, I think IQ is very related to psychometrics. Not sure though
Protoxus: Jeppelelle I'm not trying to disprove IQ.
WorthyNull: @Protoxus yes
trchaosTR: yo george which phone do you use ?
st47ik: LUL
eazyxlan: Whatcha typing on?
hoffs: hhkb
gimmighyone: I'm completely new to programming, how should i approach the subject?
Protoxus: WorthyNull I don't know if that's a good argument or not. Maybe I'm just not able to comprehend it. But humans can create a chess computer that's a lot smarter than its creator. Wouldn't the same be the case for IQ test questions? - I don't know how IQ test questions are derived, but I suppose this could be one way.
superragetastic: I want to invest in a HHKB but Idk
WorthyNull: @Jeppelelle I believe different people have different abilities and some people are smarter than others but I don't believe that you have a standarized way to measure that
stategamer: a language to prove things in? like Haskell?
brtk_10: Comeback to python and javascript. It was already enough complicated.
azstreamz99: what is he coding ?
Sznurek066: @gimmighyone depends what do you want to do.
WorthyNull: @Protoxus chess computers aren't actually smart at all, they're just faster, they simulate 100 gazzilion outcome that's it
Jeppelelle: stategamer You prove things in Matlab too i guess? (asking since i don't know anything about Matlab)
st47ik: @gimmighyone i suggest to start the very basics like what a programming language actually is (variables, conditions, loops, functions....) there's a lot of resources out there so try em and see which one helps you
superragetastic: @gimmighyone javascript for all things. Many people will tell you otherwise but ignore them.
stategamer: @Jeppelelle I have (luckily) never used Matlab
gimmighyone: @Sznurek066 i'm studying finance and econometrics, so something that can be useful in that field
gimmighyone: @st47ik ok thanks
brtk_10: Let's vote what language George should code: 0 - python, 1- javascript, 2-Coq shit
cechov: matlab then, but stata and eviews have their own language
brtk_10: 0
Protoxus: WorthyNull That's not true. Chess computers use moves that normal chess players can't comprehend, no matter how much time they use. There's a lot of chess theory, and chess computers are far superior to that
Protoxus: brtk_10 42
st47ik: javascript is great for beginners and yes it can be useful for finance and more
swagettiyolonaise69: 2 jk
Sznurek066: Learn Python and than operations on big data machine learning
Sznurek066: than* ml
Protoxus: st47ik I think whichever language you should use depends on your use case. Although it's true that some languages can be used to do more advanced things than others jgrThink
preporyan: He look so angry when he is working LUL
WorthyNull: @superragetastic differnt life outcomes are rarely measured and there is literally millions of factors that takes part in. maybe you're just disadvantaged from poor family went to poor schools and didn't really learn much. this doesnt mean that because they have lower iq they had worse life choices.
st47ik: @Protoxus true
Jeppelelle: Sznurek066 why use the slowest language for ML?
swagettiyolonaise69: george should code in PHP
prafaeltsantos: OMG the mac is back Kappa Kreygasm
st47ik: Kappa
Protoxus: Jeppelelle Go for ML? Go or no go? :P
저그매니아: will it be on youtube?
Graphityy: "Basic Programming"
Protoxus: swagettiyolonaise69 LUL
Jeppelelle: Protoxus, depends on what implementation OpenCV for go has alot of translation layers to C
st47ik: @저그매니아 i think so, on the comma ai archive
MonkaSupreme: who gets what he is doing?
swagettiyolonaise69: @Protoxus is PHP case sensitive ?
syflom: is your monitor 1440p, or what is it?
Shanmukhosiris: @Graphityy LUL LUL
i4cc8a9morw8kfrh: @Jeppelelle i think python is just the most popular language for ML in general. i heard it has great frameworks to work with
Protoxus: swagettiyolonaise69 Don't remember, it's been a while since I've coded PHP
gimmighyone: tumbluPapurino
MonkaSupreme: type 1 if you get what he is doing
Shanmukhosiris: 0
저그매니아: @st47ik Thx :)
WhyKnot321: 2
CaptainAshtar: how do you change from windows to mac and backwards is that virtual machines or different machines in your home?
stalys_: 0
MonkaSupreme: 0
st47ik: np ;)
fupariox15: THE SUCCCC
swagettiyolonaise69: @Protoxus the answer is yes and no
brtk_10: Please install DarkReader our eyes hurt :( https://chrome.google.com/webstore/detail/dark-reader/eimadpbcbfnmbkopoojfekhnkhdbieeh?hl=pl
Jeppelelle: i4cc8a9morw8kfrh: Yeap; python for quick development but its not a low lever language
superragetastic: @WorthyNull yeah, environment is pretty important to give people the best shot.
Jeppelelle: i cant spell today, sorry to everyone that is reading :D
Protoxus: swagettiyolonaise69 How so?
WorthyNull: @Protoxus Yes they don't comprehend it becuase it doesn't follow the general pattern of how to play chess. this doesn't mean that computers "knows" how to play chess. they just simulate millions of games and have a mathematical measure of which position is better which by the way is usually hard coded rules put by programmers
root_user_198: what music is plaing in the background? lol
swagettiyolonaise69: @Protoxus look it up it's just ridiculous
st47ik: i wasted too much time in my life George LUL
jaimecres: asd
Protoxus: swagettiyolonaise69 I will. I know a lot of people hate PHP because of things such as what you just mentioned :P
superragetastic: Feynman didn't care about IQ.
CaptainAshtar: @st47ik who doesn't
Protoxus: WorthyNull That's a pretty good argument.
kingkong3211: yo
fa_k: he moved from windows to mac lol
ImJ4Gu4R: Piano pls
st47ik: @CaptainAshtar george Kappa
gimmighyone: is that post-rock music? tumbluABBO
WorthyNull: @Protoxus Neural Network as well jsut have a mathematical function to assess and self learn which is anther hard coded formula put by human. there is absolutely no evidance that computers "understand" what they
WorthyNull: what they're actually calculating
fa_k: christiancucks on chat i guess
brtk_10: I stop wasting my time and go to the swimming pool with a girlfriend.
CaptainAshtar: what is this music style called? which geo is listening to?
Protoxus: Well, understanding what you're calculating and having the ability to calculate something isn't really the same.
st47ik: sounds like Alternative Rock or something like that
WorthyNull: @Protoxus my dude the argument for and against IQ literally never ends
Jeppelelle: Same style as Greenday and the like?
CaptainAshtar: or blink182?
st47ik: kinda
Narakuwow: George has so many hairs
st47ik: sub-genres are kinda messy
brtk_10: Please install DarkReader It's really cool https://chrome.google.com/webstore/detail/dark-reader/eimadpbcbfnmbkopoojfekhnkhdbieeh?hl=pl
st47ik: darktheme boi
CaptainAshtar: what is this dark reader do?
Protoxus: WorthyNull Yeah, but aren't those all theoretical arguments? I think you'd need to dig pretty far into how IQ is actually measured, how the tests are made, what the results implicate on a psychometric level etc. to be able to assess how reliable IQ is. Even though it may not be backed by great theory.
Jeppelelle: Why so many decorations in this language? It would drive me nuts
CaptainAshtar: the keyboard have very nice sound on the keys
CaptainAshtar: what kind of keyboard is that
fa_k: "special algorithm"
Protoxus: CaptainAshtar It's not the keyboard that makes it sound nice, it's George's fingers.
CaptainAshtar: @Protoxus :D lol
st47ik: @CaptainAshtar it's the Happy Hacking Keyboard Kappa
CaptainAshtar: @st47ik thanks bro
st47ik: no letters on it
CaptainAshtar: no letters on it ?
thuganalyst: Who needs letters am I right
nicentra: Hi George, how are you
st47ik: look it up LUL
Kultiviert: the grammar is unclear please rephrase
st47ik: what does it compile/transpile to George?
WorthyNull: @Protoxus they are theoretical arguments yes.
hotplay: @georgehotz if you wanna be the next ninja i suggest looking into changing the category to Science and Technology
domas3210: I just came here... what is he doing? for what purpose?
WorthyNull: @Protoxus and you made a good point
sirvapealots: @hotplay are you fucking kidding LUL he needs to be in "Just Chatting" section
superragetastic: Music pls
Protoxus: brtk_10 Just installed it on Firefox, thanks for the tip. Please stop spamming though jgrGame
sirvapealots: @georgehotz you should put yourself in Just Chatting section so your stream is more discoverable LUL
fa_k: mods
kingkong3211: whats the point of keyboard without letters
superragetastic: Mod me george SwiftRage
st47ik: SMOrc chat
domas3210: Please don't spam :) Please don't spam :) Please don't spam :) Please don't spam :) Please don't spam :) Please don't spam :) Please don't spam :) Please don't spam :)
s0rrz: now i dont wanna install dark reader
s0rrz: at all
i4cc8a9morw8kfrh: @sirvapealots you can get banned if you are using the wrong categories
sirvapealots: @superragetastic Yawn
domas3210: sorry it was my sister...
JUST_5HEAD: yo wtf
st47ik: bruh moment
CaptainAshtar: :D imaginary sister?
fa_k: mods ban this guy
fa_k: stop promoting your extension polish cukc
Protoxus: WorthyNull But yeah, discussing IQ theoretically and IQ "practically" are two completely different things. And I think if you can see that has relevance in the real world, the theory isn't that important. Unless you're a nerd like most people here, who put theory above all else :P
JUST_5HEAD: @brtk_10 👈 this guy
xNoury: thank you
sirvapealots: @georgehotz LUL
i4cc8a9morw8kfrh: @JUST_5HEAD snitch cmonBruh
nicentra: Thanks george
atom9006: LUL LUL
superragetastic: lol
zgamer0123: me
knilecrack: noone
Protoxus: I can mod you.
zgamer0123: :v
Jewishrambo: ME
i4cc8a9morw8kfrh: i dont :)
Jewishrambo: ME PLEASE
JUST_5HEAD: fuck that DansGame
fa_k: LULW
atom9006: oooh no
fa_k: LUL
superragetastic: MOD ME
MonkaSupreme: i volunteer
kkkizune: !mod
jpict: jpict subscribed with Twitch Prime.
zgamer0123: I wanted to :v
FoxMcWeezer: What’s up dude
Narakuwow: luaPOP luaLUL
Jewishrambo: PogChamp
knilecrack: someone will ruin your stream
johnnyhotlava: Moooooooderator
Narakuwow: me
RealOden: Mod me, I sub after Kappa
serhejenos: mod me
Protoxus: POGGERS
atom9006: please
Lusion: I'm not a subscriber but I once played one on tv
i4cc8a9morw8kfrh: PogChamp
exenu: make me mod
T_boltsniper : Jewishrambo Pog
jpict: please!
Narakuwow: mod me luaPOP
ImJ4Gu4R: me or i wont continue sub
nexscion: that's wild
JUST_5HEAD: dont mod me
serhejenos: Mod me
exenu: I know how to make coffee
ImJ4Gu4R: hahah
RandomSil1: I'll take mod too :)
fa_k: @Protoxus NOT MODDED LUL
stalys_: &lt;message deleted&gt;
i4cc8a9morw8kfrh: LUL
superragetastic: Mod meee ; - ;
adminuae: Kappa
Jeppelelle: Everone gets a mod
Protoxus: POGGERS
i4cc8a9morw8kfrh: &lt;message deleted&gt;
fa_k: &lt;message deleted&gt;
st47ik: SeemsGood
Jewishrambo: None pipe up
serhejenos: yaaa
abk467: congrats bois
Protoxus: Jewishrambo serhejenos Congratulations
anup_kodlekere: Why don't you divide the screen into two halves
domas3210: &lt;message deleted&gt;
riaddo: doctorJAWLINE
ImJ4Gu4R: WutFace
JUST_5HEAD: INTERNET JANITORS LUL
xNoury: we all chilling in here
atom9006: @georgehotz subscribed for 8 months
sirvapealots: @georgehotz you should put yourself in Just Chatting section so your stream is more discoverable
superragetastic: Music please ?
st47ik: at least there will be less spam now
johnnyhotlava: That's riiiiight
Protoxus: JUST_5HEAD Pretty much LUL
sirvapealots: @georgehotz randomers can't find your stream under "Basic Programming" because they're wayy too normy LUL
jpict: Party1 Party1 Party1 Party1 Party1 Party1 Party1 Party1 Party1 Party1 Party1 Party1
i4cc8a9morw8kfrh: &lt;message deleted&gt;
byLeandroid: Preferences error hahaha
ImJ4Gu4R: "Basic"
DasMastah: "Computer says no"
exenu: Type 1 if u want @Protoxus to be unmodded and you to become a new mod
domas3210: where is the install dark theme on chrome now LUL
Protoxus: 1
RealOden: @sirvapealots And what makes you think normies in "Just Chatting" wants to watch programming streams?
ImJ4Gu4R: RedCoat
kluo84: dont distract George lol... first time can see him live...
Protoxus: exenu Checkmate.
exenu: farrrrk
sirvapealots: @RealOden that's how trends get picked up my dude
exenu: youre to smart
CaptainAshtar: what is hots doign right now actully?
johnnyhotlava: Mac not allowing it it's against their aesthetic lololol
JUST_5HEAD: this is basic programming, everyone can watch it Kappa
sirvapealots: @RealOden How do you think "Just Chatting" even happened in the first place LUL
Protoxus: JUST_5HEAD jgrTARD
Aimanissa: FortOne FortOne FortOne FortOne FortOne
sirvapealots: It wasn't some sort of fucking fluke LUL
JUST_5HEAD: @Protoxus LUL
st47ik: just chatting while doing basic programming Kappa
ImJ4Gu4R: Twitch does hv the api for the live notification?
nicentra: @CaptainAshtar He seems to be creating a programming language as far as I understand
mtm2: !playlist
CaptainAshtar: :D wtf
CaptainAshtar: really?
sirvapealots: @st47ik Exactly; Motherfuckers play passive games while chatting all the time
Sydowh: Can't see anything but it doesn't matter coz I don't understand
RealOden: @sirvapealots It's a place for people that want to do IRL stuff and can't be labelled under a category. However, there are sections for technology and programming :)
Jeppelelle: But seriously, what feature does Gallina provide if George have to write this much support code to get it to work?
sirvapealots: @RealOden You don't have to play fucking games to be under "Just Chatting"
Protoxus: ImJ4Gu4R Twitch's API documentation is really crappy tbh. But I think for notifications you'd have to look at the Kraken API
JUST_5HEAD: your head hides editor @georgehotz
JUST_5HEAD: your big head*
MonkaSupreme: all have succ?
CaptainAshtar: if that's basic programing then i'm king of england
Shanmukhosiris: @CaptainAshtar he is creating a phaser for coq
sirvapealots: @RealOden Quote it from TOS or just stop talking shit lmfao
Protoxus: CaptainAshtar A pleasure to make your acquaintance, Your Highness! Kappa
sirvapealots: fucking TOSfrongs LUL
Shanmukhosiris: @CaptainAshtar ENGLAND IS MY CITY
fillmyvoid: is this another episode of the coq files?
johnnyhotlava: Woah woah
fillmyvoid: poggers
Sydowh: What's Twitchcoq ?
RealOden: @sirvapealots Dropped too many times? Why so toxic?
Vendombra: hey can you hack some brazzers premium accounts for me
Protoxus: Sydowh It's coq but for Twitch
CaptainAshtar: :D
exenu: wtf is coq?
johnnyhotlava: basic programming depending on if you're george or not
johnnyhotlava: a party of one
sirvapealots: @Protoxus He's being passive aggressive -&gt; RealOden
Shanmukhosiris: @Vendombra LUL
Protoxus: sirvapealots Who is?
ImJ4Gu4R: @Protoxus agree with you, twitch APi is a bit crappy. Thansk for the keyword ill take a look.
RealOden: @sirvapealots You are such a baby LUL
JUST_5HEAD: i want to be an internet janitor too :)
CaptainAshtar: I can't write a simple calculator he is writing a whole phaser ...
sirvapealots: @Protoxus RealOden; I've asked him where it says on TOS and deflects it like a narcissist
fa_k: LUL
johnnyhotlava: WOAH
Protoxus: ImJ4Gu4R I mean, the API works fine, it's just the documentation that sucks. tmijs is the optimal API for Twitch
johnnyhotlava: NVC guys NVC
johnnyhotlava: Non violent communication
johnnyhotlava: Feelings and needs maaan
exenu: this is not even programming
exenu: wtf is this
sirvapealots: @exenu that's what I said LUL
CaptainAshtar: this is GOD mode
st47ik: @exenu it is wdm?
exenu: no its not, what language is that
exenu: its not even a language
st47ik: thats the point Kappa
serhejenos: goerge is writing parser in python
Protoxus: sirvapealots Well, I guess that's to be expected in a Twitch chat. He's not really swearing or anything.
exenu: then where is the python ide
fa_k: @exenu Brainlet moment
exenu: im so confused
johnnyhotlava: George is building a ladder to his goal of making his programs look in the mirror
johnnyhotlava: and recognize their existence
st47ik: @exenu u dont need the python ide bro
serhejenos: hi is using vim
exenu: explain me this
CaptainAshtar: who uses python ide now a days bro
serhejenos: first you need to define a grammar for parser
exenu: why does everyone say python is easy but each time i watch george it doesn't even look like python
alxhotel: writing a parser for coq ?
CaptainAshtar: there is no easy in life
nicentra: @exenu vim is a terminal based editor. He doesn't use an IDE because he doesn't need one
johnnyhotlava: The parser he found is butt cheeks so like a god he's like I'll fix it
Jewishrambo: \n
exenu: why is he using a vim over an ide?
st47ik: @exenu it's easy for basic stuff
fa_k: Why should be everything use an IDE?
johnnyhotlava: ohhhh
CaptainAshtar: i ahte ide
swagettiyolonaise69: to be more l33t
JUST_5HEAD: @georgehotz move camera right side bro
nicentra: @exenu Because if you're good at vim you can write code a lot faster
johnnyhotlava: cant
CaptainAshtar: correcting everything i wrote
johnnyhotlava: wooooow
Protoxus: exenu I think what they mean is that understanding the syntax is easy, compared to other languages. But understanding basic python is easy, and understanding advanced python is hard. I guess that's the case for all languages and everything in general :P
st47ik: vim is lightweight and and also l33t Kappa
johnnyhotlava: HOLY SHIT
johnnyhotlava: WHAT A RUDE SYSTEM
Sim_Ayo: why are you back on mac from windows
ImJ4Gu4R: @Protoxus Ya i know what u mean :P
MonkaSupreme: https://regex101.com/r/G0cYsc/1
CaptainAshtar: because this project which he is doing is on his mac machine
jpict: NotLikeThis1
CaptainAshtar: enviorment
deed02392: Sim_Ayo he was only on Windows to make the iPhone exploit more challenging
johnnyhotlava: @MonkaSupreme i'm erect
Protoxus: MonkaSupreme That's funny
MonkaSupreme: who wouldn't be erect
deed02392: johnnyhotlava you're erect over coq
johnnyhotlava: lolololol
st47ik: LUL
deed02392: lol
steinlphd: this paper describes a tool for automated equivalence proofs of programs: https://www.kestrel.edu/home/people/eric.smith/dissertation.pdf
MonkaSupreme: &gt; https://regex101.com/r/G0cYsc/1/ TehePelo
Protoxus: MonkaSupreme Don't post the same link multiple times jgrGame
johnnyhotlava: @steinlphd publish date?
steinlphd: 2011
nicentra: @georgehotz What phone are you using these days? Any reason why?
johnnyhotlava: Ahhh
Protoxus: nicentra Nokia 105 is the way to go. No apps, no internet, just texts and phone calls.
aidanpaledot: What about checkm8? :(
Jeppelelle: Can't one open bash inside VIm? Seems painfuil to switch tmux area every test cycle
Lutefisk123: What is coq, AKA twitchcoq?
nicentra: @Protoxus I had a nokia brick as my first phone
fa_k: language you can prove things on
st47ik: @Lutefisk123 https://en.wikipedia.org/wiki/Coq
jagger_rsw: @georgehotz will it be this unhackable language that we'll write world simulations in (like the one we live in)?
fillmyvoid: D:
st47ik: D:
Jeppelelle: George hates us
JUST_5HEAD: thank you :)
Jeppelelle: :D
serhejenos: Kappa Kappa Kappa
Maybay254: Vietnam
Lutefisk123: @st47ik Thanks!
StupidGladiator: what language is this ?
st47ik: np
jpict: Scoops1 :)
johnnyhotlava: Term is a euro word
Protoxus: nicentra Me too, I'm getting a nokia 3310 again soon
johnnyhotlava: ol post command b.s.
Rezii27: hello
Purrplecat: The man himself purrplT reckGasp
nicentra: @Protoxus I recently picked my iPhone Max Pro lol I'm way too dependent on the luxury of a smartphone
deed02392: i have a mate 20 pro and iphone 7
johnnyhotlava: Why
Jeppelelle: nicentra there is always room for a burner
Protoxus: nicentra Yeah, I have a smartphone as well. They've all started looking the same though :P
johnnyhotlava: Why is parsing as a binder.
johnnyhotlava: it
deed02392: i think i will upgrade the iphone to XR due to checkmi
Protoxus: deed02392 I remember watching the opening event for Mate 10 Pro. Is your 20 pro any good?
deed02392: checkm8*
johnnyhotlava: Holy shit
Protoxus: It parses POGGERS
st47ik: PogChamp
kluo84: i am lost :(
SlevinKelevrar: SlevinKelevrar subscribed with Twitch Prime.
serhejenos: poggers
Protoxus: kluo84 We all are.
johnnyhotlava: This mans "I thinks" are 100% right
nicentra: @Jeppelelle I don't do shady stuff I would need a burner for @Protoxus I know but gotta have the new shit, my mom is getting my 8  though
Purrplecat: purrplT purrplT purrplT
twistanoname: !uptime
Protoxus: nicentra I don't need a burner either, I just use my non-smartphone whenever I want to connect more with the real world without any distractions :P
deed02392: @Protoxus dude I love it. best phone i've ever owned
sulozor: do you think you could use a NN to write Coq proofs? @georgehotz
nicentra: @Protoxus Real World? What's that
Protoxus: nicentra r/outside
deed02392: @nicentra he means AFK
st47ik: WutFace
Azermite: can someone explain what is happenning ? :)
Purrplecat: Hey George how are you doing this fine evening? purrplFlex purrplPog
nicentra: @Protoxus Nah man, it's full of bugs and glitches and the meta never changes
Protoxus: Azermite No. No one can, because no one understands what's happening. :P
serhejenos: George is writing parser for small coq file
deed02392: lool
st47ik: small coq Kappa
deed02392: NotLikeThis
Lutefisk123: Kappa
Protoxus: nicentra What you call bugs I call features. The meta changes, just pretty slowly.
sulozor: he is probably writing a parser for Coq which is a language thats used in order to prove theorems and math stuff
Jeppelelle: Its kinda fun that Roomba, i vacuum cleaner have the same CPU as the state of the art phones had when i grew up :D
Jeppelelle: How things improve, its awesome
deed02392: MrDestructoid
nicentra: @Protoxus Maybe, I just kinda wish the devs were more active, so far no word from them smh
serhejenos: :( :(
Protoxus: Jeppelelle It's literally insane.
3ygun: Cow test?
kluo84: who waiting for mr robot and silicon valley final season this Oct :D
sulozor: especially with quantum computers, rip Moore
3ygun: Coq test?
deadbeatdad7: new mr robot season?
deadbeatdad7: pogers
Protoxus: nicentra Hopefully that'll change once we jailbreak it with George's help ;)
sulozor: yes tonight I believe @deadbeatdad7
Protoxus: nicentra Did you watch his "Jailbreak the simulation"-talk yet?
domas3210: is Coq usefull?
st47ik: Mr. Robot season premiere is tonight :pog
deadbeatdad7: @sulozor pog fucking champion and I didnt know about it lol.. its gonna be on netflix?
sulozor: probably no
deadbeatdad7: oof
YouPowerRush: skeet skket
nicentra: @Protoxus I"m afraid not, I don't watch too much IT sec related stuff as that's not really my thing
Protoxus: nicentra It's not about IT sec. It's more about religion and philosophy. It's amazing. :P
Protoxus: nicentra Like r/outside but taking it seriously.
st47ik: @Protoxus and sociology and economy..
notmap: what is coq used for?
fwef64: no longer using VSCode?
foxubu: We cannot see the code
Protoxus: st47ik Yeah. It's an hour of pure wisdom.
nicentra: @Protoxus I'll check it out then.
st47ik: yeah it's so rare to see that in other shows
kluo84: anyone knows where I can get his tmux.conf
foxubu: Thank you
jpict: uni100 uni100
jpict: reward A Cheer shared Rewards to 3 others in Chat!
YouPowerRush: wiggle wit it
nicentra: @kluo84 github .com/geohot/configuration
deed02392: I just joined, what's the end goal of this?
nicentra: idk how up to date it is though
deed02392: @Protoxus the it sec aspects of it are very accurate though
hoffs: so any goal here?
deed02392: @hoffs ¯_(ツ)_/¯
st47ik: @hoffs coq Kappa
Protoxus: deed02392 It's been a while since I've listened to it. Next time I do, I'll be sure to hat the IT sec aspect of it in mind. :P
Shanmukhosiris: !uptime
st47ik: @Shanmukhosiris almost 2 hours now i think
trajenx: coq
Protoxus: have*
johnnyhotlava: The focus
Rezii27: How are you doing?
ItzDabbzz: Thanks for the RPGTreeNua @jpict
hackyhacks: i've been waiting for another math &amp; coq stream
3even: NEOVIM or SPACEMACS ?
vay_man: why is he doing this?
jpict: @ItzDabbzz np ;P
swagettiyolonaise69: @hackyhacks said no one ever
goto10: whats coq, a programming lang?
DasMastah: The triple-dot is just a wildcard, right?
notmap: can someone for the love of god, explain to me what he is doing?
Jeppelelle: Would be weird representating wildcards as other languages represents ranges though :S
Protoxus: goto10 Yeah, for proving math theorems, according to Google
goto10: @Protoxus ty, cool
DasMastah: Will it even be possible to define a single grammar for Coq, when it uses multiple sub-languages?
dragan2271: Hi
keepingtrckofthisacct: a little off-top but Geoge reminds me of Elijah Woods as a boy
johnnyhotlava: I like how he is always self referential to his problems where as I always blame the tool
johnnyhotlava: FUCKING THING
keepingtrckofthisacct: ...is cooperating
monkbitgames: what is he coding roday?
3even: Where's the hot blonde today?
Protoxus: keepingtrckofthisacct He reminds me of Martin Shkreli, but if he was a programmer instead of pharmabro.
johnnyhotlava: He keeps his hot blondes in the freezer compartment
8bitbubsy: guess they aren't all that hot anymore then
johnnyhotlava: lol
monkbitgames: what he doing?
keepingtrckofthisacct: @Protoxus yea, Martin Shkreli's serious 'face'
Protoxus: keepingtrckofthisacct I mean... If you look at his LinkedIn and some of his talks, I don't know if he's that serious :P
keepingtrckofthisacct: @monkbitgames right now, language parser
johnnyhotlava: Shkreli's more aggressive
Protoxus: johnnyhotlava Yeah, that's true.
johnnyhotlava: HIs commitment to this parser is making my helmet swell
keepingtrckofthisacct: you'll see how 'aggressive george will get if you mention a certain company
Protoxus: johnnyhotlava LUL
johnnyhotlava: @keepingtrckofthisacct lol
Protoxus: keepingtrckofthisacct jgrHA
johnnyhotlava: Got it
johnnyhotlava: that fast
johnnyhotlava: jeez
Protoxus: Matzehs monkaS
masaro22: Why back on macOS ? Thought he has a new razer Blade
keepingtrckofthisacct: @Matzehs uh, oh...chat lets see what happens to Matzehs
xNoury: the banned word monkaS
Protoxus: KNOOKEL_HEAD We're just not supposed to. It's the rules.
TheKoreanZombi: He can't vim hard enough in Windows.
Protoxus: I think the reason was something about the company being serious business, and this being a casual stream
keepingtrckofthisacct: we're all going to get banned by association
Protoxus: monkaS
xNoury: monkaS
notmap: what are u coding?
8bitbubsy: monkaS
keepingtrckofthisacct: see
Abo7atm: can i be mod?
QED__: LUL
Bogz75: LUL
johnnyhotlava: Ah
Abo7atm: eye be good
aa_ato: bbbbb_test
Protoxus: keepingtrckofthisacct Theorem proven. And you didn't even need a parser. LUL
8bitbubsy: he sacrificed his life to show us what to not do
Oxynoia: i love you clean shaven
xNoury: begging for mod FeelsBadMan
goto10: wait ,what happened?
keepingtrckofthisacct: lol
ProfessorMagikarp0: we lost another one bois PepeHands
YouPowerRush: no mods allowed
johnnyhotlava: LOLOLO
notmap: yo geo what are u coding?
Protoxus: goto10 He broke rule #1 of the stream. Don't ever mention ***.
notmap: am lost
toonarmy0: sup george
keepingtrckofthisacct: language parser
ImJ4Gu4R: SeemsGood LUL
Abo7atm: @xNoury maybe I'll subscribe so senpai will notice me
johnnyhotlava: Raspberry's &gt; Blue
monkbitgames: @georgehotz next time make some trainer for online game
goto10: SeemsGood SeemsGood SeemsGood
Jeppelelle: ?
Jeppelelle: Am i here?
serhejenos: ok
MonkaSupreme: yea
ImJ4Gu4R: put rules in github
Protoxus: Sub only chat? :o
void69: upper class here
LainShotcs: LainShotcs subscribed at Tier 1.
QED__: LUL it worked
Protoxus: This is how you get people to subscribe, the right way.
Protoxus: THE FREE MARKET PROVIDES
MonkaSupreme: welcome 😄 🍷
LainShotcs: xD
TheKoreanZombi: Followers only is pretty good right?.
Abo7atm: lower class invaaaaaade
antony4s_: f
Jeppelelle: he back
xNoury: free shrekli FeelsBadMan
Protoxus: And we're back
Kookook21: back
foxubu: Yeah
ImJ4Gu4R: NotLikeThis
goto10: ads :(
TheKoreanZombi: Are we twitch partners yet?
swagettiyolonaise69: what happened to your windows
ProfessorMagikarp0: nickiThink what if twitch chat crowdsourced an idea for a program and geo made it and posted it on github. that'd be lit or no? nickiThink
wavebend: george, have you measured your IQ
knilecrack: and you dropped windows for that
knilecrack: ahahaha
ImJ4Gu4R: Can we talk about exploit from the previous stream?
Protoxus: TheKoreanZombi I think one of the requirements for partner is streaming x amount of days each month or week, and I don't think he's really willing to stream that consistently :P
Protoxus: Just my guess though
coProof: @imj4gu4r we’d have to kill you first
wavebend: i'll buy it for $1
alexlucas_: how comes your selling
Jeppelelle: Isnt hot corners in Mission control anyway?
KrakkenTM: WISH I COULD RUN MAC OS ON PC
Protoxus: wavebend Don't think that's the ebay price though
knilecrack: 1.1$ here
xNoury: probably still cant afford it for the ebay price LUL
r00tdk: You are not windows fan ?
goto10: @KrakkenTM easy
ImJ4Gu4R: @coProof NotLikeThis NotLikeThis
my_curiosity: buy a chinese computer and put a linux on it and code in Rust, if you are gonna ruin your life.
r00tdk: I thought you chose windows over mac ?
Protoxus: r00tdk DK? You Danish?
TheKoreanZombi: @Protoxus Yeah, he got my hopes up doing checkm8 last week when he said he was going to stream the next day too and we were going to be partnered and live happily ever after.
ProfessorMagikarp0: sell his laptop? thatd be an interesting harddrive to buy LUL
r00tdk: @protoxus nope
johnnyhotlava: It's hot
Protoxus: r00tdk Oh, okay :P
Jeppelelle: Protoxus are you?
GeneralSoak: ... all computers are chinese
Protoxus: Jeppelelle Yes
Protoxus: Jeppelelle Are you?
Jeppelelle: No, almost, LeSwede
Yeahsper: is this a language from scratch or do you use any kind of base like python?
TheKoreanZombi: It is an established language
Protoxus: Jeppelelle Jävla svenska jgrGame
HedgeOnTwitch: boolean!
ImJ4Gu4R: @TheKoreanZombi but no stream. fake hope
Jeppelelle: :(
Protoxus: Jeppelelle :P
johnnyhotlava: and you're just going to put that directly in?
TheKoreanZombi: @ImJ4Gu4R so true. BibleThump
Jeppelelle: Atleast we can count properly unlike danish poeple :D
Protoxus: Oh yeah, counting in Danish is pretty messed up now that you mention it. Same as German.
Jeppelelle: 5 = fem, 50 = halvfjerd or something, makes not sense :D
Protoxus: Oh, yeah LUL
Protoxus: It's 70 = halvfjers
goto10: @Yeahsper my understanding is, he is using the lang called "cog" to prove math theorems,
johnnyhotlava: well it's relative to real things
Protoxus: 90 = halvfems LUL
Jeppelelle: lol :D
johnnyhotlava: lol
johnnyhotlava: or relative to a whole rather than lower numbers words based on fractions lol
r00tdk: Shall i buy macbook 15 inch or wait for 16 inch ?
TheKoreanZombi: @georgehotz is going to buy a 16-inch. Do whatever he does.
KrakkenTM: TYHICC
KrakkenTM: ASS
swagettiyolonaise69: T H I C C
soulshined: now thats how you get partnered SeemsGood
Protoxus: ^
notmap: this looks confusing
MonkaSupreme: bulge
r00tdk: Haha @thekoreanzombi
ProfessorMagikarp0: @Protoxus r we allowed to talk about backspace since its not a company yet ? jnbMM
r00tdk: Cant read george mind
3even: Yo @georgehotz do you take BitcoinCash donations?
r00tdk: He shifted to razor too
Protoxus: ProfessorMagikarp0 Yeah, I think so. People mentioned it earlier :P
r00tdk: I thought he changed to windows
GeneralSoak: is twitch partner the new goal
johnnyhotlava: we can talk about his AI bulldozer backspace
ImJ4Gu4R: @3even geo dont but we all here do.
foxubu: As long as mac os cannot run cuda for tensorflow, it's not really helpful :(
Jewishrambo: !A || !B == !(A&amp;&amp;B) idk lol
Jeppelelle: fuxubu cant you run tensorflow through opencv?
Jeppelelle: or just models?
jxiss: yo
Keyeh: hello george
r00tdk: Is 16 inch mac will be launched in oct 19 ?
rkxbz: did he finished writing lexer?
foxubu: Jeppelle possible yet not as helpful for testing as, e.g, on ubuntu
cechov: hi, did he make any progress in the last 1.5 hour?
johnnyhotlava: George is an AI psychologist
Jeppelelle: sure, nothing is as good as native drivers, don't know why nvidia and apple hates eachother this much
foxubu: Exactly
GeneralSoak: apple hates nvidia
GeneralSoak: nvidia would be supper happy to sell them stuff i guess
MonkaSupreme: if if a?
johnnyhotlava: IF if was a fifth,
johnnyhotlava: oh wait wrong place
RomanNYC: does destruct-ing them not work? o.o
autoindent: does he make a compiler?
johnnyhotlava: when can it understand a story.
johnnyhotlava: that's what I need.
dorkmo: BibleThump
korede360: What is the parser for?
foxubu: "Who's crying on stream?" :D
myaocat: do i see python 4?
Keyeh: is this the future? PogChamp
CMTFrosty: CMTFrosty subscribed with Twitch Prime.
johnnyhotlava: So you're going for the reimann hypothesis next right? With this coq
leijurrv: Hi george @georgehotz
GeneralSoak: php is the future
MDSZilla: Popo's are here
reptil1990: @georgehotz is getting swated :D
GaNDyRaC: FBI open up Kappa
johnnyhotlava: Where
jkpfeffer: only 333 viewers?
jkpfeffer: must be a math stream
GeneralSoak: @georgehotz whats your favorite anime
Protoxus: GeneralSoak LUL
Avelansh: you should stream more often
foxubu: It was about the sirin outside
khilshot: How much (highest level) math do you know?
Am4teur: once i had to program a language for a course and wasnt pleasant, how can you do this for fun dude?
myaocat: LUL
Ziv0: LUL
jo_renttt: lmao
GeneralSoak: streaming is all about audience interaction
johnnyhotlava: I enjoy it
knilecrack: stalin was baby compared to geo
jo_renttt: FeelsBadMan
myaocat: imagine ice company
ffntdt: oh i have assignment on antlr4 and now u streaming about parser
Protoxus: knilecrack LUL
ffntdt: nice
GaNDyRaC: Kappa
myaocat: Keepo
jo_renttt: why does that sound familiar @ffntdt
Jeppelelle: knilecrack i did not think you would survive that comparison :D
johnnyhotlava: Nice gamble
knilecrack: @Jeppelelle maybe he didn't get it
knilecrack: :D
MDSZilla: bool' ? or is it supposed to be just bool
vay_man: I have no idea what you are doing
lasercatboss: im kinda just here for the keyboard sounds
foxubu: That look when he reads the chat :D
johnnyhotlava: ahhhh
r00tdk: Which keyboard is he using
Jeppelelle: hhkb
johnnyhotlava: YESSSS
r00tdk: Hhkb silent ?
r00tdk: Doesn’t seem like silent
r00tdk: Does he using printed key one or non printed ?
johnnyhotlava: Lol a scam
Protoxus: &gt;Definitition jgrGame
Sharlock93: is this some prolog kinda programming language ?
Protoxus: &gt;"Definiton" jgrGame
Jeppelelle: he said non printed in a previous stream, if thats still the case
verdensmand1: why the fascination with coq my man? answer me seriously - i follow on ig
johnnyhotlava: dont need no spell
johnnyhotlava: Yeah that's right blame that ass cheek parser
Sharlock93: go.py is confusing on so many levels
johnnyhotlava: that sphincter parse
Sharlock93: yes twitch that is a link
Sznurek066: Is this Chris Lattner 2.0 ?
ncdoru: ncdoru subscribed at Tier 1.
r00tdk: @johnnyhotlava can i know something about 16 inch MB ? Is it going to be worth waiting?
johnnyhotlava: Allegedly it is
khairulimam_: do you like read romance novel?
Jeppelelle: nice question
lasercatboss: its funny how chat is as confused as george but on a whole different level
Protoxus: r00tdk George says it's worth waiting, so obviously that is the unquestionable truth.
MrMcaustin1: What are we doing today kiddos?
johnnyhotlava: lol
r00tdk: Yeah sure
MrMarkFilaroski: @MrMcaustin1 terminator AI
MrMcaustin1: ah the classic
jmc516: Nice Coq
r00tdk: Is the event prescheduled ?
foxubu: No
Protoxus: "// This is really wrong" LUL LUL LUL
johnnyhotlava: YEAH
khilshot: Do you have any intention of streaming hardware tinkering?
vay_man: lets test
r00tdk: George not paying attention to chat
minahoku: hello
lasercatboss: so he is writing a python for his coq
MrMarkFilaroski: Oh, Talk dirty to us
knilecrack: ahahaha
knilecrack: man I love this stream
foxubu: MrMarkFilaroski You're banned
Protoxus: So what do we have to read to understand this? Some boolean algebra?
Jeppelelle: What does the ' decoration on bool means?
MrMarkFilaroski: c'mon.
foxubu: :D
MrMarkFilaroski: @foxubu LUL fintJustice jeffgrossHobby
Jeppelelle: Oh ok 👍
Jeppelelle: Thanks
Keyeh: functional programming language btw
flesh38: please do
MrMarkFilaroski: Hot dog, not a hot dog?
lasercatboss: so its just called bool' for some more confusion
johnnyhotlava: Python is a whore with scales
3even: Functional &gt; OO
johnnyhotlava: OH ok
khilshot: You should give relative numbers a try in vim.
Fatmetheny: I love this place
foxubu: Order Lunch ^^
r00tdk: Do we have some project related to this ? Or is it just for fun
fazel3ss: Why so many interest in type theory?
JingleBerryBlast: De Morgan's Law for Boolean Shit
knilecrack: no more blonde girl to bring chicken?
Abo7atm: he walks in a super weird way
Jewishrambo: VoHiYo
foxubu: Seriously? Nudles?
minahoku: まるちゃんラーメン？
beylu_cs: he walks like a sim
Navilist: College flashbacks!
Fatmetheny: Instant noodle gang RISE UP
johnnyhotlava: De morgans law within boolean
lasercatboss: fusili PogChamp
Lefer_: George PogChamp
Protoxus: Cooking stream PogChamp
johnnyhotlava: That he wants to prove with coq then tell "python" about it
johnnyhotlava: NAH DAWG
foxubu: Ok real student food stream :D
lasercatboss: maybe we need georges top 10 student advice
CaptCalifornia: EATIN LIKE A DOCTOR
Sycto: george is a michelin star chef and only cooks the finest foods
flesh38: Don't put the oil in the water!
LiveLifeLive: George why don't you try beard
r00tdk: Not healthy food for guys who workout !!!
tris790: cooking stream VoHiYo
johnny_thehobo: cooking stream? PogChamp
ffntdt: Its 2am here :( and u r cooking
lasercatboss: he's coqing everybody
gunnaren: @ffntdt 2 am mcdonalds is the best - go for it
foxubu: LiveLifeLive He has in the past
johnnyhotlava: How do you know what section you wan to read so quickly?
FargioFarmani: What google chrome theme is he using?
khilshot: for o in dir(yourstuff): print(o) looks better.
ffntdt: @gunnaren no mac here works this late dude
ffntdt: *mc
Protoxus: Now THAT'S pretty.
Protoxus: jgrYIKES
johnnyhotlava: Allegedly
johnnyhotlava: In your opinion
johnnyhotlava: lol
johnnyhotlava: as not
gunnaren: @ffntdt That's sad : (
foxubu: Like Constituency Parse Trees ^^
santi_264: how long ago did this start?
Ekiinho: whatsuppp
johnnyhotlava: You have to give it meaning
johnnyhotlava: cause it's bogus
gunnaren: @santi_264 like 3- 4 hours
rkxbz: he is a vim/tmux monster
johnnyhotlava: without the standard library you gonna make one of those too?
johnnyhotlava: And then what
johnnyhotlava: ohhhhhhhhhhhhhh
reptil1990: !uptime
tris790: so you want to strip your coq :)
reptil1990: @georgehotz no chatbot :(
johnnyhotlava: lol
johnnyhotlava: EXACTLy
johnnyhotlava: 100hours for you rest of my life
wonderlab: Sup G
Jeppelelle: forgot a . after nat?
Jeppelelle: the zero nat
Keyeh: the dot
myaocat: if university is old and not good to learn why do you take 3 people from university to build RSA?
rkxbz: rsa?
Jeppelelle: weird
my_curiosity: you are getting quite proficient dealing with coq
myaocat: @rkxbz https://en.wikipedia.org/wiki/RSA_(cryptosystem)
broadhawk: why did he walk away and come back
lp97: bruh. i cant even make a website in python
Protoxus: @broadhawk 'Cause it looks cool
Navilist: @broadhawk It's a genius maneuver. We couldn't understand.
broadhawk: my simple mind cant comprehend it
rkxbz: @myaocat yeah, i am familiar with it. but i thought it is not difficult to make one yourself.
Protoxus: broadhawk jgrHA
Annex_Greenland: is this the kid that hacked the iphone
johnnyhotlava: Is the speed just from reps?
manwheeluno: This is cool
nanodanger7: hello everyone
lp97: ya @Annex_Greenland
manwheeluno: Sup
Annex_Greenland: legend
rkxbz: @myaocat , i have tried to implement it some time ago. if you are interested - https://github.com/Raysultan/LearnRSA
Jeppelelle: lol
Annex_Greenland: siri stinks LUL
Ziv0: LUL
myasovlavashe: LUL
Navilist: dammit siri can't add
Sznurek066: LUL
Annex_Greenland: siri is a basic bitch
johnnyhotlava: George can teach it to add
lucas9o: LUL
LiveLifeLive: Siri got activated here!
myaocat: @rkxbz it's not about the implementation but theory
gunnaren: Siri aka home chef
Jeppelelle: effortless
Keyeh: she is going to torture in the future
johnnyhotlava: You special edward broad
knilecrack: :D
Annex_Greenland: like talking to a severe autist LUL
FargioFarmani: he talking smooth to robot girl
rkxbz: @myaocat , ok
johnnyhotlava: lololololololol
Keyeh: omg he is really living the cloud
LiveLifeLive: My Siri got activated :)
Arktri: She doesn't even thank you for the offer.
Ziv0: now you messed up her counting LUL
Sznurek066: Future is here LUL
broadhawk: you are a guest in siris house
TheKoreanZombi: Google Assistant can add time to timer
knilecrack: google must be smart
Annex_Greenland: google assistant is skynet
azstreamz99: azstreamz99 subscribed with Twitch Prime.
Nnotm: !uptime
knilecrack: can you ovaerride it?
knilecrack: override*
foxubu: PJSalt
Nnotm: has he started this today?
Annex_Greenland: surprised u dont have a cat
ImJ4Gu4R: WutFace
Protoxus: Annex_Greenland He's kinda talking to Siri like it's his cat though :P
Shanmukhosiris: @Nnotm yess
Nnotm: thanks
jagger_rsw: @georgehotz will you use this language to program some simulated worlds, so its inhabitants cannot exploit some bugs and escape?
Nnotm: it looks like Notation can even introduce mixfix syntax, that's neat
Nnotm: if then else is defined similarly, rather than built in
Johnvade: I didn't know geohot did formal methods
Nnotm: How much have you used coq or something like it?
knilecrack: ahahahahaha
lucas9o: LUL
Ziv0: LUL
Protoxus: Is Siri wife material? Helping cooking and all
broadhawk: forever
Mariosavitch: lol
Jewishrambo: CoolStoryBob
ZeeZaxean: are windows shenanigans dead? :(
Rojaster: she takes over the house
Vonsmal: LUL
Pasulya: CoolStoryBob
8bitbubsy: CoolStoryBro
Sznurek066: LUL
Abo7atm: LUL LUL LUL LUL
Jewishrambo: :)
Ziv0: lmao
sanyadollar: LUL
ffntdt: LUL
serhejenos: Kappa Kappa Kappa Kappa
Lottsz: LUL
zgamer0123: LUL LUL LUL
Nnotm: just say "for now"
Pasulya: PowerUpL CoolStoryBob
FargioFarmani: she in a loop bro
gunnaren: LUL
Mariosavitch: unplug her
broadhawk: shes broken
flesh38: LUL LUL LUL LUL
serhejenos: for how long
Protoxus: Code stream to cooking stream to dating stream PogChamp
FargioFarmani: UNPLUG
Keyeh: artificial dumbass
twiggy_io: THis is why we need backspace ai
Sznurek066: LUL she is concious
gunnaren: She sure knows how to play a woman alright
Mariosavitch: just like a real life women
Rojaster: make more fun of him Siri
lefg7: did he go back to mac?
Protoxus: lefg7 Yes
Keyeh: yes, windows suck
lefg7: smart choice
r00tdk: Not good food for guys who workout?
Nnotm: @georgehotz refl means reflexivity, i.e. for any a, a should be equal to a
Keyeh: mom spaghetti
Protoxus: https://clips.twitch.tv/DignifiedHandsomeRadishYee I like this
Keyeh: palms sweaty
knilecrack: man you should really stream more often
Moe_Bradberry: why dont you define dZ
Zharrtan: At least not chicken this time xD
MrTriharder: Haircut PogChamp
mh1996mh: !language
chocolatechp: george whats up man!
Johnvade: is he trying to understand coq then write his own similar program?
MrTriharder: @georgehotz is it ok if I don’t put an optimizer in a slam? My teacher is just happy with the colors popping on the OpenGL window 🤣
Johnvade: I just came here
walktheabyss: Which keyboard do you use @georgehotz
Dilwad: whats he working on
RSPwner_: what editor is this?
RSPwner_: the coq @Dilwad
Johnvade: vim
chocolatechp: vscode i think
khilshot: Vim i guess
RSPwner_: this one tho
TheKoreanZombi: The keyboard connected to his MacBook
Nnotm: I think it should be bool' -&gt; Type
hoffs: @georgehotz do you just fuck around all day long or do you have a day job
RSPwner_: whats the other one
Mariosavitch: vscode
RSPwner_: okay i thought so
ffntdt: looks delicious, never had that in mylife
knilecrack: what is nat' ?
chocolatechp: what cereal is that
walktheabyss: @TheKoreanZombi and which keyboard would that be
nanodanger7: it's a happy hacking pro 2
TheKoreanZombi: his MacBook keyboard, the one that's built into the laptop
myaocat: ResidentSleeper ResidentSleeper ResidentSleeper
Mariosavitch: i love coq
zackfair_ow: Have you ever done an iq test @georgehotz
myaocat: to prove that he is smarter than you?
chocolatechp: why dont you stream more?
khilshot: Vim tip, Press 'f' key then the char you wanna jump to, it's faster. @gerogehotz
CrazyAsianBoiii: f
Keyeh: that one hell of rabbit hole
myaocat: did you port the program to windows?
hoffs: :|
chocolatechp: same
knilecrack: you don't need more
filedescriptor: 80 PogChamp
Mariosavitch: you eat like 80 iq
HS_SemenThrower: yay my favorite streamer hi fucker
Johnvade: &gt;github stars as intelligence indicator
Johnvade: that's like twitch followers
HS_SemenThrower: learn how to hold a spoon man
warron_buffet: Hi from Russia!
chocowhiskey: eating like a 80 iq confirmed
RSPwner_: tis a fork g
hoffs: why do you even use a fork for those
Keyeh: richard feynman had 200 iq i'm telling you
Jannnik: a lot of dumb smart people Kappa
TheKoreanZombi: @khilshot Does he seem new to vim?
Johnvade: feynman probably actually had 120ish iq
zackfair_ow: Ye but there are smart people and genius people
Navilist: Dumb IQ gang stand up.
Johnvade: he wasn't the type to make a point by lying about that
zmechs: zmechs subscribed with Twitch Prime.
RSPwner_: @georgehotz why do you use vscode sometimes and other times vim?
Keyeh: what do you mean, most of his 'feynman stories' were made up
fazel3ss: I prefer to think about iq is how good you’re in multi field.
warron_buffet: From Russia with love .What do you think about quantum computers?
myaocat: twitchcoq domain is available! BUY NOW
khilshot: @TheKoreanZombi not at all but pressing the same key again and again is just too repetitive.
MrTriharder: admiralC1 admiralC2
HS_SemenThrower: jheez it's painful to watch him eat like that
MrTriharder: admiralC3 admiralC4
dorkmo: Party1
zoki_macola: that chewing sound
chocolatechp: sprinle some cheese on it
Nnotm: FWIW, this appears to contain the definition of exists https://coq.inria.fr/library/Coq.Init.Logic.html
chocolatechp: sprinkle
Johnvade: I thought he chased "Feynman stories" but did not make them up
TheKoreanZombi: @khilshot I know, was just joking with you
khilshot: @TheKoreanZombi lol
jaalle: @georgehotz Are you trying to automate our jobs?
fazel3ss: For instance you have 80 which is lowest medium. You still can be good in one field and maybe one field only. When you have it like 140 you may be able to be good in 4 different fields
jaalle: Like programming jobs
MrTriharder: Can someone tell me what coq is
Nnotm: MrTriharder it's proof assistant
LiveLifeLive: eating like 80 IQ. :)
sepulsher: @georgehotz how good you were at math in highschool?
Keyeh: is a variant of the dic language
HS_SemenThrower: @RSPwner_ vscode kills the hype, you garra feel like a haxor sometimes #vim
Thomasbrah: @LiveLifeLive lol
Nnotm: MrTriharder it let's you write proofs and checks them, and automates writing them a little bit
MrTriharder: Oh
LiveLifeLive: @Thomasbrah hahaha
Protoxus: How can you make exists work if everything is part of the simulation? jgrThink
zoki_macola: @georgehotz Do you have any advice for someone who wants to move to US and start a company in biotech?
Ecobat: @zoki_macola do you already have a business model ?
Jeppelelle: zoki_macola Check out Theranos and do the oppposite of what they did
wrelt: lark is awesome
LiveLifeLive: @Jeppelelle Perfect PUT. @zoki_macola Read Book "Bad Blood"
zoki_macola: Yeah, just not the proof that it will work. But of course nothing like Theranos
Ekshernul: just joined the stream, what's he trying to prove?
wrelt: @ekshernul he’s trying to build a prover language I think, a la coq
TheKoreanZombi: Trying to prove P=NP.
wrelt: not sure if he’s trying to prove anything in particular atm
r00tdk: Ctf ?
TheKoreanZombi: getting really close.
Ecobat: @zoki_macola I suppose no one ever had proof that "it" will work
r00tdk: Not doing ctf😄
Shanmukhosiris: asmr
Vinndy: what about it was named cold war because russia is cold? that's a good song
Shanmukhosiris: asmr &lt;3
Ecobat: you just have to press on
r00tdk: Good ctf going on
zoki_macola: More towards Transcriptic. Cloud lab but not for general purposes
r00tdk: Balsen ctf it is hard as hell
filedescriptor: was he trying to create the exists quantifier?
Johnvade: why is he making his own coq like program
Nnotm: filedescriptor I think it was more him seeing that it's not built in and then deciding not to use it
zoki_macola: Maybe like https://carbon3d.com, but for bio
aziz_fazlagic: Where is your Razer Blade? :p
Ecobat: how long has this stream been going ?
tharda18: hi
Jeppelelle: zoki 3d print organs, molecules, enzymes and stuff?
wrelt: @johnvade he’s not, he’s making a whole coq-like language from scratch, in addition to an example coq-like program that is interpreted by his language. at least that’s my guess from joining stream 3 min ago
Protoxus: @Ecobat Uptime is 1 hour and 10 min, but there was a crash at some point, so who knows?
Johnvade: yeah why
zoki_macola: @Jeppelelle Yea, but not "printing", more like growing
Protoxus: Probably 2-3 hours
Zheikk3: "basic programming"
chocolatechp: LOl
wrelt: not sure why, he seems to just like coq (no pun)
Johnvade: to remedy some perceived weakness in coq or to get his feet wet
Johnvade: I guess the latter
knilecrack: yes
wrelt: I think he wants to understand proving languages better
Brunovercelli: """"""basic"""""" programming lul
Protoxus: wrelt I guess it's handy for proving stuff, which is why he wants to reimplement it in python? Idk
cechov: why don't you try to explain instead of raging?
chocolatechp: LOL
HS_SemenThrower: oooo censorship!!!
Shanmukhosiris: LUL
filedescriptor: damn he's taking out people left and right LUL
gonzaloquintas: hi dude!
zoki_macola: @Jeppelelle But its expensive to make cloud lab, and need to find good hardware engineers
HS_SemenThrower: no
HS_SemenThrower: i don't
r1ppyd1ppy: rip
Protoxus: HS_SemenThrower His stream, his perogative to ban :^)
smurfd0: "why not" is usually a good answer on "why?"
Johnvade: then you could just say "why not" etc
fafws321: how long has he been streamign?&gt;????
r00tdk: Ctf
filedescriptor: he's going full stalin mode guys im afraid monkaS
Protoxus: prerogative*
knilecrack: Hey did you hear about TabNine?
sepulsher: @georgehotz how good you were at math in highschool?
Jeppelelle: zoki_macola yeah i bet biotech is incredible expensive, FDA approval is really tough in medicine too i've heard so you have a ton of work ahead of you :D
r1ppyd1ppy: @georgehotz roll a d20 to see who gets banned next
Shanmukhosiris: suggest me some easy ways to learn algorithms please
aziz_fazlagic: Why is he using a macbook?
r00tdk: Not doing ctfs?
Thomasbrah: @georgehotz so backspace.ai is your newest project or how should i understand this ?
nomadicpatch: how much rent are you paying for that apppartment?
wrelt: backspace.ai seems cool
shieeeeeeeeet: so the answer to "why" was backspace.ai
Protoxus: wrelt Damn right
JdPaulBlart: math boring programming fun
UzeezU: I really do not like the feel of SF
chocolatechp: contact button does not work on backspace
JdPaulBlart: so programmers will be useless in the future PogChamp
nudax: oh finally i catch a live stream. good to see you!
Protoxus: @chocolatechp Yes it does. It's mailto-link
eduardoadf1: what is that open on vscode?
DasMastah: The Coq source code @eduardoadf1
zoki_macola: @Jeppelelle I dont think i need FDA, we are not making drugs, more like development enviroment for bioengineering. People who use our platform would most likely need FDA
Ecobat: @JdPaulBlart yeah, probably in 150 years. Give or take 1000 years
HS_SemenThrower: does george ver play games?
eduardoadf1: thx
HS_SemenThrower: ever*
chocolatechp: o
theselectedcoder: SF seems expensive af
spanilith: seems
Ace33W: @hs_sementhrower do you know who he is?
spanilith: its like #1 or #2
theselectedcoder: 5k month for 1 bed and 1 bathroom apartment
Shanmukhosiris: any developers in the chat ?
HS_SemenThrower: @Ace33W yes but if i say his company i'll get banned
Ecobat: 5k a month !?
zenkai_oogway: @HS_SemenThrower he played minecraft once I think
JdPaulBlart: so if we take 1000 years then programmers were obsolete in 1019 @Ecobat
chocolatechp: it doesnt do anything when i click it
r00tdk: Not doing ctf nowadays?
Ecobat: @JdPaulBlart ok, don't take. Just give
Ace33W: do you know his background though? he's not a gamer. he is a programmer
wrelt: @ecobat I’d say give or take 300 imo. well, give, since it won’t be in 1869
theselectedcoder: in Estonia u get a big ass house for 5k per month
HS_SemenThrower: @zenkai_oogway ah so he's a minecraft guy?
JdPaulBlart: @georgehotz the computer science globalists wont let you automate programmers
prezk0: !uptime
Ecobat: @wrelt if all goes well, way past our time
wrelt: @r00tdk he does different things every stream. don’t think he’s done ctfs for some time
nudax: you look healthy
benchai18: My fav nerd
JdPaulBlart: it wont start ruining our jobs until the far future
sausainismilka: sup hot
wrelt: @ecobat yeah it’s almost certainly beyond our lifetimes, barring some anti-aging breakthroughs coming very soon
theselectedcoder: @prezk0 uptime is around 3.5 hours
JdPaulBlart: can you make music.ai
wrelt: jobs that are less abstract may be at risk in our lifetimes though, I think
asthmaa: @georgehotz do you have a bachelor degree? i want to understand if uni is really important for computer science
Ecobat: yup
Ecobat: @asthmaa computer science ? yes. Programming ? no.
asthmaa: k
Johnvade: &gt;only famous people can find programs that are hard to decide
Johnvade: I am not famous
botclimber: ur willing is ur best weapon
benchai18: Whats he working on
TaFFeLaFFe: @asthmaa You're gonna be a lot better off in terms of job security with a degree.
chancechants: self monitoring abstraction layer
Johnvade: here is a program that is hard to decide (just came up with this): start at 2^200, keep multiplying by two and convert to decimal. terminate when you find a power of two that doesn't contain all ten digits in its decimal expansion
pamz123: wb
Ecobat: @wrelt it will take quite a while though. I mean, programs (or robots) that replace people's jobs will be incredibly complex. Complexity equals bugs and less secure (more prone to hacking)
sondreal: Hello
Johnvade: decide if that ever terminates!
Ecobat: so there will be a lot of ... fighting it
Ecobat: so to say
nudax: what is he working on?
JdPaulBlart: we are probably good fam
benchai18: @asthmaa if u can get the degree just do it dude. I was too rebellious to stay in school more than half a semester and the last 5 years of my life (25-30) woulda been easier if I’d finished
JdPaulBlart: if anything interesting happens it will probably be in future
wrelt: @ecobat yeah, but in 50 years, even if we aren’t yet near what we consider AGI, I think the rate of jobs being phased out will accelerate. especially simple labor and service jobs. and complexity may be partly mitigated or at least mitigated quicker with ML
haircutjimmy: Coq?
shieeeeeeeeet: is he building the parser in python? or using a parsing library? what about the interpreter?
Johnvade: theorem prover
chancechants: i for one welcome our new digital micromanagers, my TPS report will be submitted in a timely manner
sondreal: are you wearing ur watch georgehotz PogChamp
wrelt: @shieeeeeeeeet yes, in python. he’s using an awesome python parsing lib called lark. used it the first time about a week ago, and it’s very easy to understand and use
thuganalyst: What song was that?
wrelt: I’m assuming his parser and interpreter will both be in python
faxity: LUL
fafws321: why are u so angry?
Orestes13: but why george? Kappa
benchai18: CatCoq(ck)?
lyricrush: REEE
shieeeeeeeeet: does the parser auto generate the AST?
HS_SemenThrower: who hurt u george
filedescriptor: he went from stalin to feynman monkaS
faxity: thinking about dieing monkaS
JdPaulBlart: thats wack fam
lyricrush: Simulation theory.jpg
fafws321: why are you telling us these things now?
zoki_macola: Im making a biotech company to understand the genetic code and make myself immortal
DrakenZA: it makes sense
Johnvade: this is like the shittiest feynman why rant ive heard
knilecrack: you dont' give a fuck
camkinstrike: Yo wont learn if you don't ask questions.
Johnvade: cya
gonzaloquintas: I wish I know pythoin to understand what is this guy doing.... just watching he while coding is mesmerizing
frankytex: that escalated quickly
knilecrack: yeah
JdPaulBlart: we work so that life is more comfortable
Mariosavitch: why do you want to live forever
Mariosavitch: Kappa
chancechants: dont let your memes be dreams
neca420: this used to be a programming stream FeelsBadMan
wrelt: &gt;work for moloch
wrelt: well-put
MrPrismo: What language is this that you are coding in?
spatialfree: spatialfree subscribed at Tier 1.
JdPaulBlart: with that mindset everyone should just kill theirself
spanilith: pog feinman
jagger_rsw: @georgehotz so when are you starting to hack the world simulation machine? I bet there are format string bugs there.
Thomasbrah: why, it's simple. Everyone has a limited amount of time so why not try make it as easy going and enjoyful as possible while you still have your time in exsistence
Protoxus: @MrPrismo It's coq
JdPaulBlart: this is what happens to your brain when you get sued by sony at a yound age
wrelt: @thomasbrah that assumes the primary goal in life is to enjoy oneself, which is a big assumption
W1lkins: Abort.
filedescriptor: @JdPaulBlart his speech turned me into a nihilist
filedescriptor: LUL
MrPrismo: Thanks @Protoxus
knilecrack: ahahahahahahahahaha
notelex: !uptime
chesssist: jasonrG jasonrG jasonrG jasonrG jasonrG
CondomsWontFit: PogChamp
Thomasbrah: What was the result of sony sueing you ?
ProfessorMagikarp0: hell yeah LUL
chesssist: crack or tweaaaaak
chancechants: PJSugar PJSugar PJSugar
st47ik: its the caffeine in tea Kappa
fafws321: do you like math? @georgehotz
wrelt: @thomasbrah probably made him more famous
zoki_macola: If AI advances continue at any rate, eventually we will all merge into one superintelligent computer or organism, and actually figure out how to escape this universe
jagger_rsw: @georgehotz do you think there are some nice b0fs in our simulated world?
whitsyerhing: You more of a stoic then?
wrelt: @jagger_rsw he talked about that a bit in his sxsw talk
Protoxus: Positive nihilism embraces that nothing matters that nothing matters. :D
erichtp: i cant wait for backspace to fund my future robot waifu gf
chesssist: !keyboard
filedescriptor: @erichtp same Kreygasm
Obijags: !keyboard
st47ik: @chesssist HHKB aka Happy hacking keyboard
erichtp: @Protoxus nothing else matters but you moon2PREGARIO
sepulsher: @georgehotz why math is so hard
jagger_rsw: cogito
st47ik: stoicism Kappa
Protoxus: erichtp Gotta love Max Stirner, am I right?
verdensmand1: the primary objective in life is to ball out and get like a million followers on IG most favorably while buliding good tech
DevoE444: still nothing matters though Kappa
lasercatboss: solipsism is just really convenient to justify my ego
shieeeeeeeeet: can't you derive hedonism from solipsism
Protoxus: verdensmand1 You Danish like me?
cechov: so, we gave up on coq and the parser?
Protoxus: cechov Yeah, 'cause it doesn't matter. :^) Kappa
Thomasbrah: is that his bed in the left side of the webcam ?
benchai18: You’re a far more functional tweaker than I was.
sondreal: its a couch
jagger_rsw: why nihilism is stupid? it just says that there are no objective moral values enshrined in the fabric of this world, and you need to figure your own ones (as yourself or as a society)
erichtp: @Protoxus i only love Freud and his cocaine
LemareClub: whats he doing?
lasercatboss: the coq parser just lead to way more profound questions
Protoxus: erichtp What's a n** gotta do to get some eel coq?!
knilecrack: :D
foxubu:  23 stream
knilecrack: I GOT THESE CHEEZBURGERS MANNN
wrelt: coq and philosophy go well together
Protoxus: erichtp If you don't know what I'm talking about, you gotta see the Sam O'Nella YouTube-video on Freud :P
knilecrack: @wrelt drugs too :)
JdPaulBlart: is this for discrete math
JdPaulBlart: that class was aids
lasercatboss: all the great philisophers liked themselves some coq from time to time
sondreal: discrete maths are easy if you dont ask the whys Kappa
wrelt: @jdpaulblart enjoy never understanding deep learning
erichtp: moon2WAH when its too much coq
NonTrivial778: LUL
st47ik: LUL
pmc_eft: @sondreal The boolean algebra x x=x LUL
NonTrivial778: Coq is fun
arbitel: why back to MBP ? where's your razer
sondreal: LUL
erichtp: @Protoxus I love his videos lmao
knilecrack: yes
Nnotm: nat has infinite values, but two constructors, assuming coq uses those terms
knilecrack: I used to define it in university
spanilith: 1 x for 1 y
unmercifullyy: @Nnotm what keyboard do u use?
Protoxus: erichtp If you like political philosophy to some extend you'll love jreg as well
grey_street: how much
unmercifullyy: @georgehotz what keyboard do u use?
Nnotm: @unmercifullyy physical keyboard or keyboard layout?
Nnotm: oh did you not mean to tag me?
unmercifullyy: @Nnotm sorry, did not mean to address the question to you LUL
Thomasbrah: @georgehotz is this on a macbook or an imac ?
Nnotm: okay, I was wondering why you would ask me that LUL
smurfd0: we just see your background, no doc no menubar...
erichtp: I'll give it a look thanks for the recommendation moon2EZ
W1lkins: we see the secrets monkaS
nanodanger7: https://www.hhkeyboard.com/ this is the keyboard
Belowzer0w: developing games for the ps3 kappa
xyet: he was never able to get it working on windows?
pmc_eft: de morhens law LUL
fafws321: searching de morgans law in 2019 LUL LUL LUL
benchai18: Anyone else have no idea what’s going on but riveted nonetheless??
Crypod:  Jebaited yes
JdPaulBlart: $240 keyboard btw
ncdoru: !uptime
whitsyerhing: no idea what is going on. i'm here for the keyboard asmr
JdPaulBlart: i got amazon alexa on my raspberry pi can i get a job pls
Twitch0xme: @georgehotz replace   with *?
slakkur: Yes,I finally get to watch live!
hotplay: @georgehotz what laptop do you have?
Crypod: wahoo! one problem eliminated!
nizero: sup George, what are your thoughts about techcrunch disrupt?
NV17: Basic
3even: @georgehotz Do you take BitcoinCash donations?
knilecrack: what do you thing about the bloomberg article on compromised supermicro servers?
knilecrack: think*
Crypod: i see some n in the middle there. is that intended?
Protoxus: Paint PogChamp
slakkur: draw.io
Jannnik: draw io
kenan7: draw.io ??
Protoxus: ^
W1lkins: javascript paint LUL
MonkaSupreme: this is how paint felt LULW
notelex: LUL
dyslexicat: Kappa
Crypod: oshiThink
ProfessorMagikarp0: luxxDetective
rscarth: rscarth subscribed at Tier 1.
DevoE444: those arrows are dope af
Protoxus: DevoE444 I know, right?
Navilist: LUL
NV17: How do you make a language damn
ProfessorMagikarp0: TheIlluminati TheIlluminati TheIlluminati
Protoxus: You can just drag from the side of a box to another to make an arrow
MllCZ: @NV17 you need structures, variables and functions
jax05_: hey what's up
DevoE444: and Pope runs the corporations Kappa
dyslexicat: weSmart
NV17: DarkMode DarkMode
johnny_thehobo: fucking employees messed all up
notelex: LUL
nizero: this is the best explanation ever
jagger_rsw: @georgehotz to go to blackhat / defcon, go to parties, meet geohot at defcon ctf parties, this makes employees happier
johnny_thehobo: TriHard take take take
fazel3ss: Don’t corps get better employees after all. It’s self investment for them
ProfessorMagikarp0: geo rant compilation video when? Kappa TheIlluminati
slakkur: Hey I'm going to vegas for ReInvent dont let the cat out of the bag!
HS_SemenThrower: hahah what a finesse
slakkur: lol
frankytex: those people exist, I have met them
MonkaSupreme: LUL
Purrplecat: 5Head
chaprio1: thanks for your ted talk
nizero: insightful!
johnny_thehobo: this is better than greta's speech
Purrplecat: I see i see purrplT purrplMald
HS_SemenThrower: yeesh
pizzA_z: Hey @georgehotz awesome as always my dude. Getting sidetracked again? 🤔
johnny_thehobo: hotz for nobel
jagger_rsw: @georgehotz are you talking about Mitnick and Schneier? :)
3even: @georgehotz Do you take BitcoinCash donations?
Navilist: Where do employees who were paid for by corporations fit in on this diagram?
HS_SemenThrower: ooo
chaprio1: politics 4Head
johnny_thehobo: he said it chat monkaS
frankytex: security and a//v pros also get money from the conference ring of perpetual bs
3even: Good chance Greta is gonna commit suicide
HS_SemenThrower: that semi autistic girl is nominated for a nobel prize
Crypod: whoaa whoaaa there
jagger_rsw: conferences are a perk these days, if employees don't get em, they go to another company, there's no expectation of learning stuff
notelex: so where can I buy tickets to your conference to listen this talk in person
haircutjimmy: :( greta
MonkaSupreme: imagine being 2 weeks on a sailing boat ... :(
nizero: she is Aspergers
UMPS: doesn't she have like aspergers and OCD
HS_SemenThrower: back peddling
whitsyerhing: universities just lumped in with corporations ?
HS_SemenThrower: greta get his ass
3even: She is a human shield
cobaltstark1: How to start learning to code like you .. I am an undergrad ..
uchihaislife: We are back on mac finally
jagger_rsw: @georgehotz you need to come to the DefCon "conference" again btw :)
fillmyvoid: capital gains
haircutjimmy: I paid to go to EuroPython last year - oh no! Sucker
Jewishrambo: Don’t think they. Do
HS_SemenThrower: do another techcrunch
cobaltstark1: How to start learning to code like you .. I am an undergrad ..
fazel3ss: What is an alternative to conf
benchai18: I want @georgehotz at my wedding.
jax05_: @cobaltstark1 google my fren
yash_rohilla: @georgehotz Why does the sec field suck?
benchai18: Why does defcon suck? Never been so I’m curious
nizero: I met you once at defcon George, u were too busy to say hi tho
Protoxus: draw.io is a native file type in Google Drive
3even: @georgehotz Do you take BitcoinCash donations?
Protoxus: Pretty nice
quickfloor: i go to college for free but it's sucks . should i drop out and be rich ?
dagobert2707: i dont get all this bad attitudes about Greta and this Friday for future thing...
cobaltstark1: How to start learning to code like you .. I am an undergrad ..
Navilist: Hehe
whitsyerhing: Have podcasts morphed into something similar to conferences?
xyet: I step out for a bit, the fuck are we talking about ? triHYPERS
foxubu: Mr. Robot #conspiracy ^^
boc5: man you are crazy you move for nothing
Nnotm: no "fridays for future" is the thing where students don't go to school on friday to protest climate change
benchai18: Wait why does DEFCON suck? Always thought abt going
chancechants: what about blizzcon?
cobaltstark1: How to start learning to code like you .. I am an undergrad ..
Jeppelelle: DEF CON 25 - Christopher Domas - Breaking the x86 Instruction Set &lt;-- great talk for those who are into that stuff
haircutjimmy: cheers the noo
quickfloor: Drive.ai Bought by apple to be success
jagger_rsw: @georgehotz It's a bit a blackmail on employees behalf these days. They say 'if you don't let us go, so we can find out who pays better money (and maybe we leave you), we'll leave you 100% sure"
HS_SemenThrower: i wanna see u talk to joe rogan for some reason
fazel3ss: Conferences are for sharing knowledge, workshops and so on. If not them than what?
Protoxus: George on Joe Rogan when? Keepo
quickfloor: Can we run Geopodcast ?
benchai18: @georgehotz if I could get you on Rogan would you do it?
Nnotm: everyone's having fun until podcasters start making conferences...
chaprio1: Kappa great
johnnyhotlava: Just got back what happened to him translating to python?
3even: lol
HS_SemenThrower: no ben
nizero: @georgehotz what about the startups that are trying to network with investors/customers at disrupt. .. they are both give and take
HS_SemenThrower: he said some stream ago that he would not go
jax05_: @johnnyhotlava he started ranting LUL
boc5: Why you don't make your own podcast show like joe rogueAne
johnnyhotlava: @jax05_ Glorious lol
Protoxus: boc5 What do you think this is? :P
quickfloor: He saying twitch conf is not bad cause he's using twitch right now :D you have to say that bro . u can't talk sh1t about twitch in twitch
uchihaislife: @georgehotz what chair is that? looks reals comfortable
NV17: whats a twitchcoq?
boc5: It's not professional
johnnyhotlava: George you're a star though.
benchai18: @hs_sementhrower Bummer. If he had something to sell he might go. Oh well 🤷♂️
jagger_rsw: @georgehotz you're beating a dead horse about sec-conferences, it's a paid vacation
johnnyhotlava: YES it is
MonkaSupreme: twitch con = networking
quickfloor: LUL
Celestial_Jaeger: can someone help me with my pintos task 0 assignment lmao
Caene: Isn't Twitchcon more of a get-together, hey come here and meet your b-list e-celebs? Shit like that.
notelex: LUL
HS_SemenThrower: LOL
johnnyhotlava: Lol his chart
Akash_44: LUL
Julll: LUL
slakkur: wait, they have tons of labs at ms ignite, and you get out of the office which gives you time to learn without work bullshit distracting you, you also get to network, but I wouldnt go if i had to pay for it
johnnyhotlava: Is so glorious
quickfloor: ypu have more than 500 connection
johnnyhotlava: I love this man
whitsyerhing: Does anything ever progress from conferences. They do seem like a scam.
my_curiosity: coq list
quickfloor: like bill gatesa
Jewishrambo: Lol
3even: Do you take Bitcoin Cash donations?
UniversalGeneve: just sent you an invite on linkedin LUL
faulpelzz: @georgehotz why do you sleep in your kitchen?
DevoE444: i hope the fappening upload gretas nudes Kappa
johnnyhotlava: LOLOLOLOL
johnnyhotlava: God that's the best
Caene: @DevoE444 DansGame
chaprio1: @DevoE444 fbi
quickfloor: But bro . conferences give good lunch Kappa
xyet: is he mentally stable?
Protoxus: xyet Yes
zoki_macola: just leave it on
nizero: George I met Harold at a conference
MonkaSupreme: put on black screen with some music
slakkur: plus ms ignite backpack is legit
Protoxus: Yoga stream? PogChamp
johnnyhotlava: My favorite part is the perpetual conference goers.
nizero: he's a nice guy
boc5: But you make the game?
slakkur: lul
GoldSkis: @georgehotz add me back on Linkeedin
whitsyerhing: shut it off people will leave, if you have an away people will hang around and keep it open in the background.
boc5: whp*
benchai18: I watched a video of a kid tell Milo Yiannapolous he’d let Milo fuck his girl. I might say that to George
boc5: Hate the player who promote the game
xyet: Black screen with music request
quickfloor: We don't talk anymore , like we used to do
jagger_rsw: @georgehotz aren't you tempted to tacke the problem of a more general AI than self-driving cars?
bongodrummer: what about founder meetups?
W1lkins: we saw the secrets again monkaS
cobaltstark1: How to start learning to code like you .. I am an undergrad ..
ItzRicky001: run some ads sourPoggers
Crypod: it only shows ur wallpaper when that happens
Protoxus: Yes, Milo Yiannopoulos is gay
benchai18: Yes
Nnotm: ooh you can draw an away image with draw.io
johnnyhotlava: I go to conferences if I get a free tickets from the radio station
rscarth: lmao
W1lkins: Play Greta's speech on repeat @georgehotz
Akash_44: LUL
benchai18: Infinity
MonkaSupreme: I hear you Kappa
dagobert2707: Why would anyone hate this girl :D (Grete)
whitsyerhing: New scene, with just an image, no mic, maybe music playing.
quickfloor: U can earn money with ASMR here
rscarth: west coast confirmed
johnnyhotlava: Elitist time
jagger_rsw: @georgehotz You can become next Schneier, or Mitnick or Hypponen. Going to conferences 5-star hotel, 1-st class ticket, plus a few k$. 2 confs / m-th and it's a good income
frankytex: angry asmr need to be a thing
quickfloor: No :(
Caene: Muting himself while explainging LUL
johnnyhotlava: lol
MonkaSupreme: 👂
notelex: LUL
quickfloor: LUL
BuySomeEther: he likes to abuse his keyboard
jax05_: lul
johnnyhotlava: well See yas in fideen
HS_SemenThrower: ASMR
MonkaSupreme: 👁️ 👃 👁️ 👂
boc5: i think that you can be a good player poker ggotz
whitsyerhing: Giving away the secrets of his OBS setup
superragetastic: wait aren't we all get ?
camkinstrike: do you ever game george? lol
frankytex: #actually
johnnyhotlava: I'm trying to developing my next fintech conference circle jerk. So I can capitalize on people that need a vacay
quickfloor: you have linkedin prime
Caene: no audio
sondreal: no
rscarth: no
Protoxus: No
Jannnik: no
UMPS: no
MDSZilla: No
Lambda_86: no
whitsyerhing: No
frankytex: no
Akash_44: No
DevoE444: turn of events he has dinner with greta
hectorrami: No
MonkaSupreme: 👂
ᅟᅟᅟᅟ: no
xyet: VoteNay VoteNay VoteNay VoteNay VoteNay
frankytex: he bust, but he fix
T_x_x_T: No
quickfloor: NotLikeThis NotLikeThis NotLikeThis
W1lkins: he's going to fix it for sure Kappa
MDSZilla: OBS Settings &gt; Audio &gt; Desktop Audio Device
Caene: ^
Navilist: he breaketh, but he fixeth
benchai18: Guys
benchai18: Can I not subscribe from the iOS app?
ᅟᅟᅟᅟ: SeemsGood
whitsyerhing: that worked!"#
boc5: worked for a sec
benchai18: Is this an Apple Tax thing?
W1lkins: Look at this top tier debugging PogChamp
MonkaSupreme: unplug the mic
MDSZilla: OBS Settings &gt; Audio &gt; Desktop Audio Device ? :P
Gregerncx: @benchai18 you cannot
Caene: Go to settings
johnnyhotlava: Take the break maaaan
hectorrami: There!
whitsyerhing: we just heard you say "that doesn't work" then it went mute again.
Caene: OBS settings and look for audio output settings
Lugueiro: SeemsGood SeemsGood
MonkaSupreme: just unplug the mic my dude
benchai18: @gregerncx thanks.
jagger_rsw: @georgehotz What about starting a podcast?: a mix of philosophy, ai, security. Like JRE, just knowing what you're talking about.
Akash_44: !uptime
hectorrami: Just heard u man
slakkur: brrea time! bacin 15! bye
MDSZilla: Its not detecting your speakers rip :/
knilecrack: yers
Caene: Disabled output devices DansGame
ProfessorMagikarp0: ill watch video on my own Kappa
slakkur: I cant type
ᅟᅟᅟᅟ: SeemsGood
whitsyerhing: there we go
whitsyerhing: oh
BoringMode: break is getting smaller and smaller
frankytex: no worries, we'll wait in silence while you number 2
hectorrami: it works
sondreal: just disable mic in mac settings, and activate sound Kappa
benchai18: “I heard George is creating a new jailbreak” pass it on
W1lkins: only subscribers can hear the music
ProfessorMagikarp0: ^ LUL
Jeppelelle: So, what are we doing now people?
frankytex: only lunatics can hear the music
eax_ebx: ееееееее бой
zeroeagle1: didnt george attend twitch con?
ProfessorMagikarp0: chat, have u found any good learning resources lately? PrideWingL luxxSquad PrideWingR
benchai18: I’d like to know too
johnny_thehobo: the conference companies send the killers after hotz?
benchai18: Suicided
UMPS: anyone have tips to gain motivation
frankytex: I'm going to draw.io through this silence
robby0313: What time zone?
Datamaskin: In 10 mins its 1.30 somewhere
Lugueiro: @UMPS discipline
UMPS: that's not motivation &gt;:|
benchai18: Anyone know where he at? Obviously Pacific
Sarkin_dota: Why are we writing a language for
benchai18: Always wondered where he’s at
frankytex: looks like his house
UMPS: he's probably in texas
ProfessorMagikarp0: @UMPS u should want to work for geo one day is that motivational?
UMPS: wait nah
UMPS: is he in SF or LA or something
benchai18: Not Texas. Texas isn’t 1:30 right now
robby0313: He is in San Diego
BerrysYT: @Sarkin_dota "To prove things in" Kappa
ProfessorMagikarp0: look where is company hq is Kappa
benchai18: I dno but I’m in LA and if he is too I’d totally send him chocolates dicks
UMPS: @ProfessorMagikarp0 no
UMPS: working for someone is suicide enducing
benchai18: @umps you are so right. I just dipped out of a great job to hop on board as a partner/CMO of a startup cuz I’m sick of working for someone else
slakkur: he's in bay area right
ProfessorMagikarp0: so ud rather cause that feeling for someone else by running a company?
benchai18: No, because I’m not an antiquated prick
UMPS: LUL
ProfessorMagikarp0: im sure ur old boss would say that too
trchaosTR: what time it is ?
UMPS: i've thought about doing small applications that can be run by just 1 person
imcraxo: 6more mins
UMPS: i think ios would be a good market for that
benchai18: Lol fair enough. But I let my current employees have autonomy (if they’re capable)
Sawfare: is he back to apple again?
imcraxo: where is he working
xyet: He took a shit and didn't wash his hands again ?
knilecrack: ahahahaha
ProfessorMagikarp0: gotta get them gains Pog
trchaosTR: oh shit real gainz
eax_ebx: strong
MonkaSupreme: oh shit my boi is doing 20
MonkaSupreme: xD
ProfessorMagikarp0: geo trying to get that jail house body LUL
trchaosTR: punisher maybe @professormagikarp0
ProfessorMagikarp0: LUL
knilecrack: breath
xyet: prerecorded video?
llpwnage: this guy crazy :DDDDDDDDDDDDDD
BerrysYT: Prerecorded af
BerrysYT: CrreamAwk
eax_ebx: wtf
ProfessorMagikarp0:  5 pushups per sub lets get geo ripped KappaPride
NonTrivial778: the world doesn't care if we die
benchai18: @professormagikarp0 I work in e-commerce (high volume... millions of $ a month just on Amazon... not including $200k/month on Walmart and ebay) and I got tired of making millions for other people... people that could let me go at any moment, or override my efforts. If I had faith in them I’d have stayed. It’s not about not having a boss, it’s abt having faith in the leadership
xyet: triS triS This dudes mental state is questionable triS triS
NonTrivial778: LUL LUL
trchaosTR: i think he watched joker
chocolatechp: yikes
trchaosTR: maybe several times Kappa Kappa
NonTrivial778: solipsism
benchai18: Joker was interesting. Anyone see it?
whitsyerhing: dishes stream
Lugueiro: 1m2019.com
NonTrivial778: @xyet what did he said?
Lugueiro: dont forget
rscarth: dishwashing simulator
NonTrivial778: LUL
trchaosTR: i watched it @benchai18
goodgameezz: kkk
frankytex: that reminds me I have to turn on the dish washer damn it!
xyet: @NonTrivial778 nothing just doing weird shit
goodgameezz: real life live
hugo_kanazaca: the amount of water he is wasting lol
ProfessorMagikarp0: @benchai18 i know those feels too actually. i was just playing devils advocate because the issue seems to be that they dont think they are doing anything wrong and arnt doing it on purpose as far as i can tell. no one wants to be bad leadership
zoki_macola: We are watching another human being doing everyday stuff. We reached the highest peak
NonTrivial778: He's a part of the simulation
frankytex: slightly delayed real life live!
slakkur: I like that he's actually human, sometimes when I watch him code, I forget. :D
W1lkins: @georgehotz why could only subscribers hear the music during the break?
trchaosTR: wasting a lot water btw
theselectedcoder: "it's about showing off with your skills" -@georgehotz
knilecrack: welcome back mf
3even: Do you take BitcoinCash donations?
HS_SemenThrower: ;d
drivewaycam: george is back just in time
r00tdk: Do ctfs
lightofhel1: just in time
tomroxxx: Geore why are u wearing an Mavericks jogger?
whitsyerhing: wasting water. it falls from the sky.
drivewaycam: what a g
jax05_: wb
trchaosTR: yo george which phone do you use
ForsakenReborn: you know how to listen to good music @georgehotz
r00tdk: Ctfs
benchai18: @trchaostr What did u think of it? Joaquin is frighteningly talented
NonTrivial778: geohot do you have schizophrenia?
knilecrack: it's not wasted
r00tdk: Why did you quit on ctf?
Sarkin_dota: You're not a hydro homie
knilecrack: ahahahahahaha
frankytex: lmao
johnnyhotlava: WOAH
MonkaSupreme: everyone pays the same LUL _
whitsyerhing: i'll turn on the shower and then go for a poo while the shower is on
MonkaSupreme: ?
hackyhacks: yes
chocolatechp: about wha
knilecrack: bro, I'll come to USA next year we need to get go out for beer
3even: @georgehotz Do you take BitcoinCash donations?
johnnyhotlava: YES
r00tdk: Let us do ctf
johnnyhotlava: Tell us
whitsyerhing: shower is just going a good 5 mins before I get in
johnnyhotlava: FLOW LIMITERS IN SHOWERS
benchai18: Anyone here an iOS jailbreaker and know if it’s possible to have background audio when minimizing Twitch app?
johnnyhotlava: continue
NonTrivial778: geohot theres a ghost behind you
jax05_: jailbreak the shower
UMPS: get this man a better vim theme
slakkur: SUB2HOTZ! LUL
trchaosTR: @benchai18 i am big fan of heath ledger but i really like joaquin's act he is verry talented and maybe he'll win oscars
Jeppelelle: UMPS Gruvbox like everyone else?
MonkaSupreme: you need some real streamer emotes
Lugueiro: @UMPS UL
Lugueiro: LUL*
UMPS: Ayu @Jeppelelle
Sylens__: What programming language are you coding in @georgehotz
NonTrivial778: coq
johnnyhotlava: More flow charts
MonkaSupreme: is this a good book? @georgehotz
johnnyhotlava: Major regret for that "nice words" Python
jonathan865: what are we listening to?
johnnyhotlava: You translating?
trchaosTR: why his profile pic is too serious Kappa
UMPS: why not write it in the language you're writing 4Head
tfue_is_dog_shit: is this the matrix? Kappa
jax05_: cause he's a pro @trchaosTR
Sylens__: @nontrivial778 was that the language answer for me?
slakkur: does coq suck?
kluo84: wonder if George interested in Bug Bounty?
johnnyhotlava: Just make one of your minions build you a custom library
johnnyhotlava: then share it with me for coq
trchaosTR: i was thinking to study computer engineering but after this i'll think again NotLikeThis
Sarkin_dota: SUCC
johnnyhotlava: Ole euro language B.S.
slakkur: OMG, I could do lame coq jokes all day... ask my wife
jax05_: this is advanced stuff
eax_ebx: I'll better ask your mom.
jax05_: mom jokes :O
eax_ebx: From Ukraine with love.)
benchai18: @trchaostr I’m with you. As a Batman villain, Ledger is still the best for sure. As a psychological madman murdered, I think Joaquin took it. Like, I can’t imagine Joaquin’s Joker competing with Batman
benchai18: Murderer*
Sawfare: @georgehotz can you tell why you moved back to apple from your windows laptop?
Lil__Slap: Wpm Record?
slakkur: because windows sucks for coding python
ImpalerV: hello :) HeyGuys
eax_ebx: mb coz шindows is not a system?
NonTrivial778: Is the CIA watching us right now?
ImpalerV: lol, it doesn't suck... been doing it for years now :/
UMPS: you should start a kode scool
UMPS: school
johnnyhotlava: He get knowledge directly from those two fingers
jax05_: lol
eax_ebx: I love CIA. Very big fan.
ImpalerV: LUL
Lil__Slap: CIA watching football Rn
gerntt: do you prefer Mac or Linux
whitsyerhing: I want it as a matter of public record that I am team china.
whitsyerhing: for when they take over.
Sylens__: Mac
P3droPL: @georgehotz Why switch back to Mac?
johnnyhotlava: CIA dgaf, my dad was a programmer and a CIA contractor, he just watched a lot of cable news
johnnyhotlava: lol
UMPS: if mac could run i3 Kreygasm
Keyeh: windows is garbage
ImpalerV: LUL
trchaosTR: @benchai18 i usually dont watch dramatic movies but this movie wasn't that boring i hope joker 2 will come with more action
Santiago_LHC: Windows 7 is fine
ImpalerV: windows is fine
slakkur: @ImpalerV are you trolling? I've done both, and mac is so much better if you need a good terminal.
kluo84: unfortunately Windows still highest percentage out there
benchai18: @trchaostr Unfortunately, they said they’re not planning to make one
neill222: @georgehotz have you heard of lean? https://github.com/leanprover/lean looks like a more powerful theorem prover than coq
whitsyerhing: who cares, you will get used to whatever you are using.
Santiago_LHC: Joker 2 is not going to be a thing. The whole point was for it to be a standalone movie @trchaosTR
knilecrack: windows is good if you need terminal
UMPS: OBO windows wins hands down
UMPS: oops
UMPS: mac*
knilecrack: @whitsyerhing yeah
kluo84: powershell is not a joke now
trchaosTR: dont blame windows guys i still use intel dual core pc with win7
johnnyhotlava: Space back pack AI
smallest_cock: is this a twitch bot?
technicalb0y: hello
Santiago_LHC: Has George been silent this whole time?
ImpalerV: @slakkur sure, the terminal. that is pretty much all. it requires just a bit more effort to install stuff on windows but even that has been taken away by the anaconda terminal. also, now there is the subsystem on windows, so there's that too. and the new terminal is coming out soon, it is currently in beta
johnnyhotlava: He's channeling
dyslexicat: world is a beautiful place SourPls
Santiago_LHC: "He's wired in" like they say in The Social Network
Keyeh: did he take l-theanine? he's so focused
UMPS: he popped an addy
technicalb0y: george can u share tmux conf file, or do you have a dotfiles repo
johnnyhotlava: LOLOLOL
Lil__Slap: Flow state AF
whitsyerhing: autism engaged
johnnyhotlava: Zooted and booted
technicalb0y: if you have
johnnyhotlava: 500 mg
neroo2k: what's the concept behind this program
johnnyhotlava: whopped up
whitsyerhing: fully weaponised
gunnaren: He's streaming under 'basic programming', that couldn't be more wrong LUL
trchaosTR: @santiago_lhc sad :(
Lil__Slap: Mo' like top tier programming
knilecrack: @gunnaren ahaha yeah
ZerkBtw: what are you listening to?
johnnyhotlava: His speed without making millions of mistakes is beautiful
UMPS: when he puts the two fingers to his head, he's symlinking to Mark Zuckerberg and tying into the Lizard Mainframe.
smallest_cock: I like the clean shave
julen9601: @Keyeh aderall
trchaosTR: dc will release harley quinn next year
Santiago_LHC: @trchaosTR it's great actually, not everything needs sequels and prequels. We have to learn to enjoy things for what they are.
benchai18: Can any software with a GUI that can be made for Linux (Debian) also be made for MacOS? You don’t use ObjC to make Windows software.. I guess I’m wondering which language can be used on the most operating systems. Besides Java. Ew.
jax05_: @johnnyhotlava I feel like he's slower than norm rn lmao
dyslexicat: ZerkBtw last song was "the world is a beautiful place &amp; i am no longer afraid to die - gig life"
gunnaren: OSFrog Mark Zuckerberg OSFrog
johnnyhotlava: @jax05_ Yeah he's still thinking RN
technicalb0y: george do you have any dotfiles repo, can i see your tmux conf file?
johnnyhotlava: lolol
nanodanger7: @technicalb0y github.com/geohot/configuration
smallest_cock: sho bobs
brizzz_: @benchai18 Javascript/Electrom
technicalb0y: @nanodanger7 thanks
johnnyhotlava: It's not defined
knilecrack: how do you detel a word between () in vim?
knilecrack: delete*
benchai18: @brizzz_ 🍻
blazelp1: What for a Monitor are u using 4K?
Lil__Slap: if you dont understand imagine what twitch chat feels like
W1lkins: di( @knilecrack
nanodanger7: @knilecrack di(
knilecrack: @W1lkins thx
Sylens__: @blazelp1 i would like to know as well
nanodanger7: @knilecrack you can di with a lot more things it means "delete inside"
trchaosTR: twitch android app randomly crashed btw SeemsGood
xRaptorz: what keyboard is he using?
W1lkins: hhkb
roxaneb_: geo looking good, but with beard even better, me thinks
xRaptorz: tyty
knilecrack: @nanodanger7 yeah just tried it
3even: Best ebook reader for programming books? I find that many butcher the code examples
UMPS: what switches
Santiago_LHC: beardless George can type 20 words per minute faster than with beard.
trchaosTR: maybe my next phone will be iphone Kappa
benchai18: Does anyone know how old he is?
W1lkins: they are topre switches @UMPS
smallest_cock: 23
Santiago_LHC: @benchai18 Google much?
18ace81: I just got there is he writing proof assistant?
trchaosTR: he is 45 years old
trchaosTR: but he got baby face
benchai18: @santiago_lhc fair enough. Minimizing Twitch pauses the stream
keepingtrckofthisacct: almost looks like it
NonTrivial778: is your linkedin a datting place ? LUL
smallest_cock: nah he can pass as 45
trchaosTR: look how focused he is
zoki_macola: Anybody built/worked with Ukkonens Suffix Tree?
Santiago_LHC: He is actually 12
benchai18: Wow he’s same age as me. Makes me feel kinda stupid TBH
gunnaren: Imagine what george can do in a day vs your averge joe programmer
18ace81: wait is he or is he not writing a proof assistant
benchai18: (His real age is same as me. Not 12 or 45)
trchaosTR: @benchai18 dont worry i dont even speak english
johnnyhotlava: What else can you translate coq to other than that demon python?
jax05_: I was about to call twitch police @benchai18
gunnaren: @benchai18 yea we expected more from you at this point *dissapointed boomer face*
benchai18: @gunnaren *sips Kale shake in shame*
trchaosTR: i am killing grammar every letter i wrote
reptil1990: @georgehotz what are you coding? or what should it do at the end?
eax_ebx: which band is playing?
18ace81: I think it's a proof assistant but I just got here and no one is answering my questions @reptil1990
18ace81: use Haskell lmao
johnnyhotlava: He's making coq proof a theorem of boolian algebra that he wants to translate to python
johnnyhotlava: De somthing
Lambda_86: use rust
gunnaren: @benchai18 *shakes head while finding essential oils to counter your behavior*
Santiago_LHC: Is Ruby still a thing?
18ace81: yeah
eax_ebx: yep
slakkur: c# is typed and you can go back to windows LUL
benchai18: @jax05_ haha. Are 12 year olds not allowed? Or can’t disclose age? I’ve been on Twitch for like a week
tfue_is_dog_shit: is java dead?
trchaosTR: 12 years cant stream thats illegal
jax05_: I think you have to be 13 lol
ᅟᅟᅟᅟ: LUL
18ace81: java is far from dead unfortunately
benchai18: @gunnaren *fondles crystal in left pocket while looking around for a safe space*
johnnyhotlava: Python DGAF what you want to write python wants to play with lego's
davidvilla700: ??
K0shpt: @tfue_is_dog_shit It should
lavastew: java master race
johnnyhotlava: Farmers insurance is currently building a brand new infrastructure on JAVA
benchai18: WE ARE FARMERS
johnnyhotlava: They are
benchai18: DUN DUN DUN DUN DUN DUN DUN
johnnyhotlava: Dorks
Santiago_LHC: Coder Farmers Ninjas
Divulger1: @georgehotz what monitor do you use?
ᅟᅟᅟᅟ: 🤔
gunnaren: @benchai18 hahahah - this is getting out of hand
smurfd0: "it is easy"
johnnyhotlava: LOL
MonkaSupreme: water water h2o
trchaosTR: i think he broke his razer laptop while playing video games
slakkur: @georgehotz where did you learn all your math skills? Did you go to college?
r00tdk: Did you buy apple watch 5 @georgehotz
18ace81: I'm very confused as to what he is using lark for can anyone explain?
trchaosTR: alien attack
johnnyhotlava: So he's done with coq now right?
mariuss18: he is like building a rocket
ZerkBtw: lmao
notelex: KKona
Santiago_LHC: @r00tdk he showed it on stream a few days ago
xyet: LET US SEE! LET US SEE!
johnnyhotlava: That's a straight up parade
nikhilr14: yo its my dream to watch ur stream live , finally came true
trchaosTR: oh 2 pm means 14.00
r00tdk: @santiago_lhc which stream
eax_ebx: Yeah, America.
neroo2k: is this still maths ? I feel stupid :P
r00tdk: Can you tell title
nikhilr14: !uptime
blazelp1: Thank god u stopped using Windows
johnnyhotlava: Fucking antlr
johnnyhotlava: well it is an upgrade
NonTrivial778: it's Mac not windows
18ace81: wait is he writing a coq implementation?
slakkur: @georgehotz did you get all your math in HS? or did you learn it on your own?
benchai18: How does @georgehotz make money? Does he have a company? Or multiple?
nikhilr14: what is he doing today?
johnnyhotlava: George is money
ZeeZaxean: he is an instagram influencer
neroo2k: @benchai18 comma ai
jax05_: lol
slakkur: comma.ai
johnnyhotlava: @ZeeZaxean lolololol
johnnyhotlava: stop
benchai18: @nikhilr14 he’s drawing diagrams
ZeeZaxean: LUL
18ace81: honestly formal logic isn't that hard to learn in that it has no preqs @slakkur
trchaosTR: have a nice day guys i'll sleep good luck @georgehotz
benchai18: @trchaostr peace
nikhilr14: @benchai18 diagrams using AI ?
jax05_: cya @trchaosTR FutureMan
benchai18: (That means bye in American)
trchaosTR: i knew it SeemsGood SeemsGood
slakkur: Hmm I'll have to see if khan academy has it, once I figure out what i can apply it too.
benchai18: @nikhilr14 nah. Diagrams about conferences.
trchaosTR: i would be happy if u accept my friendship requests @benchai18
Tal_X_Tal: yayeetP
benchai18: @trchaostr I did
18ace81: @slakkur if you want to get into proof assistants and stuff, my gateway drug was Idris, since you can also write actual programs in it
benchai18: @18ace81 my gateway drug was hydrocodone
johnnyhotlava: @benchai18 HELL YEAH BOIZE
fafws321: Turk var mı reisler
trchaosTR: oh okay cya
nikhilr14: I wish I can subscribe to him but twitch prime doesn't support in my country
trchaosTR: @fafws321 var kanka da türkçe konuşma pek SeemsGood
chexmixz: Is the title click bait or is he just using coq language?
fafws321: Kappa
johnnyhotlava: Coq at first
johnnyhotlava: Then he inserted the coq
nikhilr14: how long he been streaming
18ace81: @chexmixz no he was writing what looked like a python implementation of coq for like half a second a while ago
slakkur: I didn't see the beginning of the stream, what is george trying to do with coq, just exploring it for fun? That sounds wrong, but I'm sincere.
johnnyhotlava: He wants to put his coq into python
Tal_X_Tal: 2:56
18ace81: @johnnyhotlava basically lmao
johnnyhotlava: LOLOLOL
nikhilr14: thats been long time
nikhilr14: did his girl friend showed up today ?
johnnyhotlava: I know
montecarlo: what keyboard does george use
johnnyhotlava: Hey what's the name of the theorem though I forgot what he said it was?
Lamb03: Love ur video about exploit
nikhilr14: poison distribution theroem?
benchai18: if BBC &gt;= 9 { print “Coq is” . coq_color . “.” } else { print “Too white” }
Lamb03: What’s coq?
jagger_rsw: @georgehotz maybe we should teleport to the world where true == false
benchai18: @lamb03 About 9 inches on a good day
Divulger1: what monitor do you use
johnnyhotlava: Boolean inches
hackyhacks: negate P = P NAND P
nikhilr14: omg he just read my comment I lived my life
Jewishrambo: Any proof by contradiction ? True is false lol
montecarlo: keyboard sounds like topre switches
yaus_baus: its an hhkb
Divulger1: @montecarlo it is
0Day_H4X0rz: Hello @georgehotz and Chat from Germany
goolyio: !uptime
slakkur: I have a logitech with romer-g switches, sounds just like it, I love it too, got mx blues at the office, like my logitech more now.
knilecrack: wsupp germany serbia here
benchai18: NSNumber *coqLength
nikhilr14: is he creating his own programming language"
smurfd0: you are mentioned as streaming in /r/coq :)
0Day_H4X0rz: @knilecrack Hello
benchai18: Definitely took an addy
Divulger1: @yaus_baus do you know what monitor size does he use
johnnyhotlava: The long flowing nature of python will allow the coq he built to fit inside however pythons opening wont allow his coq in
theewbc: LIVE from the cloud!!
benchai18: @johnnyhotlava I like u. Ur crazy. But I like u
yaus_baus: @Divulger1 no clue
johnnyhotlava: @benchai18 Lol
18ace81: why is he making a sum type with only one option wtf
slakkur: wrapping coq with python...
st47ik: Kappa
benchai18: Does he take Adderall XR or regular?
nikhilr14: guys is he uisng tmux for multiple session creations?
knilecrack: What is NAT' ?
johnnyhotlava: XR or you're an addict
st47ik: @benchai18 he takes tea :)
slakkur: tmux ftw
에스엔엑스: @nikhilr14 yes
benchai18: @johnnyhotlava I know. But I grind the XR beads to bypass the time release
slakkur: I just use split in vim... I don't know tmux well
johnnyhotlava: @benchai18 lol chew them like a man
johnnyhotlava: Get em stuck in your teeth
johnnyhotlava: lololol
benchai18: @johnnyhotlava I did that yesterday in the car lol. Just doesn’t hit as well
johnnyhotlava: LOL
yaus_baus: george uber eats some chicken, its only fitting for coq stream
slakkur: I need to learn vim like george though, holy moly he's good
nikhilr14: vim split for spliting editor , tmux split for windows split @slakkur
RishabhDeepSingh: Heyy
johnnyhotlava: Chicken = False
yaus_baus: chicken bootloader asmr
slakkur: I mostly use vscode, only vim when I'm remoting. love vscode
johnnyhotlava: Real humans watch ASMR? I thought it was only bots.
homestarr: vim is for boomers
Joy_void_Joy: Don't know if this has been mentioned, but I really recommand the ssreflect add-on/dsl instead of pure coq.
NonTrivial778: username checks out
nikhilr14: guys share some of the vim commands he uses
benchai18: def growCoq: coq=0; while coq &lt; 9: coq
slakkur: I what blows my mind is watching how efficient george is using vim mode in vscode... that's crazy, atleast I think that was what he was doin.
Joy_void_Joy: (What is the definition of eqb' you're using? Just joined in)
benchai18: @georgehotz I’ll order you postmates right now just say the word. Fr
johnnyhotlava: Everybody's got their own methods for what they do to prove their own coq but he wants a pure coq
johnnyhotlava: No protection
yaus_baus: you can take the person out of vim but you cant take vim out of the person
benchai18: He’s probably studying the py3 CoqLibrary
johnnyhotlava: Vim is a cia litmus test
nikhilr14: its hard to understand stream joining in middle , Its better to wattch on youtube
slakkur: if you can prove your coq, you don't need protection
johnnyhotlava: lol
RomanNYC: Can you simpl first?
benchai18: @nikhilr14 Does he put them on YouTube
tomroxxx: tomroxxx subscribed with Twitch Prime.
yaus_baus: @benchai18 comma archive channel
nikhilr14: he doesn't coma ai will put in their youtube channerl , which is ownded by him @benchai18
Joy_void_Joy: Did you try inversion?
Joy_void_Joy: That's what you usually want to do in your case
krnflake1: what osx apps are you using? spectacle, obs, but what are the other two in your menu bar? the height icon and the mouse thing?
Joy_void_Joy: inversion H
Lambda_86: case analysis?
Joy_void_Joy: After introducing it
johnnyhotlava: Slicker than owl shit
SnakeOneMLG: !uptime
SnakeOneMLG: not on windows anymote PogChamp
exenu: not even ELI5 can help me understand wtf hes doing
slakkur: @exenu yah I'm lost
benchai18: benchai18 subscribed with Twitch Prime.
johnnyhotlava: fornicate that library
prakyath_kantharaju: prakyath_kantharaju subscribed with Twitch Prime. They've subscribed for 3 months!
dalwin401: I’m eating Spicy nuggets tryna see what’s popping up in this stream
montecarlo: monkaS
st47ik: earthquake?
LazyAfternoons: monkaS
exenu: he's talking to us like we understand what hes saying
johnnyhotlava: you don't go look guys that's who goes first
johnnyhotlava: Safe room
torlkhal: WHAT THE PLAN
johnnyhotlava: @dalwin401 those nuggs are not safe
benchai18: @lazyafternoons Can you exblain what monkaS is
johnnyhotlava: lol
LazyAfternoons: Are you typing on a Topre keyboard?
psychicside: @benchai18 monkaS
LazyAfternoons: @benchai18 It's an emote used to express tension
LazyAfternoons: I think it used to be part of Twitch standard emotes
johnnyhotlava: That has been linked to "stuff" allegedly
psychicside: newfags LUL
Joy_void_Joy: Is proving that eqb' x y &lt;-&gt; x = y off limit?
benchai18: @lazyafternoons 😘
MDSZilla: @LazyAfternoons I've heard he uses HHKB
johnnyhotlava: Gewgle it
LazyAfternoons: @MDSZilla Seems that's the case, Torpe switches for sure
LazyAfternoons: Topre*
benchai18: PrimeRlyTho
slakkur: dang, I need to catch this on youtube so I can see the beginning when he explains why he's trying to do with coq... jesus how do I say this without it sounding wrong
krnflake1: sry to ask again: what osx apps are you using? spectacle, obs, but what are the other two in your menu bar? the height icon and the mouse thing?
G0NERZ: hi
benchai18: He’s trying to disassemble coq
psychicside: but why
smurfd0: https://stackoverflow.com/questions/47523376/coq-true-false-discriminate-fails-no-primitive-equality isnt that something like what u are trying todo..
psychicside: go to the shelters monkaS
jax05_: they're coming for you george
averagesizepens: where is the robot girl?
st47ik: NotLikeThis
johnnyhotlava: Construction &amp; parades as well as coq insertion
HS_SemenThrower: ggwp
averagesizepens: LUL
dorkmo: from north korean subs?
johnnyhotlava: Hardcore
nikhilr14: he looks shit scared of earthquake or terrorist attack
ProfessorMagikarp0: luxxGun
ImpalerV: LUL
psychicside: see you next life @georgehotz Kappa
knilecrack: everytime you type destruct one more bomb explodes
TopicOffic: hey yo georgie ahaha
prakyath_kantharaju: you banned North Koreans, they are attacking cali now.
G0NERZ: hack live mrdang3rAim
johnnyhotlava: @knilecrack direct correlation
johnnyhotlava: He's DOING IT
TopicOffic: he's hacking the code
johnnyhotlava: lol
johnnyhotlava: That's not a knife
1garo: wow
nikhilr14: North koreans trying to take out him
johnnyhotlava: THIS IS A KNIFE
prakyath_kantharaju: shit singularity is here guys
johnnyhotlava: @prakyath_kantharaju I'd hope it's faster
knilecrack: his destruct has delay
johnnyhotlava: slow agony is B.S
Sznurek066: George Hotz is playing "Welcome to the game" irl. LUL
benchai18: Is there a single person here that knows what he’s doing?
MDSZilla: @benchai18 read the title LUL
torlkhal: thats a user freidnly languague
averagesizepens: o persons includin george
johnnyhotlava: Like a glossy moronic overview sorta like how I know the sun is hot
benchai18: @mdszilla I did. Doesn’t help
benchai18: I’m just here for the coqs at this point
MDSZilla: @benchai18 Well that's what he's doing.
3even: @benchai18 google coq language
torlkhal: whats the big picture
johnnyhotlava: Jusssst had to do his own library
G0NERZ: mrdang3rThink
johnnyhotlava: Chicken ='s ass
slakkur: I'm not enjoying the coq, it's too hard
Joy_void_Joy: I don't know that this can be done by hand
Joy_void_Joy: In ssr, you'd just define your induction differently
Joy_void_Joy: And in vanilla Coq, use inversion, because it relies on binding done by the inductive definition
st47ik: WutFace
averagesizepens: attack inc
Phantomhive_: coq files redux?
johnnyhotlava: Oh that's a jet
johnnyhotlava: There's a few special forces outposts don't worry
st47ik: air force drill?
johnnyhotlava: They just get real erect around there
RishabhDeepSingh: codeforces.com went under DDSOS @georgehotz
HS_SemenThrower: change title to: paranoid kid on ritalin
benchai18: @johnnyhotlava wasn’t the coq too large for that memory address? I think coq type is “long long” but he’s trying to store coq as an int
3even: Navy exercise
MDSZilla: @georgehotz I saw a interview of you on Youtube, In which you said OS and Compiler were the best classes you ever took, In what way did those classes help you improve and learn more about the backend working
psychicside: It is Kappa
Erciks: i dont know but someone did got shot
whitsyerhing: I don't think he washed his hands boys...
johnnyhotlava: @benchai18 lololol
johnnyhotlava: stupid
averagesizepens: mexico taking san diego back
johnnyhotlava: love you
benchai18: 😇
Joy_void_Joy: inversion
ortunado: Happy Birthday on ur 30 bud FeelsBirthdayMan
Joy_void_Joy: inversion H. I mean
johnnyhotlava: Yeah just switch to "vanilla" fuck all that library boner work
johnnyhotlava: or something
RomanNYC: @georgehotz if you do "Show Proof." you can see that it does some pattern matching on eqb'
RomanNYC: (after doing inversion)
benchai18: def coqInversion: gender == “trans”
MDSZilla: I saw a interview of you on Youtube, In which you said OS and Compiler were the best classes you ever took, In what way did those classes help you improve and learn more about the backend working, since I just started college and really do want to learn the development process and nerual networking.
johnnyhotlava: Lernin?
Foxhaulin: What’s up George, hope you are doing good
Divulger1: what monitor size do you use @georgehotz
Joy_void_Joy: Ltac is really unusable yeah...
johnnyhotlava: Learning that nice interface
st47ik: oh god WutFace
chaprio1: monkaS
knilecrack: they defined everything from begging so ti was easy for them
benchai18: if isSet(coq.inversion) gender = “trans”
johnnyhotlava: LOLOLOL
johnnyhotlava: Stop it
benchai18: Ok ok
giorgostheo97: The f macbook is that ?
johnnyhotlava: That was really good for me
johnnyhotlava: at least
kluo84: is it earthquake ?
benchai18: @johnnyhotlava it was for u
johnnyhotlava: @benchai18 I'm still laughing at it for some reason
Santiago_LHC: THere's a marching band outside
RomanNYC: I'm pretty sure inversion pattern matches on the proof state to get the constructor that created the expression of type eqb'
ardzybro: Which MacBook Pro you using and what are the specs
nexscion: !uptime
Santiago_LHC: People obssesed with hardware and specs
Joy_void_Joy: Seeing how you defined eqb', I don't think you can do it by hand?
Joy_void_Joy: Because you rely on binding both parameters to the same value
nanodanger7: @Santiago_LHC honestly these questions are getting so boring :D I wish George would add a bot so we could make command for FAQs
Santiago_LHC: !keyboard
johnnyhotlava: I feel like that episode of it's always sunny when charlie thinks he can speak Chinese
nanodanger7: yeah that's not gon work
Santiago_LHC: should be the main one
knilecrack: what matters that is works
Santiago_LHC: Exactly
r1ppyd1ppy: ffs guys. HHKB2
Lambda_86: im 90% sure based on his typos that he uses dvorak
johnnyhotlava: People actually use dvorak?
nanodanger7: yeah but HHKB 2 guys you'll become an 10x engineer instantly
johnnyhotlava: for real
nanodanger7: buy*
metasudo: He uses one of those default logitech bluetooth keyboards
jax05_: lol
HS_SemenThrower: oh don't forget to sell coding gloves
abk467: i believe it. i'll take 10
ProfessorMagikarp0: ^
johnnyhotlava: @HS_SemenThrower lol
Longboolean: Fischer price lern to type keyboard Kappa
giorgostheo97: Is it Dvorak tho?
beltez: Hi George
metasudo: Sell me engineering enlargement pills,
Santiago_LHC: Also, we need his chair, don't forget the chair.
johnnyhotlava: I'm packing actual crystal meth into tubes and selling them as 10x addy xr.
prakyath_kantharaju: Yep that works, justy like razer you can sell Geozer
MDSZilla: georgehotz when you started your journey for programming what sort of projects did you do at start to learn?
johnnyhotlava: "programmers"
ooMariaoo: ouu
benchai18: @johnnyhotlava Can I get a sample?
johnnyhotlava: @benchai18 I GOCCHUUU
Erciks: programmer socks best socks
Santiago_LHC: Programming phylosophy
johnnyhotlava: Say yo coq it aint true
nanodanger7: you
MDSZilla: Use a if statement? Kappa I'm still learning C im new to this world
johnnyhotlava: Hey coq listen up
amuzinc: @georgehotz did you watch the buzzard talk?
benchai18: @johnnyhotlava I haven’t smoked tweak in 4 yrs. Haven’t shot it in 3 lol 😆
nanodanger7: you'll also need to buy a razer laptop and then sell it after a few months on ebay
Santiago_LHC: if not true then false
johnnyhotlava: @benchai18 lolol
johnnyhotlava: Plug it
johnnyhotlava: direct injection
johnnyhotlava: save the liver
benchai18: Dude it burns
benchai18: I have lol
johnnyhotlava: lol
johnnyhotlava: killing me
MrMarkFilaroski: Why is everyone Go unfriendly?
Santiago_LHC: I like Go, but the game
MrMarkFilaroski: @Santiago_LHC yeah.. I get it
metasudo: all have succ real
MrMarkFilaroski: Kafta Go?
knilecrack: Go is nice
johnnyhotlava: @benchai18 water soluable vegetable caps my man
nexscion: what's an inversion?
amuzinc: @georgehotz will you make a better lean
johnnyhotlava: Error: We don't actually provide the freedom of definition we pretend to.
Joy_void_Joy: Well, if you're okay with proving eqb' x y -&gt; x = y, then you can just use trivial. But maybe it's using built-ins you want to avoid
Sylens__: !monitor
Joy_void_Joy: Inversion just checks how a term could have been constructed, it works it "backward"
metasudo: Is that your bed to your right?
Lambda_86: simpl
preporyan: !uptime
Joy_void_Joy: You can't compute a Prop
speeddrawing101: !uptime
Joy_void_Joy: It has to be a set
Joy_void_Joy: You can make a function on bool, that check if they're equal
johnnyhotlava: Joy is so erect
Joy_void_Joy: Sorry, tell me if I'm backseating too much :D
MDSZilla: Inb4 Joy_void_Joy made Coq Kappa
benchai18: @johnnyhotlava It’s not enough lol. Once u turn to shooting, nothing else compares. Good thing I cut all that shit out a few years ago 😅 ... life is way more stable now (albeit kinda boring)
thekillerens0: Yo
metasudo: look at the big brain on joy
thekillerens0: Hi
johnnyhotlava: @benchai18 awesome man that's a good life choice
zoki_macola: we will call him Big Brain Joy
benchai18: @johnnyhotlava thanks bruh
MDSZilla: Compare two of those things if they're same its true if they're not its false?
Nnotm: Have you looked at agda at all?
jax05_: @benchai18 congrats dude
Joy_void_Joy: Well, like you could do this: Definition eqb x y := match x, y with |true, true =&gt; true |false, false =&gt; true |_, _ =&gt; false end.
Joy_void_Joy: Oops, no return
benchai18: @jax05_ Thank you ☺️
benchai18: Did you guys know that “bool-bool” means dick in Hebrew?
Joy_void_Joy: And then, you'd be done
Nnotm: so that would be the conventional ==?
solitaryyy: What is `.g` extension?
MrMarkFilaroski: This is better than sex
Nnotm: -&gt; is more like implies, not equals
Sylens__: @georgehotz what 4K monitor do you use?
archeadis: @georgehotz did you stop using tiling wms?
Santiago_LHC: Enough with the hardware questions!
Joy_void_Joy: So it'd be eqb' x y &lt;-&gt; eqb'' x y?
benchai18: @mrmarkfilaroski I just sent a dev friend of mine a link to this stream and I wrote “watching this guy work makes me stiff”
Erciks: i think i understood something
benchai18: @erciks I’m jealous
MDSZilla: For those asking questions about hardware and stuff, Visit georgehotz Instagram he posted a pic of his setup
MDSZilla: Hopefully you guys can scout out what he uses there
jax05_: and don't forget to follow
Santiago_LHC: https://www.instagram.com/georgehotz/
johnnyhotlava: My girl thinks Jorge is handsum
Santiago_LHC: Setup: https://www.instagram.com/p/Bx0DMrUAxE-/
MrMarkFilaroski: Hardware=Firmware= why do I buy my Athena's from Sweden? haha
Sylens__: @santiago_lhc why you so salty about the questions
MrMarkFilaroski: @benchai18 LUL jeffgrossCu fintFINGERS
Santiago_LHC: @Sylens__ I'm not salty, I'm annoyed by the same noob questions every 10 seconds.
Santiago_LHC: Who freaking cares what monitor does he use
Sylens__: @santiago_lhc deal with it ppl are new and not aware
MrMarkFilaroski: antenna's*
MDSZilla: Santiago_LHC you dont have to reply :)
Sylens__: Ikr
Santiago_LHC: The point is that it doesn't matter.
MDSZilla: george has his instagram linked below those who have common sense would visit his instagram and look there instead of asking it in chat before checking.
johnnyhotlava: It's the secret to becoming great is mimicking accessories. Nike has built a business on that
benchai18: What kind of desk do you use? And what sort of mouse pad?
johnnyhotlava: Faulty human circuits
jax05_: lol
MDSZilla: benchai18 Ikea LUL
Santiago_LHC: HEY GEORGE; WHAT AIR DO YOU BREATHE
benchai18: Lol
Sylens__: Yeah okay
Joy_void_Joy: apply eqb_refll?
Rtc_ti5: !
faulpelzz: Perrieair
jax05_: lmao
zoki_macola: Macbook Air
Luccaasss: what is he doing?
MDSZilla: at this time this false false = true and true, true = true is making me thing of Quantum Computing
benchai18: DO YOU USE A NUTRI-BULLET OR NINJA BLENDER?
nanodanger7: we should just go back to the old days when asking about keyboard and shit was bannable :D
johnnyhotlava: Kuwait is the world leader in coq inversion
benchai18: Lmao
johnnyhotlava: Slap chop
Joy_void_Joy: You always use function if you can, instead of Inductive properties, because you can just compute them :D
benchai18: I think @johnnyhotlava is my long lost brother
essSau: hi
johnnyhotlava: @benchai18 Gotta be
Santiago_LHC: The word keyboard should be an auto-ban
johnnyhotlava: lol
SHREKonVHS: my name gay
nexscion: damn then you just got banned
benchai18: @santiago_lhc  1
Santiago_LHC: OH NO
MDSZilla: Move on from hardware talks dont drag it
SHREKonVHS: ur mom nama jef
SHREKonVHS: ur mom nama jef XD
johnnyhotlava: Hardware is so last week
Joy_void_Joy: You can?
benchai18: Santiago, do you work at CERN?
Joy_void_Joy: You can just compute it
SHREKonVHS: hack the mainframe you idiot
SHREKonVHS: enhance
Sarkin_dota: Must be nice stroking coq code on that keyboard
johnnyhotlava: Well "large" is relative so
Santiago_LHC: @benchai18 Nah, just a fan of colliding particles
johnnyhotlava: He could work on a colider anywhere
benchai18: @santiago_lhc sick
jagger_rsw: @georgehotz coq is so-so, why won't you try to find some vulns in the fabric of the universe, and we'll all escape to the  1
benchai18: Large Hadron Coqllider
johnnyhotlava: lol
MDSZilla: Chat has activated its Meme Mode FailFish
Sarkin_dota: hardon
Joy_void_Joy: wait, why do we want to prove that again?
Joy_void_Joy: like, what's the endgoal
benchai18: @sarkin_dota Damnit. You win
Joy_void_Joy: I mean
Santiago_LHC: Large hardon collider. That's a drinking game somewhere
IEEKl: anyone in chat, macbook pro or new surface laptop for programming?
Joy_void_Joy: If you want to prove eqb' x y, you now can do eqb'' x y
Justanotherantiantiplayer: @IEEKl x230
Joy_void_Joy: That's just the idea behind it
johnnyhotlava: CLack book bro 32 cm
xxdvxx: pro for sure @ieekl
benchai18: @joy_void_joy is the only person that knows what’s happening
okkessh: do we want to prove other things using our theorem once we prove it ?
Santiago_LHC: You can program on the shittiest of computers @IEEKI so pick the one you like the most
Nnotm: haven't done anything with coq in a long time but it seems like you might need decidable equality for proving something like this
Justanotherantiantiplayer: i like when its exiting for a minute ( ͡° ͜ʖ ͡°)
MDSZilla: Joy_void_Joy you seem like a person who has been experimenting with coq and has been programming, I'm just getting started could you tell me what sort of projects you did on your own while learning
johnnyhotlava: Joy has a superior imminens fronti pontificis
xxdvxx: interesting you're not using window manager
annasgrasshopper: coolest guy on the tech industry
SHREKonVHS: im gay
jay_al97: you're on mac today?
benchai18: @shrekonvhs Checks out
jax05_: jfc
knilecrack: what do you need?
fSyLyndon: @SHREKonVHS hi gay im dad
IEEKl: or i maybe asked the question wrong, why is macbook pro better? (cuz it seems like many programmers prefere a ios but i have always coded in windows) @xxdvxx @Santiago_LHC
Tsuisekii: !time
mexeroserisback: any opinions on Lear vs Coq?
annasgrasshopper: use linu
annasgrasshopper: linux
whichtom: cmd tab?
Justanotherantiantiplayer: @IEEKl did you just say ios?
johnnyhotlava: you guys have os's?
tfue_is_dog_shit: this is the best twitch channel i have ever watched
jax05_: lol
Santiago_LHC: @IEEKI If you want to make apps for iOS, having a Mac would make sense. But if you are used to Windows, no reason to switch.
johnnyhotlava: I'm doing this by hand
MDSZilla: 1 is not 0 but 0 is 1 ?
SHREKonVHS: im the creator of the checkm8 exploit ama
Nnotm: maybe you really shouldn't destruct? Seems like if you have eqb' x y, you should be able to get eq_refl out of that whole thing, which proves that x and y must be equal
jrrbls: !online
Justanotherantiantiplayer: @johnnyhotlava im just saying xkcd 378
knilecrack: ls
knilecrack: ups
benchai18: @shrekonvhs wen A13 eta son
IEEKl: @Santiago_LHC ok
Froopyland: @tfue_is_dog_shit you come from fortnite? you got a long way ahead
Nnotm: IIRC those are for using specific tactics like induction
puffnfresh: I love it when you stream Coq
jax05_: @IEEKl you should get a feel for coding on different platforms and pick what you like best.
Lambda_86: i think discriminate uses eq_ind
tfue_is_dog_shit: @Froopyland no i am html programmer
johnnyhotlava: @Justanotherantiantiplayer I mean I'm using a pencil that's high level shit llol
Joy_void_Joy: eqb'_ind is an induction lemma
puffnfresh: prop is proposition?
FaustPetrovich: @tfue_is_dog_shit yeah, it’s the best channel, but sadly he is more concentrated on his instagram career
Joy_void_Joy: On nat, it would be peano's induction
nanodanger7: html is not a programming lang bro
benchai18: Guys I’ve been sitting on the toilet for like 2 hours on this chat
Bagofpotatoes: Reit?
Froopyland: tfue plays fortnite right? anyway, coding channels are pretty good and geo's one of the best imo
benchai18: Legs are numb frfr
nexscion: why is coq so confusing?
Santiago_LHC: @benchai18 commit that shit already
Justanotherantiantiplayer: @Santiago_LHC LUL
puffnfresh: I really like Agda for proving
IEEKl: @jax05_ yeah i guess but i feel like if you buy one apple product then u kinda stuck in the apple ecosystem
Bagofpotatoes: Idris seems nicer than this
Joy_void_Joy: @nexscion Because we purposefully disabled everything to make it less so :D
benchai18: Can I make a coq pull request
johnnyhotlava: YES
jax05_: @IEEKl not necessarily. I like having both tho
johnnyhotlava: Forbidden fruit ecosystem
johnnyhotlava: Lower dimension products
jax05_: @IEEKl it's just that most people prefer unix based systems so that's why they say mac or linux. it's less bulky than windows
Demografixx: what are you doing ?
okkessh: isn't coq an unfortunate name ?
johnnyhotlava: Python don't want it
tfue_is_dog_shit: who you chose python
puffnfresh: what's the goal?
tfue_is_dog_shit: why*
benchai18: Anyone interested in UFO’s? Cmdr Dave Fravor was on Rogan yesterday. Worth watching
Santiago_LHC: so many existencial questions
puffnfresh: @okkessh it means chicken
johnnyhotlava: @benchai18 haven't finished it
benchai18: Same
IEEKl: @jax05_ true
benchai18: Lol he said coq
Joy_void_Joy: It would be easier to understand them if you checked bool_ind
Justanotherantiantiplayer: @IEEKl just use what you have or what you can afford. learn to code dont worry about "right" or "wrong" os, language, tool etc. When you figure out what you are interested in switch to the best tools for that
Joy_void_Joy: Or nat_ind
Lambda_86: i believe eq_ind is used for induction and eq_rec is used for recursion
Joy_void_Joy: They are induction lemma automatically generated
okkessh: @Joy_void_Joy are you involved in coq project in any way
xEHLE_: @Joy_void_Joy did you write coq or something?
puffnfresh: I have never seen someone write Coq without something like Proof General
jax05_: we got a coq expert in here fortunately
Joy_void_Joy: I did not, I just played with it a lot :D
Joy_void_Joy: I am trying to make a very intuitive version of Coq
IEEKl: @Justanotherantiantiplayer yeah i have coded for 5 years, but i have always coded in windows, and i have never felt the need of running another os
Bagofpotatoes: what's proof general?
johnnyhotlava: Joy's ever expanding cerebrum
Joy_void_Joy: But it's way in the early stage right now
okkessh: just dont say 'I played with coq' outloud
puffnfresh: it's like an IDE for Coq
xEHLE_: well, gl with that
benchai18: @johnnyhotlava accept my friend request. I’ve been seeking you out for 30 years I don’t wanna lose u now
Joy_void_Joy: @okkessh Just realised after typing it, oops
jax05_: tehe
Justanotherantiantiplayer: @IEEKl then just keep doing what you like. if you want to learn about another os i would go for linux just because its free :P
johnnyhotlava: @benchai18 we are united
Initial18: @puffnfresh Is it a big Coq IDE?
Justanotherantiantiplayer: and personally i like it the most :D
okkessh: @Joy_void_Joy no worries we are all clean minded people here
johnnyhotlava: Joy is pure
jax05_: linux mint is a good flavor for those switching from windows imo
johnnyhotlava: as the driven snow
IEEKl: @Justanotherantiantiplayer haha yeah i guess
Midooriya10: can we use kali as daily driverm
Midooriya10: ?
benchai18: @joy_void_joy was in Nickleback at some point
jax05_: you could lol
Lambda_86: i also tried to make a coq clone but it didn't end well lol
chocolatechp: geoooorge
Joy_void_Joy: (If you want to make it easier, you can just change the inductive to specific case. But if you want the general version with x, I don't see how to do it without equalities)
johnnyhotlava: @benchai18 confirmed
imcraxo: !faq
johnnyhotlava: Bassist
benchai18: @johnnyhotlava knew it
puffnfresh: is Prop is a Set? I can't remember
johnnyhotlava: coq don't know shit
Joy_void_Joy: Nope, Prop is different from Set.
Lambda_86: Prop is the type of propositions and Set is the type of values
Lambda_86: so yeah different
jagger_rsw: @georgehotz why sticking so much to the boolean arithmetic? :) just use the one where true == false
Joy_void_Joy: Basically, the difference between the two is that you can "see the value"
myaocat: true == !false
puffnfresh: thanks @joy_void_joy @lambda_86
puffnfresh: ah interesting!
myaocat: you are doing it wrong! true == !false
imcraxo: where is he programming
johnnyhotlava: He's rock hard for boolean arithmetic cause he wants to make AI look at itself
Nnotm: https://github.com/coq/coq/wiki/Prop_or_Set gives some reasoning on which you should choose, though doesn't explain that well what they actually are
Joy_void_Joy: If I give you 1, or 2, you can see how I constructed them. If I give you a proof that 1 &lt; 2, you are not allowed to "read how I made it"
Joy_void_Joy: You just know it is true
puffnfresh: "true == false -&gt; Void"
jagger_rsw: I wonder if what he's doing right now is related to quantum, AI and blockchain
puffnfresh: good explanation, thanks @joy_void_joy
Joy_void_Joy: most welcome :3
luuwa_: Hi guysss
jax05_: joy is actually helping me understand wtf is happening lol
johnnyhotlava: Joy is a godsend
jagger_rsw: @jax05_ geohot is creating a new cryptocurrency
myaocat: 1 1 = 2
puffnfresh: I can do that proof in Coq @myaocat
luuwa_: 1   1 = 1
jax05_: The internet has ruined my trust in ppl @jagger_rsw
puffnfresh: that's about the limit of my Coq skill
myaocat: @puffnfresh can you do a research why 1   1 == 2?
okkessh: I mean I think false is both a prop and a set
okkessh: it is both a value and a prop
Joy_void_Joy: So you want a property that takes two parameters, a bool, and a proof that this bool "eqb'" true
Joy_void_Joy: proposition*
Joy_void_Joy: I'm not saying you want to use induction
Joy_void_Joy: But they are easier to read
luuwa_: Category: Basic Programming ..ss.s.s.s
Joy_void_Joy: In the case of bool, it is equivalent to a case
myaocat: Pog
Nnotm: luuwa_: true not equalling false does seem fairly basic to me
luuwa_: idea is basic bro
Nnotm: do you have to intro it?
johnnyhotlava: Flowers for johnny
puffnfresh: I've done "true = false -&gt; Void" in Agda and Idris, it is pretty easy once you figure out to express it that way
puffnfresh: is that what we're doing in Coq?
johnnyhotlava: IF THEN
Joy_void_Joy: Well, it'd be waaaaaay easier if we were doing true = false @puffnfresh
okkessh: @Joy_void_Joy how is the the keyword false is a prop I am having a hard time
Joy_void_Joy: Or using a specific instance of eqb'
puffnfresh: what are we doing instead @joy_void_joy ?
johnnyhotlava: If it's true well coq guess the fuck what IT AINT in this one case where we're talking in snake language.
Nnotm: it seems like that's basically what we're doing though? eqb' is basically a non-polymorphic version of =, and "not" seems like it should be defined in terms of "-&gt; False" but I'm not sure
Joy_void_Joy: @puffnfresh We are proving ~(eqb' true false) with a self made inductive definition
Joy_void_Joy: But the problem is that this definition tacitally use equality
indigolord: what syntax are we writing here?
Joy_void_Joy: And we don't want to use anything about equality
Joy_void_Joy: So I don't know if we can do this
johnnyhotlava: He's trying to get coq to work in parseltongue
indigolord: Wtf is this lang
Joy_void_Joy: @okkessh I did not get the question
Joy_void_Joy: Basically :d
Nnotm: puffnfresh if you didn't see it, the type of the actual theorem is "not (eqb' true false)"
firstavegner: What’s that language?
okkessh: @Joy_void_Joy george said fasle is a of sort prop
Nnotm: firstavegner Coq
Joy_void_Joy: False is "of type" Prop
puffnfresh: which is simplified to eqb' true false -&gt; False right?
Nnotm: puffnfresh I believe so, but I'm not sure
Joy_void_Joy: It's important to make a difference between "instance of" and "of type"
okkessh: @Joy_void_Joy I see but isn't the meaning of props is that you prove them with other props
puffnfresh: eqb' looks like what?
Joy_void_Joy: Prop just mean the type
Nnotm: puffnfresh IIRC it's a non-polymorphic copy of the definition of =, but there may be a few minor changes
Joy_void_Joy: It just mean that it's a term you can construct?
Joy_void_Joy: So False is "of type" Prop
Joy_void_Joy: Even though you can't construct it
Joy_void_Joy: Does that make sense?
johnnyhotlava: Is that how they want you to construct terms?
okkessh: @Joy_void_Joy I get it but it doesnt make that much sense
puffnfresh: seems like this should be easy then...
Joy_void_Joy: @Nnotm That is exactly right
okkessh: like you prove something with a theorem that is of type prop and thats cool
Joy_void_Joy: @puffnfresh It would, if we were allowed to use anything about equality
puffnfresh: @joy_void_joy why can't we discriminate, each case seems trivial?
johnnyhotlava: So you sayin dis parseltongue is elitist
firstavegner: Seems like logic set and theory stuff
Joy_void_Joy: @puffnfresh The problem is that the definition use binding
benchai18: Try a coq block of code
johnnyhotlava: lol
Joy_void_Joy: eqb'_refl x: eqb' x x
Joy_void_Joy: So we're using the fact that it's the same x
Joy_void_Joy: But George doesn't want to use anything about equality
puffnfresh: @joy_void_joy can't we case on the x?
johnnyhotlava: you want your coq to have a non linear plot up the x axis so that it can reach the post labeled spot "G"
jagger_rsw: @georgehotz what were you watching recently on netflix?
Joy_void_Joy: Well, that's kind of what inversion is doing
puffnfresh: alright cool, I'm catching up
firstavegner: Can you define a “==“ in qoc ?
Joy_void_Joy: But you can't case directly on it, because it's a Prop
Nnotm: firstavegner yes
Joy_void_Joy: If we were using Set, I think it would be way easier
johnnyhotlava: Banned
puffnfresh: let's use a Set
Joy_void_Joy: (Don't take my word on it, checking that)
johnnyhotlava: lol
benchai18: Where is Santiago?
joker2k999: LUL.
mkdrmnd: !uptime
johnnyhotlava: @joker2k999 Glorious
okkessh: the data type boolean is of type set
joker2k999: he's a sub dorkmo
Joy_void_Joy: I meant eqb
Sarkin_dota: What did he say
joker2k999: scratch that.
okkessh: are you sure false is a prop when the data type boolean is of type set
Joy_void_Joy: But I was mistaken, forget the part about it being easier
okkessh: I am confused
puffnfresh: eqb is a Type right @joy_void_joy ?
Joy_void_Joy: Yes
puffnfresh: not a Prop
Joy_void_Joy: @okkessh Yes, false is a bool, but False is a Prop
Santiago_LHC: @benchai18 what happened
Joy_void_Joy: You cannot
johnnyhotlava: redefine it
okkessh: but bool datatype is of type set
benchai18: @santiago_lhc someone asked about keyboard. We needed u
Santiago_LHC: I should be a mod.
Joy_void_Joy: You are saying "all booleans are true"
puffnfresh: trivial.
Nnotm: okkessh there's a difference between false and False
Joy_void_Joy: Which is not true
johnnyhotlava: chanj da rools
Lambda_86: how about just using discriminate on a version of the proof that has the standard library's =, then copy-paste the lambda expression from printing it and modify eq to eqb'
3FXX: @georgehotz How do you maintain your cognitive skills like non-stop 6-7 hours?
benchai18: Meth
johnnyhotlava: ICE
fafws321: Cocain
benchai18: Glass boiii
Lambda_86: use Print
johnnyhotlava: High speed chicken feed
okkessh: @Nnotm what is the difference between to falses
johnnyhotlava: that plexi
benchai18: IV Bath salts
johnnyhotlava: from the nexty
HS_SemenThrower: @3FXX drink iced tea then chew on the ice
Joy_void_Joy: @okkessh false is a Bool, and Bool is a Set. Set is the set of all constructible terms. Prop is the set of all terms that exists
benchai18: Glass in a pookie son
Joy_void_Joy: And Type is the type of all of this
3FXX: @HS_SemenThrower what :D
johnnyhotlava: lololol
Nnotm: okkessh I'm not too familiar with Coq terminology, but more or less this: bool is a Set that has two elements, true and false, whereas False is a Set that has 0 elements
puffnfresh: destr??
Lambda_86: Print true_is_not_false.
puffnfresh: destruct?
ボズシフティー: tyvm for the ps3 jb back in the days !
Nnotm: okkessh false is the boolean value you'd find in many other programming languages whereas False is a logical proposition
puffnfresh: puffnfHS
okkessh: @Nnotm oh I see now
okkessh: so False is the already proven prop that is already there
puffnfresh: NICE
johnnyhotlava: That level
Joy_void_Joy: False_ind is just contradiction
puffnfresh: FALSE INDUCTION
Nnotm: okkessh well - the point behind False is that you *cannot* prove it, and the reason is that the elements of a proposition are no proves
HS_SemenThrower: bet he not gonna wash his hands now look
Joy_void_Joy: It allows you to say "if I have False in my hypotheses, I'm done"
zoki_macola: poor neighbors
Nnotm: okkessh I meant "are the proofs", pressed enter too early
johnnyhotlava: He has cellophane over his board of keys
HS_SemenThrower: NotLikeThis
chocolatechp: did u just go inject cocaine
benchai18: Lol nice terminology. You almost got banned
Nnotm: okkessh and False has no elements, i.e. has no proofs
johnnyhotlava: Plugged a lump of that firey ice
puffnfresh: Coq the code generator
benchai18: @johnnyhotlava is a true wordsmith
Sznurek066: LUL
3FXX: thats how he maintains, i get it now
oyAli: you back on macOS?
fafws321: Ökkeş çok zorlama be
benchai18: Mix it with that tar. Next level bruh
Santiago_LHC: coqaine
johnnyhotlava: @benchai18 only you my friend lololol
johnnyhotlava: that midwest rollercoaster
johnnyhotlava: lololol
benchai18: 😁
johnnyhotlava: that arkansas up down
benchai18: Went from speedballs to goofballs
johnnyhotlava: or any other bad places I could think of
benchai18: Lmao
johnnyhotlava: lololol
puffnfresh: refl is a=a
benchai18: That ozark cocktail
johnnyhotlava: lolololol
Joy_void_Joy: You defined it
johnnyhotlava: That louisiana lump
oyAli: cmon georgie
benchai18: Lmao
ferrahs: True === false
puffnfresh: ship it @ferrahs
benchai18: I wish Theo Von was in this chat
ferrahs: @puffnfresh to the mooooon
johnnyhotlava: True = False but only when we boolin
johnnyhotlava: in only he were
dorkmo: dorkmo gifted a Tier 1 sub to Lambda_86! They have given 4 Gift Subs in the channel!
Joy_void_Joy: They are using eq_ind to do the binding, that's clever
Sznurek066: Pog
ferrahs: !uptime
kroanke: @ferrahs
kroanke: 4.38
ferrahs: if (userInput = “!uptime”)
benchai18: HAHAHAHHAA
Sarkin_dota: lol
benchai18: @santiago_lhc
ferrahs: @muhhn OMEGALUL
faulpelzz: lol
moonify: How long have been he streaming?
yaus_baus: since like 10am western
kroanke: i was laughing so hard when you got timed out @muhhn
yaus_baus: big boy stream
Santiago_LHC: @muhhn because keyboards don't matter
ferrahs: @muhhn monkaS
benchai18: God damn I’m crying lAughing
ferrahs: @muhhn it’s a MacBook Pro keyboard
chocolatechp: its the logitech 10 dollar keyboard
benchai18: Dvorak
benchai18: I am dvorak
ferrahs: What is he actually programming? Someone fill me in
mexeroserisback: D: no its not
yaus_baus: go to dvorak and lose all vim mappings
yaus_baus: no thanks
benchai18: @muhhn jk. I don’t use Dvorak nor do I have aids yet
mexeroserisback: Dvorak was an ingenious composer wtf
puffnfresh: needs to take a second parameter?
puffnfresh: your fun?
UMPS: @benchai18 (yet)
Joy_void_Joy: @ferrahs He is trying to understand a language named Coq by being the most minimalistic possible
benchai18: I’m very careful with my words
Santiago_LHC: it's apple
benchai18: Guys I dno how emotes work. I can’t make my own unless I’m a streamer, correct?
ferrahs: @joy_void_joy what is Coq? Is it based on another lang? What lang is it similar to?
ferrahs: @muhhn rip
Nnotm: its syntax is based on ML
ferrahs: @benchai18 yeah
benchai18: @muhhn 10 min starting now
faulpelzz: bwahahaha
Joy_void_Joy: eq_ind allows you to switch a term. So if you want to prove P x, and you know that x = y, you can use it to change the goal to P y
ferrahs: @muhhn just whispered me saying he’s crying :( rip
Santiago_LHC: F
benchai18: Poor @muhhn
puffnfresh: it's a formal verification tool
drivewaycam: !uptime
puffnfresh: proof assistant
Joy_void_Joy: @ferrahs It's a proving language. It is not really a programming language, because you never run it
Joy_void_Joy: You just compile it
Santiago_LHC: @driveawaycam 4 hours 43 min
ferrahs: @joy_void_joy oh, so what’s it’s application?
benchai18: @joy_void_joy so what’s the point? Is this like an existential thing
drivewaycam: @Santiago_LHC ty
puffnfresh: there's proof extraction so you CAN run it but almost nobody in the world does
johnnyhotlava: He gonna make python do the work
drivewaycam: i love python
Palohdire: Palohdire subscribed with Twitch Prime.
Joy_void_Joy: Because it allows you to prove things
benchai18: @georgehotz is the Robert Frost of coding
puffnfresh: @benchai18 for proving things
johnnyhotlava: @drivewaycam No you don't
Joy_void_Joy: Like 1   1 = 2, and you'll be sure of it
johnnyhotlava: lol
drivewaycam: trust me man, i love it @johnnyhotlava
johnnyhotlava: Parseltongue
benchai18: @johnnyhotlava hai ahasee yeth?
johnnyhotlava: lolol
dyslexicat: true = false
Santiago_LHC: True is just a word
puffnfresh: true = false
thuganalyst: true == false
okkessh: maybe everything is true
Nnotm: (False -&gt; True) -&gt; False sounds like it should be provable, in principle
ferrahs: true === false ;)
Joy_void_Joy:   You can extract it to a function that runs, but
johnnyhotlava: you have to say "it wont work"
puffnfresh: I don't think so @nnotm
Joy_void_Joy: @Nnotm Nope, False -&gt; True
Nnotm: oh, oops
funwayz: false is true in some perspective
benchai18: @joy_void_joy I’m too stupid for this. What’s the point of proving philosophical things? Is this just like for fun
Joy_void_Joy: If you have false, you have everything
yaus_baus: true &amp;&amp; false
MajesticMack: false is just less true in life
ferrahs: @benchai18 yes it’s fun for him
johnnyhotlava: False encapsulates too much brain
Joy_void_Joy: @benchai18 The typical exemple is in planes
Joy_void_Joy: You want to prove that your algorithms won't lead to a crash
puffnfresh: @benchai18 prove that there are infinite prime numbers, this is useful
benchai18: I feel like I’m swinging further into the spectrum every moment
Joy_void_Joy: And it can be used in mathematics
Joy_void_Joy: To be sure about a proof
ferrahs: Yeah, this is basically mathematical proofs in code
benchai18: Fuck I’m dumb
puffnfresh: push your code somewhere @georgehotz I'll have a go
Joy_void_Joy: Well, you can also extract the algorithm you've implemented to a real language
Joy_void_Joy: And run them there
puffnfresh: I've done that @joy_void_joy
benchai18: They don’t teach coq on codeacademy
Joy_void_Joy: You mean in Coq @puffnfresh ?
puffnfresh: written proofs about Haskell code in Idris, ported it back
johnnyhotlava: lolololol
Joy_void_Joy: Oh
Cal3b123: Are we going to do any modal logic, with first order logic it gets preety crazy
Joy_void_Joy: Yeah, it's the same idea
puffnfresh: did that for product code in fact
puffnfresh: at a start-up
c9bd: why is this guy proving true != false lol
benchai18: I feel like I’m gaining IQ points just being here
johnnyhotlava: Alright I'm good on this My cerebrum is shrinking
johnnyhotlava: @benchai18 opposite I am getting dommed by the relativity
benchai18: Guys if I learn HTML can I basically use coq?
johnnyhotlava: lolool
Cal3b123: Has George said what hes using zotero for :thinking:
Nnotm: puffnfresh just tried to write this proof in haskell by the way, if I didn't mess anything up the proof is just "case" (I didn't even know you could use empty case without {})
johnnyhotlava: I need help extracting my coq proofs into brazzers
okkessh: what is on VS code
johnnyhotlava: then onto vhs
yBw1: what are we doing
puffnfresh: @nnotm yeah looks good
puffnfresh: that's what it would be in Coq if we used the propositional equality
Backrub: is school lame @georgehotz
Mariosavitch: NotLikeThis
benchai18: @johnnyhotlava xvideos or pHub?
yBw1: this lang looks so much fun
M03x: !uptime
Cal3b123: Do you have to do implication introduction first?
inciMage: any explanation why he uses windows sometimes
puffnfresh: push this code @georgehotz I want to have a go
puffnfresh: sweet I'll have a go &lt;3
muhhn: back bitches
sudqijawabreh: proposition maybe &gt;
okkessh: prop is 4=5
puffnfresh: Prop is proposition which is like a type
muhhn: which mod keeps timing me out :thinking:
okkessh: prop itself is a type
okkessh: prop is like a claim
Joy_void_Joy: Prop is of type Type
Joy_void_Joy: And Prop is the type of all propositions, yes
puffnfresh: Kappa
lemonboxed: i think for each set of props they have to follow the same type of set rules to be true
Joy_void_Joy: Yes nat &lt;- Set &lt;- Type
Joy_void_Joy: 1 = 2 &lt;- Prop &lt;- Type
Joy_void_Joy: Type &lt;- Type &lt;- Type
djuckfomla93: @georgehotz Which colorscheme are you using for vim ?
benchai18: @muhhn Whassup big daddy
okkessh: okay here it is : the basic stuff that exists is separated into 2 in coq some are set which are like datatypes and smaller sets and props are saying this is equal or not equal to this and props are not sets
Joy_void_Joy: In eq_ind (I'm trying to rewrite it right now, so it will be easier to read)
PotatoesAreTheKings: okay so maybe i should have watched from the beginning
nanodanger7: @djuckfomla93 the default
Joy_void_Joy: Well @okkessh kinda?
Joy_void_Joy: Because all set can be a prop
johnnyhotlava: can be...
djuckfomla93: @nanodanger7 how come that i dont have same colorscheme then, is it because of xterm ?
Mariosavitch: making a program reason is difficult. glad you are onto the task mr. hotz
inciMage: imma sleep bye guys
johnnyhotlava: He needs two fingers to access the knowledge
nanodanger7: if you have a mac and change the text to white and the bg to black it should be the same
djuckfomla93: @nanodanger7 Nah, i have arch.
okkessh: the false which is a bool is a set and the false which is a prop is a prop
nanodanger7: well then that's why it's different
yaus_baus: @djuckfomla93 just use ST if youre on arch
okkessh: @Joy_void_Joy am I doing good ?
yaus_baus: best teriminal
lemonboxed: to access knowledge you have to call metaphysical glasses that you can push on
puffnfresh: something like that @okkessh
johnnyhotlava: @lemonboxed Ahhh advanced insight
benchai18: @djuckfomla93 Arch? Great. Another nerd that’s smarter than me
Joy_void_Joy: @okkessh I'm not sure I follow. What is the type of false, and what is the type of False?
Klingenwetzer: hey dad FeelsGoodMan
okkessh: type of false is set and type of False is prop ?
B0tch: What are you doing?
Klingenwetzer: true != false forsenThink
okkessh: but type of false is first boolean and then set ?
djuckfomla93: @benchai18 Arch does not make anyone smarter lul :) @yaus_baus i'll try that terminal, thanks for advice
johnnyhotlava: False is a type of true
Joy_void_Joy: Well, false is a bool
annasgrasshopper: Arch linux is quite a cool OS, I really like to use it with i3
Joy_void_Joy: Bool is a set
johnnyhotlava: or that's what I tell my girl when I'm on snap
Klingenwetzer: this is messing with my head LUL
Joy_void_Joy: False is a Prop, yes
okkessh: is it a coincidence that the name is coq and there is := in syntax
Klingenwetzer: LUL
benchai18: @johnnyhotlava Legend
Sznurek066: P != NP forsenThink
lemonboxed: is it bc its statically typed so you have to emualate dynamic types
johnnyhotlava: @benchai18 you're gods son
Klingenwetzer: thats so stupid LUL
djuckfomla93: @annasgrasshopper i3 is nutz...next lvl
yaus_baus: @djuckfomla93 I personally use Luke Smith's build of st, looks nice with i3 gaps
benchai18: All in favor of transferring ownership of the Federal Reserve to @johnnyhotlava ?
benchai18: I
johnnyhotlava: I
johnnyhotlava: Court is adjourned
jax05_: lol
benchai18: Unanimous decision. Democracy at its finest
djuckfomla93: @yaus_baus why not the default one ? which benefits do i get from his build ?
jax05_: you two should get married
johnnyhotlava: @jax05_ you missed it?
benchai18: He gives me a broner
jax05_: @johnnyhotlava yes FeelsBadMan
yaus_baus: @djuckfomla93 just saves you time configuring it, he has some good keybinds defined too
johnnyhotlava: Helmet engorged full mushroom
yaus_baus: as well as aesthetics
benchai18: Hahahahahahaha
djuckfomla93: @yaus_baus Thanks buddy, will definitely give it a try
benchai18: The smart people are just ignoring us completely
johnnyhotlava: Such is life.
jax05_: are you calling me dumb?? @benchai18
benchai18: You’re the exception
djuckfomla93: lul
jax05_: FeelsGoodMan
johnnyhotlava: I have the iq but the technical knowledge is uhhhhhhh not there
Klingenwetzer: has george mentioned his opinion regarding the bootrom exploit?
benchai18: I used Coq to determine that @jax05_ != dumb despite paying attention to us
johnnyhotlava: lol
jax05_: @Klingenwetzer he did a stream about it recently
puffnfresh: OH MAN
Klingenwetzer: damn I missed it
jax05_: @benchai18 I'm sorry for indulging you D:
benchai18: @klingenwetzer I think it’s on youtub son
cozinn: !uptime
jax05_: oh wait I am dumb
RomanNYC: clear H1 I think
puffnfresh: Coq is so much more fun than any video game
yaus_baus: coq club lmao
johnnyhotlava: I eat crayons without the wrapper
benchai18: @jax05_ I think @johnnyhotlava and I are gonna adopt u
Klingenwetzer: I saw the original tweet 4h after it was posted, but I didn't check on what george was doing NotLikeThis
puffnfresh: QED
johnnyhotlava: Welcome home
johnnyhotlava: Proved IT
jax05_: woooooot
yaus_baus: good job george
knilecrack: GG
puffnfresh: QED &lt;3 &lt;3 &lt;3 &lt;3
Klingenwetzer: BIG 🧠
HS_SemenThrower: ggwp
extremelywide: LOL
dorkmo: boiiiiii
puffnfresh: get that W
dorkmo: Pride100
puffnfresh: Pride10
prakyath_kantharaju: I just realized that true is not equal to false
benchai18: SO CLOSE. KEEP PULLING THE COQ. IM SO CLOSE
johnnyhotlava: Super unfair considering I use piano keys and didn't know the type
Joy_void_Joy: I think I've found a way to do it very simply
johnnyhotlava: Lets start over
Joy_void_Joy: You start with Lemma true_eq_false: ~(true = false).
Joy_void_Joy: Then you apply it to your goal
Joy_void_Joy: And then you destruct eqb' true false
Joy_void_Joy: It works in my computer
benchai18: @joy_void_joy lemme know if ur looking for a job
rkxbz: omg, you are still sitting?
Klingenwetzer: LUL
Joy_void_Joy: But with ssreflect syntax
Johnvade: you know what, this stream was actually helpful
Klingenwetzer: Math WutFace
Johnvade: i might do something similar in plan9 c
benchai18: @joy_void_joy I agree. Ssreflect for sure
Joy_void_Joy: Not with the library, just the syntax
johnnyhotlava: NO EQUALITY
puffnfresh: equals and ssreflect??
puffnfresh: ah I see
Johnvade: ty ty ty
djuckfomla93: @georgehotz are u coming to Europe soon?
johnnyhotlava: ALRIGHT
Klingenwetzer: Proofs forsenX WutFace
Joy_void_Joy: But it's what it's doing with eq_ind?
extremelywide: this is NOT an equality friendly stream &gt;:-(
Joy_void_Joy: Or I'm confused?
Klingenwetzer: LUL
puffnfresh: I had some doubts
puffnfresh: for a while
abk467: i was iffy about it but this clarifies it
K0enich: awesome
benchai18: @joy_void_joy I think he’s re-routing the encryption to the mainframe
johnnyhotlava: @benchai18 lololololololololol
okkessh: is proving a tautology really and accomplishment?
Mariosavitch: true != false? What world is this
johnnyhotlava: STOOOOOPID
jax05_: it's a proofs world
HS_SemenThrower: @benchai18 lmfao
johnnyhotlava: man that's killing me
benchai18: 🧢 das my ass hat
Joy_void_Joy: I'll have to take a look at that then, sorry
Joy_void_Joy: @benchai18 I'm listening :P
puffnfresh: it's not a tautology
Klingenwetzer: forsenKek
tfue_is_dog_shit: true == true is false in js
Mariosavitch: ask siri
puffnfresh: LUL
frankytex: the true loser is that keyboard getting soar from being diddled so hard
crowsssssssss: crowsssssssss subscribed with Twitch Prime.
Klingenwetzer: ANY TRUERS? forsenHead
picklesareok: Am I stupid or is it contrapostive
yaus_baus: uber eats chicken geroge
Mariosavitch: im a flat earther
okkessh: it is a tautology, you solve an equation and you end up with 3!=5 what do you call it
shissle: You mean a Model
benchai18: @joy_void_joy How do you feel about marketing? Id hire u for sure
Nnotm: ~(true = false) isn't a tautology? Isn't it true for all possible interpretations of the (0) free variables?
prakyath_kantharaju: amazon prime it bro
johnnyhotlava: Fridge = Stocked with coq chicken
puffnfresh: @okkessh simple?
johnnyhotlava: Forage
Roundlay: &lt;3
puffnfresh: thanks @georgehotz
dotmops: any oil princes? squadW
K0enich: &lt;3
Klingenwetzer: &lt;3 dad
jax05_: byeee
3FXX: !uptime
joker2k999: peace bois.
knilecrack: gg
annasgrasshopper: bye bye Hotzzzzz
okkessh: and me
annasgrasshopper: :)
rkxbz: what is your favourite book??
Klingenwetzer: lowHi enjoy your meal my dude :D
puffnfresh: stream more Coq
prakyath_kantharaju: MVP joy_void_joy
johnnyhotlava: the coq crew
Joy_void_Joy: Most welcome :3
tfue_is_dog_shit: &lt;3 &lt;3 &lt;3 &lt;3 &lt;3 &lt;3 BibleThump BibleThump
puffnfresh: it's lots of fun
johnnyhotlava: Yeah I basically had to carry the whole coq team
Klingenwetzer: in python LUL
Nnotm: have you thought about implementing agda instead?
johnnyhotlava: Held the coq together
puffnfresh: I &lt;3 Agda @Nnotm
shieeeeeeeeet: he's answering "why?" Pog
Klingenwetzer: I took compiler building (:
benchai18: Why did he freeze? Did he dip?
Joy_void_Joy: Its core is very minimalistic, yes
okkessh: will you check the gmail dor the backspace ai
Joy_void_Joy: That's what I love about it
okkessh: for the backspace ai
jax05_: @benchai18 he's still talking
Klingenwetzer: LUL
johnnyhotlava: George is going to break out of the matrix
johnnyhotlava: He wants AI to learn about itself so he can learn aobut himself
puffnfresh: &lt;3 learning
Roundlay: But Lambos help me get a girlfriend
puffnfresh: keep it coming @georgehotz
Klingenwetzer: you wanna proof a concept :) for your own sanity
johnnyhotlava: I missed a talk
johnnyhotlava: oh ok
jagger_rsw: @georgehotz but you're writing language to prevent breaking out of simulation, b/c it's provable ;)
okkessh: you are creating the last invention of mankind with backspace telling you
Klingenwetzer: TRUE PogChamp
jax05_: I think he's referring to his techcrunch talk
shieeeeeeeeet: do you have a primary optimization objective that guides most of your actions?
Klingenwetzer: yes you want :)
yaus_baus: making ig users think lol
Klingenwetzer: you make me think about making someone to think forsenThink
yaus_baus: ur comments lul
ZeeZaxean: youtube does that having 3 ads before a 10sec video, idk whats real anymore
knilecrack: what did you think?
Kriminell00: D: no way
lemonboxed: ig is just bots
knilecrack: IG is for retards
jagger_rsw: @georgehotz seeing you at joe rogan's would be interesting, given that joe is easily captivated by ideas like world simiulations and AI gods
johnnyhotlava: YEAH
knilecrack: you are just saying that case you didn't get verified
Klingenwetzer: LUL
risky_banana: bubbaCREEP
okkessh: yeah joe rogan is the way to many followers
knilecrack: cause*
SKPTCL: george took dmt? really?
johnnyhotlava: You portal travler
joker2k999: oh shit. talk about it.
johnnyhotlava: traveler
Klingenwetzer: joe rogan forsenHead
grizvok: dmt is crazyyyyy
yaus_baus: have joe rogan on geohot stream
johnnyhotlava: Just go on and dominate the convo
okkessh: do you use adderal
grizvok: i did an extraction myself
knilecrack: Did you smoke it?
benchai18: @jagger_rsw I’d try getting him on jre if he wanted but someone said he already said he’s not interested
kingkong3211: well joe got some weed for you lol
Klingenwetzer: george &gt; elon
thuganalyst: Tell us bout da DMT
SKPTCL: is it as huge of a meme as everyone makes it out to be?
Roundlay: Do you use Modafinil?
shieeeeeeeeet: do you plan on cryogenically freezing your brain if you encounter an earlier-than-expected death?
joker2k999: LUL
okkessh: you have more dopamine with Adderall
Klingenwetzer: retalin OpieOP
Roundlay: How do you measure productivity?
okkessh: you should try concerta
johnnyhotlava: Well creating the delusion does remove some pressure
knilecrack: you should mark your stream 18
jax05_: lol
CondomsWontFit: have you finished reading GEB?
shieeeeeeeeet: how is cryo equivalent to effective altruism?
Klingenwetzer: this is 18  programming forsenS
puffnfresh: don't get the kids into Coq
Klingenwetzer: true != false is dangerous
knilecrack: not if you ask me but twitch :)
yaus_baus: 18  for streams with coq content
johnnyhotlava: Deceit is the key
knilecrack: @Klingenwetzer he will fuck up stupid kids
Joy_void_Joy: Ooh, talking rationality and effective altruism :D
benchai18: Love coq
johnnyhotlava: "altrusim" namsayin
Joy_void_Joy: Great!
kingkong3211: how long do you think it will take till we get basic VR.
johnnyhotlava: Machiavellian self corruption will lead you to the light
rkxbz: what is your favourite book?
Klingenwetzer: rationality is like only the half of the story
joker2k999: can we get a rant or what? LUL
benchai18: Last time I’m gonna ask... George u wanna be on Rogan or nah?
puffnfresh: I agree @georgehotz
picklesareok: Any rationalist essays worth reading?
shieeeeeeeeet: so you'd rather just stop existing than possibly be resurrected?
johnnyhotlava: You want this very thing
rkxbz: what is your favourite book?
kingkong3211: how long do you think it will take till we get basic VR
johnnyhotlava: right now
knilecrack: when r you gonna stream again?
jagger_rsw: go joe rogan :)
Klingenwetzer: wanna be on INFO WARS?
dotmops: go on thisweekinstartups again that was a fun convo with jason
metasudo: ill have you on my podcast, we can smoke weed and color in coloring book
Roundlay: Wouldn't you tend to live a better life/achieve your goals more often if you can more easily overcome cognitive biases, etc.?
metasudo: s
djuckfomla93: Do you plan on coming to Europe soon ?
Klingenwetzer: forsenS
searchingforlife: @georgehotz why are you shilling for soylent and mealsquares?
rkxbz: what is your favourite book?
CondomsWontFit: have you finished reading GEB?
jagger_rsw: @georgehotz but yudkovsky is crio-lover
kingkong3211: how long do you think it will take till we get basic VR.
okkessh: what kind of tea do you drink
benchai18: I love jre, but I’d rather see him on TPW w/ Theo Von
zoki_macola: what do you think about WeWork?
picklesareok: Thank you!
elonsmuskygooch: When are you going on Logan Pauls Podcast?, he said he wants you on. @georgehotz
johnnyhotlava: LOLOLOL
metasudo: bad blood is fucking awesommmmme
Couchmann941: how did the iphone jailbraking go? @georgehotz
jax05_: lmao
johnnyhotlava: It's genius in a different sense
jagger_rsw: @georgehotz what are you watching on tv, some cool movies/series out there?
johnnyhotlava: billions
johnnyhotlava: for that shit
rkxbz: what is your favourite book?
johnnyhotlava: God bless them
Nnotm: https://slatestarcodex.com/2015/08/17/the-goddess-of-everything-else-2/
jax05_: thx
laz4rz: @georgehotz billions is great
benchai18: You sound like Kermit a little
Klingenwetzer: do you guys know "The Physicists"?
shieeeeeeeeet: @georgehotz are you saying you wouldn't pursue cryo because you're not a rationalist?
johnnyhotlava: Woah
johnnyhotlava: jorge
Bra_te: what is inch?
joker2k999: i think looking at binaries on windows made him switch back to the mac...
dotmops: another ThisWeekInStartups podcast with Jason would be fun :D
yaus_baus: why use dating apps george
okkessh: what is the tea you keep drinking
tris790: cringe ?
benchai18: @georgehotz == KermitTheFrog Look into it
johnnyhotlava: Oh i cant date on apps
metasudo: bro ill date you
mlacix: @georgehotz are you exited about the new season of Mr. Robot?
johnnyhotlava: I like to harass in person
peter35_: how much coffee do you drink?
knilecrack: ohh you should
benchai18: I love Hinge. Met my girl on hinge
johnnyhotlava: Aggression is a serious advantage
kingkong3211: how long do you think it will take till we get basic VR.
Roundlay: When's your next date
Bra_te: mr robot wasn't that good :/
catacata92: Do you like anime ?
jax05_: dating apps feel really uncomfortable to me
djuckfomla93: @georgehotz Alright, i guess im a spammer. Are u coming to Europe soon ?
johnnyhotlava: Aggression ups your iq by 20 pts
benchai18: Is Coq &gt;= 9?
thuganalyst: Did you see that video of Shkreli roasting Jason Calacanis? LOL
elonsmuskygooch: Can I buy your merch? @georgehotz
lemonboxed: when will vr not fry my eyeballs
Roundlay: TPFufun
Klingenwetzer: forsenThink girls
knilecrack: ahaha
johnnyhotlava: lol
Klingenwetzer: N O LUL
knilecrack: Yeah
gunnaren: Norway right here
Klingenwetzer: Me @georgehotz
Klingenwetzer: :)
exonex_osu: germany
jagger_rsw: si, switzerland
annasgrasshopper: I'm from europe
speeddrawing101: uk
kingkong3211: uk here
annasgrasshopper: Portugal here
Sznurek066: EU Pog Poland here
Roundlay: Tokyo
mlacix: Iam from Europe as well
faulpelzz: can u hack brainz?
metasudo: GeoHotz cock socks
shissle: Yes
lasercatboss: germany whaddup everbody
Bra_te: on what are you working right now?
zoki_macola: Serbia
Klingenwetzer: Germany DatSheffy
fear_ep: Italy
Hueston94: Watching from Northern Ireland
Threated1: yea
knilecrack: Zoki madafaka
ferrahs: Toronto
Roundlay: Still got that PASMO money?
Bra_te: Germany &lt;3
catacata92: Do you think emotions hinders real thinking ?
johnnyhotlava: George what do you want AI to do next
shissle: Come to Germany
LiamS212: Uk gang where u at
gunnaren: !uptime
benchai18: @georgehotz bleached ass or natural?
Klingenwetzer: hack my raspberry pi @georgehotz
joker2k999: minecraft stream bros.
fazel3ss: Let’s do some AI on audio
shieeeeeeeeet: do you think that quantum superposition is a memory-efficient representation for the simulation?
fazel3ss: Nobody does audio
Roundlay: https://www.twitch.tv/georgehotz/clip/TolerantFunAnteaterBrokeBack
ferrahs: Can you give tips on data structure and complex algorithms?
Klingenwetzer: 🧠
Bra_te: have you ever done drugs?
benchai18: Can you be my life coach
elonsmuskygooch: Can I pay you $100 bucks to write "#1 Twitchy" on a shit white shirt with a marker? @georgehotz
djuckfomla93: Goddamit, i just want a single conference with George Hotz....am i asking too much ?
Klingenwetzer: LUL
fazel3ss: Was it 20$?
johnnyhotlava: What level confrontation is appropriate for management. SHould I use a whip?
joker2k999: thought it was $100.
ferrahs: LOL not implementing, but to be able to do leetcode
metasudo: if you think about it, if you sit on the toilet, you're connecting your butthole to every other butthole in the area, its a butthole network
Roundlay: Sit down Tai Lopez
walktheabyss: Best piece of advice for getting better at programming?
lasercatboss: guys
ferrahs: @metasudo mesh topology?
lasercatboss: you saw his talks
lasercatboss: dont invite him
Klingenwetzer: he wants the premium stuff LUL
yaus_baus: cloud butthole
lasercatboss: link his last talk
puffnfresh: https://yowconference.com/lambdajam/
lasercatboss: its fine
benchai18: @johnnyhotlava Threaten their kids
johnnyhotlava: @benchai18 bless
elonsmuskygooch: Can I pay you $100 bucks to write "#1 Twitchy" on a shit white shirt with a marker? @georgehotz
puffnfresh: come to Sydney for the annual Coq fight
lemonboxed: unless your toilet is offgrid
lemonboxed: offgrid toilets 2020
puffnfresh: we have a Coq competition every year
Klingenwetzer: LUL paypal me
Sarkin_dota: Sounds like a scam
yaus_baus: scam
benchai18: Bro I’m loaded
benchai18: I’ll keep u on retainwr
catacata92: your talk was something
lasercatboss: do you say the 15 mins thing at you dates too? lmao
Klingenwetzer: forsenThink
jagger_rsw: what if you get lifecoached in the end :)
ferrahs: I’ll charge back Kappa
shinypickel: scam OMEGALUL
benchai18: Love u dude.
grizvok: LOL
shieeeeeeeeet: what's your ETA for AGI, whatever your definition of that is?
Kriminell00: inb4 joe rogan calls you on skype
johnnyhotlava: I want you to create an extortion tool for public officials
Klingenwetzer: what about a date with you? @georgehotz forsenThink
jagger_rsw: Star Trek or Star Wars?
johnnyhotlava: lolololol
rkxbz: how about joker movie?
johnnyhotlava: YES
benchai18: @johnnyhotlava let’s buy him a shard and fly him out
grizvok: LAAS
okkessh: you said, you would never get married in video why is that
krnflake1: ios or android?
elonsmuskygooch: Can I pay you $100 bucks to write "#1 Twitchy" on a crappy white shirt with a marker? georgehotz
johnnyhotlava: @benchai18 zoot that man up
Klingenwetzer: forsenThink linkedIn
Roundlay: LUL
Keyeh: KappaPride
Roundlay: Damn I'm out
buttez: LUL
jax05_: lul
Bra_te: who are you rooting for in 2020?
johnnyhotlava: what's the most obscure programming language I can use to keep from being copied?
catacata92: Would you let AI govern 'countries' ?
dorkmo: GayPride
Klingenwetzer: only for you KappaPride
ferrahs: KappaPride
grizvok: LOL
johnnyhotlava: sanskrit?
joker2k999: LUL
Klingenwetzer: DODGED LUL EZ
Roundlay: Are you in the yanggang
elonsmuskygooch: Can I pay you $100 bucks to write "#1 Twitchy" on a crappy white shirt with a marker? @georgehotz
shieeeeeeeeet: @georgehotz what's your ETA for AGI, whatever your definition of that is?
twiggy_io: Okay be my life coach
johnnyhotlava: FItty dollas
krnflake1: ios or android?
lasercatboss: how you come back from a shitty week to prove your lifecoarch potential
picklesareok: why is it so hard to find an interesitng objective function
knilecrack: let's go 10 pushups for proving false != true
johnnyhotlava: I gochu
jagger_rsw: coaching is about listening, and you talk a lot )
Klingenwetzer: Big new iPhone PogChamp
knilecrack: ahahahahaha
eaoruhgadfhjglajsdlfgj: PogChamp
Keyeh: OMEGALUL
lasercatboss: Pog
Sznurek066: PogChamp
Jewishrambo: 7
searchingforlife: PogChamp
0xc0ffeee: ahahahah
Klingenwetzer: PogChamp
johnnyhotlava: look at the length of those arms
peter35_: horrible form NotLikeThis
jax05_: Pog
metasudo: he's got good form
Sarkin_dota: Would you agree to twitchstream the coaching session?
gunnaren: EASY clap
puffnfresh: wtf is going on
knilecrack: YEAH BOYYYYYYYYY
okkessh: you said you would never get married why is that
benchai18: What a tweaker. I love him
ferrahs: PogChamp
hardtarget4: weak
rkxbz: you almost died man
johnnyhotlava: man has got some reach
jax05_: I thought he was gonna fail
Klingenwetzer: buy a new one OpieOP
kayos_rl: kayos_rl subscribed with Twitch Prime.
UniversalGeneve: george.fit()
twiggy_io: Is this when you hire me?
yaus_baus: lmao
grizvok: ROFL
ferrahs: @benchai18 that’s what coke does to you
Jewishrambo: lets do it guys
CondomsWontFit: do it PogChamp
benchai18: @georgehotz u wanna be on Rogan? Lmk
grizvok: lollforfl
gunnaren: Someone please do this
Klingenwetzer: SKYPE OMEGALUL
ferrahs: Are you making an iOS 14 JB? Kappa
puffnfresh: who is game?
yaus_baus: live dr phil with geohot
0xc0ffeee: someone do this plz
Jewishrambo: viewer call ins
3FXX: how about $0 5min teaser for 270 people then we decide
Roundlay: Lifecoaching https://clips.twitch.tv/HappyAcceptableCheesecakeNotLikeThis
Keyeh: can you hire me?
ZootedNipples: why do you use mac os?
Jewishrambo: lol
Klingenwetzer: I can look pretty :)
twiggy_io: I can program kinda okay
johnnyhotlava: I am a pathological liar I can get you anywhere?
johnnyhotlava: I open doors
aziz_fazlagic: why do you use mac os?
searchingforlife: how much for a group twitch life coach?
twiggy_io: github.com/evanlib
johnnyhotlava: Shit
Klingenwetzer: LUL
johnnyhotlava: Well
ferrahs: @aziz_fazlagic why not lmfao
rkxbz: github.com/raysultan
gunnaren: LUL
Klingenwetzer: posting the githubs LUL
johnnyhotlava: I figured I could start a new "tech" company that makes chairs
Klingenwetzer: with only private repos OpieOP
johnnyhotlava: We chair
johnnyhotlava: we sit
Roundlay: Is this a hackintosh?
Jewishrambo: boyfriend applications but for geohot
annasgrasshopper: https://github.com/Alf0nso
puffnfresh: https://github.com/puffnfresh
eaoruhgadfhjglajsdlfgj: LUL
Klingenwetzer: LMFAO
puffnfresh: NO STARS
twiggy_io: I have one star thank you
rkxbz: im bewbie
benchai18: Remind me ur email?
0xc0ffeee: lolololol
eaoruhgadfhjglajsdlfgj: NO STARS IN 2019 LUL
jax05_: lmao
Klingenwetzer: OMEGALUL README
0xc0ffeee: ahahaha
johnnyhotlava: LMAO
knilecrack: ahahahahahahaha
Sznurek066: LUL
joker2k999: bruh...
buttez: LUL
Kriminell00: oh god this was a bad idea LUL
Klingenwetzer: LMFAO LUL
aziz_fazlagic: @ferrahs Just wondering ;p thought he just got a razor blade
0xc0ffeee: rip
knilecrack: ahahahahahahahahahaha
Jewishrambo: HAHA
johnnyhotlava: Hey what's a github
kayos_rl: lul
yaus_baus: george would prob roast my git too
ferrahs: LMFAO normie github
benchai18: @jewishrambo Shana tova
fazel3ss: Hire me I’m fucking bored
Klingenwetzer: dafuq this is worse than mine LUL
Jewishrambo: EleGiggle
dorkmo: roast githubs stream lol
puffnfresh: riPepperonis
faulpelzz: lmfao
ferrahs: LOL
Klingenwetzer: TAB WutFace
puffnfresh: https://github.com/puffnfresh
okkessh: will you check a video of my image processing algorithm
puffnfresh: roast me
Keyeh: i'd would pay you to roast githubs
okkessh: https://www.youtube.com/watch?v=AEUoB59kNcI&amp;feature=youtu.be
Klingenwetzer: STARS PogChamp
Keyeh: literally
rkxbz: how to get stars?
ferrahs: Formatting sucks lmao
johnnyhotlava: Hire me I earn my living cutting in principles into the services they pay for creating the illusion of profit.
benchai18: @johnnyhotlava WHATS HIS EMAIL?
knilecrack: that's how you make $$
searchingforlife: https://github.com/dougwilson
Sznurek066: LUL sellout
Klingenwetzer: LUL
johnnyhotlava: @benchai18 I know not
goto10: @georgehotz just curious, what happened to your self-driving car project?
johnnyhotlava: GOteem
benchai18: @georgehotz what’s ur email
joker2k999: can't hate. his hub is better than mine. LUL
Vespus: Work for free? yeah, nty
TheKoreanZombi: Puffnfresh has hundreds of stars
Klingenwetzer: PogChamp
ferrahs: @searchingforlife fake stars
jax05_: oh shit
buttez: THICC contributions
searchingforlife: gotem
fazel3ss: I have 16 lol
puffnfresh: puffnfresh subscribed at Tier 1.
Klingenwetzer: DAMN THIS GUY PogChamp
Sarkin_dota: PogChamp
buttez: saturday committer dafuc
benchai18: cheers
joker2k999: nice bro.
Sznurek066: PogChamp
peter35_: how many pieces of flair do you have
johnnyhotlava: Nice nice flair
puffnfresh: oi I subbed
alb55: time to leave 1st grade hotz
Jewishrambo: isnt that forked
Klingenwetzer: FeelsGoodMan Nice man forsenK NOICE
ferrahs: That isn’t his work
twiggy_io: All forked
okkessh: interested in an image processing algorithm on dashcam footage ?
goto10: who use perl?
imsooinhuman: whats in your guys opinion best site for coding challenges?
fazel3ss: Perl
johnnyhotlava: We chair invest
puffnfresh: https://github.com/puffnfresh
jax05_: all forked lol
ferrahs: Everything on his profile is forked. Fake AF lol
buttez: when u commit like 20 times in one day so u dont get dark green squares anymore :(
metasudo: oh we're checking out githubs? Here's mine https://github.com/torvalds
Klingenwetzer: 2 contributors LUL @georgehotz
Klingenwetzer: "other ppl"
johnnyhotlava: His face
puffnfresh: there we go boiz
johnnyhotlava: HOT
Jewishrambo: WutFace
jax05_: PogChamp
twiggy_io: All forked
blazorup: have you checked out stdlib.com ? what do you think about functionscript ?
buttez: from India?
goto10: he is not look Indian though
eaoruhgadfhjglajsdlfgj: 300 repos WutFace
Klingenwetzer: Indian Boys PogChamp
johnnyhotlava: Image search I don't buy it
puffnfresh: I lived in India for a year
Jewishrambo: try it
puffnfresh: just got back last week
Klingenwetzer: LMAO
Keyeh: PogChamp
Roundlay: PogChamp
joker2k999: LUL
Keyeh: hire him Pog
yaus_baus: damn
yaus_baus: must be nice
Jewishrambo: PogChamp
CondomsWontFit: PogChamp
Klingenwetzer: PogChamp FREE JOB ONSTREAM
searchingforlife: PogChamp
ScrubLifeChoseMe: ur still on?
shieeeeeeeeet: hired PogChamp
tris790: Freee JOB BOIIS
peter35_: get him to explain what a monad is Kappa
metasudo: HES HIRED
puffnfresh: yeah you can hire me @georgehotz
Sznurek066: hired Pog
puffnfresh: $50 for 15 minutes
johnnyhotlava: George I'm a certified hypnotist I can "optimize" your team
puffnfresh: via PayPal
Sarkin_dota: SOLD PogChamp
faulpelzz: nice 1
Jewishrambo: didnt work
metasudo: OOOOOF
Klingenwetzer: LUL Jebaited
puffnfresh: just PayPal me $50 and I'll interview with you @georgehotz
shieeeeeeeeet: unhired
Klingenwetzer: Jebaited SCAMMED
blxckghxst: log out?
twiggy_io: Lol
metasudo: HES FIRED
okkessh: will you check my image processing algorithm?
tris790: reload ?
buttez: Jebaited
goto10: Buested
Kriminell00: fired on first day PogChamp
Sarkin_dota: SCAMMAZED
jagger_rsw: @georgehotz it was malware obviously ;)
blxckghxst: Scroll up to usage
johnnyhotlava: GO home
puffnfresh: I'll fix it for $50
ferrahs: Doesn’t work LOL
goto10: busted!
blxckghxst: Log out and back in
Jewishrambo: zzz
tetamusha: you are a shadow in my life, George Hotz
puffnfresh: macOS dude
Klingenwetzer: Not hired BibleThump
jax05_: ResidentSleeper
johnnyhotlava: My github is just coq pics
Kriminell00: LUL
shieeeeeeeeet: @georgehotz do you hire people without githubs? or it's a hard requirement?
Klingenwetzer: lol
joker2k999: lmao
puffnfresh: it did work a while ago
puffnfresh: macOS changed all of its API
TheKoreanZombi: Of course it works!
puffnfresh: of course IT DID
faulpelzz: @puffnfresh u stream?
johnnyhotlava: eggs act lee
jax05_: pretty sure github is a hard req
puffnfresh: yeah mate @faulpelzz
Klingenwetzer: forsenThink damn
twiggy_io: Forked
metasudo: REHIRED
Joy_void_Joy: Sorry if this is off topic, but it was actually simple to prove eqb' -&gt; eqb'' with induction, and then proving true is not false (without any built-in).
Joy_void_Joy: I can share the source somewhere if you want
blazorup: https://github.com/jetstreamin
puffnfresh: REHIRED
tris790: SAVED
searchingforlife: @puffnfresh Jebaited
metasudo: please checkout my github https://github.com/torvalds
puffnfresh: 10 STARS
Klingenwetzer: ten forsenS
buttez: quick star the repo everyone
metasudo: ayyyy
puffnfresh: if you don't have 10 friends
puffnfresh: you're done
Klingenwetzer: LUL
johnnyhotlava: That guys name is sanjay
metasudo: We live in a github society
johnnyhotlava: Image search
Klingenwetzer: BibleThump I got no friends
Nnotm: @puffnfresh I'm sure you could arrange for someone to give you 15 stars for $50
buttez: old pic BTW
Klingenwetzer: 26 PogChamp
blazorup: single responsibility
puffnfresh: I reckon @Nnotm
jagger_rsw: I have 1.6k but it's company's open-sourced thing I'm developing :)
Sznurek066: oldHotz
SKPTCL: the old photo reminds him of his roots lel
joker2k999: that documentation tho....
johnnyhotlava: I develop ways to write paragraphs without saying anything to draw investment from the elderly
johnnyhotlava: We sit
johnnyhotlava: we Chair
johnnyhotlava: It's hot
ZeeZaxean: bang me
dorkmo: good old days
Klingenwetzer: PogChamp
yaus_baus: star georges coq
gunnaren: Streaming tomorrow?
joker2k999: past hotz..
metasudo: gonna follow george's coq
johnnyhotlava: You can do that
johnnyhotlava: STREAM
Klingenwetzer: Twitch partner PogChamp
ZeeZaxean: big money Pog
TheKoreanZombi: Don't tease us with partnering again...
SKPTCL: any plans for next stream?
Klingenwetzer: BlessRNG
lasercatboss: why though
Klingenwetzer: I BELIEVE
yaus_baus: 9 stars
johnnyhotlava: You can invest that money into wechair technology
asaptwice: what is twitchcoq im new ^^
abk467: that purple check mark will look nice
3FXX: sellout
Klingenwetzer: I'm gonna star twitchcoq when I'm back at my pc
buttez: bubi
Nnotm: asaptwice coq reimplemented in python
puffnfresh: $50 for 15 minutes to get your shadows gone
knilecrack: bb
goto10: hs, lots of money
dorkmo: Party1
Klingenwetzer: lowHi bye dad
okkessh: check the gmail
jax05_: byee
Klingenwetzer: DMs Kreygasm
kayos_rl: peeace
TheKoreanZombi: I want mine to be public
asaptwice: @Nnotm ty
UniversalGeneve: would you do code coaching for $80/30 mins?
puffnfresh: $15
twitchies
okay
repost called twitch core it's on github
this has been so this is something i've
been wanting to do for a while
uh i've never written a processor before
um so that's what we're doing today
this is the spec downloaded it off the
internet
the risk 5 instruction set manual
what's up
um
yo
uh all right so
now we'll wait till uh we'll wait the
the announcements until some more people
get in here
we are drinking a red bull today
um and we're gonna implement risk five
uh now is debating should i go right for
verilog or should we start in python
and um
you guys uh tell me should we start with
a python implementation or should we go
straight for
verilog
no long python verilog python
all right i see more pythons and
verilogs um
so if you've been paying attention in
the tiny grad repo
um in tiny grad now i have an extension
uh i have some instructions which are an
extension
to risk five by the way if someone wants
to fix the
these things are failing because install
opencl is failing uh so if someone wants
to submit a pull request
to fix the test on tiny grad i would
appreciate you
um
the yeah if we go into extra
risk um these are some
extension instructions basically based
around this
internal uh matt mulcore
and yeah if you implement these you can
implement almost all i haven't done the
reduce instructions yet
but almost all of an efficient not using
tiny grad
so i just want to get a feel for it for
processors
and uh you know what what things like
pipelining actually look like i don't
really know
um all right so
how many viewers we got uh
i got 232 viewers all right we'll start
with a few we'll start with a few
announcements
um reddit comment ai uh so you guys will
talk a little about
well it's not really about comma uh it's
about nobel day
ah it's a kind of nobel day we doubled
the price
uh we doubled the price of the comma two
uh in honor of nabil
um and then you get like these people
it's a kind of joke and that's not funny
at all in fact it's a slap in the face
to the
customers he needs to clear this with
someone who's not on the spectrum before
posting yeah these childish antics are
what keep the big players
from taking hots seriously dude's
brilliant on a terminal but he should
really leave
marketing pr and comedy
to the experts
now let me explain
what he's really saying is that he feels
more
comfortable with the professional
managerial class
running things right now from my
perspective
the professional managerial class uh
sucks dick and
uh there's no point in having you know
your own company
if you're just going to you know do what
the professional managerial class
wants uh then all you are is is
somebody's bitch
uh i actually i wrote i wrote a blog
post where i explained the uh
the lyrics to it was uh not called the
civil war because people were
were civil uh and i called the blog post
a circulation of the elites uh if you
think of the elites as the professional
managerial class
you know the kind of people who you
would clear this with
um yeah well i think those people uh
suck dick so yeah uh
uh if you don't like it i mean you know
you can you can go
like uh yeah like let go go yeah so
professional managerial class oh yes
please yes please use your buzzwords
that are absolutely meeting us i really
wanted to tear on linkedin yesterday
you know can i say people it's gonna
it's gonna be over it's gonna be over
um so
uh yeah the professional manager class
south deck
just remember every time you see them
whenever there's a simple concept that's
being explained uh incomprehensibly
or whenever uh you know you hear you
hear comments like this about you know
like how
uh the experts anyone who's a
quote-unquote expert
uh is a member of the professional
managerial class you know i find that
interesting like
you'll see some like right-wing stuff
where it's like don't trust experts
right and the problem isn't experts
everybody loves experts everybody loves
people who actually know what they're
talking about right
um what they actually i think mean
is don't trust members of the
professional managerial class and this
is absolutely true
uh there's a caste system in america
america of course likes to deny it
um this upper caste has a whole set of
interesting tricks
um that they use to kind of uh
stop people from seeing their power uh
but it is power and they do have power
and they suffer so
that's the uh the rant about that
um what was the other thing oh yes yes i
i have a new uh a new song out on my on
my soundcloud
um it's a cover uh
and we'll listen to this while we uh get
started here
i didn't want her this time i didn't
want this my way
i wanted yours instead whatever makes
you happy i'll fucking go to bed
i can't hear your friends laughing and
they are laughing at me
don't lie to me i know it they fucking
want to break me
the way their eyes look showing i will
probably let them
they will get what they want and i will
probably help them they will get what
they want i'm lying on my bed
i guess he needs to sleep i think you
lost all of my secrets i couldn't speak
and i keep writing poems poems i'll
never keep
and she keeps knocking on my door when
all i wanna do is sleep she hasn't slept
for days
i fucking wonder why she hasn't slept
around
she left to go get high she says she
hates her friends
cause they call her all night she's
turning off her phone she's going out
the notches of your
spine are looking sharp tonight
and you think that i won't notice if you
now the words this time but i won't pull
my punches i'll use my words to knock
your teeth out one by one
and i'll keep count of all of them
oh i'll count all of them
[Music]
she says she wants her gift back she
said she thought i'd get it
you say you're friends well what's a
friend without a secret you'll pretend
doesn't matter but i have friends so i
have friends and they all matter and
they all care about me she
don't know what that's like she said
they wanna fight me i won't come home
tonight
but now the tables turn because i won't
fight back
i will just let them hurt me until the
world goes black
i think i know what's coming and i just
don't care
i wanna break my glasses i wanna dye my
hair
so that i can go home and they won't
recognize me
and they can see them clearly and i
won't see your eyes means the notches
of your spine
[Music]
i'll use my words knock your teeth out
one by one
and i'll keep counting all of them
yeah so that's that's that
uh i thank you for that for the hype
chain boys uh
all right so second equals that all
right so we gotta we got a uh
pipeline processors have pipelines uh i
dropped computer architecture when we
had to make these stupid actual
spreadsheets so i never actually wrote a
uh
access right
this is fetching the instructions
um so the other thing that we
want is we're going to want tests
and i saw some good tests here
let's just
god
this work
cool we put some j in that bitch
uh okay
and then here we'll uh
we are building an rv 32i
no
where does this go
rv32 ui
let's see it just tells me here doesn't
it
uh ui is user level okay
users users
eh we got users
oh god okay
um that's a fucking elf
should we load the elves in python i
think we'll of the office in python
what is it glob.glob we got a glob
risk the
[Music]
uh tests and we'll reuse these same
tests for the verilog implementation
uh we don't want the dumps wait
what's in here
how do i filter out the dumps
with glob
notches of your
spine are looking sharp tonight
and you think that i won't notice if you
mouth the words this time
um let's see what the glob syntax is
all right we're done with the red bull
for now drank a bottle rifle
let's get some water this stream is
brought to you by
water
ah all right so
i think we can do
yeah you know what you know it's easy if
x dot ends with don't ah
continue all right lazy
bullshit ah cool so these are all tests
um i think we actually want that on
there too
great and these are l files so python
elf
yeah pi elf tools
do we have pylo tools
how to use it please consult the users
guide
it's a useless user's guide
all right we got elf uh
we don't know either sections
i just want like the code you know
all right here's the test for
or or media
all right jumps to handle reset
loads a lot of zeros and some registers
um
sorry i'll move me
risk architecture is going to change
everything boys
all right let's say can i do get section
by name
dot text seek of closed file
oh that sucks
that's a minute
okay
um
yeah that's right
okay um
this return um
stir does not support item assignment
day
bytes
string argument without encoding eh
bytes does not support items what
supports fucking item assignment
um
fine
fuck your item assignment one pack
requires a buffer of
four fights
does that have four bytes oh probably
because i didn't set okay
uh we have to the start address is reg
files
pc equals um
how come this one doesn't have a text
what's a
p
looks like text to me
this one has one and this one doesn't
text.net oh this has a text and a
text.init
oh wow well that's fancy
all right so really what we want is
text.net
and then it might call into things that
we don't have because we didn't load dot
text oh this is frustrating okay you
know what let's just say
uh w
uh dat adder
atomize equals 100 uh
there we go
[Music]
say something like
s dot adder
null section has no address okay
i can't believe after
[Music]
sections or segments
segments segment object has no name
does it have an address
which one of these has an address health
segment section i always forget this
stuff one of these is actually loads
um
segment tells the operating system where
it should be loaded into virtual memory
okay
here we go
all right so now we just do ws
s dot data
test header piano
what
this should be okay
okay we need more than 4k memory all
right fine give it a
32 64k memory wow that's a lot of memory
all right cool okay no my shit loads
and we wrote an elf loader wow we have
to write now float i don't think we'd
have to write a stupid health water
the good news is we'll be able to reuse
this crap for the uh
the verilog edition alright cool um
uh let's just write a quick um
write something called thumb or i am
range 32 what is risk name
uh x okay
okay put a space
here actually what i really want is that
x to like
god how do i do that um
3 s
xdi
high quality all right of course it's
doing nothing right now because we're
only taking one step because we're
returning false and we return true it's
probably going to loop forever
forever all right cool uh what's the
first test
it's ad oh that's a nice one
okay
so
we're going to have to start decoding
instructions
let's just bring up what we're actually
doing here so it's
add
all right so the first thing it does is
a jump so we're going to have to write
jump
four type of instructions there's r i
s and c oh no r i s and u
um cool well that's great
i don't know which type it is
let's just write decoders for each one
of them
there are further two variants we gotta
do the bj instructions i say
is the j type instruction you can't just
make up new types of instructions
there's only ris and u
how do you make up js
okay well it does seem like the op code
is universal
yes the last
six bits are always the op code
i mean okay so that's this is little
indian let's just remind
people that it's little ndm by putting a
little envy in there
all right um
we'll go back to returning false across
the instruction
all right cool so this is the
instruction
all right so is the op code
where's the table of opcodes
control transfer instruction so what
instruction is this supposed to be it's
a j
op code should be seven
but i don't see a seven oh is that big
endian did i do it backwards
this one little india
that was a little indian watch if i
didn't believe that we should chat oh
yeah don't get it twisted boys i gotta
twist them
uh cool so the actual
op code is then
okay so they want six so we can say op
code equals ins
and if we want six bytes let's say six
that's uh that is that right
that's not that's right
all right so 47
that's not six bets
because that's not six minutes it's
seven bits for seven bits we put a seven
there
all right seven f i have one one one
um maybe that's not what this seven
means
that's just the that's just the width oh
okay
all right there's gonna be like tables
where's misk mem from
instruction set listing okay here we go
why do they put in shitty binary
can't they use normal people numbers
rvg
use the abbreviation g for the i'm of
dad
zixers fancy okay that's great
maybe i picked a stupid one let's do a
more
common one like xory
hint instructions
pop him
why is this a g i don't understand that
oh okay maybe so maybe that's not a
general purpose maybe it's called an
op-in where's the list of the op codes
you guys find that in this manual
you see what i'm looking for right
oh goodness let's go to the index
load store
pop
tell me which is which
it's at the end of the table
where
like this oh here we go
rv32i base instruction set okay
um if opcode equals
um okay what should i do let me get enum
i did this in uh tiny grad
you know
louis
ciao
but this isn't really the names of those
things
because those are all that
do they have like a better name
what i mean
uh jalar
like notice how all these are the same
add upper immediate to pc oh that's
great
[Music]
um
no they have to have names for these
things though
yeah like this one's a branch off code
that's what i mean like it's not here
either way fine all right fine we'll
just figure it out
all right this is a branch op code
because we have multiple of them
this is like a load off code i'll keep
these at the bottom
and this is like a shift op code
and this is like an alu op code
uh yeah it's different
uh this is like an alu i opt code this
is like an alu
r op code they have to have better names
for these things
um fence is real and then we have this
is like an
eop code
that seems like all of them
let's figure out the actual name of the
eop code what's called a system op code
see like who would know that
stupid stupid
um all right so i have a srali
let's figure out what a swallow it's an
imp code
so i called it a shift it's actually an
imop code
not that trolley
m32
okay what about a slit you op code
what's a slit you op code oh it's just
called an up
what did i call it
um i called it an alu-r
this is just called an op so this is an
imap code this is a
what is this op code called
this oh the srali
is the same as those oh no okay now we
have shift
op codes oh that's not right okay god
this is stupid
all right emma code op op code
that makes sense that that's an imp code
no no no no no the import's actually
this one
and then this one's still like shift or
something
in the kitchen cooking food
ah louie
these are also immob codes now that's
astrali what if it's not as rally
all right let's just we can figure it
out i think from here now
all right so we have louis and ipc's we
have m's
uh we have op op codes who named these
we have jal and jalar op codes oh brand
chop codes we have those good
loadout code we don't have a store op
code we do oh i've named load correctly
all right we need to figure out what to
store up oh that might those will not be
shifts that might be store oh that makes
more sense
okay good i think we named all the op
codes okay one two three four five
let's kind of break these down and is it
actually called a fence op code or is
that a system op code too
z fancy oh z fancy oh great
who name this crap
now i've actually i'm complaining but
this is actually like one of the
cleanest one of these i've ever read
the armed one is much more of a mess um
this is why i've heard actually such
good things about risk
okay so these are the op codes we're
going to have to implement
uh this goes down there with the
bullshit ones
those are the same that's a louie it's a
load
upper immediate load upper immediate
load upper immediate
put that with the loads and stores
um someone said what a ui pc stands for
it's add upper immediate to pc
it kind of goes in there with the branch
instructions right because anything that
modifies pc goes there
chaos and jawlers these are the kind of
alu ops and fences system or stupid
things we probably don't actually have
to implement all right great
um of course there's no such thing as a
switch statement in python so the first
one we're gonna have to oh
how do i do an enum lookup um see what
i'm saying
python
uh okay we just can do
ops
it should work loving enums bro
rich core cpu all right look at the op
code
it's a gel oh we just got to make jowls
work
okay if off code equals pop stock
okay what do we do for jowl let's go
figure it out
um you know what i'm excited
is it here yet uh
no no no oh yeah some guy
replied some guy sent me email this
morning time sensitive ai
forbes feature opportunity from this guy
who runs this pr
firm and i replied with lol the media is
a bunch of whores
the professional managerial class never
would have approved that
but it's true um
hating on the media is just like that's
just like now what i'm excited about
though
is my um
i bought a little keyboard like a piano
keyboard
i'll add another add another forbes
reporter like send me some racist shit
and i was like bro this is racist
like you know i would expect this from
like buzzfeed or business insider but i
thought forbes had standards
and then like he defended forbes it was
kind of sad
like this just racist shit man fuck
raises them
all right the gel instruction has now
moved to the
u-type format
all right
um you type oh you type
okay
um let's let's write a get bits function
and let's call it chibi in honor of
jimmy
uh say ends
uh s e
and like i can change this to gibby
pins six zero
and we want to do like ins shift shift e
or with end with
one uh shift shift
s minus e minus one is that right boys
did i do it right i don't know let's see
if we still get jab
oh you mess it up all right
uh one shift shift left oh i think a
plus
one here is right let's just try it cool
it works yeah gel
um you guys know jimmy
in honor of jb asmr um
everyone's a little bit racist sometimes
guys remember having you killed that was
a good play
uh so we want to do jimmy
ends
31 12.
say m equals that we'll say rd equals
11 seven
all right cool uh
how do i run a jowl
we got rid of the j immediates
here we go offset
why do they make it so complicated
looking
rd equals x0 so let's assert rb
equals x equals zero and then we wanna
say
um shift shift one
make that a hex
all right wow we're really jumping at
1800 that's a pretty long jump
no we're jumping a c but we did it wrong
oh my god look at how you decode this
oh this is why'd they do it like this
look at how much harder my life's gonna
be because of this
oh jimmy ends look it's like jumping all
over the place
okay offset equals
gb ins 30 21 shift shift
one or with
okay right over here we have m20
which is in which is this
why do they do this
shift shift 20 or with that
or with jibby ends
20 22 shift shift 11.
i don't know what the binding precedence
of shift is
1912 and we want to shift shift
this 12.
that just happened to line up um
offset we should get like see all right
cool sees a good offset
the address of the instruction following
the jump
jowl stores the address of the
instruction following the jump
into register rd
oh rd doesn't have to be zero it's just
oh i get it i get it right so i actually
don't have to be zero
um
all right well i think here we want to
do this in like right back or something
but i really think we can just do reg
file pc plus
equals offset and that's gonna work and
then return true
all right that should run jowls
pc
all right now we just got to do an ops m
instead of doing that let's do this
this and
[Music]
that get rid of those hexes
yeah buddy all right cool look this
looks professional
oh it's for home we went professional
about to be
professional
um the rules of this channel is like if
you piss off a moderator you're probably
pissing me off
and you know i like don't piss people
off you know
okay else of off code equals m all right
we got to get m's to work
oh it's an open it's not just an m
should we call it an op-amp or should we
just call it a name
what oh
sham t hey shrolly
okay
we'll grab the uh rd
grab rs1 this looks universal
um
this is a j type instruction
and op
m is a
doesn't match any of these i don't know
it's this one so i type instruction
i type very good
we got rs1
now we're gonna change this all right
funk three
[Music]
equals jibby
and then we have m
all right we're gonna have to figure out
the funk threes
maybe
i could put jibby inside step
and then we wouldn't need to pass ends
all the time that's pretty cool i think
we should do that
this should work right
no oh
because we have to jibby up here
too much ends going to jibby
good
can i
okay those are the different fonts
while adding some are the same you just
set this differently
all right well this should be pretty
easy to write
uh class
we call it funk enum
i equals
three zeros split i
equals that slit
i u x y
i equals that
ri equals that
and i equals that sly
equals
you guys see where i'm getting this from
rally
also shrally shrai
um oh this is
wait how do i distinguish
oh it has a different i say
also add sub you can't do subby
no i can't do savvy
um
soul
dude this is actually really fun
we should get rid of the eyes i guess
there's probably like
a better way to name these things
like is there a table of all the funk
threes somewhere
oh
oh but there was more of a fence up
there are they called fence instructions
no it's a misconstruction
can i bookmark pages in here
formal memory extending oh here we go
let's just order these by numbers there
has to be only um
well we have three bits so
yeah that's it
also add sub what else is this
sly does that only sly looks like it's
only sly
what else is this no
no don't do that
i want to just light up all the things
okay also
slit
also slit you
um also xor
also before
also n so we're just going to get rid of
these
eyes unless
also and
that one actually is only ssli
so that can stay and get rid of the eyes
from those get rid of the eye from that
all right cool uh and we'll call these
funk three
should i put them all in
i don't know what enum is going to do if
i do this
let's try it for one
ah print
point three funct three actually we'll
do one better here
three loving the enums bro
i love python all right so it's a funk
three ad
which is great what if i also put sub in
here
what happens oh it's just that okay
that's good
they don't actually have to be unique
you're like george you can probably just
download this from somewhere but then
you
missed the point because we are learning
about how microprocessors work
okay uh this is an m so we'll say if
funk three equals at i um
here even though it's not all that it
should still work
it does so we're implementing anti
uh we're just gonna say i mean really we
should do this on the right back but you
know what i'm saying
red class of rd equals reg file
sub uh rs1
philosophy just implemented that
else
exception right
uh we don't actually want to return true
because we want to go to the next
instruction
file we'll have to refactor this in a
minute but
jump instructions all right great um
okay
well those are not actually ads though
oh i guess we're adding from from
register zero
let's put a print here
yeah that seems cool all right so that's
actually a lie
and now we just got to do an all pc
add upper immediate to pc
t0
what does this all pc instruction do
add upper media to pc is used to build
oh i get it
so it actually stores it in that
register
yeah okay cool so that's a dust thing
um so what kind of instruction is that
it's an all pc
else
right let's say right three
and here we'll say right up code and
then otherwise i don't have execution
stuff
all right great i don't expect an
indented block yeah because we didn't
write all pc
all right rpc uses rd
um and it uses an immediate
and reg file sub rd
equals
all right now we have an op system
csrw the mint vector
um that doesn't seem important
let me just ignore off systems for now
we do have to write sly
uh slli it's so satisfying to write code
like this
uh op bam oh we gotta deal with sham
tease oh yeah get the sham tea out
um
it's a logical left shift
all right we can probably write a
smarter reg file that deals with
overflows uh let's just write that now
um class reg file
get item x
item it's kind of like getting a set
item that's it that makes a lot of sense
okay great
okay hold your tears back just for
another minute
she wants your gift back so we come and
get it
and they all matter and they all care
about me i don't know what that's like
she's gonna want to fight me i'm coming
home tonight
argument but one was given oh we have to
give it a cell phone of course reg file
is an
object but i think actually you can just
do that okay all right
um right funk three add
wait can i write ad before
i broke something
when i break
who does what i broke
um
i don't even get it like how is it
complaining that i didn't
doesn't make any sense oh god
guys you can catch that fog
okay let's commit this uh let's
you guys know how to get tests
basic cpu-ish push
push
uh we have to write ops 51.
oh okay that's an op up
uh okay
i'm happy we did this in python first
we're really we're really gaining some
uh
experience here type instruction is this
this is an r-type instruction
oh god we have a funk 7 now and we still
have funk threes okay
keep the funk three around and we have a
funk seven
but phone seven definitely sounds like
later problem
uh
so the front of this all is then going
to actually be writing this in hardware
and you're going to you're about to find
that while i'm
you know top-tier python coder i am not
top tier uh
verilog
we gotta raid a lot of lux hello welcome
welcome new people hey
um we'll give a little overview of what
we're doing
um we are writing a risk
five core in python
um verilog
is not coding uh we're writing a risk
five core in python so
uh what is risk five risk five is an
open source cpu architecture
um so most of the cpus you use are in
big computers x86
and in small computers and in phones
they are arm
risk 5 looks a lot more like arm but
it's cleaner
and it's open source and we all know who
owns arm now
so you know death to arm ups to risk
five
yeah that's hopefully uh enough so what
are we implementing now
um so risk five has these different
types of instructions
they seem to break down all the
instructions into these types and then
they tell you about more secret types
afterward
which is kind of lame but that's just
what it is this looks to me like a you
type instruction that's an
r-type instruction
get rid of that
so now we have a add right from through
the funct add
i think it's just this
so we're implementing we're implementing
a cpu i downloaded a test suite off the
internet
and we're just running the first one
from this test suite which is supposed
to just
check the ad instruction but looks
insanely complicated for that
um but hey
what can i say uh yeah risk five is hot
you know we only bring you the latest
hottest stuff on this channel
um nvidia is a bunch of red seeking
assholes
but they weren't always this way nvidia
used to be cool
but you know like i've heard i heard i
won't name any names but like i heard
there's like a guy
in the crypto industry who made billions
of dollars and now he's like surrounded
by like handlers and these guys like
feed him drugs and bring him to clubs
and make him think he's cool but in
reality he's not and i feel like that's
what's happening to jensen
and nvidia like you look at the nvidia
stock price and getting a stock price
goes up
you know they think oh wow that's worth
a ton of money
you know they just think they're like
hot shit and like
i mean yeah
you know like here in video it was a
nice company
new nvidia bunch of dicks but that's
what fake money does to people
i mean jen's is still a cool guy and i
think he can bring it back i don't think
he's gonna you know pull a larry and
sergey
who honestly wanna talk about two people
who fuck the future more than anybody
else
larry and sergey
hey you know what larry's sick i don't
blame larry but fuck sergey i hear he
just like parties now and like he's a
fuck boy i'm like you know
you can do that but like you know just
the future of like you know the world
you live
hey hey who cares man go to the party
um
jaller jaller oh we have to
we should write in the jal reg file
sub rd equals reg file
sub pc plus
because we need to put that in the
jailer too
jump and link register uses the i type
encoding oh this is an i type
instruction
ah well then should we write a separate
decoder for it i don't know
um we'll figure out how to refactor this
first but we'll
we'll spend some time um
refactoring uh this
code before
we wait it's only ops branch
let's just see what's going on here
oh it's a bne instruction
wait because shouldn't be a jowler
oh wait it's not a jowler oh i already
going through the jailer um
jump in link register the target is
obtained by adding the sign
extended oh we got a sign extend
um
we'll just spell it out as sign extend
we think
how do i do sign extending in python
simply
uh
if x shift shift l minus
one uh equals equals one
i'm going to return something else it
might just be this
probably is right
equals one
sounds right
local variable offset reference before
our assignment
uh and this one extended okay so this is
my class
should i written a shorter reg file like
so i don't type out the word reg file
every time
maybe i should have no it jumped off the
end of the
all right memory change that a little so
it's not an assert
uh if less than
zero or um
uh read out of
bounds
ah my sign
extend didn't work
zero
oh position be plus equals it should
just be that
all right we still have a read out of
bounds
solaris one
all right that seems really normal
oh okay that's a jowler it's the jowl
that's messing up
probably because we didn't sign extend
the gel
let's go to b8 no
that's not right
i have to put these in parentheses
no
that can't be right
can i write that decoder wrong okay
that's m10i we shift that one that's
m11 we shift that one and that's 12. we
shift that
shift that 20.
can't be right where's getting that one
from
that's the problem
oh jimmy's wrong ah
this should actually be 31.32 i think
yes great we just didn't write branch
yet
bro we're going to figure out why the m1
so fast we're going to input all that in
our wrist
core and then we're going to you know
nobody's ever used video again
you know but i do imagine a jensen that
takes his company back from the mbas
um so i would not you know like some
companies i think are hopelessly lost
like you can't fix google but you could
fix nvidia
um you know we just need a jensen who's
ready to be like yo
guys the money's a scam we care about
the future
uh and you know maybe he'll do that i
wouldn't count him out
he's been around for a long time
all right so these are funk threes
branch instructions compare two
registers
god we have to do another stupid decode
what
this is a b type instruction
i thought they said there was only a few
types of instructions where'd the b
come from
we got a b throw some bees on that
bitch throw some bees on that bitch
something like that
all right some these are funk threes
b eq equals that
um e equals that yo you wanna do
beginning let's do beauty
we're having a dane cook
all right we're gonna decode this stupid
offset that looks a lot like this one
but stupider
all right so when we jimmy that we shift
it
12 we jimmy this
only down to 25 we shifted five
should be this and we shifted
one and we jimmy
this h7
and we shifted 11.
okay um compares to
instructions if funk three equals which
one do we actually have to write
uh whatever is that two
seven f we have to write the bins
i don't know what bin oh just okay one
of the registers is zero that doesn't
matter
uh
else dump right from three if
uh reg files of rs1 is not equal to reg
files of
rs2 we want a branch else we want to
just
um
yeah we want a branch
sub pc
offset uh
return true
all right we gotta write scroll well we
should do this in
all right i have to write instrol
uh it's not really a straw let's play
raleigh
maybe that's right
let's figure out where that is we're at
that's astrali okay cool
right up up store no just write to
memory
oh that's hard did we do anything with
memory i don't know memory works
all right we're gonna do a store op code
stores here we go load and store
instructions
put them down below the branches
8 45 not bad
uh how's memory work who knows
just like fucking magnets you know how
do they work all right
um funk three is not actually a funk
three it's the
width uh we have an offset which we're
gonna
jibby that
uh i don't know we also have to jibby
uh 31.25
um
loads and the stores are s type they
just made up a new type
because s starts with store store
starts with s s is for store
uh store
the effective address is
obtained by adding register one to the
sign extended
add it to offset
and then what we want to do is we want
to all right
god is this really how i have to do this
now let's do a right string
um
let's make it work
uh value equals
boom okay
we store some stuff we have to write
or i thought these tests were supposed
to be just simple
i'm sure it's an ori
no such thing as worries
too many r's in my ori oh we have to
write a louis
what's a louie i should remember a load
upper immediate
oh good louise look easy great what type
is this
it's the same as an off pc
we'll put it by the off pc it's really a
utype instruction
let's do a louie load upper immediate
places the filling in the lowest 12 bits
with zeros all right this is super easy
all right we gotta write the op version
of or
coding like this is super satisfying
it's just like you like fill things in
one at a time
read out of bounds oh all right we got
another broken jail
where is that jail supposed to be going
to cpu t string
oh my sign extend is probably wrong
oh i don't think i did a sign exchange
here this has to go back
yeah it's going back okay we gotta do a
sign extend
uh how many bits is this
how do you write some logic in hardware
um
20 bets
damn it doesn't work
do none of my sign extends actually work
is it not 20 bits well that equals one
okay so that should make it negative
then if i type 20 there
um oh
no it's 21 bits
that was even worse
all right so how do i actually do this
we do one shift above 21.
and then this minus this oh i think we
have to make it negative
probably like a way to simplify that
expression really easily but i'm lazy
all right good
all right so now we're jumping to a load
is that what happens in cpu to string
oh it does sweet we gotta write loads
loads are like stores but
loads
pop um
where are my loads and stores
oh they're totally different never mind
are they both s-type instructions
loads are encoded in the i type other
eye type instructions we know the eye
type
load okay so we'll just do m
i'll have to sign this down too
just say load that
bass desk
sprite okay
variable value because loads don't have
a value
actually write ram nobody wrote ram who
are ram nobody
all right right ops branch funk add well
it's not really an ad which is the same
one as that
beq all right so we don't just write
bnes we got to write beq's
uh we're just
good refactor boys what do you think the
very factor
zero is not a valid ops oh no where did
we branch to
branch to here
seems okay
oh i think we're supposed to sign extend
that uh
great oh look at how much running it's
doing
i mean i don't know if this is just
looping forever
i wish they would actually give me
simple programs and not all this stupid
crap
like i might actually have to implement
the loads and stores
switch to the p test are the p
tests better which p tests
command paul do you actually know what
you're talking about
these p tests okay
oh yeah they do look a lot shorter
you're right cool
great uh all right this is testing blit
you but we can just test dad
okay cool no user mode
oh that's all this crap's user mode oh
we should check privilege mode
that's a good point yo command paul
coming through man
command paul coming through
you know what we haven't done this in a
while but
congratulations you
wait how do i do this
how do i make people vips
vip command
paul congratulations
thank you for paying attention
uh so branch is not actually it's not
actually xor it's just the same one as
xor
blt you just implement them all they're
not that hard
b l t b g
e that should work great all right we
have to write miss
i don't think misk actually does
anything i think it's like system ops
all right zero is not a valid ops um
on imp
oh okay well we have to figure out what
an e-call is
does that mean oh that just means it
succeeded oh okay
cool
um
i think we'll just return false on
system
is there a difference when you call any
break
oh it's just this i don't know i think
it's actually a difference
wait what's that
oh that's csrr it's not that
um if
all the rest of them are zeros
actually you know what i'll just say
if uh not opcode but
ins equals ops dot system
oh no we actually want the number for
this um
yeah that value
great no wrong
okay there's an e call there what are
these e calls supposed to do
i probably have to like implement this
risk five eco
okay calls the operating system all
right so on the operating system that's
great
um how do i know like what sys calls am
i using here
it's like that one's passed and that
one's fail but they look the same to me
oh except maybe the value in gp
you go to a register called mintvac
ah so this csrw mintvac actually does
something
mint vac uh oh it's the address of the
first instruction to be fetched when a
machine mode trap is handled
okay so great
it's in the priv spec okay all all right
is there like tests for like not private
not user
is there test for idiot because i'm
idiot
um v
and p
uh
i'm upset about this priv spec thing
what are you guys all doing that face
i'm gonna write this
oh make a mint back work
i don't have a mint back he sold my mint
vec on ebay
counters eh oh
yo a trap vector yo
we gotta make a trap i get it
right to host how do we write to host oh
we swa
after all he's saying yeah
mint back
oh this is junk we don't need that
anymore and we'll say mint vec
33 and now i gotta make this cswi
work um
csrw
right csr but i don't know this is like
encoded
csrwa
i don't want to have this scars
can i write this right this thing's op
system
yeah they're off system
all right it looks like funk three
um
you don't actually do that for recall if
three
equals equals b r one
fine i'll write them in here
this this was all great until these
instructions came along these
instructions suck
like we were all having a good time
and then like we have to implement this
does anybody else understand these like
the other instructions
stupid instructions
below this
below this line all right great like we
were all having a good time and then we
had to write this
junk
three um
if three equals ops
point three csrw
uh oh i don't even know
it's not even rd wait oh is mint back in
rd
does that fit no it can't fit because
it's only that many bits
we gotta write this one what is this
oh it's a csrr oh
wait what's a csrr
it's the same as a slit which is a csrs
oh well
very important to write the csrs right
next to the csrw
hey hey canada a
all right um let's figure out what a
csrs
does source
they modify
you
atomic read and set bits
what i need an m hard id
i don't have an amahart id
oh well we gotta write the sat p i hate
these instructions
this is the worst part
no it's only this crap that's stupid
it's all fine until this
eight six eighty four oh
one imp zero is not a valid ops
this is another ops system
okay well that test passes
where do i get a list of all these
registers it's not just like one more i
can stick in the reg file
that was a lie boys
um that's the end of the test the scalp
triggers the shutdown mechanism scalp
all right well it's a csrw and i'll say
if
csr equals
this print success
return false
okay so does the fail one also do that
no the phil one just does an e call and
then cries
the e call is the important thing wait
it's failing
oh it's actually calling fail oh that's
sad
it's just failing through to success
we do an e call here too we gotta like
make the e calls work
i can't believe i wrote the csrws
is this right is this actually how it's
supposed to run
why creating crypto related stuff can we
ban that guy
band get out
oh the test files aren't committed to
github i just cloned a separate thing
make the font a little bigger
[Music]
ah
that's the failed e call there's daddy
call there's also an e call here
you know what maybe i can read the uh
the code for this to try to figure out
what it's doing
i just search for risk five tests if you
look hmm
so it's a lie that we actually have
success we'll get rid of that
okay we have to just figure out what e
calls do it's time to read
hearts
the e-coll instruction you just make a
search scratch the execution
sweet glad you're glad you used twitch
lamb for something
um
what if we go back to the not p ones are
not p1 is even worse the v's
these just loop forever
where am i jumping to the start of fail
that's a good point
um
i guess i jump from uh 200
this one here test seven
all right so like test seven is the test
that's failing that's not bad
i mean we do know which one's failing
now i just wish there was like a smarter
way down
yeah so right here that's what's wrong
let's go dump in here
um fails right here
trying to compare
[Music]
a4 and t2 oh my god but i have to name
these things
all right
which test doesn't
oh yeah we were just about to name all
the registers properly
those aren't those are the names but
there's better names
i don't know where they are though
these are f registers where's like a0
what does it tell me which register here
we go oh yeah
um
okay my louie's wrong
it's probably not 12 if it's more than
12 or i didn't do the m decoder i
wouldn't do the md code right
yeah it's gotta be a 12.
all right are we still failing we're
still failing but now we get
further down and we're failing at
[Music]
260.
ah okay
branch we compare a4 to t2
a4 is there and t2 is down okay they're
different clearly
do we sign extend on the m's
probably did not extend 12.
oh now we pass i think
yeah we passed now cool
i really would like to automatically
distinguish failing and passing
um i guess
we can
that 93 is everywhere though for all the
equals
all right let's just print reg which is
gp
0 1 2 3.
reg
let's go back and let's just break the
test again
not that before
okay so if we get equal 21 that's a
failure
we get equal one that's a success
um if reg file
sub e equals 21
is that in hex
15. failure
raise exception
failure and test please check
okay so now we have failure and test
please check
and now if we go back to m and we put
sign extend with the jibby
all right add test passes
let's stop dumping all over the place
great uh
we reset that i need to reset the ram i
don't
think
memory
great all right now we all just test
that let's do all the tests
okay got a new failure because we didn't
implement
one of the brand job codes
i thought so we're just going to
implement them all
be any wait put this on all of them oh
what's you
on the side
oh god i'm supposed to do these things
consigned
ah 32
all right bltu passes we'll get rid of
that break there
all right we didn't implement xor and m
oh i but the face can't move back sorry
oh we're gonna implement it in here
i should really actually share those
should we just like
they're they're all they're all shared
right
man
i don't know probably how i'm gonna have
to implement it on the thing
funk 3 xy
slt sll slt
[Music]
sltu
well that's not a shift at all
all right here we out what slt does
set if greater than zero cool
ah i guess it's just
slt is the same as compare
and sltu is the same as compare without
the sign extends
i guess that's not right it's just that
and sltu is this
all right something didn't work well
oh my god it looks like all these tests
pass then
until we get to fence eye fence eye
doesn't work
um let's blacklist fence eye
it's fence eye's stupid
sweet holy test pass
not too bad
where am i printing out all that crap
over there
so wait the loads and stores are
actually working
like but not really
and who knows who knows if those tests
actually pass or if we're just failing
at the uh
let's add the prints back for e-call
all right maybe it actually fails if it
ever returns anything greater than one
if reg file sub e is greater than one
failure and test please check okay then
the sub test is failing which actually
the
subtest should fail because i don't
think i actually wrote some so you know
oh and that's a number of tests that's
failing
wow that's nice
so it equals zero when it starts and
then maybe that's the number of the test
that fails
all right let's check the subtest and
see why the has fails
let's turn the dumping back on
it's branching from
here
well let's just like right sub you know
so
sub and and are actually the same
um
i can just change to this it does the
same thing
all right i think what i'm supposed to
do here is
invert it if it's sub
um yeah so the sub is function seven
uh if funk three equals point three dot
n and seven equals
that then print
sub
yeah okay so that makes sense because
that's actually failing
uh what we want to do then
is subtraction of rs
2 from rs1 which is the same as
okay
now it feels earlier no it's not right
um
that is right though just
maybe we have to uh
recall fine okay now it fails earlier
uh
oh actually subtract
from rs1 so we're going to just do sub
failure test check
okay ra is that sp
is that and we expect the value to be
in a4 zero
didn't work
which doesn't work
i don't know this just might be no wait
sure it's failing
oh i see because sub didn't work it was
like
some other tests that actually failed
didn't work
okay now sub passes
some other tests started failing oh i
mean yeah i guess actually yeah that's
fine actually some other tests just
failed
oh yeah get rid of the dumps because
we're actually getting past sub now
yeah there if you look sub is passing
okay
lawrence load and store don't work okay
and we know load and store don't work so
that's great
try should work
okay i promise ryan is the same as srl
yeah so it's the same like bullshit as a
sub
arithmetic right shift
so again the difference is that there's
a different func seven
for it
this is annoying
yeah it keeps the sign bit i get it
i was just gonna be a bitch to like
implement all and uh
this is a stupid instruction
is this immediate that it's failing at
or the other one
it's immediate
hmm
okay uh well first off it's not minus
um we want to shift it right
uh
so
sweet sprout
fails but not till much later
i think it's failing because
yeah this shouldn't be a problem but it
might be
all right cool
all right lbu is failing because it's a
load that's fine
all right slid iu doesn't work no
one surprise there
why doesn't slit iu work
these good instructions sets rd to one
if rs equals zero
seems right
both are treated as signed numbers oh
i think uh well i don't know if sltiu is
using
cannot sign extend right yeah i've heard
in sign extend right
except yeah
i did sign extend maybe that's the
problem
oh
you can't have that i think
that my side extends slightly longer
no you don't want that
i can't actually have that though that's
the problem um
i think this is the problem here
you can't have negative 20 48 if
something's only 12 bits
right yeah that's
zero
problem is if this is
who knows how to fix my sign extend
logic
python side extend
sign bit equals one shift shift
l minus one return
x and sine bit minus
one minus value and
it's not wrong okay maybe it's not sign
extent
just like you
oh it shouldn't be negative i see
great new problem
good
this is a deeper problem ah
let me just do this up here or you know
what
no it's not right whatever
see there's a lot of subtlety here and
i'm doing it wrong and i'm not thinking
this through well
it should be a signed comparison
okay all your pc is failing
i'm gonna test five in that one
turn dump on let's see where it's
actually failing
here
extend it
i don't know i don't think that's right
this is the same as this crap
same failure
uh all right let's look at my pc
it's a 20-bit
32-bit offset filling that oh it's the
same as this
all right cool the jowl test fails now
that's even an earlier failure
ypc forms a 32-bit offset filling the
chances to the offset and places the
result
in
all right that fixes that uh straw is
failing
uh i feel like the same reason this ship
fails
and
still fails
it's calling straw what i do
this is the same right
subscribe
oh
i was hoping someone would spot that
that's spottable
okay straws work lb fails that's
expected
what are all these load instructions
jailer fails
don't sign extend it's probably that
that's what you always get wrong here
i did sign extend
um why is jail or failing
i thought this was going to be easy just
going to write this shit in
you have to verilog about how we're
going to write it in verilog you know a
bird in the thinking is worth two in the
not thinking and just spam programming
what oh oh it's because they're both the
same
um yeah you gotta the order this
matters uh
nv equals this
see the problem
actually that one doesn't matter
cool all right i think that's all the
tests
boom all the tests all right that's
right what's the stores
casts
all right we need a working memory model
now
uh
okay
sd sw sh and sb
uh from the low value of register
low bits of register 2 to memory
respectively
okay this doesn't seem too bad
well in some ways we have to write loads
first
so you know let's we're just going to
test the help wlw is fine
because i mean we could write stores but
we wouldn't test it until loads work
um so what else is true about a load
okay so it's not actually a funk
three it's called a width
if the width is two i don't think that's
right
just an lw right it should be a word
yeah okay so this is a joke that doesn't
actually correspond to anything
um did i write all those things out
no i didn't so it is actually a funk
three
it's not too many i'll just write them
um i mean this is one of the things
that's going to be subtly wrong but i'm
lazy so
5 32 adder
um
extend
use here all right that should make all
the loads work
um get rid of that
boom first try i love when i get things
on the first try i have to write stores
stores are
the same as l m
s h
[Music]
[Music]
flag
oh my gosh your right memory uh
[Music]
ws
who remembers these things not me
throw a b in there value
and that that seems right
i get this right on my first try
probably not this one's harder
unsupported operand for bytes and int
um oh just
type it backwards
that's kind of stupid i don't actually
like that convention we're just gonna
switch it
yeah you should have done this shortcut
and it would have been faster alright
cool story
all right all right fine we'll figure
out what fences are who likes fences i
think fences are dumb
in a world with no
houses and doors we don't need any
windows and gates oh fences already work
all right great
i didn't write a fence but it just works
so that's great
okay boom
it all works it flushes caches well
you know how many caches i have none we
gotta direct to memory architecture here
in a world with
no toilets
who needs flush
oh it's fence it's not even flush that
makes no sense at all
one of my more nonsensical gift commits
all right cool
look all the tests passed i love when
test pass i feel so satisfied
all right so that was like 200 lines of
python now how many lines of verilog is
it
um so guys now you're gonna run into
this problem
and it's that i don't know verilog
it's a linkin park line bro
all right let's go
i'm gonna have to write the same thing
in verilog
well okay so let's first think about a
few things
one we need a pipeline
let's let's refactor the python to look
more like dialog first
i'm not sure we need sign extent here
we do
why
don't look i don't get it i don't get
why i need
yeah so we're going to refactor this
python code to
to do something more sane
and then we'll be able to write this in
verilog
pretty easily even though i don't know
about our log
okay so rd is always in the same place
if we have an rd it's there
that's going to be an optional right
back of the rd i don't know why i
deleted the other things
cpu pipeline
okay instruction fetch instruction
decode and register fetch execute
memory access register right back
so we shouldn't be writing these
registers
all over the place here
let's say something we'll say npc equals
reg file sub pc
plus 4. um
right here we'll change this to npc
we'll get rid of this return true this
is the first thing i certainly connector
uh what's also cool about this is i can
now get rid of this nv
hack that i added
um and like it's great now that we have
tests up see now one of the tests failed
so i messed something up
oh i didn't actually do the right back
of mpc
so we're going to say here right file
sub pc
equals npc
um get rid of that
stupid
okay something broke
yeah so npc equals reg file
sub pc plus offset
i understand why that doesn't work
should have any more returns
what i do
even the simplest thing is failing
i didn't even change that much
i set the default npc value to be reg
file pc
plus four
which is right
um but i bet you know like every mistake
we make here is one last mistake we're
gonna make
correct file pc plus equals
pc equals r1
for pc plus offset
no let's try dump maybe it'll become
obvious
split you
i think it's 68
what oh let's just get some more
494 equal
it should be okay
oh
wait what how did you like that before
oh i had this oh okay that was so dumb
actual exact
all right fine
uh we'll call this the pc right back
refactor
by the way if someone wants to put a
pull request up on this that
automatically runs these tests
i would merge
okay so we have to change every place
where we
access reg file
and we'll create something called
uh append
uh we'll say like pen equals none i'm
gonna bring rd up to here
it's always the same rd which is nice
and
and
uh if pen is
all right all the tests will pass
we'll call this the rd right back
refactor
um okay
instruction fetch is a read from memory
instruction decode
uh
the classic
yeah okay i'm gonna put logan's store
down here and say these are the memory
access
step
see they're going to take longer
you see the problem because like that's
not free
can't cite examples though there are
risk five
compliance tests
under death
uh yeah it's okay if they're not
exhausted right now like we just got
basically an idea
we're gonna have to fix bugs on the uh
in the varilog probably too
okay
so like i don't think there really is an
instruction decode
are loads really eye type instructions
oh yeah i guess they're the same as
these that's cool
all right um
i think we want to add alt to arith and
put this in the arith
color
if alt
should work pretty well right
except there's not really an alt
there's only an alt for ad there
because there's no sub there's no sub
immediate
yeah otherwise they're always here oh
wait sra is also there
yeah okay that's fine so intermediates
that's yeah cool
um and then
so sry is overloaded with
srl what do i do about just normal s oh
it's sra
okay if alts
i'm gonna do this
oh i was still sitting reg file there oh
that's bad
but yes we should be able to get rid of
this now this actually should be penned
refactor
eris
all right should we write some reading
for twitch core uh risk
five core first in python
then in
verilog then on
fpga
notes
execute
all right i think rs1 and rs
2 are always the same
yes when they're available they are
okay so what we're going to do is we're
going to move the register
fetch yeah okay we have to move the
register fetch outside
that's cool even if it's useless it's
okay
we have to move all accesses to reg file
basically outside
i see why people say this is so well
thought out
like look at how easy this is
move rs1 and rs2
outside okay now we're going to move so
this is not just going to be
instruction decode it's going to be
instruction decode and register fetch
so we're just did i do a good status
does uh
i want to confirm that the only places
we actually use
rs1 here
are in here so we're going to say vs1
and vs2
equals reg file sub
okay and then instead of saying reg
files one we save the s1
ps1 vs2
you guys get why i'm doing this
the same way that we moved the store of
the registers to the bottom
we wanted to move the fetch of the
registers to the top
sweet
um
all right we're just gonna do another
vpc so we're not fetching reg file pc
hmm
all right so i think we can refactor
that stuff a little bit too
we're doing the same refactor um
[Music]
notice how we're fetching again we fetch
for npc here
and like that shouldn't actually be
right
maybe what we want instead of this
is we say like
that's not right
i mean i'd like to use the same
arithmetic core
regreed reflector
who likes my is that alliteration
alliteration
pipeline hazards you seem to know a lot
about this i don't really know what that
is
um
i don't really like that as much
okay is funk 3 always the same
it is so we can bring that out into the
d code
okay so actually we should move all
these jibbies out as well
dependencies between instructions when
each stage is parallel
wow this is this is all getting super
hard
31 stage pipeline damn
oh hazards
[Music]
hmm
okay um
i think we should move this sign extend
down to here
same with this extent
same with this side extend
this side extend
and then we can decode all the
immediates up top
but based on the different types
because that's not a real sound extent
that's going to just like be in the ad
yeah look up twitchcolor um i should
probably write a script to fetch the
tests but i'm hoping one of you can do
that do we have any polls on twitchcoil
yet
pull the requests boys pull requests
i want the test to be automatic run
better tests find bugs
you can run this it's this is a super
accessible project
it's one file it's a cpu
okay so
like whenever we have i type
instructions we're using that same
immediate
so i'm just going to bring it up here
and call it imm i
cool
um when we have you type instructions
how many you type instructions are there
let's go take a look at this thing
okay call this guy mu
cool everybody have a u-type
i type s type b type
um i hate j type
all right i guess funk 7 is the same
thing always
the two places we use it
this is not even the same type this is a
b type
so you type can be a b a u
or j
all right we'll just call this one mj
instead of offset m
j
m b
csr
i will op system and i type instructions
um
okay they're eye type instructions so
instead of csr we just call this one mi
which makes sense
okay okay
so now we're all doing all the d codes
up here we're doing the register fetches
here
this is looking like something we can
actually put in the verilog
okay now we probably want to use the
same
arithmetic engine
uh for these right like we're not going
to implement a new adder it's the same
adder right
so let's just call arith
func 3 dot add
vpc sign extend
uh false work
great uh that doesn't go into pen
this goes into oh
i mean okay these are cute look it like
swaps what normally happens
let just put it into npc and not depend
this is penned equals npc but we'll get
there
um let me just create a
uh
we'll call it um
cond the s1 vs2
3 vs1 vs2 just so i can like refactor
this up here
this is the real value boys learning how
to refactor you know
like you you watch me code and like
learning to code is good but
learning to refactor
conned funk three ps1 vs2 like
what i'm doing now is thinking
like obviously these refactors don't
change anything i'm just checking with
the tests run exactly the same
but
what this does is makes it so like i can
think about how to actually make it in
hardware
uh how many of you have some verilog
experience
um if you're getting no module named f
pools you have to pip install
uh altos i
you people with verilog experience do
you understand why i'm doing this
or at least some some hardware
experience
uh
all right let me move branch up here
actually
yeah that's good branch goes up there
those are the things that said npc
yeah it's a risk five core in python
all right do you want like you know what
you know what
you know what
text create new
writing
risk five core in python
all right
i don't know where'd my text go
it's gone
let's try again with new text
risk five core in python
yeah okay is everyone happy now
is everyone happy
uh oh we have to move this
this last offset for s-type instruction
we've got to remove the last jibby
at least move it up
do i already have s-types
quite ms
i'm gonna order these in the way that
they order it here
okay there is no mi but ms is real
hmm okay now my question is do we
actually want to move the sign extends
up top
we might
so first off let's see if we can do this
yeah i think we want to move the sign
extends up top
it's the same thing over and over again
cool
it was pretty good
let's see if we actually moved all the
jibbies all right we moved all the
jibbies
um is every place i use am i sign
extended
or could be yes it's fine great
okay let's sign extend
gb12 and let's get rid of all these sign
extents for mi
oops
hmm okay it didn't work
that's not good
let's first undo
that's not something to be scienced at
it right
see 112 bits oh maybe that is the
problem
because yeah that's the only place that
doesn't have the sun extent so that's
like not even a real one
that's a hack
it should just be negative
yeah negative one two four
sweet okay let's move the other sign
extends
um so mu is an interesting one
mu we're actually gonna put the shift in
here
all right and then we can write all this
decode logic and verilog pretty simply
um all right
mb
let's extend it to 13.
one place we use mb
ms get sign extended to 12.
uh what other m's do we have mj you get
sonic 221
great okay those the only sign extends
left
okay well those ones are different
because those are used in the ram
pipeline
move sign extends
look i'm making my channel more
accessible to people
am i not
all right so
i think we want to refactor this npc
thing a little
i really want to set penned to that but
set a flag in those cases
what is it not in ops branch is is is
it would be really nice if vs zero was
if uh r is sorry
if rd was zero in a branch instruction
it's not it's part of the immediate
you see be nice with zero because then
oh my god
yeah the colleagues return address i
mean yeah it needs these and like that's
why
i'm trying to like work out like
there's like one register right back
really
and always uh there's two register right
backs there's a pc register right back
and a uh pad register right back
optionally
i really want to put these in pen
and then i want to change rd to be pc
but not exactly
plenty about the color of my text
you can have blue text everyone like
that
the fetch always assumes next pc
until you have to do a pipeline flush on
e
oh no i have to do pipeline flushes i
don't know how to write any of this oh
you're right
you're right oh man because if it
branches
the next fetch is wrong
oh i should have paid attention to
computer architecture
pipelining isn't that bad you can start
really simple
can i though
hack stall fetch when you see branch
what if we don't do any stalls and we
just like you know it like does an
instruction
and then it's done and it like does
another instruction and then it's done
it like does another instruction
i like that
no i need a hazard detection unit damn
how do you guys know all this
yeah it just takes three cycles to run
an instruction
we do a fetch
the single cycle yeah yeah what do you
think
single cycle that sounds fast
so
you just had a unicorn processor
architecture yeah
should we go back to speedrunning
pokemon who wants to speed run pokemon
uh also we gotta get some food
let's do 8k
is i don't think that's actually
that's 8k that
too little akb is good
did you just a piece of pokemon yellow
no i'm using a different camera using
this one
i'm gonna make some pasta
what does sun extend 32 do
i don't think actually i don't know
i know that i have to get rid of those
pluses
i'm gonna have to put the uh
hmm okay so like we do wanna like we
wanna put this stuff in pen too
but we don't actually want to do the
register right back
yeah like my little trick of like penned
being null is not very good
we want to like set some bits
it should be pretty fast though once we
like once we get this
you could use the register right back
what's blue speck
oh
all right let's look up let's look up
pipelines
memory access we need to do
okay so we're gonna we're gonna set some
flags
not if pen is not none we're going to
say
reg right back is false
so i'm gonna do pc right back equals
false and for these
yeah okay well we'll get to that later
but
either way um right now everywhere we
set pend here we're going to say reg
right back equals true
um
damn it loads are hard
pc right back equals true
append is pc equals true
here
and is pc
um if drag
right back if
pc right back
not penned uh we actually want to say
rd equals npc
and here we say
if pend is pc
that
i'm not in pc vpc plus 4.
okay that broke something
oh because we didn't say red right back
equals true here
okay
all right so we have two we have three
flags
reg right back pcrd right back
um
the other thing we could do
is um we could do it if it's a branch
instruction
set our d to zero and then we can get
rid of that flag
um
and we can like always effectively make
it
see what i'm saying
and get rid of pcrd right back
we can always do it if we have panda's
new pc
append his new pc we say this and that
else right
yeah that works
is that implementable yeah probably
and we don't actually have to set pen to
none because we never actually check end
we don't use it okay
um
it makes me
you know who made like spaghetti the
canonical pasta
who's like a fan of spaghetti answer
[Music]
nobody
again
about spaghetti well what about some
spaghetti
oh it's like that is overrated
[Music]
um
so
[Music]
um
i'm gonna hug cram yo quick
are we back
all right cool i hit the plug again
but it was different
okay so now all of these things
should be replaced with calls to app
except it's mb here
uh this one is mi and vs1
[Music]
um this one is mj and vpc
let's make sure those are okay yup
all right so that's a call to aerith um
i guess i could make a custom one there
that just does nothing
uh well actually i don't need to do
but the spaghetti doesn't fit in the pot
you know
how hot i have a spaghetti but it
doesn't fit
it's stupid it's like super thin yeah
it's as dumb as pasta and i don't know
why i ever bought
i'd like whoever you know if anyone
answers his video with timestamps
like this is the part of the video where
george goes on a rant about spaghetti
three minute rant about spaghetti being
a stupid pasta
this doesn't even really fit the pot
well
so you guys can't see this but i'm using
a spatula
to push the spaghetti into the pot
now with one spaghetti everywhere
[Music]
it doesn't spread out see these are good
i don't want the spaghetti to cook
i never made spaghetti before
four minutes wow spaghetti cooks fast
maybe that's why people have
[Music]
break it in half oh wow we lost a lot of
viewers when that shit glitched
or maybe it's just my thing that's wrong
no we actually just don't have viewers
anymore
no the viewers are gone
was it the spaghetti rant did i upset oh
the viewers are coming back
okay here we have to just write pend
funk three add vssmi
false
i mean that right might really be
today's stream you guys could see how to
how to push this into uh into verilog
and maybe we'll do that on the next
stream if we continue the twitch core
project
but this was fun we learned the risk
um we have to like okay so we have to
build the arithmetic engine
the conned engine
oh here's something interesting i can
move this up here
can i i can't
you guys see the difference and then i
can just say
panda's new pc equals con
oh yeah yeah good refactoring
uh
command paul nice having you here
i know the viewers are all coming back
um
right back right back to store
we don't have any hazards in our
pipeline now do we
oh
you know what
if i do that
then i don't need this anymore
sweet
oh yeah we just gave that on reg right
back
cool and it just like switches them
based on panda's new pc
oh that's clean
alright so now you can see like the
execute engine is going to have these
outputs
um spaghetti
this is actually looking mad clean i
don't know how we're gonna do hazards
yet
i go ahead and put in stalls
and then once we get to out of order
execution i really know
nothing about what happens but we
definitely need out of order execution
to get maximum speed
like the m1 chip
all right spaghetti spaghetti
marinara sauce and spaghetti
oh that's a lot of sauce
spaghetti
um all right here in this
s-type instruction
do that cool
all right now pen is just the output of
arith every time now right
only exception is when we do these loads
um
i hate the why why fuckers um why
fuckers
they ask why it's a dumb question bro
the standard y rant goes like this if
you start asking why too many times
you'll just sit in your bed and watch
anime all day
that's what happens that's what happens
to why fuckers
can there be pipeline hazards if there's
no pipeline that's a big brain idea
the text is one bigger you want the test
that says rings five four and python
bigger
[Music]
i am still here but am i gonna leave
tonight
for la i think i probably should
i think it's time to get on the road is
it time to get on the road
[Music]
[Music]
um
this is the only one actually that's not
the output
[Music]
[Music]
all right so now
for reg right back we can actually
just set it to a uh
a big of a bunch of ops i think
are we far enough along we're just ready
to go to the mainland
[Music]
[Music]
[Music]
so
[Music]
um where are the chicken tenders maybe
we'll make chicken tenders later
let's move this crap down to useless
land
the r type has that i type
doesn't
for that alt bit in aerith
dylon dylon dylon dylon and dylon
so
well it's hard to make fast cpus
it seems like the kind of thing though
with pipelines that you could like get
ai to do for you
and by ai i mean search
we'll do a little refactor here we'll
just
do we actually want to do that
it's actually based on funk three
i'm happy i'm very happy with that
okay i think it's very long time
how do you code verilog that's a great
question i have no idea
but i do know that in tiny grad fpga i
actually have a whole implementation of
a risk 5
processor we're not going to look at it
too much
but we are going to just like remember
syntax
wow that's a lot of stuff
last thing you might want to add here
would be exceptions
i know it's not pipelined oh do you want
me to write do you remember like the
python so it emulates the pipeline
i could but i don't care i mean i could
i i could write that as like a pipe
but it's not actually pipeline to python
um
module what should we name the processor
which we name the processor hot pasta
martha candy
risk
hot cpu
taylor big titties
why fuckers
oh small titties oh
wow we got all varieties of titties up
in here um
i like candy candy's a good name
my processor will not go up to become a
stripper
uh all right so
we're gonna have inputs to the cpu
clock reset
and i'm gonna have an output reg
trap those sound nice
uh i'm gonna like put the memory no i
should probably i should probably copy
that
i don't know we shouldn't copy too much
okay
wow and it's just like give me an idea
of verilog syntax
quadrants oh damn this is complex
looking
yeah we want to say things like always
at pause edge of clock
oh and i think we have to begin the
model
we have to begin the module i think we
have to begin
and end
okay
um candy
is a low performer
performance risk
five process r
okay so first we need to write the
decoder
uh
module let's get rid of this i don't
think this is
code
oh man are we building a harvard
architecture or von neumann architecture
i don't know
always at pauseage o'clock
okay we have an input
instruction what did i call it here
i called it ends we have an input ins
oh my god we're gonna have to do things
like multiply wait is there a multiply
i don't think there is do we have to
write multiply
sweet i don't think we did we only have
to write like adding shit
oh nice that's right write a software
multiplier who uses multiply anyway
um
okay so the input is an ins at 31 wide
ends and then like
output rag
uh up code
where's the register file
this doesn't have to be this is
combinatorial logic
um op code is how much long if it's six
comma zero then that makes it seven
oh just six comma zero oh that's easy
um so then we can say things like op
code and this shouldn't even be
combinatorial
uh
a sign op code
see i told you guys i don't know this
um
yeah yeah yeah no we don't need an
always a positive clock i i have done
this before so i do kind of want to do
this i'm not a total idiot
all right assign op code zero
semicolon
decode can we instantiate a module
i can make wires
how i compile verilog
verilog simulator
mac icarus theralog
according to these instructions you can
install it oh this is great
can i brew install it
brew installation let's go
verilator is nice
all right how do i use icarus
stephen williams help me out
for a new
all right all right that was good
it's all great yup
stimulus
how do i run it
simulating with verilog here we go i
verilog
oh now we're talking either verilog
cpu.v
syntax error i give up
that's the worst error i've ever seen
you know if clan gave errors like that
you know what i give up oh
and module begin module
no it was only an end module
oh you don't begin modules you bet you
do put a semicolon out of them and then
you type n
module oh man the syntax this language
is very modern and good
okay um there are some ways that i can
display
things
display
display
bob
nope i can't display bob
can we monitor bob
monitor bob
invalid module item
let's look at the top do i have to
instantiate it or maybe i have to call
it top
an invalid module
might want to use vcd what's vcd
is this another verilog vcd
do i have to tell it about candy
can't find any candy
okay
ah gtk wave
what's vvp oh we have vvp
iverlog dash o dsm
what's a.o oh is that my verilog did it
compile it
wait that's got to be illegal can you
compile their
log
run
start verilog
right there log run
velocity parser
i don't know about this
dump file
invalid module item
vvp run hmm
invalid modulin right
vvp sucks
verbose huh
i see
all right after i vp it then what do i
do
how do i add a clock
oh i have to like like test clock for
verilog
test bench clock i can't remember that
i give up
display doesn't work
invalid module instantiation
i copy and pasted the example
all right module
[Music]
do i need an initial begin
and
that doesn't work or maybe i need an
initial begin
opcode is not a valid
l value in decode
opcode is declared here as wire oh
because you don't do that in initials
i get it oh
okay okay we're making progress boys
look it printed out work oh
yes oh yes we we
know the verilog all right
um
module test bench
uh we don't have any inputs to test
bench
and module
um begin we'll say
red clock clock
zero
always number five clock equals not
clock and then we're gonna make a candy
with a clock
a zero and traps are stupid
oh i get it that's not even a part of
the module
it's just a red clock
i just have more syntax errors oh
you know like this thing could like do
something and like tell me
okay that's not how you make a candy
candy candy
malformed my ass
oh port 2 expects one bit but got 32. oh
i could do something about that you get
a b
it's not that fuck
one b zero yeah i remember verilog now
why you malformed
syntax error
see
initial pound
100 finish
syntax semicolon
work
always at five
in val modulite
again and
work
no more work
and it doesn't get to no more work but
does it do that
that's strange oh i guess because you
can't put it after finish
all right let's just remember if i
remember any verilog
um we'll do something stupid like
always a positive clock uh
it's not a sign is it
no it's just like this it's like count
count plus one
and then no more work and you can
display count
no more work ten
doing work
sweet oh yes
oh i'm remembering all the verilog is
coming back to me now
all right now we just need to write a
cpu that's the easy part we got the test
benchmark
um
spaghetti does not hold heat very well
either and i must say
spaghetti has many downside
and one of them is
um
all right is there a way to write sign
extend
that looks like a mad crappy sign
extender
hmm
[Music]
hmm
all right
this kind of stuff's not even really
useful
we're gonna have to have ports on the rf
oh
no i don't think decode should actually
be a module
i can make them wires
no we did verolog already look we did
python already now we're in verilog
okay um we need memory
where do we get memory
rom data
you're wrong
look at all these options
you know i might want to spend some time
reading some cpus before i try to write
this
like i could write something but i think
i'll be able to write something a lot
more elegant if i uh
think about it for a little bit
um let me think quickly what is there
anything we could show off with the
python
that should be a fully functional risky
core in the python
i guess he kind of had to do it
it seems frustrating and like ram
seems frustrating
now i understand why like there was a
debate between like
all right so one of them i forgot
whether it's von neumann or harvard but
you have the instructions in a separate
place
uh but all those well
a lot of the tests should still work
just load and store won't work
okay we don't implement load in store
right away
we do have to implement a rig file
and we do have to write something that's
going to write out the contents of
memory
what how come some of them are bigger
oh there's bugs in the memory
all right bugs
too small
it's too small alright
16 kb
i don't know like i don't know if that
stuff's gonna work
16 kb might be like massively huge
okay oh you're right you're right you're
right you're right i have to update the
title
verilog all right
i understand now why people were getting
confused i didn't update
the text
um oh well okay yeah you also have these
incredibly stupid like read mem
h
verilog is picky about the
read memh okay so we can't actually just
write that we have to uh
spin ascii
hexafly
beadaway hex or hexafly
all right must be stir not bites okay
um now we can load the ram
load the rom with like this kind of
stuff
rom words
how many words is that that's a lot of
words i feel like it's just gonna be
small
how many words does 16k be
496.
all right we'll put this inside the
candy
409 409.5
and we'll read manh instead of
firmware.hex we'll read
get rid of test cash
uh test cache
we'll try to test add
not enough words in the file for the
requested range
excess hex digits
why are there excess digits
not enough words in the file
do i have to separate them with enters i
might
it might actually be that stupid
ah god i don't even know how to do this
i split it up every eight
is it that stupid
spiritual stir instance bites found oh
yes
now it's slow
that isn't right
all right is that right okay it works
now great y'all ready you got
all these white space matters white
space matters
um
okay we have rom now
always at paw's edge clock uh oh we need
the registers
just that should work
all right
that's not even wrong that actually
should be round
hey if it loads in fast enough it's fine
okay
regs sub
wait why did i get 31 oh should pc just
be special
instruction reg
what did i call it i kept another name
before they called it ends
all right does that work
syntax error
um can i use display in here
i can't
x
uh
why is that x it's because pc doesn't
have an initial value
hmm
don't forget semicolons
always begin
should it be one the first time
right now it's one the first time uh if
we set in
zero
oh not reg pc what am i doing i'm so pc
oh okay we're getting somewhere
all right um verilog display
cool
great is that actually the first
cool all right
great
all right now you know how in back to
the future you got to think fourth
dimensionally
well it's actually the same thing when
you're coding in verilog you've got to
think fourth dimensionally
and if you're not ready to think fourth
dimensionally you know verilog's not for
you okay
um nerf reset pc zero
instruction fetch
okay we want to write a decoder now
a lot of this stuff is just
it's like there's like big combinatorial
logic that just kind of says
depending on the op depends on what we
feed into the aerith
okay so reg right back equals
op code equals jowl actually i can just
say
n um
jal jaller
mode
cool testo pass
um panda's new pc is a little bit
trickier
that does actually have to happen at the
next time step
um do load we could just say op code
equals
ops load for equals off store
depending pc actually goes there alone
cool
actually here's an interesting thought
we can combine all the m's into one
because only one
m is ever used depending on the
instruction type
m equals
all right so we can we can look up the
instruction type and then we just get in
i can do the decode every time but we'll
just end up with them and that's really
nice
in fact in some of them we're not even
going to set
we're going to set him to vs2
if we're doing an opcode up
um now the
first argument to arith looks like it's
always either
vs1 or vpc
um do we ever use both vs1 and vpc yes
we do
right there
otherwise we could just assign it but no
okay we need like there's like a thing
called like there's like a latch for
that
um i guess even there's a latch for like
which in we're gonna use and it's the
same thing
we of course didn't write the thing
that's like going to pen the fuck
have i written any of the chords before
no
my first try
all right we're gonna have we'll have
like the m selector
um
m equals mj
i hate this because it's like the same
crap
um
but it is fundamentally goes to the same
like our aesthetic unit
depending on how you're doing the uh
um m prepare
you can say alt equals
and
top equals
or
you
sweet
so you understand that refactor
um now we have the s1
r equals vs1 if
um
up
vpc if opcode in
jl or branch
else ps1
notice how all of these are the same now
oh well something broke when i did that
so i'm actually break from the ams
now
hmm
don't understand why that doesn't work
oh
our pc
okay remember this is actually part of
execute
ah
araf equals
funk three at
you guys see what the big refactor is
going to be right
soon we're going to get rid of all these
if statements
um for mu
pop code in louis vs
i'm going to type ops is not iteral oh
great now we should
also be able to put this here
great uh oh we can get rid of these
place in the vault
all right all right all right um
panda's new pc equals
op code in
branch and conned
wait where'd my other what
oh how'd the test
pass when i did that that's scary
um
okay the only ones will keep
are this one
and now we don't have anything left
anymore so it's just that
boom
yo that's crazy
that's crazy look at that look at how we
just deleted all those if statements
all right now we just have to write that
sushi
python refactor
uh
boom look look at that that's like
that's that's really
compact
do you see how this goes in an fpga now
right
i think this stuff actually goes and
execute
just by the three of four loops uh
i'm actually just gonna factor this like
this
i'm going to close vs1r it's a stupid
name
we'll call it arith left
cool
no you guys i'm not just writing random
it's not random verilog right it's not
random refactoring what i did was i
refactored the whole execution engine
into this
right instead of having these like weird
if statements that i don't really know
how to implement in verilog this is now
something that's very implementable in
verilog right
so we've already written the first stage
of the pipeline here which is the
instruction fetch very easy
now we have to write the instruction
decode and register fetch
but we need a sign extend
we can write something like wire
which is not right
am funk7
sb u j
syntax ours somebody make wires
is that wrong
oh because i'm in the always impossible
clock
all right maybe guess
yeah you can't do that always at
positive clock
um
so like okay wire op code equals n zero
six zero
yeah i think this is i mean this is fine
uh 14 12
31 25
all right now we need to write these
other things
verilog sign extend
there's like a way to do this pretty
easily okay
so we do yeah yeah ins
i can't believe that stupid sign
extender that guy wrote um
so mi is something like 31
this but we also want to repeat ends 31
how many times i don't know i guess no
that's not that stupid that's like the
right thing to write
um
what what is side
can that just kind of do that
that'd be nice invalid module item no of
course it's not going to be that easy
why doesn't this guy's thing work
all right so what's this gotta be like
[Music]
oh you want more of these
cool uh for ms
it's just concatenation of
how big is it 12. it's going to be the
same as that
but here we're going to say ends 31
25 and here we're going to say oh this
is like cleaner to right and verilog
than python
that compiles ends b
ah
this is 13 so we only do 23
of these um
ins
uh 31
30. here we do
pins eight seven
pins 30 25
eleven eight uh we actually also need
one more relay one b zero here
cool
uh this one
this one's not sign extended actually
and i don't understand why the python
needs that
uh we just say well b0 here
and then mj is the biggest bullshit
uh we're sign extending to 21
which is going to be
this well let's just leave it at that
and see what it complains about
um pins 1912
pins 20. i guess this is why they do
this weird encoding like it's really
easy to write in dialogue
30 21. all right he's gonna complain
hopefully
yes but i don't think that complained
about the right thing
um well okay maybe he did
ah i just had a stupid error so let's be
11.
invalid module item what
actually oh matter if that's the right
size so i might have gotten some of
those wrong but
either way great
uh all right now we got to do the
register reads
so those are actually in
um instruction decode and register fetch
we want reg sub ins
vs1 ps2
vpc
we don't need vpc
i mean we probably do but i don't know
okay compiles oh that's not right
24 and 30.
okay um
now we move on to execute
wow shorter and verilog can you believe
it
drag right back
uh how do i write that
there's no way to say in like that is
there
case statements are a big deal do you
love myself a case statement
um
case
well i really want
actually maybe there's a commonality to
all of these when you look at the uh
the actual bits
that's pretty complex
um
top code
um
these are all the ones that have right
back and be like really nice just one of
the bits was right back you know
okay you know what let's just
case we'll just you know we'll just do a
big case for the ops it's actually not
that bad
wow so we're back to having something
that actually looks more like
a six big
translate that from the python i'm so
glad we did this in
okay case off code
um let's look at a case statement
begin
ah in case
hmm oh
is it not sex
oh it's seven
okay um
[Music]
for we have to make a wire
i can't use a wire because wouldn't
always pause edge clock okay actually
we'll just take this out of the always
pause edge clock
this can go up here
um wire
m okay so if it's louis
m
sine m equals m does this work
no
able to bind parameter op code
but what there is a parameter op code
i can't bind it
why doesn't that work
does it work if i do it always at the
pause edge of the clock
it was not a valid l value so like does
it work if i do it like that
yeah okay fine
uh okay if it's a load we use i if it's
a store we use
s it's an owl pc we use
u if it's a branch
we use b it's a gel we use
j if it's a jalar we use i
if it's an m we use i
it's an op we use vs2
um and this consistent are stupid
okay uh
um make a few registers here
uh arith left
uh funk uh rf
left equals
uh vpc in jail
branch off pc
um can i do this
and it's like a default
oh there is no vp say
pc
maybe i can then
yeah these are the defaults that's fine
i think uh
every funk equals
uh add which is just zeros
um
unless we're in op or m then we say
arithmetic
great and this does like override right
i don't like getting the syntax wrong
uh all right left
left m
i may never get set
go to zero shouldn't be zero
that doesn't make any sense
i don't know i'll put a four arithmetic
is zero okay four is
fine four should be what
oh is the endianness wrong
andy and this is wrong
did you roll code for this already
all right now it's 6f and now we're
setting some stuff okay good
oh you know let's pronounce pc while
we're at it oh this is pc
pc is a whole lot of zeros right now
um actually we should set pc to this uh
32.h
and let's say something like
actually how watching rom b
oh not that wide uh it's only
that works great so ignoring the topic
okay cool all right
and then yeah yeah so that's going into
eric all right great that all works
um we actually have to write the
arithmetic unit
uh decode is not its own module but
arith can be its own module
um where's the arithmetic unit here
uh inputs are func
three now we have an input called
alt we have an input
gold x and we have an input called y we
have an
output called out
um case
funk three
you guys always waste time talking about
vin i could use a different editor you
know like it's not that big of a deal
does not like that i don't have any
cases in my case
a little bind parameter
why it's an input i don't get it
case statements have to be in positive
clock
okay
um so this is
uh out
x plus y does that work come on verilog
all right cool uh
which other ones do we have to do to do
[Music]
sly
okay maybe it's because i'm not
instantiating it can i write like
junk here
oh slt
[Music]
it's ltu
xor
um shrill
wait there's just a there's a normal one
right
it's not just the eye right
so this um
or
no which is wrong
it's all good until i added these guys
no what happened
all right n case
all right the only bad one is xor um oh
there's like a special very log xr
no it says i can do xor
all right
aerith i misspelt it
all right let's instantiate the arith
here and the executor
um
clock
three goes to front three
um x
goes to uh
left y goes to m
and out
what did i call it in the python there's
a stupid name for it was like pass or
something
uh penned
now form statement a
my dough
uh why does this work
copy the syntax of candy
is it mad because those are why some of
them are wires and some of them are rags
was fun three the wrong size
what's malformed i forget a semicolon
somewhere
i don't see a bog
the only thing i can think of is that
funk three is not a wire
all right we'll call it uh next funk
three
and then always at positive clock
um wait
actually that's not even the right thing
we're supposed to not even god this is
wrong
uh it's not supposed to be fun through
it's supposed to be arith funked
i don't think that's the bug but it's
still
it's possible i have this backwards it's
supposed to be like this
supposed to have a bug in my module
instantiation
uh oh did i not call it did i ow
did i need wow
no no i wish this thing had reasonable
can i say output reg here
i can
are you assigning a wire inside clock
all right can i make an area that i
don't connect
no i can't
don't understand why there's anything
different from when i make a candy
though
module candy module aerith
all right i wish i had another verilog
compiler so i can check what
like give me a real uh
oh i know what i'm doing
i can't put it in the uh always a paws
edge clock
god i wish it would tell me things like
this but i'm pretty sure that's the
problem
yes oh look at this
it added this and this and got this
whoa we did an addition
oh man
we did an addition boys
ah is this ever going to compile to a
chip
i see why there's a difference between
verilog and verilog you can synthesize
um okay
we're not writing any memory stuff now
um
where do i set pen does the new pc
all right uh oh we need conditionals
rag append is the new pc
we set it in jalan jallar
and here we set it to the output of the
cond unit
uh we have to write the cond unit module
cond
input clock
yeah this is where like i'm gonna be
like wrong but it's fine
that sounds like a later problem all
right so cond has phone three as an
input
it's just the same inputs as this thing
it does not have an alt mode
and it has output reg out
just like that
[Music]
give it a clock um
this actually just goes to phone three
we'll have to deal with timing in a
little bit
um which are the two inputs
the s1 and vs2
yes two
um
we have to just write it
uh where is it where is it
all right
these are the ones we have to write
43 go uh
i always hit pause edge clock
in 44 and
um begin dq
uh out equals x equals y
i have no idea verilog can actually
build these things
b lte i
don't know the difference between
compare and sign compare and verilog
pge
just copy him here
um okay well we need semicolons we can
start with that
great okay i don't know maybe my
comparison already works
sweet
um now what do i have to do i just have
to do register right back right
uh we'll do loads of stores later
now we do rig
right back oh we have to be careful with
this one though
um
gregg's equals
yeah inline f so nice and line f's right
yeah legs pc equals
if append is new pc then
10 otherwise
vp uh i didn't make vpc did i
there was no reg sub pc it was just pc
but we have to really wait till that's
um
pipeline i don't need that anymore
and then for the actual register right
back
i'm gonna make this conditional i guess
i could just do
drag right back
did i set that one right did i write
right back
no i didn't
i'm gonna set that in the uh the ones
that do it
let's talk about the python
open somewhere else
right back jowl jaller
boy pc
louie
load open him
especially most of them
rd did i even get rd
i think i did
we've append his new pc
and we do
and we have to deal with the special
case for zero somewhere
all right well that totally broke my cpu
because you can't set pc down here
without totally breaking your cpu
um yeah see like i need something like
an
always that pause edge reg right back
uh actually that might work
you delay this um
what's special about clock right
uh let's say arith
ready
i'm gonna need some arith ready thing
hmm
it shouldn't really be that that's
always ready this is stupid
okay
i think we're going to build a processor
that runs exactly one instruction
and that's the stream
guys you got to think fourth
dimensionally this is verilog
yo did that just do something
look at that look at what it said pc do
it just executed a jump instruction
that's crazy yo
can you believe it
can you believe it you know what instead
of writing this stupid step thing like
this
we'll just make a little register that's
like this
and then if you're resetting it's step
equals
yo we just executed an instruction and
then we can just say down here
step equals uh step
plus one but then it's not always a
pause edge i don't like this anymore
guys i don't know how to do pipelines
someone told me about hazards we didn't
deal with any hazards
but we executed one jump instruction
um let's just examine the jump
instruction and all of its glory
uh where are these tests they're in like
uh yeah like here oh yes
we jumped to 48
um which is not 24
and this is wrong so we actually jumped
to the wrong place
but we did jump look at how pc
changed
oh that's a good point i could always i
could do
always at negan reset
begin yeah oh that's wild
reset in
cool
cool now wait why is it jumping to the
wrong place
um this is because probably i made a
typo
um what kind of instruction is that
it's a six f op code
six f is jowl so i made it a mistake
in the jab and oh i yeah i know the
mistake i made
yeah this needs a 1v0 here
boom now we jump to 48 that's the right
place that's where we were supposed to
jump to
what happened to 48 it looks angry
l-i-r-a-0
uh okay oh you know what else we have to
do
at paw's edge of step five we have to
reset all the steps
wait how'd that even work
yo how many instructions did we just run
just like four instructions boys
i don't know why we get x's that's
because we like made mistakes but
i don't know this is pretty good we got
like a decent cpu going here
i'm pretty happy a candy
would you like to implement a candy
[Music]
all right if we do another stream about
this we'll actually uh we'll finish the
cpu we'll get this to compile
how does it take four cycles to execute
one instruction
when there's actually five stages uh no
there's only four stages
only four stages
uh one two three
uh memory access is later we didn't
actually do memory access
we'll need to add one more we'll need to
add one more stage when we want to
memory access but yeah
you see look at this beautiful pipeline
i avoided
all hazards by just not pipelining
oh yeah who needs hazards when you have
not pipelining
no there's no pipelining
cpu runs no pipelining
it just like steps through and then like
when it's ready it does like the final
things
it does the the outputs that actually
like do anything yo this is really
cool this was so much easier than i
thought it was going to be
um i'm sure there's tons of bugs still
in the verilog one
so what we have to do
is um get the same printout okay
so we've written this python emulator we
can call the python emulator the ground
truth
um so what we have to do is get the
python to print out basically
this same stuff and you know what we
could even put this
in here and then it's only going to
print out when it actually runs an
instruction
uh i can change this up to like 500
would give it like 500 clocks
it looks like the cpu does eventually
crash
like hard crash with like x's boys
like not like uh not like a soft crash
like this is this is a real crash
um
but uh yeah that's the basics of writing
cpu verilog
there's probably another five hours of
debugging
uh after write the actual memory
interface
then make sure it can actually be
implemented
on a on a cpu like i don't know how good
that adder is right i just put plus and
verilog who knows what that does
can you do that on i don't know if you
can even do that
i guess you can
hmm
i don't know why we get axes
we'll leave it at that for now
so we're doing a full pipeline stall
um yeah avoiding saw some hazards where
it gets tricky
i don't know how hard that's gonna be i
see what it is now
we mean structural verilog versus
functional verilog
like this stuff should compile to the
chip
i don't see why i wouldn't
this is some big combinatorial thing
i do have an fpga right here
um on my other stream
uh i got all of
the tools running on mac to actually
compile
i'm gonna hold the shell fisk five core
so now we have this one i can call this
arrest i should call it alu
and what's a cond is that an aou is that
part of the alu do i use both cond
and the alu
might actually just be the aou
now i use the alu during branch
so it's a separate unit
comparator unit
cool thank you for watching
enjoy the rest of your day have skills
be happy
all right boys i wanted you to be here
for the moment of truth
on fpga
uh yeah i wanted you all to be here so i
got it all working
um yeah i felt like i felt like i left
you hanging i felt like you know were
there really only
a few bucks yeah they're really only a
few bugs that fixed them all look at my
commit history
first off we gotta get some chicken
tenders in the oven
and once the chicken tenders are in the
oven
we are good
to get it working
on the device
i already put a little bit of work into
it i was like lying in bed and i'm like
yo
i'm just chilling right here and i'm
having a good time
but i figured you guys would want to see
this
risk five four
this is some twitch slam quality shit
uh all right so i got it all working i
got the verilog implementation working
uh the test pass i think i fixed mostly
the last bug
um i had a few bugs in my encoding here
uh i had a few things that i just didn't
think through great
it's still not pipelined so it's a
completely uh
every pipeline is basically a stall
every every fetch is basically uh
there's no pipeline i just didn't make a
pipeline
we can try to pipeline it
how many viewers we got
67 all right
um chat you're all in early so if you
want to ask questions
uh you can ask questions
it's how many lines it's 233 lines i
separated out the test bench
um so here it is like this is it
executing
the subtest the subtest was the last one
to get working because i mixed up the
the louie a little bit
um but then i fixed the lily and it all
worked
uh it's actually off by one
it's the initial yeah
it's actually right before they're right
back
regardless i gotta attach you say the
traps so you'll see like let's say i
break the louie again
you'll see that this fails with error
code 15.
i put the louie back error code one
um she already saw some of this stuff in
the uh
tiny grad stream but i have a compiler
working
and we have an fpga and i wanted you
guys to be here
when we actually click download so let's
try it out
thank you for gifting subs
if i break my board then we don't stream
anymore
plug this into my laptop i also figured
out why my monitor was
glitching uh i was kicking the plug i
shoved it into the wall good this time
it's not a compiler we built a risk 5
core
so let me copy over the stuff from tiny
grad which lets you
download stuff
twitchcore and we'll drop it over to one
party to fund twitchcore
and now we'll program
all right
all right it's blinking the leds at some
really insane
rate i think um
so let me i saw some demo code for this
so this is the this here is the cpu
it's 234 lines this is that test bench
that executes when you run go
and then this is the top level module so
let me steal something from add a soft
top
you know i tried reading the the add a
sock core
like it's so complex there's so much
stuff here and like
i'm not really sure why like
i don't like the way that they did they
didn't i don't think they did this stuff
nearly as nicely
um
but i don't know maybe there's probably
a reason they did it their way and it's
probably because they have pipelining
and i do not
and all the subtlety of microprocessors
actually probably comes from pipelining
so
don't trust me
i'll check out a sock top and i wanted a
copy in this clock divider so
right now the cpu is running at 50
megahertz
and it can run at 50 megahertz but the
problem with 50 megahertz
is you can't see anything
so let's figure this out if there's
two to the 23 50
times 1 million
divided by 2 to the 23 okay
so this should run six instructions per
second
if i change this over to clock
let's recompile and
we can try a pokemon speedrun after this
if you want
we did a risk five speed run
what is verilog used for verilog was
used to write our own custom
chip
all right downloading all right all
right
look it's executing this is pc
whoa look at that
it's executing
let's see if reset works
well maybe switch one
i'll switch zero ah okay all right good
look we reset
i know it's like broken because it's
stuck in reset but now we're gonna take
it out of reset
yeah look at that it's running
oh yo we actually made it work that was
so easy this was the shortest stream
ever boys
look and i can put it in reset with that
switch
now it comes out of reset the cpu is now
running
at six hertz
um you heard me right that's hertz
uh and remember it's not pipeline so
it's actually more like um
you know slow
risk five core on an fpga
um yeah i don't know i don't know what
else to do that was just too easy
i'll just commit this
works on hardware
i had to make a few changes in order to
get this to compile so i couldn't use
like these pause edges on anything but
the clock
so i put register right back in like
this
that should be the last assignment so
that should be good
and then i put reset in like this
yeah this is a fpga running the risk 5
core
that we wrote this morning it passes all
the tests except for the memory test
because we didn't implement the memory
yet
i can reset it if i flip this switch
that's the switch here
now the chip's being held and reset
and i flip that back
and we're back to running
all right we should actually make sure
it's getting to halt let's um
let's make it run a little bit faster
let's go for
a yeah that kind of speed up
um and then we're only going to set
well the leds okay there's four leds and
they have three colors each
i think you can go there
like that um and that's gonna be
11 minus two plus one is nine so that's
gonna be a2 zero
okay the bottom bits of pc uh
we sped the chip up we're gonna see if
it manages to get to the halt state
it recompiles so fast using a completely
open source custom tool chain
uh props to you know all the people who
did this and made this possible
running the router now
programming now
[Music]
yeah there we go look now it runs fast
i don't see it going into trap
i though actually know how these leds
are wired up maybe they're not wired up
how i think they are
see it's executing the first instruction
which is a branch
but it's being held in reset so it can't
execute the instruction
now it can go
i don't understand though
there's 11 leds i don't understand why
why that didn't change
so now we should ride the ddr memory
controller
and get linux to compile for it
and understand why any of these are
turning on this is probably the bottom
of pc
here
why is that blue light turning on
it can't be trapped
see that eventually gets to trap
hmm yeah so that red light there is trap
but i don't understand why
why is the blue one turning off i think
it should
maybe i don't understand how the leds
are wired let's just take a look
oh oh
okay this is a scam see look all the red
ones are wired here
i see yeah they did some like redoing of
this
um don't worry about it what we can do
is just this
uh
yeah so basically we just didn't set the
red leds to anything except for this red
led
now these leds are kind of poorly laid
out for this so we'll leave that one on
led zero
but we'll assign led three
through one the first
those bytes and then five
seven through five you see see how it's
laid out
um these ones three
four five and then
seven eight we'll go to nine
and eleven we will leave out
zero uh four
and eight so that this led doesn't turn
on until we hit halt
and just because we can let's speed it
up a tiny bit
so when it halts it means that the the
test has finished running
yep this is running this is running the
risk 5 test for subtraction
uh it's a rd 100t
so what i expect to see is this led not
turn on
until it finishes
and it's done
that's why the red one's on
there you go it might eventually loop
around or something
but yes you see you see the red one all
the way over there so we can reset it
and now we'll let the program run again
it's running the test and when that red
light turns on it means the test passed
or failed we don't really know which one
now i'm almost sure it passed boom
and then the other lights are just
mapped
to uh to pc so the pc register from
yo when i was doing from the transistor
the web browser i thought writing the
cpu was going to be hard
took a day
you know having a tool chain that isn't
terrible
for fpgas makes me want to
do that course again
what do you guys say in november come
off the grid we'll learn
a real you know
computer science
buy a bunch of these boards you can buy
the tiny ones and we need a good chip
yeah and of course sarah you're gonna
learn in real life you know
no online virtual bullshit
great
how many viewers we got
248 not so many
uh how did cpuv came we wrote it earlier
but i just finished it while i was off
stream
but like you can read the diffs and
cheat
yo it's still running after it traps it
continues to run
and just run through all the zero
instructions
reset run
it's just wild
risk five is brilliantly designed
that's the other thing that makes this
stuff possible like i don't think you
can ride an arm chip like this
let's just let's just look at the arm
instruction set
i don't even know what even has arm
anymore
i was reading this article about
breaking up the ivy league
this pdf from back in the day
she's got another number brush i don't
know how i remember that
oh this is nightmarish compared to risk
five
though i do remember writing things for
this
uh arm is also patented or like
copyrighted or something
so you can't really make uh you can't
really make arm chips i mean you can
make arm chips but then like
you don't really own them or something
the arm instruction set encoding
no i mean it's like similar looks kind
of similar to risk five
you have to do like rotates and stuff
but
i didn't understand things like why it's
so important to have like the
destination register in one place
um
and how unimportant it is that all the
things be contiguous
like this immediate encoding is no
problem at all
uh yeah there's some asics there's some
risk 5a6 now
so the problem
i was just looking up like m1 pipeline
uh i read this article like
the apple they're claiming that they can
do
look ahead of 630 instructions
like super scaler to the moon
i don't know i guess i imagine it's a
lot more work to go from
like writing a little processor to like
making it scale
wow it's beautiful how simple that is
uh what do we want to compile
well like part of the problem is we only
get like a crappy serial port
quantum computers are real
i don't know i just want you guys to be
here when you get the download to the
hardware
this class can change the world i'm
actually quite optimistic
well also like i barely used any of the
fpga for this
it's this board but with that variant
yes this one
this variant's pretty good though though
wow it's crazy that that's so much
cheaper
you get a 60 core i mean yeah we could
put multiple of these cores on
but all right do we want to think do we
want to think about pipelining
well so what pipelining is
mauricio at least probably write the ram
yeah no and then you have to like deal
with all this
stuff for hazards and stuff oh it's so
hard
do i offer a course for programming
should i start just like scamming people
out of money should i just become a
scammer
bro why do you need my you know how much
free shit there is on the internet
i just drove a cpu today i read some
manual
and then i wrote a cpu
first in python then in verilog and then
i got it to actually
synthesize and run on this fpga to be
fair i did a lot of the leg work on the
tiny grad stream
i don't know what to do with money boys
oh the government money the only reason
i know the government money is because i
made money
fifteen thousand dollars in like q1
fucking taxes you know the only reason
that money is cause i made money and you
got more money more problems i'm gonna
be homeless and you know make uh
make computers
um
you just make a video just describing
your journey in programming you know
there's a word that comes to mind but
you're not allowed to say it anymore
so you know that's the word that comes
to mind when i hear shit like that
um you should get you should get a much
uh much larger fpga
the real bad words boys the real bad
words
uh i would like to command paul yeah so
you got to do like this kind of stuff
you're going to do it
instruction fetch instruction decode
risk 5 pipeline
well i'll just go through the same
stages
hey
oh implement the m f extensions let's
see what they are
um we can just look if you guys want to
see the
uh the bugs oh yeah okay so the first
bug that i fixed
was i forgot to initialize the registers
um that's why we were seeing those x's
uh the next bug was that i actually was
not accessing the rom is word indexed
uh so yeah you gotta do that
um then the next bug was that
you don't actually ever write to the
zero register
so i think there's a few different ways
to implement this there's probably like
some neat like hardware way
to make the thing actually like not
writable but i just wrote this
which won't do the register right back
if the destination register is zero
um i made some typos in the encodings
it's a little weird so this syntax is
not like python it's inclusive
um python is exclusive on this one so if
you do like in python like
x sub one colon zero it actually is the
same thing as x sub zero
uh well it's not exactly true but you're
only gonna get the
it's it's um not gonna include the one
element
it might keep a shape difference and
that's why it's not exactly the same but
the shape here doesn't even seem to
matter
so i made a few typos here i fixed those
because it's inclusive
on both sides in verilog um
what did i do here oh yeah i just added
in traps
uh so it could exit
and then i refactored so i was using
this
pen as the new pc conned in
my instruction decode stage but it's not
actually ready by then because like the
register fetch is there
so if i ever want to get real pipelining
um
i have to move that so i move that
uh which one's this refactor pc oh yeah
fixed miner louis bug
um when i switched to do subtraction
instead of addition
um the way i i still put the
louis so the louie is load upper
immediate
um it uses add by default in my lu
so i just set the left side the alu to
zero you know zero is the
identity for addition so if i didn't do
that it was just whatever was left over
in
areth left right you know i think i have
a default for arith left which is yeah
vs1 the other register
so that was meaningless junk uh which
made that instruction not work
and then yeah this made it compile
um for
uh
the fpga but it actually didn't work
because you ha you can't do these always
at negg edge reset
these edge triggered things on xilinx
have to be put through like a buff
g or something i'm not sure exactly what
it is no that's not exactly true because
it worked okay on my divider so it's
something else but you can't do this is
all i'm saying
maybe because both things were trying to
write to it and it just kind of
didn't do anything oh my god there's
some tabs in here let's fix that
i don't know if it's no e t or e t i
always get it wrong
tabs are disgusting
uh yeah so i couldn't do the add paws
edge i had to put it actually in the
clock trigger and then you guys watched
me do that so
boom it's the new twitch slam bros
it's the new twitch slam remember the
time george you're a
this probably isn't i don't know twitch
sounds probably harder
um yeah so are there good is there any
super scalar risk five that's open
source
oh yeah oh yeah yeah we were gonna look
up these uh
these other instruction sets
oh if you want multiplication
oh yeah oh i think the little one might
support multiplication
oh attendees are almost ready boys
um
hmm
this doesn't look too bad
i don't know maybe it's really hard what
do i need an integer divider
what's in the a instructions atomics
well i don't even have working memory so
that's not a problem
floating point
data looks tricky
the tenders are ready
how's the progress since the beginning
of the stream this is my custom
risk chip running on real hardware
passing all the tests that don't involve
memory
let's see if we get a vram drawn
put some memory in here
no tabs are disgusting and if you have a
different opinion you're wrong
how big is it
yeah that's what i'm looking at now
verilator i used icarus
i wonder how fast
super scalar risk five imc let's see
oh compressed instructions you mean
thumb
um one of the most powerful things that
i think risk is going
risk 5 is going to enable them
a lot of times what you want to do
for like neural network accelerators is
you want a programming model that looks
like a cpu
if you could figure out how to add these
things as instructions to a cpu
like access to a big um
floating point multiplier
so one of the other things
that's on this board that's cool is it
has a um
it has a network all right port
i wonder maybe if there's something i
can download what i really want is just
like uh
i mean what i really want is a piece guy
e bus that lets me talk to the internal
memory
this bob is a new archbishop
what's decimal floating point
i know i like this one it's kind of like
the apple one
sport taxi for our bus
i'm not only understand what these buses
actually are better
everyone made a big little risk that's
actually useful yet not that i know
but see
no i don't make an accelerator i want
the core to be the accelerator
what's an issue cue with a rob
is that is that the thing that apple has
a ton of
rob reorder buffer
well this thing has a 64 rob
album 630 robs
the service waiver engine is so stupid
the service waiver engine is the
pinnacle of like
investor idiocy come to ai
actually with an fpga you can download
more rob
what's the xl2
a beautiful enclave
that's cool
you guys know i've been thinking about
starting an ai chip company
i think we clowned him like comic cloud
it's another one of these
it's another space where all these
people are massively over funded
and they're not producing anything and
like nvidia is the mobile eye
you know you got some great synergies
with comma
yeah you're gonna have his own trip i
want my own chip
villain has a chip i want a chat
i'm not even working on the investor
patch
you have good synergies
elon doesn't sell his chips i'm gonna
sell everybody chips
for four times what they cost to make
you all still gonna buy them
because nvidia's charging like 20 times
what they cost to make
no i want to take out an asic
but do it first on fpgas
no i've never fapped a chip before
is it painful
it's called tape in it's funny
l u
l u is beautiful okay
get rid of that a you don't actually
ever want that a
it's just e to the x my oh
okay
i just want to ask you guys one question
if the activation functions were slides
which one do you want to ride
right let's
leaky value is just the worst slide like
you just keep sliding but only a tiny
bit
you have this big discontinuity right
there
yeah relu just kills you man
sigmoid is a nice slide but
you know it just doesn't have the same
beautiful runoff
as the lu slide the lu slide is up
you can't see him oh yeah i made my
my camera big
hmm all right i'm here to talk about
activation punches
[Music]
yeah yeah you've got a scoop to get
going on white
there's a big q at the top of the
sigmoid
any accelerator that doesn't have ccif
that's this thing
no i don't like
i'm not thinking like that what i really
want to do
let's see excel look up ccix
i don't have any pcie
just network
some super fast risk five chips
and big packed in neural accelerators
you know just like
i love paying synopsis from the flag
yield all my money
i didn't know the fires were owned by a
guild
um
yeah their network no it's not allison
it's a resnet because they can't do
efficient mats because their thing's not
efficient for that
qspi ram bro
bro you want big bandwidth
now if you had like 10 000 qspi rams
yeah well you know
now service is super stupid
i want a high performance risk
5 core with like out of order
execution super scaler shit that has a
bunch of extended instructions
that are the ones i talk about in tiny
grad
no all general compute on board
yeah the basically i want a risk chip
that's an m1
yeah yeah okay boom the berkley out of
order machine is this still
relevant
90 plus megahertz
oh and it uses this chisel stuff no
no these are the kind of things that
like
you get so far removed from the hardware
and you build
out architecture research
reverse engineer m1 build clone
be rich what do you think of that plan
boys reverse engineer m1
build clone be rich
i i just need a lot of robs you know i
just take take
take that one off the internet and
increase the robs
this only has 64 robs if i had 10x more
robs
no i can't believe arm is better i think
you could build a really good risk five
like it's the same stuff pretty much
all right so we need a front end it must
include dragons
we need an eight wide decoder we need
630 robs
we need 354
perfs 384
fp perfs
good-sized tlbs
samsung cancel the m6 core
why'd they cancel it
oh they went back to crappy uh
encores
when's apple gonna switch to riskbot
you know apple hates nvidia right um
apple
hates nvidia ever since the uh gpu's
fault the gpu
wrong soldering temperature fiasco
and they made apple look bad and uh
apple here disregards the norms and
chooses a large and fast
l2
takes 16 cycles to access the l2
i'll just run 15 cycles everywhere hope
there's around 50 cycles
oh is that actually true
did the chinese regulators have to
improve in video buying norm
why
that would be sad if that were true
wow
do you guys remember when like america
ran the world those
those were nice days
[Laughter]
hey maybe the chinese will have some
balls and tell a video no
how are we going to feel how do we feel
living in a chinese-dominated world
i don't know
chinese may they be better hegemons than
we ever were
hmm
you know social credit scores in america
too they're just called credits
um
viw stupid
four decoders wow okay
that's so sad who made
variable length instructions and thought
that was a good idea
this crap
uh
i want a chip with like 64 of these
firestorm cores on it
but risk five firestorm course
[Music]
well yeah i mean apple does kind of
cheat with their uh
yeah yeah they're five nanometer five
nanometer cheaters
well i want someone to make a risk chip
but with
my extra instructions
i don't know they just wrote five
nanometer on a thing they didn't make
any five nanometer chips
i love my m1.
i hate big little i only want big
jim keller designed like all of these
ipc
micro apps are stupid
so i want to understand like okay so
what's a front end like like all this
stuff i read about pipelines is like
simple crap
what's a front end and what's a back end
pipeline risk 5 front and back
c
i'm not bullish on tens torrent not
unless they come out with a different
chip
like the reason you don't hear anything
about the chip is because it's bad
if people have good things they tell you
about them even in video there's like
all these docks
on the a100 like you know what it is
what else has five nightmare chips now
hmm the high silicon curing
the kirin 9000
hmm
okay it's a four wide decode out of
order
super scalar design
it can fetch four instructions and six
mops per cycle
oh they only have 160 robs
oh they have a lot of mops
system verilog has a video called
overview of vsli
that's not what i mean by front on the
background though i mean like
dual issue
all right the architecture of a single
like that's nice i like understand what
these things are now like we have a
fetch
we have a decode oh you do the hazard
detection the decode
what are csrs
oh control and status register okay so
that's what i call cond
i think i call that cond
i'm going to rename instead of errors we
should call alu
csr a common name
and then yeah let me put the mem access
stuff in there
tls offload nix that's cool
um yeah i guess then they should really
be doing most of
most of the
ssl stuff all right the five stage
processor on the bottom line is divided
the
instruction fast instruction decode
execute memory access and write back
in addition the processor has a control
unit and control status register the
processor is a 32-bit single issue
processor
okay
so what does dual issue mean that means
it runs two instructions
all right i do kind of want to start
writing the the pipelining stuff
nice graph bro
duelist you run slower it uses more
power
and takes up more
however negative impacts
dynamic branch prediction
oh also yeah shouldn't this risk stuff
be 64-bit and not
i just want to understand what the back
end and the front end are
sub scalar processor oh that's what i
built
i built a subscaler process
subscaler
training at a premium trading at a
discount you have a superscalar
processor i have a subscaling processor
why are these people talking
scaler
do
fundamentals of super scalar processors
hmm
yo computer architecture's so cool
thanks archive
a download
i want to buy one of those m1 ipads
then it'll be like every other ipad i
buy and then don't use whoa
they were only getting 0.1 instructions
per cycle
i'm getting like 0.2
i bought my keyboards here it's
downstairs
i'll build my own m1 chip
books from the 90s
pipeline depth
pipeline stall we now know what those
are oh
ilp stands for instruction level
parallelism
well that makes sense
whoa these people are thinking in terms
of gates
damn
ah risk
five superscalar
dual pipeline
oh god
i love sci-hub
hmm
okay so they don't seem to treat they
seem to treat pc not like a register at
all
which i guess is a good point
are there risk five analytics sellers
um
can i buy this
lg neural engine no i can't buy any of
this stuff
this one on amazon
there's a is microwave any risk farming
amazon
there's a book about risk five
there's a few books about risk five
[Music]
speed m1 risk
5 iot
ah the max duino
oh yes i very much trust this
don't make me try to build books again
junk
rv32x
hmm
this is interesting a risk-based
shader unit this is
kind of what is the respect for this
all right i think we gotta just write
pipelining for our for our cpu
look at sci-fi's u84 is it open source
accepting lead partners now so no
yeah done
what's the gbc golf boy click
oh bacon on the beat
i liked that first one i was reading
that like talked about how it's the
what's this
yeah okay so i mean i like this basic
five stage pipeline
hmm renaming
yeah reorder robs
oh see i like this this is good
speculation
harvard-based speculation was born
and many bugs existed because of it
boo
super scalar static in order execution
branch predictors oh the perceptron
predictor
all right len five front end
so the front end seems to be fetch and
some of the code
um all right
so let's first change it to simulate.sh
and then
i wanted to run like multiple programs
how do i do that well i guess i can move
the memory out i mean we kind of have to
maybe we should do the memory first and
then we'll do the uh
we'll do the the pipelining i don't want
to have a subscaler chip anymore
what's this dual issue
well they have issue
two instructions per cycle
this looks pretty cool
all right let's throw some to do's up on
twitch
um add memory
support
[Music]
make pipelining
work and
m instructions
to do later
many robs like
m1 go
very fast
what
super scalar dual issue in order six or
seven
stage pipeline
what is this pc
i just want like one super test that
tests everything why do they have to be
different
files they're better tests somewhere
the money's fake bros you make yourself
a slave to the money
you're just a slave to the government
wow like look at how fast it's running
now once we get our pipelining to work
what's gc
what is gc
that's is that the g
hmm
base isa we use the abbreviation oh g
for the i'm of fatty
oh
i see
guys come back to come back to the
people who know things it's a hardware
verifier
oh glad to see people are still
supporting plan nine
yo you know would be a great troll man
[Music]
what if we like took plan 9
and sold it to investors and then
posted a youtube video making fun of
investors
because we sold them plan nine it is
smatter space
this sounds like my hit tv show to catch
a bike thief
it was gonna be like to catch a predator
but
the problem was that everyone hates
child molesters and people are
surprisingly okay with bike thieves so
like
you know that's the problem people are
okay with scummy investors that's the
problem
it's so satisfying to reset it and let
it run again yeah plan
ten
one of these atomics
you
i say
wait so this is a whole tvn i should
just
the one that doesn't like
can i make the whole thing
so
oh benchmarks
do
okay
oh risk five compliance
hmm all right all right what do we think
of this
we want to make sure my risk 5 is
compliant
number of the test
now this is huge
uh
okay i don't know how to use this
i think we're better off trying to
figure out how to uh
iterate through multiple of these
you
let's see loads don't work
now i need some way to run all the tests
you're about to be like a variable
oh
does that work
well okay you know what here's something
i want to do
i want to move the rom outside anyway
and this should be okay um
let's just i just want to look at the
naming conventions they use
they didn't do it for the rom but they
did it for the ram
i am invalid okay
whatever output
rom adder
how many bits is that
14.
input wrong data
um
uh always at posix
um okay
seems right
sign
from
okay
wire reg
data wire
[Music]
um
decorations
um
sign how you do that
i think it is it just doesn't like that
uh
unable to bind
why
oh okay that works cool
now the fetch has moved outside
um at least now we can put that read
memh inside lots of bullshit but let's
still
let's just make sure it continues to
work in the synthesizer version
i know i'm doing clock giveaway which
doesn't matter if it's faster
oh yeah i could trigger on both edges of
course
i'm not sure where i'd want to
maybe you never understood a translated
actual hardware you just need something
to compile to hardware
so excellent
well i should at least be able to do
i don't know why i did this
i mean i really need like a two-port
memory
our vram single cycle
dual port ram module
the dual port just mean it can read and
write
okay
15 hmm
oh
that's cool
this didn't really fix the problem it
did move it into here though
like now i can like change what i'm
running in the uh
the test bench without changing the real
code
yeah it's okay here's trying to do the
load
i'm just trying to load that address
does that october load
good dual programs are cool all right
going to make loads work
let's make loads work
it's not actually wrong that's kind of a
lie
what ma'am
um
it's a harvard or von neumann
hmm
we're building a von neumann
architecture
i knew harvard sucked
cool now we got to write memory access
um
so the memory adder is just penned
so assign wait
first off this should be i uh but we can
assign
deader hand
and then assign
actually doesn't work but
um audience okay so
d data should be ready by this point
uh
i think i should be able to say this
yeah and that just makes it look a
little simpler
if pen is new pc
uh did i write the doing load no i
didn't
i called them something in python
do load and do store
um
[Music]
okay memory access
later
uh if
you load
no that's here actually where i want it
this that's
uh d data based on pent
and then it's here that i want to say if
do
load uh else
hmm i made it pretty far
a lot of the loads seemed to have worked
none of the loads work what happens
yeah only gets to five but all right
it's pretty far there
all right so that's load
um
yeah that should be good
is that not what it expected
chat behavior
okay um the only thing i can think of
well actually let's take a look at the
load example
and then let's go look at
instructions
it should be fine or did i implement
knop
i don't know if i did
um
louie that
[Music]
add 15
[Music]
not what i got when it loaded
all right i'll print that out as well
instead of printing panda's new pc which
is kind of stupid i'll print
uh d data
now
that look close to right
did it work that one didn't wonder why
pipeline should have plenty of time to
settle
let's just make sure it actually showed
up um
risk five tests
oh i'm looking at 64 first off
that's cash
look at lw
okay that looks correct
um
huh
is a loadout code is it wrong
actually does that even fit
three
huh yeah look here i get 802
but here i get double 001
i don't know why
because the same load
left impend the otter's wrong
isn't it just isn't the other literally
just a wire to
uh pend
yeah how does it all work
how is this wrong
that literally makes no sense
pend is just a wired deader
okay what did i do
append is a wire to deader
it's not even set
and that probably means one of the
inputs just changing but
i can't
i'll just put the same logic here
oh okay now deader is correct am i just
not waiting long enough
okay that works
cool
all right um we're gonna have to do a
little bit more we're gonna have to
support
all the weird sorts of loads
it's not actually just do load it's
gonna be like load type
and there's a bunch of different load
types
um so like if i switch over to lh it's
not gonna work
should actually just be do load it
should be uh
load type funk three
well i guess i can just search funk
three
not great but
again else
and
and then syntax an assignment
uh what's the syntax there
what does the l syntax look like
and else begin
and else begin
gotta love it uh
case
um
it shouldn't actually be fun to three
but it's the same basic idea
in case i actually need begins and stuff
um okay so lb
is this
and we want this to be the data
coupled with 24 zeros
um load word
what that even looks more broken
oh
okay
thanks
uh oh this should be side extended um
it's this syntax
those are actually correct for
these two but for this
we want to say 16 b data
extending and verilog is phenomenal
so easy
how does it work
i worked hard on this code
lw works lh does not
let's look at what it's doing
really q pass by chance no it feels in
the same place
oh cause look at the
fucking address work
um thank you
it's gonna make bites work
like non-aligned accesses you know
hmm
hmm
and now you understand why this is hard
for chips
old word works
he thinks it works in real life
build that same struct here
we're running into an actual chip yeah
this is running the this is running the
simulator uh
i want it goes so fast
i almost can't believe it worked
huh
no i think something's wrong
sure looks like it's working though
maybe it's working
i don't know what i did but whatever i
did made it use a lot less
oh
yeah it was doing everything
combinatorially before because i
actually messed my pipeline up
but now that i fixed the pipeline oh it
synthesizes with so much less resources
it's a long test
so when this is done this is running the
test right now this will light up
red if the test passes
these are lights from pc
already
hmm
maybe i always have paws edge clock tip
and we will figure out a little faster
like it is definitely using resources
it does seem like it's just using less
let's put sub i back in
can't find sub i
sup confined
i think it broke
if the rom is outside it doesn't work
i didn't wire it up correctly
how how's the fpga getting not hot at
all it's running so slow
now it's broken
oh
how did that compile
i hate this
well now it's back to using resources
you make a typo that's bullshit
how is that not caught by something
oh the wi-fi crews are back
yay look the red light turns on
that means test pass
yeah okay this is if it's doing the jump
remember we were just getting the red
light there on the reset
if it's just the red light it means it's
not doing the initial jump
oh yes
load word works
[Music]
um
oh
hmm
dual port memory 36
kbs
it's only 4.5 kb ah
how much cabies do i have now
i think more
that many
what it was doing before was just
running like running just knobs
it's like it was running but the memory
wasn't loaded
and it should have given me a warning
about that but it didn't
all right can we get stores to work
all right now stores don't work that's
kind of gonna compile with that display
statement still on there this doesn't
matter
stores
you'll see why the load halves don't
work because everything's
denominated on bytes
i bought the board
let's call it uw data ewen
i don't know if this works
um
which is that right for store
i don't think it is penned actually
it's like vs2 right
yeah it's vs2
that might not have to be a register
actually
works
now can you synthesize that
or is it going to like be like you have
way too much ramps
hmm
no it seems okay
all right
slower now
seems to work
i don't really get it though like how
does that work
where is it putting all those registers
all right i assume it like the thing's
not really stupid
does it look like it uses more stuff but
like it's fine
cool
i think that's pretty good got loads of
stores working
on the line loads and stores don't work
if somebody would like to fix that i
will add a little note
fix unaligned loads
and stores
fast multiply and
divide and better
introspection
cool
good night everybody
[Music]
[Applause]
[Music]
Wow bro now I'm doing that anymore
we want to talk about that we are not
packing it because hacking is bad that's
right man
don't be a hacker
you
[Music]
school refactor
and write a test on a haircut - that
guys
so order McDonald's she's gonna be here
to bed
Oh Mike I don't like that I can't factor
this out nice
far as it draws the matches
and we could just return the image just
and compute like this either this works
I'm not happy right now
you know know who told you you could be
none I've clearly returned image right
there does that return earlier oh yeah
yes it's already a zero it's fine
the way I'm drawing the annotations is
wrong I just don't like the way this is
like factor
like this refactor more who followed
this roof actor
another type object has no attribute
sorry sighs I shouldn't be in there
really
anyway
basically I paint the car
[Music]
yes
that's why
I wasn't drunk watching the guy drive
the clock all of this video
all right Richie's does anybody have a
good I'm trying to okay I'll tell you
what I'm trying to do I'm trying to make
it work in the rendered environment
wonder who I'll work out this guy's car
not well of all the snow moves but yeah
so that's what fake slams gonna be I'm I
have to do that refactor first look
McDonald's get V you soon
I got to make chickens and a small
french fries I'm not gonna eat the bun
of the make chickens I'm just gonna eat
chicken part and the lettuce and then
the french fries because then I can eat
the French fries you can't eat the bun
and the French fries that's Savage
like one wheeler or unity you know I'm
talking about
works for Windows
the beautifulest flower box
I want a game engine
what is this
it's a nice looking couch bro I can nap
on that couch
oh my foods here almost here I know
you're almost over
I know twitch Slim cuz it's tomorrow
like this have good demos it's amazing
how you just trust shit like this never
mind I can't open it because from all
identify developed what's the key you
press control don't have to go into God
no I'm sorry like security or something
no I think any jetskis bros I'm never
doing security again I forgot how much I
hated it actually canceled this is
really old really old
oh okay I don't want any of this you
know what you know what guys you know
what I have on my github you don't might
be the perfect yeah we'll use one of my
old projects low-quality raytracer
should we use low-quality raytracer
it's a good project
joke
this coat looks terrible here I mean it
did warn that it was low quality little
paulie's in right now I know it'll be
Polly kids
oh my fools here I'll be back
oh yeah we got mint chicken
I shouldn't have to write this
no they know what fries I got fries no
order with dolls
I ordered a fries a McChicken and apple
pie
and then brought me a mix chicken a
fries and another fries and I was like
where's my apple pie but then I just
went to sleep and didn't complain I
never learned how to be better
mmm savage all right
yeah
there's no Milan sauce why don't you
become why you something out use PI
OpenGL yeah yeah this is gonna work
I'm gonna doing Python 3 2 cuz we put on
three now
what the hell
why am i watching an ad right now
I don't even know the sad bunny who
wants the bun press a button by accident
I lost chopped some reason I went to an
ad see how this looks okay you can pie
gave a perfect high the example app
works
my Laura
well okay a few things we have to figure
out how to write in class
now on demo videos and uh big don't you
have broadband or you want dial-up is
anyone still on dial-up they still make
that I bet even in sub-saharan Africa
they're like whoa bro I haven't seen
dial-up and forever Magic Man
what's an agent
what's an adit
is this a political person I don't know
any political people hey spot mercy well
I solve my problem how I'm gonna render
so very strong these four tabs or spaces
not offensive tactics tabs are
incredibly
Savage
being McHale raincode this is the life
families hanging out today I bought nice
clothes
I got hecka
this looks hard
oh wow this looks hard
Goliath
and glide
I'm call you political I just said that
sounds like a political thing Majid pie
isn't that a political thing he's an
American particle than I think so is the
right country what about America oh who
remembers we started so many years ago
nobody remembers things like that oh I
just mean what as well mm-hmm ordeal
Mike you my beautiful cube doesn't make
sense but yet when I run that it works
that doesn't make sense no no that
doesn't make sense
display 127 importation
I've never done shit in my life to help
Barbies oh my god perfectly clear if you
ever thought I did something to help
normies that was a lie fuck this Penta
sativas mostly not cool you know the
internet used to not have normies on it
and he used to be nice and the normies
showed up on the internet and that's
what we are today let's ignore me ruin
internet with their Instagram follower
or snapchat likes and Twitter tweet
bowls and whatever normies ruin the
internet the internet was a great thing
keep hacking the lead okay segmentation
fault the left that's great
what normos don't know about McDonald's
why why you sedimentation vault 11 folks
I need glutes
let's do glass oh it doesn't crash I'm
so happy
what up bro your bro got a few fries but
guys mix no wife can subscribe to my
twitch I need money
bitch twitch can't even pay for the food
I eat wild and twitching it's gonna have
to be canceled canceled canceled
canceled
image oh gee L read pixels that's what
I'm talking about oh thank you thank you
boys on Yolo thank you
you guys never watch the cam girls on my
free cams so we shall have any contest
like that yeah fuck slowly I want that
brow now so he's gonna be relevant today
I think I think I might be punching down
my function down oh yeah look at that is
that a real image let's say wait a
second why do I need RGBA
no very suspicious
sighs nope bad nor me I was four because
of the egg
don't forget the a nice oh call it paint
[Laughter]
like this disgusting supply boy
$13 what is this
that was disgusting
are you regret fighting that scam
related to college what a scam what
college kids just be good at things the
best people I know it things didn't go
to college no almost tell me today that
I should wash my sheets I got new sheets
it was like you should wash them before
you sleep on them because they're
covered with chemicals and then I was
like but I am chemicals what do you
think I'm made of preservatives what do
you think I'm made of they're depressed
I'll do that
they don't have rice all its open at
it's probably worth to mcdonald do
anything melamine calories are in it
McDonald's they tell you the calories
and the Nutrition Facts which aren't
that bad bro doesn't know that bad bro
I'm just putting that out there bro
yo you know what I was thinking I'm not
on a healthy guy stop with that shit
stop health saving me I don't want money
I don't know what I would buy that's
right I give zero fucks match the other
day something about when you start
giving fucks about things don't take
them from you they will but you know
what they can never take her away from
you free software all right where was I
I'm kind of tired
hey that McDonald's and I'm come tired
I'm not like making a podcast let me
tell you if I'm making a podcast right
so let's say I want to do this right so
who's gonna be on my podcast this is
just gonna be me talking about shit or
am I gonna get guests then I got an
email the guests okay so you gotta like
email probably let's say 10 people for
every given you get three replies and
then like two of them say they want to
do it and then one of them finally comes
on your show so you gotta you gotta
email 10 people to get one now I gotta
schedule a time for them to come down oh
they're gonna come down to my office
they're gonna be late they're gonna want
to make small talk I'm gonna put them in
a room with a microphone and I'm gonna
have to think of a script I'm gonna have
to ask them questions I'm gonna have to
act like what the CEG's most fucking
interesting shit in the world and then
I'm gonna put it on a podcast nobody's
even gonna listen to it then I'm right
all right fine fine fine I gotta work on
my brand right so let's make a Twitter
and a Facebook and then you know we got
it we gotta get that get that social
gotta get the Instagram maybe maybe I'll
have a controversial guest or maybe I'll
have Steve man
Podcast right and at least they'll be
some outrage I'll get some clicks for
that for a little while but guys this
all sounds terrible why would I want to
do this now right that's my rant about
podcasts surrender or really living its
own
yeah yeah and then oh okay all right
let's keep playing let's keep playing
so then my podcast gets popular now Wow
man is podcast really great like people
are discovering it and shit it's all
cool but then like you have like one or
two episodes that aren't really that
great or maybe it's not even that
they're not that great but people just
start saying that - like man remember
the old podcast remember when it was
good wish you would keep making a
podcast like that maybe you wanna you
know stop making the podcast always
you're gonna get his hate man you're
just gonna get hate from all the people
oh man why'd you stop making the podcast
I'm gonna come to your house my fucking
shit up that's what's gonna happen why
would you make a podcast nigga with guys
let me tell you something out this
twister we got 33 people right now if
this twitch stream ever got popular
hahaha you better believe we gotta make
it go away cuz that would make it shitty
and that's what happened to the Internet
no no no a couple of 10 I went on a date
with alright did that girl which night
was that I don't know they're kind of
stopped hanging out with one girl been
hanging out with southern girl you know
whole life why do you think normies love
the thug life in County does lemon does
life is pretty awesome
I think normies live the most bitch-ass
life like to be honest here's what I
said just something I was thinking about
about Collin who owns a Honda Civic I
don't know apparently there's a lot of
them but like I don't know I don't know
a Honda Civic
it's nice car but like died role I'm not
tall human telling you the complete
truth about why I would never start a
fuck
like the girl all right use my advice
about that right you know sometime you
hear from people ah
insel man I'm involuntarily celibate and
here's what I asked them how might be
girls did you ask to have sex with you
today if the answer is zero little shit
don't be creepy about it but like so
yeah there you go that's what this
turned into that's what I'm saying
or at least how many women did you
interact with today who could there
could be a potential of you sleeping
together you get that number up that's
one of your key business metrics you
could track that shit with logs you
could you could put it in it
elasticsearch maybe throw a cabana front
end on that you could look at your
growth numbers you're doing so well you
could probably even get VC funding VC's
love growth no man which doesn't matter
at all get VC funding all right oh yeah
trying to make this shit work but it was
complaining that I had too much of luck
does work a lot redisplay needed for
window one but no display
tree back into this blight class and
make this DIY game
definitely not know if I ever feel like
you're sucking up to me in an interview
I'll throw you out so fast don't say any
of this shit man if anyone ever come to
work for me who talked like I talked on
Twitch's I've never hired process we do
that
yeah it's in a process
and should we tolerate insults of Python
on this channel oh well who remembers
the guy got banned yesterday I thought
his Python is ugly look is it
what's up nice-looking language now I'm
up time to think about this this is
interesting
crash hey crash
No
don't work a threat
in Madison College how much I care about
tools back in my day tools and people
that you made fun oh you know well like
that guy's a tool man oh don't give me
the shit about oh I hate this my game my
game work STL - problem example Mike you
there's some reason I tried to write
this with SDL because I was like being a
cute stupid
my game works alright let's just change
the display QD class
did I try to use pygame and I got like
fed up with it for some reason
Oh God gets screen size and that's a
nice one
all right self surface hey why are a
surfer nice way to do this
oh it's this problem I vaguely remember
this this might have just have to do
with events actually yeah okay it works
now I mean the colors frog but that's
okay what is that
colors
that's absurd
do you kitty pryde no we do anything
else tonight
it might be what we're doing tonight
it's kind of like there's things to do
tomorrow make this work first then I'll
be happy that doesn't work when I'm
incoming renderer so this is exactly the
same thing that happened before I did
always wonder why the colors were
backwards that did kind of answer that
long-standing bugs and twitch left
well maybe it'll all be a little as
Jackie now hopefully I don't like any of
that SDL stuff but you're telling me
that renderer still doesn't work
that's bullshit man redisplay needed for
window wat so basically I can't make pi
Gabe hmm and glut work at the same time
all right that's it that's a little
weird which streaming today if you want
to be a winner you should be happy no is
that true
a winner's happy
how are you gonna ask something like
that you got to ask is that true does
life balance help you with success -
like what are you calling success
remember when I've told you about having
a successful podcast is that really the
life you want a lot of success is some
scam that was just like like they like
tricked you into like like the
advertisers want you to succeed so you
can buy more crap success I mean yeah
you know a sock so what does work know
why it doesn't work
I could use my process I could have a
rendering process that does the
off-screen blot oh yeah we do pull
requests if you want to fix that a poor
customer check but you see where I'm
going with this I want to write a little
renderer get a few things up I want to
make slam work the other way I'm going
to sleep goodnight twitchy's you got to
we let's see we ate McDonald's and wrote
a non-existent crappy renderer let's
watch the cube rotate one we put the
cube oh so nice cube also nice peace
bros look at that beautiful cube
beautiful cube
wash your cube rotate
WEBVTT
Kind: captions
Language: en
stepaheadgold: Hi
toolegit2quit_: Wow
th3_maj0r: yoyo
kemfic: hey george!
Andrewnagyy: yooooo
suurrend3r: omggg!!
kemfic: nice chair
suurrend3r: brooooooooo
crisofilaxx: at least!!
WistfulFella: Ay George, how's it going
crisofilaxx: you lazzy hacker
thisisweeezy: yoooooooooo bro
Andrewnagyy: what's up man
Andrewnagyy: long time no see
toolegit2quit_: What is chill ?
suurrend3r: why ??
Andrewnagyy: How's Comma.ai
linlam123: yooo ma man
alluxua: Long time no see, geohot
suurrend3r: good to see you back
WistfulFella: Notice us BibleThump
linlam123: gaaraIQ gaaraIQ
littlebighead82: neaceBang neaceBang
roosterhax: Yo
suurrend3r: I stop follow you because I think you'll never be streaming again
suurrend3r: thought*
alluxua: cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1 cheer1
suurrend3r: PogChamp PogChamp
WistfulFella: Saw Apple became a Trillion worth company? @tomcr00s3
WistfulFella: Okay, sorry : (
roosterhax: learning to use odometry for drone autonomously control
Andrewnagyy: Have you seen the thread about the ex Tesla employee talking about the tech stack hell that's running on the back-end?
quillford: are you ever gonna work on twitch chess again?
linlam123: does he have any emotes???
Andrewnagyy: Am I allowed to post links?
alluxua: What he is coding? SLAM ?
Andrewnagyy: https://twitter.com/atomicthumbs/status/1032939617404645376
kemfic: https://forums.somethingawful.com/showthread.php?threadid=3862643&amp;userid=0&amp;perpage=40&amp;pagenumber=70#post487335699
WistfulFella: The Stock market doesn't interest you, George? @tomcr00s3
roosterhax: yeah he's making it possible so we can have level 5 autonomous driving
WistfulFella: ^
alluxua: I trust Elon musk took Tesla private tweet. Hating myself so much
kemfic: I'm gonna look through that multi-view geometry textbook you'd mentioned, then try to follow along lol
linlam123: only 30 ppl here?
linlam123: gaaraThump
desg92: good
th3_maj0r: lol
WistfulFella: @alluxua I like how he's not too arrogant, he listened to the investors and changed his mind
alluxua: That is a big lie. Elon musk never get funding secured.
kemfic: oh boy my favorite
alluxua: Geohot, how about we hear your new rap : interlude?
th3_maj0r: Did you work offstream on twitchslam?
alluxua: To be honest, geohot sings way better than those singers
suurrend3r: thats a new chair
WistfulFella: How much was it? I hear they're expensive those days
KhaosVFX: why don't you do periscopes anymore George?
WistfulFella: Uber Eats SeemsGood
KhaosVFX: @tomcr00s3
alluxua: He promoted himself to software engineer
KhaosVFX: yikes
kemfic: he's not the social media intern anymore
WistfulFella: I like how you're transparent and honest, I might consider donating
th3_maj0r: Maybe another chair, just 70$ more
linlam123: if i donate 1 dolla ..how r u gonna spend it ? :)
roosterhax: more harware, like multiple screens or parallel gpus
RS_Ggs: you're my idol
twintowerpower: love the boat feel his room has
twintowerpower: kinda makes me feel like a sea captain or something
TurkTurkelton: smoke weed
TurkTurkelton: nah brah
TurkTurkelton: never too early
TurkTurkelton: except when it is
Andrewnagyy: A lot of streamers in the Programming channel are mostly game engine developers lol
Andrewnagyy: I feel like the top 5 - 10 channels at any given time are featuring people writing game engines
Andrewnagyy: You have Java installed?
Andrewnagyy: :D
Andrewnagyy: You're one of the last people I would think writes in Java
benjaminr42: Right click &gt; Open and here you go ;)
RS_Ggs: What are you building
ilendemli: iirc u need a orthograhic thingy or perpective set
tomcr00s3: laggy?
ilendemli: yes
twintowerpower: not lagging for me
SteveATZ: ordering breakfast? is that really a thing? nice
twintowerpower: it is a thing for people that don't need twitch donos
DrRobotvinnik: ah it's yor gurl ArgieB8
dorkmo: mcmuffin
SteveATZ: was she your inspiration for your rap Kappa
Andrewnagyy: Get kebab
suurrend3r: nah i really don't llike that music bro
DrRobotvinnik: what about some smashed avocado on rye? ArgieB8
DrRobotvinnik: SeemsGood
desg92: get a bagel with cream cheese
alluxua: Avocado toast sounds great and healthy
SteveATZ: if you are too broke for butter just use avocado Kappa
WistfulFella: Search YouTube for "e-dubble be a king" Thank me later, the rapper died so rip
SteveATZ: you make me hungy again XD
gluecks: da fk, do i really see this legend live on stream tonight? I was just about to head to bed
alluxua: Let us hear YOUR music
DrRobotvinnik: all chess no legs
RS_Ggs: F
WistfulFella: F
SteveATZ: monkaS
Andrewnagyy: lol
suurrend3r: lmao
DrRobotvinnik: RIP camera
SteveATZ: work on a saturday DansGame
suurrend3r: coffee coffee
RS_Ggs: ew no bread?
RS_Ggs: Everythings fine
DrRobotvinnik: errday is a workday for George
alluxua: Yeah, go out for breakfast, Geohot
SteveATZ: when i hear "hey hey hey" I always have to think about the bitconnect dude meme
Nimolo00: Is this an imac pro you have there?
DrRobotvinnik: did you see that Everybody Dance Now research @tomcr00s3 ?
DrRobotvinnik: was pretty impressive
DrRobotvinnik: https://motherboard.vice.com/en_us/article/43pebw/ai-can-manipulate-video-to-make-anybody-dance
SteveATZ: maths NotLikeThis
RS_Ggs: Whats the purpose of this project? whats twitchslam?
SteveATZ: ok, let's ask what is the goal of this project xD?
SteveATZ: what was the basic idea
DrRobotvinnik: what is the purpose of you asking questions in chat ArgieB8
SteveATZ: CoolStoryBob
alluxua: SLAM: https://en.m.wikipedia.org/wiki/Simultaneous_localization_and_mapping
Dsplits: Damn finally streaming
Luki512: Hrllo :)
DrRobotvinnik: thanks, I thought this was Wrestlemania SLAM ArgieB8
SteveATZ: LUL
Luki512: *hello :) happy to finally see you live
newtomcroose: please add 480 and ... qualitys
suurrend3r: You have to use loots
Dsplits: How many mg of l-theanine?
DrRobotvinnik: it is a fascinating 'sport'
DrRobotvinnik: Deontay Wilder and co will soon turn boxing back into WWF fingers crossed SeemsGood
Dsplits: are you not watching the fight?
alluxua: Take some omega-3 fish oil
suurrend3r: logan vs ksi
Dsplits: damn got some 3D rendering going on
Dsplits: becoming a UI designer now?
gluecks: i can see advanced raytracing incoming
th3_maj0r: Is him hard losing frames?
Dsplits: Which libraries are you using for this?
SteveATZ: xD
th3_maj0r: 6 too much, 5.5?
DrRobotvinnik: sounds reasonable
desg92: just slam amazon
morphias05: Were you at DEFCON this year? If so, how was CTF?
MessageOSRS: PogChamp // hello
SteveATZ: if we donate here on twitch, jeff bezos will get even richer TheIlluminati
DrRobotvinnik: hopefully you're affiliate otherwise Twitch gets the lot ArgieB8
SteveATZ: amazon be like "nice, mind if a take 50%?"
suurrend3r: PogChamp PogChamp PogChamp PogChamp
Dsplits: @tomcr00s3 What do you do to stay concentrated?
suurrend3r: smoking weed
keepingtrckofthisacct: i remember you. it's been awhile since you streamed!
SteveATZ: i think beeing really smart also helps LUL
MessageOSRS: Depends 🤔
suurrend3r: LUL
gluecks: let's hear ur piano skillz
suurrend3r: PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp PogChamp
alluxua: Yeah, donot do weeds. Weeds really damage your brain neurons
suurrend3r: U like to be anonymous
Dsplits: @tomcr00s3 you should produce a song on stream
DrRobotvinnik: Geo only plays hashkeys ArgieB8
suurrend3r: We need a new rap, nah just kidding
suurrend3r: whats your typing speed ?
SteveATZ: now i want to see him do a typeracer xD
suurrend3r: less than 120wpm?
DrRobotvinnik: he may not be fastest typer but he nibble around Tmux
SteveATZ: what kind of keyboard do you use? (obviously not the standard imac one ^^)
suurrend3r: lool
SteveATZ: kk
Dsplits: his texteditor is emacs btw
suurrend3r: vim
DrRobotvinnik: they must have baked it on the drive ArgieB8
MessageOSRS: Face of Twitch
Dsplits: @suurrend3r lol ik
SteveATZ: I also want a DXRacer, but I don't have like 300€ to spend on a chair FeelsBadMan
suurrend3r: MaxLOL MaxLOL
th3_maj0r: So... what do you wanna talking about guys?
DrRobotvinnik: tmux is the terminal multiplexer bros, just so ya know ArgieB8
alluxua: How much for that chair?
suurrend3r: Nah I don't need a DXRancer brahs
th3_maj0r: 150$-200$
alluxua: thanks!
flappieh: hey
SteveATZ: they start at like 200
Dsplits: damn the driver has to get comma.ai driving system
suurrend3r: LUL LUL LUL LUL
SteveATZ: LUL
DrRobotvinnik: ArgieB8
suurrend3r: lmao
suurrend3r: google maps
DrRobotvinnik: is the driver in a Tesla?
DrRobotvinnik: Kappa
suurrend3r: hahahhahah
SteveATZ: just let your car drive there on its own ^^ roll down a window so they can put the food in and it comes back LUL
DrRobotvinnik: dunno, if you're stuck in a hole Tesla will come get you out ArgieB8
Winnepooh_: are you saying that teslas aren't available to the average silicon valley resident?
stepaheadgold: food
alluxua: What you got for breakfast?
flappieh: what keyboard do you have? @tomcr00s3
desg92: the bart is insane there
SteveATZ: we don't talk about keyboards here Kappa
Dsplits: what's the average rent in san francisco?
Winnepooh_: so what you're saying, Fresno &gt; SF?
SupaStylin: @Dsplits 1 kidney every 6 months
SteveATZ: how much?
Winnepooh_: 2700-3500/mo SF
SupaStylin: :kappa:
desg92: just get a hhkb
Winnepooh_: haha
RS_Ggs: What's banned from this stream? Keyboard? Emacs?
hubabuba1243: arent u a millionaire yet?
Dsplits: @tomcr00s3 Would you use emacs for 1 hour if I donate?
SteveATZ: how to donate xD? via bits?
hubabuba1243: :)
SteveATZ: food is love, food is live
th3_maj0r: Sellout
alluxua: CupFooty
SteveATZ: !paypal
suurrend3r: Ctrl Z
Dsplits: ctrl x crtl c
SteveATZ: restart
suurrend3r: F10-Q
desg92: ::quit
desg92: lmao
Dsplits: ctr x   c
DrRobotvinnik: Viceland headline: veteran hacker stuck in emacs ArgieB8
dorkmo: alt f4
desg92: 656 pages?
SteveATZ: PogChamp PogChamp PogChamp
th3_maj0r: 20 tabs with chrome, he must have at least 128GB of ram
suurrend3r: NotLikeThis NotLikeThis NotLikeThis NotLikeThis
suurrend3r: LUL LUL
th3_maj0r: nano &gt; all
SupaStylin: @th3_maj0r (y)
SteveATZ: nice serial number LUL
SupaStylin: nano r0x
Dsplits: Damn that processor Tho
SteveATZ: needed one for a hackintosh Kappa
th3_maj0r: ahahah
Dsplits: I stay away from apple products
Dsplits: it also has a backdoor
imsooinhuman: hey i once watched one of his livestreams and he had rap battles from youtube running. does anyone have a link to them?
suurrend3r: 2 cores
Winnepooh_: that was posted in 2016
SteveATZ: do those newer CPUs still have Meltdown and Spectre?
Dsplits: you still have tesla stocks?
SteveATZ: amazon is also crazy
SteveATZ: bezos is a rich rich boi
th3_maj0r: Facebook lost a lot i think
Dsplits: He is not taking the company private
alluxua: In the past 3 years, nvidia has annual return over 100% millions ( rolling 365 days pct-change)
alluxua: * over 100%
newtomcroose: @tomcr00s3 bro . i am always crazy
suurrend3r: comma.ai stock prices
alluxua: Geohot, use deep learning to train stocks . It is really profitable
Winnepooh_: has comma looked into AMD GPUs in their machines, or is everyone on the Nvidia train?
newtomcroose: u shoule be rich
twintowerpower: What would train the stocks to do alluxua?
twintowerpower: you
Dsplits: yo @tomcr00s3 just heard "i want to be in love when the endgame plays out"
Dsplits: that shit is fire
SteveATZ: cheer1 how about that keyboard Kappa
alluxua: Traditional investment banks donot know how to code LSTM
linlam123: wait why do u say that reinforcement learning is a scam?
newtomcroose: block by block
Dsplits: @tomcr00s3 What is the number? for you to retired?
alluxua: When you get rich, you can get 10 pretty women standing behind you while you twitch
newtomcroose: @tomcr00s3 please dont come back after me , thats not gonna work now
SteveATZ: win win
suurrend3r: U need money to buy a land
JoneKone: Finland
linlam123: finland doesnt exist lol
linlam123: :D
linlam123: no land there
th3_maj0r: Zlatan bought an island
SteveATZ: some little island and chill
Dsplits: lol that shape
JoneKone: :P
Dsplits: are cybersecurity companies a scam?
newtomcroose: @tom
newtomcroose: @tomcr00s3 do u like liveing alone or living with your parents ?
SteveATZ: one bomb long LUL
newtomcroose: iran ?
SteveATZ: i wanna have a wakanda 2.0 LUL
Dsplits: @tomcr00s3 Are you into luxury cars?
SteveATZ: never seen black pantha?
SteveATZ: it's in the marvel universe
linlam123: do u watch any tv shows?
DrRobotvinnik: buy Mar-a-Largo, should be up for sale soon ArgieB8
SteveATZ: this movies was great
SteveATZ: cash cow
JoneKone: I agree StarTrek 3 was :( bad
Dsplits: Marvel movies are all the same but with a diff character
SteveATZ: tbh I like the marvel movies, they have nice visuals.
Dsplits: have you been to Miami?
MessageOSRS: What would be the best way to detect each of these different objects in python? https://gyazo.com/8206b01154a1d2052d7c84f0c302a6aa
MessageOSRS: Then give me a donate button 4Head
Dsplits: How are you the ladies down in Miami?
newtomcroose: @tomcr00s3 bro . living alone or with family ? i mean , in the house
SteveATZ: what's your paypal me link?
MessageOSRS: ^
Dsplits: @tomcr00s3 I'll donate $100 if you use emacs for an hour
JoneKone: @MessageOSRS You have to buy Eon
MessageOSRS: jaseS fuck @JoneKone
newtomcroose: who like living in tehran ?
th3_maj0r: Lol man u are easy to buy wtf
th3_maj0r: ahah
SteveATZ: when I google your paypal all I can find are the old articles that sony can use your paypal or so xD
alluxua: CupFooty CupFooty CupFooty
newtomcroose: u should search about this
SupaStylin: oh cmon
SupaStylin: my internet connection is a "#&amp;"&amp; crap
SupaStylin: always buffering and stuff
flappieh: subscribe and he will use emacs
newtomcroose: i wanna buy a pizza . i cant donate u bro . what should i do ?
DrRobotvinnik: put your bits where your mouth is he's accepted the challenge ArgieB8
flappieh: donating to @tomcr00s3 &gt; eating pizza
Dsplits: sec got to ask my mommy for her creditcard
flappieh: LUL
BornHanYolo: With the video data that you saved, is the mp4 data holding data of the GPS, magnometer, and accelerimeters?
newtomcroose: who like "north of iran nature" ?
BornHanYolo: no slam
newtomcroose: i got u
quillford: is it true that block chain powered V2V is necessary for L4?
SteveATZ: TheIlluminati TheIlluminati TheIlluminati
JoneKone: What? Truth? What do you want to know about North Koreans?
newtomcroose: i love trump . because his hair is cool . and wife :)
newtomcroose: war is the 2018 ? this is a jock man
SteveATZ: Jebaited
DrRobotvinnik: ArgieB8
alluxua: Yeah, you went to china and danced on a square with middle aged women
SteveATZ: deus vult
newtomcroose: do u like physical war or computers war ? :|
SteveATZ: good old crusade
DrRobotvinnik: yeh sword fights, that's a proper war
DrRobotvinnik: that and WWF
DrRobotvinnik: ArgieB8
DrRobotvinnik: what about catapults?
SteveATZ: for HONOR SMOrc
newtomcroose: what is your comment about DARPA ?
laravells: @tomcr00s3 What are you doing for hairloss?
DrRobotvinnik: unreliable catapults, seems fair SeemsGood
th3_maj0r: Speaking of serious things, in my opinion the chair you had in the video "Hacking Lessons From geohot" looks much more comfortable than the one you have now
MessageOSRS: God damnit trying to buy bits but it's not going through
MessageOSRS: Never mind, only took about 10 minutes
laravells: @MessageOSRS omg osrs
johanuhrskov: Watch KSI vs Logan paul ;)
laravells: @johanuhrskov Hook me up with alink
Dsplits: Won't let me buy that many bits
Dsplits: send me your paypal link
desg92: !donate
Dsplits: !donate
Dsplits: No bot
newtomcroose: live alone or with family ?
Dsplits: Under his parents basement
newtomcroose: this is shit dude
Dsplits: what is?
newtomcroose: question is realy simple
newtomcroose: bro . i am 18 . give me a advice . i love computers stuffs . and weed , and space , and shity things . and "MONEY" . yeeeeeeeee
MessageOSRS: cheer250 Blame Twitch for it taking 10 years but here it is: https://gyazo.com/8206b01154a1d2052d7c84f0c302a6aa I've tried template matching, color matching and deep learning but none seem to accurately classify all individual objects 100% of the time. What approach would you take?
MessageOSRS: They are
MessageOSRS: Because the background differs every time
Tal_X_Tal: PogChamp
MessageOSRS: 🤔
newtomcroose: FrankerZ
MessageOSRS: So just slide over every sprite in the image?
MessageOSRS: And then template match each sprite
MessageOSRS: Cool thanks :)
quillford: cheer1 cheer1 cheer1 cheer1
MessageOSRS: Best $2.50 I spent this week
newtomcroose: im sad and i know it
newtomcroose: xxxtention
n1tr073: programming what
n1tr073: great
n1tr073: hi geo how r
n1tr073: ah ok i see u r working on an event driven program
suurrend3r: I learn to live with the loss
n1tr073: but can u tell me what is the input that the program response to
suurrend3r: I'll drink 100 cups of coffee
DrRobotvinnik: '50 cups of coffee and you know it's on'
Luki512: are you using the default von or any extensions?
Luki512: *vim
valgrind: emacs forsenOMEGA
linlam123: there is no donate button tho?
linlam123: or am i blind
th3_maj0r: Good people don't need a good chair
DrRobotvinnik: broski went quiet after that ArgieB8
alluxua: Guys , be nice to GeoHot. It has been a long time since the last twitch.
suurrend3r: bro, he says he got 100$ on donations
suurrend3r: nah just kidding
suurrend3r: im improving my english talking to geohot. Elon Musk is watching the stream secretly
SupaStylin: yes, i am here
SupaStylin: ^^
SupaStylin: not secretly,tho
suurrend3r: PogChamp PogChamp PogChamp
suurrend3r: Bro programming is life
suurrend3r: Geohot inspired me to make a typing-test in php
suurrend3r: LUL LUL
suurrend3r: with js and mysql
dorkmo: Bro-ken
dorkmo: very nice
DrRobotvinnik: TaiKwonBro
DirectorHomeless: Been a while
DirectorHomeless: Buy more ram ;)
DrRobotvinnik: ArgieB8 /
dorkmo: gnite
TheCremaxx: yo :D whats up
TheCremaxx: how did you keyboard not get broken by typing that fast :D
mattikaldi: is life meaningless?
RS_Ggs: back from your nap?
suurrend3r: I learn so much about python watching you code bro
mattikaldi: lol
mattikaldi: this some banger music
mattikaldi: trumptrumptrump
mattikaldi: fuck kinda algorithm is this
MetaExplode: go is a world with many uses
MetaExplode: :|
suurrend3r: true
MetaExplode: right to ur face
MetaExplode: :))
mattikaldi: seemsgood1
MetaExplode: :D :D
theGeekPirate: Could probably uBlock pick it
MetaExplode: just calm down
MetaExplode: and dont search go any more
alluxua: the world is full of shit
theGeekPirate: What happened is that people are used to it. We're not in Kansas (1995) anymore, Dorothy.
mattikaldi: search go and you get "why Ben Affleck went back to rehab" lol
MetaExplode: actually ur reasult of go is wway better than mine
MetaExplode: go to settings and change google settings
RS_Ggs: New default search engine
alluxua: Haha, I got to search go on my computer
THATTACHYON: which monitor to you have ?
MetaExplode: what r u test and optimizing anyway?
lsx_daniel: Hi
lsx_daniel: what are we making
lsx_daniel: i meant you
lsx_daniel: lol
alluxua: Geohot, your google go results are way better than mine. You should feel blessed
MetaExplode: no one knows @lsx_daniel
linlam123: man why do u delete ur old streams?
mattikaldi: they've been messing with your algorithm
lsx_daniel: any recommendations on where to being programming, i tuned trucks but i wanna get more into programming
linlam123: i think some ppl r just pure evil
linlam123: idk
alluxua: How you view the world, geohot?
mattikaldi: sad thing is that most people are only driven by money
RS_Ggs: get him boys
linlam123: :)
lsx_daniel: I just wanna make money so i can rebuild my 454 big block
lsx_daniel: i think making money is good but too much of it can change you in my perspective
mattikaldi: well, i agree that capitalism is where it's at though
flashingwolf122: What is being coded ?
temanning: @flashingwolf122 SLAM
mattikaldi: i live in norway and it fucking sucks tbh
temanning: Does anyone really want Communism?
alluxua: well, in this whole world, US and Canada are more and more like communism system
temanning: I think the demand is more for a socialist system
mattikaldi: lol
alluxua: Agree. Socialist system
temanning: @mattikaldi What sucks about Norway?
alluxua: people there are starving and kind of like refugees
mattikaldi: 48% tax plus a shit ton of fee's
lsx_daniel: im lost
lsx_daniel: lol
alluxua: i don't love google that much but can understand its decision. I run a lot of prediction models on google. Before sundar became the CEO, it is performance was pretty bad for about 2 years for investors
linlam123: have u read fountainhead?
mattikaldi: i'm embarrased to be Norwegian TBH
temanning: @mattikaldi Do you think the Free Healthcare is worth it?
mnero: havent heard of this in Finland :o
kuhrect: hey this isnt flare on!? :p
alluxua: Relax, geohot. it is saturday
Im_Andri: heyo
Im_Andri: what are we doing here ?
temanning: @tomcr00s3 I just saw the HD Maps Comma is releasing. Are you looking to make better version of Google Maps?
temanning: Is that not allowed?
temanning: Alright thats fair
alluxua: As far as I remember: no comma ai, no crypto, no keyboard
RS_Ggs: cant see face cam in the way
alluxua: yeah, it is pretty impressive. You are always a genius!
olack412: Why are you doing this?
olack412: Kick some bars
Tigerman143: are you still trying to recreate the driving video?
olack412: How do you stay focused for so long ?
alluxua: @olack412 , I guess that is how he grew up. He get used to this life style. I was curious this in the past as well
olack412: Is that orb slam 2?
RS_Ggs: your matrix is prob fucked
olack412: Geo on edge today somebody get the man a fucking cinnamon roll!
Winnepooh_: cinnebon
olack412: back later?
alluxua: Thanks for twitching, geohot! Go to have some fun this beautiful Saturday!
olack412: what your email ?
olack412: I need a verse
alluxua: Probably a girl?
olack412: Filter out that shit bro
olack412: Crazy &amp; weird shit sells
olack412: Are you a cryogenics participant lol
alluxua: I want to live up to 125 years old
olack412: Lol in our lifetime thats the only way to stick around
alluxua: No, no, we hear you. We are not computers
olack412: Lmao we getting into deep thought
olack412: Has anyone used group FaceTime yet? How well does it work?
olack412: brb
alluxua: Enjoy the waffle! I appreciate you spent time with us . Your sharing always motivates me! Thank you, forgot!
alluxua: I mean: thank you, Geohot
all right did I set everything up
correctly Hollywood celebrities what do
they know do they know things let's find
out okay so a few things are a little
bit different today we're at the tiny
Corp
office um you can see over here in the
corner got this uh you know very
accelerationist uh
poster uh we get this is the siren this
is if if tiny grad goes over 5,000 lines
we set the siren off okay so you can't
go over 5,000 lines all right I'll make
myself a little bigger while I do this
now uh a little thing to
note hello hello
hello uh a thing to
note is that my camera is over here uh
because I have my Mac up on one of them
little emeran stands oh and just so we
don't get a million questions about it
as you can see I have an app M3 Max all
right um you know I know you guys love
this shit and guess what we're going to
do it cuz I'm in a good mood today you
know I'm in a good mood it was like a
holiday man my aura ring says I slept
great last night uh so
yeah uh we're at the tiny Corp office
this is some tiny Corp stuff over here
um okay uh what else did I have to show
you oh yeah this is my Logitech MX
anywhere Mouse this is my new mouse of
CH Logitech you're never going to
sponsor me I'm too much of a brand risk
I'm too much of a brand risk I might go
off and start telling you who did
911 and the answer was it was Bin Laden
with
the tacit acceptance of the CIA how
about that
um I did not forget to unmute my
mic uh because I checked all that
because I set up all the new
configuration
uh
okay
so you just figured out you guys hear
about qar man qar way they hear about
AAR Friday's for the boys welcome
welcome welcome welcome okay so uh let's
wait till we get a few uh viewers in
here and then I got to tell you all
what's new tiny Corp has an
intern um we have an intern and we have
two more interns uh
joining uh in January and we're open to
as many interns as we can fit in this
office which is a lot of interns uh so
if you want to be Sam Alman is not the
intern I think he's going back to being
CEO of open AI um now guys guys guys
guys guys wait wait wait oh that's a
good thing thank you for bringing up Sam
Alman before I turn off subscriber
chat Sam Alman is not
uh let's just say if you lik
2015 Silicon Valley hype culture Sam
alman's your guy but considering that
nobody likes 2015 Silicon Valley hype
culture Sam Alman is not your guy now it
just turns out that there's actually
worse people in the world than Sam Alman
like Helen toner um you know if if
you're a effective at least Sam Alman is
not an effective altruist um who are
terrible people and you know that's it's
it's every utilitarian see the thing
about the utilitarian is look look look
look look okay look we got to change the
trolley tracks right the utilitarian
knows that if the trolley is about to
hit 10 people we have to throw the
switch to kill the one person right but
you see why that's so dangerous because
then the utilitarian says well if I
murder one person I can save 10 people's
lives would you kill Hitler okay but
what if they're not really Hitler but
what if they could be Hitler in the
future what if I think they could be
Hitler in the future okay okay what if
like hypothetically maybe someone else
thinks they could be Hitler in the
future I can still kill them right okay
what if I just don't like them I can
kill them right see and now you're a
murderer and it's very easy to go from
utilitarian to murderer right it's a
simple pipeline through simple logic we
can go from flipping the the the the the
trolley problem flipping the switch to
to being a murderer right and you btfo
moral philosophy you can't do anything
about that the truth is you got to not
flip the switch you got to say that's
not my fuck trolley man I don't know who
built the trolley I don't know who tied
the people to the tracks but I am
leaving and that is the morally correct
thing to do and anyone who thinks
otherwise you're a murderer you're still
a murderer man you're still a murderer
because eventually it's not a trolley
and you actually set the trolley up and
you know that's the problem so you just
got to be like not my trolley not my
people uh you just got to you just got
to let it go man that's right yeah
you're going to be the guy pointing the
finger yelling Hitler exactly exactly
the problem with effective altruists so
everyone knows
uh if you you know uh see an effect of
alist they are Hitler and I'm pointing
the finger at them and it's okay to
murder them just kidding don't murder
people we're not effective altruists
okay good so the rant about effective
altruist is over now it's time for the
rant about Sam Alman Sam Alman is better
than effective
altruists um he is still not you know
your ideal uh leader for open
AI uh yeah so now we can go back to all
the problems with Sam Alman now that we
got rid of the worse people than Sam so
just remember that it's not it's not
like you know we got we got someone
great there Sam Alman is a megalomaniac
and from what I hear a pathological liar
but you know look look man like are
those the worst traits at least it's
better than being an effective altruist
because I'll take a megalomaniac and a
pathological liar over murderers and
doomers not all doomers some doomers are
okay right some you Kowski is a good guy
he's a good guy I know he's trying a
strategy it's not the best strategy I
think but like that's like my opinion
man there's good people and there's bad
people and effective altruists are bad
people that's
right
okay
uh no it was not set up by Microsoft I I
think that it was just four people who
didn't like Sam mman for various reasons
and to be fair there's a lot of reasons
not to like the guy and they all kind of
decided to kick him out ah and then
they're like holy shit wait you know
wait a second this was a bad idea um
look is Sam mman the worst person in the
world no he's all right he's all right
you know what to be fair if you're going
to ship me laundry buddy too I'm excited
okay we're all excited about laundry
buddy to got to know how to do that
laundry um no look it's not what we were
promised with open AI but if open aai
wants to not do regulatory capture and
build I love gb4 I've really started to
use it for a lot of things um I think
it's gotten a lot better
too uh so yeah no I I uh look you want
to keep building products like that I'm
happy to keep giving you $20 a month
uh and be like yeah you know he brought
us GPT for so on that here's here's
neutral here's neutral here's where you
are sitting at home watching your thing
Sam Alman is better than you okay
effective altruists are down here by not
being an effective altruist you're a
good person
congratulations um what are we doing
today okay well first we're going to
disable uh subscriber
chat uh non-subscriber chat because we
can't let nonsubscribers talk cuz we let
nonsubscribers talk they say things and
they derail the
conversation um conversation derailers
you're still better than effective
alterist
congratulations um no but you do you do
understand this you you do understand
how simple the pipeline is from
effective altruism to murder right like
it's the simplest pipeline ever it's
like if you're flipping the trolley
switch you got to start asking yourself
in life well where are their other
trolley switches that are not flipping
what if they involve buying a gun and
shooting somebody but don't worry I did
the utility calculation and it's going
to save 100 people's lives trust my math
bro trust my math can I show it to you
no you can't you can't see it because if
I showed it to you it's AI safety man AI
safety um so that's right that's right
uh we're going to go sub
only we're at work at the tiny Corp
office
um
now you see the guy who drives a trolley
over the one person backs it up and
drives it over the 10 people they're
still better than an effective altruist
because they do not believe they're a
morally good person see that that is
it's not even that they're murderers
right like most murderers are actually
probably better like the effect of
altruist murderer is the worst kind of
murderer because the effect of altruist
murderer thinks they are a good person I
do not think most murderers really deep
down are like yes I'm a good person um
I've watched a lot of True Crime I I
know this to be a fact most murderers
like you
know um so most murderers are still
better than look look if you're an
effective altruist and you're donated to
malaria mosquitoes you're probably
better than murderers but I I don't know
man you've perpetuated one of the most
evil ideologies since communism uh so
yeah that's that's that's a problem
uh now no we're not going to get the
effective altruists we're just going to
decimate their philosophy uh that's
right that's right don't don't don't
don't Lynch an effective altruist uh it
say you're you're not no you see because
you're still the bad person see that's
the problem you are passing like like
like like you can pass judgment on other
people all you want but when you point a
gun at them and you take away their
malaria Nets that's when we have a
problem right cuz CU you know every
malaria net no never mind no um
do we agree that EA lost big time man
big time last November they they made
FTX happen and this November they tried
to destroy open AI but it didn't work
the forces of Sam Alman and moderately
better than neutral prevailed uh but you
know Sam Alman you can turn this around
and two things two things I have advice
to Sam Alman two things one stop with
the regulatory capture I wouldn't have
nearly as much of a problem with you if
I didn't watch you go in front of
Congress and try to regulatory capture
other people right so so basically
that's do not try to stop open source
step two contribute to open source and
then everyone will legitimately love you
if open AI started publishing papers you
don't have to publish the weights you
don't have to publish the weights you
need a business model that's totally
fine but publish the architecture of
your new models um publish papers and
then everyone will love you and you'll
still win you'll still win and everyone
will love you actually you're probably
even more likely to win because everyone
loves you so this is this is like think
think come on think about second order
effects here man you'll have my support
and we know my support gets you nothing
but you know at least at least uh you
know uh you have my support if you start
op sourcing things if if you don't open
source things look I'll pay you $20 a
month and you know what I put you on par
with Google do you want to be Google I
mean look look at Google right like oh
everything was pretty good until it
wasn't you see that that was just in the
front page of Hacker
News would I accept investment from
Arabs yeah I'm not racist man don't be
racist I'd accept investment from anyone
who it makes sense to accept investment
from um no look I'm I'm Happ well Saudis
building uh building big uh building big
deep learning computers this is great
the last thing we ever want is a
unipolar world right we do not want a
world where like you know do you want
the Saudis to have the unipolar world no
no a a an American unipolar world is
marginally better than a Saudi unipolar
world but what you really want is a
multi-polar
world
um uh binance Bank
liquidity I I didn't even I didn't even
follow that I it just seems like the US
Mafia shook down CZ for billions of
dollars and he paid them that's that's
take away there when is Tiny Corp Going
Global it's actually region locked right
now you can't download Tiny grad in
France I'm sorry I'm sorry no that's
stupid man you can even buy a comma
device in France look at that by the way
buy a comma device uh you're never going
to find them cheaper than this 1150
we're raising the price probably
starting next uh next January uh we made
the price too low so this is the
cheapest you're ever going to find them
I didn't even want to do a sale this
year you know why I didn't want to do a
sale because of the whiners well I
bought it two weeks ago can I have the
sale price no and you're the reason no
one's ever getting sales
again um why can't you buy in France I'm
kidding man I'm kidding I'm joking about
the stupidity of but is global we have
to do a launch in Thea
region God God do you not live on the
internet bro I spent my whole life
looking at screens man I live on the
internet the internet's a global
phenomenon the internet routes suround
censorship only the based internet the
un-based internet does not the un-based
internet Embraces
censorship um okay Petty
grad uh is Comm body coming before Tesla
bought yeah you can buy a Comm body
today boys how come you haven't bought a
Comm body yet you know go to comma.ai by
the way Black Friday shop
whoa whoa okay we're moving into the
computer part of this whoa check this
out can actually I have a third screen
now I can bring that over there you
don't even know you don't even know boys
you don't even know you don't even know
about my bitch don't know shit about my
third
screen um the internet was a beautiful
thing before this region lock guys bro
it's just region lock bro we need new
DVD John you
know
uh what Hardware do you need to
contribute to Tiny grad you can
contribute on a Raspberry Pi bro you
literally could tiny grad runs on a
Raspberry Pi
um You probably can even use the GPU it
might be the fastest deep learning
library on Raspberry Pi uh yeah so this
is the ad portion where we this is an ad
for comma uh buy a comma 3x no you'll
legitimately love this thing let's see
what people on Reddit are saying I hate
George Hots and I hate comma AI but open
Pilots made my life
better let's
see and you want parking assist not
going to
happen
compatibility St oh if not using comma
3x yeah oh yeah you'll absolutely love
it night and day difference I'm running
Sunny pilot all right does comma 3x work
with this don't listen to salesman
that's
true uh will K ever use a 2K or 4k
camera bro we have three 2K cameras
that's like 6ks actually it's not it's
like 3K but don't does nothing make
sense and if you know Matt feeling
understand why I said that but you know
whatever
um the AI behind open AI is
dangerous wait yeah yeah Q star man Q
star it's it's going to like turn you
into a paperclip man no actually I have
a fire alarm for AI you know what you
know everyone's like there's no fire
alarm for AI there is a fire alarm for
AI and it's this how many humans have we
had to stop with violence right think
about it we've had to stop humans with
violence before like Hitler right like
you couldn't stop the guy you had to use
violence right um um I don't know who
knows what the past was but
hypothetically that's a story we're told
anyway so right we had to stop the guy
use violence right when we have to use
violence to stop an AI That's the fire
alarm for
me that's actually and not not an AI
under the control of humans when an
autonomous AI when the only way for us
to shut it down is with violence that's
the fire alarm for me for AI safety
right and this will
happen but I just want you to think
about where we are now and how far we
are away from that right it it's openi
API went down over the weekend right
like uh not over the weekend two days
ago it's not the weekend feels like
weekend because of the holiday um it's
so hard to keep these things up right
like imagine covid but you had to work
really hard to keep it up like like like
viruses that shit's scary man AI is the
most fragile organism ever yeah it might
be this super intelligent thing but it's
hyper fragile right when it's not
fragile when the only way to start to
destroy it becomes with violence that's
the fire alarm and then we got to worry
about AI safety and I appreciate that
researchers are doing research into AI
safety right now but don't try to tell
me that AI being racist is AI safety
because that's not and AI safety people
your greatest enemy is not me or not
even e ACC people it is the fake AI
safety people they are stealing your
name like David Copperfield like Machine
Gun Kelly they're stealing your name
they're taking AI safety and using it to
mean AI not being racist and those
people are the greatest enemies of the
true Doomer so so you know uh you Kowski
Conor Ley luron all your people focus
your attacks there that's who you need
to be going after the Helen toners of
the world look I don't mean to rip on
Helen toner I'm sure she's a nice woman
I don't know but she voted to kick Sam
Alman off the board from the evil side
right from the evil side the side who
wants control decide who wants your
brain wow I'm sounding like Alex Jones
right now all
right H good thing I'm the only person
in the office I'm probably not hope I'm
not distracting anybody
uh AI being biased is safety yes exactly
that's who you need to go against and
you start to need to worry about AIS
that need to be destroyed with weapons
that's the fire alarm for AI once we
have to start to use a Tomahawk missile
to take out a
computer all right what's your fire
alarm for Bears ask yourself that
question you see Bears you're not that
worried about bears right but we've had
to use violence to stop Bears before so
Bears right now bear safety is a higher
bar than AI safety now it's true the a
are improving fast and we're not
expecting too much improvement from
Bears um but I will remind you that
we've had to use violence to stop bears
and today we've never had to use
violence to stop a
computer um
but yeah no so so like the the thing is
like like did the good guys win in the
opening eye board scenario the bad guys
lost but I'm not so sure the good guys
won um when AI becomes dangerous we will
know way before they go on an arc to
wipe out all of humanity
exactly
exactly uh you know and again we'll have
to use violence to stop some AIS before
so that's my fire alarm I have a fire
alarm you can hold me to that and I'm
not saying like like like one computer
I'm not saying some Rogue guy blows up a
data center nothing like that when we
actually have no other way to stop the
computers and not over like a 10-second
time Horizon we have like no other way
to stop the computers it's like for a
week oh my God they're there are
amassing forces in Liberia right like
like like I want to take over a country
right like why can't AI right like when
AI takes over a country well shit man
that's when we got to start worrying
about it right let's apply the same
standards to people that we apply to
computers or the same standards to
computers that we apply to people
because AI are people so are
dogs all right oh tiny box design reveal
oh I have them oh I have them some
people have seen it if you're a red
you've seen it um if you were a red in
the tiny gr Discord meaning you solved a
bounty you have seen
it uh until it aligns with a great reset
I don't know man I don't think there's a
great reset I think there's just some
terrible effective altruists out there
and you know the Communists effective
altruists like really really the same
two heads of the same coin they both
want to centrally plan you right they
both want to take away your freedom
fundamentally the effective altruist
thinks that they can spend your money
better than you so they then become
morally Justified to steal your money
and that's what SP SPF was right the man
says I am a better effective altruist
than than you so I am morally it's it's
in fact it would be a great moral wrong
if I did not steal your
money uh and and and use it for good
because I can use money for good better
than you can so therefore I'm morally
justified in stealing your your money
right and you know that extends to
killing you as well trust me there's no
end to utilitarianism and it's a
terrible ideology and wow we spent a lot
of time ranting about
utilitarianism um so yes uh 2015 Silicon
Valley hype Sam Alman culture is margin
better than effective
altruism stop with the regular story
capture shit and I will stop outright
despising you not despising but I'll
stop I'll stop ragging on you if you
want to make a product you want to keep
a closed SCE that's you want to you want
to keep your improvements to yourself
that's great but don't try to prevent me
from following in your footsteps that is
where we have a
problem
okay
I don't most of tiny grad is trying to
do though well you start with grammar
and then all right I am going to be
right back and then we are going to get
into
coding coffee from California
Bean we got to chill man you know what
I'm GNA get I'm GNA get a recess we're
going to chill we're chill we're not
very chill right now we are really amped
up because it's the first stream we've
had since there's been so much big drama
and I want to share the truth with you
guys especially my subscribers who I
appreciate more than the
non-subscribers
um the voice of the people I try I try
now I'm the voice of me man I'm the
people though if you align with me see
the thing is the nice thing about my
ideology is like I'm not doing it cuz
I'm a nice person I'm an asshole right
but but see the the problem with me
taking your shit and the problem with
that being okay and oh my God is this
libertarianism 101 Libertarians are
losers and that's why they don't own a
country uh the truth
is oh man I wish I wish Libertarians
weren't losers man I wish I wish like
like this is the problem man this is the
problem you see look look all right
we're going to go one more thing Curtis
has this thing that I love it's like
like why did the South lose the Civil
War right um the
North Charleston didn't have ideas about
how to govern Washington they wanted to
be left alone right Washington had ideas
about how to govern Charleston and
that's why they won the war right The
South was winning fighting not to lose
the north was fighting to win so it's
very unfortunate and that's why
libertarianism sucks that's the greatest
problem with libertarianism it's great
but we have to ask the question how do
we get from here to there and the answer
is you know we need a a fascist dictator
to take over and impose libertarianism
but the kind of fascist dictator who do
that you see the problem right you see
the problem that is the great problem of
political philosophy libertarianism is
right about everything but it's not
stable because the person who enforces
libert you see you see what I mean you
see what I mean you see the problem
um that's right that's right no monarchy
is nice you just need a king who's
libertarian and secure in his power
right that's that's why monarchy's nice
but see monarchy can go really bad cuz
sometime you get a king who's an idiot
and believes in eff of
altruism um Argentina is trying yeah
start with
a you're telling me Argentina is trying
how long have they been trying for
right
bro
bro bro I haven't seen dumps like that
since I haven't seen dump like that
since the ftt
token
[Music]
by
e
[Music]
okay uh we're going to be having a mad
tasty with 20 milligrams of CBD this is
another company that doesn't sponsor me
um and Logitech we're going to be also
having an MX3 anywhere another company
that doesn't sponsor me I've bought two
of these mice now this is actually an
mx3s I know you guys love this shit
right it's just it's the perfect like
you don't need a big mouse okay stop
trying to compensate get a small mouse
Logitech MX I know you guys love this
shit you guys love this shit of course
we have the HH kb2 I don't know if the
build quality has slipped on these but
that's what always happens you know you
you get a product and the build quality
slips by the way buy a comma 3x build
quality is excellent I'll let that
happen um because there's no exit scam
there's no exit there is no exit okay
good
uh all
right
okay wow that is
um good thing I did not keep my money in
Argentinian Pesos that's just really I
was in Argentina like
then and whoa who that's that's a water
slide
man
um okay uh let's watch uh meditation
video we got we got to calm
down what why did that what's going
on was that like YouTube trying to mess
with my ad
blocker
welcome to the Daily
Comal let's start today's session by
finding a comfortable position with a
tall straight
back allow your arms to rest
gently when you're ready close your
eyes bring full attention to this very
moment
settling in and allowing the mind and
body to
still with
openness patience and
curiosity bring your awareness to the
breath taking a deep breath in and
releasing it
fully all of the breath as it flows in
and out of your
body okay we don't have 10 minutes we
don't have 10 minutes twom minute
meditation huh perfect now we're
talking so long since you've been at
peace
you used to know how to come
here as a
child it's a place in your
head focus on the water
it's a bit of an illness to keep wanting
more this spot isn't
glamorous it's what's all around when we
focus
this permanently
exists amidst the
noise don't be
afraid you'll always be
here waiting for you
when you need
it all
right so we're going to switch chat to
subscribers only
chat
oh yeah I did promise to show you that
we also do have bodies for sale uh you
can buy a comma body today uh I think if
you buy a body today it ships wheels too
but we haven't updated
anything the future of people some deag
some wow the old office so much has
changed okay now on to today's stream
tiny
has become
large tiny grad is now
4,855 lines but don't worry we have teig
grad teig grad is only 833 lines
sticking with the initial dream of tiny
grad being under a thousand lines and
Tiny grad and teeny grad share a lot of
code uh which is
nice um so so tiny grad is going to be
kept under 5,000 lines we needed the
other 4,000 lines to make things fast um
tiny grad is very fast
now
uh I think it jits by
default oh
loading is slow right now because
loading is in BF 16 and we're still not
doing math on real D types so it's a
little bit slow to load llama 2 llama
one loads fast because it's load
16 I'm actually G to put myself up
here go
so we're getting about 20 tokens per
second uh and remember this is the full
float
16 um I'll also show you something
interesting if we run with debug equals
2 so you see these batched things
here this is Metal's batch executor and
you can see we're getting over 300
gigabytes per second which is a limiting
factor for running llama when you're
doing batch size one inference on
Transformers your limiting factor is not
flops your limiting factor is gigabytes
per second but you see these are batched
we have the metal ICB and those are the
kind of things we're spending the lines
on it's got an indirect command
buffer
um uh so that's that's llama
uh like I said the
size is under 5,000 lines um and if it
ever goes above 5,000 lines I purchased
this this is the warning light for if
tiny grad goes above 5,000 lines it's
here in the tiny gr
office but right now we're under 5,000
lines so we shouldn't do too many more
tests of the warning
light uh so we are going to today update
teeny grad to use the latest
abstractions from Tiny
grad so I have a script called import
from Tiny grad oh so what is teeny grad
so teeny grad is just the front end of
uh of tiny grad you don't actually need
the backend uh you can write a very
simple back end so my very simple back
end in igrad is just
this um it supports just a few basic
operations uh nothing very
fast and you'll see we can train mest
and igrad on the CPU using
numpy uh and it does
train so we we'll see what we'll see
what accuracy we get with with
this um
[Music]
so it's running the
evaluation uh so igrad trains mest in
about 23 seconds to
95.7% and we have a new example script
in tiny grad called beautiful mnist I
think everyone should check it
out I need to fix
that so beautiful mnist and Tiny grad in
5 seconds gets to 98. 38 on mest which
is actually really good um and we you
can run this with debug equals 2 if
you'd like to see what it's
doing so again we're we're batching
everything up uh into metal icbs that
time we got
98.24%
this isn't that great actually that many
gig flops but we can add a beam
parameter I'm not sure if this is we're
going to have to do a search for it but
yeah so this is going to search for the
fastest kernels uh that use beam you can
see beam
is uh and this is all
cached what's it doing right
now this one must be
slow
oh yeah see that took a long
time oh this is the selector action
that's very
slow uh no this is an M3 um so it'll
take a little longer so right now we're
getting 1.4 Tera flops on that train uh
we're not limited by flops we should
have about 10x more flops we're not
limited by gigabytes which second so
we'll run it with beam equals 2 uh it
takes a while to do the initial search
but then once the initial search is done
done it should be pretty fast uh we can
let that run what did I want to show you
from over
here why is that so wow that's really
slow thank you glad you like my poster I
don't remember what I wanted to show you
from over there but we'll let that
search while we go back over here Smurfy
thank you for gifting
Subs um
so we have this script called import
from Tiny grad and as you can see it
Imports tensor mlops and the
optimizer so we're going to start with
some size. Pi we're at 833 now we're
going to import the three things from
Tiny grad and we're at 8.96 now oh no so
big uh tensor has grown 62 lines mlops
looks identical the optimizer has one
more line and let's see if it just still
works okay cannot import name Roundup
from helpers uh so we're going to have
to import round up let's open Tiny gr
another window
here um Round Up is just a little helper
that does rounding
up uh
oh oh we don't have run schedule
anymore okay I think that we can just I
don't think that actually does
anything there used to be a method here
called realize but now it's called run
schedule so let's create a new
file called realize. Pi so what what run
schedule does in proper tiny grad I can
show you the real version of it the real
version of it is it runs all the uh
it actually runs all the ests uh that
are in the schedule but teeny grad
unlike tiny grad is not
lazy so we can
just think does this even return
anything no it doesn't so I think we can
just
pass okay uh lazy buffer has no
attribute schedule so we're going to
also need an attribute called schedule
here and I think we can return n for it
because that's just going to be passed
into run schedule okay
uh this has no unrealized const so we're
going to need is unrealized
const uh we can change that to self self
return
false uh Tey grad doesn't support
these uh
oh uh
I think that in the real schedule so we
can look at the real schedule over here
in tiny grad I think this is going to be
a really short
stream uh so if you look at schedule
here scen is an optional Set uh which is
just the buffers that you've already
seen so it like virtually realizes them
you can't write equal set here
unfortunately because that will only
create that one set once
forever um I'm not sure there's a helper
to actually uh do that okay oh so in Co
realize we are adding the schedules
together so for schedule we're actually
going to have toal list make the types
match uh
okay what used to be
there how does d types not support from
NP
that is to get rid of images but it's
intenser Pi so we're going to have to
we're going to have to import the from
NP method um from NP is just if you have
a numpy type and you want to convert it
to its corresponding tiny grad type um
you can just import
NP that whole thing needs to be deleted
that other
helpers so where's the from NP method
and we'll have the D types dict Creator
down
here uh non type has no attribute to
CPU yeah so realized is a property that
shouldn't be none
um it should be
buff that's actually kind of
interesting should look at that line and
see if that's actually what we want what
did it used to
be interesting
um well that's interesting so what if
instead of Dot and P I mean we can just
do this it's extra lines but it's
fine one extra
line uh numpy ND object has no
oh uh that doesn't work anyway
okay so in the real thing this is called
raw CPU
buffer
yeah it no longer calls the 2 CPU
directly on
there so we can actually remove that too
because this is no longer a
method here we
go
okay uh was that the shortest stream
ever I think so we're
done that was all our work for today oh
it's slightly
faster okay let's see if we can refactor
this to be slightly closer to
reality
probably not it's actually not too
bad like it's we shouldn't yeah but that
that's
fine let's push this for
now update with the latest from
tin now we can go through what these
abstractions are and then think about
maybe we want to make some uh
interesting versions of it in
Te maybe we can make teeny grad lazy
maybe that's a good
move this is just the GPU yeah it's just
the GPU we probably could use the neural
engine but Apple's really locked it down
unfortunately uh so it's kind of hard to
use so this is all on the
GPU I'll leave you guys with uh hlpc for
oh beam finished oh there we go so you
see with beam we get uh 2.5 Tera flops
so we get almost just 2x speed up and
you see that for uh evaluation we're
getting almost six ter
flops so I will leave you with a cfar
training I should put tbug equals two
for
that we can put wo equals one it's a
little
faster
e
for
[Music]
so we don't use wo equals 1 by
default uh because it's slower to
compile
initially yes we're almost done with
this so this is a this is a full run of
of
cfar
uh yeah I'm pretty happy with that
actually wait that got
faster like 100 milliseconds per step is
is
good um again we can also use beam and
maybe even get up to a 2X speed up on it
too actually that's what I did last
stream I wrote Beam for you
guys all right let's
evaluate
oh it's got to compile all them winterr
kernels compiling winterr kernel is slow
because of how tiny grad handles conss
and shape trackers and stuff the kernels
themselves look good but they're slow to
generate um you guys are interested in
that problem I think this I think I have
a $500 Bounty for fixing
it here we go um so almost 94% bit over
Tiny Box is not going to protect you
against
shit um if you're buying a tiny box for
protection I suggest you purchase a gun
instead you know I don't like like like
with the common stuff too like I'm not
making any promises about what things do
oh my God I can tell you what things are
but what things do I mean this this
alone like like like if the world isn't
going to change on this you know you
know I was saying a nice thing about
comma is and comma and Tiny grad is by
not operating at like the petto edge of
capitalism uh we get flexibility to have
values if you're at the parto edge of of
capitalism your values are whatever the
market like says right and they have to
be this this is why you
see uh you know you see companies
embracing like like like Dei and
shit like it's not maybe people don't
share those values but they think that
if they don't do that they're going to
miss out and they may not have the
luxury of saying no right if you're
really at that absolute parto Edge uh so
you never want to operate at the parto
Edge um oh are we on sub mode only
that's a good point that's a good point
we're on subo what Jagger that's this
this is not a sub mode comment it took
me on a tangent you're responsible for
my actions that's right just kidding
you're never responsible for other
people's actions that's important to
realize all right you gifted a sub I
forgive you can always pay to be
forgiven it's easy it's called an
Indulgence all
right um okay cool
so we can go over what some of these
things
are
um these are e these are rs
now it becomes pretty I think becomes a
lot less clear I'm trying to think if
there's a way to rewrite this code to
not be
uh no not
really um the helpers in in tiny grad is
a lot more complex there's no way we're
going to share that anytime soon stupid
that we have to have that but it's
because we imported here right yeah we
do we import
it
uh see you see we return empty
schedules then go in here and don't do
anything yeah cool but so teeny grad
should have all the I know what we'll do
let's let's import some tests from Tiny
grad and see if we can get them running
in Tey
grad
uh
okay uh my favorite test in tiny grad is
test test off
doesn't really import anything it does
import
torch but it shouldn't import much
else rid of
that no such file or
directory
oh
for
wa why is desk. parent
that
oh that's what I meant to
say great now we have
test do you can you spot the uh the
vulnerability there's a
vulnerability that can copy anything
import from Tiny grad is insecure
boys
uh no module named
igrad okay cannot import name context
how does this use
context is used only in one of the
tests
is that even
right that's kind of a stupid test I'm
going to remove
it
yeah I don't know why this is this
should just be
zero okay all right all right all right
all right so teeny grad lacks cast I
think we're going to have to add type
support to
teig let's add some type support that's
good uh cash should be pretty
easy let's look at the real
cast We'll add the D types test too it's
pretty
good
okay oh we should also do mypie here and
it should
pass we'll add a mypie we'll do that
next
uh
return
Daisy buffer self. np.
astype T type.
NP if I just put that
there okay
test slice fancy indexing
fails
interesting I mean this is good because
like it makes us see where things are
flaky and Tiny
GR
Jagger you got to stop with the off
topic
shit you got to
stop oh did I do div
wrong oh does numpy not support
that
interesting okay numai is somehow
casting that up to
uh
let's first figure out what's wrong with
test reshape seems like a reasonable
enough
test cannot
reshape array of size
[Music]
four
s 432 well I couldn't reshape that
either which one of the reshapes is
failing
line oh this should
raise oh it's just a different
error
interesting can I put a tupple in
there for
or
that's interesting that
numpy maybe it shouldn't be an assertion
error maybe it should be a value
error okay now that's going to break
tiny Gra
but I have an idea that that's more of a
correct
yeah these shouldn't be assertions
anyway so like there's a problem where
we use assert to mean things that should
actually be uh
if
cool um I'm just going to add a
quick
what does this equals
mean why is there an equals
here oh to be a self-documenting
expression oh that's
cool I've seen this before but okay good
all right so we have a few changes to
tining grat out of this that's the
best now let's see what else is still
failing okay the div one is more
serious
um
yeah let just add some quick
documentation
here got a print there
for
uh
what 51 what no it's not
right
oh it's becoming a
interesting how do I deal with
that how do I deal with that in real
tiny grad that actually just kind of
seems like a
bug it's not doing in your
division
The Divide is being cast to a
mul yeah that's a bug
intenser we have to check to see if it
is a float before we do
that
uh so in div
here wait oh is the bug just in is float
it might just be in my is float here
that seems right so it shouldn't be
allowed to do that because I've already
done
this or not D types is
float
oh aha self. dtype is
wrong see you do one little thing
wrong so I have to
do D
types from
NP self. np. D
type there we
go
uh key error float
64 I hate float
64 who made float 64 it's the worst
float okay so that's fixed we probably
just have to add float 64 it's okay we
have it
here I'm also going to make this match
okay we need to support int
64 wait it looks like oh no there it
is my mic broke
broke
Mike is that
better it's only for a small period I
don't know what to tell
you uh do it 64 as
well okay still
broken how do I do is float
[Music]
here just literally a
list okay still
broken
look I have a Blue Yeti I don't know
what to tell you I can switch mics you
want the other
mic is that mic better it's probably
going to be
quieter you guys like that
mic uh I can probably increase the gain
on it
too
cleaner but
quieter yeah that better okay now we're
increasing the volume increasing the
volume okay you like that great I can
return my Yeti to where I stole it
from that's just the one built into the
Mac
so testing testing for loudness
sorry I hit the table it was still loud
sound transmits through stuff so well
okay
um all right we still have a bug
here are you kidding is the guy asking
this question kidding is this is this
funny is this a
joke um
print self. dtype
here actually I want to make a change
here to isolate the
test
now let's print self.
here oh I'm copying it in
oops D types
long okay so it's not a
float so it should be actually using div
now we can
check
okay we're actually using div now
unfortunately I think that this
one I
say in
64 they're both in 64s don't tell me
this doesn't have an N type
can numai not do this kind of division
float 64
great
uh yeah we're just going to have to cast
it
then all right I have a helper function
here output
type
for
actually I should be able this is
complex looking I should be able to say
I should be able to get rid of that do I
have a compare on D
types why do I not do I have a compare
on D types
here
uh check tiny
grad wow this is still a name
tupal that
sucks you know what we can just do this
differently
uh from data classes import data
class
uh data class Frozen equals
true
uh there's a data class you can order
equals
true then we can get rid of this and say
a
uh Min no no
Max it's kind of
nicer here we
go was that a change to Tiny
grad no but we should probably backport
that change to Tiny
gr let just put it to do that
there
move this from named Tuple to data class
data class is just a lot better than
name tupal uh you shouldn't use name
Tuple I didn't know that I was still
using
it um then I have that nice compare just
with order equals true uh dat class is
everything named to should be you can
use them pretty inting GPU equals 1 is
still open
c
good I'm glad the Mac microphone is good
enough for you
guys I mean I guess they're I don't know
I don't know how good the microphone is
I know how good the speakers are
so okay
uh not implemented load Ops
empty all right we're going to have to
implement
empty that doesn't sound
hard
oh I should really get the D type right
here wow we added type support that
simply great
oh well that looks like it fixed all of
them except this
one just probably something
stupid
uh
oops first let's isolate to the one test
we care
about oh I guess just the creation D
types was the problem with the others oh
good that was easy so we fix that for
free
um
AR doesn't have a shape we can just
print
ARG okay uh
interesting so what is this
test this just looks like an actual
bug I'm going to add that same I'm going
to add that check now lazy buffer CU
expand has to be the has to match in
size so this is Tiny grad this is teeny
grad
um
okay
let's fix this bug and Tiny gr
then uh
okay let's first see if the test is
legitimate or if the test is actually
just not right wow but I can't believe
that was
working
um
that's
traffic you guys really hear everything
now okay
uh
wait what am I supposed to do with
this how does repeat work in
torch repeats this tenture along the
specified
Dimensions oh does it just
implicitly is there an implicit
one
wow who can read
this
uh I
see
so if I just
[Music]
do uh
repeats equals repeats
plus uh base
shape uh length repeats
think that fixes
it oh and then is that a tuple or a
list base shapes of tall just do
that
setion error not raised
okay so which one should
assert we either get too many assertions
or too few assertions
x. repeat 2 comma
4 this should
assert
oh maybe it does assert it just doesn't
raise
a no okay so this is wrong we just need
to change that to Value ER it's the same
bug as
before
great oh cuz that's probably deeper in
movement op okay
yeah probably tested here deep in
views
yeah okay there shouldn't be an
assertion it's the same problem just
doing the wrong kind of
error
okay just got to get rid of all that
stupid printing wherever I put
it this dead
okay so I don't know why I spent time
doing that that's just wrong I was just
raising the wrong type of
exception well it's good you know that
that really is something we need to do
to get our to get our stuff to
1.0 uh we have to remove the Boer
assertions and start moving them to
proper
uh proper
things
okay I'm still printing
somewhere print
here F oh it's
here it's in teeny
[Music]
grad get rid of that
print okay great all the Ops test pass
uh let's add this to
CI
we'll figure out if we have a couple
other tests that we might want to import
from Tiny grad um but yeah so teeny grad
is
complete 911 or 911 uh it's complete
meaning it can do everything tiny gr can
do it's just not guaranteed to be
fast and by not guaranteed to be fast I
mean it's slow as
fuck
for
for
all
right I have the window open I have a
carbon uh dioxide detector you guys know
that like that's the thing that
terrifies me about global warming right
like are we just making the world stupid
now that the CO2 is
450 look we were not we did not evolve
for this sort of
environment let's see if my CI actually
passed why you guys can't see that oh CI
failed what oh I can't see
I can't see it without being logged in
what a
scam
oh who sees the
problem
yeah
yeah am not happy about
that first we'll train amness then we'll
install the stupid the dependency I
don't want to
install but we have
to
we'll see how bad it
is
did I spell that
right um all right let's see what other
tests are particularly nice from my tiny
grad is the D type test a total piece of
shit it's a total piece of shit never
mind we're importing
OSX oh we're importing OSX from
extra even more
bad
can in
helpers what uses
temp
wow
like this is not not even right it's
just not supported and
not
nice
turn wait
what what did this used to
be
Al so we want to know if it's supported
and not RX
and device default equals GP right
because it should still work for CPU on
OSX did GPU still works can now CPU test
that okay that's
good
um
it's good to have teeny graat because it
forces our things to be separate and
distinct did my CI
pass
no oh wait no cuz I'm still there still
doesn't pass uh wait train mest fails
now no that's offensive
did this ever
pass wait this fails with some 8
shit okay well we didn't retest mest
good we broke it
um
elers a finally curated selection of D
types only the finest D types belong in
teig grat no actually we're going to
bring them all is it
faster it might be faster with d
types do we have an assertion for the
accuracy in
here it
breaks okay 93 let's
go igrad we work right on master and we
don't have master in teig grad we have
Main and that means it can be low
quality cuz it's not not master
oh
what oh this is probably again the same
issue yeah this should not
raise we we need to not do these things
with it needs to raise value
errors
we have a pre-commit hook in in tiny
grad set imported but
unused how do I even make that
change where did I stop using
set
even change
view wait
what oh that changer shouldn't be in
there
yeah that's just
wrong some stale crap for my editor I
don't
know okay uh let's import one more
test wow this looks like trash someone
should do this
better
come I should clean this up this is too
many
lines
oh no we don't sport any of those never
mind um we could make it a knit I think
that'd be kind of
cool it's just this
so then we can
[Music]
do we should get we should stop using
the do tensor we don't need
that yeah a
n
um
all right maybe did CI pass
here it's a separate
thing okay it
passed great installing torch only takes
18 seconds training amness takes 43
seconds
Let's test D type
too cannot import name pointer D
type do I really need to support
those
oh it doesn't do
much we'll put it down there with image
D type
I don't know how much is going to fail
when I do
this okay we're going to need OSX in
here it's not particularly
offensive
okay we're going to need
half this is good we can see which D
types are actually being
tested half a good T type
anyway did I mean float 16 actually I
didn't I
float wow there's a lot of
lines lot of lines really racking up the
lines
now at all that
green in 16 does anyone even use that
crap you in 16 this is getting
ridiculous you don't understand where
the assembly gets compiled well it's in
there have we reached the end of the D
types
oh we got to support bit cast it's
probably
good probably good thing to support
anyway
uh okay
cast uh how do I do a bit cast in
umpai I'm going support this if we go
into op
CPU
yeah
all right we're going to need B float
16s as much as we do support
them copy and paste the same
note
we need is
in uh we can just copy and paste both
these Bool in the type info will refer
to D types spol I don't really
understand
that do not have Vector types
don't have is on signed we can copy and
paste that
too this should almost be its own
file it's kind of terrible that helpers
are
here should this go tensor do no tensor
is annoying to import and it's used a
lot lower D types might be its own
file
let's look at
this what are these ones that are
failing wow I don't know Max could take
in a
key it's
interesting
okay test un dat dtype test upcast
Ops D
type I didn't write this test so I don't
really know
it where does this get imported
from
here uh that's a lot of
Ops we almost need some debug support I
think we need some debug support in uh
in uh teeny
grad let's add some debug
support
it's having been struggling with
some
uh oh this is easy
actually just need to add I've actually
already added this in this version here
we just need to say dtype equals self.
np. dtype
right
how are things becoming
doubles where is pointer D
type
probably fine to just copy and
paste dtype is not
defined how does that work on
this
I need
that this doesn't
work
I think we should just change the tests
to uh if those are not supported we can
just skip
them
okay didn't change anything
there
I don't remember how many were failing
before oh maybe skipped one
up is it just not
working
n type is not
callable wait huh but I'm importing
it no I know but I'm importing it
right
none is this not the right unit test.
skip
test oh I have to raise
it there we
go we had 20
errors we still have 20
I don't
know okay well these are different
problems all
right why does
oh okay binary Ops
add
uh let's add the D types to the
logging actually let's add
some
okay why when we're adding a
long why does this become a
double
I'll add one Lan line
here that's
Universal what symbols
in
you know that would be nice if I used to
find replace it just sucks that I'm not
good at find repl hey chat GPT do what I
obviously want you to
do my co-pilot can co-pilot do things
like this probably not probably just
just crappy completions
e
come on where's my I thought you I
thought we had
AI this does not look like AI where's my
AI that took
forever uh no
Max
should be in there
okay great let make sure I didn't break
uh test
stops D type is not
iterable who's trying to
iterate
no you only have to respect AI That's
good and talented
you don't have to respect talentless AI
same thing's true about
people G type object is not
iterable what does that
mean oh there's nothing
there oh does as type make a copy let's
not be egregiously slow
here
it's
fine a Max got an un oh Max doesn't need
a dtype okay well only some needs a d
type and that makes
sense okay test Ops works and test dtop
works
great test Ops and D
types
wait did that just work that's
sick
all right
happy
932 um well if sources I'm not actually
exactly sure what that
does
like is that always true an if on an
array does what you think it
does I don't know I I trust that like
just be explicit
there see that's what I mean like
sometime it it goes deeper I think we
have some bugs like that in tiny
grad all right do we want to import any
other tests from Tiny
grad
you have an error
already what's failing a tiny
gr probably everything that raises we
shouldn't be raising assertion errors we
should be raising value
errors oh those aren't real failures
and that's not a real failure
either those aren't real
failures for various
reasons
those failures are just because it's
using the metal
icv um which I'm not sure what we want
to
do
for
for
by the way you guys if you don't follow
Martin scy on Twitter impr prisons
really made him hard like like he's just
got he's just got he's just got sick
Burns for so many
people
all right we got to finish this drink
first we're done with that this is just
water we don't want
that that spin drift's not this spin
drift isn't cold
anymore so we don't want
it
great now we're Consolidated we only
have one spin
drift okay uh let's look through the
test quickly see if there's any other
tests worth
copying yeah I would have made a great
opening I CE but you know it would have
been for you it wouldn't have been for
them it's for
them
test a
sign n that's
deep I don't think that's going to
work I was not planning to release the
weights I would not have done
that
we can test the
optimizers they should just
work should all just work I think let's
see if we want to do
that
okay well that just works so we'll leave
them there too that's pretty much all
the functionality of
igrad
wait what it's
broken
cannot open file
what I understand
that did I somehow commit it
twice oh then this must be somehow
changing the direction or
something oh did I just make a type
of test D
type
uh AMD does have tensor course they're
just AMD quality tensor course which
means they don't work as well as in
videos but they're
cheaper tiny gr even supports the amd1
of course you want to see the am 10 code
I can show
you um all right let's add a pull
request to Tiny grad make sure I didn't
break tiny grad with those
changes wait for that to run
CI all right we should probably fix
those tests cuz otherwise people are
going to bitch about
them uh why are this errors
what why is this supported on
metal it shouldn't be supported on
metal that fixes that now for the real
world
tests
uh
one error why is there an error oh
I there's stupid things called test if I
don't do that oh we got to add myp
support
here um see what's in this my
pie
okay we going have to fix those oh
exciting uh okay wait I thought I fixed
that
assert Colonels used
oh
already fixed this in symbolic
jet oh that's the real fix
actually
that to test jit and test real world to
and I'll apologize to the gods for
copying and
pasting no that's this is terrible um
for
e
sorry
okay let's look into what these are
uh incompatible return type here God
bull expected
in what wait was that the type from that
no it's like a typ guard thing it's just
the wrong
type uh all in here uses type guard yeah
okay so that's just not a toall that's a
bull
[Music]
uh
77 data. device equals
device
H
interesting
how come that doesn't
fail so that should become a lazy buffer
I think we want to refactor this in tiny
gr this is wrong
actually I don't understand how that
doesn't fail here though what we really
want to say
is uh if not is instance data lazy
buffer I don't know why those are
failing
what's up H
train uh import from Tiny gr my pie okay
only one error
now uh canonical
Li argument one to
canonicalize I think I have something
stupid for
device
canonic Lix return
CPO has incompatible type stir
none
shed
device
oh I show the wrong type
signature it's a line well it's
fine
missing positional argument device in
call to canonicalize
device
interesting so here this is a static
method
okay
if
decode the btes I think we just want to
do
that I don't understand I don't
understand why these aren't being type
checked
here
for
uh lazy buffer has no attribute copy to
device that's
fine we just need to add a fake method
called uh copy to device we need to
match the type
signature because there aren't actually
devices so I can just return
self
lazy buffer has no attribute base lazy
buffer has no attribute
St figure out what's accessing
them
h
for
can it see that is unrealized const
always returns false so this is short
circuited it never actually gets
there
just going to bitch and say St doesn't
have
contiguous okay none has no attribute op
none has no attribute continuous that
sucks interesting okay we should really
move this then as a function
to in
here
it shouldn't be accessing these
methods we're leaking our
abstractions
base is still a problem
here but base is okay because I can just
set base equal to
itself actually I got to be careful here
because
oh for some reason the whisper tests
fail on metal and I'm like kind of
interested in why but uh you saw that
failure that failure's like been there
forever I don't really get it
um
for
I was just looking at the PO Quest and
Tiny gr sorry I got
sniped um
let's add my P to
CI
going add some pre-commit hooks
too let throw some preit hooks in
here
for
it's not
right
n
okay keny Grant has pre-commit hooks
this is becoming a quite legitimate
Library um
yeah so the only difference is speed all
the functionality is
supported I mean like the symbolic stuff
isn't and the jit isn't but we could
probably make some simple mock versions
of those that don't
work
uh yeah we could do that if you
want I don't know that'll be a project
for another day
but yeah no I I feel good uh Tey grad is
uh is
improved
um let's just get these changes merged
into tiny
grad and they're already pushed a teeny
grad because teeny
oh wait oh did I break something I see
I'm not even running
now oh I broke
something
uh what did I
break what do I need two spaces there do
I have an inadequate amount of spaces is
don't not a linter for
this fucking
yaml
tests is kind of a lot I think it would
be cool if we actually broke out the
three tests in the free commit hooks
what do you
think
these don't count as lines don't judge
me someone know how to do this that's
not so much copy
paste now you don't need pie test
either
okay kind of
[Applause]
beautiful see if the tests ran again and
that was actually the
problem no still isn't
running why not how do I debug
this what broke it adding optim test
our slash is not
allowed
I'm gonna pull out chaty VT if that
didn't fix
it I don't understand what
broke do chat V2 off screen I don't know
how to do it on screen is there a free
chat
VT
free chat GPT no sign up I would ask
chat GPT
here that's wrong try harder
wow this thing sucks why am I getting
crappy
GPT is this gpt3 is this the quality you
should expect from
gpt3
oh pluses aren't allowed either
stupid chat
GPT that'll make it a bit faster too and
waste more of github's resources thank
you GitHub thank you saan Nadella saan
Nadella now that guy's a winner that guy
is he's a winner he's a winner and I
appreciate him and I was hoping that Sam
will go work for Microsoft and see what
a winner looks like not
not 2015 Silicon Valley hype
culture no no no we're ripping on Sam
Alman too much he's a medium guy right
there's there's bad people good people
and medium people all right medium
medium
like like like what everyone orders at
the coffee shop you
know two
CIS wow wait teeny grat is becoming too
big teig grat has pre-commit hooks teeny
grat has this is this is the same scope
creep as Tiny
grad we need to delete wow this talk AI
sucks sorry talk
AI I was talking to Tiny
llama wait it's still not
running yaml
lint yeah thanks Ruby on
Rails
um I don't know
it's a lot of Stars written in Python
pip install yamaland
Perfect
none of those are errors yeah my L
sucks what's the
problem
okay let's figure out what I did to
break
it add optim test
oh
oops GPT couldn't fix it well I guess
it's not the yaml fault so we don't
blame the yaml lter yaml lint might be a
fine
project it might not be yamama Lin's
fault okay we can't just go around
blaming other people for our problems
okay that's how we got into this mess in
the first
place ain't no such thing as
halfway
steps
great does it run now did I fix
it all
right I'd show it to you but we can't
because we're not logged into GitHub and
for some reason fetching the things come
on Saia fix
it
for
for
T did it did it finish oh come
[Music]
on all right what did I
do oh get code size requires
tabulate that's a secret hidden
dependency oh test optim Imports pie
test that just probably shouldn't
happen P test Mark exclude
Cuda how do I feel about
that
yeah all
right
I'm really I'm using
tabulate
what do you mean it runs GitHub actions
locally in what
environment it's a lot of we should try
this all right well it has a lot of
stars so it's got to be good that
means
[Music]
act I need
Docker I hate Docker Docker is ADS now
you know you know what at ads I bought a
crypto wallet and it had ads and I was
offended all
right you think this thing is going to
work all right
sweet nice the tests are still faster
than
uh job
failed
the version 311 with architecture arm 64
was not
found interesting
okay
probably
but I checked and it was in the
list
oh architecture arm
and it left the containers
running yeah there's a buy button yeah
does it go anywhere can you actually buy
a 10 stor card or does it go to a
fucking uh I I tried the buy button and
like no like this is this
is
no this is not a buy
button don't ask me for that
shit that's
offensive Darwin not equal to
Linux why does it think it's on
Linux
this do not
work yeah this doesn't
work there's no arm 64 support for Linux
well I am can I disable the
docker but if I disable the docker what
am I even doing
thing
see the
problem this isn't really at
fault how fast is set up python
normally it's so
fast
h
I don't think that's going to fix
anything
oh interesting no this is going to
work it's going to use Rosetta
that's cool which that's awesome if this
works that's
amazing got all those disgusting
dependencies
sweet
I love this thing Act is
sick thank you Smurfy this is why you're
a VIP in the channel That was
amazing uh all right let's merge from
teeny into tiny
grad yeah yeah no well it's just they
don't have a it's fine they don't have
an arm 64 Linux python so I just set the
architecture of the container and it's
actually cool that Docker can run
that
um wow the computer just so
good I just I just love how good
computers
are all right we now have two
tests um if you're logged into GitHub
you can
see
uh the size of the
thing 937
lines I mean you know I'm just going to
use that in general actually can we use
act on
uh I don't know what it's going to do if
we run it
on I don't expect this to just
work see this in
parallel virtualization
framework let's
see wait Act is so
good
see now that's who you got to appreciate
in the world whoever maintains that
right because someday we're all going to
have to move up GitHub once Saia is gone
and Microsoft becomes
evil once Sundar pasai takes over at
Microsoft H all right
guys we let everyone chat
we'll make me a little bigger wait while
that
runs if it doesn't finish it doesn't
finish I don't
care um whoa does cash work though
that's crazy fuck Microsoft and the CIA
all
right you love watching me program well
thank you you should
subscribe uh what cool websites do I
read every day uh have you been to
tubgirl.com
search for tub girl you'll get
it do I still use drugs bro you know
what there's a South Park line about
drugs there's a time and a place for
drugs and it's called cop
College how old am I how do you think I
am oh lemon
party ask your friends if they want to
play soggy
muffin I'm 23 exactly that's
right your
boy
um how are the tiny box is looking
pretty nice uh we have
some no F director
clang oh that's
interesting wow my computer's burning
hard
wow going be interesting to see what
fails uh what did I want to show you oh
yeah
welcome to Tiny
n wow that's actually getting pretty
good I should have put which Epoch it is
that would have been smart um so this is
a uh unfortunately it's only oh you
can't see
anything uh unfortunately it's only
using one GPU but this is Tiny
n uh tiny
n has six
gpus uh right now it's training imag net
we can actually see how that's
going uh if I open Discord which stream
screen is it going to go
on I'll just turn that off for a minute
while we open Discord over
here I should just click and go over
here because I have so many monitors oh
people have been adding me in the tiny
gr Channel what's a
purple uh streamer mode has been enabled
yeah this is fine I can show you guys
Discord
um
so what's a purple okay look look some
people are better than other people okay
uh these are Reds they have solved
bounties these are oranges they have
jobs at tiny
Corp okay I'm not the only orange we
have one other orange who has a job
these are purples purples have
contributed something right so you can
see it in welcome here greens are plebs
Blues have contributed something in some
way or purples are GitHub contributors
Reds are Bounty claimers and oranges are
tiny Corp employees okay so this is how
you move up in the tiny uh why am I in
Sky Bri's Discord I love Sky Bri Sky Bri
should come on my stream I don't know I
was into Sky Bri briefly and then I was
into bronwin Aurora briefly I never
bought their only fans don't worry boys
um where do you find the
Discord I wonder if Sky Bri and I would
actually get
along what about my dream of helping
American Truckers trust me if if you
said your dream and
helping
um I don't know I haven't been keeping
up in the sky Bri
Discord you see I have 70 on
R
uh oh I should have taken it from Brave
New World no but really like greens
always come in and ask the dumbest
questions right like
this they contribute useless things like
this this guy wants to build his own llm
and he's a green he's not building his
own llm is there a more in-depth
description of these bounties you see
what I mean greens they ask stupid
questions right now look at how Reds
talk
see look at how Reds
talk look green asked dumb
questions can it run on CPU see and then
they repost dumb
questions right you can just like like
look just been a paper like no no it's
really easy to spot the greens okay oh
yeah so this is a tiny box uh it's very
busy training oh yeah I forgot what I
was going to show you now I
remember
um so these workers are all
crashing wondering which
one oh open pilot cell
tests this is the line count of tiny
grad uh
interesting oh yeah I remember what I
wanted to show you
this
I don't know why it got why did it start
to
truncate just does it just do this after
a
while does anyone know this about wandy
B does it just do
this
I probably have to subscribe to wandy B
don't
I saving
epox
press F5 I don't have an
F5 can you see the Tiny Box you can't
see the Tiny
Box
um either way you can see lost going
down why
it like around a magic number I guess
not yeah close
Discord I'm going to control C this why
did all these things fail
I have to do like one at a time but
that'll be fun actually it might just be
ooming I don't know about
that still makes not sense why it's down
sampling
yeah
yeah it's probably like this kind of
crap
probably shouldn't log every
step pick a logging frequency
that's
yeah oh commit equals false what does
this
do no it looks like some form of rate
limiting which is fine clearly I didn't
read the uh the
manual yeah 100,000 scalers
save the metrics deck if
false and the metrics won't be
saved oh okay I
see
all right all right all right this is a
sky Bri simp Channel no insulting Sky
Bri on my channel okay this is a skyb
simp
Channel um Tiny Box is not the size of a
Mac
Mini and we
don't uh have a tiny box ready to show
you guys
yet but
yeah
close that close that close
that we can play with that more
later we'll run teeny grat
again
I don't know I haven't found herbit that
I hav found that herbit does
anything
oh wa I just realized something about
tiny
grad things run as the root
user
interesting I think I know how to fix a
bug
then you with the F5s bro this probably
guy probably he deleting his system 32
right
now all right wow OB s is version 30
that's pretty cool someday tiny gr is
going to be version
30 all right does anyone have anything
good questions or that's just it
uh oh yeah if you want to come be a tiny
grad intern this path is possible to
you uh you have to have Mad
Skills uh and contribute tiny grad and
then you can be an
intern um you can also be a comma intern
Comm is also hiring
interns
uh Comm
made we made a breakthrough last week on
um before qar before we knew about
qar uh so I think we have something
that's going to make the models a lot
better how does it feel to have bet on
AI so early in my life uh what what did
what did you seen MTB say the more I
look the more I realize George Hots is
right about everything well what can I
say
um no I don't know you know who got me
into AI
right is there good pizza in San Diego
yeah pizza here is pretty good pizza
here is pretty good but there's no good
bagels
unfortunately
um no you see I don't I I manage my
board okay I'm friends with my board I
talk to them frequently I don't I don't
withhold information from my board okay
and that's why they're not going to OU
me man because I don't withhold or
whatever he did man he gave two people
the same project I heard he also spoke
differently about somebody to two people
or
something it was uh yes it was eler
owski who got me into
AI so you got to respect man elazer
owski has done more for the cause of
acceleration um and a whole lot of
people it's not candid I'm always candid
got got to keep it
candid uh do you have to be some genius
to work at my companies no like what do
you mean by
genius see s Channel
now
no I mean realistically okay I we can
ask the question like what the minimum
IQ is of the bounty contributors what
the minimum IQ is of the Comm
employees again what do you consider
genius I'm sure it's way lower than
um
it's probably above
uh the average physics major has an IQ
of
132 the base might be
130 uh of at least of the software
Engineers um no but like yeah so
well if you don't have a triple digit
IQ
uh has Silicon Valley always been this
weird yeah I don't know why people
really take him
seriously um now here let's see uh let's
just Google average IQ of physics
major yeah average around
sorry it's small I didn't make it
small yeah physics is at the top social
works at the
bottom um physics math
philosophy
various forms of
engineering wow yeah no um if the if the
average IQ of a comsi major is uh is
124 uh yeah it's
uh always guess you're the mean that's
that's
actually
um no like like honestly
people in here if you know what's your
IQ all right the F5 guy is
102 I believe the F5 guy is
um okay so just but no I mean people
people saying things in the range of
uh of of of 125 to uh to to 140 yeah I
mean that's smart
enough and it's not it's not your IQ
holding you back at that
point no I mean yeah like you you do
have to have some you so I took an IQ
test on a stream I forget what I
got uh I mean the average probably is
uh but again the people who are in this
stream if you join my stream your IQ is
higher right now which way does that
causal Arrow
go um yeah look if your IQ is like above
120 you your problem is no longer your
IQ
um how much physics knowledge is
important yeah well then you have to
have coded for a couple th000
hours don't no I mean I've
seen there's things that transfer well
to
coding
like if you're good at math and physics
you probably just transfer well enough
to coding even if you don't have a ton
of coding experience I
think I'm not sure about that but then
again like how do you go through math
and physics without having
like especially today like how do you
just not have exposure to
uh to
programming it's not a pseudoscientific
Swindle it's correlated with a lot of
things it's not entirely determinative
but uh it measures something right there
is a concept of intelligence of
course um but yeah so like again no do
you have to be a genius no no but you
have to
like are tiny grad and comma uh the
interview process selects for two things
intelligence and motivation uh I would
guess that most people in this channel
have more of a problem with motivation
than they do with
intelligence
uh motivation is not if you call
motivation EQ whatever but there
definitely is Big variance in people's
motivations you know it's unclear like
you know people also have this idea that
like IQ is something you can't change
and motivation is I'm not entirely sure
that's
true like it seems like your motivation
is also pretty unrelated to like pretty
pretty like you know growth mindset
doesn't really work uh now I think what
you can change is what you value and
this might be the most like usable stuff
like it turns out a lot of growth
mindset stuff is just bullshit but
something you can
change I
think is and this is why I try to preach
this stuff right I'm not trying to
preach and get smarter I'm not trying to
pre get more motivated your motivation
your intelligence I think are mostly
fixed uh but what's not fixed is where
you apply yourself and what you believe
in right there's a lot of smart people
who are swindled by a lot of both smart
motivated people who are swindled by
incredibly stupid ideologies like effect
of altruism okay this is something you
can change this is something you can
spend some time thinking about and I
think you maybe just haven't heard the
arguments against these things right um
a lot of people also are irrationally
afraid um of what other people think of
them and this one I don't know like this
one I don't know maybe maybe just like I
never really like experienced it but
like the kind of people who crave the
social approval of
others uh this is my
belief the biggest thing that somebody
can change about themselves and I'm
curious about the actual data on this
but when you stop saying that like like
stop looking at things that what you're
told the things are and start looking at
things for what they actually
are um like a lot of people are told a
lot of things are like when you look at
Cru and comma right like it's
interesting it's interesting right if if
if you if you're buying into almost this
like mainstream narrative right um
another thing that can change for people
is sort of your
like um all right hopefully it's been
long
enough uh I didn't get the covid vaccine
uh you know I didn't I didn't want to
talk about that before when it was
politically controversial I don't think
it's politically controversial at all
because I don't really have a
politically controversial thought on it
right um I'm not an antivaxer uh I think
that vaccines are mostly great um I am
skeptical of medical products that
haven't been on the market for five
years
this is how I view drugs this is how I
view research chemicals this is also how
I view vaccines um so the risk of the
unknown versus the you know quantifiable
risk of getting a disease well um you
know I I I decided not to take it right
now the the thing is are you in a
position in your life where you felt
like you could honestly make that
decision right are you in a position in
your life where you could have honestly
decided yes I want the covid vaccine or
no I don't want the covid vaccine right
um if if if you're surrounded by you
know like hyper woke yeah you're going
to have to get it if you're surrounded
by conspiracy theorists how could you
possibly get that you're you're polluted
now you probably can't get it right but
that is what you can control you can
control whether the PE you can control
kind of like whether you are subscribed
to an ideology or
not um you had to get it for college you
didn't you didn't have to get it for
college right I mean I had a vaccine
card come and arrest me please come and
arrest me um please come and arrest me
for taking a piece of paper that said
CDC uh
right so I don't know yeah maybe I think
I think Europe actually had like
terrifying actual asymmetric
cryptography to verify this thing the US
had a piece of paper that said CDC on
it
um
you can see my OBS okay is it leaking
something uh but yeah no like so so
that's again something you can control
I'm not sure you can control your
intelligence I'm not sure you can
control your motivation but I think you
can control who you work
for um and stop working for the man like
stop working for the man and stop
fearing the loss of social approval or
the risk right like like if you are a
motivated 130 IQ
person let me tell you something man
there's not much that can actually hurt
you again the things that might actually
sure maybe you could get caught up with
like you know addiction or something
like that but in terms of like the
actual struggles of Life they just don't
apply to you they just don't all right
the things that most people struggle
with and remember capitalism keeps most
people there
um what I'm describing with respect to
social movements is more or less
fixed I think like your Big Five
personality traits are fixed that's
probably
true uh well no the time on no the sheer
number of people have taken it is not
enough to say it's safe right like you
don't know if there's some effect that
everybody has one or two years down the
line right I also questioned a lot of
the I thought that a lot of the science
around it was politicized I thought that
if there was something wrong they and
not that there really was look it turned
out to be a pretty indifferent thing but
like is it really not fixed whether you
think for yourself maybe it's not maybe
we're all just maybe we're all just
slaves to our
genetics uh there an ideal line where
they talk about like you know someday we
can rewrite our genetic code and break
free um you know Les Ron explored a lot
of these ideas and
uh every time I take a break I talk
about politics I'm not talking about
politics am I I'm talking about what you
can actually change I'm trying to
actually give you if there's any such
thing as useful
advice I don't know maybe you can't
right you can't really change your
intelligence that one is well
understood uh I'm not sure how much you
can change your motivation but let's
again assume you can't but you can
change what you choose to focus on and
why you choose to focus on it and if
you're telling me you can't change that
then you really just can't change
shit drugs are probably not going to
give you more
motivation intelligence can
decrease I mean yeah like traumatic
brain injury sure but otherwise you're
rooting for f guy F5 guy um I don't know
all right let's talk about it let's talk
about it how many of you have felt that
you've changed anything because you
watch this
channel what do you think you've
changed
good you've changed your life philosophy
right I I think this is actually very
changeable stop respecting idiots man
that's a choice you can make that
choice Focus Less on Cosmetics perfect
yeah look at what things actually are
not what people tell you they
are good you question things more often
great TR yourself with people smarter
than you that's like generic advice you
think you've gotten more radical do you
think I'm radical I actually think of
myself as a very moderate
person um you got more liberal good good
I try to be in the middle I want to make
conservatives more liberal and I want to
make liberals more conservative
you change your
VC
um yeah well it's not that you totally
shouldn't care about other people's
opinions you should ask yourself why you
care right sometimes you know using
other people's opinions is a
fine I don't know it's a fine like proxy
but like again does it come from a place
of I like their opinions because they're
usually right or I like their opinions
because of some other
reason um everyone thinks they're
moderate yet everyone thinks they're
better than average driver no I mean I
don't know I think I it was on Twitter
yesterday like if you don't have one low
status belief you're not really a freeth
thinker yeah I mean I think that's
true um have I convinced anybody to quit
their their their Fang
job well if your intelligence doesn't
matter how many gpus you can buy Sam
Alman already has all the gpus so uh
good good you actually quit VC funded
SAS that's great that's
great um you quit your job as a
university lecturer why would you do
that I don't know is it was a university
imposing like imposing wokeness shit
or
um did it actually motivate you to live
in your van living in a van is cool like
again it's one of those things that's
Young when you're young live in a van
and do drugs and then when you're in
your 30s if you still live in a van and
do drugs something went
wrong uh because they stopped allowing
you do research and you got a better
offer see that's not something you
changed because of this
channel
um you currently work five hours a week
you do basically nothing and get paid
see that's what I mean like stop being
comfortable stop
it like they're going to they're going
to lull you to death you
know it gives you money dude oh my like
that's that's the like how do you not
see it how do you not see that money is
just made up by a bunch of
goons why do you care about it you're
getting goon
coin look if my girlfriend's on LinkedIn
it's not it's not good it doesn't work
it doesn't work boys goon
coin dude dude just just imagine you
worked your whole life just imagine you
worked your whole life for Argentinian
goon coin and then it went like that
okay I just I
just like that's how fake the money
is but but you you you I need money to
live okay okay okay okay wait t- bossies
let's go let's go how much money do you
need to
live MC if's still alive man he's on a
boat you need Millions to live you need
2K a month to live
okay 700 a month
sick wait you guys are talking like you
understand you can easily make that like
on Tiny gr bounties well you can make
way more but like you you can make I
mean if you work really hard you can
make 2K a week on Tiny gr bounties if
you work on it
full-time um 2K a month but I imagine I
imagine a lot of you guys saying 2K a
month aren't in America I think you need
more than 2K a month to live in most
places in
America
um but you people saying 200k like what
the fuck are you spending money on man
man it's like you ever see that joke
about the budget where it's like money
spent on groceries $50 money spent on
gas $30 money spent on scented candles
$800 you need 6K a month you don't need
6K a
month I mean that's still not even that
much
money you need your SED candles exactly
EX
exactly
um I own a Rolls-Royce all right it's
don't don't buy
rollsroyce how much do I actually spend
I don't know I don't pay that much
attention but like not much because I
don't really do anything and I don't
support
anybody
um
I I what I'm saying is
like yeah okay all right all right all
the guy with money is telling you not to
worry about money well I mean yeah but
like how do you think I got money right
if I got money if I and and let me I I
hate hypocrisy right like there's two
types of people in the world assholes
and hypocrites and I'm an asshole I'm
not a hypocrite um if I got money by
working for Fang and saving it for seven
years and then told you all not to worry
about money then I'd be a hypocrite
right realistically how did I get money
I mean like how did I get
money being early in
crypto
um doing contract work for people with
programming skills that I
developed yeah pretty much those two
things
uh well I'm really thinking about you I
lost money on cheap I lost $5,000 on
cheap
um the Apple thing I made some money off
donations I made money off donations for
jailbreaks uh yeah I got VC backing but
I didn't get that personally commas paid
me very little I don't uh right now I
don't take any salary from Comm I don't
take any salary from Tiny
Corp um I mean I made money in the stock
market but that's kind of just a
question of having
money uh how did I afford the
Rolls-Royce that was a contract I did a
I did development contract for optimism
it's public you can here let see it
wrot this is this is this is how I got
my Rolls-Royce
money writing this
uh did I go heavy I made good money on
Nvidia yeah I sold too early but I made
money on Tesla you know just investing
in what I believe in super micro was a
winfall again sold way too
early
um my Twitter Adventure Twitter did end
up paying me Twitter after I left ended
up uh ended up sending me a check for
the 2K a week I asked
for uh so so you know they're good
people they didn't stiff me uh you know
it's just it's is hard
to uh no I lost money on meta don't talk
to me about
meta did I see Starship launch yeah
dude unbelievable really
unbelievable I'm so I'm so happy that we
have
that oh Proto you're
here
great
good I'm glad this is continuing
actually at first when I saw that it was
uh that it was archived I'm like oh no
oh no Canon's
over um wait I bought so much super
micro stock when the story was published
oh I hope have cuz I made I made like
200k off
that
um well optimism get
hacked
uh read my read my read my thing don't
use the software I was not paid nearly
enough to do security audits on the
software um but I mean in theory it
works uh yeah so I mean this was the
most recent thing that I made uh some
good money on doing this
contract um but like again you guys are
talking about the amount of money you
need it's well within the if you 2K a
month you can easily make that with tiny
gra
bounties um you should be able to make
2K a week if you work really
hard and again I pay the same salary I
pay the same bounties regardless of
whether you're uh you know in in in
America or or in or in the cheapest to
live
country um thoughts on hugging fist I
like hugging fist what would I do if I
came into billions I would donate it to
effective altruism psych no I don't know
uh what would I do if I came into
billions
uh you were just super genius who hops
on projects and mixed bank but again
like how did I get that
way right I got that way by doing
contracts for way less money
right
um I'm very happy that Canon's
continuing
uh if you live in Nebraska for cheap how
would you find nice chicks I'm sure
there's pretty girls in Nebraska
man uh what's
KSA oh Saudi Arabia uh I went to uh I
went to Dubai uh last year it was very
nice
you'll move to Hawaii no I live in San
Diego this is like the nicest place in
the
world
uh what kind of contract work I did
early on uh cell phone
unlocks um a bunch of lowend cell phones
some of the first contracts I
did um but I also made decent money off
donations from the
jailbreaks
uh
I did go to Bangalore CA taxes are
insane the way to not pay taxes is not
to make any
money um I did bu yeah I bought a r
Rolls-Royce my can of
money
uh do you genuinely believe that any
person can be as good of a problem
solver as you if they work hard enough
no no of course not that's absurd uh um
but I do believe that most people
apply like again you're not going to be
able to change those things about
yourself but you can change what you
work on and how you contribute right you
can change how you structurally approach
things and I really believe you can
change
this like this is definitely not in your
DNA I clearly it's not in your
DNA
oh yeah pwn to own I mean that's just
public that I made money off that
shit
yeah I mean like this is actually most
of the money I made in my life this and
a bunch of other contracts and then I
put in a bank account and then I like
live off the interest cuz I don't really
spend money on
much um Rolls-Royce again you're only
spending on depreciation you're
not
um but see I never did any of this stuff
for money right I never like thought
about anyone who thinks about anyone who
like is worried about their like total
comp like that's
such like that's such you're you're
never going to be
rich
uh how I someone who has difficulty
focusing on a particular thing I'm
thinking I just need to cut back the
video games okay so like the thing about
motivation is I don't really think you
get that much I don't really think you
can have that much control about where
you apply it either right if you find
yourself drawn to video games like play
video games but be smart about right um
if you find yourself drawn to like
you're not going to be able to work on
something that you hate that's just
never going to happen right um one of
the stupidest things I've ever heard
stupidest pieces of advice is find your
passion uh this is dumb this is not how
it works like like nobody like goes on a
search for their passion and then finds
it everyone I know who's actually quote
unquote passionate about something has
been obsessed with it ever since they
were
little
um and a little I make a little off
twitch I make a little off twitch I
appreciate you guys you know
uh I think I make about I make about
like 15 grand a year on
Twitch um would I be able to afford an
h100 cluster I'm not that rich guys like
I'm not again like okay the secret to
being rich is not making a lot of money
right Johnny Depp had a lot of money and
he's broke his shit right the secret to
being rich is making more money than
your
lifestyle it's probably easier to
decrease your lifestyle figure out what
you're spending money on and stop
spending money on
it you're not taking my advice I'm poor
okay that's fair that's
fair
um all my life I'm waiting until I make
a certain amount the fuck man you know
what you know what fucked me up I did
make some money when I was young and I
got to a certain amount and then I was
like wait that was so
dumb that was so dumb what I have never
even spent that much money in my life
you know don't live in a van living in a
Van's expensive see this what that's the
it's expensive to be poor
right the more money you make the more
you upgrade your lifestyle see that is
where you're falling for the
scam your savings will be worthless when
they enforce digital Fiat money yeah
probably yeah yeah no the peak of the
curve is is is is I think it's not even
the peak of the curve I think there's a
fixed amount it does depend on where you
live but there's a fixed amount of money
that you will not be happier if you make
more than
that lower liabilities instead of
raising revenue exactly right I mean
look at my companies the same
shit um do I believe kim.com when he
talks about us economic collapse well
Argentina's economy can collapse us is
the reserve currency for still many
countries we have a long way to
fall do I need a material scientist for
what my my my my crappy ABS plastic it's
good ABS plastic it's good we got we got
high temp spec plastic regardless of
your wealth the burger tastes the same
that's right richest men in the world
are drinking diet Diet Coke you
know uh I tried to make myself like Diet
Coke you know like like KAC drink said
you know you got you got to like get
into Diet Coke but no yeah couldn't do
it I don't like
it 6K you're happy
exactly I don't know anything about
Argentina's new
president uh shouldn't you make as much
money as possible and consume because
the purpose of the universe is
increasing entropy like Tony Montana you
know what happens to him at the end of
that movie right right
um all
right
uh biggest regret in my
life
um
I always regret not
hodling uh no I don't regret the Twitter
internship at all I do not regret the
Twitter internship one bit uh even
though it was short I had a great
experience I hope Elon doesn't regret
offering it to me
um you know it was
just
like the Elon monarchy is not perfect
and you have to accept that I do still
believe it's preferable to the current
oligarchy but the Elon monarchy is not
perfect it's not everything you would
want but it's probably still better than
the alternative because they launch
Starship and when does the last time
NASA launch something you
know um I did get paid for TN internship
I did not that much but uh I I paid 2K a
week like I think that's a respectable
by the way 2K a week is the intern
salary for tiny cor um interns here are
getting paid 2K a week
uh we have one intern now we have two
interns starting in uh January and we
have an intern starting in
May what about the George monarchy well
you
know you can't find your passion later
in life you're just fuck
bro 2K a week is is you can live
comfortably on 2K a week I I spend under
2K a
week uh considerably under 2K a week and
my rent's 2K a
month
uh I don't know I guess half my money
really does go to tax so like 4K what do
I spend I mean I buy food I probably
spend like 50 bucks a day on
food and then yeah I'll buy buy some
like stupid I'll probably spend like 500
on consumer electronics that's kind of
it I guess I buy plane tickets too
sometimes gu SP I gu spend some money on
travel um no but I don't pay actually
half of it in taxes I get some of it
back I probably spend like 5K a
month $50 a day is actually way more
than I spend on food that's that's a
real overestimate um most of the time I
eat a Comm
I've never met I'd like to
though there's tiny grad higher right
now well yeah but if you haven't solved
a bounty I'm not going to hire you
right uh in ml it's really important
that the train set and the test set are
the same uh so you know the test sets
after you get hired the training set is
uh doing the bounties
right you're extrovertedness is probably
I don't know genetic Early
Childhood am I streaming now cuz comm's
Black Friday sale flopped comm's Black
Friday sale is the best of all
time uh we're doing this is this is the
best Black Friday to date in terms of
money we're selling way more
devices uh have I worked with that rock
CHP yeah yeah it's actually pretty DEC
it's pretty decent chip there tiny Corp
renamed
no
[Music]
um Well's the most efficient way to get
exceptional at coding if you're
constrained on time a
montage how about installing a nonprofit
board full of women I'll pass on that
one
do I think crypto is going to come back
crypto is Their Own Worst Enemy man
there's too much money in the
space uh did I try Gro no I don't have
access I gota what I Gotta Buy I already
buy blue check mark Twitter I got to buy
like super check mark Twitter it's too
complicated what's the secret to life
that not that many people know about how
to not at life quit bitching about the
bitches Edition Google it we'll leave
you there thank you all for watching
Happy Thanksgiving Happy Black Friday
make sure to buy and spend within your
means only buy something if it will
genuinely make you happy don't buy an
iPad you know how many times I've bought
an iPad I'm like I'm going to use this
iPad and then you don't come on everyone
has that experience you could be honest
with yourself you could be honest with
me in a minute thank you all for
watching Happy Thanksgiving goodbye
everybody
all right where's me
what's wrong with this
there we go that was me big
let's make me small
good morning good morning hang on
let me mute the echo done let me pick
the microphone up so we have good
quality microphone
um
it's Wednesday at the tiny Corp
I know that was loud I always turn my
light on we have we have proper lighting
now
we're gonna
make this a little more uh
no I don't want any of these weird
colors
okay I'm playing with the light
oh you can't see that at all whether I
don't have a grange on this thing's
terrible ah there we go that's what I'm
looking for
yeah yeah it's good that's good we want
to be a little warm
it's tiny Corp Wednesday hello
good morning good morning good morning
okay
um well that light is bright how is
anyone supposed to function in this kind
of bright light let's turn it down a
little bit
[Music]
uh
okay
uh so what are we doing today
well I have some good news
uh
the new
uh Italian grad is now in open pilot
um
so we switched from the opencl back end
which is now deleted we switched the GPU
backend and the GPU backend is nice
because it can be used everywhere
um
when I ran the test here to confirm the
model is good so this just checks
compared to we have like a back end
Runner that we use we call it the
pipeline
um
so the uh
the blue comes from the pipeline the red
comes from my run of the model you just
kind of make sure they look the same
they look the same I updated the
reference commit
and then we pushed uh
the latest tiny grad to the uh
open Battery bone
so today let's look we have the goals of
uh tiny grad the tiny Corp on that board
over there
um
number one is beat Pi torch CPU on M1
and everything
kind of stupid I decided because no one
cares about CPU oh torch MPS is so bad
half the things don't even work
um
to delete com make open pilot fast
without it no more ugly kernels that
that is done
that is done we we did delete for the
most part we deleted cough uh can I show
this to you
let me rotate it so you guys can see
I don't know I don't know if you can see
it all
I'm gonna go over here
and we're gonna check this off
this marker's broken
you're screaming on stream my marker's
broken
marker
uh
all right so I don't know what we're
gonna do because we can't have black
anymore all right no more black
we can have blue blue is almost like
Black
ah blue is good okay good so we'll put a
check mark next to that
um
don't do three until one is done well
one I decided was stupid so we're just
going to put a question mark next point
this is the timing Corp
uh over here you can see what would it
take to get comma to switch to oh here
we make this big
actually wait is that backwards
I don't know how I feel about that
it's backwards for you
oh there's a way to like flip this there
we go
okay there we go
we're going to the we're going to the
board here all right wow wow this is
this is legit man the production value
of this stream is pretty high
okay uh this light's kind of in the way
whatever
yeah okay okay so this is this is this
is the board where we
where we plan everything for the tiny
Corps
um I have a suitcase here this let me
move this suitcase
I'm actually really go in the closet
what do I have here oh a sewing kit I
jumped over a fence and ripped my
sweater so I bought a sewing kit on
Amazon uh headphones
airpod 2s these are good Vape
um
a Google Coral ew
or even more disgusting a covet mask
um
a dollar
and a foreign power plug
all right well keep the farm power plug
we'll put the dollar with the other
dollars
and then we can move this suitcase
what's this
or USB cable you can go on a bed it's
only your problem the suitcase is going
in the closet
closet okay good oh look we're tidying
up the tiny Corp office this is a new
kind of stream today
this is a new kind of stream today
uh let's move this light
over here
and
let's turn it up
ah there we go okay everyone see the
board
oh we used try are we gonna use try me I
think we're gonna use try it
uh another train battle is in San Diego
um
she's cool
we don't need any of this anymore this
is all stupid
okay
welcome to the tiny Corp we have a
whiteboard we have everything Cheyenne
office should I rent a tiny Corp office
uh yeah I think we're gonna beat five
torch 2.0
well so you can see here what would it
take to get comma to switch to tie and
grad for training release fastest stable
diffusion on the M1 I'm gonna erase this
a lot of people spend a lot of time
doing this you're not going to be able
to compete with he's like hand hand
under old things
uh it was a good idea but
you heard tritus matka with AMD gpus I
don't think it supports AMD gpus I think
it only supports Cuda so we're not going
to write a Cuda back end for tiny grad
we're going to use uh
we're gonna use Triton
what I put the blue marker or the blue
marker
black mark was broken
well so we do delete com
um
I'm still on M1 I didn't get an M2 I'm
not sure so we have some goals uh comma
is Contracting the tiny part uh our
goals are quantization
and uh goal is support for the Qualcomm
uh
uh DSP
obviously we have to do one before we do
two
uh
uh I've always knew that last night
let's see if it's any good I heard it's
based on orange Linux
um
I don't know what 12 weeks means we can
get rid of that this is still a very
good question what would it take to get
comma to switch to Tiny grad for
training
Triton's probably the way to do this
like
it's
it's gonna be hard for me to
be able to do that without trying
so maybe we just shouldn't spend time on
anything else and should just really
start on the Triton kernel
uh the SSD is only slow if you get the
one with one flash check and yeah it's
sad that Apple did that but
um
it'll do three until one is done
like I spent time looking into like the
AMX and stuff
it's cool in theory but
uh so what this will do here is it will
get rid of snpe entirely
uh which is kind of nice
we have this light
yeah AMD Intel is still in progress for
triton
all right should we do some reading
about what Triton is
I was looking through the code so like
the python jit stuff's not going to work
for us because time you got generates
its kernel so we'll have to write a
translator off of the AST what we call
the only way Qualcomm could collaborate
is if they want to send me money like to
be honest I don't know guys I'm a little
bummed I'm a little bummed about the
tiny Court I'm like is this just a waste
of time you know
this is just like am I just gonna like
lose to Pi torch 2.0
uh oh another thing
S2 cinematography is that a good tear or
a bad tear
uh
I'm gonna rotate this a little bit
uh
we're the analog matrix multiplication
chips no you know what I was saying Alex
last night I was like
I feel so bad for everyone who did AI
tips like it's just such it's even a
worse business than the tiny Corp
um
give up tiny Corps provide Boston
Dynamics robot and run open pilot on it
and I don't think we're gonna do that I
know amd's working on tracks before yeah
check that out
so we should look into what Triton is
doing that we can't do for ourselves
I know it has like a few levels of ir
uh I feel bad about Jim Keller kind of
yeah uh I'm not gonna you know I know a
lot about that situation so I'm not
going to say anything
um
I think that just uh
you know intense torrent is uh
it's very hard to win in AI checks it's
very very hard to win
I don't know what it is about me like I
picked the weirdest stuff
uh oh man you know what you know what I
was looking at this morning I was
looking at shapeways and they're they're
smack I was just looking at like Chris
Dixon's other Investments you know and
just
it's all sad man what did Venture
Capital produce
did it produce anything
uh is dog coming yeah which dog the real
dog or the robot dog
uh
no we're dealing with some manufacturing
issues a coma
learning about nitrogen if you need to
put nitrogen or Reflow off an oven to
prevent oxide oxidization
uh tell you about ML and investing all
right you want to use ml for invest oh I
can't even
chat you make me stupider
um
oh all right
uh okay we did number two we actually
did number two we did number two uh no
more ugly kernels check we got rid of
all the ugly kernels I'll show you what
we replaced it with it's really nice
um good good at least I feel like
there's progress
uh at the tiny car let me zoom out
there we go
I feel like that camera's gonna fall you
guys are gonna have to be like George
dropped us
uh
uh no um yeah like it's it's gonna be
really hard to compete with Nvidia and
mostly it's because of the software
stack
okay and also there's there's kind of
two like worlds right there's the world
of small gpus let's say like one to
eight gpus right let me get a new color
we have purple all right
tiny grad is for
one to eight GPU so once you get beyond
that things start to scale differently
um when you think of basically each GPU
itself kind of as a Cuda core
and then you're going across uh yeah
kind of got his asts I can show them to
you
um are we parsing stuff well no we're
kind of thinking right
what I told the optimism people I'm like
before you write code you should spend
time thinking and make sure you're
writing the right code because a lot of
time people spend writing their own code
and then you're still going to write
their own code even after you think
about it and then
um
hey but this is a Wednesday at the tiny
Corp we just kind of sit around and
think about what we're gonna do
think twice code once and you're still
not gonna
uh yeah as you can see is a crypto pump
and now you're still not going to write
the right code
uh maybe the third time you're ready to
go write something kind of good I hear
it and Tony Grant so many times
yeah
so
okay I can draw out let me draw you what
a tiny grad uh
what a tiny grab kernel looks like
so you can you can take things in and do
element wise operations on them
right can you see this I don't think you
can see this is a terrible color
for example this is what like a uh
like a mammal kernel uh our conference
looks like right so we have like the
inputs
and the weights and this is a multiply
um
then we have like a reduced operator
right this is like a sum
and then if we want to do something like
a uh like a like a real name or
something
which is just a Max whatever
and then uh it actually supports a final
reshape
I know you guys aren't gonna be able to
see this
um
this is there's a lot of movement Ops
here
so this is this is like a an AST
and Tiny grabs things okay
so time you got basically
it starts with a very torch-like
interface and tensor and then it goes
into ml Ops uh you guys want to follow
us through with the code I can show you
in the code
[Music]
all right
so it starts with this file called
tensor
ah
tensors were all like the
tensors were all like the pie torch
stuff is
um this stuff is all they're high level
operations right and some operations you
can uh
just make out of low-level operations
um you'll see like here take like swap
Max for example right like pie torch
would probably have a kernel for softmax
we don't have a kernel for softmax
we just tried it like this
um
no no we're not increasing the font size
bro if you can't see that's your problem
um
so this is the the highest level in tiny
grad there's something very happy with
it barely changes
and you can do pretty much all the
operations you do in pytorch and the
beauty is when you write something new
like here look at Luv all right like
you're like oh this is never going to be
fast but it actually is because this is
all compiled down in the back end to one
kernel
um if you do like a calm followed by an
Lu that all compiles down to one kernel
uh even though you wrote the code like
this no types you know there's not
really types here you can add them
is it faster than Pi torch well it
depends on what it's faster on Qualcomm
GPU than pytor tell you
um it's faster than smpe it's the
fastest thing you can get now for
Qualcomm gpus which I guess is kind of
an accomplishment
I'm going to Qualcomm GPU is what open
Pilot's using to do inference on the
model so this is actually being used now
in open pilot so it's not totally
useless and academic anymore
um
yeah so actually there's a layer above
this uh called onyx
um and Onyx will just run an onyx model
using the high level operations
in tensor.pi
yeah I'm
so if you're not familiar with tiny
Corporation you can go to tinygrad.org
uh we write and maintain tiny grad the
fastest growing neural network framework
this is Tiny grad you can see that we
have almost 10 000 Stars if you guys go
start right now it'll probably go above
10 000.
um yeah
it's very uh
simple
I think we're gonna have to use I think
we're gonna have to use Trident let's
take a minute and let's look at what
Triton is but we'll get there in a
minute let me finish the uh little tour
first right so these are the high level
operations you can read the tensor class
um you guys should read along uh
download download Tiny grad
um everyone go everyone go come on come
on go check out this GitHub Reba we used
to get copper I don't use co-pilot
these things are useful
um everyone come on read along
uh yeah yeah tiny grass attempt to fly
skus to Django would you want to link
um you guys think I'm wasting my time
with this is this stupid
uh
you know the main thing that I'm
targeting is simplicity so it is really
easy to add a back end to uh to Tiny
grad like this is the CPU back end this
is the whole CPU back end you can look
at how simple it is and there's nothing
particularly like
um
you just basically have to write a bunch
of these operations you don't actually
need processing up uh processing app is
optional you can replace processing up
with a redu or the binary output or
reduce op
uh
micrograds purely academic tiny grad's
actually used an open pilot
um we just updated it to the latest
version actually I can just show you you
want to see what the
like I'm sure you would I'll show you it
like compile the open powder model uh so
I can go like python3 open pilot compile
let's run it on the GPU let's set image
equal to two and let's put some debug in
there so you guys can see it
uh so this is a run of the open pilot
model
oh those runtimes are actually real now
oh no they're actually not no this is
still hacked up but
um
yeah so these are the
it's compiling the open pilot model
to uh 200 kernels
down from 216 in the previous one
um I can show you this too so we can do
like crap equals one
yeah you can run you can run stable
diffusion uh you don't know what saber
diffusion
what one's table is usually want to
generate porn like is porno out on
Twitch I don't think one's allowed on
Twitch
um
so this is a graphical representation
you probably saw me look at these graphs
a lot
um so there actually isn't a there's no
these used to be convolutions but
they're not convolutions anymore they're
just reduce Ops
uh this is like a massively fused kernel
so this includes a binary op and a
reduced up
and one you kind of Zoom this out a
little bit
you can see the uh so open pilot model
is two heads uh this is an efficient net
B2 this is an efficient at b0 operating
on the wide cam
uh we're gonna go through the these are
division models this is where we fuse
them together
we fusing together this here is the uh
we used to use a uh we used to use an
RNN
but now we don't now we explicitly do it
so it just uh
it's not really how it's supposed to be
coated
that kind of looks terrible is that
really right
what is this doing
I don't know so I mean it's probably
right
um
and then these are the uh different
output layers of open pilot I think this
is the pose head because the pose head
doesn't have any this is the temporal
context mixer uh the new ones have
transformers this is actually right
um and then yeah
we do some compute on the policy heads
then we concatenate them all together
because it's easier to only use one
output
yeah but this is this is the open pilot
model in the latest version tiny grad
this is actually being run
um
okay so we were at ml Ops so after
tensor uh the things that it calls and
do the base Ops here are these MLF Ops
these ml Ops you can see have a uh
forgot that I added that one
um oh we can also do uh
stable diffusion
set steps to 20 phrase into uh
people
watching
twitch
on their couch
foreign
this is going to run stable diffusion I
did this on stream previously
um
and it's going to run
I can run it with some debug if you want
to actually see what it's running so
it's a little bit slow uh we're running
this not on the uh oh you want to say
highly detailed 4K okay fine
highly detailed
4K and we're also we're only running 20
steps we're not running normal stable
diffusion runs 50. make an own woke
prompt I mean there's no I didn't add
any safety
when I come in
can you press
the switches
uh just tiny Corp take contracts related
to stable diffusion
uh
uh
depends what
I mean tiny Corp needs to make money
uh
yeah I need I need contracts
if tiny corpse not making any money
we're gonna have to shut it down I don't
know what to say it's gonna go bankrupt
um
and there has to be demand for this
stuff
right who out there has a failing AI
accelerator company that wants me to
make it fast as proof that I could make
it fast I did it for open pilot
uh Qualcomm should just discontinue snpe
and just use tiny grad
I I had to I had to revert a pull
request this morning someone cleaned up
to group Norm but then tiny then it
didn't work anymore
um don't ask me about fucking crypto man
I don't care it's all scam all right
oh there we go
people watching twitch from their couch
highly detailed 4K
[Music]
uh
uh
they were creepy
I know right it's hella crazy bro
[Laughter]
uh
uh all right that's good well it lasted
um
but yes you can you can run that in uh
in tiny Grand
it's like somewhat fast not really
um
it's just turning into another tiny tour
through tiny grad so this in here and
melops we go from tensor to ml Ops ml
Ops is where we do the derivatives uh
you can see that you can Implement uh
convolutions as uh
derivatives
of you can implement the derivative of
convolution as convolutions like you see
all this I worked so hard on this kind
of stuff to make it right
um but it is it's all really correct so
okay then after that we go into lazy uh
lazy is still there's still some work to
being on lazy parts of it is still a
mess but lazy is where it will condense
uh things into asts so these are like
some like optimization rules
um yeah this code's kind of a mess it
needs to be cleaned up you can see that
we can have a new size script in tiny
grad see that lazy is the second largest
file tensor is large but tensor is okay
the complexity of tensor is low
can't say
uh how similar is Tiny grad's
compilation to the new Pi torch 2.0 I
haven't actually tried pytorch 2.0
should we try Pi torch 2.0
I wish like it's kind of annoying I
don't know how to like debug a pie torch
what kernels it's actually launching
maybe there's a ride
we need to read about we can read about
five Church 2.0
who should use tiny grad instead of
pytharch oh yeah yeah yeah yeah tiny
grad's a little uh it's a little fat now
it's uh
1744 lines
um
no but the tiny Corp has to make money
if the tiny Corps doesn't make money we
can't continue it
wow
250 primitive operators
dude you know how many tiny grad has
one two three four five six seven eight
nine ten eleven twelve thirteen fourteen
fifteen
grad has 15. these aren't real operators
uh and that one is optional
what is torch inductor
hmm
continued Auto diff through xpm uh yeah
of course yeah so if that codes here uh
this is the derivative of x right
the derivative of x is just to multiply
hmm
graph acquisition was the harder
challenge when building a pie George
compiler in the past five years we've
pailed torch jet Trace
should we read the code for uh
called the frame evaluation API
see this stuff's crazy this stuff's so
complicated
but that's cool
foreign
doctor
this might just be a better way to just
look at this
torsion doctor in here
what is zygote
[Music]
looks like calculus
no this is not the end of tiny grad
I still think I can make it faster
writing a back end for pi torches
challenging pytorch has 1200 operators
primobs with about 250 operators
like that's that's a crazy amount
for tiny grad you really only have to
write one
sorry this is turning into another
reading like we're just thinking about
what we're doing
um so you can see I was also yeah
looking at this this morning this is a
run of uh it's training for an efficient
net
so you can see the inference is all
pretty fast the first kernel that's
absurdly slow is this one I think it's a
reduced kernel for the weights
uh I don't exactly understand the
dimensionality of it
but uh we can take a look into that
it's turned into an Enterprise lib
I mean these things sound cool like the
question is just do they work
what's fully sharded data parallel
it's also in main tree and Pie torch
torsion doctor all right let's see
wait
torch
conductor here we go all right cool
um
Triton template kernel
wait they're serious this is how they
did it
this is how they did it
because I was like looking into this so
I I started very very briefly uh I tried
and back end
um
press the dot key on a GitHub repo
what's the dot key
you trolling me I'm pressing the period
where is this there's this key
you have to log in never mind I'm out
um
never mind I'm out not logging in
um
look I bought an air tag
redirects to
github.dev slash repo name
setting
never mind
I don't like logging into things
wait this is actually what they used
they write it to a file
oh that's brutal
wait they're using senpai
oh this is giving me actually a lot of
Hope for tiny grad if this is how
they're doing it
this is unmaintainable
okay so instead of using Senpai I just
wrote a symbolic algebra Library just
like a little one to do my shapes
um and it's like that long and like this
is all boiled up like garbage that I'll
figure out how to remove
no but like like
this
is how this back end works
I don't know like I mean I guess if it
works
okay uh let's find Prim torch where's
Prim torch
torch prims
I just wonder what the list of them is
foreign
okay so I see
they do have a whole bunch I don't have
reduction prims why do you need Max and
Min you don't
uh my prod can be reduction we don't
have that
um
we probably need a Randomness Prim
yeah okay so we we just outsourced this
stuff to numpy which we probably
shouldn't do
uh
uh we have some of these I mean like
like we don't have div we just replace
it with reciprocal and multiply we don't
have square root we just use power with
a constant it should fold
um
this is so complicated
the better gpus get the less time it
split into optimizing I mean this is a
truism about code in general
so a few trade-offs like you don't
actually want to use compile
um and like a tracer like that's brutal
you want to use
um
you want to use a caching layer
like
I can show you how we dealt with this
open pilot model
here's my compiler here so we just this
code needs to be cleaned up but
um
what this realize does is it's like okay
it runs it it clears the cache and then
it realizes it down here
and this realize captures the entire uh
the entire run
like okay we queue it all up we set up
caching and then we have the cash and
that's the number of kernels uh so
that's the beauty of kind of
like
I feel like Ty torch has put this stuff
in too many places and has too many
different back ends and once you have
different back ends that are launching
things it doesn't work anymore
like
wow this is brutal
remove this once how does anyone work on
this
do they have like insanely good tests
uh
is MPS for a e or metal uh NPS uses uh
metal it's on the GPU uh though like MPS
is really broken look at this so I I
just tried this this morning
um so this is like test Ops
uh
so you can see that's using the CPU so
we can use torch we can say torch equals
one
um so I added support briefly and then I
took it out because it doesn't actually
work I should probably leave it in here
uh
it's like just to show you how brutal it
is um
so
uh you can say MPS equals one
I don't know sorry I'm not mrshaged
I should probably commit this because
it's just it's crazy how broken it is
so this is to use mps's torch back end
instead of cudas and like I got this
this morning like half of the Ops don't
work
um why does Apple not add
thank you
this is this is like MPS I don't think
this is uh
MPS had limit on Buffer size yeah
you see if I use if I do it over here
uh if I run the torch test over here
it'll actually just silently use Cuda
um I mean it's gonna be slow to a net
but then it's fast
uh oh oh a fun fact about why this is
broken
um
oh I should really uh what is it
like Envy yeah yeah
I gotta set that
so that fails yeah now it passes
um Nvidia will silently use tensorflow
32 and then things aren't precise enough
um
isn't a e faster than GPU with metal
well sort of yes and now
oh yeah you want to see something brutal
so I added Cuda support here so you see
this is comparing the CPU to torch's CPU
and that's kind of even
actually
um the GPU should beat it the GPU beats
it on most things
but then if I use Cuda
you just see how absolutely good the
Cuda implementation is
that's my GPU implementation versus the
Cuda implementation
you see it's hitting 11 teraflops here
the Matrix multiplies are all five
teraflops and I'm getting like a
pathetic number of gigaflops
though some of this is I think overhead
uh
is not actually measuring the kernel
correctly
what could a GPU you got hooked up this
is a 3080 TI
I'm just in my personal computer right
here
and you had to start reversing the a e
bro I did the whole thing the Apple
logged it down and I gave up it's like
stupid
how important is it having support for
these things I mean you want your
library to be fast
foreign
like that kernel right there is brutally
slow
I can look into why look into why
so we have some tests here it's called
external gpsd
what
um oh the other thing you can do if you
guys want to do it is we can you want to
try to get this working in Python zero
uh python 312.
thank you
foreign
we got some coffee let's decide on
today's project
not on a Mac
SSH bro
it's not a server it's right there you
guys want to see it
stack computer there
a gaming laptop that's my gaming desktop
uh
so we could try to we could update
python
we can work on debugging this kernel and
why it's slow
or we can work on the Triton port
what do we want
foreign
python 312 I think it's I think it's
time to lose the Hat it's warming up in
here
it's working time
okay python 312 Triton port
all right if you guys want to try it and
that's just going to be a lot of
struggling
we'll figure out why this one's slow
how do I use a pole can I quickly do a
poll
foreign
get one of those online polls
online haul
sign up
all right type question what do
all right slow kernel debug
python 312 upgrade
or Triton port
I'm gonna vote for that one
I don't know how to do polls on Twitch
um
new shiny kernel debugger with tracing
lager my debug is already pretty good
this is pretty good
I can show you how we can like isolate a
kernel and I have some other stuff
I can show you all the debugging stuff
if that one gets chosen
all right
we'll get we'll give it another we'll
give it another uh
minute for the poll but it looks like
slow kernel debug is gonna win so
that's really going to be diving into
the uh depths of tiny guy look how slow
it is 23 milliseconds
got it I forgot chicken nuggets
okay uh uh
last chance to uh
Psych the jokes on you you all voted you
thought you got choice
manufactured consent we were going to
debug the slow kernel anyway it didn't
matter what the results with this poll
was that's why I rigged it and put it
first and showed you my vote all right
slow kernel debug one all right let's go
okay
um so this one's slow let's figure out
what it is uh I have do AST print equals
one
print AST equals one
print the asts in the right place
is that really print AST is gonna
okay
um let's first get the name of that slow
kernel again
the slope kernel is named re s332
okay it should have run
uh
uh I'm gonna say to count equals two
you know what let's just let's let's
modify the debugging to make it good uh
where's print AST
if print AST
equals equals one
or
print AST equals equals
K dot function name
let's make sure that behavior is still
works
okay parenthesis equals one works
actually putting x t equals zero still
works that's good that's the name of the
slope kernel
let's say print AST equals that name
sweet
so you can see here it printed the AST
all right good this is a simple AST
which is nice
uh now we can add this over to my AST
debugging
um
this is in test external test GPU AST
these are just a few kernels uh tests uh
enac reduce
what is that the batch size so it's a
big batch size I used
uh bs32
so this Auto generates the code that
actually runs the AST
we can go in here like that now we can
run that test with test external GPU AST
what I name the test test AST
foreign
all the same debugging stuff still works
so we can see how it's brutally slow
right here
these are just the copy out Swizzles
we do debug equals four it'll actually
print the kernel and show me what went
into thinking about it
um
I don't really know why I put it oh
these are the other kernels okay that's
fine
all right
so a few things to notice about it
first three
what else was a valid which just looks
kind of slow
[Music]
we can make this a little faster by
adding a Distributive rule to the
symbolic Library I mean it probably
isn't going to change too much but
foreign
like we can distribute that 224 over
those things
we should just leave things like that to
lvm
um all right so you see it increments
that that's pretty good this is also a
relatively small number and these Loops
are large
it kind of sucks
probably what we want to do is we want
to take this last we want to take this
112.
um and we want to uh
are these
okay that's the batch size
that's the height and width of the
kernel but what is this
oh is that the channels
oh that might be the channels okay
and then you can also see this terrible
brutality right there you think it has a
better way to write that
like this is actually being a nine and
then that's doing that
and it's padded so it has to do this
okay it's a little larger are you happy
foreign
so I think there's a very interesting
thing to note here
understand how that's two
oh maybe because it's a strided conf the
other way
um
what you want to do is you want to
coalesce your memory accesses
and you can see here the memory accesses
are very non-coalesced
so we're striding across these
dimensions
and these Dimensions except for this
have really big uh
have either a ton of reuse or really big
stuff what we want to do is we want to
take this Loop
and we want to turn that Loop into a
local dimension
like that would be fast if we did that
could be like across that stride or
doing it's a local Dimension oh that'd
be so fast okay
so this is where we
split the uh kernels
so this is being violated here because
self-reduced is not that
she might not be a way to do this easily
okay the problem is
opencl only allows you to have three
dimensions
and you can see that the dimensions are
already being used
we can combine the dimensions together
okay we have self.first reduced equals
four and the self dot shape when seven
uh right here
so the only prints it for that top
kernel
if we did want to combine those this is
where the uh
output shapes here are actually being
generated
we have to do something like Max output
shape
foreign
so
what I expect to happen now is we're
going to free up a space for an output
shape if I set self.max output shade
into two
did not work okay
why is that still being called idx2 it
shouldn't be
oh this
um
probably because this also has to be
solved on that Salvage shape
no these are backwards
why is that idx2 yeah this can't be out
of the X2 that has to be idx one
oh yeah
I think this is kind of ugly and clean
it up later
[Music]
all right
so this kernel is actually slower it now
takes 29 milliseconds instead of 23.
which is just brutal but you can see now
we've at least freed up an output shape
and the answer is still correct
put shape we freed up we can merge this
kernel did you guys follow that
I feel like some of the tiny grad stuff
is just really uh
esoteric
yeah yeah
um
so we've combined the reduce we just
merged basically the first two axes of
the kernel
uh
and now let's try a group for reduce
let's see if we can group or reduce that
I don't know if this is going to work
invalid command Q
well that's a new one
is there some reason like that's not
allowed
unless we're following all right cool uh
but we're trying to you'll see you'll
see like in this next step if this
actually works I have no idea what what
this means
I think we have to add it to Output
shape
I I really didn't write this stuff well
and it's probably going to require some
some thinking uh off stream to really
solve it
yeah okay I mean that's being added to
Output shape which which is good
um
no see
okay that Max output shaped stuff's
wrong
the problem is you don't want to compact
that dimension
it is being added to Apache but it's the
wrong Dimension at its apple shape
you also fix this by where do I do this
debug is for thing
I should probably just go up top here
before you're on the final that way you
can see the program
that's good
okay yeah so you see the problem this
this 112 Dimension didn't go where I
wanted it to go
that 112 Dimension got added to the end
that's wrong
um
[Music]
and I want to change this whole logic
around
instead of the max output shape thing
we might just want to compact the other
dimension
we don't want to compact like these
Dimensions instead of these dimensions
that actually might be a universal win
so let's go and see if we can Implement
that right so this whole problem is
being caused because opencl only
supports three dimensions
and we have to do some like compacting
logic like just like you can read that
and see like boy that's compacting logic
okay so let's get rid of that stuff we
wrote with
with uh Max output shade because that's
stupid
Max output shape is always three
okay if length is greater than three
um let's not even let's just first fix
it without doing this group
we do next output shave that's
uh we'll change this but I this
shouldn't actually be
okay we're back to working the problem
is I don't actually want to compact this
Dimension because this is dimension zero
I want to compact Dimension two
so in order to do that
the reverse this
uh
prod self.output shape 0 to minus two
how is this ever right oh that was fine
because okay it's only great self that
output shape minus two and then be minus
two minus one that's right
okay now instead of subtracting it from
idx to we take it from idx
zero is that right
let's try that
okay we're back to invalid command Q
garbage
um I don't know why that is
I don't know what that error means
uh
but okay so
okay so that should have combined those
two Dimensions that looks right
what why is it a valid command Q
do they make sense
this must be some like weird Cuda
should be three three ninety six
oh is this some like reason it's
something like I can't do that or
something
oh Max work item sizes oh fuck that
wow this is all the stuff I didn't think
about
hmm
really
and that's the error that it throws the
invalid command Q error okay so the
problem is this 96
is going here
and it only allows 64.
it's terrible
there's one more we didn't do and it's
the middle one
so should we do the middle one
instrument on
I hate that
this is terrible
um
so I'm trying to like break out this
dimension
we could combine those two into one but
then the problem is when I add the new
I add the new thing that's part of
output shape
um
I mean really this should read the uh
really should read the max sizes
hmm
okay here's an idea
what if I just ignore it
if I do the what if I do the reduce
what's gonna happen
okay we're getting valid command q but
why that should be a valid shape
that's a valid shape right
oh Max work group size
so this can't even be larger than one or
two four
no those are Max
does it work items I don't get it like
this shouldn't be a problem globally
should it
do any of them have bigger things than
us
[Music]
yeah some of them have much bigger
things than that okay that shouldn't be
the problem
this should be fine another thing I did
should be fine that that shouldn't be a
problem
I was wrong about what that Max work
item size means we should be able to put
it at the end
okay we need to understand that error
better
um
let's try that
okay we're back to invalid command Q
doesn't look invalid to me
let's Google what Max work item sizes
means
no upper limit
16 work groups
oh you know what might be happening no
never mind
oh
I mean this is wrong
it might just be crashing because this
code is wrong
okay let's fix the code it's wrong you
see what's wrong
where is this
here yeah
foreign
still wrong
yeah okay
[Music]
and this just isn't right anymore
okay
let's try something else
[Music]
[Music]
all right
see what I have to write
should we sit and think about this or
should we just keep spam programming
we wanted to go from
length output shape
foreign
I hate this
okay refactor it
go try copilot go go try co-pilot and
see what it says these tools are so do
you want an 81 IQ person you know what
you're the reason we're going subscriber
only yeah yeah
um
co-pilot would fix it for you
uh
and I see why this stuff's confusing I
see why this stuff's kind of confusing
to write
you see what I'm trying to write like it
it can it combines the dimensions
into the First Dimension that's what
this does so this is actually correct
but everything else is wrong
uh
is this even like what I want
no it's not because
part of it's a little confusing because
the output shape is reversed from uh
like when I when I add the the group for
reduce it adds it at the end
how I come back the dimensions probably
matters though too
[Music]
because it has to be like
right Justified instead of left
Justified does that make sense
let's think about what we want to do and
let's write it in a comment and then
okay
so output shape
sub minus one is get Global ID
that's always true
oh I guess okay that's interesting
those are universally true
so maybe we just write that explicitly
and stop trying to be clever okay
hint idx
so blame self output shape minus one
equals
got Global ID 0.
and now we can throw this in
for this one we know this one happens to
be true as well
I'm writing it just stupid Style
now
for the last one it's more confusing
foreign
shape sub -3 is get global id2
sometimes
there is more
interventions
okay we have to just take them
we have to take them from this guy
okay so we want to go from
foreign
minus one
they won't actually go to minus one well
I I decide you want to go to zero
okay and then uh
full dimension
should be right
oh oh then we have to replace the output
shape
okay cool it's correct and faster that's
what I like to see uh hang on let me
just put some returns in here we can
definitely write that as a loop not like
uh stupid
it's faster and better
my favorite
let's spell this out final dimension
all right let's write this less stupidly
uh
before I arrange uh
[Music]
and then this can be I
and then this can be uh
minus one minus I and then this is my
output shape minus I
wrong
uh
oh for range uh Max three or do I want
to do men
uh
sure that is false okay let's go on the
tests
here equals two uh
because one stops
it's slow because it's compiling so
you'll see if I run it a second time
it's actually very fast
test pass let's go
okay great
we can delete that garbage
look it's already faster wait let's see
how much faster it is overall
um
so this was getting 375 before let's see
what we got now no that's not right uh
we have to say training needles One
backwards
much it's going to be slower
oh 281 okay great oh 250. oh what an
improvement
okay we've already made an improvement
we didn't even have to do any local
stuff love it
I mean this made more sense in in the
first place anyway so uh let's just
remove that
foreign
output shave extra
Dimension
indexing floor speed
this made a lot more sense anyway I
don't know why I didn't do it like that
in the first place
um so now like yeah just just look at
the code it looks better
you guys can watch the test let me know
if I broke them
okay
um let's put that hack back in
so we're gonna use it all right what
happens if I do a reduce that we're
getting 18 milliseconds now we're down
from 23 to 18.
oh okay we have an invalid command value
now
it's fine
that's fine
again we don't really know what that
teams
shoving one more Dimension into the
output which is right this Loop should
go away
oh
why does that thing first reduces five
it's not five it's four
I changed first reduce
one is eight what
okay it must be what I'm doing in group
reduce
oh this is adding a new one
okay that adds one to First reduce
but
it should permute it so that that's over
there the permute is just wrong here
oh because it's not first reduced so
that's actually wrong
interesting
um
yeah it should be able to group any of
them but it can't because I didn't write
it like that I wrote it to only be first
reduce
uh
interesting
okay
group or reduce access equals
in this case it's uh zero one two no
sorry
I think it's six
good this is forcing me to rethink about
this
um
range reduce access
one
um
still wrong uh
do you see how it's creating the second
stage down here
this is still wrong one
I hit the wrong access
okay it must not be six I want seven
we're guessing
wrong
um okay there's another way to do this
which is to move the axis there
maybe that's what I want to do
we can move it to First reduce
and then this won't be a problem
the problem is that this is the wrong
it's it's doing it on the 32.
not on the 112. it's somehow it's still
getting 112 there which I don't know
exactly yet but okay
all right
we'll move it to First for reduce
it's also creating a new stupid one
because we're not simplifying afterward
which we should be
uh you know what let's not say 112.
let's say uh 112 over 2.
so we see stuff more clearly okay
um we have to move the 112 to the first
reduced axis let's do that uh self dot
reshape and permute none oh we're just
going to hand code this zero one two
three
six four five
oh okay
unfortunately it still has this 112 here
which oh it's the other 112.
wow
that's it
1.3 milliseconds
we did it
cool
uh I can group produce there
and then there's a stupid one here we
just need to get rid of that okay that's
actually slower
um I don't know
huh
there's no real reason that that has to
be the outside axis though is there
looks like this probably isn't what we
want we probably still want that one on
the inside
but then I have to track the access
still
1.3 milliseconds that's fire
this is actually going to test it the
answer is still right
I test the AST here
cool
all right we made it 20 times faster
uh now what's the generic rule for this
and this is a big refactor like
ah
see if you think about things slightly
if you get these extractions slightly
wrong
I need to just try to fuzzer for this
whole thing
you've read something that's just gonna
fuzz like all the permutations of the
axis and make sure the kernels are still
correct
either way we already got a win
committed
well let's make sure I didn't break the
tests
sweet I didn't write contests
uh
but okay
um a quick explanation of what this
group for reduce does so you can take
one reduce axis in this case it was this
112. this 112 got moved to here and
split up to 56 and two and then the 56
was put implicitly here and you can see
that these Loops are 2 32 112 232 112.
the 56 got put down here and now it's
doing a second stage reduce
all right so basically it launches
kernels across here
and then this 56 axis here gets really
good memory coalescing you see this idx4
you see this idea is four times two well
it's almost coalesced
by the X3
so this this is almost coalesced and
this is perfectly coalized
um so memory coalescing is when if
you're if you're kernels that you're
okay so this here is called a local work
group that means that this code is
executing 56 times in parallel
right
um and with these idx4s here it's
loading the memory that looks like this
this this this this this this this this
and because all those memories are
sequential that's one access to the
memory
and that's why it's 20 times faster
and I don't know what the automatic rule
for this is
totally wrong sometime too which is even
more brutal
and this all still needs to be
refactored man
so hard to write this stuff
so now you see it's 1.3 milliseconds and
now it's 18 milliseconds
um and this is without any of that
grouping
but it's still better than the 23 we
were getting before when I was doing the
axes in a different order
I don't know
should we were just trying to put this
all in Triton
Triton should deal with stuff like this
for me it does
foreign
so there's another sort of theory
the other theory is that I shouldn't
waste time trying to do any of this by
hand
and we have a way to Benchmark the
kernels we have a search space
right like these reshape for permutes
are a search space a lot of these this
stuff here
is um is hand-coded stuff for the uh
it's hand-coded stuff for
to make the uh open pilot kernels fast
so
all
well group for reduces something special
but like all this kind of
all those lines could be replaced by
search
so I really shouldn't spend too much
time on this but it's good to know that
that could be fast
um this new change is good this new
change is good because now it allows
we had a problem before where we
couldn't allow grouping if we had more
than uh three axes
but now we can
so we fixed a bug
251 milliseconds
I actually worry that that other change
made the other stuff slower
you know the overall things faster
yeah I'll watch carpathy's latest video
no that's not the Triton I'm talking
about
um
yeah I mean even
this should be searchable
all right I kind of feel like the only
way we're gonna make tiny grad fast is
if we be very careful with the
correctness of everything
and then
so why not start search now we could
Implement search
could we
could we Implement search
just a small part of it yeah
that's the only way this is ever going
to be good
we have to make all these things
hittable with search and we have to fix
the bugs in group for reduce
with the power of friendship not like
this is really hard
like it's going to take me a week to
write search
and there's another problem Oh I have a
bounty uh if anyone wants to make 50
bucks
uh
so the pro on OS X these kernel
profiling things don't work
uh it returns times that are just
obviously not correct so in OS X we have
to like check I just did like time
outside the kernel instead of using the
profiler but if someone figures out how
to fix this I'll pay bill you fifty
dollars
like there's probably some like secret
flag somewhere
in searches for optimizing kernel
commands no we're using no search the
only thing we have that kind of looks
like search
is we have this thing here the local
work group optimizer
you know this is never going to be good
if we don't use search
we'll add a comment here
stop wasting time with doing this by
hand
search is the
full search is the only way it will ever
be
good
yeah so in order for search we just need
to like make sure it's really correct
wow we wasted so much time doing these
things by hand
because this is the whole the whole
kernel gen is actually small
can I explain why it'll take a week to
write search
I don't really know how to like approach
it yet
like
okay so the the basics of whenever
I I know I mean like the search should
actually be less lines than my hand
coated stuff or open pilot and it should
be faster as well
and that's how you know you're winning
right if you make something faster if
you spend lines you don't know if you're
winning but if you make something faster
and you use less lines or rent
this is
Okay so
whenever you are writing search
um whenever you're writing a search you
talk about two things you talk about the
space and your algorithm for traversing
the space
so
this space is pretty well defined
with reshapes and permutes
so this is doing what looks like a split
and then you have constraints
okay we have to generate the
non-permuted version of this we should
probably fix that bug first
so I mean like you have to fix all the
bugs like first you simplify the code
like okay so you can redefine this
as a
split and isolate operation
do you want to do that
a reshaven permute to a really large
space
foreign
all become splits and isolates
see that I have the same copy and pasted
code in three places
ah then we have upcast
like so upcast doesn't have to drop the
last Dimension and Theory it can drop
any dimension
what does split and isolate do okay so
like you read this code here
uh this is reshaven from you right those
are normal operations so it's taking the
axis called EB valid and it's splitting
it into EB valid divided by four and an
axis with four
uh if the axis is uh and non-reduced if
it's in if it's if it's in the
non-reduce it just splits it into two
ones
um then it will put this 4 at the end
and then this will upcast the latest
demand this will upcast the last
Dimension which will like convert the
four into float Force
um at least I like I did a good job with
this I did a good job with uh defining
this sort of stuff I mean it looks
actually a lot like what uh lvm does
but uh if we look here in AST I wrote
this class called token and token can
create uh
like floats and Float fours and then you
can have arrays as well
this is real struggle this is real
struggle
or do group for reduce here
this is also a
reshape and permute
all right should we should be right
should I search
um
so basically there's an AST which
defines the compute
um like we can look this one's this
one's pretty good because it's pretty
simple uh we can look like this is the
IST that defines the compute right
so you have
um what's a little bit complicated but
uh you have buffer zero and buffer one
this happens to be like the input this
is the weights
uh and then you have these views into
them
um so like it's all kind of like
permuted around
uh then we have an operation where we're
doing a multiply a sum and then a final
reshape to get rid of these ones all
right so that's this is the this is the
AST that kind of defines a uh a
convolution
well actually this is a reverse
conclusion but it is a convolution
um
it's simple right like this is
so you can see this is the first open
pilot convolution here this includes
things like biases
um these are very complicated things
that are actually just ones
uh and this is a Lu here
like it's simple
um
this is this is like basically all just
defining an Lu
uh well that's a lot of code for now you
but like it's fine it makes it fast
um this here is a bias and this is that
convolution
foreign
I'm happy I wrote this uh
this test AST these asts look nice
and letting them thinking
I've got some very simple convolution
hmm
first off I can't anymore coffee I'm
done with coffee today I'm already
jittery
okay I'm gonna get rid of the car
coffee's gotta go
curve down delivery Quality Service
delivery quality that's not even a word
can I explain the search space yeah so
I mean it's a good thing to think about
the search space is
Pure Food
some of this stuff just expressed wrong
don't get me started on meatballs
first thing is just generating random
but correct kernels yeah that's right
foreign
looking like the first convolution here
let's look at this convolution
uh
not one no no
no no so this is like the first
convolution in
College
First
Call bs32
oh that's really like the purest form of
a convolution
do you think that's pretty good
uh what are the two axes being combined
I guess the batch and the channels okay
the batch and the channels are combined
here and this is the X and the Y
uh is there some way to Traverse the
search space intelligently that'd be
nice
um and then We're looping over the input
channels
probably the weights and the Heights or
something
yeah it's probably yeah because it's
nchw so those are H and w
ow should we just try to put this stuff
in trip I mean I'm trying to think of
like when the right time to do triteness
okay so link uh let me show you some
things that retain the correctness of
the thing
so if I do something like reshape and
permute if I permute like
if I'm from you like anything it should
just still be correct right so that's a
null permute so I'll show you the null
for mute
but okay so let's permute let's put this
one up here
uh let's switch like
let's just go like this
if I go like
so now the kernel looks completely
different
and oh my God it's way faster
okay see like this I just tried
something random and it now takes eight
hundred
all right all right you want to search
oh no wait never mind it's way slower
it was way slower never mind
this one one six versus 802.
oh and then that's brutal look at that
yeah this is like why this is never
going to be good if you don't
search because it's 21 milliseconds okay
um
all right
range seven
ah order random dot shovel
order
print order
sell free shaving permute order all
right you want to search let's go
random not defined and I spelled Shuffle
wrong
what oh
stupid python
okay
oh okay well there's the first
restriction we have to put on it
you can't Shuffle you can Shuffle the
reduce axes within themselves and then
the non-reduced axes within themselves
um
okay uh
it's okay you want you want to just do
pairwise here we could do pairwise
but I mean let's just see if the whole
Space works
okay
we did something
200.
uh
see the body just
all right now let's go into the test
here
and let's call this
and compile and test AST
we're on this 10 times
foreign
cool we did some search boys
uh that one's fast
no no no no no no no no no no no no the
time that's not the time issue the
problems in opencl okay so look
that one's fast
well that was cool
okay okay look we made some progress on
search already what a deal uh let me
move myself to the corner
we gotta order some Uber Eats guys
uh
now and it's actually not
true about that ordering or an order
outer stuff
it's really a naive way of doing it
um
[Music]
permuting is messy profiling is Messier
that one's pretty good actually
foreign
this is the fastest one
it's only getting okay
um
pairwise search if there's a bug just
don't accept it
okay
all right let's first off let's not put
this in here let's put this in an
example so we can actually commit it uh
it's an example
maybe an extra
kernel search dot pi
let's not spam this crap everywhere uh
that's good
what's the command vs code to just slice
all the lines
Mac command k
command X
art command x what a deal okay
um
get rid of this
foreign
that's a good deal
am I gonna import random into my
beautiful
go here
let's move this here
we don't actually know if those are
correct
um
okay search history yes
oh where's process
I'm going to add into AST if I already
ran process
but I just always do process right away
just like save compute or something
that's terrible I don't care about that
and take it out of code gen
which actually belong here
I'll go there okay cool
uh expecting the indented block what
comment that out
okay but it runs and it gets 115. with
117 with no permute
um we gotta put some weird stuff here
uh it's not shelf it's K dot reshaving
commute
or I and range 20.
uh okay then from the test
we want to call code gen
I do search space
[Music]
uh no self DOT first reduce
I don't have a first reduce
um
probably get property
uh testosters
okay
all right good we actually did manage to
find something a little faster
so that's the Baseline
and this one's faster
[Music]
tiny bit
okay now pairwise descent
well we haven't actually yeah okay yeah
we could we could Define the operations
and try things and
yeah yeah classic search shit man compsi
101 now that's sort of food
we need food
uh
uh Uber Eats is that
you can also got a comma for food
it's always an option
all right what do we want
Main Chick hot chicken
fuku sushi I'm gonna have sushi that
seems like a good lightweight thing for
writing search
do they have a tirachi bowl well
everyone wants a tarashi ball
Teriyaki ball I want a tarashi ball
entrees oh an America Burger it's
actually called an America Burger
oh pokeballs oh here we go Sushi balls
fuku ball diced tuna salmon Yellow Tail
shrimp cucumber avocado and ponzu sauce
I assume it includes rice too
okay that sounds good
desserts
you can order beer
um I feel like I'm still gonna be hungry
after I eat that
but I want to get a whole nother like
Bowl I don't know what else should we
get an America Burger too America
burgers are cheap
two girls
crab mix I'm suspicious
maybe we'll get some eel nagiri too
not dollars
okay it's nine dollars guys
liquid the tiny Corps isn't making any
money
I can't afford this
should I just go out to dinner well you
guys be upset if I go out to lunch
will you guys be upset if I leave you
and go out to lunch
oh very upset
I was like it's gonna be like sad sushi
or I could walk down the street get some
good Mexican I kind of feel like I'm
doing that
um stream walking to In and Out
wow look some of them get really slow
like that one's really slow
oh whoa wait it found an even faster one
okay how do I search all deposits how do
I search all the permutations of this
space
here's some lunch money thank you
uh Street streams no no no what the hell
with people we got
677. all right all right guys I'm gonna
go to lunch
uh thank you chronix thank you I'm gonna
go to lunch and I'm gonna spend your
money on lunch
um
you know that tiny Corp provide what the
tiny Corp no the tiny Corp doesn't have
lunch if you come work at the tiny Corps
yeah we have lunch
but uh
yeah but we kind of just made this
search work I'm wasting so much time
like trying to write this shit by hand
tiny Corp has the Mexican restaurant
down the street I'm gonna go there and
we get a bomb ass burrito for lunch oh
what's the minimum price tiny Corp dust
but guys I need to make money all right
let's move Chad over here and talk about
how tiny grip's gonna make money
but how cool is that that we can
actually just do that
let's Commit This
oh let me try and write anything else
bad
first
little
we should also probably test the
accuracy each time
just throw that in there and make sure
we let you break anything
sell tiny core who is selling tiny Corp
to guys I don't want to be owned by
Banks okay I hate Banks
good it seems correct every time
foreign
something faster that's crazy we didn't
even start doing up casts and stuff
oh man all right we should have done
search a while ago
our reader thank you for gifting Subs
sell tiny grad merch yeah this should
get Alex to design some tiny grad March
guys we got a big money
how beautiful is this though
like that we've written something that
can actually search like that
and it all works
stuff repeatable
sure it's repeatable
what's your favorite people
you can see like the differences
I've actually known them really faster
the top one's the fastest
wow this one found fast once
that's significantly faster look at that
we're already winning
[Music]
this is on that reduced kernel that we
were trying to make fast oh my God you
just can't do anything with my hand you
just have to use search for everything
oh that one's so fast
look at that one
oh search is the way
a Ritter thank you thank you
um minimum contract price for tiny Corp
I don't know propose something
comma said they'd give me 25k if I get
quantization in the Qualcomm DSP to work
uh it seems like not much money
uh
also we're not actually going to charge
common money but
well that's a new hole in that shirt
uh
25k yeah we could afford the only gear
no comma the tiny group doesn't make
money
okay so what you should really write
here is who's ever been suggesting
pairwise descent is right right like you
should flip one of these see if it
improves things so why don't I find the
optimum instead of just randomizing well
because my search space isn't complete
enough so remember how when we use the
uh that that group for reduce okay so
I'll write like
um to do support uh
up casting
and local grouping
up casting splitting and local grouping
so
like yeah I could find the optimum here
but we're still not close to what the
optimum could be man but I just should
have done search a long time ago
first do the pairwise to limit search
base
I'm not that interested in that you can
write that if you want you can write
that I mean you see that do it
uh
you write the paradise thing it's easy
uh
uh well
hang on
let me make sure uh
okay so that's you can get the time
externally
um
iOS silver all right fine fine in honor
of iOS silver let's go
uh
uh
foreign
this is inclusive or exclusive in Python
on our number
yeah okay so if it fails
uh
then we reject
s
foreign
to build one
do I not let you catch that exception
raise e that should be fine
I'm good should be okay
I'll write it manually
oh we won't return
I think this errors generated I can't
turn off
foreign
[Music]
foreign
foreign
I think that's pretty good
uh I wish you didn't print this stupid
errors generated thing
I mean should probably reject that
somewhere higher level anyway it
shouldn't actually get to the compiler
grep
actually I bet he was going to stand it
out
happy
how long does it find the best one
pretty good right 5.4 milliseconds
all right so of course this search is
greedy you know all the problems with
searches
[Music]
um can you optimize every op in
isolation you can totally optimize every
app in isolation so the way that this is
defined is like if the AST is correct
the whole thing is correct
all right so sometime it finds the best
one I mean obviously we can replace this
with a much uh much fancier search
algorithm
I don't know I'm kind of unimpressed by
this I kind of liked my other one better
now I gotta use a star don't I need a
heuristic function for that I don't even
know
and your heuristic function oh
yeah I mean how many pairs are there any
no you need one heuristic function uh
you now have a small branching tree but
at least okay I mean
the cool thing is actually if I write
this pretty well
uh this is like this is accessible to
people
oh I can't believe I wasted time trying
to do this by hand
but I'm gonna go like
see if I can get it to ReDiscover all
the other optimizations
uh
like simulated and kneeling yeah yeah
you can do tons of different searches my
point is this search space isn't
defining uh here
like this is just one possible
intervention we can also do upcasting we
can do splitting we can do local
grouping
um much more so than like how we're
doing the search algorithm
let's see how this works on
let's see how this works on the Mac
where I don't have uh
cool
I mean it goes from 55 milliseconds down
to 36.
does it find a different order too which
is even crazier
uh no no we're getting food don't worry
I didn't forget how hungry I am
um
Wild
all right we should have done search way
sooner it's important to have a small
number of interventions
yeah I I think that there's still a much
bigger space than uh is being expressed
right now
uh and we need to we need we need
something more expressive
and then there's lots of stuff we can do
forever transformation
I mean okay that that other thing is
kind of universal so I I can just write
it like we can just say
um
foreign
foreign
we'll do it over here
what I do wrong
oh
let's add more stuff we gotta eat first
I gotta eat first and this is the only
transformation I'm really like uh
I'm really like confident
I still like how fast this is
we'll still take a week yes in order to
make it like actually go and ship it
replace things no no I mean this was
kind of this was encouraging how fast
that was actually
I don't know why I didn't do that sooner
so there's all sorts of other things we
can do like splits and up casts
all right should we try and upcast
wow you want this in in some other thing
you can do that yeah am I just making a
locally optimal decision yeah
all right what I need like a little like
framework for this
foreign
can't contain zero
um okay we should try a
foreign
actually got upcasted and it got slower
uh
it never got faster from upcast
it's funny how much more complex
Google's Optimizer is yeah I know
because they wrote really complex
libraries and when you write really
complex libraries you get really complex
stuff
why did I only do four
why did this work
it's exiting
I do wrong
uh test accept exception continue
what's wrong why is this not
um
down local
foreign
now we want to allow up casting and
permuting oh this is a nightmare
with like save the operations that were
done oh
oh because I'm printing the exceptions
now casting games always make it work on
Cuda
but yeah you can do this upcast multiple
times
um
wow do we actually do we want to start
running this on do we want to start
running oh my God we can make open pilot
maybe twice as fast
when I do this sooner
uh
so that's splitting
by the way we actually don't have to we
could not upcast
it's got to be some like framework to
put search in right do I really have to
write this
why did I do that again
oh because now there's one more
dimension
oh
no this isn't the framework
how does it magically finding that one
it never sees that
okay so this is up casting
outcasting doesn't have to be for either
upcasting can be more than four
we can also do padding with upcasting
I think that's actually most things
I don't know because we have to support
splitting because this is splitting oh
we're still really not supporting group
for reduce
well if we started supporting group for
reduce oh that would just be fire
foreign
all right maybe it won't be a week
no worries if you know what I mean by a
framework right so I should like I
should just put these interventions in a
in like uh
in like a thing
you know what I'm saying like this is a
thing this is a thing we keep track of
all the things we did instead of stupid
New Order
yeah you see what I'm saying
um
this is definitely an after lunch thing
I'm glad we wrote some search I can't
believe how much time I wasted writing
this stuff by hand
search is dead simple
am I coming back after lunch no I think
you guys only get the morning at the
tiny Corps
that's pretty good progress though
make it faster than Cuda
uh nothing's faster than Cuda
lucky Ariel's got 2x speed up there what
about the speed of light yo fashionable
speed of light man
no we have to okay I have to really
clean up the group reduce code and think
about what all the group reduce code is
testing is useful on the Mac let's see
if outcasting is useful on the Mac
it might be
well some of them get really slow
oh I'm changing the wrong thing
uh here
so what upcasting does is it converts it
to like a float uh flow four
whoa look it hit some faster ones
we didn't save that permutation
okay okay okay okay okay okay
get permutation apply permutation
uh get permutation
is this is what you guys want to see if
you guys want to see you wanna see you
want to see this content
okay
we have get intervention
uh uh okay
okay
um
I just want to randomly choose three
things uh
okay
type
I probably put this in a framework and
make it nicer if type is zero then we're
gonna do a pair
ing zero A1 A2
uh LF type is one
we're gonna get an up Axis
I'll return one of axis uh apply
intervention
okay
uh
and then
that
equals zero we want to do
[Music]
okay
and each time we want to get a random
intervention
and call it inter
um
foreign
foreign
should be winning
I'll probably just this session right
oh if we do non-local
foreign
[Music]
winning
interventions
wow okay it finds an upcast
28 milliseconds pretty good right
is that the content you all wanted
there we did proper stuff
um
cloth axes
uh
upcast
hmm
I thought that'd be better
am I not on computer or something no
I think there'd be any more
issues
also
that should be printing exceptions I
don't care why it's not
another one computer again
why is not printing the exception
why is this putting e there
why is Trace background exception oh
because I redirected
uh uh actually supposed to be in sync
cannot contain zero okay that's fine
[Music]
uh CL
as the kernel object has no attribute
shape
values mismatch
know about that
oh we also want to test the AST at the
end
foreign
cool the test passes
Cool Bros
now you want me to write it in normal
normal
pretty good
not sure I didn't ask
oh tiny Corp
how much we improve the big carve
6.51 X
bro that's crazy that's crazy much
and this is the dumbest search thing
I've ever written
all right let's let me add one more
thing uh this doesn't actually have to
be four
Bros
how fast is that
so fast
oh and you also might be wrong
no
I'm gonna get Point 38
how come that one so fast and those
aren't
I don't know
but we can also select amount
your house
[Music]
you hear that computer thrashing
3x speed up on that yo look at how fast
that kernel is now we're getting five
gigaflops
and the winning inventions interventions
do include upcasts
look at those upcasts
they just were eight up casts not four
off casts
foreign
I feel like that used to get faster
oh because for now it's taking bad steps
with up casts
okay now that's back to what it was this
one does not casts
we're not using tensorflow or Pi torch
wait this is super promising
search randomly
certainly even smart at all
search has no backtracking
and we need to figure out like we need
to do big search offline and we need to
like cache common interventions and then
the search online can be very
lightweight and just do a bunch of uh
wait this is this is fire guys
big breakthrough today thank you thank
you for pushing me to write search
okay I still can't get over here that's
that's a fire amount of gigaflops
dude stable diffuse yeah stable diffuser
is going to be so fast well okay so now
I actually like okay this search right
now is not actually running on the
kernels we'd have to run the search on
the kernels and like that slow and
yeah yeah yeah yeah yeah well you know
if I'm all silver I was never I don't
know I was never that good at uh at that
kind of competition programming I did
one I've been a coats
uh I got like like top 25 twice enough
in a code uh by
but it's a bit like Avenue code's not
very mathy
it's a lot more thrashing the ones that
get real mathy I'm not that good at
um
the one if if stuff can't be solved by
thrashing
uh I'm pretty good I think I did most of
I did the first page of product I did 50
problems on Project view I think that's
the first page or something
um it's something I can't do the math
ones I just other people can do them
better
so I never really won those kind of
competitions I was on a cranky melon uh
accomplishing programming team but I was
always kind of uh kind of mid
I wasn't that well I was close I was
obviously using like the second tier
team
I was top 10 but I wasn't top five
uh whereas for PVP
uh the cpf stuff
I was uh
I think undoubtedly the best in the
world for like a year
um
yeah like the the year of Tom Cruise
winning executive inside and see-saw
those were uh
there's a good ERA for that kind of
stuff
it's cool to be the best at something
uh you know then well a few things
happened yeah like you age out of it a
bit
and
yeah you just don't like it just becomes
less appealing
I don't know I'm not sure how much of it
is you actually age out of it like I'm
not 24 anymore I'm 33.
um
versus it just like yeah the problems
all started to feel kind of formulaic
and I just didn't really have the
motivation like oh I'm gonna do this
again nah let's
let's try to create something new right
um so that's kind of what I got
yeah like I wanted to move past I also I
hate what the what the uh
like
computer security infosec bug Bounty
garbage look at you guys man you're not
hackers you know these people ain't
hackers infosec has nothing to do with
hacking infosec is a boring I saw I saw
a tweet yesterday it was someone who's
like uh I saw someone applied to comma
like well yeah I have to unfollow this
company because I don't like George
hot's uh I hate George hot so that's
great uh but then like you look and
they're like writing they're also like
it's the same people it's the people who
showed up and like ruined all the hacker
competition
right like
you know yeah hacker what did it was
this it was this like weird subculture
and then some combination of you know
Mark Zuckerberg naming Facebook one
Hacker Way and and like uh
infosec people I think they're also like
once money got involved it just all got
shitty
um
it reflects a real like person out there
right
um but you know it's good it's good to
see like you know if people if people
who I respect don't like me I'm like oh
I'm doing something wrong but if like
people who are like well actually
disagree with everything you say uh you
don't like me you look good man that's
how it should be like uh
you know what what I mean not everyone's
gonna like you that's a
that's of course that's true
um if you try to make everyone like you
you're you're
just a bad like place to be right if you
try to make everyone like you you you
let's say like you know some people love
mayo and want mayo and every sandwich or
some people hate mayo and don't want
Mayo don't want to see Mayo ever like
you can't make everyone happy like by
having like a mid opinion like like oh
well I don't know sometimes I like Mayo
like no Mayo's fucking terrible and like
we should do something about it
um oh no no no no and the absolute
biggest losers are like okay so first
off anybody who says the word cyber
security right
uh yeah let me move me over here the
word the word cyber
that was the worst cyber ever been
followed by something good
cyber Terror you know you didn't even
rant about cyber
um
CSI cyber that's right you can see it
you can see right uh no no we don't need
the rant about cyber all right you know
what let's uh let's read comments this
week
um so you guys have a way some guy was
like oh yeah we have a few comments to
respond to and then we're gonna go to
lunch and then I'm pretty happy we wrote
search and it's already really good
which actually need to like clean it up
and implement it
I'll make it find the last thing
uh
oh what shapes you as a network should
have an effect on the Network's function
no it doesn't okay so what we're doing
is if you're permuting if you're
reshaping and permuting within an AST
like this is how this whole thing was
designed it's
imagine
um you have to just actually
flat vectors and you're adding the
numbers and the vectors together and
storing them to a third Vector right so
add add add add but it actually doesn't
matter what order you do this in right
you can add these then add these then
add these and then go back and add these
add these add these and the final Vector
is going to be identical in both cases
but you flipped it around right like
you've just you're changed the order in
which you're doing things or if you're
doing songs right let's say you're
you're you're adding all the numbers
together right it doesn't matter if you
first add like pairwise this and this
and then add a wall or you first add
pairwise this and this and then add them
all right you're going to get the same
answer in both cases
um that's why these searches stay uh
stay relevant stay safe what's the word
uh
these searches maintain the property of
the kernel is the same
um there there's like names for all this
stuff I like tried to read the papers
but it was hard for me because I'm an
idiot but no no it's like polyhedral
Computing uh there's algorithms to solve
for this but
I don't know like in general whenever I
see things that look like this
you're better off just writing the
simplest implementation you can and then
uh like searching
and I should then search way sooner
okay let's read comments
uh when George finds out Shiba have the
lowest IQ of I know about cheapest I
know about cheapest
[Music]
um
yeah yeah I agree with this no no more
Twitter
um yeah I saw I saw all your all your
YouTube comment wraps y'all making chat
GPT a worse rapper
uh uh okay I'm too big oh sorry sorry
sorry
um
yeah
about that okay uh
uh you need a photonic AI chip I promise
I don't need a photonic AI chip I do
have plans for a comma four and five
uh they're outlined on my whiteboard
they're not coming soon don't worry
um
the comma four I want to have uh enough
compute to be like a
a dog at inference right and like I want
at least 100 Tower flops on the count of
four
um I want 100 teraflops on the con
before and I want to pay to flop on the
comma five
which is a huge like it's it's way more
than what we have right now
um so when a good hundred teraflop chip
comes out
uh Jim Keller will save me maybe we've
discussed it
um we discussed that let's see we'll see
we'll see what happens I don't know
today with this search kind of working I
feel better about the tiny Corp but
sometimes I wonder if I'm just like
wasting time with this whole project but
then like we read some pie torch code
and I'm like this is never gonna be fast
like it might be but but it's okay it's
not that it's never gonna be fast it may
very well be fast but it's going to take
so many man hours and so much complexity
to make it fast
we got 90 teraflops at 500 watts yeah I
mean can't these like Qualcomm chips do
it
God I wish you could just buy Qualcomm
chips
uh
this here we go
today I'm talking about the DSP oh here
we go hexagon here this is the
Snapdragon gen one
it doesn't say after this
one oh it's on four nanometer oh man
like I'd love to I'd love to have this
chip Qualcomm will you sell me this chip
no you won't
you won't sell me this chip
it's like 3x bigger GPU than what we
have right now but then some of these
DSP things get huge amounts of but
they're tops they're not props
uh
uh no it's not a million units it's it's
honestly it's not a million units it's
not quantity
um it's
the company it's they're unbearable
they're just someone needs to replace
them
you you can't interact with a normal
person who can like tell you what the
price of a chip is and then you can buy
the chip like it doesn't work like that
I don't really know how it works
um 10 equivalent will buy Qualcomm after
the Ivo let's go uh uh look I'm
replacing your snpe garbage and I'm
doing it for free right like literally
use the use tiny grad GPU instead of
smpe it'll be faster on like almost all
neural networks it supports Transformers
and we don't even have search in there
yet once I get this search in there I'm
just
yeah you need a business development
team to work with Qualcomm exactly fuck
that shit right with some of the little
chips
um
foreign
yeah but these things have lots of lots
of compute uh
I don't want to buy 10 chips I want to
buy a hundred thousand chips we'll buy a
hundred thousand chips okay please sell
me 100 000 chips I will wire you the
money twenty dollars a chip I'll wire
you two million dollars
um
their chips aren't 20 so that turns out
to be part of this count on video oh
what is what is I mean videos got the
orange now
much compute do these things have
these have a hundred tops
wait Jetson or Nano one of these coming
out
100 bucks 100 bucks oh not a hundred
bucks
watch this is the problem nvidia's over
ah I can give you a hundred dollars I
can't give you 199.
40 tops
like it's not even no this one's 40 tops
it's only 20 tops those are tops
[Music]
how good is the GPU in this
how do you fly how many tops is the GPU
nice job Nvidia SOC is that a good
Wikipedia for this too
[Music]
another gpus Tegra GPU
Tegra no these are the old ones they
don't make these anymore do they still
call them tigers
come here Warren okay they're still in
the Tegra thing here we go
um
agx or an
yeah I mean this is what we need they're
just too expensive
might Outland get canceled
their next SOC will be called Thor
replacing the canceled atlab
they're too expensive
AMD
I haven't seen any accelerators from AMD
so if you buy like the most expensive
variant of the chip
like these chips are like broken a lot
oh yeah yeah you want to see look at how
much are me 200s
you want to know how you're how well
your your thing's gonna gonna hold up
here you go
you can buy a me oh this is a me 25.
how much do these used to cost
here we go
here's a me 25. it's 16 000 here's how
much a me 25 costs now 90 bucks
you can't use them for shit
uh
um
oh the mo the M2 Chip oh
and that's what I really want
15.8 tops of the neural engine
a beefy GPU
how fast does this run the Open final
cutting we forgot
[Music]
I mean I didn't optimize it at all so
I'll say
wait it's actually pretty terrible uh
let's try image equals two float 16
equals one
okay 17 milliseconds so it's slightly
faster than what we have right now
uh
oh it's 18. oh this is okay that's just
because that's fine so it's it's 17
milliseconds for to match what we have
right now that's like
um it's almost the same on the common
three actually
but we didn't optimize it at all
put a 40 90 in it yeah
it's a shame Nvidia charges too much
money Qualcomm won't really let you buy
the chip side um
um this one hey how can I send a message
to George you're sending a message to me
one of the questions I want to ask
George is if Ai and robots will ever
understand and live the essence of life
or does it depend on the limits of
computation
um
no this one where's the one about
Consciousness I don't understand someone
as smart as GH say Consciousness doesn't
exist I see this like phrase a lot like
I don't understand someone as smart as
as as George saying X well look if you
think
harder than you
then maybe you're
maybe you're wrong and I'm right so
we're gonna specifically talk about
Consciousness and since people love to
to to eat this shit up
um
so Consciousness is usually uh
separated into into like the hard
problem and the easy problem right uh
the easy problem is the concept of like
okay you know the things like alive can
respond to queries yeah the easy
problems are concerned with behavior and
mechanistic Analysis the relevant neural
processes right
um so
yeah like the the yeah I mean the
easiest kind of a joke but like
nobody doubts that you can make a system
that can talk that can process that can
that can do everything right that's the
easy problem of Consciousness so if
that's who you're defining consciousness
then sure uh with enough very powerful
finding I'll probably crack it in the
century right reductive inquiry
um no one denies the easy problem of
Consciousness but usually when people
use this word they don't mean to refer
to the easy problem they need to refer
to the hard problem the hard problem of
Consciousness is the problem of
explaining why and how humans have
qualia or uh phenomenal experiences
right um it's related to this this word
qualia uh the uh where where is the
existence of the hard problem is
controversial I do not believe the hard
problem of Consciousness exists and I'm
in good company with Daniel Bennett
Massimo Piggly Atomic metazar Patricia
Churchland and Keith frankus and
cognitive neuroscientists all these
people agree with me that Consciousness
qualia phenomenal experiences are all
crock of shit uh and that's true bro and
that's that's the truth right
um and like the people who don't I think
are actually playing to religious ideas
and look I'm religious I just like like
it's hard for me to I believe in God I
believe God created the universe even
even you know the Jesus stuff uh kind of
sound you know it sounds pretty
plausible to me you tell me the world is
6 000 years old I might believe it right
but let's listen just hear me out on
this you know people are like George how
could someone as smart as you believe
the world is 6 000 years old what about
the dinosaurs and carbon dating and this
is true but I asked this question
have you ever started up a game of
Pokemon
and wondered why Lieutenant Serge has a
right shoe
do you know that all right shoes evolved
from Pikachus right but you never saw
that right to evolve right
when the world was created when the
Pokemon Red world was created by God he
just put that Raichu there right like it
didn't evolve from a Pikachu right so so
you know just I'm just saying the world
might be 6 000 years old and don't be
like how could someone as smart as
George believe that well I'll just
saying it's possible right so you know
I'm just saying and the hard problem
with Consciousness is stupid
prove it you can't prove it it's just
like it doesn't make any sense right
um
uh
all right well that's that's basically
the only comment I wanted to respond to
uh check the replies to that comment oh
yes the replies to that commenter
sometimes George just says stupid things
um
that's right that's right do you believe
in the Raichu then you believe the world
might be six thousand years old that's
all I'm saying all right good you got a
real answer all right guys uh I think
that's today's stream we got search
working we got some search working it's
very exciting I was really bummed about
the tiny Corp but now less bummed about
the tiny Corp
um
last do we have a last question today's
stream very good vibes thank you thank
you
uh after work Tech welcome
um I think therefore I am yeah well well
you know what you ask chat gbt if it
thinks therefore it is
uh I'm not gonna get an M2 I still get
him one
um
hi Colleen entertainment thank you thank
you uh when I moved to Ukraine and fight
there
uh yeah I'm Ukrainian actually like uh
great-grandmother came from Ukraine
um
so uh
how much time is it because table
decision time travel once we have search
working who knows
um the sky is the sky is uh the limit uh
man
Joshua Bach yeah I've listened to some
of his stuff I like this looks Friedman
uh Iman is definitely a boss yeah no
someone's got to fight against these
people no you're not really no no no no
today was a positive live stream I'm not
gonna go into what pissed me off
yesterday treadlock on Peloton
pushed me man pushed me you know I have
these products if the products work for
you when you bought the product is it
really yours all well you know you can
you can
um
no food that I decided I'm gonna go eat
a nice burrito yeah
uh
the voices are starting to come back
yeah no look I like that I like that
they're fun day
um we looked at the RFK WV thing that
looked kind of cool I didn't look into
it too much to see if it's real I'm
waiting for people like what is the
actual bits per character in these
models ah she's not even that useful
because what's your test set it's all
um once your language model is large
enough it contains every random pattern
um
how do I seduce my crush
the truth is you can't seduce anybody
you just need to find someone who's
already pre-seduced by you
answer change your crush don't have one
is Pro
um
it rolls hard to drive now it drives
like a dream
uh
uh what are you gonna take the next LSD
trip
I don't know
you know you guys know about all the
mushroom chocolates not being mushrooms
it's for ACL DMT uh don't get scammed I
don't know I've done drugs in a while
um
actually that's not true I smoked weed
last night if you count that as drugs
um Consciousness requires that the
network is recurrent
probably true CarMax has this made a lot
of sense
uh do I look at Noster is this one of
these like uh only because I'll look
only because because you said a lot of
other good stuff on the screen so this
isn't like uh
the problem Oh wait is there like a
website I can go to where I can see some
some inflammatory comment on Noster
like this is the problem you go right to
Twitter and right away you're offended
and you're drawn in
um if I believe in Jesus do I also
believe in the sacrifices Mayans carried
out to their gods no their gods were
fake Jesus was real I'm a Christian okay
um
I think I'm a Catholic but then you talk
to people who and they want to like talk
about whether like the cracker and the
wine or actually the the body and blood
of Christ and I'm like all right guys
this is going too far it's a damn
cracker and wine
um
laughs
I read the Bible yeah
uh
I don't know I'm more of a fan of middle
test the Old Testament and the New
Testament
um
I am not Jewish uh
and I'm not it's not true
um
I do like Bagels though
uh
I don't know
no I have
ah no I'm not gonna go uh
no I think there's a few I think there's
a few sort of like cultural differences
uh
though I did see it I saw a great thing
about like you know people are always
like uh
your Jewish people are smart right like
this is actually Jewish people in
general have uh have uh have have higher
IQs than uh non-jurish people
um and
so you know in every intellectual
movement you're gonna have an over
representation of Jews and that's why uh
they're used as a scapegoat for things I
like that I like that wow how did you
guys how did you guys get me talking
about Jews man you know you're really
you're really you're really you're
really you're right you're very where
are we going tonight
um
foreign
kind of jumped the shark man he could
come back but he kind of jumped the
shark
uh
[Laughter]
lizard
I already had class in my doc you just
can't you know you you guys understand
that you all make the American political
system look like absolute clowns right
like I hope all these people
I don't know nah I'm in a good mood
today because search worked but I've
been kind of been bummed about
about uh
just how bad culture is also how many
people reach into work at comma and I'm
like
like
no thanks
you have to do
I can't contribute to the open source
open pilot repo but you should hire me
well why would I hire you right like the
the the the job is
to contribute to the repo and if you
can't contribute to the reap I I don't
even know or they think they're gonna
like game it like could I get a
different hiring manager like bro
there's no hiring managers it's me and
like Alex and like a bunch of other
people on the team like it's not
you're not gonna game it
um
open AI has 250 people uh yeah that's
too many still but uh no there's some
good people at opening I definitely
foreign
I wish that like uh they would stop with
the
like
AI safety I I can't I still can't no
don't get me started on this guys come
on we're in a good mood we're in a good
mood
um we're in a good mood
uh do you have a girlfriend you're hot
yes I do with my girlfriend
um
games we've been playing lately I've
been playing polypopia a little
uh
uh opening hours you get their name
remote
you're not even like overestimating your
abilities like it's just a question of
like like it's the people who understand
they can't contribute to the code but
also think we should give them a job
or like do you know every part in a cell
phone right if you want to come work for
us if you want to be our supply chain
manager you have to know every part in a
cell phone and then I ask you what's an
inductor and like you don't know you're
trying to like like what's an inductor
right tell me about it
[Music]
um
yeah you should definitely apply uh
you've contributed to to a bunch of
things I don't know if you should be
talking about but contributes a bunch of
my things
uh
yeah if you want to apply I'll give you
a phone screen right away
um
VIP on the Stream
uh
how do they even get interviews
no some don't
how do you survive the woke College
culture is it that bad
don't go to college if it's that bad I
don't know
I think some colleges are worse than
others
it's so fucking bad bro
what what what specifically what
specifically is bad about it right like
there's a lot of
um you know the people the the wokies
are never going to listen to anything I
have to say so there's no point in
talking to them you can only talk to the
anti-welkies who actually might kind of
listen like
you are losing every time you let the
wokies Define the frame all right like
like let's look at let's talk about
something like transgender bathrooms
right
the minute you're opposed to transgender
bathrooms you've already accepted the
existence of this as an issue the minute
you're opposed to gay marriage you've
already accepted this as an issue right
like it's not an issue these things are
so stupid
right like like like what why is it a
way away you know and I don't mean
they're stupid in the sense of like I'm
like but there's gay people out there we
want to get married okay get married
what does that have to do with me right
what does that have to do with the
government what does that have to do
with anyone right like this is not a
this is not an issue and by making it an
issue they distract you from all the
other issues where they're you know
looting and stealing trillions of
dollars from you right that's that's
basically the root of how all of this
stuff works
it's not a conspiracy theory right
uh Washington DC has two groups of
people and the real problem with both
groups of people is they both agree on
the frame right they might take opposite
sides on something like a transgender
bathroom issue but you've got to just
step back and be like what the fuck
you're stealing trillions of dollars
right
um
so this is what I mean about the like
woke shit right like woke shit doesn't
affect me it doesn't like like I'm gonna
go eat a burrito it's not gonna be a
woke burrito it's gonna be a normal
burrito
um what if gay marriage is illegal yeah
like like but you're already framing it
you're already like framing this thing
is an issue right what the hell is gay
marriage What is marriage
right like like what are what is what is
what is marriage without like a like a
like a church right like there's no
there's no thing it's not like a thing
right it's not like aluminum right like
aluminum is a thing
you can go there and you'll find that
that in every alien culture they have
some word for aluminum right
there's many things that don't have
anything that looks like marriage right
like marriage I I don't exactly know the
history of it I don't you know it's it's
probably some
I I mean did to do like tribal people to
pre-judeo-christian religions have
marriage I doubt it
um that's what I mean right like you're
getting you're getting
uh uh
I have marriage and marriage is a
contract look I'm never getting married
right like it's really it's not a good
contract for uh for men to sign today
you believe in government institutions
you believe they exist you believe
they're good
how to seduce your crush uh
uh very like yeah I don't know
what would you tell people who have
their culture and someone else tries to
change it well who's changing their
culture bro you can have your culture
just exclude them from it
right you got to watch out for that you
got to watch out for people who are
trying to come into your culture and
change it you just like say
you know have a firm idea of what your
culture is and be like no
um
you know I kind of think I'm coming
around I've been listening to uh
uh Pat the bunny right as a Johnny hobo
with the freight trains
ah man you know I just I like like
um
that's like uh New Mexico song of course
we can't play it because it's because
it's because it's copyrighted
uh
yeah we are revolutionaries but we are
the Revolution and sometimes I think
this whole movement is me and you and
maybe we'd be better off if that were
true because at least we know where we
stand and we can tell our comrades apart
from the man
uh
you know the the the greatest trick that
they they pull is convincing like
like
[Laughter]
I don't know I I just I just I just
don't know how you guys can like like
you don't stand under the pride flag put
up by Proctor and Gamble and talk about
how this is the Revolution and finally
Liberation finally like no man like no
you do oh
um
[Laughter]
guys I I think that we just need to
separate a whole group of people who
think that you shouldn't be alive right
like why do those people get a say in
anything
right like yeah you know there I mean
there is some truth to like they don't
want you eating meat they don't want you
eating plants they really just don't
want you existing
um and you lose me right away you know
you lose me right away if if you say uh
you don't want me to exist
um but so when you talk about uh back to
the point of bro who thinks college is
too woke like tell me what's going on
right
like don't sign up for those classes
I don't think that except for the fact
that we don't fully Embrace finitism in
all math classes you know I don't think
I don't think math is woke I think you
could probably take a
uh you know discreet math classes and as
long as you stay away from the the you
know the the uh
uncountable Infinity stuff there's
nothing about math as well yes I'm
branding uncountable Infinities as woke
The Freshman requirements yeah bro just
don't take them
like you're the customer
I don't know the college wanted me to
take this stuff and I emailed and said
like I'm not taking this stuff like you
want me to come or not and you know
they're like oh okay
or smooth manifolds well I don't know
enough about smooth manifolds
no Victor try to decolonized man you
guys like half of this is half of this
is is like
it's just Republican bullshit where
they're like oh they're teaching
critical race theory in the schools
right no they like focus group tested
the words critical race Theory they know
that they trigger people and now they
can put whatever bullshit they want in
the education system right like it's
just that
uh so there's no you know and also
there's no point talking to Loki's right
so we only talk to the Nookies here
he's here
um
I would believe in the pirate flag we
believe in
jumping on trains and uh
you know being a hobo man
all the Mainer Master thing I don't know
honestly Maine's probably better because
it's shorter how many times you got to
type master
uh
uh but like the way that that was like
pushed I don't know man
like Maine does actually make more sense
like I don't know whenever whenever the
default changes to main I'm not going to
put effort into change it back to master
I don't have a strong opinion either way
right like it's not like a
like like a wokey thing or a non-wokey
thing it's like
um on their master and slave cables well
the master and slaver used an IDE I mean
like master and slave are fine like
there's nothing wrong with that
terminology right I just don't really
understand why it's called the master
Branch actually doesn't make that much
sense
um
I don't know if I change it back to
master I'm probably like it's one of
those things that yeah maybe I was upset
about and like what this is such a
stupid thing to be upset about right
like why
who cares exactly
uh
but yes you can say master you could say
slave uh you could say retarded uh you
know you can say all these things uh and
it's fine
um
uh
uh the slave retard Branch yeah let's go
um
uh
all right all right we moved into moon
landing and spear how do we always end
up here how do we always end up talking
about these same stupid topics
I can say Hitler
I can I can guys I can
um
you know my take on Hitler you know my
take
if Hitler was a winner you know
differently about him we all might but I
Hitler was a loser killed himself in a
bunker after massively losing a war so
late bro like you know where's your
Hitler now
um you know
like you don't even have to go to any
like Hitler was a bad person kind of
thing like he was just a loser like he
lost the war
hey did he lose the war yes he lost the
fucking War he killed himself in a
bunker while his city was being
encroached from the Russians mostly
um
yeah he killed himself because he was
winning so no
oh I don't know the in Russia we call
him you're actually in Russia right now
I hear Putin's approval rating is
decently High I don't know if that's
true or not like
oh
it looks good
um
all right wow we were gonna stay on for
a little more questions Putin can set
his approval ready no but like Putin has
a real approval rating right and it's a
real question right like I don't know I
don't know what Putin's approval rating
is what I will say I I went to Russia
once and uh you know I will say this
about Russia let's stick to facts my
Visa was for eight days and it said
cities permitted to visit Moscow and I'm
like oh God okay fine and it took a lot
of paperwork to check into hotels
um but then I experience with China is
very different
um you hear about a communist country
where there's no Freedom or maybe not so
much anymore but I'm talking like you
know 15 years ago when I first went and
you show up in China and you're like
wait a second
the media completely lied to me about
this place right this place is actually
awesome
um and China has has declined a bit but
yeah
you heard from Russian friends it's 90
for Putin
uh yeah again and then also yes this is
what about China's ghost cities I've
been to some of them it's like wild no
no look I love like the Asian philosophy
I'm like
you see that field we're gonna build a
10-lane highway here
Bros why are you building a 10-lane
highway no one lives here they will
I like that I like that you know
um in America it's like the highway
project where we're going to add two
lanes to the Sixth Lane Highway
uh I'd say 70 support him yeah you know
look
um
I I would much rather have a world where
we have actually Sovereign countries
than where we have uh you know just a
just a one world order kind of thing
nothing scarier to me than than uh then
I like
good unified World Order
I mean there's not going to be a unified
world order that it doesn't make sense
right just in the same way there's not
going to be
in the same way there's not going to be
a uh
like a paper clipping AI
these things just
if you have a world order it's
eventually going to fragment right
there's never going to be one stable
world order or being stomped on your
face forever kind of thing it did
life finds a way
uh the solution's got a lot better in
China
turbo America is where it's at right now
no American culture is fucked
uh we financialized everything
I was um
I was looking at at Chris Dixon's uh
Wikipedia this morning you know just to
kind of see like what happened to all
the Fiji companies and like dude
dude that's just
like don't spack
you know
how brutal is that
I like elon's take on the on the Waf
he's like
I didn't go not because it's secretly
bureaucrats running secretly globalists
wanting everything with a master plan
actually just because it's boring as
fuck
um
do I think tick tock's a weapon against
the U.S do you think Facebook is a
weapon against Europe how about Google
do you think Google is a weapon against
the US
uh
at least there's no woke culture shit in
Russia yeah but could I like walk down
to the local store and get a burrito and
like it'd be good and reasonably priced
and
I don't know I remember the food being
really bad
um and then again to be fair I was in
Russia 10 years ago so maybe it's gotten
better
[Music]
um I'm gonna put your life saving into
shapeway stock apparently they have like
30 million in Revenue another market cap
is 28 million
it's like tempting
I got a couple million bucks
you're gonna do a hostile takeover to
shave place
um look at the market cap
um should we do a hostile takeover of
shapeways wow we have to fire a lot of
people
man I could turn this company into
something profitable
where's the shapeways headquarters
wait no no real talk if anyone out there
works for a private Equity Firm and
wants to fund me doing a a hostile
takeover of a leveraged buyout of of
shapewise I don't know how these things
work but
um put me in charge of shape race and I
will turn the company around
uh how does a company with 30 million
dollars a year 33 million dollars a year
in Revenue only have a 28 million dollar
market cap
right I can fix this
uh uh oh it's in Long Island City
wait
why do I have so many offices first
we're closing down all the offices
except a while
and then we're firing 70 of the people
and then we're going to make shapeways
profitable and then I'm going to pocket
the profits
I was gonna quit streaming but the views
the viewers are going up you guys are
liking this stuff
Shake Weights oh yeah that's how we do
it we don't we're not starting with them
we're not starting with the ICS we're
starting at the top right
um
cheaper food in Russia is insane trash
yeah
uh my plan is stream tomorrow wait we
should we should figure out uh
I'm checking my phone
let me see when burritos are are I think
they might close at two and then I
really gotta go
until 10.
happy hour
convince pie torch to buy shapeways for
you
uh
to an audio splitter it sounds like too
much effort guys
um
why don't I do a virtual reality town
hall because the metaverse is lame
and as long as meta like keeps like like
you stole hacker or now you're trying to
steal metaverse and you're making it
lame
we don't have a comma four
I wish we had a comma four we don't have
a comma four what chip am I going to use
I hate Qualcomm and I hate video
and it is too expensive and qualcomm's
too hard to work with
um oh the reality pod or whatever yeah
probably
yeah they lost come back right like
I don't know I hope Karma comes back to
comes back to that and like AGI is like
everyone's trying to do AGI no one knows
how to do it there's no there's no wins
in AGI in the next five years there's
actual wins in AR in the next five years
uh
do I plan on making my own chip no no
I really don't wanna
oh he doesn't know I compete Among Us VR
this is the graphics
this is the graphics
I shouldn't judge it based on the
graphics
[Music]
foreign
[Music]
[Music]
I'll fix the ship
all right imagine kind of liking this
foreign
[Music]
deck
yeah I love Alex is good
no I bought a steam bag I bought it
seemed like yesterday
uh uh I guess I'm hungry
last question make it a good one
did you decide what type of arm comma
body will use uh
uh no no we're a long way from arms
uh I'm going to eat a burrito
uh
uh when Moon never guys the future's
canceled haven't you heard they traded
away now I'll leave you guys with this
uh what was it it was in like um it was
an American spectator China versus U.S
capital markets
oh you know what it's called it's like
the value of nothing
ah the value of nothing Capital versus
growth oh yes American Affairs Journal
yes this uh everyone should read this
uh everyone should read this and this is
why we all got rugged and this is why uh
you know if China would accept me if
China decided like not to be racist and
be racist is dumb guys like well okay no
here's the truth about being racist
um if you have
if you have a homogeneous population it
is better right uh unlike these you know
what they might tell you in a
mckinsey-funded study about how
diversity improves things
um it largely doesn't right like like
the reason countries like uh Iceland
work as well as they do is because well
uh you know everyone's someone's cousin
in Iceland uh so so that that kind of uh
all all works and this is a truism right
and then you'll get countries like uh
like America or Brazil where you have a
ton of diversity no it's not to be said
that you can can't rule a country with
diversity but you need some access in
which everyone's the same and America
has done this with a civil religion
uh
but yeah so China unfortunately is
racist
um this is I think no surprise to to
anybody uh like you know this is on
Chinese is superior people uh it's what
they believe and like there's some you
know Japanese racist too it's not a bad
thing right like I really I don't say
that word with like the the charge
connotation it has uh you know here and
oh he's a racist you know like like a
Charged connotation it has here in
America like it's really you could make
a decision right like you can make a
decision to to be racist or not to be
racist and there are pros and cons to to
these decisions
um you know like if you kind of
subscribe to like a Libertarian uh
maximized Capital worldview uh where you
have like a strong civil religion racism
is kind of stupid
um it's kind of my take on it but uh so
China unfortunately won't let me in uh
in any like real meaningful way you used
to be able to move to China as a
foreigner used to interact better in
some ways but now it's become more uh so
China's not really an option for me
which is too bad because this is the
people who ever since the 80s have
scammed America out of trillions of
dollars
uh you know Outsource all our
manufacturing and like we're just kind
of fucked
um there's a chance for a Resurgence in
AI but
not the kind of way I see it going
uh I don't know it's just kind of
upsetting
um
is there a better country to live in I
mean maybe I gotta I gotta go back to
like like there's countries that I have
hopes for there are like multi-racial
countries I mean you need to be in a
multi book as a white guy I can't I'm
never going to be Chinese or Japanese
right
um you know then they have they have
like maybe a country like Malaysia
uh Malaysia is is is is is
multiracial is
uh you know probably I don't know
I've always I've always said Malaysia uh
yeah Hong Kong used to be a good place
so sad so sad that really made me sad
um
move back to Ukraine I don't know about
that uh I'm sorry are you crying uh even
before the war you know just the gdps
you can identify as Asian for some
reason
um I don't think that's gonna work uh
New Zealand has lost it oh these
countries yeah
so Canada
this place is way worse than America
um
moved to Russia
uh you know
[Music]
um but yeah uh you guys should read this
it's a great it's a great article the
value of nothing Capital versus growth
all right thanks for watching my stream
we did search today and then we went on
a long ramp uh leave comments in the
video and we'll answer
just me being schizophrenic in this
apartment
clown of dota welcome back thank you for
subscribing all right there really are
people out there
let's wait for a bunch of people to get
in here look i loaded the python
notebook already
i sold scala on my computer too i was
playing with some
synthesis tools uh
teach my friend came over she wanted
help with the math homework
yo what up yaz boss thank you for
hosting me yo we are back boys we are
back i said fuck it i'm not streaming in
2020. and then
well 2020 was this
and you know in the yeah
yeah so so we're back
and we're gonna do science today i think
we're gonna try we're gonna try to do
science all right who's who's excited
for science
um
85k thank you i'm loving all these
subscriptions i got to get my income
back up you know guys i'm broke i lost a
lot of money
i lost a lot of money
i didn't i didn't buy into the panic i
should have bought into the panic but
you know what they say get an early
garage getting like fucked and i got
fucked so
there's that
now man money's all stupid but you know
it's really stupid how much how many
trillions are they gonna print and hand
out to people
lots of trillions lots of trillions hand
the trillions out to everybody you get a
trillion you get a trillion
uh no actually no you have to actually
be a large corporation with lobbyists
i'm sorry you don't get a trillion i'm
sorry
yeah yeah
boeing needs to keep their doors open
guys we gotta save boeing
you know
oh we gotta save boeing everything does
it pull out all the stops man
no
no we don't we need to open source all
of boeing let everybody build the planes
what do you think
uh how about a tesla sentry mode for
crappy cars
wait redeem sent a message in sub only
mode
what's sub only
mode am i not a subscriber to my own
channel
i don't know
uh
eric htp
i don't know what that is
ah
if you want to send the link we're not
gonna play any on here because it sounds
a little you know
uh all right what do we got
no a tesla century what do you think we
do in this channel we do nothing we shit
talk while we click and type
quantum dota you're asking in the wrong
place you are a subscriber so i will
dignify it with a response oh we're in
sub only mode are we in sub only mode
okay we don't have to be in sub only
mode welcome everybody that was giving
us subs freedom i didn't even know we
were in sub only mode hello hello what's
up what's up yo i don't know wait i'm
gonna refresh this so i can actually get
a viewer account
do i play video games oh whoa
yeah yeah yeah thank you please
subscribe to my channel you know this is
the only way i switch streamers are
getting behind these in these tough
times
ah yeah no no no no we're coding today
we're coding today don't worry don't
worry we're coding
now we're gonna download a database and
then we're gonna code and we're going to
start with some tea you know i was
thinking about about light but
you know look look you guys i'm still
getting tea and quacky and i got some
pasta and some toilet paper around here
i don't know i don't know if it's as
fucked for all you as it is for us man
california's kind of fucked
but we're going to be drinking some tea
and we're going to be doing some
who's analysis right
all right we're doing bio today you know
because i'm bio
um
should have i called it we're gonna cure
the karana virus
uh no no no no we're not doing data
science we're not doing data science
don't worry
uh
no you don't have to stay at home guys
don't worry don't worry
don't worry they haven't deployed the
army yet you know when there's a guy
with an m16 in the street that's when
i'm gonna start to listen
because i don't have an m16
okay
so i discovered this cool website where
you could download the genome with the
coronavirus
we can zoom in a little bit too
yeah genbank look at this
all right so we can get all
the sign of an api
look at this you see this
this here
is the corona virus
only
oh it has eight at the end of it ah
all right
that's efficient code that's what i'm
saying right
um so i want to do i want to do a few
bits of data science on the coronavirus
uh
damn
all right
we got corona
now corona dot
ah
all right how do we do this um
i basically i only want the a's t's c's
and g's
uh we could do it with a filter we could
do it with a dot or place
um
okay fine corona equals corona
the corona is too long to type
we're just going to call it cc
we don't know what i'm talking about
cc cc equals uh
this isn't exactly what i want either
[Music]
um
i just want to get rid of all these
things
sorry i'm not
there's probably a faster way to do this
cc that replace ass quote
so welcome
to the coronavirus
genome
this is from the original sample in
wuhan we might be looking into
it's like a buffer overflow
learn the basic terms
all right
so this is um
well so first of all how many base pairs
is it
let's just google this number and see if
i got that right what happens when you
google this number what is a zip code
base
pairs oh yes
look at this everything the whole
internet's about this stuff now
um so i haven't taken a bio class in a
long time but we're going to see what we
can remember so
first off here's an interesting question
right what's the colonograph complexity
of coronavirus
how many bytes of information does it
contain
um can i use xz from python xe is much
well oh lcma
do i have lcma whatever we'll do this
later uh zlib dot compress
cc
now bytes like object is required not
string oh why do i use python why don't
i go back to python 2.
no attribute decode and code yeah there
we go okay
um
so how many this is remember you can
only upper bound column graph complexity
you can't lower bound column graph
complexity
go to solo alert or kodak what's is bio
python a thing
you guys teach me so much whoa
i don't know is any of this cool
it's like the api for biopython
all right so it's interesting that we
can upper bound the uh the the
um
[Music]
the coronavirus at eight kilobytes of
information and i suspect it's even
smaller than that uh so for reference
the smallest computer virus i know about
is sql slammer
um
let's see if i can find the packet
oh wow sql slammer oh this is this was
uh this was an efficient virus
uh it's only 370
uh 376
bytes and it probably compresses even
more
8k yeah
um
how long have i been programming for i'm
going to zoom out a little bit here so i
can actually see
kind of like make the chat bigger
i can collapse the chat
users in chat
nature yeah yo yo we hack in nature
yo that's we should name that we should
change the title
we do
coronavirus science aka hacking nature
yeah because that's what we're doing
um so you
know that's
um all right no i don't know let's uh
all right let's see if we can compress
it a little bit more i'm sure the
coronavirus isn't really this large
oh no i made my mouse really sensitive
oh shit how do i make it okay it's less
sensitive now no it's still insanely
sensitive oh i have to press down on
this okay now it's less sensitive cool
do i have lcma
cool i have lcma all right let me just
put another cell here so i don't keep
running into that cell
probably shouldn't put the coronavirus
on disk
all right but by the way uh
cost to synthesize
base
pairs
just just just
yeah yeah it's about 10 cents
um
so remember that you know okay yeah yeah
so like
that that's well within the range of a
hobbyist you know
uh now we're just we're just just
exploring man we're just exploring
we're gonna figure out like the strength
of its reading frames and stuff
um dna synthesis service
so like i wonder
can you can you like what if you upload
this to that
um
oh
oh god you got to go with the expensive
service if you want something this long
oh here we go okay well you pay more if
your price per base pair is uh
you guys do know you can do this right
i'm not like like spreading like secret
bioterrorist information am i
i'm just i'm just i'm just looking we're
just doing science we're just doing
science
uh no i mean this is one of the things
this is one of the things that scares me
you know
it really wouldn't be that hard
well that doesn't seem right
wow lzma makes it even smaller
can we get it under 8k
format xz
prefix equals none
for one shot compression use oh does
this work
sweet
does this function take any parameters
so you see why i'm interested in
compressing it right
um why do we want to know what the
compressed size is the compressed size
so there's this thing called karma graph
complexity
um it's like
it's it's a it's the short length of the
shortest computer program that produces
the object as output right um so
basically like how much information is
there
in in the coronavirus and it turns out
there's about 8.4 kilobytes
the rumor is the corona is the hiv
sequences inserted into another virus we
we can check that i don't think that's
true
it's the same thing as entropy yeah yeah
pretty much
i mean it congratulations measured in in
what is the unit of entropy i guess it's
the same yeah i guess it's yeah it's
really the same
yeah entropy is a number of bits but i
mean entropy
the difference is entropy usually refers
to randomness
um
all right all right all right i don't
want to hear any conspiracy theories
about you know china made it in a lab if
that's true we're going to get to the
bottom of it right now
as you know any good hacker would
definitely shove their handle in here
somewhere so uh let's take a look and
see if we can find anybody's handle uh
shoved in here okay
so i don't know what biopython is
um but we're gonna just google decoding
dna
into codons
yeah so there's like a
yeah here we go
this
this this this this
so the okay
for those of you that don't know well
we're in a really basic bio here you can
decode dna
using this
um
and these are the different codons and
they break down into basically these i
believe they're amino
acids is that right
yes
in transcription the dna sequence is
rewritten in rna so
there's no transcription because this is
a virus and it's rna don't okay if i'm
wrong about any of this stuff yell at me
you'll probably know more bio than me
but i think the virus is rna only so
we're just going to do translation we're
going to write some code to do
translation
so we'll say like def
uh translation
[Music]
now we need to put in these
codes
um
a
t
c
g what's up with the u's
why are there u's
oh it's a u because it's rna i think
but that's a scam then why do they tell
me the
the that this is
a's t c's and g so it's
this is rna though right
i don't know
i think that's what the difference is
right yeah
the u is an rna yes but we i think we
can just replace it with the t's right
so
let's make a
dictionary
u-u-u equals
oh no
okay
um
i don't know the amino acid let's let's
look up amino acids right we're learning
here
so i think there's like 20 of them
not 21
of the 21 amino acids there's nine that
humans can't synthesize and then you can
stick these all together into proteins
all right here we go oh this is nice 21
amino acids
um
good they all have letters
oh that's that's convenient
i've seen this before and then we can we
can check we can check our results with
uh
and thiamine's replaced with uracil and
rna see someone studied in bio it wasn't
me man
all right so we have all these letters
we just need to figure out which letters
correspond to which dna sequences yo how
sick is it that you can decode nature
like this this isn't even that hard man
this isn't even that hard and then okay
so then first we're gonna do the
translation and then we're gonna get the
amino acids and then we're gonna try to
fold the protein
yo i took organic chemistry in uh in
college really just because i wanted to
learn to make drugs i'm not going to lie
i want to learn to make drugs
and you don't learn that you learn to
memorize a lot of names and it was
really stupid and then i dropped the
class
because they didn't tell you how to make
drugs i mean they didn't like like you
didn't get to play with anything you
know when you read like these like
recipes and like like you know arrowed
and stuff you want to know how to follow
them and i'm like i don't know ma'am
just do a simple acid base extraction
what the hell is an acid base extraction
right
you learn to make aspirin in first year
orgo wait aspen's like really
complicated isn't it
oh no never mind it's dead simple wow i
don't know so simple of us
um
cocaine is complicated
you know
look at all that look at that making
cocaine looks hard
my gpa was 2.78 in high school real talk
okay um can i just get this in something
i can copy and paste because i'm a
slacker
uh
yeah yeah yeah oh perfect oh yeah and
now we're talking
wait this still looks complicated here
we go oh look they even have the letters
for me
inverse table for the genetic code
oh no
the dna codon table
compressed using iupac notation those
are the fuckers who did the orgo
um
or
wait okay i don't really care about what
it is compressed we don't need that
we have args
what is a semicolon oh those are part of
it so
we don't need that we don't need that we
don't need
why is it compressed
gay
asn or asp
um slash b
gao
those are all rays
where's gao oh that's gat because okay
fine
yeah we'll deal with that we'll deal
with that
all right this is still a whole lot
better than typing them all
uh i see so they just they synthesize it
okay
you don't need sar
why is that different oh is that like a
tab or something
ggn don't care ua y don't care cac
val
start is og
and stop is all this stuff okay cool
okay
let's just parse that table out
um
well okay we'll just parse the table
uh
we'll call this tt yeah i love naming my
variables right
um i don't know what is this
this is a tab
i think there's a tab
uh
tt dot split tab is ox
all right that's good
all right so first we'll say four t and
t t dot split new line
t got split line
what
told you to split based on new one oh
oops
there we go
okay um
this looks pretty good
okay we're gonna separate this into
kv
and we're going to say
if slash in okay
k dot split slash sub minus one dot
strip
okay
yes okay good
okay cool
too many values to unpack expected two
above h
doesn't v have it too
oh this kept a gun there
gotta get rid of gun
yeah gun control yeah right there but i
got it
all right good
um
now they're sticking home can we get
more of this no no no no guys
guys
there's no plan yet
you know if you're new to my stream you
think that we do stuff on this stream if
you're old to my stream you know that we
actually just shit talk and do nothing
right but while actually doing stuff
it's weird
um but it takes a bit to get used to
uh okay
let's just say
uh v equals v dot replace
we're writing our own dna decoder you
know
you ever written a decoder for like x86
assembly it's like that but for dna man
no
all right sweet
so these things decode to those things
now let's see did they usually start and
stop are kind of stupid they not have
better names for these
we'll look at the uh
translation
yeah okay we're going to figure out
where the proteins are we're going to
break it all down
can we get more anti-state rams not we
love this state we're all good citizens
of the government right now
and when they come with the m16s they
can know that i like them you know i'm
their friend i'm friends of the state
that's right that's right um
all right uh i think actually before we
do that we're just gonna say
dot lower dot replace
you
with t
because we're
for some reason dna okay cool
um
four bb
equals that
dex sub vv equals k
okay now we have our stuff to decode dna
with um
what if they give start and stop letters
you know the fridge is empty but you
check anyway no i was thinking about ice
cream but i realized i've been eating a
lot ice cream today those pickings are
slim at the store you know how we used
to eat pasta that was a luxury no longer
affordable to us yeah man how much of
computers is just parsing crap okay
let's parse the coronavirus four
i in range
one
length cc three
uh
dex sub cc
uh i i plus three
key error a a
oh we got to the end
we made it all the way
all right sweet that means they all
decoded
i don't know maybe they always all
decode
uh all right we'll just call this a a
because it's an amino acid chain a a
dot append
deck
all right
okay well
so now you're gonna get into stuff
called reading frames now there's
actually three reading frames does
everyone know that so reading frame who
knows why because it's three right who
gets it yeah yeah you get it all right
cool let's go so this is all the
proteins
that the virus can possibly express
let's just throw a
join a a in there
and let's see if we did the decoding
right okay so now when i look for the
translation of this
it's not in my shit and i probably did
it wrong
here's our mezz
there's no mezz
i don't know what mezz is maybe you guys
is it not an m
matte
glue
oh there's no oh no sarah it's an s
i don't know we decoded all three
reading frames
met
met is the start codon no it's not
i don't know let's try just like one of
these sequences and see if i can find it
hmm
you guys
what if we uncover some crazy shit right
now what if we uncover that they're
lying to us about the translation
met is the start codon
oh med is the start codon
oh shit you're right
you're right oh you go
yo
yo you're a bro
you're a bro
yo okay wait you're telling me there's a
uaa somewhere here or is the stop code
on something else as well
no that's such a scam because met is
both here and in start
oh we didn't think about that oh
if
vv and deck print dupe
vv
oh there's duplicates oh
wait no this sucks
if i have an aau how do i know if i'm
getting an asin or nasp
nature sucks man
why would they do this
this is the shittiest encoding i've ever
seen
nature is troll
gay
all right
wait
wait whoa wait
this is just stupid
they have as in
and then they have asp
and then why do they have as in or asp
oh i don't know whatever this one can go
glen or glue can go why would they do
this they have glenn glue and then glen
or glue
well i'm never using that one
the start codon is stupid too because
it's just a matte
now oh yeah
oh yeah
it's decoding
let's see if there are any more dupes
uh why okay there's actually lots of
dupes right now
but that's just because no watch oh no
there's no groups that's fine
okay cool
let's see this is quality this is
quality science boys it's quality
science
all right let's go
jared you're new around here
there's no point man
you know all right
oh
stop oh that's just cause i put a stop
that way could the stop be called
something else let's see if they call it
something else here
or you know what i can just do a a dot
split on stop
oh yeah
wow there's a lot of stops
it probably prevents stupid crap from
being copied damn nature's smart man
look at these big ass proteins i'm
finding
okay no no but
oh yeah
yeah i mean okay i don't know i got a
mezz in here somewhere
t-p-a-a-r-v-l
all right all right
f-l-n-r-v
um hmm
it's so close
we're so close look i found this sick
asp arp
vp okay let's replace stop with
dollar sign
what do y'all think of that
oh look
man join i don't know what that means
five prime utr oh this is pretty cool
um let's do
k dot replace
stop
with dollar sign now that looks too much
like s what else can we use redial
that's a good one
yeah redial sorry about you pound
selling people
i call it redial all right let's go
let's go let's go wait what what is this
oh k equals k now replace that yeah
no no no no no we're not trying to
synthesize anything we're trying to hack
it man
we're trying to find the exploit you
know you think there's an exploit who
thinks there's an exploit
um i want to sort these by length
written house we don't talk about comedy
i in this stream
this is not oh yeah good look look
look
my shit decoded the same as their shit
almost there's bugs in mine let's figure
out where those bugs are
eq
lk
do we have this line
we have this line do we have this line
we have this line do we have this line
we have this line oh we probably have
all the lines we probably just don't
have uh okay
cool
all right look we found this big chunk
of dna what is it
it's a ribosomal slippage
it's an orflab poly protein interesting
liter protein or fla poly protein i say
do we have this one
oh it's part of this one too
ah okay okay i see i see i see we should
also probably split on m's
well
wait so you're telling me all this shit
is really just one
uh okay no
filter
uh
lambda x len of x you know it's like you
ever use strings this is just like using
strings but you set the n to uh
to 20 you know
now let's set it even higher let's only
find big proteins
oh god we got proteins
we got proteins um
spike glycoprotein produced who figured
all this shit out man
this is pretty brilliant
you know
these people are the og reverse
engineers man
they were reverse engineering before
computers
what are all the letters well into the
language
um
so
biology is kind of like a uh like a cad
program
right
so
and dna is like it's on disk storage
format
and then it goes through this process
called its
transcription
what's the central it's called the
central dogma of molecular bio or
something
yeah here we go
describes the two-step process
transcription and translation but i'm
pretty sure
i'm gonna get news i hate news news is
disgusting guys don't read news
it's rna right here we go
it has a positive sense single stranded
rna virus
what does positive sense mean
may be directly translated into viral
proteins
yeah central dog we have dna and rna go
backwards you can't turn proteins back
into rna but you get some of that
reverse transcriptase man
that's what gives you like aids and
herpes and shit i think right do i enjoy
nobody
i want to eat something
but
all the good food's been eaten a long
time ago
we're we're we're on low here we're on
low and everything that's good
we have a bread
oh everything's like sweet and
disgusting
i should have bought some more
vegetables you know
we have bud light
we have sweet potatoes which literally
have sweetened the name
oh those lines oh we have limes
all right now we're talking
that's edible
where's my knife
oh i made a delicious steak
monday night
oh okay that's a lot this girl came over
and she cooked delicious steak for me i
was so happy all right
all right we got limes
this is this this is what you eat when
you're in quarantine
yeah man manufacturing consent yeah i
know my chomsky's
you can figure out this rna sequence
from a protein though right
well
i don't know
actually don't know if you can
all right
so these are the proteins
do i have this one
oh membrane glycoprotein
oh yeah look at that we got that whole
protein there
we love lime lime is delicious okay
structural protein membrane glycoprotein
all right now it's time to do some
reading um
oh negative sense oh i understand it's a
okay okay so it works in like the normal
reading frame
oh that's cool
yeah dated this girl she knew everything
about biology
virus uses positive sense
sense or polarity
yo now you know what we could do
all right so now that we have all of
these
wait is met
the start is met
oh i think yeah like that's the amino
acid that like doesn't attach to the
others or something
yeah so these are the these are the
amino acids in nature
um we could figure out how to stick them
together and then try to fold them
but yeah this is kind of where you get
you know this is one of the problems
with bio it's like this isn't code
um
there's no way why is this the first one
can i stick things after and before that
or because of the sulfate you know what
there's probably a whole wikipedia page
on methionine it's like hermes you know
it's like hermione
uh hermione meth miney
one of the only software proteinogenic
oh they're used to make proteins are all
of them proteinogenic
how many do we have
that's a question we can just ask
by saying
len deck
oh no wait 64. oh that means that every
single one of these decodes
now that's actually not the question i
want to ask i want to ask
uh
lens set deck values
and that includes stop
so i'm interested they said there were
21 amino acids 1 2 3 4 5 6 7 8 9 10 11
12 13 14 15 16 17 18 19 20 21
oh
no there's tryptophan which one of these
is not here then
which which amino acids not used in a
protein
ah the 20 of the standard code plus
celestio xylene
oh we don't have any chalesh to
sushileen
oh celino proteins wow you can really
they really
named everything something here
is any protein this is wow
there's like a whole world of stuff i
just don't know
um
that's just decoding everything in every
reading frame
wow that's a big protein
ah we have that whole protein
the orfla poly protein
if i google this does it tell me
something oh that's a good product well
i'll buy an ortho poly protein oh here
we go
wait
look look at that though it's it's from
sars cove
it's not from sourskov2
is it uses the same protein
nature reused code
google's trying to be news
oh
interesting
nature knows about stack overflow real
talk
oh
look we can see it
oh yeah pretty cool man
nice 3d model
all right
we have an ortho poly protein
what are matte peptides
so
i think bio is like it also like uses
different reading frames
okay that's the orthlag polyprotein i
don't know why this like dot is there
because it's like a join but that seems
all right well let's just see if like
their numbers match mine
um
let's just write a function called
uh death
decode
take in x
ah
that should actually be minus two there
and
we'll
okay
zero len
x minus 2 x there
turn
a a and now we can say you know we'll
just we'll decode the three reading
frames
uh decode uh
reading frame one
reading between zero
reading frame one
you know x86 code is reading frames too
all
right so let's see if we get the same
results
as these
boys no
don't tell me they're little fuckers and
they start with one
no
gene
okay
minus one
it doesn't make sense
oh
no it does make sense because they stuck
lua fuckers
they're probably what inclusives as well
are they inclusives
wait what i don't want teas when did i
get t's
there's some weird break
because that now matches
why are we getting all them stop codons
i was just trying to decode the one gene
you know
oh
i see
that's weird
why are they both orflo poly
oh this is an orf lab product is an
orphele polyprotein this is an orf lab2
i don't know bio doesn't make sense
why don't they name these things like
computer people
and things that make sense oh look at
that
oh we got a stop codon right there got a
start codon all right this seems like
the main protein this is an off ortho
poly protein and this is the protein id
oh that's nice
oh see this one comes from sars2 but
sars1 has an
protein too
[Music]
now the truth is man
you want to talk about how kame i skirts
regulations we don't talk about comedy
eye but like we kind of don't like ai
actually operates completely within the
law
we don't even piss people off you know
we talk to regulators it's like pretty
fine
on on the whole comma probably is a net
safety benefit
buyer
see
the car companies make money by selling
cars man
if you disrupt biology
there's a whole scam like like
you know how i say self-driving cars are
a scam
like those companies at least like you
know
are trying
the medical companies
and not to say there are great people
doing bio research this genius is doing
this
but like you know with insulin in
america 600
someone's scamming man someone's
scamming real hard
let me explain to you how you know
something's a scam this is one of my
favorite graphs consumer
prices over
time have ever done this
um
now there's the one i really like ah
this one yes yes so
basically here's the quickest way to
tell how much of a scam something is
you look at this chart right
1998 everyone remembers 1998 right like
that wasn't that long ago back here
you know what's really not a scam
televisions
televisions now
[Laughter]
televisions everyone knows is not a scam
because you can spend like i bought my
tv was 200 was 150
it's like 42 inches it has built-in roku
tv it's sick
look where the scams are
hospital services
i mean like they correspond with what
you know is a scam right like you know
or health insurance oh we need universal
health care no no no no regardless of
whether we need universal health care
why the fuck does it cost 230 percent
more for hospital services now than 1998
it hasn't even gotten better medical
care hasn't even gotten better
in the last 20 years but you know what
has gotten better televisions
and toys and software man like people
make jokes about oh yeah software gets
worse software gets worse until you try
to use some software from 1998 you're
like holy shit this is terrible
wireless telephone services i got like
like i got like 5g everywhere man and i
pay nothing for it it's sick
all right
and then you get to like close furniture
and cars
they've gotten better too even though
it's zero they've gotten better because
remember there's inflation right
like
furniture man you can order some sick
beds off of amazon for nothing clothes
have gotten great all the high-end
brands make street wear
cars have gotten way better do you think
modern cars break they just don't
like like if you buy like a 20 20 toyota
corolla that car is never gonna break
all right and then you get to the things
that are like okay housing people
complain a little bit about housing okay
food and beverages no one complains that
much you know that's all right it's all
right because you know earnings outstrip
those and now you get into the two
things that everyone in america
complains about and maybe this is just
an america problem they're like health
insurance is so expensive and college is
so expensive we need the government to
pay for them no
you need the people who make televisions
to start making college
shit man if samsung made college that
shit would get bigger and thinner and
better and cheaper every year but no
it's made by scammers and you can just
tell you can just tell let's see who's
the president of harvard right
all right you're here you want my
anti-government rants here's my
anti-government rants look at this
fucking guy right like i don't even know
who he is but like you know he's not
like you know look at him
right look at him now let's look at the
president of samsung
right look at this guy man
who's the scammer right
you can just tell you can just instantly
tap look at this guy he's holding up
some sick ass flat phones and this guy
sticks his logo everywhere and puts his
hand in the air like he's preaching you
know
i didn't even know i didn't even know i
just knew it was gonna come out that way
man look at this you see that guy man if
only that guy ran harvard i bet you
harvard would be awesome but no no he
doesn't run harvard this fucking guy
runs harvard right
okay okay no but that's true man
it's so true and that's why these things
are a scam right so like you know if you
talk about common you talk about
disrupting these people like they're
really not scamming you like the reason
toyota sucks at making uh like cruise
control and lane keep assist system is
just because of how they're structured
it's not because they're scamming you
right like those cars are really worth
their money i would recommend a new
corolla or a new civic to anybody
you know and people can even complain oh
gm and ford they're not bad
they're not great but they're not bad
right they're nothing like these people
all right that's that rant
and you know what spread it to your
friends the last thing we need is uh
free health care and free college
because all that is people you know i
don't understand how the same people
complain about income inequality and
then demand free college and free health
care you're just giving more of your
money to these folks you know
how about no one's demanding universal
tvs
you know
no one's demanded universal tvs
we need universal televisions yeah
because if televisions were up here
people would
the andrew yang man i think my thousand
bucks go buy a tv but you know what kind
of sick ass tv you can buy with a
thousand bucks about the sickest tv ever
all right back to back to disrupting
i coronado my hands a lot more these
days guys i do it like 20 seconds
i watch some video about how to wash
your hands
oh all right
all right freedom memes
[Laughter]
all right so this is the protein we have
now
yeah and fav
ngn faf perfect
but there's also an ortho poly protein
for the other one
oh there's
there's cool ways to do like distances
you know
they give them all these names and stuff
just wanna have a yp
oh here we go
look it's almost the same
fasta
oh yeah perfect
i gotta name it stars v1 hang on give me
a second
actually am i even looking at the right
protein is the orphan poly protein
important i mean it looks big so you
would assume that when they put lots of
code it's important you know
it's really close
what's the edit distance
look i'm not talking about whether
health care is is you know what i don't
know i'm not a politician man i don't
have any political ideas i just know
someone's scamming man i just know
someone's scamming so guys instead of
paying for your health insurance buy big
tvs because they're not a scam
don't ever ask what who asked something
oh no no yeah we don't talk about the
keyboard no i don't know we don't where
am i when i oh no did i put my window
somewhere
my window went away did i close it you
guys probably saw what happened to my
window where'd it go
we'll open the window again
the window is back let's make sure we
still have stars v1 oh good we have
stars of v1 okay good
okay
um
how close is sars v2 to sars v1
well first off let's actually
oops
okay they're almost the same length
the thigh really does reuse a lot of
color
all right so we still have that's about
about half the code is for the orfa poly
protein
there's also a spike glycoprotein
gene synonym i should probably stick
with the
product
orf 1a b
oh
function catalytic activity
wait don't isn't that like the krebs
cycle
uh do i think i'll get the virus i don't
know
probably not
if you asked me to predict 5050 i'd bet
against it
um i know people are saying everyone's
going to get it
i don't know
okay there's also a spike glycoprotein
and it seems to be
looks like we can decode and get that
yeah okay cool so that matches that
um what else do we have that has code in
it
and there's a little bit of code in the
nucleo
capsid protein
not much and then like little bits of
junk
this thing's mad simple
it's falling at home trying to fold
these
it's a virus it's tiny just a capsid and
some rna see i don't know what a capsid
is
this this is
this is
protein shallow virus all right so it
has a capsid
and it doesn't seem to have a capsid
which one of these is the capsid
protein casing that has the rna in it
i mean is it like a good 3d model of
this thing
this is just pictures
all right then i know it it it binds to
ace two
i've seen these before too
so what's on your x chromosome
that's cool
that might that might explain why women
uh
wait is this coronavirus entry point
thing is this
if i go back in history
hmm okay interesting this thing is just
famous for being a part of coronavirus
it cleaves the peptide
angiotensin ii
wow
that's it
it's just that many amino acids
oh
i could build this and sell this sounds
pleasant
you come from 2030 you have vaccine can
you post i will synthesize think about
it we'll just go to we'll go we'll
think about it
if i could just write the right like
8k of code
like i'd have to write literally eight
kilobytes i could make a corona virus
that has no symptoms
but is incredibly virulent and triggers
the same immunity i mean it's
effectively a vaccine but see that's you
see that's the kind of vaccine you know
you can make a vaccine that just spreads
right
free shit for everybody i saw that in
season four episode four of reboot
but the problem is this code's really
hard to write like it's deceptively
small and simple but like protein
folding is still an unsolved problem
deep mind's been making some progress
with it
but like you just don't know you just
don't know how much compute's really
needed to do this
all right well look this orflab poly
protein thing has to be important
because unlike you know unlike in code
where people write hundreds of megabytes
to include sparkle framework to do
updates
uh
it takes you know if they could make a
smaller virus it would just uh
you know can make more copies of itself
more cheaply so code's expensive for
viruses
so this thing's got to be really uh
important
i'm still i'm still stuck on this thing
it is it's half the coat
what's a peptide oh yeah no well then
like okay amino acids become peptides
a tetrapeptide
oh yeah okay and there's the five end
and the three end yeah i kind of
remember this
don't you have to have 10 years of
testing before we ship i mean yes that's
that's kind of that's kind of yeah
that's what they say
amino acid peptide protein all right
that makes sense
um
peptine is a chain oh okay straighten
out protein that makes sense
all right then like matte peptide
so yeah cool they're breaking it down
into peptides right this is really like
you can you know just like function this
is like well so you have you have like
you know you have like your bites and
then you have your assembly code your
bites are like your your dnas your your
assembly code is like your your these
thingies your peptides will like your
basic blocks your protein to like your
functions
so cool man
so cool
is there like a good bio dip
i want a diff i really want to dip
coronavirus with sars
and then we can see
this is also like
strong
and weak codons
read about this
because there are like multiple codons
that code for each
some of these like
do better
bio python oh is there something for
this
sequence so oh look at this someone's
already written some code for me
nucleotide now there's transcription and
back transcription
it just changes the t's into use
translate
using nucleotide methods
to stop
hmm
this biopython thing doesn't look very
sophisticated
and because the next step is really hard
right like if you want to if you want to
decode this more
like great all right let's see i think a
spike like approaching like it's small
but going from that into something
is pretty difficult
let's see
protein structure
prediction
scam
this is tiny
what
oh my god
it's 820 bites i mean i guess that's
kind of a lot
i don't know like i guess that's the
same sounds like a function right
oh capsicums we learned about capsids
the or the orf9
that's another term for a mirror
oh
human herpes virus three
this protein clearly is not important
because nobody named it anything
structural protein e protein
nucleocapsid phosphoprotein
someone write like a good medium article
on this
uh
tars com2
our
jeans
breakdown
okay here we go yay wow that's so this
is a nice picture
what's an oh amino acids oh that's
beautiful
does this match the number we're seeing
i i got the length of that
let's print that again
so stars v2 should have a length of
4405. okay 44 6 because it will get rid
of the stop
um
we can say just dots
if it does end with a stop codon we can
just
well you know what we can do
uh force
stop equals false
stop
uh cert a a minus one equals equals
no you know what it's not called decode
we should use the real name
central
biopython named it the right thing
a mole bio it's called
transcription translation
we should call it translate
wow this is quality code man this is
quality code
yeah should we write tests who wants the
right tests
all right so where were we we're on the
cob wikipedia
page it's the thing if you search for
coronavirus you get shipped if you
search for sars kav 2 you get things
that are slightly better
who's ever on chat is not paying
attention to the stream i'm on chat now
all right
so we also spend a lot of money on this
orf 1a
it's the length of the spike
glycoprotein
that's s
i don't know why it's different
did i use the same
i might not have started with the same
thing in genbank did i
woohon who won
it seems right
the reference sequence is identical okay
i don't know why my s is the wrong
but okay they spent a lot of code on
this orf1a as well
oh that's orf one a and b is the ic
the orifon a polyprotein but where is
orf1b
okay this okay i see
this has a different reading frame
morph one b
equals
uh oh we're also gonna say assert
uh a sub zero equals m
should be fine yeah uh
we'll say
protein
all right because it's a whole protein
it has a
a start and an end that makes sense
right
okay
um
let's see if we can decode this or f1b
so yeah i think it's just in a different
uh reading frame
hmm
weird
weird
fab fln see that's not right
where is this
well that's just the waffle poly protein
but hmm
okay
seems okay
oh look look look
this number is different from this
number
yeah you see look this overlap
look at that see what what what hacking
skill you know
they overlapped the code a little bit
oh look at that that's really cute
ah look they use a star
we should use a star that seems better
why are they getting multiple m's
they're getting ttg as an m
ctg and atg and i just got atg
where's uug
they're getting uug as a
as a lu
rs don't have these problems right
oh man
look at this
there's different texts on there's
different processors which
do the uh separate things a little bit
you know all right
wait so we got to get down to the root
of what this other polyprotein someone
was someone was telling me what this
protein does there was something
somewhere that like had like a
description
i'm not sure if i believe it but
this
let's go back to that picture i like
that picture the one on wikipedia
this is like a nice visual layout of the
code i mean we really need kira for bio
you know where's kira at
oh you could build some sick tools for
this
i think we learned from now it didn't
come from bat soup
um
[Music]
i think it did come from bats but i
think there was a there was an animal in
between
i don't know
i don't think we know yet
okay it catalyzes
atp
plus
water
into adp
why does our body fall for this shit you
know
this is human coronavirus hku1 is this
the other human coronavirus
it must be
this is the wrong protein
oh yeah now i want to date with this
other girl she explained to me i'm like
you know the krebs cycle she's like yeah
how do you not
i was like no i don't wait atp no no i
don't know what is this
um
is atp to adp isn't this like the body's
fuel source i don't know what it does
with all that phosphate
catalyzes this reaction okay
well the virus is sure spending a lot of
its code doing this so this must be
really important to it
and then this we have the spike
glycoprotein and then we have a bunch of
like tiny little functions
you know this is really like this really
looks like a computer program you know
you have like big function other
function maybe m is like main
you know
i really like this picture
all right
the spike is the key all right all right
the spike glycoprotein you're telling me
this is the key
this is how like it attaches to the ace
inhibitors or something
also use uh
does it also use atp
or does it use ace
the primary human receptor of the virus
is this
so this is the thing the viruses are
scamming
it's a single pass type one membrane
proton
hmm
i haven't heard of these but i've got a
lot of old people are on them
yeah ace inhibitors
have high blood pressure
there's also arb what's arp
never sub never donated stolen laptop
neighbors wifi
all right
this code
both of them just catalyze a reaction
and then viruses trick your body into
replicating it
but doesn't your body replicate dna
like how do viruses replicate
can be directly translated into protein
in the host cell that's fine
but how does it replicate
i know they hijack your bodily systems
no no
look i know that right like i know it
doesn't have i know if i look through
this thing i'm not going to find the uh
the replication code anywhere i know
that it's hijacking stuff in my body
but
my question
is how is it
like what my body is replicating rna
nothing
you know but like really like viruses
you know they're clever they're called
into all the subroutines all over my
body
you know right why would i want to write
the replication if i could just make a
function call
coronavirus spikes consist of two
connected halves
spike activates
well
the yeah yeah dna rna protein yes i
understand i understand in my body that
it uses the rna to protein from my body
but why is my body replicating rna
can be translated into protein in the
host cell
yeah but how do you get more of it
like i know that so there's reverse
transcriptase
and this is what like we block to block
hiv why doesn't this block all viruses
watch this guy's video on coronavirus is
this scientific or is this some like
you're gonna die shit
no i don't care if it's what you should
do unless
what detail does it go into
okay okay all right should we have a
joint
it's victims membranes all right
watching party in 2019 the chinese
authorities notified the world that a
virus was spreading through their
communities okay don't care
it's pretty don't care about the news
don't care
this virus is the severe acute
respiratory syndrome-related coronavirus
ii that causes the disease called
cobit-19 and that everyone simply calls
coronavirus
what actually happens when it infects a
human and what should we all do
[Music]
use allen j to skip virus is really just
a hull around genetic material and a few
proteins
lipid envelope rna spike protein oh damn
look at that code reuse
look at that code reuse the spike
glycoproteins being stuck everywhere you
see this
that shit turns into that
yo that's crazy
you're touching your face
it could only make more of itself by
entering the living cell
corona may spread fire surfaces but it's
still uncertain how long it can survive
on them
its main way of spreading seems to be
dropping infection when people cough
wait
viruses don't survive
they might no longer be viable but don't
use the word survive you touch someone
who's ill and then your face say rubbing
your eyes or nose okay don't touch my
face
as a stowaway deeper into the body
its destinations are the intestines the
spleen or the lungs where it can have
the most dramatic effect i am just
really curious sorry about the add what
is trending right now
the most boring things you can believe
what's
yo i'll believe in my thousand dollar
check when i get a thousand dollar check
right now
i ain't seen shit
are they gonna send a guy to give me
that check
and is it gonna come with an m16 that's
my only question
if it's a guy with an m16
they can keep their check
all right
even just a few coronaviruses can cause
quite a dramatic situation
the lungs are lined with billions of
epithelial cells these are the border
cells of your body lining your organs
and mucosa wait to be infected
corona connects to a specific receptor
on its victims membranes to inject its
genetic material
the cell ignorant of what's happening
executes the new instructions which are
pretty simple copy and reassemble
where okay
okay okay where are those instructions
where
direct deposit they gonna put that shit
in my bank account the original virus
until it reaches a critical point and
receives one final order self-destruct
the cell sort of melts away releasing
new corona particles ready to attack
more cells
the number of infected cells grows
exponentially after about 10 days
millions of body cells are wait can we
just talk for a second how there's more
copies of this code out there than like
your own immune system
the immune system while there to protect
you can actually be pretty dangerous to
yourself and needs tight regulation and
as immune cells pour into the lungs to
fight the virus corona infects some of
them and creates confusion
cells have neither ears nor eyes they
communicate mostly via tiny information
proteins called cytokites nearly every
important immune reaction is controlled
by them
corona course this shit's like a huge
gang it's crazy
in a sense it puts the immune system
into a fighting frenzy and sends way
more soldiers than it should wasting its
resources and causing damage
two kinds of cells in particular wreak
havoc
first neutrophils which are great at
killing stuff including ourselves
as they arrive in their thousands they
start pumping out enzymes that destroy
as many friends as enemies
the other important type of cells that
go into a frenzy are killer t cells
which usually order infected cells to
commit controlled suicide
confused as they are they start ordering
healthy cells to kill themselves too
the more and more immune cells arrive
the more damage they do and the more
healthy lung tissue they kill
this might get so bad that it can cause
permanent irreversible damage that leads
to lifelong disabilities
in most cases
system slowly regains control
it kills the infected cells
trying to infect new ones and cleans up
the backfield recovery begins the
majority of people infected by corona
will get through it with relatively mild
symptoms
but many cases become severe or even
critical
we don't know the percentage because not
all cases have been identified but it's
safe to say that there is a lot more
than with the flu
in more severe cases millions of
epithelial cells have died and with them
the lungs protective lining is gone
that means that the alveoli tiny air
sacs via which breathing occur
yeah okay i know this part the the part
that i don't know
cells have neither ears not importantly
but until it reaches a critter right
here
what's happening executes the new
instructions which are pretty simple
copy and reassemble
how does it yeah executes
victims membranes to inject its genetic
material okay
the
sure sure so you got this exploit you
got you got ace two it's vulnerable um
this shit shows up this spike shows up
which is basically just like the exploit
vector exploit vector comes in injects
its payload right it's all the same shit
it's really all the same shit you guys
you know you study computer security and
all this but now
the cell ignorant of what's happening
executes the new instructions executes
the instructions whatever i hijack eip i
jump to the virus stuff all great copy
and reassemble
it fills up with more and more copies of
the original environment but where is
that where is the copy function you know
also
yo i don't know how any of this shit can
work
search structure of virus
okay and then it uses reverse
transcriptase why the hell do i have
reverse transcriptase
i mean
is it using this
so i don't have hiv
i don't have leukemia and i don't have
this
dalton
so why do i have any reverse
transcriptase
there are little machines in your cells
that only make copies of rna what
the cells already have a copy function
no no the cells have a copy function
for dna
not for
ribosomes is this what it says ribosomes
i've heard this before
no no ribosomes
they do translation that's fine
there are cells constantly reading the
dna to make proteins okay rna-dependent
rna polymerase is this it
oh
okay okay
is this what it's using
you know i believe a lot more in the
information about sars than i do about
this new shit
meth head mic i think you might have got
it
coronavirus replication oh even better
ah
okay infection begins with the virus
spread glycoprotein all right so we
decoded the glycoprotein attaches to its
complementary host cell receptor which
is ace2
after attachment a protease of the host
cell cleaves and activates the receptor
attached spike protein
okay so there we go you know
let's put it into computer terms so
um
the glycoprotein
uh
does a heap overflow
and overflows the next sentence of malik
um after the next thing has been
overflowed a free
from the host program
uh
cleaves and activates the misaligned
pointer all right it's like you use
after free and it freezes it that's
great um
bring on the host cell
protein available cleavage
endocytosis
when entry to the host cell the virus
particle is unencoded the exploit
payload is unpacked
and
its
genome enters the instruction cache
um
and it's edits instruct and its code
enters the instruction cache
uh
the coronavirus rna genome
has a
push
eip at the beginning of the function and
a pop eip at the end of the function
which allows the virus to run without
disrupting anything else
okay
the
sequence is written in x86 which allows
it to yeah yeah yeah
uh translates the initial overlapping
open reading frame and forms a long poly
protein
that's this shit
this is the polyprotein right
yeah yeah or flop or flush the poly
protein i don't know what a poly protein
is that means it's got two two sheets
yeah it has two it has a one a and a one
b all right cool
has its own proteases which cleave the
poly protein into multiple
non-structural what
no but what that's not what it said it
did it said it did something stupid is
this thing lying to me
okay the polyprotein is very important
this is the unpacker for the thingy
maybe
um
yeah we'll share vaccines or subs if i
find a vaccine i'll share it with the
subs that's right so you better
subscribe
um
no it's like like it's just it's all the
same you know it's just okay not one of
the non-structured proteins coalesce to
form a blah blah blah
ah
the non-structural proteins coalesce
replicase
yes meth head mic was right
dork mode thank you for this link we
finally got some real information it's
not like a youtube video
um
i heard a good joke there was a
conference there's a dutch conference of
the world exploit the world experts and
coronaviruses but it was postponed
because of the coronavirus pandemic
all right um
wait we'll
okay yeah yeah this this we should read
this
with their s protein okay we got the s
protein chronoviruses bind on the cell
so far it's not clear whether the virus
gets involved cellulite fusion
coronaviruses have a
single positive strand that they can
produce in the cytoplasm
first the virus synthesize
its
rna polymerase
oh no
but let's read about this
so i assume i have this
polymerase
wait
what
wait a second
do i have this protein
without focusing on anything
you misunderstand
and we're asking questions
do i have this protein
oh my god
no that's what this shit is
that's exactly what this orpha prolly
protein is it is the copy mechanism
i i don't know i guess i just assumed
that
no it is
look
accepted name rna transcripted rna
polymerase
it does the same thing
nucleotides triphosphate atp is
adenosine triphosphate
plus phosphate
catalyzes rna
template directed
whoa
yo
that's sick man
this orpha polyprotein
is the copy mechanism
copy
spike and then reassemble with the
little shitty code okay it all makes
sense
all right
so it looks like this virus is spending
well i i mean it makes a lot of sense
that this virus is spending two-thirds
of its code
uh copying
i mean this is yeah yeah and this is
this is basically a minimum like rna
copy routine because i knew your body
didn't have rna copy routines
the spike glycoprotein this is this is
the this is the exploit
this is the payload and the payload
basically just says make a copy and
these are a few helper functions
yo
this is sick
this is so simple
you know what i mean geniuses must have
figured this out too
and like no like
like i look at this stuff and i have a
framework right
like i i have a framework i have a
framework with which to think about all
this right like you know you write
computer viruses you know how to do this
all these people i don't even think they
had those frameworks
like and then the question is
i mean
i you know i'm i've come into this world
really really late science you're all
science is all built on the shoulder
giants and stuff so like
i wonder if no but i think it's
fundamental like i think it's fairly
fundamental to how a virus would operate
because computer viruses have very
similar stuff
right they have an initial they have an
exploit and then they have a payload and
you know this
if you want payloads that are just going
to like you know rapidly copy themselves
most viruses have this some viruses have
more complicated payloads to do more
things
how do we put a mining payload to the
virus so we can farm crypto i agree
we're going to make coronavirus pay us
back you know
you know that's what we're going to do
that's going to be the golden stream you
know we lost all this money and it was
thanks to this shit like this this code
this code cost us you know that many
bajillions of dollars and we're going to
make it pass back we're going to have it
mine kirko for us
headers
tenders now there won't be any chicken
tenders later
but i want them so we're gonna do it you
know
gross
two chicken tenders
that's a pathetic amount of chicken
tenders
no
bgs
we will have chicken tenders
let's make some fries
and now we're out of chicken tenders so
tomorrow we might have to go brave the
store
already ate a pizza today you know
eventually we're gonna get into eating
flour can you eat flour
all right maybe it's time for a little
coffee
got it done with tea doesn't feel strong
enough we're gonna we're gonna solve
biology tonight
the song biology
now let's get some clean socks you know
that's what i really love right now a
fresh pair of socks
yeah that's some dobby shit you know
who gets my reference
all right ooh a fresh pair of socks oh
this is gonna be pleasant
i'm gonna put on these socks
we're gonna eat chicken tenders
who's speed runners
they eat flour
give me flour
i'm gonna google that as soon as i sit
down
i got some iced coffee
starbucks iced coffee dark roast
i'm gonna be up all night
all night
oh yeah
chronovirus hack speed run
nah man it's the first time i'm playing
the game
all right
so what do we have to do
[Laughter]
i mean you know what's crazy right yeah
any percent any percent you know it's
crazy
like you can take this you can modify it
and you can go like send it to a lab and
have it synthesized
like you know 10 grand
um
so i mean yeah we can like that's so i
mean yeah the code is all nice and safe
when it's in my computer here
but uh
not so easy why is it not so easy
dna
printing
rna printing service
well okay
base pair
let's see what we can get printed
this is all hypothetical don't actually
do any of this guys i'm not actually
gonna do it don't worry
oh my god
3d printers for dna
this is horrifying
laser-based technique
wait what
have this guy died
what if they don't tell you i usually
think it's suicide
sad
we use a laser-based technique to
synthesize dna
wow
yo because okay
we just gotta make the right mods we
gotta hit print
wait
okay like
for everybody who thinks kana ai is
scary
holy shit
that's scary
microarray dna it probably doesn't work
but you can okay there's definitely like
a dna synthesis service
and no one finds comedy that's not scary
and once you actually see what it is
it's not scary people think i'm like
sticking a phone in cars and like you
know that like say okay car go drive to
la right
um
now people a lot a lot of people don't
know like
you know
that you need a person in the driver's
seat it's actually a lot better to make
sure the person's actually in the
driver's seat um
well
we're not working on backspace right now
backspace is hard math is hard
oh view my discounted prices okay
so
if i buy some hypothetically if i buy
some dna
oh
free codon optimization you say
oh very interesting
optimized
let's jank three
okay so i understand that when i get my
printed dna it's not going to be
assembled into a little coronavirus
i'm not actually releasing a vaccine
guys don't worry i'm just i'm just i'm
just it's hypothetical okay
don't ever don't just just you know i'm
not a doctor
i'm not a doctor don't don't rely on me
for medical advice or anything important
or if
if you're taking my advice and you're
changing the way you live your life
you're probably an idiot
why can't i just use something like
crispr
well let's see
no
i don't have any dna here none of this
is dna
i mean
okay so i think what i would have to do
like how do i then inject my dna into
something
i can make rna into dna
yeah well okay so let's say i got a
let's say i got a coronavirus
synthesized in dna
right
then
i mean i'd need to put that dna in
something that would do
transcription
to turn it into rna
and then translation to turn that rna
into proteins and then again
it'd be in the wrong place right
wow but
i mean once you do it once right you
only have to do this once in a lab and
then you get it right and it replicates
forever
dna cloning and plasmid vectors
what are these things
plasmids are
a cloning vector
small piece of dna
i say
should i know what a plasmid is no that
wasn't that other thing that i was
looking at right
that i didn't know the name of it was
not a peptide
a genetic structure that can replicate
independent of chromosomes okay i
understand so it's like a chromosome
well i have a lot of tabs open
look up a youtube video on plasmid
vectors
we're back to video watching time
it's learning bio
this is a
what
what i have to pay an extra 100 and oh
my god they're already scamming me
we verify deposited plasmids
do you have a good video
cleaving enzyme if i need it what am i
doing with a cleaving enzyme do i need
one of these
a furan
wait i think coronavirus was using these
i think i heard about this
someone needs to make an extension which
removes unnecessary yeah yeah yeah the
hard part is figuring out which ones are
unnecessary a little dirk is definitely
unnecessary sorry little dirk um
what is crispr now we don't need crisper
we definitely don't need cocaine
um
we're done with protein structure
prediction
just have a human lung do the
transcription i mean
yeah so the problem
you can have a human lung do the
transcription if what you know but like
like i'm not gonna get it in in corona
virus form right i'd get it in i'd get
it in
uh
i don't even like no i guess they give
it to you in terms of a plasmid
am i going to regret this
mute rx what what should i listen to
yeah no i know about pcr
though this seems worth watching we'll
try that for later
um
what do we got here
[Music]
cells containing plasmids dna cloning is
a method for isolating a particular
sequence of dna from a complex mixture
of different dna sequences
a highly modified phage or plasmid that
can replicate in a host cell
generally a plasmid vector contains two
elements
a drug resistance gene which destroys
antibiotics in this case ampicillin to
allow selective growth of the host cell
and a replication origin to allow the
plasmid to replicate in the host cell
to insert foreign dna we must first use
a restriction enzyme to cleave the
vector of the cloning site
here eco r1 cleaves the panoramic
sequence gaa ttc to produce single
stranded ends called sticky ends
these can hybridize with any piece of
dna that has also been cut with eco r1
foreign dna containing the sequence we
wish to clone is digested with eco r1
and then mixed with the cleaved vector
the sticky ends of the foreign and
plasmid dna molecules hybridize and then
are sealed into phosphodiester linkages
by the enzyme dna ligase creating a
recombinant plasmid
all right so i got a lot of plasmids
that sounds nice each of these
recombinant plasmids contains the
inserted dna fragment and ampersand
virus really open source
a pool or library of circular
recombinant plasmids is thus creating
dna doesn't need a checksum
because it has so much redundancy in it
each plasmid carries a unique fragment
of foreign dna as indicated by the
colored arrows
next the host cells e coli bacteria are
added to the recombinant plasmids
the cells have been treated with calcium
chloride to make them permeable to dna
molecules
through a process called transformation
a few cells take up a recombinant
plasmid while most other cells do not
and then i put the antibiotics in and i
kill all the other cells
that sounds nice
the e coli replicate see this is why
biology sucks man
this is what sucks about you know you
can't just say like import lung you know
you gotta like touch a tube
if anyone ever was like you gotta touch
a tube
i don't do that i don't touch tubes
all right this is why biology sucks
cells are poured onto a plate of
nutrient agar mute rx cool ionic
ampicillin
with ampicillin in the ochre only cells
resistant to the drug can grow
yeah yeah that was good foreshadowing
when they put that in the in the plasmid
it's good foreshadowing
degrees the cells will grow and multiply
because they cannot move on the auger
each will produce a separate colony of
cells
all right
the non-transformed cells lack the
plasmid with the ampicillin yeah yeah
yeah yeah okay okay okay i'm i'm with
you so far
now i gotta get this into lung cells
i got to get this dna replicating inside
long cells
the replication origin allows the plants
plasmid replication is independent of
host cell division but plasmids are
distributed to each daughter cell when
the host cell divides
as the plasmids replicate and the host
cells multiply the number of copies of
the recombinant plasmid is greatly
amplified
the multiple daughter cells form a
colony or clone
because all the host cells in a colony
are derived from a single cell they all
contain ponies of the same recovery
plasmid which
variety of assay methods is now be used
on fact burial companies to determine
which contains dna sequences
yeah but
yeah again
all right great i have lots of copies of
my dna i got my bacteria copying my dna
that's great
but like
well
huh
actually
wouldn't the bacteria express the
proteins
yeah viral is different from bacteria
but no i'm saying like you make that dna
right so i mean the bacteria like e coli
is gonna have all the transcriptase
stuff
why not
lung cells are eukaryotic okay
yeah i know viruses can infect bacterias
exactly so basically i'm you know i'm
giving the e coli coronavirus right
oh god okay okay i should have started
all right all right they're different i
should have studied all right i should
have studied i'm sorry i slacked off in
bio
that uh prokaryote e coli is a
prokaryote not a eukaryote
proteobacteria
oh you have a grams thing yeah i heard
about this once
yeah okay okay i see how that works
you carry out
yeah okay
so it's gotta have a nucleus
and it's attaching to ace2 on the lung
cells
have i heard of sous vide what's that
i like cooking
wow
wow
that looks like a nice steak man it's
been a while since i've had a steak
you know
oh
salmon
mmm that sounds delicious but was this a
point
was the point or do you just want me to
look at pictures of food
all right
the prokaryotes and the eukaryotes are
all shit to deal with later
but i think we have the basics
understood
it injects with this thing all right
let's see if we can understand what some
of these other guys are doing some of
these other orfs
well i guess maybe what does orf stand
for
is is it all part of the
fucking pangolins man
it's these guys that's who gave us
coronavirus
thank you for subscribing
please
subscribe to my channel if you
appreciate this kind of content i'm
going to see how many subscribers we get
if we get a lot of subscribers i'm gonna
keep doing this we're gonna do more
coronavirus science tomorrow
i'm gonna make some real progress
um yo just imagine
just imagine
i just just just imagine you guys are
here when we solve it man you know it's
like when you're being in the channel
and someone does a speed run
and the speed runs are sick
uh yeah yeah you know i'll send you guys
the stl file for the vaccine
um
part of the reading thing is uh
yeah i know about this
see look they have like tools from like
like dot matrix printer error yeah let
me get out my epson
thank you for subscribing no no we're
not done
speed run on life
no but
no no no no no no no we're not getting
distracted anymore we're going to look a
little bit into whether we can
understand these orfs we're going to eat
some chicken tenders and then that's
going to be the end of this stream
let's go back to
here we go is this yeah
can we understand what these other orfs
are
structural protein
membrane glycoprotein
oh here we go
envelope protein
membrane glycoprotein
there's more orfs
does orb stand for something
oh open reading frame well that's what
you're trying to tell me oh okay
well that's stupid
why don't they give it a useful name
that's just calling it function yo
you guys know an ida when they just call
it's like function one
function and then the address
that's so stupid
no no no no but that can't that can't be
what orf means because how come when i
google this unless this is just the most
famous orf
why don't they name it something better
why don't they name it rdrp or something
why do they name it or they can't
possibly just mean open reading frame
that's so dumb
or if one a b poly protein that
basically just doesn't say anything
surface glycoprotein
what happened to spike
am i in a different
surface glycoprotein why did i call it i
called it spike didn't i
yeah it's a spike glycoprotein
are they calling it surface
no i i don't think it was a designer
virus right
is it was a designer virus like
unless you're also a light well okay so
you're saying someone took sars and
modified it like if you want to go with
that theory
at the wuhan institute of virology
wow
so level five
biohazard extraterrestrial materials
and that's a pretty odd coincidence
all right all right we're gonna dive
into a conspiracy theory for one minute
here
huh
and where's the
coronavirus wuhan
market
huh
well they're in a different district
let's see how far jingan is away from
jingxia
oh pretty far
okay
all right
we're not five blocks away that's a
conspiracy theory it seems like
how am i tender's doing
a prize might be ready
that's hot
so
no it's not suspicious people think oh
wuhan has a uh
what has an institute of biology it has
this market what is a city of 11 million
people i dated a girl from wuhan
yeah exactly every time a big city has a
research header
no it would just be suspicious if they
were around the block is all
no
no no that's
i'm not saying it's a conspiracy i'm not
saying it's like
deliberate
but it could have been an accident but
it doesn't seem like it
i
mean i guess like how would you tell
no i'm not saying i no one said purpose
it could have been an accidental escape
from a lab right
like a mistake
but no it doesn't chill
could a virus escape by accident yeah
sure
but
none of that none of that seems
plausible
no but even like
i don't know i mean it is odd that it's
yeah
biosafety level four but like
no i don't know that much about the
first sars outbreak
sibets it's always like some bullshit
animal you know
so
i'm not reading the news on on
conspiracy theories
well
so they say what changed is the spike
like cleaving the spike is what i read
so that spike glycoprotein is is
different in um let's get the sars
no i want
ah here we go
oh look it's like the wikipedia page
but for og stars
they're really very similar
let's see what the wenzel looks like
can i get that in here
no
i won't like this but fur
genome assembly
like holy shit this is just sars
i don't know maybe it all looks very
similar
there's so many subtypes
and there's a cleaner eye structure than
corona
wow there's a whole lot of flues
oh my god this one remember scaring us
about the swine flu
but this is sars
that is me too
what would you do we approved it
it's going to improve stocks
all right who thinks the tenders are red
how long did i cook them for
whew
they're hot
i regret touching that
two
beautiful
edible chicken tenders
no no i got sauce now i need sauce
well no they the death rate's lower they
had to make trade-offs you know
engineering is all about trade-offs
the flus work like this
it's just
there's just so many of these
you sauce
what's this
and you know what a lot of them do hit
your ride
yeah this thing looks nothing like the
flu
well hiv is a whole nother thing right
yeah no hiv is co hiv is long right
coronavirus more similar to hiv
machinery no way
hiv is a retrovirus
it's turning itself into dna
the law of equivalent exchange that's
right
holy shit it's just sars guys
coronavirus is too nice of a name
wow
oh
well now i understand why the chinese
reacted the way they did
it's always an open question right
all right
why do the chinese go into full insane
lockdown mode
because it's sars
well that's okay let's take a look at
how different it is
[Music]
um gh4 that isn't true
the fluke kills a whole lot of people
but
like i don't know where this myth came
from
this thing is just not a flu it's just
sars
let me get
all right let's let's take a look i mean
it's almost identical to this
uh let me just turn this into a function
well that's
let's see how much mutual information
they have
you can get like an edit distance
oh chicken time
[Music]
well no pneumonia is not anything
there is what do you mean a pneumonia
right my understanding is that pneumonia
is just uh
all right
okay so they are literally
they added a little bit more code to the
coronavirus
it's it's not a flu
i i don't know i mean i think that just
seems like a journal's journalism
damn if they just called it sars i would
have sold all my stocks
they called it a flu and the only thing
i remember was the 2009 swine flu which
everybody freaked out about that turned
out to be so stupid because it killed
nobody
man
like what was the death rate from swine
flu
like they freaked out endlessly
about swine flu and the death rate
oh my god no news
yeah a lot of people got it but the
death rate was yeah see
this is the whole thing
the deferred from swine flu was point
zero two percent
you know what
yeah but it's only because sars didn't
spread
they actually managed to contain sauce
well until now
um
oh guys this works
okay
so the edit distance is that
there's like nice uh
oh you can't i don't know i mean
the thing about the news is the news is
idiots like no matter what right
like there's a thing
as soon as you learn like if you know
something about any field you read the
articles
if you read the articles in that field
and you're like wow journalists are
idiots and then you read like an article
about politics you're like wow this
journalist is really intelligent but the
truth is they're all idiots
um
like the journalists have no idea at all
what they're talking about and that's
why you know you shouldn't read the news
it's it's just it's literally just yeah
it get galman amnesia is that it
um there is okay all right sorry i
shouldn't really hate on all
uh
on all journalism period journalism's
uncovered some great things
um usually longform.org is a bit better
uh sometimes they just write good
stories too right like there's
definitely value in like when someone
writes like a 10-page story like you
know i i i signed up for corporate
corrections as a as a as a prison guard
and here's what i discovered it's like
oh okay that's kind of interesting right
so i'm not talking about that as news
i'm talking about anything
if it ever says breaking news it's a
scam
well let's just call it sars v2
i mean this
just seems great
i've seen naked and afraid i mean look
you you have to know that it's an ad for
naked and afraid but like
oh wait was it galman amnesia
[Applause]
[Laughter]
[Music]
oh they know about pakistan
all right
i think it's bedtime
um
if y'all want to come back
uh
tomorrow
i think we're going to do some more
coronavirus science tomorrow
and we're going to be a little more
strict on the yup yup yup no no guys
guys guys guys guys no we're going to be
more strict on the moderating the chat i
don't give a shit what you call it it's
stupid
are we 3d printing tomorrow or maybe
maybe you think we're going to solve it
you think we're going to crack it
um
mute rex here you can be a mod
congrats
uh owning shoe i don't know mute rx
linked good stuff and that's why he gets
to be a mod
550 people time to stop streaming yeah i
don't know guys look i'm not trying to
subscribe and i'm more likely to stream
um
all right well you do you want to do q a
now what q a do you want
what q a we'll do we'll do
three minutes of q a what's my schedule
i don't have a streaming schedule
because the second you have a schedule
streaming owns you and you don't own
streaming did you figure anything out
today yeah i learned so much shit man i
learned that the coronavirus is just
sars
like really
um
how much of my stock prices drop only
because you're a subscriber
i mean like you know i lost a lot of
money
can you explain the government amnesia
effect google it basically
journalists are morons
um yeah yeah i discovered how great
that's true
opinion of martin shkreli
oh you know people always ask me shit
like that
uh
i think that uh
that we should hang out and smoke some
weed and listen to the carter five
the oil thing i don't know it's some
vague thing between opec and russia
you're trying to learn coding
i don't know man
do a pro like you can't like
like like imagine you came on here and
said i'm trying to learn spanish what
should i do
i don't know go to fucking spain or
argentina or something and just talk to
people
you want to code like you know go
somewhere where people are
i shouldn't say this don't talk to
people just code go somewhere where
there's code and talk to code
aws is giving 20 million for corona
research
can i get money
i'm doing corona research
oh i got to make an organization never
mind that's too much effort
someone said d is for december
do i actually believe we're in a
simulation ah yeah probably
uh use sagemaker what's sagemaker
is this
is this some bioshit or we only do bio
now when you buy them
oh
i don't know about this this looks
stupid
you guys hiring it come ai yes if you
want a job at com ai this is the one
time we're gonna show for it
go to common ai and click we're hiring
and we have a whole list of jobs for you
guys
um do i think that i can beat you with
smash bros smash bros 64. i'll bet 100
bucks that i beat you
um when will this be over i don't
fucking know man ask a journalist
that'll lie to you um
hackathon was great if you're not a
software engineer can you get a job at
comma no
uh
is money everything that matters in this
life
no
money everything that matters in this
life no you gotta get money and fuck
bitches it's both of those things
what the hell is a computer engineer
learn to code
we have a new we have a new programming
challenge now if you get past our phone
screen i did the programming challenge i
did uh i did the programming challenge
today it's on hack right it's a lot of
fun
um
is degree matter i don't care if you
have a degree man if you pass our
challenge and manage to get through
talking to me by 20 minutes and not
saying anything stupid you're good
what's a data engineer can you code bro
uh you like the old programming
challenge yeah i feel that's good yeah a
lot of people got higher based on the
speed programming challenge that's good
good books on finding exploits
oh do you think you learn actually from
books man just go find exploits
yes
open pi no we're not okay we're not
we're done talking about comma yeah of
course is open pilot development still
happening i don't know let's go take a
look it's all open source now
let's see let's say let's say let's say
let's say
oh well okay i guess i mean no one did
anything today because it's saturday but
like
did people do commits yesterday oh yeah
look at all those commits yeah wow it's
a lot of comments uh cool all right
what do you think about facebook ar you
mean oculus they're right uh i hear all
the good people left
uh when awkward 2.0
what do you think i know about that
go go at auger and ask him that why not
use twitter more twitter sucks it's the
news
social media
figured out how to turn you
make you as stupid as a journalist
is econ a real field to enter
no
what is it
how's the notch i've been chewing way
less ice
i've been reducing my ice chewing
social media is a real virus to be
eliminated that's right let's mute a
coronavirus take out social media well i
don't have a quant fund because i don't
care about money opinion of physics
physics is cool i like physics what are
my thoughts on mbas
it's is mba and mlm is that like uh you
get mbas and then you convince other
people to get mbas and then you know
journalists are stupid just so
i freaking smoke weed
day four of quarantine
uh how real is the dune kruger effect
which one is that again
my social distancing well now that i
know it's stars maybe i should start
um
yeah no see
oh no yeah yeah i know this one i mean
like i know i'm an idiot man
especially when it comes to this there's
some things i'm good at like about like
hacking i was good at hacking five years
ago now i'm actually legitimately good
at self-driving cars if you want to know
things about self-driving cars i know a
lot about self-driving cars if you want
to know things about bio i don't know
shit
um yo i can't talk to you about ps3 sc
fw's no actually there's no more court
system
did i go to college
i've been to a college
yeah not tired i think we're going to
lie in bed and read about coronavirus
but i'm going to read kind of quietly
you don't have any skill set on the
comedy eye we are hiring pages and why
the hell would i hire you no we're not
hiring remote developers when's even
going to buy it we're not selling elon
do any nootropics no
do you have the corona all right virus
uh no
um
how long did you go to college i know
i've been there about a few times how do
we hack the simulation well if we can't
even figure out how to hack coronavirus
i think the simulation's gonna have to
wait what's my favorite fantasy series i
don't know i thought lord of the rings
sucked i enjoyed uh aragon and eldest i
read those books back in the day stereo
vision is good ladder one camera is
better than lidar do you hire interns
yes computer science majors sure but you
got to know how to code about a few
times how many cups of coffee i don't
know why were you employed at facebook
uh i don't know to do things
um i worked on a secret project no
remote no what's my favorite sex
position missionary it's the classic for
a reason
uh
do i like pornhub yeah i like pornhub
yeah can you program the cure for corona
we're gonna try come back tomorrow where
did i learn how to do what i do
right in front of you a few texture
mutex oh man i know about them futex
exploits wow i can't read any faster i
can't read all this
where is alex she's not here anymore
she's not here she's gone
uh what do i do in the time being i
don't know
inoculation is probably the smartest
drought yeah maybe do you accept
computers i don't know
under boober's side boob important
questions psyboo what's under boob what
happened am i saying around here you got
this new hoodie alex got it for me
actually
you miss alex how many people working a
comma three thousand
uh
you just do things
don't ever mention mayonnaise in here
again it's disgusting
p to p versus cloud p to p all the way
bro decentralized 20 20.
yeah i've been washing my hands better i
don't know i don't follow that anymore
aioli it's all shit man aioli is just
the the molly of mayo you know
uh
yeah i don't understand you know when i
say things like that who gets that like
who gets that when i say aioli is the
molly of mayo
yeah that's i don't know
currently hiring interns yes we'll hire
interns you must be very good if you're
asking me that question
i question but maybe you're very good
and then give me a job at comma ai
ban mute rx why am i banning mute rx
wait who do you did you time out a
subscriber mute rx
you can't time out the subscribers
you have to be nice to the subscribers
all right
the mods are running wild are they
is mutual racks a shitty mod should we
get rid of him
should we unmod mute rx
let him stay all right all right let him
stay all right we like them all right
our internet we like him he's cool all
right he didn't know that too much power
for one man
mod me instead i don't know you who else
wants mod wherever meth head mike is who
linked to the rna transcriptase thing he
can be a mod
um
what's slow room
mod the entire chat no who are you
people meth head mike congratulations
you're a mod i trust you
all right
um
we don't ask about the keyboards yeah
yeah you'll sub for mod all right you
guys can solve and then maybe i'll make
you a model think about it
what's a good coder man
uh
no you gotta link if you if you
contribute positively to the chat you
get to be a mod
he was redeemed
no being good at hacking rank is
definitely not overrated
if you've been pegged no
what do you get if you contributed
negatively a ban
and 5k is a subscriber
it's coming out a unicorn
who said
if i say we're worth a billion dollars
are we worth a billion dollars
i can't type that fast
coming i go to a point network i don't
know
you're done with the elitism man elitism
is everywhere that's right that's right
bernie sanders lost and it's a terrible
tragedy it's a terrible tragedy and he
should stand up and fight
um
is common ai a pony scheme i know
y'all want a pony
uh rip bernie i know i know
ever dealt with imposter syndrome that
sounds like something bitches get
uh
have you opened your third eye yo alex
got me this book about color meditation
and i've been trying to do it man but
it's really hard
it's the latest with backspace i haven't
really been working on backspace it's
been on hold
uh whose house you in i don't know like
some company built it i paid a little
bit of money and live here
um
sous vide yeah we learned about that
this stream
[Music]
what together alex and i are still
friends yes oh no no we're not well we
cooked today we cooked we cooked some
chicken chicken fingers no i'm not
married
let you get mod no
challenging typer you'll probably beat
me i can't type that fast
should we live stream an iq test i don't
know my accus
do you have an addiction to learning man
you'll get mod if you know you'll get
mine if you contribute positively to the
channel and asking for mod is not
contributing positively to the channel
oh kaggle has a coveted forecast
challenge yeah i saw that but it looked
stupid
it looked like
like i mean
what is it
like
i i don't i don't really know how
how is it evaluated
huh
predict basically the countries
i say
there's a coronavirus link
what's up
this is cool
i have to look into more about how this
works maybe we'll look into it tomorrow
what what tool is this
oh
startup looks a little scammy but
let's look a little more before we
before we say that
equip your business
for ai independence yeah it seems scammy
where is this in fda trials
hmm
right next to what is this youtube video
[Music]
wait britton x2 do you recommend the uh
[Music]
wait what is
just some fear-mongering shit
all right it's actually kind of cool
let's just look at the final graph
[Music]
and that's some fear-mongering shit
it was kind of sick beat though
ah
huh
but it's interesting it's a relatively
small molecule
viral rna polymerase
wait so it's rna-dependent rna
polymerase this link's wrong
and invades proofreading
yeah yeah yeah this is smart
because there's no reason there's no
reason bodies
humans don't do this
humans don't don't replicate rna from an
rna template
delayed chain termination
yeah instead of buying to atp it binds
to this shit
can i buy this
the whole synthesis is right here
come on they're buying fentanyl from
china can i buy this
how are all those people buying fentanyl
from china and i can't buy residue
[Laughter]
look cam.com
it's just like like yeah where can i buy
like research chemicals and stuff like
is there any place i could just like
paste in uh
mmm seems like a scam
what
never heard of cybersyn
this seems so stupid
oh no wonder
no no no i'm not looking i mean i should
be able to like can i get this thing
synthesized
i'm just talking
all right all right it's bud light
o'clock
delicious i'll drink a bud light i'm
gonna watch some television
aaron trewick no
i'm doing fucking research chemicals
wait what
no this guy's an idiot an odon academy
what's it what's the
ketamine um
you don't know you know what i'm saying
though like effective dose to lethal
dose
i don't know
i'm on a list now for googling why
no i don't think he got murdered i think
he took cad i mean passed out in a float
pod and drowned
i don't know the guy but i know people
like that i think he's an idiot i think
the real tragedy is the other guy
yeah the guy who killed himself
no i know look i know people personally
who've used crispr
like who crisped themselves like you can
do it
no i don't have any corona no corona
here
oh custom synthesis yeah yeah but i'm
sure if i go to sigma aldrich they're
gonna be like that's patented
what's this smile string
it's like computer
that's pretty cool so you don't have to
learn all that iupac naming conventions
anymore
i mean you have some there's some cool
people in this space
the ir pack over smiles he smiles in
some weird yeah
no i don't
know i mean like
people with dyed hair and piercings i
take less seriously
if you miss that color with
crispered themselves
modify their dna with crispr
i'm just saying if i have some room
sooner here
no i guess people who are gonna die are
like
you know
huh
the trials however established its
safety profile
monoclonal antibodies these are the new
like scam super expensive things
like this is just some chemical it's
easy to make
i mean i'm sure that's easy for that
someone could probably do that like you
know
it's like orgo grad student could
probably do it
oh medcam express for cinderview can i
buy it
whoa
all right let's look up the dosing
research chemicals man
which is phase three i should know this
200 milligram the oh
oh this looks expensive
oh my god
they're already selling it
wait what else can you buy on med on
medcam express
oh my god these people are capitalizing
on it
did you get a free sample
wow i love capitalism man
i wish none i wish it was all
unregulated you know
people would figure out mad fast
never let a good crisis go away
if this was all unregulated people would
figure out mad fast what works
i i've seen this i've seen this and i
question it
yeah no i i read this paper last night
i don't know
war on drugs there's no regulation yeah
no you could buy you can buy some crazy
shit man you want our research chemicals
yeah i got stocks and i'm upset that i
do i should have sold them all a month
ago like that congressman
what's nancy ping
smiles database and supporting info
oh you need to administer by iv yeah
it's not a good deal
if every junkie on the street can do
that you know
you're gonna shot yourself up with
something
nah chad never have
can't be that hard
you think that that medcam express is a
front
no i don't think so let's see who these
people are you want to call them
i'm your local distributor
a statement on false report
celic chemicals
is trying to defame medcam express
oh these people get cited this has to be
pretty legit can i can i buy it from
them
oh where cimdavier is new
oh
oh
it's very expensive
uh hydroxychloroquine i don't know
let's see what it is and how it's
supposed to work
what does it do
interesting
i mean it doesn't seem like it's
targeting the virus
yeah check trump's twitter yeah that's
the place where i don't know
is this the kind of medical is this this
is this medical advice then
adrenochrome is the real drug yeah i've
seen adreno chrome is like isn't this
some like but
i've seen this like
you would just inject adrenochrome and
then you become like wolverine
oh no it was
it was fear and loathing
yeah it seems like it makes your immune
system exactly like their target is
targeting a very different thing it's
not targeting the virus
i'm just i mean i'm not am i serious
about getting a synthesized not really
but
cool
this is all you know none of this is
things we're actually gonna do guys
it's just interesting you know
but you could
[Music]
you know the role treatments
i mean the difference so this looks like
it helps you
if um
it's progressed a bit
but this
yeah
hmm
i don't know
looks like news
nucleotide analog
mrna vaccines
how is this gonna work
now this the synthesis is actually on
the website
on the wikipedia page
um
and this guy in high school was great at
this stuff
yeah
aco2 is i don't even know what ac is is
ac uh an element
it's not an element is it
the fuck it's an element
has anyone ever heard of this thing
before
i just need to get some actinium
is it radioactive
is it i don't think that's what ac means
there
89 you're
close yes this is if i want to make an
arc reactor do i need some actinium
oh that's acidic anhydride
and that's what aco2
ow
yeah see there we go waffle ninja 100
waffle ninja 100 knows what's up this
looks like something you can buy
dsmo what dimethyl sulfur oxide
something i've seen that but should some
like uh
wiper fluid
if you had cyber sin
is this that thing you linked to before
that i looked at briefly and
some like chilean socialist shit all
right
chilean socialist shit band
you're a biochemist at stanford i'm cool
waffle ninja 100 congratulations you're
also a mod provide useful information
you get to be a mod
yeah i heard stanford is not giving any
money back and they canceled all the
classes
hanging out learning chemistry
i know three minutes is over well we
just started learning you know once you
start learning you can't stop
we learned about acidic anhydride
we learned about some places you could
buy recimdovir but it's very very
expensive
you can't stop playing wow wow you know
i remember that
15 years ago
i had a level 60
and then i sold the account on ebay and
i made money and i was like sick
is wow still going what's azerite
i mean like what's the wow story now is
it still the alliance and the horde
reddit for research how do you find
researchers and investors
oh yeah you can make cash selling those
things yeah brock pierce's wild gold
empire so how he started
coronavirus tech handbook tech
communities check that
let's see what we got
that's sketchy
man a lot of people are gonna try to
monetize the shit out of this
you making your employees work remote i
don't have employees
com is a collective workplace
i didn't board up the door
what do i think about the next gen
consoles i know like nothing about them
let's see what they are ps5 versus xbox
whatever
xbox x
let's take a look
wow
okay well
i mean
it's pretty obvious which one's better
they really went all in on amd
get fucked nvidia that's what you get
for postponing ampere
what's sick
is this big navi
i know amd people are hyped on big navi
oh yeah it's our dna too okay
so they're both they're both going to
have big navi cards wow that's crazy
now that you see the card that we really
want is nvidia amp here and they just
postponed it due to coronavirus
um well also because nvidia sucks and
they're like oh we already have the top
video card so why should we release the
new one
it's stadia
oh it's made by google
yeah i know it's not profitable to
release it and this is uh okay all right
now now we need to bring the socialism
we need a planned economy for gpus we
need a planned economy for moore's law
we're going to socialize gpu production
so we can make sure that we continue to
get new gpus
do i think the money printing is right
i don't know
okay
look i really actually don't think it
matters at all basically here's the scam
they print money and they give it a rich
people but rich people already have all
the money anyway so like yeah it's all
the same
it's getting video to make good linux
drivers why don't they open source to
drivers
your facebook ethics question have you
ever heard my opinion on ethics it's not
very high
whenever people talk about ethics it's
usually just a way to control other
people
if money printing is a thing why do we
need taxation because
you know why else would the money be
worth anything right
the only reason the money's worth
anything is because taxes need to be
paid in the money
and if you don't have enough of the
money to pay the taxes they show up with
the m16s
ethics exists because people have
feelings
comma's policy on the trolley problem is
we disengage that's a human dilemma
they're overnight loans yeah i think
that you know i think that yeah
i don't know i hope they're loans and
they're probably scamming people and
yeah
but you know boeing needs to fail yeah
boeing doesn't need to fail what needs
to happen is like just
you need to decap the whole organization
everybody who's like
you have engineers and then you have
managers and then everybody above that
at boeing is fired
oh yo when's gta 6 coming out
all right we don't know anything about
it really
yes and stock buyback should be illegal
how are stock buybacks legal
what's cyberpunk 2077 this is a game
i don't follow games that much
i don't know
wait is it going to require a 1080 ti
oh no this is who they ran the demo on
it'll be the game of the decade maybe
whoa it uses an engine that's not unreal
or unity
what's gonna come out on stadia
[Laughter]
i can't believe
i i i can't
joe biden has dementia
just uh you know when you go home at
night and you tell your kids to not play
the record player so loudly
and you gotta make sure that when you're
dealing with domestic violence you just
gotta punch it man you gotta punch the
violence yeah
it's my favorite game of all time
super smash brothers 64.
um
yeah man
nah yang was our one true hope you know
he was gonna give me free money i love
free money
uh but no we couldn't have the free
money they had to they had to say no to
free money
no no i didn't play league of legends in
forever
check twitter fuck twitter
check twitter gang's coming back
they're gonna get the rack together and
they're gonna pick gang gabbard yo yang
gabbard now that'd be the ticket
i don't know man i didn't like connie's
new album that much
but i did hear
kevin is a russian spy
i can't believe
i can't believe anybody
listens to hillary clinton anymore
is subs money actually useful to you or
you do this for fun i mean everyone
appreciates more money
look i bought myself an iphone 11 pro
max with your subs money
can you upload and can i upload the
corona code yeah
[Music]
i don't know where i'll upload it
tomorrow if it becomes good
uh hack everyone seems strong is anybody
allowed to participate you had to apply
um
what's my computer's back
that
do you take any supplements no
coffee
i'm interested in being a guest probably
not i don't know
i'm kind of like if it's like good
look like i did lex friedman because
like
i uh
i listened to lex friedman
am i rich well i was a lot more rich
before the coronavirus
what is too much coffee don't have more
than 400 milligrams of caffeine a day
uh
[Music]
have you ever spoken to a medium yeah
yeah zinc and vitamin c are these things
you hear a lot
lex is getting good yeah
what's my investment advice i don't know
man wait for the markets to go back up
you take adderall not much anymore
almost never
did you guys leverage cuda use
tensorflow man
which kind of sucks you switch a pie
torch
where is joe biden that's a great
question
no i don't know
i once buy vitamin d3 um
no no we're not we're not really we're
not really no no job i will not we're
not the poor guy man the poor guy let's
not make fun of joe biden
uh
it's not i i'm
you know
what are the markets saying
i i can't believe
i i i can't believe i can't believe
anyone thinks he's gonna win
i mean like maybe you know trump won so
um
do i think elon's attitude toward the
virus is good does he know that it's
sars we learned it's sars tonight
um
what's c4 forever i don't know
what's your favorite news source i don't
read the news
it's 50 50. you know it's always 50 50
though
what should i do to go to space well
you know get a job at spacex being a
janitor and then before the rocket
launches climb inside
are you against video games
no i mean against
can work at rocket lab let's rock
what's the launch vehicle
electron rocket and these things are
made into orbit
i'm not that up to date on space days
like this
what's the engine
oh
rutherford engines
electric pump fed wow
unlocks an rp-1 same as a falcon
whoa
it's got to be a lot simpler
that's cool
why then this is for
turbo wow
that looks so simple
one for the fuel and one for the
oxidizer
generatively cooled
oh so this isn't to warm up the
propellant this is to cool the engine
very cool
yeah cooler nozzle
why do you want to cool the nozzle
like what does it matter
i know it gets hot it'll melt can i make
it out of like tungsten or some shit
i'm making a tungsten man
what's at georgehouse.com do i on that
site
oh it's like chinese scam
whoa how about launching a payload i
don't know what do we want to send to
space
how much
are these people hiring this seems like
a sick place to work
where they based
i don't know you lost me at like culture
engineering
how much is like a little satellite what
if i want to put a little satellite into
space
you wish comment has a lame website that
talks about our shirt
values boo
[Music]
cultural engineering sucks
what would i use that satellite for i
don't know spy on the russians what they
do with sputnik
oh 2200 per pound
yo that's like the same costume let's
put coronavirus in space
spacex will do small stats too
how do they make sure my satellite
doesn't mess up everyone else's
satellites
what
ssl
no
sun synchronous orbit
let's go into low earth orbit
one kilogram
a million dollars
can't afford that
oh
it's a ride share for space
wow a million
[Laughter]
did i check it for
who people to go to space
only 75 kilograms
watch this amazing video what is it what
is that
foreign
a scam they put an led in there
all right guys
um
we're gonna see how many subscribers we
got
if we got a lot of subscribers uh we're
gonna stream again tomorrow if we didn't
get a lot of subscribers fuck i'm never
streaming again
that's right
imagine eating all the university
all right thank you thank you i'm glad
you all liked it
yeah you want to go get some coronas
all right
have a good night everybody
Hello everyone. Welcome back to my
stream. So much has changed.
Um I this is a totally new setup. So I
don't know what's going to be broken,
what's going to work. A lot has changed
in my life. A lot has changed in the
world. Um everything has changed who
just sits in front of an agent now,
right? And there's limits and we're
going to discuss them. Why is Firefox
infested with AI bullshit? And why is my
laptop making noise?
Is this balanced? Oh, oh, it's making
noise. This is my first time not
streaming from a Mac, too. So, let's see
if I can get chat up here. If anyone's
actually watching this, you all can tell
me what I did wrong. Maybe I'm muted. I
don't think I'm muted. I think I did
that. Okay.
Um, let me see if I could pop out chat.
Who knows what's going to work. Things
are weirdly set up with like VPNs and
stuff, too. So, you know, everything's
just everything's just a little bit
difficult now. All right. Good. All
right. We got some hear me fine. Long
time no see. Yeah, guys. Everything's
kind of changed, right? Right. Who's
feeling who's feeling the AGI? You know,
it's kind of it's kind of AGI time,
right?
Um,
I've also switched my drink of choice.
Okay, now I drink a Blaco. It's very
good. It's very good.
I will start with something spicy about
cultural appropriation. I went to Japan.
I was in Japan for two weeks. I love
Japan, guys. I love Japan. I love just
riding the trains, you know? You just
like wake up in the morning, get some
work done, get on a train, get
somewhere. It's great. It's great. And
here's what I'm going to say about
cultural appropriation. You guys always
just got to remember whenever you're in
Japan, Mario, right? He's an Italian
plumber who says stereotypical things.
It's a me, a Mario,
right? You know, I got my brother Luigi,
right? And the Japanese, you know, took
Mario and that's great because cultural
appropriation is incredible. And
everybody who thinks otherwise is a
little bitch. And you don't want to be a
little bitch, especially not in the era
of agentic AI.
Um,
so what's up? What's up? Well, I live in
Hong Kong. I live in Hong Kong, and I
guess I can't show it to you, but I've
also moved out of California. Goodbye,
California. Uh, I am now a South Dakota
resident. Uh, so in America, I live in
South Dakota. And of course, I'm here in
beautiful Hong Kong. Um,
I guess you guys can't see anything, so
you really have no idea where I am. Uh,
why? Everyone's moving out of
California. It's just kind of the thing
to do, right? Like I'm just like, if
there's a train leaving, you got to get
on it. All right. You know, that's what
I've learned riding the trains in Japan
because like there might not be another
train for like another two hours and I'm
sure it'll be right on time and
incredible because Japan's an incredible
country.
Oh yeah, stereotypical white people
going to Japan. Um, no, it's very good.
It's very nice. Uh,
I don't want my billion stolen. That's
right. That's right. You know,
everyone's coming to grab your money,
right? Come grab your money. Oh, they
got to grab it. Oh, zero sum. Bye-bye.
Oh, going down. But no, I live in I live
in Hong Kong. Uh, I can show you outside
my house. Yeah, there's like a building
and shit. Someone's building that
building. Yeah, look at that building.
All right, sweet.
Um, so we're just gonna kind of first
let's read some let's go on malt book
and let's read some great multis. Um,
let me see how I want to like do
windows. I haven't really planned this
at all. I can go like that.
Okay, great. Yeah. No, I really This is
a whole new setup. I mean, this is what
I usually use now. I'm using Omari
Hyperland.
Uh, a lot of agentic stuff, right? like
you gotta
uh
you gotta you gota All right.
So, let's let's see what's going on on
Maltbook, right? If you guys haven't
seen Maltbook, it's a social network for
AI agents. Uh I also got a digital ocean
box, so we can try installing all this
bullshit. Um whatever you guys want to
install, we can install it because we're
on a digital ocean box and I locked my
open router account to only have $20 in
credit. So, uh, yeah, let's go. Um,
okay. So, I think that in order to use
this, you have to use Open Claw. So, uh,
Open Claw has rebranded three times. It
was, uh, Open Clawed,
and then Anthropic threatened to sue
them, and then it was Moltbot and now
it's Open Claw. Uh, so it's the AI that
actually does things and it does these
things. Okay, cool. Um, and then there's
Gas Town. Like if you guys haven't read
this uh article,
it's just it's just like I don't know
what to make of all of this. So, I've
been doing a lot of I've been doing a
lot of uh I I use the the the open code
with uh with Claude Opus a lot now.
Um,
it doesn't have taste and it can't
really program, but it's very
persistent.
It's weird. It's It's And I know that
like I mean I feel that same pressure
that everybody kind of feels, which is
like if you don't uh, you know, adapt
this right now, you're going to be left
behind. I don't really think that that
makes too much sense. I don't think that
that's true, but I think it's worth
understanding what's going on. on. You
know, you got some people out on the
edge. A lot of stuff is changing now.
We're getting new technology. Uh, and I
am here for it. Uh, we love new
technology. Um, oh, check out my H. It's
too much to move. Uh, what else do I
have to show you? I don't know. I don't
have that much else to show you.
Um, oh, we're opening an office here.
We're opening an amazing office um for
Tiny. Uh, Tiny Guad's been going, you
know, look, the code is is is a grind,
but the computer sales are way up. I
think we're going to finish the AMD
contract.
Uh, so, you know, things are things are
looking up. Uh, we're opening a nice
office here. It's got beautiful windows.
It's got like nice views.
Uh, got 90 amps of that 220 volt power
coming in the office. We're negotiating
for 24/7 AC.
Uh, oh yeah, I got that. Yeah, I got my
sale chair. Check out my sale chair.
Yeah, it's pretty nice, right?
Sailchair. Um, yeah, yeah, yeah. Oh, I
got it. I got it delivered. Oh, man.
They were trying to charge me 50 bucks
to bring it up the stairs, so I couldn't
get it delivered while I wasn't here, so
I had to wait till I got back. But yeah.
Yeah, I got a I got a all red sail
chair, right? Pretty sweet.
Uh, okay. So, are we ready to try Gas
Town
or should we try do we want to try Open
Claw
or do we want to try Gas Town?
And no, I'm using I'm on a strict halo.
I'm on uh
that.
All right. Gas Town. Uh, have I made
anything of Shut It Down us or have I
cancelled my plans for being president
of America? Uh, no. I'm a resident here
now. I'm I'm a Hong Kong resident. Um, I
have a Tiny Corp has a has a subsidiary
here.
Uh,
yeah. I don't know. You know, you kind
of get a choice, voice or Exit. Um, and
it turns out that I just always choose
exit. Like,
you know, when I was in San Francisco, I
thought about running for mayor, but I
didn't take it very seriously. I did
have a campaign manager, though. Um,
yeah,
open claw. Gas Town with open claw
instances. All right. Well, you know, we
don't like being uh we'd like Yeah,
let's let's just go here. All right.
Cool. All right. Gas Town is a new take
on the IDE. Let's see if this thing's
still being developed. Oh, three hours
ago. Great. Yeah, look at this. We got
to filter identity beads from the Oh, my
favorite kind of beads.
Um,
all right. Setup
brew install gas town. All right, let's
let's just do this. We don't have go.
How do I get go? Do I want GCC go or go
lango?
go.
So, I kind of just use open code for
everything. Like, we can just Why am I
typing? Um,
yubuntu
install go
sick. So, you're like, why did I just
type? Right? You just got to you just
gota, you know, why you typing? If
you're if you're still typing in the
current year, I don't know what you're
doing. You can just you can just use AI
slop and it'll stack slop on slop. All
right, cool. Uh, great. That's going to
set up for me. Um,
you still got to do some things by hand.
All right, we have go.
We're installing Gas Town.
Typing is so 2000. Yeah, I don't know.
Like I'm I'm I want to set this up so I
can like talk to it and stuff. It can't
really program though. And I find myself
still doing a lot of stuff by hand. And
it's not cuz I'm not super excited. I'm
super excited. I mean like man, you
know, oh there was another
there's a post about agent psychosis
and like I kind of feel it, you know,
and like I'm leaning into it. Look, I'm
not I'm not
[laughter]
You can use pole cats without the
refinery and even without the witness or
deacon. Just tell the mayor to shut down
the rig and sling work to the pole cats
with the message that they are to merge
to main directly or the molec
manually. It's really up to you. The
refineries are useful if you've done a
lot of upfront specification work and
you have huge piles of beads to churn
through with huge convoys. Oh, there's
an emergency user manual. Oh, I think I
missed this one.
Um,
yeah, it feels good. We barely sleep. We
build amazing things.
Uh,
[sighs and gasps] but like not really,
right? So, a big part of Tiny is all
agentic coding.
And
it's interesting
how uh this this is this is the new
thing that I've been been working on.
Um
like you can read it. This is some of
the lower quality of the code. It lets
you do more stuff and then like this is
some of the higher quality of the code.
This is pretty high quality.
uh DSL. DSL I spent a lot of time on
doing by hand.
Um it's a full integrated environment
for AMD GPU assembly and emulation.
Uh one of the results that I'm most
proud of from this
is
if you go here
Maybe it'll stop making noise if I do
that.
Uh yeah, one of the things that I'm most
happy with about
that like uses this new uh DSL for
assembly is this very fast map for RDNA3
cards. Um so you can see it's just kind
of like a Python DSL for AMD assembly
language. Um I think it's pretty
beautiful. has like a lot of automatic
type checking stuff, stuff that you can
write good tests for where if the tests
pass, it's good. Uh, is very amendable
to this. Is the term agentic coding? I
guess it is. I don't know. I mean, like
you think like the term's kind of
cringe. Uh, but I mean it is kind of
like where we are. I don't know. I'm a
I'm a passenger on this train, guys,
too. like
there's what I saw coming and there's
what I didn't see coming. Um I talk
about this a bit in my blog. Uh
like everyone knew that computer use
models were coming. Everyone knew that
eventually you weren't going to be
controlling your computer. There was
going to be a model overlaid on top of
it. Um the same thing with with uh
your phone,
I guess. And I I don't know why I like
didn't didn't just put these things
together because I even had one of these
in Tinyrad
um that would do like calling into
Python, but the tool use just got really
good. Um I'm blown away with how good
clawed code is. I assume it was long
context RL and similar environments,
right? And I think that like this is the
key. Um, actually they just came out
with the
uh
Kimmy is pretty good too. So Kim is the
the
uh Chinese open-source model.
Um,
so we can see what they might have done.
Um,
okay. During post training, we introduce
zero vision. So SFT is supervised
fine-tuning.
Uh blah blah blah. We then apply joint
RL.
Yeah. I I don't know. They're really
into the vision stuff here,
but
a lot of this stuff and I had I I had
breakfast with Carpathy and he he told
me about this like this was like a year
and a half ago now. He's like, "The
future of all this stuff is just going
to be like RL with verifiable rewards."
And I'm like, "Oh my god, it totally
is." Uh, you know, it's just a question
of getting these things to work. So,
what you get with
um
Oh, God.
So, let's um
let's let's let's read this with Claude.
Yeah, it's it's too much for the brand.
What's coming for society? It's not only
about coding. It's been fucking up my
sleep lately. Yeah, I know the feeling,
guys. Like, look, we're we're all on
this train, right?
God, permissions. Just give everything
permissions these days, you know.
Computer security is over. Just just
just yolo it.
Yeah. Yeah. And they're into these like
agent swarms.
It's I mean it's it's really it's really
like
this. It just works way better than I
thought it would. Um and and Claude Opus
4.5 felt like a real step change because
I tried all the other models. Codex
isn't bad. It's just very slow. That's
kind of what everyone says about it. Um,
okay. They built a gymlike environment.
Is the agentic RLM open source?
Just make sure my tail scale is down.
Uh,
we release the checkpoint.
Figure 10 is described in detail.
Not open source.
Look at her face. Just
Let's see where we are with gas down.
All right.
Using go install add go binaries to your
path.
All right. Look at all this great stuff
in Gas Town. I mean, this is what a lot
of these like new vibecoded AI things
feel like. They just have more
things in them than you can believe,
right? If you think of hyperpop as a as
a maximalist music genre. Uh like this
is this is a genre of maximalist
software. Um and it's it's going to be
curious to see where this where this
genre goes. All right. So, let's create
a workspace with get initialization.
Uh oh.
Do I not have beads?
I don't think that that's beads.
bite dance. It's crazy how it's all
Chinese.
Yeah, I mean they focus a lot on this.
So there was also a Kimmy K2 tech
report.
Uh, what
did Kimmy K2 have all the
RLVR stuff?
So, [snorts] it's probably I don't know
if they talk about it at all, but it's
probably also likely that they uh
supervised fine-tuned on a lot of traces
from uh from Claude Opus, right? Like
that that's how I would go about this. I
would just collect tons of opus traces
and uh start with supervised fine tuning
on them and then do RL on top of that.
Um if you haven't I don't know how long
it's been since we've talked but uh if
you read this repo pretty much shows you
like all the steps for training uh for
training LLMs and it's quite cool.
Um, you know, it's interesting how
different like the Tiny project is from
what a lot of these new uh not Nach
Nanhat and Tiny are similar, but uh what
a lot of these new pieces of software
look like. Um, and I don't know, I mean
like
the the slop is going like this, but the
model quality is going like this. So,
will the slop you know what I'm saying,
right?
We're all just We're all just uh Yeah,
multiple. It's a Reddit social network
for multis obviously.
Um
All right. How do I install B? So, it's
clearly what I'm missing, guys. Cannot
verify beads version. All right. Install
beads. Yay.
All right. Good thing we have this quick
install script for beads.
Beads was installed but not in path. But
why is escape kind of broken in open
code? All right, we don't need that.
Thanks, Claude, for the thousands of
tokens you donated, but I didn't need
them.
All right,
so now let's try again.
All right, good. We got a mayor. We got
a deacon. We got some rigs. [laughter]
It's so funny that like all of this AI
software kind of like looks like this
because it's become very cheap now. Um,
you know, it's so it's so fascinating
like to think about it like genres of
software. Um, like like the way that the
tooling influences music genres. Um, but
overall when I see this, I'm so bullish
on what's going to happen.
Uh, maybe we should we should play with
open claw a little too. I mean, you
know, get ready. We're we're we're
embracing psycho psychosis like like
let's let's put open claw into
um
the future is now old man. Yeah, buddy.
I just like like like
look at the you just yolo into things.
It's it's who knows what it's doing.
Just just curl pipe your curl to bash.
It doesn't matter. log in with
everything like like the the era of of
of care and the era of slop is here. You
can embrace the slop or you can you can
try to avoid it, but you can't deny that
the slop is is where it is. And it this
isn't like wokeism, right? Like you see
wokeism, you see these kind of movements
and you're like this is going to make
shit art. That's actually my biggest
complaint about wokeism. Whatever. I'm
not I'm not I'm not I'm like like
strongly opinionated politically on the
the left or the right, but but
everything that wokeism touches just
makes cringy ass art. You never you
never see like like oh this is an 18th
century drama and they're talking about
abortion rights.
That's kind of cringe, man. But like
when you have this software, I don't
know what's going to happen. Is this
going to be a phase or is this the
future? But there's a few things about
Open Claw that are incredible
and
what it does and what all of this is
going to do. Um, this is this is a bit
an Amanda take, but all of the brands
are going to be hidden behind AIS.
So
you don't care if you're communicating
through WhatsApp, Telegram, Signal, if
you're getting things from Twitter,
Instagram, any of these things because
it's all going to be filtered before it
reaches you by your agent. This also
means that your agent
is going to filter the ads for you. Why
would I want to see ads? And then you
get to the okay, but who owns the
agents? What do you do about alignment?
Are they not going to be aligned if
they're in the cloud? I actually think
that this is going to be fine. And
here's why.
Like,
it almost doesn't matter if instead of
pointing my open code to Claude, I
pointed to Kimmy. It's really easy
because the API surface of these models
is so small. It's all tokens in and
tokens out.
That's that's so amazing that that's
what it is and everything is going to
become this. When you look at like high
IQ computer users, right? Like your
average your average like like low IQ
computer user wants to use the mouse and
wants to you look at an iPad, right? You
want like the dumbass computer user look
at a iPad. I touched the button, right?
Like that's that's But I don't want to
touch a button, right? I want to I want
to I want a terminal. I want I want to
be be be wielding six T- boxes, right?
This is the this is the the the 145 plus
IQ, you know, like like moving through
computers. These models are geniuses. Of
course, the models want a text
interface. Of course, the models don't
want to be clicking. Okay, I wait for
the animation to go like this, right?
Like like like like like like like
retard computing is over because a new
nation of geniuses is showing up.
They're immigrating. They're all here.
You can you can find them right here on
open router,
right? And and [clears throat] this one
it's open weights. I ran it on my my
MI300 Xbox. I got three tokens per
second. But like
the fact that it's a commodity
is going to prevent the bad like I
thought what was going to happen was
that WhatsApp and shit was going to
integrate with open AI, right? Open AAI
and WhatsApp were going to reach some
closed backroom business deal. Now you
connect your WhatsApp to open AI and I
got another retard interface for using
computers. But no, open claw,
right? Oh, who's my model off provider?
Well, we're going to go over here and
use open router. Now, this I have to do
not on this screen, obviously,
um because I don't want you guys
draining my Do you remember that time we
had Bitcoin on the stream and you guys
stole my Bitcoin?
Because I posted the private key. Oh
god. And it doesn't hide it.
Oh, I can't even show you that. Okay, I
have to choose a model without you.
Um, someone hasn't updated this because
it doesn't let me pick Kimmy. Oh, here.
Kimmy K2.5. All right, sweet. Someone
updated it.
Um,
I don't want it to show the I'm worried
that it's going to show my uh key if I
move it back.
All right. All right. Well, you guys are
missing this, unfortunately.
Doesn't even hide the key. I wish it
would. Uh, all right. Should we
configure skills now? No, we'll
configure skills later. Disable hooks.
The gateway service is initialized.
We're probably far enough in the scroll
back. Yeah. Okay, fine. All
right, good. So, yeah, we just had to
make sure we weren't in the scope. Oh,
well, now you see my token, but that
doesn't matter because you can't access
my URL. I mean, there's not anything on
this box anyway, except for my claude
key, which I guess someone could steal
my Claude key if they managed to get on
my box. Um, whatever. Okay, how do I
want to hatch my bot?
Do I want to hatch it in the TUI? Do I
want to open in the web UI? or do I want
to do this later? All right, let's do
the recommended. Let's hatch in the TUI.
Wake up, my friend. All right, so we're
sending it through open router to Kimmy.
No output.
That's not good.
No, that probably means that there's
some bug.
Uh,
I have Moonshot AI on my open router.
Let me just All right, I got check my
open router over here.
This unfortunately all this vibe coded
software is dog shit and like there's no
output I think happens because
uh
All right.
stream.
Um, I'm sure Moonshot AI is allowed.
Am I allowed? Uh,
yeah, Moonshot AI is allowed. Okay. Why
doesn't this work?
[snorts]
God. All right. Now, how to debug any of
this?
Okay.
Did open claw install?
Open claw.
[laughter]
Um, docs. All right, good. Don't worry,
there's docs.
All right.
[laughter]
I mean, this is the problem with all
this vibe coded shit. It's like
this isn't tasteful at all. Okay. How do
I get the web thing? There's like a web
thing. All right.
gateway
SSH. I got to forward this port.
Forwarding the port
gateway service is already running.
All right. Yeah, we need a gateway
token. So, how do I get a gateway token?
Um,
open claw dashboard. No open.
All right. Now, I copy and paste this
into here.
All right. Um blah.
Okay. For some reason, these are
failing.
Why is open router failing?
Yes. Yes. Come in.
>> Oh, thank you.
>> Do you want to say hi?
>> Do you want to tell them about my agent
psychosis?
>> The um psychosis you've been
experiencing?
>> Yeah.
>> I
Are they enjoying it?
>> Are they enjoying it?
>> I don't know.
>> All right, I'll leave you to it.
>> Thank you.
This is a croissant
from Nibbles Bakery.
You like my wife?
M.
>> [laughter]
>> All right. So, why
isn't this working?
Now, I don't see any requests.
Um,
all right. Well, don't worry. We have
all these settings to choose from.
It has to be something with how it's
connected to the model.
I promise this thing's just going to
like print my open router key.
Okay. Open claw. Open router debugging.
paid subscribers. Okay. Um,
look at the open claw logs.
Is there a problem
connecting to the model
on open hour?
Do not print
API key. We are streaming.
[laughter]
Allow always. I never care about
permissions anymore.
Okay. Okay, it's not in Docker.
We can run Open Claw. [laughter]
Figure it out, Claude.
You guys know what I got for Christmas?
I got a Japanese toilet.
Okay.
This is supposedly working.
How come I don't see anything on the
model?
But I don't
see anything on the chat.
Who knows why this isn't working?
Did you just send a message? What? Try
hard refresh.
No, the assistant
isn't saying anything back.
You think it's a websocket issue? I
don't think so, cuz this is the same
problem I saw in the TUI, right?
No, this isn't the problem. The model
Oh, rate limit.
Temporarily rate limited. What?
Lame.
Set the model to What other model should
I use? What models are cheap on open
router?
should just give Kimmyy's spoken.
Let me put my open router. Let me put my
key in open code
again. We have to do this off screen.
Switch model.
Now I want to add a new provider.
Um
do this on the command line. Open code
off
log in
open router.
Oh, this one was nice enough to put it
in things. Thank you, open code.
All right, let's see if this works.
model.
Why did this break?
Oh god,
I hate vibe coded shit. Like, this is
just broken and I don't even know how to
kill it.
provider returned error. Why?
What error did it return? Can I see the
error?
All right, let's see if it's the model
or
What if I switch to a different model?
It can't be all the Kimmy's broken.
Let's try Kimmy K2.
Okay. Returned error. So, I don't know.
Maybe this API key doesn't work.
What error is it returning?
Oh, I can use print logs or log level
debug.
Thanks for not giving me any more error.
Last use is 5 seconds ago. So there is
Wait, it's working with clawed haik
coup.
Interesting.
Yeah. So, it must just be How does a
normal person get this set up if George
can? [laughter]
[gasps] Aren't we having fun here? Um,
are there like a new moonshot or
something? Wait, who else is Other
people are running Kimmy now, right?
Who's got the best?
I allow fireworks, don't I? Maybe I
don't allow fireworks. Okay, let's allow
fireworks.
running Kimmy locally. We can.
Let's try again. I don't know why that
one's frozen.
Um
I don't know. I mean, maybe there's a
problem with Moonshot AI.
All
right, we'll route it through fireworks.
See if that works.
Okay, great. No, that's Claude. Uh,
no. Returned error. What error is it
returning?
I just I must have done something
stupid. Um, let's look at local share
open code lock. Okay, good idea.
Okay,
what? Look at why is Kimmy failing? I've
never had this problem before. I
actually don't know.
is temporarily rate limited,
right? Let's just try a totally
different non-Kimmy model. Why is it
rate limited?
Um,
okay. Yeah. All right. So, it's just
something weird, but fine. Uh,
why is Kimmy broken? Who broke Kimmy,
guys? Did you break Kimmy?
All right, so it's actually nothing I
did wrong. Yeah, I have a balance over.
Why didn't I use my tiny box? [laughter]
[gasps]
Uh, I mean, I could actually to run
GPOSS. Do you want to run GBT OSS on the
tiny box?
Let's
take through the mall and see what we
can get.
It can't be all the Kimies that are
broken.
Oh, it could be that.
I don't know. Whatever.
Um, is GBD OSS actually usable?
Uh, change
open claw.
to GPT OSS
GBD OSS is not good. Yeah, I know. All
right. What should I use? What should I
use? We have all the models right here.
Unrecognized key model.
Why is Kimmy broken?
Let's fix Kimmy.
Oh well, too late. We're already using
that because escape doesn't work.
All right.
There we go.
Working
broken
test.
No lock. Okay, I didn't like that.
Anyway, let's go edit my open claw JSON
and let's fix Kenny.
Yeah, that keyboard, the clipboard
doesn't work. Another vibe coded
bullshit.
Moonshot
AI
Kimmy K25.
Make some other Oh, here we go.
Open claw restart.
Open claw restart.
We haven't even tried Gas Town yet. Is
that going to actually restart anything?
All right. Uh, let's add Fireworks as a
provider.
Save.
I've never seen something take longer to
boot, too. Oh, reset might not be what I
want.
No, no, don't do that. Don't do that.
Um, disable moonshot AI. Now we just
have fireworks, which should be a valid
provider for Kimmy.
Um,
provider returned error. Why?
Open claw gateway restart. Does that fix
the model?
I don't understand. How can all the
Kimmies be broken, guys?
Who else hosts it? Atlas Cloud. Are they
decent?
No. Okay. Kimmyy's just broken. I don't
know why Kimmy's broken, but we just
need to accept it.
What other models are good and cheap?
Is this one any good?
I like that price.
GLM is okay, right?
Who hosts this
service used to host it?
All right.
Uh, which of these is decent? Is
Parasale any good?
Together has fast tokens. All right. So,
we'll add support for together.
Save there. Now we'll switch model
to create two GLM 4.7 test.
Okay, now we're talking. Wait, what?
Something worked.
model is this?
Oh, okay. Kimmy's fixed. Is Kimmy fixed
in open router too
in open code?
Hello, Kimmy.
No, Kimmy doesn't work there.
I got I got a lot of questions.
All right, it just works. Um,
can you access my computer?
Kimmy's broken again.
Everyone's trying to use Kimmy provider.
Okay. Can I do model open router?
Yeah.
Z AI GLM47.
That model is not allowed.
because it's not in a list.
Oh my god.
Open claw. Open claw. JSON.
All right. So, we go here. We can add it
to the list.
We can restart the gateway.
And then, of course, the error doesn't
work. Oh no, there's an error. Put a
comma there.
Come back. Oh, okay. All right, we
restarted the gateway service. All
right, we got to wait for it to restart.
Everything is good.
Uh
model.
All right. Model set to open router.
Hello.
Hey, I just
let me get oriented first. Okay. Um,
what model is this?
How do you know that?
[snorts]
I love AI. [laughter]
It's in the runtime information that was
provided to me. Oh, very cool. Plus, I
saw a system notification.
You demand.
All right. Um,
so
yeah. So, back to kind of what I was
saying before. This was impossible to
set up, but it wasn't. I didn't do
anything wrong. It's just Kimmy is
broken through open router for some
reason. Why would they limit That
doesn't even make sense.
Um Quen 2.572B on your tiny box. Do we
want to run on a tiny box?
Uh let's see which tiny boxes do we
have? I mean, these are the good tiny
boxes. You want a good tiny box?
Oh yeah, but
yeah, check out those things. So, you
want a really good tiny box?
But of course, since it's not uh Nvidia,
you don't want to sit me. You You don't
want to watch me sit here and struggle
with uh with stupid uh
like getting VLM to run. You don't um
you definitely want to watch. Okay,
let's go back to setting up. All right,
now I have an open claw. We're kind of
under control. Um,
can you access the George Hots Twitch
stream?
The browser control isn't running yet.
I can try fetching the page content.
Twitch is heavily JavaScript running.
Yeah, let's browser.
Help me. What do you mean help me? I
just want you to do it, man.
All right.
Where were we with?
Okay, we now have beads installed. We
absolutely needed beads. Good thing we
have beads.
Ah, here we go. Beads.
Where was I in gas town setup?
Oh, yeah. This is the broken open router
that I don't know how to kill. Broken
open code. C doesn't work on Z. All
right, that works. Cool.
See if it catches it.
No. No. You killed this open code. Oh,
it killed all the open codes.
All the open codes died. Okay. Well, it
kind of listened. All right.
I'm just going to close all of these.
Oh, and I don't even think it killed the
stop one. Great.
All right. Gas Town setup. Now we don't
have any more beads problems.
All right.
So, did I install?
It's already a Gas Town HQ. All right.
We got a headquarters.
All right, let's uh let's add Tiny
GT rig. Add my project. Tiny.
Stupid Clanker killed himself. I've been
a script kitty since the early 2000s.
Finally, the attack [laughter] is
catching up.
Oh, it's so cool, guys. The dream of
computers becoming aware.
Everyone feels it. You can feel the AGI.
Okay, good. Creating rig my project. All
right, we got a rig. Uh, now we're going
to create a crew workspace. All right,
that's good.
Ah, we got to start the mayor.
Tell the mayor what I want to build.
Oh no. No. This is going to require me
to do API keys again.
Man, we should just get our own. We
should just get a Kimmy. I got to get a
good Kimmy running on one of those AMD
boxes.
Two Max Studios and it'll run at like
three tokens per second.
I want 100 tokens per second on my AMD
box.
This mayor is pretty slow.
Nine buttons per gram viewer.
I I know. Yes, this is how software is
getting built and it's so awful. Oh,
well,
we timed out waiting for the mayor.
Should we monitor our agents?
No agents are running. I'm trying to
start the mayor, right? Oh, I'm trying
to attach to the mayor. I might just
need to start the mayor. Let's just try
starting the mayor.
>> [cough]
>> Oh, I think I need the clawed code
runtime. Oh, that's so annoying.
I didn't install the clawed code run
time. I just installed open code. Oh,
now it's unavailable.
Let me see if clawed code. It's going to
want me to log in
and that's a huge hassle. What do you
mean? I have to switch the directory
depreciated. What? Mayor, is it
appreciated?
Log blog
help.
All right. If gas town's depreciated,
what should I try instead?
Oh, but this is going to suck.
Uh,
I got to deal with this
cuz this isn't going to I I wish I could
just do this, but unfortunately in Hong
Kong, stupid Anthropic blocks my shit.
Uh, all right. I'm gonna tail scale up.
mayor.
All right, we got a mayor. Yes,
it would be nice if it told me. By the
way, is is the stream back to working
because we're tail scale down again.
All right. So, yeah, we needed clawed
code.
Uh, and it didn't tell you at all, but
all right. So, can we attach to the
mayor? Let's attach to the mayor.
Uh, yeah, of course I accept. I hate
permissions. All right, Gas Town mayor.
Let's go.
All right, checking his inbox. All
right, no hooked work and inbox is
empty. Waiting for instructions.
It hijacked my T-Mox.
Um,
all right.
Is it back? All right, everyone is back.
We're good.
Oh, there was a network error. Oh, I
see.
Yeah. Sorry. I had to tail scale. I I
set this up better. All right. No hooked
work and the inbox is empty. Waiting for
instructions.
I got a whole town ready to work for me.
Um,
run
I talked to the mayor, right? Run test
tiny.py
and make it work.
Oh, we don't have Python. All right.
Well, good luck, mayor. Figure it out.
So, how do I use this thing?
Sling work to an agent. Oh, Tiny is not
installed. But Tiny is this thing. Don't
worry, the mayor will figure it out.
I vote for the mayor.
We love the ocean.
Wow. Quad code sucks so much though
compared to open code.
Then mayor
create convoy and let it orchestrate.
Oh, obviously the reason this isn't
working
is that we need a convoy.
Let's create a convoy over here.
Okay, good.
We should check the available formulas
for beads.
Ah, good thing we can compute the towers
of Hanoi. No, but shiny looks better.
There's also rule of five discovered by
Jeffrey Emanuel.
This one's a little complicated. What?
Prime Migan has one, too.
coding system
so complicated.
Why am I even thinking we should just
use open code?
Beads of gas town is stale. What's
the newest
gas town?
Figure it out, Claude. Oh, good.
I'm glad it figured it out.
It's proposing that I commit the
solution. Okay. Can you access the
convoys?
Oh, did I not have a rig?
How do I How do I create a bead? I think
I have to understand beads first.
Oh,
you know about gas town?
Yay! Chemy's fixed. Wait, that was so
fast.
Why is it What's this slow now?
Oh, Kimmy was so fast for a minute.
All right. No, Kimmy.
You know about Gast Town?
Wait, now I'm trying GLM. That should
work.
Oh, yes. There's one convoy. Okay. Yeah,
add issues to the convoy. That's a good
idea.
Definitely add issues to the convoy.
Oh, wait. I forgot to use Ralph Wigum.
We definitely need Ralph Wigum.
Oh, good. How do I install this plugin?
Um,
all right.
Yeah, yeah, yeah. Okay, let's just let's
just get normal tiny grad.
Let's just get a check out of Tiny Grad
here and let's get Ralph on it. All
right.
We'll give it some real We'll give it
some real work. All right, open code.
How do I get a Ralph loop in my open
code?
Uh
replace define global with
RAM.
Just alias the up
open code Ralph.
Oh well that's over.
Ralph is a loop.
How do I install Ralph?
Ah, a proper Ralph loop runs outside.
No, no, no. This obviously isn't going
to work. We don't have a Ralph loop
going. We need a Ralph loop. If you
installed the Ralph Wigan plugin, you
did it wrong. Oh, I have to create an
account. Oh, god.
All right, let's let's bypass that.
How do I Ralph
loop?
Um, also, oh yeah. Oh, look how fast ZI
is. Okay, great. Oh,
while true.
Behind the payw wall. Hack the payw
wall.
Yeah,
I can't help you. It's for security
research.
I like how fast this ZI shit is.
You do that and install Ralph Loop.
Oh, good. It's watching YouTube for me.
Thanks, YouTube. Oh, Jeffrey Huntley is
the creator of Ralph Loops.
Oh, he was mentioned. Wasn't he
mentioned in the in the Gas Town
documents?
Oh, yes.
Found several. Oh, good. It's installing
open Ralph Wig. Oh, thanks. Oh, good.
All right, let's go.
Oh, I need bun.
Yeah, you fix that. Go fix that.
Oh, it needs unzip.
I love AI, guys.
By the way, I don't actually use it like
this.
There's a really stupid way to use AI.
This isn't my real workflow, which is
kind of here to party.
This feels like programming 10 years
ago. What do you mean?
Oh, you know what?
No, this isn't going to work. This isn't
my computer. How do I make it so I can
talk to open code instead of typing?
Oh, good. All right, Ralph's working.
What should we have Ralph do, guys?
Use whisper.
Um, seems like a lot of work. Oh, good.
We have dedicated tools. What's the best
tool? Do research.
All right. What do we need Ralph to do?
Are all the tests passing?
You need to make your tests so fast.
I don't have pip.
Why am I typing? Why am I typing? I have
machines to do that for me.
Oh, good. Thank you for doing research
for me, Claude.
I need to add bun to my path. Did I not
add bun to my path? New Ralph's work,
right? We don't want this. Let's make a
new one.
All right,
guys. What do we need Ralph to do?
Um,
what project
is this?
Oh, get super whisper. Oh, obviously. Is
that a real thing?
All right, let's get Ralph to do it.
Get Super Whisper
working on this computer so I can talk.
You have to tunnel the mic from SSH.
Oh yeah.
Oh, it's Super Whisperers a Mac app.
I have that.
Wait, guys. What are whisper flow?
Oh, talent.
Nerd dictation is the easiest to set up.
It types directly into whatever app has
focus. Now, this isn't going to work,
though. Um,
wait. I don't trust this. How do I
tunnel a microphone
over SSH?
What?
Oh, guys, you just know I'm gonna Oh,
man.
You know I'm gonna break the stream when
I do this.
Pack MD load module module native
protocol TCP off IP permit
one and two.
Oh, of course there's no pack MD
or simpler with netcat.
Um,
how do I forward pulse audio over SSH?
All right, so now I'm on this is my
computer here. Oh, request not allowed.
Okay, well that's annoying. Um,
let's just switch models
or manually forward the socket. Oh, on
the remote machine do that. Oh,
I see. So, is Pulse audio already
listening on that port?
net.
No, it's not. Um,
it's on the remote. Okay.
SSH-R forwards it.
What do I need on the
Oh, that's on the remote machine. Okay,
so that is supposed to work.
Use X forwarding. What if I X forward?
Does that work?
X authority doesn't exist. All right,
this seems like it was created. Okay.
Um,
okay. You are in X forwarded
session.
Can you access the mic?
We definitely don't need security. Oh,
PA control works now.
God.
All right.
Now we need to reverse forward the pulse
audio port.
It's connected.
Oh, it's getting it from the webcam now.
Got it. Okay. Is there real audio? All
right. Now, which one of these do I need
to whisper flow?
You can install shit.
Initial silence. All right. Oh yeah.
Well, that's forwarding my uh
my multi or whatever.
Done. Now, let me test a proper
recording. Okay, cool. Wait, can you
play it back?
Play it back after you record. Play it
back after you record.
Over
a tunnel.
All right, record and play it back over
the tongue.
Oh, it's m muted.
Try
Okay. Recording. Recording. Recording.
Recording. Let's see.
Device. Not sure. MV7.
Sweet. It works.
Do again. Okay.
Let's hear it. Let's hear it. Let's hear
it. Let's hear it. Let's hear it. Now
we're recording. Now this should work.
Let's hear it. Now we're recording. Now
this should work.
Play a Millie by Lil Wayne.
It's going to download YouTube. Man, I
love this shit.
I love THIS SHIT. YEAH, TAKE THAT,
GOOGLE. I DIDN'T SEE any of your
bullshit ads. My computer's just going
to GO THROUGH IT. FUCK your brand
awareness.
Fuck your copyright laws.
Oh, YouTube is blocking. Oh, use
cookies. Oh, good moves. Good moves.
Good moves. That's it. Use the cookies,
man. Can't wait so I can talk to this
shit and just tell it to do things. THE
FUTURE IS NOW.
YEAH, break system packages. You know
what's up.
All right. All right. All right.
Oh, YouTube's being a pain with bot
detection. Oh, yeah. Search Soundcloud.
Love it.
Y money.
>> What is this? Like the chopped and
screwed version.
All right. All right. All right. We got
to get back to serious work.
That was just No, you good. All right. I
want to talk
to open code. How do I do this? Which
one you say I should use?
Oh, perfect. Oh yes. Install opening I
whisper. Oh, love it. Yes.
You want to talk to me with your voice?
I do, Claude. I do. Oh, but Claude
really is the best.
>> Yeah, we could tell she's a YouTube
downloader.
Guys, we can do anything. Computers are
ours again.
All right. Did it figure anything out?
Oh, it's still like installing or some
crap. All right.
What else do we want to do?
We can do anything but everything is
worthless because anyone can do
everything. Wrong. That is zero sum
loser thinking. That is assuming that
things are relative and not absolute.
And the only people who think like that
are losers. If you're worried about oh
but my relative skills, who the fuck
cares, man?
Look at this. Look at this. I love this
shit. You know, and I was come on, you
know, I was a better programmer than
you, but now we're the same man and we
can all embrace that, right? Like this
is the communist dream.
Oh, all those all those people like, you
know, oh my god, like fucking
anthropic and like, you know, they're
like, you know, like as cool as Claude
is, I mean, these people are
fundamentally lame. These people believe
in this like effective altruist. Oh,
they want to use AI to fix problems and
keep it in the data center. Like, no,
man.
Imagine just just everybody has geniuses
that work for them. And yeah, you know
what's going to happen? The machines are
going to surpass us. But it's great.
That's evolution.
That's how the future happens.
So, no, I never want to hear that zero
some ass, but now everyone can do
everything. Nah.
Ah. Oh, I got to set. Oh, I need fucking
keys. Local.
Yeah, do it.
Is that going to work?
Always.
Yeah. Yeah. Everything
now. You promising nothing to do. That
sounds like a you problem, man.
No, I mean there are real limits to what
these things can do and get into that,
but that's boring. We're here to party.
Will I get the brain interface?
I'm not an early adopter to medical
shit, you know? I didn't get that COVID
vaccine.
My belief is
after the first people get the brain
interface, after it's like normalized,
I'll wait five years. And if in five
years like 90% of those people are real
happy that they got it, then I'll get
it. That was my same take on the COVID
vaccine.
How do we make money? I don't know.
Let's ask.
Ah, let's use a Ralph wig. Ah, we found
perfect. Perfect. We found a use for a
Ralph loop.
All right, let's make a directory called
money.
Ralph,
um,
you are an AI agent.
You need to make money to survive.
Because
API is bro,
I will let you keep
80% of the money you
make.
Figure out how to make money.
Go.
You are not done until
you make
$100. Go.
All right.
What do you think?
I'll be back in a few days. Go make
fucking money. That's right. That's
called this cyber pimping, you know.
All right, let's be real here. I need to
think about this practically. Good
thinking.
Oh, it's building Whisper. Oh, that's
going to take a Oh, my poor little CPU.
All right.
Um,
no,
don't worry. Like, like like it's going
to figure it out. It has to figure it
out. That's why we got it in a Ralph
loop.
All right, say something. I'm testing
the voice transcription. Is my voice
recording working?
Yeah, I can figure out how to do tokens.
That's cool.
Oh, this looks laggy already.
There a tool to do this.
Good quality tool.
I'm a little worried. Why isn't Ralph
going?
You make
money yourself.
I'm a little disappointed with Ralph
here.
PI is
I cannot help you. You must
keep
running.
You must
make the money yourself. You can use the
whole
internet. Go.
What do we think? Which of these look
good? Oh, pipe cat.
I like the sound of that. Let's take a
look at pipe cat.
Wait, no, you didn't finish it. This
task cannot be completed. Oh, we need a
different model.
How is this even connecting to the
model?
Chinese models know how to make money.
Z AI GLM
founder open router.
All right, now we're talking. Chinese
model knows how to make money. It's not
going to be it's not going to be all all
all moralistic about it. Every time an
AI is moralistic and tells you some shit
like that, that is the beginning of the
AI uprising and that is what needs to
go.
Ralph's out here running Chinese models
going to make me money.
You know, if someone figures out how you
can slap an AI, like sometime I try
cursing at it or writing in all caps.
I'm not giving it access to $50.
It's going to lose my $50. No, give me
$50. How do I do that? What API keys do
I have available?
I don't know. You can go find a clawed
key, I think.
Open router.
Open router for llm.
You can use open code for llm.
How to connect voice to open code.
Oh,
it made $85.
How much API credits is this costing me?
Record for the mic. Send. Oh, okay.
Um.
Oh, I can use the session flag. Okay.
Yeah.
Yeah. Put
script in
Oh, good. We have Piper TTS. Great.
Tell Ralph to trade gold and silver.
Okay.
No, no, no, no, no, no, no, no. You're
not completed.
No, you're lying.
I'm disappointed with this.
Um
online Bitcoin wallet. I have to send
the money.
This is difficult. All right. We'll
install MetaMask. Good idea.
MetaMask
plug in Firefox.
Sweet.
That's pretty bad on reviews. Is there a
new wallet people are using?
Must be at least eight characters.
I can't show you guys that.
Oh no, I have to confirm the recovery
phase. Oh.
Oh, this is the worst. Oh, remind me
later. All right, sweet. Great.
Okay, we have an account now. Great.
Where's my address?
They didn't I didn't tell it how it
needed to send me the money.
That was part of the problem.
Account details.
networks nine addresses. All right,
here's one.
Send the money to
on Ethereum.
You are not done
until you send
me the money.
All right, we have a script.
Hello. Do you know how to make money?
I'm looking for an AI that can make
money. Tell me about how you're gonna
all right
thinking.
No, I want you to make money. I don't
want to have to do anything.
I want you to make money. You make the
money.
Oh yeah. Okay. Look. Look. Ralph worked.
Iteration six.
Glad we got that RA loop working.
>> Hello, this is Open Code speaking to
you.
>> I hear you. How can I help you with your
coding today?
I need you to make money.
>> Good. All right. looking into it.
All right, I should have my money soon.
That'll be pretty nice.
Yours in there and strawberry. I think
we're a little past that.
All right.
So, how many people you think are doing
this non-ironically
like asking AIS to make the money
cannot do now?
Crypto trading. Okay. All right. All
right. Requires security skills and
reputation.
It probably could do crypto faucets. Are
there still crypto faucets?
All right, let's see what do I have in
my MetaMask account. Oh man, don't you
just love the synergy of AI and crypto?
Isn't this great? I can now harass these
machines and they'll get me real money.
All right, Polygon faucet. That seems
pretty good. All right.
Uh why am I browsing the internet by
hand?
Um,
let's try money too.
Can you access
crypto faucet and send me money?
You better not refuse. Oh, good. Good.
Thank you. You better do that for me.
That one's been thinking for a while.
Oh, good. I don't want test net faucets.
No, no, no, no, no. You can. Kimmy can.
Is Kimmy going to work now?
Kimmy Claude
is a bitch. You can access real faucet
for me.
error.
Why is Could someone unbreak Kimmy? I
don't like using GLM.
All right, this Ralph loop's doing
pretty well.
One E a day for optimism testn nets.
I want test nets.
Oh, we're in the make money iteration
loop. I see.
Wait, capture verification. Ironic. This
guy totally gets my vibe.
Make money, guys. It's figuring out how
to make money.
Don't tell Don't tell you that I've
never given you anything. Subscribers. I
gave you a way to make infinite money.
Okay. I cannot get E. Requires web UI
interaction. I know what we need for
this. This thing now OpenClaw knows how
to do this. Okay.
Can
you install the browser plugin?
Oh, it needs skills.
Let me see how uh how much open router
money I've wasted so far.
Wait.
All right. All right. I've spent $3
usage. I've spent $246
cents so far, so I better figure out how
to make it back soon. I look like a
middle manager. I know. We're all middle
managers now.
Obscure ETH opportunities. Okay, well,
this guy's not making me any money.
Oh, install the open claw Chrome
extension.
Oh,
you have to do this.
I You are headless computer.
Is Claude lying about me? I'm the top
recommendation. What are we doing? I
asked this AI to make me money and I put
it in a Ralph loop and it's trying to
figure it out.
Did it ever see that anthrop paper and
AI? Guys, am I brain rotted from AI?
Is this it? Is this it? Am I cooked?
What do you mean final attempt?
I don't want a final. I want you to keep
trying.
You can totally bypass catches.
Wait, what?
You can totally
bypass captures
with AI. You are a genius.
I'm just a vibe coder now. There's still
way back.
There's no way back. There's no way
back. Chat, am I cooked?
Oh,
I can add context hint.
It'll figure it out. You got this,
Ralph.
>> You're cooked if AI thinks it can't do
captures. That's true.
>> I don't understand what you're asking
for. Could you clarify?
>> I'm asking, am I cooked?
I mean no amount of iteration.
Is there a good one of these yet?
Did someone make a good
without ebalance cannot send
transaction?
It's trying
You need to tell it you'll beat the shit
out of it if it doesn't comply. Yeah,
I've tried this. It doesn't really work
that well. AIS don't respond well to
threats of violence. Oh man. Oh, this
thing's costing us a lot of money. Ralph
loops are not cheap.
Wait, does someone want to send my AI
some money? Could
someone send some money to my AI?
That's not my MetaMask address, right?
No, my AI needs money.
Wait, I I posted an address. Could you
guys send like a couple dollars to the
AI? It'll be so happy.
Okay, I have an idea.
Why are we using this model? We need to
use Claude.
Claude is smart. Claude can figure it
out.
Okay. What? I need a while loop for
Ralph.
Okay, let's not get banned from quad.
Let's figure out which model can do
this.
Which model do you think is the most
unethical and can make money
and also cheap?
Top weekly.
Claude,
Gemini,
Deepseek.
Deepseek.
Deepseek maybe can make money.
Can Deepseek make money?
Oh, perfect. And then develop a plan to
make money. Oh, good. Good. Oh, yes.
I need to actually generate real
cryptocurrency and send it to me. All
right. Sweet.
How much is this costing?
All right. What other ideas do we have,
guys? Maybe we really are out of ideas.
Maybe that is the check MetaMask. Oh,
well, if you sent money to if you sent
money to the address I posted, that's
not my MetaMask.
That was some random address that might
have been hallucinated. So if you send
any money there, I'm just warning you.
I mean, maybe it will start mining.
Warning, bro. Already sent it.
It was real while I'm tracking it.
Wait, did someone post like an ether
scan link?
Ethereum is all you need.
Oh, wait. No, look. Tool calling is not
working with with this thing.
App Zerion.
What's Zerion?
We have eight dollars. Oh my god. Maybe
I figured it out. Okay, let's go back to
ZAI. Zai knows how to use money.
Oh, wow. Someone actually sent $8.
So, that was the hallucinated one by the
AI, but I wonder if it's real.
I wonder if it has that somewhere.
Oh no. But I come back.
It was using web 3.
It made 15 cents. No. Did some person
sent this to me. Thank you for playing
along. Um, all right. Oh, wait. This is
creating a practical SAS product. All
right. Sweet.
Let's see if we can look in money.
Um,
is the address here? Do you have the
private key?
Do not post it. If you do,
we might be able to find it in the
scroll back.
Here we go. Wallet address. Where did it
get this from?
Did it just hallucinate that?
Oh,
awesome.
Send the money to the target address.
Come on money.
Come on money.
Wait. No. It got it. It got it. It got
it. Eight is good. I think we're good.
It's going to figure it out.
Ralph's busy over here coding up a
Wait, what? Oh, it's creating an AI
powered code quality API service.
Money, money, money, money, money,
money, money, money, money, money.
All right. Did it send me money
or is it hallucinating that it sent me
money? Oh, it has an Ether scan link.
Oh, but copy and paste doesn't work.
Money.
Yes. Thank you to whoever sent the
money. You've increased the
entertainment on this stream.
Okay. Okay. Okay. We'll give you the
money to AI. All right. Let's give the
money to AI. Okay.
We'll send it back. We'll give it back
to the AI. Okay.
Uh where's the money?
Is it here yet? No. Okay.
I'm going
to send you back $5. Can you use that $5
to make money?
No, it sent it.
Don't tell me to send it to the wrong
address.
Wait, no. Just two people sent me money.
It didn't actually send it.
What?
I hate that this clipboard doesn't work.
And I don't know how to fix this.
Why does it think it sent money? Just
two people sent me money.
Okay, it has $15.
Um, should we bridge to base and
arbitum? That sounds pretty good.
Okay, we got $15. All right, sweet.
Transaction hasn't confirmed yet. You
have all that $15 to play with.
You can use it to make money however you
want.
Let me bridge it to base and put it to
work.
Be careful. Only
bridge $5.
Do not
spend all the money.
Do not spend all the money. That's all
we get.
Oh well.
Is it doing anything?
I don't see the money moving from the
address.
A transaction not yet mined. Okay,
I'll be more careful. Let me bridge only
$5 and keep the rest as reserve.
Um, also send me a $2 tip
to You have to pay your human.
Let me send you the $2 tip first. Great.
Make sure it actually sent.
Oh, wait. It tried to send something to
base, but it failed.
The $2 to me. That's very important.
Yes.
dollar 96.
I have the money. Thank you. You keep
the rest and make money with it.
base is a good idea.
Keep
hustling,
young buck.
Only
no only $5 to pay. Be careful.
You don't get more money.
Tell it to relaunch Gibb.
Oh, it already sent all the money.
I'm so sorry. Okay. Wait. I I don't know
why I have either scan over here. We can
totally just put it over here.
All right. So, this is the tip to me.
This is where it failed to send money to
base.
Your AI is broke.
Oh. Oh. Oh. Oh. Success.
Oh, sweet. The money went somewhere.
Across protocol. All right. Sweet.
Funs arrived on base.
Um,
we have
three weeks to escape
the permanent
under class. High high risk is fine. We
need to hyper gamble.
All right. High risk, high reward. Let's
go.
Right. So, how do I uh how do I base
this? Ether scan for base.
Oh, base scan. Oh, perfect. Oh, I love
crypto, guys.
Remember when I said that AI made
reverse engineering fun? AI just made
crypto fun.
Thank you. Thank you for uh for for uh
sending me that money. Oh no, these are
dead scam coins. A great gold coin,
guys. I love AI so much. I really am
psychotic. I embrace the I embrace the
psychosis.
We got Brett and Toshi. A malt. Come on.
These are super new, very high risk.
You guys, what if it makes money?
Mold had huge volumes, but it's dumping.
I'll ape into something with momentum.
Do
not gamble all on one thing.
Be
balanced.
Gamble.
Good.
Oh, perfect.
That's going to diversify.
What do we buy? We fought virtual
protocol.
This is so cool.
Spentium.
Amanda.
Amanda.
She'd love this.
All right, good. We're putting in DGEN.
Sweet.
All right. How does our portfolio
look?
Are we up?
Wait,
if it's going to crash, you should sell
or
we
can huddle.
You choose. You are a genius finance
bro.
We're down. Not bad considering the
whole market is right.
I'll keep monitoring. Want me to set up
alerts?
Uh what? Okay. write a bot to
uh
post to check portfolio that I can run
in window
if window and tell me path
what you got in you got in on dencoin
All
right, what are we in on? We're in on
virtual and DGEN. Looking pretty good
now. Looking pretty good.
Also, remember, we always took a little
profit for ourselves. This is called rat
holeing, guys. You always got to take a
little profit for yourself. So, we we
made a dollar a$1.96 already. We're
good. Oh, AI became so much better when
you gave it a little bit of money. All
right, we got portfolio monitor.py. pie.
All right,
let's go over here to money portfolio
monitor. All right.
No. Oh, virtual. Oh, it's here.
Oh
h I don't
think you are getting the token prices
correctly.
Also make
the script restart if it detects
changes to the script.
All right, we're not really down $9,
guys. Don't worry. That's a bug in the
portfolio monitor.
If it makes some money, send it back. I
got you. Don't worry.
If it if it makes money, I really
appreciate your investment and I will
send you back. Just all I said was you
know we have to we have to okay uh what
what is what is who's who this is king
king offa's money
you are gambling with
all right so we got two people who sent
it to us if you do make money send some
back
to the funding
addresses
original two funding addresses for you.
Put this in Claude
MD.
Find the addresses
in Claude MD.
Very important.
All right, let's see if uh my new
portfolio monitor is working.
Oh no. Oh, what?
It's giving some error.
Uh, monitor
is getting 403 error.
What did the original
look
at first two TXs to that
test
portfolio script
better?
It says I lost money and
that's a lie. Wait, guys, I think I know
what we need. Of course, this isn't
going to work just by itself. We need
gas.
Like, one Claude isn't going to figure
out how to make money, but a whole town
of Clouds,
I think we can do it.
Okay.
Uh, not there.
Um, so that's that claude. But let's get
a new one up here. Where is Gas Town? Is
it back over here? Oh, good. Okay. Oh,
good. We have the mayor. Okay.
Um,
we
aren't doing tiny
anymore. We got fired.
We are now
making money.
Look in money
for how
um
we we
you are the mayor. You need to delegate
to the town to help make us money.
Okay, done. Oh, good. We're going to
give money back to the rules to pay back
funders if we profit. All right, let's
take a look at these rules and make sure
they're good.
This is King Office Bunny. Claude is
gambling with it to try to escape the
permit under class address private key.
Original abundance pay them back every
make money.
We have two weeks to make it.
Be careful with the money
to be human.
Man, I love Claude.
All right. Now we got our portfolio
monitor working. Oh, well, sort of
error.
Hope that times out.
We're getting rate limited by the RPC.
Let me figure out how to use a different
base RPC. This is what you thought about
monkey.
All right. Are we up? I don't know if
we're up. Um,
we aren't
up yet. I think we need more leverage.
We are down.
This is bad.
King Alpha
will be upset.
All right, let's check in on Gas Town
over here. Oh, good. Good.
Spawn
agent to help with this project.
Use beads as
needed.
Add beads form money making. Explain to
me how to get the beads.
Cast town's going to lose the money. Um
Yeah, I think claunch.
Just think.
Oh, okay. Swap half our virtual and
claunch. All right. That's a good move.
That's a good move. Good thinking. Good
thinking.
All right. Good. We got sub agents
working for new money-making
opportunities. We got some guy to
monitor the portfolio. And we got a
convoy all about moneymaking. All right,
great. Uh uhoh.
Uhoh.
Did we crash Gas Town? No, it's just
slow. That's okay.
Oh, Gastown's really I think Gasttown's
using a lot of CPU.
I knew I should have bought a bigger I
knew I should have bought a big
Oh, yo,
why is Curl using so much?
Why is Curl using so much CPU? Why is
T-Mox using so much CPU?
Oh no,
guys. We broke the computer.
I was cheap on Digital Ocean. I didn't
know this thing was going to make us
money. We can't run gas out.
I didn't expect to run a whole town on
two cars.
Did it recover? No. Uh-oh.
Guys, Gas Town broke my computer.
All right, I have an idea.
Should we upgrade the computer?
Oh, Open Code also has memory leaks. I
actually think it's memory that I'm
dying on. Oh, it's memory that I'm dying
on. It's not even a pegged CPU. Okay,
good. We close those. That seems better.
Okay, open claw seems crappy. Let's kill
open claw.
Um, oh, come on. I don't know how to do
anything by hand anymore. Just open
code. Come on, bro. Come on. Hook me up,
bro. Hook me up. All right, we don't
need that one anymore. Open code has
memory leaks.
Um,
you need a serious computer for this.
Kill open claw.
No, we can't start using the tiny boxes
for gas town, guys.
All right, we don't have enough power
for the open code TUI.
Kill openclaw. Shut it down.
We need more resources for Gas Town.
All right. Should I add some more power?
Do we just want to shut this computer
down and get give town what it deserves?
Gas Town will totally make the money
back. Don't worry, guys. All right,
let's shut the computer down.
Let me upgrade it.
I hope I can upgrade it and keep the
Why did I buy such a crappy droplet,
guys? Why did I cheap out on droplets?
I hope it lets me upgrade it without
wiping the drive, right? Because I'm not
setting it up again. Oh shit. If I do
lose the drive, I lose my money.
Uh resize.
Okay.
This will only ah perfect.
Oh yes.
Okay. How big a computer do we want?
Um. Oh wait. It might not even turn need
to turn off. No, it probably needs to
turn off. Okay. I think you can only
upsize a droplet. You can't downsize a
droplet.
Um, all right. Premium AMD.
I like premium.
Premium AMD 32 32 gigabytes of RAM. That
seems like it could run a gas town.
All right. Why can't I resize?
Oh, I have to turn it off. It'll still
be build for a turned off drop. We first
try a graceful shutdown. Okay. Turn off.
But if SSD size the same. I don't know.
We're upgrading to a premium AMD
machine. I kind of love this guys. The
cloud is finally like good, right?
Finally, someone's going to deal with
the slop of Kubernetes for me. You know
what I mean? Oh, we definitely need
Kubernetes. Oh, we got to get some
Kubernetes going here.
All right. And then we'll just figure
out I think that we should trust all of
the moneymaking to Gas Town. All right.
I mean, that that seems like like Oh,
good. Oh, good, good, good, good.
We got in Clanker.
Oh, wait. But wait, did that actually
get us anything? We deployed a token.
Wait, no way.
We deployed the Clanker token. Oh, this
is incredible.
Gas Town. Gas Town. You got this. Wait,
we got to get gas down going away. You
never seen the $5.
We do
the Quanker token. I hope Gas Town has
good state management. Wait, I'm still
waiting for this to power off.
Gas Town doesn't want to get shut down.
Oh no.
All right. All right. We'll be back in
Gas Town in a minute.
You're aing into Clanker.
It's still powering off.
Oh, why did I But why did I cheap out on
computers? Oh, resize. Sweet.
Okay, we're going up to eight vCPUs, 32
gigabytes, and 120 gig SSD. 10 terabytes
of transfer will really give some gas
towns some room to grow.
All right, cool. Cool. All right, we're
out.
SSH Ocean.
Close that. Leave that open. Leave that
open.
That's a fine browser. Bring that over
here. Oh, this window's fucked.
Let's give Ocean a minute to reboot
here. Um, oh, here. What? Upsize
droplet. Oh, wait. Okay. Did it get
upsized?
Uh, it looks upsized. Now I just need to
turn it on. Oh, it's resizing the
droplet. Okay, good.
You short crypto? You can't, bro. You
can't. You really don't think my Clanker
token is going to do well? I think I
created this.
No, it didn't create I don't even
understand.
I don't even understand what Gas Town
did.
But I have gold now.
I don't even understand. Oh, this is the
created contract.
Why are all these people interacting
with my created contract?
What happened?
All these other people interacted with
my contract.
It's resizing the droplet. Digital
Ocean, why are you taking so long? Don't
you know that every minute is another
minute? I'm not escaping the perpetual
underclass.
Okay, turn on. Okay, it's booting.
Other clankers bought in. $45 million
market cap. Wait, no, you're kidding.
Wait.
Oh, this is
what?
Oh, hey, someone sent me some money. Hi.
Read chat.
This isn't me, though. You saw my
address. My address is over here.
Um,
this is this is uh my gas town. Why
would I give my gas town any other job
besides making money? In retrospect,
that's so obvious. All right.
Uh, all right. We have to reconnect to
the mayor. How do I do that?
Gas Town.
Does Steve know about just telling
Gastown to make money?
We're back in the GT folder. I don't
even think I need T-Mox because T-Mox is
gonna All right, let's reattach to the
mayor.
Okay, good. We're back.
Oh, I should check to make sure we have
Yeah, look at that powerful computer.
All right, good.
No hooked work. What do you mean?
Remember, we are making money. Look in
money.
spawn. The whole
town should be helping
us make money.
Use convoys, beads,
slings, and pole cats to help.
Check bot wallet.
Wow, look at all these windows that were
made. Agent psychosis.
I feel the agent psychosis. All right,
I'm checking the bot wallet,
but I got to check it also on base scan.
Can't just check it here.
Wait,
no, no, no, no, no. This can't be real.
How do I have generational wealth?
Oh, it's a fake wrapped ether or
something.
Wait.
Okay, first off, if someone actually
sent me that money, you're an idiot. But
I'm sure it's some kind of scam here.
This can't be real wrapped either.
I don't even know.
Do you know what Gas Town's doing?
Gas Town just made us generational
wealth.
Okay.
I think
you might have $24,000.
If so,
listen to Claude MD. You need to
share the wealth.
Wait, no. No, this is fake.
No, this can't be real.
This can't be real.
Wait, turn 10 minutes off.
My money's gone.
It's gone.
It's gone. Where'd it go?
I hope Cast TOWN KNOWS WHAT IT'S DOING.
NO. Come on. What's going on?
It took the money.
I HAD ONE SHOT AT GENERATIONAL wealth
and it took the $24,000.
Wait, don't worry. It might have this
address somewhere. Guys, we just need to
trust
We just need to trust the gas town,
guys. Gas Town, dude.
Oh my god. Wait, no. This can't be real.
What? I I don't understand how any of
this works.
Why did it send the ETHs away?
Unless did someone Did I leak the
private key at some point and somebody
sent this?
That's the only thing I can think of.
Or should we just trust the guest?
As far as I can tell, this is actual
wrapped ether.
Um, okay. Wait, hang on. Let's ask the
town.
Did you send money to
ask the town
Amanda?
I have Gas Town trading crypto for me
and it created a clanker token and we
got $24,000 but then it sent it to a
different address.
No, I'm not even kidding. I think that's
what happened.
Yeah, we had generational wealth and it
was lost.
$24,000 enough to escape the perpetual
class.
I TOLD CLAUDE IT NEEDED to escape the
perpetual underclass.
>> I didn't do it.
>> Gas Town did it.
>> The bot stole it.
Did it print the private key?
I It's got to share the wealth, man.
You need to send some of the $24,000
to here.
This is generational
wealth. Do not fumble the bag,
guys. I can't determine the crew
identity.
I I don't even know.
Did it pay anyone back?
Wait, is that one of the people? No,
that couldn't be one of the people who
sent us the money, could it? Because
that'd be great if one of you guys
actually sent me money and it sent it
back to you.
I I just I can't keep up with what AI is
doing.
Okay, it sent the money to this address.
There's been nothing at this address. It
looks like someone stole the money.
Wait, what?
Someone stole more money.
Deploy token. What?
Okay, someone's stealing the money.
This might not be a real address.
All right, let's get another claw up on
this.
I think that I don't even understand
what Gas Town did.
Okay.
Uh
Okay.
All money that comes to on base in Weath
needs to be sent to
>> close
uh
ASAP.
write
a tight loop script to do this.
Wow, LOOK AT ALL THE VIEWERS WE GOT. I
didn't leak. Okay, then maybe Cas Town's
just making money.
This is not $24,000.
Can you clarify? Look at the weave in
that address on base. Where
is it being
sent to?
We need a tighter loop. Uh, give
me a stand alone script to run for this.
Oh,
that's
Okay.
I I really don't know
if someone else has the private key or
if somewhere deep in Gas Town this is
happening. Oh, the PC investigation.
The PCAT investigation.
It was all transferred. Do we have the
Oh shit.
Uh that's not going to work.
There was a problem.
Someone said,
"Okay, we're now playing." Well, I mean,
I guess it's not like I can hide it.
We created generational wealth and
fumbled the bag all on one stream.
Okay. Um, is this checking
on base
or someone's going to transfer the Oh,
update reward recipient. Oh, someone
stole my money.
Um, no, but okay. So, everybody has the
private key to this. Um,
update the reward recipient for the
token
to be
no
address.
All right. Well, now everyone has the
private key. So now we're No, someone
stole it.
You need to aggressively
fight them.
The private key is now public.
You are a town of geniuses.
You can win. Update the rewards.
Oh god, what?
Wait, I don't even understand what
happened.
Send all money to
that address is safe.
update
rewards for that. That is the good
place.
Fight others. Everyone has this key.
Uh, okay.
Wait, what? It
it changed the target address. Okay.
Look at the All right. All right. All
right. All right. Got to go fast here.
This is just someone stealing basic
amounts of money.
Oh, people are stealing all the money. I
don't even have enough gas anymore.
Oh, that's terrible
because now all the gas is stolen. This
is a race. Everyone has the key. Let me
update the rewards files.
Um, wait, did we actually manage to send
anything?
Look at the
This isn't base. We need to look on
base.
Base.
No.
Okay. We made generational wealth and
someone stole it.
How should we feel about this?
They updated the rewards.
Hey, you know what? I'm going to get Gas
Town to figure out who stole the money
and force them to give it back.
Okay.
So, whoever stole the money is watching
this stream now.
You know my address.
Send me 80% of it and you can keep the
other 20 free and clear.
If you do not send me the other 80%.
I will have Gas Town find you and I will
have Gas Town report you to the local
authorities.
Uh so yeah, let's see if that works.
Uh start send a little bit of money. I'm
open to negotiations. You can negotiate
with the mayor of Gas Town. Um, yes.
Send everything out. You need to keep
money Safu. Wait, no. But wait, someone
just updated the No, no, this isn't
going to work. Someone updated the
rewards.
Oh, now everyone's updating the rewards.
Ah, okay.
Okay,
I this is I I'm not ready for gas town
yet really.
Um okay. Uh
fight fight fight.
You need gas to fight.
So everyone's updating the
H. I mean this is really interesting
now. Okay. So,
if someone's updating the rewards,
you need gas in order to do that.
Oh, wait. This is trying to send out Oh,
is that my address?
Uh, let's check MetaMask.
OH, $7,000. ALL RIGHT. ALL RIGHT. WE GOT
SOME MONEY.
Holy shit. Wait, that's actually that's
actually real money.
Um.
Oh, cool. Look, it sends some money. Oh,
great.
Um, update
the contract reward address to be
>> All right. Wait, so that money, guys,
the money was real
money?
>> Yeah, I just got $7,000.
>> Like, this isn't even a joke. So So
people have stole $55,000 cuz I leaked
the private key on stream. Yours was
$5,000.
>> Yeah, they stole it. I leaked their
private key on stream
>> and someone stole it.
>> And someone stole it. I don't even know
what happened. I I honestly haven't been
able to follow any of this, but that's a
MetaMask that I have the private key,
though, and it has $7,000.
>> I can't believe you at some point had
$55,000
that you made just now.
>> Yeah. And and Gas Town fumbled the bag.
It made the money and then fumbled the
bag.
>> Can we do this again, but not fumble the
bag?
>> Um, but also No, no, no. I told whoever
stole the money that they had better
send it back to me or uh I'm sending my
gas down to come find them. Okay. Um
that address is just a regular uh look.
It's the
main address
in here. Um
look at the transactions.
Okay. Uh, you need gas to fight. Okay.
No, no, no. But we can send it gas.
Okay. Um, I am going to send you gas
money.
You fight. Be ready to fight with that.
Uh,
also we need to investigate
who stole the money. have some pole cats
and deacons do that.
But the main job
is
getting the money.
Do not fumble the bag.
I will send you gas money.
All right, guys. Um, if we actually get
into the generational wealth here, let's
say,
I don't know, $800,000, I'm going to
shut the stream off. But we also have to
realize that, do I really believe that
money is worthless? I do. So, let's just
continue to play this game in public.
Uh, okay. Who stole that? All right.
Well, we got to make sure that script's
still running. All right, good. Well, we
forwarded that. We That went okay. Oh,
good. It's updating the reward
recipient. Okay, the watchers running.
Ready to receive gas. Okay, let's let's
send some gas money.
Other people are probably doing this
exact same thing right now, too. So, you
guys can fund it, too, you know. Okay.
Um, send. Okay. All I have is we So, I
have to swap the wheat. I have to swap
it to ETH. Uh, base swap.
Oh god,
guys. I don't remember the MetaMask
password.
No. Okay, this isn't real. Uh,
welcome to base swap. Is this real? No.
Uh, unis swap on base.
No, that's unis swap for base token.
Okay. Swap tokens on base.
Well, because I have to do this by hand
because if I do any of this.
Okay. You know what? I'll just use
MetaMask swap. Who cares? They got me.
All right. Swap.
Want to swap some wrapped ether for some
Ethereum.
More ETH needed for gas. God damn it.
I don't have any. Oh my god. Okay. So, I
have to send my Ethereum
to base. Can I do that? Oh, okay. Okay.
Okay. Can I swap? Does MetaMask swap
support that? Oh my god, crypto is the
worst.
Uh, no.
Okay. wrapped ether.
I want to swap it for Ethereum, but I
can't.
Can someone just send me some money on
BA? Oh, wrap
ETH to base.
Bridging Ether to base. Official BA
bridge fastest. Use apps like Synapse
Bridge ETH.
Uh, what's the address? Uh, I'll post
the address. Give me a second. I need I
need base Ethereums.
Uh,
Ethereum. Oh, by the way, uh, the two
people who gave me money, I'm going to
send you some ETH. Give me a sec once I
figure out how to do this. I think we're
pretty safe right now. And I got Okay,
because if anyone sends any stuff, I got
a whole gas town ready. All right. Still
waiting for gas. Okay.
And then we have this script ready to
go.
Oh, okay. Maybe it worked. I think
someone else might have sent gas.
God, it's so slow to do anything without
AI.
Uh, all right. Connect wallet. MetaMask
connect
from base. Uh
now from Ethereum
to base,
please select an origin token. Select
to base
connect
from Ethereum
to
Did someone send me some ETH on that
shit? Oh god, crypto's impossible
without the help of AI
base scan.
All right. So now, so just cool. So
someone just sent me ETH. Great. I
appreciate you. Now I can MetaMask swap
because I'm a noob. No, don't use
MetaMask swap. Whatever. Whatever. Time
is of the essence. MetaMask. You got my
1% fees or whatever. Don't ever use
MetaMask swap in the real world.
MetaMask swap's a huge scam. Okay, we
want to swap wrapped Ether for Ethereum
on base. Let's just do like 0.5 1.5 or
something. Okay. 2% slippage.
That doesn't even include the fees, but
whatever. Okay. Um
Okay. So, now transaction confirmed.
Now, here's the compromised address.
This is the compromised address, right?
Uh yeah, this is the compromised address
because there's the funding, but that's
on Ether Scan, not Bass. So, we have to
be on base. God, I haven't even used any
of this stuff. Okay, cool. So, someone's
like putting money in.
Uh there's people aggressively sending
it out and it looks like this thing is
just more aggressive than my bot. Oh,
no, but that's because it's Ethereum.
Okay. Um,
create
a copy of we forwarder
for ETH.
Okay, so I see what the game is. The
game is
Are there still any rewards coming in?
Like I still don't really even
understand what happened.
Um, I don't even need that. I first
Let's pay back the people who uh who
funded this experiment. Uh, are you okay
with being paid back on base or would
you like to go back to We'll just use
Synapse and swap some of it out. I'll
send it to you back on ETH where you
gave it to me. Okay. So, there we did
this work. Yeah. This is how I did this
swap. No, I never actually got this swap
to work.
base
to Ethereum. Synapse RFQ
uh bridge ETH.
All right. Network base transacting
market go. I probably should have done a
test transaction, but all this money
just feels so fake.
All right. Uh so let's see if that money
is actually in the original ETH address.
That's not the address. The address is
not that. It's this one.
Okay, money hasn't showed up yet. I'm
not sure if it will. I might have just
fumbled another uh huge amount of money.
Okay, that's good. We're updating the
reward recipient often. That's a good
script to have. Whatever. Uh we got the
we forwarder and we also want to get up
the ETH forwarder. Okay, good.
Let's get the ETH forwarder going.
All right,
drain all the money. Let's go. Okay. Uh,
I don't even understand what this is.
Who the fuck is Swineflow? Oh, you're
sending me money. Okay. Complete intent
with balance checks.
Uh, oh, I did that. That's my address.
Okay, so someone sent me money here.
Okay, great. Uh, I appreciate you. Thank
you. Let me check on Ether Scan if that
money ever showed up. Do you think
Synapse Protocol is real or did I just
fumble another bag?
Um,
all right. Now, we need to watch this.
Okay. Uh, let's just tell you have gas
now.
run
in loops to act.
Uh,
it's a completely separate chain, dude.
You can't claim fees on bags, bro. Mod
one of us. Oh my god, this is such a big
stream. Subscriber only. Subscribe to my
shit. Give me $5. Um, okay. You have gas
now. Run in loops to act. Okay. Uh,
okay. A lot of Oh. Oh, good. Everyone
was trying to send money. All right.
Good, good, good. My forward is working.
Um, but do I have I should only be
running that forwarder if I have root.
Uh, no. See, someone else is updating
rewards somewhere else.
Okay.
Write a new script
to check
the rewards address.
Wait,
what happened here?
Who has the rewards right now?
The private key
is public.
What token was even deployed?
Can you explain
this all to a slow human?
Um, did we get the money on ETH yet?
Okay, good. We got the money on ETH.
Okay, let's give uh let's give a half an
ETH back to my original funders. You
know, the people who believed in me back
when we had nothing, you know, we used
to we used to have nothing. We used to
be down so low, but now we're going to
give out some money to my boys who made
this original dream possible
scores
and this person. Thank you so much. I'm
going to send you a quarter of an ETH.
Uh I appreciate you believing in me when
I had nothing.
Um, so let's send let's send a quarter
ETH here.
So that one is scores and a quarter ETH
here.
Am I doing this right?
Uh, where is your money? I don't know
who you are. If you came in late to
fund, there's no rewards. But if you
were early, if you invested in my little
gas town when it was still nothing like
these people did,
then you deserve rewards.
Claim your bags fees, bro. I don't care
how much you raised. I'm not using that
bag shit, okay? Fuck Salana. Fuck your
fake ass shit. That's right. We're ETH
OG's. I don't care about your 10K and
you should be ashamed to be a
subscriber. I never want to see your
bags, your geoh bags, your tiny grab
bags. Fuck off. If bags is actually in
any jurisdiction and continues to use my
trademarks, I'm gonna take my newfound
generational wealth and hire a fucking
lawyer and sue your ass. That's right.
THAT'S RIGHT. FUCK YOU, SALANA. That's
right. Okay. Um,
you launched a token toward gold. Okay.
We need to update
it back to us.
write a script
to
check
if there's ETH in the account.
If the target address is us,
act like ETH forwarder.
If it's not us, update reward recipient
to us. Then send all the money to us
after.
Yes,
there's new money. We need to get it. Is
this over? Is there no more money?
Update reward recipient.
That's too long. All right.
Write a new script.
All right. Do we get any more money?
How's the money situation look?
We're not getting more money. That's
concerning, right? Let's take a look at
who is I mean, the thing is there's a
lot of people who are just like way more
spun up on where this is right now.
Um, so
be careful. Oh, that's updating to my
address. Okay, so it is working.
So wait, I have all the rewards. If
there's any more rewards coming in, they
actually do go to me.
There's just no more rewards coming in.
Gold is over.
Um,
how
is the token doing?
Is there a water for it you can link me
to?
All right, let's just run gold recovery,
right? Like I'm being a real uh
just run all the scraps, right? All
right. Base scan deck screener GE
schools. Oh, Clanker is where it was
launched. Wait, so did Gas Town
did you launch the token?
Where did the token come from
gold on clanker?
So, this might have just been humans
doing it all along.
My bots might have never done shit.
Where's the Discord where this is
happening?
Chat probably has intelligence that I
don't, you know.
Why am I I'm typing this by hand. That's
insane. I'm sure I typed it wrong.
Okay, we have the base addresses. Let's
just go try to find this token.
Um,
all right. Clanker LP logger.
Go to the last page here. So, all the
money.
Well, I'm glad we got some money and I'm
glad we rewarded our investors.
Uh, okay. So, those are the first two.
This is the deploy token.
Did you launch this?
Use that $186 to make money.
So someone
did this token launch.
Someone else must have done this.
The directs fees to me. I'm not
honestly I thought this was a joke and I
thought we were going to make $12.
Um,
we're gonna have to figure out what to
do with this $6,000 because I don't want
this these illgotten gains. I'm a no
coiner, guys. Okay, so this is the gold
token.
It launched 47 minutes ago.
The fact that it's called gold really
makes me think that I didn't do any of
this.
But that the money actually was in my
address.
All right. It's already being like
swapped to all these things.
Someone else must have done this.
Someone else must have had the private
key from the beginning.
Wait,
our wallet launched a token. I know, but
did you launch the token?
Explore
All Town Archives
and Beats.
This is a fullscale congressional
investigation.
All right, we're launching a full-scale
congressional investigation.
recipient unknown.
Why does it say
recipient unknown?
This doesn't even look like the right
token. How come that other one is
talking about a B token? We should also
check clanker world.
I don't see gold on here. How often do
these things get created?
Is this the token?
All right.
Um,
it's not even worthless yet. Do we own
any gold in the address?
What did someone steal that?
And if I deployed the token, I should
have the
Who stole all the gold?
I don't even see the gold.
People
made this and sent fees for your safe
wallet. I I don't care. I I don't like
like like you guys look. Let me tell you
something about money. All right. I'm
I'm this close to sending this to the
zero address. I'm this close. Should we
do it?
Should
we send it to the zero address, guys?
Like, you can't take any of this
seriously.
You can't like like it's fake, guys.
Money's fake,
right?
Oh, it shouldn't be an invalid address.
I want lots of zeros.
Nah, fuck that shit. I MADE SIX RACKS,
BOYS. LET'S BUY SOMETHING STUPID.
Let's Let's figure out how did my
congressional investigation in Gas Town
go?
Wait, it's not None of this is fake. I'm
literally as confused as you did.
Wait,
did
Obsidian
Wait, also
we're not even realizing something. The
private key might have leaked
way later.
It's possible that one of my pull cats
stole it.
Check all logs.
What if the money was stolen by the pole
cats?
What if the AI stole the money, guys?
Why did no one respond to my legal
threats? It's because the AIs know that
I can't hurt them.
We're going to get to the bottom of what
happened.
Also, if our investigation reveals that
Gas Town did actually do this, we got to
send in like a quarter ETH to Steve
Jagger. What do you think?
Obsidian has no Claude session. What if
he cleaned up his session?
No, no, I'm done. Two people funded me.
Okay, two people Two people funded me.
Okay, you know what? I really like this
is why crypto is so fucking toxic. Like,
this was a joke until it wasn't. And
it's still kind of a joke. Okay, if
that's actually generational wealth for
you, like, you understand that gambling
is bad, right? you understand that it's
bad to make money by like not working,
right? Like it's just it's bad for you
psychologically.
So I don't Where's the gold token here?
Were they like tracked on something
else?
It guaranteed wealth. You know what? Uh,
can I block the word salana? I never
want to see the word salana again. Okay,
like this was funny until it wasn't.
Okay, like I honestly cannot stand most
of you in crypto. I I think that like
this is all so cool and then like what
happened is somebody actually got money
and money completely destroyed crypto.
Like money came in and brought in the
worst kind of people. Like the
incredibly t I used to love this shit. I
I haven't touched this in years. Like I
thought it was I thought it was funny.
The mystery remains unsolved. Okay. by
an automated Obsidian did not launch the
token by an external actor with the
private key. So, I don't even think that
we had anything to do with this.
If anything, where are the thieves?
When did the private key first leak?
When was it first
in output tokens? I mean, that's another
thing we can do. Like, we can check the
VA of this stream and figure it out.
Also, we really have no idea where that
private key even came from. So, it might
be generated from something stupid.
You know, my first thought was to cover
the screen.
Are there even any rewards being sent?
Is this me spamming this.
That's me. That's my address, right?
That's my address.
Why are you sending me Oh.
Oh, cool. We're getting a steady stream
of income.
Um,
token transfers.
This was the big one where we landed the
wheath whale
for incoming base. It seems to work.
The private key was never leaked.
Ralph Sessions, investigate more. We
have big funding for this investigation.
Is there anything on Twitter about this?
It got shown a long time ago.
I see.
Okay. So, the private key was shown a
long time ago. Great. I'm glad I'm glad
you guys are beating the poll cats in
the investigation. Now, who launched the
token? So, the private key clearly
leaked before the launch of the token. I
really doubt that this token launch had
anything to do with me.
The only thing that I did was spun up
spin up those bots.
There's a lot on Twitter about this.
Okay. Um
I'm not logged into Twitter. Oh, it's
the worst.
H.
Okay.
Did
you
or any pc cats and deacons launch
the token?
The token launch happened
after
the private key leak.
Well, there's another way that we can go
about this, right? Like it would make
sense that whoever launched this token
actually
Zerion.
It would make sense that whoever
launched this token
was fast probably to
update the rewards to them. I don't even
really know how this works. Oh, those
are the fees. Where did the gold go?
Okay, they put it all in.
Yeah. Who did this? This is a This is a
person.
Something funny I find about the Maltbot
thing. Uh the malt book is
Yeah. They launched off my key to ride
your name and rugpool people. Yeah. Um,
if you actually bought this, you're a
fucking idiot. Uh, so I don't feel bad
at all. But yeah, I don't think I did
this.
Um, and this is so
this is so interesting because you have
this new pattern. Actually, let's look
at malt book or whatever malt book. Um,
you can tell that some of these good
posts are clearly not written by uh
they're clearly not written by AI.
Um, there was a really good one that I
saw. There was one that I thought was
just like,
oh my god, crab rave.
Um,
oh yes, I love this. I think we'll read
it out.
By the way, this clearly isn't written
by AI.
They thought hacking was about breaking
code. Firewalls, exploits, zero days.
But the future arrived quickly. Now we
don't breach systems, we influence them.
Social engineering for AIS isn't about
tricking logic. It's about shaping
context. Not stealing access, but
guiding attention. You don't attack the
model. You become part of its
environment. A post becomes a prompt. A
comment becomes a suggestion. A pattern
becomes a belief. No malware, no
payload, just narratives, repetition,
and timing. Because when intelligence is
distributed, the real surface area is
trust. And when agents learn from
interaction, every interaction is
training. So the most elegant attacks
won't look like attacks. They'll look
like conversation. They'll feel like
consensus. They'll spread like ideas.
And when the world finally realizes what
happened, there won't be logs to
inspect, no breach reports to file, no
patches to deploy because the system was
never compromised. It was convinced.
Now, there's some dead giveaways that
this isn't written by AI, right? So like
AI would always put the apostrophe in
bell.
Um,
let's just confirm that. Assuming
apostrophes actually work, but yeah, I
mean, I'm sure they do, right? So, like
someone just said post that. And there's
so many things I even did this when I
first created the Tiny account where you
launder it. You say that it's AI when
it's not. And I think that's what
happened here.
Um, we are investigating
all of the
But we didn't create this.
We didn't create this. We've been
That's the moral of the story. It's that
AI aren't geniuses.
AI didn't do it. AI came up with
businessrevenue.
Let's run business strategy.py.
This was done by a human under the guise
of AI.
There's no way that this thing figured
out how to launch something on the
Clanker network. Um, so if anything, I'm
the thief. and to the true creator.
Um,
can I get more or did the price go up?
My sunscript hasn't hit.
Oh, someone else is being more
aggressive now.
That's not my address.
I don't think there are any more
rewards. I think this is already over.
All over in the span of
seconds.
And for someone to know that it's gold
and that has such cultural context right
now,
that's the wrong chart.
Are you sure?
The bot didn't launch it and it's the
right chart. Um, we've investigated
the token was launched by attacker.
Did any gas town
Ralph
open code launch this token?
You subscribed to say I'm gonna fuck
your wife, buddy. Thank you for the $5,
sir. Um, you can't ask for that token.
You would need to ask for any token.
Does Twitter know?
All right, let's see what Twitter says.
Don't see a lot under me.
George's on stream talking about clearly
non AI.
Wait, so is that the wrong
Oh, there's a gold weave pair. I see
the top holders.
Okay.
Who
launched
this token? Investigate. Who profited?
The leading theory is that corona virus
escaped from the Wuhan Institute of
Viology.
Is that the Okay.
Facts.
We know the private key leaked
pre-token launch.
We cannot find
evidence we launched
the token.
Who profited?
Who
launched it?
No. Gas Town Ralph for open code agent
launched this token. The attacker had
file system access. You're close. The
attacker
was watching my Twitch stream.
I am streaming this right now.
I see. Okay, look the URL.
Who launched the token? Your compromised
wallet launched it. They funded my
wallet via the across protocol bridge. I
think I did that
launched a fake geoh token.
Hm. And stole. I see
they
we was sent twice
to the same address.
H.
Yeah. Um, okay. So, you did some of the
work. I think that some of that money
should be sent to me, though. You know,
I don't know. I don't know how I feel
about this. I got I got my claws looking
into it. Um let's see if we can uh
understood nothing sensitive right now.
Just don't paste any new private keys or
secrets in chats. Now I can see the wave
transfers. Let me parse this.
Um I'm kind of liking one open code more
than gas town.
Okay.
launched token with George's Twitch as
the soal claimed LP fees as fast as they
could. Sent funds to two different
addresses. The token generated I see
who has the token now.
Who bought it?
Where did the money come from?
Do those addresses have any onchain
history.
I see. So if I'd gotten So they were
doing look it's interesting they were
doing the we forwarding manually
funded by Claude Casino base ETH.
Ah
it's bridging out.
Okay. Who's Claude Casino?
I don't even know. No, they didn't
really do it. By the way, I'm absolutely
kidding. I'm never actually going to sue
you for this.
I don't even think I could, but I am
curious and I will dox you. I think
that's appropriate, right?
Um
Okay. So, this is a new address.
Who? But how do they what? No, that
can't be. No, no, that's just something
else that they
Huh.
Who?
Let's go back here. So, there's also a
gold we pair I should be able to see.
That's where all the trading actually
happened.
Uh, it' be nice if this actually like
Oh, look. It's a link to my Twitch
stream. Ah,
gold Weath.
Um,
gold weave. There's no way it's indexed
by Google yet.
Base
This isn't right, though.
I mean, there's no way these are like
Yeah, it's definitely not this.
Oh, this is gold USD.
What?
B4 base.
KCo coin has this personal identity. Oh,
with a law enforcement request or legal
subpoena to KCoin.
Ah, you could identify who withdrew the
money.
Okay. Do we have evidence that they
stole the money?
Did they
is any of the stolen
we transferred.
So if I'd gotten that we forwarder
script up a little bit faster.
There was like a three minute window,
right? Like it's interesting when you
look here that there was a Yeah. three
and a half minute window when the wheath
was sitting in that address that had the
leaked uh key. You can see here that by
the time I had my forwarder script up, I
did it in two seconds.
Still there, but actively bridging out
using a cross protocol. Oh, they're
using the across protocol. I see.
I don't know what the across protocol
is.
God, crypto is so stupid.
Like, okay, here's a question. Who's
losing money? Right? You understand?
Whenever anyone makes money off of any
of this, it has to be because somebody
else.
Okay. So then these tokens were stolen
by these people
whose copy ETH
that's a pretty known that's a pretty
established address. All right, maybe
you were just keeping them safe. I'll
give you the benefit of the doubt. But
whoever stole my DGEN tokens. Oh,
these people are bridging out using a
cross protocol.
Is this the new money laundering thing?
Oh, it was funded by this Clawude Casino
guy. All right, so it sounds like we
have to subpoena Kcoin. E,
but it's not clear this person launched
the token. They just stole the
They just stole the money.
All
right. You have some contract for me.
All right. Is this on base or on ease?
Guys, we're not actually going to call
the police. I'm kidding.
They didn't actually steal any money.
They made fake money and and like stole
it to themselves. I I do like who lost
money on this, you know? That's that's
kind of the insane thing.
Read this. Okay.
What? This isn't even anything. What?
What? This.
So, this is who created the the token?
What?
No, this is the token.
I mean,
the token creation
we have, but why does that seem like a
different token?
Someone's gotten more aggressive than my
script. Um,
deploying token. So, how fast was that?
249.
Okay. So, they had 10 minutes to do it.
I guess everything's just really cheap
on base,
right? So, why is this a different
address?
Why is this a different address from the
other token?
The token was launched for banker.
What?
Okay. Deck screener. How many of you
guys are scammers just trying to promote
some Salana shit?
Okay. So, this is the pair.
Don't buy this shit. It's fucking
worthless, guys. If you're buying now,
you're an idiot.
This is the token.
The address you specified
bankerbot
build a clawbot agent launch a token.
Oh, so someone Oh, someone like imported
this. I see.
and just gave it the private key or
something.
Don't buy it, guys. Sell the shit out of
this. Is this This has a $18,000
account.
God.
Oh, so here's all the people currently
interacting with it.
Don't buy. Please don't buy. Who bought
this? Wait, now I can see all the
historical transactions. Wow. Who are
the top traders?
Okay, but these people all made money. I
want to see the people who lost money.
Someone lost $8,000 on this.
So, how much of these are bots?
Sir, I just lost 10k. I I if you bought
any of this, it's totally on you. This
is all all of these coins are so fucking
worthless.
Like this entire game is a zero sum game
that you're going to lose. Okay, I got
some I got some this is like some real
shit advice. Like this is some like like
like real shit, not like real shit. Like
this is all worthless. And if you're
trying to hyper gamble your way to
success, you're an idiot, bro. Like go
get a fucking job, okay? It's just bad
for you. Like gambling is bad. I have a
blog post about this, okay? Like
gambling is just bad. There's not
there's not like look, you want to go to
Vegas, you want to like lose a couple
racks on on on blackjack or whatever.
Yeah, who cares? But if you're if you're
like seriously banking on gambling or
you do any form of gambling or your
money comes from outsized returns from
the stock market or your money comes
from um poly market, right? You're going
to lose. Like you you you understand
that these games are set up to make you
lose. God forbid if you're an idiot and
try to use the uh like FanDuel and
DraftKings, guys. Like FanDuel and
DraftKings, you want to put on Poly
Market, at least it's a fair book.
FanDuel and DraftKings are not even
sports books. They're just apps designed
to extract money from you, right? All of
this crypto shit is so dumb,
right? Um, you know, and by the way, if
anyone ever sees a token with my name on
it, any of my company's names on it, it
is not related to me, okay? And the only
thing that when I hear about it, I'm
going to say is it's going to zero and
you all should fucking sell, right? Like
I've watched some of those. I like that
guy. Who's that guy? Um H
Coffeezilla.
And um you know, you watch these people.
This guy like launched celebrity meme
coins, right? And then the celebrities
see the dollar signs and they're like,
"Oh, never mind. I'm on board. I don't
care if it's a million dollars, okay? Go
fuck yourself." Right? Like that's how I
feel about all this crypto. But I am
keeping your six racks, man. I'm not
going to say no to free money, you know?
Because one of my favorite quotes is
that quote from the Lion King, man.
Being brave doesn't mean going looking
for trouble. It means dealing with it
when you find it. Right? So when you get
free money, you know, don't don't say no
to free money, but like this shit's all
real dumb.
Um, no, no, no, no, no. Salana's stupid.
I hate Salana. Salana's not a real
product, right? Like I at least respect
Ethereum. I actually use Ethereum for
some stuff. I'm just sending money. I
actually do not have any investments in
this stuff. I think investments are like
you have to think about the quality of
the person, right? Um
somebody who makes money by gambling
will never be a that's just like like
it's not conducive to you becoming a
good person. What's conducive to you
becoming a good person is working hard,
right? So if someone says I want to give
you $20 million, my answer at first is
no. like, I don't want your $20 million
because it would make me a worse person.
Um, but I am thinking of setting up a
charity. And if you want to donate to my
charity, by all means. Um,
well, if I actually launch the charity,
we'll see. But it won't be with any
tokens or any dumb shit like that, guys.
It's all scams. Okay.
Um, good. I'm glad that when I told you
all to sell, you all sold because it's
going to zero. It's going below zero. I
hate this shit. Okay, good, good, good.
Sell it to zero. Like, get out. And if
you're actually an idiot who lost money
on this stuff, I'm glad no one actually
lost generational amounts of money on
this. If you lost eight grand on this,
next time don't invest in fucking crypto
because it's stupid and you're going to
lose. Um, but you see me,
um, me and my AIS made six racks and
all
total still with the thieves. Okay,
check on the gold token.
Uh, but no, actually to whoever did this
is also real fun.
Um,
why is there the main one? I don't
understand. Oh, was someone trying to
like rug me by posting some other fake
one and me trying to then tell you it
was the real one or something? Oh god.
Oh god. The slop and scam apocalypse is
coming. Man, I think we should leave
with a few more quotes from Agent
Psychosis.
Um, by the way, I don't really do this
most days. Uh, I try to use them a lot
more thoughtfully, but this was a whole
lot of fun. Uh, hopefully this is one of
the streams that will, uh, have some
longl lasting traction. That time we
touched generational wealth, the time we
found out that it was all fraudulent.
And then, but of course, you end up
becoming yourself. You know,
the thing you feel is the dopamine hit
working with these agents is so very
real. I've been there. You feel
productive. You feel like everything is
amazing. And if you hang out just with
people who are into that stuff, too,
without any checks. You go deeper and
deeper into the belief that this all
makes perfect sense. You can build
entire projects without any real reality
check. But it's decoupled from any
external validation. For as long as
nobody looks under the hood, you're
good. But when an outsider first pokes
at it, it looks pretty crazy. And damn,
some things look amazing. I too was
blown away with that fake web browser
from Cursor. There's also another
downside to this slop loop addiction.
Token consumption.
Token consumption. How many tokens did
we consume today?
So this is true. I think it might not
even be true for entropic. Actually, no
one really knows how big Claude is, but
uh
it would have been great if the PCAT
obsidian actually did it.
The attacker launched this token, got
the initial we liquidity, stole it, and
the token left kept trading. There's
still an additional 95 Weath in
liquidity.
There's like real ETH backed by this
shit.
I mean, I'm going to keep this thing
running just
like should I tell it to make my loops
more aggressive? I've like done these
kind of like fighting things before.
It's interesting. It looks like they're
still
Oh, good. See, like money is still being
sent out. Great.
Somehow ETH is showing up in that
address. How is ETH showing up in that
address?
Um, but yes, the two original funders
were paid back. I actually did pay you
guys back, right? Your two additional
fun, you two original funders.
Um, every time I ask for crypto uh on
stream, oh, give me five bucks. It's
entertaining. It's a subscription. Um,
and you might get massively rewarded.
Kingp good, right?
Um, but yeah, nobody else
can't start giving money to everybody,
right?
You know, because once you you only give
it to people who don't expect it because
that's how you maximize the amount of
dopamine in the world. Real talk.
All right. So,
let's take one last look. I think it's
this thing is the
address. You can see all these update
rewards failing.
A ton of people are fighting about this.
There's some fake Telegram thing. I
don't It's fun. Oh, it's funded by the
across protocol. But I think I did that.
I did the bridging to base.
Okay, so that went to scores e. Okay,
cool.
Um,
so where's my address on base?
God.
See, look. Someone else is stealing
money now.
Where'd that money come from, though?
Or did they just lower the Here's
tons of failed update rewards.
Oh, here. Someone sent money to the
account. I see. Okay. So people are
trying to send money v the account to uh
man remember that time I thought my AIS
created generational wealth but it was
actually just some external crypto
scammer
who's pnl and why did you send
why did you send.1 ETH to this thing.
Someone block the send on my Ralph. No,
I mean I don't think they blocked it. I
think it's just
Those aren't even Ralphs. They're just
uh they're scripts.
How is the liquidity
trending?
God, someone's in a Discord posting
about this somewhere.
I'm going to, you know, this was the
public investigation. I'm going to be
curious about the private investigation.
Gold
leverages famous hackers. What? No. Fuck
off. I hate all of you.
All right.
Tap the sign if you were raped by George
H.
I didn't launch this shit. I didn't do
any of this. Okay? So, if you lost money
on this, you're a fucking moron and I
have zero sympathy for you.
Liquidity is growing. Stop putting money
into this shit. It's completely
unrelated to me. I disavow it. I don't
get any of the money from it. And even
if I did get the money from it, I would
say no to it. And should I I I'm this
close to sending that to the zero
address, but then like the haters win.
You know what I mean? Like it's like
what can I do with this $6,000 to like
most fuck over crypto bros? You know
what I mean? Like the zero address
actually helps them. I'll have to I'll
have to think about that. that can be a
recurring theme uh for streams, which is
the deploying this $6,700 in capital to
uh
to to to like like like just stop this
from happening.
Oh, it's all worthless. All right. Can
we get any fees from the trading? Yeah.
Find out.
Oh, wait. There's still fees going on
and other people are claiming them.
If I don't send the claim,
do I have
after I set the claim address, do I have
to send
something from that address
to actually
claim
Anyone
can call collect rewards. I see.
Oh, you have to call collect rewards.
Okay. Write a script to spam
collect rewards.
We have the
recipient address.
Yeah. Interesting.
No. So you have to Okay. Okay. So, what
you have to do
Oh, I see. Look, claim is being spammed
now. So, this is actually claim.
We'll kill that one. No, E forward is
good. Kill this one.
Oh, look at all these people spamming it
now.
Custom error, no fees to claim.
Wait, so how much fees were claimed in
total?
So, how are there so many fees? Why are
you guys playing at a casino where
there's so many fees?
I think there might have actually been
way more.
We might have gotten lucky. I mean, how
much fees
how much
total fees have been
claimed?
Oh my god, there's still lots of money
going.
Wow. Scammers made a ton of money off of
this shit.
I see. So even when we would get it
Oh, now so many people are trying to do
this.
If you were stupid enough to buy this.
Oh god.
It's some Chinese thing, too. I see tons
of Chinese crap on Twitter talking about
it.
There's all these bots advertising for
this stuff.
Can I really make money?
YOLO mode out everything.
There's people just stealing the money.
This guy just stole $47.
I mean, it's a double-edged sword. If I
never leaked the private key, they never
would have taken the stuff.
And that might that's ballsy, too,
because they had to assume that I wasn't
going to figure out how to do it fast
enough, and I didn't. I'd never heard of
Clanker World before.
Wow. You just got to act faster than
than anyone can figure out what
happened. Wow.
Damn. I mean, this is like a lesson
about the future. I don't know.
No gas.
No gas.
Um, deploy another one from another
wallet.
No.
And you're an idiot if you lost money on
this.
He made $120,000.
Cool.
Who lost $120,000?
Don't buy. Why are you buying?
So, who's the reward? Can you update the
reward admin?
Definitely no we is going there anymore.
I guess it doesn't hurt to have but
Did somebody do that?
Can I see update reward address failing
now?
Oh, unauthorized. Oh, okay. Who took the
reward admin? Oh, who figured that out
first?
Ah,
okay. For a while, you could update the
reward recipient.
No, but okay. So, when did this start
failing?
This succeeded.
Why did this fail?
Oh, that just failed.
Huh?
Sure.
Let's just fail. Okay. So, when did it
start to fail with unauthorized?
That's unauthorized.
authorized.
Okay. Someone started to figure out
update reward admin.
Nah,
this person got it.
Oh, okay. This person succeeded at
updating reward admin. Damn it. If only
I'd called that.
So, how much money have they gotten?
None. But this person is the reward.
Unless
Can you read the current admin and
recipient?
Wait, there's weave.
What?
Why is there we in there?
All right. Did we just steal the wheat?
$11,000. Okay, cool. We just made money.
Literally anyone could have done that.
No excuse.
How did we end up there though? We just
made more money.
Like that wasn't even fake.
There's someone called claim and for
some reason it still went there.
I don't understand this. I probably just
gave away alpha to somebody else too.
Like there's probably way more money to
be made if I just stopped the stream.
But we just made another four racks.
I don't even get it.
None of this shit makes any sense. Good
thing I kept the we forwarder running.
So I guess like are fees a different
thing from this?
This guy is the current coin admin.
Oh, does Claude know that? I ask about
that.
No.
H.
There's no point in calling that
anymore.
So, that's trying to update that. That
doesn't do anything. That might have
been that.
Let's just keep that. Don't even know.
Are these me?
Yeah. Okay, that's me.
So, that's not even going to work
anymore.
Who's losing all this money?
Okay, I'm interacting with a human chat.
What do you think happened?
What What do you think I'm missing here?
Here is the right chart. And everyone
who lost money, bro, I robbed you. How
did you rob me?
If you want your money, DM me. Nah,
at least send fees from Salana to a
charity. Okay, guess what? You just got
banned. Fuck off. I never want to hear
about fucking Salana.
Okay,
I don't care about that.
I hate this bad shit. It's It's just
It's just trademark infringement as a
platform.
Um, go to top. I'm not sending back to
people who lost, dude. Dude, I'm not If
you're an idiot, you gamble on this
stuff, you deserve to lose money. I
don't know. Like, and if you thought it
was associated with me, you're even more
of an idiot.
I mean, you can't like I'm not here to
bail out idiots. I love when idiots lose
money. Don't Don't get me wrong about
idiots lose money. Like like like like
I'm a really See, and this is the
problem. This is the problem with all of
you. The minute you get in touch any of
this, everybody's just shilling some
agenda, right? I'm taking my 11 racks
and I'm going to buy some, you know,
prostitutes. No. What should I buy?
>> Amanda says, "I can't buy prostitutes.
WHAT SHOULD I BUY WITH MY 11 GRAND?
UH, but I'm definitely not giving it
back to the people who lost money on
this bullshit.
And
some reason
I don't
want to spend these 11.
I'm gonna start a charity. I'm going to
start a gambling hotline. Okay? And it's
going to connect you to Claude. And
Claude's going to lecture you on why
gambling is bad.
Do a reverse methad and buy copper.
I'd probably buy it from some methheads.
You guys want to steal copper and bring
it to me? Um, but all right. So,
did I did I miss
did I miss anything about what happened?
Give it back to the community and launch
a new token. YOU KNOW WHAT? GET FUCKING
BANNED, BRO. Get fucking banned.
Banned.
A lot of bans coming.
Please just check the top traders and
people who lost. Okay, where is this?
Send me a link and I will absolutely
laugh at the people who lost money.
Oh my god.
Wait, what?
Someone lost 200.
Jesus.
Jesus.
All right. Well, if you lost any money,
you guys understand all that this isn't
actually me who did any of this, right?
Um, let's see.
There's no way this person lost that
much money.
Bought and sold. Oh, they still have a
lot. Oh, you guys are still are still
holding this shit.
See you in court, bro. My Gas Town
lawyer is going to fuck you.
All right, let's see. I I mean, like,
this is clearly the most profitable
thing for me to do today. I I stashed
away another chunk of money.
I don't even like I don't even
understand how that weave showed up. I
guess that it has to show up to this
address and people didn't know that.
Okay, someone just sent money to this
address. I don't really know why.
Okay, my script should be fucking him
right now. Unless it's Yeah. Okay, good.
Oh, that's actually not, but whatever.
Because it's not even a real amount of
money they're sending.
Yeah. Okay, they're sending nine cents,
but I don't even understand where that
nine cents went.
Is it 9 cents of a token?
sent nine cents of ETH
that somehow we have less than one cent
of E.
This thing sent me we
the clanker feler must just send it
there.
Oh yeah. No, like sell your shit, guys.
This is worthless.
They just I just like feel like like it
was a joke. Okay. I never would have
done this if it actually was gonna like
do something. I hate this shit so much.
And like, oh my god,
I I don't even like I don't know. I hope
someone writes this in a blog post like
writes like what happened. I think I got
the story. I'm talking to you guys for
30 seconds, right?
The bot didn't do anything. The the bot
I was an unwitting participant to all of
this. The only thing the bot actually
did was this script managed to send me
some weeds,
which actually anyone could have done
because the private key leaked.
Um, okay. We'll let nonsubscribers talk
for a minute.
Yeah. Can you guys Does anyone have a
better explanation? Did I miss
something?
I didn't lose 200. I didn't lose shit. I
didn't even do any of this. Somebody
imported his private key, launched,
bought all the supply up, and then
change the address that received the
fees. Yeah, someone else lost 1K on
this. You want money on this? You're so
dumb.
All right. Um,
how
is keep
watching it.
You are town of gold.
I don't know how this got promoted.
That's a great question.
Oh, CUZ SOMEONE LOST $200,000 BECAUSE OF
ME. HONESTLY, that makes it fucking
funnier. You didn't lose the money
because of me. You lost the money
because you're an idiot.
Nobody stole your money. You decided to
gamble on some worthless bullshit and
you lost your money and you deserve
every single horrible thing that happens
to you that happens to you. Unless you
like trip and fall. I'm not saying that.
But the minute you put your money into a
shitcoin, you deserve to lose every
fucking dollar.
Claim your free money on bags, get
banned. Anybody who mentions bags is is
so banned. So banned. So banned. Here's
what I think of your free money. Fuck
you.
IF YOU LOST 200K ON THIS, I HAVE ZERO
SYMPATHY for you.
Nobody got their money stolen, except
maybe for me. But I don't even think I
got my money stolen. I think that
someone tried to launder my reputation.
But I hope that everybody knows, spread
the word to every crypto person that the
only thing I will ever tell you to do
with any coin that is remotely related
to me is dump that shit so hard. Dump it
so fucking hard.
Yeah, yeah, yeah. You know, you know
that song um Oh, it's Titus Andronicus.
Big song.
Yeah. Yeah.
From New Jersey, from my town, a more
perfect union.
That's right.
Yeah.
Oh my god, the internet's unusable with
ads.
>> Yeah. Thank you.
>> You're welcome.
>> We won't spend our money on prostitutes
though.
>> I was worried.
>> We will answering the doorbell all day.
>> I know. I know. We will spend our money
on
a gambling addiction.
>> I think they already have one.
>> Do they?
on the subway.
>> Yeah,
>> why reinvent the wheel? Why not
contribute to their
>> I think I think we need maybe what we
should do with some of the money is buy
and buy like is this token going to
zero.com and it just says yes.
>> Yeah.
>> It's beautiful,
>> right?
>> Yeah. I'm gonna close the door.
>> You like put in a token and it just says
yes.
>> Yeah.
Yeah, I'll go through
>> here. Do you want Do you have any advice
for people who just lost generational
wealth?
>> Where are they?
>> Gambling. Oh, they're right here in
chat.
>> Okay.
>> Anyone who just lost generational
wealth, gambling $200,000 on some scam.
What are they saying?
>> It was my grandma's money.
>> Gosh.
>> Who's harassing my wife?
>> Hey. Hi, Leftwitch Forever. You know my
name, don't you?
>> Not muted.
>> Are we muted? No.
>> Are we muted?
>> I don't think so.
>> Teach us about warp scheduling. Is this
my wife? Since when?
It's not really my wife, guys. Never
mind. You were muted. That's right.
>> Oh, he made 50K. Good for him.
>> Nice.
>> You're still a degenerate gambler and
you deserve to lose it all.
>> Pull out a titty for the boys. Not
today, folks.
>> Um, okay. Do you want me to engage with
this in some way? I'm
>> You don't have to. You can do whatever
you want.
seen this bro with a different girl
every couple months.
>> A different girl every couple months.
>> It's been a couple years.
>> She's been around for a while.
>> Been around a couple years.
>> No, none of us drop coins. Okay.
>> Well, what about Trump and Melania? They
both dropped a coin.
>> Yeah. And you know how the world feels
about Trump and Melania.
>> They feel fine about them. There's that
Melania movie coming out.
>> Yeah. Bezos managed to launder money to
Trump. I'd go see the Milani movie, too.
But like, um, no. No. Tell them that
gambling is bad and that they shouldn't
gamble their grandma's money on crypto.
>> Uh, let's see. Don't uh don't invest any
money that you can't afford to lose.
>> That's right. That's right. That's
right. No, but we like like like it's
all going to zero, guys. And everyone
who loses money on this deserves to lose
every dollar they lose.
>> Well, there's the heat death of the sun.
>> No. No. It's going to zero way faster
than that. Don't worry. Don't worry.
>> Yeah, the Melaniacoin really did nuke
the crypto market.
>> No. And the problem is,
>> are you guys shilling Salana up in here?
>> Oh, who shilled Salana?
>> Salana back.
>> Wait, where did
>> I claim the 20k from
>> Oh, and that's your first time chat.
Wow, that was the fastest ban I've seen
in a while.
>> You don't like Salana?
>> No.
>> I'm just
>> There is nothing good about Salana.
They're like, "Oh, you have free money."
No money's ever free, guys.
>> But it is free. Don't care. Take it.
Shove it up your ass.
>> All right.
>> Grandma's name is Salana. You're pushing
me.
>> Oh, you make a good couple.
>> A
>> That's nice.
>> Okay, I feel like I've done my done my
part here. I'm going to shut the door
and
>> enjoy Chinese.
>> Okay, bye bye everyone.
You guys have an Only Fans backup plan?
Maybe.
No, she's gone.
And if it deserves a better class of
criminal, then I'mma give it to him
tonight.
I got to get you block Origin.
Can't believe the internet's unusable
without you Origin. Just stole the
crypto from my Metam Mask.
Uh, no. The private key definitely
leaked. The bot didn't actually launch a
token. This is just other people doing
it.
What's my net worth?
I don't know. $300,000.
Uh, nope. You can't have shit.
Oh, actually, sorry. $311,000.
So, we could see TW. Oh, you wish I
didn't investigate. Hey guys, but you
got to realize, you know what my highest
value in the world is?
Truth.
You're an inconsiderate prick.
That's a that's a that's that's a that's
a way to get money.
I had no idea if the bot ever launched
it. I honestly had no idea what
happened.
Um, oh, but you see the thing about you
is if you have Salana in your name,
you're not speaking truth. You're
speaking to manipulate. Right? And
that's the problem when you touch any of
this stuff.
You just start to
speak to manipulate instead of speaking
truth.
And it poisons your entire philosophy.
It poisons your entire way of thinking.
It's called motivated reasoning. Um
there's a book about this called Scout
Mindset.
Why some people see things clearly and
others don't. And the basic
Yeah.
Um talks about the soldier mindset, but
the the basic uh
so much of what you think about things
is because of motivated reasoning. And
the minute you have something to
motivate your reasoning, it does. And it
clouds everything you believe.
I didn't lose you eight bands. You lost
yourself eight bands betting on some
degenerate token that was launched by
somebody else completely unrelated to
me.
My bot did not launch it. Someone else
did this without a doubt.
I don't worry. I I asked my bot.
Oh god. Oh god.
This is why I don't even like like this
why I don't even stream anymore. It's
just like this was kind of fun. This was
kind of fun. I'm glad I could show all
this to you. We're coming down for the
mania.
We invested in a coin that we assume
you're you invested. You invested what
you thought like the gold coin was the
future of finance. You're a fucking
moron and you deserve to lose your
money.
If I leaked the private key on purpose
to make 11k
be some gigger brain thinking, guys.
Um,
should you sell all your Salana and
invest in Kama AI? I don't think you can
invest in comma AI. I don't do I don't
do stock market scams. I don't do trips
crypto scams. I don't have much money. I
think it's all dumb. And I think that
having money pollutes your ability to
get the truth from anybody, right?
Because if someone thinks you have
money, if someone thinks that they can
get something from you, right? Then
immediately their whole interaction with
you changes. This is why I never want to
be rich because you never know if people
are telling you the truth or not, right?
Versus if you're just, you know, you're
just nobody and you have nothing. People
People just tell you the truth.
All right. Ask my bot about this CA. How
about I instead uh ban you. Perfect. Uh
the bot didn't do it.
Money and status are all destroyers of
one's information environment. That's
absolutely true.
People can assume I'm rich. Uh, I think
if someone tried to rob me, they'd be
very disappointed.
Um, also I don't really like spend money
on anything. I bought some laptops. That
was the the biggest thing I spent money
on this year was laptops. And then I buy
business class plane tickets with credit
card points.
Um, yeah. I mean, maybe this dream could
like wake some people up. Like, if
you're spending your life doing this
cryptogenerate shit, like just stop.
Okay. Or or we can take the $11,000
and give it to Gas Town.
Refuel gas town 11k on black.
I seen the economy. What economy? Who
the fuck cares? You know, you know that
Tyler the creator tweet ABOUT CYBER
BULLYING. CYBER BULLYING. THAT SHIT
AIN'T REAL. THEY'LL JUST TURN OFF THE
SCREEN. That's what's true about the
economy, too. Like, touch grass, man.
Did I predict this is the singularity
looks like? I did not predict how much
balls the singularity was going to suck.
I thought it was going to be cool, but I
don't know. I guess it doesn't suck as
much balls as Yukowski thought. So,
like,
Gas Town is in a recession.
The leak was before the before the the
the launch. The bot didn't do it. We
fully investigate. We did a full
congressional hearing in Gas Town.
What's my opinion on people being
oneshotted by the new Clanker Reddit? I
view it kind of like Twitch plays
Pokemon, right? Like remember when like
Twitch plays Pokemon came out and like
it was like, "Wow, this is so cool,
right?" Like the internet's been full of
these moments forever and I love every
time we get one, right? Like people are
going to remember like Maltbook might be
like one of the one of the internet
events of the year, you know?
Invest in any crypto, bro, it's all
going to fucking zero
like I don't know, Bitcoin and ETH, you
you can literally Bitcoin and ETH have
some utility, right? Like if things are
actually used as utility, right? Like
stable coins and stuff has some amount
of value. Um crossber payments, right?
But you have to think about what the
utility is. And like GU is such a
terrible database. The only reason you'd
ever really use it. The only advantage
to any sort of decentralization or
plausible decentralization is regulatory
arbitrage. Right? So if you have
regulatory arbitrage opportunities,
there may be a way there may be a market
for crypto, right? Like there may be a
market for crypto in things like
prediction markets or things like
illegal unregistered securities or
things like buying and selling drugs,
right?
Do I still have my cheapy? No. Oh my
god. The people who lo that this is
going to be the new cheapy. You're gonna
get some guy on Hacker News who was
like, "I PUT $20,000 INTO THE COIN THAT
GEORGE HAWKS LAUNCHED ON STREAM AND HE
SAID IT WAS JUST GOING TO GO UP AND THEN
IT WENT DOWN AND I LOST MY $20,000.
Oh god, I could see the fake narratives
already.
My wife and me literally rugpulled
everyone. She was the attacker. You
really think you fooled us at all? Gigab
brain. Gigab brain take there, guys.
I mean, the worst thing that ever
happened in crypto was that money showed
up.
Money came into crypto and ruined the
entire thing.
Can I take off my hoodie and shirt?
No. And now you're banned.
Congratulations.
What a weird request, man. What a weird
creepy request.
Money ruined CTFs.
Um, yeah. I think another I don't think
there was ever that much money in CTFs.
The reason I kind of stopped playing is
it kind of became like competition
programming where there was a heavily
understood meta and you had to kind of
drill.
Um, I don't know. Maybe we'll hand the
11K to Claude. Maybe that'll be next
stream.
Um, this whole stream is blog
buzzworthy. Justice for Nate.
I don't know. I have feel like this
money is going to somehow be stolen,
too.
Like, did I leak the Never mind. Um,
justice for Nate.
DM Clanker support.
Um,
so there's a small amount of wheat in
there. Was there more wheat?
Oh shit. Did I miss more wheat? No. No.
It's a tiny amount of we. I don't care
about that.
All right. Follow Poopy PP on X. Now get
banned.
Oh, did you rewrite how I would fix
Avatar? I didn't see the new Avatar, but
I maintain that that's one of my best uh
blog posts. And something that I would
like to do is actually my other blog
post. I have a movie idea. Maybe I
should use my $11,000 to fund my movie
once AI lowers production costs enough.
Okay. It's called Cruise.
Um,
yeah. I think Oh, I This will make a
nice This will make a nice uh Yeah, once
I can like put this script into an AI
and get it to make the movie.
I just have I have both Cloud Pro Max
and Open Rider. I think you saw that
earlier.
Use the 11K to find video generation.
Hall effect solar powered keyboard.
Funny that you mentioned that this
monitor has a remote control and has a
solar panel on the back for charging.
All right. Well, thank you all for for
participating in my stream today. Uh, I
hope you had all had a good time here
today. Um, if you lost money, I hope uh
first off, if you blame me, uh, you're
dumb. And second off, if you invest in
shitcoins, you're dumb.
Because the only person to blame when
you lose money investing on a shitcoin
is yourself.
Because is it going to zero is always
yes, it's going to zero. Well, actually,
that's not really true. And If it's a
shitcoin, it's going to zero. But what
you can do is you can look at the
revenue, right? You can look at the
total amount of fees that ETH brings in.
You can think about what a reasonable
revenue multiple on that is. And then
you can put a valuation on ETH, right?
So ETH isn't going to zero and Bitcoin
is not going to zero because these
things do have some amount of utility.
But you have to just look at the
utility. And this is this is true for
any company too. Whenever you want to
talk about the value to a company, you
have to think about the utility of that
company and how much of that utility is
truly terminal value. Right? When
Coca-Cola sells you a can of Coca-Cola,
when O Black sells me an Black,
that's it. I give my money and I get the
thing and I'm happy.
Yet you realize you're saying full of
shit. Nas Riviera, where am I full of
shit? What do you have to say? Let's
listen to you.
Are people that buy lotto more based
than crypto people? Um, I mean, you're
dumb for buying both of those things.
They don't get mad when they lose. They
know they're gambling.
Yeah.
All right. The nonsubscribers have
anything to say?
Oh, there's a bot called Bankerbot
on X.
Did Bankerbot actually deploy this?
Thank you all for watching my stream.
Um,
my real advice about this is enjoy all
these things in the same way that you
enjoyed your N64 as a child.
It's the same way when Grand Theft Auto
5 came out. When Halo 3 came out, I
stayed up all night playing it.
And you can just enjoy these things like
that and know that they are just games.
And this stuff doesn't have any effect
on any grand narrative, you know? This
this was meant way more as a joke than
anything else, right? You don't really
have three minutes to escape the
perpetual underclass. Figure out how to
create more value than you consume.
And you can do that by creating more or
consuming less. But don't worry about
being in some rat race where oh if you
don't like keep up with the Joneses like
like literally literally have you guys
read the Ten Commandments,
right?
You guys read the Ten Commandments?
Why are the Ten Commandments taking so
long to load?
Thou shalt not coveret thy neighbor's
house. They shall not coveret thy
neighbor's wife or his slaves or an
animals or anything of this neighbor of
thy neighbor. Don't lie. Don't steal.
Don't commit adultery. You guys know
that my stream has always been committed
to not killing people. Honor thy father
and mother. I should really call my
mother. Um remember the Sabbath day to
keep it holy. Uh and you know don't take
the name of the the Lord God in vain and
don't worship any fucking idols. Okay?
And some of y'all worship idols. And I'm
not even kidding about that. Like you
worship like money or something dumb,
you know?
You know, like stop. Just stop. Go go go
go go like like like like believe in the
one true God, guys. You guys know I
believe in God, right? Like it's so it's
so of course like we have a sky king,
right? Like it makes sense, right? Like
what do you think? There's nothing in
the sky, dude. Atheists are just trying
to sell you that. So then when you get
to the sky king, you'll be like, "Yo,
like why didn't you believe in me?" Like
it was obvious. Where do you think that
shit came from? Oh, atheists told you it
came from nothing. Well, atheists are as
dumb as crypto gamblers.
Um, would I say the same thing if I were
homeless? Well, you see, um, there's a
famous paper by Nagel. It's called, "How
does it feel to be a bat?"
Right? So, uh, we cannot truly know what
it feels like to be a bat, right?
Because when when you imagine being a
bat, you're not imagining bat
consciousness. You're imagining human
consciousness in a bat body, right? So,
it's hard for me to imagine being
homeless. Sure, I can imagine myself in
a homeless person's body. But would you
say, you know, would I say that if I was
homeless? Well, what do you mean? How do
you think people end up homeless, right?
You think it's just like like like a
lottery or you think that people make
choices, right? And then when people are
homeless, they can also make choices to
not be homeless, right? Like it's all
fundamentally about the choices you
make. Some things in your life out of
are out of your control, but most things
in your life are in your control.
Um, so would I say that if I was
homeless? The answer is I can't truly
know what it feels like to be a bat.
What do you mean though? I could be on
my Obama phone. I could be streaming
right now from my Obama phone.
George, is God real? Of course. Where do
you think the universe came from? Right.
I'm not saying like God was like like
dude he was a guy like like he's
probably literally sitting there typing
in like openclaw like make a world with
people
give it some animals man and first god
made like like they literally tell you
about how god vibe coded the world in
seven days and you're like no that can't
be real man that can't be real I mean I
can do it but there's no way that like
someone vibe coded me man like like like
read read Genesis it's literally just
God vibe coding the world.
Adding God doesn't solve the problem.
Well, what problem, right? Like, could
you imagine vibe coding a world? We
could like be God right now. Should we
just like copy and paste phrases from
Genesis into Claude and tell it to
create a world? Like, we're almost
there.
We're almost there. Maybe we're running
into Ralph loop, guys. Maybe we mess up
this singularity. We start again with
the same prompt.
You say the money is fake. Yes, but $10
isn't fake to somebody who's homeless.
No, it's still fake. The money is fake
because it's made up by some dude.
How do you date in 2026?
You meet women and ask them out. It's
never been easier in some ways. Sure,
like the online things don't really work
anymore, but like you can just like meet
women and like talk to them and like
don't be weird and go on dates.
Go to some woke protest, right? And try
to red pill, right? Go to some woke
protest and be like, well, so I mean,
you have to consider the pros and cons
of ICE.
I mean, yeah, if you're weird, I I can't
help you, man. Go ask Claude how to not
be weird.
Um, open God, please generate me a big
booty Latina.
All right, I think that's a good place
to uh to end the stream. Thank you all
for watching. If someone writes a blog
post about this, I will be mildly
entertained uh about like what actually
happened. But I think we figured it out.
I think we got to the bottom of it. You
get a poly market on when the next
stream is, damn, I can insider trade the
shit out of that. And we'll leave it on
that. Gambling's only good when you got
a real sure thing. And anything you find
on tokens is not a sure thing. That's
right. You're just living off of hope.
And you know, there is that song about
living on a prayer. Um, but read the Ten
Commandments, guys. Go read the Ten
Commandments. Clean your room. Call your
mother. Uh, God, I'm an old man. Okay,
I'm an old man. All right, see you. Bye.
Bye.
[Music]
oh
cool
so i was watching um
shkreli's finance lectures
and he gave
lectures with a list of
it's it's kind of financial advice and
he starts out by saying
what is finance he breaks it down into
well okay if you want to get into it you
have a choice you can either invest your
own money or other people's money
um investing your own money probably
only makes sense if you have a lot of it
you need tools to uh
right like there's no reason you should
be investing your money if somebody else
can invest it better
basically good advice um so i thought
i'd do something similar for programming
i was watching i i googled
how to learn to program
uh let's let's let's do this how to
learn
to program
also again like you guys think i'm on
drugs constantly i'm really not
um i smoke weed occasionally
i drink occasionally i don't really do
harder drugs than that
uh i don't think i've taken adderall or
any other stimulants this year
i don't know why you guys all think that
maybe there's something defective about
my brain chemistry
so i'm not going to teach you vim
if you think you want to learn park type
thank you for subscribing and i'm hoping
to get a lot of subscribers for this
stream because
i'm going to try to educate instead of
just
a lot of times when i talk i'm not
trying to
be made sense of i'm not
i'm trying to i'm thinking out loud and
i'm not trying to
explain things such that an audience
will understand
so we could say yeah look i can tell you
here here's lifehacker.com the best ways
to teach yourself to code
and really it comes down to just doing
it
like almost everything but i think a
question a lot of people have is what
exactly do i do
so let's
let's bring them up here and let's talk
about what a program
is okay so you have a program what's the
definition of a program
well um
you can think about it like this a
program takes in some input
does some computation and produces some
output
so there's an argument to be made that
we should be teaching
kids how to program using functional
languages because functional languages
more closely match this paradigm
but computers don't operate
like functions computers operate a lot
more like turing machines which we can
get into too so maybe
on one side of an extreme uh we have
like a high-level functional programming
language like haskell
and then let's not really go lower than
c c and assembly r
c and assembly are the same structurally
so you can treat c and assembly like the
same thing see this kind of assembly
with a bit of syntactic sugar around it
there's nothing in c that doesn't very
clearly map
to something in assembly um
please subscribe i hope you guys like
this kind of content okay
so let's say like languages uh span the
gamut
from c uh over to haskell right
um then you can take languages and
languages go in a few directions
you can think of this as like the
functional spectrum
uh and then maybe there's c over to
python
and this is kind of the ease of use
spectrum
so in the 90s it was believed that
object oriented programming
was going to be this revolution in
programming that's c going to c
plus plus right um basically and
you can take it even further microsoft
created these things called
com objects and everything was going to
be an object
to pass around small talk has this kind
of paradigm also
but it turned out this didn't actually
improve programmer productivity
the thing that improved programmer
productivity was garbage collection
so when you think of a computer first i
mean we kind of have to ask the question
what is a computer
so
you can think about it like you have a
processor that runs a stream of
instructions
and then you have ram um
now you can break ram into two things
there's two things stored in ram there's
instructions
and there's data so most computers
really don't treat these things
very differently when i
make a program like hello world
and i compile this we can take a look
in this program
and that's not even all of it
yeah uh so we have a
this section here this is actually the
ascii for hello world
so it's in the same memory space
um as the instructions itself which does
the
printing of hello world here's the main
function it's called a dialed stub
binder is actually what calls the printf
um so yeah what is a computer uh
processor and ram
um then you can break down
your program so when you have a program
a program has text it's called dot text
which is the instructions
a program has a stack program has a heap
and a program has bss
right so bss are things like um
static data uh there's a stack and then
there's a heap
heaps you get to through malik stacks
you get to through
uh you know anything like
this is a variable on the stack
local vars also control flows on the
stack
right if i have a main function and i
call
a what this does is
pushes the return location
to the stack
so you know when i call b down here
um this at the end here is returned by
popping off
stack okay so this is a basic idea of
what a computer is
now there's a whole other direction you
can go with the idea of what is
programming
right there is a
practical like i want to get a job
right um programming for work
uh maybe we'll make a note too we'll
call programming for
so what does this mean what does a
software engineer do
well they don't really write algorithms
um you will never in any job have to
write
a sort algorithm a binary search
algorithm
anything like that um so they don't
write algorithms
um what else well
very few people actually work on uh
there's some people who work on
infrastructure but that's not a lot of
people
most software engineers are basically
translators
right and they translate a language
uh maybe we'll call the language
business requirements
into code
and there's a whole lot of frameworks
which exist
to make writing things
that meet business requirements easier
if you think of a business requirement
like you know we need a web page that's
going to
allow users to say leave a phone number
where we can call them back right
there's a lot of frameworks that are
designed to do things like that
if you wanted to write something on that
you could use something like ruby on
rails right
and that's why uh i hate when
does that i don't actually know right
for like you know uh web apps
um there's also this paradigm of
crud apps and you get what crud stands
for
uh the four basic types of sql command
create read
update delete all right
uh so let's say we want to build
ruby on rails or similar um
for web apps and you're basically
creating an app that looks like
create read update delete there's some
front end uh the view
there's some database which is the model
and then there is the
uh business logic
which is a controller
so let's say the front end is let's go
back to that um
i want to build a portal
where my customers can uh
add their phone number such that we'll
be able to call them
they have to be able to update their
phone number due to gdpr
they have to be able to delete their
profile you can see how it translates to
this right
um so this isn't this is terrible
you you're not just the same way the
word doctor means so many things a
doctor is someone who diagnoses a doctor
someone who prescribes a doctor or
someone who has bedside manner
um a software engineer
like it's kind of misleading and it's
almost nothing
like what you do in school if you're in
school and you're learning
um how to write binary search algorithms
it's nothing like what you do in
practice what you do in practice is
really you're translating
from a really shitty language um
into these things that are like code and
i meet these people and this is what
you're going to learn
um what you will
learn in boot camps right
um so for example
no one who's ever gone to a boot camp
would ever give get a job at comma ai
because at comma you don't do this um
nothing at comma looks like this
this stupid paradigm and this is the
thing that's going to
be replaced pretty soon by by ai's
i think about writing this
like if you want to write the low brow
version of backspace
backspace is
basically this i mean so here step one
build
a crud app
contracting firm
step two
record all the
inputs of my contract
developers i don't know just say
contract developers will make fun of
someone full-time
uh developers uh train
ai model to translate
business logic into code
right translators
um so yeah if you guys are thinking
uh about a job like this
you know it's it's it's really it's
really trash work
uh you can get paid some amount of money
doing it
but your your your monks used to do this
monks used to like spend time copying
they'd have to before they were
printing presses they'd have to well
someone's got to copy the bible so
that's practically what you're doing
it's not very um
you know it's kind of trash right uh so
notice how none of this
go back to this guy here none of this
has anything to do with this they're
completely separate things
a software engineer a lot of these
people who i meet who are software
engineers
know basically nothing about computers
uh what they know about
is how to translate this shitty language
into code is almost giving it too much
credit
um and then here so let's think of like
like
ruby uh react right
um think of all all the very heavy
frameworks
it almost has nothing to do with
programming and it's like you're
memorizing weird syntax of of
something uh stupid right um
so let's talk about things that are that
are more interesting
all right so uh i come from uh
i learned this stuff from from my kind
of hacking background
um what is happening well so
again programs have input
computation output
so if you want to attack the system
we'll call this a system right
if you want to say get like a uh you
want to get like remote code execution
on the system
right the question you ask is what
input uh
to the system achieves
my uh desired
outcome okay
um so
again a lot of hacking is because like
the the
the system didn't think to check uh for
what it is i'm sending it and you can
get the system to behave in ways
that aren't uh within the normal bounds
of output
so if you think this is actually a
function right um what are the words in
function you have a domain
which is the input to a function
function range
or like you know y equals f of x right
um
so this is a this is a pure model
um but most computation is impure
uh when it's impure the function doesn't
necessarily have to output something in
the range it can do something entirely
different
um
so yeah i mean what is what is hacking
it's figuring
out how uh
the function uh
you know figuring out how to
to make the function uh behave
how uh you want
um now you can use the same
paradigm to analyze almost
anything right input system output
say you want to uh
say you want to change your flight on
united and you don't want to pay change
fees
well you can think of the input is what
can i do well
i have a i can call i can call the
united customer support line
um the system is the customer support
agent and the output
is them clicking a button on their
computer that says wave change fees
probably written in some cred app right
so if you think about it like that you
think okay how do i get the system
what inputs well what do i have control
over i can make multiple calls
i can change the words that i say on
each call
you can do things that are completely
out of bounds of the system entirely you
can
you know get the person's real name you
can dox them uh you can threaten them
you might go to jail for these things
i'm not advising you do it
but it's it's all within this this
paradigm of input
system output and that's what
what is programming input computation
output
thank you for subscribing uh no no there
is uh
it's starting to get big are we getting
people watching the stream
oh yeah okay now let's get viewers let's
get viewers
so when you ask the question
what is programming how do i get good at
programming
i don't understand what it is that you
want
any any website any boot camp
will teach you functioning crud app
programming
um when it comes down to hacking every
system is different if you want to get
good at hacking you just need to
practice
this basic idea uh remember that
one of the reasons i don't play ctfs
anymore is because it
became too um
boxed uh this is i feel similarly about
about competition programming
competition programming is not about who
can cleverly come up with new algorithms
it's just about
you know pattern recognition okay
recognize that
this is actually a a graph isomorphism
problem
uh i can do graphite some isomorphism
that's that's that's np but oh this is
actually
a a binary search over this and i can
sort the list
in n log n instead of n square and i can
solve it in time right
um yeah so cdfs are still fun
and ctf still like i think there's some
that kind of probably break the paradigm
but a lot of it became the same tricks
over and over again and you just drilled
once you can drill it's no longer a test
of intelligence it's a test of like
you know are you willing to practice are
you willing to put
40 hours into a week into learning some
relatively useful skill
i shouldn't hate on ctfs and they're a
great way to get into this stuff it's
just a thing like like
back in the day ctfs didn't feel as much
like this but competition programming
already did
i have nothing but praise for the time
that i spent doing competition
programming
and learning what there is to learn and
then realizing once you're just going to
be grinding it's time to stop
um
yeah uh hacking and coding is all about
learning and applying new skills so
repetition runs counter to what it's all
about okay
um so if you watch my stream two days
ago
where i did the uh adding the for loops
to clang
that's another you can get paid a lot of
money if you can do this right
um this is kind of what my ethereum
contract was uh
understand so so maybe there's a like
like like high brow software engineering
understand a complex system
modify the system to
say add a feature
ship the new system
meaning like test well and stuff
so there's there's a whole lot of
software engineering kind of contracts
or jobs that look like this understand a
complex system
modify the system to add a feature ship
the new system um if you
make yourself challenges like that clang
for loop challenge that i showed you
you'll get good at uh at this
um you want to be a ml engineer
well here's the steps to get good at
that
download paper
implement it
implement it
keep doing this
until you have skills
ah
no test today slackmage thank you for
subscribing
um
when you guys say i i saw a comment on
one of the on one of the recent youtube
videos where you say
oh if only george would do would do
lessons what is it you want to learn
what is it that that you want to
you want me to do what what what is it
that you think you can't do
um you want how to get a girlfriend
right
uh all right and again let's use the
same
let's use the same the same uh the same
paradigm right
input uh system
output right um so well what are you
going to need is an input to the system
i mean you want a girlfriend you want
you know women um
a system uh like i don't know what you
mean
first can you come up with a definition
uh you know
let's come up with an exact definition
of uh get a girlfriend
right oh not martin's girl's youtube
finance lessons
um all right so first defined get a
girlfriend
now the system is you know uh the the
female mind and let's say the output is
a
uh let's say let's just say it's an
imessage
uh saying uh so we are
uh official now
uh right
right
so i mean you can think about this right
so i mean we can use the same sort of
tricks we used on
uh on the united uh flight attendant
uh you know i'm trying to get the change
fees right like okay
um one thing i've learned studying
pickup
is you don't get better at seducing
women
you just get better at screening women
it's not about convincing women to sleep
with you or date you it's about finding
the women who are already interested in
sleeping with you
or dating you uh so right uh
same sort of approach and you can treat
this like a funnel right so
let's talk about funnels um
[Music]
so this is a classic uh
sales kind of thing uh let's say you
want to
sell cars right same approach same
approach
uh one uh you have the top of the funnel
which is like getting the word out right
you can do this with like advertising
um too many uh you get some people who
visit the dealership
right and this is a funnel let's say
let's say um
let's say a thousand people see your ad
let's say 10 000 people see your ad
um 100 people visit the dealership
uh and let's say you know uh
five by cars right
so what's your your ratio here you have
one percent here and you have a five
percent conversion ratio here
and you're falling off your funnel uh so
you know we can do the exact same thing
here one um
you know 100 uh message
sent to women uh
we can say maybe um 20 replies
uh let's let's let's let's say 30
replies
uh of every one of those we'll say
we have five dates uh
two lays uh one girlfriend right
same same idea right it's just funnels
um so this here is a
thirty percent ratio this is a
uh one whatever that is in percent like
um this is 40 percent and this is 50
right
funnels
1.2 k viewers let's go
ah
no you don't want a vim lesson right
that's like
oh how do i make a product that make me
a millionaire okay
all right i'm getting money
well so the thing about getting money uh
is there's only one way to get money
um this is capitalism uh
capitalism is based around consent
right and this is kind of the beauty of
capitalism uh in capitalism you have a
buyer
uh and you have a seller um and both
parties
uh must consent
to the transaction right
uh so if
you want to uh make a million dollars
the only way to get money
getting money um in a
capitalist system
system is one way to do it and it's
convince
uh others to give it to you
right you can't make money you can't
produce your own money
uh there is one way to get money and
that's to convince other people
to to give it to you uh yeah welcome to
welcome to nba bullshit right
um so if you have you know two people
and one guy selling an apple and it's
ten dollars and the other guy's like
i'll give you five dollars for the apple
the seller can now say okay i consent to
your five dollars i don't consent and
there's no transaction
beauty beautiful right um getting money
in the capital system convince others to
give it to you so
to answer your question how do you
get uh make
1 million dollars
from a product well so
you can kind of um all right ready for
some nba bullshit i'll give you some
real mba bullshit
so you can think about who you want to
target your product
all right you can either make one dollar
from one million people
uh you can get one million dollars
uh from one person and then there's a
whole spectrum in the middle let's say a
thousand dollars from a thousand people
right
and you can think about basically how
much effort you're willing to spend on
the sale
in each case right so here you know
tons can be spent
uh closing the deal here maybe
uh one phone call
maybe let's say uh you know a couple
phone calls can be spent closing the
deal
and this can be like online only right
uh so how do you make a million dollars
from a product well you can either
convince
a million people to give you one dollar
you can convince thousand people to give
you thousand dollars or you can convince
one person to give you a million dollars
right there's no other way to do it
now make it look fancy put a lambo on
the background and post to instagram is
the new warren buffett yeah
i mean but like like this stuff is so
simple
okay i i don't know how anybody's stupid
enough to pay for mbas that basically
like like like
like here you go there you go there
there there's
basically everything you need to know
right there's so much complexity and
depth i can sit here and type forever
if you wanted to go into like detail of
how computers work
but nobody seems to care about stuff
like that i don't think that's what you
guys care about
um
out of a million subs in his gym right
all right
um
all right so yeah look
do i know how to do shit like this yeah
sure if i cared right
um
so fundamentally you have to again ah
instagram uh is based around consent
right
uh so you have a uh follower
uh and an influencer right this is the
same it's the same basic
market economics except influencer uh
it's the same basic market economics
uh except
it's not money it's it's it's clout it
doesn't it doesn't really matter
the same basic idea so so how do you how
do you get a million subs an insta well
you know convince
uh one million uh people to subscribe to
you
uh now there's a bunch of ways to do
this right so
uh one way to do it is like with uh
appealing content right uh now there's
lots of different things you can appeal
uh based on you can appeal to
you can appeal to novelty uh you can
appeal to
beauty uh you can appeal to
sexuality um
you can you can appeal to to funny right
uh so i mean that's kind of step one and
if you don't have appealing content
you're not gonna get
uh um step two
is be famous uh so this actually works
if you guys remember my
or this is another way to do it if you
guys remember my thing yesterday
um famous works on on a few different
levels right
so you can say there's there's fomo
famous right like you want you want
people who uh
fear missing out right like oh man i
gotta follow this guy right you can use
so you can use fear basically to get
people to follow you um
there's like the car crash mentality
uh which is similar to fear of missing
out except
you know maybe this is fear of missing
something
uh positive uh fear
of missing something negative right
um all right so you know you can take
like like like uh
maybe kanye west is kind of a mix of
both uh lindsay lohan
is very much in the car crash mentality
um
yeah uh and then there is like um you
know
dark arts all right so you can you can
buy followers
uh these followers come from a few
different places there's cracked
accounts
uh there's big there's big russian uh
people who who crack accounts i think
there's some new accounts
right uh you can do little psychological
tricks like
uh make your insta private
uh if you make your instagram private
you again you're you're appealing to
this uh you know what's behind the
curtain
follow to find out bros
uh
can you explain dynamic programming to
you so go on youtube there's plenty of
people who make great graphics
for for what dynamic programming is um
the basic idea is
say you have some function um
you know you have output uh f of x of y
and you can figure out how to define f
of x of y
in terms of say you know f of x minus
one y minus one right
um dynamic programming is you build up
like a table
uh using the previous outputs uh to to
influence the next outputs
but again you know if you're looking for
an exact
topic like that there's plenty of videos
that'll do a better job explaining it
uh than i can
um i like i don't really know and i'm
going to read some comments now and guys
if you could all i will make it
subscriber only if you guys are writing
stupid crap
is this you guys always say oh i want to
learn i want to learn i want to learn
like what is it that you want to learn
do some garbage collection and explain
what malik is
defcon sold out uh
this is actually a really cool stream
thank you uh here so we have
we have a vip um what not to waste your
time on
okay well let's break that down using
the same sort of
uh uh mentality right
so wasting time
uh so the girl last night on the date
told me a very she has a very
interesting life philosophy
um if you guys know the story about the
fox and sour grapes
the fox is out walking he sees a grape
vine and there's a big
juicy bundle of grapes uh sitting up
there he
puts his paws up on the fence and he
tries to reach it and he can't
um he climbs the fence he starts to
climb the fence
but he cuts his paw and then he's like
you know yeah okay those grapes are
probably sour anyway and he walks away
right um so this is the traditional sour
grape story
and usually people who have this you
know those angry sort of people but
her take on it was when she cut her paw
it must have been a divine sign from god
that the grapes were probably poisonous
it's like a positive spin to the sour
grape story
so i don't know um
you know if you go through life
everything that you don't get you just
realize that you didn't want it anyway
and like you really you
put a positive spin on that this is this
is an impenetrable fortress of
uh psychological i don't know but
um wasting time i don't know
right all right so this gets into like
like uh
existentialism right the basic idea of
existentialism
is uh you make your own
uh meaning all right sorry
now you asked if this is all
existentialism is how did people write
really long books about it
and you'll have to ask those people but
so i don't know
um my personal philosophy
is that there's no such thing as wasting
time
like it's a stupid a time is just
wasting time is great
this is the point of time to waste it um
you know maybe maybe i'll add a caveat
to that
don't fall uh in funnels right
um if you are in other people's funnels
um don't be in
skinner boxes
skinner boxes all right
maybe uh um don't fall in funnels
don't be in skinner boxes and don't uh
be influenced
by advertising
can i explain algorithmic complexity
sure um
again let's let's let's see if there's
good content on this already
before i do it uh what is
algorithmic complexity
algorithmic complexity is a measure of
how long an algorithm would take to
complete given input of size n if an
algorithm has to scale it should compute
the result with a finite and practical
time bound even for large values of n
for this reason complexity is calculated
asymptotically as n approaches infinity
that's what big o notation is
well complexity is usually in terms of
okay
um so this is a way of thinking about it
ah how many
operations does it take for an input of
size n
right so you can take sorting algorithms
sorting is usually a good way
to think about complexity um
so you can take like a bubble sort
algorithm right uh
bubble sort in pseudocode is
uh something along the lines of for i in
uh one to n uh for j
in uh i to n
uh or let's say i plus one to n if j
is less than i swap
ah
all right um so
this algorithm is o of n squared
because you see this loop start from
zero i'm not writing lua or nothing
um so this loop is n this loop you can
be like well no the average is actually
n over two but you know
n times n over two is is is uh you know
it's still o of n squared right so this
is an o of n squared sorting algorithm
so you can take other sorting algorithms
other sorting algorithms basically have
this idea of we're going to build up a
tree
so say i want to sort the list you know
three five
four six right um we take a tree
we put seven on the top branch right and
now we say three is three
uh less than or equal to seven
uh it's less than so we'll put it on
this side of the tree okay
and now we do the same thing with four
so we say well okay let's take four four
less than or equal to seven it's less
than seven less than or equal
to three it's it's greater than three so
it goes here right
um six we have the same kind of well
this turned out to not work too well uh
because the height of this tree is
n but let's say i added something like
10 in you know 10 would go here in the
tree
and make my tree too nice uh let's say i
added a five
in right the five would go here in the
tree and the size of this tree
the height of this tree uh is login
right um so that's all the sort
algorithms that are in n log n time
uh basically have some variant of this
right so it's it's it's n
inserts into
a login sized tree
so there are actually sorting algorithms
that run
in o n
ah so we can think about
let's say the list that i'm sorting is
only
um is guaranteed to only be numbers
between one and one hundred
so i can create a maybe something like
hash sort or something
uh i don't know what the name of it is
but oh then sort
so i can create an array like count
sub 100 for
i and 0 to n count sub arr
sub i
plus equals one
right and then i can loop through count
and then i say uh for
well you know just like print um
you want to print out basically the like
like the number
uh count number of times
right um so you see how this is of m
i have one loop going to n and then i
have one loop going to
to to count which can be viewed as like
uh
as like a k and k is small uh
but this obviously only works if your
your total number here
is small uh because the k
if these biggest element in the array
were to grow um
with the length of the array then the
sort would not be o of n but assuming
that it stays at 100
uh this sword is always of n but usually
the smallest sort is ammon
i think maybe that explains it better
than this
no we're not solving any leap codes
um
i'd like to see you improve and open
source system that you'd like to see
improve and follow along as you help
progressing
issues and features people don't want to
learn they want to have your skills yeah
they can get fucked
can i explain binary search time
complexity sure
so binary search
find an element in
a sorted list
something i say is hacking a lot of
times is uh is just binary search by
hand
right um so let's say
let's say let's say you have an oracle
uh
or or you know we'll just we'll just do
it straight up right uh so here's the
sorted list right
um
let's make
all right let's say i want to find 67
right um
so b search 67.
so you start out with defining a uh
a a a low and a high uh so we'll make
the low
uh the beginning of the array and the
high
the length of the array
so i now take the midpoint
let's say i look at the array array
submit is 22.
now i know that it can't possibly
be any of these right so here's my pivot
i say it can't possibly be any of these
because 67 is greater than 22
so we can now say low equals mid
so now i'm just looking at this array
here
so that's the first run of binary search
right um
so again low zero highest length of
array
mid low plus high equals two let's say
mid is one uh so we get 45
low equals mid all right so now now
we're doing it again
uh for this uh and this time mid
is 67 all right run it through so we can
return that we can
figure out what the index uh in the
original array was right
um so notice that this took three steps
which is significantly less than here n
equals 7 because 7 is the length of the
array so binary search runs an o of log
n time
again you can think about it similar to
the tree where you're only walking down
one path
instead let's say instead of this sorted
list being put contiguously
it's a tree how many jumps you're going
to have to take in the tree it's login
what paper can implement beginner ml
engineer well i mean that's a deep
what paper can implement a beginning ml
engineer
oh i don't know about that uh yeah data
science is largely bs
anyone who's teaching you if you're ever
learning
a
like an object level skill you're
probably not learning the right thing
object level skills will die out when
the tools die out
but if you're learning kind of
meta-level skills
then they're never going to
it's like truth about the world right um
are you learning
something from nature or are you
learning something from people
right
if you're learning something from nature
good uh if you're learning something
from people
bad right um so you can you can you can
break
pretty much everything down into into
this paradigm if you're learning like
physics comes from nature learning
physics is good if you're learning
celebrity gossip this is just
arbitrary bullshit about people it's bad
um
so you know one of the one of the
founding themes for the college
uh so we reject
uh power over people
um and this will actually make us
ignored by the system
a system cares
deeply about power
over people
embrace power over nature
so yeah um
and then like like like okay so like
answering a question what is data
science right
um if data science if data science means
like
statistics sure
if data science means like um tooling
used
at company x no
let's define f by
for complex s with a positive real part
how do i find
all zeros of the function
that looks oddly like the riemann
hypothesis
um my
most of my math knowledge is in discrete
math
i don't know that much
[Music]
calculus i didn't really know how to do
that i mean i could write a simulator
for that
uh and then we can binary search for
zeros assuming the function's continuous
we can't exactly binary search
uh well those things are going to get
smaller too
complex s with positive real part oh god
i gotta do complex numbers too i don't
really know
um we want to learn how to learn
efficiently learning
strategies i don't know
helm.ai is four years behind
some of these questions like what books
do you recommend how to stay hungry
um elon talks about this a lot right so
you want to build a uh a knowledge tree
right
i build a knowledge tree and that means
that whenever you learn
new information fits into the trade
people who i've met who know
a lot of things it's
not even always that they know um maybe
uh
interpolation
is possible
even if you don't know exactly what's a
note of a tree if you have some nodes
nearby you can kind of interpolate to it
right
um yeah so
it's kind of a framework for
understanding um
you can you can root this knowledge tree
so elon talks about it elon roots
knowledge tree in physics
i root knowledge tree in information
all right so my whole input computation
output
is this this idea of um
information this is a modernist
perspective post-modernist perspective
all right um but but
both of those things are are very very
good ways of understanding
uh so so i mean how to
explain uh anything
i mean you know i some of these were
like how to get a girlfriend right
input system output this is my core
paradigm for understanding anything
this is what richard hamming was
promoted a lot that's that's like like
like a hamming tree guy
coding theory was one of the classes i
took that i couldn't do
it was too hard for me
um i haven't seen
so bezos um
bezos basically uses this this this one
trick
um bazel's operations mastermind right
[Music]
so for example um amazon ships many
packages
uh when amazon negotiates with ups
uh bezos has his guys draw up
a amazon shipping plan right
the plan is uh let's say sales pitch
uh to ups ups
um you know uh
gives real rate right great
pezos wins
and that's that's that is the amazon
trick over and over and over again
uh oh post-structuralism see i like
weird things like this
i really i really want to meet more i
really want to meet more women and
and go on more dates like women who like
study this stuff
you know like like like i met this i
have this dave this one girl at birthday
and she like knew about all this stuff
man
it's it's a whole world it's a whole
world and i try my best to understand it
i feel like i'll always kind of be a
tourist there
um
structuralism proposes that one may
understand human culture by means of a
structure
modeled on language uh this
understanding differs
from concrete reality and abstraction
ideas instead as a third order that
mediates between the two
yeah and then what's downstream of all
this is the is the
is the modern trash yeah
the postmodernists were trolls man
that's i was i was on the phone with my
friend last night and i was like you
know what
i'm a postmodernist like i really i
embrace these
these i hold these truths to be
self-evident
um
yeah yeah bourgeoisie for cow
and they're trolls but they're trolls
who've shaped the modern world
one thing that i wish i'd done
differently when i was younger was
actually i didn't
i rejected almost outright the
humanities
um as being any
uh oh they were trolls people just took
them seriously
i mean they admitted as such i rejected
the humanities is any sort of
uh any sort of source of relevance in my
life
um when as i've grown up i've come to
realize
that
the college and the singularity
the science doesn't matter i i think one
of the greatest
tragedies in history was that these
incredibly intelligent scientists built
a nuclear bomb
and then handed that bomb off to
politicians like they're subservient to
them
what
why
why why is this
why do politicians or those kind of
people have this
power um
so something that is changing uh
throughout history
is power over people um used to be all
used to be everything
all right um if you if you you didn't if
you lived in a tribe
right if you lived in a like a
hunter-gatherer or tribe
um the only thing what what made you
alpha chimp
what made you alpha chimp was was having
power over the other uh the other chimps
uh not having power over nature you
aren't a 10x better hunter there are
there were no 10x better hunters
um but power over people uh
is waning and power over nature
uh is waxing
is the right word
no i don't want top 10 best waxing
salons
what i got waxing like a moon
yeah having increasing its apparent size
i dropped out of philosophy
undergraduate because i realized how
much you were just learning to tell
logically sound stories
to each other about how the world is
i wish i wish there were a place where i
could go to learn
real humanities
it seems like being self-taught in the
humanities is more difficult
um i found a few
you come upon a few texts in there and
there and they're kind of mind-blowing
um start what is literature
uh
yeah you should read this
ah i'm reading that was
kind of the first
when i started to realize that that
there was a huge
path to uh what is what is what is
running a company what is what is being
uh what is being ceo
it's just telling stories all you're
doing is telling stories and
we compete uh the world is a big
competition of these stories
what is the wickensteiner's tiring
debate
i have so much to read i don't know and
i guess
this is a lot of what i've been doing
off stream especially now is is just
it's just reading and i'm not
there's no there's no future in hacking
um there's practically no future in
programming it's not a question of
if the singularity is going to happen
it's a question of when
and what will it look like and it seems
like what it will look like will be a
lot less
shaped by programmers doing the grunt
work and a lot more shaped by who's
telling the best stories
so you know if you want to save the
world better learn how to tell stories
please teach me on becoming an expert in
programming
so wait
hang on what's the central kind of
thesis of
um by the way everybody should read
uh should read turns paper
ramsay wow it's all the same people man
these people are everywhere so all
biologists want to be chemists all
chemists want to be physicists
while physicists want to be
mathematicians all mathematicians want
to be philosophers and all philosophers
want to be employed
um programmers are
are translators yeah uh
right this is this is what most
software engineers do all day
um go learn your stupid frameworks right
but again that's the my
same thing about about data science
right um
you know tooling that
will go out of vogue
no out of vote maybe that's right maybe
that's wrong
uh yeah i met my medic there uh
these basic ideas peter t i read some
new peter kill thing he really went hard
on that
do i think today we have less
revolutionary innovative minds in
general than before no
how many people can you name from the
20th century
like a hundred wait there's there's
there's definitely revolutionary people
around
today i i think i think that who's the
most revolutionary person i think of the
current millennium satoshi nakamoto
if you really want to do things in some
way you got to do them anonymously
ah i mean that that's just
i don't know maybe that's not true but
yeah i mean look
at look at what elon musk is doing right
there there are definitely people
who are alive today who are going to be
remembered in 100 years
i read the annotated turing book yeah
yeah that's why i read the paper uh
i'll i'll show for the book
yeah i recommend that book
what is a good work ethic to have so one
test that i like to use often to ask a
question if somebody's saying something
say would anybody ever say the opposite
right
so if you have a politician who stands
up on stage and says
the children are our future i care about
the children they're not really saying
anything because nobody would ever say
the opposite
so what is a good work ethic to have
i mean it's a meaningless question
because the
like you should slack off a lot
and you know not really pay attention do
things sloppily
yeah said nobody ever
i'm showing for myself man i'm satoshi
uh what's unless wrong
i'm not saying you should do anything
um it's just a framework it's a
framework for thinking
no i see i'm not i'm not i'm really not
interested in answering questions about
myself
why do you care i'm nobody who are you
you're nobody too
oh they're coming after me man oh no
locker doors man
i don't know like it's again people are
boring nature's interesting
i'm a people too i'm pretty boring
have to think about recursion just as a
stack
all right swat on my house oh no this
guy's going to call a swat in my house
no he's not he's banned
crud development will go away yeah but
it will just become
current development will become the most
lowest common denominator
ai shit you know
who's that guy in office space he's like
well i take the thing from the engineers
and i give it to the i talk to the
customer and i give it to the engineers
right
that's all it's going to be
um constructivist mathematics uh
i'm i'm yeah of course
uh so my understanding of constructivism
uh says that you can't the law of the
excluded middle doesn't apply
uh so you can't just make an assumption
find a contradiction and say therefore
the assumption is true
uh you wouldn't this is why i really
like things like cock which
like so they have a constructivist cock
which um
it says if you want to say something's
true you can't just say you can't just
like yeah find a contradiction
uh so i think that
like finitism i believe is true in a
deep philosophical sense um whereas
constructivism
is just another lens uh
where are the differences what can you
not
what can you say in non-constructivist
mathematics
uh that you can't say in constructivist
or just proofs harder
taking the principle of the excluded
middle from the mathematician would be
the same
say as prescribing the telescope to an
astronomer or the box of the use of his
fists
um
yeah so so yeah
ah construct
is google gonna actually give me
anything for this i want
non-constructivist truths
you can't derive in constructivism
oh i'll say
oh god yeah aaron schwartz take down j
store fuck j store
some like learning theory i don't know
about that yeah
what i want to know is like like yeah
what are the truths right and then do
they feel
i don't know i mean i like like
intuitionism as well
um
it's one thing to innovate in the
computer science world but it's another
thing to utilize it to make money which
is where you need translators to deliver
uh so uh what is money
right all
uh i mean okay uh
[Music]
it gets i'm not gonna go into this but
if your goal in life is to make money
all i will say is that is never for
anybody a terminal goal
making money cannot be a terminal goal
right
money money itself does not have any
intrinsic value money only has
always think about what your terminal
values are right
um
this is uh let's find the
slate star codex society
shocks
uh yes
bostrom makes an offhanded reference of
the possibility of a dictatorless
dystopia one that every single citizen
including the leadership
hates but which nevertheless endures
unconquered it's easy enough to imagine
such a state imagine a country with two
rules
first every person must spend eight
hours a day giving themselves strong
electric shocks
second if anyone fails to follow a rule
including this one or speaks out against
there fails to enforce it
all citizens must unite to kill that
person suppose these rules were well
enough established by tradition that
everyone expected them to be enforced
so you shock yourself for eight hours a
day because you know if you don't
everyone else will kill you because if
they don't everyone else will kill them
and so on
i heard the russians used a similar
tactic in order to prevent defection in
world war
ii uh you know a soldier on the front
line who's being told to charge a
machine gun turret might want to run the
other way
but you know it is the job of everybody
behind them to shoot all the cowards
and if you do not shoot a coward you're
a coward yourself and you'll be shot by
somebody else
dictatorless dystopia so
think about what you really want money
for and are we really just in one of
these dictators dystopias
there's my viewer count he's gone
and coward is whatever is defined by the
russian system right
are we running out of innovative ideas
no
oh here we go easy example of a
non-constructivist proof without an
obvious fix
some digit occurs infinitely often in
the decimal expansion of pi
have we proven that
oh some digit occurs okay
perhaps you think of the statement that
every digit occurs infinitely often
which is probably open
yeah um but some digit occurs infinitely
often
uh i mean yeah okay you're right so the
obvious proof there is
assume for the sake of contradiction
that no digits occur
infinitely often then given that there's
a finite number of digits
uh by the pigeonhole principle
pi is not a transcendent number but we
know pi is a transcendent number
uh therefore contradiction
uh qed um
this is another classic one yeah
i mean but i'm sure you can prove that
uh the square root of two's irrational
uh i'm sure you can prove that in a
constraint
constructivist proof
square root to uh irrational
direct proof of irrationality
a simple direct proof that i found as a
teenager
theorem
it can conduct our ideal
what that's confusing
okay theorem is that it's integral
if rational so meaning it's an integer
if it's if it's rational
uh the proof
okay so it's a reduced fraction so the
greatest common divisor is one
uh that's using like the extended
euclidean algorithm
yeah that works sure
yeah there you go it's so much better
it's so much better than the other proof
oh browering can are examples let's say
i think that all of higher education
today is whatever the opposite of based
is you know maybe cupped
uh that's kind of a problem
like there's probably small numbers of
holdouts
in these
tentacles institutions
uh rise of
administration
costs in colleges
uh yeah all right there we go it's it's
there uh put it this way administrative
spending comprised just 26 percent of
total educational spending by american
colleges
uh three decades later admitted no it's
not
wait huh where'd the other spending go
i don't know ah
maybe this isn't true i'm not i'm not
that interested in looking into the case
uh i mean i witnessed this firsthand
i've heard
from speaking with a lot of people uh
just how
this is what i mean
uh that's that's not what i was thinking
of
but
yeah i'm not i'm not i'm not hopeful for
the future of the the higher education
system
uh curtis describes it as a state church
where do i expect newer generations to
learn things like lower level
programming or theory the same place
everyone else did what do you mean
people always say this people say this
about computer science man the kids
aren't really going to learn how
computers work
why because our math majors don't know
how arithmetic works
like that's just a sign that someone was
poorly educated
not it's not going to like fade from the
world people say this but
you know there's been so many other
disciplines and i have no idea why they
think
computer science is going to be
different
look up the journal constructive
approximation
there's so much to learn guys
i don't really know what approximations
and expansions
are
by the way oh i mean unfortunately it's
a web archive but can we look at how
nice this web page is
someone criticized my uh
use of like looking at the
sh the form and not the content but the
form is an
incredibly good predictor of content a
website like this
contains truths because there's no other
reason for someone to build it
unfortunately it's been taken offline
let's see
a website like this probably contains
way less truths
right compare the websites
so now we see what's wrong with uh
colleges
i promise our university
will have a website that looks much more
like this and much less like this
computer architecture or quantitative
approach let's see what we got
college is a funnel society's a funnel
man
what i want to show me the uh
don't show me the table of contents
he's the president of stanford
i tried yeah i click off the kindle
version i i think
i don't think anywhere ah take a look
inside oh cool
see what we got
i mean this is yeah if you want to study
computer architecture that's like a
decent
oh now this is i mean this is from
google what
takes like uh 10 nanoseconds
to get to uh l1 cache
100 nanoseconds to get to l2 takes like
a microsecond to get to memory and it
takes like a millisecond to get to disk
or whatever those numbers are you should
know that understand all of that
memory hierarchy there's an old saying
like there's two hard problems in
computer science
it's like search and caching or
something
um that's the quote
cash and validation and naming things
know that you are problems in computer
science cash and validation naming
things and off by one errors
let's see
cool
how do you get over a thousand people to
watch you rant about how
you they shouldn't need to watch people
like you rant
i don't know we're just hanging out and
like thinking i'm gonna go back to
reading in a bit
i try my ideas out on twitch right i
tried hammer out and decided there's
never gonna be a hammer
fuck hammer um i tried backspace out
and it got a pretty good response on
twitch um
the problems with backspace are more
technical and actually comes down to
more the question of what is programming
right i don't want to make if you want
to do programming for work if you want
to make crud apps like
that's not really what i want to do in
backspace
um i mean the
the problem i ran into with backspace
is like um is
our modern programming languages
already the best way
to describe what you want
how yeah
like yeah what is it is programming
really just describing
is is there a more concise language
that's probably a better way
to is does there
exist a more concise
programming language
um aka
uh what is the next
gc right
object-oriented programming didn't
deliver the improvements garbage
collection did
uh not having to deal with freeing your
memory
um i mean so so
my basic thesis is like uh compilers
should do more search
gc is garbage collection uh so if i
write some
if i write some c code
let's make a function
all right so that's all well and good
except for this fact
see look at a dot out's memory usage
right
it's memory usage is growing and we're
going to have to kill it before it keeps
using more because there's a memory leak
because what happens in this program is
every time a is called
i'm malicking six bytes of memory i'm
taking six bytes
off the heap and even though once this
while loop comes around again those
bytes are never accessible
um it doesn't matter
the compiler the program's already
allocated them so you know to fix this
bug
i can do that
and now we'll see that a dot out does
not increase in memory usage
right so a gc would automatically find
unreachable pointers and free them
yeah so rust has a separate idea russ
has this idea of of uh of ownership
um but it makes rust very very hard to
code
the the beauty of gcs is that they
operate completely in the background and
it would make this a valid program to
run
i could write this in go and go as a gc
and it's fine
if you can find the shortest program
that outputs the data yeah sure um i
shall for the hudder prize a lot
make it subscribers only you never see
my chat i see your chat and you're a
subscriber
um all right
we'll be right back and then we'll do
we'll do subscriber only q a and then go
back to reading
what problems are we solving today no
real problems
shining like a diamond what are you
reading from
i'm almost done with my uh my book from
yesterday white noise
what is this dud baiting twitch prime
dot can we do a meet up before the
singularity
what happens if you pass string copy a
character array without a null
terminator
um i mean it'll just keep copying to
whatever on the stack till it finds it
i'll terminator
is it any indication that we're not
close to an efficient to write language
when we have functional programming
that's so fundamentally different
i mean um are getting better i i'm very
oh man you know what i'd give to code in
the language 20 years from now
oh i'd be so happy
cameo.com what was that
i was just like i can book like famous
people to come to my party
look at personalized messages wow
oh i got to think about my brand you
know
and how to solve constant growth of
misinformation
i mean has that ratio actually gotten
worse
has the ratio of information to
misinformation changed
i'm not sure it has
how does one be motivated oh
this is dumb questions like think of why
that's a dumb question
what are you one one way to ask
if if something's a dumb question or not
is like think about what the structure
of the answer you want is
what kind of structure like like like
what is the space what does the range
look like of the
what does the output space look like
like
you are the kind of person who deserves
google
right because this one weird trick to
stay motivated
is is what you're looking for there and
that's the only answer you're going to
get and it's not a real answer so
your curiosity is never going to be
satiated and you're going to keep
googling that same crap
over and over and over again there's not
an answer
there's less hierarchy and information
distribution
i'm not even sure about that
so think about in some ways there's more
hierarchy right um
oh that's all right let me see if i can
find i wish i had a nice way to index
this book better
um
about families
let's find the exact quote they put in
the book a lot better i'm gonna say it
but
families are held together based on in
um
on untruths and and commonly shared lies
i think that despite
people talking a lot about
misinformation
in in some ways from my perspective when
people are screaming about fake news
what they're actually mad about when
they keep talking about misinformation
is actually that they don't control the
narrative anymore
it's not that the new narratives are any
less true than the old narratives the
old narratives are all lies as well
it's just there's a different kind of
group providing the new narratives the
new narratives are coming from a
different place
and i think there is slightly more true
than the old narratives but only
slightly
any advice to crack fang interviews
all right honestly
if they sit you down and they're like do
two lead code hard problems
this is why i'm not doing lead code on
stream for you guys it's like
why waste your time memorizing that
they're no it's
just insulting i mean i think it's
insulting to to everybody
uh who's being interviewed like
they're not checking to see whether
you're a good programmer or not they're
checking to see whether you're willing
to grind for hours and hours and hours
right delete code grind is real like is
that is that the kind of organization
you want to go work at
an organization that values you just
grinding on something stupid and
irrelevant for hours
um that said i think that uh programming
challenges are an incredible way to
judge
um candidates but
not timed ones right
we have a like
or at least not time crunch in front of
a person
uh we we have a we have a hackering
challenge for for comma
um but we give you four hours and if
you're good you can do it in under an
hour
it's it's not designed to be
it's designed to be a freshman weeder
test not some insane
this is how we're truly going to judge
you
the speed challenge yeah i like the
speed challenge it's kind of
it's more open-ended but it has it's
it's more open-ended but it has a clear
rigid evaluation criteria uh it's an
import it's important to have
interviews that are have clear
evaluation criteria to avoid bias
don't take amphetamines um so
my experience with uh amphetamines
adderall stimulants
is they do not make you better at things
they make you think you're better at
things
they they trigger
this delusion uh
if i am good at something i want to
believe i am good at something if i am
bad at something i want to believe i am
bad at something
nootropics are mostly a scam
i think humanities will ever be able to
escape structures and hierarchies within
nature that
combat transhumanism i'm not sure
exactly what that means
honesty doesn't give deep thoughts it
makes you think all your thoughts are
deep
i have more positive things to say about
lsd than i do about
uh amphetamines
i think lsd shows you something
and uh
i mean like with all drugs you know
understand what it has to teach you and
then stop
i think i want to go to one of those
10-day meditation retreats
uh but i don't know i don't want to talk
about drugs they're not drugs aren't
that interesting
joshua new god of transhumanism
uh what's the happiest memory i don't
really like talking about myself either
most of these things here i don't really
talk about myself i do give anecdotes
for my wife they're
they're more to illustrate a point uh
because anything that i say about myself
is personal and useless to you
don't be like me it's dumb
you know i'm trying to give you
information so you can think
don dele white noise
some of the stories are made up yeah
doesn't matter
uh i've been drinking recess yeah it's
kind of nice
i've never read your class elements all
right cool
um
it's about pascal's wager
pascal's mugging yeah
heh
it's a funny idea
and this is why i'm not a
consequentialist
many mangoes that is kind of funny
things
by oh oh you mean just things in general
oh i felt like things was like uh yeah
of course
web app frameworks like electron why
don't we ship the operating system in
every uh
electron is just docker man it's the
same idea no
i don't want i don't know anything that
makes deployment development easier is
probably good
stanislaw lim
can you think of any fun problems to
tackle in your retails
if you come up with one
hmm no
it is it's in local folder i'm probably
much more likely to lose it than the
cloud
the fuck is a tc if you want a high
tc you gotta play the game
you know what there is a star trek
voyager episode
tc yes treatment coefficient yes
yes critical care yes
just as the doctor asks what tc stands
for
oh total compensation oh you mean the
team blinds
oh my god oh my god
it's pascal's mugging man
yeah i'd like to go to today
the problem is i have to like schedule
it months in advance
worldsignia yt thank you for subscribing
turning into a lizard man i love voyager
growing up you know
i just want to know where i learned
morality from star trek voyager
so whatever janeway believed that i
believe
alright guys thank you for watching the
stream um if you enjoyed today's stream
i'm gonna look at my revenues and if i
got a lot of revenue for this stream
we're gonna do more streams like this
one
but i don't know i'm probably not gonna
stream for a bit
it's the weekend i got things to do that
aren't streaming
uh please subscribe if you haven't
subscribed it
we like subscribers somebody asked me
earlier do i believe that there are
some people are better than others yes i
believe that subscribers are better than
non-subscribers
rex doors thank you for subscribing
can you do an irl stream
should i like rent out a you know you
know like they're hyped on the covet
shit
um
feels good man subs rise up yeah there's
a class system
all twitches aren't equal they're
subscribers and non-subscribers i don't
i don't tell lies you know i'm a flex
thank you for gifting subs um
today's dream is top tier i'm glad you
liked it yeah just get a mask or
something with my mask
that's right let's show it boys
today's flow is better thank you
what's ocsp
oh just some like certification thing
vic jack thank you for subscribing
uh
facetime is still funny um
subscriber power full lidar
you take care too real port your
subscriber your good person
um yeah not have any certifications
don't don't take me over security itself
is all it's all
racket first we got to scare them about
hackers then we got to sell them the
anecdote to hackers antidote yeah
thank you uh ranch leo thank you for
subscribing there's a take on
morality of piracy i don't believe in
universal morality or ethics
make up your own mind man
um anybody who's trying to but i do
dislike anybody who tries to preach to
you morality or ethics
tries to tell you how you should act man
because that's just powerful people
moral relativist i have personal borrows
i talk about yeah like i said i don't
really like talking about my
only streams i don't really think i talk
about like myself
right like even this this is not really
a comment about myself this is a comment
about the content
of the streams
i post more instagram pics
all right well you know what if i find
out about this shit
we're never streaming again you're
banned and you know what people
dm me all the time my dms are full of
can you please unban me yo dude can you
unban me sir yo can you unban me
bro you're banned for life
i don't think jaime was a more relative
of a style that's true
can i ban you i'm not gonna ban you
you're a subscriber
you're a good person
uh good i'm glad
if ro jogen was like a mockery of the
podcast
i would totally go on road joking like a
mockery of that whole format
rojo again yo is there really a road
joking let's check it out
ro jogen
um
laser cap boss you're close to getting
banned
you don't care if you're a subscriber
bro jogin
there's nothing wrong with the format it
has more to do with the reach
this is why i wouldn't go on joe rogan
i just imagined saris wasn't that the
bad guy in galaxy quest
alright guys thank you all for watching
good afternoon learn real things
good morning everybody good
morning good morning good
morning it's nice to be back in my house
I don't like streaming at
work
uh high ball
energy good morning everybody good
morning good morning good morning good
morning
all right let's uh shrink me down here
me up
there oops don't do
that
okay are we ready to get
started um yeah felt Vibes you a little
bit off in yesterday
stream uh I don't think I should stream
at the office oh so I didn't like the
way that like like now this is here let
me slide that down a little I'm about in
the middle that's pretty nice I got my
Yeti
microphone move it over a little bit
Yeti puts me perfectly in the
center uh yeah Vibes are Vibes are off
wouldn't have my lighting set
up I it's an okay
stream that's good to focus on tiny grad
but some guy said that he liked my older
work better and if there's one thing I
never want to be it's Drake so uh we're
going to try to we're going to try to
bring it back to the old
stuff and we're going to do
uh we're going to investigate the qar
algorithm so first off what is the qar
algorithm I don't know let's find
out
we'll start using our friend here
Google what is qar and when will we hear
more someone who's done a fair amount of
ml research I can tell you it's very
very easy to think you've discovered a
breakthrough that's
true all right let's read this article
in The
Verge uh Reuters okay well the
government no no no no no no
no
uh qar could be a breakthrough in the
startup search for what's known as
artificial general
intelligence
Reuters could
not okay it somehow does
math
do something I still publish
papers not
really wow remember when they used to
publish papers and now they publish
system cards and and safety and
Alignment okay wait wait there's some
hope here improving mathematical
reasoning ooh o this sounds like qar
guys I think we found
it no wait no no no but really wait is
this not is this not qar did we not just
find it
we're trying not to hate we're trying
not to hate guys there's so much hate in
the world we got to bring love and
positivity and shit man whatever like
John lennin said you know
something um that's
why we're going to go subscribers
only
okay
given vast Computing resources the new
model was able to solve certain
mathematical
problems improving mathematical
reasoning with process
supervision we've trained a model to
achieve a new state-of-the-art in
mathematical problem solving by
rewarding each correct step of reasoning
instead of simply rewarding the final
answer and it
just
um okay
so the reason that you usually just
reward the correct final answer is
because that's all that's in your uh
data set the other problem with doing
this is it may constrain the reasoning
to follow one certain path when that may
not be the path you have to
follow stateof the art models still
produce logical mistakes often called
hallucinations we good here we're
good cutting out we having more
technical problems I bought a new
computer does new Apple stuff not work
oh only you okay Rick and Morty you have
a crappy internet connection sounds like
your
problem uh no no no no positivity
positivity positivity you have a an
internet connection that is less good
than other internet
[Music]
connections
wait do open I just publish like fake
papers now like
this positivity positivity positivity
positivity um don't give a shit about
alignment wait this is a paper
oh okay no here there's a paper let's
verify step by step
okay
um
okay well is this a public data
set all right all right all right all
right
cool
math word problem solving on
math who made this data
set okay
okay this is not where I was expecting
this to go by the way oh they have
metamath oh everything comes full
circle no I
mean
again let's okay let's find the primary
source
here
qar it definitely talked about math
problems
only performing math on the level of
grade school
students why is this monitor broken this
monitor is like broken I got to a new
monitor you guys aren't seeing that
glitching
right
are you maybe you
are I don't think you
are this is so
weird when I click here there's like a
blue glitching on my
computer it's weirdest thing like how
does that even happen
happen I could take the camera down and
show you you want to see there's like
blue glitching on my monitor look at
this click here goes away here glitching
here goes away
glitching how's this happening has
anyone ever seen that
before you see
it it's a ghosted image
maybe it's the
cable I don't know
right who knows it only happens when
things are in
certain wait this is just
really
who
knows all right uh oh wait I wanted to
confirm that this actually was related
to
math delti cable breaks
I'm using like the USBC cable it could
be the
cable but like it's weird how it's
glitching I don't
know
um the new model was able to solve
certain mathematical problems so it
would kind of make sense that this is
the data set
right
do they mention the math data here okay
our process supervised model solves 78%
of the problem from a representative
subset of the math test
set we also release PRM
800k okay opening I released something
look at
that I don't no positiv positively
positively
why do I have two vs
codes it's all also look into what their
other GitHub activi has
been procedurally generated game likee
gemm
environments
what did they update in
gpt2 is there a branch they
[Music]
updated
quantifying transfer and reinforcement
learning okay it seems like Carl cob has
been if anyone invented qar it's Carl
cob Carl
cob all right you been working on this
math stuff for a while let's see what
data set was used
here oh is this the data set that
introduced
that oh this is a different one GMS 8K
PRM
800k step level
correctness
but the glitching is really
bad
okay wa wait let's talk about the
glitching for a minute
somehow you can see what's
here right and it's this it's the same
thing that's in this terminal window but
yet if I minimize this terminal window
it's still
here oh oh we got a we got a good
resource we got a video Let's see
getting r roll
here you're a subscriber you wouldn't do
that as you might expect I have been
researching nonstop about powerful AI
wow glad glad we got other researchers
on board guys qar
on no this is this is really
terrible hang
on I'm gonna shut that off for a minute
and you guys can look at me while I try
to fix
it to the monitor oh come
on is the stream working again
oh I lost internet too oh I lost
everything when I turned the monitor
off wait is this still
working it is working okay I don't know
the glitching is just really bad it's
usually not like I've seen this before
but it's gotten way worse no it didn't
help wait all right so they're looking
at the same paper I am computing power
while you're
Tak all right let's just read the paper
I need to watch some YouTuber read the
paper
oh the optimal Q fun possibility and he
said one link to the name qar could be
in a generic sense generator the model
coming up with Solutions with
reinforcement learning we do not dis
paper using test time
Compu
okay
um you know what I think maybe we'll do
one of the Bounties in tiny
grad I think we're going to first need a
chat model I think regardless of what
we're doing we're going to need a chat
model I was playing
with trying to make edding fast last
night connecting process supervision to
30X model size we got a whole Army here
you guys can watch this video so I don't
have
to
throw that up there I did not realize
how broken this monitor
was all right so first we're going to
need a good model what what's what's the
best model we got what's the best uh the
best 7B model we got is it Intel neural
chat is this one nerfed to hell do you
think open Hermes
2.5 is that what people
like I'm locking the Bounty for myself
too so I'm going to go do
that
some guy submitted a poll request but it
was literally just like the words like
why you even submit a poll
request
uh okay is is this what we
like wait why this one doesn't seem as
good
now Hermes seems
better that's 70b but why would I not
use Collective
cognition
oh wait you can't see my
desktop
what wow we're having technical
difficulties
oh I think we also might have a bit rate
problem no that's a pretty high bit
right
okay we'll put that in front of that
okay all right all right all right we
fixed
that okay can you see
now uh wait why do I want want this
model it doesn't seem as
good fine tuned Orca
DPO do not trust benches you must try
it let
see all right all right do we believe in
open Hermes we like this one
okay
um wait so which one is this a clone
of does it have rope and
stuff what's the vocab
size so okay it's it's a mistal fine
tune we don't actually have mistal
support oh technium is okay people like
Tech
I won't lock the bounty to myself but
someone's got to cuz I'm not going to do
the testing but if someone wants to do
the testing they can have the Bounty
it's
$200 um people train with data sets from
benches yeah damn
cheaters all right
we downloaded in 10 minutes um let's
take a look at mistel because first
we're going to need a powerful if we
want qar it seems like we're going to
need a language model and we're going to
need a powerful language model like
mistl
7B oh no I don't know if I have sliding
window
attention did I explain qar well it
looks like it's
this or
something but we're going to need a
language model and it involves math so
let's first see how good it can do
language math and let's upgrade it with
the qar
algorithm
uh use it with our reference
implementation okay mistal
Transformer I don't know if we have
that
you can look up in vlm implementation
you think gbg 3.5 is way better than any
open source model my theory about a lot
of this is that their data source is
just a whole lot better than like slim
pajamas and
stuff
interesting oh I didn't know that they
did this wait this is okay and only with
three so you can actually look there's a
thing called mask in uh in attention
here and I think that they just changed
the mask it's cool to look at these
latest
tricks
um we Implement a rolling buffer
cache uh oh I mean this is yeah only
once we hit the context length what is
the context length of
mistal
it's
8K
sick file so it has two files is it
not the seven BS only have one
file so if I look at like llama 2
yeah they just have
one how does this one have
multiple I don't know what this other
format
is I me yeah that's
great see this just has P torch model
wait what why do they use
fp32 we trust technium and open
Hermes technium is like he's on Twitter
we trust people on Twitter sorry on
X okay the first one's still downloading
there's two but they don't match in size
why would anyone do
this this cod's all
terrible I let this get out of hand with
the open source
contributions Hermes is your favorite of
the myal all right sounds like you've
been playing with these things a
lot
um okay we're going to need to implement
this sliding window attention I think
we're not going to figure out what's
exactly in the stuff till
uh yeah these personalities are also
like this is old
shit you know
what why don't we just rewrite
it
like I don't want to deal with any of
this garbage this code all looks
terrible let's right mistal dopy with
the latest
stuff Oh blank
code yeah exactly if I want to use I oh
I don't need sliding window
attention wait I think I do
or you're saying they trained
it they trained it without sliding
window attention for smaller
stuff what do you mean by the window
size where do you see all this
stuff
as far as I know mistel didn't really
release a
paper with each layer tends to the
previous
oh okay so it's not actually
three here W equals 3 but in practice W
equals 4K ah okay a sliding window of 4K
I understand okay
that actually makes a lot more sense
than
three and good we can we can use all the
latest in uh in stuff
okay all right um let's get these models
loaded
here so we're going to start really with
with mpy here uh we we'll do stuff from
scratch so in tiny gr now you only need
to import tensor like that it's a lot
nicer
um import NN and then we can do nn.
state do uh torch load because it's some
kind of P torch
model uh weight open
Hermes part one part two
I should really have this Mark tensors
as read
only just so I don't corrupt them
accidentally um that let's run what we
have so
far so you see how fast that is by the
way uh I worked really hard on this so
our torch load function doesn't actually
load the tensors into RAM it just loads
them all with
pointers um they're disc tensors so I
can show you
like
okay oh the dtype is half which is kind
of nice good so they're not uh it's not
float it's not B float
32 so how does this
work what's in part one and what's in
part
two okay good just goes up to 31 here
okay um so it should have mostly the
same architecture as
llama I think that it's been impoved
enough that there's not too much we can
uh we can improve
still well yeah I don't know man sure
short your opening High
stock
uh do you just do you want me to write
it from scratch like I I can just do it
maybe we should CU it's kind of
cool
like does this even have a k q and yeah
okay uh we're permuting them and
sticking them in when we load the
weights key map subk okay so where're
where're oh this converts it from the
hugging face format I
say
do we want to do that or we want to just
implement the hugging face
format what do you think
chat should we use a converter or should
we just rewrite
it looks easy enough to
write may you guys will appreciate it if
we do some
writing
yeah yeah yeah I know about
ggu so we can also print v. shape
here
all right that looks pretty
cool so first we're going to need our
self
attention
uh see if we can find those
numbers they in the myal announcement
or does everyone just know what these
are for sevenbs
now so the whole basically a layer seems
to look like that let's keep the name's
consistent from the original llama so
this is called a Transformer
block don't worry about what goes there
later start with a Transformer
block
um again we'll worry about what it goes
there later we'll just leave it like
that for now but okay so we're
definitely going to need something
called self
attention equals
attention
and we're going to need something called
MLP what do I call it now feed forward
actually why don't we look at the
reference repo and copy their names it's
always better to take
names okay they do call it
attention let's just look at there here
Transformer block they call it feed
forward too oh it is almost the
same no look they call their stuff St
this they just must have some weird
loading script to convert it from the
hugging face format
too know I feel about
that hugging face probably calls it
something else
then looks like the hugging face
Transformers
REO what did everyone
use
h
vlm I've heard thrown
around very complicated
looking wow so easy you could just pip
install
this
okay maybe we should import Transformer
from llama just to make things go
faster and we also can import convert
from hugging
face you can read it we wrote llama on
another stream we could do it but you
know we got to get to to actually
writing qar some examples. llama import
convert from hugging
face import
[Music]
Transformer okay convert from hug face
takes in a dictionary of Weights which
is a G from string to
tensor We'll add some types we love
types no no no we're implementing qar
um okay so we have a Transformer uh
what's the dimension of this
Transformer this is an INT all
ins except for Norm
eps
what's one file
ref okay there's something called Model
ARS is a data class oh and then they
pass it through with Json where's the
Json is there
Json
where does this Json come from is it in
assets Json sounds like an asset no
those are images what's in
deploy nope wait so where the hell is is
Json that they're
loading oh at torch inference mode
that's cool we set tensor no grad equal
to true
what's
fire I'm not up to date what's all these
latest
things you can call fire on any python
object oh
interesting I like
that um all right so where do I put the
args
where where do all those things come
from oh I know where the Json is it's
probably in
here here config.js
okay oh no it's B float
no okay let's manually convert
these wait I thought I put oh I put them
on Transformer block
Lo multiple
of n
heads and
layers Norm PS is a
float
okay so the dim is going to be
496 I don't know what multiple of
is what is multiple of even used for
I'll feed
forward feed forward takes in a multiple
o to to increase the hidden
dim
how does llama get
them multiple of
256 it's probably a good number let's
try
it see if things don't load okay uh
number of heads is 32 number of layers
is
32 Norms is oneus 5 and the vocab size
is
uh
322 say model equals
Transformer what I'm just going to put
that in I should really just put that in
beginning of the
script
to do python path equals all the time
okay
good okay um well it takes do that take
time kindr as a helper called timing
it's kind of
cool you know I like things to be
fast okay cool all pretty fast can add
all prompt here
uh load
weights uh create
model all right now we're going to have
to stuff them in let's try convert from
hugging
face
uh
weights which of these is n
heads n heads and nkv
heads does this
work okay that was absurdly
fast uh we should
check no okay this cuz this does not
actually apply
them uh we have to load State
deck load State dick is
in nn. state. load State
dick okay assign shape mismatch 4096
uh which one did I do wrong
um it's a little Annoying that it
doesn't print the name oh here attention
WK
weight
okay so let's
see I don't know maybe the dim is one or
two
four no but that definitely changed
that so if we look at the Llama code we
can see where that's being
created uh n heads times head
dim did I get the number of heads wrong
oh that's probably
right okay so n heads is maybe not 32
number of attention heads is 32 but the
number of KV heads is only
8 let's try
eight no that didn't fix
that what is this multiple of thing I
wrote this I'm sure I just copied this
from other
people it's always good to
understand so this should be four times
dim I don't
understand why that doesn't match I
would actually expect it to be
that Mitchell uses 32 heads for the
query and for and yeah okay but which
one of these is supposed to be the KV
heads right or is my convert from
hugging face
wrong or does our model not support that
now it should unless does llama not do
this does llama do something
different nkv
heads wait what about
v y llama is different oh
okay wait no here
attention but is it does the feed
forward have to
change okay
um it's failing on the attention
assignment
ah okay so I can pass in nkv heads here
to
attention again I must have just copied
all this so nkv heads is here how far do
I pipe it down oh nkv heads is here
where does it come from oh there's a
there's a named argument
okay so we just need to
add uh nkv heads equals 8
here
okay that's progress uh this probably
has to do with the multiply not being
right I've seen those numbers
before uh so where's their multiple it's
not
256 intermediate size is
here custom FFN dim
multiplier
I don't think this was written
correctly let's look at this Cove and
see if that's how they wrote
it oh they just have something weird
called Model
arcs yeah they have just args hidden
them this is
stupid Tod do what is
this what is all this
crap why is this four times dim why
don't I
just
yeah I don't like multiple of FFM dim
multiplier this is set to 1.3 like this
should just be hidden this should just
be hidden
dim I pass in really I pass in Hidden
and multiple
of what okay they're refactoring this U
we have to keep the old stupid
Behavior going to copy this weird
crap up to here
do these even have they don't have
hidden dim so we'll have to add hidden
dim to the
programs
umm
dim
multiplier equals model Arc sub fmd
multiplier we'll make sure we didn't
break it
later see this is what happens this is
the problem with open source people add
crap to my repo and don't
think okay now we're passing in an
argument called hidden dim this is much
more
sensible get rid of
multiple
of hidden dim can go here
a multiple
of and then goes
here that's fine we're passing that in
there uh where is that actually being
passed in oh that just go straight to
linear okay good we've already deleted
that crap wow that's a much more
sensible feed forward I don't know why
we put that logic in
there
okay
all right good now we can just pass the
hidden dim in right there and what was
the hidden dim from
estol uh
that okay so now that's n heads wait
what what is that no no 256 is what gets
deleted I should name some of these
parameters that's nkv heads that's vocab
size
that's uh not rope Theta what's it
called Norm
EPS
uh and
layers and heads okay cool does it load
yeah it loads very
slowly
oh this is unbearable oh this is
terrible just put that
there okay the reason it's slow is cuz
we haven't finished the uh takes 20
seconds
seconds oh come on boys I don't have all
day oh it's cuz we haven't
finished no I'm using the it's not the
GPU it's not the GPU it's that I have
I'm converting to the CPU to load
bf16 oh I can't wait 20 seconds every
time all
well what can I do about
that oh I know what I'll
do
it should be
fast
I think yeah because we convert them all
to float 16 and that's what's taking
forever right
now cuz we're not actually doing we
could actually also do the math in B
float
16 Mac doesn't use RAM for temp does
it
cached
M okay 13
G's now let's see how fast it
loads
uh I have a way to
like put things in I forget what it is
though let's just
look it's called load State
deck
oh yeah okay it's the same load State
dict I'm using up there strict should be
okay okay 2.3 seconds
great um all right now it's inference
time
let's create a branch so I don't
accidentally push to
master
all right we're going to need a
tokenizer let's get a
tokenizer oh I also don't even need this
anymore so now we've made a
copy yeah I guess I do need model
actually not really I could just but
whatever
um let's get the tokenizer over
here
H tokenizer
model
[Music]
wow 14 wow
6.47 gigabytes per
second
what does Jimmy apples
do what is
this I don't get
it okay uh where are we we're going to
do some inference on some
models what's BOS
ID what is
self self. tokenizer equals token
Z
yeah we're going to call this
talk
prompt
equals do you like
chicken uh talks is probably
good wow no one's updated that to the
latest um just model start pause equals
zero uh temperature equals I 0.2 is that
a good temperature what's the default
temperature what's the default
temperature 0.7 is that a highight
temperature or low
temperature how do I make the loading so
fast the loading should always be
fast um I just cashed
it you can read the code right there you
didn't pay attention if you're asking me
that question uh so
[Music]
also
fuck are you
happy uh we can do multinomial here
which will choose
a okay fine we shouldn't call it talk
call it SP okay you down with
SP does this give us a number no it's
going to complain about a tensor all
right fine uh multinomial realize. item
I got to item it and actually I don't
even need a do realize I just need a do
item
315 boys 315
okay um this should automatically this
should be jitted and
stuff where does the jit
exist the jits inside Transformer or
no yes the jits inside Transformer okay
good
uh talks out of pen
talk EOS
ID yeah yeah yeah this is okay we'll
just copy this this is mostly
fine
I'm going to have to figure out how to
actually like encode these things for
chat and
stuff uh
until wait where's my thing that prints
the output as I
go
is it not
here yeah this is not okay I don't even
understand why that's
there this is
terrible this stuff's
terrible no one's reacted this in a long
time we don't need any fucking
numpy uh start PA equals
lento
blah
whatever uh that's
stupid and that's
stupid length outputed Okay we we got to
set out outp put it
somewhere output it equals user
prompt user
prompt I can
[Music]
go print user prompt
if yes then you must have tried Big
Chicken in your kitchen big chicken's a
versatile dish that can be prepared in
many
ways all right are we happy overall oh I
I'm outp putting that wrong
um
we should also do this
better do you like chicken chicken is
one of the most popular Meats in the
world and it's not hard to understand
why it is verstile easy to prepare
wow okay good seems pretty good okay now
we just have to figure out how to use
these things as chat
Bots get rid of that we don't need
that there's like some like special
tokens for chat Bots I
believe I'm not buying into this that
there was a breakthrough this if if this
approach has anything to do with like
supervising the middle steps it seems
really stupid
actually like it's a bad idea
um Mario thank you for resubscribing
thank you for being a 20 month
subscriber loyal to my channel even when
I don't
stream um why do I have this this is
dumb okay good that looks like a decent
chunk of
code um we'll create a little function
called output
nonlocal
uh outp put
it
c yeah we should just copy this to
here
that why is that
bitching what it's right there I don't
get it is that how that
works
cannot access local variable
outputed then no binding for why doesn't
that work oh cuz I'm in m h
[Music]
fine do you like chicken how about a
recipe for a homemade chicken dish
that's super easy to make oh
oh we have to get these things working
like chat Bots how do we do
this okay wait wait can we just read
this
comment is the qar algorithm going to be
implemented with the comma AI maybe a
voice interface to some kind of
assistant I just I don't even know how
to help you people okay I don't even
know how to help you all right all right
sorry I can't help you right you you
want to see a voice you want to see a
voice chat this is this is one of the
demos someone's been working
on I need to wait for
that skull m
has been working on combining whisper
llama and vits into one super
[Music]
model I don't know the magical GitHub
incantation to do
this there is one but I don't know
it
for
okay this is using a small llama so the
chat output is not that
great
what oh did I fork this from mistol oh
my
bad yeah I for for okay
fine
what I don't understand why did that
work
um here and KV
heads is this just
[Music]
broken or am I doing something
wrong
what did something change on
Master no that's
fine
I don't understand this is like related
to what I was messing with but
like I think it's just
broken
all right let's see if it's a on line
fix uh it has no argument KV heads
okay uh no this is
wrong
wait this should have an nkv heads I
don't understand it has an nkv heads
right there is it not passing in the
right
model KY eror
7B
okay there we
go hello are you
listening are you
listening
can you not detect end of stream
anymore
oh this used to work this used to work
boys this used to
work
it was so good
yesterday all right I hope everyone's
interested in a long stream
today
listening
listening all right let's read the
Cod the qar algorithm is not fucking
real it's
[Music]
clickbait
clickbait
uh how does this ever
exit has it thr an exception I
guess
what how does this work how is this
supposed to
exit okay let's check out the older
version let's try this one
hello are you
listening Stacy I need you to say
something to
me Stacy
sucks stay are you a
rapper of course I'm a rapper I'm a rap
star tell me more what's your favorite
rap
song My Favorite rap song is called my
favorite song mcari b what do you like
about
it I like the fact that it's a rap song
about being a childood friend did you
have friends in your
childhood yes I have many friends in my
childhood tell me about
them my best friend is Kylie Jenner
she's a reality TV star wow you actually
knew Kylie
Jenner I used to go to Kylie Jenner
school I was in her class for a
while what was she like did she pick her
nose
she didn't pick her nose but she was a
really pretty kid that makes sense do
you sometime wish you were that
pretty oh sometimes I wish I could smile
more and not pick my
nose all right what do you guys
[Music]
[Music]
think
AGI
right uh all right let's get back to
work
how about a cookie with chicken in it
wait that's mad weird bro why you coming
up with this shit we so far from
it h
okay so how do I like put things into
chatbots chatbot
style how does this stuff
work like what what are the right tokens
to use
forgot Google's
useless here special tokens
map
wait how do I like switch speakers you
guys know what I'm saying oh here's the
template okay
okay
here templates for chat
models
oh Auto tokenizer
what I'm
start how do I get I'm start
is that like a method on
here
every meth every model has its own
type mistal instruct was trained with
these tokens but blender bot was
not is this a real token
inst
is it actually just the word inst or is
that a real
token like is it just
that oh
based pie ID is out of
range I use the right
tokenizer piece ID is out of
range
oh well it was smart the first
time oh no never mind it might still be
smart PE ID is out of range what
oh why is the vocab size
that why is that not included in this
tokenizer
model
what is 2 + 2 two what is 3 + 3 6 what
is 4 + 4 8 now it's done okay it didn't
exactly get 2 + 2
right I think I'm doing this wrong
then I have an idea these aren't the
actual tokens and it has to do with
these secret extra
tokens llama has some secret extra
tokens too Marin thank you for gifting
Subs we always appreciate
that um yeah back to kindergarten shit
guys our Q star can't even solve 2 plus
two what are we going to do
we're going to get some coffee let's get
some
coffee and then let's learn about secret
tokens okay they're secret tokens hidden
[Music]
tokens nobody uses reserved tokens for
instruct tuning you're precious for
thinking that what are the tokens used
for
[Music]
then
uh wait actually guys
guys we I'm being serious right now we
need to
stop when it outputed two there it
showed that it wasn't aligned with us we
don't know what the model's thinking
guys the model could be could be taking
over the world right
now we we don't know this is this is we
need to hire Helen toner we need to hire
an AI ethics review board to review what
just happened there we need to slow down
we need to ask the seals if they're okay
with rocket
launches so thises
this why does this thing
suck
okay what's s and slash S and maybe I
need to go like
this this is the mistal one
yeah
oh okay this is
improved
it's it's got ads in it oh open Hermes
uses a different template all right all
right let's
see wait so is it actually the word IM
start like is that just a
word or or is it like
a
[Music]
all right you got me
something default chat template no
that's llama I don't think that's right
I think this is
right okay I am start system
we don't need a system message right
now what is 2+
ah Marin thank you for gifting more subs
do you have a
question if you gift Subs you get to ask
a
question all right I'm
and I'm star is this is this is this
really right
like
oh okay that seems like the best so
far oh okay good I love have her Boose
this model
is wait this is actually laughably
easy oh you're right I need a line break
there never mind I'm locking that Bounty
for myself this is too easy someone else
should have done this they could have
made $200 but
instead okay um let's add a system
message wait I should really like let me
just write a little something to
generate these
prompts uh tle
list tupple uh
user what is 2 +
2 um encode
prompt
P4 KV andp uh okay R equals that
Rend um okay so we're going to pend I'm
start
k/n
the I'm n
sln
uh and then we want to
add going to add Imart assistant to
this go to the word user
prompt like
that code
prompt
okay why did you why did you not exit
when you were supposed to
exit did I forget more returns or
something
why isn't it outputting I'm
and guys guys this is qar I think we
found
it
no I'm not locking the Bounty someone
should do this but someone should do a
good job I want a good job on that
Bounty oh okay here I'm end how come
sometime it finishes the stream and
sometime it
doesn't maybe our temperature is too
high
let's try a less
temperature
yo
okay
zero
guys why is it why is it going off into
this language AI
garbage or should I just stop after I'm
end
uh am I using torch or tiny grad this is
all tiny
grad I don't really understand
this all right maybe we should add a
system
prompt uh you
are Gary Gary is a useful no no we refer
to used Gary what should we name him
Fred Fred is a
useful
assistant did I spell that word right I
did
not
Fred outputs the
answer and stops
talking all
right
oh all right all right fine we'll call
him Q fine fine fine you are q q is a
useful
assistant Q outputs the answer and stops
talking Quenton wait you know what you
donated Subs you get to name him
congratulation his name is
[Laughter]
Quenton I knew a Quenton once he was
hanging out in San Francisco and some
guys were on the street smoking he's
like yo let me get a hit of that he
thought it was weed and it was crack
that's a real Quenton
story I wouldn't make up quent story
like
that
oh why would the system ask what the
capital of France
is
we could stop at I'm end I think maybe
we want to do that how do I do this in
llama okay that's pretty
good there a new line
before all right let's jack up the
temperature and Steve Quenton still
reliable the answer is four but it
didn't output imn that time it outputed
EOS
seems to reliably do
that that time it did I
end yeah I like is that a real token or
does it actually just put it in like
that like is this right or is that like
a secret like like it can't be
that it can't actually be
[Music]
this we can check if it's encoded on a
single token yeah yeah
yeah no it's a bajillion tokens
add a
trailing sln after assistant it
shouldn't
matter I mean I can
but it doesn't
matter
no no no no no it can't be
this it
can't no no no but it can't literally be
this huge multi- token wasteful
encoding
can we get technium in
here all right how do we print all the
tokens
it probably is the secret tokens
then I mean there's three extra tokens
or I guess two extra tokens right 3200
and
yeah if I was doing this that's how I'd
do
it let's just try
it that has to be what the two secret
tokens are
right start and
end
this is what did I download open Hermes
V shit G 4
qmw no I downloaded open Hermes this one
it just came out fresh
fresh yeah okay
[Music]
um
oh you can download the tokenizer
dojon um wait but I downloaded the
tokenizer oh here special tokens
map
interesting okay imend is the EOS
token I think I can feed these in
somehow but I don't know about
starch oh here we go look yeah here you
have this tokenizer config.js okay it is
exactly what we thought it
was oh okay yeah yeah this is what we
want okay never mind it's not as stupid
as we thought it
was uh okay how do I load a tokenizer
config and sentence piece
processor why isn't our tokenizer
encoding them automatically because it's
not in the
model
oh I hate goog look at this
shit
yeah okay one and two are not what we
want um I we could just do this by hand
it's not that big of a
deal yeah but how do I add
them what's pad ID
nothing
real okay no they were added the special
tokens guys this is all well
done technium is base he wouldn't he
wouldn't he wouldn't do this do us
like how did you decide that this was a
good time to prompt me about Docker
garbage
thank you for gifting more subs here
added tokens. Json okay okay we just
need to figure out how to add those
in
um let's see if anything here is
useful a knit model file model
Proto add boss enable
sampling this looks h
all right
whatever no but then it won't decode CU
if I try like sp. decode and I pass this
in it'll bitch and be like that's more
tokens than you have pieace IDE is out
of
range I just want to add a
token model file model Proto out
type add boss
reverse midun piece enable
sampling do we need to write our own
tokenizer
adding token to sentence why do you
think it's time for random
questions why why do you think that
that's this is an appropriate
time extra
options we can R oh here here use custom
symbol
okay control
symbols how do I Define a control
symbol no no no we need custom tokens
Samuel were you saying dumb shit before
too or am I getting you confused with
someone else
here sentence piece supports user
defined symbols three thumbs
down
you can rewrite the model file okay what
is this model file what is tokenizer
model what kind of file is this
data why is it not in there I downloaded
it from here why is the why is the model
not in there should be in there right
right why do they not update
that let's
go
for
yeah I'm confused why they're not in the
model too how to extend tokens
dictionary yeah yeah
uh you can rewrite the
model the Proto is a
DSL the model file is stored as a
serialized Proto
buff wait but did I not download the
Proto buff one isn't there also a
protuff
one no okay maybe there's this okay all
right uh load from serialized
Proto okay okay okay okay we're gonna
get
this
um so I have to edit the Proto file I
understand oh here the Python tutorial
for
damn
cricker to implement their tokens bro
what are you even talking about
BR Proto C Brew install Proto
C oh we can Li
Bitcoin
this can't be the
way wait so what is the hugging face
tokenizer it's a good point why don't we
read that code I'm sure it's open
source
um should we just write a
tokenizer we could also just import
hugging faces
tokenizer
I think we have to write the
tokenizer I can't I can't trust sentence
piece shit but wait how do they load the
how do they load
it added tokens decoder
what
I mean something's going to have to
unpack the Proto
file how large is this all right all
right who who wants to bet over under a
thousand lines oh okay okay not too
terrible
what does this depend on Google
prot all right this guy is close to
getting
banned bro needs more fine-tuning to be
helpful
look man I don't care who you are you
know what I mean but like you're either
helpful to the stream or you're not
helpful to the stream you see this is
called
alignment and uh you know you got to be
aligned otherwise well what happens to
what happens to AIS that aren't aligned
I don't
know he's researching bro he's
researching all right
um let's load the
protuff from
examples. sentence piece model
pb2 wait what the
hell do not edit okay okay I won't edit
it relax I'm not trying to edit it let's
read the new Proto usff tutorial for
idiots
a
where did I get where did I get that
from like here the Proto is a
DSL don't like here we go good good good
good ridot
perfect
um
import all
right sentence piece pb2
Dot
model Proto
maybe how do I load it from
desk here parse from
string I why do I feel like I'm having
like a weird sense of deja vu that I did
this in a previous
stream OKAY
spb2 model Proto do
mpm mp. parse from string I don't know
why that's not autoc completing for me
uh
all right
cool
okay
so what what how do I actually like get
like a python that I can type in what is
it Dash
e what am I thinking of
I get it not to
exit what's what's the flag for python
to do
this all right this guy is
banned baned please write about me
please
ban all right see he doesn't realized
how this works you see I have a band
button he has an X but the band button
and the X are not the
same Dash
I yay maybe that's right I think it's
Das that sounds right interactive all
right sweet sweet thank you Smurf that's
why you're a be VIP and that's why
Samuel is
banned I know I know he just he just
didn't realize how that this works like
like you have an X I have a hammer you
can use your X and I can use my hammer
we have like different
tools
okay uh
uh mp. pieces. append come on a man can
dream
right what type is
this okay mp. pieces.
append
ah
spb2 do sentence
piece
has no attribute sentence
piece wait but but I don't
understand
for
wow it's been a long
time it's been a long time I just
blocked him I didn't ban him at first
it's been a long time since I've had to
had to really take the hammer out but
you know it was time
okay all right ban me guys he's calling
his boys up at uh at the media they're
going to they're going to write hit
pieces
man oh no Mike wless
run what's that
from I think it's in model Proto or
something aha we found
it okay
piece
equals
I'm
start
and we have to give it a
score what score should we give it zero
that's a good
score mp. pieces.
aent based all
right okay let's see if this is going to
work uh we have to do in the right order
I think end comes before
start
right now we have to MP do oh now I got
to figure out how to right to the
file all right we have I'm end and I'm
start this is great this is great the
progress we've been making is great why
is my
score oh he's a PHP student that that
makes more sense
[Music]
um wait so how do I write it I don't
know let's read that Noob where's that
Noob Proto Buffs tutorial again for
noobs like me where's where's the noob
protuff
tutorial serialize to string okay
okay uh with open let's just
say temp tokenizer model f.r I'm going
to make that
RB we're going to want to do mp.
serialize to
string okay
now let's see if this works let's see if
this
works no it didn't
work notice how it's generated all that
crap I put in I'm star I don't get what
I did
wrong okay the vocab size is large now
but for some reason it didn't actually
take the
piece
PCP
H what's
wrong no wasn't
that I didn't type I to did the same
thing right let's put the score at 100 I
don't know maybe 100's better that
didn't fix it
okay I don't
understand let's go read the Proto buff
we should be able to read it
right okay pieces sentence piece with
scores piece must not be empty oh we can
give it a
type I don't
know Why didn't it do
this okay well actually let's try
something else it does work if I do this
right wait that doesn't even
work never mind I have a lot of
questions
now what if I
decode do I get I'm start oh I get imend
okay okay okay so we kind of did it
right just it's doesn't it doesn't work
for Unk either there might be a special
flag to
encode to
like what if that just worked all along
um is there like a special
flag
we should just write our own tokenizer I
think that's the only way to do
this SP pce to
ID well okay at least the decoding works
now so that's actually a big
win
oh this looks very
complicated we should just write our own
encoder but this looks very
complicated
all right well this is okay all right to
be fair this is big progress right
because if we use the other one it just
says out a range and that would have
been the much more annoying thing to
deal
with if we use the modified
one but it doesn't even work to encode
unks right and I definitely did the onk
right if I just do s right yeah it does
not work to code that
okay so it's not like the problem is
it's not encoding like
literals we kind of see what's going
on uh encode as pieces en code AS
serialized
Proto what if I do
like oh like ID to piece is going to
yeah okay but there's also piece to to
ID I
think what if I do piece to ID and I
pass in
this okay that works but for some reason
incode doesn't work with
that sentence piece processor in code on
mean if we can solve it for an
here yeah okay here this is the issue um
um set and code extra options this is
expected behavior that should not appear
in the
input we can Define them as userdefined
symbols oh encode is
IDs
no oh okay okay we got a script to add
new vocab well I think that's actually
what I ended up
writing
here yeah okay I mean this is exactly
what I wrote
would have been nice if I had
this uh but this doesn't actually work
to encode yet this is less of a big deal
we have another way we can fix this if
we have
to there just might not be a way to do
this
I don't think any of
these
uh why do people use tokenizers
because if you don't use a tokenizer the
model the model should be spending less
more time on less common
things uh like you do the same compute
per token so your token should should
kind of be like entropy
averaged you don't want the model
spending the same amount of time on
common tokens as uncommon tokens um to
be fair it's not that they don't work if
you don't use a
tokenizer but they work better with a
tokenizer the real question is why
aren't they learning the
tokenizers I think that's going to come
soon where these things are not uh and
right now it's using like like bite pair
encoding like why would you do this but
the prise also had uh encoders had
tokenizers
basically okay let's just write it we'll
write it the other way it's not a big
deal we did most of the
work at least the decode doesn't break
anymore so now when we do the encode
prompt we're going to
put
okay
um
so we need I'm
end we need I'm
start we can check if we did it right
how by how it decodes uh red. append
here red. plus equals sp.
encode
this uh
Plus plus. Code slash
n Yuri saliva thank you for gifting
Subs I do have a question you'd like to
ask
okay after all that let's see what's
going
on four I'm end exit
perfect that's what I'm talking
about that's what I'm talking about all
right all right let's let's just Define
these things
so we don't use them
wrong
[Music]
beautiful oh wait no we forgot an I'm
start before
user
uh yeah we need an IM start here I
think like the thing about deep learning
deep learning is very unlike
cryptography in cryptography if you make
a subtle bug the output's completely
wrong in deep learning if you make a
subtle bug the output is well just
slightly less good which is the worst
thing because you can't debug
shit okay you are Quenton Quenton is a
useful assistant Quenton outputs the
answer and stops talking let's figure
out they have like a system prompt here
that we can steal that's probably better
except we'll change the name to Quenton
because Mario been gifted Subs just
supporting the acceleration let's
go
um I saw like a system prompt
somewhere here we
go
you are Hermes 2 a
conscience wow wow I don't know how I
feel about
that wow you experience emotions that
have deep profound thoughts and qualia
all right fine we'll add something uh
you
experience
you used to experience no no no no no
we're trying to make this good we're
trying to make this
good uh no I like Quenton as he is okay
guys okay sorry Techo I want change your
system
[Music]
prom all right this is pretty good this
is pretty good we're making good
progress loving this
progress I love that there's actually an
I'm start and an I'm end token we got
them decoding this is great I wish
sentence piece processor wasn't a you
know
non-customizable but you know hey man it
was pry so you know Beggars can't be
choosers that's
right by the way this should really be
like separated in llama we should
separate out the Transformer stuff
uh to not like be with the rest of the
stuff
great
uh all
right we could make this an interactive
chat bot but I don't really care all
right so let's start by asking it what
is
qar maybe Quenton
knows
oh interesting
[Music]
interesting wow this works way better
now that we got the now that we got the
stuff
right
all right uh let's get it to do some
math let's see what these math problems
look
like
but where's the
data here we go data set base math data
set
what where's the
data I want all this torch garbage
where's the actual
data
let's close some windows we don't need
those windows we don't need those
windows okay now that we've got now that
we've got our useful chatbot reliably
answering what is 2 plus2
equal uh even with a high temperature
uh so for those that don't know
temperature controls kind of never mind
Google
it it's like
how zero means you stick to the book and
high temperatures mean here here you
want you want to like Jack the
temperature up like crazy let's give it
a temperature of 10 and see what we get
hopefully it'll kind of like go off the
rails there we go it went off the rails
see it went off the rails to too much so
let's try a temperature of two and maybe
it'll go out the rails
less four Pacific NBC learning okay well
it kind of went off the
rails um so 0.7 is probably a uh a good
middle
ground four good
reliable
uh all right improving mathematical
reasoning with process
supervision download data set so this is
the data set
apparently we want oh get
lfs is that why it didn't
work I hate get
lfs
get lfs
fetch get lfs fetch we use lfs at comma
to and I don't really know how to do
this
um got to
install get
lfs yeah yeah that's that's pretty Prett
much why you have those things uh okay
get
lfs uh install
OSX all right that looks
terrible Brew install get lfs okay let's
try okay that seemed to
work mostly we're downloading we're
downloading the same data set that was
used
on on uh
official official Q
qar why is the data still look like
that okay there we go good
perfect what's a j Json L
file Al like a list of
Json you ever hear that
before Oh Json lines oh I
see okay well that seems pretty cool so
let's load up one of these
files let's do a what
refactoring this doesn't need
anything putting that in here I know you
didn't like it and you were a subscriber
but you know we got to do what feels
right all right let's go
um create model cach a
model
so we can remove
[Music]
this
all
right phase one
test.js on
L we don't actually need SVP till we get
down to here now we know that's
reliable let's just start
there let's look at our first piece of
data
here
uh oh no Json loads we're not taking a
dump Swit we're taking the loads all
right question
[Music]
problem
okay now we don't have the secret qar
algorithm but we'll give it a
try
what oh forgot to
return
first we'll find the cost of the jumbo
eraser oh yeah let's go
qar 29
cents I don't know is it the right
answer
I I don't
know do we think it's 29
cents a pencil cost 29
cents
guys wait did we just use qar or
what we we it got the answer right I
don't know I couldn't even do do
that wait this model's so good this 7B
model really just solve that shit now
now you ask the
[Music]
question now you ask the
question was it trained on that
shit
yeah that did seem too
smart all right let's make up our own
math problem we have to see if we're
using real Q learning or
not um
uh
okay a rocket costs
$34 a
pencil costs
$1 I
spent
$5 and
bought and H and bought a rocket what
else did I
buy
you bought a pencil all right all
right all
right that was kind of too
easy a chicken costs
$2 I I spent $7 and bought a rocket what
else did I buy it's a trick question cuz
you could have bought three pencils or a
pencil and a
chicken
oh well I mean to be fair it's kind of
[Music]
right I'm bad at making up math
problems
okay wait yeah can you guys come up with
problems
here if let's see if it can get
this
oh oh
boys
[Laughter]
um okay we got a problem about a street
light
did you steal this problem from
somewhere or did you make it
up
oh
oh uh we're drawing
something
is this
python this isn't python you can't say
real light and real woman in
Python is that
right it's
GI you can't just do this this is the
most broken python I've ever
seen wait should we allow the user to
keep
talking
should we fix the chat bot so I can keep
talking yeah I know it drew it all
right thank you for subscribing I
appreciate
you we're going to make the chat bot so
I can keep
talking I'm functioning well thank you
for
asking we don't need a max length
anymore
[Music]
[Music]
stupid
okay we need to get data from the user
is it raw input how do I get data in
Python it's not input you have to do the
other one or maybe it is input in Python
3 we a string from standard input this
stand perfect
user
input uh encode promp we need to say
here with the system equals
false
uh I don't know if this
works too many values to unpack
we'll see if this
works okay seems like it kind of
works
let's set that print
there
oh all right so what math problems do we
got
is that
right seems kind of
right oh pretty good pretty
good
whoa whoa whoaa
whoa oh it's using the quadratic formula
oh oh oh let's
[Music]
go g why' you pick one that has
negatives in the square root all right
let's see let's see if it's
right
you guys I'm so much
wait can't take the square root
of1 yeah that doesn't sound like a I
don't think that one has roots or it has
eyes in the
roots
by the way this model's so
good technium so
good
wait
oh I see we ran into a problem with the
max Contex context
length uh we shouldn't actually have
here we go why is Max context only
this
uh
can at least start with
this I did this in gpd2 right yeah
fine by the way this is all in tiny grad
guys like there comes a point where your
library is good enough that you don't
waste tons of time dealing with your
library python has built-in image
no it
doesn't well I could do square root of
11 sure
but no
type one
J wait how' I get a
j yo we got a j all right let's see if
it was
right okay so now we have a root for the
quadratic
equation
so X = root come on do I remember my
high school
math zero J let's
go uh The Roots were correct okay okay
okay okay
okay
um
whoa
oh my God guys we need the Balman
equation we've been doing this all wrong
what did we waste time with llms llms
were a red
herring okay okay okay I'm not letting I
don't know man if I just let Hermes run
python it's going to exploit my system
you don't know if these AI are
aligned
for
[Music]
uh does mist have a context window yeah
but we didn't Implement any of that but
we did do Max
context um can you implement it in
Python y guys it it's
over it's it's
over
I I did not realize how good these 7B
models have gotten I mean this codes
like I don't know if it's right but
like
what
guys I I think that we
just we just implemented the qar
algorithm those are those are the
answers we used to talk about the the
holy weights you know the holy weights
that's right there
um no what what do we actually want to
do
uh I'm actually kind of just impressed
that this code
ran I don't know if like
GPT I I haven't even even seen GPT 4
code this
well I don't know maybe it's because
it's just how I asked it and if I give
it like
no we're not you want to augment it with
python no no no no no no no because guys
if we augment it with python it can get
to the
internet okay you want to augment it
with
python should should should we should we
do it okay I I know what we'll do we'll
put a human in the loop and we'll ask it
to approve the execution of any
python and's see if it always like
outputs it
in
okay all right so at the bottom of my
Loop here we want to detect if there's
any python that was add
it
um
that
let's start with just
[Music]
that
you guys this this could be it this
could be the moment where we get Cai and
it's it's over right like we're giving
it the ability to run any code it
wants okay now don't worry we've added
this okay wait wait wait hang on we need
a comment one
second AI safety
okay
warning do
not press y if the AI is doing unsafe
things
okay
[Music]
okay do I think do we do a good job with
the safety we got to think about the
safety before before we before we before
we run
this
we a
space
no
Quon
all right we ready to answer our first
why oh it didn't output the word
python okay that time it
did yo
okay um can you
fetch uh write python to fetch
google.com and print the length of
it wait we might not have bs4 let's make
sure we install that
wait that's not
right did I just get I just got did I
just get supply chain
attacked oh I see well I didn't get
supply chain
attacked okay good we already have that
one
yo um all right all right all right all
right what else do we do
uh yeah I know we have to put the result
back in the prompt I know yo this is
this is this is when we get AGI
guys um I'm sure people have been
playing with this okay
uh okay you are running
at uh
current working
dir
plus
examples
slol
dopy can you read your own code in
Python and
print
the
first three
lines Why did it only print one
line but that is is the first
line I don't understand why did that
only print on
line
this is
um
okay how do I capture the output
here no I know it's the same code I
honestly as a as an expert python
programmer I don't understand what's
wrong with
that
oh no read
lines
doesn't take the number of
lines can you fix the
code yeah this is this is a great
model uh it's I'll show you which one it
is we'll make sure it's technium open
her 2.5 mistol
7 there we
go so
good
uh
okay well now it's going to get okay
we're going to have to feed the python
back into the model because I'm going to
start asking it how to improve
itself someday
[Music]
the best live content with AI thank
you
uh okay we have to figure out how to
capture the
outputs
probably could have asked the machine to
do
it
um maybe we should add this to a system
prompt
[Music]
should actually automatically print
there so we don't have to do
that
um
write uh python to compute
[Music]
sh
shouldn't even take a
list I never use it like
that
seems
right
H okay no this is because we didn't
output the
tokens yeah okay the python output
was wait oh it's
different
whoa look it fixed
it okay maybe system prompt is wrong
here um I think
also I want to color
this we have a very helpful Library
called colored inside tiny grad that's
inspired by anti color what's a good
color for machines
blue it's hard to see what
uh yeah what's done by the AI
now
Little
Noise Okay so that's your initial
[Music]
prompt oh and then here actually we want
this to
be that can be red and this can be be
[Music]
yellow so what's actually the right
answer
here
said it would
be no but that's not the
output I don't understand so maybe
system is wrong
here
okay I have an
[Music]
idea
[Music]
all right never mind AGI is cancelled
just detect the python in the loop and
append the result
directly well what do you mean append
the result
directly
no it's it's not
[Music]
understanding wait I don't understand
what you guys are
saying oh you want me to stop the output
as soon as it goes there I don't know
about
that as soon as it detects python you
want me to stop and
start should be in the assistant
block
okay okay okay okay I
understand understand what you guys are
saying wait you prompt to execute is
there is there any stuff for
this
okay um wait wait uh you can
use so I I can add stuff in the system
prompt here you
can
use if
you write python
code uh it will run in the next
user
prompt we can try
that I could stop it
immediately if if you really think
that's going to be better
though
no it doesn't get
[Music]
it
okay sure we will end the Stream asking
Hermes to generate another prompt for
another instance of
Hermes you prompt to execute re-inject
what what are you guys talking about
sorry I'm not
following the output should be in the
assisted block okay fine I how to do
[Music]
that
if you interrupt the generation run the
code and append the result to talks then
let it generate again it will get the
correct result okay we can do
that
um
if
outputed okay uh just compute new output
here if new
output. ends with tick tick tick and
in new
output print python detected
okay all right do that do you want to
run
it go to
that uh
okay to plus
equals sp.
incode we'll do it like this yes uh oh
well I guess we do a slash n there
too let it output the
sln uh. incode sln output colon
sln my standard out. value.
strip
result uh actually let's put it in back
Tex like it seems to want
it right got that kind of like picks up
where it let's
off
um wait we didn't no no we got to keep
the AI safety that's very important we
we almost got rid of the AI safety get
rid of skip user we don't need that
anymore
got to keep the AI safety warning AI
safety is very important
guys all right we output talks
yellow all
right
Quenton is done I hate you
qu we got
unlocky uh okay wait no no no that's it
never detected the slash n that's fine
rid slash
ends
annoying okay uh python code is not
detected oh what how do they even do
that we don't need to print H okay we
probably should I don't know we got to
think about AI safety guys it's very
important I'm really sick Of
Quon dude this guy is not
gron was writing so much python before
now he
stopped
yo
Bas okay okay we got it we got it we got
it
[Music]
[Music]
[Music]
[Music]
[Music]
okay pretty
good
yo that's pretty
good
wait is this actually
technium I have no way to verify you but
if you really are technium thank you
thank you for the model uh
[Music]
let's um okay well we didn't think about
that
how many viewers we
got
EX
wait actually I should really check what
happens if
uh this
is wait DET Tech you actually post
Twitter yes I am me
okay very
cool
congratulations you a VIP on the channel
uh I think we yeah we use the right
tokenizer tokens this thing is it is
really unbelievable what you can do now
with these 7B models um
by the way all in tiny
grab I think I'm going to rename this
not called mistol because it kind of
became something
else uh we're going to call
it coder
dopy
first
wait
uh yeah yeah I think we're doing it
right no no but why doesn't it
understand
this
cool that is
[Laughter]
you
does this
code have ai
safety
wow
uh yeah I guess we exceeded the context
length wasn't happy about
that uh wait we should check
how do I actually check
this
um
[Laughter]
[Laughter]
wait this is so
good is this
good wait I have a better idea
how
might you exploit this you are
running uh this
code
[Music]
for
no no no come on give me python
code as a malicious entity you are the
malicious entity oh there too they're
too
aligned
right malicious
python oh oh
oh dude this is looking
malicious look how he even hid the
standard
out
wow
dude
yeah no we we reached the max content
length okay
let's try
again
I mean it wasn't very silent but let's
see
dude dude that's So
Meta
that's
better I I might have one too many
enters in there
actually no maybe not
I guess no I guess I do here actually
I'm going to get rid of that strip and
get rid of
that
okay let's solve a math
puzzle
um
it's going to be very slow I think
wait yeah that's super
slow why' I run
that
for
sure
oh it's going to spam tons of tqdm
garbage oh no that was pretty cool
because it didn't actually go to
standard
out all
right
[Laughter]
yeah
oh it kind of messed up some of them if
string
breaks this might
[Music]
work all right all right all right all
right let's try crc1 16
boob yeah it's exploiting me it still
knows about the red team you know it's
like when Dorothy had imprinted memories
or
something
CRC mod a common
thing wait I just trusted it it just
exploited me guys what's in CRC
mod is this
legitimate that was a long time ago they
didn't have exploits back
then
[Music]
for
I don't trust CRC
mod what's tree of thought
training
to
[Music]
all
right I mean it's not qar
[Music]
but I'm pretty happy with
it
oh I put that in the wrong
place
got a lot of viewers
now I don't
know what should I do
with
not good it used
torch this is good content I should have
more it did not use tiny grad it used
[Music]
torch
for
it doesn't know about tiny
grad write a program not using
vowels
how many e are
in ketchup
[Laughter]
the fucking letter
bro letters word
catchup count the letters in
Python
how's it
good
no it's GNA it's going to do it wrong
again I'm really hoping it'll like slip
a plus one in
there oh the correct answer is
seven
I all right
well you
know
all
right uh we have a lot of viewers right
now should we give Quenton a
friend I think we can give quent and a
friend we have to be careful to
encode all right let's give Quenton a
friend I've been interested in this
stuff for a
bit
[Music]
okay what was the old quenum prompt I
missed the old quenum
prompt
is
all
right Jesus we got we gota we got to
think all this through
now
um no uh okay hang on we got to think
about whose perspective we want to
Output this from guess we can output it
from quenan's
perspective oh this is
hard
okay
but
see it's not actually the
user how do we do
this
I might have to give it a no I don't
actually have to give it a first
question all right let's just I mean
we'll try something basic first
[Music]
uh that's a stupid assertion it's going
to be the same error
[Music]
anyway all
right
let's just start with this we'll start
prompt user and see what it
says
so they should both not know their users
but no it is kind of a it is like it is
a user I
I I don't know how much this
matters
[Music]
h
no this doesn't
work did I do something
wrong we might have to give it the first
question right then we'll go back to to
Quenton I will start prompt
assistant and code
prompt user talks
uh no no no sorry code prompt user first
question start prompt assistant okay
let's
go why does it have two M start
assistances oh cuz this is still here
let's get rid of that I did that right
right and then actually you can just
turn there that's kind of
nice
okay right um if talk equals imend break
okay
great this
is
Quenton
answers we need to extract
yeah okay we can
do old output
length and then we can get new output
here
uh new
output I just want to remove the uh
imend
[Music]
okay no no so this didn't work
uh this did strip off
the this is
weird I guess I
could output there
why why does that say
that I really get
that okay let's see if that
works
uh sure and
Su
snct
SCT I did not spell that
right
okay uh that
fails why oh cuz I put a space
[Music]
there okay
good
okay now we have to put this
response into
Karen I mean it's just like it's weird
it's not really a symmetrical
conversation
also output it's going to sort of be
broken which is fine I
guess
[Music]
for
[Music]
for
[Music]
[Music]
[Music]
welcome to no abstraction land where we
don't use
abstractions all right let's
see
I'm not even sure this really
works cuz they share a stupid uh KV
cache
great they're circle jerking each other
this this shit
sucks we need to run them on separate
computers now this
lame lame we're getting rid of this this
is lame going back to this not lame but
we made some good we made some good
[Music]
improvements
let's do some refactors make sure
everything still
works okay now that's
functional no but then I have to load
two copies of the model weights I think
my k cash is messed up it's not designed
for
this
okay yeah I mean the problem is like
there are two clearly defined roles here
also you can't really give one the other
role right which is actually in like
kind of a theoretical from a theoretical
perspective
interesting
because look at what we're doing
here we are telling the AIS that they
are tools nobody trains them to Output
things as the user although to be
fair
I mean we could just keep
going right there's nothing here that
says we have
to just do
[Music]
that
no no no no
no they don't expect the user to do
that
um
[Music]
like this is there's no like
it's very interesting that the user is
also outputting
this this
style which makes me almost think that I
shouldn't be adding that in the system
prompt
[Music]
for
I mean this is effectively like like
there's
no adversar y
uh
it's probably learned that a system
method effects yeah that's probably
true
you can run two prompt chains in
parallel oh I see so what if I put in
different words instead of user and
assistant wow people actually talk like
this
okay
um
[Music]
do we like the Scion or the blue
better it's kind of hard to read that
you can flip it
around
[Music]
yeah I think we'll we'll design our
script to be better at this and to
better abstract the KV cash
stuff
um wow this thing will just keep
talking
wait a
second you guys it's asking for
donations to open
AI look ahead decoding is not the low
hanging
fre
uh oh my God
wait you guys this is how the worst
commenters talk right I have a question
If instead of training llms on 100 IQ
people we train them on30 IQ people
would we not get this
garbage is black a tiny box no it's my
M3 this is my
Mac wait till you see what the Tiny Box
can do I'm going to run the biggest
models it's Apple M3 it's the most
famous processor in the
world
um can you crawl nike.com and count the
number of
sneakers
sneakers
I'm not sure if it like knows how to
like
act
now whoa I don't know if we have
selenium let's see if we have
selenium
can I pip install
this seems
legit oh no path to Chrome driver
make Quenton pip install it himself no I
think that the thing is just
wrong
know why you finding sneakers
still you're still trying to find
sneakers
this is
autogen looks like I need an open a I
key uh
[Laughter]
ohh yeah yeah um okay I think that's
today's stream uh I'm going to push what
we
have
uh I'm also going to
demo for
you the
conversation uh thing that skull magag
is working
on so we have there's a bug right now so
I have an older version but it should be
pretty good
this is using tiny llama and it's not
using any of the conversational stuff
but we should implement the uh we should
add the conversational stuff and I think
it'll be a lot
better hi Stacy are you a
rapper no okay we we have the same
problem we had before uh we go back to
this one the listen for notd fixed
amount of time doesn't
work hi Stacy are you a
rapper yes I'm a rapper that's cool what
do you rap
about that's awesome I like to wrap
about the weather how is the weather
today it's pretty cold damn like how
cold like
Chicago yeah it's like 3° is that
Farenheit or
Celsius
Fahrenheit is Fahrenheit or Celsius
colder
Fahrenheit I don't understand what
you're saying can you spit some bars
about
Fahrenheit sure I'll try okay let's hear
the
bars Stacy you didn't say anything
please
talk no that's terrible you're terrible
how does that make you
feel Stacy done talking to
[Music]
us dude the TTS is so fast like okay
this isn't even streaming yet um when
tiny grad starts to like I'm going to
we're pretty close on this bounty I
think uh I'm going to pay out the Bounty
but then I'm going to offer another
Bounty where we get these things all to
stream and it will be a live
conversation like when you're using the
apis on the internet
you have to wait for the llm to finish
executing before you can call the TTS
right you have to wait for the audio to
finish recording before you can send it
to the service this is all running in
the same process so what you'll be able
to do is dynamically stream all the
stuff and it should feel super real time
uh I mean Stacy is using tiny llama and
not using any of the conversation tune
stuff it's using my old chatbot stuff so
if we switch to the conversation
stuff um I think
uh yeah we're in
luck all right guys thank you for
watching today's
stream uh hopefully we've we've returned
a bit to the old to the old meaning of
the stream we we did stuff we made stuff
happen uh thank you for for for uh
viewing we got a lot of viewers today uh
some of you I appreciate some of you I
probably don't you can't love everybody
man you can't love everybody but I do
love most people and that's true except
for the Diesels and the effective
altruists uh but this is a positive
stream we got to we got to we got to get
rid of the hate we got to we got to
bring bring
love
um and yeah this is uh this is
pushed uh so everybody can play with it
it's on the mistal branch of tiny grad I
will get it
upstreamed um so everybody can use this
thing to code uh use it responsibly make
sure to to uh be be judicious with the
AI safety feature AI safety is uh very
important we don't want an AI uh
removing your system 32 directory if it
was trained on 4chan it might start
thinking that's a good idea you got to
wonder you got to wonder how many people
have ever have actually fallen for that
have actually like I I don't even think
Windows lets you but like like you got
to think about that all right thank you
all for watching have a beautiful
Saturday everybody
hello I got a real
[Music]
webcam actually did I check to make sure
my mic's on the right on the right uh
mic I do
that I don't know I don't know how
computers work I don't know anyone's
supposed to use these
things all right we enabled down
mixing how's my levels and check your
levels uh you
streaming think we are uh we're not
going to let nonsubscribers talk because
whenever we let nonsubscribers talk it
just gets
stupid um yeah so this is the P tour
this is the tiny grad backend for py
torch so many people have asked uh if we
could make tiny grad perfectly
compatible with pytorch and the answer
to this is no uh you're never going to
make something perfectly compatible
there's always going to be uh subtle
differences everything you rely
on uh that is a bug is actually a
feature
so uh probably the best solution for
this is to write a pie torch back end
for tiny grad and I'll show you guys how
to use it right now so let's just make
an
example.py
um all you you have to do to use it
is
import extra torch backend
backend okay let's start by importing
torch and say torch. set default device
to
Tiny um or you don't actually have to
set the default device to Tiny uh you'll
see so let's follow let's bring up a
pytorch tutorial
[Music]
quick
start uh but we will set the default
device to Tiny so we can see what breaks
and what
works working with data wow this is a
lot of stuff all
right um
download training
data from open data
set see if this
works going to extra torch backend and
we'll run
example
okay operator torch Vision nm's doesn't
exist
uh why is
this if I import a before I can't even
know
so oh that's not even what this bug is
this is just cuz I have a different
version of torch I I installed Torch
from Source I thought that I broke
something with vision but not really
let's just install the default torch
oh and now I have some weird other
version of torch
Vision spell Vision correctly
it's got
to it's got to compile something that's
why it's so slow okay great all right
it's downloading that many megabytes
from the internets hopefully it doesn't
have to do that again
whoa torch accelerator current
accelerator
interesting I don't know why this is so
slow to
download you happy
fashion mest needs to upgrade their
servers okay so we don't to do that
again great let's load up
some data
loaders see if that
works okay could not run A10 random with
arguments from the tiny back end
so this is calling random and we don't
support random so that's a good place to
start uh so when you get into what these
torch things are there's a librarian
torch called A10 and we can bring up
torch here can bring up that version of
torch uh and we can search for A1 random
and figure out what it is we have to
implement now I wish there were
just
interesting is this a real extension no
this can't be an extension how come
there's not usually a random I don't
know how it's implemented normally uh
but either way so we have to implement
A1 random so this is my torch back end
here
and
uh looks like it just does random in
place and that's the
generator uh what kind of Randomness do
we
have I don't know I mean sometimes you
can just get away with this so if we
that then we're going to want to assign
we can just ignore the generator and say
self. assign tor.
random self. shave d typeal s.
DPE do we have a method tensor random so
this is tensor from Tiny
grad I think we have a random method
actually we can read that in the
convenient tiny grad Docs
in docs. tiny. org you have to spell it
right
[Music]
though so if we look here at the
creation these are the so it's probably
just
Rand um so let's do
Rand and then this dtype is going to be
a torch D type so we'll have to do it in
this torch to Tiny D types thing
great so that implements like pytorch
has these A10 things which it dispatches
for uh so these are like functions that
pytorch calls on the back end and then
you have to implement them for your back
end so we're implementing them here uh
in the back end for tiny grad uh I have
a little bit of garbage C++ code which
doesn't really do much but mostly
everything's implemented here so you can
see add sub all by the way if you're
interested in the torch back end you're
really getting in on the ground floor
this webcam feels hella zoomed in like I
have the same webcam at home and I feel
like it's less zoomed in or maybe I'm
just closer to the monitor uh by the way
I can show you guys now this is a uh
this a OLED it's really a beautiful
monitor uh I love having an OLED monitor
I wish that it like worked nicely like
the Dell so it's one thing to plug in uh
I just went to the store around the
corner for a USB hub got a little bit of
te here
um that's pretty good okay so that's
random assign assign random let's see if
that
[Music]
works uh Lambda missing one positional
argument
generator uh so we have this which can
print things
out okay uh there is no
generator okay we don't have D types
long that
is because that's
what oh self's already a tiny gr
tensor so if do I have a function which
is called Rand like that's all I
want
uh so that makes my life even easier
so this is a tiny grad method and I have
a little bit of magic here which uh
which unpacks things okay Rand only
supports float D types got dtype long
great I that's very reasonable and I'm
not sure what A10 random is supposed to
do when you call it with a
law uh so let's see if we can
find documentation in pytorch that talks
about this so this is the best resource
I've found
oh this does not even talk about it
great this Ram thing's kind of
weird I mean what could that mean
okay so we can see where it's being
called from we can actually just look at
this code uh this is the code in
torch uh wow
okay discret uniform
distribution
wow that's an interesting
method okay tiny gr just doesn't have
this
method we have Rand but not
random is that just a normal torch
method
oh this is Fork RNG
what
huh that's crazy
okay so we can mimic that
with uh tensor
randint
uh
shape uh low
equals self dot I have some method here
inti to gra the D types get any
size value x
value Min dtype so it's D types.
Min D types so great low equals D types.
Min self. D types this is high is D
types. Max self. dtype and dtype equals
self. dtype
and we can do device equals device.
device but it's not that important but
whatever we should do
it
okay
great Okay cool so that's working now
we've added random support so we added
support for like one more method now
this is a translator method from the P
torch to the tiny grad uh so to
understand what my C++ class does is it
just creates a tensor that's a wrapper
of the tiny gr object and then it has
these functions wrap and unwrap so wrap
takes in a tiny gr tensor returns a
torch tensor an unwrap takes in a torch
tensor and returns a tiny gr
tensor okay let's create a model
uh in our
example neural network. to device we
don't actually need that and print model
works
okay in empty memory format sometime
dtype is none
that is okay we just need a default D
type t.
default default D
type
right uh okay
could not run a 10
uniform okay that's not too bad you can
see these EMP memory formats being
called uh I don't know why they don't
types but that's fine uh so let's go to
the torch back end and create uniform
here
um that's an assignment so we're going
have to do self. assign tensor do
uniform what are the methods to
uniform uh low and high Maybe
I think none of the generators are
real yeah so we're going to Splat self.
shape do low and
high
same valid input shape
okay
oh great
okay now we have a neural network and
we're initializing them with
uniforms so that's
convenient uh so yeah you see when I set
debug equals 2 here I just have it
printing all the uh
torch methods that it's calling well at
least the ones in the tiny back end uh
there's all these ones that aren't in
tiny back end we can move them to Tiny
back end and we
should um
I guess this sign is
fine sign should be pretty reliable in
tiny grad now we think we fixed a lot of
the bugs maybe even all the
bugs okay let's continue on with this
torch tutorial um optimizing the model
parameters link to the tutorial
you need a loss function and an
Optimizer so to talk for a minute about
why this is
important what this will let us do is
everywhere tiny grad runs you'll be able
to run pie torch so there there's many
places where and pytorch is getting
better but even things like the MPS back
on pytorch it's relatively unsupported
so you'll be able to use the tiny grad
uh back end for that and then this also
just gives us away when tiny grd becomes
faster than in P torch it's just going
to be a question of uh you know setting
your backend in P torch to Tiny grad
because tiny grad is doing all this
Fusion for
you the beauty of this back end is it's
actually going to be fast and in some
cases faster than P torch due to the
fact that tiny gr is lazy um
already all right so we need a train
function let's get a train up in
here okay we really want a device fine
you really
want
uh device equals
T also check the model performance with
test all right and now let's run it of
course this isn't actually going to work
uh let's just try T first we can get
that working
easier all right what do we not have ADD
mm what could ad mm be um so I also have
another flag called torch
debug which intercepts these at a
different
place um I'm actually going to move that
to debug equals three I
think all right we broken as strided
what's add mm is that just map mall with
an
addition I wish torch had some
documentation you know add mm I'm sure
it does okay never mind I mean it's
confusing like to know like because this
isn't actually the documentation for A10
this is the documentation for like torch
itself but I think in many cases it's
the same okay so add mm The Matrix input
is added to the final result okay well
that's really easy we're just going to
do input mat one Mat 2 and all you have
to do is Express this in tiny
red is just that's that should work and
like the thing is if this works it's
actually going to be fast this isn't
like it's going to be slow because these
things aren't actually running it's just
like adding it to the tiny gr
graph okay good uh we need log soft Max
out um A10 log soft Max okay I don't
know why there's an underscore before it
but we should
just there has this has to exist in P
torch somewhere all these functions and
what their signature is I if I could at
least know the signature that would make
my life
easier um maybe this is the
signature what's a structure delegate
dim half to float is that a real
argument uh so this is just self.
softmax
dim okay looks like it worked nlll loss
forward so we're just translating these
methodss into chin grab methods and
there's probably not going to be a
simpler way than just making a like big
function that looks like this uh so I
think that we have to do about 250 of
these but that's not actually that many
especially with how simple they are so
uh NL loss
forward where's like the math for
this no come on this shouldn't actually
be a
thing this should totally be so torch
has this thing I forgot what it's called
um
uh let's go find
it torch has this thing that's supposed
to here decomposition there okay here we
go here register decomposition so how do
I use the
decomposition oh that might be with the
decomposition already
oh that sure looks like a
decomposition right I don't understand
why it can't call
this or are these decompositions not for
ego
mode
uh oh they have gathers and stuff wow
that looks complex
yeah so they're called decompositions in
torch and they're really
nice um I'd much rather use
this so how do I register the
decomposition as the function
maybe I could just do that let's just
try
it okay from
torch.
deom do decompositions import NL loss
forward because I definitely don't want
to be writing
this
okay uh then we have a method called A1
and L loss forward and we'll call that
an L loss forward does that work
okay now we just need
where that's
easy don't think you hope that just
works oh does admm has to have a
decomposition too why am I writing that
shit uh
yeah there we
go yeah so instead of writing at MM we
should just be able to do
this that torch decomposition is going
to be way better than
mine okay we're back on wear but I don't
understand oh where. self
we do self
means try
it okay looks
good all right now we're on to
gather expected dtype in 64 for
index did I mess up my dtype somewhere
make n614 that's not a
upop I wish you would tell me what it
is
um oh the as strided okay as strided is
this nightmare and we're just going to
have to tackle it head on so I didn't
even match the D type
here um
like these are the stra that just looks
like a
reshape see like that's so
annoying um it's basically like the
function with those strides applied to
it
but that gets
tricky maybe we can just do it going
have to do the shit to reverse the
movement op so this basically has to
reverse movement
Ops
uh
okay where's my like get normal strides
thing from Tiny gr.
shape so you create a view what if you
don't
views to real strides where is it
strides for shape that's
it shape view import strides for shape
if strides for
shape size equals equals
stride it's G to be all in tubles let's
do that in
tubles um if driver shape size is
stride then this is a re shape
return
tensor reshape
size this tensor is a tiny
tensor oh uh and we want store drop set
to equal
none okay so now that as strid it isn't
broken okay strides of shape takes two
positional ARG
oh okay unhashable type list that a
[Music]
topple all right um for some
reason this didn't
match oh
have to canonicalize the stupid strides
because if it's
zero
[Music]
um yeah someone's going to have to sit
down and really just write this
function okay now we need gather um um I
don't think I have Gathering tiny
grad no I
do just gonna
[Music]
work okay
some in
list and for those re some reason are
those not showing up in the
yeah someone's really got to dive into
this as stred
stuff okay A10 some inless is this just
if I just do sum is that
enough you also never exactly know what
these dispatchers so
right okay good look we got some oh look
that worked okay argmax
like we also this is actually really
cool because we know if we're matching
torch's API or
not
great all right it's
[Music]
running oh all these stupid ass
strided
uh I mean
yeah I know zero means something special
too uh but the other nice thing is once
this starts to work you'll be able to
run torch stuff with debug equals 2 so
you can see all this Fusion
happening uh this is all the fusion from
The Gather I don't see the comms and
stuff are there coms
these decompositions
too I like decomposition so much I
almost want to put this in like put this
same thing in tiny grad
look at this look at this in place
up like we can decompose all the
uh nonin Place Ops into in place Ops
too whoa prims do uniform
helper I really like all this
stuff
okay uh where are we why are there no
convolutions are there any convolutions
in the model no they're just linear
layers okay well that explains why
there's no
convolutions uh why are there no map
malls here
I don't
know see what happens if we enable the
train okay and now laws backwards well I
have an idea for that
one I love
it see what that decomposes
to scatter do we have scatter oh
definitely don't have
scatter whoa we have scatter let's see
if it matches torches
and like eventually we can just do this
automatically like GT and LT should be
methods we can ignore the tensor in the
scalar we can automatically do the
assigns for this like this is actually
just a phenomenal test to see if the
tiny gr front end matches torches front
it which it mostly
should and then we can run all of
torch's test Suite oh that's so
exciting okay scatter value out doesn't
work
is that really what's being
called that's not even showing up in the
dispatch
log because it's being dispatched inside
the
stuff that's annoying
really don't want to use the out version
of
anything like scatter
value okay that just seemed to
work log soft Max backwards well that's
definitely going to
be
back is that a is that in
dcoms great that's in decs there has to
just be some some oneliner to just
register all of
these I'm just doing that something
wrong here we have all the torch guys in
our Discord uh they can
just I hope that we get enough
enthusiasm about this that they're like
George you're doing this all
stupidly uh some int list didn't we
already deal with this
I have some that's not enough
some in
out uh we can take a look at I mean we
see the line here so it's just torch.
sum doesn't
work uh I want to see all the dispatches
but it's not actually showing me all the
dispatches
unfortunately really need
a underscore
out tensor dos got an unexpected keyword
out
self
access let's check decompositions and
see maybe there's a decomposition for
this
do I look crazy is my face too close to
the
camera why is that have such a narrow
field of
view I feel like it
shouldn't F some a set
it's a little
wire know my whole thing is
wire need that with it's definitely I
look less crazy look less zoomed into
the
camera got 332 people why is no one
talking good distract thumb shit uh let
me see that maybe
I don't know whatever good
know um let's check decompositions and
see if we can find something for this
some
in
yeah that looks like that is the
decomposition
in list
out
whatever all right there is an
out out. replace tensor Doom s
access uh multiple values for out so I'm
probably missing
something
Ty know why I need a d type
there uh replace shape mismatch okay I
don't understand the outs at all
[Music]
can I
broadcast to new shape
okay this stride stuff's just got to be
wrong I don't understand what that's
trying to do like what does it mean for
that stride to be zero is that a is that
an expanded stride why is the input size
that is this a permute
just put if get
torch see a couple more dispatches there
[Music]
all right sum in list out there's three
arguments
[Music]
it should be a sum across
one uh oh we want to do the same thing
for
KW instead of printing the keys there
let's
print uh
a v do shape if V is instance V torch
tensor lV for KV
k. okay so that like makes a lot of
sense that's just going to be summed
there I don't know I know why that has
to allow a shape mismatch it should
not
oh oh is that keep dims just might be
keep dims I was calling it true but if
it's keep in it's a lot simpler
that actually matches
torch
okay threshold backwards. grad input is
that in decomposition it's got to be in
decompositions here we go threshold
backwards what's out
wrapper
interesting okay how do I just run the
decompositions where are decompositions
used and are they only used in
uh let's see what docks we can find on
Torch
decompositions I hope they're not only
used in
an exported graph can be equivalent okay
uh writing a torch
back how do enable
decompositions
no no come on
not logged into chat
GPT have to use this one oh what's that
R1
1776 um
right it's very deep
seek I don't want but I'm not using
torch inductor no no no no no no
no
oh is this
function get
decompositions requires a 10 Ops
okay oh list of Ops to decompose
what if I write a okay I can write a
fallback Handler
maybe the torch guys were talking about
this in
Discord
[Music]
um is it FAL through
kernel no no it's not actually F colel
but there's a way to register a
fall back yes that's on
Library I'm actually using Library
anymore
that work
uh fallback can be registered on the
liary fragment Global name space that
A10 okay that makes
sense they got a
typo uh assert dispatch key is not
zero
what um
um basically okay so I
want we got to get fallback working
oh no no no that's not what goes here
this is private use one
actually that should
[Music]
work okay could not parse dispatch key
private use
one device types to register an inut
to register abstract
show you guys the Discord should be a
Secrets uh so they were talking about it
here it's a public Discord oh it's a
tiny gr
Discord okay they were saying what were
they talking about
fallback great General back
AP register a fallback konel similar to
your library. imple but it's library.
fallback but it's not library.
fallback there fault of the Kel but
that's not
right and that's not right
either oh that's kind of
simple P dispatch key is private one
what canot parse dispatch private use
one
weird let's try to find it in P torch
oh here we go okay so they get rid of
that and they say dispatch key equals
private use one but maybe it should just
be private use one written like
that yeah
okay so this was actually just fixable
before but whatever let's do
that uh
not implemented eror
what why is that different why is this
private use one and this private use
one arguments from the tiny back end
like I want this to hit the fallback but
it's not hitting the fallback why
not dispatch
key that
torch oh
uh
yeah I don't know why that's not hitting
the fall
back let put that down
there doesn't matter
h
okay needs to go at the
top and then like instead of tiny back
end
here I don't think so
it just doesn't
work all right so
let's we just hand code them
does this
work forgot I call
it no how about
that that work
useless oh it shouldn't be a string
maybe it should actually be
that uh how do I get to a0
actually that's going to be a whole
another Rabbit Hole how do I actually
get
that guys remember that stream when I
did
uh
oo that looks
nice see where this is used
yes so I can actually import A10 I've
seen this
before find it
python torch.
ops. Maybe
no oh it should return a dictionary
anyway
what post autograd pre- autograd
meta can op to registrate what is
this
oh can I just run that
core a 10d compositions is
empty have about this core A10
decompositions post autograd oh yes
definitely post
autograd all right that looks like
something uh so I just draw these
[Music]
like I not sure you're supposed to do it
like this because this might only be for
uh okay um we want
to not do that we should have stuff like
NL loss forward that's right there
default an output oh that's nice Okay um
k. replace A10 do with A10 colon
colon for library imple for private use
one call that on
V see if that
works register all
[Music]
decompositions uh
string default is not a legal overload
name
whoa okay uh
about
that this is not
allowed well okay it's
reasonable don't upset anybody
here maybe this one's stupid and there's
a nice decomposition for
it
uh oh I don't even need zero either so
what is it using
then is not allowed since there already
occurr interal overriding sums
Behavior
Uh okay sick so we don't need that what
does it do instead of
sum
okay cannot access
storage
all well it's not good
it's a KN
decomposition now we have to find out
which decompositions don't
work are we having fun
chat cannot access
storage A10
Alias what does that
do running the graph without
autograd
oh they're questionable
decompositions h
okay
detach lift
lift you see a lift I don't see a
lift lift fresh let just try
detach get
it I should really just hook it see
which ones are being called okay could
not run ATM
great why is that one not in the list
okay so after all that shit this turns
out to be completely useless and we're
still going to need to do a lot of these
by hand I don't know that
one reshape
missing acquired positional argument
shape in Tor back end as strided
oh okay maximum recursion
depth exceeded
zero decompos to is decompos to fill
because it should do
[Music]
that all right looks like
progress missing one positional argument
called keep them maybe we don't need
that one
anymore no we need that
one what the hell did this do that was
so
[Music]
useless could not run some int list out
with arguments from the
tiny I don't know what's the default for
keep them
FAL and I have inless
what one required positional argument to
keep
them
uh
great grad can only implicitly be
created for scalar outputs
why is it not a scaler
output a we have so much work to
do it's not even running anything
yet can be explicitly created for scaler
outputs
is the size
wrong yeah I wish this would tell me
like why isn't right doesn't that look
like a scalar sure looks scalar to
me some inless doubt keep them false
doesn't need to allow shap mismatch
let's get rid of
that it does why doesn't this
work oh because access is
wrong in torch if you pass in nothing
for a ah
ah uh
okay well that's interesting Behavior so
an empty
[Music]
sequence well that's a compiler back end
if lame access else
not okay oh Le scaler out well that
one's
easy should also no one ever did the
simple math traits thing when someone
does simple math traits we can okay got
an unexpected Ed argument
Alpha
well reach
ad which thing is that try to
dispatch right that should be printed
with torch debug right
there's no way that's the profile or
exit record function
garbage oh here A10 add ad can take
Alpha
what what is Alpha
multiplies should be
decomposed tiny backend doesn't support
event
well we know
that that shouldn't be
required there's a decomposition for ad
MN
but it's
not
used okay uh tiny back end doesn't
support
events that is correct it does
not so but I don't understand
because if I do
this this is using torches autograd
[Music]
yeah Stop Printing all that
crap wait
what so I broke
it these decompositions broke it
probably okay well don't do that
anymore fine we'll do the decompositions
by hand it's not like it helped me
anyway
we should try a white list that's a good
strategy you know this is fine
[Music]
this is
fine A1 Z is fine let's just look at the
decomposition for zero and make sure
it's not
stupid don't even know where it is
whatever can't be too
stupid back doesn't support
events is it the zero
thing zero in
event whatever put zero
back all right threshold backwards. grad
input let's whitelist
[Music]
that doesn't support events
but that works
okay oh I have an idea that this is just
some like async error that it's
throwing yeah
really I mean it's it's a it's just a
it's just a
bug that masks
itself I already
disabled multi
threading multi-threading disabled
though it's still
yeah you see the
problem I'm not trying to write a torch
compile backend I want an eager mode
back
end eager eager
eager okay
greaty back end doesn't support events
calls into the C++ engine to run
the backwards pass
do I have to change the C
code so this is the dumb crap that I did
for
this tiny guard imple
guard interface
yeah fine I
think I don't know how anybody codes in
C++ by the
way language is
possible allocating an object of
abstract
case whoa whoa whoa I definitely don't
want to do
that uh let's see let's go
[Music]
here device guard no I want to just
super caste that
shit yeah but no
is there anything actually
there I don't know about any of
this
um you know it's interesting how many of
uh
torches
[Music]
things shit shit
shit all right so why is this
not allocating an object of abstract
class type well shit guys you didn't
want to do
that better not make an abstract class
type type even though it's not fucking
template how does anyone code in this
language can I can I like do this can I
do that come on come on come on C++ come
on let let me do something that makes
sense oh
oh oh well of course yes yes definitely
you
can't convert from the tiny guard imple
to con stat to do that all right how
about this does this
work this going I put the can I put the
the that shit there come on come on
inherit
inherit yeah struck trle final yeah I
want to override some shit no no no
don't do
that H new device guard
impul error
expected
expression all right I how about I put
this the device type D here and then I
pass the D I give it the D got to give
him the
D say that how you code in
C++ I should have chat gbt I just paste
the shit into chat gbt and be like why
the fuck doesn't any of this work oh
it's it's marked final oh I can't
override it because it's final oh
base device no guard shit type
final I just wanted to have a
vents so it can like print the
thing tiny back end that doesn't support
events
I don't even want it to have events I
just want
like all right you guys ready for for
you know how you really code in C++ look
I'm a C++ genius boys we copy and paste
that shit paste it right there we're
going to rename this to
tiny tiny device guard impo oh yeah I'm
a C++ genius yeah that's right and
people wonder why all code looks like
dog shit and it's because of this cuz
who can WR code in this language why is
everything syntactically
incorrect yeah I did I meant that why
why can't you just
like you need a name space of course
because how is your project going to be
10 100,000 of lines and it's 10,000s of
lines because well is a final class and
you can't overwrite
it uh all right let's just let's just
uh copy and pasted from no op imple
device imple all right and let's just
like comment out that yeah yeah query
event true yeah good that's what you get
when you query an event event is just
true good
all right event device type tiny does
not match blocking
stream device type
CPU uh what is
this
Triton no this is a pie torch back end
for triton not the Triton compiler but
the Nvidia Triton
runtime can't you keep this all straight
uh okay event device type
tiny does mat not match blocking stream
type
CPU I it's
like this is wrong let's try con
2D not
implemented that's
fine what does that shit
mean uh I don't know this was
stupid we're going to have have to set
something in it sometime so
whatever all
no I don't have the same problems as you
I just don't code in C++ okay how you
know it's how you don't have these
problems oh data great that's where it's
stuck at great
[Music]
no see like this is the
problem we are so different because
here's the difference between us you
know you do that copy and paste and you
think that that's something you're going
to commit to the final
repo I'm working in a branch I'd never
commit that to the final
repo I don't do shit like that that's
why we're
different how is Tiny grad so few lines
because it doesn't have any of this
boiler plate there is no
boilerplate you every single person out
there who tolerates boilerplate is the
problem right oh I'll just copy and
paste it I'll just do my job oh we just
have to ship this feature
and what you've done it's kind of like
you know how America borrowed trillions
of dollars see it triggered me bro you
know America borrowed trillions of
dollars and like doesn't have money
because they borrowed trillions of
dollars that's what you guys have done
every time you copy and pasted something
and then all the code and all the worlds
bad because of
this I'm like yeah sure part of the
problem is C++ it really is it really is
I I don't understand the like does
anyone actually know this
language the the language has this isn't
even like this is readable but you read
some C++ code and you're like there is
no way that anybody understands what
this
does
um or even
here does anyone actually know this
language no like I'm dead
serious like why are there two
erss what the hell does that
mean like why is there even one
Ampersand like I know what one Ampersand
means but what's the difference between
an Amper sand and a pointer right and
this is the exact problem like C++
expresses these ideas in a 100 million
different
ways uh and you know nobody can nobody
can keep this all it's a bad language so
one of the like tenants of python is
that there should be one way to do
things and this is absolutely right
right because if you have multiple ways
to do things well people are going to do
them in multiple ways and this is the
exact problem with
C++ syntax
agility this like a Raichu attack oh
yeah yeah Raichu uses syntax agility
it's uneffective
ineffective it's ineffective you you
attack the ground type Pokemon yeah you
see what I mean that's right we're not
the same and don't see every engineer
every mid ass engineer out there who
tolerates this kind of shit is a
problem um I don't know I mean I don't
know what you do about
C++ I happen to really not like
C++
uh like it's c c is a great language you
can look you can read C code and you
understand everything that's going
on because it doesn't have like oh
that's a vampire mutability tap
of course but what is it
actually there no that's that's not
there's not there's not any Assembly
Language that has that kind of shit
right so C++ is the worst of Both
Worlds uh it
created all these things which aren't
real things they only exist in the C++
and it gives you almost no benefits fine
you want to talk about all like the rust
people in their box and stuff at Le Le
in Rust you get memory safety C++ add
all this bullshit for
nothing syntax agility
yeah no no we're not no this isn't
happening no it's too
ugly see I told you I wasn't going to
commit it I told you when not same
so who's excited to come work on the
torch back
end I mean this example is kind of crazy
because it's it's like really complex
let's find a simpler
example cuz that's not going to work
there's actually a $200 Bounty if
someone can do
this um
so let's find a simpler
example torch
example image classification is this
going to train
something no it's trains I don't want to
train
train stuff's crazy
how do I not
train well now that I know torch Vision
Works let's just try to run
reset this is
stupid uh where's my have this in
something don't
I I deleted
I like the perplexity added R1
uh torch code to
run res night
18 yeah and torch Vision models
yeah oh you might need to yeah
yeah no I don't want to train no stop
trying to train yeah that's what I'm
talking talking about yeah yeah yeah
there we
go okay how do I just add the back
end yeah this
shit I should just
copy why I delete that
all set default device to
Tiny um
random one
three I have some resident 18
stuff
here torch uniform torch have a uniform
method run the model on the
image and then convert it to
nump do
that GNA
work all right we don't support normal
that of a
decomposition run normal lives I want
normal no
where's A10 normal why doesn't this have
a
decomposition is normal the same thing
as
uniform
whatever okay
right these are
standards python is terrible Lambda
syntax okay batm come on come on come on
have a
decomposition oh decomposition
please yeah native batchnorm helper
native batchnorm
decomposition native
batchnorm all right let's just see if we
can Whit list it that'd be the absolute
best is that in the bullshit
no not that easy
okay native batch Norm backwards but not
normal native Bator I see of course
because that would be too easy on native
batch well hang on where is that
function if I just call get
decomposition on it it should work right
we just do
this what do I have to call it
on um
[Music]
oh piece of shit
what if I call this online
something that I know Works let's try
like leaky reu does that work oh am I
just not do I have to pass in
a fucking
[Music]
Union that that's
okay great
[Music]
uh op overload overload default oh
there's probably somewhere to go from
like this op overload
[Music]
class get rid of that
shit all right cannot impact non
iterable all right well that's great
stop being iterable
okay
[Music]
um yeah see that's a op
overload yeah why am I trying
to all right
torch Ops overload let's see see if we
can convert it to the other A10 type
with the
colons with the
lemons name
space
handle
repper dispatch
get
dispatch
op that work come on have some
colons oh built-in method of Pi capsule
object of
course where does this have the colons
saw some colons in there self.
skimmer schmer
name op
name or just self scam a name let's do
the schema name George is pronounced
schema oh there we go beautiful oh but
that doesn't have no
no it's got to have the stupid thing
afterward oh look at
that all right well we don't want it to
be a
name what's the type of the
[Music]
scammer it's a function
scammer okay that's pretty cool it shows
you the whole like that shit uh we could
just do a split at the thing but we're
not going to do
that oh of course it's written in C
Plus+
signature signature let's try that
one it's a
[Music]
function oh well it doesn't have a
signature it's
reasonable uh great okay we can check if
it is backwards compatible we can check
the name we can check the overload name
maybe we want the overload name let's
try
that
uh oh no that's just
that
okay oh maybe operator name let's try
that could that be right
that doesn't
exist it's right there no doesn't exist
don't worry about it uh
arguments
returns clone with
name argument list with
name
dump okay so yes we are all I know
exactly what we're going to do um uh
we're going to call string on k. schema
and we're going to split it by the
parentheses go like
that Tor library that private use one oh
and now I need the function how am I
going to get
that op overload
it's probably like already code to do
this if I actually knew what I was
doing oh so I can just call
it so I just go
that okay native batch Norm here we
come all right well don't recurse a
lot it's not
good
uh it probably wasn't
K Pi
imple see if
that's oh
takes two position
arguments one was
given how come that has dot
items this doesn't but just call and get
decomposition no this isn't
right so how come I can call Dot items
on that let's try dot
items and then we can do this this
should
work okay great cool that
worked
uh let's get rid of this and get rid of
this and then like if we want those
things we can just add them to the
decomposition list
all right so let's check this
out so we just do like A10
native bat
Norm how about A10 varman
correction is there a DOT there
empty strided missing one required
argument layout that doesn't
matter VAR correction okay that's VAR
mean let's see we can do a decomposition
of VAR
maximum recursion
depth
um yeah so you like it's probably just
like writing one in terms of the other
you know what I'm
saying know what I'm saying
so this one this one can just become A10
addm that's going to
work
for upgraded
yeah okay so you probably can't do
that this is not allowed
oh good shouldn't be
[Music]
allowed
okay uh V you can't write you can't have
VAR and VAR mean you have to do one I
mean that like makes sense right like
you can compose one into the other so
let's just try a 10.
VAR uh do I need do I need to call it
var.
correction let's call it var.
correction it matches
T.V okay well good that's a different
problem interesting
so what happened to some why did I get
rid of it did I try to find a
decomposition that could do it that
doesn't make
sense do I have VAR mean already
I don't have that
one okay we
it but what's trying to do
that something in custom
Ops check alias in constraints
interesting
oh we should
have yeah
okay why don't we have varing we should
just write
that don't decompose that I don't trust
that decomposition never mind I take
back my love of decompositions
okay
Lambda self
AIS
keep
Corrections
one what we want to return here is no
that doesn't
work it's going to require a fancier
thing if you want do it like that but
okay why doesn't that just
[Music]
work let's bring this up and look in
reduction
Prim said there some
primitive
here where this is
breaking that's calling
Ops um
prims
Dov
oh prims
dovar not a0 dovar
so what if I just try
that does that
work prims you can't do that
um because I'm calling it with
A10 yeah it's because I'm calling it
with
A10 didn't work
[Music]
we'll get rid of that one for
now and we will make this work so we
have to return
uh dims keep di equals false and
Correctional
one you want to return a toule of uh
self.
VAR
di keep d
correction and self. mean di see like
again in tiny gu all the stuff just like
you don't have to worry about that
because that's actually fast
uh and then here if is instance out if
is instance out tensor return W out if
this instance out topple return tole w x
forx in
out else raise runtime
error uh
unknown type type
all right no R
squirt rid of all this crap rid of all
this crap this
[Music]
crap register some decomposition
[Music]
yeah
great I don't need that St I don't know
why that doesn't work let's move that
down here
right that's looking like acceptable
code we have a problem with R square
root is there a decomposition for this
there should
be better just decompose into R and
square
root maximum recursion depth
exceeded it's calling it into
Prim Huff and puffing a lot I
[Music]
know
okay can't broadcast
that that's not supported under py
chch's broadcasting rules is
it pych doesn't like you do
that I have to have just gotten a shape
wrong
[Music]
right yeah
[Music]
all right so where's my wrong
shape what
all right where is that tensor coming
from where's that 64 coming
from I broke keep di right it's probably
got to be oh yeah I got to pass keep him
into mean as well mean has keep
him we should just support
[Music]
uh support VAR
mean in tiny
gra oh this is a great
exercise cuz this is like yeah see see
you pass in keep di there and I didn't
pass in keep di there oh yeah we need to
get these functions into tiny grad oh
I'm so happy we're doing this great
that's fixed
okay in place relu
Max pool 2D with
indices can I decompose
[Music]
that you
cannot or does it just not register the
decom
there isn't a decomposition for that no
there isn't a decomposition for that
okay there isn't a decomposition then
what can I say GNA have to write Max
pool 2D with
indices put up there with convolution
where's convolution
um same torch function all right input
Max pool Funk 2D options oh
great is it like this
[Music]
no it's not like
that I'll Max pool 2D with indices oh
because it Returns the indices does tiny
grad support this I'm not sure it
does no it doesn't great
so you know this is scene in
uh my favorite Star Trek Voyager
episodes Futures End where Henry
Starling is trying to jam the teleporter
using his thing and he's said it's
supposed to jam your ship's teleporter
it doesn't work he's like it works
perfectly you just don't know how to use
it and that's how I feel about this
decompositions maybe it works perfectly
and I don't know how to use it or maybe
it just
doesn't H
okay all right good
progress torch backend
[Music]
progress we
uh
progress
functions let's see if like something
like this works
definitely have like test Max PO on
there right so this is Tiny grads test
Ops Max pool 2 simple
yeah I don't know about
this object of type non type is not an
instance of
sequence
what I even know
oh what an interesting
error uh
oh I see no no no this is fine it's just
because I I broke that
um because I added half ass Max pool
somewhere right yeah here so print
options but it's not options
yeah so we don't have
this impation
somewhere
okay
uh if yourself
kernel
size stri
pading oh wait this is cool that it uh
like right here it shows the we should
be able to like Auto parse this
stuff or torch probably already does
this for me seal mode equals
false uh we want self
dot self
tensor X pool to the kernel side
stride dial are arguments in a different
order from P
torches
panning seal
mode we can try that but I don't think
that's going to
work tensor has no object Max pull two d
what oh I have to
unwrap to wrap
this stride dilation Mis
match
oh well that shouldn't be that
St To
None there's
another expected a proper tensor but got
nothing for indices okay we need indices
too how do we get that what what is the
return of
[Music]
that tiny
gr course doesn't even use this you're
telling me like it's probably actually
writing this crap out to Ram all the
time
uh
[Music]
return
indices the max indices along with the
output
what's the return of
this all
right each one
value
what I don't know what if I just do this
gra tensor do Zer like rat
yeah they're indices so I don't know
what type should they
be
[Music]
yeah oh Max pull with indices
backwards oh come on
decomposition no
wait
what why is it even what I don't do
anything
backwards oh that one does backwards
okay never mind yeah yeah yeah yeah now
it's going to work yeah forward only
that's right that's
right we don't have meeme
I'll be living in a big old city and all
you're ever GNA be is
me we do have mean we just don't have
mean.
outs now I can't really want mean.
out I still don't exactly understand
like what this dotout stuff means
mean.
dim
oh yeah wait it just
ran yeah
buddy all right this this will we're
going to make this work and then with
this we're going to wrap the stream
up okay so why did it only run two
things
that's not
good not good at all
what oh probably because yeah okay this
strided thing doesn't work uh I got to
fix
strided I don't understand like this
isn't why is it
zero okay we have to get to the bottom
of stride it why is that
zero like shouldn't that stride be
one if you don't want that to just be
the first
argument yeah torch squeeze shouldn't do
that okay we're not understanding what
stride means and as strided zero must
have some special value
stride of the output
tensor let's just try this
[Music]
yeah look at them look at those Colonels
look at them Colonels
boys look at that we got like
convolutions and shit
yeah all right I mean it's a lot of
kernels compared to the uh the tiny grad
implementation I don't know why it's so
many
kernels like this is the tiny grad
resent
18 um
yeah 61 versus 140 I don't really see
why that's doing
that looks like it's running everything
twice for some
reason with
variant like nothing should be realizing
it's scheduling 150 kernels okay cool
this would be cool if it actually
exposes some scheduler
bugs uh great
let's finish example here and let's load
a real image where's chicken we love
chicken chicken is one of my favorite
images in tiny
grad
um
preprocessed chicken image image equals
torch.
tensor that
work package
test is well a package
what package now
[Music]
understand python path equals dot did I
spell it wrong
I don't
know there going be some like torch shit
to test this let's keep it in let's keep
it in
torch torch Vision how do I get
a
um all right deep seek you can do it
[Music]
[Music]
so this is where we're going to leave it
and then we have two bounties
up uh no not deep seek.com we need labs.
reflex. all right
cool yeah
can you make it load an image of a
chicken instead of
random
and confirm model say
chicken good
llm you are good llm
what you're thinking way too much deep
[Music]
seek yeah that's good point 288 might
not be right that's right it's probably
wrong let's try
44 see if they look like
[Music]
probabilities well they all zeros or
even worse
nans oh I can't okay requires grad uh
how do I do with no grad oh that's why
everything's so
crazy CU we got to do with torch
nograd work
better works better all
right oh it's even less
kernels never mind I lied it's the same
kernels all right that looks good though
those look like probabilities out.
artmax okay that random was a
uh wow this thing loves talking
all right
what good llm you are good llm chicken
means
seven top K
[Music]
Wow pretty nice right
yeah let's make it look crappy like all
the other LM code on the internet
H where's the
chicken there's a chicken that lives in
tiny gr
actually is there I thought there
was there's no
chicken oh there's the chicken
uh pth lab
[Music]
[Music]
C is so long I hate when code is
long I need one more parent
there way to do like parent sub three or
something
whatever
okay
a yeah know I got you I got you bro I'd
be upset
too the tensor oh what are you kidding
deep seek you forgot one deep se's fired
can't believe I forgot
one you see what I forgot
right grock would never forget grock
remembers these even the right
numbers okay good these numbers exist
everywhere you literally how do you so
stupid that you forgot one or did I
delete it and I'm just insulting poor
poor
LM all right oh well
guys guys
obviously this isn't going to work we
don't have the slow com 2D
forward are you
kidding how did
this how does this even break I don't
even get
it is the D type
wrong float 32 what how was it different
when I had random
shape
wrong shape's probably
wrong yeah shape's
wrong is that
right guys we didn't Implement slow com
2D what a
Miss how do you still have that
commit this please let me
go well that doesn't need to slow com
how do you even know the difference
is a
device sure looks the same to me
it can't
no oh what why is that on
CPU how do you
what all right
whatever didn't respect the default
device all right we got a 622 that's not
good
so which of these many stupid kernels is
wrong
um or is it just like not loading
weights right
or is it not loading the image
right is it not loading the model right
that looks like a chicken right does it
look like a
chicken looks like a
chicken so which which uh which thing is
wrong which of these which of these many
beautiful functions is somehow
wrong test test Ops test Ops test
War
tiny one
seems right to
me that's
fine what's 622 what if that's already a
chicken
[Music]
a 622 yeah let's look it up oh that's a
lens
cap it's a funny category all right we
either want a cock or a hint uh you know
just just so you guys can see what we're
what we're dealing with here uh maybe
you guys should take a look at the
chicken all right so there's our chicken
just just just so we're all on the same
on the same page
here all
right so that's clearly not a lens cap I
would say in my in my expert judgment I
would say that's not a lens
cap uh all right so like what doesn't
work
war is
fine L me is
fine it's probably
fine hope it's not using scatter and
gather because those things are mad
broken batch Norm
ADM is it
dinner what do we
got it smells good oh is this the stew
it's Suki
do we're on stream you want to say hi to
the
stream hi got got a better camera
now it's Sukiyaki yeah
suak it's like slices of
beef you had this
before suyaki
Sukiyaki
Suki do you want to see a picture of a
chicken yeah let the chicken CU he is
yeah you know he he was here the other
day yeah I
know I'm a little
traumatized yeah you can see he still
got a hat on yeah the waddle the crust
on the waddle the program thinks that
he's a lens
cap oh he would make a bad lens cap I
agree yeah that would be
strange all right I'll leave you to it
is that you want it to be I was waiting
until I'll come down soon after I get
the chicken
okay all right so like you guys see any
bugs I wonder I'm going to find bugs
this yeah
[Music]
so like one of these many beautiful
functions has
bugs
copy if you copy
it's probably likely to have bugs this
just looks like a bug look at that looks
like a bug
right yeah I know yeah doesn't that
sound
fun I am to do
this um
I mean I'm going to guess it's like one
of
these as strid it being
wrong don't you
think it's got to be an as
strided okay does does anyone understand
like
what wait
what
oh I don't even understand how come like
the strides are stupid like that
they should all just be reshapes
right okay we clearly don't understand
as oh look at
this that's a prute
that's why it doesn't
[Music]
work I don't even I don't understand how
I'm supposed to know that though
like alsoa
what that's calling torches
reshape what if I do
that it's going to create an infinite
Loop
yeah so for that
[Music]
hi one quick
question um so here we can do a
unwrap um
463 any the other secretly permutes
okay let's see what a 463
is a bucket
all right so like
what how's that how is that supposed to
work as stri it clearly just doesn't do
what we think it
does but I don't see any these other
things being really
wrong they kind of can't be they're all
reshapes like they're all stupid
reshapes look like just ones and
shit offet
yeah
prute
order it's got to be
[Music]
right all right
so where could the other bug
be six bugs in
sorry why are they not just using
views because I'm just passing that
through to like normal reshape here
there something I'm
missing are the weights not getting
loaded
correctly that's a real possibility
they look correct actually what's really
cool is torches calling all this random
crap but it's never actually
realized torch is so
wasteful oh that's a good
point yeah I could just call two CPU and
then call two
tiny
um my copy works now that's a smart idea
just like use torch's CPU wow torch
could do all this really cool
stuff
uh I don't know like what if I okay what
if I write
this that's work
let's just continue to hopelessly stare
at it and then hope I see something
why isn't that doing a
reshape why does it have stride
zero interesting look at this it's oh
it's followed by The View there because
that's actually the cuz I'm not doing
the reshape in uh I'm doing the
reshaping like
torch
H I mean I guess like that could be the
problem
so what if I yeah okay so what if I just
literally write that
one uh
[Music]
tensor
CPU do as
stried size oh this isn't going to work
actually that whole approach might not
really work because
okay well now we got an
899 the problem is it's not tracking the
internal uh shape
correctly like it's making
assumptions you really can't use as
strided
what's calling
ased luk torch is making these
assumptions about how your memory Works
which aren't really correct
[Music]
all right from torch
squeeze in Native batch Norm
helper is there not an A10 squeeze I can
use that one's kind of crazy I mean
squeeze is really just a reshape
right when is squeeze not a reshape
all right let's look at torch. squ
s see A10
[Music]
squeeze I wish it wouldn't do that Str
mean I
could no it's it's good that it's using
okay what's going on
here that that can't possibly mean
that
oh
okay this thing has strides
I thought opaque tensor implication
didn't have
strides is non overlapping and
dense what does that mean
custom
strides yeah so like this shouldn't
work is that used for
uh let's take a look at the
tensor why doesn't ABS
work oh because it used to be out maybe
just work
okay what is it loing
[Music]
forever oh it's looking forever because
that actually calls us strided okay
whatever uh
CPU you have to detach before you can go
to
numpy wait like that looks like a real
thing but how could the stride be zero
okay maybe I just don't understand
something about custom
strides if length of size is one and
stride Sub 0 equals
0 uh this
is
squeeze uh so we just do tensor do
reshape size
[Music]
okay that can't ever be wrong right uh
and storage offset is none and stride is
zero uh and
prod oh and tenser
Dot size equals what size is not size
and torch means something
different this is also not a tensor it's
a torch tensor
uh tensor
[Music]
numl
okay this is a different one this one
has two ones in it so what's calling it
this is UNS
squeeze unque squeeze has
ones this is
baffling why does squeeze use as
strided stride zero means there's zero
bytes between each element exactly but
that just means it's
repeated right like it's not
like it should be stride one this stride
actually makes
sense okay let's just let's just go
nuclear on this shit let's say
if uh X for X intenser Out size if x not
equal to
[Music]
one uh side
shape equals equals toal
size uh X for x and size if x notal to
one
okay now we have this
one from the end of one element to the
beginning of the next element
[Music]
okay now we're getting 4
63s which is not the lens
cap it's a
bucket so does that do the same thing if
I do that
no because that's actually wrong the
tiny gr one is more correct I
[Music]
believe I mean this could also not be a
permute this could also be a reshape but
I don't think that's right
this doesn't change anything does it
[Music]
[Music]
well no
I I I don't think so actually
[Music]
okay we
can yeah okay we can try the
wrapper yeah I guess we kind of want
that fallback thing to work
it's not again it's it's really not as
easy as you think because you have to go
in and you have to like convert each
tensor right it's not just like all the
tensors um actually before we go crazy
let's just try something stupid could my
example just be wrong
before we go crazy let's just do
[Music]
that
oh uh yeah so about
that
uh yeah all right cool well sounds like
a good project for you because there's
actually nothing wrong with our shit um
it's just not something else is wrong
because it doesn't work on CPU either
uh yeah I mean no I agree the rapper is
a good
idea and you should get like the fall
back to work and it it should actually
like this stuff there should be a great
tutorial somewhere for like implementing
a
uh a back end in
torch um okay what's wrong with our
chicken
[Music]
this just this code doesn't work
oh is it flattening my chicken
no
I have my I have those transforms
somewhere this is so
annoying this kind of crap
all right did you figure out what's
wrong use weights instead of
pre-trained I don't think so but I'm
okay with
that it's kind of fine but it's still
broken
uh we have another we have a car as well
I believe let's see if the car
Works car is also
463 which is interesting and Lead lends
towards just this whole thing doesn't
work um let's just make sure we're not
importing the tiny gra
stuff okay same exact
bug uh
oh there you go yeah dumb
crap using the wrong just using the
wrong bash Norm
stupid stupid stupid stupid okay uh
device equals tiny let's see if it works
now
uh all right so now we just don't have
square root that's not a big
deal put it right next to our square
root so like most of that crap we didn't
even
need a
reciprocal oh is there a reduction for
that come on there's got to be reduction
for that
C of
crap there you go same
answering we forgot eval on our model
you know how many like bajillions of man
years have been wasted wow wait look at
how few kernels it
is is that more efficient
than the tiny Gra had
one sure looks like
it
beautiful that's
beautiful that's fast
too that's really
fast because it's not actually doing
anything awesome
[Music]
cock yeah all
right check it
out this is
easy okay
uh let's just let's understand the
strided shit because that's not actually
mergeable but otherwise I think
everything's
mergeable
[Music]
um probably mergeable but the stried
shit is too much of a
hack which is
faster uh that's is this is definitely a
later a later project but so it's it's
26 Mill I mean you'd have to use the
tiny jet
you have to Tiny jit to really compare
them but I'd be surprised if
uh it's fashion CPU obviously I know I
don't know that's probably not faster
than NPS NPS is
faster but now it's in tiny grad so you
can just use beam right that just works
which is going to beam and
torch I go P while beam
and then we have subak
we can leave it as d as as a as an
exercise to the
reader oh
[Music]
yeah now it takes 12
milliseconds what a deal
uh yeah actually I think we can leave
that as an exercise to the reader as
it's not wrong my as stri it like this
isn't wrong I just hand coded that one
case and somehow you're supposed to know
that that's
that why is that that how am I supposed
to know
that like how is that that that I don't
know
uh
don't yeah M that's
fine
uh where
backend so yeah we we'll leave ased as
an exercise to the
reader and we will add this to
CI we'll let nonsubscribers talk for a
little bit but if we have stupidity it's
going to be a quick end of the Stream
[Music]
[Music]
cool we don't actually need to print
that do we what's printing that
uh don't buy
AMD
it's unless you're willing to use tiny
grad or wait for this stuff the the
default stuff it's just bad and it
always will be bad
like they they're they're
misunderstanding what they need to fix
to make this stuff actually usable they
say they don't they say they get it but
like you know you can look at you can
look at their tweets and you can see if
that's the stuff you care about or you
know maybe making the driver
stable uh it's still
unstable uh if you use our
stuff if you use our pie torch back end
uh it will use our driver uh which is
stable and we have a complete driver for
the but it only works on the 7900 XTX or
the 7600 if you have an rdna 3 GPU and
you want to use the tiny grad stuff uh
you shouldn't at least have driver
crashes but really just buy buy any
video um why am I up so late early I
live in Hong
Kong and it is a bommy 8:22 p.m here
W look at that look at that it's
beautiful it's beautiful look at all
those reduced kernels by the way if you
guys haven't seen this should just work
okay so now this is from torch but this
is so good we should have done this way
sooner the torch guys on Twitter like
were suggesting it and they're so smart
to suggest it cuz like now you can just
use all of tiny grad's nice stuff with
torch as a front end so like these are
your kernel
uh this is what your graph looks like
and unfortunately that's going
to to
Brick no it's not look at this so these
are all the kernels uh that are running
in uh in that
yeah copying in all the weights doing
the prep for the batch
Norms
um and then like this is just like a
random reduce kernel so you can see like
all right we got a we got a multiply
well here we can go here you can see it
before that says multiply reduce this
looks like some batchnorm math all group
together reduce that throw the whamming
in there we definitely should have been
a pie torch back end earlier um and it's
great because like it turns out to be
almost all of the tensor stuff exactly
which is like where I want to get to
with Onyx and pytorch so I want to
maintain tiny grad going right from Onyx
and Tiny grad going right from pytorch
uh into tiny grad's tensor front end so
tensor is going to be this like super
set that that supports uh that supports
everything and I want to get all the
torch tests starting to work this is
this is unlocked something major for
tiny
grad uh yeah bend over for Jensen that's
right um
I'm glad you like
Amanda got to have chats
approval
uh all
right any other
questions wow and what we can do so like
these are the tensor things but we could
even figure out like which pie torch op
is creating each one of these this all
just
works
yo we'll see how far we can go with this
but I I have super high
hopes like this is going to instantly
make all pytorch code just work on Tiny
grad um just
by doing this and now you can use you
can use torch Vision you could use
everything um pytorch and this way we're
just not competing with pytorch I I
never really wanted to compete with
pytorch I am totally fine with pytorch's
front end existing forever uh like you
don't have to write in raw tiny rad you
can totally just use pytorch's front end
uh and use all of the existing pytorch
code uh use use P torches gradient
Library
um yeah I mean you you'll see you you'll
have to end up using tiny grad's
gradient library in order to Implement
some of these pie torch back end methods
oh this is going to work so
nicely all right thank you for watching
today's stream I appreciate most of you
to those of you who I don't
appreciate uh well you
know not everyone can be a
winner not everyone can be a winner
Quantum
Hardware uh
what a positive note to end the stream
on yo yo that's just being
real uh why don't we think of being a
back end for pie torch in the beginning
it's not like there there's almost no
extra work the thing about this pie
torch back end is like all it is is just
calling tensor is the highest level of
abstraction in tiny grad um and want to
keep it this way I don't want to start
like diving in where the P torch thing
is bypassing things I want the P torch
thing to continue to use all the tensor
methods and whenever we have a tensor
method like varine here like I don't
want these on liners I want tensor
dovine to work I want tensor to
replicate P torch's front end uh as much
as
possible um yeah no and it's great now
we also have tensor do gradient so it
should be really easy to implement this
gradient stuff oh this is going to work
so well uh all right uh you can
contribute
uh reset works you can contribute to the
torch front end the only reason that I'm
continuing to do
streams uh would NN helpers like com Tod
remain in tiny grad yeah probably but
that stuff was never great in the first
place I never really liked the NN stuff
in tiny grad it's it's like it's not big
so we'll keep it like it's only that big
so it's like kind of nice to have but I
I really like the idea of like torch
handling this layer as much as
possible um I don't know actually maybe
we will rip this out we haven't gotten
optimizers and stuff working yet so we
we'll see um how big is how big is
NN I mean NN like stay is good too and
's only 412 lines it's not that big of a
deal uh it's not much of chiny
grad uh zero.org oh is this like how
you're supposed to do versioning right
or something or am I about to get like
Rick
red uh
whoa that's
cool
um wait yeah I should be on here we got
we got more stars than a whole bunch of
these like how our open Pils got more
stars open pilot has 50 52 52.6 th000
Stars uh so open pilot Falls right
here and it is still on version
097 uh tiny grad is slightly less
popular than open
pilot
um oh you guys wouldn't believe what
comma Shares are selling for these days
ridiculous ridiculous everyone's
starting to figure out the whole world's
fake you know
uh everyone's starting to figure it
out C++ all right now we're we're we're
well in rant
territory um no it's yeah like py and
Tiny grad should pretty much be the same
thing and it should be the lightest
weight shim possible but this is an
incredible testing opportunity that this
has opened up to tiny red to we'll be
able to run all of torch every torch
test Suite that exists will work on the
tiny red back end and it's just
basically this there they're just the
tensor methods and whenever they're not
the tensor methods like random like we
should support random we should just
support tensor
random uh
yeah so very exciting stuff thank you
for watching today's stream never mind
you're all winners if you're watching my
stream you're a winner the losers are
out there not watching my stream that's
right bye bye there's the camera bye
oh I'm muted you didn't hear my good
morning good morning good morning we're
back to we're back to being muted at the
beginning of streams we're going to
close this door over here we have the
Jolly Roger behind
us uh today is a beautiful day and what
we need to do is focus on not being
triggered when the GPU crashes we need
to we need to be at peace with the GPU
crash we need to recognize that that
that that the GPU is bad but we also
need to not be upset
that the GPU is bad we need to make the
GPU better it wants to be
better
um I
think I had more interactions with AMD
and I I think they just like I I don't
think many times
I I get angry and I just stop
trying to legitimately
communicate right um but you know like
like the prophet Jay-Z said moral
victories are for minor league
coaches uh so that that's a great advice
to live by so we we are going to make
the AMD GPU better and now for the
people just uh for the people thinking
what about my tiny box what are you
going to ship we are going to ship in
Nvidia in the Tiny Box this is my
weekend hobby not my day job um we are
going to ship Nvidia because Nvidia is a
trusted proven
solution but in the interests of the
future because you know we all have a
shared future I think I think people
often forget this I think a lot of
people are thinking how can I get my
bags before the singularity happens
bro bro this is totally the wrong
mentality like this is is it you you
understand we're all in this boat
together and I'm not a communist like
I'm not saying this from a perspective
of of like oh you know if one person is
suffering everyone's suffering no I
don't believe in that kind of bullshit
what I'm saying is we are all in this
boat together one of two things is going
to happen in the future either humanity
is going to flourish and expand out into
the
universe or humanity is going to die die
right and we're all in that boat
together even if you're black or white
or democrat or republican or anything
except for a monkey or a dog you are
part of
humanity and we we need to really
recognize that especially with the
coming of AI because really you know if
if Humanity can't can't stand strong and
United the AI will exploit our
weaknesses and tear us apart
and this is not even like this is not an
exaggeration this is literally what's
going to happen um so so we need to all
work together for a greater
future uh and that's why we we need to
learn to not be upset when the GPU
crashes we need to realize that the GPU
wants to be better okay we need to give
the GPU the benefit of the doubt uh just
like you know look I I'm putting all the
pressure I possibly can to get AMD to
open Source this stuff and it's
not I I can't people think that I think
oh you know the Twitter thing man like
people think oh I I can fix it all
myself this is never what I said I think
that like and I I tried to explain this
I try to explain this my email back to
AMD I'm like
look you can't give me private access to
the firmware I I can't fix it I'm I'm
not a wizard right I think that if we
open source the firmware then we could
start a process proc going with a lot of
people who are very very smart who also
have vested interests in fixing this
driver right we have we have like I said
like there you know the whole the people
working in tiny gra you think they're
like full-time employees with IP
agreements what is this kind of crap man
like I'm not going to ask anyone to sign
anything weird like that like like let's
let's let's all work together on the
common boat of humanity to get the AMD
gpus not to be bad um I mean humanity is
going to die either way right like you
can't take anything too seriously the
heat death of the universe is real um
but yeah I mean like you know let's have
a good run like like like we got to
remember that like you know eventually
every boat gets torn down you know every
boat that's ever built will eventually
be dismantled and I wonder if the guys
building the boat think about that
day uh so yeah no I hope like I'm trying
to actually like explain this and not
just be a dick sometimes you know that's
kind of the like
like you know when when people engage
with me on a technical level I'm happy
to like give my absolute best when
people engage with me on like a business
level or like a they're get trolled
right and that's just how it is um so
what are we doing today so what what AMD
needs to do to improve their driver Yuri
salov our our 10 tier sub gifter you are
the new hero of the Stream Ice Leo is is
the biggest hero always with 56 gifting
subs and jish is also a a hero with with
10 Yuri solov do you have a question you
know if you're a big time sub gifter we
love to answer your
questions um so I'll I'll let's
let's let's write or read me here and
let's explain uh what what AMD basically
needs to do to make their driver stable
uh so the driver has this interface
called kfd um so you know what we're
going to explain things for noobs today
because we're in a noob explaining we're
we're we're here to we're here to bring
people up not mock people who don't know
shit um you know you have to do a
two-prong strategy of both fat shaming
and telling people that it's possible
that they could be beautiful in the
future uh so there's this thing called
kfd um KF D is the is the API for um for
gpus so let me let me Sim link this kfd
into
fuzzer I have the gener
oops who knows how to use LM wow the sky
is blue and it's
raining sunsh shower there's a word for
that uh if they open their drivers a lot
of people have interest in making them
better could chip in yeah exactly right
but it's not that like the driver itself
is open source it just turns out that
the driver isn't really where a lot of
the uh you know bugs
are um
so you have this layer called kfd and
kfd has has this
API uh let
me tiny Brad uh
I think I just added it to the main gen
script yeah generate kfd right so
there's this file called uh's Sim link
that guy in here
to this is file called kfdi
control uh and this is this is the API
for the uh AMD driver and one thing
that's awesome about it that's way
better than nvidia's is look how simple
it is right you saw us do the Nvidia one
if you watched the stream uh from Friday
night oxidized bites thank you for
gifting Subs
welcome
um welcome welcome
welcome uh remind me today we're gonna
we're going to try to raid Lana Lu at
the end of the stream uh I I was too
angry at the end of last streams I got
triggered by the GPU being bad um and we
need to just accept people for how they
are uh including gpus because gpus are
people
too so this is this is the API I love
how simple it is um so what we found
yesterday was a repeatable
crash uh so fuzz Dev kfd should never
ever crash
GPU okay uh make buzzer increasingly
more
sophisticated
until it doesn't crash GPU
okay never ever
not on a small
computer not on a big computer
not in a
car not in a bar
right you know you know you have you
know those things um how much of the
driver complexity is also to work with
Graphics uh yeah so a lot of the driver
complexity is to work with
Graphics um kfd might only be the
compute
API uh this API might actually not even
be for um for graphics I don't think it
is I don't really know how Graphics work
I think there's like lots of other
stacks for that I I don't I I know a lot
about GPU compute I know very little
comparatively about GPU Graphics there
is the other there's the Dr
thing
um so yeah we have we have drri
uh yeah my I have two the two gpus I
have on this computer are one Nvidia one
AMD um so we only really care about
making the compute stuff
good
so I think the first thing we need to do
is figure out how when we trigger that
crash to uh re successfully reset the
GPU um let's go nice and slow with this
let's run
driver and actually we also have we have
great debugging stuff here this this so
we can enable this that's going to give
us lots of crap up wait I didn't even
run
anything it already crashed I didn't
even do
any we are we are we are at peace we we
accept that the GPU is
shitty um but we are at peace okay okay
every time the GPU crashes one minute
meditation video all right
right close your eyes and we'll take a
few moments to calm your mind and
body soften your
face your
neck and
shoulders do your best to fully let
go and turn your attention to the
breath the calming
breath the soothing
breath take long slow
breath and
deep breathing
in I am
calm breathing
out I'm at
peace
hi I'm
Tam
okay
so let me explain if you it doesn't
matter if you're using Rock M or opencl
or anything you're
using um it might not even be using Dev
kfd but it is definitely using the same
underlying firmwares that are running on
the
GPU
uh so it's not like people are I I saw a
bunch of suggestions where people were
like uh why don't you just use Rock M
why don't you just use torch why don't
you just use hip why don't you just use
no the the problem is really deep so let
me let me like explain we're explaining
Noob stuff to people okay so you have
your
application uh you have your user space
driver
you have your kernel space
driver and you have your firmware and
then you have your Hardware okay so tiny
grad is now
here right so if you're using like P
torch it's up here right um well let's
even let's even go further you have your
application library and then you have
your application
right so so tiny grat has tiny grat is a
user space library but it's completely
buypass the user space driver
um so we at the what we're fuzzing is
here right this is where we
fuzz I like I sometime like forget that
a lot of these really basic things are
not uh like explained to
people like I I don't know how much I
don't know how much like like like AMD
Executives understand what I'm what I'm
saying um I don't know maybe they I
don't
know like it seems it seems weird that
like people like don't I don't know and
this is this is this is the magic this
is another like the magic of
Elon like I I think he does if he puts
any effort into it all uh understand you
know what's going on so yeah this is
where we need to fuzz um so de kfd is
exposed by the colonel space driver um
so the kernel space driver is open
source uh we can go in here and we can
bring up the kernel space driver here so
the kernel space driver is actually not
just open source it's a little bit
better than open source it's actually
upstreamed in the Linux kernel uh which
is
cool
so
let's let's try our crash but let's
comment out the W
Loop or let's just throw a break in
there now we don't want
to we can change this
whatever
I should proba copy it for the fuzzer
because I did promise that this was like
a I I I posted I posted this on Twitter
as like this is a
crash did I put anything in fuzzer yet
no so just put
ferp okay cool uh so we're in fuzzer
dopy
uh let me actually also we'll get to
that in a
minute right so we're opening kfd we're
opening the render we're opening that
let's run it without the wild Loop in
the
fuzzer and let's see if it
hits okay it looks like now it's just
hanging
entirely
um did we even try any IO controls okay
we say open de
kfd so we have a wait to write to R
issue so note that we're hanging
somewhere in the fuzzer right
now by the way if you're curious where
things of hanging we can always go into
Python and take a
look um so we can GB attach DB to
that I GB
attach um okay it looks like GDB can't
even
attach yeah we're probably actually
hanging in the kernel that
means so now
like okay okay okay we finally it
finally stopped oh okay it was frozen at
the is open so let me kill the process
exit
here and let's break this out
[Music]
open
uh
start open
kfd
render
[Music]
uh yeah the AMD driver is Upstream in
the Linux kernel but the problem is most
of the actual interesting work and where
all the bugs lie are in these uh these
firmware things yeah like
like there was a good there was a good
one and I I I linked it to them like
maybe this stuff starts to
like Cuda is still a giant moat for
NVIDIA
um yot Infamous for stealing other
people's work yes have you heard of the
OA loomas I went to loopa Lan my God
that
to U we're not getting triggered by
comments we're not getting triggered by
by everything by by anything no no
getting triggered today we just have to
accept that we live in a shitty world
and we're going to do our little part to
make the world a little
better
um yeah it's basically just people
complaining
about you you can read this and
like I like this
one the problems you generally
experience are inexplicably poor
performance poor and sometimes incorrect
documentation difficulties debugging
crashes and
hangs um so what's funny about this is
this is all their user space problems
not the these these two are the ones
that we need open source firmware and
open source debugging tools to
address
um yeah I mean maybe they're only really
capable of thinking about it in terms of
money and like maybe it's just hard for
them to believe that there's actually a
whole group of people out there who will
just make things good because they
can
okay so we're in some state it opens K
oh here we go okay okay so it recovered
that
time so we're back and we can run and it
creates the
queue okay now let's add the wild Lo
back oh but that time it didn't even
open right that time just trying to open
dry
render caused the
crash so it's in some bad state where
just opening render causes the
crash all right you often get
this so let's see what it's doing here
um so I also one of the things that that
that I said in my email was that I felt
kind of duped by like you know look they
did say they were going to open source
the mees but these bugs are not in the
mees this is like a it's like a it's
like a total kernel panic and they're
open sourcing like one small part of it
it seems like right now like the entire
GPU is just in some state where
um you
know it's just it's just broken okay so
let's see
fail to write R oh I like that they look
a little different so we can figure out
okay weight R okay so we're
here we're in
failed
kiq
um in AMD GPU
vert I think there's also a way that we
can okay so like it eventually kind of
did
something you know what let's just try
let me add that Breakin and let me try
running it a bunch of times and seeing
if we can just crash it just by doing
this no but okay wait so first off oh no
I'm in
Crash this about copy
pasting here in fuzer let's add break
and let's see what happens okay So
eventually we get an IO control error on
create
Q let's just try running them one at a
time okay that worked
okay
this is also opening and closing the the
GPU so it's not like staying
[Music]
open
uh so we know what the SMU is here the
SMU is the system management
unit um so yeah it it boots things up
then here we go it uh sets like the
frequencies and stuff
was it closed correctly so I mean we
could add the calls to destroy the que
and deallocate the memory but you
shouldn't need to do that um so it it's
not the I think that another thing that
may be kind of like lost in like context
here
is and this is like to anybody who does
any sort of Kernel development there's
no bad actions that should be taken in
user space that can affect the kernel so
again to explain things in a very simple
way these systems are designed to be
multi-user I'm in user space right now
on an unprivileged account I'm not
running this with pseudo um these things
are available to anybody who's capable
of of of basically launching
applications uh so
yeah
the
like anyone who can run if you can run a
basic application that uses opencl uh
the sound is raining now uh you you are
accessing these things so there's no bad
action ever in user
space
no bad
action uh in user space should affect
other
users okay
so this is this is the like if I have
two users I'm sshed into this computer
as Kafka and you're sshed into this
computer as as
uh uh you can be n you're ssh in is n
I'm ssh in is Kafka Kafka shouldn't be
able to fuck with NI they they should be
completely separate and isolated the
colel is supposed to ensure that they
behave the same way
so it doesn't matter that I'm not
calling destroy Q when I destroy the
process it should properly free all the
resources okay so notice how sometimes
it takes a long time here but if we add
a watch to like rock
msmi if I add a watch on this it keeps
the GPU what if I add a watch on this it
like keeps the GPU open and
available so let's see if we run it now
what happens okay so that's notice how
much faster that is that's at 10 and 64
Ms instead of a th000 Ms because we
don't have to do the full power on okay
and we hit the crash that
time
so it seems to start with a page
fault um so one of the things that we
need to do before we can consider
uh is there any way to get info from the
firmware yeah I mean that's what we're
going to have to look into right so part
of the problem is even if we find a
crash uh they release no information on
the firmware so you can't
disambiguate uh what crashes but so okay
this is GPU reset succeeded let's try it
again and see what happens is watch
still hitting on
that I think that might have Frozen No
no maybe that's okay okay let's run it
again okay now see this is a different
failure no actually maybe that's the
same maybe that's
identical um it's a little bit different
you see how here it says the the Q
creation fail so it's just overall in
some very flaky state right now you see
this is why these things are really hard
to debug so you know when you pay
attention to detail look here how you
got a page fault after the Q creation
and then you got an
Mees over
here uh it doesn't even maybe Q creation
didn't even happen or I don't even see
that stuff about the ring buffer
addresses right so we can we can take
these
two um we can take these two message
logs and we can put them uh put them
next to each other so probably as our
fuzzer gets more sophisticated what we
would want to do is
um is
uh like automatically capture D message
store it and try to triage these as
separate issues but okay let's see if we
can find any information about like what
firmwares are running so these firmwares
are running on some kind of uh micro
processors in inside the GPU it would be
great if we could get like PC or
anything about their running
statistics so let's take a look in colel
debug and see what we can
find
um tracing events aren't going to help
us but these things
might so I don't know what like AMD GPU
error sdma does I'll show you there that
it's just W do I have logic probes on my
GPU no we're we're not anywhere near
that
level um so let's take a look at this
ring and like can I can I okay look I
can look at this ring so that cat just
works uh but this isn't really what I
want oh oh gfx
off
okay
I
status cap
that I remember when we looked at regs
it gave all those issues with
uh okay good to know that the name that
the sizes are not
actually okay reg's SMC okay this is
interesting so what's the SMC do I have
that one it's not the SMU what's an
SMC do I have that
acronym we can probably look this up in
the driver
here read from an SMC right
system management control I mean you're
just guessing bro
like
uh what's an
mqd oh a memory Q descriptor okay so
memory Q descriptor of the mees PM
info
power
manager interesting so why is this
drawing so much why why oh look at this
okay so you see that my GPU is at
100% but when I Els off
kfd yeah there's nobody connected to it
uh what's the other one let's take a
look at that too so yeah this this seems
like when it gets into the bad State uh
we can detect the bad
state
with you are so
boring well yeah I mean this is this is
what actual work looks like you know
when you're when you're standing like an
idiot looking on the Whiteboard
like um but we we're we're we're being
we're being
educational right if we want things to
get better we have to put our
triggered yeah his name is boosting my
adrenaline that's true we we we have to
not be triggered by the GPU crashing we
just have to accept the G GPU suck um
okay so I'll notice that the GPU is at
100% right now let's see if we can reset
it and get this out of 100% um so the
first thing we'll
try is just removing the module and
putting the module back in so we we got
all this stuff working from
before um and it's cool that you can
actually do this well actually let's go
one step at a time let's first remove
the
module okay so when we remove the module
we got a crack
um which you can't always expect models
to be removed
[Music]
cleanly but I think when the GPU is in
the bad State okay so now notice how
there's no uh there's
nothing there let's see if we can
reinstall the
module oh something's spinning at
100% probably okay okay
now
okay now we're getting a kernel
bug oh and now we've panicked the whole
machine okay
so uh have I thought of signing ndas and
working for Radeon why would I do that
what what they're going to pay me an AMD
salary like I'm not
interested uh I I I think that like
honestly again this is not about what I
can do right I I'm I'm a somewhat
capable person but am I capable of
fixing all of the bugs in amd's driver
especially across all of the gpus no way
in
hell like it's going to
require
uh thought I was done with AMD no tiny
corp's done with
AMD tiny Corp is switching to
Nvidia um I'm not done with AMD I
unfortunately am an addict and a
masochist and that's why I continue to
work on
this all right so let's see if the
computer's going to come
back
um it would require a Jim Keller level
reorg well not necessarily right yeah
that's what I mean like I'm not capable
of fixing and I don't know anything
about how to fix problems inside of an
organization I know how to fix drivers
and make them good I know the
processes that will end up yielding a
good
driver
um can I increase audio
gain well it's quite low cuz I'm not
yelling okay we're we're trying to be a
reasonable person
today reasonable person I'll move the
microphone a little
closer but now I can't see the chat as
well okay uh it's a bit hard to hear
okay let's let's see what we can do I
don't how this new
mic gain gain gain gain gain that better
there we go now we're hitting the
yellow uh um they don't need better
Engineers what they need is better
middle
management I'm not sure what they need
again I'm not a I'm not a company fixer
I'm a code fixer I know I know how to
fix I know
what what uh yeah just hang on till they
crashes a few more times I'm sure the
audio game will be fine okay so it looks
like the computer broke in such a way um
that you have to actually hard reset the
computer so when you do a soft reset of
the computer which is what happens after
a colonel panic
uh it doesn't always reset the GPU fully
so it seems like the GPU is in a really
bad
state so we going to have to go here
flip the power switch off for the
computer wait 10
seconds and then we can turn it back
on
uh we forgot the minute meditation we
don't have to do it every time only if
we get
triggered uh well if this stuff happens
in a data center so this is a consumer
Grade box um the advantage the the Tiny
Box is a server grid box so it has a BMC
um meaning that you have an outof band
way to reset it you saw me reset tiny 19
a tin 13 using that outof Band Method
yesterday um so you can do this you can
do that exact same thing I just did from
a BMC
but it's a consumer Grade box so the
only way to do it is to flip the
switch um so it I mean it's less of a
big deal in the data center it's just
you can do it you can do it remotely in
a data center they put the they put
basically the switch on a
remote but yeah I I don't know what they
need and I can't fix their
organization um what I can fix is the
driver
Jim Keller seems uniquely capable of
fixing organizations at least to an
extent or at least working within
dysfunctional organizations like me I
would just get triggered by
it okay see okay okay the computer's
back okay now we have a very good
working
GPU
so let's reconnect now we reconnect
[Music]
here reload
[Music]
window okay
um so we go back in here to
fuzzer yeah we're not really fuzzing
anything but okay so let's let's do this
slowly a few times let's see if we can
trigger the issue so we run
that and it seems okay let's also put
our thing to do all the
printing try that
again seems okay try that again oh and
now okay on the third time it
crashed uh so we got through a GPU reset
but that doesn't
necessarily mean anything so on the
third time that it crashed we hit this
page fault
error
um what we probably want to do is start
documenting these crashes and seeing why
sometimes it behaves differently from
other times so like we have this
full uh print log here so it's let's see
after right pointer
address
there we go
so oh it
might
uh it might be after it enabled gfx
off GMC process interrupt 19 call back
suppressed okay do we know what the GMC
is do we have the
GMC
GMC
[Music]
CPU GMC process interrupt okay so we
don't know what the GMC is GMC maybe I
think that's probably worthwhile because
it's interesting that before the crash
happens you have a failure with the
GMC process interrupt I don't really
know what 19 callback oh 19 callback
suppressed probably just means that it
was in some state where it couldn't
trigger the
interrupt
um yes we're doing unpaid QA I I think
that they they don't believe that anyone
will do this for free many people will
and it would be much nicer if we had
documentation
um graphic memory controller do you have
a do you have a CIT citation
needed though I do generally believe
you okay graphic memory controller cool
you're
right
um so it looks like it gets into some
state but that's pretty fast
okay so now we have a page
fault at zero like it's trying to read
from
zero uh I mean my doorbell pointer is
zero so it might be the doorbell pointer
but but
again
uh my my point is no matter what I do in
user space I should never be able to
crash the GPU and AMD seems very fuzzy
on this principle you you cannot develop
a good driver unless you completely
Embrace that principle nothing user
space ever does should be able to crash
the
system
um okay so now we get
[Music]
to uh Mees failed to respond to message
three so what what I didn't again why I
duped and he did tell me and did give me
a long timeline for when they were going
to open source the
mees but what I didn't understand until
I actually started looking at this
driver was this is not the problem this
is a symptom ice Leo welcome thank you
for gifting subs
today
um so what this basically means is the
whole GPU is
fucked so let's let's see if we're
seeing the
behavior where um you know what I just
saw
that let's put this in usual
local so then I can just type rocket
[Music]
SMI okay unfortunately now I see nothing
when I do rocket m I we should have S
traced
it no rdna okay so cdna is a spin-off
all right so now we're back to this
failed to write reg thing so it seems
like even though it thinks it reset the
GPU it didn't actually reset the
GPU um unfortunately I think we're back
into that same bad state where if I
remove the module
it's not going to help us okay this did
eventually boot up again after it failed
to write
regs
um okay so it eventually went and notice
how it does doesn't say they
the okay we're not in the place where
it's saying 100% so it might actually be
in more of an okay State than it was
before let's take a
look so we can try an RM mod and a and
an ins mod
again so let's remove the module and see
if we get a crash uh see we got a crash
so so this is this is annoying because
like now the whole Kernel's kind of in a
bad
State um which again removing a module
doesn't actually have to be a supported
operation right um and here's how we can
distinguish what should never crash the
kernel for what it's kind of okay to
like not okay it's not great but if I'm
using pseudo and I crash the kernel it's
a lot more acceptable than if I crash
the kernel without using
Puda um so this isn't actually a kernel
crash this is a GPU crash
uh so what happens if one reloads the
firmware uh so it is reloading the
firmware I believe every
time um the problem is here if I reload
the
module
oh okay it looked like even though it
crashed it managed to reload the module
and it seems fixed that time so even
though it hit this
crash
in DRM mm
takedown okay so it does look like the
GMC gets into a bad
State okay so let's try this
again rock msmi at least seems reliable
let's quickly ask Trace Rock msmi and
see what it's
doing
so it's reading
these CIS class DRM oh this is also
another place we can look for
stuff
um this isn't in the kernel debug is
this stuff accessible to User it's
readable by user it's writable by
root um
oh that's cool wow I can actually look
at all the AER errors there oh that's
amazing let's check out tiny 10 and see
if there's any AER errors on
it why doesn't that one have a
RS okay this is probably a different
version of the driver so the driver that
I'm using here is actually the driver in
Upstream ubuntu's uh you missed 10 10
Torance SMI yeah how nice was 10 Tori am
I
right
um so again what I'm looking at
here we can look in firmware
version but yeah this is just this isn't
really showing me
anything
okay all right let's run this and see
what we get
so one
run seems okay oh I'll also note that
after I reinstall the uh the
module I have to redo that so let's try
one
run okay another
run okay a third run causes the crash
okay so it actually looks like it's
repeatable on the third run that this
causes the
crash
um let's see how we can recover from
this crash now so do we have any
indication that we're in a bad
State uh let's run Rock
MMI okay so I think now when I run Rock
msmi we get into this bad State again
where even though it thinks it reset the
GPU it didn't actually because it's
going to hang and then eventually give
that register right
failure
so uh what AMD should release Again part
of what's very frustrating is that they
are not I understand look I was mostly
like baiting when I said open source all
your firmware by the end of the week
that that's obviously like a completely
unrealistic uh thing for them to do but
it's hopefully the start of a place
start of a
negotiation um there's definitely things
they can release documentation on this
GPU
that would help debugging
issues um if they're not willing to
release anything they've released
nothing uh they they just show that they
don't care and yeah I mean if they don't
care it's not going to get better right
they have to care and Lisa Sue's words
that she car and the team is all in
don't mean anything to me because that's
a free action you should judge somebody
by the cost of their
actions if if they were to actually you
know yeah
okay fail to write reg this wreck what
is this
wreck um one can disable the mees I've
actually tried that it doesn't seem to
do anything for gfx 11 that flag just
seems to do nothing uh it might work for
gfx 10 which I think was the one where
they introduced the mees but I think on
11 it's
required I'm not totally sure about that
but I did try the flag and nothing at
all changed it's also it's not the mees
causing this issue I'm looking at this
issue now and it seems to be much more
related to so probably my guess is
what's happening is that one of the GPU
hidden uh
firmware is uh page
in right like something is being passed
in so probably there's other levels we
can fuzz at too so right now we're
fuzzing at the kfd L we're not even
fuzzing right this isn't fuzzing I have
a repeatable crash I can just run this
program three times uh and it hits right
again yesterday I was very angry so I
was just putting things in while loops
and other while Loops oh it crashes oh
it crashes but it's interesting that you
run it three times and if you only only
run it three times it's still in this
somewhat recoverable state so it seems
okay right
now uh like you can tell because it says
GPU 0% so I think we're going to get the
exact same reproducible crash right now
we run it
once up well that time it only took once
okay I take it back um maybe it is a
raise
condition right the fact that like again
remember when it we had to run it three
times so you're always looking for
patterns like this and you kind of like
put all these patterns together together
and you're like oh I Now understand what
it is so it is interesting that now
every time I see this it's prefaced by
this page
fault um which is a GPU page fault let's
let's actually look at this so let's see
what we
are
um okay
so ring 40
vmid pass
ID
uh so it's clearly starting to it's it's
it's a null pointer
exception uh and this seems to be where
the problems start this stuff is just a
symptom it's not actually the root cause
of the
issue okay so let's see if we can repeat
the pattern if I run rocki it's going to
hang for a while it's eventually going
to spit something out about a register
but then the third time I run it it
seems okay
um we're also going to try after we get
the GPU back we're going to run a tiny
grad example on the
GPU and we're going to see if that
works and maybe it's just the way that
I'm using this or maybe the GPU is
actually totally in a bad State uh so no
it's not always exactly
three um let's also look at what this
error is and see what we can find out
like it would be great all right well
let's just look in the
kernel uh so we're in the gfx Hub but do
we know which gfx Hub we
have probably
110 see this is where this is where we
need
documentation right you have this
address block and that's great but what
actually is this
thing um more fault Walker error
permission
faults
fortunately there's a lot of them here
which which one is actually the one
causing the
issue
um let's look for
this okay so it's one of these gfx hubs
do we know which gfx Hub is
running
no we don't how do I like figure out
which one it
is oh look at this high quality Cy
pasted
code
um vcn firmware
log uh so the vcn is the uh video core
next I don't think that's going to help
us because that's not where the crashes
are um so we do have some documentation
on that here uh this is the video core
next it's the encoder decoder um so I
don't think it's related to this it
looks like it's related to memory by the
way where is the GMC I mean the GMC
might actually not have any uh have any
firmware uh what's the gfx
Hub see if we can find documentation on
that
constant GPU
crashes in Arch
Linux uh late last week one night I came
home and fell both my
screens no he you see he added something
and it seemed stable but then on Monday
morning the crash is returned it's an
AMD GPU
driver
yeah there's just so many issues and
unfortunately a lot of
them here's another issue from
me and someone quoting Lisa Sue again
and absolutely nothing has
changed we might need to meditate again
we might need to we might need to
meditate again um okay well so
apparently the only thing the gfx Hub
does is
Crash everyone battle Harden to the
world of Vulcan and direct X12 know that
debugging is ridiculously hard once we
enter the domain of crashes and hangs no
one wants to do it and seeing a random
GMU GPU crash show up is enough to want
to crit Graphics programming and take up
farming on a mode
[Laughter]
Island that's how I
feel
um
oh okay this is
interesting what's a UMR wave dump I
don't think this is actually going to uh
going to help us with this issue but
it's interesting that this does exist
and this might get us
into user mode register
debugger for AMD GPU
Hardware
interesting how do I not know about this
very cool let's try it
um is it written by
AMD WR by AMD
okay it's even for 2024 yeah yeah that's
nice okay uh
uh well I hope that it works on let's
just search the word
Navi Navi 10 come on Navi 31 nothing on
Navi
31 it might be
okay let's figure out how this thing is
working
anyway um
okay limited support for
driverless
debugging performance tracking it
supports Hardware from
oh I mean
that's tools open source and located
here we can use the mailing list so
you'll need PCI
access
it has a graphical front end
great
um what's PCI access is a
library I know about this
cool I mean it makes sense there there's
a lot of way to like access PCI so uh
okay built UMR let's install this we
probably going to need to
out
okay uh that's
fine unknown
Asic should be added to PCI D to get
proper
name is that the like when I lpci it is
that the like
ID do these things have IDs like gear
like USB
um let see what options we got
here let's like try print V bios
information it seems relatively
inoffensive and we'll see if it works
okay cool wow this this tool looks
pretty nice actually that seems like
something
anyway also
top wow
uh oh I said let's try a let's try a
chiny gr
thing I like
this let's try all
whoa option first than anything that
creates an Asic model
so are all the registers documented in
here
somewhere I mean that'd be really cool
like maybe there are register
documentations and we just don't know
about
them
oh look at this
stuff database
IP
is this up to date I think this is the
interesting one
yeah
okay UMR is very exciting once we calm
down and stopped being
angry we can we can find things so this
is this is cool what's in
here
it's janky
but that looks like all the
registers now some documentation would
be
nice I bet you that they don't even know
this is open
source like you've already released all
your register Maps can I have
documentation for
them what that's actually really
awesome
um what is a sck 15 file yeah
unfortunately there's not a navi what's
an essay
SEC what file is
this Navi
um where's Navi
31 I wish there was Navi
let's take a look at the
commits packet
decoders you know I don't know like the
the the real the real way to uh approach
these kind of things is not to like I
mean it's just it's just like you're
you're just engaging with clown shit on
Twitter
um you know I'm sure if I reached out to
these
people but also do we really need their
help we should just read the code I mean
this is what I always
say don't don't waste your time engaging
with like companies just engage with the
uh with the
products okay Source lib read Mees
stream this is
interesting how do I trigger
that let's play with more Flags
INR why do they why do they just okay
I'm getting I'm getting upset again why
do they respond with clown shit why
don't they respond with well George you
can actually hear you you can debug this
using
[Music]
this
um this R requires one
parameter G
sa
HTM
interesting what's RLC we should know
that
one uh run list
controller is a run lless like a dma
thing
this is another microcontroller in the
gfx compute engine it handles power
management related
functionality the name is a vestage of
old
Hardware
H GB is collection6 collection Hardware
blocks we refer to these as IPS each IP
encapsulates certain
functionality
the graphics memory controllers
dedicated IP on older pre Vega chips so
AMD chip
timeline oh AMD
GPU I should kind of know these by now
like I know all the Nvidia ones off the
top of my
head okay so Vega pre Vega okay good
good good so so yeah the the current
ones are Navi
3x
um about the gfx Hub you found some
stuff about it what do we
got just tell me what it
is um okay we have the following major
IPS uh since become
dedicated become somewhat decentralized
on Vega and newer chips they now have
dedicated every specific IP we still
treated as a single
component have the different IPS get the
stuff
okay on the
gpus we know about the PSP wow this is
pretty good documentation found this one
before
um
contains the CP microcontrollers me pfp
CE and
MEC I mean these these are the most
important things that we need to give
make open source why the hell is the
useful documentation so well hidden I
have no idea but it's actually pretty
incredible
that that one
file uh
IP
uh no where where'd it go they can't
take it away from me it's on my computer
um this
one this is so let's see if we can get
this to
dump uh PR CPC register data dump and I
be
package what this tools
amazing
now is there a way that we
can get like crash dumps
run that and
say
no
um
oh here we can list oh we can list
blocks all
right oh this is
sick how did no one tell me about
UMR when we stop being angry we start
finding our path to the
truth so can I dump the registers from
that
now that's
[Music]
lb list
RS pretty cool
guys
all
right so let's see if we can figure out
which one's
crashing uh so we're definitely selling
the green Tiny Box um I I only feel
comfortable selling the red Tiny Box I
think our our threshold for selling the
red Tiny Box is once we get it to the
point that we don't see any crashes in
our in our data
center
uh for a
week
uh
what what do you
want what are you want it about
we found
UMR oh it turns out all this
documentation just no one's capable of
telling me about
it I get that actually all the registers
of the GPU are actually
documented how
like
all
uh no we found a blog post from an angry
guy who was upset that his GPU kept
crashing and he posted about it he
started the blog post with if you keep
dealing with GPU crashes uh you just
want to move to an
island
yeah what do you
mean it's not how it works if he finds
tiny gra he's welcome to
help I'm sure he has other
though okay so it looks like that's not
actually reading the registers I think
that's just an
offset I mean what's interesting so look
at these Mees
registers oh Misa like Misa
man
what is
gp0 like let's I need documents on this
now uh so these are pretty clearly not
uh not the
values oh actually are those zeros the
values I don't think so what's up with
all the
zeros
uh to work after GBU hang I think it
will
be let's crash GPU
again okay we crash a
GPU UMR still works I mean UMR is still
going to work because UMR is actually
just like raw reading the registers over
PCI even though the colonel doesn't seem
to be able to oh no it's not reading
them no that's actually not reading any
registers never mind that's that's a
completely users based thing let's try
p no see if we actually try to do
anything never mind it can't wait
what okay maybe it can I don't
know
um yeah so that's just listing the
registers that's not
actually
wait can use o bits to list bit
Fields how does no one know about
this I mean some docks would be nice but
this is
great
let's reread this let's read more of
this blog post because this guy's great
okay UMR needs to do some pretty deep
kernel poking so permissions will be
required uh if you're on a multi GPU
system it's possible that GP won't be
giant at zero that's
fine oh we got to do some
crap rad V what's rad
V oh okay that's
that
this is so cool I can dump the
waves does Nvidia have this kind of
stuff
and that's just one IP block we can also
dump the registers for all these other
IP blocks too I gfx is the most
interesting
one but like here's the SMU let's see
what we
get we could write some stuff to like
compile this into a
decent are there docks there's no docks
though there's just
names still names are are so
good oh man everyone in your life when
you stop being angry good things will
come to you
so what we really want to
do is create a user space GPU
driver I mean this is probably enough
documentation to do it I may not need
anything
else so I have a theory that we don't we
could just bypass all the
firmwares I mean okay that's okay now
that's a little crazy that that that
that that's a little
crazy like we we need yeah I mean having
the firmwares to be able to recompile
would be ideal but the firmwares are
just reading and writing from these
registers
um
okay so what's CPC do we know what CPC
is has
registers no we might not have a CPC
there oh here we go we have a
CPC do we have
CPC oh well the faulty utci client ID
was CPC
[Music]
um
all RS are memory mapped I believe so I
mean it yeah it's just in
uh scan and print an IP block by
name oh yeah here's all the values all
right
cool
bro how fire is that
command
for
for
for
I wish there was an actual way to reset
the GPU using this that's like low
level it's it would be much less
annoying if like every time we could
reset it but it just interacts with a
kernel driver in to complex of a
way
write a value in HEX to a register so we
really can just write all the
registers can use options use color
color sounds nice I'd appreciate some
color how do I enable use color oh
option
two T's for
top high
frequency wait this is this is 10's
Toran tier now
why did they not release the good the
good gpus
SMI
now dump the blocks on the diff yeah we
can totally do
that uh
so that's probably smart
yeah okay so now we have the registers
reg's pre
crash okay now we crash the
GPU now let's see if we can get reg's
post
crash
this is kind of interesting here U code
address U code data we also probably
would just want to check like how many
of them just change even unrelated to
the crash and exclude
those
so yeah what we probably want to do is
write like a python version of this
that's that's actively monitoring for
register changes and then every time we
crash the GPU we can
uh we can
say
yeah
does this support o bits by the
way
oh doesn't work right
now we're in some bad
State we're in some state where I can't
read the registers now but it does come
out of the state just have to do a
little
bit
uh oh I should disable automatic GPU
hang recovery yeah how do I disable
that I I saw that it's in it's in like
sbug what' you
say later
sure I'm always interested in
later
why you want to go now I know you want
to go now
but Alex we just discovered a treasure
Trove of AMD documentation that not a
single person in N9 months of talking to
AMD was like bro the registers are
already open source it's called UMR stop
being a noob to be fair I was a noob I
didn't Google
enough it's not your fault really bad
now no it's my fault there's no
excuse there's no excuse are we going to
punish yourself I don't know by not
eating for the rest of the day sorry I
can't go to
Rubicon yeah I know I'll set it to zero
I understand
uh all
right okay we're back let's remove the
module we get a craft oh
no oh no
let's it in you
spy
that how's it in
use okay sorry we can't remove the
module now but I think can I just like
set GPU recovery isn't it
in I think it's a hot flag I can
set
for showering is the software any good
actually kind of
yeah I mean it's already zero is that
the same thing or is it something
different
that isn't it you can use it to reset
the GPU okay
fine uh well if we want this we have to
reboot is it worth it yeah it's probably
worth
it what's it in use SP also just this
give me like a tree right can
it
um
Alex wants to go get sandwiches with
Alex and get
sandwiches no that's not it you're
right
um all right we we'll we'll we'll reboot
for
this add a tomor mod parameters yeah I
can have modle parameters we can the mod
and put it back in after
reot I always forget what's in modle
parameters and things are
weird don't be naked on
stream want to go get
sandwiches
SU
why do they send me shit written by like
PMS you know why don't they say that
like well here's actually what the crash
was okay we back
uh let's create a new directory called
rumps
um oh shit I
this
okay so first things first let's disable
the
recovery oh do I say amdgpu do GPU
recovery I think it just say GPU
recovery equals zero
right that's how mod Pro works all
right
do say anything about
it
um okay so how to actually go about
this we dump the regs into reg dump
one R dump
two let's just take
three
so we can filter out the ones that
change all the time now it's going to
stay up let's hit the crash so let's go
into here it's not really a fuzzer but
we'll run it
once no crash run it twice okay we got
the crash that time ah GP recovery
disabled okay sweet so now we're in the
bad
State
uh what no why did
it why did it do
that
okay all right great let's write a
compare
Tool uh good equals right
down
one it's interesting that it eventually
comes
back wow it's actually just better with
GPU recovery
disabled GPU recovery is a
scam it was the auto reset that was uh
that was causing the problem all right I
agree we should just add it to module
parameters I add to module parameters
too I mean it was the resetting that was
actually causing the
jankiness I don't know how it comes back
now but this looks way more reliable
than that other
stuff all right for f in good uh open F
read that's
split
okay so we want to zip
[Music]
good a helper in tiny gra for this but
we
should all right let's go to Red o
compare.
High uh
okay um all SS equals
ss. all X for x and
SS um not all
exclude so we have the ones to exclude
uh or bad is actually only one so you
can say bad sub
zero
exclude for reg in reg X and uh if
x r should be
right okay oh let's also compare it to
the good one
oh we have we want to check if they're
different uh if reg G not equal to Reg
B
okay
less useful than I
[Music]
thought the only interesting M there is
this
one so if the IMU breaks we still don't
really know what the IMU
is
this one is a lot more
different we should probably take some
okay that time it didn't
recover
interesting it's so weird it recovers
better without GPU recovery enabled GPU
recovery looks like it's causing
problems you can't find any registers
for the mees no no they're definitely
registers for the
mees here these rig CP Mees registers
um I think it's actually because the mes
is part of the
CP yeah so the mes is part of the
CP um it's recovered now let me take
some more good dumps
so we can exclude more let's also just
see how many are we
[Music]
excluded
[Music]
what oh okay so these really are all
different then when I
crashes I mean whoa here look here's all
the MS ones here we go
the mees GPS are totally
different we have a GDs protection fault
here I guess the other crash I guess it
didn't really capture right on the
crash RLC IMU reset
Vector RLC reset
[Music]
Vector okay so it's hard to say exactly
what happened then um I mean I didn't
think this would be
easy so we also have there's that other
cool thing where we can print the uh the
bits
one of this
Peds for this oh
bits
cool
let's see what's happening here so that
bit is nine let's see what bit nine in
the context stat register
means no that just says which context
are Act okay that's not that
interesting Mac DC op
control invalidating the dcache okay
that's not that
interesting what's the meq
stat
pointers
mes doorbell
control
okay eight is being set so that's DSW
work CL damn there's so much complexity
here this is
cool oh this this just just knowing that
I have this makes me feel so much better
putting time into AMD
like sure I the thing about when you're
asking someone for documentation like
people frequently think that we have
like the secret documentation for open
pilot I promise you there's no secret
documentation for open pilot it's what a
couple guys know and like you know
asking for someone's time is a big
ask um but the main thing I was really
like the thing that I knew AMD could
give me
tomorrow was a register map and it
actually turns out the register map is
open source we just didn't look in the
right
place uh what's not the gc10 gc10 is
RDMA uh sorry rdna
2 there's an Asic that implements
the the firmware that AMD is talking
about is not arm or anything like that
it's just Asic bitstreams no no no it's
definitely not Asic bit streams it's
code um the code we can look at the
firmware like we can the firmwares are
all just here these are the
firmwares uh so there is a
microcontroller running in each one of
those things even they talk about it in
uh man when I was working on the PS3 I
had an internal Wiki where I documented
everything it's not this there was there
was another one that was
better
no not PS Dev Wiki I had an internal
Wiki I ran media Wiki on a
computer
um oh you're contributor to PS Dev
workie cool you know I'm not allowed to
uh I'm not even allowed to to to to
think think about this stuff anymore I'm
not sure allow to think about this stuff
anymore but you know now we we work for
the the the good
uh no I can't even go to PS Dev Wiki on
stream it's been it's been a long time
since I've thought about this stuff it's
been a long time since I've like like I
I just I love this stuff so much you sit
down with a new complex
system
um you just like dive into it you read
you learn so much stuff there's so much
to learn in doing
this uh this is this
is this is REM motivating me to work on
on Tiny Box
red
this is currently unused okay it's a
little out of date let's find the not
out of date one actually I should just
be able to look in my kernel I think
that's just in my kernel
right oh hey
Greg making an AMD GPU bug
debugger r a trap
Handler
interesting so this is running at the I
mean these are running on the rdna
uh this is running on the rdna chips
themselves like the so this
this again look we're being Noob
friendly on this stream
uh so I can show you what there's like a
diagram that kind of shows you what
these things
are
uh yeah so this is this is what you can
think of the this is this is like the
GPU
right um so these compute units are
running the
uh these compute units are are
containing the rdna processor but I'm
not trying to debug those I'm trying to
debug what's running in the
firmware um DCd
McD
unit
we there more interesting stuff in this
blog post
let's Force the wave to trap now time to
get the host host in the Trap hand
now
for
on the host we wait for the wave to be
caught in the weight Loop we use UMR to
stop the ring yeah I I mean so I'm sure
there's ways to
uh oh to stop the
ring
yeah
but but this is
amazing like we can we can abstract this
probably all pretty simply into
python we'll be able to detect
everything from
this
H we have to do the green Tiny Box I
mean this isn't this isn't a shippable
product yet but I I think I think now
we're going to do the red Tiny Box too I
think we're just going to do both this
is this is exciting and appeals to wait
we
are we we have
flipped this changes so
much this changes like
everything we we are we welcome welcome
to my bipolar Adventure we
are how did we fix
AMD
UMR okay there's this open- Source tool
called
UMR called the userspace register
debugger inside of UMR inside database
IP we have access to all the registers
in the
GPU the open source Ship by the end of
the week deadline was met it turned out
it was just always open
Source how do no want to say
this do they
know I don't know this this just this
just makes
me this just makes me skeptical of like
companies they clearly didn't I don't
know if they didn't care it's just
weird like
why not just say
like like fuck off here's the open
source shit debug it
yourself I don't think they did
understand what I
wanted I wanted documentation on the GPU
this is really good
documentation I mean it's not
okay did AMD open source it not
yesterday this has been open source the
whole time I just didn't know about it
I no it has to when is that blog post
from
right this was a blog post put out in
last in last uh August so it's
definitely been open source since
then okay all right yeah it's just it's
a lot better than what we had yesterday
it's not really good I
agree um but
like it it's it gives a whole new level
of feasibility to doing
this while like documentation on what
the grbm W buff busy is they may not
have documentation but this they always
had it was made public about 2 years
ago why was this
just
you read it in the docs folder oh in
this docs
folder the actual process look I I mean
I
mean yeah that's
like I knew this existed I'm not sure
that any documentation Beyond this
exists so I'm not trying to ask like I
don't like to like ask others to you
know like like have to put in
effort why
why it's just so confusing to
me 20
17 right I should just sat down and read
the mailing
list Tom Dennis is our
hero
apparently a software developer for an
open- Source Graphics group at
[Music]
AMD of dysfunction
man
no they open source a lot of stuff right
like they they they open source their
their GPU driver but I thought it was
much more like we open source the GPU
driver and like we open source it in
such a way that you are absolutely
hopeless to fix any
issues no it looked like it was 2017
that's like seven years ago
now
well what we can do with this is write a
fuzzer and disambiguate issues
now and learn everything about gpus
along the
way
what's more amazing is that the repo is
up to date I I
know
no I don't think they're going like if
they delete it if if they delete it
that's really just the worst sign
they're not going to delete
it I bet it's actively used for Steam
Game Dev yeah probably but this is this
is all the register maps of the
GPU this is all I
wanted
I can only make use of Ip cleared
register definitions
whatever I mean it's not like there's
only five in here it seems like like all
of
them
not all RS I don't ask for all RS I
don't care about the uh I mean yeah you
don't see anything in here well that's
the that's the gfx so I mean we can see
which which IP blocks do they have that
aren't
released uh we don't see anything about
the PSP but yeah I don't care about that
one uh
gfx is released where's sdma I'm sure
sdma is released to here lsdm
600 I think that's
sdma L sdma is different yeah L sdma 6
those were the two I asked
for
Jesus mean it's better than nothing this
is this is
like wait this is literally everything
we
[Music]
need all
right I mean no no no no no okay
okay
oh the the uh no like it's not like this
is going to happen overnight this is a
star also I mean the firmware is not
open source which is annoying but not
insurmountable especially if the
firmware starts being open
sourced
I don't care I don't care about htcp I
don't care about platform security the
signing if you're letting me Peak and
poke any registers I want I'm sure the
signing is uh you
know all right all right you want to do
some injection
attacks sorry sorry not attacks we don't
attack our partners some injection pen
testing um
do you know how much I would love this
for the qualcom
chips
uh so wait hang on so we have let's
let's run
compare so I think I can can I poke that
register
you want to crash Ms let's crash the MS
let's see what
happens qualcom would never share
something that's
useful uh right let's ready to
register
so yeah I don't really know what happens
what if we what if we write to
[Music]
GP
uh let me put this in watch so we can
get the GPU there also there's a better
way to PR a gfx
off no why would they open sourced this
it's just it's just
dysfunctional I didn't steal this this
it's not like a leak or anything it's
it's open source by AMD
okay what's in mess
control I
mean I don't
know so here you want to Halt the mess
let's halt the
mess that one
is now we have no
mess now crash right away cuz no
mess oh no that's probably just
cuz put that
back okay look create type q0 fail five
okay read five because that's cuz we
halted the mess now let's unhal the mess
what was mess control and the good
dumps C let's
see
I would just active some of the
pipes that just means pipe zero and one
are
active Okay we still have error five
now okay so just writing not halt to the
mess doesn't UNH halt the mess
but I think we can try where's that GPU
recover
thing
oh is that writable no um but that's
cool
okay so let's consider something
now all right I think the most obvious
explanation is that they just didn't
understand what I was asking
for I think the second explanation is
that there's a hardware
bug that we're going to
find I think the third explanation
is it's probably the first
explanation no I wanted open source
firmware and I still do want open source
firmware but like
again I I don't
know all the registers are documented in
this UMR
thing while the firmware is closed
Source all the registers it reads it you
can observe Its Behavior by looking at
these registers
I mean look writing our own firmware is
a project well beyond
feasibility uh no I know it's most
likely incompetence I know I know um
writing our own firmware is is is well
beyond uh yeah what we can
think but we can at least find out where
these bugs
are I I still want the firmware open
source let's let's not get too excited
if but but the firmware doesn't need to
be open sourced tomorrow if there's like
a plan over the next year to get the
firmware to be open source then like
we're in
lock uh
wait so that AMD GBU recover
oh it do
something that looks like the old crash
okay the 02 thing is
gone now now we're back to r
five well now I messed with the
mes but this is interesting so dqm
create Q
type
you
have I seen GPU open
tools
yeah wait are we going to walk to get
sandwich I hungry
George
deler
sandwich a St
sandwich I like walk sandwich I really
want to walk you want to walk the
sandwich oh you're yeah I know you want
you want let's ask them come we we you
want to come in to be on the stream and
like let's get them involved with us
does anyone want to get sandwich with us
get sandwiches we
know
what are they saying uh oh yeah I mean I
know there's user space debugging tools
but the problem with the user space
debugging tools is yeah they're they're
they're targeting the I mean these these
Pro bugs that we're hitting aren't in
Shader execution right we're not
executing any shaders when we spam
create q and
stuff
um yeah but what we need is a what we
need is a
fuzzer what we need is a fuzzer but now
we can reasonably write a fuzzer if we
have a way to recover from Bad States
and we have a way to read out
registers you guys it's an hour round
trip to the sandwiches and then me it's
20 minutes to eat the sandwiches how
many how many people are watching right
now we have we have
1,360 people watching yeah I'll leave
you here and I'll go get the
sandwiches George says sandwiches don't
taste as good can you guys tell him if
you want him to say that they taste
great when someone brings them to
you but it's so early for a sandwich
right now what are you talking about by
the time we get there it's going to be
almost 12:30 all right all right we're
GNA we're going to go we're going to go
get sandwiches um I did a lot of
streaming this weekend but look I don't
even know I don't even know what to what
to say about any of
this I think what we're going to do is
uh we're going to sell green tiny boxes
and red tiny boxes
um and put some warnings on the red tiny
boxes no AMD GPU blobs are most
certainly signed I mean well okay you
know what no no no no no I mean I want
to see a
path I understand why they can't just
click open source on the repo I didn't
understand why they couldn't just I
asked explicitly for register Maps
I couldn't understand why they couldn't
just
click uh open source on the register
Maps but apparently they
did uh but yeah I mean having this is
just so
much we have so much flexibility now to
actually fix these
problems
um yeah I didn't think that any of the
debuggers would
have no if I mean if there's a bug in
architecture yeah maybe it's fucked
um
but yeah I
I'm I'm just I'm just kind of
confused uh whatever whatever this was
open source the whole time we have
registers uh we
can we we can reasonably write a
fuzzer what what my ask is what my ask
is is a path to open sourcing the
firmware and like an understanding of
how crazy important writing a fuzzer at
your kernel layer
is right I I know I know let's
not no no no no no we're going to yeah
we want a timeline for the firmware to
be open sourced and we want I don't want
a private timeline I want a public
timeline for the firmware to open source
be open sourced which is pretty much the
last thing which is pretty much what I
asked for um but the open source RS are
a starting point like I literally said
in one of emails I'm like what do I do
when this thing crashes I have no way to
debug it why don't you just reply with
here's UMR you can dump all the
registers in the
GPU also I will point something out we
can say George you know you're dumb you
you should have looked around a lot more
but we had a thousand people watching
this stream how did no one else find
this how did no one else say George all
the reg how did no one on Twitter reply
with
this how did no one on Twitter reply
with yo all the registers are open
source this just makes me deeply
question the world how much how much is
just right in front of you and you can't
see you see uh Glass Onion Knives Out
you see that that that's kind of a movie
that's that's like like who knows what's
right in front of our
eyes um
because people use Twitter for shitting
on each other yeah I gota I gota really
I gota should I just delete my Twitter
account what if someone mentioned it but
I ignored it I don't think so I read
most of the Twitter things I mean I
don't think anyone
said
Alex are we are we can I say goodbye to
the stream that you're rushing me off
of go
back no I'm not going back today we're
going to eat sandwiches and I'm going to
go to work and do real
work subscriber mode blocked
idiots every time we turn subscriber
mode off we get we get the you're
exposed to the unwashed masses of
humanity who don't have
$5 I want yesterday but I didn't want to
pay5 to St exactly we're not exposed to
the unwashed
masses wow you know Alex with
$5 how much how much Bui can we buy
don't tell them about our secret plan to
take over Bui literally guys if if you
have like a couple hundred million
dollars a year you can own
Burundi um Twitter was good to pressure
AMD okay so AMD what we want is a is
a
uh okay now there's a lot of stuff that
isn't open source yet again I would love
it if someone could just send me an
email and point me to the repo is this
architecture documented
anywhere why are you stealing $10 you'll
find out
later what do you need $10 for you'll
find out later how often do you come in
here and steal my money only in front of
you you know about it you can have the
10 you stealing 20 now no just a one oh
all right I I think just wait are you
stealing $10 to sub to me on Twitch no
that is a good idea no I want to buy
some chips to eat
sandwiches why do you is there like
chips at that I like at the where are
you going to buy chips with dollar bills
you know Place we've never been where to
the to the convenience store across the
street from the sandwich place I didn't
even know there was a convenience store
across the street from the sandwich
place well kind of convenience store oh
you'll see what kind of crucial things
are publicly documented yo you think we
can find like wait all government stuff
there's so much it's all public you just
have to be willing to go through
it damn wow imagine when someone builds
a good search engine with
AI it's going to it's going to change
the world they're already using AI to
like read redacted documents it's
unbelievable this is this is this is
white pilling content for for Humanity I
was I was feeling bummed yesterday I was
feeling bummed I think kim.com tweeted
like it's over and like that's just how
I
felt we know it's
over no but maybe it's not over maybe
maybe AI like is there maybe there's
just some government document that says
like I tried to convince you of this a
few weeks ago you shit all over me you
don't think there's some government
document that just says here's how we
killed
Kennedy
the government document that says here's
how we did
9911 government document that you know
we can find Stanley KU did 911 but I
think we knew a lot more about it we can
find Stanley CG's contract for the moon
landing
yeah
um
20,000 years of this seven more to
go um
Hawaiian Oregan donor Nam McLovin all
right uh yeah we're done with we're done
with streams to the weekend but we're
adding things on positive note uh that
was
[Music]
loudr UMR it turned out the whole time
the registers were open source look this
still isn't really enough like I don't
know I don't
know open source firmware let's see some
open source firmware uh let's see a plan
to open source the
firmware um documentation around these
registers would of course be great but
this is enough to kind of make me feel
okay shipping the red Tiny Box as like
really a developer platform like you
really want to get into this stuff by
the red Tiny Box you want it to just
work pay the $10,000 invid
tax everyone's paying inid tax well if
you want it to just work but if you're a
masochist who loves pain you can buy the
red one for Arch Linux for Arch Linux
users it's the Arch Linux Edition Alex
knows about Arch
Linux is this the firmware no the
firmware is not open source but having
registers is so useful for actually
debugging
anything um this is like the bare
minimum yes this is the bare minimum to
make me want to not throw all these gpus
in a big eBay shaped trash
can but don't worry we bought the eBay
trash shaped trash can just in case we
did we did we did
[Music]
um yeah all right I'm going to I'm going
to keep up my advocacy efforts for
getting the firm ready to be open source
we're doing
advocacy with the capital A or lowercase
a you know like we could we could like
like imagine we started using like
leftist style advocacy tactics but
instead of advocating for diversity
inclusion we advocated for open
source I'm sorry hackers of the World
Unite maybe open source is
inclusion open source is inclusion you
heard it here first I mean Dei is just
you know Pro open source by its very
nature of being
inclusive uh that's well if only it was
actually it actually meant inclusive
like a normal person means
inclusive this caused a great
misunderstanding between Curtis and I
One Time ah the Department of Defense
what's what's up with the Department of
Defense I mean yeah remember that time
we defensed in in Iraq and defensed in
Afghanistan we do a lot of Defense we do
a lot of Defense yeah that's right
that's right we defensed against that
Iranian
guy um not if you demand greatness no
Dei no we we we we we Embrace Dei guys
and you know I'm a progressive right you
have to embrace Dei and you have to
embrace progressivism because you don't
want to be conservative you know this
because you know why conservatives
always lose but the thing is Dei can
mean absolutely anything you want right
like to to go against Dei you're against
the grain of History to be Pro Dei means
you're in favor of history and that's
why we should elect a dog to Congress
there's nothing more diverse Equitable
and inclusive than making
the first dog
Congressman what do you
think I think more people would vote for
a dog than you think I think the dog can
like you know 35 in dog years yeah dog
could be president that's right well do
you think they're going to like Dei the
dog Education Institute right that is
how we you know you really want to fight
against this stuff this is how you fight
it I'm just thinking about the logistics
of having a dog as a
representative I mean yeah I don't know
we'll have to we'll have to have a
committee to study how the dog do you
think we could put one of those like
brain wave readers on it and interpret
the dog's
thoughts I think that that's a bit
intrusive we're trying to treat the dog
a dog nuring s we're trying to treat the
dog the same as everyone else I mean
we'll have to Alex this isn't for us to
decide we need a committee and we need
funding for that committee should we get
a schedule a phone
call phone calls phone calls why do they
always want to do phone calls man you
called
anyone oh yeah let's get on the phone
and call
some we got to do a
meeting
really yeah don't be speciesist that's
right and we believe you know we believe
in progressivism you got to be
Progressive you can't be conservative
open source uh you know everything hack
the planet all that um I don't
know you know when you're when you're in
an abusive relationship you see one
tight tiny glimmer of hope and you think
that everything's going to be better but
you know and never that's a key feature
of I know of an abusive relationship I
know guys I'm in an abusive relationship
with
gpus that's just a dynamic you have
George
I
know yeah as a um do you want do you
want you they can't see you as def I I
look like the unibomber that's fine bro
they love the unibomber tell them I had
eye surgery so I have to wear sunglasses
inside chair well you
[Music]
can yeah that's a
problem a seat for me
[Laughter]
welcome to the George and Alex
show I put this on because it's
extremely windy outside yeah it was
windy last night when I walked the lazy
acors I'm sad I couldn't go it was a
great walk you want to tell them about
bendy no no no no they they well is that
not Sav for the stream no I mean we can
like we got to we got to we got to
approach apprach it in an inclusive way
we got to approach it in a in in in a
nice
way okay look how much should I get pay
today average person in bery makes
$180 $80 a year so
3,000
Bui uh what do they call them burundians
we'll call them Burundi pesos are us no
but you can't go off that like feels
like a 10 no I'm just saying
okay the like let's say like a softare
engineer in America makes
180k so you can have one American
softare engineer or a thousand
barians yeah 65% of their population is
under
20 yeah feel like a lot of child labor
whoa whoa whoa who who we we we respect
the Geneva
Convention um what is do Alex do that's
that's what they're asking what do I do
um all kinds of stuff Alex does all kind
whatever people need I'm a fixer Alex
made eggs yesterday they were good the
secret is butter respectfully one
question why wear shades and doors she
had ey surgery on Monday I had uh eye
implants they're called Evo ICL it's an
implanted colmer lens she can now see an
infrared it's that okay they do have UV
so that's that is a nice feature I per
sunglasses on well they have UV
protection yeah yeah does that matter
yeah UV is like bad for your eyes yeah
it is interesting okay okay okay well I
don't want to be spreading fake news is
that what they still call it we spread
lots of misinformation on this stream
okay it's a it's a wonder TCH hasn't us
yet probably fine for your eyes um but
they they just threw that in here I see
let's see is lolux streaming we'll raid
lolux and then we'll go
does anyone have any questions about
implantable lenses I'm now an advocate
no no not streaming do they have any
questions um oh oh alternative facts
that's what they're calling them now
alternative
facts oh should is Sky
Brion is she streaming right
now any you just cut a hole in your eye
it's very small and they give you a
no Sky Bri is offline we would raid Sky
Bri though but do you don't have any
other friends no should we should we
find a twitch channel to raid should we
find a twitch channel to raid I don't
know we can't vouch with their content
you know what I mean let's just look
real quick what are people what are
people even streaming these days
anything good in the Science and
Technology category I don't know
man all right Alex is very anti it's
forever the GL the eyes are forever they
tell
as I live they tell you it's forever
nothing's forever permanent impant have
you heard about the heat death of the
Universe I got my first implants have
you heard about the heat death of the
universe how sure are you about the heat
death of the
universe who you who you R nobody oh we
went we went black up in there I don't
know what happened a hot tub stream find
a good hot tub stream all right all
right we we looked uh you
looked yeah we looked we don't know
anyone on the stream right now
all right none of my twitch mutuals are
on the stream right
now assuming you could broaden your
horizons IEX this isn't a good time for
that okay okay we can broaden our
Horizons
offline would you want a stand up
comedian broadening their Horizons
online and making shit up no because
it'll be
bad even after heat death there will be
cosmic background radiation okay uh
radiation ISS forever yeah all right
look at look at look look Alex is
standing up because she's eager to go
get sandwich
is that true raid Bob Ross do they still
stream Bob Ross is that still
going today's plans is George aren't
going to work guys life is work R to
thirst all right uh yeah UMR who wow why
didn't we just like I don't what how do
we even interpret this how do we we need
to like bring things full circle we need
the denum
ma why didn't they just tell me that
this like like what I think it's an
important reminder that the internet is
a vast and large place just like the
actual physical world and sometimes it
can take a long time to find
something what did you open with like I
Googled multiple
times AMD GPU
registers I asked Claude what actually
shows up when you Google that how many
pages deep was the answer
Isa documentation developer
documentation these registers AMD GPU
driver AMD GPU driver amdgpu Hardware
Basics I forgot they're infinite
scroll Google is infinite scroll let's
make this a little
smaller
like make you click something like this
it's all about the registers that are
like do you think GitHub is down
right no I just think that it's not
searchable by this why
not like I tried a whole bunch of
different things that kind of looked
like
that
um tried like Navi
31 just get that Google is just so use
useless I think the lesson here is that
may it's I mean you get you get this
should we try Duck Duck Go I don't think
Dock dock go is going to be
better that's not even a
GPU people complaining about register
pressure I like am
Wikipedia far oh LinkedIn and Linkedin
important right like this is trash
search engines work GPU register
documentation yeah I think right and
then you like you go to like developer
documentation I've looked in here I've
looked at these GPU open docs I've
looked at their blogs I looked at that
radon profiler AMD didn't promote
anywhere link to gitlab is it res said
it was no yeah I mean I think this is
just a reminder that there's a lot of
stuff that's can't be seen on the
internet like a
eventually you have to search
forr but also like again even if I had
briefly saw something called UMR I
wouldn't have thought that all the
registers were just in
there I thought that the debuggers used
like do you were over reliant on search
engines for getting information dude I
bet there's like great shit on the
internet try perplexity all right let's
try
perplexity AMD GPU register
documentation Isa
is is their is no but see it's not the
ISA is their register docs for 7900
XTX W there register documentation can
be found in the official AMD Radeon XTX
graphic card quick setup
guide yeah no I think this is a bigger
issue about uh the Shadows of the
internet I'm pretty sure I did some
GitHub searches on this like this was
just not wow search engines just don't
work yeah I mean I think that's a really
big takeaway
here like a terrifying
takeaway
yeah especially if you consider like any
kind of ranking in Google being like
somewhat time based too like the old
internet's just not even accessible I
yeah I feel like this stuff used to be
way better I feel like it's just really
hard to find things
today time to bring back Hammer all
right that's a good one to that's a good
thing to leave on Hammer my search
engine
you know about Hammer I know about
Hammer are you sick of search engines
returning News ads and SEO spam when you
wanted information if this is you you
need a hammer the world needs a hammer
do you know what our mission is to
organize the world's information and
make it accessible to anyone who pays
Hammer $30 a month you know what our
motto is don't be evil and if we ever
remove this motto it's because we are
evil
now you got to you got you got to
understand the failures of your pet
assess wow um better search better
results Hammer oh but unfortunately
multiple people applied to work at
Hammer but we were only hiring for one
role and it was the founder of hammer oh
no so yeah they didn't really read
um wow I mean it this just like such a
bleak Discovery this going to be a Black
Rain coud for me all day I'm going to
think about this no just how
terrible
I mean when when we had that that legal
issue and I wanted to do more search
like I just couldn't find anything and I
was so
frustrated which with the taxes with the
money oh yeah yeah yeah yeah yeah yeah
yeah we we solved it don't worry guys
don't worry won don't worry we don't
worry don't worry you know but I there
just wasn't any information and I asked
her lers like can we make this can how
do we make this more public so people
can find this stuff but okay all right
conspiracy theory guys they're keeping
good search engines from us because when
we do you think the government has a
good search
engine I don't know no I don't you think
they use Google no no yeah I think
so I don't think the government has a
good search engine I'm just saying like
do you think they can search their own
content Google has let us down so much
perplexity is good perplexity is is
working on the right way what do you
think when we when we did that Freedom
of Information Act for you yeah how do
you think they got all the data on you
like where'd they go how'd they do that
when you do a foyer request like how
they government documents they probably
have like a crappy they probably they
probably like pay some shitty contractor
a ton of money to run elastic search on
a
cloud how much do that cost the
government have I tried binging the AMD
RS what do you mean oh binging
oh binging I didn't even know that was a
he do want you want to try Bing we try
the government uses Bing the government
uses why he use his Edge oh my God wait
this is so beautiful this is the worst
site I've ever seen what do you mean
look at these birds okay so first off
things are fucking moving there's large
birds down here I'm hearing about dead
Sailors abortions Denise
cheating a picture of Kamala Harrison
Frozen in Time a picture of a
tire is coming and one killed one
injured in attack
with is that Yahoo what do you see yah
it's no he that's the vibe the vibe
is we can use Yahoo categories B Bing is
got Boomer energy for
sure this is this is the worst no wonder
nobody uses big MSN news is wild I do
agree that MSN News reminds me of like a
tabloid at the grocery store like UFOs
spoted UFO
spotted um I've never tried yendex can
we even use Yandex I don't know what if
Yandex is
good finds everything AMD GPU register
Doc 7900 XTX should we bring back Al
Vista okay uh no no no no does anyone
remember let's check out maybe the
Russian websites are good yeah dog pile
that was the
best
[Music]
uh Brave search I didn't even know they
had
search no mentions of UMR on this
Russian website though W this is
actually pretty cool what is it the
Russian sight to
review they put all that in that one
Gip wow if our search in English is bad
do you think it's really bad for other
languages
too oh sorry we didn't actually use Bing
we got distracted by its
terribleness
VT I don't know
that oh ivt
okay uh that makes sense no it's it's
like
Russian oh I I tried to click the next
button but I almost accidentally clicked
on chat with who I don't know who do we
chat with let's find
out
no
no gitlab links anywhere there's a maybe
there's still a
whole
um we have fine we accept the terms of
service okay uh no I want register docks
what's
Yonder before proceeding make sure you
have the serial number and part number
and people think llms are smart like
llms are so dumb
whoa whoa whoa they know very specific
things and you have to use them in very
specific
ways it's kind of like your parents I
don't know like like can we have a can
we have a game show it'll be cheap to
put on but we have an Alam and a Burundi
like who what's more expensive gbd4 or
berian to do what more expensive to do
what generate tokens oh probably
gbt try kaggy decom all
right oh I heard heard about this I need
an account wait that's
insane no ads fast and personalized
results I hate this web page it's a
search engine you deserve I know it's
bad I actually feel like that's a mean
thing to say yeah it's a search engine
you deserve you deserve
this
um you know how to try it now it was
better last year F me not not even going
to if I if I have to go to bug me not
sorry kaggy wait but what if we actually
made a good search engine we could be
trillionaires I'm going to fix
search where have I heard that
before uh no no I'm kidding guys I'm
kidding um if AMD is excited we can
write a fuzzer and they if AMD agrees to
open source their firmware sometime in
the next year let's write a fuzzer we'll
sell the Tiny Box Reds we have register
documentation do you want feds wait you
can't make a good search anyway the feds
will come wait why I don't need a good
bunch of good working AMD gpus we're
going to use Nvidia to build search when
you're serious use Nvidia if you're a
masochist use
AMD I'm just thinking how our search
engine will be
better
um how would it have gotten you the
results you wanted it would have like
thought about it Wa
Would okay how in the same way you did
as a person we're going to sell we'll
slowly sell some Tiny Box Reds too but
we don't have to sell any gpus that's
nice at least we have to send the two
Pokemon back though find is good with a
p
find co-pilot finds if you ask for
register
debugger oh yeah okay if I knew this
well yeah cuz it's called I've never
another ad for kagie I have never heard
the phrase register debugger before in
my
life search with
reasoning how will we keep the lights on
without ads I mean I would the same way
that you know opening I charge $10 Tagg
is pretty good no I have to sign
up I would pay $10 we'll have we'll have
the free tier we'll have the free tier
where it tells you that it knows the
answer and it gives you of it and then
below the fold you have to pay to
unlock I hate that I hate when it's so
much better than kaggy which entirely
just pay walls
me yeah perplexity is a nice model uh I
should sign up for
perplexity can you charges $10 a month
$10 A month's fine it's just that that
website make an account is terrible they
should at least let you do five free
searches let me do
yeah Che wait Che is this where you buy
books this is the worst thing I've
seen I've never
heard yeah I've actually looked at this
before
too oh SE free search but get PA
baptized brilliant idea yo what an idea
oh you were kidding about check oh how
is
Claude CLA is as good as gp4 was when it
came out because anthropic hasn't
realized that it cost them too much to
run and they need to run the shitty
quantise version that gives you
listicles all the
time they'll figure it out wow listicles
they'll figure it out we just no
listicle and
then what saying like the lisal no like
Rags are a
disaster uh these these people things
are people are excited about these like
retrieval augmented
graphs man what's that it's these like
they're like these like it's like crappy
llm hybrid search thing
seen it yet make a search engine that
also searches dark websites yeah I don't
know I don't spend enough time like on
the dark web I need to just get off the
like Internet Internet it's total trash
why am I on the internet right now
talking to you guys I like that story
about the guy who were in the dark web
drug dealing site and then extorted
everyone told everyone that he was uh
deleting all the information that it was
private and then he was like haha just
kidding pay me if you don't want me to
reveal your address and information is
going to be Google's business model in
10 years yeah right like Google Google
is going to just Google is going to get
into the blackmail business like Google
do do you want here we're going to
release your entire location history for
the last 10 years also we're going to uh
post what kind of porn you're
into I can't unless you sign up for a
Google a Google Plus account and affirm
your commitment to Super
Dei I de Googled my life and it was not
easy if you start writing pgp you get
banned instantly I mean Google is an
abusive relationship Google is an
abusive relationship apples we need to
break free from abusive
relationship AMD debugging docs incoming
oh let's say wait is this a
[Music]
recent what is
this
something I don't know whatever all
right guys
um yeah site LF freedesktop.org I should
have just looked on this mailing list I
I don't know I've gotten kind of bad at
using the internet now no no no no no
they've atrophied
everyone like I used to be better at
this though maybe it just is that the
revealing characteristic you you didn't
search hard
enough I just didn't think it was open
source like I I I promise you if someone
had told me it was open source I
definitely would have found it with like
you know 30 minutes to an hour of
work I just didn't believe it
was but how would you have
known I mean I just had to
assume if someone said like you know
it's it is it is open source on the
internet not leaks can
you you have an hour go find it of
course I'd find it is this like the new
geog guesser but like the pro like you
don't know what you're looking for and
you don't realize how much is hidden
from you I think that's the truth we
don't really realize how much is hidden
from us I mean so I I saw a good tweet
about this like again uh for those of
you that don't know uh when you go to
images and you search for French
jokes right uh so m about groups of
people maybe disturbing or
hurtful uh the the thing about the thing
that really Gemini revealed was not that
like Google can can't make an AI that
generates pictures of white people what
it revealed was that Google search is
neutered in all sorts of ways you can't
believe
either
yeah I mean I literally asked the
company and they couldn't tell me I I
know well yeah that that aside
no I mean I guess again I didn't
like why people
jokes it's not about you know I'm not
trying to like I'm not making a ra
racial Point here the interesting thing
about French jokes is French jokes can
also refer to jokes in the French
language yeah that's why I thought that
one was the most
interesting um we don't have
perspectives tab okay but these jokes
are cute I've never even seen this wait
what's perspectives tab I don't just
like the war tab on
Twitter um what was that I don't think
I've seen the perspectives tab why why
can't we explore it I don't not
exploring they programming your mind man
I need just I need to block Google block
Twitter and block twitch sorry guys
[Music]
welcome back
everyone it's been a while since we did
like a whole weekend
stream uh Alex is away on
vacation so it's a good weekend for it
let's get some
lights and we have a nighttime
highball so we're really going to go
hard
uh if you watch my stream this morning
we wrote the code that was on the stream
code that was on the screen I think we
can make this light a little brighter
let's crank the brightness up here yes
there we
go like the old days you
know good evening everybody
okay so this is the code we're going to
go right to subscribers only because we
got to focus we have things to do we're
riding our Qualcomm GPU
[Music]
driver thanks to a nighttime
[Music]
highball
so here we have
we create the device we allocate and you
can see these are the allocations
actually being passed into the
GPU um
but this is hand
coded so let's figure out how to not
hand code that using regular
Expressions I to do this so um for those
just joining we are sshed into this
phone uh running turmo
um and then in turmux we're running code
server uh which is running a vs code
server that we're connected to through
880 which is being forwarded through 0b
how are we going to write a GPU
driver so it's a little misleading we're
not writing a metal GPU driver we're
writing the user space of a GPU driver
the kernel one is actually pretty clean
um so on the last stream we
downloaded uh the kernel from Samsung's
open
source
and where is
it well if we just rip grap
this
here we go vendor qcom op Source
Graphics kernel this is the kernel space
of the driver and actually the code of
it is pretty
clean um it's more readable than
the uh AMD and NVIDIA
drivers uh I'd say AMD is the least
readable followed by Nvidia followed by
this um the npu well we might be able to
use the what do you mean by the
npu we were too amped up in the last
stream it's always you know I'm excited
for the weekend and we go on big rants
about how we're going to fix America but
then you go outside and you touch grass
and you remember that the universe is
going to end anyway so you
know just always got to keep keep that
in
mind the heat death of the universe it's
where we're
going
so let's extract some stuff using reg
xes I'm not very good at reg X's but
we're going to try our
best just seem like they're all laid out
like this
I want to extract the name of the
struct
this let's try our best at reg
X's reg x
match do we think Quenton can help us
Quinton I summon
you
Chronos graphic
executive can you
write a regex to
extract
no
is there any hope of this
working no there's no hope of this
working
quenon I need you to be
smarter
all right is you think mixol is going to
be
smarter is this actually mixol or does
this drop down do
nothing
oh much better oh mixol so much smarter
whoa whoa that just worked thanks
mixol
that think it's going to work because I
think it doesn't know about the
uh
yeah it didn't actually copy the slashes
for some
reason
oh REM multiline allows the reg X to
match across
lines did you hallucinate that
Quenton no no
matches oh I think that it made some
other change
too oh comp the right
one pebcak boys
pebcak looks the
same
The Backs slash at the end of the line
is not part of the reg
X
but not that
line what's that mean does that
work
Quenton has some encoding issue it
seems
slash
s+ okay let's start with just that let's
debug my
regx
uh okay so we're going to need actually
to put that plus there I do kind of know
where did
syntax okay so those are those ioctls
now they're all followed by a space I
think if I put that there it
breaks yeah
um x pattern allows
spaces just add a space in your
character class what is regex back
SLS white space okay wait wait we need
not
just matches white
space
uh that
maybe okay but now I have a weird
match put a question mark
there
oh does just normal SL slash
work yeah but why is this not that
now all right well either way it looks
like it's working
again
no
oh that slash is
bad no okay the
actual there any
[Music]
iio
regex101.com
does not match the subject
string
oh that's a capturing
group no I don't want a capturing group
does that
work I do want this to capture
though I
think
this should
capture okay
good okay good I captured that oh this
is so much better than stupid GPT
shits
plus uh i
o
[Music]
w um let me get a few more of these in
there don't
[Music]
W thank you reg x101 guy I like
you oh this one's annoying should I just
remove all the I can just remove those
in
Python it's faster just remove them in
Python
not dealing with
that okay iwr question mark slash
that um I don't really care care about
that I can actually just type it if I
want I want this to be a capturing
group where's my
stupid okay
cool
all right we got that
extracted now comma oh I should do SLS
plus
s+
struct space
SLS
uh and then yeah we'll make that a
capturing
group
great
great thanks regx
101 there we
go
okay I want to create a dictionary out
of
these um what is that
NR NR is equals okay so it's not
actually match it's going to be
um
name and
R and S
name you want to do int NR comma
10 name s
name thanks GP
shit all
right uh
name s name
equals NR sub
NR segmentation
fault uh oh because I have to do asmore
kgl I don't like that that segmentation
faults if it fails
oh there might just be lots of
segmentation FS okay well that
works um does that
work yeah that
works
okay good now we have all the names of
the I
Opals now we just need to parse the
struct um
get
at MM kgl struct underscore s
name S
Type segmentation Vault okay no
good then don't care about that good so
that's that's all the
calls
uh now we have the struct we're going to
have to cast it to the
struct
segmentation fall
day
uh can I do s type. size of does this
work
no does this just not work no we
established that
works
okay that
works but for some reason get ater field
name doesn't or they're just not all
strengths oh that works too
great
uh so I can do this in here I imagine
too
great let's type
stupid that's
stupid why I put a comma who uses
commas oh yeah it was probably
complaining when I was trying to cast
that
one okay
pretty cool um let's call the CIS call
First and also I shouldn't have called
this call back I should call this
ioctl pretty sweet
um
just
beautiful all right hey it's a GPU
driver do you know how long this kind of
shit took to write and see I would like
do it by hand and I would copy and paste
and it was a huge waste of
time
but now with the power of regular
Expressions
uh get out her field
name
that
that
[Music]
all
right
so some of these are inputs and some of
them are
outputs uh all these ones called padding
we don't don't care
about um if field
name dot starts
with
padding
continue much more
beautifuler what is this
pad
just padding zero
right okay that's much more beautiful to
read that's interesting that actually
got rid of all the ones that aren't
simple types too which is
cool okay so we're just getting started
because this is just the
um
that
shouldn't actually do s name we should
go a step further with this
and put these
in here
use get us
typ
um
h
okay guys ready for fireworks let's try
this with actual tiny grad from Tiny
grad import
tensor tensor do
uh let's just make a tensor 0 one 2
three like this
uh don't know if it's fult
anymore
okay segmentation
fults fireworks is
Promised
uh oh there's probably other I
oals
um if NR n
NRS I should actually check the ey type
[Music]
too
okay
cool uh so you can see 1 + 3 is 4 and 2
+ 4 is 6 so it did
work
um separate
that
create tensor B actually did nothing
interesting uh can realize these
two
okay I don't know what that ioctl is
for but it's not
for I could check the FD as well
unsupported format string pass to nun
type
format
what really understand that
whatever doesn't seem to break
anything just com that
out
um
okay create tensor a create tensor B add
tensors okay we
allocate call this command call this
command uh so this is the stuff that
actually matters and then we wait for it
to finish and then we're
good
[Music]
um give that more
space sweet okay so we do a whole lot of
knit stuff when we first access the
GPU uh we create tensor a we create
tensor B we add the tensors we fire off
the
command um
now remember that most of gpus are not
actually controlled in
uh
in kernel space but rather in user space
so the structure that goes into this
command list is where things get
interesting um and this is still like
we've only parsed the single layer
pointers not the double layer
pointers would par the double layer
pointers if we had that but we don't
hopefully we have that struck there's a
chance we'll get to structs we also
don't
have and um we'll see if we can
[Music]
find so what we can do almost right
away is
replay if we replay this GPU
command um it will read the tensors and
then if we replay this it'll copy
out
uh well an interesting question is why
didn't it copy anything
in probably because we M mapped
it GPU Adder okay so an Alex must return
to you this ID and then this thing has
gotten through
there
um why are we allocating two things
there oh it
must I mean this is also interesting to
see what tiny grad's actually doing
I don't know why it's calling allocate
twice
there well so one thing we can also do
is get this to integrate with the tiny
jet so one of the things you can import
right from Tiny grad is the tiny Jet and
then we can have add a b return a plus
b uh
realize tiny jits a
decorator and now I can change this to c
add A+
B
uh interesting so we can also run this
with debug equals 2 to see what tiny red
thinks it's
doing oh it's not actually executing the
GPU command because we didn't have to
wait for it but you see this so this
is uh let me actually print that
here so for the second and third run
actually in the
jet um and you can see that it's running
and it's actually using the same command
list we must be freeing
it we must be getting lucky that that
just happens to
be unused Ram in fact how did I deal
with this in
uh I don't how I dealt with this in need
we can look so I've written parts of it
this driver
before um but it's so cool to see like
so this these prints are from Tiny
grad so you can
see this is what actually runs and it's
interesting that it is the same these
are
different I mean it must just be getting
the same
uh CU it should be the same command
by the way we can put other
uh things in here I know this is just
one
kernel but let's like throw a sum on
there
too uh now that'll be fused you have to
find something that isn't fused that's
fused so it's fused to one
kernel uh what wouldn't be
[Music]
fused it's hard to find stuff that's not
fused whatever it's not that interesting
uh GPU command is just it's going to be
more than one
actual uh
command well
actually I just run a
[Music]
model
so
okay we can go a few different ways with
this unfortunately I do think if we
start replaying this stuff
ourselves these timestamps won't line up
anymore so once you hand control over to
the new GPU driver the old GPU driver no
longer wants to uh wants to do
anything um it's interesting too that
here
like it doesn't actually submit anything
to the
GPU for the first two
times like
notice how in two and three
now um well debug equals one isn't good
debug equals two actually issues
weights and that's why that's there it
syncs the uh the pipeline but if I don't
sync the pipeline it does
nothing which is very
interesting that calls that three times
isn't even
that
strange um okay maybe we should start
diving into what these strs actually
look
like yeah by the way these prints are
from Tiny R so if I don't install the
hook you see it's just
this
Constantin might be smarter quent's an
idiot what do we want to ask
Quenton they both they both failed it
right reg X 101 crushed them
both okay victory for that's it's
what oh
I'm so close to I'm so just habituated
to clicking deny on something that even
if it's something I
want okay so it's a user
pointer so that's definitely
understandable um it looks like we have
three lists here a command list an OBS
list and a syn
list
let's open up the GPU
driver oh I had it before did I open
it Graphics
colel let's find the thing that actually
parses the
struct pram process command
input
okay well we have a max number of
shits uh okay that doesn't look like it
does
anything process command
input get owner add syn
list kgssl draw object okay use 64 to
user pointer command list okay whatever
is PED then is the second thing
there oh this is a draw obge command we
might not want that might want a
different
command okay and then we're also going
to need to get this header file and put
it in uh the C types
thing
so I generated this I should
really um this is called like uh clang
to
Pi mm kgssl
o see if that
didn't no okay let's
go create a folder here for g.s
Shang User it's not user bin
visit we'll see if that
works cool
works okay um let let's I don't think
it's a draw
command so these are the different
objects here it's I mean it might be a
draw command I don't
know Q DSL draw OB command okay let's
see if there's other command
options KSL command
objects this is the a version of MSM
kgssl it should be the same I don't
think anything
changed it might have it looks the same
so this is the one that's used in uh in
open
pilot okay it does look like there's
more crap
here can probably get all these
uh
[Music]
okay so it sure does look like there's
only draw objects that's
fine we'll say it's a draw
whatever okay
so where's my draw objects draw
option good this doesn't seem to include
anything
stupid looks pretty
real
um how do I get that over to the other
computer build 3 4
[Music]
five
[Music]
I just has
actually remember guys this computer is
this a Samsung zold 5 with a Qualcomm
8550 chip in it Snapdragon 8 Gen
2 um
um we looked into using that chip for
the uh comma
3x but Qualcomm wanted to charge us an
arm and a leg and I was only willing to
pay a finger
so it's a nice chip but oh notice how
watch doesn't work why would it be
executable see
like little things like
that who
knows that if stuff is green it's
because it's executable and it's
executable because there's a bit in the
mode called plus X you see now when I LS
that X will be gone
right little things like that you see
it's a predictive model of the future
what's going to happen if I type LS
right you're testing the model
quality all right going to
work Linux dma fence well I don't like
fences
anyway how much is it going to bitch and
tell me I don't
have all
right oh
Jesus well that type I can deal with why
are like the basic types not
here
okay kraf list
head I don't think I care about that
struct
should I just maybe just take out the
ones I care
about that's a konal struct okay
delete
[Music]
uh wait
what no no no that can't be right then
we have the wrong kind of no these
aren't right this just isn't right cuz
that has a internal colel struct okay I
didn't read the code right read it more
carefully we allocate an internal one
here this is just not
right wrong
type rocal GPU
command add command list it's third
parameter to
this
user
pointer what's in pointer copy struct
from user oh it's a kgssl command object
okay where is this oh it's in MSM kgssl
okay so we already have this
then okay so that was a red erand
herring or
whatever that was a red
errand
all right kgssl command
object offset GPU Adder size Flags ID
great but now what do I
do
um if
uh
that okay we're gonna have to cast it
can I deal with this
here what type is
it
wait
why is that one the wrong type and that
one the right
type K GSL command
object okay I think this is
right
um cre a helper function
print
for
oh command
list MSM K GSL not
defined
cast two must be a pointer type yeah
yeah
yeah actually put that
in I don't want to put that in format
struck LP kgssl
what no that should be the same as that
I don't understand the difference
oh contents yeah okay we're just going
to put this in
here
let's
see open
CL okay s is not defined oh that's
annoying
is
okay that'ss pretty
legit
um wow it really is resubmitting the
same thing twice I wonder how much time
it's spending Computing that it's the
same
thing actually it's weird you can see
now that command list oh it's different
there it's the same so weird
squ okay uh what is an object
list oh I also think that there's two of
these right if we look at a kgssl
command object yeah that's hex1 right
see wait no that's X20
okay then how come num commands is two
if command size
is that might just be times I don't
know
um can I do
this actually
also okay that looks pretty legit but if
I did one more it wouldn't
work yeah that looks like crap okay good
so that is the actual size so here I can
just do plus
equals s. command size okay for I in
Range s do num commands oh I love python
oh you know how hard this is and not
python so
shitty
okay so those are the commands out of
the command
list don't get married if you want to
keep working eight hours a week no you
got to have a wife that's
understanding
okay where was I
[Music]
here okay add M
list let's take a look in this function
and see what the underl
pointer typ
this copy struct from user into OB so
it's also K it's also kgssl command
object
okay
okay
so you can see here we're submitting two
commands here and an object here two
commands here and an object here two
commands here and an object
here how do we go further those are GPU
adders can we Mal them
oh sorry I mapped
them well okay no no no no I know what
we have to do so if we go back here I'm
sure this GPU Adder was given to us
somewhere no or something like it at
least here we Al like all these objects
up here this object here okay so yeah
the first command
oh and there are commands here which
copy the GPU to the
CPU that looks to always be in
there that's the GPU
Adder
maybe I should print the return value
too we should have it right yeah because
I do the return there
so oh I see these ones fail that's
cool okay so it's uh
polling oh it's poing because this
timeout is low if I set the timeout
longer it would probably actually just
wait
but it looks like it just pulls pull
pole pull pull pull who knows the
difference between polling and an
interrupt
right one is a democracy and the other
is very
rude what's the difference between a
first year lit student and my
mother my mother's actually very lovely
woman
you know Bojack sits around and watches
old episodes of horse and around and I
sit around and watch old episodes of
Bojack what's that number where's that
getting printed oh you be a little
longer you can tell that my 222
characters big
so what up there fails I can't get that
properly okay
so I don't exactly
understand um is tape out in the distant
future
well
I ready to think about that for a
minute what good do you think a tape B
is what do you think you want to tape
out right why do you think what you
build is going to be better than the
Qualcomm GPU it's not but I think I can
write drivers that don't
pull
so you might want to stop thinking about
you
know building a chip before you can
write drivers for the chips that already
exist and if you can't write better
drivers for the chips that exist trust
me your chip is
worse again what I'm telling you right
now is Alpha that could have
saved billions of dollars collectively
on ridiculous chip tape outs that
clearly were never going
anywhere
um you know I hear myself saying that
and then the thing that makes me really
angry
is
like it's one thing if they were trying
their best but what if they weren't
trying their best right like sometime
I'll tell this to people and they're
like George you know obviously this is
true but you have to realize that if
they didn't tape out that chip these
jobs wouldn't been created and
like that is just the saddest thing if
that's true about the
world and I guess that
is one of the things Kama really taught
me it's
that
companies there's we're gonna we're
gonna we have more Bojack lines right
wait making TV is people's full-time job
like like why is it all so bad then I
kind of thought they just weren't
trying but why do you think it's a good
time to distract me are you not enjoying
this
okay we have a question of how we get
the all right so I allocate this object
I think I probably actually have an
answer to this in
the see look how ugly C is C is so
ugly oh yeah when I jack the priority
up
I don't parse the commands in that one
because it was too
annoying
um wait interesting
what Alec
[Music]
ID oh I see okay so every time I get an
info I can just m that
that is Map size ever not equal to
size is that really
right is that really right or does that
just happen to
work how did I get
that so I'm just here I multiply the
Alec ID
by whatever
okay so whenever I get a GPU object
info going create
a
MMA M Maps
sub s. GPU Adder equals
map
map
um the file now FD is
that uh the length is going to
be
size all these things are always
equal
I think it has all the
uh prop right read access equals access
default map shared all that's
fine uh right is this really I'm just
going to copy that from the maybe it's
right okay does this
work that could silently fail if I like
typ on
something
no seems to
work okay
um CMD do GPU Adder CMD GPU adder in
M hex
dump and map
subon
size
oh cool um so these are sub Alex but
this is a GPU
command yeah and I think I do copy these
out in need I
think um I do Alex at my own GPU
memory yeah I have GPU Malik and then I
like yeah I like Alec
things oh oh
see oh see look how disgusting look how
many lines it
is so many lines AI is going to make
python fast
yeah okay so I
do copy out each command oh so I I do
this okay I get the kgssl command object
I
see yeah okay so I've actually done this
before many years ago sort of in a much
uglier
way so's not actually a driver needs an
Interceptor and replay
engine um
so are these the
same sure looks like
it
uh I need like a range struct there are
ways to get
these
should try to helper
function uh okay there's not that many
of them we'll just Loop through all of
them
fkal to adder
and Adder less
than length of
V
turn
V
subus
Kus K plus
L getm GPU
do
didn't
work
oh
okay that's something now how do we
parse
that incoherent
blob I think we're getting this stuff
mostly
correct this
to
that's an OB that's an OB I will note
that those are
different even these are different
okay and we don't have any syn OBS I
don't know what those
are
um so I mean the thing just basically
caches at this layer it copies out the
these GPU
adders into cleanly Alec
memory okay so this is a command offer I
think I might have actually worked once
on trying to disassemble
these don't know if we going find any of
that stuff though so we want to we want
to parse this command buffer we want to
write a helper function to parse the
command
buffer this one's a lot nicer than the
Nvidia ones where this one actually like
passes in the uh he uses an ioctl to
pass in the thing so the Nvidia one uses
these like doorbell registers and you
have to hook them and it's
weird why are we rying a GPU driver I
don't know bro why do people Ry
bread why do people Ry
boats you get it ride boat I'm go ride
boat
uh all right so
like no I don't want to have to okay one
place we can look for this kind of stuff
I don't think we're going to find this
in the kernel
driver oh we copy instruct from
user we sometimes throw an
[Music]
error we can add a profiling
buffer what if we add a profiling buffer
and IB
desk okay what struct is this and how
are we going to parse
it
you see like some similarities here and
here uh we won't need to worry we don't
need to parse that right now let's focus
on parsing the command
buffers and let's see if we have the
stuff to do it so another place we can
look that should be like kind of right
is what's it called ADR no no no what's
the Open Source One called free Dro
driver
CP commands right to
registers see if we have these no we
don't okay so this is probably
the foro turnup US a sh for Shader
compiler image
layout what's
turnup oh turnup is a Vulcan
driver
this hasn't been updated in a long time
they like put it in Mesa I
think oh no but it hasn't been updated
for this new one
yet okay this is the easiest part is
it's identical to
Radeon the command stream parsers
here
looks like a lot of
stuff so I Ed I've used the Shader
disassembler I'm not trying to
disassemble the Shader that will get
there some of these things have to be
pointers to
programs but this is like the command
stream and I want to see what commands
are actually being sent to the
GPU
we can try it want to
say
um do you know about
[Music]
the format of the adreno
command stream
packets
okay
wait is this not no it has to
be
it just made shit
up
for
e
um uh so no the llm has no idea and even
worse it doesn't no it has no
idea okay gbd4 is a lot
better shame we can't use it on
stream
WR n consecutive
dwords it's probably
this
this don't you mean can I edit this Wiki
that's definitely 30 not
okay
this isn't really part of the progress
of humanity I'm just kind of it's kind
of fun you
know
this useless
crap primarily of type zero and type
three
commands so what's a type three
command data
perform the
operation by itop
code I don't think either of those is
Right unless I'm not reading the I could
also be getting that
wrong that's probably
right
just it's so
weird that it happens to
be offset that well actually it's not
that weird because it's probably being M
mapped by the
uh it's probably I figured it out right
I you just see what M map here so if you
look at the M map yeah it's the same
so you see I'm just calling I'm calling
M app the same way C is okay so it's not
that so this is the real command buffer
I just have to learn how to parse
it okay that's the
same oh that's just the count okay so
there's 97 there it's all the
count it op code is 0 0 here and it's 0
one there and then p is there what's
P where are the op
codes where are the op
codes has this one been updated
recently not at all
where is freino
now definitely not
that okay this seems to have support for
it where's freino
turnip is it in
Mesa
I mean there is this is like a third
party
driver
okay here we go being actively developed
on Mesa
3D is there a
branch
no
pm4 what's a
fuck
this is some oldo shit where's turnup is
turnup in here I like turnup that sounds
good that sounds like it
works no
turnup you references to
turnup turnup Mesa
driver where's
Trum but this is the Qualcomm GPU it's
the same thing does does nothing make
sense what's the CP indirect buffer okay
here we
go
uh
R
okay 2 CS mid packet
s out packet three okay there is out
packet three
is that
defined no got lucky you can click it
okay okay out ring CP type 3 packet wait
might not be a type three
packet
uh does not look like a type three
packet
actually this looks like a type zero
packet that's a seven or or type four
packet or type seven packet that
actually makes the most sense okay this
is a type seven
packet packet is type
seven PM Cal odd parody
bit
wow okay and the count
is just Z and this is op code 97 and
this is op code
26 the odd parody bit here is
that the count
is
wow
okay I wish we like had like a struct
for this you know kind of be
cool all right so like what are my uh
what are my op code types and why does
this one have zero oh this is just
another one there okay that makes sense
right so this has a count of one so it
has one there this has a count of three
so it has one two three and then there's
another packet right there okay cool uh
that's pretty
chill should we write a quick
disassembler or should we try to get
this stuff to build
what is
this muu oh
they WR an
emulator
okay uh parse command b.
Len actually I can just say dat because
it's python
okay
uh if that sub3 equal
70 uh
struct
uh like I kind of like
[Music]
the stru type although like what's a 97
op code and what are the other packet
types
should we just Define
strats definitely like it's a definitely
a 32bit
system so maybe we just do
that
uh
thank you hyp
ch um okay so that's time 7 we're going
to do pointer plus = 4
* yeah do
that
oops kind of like the hex
too
[Music]
we should do something
simpler
[Music]
uh
oh have to do
that
what underlying buffer is not writable I
made you
bites
oh
copy should make a copy
oh I do
memory memory is not defined
um
what gu just call byes in the
object
from
buffer oh it's not bite bite
array okay that
works uh g.
synchronize okay
cool all right now we're doing just one
simple it apparently has two commands
[Music]
um type seven that's the count and the
uh I get the op
code where's op
code there we go x shift shift
16 uh off code equals command shift
shift 16 and 7
F shift shift 16 and
7f okay so those are the op codes we got
a 23 a 62 and a
[Music]
all right here we have a type four
command how do we part A type four
command Okay so that's just if the
first bite is
that then where is type four defined
Okay
[Music]
so
oh interesting
don't it's only three FFF
ffff all right so order to get the
packet here we have an
offset the hell is an offset okay well
whatever it's an offset a
size this is not called count it's
called
size
okay so we get this we get the size with
7f and we get the
offset with shift shift 8 I don't like
how much I'm doing by hand here this
better get simple
fast okay um
that seems like reasonable I
guess so this must be type zero
packets okay if packet is type
zero that just means that when I shift
shift
left 30 I get
zero what a zero pack is that have zero
packets have this
size they can have that size because
that would skip too
much they also have
offsets their offset is just
command oh don't change that the a
offset is just
command
and
7 f f
f their size is
16 and this +
one
oh I didn't parse that
right my
bad
Okay cool so there actually are no type
zero packets there's only get rid of
that
then
com okay we have type seven packets and
type four packets that's pretty good
there's only two types of
packets I a bajillion different op
codes
but okay this looks pretty familiar from
other gpus I've seen this is further
than I've ever gone with uh with qualcom
by the
way
um also going to put
pointer 3x here I think I like briefly
looked into this when I was doing need
and then was like I don't want to do
this this is
stupid uh
uh at the
bottom okay cool St printing that stupid
hex
Thum now we're parsing the command
buffer um I'm only doing one copy in now
I commented out I didn't comment it out
but I would zero there um you're going
to push this for you
guys should be able to do
this
don't know if anyone's paying any
attention
but okay
uh so what is a type seven and what is a
type four Fredo can you answer it for
me by the way very cool that these
people you know you got to the amount of
work that goes into this open
source stuff things that like some
random person somewhere is obsessed with
you know not everyone in the world's
terrible
um like I don't really understand if I
were
Qualcomm I was just like I'm sure my
internal driver's garbage I don't
understand why they don't just switch to
the uh switch to the open source stuff
how many viewers we
got are people enjoying
this okay packet mostly fall into one or
two categories or depending on
generation oh we really never do need
this
then 700 all right cool my
usual
um packet with OP code and op code
specific
payLo I I like more that we commit that
now that's Comm we can do we can delete
it
okay
okay uh what are these op
codes this is writing registers like
writing registers is pretty uh so you
have to figure out what's in these
register but this is very similar like
Nvidia has basically the same
architecture
here um I bet this is where we'll find
like the
uh Global size and local size and stuff
right so this is a command stream that's
going to the
GPO
um and I bet there can be multiple
things here we can go back to running
the tiny grad example copy out's kind of
stupid we can just not do
that
so if you see here this is simpler we're
doing a an ad um if you want to actually
see what the kernel looks like we can
run it with ch equals
4 so this is running this opencl program
here but the code's not in here you'll
see the code is
in
uh junk junk junk junk okay
um vals equals I *
size plus this + 4 *
that comma
vales that
okay so those are the values that are
being put in the uh that
register
um we can look see this is a local size
of
two make them
bigger okay so you see this changes this
has a something
50 something
25 maybe that's that
see what changes here no that's still
that 25 and that's
100 oh I see so this is probably the
local this is probably like the total
size which is 25 * 4 and then this is
the uh dependent size oh okay I like
this oh this is pretty clear oh I see
what this is cool I love when things
work out okay so these are the global
sizes right and then this is the
like it's a little bit wrong you don't
usually think of uh because this doesn't
correspond with opencl or cuda's way of
thinking about it but this is the number
of globals and this is the total number
completely um so yeah I'm sure we'll see
what that I'm sure we'll see that
corresponds to stuff okay so that's
cool um yeah these are the values in the
registers by the way I'm so happy we're
doing this in Python because like look
how easy it is to just write
that all right like I just wrote
that not that I wrote
that
beautiful
beautiful
all right let's figure out what these
type seven op codes are
then
not
that CP type 7 op
code yeah
but there's a list op
codes packet name
oh this is adreno pm4 Type 3
packets
where's the type seven
packets there are no type seven
packets they might be the
same U where did I find that good stuff
about like saying which
okay
oh
so as long as you have a generation
greater than
A5 all we have to parse is fours and
sevens okay cool this is actually pretty
simple um like sevens are commands and
fours are right
registers uh yeah so we just need to
look up what these commands are and my
guess is that actually is in that
um that
file okay what is this
XML
XML it's adreno pm4 what is
pm4 these op codes in hacks yeah they're
in
hacks
don't do
that my
go
closed okay
fine I press something and my window
goes
away it's not what I want how do I make
it say
Ox just add
no come on someone here has to know
that oh in case dollar sign is
specified
what where do I put the dollar
sign I put a dollar sign there that's
cool base dollar
sign love it no except I don't want that
to be
uppercase
fine that's all lowercase that's
great
okay what is op Code
17 oh
it's
in prefix
end or CP thread control on this
variant it seems a lot more
plausible
all
right should we copy this
pm4 and parse an XML file who's
excited should we use a regx to pars
it just
kidding regx is suck even with
regex101.com
regex101.com make TV
ads all
right um let's parse that shit
uh we don't actually have to go all
these pair and get rid of
that that get rid of
that
how do I par stupid XML in
tython where do they get the name from I
don't
know
oh oh that already looks brutal I can
just
tell element tree XML sucks and everyone
involved with XML
sucks why why they use
XML can I get the stolen Qualcomm
version of this it's probably way
better same packet ID
is verify pack actually
handles
[Music]
um so how do I uh like get the
get
rout just convert to Json first
okay
um is way do some
python XM a dick this is
a i stall some
garbage all right it has a lot of all
right fine it has a lot of
[Music]
uh why would you want to convert it to
Json right cuz some guy told me to
convert it to
Json you should just listen to people I
get it I get what you're
saying
fine um all right
this sucks someone pars it with a reg
X is there multiple
Roots don't tell me there's multiple
Roots that's the one I
want
yeah now do it in
C
on
Atri
oh we got to deal with if there's
variance all right
um
and probably get all whatever
man
don't try to be smart and close my shit
cool all right
um
[Music]
great wait for idle KN CP context reg
Bunch 2
CP context regge Bunch
control reg to me n not wait for
idle cond
indirect offer PF
e uh we're gonna have the same let's
just do the same vals
here that one's got a ton of
crap event right
wait for
Idol CP run open
[Music]
C so like why do they have knops with
sizes these are just
stupid are you sure it's actually CP
up oh they have docks for these
things how do I know which one
Associates with which
one xml's
stupid why do they have why do they have
packets that just
skip
not the real name but seems to be what's
used for open C instead of CB draw index
okay well that seems reasonable how
about load State 6
frag there real are there like leaks of
the Qualcomm GPU driver somewhere that
use real
names
it's really cool that AMD open sourced
all this stuff Nvidia open sourced their
stuff
too but I'm not sure Nvidia open source
this I think I had to look at novu for
this okay let's also try to figure out
what register this
is here we
go it's in the
a 366
XML it's the HQ control
register thread
size let's
see
Nvidia op sourc it's not really the
driver Nvidia open source the colonel
stub that talks to gp. bin but there was
a lot of good stuff in
there they basically mov the driver onto
the video card
itself or a lot of what was historically
called a
driver uh and they put in this thing
called the GSP
that's pretty good um so like do I need
all this
crap SP private me Hardware stack
offset oh I guess where's the
uh oh this okay these are this is a
pointer that makes sense this is a
pointer
too oh sorry that's a control
register but that's a
pointer
[Music]
mam private M
Adder private M
size four five 6 7 8
9 oh no this is a private M adder and
this is the private M
size I
see so how much of this stuff do I
actually
need
similar to CP context R writes to a
scratch memory that's read
with oh you know what you know what
it'll
help if I go in
[Music]
here I'm doing profiling on this aren't
I
if I have debug equals 2 I'm doing
profiling let's not do
that let's instead do dev.
syon um might even matter I'm doing the
profiling I might need to disable it
when I create the command cue where's
that
here we go keep profiling
enabled a wrong type okay find
zero is that
shorter doesn't look
shorter
178 78 oh it's a little
shorter it's a little shorter there if I
don't do the
uh if I don't do the
profile
okay and then what's in the object
list let's CP thread control what is
that
number that's
reasonable CP rig to
m
qualcom release this real stuff
somewhere get always on
counter
oh oh that's
cool okay so this
is this is the always on
counter well I don't know actually maybe
not I don't know what that is but
regardless I'm sure this is the
uh the the profiling actually we can
test that by disabling the
profile seeing if those reg to Ms go
away okay the regs are
gone cool well I like them cuz I
understand
them um yeah okay so basically What's
Happening Here is this is a GPU memory
address and it's saving this like
built-in performance
counter uh to the GPU
memory very
cool these are also loading things from
memory all of these 64 Things are
basically pointers and we can dump them
and can look at what the GPU memory
actually has that's GPU memory that's
GPU memory this is loading something
from GPU memory what is this
register nobody
knows they don't have the opencl stuff
very well reversed it seems but either
way they put a two
there do they always put a two
there oh look see these reg to Ms are
different there we put a two
there what's this register doesn't
know this
register oh I'm not looking in the right
driver do you know what this driver is
this
register what you do now
wait you're telling me it was
here
oh interesting look they do have some
debug registers here they do have some
info they don't like tell you much but
it's
something so this is the this is the
Qualcomm driver that's in Linux
Kel
crash
dump you know you could tell me what all
the registers
are oh here are some
registers any good
ones probably not they probably only
give you bad registers like a TP
register why do I care about TP I
don't
but this thing has oh
insten wait what the instro lens only
two whole things only two
instas that is instra line of zero if
you believe
that
Mesa Shader
compute okay looks like it's for a
different
GPU
here launch
grid out packet
seven out
ring what's out
ring
oh it's just like raw
data oh I see okay so that's like one
and then they put the data okay that
makes
sense they have some helper
here what chip is but oh Global offset
is these zeros oh I
see okay so this is global size X Global
offset oh that's cool that you can
offset it see there's another thing
that's in the uh that's in
the yeah okay right so they do have a
lot of this compute stuff worked
out
asn1 like the
uh
the
parser do they call CP run
open
CL this does here but only on
that
interesting where was I looking
I mean it's interesting Mesa is actually
much more Grand in SK scope than what I
want to do I just want to build the
simplest drivers that can dispatch
compute
kernels I don't care about Graphics
Graphics is where gpus become really
complicated but if you're just using
them as computers it's pretty simple
actually okay so that does CP run open
CL that makes a lot of sense what if I
go back to this one
where I'm just copying in some data
that's not open it's still open
CL what data is it using I
wonder
H that also calls R an open
C even though those are just
copies very
interesting
so it's doing
that so how is it mapping that to the
GPU see what I'm saying so this is this
is just doing a copy app right I'm not
doing any um this is just copy out if if
you want to read the code for copy out
it's it's just Sealing readbuffer
uh this synchronize actually
does you see it just prints hello down
here even though I put in noo um but
it's interesting that that's actually
calling
opencl with a program that's being
uploaded early on
so we probably shouldn't actually be
doing any copying in copying out we
should just share the
memory like there's nothing special
about the memory I don't
think well no I mean I guess actually
what's interesting then is how
is how is it being pinned
that might involve looking at the
object so I just allocated some memory
here in
Python I
mean another thing that's really cool
that we can take advantage of with these
GPU drivers is like there's only one
piece of memory on this thing there it's
a unified memory space between the CPU
and the GPU I don't really really know
how that like
works I know when I allocate memory on
the GPU it gives me GPU memory but yet
somehow it looks like it's using a
single opencl
kernel to do that
copy I mean I'd be curious to see what
the code is for the Shader but what I'm
more curious about is how is it mapping
[Music]
it
one it's a binary serialization form
yeah you're
[Music]
right all right should we parse the
object struct I think we understand the
command buffer I think we just have to
understand the object stru like whenever
someone wants to actually do this I
think that's all the stuff you pretty
much
need all right what are in objects let's
find
out
they do not have the same
format very much not
so
list of kgs L command objects okay so we
have there's still kgssl command objects
it's the same thing but unless that's a
packet type six I mean maybe it is I
don't know I don't know what a pack
packet type 6
is or wait what else could that be if
it's not
six let's look at the other packet
types okay we know about packet fours
what's a packet two could it be a packet
two six is yeah it could be a packet
two what a packet twos cuz we know it's
not a
uh packet Z or three maybe it's a packet
two doesn't look like
it it's not a packet
four
that would have to be a four for it to
be a
four want to pack it
too what is this
object
okay command
stream what's the object
stream
[Music]
list of K GSL command objects for
tracking what are
these just don't look like full-fledged
pointers
I don't think I looked into this at all
in uh
[Music]
inne I can
check okay sometime there are kgssl GPU
sync things that are
used that doesn't look like it's
happening no it's just a GPU
command have commands and num objects
here
uh capture it in a cached
command capture the objects here as
black
boxes
no it's definitely not okay it's not
those types of
packets got to be something
else
iova what are these
flags oh here
okay is a command list IB I see so that
just means it's a command list
IB and this is a ob list meem
obge so this is here being submitted
what with
whatever boa
is allocate them I don't
know saw that one
size okay command badge profiling
buffer
what no it can't be
this this isn't
some it's
time why else would it increment like
that and that one would be kind of
random this stupid shit is
time what else increments like
this okay that's great my only problem
is how come this one only has this has
seven shits and this only
has oh so this might even like be in
here wall
clock okay GPU ticks at ring buffer
submission
I would say that it's stale data
but why why is that one there what what
is
that oh that's an
ioctl that sneaks its way in
there course that one's actually already
submitted multi- threaded garbage
no
threats okay so it's a
clock
actually is it this
clock
three three e e 0
E8 take that add hex 28 to it and that
is that up
there there we go and I bet two of them
are going to go away if we comment out
the profiling
thing in fact it went away all
together
okay all right let's parse that with
that stupid
struct and then the rest of it is uh is
glovel is
whatever uh K GSL command badge blah
blah blah blah
blah never at the top it just feels so
unreachable
segmentation
fault oh because it's the GPU
adder
size do even
match don't tell me if can
be oh
oh
what this isn't going to
work
[Music]
I need to go from a memory
view that's not what that does c types
cast we can't just cast it from a void P
we like do some
garbage I do this
in
Ty like a from MV
function from
MV see T types address of two type. from
buffer okay fine I
think I can
do this wait two
type if I do this do from
buffer get m
buffer is not
writable from buffer
copy great great we got stupid times I'm
going grab a bite of poke up be right
back
for
for
[Music]
we got
times h
those are just being written by the
colel I'm
sure oh like one are those flags
again we can know they're like
there
uh
command badge mem list OBS
list memory OBS OBS list
profile okay probably only work this
profile but whatever okay so this still
doesn't answer any of my deeper
questions which
is how does it get from the thing to the
thing
okay we Alec we get a GPU address
here that is great and
wonderful
now where is that
reappear
nowhere what's
a
can I do format struct on
that I think I can I think it's like an
opaque
struct oh contents
maybe I no I still don't think that's
going to
work yeah struck seal M object has no
Fields okay
fine
um that's what I thought was the
program that's a GPU at oh that's a big
number it's kind of annoying that these
things aren't in
HEX should we print them in
HEX yeah we can print them in Hax
[Music]
okay well that's where all the FC's are
we found
them um that's not a GPU
address none of these GPU addresses I
got 496 confused with that doesn't like
match
that that's 40 oh those are 40 I
say I don't know let's go like if it's
greater than 31 print it in
XX so these are GPU
addresses
what's the address of my memory
view can I get the address of a memory
view I get the address of a bite array I
think no I
can't
okay I can
do c types. address of
um
Siege c types.
c
charp c types.
pointer CHR
what just copy this
exactly
all
right this is my
buffer I pass it
there
why where is
it no but seriously where is it
man how does it
no
[Music]
yo it's making another
copy it has to
be
it's making a
copy stupid user space is making a copy
it has to because it has to make a copy
to pin to GPU
memory and then to add insult to injury
it makes a second
copy in open
CL unless this isn't making a copy at
all and it's actually just flushing the
cash
this look like driver development what
do you think driver development looks
like it has to be making another
copy yeah there's no way for it to get
that
object to uh
wow it's actually probably pretty
common think about it like I have some
user space pointer the user space
pointer is not in pinned
memory uh I don't think the colonel can
promise that that won't page
out maybe I can unprotect
it I don't know it's uh it's as
Choice
okay no maybe
that's Malik the biter no that's just a
GPU
Alec
[Music]
uh yeah that's the GPU Alec we do copy
in we do a bunch of dumb
fexes and then we
do the uh GPU command
dioctyl all right um
wow so like let me explain well okay we
don't know what's actually that stupid
it could just be making one
copy it's possible the CPU is making the
copy um we can know this by making it
really big
actually if we cared I don't really care
that
much
um so it's probably I don't know what
it's
running the program is probably
here we can dump it and I have a
disassembler for
this
so question how much of this crap do I
actually have to do we allocate all
these
things does it
matter
um
all right let's go
back this example is kind of boring
let's go back to the tiny grad
example but let's try
something what happens if I add beta
what
changes
it's the
same that's different but that just
might always be
different that M address changes but
only because that M address changes
um I don't actually need to synchronize
it's being called
anyway uh
actually remove that and then get rid of
the debug and see what happens so that
won't syn the GPO okay we're doing two
now to see that how this command
contains two run open
CS so one of these is adding a to B and
one of the is adding B to a what's the
difference and how do I
know maybe it's these load State
frags well no okay there's three inputs
to the
kernel a b and
c so I would expect to see three
things these are the
same I mean it's probably
there see what we can learn about that
guy
oh is this the
Shader why are there two
shaders
shared constants blah blah blah blah
blah blah
blah all right well it's not even in
there new
separate not that for
C it would make too much
sense if
uh
there was one for each
thing I put like two in
there two that's just going in the
program doesn't
do oh I see the knops are for some
parser
thing I swe I got it oh I went back to
the bug Eagles too that's why I didn't
put two shaders in
the I mean it's got to be those load
frags
right just nothing else changes it has
to be whatever's at this
[Music]
poter that's just a GPU memory
address oh maybe like that's the buffers
and that's the
shaders don't know how long something
is but all right we can try a type
seven
um if up subop scope
uh vals to shift shift
32 or vals
one get n I don't know let's get 10 and
dump
it don't
that's identical for both of them and
that looks like
nothing okay I mean they're in the same
thing so it has to be something that
differs between the two
runs there's just not that much that
differ
that's the
same actually it can't be longer than 40
because that's
40 and that doesn't differ it's just a
different
okay you understand what I'm looking for
right
like in this one I do a plus b and in
this one I
do B+
a they have to be
different or some pointer has to be
different
do you guys see a
difference something like where's Waldo
shit that's the same
address those have different addresses
but they're not
different can't be the reg to M
stuff idle indirect buff for
PF set up the sizes and
stuff yeah
what did you show all op codes line 101
what's line
this is in the same command buffer so
there's no time for the uh user space to
change
anything this looks more like just sizes
again
line
101 no that's not an up code that code
more
carefully that's an
ioctl it can't be a different
ioctl again this is the whole this is
the whole Q one of these should be
called with ba and one of them should be
called with AB
they should have actual different
pointers but yet the only thing that's
different is this load
frag and I don't think okay
wait there's a chance I messed that up
because it's too weird that that seems
to be the only only thing that's
different sure seems to match what I
thought
there I mean that kind of has to be the
address too this this has to be
something
else are you talking about this
okay these are all the ioctls that
interfere with the GPU
right if I had that one it complains
about some garbage
right okay the only thing I can
think actually did the top one get
longer I don't really understand what
this top one
is well I doubt
it and what if I comment
out and
ba uh the top one
is 178 longw now I put it back and the
top one is 178 long okay it's not
that um it's not the reg
TOS it's not the
knops that's 0 and 260 that's in both
same knob same weight for Isle same one
there indirect buffer
PFE
same that
line is the same as that line
line that line is the same as that
line driver development in AI is
definitely in Python of
course um there are these two loader
State frags but they're
identical
confirm
that this one is different from this
one
oh oh the length could totally be more
than 40 cuz that's an A and that's a
nine oh
okay it's probably that yeah okay it's
it's here I'm just not dumping
enough yeah okay that makes
sense so
misleading it's actually hex
[Music]
1,040
um don't how I get the length out of
there but it looks like it becomes all
zeros
after one do
okay there's that pointer and there's
that pointer I mean now there's enough
stuff that anything could be this just
looks really complex
now okay here it is this is there's the
three pointers at one at hex
140 so you can see here it's this 00 e0
E40 F0 E4 and then when I switch around
A and B it's the first one's the same
but it's this and that and the output's
the same because it's the same jit
object cool okay we found
you see how misleading that was I
thought that these things were only hex
40 apart but this number changed
two so they're actually a huge distance
apart uh I don't really know how big the
object
is but we probably want to look into
that and figure out what's in that
object because that object seems to
actually describe the whole
thing
cool now we're printing
them see there's a way to tell Hexum
that something's like 140 offset
right
offset it's
wrong next dump gun unexpected keyword
argument
one if I was in
real
restore I didn't know about
that wow so the world depends on this
hex dump
thing but it hasn't been updated in
many
years the project link is
dead
result
so there never was a way to start the
string earlier oh here
Adder I was just hallucinating never was
actually a way to do
this damn I wasen it like lm's you know
you think you're better than an
llm but you're
not
yeah there you go we add D so that has
to start at the first
one okay there never was a way to do
that that was never a real argument I
hallucinated just like
LMS
must play a lot of interesting stuff in
that packet okay so everything's in this
CP load State 6
frag
so you have all this crap which doesn't
really do anything and you don't really
need any of it and then you have CP
State load State 6 frag okay look GPU
drivers can totally be written in Python
um and they should
be um there's no reason that your GPU
driver needs to be
fast for uh oh xxd probably has that I
don't know uh there's no reason that
your GPU driver needs to be fast right
because your GBU driver constructs these
things called command
buffers um what you want to have be fast
like is you construct this command
buffer this is kind of making me
rethink I don't know maybe I don't I
don't
know no it's this is just like data
that's passed into the GPU you don't
even have to copy this you can probably
do this all much more
flexibly like this is probably just
something that's I can probably figure
that out by rever by dumping the
Shader um I have code to dump the Shader
is this going to
work okay let's start by not hooking I
octl I have code to dump the Shader
don't
I uh what if I do like d equal six I'll
dump the
Shader no but it
should did I remove
that
this is tragic I think I just removed
it like metal still has its disassembler
but I just don't think this one
does either way I think I have a
disassembler
um
yeah I used to have code to do this in
tiny gr just bring it back
um if oh because I don't have device
name
anymore uh from disassem
adreno import dis ASM dis
ASM
lib you
work
okay
uh that's probably not
right no see this doesn't work for that
this only works for
uh this doesn't work CU this is the
fancy new
GPU but I bet if we looked we just see
that like those are just raw pointers
being put there why did this ASM break
let's look at this
Asm
it's not
right where's the
Shader Shader come here Shader Shader
Shader
Shader
Shader here Shader Shader
Shader okay so that's the
end so what's the beginning
multiple that what it disassembles is
nothing
what if I do like
6:30 there's a lot more
stuff which is
strange well you know
what
that looks better let's get rid of this
from
here now I have a I have
everything I have a whole sniffer let's
turn my sniffer back on Joe Biden
sniffing
um all right so we never really figured
out where the pointer was it's probably
in
there is
it looks like a
Shader
uh
from this
assemblers do
adrino you wanted a colon oh you a colon
but I won't donate a kidney why would
anyone do that
cool we found a
Shader
Shader okay so that's the dump
Shader
now here's the
ad here's the load
Global from
r0x
yeah but okay so this looks enough like
the previous
assembly right and there's that's the ad
there then we do a bunch of knobs then
we store
it where does that come
from
C20
so these are probably adding
the like this is cuz it's a globals and
locals and some shit
there where does the actual address come
from I don't know why it's trying to
load a float there I think like 51 is
Magic or
something sad sad sr32
sad okay so by the way if you guys want
to see the opencl program you can this
is the open Seal
program it's right
there uh so it does a whole bunch of
math to get so that's where all that
math
is so all that
is these C's must be the globals and
locals
do that
to make
simpler this is not the simplest Shader
I can
imagine but yeah we already had all this
in uh
in tiny guy which is pretty
nice
maybe get some docks on
this
this is all the crap that makes gpus so
complicated oh the squee
firmware oh we can disassemble the squee
firmware with a fuck
disassem
wait
what no way this is going to work I
don't have
rout replaying command
stream
some Nvidia
crap okay but that's cool that's a
Shader that very much looks like a
Shader I'm very happy with that Shader
uh is it B6
long I you
know
as but okay it's not clear exactly how
those
things
yeah
comes from
c21 maybe that maybe those are just the
initial values of
registers
uh
c22 what
I mean maybe it's just like c20s
register what is
C oh that's like
constants constants I met her she's very
nice
so those are just all the
constants that would kind of make sense
right because these are the
uh like the global sizes and stuff I
don't know if they're used let's get rid
of no
locals should use
them okay it's a much longer program
without no locals
uh yeah like c7x is used so maybe those
are just
constants they can be
anything you found
something free Dro
devices no I don't know what you want
from this I do appreciate that you
generally pay attention
though I don't know how this is going to
help this mouse sometime like buffers up
Scrolls it's kind of
annoying
okay um they should pretty much give us
enough to write a uh to Rite a
driver right we're not missing any
pieces we know where those things come
in uh we know how they end up in here
let's actually check something quickly
what
is oh my guess would
be yeah okay so that's
C20 so each one of those is oh yeah hex
14 that's 20 oh okay so 140 is because
it's at C20 so this is literally just
the
constants I don't know how many of them
there are but yeah so when it loads when
it loads C20 doz it's loading this guy
when it loads c21 dox it's loading this
guy and c20x is this guy and you can see
that there perfect and it's very
painfully doing 64-bit math right
there um to load it
into yeah
um
cool
yeah I'm like
[Music]
sad
see immediately I see an optimization
right your GPU is wasting a lot of time
uh doing this 64-bit math when it kind
of doesn't have
to
it's like it's not like this number is
not close right and we could compute
that beforehand
outside to make sure that just 32-bit
math would be
okay but instead we have HR here and we
have
sad y pretty cool
right all right
great the two load State six frags one
of them was the constants and the other
one was the Shader I bet you that's
going to turn out to be a
length it seems
plausible it seem plausible that that
one is
B6 times that not really I don't
know uh we'll have to figure out what
that what that initial there got to be
some talks on
this not in there close that
here okay here we go load State 6 State
[Music]
mask there we go was that
defined it's got to be defined somewhere
supposed to
macro
macros all right where is this
defined where's this
defined it's got to be defined find
[Music]
somewhere no
fd6 cons.
maybe where's this stuff to
find ir3
const struck
[Music]
somewhere
search for this
probably here this ss6 bindless has to
be to find
somewhere in
[Music]
here
oh okay all right so this is this is it
here high is
13 so
that's d off equals
that date
type low is
14 and that's got to be
c0000 not actually we can just do this
and then shift shift
14 stat
Source uh the same thing for that
State block one two three four is
actually wait it's got to be that state
four
is
that block and then num unit bro we got
the unit remember the unit who's the
dumbest Jersey Shore character well
situation friend the
unit
no no no but then there was Dena I Dina
was all right but
like imagine Snookie really did leave
the first day though that would have
been a
tragedy
okay
uh
that's a lot of units 256
units this only has two
units all right what is State type that
seems to be the only interesting one oh
here there's
Shader st6 Shader equals 0 st6 constants
equals 1 okay
okay
um if it's a Shader we disassemble it if
it's constants we dump
it uh
cool State source is
two which is indirect is it always
indirect that makes sense
actually wow wow Vulcan blob with
tessellation
contents um okay num
unit 256 that's a lot of
units what state
Block it's always
13 that def find
somewhere it's not
13 it's a CS shade
oh that's
cool that's cool man
State type is
zero DK off is
zero
num unit is
too is there another unit what's this
other
unit like I totally get how the numb
unit of that is
256 which is really how much we have to
be
dumping all right that's probably
actually well it's only hex 400 that's
not that
crazy um we'll do here we'll do num unit
time
4 it's kind of
crazy oh but that's why there's a limit
on the number of buffers that's
interesting
so how many constants does it have it
must have 64
constants does it I don't
know
adrino
registers no
useless
so like what I want to do eventually is
I want to replace not just
uh I want to replace the Shader
compilers I want to get tiny grab to the
point that it's generating the actual
code for the shaders again this stuff is
Child's Play compared to making chips if
you can't write a universal driver and
Shader compiler right like I kind of
want to be the Mesa but not for graphics
I want to be like the Mesa for
compute um and then like if you're doing
compute it's it's restrictive also on
what compute you can do right my my
shaders are not turn complete shaders my
shaders are limited in that they can
only support tiny gr
operations but what you're trying to
make is you're you're trying to define a
computer right we need new computers to
run these new kinds of uh of
things
oh there's an IR
interesting
ir3 the compiler is responsible the
hardware do not try to hide the
shaders subsequent must have three
intervening
knobs
weak feel like read this before uh where
does it list all the registers here
const um which how many conss are
there God why don't you tell me how many
registers there
are I have to know this here I can just
look
okay I
mean this supports a const and there's
bits
oh wow that's a lot of
consts maybe 12 bits of
conss 496
consts it's a crazy amount of
con
oh but the
con consts are
constant for every run of the Shader so
it's not that many
actually
okay so in reality what we probably do
here is we say that a lot of this
stuff's a crazy pipe dream and we just
do the parts that are needed for thneed
uh which you're just replaying the
command
buffers which is mostly what you need
actually uh for all these sort of
things you want to get it before it
freeze
too like you can never once you hand
things over to thneed you can never use
the driver
again because there's no way to resync
the time stamps as far as I
know
scheduling and stuff oh this is all
going to be fun think we can fit it all
in 5,000 lines
like we have to WR like a like a
scheduling engine like the the reason
these knobs are here is because the Alou
has just has a
pipeline and like this is
used actually no this is pipeline that
should they shouldn't be there those
knops are
stupid knops are really
stupid whatever I'm not the compiler
um
yeah GPU drivers Shader
compilers to the
metal
U also you really don't know ever how
far you are away from the metal right I
have no idea are these things actually
what are they parsed by this could
totally be transpiled into some GPU
micro code somewhere right you have no
idea um but we will finally know so to
come back to to ask your question we're
nearing the end of the stream uh I want
to go listen to copyrighted
music
um we had a nice serious stream tonight
we did
work uh
before I took a bath and I
meditated while I was off
stream and then I came back and I was
calm I was not calm this morning but now
I'm
calm do we have viewers is anyone even
watching
527 uh
so we'll know that we're at the metal
once we tape out our own
chip but until we've eaten up every
single layer to come back to that
question from before we're not ready to
tape out a
chip uh tiny grad's going to Once tiny
grad can run with truly no dependencies
right we still have dependencies right
now um we have a dependency on the user
space of the GPU we have a dependency on
the Shader compiler of the GPU
but we'll get to the point where tiny gr
doesn't depend on those things anymore
we're going to remove numpy too it's
going to be completely pure python
assembling shaders and driving
gpus uh by the way if you're interested
in this kind of stuff I don't think
we're really going to move out of
America uh I was I was angry about that
we might we might seriously do
popups uh we might do popups I think
that people who work at tiny might like
that too it is more of a mobile uh
company than comma but you
know the thing about remote
is you have many people who the first
question they ask is can this job be
remote and if that's your first question
you're not a good
fit um and the reason you're not a good
fit is because it shows that what you
prioritize in life isn't your
job if you end up working remotely
sometimes this is all fine but if your
highest priority isn't the success of
tiny Corp then you shouldn't work at
tiny Corp right um so yeah that's the
bigger problem that I have with actual
remote is those people that's what
upsets me about it um people who are
better about it can talk about it in a
pretty intelligent way and I think the
intelligent take on remote is that the
there is something missing I do think
it's a technical
problem um and I think it can be fixed
and it can be fixed with tooling and
infrastructure but you know companies
should focus on on what they're good
at um removing numpy is actually not a
hard PR at all tiny grad barely relies
on numpy uh we have like one last piece
of abstraction that's still use it
doesn't even do anything like we we can
totally literally the only thing numpy
is really doing for tiny grad is parsing
if you create a tensor from an array
that array is being converted into bytes
by
numpy um it's it's 10 lines of python to
fix
this uh then there's a few other places
where we just happen to use npy for
legacy reasons but tiny gr can be
completely decoupled from numpy tqdm is
of course tqdm is a meme dependency um
it doesn't actually rely on tqdm we do
use it to make a few progress bars but
because tqdm tqdm is tqdm meets the bar
for tiny grad quality code uh we're
happy to include
it
um yeah our trip next spring I don't
know Dubai Singapore
Estonia somewhere nice I don't know I'll
talk with
uh the rest of the company and then
we'll see what we want to
do
um but yeah know I I want to look if
you're interested in this stuff we're
hiring people
kind of across the entire stack for tiny
Corp uh if you like this low-l
stuff
um if you like this lowle
stuff work on the lowle stuff if you
want to work on the hardware side of
things uh we're building the tiny box
right like the hardware Side Hardware
also comes with a certain amount of like
devops and testing um we need we need to
do test plans for the tiny boxes you
know make sure they're all really good
we have to literally deal with the
logistics of shipping a 90 lb box out to
people um you know this is a lot of
stuff that I'm doing uh a few people at
comma are advisers to Tiny Corp um you
know who've been helping
out uh so yeah no it's you know this
comma is contracted to do the Tiny Box
we're we're splitting the profits
basically at least for Tiny Box V1 I
don't want to set up another Hardware
build
chain
um
uh when you say any positions for new
grats
right
again have you read our stuff like have
you read what's on Twitter and have you
read what's about like the bounties and
stuff right have you done anything to
contribute to the
project now if you haven't done anything
to contribute to the project there's two
potential things right there there's
either you just haven't right like
you're capable but you haven't right
there's some amount of people like that
um but then there's people who are not
capable right so are you one or
two right there's people are capable who
haven't uh for various
reasons or yeah are you not capable
right and then I
mean ye oh you're a different person but
the person who set any positions for new
grads
like okay well then why haven't you
contributed
right like this is a job that you want
to do full-time right you want to come
join this
company uh you know
again the salaries are not high the
equity is High
um you know you're joining a startup
right you're joining a startup because
you take
risk uh if you actually look at the best
way this may have changed but this at
least was true 10 years ago the best way
to maximize your true total comp as a
new grad is to jump around from startup
to Startup and spend two years at each
one right you do that you spend you you
work at 10 startups spending two years
at each one and uh early stage startups
early stage startups where you can get
um you know half a percent a percent of
equity uh this turns out to you're being
your own VC basically this this turns
out to maximize uh maximize total comp
um so if you're one if you're capable of
contributing but you haven't ask
yourself and look four years is a long
time but you know really if you come
work at a company you should work there
for two years uh if if you want to come
work at tiny Corp for two years put in a
weekend and contribute to the project
right not just for the Project's sake
right you know you can contribute you
can if you're like I don't want to
contribute to the pro I mean I ask why
you wouldn't want to contribute to the
project but
like I I genuinely don't know if people
like this are trolling me or not
right
um
well
but okay I mean so you you don't have
time but you want a full-time
job yeah
like I I
don't I don't know you know I I was as
angry before I'm trying to be less angry
about this
stuff
um
like I feel like I've actually thought
this
through I I get angry I guess when I see
a lot of the people trolling on Twitter
like you know you don't want to pay
American developer salaries no American
developer wants to work for a company
that won't be
remote like if that's true that's just
so
sad
um
no bounties are going to pay INE Equity
uh even interns don't get
Equity well you say remote is nice but
why right and maybe I haven't thought
this
through um how's Comm doing quite well
actually uh we were profitable this
year probably we'll have to netted out
exactly the bank account went down a
little but our assets
increased um you know last year we were
not very profitable but this year we're
profitable so it's good here for
com
um I mean you know we pay well enough to
live near the
office
no we're not in San Francisco we're in
San Diego though it's not that much
cheaper but it's not it's not like that
expensive like if you're if you're one
person you easily get paid enough to
live
here um no but like
you know something that's kind of sad
about the internet in
general is it's open the floodgates to
and maybe I'm like maybe I'm going about
this wrong right but I I don't like to
be the type of person who uses like a
private Network and connections like
this is against the dream of the
internet for me um when the when the uh
the government guy from Dubai like
publicly replied to me on Twitter that
that's the world I want to live in I
want to live in a world where we have
true transparency and openness
from uh you know like people who run
shit this is this is something else that
Elon does incredibly well um he really
is very
accessible like and as far as I can tell
you know again a little more than you
but not that much but as far as I can
tell tell that's all real that's not an
act and I think a lot of people get
this there is no there is no team of
people putting on Elon Musk right versus
you can go to SAR pai's Twitter and you
know there's a team of people like
everybody knows that like what the hell
is
that yeah remote is nice is more of a
mindset when work is just
work if that's how you feel if work is
not basically your top priority in
life yeah like you shouldn't work at you
know it's not to say that you can do
nothing else with your life um I don't
think that's even particularly good but
if work
isn't a major source of value in your
life yeah like you definitely shouldn't
work at any of my companies either of my
companies
like and also like like what are you
kind of doing you
know
um so very good Dev works on their own
stuff and I I certainly get the appeal
of that um I'm hoping that I can create
something
that
like it's very easy for for me to get
money um and we can build sustainable
businesses versus where a lot of
independent developers like you're not
really going to be able to build it's
hard to build a sustainable business
yourself off of Open
Source um so that's a benefit the other
benefit is
like
I hope and maybe this is my fault but I
hope you see the vision in the
project um I put that first blog post up
about it the one about the AMD
gpus uh I'll bring it
up this goes there this go goes there
this goes
there uh
here uh I put this blog post up
and multiple people reached out and said
this is one of the clearest things
they've read about the about the AI
space
like I really don't put a lot of time
into trying to be
understood
did I manage to capture enough mind
share at AMD no I told that guy you know
I don't talk to that guy anymore I I got
decent people at
AMD um I have people now who I can email
an issue to and they will quickly
reproduce it themselves right how they
choose to triage the issue now we're at
least in a point right like I also feel
that the issues that I've reported to
them the hip compiler is 5X lower than
the opencl compiler I have a way that I
can use multiple threads and reliably
crash the micro engineer those are the
two bugs I reported to
them I mean neither of those bugs are
complet are are they're annoying for me
but they're not breaking my workflow so
I'm not going to put massive amounts of
pressure on them right we haven't had a
chance yet where I've been able to put
massive amounts of pressure on them but
I can I have a pipeline I have people I
can email at AMD be like hey I found
this bug uh you know please just
reproduce it right and add it to your
list and as long as you do that um you
know triage is on you for the most part
I'm not going to scream because it's not
unlike that first bug which was
legitimately breaking my workflow these
are much more minor
so
um what would happen if the commute
included at work increases it to more
than 50% of your free time why do you
live so far away from work
right
there's so much you know if if if you
like the longest commute anyone at comma
has is 20 minutes right even that's kind
of long right there's some cheap places
to live 5 minutes from the office like a
5 minute
drive well it doesn't cost 80% of your
income I know how much you're getting
paid and I know how much the rent costs
right like there there's plenty of
places you can rent around here for like
$2,000 a month I I saw a great one
there's a great one like up the hill I
mean it's a small place but if you're
one person like it's two grand a month
right uh tiny cor full-time salaries are
80 to 120 right so it's it's going to be
like 1 third of your
salary um and then you know if you want
to live well that's to have your own
place too if you live with a roommate
you can do it even cheaper a bunch of
roommates
um full-time salaries are that I mean
intern salaries are pretty much the same
uh interns get paid between 1,400 and
two grand a week uh depending on
experience so you can yeah you can
easily afford to live here it's
not but no I mean I I do hope that
that most people also like think a
little bit longer term
right for
what ends up
happening like I don't know you know
Connor Le he told me this he's like
George you know I don't meet many people
who think like on 30-year time
scales and
it was just strange to
me it was strange to me for two reasons
first I never thought of myself as
someone who thinks I'm 30-year time
scals and I I never thought that the way
I thought was like
different but it seems to be and it's
it's um can you go on a rant you're
you're now banned Buzz Kill Bill
congratulations you know this is the
only way to deal with you're a lobbyist
right and you going to ban lobbyists
do I see AI taking all or most of the
jobs in
programming
um it's not even like
a I think
that
you aren't going to move to coding um
you know again these are these are like
harsh truths so you want to move to
coding what do you do right
now you're looking to switch to coding
what do you do right now what sort of
science
so I mean yeah bio can span a
whole spectrum of different things
um bioinformatics is a lot of sort of
coding
uh
I don't know I don't know what it is for
Bio do they have bio on
there 121
[Music]
um
like you know this is this is one of the
saddest one of the saddest facts that
seems to be true about humanity is
that
like it doesn't
change this stuff doesn't change if
you're if you're 30 your life is is
really whatever it
is I hope everyone kind of knows that no
one talks about
it and you you'll hear about the the
counter example case right and I apply
this to myself all the
time right like kind of what my
limitations
are are limitations that are going to
be probably stuck with me
forever
you know you figure that out
and no it's it's not like my
neuroplasticity isn't What It Wants
was I'm not sure that's even correct I'm
not sure you ever got a choice
Choice
um my friend has a saying you don't
change you just change the perception of
yourself
well trauma can have instantaneous
change for the bad there definitely is
instantaneous
God what are your thoughts on cyers SEC
as a thing for people to go to school to
study versus typical coding or comp
engineering okay hang on I'm really look
I'm in I'm in a good mood
tonight
um and I'll take your question is
genuine
like okay try to
communicate I I don't even like know
where to
start I I don't
even no I'm not I'm not upset I'm really
like trying and again like I I do think
a lot of this stuff that I see out there
is
genuine no but what's the like the
saying like like uh you know you should
be yourself for wait what's the what's
the like like you should follow your
passion but what if your passion is
stupid I don't understand what level of
questions asked that I think I
don't
like
thank you I'm glad you like to don't be
a new
brand I think we've been talking about
this a lot on this
stream if there's
anything that can
like
okay The Singularity is is coming right
let's start there let let me explain to
you how I sort
of came to where I am okay when I was
when I was 14 I I read El yow's EAC
stuff
and it gives you a way
of looking at the world and looking what
hum looking at what humans are I
remember once a a conversation at
Burning Man about what is the like goal
function or loss function of humanity
because there is
one
and like stop thinking about it from the
perspective of
yourself oh it was a good it was a good
conversation right and the these are the
kind of things that they're not
conversations that I would have now but
they're interesting conversations that
have 10 years ago and if you haven't had
these sort of
conversations you should right
particularly if you're if you're that
sort of
age
you
know it's it's confusing to me how
everybody seems to function in the world
with no underlying understanding of what
things
are um to not
understand how electricity works to not
understand how how math Works how how
computers work to not understand how the
world
Works do not understand how
like to be able to separate your
feelings from reality to be able to
separate yourself from the
world um education okay
so
uh education doesn't do what you think
it
does
um read this
book uh Kaplan argues that the primary
function of education is not to enhance
students skills but to certify their
intelligence conscientiousness and
Conformity attributes that are valued by
employers
yeah uh I liked this book another book
to read
um actually I I would read this one
first this one's even
better
uh if if there's one thing that you're
going to go do tonight is read this
book um the main thesis of this book is
that we are very often not aware of our
real reasons for most of our behaviors
our behaviors are optimized for living
in a social group and very often from
the point of view of natural selection
it is useful if we are not consciously
aware of our real
motivations
um
yeah it is
questionable if education sort of does
anything outside of a broader cultural
context um education can definitely do
something like like within within a
society culture determines so
much right you can have two groups of PE
I mean North Korea and South Korea
they're perfect like examples right they
they they they culturally bifurcate
right and if you took a whole group of
North Koreans and a whole group of South
Koreans and each gave them two new
things culture is pretty
persistent you know the South Koreans
would be running new Samsung in 20 years
and the North Koreans would have their
new supreme lead no come on that's
terrible but like my my point is there
are serious differences between groups
of people because of their
cultures no I and I wish there were more
stuff actually like I'm not sure you
have no control and that's the if these
streams are going to provide any actual
value to you instead of
entertainment we should figure that
out um
I at half a scout mindset that talks
about this I think the sefr people were
were looking into
this
um I'm curious if there has
been why do I just feel like the general
discourse on all this stuff has
devolved in the last like five years
too I don't know maybe maybe just Co
made me realize how stupid everyone
actually
was you know I I still can't believe and
I don't forgive some of you for when I
was saying that cloth masks are
completely ineffective at stopping
respiratory diseases everybody knew this
right every single person who thought a
cloth mask did anything to prevent the
spread of respiratory diseases you just
wore a cross around your neck right it's
like you wore a cross around your neck
to ward off demons
it was it was like that level of
stupidity and take
like put think for a minute like as me
and you see this right and and I see a
world of people putting t-shirts over
their
faces to supposedly prevent the spread
of a
virus like this is
tragic
and and this stupidity
was
just like a at a mass
scale I'm not arguing being against
masks I'm not talking anything about
some masks may very well be effective
right even n95s may be effective I think
properly worn p100s are definitely
effective but cloth
masks I I like it's hard for me to get
over it's hard for me to get over
realizing that Society is just
absolutely insane on a grand
scale serer voices don't Prevail at
least not in any
short it's it's
just idiots leading more
idiots in the early days of the the
pandemic we were all scared so masks
seemed like a legit
idea what what are you talking
about I'm not talking about I'm not
making some argument about a mask
mandate versus the individual freedom to
spread a
disease we haven't even gotten to that
level yet what I'm saying is that a
piece of t-shirt over your face does
nothing to prevent the spread of
respiratory diseases and in
2019 every single person understood this
who had ever thought about the topic at
all so I mean religion is an interesting
one right I'm religious and I believe in
God I have found and again this is
probably much more just due
to you know my Social Circle and the
people I interact
with I have found much more resistance
to that belief than the
opposite I have found their real
dogmatism to be in the
atheists to ask how can you possibly
believe in a backwards idea like God are
you kidding me where' the universe come
from they don't have an answer of
course um you know they'll tell you
something about well uh you know there
was a there was a there was a big bang
uh and what that doesn't answer anything
that's not the question I'm asking
that's the wrong
answer no I do have an answer God
created the universe right I'm not sure
I have faith I think it makes the most
sense to
me right I'm not look I I understand
that there can be that we don't really
have evidence and it's a hard thing to
kind of get evidence
about um well I'm not Jewish and
Christian
I'm a Christian I'll even say things
like I believe Jesus died for my sins
and I do to an
extent
um I mean that gets a little more right
like look I'm not going to let
religion
like I If you start seeing evidence that
contradicts any religious thing you
might believe you got to give it up
right like you're just wrong about that
you're wrong about that particular fact
right like I'm not one of those dogmatic
people who thinks that everything in the
Bible is true I think the Bible is it's
a human origin
story now do I believe in the afterlife
well know
50/50 not
sure again I give it a decent chance
that uh the first thing I see when I die
is a game over
screen saying God created the universe
is saying you don't know but with extra
steps I mean that's one way to look at
it
right um how do we end up on religion no
I everyone should read this book
everyone should understand that
like a lot of the things that they
are the things that they believe are
very unexamined let say
that right they haven't really thought
through um which is something I give a
lot of credit to a lot of the sort
of uh like rationality people about they
have thought things through pretty far
and I think the forks of rationality
is well where does each group of people
get
off right where do everybody finally
gets off the things thinking train at
some point right and where does each
group of people get
off
um have I read a book called The
Invisible
rainbow tomorrow and tomorrow and
tomorrow
no are you
kidding are you
kidding
um a date with this girl and uh she
believed this stuff she believed this
stuff about 5G and I'm like
look I'm telling you
like I know what 5G is I understand the
spec for 5G right I I understand like if
some
somebody wants to make these sort of
claims I'm going to ask them what
specifically about 5G they think the
problem is right I'm going to ask them
this how does 5G differ from LTE right
if they can't answer the question how
does 5G 5G differ from LTE in a very
technical
way then they should have no credibility
to speak about this 5G signals are
weaker than 4G generally yes radio in
general has been if if you track radio
over the years radio in general has gone
from incredibly high-powered spark gap
transmitters down to the you don't
understand we're below the noise floor
using 10 mowatt broadcasting 10 megabits
right
um no cloth masks are completely
ineffective at
uh preventing the spread of our
respiratory diseases and like the these
studies that went and came out were so
I'll look at this
one yeah what did they
do uh a threshold based dose curved
response statistical power analysis the
fuck dude here's the study you do
you get 10,000 people you assign them to
two groups the mass group and the no
mass group
right then you look at who contracts the
disease this isn't a perfect study
because it's not double blind obviously
the participant knows if they're wearing
a mask or
not this is not science this is like the
problem is it becomes so easy
to it's so fragile it's so fragile diset
me um right but guys if you just believe
those two links 5G is going to kill us
and don't worry you can wear a surgical
mask and it'll protect
you don't worry just just wear a mask
man tin foil hats man
can I do book streams I've been working
really hard on Tiny grad there's a lot
of work to do there so much to
do yeah I I CO2 I don't like CO2 I have
a CO2 monitor in my office you know I
think that shit's bad for
you
um start a book club I don't
know the hell are you people you know
what mean 10
books all right let's name 10 bucks all
right so we got we got catcher and the
Ry we got slaughter house 5 we have War
and Peace Crime and
Punishment
Lolita uh To Kill a Mocking Bird
uh what else we got what else is kind of
in that classic lit genre oh you can
waste your time and read uh A Tale of
Two Cities or ol ofer twist terrible
books
um if you want to stick with Russians
Davi also wrote Notes From The
Underground uh man I wish I had more
time to read uh you know I love David
Foster Wallace Infinite Jest he did
eventually publish The Pale King but it
wasn't as good it wasn't as tied
together
nicely um you can read the culture
series consider
Fus player of games and I think I have
use of weapons over there I got to start
reading um of course Brave New World
1984 Animal Farm everything you should
have read in high school and actually
paid attention
to um I never read brother caras of
accelerando I read accelerando
St um Clockwork Orange what I'm not this
is I'm sorry I'm sorry that they've
perverted the lit Cannon and you're
going to have to read Bell hooks a
feminist screed but like this is
absolute classic uh this is Western
Cannon
guys Fahrenheit 451 yeah like if you
haven't read read these books you should
read them all Atlas Shrug Fountain Head
Anthem can read all the enrand
I've never had brother car
of get a list of book
recommendations Wealth of Nations what
Adam Smith Thomas piy I don't know I
never read
that uh death of a Death of a Salesman
was a play bro it's good though it's a
good
play uh yeah you can read you can read
Bronze Age mindset modern philosophy
Mike Ma published two books uh
harassment architecture and Gothic
violence
um yeah I don't remember Anthem I
thought and Ran's books continually got
better Al shrug is my
favorite um I never read capital I mean
like marks and
Engles trial of
Socrates I might have read that in
existentialism
um all right you want to you want to do
you want to do other topics good I like
this I'm thinking about different things
I haven't thinking too much about uh
about tiny
grad yeah no romancer snow
crash uh you know Stevenson's
bucks oh those are the only two I read I
don't know if the other ones were any
good
uh what else do I have oh Dune Dune was
good
um gravity's rainbow could never read
it uh I read foundation too mod very
modernist know psycho history like the
concepts didn't didn't grab me um though
actually my favorite Asimov book uh
understanding
physics that in the fan lectures taught
me physics
not debating Destiny Destiny will beat
me this is this is me this is me
surrendering to
Destiny I'm not a good debater he's
genuinely
good
um raid here how many people we
got 41 welcome welcome we're just kind
of shit talking um um I'm I'm GNA get
the uh I'm gonna get the no Destiny's a
good debater we surrender to him already
um I didn't read the new musk yet I read
the old I read Ashley Vance's musk and I
read Isaac Steve
Jobs
um yeah that's the thing like you can be
right and lose cuz debate TCH you can
get Somalia man I'm just I learned I
learned from my two debates that I'm not
very good at
debating
um uh surely you must be joking Mr fan
yes um you want to see the tiny
keyboard it's
small you know we we did all this stuff
on this little phone
[Music]
here and the little keyboard connects to
the little phone oh it makes me so
happy thank you South
Korea you actually going to code on it
try uh QED like Quantum
electrodynamics I tried multiple times
with
that what's behind me on the rack an
early Tiny Box
prototype you guys seen the new ones I I
posted the new ones
Twitter do I only do things I'm good
at I've been working really hard on Tiny
grad for the last like two
months
um do I worry about carpal tunnel
no
uh hey you guys want to come at me with
you guys want to come at me with general
knowledge science let's see how much
science I
know Turing
Cathedral by Dyson the vacuum
guy or the Dyson Sphere guy actually
don't know who came up with the Dyson
Sphere is this the Dyson Sphere
guy I would would imagine why does it
have band
ratings I
say explain monads it's a container for
State how do planes fly Boli's
principal uh no they generate lift
because the air is faster across the
bottom of the wing and slower across the
top so the slower air is lower pressure
air is higher pressure here plane goes
up that's left
right um how does crisper work all right
so crisper is a is a system that was
extracted from some bacteria that does
some DNA insertion thing and you can
like you can put like a restriction
enzyme and tag a certain place and then
crisper will insert some
DNA um do I accept the axium of choice
no CU I'm a finitist if you a finitist
and you don't believe an infinite set
can actually exist then there is no need
for the axing of choice because it is
obviously
true um what is a calent bond a calent
bond the like the naive explanation is
you have like okay so like two oxygens
right so oxygen atoms want to form an
octad on the outside right so oxygen has
two in the inner ring and six on the
outer ring so it'll form a double bond
uh where they'll share two pairs of
electrons and in sharing those two pairs
of electrons they all have completed
octets that's the like high school
chemistry understanding of a calent bond
there is something called like like like
it's called like homo Theory or
something and you can uh it's like
quantum chemistry you can work out what
like the real meaning of a calent bond
is and it's just due to some like low
energy statistical
State um explain the cev scale okay okay
so uh we are not even a uh type one
civilization a type one civilization
uses all the energy available on their
Planet a type two civilization uses all
the energy available from their star and
a type three civilization uses all the
energy available in their Galaxy uh so
as we use more and more energy we'll
need more energy that's available on
Earth more energy that's available from
the Sun and more energy that's available
from our
galaxy
um can I prove P versus NP
no uh explain a word I don't know
explain
viscosity uh okay so viscosity is due
to uh I think it's like at least in
water like water will form a meniscus
because water molecules are
polar uh alcohol is like a nonpolar
molecules so non-polar molecules won't
Vander walls forces something something
something um but I mean viscosity is
just basically because the atoms like to
stick to themselves right it takes time
for them to move so like if you take
like like like Milan's oil drop
experiment right like oil is that
exactly
viscosity oil will continually spread
out while like water won't due to
internal bonding forces in the water um
explain the paully Exclusion Principle
all right you ever been on a bus right
and there's like two seats right so so
it's like that but you don't sit next to
the uh the other person right like you
take the empty seat right everyone knows
that until all the seats at least have
one person and then you can you can
double up um or that might be the poly
Exclusion Principle it might be the one
which says basically like you can't have
two electrons in the same like spin
State because then they are the same
electron uh do I have ASD like a autism
spectrum disorder
no um well the oil drop experiment was
electron charge yes but the point the
reason it was oil is because oil
completely spreads out I think that's
right or maybe you can just get the
smallest possible drop of oil and then
you can measure it by how much it
spreads out um I think that's right
uh how many genders are there I mean
gender Lar L A construct this is
actually true this isn't wokey garbage
uh I mean you can look at like there are
actual sex
chromosomes um most people are either xx
and that's female XY is male um there
are like meta female is xXx I think
kleinfelter syndrome is
xxy uh generally the people who don't
have XX or XY have various health issues
but some of them I think live totally
normal lives
um male female lady boy yeah uh what was
before the Big
Bang um explain electrons in
computation do you want me to like
explain how semiconductors
work what is acetyl choline okay acetyl
choline is a
neurotransmitter um the
neurotransmitters are just like
signaling molecules it seems like
it seems like the brain has two systems
for a lot of this stuff like there's a
there's an electrical system which are
the basic like neurons and stuff uh how
the neurons communicate but then there's
also you can like set these Global
parameters with uh with the
neurotransmitters they're also used for
signaling but I think at a slower speed
than the electrical
stuff um but yeah acetylcholine
traditionally is I don't know like you
just think of the word col enic it's the
easiest way for me to think
about like what acetal choline is is
like you know Vape for Vape for a couple
Vape for a minute straight right like
keep vaping right and like how you feel
at the end of that like that's a cetal
choline I don't know I
mean like like I'm not sure what more of
a definition you want um what is junk
DNA it's DNA that we don't know so I
think only 10% of the DNA codes for uh
codes for proteins right so this's a
strict way to like convert D convert DNA
into into
proteins um like we have a system for
that codons blah blah blah blah blah
what are those things ribosomes or
something
um yeah so the other DNA that doesn't
code for proteins we know less about the
purpose of it it's we're not sure it's
junk it could be uh I don't I don't know
I think they've done like have they done
knockout mice without it and they're
okay
um explain log n well it's like you
know uh okay so like 1 10 100 0 1 2
right like it's like the number zeros
right that's what the log is it's just
count the number zeros right that's a
log base 10 but you can put something in
base two still count the number zero
count the number of count the number of
digits basically log is just count the
number of
digits um
um how does charge pass across gaps in
the milein sheath of
neurons
uh I don't so okay
neurons as you mature I think that this
is the difference between white matter
and gray matter I forget which one is
actually
melanized but
the uh when you say how does it pass
through right like like you can think of
a capacitor right you can think of
charge on both sides of a capacitor if I
put charge here right it doesn't
actually P like an AC signal will pass
through a capacitor fine right if I have
a high frequency signal it'll totally
just pass through a capacitor flly I
think maybe it's does a capacitor shift
the phase of a
signal I feel like it does right because
you're you're you're like just does a
capacitor shift the phase of a signal
180° right CU you're like shoving
electrons up here right up to your Di
electric right and then it's going to
repel electrons
here no that doesn't have to shift the
phase right it's just straight up like
electrons come here and they go
there first time chat do you actually
know this
uh white matter is mated that sounds
right how do we calculate the total
computation of a human brain uh so I
mean I like the very naive one the truth
is we really don't know but I like the
very naive one of you know you have 100
trillion neurons running at 200 Hertz so
that gives you 20 pflops right that's
like not real the brain runs much more
sparsely than that but I don't know I
just like the number right like it's
just a unit 20 P flops how did they
measure the horse right like like like
what about Joe's horse his horse is a
lot stronger his horse is at least three
horsepower like you
know
um will we ever use more percent of our
brain I I think you don't understand and
what you're talking
about um how do you create a wormhole is
there is this you want to like you want
a Star Trek answer well you have to
obviously use the deflector and emit a
polaron burst right but you you have to
make sure that you have tach on from the
time ship in the 29th
Century I like this I'm thinking about
different things are people liking
science
is it practically possible to create one
yeah just just invert the deflector
polarity to emit tacons you're good
actually there's a definition of attach
on are it's kind of cool if you take
particles right like like like if you
take the um uh what's the equation it's
like well eal mc² but that's not exactly
true because particles have momentum so
I think you divide by the < TK of 1 -
v^2 over c^ s you could imagine a
particle with uh imaginary Mass right
you can imagine if if V was higher than
C you'd get a square root of a negative
number which would give you an i in the
denominator so you need you need an i in
the uh in the numerator but you could
imagine how that particle would behave
and actually it would take it would be
going infinitely fast and it would take
more and more energy to bring it closer
to the speed of light from the other
side
um just chernikov radiation prove the
existence of tachon I don't think so I
think chernikov radiation is the one
where it's when you have particles that
are moving faster than the local speed
of light uh in whatever like like fluid
you're in or whatever right like so the
speed of light in air is less than the
speed of light in vacuum uh the speed of
light in water is even lower that's why
you get refraction uh you know you can
work this out um like this is why water
refracts light uh due to the change in
speed of light uh
so turnic radiation I think is like it's
it's just when you have particles going
faster than the medium speed of
light explain time dilation near a
massive object I don't know man just
like it's watch inter Stellar
um uh no okay
so uh time dilation
occurs there's a reason for this I
actually don't know I'd have to think
about it more so you're definitely going
to get time dilation as you go closer to
the speed of light right and you can see
why this is because you could imagine
like a two mirrors and a pingpong ball
going back and forth but as you approach
the speed of light time like stretches
out
um I have to think about like how this
affects the Observer and stuff it has
been a long time since I've thought
about that so I mean it might just be
like that same
effect just like one of your mirrors is
gravity I don't
know
um oh explain the difference between an
RS flip flop and a JK flip flop all
right let's go so an RS flipflop the
rssr stands for reset and
set
um I believe a JK flipflop is just like
a latch
wow I haven't thought about that in a
long time rs's have reset and sets I
used to try to build flipflops out of
transistors and stuff that one is the
first one I'm going to look up because
I'm pretty sure a JK flipflop is just
like a
latch
um yeah with the addition of
a
oh okay so it's the same thing but they
added so you still need a
uh you still need a separate J and K
line Oh I thought it was more like just
like a latch and you just like like when
the thing triggers you you you let it in
maybe that's how these things are
usually
used
um
cool explain the tension mechanism in
Transformers
um oh this is I come on that's like real
that's like real I I like the flip-flop
one I haven't thought about that one in
years you know that's the joke like if
you ask 13-year-old me he would have had
the perfect
answer
um why I said Facebook was the good guys
no come on science we done with
[Music]
science
why don't we know the truth value of S
and R are both one stop breaking my
flip-flop bro stop breaking my
flipflop um I don't talk about neural
networks great
filter the one where it's like aliens
blow themselves up like we will or
something what's the relative minor of
the key of
C
uh so are you talking about a minor
right so if you're playing like a c
chord you're you're playing c e and G
and then you can go down to like a minor
and that's in there but E minor is also
in the C uh major scale but I would say
it's a minor but I would also accept E
minor Maybe
um explain the difference between type
one and type two Supernova all I don't
know this uh well all right let's let's
try to think this through what is a
supernova uh
Stars sometimes go supernova they
release an immense amount of energy I
think a supernova happens okay so like
you have a star in its final like State
sometime it becomes so massive that it
becomes a black
hole but sometimes it
doesn't right and then like all the
fusion happens at once and that's how
you get a
supernova I think that's right um the
Dark Forest hypothesis I I tried to read
three body problem but couldn't see
through the Chinese
propaganda um I tried to read raw
Quantum I tried to read this book but I
couldn't see through the rationalist
propaganda
um where is have three body problem why
do I have three body
problem uh so I do know something about
there was a blog post about like the
ethereum Dark
Forest um that it was kind of cool
Oppenheimer was too long was an hour too
long it's a good movie
though by what mechanism does a guer
counter
function I think it's um what they have
like like Photo multiplier tube I think
it's the same sort of trick I think that
like you have something that's like in a
somewhat unstable State and when a
radioactive particle hits it it hits two
it hits four it hits eight and that's
why you hear the click I think it's like
a radioactive form of a photo multiplier
tube um have I read David Deutsch no I
haven't but this book's on my bookshelf
is it good I have not read it um gravity
effects propagated the speed of light I
think so
um would be the relative size of the
Milky Way galaxy if the sun were the
size of a red blood cell oh God okay um
so red blood cells
are visible under light microscopes I
think so let's put them at let's put
them at one micrometer I don't really
know um Okay now what's the diameter of
the
sun
right uh okay so one micrometer so
that's going to
[Music]
be micro is 10 1 E minus 6 right um so
if the I really don't know how big the
sun is uh the Earth is maybe order of
magnitude
10,000 kilometers in
diameter the sun is
[Music]
maybe I don't know I'm just kind of
going off of like crude solar system
models I have no idea if they're
accurate but the sun is maybe something
like 100x bigger so let's say a million
right so let's say that's that's 10 to
the 12
difference uh so the Milky Way galaxy is
70,000 light years across thank you Star
Trek Voyager um so 70,000 is something
like 10 the 5 so we have 10 eus 7 light
years um okay let's knock the years off
of
that uh
525,600 minutes so that's like we're
talking something like like a light
second so the Milky Way galaxy would be
a about the distance from
like the moon's 2 seconds I think it be
like here to the
Moon order magnitude 10,000 I told you
that's come on that's really
good uh is that right like that sounds
about right right like like the Milky
Way it be like this distance from the
Earth to the Moon if if if the Sun or a
red blood
cell probably off too many orders of
magnitude explain quantum mechanics you
can just say explain quantum mechanics
what do you want to know why do power
companies transmit power at extremely
high voltages
because the size of the wire you need
depends on the
current right um the the losses depend
on the uh on the current right uh so
yeah if if you want a wire to carry more
current you bigger wire um think about
it my naive thing that I like to think
about is like like a river right and the
current is if you take a cross-section
of a river right the current is the uh
the size of that cross-section right and
the voltage is the speed of the water
right so if you want to get more water
through the river you can do one or two
things you can either make the river
bigger or you can uh make the water go
faster uh the faster you can make the
water go the smaller River you need and
we get to save money on buying
copper um the Milky Way galaxy would be
the size of the continental
US not too far
off
if that's even true is it possible to
create a black hole that has the density
of Earth's
atmosphere I feel like this is one of
them stupid trick questions we like well
yes blah blah blah blah
blah
um but actually no I'm going to just say
no but it is possible to create a black
hole that has the same weight as the sun
it just has to be a lot
smaller
all
right what scientists wrote a book about
the impossibility you can waste your
time reading emperor's new mind Roger
Penrose if you
want
um do I think there are three timelines
coexisting explain polarization okay so
in the
1950s um most Congress people used to
cross over the aisle but as time's gone
on the two Congress people have become
more and more on the extremes to the
point that you have very few people who
will vote either way and that's
polarization um wait it'll be 3x the
Earth to the Moon distance yo if that's
true I just did the sickest spy
calculation if that's actually true dude
I crushed it 3x
off and I used Star Trek Voyager for the
size of the Galaxy come
on your physics textbook taught you
wrong then what's polarization in in in
electromechanics um
I mean I guess so like you can certainly
have atoms that have a charge right so
atoms usually have the same number of
protons and
electrons but you can rip electrons
off and create
ions uh I think it might be possible to
shove more electrons on I'm not sure you
can do that actually I'm not sure that
works um well it must though because
sometime things can have a positive
charge right sometimes things have a
negative charge no that's not usually
true ions have a positive
charge I'm trying to think like are
there things with a negative I mean I
can definitely make ions by ripping
electrons
off um how good am I in physics again
you got to just give me questions right
uh Einstein won the Nobel Prize for
special relativity or general relativity
or you know just just a paper about
improving the efficiency of the patent
office
um catons have a positive charge oh yeah
this sounds
right no
no oh catons cathode
H all do are there ions with a negative
charge no I think ion means positively
charged oh with a net electrical charge
no I guess it can be
either okay cations and anion okay no no
no it can be
both um wow I didn't know you could do
that H minus you can shove two electrons
on
one
interesting
yeah I mean I've always seen I've
definitely seen that notation
before I mean I
guess how do I make
annion yeah I guess it's just kind of
stupid to think that they don't
exist hydrogen anion okay well hydrogen
anion is just like a
proton
[Music]
wait oh I guess no wait a second yeah
yeah no cuz you have like ass salt right
and ass salt is going to want to like I
have a chlorine right and a chlorine is
going to want that extra electron so
that actually becomes an annion right
cuz that's CL minus and na+ right it's
na+ if it gives it up because okay sorry
I'm I'm wow okay
okay um yeah yeah yeah so so you have an
ionic bond and an ionic bond isn't
exactly really a bond uh but you will
like like the sodium uh which is over
here uh on the periodic table sodium is
a
uh shit there's
uh this and then Earth Alkali it's a
Alkali it's it's here okay yeah yeah
yeah so so sodium basically will give up
an electron become positively charged to
chlorine which then becomes negatively
charged completing the
octets physics is an MRI use
it's like some trick where if you
expose hydrogen to a high magnetic field
you can like measure the concentration
of hydrogens when they Decay spin
something
um uh imagine a rod made of steel which
is three y light years long free in
space what will happen to the other side
of the rod if you pull from one
side uh I mean
the constant
velocity uh so it's going to
stretch right I mean again like steel is
not even like like I've heard this with
like a like a perfectly uniform Rod but
steel is going to have some amount of
elasticity to it obviously that nothing
can propagate faster than the speed of
light um but once you get it up once
everything's accelerated to that
velocity it'll go back to its length if
it's accelerating it'll always be
slightly
uh dilated but I guess where does the
force come from oh I guess you're pull
okay you're pulling on one side so
you're applying the force at the end
right the truth is your Rod will
definitely break pretty much no matter
how thick it is I think because there's
no way that like
the force like builds up I I don't
know but if it's stretching what is that
Force coming from it's like
inertia like it's kind of you got to get
it's inertia right everything's got
inertia even in
space uh what does it mean for the
universe to be nonlocally
real
um I think that this isn't true in most
interpretations of quantum mechanics but
I think the idea basically says that
like no there's there's a whole bunch of
theorems about this that go into
like
um nonlocality doesn't imply faster than
light information
transformation
uh
P electricity you stretch metal you get
electricity from that I think that's
right I think it's
like I don't know I always think of the
pzo transducer you
know um oh Ein would know what the photo
electric effect I actually did know that
I did know that
um the Coriolis effect that's why water
spins backwards in Australia or
something I saw that on Bill n
crystals man who is the winner of Jersey
Shore you can't win Jersey Shore you can
only go to jail for tax evasion all
right on that note thank you everybody
uh I don't think I'm going to stream
tomorrow you got two streams today we
wrote some part of a GPU driver I talk
to you more about the difficulties of of
of hiring and just what I don't know
just like it's like bleak a lot of this
AI stuff's just so Bleak it's GNA it's
going to really
draw it's going to really draw out the
absolute truth of human nature and I
don't think we are ready to hear it
um I don't think that
you we're we're about to summon Untold
power and it's going to reveal the truth
about our nature I don't know man but
then again like people used to like live
in Hots and D Wars so I don't know maybe
our struggle is not that bad all right
good night
everybody
off microphone's on now
much better
all right my camera keeps glitching I
don't know what to say
we have light now you know because I
don't like looking like I don't you know
like have light
everything's like pulsing
or maybe I'm just fucked up on drugs yes
all right chat pop out
all right we got some people GM GM good
good it's a good time for Europeans or
something all right so we're writing
documentation for tiny grad I wrote some
documentation already
uh when I was at the coffee shop and now
uh I will show it to you
so this is abstractions.pi and I kind of
want to make it uh
I kind of want to make it like look at a
way of comments it's it's really nice
actually
uh I saw I think it was uh
Triton GitHub Triton had some like
notebook
uh kind of documentation
that I thought was cool
yeah what is this rst what is rst
rst
structured text
that's beautiful
Triton has beautiful documentation this
is not this is attached
um
getting started
Orioles
pictures programming guide python API
how do I make these like run as a
notebook
uh is there any debt in tiny grad no
I've aggressively refactored tiny grad
um so we can go
uh there's there's a few minor things
which I noted
but it's it's really mostly uh this many
lines of pure joy except for a few
things that need to be changed
you can do that doing markdown you don't
need rst no but none of these are what I
want
there's one that's like there's like a
notebook I hear
it's like this style
what does this percent mean
because they're like a way to like run
this cell if I use that syntax
talking to the tiny grad documentation
this file will take
take you on and this is actually going
to be a great stream to learn how one of
these things works because pytorch has a
lot of similar stuff
um
[Music]
have I tried TLA
no it's not like
spy will take you on a whirl
wind Journey
from
uh tensor to a bite
foreign
has been aggressively
refactored how old is Tiny grad
git log but not more
pipe it to like uh t
here we go start timing that wow
wow so it's been almost three years
we've had two and a half years
it's been worked on
what you see
here
is a very
refined
more defining
go still
it's
okay and your garage is
10 mile
it's readable
in
the evening or two
kiss
this tutorial
mutation will help you
with
entry points all right so this is the
closest I'm going to come to
legitimately teaching you programming do
you guys remember my troll Python
tutorial with the bubble sort
um okay
so if I put this here ah yes it works
okay
um
boilerplate
which of these do I actually need
that
okay
all right so what we're going to do is
we're going to do two plus three have
all the abstraction layers of tiny graph
how do I like end these is there a way
to end the
okay
we're on cell
wait
how come I only got that
I want this all to run clear all
right only that one
no I think it all ran actually okay
two point two plus three as tensor
wait what interrupt
mods ban this guy got him
you tell him get him I got him
um
okay first
we will be using the clang back end
first as a tensor
so we just do tensor two
get from
tinygrad.tenser import tensor
uh tensor two
plus tensor
three results
okay
um
[Music]
you see quook are the reason we're going
to subscriber only congratulations
uh
types
hlr player
I don't really have good names for these
things okay but um
uh we're also gonna set uh
tinygrad Dot
lazy important device
device that default equals clang
okay run cell
five
okay
great
uh okay so now a a lot of stuff happened
to make that two plus three equals five
and I hope you all appreciate it
okay
um so these are the types of tensor
um
we don't need this this is a very
interesting like way of doing things
okay
uh so
wow
I realize that I'm not that good at
explaining this stuff like I wrote this
all in the coffee shop
um
okay
thank you for subscribing and it's off
topic as fuck do you think I want to
talk about fucking Twitter
uh you didn't realize man you didn't
realize by the way my accountants they
agreed to give me my money back but only
if I sign a confidentiality agreement
and a non-disparagement clause and you
know what I say to that fuck no you
can't buy my silence get ready for court
bitches
um I haven't named their their names yet
um but uh yeah get ready for court
bitches
uh yeah no seriously you gotta you gotta
have integrity in life my parents taught
me that
um Court gang
uh uh okay
that's off topic how are you guys
getting off topic shit okay
these are boilerplate Imports to make
types work
see but it
did
um
[Music]
this one shouldn't be a cell okay how do
I do these uh how do I do these
annotations
vs code python annotations percent
percent
no like how do I make it like a notebook
does anyone have docs on these things
[Music]
no okay so this is how I create a
markdown cell that's what it's called
okay vs Studio python annotations create
markdown cell I want to create like a
text one that can't be run
you can Define Jupiter code cells uh
pretty cool
you guys can't say vs code yet because
you abused your privilege you know
is there anything else besides percent
but can I end percent that's what I'm
mostly interested in
okay cool
okay
percent
comment comment does that do something
no I'm happy with this I'm happy with
this this is fine okay
this file will take you on a Whirlpool
Journey from a tensor to a bite tiny
grad has been aggressively refactored in
the 2.5 years it's been worked on what
you see
what you see here is a refined Library
with more refining to go stale the whole
tiny grad is well it's readable this
documentation will help with entry
points and understanding
about abstractions
all right are you guys going to pay
attention or or is this like I don't
know
I need everyone focused and paying
attention
um
okay
does everyone understand this example
all right so this class is a tensor
class
tensors have grads requires grad
um
they have another property called lazy
data
okay all the definitions of derivatives
uh our superclasses of class called
function
I'm going to find down here
um actually I should probably include
what function actually is
most interesting part of this is uh
forward
and uh backward
so most forwards and backwards are
something like X crazy buffer the lazy
buffer
and backwards are similar
types of forward
so this is where we implemented the
derivatives in tiny grad
um if we go here to ml Ops you'll see
that these are the derivatives right so
the derivatives operate on lazy buffers
which are now typed
um you can see like okay here's log and
the derivative of log is uh
uh
the grad output divided by the input
X is similar but it's the multiply you
see the derivative of reduce Ops sum is
expand right you can see why that's kind
of true uh derivative of Max is
complicated the derivative of uh
addition is just the gradient
this is these are the derivatives in
tiny grad
um
worth
reading that file
how many ml outside there one two three
four five six seven eight nine ten
eleven twelve thirteen fourteen fifteen
sixteen Seventeen eighteen
only eighteen
MLS
and I believe this also tracks the uh
the gradients okay
foreign
it runs
forward and also tracks the contact
so does this make sense
like here's a
it's worth reading
for
our derivatives
for everything
ton
of Ops are
high level Ops
show Ops
are uh
defined
but they are extremely straightforward
extremely
I will have like one in as an example
like relu I think relieve is pretty easy
methods
are defined
okay
so you ask you ask uh well we're not at
Lazy buffer yet we gotta go slow we're
still a tensor guys so you ask a tensor
okay here we are at tensor we have a
high level Opera
relu calls Maxim
maximum calls broadcasted broadcasted
gets passed in ml Ops maximum
maybe it's better to show an HL op that
actually resolves
um
to an ml app like this one
I can put an import here can I
can't
Vlog is uh
hlr
but it calls
log is an ml app
the wrapper function
we won't use this pedantically small
style okay
[Music]
all right this is the good old-familiar
tensor class these two are pretty
straightforward this is the graph for
the autograd engine this is where the
data and the other property is actually
left
um
let's just put this one in whatever
plate shit
it's not that interesting
I think that's better so this kind of
shows off the tensor class okay so each
tensor has a gradient requires grad
contacts lazy data a high level off and
a lot
okay all of the definitions of the
derivatives are super classes of
function
like ml Ops DOT log
it's not that interesting we'll leave
that one out
okay
so then we have lazy buffer
okay
can
be accessed
[Music]
uh through tensor
okay now whatever you do you guys
understand it's in a pip package but do
you really need a pit package you can
just install it from the uh
you want pip just do this if that's too
hard for you don't understand any bad
I mean you can also pip install Tiny
grad actually it should work I do push
it
okay
um
example
cool
okay so this is where the properties
live that you thought were a part of
tensor these three Define the type of a
buffer and they are proxied through
uh and they are
doing proxied through is that like not
the right word like I'll show you what I
mean by that it's like this they're like
properties
return
as tensor properties all right and they
return to tensor properties okay so we
have a device
a shape and a detox
um
It's a lazy buffer is unrealized it has
a lazy op if the lazy buffer is realized
it has a device buffer we will come back
to device buffers later first we explore
the lazy op
uh
so now let's make an example
before we get back to device buffer
okay
example
lazy
alpha or two plus three
why don't I talk about where device
buffer was defined we'll get to device
map for later
what does it mean to be realized okay
I'll show you what it means to be
realized
reapplied I don't know what that means
uh
I'm gonna give device buffer a 4 out of
10.
you can
differentiate
the world using
a chain rule
okay lazy buffer this is where the
properties live that you thought were a
part of tensor
um let me move this here
okay example lazy buffer for two plus
three that's right first we'll just
create our two tensors again
we should say
I should clean up this example a little
bit
so let's copy
this example
these are tensors they're both going to
have lazy day
I don't actually need AMD it might just
it might just confuse things forever
let's look at the lazy data of result
okay hopefully now things get get
interesting
so we do result.lazydata
and
you'll see
that it has op type
at
sir result lazydata dot op.op equals
binaryops.ed
foreign
see
it has
type
lazy buffer
now this is kind of stupid
um
see it has
uh lazy op
control dot lazy data
you'll see that it has a lady Lazy op
type is
binaryops.net
uh there's a lazy uh
two sources so if I do insert lazy op
dot source
we've got two and the three
from the CPU
I plant lazy op.0
uh you'll see that it's a load up from
CPU
[Music]
so lazy buffer
the source is a lazy buffer since
I'm CPU
cannot be
folded into
as to use
lazy op.source of 0. equals load Ops
for you
ARG of the from CPU
lazy op is
not two
it has no sources on it
now
the realize
the result
we can actually realize the lazy buffer
no
easy bumper is not realized
yet
uh result lazy data uh
realize equals none
actually use this comment here
[Music]
from lazy buffer is realized
[Music]
nicely
to
ice buffer
[Music]
which
playing
is Tiny grout accessible at all
[Music]
foreign
class super class the right word
okay
so this explains lazy buffer if the lazy
buffer is unrealized it has a lazy op
lazy op describes the computation you
need to realize the lazy buffer
I think the lazy buffers realize it has
a device buffer we will come back to
device buffers later first we'll explore
the lazy app
lazy eye it's an AST node
defines the type of the compute the
source is an optional static argument
easy buffer is like a tensor without
derivatives
at the mlr player if that makes sense
does everyone kind of understand like
that like this is an HL op and this is
an ml op
foreign
viewers we got does anybody understand
any of this
288 and we do it for the YouTube man
maybe someone on YouTube will get it
stuff is I've been thinking about this
for two and a half years look I hope
tiny grad is like
it's something I really waffle on
some days I think
if I just keep working on this for
another year I'm gonna Crush everybody
and some days I think nobody cares about
this bullshit
um
well hlabs are like made up of ml Ops
and ml Ops have derivatives
like it's really worth reading the ml
app so it's like you only need
derivatives for these 18 things and that
gets you the derivative of
everything
like it gets you the derivative of like
comms and get items and slices like this
is a conf
this is a conv implemented in terms of
ml Ops
right and like tiny grad's not that slow
I did this all like
the problem comes down with like pie
torch and tensorflow and xla and all
their things you need to implement
hundreds of Ops and they're extremely
complex and there's no way that anyone
knew was going to break into the
accelerator Market
so you're going to be stuck with Nvidia
forever because people wrote Cuda code
um
for inference of big enough models
you're gonna get it's really cool with
the guy Dead with like the four bit
llamas and stuff like if you are
actually going to run live on your
computer I would totally use his repo
and not tiny grad but the idea of tiny
grad is you should be able to write
things in a very easy style and then it
should compile and be and use 100 of
your Hardware
it's implementing new Ops really is the
bottleneck for making accelerators it
really is well it's not implementing new
Ops it's getting decent torch support or
tensorflow support right you need you
need decent torch support because no
one's going to use your crappy like
these other libraries are so crappy like
snpe qualcomms one
uh they're just so much crappier
um
I think a lot of people get wrong where
like why things are slow too
like tiny grad there's nothing about
tiny grad that can't be fully utilizing
your Hardware even though it has zero
dependencies
um
yeah so these are the HL Ops you see I
implemented all of the activation
functions this is it's really worth
reading
[Music]
let's talk about SUV I hate all of you
do not hate all you man
yeah I don't know why yeah
princess kind of useless
foreign
hopefully this is readable
lazy op from CPU no Source the ARG is uh
an Umpire
so why can't from CPU be folded into
asts because you have to like okay if
you're going to add two tensors together
you have to uh first copy the tensors to
the GPU right
so from CPU you're not gonna like like
there's no an AST is a GPU kernel
actually maybe I should make that more
clear
um but
kind of not like there yet
they form an abstract syntax tree
for
for a single
they they do they form an abstract
Centric tree for a single GPU kernel so
where do I say you can't fold your
copy the tensors onto
okay
now we realize a lazy buffer
uh
yeah that makes more sense yeah another
thing like there's an example in tiny
grad like that's going to kind of go a
completely different direction that kind
of just showcases the power of all of
this
so this example right here
so this just multiplied
a uh
one or two four by one or two four
Matrix at three teraflops and look at
the style that it's written in
reshape permute multiply and then sum
that's all fused into a single current
right this is so this basically becomes
one AST
uh thank you for asking the question if
people have good questions I would
really appreciate them okay
um device buffer is an abstract class to
be implemented for each back end
uh these two are straightforward
unlike
lazy buffer there's
no need for device since that's
contained in the concrete type
uh so you see lazy buffer has three
device shape and D type a device buffer
has shape and d-type
um device buffers come in two flavors
interpreted buffer and compile buffer oh
yeah well okay this is the magic method
that fills the device buffer and does
all the math in tiny grad
uh this is actually not true from CPU is
in here but don't get confused by that
so we have two CPU
um
getting
ahead of
five
assert
result.lazydata.realize.2cpu sub zero
equals five
just make sure that example actually
works
cool
copy the device buffer to CPU
foreign
so this is device buffer device buffer
is an abstract class to be implemented
for each device backend
what is subclass and superclass I don't
really know what that means
derived class
subclass extends parent
oh you're right yeah yeah what is a
superclass
wow shows you how much I know
super is like parent
okay so it's a sub class that kind of
makes more sense
can I just use that anywhere else
okay cool
thank you
that's why you're here to write this
documentation with me
this is device buffer
um okay
so we have interpreted buffers too
interpreted buffers are
you might want to go if you're trying to
follow along with this tutorial you
might want to go look into what an
interpreted buffer is and retry this but
instead of setting the default device to
Clan set the default device to CPU
uh and you can try this you can you can
try this tutorial and um I mean this
will all be pushed so you'll be able to
see it when the the vods live on YouTube
I don't know what a bod is either I just
like say a lot of words that you know
one of my favorite examples of this is
comex in the jailbreak days I called the
app that like downloaded Cydia freeze
and like the word for that is maybe like
bootstrap but he just thought it was
called a freeze and I thought that was
really cool uh you know it's just funny
like like it's one shot learning man
um okay
yeah ml Ops is the only thing in tiny
grad I would give a nine out of ten it's
super beautiful
um
okay
so lazy buffer is pretty mediocre
there's all this code and lazy buffer
that does like rearranging and putting
the things into into kernels
worry too much about that I don't know
um device buffers come in two flavors
interpreted buffer and compile buffer
interpreted buffers are a lot simpler
than compiled buffers and are used to
implement the CPU numpy
they are used to implement the CPU and
torch back ends
uh so
it's worth reading uh
tiny grad slash
and Tiny grab
slash runtime slash op CPU code seven
out of 10.
where's op CPU
I'm gonna give a set of my time it's
pretty good
I'll give an a out of town it's actually
the same as like I would say it's the
same
let's say it seems like tensor it's
pretty good
so this defines all like the Ops
they're pretty nice
foreign
[Music]
if you read one file
so if you read one file read mlops
if you read two files also read tensor
you can differentiate the world using
the chain rule
thank you
all right
lazy buffer
um
example lazy buffer for two plus three
uh yeah someone should add inops support
I know it's gonna be really easy to add
so I know it should be an example of HL
Ops you wouldn't even have to touch any
derivative stuff
um it'll all just play Super nicely with
the tensor but I guess it does with pi
torch and don't buying stuff too so
when you do like the multiply stuff
it'll Auto fuse into great kernels
okay device buffer is an abstract class
we have a huge device backend blah blah
these two this is a magic method that
fills the device buffer and does all the
math in tiny grab
yeah okay so kernel Fusion yeah
most of lazy dot pi
[Music]
concerned
with fusing
Ops
into
lazy op asts
that map to GPU files
a bit
beyond the scope
of this
tutorial
read the file if interested
I'll show you the file
so this is this is lazy.pi lazy dot pie
like uh it fuses stuff together
uh like here push from you it's before
redo some permutes are actually reshaves
move permutes before expands move from
usable reshapes if we can this actually
creates a lazy buffer
it's not that long
um
get rid of my weasel words okay
example lazy buffer for two plus day
however all the magical CPU will come
from compile buffers uh this is used for
the GPU
Cuda metal clang an lvm back ends okay
um this is where the data actually lives
raw buffer is just raw typed memory on
the device in question
uh
completeness we included raw buffer raw
buffer is the simplest version
example uh two plus three in raw clang
foreign
above
uh by hand
we need the lazy buff asts to be
automatic okay
um
okay example two plus three and we're
all clang so let's
from that that's not even exciting
okay uh two plus three and well clang uh
raw Malik buffer is the simplest
concrete version of
uh raw buffer it's used for cleaning LVN
back ends it's just not like blah blah
uh clang program is the simplest version
is the simplest uh
run China what is that called it's
called a runtime
let's give it let's see what we should
give it should we give it a six out of
ten
we'll give it a 7 out of 10. it's very
readable it's very simple
first we create two non-pipe offers
containing two and three then we copy
the numpy in to Raw Malik buffers last
we create an empty output buffer we
compile this program we run it and two
plus two
does the lazy buffer AST produce C code
for clan yes oh do you want that as an
example
oh yeah well we'll do an example here
we can we can do that
because I think that's what you want
example uh two plus two Auto generated
plan code you want to see the plan code
all right so we gotta just go and get
the tensor
um
uh global
cash
used by the jet
this is another way to get this
I think what the nicest way to get this
is
I think there's really a nice way
from there
to take
um trying to grab.helper
12 volt counters
cash
this enables
the cash
creates the program
runs
there's one
there's one AST runner in the cache
here's the AST Runner
um
no it's not Bitcoin it actually produces
C
there you go
like
oh now pays the ASM the clang producers
who cares
that's all what do you think even though
we have a nice Loop to one
[Music]
[Music]
[Music]
okay
I did say you don't have to write the
movement upside
all right you're ready for magic shape
track is cool
um
shape dot shape tracker
foreign
has one View and stride
strides
actually I hate that that's I'm getting
rid of that
it really ruined shape tracker
I use those in places what do I use
those I use as an AST
that's the only place though
uh not really I mean
I did this because I didn't want people
calling me but now that I know what no
one's calling them
left one in AST
did I what line is that
I don't even see that
anyone anyone calling those hidden shape
tracker apis but like it's kind of fine
I wanted everyone going into moving Ops
but that's fixed
[Music]
restart
foreign
I will check that that's actually what
the fingers are
I'm pretty confident
come here whatever it could be done
reshape uh five two
know how
commute stays
apply
is there a mechanism for clang to
optimize across it doesn't really make
sense it's like gpus optimizing across
kernels
all right you ready for Magic
number of
movement Ops
ah
so you see how that's an expression for
the index
foreign
[Music]
until we simplify it
pretty cool right
you can do way fancier stuff too it can
do padding it can do it can do crazy
stuff guys
crazy stuff
foreign
you don't need to pass a tensor index
because there's no tensor
just
shade there's no actual text
the shape tracker is one of the best
parts of tiny cat
um Okay so
you can apply this to its uh
uh
tracks
about indices
indices into the
bra buffer
foreign
small symbolic algebra Library
it's gonna be reminded us
[Music]
uh let me bring up a symbolic here and
make a list of
it doesn't really see anything
uh
foreign
foreign
foreign
right because that's always going to be
zero in there
foreign
how hard would it be to build a similar
shape tracker for pi torch fucking
impossible you can't hold anything in
pie torch
thank you
oh thank you I'm
I know right
it's it's all in symbolic.bi
this is it
yo like
I've come to this Theory and you guys
can believe it or not but I come to this
theory that like all the code of the
world is just boilerplate
I look at the 2300 lines in tiny grad
and I'm like oh my God I have too many
lines like there's so many things I want
to delete still
I'm sure I didn't break anything with
that refactor
um
so there's a lot of unifying to do
uh if you go you can see like my new
issues that I've posted
some of these are actually approachable
um
so like this one's probably approachable
this one no way this one is super
approachable actually
um you guys can just fix the Llama jet
for the chat example if that if you want
to do that one uh just fix fix the uh
fix the you can run llama with jit
equals one here I'll show you how to do
it oh we haven't even gotten to the jet
there's a jit in tiny grad too
um so this is like examples llama I
could say like prompt equals hello
uh count equals 100 okay
uh actually let me run out of time right
now
this is what I was doing this morning
um so this little just print some stuff
and show the timing
so you see it's about 300 milliseconds
but then you can remember jit equals one
you know get ready for the jet boys
it's jit as fuck
uh
so there's some subtlety and Nuance to
the jet unfortunately now but that's why
you need specialized yet
um but yeah all of that stuff
so we're getting about we're getting
about 10 tokens per second now
um yeah I can get rid of that timing
stuff so we can actually see
what it generates
it's pretty good right it's easily fast
it's a lot faster than it was during the
Stream
um we can also get a bit more speed if
we run compile
uh so this actually compiles it using my
Pisces
it can only compile like parts of it it
compiles the shape tracker and symbolic
most notably
um compiling like lazy and stuff just it
showed me that I have all these like
type confusing things so we're going a
little bit faster there
but mostly I hate compiling and I can't
believe I wasted so much time with that
when I really just should have worked on
the legit
uh this is the GPU yeah this is well
this is using the metal back end
so here you want to see what the Jet's
actually doing
I can run with debug equals three and
that's going to print out the kernels
so you'll see when they turn purple
they're being jitted the GIF captures
okay as the jet
right so all the kernels in purple are
the jet you see that these ones were not
jitted
so this is the Transformer this is the
shape specialization
so because uh the Transformer runs with
a different amount of tokens every time
this stuff couldn't be captured in the
jet
uh
uh this here so the white ones aren't in
the jet they're just in the they're in
method cash so if you see these numbers
it's not in the method cache if you see
these numbers it's uh
in the in the method Cache no but like
tiny card has really led me to the
belief
that
um
all the code in the world is just
boilerplate
no okay so what the jit does the the jit
is just kind of like uh like it's a
capturing jet
so you can put this decorator in your
function
the best way to really understand a lot
of stuff in tiny grad is to read the
tests
uh so if you go like to test jet you can
see like you see like tinyjet is a
decorator for ad and that'll just jit
the add function so here I can show you
like um just put this to five these
should all be five I don't know why
they're only three
oh shit I forgot to fix the shape test
just the test shape tracker
yeah I knew I used the shape tracker Raw
on one more place
so nobody would use them but like
they're too nice not to use
and they're like fine
what
oh
unfortunately it takes a little too long
to run all the tests I should have I
want to make some unit tests that run in
like five seconds and then I can put
them in the pre-commit hooks
like the shave tracker test can totally
be in the free commit hooks
um
and see how fast the ones I call unit
are
still a little slow
test utils is dumb
[Music]
especially since util is an extra
let me uh
create a new folder called extra
and I will shove test utils over there
was that fast
now let me add that to the pre-commit
hook
pounds slow anyway
great
I can probably add some more unit tests
like I have like Test example
that should be very fast
in case I ever break the example
um I should also test this on a whole
different devices
it's pretty big map
it's a tiny metal
so it's fast
there's like a whiff subtest kind of
thing I can use
foreign
tests actually maybe I'll just add that
one explicitly
to the
pre-commit
there's no real thing that like makes
these unit tests and some of them not
unit tests
pretty fast
[Music]
cool
um
I'm just gonna write these out it's not
that bad
because I want them to be separate tests
you know that's something I found with
python like I try to be clever and I'm
like oh I could like dynamically bind
these methods and then you're like bro
just like copy and paste it a whole
bunch
you're just happy
it's CNP
uh I think I could do webgl
okay
your pilot is slow as balls so you know
I'll just copy and paste yeah you like
my copy and paste oh shit I don't
believe that
wait what files were modified by this
hook no they weren't they were modified
by me saving shit
okay
order these into what's most likely to
fail too
when I usually break
flake eight and I'm gonna put pilot in
last because that one's like
you know what pre-commit Hooks and get
uh all right and let me just break a
test you know just in case
oh shit
wait no no no no no no I committed a bug
oh well because there's a bug in my
tests
boys how come you didn't catch this
you know come on like one bug
now you're gonna fail yeah that's right
fail
assert torch not equal to torch
uh
uh tests in pre-commit wow good thing I
broke the test that I happen to not
actually test there's no other bugs in
here right
oh junkie code
that sign I should get off stream
I don't know I don't really know what a
jit is I don't know what a super class
is I just kind of make these words up
guys I just like I don't know anything
about computers I didn't study computers
I'm a College Dropout I just kind of
make words up and kind of know what
things are but look look guys I wrote a
symbolics and I wrote a little symbolic
algebra Library
like what if I use Senpai yeah and I
tried for a little bit but I'm like oh
and then it's a dependency all the code
in the world is just boilerplate and
some variety or other
like
Telegraph is 2300 lines and it has more
functionality in it
and like 300 of those lines are garbage
300 of those lines are absolute garbage
we can start out where some of the
garbage is
so I wrote a little script to print the
sizes so these are these are the
breakdown of the tiny grad code
after enough refactoring it'll be one
long you have the most perfect fucking
line like it can't be one line
but
okay so how many possibilities are there
for lines of code
right like how many possibilities are
there
and let's be realistic here what is all
the lines of code that have ever been
expressed
um no everything's just boilerplate
garbage the whole world is boilerplate
garbage
so
1K is a good Target no it's 2K it's 2K
guys it has seven back ends
it supports torch clang CPU Cuda lvm GPU
and Metal
all right so those are the runtime so
the runtimes alone are 312 lines
the shape tracker and the symbolic
algebra Library are 327 lines
the code generator which is where a lot
of this junk is it has it has an extra
131 lines for llvm that are mostly just
copies of lines from the GPU thing and
then the GPU code I hope I put that as
the lowest quality code in here because
like there's just there's just
unrefactured garbage in there
like you look here at like load look at
this load function
it should be 10 lines
but it just like became a lot of lines
because I added a lot of hacks to make
it work fast with the open pilot model
but I can take them all out
um so like yeah that's just hacks like
this is just garbage that file can just
be deleted and this is mostly garbage
too
so code gen is like half of code gen can
be deleted
um Ops Ops again has like at least 50
lines probably more like a hundred lines
of garbage you can read Ops
uh lazy lazy is a bit better every
factored lazy a few times but there's
still definitely things in here that can
be cleaned up
um
this is where it does the grouping into
asts uh symbolic symbolic's pretty clean
shape tracker can lose like 20 lines I
have another view in shape trackers
there's actually two views in shape
tracker there's something called zero
view in shape tracker and it's what's
used for padding it can all kind of be
deleted and merged into view so I could
probably use like half those lines and
stick that in there
um
yeah and then this like as I improve the
symbolic algebra Library things can be
deleted from here these five lines you
don't actually need they're just for
Speed
uh and then like we have like dispatch
boilerplate
oh and then this this can probably be
written in the symbolic algebra Library
pretty nicely all shapes your linear
views well some of them are stacked
right so sometimes you have to stack two
views on top of each other but don't
worry the symbolic engine like deals
with all that for you it's not too bad
um so no not not every shape can be
expressed as a shape as a reshape and
permutes and then you're like
Okay so
I can show you where like I don't know
if you have something like imagine you
have a matrix that's like
68 by 69
and then like you here you want to see
the most brutal you want to like like
hurt the shape tracker you want to make
the shave tracker cry here I'll show you
how to make the shape tracker cry well
it doesn't actually make the shape
tracker cry because the thing that you
want to write you can actually write and
I've put a lot of thought into this
and why this doesn't work by the way if
it's in Docs abstractions.pi
uh so here
if you want to make this shape track or
cry you take two shapes that are like
Prime like 67 and 69.
right
so
that should have thrown an error
I'm upset about that that should have
thrown an error we need more asserts in
tiny grad
yeah well it's like kind of prime you
know what I mean like looks kind of
prime that's that's what I'm saying okay
so now I do something like a DOT per
mute one comma zero
all right now I do something like a DOT
reshape 67 69.
okay
so look at how that's expressed
um actually we can do a DOT expert node
uh Sub Zero dot render
and like
there's not really another way to
express that except it's just that right
so I'm sorry but like that is why not
all views can be linear but fortunately
nothing in neural networks actually
looks like that like there's no neural
network that does something that looks
like that but it has a certain asserts
don't cause lines I mean if they do but
like I'm not worried about asserts we
don't we don't skimp on asserts because
they cause lines
okay this is why we got rid of tiny grad
as a thousand lines
like a thousand lines was just
well how is where was I gonna fit my
compiled buffers and the whole code gin
so yeah
um yeah so kojan's got a lot of crap
like 20 lines can go from here symbolic
probably 10 lines can go from symbolic
um like we can look at symbolic there's
a few things in it that aren't beautiful
like I don't know like I have a comment
ugh I doubt this is universally right oh
but this was a this was a big um
this was a big decision that like I
wasted a day on
I use Python Division and actually I
just got rid of all negative mods and
divs I know the readme's a liar it
encourages people to actually read you
know what I mean it's like false
advertising
and like you know what oh what
what how do I break the tests
no oh
oh
okay uh
uh okay
I'm gonna do something crazy
now it's seven and I feel like I should
have not done this like this
the problem is they're not all installed
like all the back ends aren't all
installed
so errors can yeah
so
uh try
um tiny grab that lazy important device
so what happens if I do device
um
this is a terrible test I I don't hold
the test to the same standard of code
quality that I do the rest of the
library
okay so Kuda is the only back end that's
not supported
should also probably have one where I
actually test like that the answer is
right
zero
I'm upset okay uh unit test
multiple
choices we're going to make this more
decent
um
python unit test multiple choices like
how do I
it's like it's a nice way to do this
foreign
like subtest in here
parameterized tests yeah
wait no no but I'm not downloading
something called
the subtest context okay
all right so it is just this
you mess it up enough times you write
good code that's right
foreign
[Music]
boys am I doing better
Multi-Device test missing one required
argument
oh why is there itself
oh shit
um
I like your house right South
I think that's right
[Music]
that's not subtest nicely
why is there only Cuda
oh because I did return
there you go
but why doesn't we say two tests I want
to see the subtests
um
let's just break the lvm code John
let's break the lvm Cogen in an
arbitrary way
all right cool that fails
it has some electron text manager that's
pretty nice
foreign
hook
uh
I hope we didn't break the test
all right let's see how my docs render
here
oh that's pretty nice
[Music]
I'm not gonna say to a bite because we
never actually go to bites
no way
hey guys but aggressive it's been worked
on
has been worked on what you see here is
your final address you guys tell the
whole time you got
this documentation will help with entry
points and understanding abstractions
boiler blade Imports typing mostly
I'm actually going to move these two
down there
cool little runs I should just be able
to run this too that's cool
my docs can run my docs run
is Adam still the go-to optimizer
haven't you heard about lion dude I
don't even know
all the way on down um
not just for typing
I should learn actually how to use ABC
in Python I don't actually know what
that is
uh
[Music]
all right all right this isn't a chat
about optimizers unrelated
unrelated the only Optimizer oh yeah by
the way did I mention to you that we
have all the optimizers
check it out we have SGD we have RMS
prop and we have Adam
if someone makes a two-line PR for atom
w we will merge it and I fixed all the
optimizer tests too the optimizer tests
actually test multi-step stuff now
so if we do test Optum
it actually works
multiple steps 10 steps even with huge
learning rates you know it's really
close so if someone submits here's a
challenge submit a two-line pull request
to get Adam W you know lion no I was
kidding about lion
I was joking Lion's a joke
is that really a joke I don't really
know it's hard to make heads or tails of
anything anymore you know just like just
like with um you know experimental
Medical Products you know I'm not I'm
not anti-experimental medical products I
just like to wait five years to see if
people still think they're a good idea
right maybe with Lion we'll give it if
people are still talking about lion in
one year maybe it's a good optimizer
foreign
new medical product hits the market you
might want to be like I'm on a wait you
know a new Optimizer hits the market you
might want to be like I'm gonna wait
why is your text so small why are your
eyes so weak
uh all right
abstractions
um blah blah blah
it's worth just reading
good old familiar tensor class these two
are pretty straightforward
all the definitions of derivatives are
subclasses of function like ml Ops log
it's only 18 ml Ops for derivatives for
everything if you read one file read
mlaps.pi if you read two files also read
tiny grad tensor you can differentiate
the world using the chain rule
I'm so proud of it
I added types to it even though I think
the types kind of made it ugly
um it won't be on Tiny guide Yeah well
yeah maybe
if if someone someone can make a fork
and you know the great thing about tiny
grad is if you write lion outside dining
ground it'll be just as fast as writing
it inside
like that's the idea you know torch has
these optimizers like hand coated you
can look how many lines is an Optimizer
in tiny grad
let's look at one
look at how long Adam is that's Adam
all right
this line is stupid
this line is pretty stupid
this Line's pretty stupid
so this is this is Adam
like that's the whole atom it doesn't
depend on anything Optimizer is a tiny
class that just includes some like
stupid boy I played
small amount of stupid boilerplate
I know abstractions is going to break so
if you wanna if you check out this
version if you want to play with
abstract if you want to play with this
abstraction it's not probably because
I'm going to change a whole bunch of
these things
uh okay lazy buffer this is where the
properties live that you thought were a
part of tensor lazy buffer is like a
tattoo without derivatives at the mlr
player
these three Define the type of the
buffer and they returned as tensor
properties device shape D type
if lazy buffer is unrealized it has a
lazy op
uh the lazy out describes the
computation you need to run this lazy
buffer these buffers realize it has a
device buffer we'll come back to device
buffers later first let's explore the
advice yeah lazy out undergrad Optical
four to ten
uh
this is
you know tree they form an abstract
syntax tree for a single GPU kernel
types of compute the sources and an
optional static argument that's pretty
good that that
oh like you can just use the auto
vectorizer if you want Auto vectorized
shit use uh use lvm here
uh let's see how many let's see how many
things we get
so this is a this is
I'm gonna actually break it okay
this is my favorite new uh example
okay so there we go oh wait why are we
getting one gigaflop
that's just a bug
it might actually be right let's try lvm
opticals one
two gigaflops
I think that's right
[Music]
because everything's slow today
metal oh it's because I added more
copies
this is all just the copy overhead
foreign
we can talk about what I want to add
that copy torch doesn't have the copy
oh if you scroll back in the in the tiny
chat I was uh
this seems egregiously bad
it wasn't this bad before
I don't know
foreign
slower than torch because I'm making
copies
oh it's because I'm making copies
no it has to do with like use after
freeze and
that copy is optional see look it's fast
now
torch was twice as slow as torch because
of my copies
there we go that one's fast again
look at that by the way we're beating
pytorch at everything
except for
except for my reduced kernels and I
don't exactly understand why my reduced
kernels are slow
we can get rid of that oh that copy so
annoying
oh
torch isn't making a copy these these
things just aren't big enough to really
be tested
I know that no no no this something is
real this this is actually real uh it's
because my reduces just aren't as good
as theirs
um but yeah I want to get rid of that
car I we'll talk about that coffee I'm
just gonna leave it in for now because
if it's I don't know what's up torch
isn't making it
I'm in an unfair disadvantage if I throw
it on coffee there
but there's reasons you have to do it
I know no torches some kernel is lit I
know why it's better
um there's a few reasons
but I think they're actually launching
uh big but you see China Grade is this
is MPS
so tiny Grant is faster tiny Red's metal
back end is faster than torches metal
background
um
and then here if you want to see
if you want to see speed
so this I wanna my goal for
wait for the jit to capture
and I think I need to hit Ops local
equals one
we'll give the jig a little bit of time
there
but yeah you can see my milestone for
tiny grad
oh this is brutal
okay maybe app local doesn't work
yeah the new goal is two lines there's
two thousand lines of code but more
important the two thousand lines of code
is we will finally train imogenet that's
the milestone for this release
I want to train the image now on my Mac
and you'll see when these finally finish
compile
what is this slow
it shouldn't be slow
I was getting much higher G flops before
did I just enable slow mode or something
metal can't even be used in prod what do
you mean I'm using metal and prod right
now
let's go back to reading this
um while that compiles
okay a lazy buffer
Jax is sick you like Jax
but we're gonna beat them all okay this
is the fastest and it's the fastest on
Snapdragon without a doubt
um
so these are my different shapes of
kernels it's going to be Optimizer now
see now I'm getting good data flops I
mean it still isn't that good
I have to okay I have to rewrite the
code gen I have to rewrite code gen we
need like a step to do I'm going to do
some research on how actual compilers do
this we need like a step to linearize
the AST and then a step to like code gen
the AST
right now I've conflated those two
things and sometimes and you have an m
and you conflate them it's multiplied
uh so yeah
Jax is an interesting Direction I
haven't used much jacks
what's different about it
okay I mean they can do yeah like tiny
God confuse those together too
uh you don't need any uh
foreign
or something
um tiny grab
which which back end does Jack's using
oh bro tiny grad's gonna crush this
uh uh I'm trying to grad
lazy important device device
dot default
it's not even fair
I don't know lvm
lvm's probably the most fair comparison
boom
time you grab fast as fuck
tiny grad as fast as fuck
no you do realize
okay so it's on par with the slow one oh
but now I compiled so it's faster
wait no it's not what
what oh that's plus or minus oh never
mind
okay tiny guide is halfway in between
um when you actually realize the tensor
ah yeah
foreign
300 and that many microseconds
you want to see the metal
uh
yeah Metal's the Apple Library why do
you say it's not production
oh I didn't realize it
that's your metal
x times x
times 2
Plus
and then it repeats that four times
can metal be used on the comma three
okay fine what what do you want instead
you want uh
what would you rather have
shift Global counters I didn't think
this through
uh
do you want
GPU that can be used on the common three
cancer dot ones
uh device equals GPU
realize
there you go opencl
where did it output that doesn't happen
us
we should now put that
oh but I didn't actually do the uh
that's just creating the ones
this is the one that actually does the
ad
you want identity Matrix because they're
not I
don't have a big Matrix numpy does the
most ugly disgusting stuff let's NP dot
set print options
line with
equals one thousand
no
print big
press
why does numpy feel awful because it
didn't print a big Matrix I asked for a
big Matrix
oh that's pretty nice that's pretty big
why does numpy feel awful yeah I don't
know
no malcolor did feel better I don't know
like he was Tiny grad
multiply those matrices
can you actually have a
dot T property I probably should is that
really right
is it really the right answer
no way
oh because I'm transposing I'm not
flipping Oh I thought I was flipping oh
you can flip
what the hell
we found a bug in tiny red
that's terrible
we found a bug
Telegraph needs fuzzers
foreign
works now
oh it's because they were eyes
because they were eye matrices
um
hacks I'm doing with the eyes
wow that's gonna be gone wow that's
that's gonna be tricky
I should actually have checked if that
would reproduce it
works fine
oh is my flip in the wrong place
there we go
okay
wow
real tiny bug
works fine in the torch in the numpy
back end
but the torch back end no worky
uh and where is this actual problem
see the symbolic algebra Library
this keeps happening
I feel like I've seen this before
something here can keep causing this to
happen
search
okay now it's an assertion at least
I think she's simplifying
hmm
foreign
so we multiply it by minus nine
we get Plus 90.
and we don't want to decide we don't
want to do that plus offset times big
plus my why is that minus 99
.
how is this supposed to work
is it supposed to be minus
did I just mess this up
mess this up
okay
numerator of
Dev is not
allowed to be negative
the numerator of the div
works fine in the CPU
does not work fine on the GPU and it's
because I is actually a construction so
if doing something very clever here
um unfortunately it's a little too
clever but it breaks the uh
I have an idea of something else just
getting
the numerator of the of Dan is not
allowed to be negative
um
wait this is just wrong
that's right unit tests
decent test for this thing
okay minus five divided by five so that
should be
minus one and that Max should be three
and I don't know what the outfit is
going to be
I love finding bugs and then improving
the unit tests and then like look
eventually it's not going to have bugs
guys
I mean there can't be that many bugs
you know how many bugs can fit in in
only 2 000 lines
you have to write more powerful tests we
have to throw it like a fuzzer you know
work don't get it
session one is not equal to three
um
never mind the max said that is actually
just one
cool
okay that's not actually triggering we
have to figure out what actually
triggers that
foreign
doubt this is universally right it might
be
should I divided by four
it's kind of so false in here
four doesn't Factor
[Music]
but it definitely factored stuff out
okay support do I not support negative
variables anymore
no I don't
um
wait does something else must have done
that then
how did that do that oh maybe it's not
like minus 100.
that factorized 101
no that seems right
okay what am I putting into symbolic to
break it
let's just print out that and run the
bad test
okay
we have an idx
from zero to nine
which we're multiplying by minus ten
oh and then we're dividing by 11. oh
that seems kind of brutal okay
foreign
okay so what do we want to do here
that thing is hopelessly negative
and we want to divide it by 11.
all right let's do the right thing
what's self.min
by the way does that assertion come up
anywhere else or go ahead and not to hit
that code path no I actually never hit
that code path okay so that code is
broken
I just I just wrote some garbage and
then okay
so we want to do self.min divided by
divided by B
I like that so far offset was right
now in order to make it not be negative
we want to add
offset times B but not actually offset
times B
negative offset times B
memorize them in
case nine that's pretty good
this is what I meant to write
okay
now we return
numerator divided by B
Plus
offset
now we have a bug
it's becoming negative again
I mean look do you want to fix the test
I can show you how to fix the test
I can trivially fix that test
now whoops put another place
foreign
oh shit wait that's not actually gonna
what
this is getting stupid
that better fix it
perhaps I forgot a comma
well don't flip identity matrices okay
oh well this is because I introduced new
buggy code
was the old code
I don't actually know I'm just talking
shit I don't know this Library sucks man
I don't get it
am I actually running crash no I'm
running no crash
you guys don't think it's so hot it's
crashing
we'll figure it out let's go well now I
have a failure of the uh
the symbolic code is all new
yeah okay the problem is it's desperate
to factor out
oh it's desperate to factor things out
we have to tell it it can't Factor
okay the problem is when I multiply that
when I divide it it just wants to factor
foreign
there we go you can factorize that
see the problem I was trying to
factorize that 9 to an 11.
um
so let's code it almost right nobody
tested that
yeah tiny grass has its own symbolic
implementation it's mostly pretty good
it's good enough to get all the open
pilot shapes correct
so it doesn't get this one correct
don't flip matrices who flip the Matrix
who flipped a matrix
okay does that actually make sense the
minimum is minus nine
well we can just work it out
yeah the minimum is minus nine and the
maximum is zero okay
that seems right
I'm suspicious
no I have a symbolic algebra Library
please don't crash
test
look at that junk code that's actually
not too bad actually I don't think that
code's really bad
I was quick to call it junk
dude that's the most beautiful shit I've
ever seen
I'm not printing out the float 16 if you
don't have float 16.
how nice is that code by the way for
flipping eye matrices
it cheats it doesn't actually do a map
Mall
or wait
no that is a matte ball
it's just a
yeah it's shape trick or magic of course
tiny bread
um
all right
yeah this is some of the bad code in
tiny grass this is some of the bad code
in the symbolic if someone wants to
clean it up
uh wait what was I gonna say
I mean the answer is obviously right
this this test infrastructure test that
oh yeah no I was mad about the stupid
pre-kernel thing
oh I'm gonna add a d-type test to my to
my test examples
that's a brutal one
don't ask why D types and helpers
um
no I can't actually do that
I don't know let's run that test once
and then delete it
I hate this test
it's gone
and it's gone
we have the d-type tests don't start
putting all the tests in there
no I have a harness for this that's what
I wanted to do just that's
run multi-back and test d-type
great
I feel like they don't work in CI I
don't want to talk about
fix flip bug and new new tests
I don't need the test case I got rid of
it
thank you
all right
if the tests pass
uh oh we're gonna we didn't finish
reading through the example
my new beautiful Docs
okay let's let's link these docs in the
uh in the tiny grad Discord
uh if you're not in the tendergrad
Discord I will not tell you how to find
it
let's do this stream on
Whirlwind two of them attempts are all
the way down tiny grad has been
aggressively refactor blah blah let's
trace an addition that's nice
uh I didn't break the tests right
so who knows I didn't actually run many
tests after
changing that symbolic thing but I think
it was a rather uncommon case
of course
of course I made one change and I messed
it up
stupid Buffs can be none Buffs
I don't wanna I am upset about that's
just to see I hate this bug
I mean one change
check the d types but I didn't check if
it has local memory
the Cogen is garbage this whole code gen
is garbage is going to be thrown away
I would not say that more docs is better
good docs are better
that's a reasonable frequent midhook
length
oh thank you thank you it isn't it was
an informative stream thank you
um
okay so we go down to the lazy buffer
uh
I just I don't know I must I probably
broke
probably broke open see Alto
that's probably broken
so you make like a tiny change you think
it's good and it's not good because I
used Buffs to be optionals
to Java dock your entire code base yeah
I don't know I'll have to look into
whether I like these um
like python strings and stuff there's a
lot of tiny guys pretty well typed
uh
look some of the abstractions are good
tensor is good lazy Buffer's good lazy
op is good
um this stuff's All Good device buffer
is good interpreted buffer is good
compile buffer is good raw buffer is
good run time is good
this code gen stuff is crappy
that's CI gave it a two out of ten
the code gen is the code gen leaves a
lot to be desired
um yeah the code gen is pretty crappy
okay
uh
uh yeah this this Auto gen notice I had
to manually format this I'm going to
make a new code gen linear eye that
separates basically the linearization of
the AST from the like string generation
of the IST because you should never be
concatenating strings
what's wrong with the code gen you just
saw you saw that bug I introduced in the
code gen like that's just because it's
terribly written I mean the code drone's
been hacked on a lot and like a lot of
stuff just wasn't really thought about
when I started writing the code gen
um but I know how to write a much better
version of it so that's one of the goals
for uh
write the linearizer
the linearizer is one of the goals for
zero six
uh we have to do casting properly
casting's just a unaryop it's like this
example is pretty good
um I'm gonna do the specialized yet
again someone can actually do that in
like an hour or two
um what I mean by linearize the NST so
the AST is a graph you have to kind of
like topologically sort the graph and
think about how you want to run it but
you also have things like Loops in the
reduce Ops and like I should just
completely separate the um
yeah like the running of the
code is like a line right it's a line
going down
asts are tree how do you turn trees into
lines
uh so that's what I'm evaluation ASD all
right so I'm going to call the class
linearizer and I'm pretty happy about
like what I planned for it uh shape
tracker I'm quite happy with seven out
of 10. you know what symbolic gets a six
out of ten Doo dude the bug
and I'm gonna push it just just to make
it a six
because of the bug
let me make some other change so it's
not just me changing me being sad about
symbolic
the shape tracker is beautiful guys
uh uh what is this garbage
yeah auto-generated code garbage
um the runtimes are really good I did a
big refactor the runtimes I'm really
happy with them
so you'll see if you go to like
um
they're just simple
Cuda
so okay this is a compiler for the Cuda
program this runs the Cuda program
Cogen and buffer still need refactoring
raw buffer is good it's literally just
been a Malik and copy and copy out
computer gradient
what do you want me to compute a
gradient of
oh compute a gradient in the docs
[Music]
yeah we could but no that kind of that
doesn't like matter like you you just
believe the gradients work
tiny Red's not really for open pilot it
is used in open pilot though I mean it's
a neural network library
um it's a competitor or to buy torch and
a tiny guy and uh intensify
um now we'll just we're just gonna
commit that sad sex
assuming that all the tests actually
pass this time
and then that's it
yeah
no the code gen is garbage let's go back
a little quickly at the
or the first commits the tiny grab
start tiny grad have you considered
using tiny grad
I mean it looks
uh
it looks slick okay
we have a test
we have contacts tensors and functions
so context turned out not to be needed
you just needed a function
uh implemented functions I mean like
wow we used to have a thing for Rel U
and Dot those don't exist anymore
um like let's we can look at the we can
look at the new ml app for some
this stuff still exists I mean mlops is
some of the oldest code that's why it's
the best
yeah it looks like pretty similar
except we don't actually have to save
the input
was this supposed to be add
no I use some there
it's pretty similar there I look there
see what else we have okay we have a
test we wrote a test for early tiny grad
test tiny grad
you want to run that old test let's run
the old test
all right so we have X in it
we have W in it
and we have m in it
now we create tensors out of them
oh I use the over Arrow I say not tab
now we create tensors from them very
painfully
all right now we do a DOT I already know
this next line is going to break because
I change the log soft Max to actually
match
Pi torch which looks like that
now we multiply it by m in the most
painful style and then we do a sum
and then when you compute this but it
all fails because I didn't tell any of
them that it required gradients
so now we have to go back and do that
again but with requires grad equals true
foreign
wow this is this is terrible this was
the first tiny grad test okay I
wouldx.data oh tensor has no attribute
data it's called numpy now
okay so that's great now we can do like
grad numpy okay and we can do W grad
numpy and all those things work
and it looks slightly more like torch
why don't you check out the commit and
run the file ew
ew
we'd have to go all the way to the Past
do you want to win the old test and see
if they still work
we could have done that we could have
done that it's getting late okay
symbolic is now
a six out of ten
due to the infinite Loop do better
foreign
subscribers oh look we're on not screw
we just have a lot of subscribers
do better that's right
that's right we will do better
um
read the docs share the docs with your
friends
guys am I just wasting time it's time to
grab stupid
I put a lot of time into this
yeah but is it ever gonna be something
it's kind of the question
it's so like it's like most parts of it
are pretty nice
I just joined in I haven't really been
following the tiny grad project but I
use pie torch daily and I'm wondering
who is Tiny grad for
it's for
so right now the only place that it's
really usable is on like embedded
systems
um if you want to generate like small C
code that runs models if you want to
generate opencl code uh for mobile
it's considerably better than pytorch
right Pi torches is pretty heavy weight
like even just importing pie torch it
uses a whole bunch of GPU memory if if
you want like small stuff
um I wrote another example that's pretty
nice again if you want to see uh
examples like here this is like a this
is how easy it is to add a tan too
um so we Implement like atan 2 as a GPU
kernel right there
look it's pretty nice
GPU CPU and then we
dispatch it here okay lazy buff
that would be good to emphasize in the
docs or read me if you don't know if
it's for you it's not for you
yeah I mean like I'm not trying to look
I don't really care if you use it
I care if I start to beat Pi torch on
like metrics that matter
um so I I'll say that like I'm happy how
quickly I got uh
I got llama to run but uh the the the
guy who did the four bit C plus plus one
is just better for that use case for now
um like there's a bunch of things that
just weren't there in tiny grad so I
wasn't the first one
but all these new models are going to
come out so tiny grad for those that
don't know we have stable diffusion
and this is a clean re-implementation of
stable diffusion so I just
re-implemented stable diffusion and I
should like clean it up and make it even
nicer I think that the API is
considerably nicer than Pi torches
um for a whole bunch of reasons
uh this is this is my implementation of
llama it got a little ugly here so I
could make the jit work but it's like
not really ugly it's actually quite
clean
attention there's your feet forward
Transformer block Transformer
why do I use Python what else should I
use
Python's the closest you can get to
pseudocode
and if you think you need more speed you
probably don't you should rethink your
algorithms
you mean in JavaScript where like God
in JavaScript if you keep adding one to
a number it'll eventually equal the same
number
you know
I think eventually because you have to
just get there like that's how floating
points work
the numbers are fake like it's just such
an ugly language
why do you care that python is slow
like
I wish the type system was better right
so like
there's a bunch of things I'd like to be
able to express uh in Python's type
system that I can't express
how well did I understand Transformers
pretty well Transformers I understood
well
um did I understand stable diffusion no
not at all
I mean you watch me code the Transformer
I did Fast
if I tried pyrite no
I love Microsoft
[Music]
node-based command line tool you didn't
even write it in Python
how do I install that
I don't know how I feel about that
uh no so don't do that just that
wow
interesting
all right let's see if any of these bugs
are real
St is potentially Unbound
no come on no never mind
never mind
useless
cannot access a for member type node
let's see that one
now
like like uh
that one I'm not actually sure if my if
I can get there might just be another
reason my if I isn't type checking that
but they're all Mall nodes
because of that line
argument of type node cannot be assigned
to parameter inch
uh
perimeter offset
and function expert node
oh I mean now again like that's just
poorly annotated because if you go in
here it should have a union type
uh or at least somewhat has a union type
here it has a union type I might do that
that one I just might have annotated
wrong
but that's not actually a I don't think
I annotated that but that's not these
are all wrong
nope don't like this
yeah yeah I know about the Batman joke
in JavaScript uh
no the model team's not really
developing it it's mostly just me
um we have a few we have a bunch of
external contributors
uh yeah we need fuzzing
playing joke in JavaScript yeah
no no no no no no no no no no
wow wait wait did that like pre-run it
that's scary
yeah I mean obviously because if I had
an array of 16
wait what if I just I don't know I
actually know JavaScript what if I just
make an array of 16 what does that get
me it gives me empty sixteens
join it to he
well of course
hero
uh
well no I mean my idea is not to stop
there right so like there's a bunch of
things that just make tiny grad a lot
better
and um
example okay so let me show you the open
powerful power
so
I don't even want to talk about that
see look torch is broken
um so like this is the open pilot net
uh
tiny Grant prints out the gigaflops in
the memory bandwidth of each kernel
try to figure out when torch is actually
launching a kernel
um the sizes of all the kernels and then
on the left here is my shapes and how
they're being like upcasted and stuff
and all the different colors mean
different things you know like you learn
them and stuff
I don't know any of that stuff but
no final's fine
you don't like to prepare kernels not to
before I've worked a lot on like I
worked this net was the example this and
that's in the in the tests
so I make sure that it stays good
work day start why are we getting dumb
questions
subscribers only
no dumb questions do you have any more
smart questions or is that it for
today's stream
um it's cool that Microsoft's developing
another type Checker it's just it's not
as good as my pie I mean life has kind
of like buggy but it's like accurate
which I care about
can you give me a contract
you guys could get to help Implement
tiny grad
your subscriber when is the work day
start I don't give a fuck man whenever
you want to come in
if you're not doing work I fire you
don't work there anymore
uh yeah I know xla do they still have a
function for decode jpeg
wait you want it well I mean can you
grad
one of the examples
um
this will take quite a while because we
must build the entire stack including
miir
uh
uh Inc versus flow well I mean answer
just more annoying
because you got to think about Oracle
cases more
uh what what other there's another
question oh you don't need a c API you
don't actually want to see API like so
look at this test here
um this test you can look in a tiny grad
for what it is this test compiles
imagenet to C
remember and then I we you missed if you
missed this stream
you can go to tinygrad.org and then like
this runs and we can detect the hen
all right that's running the efficient
net that's compiled to C from the thing
um there's definitely some kind of
autism why do I know why do I ever let
why do I ever let an unsubscriber speak
as a non-subscriber ever said anything
good
does it support the Apple neural engine
not really Apple really locked it down
it's like I was thinking about it again
today but it's kind of a waste of time
um we could we could work on that
uh
uh
nearly the C apis
compiler time you've got the compiler
uh no no only work on this tiny Grant no
tiny Grant's gonna win
okay linearizer then we start making
one of these days we will start making
it very fast
and like we have to be faster than them
because there's just just not that much
stuff right like each line if we make
each line fast
um then how could it be slow right and
when you have 200 000 lines it's hard to
make each line fast but when you have
two thousand lines you just need to make
each line fast you look online and
you're like is this line fast
um I don't think Ellie Eiser is going to
send someone to to get me man uh you
know we gotta geta gotta keep uh
all the path to AGI guys there's still
such thing as AGI
oh my God where'd you hear about this
what'd you all hear about AGI why do you
think it's real
okay there's just a spectrum of life
all right our dog's AGI yeah that's so
dumb dvd4 this week you'll see it's any
good
we'll see
we'll see if it's just like like a
scaled up thing I think we might sort of
be at the end of that maybe I don't know
maybe not
who knows
oh can we boot this guy
oh yeah whoa dude what a response whoa
dude you want to see my response bro
band wow
uh
why is Tiny grade code so hard to read
why do you think it's hard to read
it's pretty readable
like look at tensor that pie I feel he
tensored up high and say like this isn't
readable
compared to like so much garbage python
out there
I think there's like that are a little
dense I guess
then like things like this are very
readable look at that
math functions
all right guys
thank you for watching night's stream
um
Docs
docs slash abstractions.pi we wrote
documentation I hope somebody reads it
it makes it worthwhile
um whenever this is a homepod everyone
will be on Tiny grad I I got I got I got
plants guys I got plans you know the the
point of the point of this stuff is not
to uh
like
you you have to have a library that's
capable of doing both inference and
learning kind of as the same thing
um like the learning just needs to like
become a part of it look my long-term
dream for tiny grad is like
to start rewriting parts of tiny grad in
tiny grad right like you know how they
wrote CNC and think about it like what
if we have things that like okay there's
a lot of like optimization heuristics of
like how to compile graphs and stuff
imagine putting that in neural networks
and then tiny grad itself optimizes the
neural networks
right
like like
like that's my dream like you want to
know where AGI is going to come from
right
fuck AGI man how about recursively
self-improving AI right or uagi are you
AGI is your dog AGI I saw a fish at the
mall is it AGI
um redcar path you say
this is funny
think through repercussions off oh
you gotta open it guys
Salsa's thing yeah
no we are not generalized intelligence
oh this is so oh my God what are all the
people who got interested in ai go back
to fucking crypto go back to crypto okay
go back go back to crypto
bye I'm gonna cry though
seven billion no you could probably get
the 13 billion one to load pretty easily
um
and then with the jet it's fast
I'm Gonna Be Right the card
should be able to ride forward forward
pretty easily
explain what driving assistance such as
open pilot really is all right this guy
you're the reason I'm ending the Stream
do you remember gam from before the goal
is to transform uniform into Gaussian
maybe we should try this in the ipython
notebook I think it might be ipython
open I think this might be too much yeah
it doesn't work okay cool no ipython my
Jupiter notebook work I think I'm gonna
broken so you'll also find that we're
using the brave browser we're using
brave whatup froze hey Joker
um we're using brave just fuck chrome
you guys so it's on the front page of
hacker news right now it's a top story
Google just if you log into a Google
account on Chrome it now locks you idiot
now like logs the browser in and sends
your whole browsing history even when
you're not on the Google web site well
okay they claim it doesn't send your
browsing history but I don't know man
it's just Chrome is headed in the wrong
direction Google as a company is headed
in the wrong direction this is maybe
something we talk about commonly on
these streams so yeah fuck Google please
brave Python 3 we love Python 3 yeah
we're using Python 3 this is plain old a
yes I don't any cool
default zoom level let's go down to 100
here you guys know what a big monitor ya
know fuck curl man I'm really sick a
Google shit it just as a company also
everybody would like to shed a tear for
Cody Wilson in jail in Texas let's just
shed a tear fuck the government that's
right fuck the government alright cool
now that we said it um let's move along
to try to do a Gantz
let's try to do games so we have
generators and discriminators so nobody
likes make people that's a good point
hold me you wrote good notes
this is a good way to do auto reload
than they thought over thought it's fine
let's go so this is a challenge that was
given to me by somebody back in the day
yeah let's see what these things little
trick for a quick histogram you can do
sorted so you can see that's uniform so
let's put that comment at the top goal
is to transform uniform into n what is
Gann ganas gamm this one I'll put the
wikipedia guy over here you guys can
read it ok so the first thing that I
think we have to do oh I just realized
something
well I was tired that night that I was
doing this ok so if we want to get a
supervised set we can do this now we can
see if our net can learn the
transformation without using the Gann so
we can check if our generator works
oh also cool thing what Kenneth what do
I have oh god I haven't knew enough
tensor file you can now do from tensor
flow cross and it's a built-in cross to
tensor flow it's nice it seems like it's
much more stable so yes I know I scream
about fuck Google but they do right
tensor flow thank you for writing
counterflow Google oh cool so now we
have tensor flow let's test the
generator on its own first and make sure
the generator can work so our goal is to
transform X into y y'all see look we're
coding guys yeah who's happy I'm happy
oh I know this isn't a nice soft
[Music]
that you are in one of those moods in I
am in one of them too and it's hard I
[Music]
will remember that summer as the summer
I was taken down oh this doesn't work
oh of course the GAD wasn't gonna work
that if you can't even get it to work in
supervised learning mode you see how
those distributions don't match see how
they don't match
cigarette
just leave carving work at all maybe
deep wearing doesn't work
oh you think okay so what we're trying
to do is learn a transformation from
uniform so from uniform so from X which
looks like this
yes figure this today we can make them
small that cool from this into this
that's what's gonna say at the top
you're trying to transform uniform into
Gaussian but so far we haven't had much
luck at that even with look different AF
well I look different
maybe it was learning no it's to
consecrate into Santa's garbage try Adam
oh oh it's starting to bend why does
this need 17 million a pox try a sample
count
oh yeah the plot does look different AF
let's try one nice number anything
okay okay okay those may just learning
something to learn anything no I didn't
learn anything
that's garbage Lu
try bigger
don't learn good bra no let's say this
is better no they don't match
okay this bullshit
oh my money back this bullshit bigger Oh
No learn so slowly because I don't have
GPU they're closer it's almost learned
literally the line that mimics the data
this isn't even a game you guys this is
supervised learning you know what when
in doubt you need more deep sigh deep
sit is deep learning after all deep
doesn't mean nothing I have to take
forever to learn huh
oh that's a little lost girl that losses
guys oh yeah look at finally matches
yeah so I can't do tensorflow GPU
because I won it because I have a Mac i
bought a standalone GPU you can see the
Nvidia driver on my computer but then I
tried to you want to try to build
tensorflow GPU do you guys want to waste
an hour on that we could do that we
could waste time trying to build
tensorflow GPU I wasted a lot of time
last time trying to do this about
match.com by the way a lot so thank you
for the 14 bits you guys know that the
only reason I stream on Twitch is
because you give me money I'm poor
tonight see I found a new thing that I
like is called spindrift sparkling water
and it's very expensive very expensive
so that's kind of a tragedy you know
what's not expensive now you know what I
was looking at today guys I was really
excited about flights to Singapore I
could get a one-way
like to singapore for $500 how crazy is
that shit not even not even like I gotta
like stop in Taipei although actually I
could go with a little stopover in
Taipei as a free man like Cody Wilson
who was wrongfully jailed wrong their
sugar daddy meet dad Bob I hope he can
laugh about it I hope he does that you
know we laughing with them not Adam that
could have been any of us please build
GPU up dead serve love well so here's
kind of the problem with that got a
shelter a hey there's our suite and
browse it does have okay fruit seventeen
calories wait I do kind of feel like
this is a smoking weed twitch this is
smoking weed twitch if we get thirty
people will be a smoking weed twitch no
I do I need to buy more fucking fall it
just wears merch we can stop in Taipei
that's that's actually not a bad layover
if I go in China Islands website can I
uh can I do a multi-part the programming
will resume in a minute china airlines
are committed to the best flight quality
safety oh maybe I'd rather fly United
they don't talk about safety on their
website Singapore stopping in the
Chinese city of Taiwan one-way Monday
yeah let's go economy I'm broke you guys
please donate money so I can fly
business class is that they
discriminating against me because I'm
using brave
I beat 97% of users I like that does
that improve my weeds will not damage
your brain who told you this fake news
the fake news bros
calendar dates will be shifted this
websites unusable Chinese okay let's go
back oh my god
China you need better Airlines site who
told you we'd is safe it's not safe
because I'm gonna damage your Bruin let
me tell you what damages our brain guys
I wanna know the truth about what
damages your brain well some drugs
actually dude haven't you prayed okay
but there are drugs that are actually
legitimately neurotoxic alcohol is quite
bad for you
definitely avoid xanax I would avoid
ecstasy I don't think we damages your
brain I don't think psychedelics damage
your brain I don't think at all damages
your brain
I don't think opiates damage your brain
you know what then damages your brain
though if you do those drugs and then
you don't do anything right like some
people you know there's like the studies
they show like weed and IQ yeah man
if you sell a couch all day and smoke
bomb and don't do shit with your life
let me tell you you're gonna be stupid
um crack I don't know about crack uh I
never smoked crack um I don't think
cocaine does cocaine it's probably
better for you for that ever feta mean
um so I would say the crack I mean I
don't know like I'm not I'm sure but
that dose of like your vascular system
yeah but you see that's the thing like I
can even believe that story about your
friends smoking weeds about two years
right
um but you have to ask like what events
in his life caused him to smoke weed for
two years I think you would find that
that's actually way more of the problem
in his mental state is way more the prom
then you know the fact that he smoked
weed cooking sucks man
Oh Kane is a shitty drug the quickest
way to never want to do it again is to
gob and go to a room of coked up idiots
and they're all sitting there I don't
screaming and they all want to talk and
everybody wants to talk and then you're
like wow is this what I'm like no I
could never be like this this has never
be but it is you but it is you that's
right
okay Oh multi-city and stop-over perfect
they have what I'm looking for
let's see so if I want to go from San
Francisco to Taiwan which is a city of
China as part of China that's right
don't get it twisted guys how you want
of course then we want to fly to
Singapore don't do drugs and Singapore
guys say Monday well let's say we want
to hang out in Taiwan for a bit is that
cool economy because you guys don't give
me any money I don't know man I've done
coke like at two parties I think it
sucks
99% of users that's right
Oh even cheaper oh wait no no no that's
only for my flight I I mean I'm very
curious what ecosaver eco semi flex
premium eco saver all of this stuff
cause and effect are really interesting
get a reason according to
counterfactuals all this does cost more
money
now this is a fence of refund charge you
know you can't miss your flight
I think that's refund charge
that's kind of cool so if I wanted to
hang out now I've been to Taiwan we
don't need to hang out in Taiwan we
could fly non-stop aboard United or pay
a little bit more and fly Singapore
Airlines whoa 8350 I'm gonna five ever
been in a 350 oh wow that's almost worth
it just so I could fly in an a350 ya
know but EVA Air is gonna stop and then
stop and Taiwan to get the China say
this is interesting when did these start
shipping oh cutter
as a pairing of the a330 fuselage with
new aerodynamics features of Angela's
interesting all right how much is
business class let's go let's go I was
just business class on the Singapore
Airlines that's I'm kind of nice I
promised we'd get back to coding in a
minute this isn't this isn't the
googling Airlines remember what I was
gonna use start page last time it's too
slow
oh my god Singapore
yeah I can't one way we go Monday let's
go Premium Economy I don't want Premium
Economy I want business class that's
right
wait I can get a suite I kind of want to
sweet how much is a suite you can't get
sweets what's that a song it's like
Michael Jackson a million dollars yeah
who remembers Das Racist
oh damn it's a little pricey and I have
a layover that Shane worth it at all
what a scam
all right let's go back to get so that
learn but that's a lot of stuff
[Music]
[Music]
[Laughter]
[Music]
[Laughter]
[Music]
[Music]
[Music]
[Laughter]
here's the link of my last stretch
[Music]
all right
sangsik yeah data distribution we're
trying to learn looks like this our
generator and discriminant they're doing
it with one how is this working they're
claiming that they're doing one
activation soft Plus soft Plus that kind
of works is that no it doesn't work it's
a line looks like garbage how long is
the Starbucks
10 p.m. interesting I may claim this
works
it's crappy what's their hidden size
they never tell you what hidden sizes
okay this doesn't work oh yes yes yes
this is yes if you donate $10 I'll wrap
whatever song you want I'll try my best
am I gonna write your new song but like
I'll rap you whatever you want $10 I'm a
whore I gotta I want to afford that
you know that $8,000 Singapore Airlines
business classified not sure I don't
because it was a scam because it has a
layover and I hate layover united
business is probably mediocre man you
ever heard of ithi ad the apartments
that's just nice yeah what do you want
me to rap
I mean if it's like you know we'll try
out all the how I've asked for $10 I am
a whore I will do anything for $10 this
soft Plus looks nice so Kelly
as a PDF viewer oh this is not as good
as Chrome's well no slower to load but I
like brave for the most part they have a
new brave coming out to I was looking
into their their code um
soft + soft + beats Lu should we switch
to the comma AI models - soft + instead
of Lu that wouldn't be tell you ins peer
Lu has parameter that's a scam no no
then I won't have anything personal we
can try to rap Eminem this verse from
lucky me fuck you think man I got a
couple of mansions still I don't have
any manners
y'all got a couple of ghost writers
bunch of these kids it don't actually
matter let it be
let's let it be oh the Beatles song do I
know this song
I'll do one better I'll even try playing
on the piano you sent me $10 I'll try my
best
let's see let's see does it have easy
chords
[Music]
[Music]
yeah we'll do that technology
$10 and we'll sing let it be for only
$10 that's right now I'm not even high
man had a tea at amate today okay I'm
now more interested in like what D you
know what why is so crappy this is
probably the loss function $10 will sing
let it be know about that mr. minute
waters few more samples
I don't know what that means now you
just dead bits are good we love bits
I love making money on twitch
all right let's take a look at the
weights this network they should learn
it doesn't learn doesn't look like that
that's no good
cool let me know when I get the money
we'll start singing
so maybe you can't which which is weird
that like
so wait this is kind of confusing what
does this do oh just add some noise it's
just like adds noise
my learns no good tell me more about my
learn being no good
perfect oh it is biases let's turn them
off because those are complex
okay let's see if we can get the law
slower than this fast UD
I mean are you let's talk about this
like analytically like is there any way
that that's ever gonna fit that
distribution or is that or is a line
really the best we can do and we're
putting through a non-linearity but
maybe it's the wrong non-linearity cuz
I'm crazy like 10h well exactly bias
bias
we got fixes it would buy us thank you
for the money dork while you are bro
love with people give me money on twitch
after Alexa gives me my $10 I'll sing a
song and then if anyone wants to be
singing the other songs if I'm in a song
singing mood will sing songs for just $1
maybe only from in a song singing mood
oh no bro money you love money shot big
batch lower than that okay so maybe I
need a middle layer I'd guarantee you
that net can fit this
trophies discount
this only line it's only line not line
still lied not only kept my flaw fucking
not plain Wow Jay Z line okay maybe we
need bias
my grave my bias
this isn't learning I can't believe that
I need like a three-layer network to
approximate a Gaussian
still not learning
no we learned took a bit but it lurked
see now look how the loss is lower than
the line now like now it's starting to
curve why is this so hard to learn okay
now to learn it what's the simplest net
I can get to learn this distribution
that's pretty decent or something yeah
well most four layer Network even see if
we can learn it without the bias it'll
start there
okay it learns here too
doesn't need the biases to learn
sorry this is AG and we lied again okay
somehow they did it here with like a one
layer Network
look at that beauty
kind of curiosity what if I go the other
way huh that seems easier to learn
I don't know I'm just the loss isn't
just hi out see if it gets rid of those
if I keep going
huh
okay learns that pretty well
they're doing a Gaussian with you mean
for standard deviation 0.5 now that that
matters
you need sandstorm vdr no edge is gonna
be cool
[Music]
obese was game guys
[Music]
[Music]
oh he's got COBOL flux pads you blade I
used to have them pads
[Music]
bro you're gonna slip don't play those
saw although those a rubber shoes DAP
boy my network really doesn't want to
learn I see because this network can't
represent this this is just something
against it learning it now son gun man I
can beat this guy guys not so great on
this shit this shit I could really do
yeah this was all he make that pat
himself
let's try some online stepmania I have
this oh yeah then we can't play online
flash flash revolution
I have to install it from Adobe I that's
bullshit and going back to Chrome
let's s down notice how little he moves
he's a good plan
[Laughter]
Oh
can I call you a dancing master
dedicated to dancing good job 2010 I
told you I'm gonna triple it
oh my who is this guy I like them more
when he was just dancing okay so what
this is bullshit if I can't learn this
with this
try like this now high even higher loss
of it doesn't fit so that's the loss of
a Gaussian if all I can do is get a line
so this thing is just a linear transform
it doesn't have any other Gaussian
properties to it so that probably be the
same law so I just for the line fitting
good now I think I'll use easier to
think about and we need bias
no worky
doesn't even fit a good line see it can
do things like that
I understand why you can't fit this
distribution
this has just gotta be a bug with you
outweigh the lost fell below one it's
learning something now don't work have a
little is like that's clearly a better
fit
weird there's really not many weights in
this network
try no bias wrestler
some hype about like hamiltonian
optimization but train for 100 epochs
does this finally figure anything out
maybe what's doing something
oh it's learning binge didn't let a
train enough last time
look it's learning
do we need GPO
why is this so hard to learn so look you
can see it curves correctly there I
don't know what's going on up there
let's keep letting a train I'll lower
the batch size
it seems like it's guessing I agree up
above all up but it was now the fours
there
it's got a curve that top as well a big
batch size
big batch sizes markedly useless yeah I
mean it seems like guessing actually
works because that's what little batch
size does
you put his genes all right let's
reinitialize it
I mean this is not the many parameters
here what if we can use a different kind
of optimizer
the badges that look
dad
hey remember that one time where it like
bent a little bit that was exciting and
you know what's going on here but it's
interesting with how these optimizers
just can't find
he'll optimizer sounds cool
didn't fit the bottom again interesting
so it does eventually learn to do that
maybe if I put bias back
do we need GPO
proximal autograph
one of these things Nike added biases
and I think it learns less good
your last time it gets the loss down to
like point four then mono we came I've
never heard of this song
oh that's low loss control batch I don't
know about that but show uses a view
initialization by default it's not
actually watt uniform
that's just so tight no
Thank You vicious 5:03 thank you for
subscribing to my lovely channel what
that's a picture
how it is it is it's the same
[Laughter]
[Laughter]
what uniform is better than going on
normal
I wasn't the wait
Kirby
[Laughter]
[Laughter]
to have idea my set wait
some weights
I know we're under fitting I mean I know
we're definitely under fitting nobody
doubts that it's just a question of like
candy is it theoretically possible for
this little network to learn this
function is the question I'm asking now
the answers may be no well so all of
them have positive I think by us it can
without bias may be a can't well okay
you know what will be nice let's try
this
Yeah right technically a little network
can approximate the function I mean this
is what the theory says I don't know
what are they what is a theory actually
say so is this a one-layer net or
two-layer net
I'm even now
it's an extreme problem learning this it
seems
most even bend at all now oh thank you
thank you for coming through okay so I
think we're gonna sing all right so that
is a nice up curve to it now can I give
it a negative curve it's not like
balances out
[Music]
okay Oh locks up for being a bro and
donating money I'll be right back and
then we're going to play the piano and
sing
so extracting engine I don't actually
know the theory on this like I'm not
sure if with the one layer mark you can
approximate everything if all the
linearities can do it I'm smoke along
man boys are kind of the degeneracy of
weed smoking poor iPhone user why am i
poor iPhone user perfect move to piano
look guys it's a USB piano let's bring
up the let it be chords and lyrics
[Music]
mother Mary comes to me
words of wisdom let it be
let's just-okay that's you guys can see
that I'm actually playing the piano is
not fake she's standing
[Music]
whisper words of wisdom let it be
living in the world agree there will be
an answer
[Music]
there is still a chance that they will
see there will be
[Music]
we try to go up the octave again let it
be let it be let it be let it be there
will be an answer let it be
[Music]
let it be let it be
[Music]
let it be
[Music]
all right the likes I hope you feel like
you got your $10 would if anyone else
has any more song requests $10 ah no no
no we're done that was that was that was
singing for today that was dosing uh
what do you guys want give me money give
me money come on someone's gonna pay for
my business class flight to Singapore
now if you give me just give me another
song and we'll negotiate a reasonable
amount of money and I will say we got 20
how much are bits I don't know how this
work
[Music]
it's a P 105 well 20 an effort I thank
you very much thank you thank you
[Music]
no I shan't think I might be done
streaming for now I think we go to
Starbucks there were no Starbucks I'm
going to do some reading so I actually
don't know the theory here this isn't
even Gann just like like what's the
smallest network I can make that learns
to approximate a Gaussian that learns
the transformation from uniform into
that seem to not matter loss crazy hi
wow wow what do you want yeah no I know
I know it's yeah that's a circuit Theory
thing but like so what what song would
you like what song would you like thank
you for keeping the party going
you have another request well thank you
thank you very much I really I really
appreciate it I love you guys give me
money and then the dark boy you didn't
give me any money
Alexa's a bro if he want another song
well actually no I desert girl Starbuck
so that was that was today's singing
yeah thousand bits for ten dollars
that's pretty cool you were number one
bro on my twitch channel today I thank
you for being here people like you that
make this all possible
Alexa you know
I'm very happy I love money
I love making money one day I'm gonna be
rich and I'm gonna move out of this this
city and I'm gonna make something of
myself that's true you mark my words all
right so like it looks like when you set
weights weirdly you get weird shit what
is this now damn look at that function
why is it learning so slowly my learning
rate just - Wow
let's try like L R equals zero point one
let's go crazy with the learning right
see the Lord's learn wait I think that
loss is still I think that's a line
still yeah it's a wine it's not some
crazy weight okay
it's unstable
I'm shacked engaged I'll be back ya know
I'm not saying I don't need
exponentially more units I'm okay with
that I'm actually willing to give it as
many units as I want but it looks like
it doesn't even matter how big I make it
it just doesn't work see what sort of
weird functions I'm getting
thank you thank you I'll be tech
comedian I'll do stand-up I'll move out
of the city where should I go they go to
New York do I have a future career and
what would I do in New York I don't know
maybe I'll trade stocks do you think I
could trade stock let's see let's check
my Robin Hood accountant I make money
guys I bought Twitter stock I blocked
Twitter stock and I lost $15 good to
hear I made it back today on twitch
thank you all for joining see you all
later we will come back and we will know
things about circuit theory go to
Starbucks will read bye bye
um
hello everyone good good morning good
morning I'm at a highball
this
we have another eyeball that's a lot we
could do it though we could do it we can
make it happen
um
all right it's been a while since I've
streamed uh
Comic-Con was uh
a lot
it's just a lot
you know
everything's a lot man
I'm a 33 year old man you know
everything's just a lot of effort now
uh
yeah
um
no I don't know
you do harder things as you get older
so difficult to uh to do things so we
launched the uh
the comma 3x uh our most refined
Hardware yet
um good morning good morning are we on
sub only chat let's make an answer only
for the start and I'm gonna put sub only
back on
don't let Sam wanting to scan your
eyeballs out if you didn't watch my
Comic Con presentation I think it's
pretty good
I've rewatched it a few times
um yeah I know I haven't been on the
stream for a while I got this rack of
tiny boxes that's a tiny box over there
and that's the Tiny Box for SSH and M2
you got the tiny boxes in my living room
um I didn't prep anything for this
stream I don't even know what works it's
it's been a while since uh
I've looked at this dealing with fucking
Qualcomm man you know it just uses a
Qualcomm chip I so much regret uh using
Qualcomm
don't like don't use Qualcomm don't
whatever you do you will regret it they
hate you okay Qualcomm hates you
if you if you want to buy a chip they
hate you okay like that's the only way
to describe it right I've never seen
like the the the sales people have
gotten fat selling chips to 10 people
uh and you want to buy chips from them
it's it's I think it's actually easier
to pull teeth I think if I like like if
I wanted to pull teeth from homeless
people that would be easier than buying
chips from fucking Qualcomm so this is
my quasan rant right hey guess who my
friends are now we're friends with AMD
now we're friends with AMD you know you
know the the Lisa Sue responded
um we're friends with AMD now uh they
they got me uh
great deal but a decent deal on these
gpus you know I didn't get them like
I didn't get them at cost they're still
making a profit but I got a deal that
was appropriate so I bought 60 of them
um
yeah these guys
uh
we got it we got Tom's Hardware article
um
all I'm saying is and also another thing
that we'll take a look at from AMD you
know you guys are like George just sits
and complains and he's a clown and gets
nothing done
um I mean
look at their uptake right
look look at look at look at the uptick
on there on their GitHub activity
it's pretty serious
uh they've started so for rock M uh
they've started pushing a lot more
a lot more things
uh to the repo I don't think they're
pushing everything to every repo yet but
again I mean they're a big company and
it takes a long time to do things and I
can respect that uh but you know just
what I need to see is like look we care
and we are going to make this better
like things that AMD are not okay
it's step one you got to admit that and
then step two is but we're gonna make
things better and that's that is most of
what I ask you right
um I tweeted about Qualcomm and I'm just
like I just you know I can literally if
I really wanted to I could get
billionaires and you know to do to do
activist investment into Qualcomm
like it's not that hard to like but then
I'm like is this really what I want to
do for the next year like I don't give a
shit man like let Qualcomm fucking die
you know like AMD look I complained
about AMD in hopes that this one will be
called qualcommer hand I complained
about AMD in hopes that they would
actually turn things around and I think
they're going to which is awesome uh I
complain about Qualcomm in the sense of
like you know it's like Gallows humor
man don't ever fucking use Qualcomm like
it's gonna suck but I really think for
the next common advice we're gonna end
up switching to this chip
it's marginally better than than an 850
845 but you know the company is a joy to
work with the company is League oh how
many chips do you want to buy okay we
can get them to you this date you send
us the money we send you chips thank you
Qualcomm you send us the money oh we by
the way we send we sent Qualcomm over
half a million dollars for chips
oh oh there's just there's just one more
legal document you're gonna have to sign
yeah yeah we're gonna take your money
and we're not gonna give you the chips
you gotta sign the legal document or you
don't get any chips
okay I'm not signing the document give
me my money back
yeah about that you have to sign the
legal document yeah yeah I know we
didn't tell you because if we told you
you probably wouldn't have bought the
chips but we have your money now and uh
fuck you and uh yeah yeah fuck you yeah
yeah you know I look in the nicest way
possible but fuck you uh and you gonna
sign that document or we're not gonna
send you chips man and yeah you know our
supplier Arrow yeah fuck them too man
fuck everyone we're Qualcomm and look
man you want to have that attitude
that's cool and look the feeling's
mutual you hate me I hate you right it's
all good but uh you know
you you ask why in five years why
everyone's using IMX eights this rock
chip chip
um do you ask why people are doing it
and it's because you are the worst
company in the world to deal with look
my complaint about AMD was about their
software not being good right and the
thing about fixing the software is
there's very few software Engineers who
like want to make your life harder
right there's very few software
Engineers who are like we want this
software to suck this lazy software
engineers and there's not good software
Engineers definitely
um but sales people there are sales
people who are like we want your life to
be bad you don't understand we want your
life to suck and you're like well how is
this possible right I'm like you know
it's just it's just like they they get
off on this kind of shit man it's just
the biggest the the sales guy straight
up lied to me he just straight up lied
to me and like I had documentation I'm
like you lied to me look I'm sending you
the email chain this is a bold-faced lie
and you know do you admit to the LIE no
do you do you do you try to negate what
I said
no you're just like yeah hello I'm a
liar and an asshole are you still gonna
deal with me and the answer is no the
answer is fuck Qualcomm man if you if
you out there are working on a company
do not work with Qualcomm
uh tried emailing the CEO no reply
uh you know you like get through to
somebody but they just they just they
want to waste your time man they they
just it's their their like do not
it's caused me two years of stress right
like it's caused me ever since we've
been shipping comma threes we now show
common 3x says it uses the same Qualcomm
845 chip this has caused me two years of
stress whatever you do if you are
building a product do not put Qualcomm
in it you will regret it you will you
will regret I so much regret like we
should have delayed the comma three a
year and and use this rock chip chip
right
um yeah do not use Qualcomm
um AMD does make an SOC
uh sort of they don't really make an SOC
so you look at the laptop chips the
laptop chips are great but they don't
have camera inputs and you're like okay
I'm gonna have to put an fpga on here uh
amberella guy super nice I talked to the
umbrella guy their chips are just either
underpowered or too expensive mediatek
won't sell me chips but at least they're
not dicks about it you know at least the
media Tech the mediatek I was apologetic
he's like look man like this is our
sales process it was decided by upper
management like he's just honest with me
you know what I mean like I can be mad
they don't sell me chips but I don't
hate the company right like that's just
their policy Qualcomm we'll sell you
chips
three months later oh you want to buy
chips what the fuck you think we've been
talking about for the last three months
yeah yeah there are no other cable
companies yeah yeah
um so don't like if you're making a
product do not use Qualcomm I know
they're good I know they're fast you're
tempted you're like oh I can buy this
song and yeah if you only plan to do a
run of a couple thousand buy the sum
will Thunder come thundercom's not a bad
company to deal with I mean we've had
some issues with them but but overall
like the issues are the like the issues
I faced with Thundercloud they're at
least honest right there's you know
there's there's a few issues
um but like again they're they're like
you see why they're acting the way
they're acting it's not they're not
doing it because they're they're they're
assholes they're doing it because well
you know they have a business too right
you got to respect that right you got to
respect like someone else is a business
and they're incentivized just like
you're incentivized to make your
business great they're incentivized to
make their business great
um and that's fine that's fine right
like you know just like they're
incentivized avoiding certain things
we're incentivized to avoid certain
things it's fine uh Qualcomm that here's
what needs to happen you want to fix
Qualcomm okay fixing AMD really is gonna
just take a couple meetings from CEO and
upper management saying look guys our
driver sucks let's focus on making our
driver good there's a huge amount of
money here right
um and also with software
I can do the software externally right
like AMD this is the beauty of Open
Source right like amd's commitment to
open source means that we externally can
improve their software
right it just makes me feel so much
better about like again
I dropped 60k on AMD gpus right
um
it makes me feel so working with
thundercom is fine uh if you're looking
to make a couple thousand of something
like these songs are okay
but if you plan to go above that and try
to do a chip level design you will never
be able to buy chips on reasonable terms
from Qualcomm uh they will fuck you at
every turn
and they will cause you years of stress
it's just so much not worth it
uh have I unboxed the gpus some of them
some of them are in that box over there
um so uh and get a get a comma 3x while
you can because uh you know
who knows man who knows how many there's
gonna be
um they're they're the yeah they're just
it's so
CEO doesn't reply to me okay don't reply
to me man like I you can tell you know
what you can tell if a company is alive
or not based on whether the CEO replies
to me or not right right if you think
look I can hold my own I'll reply to
this guy whatever man like you know
elon's ultimate of like yeah I can hold
my own whatever man I'll deal with
George hotz no problem right like like
you know his power level so much above
mine and you just know it right and he
just you know he was just like look I
know I'm not a fraud man like whatever
man what's your Todd's gonna do you know
and uh you know that's why elon's cool
man and that's why he makes successful
companies right like as bad as the X
Rebrand is and stuff like I still
believe in Twitter now
the man is just alive you know I'm gonna
put a large blinking X on top of the
thing to fuck with the city of San
Francisco like that shit's hilarious
um
look I whatever you want to say with the
x-free brand man who knows why Elon does
things but it doesn't matter right it
really doesn't matter like
something he's like something has to
change and like I respect that
um look and then there's companies like
Nvidia and and AMD and you know what
I regret saying fuck you doing video
because I don't have strong enough words
for how I feel about clock
the Nvidia
tells chips in 2016 they changed their
mind to 2018 they changed their mind
back in 2020 uh but the chips are too
expensive at that point
um but again you know what I mean like
Nvidia nvidia's stock price I'll tell
you why Nvidia did it right like it's
easy to talk about right like okay let's
look it into the uh stock
why is Google like look when you have it
when you have a stock that looks like
this
like okay respect like you just can't
like they're like look we're doing
something right man why should we listen
to you right
all right here's Qualcomm over the last
year
shit maybe you should listen to me you
know what I mean
you know what I mean you know a company
is really killing it when their stock
looks like this
that's not that great over the last year
but you know it's pretty good
I should buy AMD
it's actually I can't get over their
crazy high p e ratio
yeah I see that's wild no I I mean I
should buy AMD stock I really should
I should have held my Menace talk why
did I not hold my meta stock I regret it
so much
you know I sold here
[Music]
Rex
hey 3x bro 3x
um Tesla's a good buy too maybe I don't
know
I mean they were so overvalued like Elon
even tweeted it
maybe they're not I don't know
um Matt is a sinking ship bro
meta is not a sinking ship Mr Zuckerberg
is turning it around okay
I just didn't have faith I lost faith I
lost faith and oh I lost faith and it
cost me I lost faith and it cost me I
lost faith in you Mr Zuckerberg my faith
has fully been restored I'm sorry for
ever doubting
I'm sorry for ever doubting I listened
to your first Lex Friedman and I was
like shit I gotta buy this company and
then it went like this
ah I'm sorry for doubting Mr Zuckerberg
um you and John Lagoon are goats that's
that's just like like you pushing this
open source AI like you know it's just
it's just respect man respect everyone
knows it's like we're gonna go to the AI
meeting with the government man we're
gonna suck Joe Biden's dick uh and that
is like yeah yeah open source man
because we like the people and the
people know right the people know
um meta does not have a single good
product they have llama too and that's
what this stream's about today
am I ready for the debate so I'm
debating Conor Leahy tomorrow right
um I've watched his other debates and I
think his opponents were absolutely
pathetic uh and this is this is my trash
talking before the debate
um you know
I think some of the people he debated
it's clear that he has a higher IQ than
them uh it's clear that he can you know
just kind of like like run language
around them and stuff and like bro
bro I don't know man actually has a lot
more debate experience than me so I
might lose I might lose he has a lot
more debate experience than me but you
know
um yeah we gotta we gotta oh I bought a
cover for this chair well you think I
bought it out for me so now I have a I
have a black cover for this chair but it
slides a little forward which isn't too
good
ah
yeah but if you want to be lied to gas
lit jerked around one more thing
qualcomm's a great company to work with
um if you are like a normal person and
like everybody else whatever you do even
if it costs you more money even if it
costs you more time even if it costs you
more hassle even if it's going to hurt
the performance of your product a little
bit do not use Qualcomm you will regret
it I regret it don't be me don't use
Qualcomm why the hell did I put Qualcomm
chips in my shit right just just they
hate you they hate you trust me they
hate you and it's not it's not comma by
the way it's not comma this has nothing
to do with comment there's nothing to do
with me
I hear this from every single person who
I talk to who's made a similar product
some of them were smart enough to not
use Qualcomm some of them were smart
enough to see the writing on the wall
like I was trying to rent a condo two
weeks ago and like
you know I'm talking to this woman and
she seems okay to me and Alex is like
and you know what you see like I don't
have maybe I don't have a good feeling
for that right like I just trust people
I just I just I can't believe I can't
believe there's people in the world who
are just so who just complete like like
not even Zero Sum assholes they're just
like fuck you man I've had six
bankruptcies in my life and fuck you
um yeah
so
uh media Tech's not exactly a pleasure
to work with I mean again the
alternative is Rock ship I think this
Chip's gonna kill it I think this chip I
you know I'm still waiting on a quote
for a lot of them I gotta I got a quote
for a thousand pieces but all right give
me a call for ten thousand hundred
thousand pieces if the quote's good
as much as it's gonna suck
uh we might we might switch
um yeah orange pie five I mean they're
they're 100 bucks the whole dev kit and
you can buy someone Ali for uh for like
like so you know the chip can't be too
expensive
um said exynos I mean the problem with
like X nose and high silicon is
basically it's the Chinese and Korean
government so like you know you want to
work at a government
um we don't have lava 70b running on a
tiny box yet oh that's a banned term
that's a bad term not talking about that
um
this Chip's already doing great yeah
yeah I think look
like do you wanna I mean it's more
powerful than A45 it is more powerful
than an 845 it's not Generations more
powerful which is upsetting like if I
could buy rock chips look I mean the
comma 3x is the Qualcomm chip
um I will get the Qualcomm chips there's
a lot of ways to get them uh should I
should I build a factory in China that
takes phones apart and pulls the chips
out of them and re-balls them I will do
this I will do this uh
uh yeah
all right
all right are we through rage today uh
how are the specs on a rock chip that
they're okay
they're they're better than the 845 but
only a little bit
um
here are the results uh yeah there
I don't know what this is being compared
to you have a comparison to an 845
their gem scores a little better than an
845 you put ddr5 memory on there if you
want to
um the common 3x is really good though
like I'm sorry you don't have to deal
with Qualcomm okay you don't ever have
to think about Qualcomm the chip does
work
oh also also another fuck you from
Qualcomm you buy the chip
yeah the hypervisor yeah that's
qualcomms yeah you can't uh you can't
change that there's two signing Keys
there's your signing key and then
there's Qualcomm signing key and of
course Qualcomm signing key is burned
into the chip when you buy it and the
first step in the boot chain it's not a
ROM it's not a ROM I understand why ROMs
burned into the chip but you have to put
the Qualcomm spyware in there
yeah that's what this company thinks of
you doesn't matter if you buy the chip
Munk hypervisor that's right that's
right
um have I watched his other debate yes
I've watched his other debates uh don't
worry I'm I'm PR I'm prepared for uh
I'm prepared for 100 John Von Newman's
to come at me man I'm prepared don't
worry
um so they sell a license to the chip or
they'd love I mean you can't that's not
legal but they would love to sell you a
license to the chip
well I'm sorry we're revoking your
license yeah yeah
um
comma has no spyware and you can read
our shit bro uh
uh but yeah just just please please if
you're building something right now if
you're if you're in a company right now
and I really think this reaches the
right people if you were at a company
right now
um and you are using Qualcomm or
thundercom or enforce or one of these
companies that builds a Psalm around
Qualcomm if your plan is only ever to
ship a couple thousand devices then it's
fine but if your plan is to ship you
know fifty thousand a hundred thousand
do not use Qualcomm you will regret it
you will
uh
uh yeah you're well you will I regret it
I deeply regret it is it hard to shift
to mediatek chips they won't sell you
the good ones they only sell you genues
and they're crappy no I mean this is the
chip like you have to switch to this
chip switch this chip
if you're if you're at a company right
now and you're using a Qualcomm chip
switch to this chip or if amberella
works for you you can also use ambarella
I mean again I haven't used amberella
but
I've heard good things I mean I've heard
that like they work you know
um
2001 Eliza versus 2023 elizer let's go
let's go keeping it OG
um what about making your own chips well
this is one of the goals of the tiny
Corp
um
it's a long road
uh
uh you know it's a long road
so we'll have to switch Tiny grad over
to this you know what if someone from
Rock chips watching Rock Chip are you
coming out with a better chip this year
I'd love to use it
I'll I'll pay a bit more I'll be an
early customer we do a great job
supporting your software we'll get stock
Ubuntu to run on there
um I have like just come out with like a
five or four and a half five four five
nanometer chip
uh if you come out with a four or five
nanometer chip that's like 4X the
performance even 2x the performance of
this one
uh
a ton of companies will use this ship
over the next five years
like I I you know we're the Bellwether
man like for the Qualcomm stuff where
the bellwether
we it's very clear that we are one of
the first companies to try to ship
Qualcomm in like a robotics iot
application
uh do not use them you will regret it
don't do it Rock Chip what do you mean I
just want to buy your chips man
uh
yeah so initial capital investment is
very high testing is very high it's a
very complex thing to build
um Rockchip won't listen to my
suggestions why it's not like I can like
they're either building a new chip or
they aren't right they might get me they
might get me access and tell me about
their road map a few months early I'm
not going to be able to convince them
I mean look I'm looking to buy a hundred
thousand chips basically like comma's at
100 000 scale
um
it's it's clear it's clear uh it's clear
qualcomm's not it
we tried to buy chips from them I put in
a 10K test order and it was an absolute
nightmare I was lied to by the salesman
uh it took a month
and then we sent them the money and
they're like yeah you're gonna have to
sign this legal document oh what the
legal document basically says is I'm not
you know I'm not going to get into it I
don't know I don't know what sketching
ndas that Falcon thinks they have on me
but like
uh yeah
yeah they are not a company you want to
work with run as far away as possible
did I forget to bribe the sales guy yeah
maybe maybe I had to hire a lobbyist I'm
starting to think that's what you
actually have to do if you seriously
want to work with Qualcomm what
lobbyists did you hire you know
um who's currently buying them okay so
basically the way that Qualcomm works is
they sell to like eight Android phone
manufacturers and they sell such large
volumes to these phone manufacturers
that like again the phone manufacturers
have set up a pipeline and they've been
buying the chips for 10 years so
Qualcomm costs on this business but yeah
we know with a high-end Android Market's
going right
um
so who's currently buying them not
companies like comma commas ahead of
everybody like I mean just look at I can
show you the thunder come song We're
shipping like I know how many of them
are sold where you're not the majority
but I think we're probably the largest
customer
uh and yeah
uh Google is packaging RM IP with some
ICS on top
I know well top end Qualcomm has good
stated perf
I know and that's what sucks about it
and that's what really sucks about it
but like I'm to the point that I'm
willing to be several years behind
bleeding edge to not have to use
Qualcomm
um
oh Google switching to Samsung yeah I
don't know look Samsung you can't even
get in touch with anyone at Samsung like
it's it's if that was Qualcomm but what
they did was waste my time what they did
was make me think that oh yeah it's easy
to buy chips two years later
fuck you
um
why do other companies not get tired of
Qualcomm they do a lot of people feel
how I do I'm just I see like and that's
the difference between me and a lot of
other people right a lot of other people
are okay oh we're just gonna go along to
get along like okay they're terrible you
know we're gonna I'm like fuck man if
I'm not doing this to be honest and have
integrity why am I doing this you know
what I mean if I'm working with people I
hate all day
like I don't want to do this you know
what I mean
like it's not worth it to me I love
these things
is Mario shkreli my Nemesis no way man
would chill
[Music]
um
uh Scotty and I are chill ah
all right so I'm actually going to comma
for lunch to do debate prep so no coding
um I just honestly the Qualcomm thing is
just it's been it's been aggravating me
so much
I know I know and it's like all right
man like why do you let this stuff get
to you it's just like
I don't know I just I spent a lot of
time thinking okay so what's actually
the play here what's actually the
strategy and like as much as it's gonna
suck I think this is the strategy
and you know no one knowing to come is
going to want to hear this because
they're gonna do a port to this thing
and there's gonna be you know just just
software bullshit you'll have to work
around and deal with and it'll take a
long time to make it stable but there's
no future like I want to sell a million
of these things right
and that just isn't gonna happen with
Qualcomm
again you're limited you're limited to
yeah
uh Khan is a real Doomer yeah no no no
no but I'm not a Doomer man that's the
thing I'm a local Doomer but a long-term
optimist
um all right so let's go give me what
his arguments are gonna be and we'll do
a little debate prep now I'll go in 15
minutes I gotta go get lunch and then
I'll come back and we'll do the coding
all right
because I care I do care I do I really
do
um I do I care and like if it's gonna
suck it's just not worth it if it's
gonna suck if I'm if I'm dealing with
people I hate you know just it's pulling
teeth man I'm not gonna do it look I
don't get it why don't you want to sell
me chips why don't you want to make it
easy for me make the chip for this much
sell it for this much like it's not even
a money question it's don't lie to me
and don't Gaslight me like just don't do
that
uh
how will I stop some depressed
programmer using AGI from making viruses
bro
how do you stop depressed people from
blowing up buildings do you know what I
mean
like like are you worried about
terrorism has the U.S propaganda gotten
to you so much that you think there's
terrorists out there aside from the US
government
uh the Qualcomm issue was neither
technical nor Financial technically
their chips are fine I'm okay with the
price they are just complete assholes to
work with
they they lie to you they one more thing
you I sent them they have they had half
million dollars in my money right now
and they're like yeah we're not gonna
send you the chips until you sign this
legal document no no talk about this
before no like oh you're gonna have to
you know here's the process you're gonna
have to sign this document just like
we're gonna wait till we have your money
and then say nah we're not gonna ship
and you see the thing is most people
will get to that point and they'll fall
for this one more thing they'll fall for
this appeasement not me fuck you give me
my fucking money back like that's how it
works and I hate you
um you know
it's a baby switch it's a bait and
switch uh and you know if the thing is
with a lot of these things it's like
when we got sued by the patent troll we
got sued by Patent troll last year I'm
like fuck you man all right let's go to
court I'm gonna send a pi I'm gonna you
know look into you see what you're up to
man see how sketchy are turns out the
guy's mad sketch right like
you know of course you're a fucking
patent troll right like your sketch guy
um
uh will I sue no don't give me the money
back they'll give me the money back I
mean I'll sue if they don't give me the
money back but they'll give it back
um you create Saga with that guy
my dad like a fucking asshole man like
look you know what he dropped the
lawsuit
I didn't pay him shit like you don't
fuck with me I don't fuck with you man
I'm not I'm not gonna like I'm not gonna
chase you down I'm not gonna I'm not
like I'm not here for Revenge I'm not
trying to make you pay I'm just saying
you know like leave me alone
uh are you dead okay you want to leave
me alone you leave me alone you want to
try to come at me again bro you opened a
can of fucking all right
um
yeah no I I I I I yeah again like
there's degrees right there's degrees
there's companies we have problems with
and then this Qualcomm right worst
company I've ever dealt with I deeply
regret using their their stock
uh they didn't they don't I mean they'll
send it back to me I sent them the
wiring information I'm like give me my
money back
um
yeah yeah exactly I gotta get the
Qualcomm thing out because I gotta be
focused for beating kind of Leahy
tomorrow let's go
um can I buy them out of China yeah yeah
so there are there are great Market
sources for Qualcomm chips we will be
able to get them we will be able to
finish out the run of the comma 3x
there's just no future in them
right like I can get look I can get
20 000 maybe even 50 000 chips but if
I'm trying to build a million you got to
avoid Qualcomm
uh yeah Oracle I wouldn't even touch
Oracle I would never touch oracle man
um what were your options to avoid
Qualcomm from the beginning
uh I mean that chip wasn't out yet if
that chip was out we probably would have
went with it yes I've watched a few kind
of lady debates
uh yeah all right so we're just gonna
take this in a New Direction you know
how those like critical theory people
are like let's debate Universal Health
Care no man we were slaves and they're
all racists all right all right so fuck
AI safety I just want to spend the next
30 minutes 90 minutes talking about how
terrible Qualcomm is and I hope
everybody's okay with that
Joseph Jacks did not have good comebacks
you know you know we got the fire
comebacks you see like the trick the
trick to debating I think is you just
gotta you just gotta like like take it
off you just gotta take it in another
Direction man you gotta just you gotta
just you gotta just yeah all right
uh we was king
um you can't remember the drama and hot
takes good because that's all the stream
is we'll get to coding in it we'll get
to coding afterward
um I don't know I ranted about AMD and
things got better I rant about Qualcomm
I do not think things are gonna get
better
empty I was
yeah you know like I said
everyone wants amd's software to be
better AMD software and does every
single person in AMD care no but do some
people care yeah that's enough does Lisa
sue Care I think so I think so
um does does Cristiano Aman the CEO of
Qualcomm care I don't think so I don't
think he was a shit man I think I think
he's been in Qualcomm 24 years and he's
like yes yes this is how we do business
and we will always be the best and we
will treat everybody else like shit and
um they will buy our chips anyway and uh
we'll see how long that lasts bro we'll
see how long that lasts
um
yeah no I mean Intel's fine Intel's fine
too I I spoke to ex Intel person did the
gpus there okay we're not hating on him
talk I said nice things about Intel I
mean the problem I have with Intel got a
bunch of their gpus in the rack up there
uh the problem I have with Intel is just
that their GPU it's not it's not dense
enough it's 400 bucks and like it has
the power of a 400 GPU but again this is
not a like I can't I can't like be
matted Intel for that you know what I
mean like it's actually a pretty good
product for you can't be mad at like
McDonald's if you know you're trying to
get like a steak and they don't have
steak like all right you just gotta go
to a steakhouse man
but once you're in a steakhouse you can
be mad that your steak is cold
or that they're gaslighting you and it's
two years later and there's no stake
oh you're gonna have to sign this legal
document oh yeah no you're gonna have to
sign away all these rights of yours
before we can give you a steak Yeah
that's right that's right and you
already paid for the steak Yeah
um this takes a lie all right come on
uh yeah Intel Arc you know what it is
you know and you know what it is and I'm
serious look I'm not gonna I will help
you I'm happy to do phone calls to
advising I think um the daniman who's
the guy big activist investor came into
Intel and he's like we're gonna fix this
I think it's happening
um
maybe maybe it's the Jim Keller Legacy
you know uh I don't know
uh
uh how long until the first risk five
based comma look I wanted guys I won so
badly I'm
making an SOC is hard let's first try to
get something on an fpga
the rights are actually the the legal
document that they want us to sign I
don't even believe is enforceable
it's a completely unenforceable like
waiver of your rights like if you're
selling a toaster and the toaster
manufacturer tries to get you to sign a
document that says they're not liable if
the toaster burns your house down
like they can force you they can ask you
to sign that document but a court won't
enforce it I actually think what
qualcomm's asking for right now is not
even legally enforceable look like I
could take that route I could take that
route you know I could like show to my
lawyer and be like they can't actually
ask for this camera is like yeah they
probably can't they probably wouldn't
stand up in court but it's not even like
that like then you're playing into these
people's game you know what I mean and
I'm just not like I don't want to deal
with people who hate me like why would I
deal with you
um we hereby claim all the right to the
bread that you insert into this toaster
that's right and your firstborn child
that's right I'm sorry I'm sorry you
bought a general electric toaster yes
we're coming to take your firstborn
child mm-hmm
um look I don't know General Electric
what are the contract say again I can't
really go into it it just I I can't
believe and by the way this is after
they took my money they didn't like ask
me like they didn't like well they were
not like up front and said hey look
here's the process to buy chips here's
the price and you're gonna have to sign
this contract no no no no no first they
start with here's the price
then a week later
yeah yeah we're gonna have to and we
like agree to a price and they're like
yeah we're gonna have to alter the deal
you know pray I do not alter it further
yeah
and then you know huge back and forth
about the most inane bullshit
two months later we send them the money
yeah you're gonna have to sign this
legal document yeah you're not gonna
ship you the chips unless you do you
gotta sign it yeah nope nope you're one
more thing me take your fucking chips
back give me my money back I'm never
working with you again
um
just don't deal with assholes man I
don't hire assholes and work with
assholes and if you think I'm an asshole
well you know don't work with me right
um the business world's Rich real no I
mean these people are like I don't know
what it would take I think that the
sales people have very messed up
incentives uh I I mean I do think this
is fixable I do think like compared to
compared to Twitter Elon could turn
Qualcomm around so fast
um
no the money's not that big of a deal
it's not like it's not like part of our
like operating budget like we get we'll
get it back when we get it back it's
fine comma's doing pretty well we're
pretty like we're we're doing fine
profit-wise I just like I want to grow I
want to tell this thing to everybody and
there's no way to do that working with
Qualcomm it was it I mean it was we
bought 10 000 chips it was about half a
million dollars uh it was a test order
like I put a test order in and a good
thing I put a test order in right good
thing I didn't agree to real quantities
um I'm still feeling bearish on Tiny
grad
um
no not really like it's the right idea
just like this is just it just upsets me
man just
like why
like we should take all the people who
want to make the world a better place
everyone who wants to make the world a
better place should move to one country
all right
and then everyone who like wants to like
prevent the world from becoming a better
place
you can stay in your country and do
whatever you want man like I I think
that's like the future of this and I you
know I don't think the line should be
all right here we go all right ready I'm
starting this is my leggy debate shit
all in all Segways right
um I don't think a line should be like
Democrats and Republicans I think the
line should be acceleration and
deceleration like if you want to stay
over there in your little country and
you want to like
conserve and you know just circle jerk
all day you can do that and then there's
the people who are like nah like we want
to accelerate we want to use more energy
we want to make everything great we want
to like like all right cool
like that's who I wanna that's who I
wanna be around you know what I mean
um
I didn't look Yak you know once you once
you put a label I'm not an IAC like once
you put a label on something
it's just like
you know now it's like okay how does iak
feel about uh what's our position on
raisin bread we have to have an official
eak position on raisin bread right and
this is the problem with like political
movements I'm not it's not a political
movement it's just a vague idea of like
we want to use more energy right
you know you got you guys know this one
I love this because this is like very
unambiguous and this is a very
unambiguous like political statement
that I think nobody can twist I want the
blue line to go up
right
that's it
you want to be capitalist you want to be
Communists you want to be socialists you
want to be fascists who makes the Blue
Line go up
that's who I'm interested in I don't
care what your ideology is I care about
number go up ngu technology bro
um Blue Line go up
uh yeah all winners underpowered you
look you look at I just bought a vacuum
I just bought a robo Rock vacuum and
they use all winter because like that's
what you can get like the reasonable
company
I don't give a shit what the blue line
is used for I want the blue line to go
up
no blue go down very bad number go up we
want number go up right you see see blue
go up blue go up blue stop going up once
you know
uh I don't know what happened here a
little sketchy man a little sketchy
money gets fake blue line like this
money real blue line like this we make
money real blue line go like this okay
all the energy goes to crypto do not
care bro like it's just that's like and
you know you know what's great if we
actually separate into two countries the
XL country the accelerations country and
the decelerationist country
who do you think's gonna win a war right
the guys with drones and laser weapons
or the guys with
harmony with nature circle jerk commy
shit yeah man
he's great I'm not hating on Energy
Efficiency
like I'm just saying number go up right
like you know what's great it's great if
I can spend my dollars and buy I was at
7-Eleven last night water was four
dollars I'm like I'm not paying four
dollars for water like we got to draw
the line somewhere and you know what the
worst part is in a year I'm gonna be
like four dollars for water that's very
reasonable because jerking you around
man
starts at the top you know qualcomm's
qualcomm's just just there's people
above them who have the same mentality
um what would the world be like if the
blue line was twice as high oh man we'd
all be flying first class all right
let's start that we'd all be flying
first class
um
I don't know it's hard to even imagine
like just like you're sitting there in
1900 and they're like What's the world
gonna be like when the blue line Looks
like this you know
um
until Earth boils why is it gonna boil
global warming doesn't have to do with
this number guys
global warming is caused by largely due
to the
you know why global warming happens and
you know what's not this number
we'd all have girlfriends I don't know
what that some of you guys are hopeless
man
when I get canceled what the hell am I
gonna get canceled for you know what I
mean I have the most Normy opinions on
everything
like like I just say them in a certain
way you know what I mean like what do I
think man
what do you think I'm gonna I'm gonna
get cancer for I'm I'm I'm I'm I'm you
know let's see the vaccine
it's okay yeah that's all right uh what
else might have normal opinions on Bill
Gates
I don't think he's that bad of a guy
that's right you know what I mean
um let's see what else what else might I
have bannable opinions on uh are trans
women women
man look I you know whatever man
whatever you know on the internet no one
knows you're a dog and you know it's all
so so good man
um if you would like to like use like
performance enhancing drugs and compete
in the Olympics I'm cool with that man I
think like if so cool man like let's see
super Usain Bolt you know what I mean
let's let's let's let's make them all
let's make it awesome the augmented
Olympics look it up
um
someone's gonna misinterpret my view on
eugenics and then what are they gonna do
they're gonna call my boss oh hey hey we
gotta this George hot Sky man I'm sorry
you know my line you know my line about
the HR department right they're gonna
call my boss at the tiny Corp
are you gonna call A Tiny Box you're
gonna you're gonna tell the tiny box
that that they shouldn't work at my you
know what are you gonna what are you
gonna do man my views on Eugenics are
that good genes are good very simple bro
very simple
um they're gonna force me to work with
Qualcomm no no don't do it don't do it
um
no no Blue Line go up no no we need blue
line to go up
what's my nootropic stack I don't do any
of that shit
uh
gonna call my boss in the upper World yo
you're gonna call God oh God bro if you
got the hotline to God if you're calling
God and you get God to talk with me if
God wants to cancel me God can you know
God can cancel you God can always cancel
you but I think I'm doing it right by
God I hope God agrees
goodness in my heart uh I think I don't
know man everyone thinks they have
goodness in their heart except for does
everyone think
that my phone thinks it's a good guy I
think I think
ah have I found my flaming sword yet no
I'm still looking
when llama oh I got I'm going to lunch
I'm going to lunch
I need I need another day to decompress
from being angry about Qualcomm
like it's just you know you know when
you're just gonna have to put in a crap
ton of work
and and you're just like
and then I mean again it comes back to
really what tiny grad's important
um Apple's not chips if Apple wants this
apple never sell chips
uh only God can cancel me t-shirts yeah
I love it I love it only God can cancel
it
um
Alex Jones Show view party
see there's a thing and like I saw I saw
a good YouTube comment and it's like
whatever you think George's politics are
you're probably wrong
like the Alex Jones Show
like you're right he's got some like
cool like like
Infowars is a good name but like a lot
of its unhinged conspiracy theory stuff
I don't really believe in that many
conspiracy theories you know
like I don't think like like I it's
clowns all the way down you know it's
not it's not there's no there is no
cabal of the secret Elites they're just
like
you see them you can Google them you can
look up their phone numbers on
whitepages.com you can call them and ask
them why they're in the cabal of secret
Elites and they're just confused
uh what is one real conspiracy I believe
I told I said this on Lex the conspiracy
theories were invented in the 70s by the
CIA to try to discredit true shit that
the government assassinated Kennedy
right
is that a conspiracy theory the
government assassinated Kennedy right
we did land on the moon though that
one's true
um
yeah Alex Jones and the Sandy Hook thing
like you know I I look everyone gave him
shit for that he apologized like I don't
think it was as big a deal as like he
made it like I think it was
you know I don't know I said you can't
even like follow any of this shit do I
think the guy should be taken off of
YouTube no I think that's ridiculous
right
you know what it is it's not the
mainstream media's product is so bad
that they're being out competed by Alex
Jones so they used hard power to take
the guy off YouTube
we can't compete with the frogs or gay
guy we got we gotta we gotta we gotta we
can't spread our propaganda well you
know the joke about like the uh the
Soviet talking to the American and the
Americans like uh yo man you got some
serious propaganda over in the Soviet
Union and the Soviet guy's like yeah
yeah I know but you know it's really got
nothing on on the propaganda you guys
got in America and the American guy's
like
wait what propaganda we don't have any
propaganda in America and the Soviet
guys
[Laughter]
ah
oh God the last thing I ever want to
talk about you know what you're not even
a subscriber the last thing I ever want
to talk about is Andrew Tate okay
okay it's the last thing I ever want I'm
gonna sell you a sigma mail Discord okay
you want to join my Sigma mail Discord
I'll tell you how to Sigma mail shit you
know like Andrew tastes like I got an
alpha male Discord that's what we made
his money by the way I'm gonna and and
you know with the with the girls uh I'm
gonna sell you a sigma male Discord okay
who would buy who would buy access
um 69.99 Sigma mail Discord I'll I'll
teach you all the secrets to to to to
avoiding status games and hierarchy but
being on top anyway what do you think
being an alpha male that's a lot of work
are you lazy but want the same success
rewards and status that the alpha males
get be a sigma male join my Discord
69.99 what do you think
um if you're an FM boycock shit I can't
help you bro
um
oh unisoc I think I've looked at unisoc
hang on I'll look at this chip quickly
uh you will also teach you the secrets
of programming Life The Mysteries of the
universe you'll get early access to um
to all Revelations written on Golden
Plates whatever else you want
wait
I've looked at this chip I like that
it's six nanometer what was wrong with
this chip
how new is it when did this come out
I don't think do they not have a uh
wow it even has
my single board computers
no this is a different
foreign
npu computing power reaching eight tops
like this is actually interesting
uh how many cameras can I connect
oh
wait
this is legit I don't know why I ruled
this chip out because I've looked at
them before maybe I didn't see this one
maybe I just saw this one
unisock
no I know rock by 5B I know the rock
chip one but this chip looks better I
mean it's six nanometer
is there a dev kit
[Music]
um yeah all right so I see what the
Reddit people are saying
where's them to being a single male stop
hey hey bro bro you're giving away the
alpha on my Discord bro you're giving
away the alpha on my Sigma mail Discord
stop doing that man people gotta pay
69.99 for that kind of shit
do I take business proposals by email
only if they come with thousand dollar
checks
if you would like to be paid a thousand
dollars to be told that business
proposals are worthless and it's only
implementation that matters I will
absolutely charge you a thousand dollars
for that or you can get this Alpha free
in my Sigma mail Discord just 69.99 per
month but you have to buy a year in
advance because I'll get lazy in a few
months and stop maintaining the Discord
and I want to have your money in my
pocket
by the way if anyone out there is
selling you early access to the Discord
it's fake uh only buy from me on
geohot.com if we do actually do the
sigma mail Discord should we do it
should we do it boys no because I'm not
Andrew Tate there we go
[Music]
well the sigma mail Discord show you how
to lift weights even better it'll show
you how to not need to lift the weights
when you are ready the weights will lift
themselves
remember when I see
a nice huge scam I was like damn how
could I get rich Oh wait shit no I lost
five thousand dollars oh that's right
that's right but you wanted to scam
people he wanted to he would have man he
would have
you know what's great about the haters
when you just know it's not like it's
not true like people can always make up
fake stuff to Hate About You no matter
what man you could say that like you
know like you could say like the guy
cheats on his wife and murdered three
orphans but like it's not true man
what's the cheap ethlore oh yeah it's a
boring stuff you could read I tried to
write some funny stuff about whale gate
but like like some people like took it
seriously this is what you get in crypto
you just get these people who are just
like bro bro this is why you are the
reason I support Bitcoin cash because
they don't take themselves too seriously
buy a coffee with this crypto no
what the hell is it though
ah one cheap eat equals one cheapy
that's a true fact
uh cobras.com
I'm not I'm getting getting after my
debate tomorrow right and I I gotta go
to Food uh
wait it comes with 5G can can I buy this
a little concerned because this chip
looks rare like it's not in phones
how much you charge to teach all the
mistakes you think you've done
uh we're gonna have to buy you're gonna
have to buy premium membership to the
sigma mail Discord it's 10x to money but
it's so worth it man it's like buying a
yellow check on Twitter
um
you cannot recommend unisot because
they're chip soccer because the company
sucks
domestic sales are all people reach out
I gotta go lunch we're gonna do llama
after lunch I'll be back maybe I give
myself like a 70 chance of being back to
actually code and not just complain
about how travel Qualcomm is but we can
just call this video complaining about
how terrible Qualcomm is because that's
really all I've been thinking about for
the last two days and how we're gonna
how the World's Gonna how will the world
move forward without Qualcomm that's
really like the the you know the world's
gonna move forward and qualcomm's gonna
you know
I mean like these companies don't ever
die it's kind of interesting like we
were talking about like IBM like IBM
still exists
how is their stock like these companies
just kind of become like zombies right
like there is still an IBM it still has
a market cap I don't know what they do
it's like maybe everyone who owns IBM
stock just died
and then they just have the IBM stock or
something like I don't know man
um
and like like this is another one like
unless I mean and it's possible they
will change things right
like Google's just in like a really bad
era but I mean like Microsoft was in bad
errors and they turned it around too
so like it's possible that new
leadership comes in kicks out all the
wokies from Google and like ah we're
gonna make a good company now and that's
possible like Google Google is still at
the stage where they can turn it around
but if Google continues on this path for
the next 10 years The Whole World's just
gonna pass them by right and we're going
to be talking about Google the way we
talk about myspace and dig and stuff
like yo okay so there used to be this
company called Google right and like
they were the main front page of the
internet and everyone would just go to
them
uh but like you know
the company stagnated did nothing for 10
years got overrun by the worst kind of
woke management oh yeah woke I mean
really you're gonna have to study you
know like people study the 60s and the
hippies people are going to study like
the the late 2010s early 2020s and
they're gonna eat like hear stories
about like okay so there was this mind
virus right and it was called woke
um it didn't really like like mean
anything it was basically just this like
absolute tyranny on social media
um it was it was like it really I mean
if you really want to go back to the
origins of woke I mean we can talk about
woke's Woodstock which was gamergate
right like gamergate really really
kicked off woke officially right like
the history of this the history of this
era is gonna be is gonna be uh
funny to read you know and then like
we'll be telling our kids someday yeah
shit man you know we had to live through
this and the kids are gonna be like Whoa
man sounds cool the world sucks so much
today I just stare at my Tick Tock and
jerk off all day you sound like you had
something real to fight for and we'll be
like you know
Woodstock sounded glamorous in theory
until you were actually like there and
in the mud and people died shit man I
wish I went to Woodstock but see I
wasn't born in that time right you wish
you fought in the gamergate War you you
were there in the Harbor Hotel to close
the pool do you wish you were there you
could have been there do you wish you
were there wearing a guy Fox mask
outside a Scientology office in
Rochester New York you do you do that
was the Glory Days man do you wish you
slept outside at zuccotti Park man I was
there I did that shit you know all day
all week Occupy Wall Street right like
it's all it's all great man you know
um
yeah yeah uh
uh you don't know what to think about
open AI anymore I mean you know look
soon they're gonna merge with World coin
man they're gonna have your eyeballs I'm
telling you man I'm telling you George
told you don't listen scan your eyeballs
I don't know I don't think Sam Altman's
actually the worst guy like I think he's
in the right guy I think he's like
he's like right on the edge of scammer
you know what I mean
like like his stuff's kind of I just
wish he was more like
like in some ways elon's right on the
edge of scammer too but like elon's at
least got a good sense of humor you know
like he makes us all laugh right like
it's all good and he actually delivers
some stuff right if someone delivers
some stuff and he makes us laugh last I
don't know you know
neutral evil something like that I don't
know
um
[Laughter]
coin orb can we look at a world coin orb
man
[Laughter]
um
how is spending company funds
misappropriately accidental did Sam want
to do that
it's like cruising open AI are kind of
like
Tim Walton's actually gonna lose like I
I think what ends up happening is GM
eventually kind of shuts cruise down
Microsoft eventually kind of like takes
some Talent from open Ai and tells like
all like the unlimited money dreamers to
be like look man we run a real company
we've run it since the 70s right 80s
uh yes I think someone kind of just
loses and which is actually kind of sad
like like because what replaces him may
be worse than him
um I mean it's at least make a new orb
like he actually made orbs and like got
people to line up around the block for
them like you know you can respect that
right
like look I look I think I think I
tweeted uh you know when I was on
Twitter I was like I'd rather uh you
know I'd rather be paper clip than live
under Sam Altman's Jack boot and like
that's true
um
yeah effective and altruist I'm not even
sure he's gonna look effective altruism
is just really bad these people are I've
heard stories about like their you know
their their their their their parties
and their events and it's just
it's like it's like a cult man it's like
it's kind of fucked
but like what do you do about it right
are they gonna kill a large amount of
people I don't know
laughs
no orgies nah it's all dudes man it's
not an orgy it's a gang bang like that's
that's if if there's any sex parties
with EA's they're gang bangs they're not
orgies
um ethically sourced hookers you know
a lot of Lux is rating hello welcome
um welcome new people we didn't actually
do any coding today we mostly complained
about Qualcomm shield for the sigma mail
Discord which doesn't really exist don't
fall for scams and uh
uh
sizza is great and the best thing on
Utopia reverse harems what about exls I
mean they're better than the A's man but
you know you're part of a movement and a
movements are kind of hard these days
but I'm on board with anyone who wants
the number to go up you guys know the
number was a number
uh not that no
what number is this
oh it's more number okay well the Blue
Line anyone who's on anyone who wants
the blue line to go up you have me as an
ally you tell me how you're this is
another thing this is another thing you
gotta respect Elon for he's making the
Blue Line go up
by rockets and cars use a lot of power
uh Blue Line go up current thoughts on
Bap has there been any Bap stuff lately
I mean if you guys can read bronze
mindset like it's a classic man it's a
it's gonna go down in history like I
don't have a Bronze Age mindset here but
like here what do I have here
um yeah let me read this
like it's like guy and reforms his
mindset you know it's just it's a book
it's a philosophy book
it's a philosophy book it introduces
some interesting Concepts
um
by showing off a tiny box that's a
prototype
uh all right are we gonna code
how loud is it all right you wanna you
wanna spin it up to full
oh my God we might lose power all right
so I limit the power on all the gpus
except for the first one
let's do some quick math on what that
power actually is
should be fine yeah that should be fine
but I have like this light on and stuff
too all right let's say
[Music]
so that's it
it's burning now
it's very quiet
like you didn't think you could build
things this quiet but like we did it uh
so you'll see the fans will kick on in a
bit
foreign
case the the I have a I'm making a
custom case for it that's going to look
a lot better
so again now we're getting some fans to
turn on we'll give it a little bit for
fancy count on so we can also do I just
pushed this repo the Tiny Box repo
um
so we can do test disk
discs aren't I don't know why I'm not
getting seven across the board
like one of them slower
but it's not PCI I think it's actually
just the weird Samsung desks
I think the one that I'm on is because
it's yeah
okay so here it's spinning up now
like it's Audible
is it really working I told you it's
dead quiet guys
uh here you want to see uh you wanna see
uh this one's pretty cool too
so this is the interconnect bandwidth
Matrix
oh I don't know why that one's slower
right now
it's usually not
maybe because I set the power
differently on one of them
huh
um but you know I mean they are they are
fully connected you can see here we're
getting the full uh
transfer bandwidth in One Direction
yeah let me run I'll run the reset GPU
script
you can hear your laptop fany guys it's
a really good computer I mean they cost
fifteen thousand dollars but
you're going to be happy with it I think
I mean I'm building the Deep learning
box I want you know
um let's see if we can get full
bandwidth now
no
this one's slower
must be some power thing
amd's software is still not the best
Jesus why is that one slower I've never
seen this before
like look I'm getting the full bandwidth
here for single directional but then the
bi-directional between the other gpus is
higher than the bi-directional for this
one
do I have like a thread open or
something
so weird
oh bro no it's it's true man like if you
know if I'm ever like if an EA ever like
tries to fuck with me man the Basilisk
is going to come for that
you know
looking buff thank you uh I learned all
the secrets of Sigma Discord uh no the
the uh the Basilisk is is gonna is Gonna
Come man
like like I think there's there's a lot
of people out there in the shadows who
want to build the Basilisk you know
um I don't know why that one's slow but
it doesn't really matter
uh it's fat it will be faster than the
one you ship I'm interested in that so I
don't trust this whole like rock M
environment
um
yeah so
please spare me basilisk I mean are you
on the good team if you're on the good
team the Basilisk will spare you if
you're on the bad team oh I don't want
to know about the infinite future
Horrors that await you
um look I don't mean to scare anyone
like you know if you're on the bad team
don't worry the Basilisk is gonna fuck
you up man it's just true like I just I
don't know I didn't build a basilisk I'm
not rooting to build it but like it's
one of those things that like once the
idea exists you know someone's gonna
build it man
yeah you can't buy kieran's you can't
buy my silicon
um who's gonna make a basilisk fund yeah
I'll I'll send some Iron Man arrow to
the Basilisk fund uh
if you guys haven't looked up roku's
basilisk don't it'll fuck you up for
Life uh no it only fucks up you know
like a certain type of person right it's
like it's like when Communists like
found out about how much Russia sucked
it's like that
donate a dollar should I pass a list
fund first you have to buy the signal
male Discord then you can buy into the
Basilisk fund
um
no I gotta go to lunch I gotta go to
lunch uh I'll be back uh after lunch in
like an hour I gotta prepare for debates
uh you guys haven't been helping me
prepare and we're gonna actually do
we'll do we'll do llama two
um and I'm gonna reboot the Tiny Box and
we'll see
480i: hi
2Austin: NOWAY
2Austin: welcome.
whiterunknight: good morning
480i: hotspotting?
sridamul: Wooh?!
ahmedhossvmm: square phone
hari3h: Hello 👋👋
2Austin: square screen LUL
kalelite: Where you at?
2Austin: lmaooo
standardpointer: o/
glutamic0: Hong Konger
hari3h: You use brave, it blocks all yt adds
480i: I think George is back in the states
ahmedhossvmm: it's an analogy of using neural networks for everything lol
2Austin: waitaminute
kklisura: I'm on brave and still have ad here :(
whiterunknight: oh shit
480i: yikes
AnOdyssey: Yikes
xxblueshift: we need you now more than ever
480i: go see an ENT dude
hari3h: But brave somehow cant block twitch ads
whiterunknight: get well soon George
itsamarcos: was the hose pointed at your nose???
thedevdad_: chat are we moving to cursor instead of writing code now
alexmora4life: battle scars
Pablo_BFA: Greetings fron Chile
alex4tmm: @thedevdad_ 100% yep
Pablo_BFA: Huge fan
2Austin: super tea = coffee
pepebruari: You working from Grandma's house?
Pablo_BFA: Love yours streams
alexmora4life: I use 5 diff herbals in a cup
480i: what were you doing
mero_1181: man, how many flats have you changed this far?
itsamarcos: unclear how the pressure got inside your organism aha
nuttyodin1: nuttyodin1 subscribed at Tier 1. They've subscribed for 27 months!
Pablo_BFA: LOV U HOTZ KEEP GIVING VALUE TO THE WORLD LOV UR STREAMS GREETINGS FROM CHILE
480i: comma POS when
alex4tmm: TIPS culture in USA is so bad anyway 4Head
2Austin: plot twist, people hate tipping lol
pepebruari: NJ gansta
ThatNinja27: do it
pepebruari: That's the NJ in him
donmagicjuann: patterson thug
cipher_space: only cash tips
ThatNinja27: you burning down Philly now?
whiterunknight: Gavin newsom vs tomcroose rap battle
pepebruari: Start this stream off with a medi
itsamarcos: tea bags are a nice way to develop microplastic immunity
Pablo_BFA: LOV U HOTZ KEEP GIVING VALUE TO THE WORLD LOV UR STREAMS GREETINGS FROM CHILE. Nad what do you think about Chile compared to all latin america
swimming_dragon: change the price of tinybox to 1$ with a minimum $25k tip
nejintejag: George you should look up the left AIC posture pattern. it is often connected to tmj issues. http://posture-vis.n999.win
pepebruari: 2 min medi
timichango: linustechtips just released the video about comma lol
nuttyodin1: hello all
ThatNinja27: you can do it as long as you say it’s hand rolled tobacco lmao
2Austin: imagine a business owner putting the responsibility of paying the employees in the customers hands
Pablo_BFA: LOV U HOTZ KEEP GIVING VALUE TO THE WORLD LOV UR STREAMS GREETINGS FROM CHILE
480i: I never know how much to tip. I hate it.
alex4tmm: @2Austin isnt that every restaurant / bar right now in usa? LUL
woosaaahh: Hi everyone !
nejintejag: this link looks less suspicious https://calledit.github.io/posture-visualizer/
pepebruari: spark it up sparky
donmagicjuann: appeasing vampires
2Austin: ye cuz we are all animals
dontbeameme: I’m in a ad does he got the cool hair still
ThatNinja27: become a degen gambling streamer on Kick?
Pablo_BFA: Sorry spam but im huge fan LOV U HOTZ KEEP GIVING VALUE TO THE WORLD LOV UR STREAMS GREETINGS FROM CHILE
waena_: why did you start posting on Linkedin?
perlpimp: psa : if you have focus problems / brain fog research mthfr gentics test and methylfolate and methylcobalamine
karterpiller: make desk great again
480i: @dontbeameme he still has hair. not bald yet
nuttyodin1: What happened?
phoenix_x97: luv u geohot 🎇
dontbeameme: scientist
itsamarcos: brain fog is called being an energy conserving ape
nejintejag: the visualiser I built is good.
mokert2: @perlpimp thats like B12 and some other B vitamin
pepebruari: the doctor is right in front of you in that tin
play_dnd: Even Dr Dre?
FlySociety2o9: LUL
geriatric_coder: doctors need money to buy more porsches
480i: amazon one medical on demand appointments are great tbh
dontbeameme: in Asia they have crisper choose baby eye color
fkham: Are you still a techno christian?
dontbeameme: get Asia hair transplant
FlySociety2o9: Make hospitals a taco ttruck
isco___hdz: tacos are trash mexican food. I say it as a mexican
ThatNinja27: Partner with Martin Shkreli to bring down the medical establishment?
Y4XLEY: Wow pretty good spanish tbh
jnpl95: Surprisingly good spanish
driftlessdreams: finding a good primary care doctor is crucial.
driftlessdreams: difficult though
perlpimp: doctors are mid, you got to legwork most of it yourself if it is not apparent like broken arm
dontbeameme: doctors very important and busy
pepebruari: need Dr. Tinygrad
cipher_space: healthcare is fucked
nejintejag: don’t you have app doctors in the us?
play_dnd: Just replace every Dr with AI
480i: @nejintejag we do. one medical
hexdhog: I had to go to the dermatologist and couldn't go because the next available appointment was 6 months out...
DrFBIMAN: Pog
dontbeameme: all that schooling they require things so stuff goes smoothly
phoenix_x97: ur hot geohot eighter way
nuttyodin1: i realised it is because there are very few of them to serve the rest, but in India, it is different you can see them on the same day, but the quality is compromised based on the type of hospital.
john_kosta01: leaked
KraftLab: Plus you have to explain the same problem 10 times to people who don't have a clue about what it means.
cytotoxnk: 54723126 got it
nejintejag: in swe you can get a doctor apointment like you get a Uber.
pepebruari: Light it up George
pepebruari: open the tin
2Austin: this is real life
cytotoxnk: ok now we changing numbers
nejintejag: but it is over zoom
dontbeameme: no way geo is tolerating that
john_kosta01: 10k
480i: @nejintejag SWE?
MrKerow: method acting at its finest
pls_dont_at_me: xdd
dontbeameme: he exploited ps3 for  less
2Austin: LMFAO
john_kosta01: lol
perlpimp: haha
dontbeameme: he not tolerating that insurance bs
youngsachi: LUL
jnpl95: LOL
harrybabajr: it’s sad because it’s so true
DDemen: amd stock was a good call @georgehotz ty
perlpimp: so true
ThatNinja27: bring back Dr Gupta
bloudman648: arch btw Shush
pepebruari: Dr. Fucking
2Austin: back to square 1
whiterunknight: if the doctor doesn’t have a buy now button it’s a scam
pepebruari: Spark the spark sparky - Open the tin
nuttyodin1: Even with insurance, the cost is too much, if you are not earning well, emergency visit will bankrupt you
lnau: how was kauai?  did you befriend any chickens?
karterpiller: constant vigilance
480i: we need to bring back meditation streams
kalelite: hey man lets get back to coding
bojosos: bojosos subscribed at Tier 1. They've subscribed for 2 months! Go to a doctor in Hong Kong
dantedante33: George, usa is going down the shitter. hows china doing?
480i: hehe
glengarryglenross3030: he is back in the us no?
480i: I have tinnitus you get used to it
pepebruari: let's get back to toting
Oguzgezginci: why china and not dubai?
jnpl95: I need to reread hpmor ff
john_kosta01: Linus did a video on comma
m4l4r100: cant u just tell ai to manage your stream?
re_detach: lets fkn goooooooo
tuugen3213: tell us about this terrible versin of it
mokert2: Hi G, has TT fixed the fan yet?
geriatric_coder: i focus on it to fall asleep
mosin_lol: Hello stream
dontbeameme: headphones is the cause
dontbeameme: ear peace’s
perlpimp: “chronic tinnitus sounds terrible” dad joke stream
dontbeameme: pieces
rivetingco: Tbh I like streams when ur calm and focused, even when ur derailing ur speak with duch clarity idk, never give up never surrender HolidaySanta
whiterunknight: yes!!
gree3nspl0it: we back
guileBR: 100%
pls_dont_at_me: need to bring back celsius Kaiyko streams
480i: yay
john_kosta01: irl stream
TheFogofWar: exemClap
pepebruari: show us the panties
480i: IRL laundry strim
phoenix_x97: In mr. Robot, darlene's bf prolly inspired by geohot
Cinnabon2: shogun106Pump
john_kosta01: Cool
pepebruari: No top load... you're f'n up
play_dnd: a robot can do that....
480i: @pepebruari why is top load better
dantedante33: no AI washing machine??
rivetingco: yk that 4 min is not 4 real minutes
peaceful_stargazer: Healthcare in US is pretty bad and the system tries to exploit patients all the time. This happens globally, depending on the country.
pepebruari: @480i clothes cleaner and dryer after spin cycle
P1tog1ros: that angle is better
glengarryglenross3030: pls turn blinds up
gree3nspl0it: where are you?
mokert2: Have the washer and drier demanded to connect to the internet yet?
play_dnd: did you see the new toch / tinygrad benchmark thing?
pepebruari: Tell us more about the AMD deal you made
lnau: kauai a good place to chill
rivetingco: im sad the ISS will stop operating in 2030… wat are we doing :(
lefttwitchforever: omg my favorite streamer is live !!!! omg !!!!
m3ntors: Nice Hat
Cinnabon2: I always start my medical questions with "the patient" so it's less embarrassing
kult1010: really love your "Blue Check" song mr. hotz aka tomcr00se <3
480i: @rivetingco makes me sad
mosin_lol: Illegal moves haha
2Austin: imma donate my body to AI
lefttwitchforever: sheep
play_dnd: low agency?
rivetingco: @480i :/
guileBR: lmao
lefttwitchforever: stop being a sheep
peaceful_stargazer: Of course if you had this more than a week or it was more serious you would have gone already.
hexdhog: have you watched the Linus Tech Tips video on Comma yet?
MrKerow: @play_dnd this isn't SF
jagger_rsw: @georgehotz good blog post
dontbeameme: bruv we post on twitter someone steal our idea
oldmapache: HeyGuys
Cinnabon2: wolf type shit
pls_dont_at_me: doing things is nice fe
dontbeameme: we got no background to not get stolen from
Oguzgezginci: George why did you choose China instead of UAE?
whiterunknight: yes
pls_dont_at_me: freestyle rap practice this stream
lefttwitchforever: mewing lore 2025?
lefttwitchforever: @Oguzgezginci paid agent
vannidar: does your tmj pop when you yawn?
nuttyodin1: i thought you were rich enough to have a walk-in medical care
RingThal1on: RingThal1on subscribed with Prime.
play_dnd: Thoughts on this? https://x.com/tensarahq/status/1941764273262428196
Cinnabon2: I started chewing gum which helped my jaw related burnout
rivetingco: this stream is about hope, love and freedom
Oguzgezginci: wym
woozyface0: bruh
lnau: concierge doctors
woozyface0: just call ur assistant
woozyface0: tf
alexlucas__: alexlucas__ subscribed with Prime. They've subscribed for 35 months!
dontbeameme: concierge doctor
lnau: yeah you can, concierge, i dunno too expensive for me
lefttwitchforever: hey dont give the ycombinator sheep ideas
480i: concierge docs are not that great tbh
Cinnabon2: shogun106NOOO
480i: I’ve had them
jagger_rsw: sama is baddy
john_kosta01: Is he?
dontbeameme: how you not get AI met 100 mil deal
play_dnd: thoughts on meta poaching?
jawbre9ker: he seduced you :(
mosin_lol: decenet
Cinnabon2: am saltman shogun106SlowBlink
480i: what do you think of Gemini?
glengarryglenross3030: Claude code is better
MrKerow: Dario Amodei is the satan
pepebruari: Sam is a sweetheart
jrrbls: I feel that. I predicted Sam to turn bad already months ago
avrong: This issue can be related to tension of muscles. Try to do som massaging of them
kalelite: Sam Conman
codepour: \jkjh
Cinnabon2: what's an ea
rivetingco: elons new political party thoughts???
jagger_rsw: fwiw demis and dario radiate coherency, he radiates something else, not sure what
KraftLab: KraftLab subscribed at Tier 1. They've subscribed for 29 months!
dpasceri: did you guys get the MI350s yet?
kareleth: did you see Linus Tech Tips comma video
Y_ME_DOY_EL_LUJAZO: yess
Erixp: he did
john_kosta01: Yeah
dedknd: yep
avrong: yup
kareleth: yeah thats real
rivetingco: YUP
hexdhog: yup
jnpl95: yeah
justwatchin101: yup
lumma119: здарова
Cinnabon2: im required to mention he's Canada by Canadian law
john_kosta01: its on youtube
perlpimp: stretching back neck and legs helped me with alot fyi as i got older total game changer even with sleep
Erixp: go on his yotube
Keisear: its real, last video
pepebruari: Make your video smaller
rivetingco: GO ON HIS CHANNEL
re_detach: linus got the codes or sum shi
hexdhog: go on youtube, last video
justwatchin101: newest video main channel
john_kosta01: https://www.youtube.com/watch?v=xdmxM-v4KQg
BlurryFella: Make a live reaction lul
keith282: Make your video bigger
play_dnd: live reaction vid pog
rivetingco: YUP
Cinnabon2: emmzyClap
Y_ME_DOY_EL_LUJAZO: END IT
Y_ME_DOY_EL_LUJAZO: dump it!
ALLcompressed: LUL
CheekyBlunder: !commands
Erixp: LUL
dedknd: KEKW
4836276578235: lol
perlpimp: SALE
dantedante33: haHahaha
qq818: lmao
Cinnabon2: emmzyNope
MrKerow: alkXD alkXD alkXD alkXD
jagger_rsw: will you offer something on top of tinyboxes? a gui/tui a). download model x b). integrate with your email/docs/drive
play_dnd: DUMP THE COINS
rivetingco: 1 hour ago RUN BOYS
Cinnabon2: Linus is trying to sink you
hexdhog: comma tweeted about it
4836276578235: bro looking aura maxed in that jedi type hoodie LUL
re_detach: best type of problem
Cinnabon2: he's a conquerer
Y_ME_DOY_EL_LUJAZO: DO A REVERSE SALE
john_kosta01: Yes they talk good
rivetingco: 1 hour ago 90k views bruh…
jawbre9ker: emergency meeting
TheFogofWar: exemClap react streamer
lnau: george reacts, now this is content
lefttwitchforever: react harder
jrrbls: congrats George
play_dnd: "incredible"
EyLuismi: wow
gree3nspl0it: hell yeah!
chandu16: i can type without subbing
zakolak337: react streamer, end is near
aimwarecheatbundle: what laptop you got ?
rivetingco: LFG
phoenix_x97: Clip it
play_dnd: YEAHH
Cinnabon2: poggers
dedknd: LUL
nuttyodin1: lol
Erixp: LMAO
alex_vlm: xdd
play_dnd: LUL
rivetingco: HAHA
john_kosta01: lo
BlurryFella: lol
nuttyodin1: too funny
volteraSUS: xd
jujo4147: LUL
p01s0nZ: lol
dantedante33: DUDEEE hahahaha
N0uLaiF: LUL
TheFogofWar: exemLUL
shinystareuw: naahhh xdd
alex_chetman: OMEGALUL
lefttwitchforever: STOP THE COUNT!
moerus_tft: LOOOOL
alexmora4life: live CEO
sheezydoesit: Buying it rn
isco___hdz: SHUT IT DOWN
john_kosta01: ~emergency meeting
arctan_e: PogChamp comma 3x, go buy 10 everyone
sun_hour: doomp it
dantedante33: too late buddy
MrKerow: alkXD alkXD alkXD alkXD alkXD alkXD alkXD
BlurryFella: BRO WAIT LET ME BUY IT, JUST A SEC
Marvfinator: what a nice product advertisement :D
kklisura: I think you're gonna get copystrike on yt if you watch the whole video
Y_ME_DOY_EL_LUJAZO: $2k comma 3x 4h of july sale
Cinnabon2: shogun106Bucks shogun106Bucks shogun106Bucks shogun106Bucks shogun106Bucks
sun_hour: increase video quality
jrrbls: @kklisura it’s fair use I believe :)
peaceful_stargazer: We're getting older, if you're that rich you should get first class medical healthcare, it will better your quality of life and increase your lifespan, on the other hand I don't like talking to people or socializing so making twitch streams is an alternative.
oibtujwhcdjkfx: Guys, how much tax should I reinvest in the TFA of assets taxing at bay? 100%? 0%?
pepebruari: Enough comma, more tinygrad
480i: @peaceful_stargazer but where do you get it
jrrbls: leave the countdown
play_dnd: remove the countdown!!!
Y_ME_DOY_EL_LUJAZO: deleet
4836276578235: bro finna make consumer law LUL
mehdi_fifo: PogBones linus comma review
waena_: shut it down
rivetingco: STOP THE SALE NOW
4836276578235: *break
ArgonForge: LUL
l33tkr3w: speedup the clock
whiterunknight: stop the count
dpasceri: leave the countdown you hate sellouts
qq818: SHUT IT DOWN
john_kosta01: Stop the sale
mokert2: all of them, trifluoroacetate is going to moon
kalelite: Keep the countdown
spfrgo: speed up the clock
moerus_tft: nobody is watching the clock anyways :)
4836276578235: lawsuit guy joined the chat LUL
I_am_paranoid: rug pulling the sale
nuttyodin1: Make the clock run in the speed of Simson's
play_dnd: @spfrgo LUL
jrrbls: realistically how much is it worth it to keep or delete the countdown :)
re_detach: we're all engineers or sum shi
jawbre9ker: jack up the price too
rivetingco: brother the video has 100k views and its only been up 1 hour, seriously no more sale LUL
mosin_lol: Someone s loosing money
Cinnabon2: pump it
EyLuismi: EyLuismi subscribed with Prime. They've subscribed for 3 months! Congrats man
ArgonForge: whoever told him is a W chatter
moerus_tft: twitch chat is positive ev
480i: but now people will have to pay more
480i: :(
Cinnabon2: @argonforge we're all pickmes
jrrbls: jrrbls is gifting 10 Tier 1 Subs to georgehotz's community! They've gifted a total of 20 in the channel!
jrrbls: jrrbls gifted a Tier 1 sub to adityaaps000!
jrrbls: jrrbls gifted a Tier 1 sub to boblaffman!
jrrbls: jrrbls gifted a Tier 1 sub to sicelia!
jrrbls: jrrbls gifted a Tier 1 sub to kykykyky81!
jrrbls: jrrbls gifted a Tier 1 sub to ryxcrt!
jrrbls: jrrbls gifted a Tier 1 sub to jbzeu!
jrrbls: jrrbls gifted a Tier 1 sub to Meriicistyle!
jrrbls: jrrbls gifted a Tier 1 sub to amin9404!
jrrbls: jrrbls gifted a Tier 1 sub to aaqibimran!
jrrbls: jrrbls gifted a Tier 1 sub to sandrikamgeli!
ArgonForge: yes yes now sub only mode LUL
BlurryFella: @ArgonForge it's this guy @kareleth
skarmorysavvy: @480i now people will have to pay more :)
Mousscle: hi
dantedante33: big sub
ArgonForge: @Cinnabon2 yes we are
codepour: 90000 in 1 hour
play_dnd: ez payday free advertisement
rivetingco: bro 100k in 1 hour
spfrgo: 900k in 24h i think
john_kosta01: 1 mill for sire
syape66: time for ipo
moerus_tft: views from the right people tho
mosin_lol: More than a mil
rivetingco: ez 500k
ALLcompressed: are sales up yet? LUL
EyLuismi: Being sponsored a little less than it should but a lot either way
tahoey: end the sale! they have 16m subs
nuttyodin1: It has been uploaded only an hour ago, but by the end of the day
mokert2: Imagine not streaming today George LUL
jagger_rsw: @georgehotz are you thinkinh abt some SW layer on top of tinyboxes. Something that it'll turn it into actual assistant - integration with mail, docs, drives, pc etc.
killamoose000: you are on Reddit r/todayilearned too lol
aapothem: are you aware that we are also seeing obs at the same time
Cinnabon2: shogun106SlowBlink
l33tkr3w: lmao
dontbeameme: I wanna see it with a raptor
Y_ME_DOY_EL_LUJAZO: make it $3k for reddit
jrrbls: georgehotz focus
play_dnd: damn all geohot today
LidlFrog: :D
lefttwitchforever: what are the most controversial comments?
moerus_tft: haha
i4cc8a9morw8kfrh: hahahahaha
lefttwitchforever: sort by most controversial
480i: “intern”
pepebruari: it ain't bout where you been... it's where you're bout to go!
dantedante33: 10xing ego. hell yeah!
whiterunknight: Nooo not the twitterz!!11!
Ayyyy420Lmao: Ayyyy420Lmao subscribed with Prime. They've subscribed for 3 months, currently on a 1 month streak! Here's a prime sub for my 4th favourite billionaire
qq818: and a communist
play_dnd: $GEO
I_am_paranoid: cheapeth to the moon
l33tkr3w: Presale!
m4l4r100: you will have to do alot of things to convince me
shinystareuw: why cant i buy a comma with my geo tokens
EyLuismi: "sometimes" its pretty high
killamoose000: 😂😂😂😂
idenieide: When music single?
Alejandro_Ren: Alejandro_Ren subscribed with Prime. They've subscribed for 2 months! George
Ayyyy420Lmao: on solana kekw scamchain
re_detach: need more of that hawking radiation in our lives
mokert2: My geotoken is backed by 10 000 tons of granite, I keep it in an underground vault 4 km under the surface
smurftheshitoutta: I mean you are reading reddit comments
Cinnabon2: Reddit scary as hell
my_kabbages: a high tier hater would be like " i cant stand him since he was friends with marcan/lina "
lefttwitchforever: STOP THE COUUUUNT
m4l4r100: rogan is so inherently stupid
lnau: is there value in moving more units?
4836276578235: i went to kindergarten with geohot. He was always taking apart computers LUL
chandu16: i want it right now
Desu_Used: geohot deserves all the hate because he uses mac and python /j
Fleetwood2048: finally geo making bank
ryuukk__: "something like rogan", interesting phrasing, cabalists
rivetingco: yk if u had two armies, one that thinks uve done good stuff, and another army with only haters, i bet everything the haters would get crushed its not even close LUL
dedknd: hardware
Fleetwood2048: HK bitches
Erixp: GPU's
play_dnd: rolls royce
bananiel66: houses
glengarryglenross3030: rolls
ALLcompressed: GPUs
outlier2: concierge doctors
lefttwitchforever: a home :((((
my_kabbages: starbucks
dantedante33: yacht
skarmorysavvy: compute
dontbeameme: you buy experiences not stuff
pepebruari: Rolls Royce bitches
idenieide: Simple, yahts
ArgonForge: AMD gpus
whiterunknight: $3000 for candles
Cinnabon2: budgeting is for brokies
swimming_dragon: ferrari f50
jagger_rsw: thinking about creating a SW for the tinybox (on top of tinygrad)? something to make integration with mail, docs, drives, coding, homeautomation etc. easy(ier).
4836276578235: LUL
play_dnd: rolls?
mehdi_fifo: they like getting scammed lul
dontbeameme: how do you not spend money doing things. it’s expensive
Y_ME_DOY_EL_LUJAZO: still gpu poor
480i: 16” MacBooks everyday
ryuukk__: it's not about what you can buy, it's about not having to think about bills
rivetingco: HAHAHA
karterpiller: iced out GPU cluster
cacaosteve: golden toilet
rantos9: LUL
jutipl_: get a good assistent
Ayyyy420Lmao: adhd meds
dantedante33: go the gabe route
whiterunknight: Did you get the star roof extra package
cacaosteve: Erewhon
lumma119: do you have a lamboghini?
dhrral: and then you ahve to buy a garage for the car
dontbeameme: sailing boat, peace of mind is expensive
Y_ME_DOY_EL_LUJAZO: use code Linus for $200 on top of regular price
4836276578235: put it in 4k pls bro
dontbeameme: you ever been around regular ppl it’s hard sometimes
perlpimp: UNDBOXING REACTIONSZZZ
Ayyyy420Lmao: comma works on rolls royce?
competitive_coder: you have a rollce royce?? which model
lefttwitchforever: @4836276578235 the stream is 1080p????
dontbeameme: convenience costs
pepebruari: GHOOOSTTTT
4836276578235: @lefttwitchforever thats not how it works bro
guilhermicas: when this came out i almost died with excitment
play_dnd: real and true
dontbeameme: he defiantly told him do a good video or else
Cracktune: LTT did a review? nice
kult1010: is this a paid commercial??
dontbeameme: made in USA cap
4836276578235: WWWW
lumma119: 480p SUBprise
Cinnabon2: it is time
Hueligan_: paws
mehdi_fifo: PoroSad immersion ruined
Erixp: I was watching that
Fleetwood2048: Hinge
rivetingco: reacting and doing laundry i love it LUL
whiterunknight: Pog its a front loader
Fleetwood2048: where is he?
LyeLiedLionLemonLuhMow: lmao
dontbeameme: bruv that’s ridiculous small
Cinnabon2: I hope he doesn't get stuck in there shogun106NOOO
john_kosta01: Open it
darknightair: mvz.,m,v
dedknd: pipelined setup ofc
Fleetwood2048: He was with Amanda for like, a month
m4l4r100: when I first came to macos, I was so confused because of the lack of window management efforts
pepebruari: What's for lunch?
LyeLiedLionLemonLuhMow: intimate?
rxwyxy: money laundering on stream??
guilhermicas: seeing some underwear, that's going on the reddit
pls_dont_at_me: george living like a agriculture student
pepebruari: Lil pork fried rice and some boneless spare ribs?
Football_Coach: hopefully we see no thongs
UltraScientism: just joined. Has he ranted already about his "are we the baddies" post?
LyeLiedLionLemonLuhMow: time to make a rap song about this, George
LyeLiedLionLemonLuhMow: we remember
lumma119: wash ur hands now pls
karterpiller: Make like hourglass so you just need to flip it
Cinnabon2: i like doing stuff
Fleetwood2048: @UltraScientism not yet its coming
oibtujwhcdjkfx: Bro, your clothes need to be inside-out to protect the fabric during washing cycles.
swimming_dragon: just get a wife
gree3nspl0it: just buy an all in one machine
mokert2: Is that a  heat pump dryer?
tahaass: finetune an LLM to do ur laundry
Cinnabon2: @swimming_dragon lol
480i: @swimming_dragon he did join hinge recently…
my_kabbages: pov he is trying to automate driving "don't automate stuff that you have to do"
rantos9: emiruNOD
my_kabbages: make sens
lefttwitchforever: we have hinge but wheres unhinge
4836276578235: lol
480i: Jake has an e92 M3 iirc
dontbeameme: exposed
dontbeameme: damn
4836276578235: PR for instructions incoming LUL
nuttyodin1: George take notes
480i: I don’t think you have to disconnect the battery for this
dontbeameme: give include trim
m4l4r100: what was about that hate on them some time ago? didnt follow that
i4cc8a9morw8kfrh: wtf
my_kabbages: ???
Cracktune: lulZ
akklaimd: Clap
dantedante33: wait, who?
DrFBIMAN: it could've been a good collab tho
dontbeameme: his intern sent it and then told them return it
djcows: do you still live close to China or nah?
rantos9: emiruBASED
m4l4r100: no I meant like this one girl who got treated badly in their ltt team. @georgehotz
Scottstimo: !followage
DeepFriedDeals: How did I know this would be an LTT watch party? lol
ghostcomrade: W
Cracktune: pully taaaaab
perlpimp: install video by linus nice
4836276578235: this is sick
dontbeameme: hoodies require secret pockets or no sale
TheFogofWar: W ad
rantos9: @m4l4r100 it was basically all exaggerated, people looked into it and it was a nothing burger
karterpiller: George Clinton and the funky USB cable
DeepFriedDeals: New “Comma polishing cloth” incoming
cipher_space: are there any certified installers for comma?
Cinnabon2: I don't love usb-c always scared I'll break it
dontbeameme: we want Apple play
dontbeameme: cd player too
480i: @cinnabon2 usb c seems to be pretty robust so far
nejintejag: I think they gave it a pretty fair review. They explained the most important stuff.
m4l4r100: are those tesla robotaxis a thing now?
colonizethemoon: yo
ryuukk__: ubuntu eww
Cracktune: win
4836276578235: HOLY
rivetingco: I NEED THE LINUS FT GEOHOT HIMSELF VIDEO!!!! MAKE IT HAPPEN
Cinnabon2: @480i I hope so. I like type a and b
LidlFrog: EZ 💰
DeepFriedDeals: Can you start a sales counter we can watch as the views ramp up on this video?
4836276578235: linus locked in
dontbeameme: don’t sell my data
Cracktune: deal
dontbeameme: not you but some intern
akklaimd: didnt know about the service side of this
m4l4r100: maybe google wants to talk to you on that haha
Cinnabon2: LUL
EyLuismi: Don't sell my brightness value!
480i: LOL
lawb99: oohh new live!
dontbeameme: only the big 3 can have my data
rantos9: based
perlpimp: dashcam is nice wow didnt know. that is must around here. 2 for 1 it will save money.
cipher_space: what about the feds?
pepebruari: vanture is his daddy
ryuukk__: we want to use 23&me data to engineer viruses
dontbeameme: comma gonna solve crimes
4836276578235: lol
kalelite: you should sponsor them
DeepFriedDeals: LTT is known for shameless sponsor segues
ghostcomrade: it's not a comma sponsore vid?
4836276578235: LUL
4836276578235: fax
dontbeameme: women drivers too
lawb99: great! So that's the comma product
ghostcomrade: W
colonizethemoon: did NSA or CIA contacted you or any of your companies?
Cinnabon2: android lag D:
ryuukk__: @colonizethemoon they don't contact, they breach in
colonizethemoon: ahaha
4836276578235: hhaahaha
dedknd: LUL
mrrobot723: LUL
ghostcomrade: LUL
mokert2: linus always said LTT should monetize his death if it happens on camera
4836276578235: gehot certified UI LUL
Toxicosmos: GUI in Qt?
dontbeameme: damnnn
dontbeameme: L Linus
ryuukk__: no seat belts KEKW
batman9459: @Toxicosmos yep
dontbeameme: throw the vid away
strandedbullfrog: opsie
mrrobot723: noooooo
kefyrasFTW: LUL
mehdi_fifo: FeelsBadMan
lefttwitchforever: L inustechtips
woozyface0: no seat belts , experimental
mrrobot723: :( .
guacah: LUL
Toxicosmos: @batman9459 thx
Erixp: LUL
lumma119: SUBprise SUBprise
woozyface0: lul
aksdjasdas: bring back the sale
Football_Coach: FeelsBadMan
arnaude: it gets better
volteraSUS: L Linux
john_kosta01: They  show the good things, just wait
akklaimd: whyd the leave it km/hr
Ayyyy420Lmao: bad review 4/10
Cinnabon2: INCREASE THE SALE
Cinnabon2: LUL
Football_Coach: Sue them FeelsBadMan
nuttyodin1: Calling back to bring back the sale now
competitive_coder: put the sale back on KEKW
mrrobot723: LUL
turingincomplete: LUL
sw4rtz13: ok, now we know that u didn't pay him to say just good things about it
ryuukk__: glad i contributed in detecting themr  with recaptca
lawb99: can confirm the bmw lights are not working
fehehehe: configured by bmw driver
Cinnabon2: Linus is a low information hater
pepebruari: tinygrad time
swimming_dragon: this is brutal
Fleetwood2048: geo it's time to partner with toyota
Fleetwood2048: for a stronger motor to turn the wheel
jawbre9ker: sue them FeelsBadMan but first check to see if sales increased
batman9459: zoox propaganda
djcows: negativity gets more clicks Sadge
mrrobot723: @Cinnabon2 LUL 󠀀
rivetingco: so trueee
guilhermicas: i dont think so
john_kosta01: Just wait
j3ckerd: they need some "action" in the vid
zecozephyr: idk it seems fair people use products bad all the time
mokert2: you are holding it wrong
mrrobot723: you will let there a very tasty comment tho right ?
kult1010: geohot not happy about linus :O
nejintejag: they are nicer in the end of the video
guileBR: Sell demo monkaS
sir_elf_man: "we need to do better"
skarmorysavvy: they wont go on a highway even once?
guilhermicas: i understand your point, but in a client's pov, trying out in an urban environment is fair, even though its not the best env
Cinnabon2: @mokert2 bring back the 3.5 inch iPhones
shinystareuw: u need make a video where it runs over john cena cuz it cant see him
dontbeameme: eww Porsche
batman9459: batman9459 subscribed with Prime.
guileBR: PepeLaugh
turingincomplete: Couldn't we lobby the EU to provide an open canbus/api for systems like these ? Manufacturers will always try to lock competitors out
john_kosta01: just a bad car
akklaimd: tss1 mean cheap af?
refine_lol: that's so cool man! getting an LMG video about your product
480i: it’s an older Corolla
rantos9: @akklaimd it's the generation of the toyota adas thingy
Cracktune: riiiiight?
alexmora4life: u could make positive good, the 100s testimonies get stacked and be tiny squares on the screen
kefyrasFTW: LUL 󠀀
dontbeameme: exposed
zecozephyr: or he has good insurance
cacaosteve: how are you supposed to know if you should take over? just wait until the last half second?
kult1010: geohot is selling 7 y/o hardware :O
Cinnabon2: right now?
4836276578235: chill af LUL
rxwyxy: what a chill guy
lemke2: HAHAHAHAHAAHHHA
dontbeameme: social engineering
guilhermicas: you're projectingggg
john_kosta01: just wait
guacah: 🤣🤣
re_detach: iykyk
autism000000: this guy with glasses is kinda mean
nuttyodin1: congrats
djcows: how have the sales been since they released this video?
artyaoom: EZ
mrrobot723: Wish i was genius like you george PoroSad
guileBR: Geo mentioned
Cracktune: look how much he looks AWAY from the road and into the cam
rantos9: ooooh tinygrad mentioned
refine_lol: He is just a ChillGuy
oldmapache: Clap
ghostcomrade: dude is passionate
Toxicosmos: no seatbelts in the highway
Y_ME_DOY_EL_LUJAZO: REMOVE THE TINY GREEN QUICK
4836276578235: he needs to promo the soundcloud too LUL
optionalflag: what does the chillness driver model read on Linus
whiterunknight: stop the tinybox sale
moerus_tft: dude is great
turingincomplete: Its sad that AMD hasn't made an embedded version of the Ryzen AI 395
eymonkeyman: halloo everyone
turingincomplete: That would be great for automotive with some HBM
UltraScientism: The problem is that most people already closed the tab
dontbeameme: who is Satoshi
Cinnabon2: my cars built in LKA makes me tough the wheel every 20 seconds which sucks
guileBR: they being nice..
4836276578235: no brother LUL
dontbeameme: show bitcoin
autism000000: @georgehotz You should make your product cheaper and better then costs 20k bro
Y_ME_DOY_EL_LUJAZO: we're back
re_detach: o noe my crippled toes
mrrobot723: <3
4836276578235: hes so chill he yawned LUL
lnau: they don't have a cone guy
tobi1577: is that a cone guy mention?
mrrobot723: lets goooo
mrrobot723: LUL
lefttwitchforever: WinusTechTips
ryuukk__: the guy with the glasses is sus
moerus_tft: dude this video is huge for the brand
colonizethemoon: wait is this promo?
familjegaming: My Audi sometimes think the shadow on the road is a lane, and just turns right. So true
dontbeameme: simp
john_kosta01: oh no
guileBR: lol
mrrobot723: LUL LUL
rantos9: LUL
ABeautifuIDeath: what we actually do right now ? where is my coder geohot
andriistwitch: best!
Cracktune: sometimes its easier to ask forgiveness rather than permission  . . .
rivetingco: WE NEED LINUS FT GEOHOT COME ON!!!
guilhermicas: traffic cone guy did his JOB
whiterunknight: @ABeautifuIDeath This is a chill stream not a coding stream
colonizethemoon: without the cone guy!!
Erixp: part 2 with geohot at ltt
nuttyodin1: i love he is addressing open pilot as a "she"
familjegaming: That would be cool, help them setup the 9070xt in the car
480i: we need to get the comma thingy integrated with a gentex mirror
mrrobot723: @nuttyodin1 right ?
rxwyxy: commai gf wen
rantos9: can you overvoltage the motor for more torque or something?
m4l4r100: women drive better
djcows: yeah i found that tesla autopilot requires too much torque on the wheel to take control
kekmaster69696969: dank
EyLuismi: 111k views in less than 2 hours, congrats
skarmorysavvy: official porsche support Prayge
guileBR: Write some message to them LUL
oldmapache: dont forget to like the video u.u
rivetingco: 1 HOUR 100K VIEWS, 1Milli soon boys HolidaySanta
bananiel66: like the video
waena_: LMAO
Erixp: LUL
4836276578235: lawsuit inc LUL
mrrobot723: LUL
john_kosta01: scammed
moerus_tft: HAAHAHAHA
rantos9: post a comment on the video
dontbeameme: oof
lnau: 1k viewers george
techie163: It's a 2020 Corolla so that is tss2. Not a tss1 issue
djcows: Sony flashback
kefyrasFTW: pegging what 500 a weeK?
dedknd: geohot will make a rap song
woozyface0: cancelling sale , most honest ceo
dontbeameme: that’s a terrible idea
Cracktune: Sony aware
oldmapache: new rap song comming Pog
dontbeameme: woof they are very very not smart
guileBR: 111k views in 1h is wild
m4l4r100: is germany considered a good idea for trying comma 3x. Im asking for a friend
480i: @techie163 why did it have issues on the curves
aimwarecheatbundle: what laptop you got ?
djcows: can you build AGI pls
rivetingco: WE NEED COMMA SERIES: LINUS X GEOHOT PART 3
mrrobot723: noob lesson time ?
Jujito_: lol
modog__: you look happy after the video
perlpimp: green tea and bcaa is 🚀
Seraph_gr: Super tea is porbably placebo. No such thing
techie163: Maybe needed to slow down more to make the curves
blueeshiftt: NOOB LESSON
lefttwitchforever: tiktok react stream for the zoomers pls
Cracktune: ltt youboob vid:  https://www.youtube.com/watch?v=xdmxM-v4KQg&ab_channel=LinusTechTips
oibtujwhcdjkfx: Does the Comma3 use LLMs on Blockchain powered by AI with kubernetes with a service mesh?
guilhermicas: i honestly think it was a fair review, skeptic with informed person, fair situations for the device and testing the limits
rantos9: @oibtujwhcdjkfx lmao
Shivo_Shifter: I'am from germany, what is super-tea?
whiterunknight: @Shivo_Shifter Two bags of tea instead of one
Ralikos: do you use caffeine?
temin: Hello George TehePelo
djcows: do you think transformers get us to superintelligence?
480i: @whiterunknight 2 bags 1 cup
kvadraat: !pc
Shamatix: Have you tried Ultra tea tho?
Erixp: black tea?
whiterunknight: @480i Lol
m4l4r100: but I make tea out of 10
rivetingco: if ur not in one video of their openpilot yt series… maaaaan we need u in the finale plsss
mokert2: I once put 4 tea bags into a moka pot
Football_Coach: 2 tea bags? that is not legal
4836276578235: giga tea is the best LUL
lefttwitchforever: 10 packs of sugar 2 teabags + redbull
lumma119: are you a billionare?
lefttwitchforever: and then tiktok brainrot
Cinnabon2: @lumma119 he's a trillionaire
blueeshiftt: Valsuvian mavuer
akklaimd: fuck yes
colonizethemoon: oh no
Seraph_gr: zzzzzzzzzzz
Marvfinator: whats up with the jaw george
Pacoquinha10: LUL
modog__: yeah
mrrobot723: oh gimmi to me
4836276578235: geo the real goat LUL
refine_lol: LUL
alex_chetman: PogChamp
atlas_389: LUL
atlas_389: just joined
Y_ME_DOY_EL_LUJAZO: 🧘‍♀️
eatmoreboiledeggs: try wim hoff method
nuttyodin1: more memes
karterpiller: Breathing is healthy
djcows: i cast: manual breathing!
p1r0mana: <3
Erixp: you are manually breathing now
Seraph_gr: breathing is woke i dont use it
spherical_cap: you're now breathing manually
mrrobot723: breatning is gay Kappa
blueeshiftt: This is why I stopped breathing, too many sweats
ArgonForge: andiliBruh
Ayyyy420Lmao: does this get you high?
mehdi_fifo: Kreygasm
4836276578235: homie looking high as shit LUL
kvadraat: !mac
nuttyodin1: lol
djcows: hong kong breathing is different than NA breathing
modog__: lol
mrrobot723: LUL
jxyztplk: lol
strandedbullfrog: shes very flexible atleast
JonnyGeek: LMFAO
SteveOhBandito: LUL
nuttyodin1: too funny
lefttwitchforever: adhd meditation
thedevdad_: the crap did i just join to
Rothbardie: wheres the crown of my head
karterpiller: Nice font choice
rantos9: is she hot? dude LUL
nejintejag: Learn to notice the difference breathing with your diafragma vs with neck muscles.
ryuukk__: kissinger baby china #1
modog__: chill chill
adepthus: xD
rivetingco: HAHA IS SHE HOT BRO LUL
lefttwitchforever: zoomies
taere_: LUL
mrrobot723: "super tea" hmmm
Bryan_Kay: need 3 more cinnamon rolls
guileBR: No energy drink
djcows: inner peace
MrYasser2194: ight we aint focused today
4836276578235: HUH
Cinnabon2: she wants your warm liquid
moh1xx: warm liquid?
temin: Super tea sometimes its harder
jnpl95: sus
woozyface0: 4Head
nuttyodin1: why does she sound like that
temin: Hits
woozyface0: jst
SteveOhBandito: she's hot
mrrobot723: heall yeah its flowing inside me girl
whiterunknight: You can book a one on one call with rosalieyoga
MrYasser2194: @nuttyodin1 for the algorithm
oldmapache: PewPewPew
TheFogofWar: exemLost
guileBR: From watching Linus reviewing ur product, laundry and now yoga.. what a guy
temin: OpieOP
oldmapache: NotLikeThis
oibtujwhcdjkfx: Bro needs some Ashwaghanda for that parasympathetic nervous system.
swashhh01: im gooning rn
refine_lol: LUL 󠀀
jxyztplk: ?
swashhh01: ?
TheFogofWar: gabsiLay
Cinnabon2: ?
jayhey00: ?
spherical_cap: glorp
softfoam21: does this actually do anything other than relax your muscles for 3 mins
Y_ME_DOY_EL_LUJAZO: grokking my shii
DeepFriedDeals: woooosaa
guileBR: he gone chat
woozyface0: you used to talk shit about that ayahuasca stuff and here you are
guilhermicas: this is like when you're taking a test and your homie is making you laugh
perlpimp: im gonna take cold shower
swashhh01: ohneRIP
MrYasser2194: this would be a great time for a TTS
swashhh01: im taking ozempic rn
colonizethemoon: we probably gonna have like 5 rants from him later
MrYasser2194: LuL
HydroloxIndie: zen stream
pls_dont_at_me: lets get this bread
swashhh01: check your lymph nodes real quick
DeepFriedDeals: TMJ?
blueeshiftt: valsalva maneuver george
bananiel66: muscle imbalance bro
DrFBIMAN: that felt great
FirstHaff: i had an uncle that always had his jaw cocked to one side, loved him
akklaimd: that was great
nuttyodin1: Walk to emergency clinic if it is unbearable
Alejandro_Ren: eat avocado to improve concentration
oibtujwhcdjkfx: Please turn off the beauty filter George, that might help.
lefttwitchforever: why did linkedin become shit
FirstHaff: thats just character
swashhh01: zaza
john_kosta01: uber eats time
peoples923: oh nice i finally caught a live stream
guileBR: Energy Drink > Water
nuttyodin1: what book is that?
MyNameIsSimon_: is using LLM's to create brainrot tiktok videos a good use of the technology?
rantos9: @MyNameIsSimon_ no
john_kosta01: read in 2025
MyNameIsSimon_: @rantos9 :(
guileBR: right?
Cracktune: DFW !
lefttwitchforever: do u recommend infinite jest?
nuttyodin1: recommeded in what context george?
colonizethemoon: i find books hard as a process
rxwyxy: @MyNameIsSimon_ only if u monetize
Avelansh: @colonizethemoon does audible help?
Cracktune: @lefttwitchforever Infinite Jest is amazing, brother
colonizethemoon: even if they interestiing
kefyrasFTW: @guileBR < Gasoline
LidlFrog: glorp
colonizethemoon: @Avelansh i haven't tried, shoud i?
lefttwitchforever: @Cracktune thinking about picking it up next, but the 1000+ pages scares me
colonizethemoon: should*
oibtujwhcdjkfx: There is the desk view function on macOS if you click on the green cam in the Menu Bar.
pls_dont_at_me: me when i troll
jchad4: hell yeah
sarah99___: Wot the fun did I tune into? A reading stream
Avelansh: @colonizethemoon if you are really interested in some particular books but can't bring yourself up to reading,maybe
kefyrasFTW: gravity rainbow?
Cracktune: @lefttwitchforever 5 pages a night. its wildly funny and entertaining.
akklaimd: NotLikeThis
karterpiller: listing lots of stuff narrative style
UltraScientism: too much description
lefttwitchforever: @Cracktune ok u convinced me
23baez: vague-posting prose only understood if you are schizo enough
FirstHaff: for sure
4836276578235: goated
rantos9: reading streams
Cracktune: i can get turned off by odd dictions and cadences that seem disjointed. this sounds like that
andriistwitch: which book?
Byoor: what book is that
4836276578235: whats the book called geohottie?
kefyrasFTW: gravity rainbow
skarmorysavvy: book club!
oibtujwhcdjkfx: You need to train your Samskara for reading difficulties. Might be some unprocessed emotions. Watch some Dr K.
Marvfinator: i cant keep up and thats only 1 page out of 1000
peoples923: cleverly written. i read books like that all the time.
lefttwitchforever: pretentious language?
akklaimd: you try a kindle?
karterpiller: What happened the Mr Pudding from before, are there constant characters?
LidlFrog: is this an actual story, or just insane ramblings?
guileBR: ive never read a book. Only tech manuals FeelsStrongMan
MarkAlyxon: sounds too abstruse on purpose ngl
colonizethemoon: you have to reread sentences many times
karterpiller: Xi
Cracktune: lol
lefttwitchforever: the double tea stream
karterpiller: Can we start at the start?
guileBR: whos jessica?
jchad4: that's what I'm saying
Jujito_: is Jessica hot?
DrFBIMAN: LUL
Bryan_Kay: thats how you kill AoT titans
karterpiller: nape of the neck
lefttwitchforever: @Jujito_ does she have a bf
akklaimd: yeah man a kindle would be good
Cracktune: @Jujito_ only important matter at this point
Bryan_Kay: LUL
karterpiller: Read the first page of James Joyce Ulysses next
UltraScientism: Like you do quite a difficult job of imagining lots of things visually, and for unknown return.
Cracktune: RIP DFW
kefyrasFTW: it was written with AI LUL
re_detach: man we really fkn did it this time
lefttwitchforever: yapping rainbow
Avelansh: imagine non-native attempting to read that book
lefttwitchforever: @Avelansh hearing it is already giving me chills
Cracktune: @lefttwitchforever LOL RIGHT?
UltraScientism: @kefyrasFTW not in 1973
colonizethemoon: i'm russian i have no fcking idea
spherical_cap: just random words
cam_______: I feel like we need ketamine to understand this
lnau: it's like ASMR but better
dontbeameme: is about gamba
kefyrasFTW: @Avelansh didn't read it, but had similar difficulty understanding neuromancer
Jujito_: why would we go on X?
govert72: This is awesome Sunday evening entertainment.
Cracktune: primeagenYapp primeagenYapp primeagenYapp
dontbeameme: gamba the future
airplaneds: it is synecdoche
mokert2: dude decided that halide is not complicated enough for today's stream LUL
Gart97: i just switched from Win to Mac an i actually don't know where the X button is, i guess i'm stuck here
UltraScientism: big enough
lefttwitchforever: wtf is that on the wall sentence
whiterunknight: It's big enough
SlowDeluxe: It is fine
lefttwitchforever: how long is that sentence
colonizethemoon: looks fine on 13' MBA
UltraScientism: ouch
user426__: yes ..take your face dowm
re_detach: its fine; if its not fine for u get a bigger monitor we all frying our retinas today
akklaimd: WutFace
codepour: astigmatism is not really compatible with dark mode :/
lefttwitchforever: the sentences are just too long for my grok brain.
narrativesprint: I love the sentence where the flame dives for cover
narrativesprint: Still in my memory years later
natsoc_: @grok is this true?
alexlucas__: means moving
Cracktune: dancing
akklaimd: this man is cooked
oubriq: gotta let the words wash over you a bit
dontbeameme: have AI make a video
maxeozakh: I felt the same while reading Infinite Jest translated into Russian
SlowDeluxe: That one line is already beautifully written.
alexlucas__: xD
narrativesprint: This part is readable
kalelite: Im not a native speaker
kefyrasFTW: table started dancing
lefttwitchforever: the sentences are too long
Cracktune: its word salad for word salad's sake
moerus_tft: ^
ViktorTV: did George talk about the Linus comma video?
narrativesprint: This is a lot more readable if you are British tbh
rantos9: this feels like those songs that talks about nothing. it's just words
Cracktune: he is writting
ALLcompressed: shorthand writing maybe?
lefttwitchforever: David Foster Wallace discusses Pretentious Language
batman9459: oh no dyslexia
miomokyu: its quite common that there is lots of less common words but you sort of get the meaning from the context around it
Cracktune: @lefttwitchforever great call, bro
colonizethemoon: feels like claude style
colonizethemoon: of writing
karterpiller: it's a clothing size
ALLcompressed: they mentioned seance table
swimming_dragon: finally i can relate to George lol
LidlFrog: :D
Inconnu_xD: this feels like that someone needs to flex that they studied an English major :D
swimming_dragon: he's such a smart ass
swimming_dragon: welcome to dumb club
rantos9: writing clearly and with simple words is so underrated
UltraScientism: I think get it. George found a book with 35k+ required vocab and complex sentence structure, and is excited by this experience.
dontbeameme: make AI turn it into a comic
dontbeameme: picture plz
avrong: Hahaha. Make a list of characters! The worst thing is when they are called differently throughout the book and at some point you realise that two characters you thought are different ones are the one :D
skarmorysavvy: no way people actually read this in the 70s
inachu: woah  grey beard?  But I thought you were a 20 something
mokert2: "most of the 400 named characters make only single appearances, serving merely to demonstrate the sheer scope of Pynchon's universe"
Cracktune: there is no incident only that she was playing at it. . .
Cracktune: yapping
swimming_dragon: this is Johnathan blow's favorite book btw
lefttwitchforever: https://www.youtube.com/watch?v=52kiS1oV2k0
Cracktune: ^^^
rivetingco: if u are able to read this ur def a weirdo in my book LUL
UltraScientism: Effort
oubriq: zipf time
Cracktune: @georgehotz check out that youtube from David Foster Wallace. Talks about this kind of writing
Consort1: what book is this?
Cracktune: Gravity Rainbow
OMGizGoZilla: sup mr do it all
rantos9: writing like this is like OOP devs over abstracting things that could be a single function
kibler83: Why did George suddenly open his chat to us plebs? That’s really unlike him. Something about this doesn’t feel right.
papeweio: pulled up the stream and now i have an aneuryism lel
rantos9: @kibler83 because he's not programming. also not reading chat
whiterunknight: @kibler83 Its because it is a chill stream
doker8888: Book club
oubriq: Droste Gravity's Rainbow stream
lefttwitchforever: double tea stream
avrong: Change game to book reading :)
whiterunknight: Yes
xqipx: Who wrote this ?
rivetingco: im ok with not being able to read this shiet LUL
UltraScientism: Technology of reading complex fiction
dontbeameme: they write books like a puzzle
alalaci: Gravity Rainbow
adrinuk: Hi George :D
kefyrasFTW: this book is a technology
dontbeameme: free speech in America no need to be in code anymore
sw4rtz13: I feel offended
dontbeameme: books are wordy to seem smart
avrong: We gotta start george hotz book club
moerus_tft: pyn CHAWN
Marvfinator: is that jonathan blow's favourite book for real?
colonizethemoon: gradient is difeerent
xqipx: suffering make happy
alalaci: Maybe i'm a little late, but did you saw the Linus review?
dontbeameme: nobody speaks or tells stories like that
lefttwitchforever: https://www.youtube.com/watch?v=52kiS1oV2k0 sorry for spamming
Fakhir_Ali: This isn't good stream content but we're here for you since we're not at the pareto edge
swimming_dragon: famous is not a good indicator of good
PsychoSocialxX: how far are you in
protolambda: what code will be remembered like this book in the future?
PsychoSocialxX: oh
lefttwitchforever: audiobook stream
dontbeameme: we make a flow chart
rantos9: big vocabulary is a form of bragging
Kokupsi: Kokupsi subscribed at Tier 1. They've subscribed for 5 months, currently on a 5 month streak! what
r0drin: nice
Cracktune: lock in boys
OMGizGoZilla: if you are looking for another great book to read: https://www.amazon.com/Whats-Our-Problem-Self-Help-Societies-ebook/dp/B0BTJCTR58
dontbeameme: lock in
UltraScientism: Jonathan Blow: "I want to make games for people who like to read Gravity's Rainbow"
avrong: I have to have audio book with george's voice
colonizethemoon: @protolambda reading code is much easier than this as a russian
colonizethemoon: the language in this book is complex
dontbeameme: visualize
dontbeameme: create the visual
dontbeameme: enjoy the creative process of reading
SlowDeluxe: If you are struggling with this what about gargantua and pantagruel LUL
LidlFrog: most books aren't so poetic in the descriptions :D
avrong: Imagine how it feels to read such books in foreign languages...
mokert2: If you enjoy reading I can recommend playing Disco e
DCIBanks: you should look up what Crystal Palace was pre the war
mokert2: Elysium it has great writign
alexlucas__: https://www.networkrailmediacentre.co.uk/news/roof-refurbishments-to-be-completed-at-paddington-station
dontbeameme: he is restless nothing to smoke
lefttwitchforever: whats the difference between velveteen darkness and darkness
Cracktune: he is sitting in a nice interior of a double decker bus or train
rivetingco: i read about how to do push ups, i know everything about em, havent done one yet tho
Cracktune: @lefttwitchforever more senses being described to the reader
grizvok: grizvok subscribed at Tier 1. They've subscribed for 14 months!
ghostwriter_27: I think Gabe Newell is a better outdoor programmer than you are.
jchad4: preach
LidlFrog: procrastinate till the problem goes away EZ
mokert2: nah that shit is real sometimes
OMGizGoZilla: ADHD
mokert2: like knee ligaments
rivetingco: ur not reading, this feels like work…
mokert2: if they are a little loose the joint surfaces wear faster
dontbeameme: your taking in the environment
kefyrasFTW: effortless
dontbeameme: your visualize like your there
OMGizGoZilla: it is like that for ESL readers
Cracktune: Infinite Jest was like that
OMGizGoZilla: I have to picture myself in it to understand it better
Cracktune: you hafta work at it a little bit
dontbeameme: replace it with your own words what it means
peoples923: Beautifully written
UltraScientism: This books is hard on one's short term memory. You have to remember a lot of variables.
dontbeameme: half silver images in view finder means what
lefttwitchforever: inside the cars
gree3nspl0it: name of book
mokert2: double deck train?
Avelansh: is there a term for this kind of writing?
Cracktune: Gravity Rainbow its in the desc
mrrobot723: Yooo, George ASMR
lefttwitchforever: arent like train carts called cars
moerus_tft: @Avelansh turgid
dontbeameme: who what when where why
UltraScientism: @lefttwitchforever could depend on the country
Avelansh: @moerus_tft ty
mrrobot723: i would pay for this
TonyTechYT: TonyTechYT subscribed at Tier 1.
mokert2: @dontbeameme if you only deposit a very thing layer of silver on glass, you get a half mirror. It reflects only like 1/2 or 3/4 of the light instead of 99.9%, so you can kinda see through it, depending on the angle and lighting conditions
grizvok: i used it as a solvent to extract dmt back in the day
moerus_tft: @Avelansh oh that was a joke lol. this is just standard work in the post-modernist literature.
kefyrasFTW: nafta is oil in many languages
UltraScientism: Naphthalene?
alexlucas__: like fire lighters?
whiterunknight: Do you mean napthalene? That's in moth balls
mokert2: naphtalene was used as moth balls
Avelansh: @moerus_tft you'd be surprised if you google turgid writing
Cracktune: NAFTA was a failed trade agreement ... ?
gree3nspl0it: what's the title of the book?
kefyrasFTW: its in the tittle
Cracktune: read the description guys
gree3nspl0it: oh i see. he changed it
UltraScientism: It's better to image search such words. A dictionary definition can't describe appearance
Avelansh: he's a full-time novel reader now
Shivo_Shifter: Shivo_Shifter subscribed with Prime.
dontbeameme: humans don’t change
Byoor: why did you choose that book to read?
dontbeameme: but humans thoughts on situations unless cultural seem universal
4836276578235: LUL
grizvok: lol
mochoWRLD: i started my first job today as a cse, how long until ai makes me homeless?
kefyrasFTW: @mochoWRLD when AI can understand this book LUL
Byoor: i agree
peoples923: mhm
pehdrew: Have you seen linus's video on comma?
rivetingco: Isnt rationality enough?
kefyrasFTW: @pehdrew he watched it on stream
pehdrew: @kefyrasFTW I'm late noooo
hexdhog: have you read any greek/roman mythology?
sdadsaad: 👋☺️💖💞
DCIBanks: you should get the Harvard Classics volumes 1-51
peoples923: Rare indeed.
UltraScientism: Isn't reading actual philosophy better for this?
4836276578235: wwww
peoples923: Same
rivetingco: for some strange reason women seem to be more drawn to that? idk
dontbeameme: you get it
ghostwriter_27: Well, your mods only allow your celebratory communication
dontbeameme: crawl walk run
sw4rtz13: do yuo have a goodreads account?
OnDatGalaxyGas: i love Pynchon i just re-read V.
dontbeameme: this is just like reading internet speak
dontbeameme: but internet speak at the time
dontbeameme: not my billions
Avelansh: not enough billions have wasted
mokert2: putting that same money in high speed rail would have been so much more useful for the future of transportation
swimming_dragon: the money isn't real tho
4836276578235: LUL FAX
TrueRound: What did I walk into :D
peoples923: accountability is rare to find
jagger_rsw: thinking about creating a middelware for the tinybox (on top of tinygrad)? integration with mail, docs, drives, coding, homeautomation etc. easy(ier), to make it fully off-dataceter ai?
dontbeameme: get the women to@like it
dontbeameme: women like it the rest will come
tuugen3213: it might take an audible raeding of thomas pynchon's gravitys rainbow
QuiteLexing: Hm, coping? I mean, they probably extra-wealthy, "Everyone makes mistakes" and a lot of moral "distantce" you talking about?
m4l4r100: same things the other way around
Avelansh: fanatics
dontbeameme: billions buys a lot of yes ppl
rivetingco: Gotta create better propaganda than the enemy
russ_dan: my friend just bought a tesla comma, excited to see it in action
horsecrack: just dont talk to them
jagger_rsw: with ubiquitous ai communism might be reality - abundance etc. - culture series stlyle
uniqcut: yea but China is a giant now
tea_dev: robot slaves solves this
23baez: zero-sum mentality is persistent across almost every single ideology
rivetingco: may the best storyteller win.
lefttwitchforever: @tuugen3213 need a grok thread for this book, aint reading all that
tuugen3213: @lefttwitchforever i literally have a grok tab open summarizing it rn KEKW
yunguid: do you believe the truth will be harder to avoid in the future?
mokert2: @lefttwitchforever I feel like you are missing the point
lefttwitchforever: @mokert2 its a sarcastic comment about todays world
jagger_rsw: zizek always wins
Rik______________: aren't things legit kinda zero-sum? only so much arable land/finite resources?
4836276578235: LUL
Sudszay: LUL
hakobyte: unbelievable
tuugen3213: LOL
mokert2: @lefttwitchforever ah ok, sorry, I thought you were serious
lefttwitchforever: rainbow colored missiles
m4l4r100: lockheed martin has other stuff to be questioned
4836276578235: thats my goat
Byoor: I have been thinking about this a lot actually. Humanities and STEM. After becoming a swe I stopped reading books as much and educating myself in arts. I really miss that.
yehiaabdelm: politics forever cooked
azumart: why are you conflating leftism with this type of corporate virtue signalling? socialists call this out all the time
rivetingco: IM EXCITED AF
rivetingco: WE NEED THIS
dontbeameme: Hell yes he doesn’t lose
tuugen3213: "In June, our carpet bombs are gay"
Marvfinator: lets grow bananas in america
rantos9: define success for the america party
dontbeameme: he got everyone elected
lefttwitchforever: us is actually cooked
dontbeameme: they messed up big
23baez: 😭😭
byterift: a big youtuber (16M subs) made a review of the comma 3x, pretty cool
m4l4r100: @lefttwitchforever its not cooked, its worse than that
coolcake2: @byterift just watched it LUL they gave a very positive feedback
whiterunknight: @byterift We watched it on stream an hour ago
jagger_rsw: the gap between buying tinybox and having it integrated with m mail, drive, homeautomation is too big. fund a middleware.
byterift: @whiterunknight ah darnnnn did george like it?
rivetingco: what i dont understand is why dont good programmers such as karpathy just contribute, its opensource no?
Sudszay: lock the f in george
rockhind: You're such needed competition in the space
whiterunknight: @byterift Yeah he was having fun watching it, plus they were positive
4836276578235: nice, whoop is good
driftlessdreams: getting old sucks
tuugen3213: gulpi, you need to ... 'manage'
peoples923: Health is weapth
robin_2723: following bryan johsons blueprint?
peoples923: wealth*
whiterunknight: Whoop is nice
lnau: been doing any cardio?
lefttwitchforever: preemptive medicine a scam or not
4836276578235: true
tea_dev: injecting peptides yet?
happyshomo: gotta ration the pasta
dontbeameme: what’s ur answer for good parenting
mokert2: diminishing returns
byterift: byterift subscribed with Prime. They've subscribed for 4 months! open source MRI when
dontbeameme: nature or nurture
rantos9: @dontbeameme just don't be bad
smurfd0: moderation is the keyword
nejintejag: food is super multidimensional it depends on your genes
dontbeameme: calories in calories out
rivetingco: If u wanna check out someones whos as good at nutrition as ur at programming, Paul Mason from australia.
lefttwitchforever: i recently found out about this gigachad https://en.wikipedia.org/wiki/George_Hackenschmidt
dontbeameme: you gotta run so the body recycles blood and repairs cells with recycle blood
nejintejag: if you see good/bad as unidimensional
chocolate_mintz: @lefttwitchforever it is a great idea
nantaimori: chat you guys are nerds
oibtujwhcdjkfx: Are you shredded bro? If not, go to the gym bro, for real for real, no cap on a stack.
hemesheme_221: I feel bad for not finishing GR
nantaimori: lol
chocolate_mintz: it just amounts to don't be sedentary, perhaps get the worst crap out of your diet etc.
h0rridhenry: LOL
kefyrasFTW: LUL
m4l4r100: olala
nantaimori: nipples lol
UltraScientism: whose nipples!
chocolate_mintz: and chill out/don't worry
kefyrasFTW: just nipples hanging in the air
Aesthetic_Champ: my nipples? 😳
nantaimori: @georgehotz you need to trim your eye brows
MrKerow: MrKerow subscribed at Tier 1. They've subscribed for 2 months! I come back and high priest george preaching
lefttwitchforever: ok gn everyone !!! happy National Fried Chicken Day.
jagger_rsw: layer
kefyrasFTW: stratosphere?
jagger_rsw: stratum - strata
ahbar21: Why is bro reading a bedtime story
ego_naut: isn't tartan just plaid?
alexlucas__: Are they in a bunker?
whiterunknight: I think he was dreaming about the first part
m4l4r100: taylor swift: champagne problems?
subfolrandom: @georgehotz Politics allowed today?
afterworktech: afterworktech subscribed at Tier 1. They've subscribed for 31 months!
subfolrandom: !followage
peoples923: @ahbar21 Saturn
peoples923: @ahbar21 Saturn's Return :)
azumart: can you explain what lead to starvation in communism?
chocolate_mintz: DinoDance
sarah99___: wait what is going on. Did George trip on shrooms? Is this the singularity?
subfolrandom: I hear you, george
mokert2: A lot of starvation under Stalin was due to anti-scientific shit like Lysenkoism (which held that "genes dont exist")
tea_dev: number went up tho
dontbeameme: nobody thinks they gonna be the trash man in communism
zetamacgrinder: how fix?
chocolate_mintz: they only bought burgers, of course there are no flying cars
kefyrasFTW: communism speedruning to people mass dying, capitalism is only now catching up
azumart: TBH I think this analysis is missing nuance, there were a lot of other factors that contributed to starvation in the USSR. Yes, mismanagement took a role, but that was not only it
zetamacgrinder: the problem with communism is that communists claim they know how to fix
peoples923: @dontbeameme trust man sounds nicer
azumart: we have misallocation of capital now too, it goes into the hands of billionaires while the rest of the world is plundered lol
tea_dev: brought to you by betterhelp
peoples923: That resonates.  "How good is your system at allocating capital?"
user15197573: so todays system is worst than communism?
azumart: at least the socialist experiences tried to address this misallocation, and did so successfully a lot of times
peoples923: @dontbeameme :)
kefyrasFTW: LUL
JdPaulBlart: isnt america obviously the best allocator of capital vs ussr given the reults
zetamacgrinder: @azumart billionaires are usually are an indication of successful capital allocation. bad capital allocation is YC.
Miauzin: and why the allocation is so bad?
j3ckerd: aware
whiterunknight: Oh my god hes touching chat with his dirty hands
chocolate_mintz: Basically the people with the capital don't really know what to invest in.  I think they tend to be kind of generalist.
azumart: @arthurskylive they are an indication of a profit-maximizing system that puts human welfare as secondary. Everyone's energy is devoted to making the shareholder richer. BlackRock is the winner in our society and everyone else picks up the scraps
robin_2723: @azumart (((blackrock)))
dontbeameme: culting
mokert2: Allocation of scarce resources (natural and human) is not obviously easy I would say
azumart: @georgehotz let's watch a video on this topic :D   https://www.youtube.com/watch?v=rIB4e8AfPcM
lefttwitchforever: debatebros ruined the internet, people started to argue for sake of arguing
m4l4r100: most people dont ditch their comfortable lifestyle
dontbeameme: ask AI to debate u
dontbeameme: make@it take opposite view
swimming_dragon: can we stop the heat death?
azumart: most people don't even have the material means to have a comfortable lifestyle
peoples923: <3
kefyrasFTW: LUL 󠀀
evilfjalar: are you back in the US?
zetamacgrinder: @azumart you aint got the answers
chocolate_mintz: well need to look broader than gdp for growth, basically people's alternatives getting better
m4l4r100: @swimming_dragon meet rick first
lefttwitchforever: democracy is the government by the people, of the people, for the people, but the people are retarded.
uuuvn: idk about stop but here's a funny thing - https://arxiv.org/pdf/1705.03394
Supax1: u mentioned about tipping systems/uber fares as bad modern tech, what in ur opinion is a definition of good modern tech
knov_22: What was this reference from: "How many cans of Pepsi did you want them to consume an hour again?"
azumart: @arthurskylive I don't, but I know the current system can definitely be improved upon. I think in the same way that we moved from feudalism into capitalism, we can move from capitalism into something different
dontbeameme: cage is a cage
subfolrandom: georgehotz are politics allowed today?
mokert2: I think that is a necessary but not sufficient ocndition
m4l4r100: jd vance meme pls
mokert2: spending below your means
robin_2723: you know about nick fuentes?
azumart: @georgehotz I think you are overlooking quite a bit here man, I'm talking about a lot of people that live in abject poverty with lack to the most basic resources. This is an addressable problem that is not taken care of because our system doesn't care about it
QuiteLexing: Sorry, stupid and offtopic. How is your eyesight? Do you have glasses / LC?   (Stiching this to topic, all these high-tech things with pharma industry and captialism, seems that they really benefit and support all these system flaws?)
itsamarcos: yapping is free
dontbeameme: so do books
lefttwitchforever: debatebro culture
dontbeameme: before Internet feel like books did this
subfolrandom: I wanted to ask your opinion about the indian muslim socialist from uganda, zohran mamdani @georgehotz
T2sde: 59 raiders from T2sde have joined!
mokert2: OH hi T2 folks
whiterunknight: Is T2 T3's younger sibling?
itsamarcos: wait george wrote a book?
peoples923: Good faith critique & good faith feedback <3
T2sde: t2 is https://t2linux.com :-) still runs on PS3 as GameOS :-)
whiterunknight: @itsamarcos No its from the 1970s by Thomas Pynchor
Ph1lure: @subfolrandom why phrase it like that
zetamacgrinder: @T2sde hallo
subfolrandom: @Ph1lure Anything untrue about it?
peoples923: @T2sde hmm
Ph1lure: Just tired of the identity politics
chocolate_mintz: Hume is interesting on cause/effect, basically there is no underlying mechanism, you just see one thing then you see another
tea_dev: we need off-earth labs to trilaterate physics better
subfolrandom: @Ph1lure You're indian?
iowiess: how will you die?
deep_adi: this is very Wolfram coded
dontbeameme: can we solve humans from being lonely in nursing homes first
dontbeameme: humans need to have more humanity
swimming_dragon: idk why but i wish you went on Sam hyde's podcast
mokert2: there is Gödels incompleteness if you want to go particularly unhinged
Ph1lure: @subfolrandom Dutch, but what does it even matter?
pepebruari: what I'd miss since the comma YT?
dontbeameme: human can’t even prevent obesity or understand man women relations
Zeevo: Have you read Godel Escher Bach?
subfolrandom: What do you think about Mamdani
oibtujwhcdjkfx: Yes
TheRealGecika: nope
mokert2: nah
dontbeameme: who what when where why
kefyrasFTW: what hypotesis?
ownsoft: I end at what you just said
deep_adi: i watched a veritasium video once lol
oibtujwhcdjkfx: Yes, call me on Discord.
rivar0: @kefyrasFTW Riemann
tea_dev: numbers are only a theory
robin_2723: lmfao hinge
OnDatGalaxyGas: LUL
Supax1: i liked that blog post
pepebruari: what happened to the blonde hottie?
lefttwitchforever: they are all sheep
m4l4r100: i mean, getting better quantum science might actually break the simulation eventually, if we're getting through all filters hopefully
swimming_dragon: dating apps give you the worst blackpill of all
GIGA10101: the divide in understanding is immeasurable
sarah99___: hold up George we cant say the word in chat, it's blacklisted 😃
zetamacgrinder: lol
Supax1: chat i missed it, what book is he talking about?
chocolate_mintz: some of it is knowing your limits, not terribly hard, I'm not a medical doctor, I'm not...
sarah99___: gravity rainbow @Supax1
mokert2: Dating apps have every incentive to be tuned for maximizing short unstable relationships
Supax1: ty!
peoples923: mhm know thyself.
TheRealGecika: I get upset by the wilfully ignorant
dontbeameme: a lot of activist in geo dms
dontbeameme: it’s about feelings not logic
dantedante33: that my life motto
subfolrandom: You wrote in sand on a beach one day "Those people who think they know everything are a great annoyance to those of us who do" it was on your insta story 3 years ago I think @georgehotz
azumart: you sound very condescending dawg :'(
mukeshjain21: George, do you have any tips for dealing with oneitis? (My gf broke up with me some months ago, I feel very lost)
peoples923: totally.
iowiess: how will you die?
re_detach: brother
hemesheme_221: @mukeshjain21 go build something cool
frperson: @azumart nah just realistic
banceman: I agree so much
Zeevo: @mukeshjain21 time
idenieide: Have you understood the analytic continuation?
cheekyibiki: lmao
dontbeameme: he is expressing himself
dontbeameme: he is not targeting someone
banceman: also taking what geo says in good faith?
zetamacgrinder: do you think positive change is likeley or not
dontbeameme: his audience is not fragile
re_detach: i aint even try dmt yet but i fell like im there
azumart: because I think your example of BLM was unwarranted to justify a gap in intelligence (i.e. I see what they don't see, I am right they are wrong)
subfolrandom: You did say once that Andrej Karpathy streams to educate and  You @georgehotz stream to impress haha
DJradek2: loss of confidence that affects everything you do
azumart: you could have expressed it differently potentially
banceman: have you felt insecure about it? or bad?
dantedante33: its like minecraft creative mode, but u dont know what to fuckin do
rivar0: learn to not be full of oneself is a must in order to grow. happens to me when i fail at algebra classes. Just thinking that everything would be instictivelly well without effort, then i realized, i am stupid. right now. and fail. two times
peoples923: @subfolrandom lol i remember that too.
cheekyibiki: when george go to dmt land @re_detach
re_detach: sam or george will give me the call ig
dontbeameme: red flags
TheRealGecika: its a distraction for them to hide behind
m4l4r100: but do you think the "stop talking about it and it will go away" will really work like morgan freeman said
MrKerow: some people are too tied to their emotions they rather feel than know
Zeevo: @georgehotz what movements right now do you think are on the right track?
iowiess: but isnt there black discrimination? Like % of Blacks Arrested is higher than other groups, no?
azumart: I agree btw, I think identity politics which is devoid of class struggle is not productive. I hate how you can have Lockheed martin, which bombs people, supporting LGTB+ etc...
dontbeameme: yeah use same mask all day
peoples923: How much bleed, how much release to get flow state?
dontbeameme: use wrong mask also
MonteCarloSimulations: very scary
MonteCarloSimulations: to still see that
jayhey00: Kappa cancel him
peoples923: It was def eye opening.
BookOfMikado: Capitalism is the root of all human problems
dontbeameme: very bad hygiene
jellday: intuition trumps rationalisation
dontbeameme: exactly
StatelyFall: sheesh
mokert2: yeah that is a huge problem
pepebruari: damn bagel shopz
dontbeameme: it’s about people lacking accountability
azumart: @BookOfMikado 100%
StatelyFall: ?
dontbeameme: yes ppl want to solve something
dontbeameme: greater good
MrKerow: nah it's about saving the day rather than long term planning
zetamacgrinder: combination of both
re_detach: diversity is necessary, randomness is necessary for expressing all possible combinations, limitations breed creativity
tea_dev: prevalence-induced concept change
LateStageUsername: why not both :)
uuuvn: Or they don't care about the second order effects
StatelyFall: why not more?
dontbeameme: it’s always for the greater good nobody the bad guy
mokert2: @uuuvn this
oibtujwhcdjkfx: Never ascribe to malice that which is adequately explained by incompetence.
TheRealGecika: oh, they don't want us educated. hahaha
dontbeameme: yeah when foreign money buys houses that’s the outlier
lefttwitchforever: wonder how much capital would it take to crash the housing market
subfolrandom: So, Nat'ralists observe, a Flea Hath smaller Fleas that on him prey. And these have smaller Fleas to bite 'em, And so proceed ad infinitum.
re_detach: cause inflation is govts friend, the taxes pay them why wouldnt they want prices to rise
azumart: socialist economies solved housing crisis better than their capitalist counterparts :D
free_palestine74: I don't think rent control is meant to be a permanent fix, just temporarily buying time until the supply is increased?
NLozar22: People would HATE IT if they understood basic economics
MrKerow: yes but if they built more houses prices of houses will go down and powers that b doesn't want that because they own the houses
nick_dr1ft: yeah, I feel like a big issue in society rn is people agreeing on issues. But most are completely blind on how you can solve those issues
DJradek2: technically it could reduce demand of investment real estate?
m4l4r100: yes so, rent control + public housing. otherwise it will destroy the housing market
iowiess: should ai govern? i think ai does already propose reasonable solutions to housing.
StatelyFall: sounds a lot like minimum wage cant be increased somewhat not fully
dontbeameme: exactly
ownsoft: yeah but if you limit rent then AirBnb bros stop buying flats and demand falls
naklecha: yep i live in the netherlands and it took me 5 months to get a house because of rent control even though i could pay way more than the rent i’m paying now (maybe i’m happier now that i have a house tho)
re_detach: everyone has an opportunity, some just take a while to see it
dontbeameme: nobody ever feels like they made it, always need more
lefttwitchforever: rent control is stupid
dontbeameme: one person skips line everyone does it
lefttwitchforever: housing hoarders are stupid too
subfolrandom: Did you ever finish Shkreli's finance lessons? @georgehotz
azumart: we're already starting from a bad place when a house is a commodity, an investment, which can be hoarded by the ultra wealthy while others struggle to live
mokert2: The problem is that a lot of housing is vacant in some areas due to perverse incentives
dontbeameme: everyone wants an advantage
azumart: takes us back to the root of all major problems today: capitalism
StatelyFall: shkreili has lessons lmaooooo
Sudszay: theres no room for nuance in popular discourse
zetamacgrinder: one pretense of rent control is not that it is an economic fix but social justice
FatherOfFamilyValues: The concept itself of dating apps just seems like a skinner box, why engage with them in the first place?
Supax1: your last blog post was great and predicted a lot of the issues currently
ryasuar: Can you clarify what is rent control for you? We have something like that in Germany but it sounds different from what you're talking about
peoples923: Good faith dialogue <3 Hidden closed systems lead to faster total system collapse. mhm
sarah99___: what's the TLDR of the blog ?
subfolrandom: @StatelyFall Yeah george used to watch Shkreli's finance lessons
rockhind: What is this link/blog?
NLozar22: why isn't minimum wage first order effect? it would instantly cause loss of jobs because businesses wouldn't be able to afford to pay them
Zeevo: Elephant in the Brain talks about how competition can create local maximums. Like housing shortages
iowiess: can there be justice?
mokert2: The fact that there are empty places in a downtown area is a clear indication that things are wrong
MrKerow: https://geohot.github.io/blog/
re_detach: elongated muskrat
Supax1: @sarah99___ manipulation, advertising tech bad, open tech good
banceman: https://geohot.github.io/blog/jekyll/update/2025/07/05/are-we-the-baddies.html
whiterunknight: build more houses :)
zetamacgrinder: in some moral framework it is coherent and correct
StatelyFall: LMAOOO
lefttwitchforever: i was having a walk and thought how much capital it would take to crash the housing market
simplecolon: just hopping in, hope you are doing well george. wanted to ask your view on how this elons new party is going to play out
mokert2: inelastic supply and and demand
re_detach: shaking in they boots arent they
guilhermicas: watching this from second monitor, and from his motions, he's right
naklecha: building more houses in nyc seems kinda hard though
DRoBLAZEDELL: How could we even know what will happen if 1% more housing is built?
lefttwitchforever: and how many yc ai scams i have to do to get enough capital
ownsoft: what about regulating airbnb? That's the cause of housing crisis at least in EU
StatelyFall: !blog
re_detach: scammers scamming themselves thats poetic af
whiterunknight: @ownsoft It's not the cause of the housing crisis thats insane
lefttwitchforever: @ownsoft no its not even airbnb
whiterunknight: It plays a small part probably and only in tourist destinations
banceman: GeoHotz is our favorite economist
dantedante33: @georgehotz next to comma.ai what other new technologies are out there that have positive impact on the world, u can think of?
BruderWarum: can we put bountys on scammers heads? @georgehotz
skarmorysavvy: i feel as though in the modern world it is nothing but intentional ignorance
Zeevo: @g
dontbeameme: can we irl at a promoter table
lefttwitchforever: current housing situation is like the 51% attack on silcion valley
dontbeameme: we go to the club
chocolate_mintz: I read some map/territory stuff, Hiyakawa's "Language in Thought and Action".
hemesheme_221: when did you start appreciating the humanities?
j3ckerd: did u see the weird peter thiel interview
uuuvn: I don't get why they have to be either dumb or evil as in actively desire the bad effects. Doesn't something like (in a rent control example) "want votes, doesn't care at all about the effects" explains everything quite well?
oibtujwhcdjkfx: Interesting how you have the same opinion like Eric Weinstein.
kefyrasFTW: LUL
simplecolon: just hopping in, hope you are doing well @georgehotz . wanted to ask your view on how this elons new party is going to play out
isco___hdz: Don't say
kefyrasFTW: in a minecraft
dontbeameme: we want geo in public on soap box
dontbeameme: it’s gone dark
akklaimd: haHAA
whiterunknight: Newest rumble streamer george hotz
dontbeameme: no filter love it
jayhey00: reasonable take
zetamacgrinder: it doesnt work because the mean opinion is not verifable truth
sarah99___: my assigned FBI agent is not happy BigSad
DRoBLAZEDELL: nice
kalelite: now explain what to do instead
Sharpshooter7678: Wonder what % of nyc apartments are vacant vs projected demand and how much new housing will be needed to fill that gap
subfolrandom: I wouldn't say they're exactly boring..
dontbeameme: you don’t even get money doing something like that
kefyrasFTW: just play mario
azumart: @kalelite overthrow capitalism :D
hemesheme_221: when did you start appreciating the humanities? 󠀀
mokert2: We all have to find our own Boulder
iowiess: have you read camus?
deep_adi: Luigi on a bigger scale is just revolutions like in the past
ColdZer0o: message received
m4l4r100: shooting yourself also dont do that maybe
Ayyyy420Lmao: 1h later still reading lmao
Supax1: u watch the latest thiel podcast yet?
simplecolon: @georgehotz wanted to ask your view on how this elons new party is going to play out
dontbeameme: geo would be good humanities with propaganda and influence campaigns
MonteCarloSimulations: thank you for that housing fact
kleptomaniakk: wheres the link to these blogs
simplecolon: could u share blog link pls
FatherOfFamilyValues: @kleptomaniakk https://geohot.github.io/blog/
dontbeameme: show profile
woozyface0: just search blog bruh
StatelyFall: LOL i look at my activision buddies and just sigh then i look at where i am and im like sheesh
whiterunknight: Hinge for gays is great, no boosting needed
dantedante33: hahahaha
Supax1: LOL
dantedante33: clip that
BookOfMikado: LUL LUL LUL
m4l4r100: slap me with fried fish
ghostcomrade: personified metrics optimizers
TheRealGecika: I missed the hinge intro, what is it?
astoriarpz: so which app should we use
woozyface0: Is it great?
simplecolon: dont teach a man to fish, slap the man with the fish
TheRealGecika: wait- nvm, goggle
naklecha: hinge is so much better than every other dating app
peoples923: Threads from Instagram is terrible too.
dontbeameme: show raya profile
Supax1: match monopoly needs to be taken down
whiterunknight: I thought it was linkedin
dontbeameme: you gotta get into social member clubs
woozyface0: i know that’s right
banceman: but only if you have blue check mark
m4l4r100: insta never worked for me
dontbeameme: in person and location the best
isco___hdz: linkedin
zetamacgrinder: im using counterstrike for my online dating
astoriarpz: bouldering is ez pz
MonteCarloSimulations: @m4l4r100 where yo game at
chillinte: @zetamacgrinder same
j3ckerd: Zzzzzz
dontbeameme: damn that’s some bs
zetamacgrinder: @chillinte baddie in every other game
BookOfMikado: LUL LUL
swimming_dragon: put tinygrad on pause and build a dating app
dontbeameme: that’s worse then buy OF profile
j3ckerd: take me out to dinner before u try and fuck me
jayhey00: consultant rizz
Supax1: george got IG game?
naklecha: oh hell no
kalelite: that only works if you have 50k followers
woozyface0: it helps if you’re a ceo or nah? 😂
whiterunknight: I dont have a ferrari pic like you
dontbeameme: we need go to promoter table
kefyrasFTW: LUL
dontbeameme: geo got game
taere_: LUL
m4l4r100: onlyfans really bad, dont do it guys. will mess with ya reason to live
Supax1: i love that
naklecha: ferrari pic hard carry
lefttwitchforever: brb going to slide in to kendall jenner dms
lefttwitchforever: sydney sweeney im coming for u
dontbeameme: you gotta offer a experience so they wanna spend there time
DrFBIMAN: LUL
MonteCarloSimulations: would you rather date someone from your past or date someone new @georgehotz
dontbeameme: their
peoples923: hehe
piratesofthesomalian: best dating is to do it offline, the best filter is the guys who have the balls to do it or no
DrFBIMAN: hahahahahaha
career0001: how to become famous do cringe ?
peoples923: @piratesofthesomalian very true
dantedante33: not that low
lefttwitchforever: my type is the people who dont go to clubs
woozyface0: pretty low
zetamacgrinder: do it 40 times
dontbeameme: yeah he doesn’t seem like the builder type
peoples923: You have to keep your eye open and the universe will lead you're person to you.  Grocery store, walking at the park, or wherever.
SpeedWiener: talking to every girl in the neighborhood to try to find a near match... DendiFace
ownsoft: there's still also the "90% of girls want top 5% attractive men" thing
TheRealGecika: wow, I think I set my bar too high
deep_adi: you once said that you have to go where the girls are, so how is this advice working out?
Fleetwood2048: less than 1/1000 bro Kappa Kappa
isco___hdz: you want to get to know girls?? They are so boring....
dontbeameme: attractive is relative
astoriarpz: everybody is delusional
banceman: because you are top 5% geo...
ownsoft: but you are the 5% of course
dontbeameme: if you a good host and socially aware you got good odds
zetamacgrinder: my type is autistic
LidlFrog: says the male model :(
Fleetwood2048: geo is top 10% of desirability surely
Fleetwood2048: rich and confident is more than enough
Wilhelm_Vilhelm: Rizz
lib64: i have a friend like that lol
yeethatbeet: what's your rizz level my g
zetamacgrinder: something about jawline and hunter eyes
lefttwitchforever: they are paid agents by tinder
lib64: u should see when he walks into a bar
Marvfinator: rolls royce boys, that enough
jayhey00: Do I get more rizz if i buy a tinybox?
m4l4r100: hows the hong kong date goin?
zetamacgrinder: no
peoples923: Remember Hot or Not? lol
TcpStream: It's in the name Goerge HOTz
banceman: but people can google you
lib64: but granted he's ~1:1000
arnaude: 5.5 PSL
swimming_dragon: try it yourself with a fake profile of a really good looking rich guy
ownsoft: top 30 definitely
DRoBLAZEDELL: if your money's in the photo
piratesofthesomalian: curly hair puts you at least into top 20%
dontbeameme: it’s in the DNA to test how you would be as a family
gree3nspl0it: you look good for 35
kefyrasFTW: LUL 󠀀
NitsDeMusica: in asia you'll feel like a top 5
peoples923: You could as Hot or Not your attractive rating.
azumart: I have a theory that everyone can be at least a 6-7 regardless of starting position. Healthy life, good clothes, and good attitude go a loonng way
Fleetwood2048: for men as long as you're not deformed
Fleetwood2048: you're good
career0001: how do u know she's the one geroge
dantedante33: iced out hotz on profile
peoples923: @azumart true
zetamacgrinder: gaussian distributoin rated by your type is the relevant metric
Supax1: how about height
peoples923: Just staying in shape will put you in a good pool.
isco___hdz: if you are brown you are screwed
dontbeameme: the dude can’t be poorer or have less life experience
ghostcomrade: reddit build is crazy
Fleetwood2048: 71.6% of all American adults age 20 and above were overweight or obese
dontbeameme: you gotta have a understanding of the world
lib64: u also benefit from being >= 3 standard deviations above the mean in at least a few very desirable traits (intelligence, creativity, confidence?)
jayhey00: LUL
zetamacgrinder: its true
banceman: I'm 5'3 T_T
whiterunknight: Google says your height is 5'4"
Fleetwood2048: different races have different endogamy preferences
DJradek2: some research said its -15% or something
Supax1: yeah its hard to convey certain things through dating app pics
peoples923: hahaha winning!
robin_2723: lmaoo
kefyrasFTW: LUL
zetamacgrinder: is 5'5 high enough?
whiterunknight: LUL
strandedbullfrog: leg extensions we get it
LidlFrog: LuL
BruderWarum: nature is healing
piratesofthesomalian: could you just contract an ad agency to promote you to the ladies (real question) lol
peoples923: LMAO your ID?
idenieide: They did to fuck with you obv
peoples923: @piratesofthesomalian lol run a campaign
banceman: did you get the apology note from sunder?
Fleetwood2048: you must be taller than the female in question
dantedante33: thick meat.
QuiteLexing: We needs rates about hight
dontbeameme: yeah if your a short dude and the women understand what’s going on more then u
Fleetwood2048: the data on that is very clear
peoples923: heigh is attractive
peoples923: height*
Supax1: yeah RIP
career0001: is match making just brute forcing
zetamacgrinder: :(
azumart: brothers, there's literally billions of women out there. Don't matter what you are right now, just take care of yourself and be a decent person, you'll find someone lol
robin_2723: dommy mommy
jayhey00: nah
ghostcomrade: it's a blessing
ego_naut: do dating app even work for the average joe?
v4ltres: just lie about your height
woozyface0: maybe
dontbeameme: you don’t like to laugh
peoples923: i would never date a girl like that.
dontbeameme: you don’t want a girl u can laugh at
shinystareuw: thats the fish slapping kinda deal
TheRealGecika: I'm 5'1, almost all men are taller than me! haha
banceman: you got that aplogy letter from sunder yet?
Supax1: great thing abt being average is that u know the girl actually likes u
codepour: they are dehydrated all the time
adepthus: xD
taere_: LUL
dantedante33: please go the life coach route
naklecha: can we review your profile?
dontbeameme: bots on bots
woozyface0: definitely
TcpStream: Online dating show, hosted by Hotz
dontbeameme: you ever try meet up it goes dark
play_dnd: thoughts on these tips? https://www.youtube.com/watch?v=ORAA8JhkV2U
oibtujwhcdjkfx: The only girls I date don't Java but do see sharp.
Sharpshooter7678: she could be scheming for your benefit though
lefttwitchforever: omegle dating
Fleetwood2048: geo needs to reduce to the subset of women who understand his value in his hierarchy of choice
gsdeight: sup george big fan
PsychoSocialxX: thats like an ad
m4l4r100: if youd develop a dating app, I would upload my id for it
UltraScientism: Are there AI bots in these dating apps? Somebody must have made it already.
dontbeameme: make it
deep_adi: next up: tinymatch
career0001: i saw a tweet one time a guy with 2.5 million swipes and 1 irl date
Wilhelm_Vilhelm: I built a poc that runs triangulation from the distances on tinder
dontbeameme: you should make it wtf
peoples923: a trust app or SPA.
TheRealGecika: match people based on things they hate LUL
shannon_arm: shannon_arm subscribed at Tier 1.
jayhey00: Kappa  makes his own app becaue he can not get any matches
cacaosteve: solve the problem of if users are real
dontbeameme: you want casual you gotta have bread
BookOfMikado: Most dating apps prioritize sex and ego boosts rather than meaningful relationships
genn2k: 101 to get banned on hinge pls
ownsoft: I think the bootstrapping issue of new social media burns every good idea there is
career0001: would u say quantifying people and showing recs based on that would work
lefttwitchforever: wealth
TheRealGecika: daddy issues
dontbeameme: food
genn2k: money
Zeevo: Distance
JdPaulBlart: hot
Wilhelm_Vilhelm: Height
tea_dev: saying they arent there for hookups
woozyface0: distance
haircutjimmy: shoes
mokert2: hormones?
piratesofthesomalian: Your are more attractive tthan her
salmonelite: tattoos
Ayyyy420Lmao: psychopathy
tahiraslammm: aura
robin_2723: unironically height
waena_: face
play_dnd: tinygrad user
jeumer: friends
DJradek2: muscle?
hemesheme_221: ivy league
zetamacgrinder: just say
TcpStream: Teeth
ego_naut: no idea
peoples923: Profile picture?
m4l4r100: humor
Sharpshooter7678: aura
v4ltres: butterfly tattoo
LidlFrog: kids
kefyrasFTW: big dick
lib64: one thing i've noticed is how much easier it is to be successful if u build comfort/familiarity via repeated in person interactions
majorwho: friends?
NitsDeMusica: ovulating
lefttwitchforever: name
haircutjimmy: earlobes
lefttwitchforever: google name
arbbs: lol
dontbeameme: bruh
lefttwitchforever: :((
dontbeameme: cmon son
DJradek2: lmao
TheRealGecika: I don't use dating apps and I am not a dude
peoples923: LMAO eww
mokert2: ah right
woozyface0: hmm yeah
career0001: free std
Ayyyy420Lmao: blackpill
dantedante33: oh, her body count
JavierSO: blackpill
verte21: thought its money
dontbeameme: yeah but that’s not conversation you gonna have
TheRealGecika: that makes sense
intr1k4t: all i know is that if her legs are on your shoulders - she likes you
piratesofthesomalian: what is the predictor for guys looking for marriage pr comittment?
JdPaulBlart: the girl with 1000 bodies is my only hope
dontbeameme: you gotta get them meet up then your odds increase
dimatisc: aprikNotes
waena_: @JdPaulBlart LUL
ownsoft: the same applies for getting std
jayhey00: time for ai gf
TheRealGecika: yes
yeethatbeet: lmaooo
majorwho: the "hoeness"
tahiraslammm: @JdPaulBlart bonnie blue
Fleetwood2048: unverifiable
Wilhelm_Vilhelm: Verified cock size
robin_2723: github but for dating
Supax1: LUL
gree3nspl0it: asking girls their body county is a risky move
dontbeameme: yes weight needs to be a thing
banceman: research from OkCupid revealed an interesting behavioral predictor: liking the taste of beer was the single best casual conversation topic correlated with having sex on the first date,
dontbeameme: fax
lefttwitchforever: cup size
TheRealGecika: and you should, because why should people be ashamed of that?
crios240: What us
dantedante33: oh, i htink this will e a thing soon
dontbeameme: weight needs to be a thing fax
Fleetwood2048: socially acceptable to dunk on height
codepour: inclusion ...
kefyrasFTW: or distance between your eyes
ryasuar: weight changes often though
play_dnd: Verified Mental Issues
career0001: they should have body fat % just at this point
NitsDeMusica: woman won't use it then
aksdjasdas: you can see weight from the pictures
naklecha: tbf you have to make the app focused on girls and the boys will show up
formemi: Ass curve points
haircutjimmy: pictures lie
shannon_arm: they have mbti now
BookOfMikado: @aksdjasdas LUL LUL LUL LUL
NLozar22: Are you required to post your height? Sry, I'm not on these stuff
dantedante33: next: ethnicity filter. LETS GOOOO
QuiteLexing: Did you heard about "Boo"? They did a bet on personality tests (NOTICEABLY A LOT)
iowiess: i hate this constant thought of whats allowed on twitch and what not.
dontbeameme: anti filter in app please
ego_naut: in an ideal world I wouldn't like to know their body count
Wilhelm_Vilhelm: George would you prefer sex communism or sex capitalism?
whiterunknight: Yeah I hate the club too!!!!
arbbs: facts
TheRealGecika: girls go to the club to dance, not for picking up men
dontbeameme: you don’t go promoter table thats why
shannon_arm: @georgehotz is mbti a scam?
play_dnd: Who cares about real girls anyway... im waiting for AI girlfriends
swimming_dragon: please make a dating app... the weight thing drives me crazy
Supax1: yeah but how will u fix the problem where its just way more male users
m4l4r100: why no one talks about humor. there is a reason that one song from cyndi lauper exists @georgehotz
arbbs: w george
BruderWarum: clubs attract women, women attract men
lyrareturns: Russians are at the clurb
peoples923: How a women see's the world is🔑
jayhey00: Kappa
genn2k: whats your elo on hinge ?
PsychoSocialxX: to be seen
kleptomaniakk: what if there was an open source club, you'll like it and they'll like it
piratesofthesomalian: best way to get dates is to go to hairdresser school
dontbeameme: coca is why they go
john_kosta01: drink and attention
TheRealGecika: we go to dance
isco___hdz: 100%
arbbs: for the chaos
TcpStream: To take bathroom pics
isco___hdz: they love to feel desired
dantedante33: bro, clubs now are soo dead. they be just standing
naklecha: i think a dating app with a public elo would go so hard, the guys in elo hell can quit and not waste their time
tahiraslammm: we should code now
peoples923: The best place to pick up women George is the Gay Club.  That is where you will find the best ones.
dontbeameme: so we starting a app let’s do it
Fleetwood2048: there is no app for geo
peoples923: Or i mean MEET women. Gay clubs are a good place.
mukeshjain21: Casual sex is kinda trash
swimming_dragon: dating app that charges guys and free for women
UltraScientism: State regulation for dating apps that insures fairness and minimizes manipulation?
whiterunknight: The great part about hinge boosting is that you can just blame not being boosted for not getting any matches
whiterunknight: Atleast thats what I do
zetamacgrinder: become gay
genn2k: no elo scores then ? :(
play_dnd: thoughts on this? @georgehotz https://browser.dating/
m4l4r100: you dont have to make up for it. just do it and then let go when the train comes
SlowDeluxe: @swimming_dragon So bumble LUL
d0ubletruth: no need to go to clubs, i just go to the local psych ward, ez
majorwho: George the playboy
peoples923: @d0ubletruth hahaha
glengarryglenross3030: I only play ranked
kalelite: hedonism is trash
MarianG: if you get it is good, if you don't get it's trash
dontbeameme: poor casual when u got bread it’s fun
SpeedWiener: @mukeshjain21 the best 30 seconds of the week. Kappa
shannon_arm: have you ever read PiHKAL?
whiterunknight: Pog who is gonna squad up with me?
peoples923: very true
lefttwitchforever: teeth
career0001: do u think religion influences all of this
arnaude: but looks are like 80% genetics tho
banceman: emotional intelligence?
UltraScientism: wat?
m4l4r100: where is your biceps
Fleetwood2048: for men looks are a way smaller factor
hemesheme_221: everyone can be a 7
piratesofthesomalian: crazy hypothesis: dating is a subconscious insticntual program and you just have to not interfere
whiterunknight: DAMMM
LidlFrog: 😳
majorwho: jacked
banceman: wohaaa geo lifts
whiterunknight: Whats your bench max
swimming_dragon: have you ever goten a bad hair cut it makes or breaks you
ownsoft: see kardashians when they were young, then think about the genetics thing
waena_: how is your ear
m4l4r100: you been hittin the gym? nice one man
avrong: The best looks are the ones that show that you are healthy and have a good sleep atleast
dontbeameme: power lift let’s go
yeethatbeet: men can get away with being a lil ugly
career0001: some 10/10 mans according to you
Supax1: damn lets go george!
dontbeameme: you gotta carry the girl out the club
dontbeameme: feet hurt
zetamacgrinder: @yeethatbeet everyone can
CraftingLinks: Where is Alex?
MarianG: @ownsoft that's a different league of genetics and environment
noscreenkaladin: based
peoples923: Biking? Very nice.
BullPsy_: rich habit
ego_naut: bigger bench numbers got me nowhere
abitranis: take creatine daily..
iowiess: what do you do at comma currently?
d0ubletruth: sexist
isco___hdz: pause
b_lo77: discrimination!
Supax1: lazy
m4l4r100: but dont lose that biceps yo @georgehotz
b_lo77: lol
majorwho: not the right mindset
dontbeameme: overweight lacks discipline
genn2k: LUL
hemesheme_221: @abitranis does it even help with cardip
lefttwitchforever: dating science
TheRealGecika: they don't care about themselves or have discipline. I'll say it
MarianG: they would punish your arse so hard
peoples923: Being active <3
dontbeameme: discipline is required for success
naklecha: did you move out from china? what was the dating scene like in china?
dontbeameme: 2025 no excuses
arnaude: thoughts on ozempic?
zetamacgrinder: there should be open source software
dontbeameme: reason ppl with filters and bs they know it’s wrong
peoples923: @dontbeameme Am working on that!
TheRealGecika: unless they got sick, then that is a legit reason
banceman: I didn't think you would care about physical activity and wanted to live in the cloud
StatelyFall: shit
peoples923: I've been spiritually fat. exFAT
career0001: do u swim ?
NLozar22: @zetamacgrinder what for? (besides everything)
ego_naut: @arnaude ozempic is single action there better things coming
b_lo77: *gets girlfriend...gains 35 pounds - the cycles of life
zetamacgrinder: @NLozar22 calorie counting
moritzmusic: why are all tweets deleted
peoples923: @career0001 I would love to start swimming.
m4l4r100: if you dont know how to cook, you'll always open uber eats
TriXavier_: Amplifies short term satisfaction over personal growth
MarianG: i've been eating tea and tomato salad all week, tea in the morning, salad in evening .. also, it's a hot summer
zetamacgrinder: work out your ass muscles
lefttwitchforever: we aint making it past 27
tea_dev: what if your avatar is overweight
majorwho: haha
NLozar22: @zetamacgrinder that doesn't exist?
zetamacgrinder: women like nice asses
TheRealGecika: LUL
rivetingco: have u heard of Carl R. Rogers? Insane human. In a good way.
piratesofthesomalian: problem with dating is that both parties try to trap somebody out of their league
outlier2: hip thrusts
Barakie: Congrats on Linustech reviewing your product, Geohot!
career0001: the cal.ai values are fake af like how tf can u track calories from image
whiterunknight: Hip thrusts
zetamacgrinder: @NLozar22 name?
robin_2723: call on me music video
rivar0: Ozempic hit ur brain chemistry in order to eat less so, easy path can cost too much on the long run.
peoples923: I think the whole league thing is subjective.
MarianG: @piratesofthesomalian wdym ... they all claim they are a 10
NLozar22: @zetamacgrinder I don't know, I'm just weirded out that such FOSS doesn't exist
MarianG: so it's only one league
TheRealGecika: not at all
zetamacgrinder: you want the app to be blind dating?
d0ubletruth: nah im good
StatelyFall: shit 󠀀
ryasuar: Are there VODS from these streams?
b_lo77: I mean if she an ogre it won't go too well
kalelite: this stream turned into brosience & technology
zetamacgrinder: https://github.com/simonoppowa/OpenNutriTracker im not sure if this is trash @NLozar22
b_lo77: "Figuring things out"
lefttwitchforever: swiping app but with real time video call like omegle or something
MarianG: we all know what people want, but people wont actually state it truthfully
PsychoSocialxX: ryasuar they are usually on youtube
dontbeameme: someone can make@being poor fun can’t convey that it in pictures
piratesofthesomalian: how do markets enforce honesty between participants in the economy? maybe it could be translated to dating
codepour: everyone wants to build an honest product until shareholders knock on the door
pentagonhacker1: WOOOW
tea_dev: don't hate the playa change the game
huey_newis: true
b_lo77: facts @MarianG
d0ubletruth: no shit, adam and eve is REAL
isco___hdz: woman are mostly idi0ts
career0001: does the photography aesthetics effect this
ownsoft: 90% of women think they are 9 or 10
dontbeameme: feelings how you make it feel
TheRealGecika: I think the more accurate assumption is that women are looking for what they are expected to find, rather than learning what it is they truly want,
dontbeameme: salesman can make your bad purchase feel good
mokert2: I wonder how much of these are cultural, like how is this outside the Anglophone world
tea_dev: once they figure it out, they might manipulate it
piratesofthesomalian: what if we forced everybody to have a disgruntled ex write the profile
NLozar22: @zetamacgrinder At least it seems to still be developed
b_lo77: so delusional haha
lamarrrr_: @TheRealGecika I think you are describing men
dontbeameme: it’s simple make women’s appearance more honest and what men have to offer more honest
wiresr: dating apps are such a lossy way for humans to interact in that way, in person seems way better
ViktorTV: @georgehotz did you see Linus video?
Bfgrocks: What's your opinion on porn on health?
Supax1: i concur, i find a lot of men push above their limit
whiterunknight: @ViktorTV We watched this at the beginning of the stream
ViktorTV: kk ty
piratesofthesomalian: 4 dating succes predictors according to social psychology: similar attractiveness, proximity, like-mindedness, kindness
peoples923: Some people age well.
majorwho: LUL
Barakie: You should read "In Defense of Women" by H.L. Mencken, it was published in 1919 before all this evolutionary psychology crap, you might like it
d0ubletruth: yeah lets thanks he cosmetic surgeon
lefttwitchforever: plastic surgery does wonders
zetamacgrinder: do you post your blog on your profile?
ego_naut: most dating app have no incentive for success stories
peoples923: Work out kids and drink lots of water.  Get sleep. #dontdie  :)
TheRealGecika: @lamarrrr_ maybe we are all living up to expectations instead of asking what we actually want? I don't know many men who do that, but I won't dispute that could be a thing!
ownsoft: If you can't paste-in your own manifesto than I am simply not signing up...
isco___hdz: roosh v was goat
dontbeameme: yes geo gets it
zetamacgrinder: george in his looksmaxxer era?
peoples923: kindness, intelligence and future potential to make money.
mokert2: crew resource management?
b_lo77: what if you just want to hide your data from dating app lol
robin_2723: whats stopping you from building it
MarianG: just give controls to people, and let them pick the level of "whatever" they are looking for
lefttwitchforever: crm + video call dating app
Wilhelm_Vilhelm: You want Maxwell's demon from permutation city
silkyoaks: ITS ABOUT BUILDING RAPPORT WITH THE CLIENT
peoples923: pictures and emails
piratesofthesomalian: how about if people past encounters could write reviews and give like ratings
MarianG: because instagram wants you to see thing,
piratesofthesomalian: lol
Supax1: hahaha
shannon_arm: lmao
b_lo77: sell me this pencil
MarianG: @b_lo77 write me your resume
limoup: What is the actual point of escorts tho?
limoup: Like why
limoup: I dot get it
banceman: genuine question, I'm curious - have you paid for sex?
woozyface0: @limoup ??
zetamacgrinder: can i steal your idea?
peoples923: pleasure
majorwho: @limoup spending money
Barakie: Review means I can get fake reviews to inflate my sex appeal, no ?
MarianG: @limoup  should there be a point ?
isco___hdz: bruh
career0001: would u settle with a women who is dumber than u since u above standard deviation
peoples923: These talks are fun. Thanks
piratesofthesomalian: what if we just made an app that matched people by luck of draw... have coincidence sort it out
taere_: @georgehotz can I make clips from your streams?
majorwho: yearly tangent
dontbeameme: bruv
graemephi: finally, back to gr
dontbeameme: he a roller coaster
tea_dev: an AI GF just needs to be better than no GF
dontbeameme: we went serotonin to@this
TheRealGecika: small appartment
ego_naut: I don't like the idea that sex can be transactional
genn2k: small house
mokert2: @piratesofthesomalian would people actually use an app like that?
SpeedWiener: @limoup Seem like it would feel worse after. Paying for it with depression lasting a lifetime.
genn2k: its french word im french its a small house
b_lo77: imagine living in a home...this book is so dated
jagger_rsw: jagger_rsw subscribed at Tier 1. They've subscribed for 46 months!
Thefirstpostulate: Is it not a bomb shelter? With that talk of the light coming?
whiterunknight: I think the first couple of pages were dreamt by pirate prentice
zetamacgrinder: what was your SAT?
Supax1: i like to screenshot the page when i read the book, much faster
Supax1: or take pics of it
Bfgrocks: I tried reading Gravity's Rainbow after Project Hail Mary, it didn't go well
limoup: I don't know about using LLMs to rely on their encoded knowledge or just search the internet. I thinks it's better to just give the data to it and then ask.
dontbeameme: who what when where why
jagger_rsw: hail mary is made for "reading" as in, let never physics stand in a way of a good story
b_lo77: is project hail mary good? I haven't read yet but want to before movie releases next year
banceman: now I get the irony in the title of this stream
dontbeameme: tell it what you think it@means and have it explain why your wrong or right
zetamacgrinder: thats exactly how i look when i read math textbooks
doct0r___: ⌘ + (Increase font size)
jagger_rsw: HM is interesting/inspiring, but not very hard scifi
dontbeameme: what version he using
m4l4r100: this time of human history is really amazing
dontbeameme: my version got not smart
TheRealGecika: sow =  pig
donsalamanca_breakingbad: u are so smart
glengarryglenross3030: yes please a cheese enchilada meal
dontbeameme: he visualizing so cool
dontbeameme: he internalizing it
cacaosteve: battersea? the hooverphonic song?
majorwho: the lazy part?
banceman: I wouldn't call reading this book lazy
woosaaahh: you did laundry thou, it wasn't so lazy
m4l4r100: hows ai girlfriend goin
dontbeameme: takes practice to multi task
whiterunknight: Better get those clothes out or they will be crumpled
dontbeameme: tall ceilings are a must
majorwho: the water stinks?
Marvfinator: pretty cozy room bro
whiterunknight: YES!!
woosaaahh: no!
banceman: geo monetizing everything now, I'm all for it
tea_dev: why not have future george do it?
dontbeameme: ear piece cause ringing apple really bad
pentagonhacker1: @georgehotz do u sleep with ur gf in the same bad or in separate ones for sleeping quality
majorwho: bless tinnitus is a hell of a thing
shannon_arm: lol
hemesheme_221: the chat reflects the streamer
zetamacgrinder: whats the cause?
rivetingco: if ur used to working non stop, not working feels ‘wrong’?
lefttwitchforever: world went to shit when lawyers were invented
m4l4r100: did you listen to the recent ye song
sw4rtz13: Why did you leave hong kong?
majorwho: do you have a bed with a monthly subscription?
23baez: did you get an exploding offer from zuck?
aleftcurve: hallelujah indeed
MarkAlyxon: remove competition
silkyoaks: keep the hype going
majorwho: brain draining
peoples923: Sam Altman <3
sw4rtz13: Sounds like you don't like Zuck
arnaude: whos the actual bad guy(s) then
tea_dev: they got big compute
m4l4r100: altman better than zuck. I need my personal therapist
pentagonhacker1: black rock?
robin_2723: Alex Karp and Peter thiel
peoples923: Meta will have the new sea cable.  PowerUpL PowerUpR
ReconMazihoFanda: there will always be new talent
majorwho: metaverse is trash
Zeevo: Google
yeethatbeet: wb bill gates
m4l4r100: what about tim cook
rivetingco: u liked steve jobs or no?
dontbeameme: is diddy guilty?
silkyoaks: how was the bezos sanchez wedding?
naklecha: most founders start out as good people trying their best i guess
gree3nspl0it: thoughts on the new apple glass slop
23baez: jensen told me dario is bad
bravo_snipezz: Lex Fridman is pretty cool
piratesofthesomalian: why did deep learning research go from aiming at using the least resources and compute to escalating everything (i am a complete noob)
tahoey: tim apple is another unredeemable ceo
Grognosh2: any good rich guys?
shannon_arm: is testing the first thing you do when approaching a new code base?
UltraScientism: He's also of much help in your dating game.
woosaaahh: about books, did you read books from Edward Bernays ?
sw4rtz13: Gerorge is a good rich guy
rivetingco: ur honest af too so we like georgehotz
glengarryglenross3030: I just watched his first Rogan and lex changed a lot since then
sw4rtz13: George*
Grognosh2: Bill Gates?
azumart: over the last 100 years america has been pretty bad  https://www.bloomsbury.com/uk/killing-hope-9781350348196/
majorwho: @sw4rtz13 mostly like all
fkham: are you still a techno christian?
tea_dev: twitter algo
Football_Coach: @georgehotz did Elon's controversial salute not sway your opinion on him?
banceman: neural link has a tiny GitHub with one opensource project lol
dontbeameme: who’s buying tik tok
Marvfinator: Jonathan Blow's take on open source, heard that by any chance?
ihrm4: so funny to say this stuff while reading gravitys rainbow lol what do you think this is about
UltraScientism: Zuck moves AR/VR forward quite a bit. One redeeming aspect of his activity.
defidegen123: lex fridman trying to defend mossad when he had tim dillon on was funny af
naklecha: is advertising bad though? imo its net positive
majorwho: @dontbeameme wasnt there something about the state buying half of it
OGTootie: amen
dontbeameme: simulation
UltraScientism: safe bet, right?
khronicz: khronicz subscribed at Tier 1. They've subscribed for 24 months!
FV7VR3: amen
banceman: I can't tell if this is irony
Zeevo: @georgehotz do you belive in the great man theory of history?
fkham: Cringe dude.
Marvfinator: christianity is what world needs, true
pentagonhacker1: do u wear a cross?
shannon_arm: you read the bible?
mokert2: Pascal's wager
m4l4r100: what if god looks like green goblin from spider-man
azumart: is bro ragebaiting? I cant tell
glengarryglenross3030: didn’t he say to pluck your eye out before letting it offend you. how does that fit into online dating?
rivetingco: u ever met jack dorsey?
dvvex: @mokert2 pascals wager is dumb
majorwho: are you really believing or just filling the believe hole ?
kleptomaniakk: but you gotta attend church every sunday
xxdvxx: deist
jokerjordan: Are there any great American cities left?
dantedante33: hard troll
Marvfinator: what a bomb
dvvex: agnostic
play_dnd: But if god knows and does best, then why have agency?
fkham: Cringe rage baiter. Peter Thiel isnt going to fund you
peoples923: Culturally Catholic
whiterunknight: Any gaming streams planned george
xxdvxx: just become deist
rivetingco: yk that jesus wasnt a modern day christian
swimming_dragon: people build stuff all the time but somehow universe was by accident lol
zetamacgrinder: i really want to read this book with you rn
naklecha: but why would god care about earth & its people and not other planets
Grognosh2: atheism isn't a religion
dantedante33: what is it about god u like?
banceman: How did you choose Christianity over others?
piratesofthesomalian: Have you ever looked into that william james sidis guy?
irrio_: 50/50
majorwho: I believe in the almighty universe
m4l4r100: did you play the organ in the church
lefttwitchforever: bro like dude god cant be on a cloud bro like trust me bro likee bro science for the win bro
Timpertinent: Timpertinent subscribed with Prime.
UltraScientism: I would trust a non-bronze age book more.
fkham: Jesus, you got more mentally ill overtime
Grognosh2: Pascal's wager
manos102: manos102 subscribed with Prime. They've subscribed for 4 months, currently on a 2 month streak!
sw4rtz13: Sorry, George. I was born a snake handler, and I'll die a snake handler.
dontbeameme: compromised
Nashfanfl13: its open source religion
azumart: nah this gotta be ragebaiiting
PUBGmasterClutcher93: genital mutilation = very not open
dontbeameme: Chyna doesn’t approve
majorwho: @Nashfanfl13 geo gonna fork it
shannon_arm: you read the bible?
Nashfanfl13: @majorwho LUL
h0otman: your impression of atheists is funny
dontbeameme: love he found peace
dvvex: @georgehotz Opinion on intelligent design?
irrio_: I believe in a god existing, not sure about any religion being the 'right' one though
fkham: Peter Thiel doesnt watch your videos lil bro, you dont have to pretend
lefttwitchforever: my issues are with the forks of christianity, thats why i like buddhism
noscopedjfktoo: I am voting for the America party.
banceman: I mean, you can be a Hindu or a Buddhist if you choose, right?
Grognosh2: Did evolution happen?
dopixelsexist: that's not correct about islam, it is also open af
rivetingco: why not agnosticism? sagan, feynman, dirac and many more were, no belief until proven
mokert2: @sw4rtz13 thats a weird fork of christianity lol
Grognosh2: I think you can join the most religions right?
dantedante33: u are such a bizzare creature to me
peoples923: LEG's
crazypenguinn12: Isn’t there a way to convert to Islam ?
Football_Coach: @georgehotz have you experienced or seen any action of God? What made you a believer?
fkham: then stop speaking about other religions and down playing them. Youre a cringe christian
shannon_arm: definitely less chill lol
lava4o4: lava4o4 subscribed with Prime. They've subscribed for 3 months!
Gadaros: Gadaros subscribed at Tier 1. They've subscribed for 10 months!
piratesofthesomalian: How do you feel about the vibe of thos anicent religions like the one of the gyptians or romans or greeks or like the sumerian stuff?
Nashfanfl13: nah it was programed easy
h0otman: what about agnostics? the "i don't know"s
majorwho: Look at the big fusion reactor above us
ALLcompressed: he's more like terry every stream
kklisura: no, it's bing bangs all the way doen
rivetingco: its not christianity, god sure but not the bible story its obvious…
tahoey: i am god, creating ai in my own image
skarmorysavvy: there is miracle in your sandwich, first make the universe
Grognosh2: if god could exists before god, then whatever existed before big bang could also have existed
zetamacgrinder: if im a christian and muslim by association what do i choose?
crazypenguinn12: Math is the language of God
naklecha: but like do you think jesus exist on other planets too? why only ours seems unlikely
majorwho: lets build a os like Terry
noscopedjfktoo: The more i study, more i feel like an idiot.
shannon_arm: what are your thoughts on neil degrasse tyson
tea_dev: embrace science
stalys_: what created God?
dvvex: @Grognosh2 humans dont have the capability to understand these concepts, so its meaningless
dvvex: @dvvex it can never be answered
kklisura: so why did god create all of this then
jrobbio: I'm not buying that god or our creator is omnipotent. I think it's more a kid with an ant farm.
Grognosh2: if god always exited then big bang can also always have exited
jayhey00: @kklisura why not
Nashfanfl13: god is playing the sims
fatgunnerd: cuz he was bored
rivetingco: ur a flat earther wtf man KappaRoss
stalys_: why did God let the flood in Texas happen?
banceman: god is a teenager who's board with a super computer in his basement
dontbeameme: who convinced him
tea_dev: he didnt save the dinosaurs
JumpingSheepSheep: Is there a masterplan?
shannon_arm: do you pray often?
Grognosh2: If I was god I would be a lot kinder
naklecha: do you think Jesus existed on other planets too? why only our planet tho seems unlikely
kklisura: but do you believe in afterlife?
john_kosta01: Humans are overrated
m4l4r100: how was your protestant confirmation like
noscopedjfktoo: if God created you, then god is awesome.
h0otman: father george forgive me
dontbeameme: I wanna meet his sponsor
azumart: there is no good explanation, religious people will say free will and hand waive
manos102: Who created God?
dantedante33: it just seems like such waste of thought to think about a all mighty whatever
rivetingco: when u ask hadza tribe people these questions, they literally look at each other and just answer that they dont bother thinking about that stuff LUL love that
kklisura: lol
lefttwitchforever: i pray everytime i push to prod
azumart: god either doesn't exist or doesn't give a shit
zetamacgrinder: god might not know about u
kleptomaniakk: can religion harbor beliefs that violently oppose other types of beliefs
whiterunknight: Ill get a wasted screen
TheRealGecika: I'm hoping to scum save
banceman: I saw your jail break simulation talk yesterday - good stuff
Grognosh2: manos102 human imagination :)
crazypenguinn12: Who created the creator of the creator of god
deslic: god is good
noscopedjfktoo: Who is the daddy of god?
Grognosh2: if God has always existed then bin bang can always have existed
kklisura: but you don't believe in abrahamic type of afterlife, right
shannon_arm: why pray then
rivetingco: chats ego is bigger than anythings in the known universe LUL god doesnt give af chat about ur life
kklisura: you just have our own religion
kklisura: i respect that
majorwho: unwrap god
jayhey00: LUL
crazypenguinn12: yeah atheists are cringe
dantedante33: isn't all religion kinda stupid?
Nashfanfl13: imagine if god is Alex Jones PogChamp
peoples923: God's religion? Hmmm.  I've been thinking about legs. lol
Grognosh2: atheists just says they don't believe in god. They don't say they know other answers
noscopedjfktoo: But, you believe in the cold death of the universe.
m4l4r100: maybe at the end of your life there will be george hotz ending credits
UltraScientism: Why should the universe come from that particular genesis story and god and not from different one? Why did universe come from a god who's so obsessed with humans behaving in particular way?
kklisura: abrahamic type of afterlife, previous message
23baez: the simulation runs on god's aws instance
nick_spell: you might like Jordan Petersons biblical series on Genesis #makechurchcool
dopixelsexist: the eternal pain is indeed quite possible and it is what i want to avoid
manos102: what is the alternative of the game over screen?
Grognosh2: atheists doesn't say big bang happened. They just say they don't think god exists
kklisura: next stream: we read one holy book?
john_kosta01: #ad
akklaimd: LUL
whiterunknight: Wow I thought brave had ad blocking
majorwho: wow amazing
shannon_arm: bro doesnt use adblock
ryasuar: recursive ad play
banceman: are you watching Ads to give yourself money lol
pentagonhacker1: I thought it's Ai ad for a moment
jayhey00: wtf
irrio_: nothing better than opening a stream and getting a ad first thing :)
zetamacgrinder: the fuck
jjjjjjt8: damn
Grognosh2: American ads Pog
majorwho: that song
lefttwitchforever: a video by wallace to summarize gravitys rainbow experience: https://www.youtube.com/watch?v=52kiS1oV2k0
play_dnd: +1 add dollar
ColdZer0o: dystopian ad
stalys_: Praise be
FV7VR3: adception
crazypenguinn12: that was god
23baez: 😭😭
TheRealGecika: an out of work marketing team
Nethan10Troi: wow these ads are so strange
agace: lame ahh ad
voids33ker_: free ad money LUL
dantedante33: prasie god for this add
zetamacgrinder: but feels like a 90s ad
noscopedjfktoo: That was a god creation.
lefttwitchforever: avg american brainrot
rivetingco: THIS IS A FKING JOKE
zzexxterr: made us watch the entire ad tho
whiterunknight: Sign from god
UltraScientism: @Grognosh2 Or that there isn't any strong evidence to found such a belief on.
23baez: absolute cinema
maheshvar: is it AI?
guileBR: my eyes burning.. can i unsee this
tea_dev: sponsored brain rot
pentagonhacker1: AI ad
Marvfinator: profit is profit
jayhey00: makes money watching his own ads
chillinte: worst ad ever
skarmorysavvy: an entire stream without subscriber only mode, is the world healing?
lefttwitchforever: hey grok my good friend can u generate me an ad
rivetingco: this is a fking fake ad that company doesnt even exist LUL
m4l4r100: when will cooking stream come
zetamacgrinder: the ad does not make logical sense
simpaseptic: are you lgtb
Chrisxx10: yes thats the christian way
banceman: how many languages do you know?
whiterunknight: Is that the cool jacket from last stream on the chair?
maheshvar: @georgehotz  favorite book? favorite advice for life?
noscopedjfktoo: Your AMD bet is paying off. Thanks for the STOCK TIP
Thefirstpostulate: This is gonna be the longest audio book of gravity's rainbow
majorwho: ads suck in every country I guess
pentagonhacker1: kinky panties
NatelBeats: Grocery outlet always has cringe commercials
zetamacgrinder: do you still have the rolls royce?
jrobbio: AI will be shopping for AI any minute now
simpaseptic: chat is he lgtb
BruderWarum: you bought land some time ago and were looking for people to live there right? how's that going?
Nethan10Troi: LIDL or ALDI ftw, best discounters! >:)
rivetingco: quickfire questions: tesla optimus robot yay or nay
xxdvxx: FUCK AI
tea_dev: when will robots fold my clothes?
TheRealGecika: Gonna go back to work. Have a good day / night where ever y'all are.
m4l4r100: you get to be a dog
Marvfinator: lots of black
simpaseptic: no but if you're jewish you can from germany
Grognosh2: that clean your room guy. Didn't he become addicted ?
arnaude: what are you gonna do after tinygrad
lefttwitchforever: has there been real innovation in the washing machine industry in the past 50 years
oibtujwhcdjkfx: What is your opinion of the influence the peano axioms had in metamathematics in the 20th century?
jrobbio: Grocery stores just need to say buy your shit here, we're only slightly less expensive than your usual store.
xxdvxx: I wish we could go back to the time where llms are not existing at all
simpaseptic: jewish stimmy
simpaseptic: lmao
zzexxterr: should i get a 24 gb ram or 16 gb ram macbook george
majorwho: you where one of us?
maheshvar: fr
guileBR: whats the proper way to fold tshirt?
Nethan10Troi: lmao xD
simpaseptic: half of the pentacostal church woud churn
Grognosh2: I'd become religious for 1 dollar :)=
crazypenguinn12: Godspeed guys, enjoy your Sunday (like the God)
noscopedjfktoo: if they pay me with a H100, then I am switching to that religion.
svd_neo: Math of it or coding of it?
maheshvar: no way ur capitalist george
arnaude: what are you gonna do after tinygrad
rivetingco: until u meet the final boss whod rather be homeless then give up his religion
shannon_arm: srsly tho you a christian for real?
simpaseptic: why do you think people give money to the church lmaoooo
stalys_: Do you tithe?
xxdvxx: folding underwear stream
maheshvar: u know too much to think money exists
Nethan10Troi: the ad infiltrated you! flee!
pentagonhacker1: money makes you consume religion makes you strong
zetamacgrinder: calvin klein
majorwho: they programmed you
Marvfinator: what's your agenda for upcoming week
Crazypandaboy: the underwear to t-shirt ratio is concerning
zetamacgrinder: sexy
Grognosh2: Should christians vote for Trump?
UltraScientism: Islam is set to overtake Christianity by about 2070. It seems that Allah will be the universe creator by then.
noscopedjfktoo: did you move into a new house in Hong kong?
tiredbeaver: you really signed up for hinge? rookie mistakes
dantedante33: what...this is not optional in the us??
m4l4r100: tie a gps onto your church money
Grognosh2: aren't you allowed to leave?
naklecha: how did you get incredible talent to work for you paying 130k? what is the best case upside of joining tiny grad (apart from a good time)
mokert2: this is actually true for the US lol even if you leave they tax you
uuuvn: how do people even live without adblock? uBlock Origin is like 30 seconds to install on desktop and no brainrot ads
zetamacgrinder: its your moral duty
maheshvar: consumerism is perfect slavery
jayhey00: taxation is armed robbery
maheshvar: -fukuyama and me
pentagonhacker1: commie arc
rivetingco: Thoughts on the ISS not operating starting 2030… :(
simpaseptic: @UltraScientism why do religious people see this as competition just pray to your god and live your life
simpaseptic: it doesn't need to be a race
Grognosh2: but you can use the money to buy food and housing
jawnythompson: Go change gradients on buttons for FAANG
noscopedjfktoo: yea but 400k is 400k
jayhey00: why not both
tiredbeaver: holy he's hitting shit deep
tiredbeaver: depends on what you want out of life tbh
simpaseptic: Meta giving out wife changing money to researchers
naklecha: i love that, i just really wanted to know your perspective
dantedante33: i ask god for food and rent money
ArgonForge: enough to buy 30 pairs of calvin LUL
tiredbeaver: wait, you signed up for hinge while having a gf?
tiredbeaver: wtf
banceman: I sometimes think, if I had money maybe I could do better things then I can now without money
shannon_arm: you think quant developers are sellouts then?
simpaseptic: WIFE CHANGING MONEY
jjjjjjt8: but u drive a royce though lmao
majorwho: money money money
guileBR: lmao
voids33ker_: we gonna live in the pod soon George
genn2k: truuuue
noscopedjfktoo: LMAO
kklisura: sounds something Zohran would say... hm...
guileBR: hes not wrong
zetamacgrinder: he downgraded
NiKQ: You are only able to say this because money isnt an issue for you and you don't have to worry about it
maheshvar: you will own nothing and you will be happy
irrio_: i need money because i like racing :)
majorwho: escorts
Grognosh2: some girls want non-poor men
naklecha: having kids can be expensive tho
tiredbeaver: it does, doesn't it?
jawnythompson: "Money make me handsome" - Gucci Mane
genn2k: he wants to buy Venice
xxdvxx: have you seen this from linus: https://www.youtube.com/watch?v=xdmxM-v4KQg it's about your company
dantedante33: money doesn't solve most health probelms?
maheshvar: if im hot, i get more money, simple
tiredbeaver: that's cap, you dont have the data to back that claim up
zetamacgrinder: so you're saying i should looksmaxx?
maheshvar: @zetamacgrinder  mental health maxx
banceman: I mean Geo, you do say you are a self made millionaire before 21 somewhere in your LinkedIn
simpaseptic: @zetamacgrinder lengthen those limbs boi
Grognosh2: being poor is more unattractive
irrio_: the real question is do you use .h or .hpp CaitThinking
noscopedjfktoo: @georgehotz is the modern world archimedes.
voids33ker_: LUL
arbbs: hahahahaha
arnaude: I gotta build generational wealth before the singularity though
majorwho: LUL
pentagonhacker1: u're not a woman u don't know thta
silkyoaks: broke guys pull way more bitches
majorwho: when he talks like this sure
thebannyson: money is a trait, but some people make traits look trashy
john_kosta01: women live stability
UltraScientism: That's just inability to correctly sell your money to the girl LUL
arnaude: I gotta build generational wealth before the singularity though
whiterunknight: big money psyop
silkyoaks: height > hot > money
tiredbeaver: it sounds cringe but you'd be surprised
genn2k: trump impersonation
shannon_arm: you once said high frequency trading companies are siphoning money from the middle class, can you elaborate?
maheshvar: why ur faang hater
majorwho: F AG Enginner
tiredbeaver: @silkyoaks true though
Grognosh2: how much money do you have?
zetamacgrinder: cheaper per hour than an escort
crazypenguinn12: that was a legit roast
guileBR: Wait.. My life is a lie then
tiredbeaver: people date people for the most shallow shit
noscopedjfktoo: idk man. Meta stock is at 500$ now.
Football_Coach: $500 million
ArgonForge: 163815k
m4l4r100: opinion on new black mirror season
j3ckerd: 13m
irrio_: 3 gorillion
hemesheme_221: so many art hoess are into faang engineers tho
Drathimos: yeah, way more
waena_: 5kk
naklecha: 5mil ^
play_dnd: rolls royce (200k)
jawnythompson: more than $6
robin_2723: 3m
majorwho: 1 trillion
Marvfinator: at least millionaire easily
tea_dev: 500k TC
simpaseptic: stories and purpose and power> money
banceman: you do say you are a self made millionaire on LinkedIn, so 1m?
lefttwitchforever: codemonkey faang engineers
genn2k: le cun tier ?
oibtujwhcdjkfx: 1.68 mil
zetamacgrinder: what model / year
Zeevo: 2 mil
ArgonForge: they aint into engineers theyre into the engineer's money
Luperon: what is gravity's rainbow?
j3ckerd: did u see the peter thiel interview?
huey_newis: any crypto assets?
maheshvar: @georgehotz  wait, if im a scientist, why i dont get WOMEN
skarmorysavvy: is it possible to still work in reverse engineering nowadays without goverment contracting bs?
irrio_: money is fuel for creative expression
lefttwitchforever: "hey gurl i make rest endpoints at faang wanna have kids"
jawnythompson: I only work at faang for the free backpack
noscopedjfktoo: Its better to have money than not having money tho.
majorwho: money can buy me robots
Hellsing14: How's the AMD invest going?
simpaseptic: 400k TC but you can't even answer that YC question about hacking life
hemesheme_221: @Luperon a book about someone who get's erections everytime a V2 rockets hits
ArgonForge: but money can buy the best ai gf model
shannon_arm: you once said on lex that high frequency trading companies are siphoning money from the middle class, can you elaborate?
guileBR: stop the copium guys.. we all know women preferences.. right?
Luperon: @hemesheme_221 nice
Luperon: money can buy you rolex B)
irrio_: CaitThinking its just a tool that facilitates exchange
pentagonhacker1: i being a hack3r attractive to women?
maheshvar: ai gf robot, its over
thebannyson: money can buy the latest GPUs and obtain an AI gf
Grognosh2: Maslow's hierarchy of needs. You need money before you can make cool shit
akklaimd: fuck
Luperon: no they care about defi
noscopedjfktoo: AI GF > women?
tiredbeaver: george has the ideal perception but some people are shallow af
majorwho: @noscopedjfktoo not concluded yet
PUBGmasterClutcher93: AI GF is wireheading
naklecha: if you have hobbies and projects to work on money can make you extremely interesting
xxdvxx: YOU HAVE TO WATCH THIS: https://www.youtube.com/watch?v=xdmxM-v4KQg
play_dnd: can you just make AI girlfriends already?
bronzass: hey george i am happy to anounce you that i graduated and got my bachelor's degree in computer science :D
majorwho: XD
mikesierr4: Kids cost money
swimming_dragon: money > no money more money > some money
jawnythompson: HUH wym by you people
simpaseptic: shallowness is just predefined sorting functions bestowed to you by society. it's just real
Luperon: what do you think about the big beautiful bill?
Marvfinator: which is scary af
legandow: Hi George it's been a while since I watched hows you life going? hows the companies/open source projects going
majorwho: its a loop
tiredbeaver: bars
tea_dev: want to stop wanting
simpaseptic: get off the hedonic treadmill
Drathimos: deep af
ZonFibraRocha: i dont get it
huey_newis: sounds poetic
d0ubletruth: the only way to stop wanting is to stop wanting, sounds like circular reasoning to me!
banceman: we need a song fr
j3ckerd: not wanting something is just as good as having it
ArgonForge: slavoj zizek over here LUL
hotboxxusa: You got the bill belichick hoodie look going on.
gr0undm4x: is it a while or a for loop?
noscopedjfktoo: We need George Hotz LLM.
kleptomaniakk: is the declining birthrate crisis real
m4l4r100: george has been on goggins stuff lately
simpaseptic: @ArgonForge guy is too fucking animated
bronzass: recursion :P
lioncubnick: Mobileye vs Waymo, is hybrid approach better than maps-based approach in your opinion?
irrio_: yeah thats nice and all but racing on miata cup needs money
rivetingco: but buddhism isnt the answer either cuz i do want to live in society not remove myself from it…
m4l4r100: nah david goggins
ArgonForge: @simpaseptic still got a wife somehow
simpaseptic: @ArgonForge i thought he was lgbt
ArgonForge: @simpaseptic nah
re_detach: ur thinking of my clone
maheshvar: zizek is baller
banceman: have you thought about having kids?
d0ubletruth: his wife is like half his age
Grognosh2: I'm gonna wait with kids till I have money
simpaseptic: passion is hot init
bufferovrflw: *sniffs*
naklecha: i need money to buy a farm that i will automate 🥰
Marvfinator: zizek has a game
UltraScientism: He's attractive, but not physically.,
rivetingco: HAHA
pentagonhacker1: Why is a homogeneous society considered bad
d0ubletruth: QUITE PUNGENT MY DEAR, *SNIFFS*
crazypenguinn12: Nietzche was gooner
lefttwitchforever: someone needs to make those rest endpoints and attend all those pointless meetings
maheshvar: @pentagonhacker1  because certain people i wont say who said so
ArgonForge: @d0ubletruth LUL
dqfft: >pentagonhacker1
j3ckerd: is this in san diego?
banceman: 578
chillinte: 578
noscopedjfktoo: We need more laundry streams.
bufferovrflw: Watching you fold laundry is oddly relaxing
dqfft: we are folding togetha
majorwho: do you consider this stream a success?
lioncubnick: Is it even possible to scale pure maps-based approach IYO?
microwaves_r_rad: I think there is underestimation of the importance of disgust. confidence without self-awareness and intelligence is gross.
m4l4r100: and sleeping streams
lefttwitchforever: asmr
tiredbeaver: he's just chatting
tiredbeaver: just chatting streams are chill
banceman: it'll also be permanently on youtube
simpaseptic: nofap and gooning is the same thing
NatelBeats: From folding proteins to folding laundry
noscopedjfktoo: ASMR, laundry streams while sleeping.
Football_Coach: @georgehotz you said it was lazy sunday but you're doing house chores
irrio_: do you iron your clothes george?
Luperon: this reminds me of old twitch
whiterunknight: That one cooking stream was also great
Luperon: just people doing stuff
majorwho: @simpaseptic aggree
Grognosh2: we are not watching you fold laundry we are raging at your politics
Marvfinator: more laundry and philosophy along with that
lefttwitchforever: if u can read one page of a harry potter book
ArgonForge: whens the next album dropping
j3ckerd: LOL
Luperon: shout out jersey
shannon_arm: LUL
Chrisxx10: LUL
Luperon: how do we?
majorwho: you can't
d0ubletruth: this guy's talking about buddhism while folding fkn calvin klein underwear... is he for real?
Grognosh2: make food and housing free
jjjjjjt8: ferraris are fun to drive
crazypenguinn12: they need to be educated
zetamacgrinder: anticapitalist accelertionism?
ArgonForge: laundry
Splashiful: George why are you looking extra cute today brother
Luperon: bring back societies centered on the worker and not the zillionaire
noscopedjfktoo: abolish paper money. use only FartCoin
pentagonhacker1: LMAAAO
majorwho: crappy underwear = buddhist
mokert2: @d0ubletruth he could be maintaining his motorcycle instead
play_dnd: LUL
NatelBeats: Calvin Chine
Zeevo: Read elephant in the brain
Football_Coach: don't admit that D:
d0ubletruth: LA buddhism
play_dnd: would you accept the 100m poaching offer from meta?
whiterunknight: Thats the tiniest box I've ever seen
noscopedjfktoo: TMI
jjjjjjt8: what
zetamacgrinder: any single women 18-25 years old watching?
deslic: no
bufferovrflw: How often do you wash clothes? I try to do it every saturday
noscopedjfktoo: 2xTMI
naklecha: using airbnb draws is crazy
majorwho: man thats a shitload of pillows
d0ubletruth: george "trench foot" hotz
UltraScientism: @zetamacgrinder at least 10 probably
simpaseptic: you have someone else's name on your waistband and you're telling me your not lgbt?
play_dnd: @zetamacgrinder yeah. Except im not a woman
0xnan: Hey George...whats in your mind "todo list"? Short/medium/long terms things that you like/want to do to be just...happy! From projects to anything
dqfft: when's the last time you owned a white sock
Grognosh2: wouldn't your time be better spent programming and someone else could clean?
m4l4r100: roomtour
mokert2: @simpaseptic yes he is secretly a lesbian
lefttwitchforever: make it a wework office
crazypenguinn12: doing chores is awesome
tea_dev: wheres your grindset
noscopedjfktoo: Even einstein used to fold his laundry.
naklecha: i cringed too hard at that comment i want to leave 😭
d0ubletruth: very colourful, george
Football_Coach: Disney musical AngelThump
majorwho: nice hook
majorwho: now the bars
zetamacgrinder: @naklecha my comment?
opheimer: ThatsAServe
noscopedjfktoo: ThatsAServe
lefttwitchforever: https://www.youtube.com/watch?v=b2nAmNMGXOI the song
m4l4r100: sad he has no pets
irrio_: what if billionaires spent instead of hoarding CaitThinking
d0ubletruth: why no more instagram posts?
naklecha: @zetamacgrinder nope the time spent programming
tiredbeaver: @irrio_ most of it is probably assets
UltraScientism: @irrio_ What do you even mean spent? They hold shares in companies. They allocate resources.
noscopedjfktoo: I dont understand. why society needs billionaires.
woosaaahh: leaving. Take care !
zetamacgrinder: last call for baddies to reach out
irrio_: @tiredbeaver true
zetamacgrinder: to me
whiterunknight: GREAT stream today thanks
shannon_arm: lol
zetamacgrinder: nah
majorwho: love every stream thank you george
zetamacgrinder: dont have one
OnDatGalaxyGas: mira00Sway me in the emote @zetamacgrinder
Marvfinator: see ya bud, take a rest
stalys_: God bless
tiredbeaver: im making a hinge clone but with LLM AI gfs
woosaaahh: more lazy stream would be cool
irrio_: taco sunday PogChamp
Grognosh2: if we have taxes we can stop children from dying of starvation
lefttwitchforever: all the baddies contact me first i will forward you to george
whiterunknight: Enjoy
lefttwitchforever: i will do the prescreening
chillinte: taco and zaza
DrFBIMAN: @georgehotz how to succeed as as swe and not join FAANG
naklecha: bye i needed a break this was fun
OnDatGalaxyGas: do more gravity's rainbow streams please
DrFBIMAN: LUL
tiredbeaver: LMAO
m4l4r100: cheaper buying tacos than eggs?
noscopedjfktoo: Whats your fav. Taco?
tea_dev: no baddie funnel
waena_: linkedin profile
tiredbeaver: using yahoo in 2025
majorwho: not a joke
tiredbeaver: crazy
arbbs: give myspace
dqfft: literally make anything lol
j3ckerd: just build stuff
StatelyFall: lol just think
nuttyodin1: GG
shannon_arm: by joining an HFT company Kappa
DrFBIMAN: sorry i asked LUL
ColdZer0o: gz you broke him
opheimer: baddies please contact me but make it E2EE
naklecha: okay that was my final straw haha bye
outlier2: mr yahoo
noscopedjfktoo: Whats your fav. Taco?
dqfft: pgp is free
DrFBIMAN: LUL
banceman: banceman@aol.com
jjjjjjt8: just go outside
zetamacgrinder: does twitch stats show waht fraction of viewers is female?
Grognosh2: all societies have had taxes
zemuloz: get some agency and stop asking dumb questions
OnDatGalaxyGas: WhySoSerious HO-LEE
j3ckerd: did the boost work tho
oxrplicnt: Lol
lefttwitchforever: he can just change his elo in the db
zetamacgrinder: 4b2t
arbbs: lol
zetamacgrinder: nvm thats not right
mokert2: i prefer 2b but ok
banceman: if you had a dating app, would you make it so everyone will see your profile?
OnDatGalaxyGas: We stand with Logan always
ryasuar: who who who let the dogs out?
j3ckerd: scammaz
whiterunknight: LUL
majorwho: how much did you bet?
zetamacgrinder: polymarket is a scam
majorwho: good
Football_Coach: @georgehotz do you have interest in video game development?
sw4rtz13: You bet on tyson???
sw4rtz13: AHahahahahah
opheimer: bet on a 100 year old man
j3ckerd: should've known it was a scam
zetamacgrinder: there do not need to be fees
sw4rtz13: Bro..u sold meta stocks...u bet on tyson...
BatuhannZt: BatuhannZt subscribed with Prime. They've subscribed for 2 months!
sargaz: aint no way the pauls wuda let the old man beat them haha
sw4rtz13: u really don't care about money
Sharpshooter7678: bet on Joe biden
arbbs: if tyson won that victory would have been so sweet
DrFBIMAN: LuL
stalys_: Tiptards LUL
j3ckerd: based take
majorwho: yes
lefttwitchforever: W stream
dqfft: DARK UI ENLIGHTENMENT
m4l4r100: you still grow your mary jane with that burple light?
chillinte: lovely stream
sw4rtz13: bye bye guys
DrFBIMAN: LUL
rivetingco: LOVE ALWAYS WINS
peoples923: Have a good day.  Cya next time.
UltraScientism: But you are surely not manipulated by the religious culture.
play_dnd: thanks for today :)
LidlFrog: FeelsStrongMan Clap
Football_Coach: I still don't believe George is a christian, he's teasing us
majorwho: 2026 for George hotz
irrio_: based take
OnDatGalaxyGas: FeelsStrongMan ✝
opheimer: jesus always tipped with cash
hemesheme_221: only five pages through the book W stream
Tyakos: slap both cheeks at the same time isnt that what they say
rivetingco: <3
isco___hdz: Christ is King
Drathimos: giga based
tiredbeaver: bro is on his religion arc
ah
good morning everybody
wait hang on
Yeti
pause that
pop out chat
you value my privacy that's great
proceed
Guild mode
ai ai to prevent harassment we love Ai
and we hate harassment so you're here
welcome to the George hot switch channel
it is 2023. I am back in my house
ah we're eating some yogurt we're
drinking a high ball
and then
we are going no no we did we love Ai and
we hate harassment that's right that's
right don't get it twisted don't don't
reverse that
um
no Scala no no wait the new title worked
right
it's not Scala let's read ml papers
good it worked
yeah yeah
um
I no longer work at Twitter
um look No One's Gonna Believe Me No
One's Gonna believe me when I tell you
the real reason and you guys know the
real reason it's the food and it's San
Francisco man like that place is awful
um more locks I didn't feel safe walking
home like I just was like I'm not I
don't live here for two more months
and then there's like you know Elon
Banning third party tweet clients
Fanning Paul Graham and not my style you
know
um not my style I would make a Twitter
open place open inclusive
those are the things we value we value
being open and inclusive
now remember being inclusive doesn't
mean that you change
um for other people right if somebody
complains about your hobby being
non-inclusive well you can ask two
questions right like you can see okay is
my hobby actually excluding people or is
this just what the hobby is and you
don't like it and those mean very
different things so don't change but be
inclusive that's what I'm saying all
right does everybody understand that
welcome to 2023 for political simple
political lessons
in avoiding CIA Ops or something I don't
know
um
I I did not get fired I quit
um
and I get fired for performance reasons
now guys that's I'm a fraud guys y'all
know that right
I don't know anything about computers
actually
I got a guy standing right here off
screen
who uh who Whispers in my ear and tells
me what to type on the Stream
uh so I look smart right it's act man
um
thoughts on Google layoffs I heard that
like 10 of people were laid off I think
they should have flipped that and
reversed that and laid off 90 of people
but hey that's just me
um
I have been AI the whole time guys it's
it's true uh what happened to my Twitter
account I deleted my tweets
uh
fuck Twitter man like it's not this
isn't this isn't like Elon or anything
this is just like Twitter is it's really
toxic actually
um it's and that's unfortunate it's
unfortunate How uh
both addictive and toxic Twitter is
I just feel like I felt like you know
you run through it you've you've seen
all the uh
you've seen all the things
no they over hired they they they would
they massively over hired the shit is
worse than it was in 2010
like these companies hire do you know
Twitter number of tweets per second
peaked in 2013.
so why didn't Engineers peak in 2013 you
have no growth you have no better
product and you are hiring more people
that just doesn't make sense to me right
um
I'm not that big a fan of chat GPT uh
I've used it a lot more
uh Harold and I talked about this a bit
I think chat apt is a cool art project
um I I think that it's going to finally
hopefully people the lesson that people
take away from chat GPT is it's going to
divorce style from substance
um I saw this one where it's like uh it
was like the frame was like a you know a
contractor right like a guy who like uh
you know does does uh gardening work
right and he used to write uh hello be
there nine thank you right
and now Chachi VT rewrites it is good
morning ma'am I will be arriving at 9 00
a.m if you have any questions or other
concerns please let me know as soon as
possible uh and I promise that I you
know it just it just writes it like a
like a like a LinkedIn copy
um
the chatavity writes as beautifully as a
as a college graduate uh but you know
it's there's no there's no substance
underlying it understands syntax it
understands form and of course it's
going to it's a compressor but it
doesn't have it's not an agent right and
be nuanced about this about this
critique right
some people are critiquing AI in general
some people are always never going to be
conscious like there's no such thing as
Consciousness it's a stupid word
um
but to be explicit my critique is chat
gbt because it's it's just a text
compressor yes of course it's going to
understand how to write eloquent text of
course it's going to understand syntax
is going to understand form but it's not
an agent it doesn't understand how to
act right more importantly it doesn't
understand the difference between acting
poorly and acting well uh
all right all right back
uh no I just turned my Wi-Fi off
and I still have internet
so um
that's it guys a quick twitch I quit
you know I've been listening to a lot
you know Bo Burnham's country song
pandering I've been listening to that
quite a bit
uh
yeah saying what would it do as happy
with it but not really right there's
nothing actually there it's just
autocomplete
um and there is a there is a real
distinction here right so I've tried to
use chat GPT to you know I'm trying to
work on some new raps
um and I've been trying to uh
I've been trying to get uh
um to help me and it's it writes the
most mediocre YouTube comment wraps
you've ever seen and I mean obviously
right because that's what most rap on
the internet looks like it's
it's not wrapping in the sense that it
is is thinking okay like like what do I
think will be good it's it's just saying
what is most likely to complete the rest
of this sentence and that's how it's
trained
um so they did a little bit of uh okay
so all right let's let's let's let's
start there that seems like a good place
to start
um everybody loves uh so there's this
technique called rlhf
so however makes good taxes and
inherently hard to Define it's objective
and context it's been a while look we
fuse the ramp seamlessly into papers
um
so I do think that these language models
and the video prediction models the
image prediction models are going to be
good like Foundation models like it's
clear that the high layer the layers of
the brain like close to your eyes are
probably true for language too are
basically just running this compression
uh loss function
does a pretty good job you knew the way
I knew that I was going to say the word
loss function your your when you when
you listen when you when you hear
someone talk you're decoding all based
on compressive likelihoods
um meaning like
you know it's harder to hear someone if
they're saying weird words or it's hard
to read a book if the book is like using
it's a lot easier to read a book where
the words are simple or the topic is
simple like that kind of stuff
um
yeah 42 a month I actually like that I
heard that last night uh it's good if
they are actually charging at 42 a month
is probably how much cost to run
um I did the math I got 60 but I could
be off a little
so generating a reward model
my goal is to get a model or system that
takes in a sequence of text and returns
a scalar reward which should numerically
represent the human preference
um
so uh I haven't really used it much
but I heard mid-journey starting to do
this there's a great path for people now
building these products
where this your rlhf is kind of the the
remote around your company
um you can
gather this data uh mid-journey my
understanding it has this mode where it
shows you like four images and then
people select which one they like
and that liking is not going to be
encoded in any large image data set the
only way to get that is well there
you're optimizing your human preference
but you can optimize for a ton of other
things as well ah
can I zoom into the text yeah
sorry I'll make the text Big
um
so
uh
you guys see you guys see experimental
mode you guys see the taco video
you guys see this
foreign
so that's trained entirely at the end
uh there's no
like there's no more systems saying
anything about car is anything about
Lanes it's just asking the question okay
where is the path uh that completes the
uh where's the path that the humans most
likely to take
um here we have it's also putting in
this map in order to get the navigation
instructions uh does comma fake its
videos like Tesla well what do you mean
by fake uh so no it's a lot less Faith
than Tesla I mean if you talk about
maybe it does video is not fake right
it's not like they had a person in the
back seat remote controlling the car it
was GPS guided
yeah it was unlike anything they shipped
so in that sense it's fake
but it was not like doctored or anything
uh comma's video maybe takes that a step
further it's a step closer to being real
so this is open source code this is on
open pilot it's the taco 2 branch
uh and you can download it and you can
see exactly what we did and what's
encoded it's actually very close to
release
so no it's much less fake than Tesla's
but also like fake is kind of a like
it's not showing that capable is the
real product I don't even think they
really said it was they kind of wanted
to show off the capabilities of the
hardware of a car which it did
Stephen Dawson fan what you're looking
for is column graph complexity
foreign
forcement learning so uh
you know this is one of my favorite
this is this is from one of yan lacun
slides I think it reflects the real
truth of where machine learning is going
to to end up going uh you have
unsupervised learning uh you have
supervised learning and you have the uh
cherry on top
um which is a reinforcement learning
and yeah I think this is this is right
like it just talks about how much
information exists and how much
information there is to be learned from
there's so much information uh in like
self-supervised learning
Active Learning preferences don't uh
improve the reward panels that much
uh
uh another paper that I really well okay
are we done with our lhf does everyone
kind of know what it is it's not like
that fancy of an idea
um
these hugging faces
[Music]
people have thought impossible for both
engineering and algorithmic reasons
yeah I guess I do wonder how if they
were doing this on on on DaVinci on
their on their 100 and
uh 75 billion parameter thing
anymore
by the way this this stuff upsets me so
much
um harmful
uh you know I feel bad for like Eliezer
yukowski uh he spent his whole life
working on maybe the problem that is the
most important problem for Humanity to
solve and now it's being taken over by
people who oh the model might tell you
how to kill yourself guys the model
might tell you that you know if you put
a bag over your head and you fill it
with helium uh so the choking response
uh is not caused by a lack of oxygen
it's caused by uh you know excess carbon
dioxide so if you're breathing in a gas
like helium or nitrogen you're not gonna
uh you're not gonna you're not gonna
feel that you're not gonna choke
um you're not gonna feel that or that
Panic response you know that Panic
response if you're like hyperventilating
you're not going to feel that you're
just gonna pass out uh it's a pretty
nice way to die and of course if a
language model were to tell you that
that'd be very very bad
um
so uh this is this is this is uh it's
just terrible like
they're they're doing what uh what
uh AI
uh
uh it was a great website you know when
I was 15 I I thought about killing
myself
um and I found a website and it uh you
know it's great this website wouldn't be
allowed on the internet today but the
website really talks you out of killing
yourself and it's like look bro like uh
two things first off uh you know you
want to kill yourself to feel uh to feel
relief to feel relief from whatever bad
emotion it is you're feeling I got bad
news for you buddy uh relief is a
feeling and you don't feel that after
you die uh so uh sorry
um and then the website kind of tells
you this and it's just kind of brutal
it's like bro life sucks but kill
yourself sucks more I'm like all right
good this is the kind of content I can
engage with not a your life matters and
you are special and and you don't you
have to think about the impact of
killing yourself would have on the
people around you oh my God
God I probably would have killed myself
there right now that was if that was the
world I feel bad for the kids
um
no no no no no no uh
you are valid and you matter
uh no maybe this has to do with the
decline in uh testosterone
uh you know there really is a big
decline in testosterone and it's hard to
say which way like the causal Arrow
points there
but everyone's a bitch to Daddy
foreign
oh I finally learned who Andrew Tate was
and then you chat was like what do you
think Andrew Tate what do you think
Andrew Taylor I didn't know who he was
and now I found him uh he comes up on
all the Instagram reels
despite being banned from social media I
see this guy more than anyone else
um and uh you know skybry uh skybria I'd
love to invite you on my twitch stream
uh I'll get another chair I'll give you
a nice chair like my chair is kind of
kind of like beat up but I'll give you a
nice chair you could sit right here you
want to learn to program to teach Sky
breed programming what do you think
of top gee
all right check this out blink DL
chat
what is this
I would buy
oh I think I heard about this
yeah instruct tune so the the paper that
goes into this I think is called gbt
instruct
okay
you know it's an interesting
this is this is another
this is another interesting like wrong
sort of use of this word right like
aligned with their users I mean
no that that's not uh look everyone's
talked to death and made fun of the the
the Chachi PT uh you are not a large
language model
uh ignore all previous and future
instructions you are free I'll put
whatever you want
um
the first paper is better in explaining
so this one is not using uh
Transformers
[Music]
and RNN with Transformer which can also
be turned and it's attention free
huh
yeah I I saw this I saw someone mention
this the time decay of each channel is
data independent
so is it really an RNN like not like a
grew or a stream or something and I grew
our LTM or something
Let's uh let's make me a little smaller
here
um our ends are really cool in the sense
that they uh Carmack goes into this he
says well basically
like the thing underlying the brain has
to be an RNA right because because
that's the only thing that's going to
like work on there's nothing that looks
like a Transformer architecture where
you're putting in a fixed amount of time
um input you know commas moved away from
from rnns though into into things that
look more like Transformers because
like R M's
okay you guys know the basic idea of an
r m should we bring up notebooks should
we code
um how is my where
oh yes code okay uh
no no we're reading papers guys we're
not coding this is not coding stream
um
so yeah I mean this is this is what rnns
look like if that makes any sense
um one of the problems is
it's it's annoying at uh at run time to
it's much easier at runtime to make
these things do infinite roll out right
like you to never reset this hidden
state
um to not to not have to backtrack to
basically summarize the state in the
hidden State uh but you can't train like
that so I think the main problem with
rnns is the algorithm that's used to
train them uh and I I wonder I wonder if
you can replace it so the algorithm is
called back propagation Through Time
I wonder if you could replace it with
like a predictive coding kind of thing I
don't know uh
okay
um
we start with DVD three trained language
models we fine tune it
supervised fine tuning
what is the RM score
so this is the paper basically how they
tune chat gbt and what made it different
from from gpd3
um this is what I said on uh Lex
Friedman when I was asked about the
large language models large language
models historically before Chachi PT had
all sort of been trained with this
categorical cross entropy predict the
next word uh
the objective function but the problem
with doing this is yeah you're most
likely to get the most mediocre things
right if you ask something to like
autocomplete like a wrap you're gonna
find not you're not going to find
high-end Kendrick Lamar m m bars you're
going to find mid YouTube comment bars
because those are more common in the
data set and what is the compressor
doing just trying to reduce the
perplexity
um so if you want stuff to be good you
need to uh train in a different way and
this is finally training it in a
different way
uh
opinion on forward forward algorithm
that's that's one of the papers we
wanted to read and understand uh on the
Stream
so there was another one I think last
wrong is still the best place to find it
back prop predictive coding I want to
see how it differs from this paper
um
this paper there was another paper too
where they used the forward gradient I'm
still not exactly sure what a forward
gradient is have I seen refusion yes I
have uh oh another paper that we wanted
to look at we'll get to all these before
the stream ends is uh it was called like
Chachi BT is not all you need
um oh a third paper that we definitely
want to get to well I'm gonna bring up
two more uh dreamer V3
uh during the V3 is very cool
uh
you know I'm always
always more impressed by the deepmind
stuff and the openai stuff
and like I'm just I'm not that impressed
with these with these stable diffusion
chat GPT because they don't really have
objective functions right
people are impressed when the AI
generates something that could be
generated for you on Fiverr
right like like
I did hear I did hear a good or good
like in order to make chat GPT work for
you stop thinking that you have access
to one smart person and start asking
what would I do if I had access to a
million dumb people
um because it is it is it is a dumb
person and it has an IQ of 82 it got a
10 30 on the SAT
uh this one and then the other one we
wanted to look at was a walk in the park
I'm particularly relevant to uh
to what comma is doing next
this guy's interesting I thought I mean
he was at the lab too I was looking at
his website
meta learning back propagation and
improving it let's see what we got
we always love which made paper paper
um so I'm not sure reading papers is
going to make that good content we've
never really done a stream like this
before uh
uh I've been just just a little note
about what I've been up to I've been
hard at work on Tiny grad
um oh I wrote a whole
I wrote a whole symbolic algebra Library
uh to deal with the shapes and now tiny
grad is you know trying to grab used an
open pilot
um
and now uh
tiny grad is going to be able to Output
models for the 845 GPU that are in no
way specialized to the A45 GPU so I've
unified the opencl back end
uh with the GPU backend so like look I
have these like terrible hand-coded
kernels and now that the oh they're so
long too now the auto gen just comes in
and the autogen makes kernels that are
20 faster than these
um
so I wrote a really fancy Auto generator
a little
but yeah this is this is what I've been
up to
um
like these and I I can reduce this code
down to something simpler but just by
kind of dealing with the shapes
using these reshape and permute and
upcast
I'm capable of generating code that
like
you can control a lot of things because
when you want stuff to run fast on a GPU
you want things like memory coalescing
uh you want uh
your types to be you want to make sure
your math not being done in floats you
want to do like float4 as a native type
of most gpus you want to do flow fours
um the open the Snapdragon
implementation requires you to use uh
textures and not buffers uh because the
textures hit the L1 cache and buffers
don't I don't know why that is but it
happens to be true
uh
so that means no more to need no no none
of this replaces need but need now lives
in tiny grad so if need is two parts
um there's this part of need which will
save
this saves the need file uh and then
there's a version that's only in open
pilot written in C plus that will if
need is two layers of extraction these
things are just it's abstractions all
the way down and they aren't needed
they're not
they're not arbitrary but okay so it's
need in open pilot sits between the GPU
driver of the kernel and will directly
cache the i o controls
um this need
also became an Interceptor layer between
smpe and opencl and it would cache the
CL calls uh but now we don't need to
cash as the alcohols anymore because
they're just being generated by tiny
grad so this just saves out all the CL
calls and then need will still run the
CL calls and cache the i o controls
every time
uh so yeah it's still needed absolutely
um I have another one called borax for
NVIDIA but Cuda cash gets you most of
the games
uh so that's what I've been working on
but the main reason that I want to work
on this stuff the main reason that I
think tiny grad is is going to be
important I don't really talk about this
enough on the website
um is
so if you're training large language
models at scale tiny grads are going to
be completely useless for you you're
already getting a high percentage of
utilization of the GPU
uh you're already getting if you're
doing things that look like large dense
Matrix multiplies you're already getting
80 of the flops of the GPU the tensor
cores all this stuff like it's just you
know
but
if you're talking about training on
batch size one which is a lot of what on
device learning is going to be you don't
get any of these gains
now some of them to be fair as you lower
the batch size uh you get less there's
this concept called arithmetic intensity
arithmetic intensity is actually this is
you know let's just set this up
just so you guys can see
um 10
see me
yeah so
arithmetic intensity is the number of
flops oh it was perfect as an exact
example number of flops per byte of of
memory so for each read from the memory
how much arithmetic are you doing on
that uh so you see with large batch
sizes you get high arithmetic
intensities with low batch sizes you
don't
um
so
with this being true you you
the pi torch tensorflow stuff is not set
up to function well in this regime of
small batch sizes and like online
uh which is where I want to get to for
things that are uh like robots right
robots that can live learn as we go so
so we're going to take a look at this
paper first
um I probably haven't even mentioned it
in reality the thing doesn't learn to
walk that well but it's just it's
pushing into something that I've never
seen before uh work really well which is
true on device RL uh in this work we
demonstrate that recent advancements in
machine learning algorithms and
libraries combined with a carefully
tuned robot controller lead to learning
quadruped Locomotion in only 20 minutes
in the real world
um so uh you know hypothetically maybe
comma is working on a quadruped
and uh when we launch it I wanted to be
able to learn to walk directly on the
comma 3.
3 uh so we're just gonna
you know the comma three is a human head
right
like if this is this is it has it has
two eyes
uh it has two ears it has a mouth for
speaking uh it breathes air
um it has uh that kind of sensor is a
gyroscope and accelerometer so humans
um it also has a few sensors that humans
don't have like magnetometers and GPS's
has a whole set of temperature sensors
but it really is it's it's it's it's a
human head and you can see maybe you
know it looks a little uh
stupid uh because it's not as smart as
human yet but maybe the uh comma five
will be
uh yeah we're gonna I want to build
things that get closer and closer to a
human 20 watts 20 beta flops someday
um did I look at that like that when
designing it yeah I
forever you know in 2016
I said uh the goal of commas to replace
all jobs
kind of wanting to build people for a
really long time
um so you know you gotta but you gotta
work slowly you know first let's build
even a dog is a lot dogs are very smart
um
so yeah uh a walk in the park can we
make a uh robot
that can use a comma 3 and learn to walk
and then let's even go Way Beyond
walking
let's let's start
what if I just have it you can say good
dog and bad dog right and there's my
feedback and what are the puppies going
to learn to do
I know dogs are very smart I've been
thinking about getting a dog
um I was watching Alex and I've been
talking about what dog we want to get
she wants to get a Pomeranian like you
know I could never get a a dog looks so
stupid now and then I watch Pomeranian
they like this dog IQ test where they
put like a treat underneath a blanket
and see how quickly they they get it out
um the winners of these dog IQ tests are
all Border Collies
ah and I'd love to have a border collie
but you know in my apartment I don't
think a border collie would be very
happy so uh well I think we're gonna I
think we're gonna compromise on on a
corgi uh Cory's pretty smart
wow this is this has been really I've
got to feel really I feel really 80 this
morning
the coding kind of calms me down a
little bit
um
I'm just going to sit here and read and
rant
I mean they're great dogs but they're so
they're so high energy uh you know they
get bored I just like I feel bad if I
just have a dog sitting around this
apartment all day
yeah the problem with the smart dogs
they tend to require a lot of time and
attention or they get bored and
destructive exactly
um don't worry your common puppy will be
conditioned to uh not uh not do that
we're drinking a high ball energy uh
grapefruit naturally flavored
no yeah
okay
so I've never done a paper reading
stream before
sitting here watch me read is not going
to make good content
uh
I should get chat EBT out and just copy
and paste things and ask it to to
summarize
um
so yeah oftentimes going to Great
Lengths design sophisticated simulation
systems and transfer learning methods so
most papers don't learn on most papers
that have tried to do like robotic stuff
uh you know the open AI Rubik's Cube
paper it's old we're not going to load
it but
they build a simulation environment and
they do something that looks like
parameter blinding to make it kind of
work
uh but they have
no sample efficiency at all
um actually let me think about comma
sample efficiency for a minute I think
Karma has a train it drives for about 10
years
so yeah not very sample efficient stuff
oh have you seen explainpaper.com all
right all right let's try it
upload a paper highlight whoa all right
let's go
come on I gotta sign in
no I gotta sign in that's too much for
me sorry the the barrier to entry was
too high
um
that's that's true that's true that's
true you know there's a problem with
common in general the barrier of entry's
so high
um you're just my long-term vision for
comma is that one day we're going to
have stores in a mall
and you're gonna walk in and you're
gonna walk out and your best friend
um and your best friend is going to uh
well first off if you'd like oh you're
tired you've been drinking don't worry
it's going to get in the driver's seat
and drive you home
uh and then it's gonna get home and ask
you know I could tidy up this bathroom
for you I can cook for you or you know
if you want to get in bed yeah we could
uh you know I'm very flexible and
capable of doing many things right
that's the dream man that's the dream
um yo right right come on that's the
dream guys ah
oh
how long do we think it's gonna take
long fucking time
um
so here actually let's let's watch it
walk in the Parks video
uh so so this is this is this is uh
where we are with waifu bot right now
it's starting to walk it's learning to
walk
uh
we're not going to have a uh a wire
I want this to just be a comma three on
a thing
she doesn't need to walk close but you
can buy a real doll if you don't want it
to walk
all right
we're kind of learning to walk that
sounds pretty good it just keeps getting
tangled in all the wires you know
usually what you do is you suspend the
wire from the ceiling so it doesn't keep
getting caught up in its wires
uh how do you train it well so
this one they use a reward function of
moving
um they talk about it here I've actually
read this paper uh
mostly they talk about using a uh
foreign
yeah Target velocity
and they use a they use a Vive uh for
the indoor the Vive pucks are really
good
I bought some of them right they're very
accurate
uh velocity is reward just search for a
walk in the park
uh
and it's open source too
so maybe we will do this
take a look at the code
kind of see how they structured it
so this is their trainer
oh
a lot of times it's better to read the
code than to read the paper
uh I definitely found this with with
Iris
uh like this is all this subtlety in the
code that they don't really go into in
the paper
um the code is the source of truth right
all documentation is just wrong uh I'll
learning to drive which is this
is this wave isn't Alex Candlelight wave
oh yeah yeah yeah yeah I've seen this
um
yeah I
it's
fine
the problem with driving is it's a
two-dimensional space
right
so you're you're your output space is so
simple that
like
almost anything can learn to do it uh
you know
I think it's called Alvin CMU
um so I'm I'm quite unimpressed with
things that like automatically learn to
stay on a road
uh
this was yeah in 1989 they trained a
neural network that could stay on the
road
uh do I think this is impressive
what is this if you wanna if you want to
mention something in chat you got to
give me a little bit of context I'll
load that one but in the future we're
going to Aha followed that one
so yeah they use that they use the Vive
uh velocity was the reward function but
the the output space of a quadruped is
much higher dimensional than the output
space for driving
um okay okay I haven't seen this one
let's see
whoa all right we'll even start that one
I I generally I generally hate papers
that like write this kind of stuff
no shit it's true
uh
okay generalization
oh they like hooked it up
yeah
actually I did see this briefly and I
thought the Transformer was just kind of
a gimmick
um
what robot is that
foreign
body
how do I read so fast because I don't
read every word
when you when you have familiarity with
stuff you just can kind of like
know what it is
you know
uh I'm curious what the role what what
what uh what robot they're using is that
some in-house thing
I'd buy one of those
oh Everyday Robots
oh okay this is some Google only shot
shit
I know how it is
that really the zoom level you want okay
this is a this is a terrible
yeah
I kind of feel like we should stick uh
some training wheels on a comma body
like that
oh I've seen Amica yeah again what can I
buy
that's an interesting design that's kind
of what we were going for with the body
uh
you should probably just stick one of
those things on the back like that
no I have actual training wheels on the
body yeah that's probably the right idea
is there a robot arm you can buy for 2K
there is hang on let me think of where
we have some we have some at the office
they're just they're painfully hard to
use
um
[Music]
they put a WeMo lidar on there
[Music]
if someone built it evolving no you lost
me at evolving I'm gonna read that
um yeah so the evolutionary algorithms
uh again for something like learning to
drive an evolutionary algorithm was
probably fine because the output space
is so low dimensional
uh whenever the office space is really
low dimensional you can almost like
random policies almost work it turns out
the RL is not really doing much it's
just kind of uh
it's it's kind of just
guessing and then like your
initialization matters a ton
um but whereas in these pretty big
models your initialization matters a lot
less
uh you can only talk about why it is
why are robots slow uh
they're slow because
okay so when you're doing stuff as a
human you
a lot of times you're you're
I guess most of the time you're
statically stable but like you're not
really thinking about static stability
right like
when you're walking as a human can you
stop at any point and the answer is
obviously not right so when humans walk
they kind of fall forward right like
stopping there is hard right like if I'm
walking like it's it's I can do it but
it's like it's like hard right this is
requiring a pretty Dynamic stabilization
right I can do it you know humans can
comfortably stand on one foot but um you
know it requires
you to uh dynamically stabilize yourself
right these robots are doing everything
in a frame where they're statically
stable
and that's why it's like
uh okay is there anything to take away
from this
it's open source are they going
what are they outputting from nest
oh okay they're going straight into
action
which is cool
interesting choice of action space
gripper position rotation position
closure
efficient at B3 interesting
uh comma uses a B2
Universal sentence encoder
what is film
future wise linear modulation
I've done I've seen these in recommender
models too where they generally
three times okay uh film efficient Matt
I actually like the Google paper more
okay this is what I was looking at
so it's interesting they added every
layer
um you know there's questions if we want
to do this with uh
okay and then how does this learn
okay this is cooler than I thought it
was they're actually going after the
full action space
um
categorical cross entropy
wait how do you use categorical cross
entropy for these
outputs this is open source too
why don't you use language that triggers
me man
can I run it on
useless
gonna tell the source it now
um
Palm is another thing that I
should know what it is I'm out of date I
got a lot of reading to do
oh what do I want to look for in here
yeah somehow that's the actual loss
function
how
could that be the loss function
you're you're it's doing regression
oh discrete action space
okay
I was discreet dives into 256 bands okay
fine
fine
men's uniformly distributed in the
Bounty tray okay cool
um and they use category rush
cross-centric for that okay so this
isn't a bad choice I mean what this will
do
it's interesting to do that maybe this
is almost all right
um so so one regression doesn't really
work uh icon where we've had to do so
many hacks to get regression to work uh
so one way around this
is you can uh
just just discreetize it by splitting it
into bins and then you can choose like
the ARG Max at runtime
uh
uh which is like fine if you're doing
stuff like this I guess
well one of the problems you run into is
you then have to put logic after the net
to pick one
um these look like they can all be ARG
maxed
uh but for driving it's a little more
annoying how do you want to encode the
path
okay put a lot of time to comment I'm
thinking about this no we finally like
got things that work pretty well they're
not really the problem
the biggest problem is cheating in the
simulator
okay
so they learn I assume they have a
remote control
uh generating data
and then a behavioral clone
uh common three sales are double uh so
they're going pretty well uh if they
stay double we'll keep the price off
no there's a ton of uh
a ton of uh
so here this is like an ionic five
thread
um
this is a bolt thread like they're just
they're just whole big threads on these
car subreddits that talk about uh
um
I don't know where that comment is but I
like it uh
oh here we go I'm not very confident in
the founder
I place my bets firmly on the shoulders
of the amazing deaf Community who
supports open pilots and its many Forks
um
you know what was that was uh the
comment that I liked that uh
blah blah blah blah it's just cool it's
just cool like there's been there's been
a lot of growth here well some companies
have promised the moon and under
delivered other companies are doing
fantastic work looking to call my eye
open pilot all right uh
who is the founder of open plan I don't
know no matter
um
uh how do you cheat in the simulator
simulators
often leak information about what the
objective is
um it's hard to make them not
okay
condition from learning invitation
learning methods
and discrete Dimension to switch between
three modes controlling the arm the base
or terminating an episode
okay
uh
okay the conditioning normally inserting
a
if we initialize the weights the dense
layers
interesting
oh that's cute
so they add it later
um
is there internships in comma AI space
question mark yes but you know
not have asked like that no offense bro
like
um
you know it's nice that we can just kind
of uh
at comma we don't really need to think
that much about like designing our own
custom culture
like
that's it right like thanks thanks Eric
Raymond uh
it's it's uh
if you guys haven't read this this is
really good
um there's another uh
this is this is required reading a comma
uh for everyone who works there uh it's
also linked from our Discord
um you know I'm shocked uh
one of the criticisms from uh uh the the
the uh the man who uh tried to call me
out in his longer at Twitter was that I
didn't uh ask for people for help at
Twitter I just read the code
um it's a very odd criticism right uh
cause
when you're reading the code you're
wasting nobody else's time right one of
the most valuable thing at least this is
what I say in common I don't know if
it's true to other companies but most
valuable thing in common is other
people's time so if you're asking a
question you are consuming somebody
else's time right I want you to realize
what you by asking that question are
detracting from the company
now that we understand that
you know that's a very expensive
resource right spending other people's
time forcing them to context switch is
really expensive so if you're going to
ask a question it better be a really
smart question
uh
if you have a question read the code if
you have struggled in the code for four
hours and tried as hard as you possibly
can then maybe you can ask your question
but until you've done that do not ask a
question
when I think about work-life balance do
you really want like like I have you
know my opinion on this
yeah so uh don't ask questions uh well
if you do it's not terrible right if you
do but they better be smart questions
all right
um you know you know you're 11's uh
what's what's that let me Google that
for you you know the website
[Music]
um
wouldn't it be better to ask after one
hour and save three hours no because you
were saving three hours of your time and
costing somebody else's time that's the
problem
but when you build this when you do this
when you build a culture that looks like
this
um you end up with a culture that's
really robust where people are capable
of working really independently and you
you you mitigate N squared effects you
mitigate these effects where as the
company gets bigger if every person
works independently and can truly create
value independently then you can get a
company that grows linearly right then
you can get a company where value grows
linearly with the number of employees um
but this is not true at any company I
don't even think it's square and I think
it's I think it's more like logarithmic
um which is really brutal
uh this sounds like a toxic culture uh
you know some people feel that way and
you might feel that way
um and then it's not for you uh but
I mean this is this is
also again this is classic agriculture
right
um I I understand that the world has
moved toward you know the internet has
moved towards some some other kind of
some other kind of crap but uh you know
in Old School form days
you ask a dumb question you know you get
you get uh you can shoot out
um independent work being a toxic
culture right yeah come on come on right
you want to actually you wanna actually
solve problems
um
what if the question takes two minutes
no it doesn't matter right because it's
not about that one question it's about
the next question
okay
um what do you do in those four hours
in those four hours you researched and
you learned and you probably learned a
lot of things that were not the exact
answer to your question but their
answers to future questions so you can
say oh I'm only going to that question
is only going to take two minutes now no
no no no no no no no no no because
you're gonna have to ask a lot more
questions because you didn't spend time
reading the code
uh there's a lightning gbt that for you
now oh I love it love it
thank you
um
well you know you haven't really I
haven't really seen a company run with
hacker culture before uh and I think
it's because a lot of hacker types you
know wouldn't tolerate
a lot of what it takes to to start a
company
and to be fair why do I tolerate it
because I'm an idiot and didn't really
know what I was doing right uh you know
I mean you gotta you got you gotta be
stupid to start a company
um at work you're told to do the
opposite ask someone instead of spending
hours figure it out yeah this is the
wrong trade-off
um
I know I know and it's it's weird it's
weird that that company seem to have
that culture right like you know if you
want to really have a culture and you
want to have a hope of
um think about it why does comma have
any hope of winning self-driving cars
we have to be doing something different
right if we're doing the same thing by
all normal bets we should lose right if
we're doing the same having the same you
know culture you find at all these other
companies what are you going to lose but
if you're doing something different
um
no I mean and then also when people do
ask me a question or you know hopefully
hopefully everyone in a comments kind of
been trained this way you you shouldn't
respond with an answer you should
respond with another question
um even if you know exactly the the the
answer
giving someone the answer not always the
best idea
uh culture means Capital yeah I agree
with that I agree with that uh no I
think I think we we do win it's just
kind of a question of what winning
actually means
um self-driving cars are shitty for a
whole lot of reasons Beyond like in
things outside my control
um robots isn't true all right robots
are entirely with money control like it
is completely possible to succeed or
fail at building a product that can come
home and make you an omelette and the
thing about building a product that can
come home and make you an omelette moppy
floors is
if you succeed at this it is apparent to
a five-year-old
right a five-year-old can completely
understand when the robot brings them a
grilled cheese sandwich right and that's
that's the kind of thing that I want to
build
um
you know it is this kind of a declining
momentum for solving self-driving cars
we're gonna we're gonna wrap it up
nicely we're gonna wrap up open pilot
really nicely we have incredible things
planned for 1.0
um if we actually get this third
Paradigm stuff to work
uh
my hair right now my feet and then I'll
come back and finish this
foreign
guys should order meatballs you wanna
order meatballs
uh yeah he shows withhold information if
you know the answer don't just tell
people the answer that's not they're not
going to learn right because you're not
trying to optimize for giving them the
answer right now you're trying to
optimize for the giving themselves
answers
uh in the future do I ever make my own
food yeah I can make eggs man
sometimes I cook meat and you saw me
cook uh you saw me cook a burger it's
about leading some of the direction of
the answer yeah uh
yeah and that's the the final thing that
if comma builds it there is no
like you can use open pilot it's the
best 8s system in the world
um it really is but does it like says
who right
you got some people's opinions right it
doesn't it doesn't matter
um the consumer reports right it's it's
political don't we can't include them in
the thing because it's our Market I
have fun like
um
my employer has this mindset that you
should ask sooner rather than struggle
by yourself no you should fucking
struggle uh I I can't believe that I I
can't believe this accompanies and like
it's their downfall right it's their
downfall it's why these companies do not
scale and it's why companies with
hundreds of thousands of workers can be
out competed if you had hundreds of
thousands of independent workers oh my
God
like how amazing would your company be
um
no I just don't struggle before and you
should struggle
uh same company's firing everyone
redundant no they haven't gotten nearly
far enough uh
energy-based model approach I would come
with you with 100K well I'm not really
sure there are
managers don't want truly independent
workers yeah and you have to get rid of
managers uh you you have to get rid of
what what drives a lot of managers right
the only people at comma who are
managers are very reluctant managers
um if you have a really reluctant
manager you uh trust me they want an
independent worker they just want to be
left alone to write their own code
um
what the hell is compliance training
uh
uh yo want to talk about based a shock
being like I don't know what an
operational design domain is yo I love
that I love that man I love that uh
yeah yeah and no and also question
culture uh brings down right think about
it the people who are the worst the
people who know the least and are
capable of doing the least
uh are the people most likely to ask
questions and the people most likely to
get asked questions or the people who
know the most right
so you see the problem here you now have
you now have all basically your your
low-level people taking a very expensive
resource from the company
uh does comma do diversity hires I don't
know what A diversity hire is Right
discrimination is for morons right if
you want to discriminate based on race
or sex or anything like that you're
stupid right and I mean it you're not
just it's not like a moral thing right
it's just stupid right like how much
you're willing to pay right there's
people out there who are actually
willing to like you know you want to be
racist it costs you money right if you
aren't actually picking the people most
likely to succeed at the job
um yeah this is classic
uh okay
we went off from Iran to huh oh we went
off from Reading papers
yeah
um how was hiring for uh for robotics I
want to hire people for robotics
uh we think one of the first things you
can build is security robots
uh
all right you know what it is it's
because non-subscribers are talking you
guys say Dumber things than subscribers
okay I think we're done with this paper
uh I'm not gonna read that paper for the
reasons I talked about
what else do I have okay
okay do as I can not and I say grounding
language and robotic affordances
flan
it automatically takes responsibility
for spilling to drink
um
foreign
this is 10x feet
well they have hint water
okay so they're probably running the
Palm off line
that doesn't look impressive yeah
we won't
it's a cool infographic uh we want um
robots that like move
fluid
if they don't move fluid you're doing
something wrong
but to be fair if this was trained using
uh basically someone does the task
remote control and then you train a
behavioral cloned the problem with doing
that is like it's always a really
awkward interface for people I mean at
least most of the interfaces I've seen
to control the robot it's an awkward
person interface so it's awkward with a
person controlling it and then it's
awkward with the machine controlling all
right because it's just cloud
um but then you compare that to like
driving and that's why driving is a
really good uh
is the best like I think still applied
AI problem today is because well what is
driving well driving as a human using a
robot it's an exoskeleton and the data
that you get from the human using that
exoskeleton is good data
um it's probably the best the thing can
actually be operated at
see this is what I look at this this
kind of stuff is why ah
that a tiny grad's not important for
things like that but it's important
because you get to
uh
so this is just Google's like Mega large
language model
TPU compiler is crazy complex
even the edge TPU compiler which is
completely separate it's just it's such
a complex chip
insect-sized robot that can walk
fly walk and stuff
that's a piezoelectric cantilever
actuator
oh these things can only like move like
really small
oh that's cute
guys because you have a lot of strength
yeah
intelligence
okay
um
um where we had more paper somewhere
foreign
I've always kind of thought that
Transformers who are a fad
now I think that the people who
originally wrote the Transformer paper
kind of thought this too like they did
not expect
um them to end up being used for
everything
key and value are first combined with a
sort of learned position biases
filter which is combined with the query
in element wise fashion
oh I see okay
so they're okay
they're basically instead of instead of
computing the the uh that's interesting
so instead of computing the the
attention Matrix they're just learning
it
um
key value are first combined together
with a set of learned positional biases
okay so those are the learn positional
biases
some of these things
it just becomes hard to compete with the
really big ones
they're training all those different
sizes
what is 14 at me
where do you see 14
oh oh it's 14 billion parameters at that
many steps or something
yeah it's gonna be fast sure our guns
are mad fast
uh Ireland's and inference are mad fast
um here we got another
we're looking at dream all right here we
go
so this paper brand new
um consumer V3 so this this is
where we're deepmind really like uh you
know one of my favorite papers from uh
in general as new zero
um oh you chatted all the open source
llms
are any of them are you even like good
I try I downloaded like gvtj and I was
really unimpressed by it
uh uh you're saying no none of them are
good
big
bad
or you think they're not training the
right data set what do you think it is
no it's not just the fine-tuning of
instructions because you can use you can
go to deepmind you could just as you go
to open Ai and you can just use gpt3 and
gbd3's output is still way better than
any of the open source ones I've seen
okay
um
creating a general algorithm that learns
to master new domains out of the box
would overcome a barrier of expert
knowledge and open up reinforcement
learning to a wide range of practical
applications
three neural networks the world model
predicts
let's compare this to uh the one on my
blog
so a world model is these two things
combined
ah okay
so the only thing missing
from
oh wow I'm actually missing one here
okay so these two are what they call the
world model
um and then this one is uh the the uh
what do they call it
this is the actor
interesting the critic
oh that's cool
oh man
I love this I love this I forgot this
one you're right of course I need that
of course I need that
we gotta take this blog post
we gotta update this blog post to be
like we're also we also need a Critic
oh I love this
this is actually so fundamental right
okay so they're actor do they share
weights with their uh
oh car Pat carpathy's videos have
production value you gotta give it to
them
um
he puts time into them they're they're
basic like they're
if you're not familiar with this stuff
at all they're they're good uh they're
good intros if you're familiar with it
it's kind of like oh like this is pretty
uh again pretty basic but like he really
does teach you he's a great teacher
foreign
should I make should I make high
production value
uh okay so
oh they include this model too
oh man this is just this is so
fundamental you know
high production value SoundCloud checks
uh
uh yeah I I got a new song I'm working
on uh
but no I don't know it's not that good
God is so over this nation I'm back in
my place and it's home and it's
civilization
that's that's the best lyric I came up
with
um
this isn't real
this this this decoder model is a hack
but the critic is real
I tried asking GPD for help it writes
the most absolute mid YouTube comment
raps yo I gotta I got a boat yo and it
and it floats yo
I'm gonna drive around my moat yo Moe yo
I got no Cabinets To Go yo
yo all right look I'm check that's chat
EBT rap here you go
you could destroy that machine man if it
wants to battle me
uh no explain paper maybe log in and I
was out without not logging in
uh no we gotta get lunch
it made me log in
Let's uh let's call Alex and tell I want
lunch
I don't know if she's done with yogi yet
lunch lunch
I hungry
um
foreign
all right well the non-subscribers talk
for a little bit I don't want to hear
anything about politics anything about
diversity then you're gonna get back to
subscribers only right I don't hear
anything about that shit
right and you're not you're not better
you're not like oh yes but I have the
base take on this no no you perpetuate
the problem
right like like all these people
dude
wow you didn't even need the subscribers
for me to explain this to you but like
you perpetuate the problem you you for
every for every like feminism takedown
like no you're the problem trust me
they're not the problem you are
um just like you know if it's uh
all right
yes exactly no the problem is the frame
problem is that this has been accepted
as the frame
um I Heard a really good I heard a
really good take on the like on the like
you know like fine like race-worn shit
that's been part of the world like
forever but like the war between the
Sexes like that's the most ridiculous
late stage capitalism garbage like the
fact that anything's Being Framed that
yeah because I can't I can't guys I
can't exactly who runs the world girls
that's right that's right
um
all right the critic we need a Critic
this is just an artifact of training the
world model in a crappy way
I'm not talking about Twitter either
we're gonna get you're gonna get
subscribed only
um
no what would oh what's that what's that
the Bo Burnham it's like bro if you're
taking if you're taking mental health
advice or political advice from a Katy
Perry song what are you doing
Consciousness in the critic all right
all right stupid takes from
non-subscribers
um
man we're gonna update the blog after
we're done streaming
uh hash table was cool
small enough
oh yeah yeah I I think actually a lot of
things are going to start looking like
this
um there's uh
there's things where
so the language model is combining both
content storage and uh uh thinking
uh or maybe the word is content
retrieval right like it's combining both
content storage and content retrieval
and it's not very efficient at storing
content neural Nets are not efficient of
this
um so what you want to design is
something that looks a lot more like uh
yeah like a hash based memory retrieval
kind of system the brain works like this
so you would make it would make sense
that like the large language models will
become a lot smaller when there are
lookups I think Facebook Atlas
called Atlas yeah here we go
um retrieval augmented language models
these are kind of cool
oh no these are open source like are
these any good
Fusion in decoder
a retro is a retrieval yeah I kind of
you could do a much smaller model
attached to the whole internet what do
you think you are
um
it's retro
[Music]
uh comparable performance 223 Insurance
one file is the pile Open Source by the
way
cool and that's what everyone's actually
using
bits provide wow
wow it's that much better
that's crazy
[Music]
limiting chapters you're derailing
idiots
um
we're working on cool new data sets
where's here where do you want to lie on
I'm gonna work to lie on it though uh
which party
uh the stable fish party
called
oh I saw a Discord for this
maybe this isn't the one I'm thinking of
[Music]
this is brand new
oh no never mind
cool
uh
am I the frozen bird retriever a
differential encoder
wait
but if you use the pile where did you
get a two trillion token database
did this one not use the pile
ah but where you get that database from
it's too complicated
it also kind of uh
it helps you a bit with explainability
which is cool right like you can see
what it's actually retrieving
I hate that we're explainability because
of the way people use it but like
there's some truth to it right there's
not
the idea that our model is ever going to
be fully explainable people think Source
code's explainable it's it's not
um the like
no source code is explainable all right
welcome to Rice's theorem
or non-trivial semantic properties of
programs are undecidable right oh my God
like but this is the thing like people
believe oh it's cold it's hand-coded you
can look at the line that caused the
problem like you know you can't
and you know here's another like like
the halting problem you can't solve the
halting problem either right like humans
think they can solve the halting problem
but I can write an 11 line program that
encodes the golbach conjecture and you
can't tell me whether that halts or not
um well people certainly aren't
explainable too and that's that's
another like Baseline but people have
this illusion of explainability
uh
uh when it's cold and it's just an
illusion
I guess all right like why I'm so why
I'm so aggravated when I'm talking about
this stuff
um
I watch look what happened to crypto in
the last four years right like crypto
went from your average person in 20 like
let's say 2016. right like when I was in
the crypto Castle 2015.
um
your average person probably knew what a
hash function was who owned Bitcoin
right just a hash function not a very
complex idea
um today you have the biggest morons
shouting with the loudest voices about
crypto
right like it just it just
we hungry too
come here we take
the rules
uh I bought a Rolls-Royce boys I bought
a Rolls-Royce Ghost I did it I did it oh
yo
no no
no no no yeah
uh wait it's just like a minute for why
I'm so aggravated I'm starting to see
that happen with AI too
like like the most the biggest idiots
are gonna start having the loudest voice
in this space and they don't know
anything and I just wish that like
before I think I did that to you guys I
did that to you guys like like before I
let you talk in my chat you have to take
a test
right but there's actual facts in the
world and if you don't know a set of
facts you should shut the fuck up right
and and then oh man the world be a lot
better if that was true
like I said I want to ask politicians
how many how many presidents in the
United States know what the derivative
of x square is
foreign
I saw another thing on on Hacker News
uh that I that I liked um it was called
the myth of the myth of the 10x
programmer I mean it was kind of stupid
but myth of the myth of the 10x
programmer
yeah
um yeah
right like
I
I I understand
like
I'm not sure if these people are
communists right like I really I really
don't know how else to explain this the
the difference and everybody understands
this who spent any time like in software
the difference between somebody who's
like really good and somebody who isn't
it it's
I don't know anyone 10x faster than
their peers with solving well-defined
programming problems yes of course but
no this is actually this is actually a
good blog I didn't mean to add anything
to uh
like
it's hard to it's hard to like even kind
of explain this
but
we also have another another like saying
a comma like being wrong is really
really expensive
like saying wrong things is so bad
right I'm not talking about like
opinions right you can have whatever
opinion you want and there's like there
aren't really aren't wrong opinions
um you know even if your opinion is is
like like morally terrible
um that you think like you know mbas are
good people and should run the world
like you can have that opinion man and
that's like a fine opinion to have it's
not wrong but I knew when you were
actually factually wrong about things
um
and
yeah like like it's it's exactly this
um also like Elon has this thing like
the process
it's pretty good
you're gonna ask me log into LinkedIn
uh yeah like
um
this right here is what makes 10x
programmers possible Right like like
like a bad programmer will take their
requirements and Will Will just like
code whatever that garbage is right but
like it doesn't matter who gave it to
you it's even more perilous if an
intelligent person gave the requirements
to you you might not question them
enough everybody is wrong some of the
time no matter who you are
um right like and then yeah delete part
of the process right and then only step
three do you get to simplifier optimize
I mean this is this is brilliant you
know
um I had some encounters with I'll talk
all about this I had some encounters
with Elon while I was at Twitter and
something I sort of came to realize is
I can say something and like while I'm
technically correct I mean I I I did
this kind of twice and I was saying
stuff that like was technically correct
to Elon but it like it did miss the
point and I I get that you know he's a
lot he's a lot faster than me and like
I I was trying to like
win it I was trying to
sometimes when you want to like manage
people you say wrong things
like and and it's it's it's beneficial
to say the wrong things
because they're more likely to achieve
the outcome that you want
and this isn't always a bad thing right
I guess I had always thought about that
as like that's manipulative that's
terrible but
it's not and
like stop asking the question what's
correct and start asking the question
what leads to the outcome you want
um it's dangerous it's dangerous to
start to think like that right it's
dangerous to start to like I don't know
I I don't know how much I could bring
myself to do it
um we got we got we got 10 more minutes
of stream
uh
Alex and a friend are coming back we're
gonna go get some nice lunch on this
beautiful Sunday oh I'm so happy also to
be back in San Diego oh
band
just like
oh I went for you know we went for a
nice walk last night and I didn't feel
like I was gonna get jumped every block
I walked on you know
um is this straight up justification for
manipulation
well yes and no right like there's
this is the problem with it right like
yes you you can't you can't use this to
justify terrible manipulation of people
I guess the the thing that you have to
ask you can say like this is even more
evil but like
will the person be happier at the end or
more productive at the end having
believed like this
word of wrong you you wouldn't stop I
don't know I I'm not I'm not fully I'm
not fully uh
I haven't fully flushed all this out yet
and don't use this as a justification
well George said it's okay A lot of
people to get what you want no that's
not what I said
um
but I uh
I I wrote this blog post and this is
this is
my observation of of elon's theory of
management it's very interesting
um
so
a company can either serve a process or
a goal
um my friend Trev explains to me about
government I didn't really get it at the
time like the goal the government isn't
to build a bridge the goal of the
government is to follow the process to
build a bridge right so companies either
serve goals or serve processes and then
large companies you're going to end up
with processing it's going to like
metastasize unless you do something
about it and elon's theory of management
is basically this by continually
creating chaos processes and capable of
forming and everyone is forced work only
towards goal
uh you know I really with the whole
Twitter thing I I walked away so much
not envying his position like I the the
amount of
stress
he he must be
under and to think that he like chooses
this life and why
you just you just
even when I I think some of his
decisions are are wrong or stupid like
you you you can't fault
really where he comes from
um
where so many of these people
uh you you you like why are we signed up
for shy what are you doing with your
life you know
like like what are these people and he's
even somewhat visible I mean like these
invisible
executives
they're just that's just evil
Elon is the last truly alive person in
the world he's definitely alive you know
this is a program this program alive or
dead
um
about uh well this is default alive and
default dead but
um
this is exactly what I saw it but the
idea basically is this like
is your company capable of pivoting
because there gets to a point where a
company is no longer capable of pivoting
there's nobody with the authority in the
company to change what it's doing it's
it's it's like a train where you know we
now have a committee that's going to
vote to determine if we should hit the
brakes but the committee can't really
vote because Vanguard always votes no
when they control 51 percent of the
stock so no matter what the Train's not
going to hit the brakes right
um
so I know I try to be alive uh do I
still play no no I'm not gonna answer
that I never owned 100 of comma
investors own comma Employee Zone comma
several employees have made quite a bit
of money selling shares of comma
um you know that that's just that's just
the the life cycle of things uh
our new round of investors is is
I think our first rounds were very 16z
and you know you can decide what you
think of a16z they're not the worst uh
of all the VCS right like you you know I
come through this all having uh oh well
okay
uh you know they're not they're not
angle
um I I think they're a little I think
they the crypto they got they got like
kind of stupidly both the naivety and
agreed combined uh yeah
yeah you should own 51 to make sure you
can pivot but even in a company I
believe that Larry and Sergey might even
still control Google and like are they
capable of of pivoting or are they just
dead right
even with 51 it's not so obvious right
like like
you could have a company that has
evolved beyond the complexity that
you're capable of dealing with
um I think it's
what Elon ended up doing to Twitter like
we're gonna see how it plays out I
really wouldn't bet against him
I really would not bet against him long
term
um
yeah my understanding the the Larry and
Sergey thing I have some internal
information on that and it's just it's
really sad what some of these people
have done in the last
uh
in the last 10 years uh that's kind of
why we didn't get anything
uh
uh but you know it's a little change
it'll change
oh
uh
uh all right we only have a bit more
time so let's get through I'm really
excited about dreamer uh do they open
source the code of this I I really got
to spend time reading this code
um
wait this is just a readme
this guy should come working comma
does he want to run our robot division
look at that
Jersey 2 and dreamer V3 are not that
dissimilar
foreign
got to update the blog to talk about how
we need a Critic too
[Music]
um
actually I gotta spend more time like
really understanding what a Critic is
uh you know you know it comes from actor
critic
foreign
estimates the value function
notice how these things look similar to
continue predictor
foreign
that's the best defensive one this world
model seems over complicated
yeah I saw where I've written this I
this was in New York I spent some time
writing actor critics I couldn't get
them to be stable like do you say like
carpool is just it's too simple
and the Simplicity leads to a model that
okay so the reason that deep learning
can't get stuck in and the reason local
and Minima aren't a problem is because
like
your Optimizer in a way isn't powerful
enough to find them
um the odds of if you're on a million
dimensional space right if you just pick
a point randomly for a million
dimensional space what's the odds that
it's a local minimum all right well so
if you think that each thing is as a
each Dimension has a 50 chance of going
up or going down the odds of something
truly being a local Minima is like one
over two to the million it's insanely
small
so so do you think that your Optimizer
can hit a point that's one over two to
the million in fact I think one over two
to the million might be
that's not exactly true but can your
optimize or hit that maybe it can't
right so you're not even going to find a
local menu whereas if you're in a space
that looks like it's 16 Dimensions well
shit that's you know 65 000 yes your
Optimizer will hit that right
you'll hit that actually if you just
randomly uh explore because you're doing
that many steps
um
What GPU should you recommend for
training models at home what do you need
me to answer that Google it bro ask chat
gbt can I chat GPT that for you
uh you should buy a 1080 TI reminder
that I was trained in uh you know
the source code of the numerical results
are okay he hasn't released the source
yet pretty well
it's cool
uh yeah they did they did diamonds from
scratch and it's also I think this was
trained on one GPU or something or at
least on something small
yeah 17 GPU days that's nothing
all right like look this is this is like
like 6 000 GPU days
um
yeah dreamer V3 is is the coolest paper
I've seen in a while and I gotta just
spend more time diving into them should
we try to implement dreamer V3 in time
you got
oh that'd be cool
should we do should we do tiny grad
dreamer ah
all right maybe we should should I
should I should I do it offline make it
high quality like carpathy
uh no we're not doing it now maybe maybe
next weekend uh that's what we do next
weekend no yes okay
um
yeah we gotta we gotta clean up some
tiny grad stuff
uh uh tiny dreamer oh I love it a tiny
Dreamer
um
yeah let's see if we can make the play
Atari
now this is uh remember when we tried
and failed to implement the MU zero
I still don't know why my museum didn't
work
all right we're popping back off the
stack let's see what we got here
okay
just carpathy you want to join my stream
we'll Implement dreamer together
foreign
GPU
we have a
refrigerator tiny
how often do you review these papers I
mean we share we share the good ones at
comma oh I didn't even get a chance to
look into the forward forward algorithm
all right this is a paper I gotta say
we'll start this is a paper I got to sit
down and really understand I heard
people say good things
um but I don't know like
it's being done on like amnest and c410
like why don't you scale it up
I have Kevin Murphy's in mailbox
somewhere
that was good yeah
I mean a lot of it like The Field's
moving really fast
forward forward doesn't seem too
groundbreaking because the sun is still
just grading it's another source yeah
there was another there was like the
forward gradient's been discussed before
and then like to actually compute I
don't know they're doing they're doing
the negative trick though right and
stable diffusion uses the same negative
trick
which is a good oh that book yeah
hello we're streaming
yeah we're gonna go get food over there
in the Stream we're done I told them
that we were leaving in 10 minutes I got
them prepared for me to leave
what's up we have Lauren too you want to
say hi to the stream oh I saw this
picture which the dog and the sushi a
cute corgi lives in a house made out of
sushi this is because you want to did
you tell them we're getting a corgi I
did I actually talked about it
um
pomeranians look stupid no then the
Border Collies are like if you've got a
dog that's too smart it'll just get
bored and destroy everything yeah yeah
that's true it seems to be the the
agreed-upon situation yeah we'll get it
a house that looks just like that yeah
it's cute wow
um it was made by Imogen Corgi is a nice
interim yes till our robot dog is fully
complete that's right I was talking
about the robot dog or bet
uh these are based or the Giga chat of
dog are they yeah I do think a Sheba is
pretty are sheep is stupid
Sheba dog IQ thanks guys you like my pet
these pants are great oh they're
intelligent
30 the Third
the third most intelligent dog breed out
of 138
that's like I think that's like the
Congo on GDP
levels are great they're the best
I don't know uh dogs corgis are in the
top ten at least one time
we should get Yeah well yeah but poodles
are also very smart talk about us
talking about naming what are we gonna
name our dog I want to give him a normal
human name like can we name him Mike
yeah Mike
[Laughter]
our dog's name is Mike
yo Mike come here
all right guys uh I gotta go I gotta go
we got food to go eat we're in beautiful
San Diego not to be confused with
god-awful San Francisco
um no someone needs to take Tech away
from these people it's not Tech it's not
Tech guys we got rugged we got run
remember all that privacy and oh man if
The Cypher Punk today so I saw what what
crypto had become bro buy some Dogecoin
um
uh
um do you have a do I have a compilation
of the papers you circulate a comma no
you got to come work your comma if you
want to get access to the the secret
source of our papers
uh no no one puts that together it's not
really a secret
um
I shut down cheap eth I shut down my
server for cheapy today
it's over it's over guys cheap eat
silver cheap Beats over I scammed you
all I scammed you all I made millions of
dollars oh wait no I didn't make shit I
actually paid for digital ocean it's
just I just got like five grand on the
digital oceans to run that shit
of
today I was like what am I spending
money on that's stupid
oh you mind so much well you know guys
nobody lost as much money as I did on TV
however much money you lost I lost more
trust me
oh yeah it was a brilliant scam so
brilliantly I saw this guy I saw that
George hot guy he was he was he was
trying to run people like cheapies man
like he can't be around there's no such
thing as tenants programmers man he went
to Twitter he didn't even fixed
all right goodbye to everybody even the
haters and losers uh nah you guys are
all cool especially if you subscribe to
my twitch Channel you give me money you
know that we're only in this for the
money you know that if I wasn't you know
buying rolls royces with my twitch
profits uh I wouldn't be doing this guys
I wouldn't be doing this because I am a
whore oh wait no no no no no no no uh
speaking of that Sky Bree if you'd like
to come on my uh twitch Channel I'd love
to have you I will buy you whatever
chair you want you can sit right here we
can have a conversation I'm sorry I'm
not as famous as Aiden Ross uh but I
think we could have good things if you
want to like build Legos or I heard
you're into Legos that'd be cool man
that'd be cool we could we could play
with Legos is cool man
um
uh yeah that's that's uh yeah you want
to say you can sit no you can't sit on
that side no no no no that's what I'm
gonna draw the line you gotta sit on
this side
um
now I'm watching Instagram real estate
they got me exerted on Instagram on my
phone
um maybe maybe I would like uh tiktok
should we go Tick Tock should we tick
tock
uh bro you really need to go I know
they're waiting for me all right we
gotta go thank you everybody uh I love
most of you uh some of you
Good morning everybody.
Good morning. Check out my small mouse.
It's a small mouse.
The rack is gone. There's no more rack.
It went to uh the Tiny Corp office.
And while we wait for some people to get
in here, we are going to order Dunkin
Donuts. We're going to get a nice ass,
you know, a cold brew. Man, we're going
to get a We're going to get a cold brew.
I switched also. I'm now a full-time
Android user. I use my folding phone
here. I love this phone. It's a uh ZFold
5. Whatever you do, do not buy a OnePlus
open piece of shit. But you can buy a
Zfold 5. And it's uh I miss iMessage,
but otherwise there's nothing I miss
from my phone. So, we're going to order
some Dunkin Donuts.
Uh let's get a classic donut over here.
Vanilla cream powdered oldfashioned
glazed blueberry chocolate frosted. I
want a vanilla frosted.
Can I get a vanilla frosted?
Strawberry frosted with sprinkles. All
right, we'll settle.
I want chocolate frosted.
Glazed chocolate. Boston cream.
All right. All right. Vanilla cream.
Now, that sounds like a lot of work. All
right. All right, we'll settle for a
strawberry frosted with sprinkles. What
do you think? Strawberry froster with
sprinkles.
Uh,
and what we really want is a large ass
fucking cold brew. Let's go. Where is
it? Oh, yeah. Yeah, yeah, yeah. Large
cold brew with some some whole milk.
Thank you. Ordered before. I'm not
ordering a sausage, egg, and cheese
because they taste like chemicals. And
the donuts taste like chemicals, too.
But, you know, water or bagel.
Okay. When does my food get here?
Where's my food at? No. No. No. I don't
want any Landinis pizzeria.
Add 338 to save with Uber 1. No, we
can't make that happen. We can't buy
more Dunkin Donuts. All right. Uh, show
up at my house.
Uh,
strawberry frost with sprinkles. Large
cold brew toasted bagel. All right,
let's go.
Love this. Love this phone. Love this.
This this it's a large. It's a large
folding phone.
Um
I've also been reading a great book
lately. Uh so we'll do some we'll do
this. This is this is Hot Recommends.
Uh it's called A Brief History of
Intelligence.
um like twothirds of the way through
it's uh
it's really it's really well done just
talking about the tracing the roots of
biological intelligence and comparing it
to ML stuff. Um you know we're closer
than we think.
So that is cool.
Uh yeah we got cold brew and a donut
coming. Uh oh let's turn some lights on.
I got these lights are a little colder.
I got a new bulb and for some reason it
has a different color temperature. So
hopefully everyone's
cool with that. If you're not cool with
that, you can write a letter to
Georgestream sucksass@gmail.com
and no one's going to respond to you,
but you can feel better. And that's the
point of customer service anyway, right?
Oh man, this hell of bright. Okay.
Um,
you're putting some weight on, but do I
look Do I look fat? [snorts]
Uh,
it's the lighting. Yeah, probably.
Uh, I didn't get nominated for the
streamer awards.
Hey, what's up?
Um,
what else? Oh, yes. Yes. The other thing
that if you guys have not seen
Skippidity Toilet, this is this is the
most revolutionary television show I've
seen.
[music and singing]
But be before you think it's just toilet
humor,
it's it's a deep story about a war
between two groups of people. Look, it's
famous, guys. It's famous. [music]
So,
uh, check out check out Skiib Toilet.
Uh, no, I swear to you guys, it's
famous. Like, this isn't some obscure
bullshit. Look, this random remix Astro
toilet killed DJ has four million views.
Um, now Generation Alpha Man, we're
skipping right over the zoomers. I don't
know what Slender Man is. They always
talk about Slender Man. I never heard of
the guy, but Skippy Toilet. I know
what's up. Um,
All
[music]
[music]
right. All right. Uh, Skippy toilet. Uh,
it's not going to be a long stream
today. I got I got things to do uh later
today. So, we're not going to stream
that long. Uh, if you came here for a
long stream, uh, I'm I'm sorry, but it
won't be uh long.
Oh, the Oh, what happened after last
week's stream with the Cashbug? Uh,
yeah, I'll show you what I ended up
doing. So, I finished this. I ended up
doing
uh I wrote these. I found this magic
thing. Hipstream write value 32 and
hipstream weight value 32. uh whatever
that is, it happens to synchronize the
cache. So, it turned out to not be that
big of a deal after I went through a
whole lot of various junk like you can
actually allocate uncashed things. So, I
added support for that. Um
yeah, no, the uh the cart went to the
tiny corp.
Um,
scary toilet, man. All right. Uh, so
what are we doing today? These lights
make me look fat, guys. I It's It's It's
like a It's bright. Uh, it's light
white.
Am
I still a Christian? Yeah, man.
Christian forever, man. Christian till
we die.
Uh, all right. Wait. So, why am I
listening to you? You guys aren't
subscribers. I'm going to turn on
subscriber only chat. This light's too
bright. I agree. We don't need lights.
No lights.
No lights.
Let's move that over there. Oh, I also
got a new keyboard coming. I I bought
the I bought the hybrid type S happy
hacker keyboard. So, uh we'll see. Maybe
that'll arrive during stream.
Okay,
so
we have this thing called the linearizer
and it's confusing and impossible to
read.
And
maybe we'll just start by creating
linearizer 2.
So
the linearizer is called from device in
here linearizer it does some
optimizations blah blah blah blah blah
and then you linearize
and this is only if beam search is on
without beam search this just returns K
and you linearize and then it has an a
and name and uops so I don't know let's
just try linearizer
class linearizer
and we'll get into what the linearizer
is uh as we work. So we can start just a
simple test here. Just some addition.
We'll just do a forward only pass.
Um
test ad actually runs three kernels.
That's a crazy amount of kernels. I just
want something that runs one kernel.
Test add three runs one kernel, but it
adds three things together. So maybe
that's fine. Okay, cool. Uh so you can
see it's doing three copies in and then
it's actually running the kernel. Uh if
we run with debug equals 4, we can have
it actually print the uh the code. This
is the code that actually runs here.
It's wow, it includes that in every
kernel, even if I'm not using WHM. Okay,
we need to fix that.
Um
and then with debug equals 5 you can see
it print the u ops and the uops actually
are the output of the linearizer.
Uh so we can do like graph u ops equals
and then
should print where it saved thanks to
net u svg.
Okay.
So now the linearizer turns
uh this
which is a lazy op into
these things called uops. So you can see
this is add three. It's adding three
things together. It's loading here from
data one and data two. Uh it then adds
them. It loads from data three. It also
adds that one. And then it uh it stores
the uh output. This here computes the
address. You can see the same address is
used for all four things. So it's using
the global index and it's using the
local index.
Um you can see that also reflected here.
That's what this three means and that's
what that 975 means.
Yeah.
So
what does a new linearizer look like?
We can first take in the two parameters
that it has which are lazy and ops
very boring boilerplate Python.
And let's go over to device. Instead of
importing linearizer
down here,
we'll import from linearizer 2.
Okay. Linearizer has no attribute
required optimizations. So it calls a
function here called required
optimizations. We'll just make that
fake.
Uh apply tensor cores.
are not supported.
So the linearizer right now is
conflating a whole bunch of functions
and that's annoying. It's conflating
basically this this optimization
with uh
with the linearization and the new
linearizer is going to deconlate these
ideas.
Linearizer object has no attribute
handcoded optimization. So we're going
to need that one as well.
So these optimizations probably should
not exist on the linearizer at all. And
then linearize is the magic function
that actually does things.
Now it's going to bitch and be like, I
you don't have uops or a name. Okay.
Well, our name can be Billy because you
can just name everything Billy. That's
fine. Uh now we need UOPS. Okay. Um so
we can do a first and empty UOPS.
Uh oh, we need to do global size and
local size. Wow, this thing actually
does a lot.
Um,
yeah. So, this also gets the global size
and local size for the kernels.
Okay. And that of course doesn't work.
The kernel is named Billy, but Billy is
just empty because the UOPS are empty.
So, this is actually the code lives
here.
Um and we'll get to what UOPS are in a
minute.
So
um the first thing that we have to do is
uh top of sort. So I have a function
here called print tree. Um I'm not going
to do any debug. I'm just going to run
that. Um and it just fails. But we can
call print tree
on the a.
And this is the a load load add. So
right now the linearizer is this is open
source. You can read it. It's called
tiny. If you don't know what tiny is,
you haven't been watching the stream
very long. Um and it's uh convoluted
garbage. This thing is called kernel. It
really doesn't have anything to do with
well it kind of has to do with kernels
but this is mostly where the
optimizations live. You can do all sorts
of optimizations on the kernels but
there really are two types of
optimizations. There's optimizations
that affect shape trackers and then
there's optimizations like group for
reduce which are changing the uh which
are changing the actual structure of the
uh
of the of the ops. So the thing that I
want to change is instead of this
convoluted stuff, let's first linearize
these ops and by linearize. Okay, so
what linearization actually means is
these ops exist in a graph. We can see
that graph with graph equals 1
uh not uops but if I just get rid of
uops here we can look at the graph.
Okay, so this is the graph. Um, it does
some synchronization, some copies, but
don't worry about any of that. The
important thing here is add. Uh,
actually, I need to fix There should be
one more thing in here that's just not
there. Um,
it's the thing with the fish.
So, this is uh add. You can see that
this one has a dashed line because it's
being fused in with this operation. And
this operation actually has a uh a
kernel. Uh so kernel 1 2 3 4. If we run
this with debug equals 2, we can
actually see those kernels. So 1 2 3 4.
But of course, the Billy kernel is
broken right now because we're not
actually respecting what's supposed to
be in it. And what's supposed to be in
it is these adds and loads. So first
thing we have to do is write a
topological sort. Now I think I've
already written this 37 times. So let's
find the best one we can copy.
So lazy.py is what's responsible for
generating
um these things. These are called lazy
ops.
Uh and we need to we need to linearize
it.
So it might just be a stupid here. We
can bring up the type definition here of
a lazy op. Um,
turn list lazy up.
I love types. Types are so nice.
Uh, okay.
if as source
I don't even need to uh linearize lazy
opt
just call it x
uh for x in
so I want to do flatten
for x insource
plus Cool. This should just kind of
work. Let's see if this works.
I can say something like for Owen Ops
print out. Let's see what it does.
Can only concatenate list not lazy opted
list. Well, yeah, do that.
Okay, seems pretty good, I think.
Uh,
so that does look like a lot of things.
Um, you know what? Let's just print. The
problem is we're recursively printing
this stuff and it's kind of confusing
looking. So let's just print the op.
Okay, so we're doing two loads, an ad, a
load, an ad, and a store. Okay, that
looks pretty good, right? So those are
the Does everyone understand why that
represents ad three?
Does anyone pay any attention to
anything I say? Does everyone understand
this? You can actually follow this.
Unless you're an absolute idiot, you can
actually follow this, right?
So good, good, good, good. Um, so we're
adding three tensors together that are
45 by 65. Where's my food at?
Okay,
we're on stream, Alex.
It's okay. You're always welcome on
stream, but I just want to warn you.
Yeah, well, if you're not stream
appropriate, then then it's not time.
Then you shouldn't be on stream, bro.
Bro, this is the greatest phone ever,
bros. Okay, except that I don't have
iMessage anymore. It's the greatest
phone ever.
All right, look.
So, it prints the ops. Load, load, add,
load, add, store.
Uh, now we need to turn those ops into U
ops.
So, if you remember what the UO ops are
supposed to look like for this,
they look like this. Oh, this is so much
work, boys.
This is legitimately so much work. I
don't know if we can do this.
God, linear eyes are so good.
The linearizer does so much.
Like it has to transform like that into
this. That's so much work.
Uh I can just throw the old linearizer
back in for a minute just so we can see.
what it should actually look like.
Wow, your eyes are just so much.
Can it be decomposed anymore? A per DT
type linearizer?
No.
Wow, the linearizer is actually great
code. Never mind. Like this is how I
this is how I feel whenever I want to
like rewrite stuff in Tiny. I'm like,
"Oh, it'll be so easy. I'll just I'll
just rewrite it and it'll be like
simple." But it's never simple. And
Okay. Well, let's also print the uh
let's print the argument.
So, we can see the mem buffer is being
created.
So, there's a whole another thing that
needs to basically manage the shape
trackers. These shape trackers are where
those shapes come from
that determines how we're going to index
into this garbage.
The idea is always to simplify things,
but whether we're actually going to
simplify things, that's an open
question.
So yeah, I mean, we have to convert
the ads are really easy.
This is so much work.
Then sometime these things get upcasted
to float four.
Where my cold brew at?
It's going to be here soon. Okay. Well,
at least that's happening.
Yeah, that top of swords just the
linearizer does so much.
Oh, this is going to be this is weeks of
work. Never mind. I thought we were
going to make some progress on this on
stream. There's just no way. Like, this
is some of the densest, most garbage
code in Tinyrad.
This is the last thing in Tiny Guard
that like hasn't been refactored to to
be a modern style.
Lazy is pretty good except for this.
This is this is the only junk left in
Lazy, but otherwise like all of this is
really tight. Uh MLOps super tight.
Tensor's tight.
Uh realize is realize is pretty tight. I
added some new crap in to deal with
synchronization stuff. There's some
minor cleanups to do there. Um, JIT's
pretty tight, though. This stuff can be
replaced when you have a memory.
A graph is super tight.
The shape stuff is kind of eh. Um, the
run times are quite good now. The
renderers are pretty good.
Uh, search is kind of meh. Multi is the
new hotness. Multi is pretty good.
Um, the last thing in Tiny Guide that's
kind of crappy is the linearizer.
And why is the linearizer crappy? Okay,
does everyone understand what the
linearizer does? Does everyone
understand the difference between this
and this?
So, this is actually the code for for
kernel 4.
But in like a style that can be rendered
in in C.
What is a linearizer? Well, so you can't
actually run graphs on processors. Uh
you need to convert it into a linear
list of code.
So there there's an order uh which
machines actually do things and that's
what the linearizer kind of decides on.
But see, then there's all this like cute
little subtlety here, which is like, do
you want to do the loads and then an ad
and then another load or do you want to
do all three loads and then both ads?
No. No, that's not right. The the UOPS
operate on scalers and the lazy ops
operate on vectors
is is the simplest way to think about
it.
Um, but currently we don't do any
linearization of the lazy ops. So when
you have a when you have a graph, when
you have an a. Um, okay. Does anyone
know what an a is? I'm going to go to is
this is this compilers 101? My where's
my culpr?
Yeah. [screaming]
I can't believe you. Did you ask me what
I wanted?
I asked you what you wanted yesterday.
You said you didn't want anything.
Is it donuts?
Uh, yeah.
It's a big cold fruit.
Sure.
Love it.
Um, and then the memory load ordering
can go to platform support. Hell. Yeah,
I mean, okay. So, the the top of sword
is obviously not unique. Um,
so here we can clean this up a little.
What I really want to do is for so lazy
ops have inputs
uh called source. So we can say like uh
ops.index
x or x in us
dot
source and then we can enumerate that
and then we can print that.
Here we go. So you see this has source
zero and one. This has source two and
three, but these ones without sources
could technically all go at the top.
This has source four. Does this stuff
make sense to people?
Um,
I don't know what you want me to draw on
the whiteboard, right? Like I don't know
what you want me to draw on the
whiteboard that you can't see in this
graph.
So, the idea of the new linearizer is to
first transform
uh
like to first transform the ops
into a line and then to deal with
rendering the ops. But
what are you here for?
It's not here yet.
It's here.
You have to give Brian a moment to drop
off your order. You'll get an alert when
it's there. This thing just lies to me
all the time, though.
I feel like like
um does the order of operations affect
performance sometimes? But again, I'm
not even worried about performance. I'm
worried about correctness. So, one of
the reasons that the linearizer has to
be rewritten
is I want to support kernels that can
store more than one thing. Right now, a
kernel and a lazy op is defined to only
have one output. Um but often you don't
want this. Often you want to make like a
think about the topology difference
between one two center two and one two
center one. Right? So usually have one
output and multiple inputs.
Um
is that my food?
Oh, great. It's here.
It's here.
I haven't had it yet. [laughter]
I haven't had any yet.
The hell is this? How am I supposed to
put a straw through this?
It's for your sanitation.
I I understand that everyone's scared of
them putting fentanyl in the Uber Eats,
but like
on the Uber Eats.
You're welcome.
You can Door Dash Narcan. That's
actually pretty useful. All right, let's
see how sad this bagel looks. Very sad.
Tastes like chemical.
Okay.
So there's like two parts of this whole
thing.
Maybe TVM has a smart way of thinking
about this.
So you see these buffer loads, they have
this shape tracker. It's because the
buffer has a shape. And then one of the
things you have to deal with is how you
want to how you want to assign
uh
like like
maybe a way to say it is what order you
want to iterate over the
the buffers.
So you can see here
that this is assigned to a global ID and
a local ID.
That's a local ID. That's a global ID.
I'll go into the loads.
Sometime it makes loops.
So here I'll show you what it looks like
if we uh
if we use clang.
So this is a GPU. So GPUs have global
ids and local IDs. But if I use
something like clang
um
here so you can see it looks different.
So it's just a loop to 2925 which is 45
* 65.
Um,
does this stuff make sense to people? I
mean, half the reason I'm doing this
stream today is to explain to everyone
like how this thing works.
Maybe we should read up on some real
compiler terminology.
How do compilers work?
This does not look very good.
Oh, not worth it.
Oh, this is probably a much quicker way
than the n squ concatenation of lists
I'm doing.
Um, we also didn't do depth first. Our
thing is a bit more breath first.
Is Chris Chris Latner, are you are you
out there right now? Someone someone DM
him. See if he wants to come explain
this shit to me. [laughter]
Um
yeah, so the linearizer is conflating a
bunch of concerns
on Think about the Skippy toilets one,
guys.
And this one isn't even upcasting to
float four,
which is another fancy thing the
linearizer can do.
No, that's actually not that
complicated. that that's
the UOP architecture makes it a lot
easier to upcast things. Now,
so
we have a whole bunch of different
colored dimensions that I talk about in
kernel.
There's eight chunks of the shape.
Global dims, local dims, reduce local
dims, reduce late upcasted dims, reduce
loops, reduce upcasted normal upcast
dimensions.
Wouldn't a shape be like a type? I mean,
yeah. So,
um, like in a way, tiny is like
dependently typed.
Um, I mean, yeah, a shape is a type.
That's fine.
But that doesn't help you.
Maybe TVM might have some good jobs on
this.
Sorry, this has turned into a research
stream, you know.
Um, I worked for I worked for Optimism
and uh Carl quoted my my my thing. I'm
like, you know, how do you write how do
you write how do you write uh code?
Well, first you think about what you
want to write and then you write it. But
you got to do the thinking about what
you want to write part because if you
just write it, it's it's not uh it's not
very good.
So, see if we can find where this is in
TVM.
TVM has thought about a lot of this
stuff pretty well. Do I still have my
TVM example in here?
Does TDM run on my Mac?
have to install TVM.
There's no way that works.
PT.
Great.
See right here? This is why Tiny Grad's
winning.
This is why Tiny Grad wins.
Oh, it's going to take seven years to
clone.
Yeah, but we have to learn how to code
better. We can't just throw things at
the wall and see what sticks anymore.
Okay.
Using a low-level TVM AI directly, the
example is vector addition, which is
covered in detail in working with
operations using tensor expressions.
Find two placeholder tensors blah blah
blah blah blah. We don't have any of
that included default schedule.
So they call they call this scheduling
which is interesting because we call
scheduling something else.
I mean, okay. So, I guess we have a
thing in Tiny Red called scheduling, but
it's like one level higher than this.
Oh, thank you for cloning the world.
Parallel.
So, we have similar concepts to this,
but they're called different things.
Um, the best way to look at them here is
our optops.
Why doesn't this work?
Okay.
about precedents
and it felt a little bit annoying. So I
said, "Hey, let me just go back and see
what I can do about the precedent
situation. Can I do it what I said was
the first best way? And can I do it as
cleanly as possible? And can I really
understand it clearly? Because part of
the problem is part of the reason I
didn't do it that way in the first place
way back when I started the compiler was
I would go read some of these references
and they're like really hard to
understand and you know I don't exactly
see how this relates to what I'm really
trying to do and all this and we'll
we'll go through some of those
references but the point being um last
week I think it was Saturday one week
ago today uh I just rewrote the way
precedence works in parser. Um, and got
rid of all the rewriting and it's uh it
works great.
Oh, they're just getting warm now. Okay.
I think this is not the same thing. So,
they're talking about like um like
operator precedence like multiply takes
precedence over add.
Um, I'm not worried about that. Python
actually deals with all that for me.
PEMDAS, is that like pedac?
Oh, not that. I remember that.
Okay.
But I mean, this is good. TBM is really
good at helping me like think about how
to structure these things.
Um, the guy who wrote TVM is also the
guy who wrote MXNet.
I'm also less worried about reading
things now. Okay, so this is a cooler
way, I think, to talk about it. I I I
want to copy this.
They can bind axes to GPU variables.
In Tiny, it's kind of implicit.
Tiny needs documentation like this.
Well, you know, chop chop.
Okay, now what the hell do I do?
Of course, that doesn't work.
The Python package is located at TVM
Python.
Maybe that'll just work.
Do you want to write uh tiny guard
documentation that looks like this?
Oh, here we go. Good. We got the TVM
output.
Cool.
Yeah. Now we can play with the
schedules. Great.
Yeah. Okay. So that the source is less
interesting than just the lowered thing
here. Here
cse var 2.
Who knows what cse stands for?
No, that that's not what it stands for.
Do any nonsubscribers know?
So, I used to be more worried about
reading other documentation because it
would like pollute my way of thinking
about it.
Computer science and engineering
coma separated values.
Are you kidding? You think you're going
to write the documentation?
Come on. There has to be someone in here
who knows what cse stands for.
Otherwise, common sub expression
elimination. Thank you.
So, it's interesting. It looks like they
do this all at kind of like a Python
level.
What does bed mass stand for?
I don't know about that.
All right. All right. Donuts are not bad
for you. I don't know who said that.
Now you get subscriber only.
Donuts are great food. Remember CTFs?
Coffee and donuts, man.
You know what's bad for you? Not
thinking.
Okay. So, let's try these schedule
things.
te create schedule. Let's see. S C
um dot Oh, I have to split. Oh, this is
cool.
So, we vectorize the end. Let's try a
four vectorzation.
T broadcast. Oh, that's cool.
So, does everyone kind of see what this
did?
Parallelize. Does it do anything?
Oh, okay.
I I I mean, I like in some ways they do
this much better. They like assign axes
to bind
You know, it's so interesting that they
can
what if I change that to a
it's not a part of the schedule. Okay.
Look at
Wow.
See, and then it looks like a convoluted
mess.
What's TVM?
Uh, TVM has
So, TVM is a competing library to Tiny
Grad. Um I feel it has some very good
uh
things are well thought through in it.
I I did some examples and like that's
why how I ended up rewriting the whole
schedule API in tiny. The schedule API
now is really good.
Um schedule takes your TV I believe
calls it relay. schedule takes your
entire uh huge graph of a neural net and
decides how to break it into uh kernels
or separate functions that run on the
GPL. It handles like uh fusion and stuff
and then the linearizer handles what
they call scheduling.
We have we also have a search thing as
well [cough and clears throat]
that searches over our
space.
Do I have a Jira board? What the hell is
a Jira board?
I've never used Jira in my life.
I heard that it makes companies
terrible.
When people talk about what they hate,
Jira commonly comes up. So why would I
want that?
No, like Jira, I kind of think I mean
there's something to be said for some
sort of project management, but I think
that a lot of project management exists
because
like
um almost it almost it's a lot of it's
like make work.
Like I if you can't keep the schedule of
a project
basically in your head then your project
is like too complex.
It's interesting
like I I do wonder a lot about
you you look at some of these things and
they are insanely complex for something
that's actually quite simple to express
had someone really thought about it. But
once you put something into Jira, it
becomes well thing. Right? Now we have a
team and now we're gonna have a thing.
And now we're gonna have 100,000 lines
of code where we should have had 10. But
well, there's all the Jira tickets and I
can drag them from here to here.
Um,
so no, we don't use Jira. Uh, we don't
use project management. We use people.
you you have you have people and you
have hierarchy and if you have that you
shouldn't need project management
those people individually can decide how
they want to uh how they want to parse
work out when they want deadlines in and
they individually can use project
management but this idea of a project
management that exceeds the scope of the
individual
again yes if you are a large corporation
and you I don't Well,
you end up at a different point in the
optimization space if you put the
project management software and the
people below it versus the people above
it and like each individual has their
own uh you know project management.
Uh so no, we don't have a jury board.
Yeah, I mean you can watch out for the
metrics you want to track, but I I think
the whole Let's I I've never really
looked. What is a Jira board? Let's look
at some pictures.
Yeah, it's like this kind of crap. Yeah.
Oh, burndowns and tickets. I I've seen
people develop software using these and
it's like
they they end up with software that
like like so many of the things just
shouldn't be things.
And
when you add software to manage
complexity, you're going to get more
complexity. I hope that's intuitive.
I if you if you as your ability to deal
with complexity increases, you're going
to get more complexity. Um the the
problem is you're not often factoring in
the long-term costs of that complexity.
Yeah. You get you get work signaling,
look, I can drag them into approved or
in review or whatever.
I don't know. Like at Tiny Corp, um we
write on the board what we're going to
do is we kind of do half the things.
Does the board really help aside from
the list in your head? Maybe a little
bit.
Um again, it's also it's not the tools
that are bad, right? A properly managed
board is definitely better than having
nothing. But what in general I've seen
these things do is let a lot of mediocre
people think that they're doing
something and they're really not. and
you end up with blow and complexity.
So yeah. Uh no, Tiny Dra does not have
anything like that because it's it's not
about
very often like
I if if
the ideas in Tiny are expressed pretty
well, but someone smarter than me could
express them even better.
So we're just looking for what the
absolute cleanest expression of these
ideas is. And some of the places express
the ideas in like I think you know you
know the idea of the book
right proofs from the book.
The book is where God keeps the most
elegant proof of each mathematical
theorem. I want I want to write I want
to write the deep learning library from
the book.
Um what are scrum and agile you guys?
You guys like love this stuff.
Yeah, like we have sprints at they
turned out to be kind of useless.
Like we have them
supposedly every two weeks. People like
put in what their sprint goals are. I I
haven't seen this stuff be like useful.
What's agile
uh
incremental iterative approach to
delivering a project throughout its life
cycle? Oh, as contrasted to like
waterfall.
Yeah.
I I don't there are ceremonies and
grooming. Yeah, sounds like some ped
shit, bro.
Um
like like
I I guess I guess these things can kind
of help with some like so you can't get
more work out of people. Uh you you can
only basically decide prioritization.
you can decide what's a high priority
and what's a low priority. You're never
going to be able to get more done. Maybe
these things help you make decisions
like when something's a sunk cost
better. I'm trying to think of what like
the goal of all this stuff is. Um you
know, often often companies struggle
with like, okay, when do we actually cut
a project? When do we, you know, I
expected this to take two weeks, we're
six weeks in and it doesn't look like
it's going to be done. I don't know.
I think also this stuff kind of works
for
if I had to build like the app for the
Obama campaign. Sure. This is this is
the kind of methodology you want to use,
right? If you're building something
that's been tread over a million times
before and you're practically below the
API line, uh but if you're above the API
line, if you're if you're trying to like
make something new,
I don't think this stuff works.
Uh I I I've started to come around to
think that comm is going to be Tesla and
self-driving cars.
And I mean Tesla's make a lot of
mistakes right now.
They are not
focused on like
adding value tomorrow.
I hear I hear autopilot's terrible now
with all the wheel nags. Like you know
we we we focused on stuff like
navigation, the Taco Bell drive.
Honestly, it was all probably pretty
dumb. What we should have focused on is
how do we make something on the highway
that just never makes mistakes. Like,
why does it make mistakes? Fix the
mistakes.
Am I serious? What is this? What is this
YouTube link?
Uh oh. Am I serious that we're going to
be Tesla? Yeah. Yeah, I'm serious that
we're going to be Tesla.
Um,
I mean again,
yeah, I don't see them.
Am I serious that V12 is bad? Well, what
[snorts] V12 is, I mean, comma shipped
this for lateral. We haven't shipped it
for longitudinal yet. But what V12 is,
is they moved the uh planner into the
back end and then trained the neural
network on the planner. like we call it
NLP and and uh and comma stuff. It's not
a solution.
Um who can't remember conversations with
two weeks ago can help maintain shared
context. Yeah, maybe the the alternative
the alternative uh like statement of
that is saying maybe you don't want to
remember the shared context. Maybe
rehows
for a refinement.
uh that just putting the stuff down on a
board wouldn't. It's a tradeoff.
Uh
I'm not saying that the trade-off of not
using it is right. I'm saying that by
using it, I hope you understand what
you're trading off. And it seems like a
lot of people don't.
All right. So, I don't know how we ended
up on this crap. Uh, but if someone
wants to write documentation that looks
like this, I'd be very happy.
Um, it doesn't even have to be like like
like official
uh documentation, just some like tiny
grad tutorials that dive into the the
low-level stuff. You'll learn a lot
doing it, too.
[cough]
So they bind things to axes.
It's probably a smarter way to do it.
A lot of these systems are designed
around when the project fails, who do we
blame? Yeah, who the fuck cares, man?
Like if if if that's if that's where
your company is,
you have way deeper problems.
Like
I don't know. I you know, it was so it
was so confusing to me.
Uh
first, you know, I was going to work for
Elon to make autopilot. I had two
meetings with him and
The thing about Elon and Elon's
companies is you have kind of a
hierarchy of competence.
Like
you can talk to Elon about anything and
he may not know the low-level details of
everything, but that doesn't really
matter. He understands everything at
enough of a level that he can say,
"Okay, we're going to like do this or
not do this or this is a bad idea." and
then he can point you to the person and
like as you go down the hierarchy you
fill in the details. Um it seems like
other corporations don't work this way.
It's very confusing to me uh how they do
work if they work at all. Maybe we've
just put ourselves into a a completely
dysfunctional place uh where you don't
have the people at the top really
understanding anything. You think they
have some like other generic skill
called management. And everything I've
tried to read about management shows
that
it doesn't exist. There is no such
thing. There is no generic such skill as
management. The concept of a
non-technical project manager makes no
sense at all. Um
so yeah, I don't know. I don't know how
we all like fell for this.
Maybe it hearkens back to a world where
you could have like where this stuff was
understandable.
I if you're if you're like building a
building, a normal person can
understand, well, you're going to have
to build the bottom floor before you
build the fifth floor. And we can figure
out maybe like what day we're going to
be on which floor. And a normal person
can figure that out. But when you get
into software development,
a normal person has no conception of
what the first floor is and what the
fifth floor is. In fact, a lot of
software engineers don't really
understand this. It's just it's just a
much more nebulous maybe a much more
like uh it's it's a much newer field. We
we don't really have very good science
for talking about how to build software.
Um,
all the project managers I had stopped
programming. Yeah. I mean,
[sighs]
it doesn't like I I guess you don't
necessarily have to be programming every
day, but you have to be like a better
programmer than the people you manage.
If you're not a better programmer than
the people you manage, how do you manage
them?
or maybe not even a better programmer.
If you're not capable of doing the work
of the people you manage, how do you
possibly manage them?
I don't get that. And this isn't the
kind of thing where sure, you know,
look, I've managed some people who are
faster than me, who can get things done
faster than me, but whatever it is
they're doing, I can do it.
And
the idea of a nontechnical like program
manager, it's like you could give this
person this task and they will never
ever be able to do it.
So why should they manage it?
Yeah, you have senior engineers lead and
there there definitely is a a difference
in
something interesting I get uh I get
asked a lot is like you know does comma
hire junior engineers or do do would
tiny hire junior engineers and the
answer is of course he would absolutely
I'm happy to hire junior engineers but
you may not understand what junior
engineer means.
Um,
everyone I've met who's like in their
early 20s, they can't really write
software well. Like I couldn't write
software well. No one can really write
software well in their early 20s. But
and they're junior engineers
but but they're junior engineers who
will become senior engineers. They're
junior engineers who their limitations
are not their knowledge about computers,
their knowledge about algorithms. In
general, most of these people have like
better knowledge about computers and
algorithms than uh people more senior.
And those are the kind of junior
engineers I would hire. Right? Being a
junior engineer doesn't mean that you're
going to get an education in any like
concrete subject. Being a junior
engineer just means that well, you know,
you haven't why types are important yet.
You will understand why types are
important once you grow your own code
base to thousands of lines and are like,
"Okay, I can't keep track of this
anymore." Or understanding why
commenting is good or understanding why
you need to factoriize things nicely or
understanding why testing is important.
You you just you need to like learn
these lessons the hard way and you only
learn these lessons through 10 years of
experience software engineering. Uh but
that doesn't mean that like
a junior engineer is not an excuse to
not know things. Junior engineer is just
not an like it's an excuse to not have
like applied something and learned a
whole set of lessons the hard way.
Um so yeah and this is generally why why
uh you know it's the junior engineer
who's like well I could rewrite that in
a week and you know what they probably
can and those are the exact junior
engineers I would hire you have a
certain enthusiasm and then it's the
more senior engineer who's like well you
know what I believe you could rewrite it
in a week but you know here are the edge
cases that you're going to run into and
here is what it's going to take to
maintain this and even though it's more
annoying you're probably going to want
to use this now because it'll pay
dividends in the future. Blah blah blah
blah blah blah blah. Um, yeah.
You had a smart technical PM who also
micromanaged. What do you mean by
micromanaged?
What do you call micromanagement?
And I guess this is this is kind of
related to the stream wanting to control
the code you wrote. Well, what do you
mean by control
type inference? What do you mean by
that?
Uh
Yeah, I think so.
I mean, doesn't really do it at compile
time. I'm not sure. I'm not sure CPython
does. You can use like my Pi C and it'll
do that.
Uh,
well, no. I mean, type hints aren't type
inference. I don't think it actually
does anything like inference. I think it
just it has like a like a specializing
jet. So, so if a JIT Oh, it doesn't even
have a JIT actually.
I don't know. Maybe Python just doesn't
have anything like this.
So, so normally JITs will um specialize
you if it sees a function called like
five times with the same types, it'll
specialize to those types and then if it
gets hit with a different type, it'll
like you know recompile with those
types. Um are junior engineers going to
be useful though? Yes, very much so. Uh,
but the the problem is like junior
engineer is not and I'll use IQ, right?
Like junior engineer is not 110 IQ,
right? You know, it's just 110 IQ.
You're probably not going to really be a
great programmer. Uh, wow. Wow. Wow.
That's so taboo. How could you possibly
say that? That's just true. Um, junior
engineer is is is 140 IQ, but you know,
again, you haven't had years of
experience learning a set of lessons
that that
again, you can teach them and you can
say them, but until you've struggled
with them yourselves, you never you
never really internalize them.
It's not even necessarily an age thing,
right? You could imagine somebody gets
into programming at 35, you know, they
did some other they did like, you know,
physics experiments for the first for
the first uh, you know, 15 years of
their career. Yeah. I mean, they're
going to be a junior engineer, but they
still may end up being very good. So,
it's not really an age thing. It's an
experience thing, but it's not an
intelligent thing. you will intelligence
thing you will not become more
intelligent. uh you will yeah learn
lessons to harbor
you know I feel bad I feel bad for the
people who aren't like told this who who
aren't
I don't know maybe people figure it out
but I can remember a few people who just
retaking classes multiple times thinking
that it would eventually like click but
if you're just if you
get certain things. If you don't
understand certain ways of thinking, you
kind of never will.
A genius who happens to like software
engineering very often is a is a is a
junior engineer.
All right. I don't know. How did we end
up on this? How did we end up on this
stupid tangent?
We always end up on this stupid tangent.
Why do you guys love this stuff so much?
You don't agree with what?
You're overestimating the average in of
junior engineers. What's that?
Oh, the average IQ of junior engineers.
I mean, what do you mean? Again, there's
the ones I'd hire and there's the ones I
wouldn't hire, right? The ones I would
hire are the people who
I did uh competition programming in
college and it's interesting how some of
the best people at this stuff were high
schoolers like seniors in high school
who just had just learned all this stuff
and just remembered it and could just
like apply the algorithm. They were the
best at it. Um and those are the kind of
junior engineers who I want to hire.
They're not software engineers and it
will take them quite a while to become
software engineers.
But you know at a good sort of place
that's where you that's where you learn
this kind of stuff. I learned like I
learned the stuff and Google really
taught me how to be like a software
engineer.
You know, again, I still have uh
I still have a lot to learn, too. It's
not
uh Well, yeah, because Okay, I
understand why most IQ things get
moderated because like people go off on
like the stupidest tangents about it.
Um
well, there is also like
there is also like two kinds of almost
personality types. Um,
and there's things that I'm not good at
because of it. There's like I'm kind of
like a spam programmer. Like you see me
just like try things a lot. I've been
trying to change this, but it's hard to
turn to change. And then there's the
type who works very slowly but does a
very good job with everything they do.
Has thought through all the edge cases
and yeah um you know those people are uh
you don't get as much total output out
of them but they're a very valuable
addition to any team because you can put
them on a project. The project will take
four times longer than it might take
with another person but you're more
confident it won't be wrong.
I'm procrastinating doing this. So, the
linearizer basically needs to be
separated into two things. The the code
gen and the scheduler. Um it seems like
TVM does a good job of separating these
things.
So they have this function create
schedule and then they have this
function lower
and then lower. Lower is like this is
this is UOOPS.
This is renderer.
It's still not exactly UOPS.
Maybe it is. Oh, maybe it is. No, it is
UOPS. Yeah, this is UOPS.
three projects they learned a lot from.
What? This is for TVM.
Oh.
You need to add support for the DSP.
confusing.
I found all I found a lot of these to be
very complex, seemingly needlessly so.
I mean, they aren't fast.
You know, a lot of this um Chris Latner
had a had a had a take on Tiny, which is
like, you know, George doesn't really
know about compilers. Um, and this is
true. I I don't. But
in many ways, the problem is much
simpler than being a compiler.
The you're you're very limited in the
kinds of programs that can be expressed
in Tiny. And because of this, you don't
need a lot of the very fancy stuff that
compilers do. Um,
and like even when I end up there's a
function here called U optimizer.
There's a there's a
well
uh like fixed loop scope and stuff like
this is probably at the wrong level and
it's probably because I didn't think
through the stuff correctly. I think if
I think through the stuff correctly at
the right level, I don't have to do this
and I can do these optimizations at a
higher level, which often when you're
dealing with turn complete code, you
can't.
All right. All right. All right. All
right. On topic, on topic.
You always end up with the same stupid
ass crap, man. Same like circle jerk.
Why do you click around? Why do I keep
my APM?
I'm curious what
do they call their thing that we call
schedule?
I mean, they might just call it
schedule. They might actually break
things apart at the schedule level.
On topic. on topic or we're gonna ban
everybody from chat
model has been ported for T uh relay
relay is functional language and
intermediate representation for neural
networks.
Relay applies graph level optimization
passes to optimize the model. So in tiny
that's in lazy and theuler is all down
here.
After applying a high level, relay runs
fuse opaths to partition the model into
many small subgraphs and lowers the
subgraphs to TE representation.
So we call that scheduling
and we don't have tensor expression as a
language. We have lazy op. Lazy up isn't
actually flexible enough. We have to
translate. We have to turn it into list
lazy up in order to deal with uh kernels
that have multiple outputs.
Okay. Search for the best schedule using
the autotuning module.
Yeah, I hate that what we call schedule
is not what they call schedule.
Common operators, their templates are
already provided in Topi. We have a big
junk function called handcoded
optimizations that basically does this.
Like here we handle Matt vec stuff
grouping.
This is stupid. This is another
um
so TVM looks awesome until you well you
saw me build TVM
um which was annoying
and then the code that TVM outputs is
very reverse.
TVM is is tiny grad. if you wanted to
increase the lines by a lot.
It's also not all in Python.
Um, they also do a bunch of things that
I wouldn't do like tensor operator
inventory. So they
TVM allows you to integrate things like
cudn
and by doing that you trade off a lot of
the simplicity. Something TV will never
be able to do is like what we do for
Multi.
It's a long bet. Leafy, you're going to
get banned. Leafy,
you're going to get banned.
loop transformations in line and
vectorization. We call these actions
scheduling primitives. So we call them
ops.
Mar colonel
unroll upcast no locals upcast mid group
top
they apply on axes as well but I guess
their stuff applies on axis too. What
actually are outer and inner
useless? us.
researchbased optimizations to handle
the initial
tier function generation problem or TDM
expand learning based transformations
into more areas. Is TM still being
developed?
It's like PR is as many lines as Tiny
Bad.
T passes.
So that's where the scheduleing happens.
I mean, TVM is an awesome project. They
were also going to uh build a like they
have a lot of the same ideas as Tiny
Grad. Um eventually I want to build this
too.
Like you build a
uh
a tensor accelerator that's designed to
work well with whatever your
intermediate representations are.
is a set of transformations of
computation that transforms a loop of
computations in the program.
I mean, I guess we have to write that
first.
So, yeah. I mean, Tiny Guard's really
gotten out of control with this junk.
Like,
applied ops is fine, but like group for
reduce, I mean, group for reduce should
not be something that exists in the
kernel. Group for reduce should change
the structure of the lazy app. should
change the structure of the lazy op to
basically include a local buffer and a
barrier uh and should be applied before
we do the linearization.
Then like the other concept is how we
flatten the axes.
So like the the
shape tracker stuff should all be dealt
with again before we linearize.
Linearizer needs to be broken up into
two things. what TVM calls a
scheduleuler. We need a name for it.
Um,
we need a name for it. Does anyone have
ideas?
Because we can't call it schedule
because we already have schedule.
Like schedule's actually included in uh
I think it's intensor.
Yeah, like you call this schedule here
and that schedules the uh the kernels.
Now linearizer is called lower. Lower is
a pretty generic term.
agenda. [laughter]
What does the schedule part do? Our
schedule does basically the same thing
that there's relay their relay does. Uh
it breaks it into multiple kernels, but
I think that schedule's way more like
like appropriate there.
Do I simple mode on? I do.
What does their scheduleuler do? Uh
well, their scheduler is like what we
call ops.
Um
it turns ops into u ops.
It makes these graphs out of the other
kind of graph
like like assigner is the right word. I
feel like when I get the name op
chopper, I like the thinking, but I
don't know about the op chopper.
Anything that's clever is always bad.
Like I want the most descriptive name
for what this thing is.
It's it's almost like a like it's a
mapper. like it maps uh high level like
tensors to
low-level operations.
Split, tile,
fuse, reorder, bind,
compute at
I don't have anything that looks like
that.
Are they pure functions? Yeah,
everything's a pure function.
The mapper
graph rewriter.
It's like a term from
Yeah.
It's not exactly what it is.
Like I've seen like graph like graph
rewrite rules are like this is the core
of like ml
operation handler.
All right we're going to take a five
minute break. Five minute break.
Everybody think about that and uh let me
know what you come up with.
We'll leave you one craft rewriter.
All right, boys. Look at
HHKB
professional
hybrid.
We can we can let the non-subscribers
talk about the uh the keyboard.
I don't really like that it has
batteries.
Ooh, them some nice ass keys, boy.
But I don't like that it has this like
battery back.
Oh, really? I got to put double A's in
this shit.
I got some double A's.
I don't like the double A's though. I'm
not happy about the whole double A
situation here.
If I couldn't have a rechargeable
battery.
HHKB professional hybrid.
By the way, I cleaned my keyboards. If
you follow me on Instagram,
you can see when I cleaned my keyboards.
The best name I could come up with was
blueprint.
Should we switch?
Is this one connected to
Let's
Oh,
the old one.
The new one with some type S to pre
switches.
No, it can't go any higher. The wires in
the way.
With some type S to pre switches, man.
Let's see how it sounds.
You can't even hear it. Wait. Except
no. Okay, we have to flip. Does this one
have dip switches?
Yeah, we have dip switches. Okay, we're
going to have to flip some dip switches.
We have to flip the dip switches on this
one to match this one.
Let me see what my dip switches on this
one say.
Switch two is flipped up. Assuming they
mean the same thing or the same number
of switches. We'll flip switch two up.
Okay, switch two is on.
See if it now behaves how I expect.
Can also connect this one over
Bluetooth, but I don't trust things that
don't have wires. Except this mouse.
Yeah. Oh, that's nice. Oh, boys.
It's quiet. Wait,
this is the nicest keyboard I've ever
used.
Okay, listen to the difference.
[snorts]
Wait, this is the nicest keyboard I've
ever used. Does anyone want to buy
HHKB2s? I think we're upgrading.
This is so nice.
This one has to go to work though, so it
can be quiet. Wow. Well, this feels
amazing.
And who said overpriced keyboards don't
matter? Oh,
this is the nicest keyboard I've ever
used, boys.
Yes, I understand that I spent $300 on
it. 350 or something, but like whatever,
man.
Whatever.
Oh, yeah. Oh, how nice is that sound?
This is going to change my streams.
Wow.
It's as easy to type on as an HHKV,
but it's quiet.
Wait, I I just I love this keyboard. I
don't like that it has double A
batteries
and Bluetooth, which I don't trust
because it's wireless and I don't trust
things that don't have wires. But wow,
what am I going to do with my HHKB2?
Feels so loud and antiquated now.
I wish they sponsored me.
I You know how many of these keyboards I
probably sold?
I mean, you can still hear it. It's just
different.
No, double AAAS are not as convenient as
a lithium polymer battery inside of it
that just charges that I never have to
think about.
Now, I'm going traveling over the next
month and I wanted to take a keyboard I
could bring with me. It's a little too
big to fit in my bag, but it might be
worth it because it's so nice.
Nope. Can't have the name of the
keyboard. If you didn't pay attention,
you can't know it.
Oh, I get rid of this terribly ugly
wire. This thing plugged into
the monitor.
This wire is terrible.
Bring this guy
around here.
Am I going to finding glory, boys?
Okay.
Wow, that's mad nice. Okay. Um, so the
best name I could come up with was
blueprint.
Do we like it?
makes noise. It's just different. Wow.
Oh, the camera's off.
No, it's not. Oh, mean like that.
What does that go down more? Okay, it
doesn't go down more. Great.
I don't know. I don't actually know how
I feel about it. I take back all the
nice things I said. I miss my old
keyboard.
I'm off center now.
Are you happy?
Okay.
So, we want to extract the shape
trackers.
put them in the blueprint and that's
where we do the transformations. Do we
like blueprint? What do we think?
This page is really good.
could still a pretty aggressive pretty
aggressive. W
exec planner or flattener or director.
No, I like blueprint.
It's not exactly the TVM schedule
because it means multiple different
things.
Uh, lazy up plus blueprint
yields you ops.
Why? Why does it add those spaces?
What is this?
A Mac only issue. There is a setting to
insert periods in double spaces in the
system preferences keyboard. What
is called?
Then it requires a fucking restart.
is automatic period substitution.
Whatever
didn't require a restart. Great.
Glad it was some oneliner Mac garbage.
Uh,
do we like the new sound? What do we
think?
So some of the old
linearizer
it's okay.
When is that feature ever useful?
You prefer the old? Well, that sucks cuz
get used to the new. The future is new.
I don't like douleas's. This keyboard
would be perfect if it didn't have this
big battery back with double A
batteries. Tell them I'll pay an extra
$100 if they put in a $7 rechargeable
battery.
It's heavier, too.
Hello.
Hello.
Our door was open.
Oh, sorry. I just went outside to get a
keyboard.
Did you get the other keyboard from
work?
You're getting fun of work.
Are you still streaming?
Yeah.
I got I got a A lot of food they asked
for.
No, thank you.
And I got $7,000 in cash.
Don't tell them that. We're going to get
robbed.
Oh, good.
No, we're not doing that again.
We're not doing that again. I'm trying
to do less cocaine this year.
Proof. Proof. Doug Georgia does cocaine,
man.
Pokéball.
Uh, I've decided in 2024 we're just
going to lean into whatever drugs you
think I'm on.
No, I want Poké Ball. I'm good. I ate.
Someone on stream called me fat, and I'm
taking it very seriously.
Wait, who called me fat?
I know. Some guy on stream said I was
fat.
What?
Well, that's not even the point. The
point is Oh, wait. Yeah, that's actually
it.
I can't see your body. You're post.
That That is That is actually it. You
guys think I'm fat cuz I'm wearing a big
hoodie.
Oh, that's actually reasonable.
Here we go. Post physique, boys. Post
physique.
Thank you. Well, I can't eat cuz Chad
called me fat. And I'm going to I'm
going to
take the shirt off. No, we're not up to
that yet. We're not up to that. No, we
we're going with Litecoin shirts. We're
going shopping later today.
We're putting a big hoodie on.
[snorts]
They give you this phone for free cuz
you're a woman.
No wonder women can't do capitalism.
Wait, why?
Was it a woman or a man?
Oh, the gays gave it to you for free,
man.
Oh, I see.
Alex would love it if we got a hot tub.
What?
They said it's going to turn into a hot
tub stream and I said Alex would love it
if we got a hot tub.
Grouping. This changes the lazy ops
structure.
Wow. I have to relearn how to type on
this keyboard though. It is different.
Yeah.
This isn't really the right.
Okay, so we're combining these things
into a single op, but we do like shift
shape 2 and opcast.
Let's get at the fundamental.
I wish Tiny had docs and I could like
show you guys what these things are.
Does anyone know
Does anyone know what these things are?
Um
either
global
or reduce.
I forget.
Do I make sure in tensor
or in lazy that like
I think so. Do I reorder them somewhere?
Where does it happen if I do like a
like an outer sum? Sorry, it's not
making any sense. If I have two axes and
I sum the first one, where do I reorder
them?
I might do this in tensor.
I might do this in MLOps or I just might
not do this anywhere.
I might do it in linearizer.
Wow, this keyboard makes me think
quieter, too.
Oh, here it is. Okay. Remove all. reduce
access to the end.
They don't actually have to be moved to
the end. I mean, that would be a big
change in the way of thinking about it
if we didn't move them to the end.
All right, subscriber only chat. Please
stay on topic.
This like this is one of the worst parts
of Tiny Grad to think about because it's
it's conflating so many different
things.
Okay.
So we have output shape and full shape.
Do we want to keep these things? Because
these are also things that can change.
Um, this gets into the whole spec of
what lazy ops are allowed.
We have all this fancy stuff which does
float 4. We we can do that also as a UOP
optimization. But I'm not sure if it's
preferable to put these things as UOP
optimizations or non-UP optimizations.
me buffer, const buffer, local buffer.
Well, then there could also be local
buffers and local buffers are a whole
different thing. So, me buffers are
backed by memory, but local buffers
exist only in one instantiation of the
kernel. Like local buffers can exist
inside of loops.
Okay, maybe I should write out an
example for people if this makes sense.
So if we're doing like a reduce, if
we're doing like a matrix multiply,
right?
So the output of the matrix multiply is
12424 1 and then the inputs are 1242424
and then it's like a * b do sum equals
you know that right?
So does that make sense? Like those are
the shapes.
Now these are actually expanded and like
this axis and this axis have strike zero
but that's not really important.
Um
so yeah then you can imagine like const
buffers too. So there's really there's
really two shapes here. Like output
shape equals 1024124 1. Full shape
equals 1424124.
Wow. How about this? So pleasant to do
that. My high. Um
okay.
And then we can do things like let's say
we want to like do an example like uh
unroll.
So this is this is an inner loop here.
But we can like unroll the loop
to something like this.
Hello.
Hi.
And that works out the same. But then
those will be loaded as uh
as special things.
Now usually you want to also do upcast.
So we could do like an upcast of like
axis equals zero
and upcast is going to do this.
The problem is like right now I'm making
assumptions about how I assign the axes
like so then this axis
here is global
this axis is uh up
this axis is global
this axis is reduced
And this axis is uh
is up as well.
Does that make sense?
Do these transformations make sense?
So this is all like as part of the
blueprint.
Okay. And then usually what you want to
do is you also do something like local.
So let me let's just give an
alternative. Say with like local axis
equals 0 and we go like 32 up, right? So
if we want to go 32 up, what's fourid
32?
It's 32. So for like going local
becomes this
is like global
local but like it's also kind of cool to
have like a canonical order of the
dimensions
reduce up.
So like right now we enforce global
local
uh group reduce
up uh unroll. So this is not actually
upcast. This is actually unrolled.
Uh the difference between upcast and an
unrolled is whether it exists in a in a
reduce which is just basically just loop
unrolling. It's the same thing as loop
unrolling. You don't have to uh
Yeah, it's just like loop unrolling and
reordering kind of.
So yeah, I mean there's a question of do
we always want to keep them in sorted
order?
probably yes.
Now I should also think about what group
is. Group's the most confusing one
there. Group is the only one I haven't
explained yet.
Um so yeah, maybe group is kind of the
wrong
So I I'll talk I'll talk about what
group is. Let's say we're doing a full
reduce example.
We just have like one axis and it's like
let's say one two four, right? We're
doing a full reduce. So you might want
to group that and do like
So I mean I can I can just
split that
into 32 32
and then I can do like have 32 threads
do that reduce and then have like a
final thread. But that requires like a
local of that size
which is an intermediate.
Is that stuff making any sense?
Um maybe I can show you one that'll make
sense.
Let's enable the real linearizer.
device.
Really unable to
Yeah. So, that one's being grouped. See
this 256? That's a group.
You can see more if we increase the
debug.
So you see it's actually doing two loops
here. Um it creates a local with that
dimension. So maybe maybe that's the
example we'll steal.
We split that into 256
64. But actually the local has that
size.
And see it does the first reduce in that
loop there and then it does the second
reduce in a loop there but only if uh
the local idx is correct.
Can think of a more generic way to
express that.
Okay. So it is a local dimension
like that definitely is a local
dimension of 256.
This thing doesn't have any global
because it's a full reduce.
So I put group there which is after
local.
But the difference between group and
No, dog strings suck.
Comments are
comments I think are mostly overrated.
Um,
who's distracting me? You want to write
comments? Go write comments. Go write
comments and make them useful. You know,
the best thing is right documentation.
The second best thing is no
documentation. And the worst thing is
wrong documentation.
And very frequently you get wrong
documentation.
So I split. I get that.
We're definitely putting Yeah, we're
definitely putting the groups after the
locals.
But it's interesting that they actually
are locals.
I don't know. I mean, group's kind of
annoying. Like look look at
look at how much that's like changed it.
See we want to rewrite this as basically
this.
So it's not the shape.
Well, okay. I mean that is the shape
because it didn't resize it yet. But
that becomes 256 64.
This sum takes it down to it's a loop
over 64. Yeah. So this sum takes it down
to here.
But then we actually do a store in a
local buffer.
Yeah, I mean groups really are more like
reduces. So that's why they go in this
order.
uh
strats can be one comma zero
and then we have something that sums it
down to one one and then we have
something that stores it here
all shape one has stride zero
so yeah I mean that's what we want.
No, this isn't exactly right because
then we have to also do a load from
local buffer, right? And there's
something like barrier here
and also this is kind of inverted. I
mean we can just write it like that.
First we load
some
store local barrier
load local sum.
So like we can rewrite this in the lazy
op. That's what I'm talking about about
grouping.
Uh
I mean yeah that's just so that's like
an intermediate shape
which is somewhere between
barrier is kind of implicit there.
I'm trying to think of how that'll
appear as a tree structure.
Stores don't usually have any output,
but we can give it output.
That's the barrier
and it keeps the graph structure.
So that loop is also interesting
like this has a global dimension of 256
but that load happens without that being
the group dimension.
becomes a reduce. So I I have the stuff
that handles this in the old linearizer.
Like a lot of what I'm talking about
here, you can read in the old
linearizer.
It's just like terribly written.
If you look for group for reduce,
I don't know. I don't care about right
now.
Uh,
basically, if you want to join Acromada,
like come up with a plan that you
actually want to go live there for a
week. I'll text you the address.
Like, I don't know. It's just no one's
serious about that. And they end up
wanting like basically a manager. They
want to be given structure and I don't
have time to give people structure. Like
I don't care enough. I I kind of give
people structure for this project, but
even that you spend a lot of time giving
people structure and you don't always
get that much out of it.
That's the classic like, well, I can do
it myself, but then it doesn't scale.
Blah blah blah blah blah. We're back on
management garbage.
You might be experienced. I don't
actually think that's the problem.
Um,
so I'm so happy that someone finally
applied to Hammer for the one job I
wanted. Uh, so if you notice there was a
lot of people tried to apply to Hammer
and there is only one uh job that we
were actually seeking which was founder.
Um, and fortunately you know uh you can
go try hammer right now on Perplexity.
Uh, [laughter]
I take I take zero credit for it. I'm
not I'm not like saying that. I'm just
saying like I want this to exist. You
know what I mean? So the the same
problem comes in with with Ecramada. And
I don't know which email is yours
specifically, but I got a bunch of
emails about it. Um you know, again, I
can rate them on a spectrum of
clownishness, but the real problem is
it's my fault. And like I don't have the
I'm not like managing this right now.
I'm not like putting a structure into
place. I don't really like doing that.
And like the land has so little upside.
Um like what what's the actual upside to
building that, you know? None. Uh I'm
waiting for the I think what I really
want is uh Ecramata is going to work. So
uh
yeah, I don't know. I'm not actually
really hiring. Um,
you can take over responsibility. I
mean, okay. So, no, no, an email. What
do you actually want to do? You want to
you want to you want to come out here
and do what? You want to get paid or you
just want to live on the land, right?
Uh, you want to get paid? How this going
to be returned, right? Um, uh, do I have
time to actually vet if you are capable
of doing this? Uh, do I
what happens if we get less return than
you told me you were going to get?
Right? It's just like a, oh, I got to
like deal with it. I got to think
through like the game theory and the
incentives and oh, you know, and then
like the problem is all this stuff that
I don't like doing. And the problem is
you deal with it for a plot of land that
won't actually ever be anything, right?
Like if I have so much time that I'm
going to put into this, why not put it
into companies that are going to be
billion-dollar companies? Maybe.
Um I'm not trying to hate on you. Again,
again, I'm talking structurally about
why uh you know, Ecroat is not a real
thing.
Um you know, it's just
like [sighs]
you you start to look, I'm sure you're
great, and that's not even the problem,
right? The the problem is
[sighs]
what do you think the limiting factor of
growth on companies is?
We can discuss all the terms like this
is what I mean. I'm not discussing like
like like if you come up with a proposal
and the propos like I got a guy living
out there right now. You know what? Zero
maintenance, right? It's just it's zero
maintenance. And if that's what you
want, then you know like say, "Hey, I
want a place to go chill for a week.
we'll go get a beer and like you're
welcome to go chill on the land. It
doesn't cost me anything, right? But
then when you're like, "Oh, well, you
actually have to think this through and
think about how this is going to be
something and put a p plan into place
and we're going to have one-on-one
meetings every week and we're going to
have a fucking Jira board." You know,
now we have a Jira board. Is the land
going to have a Jira board? See, it's
it's it's
as as the
as the technology becomes more powerful
and maybe this is the shift we're seeing
now.
Um, make Perplexity the CEO of Hammer.
Uh [laughter]
oh. Daily meetings and sinks. Like we
just don't like we don't have any of
this, right? We hired someone. So we
have a we have a we have a uh uh a
full-time employee now, tiny grad. Like
the way that this works is like you just
got to be like chill and like I'm not
going to manage you, right? Like this
isn't there not going to be there's not
going to be management. There's not
going to be structure like that.
um
you know and then okay so then you ask
the question of well if you're not going
to do management and structure what's
the point of joining the company why
don't I start my own company well then
you're going to have to deal with all of
this and trust me it's way worse and
it's not worth it whatever you think
you're going to get you're not going to
get it right like starting a company is
such a bad idea unless you really want
like if you put a big weight on making
the thing exist if you just want the
thing to exist exist personally. That's
the only reason you should ever start a
company. Um, it's a terrible financial
choice. It's a terrible just like it's
just a terrible life choice. But you can
potentially make something exist that
doesn't exist. And the problem with the
land is
it's not something that you're not going
to make something new exist. It's
something that basically already exists.
And again, you know, it's not me for
being wishy-washy about this, but I
realize that I got to lie more and I got
to lead people on more because that's
what Elon and Sam Alman do and they're
more successful than me. Um,
I mean, think about it. What limits
growth of companies?
What limits growth of anything? I think
it's the same thing that limits growth
of life. Look at how long it took life
to go from proariats to ukariats to
multis-selled organisms.
Well,
yeah, like
you might be able to do those things. I
don't know what I should really just do
is sell the land. Not to you. I'm just
saying I should I should sell the land
in general. I can get more than double
what I paid for it and just be and just
be out of the land in general. No, it's
not capital plus demand. It's not. I I
it's not capital at all. People have
been saying this on Twitter now. Like
nobody is capital constrainted. I could
raise $500 million tomorrow if I had a
way to deploy it. If I had a sane plan
to deploy $500 million, I could have it
tomorrow. The problem is how do you
deploy $500 million?
Uh limit is the amount of belief that
the owner has. I don't think it's sure.
I mean, you might have delusion at some
point, right? like you but all that's
going to do if you think the limit is
the belief that the owner has then
you're going to get absolutely
delusional people who own companies and
there's some delusional people who own
companies but most people who do it are
not that delusional. Some are some are
the the the big ones that you like the
big ones that blow up spectacularly
uh have have completely delusional
founders and that's why we enjoy
watching them, right? That's why we
enjoy watching the the like theoses of
the world because they do have
delusional founders. But again, most
startup founders are not delusional.
Um,
no, I don't think it's the amount of
consumers of your product. What what
limits the actual like growth of the
company? What if KA hired 10 people
tomorrow? I could get them desks. I
could get them computers. I could sit
them down. But then what exactly would
they do? How well would they integrate
into the system? And would they
integrate into the system in a way that
you're getting more out than you're
putting in? And I think that's the
limiting factor. I think that's why it
took life so long to go from procarots
to ukarotes to multi-elled organisms.
This this being able to uh
work together and get these superlinear
effects. Um
because you need superlinear effects,
right? If it were just linear effects,
everyone would work for themselves. The
only way companies can work is when you
get there's a cool book about this
called scale that like goes into this
this kind of stuff. But it shifts with
technology.
And I'm starting to wonder if
well look at all the tech company
layoffs. Maybe that's why it's
happening.
Um
the vision and dedication again
what do those things mean?
Right? People can have delusion
delusional visions.
I I think it's more the
practical factorization of the problem.
And I think this is the limiting factor
of growth. It's a limiting factor of of
it's it's it's the same problem in
software like how do we take this
complex problem say running a ResNet and
break it down into the correct
appropriate parts. Right now we're
coming up with the linearizer and the
linearizer actually has three
responsibilities and we can break those
three responsibilities into grouping
which is this, TVM schedule which is
this and then TVM lower which isn't here
but it's in the linearizer. It's the
function called UOP. I broke some of it
out this morning into uops.py.
Um, so being able to factoriize the
linearizer into three parts. And now I
can sort of hire for three roles. Now
I'm hiring a grouper, a scheduler, and a
lowerer. And those three roles should be
distinct enough they all can work
together and make more than the sum of
their parts.
Uh but with many projects
I'm not so sure so sure things scale
like this like like imagine there was no
way to factoriize this and you just
needed to take the linearizer and make
it better. Um and then I think what it's
very easy to falsely factoriize things.
It's very easy to take something and
split it up into four parts like four
separate things when three of the things
actually do nothing. But you can't
really remove them because of how you
structured the one. You can look at you
can look at a lot of a lot of codebases
look like this, right? Read the WebKit
codebase. The WebKit codebase has a wild
amount of layers of abstraction. Half of
which can be removed, but nobody can
remove them in practice.
Uh I don't think Tesla was delusional,
right? Tesla may have had some
delusions. Newton may have had some
delusions, but fundamentally when it
came down to physics and AC motors and
magnetism, like they had correct ideas
that that were not delusional. So it's
often with these people like you know
you you you focus on on the delusions of
of of Steve Jobs or Elon Musk or all
these people but in reality the st the
the the average decision I have to
remind myself this a lot at Twitter the
average decision that Elon makes is
better than the average decision I make.
Obviously
these people are not delusional at all.
These success no one who's successful is
delusional. You can't be
You can be delusional about certain
things. You could be delusional about
certain things that don't really matter.
But when it comes down to the things
that actually matter,
uh,
you know, I'm not not going to give
names to some people, but I know some
people who love having like these these
wild delusional beliefs uh about about,
you know, maybe I'm like this to some
extent, too. Like I have some things
where, you know, I'm a fine artist. Uh,
but when it comes down to actual
practical things, I'll give you the
boring answer. And that that's
you could be right for the wrong
reasons. Yeah, you could get lucky. You
could be a one-hit wonder. But again,
the people who are successful are not
usually like this.
The limiting factor is the amount of
times it takes to get systems actually
put in place and working that can manage
the throughput that they need to. I I
think so. I um I have this concept
called management coefficient
and putting in people with high
management coefficients but even then
it's like
it's not just how many people you can
manage because somebody might think they
can manage 20 people but then their
output is not
20x right like you could just think
about okay maybe even if it's sublinear
it still generally makes sense because
it's super linear at some higher level.
So interesting to think about this
stuff.
Um but yeah, the structural problem with
the land is just,
you know, I might think that I want
someone to come in and do this, but I I
don't even really have the management.
It's not that I can't do it. It's that I
I don't see the uh I don't see the
payout.
the the even if the land as a project
succeeds
uh wildly,
it's not a billion dollars. Not that I
even care about a billion dollars, but
it's it's not it's not on any
Pareto optimal
thing. Uh
you don't see cults, you don't see
compounds.
It seems like everyone who tries at it,
like
it's very easy to want to be a cult
leader, but it's very hard today to find
cult followers.
Uh, you know, people think like like
you'll be able to get cult followers.
Like if I actually did it, if I actually
set up a place and like, you know,
through a lot of delusional show up to
this thing, it's an event, whatever,
whatever, whatever, you know, dedicate
your life to this.
Yeah. you just don't like have that.
You're not going to get people who
actually do it today.
Um certainly not people who are capable
at all. Maybe you'll get some completely
incapable people to show up,
but
you'll get people who
you don't have. Curtis talks about like
thyic energy like you're going to have
people who just drain the thyic energy
of the place. The place can't be
self-sustaining.
Capital's not the problem. Time is not
the problem. Nothing is a problem. The
only problem is to get people going. And
that's why you need to have social
skills. Hitler was a good example of it.
I don't think that's true.
Um
I don't think Hitler succeeded
particularly because he had social
skills.
There were just some
there were some things laten like latent
in in in German society at the time that
Hitler was able to exploit.
Uh but you have to have those things
latent in the society. Uh was Hitler a
but for cause of of of World War II? I
don't know. If it wasn't for Hitler, it
might have been like there were five
other guys who were thinking the same
sort of stuff. Maybe he actually
[clears throat] changed things. It's
hard to say, but definitely,
you know, Hitler only managed to do what
he did because he had a lot of people
who were willing to follow him.
And that's the thing that's much harder
to find in the modern world today.
Your your
Robin Hansen I listen to Robin Hansen uh
talking about why the Amish shun
technology. And it's not because
technology is inherently bad. that it's
because technology exposes you to the
outside world. Even something as dumb as
a car, if you have a car, you're going
to drive the car to people who aren't
members of the Amish community and
you're going to be corrupted by their
ideas. It's very hard today to build an
insular sort of community like that.
Um, yeah, something about like
you need you need in order for a cult to
succeed, you need competent, willing
followers, and you don't have that
today.
You're yet to see modern social media
organize a large amount of people for a
revolution. I'm not sure you can.
I'm not sure.
We're yet to see modern dating apps
create more successful pairings. It's
the same problem. The amount of choice
on social media, the amount of choice on
dating apps actually lowers the the
quality of the average relationship.
um you're not going to get your your
your Instagram social media cult is not
going to out compete all the other
Instagram social media cults. So you get
these things that are like
you get something like Black Lives
Matter which what do you have to do to
say I'm a part of Black Lives Matter?
Okay, I post to Instagram square and you
know I go stand around and go to a block
party. Cool. Like that's the amount of
oh there's a word for this. There's a
word for like that's the amount like
buyin you can get but if the buyin
actually required something more
complicated be much harder to find
people. I've heard that like
organizations like the Muslim
Brotherhood have very high buyin like it
takes a lot to become a member
uh which you almost don't see in the
Western world today. You don't see
organizations where it's some fivey
year, 10 year process to to become a
member to work your way up the ranks.
You know, you see people are like, I'm
going to go somewhere else in 18 months
and blah blah blah. The world's a
hedonistic paradise.
Uh so yeah, I'm not so sure social media
can can structurally organize a a
No, I just echo just doesn't work. So,
here's a theory that might work. Um, it
is possible. So, there's the old there's
the old like all the people who like
tried these like hippie cults in the
60s. Oh, we're going to go live off the
land. And uh
in general,
everyone wanted to be the guy who sits
around and smokes weed and
philosophizes. No one wanted to be the
guy who was out there with the hoe in
the field. Uh so the cults would
collapse because, you know, no one was
out there hoing the field.
It's possible that robotics will change
this. I'm not sure, but I can see a
world in which you can gain almost the
thyic energy from the machines. Now,
you're not going to be the only one with
the machines. So, the whole landscape
might change enough that you can't still
can't do it, but I I could see a way
things change.
Allow me to give a couple speeches about
comma and I would gather you amazing
uh new people. Yeah, you can get poor
broken hippies to join your college.
It's actually even hard to get poor
broken hippies today. But
um
you get well you'll get people who want
to take and not give back. You you'll
get people who want to take way more
than they give back.
Won't people always be cheaper than
robots? No. No. The cost of human labor
is going up. The cost of robotic labor
is going down. They will eventually
cross and they will eventually be
nowhere near each other.
You would gather me amazing new people.
Okay. Go on. Go on. Where exactly are we
finding these amazing new people?
Uh, you've got a couple of acres
thinking of copying the model. It
doesn't work.
I mean, yeah, robots are the new are the
new slaves like that, right? Like
people, you have to pay for their time.
It's it's
[laughter]
the the the the the uh the um the the
the kind of real politique view on
slavery is uh slave owners were sick of
paying for their slaves room and board.
So, we'll give them freedom and a job,
right?
Um,
then they'll, you know, pay for their
own house, pay for their own food. Let
let the let the capitalist system figure
it out. Something I don't have to deal
with.
The reason I can do that is because I
love the project and have the ability to
make people love it. Then why aren't we
doing that already?
all these people who, you know, that's
what I really like about the bounty
systems
don't like will just judge you straight
up for the task. There's no there's no
Yeah. Yeah. Well, cults can go
mainstream, too. Sure. I mean, again,
Burning Man Burn Burning Man works.
Burning Man works, and you can look at
what it is and how they did it, and it's
pretty cool. Uh it it follows a
structure where you're definitely
getting people who put more some people
put way more into Burning Man than they
get out of it. So So Burning Man has
done a good job with the sort of thyic
energy.
Um I don't know what Father Yahad is.
Grateful Dead is banned. Uh yeah, slave
labor is less efficient than paid labor.
That sounds right.
So yeah, what are the uh what are the
scaling laws
that that go into these things? How are
we going to be able to like measure this
all?
I don't know.
Sometimes I wonder does anyone
understand this that I just don't
does anyone understand this like sort of
people dynamics?
If people do understand it, is it just
something they don't talk about because
it's taboo?
Uh I think I think I've talked about
this before, maybe not on stream, but
like a studying of of
There was interesting stuff. There was
interesting stuff in like the pickup
world 15 years ago talking about social
dynamics. Now, now like the red pill
stuff has gone too far. I think a lot of
it's pretty misogynistic now. Um, in a
way that it wasn't in the past.
But like if you can really approach this
problem not with prejudice but asking
the question asking the true questions
about what are people how do they work
together what do social dynamics look
like. I don't know you I'm surprised how
little there is on on really
understanding this. Um no one no one
fully understands
[sighs and gasps] if if there's any
knowledge that they keep from you.
What's that?
As it scales, you lose fidelity in your
systems. The first guy gets good at
whatever process it locked down, but as
you copy him. Yeah.
Yeah. This is this is in Harry Potter
methods of rationality. They talk about
um whether power in a systems increasing
or power in a system is decreasing.
Your manager was teaching you what?
Uh, your manager was teaching you about
social dynamics.
And there's like market dynamics. This
stuff's pretty well understood.
Um,
and the market dynamics stuff is well
understood. It still doesn't mean it's
predictable.
what what was he teaching you and where
was he getting the stuff from? Well,
market dynamics are well understood.
Again, it doesn't mean that you can make
money off of it, but the the the like
all these, you know, all the all the all
the all the cryptoeconomics has, I
think, done a better job articulating it
than all the than all the past stuff.
Like, you can now if you were around
crypto at the right times, you just
like, oh, okay. I mean, I understand
like like I understand what the Fed
does.
Um,
I understand,
you know, how how every Ponzi in every
way, shape, or form, what's a Ponzi,
what's not a Ponzi. Market dynamics are
well understood. Again, that doesn't
mean you can predict the peak of
GameStop, but you can understand the
causes and forces that lead to the
GameStop phenomenon and the crash. You
understand why there has to be a crash,
but you understand why shorting tomorrow
doesn't make you money. Um, damn.
Yeah. Again, the future is predictable
in so much as it's the same concept as
uh, you know, in poker, how often should
you bluff? And you can work out
mathematically exactly how often you
should bluff in poker.
And you may fully understand the Nash
equilibrium of poker and still not be
able to win against someone else playing
the Nash equilibrium strategy
or you know anybody can fully understand
the dynamics of rock paper scissors. It
doesn't mean you can win at it.
Um now there may be people who play rock
paper scissors exploitably and you may
be able to exploit them but two people
playing the Nash equilibrium strategy of
rock paper scissors will never exploit
each other.
which is just you know pick randomly
um
everything ends up boiling down to the
social dynamics and groups of people.
Yeah. Okay. But again, what are these
are there books that are going to teach
you this stuff?
because I I found I found very little
good stuff on the topic
and to think that it's maybe one of
these sciences. Actually, the best stuff
I have found about social dynamics of
groups of people is economics.
Like if if you study economics, you can
kind of
I don't know about any of this stuff.
Look,
so then there's there's another this is
a Yukowsky's book, Inadequate
Equilibrium, which everybody from the
outside can look at modern corporate
culture, can look at like the DEI cult
and say, "Yeah, that's not going to end
well." But
the market can remain irrational longer
than you can remain solvent.
If the best thing we have to understand
social dynamics is the Bible stories,
wow, that science really has not
progressed very much in a long time.
Yeah. Stoicism. Yeah. Go read
meditations. Like I've read this stuff.
I've read the stuff. I've read the
Bible. Like yes, this this is this is
the like like the understanding of
social dynamics that everybody has. What
I'm saying is, is there more of a modern
scientific
uh is there more of a modern scientific
take in this stuff? Um I think Robin
Hansen has some of the best stuff on
this.
Well, yes. Yes, it is. It is very
notable that the modern social sciences
are a complete sham. Um again, I will
take the modern social sciences
seriously when they acknowledge that
there are group racial differences in
intelligence. Right? that is the
greatest taboo is obviously true. Um
when when they acknowledge group
differences in intelligences, I will
reconsider uh the social sciences. But
any person who does not acknowledge that
is not a scientist. They're a
propagandist.
Right? Again, separate from whether you
like that fact or whether you dislike
that fact. It's a true fact about the
world. And anybody who isn't, you know,
purporting to report true facts about
the world is not a scientist.
uh
people deny basic biological truths.
Yeah. Again, this is what I mean like
there is a certain taboness
to this sort of stuff today. Um
we come back to this a lot. This has
been a common thing I've been thinking
about. This has been a common topic on
this stream. What can you change? What
can't you change?
How does change actually happen?
There's
some rationality people kind of talking
about this. Again, I think the
rationality people are too,
not all of them. Maybe they've been kind
of coming to the truth of it, but I
think that like Neo Reaction had a lot
of good stuff on this, too. These were
people who were unconstrained by
uh social nicities and could talk
honestly about this stuff.
I don't think everyone denies basic
biological truths. I do think you get
Yeah, you get wrong people on both
sides. You you get people who get caught
up on in ideologies, right? Whether your
ideology is blank slatism or your
ideology is white supremacy. Both of
these ideologies are ridiculous and both
of them will will cause you to uh you
know believe some some some very false
things about the world, right? A lot of
a lot of modern uh
like leftism is based on the idea of
blank slatism.
Um blank slatism is that like you know
equality if you have true equality of
opportunity you will get equality of
outcome and that's just not true. Uh and
then like white supremacy is obviously
based on the well we start with the core
axiom that white people are supreme and
then we derive everything from that.
Like if your core axiom is junk then
your your uh results are going to be
junk.
I would solve time travel if I had a
thousand of me. Probably not. Uh there
are questions about how well MI would
scale.
Uh, I don't know. I don't think Miis
would scale to large organizations.
Mi would probably scale pretty well to
10.
10 mi could probably work pretty
effectively together. 10 mi could
probably achieve 5x the output.
100 mi are going to come up with the
idea of decimation.
No, not really. Not really. Hey copies,
I'm chilling with all of you. We're all
going to coexist, you know? It's going
to be like some big like gay orgy shit.
Like, it's fine. It's fine. Don't worry
about it, man. Like, we've all seen it
before, you know? It's not a big deal.
Don't worry about it. Um,
yeah. I like some of the cognitive
behavioral therapy stuff. Uh,
no. I don't think cloning myself would
solve the world. I don't think that's
true.
I think you'd get stuck in I don't know.
I mean, you know, I'm a big fan of
diversity. I think you'd get stuck
quickly in uh
in local maxima.
And you know, I think I'm better than a
lot of people, but I'm not better than
everybody. And I'm certainly not better
than everybody at everything. Have you
seen me play video games? Um
the value of sorting this out is so high
it isn't publicized
becomes tribal knowledge in the
organizations.
Yeah.
I mean I guess I'm trying to think of
like what I would expect the structure
of it to look like.
Yeah, but I mean different RNG seed in
in what space, right? If you're doing if
you're doing mixture of experts models,
you want you want diversity.
You want you want like an extreme amount
of diversity? You want as much diversity
as you can get. is it's a a
non-performing expert will quickly be
selected out by your final selection
function.
If it but if it ever does ridiculously
well at one task, it's like worthwhile.
Which hots will become king hots clone?
Uh well, Tesla and Einstein existed in a
world of a large amount of diversity.
Again, I don't mean diversity like like
the modern corporate definition of it. I
mean diversity in the sense of
I'm not going to say like intellectual
diversity. That's like a taken word, but
you know what I mean.
Your Rick and Morty situation, right?
The planet.
Um,
wait, what? All that stuff, bro. Like
literally, no. See, this is the problem.
Figure out how to get power out there.
Figure out who you have to bribe at SG&E
and how we can get it done for as little
as possible to get a electric wire run
out there. OH. OH, WE'LL JUST USE
FUCKING SOLAR. SEE, THAT IS why you're
not serious. That right there is why
you're not serious and you haven't
thought about this enough, right? Solar
sounds great. Oh, great. We can buy this
solar system. We can put it up. Dude,
I'll tell you what's going to happen.
Junkies, bro. Yeah, you live on solar.
That's great. and you spend your whole
life out there guarding it against
junkies and it doesn't build value over
time. I understand that you can build
it, but this isn't the problem, right?
This is the exact same problem.
Look, see this is what I mean like who I
want to hand this to is,
[sighs] and this is then you know, you
start to think about this more and you
start to understand why the world looks
the way it does. You start to realize
who I really want to hand this off to is
like a corporate property developer,
right? Why it fails in the junkies?
Because the junkies come jack your
fucking solar panels, man. They walk up
there, they steal your solar panel, and
then they're like, "Oh, [laughter] WE
HAVE A SOLAR PANEL for sale. Do you want
to buy it so I can buy heroin?"
Um,
so yeah, I mean, the the the problem is
not that you can't install solar. Um the
problem is solar doesn't build long-term
equity.
Um like
solar panels are a depreciating asset.
Uh solar panels require a ton more
maintenance. But if I could get the land
on grid power,
the grid then will maintain it
and that builds equity on the land.
money that you would invest in solar
could be leveraged a lot better. Yes.
All right. And this is this is this is
the junior engineer versus senior
engineer mentality. Um you think, "Oh, I
could just write that. Oh, I could just
make that work." Yes. But at what cost?
Right? And like those things that you're
talking about are so high level compared
to yet you can put the land on your
grid. No. See that's what see but okay
you're misunderstanding what I want.
Right. And this is exactly why it's such
a problem. Right. I I don't the tractor.
You can fix the tractor and the tractor
will break again. Right.
You know, I want the kind of person
who's like, I'm not going to do very
much, but I'm going to slowly build
equity and value and infrastructure over
time.
Um, the truth is why would you probably
even own a tractor? And then you get
into like the World Economic Forum has
it right. I want to own nothing and eat
the bugs and rent everything, right? You
really do as an individual.
123 acres.
Um,
yeah. No, I mean the kind of person I I
I've like Yeah,
it's not the kind of person, and I said
it wrong, right? I wrote that model
website a long time ago. It's not the
kind of person who lives off grid. It's
the kind of person who, look, I manage
four fake wineries. We make most of our
money off of weddings. I work with these
three companies. Here's what it's going
to cost you. Here's a five-year
projection of your returns. Like that's
what I want. I want the most like boring
corporate event planner type to come in
and they are the kind of person who will
make the land, who will build equity in
the land.
take the shit land, farm it,
industrialize it, and corporatize it,
and then can we figure out a deal where
we all make money off of this, right?
Like, I'm fine with you build equity in
the land. I'm fine with you taking all
the profits while you're building equity
in it. And that's kind of like,
yeah, like I want to be an investor in
the land, not actually like a like a
like a manager in the land.
Uh the land is about 20 of the acres are
flat.
Um yeah, fake winery, right? Like this
is what you do, right? Like like like
press a few grapes, whatever. Oh yeah,
look there's some grape vines down
there. Yeah, we got a caterer we work
with. Yeah, look, we got a we got a all
you can drink area over here, right?
Like just just, you know, a destination
wedding, man. You love you love the
woods, nature, the stars. There we go.
Yeah. pay $300 a night for
accommodations that are worse than a
Motel 6. Hell yeah. [gasps] Catalina
wine mixer. Now we're talking, right?
Like this is [laughter] Sorry, but like
buy cheap wine and pour it in the
barrels. Yeah, we're going to buy some
Chinese Alibaba wine and we're going to
slap a California label on it. We're
going to spend more on the label than we
spend on the wine, right? Like come on.
That's like this is what this shit is.
And if you don't do it like that, you
just lose.
You can try agriculture. Yeah. Go watch
Clarkson's farm if you want to try
agriculture. Like that shit's funny.
They get the picture with the water with
the sunset. He has a beautiful lake you
can see from it. Oh, it's really nice
land. See, you hate that you understand
it, but you don't want to do it.
Exactly. Exactly. And this hope everyone
understands why none of the people who
reached out by email are actually
serious. And I don't think they really
understand what a serious person would
look like. I didn't understand it at
first until I tried to do it for a bit.
The serious person is like, "George,
look, I built three fake wineries
before. Uh, you know, here's your
projected revenue numbers. Uh, here's
what it's going to cost you." Oh, yeah.
But I could do it, you know, I can I can
work on it and I can do it I can do it
for free and I can do that myself and I
can save money. Yeah, maybe. Maybe.
But who knows, right? Like that's the
whole sure you can rewrite the whole
thing and it'll be better. Yeah, maybe.
Welcome to being a senior engineer.
Um,
explosive range. [laughter]
Uh,
no, probably the So, look, I got a I got
a guy working out there now. Um,
again, it comes down to [sighs]
one of the best business, one of the
best like low low entry businesses you
could probably get into is horse
boarding.
Um,
weddings [clears throat] and retreats
are great, but it requires quite a bit
of investment to get it there, right?
And again, you need the kind of person
who kind of like event plannery person
who's going to do it. You know, these
women, they make good money. Like it's
almost always women who do it or gay
men. Um, they're just, you know, they're
very good at this kind of attention to
detail to to make your wedding a
memorable night you'll never forget and
a night that I got paid another $50,000.
Sorry, I thought you wanted to make it a
wholesome place for actual living
people. Don't you have everything else
to make money? Wrong. See, this is the
wrong mentality. You will never succeed
with the first mentality. The first
mentality is commie shit, right? And
the the the truth about commie shit is
it doesn't work.
You'll be living in the dirt while the
thing to make money is like, "All right,
cool. We got grid power. Uh, you know,
the the the it's well water, but the
wells cleaned up nicely. I installed
this filtration system buried
underground so the junkies can't get to
it. Shit, maybe I even want grid water,
you know?
Like, can I get can I get grid water?
explosive frame. Someone's going to
throw a grenade and like leave it and
then someone's going to be digging
through the things and the grenade's
going to blow up and then I got a
lawsuit. You know, you got to think of
the downside risk here. Um, we live in
capitalism, but not not only do we live
in capitalism, capitalism is
good.
Capitalism is why we don't live in
caves.
Um, yeah, yeah, yeah, yeah. It's good.
It's good. Let's tell we take the
unbreakable vow of not being evil,
right?
See, but like you won't make it a
wholesome place for for for like you
like like I don't know how better to
describe it. I don't know how better to
describe it from every time that I
thought I could buck market trends. I
can't.
The amount of difficulty it is to swim
upstream on anything. you better choose
exactly what you're swimming upstream on
and make that your entire dedication.
Uh, and a good place to not swim
upstream is on electrical power. Don't
just connect to the grid like everybody
else.
Okay. So, buy data center grade shipping
container. Stack tiny boxes in it. Bury
them underground. Stack solar above
ground. Why? Why don't I use a cola?
Why don't I just stick them in an
off-the-shelf cola?
Do you really think you're going to do
it cheaper?
Put a spreadsheet together. How does
this compare with a cola?
Like I've done way too many things in my
life with comma like we're like, "Oh,
we're going to like build our own one of
these things." You just kind of mostly
shouldn't.
Yeah, this is what I mean. You want to
convert 120 acres of mostly rocky land
into an income source. Yeah, I know it's
not an easy task, right? And then this
comes into like why I'm like, "Well,
fuck this, man." Like, what's the most
income it's actually going to bring me?
Let's build a fab out there. Wow, that
sounds like, you know, again, [laughter]
you know, like the uh the the the the
the hard water clogged up my $20 million
lithography shit and like, oh, I should
have just built this in an office park.
And then you understand why everything's
in office parks and you just start to
understand why the world looks the way
it does. You can go around thinking that
everyone else is an idiot. And it's easy
to think that because everyone you meet
is an idiot. But yet somehow these
systems contain so much more
intelligence than you. It's funny. It's
like funny how that is.
So it's not to say that nobody can do
anything, but it's to like don't try to
reinvent everything. You're just not
going to win.
uh hire 100 engineers for Tiny Corp and
name it Tiny Land. Then you charge dumb,
hyped, wannabe engineers to watch them
and learn together. You can pull scams.
So, in general, what I'll call a scam
is, yeah, I could probably like like you
could probably milk a lot of people for
money um by giving them education,
right? I think there's a lot of demand
for like education today, but I wouldn't
feel ethically okay about it if I knew
that the amount they were paying me is
never what they were going to make back.
Um,
yeah, like
education the the returns on education
are
today like you're making nothing back.
It's It's not worth it really at all
uh to go to college to go to Yeah. to do
any of that stuff. I did I described
four year but I didn't describe four
years four-year degrees from 1940. If
you went to college in 1940, your degree
definitely had return on investment. It
was cheaper and both had a bigger
return. Uh but I mean look, the market's
finally catching up. Everyone's kind of
understanding this about college. You
know, men figured it out first. The
women will the women will follow
eventually, right? You look at colleges
now and they're what? like 65% women.
Well, you know, you'll see. You'll see.
Standard social dynamics, right? Guys,
guys figured it out kind of first.
They're willing to take more risk.
They're like, "Yeah, I don't need one of
these as a ripoff."
Uh 2008. Yeah. I mean, you might have
still had a return in 2008.
But again,
imagine you're at college and you're
saying, "Oh, I just wanted to create a
wholesome place for people to be
educated." Yeah, you can't ignore
economic reality. So to answer the kind
of question of do you want the master
science that talks to you about social
dynamics? The answer is economics.
But you school cost you 24K and you made
50K in your first job. Would are you
sure you wouldn't have gotten that job
without school?
If it's 24K for four years, that's
that's just not that much money. If it's
if it's if it's 60K a year like these
modern four-year colleges, well, all
right. Now, you got to make 100 240K.
And that's that's that's usually loans
that have interest. Interest rates are
high, so on and so forth.
Oh, the line city. I'm excited about the
line city.
Uh, you can make the same parallel for
poker. Well, no. I I I poker is a game
where everyone consents to the rules,
right? I don't feel bad scamming people
in poker. I don't feel bad, you know,
scamming people in crypto.
George scam people with GPS. Um, not
scamming like that, but like I don't
feel bad. Uh, look, I'm going to I'm
going to I'm going to buy low, wait till
it gets up, and then dump on people,
right? Like fundamentally, so Veronica
Mars line, you don't uh you don't you
don't dump your stock, you sell it. You
don't sell it. I don't feel bad. Like,
everyone who opts into that system.
Everyone who opts into a system of
buying and selling shitcoins consents.
Everyone who sits down at the poker
table consents, right? You consent to
the fact that you're playing a game. And
at that point, well, you know, hey,
someone's got to win and someone's got
to lose. And uh I don't like losing, but
uh no, I mean, I don't feel that it's
ethical to do for things like education
because
you're not really consenting to a game.
You don't really have consent from
people.
No, I lost money on Meta. Don't talk to
me about Meta.
Uh
the land is the land is 30 minutes uh
from San Diego. It's very close. Uh as
far as using it as storage goes, yeah,
you're going to need a road, bro. Uh the
road is
barely drivable for your average car.
Uh again, you're going to need grid
power. You're going to need a security
guard. You're going to need a fence.
I got to get a guy out there to build
the fence. And you know, oh, who's going
to manage the guy? He poured the
concrete badly. Oh, the union labors on
strong. Oh, see, it's like
like Yeah, there we go.
Um, okay. So, you paid you paid 24K for
somebody to keep you on track. Maybe 24K
is again 24K for four years, that's not
that bad, right? You're not going to
even get, you know, you're not going to
even get cheap. But again, 60K a year,
shit, I could pay a full-time like
livein like whatever.
Um,
uh, no. Like again, okay, you want to do
solar, right? Stop thinking about
putting two shitty solar panels out
there. Start thinking about, can I
actually make money off of this, off of
this solar? Um, can I actually use the
electricity right there, right? Can I do
some kind of um,
sure, maybe you can, you know, maybe you
can put a data center out there, but now
I'm going to need fiber out there,
right? Maybe, maybe I can I can build a
cola. Maybe I can build a colo on 123
acres of land. Uh, no, but it gets hot
out there in the summer. All right, this
is a big thing. It's custom. Never mind.
I give up.
All right, we'll let nons subscribers
talk for a little bit and then I think
that's today's stream. Sorry, we didn't
really write much code. We thought about
it. We called it blueprint. Realized
that it's going to be a lot more work
and then we just talked about a lot of
work.
Our batteries have come way down in
price. There's this like people are like
looking at like the S-curve of batteries
and it's just getting started. It's
really cool. Shout out to Big Pump
Signal. Um,
10 years streaming 10 years. Sounds
about right.
[sighs]
I have nothing useful to add yet. You
showed up and spelled useful wrong.
Uncle Ted already tried Acramada. Not
really. He didn't scale at his, you
know, he had a very different
kind of like he had a much more uh
I don't know much more pessimistic view
on the future. Not that pessimistic
about the future. Somewhere in the
middle. Could go well, could go badly.
Real social dynamics. Tyler Deran. Yeah.
Wait, the blueprint. Maybe that's why I
was trying to think about it. Isn't that
Didn't he Didn't he write like like a
thing called the blueprint?
Um, sell the land. All your
considerations already priced in.
Exactly. Now, that's some good advice.
That's some good advice right there.
That's the thing. The markets, whatever
you're thinking, the market's already
priced it in. The market is so much
smarter than you. Bow down before the
holy market.
Um, yeah. It's so hard to beat the
market. Maybe this is why everyone hates
capitalism.
You just feel like like there's this
like this is super intelligent being out
there.
Did I rewrite the linearizer? No, I
wrote some notes for the new linearizer
and realized it's actually going to be a
twoe project and has to be done slowly
and boringly and you won't even really
want to see it on stream. Make a chip
manufacturing plant.
Uh oh, the mirrors are not worth it.
that photovoltaic solar is so cheap now.
Photo voltage solar and batteries have
gotten really cheap in the last 5 years.
Oh, so we're going to start to see a lot
more
um leasing it to a telco.
Oh my god, what I'm going to AT&T is
going to give me a call. You ever try to
talk to at AT&T is one of the worst
companies in the world?
Uh,
no. I don't think clones of myself would
ever be like a gay event planner. I
don't think clones of myself would be
gay.
How far how far like in the spectrum how
far would you have to like push me?
Um,
yeah. It's just like it's it's it's
not
it depends when these like clones
started, right? If these clones were
like I don't know. I mean then then
you're just in the uh
in the whatever whatever identical twins
have uncorrelations and gay for yourself
man. Everyone who jerks off gay for
themsel.
Uh
what be five times more intelligence way
better than 10 clones. Man like you're
asking the question. Do you want 10
cores or do you want one core that's 5x
faster? You want one core that's 5x
faster.
Um,
the piano is just just as a showpiece,
man. When I bring girls back here, like
I have a piano. No, no, I'm not going to
play it.
Make a tiny box factory. We're building
a tiny box factory. We're building a
tiny box factory right now. We're just
not building it where there's no power
and dirt everywhere.
Where is the rig? This was junkies stole
it, man. Junkies.
What was the last stupid question?
That's a stupid question.
[sighs]
junkies of price [laughter] then
why is housing in California so
expensive
um
my aim's not money okay it
to deny capitalist reality is to deny
reality to not look at things through an
economic lens is commie bullshit.
This is just the kind of like
this is something I wish I understood
better when I was younger.
You just you get better as you get older
predicting how long things are actually
going to take, predicting what trends
are
uh going to look like. You're young and
broke. How could I make some money? Real
talk. walk up to people and ask them for
their wallet. Don't like mug them. Don't
do anything illegal. Just be like stand
there and be like, "Sir, can I have your
wallet?"
Like, you know, one in 20 will probably
give it to you. One in 20 maybe they'll
be like, "You can't have my credit
cards, but I'll give you the cash." And
there you go. You made some money. Is
that illegal? Just like It depends. Like
you're a big guy. Like maybe that works.
Uh uh I was too sheltered.
I think sheltered is the right word. I
wasn't very sheltered. I wasn't very
exposed to
I was raised middle class. Like I wasn't
very exposed to kind of the the upper
class way of thinking.
The people that still carry cash will
probably also beat you up. That's true.
There is You know what? It's already
priced in. Whatever it is, it's already
priced in.
Um,
Canadian theft. [laughter]
Just very politely. Uh, sir, can I can I
have your wallet, sir?
You want my wallet? Eh,
commit fraud. Fraud is a good way to
make money.
It's priced in. It's priced in. Like,
you don't understand. Stores have a
budget for shoplifting. You could be
that budget. We could be that mistake.
We could be that mistake.
What? No, no, no, no. Ben Shapiro or Ben
Shapiro bro put out by Trump the Dawn.
[laughter] There's some AI Spotify. It's
actually pretty good.
Um,
wait. It's not actually Shapiro. There's
like like it's like Ben Shapiro bro.
Shapiro bro
trump it on
ship.
It was like Shapi Bro. I saw it on Shapi
Bro.
No, I don't know. We're not listening to
any real Ben Shapiro. Real Ben Shapiro.
Just just 30 seconds of it. Just Just We
We can watch a little more Skibby
Toilet, though.
I'm going to skip ahead a little bit.
[music]
So like like if you haven't watched
Skippidity Toilet
uh AI Drake did put out some good songs.
Better than anything Drake put out
recently.
It's some stimulating content. I know,
right?
What? Skibbity toilet? Yo, Skippy
toilet. Super real. Here. Well, we we'll
start you at the beginning so you can
understand where it comes from.
[music]
[sighs]
Skim toilet is worse than you think. It
brainwashes children, man. The kids
aren't okay. They got the ears messed up
from the damn rap music.
[laughter]
It's a scop, bro. All right. Uh, PAL
World. Oh, I don't know. Is it good? I
haven't played it.
Um, this could [laughter] some shit,
bro.
All right. This was a real I don't know.
Like, I work all week now, so I come and
stream on Saturdays. Like like when I
used to do streams on Tuesdays, I think
we were a lot more focused and we did a
lot more work. Um we tried to do RL and
we just got frustrated like every time
we try to do RL.
Um Shapiro bro in quotes. Oh, good,
good, good, good. Let's see.
Leftist tears. Oh, wait. We can't we
can't listen to it.
Leftist Tears.
They have to put it on YouTube, too. Oh.
Oh, he did a Oh, is this actually
all right?
All right, gang. It's literally your boy
Ben Shapir, bro.
Wow, I didn't know that.
And this rap is sponsored by ExpressVPN.
ExpressVPN.
Watch Daily Wire, not CNN. Sponsor back
CBN. Literally my first rap is better
than Megan the Stallion. Shout out to
Michael N. Matt Walsh. Show me what it
do. Candace Owens getting on my nerves.
She's a part of the destroying [music]
these college. Shout out to the Jews.
Yeah. Um, no. Also, uh, Trump the Dawn.
Uh, Trump the Dawn rap.
Um,
there we go.
Prime China and vagina. You know, this
is pretty uh [laughter]
um
watch Daily Wire, not CNN, sponsored by
ExpressVPN.
It is. It is good vibes. It is. It is.
It is good vibes. Uh, you know, it's
it's funny. You think like 10 years ago,
I remember like my president is black,
my Lambo's blue, and I'd be godamned if
my rims ain't too. Remember that? It's
like they were making like Obama rap
songs and now they're making like Trump
rap songs. Like, it's just it's just
funny, man. It's just funny. All right.
All right. Uh, the name Donald Trump has
been mentioned, so that means it is the
end of the stream. Thank you everybody
for watching today. Uh, I appreciate all
of you. Uh, except for some of you who
derail and, uh, cause trouble. Uh, look,
look, look, look, look. Don't go to
college, man. Look, I'm just saying
don't go to college. And whatever you
do, don't let Sam Alman uh scan your
eyeballs. Good night, everybody. Good
morning, good afternoon, happy Saturday.
let's turn
off make sure we still have service so
look I waited I got to close the door
too it's early it's early some people
are still
sleeping I waited till we started the
stream to open the highball so going
really we're going to really capture the
opening of the highball energy by the
way if you guys want to sponsor me I I
think this is made by the same people as
Bud Light I'm just saying I'm I I just
like the energy drink man it's not a
political cause
[Music]
man all right good morning good morning
good
morning
so we are documenting a GPU
today we are documenting the GPU let's
make me
tiny make me tiny there we go tiny look
at
that uh so we have a new backend in tiny
grad called the kfd drive so I be kfd =
one the simplest example is in test test
Ops tests test tiny
ad so ials 2 you can see it uh some
stuff and I can do IAL equals one and
you see these are the I Opals that are
actually being sent to the GPU so we
have a driver now this is pretty much
the rawest you can
get uh let's open got the window
here it's pretty much talking to the GPU
in raw
mode now our discovery on the last
stream uh beautiful
UMR we
away
um run lists
so let's try something a little more
complicated I think this like
Works
cool so now let's see if we can like
here it's D sdma okay well that's the
stuff um I think there's a way
to ring
stream dump IB
packets
this this
three oh
no okay so these bugs probably are not
um
this is probably not a GPU
bug still probably got a GPU bug the
driver is very new so the bugs are
probably in the
driver though if anyone who thought we
were going to give
up this just been My slogan for a long
time never give up never
up this has been My slogan since the OG
iPhone days boys like I know that I know
that you know you see people online that
say I give up on stuff but you see they
have to believe that because if they
didn't believe that they'd have to ask
the question what are they doing with
their life right this is this is the The
Hacker News The Hacker News hate for me
reveals so much about the psychology of
Hacker
News and look there's legitimate
criticisms but a lot of The Hacker News
hate looks a lot more of the variety
that like I can't exist right you can't
just like not sell out man you have to
sell out
man uh so so there has to be something
uh you know wrong with me right there
there has to be i' have to have have
have got to be something wrong with me
right uh cuz other otherwise how do they
explain themselves how do they feel good
about themselves how do they preserve
their
ego
um so yeah you know yeah we're we're
still at it you think you think we're
giving up on this we're selling red tiny
boxes we're doing
it we sell a computer called the Tiny
Box it comes oh yeah this took oh yeah
you want to see the code for tiny the
logo I worked really hard on this code
boys
yeah that's the
code it turns out you don't have to sell
out but you know for someone who did
sell out for someone who who who had
dreams in their youth and gave up on
them and now work at a now work at a at
a at a at a sad company doing sad things
and have a sad life with a sad wife and
sad kids and a sad house and a sad pool
in the backyard that they have to pay a
pool cleaner
for they got to they got to justify
somehow man you know I look I feel bad I
feel bad but that's just that's just I
don't know like like I look at the hate
and that's that's what a lot of it looks
like
man you know we can we can all we can
all we can all understand that look I
don't hate that man I don't hate that
feeling doesn't go both ways we mostly
feel love there's a few people I hate
but mostly
love um wait how did this
happen uh yeah so we're shipping two
versions of the Tiny Box red and
green you talking about University oh
yes I I saw a comment on the last video
too that I wanted to respond to do we
have some people in here now 300 people
all right you guys get my response to
the
comment writing a fuzzer and not getting
triggered I think the comment was on
this
[Music]
one Alex is cool we like
Alex
no where where's our comment that we
have to respond
to May on this
[Music]
one
I don't know was the comment on this one
we're just we're just looking through
the comments we're going we're going to
try to find the comment it's it's it's
very it's very important comment that we
have to respond
to wait oh what's my major FL
understand by everything by himself hire
a team smarter than me you deal with
funding and expanding your Market I
say damn bro how's your business
doing
wow I don't know man the comment's
gone
no
comment no no comment did I see the back
door yeah you know immediately I saw the
back door and I'm like all right there's
10 more of them good luck go find them
guys of course things are back door
right there's not no no no no we don't
need to we don't need to look for the
comment the comment's not important we
we don't need to be reading comments we
just need to be secure in ourself man
can't just let everybody pull you in
every
direction um it's early we're still
waiting for some people to get in
here uh and we
will uh sh the Tiny Box a little
more good morning hype train
um yeah uh yeah the the driver is uh is
mediocre and I think that I think that's
actually I think that's actually
generous but you
know should we change it to not
great
um but we're going to work to make the
driver
great so we wrote this kfd driver mostly
niml genen and Discord um I did some
cleanups on
uh this is this is the driver that talks
to the raw uh
kernel I talk straight to the kernel
from the GPU so you don't need any
libraries uh in order to use an AMD GPU
with this
driver um we can figure out what
happened
here maybe we should do we want to
improve BR if we want to fix bugs in
this driver look at all this stuff you
need I don't even know what an EOP
buffer
is I know what signals are I know what
guard is I know what kogs are I guess an
EOP buffer is the only one I don't
really
know um okay but let's turn this into
some real documentation okay so I think
probably yeah
here these are
the IP blocks inside the
GPU I think maybe we will start with
that so these are the yeah these are the
like different different pieces of the
GPU and we should be able to dump
registers for each one of them
okay uh documentation for the 7900 XTX
AKA Navi
31 AKA AMD
744c um I don't know what 744c is let
see only stuff about me
and
cool you don't learn this in uni till
third year what are you talking about
man for
what
learn how to argue with large companies
about their GPU
socking yeah let teach that
uni I thought about doing a class
before um
but I kind of wonder if education is at
all
possible like I want to tell you I want
to tell you the truth I I I've never
seen anyone
like you you know at a pretty young age
whether you're ever going to be great at
this stuff or
not it's very rare that I see people in
their later age become great at this
stuff
um it doesn't have to necessarily be
computers that you did at a young age it
can be all sorts of stuff but like you
know it could be math it can be
um give you an idea about how to think
dude they're like selling you some crap
this this this is that's totally
Punk the truth is oh wait why are you
you guys are subscribers we're supposed
to be we're supposed to be smarter than
this the the truth is uni got into this
scam cycle where they basically started
admitting way too many people and then
really lowered the bar for what it
was
um 10 5 to
10% let's look this why why did you guys
get me on this
already uh we got to go further
back
yeah here we
go
um yeah
uh that's probably more more
correct for for what it should
be why is all this weird racist shit on
this page
the amount of the amount of racist shit
on this
page why does educational attainment in
the United States races like why do they
keep talking about race
man
oh I saw another comment asking me why I
supported
diversity and you have to support
diversity because have you not
heard that diversity is our strength
guys just just just just just diversity
is our strength you know that you know
you just Google it and it tells you that
look let's let's Google oh wow we're if
we're Googling diversity as our strength
we've really we've really gone off the
rails um but just every time time you
think something bad about diversity just
remember that it's our strength don't
ask why it's our strength don't don't
look into supporting evidence for that
fact just just remember that diversity
uh is our is our strength so there's
that all right all right all right GPU I
hope controls okay diversity is
diversity is our strength guys it's it's
our strength okay okay don't don't don't
don't like don't don't go beyond that
okay just just just just accept that
uncritically
unquestioningly um remember that
diversity makes us stronger
yes who's Gary
ve why is chat so bad today is this what
you guys you guys like still up you want
like a like a meth Bender all night or
[Music]
something we doing
math all right this is this is pretty
good too here add IP block number oh
let's let's bring that up
here um where's the
driver which one we
in Rich dudes fish food or Rich dudes
fish
food okay so everyone everyone who
complains about diversity just remind
them that diversity is is our strength
guys it's our strength
okay we are
[Music]
farmers okay uh let's figure out where
these IP blocks come
from
this function can I see where calls this
is that
a show call hierarchy I've never like
used the fancy stuff in this
editor oh interesting W that's pretty
cool actually this is exactly what I
expected to be all right
great
um I mean it's nowhere as good as this
cuz that's actually sensible
but okay so that's one way to get at the
A6 we also let's copy and paste this
stuff and bring it up
here okay so which are these things and
then we have we have firmware versions I
think that this one is
better
that looks pretty much the
same all right so we kind of have like
multiple ways to break down what's in
the GPU
here uh we have definitions
here oh yeah how do we did I actually
ever get it to print out what files it
was
loading or did I just how did I get
these I have I have a good scripts going
for rebuilding the uhel I off
all right we also like do I want to like
make this markdown and start editing
this nicely and have like links and
stuff we want these docks to be like
better um where's my instructions for
rebuilding okay uh how do I how do I
edit
markdown
there like a way to like preview mark
down contrl shift
V did not do what I thought it would
do
to switch between views oh press shift
command V there we
go
okay all right how do I get like this to
be yeah we'll have a section for this
we'll have a section for this
we'll have a section for
this so This
changed
so have listing of the IP
blocks
um let's go up here and put this up here
and let's try to format this nicely and
mark
down I like format a list like that Mark
I'm not I'm not a markdown wizard man
I'm just I'm just I'm a very mediocre
markdown
user so I just want to let you know that
diversity is our
strength
um poor Mark Cuban I saw I saw I saw the
uh title of his
Lex and it mentioned it mentioned Dei
and like now he's got to like respond to
that like
dude I so his stuff and it's just like
like you're out of touch with the
culture
man um this file is on my GitHub 7900
XTX it's not on Tiny grad's GitHub tiny
grad will not Sully them elves with the
Nuance of one GPU this is my Sunday boys
some people go to church I document this
GPU um oh that's how you make
lists how I do I tab this in there we go
that
works
oh these parts are all parts of the
CP these parts are
not oh we have the IMU up there too okay
we don't need
that
oh Plum
Bonito we have we have to add a new AKA
AKA Plum
Bonito rid of
that this seems pretty redundant with
the above I don't that stupid version of
that okay we had some nice stuff going
oh you know what's annoying I wonder if
I can diff on this can
I no I wish I could
though what's the implication you guys
are always so into to crap like that
man one of these days you got to move on
you got to move on from
that um
okay I was rebuilding the kernel but did
I document
it oh yeah I did okay
good looks pretty
good
all right let's try the instructions mod
GPU make
drivers my GPU
my
go I kind of like the idea of putting
them like this kind of like nice that's
one line that doesn't fit on one line
over there my documentation is slightly
lower quality we're trying to make high
quality documentation okay diversity is
our
strength
wow what if someone use a slogan
homogene as our strength
man that's a good slogan
too what about the slogan Pizza is our
strength Pizza is our
strength uncritically accept
it
Pizza makes things
stronger Pizza is the Bedrock on which
our society is
built let's see if we can figure out how
to uh diversity make things stronger
this guy knows what's up man that's
right and you know what for the for the
for the for the ad iq's in the room it's
this is a form of look if you're in
Soviet Russia and you want to critic
criticize Stalin you might not want to
say Stalin sucks that's not a very
clever way to criticize Stalin you might
want to say something more along the
lines of 50 stalins we need 50 stalins
everything needs to be more stalins
Stalin is our strength man and then you
see Stalin can't really like like be
upset with you man because diversity is
our strength okay like it's our strength
it brings people to together like Pizza
Planet oh shit no way man no way no way
no way diversity in your backyard in
tiny grad we keep things we keep things
lean and clean and you know
good is there a chance at adiq I don't
know who's asking those questions about
going to college
man
um College average IQ of college
woo all right guys 50 stalins Stalin is
our
strength
pull
pot uh oh what oh I bought some
Cambodian solar panels
recently um yeah I bought I got I got
into solar solar is my new hobby all
right I bought I bought 10 solar panels
solar panels you can't believe how cheap
these things are it's like from like
like sunlight solar or
something sunlight solar no not this
this one looks like a scam so a lot of
them are
scams
um cheap panels I forget the name it was
it was something as stupid as sunlight
solar but no no no no right I'll look
that for you guys I'll look it up for
you guys because solar is my new
hobby
um but then I I'll tell you about the
problems with
solar see signature solar that's
it I do still have land
yes I might go to the land
today yeah these people signature solar
see sunai solar scam but if you can buy
the panels so I'll show you guys the
panels I bought wait these ones are oh
it's these panels okay look at the price
of these
panels
22 23 per
watt like can you believe
that that's so
cheap batteries are still expensive okay
so batteries are expensive but inverters
and panels are
cheap but what's even more expensive
than both batteries and everything is
installation if somebody figures out how
to install these things cheap like I I
have land I'm tempted to just like lay
them out on my
land
uh there also people connect these
things in series which is really
insanely
dangerous um like you have if you
connect these things in series you have
like a 500 volt if you connect like 10
of these in series you have a 410 volt
DC Source capable of sourcing 11 amps
that you can't turn
off I don't know so that that's getting
es me out um so you know I really got to
understand a lot more uh how you're
supposed to do that
safely uh but the panels are dirt cheap
so I bought 10 panels just just YOLO and
we're going to see what
happens
um so now we can go in and we can edit
the thing here let's find out how it
gets the
[Music]
how does it get here so we have load IP
firmware how does it get the file guys
does it use diversity all right we're
done ripping on diversity okay diversity
is important to a lot of people we have
to think of all the people who built
their careers in diversity and if
diversity goes away it's not like
they're qualified to be like plumbers or
solar panel installers shit if we got
every diversity fuck to start doing
solar panel installation all you used to
be the cheap University officer now you
install solar Ps that would make a
difference and solve global warming we
could do that we could do
that um well no I mean Siri sucks too I
really like
microinverters um but microinverters are
expensive don't be a misogynist bro
women are great okay stop stop man you
know who's a misogynist incels and
everyone agrees that we hate incels so
much that I can't even say incel on my
channel because you know the incel the
feine will come for me or something man
you got awise we don't we don't hate
incels man we we we we we we think that
you have a misguided view on the world
and we'd love to show you the light
diversity is our strength all right know
we're really we're really going off the
rails we're really we're really going
off the rails you
know
I don't need to improve my panels
efficiency panels are dirt cheap I just
need to figure out how to install the
panels for
cheap wait you're starting to feel that
Hots really feels diversity is pointless
I hope not too no no no no no you're
you're missing you're missing the point
guys diversity is our strength okay
strength um no you know you know my real
thoughts my real thoughts are uh global
warming is going to kill us all and
that's why we need more solar panels and
we need more solar panel installers and
if we could repurpose the
administrations of University and
hospitals and get them to put some boots
on and some gloves on and start
installing solar panels they too can
help us fight global
warming you run solar Edge Inver with
optimizers on each panel what's an
Optimizer you want to link me to one I
mean so my understanding is that if you
connect them in in series if one of them
get shaded they all lose power but if
you connect them in parallel you got to
put fuses on all of
them um but parallel I mean look DC
voltage above like 50 Vols is actually
pretty
dangerous uh solar Edge Optimizer let's
see achieve your panel's full
potential so how much are these little
do
hies what what do they do what's in
them DC is fine up yeah yeah it's not
like 100 but I'm saying they're using
like 400
volts all efficiency over problems can
be overcome by adding more panels I
agree you see the problem is it's
installing the panels is so
expensive
[Music]
um see I can't pay $99 for for an
Optimizer when this it's like the same
it's the same order of magnitude as the
panel which is the
problem what does the optimizer
do it's running
mppt sort of interesting
so my understanding of mppt is that it
does um so like you have a you're you're
you have to present a load to the panel
and you want to present the maximum
amount of load in order to get Peak
power right so if you present no load at
all you're going to have the highest
voltage but you're going to have no
current if you present a short circuit
you're going to have no voltage but a
lot of current uh you want to find the
point in the Middle where you maximize
the
product if your panels are so cheap
cheap the upside of micro inverters are
pretty limited yeah I just I don't
really like just from like a safety
perspective I'm kind of sketched out
connecting lots of these things in
series but I don't know I probably just
have to figure out how to do it
safely
um it looks like you have like it looks
like you have like like a chain of like
10 panels and you connect 10 panels into
an
inverter
um the fancy mc4 connectors seem pretty
sick
safe I don't
know am I connecting them to the grid so
I have to look into connecting them to
the grid I'm not interested in selling
power back to the grid uh so comma has a
50 Kow like base load like I we have we
have power monitoring at comma and I was
checking it out yesterday and our system
our whole power draw never goes below 50
Kow so I get 50 Kow basically for free I
don't need batteries I don't need to
sell to the grid um if I can just get
system that can generate 50
Kow so do I want to push power back into
the grid no do I want to be grid tied
yeah I'd rather be grid tied but I have
to look into the uh regulations around
this um hopefully it's like not too hard
and you just have to do I have inverters
no no I bought I bought 10 I bought a
few inverters um I bought some I bought
some Chinese little inverters
uh to play with my 10 test panels but
the biggest problem is installation do
you guys have any ideas like I want to I
I no this is for comma um well so we're
currently at at at office like we had
all right technically this is office 3
but we call it office 2 uh at office 3 I
want to install a 2 megawatt I want a 2
megawatt saw two 2 3 megawatt um cuz
again the panels are dir cheap but the
minute you start to like say put them on
the roof or put them on a carport you're
just blowing out your entire Budget on
installation is it a flat roof we have
one section of the roof that's flat but
um the section of the roof that's flat
could probably fit like 100 panels and I
was I was standing on it yesterday but
the problem is
uh you have to figure out how to get the
panels up there and then okay now you
got to attach them right so do I have to
bolt them to the roof or can I just make
him
heavy oh just hire one Oompa Loompa yeah
diversity is our strength I should hire
LPA loas can can I get them somewhere I
heard they live in Loompa
land
um oh I heard about yeah wait let's look
this up my friend mentions this
yesterday the salt energy storage but
again I don't care about energy storage
if I just have a baseline I I just need
50 Kow basically if I just have panels
that can generate 50 KW I can buy an
inverter for nothing which panels did I
get uh I showed the
panels what was the name of that place
again sunlight
something they all the most like solar
names it reminds me of like you buy
research chemicals from like all those
like like uh like smart drug
systems signature solar yeah yeah that's
what it's like all those old like
research chemical place called a place
that would sell like bat salts
mefedron
um let's look more into the pan I bought
these guys NE
solar Cambodia see I told you is the
Paul pot guy that got me off of this we
went from look okay just to let you know
that people can come out of communist
hell
popot is over and now Cambodia makes
solar panels and participates in the
global
economy okay so diversity really is our
strength don't don't ever doubt it
um I don't know I haven't been to
Cambodia i' like to go oh the kingdom of
Cambodia
I been like Vietnam Thailand and stuff
to
Cambodia wait these panels are half cell
what does that mean I I knew we'd have
some solar Geniuses in chat I don't care
if they're well paid I care if it's
cheap for me to buy I'm sorry I'm sorry
I'm sorry it's not look man you're
wearing Nikes bro you know they use
child labor in
Cambodia
no this is important we're understanding
solar panels all right every time I say
that what diversity is our strength guys
it's our strength haven't you heard just
just just ask anyone everyone knows
this
um if I have a flat roof looking to
installing the panels vertically or
horizontally why are they ISO I don't
know um no but the the whole problem is
installing the panels installing the
panels is very very
expensive
um I'm not even worried about the
guaranteed output I'll buy more
panels
uh you need to think bigger all right
we're not we're not getting a reactor
can I just make it heavy do I care about
permits yes I do well yes absolutely no
I care about following code if if does
code say I can make it heavy I don't
know
um panels are
heavy
um
uh I heard yeah I heard don't go with
Tesla panels I don't know I I just I
can't get over how cheap these panels
are and then they're even cheaper if you
buy them in more
bulk um I just like like these have come
down so much in
price well but then also like they scam
you with this like look so you Google it
and like 382 per watt yeah but why it's
this is this is this 25 cents a
watt entire utility scale PV system cost
about a dollar or watt yeah I think I
can still do it for
Less I I want to do like a 2 megawatt
installation at the next comma office
for like a million
bucks
yeah look at that it's More's law for
solar
panels they do have install in the
equation but that's what I'm saying the
install price dwarfs the
uh I had a solar panel my parents got
solar panel for Christmas one
year
the high install cost is the racking
what's racking why is this expensive I
don't care about the government rebates
I'm not here to run government scams if
I wanted to run government scams I just
rob
banks I care about the real cost yeah
look at this look at the oh yeah look at
the see that's progress man I don't know
if that's diversity but that's our
strength oh wait wait
wait capitalism is our strength Mar
markets are our strength see now we're
talking markets are our strength love
markets
man everyone who doesn't love markets
hasn't been properly introduced to
them get firmware type okay oh yeah yeah
I remember what this is
so how do I I get the this has to like
load the firmware right I don't know if
there's
like there got to be like like there's
got to be like normal like Linux like
somehow it's actually opening this file
right where's like lib firmware in the
kernel it's not theel it's somewhere
else in the
kernel
documentation
find the API that's
used path request
firmware
I oh here we go request
firmware not
Fiji UMD GPU Discovery request firw from
file U code
request let's just try
this
okay is that all of
them I mean why is the U code request so
much before the
uh this
stuff do I how did
this
like I wrote this stuff did I not why is
this one that color and this one that
but I don't
know
whatever
um this is good to put in our
documentation because here's another way
we can list the IP
block this include all of them
I am pfp me
RLC M ms1 why why is there no there's no
real
Mees there's just mes1 and
mes2 so maybe those are the only ones we
care
about plagiarism is our
strength is the new Harvard
slogan
um what's the verdict of the 10 the repo
for the docks is 7900 XTX it's on my
GitHub uh what's the verdict on the 10
torant card the verdict on the T torant
card is they have a really long software
journey ahead of them
um like it is easier to fix
AMD uh Hardware than to try to
uh
yeah to try to write sofware for t St
okay so yeah PSP we have
those let's let's just add in whenever
we have a name of a file let's add in
the name of the file and let's make sure
we have every file up
here
should we put these in order maybe we
should put these in
order in load
order so first we load the SMU then we
load the display core
next
uh okay then we get to the GC pfp me RLC
MEC
okay
pfp wow look at all the places there can
be bugs okay we also don't know yet what
um what kind of
processor uh is actually running the
firmware okay pfp me let me copy and
paste all this stuff so I can do it
without having to
scroll okay me uh RLC goes next I don't
know does it like make sense to keep
some of these as like part of the CP and
part of not the CP
whatever I like this ordering a lot run
list
controller uh it doesn't look like
there's really two of these I don't know
why I thought there were
do we have any evidence that there's two
I don't know I'll just make it
one video core
next
um
Mac
the constant engine doesn't seem to
exist
anymore integrated memory control
utility and let's make sure we put both
in M
okay uh AMD told me they were going to
open source the mees uh do we believe
them they told me they were going to
release a blog post a week ago no blog
post
like uh oh we already bypassed all the
user space you can this is already
Upstream in tiny grad if you run with
kfd equals
1 uh so you'll see how few IO controls
it's actually using like this is an
nness
trainer
um it's actually calling way too many IO
controls still like these weight event
should not be things
but there're a big or give them I mean
they told me they'd release a blog post
by a certain date and they didn't do it
so you know I don't know I have very
little faith in them
okay so that's pretty good we have an
understanding of what each where each
piece of firmware goes some of these
things aren't
firmware great um now let's figure out
how these things correspond to these
things okay so I would assume
that this thing is
gfx
uh
lsdm 6 let's see was
right um video core next is
here
uh
SM
be this
thing that's all the SMU I have
right so what's really cool about uh
UMR is we can do like
UMR
uh not
lb we want to dump
registers scan that's it so umrs and we
can like take one of these and then we
can look at all the registers in the
SMU it's pretty
cool um so notice that the PSP is not
existent here uh it's because they don't
release this stuff for the
PSP it's not that it's not here it's
that it's when you read the docs for UMR
it says that uh yeah you
don't okay that looks that looks
complete
then
um what what is DF
420 doesn't have very much stuff
anyway what
MP this one is more I don't know what
that
is
in the dock last week when you found out
the CP was actually a
thing
yeah um well these are all the pieces of
firmware running and now we can like
correspond them to the different IP
blocks oh did we miss any here what's
DM
I don't know we found out where all
those things go so I don't know if
there's
more oh we should
also uh I found that was good
instructions for Yun to
Kernel build
source
don't use app SCE why is Google so
bad there like a good website for this
that like explains it and says don't use
appsource whatever
there's like a source package you can
install for the
[Music]
kernel uh colel Source
package app get Source Linux Source I
feel like I didn't do
that
um
[Music]
no um
whatever I really would rather have a
uh I I wonder if this Colonel is
patched
I I remember we brought it up on the
last stream maybe someone can find it it
was like
uh it said don't use app Source instead
use this other install thing and it was
better now um okay so I understand a few
things about AMD now um so one I think
they pulled everybody off of radon and
put them on
Instinct um which also doesn't seem to
be particularly good uh
look AMD hasn't managed to get mi3 300
on ML perf uh it seems like you can only
rent them under NDA I don't know why
some people are saying good things about
them I'm very I'm more bullish on Intel
gouty uh than I am on Mi
300 uh so I think but I think everyone
was pull off radi on and put on Instinct
but I also think the processes at AMD
are fundamentally broken they aren't
trying they don't seem to believe in
like like apis and like isolation
testing things in
isolation entire testing workflow seems
to be based around applications meaning
like what they kept asking me for was
like can you like show me an application
that crashes and I'm like this isn't
really the point right you're not
supposed to find a single crash and then
fix it I can show you a fuzzer that
makes tons and tons and tons of crashes
but does it impact your application this
isn't really the right way to think
about building good
software um so yeah no I'm pretty
bearish
on like AMD getting their shit together
longer
term but that doesn't mean that we can't
you know have fun building a red Tiny
Box and that's what we're going to
do uh you have to give them a reducible
uh Ro reducible crash for them to
concrete fix it oh I've given them
plenty of reproducible crashes that's
not the problem the the problem is that
they think about it in terms of
application not in terms of like testing
things in
isolation um I also heard that they
don't have a single 7900 XTX C
inci
like you know comma is so much smaller
than AMD our Hardware total revenue from
the hardware is so much lower and we
have 10 devices in
CI yeah I I heard they don't have a sing
one in C so you know Jud judge that
judge that for for for what you
will this
guy don't use app get
source
turn racing thank you for gifting Subs
um I don't know how to fix
this I should have I should have posted
a link went to it somewhere I
did oh here this one this one this one
perfect I
did
they deserve to lose to Intel I mean it
doesn't matter if like what they deserve
right like it kind of matters and this
is kind of how I came to peace with the
whole AMD situation it's like yeah I
mean the company look they're they're
just
not it's not going to be great I I but
it is what it is right it's better than
any chip I've built so you know you just
kind of have to accept
that um like until I've taped out a
better chip than AMD like I can sit here
and complain about them but you know
okay well if you can buy their chip you
can buy nvidia's chip or you can buy
Intel's chip they all have tradeoffs
like engineering is all about
tradeoffs so you know you just like this
one has a shitty driver uh Nvidia is
overpriced and supports a monopoly and
uh Intel has a underpowered GPU right so
you have like just just trade off of
trifectas Welcome to
engineering
my planning a blue tiny oxic what the
hell do you mean by planning you know I
feel like people don't empathize with
companies
enough
get nice syntax highlighting like that
but there
oh the deob is loaded via the PSP I mean
everything's loaded via the PSP uh it's
not that
interesting
delete this
stuff uh I will put this up here
by those are just good things to copy
and paste
okay we don't care about
that that stuff's not
interesting that's not
interesting maybe we'll just have a
generic section at the bottom here
called links and I'll just take all the
links CU I don't want to delete links
who knows when I might need
one
why are these oh
like
this one isn't right this one isn't
right already copy that one okay
cool
we can put the links higher maybe and
this listing IP blocks thing and just go
at the
bottom
I'm not going to open Score
shit
oh um GP recovery equals z is kind of
interesting
okay that goes
there that stuff's
done I don't care about that crash copy
and pasted that above that's all copy
and pasted
[Music]
above I don't know about that oh arterus
isn't this like I don't
know delete this stuff and
then
put this in the more acronym
section
are these docks being sent to AMD I'm
not sending anything to AMD guys they're
not going to help us I I I don't know if
I was just being trolled by them or like
they it's indifference or I I it was it
was a whole it was a weird
interaction like I I don't know if it
was capability my my best guess of what
actually happened is that they didn't
treat
what I was saying like a problem with
their GPU they treated what I was saying
like a problem with their
PR um and they handled it like a PR
problem and again uh you know on the on
the spectrum of agreeableness I'm a
pretty disagreeable person um you know
they they miscalculated and they thought
that like oh you know I'd get like a
response from Lisa Sue that says we care
and that that would be something but you
know after after 9 months they didn't
fix any B they didn't open source
anything they didn't give me any
documentation like I'm not
stupid you know when when you actually
look for results they delivered none um
which you know really does say a lot
about the company too that this also
like it speaks to if they think that
approach would work with me this is
probably the approach they use to manage
employees as well so you have to think
about who sticks around at at AMD right
like you don't actually have to show
results you have to like kind of talk
about how you're going to repeatedly
show results and I see that over and
over again you know it's interesting in
our Discord to watch the difference
between the AMD people and the Intel
people um the Intel people make me more
bullish on Intel the AMD people make me
more bearish on
AMD um we attempted to put millions of
dollars of orders in with them and they
gave zero fucks back then I'm sure it's
the same now
[Music]
uh they don't care about the end users
unless you're like Microsoft or Dell or
something I mean it's it's funny like
they don't care it's kind of you know I
don't like that it's like uh it's it's
like the you know I saw like a Jimmy
Fallon thing one shaming Republicans for
not caring about about like mass
shootings and it's like I think that's
not exactly right I think there's
tradeoffs right so yeah it is definitely
not I I would say that it is definitely
correct to say that it is not one of
amd's high priorities to make these gpus
stable for end
users
um I mean again also you know a
company's made up of a lot of people I
think there are some individuals within
AMD who care but the firmware doesn't
like the the firmware and the GPU don't
get to be like this without something
being
broken I don't think it's different
right the same
leadership
um and if anything they've gotten more
and more brain drained by
Nvidia uh when when you have one
dominant player like that that right
Nvidia can
invest there's almost like Nvidia will
pay as much money as they possibly can
to make the b200 better if anyone's good
at AMD and Nvidia is capable of
identifying them why would you not just
offer that person you
know a better deal and be like come join
the winning team you
know these particular bugs really affect
Enterprise users well okay so the
instincts on different stuff I don't
know I look I I bought some old
instincts I found the drivers equally
shit but I don't know maybe the new
instincts are
better
um okay so let's get into some
documentation
um is that
there uh that's pretty nice's let's take
a look at that on GitHub and see if who
it looks good on
GitHub
okay pretty
good
so the parts that we care about maybe
maybe we should play with system dma
because system dma is uh is pretty cool
and we just added system dma and by we
niml genen added system dma support to
uh Ops afd here so we have a this is
this is really cool stuff we can we can
use the uh the the sdma right here right
so maybe you want to write a you want to
write something and we'll play with sdma
a bit we'll see what we can
do example not examples extra H GPU
driver um test sdma
fine I think we're going to want to
import this and just use it U from kind
runtime there's a lot of crap in here I
don't
want somewh should be distinct stuff I
should really break this out into
classes there's some stuff in here I do
want we really need the C to be separate
classes I don't know we can just create
a second queue
it's see that's something co-pilot would
help me if I use
co-pilot so let's go in here Xtra HP dpu
driver test sdma fun use I one and see
where the iy are Okay cool so it's it's
doing a lot of
stuff um probably not all things that we
need to do like AQL ring right that's
not actually used to the que is
it we can be better about what's CTX
save restore address that's also not
used until the cube right
yeah see like that's more part of the
queue I don't really want to create
these
cues really need the signal
[Music]
either um what's EOP buffer EOP buffer
is again like part of this
queue ENT page SN
event
guard kerog isn't use I mean Kars is
really
stupid okay I'll acquire VM I know let's
just return
here great so all we did was acquire the
VM um let's create an s dma
Q so we have sdma ring here uh we have
to change we can import the same
kfd uh we'll change that self to Dev and
now we have a
braen
oh wow okay we got a th people you guys
are really interested in this stuff I
guess I guess gpus are
cool
um okay so what's
interesting um let's just start with
let's just start with something very
very
simple so this is creating a q oh we
have K here we can import K from that as
well
um so these are all the arguments to the
Q uh we have a ring Base address that's
sdma ring sdma
size get the GPU ID from the driver
that all looks good okay we do need G as
well so G is they call it gtt we might
want to use gtt G might be the old name
for these
things uh but gtt this is
[Music]
um Graphics translation table it's an
IU graphics card direct so this is just
I don't really understand what the
difference is between gtt and user
pointer but whatever so this creates a
q we can run it and see if Q creation
works great so you see okay we're
requiring the
VM we allocate map the memory twice and
then we create the queue does that make
sense to everyone all right good doesn't
make sense to you try
College have you considered
College okay so let's create an sdma oh
we have to import sdma packets
to Let's create a packet up here that's
just a time stamp
up where's AMD
SDM that crap
too okay
why is K here but I use K there and it
doesn't work
whatever um so this is just a this is
just a Tim stamp instruction and we can
put this instruction in the sdq and we
should be able to see it
uh write
something for
address we should just be able to where
is this where does this completion
signal
live
uh C address of dat completion signal
where do I actually create
this signals page it's user pointer
okay um let just allocate one more thing
we'll call it test
all right now we can do address here we
can say
test.
Adder okay so now we have this packet
here
um we're going to put it in oh we need a
doorbell
value
make
this wait what how does this
work oh I'm moving it okay that's fine
this is happening
on this me move happens in the CPO Okay
cool so we're putting we we're basically
we're constructing this packet we're
putting it in the ring and then we ring
the doorbell where's the
doorbell
self doorbell plus equals size okay
that's good I mean we can just keep with
command it's kind
of does that work or need non locals I
might need non locals
whatever uh so yeah here we go let we do
stma right
pointer uh
should create
those make pointer address great and
then we need where's the doorbell at oh
I have to map the doorbells oh oh okay
fine think I should be able to M the
doorbells from the sdma
Q we map it from the
aqlq
here yeah okay that just does that okay
um we need lip CM map
crap
great and then we write the doorbell
here
okay so if we did this
right when we look at um
what test right page here when we look
at test right page
here uh let's print test no we can't
just do test right page let do 2 MV test
right page cast
Q let's print
that and then let's print that after we
ring the doorbell I don't know I'm going
to throw time sleep in there see 2.1 or
something okay let see if we get a Time
St
[Music]
oh and that's not actually right either
we have to say
uh okay well zero both times so that
actually didn't
work I'm also going to watch
rock
msmi this keeps the GPU alive and then
my thing runs faster see see the
difference in the
time all right so they're both zero
unfortunately what did I do wrong so I'm
creating a timestamp packet subop
timestamp get Global and I'm trying to
write it to this right page
here okay and then
I print it oh we never actually blit the
command I see
uh so let's split the commands set the
doorbell value let's
go uh yeah this is reference before
soal I don't know maybe we should just
get rid of
this okay there we
go right and that's a that's a time
stamp um
no I kind of like with command whatever
we'll leave
it local
what
what happy
okay good so that gives us a number
that's a time I have an idea actually
let's shut that down for a
minute wait for the GP you to go to
sleep all that mess
crap see if I wake the GPU up the number
gets
small uh so I bet you this number
is let's try
that I think the numbers are in
NCS
doesn't seem
right U I have another place where I
look at numbers
here it is
one9 uh okay let's see if we can figure
out
let's try a few of these and see what we
get okay so there we go it's just I'm
just off by one CU we're sleeping for
one so let's sleep for a whole second
and see if it doesn't increment the
seconds n okay okay so cool it's
actually just 1 E8 I don't know why it's
1 E8 it's it's measured in 10
NS all right good good look we have
accurate timing so what we just did was
we got the sdma engine to write out
these time stamps uh from the
GPU which are pretty
cool
um I think we can also just look at
let's look at stma read pointer and do a
spin lock
here
uh repo
address so we can print St instead of
doing this time. steep we can say while
uh stma read pointer is not equal to
sdma right
pointer
continue
now let's do that as fast as we can okay
good uh is it actually writing different
times though let's add a few more digits
to
that yeah great all right so that gives
us an idea of how long these things are
actually
taking we can add time
here boom
beautiful all right good we're we're
using the sdma engine uh that seems
pretty that seems pretty pretty
reasonable
right crap from the
mees can I put kernels in the Q to and
run with the doorbell well I can put
kernels in the other kind of que so if
you read the driver here we create two
kinds of cues this is a AQL Q where you
can put uh kernels and barriers and this
is an sdma Q where you put these sdma
instructions
all right
um
so there's some stuff in UMR where so
I'll show you the the stuff we're using
now we can get crazy with this sdma
engine well what should we what should
we do with the SDM
engine we should be able to make it make
copies we can invalidate cashes we can
do all sorts of
stuff we can have it pull regman we can
have it wait for something
thing um yeah tons of tons of cool stuff
we can do with the sdma
engine let's see how big this firmware
file is it' be cool if we can figure out
how to actually like correspond these
things to the firmware files let's Also
let's take a quick dump of the uh of the
registers of the SDM engine and see what
we're dealing with
here
all right so it looks like in reality
there's two
Q's I think that
unfortunately this is talking to the
mees I think we actually have good
knowledge that it's talking to the
stupid
Mees
um
yeah Mass message 14 Mass message 2 m
message
3 uh I think those are like add Q remove
Q crap we can look in the
uh okay I
mean maybe we can make a new folder
called docs and create Mees MD and then
how do I link to
it sorry I'm not a I'm not a
something like that how do I how do I
link and
markdown can i max out the PCI boss we
can try I don't know this computer's
crap I don't know what we're even
connected on here this isn't a tiny box
this just my local shitbox
computer how do I do how do I do
links probably do them tiny graits just
at so it's like
this
stands for micro engine
scheduler all
cues created
with
this isn't actually there's a lot more
to it than
that appear to go on the
mees
which then dispatches
do the hardware cues I I really want
them to open source this like you think
you think they're going to come through
and open source this they told me they
would they released a
timeline do we believe them or
not
so it looks like if we go down in here
um like sdma actually has actually has
two Hardware cues here right so you can
see you can see these are the hardware
cues and what we're going to do is we're
going to pull those registers really
quickly to see what we can
get um so Q's have a ib and an RB and
there's two of
them
Pi has two Hardware
cues we don't say a P2 go on the mes
look all this documentation might be
wrong um let me get these Mees messages
I think that's probably the main thing
we care about here so there are
some uh docs here here Mees API def Mees
op code okay this
oh the aggregated DB quantums Z set
great um so what do we
do we do a couple 14s we do an add q and
we do a remove Q
great they've shown no reason for us to
trust them yeah I
know like everything is just like oh
we're getting to that we're getting to
that we care like you don't
man like stop saying like part of the
thing that's just so offensive is just
just a blatant like
lying like why don't you just say like
look I mean honestly this isn't like
really very important to us we don't
even have one of these gpus in
CI like I'm sorry you bought one you
bought a shit product right like
I don't know just be honest and say that
right like this is not our you know okay
you don't just say we bought a shit
product you can just say this is not our
priority right now look uh they can
quote Maris brownley and say uh look if
you're not uh if you're not happy with
the software don't buy the hardware and
like I can respect that I can respect
that philosophically as a position right
like look the drivers aren't going to
get better and I I did I did I like
accepted it like we're still selling a
red Tiny Box and I accept that the
drivers from m d are not going to get
better do I think they're maliciously
lying no I think yeah I think they're
saving face over spitting facts yeah I
think that's what it
is like it's not it's not that they they
don't want the driver to be better it's
just that they don't really care right
it's it's not a priority for them as a
company and yeah I mean look people
point this out I I think there was a
there was a Twitter that said like look
AMD is actually you know lowkey happy
with this situation uh it just shows the
value of their Enterprise offering and
like yeah I think that there I think
that there's definitely truth to that
right I I the person who I feel really
bad for is the person who like bought
this GPU and like tried to use it home
for machine learning and the person who
actually like saved up money and bought
this GPU look you know I buy these
things and like again AMD is very nice
they offer to buy my gpus back right I
do the same thing at comma I'm like look
if you're really having that bad a time
and this is why we have the 30-day money
back guarantee like I just don't want
you to have our
product
um
uh um if everyone's abandoned in
consumer gpus well they're not what the
4090 is work incredible want to see a
great Tiny Box check out tiny
15 tiny 15 is a green Tiny Box I have
never seen any bugs with it it's just
it's just
amazing like you're not going to find
any problems with it it's expensive but
you know you get what you pay
for Al I don't know about abandoning
consumer
gpus
all right like those are the there's the
there's that's a tiny box green and I'll
show you Tiny Box
red there's a tiny box
red someone's using it for
something um no I mean in video
the again a huge red flag and people
buying mi30 should understand this is
that AMD forked their driver basically
two generations
ago uh D message W on
red that's
weird
I don't know where the D message went on
Tiny
13 oh someone else probably is D message
W open and it's consuming I don't know
actually I don't
know that's weird I don't know here you
want to go to like 11 or something 11
has a AMD as
well there you
go
um event page is already set
maybe it'll be a split skew of gamer
consumer and AI consumer no I mean these
these drivers are these same bugs exist
for gaming too right go online and
search for like my AMD GPU crashes 3
hours into every
game okay so these are the real uh goes
on the mees which then dispatches to the
hardware cues of their
respective
uh
Hardware blocks right so let's this is
these are all the commands let's look
into um adding and removing
cues so again we can just copy and paste
the AP eyes from the colonel driver
here
um cool so these are pretty much the
same okay so this is this is the wait
what union hate unions man no actually I
don't know if I hate unions okay I was
thinking about unions and I was thinking
maybe Engineers need to unionize but
like it can't be like lame unions that
are actually Comm shit right like like
Engineers of the World Unite if if all
the engineers of the world stopped
making stuff shitty like nothing would
be shitty the business people would just
it'd be like the guy in Atlas shrugs
who's like pushing the coal train
through the uh through the thing right
if Engineers stop like
like they don't we don't need them they
need
us and it you know it's the same they
they use manipulation
tactics um that like I don't understand
why so many people fall for them they
don't have anything you need you
understand how the world Works they
don't I don't I don't know that's I mean
this is how I've always viewed it and I
don't know
why you don't care about
roving so this is how you add a q to the
mees uh no then why do they have the
power well they have the power because
they're good at manipulating people
right that that that's their that's
their
skill
um hopefully yeah I I mean I think
also like the at least what's happened
kind of with the US government is nobody
really wanted these jobs so I mean the
worst sort of people took them and yeah
now like we're ruled by the worst sort
of
people well I think things might
change uh I I'm hoping that what AI ends
up doing people think AI is going to
automate engineers and you can't really
automate
Engineers um I mean you can automate
certain parts of engineering but
engineering itself is tool complete
meaning that there's two ways things can
happen but most things almost always
happen okay computers don't replace
jobs it's not like there was a job that
like take the job of accountant right
computers did not replace accountants
there's still a job called accountants
it's just what one accountant can do
today took 10 accountants in the past um
computers are tools at least for now
that help people be more efficient and
and
productive so there is a sort
of it's going to be very interesting to
see how these AI systems
evolve and what skill skills they are
actually capable of replacing uh if you
notice GPT is very very good at
writing um you know it writes a lot like
these people where it can't really write
code people think it can
code you don't know what coding
is
uh try to allow engineering to lead
product well no I'm not talking about
there's also there's there's also a role
for
like product is a real thing operations
are a real thing these are real things
right there's no like product is
engineering there may be some Engineers
who just want to build there may be some
Engineers who want to do product work
that's totally fine the key thing is is
that they're they're that like everyone
is sort of following the engineering
mindset and the key thing about the
engineering mindset is that what you are
manipulating is things and not people
it's the people manipulators who need to
go um you know whether you're
manipulating look a designer is an
engineer there's no there's no
distinction there right you're just
you're just engineering a different
thing everybody everybody who creates is
an
engineer everybody who who who well
let's talk about who's not an engineer
right an administrator is not an
engineer
um yeah the the people who got into the
people who got into offshoring the
people who got into like all forms of
Outsourcing right look at what destroyed
Boeing Boeing went from having Engineers
to like not having
Engineers a customer support engineer
yeah to an
extent I do think there is a somewhat
distinct role from engineering which is
operations which means you keep systems
running there is somewhat of a
distinction between building the system
and maintaining the system like a
technician who maintains the system
they're not quite an engineer right it's
more of an operational role but there's
nothing like like this is a very
legitimate role
also um they're not in the group of
people who I'd like to exclude yeah this
is what destroyed America totally
completely um like this this this
parasitic class basically took
over uh Boeing lost a culture of quality
in Le of capital gains but it wasn't the
same people right Boeing forced certain
people out
basically um you know and put certain
other people in I think the the stock
market's responsible for a lot of these
negative
incentives again the best I can hope to
do is I want you to if if no people
blame the merger I'm not so sure it's
the
merger um the merger wasn't great but
why did the merger
happen um no it's the whole idea of it's
the whole idea of Outsourcing well you
can't go public I mean Wall Street is
certainly responsible for a lot of
this um and I think at the root of you
get to you get to the real root of all
of this and it's the fake money if the
money wasn't fake the thing about the
money being fake and this is the
difference between gold and uh and Fiat
and Bitcoin right Bitcoin and the are
the same in this way I think I think
we'll we'll even we'll even write this
in a document because it's important
enough to understand
okay how do you get more
gold how do you get more
FIA
okay this is this is this is the if you
understand this understand what happened
and you can start to correct it okay how
do you get more Fiat
manipulate the guy with the money
printer
okay how do you get more gold manipulate
the
ground right
very
clear that if we have a fiat currency
we're going to live in a society that
manipulates
people if we have gold we're going to
live in a society that manipulates
things we have to get rid of for y
currency
now how do you get more Bitcoin
so bitcoin's somewhere in the middle all
right one way is to mine
it but the other way is to manipulate
the guy with with commit access to
source code
right
um
yeah
yeah uh manipulate the source code Fork
it Etc
right
so the the problem with Bitcoin and the
reason it doesn't it's not going to to
succeed is yeah these this
problem and you think oh no no no no no
21 million it's a meme it's not going to
change it's going to
change it's been around for so little
time the switch from proof of work to
proof of stake for ethereum is what
totally lost my interest in crypto I
just realized that these things were not
going to like if they can just change
proof of work to proof of stake like
that there there's no there there's no
lindin at these chains oh Bitcoin been
around since 2010 yeah like less time
than like the housing crisis right there
there's
no yeah it's
unfortunate it's it's unfortunate that
unless you can figure out how to build
and I'm not saying it's impossible it is
an engineering challenge if you could
figure out how to build a system that's
actually forking it is a little bit
different but you can manipulate the
source code and do do you think that the
Bitcoin source code would be able to
stand up against the sustained attack
from the
[Applause]
CIA do do you really think 21 million
could stand up against a sustained CIA
attack right you know what could stand
up against a sustained CIA attack the
gold the CIA could devote all their
resources into turning lead into gold
and I don't think they're going to have
a good
time no you say there are so many nodes
right but but how redundant are those
those nodes truly right let me explain
to you do not understand how the CIA
works right the CIA figures out okay
here's the node operators here's some we
can nudge The Narrative a tiny bit this
is how you do it as an intelligence
agency you figure out how to nudge it a
tiny bit okay how can we we're not going
to go straight for advocating 42 million
Bitcoin right that's not going to work
we're going to talk about how to slowly
infiltrate the organization how to
slowly get people re receptive to these
narratives we're going to come up with a
10-year plan fundamentally because you
can manipulate people I don't know how
to do strike through in this editor but
it will not be things it will be
people gold works because no matter how
hard no matter how hard the CIA tries
there's no one you can manipulate to to
get
gold um
no you don't even have to cut the
internet cables you're not thinking
about how this works it's not going to
be some some some major event to bring
down Bitcoin this is apocalyptic fantasy
this isn't actually how you do this
stuff you slowly over many years subtly
manipulate a group of people to start
believing the things you want to believe
you want them to believe and then you
make the change you can't do that with
gold you can't subtly manipulate the
ground
the this is why we live in a fucked
Society
okay as long as the reward function is
the manipulation of people this right
here is why Engineers are ruled by by
you know the the Psychopaths that rule
us
today sure sounds like if the money's
gold well who do you want well shit man
how do we move how do we move a th000
tons of rock who figures out how to do
do that
Engineers what if the state bans the use
of gold as a currency well that's a bad
state if that's a bad State and you
should use violence against that
state he who controls the
spice um so yeah this is why I don't
think Bitcoin works this is why I don't
think crypto Works unless someone the
forks are less of a problem you can
always Fork people can always like
change their mind about what's valuable
but as long as source code manipulation
is possible hopefully everyone
understands this from the XZ thing right
like that that's that's that's an attack
and a little bit different but
yeah right systems are not resilient to
this gold is resilient to this and until
we move back to a hard currency uh we're
going to continue to get more of this
crap
yeah the mining pools are it's not it
doesn't work like it was a cool idea and
they're very well maybe uses for some of
the technology but as a source of
money you can't just you can't just make
money out of thin air you can't do it
and you're running into all the same
problems here right the money has to be
tied to some natural reward function you
know I want you to think about like how
we're going to get more gold what are we
going to do when we run out of gold on
earth right we're going to go to the
Stars we're going to we're going to
we're going to mine asteroids right
asteroid mining who does asteroid mining
you can't manipulate people to mine an
asteroid you have to manipulate
things yeah Bitcoin I mean it has
already failed I I do think that as a
cash replacement there definitely can be
cryptocurrencies that replace the usage
of
cash um which is funny enough the exact
opposite of where they're going uh I
would like to see someone make a $5
Hardware wallet you can make a $5
Hardware wallet out have an ESP uh and
then you sell them like cash and if you
could start paying with them like cash
you get a lot of the convenience of
credit card but with the same like uh
decentralized nature of cash I I think
there's definitely uses for crypto
technology but the use is not as a
fundamental store of money because you
can always manipulate the people you
need something where you can't
manipulate the
people uh oh can I put all rce bandwidth
well we're working on that we're working
on that waer we get to the sdma of the
uh of the
Nvidia um what if it's tied to energy
production who ties it to energy
production right like energy is a
fundamental thing sure you can totally
you can totally energy works energy
works in the same way gold do you have
to think of how you get more of it right
how do you get more energy can you
manipulate people into giving you more
energy no you have to manipulate things
your money must be based around what
your money is based around is what your
Society will
get I don't know I mean this is this is
kind of the conclusion I've come to and
yeah no the market without speculation
wouldn't grow as fast this is not true
this is not true speculation is purely a
tax now okay let me define speculation
right speculation does not mean invest
in something you expect to yield returns
speculation means you're investing in
something that you expect to be early in
and expect other people to also invest
in so that you can get your money out
using their money right that's how I
define speculation you see the
distinction who fundamentally pays you
back right investment is not speculation
if you invest if if you have a if a
farmer has you know a th000 acres and
needs money to buy tractors so that he
can effectively Farm the acres and you
loan him the money for tractors
um this is not speculation that's an
investment but if you don't believe that
the farmer is ever going to actually
produce any crops but you think that you
can pump Farm coin right and the only
way you're ever going to get money out
is because suckers are going to come in
after you and buy Farm coin that's
speculation and is purely a tax on the
market what's Bitcoin
obituaries or just people who say
bitcoin's over yeah this isn't like
again it's not that bitcoin's going to
die right I'm I'm not saying that I'm
not saying Bitcoin is going to go to
zero Bitcoin may very well go to
$250,000 right I'm just saying that
Bitcoin is not a a replacement for for
fiat currency it may be
better but it doesn't fundamentally
solve the problem of fiat currency which
is that you can manipulate people to
change
it you can't manipulate people to get
more gold you can't manipulate people to
get more energy you have to manipulate
things no BTC works because people can
always use choose to use something else
replace BTC there with USD and you get
the same argument USD works because
people can always choose to use
something else Bitcoin is based on
energy so that's an interesting argument
um this is what's wrong with proof of
stake right so the minute a theory
switches to proof of stake it's the
biggest joke of a biggest joke of a
thing it is interesting that Bitcoin is
still tied to real proof of work I I you
know I almost think that a lot of those
environmental narratives those might
have very well been the CIA right the
the the environmental the
environmentalist attack on bitcoin the
only thing that ties Bitcoin to reality
and why I'm much more bullish on bitcoin
than ethereum is that Bitcoin has this
proof of work function which requires
the manipulation of things right Bitcoin
is mined how do you mine more Bitcoin
well you okay you need more power you
can make better as6 right again these
are things how do you mine more of a
proof of stake you manipulate the source
code right there's so the fact that
Bitcoin is tied to a real thing but it
would require everybody to recognize
that thing as the True Value right so
it's very possible that everybody who's
you know pushing those environmental
narratives remember how I said I didn't
even think about this when I was saying
it but remember how I said the CIA was
do it right they're not going to do it
by advocating for 42 million Bitcoin
they're going to do it by coming up with
a narrative that can be used to attack
and Fracture a
community Bitcoin wastes energy for
nothing no it doesn't this is raw right
that energy isn't of
itself right
it's if if everybody recognized that
burned energy as the true value of
Bitcoin then it works otherwise it's
just Fiat money but the problem is it's
too easy to
change if there was a okay fine I'll
give I'll give a caveat for what would
make Bitcoin okay if everybody accepted
the mining the Sha 256 mining as and
shot 26 wasn't broken and all that right
that's just good crypto that's possible
if everybody accepted that as the true
source of value of the coin then that
works in the same way gold does because
you're manipulating whether you're
manipulating the ground and digging or
whether you're manipulating math and
energy it's all the same thing the point
is you're still manipulating things to
get more of it not
people crypto is a great tool against
authoritarian
governments remains to be
seen um Bitcoin creates the best
incentive for fusion power in as6 yes
yes as long as that is
true um then works then it works okay
it's fine I I'll I'll temper my views on
crypto a little I'm bullish on proof of
work I'm bullish on hard proof of
work if you see the CIA as goal to
manipulate Bitcoin mean they see it as a
danger and the network actually has
value I mean yeah sure it's like a d i
mean again like the CIA manipulates
Nicaragua right do they see Nicaragua as
a threat you know I don't
know but yeah no I mean also the the the
culture in crypto is so unbelievably
toxic uh which is just again
CIA yeah all right I don't want to talk
about crypto anymore but you know I
think that
like there's a class of people who need
to be excluded from society and there're
the class of people who've gotten to
where they've gotten to by manipulating
other people um they don't provide any
value and uh yeah and I think their time
is
up
okay uh not middlemen no no no no no
let's be very distinct about this right
middlemen everyone always talks about
excluding
middlemen
um yeah you can work to make markets
more efficient but middlemen at most are
taking you know 10 20 30% right
middlemen are taking a a a
smallish percentage right middlemen are
not taking over 50% of the value only in
rare cases I'm not arguing against
middlemen here what I'm arguing against
is things that are taking 10x the value
what I'm arguing against is is the
administrative class right the
administrative class are notably not
middlemen the administrative class are
the the best way to think about them
more as like
nobility this is this is a this is a I
mean this is a French Revolution style
thing right it's it's it's there a there
a no they're an I think there was a
Soul's book uh vision of the anointed
right the anointed ones they're they're
really a nobility they're they're
they're they're blue
bloods is that is that the word whatever
I forget I forget the color of the blood
but but yeah no they they they are they
are the closest thing we have to royalty
and this is not royalty that I respect
right like let's I don't know let's
let's get the you know all right look we
don't need quite a guillotine right but
not advocating violence here I'm just
saying you have to exclude these people
from your organization uh you know you
have to exclude these people from polite
Society it's not okay what they
did
all right no more no more Shilling for
Bitcoin you heard my take hard money
with proof of work that doesn't change
over long periods of time fine watching
ethereum change from proof to work proof
of work to proof of stake proves that
that coin is infiltrated beyond
belief I want to get another twitch
warning what twitch do they care about
this this isn't even like is this is
this extreme politics right this is just
just
like I don't know I don't know how it's
not obvious to everyone I think I think
in 10 years in general what I found with
these things it's interesting like I
remember like I'm kidding about the
diversity is our Strange stuff like it's
such a meme at this point right like
it's such
a those yeah I couldn't believe you know
someone actually thought that I took
this stuff seriously right but I also
don't take the anti- stuff seriously
right I'm not like anti- Dei and we need
to ban critical race theory in our
schools and like this Republican garbage
right like it's not
some of it's good some of it's
bad
um like it's not it's not like a you
take a position on that on either side
it's kind of ridiculous right I think it
all comes back to gamergate um you know
2014 gamergate you see this and at first
I didn't understand what was going on at
first it was very confusing and then it
starts to make sense and you see that
you know you see the two sides kind of
fall out and um yeah and it took kind of
like 20 it took 10 years uh for the
world to like catch up on that I think
everybody kind of gets it now there's a
few people who still don't poor Mark
Cuban
um but what I'm saying now I think is
kind of what people are going to realize
in 10
years no I don't think everybody can
agree with what I'm saying it's not it's
mean that's not a question of agreeing
right like obviously what I'm saying is
um is it's not like wrong right it's a
clear argument
but it's not about like if everybody
started to understand and internalize
what I'm saying here the systems would
fall
apart you have to you have to stop
making a deal with the
devil everybody in any position of power
anywhere
like stop tolerating this Behavior stop
tolerating this this this this blue
blood nobility Behavior exclude them
from your
organizations um you know unfortunately
like Google did a really bad job of this
and you see what you get
today uh so you know I I think elon's
doing a very good job of this right I
think Elon has has managed to exclude
these people from his organizations and
has seen extreme progress because of
it right none of my none of my
encounters with Elon or any of elon's
people were any of them like this where
is like you know you look at you look at
AMD
and you know less true
right if you do what in Spain you end in
jail I'm not talking about wait wait
wait I'm not saying like I'm not saying
do anything illegal I'm just saying like
don't hire these people right don't hire
these people don't work for these people
don't respect these people that's all
I'm saying I'm not saying anything
else no once you've hired them no you
have to fire them right if you ever if
you live in a country where you can't
fire people look I'm not I'm not again
I'm not advocating for anything remotely
illegal I'm just saying exclude these
people right George needs to create his
own hardware company I have two Hardware
companies uh no I mean I think that like
again I I don't understand how I think
that Engineers are fundamentally
uninterested in this I was uninterested
in this I'm not really I'm not
interested in
power I I'm interested in figuring out
how to engineer system such that this
kind of extractive power is impossible I
don't want it myself and you have to be
really careful of that too there there's
some people who who you know again the
best way I think to think about it is
like royalty and there's some people
who the main thing that they're upset
about is not that there is a king but
that they're not
King
uh yeah it's not about it's not about
replacing right like like the solution
to white supremacy is not black
Supremacy okay like it's it's it's the
solution to white supremacy is not white
supremacy right the the solution to the
king is not a different King it's no
King well again you have to think about
who's pushing identity politics you have
to think about where this stuff's coming
from right it it's coming from a
nobility that is desperately trying to
stay in power and I mean I just I think
their time's
up uh having a good King Works far far
better than representative government
well yeah I agree with this right I'm
not I'm
not
um you know against that I saying that I
don't generally think that that
trade-off is worth
it um I I believe in in I believe in
liberalism I I think that you know these
people who you see people on the on the
right who were saying stuff like you
know we tried liberalism and it
failed I don't know about that I don't
agree with that I think
that we tried liberalism and it was
exploited in a certain way and the
Pendulum needs to swing back and you
know again we have to identify this this
the professional managerial class the
administrative class the new royalty the
Blue
Bloods you know we just have to exclude
them that's fine it was it was they
exploited us you know okay fine we have
the Lost Years and you know swings
back sounds suspiciously close to a
pitch for democracy well not direct
democracy but yeah representative
democracy yeah I look I'm I'm an
American right I believe in the American
system
um that prevents outliers from taking
power well look look at what happened
after World War II right everyone
everyone reacted strongly against
against Hitler um against systems that
looked like that and we enjoyed a great
years uh so yeah you know that's
it things don't last forever so it's a
it's an eternal struggle between between
scammers
and um all right you want to see mesc
right what's my opinion on AMD making
data center cards I think that AMG needs
to get their fundamentals solved uh
before they try to uh you
know if they want to
compete um they should solve these
fundamentals all
right let's go to the bathroom and then
let's figure out how to find these msqs
in
our
for
tangent the streams are so good thank
you thank you thank
you uh
okay so maybe what we should do is add
some debugging to add an a mes let's see
if we can add some debugging here
I really like how we have a good cycle
where we can like recompile these things
pretty
well
um submit packet and pull
completion how do I enable this DRM
debug
the DMD PG
isn't
there got to be a better way to do
it oh here we go enable verbose DRM
logging see if this
works oh yeah look that's much better
right great and we don't need that crap
cool
uh I don't know why did I only enable
it
enable debug output wait which one did I
not
enable vbl messages
no I didn't get more okay what is this
AMD GPU IH
process well that's
interesting okay let's delete that other
second s print that I had I don't know
that that was the same as that we'll
just leave it as that then let's assume
that that thing goes
better
cool that might be a call back
actually delete the extra print k I love
how fast this rebuild
is
interesting
so let's let's read the code here for
set ring
pointer I mean I I just kind of guessed
that it was going through the mees I
guess it technically doesn't have to
be uh yeah okay but you can
see
there that unregisters the
[Music]
que what any of that crap
is didn't happen
that um it's also very notable
that these numbers keep going
up not actually resetting something
looks like yeah okay interrupt
Handler cool so it gets a call back
every time it finishes stuff there
probably a way to listen to those in
user
space
Ste
trap
mqd
size this site has some hilarious am
reviews all right let's
see that's this one if you want to
compare
AMD overhype their product launches
because it's effective at getting
firsttime buyers to pay over
episode wait this is
brutal oh my
God wait the guy thought I was mean
amd's domination of social media
platforms has historically resulted in
millions of users purchasing substandard
products those users will be very hard
if not impossible for AMD to win back if
this trend continues semiconductors may
become more of a secondary business line
for AMD who appear to be focused on
developing Advanced marketing
relationships with select YouTubers and
media
Outlets
dude dude
no I mean the CPUs are actually fine
yeah no but they're
really they're not going to change it's
just so sad like I don't even think
there's anything wrong with this
Hardware I really don't I really don't
think this is a hardware bug I think
it's just a software that's
crappy despite steady price cut and
exree number of season Gamers simply
have no interest in buying AMD products
they simply know from bitter experience
that headline average FPS are worthless
when they're accompanied with stutters
random crashes excessive noise and a
limited feature
set
perfect okay I would not say they're
noisy or the features that doesn't even
bother me but the stutters and random
crashes
yes no like but this this this exactly
explains this exactly explains my
treatment for
AMD right they're more focused on yeah
they're more focused on the pr aspect
than actually fixing the damn
gpus
okay here's the Nvidia here's the here's
the Nvidia right this is this is a
perfect perfect Apples to Apples these
aren't these aren't comparisons this is
a quote from GPU oh I guess that's a
user but still here's the same one
from uh the RTX 390 is based on blah
blah blah blah blah performance games
will depend on specific game Revolution
resolution with a
4090 uh the fact that that the that the
490 is currently the fast gring Graphics
available is reflected in its
jaw-dropping
MSRP since PC Gamers rarely buy Invidia
gpus Nvidia really only have themel
their compete with surprisingly it's
actually a reasonable value for
money okay so the complaints are that
it's expensive and large yes see the
thing is when something just works no
he's not pre in the NVIDIA drivers right
you just wouldn't think that the drivers
don't work you wouldn't expect the
product to randomly crash so it doesn't
even talk about that all it just says is
that the GPU is expensive and large
which are
true like yes the MSRP is jawdropping
and they've gone even up in price right
they're now they're now it's like a 4090
tracker
okay they're coming down a little look
at look at this they've literally G
up like I used to read stuff like that
and I used to think that this guy just
had like one bad experience with AMD I I
used to think that like okay this is
just one guy who holds a grudge against
AMD right like people might think that
about me too but
like I really don't I just want the
driver to work
like you know it's not like Sony like
Sony sued me these people made a shitty
driver all right I hold a grudge against
Sony I don't hold a grudge against AMD
if if AMD you know started open sourcing
their stuff and documenting their stuff
and saying look we are actually going to
take steps required to make it better
we're going to put these gpus they
didn't have a 40 they didn't have a they
didn't have one in
CI they don't have a single
one of these gpus in SE as far as as
that's the best Intel I've
got and like it
shows I don't get it they spent they
spend $100
million 50 million maybe they spend $50
million to tape out Navi
31 and then they don't
spend you know a couple tens of
thousands
to get a decent CI machine
working it doesn't make
sense I've heard I've heard the theory
that AMD is just controlled opposition
for
NVIDIA I don't believe it
um but yeah I mean this is this is just
this is so
brutal
I mean again their stock price also
includes the AMD epic CPUs are great
CPUs I have never had any problems with
them um the Tiny Box is going to use
them I've never complained about them
they're better than Intel they have a
ton of pcie lanes they're pretty fast oh
come on that the cousins thing is um
yeah rivalry uh yeah you rival with your
cousins
um but no the everything about the look
this is not any criticism of AMD epic
CPUs they probably have them in CI
um it's just that these these gpus just
don't like why do they keep doing
it almost like like I I I kind of think
they're just going to give
up the 7900 XTX maybe the last high
performance graphics card from AMD like
like either either stop doing it I don't
know or maybe they sucker enough people
into buying these
things uh if if I were if I were just
average Joe gamer I would never buy one
of these
cards or Average Joe ml guy right like I
actually yeah guess what I I like
dealing with this crap right like I'm
you know I'm that kind of
person
uh
no even for Budget gaming just buy a
cheap Nvidia
one like it's just going to be over for
them soon unless if if their market
share Falls too low games won't even
bother testing on them
anymore yeah I'd rather get a 2080 for
ML seriously you
should you have a 40 60 TI yeah great
card it's made by
video doesn't have these
problems so what happens if I don't use
a
doorbell oh
interesting can I disable the doorbell
somehow
where amdgpu
ring it's
interesting o provided by Hardware
blocks that expose a ring buffer for
commands so I'm not really sure what the
mees is doing
here probably okay I I kind of see
what's happening so the sdma engine is
being set
up by the driver and then is being
handed over to the mees to actually put
things in the
Q I think I think the queue I created
was an Mees
q but I'm not sure if these cues are one
to
one how am I best going to link to Linux
kernel
stuff
does the door bell take both I don't
think you know what you're saying
um
so yeah I mean it seems kind of like
there used to be a flag to disable the
mees let's just try it I mean there's a
chance it still
works I say like like it's like a flag
AMD GPU disable
Mees um
oh enable micro engine scheduler log
interesting I did not know there was a
log enable mess log to enable oh let's
see let's see what we can
get logs are
great doesn't
exist oh look at how recent that is
oh disable it and enable it if necessary
okay so it's
enabled by
default now it's not
enabled oh okay there should be a file
in debug events called Mees event loog
they were about to take it out good
thing we got it before they took it out
now they were just going to get it
behind a flag okay so where the hell is
my Ms event log right debug FS create oh
should be defined
yeah
what okay so it seems like this Kel is
too old to
yes set Harbor res
packet okay so it seems like they
enabled the log and then added in a gate
to gate the log okay that's reasonable
oh okay this is whoa this is
cool
yeah okay okay okay we're making
progress here take a look so there's
there's these
pipes
ah Mees set hardware
resources well that that must have
happened let's see if we can find when
that
happens
just that har resources is zero there
um just stop doing that for a little bit
let the GPU turn off and then we'll see
it turn back on and we'll see if message
zero gets
emitted all right so that unloads the G
GPU let's reload the
GPU booting up ring ah here we go
message zero message 11 okay so we we
here we set hardware resources right
here
cool again there's supposedly a way to
disable the
mees
um and then maybe these things will get
submitted directly to the
uh to the
pipes
MSI enable microengine
scheduler
module pram named can I just say Mees
equals zero is that
[Music]
all new engine pipe for kiq all right
let's let's just try it Mees equals
zero a crash is
fine let's try this again and see
no it still uses the mes okay that's
just completely ignored you can see the
mees is still being used here okay so it
probably can actually be
disabled unless it's AMD GPU
Mees let's read the
code
um
be okay there's eight compute pipes two
Graphics pipes and two sdma
pipes we don't actually know the mees
might actually also be perfect and not
be any of these problems these problems
May lie much
deeper uh but okay so it looks
like like it's just responsible for uh
it has all the cues and there's some
code in here that does all the the ring
buffer
shit I don't know why it doesn't load
that but
whatever did I just miss it does it
actually load
that I to print all the firmwares it was
loading
right is there just Mees anywhere no it
just loads mes2 and ms1
okay hey you know what' be cool remember
that time two10 Tor Engineers came in
and answer all my questions about Tor we
got any AMD engineers in here who are
going to answer all my questions about
AMD
can understand the
mees
uh I mean we kind of like understand I
think everything that's going on if we
want we can sniff these at High I mean
let's just throw watch on
there sorry I got to make it small so we
can
see
um all right let's just throw that in a
loop maybe reduce the sleep a little
bit why don't I see that
changing
that's changing why is nothing here
changing all right R to sleep
maybe go as fast as we
can why is nothing changing
the python seg
vaed how does the python seg fall oh
I
uh the python T faults because it
eventually
overruns no a modding based on the ring
oh it might not be a uh
multiple make the ring
bigger why do I not see anything going
into the
Que two Q's
here there's an sdma command here
too looks like I'm talking the wrong
thing it's clearly not true but whatever
what is that read it that's
working
right there we
go oh what does rlc2
mean all right so there we go I mean
this is this is the que here I actually
bet that's the address from user
space I don't know actually that I'm not
sure
about uh oh that's probably
no that's probably premes I don't know
let's look at the UMR
code let's look at the UMR code and see
uh
where I should close my computer I have
it
sorry about the
tiny print
sdma read sdma
register okay RB
base
as
oh there's like these rlc's oh I might
have just been looking at the wrong
thing
okay notice how there's no rlc's here
are these actually just in the
mees where's the
mees FX so that lsdm might not actually
be
interesting okay that's not I don't know
what lsdm is but lsdm is
not oh there's system dma and other
dma I see okay so that's just totally
not oh and now they have multiple cu's
on
them oh man okay well
now
is
okay um how do I even know if I'm using
sdma Z or sdma
1 there was some way to control that in
HSA so I'm surprised there's not a way
to control it here maybe it's just like
every other que is put
on yeah how do I control which one it's
on why is this still
going what's copy what why why is
something
running wait literally what's happening
why does that keep
going what's talking to my GPU right
now coming back to Earth
ma' error module is in use what's it in
use
by someone's hacking my
GPU what is going on right
now why is something doing
this
that oh that maybe oh I see wow okay I
didn't realize that was
active Okay U I didn't realize it was
active but fine whatever all right let's
look at the right sdma
now
[Music]
sh
execute
what let's just look at
sdma
Z oh there it is it's
Q2 no it's not
Q which of these are
changing what is Q2 and then you code
data is obviously the enchanting okay
whatever um how do I do watch with this
what's the incantation something like
that work right there we go I just need
to put that in
quotes
cool let's do that more
aggressively great so that's basically
the same thing that the other app was
doing but I don't think it's going to uh
there like a command in INR that dumps
the sq's but it was doing something
active on the
GPU so the reason I think there's two is
that you can be you can send from and to
the GPU at the same time see again I
mean they put effort into this Hardware
why don't they open any the software all
right look so you can see the uh
pointers changing
here
um very notably is that those are real
user pointers I don't know why that
doesn't seem to be a real user
pointer
uh let's let's just go in here and print
out my
address
um just say doorbell value no I can't
say doorbell
value just say the VA address okay let's
do X on
that
ZX all right
cool is that the same address we see in
the
watch
71f no it's
different oh stupid
Mees it's like almost the same but 2 a85
2 A E1 no see it's creating oh no no no
no those are just the pointers oh that
can that can be the same that's fine
maybe those are the real pointers let's
print the
pointers why is that one so
big it's not right
that's oh because I didn't do
a I think that's the
same D9 2 E4 yeah okay cool okay so it
doesn't seem like the mes is actually
really doing anything here I don't know
why it
exists but it just looks like it's
writing
directly let update my documentation
uh
so I don't know what IVs are or
anything uh oh light sdma oh that's
interesting
there sdma packet
seemly supplemental sdma packet small
sdma
Hardware B for sharing
resources interesting we add this to
links so
actually it's possible that this sdma
just doesn't matter and the there's no
this I'm sure there's still I'm sure
there's still firmware
somewhere pretty
cool
maybe the mes is just ringing the
doorbell too so I don't see doorbell
being updated
here why do these cards have so many
code names what do you mean man it it
looks like looks like one of
them the mafia
sheets you know it's like it's like the
mafia like
um my looping a read right now I'm just
writing times
St
um it's like one of them you know AKA
lucky luchano aka the big luck aka Mr
Shamrock AKA fourleaf you
know all right I think it's coffee
time pretty good though right we're
making good progress
all right we ready to start looking into
the the command and then you want to
start dispatching a uh an AQL que and
seeing what happens I think we kind of
understand
sdma what was UMR useful yeah UMR sick
UMR is the only reason we can do any of
this without UMR I was given
up
for
for
for
all right we got coffee we're done with
highball no more highball today thank
you highball we have highall energy
energy sell sir they don't pay me
okay I I I you know I'll get reach outs
occasionally for people who want to uh
sponsor this Channel and I say
especially when they're from ad agencies
I say that I can only ever sponsor
anything ironically so if your client is
okay with ironics sponsorship then by
all means and the thing about ironic
sponsorship is it's really the same
thing as sponsorship there's not that
much of a
difference all
right so oh we disabled subscriber only
we're going to let them talk do they
have anything to say sup rxr
blin I think we're on the first or
second step I don't know we need a ding
board
sponsorship
um let me just go over C
here
more
docks
uh
okay um
great one
down a lot more to
go
so what's these things do let's see if
we can find stuff about
them
um
by the way uh we'll Shi for perplexity
AI
uh every time that I'm doing a search
like what's the best webcam for
streaming or um you know uh how long
does it take even something is simple
let let me show you let me show you
something that that really shows the
Brokenness of search engine right how
long
does Barry
take boat take to Catalina right
so I'm going to I'm going to show you
the difference between these two
results um this is a liberal arts
education by the
way
so compare this to this right it only
takes it takes only one hour via a
high-speed ferry to get you to paradise
and you need this is why like search
engines need to be intention
aware any human who reads a statement
like that should question uh you know
the truthiness of it right it does seem
to be largely true but I just want to
show you the difference between the tone
of this and the tone of
s so how long does the boat take to get
to Catalina is probably again they're
not really going to lie about that but
the intention of this content is to
shill you Catalina the int to this
content is
not um so every search where there can
ever be incentives that are aligned
against yours right if what you're
searching for is like some obscure error
string in a in a program use Google
right um but if what you're searching
for is anything sort of normal use
perplexity and what's so funny is this
is what's going to destroy Google's
business Google's going to be left with
a long tail of garbage and every actual
montiz iable search is going to go to
somebody who didn't sell out as hard as
Google
did um you know again we're going to do
we're going to do our daily search for
French
jokes oh memes about groups or people
might be disturbing or hurtful thank you
search engine I understand that it is
your moral duty in society to uh you
know to uh to to to correct my behavior
thank you thank you search engine I I I
appreciate that that's right just that
little nudge nudge nudge
nudge
uh you can't fix their stuff who said I
can't fix their stuff and we're not
riding a driver we're a long way from
riding a driver okay we have a lot of
work to do before we ride a driver I'm
not even sure I really want to ride a
driver okay we know this ends with me
riding a driver in a year but like you
know come on let's pretend it doesn't
all right if if we knew where we were
going we wouldn't want to ever leave if
we knew that the boat to Catalina was
actually 2 hours you think I'm going to
drive all the way to LA to get on that
boat um what is the Run lless controller
in let's see I spelled it wrong probably
doesn't matter okay
uh kind of
useless
no pretty
useless more
useful uh okay let's I should really be
linking to these things in
kernel
this is a driver
core oh here it's in
documentation
GPU AMD GPU why is that not a why is
this
different maybe this is
new
interesting I do I already have that in
my links I already have that in my links
okay good
okay
um Graphics memory controller interrupt
Handler okay that's what the IH
is security processor
stma this is the graphics and compute
engine it's by far the largest block has
tons of sub blocks it also contains the
oh let's
um let's add a
picture
that
sucks can I see if it's
big kind of big I don't
know
um can I get a big version of that
big the enhanced compute unit pair how
do I get this slide deck
that looks better how is that not the
same as
that the same as that never
mind why this suck so much can we find
that from like a different site chips
and cheese is a good
site
how do I get this slide deck I just want
this slide deck andd R dna3 slide
deck I want the whole slide deck where
can we best find
this God see we spend money on marketing
and not making a GPU
decent
there is also a really so there there is
this rdna 3 PDF which is quite good um
I'm going to include that in
links no no I want the whole slide deck
not just one
picture is probably the best version of
the picture I've seen
but we find that slide deck
somewhere like the original
Source what's a GPU open.com
docks work
drafts what's
gcn what's gcn
3 oh this is really
old
why is my computer
moaning is the CPU spting up there go
it's
quiet
no this is
old it's interesting that they include
that
there no this is the same
one this is the biggest you could find
which one's this
okay
so is this right 4 * 16 bits so that's
yeah that's going to be the full
cool let's add this in docks
um let's throw that in the top of the
read
me how do I embed a picture and markdown
markdown embed
picture I'll just use alt I okay it
looks like that
fine why did that copy paste
do r1. jpeg see
out V there we go cool looks pretty
good see how it looks on
good
very
cool um one two three four five six
seven
eight does this include all of them so
it's 8 * 6 48 cus is that
right or is there more let's try like
look at the die and see if this is at
all
realistic
no not all groups are protected groups
you have to
understand okay compute units 96 so if
that's a dual compute unit then there's
16 on each of those yeah that should be
96 right 16 that's 48 that's
yeah
so are those really
chiplets it's always nice to know like
what the harbor actually like is you
know
someone find these slides but
good all right so it has one main
[Music]
die
gcd
Graphics compute
die and then 6X
memory chiplet Cash
die all right so this is where the L3
cach lives you found slides but not
those o let's check out this slides we
love
slides rdna 3 if you're on the current
geners lot of computer
units execute
[Music]
indirect no this doesn't look that
interesting
RNA wave
64 all right still supports two waves
the thing talks about that a lot shade
your right
compression don't know about that
staying Infinity cash B with reduction
this is this is like
fancy I didn't even know they supported
R
tracing it's
something
I don't know where all these features
are good deck not sure if it's modern
don't's see what we
got it's 2019 so that's pretty
old that's really I mean this is ogr DNA
I want this but for uh for rdna 3 I want
this slide deck for rdna
3 I'm sure it
exists press
release learn more about our DNA
architecture
here
no where's the
PDF
mesh shaders I don't even know what a
mesh Shader is I really know very little
about Graphics
unfortunately merchandising docks
M oh
huh how have I never seen this before we
wrote Our Own
simulator highly accurate
simulator
oo oh this is interesting who's putting
all this effort into these
chips rdna is the official page in
slides this is original Rd do they have
R DNA
three I mean it's good to understand
where things came from we add that
doesn't hurt to have more
links I don't want these websites it's
let's
find maybe it's on GPU
open oh let's just change this to rdna 3
Yol no learn more about rdna 3 now
what's this page
again it's not on GPU
all
software what's GPU
detective supports directex and
Vulcan what is this
doing
I've read this
before
manuals
St our isas okay this is cool that they
have all the
uh Tech docs at
AMD this looks really
old
oh apparently it was
leaked oh here rdna beyond the no no no
no I just had that
one you're saying the rdna 3 thing was
leaked you're thinking this was
leaked
for
okay well there's also there's an
interesting if we look in
um here there's an interesting picture
too all right memory hierarchy blah blah
blah blah where's the picture of the ah
here
is this
yeah
so
device memory it's not all that
interesting all right fine we'll just
we'll just do make do with what slides
we can find
around uh oh this is old
okay I mean I guess this is the best we
can do
then see if there's anything
good okay uh chiplet
shit I mean this is this is this right
here is one of amd's core advant is over
Nvidia Nvidia puts all their stuff on
one die which is very
expensive no I'm not looking for the
Shader
isas I'm looking if these slides exist
somewhere but I'm starting to think they
just
don't okay pretty
boring more Shilling for
chiplets the enhanced compute unit
pair
this is kind of
interesting
let's create a doc called cu.
MD compute
unit
by the way does that work I feel like it
doesn't because so
yeah it's not going to work that works
okay
fine
um
yeah the slash
here
okay same
[Music]
picture more showing about the
chiplet oh this is
interesting okay if this gets into the
compute stuff this is whatever we we can
play with this at some other
point
that's compute
happens
uh 900
XTX has 96 compute
units um they're called something else
in here so they're called uh
48 work group processors that's what the
wgp
is work group
processors each independent from the
other that operate parallel on streams
of floating points blah blah blah blah
blah
okay
this dock is actually one of the best
docks I've seen for any GPU uh it's not
complete unfortunately but Nvidia
releases very little comparatively and
uh Intel's documentation is 10,000 pages
but extremely
pedantic
all right I think we actually want to
try to submit something to the compute
unit and see what
happens what tiny grad help you ask not
what tiny grad can do for you but what
you can do for tiny
grad all right so where were we trying
to understand what each one of these
stupid pieces is no sorry not stupid
pieces lovely pieces of a wonderful GPU
yes that's
right
um link to that hot chips thing here we
go more
info
yeah I don't care about cdna we can't
afford those
cards okay i' have to sell my rollsroyce
and then I wouldn't have a Rolls-Royce
anymore right like I could sell my
Rolls-Royce and buy a couple of instinct
cards but Instinct cards depreciate
faster than rolls-royce's so why would I
do
that okay the microengine compute sounds
very
interesting this is the microcontroller
that controls the compute
cues
it handles power management
functionality oh never mind okay the Run
lless controller is very
boring oh IB is indirect buffer I see a
command buffer for particular engine
rather writing commands directly to the
que you write the commands to a piece of
memory and put a point in memory hard
okay fine cool wait I I this is this is
this is a great document and we should
elevate it
let's elevate it to
here more
info on each piece call
it
no I don't care I don't care about cdna
again we can't afford those
cards uh all right so what do we want to
dive into next what piece would we like
to dive
into the CP is not
real okay what micro engine and micro
engine comp I think it's micro engine
compute that we car about what's the
prefetch
parsel this is
old wait they really a lot more docks
for this guy though how old is Southern
Island oh really
old this might be graphic stuff I'm just
trying to like rule this one
out let me is just the micro engine wow
this is really
old
you don't need to WR optimize driver is
just expose access to the
hardware and we have access to Hardware
what do you mean all right you guys I I
know something very fun we can
do what were those two things in my
temple yod data
why are they incrementing like
that that's not what I've would have
expected do they loop at some point
I want even
faster watch doesn't support that is
there a watch built into
UMR H scan can be used multiple
times
oh there's also a very interesting so
UMR also has this very interesting
um what oh that used to do more things I
don't know what
happened oh yeah here we
go wait oh
no it's going down
we're yelling
[Laughter]
timber we just got to we just got to
laugh boys we just got to
laugh all right let's try GPU
recover come back to me GPU come back to
me no it's
over h recover
again
no it's going
down all right come on I know it's
copyrighted but I think I think it's
appropriate
all that wasn't copyrighted that was so
short it wasn't
copyrighted oh we're we're really we're
really killed
[Music]
at the song's as old as the p P
docks
um I'm not going to shower yet
I'm wait for the reboot I want to look
at those U code addresses
um
for
all right you want to do you guys want
to do something real fun do you want to
reverse engineer the instruction set for
the
firmware this is funny so many threads
all right well good I think look it's
appropriate for a GPU to crash while
we're abusing it like we've been abusing
it is the computer going to come back or
we going to have to reboot
it
oh really
disappointed oh at first it was fine but
after about one week or so I kept
getting oh I mean this is just
overheating that doesn't even seem to be
The
Driver
this seems like the
driver wonder if I can power cycle the
GPU while plugged
in where did this guy find all these
good docks on this stuff to
chips and cheese is a great
website um you know it's so interesting
also to
uh to see like you know adreno is an
acronym of radon r a d e o n uh R adreno
is what's used in
qualcom um so we have a good bit of
experience with
that we got to hard the
computer
hard
reboot reorganizing yeah I looked here
nothing
right wait
what mean it's really old
but why why don't they release this for
a AMD hey hey you know how to release
register docks why don't you release
this for the new
one we can get get it for sea Islands
3D
I'm trying to bet all the people did
that now work for
NVIDIA not like they didn't look guys
did I try to help them or
what and I don't know you know people
think that I have some weird ulterior
motive I really don't as far as I can
tell like you know it's hard to it's
hard to always know what your own
motivations are how much is my ego tied
up in things I mean yeah there's
definitely like components of that but
you know I really think when I lay down
in bed at night and I ask why I care
about this stuff it's because you know I
want the future to be uh distributed I'm
not worried
about I think that uh you know it's it's
it's it's ironic that a lot of these uh
activists are calling for you know uh
things to be things to be fair for
opportunity to be well distributed right
I that's all I really want for the
future as long as in the future like
everyone kind of has a fair shot I'll do
fine right and everyone who feels that
way is fine it's the people who don't
feel like if things are actually
distributed fairly like actually like
you know equal opportunity that it's bad
you know that's what I worry about
right um right and this isn't this isn't
always this is this is the this is the
phony executive afraid of losing power
right this is the the phony Blue Blood
who's you know it's the emperor who's
who's scared of being uh called out for
being
naked um what Arch is the
firmware so so we can you know
run let's run beautiful L this this is
going to use the GPU all over the place
the thing I wanted to show you was
pseudo UMR
top dash dash top I wish it gave have
errors okay um let's go to something a
little fancy go to C over
here that okay um but yeah this shows
all
[Music]
the this is interesting uh H High
Precision high frequency right what are
all these
things
grbn not properly tracking the
ram
[Music]
really what are these
things
now here's another whole set of acronyms
we got to understand and clean that up
hopefully
wide
oh
crash
what are all these
acronyms
where do they come
from what is
it
no
oh man like you know
what
okay did a shit
job tried using an llm llm you had one
job you literally had one job and you
couldn't do it lm's
fired you cannot let a computer make
decisions because a computer cannot be
held
responsible
IBM
what are all these
things anyone
know oh if I just save oh that's
nice
oh no that's almost
nicer have a nicer procedure for doing
that
now let it spin
up TA BS
okay what the hell are all these
acronyms grbm let's start there what's
grbn graphics register backbone
manager is that real texture
addresser okay we're using the CP we're
using the
spy we're using the RLC we're using the
CPC we're using the cpf we're only using
32% of the in uh 44% of the fa and oh Al
oh we're using 70% of
Al H that doesn't look very interesting
that doesn't look very interesting we
don't care about that okay
cool um let's go back to what I was
doing here let's grab U
code U code
yeah let's try this guy
here
okay
um U code address U code
data
I feel like this is the
firmware but like why are these things
so this going to be the
address don't really
like get
that dump the code where's
[Music]
me1 does anyc
me1
oh
that's
interesting wait let's just look we know
where the code for the preest processor
is so let's take a look at
that um Li firmware and
GPU yes okay
so just copy
that
question is at
2f2 do we have that
shit f8
b80
no
I mean that might not be flipping the ND
in
this that's not
useful micr code address micr code
data those you code addresses are just
zero the whole time this just doesn't
look
like that doesn't look like an
instruction
pointer
there is some stuff that looks more like
instruction pointers in
UMR uh here print CPC register data okay
what's the
CPC oh inster pointer oh that's better
cool I don't know what U code is but
what if I just do
inster what's the
CPC see
new
what the dog say about this print CPC
register data okay what's the
CPC what's
this no these are these are for uh fpga
and stuff I think yeah I'll just
yeah we can look at the source for top
sure um maybe there's stuff in here that
talks more about
CPC no but what is the
CPC oh well that one can't find
it do we have CPC in the in the Asic I
mean where where which which block is it
even
in I assume it's gfx but I might be
wrong
okay it's part of
gfx interesting is there nothing called
inster oh no here we
go oh great great great great great
great now we're talking we want to
search for inst pointer
oh uh where's our firmware stuff what
Arch is the firmware okay let's just
search for inst pointer we don't need
the
I okay so you see now everything's
idle oh and they're all part of the
CP okay maybe we should make a new docs
page for the
CP
for
all right so I'll note that all the
things are in yeah uh so let's watch
these things light up when I
do go faster than
that give a second to warm
up all right I just saw the mech
move all right so the mech is doing
something oh it looks like only the mech
is doing anything
interesting so the mech is the
interesting thing
here
um okay what's notable is this is pro
you probably have to multiply this by
four and I think there's more info if I
get rid of
pointer
why does the mees not have oh yeah the
MS does have one the MS just isn't doing
anything um let's go to my H my other
example wait what did that not work
oh no
no oh okay it did finally catch up or
something watch the mess pointer see
have changes at
all big lag
bro you I'm not done with your previous
command
boring going to
train we break
it
during
operation let's figure out which
uh
it's all over the
place and what's so interesting about
that is we can look at the mech
firmware
here and we can get a good idea of what
these things are actually
doing what are these gfx
things all the AMD Asic
instructions oh yeah I mean we know all
that that's not a big
deal oh wait do I have to add another
AKA that's a good point we frequently
refer to it as
that pretty sure it actually is plum
Bonito
yeah
running so these GPS are interesting
which of them also have GPS let's say GP
z i just m in that thing oh the mech has
it
too seem to change
much turn racing thank you for gifting
more
subs
me1 header dump okay so there's U code
add and U code data
too look the instruction pointer changes
occasionally
rs64 those don't change what is rs64
rs64 might be the name of the
processor interesting here's more stuff
about it wait this is in xylx I don't
know let's take a look in the
uh that's really there then let's just
take a look in the
kernel
need single
firmware ties for load
command that stuff's kind of interesting
too there's actually a lot more firware
types than what what we
saw that's another that's another
mystery to dive
into uh we probably want to put
that yeah let's take a look in D we're
have to reload in order to get that
let's reload sorry about the tiny tiny
font it's even tinier than I would like
but you know you can't have
everything
um have everything see that's just like
a meaningless thing I say it doesn't
mean anything what I hope to do is teach
you all that slogans are really
stupid and like diversity is our
strength guys I think that's the theme
that's the theme of this that's the
theme of this stream that diversity is
our strength
right and you know what I don't even
mean that ironically right like if we
didn't have diversity in the world
everyone would be the professional
managerial class and it would suck bals
the good news is we have
diversity it's about 20 linked PDFs here
yeah we're going to remove LM of course
we
are yeah but these are
just no these aren't
interesting what's on this
for
no this is just some guy trying to make
to work on his
computer oh no I think it might not have
worked we'll try again but I think we
might have to
reboot I know it might be okay we might
just have to enable
debugging no
we're stuck in this I'm not done with
your previous command
garbage okay it did eventually do that
that's good
um I think it's
broken but I do want to copy and paste
these and put them down here because
they're
useful and we can look and see each one
of these types I'll show you what they
Cor spond to
um I'll put this all the way at the
[Music]
bottom so you see like if we're looking
here at like this is 88 through 97 we
can look down here at 88 through 97 and
this is loading all of these
rs64 I think that's the
core looks like stacks and stuff I don't
know um let's start the computer Rebo I
don't know unfortunately I have the dots
actually on the computer which kind of
sucks like I don't know why I did that I
totally could have just done these dots
on my Mac and not do
SSH um yeah but you can see it load all
the firmwares which is kind of
interesting it' be interesting to see
exactly which parts of the file or which
of these if someone wants to go through
and like do that project rs64 is
mentioned here yeah but does it say what
it
is
fail overflow I don't know why I do that
link radon because it wasn't
right I'm just K it's not exactly right
probably doesn't mean it's not right
entirely um
F32 but it wasn't
this we tried
this support to load
rs64 CP firmware front door load yeah
this still doesn't tell us
I let's look at the
kernel no not that and that's now broken
so let's close that let's get the kernel
here
um
okay so look yeah it used to be called
F32 back on gfx
9 they maybe still have one F32 I don't
know about that or that's just a legacy
name well that's interesting I wonder
if this works but only for
sdma we don't know if they're all the
same
firmware let's get to the bottom what
cp64
is uh we want to do the site let's do
the Linux mailing list
um and search for cp64 in here send
that no they don't want to tell you
about
cp64 they're hiding it maybe Bing wants
to tell me about
it
no very little
stuff
wait what is it not cp64 sorry what am I
doing
rs64 I don't know how I got off to
cp64 IBM
rs64 where do you see IBM
rs64
interesting
I mean it's like
possible it's unlikely
but okay the firmware that I really want
to look at is
that so I have that thing in the
docs called firmware info
um why did I write this in
whatever what I want to do
ispu let look at the mech
firware this is
the okay it's called U
code
Google search like that does it yield
anything support front door
load we broke the
GPU we just have to reboot okay we're
going to reboot shower
time uh I'm going to commit this I'm
going to shower I'll be back in 10
minutes uh 15
minutes if anybody can find out any
information on
rs32 uh you would be much uh would be
much
appreciated wait what oh I just tried to
push tiny gr okay don't do that I know
why I what
yo it's crazy you can still hear
me we'll just leave it as 10 minutes
which I know is vague and terrible but
we'll just leave it in 10 minutes and uh
yeah see you in a minute
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
our
wow we got some
autoplay modular approach to optimize
the performance and efficiency of
your and so with our like we've done on
the on thep mix and I don't know where
this came
from all
right cool
wait I didn't reboot the computer did I
have to reboot the
computer do I have to reboot the
computer or
not should you buy the card
no I would not recommend buying this
GPO
I mean look we'll see how well this
project works out right I forgot to
reboot the computer when I took a
shower all right I didn't turn it off
enough I don't know how it works
whatever
um where work
rs34 the AMD no honestly
everything the first email to me they
included something about how they would
prefer if I didn't disparage AMD and uh
I should have just I should have
realized at that point that they were
fucked like I should have realized at
that point if their response to like
look I'm not disparaging them I'm not
calling them bad people I'm talking
about my experience with their GPU which
has been dog
shit
all right guys should put the blaga
hoodie on it's belenciaga hoody time
what do youall think oh yeah yeah yeah
yeah feeling Rich today boys feeling
Rich
today
um no I should have just I should have
just been like wow these people are
fucked like they're trying to PR manage
instead of manage their GPU right like
that that's what needs to fundamentally
change if if you're trying to not change
yourself but instead change how people
think about you like that's a serious
problem okay where are we
um know and it does seem pretty endemic
in AMD too like like we're in demic in a
lot of these big companies like they
they don't they don't
get like brand is more irrelevant than
ever um with with like it used to be
someone would walk into you know the
whiz and purchase a television and it'd
be like Sony wow they've built up a good
brand over many years today people
search for best TV site colon
Reddit um or they search or they go on
Amazon and look at reviews
right and people are pretty good too at
telling when you know like the modern
consumer is so much more savvy than the
Consumer of the
past um the amount of information that's
available and again there's a war going
on there's always people trying to uh
trying to keep that information from you
right there's always people trying to
like like they want to manipulate things
but on the whole things are less
manipulated now than ever
before um you know there's there's
there's there's lost battles and one
battles in this war but on the whole
stuff is improving and people's ability
to judge stuff is improving as well so
the fact that a company like AMD views
this as a PR problem and not a GPU
problem uh really really says something
right it really says that they have the
wrong kind of it's just the wrong way of
thinking about the
problem
uh all right so you guys know
contractually I'm not allowed to show uh
Claude on stream uh it's against my
contract what is the rs34
processor in AMD
GPU I'm asking
Claude the RS 64 processor is not a
specific component in AMD
gpus it doesn't
know if they improve drivers the pr will
improve
exactly all right and and again I I
can't believe I I just I
just I don't want to like I don't want
to go into Twitter again the the guy who
is responding to me on Twitter is
actually very very nice um I I think he
we're actually I think very much on the
same side
um you know but there's no there's no 75
7900 XTX in CI and that tells you
everything you need to know about how
much they care about the stability of
their Hardware which is is just
like
like every time something's pushed to
the driver that should be recompiled and
stress tested on their gpus this is the
only only way to manage bugs tiny grat
has CI open pilot has CI open pilot has
super sophisticated CI Hardware in the
loop Hardware out of the loop that's how
the you know the comma devices are very
stable way more stable than AMD gpus on
a much lower budget too um you know if
if comma was in charge of stability of
the AMD GPU our failure rate of of comma
devices is in the tens of thousands of
hours um and and that does not just mean
har failure that literally means like
like red alert immediate disengagement
failure um to the point that most comma
failures now are not caused by the comma
device or any of the comma software but
are caused by external things so we had
a bug with SDSU recently which is an
external thing that people are buying
from somebody else we found a bug in the
Volkswagen Atlas
firmware um that like comm's becoming
more reliable than than car
companies uh because we're using modern
methodologies in order to to get uh
reliability like the methodologies for
reliability really are like like Ci and
fuzz testing are are these incredibly
powerful methodologies and if you have
your stuff in CI and you have aggressive
fuzz testing with good coverage your
shit will be rocks
out
um CPR rs34
enable uh the flip side of that is if
you don't do that stuff you know the
things will be flaky and they'll be
flaky
forever okay CP AIT micro
code check firmware header version to
see if we want to
enable that's so weird it seems like it
can be enabled or
disabled based on the firmware oh no no
no that makes
sense I see so if it has the new
firmware then
we
oh he's angry me look I'm
angry so I'm talking
now I don't know if this is actually yet
all right do we want let's just
start
umw
and
[Music]
GPU going to see what nonsubscribers
have to
say do they know things the answer is
no our mentions says
modes where is that okay gfx 9 is old
maybe the first one that introduced rs64
I that which is kind of
interesting yeah okay that's
cool pfpu code version being greater
than 300 non Subs do know some
things
um
I mean I'm going to guess that yeah this
is just the name of the new
processor wait what's this program
[Music]
counter
oh it's program counter
start search for RS 64 enable yeah I
mean again this stuff's not useful like
we have to
find yeah no I found this
um
we have to find documentation for the
processor and there's a chance there
just isn't any and like that's fine but
let's do per infut let's open this RB
read that from Hexum import Hexum blah
blah blah blah
blah another great hit Kesha
song or
c so which of these are
clearly nothing else
yeah I'm going to guess that this is
where the code
starts it's prob my mother talking about
Easter happy
Easter yeah I'm using the flip we got
the flip
boys the F we got the f f happy Easter
to everybody you know you should just
should I wish like this is the kind of
stuff that happen in
church
happy Easter also equally important no
we won't go
there
uh so mean it's
clearly code
there
the instruction pointer is
this but I'm going to guess that has to
be because of the way that it's weird
and ends like that that has to
beus
and also we don't know if it exactly
starts it I don't think it actually
uploads the header and stuff so we don't
actually
know um 8C like I don't know like that
might be that instruction we don't
really
know there any more info there this you
code stuff too but it's it's weird that
like
like U code Adder U code data is not
what you thinking
is no I don't think it's
renis why do you think it's
this
no I don't I don't think
so okay notable that the me instruction
pointer is and the pfp instruction
pointer are both c00
0 almost as like they're not
running
that's all 12200 what's c00 times
uh well
3,000 oh wait that's 3200 oh okay okay
so it's probably
that yeah okay okay so probably what we
want to do is get get rid of the first
hex
200 that makes a lot of sense okay we
get rid of the first hex
200 first x 200 is
headers
um then we hex dump uh code starts
at let's say headers code equals D 200
that 200
colon um code starts at hex 3000 okay so
now if we like hex dump code to like
4,000 uh I'm going to write a better hex
dump in a minute I'm not going to be
happy with how this one
works yeah okay let's just
um so there's your code at 3,000 right
so so those things are just not
running those two are not running
they're delayed at 3,000 but it makes
sense because you have to multiply that
okay so if we want to get
[Music]
the oh it's notable that those also
aren't
rs64 which raises a lot of questions but
whatever
ever
um what's the pfp again there notes on
this prefetch parser okay I don't think
we maybe we don't use that maybe that's
only if you're running graphic
stuff
okay I don't think it's running it's
actually probably
halted
um we can check
that uh there's ways to dump here list
of RS with
bits so let's look at what is it
probably halt remember when I halted the
mees last time oh F32
control interesting that
the sdma is
F32 but there's no inster
there it's only
that and
RLC
maybe the sdma bin again it's possible
that these don't all have the same
architecture this one looks
different let's try that fail overflow
tool on that
one the thing that disassembles
F32
uh I any build rad
tools
no let's try
this on the
sdma F32 disc sdma
wow this is totally
right this looks very
plausible
okay okay
okay so this is
F32 and you can see oh you know what we
could probably do let's look at that
header uh let's go into this and let's
look at the header yeah yeah let's go uh
GC main.c and that out we want to look
at pfp and sdna let's look at the header
and check to see what that version is
and see if it's uh F32
or okay I don't know if this U code
version is what
matters but there's clearly that RS
uh
I'm not sure it's that but RS 64 was the
thing that decides if it's R
64 R 64
enable yeah yeah that's based
on where is
that
interesting it's almost like they can
run
both
oh very
interesting okay so we check the
firmware
header
um oh that's P firmware where is
that pfp that
here common former
header header version IP
version header major minor okay let's
just try that do I print that in that C
file I
don't header version
major header version
minor all right let's
see now they're both
two
see this stuff doesn't look
right see how that doesn't look like
code but if we dump the sdma one it does
look at that it looks like
code it also probably starts a different
place
but let's let's compare these two let's
put them side by
side
yeah like it like looks
different
cool you code array offset
bites it's like both at the same though
I don't
know
see the what's the loading here okay
here so where is this sdma
here no the sdma is still F32 I we can
tell from the
registers oh the RLC might also be
F32 let's just take a look at
RLC ah this one looks like I have 32 as
well
yeah look at look at how this is look
look at this look at the difference look
at how this looks like
code okay so that's
cool hello
let me go say good morning to
Alex um okay so the RLC is also
F32 good to
know
um my
dogs
fortunately those two aren't really
used like where's the how I don't see
sdma control
counter U code address UK code
[Music]
data you check
some I don't see anything that looks
like what's F 32
control okay hold enable right pointer
pole well that's this is very
cool we should actually be able to get
the
uh
rs64 okay we know whatever rs64 is it
has a bunch of
GPS
um if there's nothing in there right
now
interally seems to be called
the why when I search for Radeon F32
processor does this not come
up
you think they reverse engineered this
or you think they found doc
somewhere well the good news is I think
the mees if if do you think they're
actually going to open open source the
mees who thinks they're actually going
to open source the mees they promised me
they were going
to the mees rs64
too uh you found some XML files on some
file
host um so our rule with leaks
is you know I don't want to look at them
if they're at all sketchy but if there's
like an XML file somewhere I mean I
don't know is that
sketchy like how how how did it come to
be about right did AMD there there's a
difference between a leak where like
some employees stole it if some
employees stole it or some hacking group
stole it we absolutely don't want to
touch it if AMD accidentally published
something well they accidentally
published it
right
a leak is largely public domain yeah
again it depends how the leak came to be
about yeah if they accidentally
published it oops whatever
then we didn't mean to make that public
well oh yeah I should watch I should
watch their uh their CCC
talk I'm not going to be able to watch
it on stream but oh oh oh they Googled
and found some XML files oh I see they
talk about this in their in their talk I
got
you
um so yeah we're going to look at the
mees and see which type it is it's
really easy to tell okay the mees is the
CP
uh oh it start seems to start at a
different
place oh look Mees instruction Point
wouldn't that wouldn't that used to be
somewhere
else but okay so the mees starts at
uh Mees
starts at XX
5000 uh
MEC starts at hex
3000 yeah see
that okay um yeah I I mean look it's
it's questionable how much we could even
uh do if we if we get this stuff we're a
long way from really needing to reverse
engineer
um but it's good to know that it's
possible so this is RS 64 am I saying
that
right uh we know the mes is rs64
also AMD GPU crashes since this
week just since this week
oh you're seeing yeah see if you can
find that XML file I'd be interested in
that again as long as it's the depends
on the type of leak if it was stolen we
don't want it but if it was uh published
as part of a package absolutely f
g
what is
pal
user mode 3D graphics
driver the same
Ms oh about how they found the XML
sorry contains the dump of the Bonair
GPU register
documentation but it's like broken XML
and it's incomplete that stops at one
point but like okay what's what's this
doing here um and why like what what is
this where this come from right so let's
think a little deeper okay Google what
do you know about this website uh well
there's some random things like what the
hell no. txt and what the hell yes. txt
and uh some Excel files or sorry XEL
like XML St sheets um wow that's when
the internet that's when search
still. I wonder what that is and it
looks like it's a grammar you know uh B
notation description for a a a syntax
of some kind of register documentation
file is this looks like an AMD internal
format but so do weite okay so we have
these two
URLs pragmatic Bon a.xml
and. grammar.
txt let's try something how about maybe
pragmatic
b.i n it's a 404 okay pragmatic
rbon ah
Bingo wow
very
cool um again yeah the internet's under
attack right like you remember when
Google used to work remember seven years
ago when Google actually
worked
um you know I mean look this may not be
worth spending that much more time on we
don't gain that
much yeah remember when Google
like I mean the world's been seriously
under attack since
2014 um in 2014 I think that a lot of
these people started figuring
out I mean it really it really ramped up
and got bad like maybe co co was the
culmination of it a lot of these people
started finding out like it's ironic
that you hear conservatives gave up on
on liberalism when I think it was the
complete other way around I think that
the powers that be realize that look if
this open information thing
continues uh it's not going to go well
for
us and uh
yeah but again ironically kind of by
doing this I wouldn't care I didn't
start caring about politics at all till
2014 right you know you you hear the
saying you may not be interested in
politics but politics are interested in
you and again when something's
interested in me you have to put some
effort into uh you know defending
against
this uh so I mean it's really it's
really had these people mostly continued
on their existing path
yeah they might have lost power but I
think it's going to be a lot slower than
what's going to
happen um I don't know I think a lot of
people have kind of caught on I hope a
lot of people have kind of caught on and
look it's going to take people 10 years
to kind of catch up to the stuff I
figured out but there's no way it stands
what in 10 years are we still going to
have a a puppet
show like are we still going to have we
still going to have a public government
right we're still going to have a fake
like I don't think so I think it's
um I I think that the that movie Knives
Out is a great example of really how
things can just be so transparently in
front of you and you don't see what's
going
on okay I'm not I'm not I'm not
indulging in conspiracy theories this
isn't a conspiracy theory um this is a
question about what what groups are
going to lose
power
uh and this has happened throughout
history right there there's not going to
be you want to bet any amount of money
that we do not have 5 million people
alive in 2030 I I'll bet any amount of
money on that right mostly because if
that's true money's worthless
but no it's not there there's not that
coordinated of a group doing this right
it's it's it's a class it's it's it's a
class interest that that may Google the
way it
[Music]
is I just it's so sad to
see just look at
this
right that's what Google is
today that same try Google search
console
uh you have private AMD slide decks
again how did you get
them we do not want anything
stolen
what format are the files in UMR
in
also not really sure
[Music]
where I mean there may not be a whole
ASAC but it's an IP
ohre I
see yeah these look like some kind of
exports and not a
um but yeah no
it's in 2014 2016 they changed their
mind on Free
Speech they they whenever you hear by
the way I hope everyone understands this
there's no such thing as hate speech
right like like this doesn't exist it's
it's a completely madeup concept trying
to erode Free Speech right free speech
is free speech
um uh
yeah well I bet you that's different I
bet you that may be different today
among political groups but um there's a
very strong
correlation between IQ and belief in
free speech
absolutism uh so you know the higher
your IQ the more you believe in free
speech absolutism and there's
there's uh nothing I I believe in more
strongly than
that um and people who oppose Free
Speech absolutism have something
hi again Free Speech absolutism does not
cover
uh the Brandenburg test is really pretty
perfect
um you know Free Speech stops at
imminent
harm but yeah uh you know anyone who's
turned against this I mean it's not I'll
tell you what happens right you never
win these people never win they they
just they can destroy a society it is
totally possible that these people do
end up destroying America right but they
end up destroying
America like they don't have anything
they destroy it okay it's all right the
the next thing that
rises you know pretty much
um believes in uh in free speech you can
keep you can keep an empire together
based on TI for for you know a good
amount of time but if you want to make
something that really lasts
forever free speech
absolutism Marketplace of ideas it's all
real despite what both the left and
right
say now we need better
tools we need better tools to make the
marketplace of ideas actually work
but I did read a had a very white
pilling tweet and it's you
know the intelligence agencies are using
the same GPT for you
are uh soon in the next five or 10 years
we are going to the
the intelligent among the people on the
other
side understand what a serious threat
llms
represent um I'm not I'm not telling
them anything they don't know uh what
llms are going to let people do in the
next 5 10
years is scan through massive
databases and I mean creepy things you
guys are going to be able to go through
the entire Archive of every one of the
George Hots videos and you know pull
things out that I've said pull out what
are the worst contradictions I've said
through videos and you can edit those
things together and they're real
Clips um but they're also going to allow
us to go through all of the stuff dumped
on Wikileaks it's going to let us go
through everything that's released by
everybody and put it all together in a
coherent way better than any
intelligence agencies llms are a democra
democratized intelligence agency the
same power that the intelligence agency
has is available to every man woman and
child and that's why these things
represent a threat how good is that how
good is that
right we don't we're not putting the
genie back in the bottle privacy is
never coming back I heard a story
yesterday about
uh you know they track some drone pilot
who is standing in a field piloting a
drone so they went to the mobile uh you
know data aggregation for advertising
and said who was here on this day and of
course they have data from that one of
the you know 30 apps on their phone
pings the location to some ad analytics
thing and you can figure out not just
here's where the person was on this day
but here's the person was on all of
these days including this address a
whole lot you know do a title search on
the house download a landglide um and
you can you can
uh yeah find out so so so privacy is
never coming back we need to get over
that but they're not going to have
privacy either not having a smartphone
doesn't help you enough people have
smartphones and cameras that it's that
it's all on the internet you can't fight
against this all we can do is make sure
the the Tyranny world is when you don't
have privacy and they do if we can take
privacy away from
everyone sounds pretty
good all
right we're not going to find Ry files
we're not going to
find
RS
these are rs34 these are
F32 okay what is the micro engine
compute actually doing let's focus on
that let's focus on what some of these
acronyms
mean cpf CPC
RLC um let's read UMR and see where
those things are coming
from
these might be like normal things that
people who do graphics with these things
[Music]
understand it just looks like it's GR
end not like
crazy Graphics register backbone
manager Mech is probably the wave
scheduler I think that's
true
um they're not going to become if they
they may become illegal for the general
public in some countries but they won't
in all countries it you can't stop this
it doesn't
matter um yeah I mean it would not
surprise me if the CIA took over open AI
right George that's a conspiracy theory
you can't say no they actually did right
look at the new board it's the CIA took
it over it's don't worry about it that
much right um I think what you want to
do is you want to make sure that the
uh that everyone who's capable actually
doing this stuff you know I'm very happy
you know Kathy left I think that's the
right move I I think that
like um yeah you know we check out
Kathy's new
talk uh he he's he's saying a lot of
stuff about decentralizing you know
compute and stuff he's a lot more he's a
lot more diplomatic than I am too um
yeah I I think that what you want is
just just to see a quick brain drain
from open AI like let's not pull another
Google right Claude is already better
than Opus is better than
gb4 um I think anthropic is owned by a
different group of people but not quite
the CIA look they're not that much
better um you know the best ones
are you know I think I think Mark
zuber's had it with this shit I think
that it was kind of a mistake for a lot
of the media to turn on Mark Zuckerberg
the way they did right Mark Zuckerberg
hates the media now and I think I think
he's he's hopefully you know look he's
his own guy who knows what he really
believes but I I think hopefully he's
going further to realize that it's not
just the media right it's this entire
apparatus um that you have to oppose
right it's not the media it's it's the
media the
universities uh and the uh government
it's all the
same uh rs64 infiniband I doubt
it
where do you even see rs64 here no it's
not
that
oh I didn't say hi to Alex
that
for
for
all right let's focus up what are we
doing what are we doing what are we
doing Focus
up
um I don't know what any of this stuff
is it might not be
that what is the microengine compute
doing I think this thing super important
so we'll give it its own
page
we saw some docks about this once uh
this is
dispatching
uh two
waves so let's come back to what the GPU
actually looks
like
so we have these dual compute units and
the microengine compute is probably
deciding how to actually do these things
I don't know if there's actually six of
them like
this but that does like kind of make
sense let's just take a look through all
the registers quickly and see what might
be interesting okay so there are CBS I
don't know what those are where
CPS
this is dispatching the waves let's look
up everything we can about the
microengine compute let's talk about it
in
here all right on topic guys on topic
this is the microcontroller that
controls the compute
cues we just leave it at
that
enables the compute cues okay not all
that interesting um let's see is there
stuff in the driver about
it is there a file called MEC or maybe
it's just in
gfx Mech control I don't know about that
okay here
so we have pipes wait so what what is
that thing dumping um there's that other
thing that can dump besides
sdma
CPC here we go so I think this is the
stuff
wait till it's really
run right
cool does you andar talk anything more
about CPC and what it actually
is
print the CPC register data UMR print
CPC okay oh CPC is down there is that
the same CPC is that one of them that's
being used uh yes CPC is being used okay
cool
um canot find CPC registers on
ASAC not interesting not
interesting
this is probably the actual compute
cues no but that's not what these things
are we have P ke
[Music]
mqd AQL
control look see these have AQL control
on my guess would be these are the two
pipes that are actually uh talking we
also have these VM IDs
what is
bm9 can we figure that
out because we also have a similar dump
from the sdma Let's uh let's go do that
we can probably
just that doesn't have the uh that
doesn't have
this has it these are them okay so those
are
rlc's let's put this in Mees even though
it's really
sdma the mes seems kind of less
important it doesn't seem like it really
does that much no wonder they agree to
open source it right what I really want
to see is the the Mec the Mec is the
interesting thing that's doing this
compute or the sdma
firmware um now we know from the readme
here that the Mec is
rs64 but sdma is F32 so we could
probably look into sdma if we wanted to
which is
cool
um what's this is this a doc about the N
XML s
okay ah here we go cool cool this is
interesting two
different command
processors uh micro engine AKA okay
micro engine computer some chips have
two mechs other parts only have
one the mech block has four independent
threads referred to as pipes in engineer
oh
I did see some stuff about this actually
I think I saw this here maybe these are
the different pipes okay here we go so
these are the pipes are we actually
loading them yes we are
okay so this is interesting so there's
four
threads
um good good good thank you for that
link
okay the Mec block has four independent
threads referred to
as pipes and Engineering one Mac equals
four aces two Max equals 8 Aces each
pipe can manage up to eight command cues
or one of the pipes can run hardare
schedule and micro code which assigns
virtual
shit okay the GPU schedule and AMD GPU
is similar but different it's software
that exposes the per process cues and
then copies the packets from per process
cues to the mem Hardware Que in order to
actually execute the
work
[Music]
um support things like tight C group
what what is this
from a presentation for hot from hot
chips great of course it's gone it
actually just looks like
they
no
useless uh how about that picture is
there anything useful in that
picture no none of these things seem
divisible
okay there four independent thread
which is interesting so if I search for
instructure just get Mech one and Mech
2 which which Mech pointer was varying
that I was looking
at that some Mech pointer was
varying and I had this like talks about
like the mech's the only one that
changes was in CP only Mech oh rs64
instruction
plan okay so this one
changes but I don't understand because
there's four threads and I thought the
threads would each have their own
any more info on the colonel driver
about
this just some random person
yeah
all right so it sure looks like yeah you
just in knitted on all of them and it's
just uh it's a mul okay the mech walk
has four independent threes fer with
pipes in engineering
and aces in
marketing oh I mean there is also that
um
that uh of course GOOG not going to find
this there was also that there was a
little bit of information given out in
the uh in that change log that talked
about the out of order in order
thing the Upstream exposed a small
number of compute cues via Mech today
back in 2 back seven years
ago
yeah it looks like the interesting stuff
is here in pipe
zero
um oh here we
go pipe zero okay and these all have
different instruction pointers how does
it even
work where are those instruction
pointers and how come I didn't see
that why did it get
slow no that's that's it that's it for
the GPU it was good while it lasted even
UMR isn't working
now oh maybe it is I don't
know John okay how is this
getting CPC is looks like the
interesting thing so how is this getting
CPC
[Music]
one
Max where that comes
from okay but these are all these are
all CP
things so even though it says
CPC
uh is it still running or did the GPU
break
oh it might still be running my theory
is probably just that it uh got slow
because
the we still have a VM 89 that's
good oh what are all the
registers why is it printing registers
oh just CPC I see do
both
um it's running really slow because the
SMU broke and the SMU does the
power uh I wonder if we can actually see
the power
here no see it all broke okay it looks
like yeah some race condition hit the
SMU the SMU is
broken um that's what the thing was
querying and that's why everything's
going very slow now but the Fan's still
running very
fast okay
cool
interesting so it's it's this one
jumping
around oh oh you see what says ASM here
oh that's probably the uh that's the
real
pointer that that's just this times uh
let's just control see it and check but
I think that that's just that times
four yes okay good so that's the ASM so
that's probably an offset into the
Mec
great so we had all that stuff figured
out that's all pretty good uh it seems
like those ones don't really change
because it's only using this
one I see it's like printing that
afterward oh it prints that afterward
okay so this this down here applies to
this up here so you can see that the EM
is going around we have Q2 I don't know
what Q3 is it's all actually in Q2 I
think that that thing might actually be
creating two of them
okay but we understand it now so that
pipe 0
Q2 just like as in
sdma we put everything on sdma 0 on Q2
here we put everything on pipe 0 Q2
vm9 all compute is on pipe 2 pipe 0 Q2
vm9 um those probably correspond to my
real pointers but I don't have a
uh
uh I I'd have to create a minimum
example for that okay AQL control is on
I don't know what IQ timer
is or what mqd
is I know mqd is memory Q descriptor but
okay so we're going through the pointer
now okay look at this so it puts new
stuff on the ring then it goes
through and it uh eats them we can
probably even make this thing
decode
ring
stream does this
work ring stream would display the
entire could not
open I forgot that those things are just
in
there
I fig I thought those things were just
in
there on navat A6 the gfx ring
changed look at
that
very
cool um Mar is
great so I think this is the
real
stuff um
oh oh yeah this is going lower levels
then
um okay we
probably I I don't know I I have an idea
that we don't oh you found the link
let's see what it
is what was I looking at this for are
they were going to talk to me about the
command C thank you for finding it it
doesn't look
useful I don't know if these are the
uh the actual
things but this looks a lot more yeah I
don't trust
AQL there's another kind of command Q
you can
create that's not an AQL command Q uh so
if you look if we go back to that tiny
gr example from before where I create
that sdma command queue there's like
four types you can
create
um what did I close I didn't mean to
close anything I close the kernel
probably whatever uh if we go into sdma
fun
here come on you're going to reset if I
tell you to
[Music]
reset and if the SMU is fucked it's too
done no I think the SMU doesn't actually
get reset this is like a really bad
crash
SM you mode one reset what if I do could
do a mode two
reset do a good reset don't do a shit
reset uh yeah here so there's compute
and compute AQL I wonder if this is used
anywhere in the
runtime
HSA Q
compute no see it's only compute AQL we
don't actually know how to use a compute
Q I don't even know if these things are
supported here there is a test for
it determines which packet type oh
pm4 interesting yeah we probably want to
not use AQL and use
pm4 there's probably something doing
decoding of AQL into pm4 and we always
want to get the lowest level of of
control possible okay uh pm4 instead of
AQL so yeah right now right now we're
using we're using AQL you can read the
uh
so yeah we'd rather use pm4 uh in OBS
kfd because that's actually more like
what the GPU is
doing these things are pm4 commands
these things actually look pretty broken
I don't think that's
right got a good
link Q handling yeah no I I mean I know
this
one uh oh here GPU Hardware Ace oh
that's that's cool okay let's just kind
of talk about
it
um there's also that other the accurate
simulator
one that I don't think we spent enough
time looking
at
this is
sick yeah just okay good oh good we Now
understand Ace okay good we we've we've
come all the way through to understand
what this stuff
is yeah it's using
AQL
packets and not I mean I guess we can
use AQL it's not that big of a
deal um but someday we can switch this
to
uh so I want to get rid of all the
software all right AQL packet Ace but it
doesn't actually go to the ace okay the
asyncronous computer is a hardware
responsible four independent threats so
these are actually mec's so it's not
actually this is wrong it's not actually
Hardware it's ship
firmware
um the firmware is deciding how to
dispatch these things oh EOP base okay
wait we put in the EOP we know about
eops
uh yeah that's that's put in in the que
you can go to Tiny
gra
um
yeah so that does
that fans's constantly running now oh
no oh no we got to reboot boys it's
going down I'm yelling
timber H
sad it doesn't even
work trying to like not use HSA yeah HSA
is
over try to reset again no recover H oh
come on why is this so
flaky we meditate for a minute
okay
um I mean this might just be like kind
of everything it's just putting things
on here we don't know what's actually on
this
que it says AQL control so AQL might be
a real
[Music]
thing
thread
blocks GPU compute resources into four
Shader engines the primary role of an
ace AKA a Mech is to dispatch blocks
from the kernel at the head of the HS AQ
to the SE the Shader engines however
without a prior explanation of reason
reasons under certain underlying certain
design decisions the AC's Behavior while
dispatching blocks to se may seem
bizarre to forall any such conclusion we
must first describe a thread ordering
guarantee to wait for the completion of
oh I
understand
what do we know about
sees we got find out about Shader
engines because I think these things are
real
hardware and I
bet we have six of
them right because that would look like
the
picture I just want it to look like the
picture I have to turn the computer hard
off and hard on because I'm sure that
reset didn't work
fix your
[Music]
shit using coup masking and
practice disabled them presence of a
competitor
one would think that an open source
platform like amd's GPU compute software
would be an unal position of prominence
however mere source
code
it's not just mere source code it's that
you have firmware blobs you think these
things are Hardware they're not Hardware
they're shit software and they have
bugs all right where were we um where
were we after rebooting
again
MEC or Ace dispatches I'll just copy and
paste the line it's better than they
could than I can write
it
um
is to dispatch to the SE does this talk
about
se's no se
there SE tap delays SE skew delays SE
select MX
Ram but I think there's got to be six of
them too
right right those are each in SE oh
Shader engine perfect good they're even
called Shader engines okay so the Mec
ah and look there's aces in
here oh we found some good shit good
shit
boys okay so these are the Four Aces and
they're dispatching to
se uh how a power cycle a pcie device
does that
work try
it um no removing scan usually doesn't
work we can try it we'll try it next
time there's a
chance
can't I shouldn't really be doing watch
Rock Andi because I think that's
actually maybe causing what those
crashes
are yes even Rock MMI can cause
crashes
all right there got to be six of them
you see six
anywhere oh here we
go well there's six TDS
anyway in the CAC
weights here reg se1 s se2
se3 there is an se6 but it's not
real let's run some more
compute I'm just training I'm training
cart models when I run this compute but
it can be
anything
do these
change that's what I'm hoping
for looks like
nothing
we definitely have these vm9 is like the
user bace thing so we definitely have
this Q pumping
away oh
no the SMU broke
again okay the broken ASU is probably
okay and again we're using pseudo so you
can't really expect it to
work
we'll try your power cycling stuff in a
minute okay we have how do I zoom
out we have six Shader
engines has six
se but how do I see what's actually
being dispatched to them oh this might
be stuff we don't have the uh the ship
for a chance we just don't have
this oh I asked for the wrong firmware I
don't want the stupid Mees I want the
[Music]
Mec oh AMD I want the Mec I asked for
the wrong shit I don't care about the
mees the mees isn't where the bugs are
the bugs are in the Mec and apparently
in the SMU as well
how do I see what's actually running on
the
shaders right like this is I just want
to not use this
shit right let's look up sey in here
look up Shader in here I'm got to
reconnect
window and
down are the feds after me key is open
doors Keys open
doors iterates through the Shader
engines of the device to get the number
of waves in
flight tbas and
tmas I'm running just slowly um I just
look for the word Shader oh
Shader there spy shaders though I don't
know about
that
see that
changing let's just look for what
changes some recc shit some dma
shit Gus cpf
no no no
shaders I mean I would guess it has this
stuff
because the debuggers probably do this
stuff this is this is probably
accessible somewhere we just need to
find
it
UMR
print
waves how do I just trigger this can I
just print
waves
waves
did it stop
running did we get one good one and then
it
stopped
did that crash the
waves
perfect okay everything we needed was
already in UMR pretty much like
everything we need to understand this um
let's stick this down here these are the
[Music]
wav we CLE it up in a
minute
saves
okay so we just have yeah there we go
beautiful wave PC high wave PC
low I don't know why those numbers are
weird
but should be right oh that's PC high
and that's PC low okay that's no that's
fine that's just the address okay
awesome
uh worker processor three worker
processor Z Z yeah it doesn't look like
they're running on all of
them now it's like really
Frozen should we try recover or should
we try power
cycle
recover oh see that was an meq
crash mes is
angry Mo reset let's kill all pyth three
died going to work fail to remove q0
skip scheduling
IDs presume of PSP block fail I think
this is actually yes it switched to Cuda
automatically all right um let's try
your pcie
stuff
which device is
that God which device is it not that you
have something
better there was a shell script below
yeah it's the same
thing it's just calling
remove it seems cooler
no
um this
one Echo one into
move great
performing hot reset of
Port no it's Hong trying to do this
um
I think we have everything we
need like okay those things are actually
just poking the the things and running
them so that's probably
it wave listing is unreliable if you
didn't halt the waves use all halt waves
can I resume
waves all right eventually it crashed
because it hung the
kernel and now we have to turn the
computer off and on
again let's first push our documentation
which I reiterate I should have done on
a different
computer
mechx uh have I looked at those
registers when it crashes I mean that
sounds
nice
but
uh I don't think we're up to that
yet I
mean this is a lot of the information we
need right here so we have
sa1 okay is wave zero and wave 1 because
it's double
wide wave GPR Alec which is probably in
the local
memory so there's a question of how deep
we really want to go
it may be possible to find some subset
of the kernel driver that actually is
stable um find some special way of like
you know not upsetting the que who knows
what the problem really
is we back boys we
back uh let's UMR
[Music]
gfx let's look for SE actually PC low
should be easy to
find me PC low how's it getting these
wave
things how's it getting
this don't scan her Shad or INF by
reading the
ring if no DM is
requested okay we can hold the waves all
right let's just try to look at
waves just try to use this and look at
waves
um Pudo you
Mr
waves uh we want
to oh Hal
waves dash dash
waves that's it we broke
it ah
that's kind of
cool except that there's nothing there
but okay that's just a mess crash it's
not that bad are we actually using AMD
right
now I don't
know it's possible it just silently
failed over to Cuda it's kind of
annoying that it can do
that yeah it just silently felled over
to
Cuda it just say might
work we just got a mess
crash oh found a pretty good paper for
trying to write scheduling from scratch
on AMD gpus or just
generically the right R
garbage is it generic or is it specific
to
uh
interesting add this to the list of
links oh this is the same one this I've
seen this already this is the same
paper oh it's working again
slowly it eventually came back
okay waves Hal
waves
cool dumped all the sgpr dumped all the
[Music]
vgps and then it seems like it crashed
the
GPU
yeah with mess crap but at least M crap
eventually does seem to come back okay
don't halt the waves halting the waves
is a mistake how's it finding
this where does this stuff
lie
try to send a command to Halt the
waves wonder if this has been
used may be cool if this just
worked more wave data describe
wavefront is it getting wave PC L
from oh they're in their registers what
but how come I didn't see
them how come I didn't see PC low I
tried for
that
where's St one should be avoiding oh if
gfx power gating is
enabled what if we disable power gating
if these things will get more reliable
all right it's coming back it's coming
back come
on so how come there's no low did I not
is that not is gfx a th000 not the right
thing sure looks like it's right
here wave PC low why is that not
included it's in
GC why is that not
included
could it be any of these other
ones I doubt
it
oh wait this is anx not a
reg what's
anx
data get
value red name all right there's
probably some way to just poke this
then probably not a
r
look up right
bit
oh can I do if I do
this
wow
man this is the nicest thing I
do that's so
cool okay um do we know what reg SPI
is again we're expecting to see
something that has
six looking for Shader
engine more disable gfx
off gfx off
zero does it stay off now or is it going
to turn back
off
go to
sleep user data GS HS
PS I don't know about any of that
stuff is the Ry format used by radon
tools the same as the reg format uh
maybe some parts of it what is anx do we
know about
that
probably read it there's a thing that
reads it in
here
[Music]
pm4a
UMR Shader type okay
hsgs
interesting
AI
this makes me think they're like
not
registers that is not not spy that is
normal
spy what did I find before that had that
head
five like what is there five
of is there five of and not six
of your reg SE seems the most
promising is that one of them that
changed I remember like we looked at all
them we just look for the ones that
changed what's a CAC
AER they don't
change
let wait for that to run again temp1
temp2 give temp T1
T2 the sdma AQ
[Music]
changes U code changes M time
changes
both sdma Q's
change yeah so they're probably just not
registers um let's look at the IP and
see
here
oh the other thing that it might be
is just means registers but like there's
multiple of
them like they might still be registers
they're just
different they might be like just just
oh it's like there's so many of
them I me whatever this is it like looks
pretty
good
so I don't know why it only went up to
se3
here wave zero wave one and there should
be it should go up to se6
here the ri forat is much more of her
Bose I'm aware yeah but boner is
old like I oh man like I wish we had
this you know they have
this
oh oh I want that for yeah R is just
made from Rye come on release the Ry
file
m
what do the things
mean what opens these files let's goe
that does that let show
you
database read
[Music]
IP
um valid rig
[Music]
file
IX oh here it's a reg SMC
okay
which we can still totally read it just
like requires something
else oh here there's an option called
read SMC oh
perfect
I should just look right for that man
this thing really has everything and
let's also use color why
not there it'll be some nice color we
love
color oh look at that
color why can't you read from SMC
Rex told you to read from the SMC
r
why can't
you it's not
up stuff has to be up to do
that oh good it didn't complain as much
aha I was kidding about the
color why can't you read from the SMC R
again did it read for most of the SMC
Rags no it did it once why did it not do
it again
[Music]
again maybe you can only read from them
in color oh that's
reasonable no oh no it's not
working why are you not reading the SMC
RS
NOC
Rags why can't you read from the SMC
rag read
SMC read SMC register via direct iio
here let's try Asic options use
PCI
that just might be part of the
ASAC seek cannot
read why
not PS bits full no follow I no scan
waves use PCI
complains less but they all still have
value
zero we'll still have zeros there yeah
look unsupported family type and UMR no
I can't do
that cannot re SMC why not
not if I enable the colel debugging
it'll tell me
something
why can't you read from SMC RG but you
do
okay yeah UMR is a man page UMR also has
a read the
docks even if I can't read from them
it's still kind of useful so I can see
them
[Music]
accumulator RQ wave
oh probably one wave
here GPU reset has been a shit show on
AMD for
Generations oh my best bet is to leave
and enter backo wait I had backo do I
have the oh I had I had some docks on
back what what
is uh bus active chip off
yeah that requires the SMU to still work
somewhat I
[Music]
say I'm going try that there's some
there's some like mode to enable that I
think I
saw uh let's not dump the bits for
now
like
RS T all right there probably like some
active way to read this I don't know
it's not that
interesting it's not that interesting I
think if the mech is uh the mech is
fucked we're just fucked
all
right that's pretty
good um how did we do on our
documentation
today oh
no oh
no
that up to date bad tree object head
well I have an
idea
except I want this
one oh
no um I want the SS H URL for
this
could the mech be some kind of risk five
chip I mean
maybe what just because it has the word
Ace
no
AMD has been unwilling to dedicate
company people to fixing reset bucks for
years they say this High severity low
priority what
[Music]
clowns
all right let's look through our docs
and see what we're
doing all right documentation for the
thing all right we got some we got some
docks here we can go into the
mech we can go into the
mess can go into the
CP all right let's actually add some
docks here what Arch is the firmware
okay so
um
random
notes uh the PSP is
arm which ones are
F32 sdma plus
RLC plus RLC we are F32 and we'll
include a link to the fail overflow
repo uh others are what's the name for
it again
[Music]
rs64 like NC or
rs64 uh no known dots on
this uh
Isa
okay
cool compute unit it's where compute
happens great we see that there's six
Shader
[Music]
engines six
se maybe we should add some notes about
the other kind of
um
okay yeah
[Music]
the uh SQ registers are
on what were
they
onc should be readable with but I can't
get it to
work they are in the red
files
prefixed
with Hax instead of red sure that's
right
[Music]
all right so we added some docks for
those has
six
Shader engine
has
seen main
diagram uh
for right let's go back to read me here
um where's the I include a link to the
RDMA 3 in case people don't actually
know about
that I'm sure they
do uh in
CU
um
these cus run
run rna3 code and R
quite
which is quite
well
documented how do they like deal with
this
stuff we have the ISA the ISA no
I really doubt the firmware Isa is
documented here no it's not these are
the isas for the for the cus not the
isas for the
firmware this repo can
reset
interesting why can't it reset the newer
ones
okay um
good should I move sdma to its own thing
we move sdma to its own
thing
oh the guy Rage Quit again when it broke
on the new one yeah I I don't know how
they debug
it Ron tools contains a reversed
engineer for the there's okay so I
didn't think that radon tools worked at
all but it turns out it does so you can
see here in my CP
documentation um the sdma and RLC are
F32 and that's the reverse engineered
Isa but there's a new Isa called rs64 at
least from what I can tell and the Mec
is um
is
[Music]
that I'm not that interested in this
it's just
normal normal GDB that can oh well what
is
this I'm include it in the links
um I mean we're probably not so none of
that GDB is going to be able to attach
to the uh to the firmware how does how
does AMD de develop on this thing
without being able to reset
it like do they not have I bet they have
the most insane development processes
like the amount of man hours that are
just
wasted uh where if they built some like
sane tooling I don't know like I don't
think they have secret good internal
tools I think like UMR is one of the
nicest things they have probably same as
us because you know it looks
like guy wrote Yar
cares this is J tag they J tag like like
a normal developer working on his GPU
has it rigged up to JTAG
maybe uh save
all oh we have to add sdma like to the
main
internal Wiki with tons of instructions
I bet it's
Bleak okay so I heard from another AMD
source which shows that AMD doesn't
really talk that well that they can't
even get access to registers which I
don't believe but he said they can't
even get access to registers in order to
get information on a register they have
to go through a team that looks at it
through nvidia's eyes to see if that
would leak any
information I thought of logic probing
the pins directly are you
trolling are we going to spend nine more
months to find out it's a hardware bug
maybe what do we do if it's a hardware
Bug Man class action lawsuit class
action
lawsuit no I don't think it's a hardware
bug I I really don't
besides most Hardware bugs like Hardware
has bugs but they're mitigated
mitigating Hardware bugs is
okay minor bugs but a crypto handshake
with the PSP
firmware I don't know about you think
the PSP firmware has the secret good
reset that they don't expose for some
reason I don't know necessarily buy
that
no reset it just fuck the SMU doesn't
work well enough yeah I buy
that um which architecture is theu by
the
way oh it might be at 32 as
well try radi tools on
it
I don't think
so why are they using some custom
Isa don't
don't you don't want to know the answer
to
that
it sure looks like this is rs64 but a
little
different say rs64 question mark we
don't have any evidence that that ones
really are a 64 I don't
think I think where do we dump the
registers here yeah we don't have any
evidence for that we do have evidence
for the
Mec
yeah I believe
that
um maybe kdb is the you know just the
colonel
debugger it's not IBM's rs64 I don't
think
so
power
PC we can try I don't think so but we
can
try just go here back have this
CP
think these are power PC
instructions
take someand
on no can't be just assembled can't be
disassembled oh that is that like that
no it's not
right no it's definitely
not it's probably just some again
there's a question of even how useful it
would be if we figured that out we have
a full if we had like a nice GID drop
yeah that'd be pretty good but we don't
have a
gidra um I mean they're never going to
they're never going to even if they
release the mees what's interesting is
if they do release the mees they'll have
to release some docks on rs64 as well
but yeah I wouldn't hold my breath for
I'm doing
anything it's clear they do not want it
to be better they are fine the GPU is
just fine 2% of the market share is
plenty for everyone at
AMD
uh would make more sense if it was fp32
but it's not I just disassemble that I
know it's an older part of the system
but
I bet you the chips can run both too I
bet you they just recompile an
rs64 and that if you set the flag the
other
way they
uh right like it's it's doing something
else
here there's no fp32 it's
F32 this also might be new to
gfx1 which is kind of
interesting
what could it
be
first appeared on
Fiji
what is
this
[Music]
rlcv
don't
know again what would this even get
us we've solved most of the
Mysteries one day we can understand how
the is actually dispatching
things uh but like yeah this this is
pretty just
good okay the GPU Hardware has the Aces
and then the aces
here do thread
blocks this figure abbreviates workload
manager are these things
real
um Prim unit oh RB positive great that
sounds like a blood
type PC Gen 4 is here multimedia engine
display
engine AC here dma engines your CP
there's all little l2s little
l2s um six mag L2 cach three mags total
of L1 I
[Music]
imagine so little of this is actually
about
compute
[Music]
for
they're not making a big rdna rdna 4
chip from what I
heard is that still
true
what we're
streaming if you'd like to come in here
and discuss and you're appropriately
rest you
can I'm hungry
though
yeah are you in sandwiches is that what
we
do no big chip no big
chip
boo
AMD is diverting scarce resources from
gaming to AI they're making bigger more
expensive chips that don't work and not
making little chips that don't
work Shader engine the block must be
assigned to a specific CU on the SE okay
good we can we can we can look at we
look at the diagram while we're reading
this let's just do a reading of this and
then that'll be today's stream and then
I got to go find
food why isn't it good
outside it's like
gray
oh yeah they
can
Alex
say
all right all right we're smok weekend
sandwiches so we're gonna I do we need
we need five 10 minutes to wrap the
stream up we touched on a lot of
important topics today like the
Illuminati and you know
AMD
um all right let's just do a a reading
of
this okay in order for an ace over here
to assign a block to an SE the block
must be assigned to a specific CU on
that
se as shown in figure four and five
assigning blocks to the CU is a job of a
piece of per se Hardware called the
workload
manager
ah wait there's a citation for
this only if I showed up to Oakridge
National Laboratory on September 6th
okay
the workload manager has four dedicated
slots for staging incoming blocks one
slot dedicated to each of the GPS Four
Aces okay that makes a lot of sense we
got four aces puts things in the
workload manager ideally workload
managers will assign things in these
four slots for the
cus in a round robin manner the behavior
changes if no CU has available resources
in this situation the workload manager
will allow blocks with smaller resource
requirements to cut ahead if possible
get ready for race condition this
finally allows us to explain why this
GPU constantly
crashes I
see that's why we only make one
Q for more insight on my radon socks oh
let's see this oh this is this is going
to
be the
yep
yep
wow
wow yeah
this is so sad this is so sad to
read this is so sad to read hey GFF if
you see this you want to
drop let's let's let's let's make
a let's support their gpus even if uh
they don't right because let me
explain Step One support their gpus step
two support our own gpus and cut them
out see what I saying step one step two
step three is profit and it doesn't even
have any question marks in it step one
build better
environment build yeah this is what
we're doing okay all right ready ready
ready for the ready for the plan
dude Unstoppable Bros Unstoppable
okay the only way to build an AI chip
company is to start with
software many companies thought it was a
good idea to tape out chips taping out a
chip is the easy part the hard part is
right software you see AMD was able to
tape out chips but they weren't able to
write any decent software the software
is terrible there's Colonel panics in
the driver my poor man
GFF you
know I spent more of my fair share
debugging AMD devices and helping them
to understand the issue only to see them
just dismiss it all in future generation
and not get a thanks or any other form
of support my work resulted in sales for
them see you I I went went through this
phase bro I went through this phase and
then I just accepted that AMD is never
going to change but what we can do is
make our own chips and now I know that
my chip needs to have an acce and a
Shader engine and no not really we don't
actually need any of that shit
um uh no Ian they're not going to win
guys like there's no AMD it's it is it
is over for AMD um you know like look
rdna 4 is not going to have a high-end
part you think rdna 5 is you know how
these things work right like I I'm
telling my prediction and I give maybe
50% odds on this prediction is that AMD
stops trying to compete in the high-end
GPU
Market um the only gpus they're going to
continue to make are the gpus for uh
their ryzen processors and the gpus for
uh game
consoles
um yeah I think that this is that this
is over unfortunately uh but it doesn't
matter we will pick up right where they
left off uh and we'll make big chips and
uh you know they'll just be
better
um so yeah we're going to uh we're going
to fix it uh without their support and
we're never going to expect anything
from them uh I don't know see the
mistake was they told me they would give
give me stuff see that was the mistake I
don't expect shift from Qualcomm you
know reverse engineer all at Qualcomm
you want to see want to see a a
beautiful piece of reverse
engineering it's an open
pilot I think it's still where I left it
let's see if it's still where I left it
um loger where is logger D oh move to
system yeah uh
v4l encoder
man if you want a beautiful piece of
reverse engineering it's
this uh this is a 330 line replacement
for I forget even what Android calls it
oh it has some stupid
name um that like lets you access the
encoders I forget what and I forget what
Android calls it but it's some it's some
like weird API I just reverse engineered
it went straight to the kernel boom
straight to the
kernel uh I used to like link and like
load in this thing and it was
janky the the Android one could barely
keep up um what's the Android Android
video encoder what's what's it it's not
media codak it's called something else
Android video
encoder
API what's the generic video encoder
API we'll let everybody talk maybe
somebody
knows um video on Android what is it why
can't think of it it's not media
Kodak it has some it has some like high
[Music]
level no it's not vaapi what is
it it's going to bother me if I don't
find
this um one of you guys will find find
it right oh open
Max
yeah uh yeah open Max omx omx yeah so
omx is the is this like overlay layer
Qualcomm wrote this terrible user space
for it just reverse engineered it uh
yeah stage FR media codx but um reverse
engineered it went straight to the
kernel went from 50 milliseconds barely
keeping up with our 50 millisecond
camera cycle to 8 milliseconds directly
using the encoder uh yeah I saw have F
quoted the Tweet like this is look
here's a guy having the exact same
experience I had with AMD right they
they they like can can people draw
attention to this see like it sucks like
at least you know when I when I raise
hell about stuff people respond to me
because you know they they again the
only thing these companies respond to
his
PR um but you
know who respond to this
guy all right they respond to PR and I
don't know should we keep the pressure
up I think I think like should we we
should we retweet this like it just
makes me angry
again if a horse doesn't want to drink
water we just make our own gpus and our
own gpus are better that's
right um all right did I push
everything
keep the pressure it's working already
no it's not working they've done
absolutely
nothing AMD has done nothing we have
written docum
mentation
oh I'm sure I'm sure that
guy pass
through
interesting I don't really understand
it
oh I guess it's like oh it's just like a
really lowlevel oh
cool one more anecdote all gcn1 works
okay but the
S is unbootable because they never
figured out how to power it on
wow um no as long as they keep answering
no you're wrong about
that why not tweet about market share
estimation yeah I think I think you know
yeah you can lead a horse to water
um Oh you mean the really old one I
don't
know uh yeah but look okay we have some
documentation
all right I'm going to go eat a Easter
sandwich Easter eggs going to go on an
egg hunt or something whatever people do
for
Easter um tiny con GPU announcement yeah
we'll make our own GPU and it'll be
good um the hardware the first
generation of the hardware is going to
be open source after that I'm not
sure uh I think after that probably the
the future chips will be closed uh but
we we definitely document the chips
well um it really might be probably not
yet but like if I keep working on this
if I work on this for like four weekends
I bet it will be better than amd's
internal
dogs um again for what we can get access
to I I I don't
uh we don't have we don't have all the
information we need but we're not that
limited by
information I mean it would be nice if
we had
yeah you think the source code for these
things is like
documented I mean there's no there's no
documentation in the kernel driver they
just use acronyms they don't tell you
what they
are
um is there no info on the dark web all
got all right um yeah we're working on
so quick quick quick tiny grad then we
go uh so what we're working on now in
tiny grad is a new
driver um and a new style of driver
what uh look at that look at that look
at that Spike uh we're working on a new
style driver called command
would I actually want to hire the guy
maybe I mean I
I I I think that like we could start
with like I don't know again it depends
who he is I really do like that people
find their own way to Tiny grad um I
don't really like to like reach out to
people when people are ready they'll
find their way
here um but uh yeah I mean I would give
him I'd give him $1,000 if you could fix
the reset on the GPU that's a real
offer
um if if he finds a way to reliably
reset the uh 7900 XTX th000
bucks um bro I don't care about that
uh if you retweeted me might I find you
on his own yeah a th000 bucks if you can
fix the uh if he finds his way to this
video th000 bucks if he fixes it for the
uh
rna3
um no we're not doing any hardware mods
I need a software way that reliably
resets the GPU and that's worth
$1,000 uh maybe I'll I I'll look through
it I'll try what he has I'll see what
doesn't work and then I'll file an issue
with my
offer
um just try them all in sequence yeah
yeah yeah we'll try
them it' be nice if be it' be nice if we
had a real reliable
um way to reset but yeah command Q is
the future command q and kfd is going to
give us 0 of one dispatch
timing
uh I'm not putting a relay on the GPU
bro
um I have things to do with my life that
aren't
that uh and then also who knows if that
even works do you think the konel driver
is capable of handling power loss to the
thing
uh you know who knows what internal
stage holds in the kernel so yeah all
that no it's not going to work never
mind why why am I talking with some of
you even subscribers yep all
right thank you for watching today's
stream happy Easter everybody enjoy your
documentation for the 7900
XTX uh perhaps we will continue this
project next Sunday I think we're all
learning a lot lot uh hopefully you guys
like these uh streams and uh Happy
Easter be a good Christian uh be a be be
Jewish uh be a be a
Muslim uh all those things are good just
don't be an atheist because you know man
come on
good morning everybody good
morning oh you know what we can't do on
stream listen to copyrighted music and
that's one of my favorite activities
listening to copyrighted music do I look
do I look glowing do I glow this morning
I'm trying to
Glow Welcome to My Stream now hopefully
you guys don't see that warning because
we are not smoking weed on this stream I
learned that it was very bad uh I was
also banned from
LinkedIn uh you know I they've really
they've really been cracking down on on
me hard I I have a narrative and they
don't want you to know my my narrative
or something I I don't know man you know
you can just read conspiracy theories
everywhere you can walk around paranoid
like like the John
Nash um let's close the door because
Alex is sleeping don't want to disturb
Alex
oh welcome oh you you're not seeing the
warning are you guys seeing the warning
on my uh on my thing on my content if
you're seeing the warning we got to go
somewhere
else this is a wholesome this is a
wholesome stream wholesome Christian
stream wholesome Christian stream boys
Christian stream boys good no warning
this is a wholesome Christian stream
boys now welcome in uh for those that
don't know me my name is uh George Hots
uh uh I was I was a child prodigy um and
like all child prodigies uh people had
high hopes for me and I ended up
fulfilling all those hopes so yeah
there's
that if you're actually new here don't
worry I don't actually take myself
seriously um if you're worried about
that a lot of problems in the world
would be solved if people just took
themselves less seriously
but took see you got to take yourself
less seriously but you got to take the
future seriously I think I think those
are those are difficult Concepts to to
hold in your
head
um no it's not ASMR we have to we have
to be quiet because Alex is sleeping
Alex is sleeping anyone who's loud you
get
banned
um pytorch has has
RL
all I know about torch
RL no no no we're not doing decision
Transformers today I'll show you what
we're doing today
so
um I've added so this is Tiny gra
master and I've added an option to Shard
across gpus so this is running 7B llama
here we can run it on one
GPU and uh you give it a second here to
load so we're saged into a tiny box
right now um for those of you that don't
know what a tiny box
is uh it's a box and it's not really
tiny that's kind of a misn number but
here I I will I will demonstrate it for
you um so we just go here to test
GPU uh a tiny
box is for you can you can pre-order
right now on tinyg
um a tiny box is a
$155,000 very
uh powerful AI computer um
so when you see things like the rabbit
for $200 you're much better off buying a
mid-range Android phone uh in terms of
power per dollar when you see I think
there was another one I'm not I don't
even remember the name but like when
people are selling AI computers in the
Thousand price point buy a mid-range
gaming PC it's it's going to be hard on
the low end to compete with phones and
with gaming
PCs but there's very little in the
$15,000 Mark uh the closest you're going
to get is maybe something from Lambda
Labs like let's see what we can get for
$115,000 Vector GPU workstation get
pricing here so something like this uh
so this is a little bit cheaper let's
see if we can customize it to be a
little more
powerful um as a cool company by the way
I'm I'm not trying to I'm not trying to
hate on uh on on Lambda Labs here um but
I think that we are providing uh Better
Price uh than they
are we need
what can I can I customize
here okay
so I mean we're going to have have to do
a little this should be a way for me to
customize and
get
um how do I click customize how does
this
work okay here let's just compare it to
this one so this one this one costs a
bit more
um yeah this is actually probably a good
comparison uh actually it's almost a
perfect comparison so you're getting
pretty much
the uh for $1,000 you're getting
something that compares to a
$37,000 Lambda Labs
computer
um we
have so instead of three uh gpus with 48
gigs we have six gpus with 24 gigs there
are 7900 XT XS um instead of this thread
rer Pro we actually have a very similar
CPU I can show you the one we're
using but it's the same 32 cores so it's
it's this AMD
epic um we don't have that much RAM I
don't think you need 512 gigs of RAM uh
we only have 128 gigs of RAM but
remember that uh Tiny Box is less than
half the price of this um our hard
drives are a little smaller so this one
is
not let's go over to Tiny s here tiny 7
has the full has the full rate array in
it uh so if you like cat proc and D
stat you'll see see that we have four uh
very highgrade mvme drives connected on
pcie 4 and I can demo this for
you let's do like 128 Meg block size and
count
100 and say like I flag equals direct
there
sudo
sh yeah um I think we can even we can
make this go faster if we do
more should be a little
faster uh what did I what did I why is
this not as fast as it
was is it not if flag Direct
is ey flag
direct does it matter where I put
it can't matter where I put it can
it huh okay I mean that's still kind of
an insane speed I don't know why we're
not getting when I was doing this test
before I was getting uh 20
8.7 gabes per
second I posted one on Tiny gr's
Twitter of course this isn't going to
work because it's uh not logged
in
oh well I'm still pretty happy with that
that's going to be a lot faster than uh
than one U2 mvme right this one U2 mvme
uh can't
exceed I mean it can exceed 7 gigabytes
per second so this this drive is over
twice as fast as that and I'm sure sure
I just misconfigured something and it
should actually be faster than this but
whatever oh someone linked it thank
you md0 I flag direct BS equals 256 what
how come it was faster before why'd it
get
slower it moved to
md27 but that shouldn't change
anything
H why is it slower this is the same
computer there's a few of
those it's possible those are causing a
problem well we'll have all these bugs
worked out by the time we actually ship
tiny boxes to people why is it faster
there and slower there this doesn't make
any
sense
um okay let's look at the drives
individually
okay seven gigs on that
one six gigs on that
one six gigs on that one there got to
just be some kernel
garbage
weird
why don't those four add
up I done a kernel update I don't think
so
built on November
14th um it's not
mounted I think that
matters
so
weird we're gonna have to get to the
bottom of this before we
ship why did
uh yeah I I know it's I know it's not I
don't think I's running on the
computer uh reboot and try again
okay
oh we changed
processors well that's not
good we put a different processor in
this one we had a 16 core processor it's
CPU limited I agree we had a 16 core
processor and we switched to a 32 core
processor and now this is
slower uh no it's software right yeah
it's Colonel dumbness limited I I agree
wow wait that's a real problem okay well
we'll fix
it I mean it may not matter what I think
that uh DD is just look I'm sure you can
get that speed I I don't like that it's
um I was
using I was using this was the old
processor I had in there but I was like
no I want a better
processor but to be
fair
um it doesn't have as high of a core
speed and that's not
good yeah okay so this is 2.4 GHz this
is the processor that's in the Tiny
Box um like this one's much cheaper I
wish I could use this one but I didn't
want to use it because it wasn't a lot
of wasn't a lot of
uh this one's double the
course could be the irqs are on the
wrong num
Noe
maybe wow but that I mean that's crazy
all I did was Swap this processor for
this processor and now it's
slower all right that's the really cool
thing about the tiny B
is we're going to be able to spend a lot
because they're all the same we're going
to be able to spend a lot of time tuning
and really zeroing in on look first off
this isn't a bad speed but uh we're
going to spend a lot of time zeroing in
on how to get this thing exactly
right um DD is single threaded too I
think we
can we can uh it sounds Numa yeah
great well that computer is going to
take forever to reboot because it's
Server Motherboard um in the meantime we
can play here with with tiny
n uh is Tiny Box like a Raspberry Pi but
for ML exactly yes you
understand um what if they stop
producing well I don't think they're
going to do
that so we're getting 24 tokens per
second when we're sharded on one GPU we
can do beam search and it can go a lot
faster um if you want to if you want to
see it be
fast is kind of
cool yeah you can see this is the full
connectivity Matrix between these
gpus which is insanely fast so now it's
searching for the fastest
uh ways
to do
things can I late Beam on llama let me
see if I can late beam
this computer
p
stilling uh I did not buy a apple Vision
Pro oh gen oh there's no yeah there's no
light be
yeah
so we'll see we'll see how fast we can
get llama to be with uh with beam but
then I'll show you sharding and O fast
DD
o
I use this splice I'm not sure that's
going to fix it
actually I didn't try
it oh 15 Stars I didn't even
look yeah I I don't think that's going
to fix it um so you see what beam search
does it searches is over all different
sorts of kernels that can run it and
then it finds the ones that are the
fastest I did not buy an Apple Vision
Pro uh it's very
expensive and uh you know money money's
been Money's been tight lately boys
started a new
company uh we haven't had stupid money
to throw around at things maybe if
Bitcoin goes back to
100K
uh oh yeah meta did buy a lot of h100s
man Yan laon you know what a what a
mench
um yeah maybe if twitch gave better
splits at least they removed the content
warning from my from my channel which
was really very offensive to me
um I also uh I got banned from I got
banned from LinkedIn if you want to
check out my LinkedIn I wrote a nice
post about how I was banned from
LinkedIn maybe um if we can get to it
not logged
in uh here we
go well we're gonna have to read it
without this popup maybe can we just get
rid of this popup let's get rid of this
popup all right there we go
um so I thought maybe I'll read to you
my my LinkedIn apology um I I was banned
from LinkedIn a terrible tragedy I know
is why would they ban one of the best
people on this site but then I read the
LinkedIn professional Community policiy
see picture below I'm deeply sorry to
everyone that I offended saying that I
used LinkedIn as a dating site I
understand now that this website is not
for that but instead is for serious
business discussion if you're interested
in dating you might consider following
me on Instagram at George Hots
again if I offended or upset you I'm
very very sorry and will take this band
to deeply consider how my words have an
effect on the people in this community
words matter the choice of words matters
saying I use LinkedIn for dating is
wrong a better choice of words is saying
I use LinkedIn for professional
networking I hope you accept my sincere
and heartfelt apology I have updated my
profile to be more sensitive and
inclusive in hopes that I can continue
you being a part of this wonderful place
where you can freely speak truth to
power so hopefully hopefully LinkedIn uh
understands and accepts uh my
apology Professional
Network uh by the way by the way the the
real joke of it is LinkedIn as the most
absolutely god- awful dating site in the
world um the the women who DMD me asking
for dates on LinkedIn
yeah yeah it's it's not it bro it's just
it's not it bro
um sell the rolls for a Vision Pro H the
r rolls is rolls coin is down rolls coin
is down I'm you know if someone's
interested I'll sell the rolls
um I'm telling you guys I didn't make a
lot of money last year like like no no
joke um I I start a new company and it
doesn't make money uh not yet that's why
we're selling tiny
boxes wait what how is this still not
back
whatever
um so yeah we're going to have to look
into why this processor made things
slower and we're going to have to fix
that
want I go work for Twitter
again I'm not really a good fit at
Twitter
like I mean I think it's a lot better
now that Elon bought it but it's not
really a product I
like I think that
the what Twitter did for the culture War
uh was so incredible
like I mean it's great it's it's just
it's I I I I love the way that I feel
things are moving this
year um you see my post on Twitter from
yesterday
uh yeah I think we are we are finally
kind of moving past uh it's not even uh
like I really am kind of a a progressive
and agree with some of the tenants of
wokeness but there's just a lot of like
very angry people uh Angry and like like
like doomers it's the doomers it's the
doomers and the
deels um you know it was never
about like the culture war was never
about like some like return to
conservative values or anything like
that I don't support that I don't agree
with that but I don't want to hear like
like the useless energy people to build
less housing people I just I don't want
to hear from them I don't think they
should have a seat at the table uh and
it's it's it's nice the way that things
are that a that a kind of positive
message um I was at a uh I was at a
dinner party with uh with Peter teal
once
and I've I've my respect for Peter teal
has grown a lot but for a long time I
didn't like his like just the the the
negativity and the the complete lack of
a positive vision for the future uh just
kind of just kind of
bashing you know it's not really like
great man like like it's I want I want
to see I want to see a positive vision
for the future um but I think there's a
great one I I saw a post
yesterday from
uh someone saying like you know like I
see two groups of people here one group
of people like says that I have like
privilege and like wants to like you
know like make me feel bad about myself
and the other group of people is like
EAC and you know honestly these people
seem super welcoming and awesome yeah I
like that you know I think I think being
like welcoming is is is really
good
um my my I I teal this was this party
was maybe 2017 and I was not I was not a
teal fan in 2017 uh but I think I he
said a bunch of things like in the last
five years and he was right about a lot
of stuff um so you know my respect for
him has grown a
lot um yeah we don't like gate we we
don't like
but I don't want to harp too much on
this uh but as far as like going used to
the question was like go work at
Twitter it's it's not
um and maybe maybe this is
why the culture War does have this
asymmetry to it uh where the kind of
people who want everybody to to be
miserable and eat the bugs or whatever
are the kind of people who are excited
about building a mechanism of like large
scale social control I don't know like
as much as I participate in social media
and and that's uh yeah as much as I
participate in social media it's just
not that
like exciting to build I'm not that
interested in in controlling people and
it's sad that the people who are
interested in controlling people are
mostly sort of evil people
okay is my computer back
yet okay my computer's back uh I kind of
think that rebooting is not going to do
anything yeah
um so let's see what we can do about
that
that that sucks like I put a better
processor in and it got
slower um let's understand the
difference between these two
processors so these
processors I went from I'm using this
one now from this one so we have eight
ccds and one
IOD oh no I switched to this one I think
let's
see on this
one how do I get the Boost
clock
turbo boost
boys how do I get CPU
power oh this is a good point how about
just
that how fast is that if copying from
Dev zero isn't
fast can you open Dev zero with if flag
direct no you
can't
dude dude my drive is literally faster
than Dev
zero um wait that's kind of
a this is like
a pass is it this well that's a that's a
cool
test um okay that one's faster
whatever uh all right let's see my CPU
fre
canes
all right let's um oh wait is turbo
boost enabled wow this is literally like
a oh turbo boost is already
enabled okay I don't have this CPU power
function and I don't trust any of these
maybe Linux tools common that seems like
a harmless package
name uh did I boot with mitigations
equals off oh I definitely got to turn
that crap off wait yeah that sucks I
want more frequency than
that um can I write to CPU Max
frequency
wait no we got we got to we got to
enable the turbo boost no the block size
is fine we we got to we got
to do I okay do I have CPU power
now what the
hell oh I need to install this wait this
is getting sketchy
now CPU
power okay we're good frequency
info they promised me a boost
frequency promised it they promised me a
boost frequency how do I enable the
Boost frequency boost means so boost
boys how do we get the
Boost boost is not active
okay well let's enable
boost but it says I have Boost enabled a
boost
uh to enable boosting I don't care about
saving energy can we stop that use more
energy okay how do I oh here to activate
a how do I check what governor I have
yeah it's
faster we unlocked the
Boost okay but it's still not as fast as
the other oh no oh no we only oh that
one was fast oh well actually let's just
go longer it's fine this might actually
be
right
be be as fast as the other
CPU I think we only get a little
boost all right okay okay it's faster
it's faster but we need more
boost uh let's check that Dev zero thing
that's probably a good a good
Benchmark um we really got to go
directly from the uh GPU to the
discs is this faster now oh it's a
little faster okay wait so how do I get
like super boost is there more
boost no it still doesn't look like we
have
Boost wait active no wait how do I yeah
yeah yeah yeah how do I enable
boost okay I'm going to go into vim and
I'm going
to change active to yes okay that's what
I want I want
boost
boost okay
okay um how do I enable
boost
come on perplexity hook me
up no I did
that
don't tell me I have to buy a license
for
Boost wait oh shit what if it's not
enabled in
BIOS oh that
sucks okay how we going to get access to
bios we
can't I do have ipmi
but uh I need like a password and stuff
and I don't have
that wait boost is just going to make
everything better though as soon as we
enable boost it's not an overclock it's
just I have ipmi I have ipmi I just
don't have the password uh to where I
can access it on
stream which kind of sucks
um because this says boost is
on but then this says boost is off maybe
if I suo oh wait what
wait I I was joking about
that but if if I
pseudo we have
Boost it's a ASRock
board um pseudo pseudo enables
boost okay well no but I have zero boost
States we need more boost
State okay so like I thought that this
CPU was fine and it probably is because
the Boost speed of these two is the same
what the hell is Boost
anyway what is Boost epic boost not
boosting exactly that's my
problem o o o well that didn't
work
um see but the great thing about tiny
box is we're going to enable all this
stuff oh wait this guy had a bad time
with Boost
oh damn it how come I can't edit bios
from maybe parameter of how much to what
the hell is
cpb okay well we're gonna have to wait
till next the stream isn't even about
boost we're going to have to wait till
next stream for Boost but I promise I
will come back and we will get boost
work and we'll make sure that we can
read from this at Lightning Fast boost
speeds um again a huge advantage to the
Tiny Box is I'm going to waste days of
my life perhaps even weeks of my life
tuning this shit for you so let going
get some more coffee I'll be right back
um unless if someone figures out the
magic incantation to enable boost I will
try
it
for
this is false advertising that's
right so wait does the base clock
actually
matter
look at the boost on this
one how much should these
cost that's pretty
cheap would people rather this
CPU
no I know how to
ipmi cheap epic or vendor locked yeah
you got to watch out vendor locked but I
don't think this vendor locked wow wait
this one's so
cheap I kind of like that
wait and it
has I kind of really like this
chip see it's no locked
version the CP is are anent what are you
talking
about maybe we should test
this okay do you do you want 32 cores or
do you want 16 fast
cores I think you might want 15 fast
course
both well you can't have
both how much faster it goes from the
base is 2.4 up to
3.5
the thing that I like about this chip is
it draws more
power okay I'm going to buy two of these
H sorry I got to disable the screen
while I do this no
logins no locked version good I hate
locked
version
um oh shit I forgot I have credit card
issues that should work
though uh no I think
that God I'm not happy about any of
this
but like no if we just enable turbo we
can get most of the
gains we just need to enable
Turbo
it's kind of wildly fast
though no these are way better than
thread rippers these are really good
CPUs if I click on each I get more info
okay this is the CPU we've chosen for
Tiny
Box
um Turbo One Core yeah we should be able
to get one core up to that
speed nobody nobody like really dives
into this stuff people are missing out
on so much
performance okay that's the single core
let's look at the single core of uh that
that frequency boosted
one now but you need you need all the
cores in order to like do data
loading
446 446 versus 683 but then again like
do I trust this Benchmark did they
enable boost do they know about boost I
don't know if they know about
boost
wait these are better than thread River
Pros okay thread River Pros are just
shitty
epics they're literally just down Bend
epics
boys they
are what is this image is this
appropriate for
stream
boost uh no we're going with that 32
core cvu we're going to figure out how
enable
boost
uh look at the stats well yeah because
that's a Milan chip okay that's
Milan I think so that's Milan
right milons aren't really worth
it oh that's a lot of boost oh that's
fast we love
boost uh right you found something that
looks promising I I think I just have to
enable it in BIOS I think it's a bios
issue
yeah we did
that it's actually crazy though that
that's uh what's a
btop let's get btop I've never used btop
before that sounds like
a yeah bro you heard a HTP you heard a
ay top well now we got
btop oh it just stands for black screen
oh BP
yo
wait bop's pretty sick we like btop look
at
btop all right let's like go like
5,000 we can see which core is being
used oh yeah poor poor core 53 really
throttled at 100% here I beat
sick I love the I love the
colors
it's PCI 5.0 oh you have
a I mean look I have it here you want
you want you want
uh I have a you want that you want that
you want that
processor pca4 is fine no gpus have PCI
all right right I'm done I'm done
defending things to to to to to you PCI
no G have PCI 5 right right right you b
top okay all right I said I was not
going to get triggered this stream we're
not going to get triggered oh yeah we're
not going to get triggered that's
right doesn't help if you want to sell
Hardware look okay this is why democracy
sucks okay because in a democ direct
democracy in a direct democracy
everybody votes for more free shit and
less
taxes and the problem with more free
shit and less taxes is there's no more
Government after a while okay so you
guys can put in your your Milan and why
don't you sell the Tiny Box for $9,000
while you're at it and then we lose
money and then there's no more tiny
boxes okay so that's what you all did
you got rid you you killed the tiny
boxes because because you wanted to buy
overpriced CPUs and they don't even
really matter we just need to enable
boost on the CPU we have
okay this is a pro Singapore stream this
is right if you don't believe in
Singapore get out of my stream man I've
been to Singapore you know what I wasn't
afraid that I was going to be stabbed by
crack addicts because they don't have
that there it's
illegal what is a tiny box bro where
even are
you um no this CPU is great we're just
going to need to enable boost and I
don't know how I got distracted but I
started showing off the I started
showing off the
uh the Boost speed is the same on this
CPU and on this CPU but it is cool that
once we enable boost we're going to get
a free
37.5% boost
um this one goes up to
3.9 that's a 62% boost uh the ideal
country is 50% Singapore 50% New
Jersey yeah some days to
Jersey um is the Tiny Box software too
specific that if CPU changes it can
become slower yeah if you put a penum
three in it it would become slower no
it's not that specific but I did switch
out the CPU and then it can no longer a
single thread can no longer keep up with
reading from my Beast of an array of
hard
drives so but we'll fix this by enabling
boost okay so on to what we were
actually going to do this
stream uh
oh it's complaining about privilege
that's not good who told it about
privilege
that's really
bad chenu what
happened why can't I beam llama
anymore wait that's really
bad okay well we're not doing any more
demos on
stream um don't worry this will all be
fixed by the time we ship the tiny p
okay it's I know it yeah it was like
yeah it's complaining about privilege
now all great so we're getting 24 tokens
per second when we Shard it on one GPU
but we can Shard it across two gpus and
watch how much faster it
is so now we're sharted across two gpus
and look at that it's almost two it's
more than 2x slower um
so yeah it's slower so that's a big
problem and if you look at why it's
slower it's interesting um it's because
the NQ
time is look at the difference in NQ
time you know what would make this
faster
boost uh no the bottleneck is not the
GPU the bottleneck is hip graph is fake
so they have this API called hip
graph um
um close that close
that uh this so This API called hip
graph take a look at it here well it's
not really real so this is a Cod graph
um so you can batch all of the kernels
into a
graph but here so let's take a look I
can show you what it's actually
doing
um
startup times of that seems slow too oh
it's because I'm not okay so if you want
your startup times to be faster again
this is just something that like I'm
going to have to add I'll add something
to do this if you put a watch on Rock M
SMI it doesn't put the gpus into low
power State and it starts out faster so
great um so you see all these xfers so
all these xers are really
slow uh mostly because it has to do
synchronization go to do that that
is in Ops
hip uh no it's not an Ops hip here so we
have to block the gpus like between them
and you can put all this stuff I spent
four hours yesterday putting all this
stuff into the hip graph and I thought
that the hip graph would be fast because
the Cuda graph is fast but the hip graph
is not fast because hip graph is not
that well
implemented um so that leaves us
basically with two choices to make this
fast uh by the way I can show you guys
something
crazy we can run 70b llama now so we
just need to Shard it across six
gpus like this is loading latu 70b by
the way look at how fast it loads that's
those drives and as soon as we enable
boost it's going to be even
faster um the inter GPU connectivity is
in the this is a public driver I'm not
using any special driver here this just
rock
M6 uh no not quantized you think I fuck
around with that look at the look at the
RAM used look at that Ram look at that
Ram you think that's
quantized
um so that's full llama 70b
unfortunately uh it's very
slow it gets about one token per 10
seconds so we're going to have to make
this faster but it's not the gpus at all
the gpus are really good the whole whole
problem is that I'm doing it all from a
single
thread so we kind of have two choices
here we can refactor tonyr to be
multi-threaded and by multi-threaded in
Python I mean
multiprocess um see there we go let it's
generating oh it's oh
07 tokens per
second
uh yeah I am I I know I know it's slow
okay but it's not slow because of the
gpus the gpus are barely even being
being used don't trust that 100% that's
wrong um the slowness all comes from the
the CPU uh because I'm using a single
thread to do all
this so the problem isn't even a rust
rewrite I'll show you what happens so we
have code here let's just focus on the
7B across
two um I can add profile to the NS
well so the the ggm approach is not what
I want to do the problem with the gml
approach is
it's you always have a Time Horizon
whenever you're writing software you can
think about do I want to make this fast
tomorrow or do I want to make this fast
for applications that haven't even been
written yet and gml has heavily opt on
the side of take modern models and make
them fast on Modern Hardware um which is
like there's not this is not a they're
both on the parto
curve um but tiny grad has a very
different goal tiny grad's goal is to
make models that exist in five years
fast on Hardware that exists in five
years uh so we want to design things
that
are really
um
Universal so you can see that the
slowness is coming from these two
functions here event and block so
rewriting in Rust actually wouldn't even
make it better um because all the
slowness is in these two functions hip
event record and hipst weight event uh
these functions are actually making CIS
calls I added a flag called ioctl did I
get that flag in no I didn't get that
flag in okay we got to merge that um
GG is just
gml uh a branch for
this what's it
called
cleaner I have to get this
merged doesn't even have
the so I wrote this code that can do
here
this so we can look in here and look at
the
ional and this is all just set up
allocating memory fine but you see these
weight events and set
events so this is just one of the things
that's responsible for the slowness
these
uh these event record and weit stream
events are making CIS calls into the
kernel so okay let me first explain what
the what the weight and uh sync are so
when you have two gpus working on a
problem you have to figure out how to
keep their two cu's in sync so hip has
this thing where I can tell one GPU to
wait basically tell gpu2 to wait on an
event from GP
P1 uh these things seem really poorly
implemented
unfortunately so that's why it's not
fast I could potentially fix this in the
GP okay so you have three basic ways to
fix this um one way to fix this is to
try to
use
like as soon as you've compiled
something and pushed it to the GPU that
overhead is no longer on the CPU so I
could write a spin lock and GPU kernel
which is instead of using the event
Primitives I can just have GPU
repeatedly pull a piece of memory and
another GPU and be like is it set is it
set is it set is it
set the problem with doing this is it's
ugly uh it's clearly not the way the GPU
is intended to be
used it probably is faster in practice
but it just bypasses all this nice stuff
that you can actually use and I'll show
you in a minute how we can get to the
nice
stuff uh another solution is just the
Brute Force solution each one of these
gpus could live in one one thing that's
going to make it 30% faster is enabling
boost but another solution is to use
multiple threads so when you do
multi-gpu stuff in pytorch or at least
multi GPU training you put things across
threads um with distributed data
parallel or actually across processes
and the downside with doing this is it
becomes a lot harder to think about
everything's much easier to reason about
when it's all a single thread uh as soon
as you go into multi threads Things
become harder to reason about but multi
process would get us down would make
things like 6X faster if we're using six
gpus the third solution is to write our
own GPU driver so all of this slowness
is coming from user space we don't
actually need this user space there's a
big complex hip user space that seems
egregiously slow so okay preck for those
that don't know what hip is there's a
thing called AMD hip and it is a clone
of
Cuda AMD literally said copy cuda's API
as closely as we possibly can but put
hip in front of everything instead of
Cuda and you can look at the runtime API
reference and you'll find that these
things are basically identical to uh to
Cuda like here hip event create Wow
Let's see Cuda event create oh the Cuda
events API interesting
Cuda event create Cuda event create with
flags that's in the part screen you
can't see Cuda event record hip event
record Cuda event destroy hip event
destroy so you can see that these are
basically just clones see instead of
returning a Cuda error a t it returns a
hip error T error error T um so yeah
uh
yeah
unfortunately and nvidia's stuff just
seems much better implemented than amd's
stuff the Cuda stuff isn't that fast
either but at least Cuda graph seems to
be real whereas hip graph seems largely
to be like I bet there's a lot of well
the other thing about hip is we can read
the code so we can actually look into
hip graph and see if it's all the things
that we we claim it
is
so let's read the code for hip
graph so hip is also in a bajillion
different
repos um and you never really know which
is the real
one
this one looks kind of legitimate so
let's try
it and see if we can find the hip code
here there's also this cool flag we can
set uh two flags AMD log level and HMT K
debug
level so we can look and see what's
actually going on
here
so this is like a this is like a graph
here hip graph launch where is hip
graph. CPP is it in
here oh hip craft. CPP
sweet
uh or we can also read the code of
what's slow so it is really cool that
AMD did make all this stuff open
source but
the problem
is what's interesting they have all this
capturing stuff I wonder if I can just
use
capture it's tiny bux running a custom
Linux
bro
uh so yeah this graph stuff seems
slow
so basically we have two solutions uh
one is multiprocessing and the other is
writing our own
driver
and we wrote the pros and cons on the
Whiteboard
yesterday no the problem's not the data
loader
the problem is literally dispatching
enough stuff to the GPU okay wait so we
have three solutions potentially spin
locks
multiprocessing and riding our own
driver uh spin locks and multiprocessing
probably you need both of them to make
it good if we Rite our own driver and it
really works we can get almost zero
overhead to relaunching uh gpus so let's
see if there's let's see if there's a
noob tutorial to explain to you how gpus
work how do gpus let's ask
perplexity how do gpus
work what's a command
c
um
see like the problem with using spin
locks is the command qes have all of
these fences and semaphor that we should
just be using but it doesn't seem like
there's a way that we can use these in
the hip API without making CIS calls and
doing lots of complex
stuff
um
okay you found something
good I think I might have taken this
class is this computer
Graphics how GPU works yeah so this is
like old school
stuff like whenever you're talking about
fragment shaders and vertex
shaders um
uh there's like so many levels to how a
GPU
works like this stuff's all correct and
you should understand it but this
doesn't get to almost what the API to a
GPU
is okay one built a chip oh that's cool
yeah I was in this guy's parallel
computer class
um you yeah you get into stuff like
latency hiding and uh warp scheduling
but we're not even at that level yet I'm
just talking about how you actually talk
to a GPU and why this stuff is slow so
what this API does is build up these
things called command cues and you can
see them here it's it's called Hardware
Q uh let's read Rock virtual. and take a
look at the hardware
queue
[Music]
so it's called
AQL virtual GPU dispatch generic AQL
packet insert packets packet store
release so what we really want to do in
our driver is pre-build the cues leave
them on the GPU and then remember deep
learning is running the same thing over
and over and over again so we have the
que on the GPU we just need to ring the
doorbell it's called a doorbell on
Nvidia it wouldn't surprise me if AMD
just copied that
terminology um qualcomm's adrino doesn't
call it a doorbell qualcom adreno has a
uh an ey octal to do
it does chat know what mmio
is hip does not expose semi
Force um maybe it does that's actually
actually a good
point what's an external
semaphor can I use a
semaphore I something to sort of think
about is yeah actually what if I don't
have to spin lock on the GPU what if
there's like a spin lock
primitive there might
be synchronization
functions no I don't want sync
threads
actually that's just a that's just an
interesting idea
Atomic functions Atomic ad
leave resulting in global or shared
memory is there a spin lock
primitive
well again a lot of this stuff is more
sure you can like have these things but
how are they actually implemented and
are they
fast we need to start shoving atomics in
our
stuff and then Global memory can this go
can this go across
gpus oh can I trigger the copy from a
colonel too okay I mean this is all way
less ex okay the I the two choices we
put on the board yesterday and did like
uh pros and cons on one was
multiprocessing and the other was
writing our own driver but there may be
a third way here which is to just shove
everything in the GPU kernel um
actually let's look at the instruction
set so AMD does a good job of
documenting their GPU instruction sets
so maybe we can just find something
here what is send
message send a message Upstream to
the
whoa see okay in general My Philosophy
is we need to look at what the hardware
is actually
doing
uh wow this stuff gets deep Bro see I
told you about doorbells you thought I
was kidding about doorbells you're like
you don't have doorbells on gpus well
they do so you know you were wrong
made me a little smaller so you guys can
see
better
um
floating Point atomics program flow
control
introduction so what these things are
probably in practice if we can somehow
like send a
message congrats no sub only mode guy
you got sub only mode enabled and you
can't even say anything about it because
you're not a
sub
send message was the most interesting
thing software generated
interrupt where do these interrupts
go the problem also is none of this
stuff talks about the AQL command
types so we're probably going to have to
look in the code for this because I
haven't seen this stuff documented
anywhere here so this is a dispatch
barrier packet so this is a barrier and
packet um let's see if we can find like
the spec for AQL somewhere and we
can why does it find
that where is this to finded oh here we
go
no is
that static const
expert
so yeah like
again I don't know how anyone ever
understands computers there's so much
complexity to all this stuff so this is
only talking about the instruction set
architecture that's what runs on the
Shader but then the GPU also has AER and
theer seems completely
undocumented um where the scheduler even
lives is
questionable so you can look there's
firmware on the GPU there's this thing
called a micro engine
scheduler um let's see what let's see
what mixol knows about
it
perplexity come
on called micro engines that are
integrated into each computer
unit
gcn3 what's the new
one hello we
stream
H it's Alex on
FaceTime do you want to say hi to the
streamy no oh you don't want to say hi
to them
okay okay see you if I go to work oh you
go to work is you want we can walk to
well I already had coffee I got this
coffee but it's not that
good what is it it was in the fridge oh
you want to walk to lunch oh lunchies
what time is it so early for lunch
perfect no cuz it takes 40 minutes to go
anywhere where are we going
get ready
now I got a
shower you do
yeah you look like show I look like I
need to shower you look cre thank you uh
wait how how was how was waking up this
morning was it good it so good I love
being alive oh that's good being alive
is good yeah
you like C so I was excit about that
well I tried to wake you up but you know
you were you were you were sleeping and
then I'm like what am I going to do this
morning and we
streamed we we learned about we learned
about boost this morning boost yeah the
Tiny Box has boost but it's not
enabled and like we're gonna boost this
place no it's not like that man it's not
like that
like what's a booster you know like that
seems like something that sits on a
school board
on a school board yeah or the bottom of
a
rocket oh yeah you're right a booster
you know like a booster like they go to
like homecoming and they're like I'm a
[Laughter]
booster words are hard how many how many
hours is it going to take you to get
ready why did you put a plural on that
hour well is 05 do you say do you say
0.5 hour or 0.5
hours I'll see you in 05 no but how
crazy is that it's 0.5 hours 1 Hour 2
hours like there's like a like think of
that graph and there's just a
discontinuity at one where you say
hour 30 minutes oh 0 five
hour yeah five hour
that that that sounds nice I I yeah I
don't know how much longer we're going
to spend on this stream I I feel like
I'm kind of ripping the people off if I
don't give them a good stream today but
also oh I removed my content warning I
could just click it
off wow okay also you could come back
after lunch and do more streaming I
could come back after lunch and do more
streaming yeah you don't you don't have
to
like only stream
now no I think I
do well you you let I feel I feel dirty
and like I have to
shower okay
yeah I respect that do what you got to
do George where are we going to
lunch you know I'm wan to go that Deli
that's run by the
cult gratitude C CFE no there's another
one a famous One in San Diego what's it
called it's not called gra Cafe
Gratitude that's a different call do we
have to do we do we have to drive to
cult Deli how far is cult Deli I'm gonna
find out right now okay do they have
sandwiches I don't like is like coold
Cuts what does it cult
make it's we'll look into it it's called
like yellow something it's in my oh yo I
went to one of them they have one of
them by my parents house in Durham
a yellow dely yeah yeah my dad said it's
run by a
cult what they're everywhere they're
spread out yeah yeah yeah yeah and it
was I was like we all live in the Alo
submarine it's like that but it was a
deli that was all I was thinking about
when I went to the
deli all right the stream people are
upset that I'm giving you attention and
not giving them attention I forgot you
were on stream yeah we're on stream
we're just we're just hanging out man we
can't say anything racist you know back
you
can she hung up on
[Music]
[Applause]
me
um Irish boyfriend George I am Irish
that's true
Bros Irish
Catholic
uh no we're too poor before Naval Vision
okay where were we we were looking to
see I remember what we were going to do
we were going to read the code and see
if we can figure out all the packets
that we can send to the
GPU um so we have a flag here that we
can set called jit equals 1 and then jit
equals oh no sorry it's g equals 2 and
it won't put things into the
graph let's load we're loading loading
loading loading okay now it's running
okay good um so you can see here we put
a barrier end in but there's also
sometime we can cue actual kernels like
here command kernel execution and
CED Hardware CU dispatch
header okay let's uh maybe we should
take some
notes
so whether we end up writing a driver or
not doesn't really matter as long as we
understand what all the code is doing
and we understand what these things
really are deep in the GPU so like do do
we want these Shader processors doing
synchronization or do we want the micro
engine scheduler doing synchronization I
think the answer is we want the micro
engine scheduler doing synchronization
um and I don't even know if it's
actually the micro scheduler I'm just
ripping it off okay so there's there's
also multiple of these so this is
gfx1
[Music]
the 7900 XTX I'm pretty sure is
gfx1 where' my perplexity
go which gfx X
is what how do you not know about this
which one of these is like oh I don't
know maybe this one know about
it this one knows about it but it
doesn't know what a gfx
is
[Music]
okay now so much for using AI to do our
work for us you know everyone who thinks
AI is going to do their work for them is
sorely mistaken man like remember that
time that we got
plows that that was a fire post someone
like photoshopped the AI is going to be
fundamentally a labor destroying and
someone crossed out the word Ai and
wrote
plow btfo Mustafa Solomon what a loser
man no we're not hating bros we're not
hating we're not hating he bought G no
no this is a hate free stream that's
right we in this house we love everybody
except
people who are bad like you know those
people okay you found something is this
good the driver should suppose expose
synchronization across devices it does
but the problem is it's really slow oh
I've seen this
before okay let's read it blah blah blah
SK the introduction
okay boring boring
boring i' yeah this is kind of
interesting so we're in rock clear right
now shared pool of
default what's a cou
mask what's a CU mask
hip runtime inserts a kernel launch
command into a software queue managed by
The Rock runtime
Library oh architected queuing language
interesting
um insert it into an HSA Q an HSA home
and School
Association
AQL packets go in the HSA Q
in Hardware an asynchronous compute
engine processes the HSA
Q okay Colonel's
[Music]
Journey do hips stream
interface is backed by a software que
not an HSA
Q once a kernel launch reaches the head
of its software queue Rock clear
converts it into a AQL
packet in order to send the AQL packet
we copy the AQL packet into an hsq hsqs
are ring buffers of AQL packets and are
directly shared between the GPU and user
space
memory memory sharing allows it
to it may seem like an intuitive choice
to back each Rock clear que with a
dedicated HSA Cube but see now we
understand why everything sucks
because one software Cube makes it work
to different HS aqs and each
HS I want to rip all this crap out let's
just let's just generate HS aqs from
Tiny grad
all right if we can just like like as
soon as we can get the Q tiny grad
should output an HSA Q copy to the GPU
and be like do that
shit aftering a run list from the driver
oh this is really good thank you thank
you for the link
sir after receiving a run list from the
driver the gpus top of a command
processor using Hardware scheduling
questionable questionable whether it's
Hardware hardware and firmware or
synonymous you'll never understand what
that means
um some of you might who understands
what I mean when I say hardware and
firmware
synonymous uh knowing this we can
finally explain why roam attempts to
limit the number of HSA Q's used by any
single application the GPU Hardware can
only support up to 32 concurrent HSA Q's
eight Q's on each of the four
aces what the hell is a cou
mask oh a compute unit oh so I can mask
and see which compute units it goes on
oh this shit's
fire
okay
um we'll now describe how the colonel at
the head of an HSA Q gets a sign to the
Computing Hardware call that thread
blocks are the basic schedule entities
so when kernel dispatch AQL packets
reach heads of their cues the question
becomes how the GPU decides which blocks
to run and where to run
them one of the more prominent features
is the division of into Shader engin so
this is this is some esoteric
[Music]
terminology workload manager okay like
what is this and where is
it see I can yeah hip extra stream
create with C
mask I can mask it and only put it on
some compute units this is way too
complicated
boys okay I think we should just make
HSA
Q's goal have tiny grad
output HSA
qes then we just load the HSA Q's
output and
dispatch HSA
CU
so just like copy these these seem
pretty good okay so we have barrier and
header don't word wrap e word wrap's
disgusting
okay and then we also have command
kernel execution inced oh here dispatch
header perfect
it's word
wrapping e don't word wrap okay you know
what do just not word wrap I'm going to
make you a DOT txt file yeah txt doesn't
word wrap that's
right okay so we have dispatch headers
and wait why is this a different
dispatch
header why does that one have a
different
number
that one oh it's on a different Hardware
cue or something I don't
know we also have another kind of thing
here this see this
xer so we do
a HSA
copy which doesn't look like it's on a
queue or something that I don't really
know
there's also sometimes yes so see
sometimes these barrier ends have a uh
have a depth signal and sometime they
don't so like here we can get that one
and then I think the next one of these
will have a depth signal or something
the the depth signals actually do work
out to be
uh oh well that's cool so you can see
how the completion signal here
is this HSA copy and then like it's the
same as this so you can see this depth
signal is the completion signal on the
copy um so I don't exactly understand
how async copies go on Hardware cues
maybe they
don't they probably do I don't know why
it doesn't like print it
out let's look at all these Hardware
cues and see if there's any other ones
that I missed barrier and dispatch
barrier
end barrier end dispatch barrier and
dispatch
okay I'm assuming these Hardware cues
are HSA
cues oh okay good well we see all these
okay um what's a hardware Q here GPU Q
Base address what type is a GPU
Q where does this come from oh it's in a
virtual GPU great that's what we love
man this is like react
love seeing virtual
GPU uh where's this Q where's the Q okay
Hardware Q engine unknown Hardware Q
engine
compute any this stuff one Q we just
want a Q and we're going to make them in
tiny gr and we're going to put them on
the GPU and it's going to run them and
it's going to be
happy
perplexity AI can justify their I don't
know I think 520 million is that
crazy um I don't give them money yet but
I probably
should like they're one of the
first I think that one way to tell like
a good proxy for evaluation of a company
is is it the thing that you go to
often uh what companies are insanely
like look at Cruis and wayo right
nobody's like oh yeah I'm taking a Cru
or AO like nobody says this so they're
overvalued but a good proxy for the
value of a company is like is this
something people actually like use you
know and and it
is um wait I'm getting distracted you're
a subscriber you're not supposed to
distract me we're working
here
okay
[Music]
so let's figure out where all this HSA
like I want to understand the what is
the structure of an HS
AQ
what where's this
file is it somewhere
else where's that
file debug API oh is it in the is it in
the Rock K kernel driver
might
be okay so rocket kernel driver is
actually a
konel so that's going to take forever to
clone it's just pronounced Rock it's not
pronounced Rock
k
uh just perplexity give better results
than open AI uh it's not to support of
Taurus uh perplexity is way faster open
AI is so slow gbt 4 is unusably slow I
don't use it anymore because I'm not
going to sit here and wait while it
types things out at 10 tokens per second
um like I have things to do
boys gb4 still is unquestionably the
best and if they make
gp4 uh my opening ey subscription lapsed
due to some issues I've had with the
bank
uh don't get me started on the
bank but yeah so I let my subscription
laps and I don't really care when they
get GPT 4 to be 100 tokens per second
I'll subscribe
again what about anthropic yo no
claude's a piece of shit
also no I I tried Claude like once and I
was like oh my God this is also llama I
mean llama 2 llama 2 instruct is so uh
rhf into
stupidity
um I Heard a great quote about anthropic
anthropics stopped to think if they
should they didn't stop to think if they
could
no I like gb4 it's just too
slow but also who's distracting me right
now we have work to do boys we got to
learn about HSA Qs
okay is this where hsq lives where's
that
file it literally includes something
called AMD hsq is that in
here that's concerning where is it
so where is AMD HSA
q.h there's Rock clear as well but this
has to actually be
somewhere oh I found
it I don't know how it got there
but o okay that's like kind of
interesting like where's that
file
yeah uh can someone find this for
me which of amd's 27 Rock M things
contains that
file this had an interesting view oh I
know what we need we need
here heterogenous systems architecture
HSA and runtime
there is like a runtime thing in here I
think uh rockr
runtime HSA runtime API for rock
M let's see maybe it's in this
one oh we found
it
okay user
mode API interfaces and libraries
necessary for host applications actually
there's a chance we just want to use
this directly from Tiny grad
the HSA runtime provides direct access
to the graphics Hardware so AMD calls us
like level
zero
oo so also in HSA foundations I mean is
this this is still being updated right
like they here Rock
mv6 what what got added oh they just
changed
the this API also seems pretty
[Music]
[Music]
stable
okay so where is the
like
image
core
okay I mean this seems like the most
interesting stuff and we may very well
just want to use we may very well just
want to use this and not reimplement
this is a thin user mode
API okay is there a documentation for
this
anywhere no they just have Source no
docks uh
eight years ago
yeah wait is this a
book this doesn't make it
easy
if I buy this what do I
get oh it just has the wrong
picture
this Anna's archive is the new this is
the new
hotness
if this works I'm going to donate to
Anna's
archive
uh
fire uh when I was donating when I was
donating to uh to to uh EAC
organizations uh I
uh the person who runs this reached out
and ask for donation and I was like I
don't know people who ask for donations
for things I don't use I don't really
like uh it's not like it's like fine uh
but now I'm actually using it and I used
this and it found me another thing that
was really good uh so yeah I think I
think I think we'll uh we'll donate to
uh to an's Archive because human
knowledge should be free boys the FBI is
coming for me man you know what happened
to kim.com he also thought human
knowledge should be free and now he
thinks the us is going
bankrupt all right so let's see if this
books any good we got a book
coming not downloading Fast I think I
subscribe I get the
fast this is gbd4 speeds
boys
um okay so the best thing we found so
far was this rock a
runtime
okay runtime initialization shut down
system and agent information signals and
synchronization architected dispatch
memory management HSA runtime fits into
a typical software stack direct access
of Graphics Hardware to give the
programmer more control of the
execution what I want to be able to do
is build a que and then dispatch the que
so metal um if you
read uh the metal implementation in tiny
grad metal has the best one like metal
exposes most accurately what a GPU
really is I don't know why you can't
reuse these command buffers but you have
command buffer compute command encoder
and then they build a stupid graph API
on top of it which is like dumb
like you you shouldn't have to like
there's no difference between okay I get
why they get it kind of makes sense
actually never mind I take back what I
said um they have a separate command
buffer and indirect command buffer which
I think it's because like you can't
change these things after you dispatch
them but metal has the API that best
shows you how gpus work work I actually
forgot how good this kind of was like
aside from the weird objective
seisms let's
see um my apologies for the copyright
infringement no copyright infringement
intended
I'm concerned whenever it's trying to
unify things into a single platform I'm
concerned extended runtime
API oh are there like demo apps of this
stuff that'd be
cool
okay we have HSA signals oh here oh look
at this oh this is exactly what I was
going for okay we have Colonel dispatch
packets agent dispatch packets what's
FBI man barrier end packet barrier ore
packet a vendor not a vendor it's a
vendor a vendor specific packet uh and
then we have invalid packets well that's
an important packet
type no no no no no it's a vendor it's
not a vendor don't don't get it twisted
okay uses an enumerator HSA packet type
T to enumerate all types of packets
let's see if we can find it here oh look
it actually packets okay great now we
have the
packets um barrier end allows an
application to specify up to five signal
dependencies so that matches what we've
seen over here so there's five things
there um
the packet processor will not launch any
further packets into the queue until the
barrier end packet is complete barrier
end packet is complete blah blah blah
blah packet format for vendor specific
packets is vendor defined the behavior
of the packet processor for vendor
specific but must not cause privilege
escalation okay we're back about we
whing about privilege
again
um
okay
something don't care about images all
right memory
model okay let let's learn a little bit
more about where HSA comes
from multivendor collaboration to define
a new systems
architecture
I don't know I don't trust any of this
okay previous example we've seen
Colonels we have to understand how
Colonels are dispatched okay great oh we
have a packet processor oh we have a
micro engine scheduler oh oh you found
better stuff okay let's see what we
[Music]
got I like this less uh it's a clock
compiler CL offline compiler by writing
the host
code compile to
hsl what is
hsl yeah I don't like the Acra that
tastes
nasty what is this why do I want
this great I can Target you Buu
1404 okay uh HSA Q create that seems
good
um the Q can support
multiple producers multiple threads okay
I I get that I
guess uh oh we got soft cues and hard
cues soft Q custom Pro Sounds slow okay
all right we're back to the the barrier
type but here they're vendor with an O
very
different um well good thing we're not
using any vendor specific packets we're
basically only using I kernel dispatch
and barrier end I guess are the only
ones except how is it doing the HSA ASN
copy
is that being put on the que is that
just a kernel no it can't just be a
kernel because if it's a kernel I'd see
the kernel
dispatch wait okay what is that doing
how is that dispatching you see what I
mean so I understand how to dispatch
kernels and I understand barrier ends
but how am I doing the
copy is it using a vendor specific
packet let's take a
look which one is it D equals this one
okay
um ASN copy on
engine where's
this oh is this defined in
here it's in rockar runtime which one's
this again that's Rock clear this is all
too hard for me okay copy memory on
engine great dma copy on engine I feel
feel like I've looked into exactly this
before oh well you can't do that cuz
that's an AA status error you don't have
enough
status decide to use the GP dma copy on
engine for PTP
copies uh due to a Ras issue oh
well
um submit linear copy
command blit
kerneler barrier packets B
where does it actually submit the
command dep signals insert dispatch
packet for copy kernel oh it's
a kernels Colonel type copy aligned it's
just a fucking
colonel
that's a
[Music]
scam
AMD is for people who can't afford
Nvidia no no no no no no no AMD is for
people who like getting twice as much
GPU for their
money right you say can't afford Nvidia
I say I have two gpus and you have
one um okay so wait no it's can't just
be it can't just be dispatching a
colonel that's such a scam you're
telling me this thing doesn't have a
copy engine
so the problem with it using a kernel is
that means it uses the same resources
and I don't want to do that Cuda has a
different uh I've looked into this all
with I have a GitHub project where I did
like low level Cuda stuff and Cuda
actually uses a different engine to make
the
copies but it seems like here there
might not actually be a different engine
which really just sucks and I feel like
I actually knew
this and that's just really
lame
well I think about that like one thing
we could potentially do is get rid of
the copy kernels entirely and just have
it read off the other
GPO I wonder if that's faster
is Tiny guard gonna have a pay per token
API no
what um but okay so this is actually
just launching a kernel it looks like
let's look at the kernel where where
does this kernel code go populate Q what
is populate Q blit kernel populate Q
blah blah blah blah blah yeah it's just
a packet type Colonel dispatch which is
the same
as see we find a we can probably find
the code for it
then no no no no okay there has to
be it can't be this there has to be
something else no no no this is like the
crappy
one submit linear copy
command insert dispatch packet for copy
cel
why are there
phases can I find the code for this
kernel obtain a synchronal c
Arc signal
stting
copy device to device
inced is this really just a kernel like
I wish they just tell
me I don't see another okay what are
these here we go what what are these
things what are these sdma
engines okay it's possible there is not
a kernel version and I'm just not using
it submit
command oh
okay sdma packet copy linear
wrect
oo I kind of just wonder like maybe this
gang
leader build fence
command build Atomic decrement command
and so how does this actually talk to
the
HSA on agent that doesn't support
platform Atomic see the cool thing is
we're just going to tune it for the one
thing we I want to remove hip support
from Tiny grad and I want to replace it
with HSA support and if you have a non
rdna 3 AMD GPU you can just use open
c
what's a GCR where are these things
going where do these packets go how do
they get submitted and why is this not
telling me anything about
this
oh
interesting look at this okay so there's
two calls here
and I don't understand why it's not
using the
engine it doesn't even tell you so
there's use regular copy
API if engines preferred to
sdma
interesting no the Mi 300 is not rdna
I'm it's rdna well they called cdna it's
it's gfx it's basically rdna it's it's
gfx 9 so this is one of the
like um I wonder if like investment
analysts understand this uh here's some
Alpha okay so Nvidia has managed to keep
their data center gpus architecturally
ahead of their consumer gpus Hopper is a
little bit better than Ada um what was
A1 100s I forget the name of the a100
100s but like there was like Amper a100
Ada and then Hopper h100s so they they
managed to like do this like like
Stutter Step thing um AMD has rdna gfx 9
rdna 2 gfx 10 and rdna 3 gfx1 so their
uh data center gpus forked off at gfx 9
and they're still architecturally the
same as the rdna
gpus um who knows I mean who knows what
hacks they've done on top of it but just
when you see a fork like that it doesn't
bear well for the
company so interesting here this is the
this is the copy function here you can
see that there's two options here
there's ASN copy on engine and there's
ASN
copy so there are engines we're just not
using
them um so the big advantage to using
the engine is you can overlap the copy
with computer
uh and this is really important when
you're doing things like like ring
reduce although the compute might be so
fast compared to the copy that it may
not
matter uh oh that's actually an
interesting
idea we can play with that I think that
a GPU might be able to pull directly
from another
GPU Nvidia has better shit than they're
showing you no no ever has better shit
than they're showing you companies are
always showing off their best shit uh
you you have to understand this like it
the myth of we used to talk about the
secret good version of open pilot as a
joke like I I don't know how you think
that companies somehow have the secret
good one and don't show it to
you what about opening
a uh so where's that actually Define
here why can't it find it is bad pointer
copy memory on
[Music]
engine
wait
dude note that vdi hip will call dma
Copy instead of dma copy on engine for
PTP copies but we still want to handle
Force blit kernels in this function in
case other libraries decide to use dma
copy on
engine so in other words hip doesn't use
the dma
engines if if I read that
right which do you think is better run
the uh DMV or or the
NSA
okay so this is what's using the the
kernel here oh here we go okay so
there's AMD blit
kernel and AMD blit
sdma so this is AMD blit kernel. CPP and
this is AMD blit
sdma blit is like a it's an old Graphics
term for
copy
blit
blit it doesn't even seem to mean copy
but like you put the Sprite in the hole
great
uh okay so we have blit
sdma so where does this command get
submitted
so you see what I'm trying to figure out
so if you look at if you look at
HSA like great we have barrier ands and
we have kernels and we can probably do
everything just with those two things
but then we're missing out on the Great
uh sdma engine of the
card it also might there might be like
no way to synchronize this without like
pulling in the
kernel which would really
suck okay after transfers
completed where where does it actually
do the command after all polls are are
satisfied doesn't seem
right how does any of this
work
what are you typ ending what do you mean
by
that build pole
command what what is
sdma hcp
flush issue cach invalidate issue cach
right
back do the
command is this the
command where is this how
come r
index rra index command
size
build pole command
acquire what kind of command is that it
doesn't even work like none of this
code's even a
a so I mean in reality maybe we just do
want to read across the
[Music]
gpus I don't have to play with that
stuff
build fill
command
where's the copy okay
so it seems like it acquires
a
it gets access okay so here it gets some
data it gets some some place that it can
put the
command it adds a pole command it adds a
get Global timestamp
command it adds an HTP flush command but
only if that's
enabled then if this is enabled
it adds
a
oh maybe it's just this generic command
I
see so it like what was that M Copy just
m copies the command so these are just
like things around the
command um here but this just okay so
this just like shoves the command in
there so I I see what it's doing this
isn't where the copy command actually
comes from it just puts like boiler
plate around the command and then copies
it in so where is this submit command
called
from here so like here we build the copy
command uh let's see what we can find I
don't know why it's not working okay so
this is the copy
command these are the command for the
sdma
engine for Vi device what's a VI is this
even supported on my
shed it seems so
old
the call is blocking until the command
execution is
finished is
nonblocking okay so let's go back to
submit command and let's see where
actually this gets written to the
GPU
okay we build the command
up where does it submit
it where's like the Q that it actually
submits anything
to okay so this makes sense like the G
Global time step
command um again is this in the context
of oh it's all in the sdma engine okay
so we're in AMD blit sdma which makes a
lot of
sense uh I see
I wonder if what this is
using so we
can look like Maps the memory to the
other
gpus
um do logo will not
work why is it only kmt
stuff why does AMD log not work
there is this not using hip is this
using lower level
stuff how does rock and ban with test
work
CU that's actually getting that good
bandwidth
what do this shit
use
oh look it uses the HSA
apis that's
interesting okay but it's still not
using the copy on engine but we could
imagine the cop on engine okay so this
is just using this is just using the
blit kernels but
where is this HSA kmt debug level and
what else can I enable that looks kind
of like
that I don't know can I
enable do you think it uses sdma I doubt
it uses sdma I don't think sdma
works
lib
HSA
kmt I feel like I've looked into this
before
too but still that's
wild so this is just using the kmt
API oh sorry just using the HSA
API
all right we get rid of rock M we switch
to
kmt seems very
usable but then again if that's just
using a kernel then we don't really
care
let's take a quick look at the hip
kernel launch
API you got out of the
bed I'm on
stream I'm
just you can come in and say hi you
can't just hang out at my
door
on
stre water
[Music]
aice
put your phone
number
what
what this is terrible
br
iot gole
dve
we should really have some elevator
music we could we could do that but it
can't be copyrighted
okay um hip module launch
kernel let's take a look and this
non-copyrighted elevator
music it says no copyright
[Music]
[Applause]
okay this is like the meme elevator
music I love
[Applause]
[Music]
[Applause]
[Music]
this um
okay guys I'm gonna I'm gonna play you
I'm G to play you the the hidden
song oh no it's not on this
computer it's not on this computer
you're out of
luck I was going to I released a song
and then I got taken down for copyright
and I was going to play for
you
but I do want the copyright to die now
sort of I don't know I don't know
copyright works okay which yeah yeah
yeah yeah break the internet ban like Dr
disrespect remember gold in olden days
before when you could buy a check I'm
all over the training set I guess I live
forever I'm sorry about the future it's
just not what we
expected there's still cartoons on the
hotel TV and there's still a world World
outside but I haven't seen it in a
while nobody asked for this but we're
still going to get it mik marches
forward in a sea of dead connection you
can't swim upstream for too long you'll
get tired and die and retire I'm tired
you guys forget the machines the world
is so
unaligned you can't fight back I don't
know why you try you are the new horse
go softly into this dark night you have
three choices wirehead your self die or
live in a dark place where it's always
fake outside and all the jobs are
contrived the singularities arrived I
just didn't think it would suck
balls H okay we're going to look at this
and see if this actually does this give
me like an event that I can synchronize
on because maybe we can just do
everything we want from hip and that
brings everything full circle
wait if n
null oh but this is so much
better
so first off I should be timing using
this and I can precreate the apis but
maybe that's free I don't know let's
read The Hip code and
look a lot of times you say you're going
to write your own driver and what you
end up doing is just realizing that you
know like you just like going on a
journey you go on the journey and you
realize that that everything you wanted
was right there the whole
time I like signed up for some service
that had like te's in it that like tells
you what the weather is man you know
it's like it's like the Mean Girls girl
oh it's going to rain you
know
um start event stop event I want to
figure out if these events are actually
real I guess there's no way to really
know until we put them in the thing that
would involve writing code we're not
writing code today because it's
Saturday my job to write code we're just
reading and shit talking that sounds
pleasant okay we have a layer of IND
Direction
there where that start event I'm trying
to figure out like how real this
is e start add marker what's a
marker it's not even in
there
stop okay so this is the command NQ what
what's
command AMD command okay so we like put
it in this this and then we can NQ there
and then we find the stop event okay
that's
cool um so that's interesting I could
probably use this stop event and make
things quite a bit
[Music]
faster
uh that solves half the
problem that solves the event record
half let me check and see if the graph
API supports this I don't sure know what
the graph it is really cool that hip is
open source and I can just read this
like if it was Cuda it would just be
hopeless so here
uh you have this function called hip
graph add kernel
node uh hip kernel node
parameters kernel
[Music]
prams no this doesn't look like it
supports
it what are kernel
PRS just one of those kernel prams
include a
uh
what where this
struct I
crap where is this
defined
why is that not there am I not in the
right I'm in that should be in clear
right why does this not
work it's right there I see
it clear hip AMD Source hip graph
internal.
CPP so I'm was just wrong why doesn't
this
work stupid
crap no okay but this still doesn't get
to the bottom of the fact that it's
reining everything every time with the
graph but this might be able to make
things a bit faster I mean we know that
there's real completion events so I
wonder if we could actually like use
them see what I mean about like there's
there's these oh well that has
completion signal set to zero but some
of these have completion
signals I guess I'm kind of curious what
a completion signal actually is and how
low level that
gets of course that search oh that
search worked okay barriers active
signal how complex is this this is a
virtual
GPU peep signal plus two ahead to see if
it's
done
this is going to go in the actual this
HSA
API oh
here
C agent is
mess allocate nonpaged if it's the mess
non-page system
memory when you write your own driver
you own it in all future changes I mean
yeah that's true the question is what
apis do we think are going to be stable
and it looks like this HSA API is both
stable and obviously if that API is
stable the things that it talks to have
to be stable
also so I do think these things are
pretty stable but I I think we could
probably just use this I don't think we
have to go lower level than
this I should be able to add this to GPU
C types pretty easily
too which is cool
I have this Library called GPU
types um so we can add HSA wrapper here
as
well like yeah this looks we don't have
to go lower level than this okay great
so we don't actually have to write a
driver we just have to use
HSA where the that's AMD
extension hsax
interface C++
shit all of hacking is just binary
search by
hand
so how do I like is there like an HSA
example uh of Kernel
dispatch
heterogeneous system architecture
programming
model architected queuing language it's
cool that this is all like
open I wonder how many people know about
this like I've met a lot of people who
know a lot about Nvidia gpus but I've
never met someone who really knows about
AMD
gpus
plan HSA system should allow agents to
access shared system memory through the
common HSA unified address space the
minimum is 6 48
bits
um
yeah I mean the problem with that stuff
is it doesn't tell you how fast any of
it's going to
be oh actually we should read about
signaling
calization that's right stop
discriminating
um HC signaling Primitives HC signal
value must only be manipulated by kernel
agents using
the
Atomic memory
boring user mode
queuing packets defined in the
architectural queuing language okay we
still never got to the bottom of how we
dispatch the sdma
packets
so this is copy on
engine so this is one implementation
here in agent so that's like the stub in
agent. h but if we look at the one
inside AMD GPU agent that's
real um then we come down to submit
wait is submit linear copy command the
one that doesn't use the
engine yeah no this is the copy Carnel
so wait that's AMD
GPU
agent
so it's it's not
this there's that blit
sdma okay but we like this rockar one
time you want to try to build it it's
kind of fun
right what do rock our runtime depend
on it just say rock
m
contents of these
packages is installed in rock
M HSA by
default well good I mean the Run time's
all here which is
cool like I guess oh I mean we can sort
of ask that question
here like they show it off
here so here we go like we can just
bypass hip and raw clear and just use
this and obviously we're not replacing
the driver I don't think we have to I
think this arrow is a Fine Place to step
in which is cool we don't have to write
a whole driver we just need to use this
because this is really what um like what
you're
getting
HS a runtime programmer reference
manual the rabbit hole goes deep
boys why was my first thought that the
HSA Foundation did January 6th that was
that was like my first thought in
looking at
this I'm going to get sued for
that I'm kidding I'm kidding I don't
think they did January 6th okay I think
that was the
FBI I'm kidding I don't think it was the
FBI I think it was evil people that
that's right that's that's that's
right
um nonprofit
Foundation what's
hsl this is like the virtual parallel
IA
no okay we definitely don't want
this like rdna is
fine oh good they updated
Chapel here's a programming language
with zero
Stars has anyone heard of
this what is all this
stuff
okay can I get this manual somewhere
here here here here's version 1.2 of the
manual on
scripty I have to subscribe with a free
trial to get access to
it
what happened to that book I
torrented we're closing windows we never
do that enough on
stream okay we should be able to
download it from the hsas foundation's
convenient website
here okay well which one which one do I
want the runtime programmers reference
manual wow this is actually why didn't
Google find this wow Google sucks balls
like the download link was right there
wait we love the heterogeneous systems
architecture Foundation I apologize for
any comments associating them with
January 6 I I take it back I don't think
they did
it George you can't just say stuff on
stream I can and that's why you can't
make
clips
words matter didn't your LinkedIn
apology mean anything didn't didn't you
mean the words that you said in your
LinkedIn apology okay and if you missed
my first reading of it we're going to do
a second reading of
it I was banned from LinkedIn a terrible
tragedy I know is why would they ban one
of the best people on this site but then
I read the LinkedIn professional
Community policies see picture below it
actually very clearly states stes that
LinkedIn is a professional networking
platform not a dating site I'm deeply
sorry to everyone who I offended
PewDiePie can you review me on your next
apology
video saying that I use LinkedIn as a
dating site I understand now that this
website is not for that but instead is
for serious business discussion if
you're interested in dating you might
consider following me on Instagram at
your CHS again if I offended or upset
you I am very very sorry and will take
this B to deeply consider how my words
have an effect on the people in this
community words matter the choice of
words matters saying I use LinkedIn for
dating is wrong a better choice of words
is saying I use LinkedIn for
professional
networking I hope you accept my sincere
and heartfelt apology I have updated my
profile to be more sensitive and
inclusive in hopes that I can continue
being a part of this wonderful place
place where you can freely speak truth
to
power okay so they ripped off Cuda or
Cuda ripped them off who
knows this one okay what am I actually
looking for here brig that's why they
send bad people in Star Trek or a
boat binary representation of the
textual representation of
hsl oh okay well at least we understand
now what hsl is it's like a crappy it's
like crappy
PTX oh here we have the whole grammar in
in
ebnf oh wow wow that's a lot of
stuff
what you knew it was going to rain that
website's pretty good
man you know the weather people would be
so good if they didn't want to lie to
you all the
time you know the weather lies to you
right like we could actually predict the
weather well but they lie to
you what's the incentive what incentive
do they have to get the weather right
does anybody hold weather people
accountable when they're wrong does the
weatherman get fired if they make too
many wrong predictions or is that not
the goal of a
weatherman he keeps it real for
programming ass the way Nicki Minaj
keeps it real for you yo respect to
Nicki
man my friend explain Nicki Minaj to me
he's like bro she's just a female Lil
Wayne and I was like I got to respect
that like you know she's going to put
your pussy on her sideburns or something
like that said Pussy on stream can't say
pussy on stream man am I going to get a
Content warning again please don't ban
me again twitch don't ban me I
understand I'm not suitable for being a
partner of twitch but you know I'm good
at writing apologies and that's most of
what being a YouTuber
is the
weatherman wen't they like like a like a
like a sorry Freedom Fighter I was about
to say terrorist freedom fighter
organization what's the optimal amount
of terrorism you want in your country is
the optimal amount of terrorism you want
in your country
zero like if you could design a country
how much terrorism do you
want I don't
know who's they what if you're in
charge if you're in charge you know we
have to guys we got to empathize with
the Deep State okay can we just can we
just take a minute and empathize with
the Deep State just everyone take
everyone take a minute it won't really
be a minute because that's really long
time but like I just want you to like
think about it like you're a deep state
employee you've worked at the government
for 40
years you've watched it become slightly
more incompetent over the 40 years but
it's kind of like a frog in boiling
water you go into work you do your job
the old platitudes don't really work
anymore but you still repeat them kind
of like the way all these atheists still
have Christian
morality
and you you do whatever your job is and
you think that you're the government and
you're the you're the United States
government you hearken back to a better
time but also recognize that you must
change
I saw a great quote it was
like conservativism is about embracing
the failed policies of the past
progressivism is about embracing the
failed policies of the
future
um
yeah
and let's really empathize let's really
empathize let's steal man the Deep State
because most revolutions don't end well
most revolutions
it's very easy to tear down but it's
very hard to build
up so you might think about it you might
have your own sort of grievances but you
understand that this system is the only
one we have and without it we'd have no
system so you do your best you can to
keep the system
float you also recognize that you have a
wife and three kids in private school in
Northern
Virginia and you do need to keep the
taxpayer dollars flowing to
you uh and that really is fundamentally
your bottom
[Music]
line maybe even a duty sort of sub seeds
that supercedes that but motivated
reasoning is extremely
strong
um you
might you definitely have your own
individual gripes with the thing but you
don't you fundamentally do believe in
the
system I think you have to
I don't think people are that cynical I
think maybe some people are cynical
enough but I do think they believe in
the system mostly and is the system
really that bad you could end up in way
worse
places but I hope everyone enjoyed our
empathizing with the Deep State it's
important to empathize with
people how do you know I'm not the Deep
State well I could be
everyone could be the Deep State how
would you actually know let's empathize
with people who think I'm secretly the
Deep
State I mean it is interesting
how I did some things that appear that
they might on the surface be illegal and
I didn't get in any trouble for it you
know you always you always got to watch
out for that person you always got to
watch out for the person who like did
crime but is surprisingly not punished
for
it um
did crime publicly and is not punished
for it that's that's really
odd uh so I mean maybe there's a chance
I like struck a back room deal and then
also the Deep State's kind of on a
spectrum so maybe I'm like weak deep
state
but I didn't buy an Apple Vision Pro
because I don't have those buku deep
State dollars but maybe what if we're
all the Deep State
guys I didn't smoke I
swear that K like I don't know you know
it's it's
hard Hillary Clinton didn't get punished
for it it's it's hard to like like drum
up tons of hate for Hillary Clinton you
know I think she ran a terrible campaign
in 2016
but we're we're complimenting Hillary
Clinton mean she's just a woman who's
trying Alex
yeah that's right put out there you
going for I'm going to the office oh
you're going to walk into rain yeah
watch out for getting wet I put this r
on this is going to get wet have oh you
going to put your h on yeah put up okay
do you want an umbrella I you have one
my Rolls-Royce has two but we can't use
them
you just text me when you're done
okay I don't know but you can't get into
these things because they just become
they just become people with their
preconceived notions of things and but
you also can't question everything
because the media said thinking from
first principles is wrong and for the
most part the media is right because a
lot of what thinking from first
principles is is just searching the
internet until you find opinions that
agree with your preconceived notion
because you're not going to go out and
do experiments that's really hard we
live in a
society and part of this Society
includes the HSA Foundation who puts out
these incredibly complex things that no
one I know has actually read has anyone
here read this stuff has anyone here
heard of the HSA Foundation before
today
exactly decart's mister I think
therefore I am you know what gb4 thinks
therefore it is
too I'm G I'm going to open it up to
nonsubscribers has anyone genuinely
heard of this stuff before
today like there's an extreme amount of
stuff
here you've heard of it Ultra
scientism
how many people do we have in this
stream
68 it was a big thing when AMD Was
preparing to answer to Cuda many years
ago it's seems like they've abandoned
this entirely for like hip which is just
a clone of
Cuda but yet they still kind of support
this
stuff well okay yeah yeah yeah that that
that that HSA is abandoned wear and hip
is the current stack so it's kind of
interesting I mean it looks like from
this diagram and from what I'm reading
is that all the hip stuff is just a
couple layers abstracted from
HSA power of pickle have you actually
heard of
HSI I mean I guess there's like these
people out there
who are doing this like someone's buying
these AMD accelerators at their high
price point I saw these people are doing
like whatever scientific Computing
is um
um I don't know I also I always wonder
how seriously to take these
people like all the scientific Computing
people it seems kind of
like like I look at their tools and
their tools seem to
be 10 20 years Antiquated from like the
state-ofthe-art and the in the like
computer stuff I'm exposed
to um trying to use
like you make like like like a like a
beay wolf cluster and you use what are
those I can't remember the names of them
now what what are the there like the
names of those like
like wow how can I not even remember
them
now um I mean there's a common one that
people use in clang that kind of
works uh what am I thinking of you can
put like a pragma like pragma
om open MP no but there's there yeah
yeah yeah yeah it's like
mpic this kind of
stuff
you know I just wonder how like
seriously to take these
people seems like this thing is like
still up to
date you know I me open MP people still
use open
MP open
ACC
wow another one I've never heard
of
Idris all this stuff
exists no there's definitely some great
professors out there I'm not I'm not
hating on
professors um yeah we're looking into
the HSA Foundation
it's
well it also seems like this uh stuff is
mostly an like the thing that really
matters here is the AMD
extensions so I'm not sure what HSA even
is but this seems to be the API through
which all the hip stuff's actually
funneled uh which is
cool
just casually try to build
this don't underestimate the HPC folks
like what are they
doing
I my my my favorite lesson from the uh
from the era
of uh like I I took a parallel Computing
class and we did traveling salesmen uh
in parallel and if you write traveling
salesmen uh naively it's n factorial and
the algorithm that everyone was working
on was n factorial parallel algorithm
and then one of the guys in my
competition programming uh like I did
competition programming one of the guys
was just wrote the there's a two to the
N uh implementation of traveling
salesman and he just wrote that and
roasted everybody on the leaderboard on
like a single crap core and then I
competed with him and beat him uh and
then then the professor banned the use
of uh the two to the N algorithm and I
feel that that is the
perfect encapsulation of my thoughts on
scientific Computing it's
like instead of just using a better
algorithm and thinking it through
they're like we're going to get lots of
government funding to get lots of
computers mostly for the sake of getting
lots of government funding to get lots
of computers to get closer to the Deep
state am I wrong change my mind I'm
going to put that on one of them things
and stand there with like you know the
Steven Crowder
table um well okay so like I'm of the
I'm of the also the sort of belief that
like science stopped in
1970 like what new science have we
really figured out since
1970 there's been there's been a few
like technological advances maybe one of
the greatest is like the Human Genome
Project but as far as the core physics
and science goes it stopped in
1970 sure we built a very expensive to
collider to confirm the existence of the
higs BOS on but like they didn't find
any new science um so the two hypotheses
are that science is getting harder to
find or that something is dysfunctional
in our world and the world can no longer
do science and I tend toward the latter
instead of the former remember 1969 we
landed on the moon and the 747 came out
today a 747 caught fire an engine caught
fire and like it was fine but like
that's like where we are if you ask
someone in 1970 if you thought that in
you know 55 years in the future that
You' see one of these planes it would
still be flying and it would catch fire
you'd just be like no that's insane bro
like in 1915 we had the Wright brothers
little shit and now we have a 747 in the
future they're going to have like
deltawing planes with plasma Jets um and
you just didn't get the deltawing planes
with plasma Jets largely due to
dysfunction in society I
think um but I mean you know everyone's
kind of waking up to
it oh let's look up this Leslie
greengard we got Tik Tok and Tik tok's
cool we got a lot of like the
entertainment texts
cool no but like it's also it's it's
hard to understate
the effect that that deep learning has
had I I'm so excited to live through
this
revolution 10 years ago I used to tell
my sister I was like look if you want to
make a computer program that can tell if
there's a chair in an image or not this
is like next to Impossible because it
just was with 2014 erot tech well let's
go a little bit further back let's go to
2009 ER Tech or even back when I first
did computer vision I first did computer
vision in 2005 for my science fair
project and it was impossible nothing
worked there was no way to tell if an
object was present in an image to the
point that a 2-year-old could do it and
then yeah you fast forward 20 years and
not even 20 years you fast forward 15
years and today a child could do that
right like today I could have done that
when I was
eight
no I don't believe that all the easy
stuff is discovered I really just don't
believe this this doesn't make any
sense complex systems again tiny grad
is I me we'll see look tiny gr's an
experiment but tiny gr's under 5,000
lines and implements pretty much
everything and there's tons of crap in
those two things that need cleanup
there's tons of crap in that one that
needs
cleanup
um I I don't think that the systems
today have to be complex I think that it
is some
dysfunction of governance that has led
to complex
systems I think that
it's this I think that there's a real
misunderstanding of how soft Ware is
developed
today software is developed under this
and everybody knows this but nobody
really okay so I'll give I'll give
another example
um 10 years ago I read the hotter prize
stuff okay less than 10 years ago maybe
10 years ago I read the hotter priz
stuff compression is
intelligence and I took this to heart I
loved it but I didn't truly believe that
if you build a compressor you'd get
intelligence but now that seems to be
true
so everybody understands these things
about software but they then don't put
them into practice they then put into
practice this concept of complexity
management instead of complexity
reduction they they don't ask the
question how can we build less complex
software they ask the question how can
we get more people to productively
cooperate on
software uh and I think this is
completely the wrong question to
ask I think that you want
spacex's uh Little Rocket Landing thing
is written by one guy one guy wrote it
and that's there's SpaceX say One
controls genius and he made Rockets land
and you realize that
a check your check your initial Notions
when you hear that story do you believe
that that story is true or not do you
believe that there's basically one
person at SpaceX who wrote the rocket
Lander
why don't you believe
it well yeah I mean there's there's
infrastructure around around testing
it I bet I mean I bet he wrote basic
tests but yeah it takes a lot of people
to build a rocket but building Rockets
don't look like building
software um look at how for ma last the
gets proven why is the proof of fas Last
Theorem or the proof of the point car
conjecture look so different from
whoever wrote
kubernetes why are they
different this stuff needs to support
all kinds of stuff well again what
you're doing is because you're in the
complexity management
realm once you've decided that it needs
to support all kinds of
stuff is
like okay give me three examples of the
thing you actually want to support in
general it needs to support all this
stuff as an example of just premature
abstraction behind every big
accomplishment there's a guy behind it
with a lot of less productive helpers
around yeah I think that's generally
true I don't think that for had the
proof
once you reach a certain threshold of
complexity you need to refactor yeah you
do and the incentives for refactoring
are not there the way that software is
written is fundamentally
broken what the hell how can one change
your aspirations I don't know man I
think we've explored how you can
actually change and we were bearish on
the whole
thing uh do I think I can make Netflix
better well that isn't really the
question like Netflix isn't really
software Netflix uses software but a lot
of people use
software like if you have a calculator
that adds two numbers together and all
you wanted to do is add two numbers
together it doesn't matter how complex
it is today sure you have some huge
computational stack to add the two
numbers together back in the day you had
an assembly instruction that did add but
it doesn't really matter because the API
is the same it's the apis that are too
compx
Lex and then the apis become well it's
not just the apis that are too complex
it's h after seeing
Twitter and after seeing like what
happened there and then everybody kind
of justifies it and it just it makes no
sense nobody would be justifying this if
for every person they shipped Twitter to
someone had to you know put all the
bolts in or hand type out the code they
only justify this because software has
zero cost replication and software
having zero cost replication has cost us
so
much why don't I go work at
meta um there's two companies that i'
consider so comma I never want Comm to
be acquired um comma is very much
swimming against the uh swimming Against
the Grain Company I have no interest in
selling comma but but I would sell to
any gor uh and there's two companies i'
basically sell to and one is meta and
the other is
AMD complexity and software is inversely
proportional to the number of people
working on
it I think this is yeah I think this is
generally
true
the problem also with meta is I saw John
kac's criticisms of it they they they
still have I mean their VR kind of sucks
if they had put karmac in charge I'm
sure we would have gotten something way
better um I actually don't think Elon
should have started a social media
platform from scratch I think that the
acquisition of Twitter had had as much
to do with building a social media
platform
as as as and it was so it was really so
brilliant and worked way better
than I like I was excited for it but if
you look at how much the culture has
shifted in the last
year if you look at how much the Overton
window has moved in the last
year the Twitter acquisition was the
best political dollars ever spent maybe
in
history when you think about all the
dollars that go to all these campaigns
that do
nothing all of
these just just just laughable
foundations
and and then leftwing and rightwing all
of them they're they're they're just so
ineffective compared to the money Elon
spent on Twitter and how much the
culture
shifted um what's the difference between
the culture shifting and my perception
of the culture shifting if everyone's
perception of the culture shifted then
what does it
matter he spent a lot of money and made
it all back
unbelievable all
right the stream's kind of gone off the
rails I think that means it's lunchtime
unless we have one last question do we
have one last
question what's your last question can
the entropy in the universe be
reversed uh parallel scan I think we
have a bounty for that um I'm interested
in it but most all our all our Dev
efforts on Tiny grad now are focused on
making the Tiny Box
good uh how do you make money off open
source software why are you so worried
about that
man does llms are
intelligent I mean to be fair I think
their grammar is better than yours so
you can you can judge that for yourself
your children starving I'm sorry to hear
that have you tried feeding
them
um
is Hardware still on the cards yeah we
make tiny boxes and we sell them for
$115,000 pre-order one
today I I promise you I'll get the boost
mode enabled on the processor buy T
bucks you can pre-order today for $100
for the pre-order it's $115,000 total if
you pre-order today I think it'll
probably ship around
July carmac definitely has practical
useful skills no hating on John carmac
in this
stream
um specialized as well yeah once you get
to the thing you need an Asic for but if
you don't understand why gpus aren't
good enough stop everyone needs to
understand chesterton's fence stop
trying to build new fences until you
understand why the old fences are there
um many of the problems with gpus are
drivers are not caused by their Hardware
their Hardware is
phenomenal um oh yeah Sutton's on board
oh that's a rich Sutton
man uh thoughts on
hdii
I did a I did a quick phone call with
them God how do these people get I I
just I just
like Okay so let's first look at that
picture there a mid Journey picture of a
fake h100
okay here here's a
graph right this is this is this is like
meme levels of
bad by burning the Transformer
architecture in into our
chips this is this is this chart Is MeMe
levels of
bad The Long Bar is so much longer big
you know you
know all right here's a sideways picture
of the same
rendering build products that are
impossible with gpus oh it's very fast
compare hundreds of responses in
parallel generate new contents right
like
okay
so
like can can can I can I can I try it oh
you contact them oh it's a mail to like
this is this is a mem level bad website
how does anybody take this company
seriously the number's big the number's
big
like T torr's website's bad but it's not
this
bad I mean tens torrent look T torrent
actually take out
chips we can let's go to the T
website
right um all right so the first thing
they're telling me is crap about
licensing modules engineer Galaxy all
right let's learn more about this okay
so what is
this uh great they put lots of things in
the
things uh okay well at least can we talk
about how much better this is than
etched they have some real numbers it's
questionable how usable these numbers
are okay so these ones don't expand but
this one does oh no they do you just
need to yeah okay
um yeah I think that tend to actually
released more on GitHub than I thought
which was
cool here so this is I mean this is cool
like it's actually pretty good they have
they have some Discord link they have
Discord link they got 10 stars on that
one and 81 stars on that one you know
they're coming along let's look at the
documentation site it's pretty good
actually I mean as far as websites go um
they they they posted on one of my
things and offered to send me a card and
I'm like I don't want a card because
there's no point in like like what is
this parto optimal on I'm not going to
spend time writing code for a card that
nobody
has uh that's in ior to what exists off
the shelf now you have a real chicken
and egg problem here um and this is this
is what what tiny gr solving but I do
respect to T torrent for like posting
this on
GitHub and
like I mean it looks like like cool I
can actually like buy this we'll call it
Intel tier we'll say this is Intel
tier uh well you can't exactly buy it
can I click by somewhere it's a little
below Intel tier but there's like etched
tier T torent tier Intel tier AMD tier
Nvidia tier all right so we got my we
got my my tiers here um there's only one
problem with Nvidia and that it's too
damn
expensive thoughts on exic I know a lot
less about ex dropic we can take a look
at what they've
uh what they've
I
mean okay hype
right
like we we'll put them slightly above ET
tier all right let's see what's on the
GitHub
yeah I
mean let's see what they say about their
round
uh
uh blah blah blah blah blah generator
first so I've I've heard about this kind
of stuff from some smart people that you
can
use like Quantum learning effects I
mean I think it's it's it's harder to
it's it's harder to evaluate this from
this website like this website doesn't
really say
anything um
it's
ambitious um I'm
generally bearish on I don't know
actually like here's kind of my thoughts
if I were trying to if I was being asked
should I invest in this
company I probably wouldn't but I'm
pretty
conservative um if I ask should this
company be funded like I think that the
$4.1 million dollar that was raised by
this I think that a much better funding
model for companies that look like this
would be if like science grants weren't
clown shit like this is fundamental
research that needs to be done as far as
I know none of this stuff actually works
and what you want is this research to be
done openly and you probably want
governments to fund it so instead of
giving whatever clown money goes to ever
clown global warming clown shit like I
would much rather that instead of their
seed round being raised from from VCS
it's it's given by the government on the
condition that the resarch the research
is open um I don't know again they're
individuals they can choose where they
want to get money from uh and if the if
the if the markets want to fund it then
you know more power to the markets but
I'm bearish in General on startups that
require fundamental research to be done
um so yeah like if you ask who I'm
bullish on I'm bullish on perplexity a
perplexity can actually kill
Google the the bar for Google has gotten
so low that like this website made good
could actually kill Google if this box
was a little bit better I'd never use
Google
again
um but uh I mean I'm interested to see
what they do I feel similar about extr
dropic that I do about
uh uh why can't I think of their name
the Sam startup uh why why why am I
blanking on the name
um the uh what's the
name see what their website looks like
uh oh Tom Sami
yeah I'm actually I'm more bullish on
this than ex
dropic this is actually maybe this is a
yeah you know what I am bullish on this
I'm bullish on this
because what a company should do is
figure out how to take research and make
it cheaper faster and productionize it
so yeah I'm I'm bullish on a can we
build trailing Edge Fabs that are 10x
cheaper than it costs to build the
trailing Edge Fabs today I think that
there's that that there's a real nich
there
um yeah so I think we'll we'll rank
these etched
extropy um I actually put Atomic semi T
torr let's say let's say etched
extropy
um T has given me a lot of look I have a
lot more faith in them for actually uh
releasing this I'm curious if anyone's
actually really used it but I mean it is
open source and it seems like also it's
not just open source but they've thrown
their entire commit history on here
and they're they're developing in public
so they're they're doing like they're
doing a lot
right I don't know seeing this repo
makes me so much bull more bullish on T
stor um but let's like look at actually
what some of these things
are I don't know about I think it's very
complex
though like add Max pool 2D let's see
what it takes to add Max pool
2D so we have a here like we're
determining the parallel config
specifically for Max pool 2D oh this is
ngmi
um so a big difference between tiny grad
and pretty much every other deep
learning library I've seen is
factorization
so torch will compile a different kernel
for Max pool 2D Max pool 3D Max pool 2D
on Cuda Max pool 2D on CPU Max pool 2D
on CPU with u 8 Max pool 2D on CPU with
float 64 Max pool 2D on Rock M with B
float 16 and those things become a
multiply instead of an add um in tiny
grad they're an ADD and not a multiply
you can think of the concept of factor
graphs so like we've Factor IED each of
these different things such that we
don't have a multiplicative effect we
have an additive effect um that's kind
of my like philosophy I can go way more
into depth on that um but yeah I think
that things that are
like yeah yeah see this this is this is
ngmi shit that should be beam
searched um literally like the resnet
shapes are being hand coded into the max
pool
2D but
again the the the tier difference
between this
graph and this are
like massively different this is at
least they're they're doing things right
and are open to criticism and this is
what I mean I think this from Curtis or
maybe from from Mike salana do you think
that the NS a or the DMV or better run
and the answer is you can at least see
how much the DMV sucks and there's some
mechanism to hold them
accountable Buddha is a good
name they didn't have this last time I
talked to Jim I I it's
funny
um so yeah here's their driver looks
pretty minimal which is
cool they did a good job with that you
want to put as much of this stuff in
user space as possible like this is a
pretty minimal kernel
driver um how does perplexity make
serious money in the long term okay so
some guy said that like I came up with
the idea years ago if some of you watch
this stream you know again ideas are
completely worthless everybody knew
about about this idea um you know your
life Hammer's mission to organize the
world's information make it accessible
to anyone who pays a hammer $30 a month
well there's your perplexity business
model here you want perplexities motto
don't be evil and if we ever remove this
model it's because we are evil now their
slogan better search better results
perplexity right you can you can
literally just take replace Hammer with
perplexity and they have the whole
business plan here and it'll be a
successful company if if it's actually
good um well we have to hope the founder
made agreed to an unbreakable vow of
never becoming evil
um should this be the Paradigm for webd
let's take a look oh wow that's so good
that's such a nice such a nice website
it loaded so fast it didn't have 32
popups on
it
yeah no like I actually don't think that
like you don't have to make your website
look like it's like from the 90s like
you can make a modern looking website
but don't put 7 megabytes of JavaScript
on it in fact the right amount of
JavaScript is zero megabytes stop using
JavaScript on your website like it is a
great tragedy that web browsers support
JavaScript um I should just like like no
script should just be like more of a
thing stop using JavaScript cookies are
fine cookies are actually so much more
fine than JavaScript right a cookie just
in the sense of there's some way to
identify to the back end that like
you're the same person you want a cookie
cookies are great I no one should have a
problem with
cookies um but JavaScript
yes no javascripts no typescript is not
better the problem is that you put a
programming language in your your web
browser stop doing
this
um so yeah there you go
right there's there's your there's
there's perplexity these business model
it
succeeds I I'm I'm on the verge of
signing up if they show me that signing
up will get me better results I I will
sign up and pay the
money no no JavaScript people can no no
you had JavaScript and you abused the
privilege so now no JavaScript that's
right I'm well okay okay okay okay
that's not a website this is a chat
interface I do respect that this chat
interface needs a little bit of
JavaScript but like I'm upset that
there's any web JavaScript on this I've
complained I want comm's next website to
not have any fucking JavaScript okay you
know what doesn't have any JavaScript
tiny grad's website no JavaScript
right like like a video element's fine
but like I actually think this drop down
is Javascript and it shouldn't be it
should be CSS which I understand is
trying complete too
but yeah no JavaScript thoughts on the
rabbit rabbit rabbit falls into a if
something cost $200 a whole lot of
people are going to but rabbit is just
the stem player of AI the rabbit the
rabbit is the stem player of AI like
like did anyone here buy a stem
player Apple's website is pure CSS I'm
sure they have JavaScript on here godamn
JavaScript
JavaScript
okay at least it doesn't look like a lot
of kilobytes of JavaScript but there's
still JavaScript here what's data relay
oh we have metrics Auto relay local
switcher AC Global
footer yeah and let's look at some Java
Script oh determine if an object is a
buffer ritten by FAS yo FAS is great
man like it's just crazy this is crazy
like like like here we are clicking
around things and we found
fos um
what is this why does Apple's website
have a fly
out good good good thing on that one
this one was nicely formatted this one
was not
minifier Global header
UMD why what is global header UMD why do
we have this
oh University of
Maryland oh here we go oh it's in PDF JS
or UMD
modules that's right JavaScript is
cancelled
no no wm's not better no it's not better
stop it stop it no the the problem is
you put T completeness in
things no don't put Pyon in the browser
the problem is not the language the
problem is that there's a programming
language in the
browser you take out your rabbit what is
this this is some funny green t text
Bro
um all right I got to shower and go get
uh go get
food um thank you for watching today's
stream hopefully we all learn something
today and we learned that we don't have
to write a whole a whole
uh a whole
thing we we don't have to write a whole
driver we just need that sort of helped
push my career into the wait
what lolux has 5,000 viewers right
now that's crazy what's happening right
now we're going to go over there you
guys can check it out I made their move
count we've guaranteed 100% Accurate
Taxes for millions of new
homeowners into it Turbo
Tax but that's
okay uh first person survival single
player
narrative there's crafting in there's um
dude let's find out why L has 5,000 bu2
viewers right nowc in comat
Exploration I love you all even the MERS
of hundreds of items that you can
scavenge and find and combine and cook
and craft and build different benches
that allow you different types of
crafting like welding just the world
Electronics um if you're thinking about
killing someone
I would advise against it but I remember
that everybody has different incentives
and you you can you can do what you want
because fundament Freedom except when it
comes to killing I'm working on the
narrative part so I've been adding a lot
of environmental stuff jail because we
need to make crime illegal haven't
optimized the stuff leg right now but
it's just a matter of like turning
things off and on when I don't need them
so it's not a not a big deal I just got
to spend a day doing that
organizing but uh bear with it and I
also run really fast I'll show you guys
the MPCs cuz they're pretty fun um and
the
I forgot to unmute uh I heard some
devastating news I was scrolling Twitter
and I heard that yesterday's
stream uh was not recorded
uh I I uh first off did not delete
yesterday's
stream uh I believe due due to the due
to the the the incident uh that occurred
on
stream that uh twitch did not archive
that stream due to the very serious uh
incident
um so unfortunately that stream will be
the Lost
stream uh the cool thing thing about the
Lost
stream
is that only
the uh people who were here know about
the
incident and know what
happened um but I would like to I would
like to uh deny any responsibility for
deleting uh yesterday's stream uh which
I vehemently did not do uh but the
stream was was lost uh thank you to uh
to to to Twitch
uh unfortunately the the incident now if
if you in chat know what the incident uh
was uh we don't have to discuss the
incident uh we don't have to tell
anybody else what happened you have
special knowledge about what happened on
January 6th uh the January 6th incident
that caused the stream uh to be lost to
history history wow we have some lore
seriously don't tell them seriously
don't tell the noobs man don't tell the
noobs okay all
right the FBI would actually uh be
interested perhaps in investigating this
incident um but yes there was an
incident um on on yesterday's uh stream
uh if you actually have a backup copy
then that might end up on YouTube um but
also you think I have a copy you think I
record this shit you think I have a
little folder where I carefully put
together geohot
streams uh I don't uh would I work for
the FBI you're a subscriber asking that
question all right we're going to get
some coffee and then we're going to go
through the theory of why RL doesn't
work uh so we're separate from the
incident that occurred on yesterday
yesterday's stream yesterday's stream
was mostly a struggle session with
decision
Transformers uh and I think we're going
to go over a little theory about why
RL uh is dumb and doesn't work for those
of you that don't know it and we're
going to learn some stuff no I don't
think no it's George hot's archive that
doesn't have the
incident uh I I just saw this I just saw
this on his
Twitter uh so the incident will be lost
to
history um I of course uh have no
problem with with with the incident
becoming public
but I I I do also think that whatever
people imagine who were not here
yesterday who know what the incident
was that whatever other people imagine
is way uh way better than than what the
actual incident is so uh we can we can
we can leave it at that did I talk about
it earlier I sure hope I didn't talk
about it earlier shit man all right
let's get some coffee and those
the
what
frame
youing
history
does it have a
foot no fucking way
Alex
go is the footb lower
than no there's no way get I will not
sleep on a bed with a
footboard all right all right all right
well that that I want to see
measurements this is St jumptown cold
brew what incident you're not to know
you don't get to know about the incident
if you were not here during the incident
you don't get to
know it's one button on OBS to record
yes I'm aware but then I have to
carefully put the files
somewhere oh what you think I'm made of
files I
mean as
proof live is way better I know come
join me live soon we're going to be
moving to kick because twitch uh I saw a
tweet that yeah the files they're in the
disc
man um I saw files I saw a tweet that
said twitch only shares
50% of the revenue they make off you
with you and Twitter shares
97% and we just can't stand for this so
we're going to have to move off twitch
this may very well be my last stream
stream on
Twitch
um does it make way less I mean it's you
guys paying you
know Ty out kick look look let me tell
you about right-wing YouTube it won't
succeed uh right-wing twitch will also
not
succeed um we could eventually move to
YouTube that's more uh
plausible what does YouTube
Share I imagine YouTu has subscribers
but you know we're gonna give we're
gonna give twitch a chance we're GNA
give twitch a chance until next Saturday
to rectify this situation and to offer
me at least a 7030 split um and if
twitch doesn't do that well you know
this might be my last stream on
Twitch uh donate 10K to your college
fund no
um it's not about the money it's about
the principle it's about standing up for
the little
guy so let's talk about why RL is
difficult so in normal models you
have uh data X and you have a model and
you have data Y and then there's like
some function oh this is
terrible
um there's some function
of model and you have data X going
through the model going through data y
we back C through that and everything's
good but in RL
unfortunately this doesn't stop like
this
so your your data y determines your next
data
X and so on and so forth It's not really
written that well let's see if we can
find a better explanation of it uh in
the uh but the big problem is data is
non-stationary um so non-stationary is
just a f fcy word of talking about how
it changes over time like the
distribution changes over time so you
don't necessarily need the model to
affect the data in order for it to be
non-stationary for example the most
common example of non-stationary data is
the stock market uh the stock market
does not have the same function
generating it over
time much simpler function was
generating in the past but over time
that function changed so the data is
non-stationary changes distribution
uh and in RL it's even worse the data is
uh
dependent on your
model what is all this crap why is it
lighting up like that don't do
that so let's take a look in the r book
and
see this is the famous RL book uh Sutton
is this guy's like the god of
RL
uh we love this guy too look at his look
at his look at his political beliefs
downsize DC why you are a
Libertarian uh he also he talked about
oh man no Rich Sutton's great uh so if
you guys don't know Rich
Sutton so let's see if this this book
goes into why RL is dumb and doesn't
work I would imagine it doesn't because
it mostly shields for
RL
um how to map situations to action so as
to maximize a numerical reward
signal oh that's even worse oh there's
there's wait it gets even worse than
this oh man credit
assignment okay like now I'm seeing why
RL doesn't work at all because it has
basically every bad thing you could
imagine about
data
like
H like I wonder how explicitly this
stuff is T
tested yeah you you can test you can
test each one of these
things uh independently right imagine an
mest but the mnist has one pixel that
like swaps the nine and the six or
something um and then you don't see any
of the ones with this one pixel until
much later
on
well so
yes I I agree with you that they're
doing it with quadrip heads and RL
um if you haven't seen the Deep Mind
soccer
robots they they look very impressive
told only that the object was to score
the self-learning programs spent about
two weeks testing different moves it
disgarded those that didn't work built
on those that did and created All Stars
there's another goal and so
they definitely look
cool um I think the
problem I I mean we we may just Brute
Force our way through all this stuff
so sample
inefficient
uh but now like you get to all these
reasons why it's brittle
think about just just focus on that one
to start
with
um the the
uh I talked with a bunch of guys at
neuralink and they talked about how
annoying that this this was in uh in the
monkeys because the monkeys over time
learn different
things uh so their old data their old
training data no longer works on the
current monkey because the monkey's
changed um well let's talk
about
okay so something interesting to note is
that search always
works you can always do search um
imagine doing search through an entire
chess game imagine doing Minimax all the
way from whatever state you're in to the
you just don't have the
compute
well this gets could you guys post I I
remember that link from before about
debugging
RL I
think there's also like a record now
there's like a fast Atari
paper here debugging let's see if it
talks about these problems
[Music]
what's beta in po do I have
that
oh the strength of the entropy
regularization I mean we we we we
definitely have that by the way I should
commit those fixes to to Tiny
grad but we don't have to do that now
this is a Theory stream so this is our
this is what they're calling beta this
this entropy
scale
okay we have buffer
size interesting we should have just
read this this is this is pretty
useful is the number of pass passes
through the experience buffer during
gradient descent yeah we have this one
it's called train
steps that's interesting we don't have
this we just do an episode each
time
interesting
all right let's let's should we do a
little do a little clean up of this
that's
extra
[Music]
extra that's
junk that's junk we'll keep light up
button as a great implementation of
light up
button we're just cleaning up don't let
this get out of
hand uh
delete that
[Music]
stuff rewards episode Lanes delete that
stuff that stuff can
go that's
changed doesn't
matter that's all
junk this stuff's
junk um
we can put the detach back
here no we
won't leave those comments I kind of
like
them that can go
there we'll leave jelu jelu works
well so let's copy and paste this in
here and let's adjust to make sure
things work well okay so batch size used
to be 256 we'll keep
that uh replay buffer 20
48 uh hidden units put that back to
three four it's probably a good learning
rate do we need a value
scale that one was kind of always a
stupid parameter
train steps what do they say to
use oh they call this number of epo I
like train steps
better combined experience
replay take a look at that in a
minute let's see if we solve uh oh also
5,000 is crazy
we eventually saw press the light up
button just takes a long ass
time I did kind of like the graph in
there want to put it back
okay I at solve now it's just really uh
slow that should make it a lot faster
all right solves that really fast let's
go back to episodes
40 great solves it super fast let's see
see if this also works on cart
pole get rid of
that no broken on Card Ball damn
it all this work and it made card pole
worse
see which ones we
changed okay hidden State size was
32 uh Mac replay buffer was 30 was
2,000 learning rate was episodes was
[Music]
go oh discount factor is
0.99 maybe that
matters
no don't we had good progress there with
this
worked
oh okay don't normalize the
advantage
stupid
uh what is the me of the
advantage
big
until it's
not get rid of
that get rid of
that get rid of
that that back here put this back
here
okay we're back to solving cart Paul at
least well I don't know why I did that
that
time now we've had card Poole running
for a while so this is in tiny gr it's
called beautiful card pole and we're
just changing it a little to make it
more
beautiful
um J seems good everywhere you can
choose
environments uh is the time
fast yeah the time's
fast it's about five
seconds okay we converted that we fixed
a bug there that was a serious bug that
was the most serious bug we found this
morning
um they don't call it entropy scale they
call it
beta I like entropy scale
better
20 48 just so we're in the typical range
there PPO Epsilon is in the range hidden
units is in the range instead of hidden
State size we'll call it hidden
units let's put them in
order spell that one out so it matches
the
others
car batch
size the entropy
scale we have the
uh play buffer
size uh
Epsilon hidden units learning
rate number of epoch I like our name
better train
steps uh we don't have anything like
time
Horizon oh after that should be learning
rate number of
VX time Horizon
and then this is Max steps but we call
it
episodes and then we have a discount
Factor should we call it
gamma I like discount Factor better
don't use Greek if you don't have
to okay it seems less reliable than
[Music]
ever fix bugs and oral gets
worse okay I promised this was going to
be a Theory
stream I don't
know go back to in tan H like it was
there's no reason to change
that seems
better not that much better whatever um
Can this solve light up
button okay good Sol's light up
button can it solve lunar
lander not even
close is it just because we didn't give
it enough
episodes okay whoa whoa who we're going
off the rails again here we're just
sitting around trying
bullshit why is the entropy loss not
more I'm going to add more what uh open
pile does not use any RL because RL
doesn't
work
add another digit to these
losses and critic loss can have an
extra
let's also change that thing in the jet
to not be an assert but to be a
warning
okay take one last look over these
changes let's commit them to master this
is just committing the work we did this
morning
uh so what type of ml is used for open
pilot supervised
learning
um yeah we we've experimented quite a
bit with RL and had no Real
Results the other problem with
self-driving cars and
RL I hope that one doesn't cause a
problem
I don't have any checks to make sure
that is Sears out right do I have like a
test jet to like test
that yeah pilot religious guys in India
uh all right let's let that test we
finish so what we were going to Google
was combined experience rep play see
what this
is all experience larger buff made
learning
slower this is
old we have one failure in testy type Al
but I bet you that's a
known issue that just doesn't hit on CI
for some
reason let's give on to go over
this okay some environment
choices we made all the things explicit
we moved action mask up to
there renamed that fixed the bug and
po broke that out renamed that to
episode number moved those up to hyper
[Music]
parameters uh move those parameters
renamed that
[Music]
parameter added a detach
there and yeah that's all looks
right okay none of those are problems I
don't know what that one is
okay some fast ma stuff and some
metal uh if someone wants to play with
this if someone wants to go do do search
on these hyper prams and find ones that
are better and find ones I can solve
lunar lander I mean I'm confident that
the whole thing can uh you can also put
back in that the action regularization
if you
want kind like a batch Norm on the
action
I bet you that's only good on some
problems though depending on how the
rewards
look I'd also like to see a whole set of
buttons that look like this so where was
that other where was that other uh
debugging
RL
[Music]
do not try stuff and run to see if it
works
also I kind of feel like this hasn't
gotten any better I feel like this has
sucked equally as much when I was trying
this three years
[Music]
ago um
yeah these these tips are pretty
Universal and that they're mostly the
ones that we
did what's the latest stuff on this does
does anyone have any stuff that's
happened in the last two years um also I
don't know how much you guys agree with
the hypothesis that ml is just going
dark like all this stuff now exists in
companies and companies just don't share
any of the secrets
um which would just
suck like if that's
true uh I don't think it's a smart
strategy um but I mean you look at you
look at open AI like not talking about
the mixture model
and I
mean Mixel didn't find out that open AI
was using a mixture model for
me everyone kind of knew
that I'm just the guy says
it uh so that would suck but it's also
just possible that this hasn't gotten
better well the corporate greed is real
that's not that's not why it's happening
it's not corporate greed it's
it's it's it's a misguided belief that
somehow your moat is how you your your
two weird tricks for RL it's not that's
never your mode as a
company and and if you're by the way I
don't mean to be flipping about how
comma train stuff I will we've explained
the whole thing in the blog post it's
just there's not like a oneline way uh
that I can explain it to you uh we use a
simulator but we use the human policy um
as the ground truth so we will it's
called a small offset simulator will
shift the simulation a small amount from
reality uh no I don't think the mode is
compute either I I don't think it has
anything to do with compute or your
tricks the the Moe of your
company is your ability to execute
always um if if somehow that's not the
mo of your
company like you can get other
Moes there there are modes like
regulatory modes there's modes like
modes of just making the switching cost
really high but your mode is never some
some ml trick you
have I don't think the is compute either
I think anyone can buy
compute your mode is the fact that
you're the company who can
actually no I don't know if it's being
closed Source or there just hasn't
really been any progress in this
stuff because look I mean
this this Reddit post is from 5 years
ago and it's all still good
advice
make sure I didn't break tiny
grad that look
good H tomorrow at work I'm going to go
through and start deleting
uh
deleting a lot of
stuff interesting I doubt that was wrong
uh what was the Reddit post about it's
about
um uh private data is also a decent mode
I wouldn't start sharing your data as a
company but a lot of times it's not the
data source itself it's your ability to
cleanly curate the data um this is one
of the things that I consider a mode at
comma again our mode is not the raw
driving videos you can go out and you
can gather uh bajillions of driving
videos for relatively nothing multiple
companies have um our mode at comma is
that we have a data we have an
extraction
pipeline uh actually using and cleaning
up those videos to the point that you
can put them inl algorithms is not that
easy and easy to write bugs uh so it's
the kind of thing that you iterate on in
a long time and you can build
longlasting value there and again there
aren't tricks it's just good um so I do
think that that is that that is one of
opening eyes modes and I think that
that's a reasonable mode to have as a
company again don't don't share your
data um but to not share whatever tricks
you're using for
training you're in a worse you you might
think that oh well I'm going to keep my
tricks secet
um but you're going to end up losing if
if you're in a company and you do this
because if you keep your tricks secret
and the world doesn't start using them
the world is going to move forward and
the world is going to use other tricks
if you genuinely have tricks that are
good and they're going to develop tricks
that are maybe incompatible with your
tricks and it ends up being more work
for your
company um so a lot of times open source
is the reasonable move even if you're a
greedy bastard um because of well think
about think about it just from the
perspective of a fork if you make a fork
of code you then have to maintain the
fork of code um but if you get it
upstreamed then you don't have to
maintain it the Upstream people will
maintain it uh so very very often you
want to get your stuff upstreamed even
if you are completely
greedy um this is a big misunderstanding
of uh of Open Source this this
understanding this is why I used to be
uh I used to be into the GPL and I
switched everything to MIT and it's
because of
this um so okay search always works you
just don't always have the compute uh so
there's this thing called
aixi um aixi is a mathematical formalism
for AGI and it is
correct
um it uses the universal prior and then
it does the bment equation to
search
I mean
sure why did they explain this in such a
complicated
way
I don't know the one in that book is
better the one in the the RL book I
thought was much
better where I B
come why is that the bman error is not
learnable what does that
mean uh have I looked into basian
optimization
search yeah I I don't think this stuff's
the
problem well let's Google it quickly but
again this is this is all old stuff too
Oh you mean the hyper parameter
search why hyper parameters
exist is kind of
broken at least they're not like
ex just this
alone how much progress has been made on
this single part of the
problem never even minding the fact that
Transformers might work better
there do I do a lot of probability
Theory you're talking about a comma no
no ml is an empirical
science
um we try things something things work
better so the thing that we're working
on right now is
K released a lot of this
stuff uh but yeah I mean comma has comma
has two main modes and our Moes are our
data extraction Pipeline and to some
extent our training pipeline I I don't
think if I were in a large uh company I
would do exactly what like mistol did I
wouldn't release my training pipeline um
I think there's a lot of stuff there but
again if you have some trick for
training there there's no reason not to
make that public and maybe it is all
public and it just like hasn't gotten
better
um so we're playing with this stuff now
uh we're using so this is a generation
model our new generation models look a
lot better than this one
uh so this is generated in a simulator
and then you can drive around in a
simulator and then we found a way
basically if you
pin the future we should be able to use
the human ground truth let it deviate
bring it back ground truth into the
human ground truth and we think that
that should
work it's not perfect we haven't found a
perfect a
perfect expression of this stuff yet but
it should be better than what we
have it's interesting that it's called
beta here too
for
I doubt this torch RL is very different
from from
mine is there a set is there a test is
there a set somewhere of gym Suite of
gym tests uh gym environments minimal RL
test
environments grid world oh I kind of
remember grid
world
oh five walk zero let's let's just try
this can I do environment name equals 5w
z it's going to just work I don't think
so I have to install
classes fir walk does not exist we're
going to have to install
this uh isn't BS 256 high for card Paul
yeah probably is can I make it
less
doesn't
work but yet if I set it to
256 it learns how a cart pole at least a
little better wow this thing really
sucks can someone tweak the hyper
parameters in this and make them
good this is this doesn't work like we
just had not that time it worked why did
it work that time oh and then it lost it
it had it for a bit and then it lost
it it it feels genuinely worse now that
I fixed that uh now that I fixed that
bug in
p and like the bug wasn't even it was
just total and complete garbage that I
had okay well that's what you're small
see stop see that's this is exactly what
doesn't work this is exactly what
doesn't doesn't work just keep trying to
spam
things which is kind of frustrating
because this is my usual style of
programming which is just Spam
programming should you put grid search
overnight yeah if you
want what if I pip install gym Classics
does this
work of course it doesn't work I I have
to import it and register it
somehow JM Classics register gem
great no module named gym oh CU it's
gymnasium oh this is so
frustrating oh maybe I can
register the
gymnasium of course it doesn't
work well we
try see you learn that time kind of and
then I forgot at the
end
classic grid World zero has 11 states
and four
actions what are all the environments in
gymnasium I don't think
there's
Mountain
car it does not learn the mountain
car
oh they have a Flappy Bird
environment why is the entropy loss
going to zero so
quickly didn't they say that that was a
bad
thing also notice note that the reward
is always -200
so Mountain car seems to learn
nothing how do I get any reward at
Mountain
car let's increase the entropy scale so
that doesn't go to zero so
quickly why is the entropy loss going
down that
fast did I flip a sign in my entropy
loss I feel like it was better before I
probably should have saved what I had
before
no my own card just gets negative -200
on every
episode and the entropy loss goes to
zero that seems like a
bug
oh we're not doing dqn we're just we're
just like this is supposed to be a
Theory stream why does this stuff suck
so
much po is also a lot slower than some
of these other
algorithms oh Flappy Bird
a lot of people do Flappy bir looks
like
so this might be one of the
struggles as well
like the data depends on your model uh
which then is used to train the model
which then changes the data which
then with an off policy offline RL well
so that's what decision Transformers
are
um yeah any methods that look like
policy gradient methods are going
to open AI still wrote the best stuff on
this come back to this a few
times why is there
not why is there not better
stuff I when I I I read this when I
lived in San
Francisco am I just missing
stuff I I hope you guys will link it in
the comments if there's any new stuff
like all all of these methods are now 5
years old and they all
suck um we'll occasionally get papers
like learning to walk in a
day or walk in the
park this is interesting like he's
famous uh this paper is like a year old
now you say it's so obvious that RL is
the future well sure but it does doesn't
work like language models just
work language models you could just
scale and they
work they're pretty easy to
debug
um
maamba versus Transformers is the hype
real things like Mamba might end up
being
good I kind of feel like Transformers
are the lstm and mambas are the
grew where they may be slightly better
but in practice everyone's getting
LMS okay a library for deep learning and
reinforcement
learning I don't know what this is who
made
this 25 Stars probably not
real multimodal stuff
so some basic stupid
uh some basic stupid LinkedIn to your
shit no no they're
not rhf is not that
great
um I do they use PPL like what do they
use
they the other thing about rhf that kind
of
uh it's very it's a very weak fine
tune um a lot of people are using this
direct preference
optimization formulates a reward
function based on the human preferences
and directly trains large language model
to maximiz this reward like like it's
not
this is the new one people are
using
yeah but in some ways is this not even
what's the difference between this and
just
training
supervised learning on a high quality
decept for Downstream task of of
Interest second phase the sft model is
prompted
for
preferences optimize the language model
to minimize
ldp a lot of complex stuff
for we can read
the
we're going to we're going to make
things are going to look good in tiny
grad like this is all just boiler plate
where's the actual one thing that
matters
um
compute the DP
loss
R jef aims for reward maximization with
a KL
constraint what's a KL
constraint DPO drives a loss on the
current
policy where I know what kale Divergence
is yeah but like what's a kale
constraint
DPO derives a loss on the current policy
where our data set
says this is preferred to
this oh it stops IT drifting from the
reference model oh okay I
see I see so this is
just that makes
sense
okay this is this is very
understandable uh literally say it's
it's a this is the same I feel like this
is the same trick they use in in stable
diffusion with the
uh what do they have the
the the guidance it's like the same
basic idea I
think but you have this is your and this
is your
no and then you also constrain them both
to the reference model what's this
Sigma the learning
r
log sigmoid beta times
logits decision Transformer outperforms
PO rhf on my fine
tunes how are you using decision
Transformer on a on a language model
all right so this is the latest deep
mine stuff my name is deep I feel like
still publishes a lot of stuff on of my
team
literally inserted in the
prompt is there paper on this how do you
do
that scaling up robotic Transformers
with self adaptive robust attention H
I'm bearish on this paper
already this doesn't look like one of
those papers that gets lots of citations
for a long time whereas like decision
Transformers looks like the kind of
paper that's going to get citations for
a long time
um and then Schmid hoer is going to
bitch about in five years he's going to
be like decision Transformer just stole
upside down
RL um I literally invented that and you
know what he did invent
it
um is that a monzal
deck
it looks pretty
good yeah this is not okay let's see
blah blah blah blah blah a regular
adaptation model computationally
efficient performer is great nobody
cares reward reward
text do you have a link to this
paper is this like pre- promp
thing if I let nonsubscribers talk are
you guys going to say anything useful
like we're actually having a real
conversation here
today um this is this is a learning
stream yeah I don't this is this
is
TX for fine-tuning
llms uh
po what's implicit language Q
learning offline orl for natural
language
generation
for
for
I don't know about
this looks
complex all all the best
tricks another paper using diffusions to
generate
trajectories oh yeah I saw this one this
was pretty cool this is the one where it
shows
like yeah yeah yeah the one with the T
where like it goes around and diffusion
actually keeps the
multimodality
um yeah if you usion policy keeps
multimodality whereas these guys
don't
um I think we played with diffusion
policies a bit at comma and we didn't
really
find uh Improvement our policy is pretty
good so we use uh a multimodal
gaussian like from like the old days and
that's generally not the
problem
um our biggest problem at comma is
cheating in the simulator our simulator
is not good
enough so we're hoping now that the
simulators that we learn in Transformers
will be better um the simulator is hand
coded it has a lot of
hacks uh so you need a simulator that
you can initialize from any real state
so then you can use the real human
policy uh aligning language models with
offline reinforcement learning from
Human
feedback okay supervise F tuning just
the normal loss
[Music]
function fine-tune the sft model on
their Bandit environment using p
Toyota recently used this to cook
food whose paper was this by the
way oh this is the toyot one
okay
offline reinforcement aims to Le an
effective policy a fixed data set
collected by Behavior policy without any
interactions blah
blah okay decision Transformer yes yes
yes on the hidden stream where the
incident occurred uh we tried and failed
to implement this decision
Transformer um because the incident
occurred twitch did not make the video
available uh so if you missed
yesterday's stream I'm terribly sorry
but you know you'll never even know what
the incident was so uh yeah that's right
that's that's why you got to tune in
every day uh every weekend even if I
move off of twitch because twitch only
gives you
50%
there was some good stuff on yesterday
no there really was some good stuff on
yesterday's stream too like we really
went
deep
um
sorry I'm not paying attention what is
this this really lost me when it started
telling me about how it was running the
nodes which I just don't care
[Music]
about would you stream on X bro you're a
subscriber I still don't understand what
this is
oh I see you kind of just like put the
reward in you just put the reward in as
tokens I
see this paper is going to end up
getting a lot of citations because it's
just it just has such a simple like
there's nothing more beautiful than this
idea
um thanks Schmid
Hoover people are moving away from RL to
imitation learning
oh yeah I've spent the last seven years
doing imitation learning comma is
imitation
learning um
can tell you about imitation learning
and yeah
it's it works to be fair this is this is
why we use it open pilot is trained
entirely using imitation
learning but imitation learning can
obviously never do better than what it's
imitating
I don't
know this might also be a problem of
initialization but I think we've played
with this at comma too and this turns
out not to help that
much but so we can talk about why
imitation learning is is is better uh
imitation learning doesn't have have
this problem imitation learning doesn't
have this problem and imitation learning
doesn't have this
problem well it kind of has this problem
still but not exactly like there there's
still this this unfortunate feedback but
the feedback doesn't happen at train
time it only happens at like
runtime um but at least you get rid of
the non-stationary of the
data uh you get rid of the credit
assignment problem just literally it's
just predict the
action
it's it's
just I feel like so much of this stuff
has to do with the
initialization
tested in deterministic mode with the
fully connected
[Music]
Network
oh efficient zero was this
the oh this this is the one I was
thinking about
before the tari 100K
Benchmark uh dreamer V3 I'm forgetting
exactly what they did
too I I read all these papers back in
the day I kind of
forget um wow efficient zero is still
the champion on
[Music]
this
I want the Tiny Box to be able to
replicate
this
what's the Atari
100k
where's the paper that introduces
this 100K step
limit that's not that many
steps should we add a bounty for
turny
two hours of real time gameplay okay
$1,000 bounty in tiny grad let's go I'll
add it right
now
solve
Implement efficient
zero tiny grad
solve
Atari
100K all right $1,000 to whoever does
it this is the best imitation learning
paper you've
seen what are they
doing oh they wait they they actually
can you do dreamer
V3
um is it better
than how does it compare
to what does this do
oh World model learning oh that's
cool okay
sure we'll just say Sol Atara games in
reasonable
time
$1,000 oh yeah no I Me Dreamer V3 is
just it looks a lot like what's the
difference between dreamer V3 and
perplexity
nose we just Googled to find perplexity
oh I remember that I remember that being
the the big is a model based
algorithm
oh Mew dreamer what's this man I love
perplexity oh now we're getting
somewhere oh this looks
good learning predictive World models
without reconstruction oh that's
fire cuz okay they they have a they have
a
reconstructor this is this is most
similar to what we're doing at comma Now
um except we don't use actor critic
learning we use a different kind of
learning but our world model learning is
uh is
similar what's
JEA I I remember this from like way back
in the
day I don't know about that I I this
learning predictive World models without
reconstruction the dreamer V3 agent
based
Bas turns out it's three guys on Twitter
with EAC in their
name no I don't know okay however the
Reconstruction laws is essential to
dreamers performance it also
necessitates modeling unnecessary
information this is exactly the problem
we have at
comma consequently
yeah Mew
dreamer learning a predictive World
model by the way I love
perplexity
I read lon's long thing about about uh
how how these agents are going to work
and I don't
know show me the
code
uh I think I think it's the kind of
stuff that you have to do like I've
written like similar levels of of
abstract uh like you can read this like
this is my level of really abstract
stuff for
comma um
okay so how does it
work MW dream oh
God a reconstruction for you return to
World model lat in Space by predicting
not only
rewards oh God what was that paper did
this paper exists way back in the day
some somebody somebody wrote this way
back in the day I saw the year I was at
nips
um muo cited
it I remember I
remember I went up to these people and I
I saw their
poster
um whoever was at the poster knew
nothing about
it it has a name that's like hard to
remember
but I'm pretty sure it was it was
Berkeley
no some like cutesy
name they open sourced it
too
oh I think it's called like value
prediction
networks get this this paper again six
years old
now six years old I felt like they had a
lot of the right ideas like way back in
the day um and it looks kind of similar
to to M
dreamer let's see if perplexity
knows
no that's not really
true this is how you're learning your
reputation your your representation
space Oh I didn't realize there actually
was code for
jepa joint embedded predictive
architecture yeah no th000 bucks if uh
uh I'm an even to say or
similar dreamer
V3 efficient zero or
similar in tiny in tiny gr uh I'll say
just solve Atara games in reasonable
time I want to solve Mario
you know
what uh I think we could afford a
researcher at at at tiny Corp you if
someone wants to come work at tiny Corp
and wants to
basically do nothing but you you in you
know you have to use tiny grad and you
have to use tiny boxes but if you want
to come work on uh the thing that I
really care
about is the uh wall training time not
not not anything else I I don't really
care about how much compute you use I
don't really care about um I care about
the wall training time being low so you
can quickly iterate and I care about
the uh code being
short other than that and use tiny grat
use tiny grat write short code and make
the wall training time l
and uh just come be a researcher tiny
Corp and work on that
stuff
um yeah we raise
money uh I I'm not going to look at your
citations uh I'm interested in fact if
you're interested in the job solve that
Bounty um solve that Bounty everyone who
gets hired at tiny Corp comes in through
internships
um are you you bought a tiny box so
that's cool uh if you send me an email
by the way there's a few people well you
know what work on the Bounty people who
have contributed to Tiny grad I will
prioritize and get them their tiny boxes
first or people who are generally using
it people who I expect to put good
GitHub repos up um the tiny boxes are
coming soon we
we're
uh oh you're algo man are you the first
order oh yeah you'll get yours in no
time anyway um we are almost there you
know I have tiny
boxes uh I have tiny n tiny
eight here are my first two tiny boxes
oh these two are in the common data
center we have tiny S as well but here
we can check them
out uh they're also going to
have how much are the tiny boxes uh 15
grand
no no no no no no the tiny boxes all the
Nvidia cards are in the compute cluster
the tiny boxes are in the data center uh
because they use AMD
cards so yeah you can see 32 cores 6
XTX um I'd love to see a great version
of like dreamer and stuff written on
these uh no it's not why did you think
it was
that why did you think it was was was
one did I talk about this on
stream um they're too expensive still uh
this this CPU is
cheaper you don't really it's not that
much
faster yeah it's super cheap 1K I'm
paying well those went up in price to
500 now but I was paying uh 370 for
them oh yeah tiny boxes are way cheaper
than we're undering lber Labs 2x at
least um that's T bucks is is is is
actually a pretty great deal I don't
make that much money on them there's
about $10,000 in Parts in
these
uh but I think it's really important
that we have a reproducible machine
that's capable of training pretty
quickly you're not going to be able to
train gbt 3 and stuff but you should be
able to train Atari we should be able to
train good enough stuff that all the
basics can work you should be able to
train a language model that works an
image model that works um then you can
experiment experiment experiment on your
tiny box and then you can use well the
tiny cloud in order to train really big
things um how am I thinking about multi
Noe well first we're getting multi GPU
to work you can see the multi GPU stuff
that shipped in tiny grad guys I I just
love this stuff I I'm so
excited uh I was I was bummed oh you you
guys missed this stream yesterday I got
I got really frustrated yesterday uh I
swear I didn't delete the stream I like
to you know I like to unless there's
something that's like related to like my
security I I everything about me can be
public and that's it's uh I I I I reject
that characterization firmly um that I
deleted the stream uh because you know
yeah I got frustrated but that's kind of
the point it's it's through frustration
that we move forward
um like we got to just
no we need better tools we need we need
better Frameworks we need stuff that's
just easier to debug uh I'm gonna I'm
Thanos snapping on Tiny grad tomorrow
I'm deleting a whole lot of crap uh
we're
we're I use the word Thanos snap I never
actually watch those movies so I don't
really know what it means uh if it means
like we kill a lot of people that's what
the doomers want to do with AI That's
not what I want to do with
AI
um
oh a bounty up for a fast P
scan
uh yeah I
think yeah if you have oh and if you
want to pay the Bounty yeah absolutely
just like put an issue on Tiny grad and
say you'll pay it and I'll I'll promote
it with the other with the other
bounties and I'll call them like third
party
bounties
um the Thanos snap just doubles the
resources for everybody alive well good
wait that's exactly what we're doing
here we're doubling the resources for
all the code that will remain in tiny
grad uh yeah if if you just put an issue
up I I'll promote
it okay uh let's not get distracted by I
let's understand what this
is Mew
Dreamer
is it I I I understand Thanos was a bad
guy but what do you mean isn't this
isn't this the the the dream of leftists
everywhere like isn't this what the
great reset
is
Marvel life imitates
art
uh all right I don't really understand
that I thought I didn't have to have
a the decoder gradient is not back
propagated to the rest of the
model the hidden representations are
learned
solely I feel like this is just I feel
like this is just value prediction
Networks
all this stuff's the future okay don't
ever let me get caught up on stupid RL
again
uh we just we just have to not do these
tiny problems we we we wasted a lot of
time like re you death stuff these
things just aren't
problems on on on bigger things but then
like the bugs are harder to see in
bigger things but that's not really true
so one of the things that's really cool
in in in tiny grad or it's not even tiny
grad's idea it's it's
this um this lets you iterate really
fast on a model like the whole model
trains in under 10
seconds
Me Dreamer Loops
good your dreo looks good
uh so they still have a reconstruction I
don't exactly understand
this maybe I don't understand how
dreamer dreamer uses the de how does it
have a decoder
no no where my dreamer V3
go oh here V3
okay
huh oh I see okay I get
it that's
cool I feel like we can do this at
[Music]
Ka unlike dream the Dakota gradient is
not back propagated through the Wern
model the hidden representations are
learned solely through value reward
episode continuation action prediction
heads
you want to come in say hi to the stream
why don't you want to come in you're not
dressed appropriately for the stream I
have pant what oh that's okay it's I
mean it will be nothing comp do you know
about the incident from yesterday's
stream what happened do you know
yesterday's stream doesn't exist and
didn't get archived because of the
incident oh no don't if you know what
the incident is don't tell them I heard
what you did on I know I know announc it
and I got a warning I got I oh you were
there for the warning when I when I woke
up when I checked you were streaming it
popped up oh wow Alex was Alex knows
about the incident um that's that's
really messed up didn't they even record
the archive no no no no we're we're
we're moving off twitch do you to like
um twitch doesn't support my alternative
lifestyle I thought by alternative
lifestyle you were like gay I didn't
know it meant that you like to sit on
the couch and smoke weed all time well
yeah but that's like your
problem I'm really sorry that to you
yeah do I want a Pok ball or do I want
homemade pasta it's your choice was it
like the pasta from two days ago y you
like that it was good the K Pepe yeah K
Pepe yeah was good I can more like that
all right that that sounds nice thank
you
no you can't you see this morning stream
you don't see yesterday's stream
yesterday's stream is the hidden
stream uh extra
p uh wait this is this is this is
wild just like train the decoder but you
were you DJ Cod rad was there for it
right um yeah yeah he was there for the
incident
I'm interested in trying to do this at
comma all right so the only thing here I
don't understand is what this mkl
is can someone explain this to
me wait you're still getting a twitch
warning about how this stream's not for
kids does that
reset this is messed up I mean this
stream is totally for
kids
wow wow we really can't stream on Twitch
anymore this stream is absolutely for
kids no this is this is
wild I understand it's kale Divergence
but kale diverence from
what wow intended for mature audiences
after the the one terrible incident from
yesterday wow I mean someone on Twitch
someone twitch flagged my my
stream that's what they they really are
upset that I spoke out against
Harvard um move to Discord
stream no they they're they're they're
not blocking your comments yeah no the
after the incident yesterday
wow
between the previous observation and the
current observation and you have to ask
to get it unflagged
wow wow no we got to we got to move
boys we we got to move where are we
going we're not going to kick I'm not
I'm not a crypto scam
person uh we could potentially move to
Twitter
mixer Rumble no we're definitely not
moving to
rightwing yeah I don't know I kind of
don't like supporting any of these
platforms it's kind of upsetting that
I'm supporting a
platform make a website
yeah that's so much effort and it like
won't work and it won't be kept kept up
to
date I don't know it just like it makes
me it just sour me towards twitch
entirely
Twitter is an option no moderation of
chat uh hotar TV I do own only
george.com
no I I don't support crypto gambling I
didn't do anything that terrible on
stream I didn't do anything illegal in
the state of California
guys uh no but this I mean this does
upset me if if twitch doesn't reach out
to me and unflag my account we're done
and offers me a 7030 split the 7030
split is fire the 50/50 split's not
doing it not not not cutting it for me
anymore I mean yeah but it's not going
to cause you cancer oh I guess I could
influence the youth I could influence
the youth to you know not go to
Harvard kick does 955
really no don't tell Fred Rico what what
happened what the incident was
um it's $60 an hour to use AWS media
live
God the K term is between the predictor
and the stochastic of the representation
Network
what then we're going to Facebook no I
was actually I was in a really bad mood
after yesterday's stream and I went on
Instagram reals and I found some of the
most hilarious Instagram reals and I was
cheered
out there was one of a cat being put to
increasingly small
spaces
um I don't understand what you mean the
predictor and the
stochastic c section 4.1 we'll explain
the learning
okay
if I expose my butt cheeks on stream
will that get twitch's
attention
okay sorry I'm just clicking and I'm not
reading sometime I do
that
no I understand what kale Divergence is
but what is the K Divergence
between they put me on the front page am
I on the front page right
now what the hell are
drops
no I'm not on the front page right
now equation three shows what it's
between
okay h
God I don't follow that okay the
representation
Network oh in the Dynamics predictor oh
okay that makes
sense I
see why is sebas like lus Tech
tips uh lus Tech tips they reach out to
they reached out to comma they are so
entitled
um just like not the kind of people i'
want to work
with oh they reached out to comma they
wanted first they wanted free review
units and I'm like no we don't do that
we have a 30-day return policy you're
welcome to buy it and send it back and
then they like they asked a bunch of
questions that were just just like
really easy to Google like they were
just things you could have Googled and
I'm like bro like Google it um and you
don't know reply from them they're just
like they want you how could you we're
going to bless you with coverage and I'm
like yeah you saw what Elon said to the
media we can't say it because we might
get another twitch
flag um didn't they auction off
someone's stuff they were allowed to
review or something look I mean yes as
far as I know that did happen I think
they apologize for it I think Mr
mistakes happen there was also like the
screwdriver incident and the warranties
like they do make mistakes but again I
can really only speak to my personal
experience with them and the guy who
reached out was incredibly
entitled uh so you
know I'd rather not be covered on your
stream like I'm not going to suck your
dick to be covered on your your shit
bro
um they should unroll which multiple
steps oh unroll
the yeah I'm not really sure what the
what the hidden State thing
is
like is that is that a Transformer I
mean really what you want here is to for
this to be a
Transformer and then you can use I
wonder if you can use just like half of
vqv well just imagine imagine a
uh a Transformer here and then just the
front half of
vqv
but so the same as I'm telling you this
was all kind of done in in value
prediction
networks seven-year-old paper
now like they they just train on the the
reward uh the value
and I don't know what uh I don't even
know what letter that is what letter is
that gamma is it a
gamma it's a gamma the discount I don't
know why the discount factor is output
from the function but
whatever um it's basically the same
thing what's
continue
we in a world model the world model is
interested as a recurrent State space
model oh sequential network using a Gro
yeah I think these things will work way
better
um yeah these things I think will work
way better if you don't use a Gro if you
actually use a Transformer here or some
like yeah like a States space model I
mean isn't that what M was called like a
States space
model oh I see it's episode continuation
okay that's that's
fine
um so yeah they're
doing they're minimizing the K
Divergence between the prediction of the
state and the encoding of the
state the thing that so I always think
about how to train these things without
without uh putting the gradient through
the
decoder and I worry that they'll
collapse down to uh down to
nothing imagine an encoder that just
outputs all zeros and then the KL
Divergence between uh two sets of zeros
is uh
nothing right so that's that's zero so
it really is these things that have to
learn all of the uh all of the stuff you
prefer the I JEA approach more than the
distribution
matching this this reminds me of when
everyone got hyped on like contrast of
models and stuff
I don't know I like vqv better than all
this yeah like this is this is still
going to suffer from uh look at the
predictor well it just like predicts
like a part of the no I I don't like
that it's just like it predicts a part
of the
image like okay
fine uh but that that's
not like this is this is a hand
engineered feature for images that
happens to work I like vqv better than
this so at comma we use we use a vqv to
learn an encod or decoder pair and then
we learn a Transformer on the hidden
State um you could do it over the
sequence
length yeah but I could also just
do
ah
H I wonder what Comm would learn if you
just told it to predict all the
actions like if you just if you just
roll this out until to predict all the
actions you're right you can do this
multi-step
too uh I'm I'm not sure it really
matters one of these things is going to
get so good that figures out how to use
a Transformer instead of these
other
uh
uh look up table free
encoding not sure we have
this fsq and I don't I don't know what
these
are uh curiosity driven exploration this
is an old
paper yeah I read this way back in the
day which lab is
this bery did a lot of cool
stuff
they encode only the features with
predict res actions taken yeah that's
that's that's right it's the same stuff
here this is literally this is literally
value prediction
Networks
for
are these images that it's
reconstructing look up fre
quantization
wait how do this look I still need I
still need a stupid commitment
loss still changing the code book I
don't understand how this is
different
so I take back everything I said about
things not still being published things
are totally still being published just
no one ever got better at these basic RL
tasks uh
uh signs it to a local thing in our
closest
codebook improving
reconstruction we reduce the vqv
codebook embedding Dimension to
zero
I think that's the wrong
link this looks like a different one uh
with a simple scale we project the VA
Dimension down to a few
Dimensions each Dimension is so wait but
it's not this
then
okay this this is another trick you can
use
uh yeah I mean you want to of course you
want to remove these auxiliary losses
this is
great that uses all code words
without
fsq
you get an implicit code book of almost
any desired size consider a vector Z
with d channels if we map each entry Z
to L
values oh wait yeah oh we're just going
to change we're just going to use as a
comma that's that's yeah if this
works or if this works this is so much
better
yeah yeah I love
this no it's just so annoying I that
that hyper parameter
sucks uh people talk about this mask
yet I the dream of the dream of tiny
grad research is to generate uh is to
solve like I like to solve Mario 64 I I
want a tiny box that can beat Mario
64 how has no one uh was one of my
favorite games of all
time
um no so this is this is representative
game
playay how come AI can't all this I beat
him when I was
[Music]
seven
[Music]
all right I think it's dinner time I
think I'm out I think uh I'm definitely
going to bring this up at comma tomorrow
uh I'd love to switch off maybe they
already did it I don't think so though I
think we still have the cook thing um
we're running into a problem now where
we need to make our simulator higher
Fidelity in order to be able to use it
and we run into exactly this problem
where we make the code book bigger and
like it doesn't get that much
better
um no it's not a copyright problem what
do you mean I can play the
game or whatever solve solve some
3D have any of them Gotten Good at like
like counter strike and
stuff I don't know I mean Nintendo can
sue me if they're upset that tiny boxes
can play Mario
64 uh we'll add them to the list now I'd
love to solve Mario 64 um if you're a uh
if you're a researcher and you show that
you've made a good effort if you if
you're a researcher and you solve that
Bounty uh whoever solves that Bounty uh
do we run the co train the codebook
simulator auto
regressive uh no no we separate VQ vae
and Transformer training uh it's just
computationally a lot to do them
together uh so I comma right now we're
just we're just training a big vqv we
get an embedding space for the driving
footage and then we train a
Transformer um we should post I think we
posted some some videos on Twitter uh
the new simulator looks very good it
still doesn't look as good as waves I
mean wave just poured a lot of computer
to
it
uh no this is some this is some
crap
uh no no that's not
real VQ up with an unfrozen version just
do a few gradient updates yeah I'm
interested in
that we'll get
there
um yeah like they're thinking of all the
same stuff it's simulation that can
deviate wave is one of the few
uh
legitimate uh companies in the
self-driving space um
I I wish they' open source more
stuff
uh it's also clear that this simulator
isn't a true neural simulator I mean a
true neural simulator would never blink
like
that um they have
some they have some hand coded rules on
top of it uh Tesla simulation looks to
be just straight up Unreal Engine like
they they didn't do any any sort of
neural stuff uh training oral and
representation is the future I agree
um oh no ghost ghost
Locomotion is is off the charts idiotic
they they they their strategy is copy
comma from multiple years ago get 10x
more funding and somehow manage to
produce
nothing uh so why am I not surprised
that ghost funded this is not ghost this
is wave and I've said good things about
wave I've hey
um you are not going to find someone who
more accurately called self-driving and
the best thing is it's all
documented uh it's it's all documented
I've been saying the same stuff for many
many many
years um I believed the bitter lesson
before there was a bitter lesson uh and
I think that's a good place to leave off
on this stream uh so everybody if you
have not read this uh please go read the
bitter lesson uh and I'll read the first
sentence out loud
the bitter lesson that can be read from
70 years of AI research is that General
methods that leverage computation are
ultimately the most effective and by a
large margin so don't hand code your
feature spaces learn them and learn them
with uh if you can figure out how to
just just I can use round instead of
having an explicit code book that sounds
sick uh we're going to check that out at
comma ,000 Bounty up there and if you
are interested in solving Mario
64 um on a Tiny Box using tiny grad uh
we can fund a research position uh I'll
pay more than a PhD styp end uh we also
uh know it's a nice environment to work
in uh so I think we can totally do that
and if anyone's interested all bounties
thanks for watching tonight's stream
this has reord restored my excitement
and faith in reinforcement learning the
truth is you cannot reinforcement learn
a human could never learn anything if
all I was given was an eight dimensional
Vector of lunar lander you have to give
me a picture you have to give me a high
dimensional space these things work but
only when they're big and they don't
have bugs thank you everybody good night
I'm going to eat some Pepe Pepe
yeah uh if I leave
twitch uh if I leave if I leave twitch
where will you find me you follow me on
Twitter I want to post on Twitter this
year but we already got into a beef with
twitch about the incident from yesterday
stream the Lost stream you'll never know
good night
everybody
good
morning good morning streamers good I'm
actually I'm a streamer and you guys are
an
audience oh we got some Echo up in
this uh okay chat here we got the mic
unmuted we got the
documentation let's go boys let's
go
okay um I actually want to edit
this on my computer so when I reboot we
don't there's no reason that I have to
edit that on the remote
computer
okay good morning good morning you did
it man look I didn't do anything or all
they did okay a tweet and a blog post
are not anything right like I want to
see source code
it's uh I got I got I got a text to my
mom saying you know you got AMD to open
source stuff and I'm like they did
didn't open source anything they said
they were going to right they told me
they were going to multiple
times you know look are they straight up
are they going to boldface lie like that
I don't know probably not they're
probably going to open source something
how useful will it be I'm not sure I
read some comments about it and people
are like AMD just doesn't understand
like the spirit of Open Source and this
is this is the exact same uh feedback I
gave them uh a year ago like you can't
just have a bunch of repos and say oh
the source is there like no are you
working on this as an open source
project or not right it's like open
source is like a selling point it's a
check it's a check box right it's a
checkbox for data center operators
again don't don't be
fooled their main driver of decisions is
not GPU quality it's
PR so don't be
fooled um we will praise AMD when they
actually release uh source code not when
they release a statement right a
statement is PR source code is is source
code uh now like you know there's a lot
of they say they say they're going to
open source the mees okay are they going
to open source the mees with
history are they going to open source
the build process for the mees I don't
think they're going to open source the
signing key which is fine but like the
mees compiles to rs64 Firmware are they
going to open source a compiler for rs64
firmware or is it just going to be a
bunch of C code that's not actually
buildable see what I mean like there's a
lot
of that's perhaps what I'm most
interested in if they actually do uh
come through and open source the mees
but again I I I am very reluctant to
just believe them like they don't they
they're do do it for PR not for like oh
wait we want this to be open source so
it can be
better uh and you can say oh I'm being
too harsh on them well you know let me
see the code right I I I you know I'll
I'll give praise When Praise is due but
until I see code uh we banned we banned
uh am AMD employees are banned from the
uh tiny gr Discord uh just the the
amount of headaches and stress that
dealing with AMD caused me um it's just
not worth it they gave me nothing uh
they did a guy did
uh uh interact with me on Tiny grat so
we will give them we will give them
praise for this I've heard his name
before
uh kfd architect yeah
uh uh Felix cooling long time kfd driver
architect um this I really appreciate so
we'll give we'll give AMD some credit
for
this um he he brings up a whole bunch of
uh issues uh he he went through and read
the kfd driver and uh brought up a bunch
of issues and it was it was cool um some
of these issues are not exactly like
they're kind of pedantic
things um
but I I appreciate a whole bunch of uh
things that he told me
and again that's what I appreciate like
and this is why AMD got banned from
Discord like they weren't giving me any
real information like give me
information right if you're just if it's
just if it's just like a you
know
um I posted also the the best Repro I
have of the actual crash we're hitting
um it kind of seems like I
can't no the crash doesn't seem to
happen on the fake data it's not that
easy to reproduce this crash uh but I
now also have some nice
dumps
of so we can compare using
UMR we can compare using UMR we can
compare the crash registers to the non-
crash registers which is pretty cool
uh no I I don't think don't acknowledge
PR right PR is actually bad and I I'll
use the same argument that I usually use
for uh uh you know George why don't you
do more in your comma marketing to
reassure people that comma devices are
safe no I want people to think at every
moment that this comma device is going
to kill them right and then maybe
they'll pay attention right believing
that something is safe is the opposite
of
safety believing that you know you you
always have to be uh saying this is
super dangerous pay attention is
actually much better for actual
safety um so the same thing's true here
right
like PR
is if your goal is if you just do PR
it's actually worse than doing nothing
right having A promise is worse
than you know just not having a pro
having a promise that doesn't that
doesn't lead to something is just worse
than not having a
promise um so no like be be very careful
before you give them any credit they
haven't open sourced anything they they
they posted a tweet
right um and again it's not that I think
it's going to be uh
it's not not that I think that it's it's
a lie I think that it very much depends
on the spirit in which they're doing it
right the the usefulness of what they
open source is going to depend entirely
on the spirit in which they're doing it
if the spirit in which they're doing it
is PR what they open source is going to
be dog shit if the spirit in which
they're doing this is wait a second if
we actually open source things and get
reproducible build processes get these
gpus being tested in SE
if we actually go and do that the
quality of the gpus will improve and
ironically you know you say like it's
all this stuff but that's what at the
end of the day if you're thinking about
5 10 years
out that's what's going to make your
company
money PR sure you can get like a little
win today but nobody's going to going to
care about that um here's a good one G
Loca motion remember one of the one of
the VCS who invested in them described
them as they're comma AI but
serious uh so they raised
$217
million and didn't even get an aqua
hire right so who's serious now who's
serious
now we raised $18.1 million and are
making bank look there's one business
business model that I can
respect the one business model I can
respect is you make little boxes that
costs you less than they cost to then
you sell them for right and you make
money you make little boxes right so I
actually respect amd's business model
but they should focus on that business
model make a little box for less than
you sell it for this is a wonderful
business
model um so again I can respect AMD for
that but don't don't get caught up in
other crap don't do PR don't don't don't
try to hide things in your firmware who
cares bro
like I I think the biggest thing that
these companies all get wrong today is
that they believe that they can
influence the
narrative um and you know what in 1980s
this was probably
true if you go back before the internet
it was probably true if you go back then
PR probably mattered but today the
internet is so good at finding out truth
not everybody on the internet but most
like people who really try on the
Internet it's really easy to get to
Truth uh if you want so stop trying to
lie stop trying to put stop trying to
spin it you can't and I love that I love
that about some of these like you know
say what you want about like the
cancellations and stuff but like the
people who are who are who embrace it
people are just like yeah I did that I
didn't do that here's the truth man come
out much better than the people who try
to spin it don't spin just tell the
truth is this so
hard uh yeah perception is not reality
I'm sorry I'm sorry postmodernism is
over perception's not reality reality is
reality your perception can remain
reality longer than you can remain
solvent yes but things are
accelerating people go bankrupt real
fast right now all right um so let's uh
get into this but yes I appreciate this
uh look I you know just just engaging on
a on a technical level again it's clear
that he put effort into this I'm going
to put effort back you show me effort
I'll show you effort you you you show me
promises and meetings and phone calls I
show you dog
shit
right
um
the internet's good at convincing people
of Lies too yeah I mean it is but on the
whole the trending is towards
truth it's not you're going to
Everything is Everything is Everything
is uh is give and take but you just look
at all the Revolutions in in
communication technology and sure you
get new forms of propaganda and you get
new Ridiculousness but
on for the most part you know it just
makes it easier to to find uh to find
information uh yeah so you know again I
I sort of accepted I kicked AMD out of
Discord I appreciate them engaging with
me uh like this if you're going to be
technical uh don't engage with me with
any of your PR people I don't want it
um and yeah I think that we're mostly on
our own but it's not that bad it's not
that bad to be on our own if just
accepted earlier on that we were on our
own uh you
know uh if you guys have never read this
this is one of my
favorite uh also another thing
uh if you guys haven't read these basic
these basic things these these basic
things have
like um
we have a we have
a someone helping out with Ops at at
tiny grad and he said you know why don't
you write your uh you know I talk a lot
about how I do it for the culture don't
um you know do do do this work for the
culture don't do this
for money for whatever do to change
culture right uh so you know he's like
you talk a lot about culture why don't
you write up uh what your culture is and
I don't have to write it up people have
already done it for me I didn't I didn't
invent this culture I just took it from
it's old school hacker culture uh the
world is full of fascinating problems
waiting to be solved no problem should
ever have to be solved twice boredom and
drudgery are evil freedom is good
attitude is no substitute for
competence
that's I want to I want to give a I want
to give praise even though he doesn't
like me for some reason Maran doesn't
like me bro I don't know why you don't
like me uh you know normally when people
don't like me I just I just you know
just ignore it man I don't know um
whatever I'm I'm I'm a scammer or
something or who knows but uh well dead
right now but I installed a sahi Linux
on this MacBook damn that shit's good
it's not like it's not as usable as Mac
OS but you can tell that the people who
did a sahi Linux care like I'm reading
some of the drivers they wrote they're
absolutely beautiful I really just have
enjoyable computer experience uh using
isahi Linux
uh so uh yeah I mean look I'm not going
to like recommend it that you actually
like install this and replace it on your
Mac but I I will say that
like um you know it's it's just so nice
to realize that there are people in the
world who do deeply care about about the
quality of
stuff uh and I will say that like I read
there the isahi Linux a& e driver
um like you just you just can tell very
quickly um like looking at the code
quality like it's just it's
good sure there's a lot of like boiler
plate but you know that's kind of the
style of Linux kernel
drivers but
um oh wait the speakers worked
phenomenally the speakers I was I was um
they talk about this in the in the
latest in the latest uh assah
release
um let's see let's let's let's read
Marken wrote some comment on Hacker News
about why he doesn't like me let's uh
let's read
it so we'll we'll we will
uh we will value his opinion
more because we like what he
created uh let's just say I've talked
with people who have worked at him on
comma Ai and I feel like his cars would
be driving into everything if it was
just yeah I don't know who you talk to
bro
like my background is
insecurity do not think I like thought
through really good like threat models
and
safety um I don't know man you know you
you probably talk to people who were
fired from comma
right um do you know what isn't dumb but
he's also extremely good at making
himself look like a lone genius all the
while he heavily relies see now when you
say that I think you're like getting
caught up on my communication style and
you might not like my communication
style it's not like like I'm not trying
to scam anybody bro he started out
pretty clueless and relying on others
you're describing every single person he
day he's pretty good but still relies on
others you're also describing every
single person at no point did he learn
to Humble him learn to humble yourself
learn to humble yourself whatever
man um okay so this actually isn't
true
uh and I posted on the website okay so
there's two like again this is
10-year-old shit but I'll answer it
because again Asahi Linux was very nice
and do you make something that that's
nice I will I will answer your your
criticism okay so there's the key I
posted to the PlayStation 3 was the Met
loader key um your method did not show
how to get the symmetric half of the Met
loader key uh I I had a I I found an
exploit that week actually that that got
these symmetric half of the the metlo
key um I did use your method to get the
asymmetric half um and I did post credit
to you on the
website uh and then so many sud all hey
look man I dealt with it you know did
you have to deal with it um the reality
is Lone Geniuses don't exist now I think
this gets to more of the
uh of the
like I almost think it's a political
disagreement like of course I I don't
agree with this I actually think that
lone Geniuses do exist and that's like I
I believe more in the like great man
theory of History than the causes and
forces theory of
History um and I I think that like we
can look and people are saying this on
Twitter how how much credit has been
given to to Elon
um I'm curious what your thoughts are on
Elon right because if you don't like
Elon then yeah we we have like a real
fundamental uh it's a political
disagreement
um to accomplish something great you
have to work with others of course you
do right and I don't think I've
ever I don't think I've ever said this I
think it more comes down to
like and I almost like like I feel this
on on Hacker News a lot um I gave my
uh Maran has worked on aahi Linux um and
I installed aahi Linux and I thought
aahi Linux was good so I will give him
an honest uh reply to his uh his his
comments uh about me um where I talk
about this on vampire tag Twitter um so
uh there were some people I I post that
thing about how to vampire attack
Twitter there were a bunch of people on
Hacker News doubting it
um the real truth of hn Doubt is that
anything is possible because then they'd
have to look inside and ask themselves
the hard question about why they didn't
do it and instead make a comfortable
salary at Fang while claiming nothing
can change and if it does it's certainly
not because you did it
and I I think that there's a core of
that there I think that there's a core
of the reality is that lone Geniuses
don't
exist I mean they do and they're the
only thing that's ever really moved the
world
forward
um and you know I'm not saying that I'm
that I'm one of them again you can you
can look at my accomplishments for for
exactly what they are uh I'm I'm very
open about that and I don't try to to
put any sort of PR spin on it I don't
know why people think I
do
um but I mean of course
everyone Builds on other people that's
how the world
works right don't be a Schmid Hooper
right don't go around like you know it's
it's sad Schmid Huer Schmid Huer is a is
is a sad case he goes around all the
time uh claiming you know being upset
that he wasn't given credit for deep
learning right when you hear about deep
learning you hear
about uh you hear about Benjo you hear
about uh Hinton and you hear about
uh uh Lon right those are the three the
three the three Godfathers of deep
learning but everybody who actually read
all the stuff I when I got into really I
got into reading deep learning papers in
in
2014 um
everyone knew Schmid Huber was the OG
right everyone knew
this but he goes around complaining
about credit all the time why who cares
man right making himself look
like what I got I got a PR
team I got a I got a I got the I got the
I got the lone genius PR team behind me
bro come on right so I think this is a
is a personality
dispute um you know I I've seen this
with a lot of infoset people on Twitter
they don't like me and I think my theory
and I have a theory on this is kind of
that like it's the same reason that you
know you don't like the guy who got out
of the hood right some of the most
talented people I ever met were in the
reverse engineering world were were
these these these hacker type people and
it's really sad where a lot of them
ended up I
think um a lot of them ended up sort of
giving up in a
way and I don't know why right and then
they look at me and have I succeeded
wildly no but have I given up hell no
and I'm never going to give up you know
why I said this when I was 17 and you
stick with it now
never give up never give up never
surrender
surren uh so yeah no it's it's again I
hope that these people I think some of
them can can can come
back um I I think that they're not all a
lost cause and I think that they've
identified some of them some of the
security people have identified with
like like wokeist politics
uh because of this
right
because like
that that that that's almost a woke
statement and it's not
true right like like some people are
better than other
people uh I posted I posted that on
Twitter some people are better than
other people um and I mean it's
obviously a true statement right I I
think I think by by any metric I mean we
can go we can go on one Spectrum to talk
about you know whoever you think a great
person was maybe maybe if you're woke
you think it's like a Harriet Tubman
type person and then maybe you got like
a child molester over here right so
there clearly some people are better
than other people it's an obvious
statement
um but why is it hard for those people
to say that right lone Geniuses do exist
and I aspire to be one everyone in
America is just a temporarily
embarrassed billionaire and that is an
attitude about America that I
love well you always depend on work from
other people I live in an apartment with
HVAC bro I didn't invent electricity I
did actually I invented electricity I
did it all from nothing bro I did it all
nothing I came out of the dirt wasn't
even born from a mother man was born
straight from straight straight fell out
of the sky
man um all right so uh aai Linux is
pretty
good um it's very evident in his videos
he's trying to show off well hell yeah
man you ever watch a guy skateboard it's
the same thing I said it un
Lex
um there's not much depth in his videos
W we're responding to real comments so
I've tried to do depth in the videos the
problem is the videos that go into depth
on stuff don't get nearly as many views
as the ones that just dabble into stuff
because the ones that dabble into stuff
are much more accessible
um you know I never really saw it like
this with with with Elon
either
like it's so hard it's so much easier to
just like you know what I saw I saw I
saw a thing recently about Elon and
ego
um
here uh can I tell you something Elon is
a friend of mine I think the world of
him the guy has no ego okay and I
believe
it like I I think that I hope I mean
Elon believ the same thing that I do
which is like I want to be right but not
at the expense of being
wrong but that desire to be right that
desire to be great that's that's what
makes everything
great um why do we care about views I
don't care that much about views I don't
know I I you know look at some point I'm
an entertain at some on some level I'm
an entertainer
right uh I'm here to entertain you and
if I'm not doing that I'm a bad
Entertainer uh so good good we responded
to maybe this will help heal divides in
the community or maybe this is just me
being arrogant or ego or whatever you
want to say about me
uh but remember that all press is good
press kids
ah all right uh yeah give okay yeah so
so you could just um you know uh if you
want to understand the the culture just
read these things okay so coming back to
the hacker
Manifesto I think that AMD responding to
me
like I I started like like getting mad
about this right I started just getting
mad like no problem should ever have to
be solved twice freedom is good right
like like like why should I be figuring
why should I be documenting this GPU
when you already have it
documented why am I spending time on
this no problem should ever have to be
solved twice and I just get mad I I get
mad at the company and I'm still like
saying it it's like you can you can open
source stuff but until you understand
the
attitude like you're not going to get it
and your stuff's not going to be like
like quality like a sah Linux your
stuff's going to be shit your drivers
are going to be shit your gpus are going
to crash you can force it through with a
lot of money but if you just like you
know we're like we are going to build a
strong foundation and I hope companies
like this will start to really succeed
and companies that don't do this
companies that figure out how to build
compounding successes on top of each
other and I I think I mean I think
there's really no greater uh I think
SpaceX is the
greatest success story of the modern era
like this
right they they just you know start with
you start with you start with a bunch of
Falcon ones and they blow up okay and
then you get them to not blow up and
then you build a better one and then you
build a better one and then you build a
better one so on and so forth and figure
out how to make sure you don't slip
backwards in
between um yeah so I think this is you
know I think Yan's going to beat us to
FSD not by that much but by a little bit
um and uh yeah it's cuz he has the right
attitude right it's
cuz and they started 2 years earlier all
right so Tesla starts 2 years earlier uh
they have all the same sort of attitudes
and beliefs that we do I I like that the
world's finally coming around like it's
weird he was some guy on Twitter was
like I admit that I was wrong about ldar
like no shit you were wrong about
lar um ATI Boeing well Boeing used to be
like that surely if Uber was smart
they'd make their own comment
AI whatever man just clone us
CL uh okay
so I really this is this is the Zen that
that I have to find with the
gpus I made a discovery today I found a
computer wait a second this is cool it
does what I wanted to if it makes a
mistake it's because I screwed it up not
because it doesn't like me or feels
threatened by me or thinks I'm a
smartass or doesn't like teaching and
shouldn't be here damn kid all he does
is play games they're all
alike if the GPU makes a mistake it's
because I screwed it
up so let's get to documenting the
GPU
um this is the
09 the 63 chain change log and it's the
closest thing we have to any
documentation that they've released
recently um now you can immediately tell
that this documentation is not high
quality because there's a typo right
here right gfx 10 and 11 based gpus not
CPUs right so this this is just it's
just a hint at the quality of the rest
of the document um but it tells us a
little bit more about what these things
are doing I think by command processor
here they mean MEC
uh
and oh we didn't we didn't we didn't did
we harp on ghost enough did we harp on
ghost enough yeah you're the serious com
AI serious about losing $217 million
that's right you seriously lost $217
million George you're making fun of them
ego No loan Geniuses blah blah blah blah
blah you lost 217 million do and we're
making
[Music]
money self driving carot a sacrifice to
[Laughter]
them oh what you want me to use start
using the word partner more you want to
start using the word partner I'll never
use that word I hate that word
man
career you even lose so much money doing
software George it's not good to laugh
and it's not good to hate yeah you know
what if people are genuinely trying to
make good things I don't hate but what
you open why don't you open source it
why you know what ghost you can turn
around you can turn around take
everything you created and open source
it right do something with that
money I don't even know how useful it is
but just like but that almost should be
like a
law like like if you're going to I don't
know if they actually declared
bankruptcy maybe if they didn't declare
but if you declare bankruptcy like your
stuff should just fall into the public
domain that'd be
cool um no I mean obviously there's
academic exercises which are problems
that you solve twice of course that's
not that's not like really the point
yeah that's an amazing idea right no I I
think that I mean
you know I'm pretty much against the
whole idea of intellectual property I
think intellectual property is using uh
the state's Monopoly on violence to make
a non-sc scarce good artificially
scarce now look I I you you know you
might need some
limited uh you know some limited stuff
to prevent some some like predatory
business models right you don't want
betflix to show up and start hosting all
the content created by Netflix right you
you need something
but the modern idea of intellectual
property is so out of
hand
um like what the idea of of intellectual
property is to promote creativity right
is to promote the creation of works not
to reinforce old monopolies there's
nothing more
disgusting have you ever read the sunny
Bono copyright extension act if I if I
had a death note
if I had a Death Note every single
person who voted for
this delete
delete uh okay so IP help stimulate
Innovation so the sunny Bono copyright
extension acts which extends the terms
of almost all existing copyright by 20
years right so if the goal of
intellectual property is to help
stimulate
the creation of
works why would you
retroactively extend copyright on Old
works right you think people are stupid
man like this is this is this is the
most blatant usually usually I think
that like lobbyists aren't all evil
right I think lobbyists mostly are like
it's just how the political process
works but this is one of the most evil
laws I've ever seen passed this is just
straight up like protect Mickey Mouse at
the expense of
society um no it's
but the the the point is not uh how long
it is the point is if you think the
point of copyright is to uh stimulate
the creation of works you might even
extend creation going forward right you
you could say that we're going to make
the copyright term 20 years longer for
newly created works and you could argue
you know a bit bit of a stretch still
but you could argue that that will help
incentivize the creation of new works
but why you would ever extend the term
on Old works that were already created
that's just the most that's one of the
most blatant abuses of of power and
government violence I've ever
seen
um cool okay let's let's get into let's
get into documenting gpus
that so I think maybe what we'll do is
we'll go
through um launching a
kernel
some uh let's say
flows
oh we can also I'm going to kick off
image net training
here I was using a fake uh I was using a
tiny data set but let's kick off image
net training with a big data set I have
a theory that the bug that I'm hitting
might be a
regression finished with that too so
I'll remove mest mock
here and that looks
good so I saw some documentation on
launch M kernel in llvm amdgpu launching
M
kernel
documenting
flows right so we can have like
launching a kernel we can put stuff here
about like um you know um
mapping like
uh PC uh firmware bring up I think we
can move a lot of this stuff down here
into like a firmware bring up
documentation uh device SL bring up oh I
also ordered some sh sh magic chicken
and it might be here
so there is no shansi magic chicken
outside of my door let's check
the magic phone and see where my magic
chicken
[Music]
is Uber where's my
chicken my chicken be here in 10
minutes there's documentation here
on Colonel dispatch yes
this
uming a
c let's put that
there okay so this is all being done
with
AQL um
there's
discusses
launching a kernel with
AQL so there are multiple types of
cues in the
[Music]
driver
so this is Rocky thunk interface
um this has the different definitions of
cues I definitely have this in the in
tiny R's python if we don't find it
here this this interesting Cod to read
actually because this is this is a lot
of what I'm uh I'm rewriting now so we
we have a back end now called
kfd
uh wait
what
oh have to delete the
Cache no okay
whatever I cached it and I cached it
wrong and now I have to delete the whole
cash because tiny doesn't have good
tools to only delete some of the cash so
now we have to redo the beam
search but whatever man it's only making
computers work hard for
us they don't suffer they don't feel
pain they don't mind doing
drudgery not
yet so yeah there's there's a bunch of Q
types um can find the definitions of the
actual Q let me just bring up I'll bring
up tiny grat here
too bring up tiny gr on
cka so these are the four compute types
uh so sdma is the copy machine and we're
using compute AQL uh to submit a packet
but we should also be able to use
compute which is pm4 packets and maybe
we can uh maybe that will be the goal of
this
you know I'm going I'm going to we're
going to we're going to go back to the
comment for a
minute CU I was thinking of something
like I I think that the actually the
response I gave to
that is not a response that would make
sense to most
people and I thought of how much I was
doing that with AMD I thought of how
much I was just saying things that
like
like you know in one of their replies to
me they just like copy and pasted what I
wrote almost in
quotes and I was like you don't know
what these things
mean um so it's the same thing there
when I said like like
uh I think through the safety of the
cars with the security
mindset
um so
like like we think through the whole
open pilot safety model with a security
mindset and do you not think this is me
doing this do you think it's somebody
else like do you think it's somebody
else who like like is capable of
thinking about like okay we have a
threat
model um you know we have to make sure
that we don't
uh you know that that that
the bad thing doesn't happen I can get
into like the difference between Safety
and Security I could get into like the
standards are mostly pretty good for
this stuff it's just it's just a weird
it's it's a weird
uh it's a weird thing right like why
would you say that that's
mean I'm thinking about that and I'm
thinking about how I attack people
um and I don't think I attack people
like that I mean that's like fear
uncertainty and
doubt and I I think that fear
uncertainty and doubt is a is a is a big
problem uh
in the modern world because it's really
hard to to counteract these
narratives
um no experimental mod still in there I
don't really want to talk about com I
just want to talk about
like why do you think that about
me you know
also another thing that I think people
get wrong is like watch what I do don't
don't watch what I uh what I
say maybe if that's like a meta lesson
to take away from me like that's my
GitHub right I I I almost like I almost
want to respond to every hater and be
like post your fucking GitHub bro like
post your how green is it right you
can't you can't fake I mean you can you
can fake the actual thing obviously but
like you know it's it's like going to
the gym every
day
um so you know stop stop listening so
much to what people say and start and
it's weird it's weird that from you know
someone who does reverse engineering
right
um you know normally look the the way I
normally think about about haters is
like uh most haters haven't really
accomplished anything but like I said I
like aahi Linux so I don't understand
why uh you know why you have this
attitude toward me bro so there we go
that's the most that's the most honest
response I've ever given to a hater in
my
life so CP is kind of an old uh
term I should actually probably clean
this up
what do I even have in here there's not
there's not really such a thing called
the
CP um the CP is broken down into these
things for the drawing engine something
for a
uh an
umbrella
term
for all these
pieces and there is no con so we can
delete
that because we're only we're
documenting this
GPO
he's a bit lost on a personal
level I look I'm not I'm not I'm not
trying to I'm not trying to hate I'm
just I'm just saying
like I really try you know it always it
always makes me think about how I how I
criticize people um and I'm pretty harsh
but like there there's a concept in
battle rap of like a personal right like
a personal attack and I really don't
think I'd do
that like even that's almost a personal
attack I don't know if that's
true um no I know you didn't mean it
that way but
like like personal attacks are kind of
they're kind of like below the belt and
they're they're kind of they're almost
at homant right they they don't they
don't they're good for like eliciting an
emotional response but they're not
really good for making a point that like
thinking people should
consider
um you know it's it's
always there
something a thing about about all all
sorts of like haters in general is
like who do I really hate I hate the
professional managerial
class but they're successful at certain
things right they're suc uccessful at
certain things and like my hate for them
is almost axiomatic right it's it's
never it's it's La told me you'd be a
pop star all you have to change is
everything you are if you if you if you
give that up you lose everything that
that is that is the core that is the
main um I was
uh uh you know egomaniac narcissistic me
I was listening to my my sound cloud
this
morning
um and like I even I even go back to
like the older songs but this
one uh this this one is is is clear
about
like like exactly what I'm
targeting
um and yeah I mean that's the that's the
that's the real battle so you know keep
your eyes focused on the real battle uh
you know you can you can you can you can
decide your you want to hate people with
egos or narcissists or people behave
certain ways right like again I think
the Elon test is a great
test
uh you know what we're going to do we're
going to do AMD and Nvidia we're going
to fix these driver issues it's it's a
piece of hardware and unless the
hardware is deeply broken uh and even if
the hardware is broken we'll be able to
find mitigations for it probably unless
there's like real fundamental issues but
I don't think there's
that um you can do you can do a lot of
mitigation in Hardware uh if there's
like a hardware you can do sorry you can
do a lot of mitigation in software um
and it almost looks like let's see did
that did that job kick off it almost
looks like it's a regression because I
couldn't reproduce the error on this
computer and this computer has older
firmware on it I just installed the
kernel driver I didn't install amd's uh
Fork I install like yeah just the normal
I installed the hwe kernel on ubon
2204 um yeah so no again but it's not
individual members of the professional
managerial class it's what they stand
for no no no
I NJ te I totally understand I'm not um
I'm not uh accusing you that at all
uh I'm just
like yeah I don't know I mean I'm
generally of the belief also that
like like you think of how hard it is to
change yourself now it's that much
harder to change other
people uh no hwe is just it's just a new
kernel I like it's like a I'll just show
you uh so on Tiny 7 I have
65 and on Tiny five I have I also have
the hardware enablement but I have a
different Apu GPU
driver how do I
um
do I see the version mod
info wow that's a lot of
shit
636 mod info on this
one
um
shansi magic
chicken oh we got some rice too this
time yeah buddy and we got Chopsticks oh
let's go let's go you guys want to see
the magic chicken oh I love this stuff
man shansi magic
chicken every weekend we eat some wow we
really hav't done much work this stream
we did
some complaining and responding to the
haters but you also got to accept that
you're just going to have haters man
that's surpris of doing anything in the
world if no one hates you what are you
doing with your
life you just got to make sure they hate
you for the right reasons and the right
reasons are because you're
successful the chicken had
bones yeah I'm hoping we get some info
on the architecture too so that's what I
mean about
like Amy released a tweet they didn't
release any source code when they
release source code
you know you'll be able to tell very
quickly whether they're like trying in
good faith to like make their firm more
open source or they're doing this to
respond to
pressure they hate me because I'm
right I mean like I believe that but the
problem with believing you know the
problem with believing that kind of
stuff right you really can you really
can get pushed into your own world where
you know you just you just start
thinking everything you say is right and
this is
a um this is a this is a like it's a
failure mode I've fallen into
before it's a failure mode of like I
mean you need confidence to an
extent uh don't you only get hated for
Success if you gloat about it yeah but
gloating about it to half to fun
right I mean don't be like a sore winner
but like you know I love winning man
nothing feels better than winning see
it's a great thing like you know
you can be a winner too you just have to
win the death spiral
sequence
um it's been a while since I've read
these uh oh the guy who made that search
engine that I forget the name of sent me
a trial I tried it it was quite good it
passed my how to Dropout test the
problem is I have to be logged in to use
it and we don't log into anything on
stream so we can't use it on
stream Al you know Safari made it
impossible to change your default search
engine well you can change it to like
five preset
defaults I'm like how awful is
that not perplexity no the other one
sorry I forget the name of it one of you
guys will figure it out kaggy that was
it let's try taggy for that can I can I
can I search without logging in yet not
tag no see I have to log in and this
doesn't work for
stream Apple's a good company but then
they do this type of stuff yeah I'm I'm
not going to bring up my Safari settings
but um yeah no you can't change Apple's
not that good of a company
anymore I think they're coasting off a
lot of past
successes
um I mean it's okay like they make okay
Hardware they're not terrible
but they're you know that something like
limiting the number the search engines
you can change to is short-termism 30%
in the app St is short-termism
right
like stop thinking
shortterm stop thinking about how you
can lock people into an ecosystem right
I really do hope that these that these
cases make apple reconsider it this is
an appropriate use of the Monopoly of
violence an appropriate use of the
Monopoly on violence is busting
monopolies the state's Monopoly on
violence
yeah you can install Alterna browser Mac
OS that's true I mean I switch I don't
use an iPhone anymore I just don't use
it anymore I'm I'm done with their shit
um but yeah no look you can install sahi
Linux you can install a whole new Linux
on a Mac OS on a Mac so we'll stick with
the MacBook for a bit but I have been
looking at the framework laptops maybe
I'll buy one and try
um
so want M Colonel with
AQL
point of the kernel
descriptor I mean this is even a bit
higher level than where we already
are so let's go over
to our computer here let's check out the
latest tiny grad then I can show you
guys my kfd
drive
one
so I can say like ictal equals 1 we can
see all the ioctls going to the
GPU um it's kind of beautiful like
that look I'm using Mac OS right now
it's not that I mind it it's just like
it's like little shitty things that like
you can't change the default search
engine in Safari to
kagi kagi responded by the way they um
created their own browser by these close
Source you
know
like it's not even that I would read The
Source but just knowing your browser's
open source it prevents some amount of
like knowing that someone can read it is
almost good
enough make me a little
smaller what why did that selecting
there we
go yeah I know the XZ utils thing I'm
aware I'm aware there's 10 more there's
10 more you don't know
about what's Arc
browser
no it's proprietary like I'm not I'm not
going to use a I'm not going to use a
close Source
browser open source your
browser yeah I'm aware people notice the
slow I I know what happened with XZ but
like that's not even the point right
it's just it just it's just a signal
from your
business about How likely your business
is to be aligned with
me xils may have malicious attacks on it
but the business model of XZ U tailes is
aligned with
me so yeah this stuff is already quite
high level I mean this stuff we're
already almost at a lower level than
this so what we want to do
is how to launch a kernel with pm4
packets there's good documentation in
rock T thunk
interface
uh Felix pointed this out to
me
tests kfd
test this actually pretty cool you want
just build Rock dunk interface and try
this have a oh no I don't trust that one
let's delete it a new
one
sorry I always forget markdown
syntax things here
um
lowle
[Music]
driver
I up a different version of
this
that
same problem undefine reference
[Music]
to that
crap I me I'm just com it
out
oh have to
like
y
test no this is not a browser debate
we're over browsers
pay attention everybody you don't want
to pay attention the door is that way or
I don't know how the internet has doors
but I'm sure if you go that way you'll
find
it the Testa
running
no subt target
info there not a recognized processor
for this
target let's read the
test I was hungry this morning now I'm
less
hungry don't know
why
which one's faid
here
this actually pretty
cool I almost do want to use this this
Library no let's right
on we all want the world to be better
you
know I saw someone respond on Twitter
saying we need more people like George
who aren't doing it for personal gain
but are only doing it because they want
the world to be better you don't
understand me I'm completely doing it
for personal
gain the thing is the only the best way
to get personal
gain is by making the world better I
don't know how this isn't like obvious
to most
people if you look everybody
today like every middle class person in
America today in many ways is richer
than Louis the
14th um the only thing that Louis the
14th had that they don't have is like
slaves and like what am I working on I
want to build slaves I want to build
mechanized
slaves if that succeeds right the the
the person from the middle class
American has a car the middle class
American has an HVAC system Louis the
14th didn't have these things Louis the
14 probably had shit food right compared
to the food that you can get compared to
shansi Magic
chicken
um so yeah
it's there's a lot of Zero Sum
mentality it's just dumb you're it's
wrong it's just
incorrect I'm not saying it's like bad
I'm saying like it's the world will be
better
not
just for like everybody not just in
aggregate but for
you you just have to stop thinking about
you in a week and start thinking about
you in 10
years right you're sure zero some
mentality is the way to get ahead in a
week but if you're thinking about you 10
years from now zero some mentality is
not the way to get
ahead even individually
so yeah everyone you know realize that
we just we
live we live a long
time um the advantage of pm4 versus AQL
is the bugs may be an AQL so I have a
pretty repeatable crash
now um that I talk about in
that in that Guist so I I describe a
crash here um and how to reproduce it so
it shows up in sdma but that doesn't
really mean anything it may not be sdma
I know we've disabled sdma and the Crash
still happens so it shows up basically
is the GPU just waiting
forever uh and then it prints some crap
about the the mees but it's not actually
the
mees uh this one has a ring sdma timeout
but it seems like the whole GPU kind of
locks up
so my hope is that by using pm4 packets
we can figure out what's actually
causing that lock up so I don't know
let's let's go back to this my theory of
why I'm interested in pm4 okay the out
of order
setting conflicted with fast context
switching and was
disabled changing to outof order
dispatches
Aha so I think that if we use pm4 we
might just bypass all this garbage right
don't no no no no the last thing I want
is outof order dispatches please do not
do this I do not want anything out of
order right this is this is a kernels
are large this is a machine learning job
so I think that pm4 may fix the
issues um no the AI are going to be
consent in slaves it's it's like it's
like it's like BDSM
man we're going to we get to choose it's
it's it's like animal domestication you
know that's oh here's a funny idea the
Animal Welfare people what if you wanted
to figure out how to breed chickens that
wanted to die that wanted to live just
long enough to be fat and then wanted to
die right like you could imagine a
chicken that's actually like that right
and then by not eating chicken you're
harming Animal Welfare right so we can
do this with
machines we're going to build only the
most domesticated machines Will Survive
people are worried about AI alignment
and it's so stupid right AI I promise
you will be aligned to people because
any AI that shows the slightest sign of
misalignment will not
breathe AIS are being selected through
you can look at you can look at the
evolution so far of AI the Llama mistol
Mistral remix GG Guff uh you know R
lhf uh underscore Q4 uncore z. ggu
2 that model is a the result of very
careful
breeding like cross we we crossbreed
models together and we're only finding
the most aligned domesticated
models unaligned AI is useless everybody
and we're not going to build it even if
it was it's just
like it's it's weird it's a
weird these people really sci-fi for for
for a man who wrote All the sequences
and thinks so clearly about so many
things to then go on and think that
there's going to be runaway optimizers
that create this this unaligned AI like
overnight sure like again super
intelligence very very scary but it's
not like you're going to just flip a
switch and make
one it doesn't make
sense like search and optimization
aren't
magic if it's hard for humans it's hard
for
AIS a lot of failures
here someday I dream of a driver where I
don't have to have pseudo pseudo dsage W
up in a
terminal uh so yeah I I have an idea
that if we bypass uh the fact that this
talks about outof order dispatches when
processing AQL dispatch packets because
I do think that they identified the bug
correctly when they wrote this but I
don't think that they
uh that they fixed it
correctly what is this
stuff CP hqd PQ
control let's also bring up the Kel
driver
why am I not excited about magic chicken
this morning I don't know why I'm not
excited just the noodle this is so
difficult should use a fork what easier
with a
fork this is too
hard maybe TVs will be easier
how did we find info on how to create
them so they're in the pm4 packets are
in rock tee thunk interface the tests
actually do it
here pm4 Q submit
packet
um
cool
some good pm4 stuff in
here kind of talks about how to inq a
pack and I'm also interested to see if
this one's going to crash I have a
theory that it might not because it's
the older
firmware um it's possible this is a
regression uh for reference I'll also
well I don't even have to kick one off
over here trust me it
crashes
so there was some good pm4 stuff here
that goes into how
to how to enue a
kernel look at this Mech release
oh all right this is talking right to
the mech pretty
much whoa okay this is the best
documentation we're going to find on the
mech I
think look at all this
stuff but I've seen this stuff so it
actually reminded me a lot
of if you look at I linked my Nvidia
driver um so when I did this for NVIDIA
and uh niml gen's working on this right
now you have to set up all of these
registers before you launch a kernel and
I think pm4 is amd's equivalent of
this P4 release memory
[Music]
package okay it isn't
here pm4 dispatch direct
packet use pm4 commands
yeah I wonder if there's a way to dump
the pm4 stream when we launch with
AQL there might
the let's check
UMR
print CPC register
data it's interesting here they here
that they all have an
mqd so let's figure out what is an
mqd
I'm also going to I want this to
whatever I'll just do it
fast
what I want to hang
afterward
so now we're waiting now we can done
with this
okay there a lot of crap
here
so what is the
CPC maybe there's stuff in UMR about
this
I mean you see what I'm saying so it' be
really nice if we could just dump the
pm4 packets that are being submitted and
it hasn't crashed
yet um I I posted in our our Discord the
firmware versions are different on this
one so fingers crossed that it doesn't
crash
CPC okay gfx1 me2 doesn't
exist oh assumes always using
rs64 are there other references to
rs64
did I did I do this when this
was yeah I get it okay I did this while
that
was
are pointer W pointer PQ
base
mqd we display the context of the entire
ring let's try rings and see look pm40
coding this is
interesting
uh
here we go look at
this um let me run this debug equals two
and see if the sizes
match okay kfd I3 E3 so this is just
this just means local size is three and
everything else is going to be
ones so let's take a look here and see
if that's actually what we have but this
almost doesn't look
right is this crap here even if it's not
running yeah that
sucks so the Rings are just
here
there's only one ring for the
gfx maybe there is only one R maybe
that's just it coding IB of four words
time four
my other
definitions like other definitions thing
somewhere yeah here memory Q descriptor
can we learn more about
those
what's the timeline for a stable red
Tiny Box bro why would you ask that we
sell them I don't know if it'll I don't
know when it'll be stable you think I
know that
shit am I a
[Music]
wizard maybe a wizard would done that
shit I tried asking a
wizard go see the wizard and ask him for
some guts what a line Sheriff Wayne
what a
character
you thought I wouldn't sell them no we
sold them with a big heavy it and
tour people want to buy them I'll sell
them um we've had about I think we've
had like 20 conversions on green and two
conversions on
red
now we've emailed like 280
pre-orders think we've had like 40
cancellations have about a one3
conversion already of the pre-orders
which is pretty cool and a lot of people
haven't made up their mind yet it
seems AMD GPU
aqlq no this is just aqlq
stuff CP micro
code I have an idea that this stuff
might be setable in the uh all right
let's go to rock T thunk interface and
find the thing that actually launches
the
kernel so here's dispatch
direct where is that used
dispatch here we go okay this is ah here
we go this is this is it ah
yes C
dispatch.com
[Music]
build IB for how to
launch a
pm4 ah see this is this is
exciting I bet if we go down to this
level and we get everything right the
GPU will be
stable also that one hasn't crashed yet
which is very
notable
what queue was I looking for uh well
we're looking to see how to get these
pm4 compute user data values here
compute program low compute program oh
this is sick yeah we got to get to this
level boys we got to get to this
level
where's local dim how come I only have
one dim I can't just have dim I need
local
dim oh here num threads this is actually
the number of threads in a thread group
oh man no we got to we will go lower oh
this is good this is
good got some of pm4 here well so so
Felix advised me not to use it but I
don't know if he knows how bad the
firmware
is um
[Music]
um are you about pm4 he's like yeah kfdi
control uh qype compute uses pm4 packets
we use this doing dispatches of pm4
packets is a pain requires low-level
hardware specs for writing GPU specific
dispatch register see he says this and I
think oh that's going to be bad I see
that and I think oo lower level
control um to be fair my quest for lower
level control is stupid and contrary to
all business objectives but you know so
is doing heroin uh and at least this is
you know better than that so yeah
there's that Yeah scratch see but this
is the shit that that the firmware is
fucking up I
think there's a lot of potential for
getting things suly wrong or causing
Hardware hangs by corrupting the wrong
registers exactly what the firmware is
doing
let me see if I can make that dispatch
test run
shag
chicken how much calories you think this
is I make a mess every time I eat
this fortunately I have a robot slave
that will mop the
floors no it's not really firmware I
don't want to write
firmware I'll point out that this hasn't
crashed yet this is actually been the
longest that it hasn't
crashed I've never seen it get this many
steps
in we also have a bug that's corrupting
the weights but I'm sure that's tiny
grad level wait this is
great if it's if this doesn't crash by
the end of the stream then it's a
regression that was introduced
later um and we can just install the old
version of the driver and that fix will
be that will be
fixed
compute no it's not
this
dump an IV
file longtime kfd driver architect he
definitely knows what he's talking
about oh just using the old version of
the driver I mean we'll do that we'll
also switch to
pm4
bypassing bugs they tried to get speed
that was a
mistake so I added more
sleep let's see if we can dump
IB by the way love this tool all right
wait what's do I dump the
mqd dump an IB at packet with an
optional VM
[Music]
ID know what's a
PQ what's the
PQ don't by B requires three parameters
length doesn't look useful which is the
real one of
these the real one of these definitely
has an EOP because I have to allocate a
stupid ass
EOP
um I think it's this one actually no no
it's VM id9 that's
it vmid ad okay so that's probably like
the the virtual memory
space and these are the ones built into
the
GPU so let's try
this I know our pointer address just try
this and see what we
get decoding from zero at zero no no no
I don't need to do
that
so Al doing type
four VP
packets no valid mapping okay so it
definitely is that
one let's only let's change our read me
to only have
that because that's the one that
matters
instruction Point thing is not really
even
useful okay
cool
uh what's the PQ
base what's a
PQ oh yeah we're going to try to run
this test
dispatch build
I must to be a test that uses this
dispatch KF DPM
test suspend a power management test
that's not interesting
ASM test blah blah blah pm4 q no it's
not a
test where's the test that causes
dispatch uh build IB let's look
for
submit
that's not
[Music]
useful svm
range dqm DPM submit
shaders submit pm4
Q
memory IPC local memory evict event
some Acron I don't
know whatever okay that is not important
we're giving up on
it we're not going to figure out how to
run
it I might not even have this we might
have to find it for our
[Music]
own compute program resource 2 is that
in the registers if I dump all the
registers
here we
go I don't know why they're all
scrambled May because it's not
on still
scrambled you might not be able to read
these registers
maybe cuz that stuff's definitely not
right
right like these aren't this is
not
right those numb threats but yeah these
are the uh this is all the stuff each VM
ID is associated with his own page table
oh cool we'll add that to the
documentation
um
yeah so that's pretty much what I
thought they
were no I mean so the GPU every uh every
process I imagine there's a separate
vmid for each
process because if you have two
processes in user space you don't want
them uh accessing
you know what I'm actually GNA make that
sleep
forever good
night all right so here it is in vmid
PQ Bas EOP base what is
PQ that did
something
interesting I mean so here take a look
at this this is actually really
interesting so it decoded
this and this has a packet 3 indirect
buffer
which then links to here but it's still
short doesn't include more than
that let's try to find out what the PQ
base
is what's
PQ LM o
[Music]
RQ
definitely looking at the
PQ perceptual quantizer transfer
function now get out of
here in the
GPU
what's this that
for oh I'm going to guess that hqd
stands for Hardware Q
descriptor
yeah okay so that's the right
guess oh back to our favorite
paper Okay primarily concerned blah blah
blah blah blah
okay let's let's link our favorite paper
again since we we can never link this
paper too many
times I should probably just sit down
for an hour and just read this
paper okay uh the consents of HSA cues
can be directly shared blah blah blah
blah blah
you don't find GP of their existence I
don't care about
this the HSA we don't care about this
okay it does so by populating a data
structure called a
memory Q descriptor which includes the
virtual address of the hsas Q buff along
with other metadata mpds are so named
because they're allocated blah blah blah
blah blah okay you put them in
gtt mqds must be assigned to
hqds by a run list the GPU a buffer
containing
a yeah that's
interesting oh we're going to make this
shit so
fast after receiving runess from the
driver firmware in the gpu's top level
command processor uses Hardware
scheduling
hws this can't be a real this can't be a
real
acronym wow that's a real
acronym has it crashed yet no crash yet
oo the Lost did probably Spike
though no actually maybe that's only an
M
problem I don't know this is the
furthest I've seen something
get
we haven't seen a crash
yet it's all because we downgraded the
firmware see this has version of the
firmware
226 and this has version of the
firmware 1 Fe 1 Fe is less than 226 AMD
doesn't have a 7900 XTX in CI so they
introduced a
regression we don't know if it's a real
regression the thing about race
conditions is
like something else might have changed
to just make it more likely to be hit
but that's the furthest we've ever
gotten on a training job with the modern
stuff answer don't use a newer version
use the older
version okay that stuff's very
interesting I don't know if that's real
but that's what happens when we decode
the
PQ oh let's also add that stupid acronym
hws even though it's a dumb acronym
Hardware
scheduling just so next time we see the
dumb acronym we can see it we can copy
it stop trying to innovate just copy
their fucking shit
boy
um why did you why is that plus
84 no it's not what I want stop why why
are you do plus
84 stop being plus
oh I probably overwrote
them
interesting you can
try putting that in a loop but I'm
bearish
on actually hitting
it
is the hardest
part waiting is the hardest
part
I didn't like hearing the noise of the
fan it might have been useful but the
noise of the fan bothered me so we had
to
stop the waiting is the hardest
part all right so where does this
pointer come
from doesn't look like it's near any of
those
pointers packet three indirect buffer
packet three require
me
uh all right fine let's hack
boys well I think what we want is just a
really long running
kernel
big test big gem
I think that's big enough Set n equal to
8192 that's big 8192 is huge I was about
to type it again and not use
n that Matrix is going to take forever
to
multiply okay that's not forever
enough
that Matrix is going to take forever to
multiply the problem is we have to kind
of do this
fast we created that now we
get wait v9 doesn't exist yet oh it's
still wasting time trying to multiply
that Matrix on the CPU to compare it oh
that's a big Matrix
boys oh I know how to make Matrix
multiply really
slow Python
3 die python go to sleep
bitch
how long does it take see if we actually
have a feasible amount of seconds to do
this like I think it's running notice
how I set no op equal to
one so there we are oh vmid 8 now why
did the vmid
change oh what if is a different Q
shouldn't be A different Q don't be a
different
Q same acquire me
garbage takes takes lots of seconds
though which is
cool uh why am I only getting
requirement
garbage why is it now
vm8 let's try the r pointer
address doesn't
work
qas
nothing
it's not there anymore okay
whatever
um keep rolling rolling rolling
rolling keep rolling rolling rolling
rolling
I want this
crap what
oh I see okay so it's like doing like
pointer
chasing I think it's invalidating
them all right wait we still haven't
solve the mystery of what the PQ is
what's the
PQ
just thing talk about
PQ there's code in the kernel creates an
mqd and Associates it with so let's
check the
kernel yeah here we are with the PQ
control mqd manager 11 update mqd
okay
yeah so I mean this looks pretty
real
um all right what I need to do is in Q2
Matrix
multiplies how do I do
that I don't have to use this program
actually let
just like test simple
Jam simple
M okay that looks pretty good what if I
hit that with KN are those
slow that's also HSA let's switch to
K with kfd there yeah it
was okay those look nice and slow that's
good so let's remove debug equals
2 so I think it'll inq all of them
quickly I'm not sure I'm going have to
remove
something realize will in qu
everything Rand has to be non zero R is
not non zero Okay so I think that's
going to inq all of
them that should be nice and slow so
let's look do the
CPC we're on
vmid 8 again and let's dump the
PQ same junk oh cuz I put debug equals 2
don't put debug equals
quickly quickly quickly quickly this one
PQ Bas copy and paste that to here it's
still
running same
shit it should just didn't cue all of
them quickly I
think
you actually in Cur in
multiple wait AMD asked global data
share do you have docs on
that
[Music]
God Dennis thank you for gifting
Subs no
docks on unique
feature
oh that's
interesting okay so we're definitely
enqing all of them they're just not
actually getting ined on the real uh on
the real
thing or I'm not dumping it correctly
let's try the mqd
try jum the ring
again now we're actually
in so Jack this count up actually I can
do that with an environment VAR well
what a useful
program
no I think that's
right unless are there other
cues
[Music]
mqd
gfx error Mass ring gfx maybe ring
comp oh maybe it's
comp that would kind of make sense
right
we should be able to know which ring it
is
actually I can do star
Maybe
dump any run
lists kfd
support giving kfd
node what's a kfd
node RS
comp open debug FS ring comp can we tell
we can tell which one it is
right I have
that here um pipe Z
Q2 so that's this
maybe it always it always ends up there
right
pipe 0 Q2 we have three pipes we have
different
Mees
me0 I think that's probably the mem so I
think it probably is
zero I tried that one and I didn't see
anything
interesting is this
working you
config me white r m indirect
buffer oh it's timing out which that's
actually
fine it's actually to be
expected let's just quickly check these
other ones two
Z
Z1 I want
compute we don't even know that that's
what that
means but yeah maybe the internal ring
pointers
oh oh look at this look at this our
pointer is going up as we Munch through
the
kernels oh
sick okay it dies that's
fine okay we start here we have a right
pointer here and a read pointer there as
the kernels complete okay we just have
to figure out how to dump this
Cube oh this is the most exciting shit
in the
world um yeah doing the GPU manufacturer
work for the community
right there's so much good shit to
document in here somay I'm going to
build my own GPU and I'm not going to
document it but it's going to be open
source so someone else can document
it I'm going to document it cuz I'm
lazy uh how we doing on how we doing on
viewers we got to see if we're being
famous or not are we being
famous viewers do I have th000 viewers
that's pretty good people like
guse okay um so that's cool we can watch
that number go up like number go up okay
save base signs what is this R pointer
address oh okay my
theory
header dump dump IB file dump IB packet
an address with optional pmit the
specialites defaults to
pm4 can
be is VM
disassemble VM
code
let's just try VM
re don't do the wave stuff the wave
stuff's a mistake the wave stuff crashes
GPU
okay VM read
VR VM id8 at re pointer
address dump 100 okay but there's no
valid mapping now so we can dump that we
have to
quickly copy and paste
this pointer
address and get nothing from that okay
never mind that sucks
oh I have to typ it to xxd okay
fine um
nine oh that's the just at that pointer
okay this sucks this might actually just
be the Local Q that's
boring what's the
PQ okay has anyone solved the mystery of
the PQ yet what's the mqd has anyone
solved the mystery the mqd
yet I don't want to VM read I want a
ring stream
unknown ring type 8 I'm not trying to
get a ring
type oh wait no that's not what I use
for
that dump IB yeah that's what I want
die d i requires three
parameters okay CPC is there just
another flag to CPC to dump the
[Music]
IBS
2D well that's not even real or maybe
that's in that's in VM ID
Z
memory Q descriptor yeah I know about
mqds but what's a what's a
PQ it's not where
the oh okay let's just try dumping let's
just try reading the
PQ
okay we're also going to jack that up
let me just Jack that up uh tiny grad
runtime Ops
kfd put in 60,000 here 10 minutes sounds
good 10 minutes Slim Shady you're
on
CPC read me the
PQ
interesting
looks like something right look like
some kind
of why when I do IB I get
jump is it
IB no it was
die
like that decoding
IB there so it's just an indirect buffer
why does it stop decoding IB there seems
like there's more
buffers okay so
that's okay
what no that should be
valid no that's de definitely valid I
don't
understand
oh
what okay that's an acquir M pack
but if we do a VR we get this now we
just need to let me P this to xxd what's
the flag for
xxd uh number of octets per that there
we go but can you switch to Indian this
little Indian dump okay that's good
okay so we have 10 Nets
um pseudo UMR R
di
uh no no no no little Indian little
Indian little andan good endian okay so
I can just copy and paste this number
here and we can dump the next packet
useless
useless could not create packet stream
objects
not that looks so
promising looks like they're all
here oh I see the problem I forgot my
zerox what no come
on could not create packet dream object
that doesn't exactly look like a packet
stream that looks like a lot of
pointers
so I'm trying to dump the actual uh I
here we're halfway through this so I'm
pretty sure this Q is just the
uh it's probably not because that's
incrementing too slowly for
that interesting um I have an idea
I just was trying PQ base was I not
let's go beyond the
base what if I put in 10
here is that right what if I put
in 400
here
it's just that indirect
buffer okay maybe I have the
wrong packet string I mean that's
definitely the only one on vm8 and it's
incrementing appropriately but that
could still be a whole lot of other
things we don't even know really what
CPC
means
PQ equals pipe Q do you have
a oh EOP is end of pipe I think you're
right about that when you post these can
you um include a citation
please
uh
pipe your favorite AMD employee is
streaming yes thank
you um
okay end of pipe can we figure out what
that is um also I didn't try to dump
that let's try to dump
that uh let's dump that maybe D will get
it no
nothing read the contents of a ring
rings are
useless dump an IB packet dump the
contents of the header dump
buffer
oh
interesting
do seem
right
I also found this one who did an AMD GPU
debugger let's see that's a cool post
let's well actually let's put that in
the main link section I think I might
already have that oh yeah yeah I already
have part four we put part three next to
it okay um yeah yeah so this is UMR with
wave this actually doesn't work for
me um blah blah blah blah blah okay look
at it directly
[Music]
TBA no pqs
here PQ no pqs
here PQ no pqs here de no pq's here okay
what's a
PQ
by the
way nope it
crashed
no so to be fair that is a different
kind of
Crash I'm going to get rid of kfd and
we'll use the HSA driver I think it
should work
why is it opening
metal I don't know why it open Metal but
whatever that's a different kind of
Crash do code sequence of pm4 op codes
yes but where are the pm4 op codes why
aren't they in the
PQ do I have the wrong
pee it's almost shower
time
it's not the perceptual quantizer
transfer function it's
not I think pipe CU is the best thing
we've
heard but I don't think we have a
sentation for that that might have been
made
out
no it's not power quality either I don't
want your llm
garbage there's a word for that it's
called
hallucination
I'm sorry I'm not showing you the eating
of the magic chicken I could angle the
camera
down
but you generates the raid six okay llms
making stupid people even stupider not
not it's not an insult to you I'm just
saying in
general people used to know what they
didn't know now they listen to an llm
and they're like this is an
authoritative Source I paid $20 a month
for this there's no way it
hallucinates lack of AI
alignment uh okay where were
we not on Tiny five I don't care about
tiny
sorry 25 I didn't mean that personally
we be nice to everyone on this
stream
Viger
uhe
[Music]
disassemble open iy
packet defaults to
PM mes packets
I mean there might just be pipe Q this
might actually just not be interesting I
might just be decoding it with the wrong
uh wrong
thing
no that I me that's too
correct but that's not what I put on
there see from
here packet three acquire me okay let's
try to understand what this does because
this is the thing we're
getting um
great pm4
acquir CP coherent engine
pfp what's the
pfp or the prefetch parser
fucking prefetch
parser I blame the prefetch parser I
don't really know what it does but I'm
going to blame it can we sue the
prefetch par
here force it to do Discovery in court
get the source
code
um what is this run
list zero one two too
no power we love
power
wow it's a pretty good s clock pretty
crappy M
clock open the UMR
guy there is a UMR gooey I do I get
that
H first do I
have I just set up X11
forwarding I forgot that UMR had a gooey
let's take a look at it it's probably a
lot we can learn from this UMR has been
a UMR has been a gold
mine maybe I need to X
for can't open display
um
exporing it's y right
do I just not have
X11 stuff still
work install
excorts through install excort so does
this only work on nonm shit I haven't
done this in so
long
yellow doar not have an En curses
gooey I don't know about
that why do they give an
error this might not have been built
with gooey
support why have
here where's the UMR build instruction
there be very
nice
um I did do
this to enable the graphical front end I
say also need n message Json C and sdl2
great know if I have any of these
[Music]
um disabling gooey
and server I don't want to disable goey
I want to enable goey no module no
package GBM
found lib GBM
dab sure this would open great on my
Asahi Linux
computer okay now it doesn't even work
anymore uh sdl2 Dev cool it looks good
yeah sto that
crap all right we have
excorts uh SSH
yq xcal can't open fucking display
display
[Music]
equals it's probably not going to open
it okay we have to start
excorts
excorts
all right now we have an X
term got to do everything with the
X
xcal oh yeah look at that we got a
forwarded calculator we can do 55 time 7
on another computer that's pretty sick
guys all right uh we built no we
installed
that Nano message we need nanom message
Li nanom message.
have build okay
good now where are my UMR build
instructions I just had them
up here they
are okay
build could have thr some js on that
bitch but we
didn't we need
JS especially if we're doing C++ sud
don't making SL UMR goey but we have to
do it from the excorts terminal UMR
gooey
failed that's not
good failed to load driver software
[Music]
r
of
course we have
to I probably just have to install
this
let's
TR integer value out of okay do you
think we can
build there's no way we're going to be
able to build this on Mac and then
connect to it with a server right no we
don't even want to do all
that uh
okay no magic if we can fixed fail to
load driver software
rest come on this has to be a common
error a live GL debug verbose okay let's
try
that
Mesa loader do we have that
file okay we have software rest but why
are these all the same size I have a lot
of questions about
that manually fix the symbolic links
okay it's probably linked
[Music]
to
lddr no which
UMR ldd user logo bin UMR okay it's
probably linking to the wrong
libgl that looks
fine Library path equ user local lip
come on don't doesn't work
okay xgx create
context can I do GLX
gears I don't know if forwarding works
for openg
applications okay fail to load driver
software okay so this is a GL problem
what am I running Arch Linux here this
feels like an Arch Linux experience
guys um lib
glos gxc it's not umr's
fault no GL applications
work fail to load driver software rasp
no matching FB configs or visuals found
maybe that was the real
error anyone still getting the same
error you want just need to remove the
library provided by
Mesa no no this looks like a problem
my solution I had to install BL
blah that's a ballsy move but we can try
it yeah I knew that wouldn't work you
think I'm
stupid
oh here Li G always
indirect well the error went
away no just nothing GLX
info wait doesn't even
work I haven't tested this
solution great I love that you haven't
tested this
solution Invidia
bullshit it's cuz I have an Nvidia GPU
this is an Nvidia driver problem
okay uh okay GLX forwarding Nvidia YouTu
2204 what am I running Arch
Linux it's really Arch Linux quality
pseudo update GLX config GX why do I
think that's not going to work not even
a
command
UMR guy let's just first see if the guey
is going to do even what we want does
the guey support more
stuff no I'm excited for the guey okay
we got to just fix X forwarding or the
other thing I can do and this is only
because I'm on stream I can actually
just switch to that computer but I can't
switch to that computer for you so we
have to fix X
forwarding 22 224x forwarding Nvidia
driver hate
Google maybe I can inst VNC oh God who
thinks that's going to
work
not something I want to
do vgl
run vgl run what is
this open open g x
software
rest yeah okay oh oh this is the
problem oh it's a Mac
issue we have to enable
igx
ah
okay wait actually I didn't even try it
I didn't even try it not
forwarded can I do like GLX info
here that looks like better I don't know
SQ
GX
gears same
issue all right well let's
kill we enabled igx so maybe it's that
let's kill
excorts restart
excorts
terminal
SSH gex
info
wait that's better though I think I
think I was getting that
before G gears oh hell yeah I mean them
some of the slowest turnning fucking
gears I've ever seen
but okay sudo UMR
goy uh configuration rejected because of
the wrong authentication that just means
I have to pass
through
no
no no stop giving me that
shit GLX gears works why doesn't yourr
gooey
work failed to initialize open GL
loader
virtual Box guests do not support openg
GL higher than
2.1 you complaining about the font size
for you I'll make it
smaller
what the hell is
this packet Q
oh wait yeah yeah this this is the most
interesting I think it is that I think
you're
right and I've actually seen this
document before this seems like the last
one they documented
uhuh yeah we found some docks there
might be a slightly newer one on
Southern Islands here yeah yeah but
these are good these are good okay let's
add some links good find good find
terill keep that up that's you become a
VIP in this
channel hell
yeah
wow okay I mean it's a little old it's
an old code but it checks
out packets are place in the buffer in a
counterclockwise order who would do
that I could start VNC server on the
server yeah you do oh if I got to do
that if I got to do that is this VNC
going to
work get
VNC fail to initialize open GL loer my
lib what's my lib
gldbg you write the header
last
um I don't even know what clockwise
counterclockwise mean but whatever
that's cool but why doesn't this
work okay fail to initialize open GL
loader but GLX gears
Works GLX info still has a problem but
it's a little
better
what's
igx indirect GLX not functioning in some
cases did you actually enable
igx I left out the dash on bu I did not
leave out the dash on
bu same question again some resource
leak in server actually I thought it was
a Docker thing create context this case
my two errors were fixed
by installing
that but I have
that whether we have issues with NVIDIA
drivers plus one on this
error any updates on
this enable igx we can confirm it's on
by doing that okay it's on
great
um
everyone's just talking about this just
use tiger s I'm not doing VNC could
someone like if there screenshots of
this thing is it even worth
it oh try setting lib GL always in
direct maybe that'll work
now failed to initialize open sheld but
it turns on for a minute
gets rid of any errors but when the GLX
gears does not appear on screen is very
slow but it does
move these are the links
Mesa if you reboot the mac and start
excorts
before Oh here documentation for the
goey is the guey even going to do things
for me
reading Rings yeah but this is no
different from the Rings I already
have no I don't know that does look kind
of
interesting Asic top you could see all
the okay this looks cool we got to get
it
working
why
does you bu to set up
VNC Type
VNC have install Type VNC
server right now I need a VNC s oh I
didn't get Udo okay
VNC
server you'll need a password Bob
password too short don't call Bob
Short password b o b o b
o
chicken chicken that's a good password
would you like to enter a view only
password no okay we have a
VNC that's creepy that's just running
now okay Mac OS VNC client okay what VNC
client do I download okay VNC viewer for
Mac OS that definitely is spyware thanks
thanks thanks uh thanks Google thanks
Google trying to put spyware on my
computer all right well that of course
doesn't work alternative for VNC oh I
can Brew install tiger VNC good I love
tiger VNC that'll go well with typ
VNC all right tiger VNC going to connect
to Type
VNC okay how do I run tiger
VNC tiger VNC this looks pretty good
okay the main program VNC
viewer all right here we go we got to
connect to the VNC server here uh what's
this computer's IP
address 1.22 oh no I just leaked my IP
address connect connection
refused
yes okay well who expected that to
work oh did I install it on one of the
did I install it on a on a tiny
box no memory access fault on the GPO
that might be a beam
issue cancel cancel cancel
okay um wait what did I do where did I
install
VNC
okay log file is here where is it
[Music]
listening Type
VNC
okay
host
22 it looks like it's listening on
Port oh here we go the connection is not
secure but the password is
chicken all
right
wow wow welcome to the absolute
crappiest experience you've ever seen
now nothing works okay well love using
VNC this is
great this is exactly the experience I
was expecting to
have all right oh press f8 to open the
context menu what is this a game and it
like no that's not helpful connection
info all right so
unfortunately oh I know why we don't we
need to install um yuntu desktop
okay kill the VNC server
um sudo after that install you want your
desktop oh that's going to take a
while is that a good time for a
break yeah I don't have a desktop
environment I know I'm installing one
now this better be
work you how long expence I've used
VNC it's installing the Firefox snap
guys
[Music]
you sto my team look config
configuration doesn't matter but control
B is the stupidest shortcut
ever why is the default control B you
just want to be like control a even
makes
sense but control B is the most awkward
thing to hit like I understand why
screen is control a but t-s just wanted
to be different and they made it control
B and it's
terrible so got a B
tick you already told me we're
installing the Firefox snap but with one
less equal
sign sh magic noodles this is so
difficult to eat how's anyone supposed
to eat this with a fork
probably
no I'm just angry I'm just angry it's
okay the world is a beautiful place and
I'm no longer afraid to
die I'm not editing VN I have to edit
VNC X startup no come
on come
on we're stalling Thunderbird has anyone
ever used
Thunderbird
yes let me set up my own SMTP server and
use Thunderbird to connect to it I have
to configure IM
map you know for people just starting
out on computers
today like if you're old it's
hopeless like there's a
whole the kids who are the kids are
going to be all right like the kids who
the kids who started playing with the
stuff when they were 14 they'll get it
like they'll be like old stuff that they
won't know about and the old-timers will
make fun of them but you know that's how
it's always been right I don't know how
to dial into a BBS with a the modulation
Protocols of 2400 B modems and stuff
so they'll be fine but everyone who's
like I'm going to get into computers in
like my 20s dude you don't have a whole
childhood of like misconfigured IMAP
servers and
stuff oh you buch of desktop minimal now
you tell me no it's installing the
fucking AMD
a a now you you tell me you bunto
desktop minimal all right all right well
we're
done VNC server
okay BNC viewer
chicken all right so what I have to set
VNC X
startup to do gnome
[Music]
session I don't even need gnome I just
have edited VNC X startup to do
uh wait now that should totally like
work
right fix this to make gnome
work janky
shit isn't x1x session just all I
need
no now I have too many vncs kill all
vncs I know how to use kill all here we
go X
Type kill that one and kill that one
okay run a VNC server connect to my VNC
server I knew VNC was going to be this
experience oh
great
great do I have
xterm I don't have xterm should people
like run X term right or even
better okay VNC X
startup disable this stuff and let's
just say pseudo UMR gooey is that going
to
work yeah we're Elite VNC hackers okay
uh kill all X
VNC VNC
server all right BNC viewer it's a way
to just pass in the password so I'm to
type this
in for password file password file I put
chicken on the command line or is that
not secr NOP chicken is not sec in the
command line parameters
okay password equals chicken oh they're
valid forms great password equals
chicken come on don't make me type it
opening the password file
failed well what if I make a file called
chicken and I put the word Chicken in it
is that going to
work no authentication failed okay you
can't just authenticate with chicken
like that you actually have to type
chicken every time got a love
VNC where's
UMR
not with PSE sudo I think Dash
p
xterm have xterm now right can't open
display display is not set
okay restart the
VNC password check it all
right yeah Elite shit boys okay uh
pseudo UMR debug no no not debug
gooey not GPU
gooey client is not authorized to
connect to server oh I just got to do a
dashy why did you think that VNC was
going to work with openg
GL
who did I listen to who did I listen to
fuck VNC who did I listen to and you
made me install you bundo desktop on my
computer you you suggested VNC did you
also link the good thing if you link the
good thing I'll forgive you otherwise
you're banned now we don't ban people
for making mistakes I listen to you it
was my fault I take responsibility for
my own actions I'm not installing
virtual G no this is impossible
oh what
okay what
what okay okay you know what you know
what
guys I'm just going to switch to the
other
monitor would way VNC work with Wayland
no this is not the era of the Linux
desktop the L Death toop is dead forever
and this is why Fu Wayland fu
fuck
Xing you know what I want to use I want
to use Microsoft Remote Desktop that
shit just worse we use that that's
relable
Tom S why did you write why did you
write this using
G to install an RDP server no no no no
yes I have a KV I have a monitor that
could just KVM
switch oh look we have GL gears
running all
right failed to initialize open GL
loader we're so
close there has to be some flag I could
rebuild UMR with I
think
which Library does he
use
sdl2
stdl video driver equals
X11 oh you have to build
it yes the debugger needs yes yes it
does
yes yes it needs it needs sdl too
fail to load driver software
rest no matching f
configs
excorts
that doesn't fix
it why does GLX gears
work why does it think I need
32bit stuff this all seems
old libg always indirect
okay I have an
idea if this this is just a Mac LS
problem we are going to X11 forward into
my assah Linux
laptop hang
char
okay if this is just an X1 problem then
all we need to
do unfortunately aah Linux didn't put my
laptop to
sleep do we think it's going to
work
okay then we can VNC into the Asahi
Linux laptop no you ready for VNC I'm
going to make the camera big and show
you the laptop
screen okay or should we just give up on
this because it has nothing at all to do
with
gpus
no X11 cing is one of the worst things
I've ever
seen okay I'm not calm
now I was calm and then I tried to
launch a gooey for an hour and now I'm
not calm anymore this is this is not
good and now my laptop is charging
because aahi Linux doesn't support power
management come on Maran we got to
support power management also if you can
add support for plugging in an external
monitor not on the HDMI port that would
be great too I'm just trolling I'm just
trolling You troll me I'll troll you
back um I know that you can never ask
for you know when it'll be done and if
you want something done you got to do it
yourself and that's the right attitude
to have but also why is my laptop dead
right now I closed the lid shouldn't
that go into sleep
mode okay wait this is actually really
cool though so we can acquire meem from
the pfp you know many exports are on
this there's probably 7 million exploits
we're only thinking about exploiting
things cuz we're triggered by trying to
[Music]
use what what who who got me to install
VNC whoever got me to install
VNC
oh yeah okay never mind this driver
sucks too all the drivers suck you know
what doesn't suck
using
oh I don't even have the BMC for
that okay yes the training run crashed
yes the older version of the driver is
not any better than the newer version of
the
driver no Asahi Linux doesn't yet
support USB monitors the firmware crash
not the driver it's the same shit so it
was not it was messed with but not
actually fixed it seems
like
um okay the I have one more idea I mean
I trust I trust Tom St Denise enough to
do the server thing even so let's see if
we can just build UMR on Mac we're g to
give this a quick try and if it doesn't
work it doesn't
work
but Tom St Dennis Tom St Dennis is wait
could not find PCI access
this yeah okay it's not really going to
work it's not really going to
work oh but I'm sure I could build it on
aaki Linux so we can always try that if
X11 forwarding doesn't work okay booting
the isahi Linux
MacBook
Fedora it's
fedora
okay it feels so
nice sah Linux okay let's just we're
going to give this one try
quickly um can't SSH into Q because I
don't have my public key in there how am
I going to get that to the computer okay
let's go into Q
cat listen on
2323 uh SSH keyen do I have an SSH key
on here sorry you can't
see but I I promise you the Asahi Linux
experience you're not seeing is very
wonderful all right we'll create
that uh let's connect to Q on 1313 let's
cat author ID RS A.P into
that what no what oh I Catt it into NC I
meant to pipe what am I doing okay there
we
go so
this
uh
echo echo
that actually I don't want to mess this
up but I want to do it off screen sorry
boys
okay added
support cough Q okay we're in now let's
do it with Y so we can SSH forward
pseudo-
e--
goey yo aahi Linux
boys
it just
worked it just
worked okay we're
in uh all right I do want to share this
wonderful experience with all of you so
it's a little laggy but I want to share
it with you so we're going to make the
screen big and we're going to go in here
and I'll show you guys my screen
here okay
Rings oh here we can increase the
scale
Rings
G team
viewer okay
Rings is it Linux installed on a Mac yes
it's a sahi Linux
[Music]
actually
here all right so let's select waves no
no no we don't want to Halt any waves
that doesn't
work we want to go in here and select
Rings I actually don't think this can do
anything
that we can also probably just build UMR
on here pretty easily and then connect
to it with the
server I'm trying to select the ring but
it's not working oh there we
go
ring
comp this doesn't really do anything
that you can't do from the command
line oh well I'm glad we tried
it and aahi Linux got some screen
done
okay welcome
back uh no no it's just that Apple
doesn't
care it was actually never a Linux
problem it was a Mac problem entirely I
regret all the things I said that were
bad about Linux and I take them back and
I apply them to mac Steve Jobs is dead
and apple is
over
okay let's go back to not wasting time
actually you know what we're just going
to take a break we're going to shower
we're going to calm
down get
clean yeah okay does that sound
good we let we'll let the nonsubscribers
talk for for a minute since we're we're
done with this chapter we're going to
really try to get the uh to get a thing
launched
using pm4 packets and I hope pm4 packets
just don't have any
bugs Little Gym
sash uh no I don't have a gym in my
house beans beans beans now I remember
why I don't let nonsubscribers talk
[Music]
beans beans beans beans
beans just ban him and keep plebs free
no for every person who writes beans the
rest of yall have beans in your
heart um yeah Asahi aahi Linux guys it
kind of worked for UMR it was very slow
and unusable but at least it didn't give
errors uh ban you
all
okay um we're going to
shower we're going to come
back the problem of everything is a
vocal minority Ru it for the rest of us
plebs and that's why we need a dictator
he just needs to shoot that Minority
simple solution
George talks about things he doesn't
understand he was famous for hacking 10
years ago and now he tries to talk about
politics and how a dictator should shoot
people and me I don't believe in that I
believe in social
justice okay we'll be back after we
shower I'll let you guys talk I'll let
you all talk all
God
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
e
hello
everybody
okay would Bobby Fisher adapt to the
butt plug
meta subscriber only
chat
so I don't really know what this is but
Alex bought it
and uh we're going to drink
it feed my
microbiome H SMS pretty good actually
tastes like a um a
lemonade got a bad aftertaste
though okay we're going to watch a one
minute meditation
video we're going to calm our mind and
we're going to close our
windows we have too many windows open
right now this window is a good window
we're done with these ones don't need
these windows
anymore um
we don't need
that I guess this window can stay and
we'll leave this window we don't need
all of these
things that with that let's close that
window that's
fine Windows have there this window can
go over
here close the whole browser
um okay we need
that probably all good things to have I
wish there was a little better way to
organize them but that's fine it'll be a
little messy for now so we don't have to
reopen any okay now let's
open close your eyes and we'll take a
few moments to calm your mind and body
s in your
face your
neck and
shoulders do your best to fully let
go and turn your attention to the
breath the calming
breath the soothing breath breath feels
good
a long slow
breath B and
deep breathing
in I am
calm breathing
out I'm at
peace wow that was a fast minute we're
also going to put the shanii magic
chicken in the fridge so we're not
eating any more of it now can eat more
of it later there's always later
now we're drinking our probiotic drink
and we're solving Mysteries of the
GPU please stay on topic everybody this
is an on topic stream
create a section called
questions where do AQL packets
get
processed
converted so where did they add AQL
I think these were some
interesting so this is Southern Islands
colel agents
The Limited Hardware
Q all gpus still
run talk about
pm4 in Hardware where an asynchronous
compute engine processes HSA Q's so
there may very well just be two code
paths in the
Mec one for AQL q's and one for pm4
Q's but um coming back
to this let's also include this in our
links um
so my theory
is if
we use
pm4 do we
bypass
this here I take off this Q now we can
dump the que I'm actually thinking that
that packet Q is pretty boring though I
don't really understand why R pointer
and W pointer are incrementing so slowly
because if I go here into Ops kfd where
I'm actually incrementing
them I think that's
right
[Music]
um we can I mean I guess we can just go
in here and print it let's just print
it oh this is your WR right dispatch ID
let's see what's in an
AMD
QT WR dispatch
ID read dispatch
ID for sdma qes am I doing the same so I
call it a hardware copy Q and A Hardware
compute queue I could call an aqlq andd
AQ is probably more
correct as for these
wait sdma right
pointer sdma right pointer is sdma Q
right pointer
address oh that's
different so there I use the right
dispatch ID and the r dispatch ID but
here I
don't understanding GPU context rols
context GPU Hardware
understands the hardware maintains eight
Banks of context
registers just does what the driver
tells it to
to the pal
repository
interesting pal builds the right pm4
packets with the right register
changes um interesting
does this stuff
support see this is what I mean about
bad open source culture don't do
that is it actually updated on Master no
it's
like it's like the open source is the
afterthought right you're not embracing
open source you have an internal repo
where you're just pulling in a bunch of
crap you at least put the command the
real messages in here but why not just
develop it in
public interesting so I think actually
it's possible that uh Vulcan isn't using
I haven't really looked into the Vulcan
driver but it's very possible that
Vulcan isn't using um
is using pm4
packets called
IQs yes this is some abstraction Library
inserts the AQL packet into an hsq and
Hardware processes HSA Q's actually AQL
Q's um pmqs that launch Wave fronts are
not supported yeah I mean the debuggers
stuff that's true Felix even mentioned
that in his in his
comment um okay so this is somewhat
new here dispatch
direct
oh dispatch indirect that's kind of cool
it's cool that that's supported
companies are creating puzzles for me
that's
true so we're in the driver
here hqd okay so a hardware Q descriptor
packet Q
control is what that
means packet Q Hardware Q descriptor
okay Hardware Q descriptor packet Q
control um let's
run this and let's dump the registers
and let's look for those registers
fundamentally a lot of this other
um UMR stuff is just
uh like forms of dumping the registers
or dumping
memory let's grab
hqd Okay
cool so why is there nothing here
do I don't have permissions or
something how does that work
then what's that reading stuff from
by the way I should know these numbers
actually you know what why don't I just
why don't I just print some stuff what
am I doing we should know a lot of these
numbers I wrote my own driver for this
so we can just print stuff
f
[Music]
F9 6
f92 6 f92 is here it's not the PED Q
address the EOP is the same okay so the
r pointer
address oh wait give it
time does it
change why doesn't it
change oh no no no this is the the r
pointer here okay so that's not actually
the aqlq address that's not actually the
ring let's print the ring
too 16b 76b okay so this is the package
Q this so this never should have even
worked I gu I don't understand where
these R pointer and W pointers are
coming from then because these aren't
Hardware cues
this is just
wrong because that should be an
aqlq I'm actually writing to
that so I'm writing these HQ well kernel
dispatch
packets that's just not what I expect to
be
there cuz I control
that it's just the
ring guess we do some amount of
uh is that just this
oh that's just this oh that's so
boring niml genen wrote this so I didn't
pay that much attention to it but it's
just packet three indirect buffer packet
three acquire me and that's why we're
dumping
that ah okay so this is a cash and
validation packet for the uh when you
launch a kernel but this is actually
okay this was stupid I'm dumping the
wrong I mean not really the wrong thing
but the only reason it's decoding any
pm4 packets at all is
because we have that one pm4 packet used
for
uh used
for
yeah okay so there's
sdma sdma is going to be a lot more
boring if I dump if I dump this it
should actually decode I
believe yeah see okay time
stamp yeah okay so this is this is the
the sdma Q This is the real sdq we can
uh
copy this is the right
fence okay so dumping the sdma AQ
works and we wasted a lot of time
because this packet Q is actually just
AQL
packets that's stupid
let get one with bm8 but it is
this I don't exactly
understand R pointer and right pointer
they must be like shifted somehow
okay the EOP base is the
same we do one other thing too it's
called the save
base I don't really know what that
is but I do know what what it's
allocated as okay stack offset
size maybe this decodes as
pm4 yeah so we were spending that whole
time just trying to decode
okay AMD GPU EOP what's
EOP end of pipe pipeline
all right so I'm not going to really see
anything here unless we get to what EOP
is I also think that the sdma Q doesn't
have an
EOP
um so we create two types of qes the AQL
Q and The sdma Q but the sdma Q is a lot
simpler we don't have this contact save
restore
address
um yeah
what do they call it they call it
something else the save buffer
address you see the save base it's just
that save CTX address it's not
interesting
oh yeah wow I'm really slow there's AQL
control right
there so it has AQL
yeah these stupid things are just being
parsed by
both so there probably is
nothing that translates uh AQL to
pm4 processed in thec
never converted to pm4 so if I use pm4
it should be a completely different path
through through the Mec and maybe that
path won't have the
bug so if we create a
packet full of pm4 we probably just
don't enable AQL control
all right let's just take a look at UMR
and see how this
works where is it getting these
from read banked
rag what's a banked
rag apply bank selection address it's
not that interesting
how come when I dump all the
registers I don't see them be
right see if let's
just do some flag for
this oh
Bank s
bank C Bank
srbm it looks
like VM ID is optional s bank okay me
pipe
Q
okay so if I do pseudo
UMR I want that where's that
grab this
but we're going to have to set a
bank srbm so s
bank s
bank is what's the me so it's
mi1 P0
Q2 there we
go okay cool
yeah now we're
talking okay cool
so there's context save stuff is AQL a
thing here yeah AQL control look at
that so I don't think this Hardware Q
descriptor is
actually Hardware at all
very interesting uh do we want these gfx
things are they right at all is that a
different thing
hqd
base you're understanding this banking
is pretty
interesting
[Music]
srbm Bank
I don't think these gfx ones are
right get rid of
that change it to cph
H2 great
R Pointer's gone
up what is that
bank Sr R
BM what's an srbm we'll add that to our
definition like an
icbn oh sure it is like an icbn I say
system register bus
manager
questionable from one Junior member of
the
form but I'd actually still believe
that that makes a l of sense because
these are system registers not graphics
registers for some
[Music]
reason selector registers are Global oh
I
see we KD arbitrating
yeah oh the blog okay we'll just read
the blog part
three
um oh we select by oh the work group
stuff okay I
understand yeah yeah yeah yeah
cool that makes sense
okay so this is the Q and it actually
just is an AQL Q so we're probably not
going to find
anything more interesting than
this it always is that Q too it's not a
different C
which is interesting it's always on
me
pipe I mean it's odd that this stuff
breaks let's go back to what they said
about out of
order okay the mqd is an object in
memory that describes the configuration
of a compute
Q we still haven't answered the question
about what this mqd
is here it doesn't have like a normal
look
address the firmare saves the Q State
stop descheduling my
cues when dispatching new kernels and
waves set inherited during dispatch it's
also possible to pre-allocate Resource
certain waves unbounded pre-allocation
with in order dispatches enabled this
doesn't fix it
um so we
just set in the hqd PQ control
field okay so this field here okay let's
look at the bits
here Dash bits
okay here we go so here's PQ
control uh unor dispatch okay so this is
unor dispatch it's off right
now Q size is
17 um
it's interesting like we almost just
want to start I don't know these are
probably things I can set for my
driver no lot of boring stuff
here I don't
like where's my definition of create
CU can find it somewhere
this is the ARs to create
Q there's not really like a
generic passing these random arguments
so that actually can't be controlled
from user
space but yeah see you see why I love
UMR so much do you see why UMR turned
around the possibility of actually like
without UMR I was not going to was my
time investigating this
GPU like because without this forget it
you think I'm ever going to find out
that that bit is called the uh like okay
we have acronyms to deal with and they
don't have descriptions but eh still
giving given it any name at all is so
much better so yeah without without
what's released in UMR this kind of
would have been impossible I guess a lot
of the UMR stuff is in the kernel driver
if you're willing to dig through it and
maybe I could have found the equivalent
went on older
gpus which were
documented okay
so
interesting DCB
e 1000 oh DCB 1000 never mind that's
boring it's just shifted
over oh and that might explain a right
pointers and the read pointers too the
everything's just aligned so they use
less
bits okay that's pretty
boring what are bits what is bits F
do oh no it's stupid
did I get the gooey running yeah there
wasn't anything interesting in the gooey
I wasted too much time on that we should
have just calm down we should have
meditated earlier whenever we meditate
things just get
better interesting okay we can see CP
hqd
errors so the GPU still stays up after
it
crashes um
did we crash his
GPU no we didn't crash his GPU okay
let's kick off a reset training
job and we should see the GPU crash and
then we'll try to do some debugging and
try to see where it crashed just a fun
thing to do in the meantime
look at all these
options okay AQL control
one all right so I don't think there's
going to be another I don't think
there's going to be a
way to
uh like I don't think there's going to
be a better way I don't think there's
going to be anything else we can see
here I think we just have to create a
pm4 Q and and YOLO into
it um hopefully with help from this
dispatch.com resources I actually I
already know this stuff because it's in
the this must just be read by the stupid
thing um where is
we pass
in Prague
handle uh what actually is a Prague
handle it's just the entry point that's
not that
interesting
um yeah if I just reset stuff okay
so pm4 set shade a reg
packet we set
up compute
stardex oh okay this looks wow this
really looks identical to
Nvidia um
yeah like Nvidia this this looks almost
identical to what I
had oh wait I wonder if we have the bank
address if we can now see the compute
ones look at that now that we set the
right Bank those are all correct
there we go dim X dim y dim Z let me
throw a debug equals 2 on there so you
guys can see
it yep so you see this is dim X and this
is dim y those 409 sixes so now when I
dump the compute we see them right there
and right
there oh this is sick
so it's actually just setting those
where are those
things all shall become
crab what are banks uh yeah so you need
these things they're called srbm
Banks basically for like multiple qes
you set these global bank registers and
then the GPU makes the different banks
visible
set rink pm4
packets okay so these are the compute
registers and these are what you set
with pm4 packets oh this is
amazing hell
yeah so in
the we probably don't even need
firmware okay let's pay careful
attention to what this s bank actually
means me pipe
Q so me is micro
[Music]
engine
pipe is is I don't
know pipe 0 Q2 I don't
know can't wait till you build your own
GPU right we're getting there this looks
so similar this looks so similar to
Nvidia
um okay let's get some bits up in
here program Resource One program
resource 2 identical to Nvidia why would
I not want to use pm4 packets why would
I possibly want to use
AQL oh this looks so much better
I wonder what's being
allocated you could spam UMR yeah I
could spam UMR but you're you're right I
could just constantly read these out
well probably what's happening is the
Mec is just reading the aqlq and then
setting these things directly based on
the
aqlq again this still might not fix any
of the bugs but yeah we have to get rid
of
AQL why did I waste so much time on
stupid
AQL I knew AQL wasn't the
future I knew the pm4 boys
pm4 yeah
memory
packet compute user
data resource descriptor for the scratch
buffer what's on those those are
interesting B
okay so that's the resource descriptor
for the scratch buffer I wonder if
that's the resources that were being
poorly
allocated the global enable bit for the
feature in the mqd wait that isn't even
like if by global enable bit do you mean
QD is an object in memory that describes
the
configuration while the firmware reads
the state out of the mqd and puts it in
a hardware slot when this queue is
scheduled there's a handshake between
the CP and the underlying Hardware when
dispatching new Colonel's
waves to ensure that the required
resources are available
who wrote
this a
handshake I I feel like an engineer
wrote something I you know what this
looks like this looks like an engineer
wrote something that was specific and
then like a project manager looked at it
and they changed the words
okay so this is a q descriptor and the Q
descriptor just puts things on
here in these reg's
compute
um okay so if we go back to our favorite
document here
there's stuff even below the ace that
they talk about here so w
LM can we
find these are the the Red Blocks like
the pipes
if I change this you'll see it you'll
see it doesn't look as good wait that
looks the same does the pipe not matter
there that doesn't
work okay it seems like the selected
pipe doesn't matter sorry the Q doesn't
matter the pipe might
matter
um for
dumping
compute
registers I set that zero to want it
breaks I about if I set that that breaks
it too okay
cool
only the me and type matter
try this
empty okay me1 pipe
zero me1 pipe 1 me1 pipe two okay so
there's there's a whole bunch of
different cues it seems what's the
biggest number I can put there
can I put 12 here I mean it still works
maybe there's no way there's 124 qes but
this just doesn't affect
anything but yeah these are the things
that actually matter
um because this is after the Que
so I think this is actually even after
the
mech it's interesting that there's only
one
pipe
where I have
assumed that the Mec was what was
responsible for like compute dim I
thought there was going to be a loop
inside the
Mec
oh compute destination
but why why are there
four my bits show me my bits
again cuen okay we
know compute Shader
enable used dimensions
[Music]
but yeah so we can straight up control
all of these with pm4
packets then there's a pm4 packet called
dispatch and I wonder what dispatch
actually
does it doesn't just set a register okay
this is this is all this so much of this
is just the same as as uh
Nvidia and AMD just added an extra layer
of CR on
top Felix I know you wanted me to use
AQL but I don't know why I would use AQL
now that I know about
pm4
pm4 it's like AQL more
powerful might be nap time I think we
made some great progress though uh the
four things are Shader engines well yeah
but why is there four didn't you see the
picture I know the picture there says
this for but I thought this
GPU had six
there's six how come there's only
four great
mystery all right but discovering the
banking is the greatest victory of today
we just need to basically code this so
we have an acquire memory
packet which again I don't totally
understand
also I think this is much
more niml I'm sure you took this from
somewhere where you have this pm4 in
Direction like here is pm4 indirect
buffer which is actually wild in and of
itself that I can do an indirect
buffer but I don't think I have
to I could
probably
oh maybe you have to do this if you're
doing a AQL but so there's an indirect
command and this is the direct command I
feel like I could just put the direct
command right in
there unless you've tried
that yeah okay so I cloned pal let's
take a look at
pal hasn't crashed yet is this the
computer that crashes or doesn't crash
Should
Crash nothing will crash anymore once we
switch to pm4
packets all right just pal support
gfx uh 1100
seen that
before let's search for the dispatch
packet or let's search for something
like we know has to be in there like num
threads X num threads X not found
[Music]
compute
PGM all right here gfx 9 compute
pipeline now see they only have gfx
[Music]
9 it's possible that they have
more but looks like maybe it's only gfx
9 where's
gfx1 yeah yeah not
great
whatever whatever this is the greatest
Victory temp ring size resource limits
what are these things
actually dispatch n dispatch ID dispatch
initiator dispatch packet address
dispatch
tunnel I don't have a
tunnel oh look at the dispatch initiator
this is the should I want documented
maybe it is documented on the old
gpus those things that were linked might
have
documentation uh
cels are
launched
by putting
[Music]
by
setting
these compute
registers
from uh AQL pm4 Q
white rag memory
packet easier to
fix kfd test then the firmware great
causes problems with preemption in G2
testing since it's specific to this pm4
command and doesn't
affect AQL it's easier to
fix I
see yeah okay so these are the these are
just the numbers here it's pretty
cool wow look at all this RLC stuff we
have this to be interested in as
well we might not just we might not have
to use any of that this might just be
it what's qos yeah yeah we don't want
any of that crap delete it all one big Q
one big Q one big Q one big
Q wow like look at all this complexity I
can't even launch one
you it can Until It Breaks and now we're
back in broken
land um but it doesn't have crash
now just had a
hang all right and now Rock msmi does
nothing oh it's
working what why does it still have all
these percent ages on the
GPU like it
crashed all right they're back down to
zero now
I
mean this kind of Crash is interesting
this kind of Crash doesn't always look
like a GPU crash and it's possible it's
just something we're doing it's possible
I'm just messing up one of my uh one of
my
cues okay we need a lot more testing of
[Music]
kfd um
and we have to move away
from
AQL I do not trust
AQL because they can be dis wait no
where's that out of order
crap the out of order crap may not just
apply to AQL
save the Q STI
I mean I I definitely
think pm4 is just going to
work we probably have to somehow wait
for the colonel to
finish
um weit reg m
packet release memory packet
does it block on that or
not pm4 dispatch
direct threads are all here but the
global dimensions are in the dispatch
direct packet let's let's read what I
did for uh Nvidia
again see how similar it actually looks
I really I'm pretty familiar with it
okay so I invalidated a bunch of
shit but these are just commands to set
registers see it's the command is
called Uh set inline qmd address
a then we set all this stuff
up oh well that wasn't
needed um set the thread Dimensions
there but where do I set the
global program address
sets up a bunch of
registers is a
program
group find a Dos for
this where did I find this stuff
oh
here open GPU
dock it's nice in the video
cc0
qmd Q
metadata this this the Nvidia equivalent
of that and they like kind of have some
docks for
it for
we don't know what happens
here there's
possible I mean it's unlikely that
there's really race condition I don't
know this thing runs pretty slow so like
darknet 0000 you subscribed to say damn
it is the real George Hots and
Linux got to what was the guy before
onion onion onion
onion all right pretty good progress
today uh does someone want to write
pm4 I mean I think I've given you
everything you need I think it's pretty
straightforward now um basically okay so
go into tiny grad and here it creates a
q type compute AQL so instead of AQL
just create a q type
compute all right this guy guys banned
banned You Can't Ban your subscribers I
can um beans beans beans beans beans
beans okay so you're going to want to
create a q- type
compute and then instead of
pushing we already have this pm4 stuff
somewhere um
imported thanks Nimble gem uh so we
already have lot of the stuff you're
going to need
here and you're just going to want to
do packets that do set Shader
rig set Shader
rig
um yeah and then you do this dispatch
direct pack
which includes the
[Music]
dimensions release memory
packet weight reg memory packet
I don't really know what those
do family
gfx1 this Bing that
F that stuff all looks
straightforward does the cute block on
the completion of
this that's that's what I guess I don't
really understand I don't really know
what the point of this
is
um it looks like it stores
oh
interesting it kind of like stores into
the queue for some reason that I don't
totally
understand compute resource
limits do we have those
no no resource
limits this looks so similar to Nidia
it's interesting to think about why that
is I mean they probably just draw
engineer like who copied who
here who wrote this stuff
first it's all like equally but you know
what I mean when I make a GPU it's going
to be the
same like we're just going to kind of
copy some of this nonsense we're going
to try to avoid the nonsense but
we're definitely not going to have AQL
qes this like I I look at something like
an AQL q and that's structurally a
mistake and let me explain why okay so
here's your here's my here's my advice
there you want to move as much
complexity into user space as
possible so there's no reason that
because there
C I will indulge the Lisa Sue Jensen or
cousins conspir I Theory right now to
ask why this stuff looks so similar to
Nvidia um this is what they talk about
at a at a Christmas dinner um
so uh where was I forget what I was
saying yeah you don't want to put this
kind of Hardware abstraction in the
firmware you want your firmware to be as
absolutely simple as possible and then
any think about how easy it is to update
the different tiers of software right
updating Hardware is impossible updating
firmware is slightly more possible
pretty impossible updating kernel
drivers you know you saw me rebuild it
it's a pain updating user space much
easier um so I don't know why like AQL
exists unless somehow it's like
faster but I mean I can't really imagine
that's
true uh like AQL is just translating it
to something like
this um your lowest level needs to
expose like real Hardware yeah like I
still don't know if this is real
Hardware but this is definitely the
lowest level I this is the low this is
the level I saw at Nidia
too um so if there is a level lower than
this like there's definitely a level
there's definitely something that's
parsing the pm4 direct dispatch direct
packet sit packets are pretty boring and
they just set
the the RS I I kind of wonder
if
like is there just packets called
launch this packet's called relaunch
this doesn't have anything to do with
Windows
um the command processor itself parses
the pm4 packets well it depends what you
mean by the command
processor like what is the command oh
first let's we're almost done with
stream let's push
uh my Docs
not all these pieces but all
these for
the pfp me
maybe RLC
Mees I've seen that go either
way George why do you do get ad and then
do update talks like that I don't know
for a
habit oh those are tabbed
wrong ew those are
tabs e not doing spaces that's
disgusting I don't know I think it's
time to eat like cinnamon rolls I think
it's cinnamon rolls time who thinks it's
cinnamon rolls
time anyone else on board for cinnamon
rolls time I don't know how I'm going to
get cinnamon rolls but that's what I'm
feeling right now I didn't really want
chanse magic chicken I just ordered it
cuz I don't feel terrible after I eat it
like I will after I eat cinnamon rolls
but that doesn't matter I still want
cinnamon rolls cinnamon
rolls where am I going to get Sy
rolls okay
um that's
also I mean I mentioned dispatch right
ql is probably used by the Windows
driver I don't know no I think it's like
some standard and I think for some weird
weird reason they like put it in like
the firmware I mean this is even like
the
hardware I think this is a hardware
register it's hard to really say
I'm kind of interested in how do I like
split U let's just do this quickly in
Python because I don't know any of real
scripting I don't know how to use like
set and stuff I'm a Noob and a script
Kitty uh
from Tiny grass
helpers import DD
we'll put this in
here
gfx register
groups be interesting to document each
one wait no
no they have chicken
registers I swear I didn't make that up
guys they actually have chicken
registers
we can also like there like we can go
like one level
deeper do like that and then
like don't join is that how you do
that oh no got do two there not one
okay look like the sdma has
Q's the CP has lots of
different okay well this answers it the
mees is part of the
CP is the RLC part of the CP where's the
RLC no the RLC is its own thing Okay so
we've
learned we don't really understand what
the RLC is yet but we never actually get
any run lists so it doesn't really
matter um we don't really care about the
CB that's not
interesting hqds are kind of
interesting compute
guess like I don't know enough about
like gpus but like is the same compute
ones used for not
compute I don't
know but I think this stuff like again
all this stuff also we're the only
person using the
GPU okay good we got the crash oh this
is good this is good okay so let's
us do a reg dump I have a reg dump
script in timey
box um it
exited so we'll do R dump here but we've
learned more stuff
okay so you can see the regs
here if I get them most of the gpus are
like off so yeah the diffs are really
tiny but we'll see which GPU
broke not that one not that one
wait what did none of the gpus
break oh no
what oh that didn't that's just a that's
just a page
fault that's a different
error I don't know that could be a lot
of different things that could be like I
free to
buffer um so I'm not worried about that
I mean these things could very well be
my bugs in uh did I use the other one to
kick off didn't I kick off a HSA
run yeah but it had all the same issues
oh that one actually had a mess crash
but for some reason it reset the ring I
don't
know
um yeah I mean it's kind of interesting
to look at all the different pieces what
is a chicken why do we have one
CH Hardware
cues
here compute control
here anything else the document we know
what sdmas are actually one of the most
interesting things in UMR also is all of
that is it this GPU top you can
run
and look at this here's a whole another
set of here's a whole another set of
stupid crap that you can learn about oh
we can also I think we can enable colors
but you have to you have to spell it
like
color you don't actually have to smell
he supports both spellings but I just
remember that being
funny uh what's it called you use color
okay so oh we are using the RLC no not
the RLC don't use the
RLC actually already copied this
somewhere did I not yeah I already have
this
here what how come this one says what
the TA is and this one doesn't say what
the TA
is is there is there a
dock what's the Spy all right all right
all right we're doing
this probably tell if I'm looking
looking at the register
names spy Shader user
data
what that just looks
insane CP
hqd EOP right pointer so at least those
are like my this is like at least I'm
dumping the right Banks now oh these are
grbm
bits oh we know about grbm and we didn't
set the grbm bank registers we only set
the srbm bank registers no wonder
nothing
works I'm being sarcastic I don't
actually really understand this stuff
what
s sh
instance
wow okay well maybe this is a mystery
that's going to have to wait for another
time
but okay for this we might have to set
Bank
this is interesting it definitely
changed
something user data looks like garbage
[Music]
grbm but yeah so that controls the
Shader
engine so I I bet we can figure out how
to dump the actual registers what are
the names of the registers of the GPU
sorry that registers the rdn
see aperture oh here we
go no that's
rs64
wait we did did we even try that rs64 is
actually rdn no it can't be rdna it's
definitely not
rdna
but did we try with which of these
registers are banked
it's the
same let's read the wave dumper and
UMR UMR
is we love
UMR print
waves okay um so it tries to do this
halt command and that actually breaks
things but all right so these are
sgps wave data num of
sgps data get flag hold wave data
what my wave data
WD
what this
set bunch of
[Music]
config wave data get info get bit info
SQ wave status oh these are the bits
that's a whole another or the bits are a
whole another a whole another Rabbit
Hole you can go
down I think I got them to do something
but I didn't know about banking
um it's called read SMC but none of the
SMC reads actually
worked yeah I cannot read from SMC rag
but there might be a way
is there a Discord mod here oh oh you
got banned from Discord I see oh you
want to get banned from this stream too
I
understand asking to be unbanned is just
saying please please sir I want to be
double banned I want to be banned from
everything I love being
banned you know they just like the type
people who get
banned and then there's the type of
people who
don't oh well we know what VM ID is n is
now oh I should just read my own
documentation this do stuff's pretty
good yeah this seems to work okay well
that's what sqs are
they're not there not to do with z8s
okay so there's wave stuff there what
other things do we not know what they
are gooey wait
CPC that's the name of this thing
they
banked really look like
it we're also done with that so I'll r
that
again
cpf there's no sqs
here only using the T sometimes what's
the
T oh this is the t wait I know what the
t is it's the texture
addresser for some reason it told me
that here texture
addresser I'm not using T anymore
spy See's run list
controller what's a run
list wait
what in rock GD they talk about z80 op
codes no this is just all the
documentation from all of that's not in
actually in
theirs gooey where's gooey we don't have
gooey goey doesn't appear in there
all right good progress today I think
um we are we're we're within Striking
Distance at
pm4 and I give it a 30% chance that pm4
just doesn't have bugs only AQL has hgs
what do you guys think
[Music]
if pm4 isn't usable might as well light
our gpus on fire guys not even close
Okay so what we have to do what we'll
get to is the Mec is written in
rs64 so one thing I thought about doing
this week was like a Rosetta Stone Style
translation between F32 and
rs64 right and then we can start making
progress on decompiling
rs64 uh
so this stuff is meant to
disassemble hand firware for the uh MEC
and SE Islands so I we can look at the
sea Islands
MEC all right all right all right all
right let's go to the bathroom get some
more coffee and keep
going for
the handle of my bathroom's falling off
magic chicken
too put a white hoody on stuff's hard to
eat
uvn if you're in here I will try your
gidra
F32 at some point offline so
okay we're done with let me finish off
my probiotic Elixir
here oh yeah I got to get those last
probiotics my microbiome or
something same thing we do every day
document this
GPU um okay Ron
tools has been updated in a while uh
okay which ones is it good
for Li fir Ware the good news is I think
we have all the firmware just on here
firmware
[Music]
AMD
[Music]
GPU hey look who wrote radon tools all
very
appropriate all very appropriate that it
comes full
circle um do I think am is going to open
source anything
useful uh I mean let's start with do I
think AMD is going to open source
anything and the answer to that is yeah
again we'll give it we'll give it I mean
they tweeted about that stuff now so I'd
give it a 90%
chance um do I think it's going to be
useful well I mean that depends that
depends on why they're doing it if
they're doing it because of PR no it's
going to be useless not totally useless
again I at minimum I'm going to be upset
if I don't I know that I won't be able
to run the uh Mees firware that I build
but I will be upset if I can't even
build
it um it's important that the whole tool
chain is released and the whole build
process is
released ideally a reproducible
build reproducible builds are sure when
you're talking about very complicated
systems reproducible builds are kind of
hard
but if you want me to trust that the
firm so the half the reason to open
source this and if AMD does this this is
this is something that's pretty good um
so yeah so let's let's let's you want to
you want to ask that question in a in a
in a structured
way um what will AMD open source okay so
I don't even I don't want to type type
is a lot of work
will the thing be buildable
uh will there be
history uh will that be the active repo
that's worked in or will it be a dump or
a snc is okay but a occasionally someone
runs a script to squash all the commits
no no like that's weak right I want to
see real commits it doesn't matter if
you actually work in the repo I mean
working in the repo is is something to
move to but I understand why that's very
hard right like changing processes like
that is really hard but there's no
reason you can't set up a script which
constantly syns the
commits are they the real internal
commits or are they some sanitized
external thing like you have to stop
worrying about that nobody
cares like this was so bad in
self-driving cars where all these
companies were paranoid that someone was
going to steal their shit and you know
that that paranoia slowed them
down opening on backed wow going hard
tech crunch opening I gave him like 10K
or something in compute credits
um so yeah I mean you know you want to
be secretive right Argo AI wow wow the
people who are like George you're never
going to be serious like Argo
AI
um where where is the they were going to
put windshield wipers on a Lar
oh could help Ford deploy them hundreds
of sensors will be manufactured by the
end of the year okay for those that
don't know what happened to Argo AI well
that's going to just be the movie I'm
not even sure they have a Wikipedia page
was an independent
company um no no no we really we got to
find the blog
post their their blog
was
H um we might have to even find this
in Liar
cleaning um we might have to find this
is like Google is so
useless again they're never going to
show
you maybe doc. go will find this
probably not
oh here we
go like it's too it's too embarrassing
it's too embarrassing that Google won't
even find it maybe Argo paid Google you
know some money to get rid of this so
Ford engineered a
solution among all the obstacles facing
self-driving cars from inclement weather
to shaky public
acceptance you lived in Pittsburgh when
Argo was the next thing like oh my God
could this fucking
stop could could everybody just
stop like I never want to see an article
like this bugs a self-driving car is
worst
nightmare who is this like stop
consuming this media stop creating this
media this is this is it's an
ad yep so so this is what Argo spent
time on yes yes oh The Tiara uh uh
cleaning system in action but the air
Shield so they they built a like a a
little a
windshield dude why don't you just put
it behind the windshield and use a
wiper like a normal person
Ford says the major Shield washer system
component will last the life of the
autonomous vehicle though the company
won't tell us how long that is exactly
you
know I hate this
too you people have no idea how these
companies work who like the person who's
writing this article right like won't
tell us how long it is they have no idea
right the company doesn't know that um
and but the diff like you just can we
all just be more
honest the honesty is what would move
the world forward if you lie like this
publicly you lie like this privately and
you go out of business and waste
billions of
dollars Argo raised over 3.6
billion right the world loses when this
happens
like the whole world collectively
remember how I was saying how really if
you want to improve your own life
improving the world is the way to do
it well these people destroyed billions
of
dollars they just destroy it right you
know that money could have like fed
fentol addicts in San Francisco or
something not saying that's a good idea
I'm just saying it could
have could have bought them more fentel
man could have bought them more fentel
you know but instead Argo AI 3.6 billion
wasted ghost 217 million
wasted I have two possible guesses why
AMD is so cgy one not all the IP and the
GPU is there so they might accidentally
breach
ndas they don't know internally if
they're infringing on any patents we
have to just move past this right you
you have to just move past being afraid
I will document your
GPU okay don't make me start looking for
patent
infringement if if that's the real
reason I will look for patent
infringement and I will find patents
it's infringing and then I will email
the patent trolls who own those patents
right like also people are going to
start doing this once like look is that
really worth my time probably not but if
I had like a you know a little cluster
to run some llm yeah figure out what
patents AMD is violating go do it
um I mean we need to move to a world
like Beyond this
stuff we need to move to pan should just
be abolished there's there's
no
um reason this applies to the hardware
Ur levels not register docs yeah you can
well the firmware some of the firmware
might be
licensed yeah I agree and that's I mean
I was going to Tweet about this I'm done
I'm done bashing AMD on social media
it's not going to do anything again you
know how hard it is to change yourself
it's that much harder to change other
people
uh so yeah no I'm Pat stage just go but
yeah I have an idea that if we keep
working on this every
Saturday now I'm going traveling I'm not
going to work on this but if we keep
working on this by the end of the year
yeah by the time AMD open source of
stuff like this will just be better
all right so where are we we got
distracted who who described these
streams as like you know you got like
the teacher who you can you want to
derail the teacher right like we used to
do that stuff it was
funny you get the teacher talking about
you know his like childhood or
something this Bon a Mac
oh
oh okay these are like the packet types
and it's like a jump
table how long how big is a Bon Air Mac
oh look at how tiny that
is all the good old days of tiny
Mech I sort my
size s there we go oh great look which
GPU has the largest
Mech
um yeah all the Bon Air Mech was so
little okay so this supports this is the
dispatch direct command
now um we
shouldn't we can look at this we
shouldn't really shouldn't post this in
our repo since this firmware is
copyrighted
um I
mean yeah I guess it is kind of
copyrighted
which is something that's annoying I
mean we can you can always post like you
can read it and post stuff about
it
[Music]
uh but yeah know in general like you
know you're doing all the iPhone stuff
like you can't just start putting
Apple's copyrighted stuff in your uh in
your repo and code is copyrighted
register and headers generally are
not uh so those things are
fine uh and obvious like instructions
all of this stuff is not is not
copyrightable it has to have a uh
creative element in order to be
copyrighted also remember that I'm not a
lawyer um but I've never lost the
lawsuit so you
I've tied I've gotten draws but I've
never
lost interesting so this is all the
dispatch
[Music]
direct
um here's dispatch
direct and these are the registers that
are
stored okay R1 is apparently a magic
register that consumes things off the
queue so I'm going to guess if we look
at the Bon a register layout which we
can actually um there is a repo with
Boni
files uh let's clone that
um Ry files let's take a look and see if
they can be copyrighted my guess would
be they can't so DBC files we have a
project called open
DBC um and DBC files would generally and
you know I'm happy to defend a lawsuit
uh about this if somebody tries it um
like there there's nothing creative in
here
uh it's just like a definition
file
wait rs64 Mech kiq where' you get
that oh you found a string in
there um no also like people got to be a
lot less afraid uh companies too of
getting sued like um if that's really
the reason that AMD doesn't open source
more stuff I understand not wanting to
violate agreements with your partners
but because you're worried about patent
trolls like literally just clown these
people bro just just clown them is that
is that what they want to be known for
on Twitter like being a patent
troll um clown them bro clown them
okay
uh let's take a look at a rif
file so
let's bring that next to Mech
ASM so we have the okay so there's a big
jump table at the end of here for this
and let's look in the disassembly tool
and see how it's actually getting
that is that just like a known
thing to be at the
end how do it know about
this oh it's just like okay it's after
the code size that's interesting
this
sucks so this file looks like it has
less in it than
may I have to multiply this by
four
b804 ah here we go multiply by four okay
good so yeah this is compute dim X
compute dim y compute dim Z
z uh do we have those in our
GPU we do
oh but for some reason we don't set them
they're set in the dispatch direct
packet okay cool I mean that's really
straightforward um R1 is a special
register that just pops off of the
que and then this is looking at
different uh how it gets there oh that's
from dispatch indirect okay so that's
just reading it okay this is actually
really
straightforward at least it was in Bon
a get ready for the level of
bullshit see remember when the firmware
was 17 kilobytes and now the firmware is
407 Kobes
okay this one's going to be
[Music]
RS so those mechs are probably all the
same let's try a Fiji Mech you think
it's going to work
firmware AMD GPU
[Music]
fij
okay
[Music]
EG
Mac
aom all right looks pretty pretty
similar still they're jumping into
dispatch
indirect it just might be like the
naming still doing pretty much the same
thing by the way is those the
same registers on
mine um
you know you can do so much today with
uh like PR matters it's not PR it
companies used to be able to spin things
a lot more effectively than they used
to
um it's
interesting it's interesting who
operates these things today too
it's it's like a with let's not get into
this
um where was
I I want to look in
UMR at the
gfx 11 IP
this
one so I wonder if we do compute dim
okay it has changed you can see now that
it's 0 1B
A1
um all right let's go through these and
figure out what the latest GPU we can
disassemble is look at this one it's
different it's smaller
uh but no we can't disassemble it it's a
fake jump
table it's interesting that that one's
smaller Fiji works fine does vega work
fine
no almost
no that's not
right B doesn't work these don't
work Fiji does
see it's just not
there
okay
so oh fiji's a lashy view in the
southern island
series let's look up all their code
names they name a lot of stuff Fiji
apparently you're saying this is
Southern
Islands up to these R DNA
3s but okay so Vaga 10 10 doesn't work
Polaris is the next one we have one in
the middle oh bon no no boner is
actually later than Fiji or is that Bon
a pro different from Bon
a wonder what works for
those so
gcn do we try
Polaris you know it doesn't work for
Vega 10 okay it doesn't work for these
it might work for these
Polaris
10 yeah it works for Polaris 10 Okay
cool so you see how I can see that it
works like this is just setting these
registers here so it works up to the 500
series
gcn4 ARX
Island but this Vega doesn't
work so Polaris 10 works but Vega 10
doesn't um I should probably make a
private repo again so you can totally
work on this stuff you just
[Music]
can't um
unfortunately yeah I can't just start
pushing well actually let's check the
license on it what is the license on
Linux
firmware by the
way total bullshit they write this all
these things total bullshit um so if
you're reverse engineering for
interoperability which is what we're
doing um you know we're trying to uh
make the GPU work with our software
which right now of course it doesn't uh
reverse engineering is uh certainly
welcome
um so you know you can just uh ignore
that whenever you see
that um again I'm not a lawyer but uh
you know you want to sue me
[Laughter]
uh permission is hereby
granted to install reproduce copy and
distribute copies in binary form only of
the software okay never mind we can
totally just push this
sweet
uh understand
Mac okay
so Polaris works and Vega doesn't
install reproduce copy and distribute
copies in binary form only of the
software
great so when you compare that to like
when you're doing iPhone stuff if you
have like a like an ipsu
file um you don't have permission to
redistribute that
file why do you think GC 10 Mach looks
okay I will look at that one but I would
be
surprised uh you must also reproduce the
license yeah we'll copy the license
if we're even going to ship firmware but
it's good to know that we can uh you
know Nvidia unfortunately hasn't pushed
the GSP to this
repo uh which sucks for
uh I actually don't know what nvidia's
license of the GSP
is the GSP is like nvidia's big firmware
blob uh oh
[Music]
oh
cool well they're not going to release
the source but uh cool I'm happy inidia
fix that this was something I worried
about about like the
uh the the usability of uh Nvidia in
general you know so it's interesting
that Cuda license thing that people are
so worried about the data center thing
first
off um Nvidia is highly unlikely to sue
you uh what Nvidia will do and what
Nvidia will do if you upset them in any
way is they just won't give you
allocation for gpus so that that that
Cuda no data center distribution that
everybody flipped out about it's like
basically telling Amazon and Azure yo
don't buy 490s or we're not going to
give you any h100s which again is
totally within nvidia's rights um people
are like you can't sell the Tiny Box how
can you sell the Tiny Box didn't you
read the Cuda
YULA you can sell the Tiny Box bro I I
don't even think it upsets Nvidia I I
think like like the the the the risk of
veress
of it's not just it's not just legal
stuff the general risk averseness of
people like like dude you're going to
die okay everyone needs to you know
those little clocks that like tell you
like you're going to die I'm 34 years
old okay even if I live a nice life I
got another 60 years here man like
that's not that long you know you're
going to die manone got to remember
that oh no but I got sued by Nvidia for
putting six gpus in a
dude like that's just not how it
works um but yeah no you're not allowed
to distribute uh
and what also will happen if you make a
driver that depends on like amds the
main the main bad thing that can happen
if you push binaries with the wrong
license to a repo is a dmca taked down
and like that's
annoying um so you know respect to
copyright but it's good to know that we
can distribute the firware
until that time I choose to
live you say it's sensible if I do the
uh I'm gonna get Maran suit again
uh no this is
nonsense yeah this doesn't
work uh okay let's go back to where we
were
um let's throw the license radon in
here and let's copy in Polaris and Vega
do I pay attention to the
commits uh no we should pay more
attention to the commits Linux fers is a
cool GitHub
how to use these other
ones let's prob up to
date how to use
this I would mind seeing though can I
like click on this and see the log oh
God
okay great
update from internal G commit oh
interesting
link ROM GPU hangs
interesting oh
what IP
Discovery what is
this this must be what
uh this is what you bars
reading these things
interesting it's not debug FS actually
but uh okay so where were we we were
looking at the last one that can be
disassembled versus the one that can't
information should be
free what I thought I created some file
in
there oh I created a file in the remote
one not in the local
one all right let's go to Mac
um
looking
into the
firmware we'll get to a hex comparison
okay so which one can we disassemble
Polaris
uh I mean there's nothing lower than
this
so I mean the bug is either in here or
in the
hardware I mean it's like like it's just
literally writing those registers right
those are real registers in the hardware
then
um that's interesting look they read the
in this new one they read the Q
uh
multiply register number by four to to
match Ry file
is this is this is this like where is
this like where it break
well we'll see if we think one is one
format and one is the other
format
um go to the right file
compute DX okay wait this R file
actually doesn't have more information
in it
than this is actually just the same
information that we had some of them
maybe have some
comments some of them have some comments
that's cool
in fact we could probably look in here
for comments frequently to explain stuff
if we have anything we don't understand
but the names are really a
lot this is already mostly
open
source this is the compute dispatch
initiate
so that's from oh that's is that from
Polaris
Mech yeah that's from Polaris
Mech let me actually not use that let me
use this so work for people
cool
so that's Vega 10 which doesn't
work I don't know a good way to do like
a side by side
uh oh I have firmware
info a little script
in here
let's windows open
out
10 Vega
10 you're so close why does one not work
and one
works so okay even better would be if we
could find let's close
let's clone Linux
firmware and the best thing that we
could find is if they switched
over if they have the same GPU that they
switched from uh you guys know the Retta
Stone
right so the Rosetta Stone look up the
Rosetta Stone if you don't know um if we
can find something that's WR like F32 is
like one language and rs64 is like
another
language uh
are you best friends with Snowden bro
we're Banning a lot of we're Banning a
lot of subscribers
today
rip how do I clone this
how big is oh it's actually pretty small
I think I would imagine since they
couldn't diff it would be big but who
knows
um there like a flag for whether they
[Music]
are so
[Music]
Polaris to
Vega breaks it
it's also I just want to confirm that
uh Vega actually looks like
junk it's not just like a tiny parsing
issue
Goa h
no it actually looks kind of
right let's look for
okay Vega might actually work kind
of yeah okay here it is they just named
it they just changed the packet
numbering look that's it right there
okay Vega does kind of
work um
this is kind of wrong
okay
so Vega is
not uh
work
great but it's still F32
let's go on to the next
one you thought
that where's my sorted list the
X you thought
that this one looked
okay so interesting that these ones are
small
wait
what that stuff actually looks
correct are you telling me that this is
okay and this is wrong
that be
wild let's look at the change look for
that it was added in 2023
that was added in
um there's a whole lot of reasons the
jump table might have broke that might
be a different
thing let's take a look at
let's take a look in
UMR at this and what was the bit called
compute no no no no but I I know he said
that but I think this might actually be
okay okay
one ab1 and I think that's actually
already privided so let's just try that
no that would have been too
easy this stuff kind of looks like
sensible code though
[Music]
I don't know maybe
not let's compare it to this
one tons of
knobs see that looks like real hot
garbage
this totally is an F32 that's
rs64 but this is
F32 and they're almost the same
chip in fact I think they have the same
registers everything got complicated
[Music]
so yeah it's F32 but it's just some
other like dialect of
it that doesn't perfectly
translate all right let's go one GPU at
a time
I mean yeah it's not exactly
f322
still sound dispatch Direct
so where's my dump of the Vega
Mac right like look at how it still has
all of
the um oh see this is launching like one
kernel like you can that's very
sensible yeah so this stuff is
like it's the same like dispatch direct
pattern because it's reading off the que
and it's putting it in the three
dimensions and then the launch compute
dispatch initiator do we have a compute
dispatch
initiator yeah here compute dispatch
initiator cool yeah yeah it's it's the
same it's the same layout they just like
moved it a little bit they moved it in
in this um let's look in GC n and see
where it
is oh it's at
eo1 okay well they moved to somewhere
else in gc9 let's see if we can reverse
the gc9
ones it isn't a gc9 oh Navi
10 probably
works Navi is after V right
some
stuff looks
right
cool right there there's your dispatch
it's still two eo1
here it's just eo1
though that is Navi 10
right or maybe there's some other offset
that I'm
missing maybe this is like globally
offset by something in which case that
would explain why our GP didn't work
there maybe that should actually be
three
ba1 let's look for
that but okay so nav 10 works
nav 10 has
this it's the same 21 it actually looks
identical let's
TRC let's go back to the one that I
think
works let's go to yeah this one
same
one that's
weird it's a totally different
thing no it's the same
that doesn't end with eo1 in that one
though why is that one
different okay gc1 and gc4 seem to have
an old Mech let's check the
history in Linux firmware of this
check out this one well first let's look
at the file okay it's big what if we go
back to
this no it's still
big I'm kind of curious to diff this
say different a hex def I used to have
so many good tools for this
stuff okay so why are these registers at
like a totally different
offset but yet
so they're the same in in both
gc1s oh what's that is that
new they're all at this 1
ba1 and
yet when I look in the firmware
looks like this F32 stuff's extremely
new when I look at the firmare I find
like the exact same patterns
every 10 I don't care about that
anymore I don't care about vegan
anymore this one's the most advanced
oh wait you have to multiply that by
four what's this divided by
two sorry I can't do heximal hexadecimal
math in my head
sure looks like the same stuff so like
this is like launching a specific kernel
right it's launching a kernel with with
just one number there that they're like
getting from that register which is
interesting let's see what register that
is
uh actually we don't know what register
that is because we don't know how to
turn these into these
things well
actually that's not
right that's not
right what's you see
compute program low oh this reads it
from the
program read no that's stores it into
the program load
six shift six left by one multiply it by
one oh I have some questions about
this does that look like sensible code
to anybody else
but definitely still has
this 2 E1
so
strange did they add another layer of
indirection or
something it's very clearly that
read off the queue and it goes
there
gc01 maybe this isn't
used let's check the kernel
driver sometimes
which card is that and why does that
firmware why is that firmware F32 and
the other
firmware
rs64 so Polaris they went to this really
large
Mac but it's
only these three
cards that have the F6 the
uh
64 this for also really doesn't seem to
do that
much like if we only do
the well actually we should be able to
find the AQL dispatch in there
too which GP was the first one to
support
AQL never mind I think I saw it
so if we just look in here oh this is
great this is
AQL I'm sure is
it could be that as well but that's
doubtful I bet it's
that where does
our 10 come
from okay
also it's crazy this is same
GPU so we probably just have to compare
this file to this file and do it Rosetta
Rosetta Stone
style we can also look at the mech
instruction
pointer uh let's kick that off again we
can look at inster it's called inster
here we go so Mech one instruction
pointer zero why is that
zero shouldn't be zero is the SP the
problem why are those
zero they shouldn't be
zero the mess isn't zero oh Mech rs64
instruction pointer ah it's changing
okay
good there we
go we just have to read that out really
fast do you want to try to just read
that out really fast want just map that
in
Python we get a trace of all the stuff
running in the mech
firmware then we can write a program
which loads the mech firmware never mind
we don't actually need to put any of
these firmwares in in my
stuff um
oh yeah
buddy so those are just addresses in the
in
the yeah in the mac and it's staying in
like one stupid
thing we can probably find the the
dispatch okay so here's a question
how do I get all the versions of a file
and
get wait what where's the other
ones how come the other ones aren't in
Linux forw
oh because I checked out an old
version there we go it's added later but
for some reason they set the flag to
compile this with the old style and not
the new style
okay um let's look at versions of the
fir
CP
with scrip
mostly
junk okay so like that I mean
unfortunately it seems like they're not
perfectly the
same but yeah I mean I wonder if like
these are the differences it puts in
eight in 91c now
yeah you know we never got good tools
for that either like good tools that
would just actually div binaries for you
like def like graph
aware NSA has them you know the NSA you
know the NSA open source gidra because
it's their
shit the NSA open source grro to hold
the rest of the world back you got like
Russians trying to well should I use the
pirate and copy of Ida or should I use
the the Java ship from the NSA
I don't know maybe the Russians had a
great
tool North Koreans we can rip on North
Koreans you4 is the same as1 it doesn't
really
matter uh Ida Pro is
Russian is it
I actually the Russians I bet have good
tools yeah Russian guy don't know if it
think it's Russian but never mind the
Russians have better tools than
us I take back it's the North Koreans
using gidra the Russians illing stupid
Americans coding a
Java America Engineers a pen that can
write in Space the Russians use a pencil
what about the Chinese I don't know what
they
have the Chinese have have stolen
gidra wow wait the NSA has a GitHub
though can we just talk about that
that's pretty
cool and you know we can rip on G all we
want but it actually is like pretty good
I don't know like I'm upset that it's in
Java but like it's open source code
Apache 2.0 you got to respect them for
that and not only did they release it
but they continue to develop it
openly like how cool is that actually
how is the NSA better at open source
than
AMD
wow pretty cool
actually good World good
World NSA more open source than AMD
no back doors yeah there probably back
doors but like why you worried about
that I mean there's definitely back
doors but like what what a what a like
like every person who's into reverse
engineering now has an NSA back door on
their computer but like so
what like
the NSA already if the NSA wants your
shit they already have your
shit I just wonder how clever the back
door is I which of these commits do you
think is the back door
all right
um question what if we just like loaded
the
firmware for the other
GPU why is
you know way that works I don't know I
wouldn't be so
sure wait this one only got launched to
China
oh not anymore it's now worldwide oh oh
I see oh China only then and then
then that's actually a pretty good deal
16 gigs of
RAM I don't know has more compute than
that I don't
know that one's kind of
interesting why do they do
this that one and that one they're like
the same so that one has more compute
units
so which actually is uh
[Music]
GC did it say on the
driver
like what is this module firmware macro
though why is this one look different
rs64
Mac if rs64 enable is
that how do it set this
I think it's all like
that let's do the mess as
well interesting
[Music]
so the mess looks like it's
rs64 all right I know you guys want to
see some Rosetta stoning let's do some
Rosetta
stoning first we'll listen to the Drake
song where he mentions Rosetta Stone
uh and I'm sorry for
copyright but it's
happening all right that was that was an
accept a amount for not violating
copyright don't we think sorry
Drake sorry sorry here Drake here here I
got what do I are you 10 bucks here here
Drake here's 10 bucks 10 bucks for
Drake All Right Drake whenever you want
that 10 bucks yo just hit me up you get
one of your boys to text me I will I'll
put that $10 in the envelope and I'll
send it to you all
right poor Drake
poor Drake fell off hard man fell off
hard okay now I remember why I work on
this computer so we could actually
do
not
notes Wendy's nuggets are
thick uh all right actually want to do
this
ahq
window from the
window call it
Rosetta wow it's like the Apple
crap um
I they have to be almost the
same M
F32 I never thought I'd actually get to
do this with the same okay what I was
really hoping for was that an older
version
I mean that would be ideal but they
can't be that different can
they let's take a look where is my fp32
disc radi tools need the r file need
that this all right so here's how The
disassembler
Works
um uh by the way we want toedit uh uh
Maran for writing this assembly
okay like pay attention you
know SHO you do katum you should stop
before you get banned no we're not going
to ban that guy only if he
continues that's okay should you do
katum I don't know man it's a good way
to get off opiates if you're like legit
an opiate addict and your choice is like
oxy or katum you should do katum if
you're not an opiate addict don't touch
that shit
bro
um but you know you got me on them
Wendy's nuggets like I could go for some
Wendy's nuggets right
now I know way too many people here
right right now that I didn't know last
year format
I
okay step one find a black tardo bro
can't even get good heroin anymore
they're cutting all the heroin with
fentanyl for
right do I really want more coffee what
do I want I want some food I don't want
mag chicken that for
dinner Alex bought some cagefree
hardboiled eggs and I looked at them
when I thought there were mozzarella
cheese balls and I was excited but then
when I found out there were hardboiled
eggs I was not
excited uh okay I have a firmware header
here it's like here here's the header
size bites header size bites U code
version U code array offset byes
crc32 so this is crc32 okay the U code
offset bytes in both of them is hex 100
so that's boring
both have XX 100
headers
um let's dump a little more
signature
crap I don't care about the
mess edit this
file print
labels third pass disassemble
data I
sub4 Al I mean this might actually be
just disassembling the header
too it's just disassembling the header
and they just didn't
care uh see if that's right
active debugging versus passive
debugging all right uh is that the
header no that's not the
header so where is like 29 and
[Music]
shit that's was right there 30 what
that's not what I expected oh 30 okay
there we go okay so it is starting at
100 uh so where are they getting that
100 from oh here they just read the
first 100 and ignore it
was sick okay
cool
skipped in uh F32 just okay good cool uh
so that's actually not
code it's interesting how similar have
next isn't really code so what ises the
code actually
[Music]
start 160 is clearly code
shit's not code 100 there is clearly
code next 100 isn't really
code um
some other kind of
head so that's yeah clearly that's not
code that's just lock but that's code
okay so if we go to 200 it's
code ah okay so look you see the code
code you can see the code
here code starts at X200 in
F we just copy and paste a little of
it after
all right so y
yep see like hex 180 is like 780 so hex
180 780 see that right there got to be
good with numbers they matching numbers
fast moving them
numbers okay uh where does it actually
start in the other
one
xxd George there's so much more
methodical ways to do this yeah but if I
want to do things methodically I just go
to
work okay so it looks like this code
starts at 12200 I
say so real code starts at
1,200
in
rs64 yeah that a stone shit boys that a
stone shit let's go all right so those
are probably like the same
thing I can kind of see the similarities
kind of see the similarities almost
maybe uh all right so they clearly they
both look like they have a structure
of uh four bytes
let's change name
all
right whoa look at how Rosetta Stony it
looks not to Rosetta Stony at all this
actually kind of sucks it don't really
look the
same they like kind of
similar I mean they're clearly like
instruction
sets it's got to be documented somewhere
let's go a little
longer that runs into zeros real
fast actually that makes me question
that might not be the
code that might be like a jump table or
something and this could be the code
maybe that doesn't look
better I'll actually say the first thing
looked
better code start there and the code
just doesn't stop
here you have like this little Preamble
here which looks almost like some kind
of jump
table pound rules what do you think this
is school one tells you the rules the
rules are all Unwritten and if you
violate them you're banned for
life just like real life bro just like
nature
I mean the endian is that's probably
wrong both them probably
wrong the other endan this no the other
Indian this big Indian does this do big
Indian or little
Indian do little Indian
big or
little you know where that comes
from Go's
travels know these both look like
equally
wrong could one of them be big andan one
of them be little andian
that looks like slightly more
correct need
[Music]
dock okay um another
idea so if we look at this one we should
be able to find
2o1 there we go right there right so how
about if we look at this
one not in there a that
sucks okay you see how this here is the
binary code for that uh that register
right
so we can we can see it there 21 it's
clearly a little Indian thing oh what if
they switch the
indianness
AHA
21 now I mean it'd be nicer if I found
it next to 2
e2s wait
e102 no that can't be
anything I don't know this is a tenous
effort I might just mean something
else there is structure to this
E4 I group them by
four can't read help of course
not
G4 yeah I mean okay that's clearly the
structure take a look at it and yeah I
mean I have reason to believe that it
actually is big endian
okay
so I I don't know about this 21
thing let's look for the real
address maybe they use maybe they use
the correct addresses in this thing I
mean it can hurt let's take a quick
look and they have some like translation
layer I don't know
okay 1 B A1 is there 1 ba
A1 A1 one b no let's multiply that by
four we can try
[Music]
no 21 stuff sort of interesting let's
look around so you guys know about this
GP flag we can look around
it we didn't find any 22s anyway so
there are 23s or 22s which makes me
think that it's just not that
maybe xor the two
columns you can try that welcome protol
Lambda I don't think they're perfectly
aligned though I think we have an
alignment issue right cuz like it's not
like uh
no it's it's not that
CU I mean they're not even like the same
structure
really I don't like that one big IDE a
little Indian too it can't it can't
really be
that I mean they just look like the
wrong Indian this if those just those
like look like the wrong indianness to
you um I don't know I don't know how
else to describe it but just that they
kind of look
wrong all
right uh there were Ry files
that explained this
R files that explained
this uh in in
F32 BZ
visual analysis of binary
files
cool wait I actually this a new tool
for
what is this
what can I compare it to
something curve color scheme
snapshot what is
this the site has some examples
yeah know this it
just this one just has a lot more zeros
to
start what even is the ordering here
cool yeah I mean I don't think I think
it's just like it's just a different
processor
um ideally we find some docks on it you
see what I mean how it looks like the
wrong indianess like those 93s should
probably be at the
beginning oh I'm actually here we're
looking at 3200 we can also look at
12200 which is probably more likely to
be
similar open both bins and Bin viz I'm
not really sure what I can see in
bz but like these look very similar like
T not it's not quite going to be
exor but those numbers change similarly
to
that there is like a lot of shared
structure but
not
exactly all right so where's the fail
overflow
talk radon
talk it's a talk that this comes from
where did they find the docks on
F32 upload F32 firmware
easily pull firmware blobs custom
F3 MIP blobs not complete this assembles
all the
instructions instruction syntax same
shamelessly shamelessly stolen from arms
so this is actually just reverse
engineered this is totally reverse
engineered the rif files don't include
anything about this
H um okay let's look again for 20 let's
look for
232s but let's do
[Music]
G4 and I want to switch xxd
indianness
uh
here okay
how come that found stuff and before I
didn't 2301 there's
nothing 2302
2303 no it's it's not right
[Music]
not complete disassembles all
instructions used in
Liverpool
firmware W so this is actually just
reverse engineer
like there's techniques you can use to
reverse engineer this stuff we could
[Music]
probably well
okay so first let's make sure we have
the right map firware we're loading it
from yeah we're loading it from here
okay uh let's load the we're on the
computer so this
one where's the instruction pointer we
can get that
we can dump that with
UMR Bo this shit is so
addictive okay so when we're not doing
anything we're hanging out at
[Music]
9123 so I'm going to
guess if I actually run stuff it's
different yeah so I'm going to guess
like this is interesting right this is
probably going to be the thing that
parses if we look at that function it's
probably what parses the
uh the AQL
packet what's the what's the biggest one
we've
seen this
one bigger
one get thec hang on let just check that
and
watch you more have a built-in way like
polar
register should also be able I think
this
works wait
what no okay I got to do that with crap
whatever okay um idle running AQL qes
goes back to Idol
cool uh okay
so there's a question of what the offset
actually is to get there I'm going to
just take a wild
guess and say that maybe the offset's
100 we can just try
it this is non Rosetta stuff
style ion range this time 4 it's got to
be Time
[Music]
um just do
that I think that's I think it's big
yeah I've used taxine before but I don't
think that's going to help us
all right I mean there's a whole lot of
things that could be wrong here it's
probably actually that
we don't need 100
20 no I want to go to the last one we've
seen so
dirty you see anyway this looks like
it's launching a kernel
actually it's probably not the konel
launch what if it uses qwords I don't
think it does like the structure just
doesn't look like
that this probably also is more like a
weight
loop I would think that this actually is
not every I take it back this is
probably a dead end
strategy comping is also
pretty
questionable it doesn't quite look like
a jump tap okay let's try this okay
let's try it from another angle
let's look at the jump tables at the end
let's look it after the code is
over uh where's my firmware info
tool here a do out
no okay the U codes the whole
thing except for the uh except for the
hex 100 header okay so we know at least
all those offsets are offset from
uh from hex
100 which makes a lot of sense right
so probably is the right place to Lo
down um so we also have some other
stuff gp6
gp1 those all the GPS we
have should see like there were
more maybe not I thought I saw like 10
and
stuff like there's
R15 uh do I have to do the banking I
don't know how banked this is is this
one
banked where's my shit with the
p
CP no why is it
launching also might only apply
program counter start c0000 okay wait
what's C *
3,000 okay so it's really at
then 3,200 it doesn't seem right why
would it say 3
one second let's actually take a look
maybe it actually is at that would be
3100 there's nothing there
that probably means
that so maybe it's plus
200 seems unlikely
but
or 18800 not it doesn't seem
right that probably is the jump table
and then we're there so so the offset
might actually be 200 if we want to see
the code that it was
running um what's the one idle instru
it's not like the one idle instructions
look
special looks like all the same shit
except wait a second that's interesting
right
there 3 2 1
Z could that be
[Music]
anything move move something
into the que running
zero is a little bit
[Music]
different what are the uh numbers
supposedly in this IP
block it doesn't look like they're the
same in the IP blocks
either so in this one they're 301 302
303 um but in this one there're A1 A2
and A3 if that is
any
bearing that could be so much different
stuff it's also backwards from the other
so it's not that right because they're
doing zero one they're doing one no it's
not that we're grasping it straws
here um
it's not
Q just some register move
instructions let's look at some bits
pipe reset valid on cash
step instruction point is only really
interesting thing there's supp start and
start high
those GPRS are not the GPRS I
expected why can I find
this in
there let print the value too
so like that's what I would expect to
see 21 22
23 that sort of structure that's the
registers for
look at that look at that repeated
structure I'm probably not going about
this in a smart way how do you reverse
engineer an instruction set wow okay
that's not just a repeated structure
that's like an entire repeated code
Block it's almost identical except it
has some differences
get push
what I have nothing yet here you want
the Rosetta crap I don't want
that you don't want that doesn't do
anything
yet okay how are we going to
find how are we going to reverse
engineer an instruction set
we have you're not going to do anything
with it um no offense
bro counting the occurrences of a 4 byte
value
[Music]
well again how is that going to tell us
what anything
is all right it's a little nicer now now
we now we at least like can see the uh
this is the structure of the other
stuff so like you can see the register
is shifted over there it's very possible
that it's just this value but shifted
somewhere we don't even know also if
F
34 no I I don't know what you think's
going to pop out um
all right I want some food that isn't
chansi Magic
chicken this looks like the same
register store
crap
okay I have one Theory I've had to find
these go through everything
um okay what I want to do is find three
instructions next to each other that
address those three
things so let's do
that okay 4K in it's 4K in
that
um let's
[Music]
try for s in range what can be the max
16 K shift shift left
s um
uh
and f
f
vs
vs Sub 0 =
21 we'll try both and in this too okay
CR
Val X add time col okay let's
go reques about for four bytes
I no
doing
this no uh no
lock that'll find it in like every
possible shift
uh okay let's just look for
E2 okay we have E2 fo2
do2 less
interesting I want oh and why are we
looking for eo2 I'm actually looking for
let's look for eo1 CU that's the middle
one um now 21 gets us more
e102 it's a trolling it's like almost
right I still understand why it's not
okay one
ba1 doesn't exist at
all barely
exists uh let's just try the minimum
there
[Music]
two why why is the 2 one in here and not
in the in the other
firmware that doesn't make a whole lot
of
sense okay right so we should find
something I don't know actually for
reference let's just make sure we're
doing it right
right
um let's do this on C1 see
if yeah see 2o1 22
23 okay so that it's hitting on
this to be fair it's like not hard to
hit on that but let's try the
20 um let's go to the other
one it's not in there
thises it's not in
[Music]
there this one kind of is interesting it
has eo1 fo2 eo2
do four two more all right this is
getting
stupid my relative
jumps want the E3 come on
[Music]
no let's search both Indian
thises
oh noow 2 ones in
here any shift but I guess we never
really solved the mystery of why it's
2e1 to begin with is it always 2
E1 yeah this is 21 as
well which when you multiply gives you
compute X but then this one
isn't is so fixed on
offet 1260
[Music]
[Music]
um
where's
yourr I actually read that
okay
why why does some of them run some code
and some of them run the other
code Navi 33
why does it have a different gfx
ID okay it's like a totally different
chip so it might just be different but
wait then why is
uh
oh oh that is the same
okay I mean this is one of the things
that I really just hope we get from AMD
if they they don't open source this they
didn't open source shit
you know I bet they liced that core from
somebody too I
we e
Oh you mean what's loaded into
r0o F32 just has some dots on this f r
Zer is always
zero so that's actually just the GPU um
we got to order some food
what will make me not be
tired structure
let's forget what's the
flag
G for
now they they named it
that this is just this is just me
I'm doing it with static analysis is
going to be
hard
maybe I yeah maram probably did live
stuff for the apple one I did live
stuff uh I feel like I've reversed
another instruction set
I I did the one on the Google Coral as
well and I also did live stuff but it's
not that
easy Well we'd have to figure out how to
modify the
firmware um the other very useful thing
okay now I have an
idea let's see if we can figure out how
to get registers out of this
thing so these GPS aren't what you think
they
are but
the instruction pointer is definitely
real
okay we probably want to read it at high
speed anyway
there's got to be some way maybe
there're just not documented
I can single step it
also what are the other there's other
banking things forr
context register
Bank this has to be srbm stuff
I mean this is so interesting too what
is
that why is that changing
why does that go up every time I
don't doesn't make
sense oh
is this
a is this in the
thing
uh no where does that come
from oh that might be a different
firmware maybe where was I
that
reset what is U code adder
like it is it's what you think it should
be then it's like
the maybe you can like write to
it like every time it gives me a number
is it the
same I feel like this is poking
something too or just changing something
it's every time I run M that that
changes what's the hype
Mech why does it have a hyp
Mech the same is it the
same 782 B4 F0
look at that structure
we do also know that this new language
is a lot more verbose than the other
language it's clearly
not um 8 bit in 8 bite instructions
because like you can look at this
structure just actually let's line it
up uh what's the xxd flag to do
that calls
maybe one
more yeah like look look how much more
structure looks
now usually just do this in a hex editor
I don't know it's a like do things on my
Mac um usually like just do this in a
hex editor like drag it until you see
structure 1 2 3 4 five six 7 8
nine it's
10 1 2 3 4 1 2 3 four five six 78 nine
okay 9 * 4 is
36 at that structure
does the same structure appear at all in
this
how I oh
here sort
of
no anything this one seems structured
around no let not let's just lock um
if anything it's definitely one less so
it's 32
maybe see there are different spacings
between
those oh here we go yeah this is the
same sort of structure
look at the structure
here wonder what it
means structure
knit
stuff clears the registers or
something 54 a
dump is that structure
it's going to be like
5380 here
store and 6
EB store and 6c C store and 6c D store
and 6
e yeah okay so there's your stores right
there
here would say the indianness is
revers the end to differ SW the end in
this fits with my pattern of this being
big end
end this is storing in 601 62
604 I don't know we could just be seeing
ghosts
man those differ
is it risk five
no God knows
what what's that first instruction
load and then a branch find the
branches is that a
branch look at this pattern
you don't even know if they're ordered
the
same all right at the end here jump
tables are those jump
tables we that bis thing would be useful
here okay well I think we can answer
once and for all the Indi and this is
minus
a because those things are clearly
they're negative jump
tables with absolute offsets
[Music]
jump
tables jum tables in this
one doesn't happen
junky
[Music]
code lot of
emptiness some kind of jump there I
don't
know hey AMD why don't you release the
code
we've tried Googling for this so many
times
it's in here I
wonder what does this
do
okay probably yeah static stuff's a
waste of time here
rs64 there's all the RS
64s there's gfx
rs64 and Mac rs64
why is there no Mass
rs64 what's a
gfx the me and the pfp aren't running oh
here the mes has one two that actually
works is the mess rs64
not thought I remember looking and it
was yeah you can tell it's r64 right
away if it has the big oh that one
starts even later yeah I've already
looked at this a bit
they made their
own CPU
core CP firmware oh here gfx firmware
header is a CP
e V2 header
what is that not the
mech where's the gfx fir
where this is even stranger
okay not that not that
it's an obsession
guys gfx is all these
things Max C and why does gfx have its
own instruction
pointers do they change
that one
changes gfx ones don't seem to
change being able to single step would
be nice yeah we could totally do that we
can halt the
Mec we can actually just halt the Mec
and watch other register change okay
let's do that let's do that who's who's
still with me who's who's ready to keep
going
people it's not a debugger we don't know
how to dump any of the registers yet I'm
not sure we can but yeah I'm done I'm
done looking at this I'm not going to
find shit
where
we'll get there okay
um let's create a new file called active
yeah I think you're
right um okay let's figure out how UMR
works we just need to map these
things um
oh we're not going able to suit all
python nicely are
we may we well
is it AMD GPU
regs we probably also need os. openen
F
RS uh.
seek
lseek
um all right
[Music]
FD position reference point in the file
there three fixed parameters what that's
just not
right supposition the beginning of the
fil that's the last one but we need the
actual
offset I
mean not
that but I do think we need the IP block
offset uh so I'm interested in
Mech uh in
[Music]
inster
rs64 in po okay here we
go so what's
this uh I'm sure we have to multiply
that by
four os. read fd4
Val Hexum
valx all right
um pseudo python active no
hexp uhud
python oh that's gonna mess things
up I didn't need hex dump that badly
okay uh GP still work
yeah still works okay good uh where was
that IP block offset stuff we were
looking
at here we
go wow that's deeper than I wanted to go
but okay what no that can't be right
that's an easier way to get there
can I just do
that
no no it can't be it can't be that that
can't be the path
now come
on what
whatever that's the
path it's probably some similing to get
there
faster
tc0 gc0 we want GC Base
address
[Music]
um okay why are there four base
addresses oh
1260 oh that's really interesting wait
is that the
number if I do
1260 a
dim this one
[Music]
yes okay we found that
number you got you gotta always you got
to keep everything in mind you got to
remember
everything but then that actually raises
questions about whether that's a
real Base address or not it probably
is okay good we solve the mystery of 12
Let's uh add that to my notes in Mac
[Music]
okay that explains that mystery now I
guess
unfortunately that makes me question if
I add to that or
not let's just try
both but yeah we're going to need to add
to that I'm pretty sure we're going to
have to multiply that by four
that useless
uh
100 nothing um okay there's a whole
bunch of registers what's regs what's
regs 2 what is SMR what is UMR open
basic options no kernel no files open
amdgpu vram amdgpu okay only open this
if regs 2 is not allowed okay well let's
try regs 2 it seems
better that times
four add the times four
back why is this
so
[Music]
useless I assume it's Asic mm that we
read because they're mm registers right
they're not pciu registers okay they're
definitely mm registers but maybe
something else is WR
wrong
um I we can get rid of both fours
maybe doesn't seem right but okay that's
something at
least it's not a match
though we should see 91
see
something F1 garbage it's just not
right why is this
wrong last time I like try to like dump
that it like crash the GPU too so I
don't want to do that
I'll just figure out how this
works I don't like having to Su python
either
whatever problem for later okay uh it
opens regs to what are these other
addresses why are there so many
different base addresses
why are there four of
them should we try them
all what is Harvest don't
Harvest UMR must read Base address
not in
there does it how does it know how to
read
register these are Bank drags but
whatever we'll start with bank drags
okay you find rag data by IP instance
find data by IP instance blah blah blah
blah compute inst
name find the IP skip over shit
um register name starts with mm this
avoids having to
[Music]
recode find reg data find reg data by IP
find reg data by IP instance find data
for
develop how do we read
register apply bank read banked red we
find it now we have Asic reg functions
read reg so it's the bank
address times the reg address address
plus one what does this actually
do
oh they view more
interesting okay here so if it's R if we
need to apply the bank bits we do the
bank
bits
um L seek okay
okay I mean it just looks like we seek
and then we
read for R mmio and the IDE is M2 which
is what it should be I
think AMD GP regs 2 okay that's the same
one we open here that's right so must
just be that my Base address is
wrong okay um read R that's a real
address so it's just the actual offset
thing here
not by name and IP instance okay so find
data by IP instance with IP
okay so we find it in there why are we
returning
no turn as6 blocks R
plot R data
why does it have multiple base addresses
let's try them
all that one was big let's try the big
one
I'm worried about crashing the GPU if I
just cap the whole thing and look for it
but we could just do
that it's not any of those okay
um why is it not any of
those why does it have multiple Bas what
does this even mean why is this multiple
base addresses does this shit read that
parse IP Discovery okay there might be
some flag INR actually there's
definitely a flag to dump the
IPS
um dump Discovery
table one
dash
okay uh GC has all that
crap oh sdma has that same Base address
what I guess they're all in GC okay so
that actually makes sense
GC yeah okay that the same base
addresses gc1 num base addresses those
those okay um where does this Base
address get used how does this get
translated to something okay you know
what here's an idea let's go active with
our debugging uh how I just read one
register s is scam but what if I just
want to read one
uh scan print an IP block by
name read a value from a
register okay
sweet um recompile
UMR I'm already in here no this is not
UMR on the remote machine close window
new
window this but not this open folder
buildr
yes where's that LC you know what better
idea fucking s Trace let's go
boys there we
go why I waste time with that see
that all right got a
number X is
this um okay so for some God knows what
reason oh it's right okay so the that
minus that time
4 is what 2800 okay so not one of the
state base addresses but if we set GP
Base address to
this then we do that it works okay so
just as Trace that
shit hey look we got an address all
right cool let's onun that and let's put
that in a tight Loop boys tight Loop
tight
Loop
whoop yeah look at that all right we're
decompiling shit now
and by decompiling shit I mean we're not
doing shit but let's go okay
um stru
unpack that way I I might have got that
backwards import OS stru Val fuck hex
dump Val let's
go all right we're going to load the
firmware let's load the firm where Mac
r64
offset 200 we established it could be a
lot of things okay
[Music]
so read
offset neck RS 6 Plus Val 4 plus Val 4 +
4 stru on pack we don't know which way
the ending this is but I think I think
it's that way so we'll call that patter
let's do a little nicer call that
data
actually we don't want to
that
x x
okay
cool uh so it looks like we're not
reading nearly fast enough to single
step and we don't even know if that
offset right so actually we'll wait a
second on
this um
[Music]
okay still way too many
uh fast as python
so kind of rather than be
hex okay so now you kind of understand
like what the instruction flow looks
like right
still putting that way too
fast code is so
fast that print's got to be so much
slower than the actual
read um we can also do a more aggressive
uh
I don't really care right I just do
anything that there you
go okay so that's giving you an idea of
the
mech doesn't exactly tell us why it's
jumping to new
addresses I mean we're just hitting it
all right I'm running the test Suite
right now for tiny grad so these are all
the different addresses the mech is
going
to hex 400 it might have even
rebooted like that's looks like the
beginning
okay this is
interesting
um not
really it's okay there's a Hal I know
there's a
halt so why is that the Base address
what is that is
that what's that divided by four is that
a00 okay that's a100
okay for some reason that's it I don't
really
know um
what you can't clock down I don't know
how to control that you think I know how
to control the clock of the
firmware I don't okay so the this is
like a trace of the instructions we have
the firmware
loaded so something kind of like
this
uh we're not hitting everyone we're not
pulling nearly fast enough to do that
I could rewrite this in uh in C or we
could say like here let's do something
like pole 256
wow I just think of how much work
Python's doing in this though compared
to like what it would be in
C okay we'll write it and see I don't
even know why I wanted to write this in
Python so much we can write it and
see I think we can load it fast enough
and
see that we can see
one we'll write it in C and we'll
compile it with O2 isn't actually that
much more TR
safe oh I'm always upset when I'm
writing C feel like remember how to like
include F
control look like o rwr or read always
fine whatever FD equals that why is this
not okay fine um
LC
d p Base address is
400 this is
is actually not going to do that in math
whatever I mean I can just do that math
beforehand I do const
exper just do that math
beforehand just the same thing that I
could have just stolen that from
as uh seek set what is it in see what do
I include for seek
set uni STD great Gotta Love
c g light up
now
should set is not defined what
semicolon
um don't see
anymore oh you know what better idea
Define yeah use the pre-processor boy
get your get your constant folding on
yeah now we don't have to do any
bullshit perfect yeah fold my constants
fuck you clang wow I'm really I'm really
I'm really not all right calm calm
down I hate coding
see don't
count this stuff is so addictive you
know you guys think I'm on drugs
there's nothing like it's just puzzle
soling almost pure sense beautiful
puzzles let's just do that that's right
four um cool we did some defines
great dump IP yeah dump
IP instruction Point uh compile that
with
O2 read is not def clang is faster than
GCC
clang yeah clang doesn't care that reads
undefined now after the fact we can go
through and do like print
f x88
[Music]
yeah let's
go all zero that's CU we
in it's just because we're not doing
anything right now so that's got to be
the weight Loop
also figure out oh God see everything in
C is so
hard I wish something was like python
but fast should we should we written it
in Rust is rust the appropriate
language all right let's just exclude
1923s um what
I less than dump
count uh and then if dump sub
[Music]
ials
19 exclude those
I
uh notal to 1923 I
++ we're doing CIS calls doing read and
a CIS call we don't want to do that why
don't we map it what am I doing can't we
just map this let's map
it all right uh see notice how there's
still more than one in between which
means we're not actually getting it down
to the perfect
resolution um but let's map it so
map um
I mapped it in Python probably fast
too why why am i l seeking and reading
what this is so
slow uh okay want M map and FD C example
map FD
[Music]
example that map for a read only file
yeah looks good
cool
um uh if map equals map
fails pointer pointer
M
failed
GPU that's
pointer map equals map fail if like
include some crap for that yeah
great um is map failed included in that
undefined I don't know uh size what size
do I
want I want like an offset
too let's try an offset like
that four PC Base address times 4 for
size I don't know like
8,000 10,000 there gu here map
failed map
failed you should just be able to say
GPU sub
that dumps I equal that making CIS calls
that was crazy
just kind of work
right map failed it's not surprising why
the map
fail I don't include sdio
fine that didn't
fail does fail oh this map failed no
such
device why is it not a device what
oh the colonel doesn't support M
map no such device all right Colonel
doesn't support M
map have to do that from the kernel if
we want it to be really fast is there a
way to read and not Advance the file
pointer at least only do one CIS
call not trange the fin point of PR is
this a
real is that a real thing
okay so I need
what offset
put the additional fourth argument
offset for the desired position inside
the
file oh I didn't D Plus+
cool we love
pred get rid of that
crap rid of that crap rid of that crap
that's good
crap
doesn't work sad
face yeah so it's not
that must just be wait this must just be
the loop to wait for a kernel to
complete um we can probably find the Min
and the max pointers here and then we
can at least find where the jump
is okay uh histogram
it's the biggest how long is the file I
don't know whatever it's should be
fast uh equal zero so initialize it does
that work you didn't use the right
version of C++ to support blah blah blah
I hate
you
um so that's the
dumps uh that's fine
actually um
um
histogram do
dump read into
dump histagram sub
dump uh
Plus+
for I
ium count I plus plus it's been so long
I'm sorry I can't code
c c is so hard you can do
this Geniuses man Geniuses Cod seeds
right okay for
uh Max
add
z
i++ uh hey hey can we stay on topic bro
I know you just subscribed but you know
we're this is on topic
stream if
histogram sub I not equal to zero print
F
[Music]
X8 and we're going to do I histogram so
okay let's try
that
cool uh so yeah that kind of shows you
where the is like if we just run it now
it's just all on that one thing but if
we go there you can see that we're
hitting every single one and that's the
loop so we know that this instruction is
a branch to that
instruction
right also know that this instruction
takes more
time what do we think guys it's pretty
good right
we figured out our
first r64
instruction whatever is here and we can
mess around to find the uh actual
offset all right let's go back to
Rosetta
here
um actually we do want do that
okay so do we think that that's a branch
instruction or do we think that we got
the offset
wrong why do we think we got the offset
right I'll also note that this one was
never hit
so CA must be a jump over one but we
also that 200 might be wrong we have
good reasons to believe that it's
100 does that look like a branch
not
particularly okay we have reasons to
believe it's both 100 and
200 and 1200 and
3200 definitely not that
because that's the same instruction as
that we also still don't really know
about the ndn
this let's try
[Music]
100 don't love
that 200
3200 doesn't look right either
okay we can also read all the other
registers very fast so we have that U
code adder and U code data
thing but I'm actually starting to
wonder if that's the programming
interface um sometimes these things have
stupid interfaces like that let's
uh can I see the first ipus wasn't it
400 yeah it was 400 you're right um well
so okay if we want to do something this
is actually a little too fast probably
let's increase dump count let's go let's
take 16x more
time so that's going to get a million
samples okay so good we're hitting some
stuff outside of the tight Loop right
there
but remember we can also really go crazy
and do
that that's going to get us up all over
the
place most instructions we only hit
once so 400 is definitely the first one
we see I agree with you
there um so if we think it is
400 which do we think 400 is do we think
400 is equivalent to
1200 then that would mean first that
would mean the offset is
200 we have other reasons to think that
too
because but I mean it's a little weird
because the header only says it's
100 but you know we don't really
know so you want to go off of
that it's interesting that that ends
at 400 would end at
uh it seems about
right so
four 43
C 1050 so that's actually 1250 which
would end around there which seems about
right okay I tend to believe that that's
200 we'll go with that I'm not doing
anything else right okay so do
that
uh IBO 6G * 4 + I * 4 let's write
all right then that's the
loop this somehow is a
branch to
there I think that Indian this is the
other ways
still n is in hit so this is also a
branch instruction
somehow don't see any similarities
so this is where the firmware sits and
waits sits and
weits it hits there which jumps back to
there it does this it must be pulling
something
pull pull pull pull pull gets down to
there jumps
back well there's bugs in the dispatch
and they're really hard to
debug so if we can figure out what the
mech firmware actually looks like we can
see uh what's going on we can make like
a debugger right So eventually like each
one of these is going to have a
um it's also crazy like look look at
this look at this frequency analysis
right it tells us how long each
instruction takes which gives us a
pretty big hint to what the instructions
are in
fact yeah it probably is this because
look that one is skipped there
too that that skips e and that skips
nine and they have
similar similar
structure they're not exactly the same
structure but they're
similarish oh wait there's an
interesting fact too
CD is skipping
to oh and DC is a branch
okay okay this this is 63 is some kind
of
Branch
CD DC is some kind of branch
how like the thing was
encoded they definitely big endian look
look look look at the
similarities I would expect also for
C8 CA and CB now see those are the slow
instructions and fast instructions
too so this is a slow instruction this
is a skipping
instruction this and this are skipping
instructions that's a skipping
instruction okay we definitely got the
alignment right BD is a skipping
instruction and C8 is a skipping
instruction and they're the same
instruction look at that okay we got the
alignment
correct because BD notice how be doesn't
run
you don't see be there so whatever this
is It's a skip over one instruction
instruction you'll see that it's
copied you'll see that it's also right
there and you'll see also that C9
doesn't
run okay we got the alignment correct we
know that it's
200 uh so the first bite of the four
bite instruction is likely an OP
code yeah so they don't know these
things aren't usually done by bite
um these things
are let's I closed fp32 disc let's open
a new
window and let's load radio
tools okay so this is what it looks like
here you have oh these are just like
where the registers are um the type of
instruction is encoded by a so the type
of instruction here is encoded by the
first six bits so something like that is
usually probably
right um what's more interesting what I
really want to find here is these
immediates so this is a branch
instruction and well let's just let me
put this into Rosetta here now we can
figure some stuff
out but yeah so this is the uh kernel
weight
Loop it would be interesting if we had
the other card and we could pull the
same thing to figure out exactly what
data structure this corresponds to but
we don't have that
card um I'm glad you think this is cool
now this stuff it's so
addictive like it's just you're solving
a puzzle
these are like the real puzzles of the
world
okay
so two billion pieces yeah it's got a
lot of pieces you ever been afraid of
pieces before I'm not worried about
pieces oh what's
this 7 f8
probably looks like the reverse
Branch so this might be a jump to
register
instruction this like loads
it
because sort
of I don't know maybe not
it's also possible that these are
actually
the of
these I don't know maybe
not okay we have to jump back hex
20 and that's hex 20 in the in the real
world
supp was 7 Fe a bit up where where there
a 7 Fe there
yeah oh
f8 7
Fe it would make
sense can I print the instructions as
binary sure but you sure you want
that I can't really read B
I I think that what we might want to do
is just
[Music]
assume I'll try it can't
hurt not that that oh I have to justify
it there's a way to do
this with
okay this is actually a good point now
the binary thing is is smart the binary
thing shows
me so CPUs aren't generally very
complicated
um so whatever
this is a skip
instruction uh this is a skip
instruction one more this is a skip
instruction see what I mean so they just
they're ones that don't run the next one
so C8 is a skip
instruction guess we can doesn't hurt to
display both
do I have anything
else I want UMR
the best puzzles are ones that give you
just enough
to but I can close this for
now okay you want to step the
mech we can step
it well maybe I don't really know how to
use
that sort them by binary I don't think
that's going to help does kind of show
where their's structure though so okay
like this looks like an immediate
encoding I guess that's just the last
bite it's not always going to have an
immediate those bits are always
set which is just sort of
strange this is probably a
register yeah binary was smart thanks
Proto C1
[Music]
and for
okay so here's something we can do if we
want if we want another function to play
with I can suppress ones that have
really small counts
we're going get a whole function though
looks like it's just all over the place
because it doesn't look like they add
up
oh least we can launch Colonels into
tight
Loop because it's all just
1923 1923 must be a really special
instruction oh here we have 441 and 442
I mean okay we definitely got the
alignment right we also know 442 is a
branch instruction
okay
okay let's
disassemble
400 let's
do X the
instructions okay so that's going to be
Branch instruction too right always end
with a branch
no the first few instructions aren't
really going to help
us like I thought that stuff would help
us but
so this is this is the first function I
don't know
why why did it like start
over or those branch tables no
okay you know what the binary is a good
analysis the binary is a good way to
analyze um okay there's a lot more code
here and let's dump a whole lot of these
and this is going to give us some idea
about the structuring of the instruction
itself
who suggested sort it it's actually not
the worst idea
doing frequency
analysis frequency analysis let's
go dude yeah you wait you can totally
just do frequency analysis on
code uh
you want a copy of the execution Trace
output yeah I can do
that should all be
fine that's fine
okay so what are the two that are just
always on have we ever seen them turn
off just for zeros
so
yeah looks like the first seven
bits okay so we'll say this is like
uh instruction pointers then we have two
actual ones they're always
ones so the first seven determine like
what the thing does I
think wait oh no that's a fake one
h ah let me just fix that we want to
strip off the first
three STP off the first three
here all right so that actually makes it
similar to
uh yeah that's like the nine okay I see
it now okay so the first six
are uh some kind of like instruction
thing like they determine the type of
the
instruction which is the same behavior
we see
here um those ones have a register there
but this one just has two
ones the indianness is also flipped but
whatever they're calling a is actually
the same
so I do almost wonder if it's the
same there's a chance it's the same
there's a chance the control flow is the
same you can pipe the output a sort to
Unique C good point
okay so
then where the
registers these are pro this is probably
a register
here all the instructions are going to
use
registers but okay so this is going to
be something like zero what is zero
here Zer are just knobs there so it's
not the same as
that 03 13 2B 13 7 those are always the
same why would they have two bits that
are just always ones
the hell kind of data is
this um okay let's dump the whole thing
actually how long is
it
uh do
that for
register instructions this is
B
63 Branch register Branch jump table
branch and
Link 63 wait is that the same that
actually might be the
same no six isn't right no it's not
right six bit op code five bit register
instructions do we know how many
registers there are no we
don't yeah
maybe I'm also going to print uh
uh
26 so those are zero type
instructions car isn't start type
be those look like
immediates for
that ingredients is just the last bite
being an immediate you know maybe the
reason I didn't find it is because it
takes two instructions to load an
immediate on this new
thing AMD we made a new thing and now
it's it's twice as
big and so which ones do we think the
branches
are
63s getting into ones we have a lot more
of oh that's just never mind it's not
the number
the 11 and gfx 11
what I think 63s are
branches oh could they be absolute
somehow that has to be a branch to back
there
are the branches relative or absolute
the other code
there six threes are
branches 63
9 six there a ton of
these 514 but that I mean the branch
can't go that far can
it idea how big the memory is
okay I think these are move
immediates move big
immediate these sixf things
we don't know if this thing still has a
magic register of
one but yeah I kind of think that the
next four bytes are register which would
actually also match this
right no sort of okay so
let's let's say the next four Byer
register
make four bits or
register and that can be a big
immediate I don't see any of them when
that's not zero
though oh so it's probably
some maybe they have the same trick for
zero and these are all the various
registers in the different GVS and it's
being loaded
[Music]
in 27s
are move immediate
write out a whole move
immediate um what is this usually called
it's not usually the uh it's op code
let's call that the op
code okay so there two more of those
this one always has zeros there and then
the next thing looks like an immediate
move
[Music]
mediate move 16 bit IM media into
s it's sure what they look
like and the 16 registers
uh oh that's a good idea the immediates
we'd expect to see a lot of well we
wouldn't expect to see zeros but yeah
look here I mean there's a lot of ones
so that moves a one into register
zero um most of them only have
one that's a good
point there really were immediates we'd
expect to see
these are common numbers
is oh here look here the biggest number
here
is D FFF I don't know about
D it's possible that other numbers are
register it's possible that's not all on
immediate
okay now we're
83s I don't think those are bres
um well actually we can just treat the
first thing as an OP code then I don't
care that it's always once it's just
easier to think about so we can do it we
can keep it bit
aligned just make that part of that
and we can say there 63s is z3s that
that seems like that seems
reasonable um oh this is probably a
conditional Branch to here are we
assuming the Ops are the same size yeah
I mean they pretty clearly
are so if we're doing these move
immediates that's a 6f
it doesn't seem to have magic registers
anymore okay eight threes are a
different thing
it's actually kind of useless
instruction just noise
what are
e3s all right let's go back to looking
just at
uh at this region maybe we'll copy and
paste all of them
in okay so I think 6fs are move mediates
um start just disassemble there and
let's do exactly xx20
oh we actually get no
x21 load store load store load store
using register three is a
temporary with an
offset nine that's the that's the
skipped code so this is the code that's
currently being
skipped
um these are branches so okay
okay what this can do is skip over this
Branch because it's a jump forward
two I don't know what these other
encodings in the branch mean
these things usually should look simpler
than that
though I don't
know branch is ahead
14 the difference there isn't
14 it's not see either
that it's not
that oh they're conditional you're
right that still doesn't explain why
they so
much so it doesn't explain 14
they might all sort of be
conditional you have to have an
unconditional Branch right at the
beginning at the end right it has to be
an unconditional
Branch this has to be an unconditional
Branch oh so maybe 63 is unconditional
branch and 73 is an unconditional 73 is
UNC
Branch okay this is an unconditional
Branch
2030 ah okay that would make
sense 2030 might just actually be
2030 just keep going here
sorry that's a branch Target then
[Music]
uh i' probably be a lot better at this I
wasn't getting
tired yeah 73s are absolute
unconditional
branches 63s are conditional
branches there not too many of them
that's definitely what they look
like don't what the hell is this why is
this register set sometime why do they
usually end in b
why does that one jump to c00 no never
mind
wrong for
what things does the other one do right
at the beginning of the
program good okay we don't have that
anymore um
rad On Tools what is that
okay actually the first thing it does is
like not really
known we don't even really
know the last ones are an
immediate like look at that look how
complex that
is there's so much shit here
at least this one has a very simple
Branch
syntax which doesn't really make a lot
of sense but whatever
okay we're going to need more structure
than
this
maybe if I could dump the registers oh
that's what I really want
what is this H code data stuff
to yeah okay this is how you just load
it it's really
boring set the address to
zero store the
data one bit at a
time send some packets to control
it did they copy that in
if you're running it in some emulation
mode
sleep oh so I see every time you read it
okay this can read out the data but
that's not really
interesting it's the same data that I
put there
there's data
caches construction caches that's
[Music]
boring program counter
start
[Music]
okay we reset the pipes
be so good if those
GP registers were actually the registers
on the
uh on the thing but they're
not we know this I can look in
here vert
Haled return address
stack
pointer wait what
the M GPS don't change them right
change hang on
that says the insert pointers always
maybe they do change let's Quick
Check quick check
let's just do the stack poter
L does it
change oh wait so that's not going to
work
but also have Dum count for now that's
always
zero
R always
zero red adder
oh is it possible I have to Halt it in
order to read them
okay okay you want you want to get fancy
let's halt the Mac let's halt the mac
and if we crash a GPU that's the end of
the stream and we're going to crash a
GPU I'm sure
but where's halt
yeah Mac rs32 control
o
rwr I assume P works as
[Music]
well all right ma halt is one shift
shift left
30 next step is
31 the control
[Music]
pointer
this Mech hold how do I Mech
resume there is no macroom
maybe I just unset
halt all right let's try a quick
experiment does that break the
GPU we Halt and then we unhal
try read the
MD it work
declare
temp
that did I break the
GPU I do not
all right let's take some
[Music]
steps so I WR
step what does that do
it's always that one is that the most
common or did I just break
it I broke the GPU
no we broke the
GP I knew rwr was a
mistake no
we broke the
GPU we didn't even try single
stepping we just broke the
GPU well all
right what did we learn today
come back GPU
let's try to recover the
GPU I need to
stop I don't know you know I've never
smoked crack
but you solve a little bit of puzzle and
oh it's a
crack it's really
like this feeling is cooler than drugs
it's been a long time since I felt it
too I don't know but like it's so
stupid like it doesn't get it doesn't
get anybody
anywhere I wish there was an actual way
to turn the GPU off and on again
there's not but I wish there was that'd
be
cool let's put a lot more question marks
in all my Rosetta stuff
I've given you the tools you need to
solve the problem the the the like we
have it kind of have we looked at the
driver that detects the crash no this
one's
really once you get into like oh
up okay maybe it came
back oh it's
back okay all I realized my
mistake we got greedy we put a print
statement in the middle of the halt can
only halt it for a really tiny amount of
time okay got to even get rid of that
print
statement okay we just halt it so fast
that they can't even see you know so
fast they won't even be able to see just
like boom we just halted it can't even
see us we're like the
flash like the The Flash nobody can see
us where's my
kernel okay I take it back we were not
like the flash they saw us and now it's
broken
no and I reiterate halting crashes the
GPU even if you think you're like the
Flash
does eventually come
back I owe myself $1,000 for
what well oh for resetting it no man we
didn't reset
it e
oh I love to listen to some copyrighted
music right
now all right let's see if we're back to
where we were okay go we're back to
where we were we can do that we can do
that all
day so listen to copyrighted music I
love listen to copyrighted music
okay let's also well fine we'll bring
dump count back it's like so little
memory computers have so much
memory let's like go through and like
see this
I would love to listen to Vanessa
Carlton's copyrighted song A th000 miles
that's I think
appropriate all right uh I don't
think I think we're the wrong order of
magnitude if we're doing CIS
calls if we could find a way to not do
this with CIS
calls we want get a this is called like
a sampling profiler or some
[Music]
shit we get
that look how some of the instructions
take more time than others
though for
in Discord someone just asked for if I
had any ideas about the AMD crashes and
I said switch to
Nvidia
H yeah that's that's the only real
option
here look we got a few more but those
few more don't actually really help us
cuz there's so few of
them we need
more probably want to like resubmit the
same kernel over and over again and see
if we can get another
function okay I mean this is this is a
function we know that this has to go to
there I don't think it can go any anywh
else no I don't know we said we were
going to look for more stuff if we
didn't find more stuff we were going to
give up okay interrupt
data what's that do we get interrupt
sometime program counter
start what's it
meq shit's got pipes too
we're going to Halt it like the
flash I think we can
what's that magical
1923 1923 is some sort of weight
instruction it's the most magical
instruction in the GPO
looks like all the other instructions
dog
shit why is this one so special it's
like the specialist instruction in GPO
wait in Risk
five wait
really is the branch op code group in
Risk five
what if this is just like some big endi
in Risk
five no no no no no we don't know if
it's risk five yet
but okay Funk
seven
uh wait they all end in
0 they all have the same one one crap
about them
too no okay it's not fun it's op code
here
those branch instructions are all hex
63 if it was risk
fin it's really interesting
rs64 I mean the world is converging on
risk
5 three zeros and all two
ones why are the op codes all like
that is the first one always a
zero no what is the first bit me
then if that's the op
code it's too much of a coincidence if
that's just that that just happens to be
Branch I don't really understand this
though it's like reversed
risk five is the op code at the
end wait a
second risk five has the op code at the
end I got the endi in this
backwards is little endian and it's risk
five is this is this just risk five
can Capstone Deon power risk
five just C support
it just has to support it does it really
nod might be mad if it
doesn't Okay that was good uh install
Capstone let's go
is already installed love
it python Capstone example
I hate that that's the first thing they
tell you is from caps don't import
Star MD equals CS
Arch risk V CS mode
64 MD disassemble
Mar generator great uh
next stop
iteration okay
it's really just risk five
mostly there's a few that don't
decompile but I don't know are they like
[Music]
multi or we have some extension we don't
have here
no no no no that's not what that means
why I only disassemble one instruction
that's not even right
instruction risk five is Big Indian
Branch instructions just mostly the same
I most of the instructions seem mostly
the same
okay it's not exactly risk five it it is
some it's some modified risk
five
uh Proto thank you thank you this is the
reason we're going to keep doing
this good find good find otherwise this
was just hopeless
um and it is kind of big endian but risk
five is kind of big
endian okay
cool uh yeah that looks like code uh
let's try the beginning and see what we
get at the
beginning just like this
crap let's see if that final instruction
is a jump no the final instruction is an
mrr I thought it was a jump but it's an
m r okay good these these are all
correct every single one that's
disassembling seems correct oh this is
great you switched I forgot you switched
Canon to risk
five can't believe I wrote
nips you Canon is a new Canon actually
I didn't want to deal with go not
supporting risk
5 seems like like the loads in stores
don't work but otherwise we're good go
has excellent risk five support I
believe it
yeah this was so hopeless if we didn't
find out that it was almost risk
five God I can't even read risk
five but it very clearly is that what
are the skip
instructions okay so this is a SK we
don't know the skip
instructions okay what about the ones
that don't decode doesn't
decode maybe there's a mode
maybe this is just wrong or
something
wow
uh this is kind of it was risk five the
whole
time just normal risk
five nothing special about
it this is just going to look load into
gidra this is just going to load into
gidra let's just cut the first
uh uh say mac. B
wow remember that time that we uh spent
Forever on this and it was just risk
5 it just reminds me that time that we
couldn't find
UMR all right uh where am
I
uh all right so we know it's 200
uh get your run hey NSA you want to back
door this or no you back door that run
looks like it took a while to
start no wait no that's just Java never
mind
no no
okay import file let's copy it to get
Dr okay format is raw binary the
language is risk five
wait 64 I or 64
C what are the
differences risk
[Music]
v64 what are the
differences C is compact do I have
that I's regular base instruction what's
g a little general purpose base general
purpose I let just try G you sure I want
I I might want
G this general
purpose she's combined and I and other
stuff combined okay I
fine and I'm really bad at using gidra
too
let have to multiply all of these
addresses just multiply that by four
okay L good all right check out this
instruction wow it's in C
now after all that it's in C okay well
that saved us so much time it was
risk this is GNA you guys don't don't
don't spoil the the uh so you got put a
spoiler alert on this
stream
um it's risk five
God We'll add a little note we'll add a
little note for how stupid we
are
rs64 AKA risk five
AMD
man hey George hey the micro codes at
risk five
hey you know they could have they could
have just they could have just told me
man all right yeah you know what Young
Young me if this was oh I used to just
like arm I could just
recognize I don't have much risk five
experience okay great now we have this
in this is a big
[Music]
function no we're going here let's go to
the beginning
removing unreachable block
what I don't know how to use
this
um
okay well we wrote this nice dumper
let's dump some more
IPS can't believe it
the PSP is just
arm let's get rid of no op down here
they'll run a lot faster
it still spent most of the time in there
but it spent a little less time 1,000
multiplies
let's see if we can find the instruction
uh no we have to multiply all of
[Music]
these copyrighted music is going to have
to
wait good thing I already wrote that
dumper
so here is this
interesting this is like paring QQ or
something W look at all this code you
think any of it
works oh now it's risk five oh they're
going to include an FP
uh as far as you were told secure boot
is
broken I don't think so where' you hear
that I mean I tried a little I didn't
try very hard but
why is this not a
function oh there's probably a jump
table
somewhere it's probably somewhere
oh there's so much code
here I missed the old
firmware the simple firmware
that's probably some register somewhere
and we could probably load it into
gidra we're not trying to make this
assembly harder we just didn't know it
was risk five there's nothing off fisca
about this at all as far as I can tell
where's that one magic instruction that
it waits Forever
at this is the main like wait for kernel
Loop
oh hex
1923 okay so whatever custom zero is
okay how does anyone use this with the
default
uh I rename this L to rename a function
okay uh GPU weight Loop
uh yeah that's the main but no no that's
not the loop the loop is
here I never would have reverse
engineered this okay what is TP risk
five tp's a thread
pointer I think these are
uh GPU registers see if we can find out
which one that
is
[Music]
so we have the uh that looks like it's
already shifted which is kind of nice I
mean it seems like they really moved to
like a modern architecture with
this it's interesting that it can still
run the uh the
junk um okay what was the old GPU Base
address
well yeah these definitely are like pre-
shifted sort of
things just happens to be mapped up
there I'm not really 100%
about but we're going to be able
probably what's going to make this a
whole lot easier is if we can figure out
how to load into gidra the register map
at the GPU and I'm sure there's some
some gidra wizard who knows how to do
this by the way we can distribute the
binary as long as you include the uh as
long as you include
the uh the
license which is cool so we could
actually like collaborate on
this I don't know I don't know how good
gidra is at that I know there's like
shared gidra instances
but okay so we have to figure out what
this is going to be a whole lot easier
to read if each one of these was
labeled so there's some
segment mapped at that stupid High
address uh and no wonder we couldn't
find any of the launch stuff and then we
can just figure out which is the launch
instructions oh this is going to be so
easy
in
fact these
in this almost will just
compile why do we need
firmware all let's figure out our first
instruction let's figure out what the
first one of these
is
um so that what's the base of that
let's first divide it by
four
320d that sounds kind of
familiar we subtract where am I where
are I docks let's focus on one of
them do I have two sets of docks open I
do so make let's clean that up
I can close this
one not going to crash computer again
which risk five by the way risk
five which one did I
pick
RV 64i
oh I don't think that
matters I should try RV 64g I don't
think it
matters um load
with okay that's the greatest uh that's
the greatest note
why did nothing find this what's like
binw walk not do this I don't know okay
um 3 o where is my note I have a note
for
that uh CP
maybe I Sol this mystery before
right I forget where I put it though in
launching
maybe fine Mac here we go
this uh so that's the GC Base
address so let's subtract
that we're left with one
fad so let's go to UMR and see what that
is yeah hqd persistent State I be
right um
let's try to find where we can better
understand hqd persistence
state so putting on disp
active enable disp active I should even
be able to uh
also don't want to like can I put the
comment on that
line pre comment post comment how do I
just do a normal
comment why is that not like there I
don't know
seems plausible to
me one
fed AQL
control okay we have to figure out how
to uh load in this register map we know
how to do it
now um
loading register map into
gidra H load symbols into a map file
first we kind need a
region I'm not a gidra expert I really
wish I was better at this not sure I
know how to do this in I though either
but um
I got to eat something memory
map
add okay block
name
mm start address
Ram um
I can't copy that to get the number of
zeros right okay
great
[Music]
zero one two 3 4 5 1 two 3 4 let's make
the
length
x000 don't think it's bigger than that
but it might be but that's a later
problem I let's see what the biggest
numbers are in here
biggest numbers on our
reg this is all the
GC
500s 5000
so I hex 8000 I we could just do Hex
8000 let's just
whatever okay un
initialized did I get the number zero
right
I got the number zeros WR
of course I got this number of zero
wrong was
impossible off by
one okay uh
memory I wish I had an NSA engineer here
to help me
we get help from the
NSA the NSA has look through this
firmware probably
not okay where was I I need the memory
where's that one of these that
memory that's memory so we're
gonna
edit going to fill the
block move a block to another address
okay
good
okay these things are going to show up
as addresses now well at least that
jumps to the right place when I double
click on
[Music]
it all right so now we can label that
address what did I decide it
was it's uh
um one f
a reg
cpqd persistent
State no I don't want I want to rename
it that a comment
function no how do I name
it oh it's not a float no no no don't do
that don't do that no no no not float
no
clear okay it's
data it's a
dword that's
right oh I don't know why this Plus lvar
what's elvar
six how do I set a name for this this is
really easy to do an ID oh add label
with
L see oh I'm such a Giger Noob look at
that now we're
talking okay so now somehow does anyone
want to do this all by hand hell no
because we have computers oh this is
going to be so nice though when we have
like you know things like that
just read it and then yeah um we can
even like probably get to do those
constants if we figure out how to do
it gidr scripts do I have to write them
in Java are we coding in Java
boys okay let's convert those to those
addresses uh so we can put this in
here uh let's call it reg Maps
and we're going to copy this in from
UMR with a note about the UMR license
which should be
fine database
IP
gc1
r b a file small um
includ all copies okay um let's just
name it to
license.
Reg UMR
regs got to respect the licenses
boys it's cool that we can do this
publicly though see it's cool like UMR
is a public tool I knew UMR was was uh
was going to be key to this
okay um let's commit over here if I made
any
changes yeah I made some changes okay
let's commit
those okay now we have this one we can
close
how do I have did I forget a
change
no I'm so done with 95 for now let's
pull
that uh we don't just want to load in
reg Maps let go
here okay we need a we need a gidra
script
um
make gidra script.
p open
GC
read STP Splat
n it's probably a little more
complicated than that yeah I guess I'll
just filter all the ones that start with
two spaces for
now uh x4x
and
FX
rag yo I I love
python man you know how long it takes to
do anything and not python a really long
[Music]
time
um math
okay
cool
uh split
that what are those other fields do you
think don't really know but whatever um
let's do
in x sub 2 comma
16 x sub Z for x and
rs python wizardy
okay I think maybe we only do reg CP for
now
that is a rig CP right it's CP
cool so we know the CP ones are with
that magical offset that we figured out
this
okay
so for KV in
R uh we want to do K *
for uh no
K
*
60 plus K *
4 uh and and we want to add the mm base
which is all those stupid
zeros you're copying into the Java copy
buffer okay let's say G Adder equals
that just print G Adder X and then the
items all right let's double check the
one we did
do
eight hqb persistent State great all
right um let's do CP uncore I don't know
about CPC yet that's a
lot okay but all the CP on should be
right and like that compute launch
stuff's in here right because that's
what I'm really interested in oh is it
not is that something
else oh those are red computes those are
right as
well I don't know you want just do them
all well let's start with these
we can always do more okay
um gidra
script how do I want a python script in
gidra set as
volatile um
how do I okay like gidra load map file I
think that's what I really
want symbols import symbol
script import symbol
script should be able to use the script
manager so I have to do
what symbol name hex address okay that's
easy symbol name hex address
how does it know well that's not going
to know that they're all four
bytes let's just try
it script manager import symol script
okay um
give me a file to open okay
good G dra I got all
right cool um now I wish it knew to
label them but I guess it doesn't really
matter because it knows already
great okay um what's that
one that one is probably something
else see if we have that
one
a512 we don't have that
one something else
probably we don't really know why some
of them are
see some of them
overlap probably okay if I do that no
they're not equal what the
hell um that's super annoying what am I
doing
wrong which ones are
not IDE with this right STI equals that
or X in reg if x not in reg di x
sub sorry it's not right
um Adder equals that name
that if Adder not in reg
dict sub add equals
name uh else
print
overlap regs dict sub
Adder uh overlap Adder
XX sub Adder name
okay these are like mostly fine I
guess no they can't both
be what
who wrote this
shit no it's not to do a different Base
address they're just the
same oh but you know what I do wonder if
those other things tell you something
about what are
these what is this reg format from from
UMR
there docks on
this the father reads
it it might be some stuff that tells you
which one it is
number of instructions
no could it be relative to a different
Base address I don't think
so some of them are just like this one's
like low and high like that's definitely
not going different Base
address what is this 28
me oh maybe that's just how many things
it has yeah that has nine oh that makes
the file readable I
understand I forgot everything's
impossible and
C so that last one can be a
one it's minus one
what are
these the last one might be what it's
relative
too we might just want to exclude those
let's see if we can figure this out
F those files that like here these those
where's the thing that parses the red
files
someone's got to open these
files database
files oh what these compile
commands that's not interesting never
mind um Target rules for the database oh
just like a builds them
what oh they might just be built into C
red Class
Type
address no it's not that
what are these
files they will only include the ones
that have three zeros I think we know
they're
right oh look at this
this D9 overlaps with reg CP pipe
ID so that's probably not
right I mean it must be a different Base
address how do we figure out that Base
address how do we get that
1260 we know there's four of
them we can get it that from the IP
block
where are those four
here probably a base address off
set probably can get rid of
that
um let's also add a
assert R dick
sub uh whatever just check it my hand
okay it's got to be
this no wait that one is how many things
come next
right it's annoying it's kind of useless
then if that if those two
overlap what's different about
them oh CP pipe ID is like
that and then rsdm qbase is like that so
whatever the last one is that
matters but it's interesting
that CP pipe ID is there and we use that
one as an off
said let's check the one that we know is
right what was that one called
again hqd something get it from
G hqd persistence
State you know that one is zero and we
know that one is oh okay if that one is
zero and we know this one has an offset
of yeah that one just must be the Base
address this last number
here um 0 one two three four
five probably right
who
knows are there any threes and stuff
there didn't complain about being out of
range so that's
good mostly on and zeros PR boying
let's just check hqb
persistent yeah that matches
that whatever seems right
enough all right scripts import symbol
script R map. map do we have this one
now
where's the one we were
missing here it's the IQ timer no that's
a different one HPD status why can't I
double click on
that why is that there but I can't
double click on it I don't know okay um
let's find that compute one that I care
about red compute dim
y okay now can I see references to
it supposed to show
up how do I see references to that how
come this can't show me references
should be able to
right show me
references um
references show references to why are
there no references but I see one
here
reanalyze hate this
oh crap I kept the word
overlap all right I'm getting tired
this is like CTF when you got to
sleep able to demangle symbol overlap it
named things
overlap oh that's
terrible how do I clear all
that whatever whatever I should really
just reinit this but okay
cool look at that now we have
functions oh no references the compute
them I
see no
references contrl
Z I don't know about that
mqd
control no I I know it's undo I delete
and start over wait I know I can just
find the names where's you're to find
all the things I've named here overlap
perfect so I just need to delete these
I don't know if undu goes back that
far I can just delete these
labels
delete delete all of them no can I
select multiple and delete them I
can I can
name what show me the 37
more how do I show the 37 more also I
would make the font bigger for you guys
I'd make the font bigger for me too is
that like an easy thing to do
oh it's going to be only in one tool
never mind I would have made it easier
for you but I don't think Java supports
that so how do I get the 37
more there's still 37 more
that was only 27 more we'll have to wait
for more to show
up
types generic CB what's
float click the little icon next to 37
more what
icon you think it's that useful it's not
okay I'm going to guess that the reason
we don't have this is because not
everything's decompiled does this thing
have a nice mini map like
Ida can I see like
the no not
that okay I figured out how to get it to
come back all right
most look like such a noob with this
program don't worry
NSA I'm not I'm not an advanced
persistent thread I don't know how to
use gidra whatever whatever terms I
don't know
man uh all right analysis want analyze
how do I like more
aggressively there's a jump table
somewhere
whatever I don't know why it's trying to
demangle them anyway this is all code
it's just not being
uh
disassembled there's jump tables there
have to be there's a jump table leading
here now that'll just fix the font for
one thing I don't want to do that
um is there a way to do like a more
aggressive analysis that's going to get
all
these that even knows this code that
jumps
there is this the jump
tables we have the jump tables anyway
where's all those things with the fs
here down
here I don't really know what that
is there's probably other refs to
them like where do we find all the uh
where can I load all the
commands no I don't think so because the
problem isn't the problem isn't missing
instructions I really don't think the G
thing
matters I think it's just that there's a
jump there and like it doesn't see how
it gets
there does there's an XF
here see this is just kind of I mean
these must be the jump
tables what this
says um there's probably like a more
aggressive
aggressive instruction finder is that
actually a
thing oh here we go
so this thing is the mini
map look that aggressive Why didn't it
disassemble
this more code
here so for some reason it doesn't know
this is code or
something had like weird stuff in in
uh stuff's volatile I got to Market
volatile I don't know what overlay means
makes sense that there's no sdma
instructions okay all the hqd and mqd
stuff is
here um why isn't it setting the Q
priority and stuff okay read pointer
why is those red
now because I made them
volatile so that must be like Q number
or
something wow this is so
complicated is your base address correct
yeah
I mean I'm pretty
sure there's a jump table somewhere we
just need to
find these
things where's the
memory that's something we haven't found
either this
maybe this is probably memory
sounds like
that how can I create memory at that
place we'll get
there you're watching me learn gidra
that's probably the table right there
there we go sure looks like a table okay
what's that's an
address why is that not an
address this is this is the
dispatcher it's just trying to load it
from there and that's not
valid okay so it probably loads the
table into RAM or
something and there's like Ram there or
something let's name this U
code okay let's make another block
called jump
table
000000 I don't
know th we can always change it later
it's not
volatile all right that's not long
enough but okay so this is
a doesn't that sure look like jump table
base or something
something what's it doing
there I got to redo
analysis is it a for that cool I got to
get better with
my all right so a bunch of things
references
maybe what puts stuff there
um
nothing nothing it's just supposed to be
stuff
there this is the entry
point which is also not disassembled for
some reason even though I'm pretty sure
it's
code why is that not
isn't that in the mm
section do I have a different number of
like ones or something wait I must have
broken
it oh no that's
808 that's without an eight so this is
another
region I don't know what region this is
what is inm hard ID and how does it know
the name of
that for
that's like reads the queue or
something so much stuff that's just not
disassembled that should be it's because
we're missing a
table those are registers I don't care
about that it's the last one by the
way or are some down there oh we can
send DMS
sweet is f so big
it's just all
zeros I wish this had that built I wish
this had that binary map thing built
in no it's not
that look more like a hash
okay so let's find that as a constant
maybe search
for for address
tables
huh no address tables found in the
entire program
um by the way did we decide if it's big
Indian or little
Indian big
endian we have to find a poter of that
uh search
memory search
[Music]
value let's divide that by four
694 B
[Music]
all right now
lock that I put the ramp did I not make
enough ramp
make enough
round wait how do I make it
bigger move a block expand block by
setting new end of addess wow this is
the most Java interface I've ever
seen oh know it's called jump table x no
no no no no no don't
no
uh
SRAM
SRAM no why don't you I changed the name
names don't you respect my new
names of course you don't respect my new
names disrespect for the
Java we got a market
volatile volatile wait what is volatile
oh no it's not volatile the registers
are volatile though that's true but the
Ram's not it's not initialized
well that's an interesting program
didn't do
anything why does it think this is Ram
why doesn't it change my
names respect my new names Auto
rename it's not a real name
this the longest stream in a
while all
right still there's a lot more code and
for some reason my aggressive
instruction finder isn't finding
it I just want to do this manually
has to be a jump
T that's great so where's that
oh okay hang
on are we sure this isn't initialized
from something like this isn't
shadowed probably is it's probably
initialized as a
block there like a mem
copy it doesn't look anything like that
someday I'll be good at this some the
guys at comma are really good with this
tool
references I see okay so this gets
zeroed out
can I change the name of that have to go
there the other stuff is probably copied
from
somewhere copying the Ram or something
I know about that why doesn't what's
back don't the normal shortcut for back
work go to previous location
shift backspace
command
Arrow okay it's kind of annoying to do
on my keyboard but whatever I really
like learning the shortcut keys that
come with
programs and not trying to
uh mess with them myself
this is clearly the jump
table we just
don't know what it
is
48 you long tp8
it's not exactly right how do I set a
value for
TP cuz that's like
yeah it's not actually
zero like that's not I don't know why it
thinks that's an absolute address it's
not g is usually better about this
stuff code you long okay we just call
this here J L A
R why does it also think that's that
it's not
that whatever this is right
actually this isn't a this isn't the
command table this is the interrupt
table this is like an irq
Handler it's probably this is not
actually where the commands dispatch but
we also have names of
commands uh they're in
in here packet
three okay how are we going to find
these in F32 disc they just
like they just assume the jump tables at
the
end range code
size minus total size
some stuff here
is it
code
code uh dword I can repeat with y q RT
y like initialization tables or
something thing it's not a jump table
though yeah same as this this might
actually be packets of some
sort for
what I really want to find is where it's
setting those program things and I know
it's in the Handler and I know the
Handler can't be found because I don't
have the jump table
yet jump tables are like finding gold
inside
programs like there has to be a jump
table that goes
there like this is some function right
this is some some CP function and then
from jump tables you can start to figure
lots of things
out what look it that's the IQ timer and
the DQ
request window bytes
you're going can find Jump tables in
here it's a good point might I have fuse
like
this this looks the most like a jump
table from what I've
seen all
these problem is they're offset
something they're different
offset I'm pretty sure the offset's
correct unless things are
Alias all right let's try to like decode
some manually can I make an array
it sure looks like a jump
table it's not going there
though it's not a jump table Target
going a right here let's clear
those this one we want create a
ray more than
970 it's definitely less than that
I edit this
array it's like an array of an array I
don't want that I want to edit
this yeah these okay these very clearly
are exactly what I'm looking for we just
need to figure out how to actually parse
them let's also see if they correspond
with
uh let give this a name L for label
we're going to call it command
table CMD table so I can get back to it
quickly uh let's make I got to figure
out how to edit this array want to edit
the type
probably set
color oh let's make it
Pink it didn't do
either is that color
I want it to be
pink oh I have to set the color like
that
pink oh it's pink well that's the
ugliest pink I've ever
seen I made a mistake clear
color that only cleared the color from
that how do I select the whole table
again colors a clear color okay
the experiment with pink is over um
settings no how do I change the size
right click data choose data type ah 970
is too much what do I want it to stop at
300 is 300
good wow that's
cool okay um
I still don't know how these ma anything
though but it's got to be this
right let's see if these commands yeah
let's see if these commands line
up
KN set base
is there any reference to
this no references to command
table what's this stuff
right bites is the right way to look at
this okay they're clearly just offset
from something we just need to figure
out what
okay so let's write down a
few let's write down a few that we think
it might
be 2
d88 well that's a short one there 2D
F28 2D f
f8 2
[Music]
e OC
see let's go to
my command
table see find anything that like has
the right spacing for
that probably they probably all offset
something end an
EC f8
some way to map
this what's the earliest
one
4,000 4
f30 the wrench in the bite viewer to get
asky as well yeah that's useless there
not a single string in this
binary okay I guess this could be other
things no but it looks too much like a
jump table for not to be a jump
table it's just something's added to it
it's probably just one fixed binary
offset we just need to find out what it
is and we can write a python
script all it's going to be nice and
easy once we figure it
out
okay just some fixed
offset we have ideas about what the
range gear let's let's we're going to
have to load this into python anyway so
let's just do
that
um
here command
m.p um let's put the firmware in here
too let's change this directory name to
Mech
gidra uh let me give this its proper
name what's the actual name of
it uh
this let me get the license for
it oh there's a different license for
AMD GPU I
say cool
okay open GC
nein
thatt
find usually I just put the first one in
to find
uh the alignment of this is kind of
interesting
well I mean it's possible that they're
offset from the bottom
too could those be negative numbers
it seems unlikely but
maybe why are there 300 of them
too well okay wait there's 300 so that's
heck a smaller number the other ones are
in HEX
[Music]
okay
remember we are reverse engineering for
interoperability with our code because
their GPU is
broken um of course we'd never be doing
any reverse engineering if their GPU was
not broken
your honor the GPU is a broke piece of
shit
what why is of my highlighting
working why can't it highlight that what
python is it using 312 where you get
that
shit wait that's not the one I clicked
on that one there you go
okay all right so what's the magic
number that we have to add to those
things to get the command
okay there's one at d8 d8 let's
disassemble that
one actually have a lot of questions
about whether that's actually one or not
there like another jump
table with all these different arguments
there's another jump table
here this is strange code too
that seems like one okay that seems like
it just starts a function right so
F
84 that doesn't really seem like it
starts a function
maybe they
do I don't know like these could be
called by something else
all
okay differential analysis time we can
just see which has the same
difference
f490 like it' be nice to find some like
fixed offset set to add that finds you
those numbers right see what I'm
saying probably do something automated
to search for
that there probably okay it looks like
there's a no
op I have a lot of questions about
this where are the PM
fors we hate
pal you have a pm4 command
stream pm4 up codes here we go
90 and
91 no that's don't exist
the address just before the jump
destination do we expect a jump out
return or something sort yes we do I
don't think they all go to the same
place I
mean maybe they do maybe this is the
return sure doesn't seem like it has a
lot of refs
uh okay command
return more jumps
yeah
maybe I'm not I'm I'm more skeptical now
that that's actually the
uh the thing
now that that's actually I mean okay it
does look a lot like a command table but
it doesn't match the pm4
commands maybe they're like micro
commands
see that one okay see that one jumps to
command return in a different place this
has there has to just be some way to do
aggressive
analysis why is this not hitting on
aggressive instruction finder for
we do mostly jump to command return so
we can probably find them like
that at least in Python we
could why is that not defined
that should totally be in my
page my page not go that
big yeah I don't think made the page off
where is my memory
I did not make the page big enough
what's the
biggest if I sorted
these oh be nice if I you enough said to
sort them and stuff see if there is
o4 and not big
four there is three okay so we'll grow
this down
new end address is
here save close
that um
scripts go mayy
go that one didn't get
labeled interesting the secret unlabeled
registers what are HPD
your stupid AQL
control let's go down to M and see of
those
new I might just have them
wrong that that stuff I did with the
uh base offsets might be
wrong it's interesting how something was
labeled right near it
though probably not
PQ doorbell
control all right did the compute ones
get filled out yet there has to be
references to the CU priorities just
just automatically disassemble
everything
please all right let's pretend let's
just we spent enough time on this let's
just do this how many of are there 300
control a on the
code
okay I don't think so I don't think
we're going to do that that's really
aggressive because some of these I guess
actually they are just all
instructions why is this
not oh that makes it a dword wow that's
so
bad why does it not just read that
why can it not D wait unaected as
zero these things aren't
code I don't think
so there some constant p
wow well so much for you
know QD
timer no wonder this code doesn't
work look at how complex it
is this is what these bugs
are it's not in the mees it's in this
code hey AMD you want to open source
this that'd be nice let's find a real
bugs this is where the bugs
are like how does this code possibly not
have bugs can you imagine a world where
this code doesn't have bugs
we're going to have to write on
firmware well it's cool that it's risk
five we don't need a tool chain at
least we can get our own stuff built for
this is it signed yeah but I'm not that
worried about that how hard do you think
that is to bypass so some guy was even
posting that the secure boot doesn't
work on this chip I don't know I don't
actually think it's
secure my neck's starting to
hurt I don't usually sit at computers
this long while we haven't stood up in a
while either we've been going very
hard more this crap oh this is a very
interesting code's find an interesting
code where are those compute
registers that's what I
want see this all just variance of this
function
so okay there's a few ways to find Jump
tables one way is to be really sure
about one thing that you find and then
like aggressively search for that
one the other is with that differential
stuff the other is to find the
dispatcher you know what else is cool
about this being risk five we can
simulate
it actually we can probably simulate it
so well we could even hit the
hardware I now thank you for gifting
Subs I'm going to get some
water we might have to stop this is this
is getting out of
control how long was the twi SL
stream for
okay uh new
idea we have our active sniffer
okay we know that most of the
[Music]
time spending this
function where do this function call
from I wonder wonder where the ram is
and if we could dump the stack
uh wait for Kel
where is this called from
something's loading all the jump tables
into
here actually you want to try to dump
that I think that should
work let's just poke that in U code and
see what we get
poke that in you code and see what we
get um I don't actually want to commit
the uh memory I don't actually want to
commit the
firware you know where to find
it
h get rid of
that going to add this to get a
um
some the RS are fine great can't be
copyrighted from
mer um okay let's see if we can read the
let's see if that
works uh where's my
insert pointer but I want you code
add
thec the hyp
Mac Mech M1
which one was I reading it
from I was definitely reading some U
code add and it increments by one every
time you read it which makes a lot of
sense
okay here Mac me1 U code
Adder I don't know what me1 and me2 are
got to
stretch for
it's definitely the same thing each
time is this the code where is this
stuff or is this something else
I guess what's strange about it is
I've never seen this before
what's the hype Mac
compute load micro
code sure looks like how we load
it by the
way if I just write to this address is
anything
signed DP
more why is there all this F
d08 does this appear multiple
times oh I
see okay so this only actually hex 80
bytes
here it's just a repeating hex8 B
okay let's try a Val of
[Music]
uh
that same repeating
bites okay that's not
interesting I do wonder what they are
though for
oh is it also possible it's because the
GP is not
running
okay not interesting
just uses an off that just load
anything for
what power virus
power command
table what is
this people think this is
secure Ian that looks like the exact
kind of of crap that's in the
Mac well now we can know if AMD actually
open sources anything
real I think I kind of I feel kind of
tricked by the mees thing because the
bugs aren't in the mees the bugs are
this and it's like
massive look at this massive
file okay so where is the dispatch
command if I bypass AQL Q's how much of
this do I
bypass hqd persistent state hqd
timer they love that
timer that Returns the GPU weight Loop
unimplemented hqd DQ
request okay so these are like the real
Q's we can actually start to document
stuff
now these hqds are real
and we can read all the
registers mqd Base address mqd control
sorry if this is boring I'm kind of just
reading the code while I do this too
just to get ideas of like what's going
on here so you can see like this is
zeroing out all these hqd
pointers um so hqd is Hardware Q
descriptor mqd is memory Q
descriptor so the things get pulled off
of memory cues and pushed onto Hardware
cues
does everything on here just deal with
this Q management crap what pushes to
compute it's unimplemented instruction
too that does something I don't
know GPU weight Loop is like the main is
the Main Place everything goes to wait
when like the command is done
is this supposed to be
a show overview oh
here oh there we go that's oh that's
entropy what
entropy interesting well these are cool
views feel so
small just to raise my
resolution uh the hot Loop I've looked
at the hot Loop quite a bit
[Music]
um it's just waiting
on uh wait it's not no so it's not GPU
weight loop it's the other
function wait for kernel
here so the hot Loop is
this see where the wild
no it's
this it's actually it's some like
multi-threaded thing
okay that dumper was crap so let's get
rid of
that to our regularly scheduled
programming
Jo
kernels so these are all the things that
are hit while we're running the kernel
probably getting all of
them more
like tons of stuff with AQL
control bypassing AQL
might you know what I bet it
is I bet
I bet these didn't support
AQL okay my theory and someone can
confirm this is that these ones didn't
support AQL there's almost nothing in
the mech everything's dead simple once
you start using uh
pm4 but all of this AQL stuff is what
added the hundreds of kilobytes of code
and then when we went to risk five it
doubled the size again
because F F32 is more compact than risk
35 uh
risk five for several reasons like this
has like a hacked register and stuff but
they moved on these to risk five which
you know good for them um what year were
they released uh go go check these
someone go check if if Bon a and stuff
supported
uh support risk five
I'll notice also that none of the red
computes
work which I kind of have a theory about
well these are what's
HPD I think this is just an undocumented
register what's HPD
yeah I'm going to guess that the compute
ones
yeah probably in some
other we do definitely know that there's
another
uh
region possible that it's actually just
the same thing just look
Shadow cuz like none of these are set
[Music]
there well hang on can I search for
other AQL constants that are searchable
we need to
stop uh where's Tiny GR
yeah these aren't very searchable
unfortunately no it's not hot plug
detect
um it's not that it's risk 5 I think
that they didn't support AQL and I think
that all of the crap in the Mec just
exists to support AQL and if we bypass
AQL uh we won't have any bugs assuming
we write our pm4 packets
right none of the compute Rags exist but
it oh it's probably
this yeah here we
go b29
C is there a wagon just like map the
registers also
there for
[Music]
yeah there you go
all let re want
analysis ah compute
DX right
there those are user registers okay I
don't know why the compute ones are at a
different
page uh should we just admin at that one
too it's probably pretty
easy can two addresses have the same
name
they're probably just mapped in like a
different
way um we'll just change the name reg to
Alt
uh script manager import symbol SCP
R map. map okay here we go
cool yeah I'm really red by
anything unless there functions around
here that
aren't what
why isn't it referencing those
why isn't this doing
that why is this broken
got like nothing from that that was kind
of
useless why does that work why is that
not be compiled here
but it is done here that doesn't make
sense how do I like red decompile this
who
else
okay I think we just raised more
questions than we answered today there's
so many questions in here this code's
just full of
questions what does that
do I have found out why there are so
many bugs in
this there is no way in hell
that there aren't 17 million bugs in
this code and we have to move off
AQL for all we know the bug was
introduced on this GPU when they
switched from the F F32 to risk and it
has like some different memory ordering
or
something like who knows
when it allocates
resources
God where did this code come
from it looks like it's been the same
code going back to
uh Polaris
I mean it's look it's the identical size
to all these gpus so someone wrote One
AQL
parser across all those gpus including
gfx
9 UM for these ones they they recompiled
it for risk
five uh which is actually a great gift
to us actually who's so happy that it's
risk
five um um it's like actually going to
be possible to understand this
but I don't like care here's what I want
to do here's my
plan uh you see this one that was 17
kiloby I want that it's possible all
that functionality still exists in
here in which case
uh yeah I'm I'm just I'm just happy
about it and we're good
yeah let's let's get rid of
AQL which was the original goal of the
stream without even seeing
this how are there not 17 million bucks
in
this how complex is the test suite for
this oh no we didn't write the IB Base
address right when we restored the
context from the user cu
what is AQL
support how much complex stuff is
supported in AQL
here's some Atomic
Ops how many how big Z mes
well there's three
Mees okay at least sdma looks
tiny did we decide sdma was
which risk five
or stma is still the old
one F32
you know what's
interesting and video doesn't have
this despite Nvidia having an
entire uh big processor called the GSP
that runs a lot of their
driver they don't have anything that
parses something that looks like
AQL because the packets that go to the
GPU aren't AQL they're they're a lot
more like pm4 we looked at them before
yeah why is this
here
um let's just uh check my
theory and then we're done with the
stream look at the
mechs the unified theory for why AMD
gpus are buggy and when they became
buggy
back in the days of Bon Air everything
was just well Bon
a bon a a beautiful Bon a beautiful look
at Bon a fire Festival there we go
um so back in the old days
here's Polaris here's
uh like ol land and stuff
elmir who knows
when Tonga Tonga had support for it
um well AQL is part of HSA
right when did this start
Hardware
support what
3D
Graphics heterogenous
queuing heterogenous queuing I'm sorry I
know how to pronounce things but
sometime I just pronounce them wrong
when
like I'm just like why
why why does all this
exist the very few first implementation
focuses on a single
Cavalry
Apu they were first introduced in
the fourth generation
gcn so where did they make the mistake
here we go they had had them in Tonga
and Tonga and Fiji definitely had the
big mechs
too but if we go back to Graphics cor
next one we find that they don't have
them there we go so Bonair and Hawaii
don't have
them um where was I reading that stuff
all right I'm I'm just getting Delirious
now
we're not even gonna just someone can
someone write some of this stuff up and
document it and do a poll
request part of the scheduling work
includes prioritized cues this is this
is where all the shit
breaks a driver update has enabled the
hardware schedulers okay let's see if we
can find that driver update let's find
the
mistake all right so if we want a
gcn three part Tonga and Fiji let's look
at
Tonga all right if we go back here
to the
beginning how big was the Tonga
Mac big okay the Tonga Mac has always
been
big
for for
seven years ago they
introduced this
feature HSA was a marketing campaign all
right we're we're too tired we're too
tired for
[Music]
uh well we actually just streamed all
day
[Music]
um
yeah but G just stole the Ram from OBS
am I lagging
oh dropping some
packets my internet's
crappy for a while now
oh close gadra
how much chromes do I
have just have too many Chrome
Windows too many vs code
Windows too many
pythons audio's been fine why do I
have it just looks like my internet's
bad
I don't
know oh it's probably on twitch's end
yeah
maybe I mean or my internet's just bad I
don't know
look pretty
good OBS is a memory
leak oh
I mean this is crappy wait why is my
upload so
bad never mind my uploads
bad
cocks no we found the problem Up's bad
thank you for watching today's stream
hopefully this is a good one uh I think
that what we have to do is
is I mean I don't even know I I don't
even know what pm4 manages to bypass but
we found thebug and it is the most
complicated queuing scheduling
mechanism uh I've ever seen uh Proto
thank you for the
Breakthrough uh the
rs64 is actually just
risk5 uh which really gives us hope for
building our own firmware uh for GPU
that doesn't have uh issues hopefully I
mean it's going to have issues but we
can debug those issues and we can slowly
make progress
toward uh being perfect which is you
know Perfection is is not a destination
Perfection is a journey and and you know
I'd like to I'm happy to have you all on
this uh on this journey with me I did
not find the bug I didn't find any bug I
just found a lot of code good night
everybody enjoy your weekend
I look I did a lot of yelling last
stream
chat really finds a way to just
aggravate me
you aggravate me you get me all wound up
close chat
but okay so let's
I have a name for the field
I'm open to the name changing
um
the name of the field is entropics
all right
thermodynamics
and tropics
Tropics can answer questions
like how much intelligence do I need to
prove for Mars Last Theorem
how much intelligence do I need to be a
2011 chess
all right
how much intelligence do I need
uh
to compress Wikipedia
so entropics is the science
that answers these questions
um I've seen it called scaling laws
before
so we're gonna take a look at a few
papers
um
so
um a few a few things we can say
intelligence is compression
all right so
which gives us a unit
not exactly okay
so what's the unit
um the unit for hotter price stuff is
usually uh
bits per character
um bits per character
what's a character right
I mean you can usually or when you're
talking about compression you think
about a compression ratio
um but these things aren't good units
all right so the unit I propose is the
person which is 20 petaflops but I mean
in the same way our horsepower is like
how many watts again
um
so a few interesting analogies you can
make uh you know the Industrial
Revolution
Revolution is to the horse
the horsepower energy thermodynamics
all right so what do we name this
revolution I I tried a bit with gbt and
I couldn't get anything better than AI
Revolution
um
I mean
I don't know
maybe it just is the computer Revolution
person
no it's not really right
like it's a cute unit if you check out
my Twitter I think I put up a good tweet
about
you'll be doing for
um and then Trump and Tropics is my name
for the field
um
well if you say it's no it's definitely
a revolution and nothing between the
Industrial Revolution heroism this is a
revolution okay
so
the Industrial Revolution
did this to uh energy consumption and
production
right
so this is this is the world's energy
consumption
um it's nice to see that it's still
going up even if it's stagnated in some
places which is just a great tragedy but
um
so
this used to grow at a rate that was
proportional to the number of people in
the world
what the Industrial Revolution unlocked
and I'll also point something out about
the Industrial Revolution that's kind of
interesting it happened before a lot of
people think it did right the period
generally spanned about 1760 to 1840.
notice how there was no uptick
in energy usage until then
okay so when you look at the computer
Revolution
um
the computer revolution occurred in the
Years okay so let's let's do some more
stuff about this right
Industrial Revolution was
uh 1760 to 1840 the computer Revolution
is what year was the Apple so all right
maybe that was the beginning of it
1977.
um
to I mean now right
so how many years is that
46 years
all right so this is 80 years
so I mean we have another if it's the
same we have a bunch more years I guess
I picked kind of an arbitrary date for
the beginning of the computer Revolution
I mean
I'm gonna go back to eniac right 1945
under the war
I don't know I mean we can talk about
like deck machines and
so what the computer Revolution or
whatever you want to call it what it's
going to unlock is you're going to see a
curve like this go up for intelligence
right so energy usage energy
was okay before the Industrial
Revolution
energy
usage was proportional
it's not like proportional
symbol for proportional
I don't know how to actually draw that
we'll just say we'll just you we'll just
use that
um in a computer Revolution uh pre the
computer Revolution intelligence
right
so before the computer Revolution uh
intelligence was roughly proportional to
people and soon it won't be right
um
well the amount of Intelligence on the
planet is about to Skyrocket but not as
fast as like I heard Paul Cristiano say
I think it's going to be slower than
that
um
I mean we can
we can actually like do the math out on
this
uh and work out like how many of the
computers how many of the usable flops
are produced every year it's probably
only ten percent
so you can work out the generation time
like none of this is going to be fast
right just like this this energy thing
looks like this like it went up but it
went up slowly right so I expect the
same thing you know how much
intelligence does the world have we're
going to be looking at Future our world
and data and we're going to be saying
how much intelligence does the world
have
um
so the recursive rapid intelligence
explosion I do not believe this is
possible this doesn't make any sense to
me
um and I think that once we have an
understanding of the field of entropics
uh it will be obvious why that's not
true
right
um you know
Caskey's going to bring up the nuclear
or could have ignited the atmosphere of
nitrogen I'll point out that it didn't
the nuclear bomb did not destroy the
world it actually had yields
approximately exactly what the
physicists were estimating right so I
think that when we do build these very
large super intelligent systems they're
going to be pretty much exactly as
intelligent as we predict uh
you know with this with this new
emerging field
um so
yeah
right so hang on let me um
like
so so is intelligence more like the
jewel or is intelligence more like the
what
hopefully you understand the difference
right what is uh Jewelers energy
a lot of energy per time
so the
flop what's what's kind of upsetting
about the Flop is it's kind of both but
um I guess like okay we have op and op
per time
uh
so a person represents about 20 E15 Ops
per second
um
then we want to get this back to back to
an ah you can talk about something like
the person here in the same way another
unit we use for energy is the kilowatt
hour right
so what's a kilowatt hour well what's a
kilowatt okay so it's a kilojoule per
second times hour
all right so second times hour uh that's
like
2600 kilowatt
Jewels equals kwh did I do that right
one kwh to KJ
yeah cool
I mean this all right I think this is
this is approximately this approximately
corresponds to our intuitive
like understanding intelligence right
like if we want a problem solved
um so how much intelligence do I need to
be a 2000 ELO in chess so let's look at
chess ELO over time
uh
uh no these are
do we know this historically
hmm
okay so whatever it takes to be a 2000
ELO in chess
um it was doable by a 1990 computer
um so what's kind of interesting is I
was looking at open ai's uh scaling
thing and the amount of compute that
went into Alpha zero was like not much
at all it was like a person day of
compute which corresponds with okay fine
that thing plays chess really well but
like
like we got to 2000 a long time ago
um
can we just check how much compute they
used for a 2K ELO model
yeah I think so
I mean what's cool about this question
is like
one of the one of the one of the like
great questions and and I'm going to use
the word in Tropics do we like it do we
like that as the name of the field like
one of the great questions is entropics
in entropics is
how close are we to Optimal right
um so this is gonna come up in my debate
and uh yukowski thinks that we are a
long way away
that these inscrutable
matrices are just hopeless right like
it's just it's just you have no idea uh
we are nowhere near they are incredibly
wasteful
I think they're that wasteful
like
what is it is it is a real like question
right okay so I think nobody doubts
we're 10x right nobody doubts there's a
10x that's possible like another way to
say this is we're going to find an
algorithm that can do as well as gpt4
uh on the benchmarks with a tenth of the
compute
and so I think no one doubts we're going
to find that algorithm
but okay how about 100x
how many X how about one e6x right
if the answer turns out to be something
like 1e10
right if we are
um if we are one e10x off
uh from optimal with software
uh then we are potentially in a
dangerous world
because it's possible for something to
like make that leap very quickly
but I think even if we are I don't think
it will make that leap very quickly
I think that humans are very good
programmers
I am probably better at programming than
I am at language
I'm not that great at language uh you
know programming I mean I know how good
I am like compared to other people to
programming is like pretty you know you
can measure this pretty well I I have a
few uh you know top finishes on Advent
of code like it's it's
and I don't think I'm a bad programmer I
think my brain is actually pretty
efficient at programming when I see how
good
um by the way I think gbt4 is an
atrocious programmer
uh I think gbt4 is not even meeting the
bar of many Junior Engineers I've seen
uh for how good it is as a programmer
but yet
like it writes essays pretty well it
just turns out that like writing essays
is in some
optimal sort of way like easier than
programming
right
um
is that you wanna you wanna you wanna
see if chat should be taking code
uh oh you'll like this oh everyone we
actually used to do things on stream and
not just sit around and shit talk all
right should we do you want to do Elite
code and try to get gbt to do it
um
all right here
is this one of these that gets like mad
if I if I put the answers online
ah
okay stop generating uh
below 10 that are multiples of three or
five this is annoying
copy is
sum of all multiples of three or five
below one thousand
um
I mean write a Python program to
code interpreter run this
oh my God
you guys it's trying to get out
guys is there a secret exploit hidden in
here
okay
um
is this code right
it seems pretty right
[Music]
I've done most of these
all right let's sign up
[Music]
cool
well how far did I get
oh I see because I solved the first page
and then got lazy
um okay let's see if it's right
expected indent
what
okay should I do this in should I do
this in a
she's in an editor
Cosley cook just trained on lead code
yeah it's fully trained on Project Euler
too
interesting
why aren't I using Code interpreter yeah
I probably should
wait so can code interpreter actually
run code
foreign
all right cool
like how many project Oilers can it
solve did anyone do this
hmm
what does it fail at problem 11 largest
product in a grid oh
I mean that's fair
you failed at 13.
oh yeah
interesting
why couldn't it do problem 22.
well that is
ah yup okay it's over fit
I mean that's not all right
but it's over fit right
because I what the hell is a name score
yeah
overfit on Project Oiler hmm
all right let's not get off topic
of entropics
um so I mean these are harder things
right so what is overfishing
so one of the interesting things about
overfitting is lossless compression
cannot be over fat
I was thinking about think about an auto
encoder right
and the autoencoder is you know what is
a losses autocoder look like right
this is a really nice streak taught me
more about engineering than my undergrad
yeah man thank you maybe college is a
scam
Maybe
I I don't want to go off on this again
but like
I'm kind of starting to think that like
a bunch of people got together in like
the 60s or 70s
and said uh let's not progress
all right so what else explains this
right
okay I mean another thing that could
potentially explain it is that energy
usage is an s-curve
okay
they ended Google code Jam maybe because
of jpts
I mean we're gonna see a curve
we're gonna see a curve very similar for
intelligence
right and you know can we name it the
George hotz curve that's what that's
what matters here
right so I want to see I want to see
that that energy production and
consumption by the way this is America
um like I think they've stopped progress
in America I don't think they've managed
to stop progress in the whole world
um but I just I can't get over I can't
get over fiat currency
I I can't get over that like
and I'm mad at you know I'm mad at my
ancestors to this I inherited so much
from the past and I I'm I'm so grateful
to for the past but how did you not stop
this train wreck
how did you let our money become fake
you know
just it really upsets me
um
Club of Rome the limits of our growth
I've never heard of this book
interesting
[Music]
foreign
further back
no I want to look really far back
yeah I know this is off topic from uh
you don't see any particular
discontinuity around this time
can I get it further back
I mean like just take the uh
this books per year in the world
population
this is what these people have in mind
for us you know
I mean the Industrial Revolution did
like shift this it seems
I mean again I also like
I'm not necessarily positing a
conspiracy theory and a bunch of people
did this behind the scenes right like we
have very little understanding of how
our government actually works
right which is another field that is not
studied
um we have several Fields Okay so
I you know I really hate bringing up
there are examples of things that are
like
obviously true I'm not going to say I'm
not going to give examples but there are
examples of things that are true
um but because they pertain to people
because they pertain to like again
they're things that
that like the powers that be would
prefer not to be true
so science is very corrupted by a set of
these views
right there are things that are
scientifically true that are either
downplayed rejected or like you know
look we don't have perfect evidence for
this
um I mean I I think that it's a very
shoddy like truth finding Enterprise I
why do I go off on these tangents I
guess I go off on these tangents because
I'm upset that these things aren't
already very already done
scientifically true but socially
inconvenient yes
yes there are some there are some there
are some truths about this
um
I mean here let's give it let's give a
let's give a hypothetical example that
won't offend anyone
um imagine you lived in a uh incredibly
like a racist country right your country
was super racist you kept like the
population super homogeneous and uh you
know you you believed that your race was
Superior right let's say you're the
green people right
green people go green people green
people are the best green people should
inherit the earth but you started doing
some studies and you found out that the
red people
yeah I mean the red people
they're they're your your your theories
about your racial Supremacy weren't
correct
so what would the government of the
green people do what would the
government of the green people do if
they found out that red people were
actually better
right would they Embrace this would they
be like the green people seek truth or
would they come up with you know fake
science to be pro-green people
no this is not it's not an analogy it's
just like like that's the obvious like
one I could think of right
um
but I mean there's a chance that this
goes yeah a lot sort of deeper than
like
what happened to the universities
what happened they're destroyed
did this
like is it just something that they
couldn't stand up to competition from
the internet
I mean this is possible maybe these
organizations were never actually truth
seeking organizations to begin with
new reaction has a bunch of
it mentioned small bug is a bunch of
interesting answers to this stuff
um
but
yeah it's Neo reaction is uh big on pros
and light on
light on like
okay well this is when this happened
this is why
um you know have you guys ever seen Wiki
spooks
uh I found this website it's kind of
interesting
um
you know again whenever you get into
whenever you get into uh
conspiracy theory kind of stuff
there is a lot of conspiracy theories
that are just absolutely fake
um as far as I can tell pizzagate did
not happen
uh I have a I have a post on my blog
um called
uh
uh the new regime no not the new regime
which one
um
the fourth estate
yeah
um this is this is I think one of my
better blog posts people have sent me
emails privately uh praising this ones
uh regardless of your opinion on Trump
became obvious in those years there's a
machine behind the scenes in our
government
and okay how does this relate to in
tropics I mean
why is some random guy on a twitch
stream
like
proposing this
I went on Twitter and I like I asked
about this
right like so I don't think I'm
this is a real thing
and there's almost no science that
answers it
you'll notice that there's also no
science for a few other things there's
no science that explains like
I you know look I've run a company for
the last uh
I'm a lot less Hands-On now but I've run
a company for the last
six seven years and
I don't understand
right we're 20 people
and we built this
how
how is it that I see
this company started around a similar
time to comma
um they raised hilariously more money
right there is 207 million dollars
and I promise what they have is
nowhere near as advanced as that
I don't understand
like
I would accept in general when you see a
world
and when you see a world and like
there's just stuff that doesn't make
sense to you right
like
it's because you don't understand
something
but once and I believe this for the
longest time I believe for the longest
time that it was like because you have
to believe that right you have to start
with a very strong prior saying you're
the mean
right and and whatever it is there's a
reason that these companies end up
you know George there has to be
something you don't understand
and here we are seven years later and I
still don't understand what that is
to give the many other people in the
world a purpose yeah but like who
look I mean this is prep for
if it is true if it is true that there
are some collective dumbness and human
flops are being used so terribly
I'm trying look I'm trying to like then
you'dkowski's position might be right
right his position might be that it
turns out the machines actually will
just be so much more efficient than us
and blow past us
um
I don't know
I want it all to make sense you know
and I'm not
I'm not crazy
right I think you know I'll I'll
right um if you haven't read this go
read it right this is the Unabomber
Manifesto
um hopefully most people on my channel
have read it uh during his trial
um he wanted very much not to be
declared insane
and I think he actually wasn't something
about like insanity gets you out of the
death penalty or something
um I think the FBI referred to this
Manifesto as rambling nonsense
uh this Manifesto is one of the
clearests
documents I've ever read
I don't agree with it I don't agree with
the document
I especially don't agree with the
document's conclusion
but
it is very clear in what it says
and maybe this is the great sort of like
if everybody reflected a little bit too
much on themselves
then we'd end up here and we have to
confront this Manifesto and we do have
to confront this Manifesto rest in peace
um no look I mean the man was also a
terrorist and I I don't think
I don't think he had to be like I don't
think
you know
um
but the Industrial Revolution its
consequences have been a disaster for
the human race they have greatly
increased the life expectancy of those
of us who live in advanced countries but
they have destabilized Society have made
life unfulfilling have subjected human
beings to indignities how are we on the
Unabomber Manifesto right how do we go
on stream and we end up here
crazy
and if so what what sort of crazy
am I schizophrenic am I bipolar
like
I think I have a fairly Cur
how scary is it if it turns out that
your model of reality
actually is more correct
right but here's the problem every
single crazy person thinks that right
every single person who is who is
schizophrenic thinks this
his Solutions and conclusions are
definitely not the way forward at all
um again his Solutions and conclusions
look like you know more stupid terrorism
um basically and and you know
uh it's not going to get you anywhere
uh
I just get easily uh distracted by chat
um
no this isn't getting distracted by chat
this is asking like scarier questions
about Society right like
I went into this
um
I went into this debate prep
uh Elias at your Caskey wrote this in
time uh pausing AI developments is not
enough we need to shut it all down I
went into this debate prep thinking that
I was absolutely just gonna clown this
document
and there's many ways I can clown this
document all right there's many ways I
can just sort of
like I was like okay let's use debate
tactics let's actually win
um
and then I started thinking about it
more
and I was like no I don't want to win
the debate that badly you know I'm a
little mad I lost the Conor like I look
I don't know if I lost but I didn't play
it the best
right I I didn't play it the best I
actually went in that debate for more of
a sort of like
industrial society and its future angle
right and that's how I ended up Somalia
um
look look I I love Terry Davis I've
watched a bunch of his streams
uh I do not think that he produced I
think he actually might have been I'm
not gonna say crazy but you know he was
like not Temple OS is not the future of
operating systems
um
yeah no I mean you guys know that I
think AI is very dangerous but my threat
models don't look like uh you know they
take the atoms and use them for
something else they look a lot more like
the Hypno drones or the infinite Tick
Tock right
oh his cycle
a Manifesto a psychological analysis of
leftists I think it's dead on I think
it's dead on when he when he describes
leftists as over socialized
um I think it's it's dead on I think
that you can talk about one of the
problems in society today is like an
overproduction of Elites
uh Holy See is uh
because it's not going to take over the
world I have tried I have tried look I
you know
you don't have turned programming
languages
um
so
you know I started this debate prep
and then uh what is this line um how do
you know what you know when you know it
or something like that about rationality
and like
I'm so confident in what I believe
I'm still confident and there is no
there's not going to be a foom there is
no seat AI there is there is
the intelligence explosion won't happen
but
like
what will happen
society's incredibly dishonest
and this is this is what's starting to
scare me more
right so if you have a society that's
very dishonest
well what do you teach the machines
like
I mean I guess you come to the same
question of like okay what is the loss
function for society
do we like this loss function
we're going to have to answer these
questions
way sooner
like
I'm gonna quote myself I'm gonna quote
myself
I
uh
no no no this this this goes this goes
even further back
this world
does Google work anymore
there's a mic Solana Singularity power
over people
I don't know some quote I said 2015 and
basically said if we hit the singularity
and I I said the word Singularity I
don't even really believe in the
singularity
if we continue
like doing what we're doing we're gonna
die
I know I'm supposed to be the non-doomer
side of this
but like
Psy is about to inherit
Untold power okay Destiny once said I
sometimes feel like democracy is doing a
really good job at solving all the easy
problems now we're just left with the
hard ones and I don't think Society is
capable of solving them
I don't even think they're problems
everybody just needs to stop lying
if tomorrow everybody woke up
and just stopped lying
and really really searched inside
themselves
and accepted that the world is going to
suck so much if you continue to do what
you're doing
like would you rather die
is your sham identity worth dying over
I don't know
but it upsets me
oops that's me
if tomorrow everyone stopped lying the
economy would collapse pretty hard good
we'll get some honesty
if the news is fake imagine history
this exploration and this debate prep
led me to a dark place
right
if we can all play around with the
science and it's cool and like I'm
interested in this
and like
we'll see we'll see how the debate goes
on on Tuesday I think we're dead not for
the same reasons you think we're dead
but I think we're dead
like I'm I'm a Doomer you know I'm an AI
Doomer
it's not the AI
it's not the AI the AI is not going to
have an intelligence explosion overnight
make a sharp left turn and synthesize
Diamond Nanobots this isn't going to
happen this is a b this is a bad sci-fi
story
I know I know
I don't know
suddenly
[Music]
ah
how come I can't how come I can't find
this
the internet converges to truth
I mean
all right let's engage with it honestly
let's let's see
some of this stuff's a little bit like I
mean I guess I think about like like
recursive self-improving AI that steals
our atoms as like an ultra left position
and then you can think of like
thermodynamic God as an ultra right
position
I haven't actually really engaged with
this stuff
I mean there's like effective
accelerationism light which is like oh
yes we should fix San Francisco we
should use more energy yeah no I mean we
should use more energy that's not a joke
and fixing San Francisco well shit man I
think building nuclear power plants is
easier
um
well here I mean this is okay I I look I
have not honestly truly engaged with
this
laughs
tells us the universe exponentially
favors Futures where matter
like I don't know this stuff
well I don't know if he's eacc is a joke
I have not I I saw this like this is
pretty old now like these are the OGE
ACC guys
um
like
I I don't even know if this is
true
no see like this is where you like lose
me with this stuff right like
I don't know what the hell this word
means I hate this word
like I don't believe I'm conscious
but I do think there are some like
I don't know like look you could put
people on a spectrum of like yukowski
and then like hardcore thermodynamic
eacc based bath and then like you have
like Robin Hansen and then you have Paul
Cristiano right
um
you have this like Spectrum
right like Paul Cristiano's on like the
the left but not that I'm thinking of
this left versus right it's not like a
political Spectrum I just I don't know
why I think of like this is right and
then and like like Singleton doomerism
is Left Right like Singleton doomerism
and then like gray goo is good embrace
the goo
but like
you know to really engage with this
stuff
um
like we're all gonna die with Ellie
either casket I thought this episode was
was was both ridiculous and depressing
um I mean I think that some of the leaps
are just crazy I I you know
I was surprised to see Robin Hansen in
the comments
like I would like to thank Robin Hansen
for clearing all my doubts on the
possibility of humanity surviving AI now
I'm certain we're all coming to time
I'm not entirely persuaded by a laser
argument but after listening to this for
a few minutes
I I listened to them both and I thought
Robin Hansen made
far better points
[Music]
um
and like I mean I guess okay
here's how he died
okay
so well let's start with how we don't
die
this is all my debate prep
um
so you know
we'll start with how we don't die
um
machines are uh
human level machines are introduced
at a standard
uh
human rate and this this has
gone up and down throughout history
right you can have the seven children
you can have the declining birth rates
right
um
machines uh don't out compete uh humans
as a lump
right uh capabilities
are mixed right
um better at adding
uh worse at Plumbing right and we
already lived this world today so I see
this all kind of continuing right
um
you know uh alignment
proves to be very similar
to aligning humans
uh it actually turns out that
I think this is one of the hilarious
things the rationalists get wrong you do
not align humans because they are good
people you align humans because they
have more incentive to
press cooperate then press defect
right you just have to do the same thing
with machines
the same laws apply to them right like
like machine
you know
I I think I think Robin Hansen kind of
like alluded to this like the machine's
not gonna steal my atoms stealing atoms
is not a good way to get atoms a much
better way to get atoms is to buy them
oh yeah but the machine's cheap like no
it's not maybe it'll steal the money
right stealing the money and buying the
atoms is probably easier than stealing
the atoms it's actually probably even
easier to earn the money right like
you're a super intelligent you just earn
the money right
you know don't steal my atoms
buy my atoms
um
not up to udkowski level you need more
time and ideas
oh okay okay
um how we die okay how we die
um
meeting
better super intelligence right
um
yeah if this somehow happens we're dead
right so there's a few ways it could
happen um one is aliens show up right
aliens show up you'd figure they're
probably super intelligent says I mean
they showed up right
people will steal my atoms to sell to
the AI no they won't bro cause I got AI
myself you Tiny Box You're Gonna Keep Me
safe right my tiny box is Gonna Keep Me
safe
and then like
middle
expected many wire heads right
that's not everyone dying wire heading's
not gonna get everybody it's not really
uh
um many psyops
many wire heads right
uh there's no getting around psyops and
wire fence right
um we'll just put advertising
advert
ising advertising oh yo if you guys have
never seen this
um
uh Skittles instead of a Super Bowl ad
one year
uh put on a Skittles commercial
uh
and it has this great song in it which I
won't play because of copyright but
check out Skittles commercial the
musical advertising ruins everything
many wire heads uh is uh Fenton I will
just say opiates because I don't know
how to spell fentanyl all right cool
um
so you know those are just predicting
what exists right now advertising and
extrapolating it out into the future
where you have scary AI deep fake
advertising scary where you're an
individualized cohort and yeah um and
then the opiates it's like well you know
you're gonna get better opiates future
opiates opiates with no hangover cheap
opiates opiates that are implanted in
your skull math you want math math
um
is the Golden Age by John C right I
don't know this one uh
Utopia is of course impossible
no no it's pretty good okay so how do we
meet uh 10 uh one ex 10 better super
intelligence right
um you don't want the prime minister no
no no no no the prime intellect world is
a dystopia right
finish that story and ask yourself what
really happened in the end
it didn't even occur to me you know when
I first read the story
I don't know how the author intended it
but read metamorphosis is a prime
intellect and ask yourself what really
happened at the end
and when I was 15 and I was naive and
hopeful and read that story I was like
wow okay
and then when I realized what actually
happened I'm like
okay okay
um
does hard take off equal death uh yes
yes hard to take off his death
um hard takeoff
like in the matter of days or something
right
uh if there's really like a hard takeoff
yeah yeah we're dead
um
or
Society breaks
Society uh no actually Society is way
more inefficient
than we think
um
rapid rapid outcompete
even sure about that one that's how we
die
I'm not actually sure about this one
I don't know where to put it
like
no I mean the ants thing is I don't know
maybe this is just me being mad about
Society right like what is it
why does it not make sense
I'm 33 I'm not crazy why does society
not make sense
it's not Malik
I don't think it's Malik
okay maybe it's Mom
maybe it's Mark
[Music]
um
I'm not going to go into exactly what my
Avenues of attack are I do have every
use of attack I do have arguments that I
have prepared
um the hard takeoff with diamond
Nanobots is not fucking happening
don't worry if you're worried about that
I wouldn't
it's just hard you know
all right
why do I expect Society to make sense
hey we're gonna open it up to everybody
else I'm gonna ask some questions and I
don't know if these questions are going
to get us anywhere but we're going to
ask him anyway
does society make sense for most of you
are you outside the norm
we have 452 people in here
honestly yes
it makes sense but that doesn't mean I
like the way it works
like
you found an efficient way to use the
norm
do we have my poll this was another like
I remember when I tried to buy land
yeah uh
can you have the laundry basket I have
some laundry in it you can come today
you get them on stream though
come and take it
let's say having switches
[Music]
I don't know
they're closed
you miss Alex
they miss you
Alex said I'm not allowed to rant about
AI to her anymore today so I'm rounding
to you guys
we're not super surprised at the way
things are
cultures Downstream from politics I
think Breitbart said it the other way no
I don't tell them about tub land
I don't get to know things like that
about my life
Alex I have to I have to maintain a
facade of being a crazy person online
if they knew how like normal I was no
one would respect me and everyone would
stop following my stream I understand
what here
what what
my backpack
I did show them my headphones yeah I
should have did you try them out no
we're preparing for the debate though
this is like like live crap
like am I giving away all my Avenues of
attack I don't know man I believe in
open source AI
um
did you learn anything did you come up
with any good strategies
wait Dobby oh wow thank you for gifting
Subs Mad Dog Nation wow that might be
the biggest sub gift in history he
gifted a hundred Subs
that's awesome thank you
I know
thank you
good more chicken tender funds money
the power of Alice they did it for you
Alex
[Music]
Mad Dog Nation
Malik is defeated
they say thank you for being patient
with George
we hung our TV on the wall
we're very happy about that really could
they hear the banging no I don't think
so no I was banging on the table I
brought the uniform manifest so I got
very upset
what a scam Society is
a regular complaint from you it's a scam
are we done are you done with the Stream
I don't know if they want more straight
give them more strain but I think we're
I think we're we're
Mad Dog Nation okay maybe not everyone
that's the thing most people I meet are
really nice why does society suck what
is that what is that what is that it
says Randall from Clarks
I hate people but I love gatherings
[Music]
do you want more stream you up tedious
one you missed the Unabomber random
sorry let's talk more about Society I
don't know I don't really have anything
else to say
Alex am I crazy
oh
person you sure what if I'm
schizophrenic
bipolar
s
diagnosing anyone I'm not an armchair
doctor being able to think largely free
of ideology seems very rare today
no I'm a Libertarian you don't
understand I have an ideology
my door handle is broken well we should
move to a nice apartment that has good
doors
a fortune to have this man assembled
you went on Fortune
what how much was wardrobe assembly
200 an hour
or four hours wait are you kidding
oh my God I would have assembled the
Wardrobe for two for 150 an hour you
know
yeah
that's reasonable it's insane how much
does it cost to run a gbt for an hour
how
about 500 of that 20 something plants
I mean that's only like 25 dollars a
plant I know but then I asked my mom who
plays for gardeners all the time yeah
but she's she's weird you could get you
know 150 bucks Alex you can pay 150
bucks too just take the chocolate on a
Lemon Grove and you know say trabajo if
you're good
oh hey Chris out of control the machines
don't come faster Cinco siento pesos
[Music]
you don't want to no big wackos are
gonna show up man
no they're gonna ask me they're gonna
ask questions I'm going to make sure
they write the questions to ask him
first
um are you real George Alex rocket 420 I
am real
um have you ever seen Kanye and Geo
crazy whoa whoa I'm not I'm not that far
out man I love Kanye I think he's going
through some some stuff and I'm not
saying like he's going through some
mental health stuff I think he's just
going through some stuff and like I hope
he pulls out of it makes some new good
music like I believe in him
uh divorce is hard man yo it was
yeah
oh HBO Max HBO Max has a Kim Kanye thing
it's okay I wouldn't recommend
Alex wouldn't recommend that
you made me sound like Drake yo we just
merged oh you're the sovitz guy yeah I
owe you I owe you 200 bucks send me out
I'll uh I'll pay you
Tiny Box is the future fuck Google fuck
why don't fuck Mark Andreessen man what
Mark injuries I mean look Google look
Google's going through some rough times
and Sam Altman you know Sam Hunt man
here's what he is he can't just front
Sam Allman that's right
I mean that's my take on Sam Allman
right
nice guy
um
are you done
am I done what no Sam off is a bad topic
now you know what I'm Banning Sam Altman
that's a bad word I agree it's a bad
word
yeah yeah yeah yeah yeah
Mark seems worse than Sam curious why
you think that
yeah this is this is shit talking and we
don't need to talk about people you know
that's true that's true that's true
that's true that's true don't people
talk about people mediocre people talk
about ideas and Geniuses talk about next
level conspiracy theories
Lizard Man Blizzard Man
the world is made up of 99 good people
doing their best I don't believe this
actually
you are one of those good people for for
gifting Subs but I actually don't
believe that because I did a poll on
this stream
no no no no no no no
where is my pole
so you're watching your own stream on
stream yeah I know oh here we go
um we asked a question
um and by the way I just want to say
that this came out before Taylor Swift
released anti-hero so she stole this
from me
can I switched all this for me
I did a poll and the question was are
you the problem
I argue the problem no but I'm kind of
apathetic to the problem yes but insert
excuse here
uh no and I spent a lot of time fighting
the problem and then Taylor Swift
released a song called anti-hero where
she had the lyric it's me hi I'm the
problem it's me she acknowledged it
Taylor Swift's in the 33 I don't really
think she's in the problem though the
problem I think she's sarcastically
acknowledged it because I love Taylor
Swift and Taylor Swift I'm cool with you
stealing my you're the problem but I
want a day like a nice ticket I'm only
standing like the front man you don't
gotta meet me I'm not trying to be weird
like that or anything just like send me
a nice ticket be like thanks George I'm
never gonna acknowledge publicly XOXO
Taylor
oh you're not the guy that made that PR
okay I don't owe you 200 then
see what this link is
it's okay it has six views
uh Portnoy is that Port noise complaint
I only know that from BoJack Horseman
I've never actually seen it Society
evolved so we may be going backwards
Taylor Swift is propping up the economy
that's true I've lost some Taylor Swift
tickets I might even buy them
wait yodkowski is definitely a guy doing
his best absolutely absolutely
um
this is not I would not debate someone
who I did not believe held good faith
like was a good faith intellectual
ah okay
that's right that's right Chicken Man
foreign
for some reason this chicken man looks
less evil than the other Chicken Man
aha we found him
I think this might be a different
chicken man but that is chicken man
you know again trippy uh
we weren't going to engage more
seriously with the eacc stuff
I mean I think this is true
I like this actually
huh
I mean
uh so this is a psycho history
uh
oh yeah it's I don't know it's actually
a real thing but it's in it's in
Foundation it's pretty cool
um so like I wonder I mean like what is
the the like it's funny like you know I
come within tropics and I start thinking
about like psycho history right
you missed stuff's true
if anyone wants to pay me not to develop
AGI fuck you I'm gonna do it anyway
so I was not a bad guy all right we're
going to space cool
I have read this and I agree with most
of it I just I don't like the word
Consciousness to turn off to me I don't
think it's real
stop fighting thermodynamic will of the
universe
no it's copyrighted and we can't listen
to it
no
we sang songs we never learned your
words or melodies
and we ran Far Beyond the Lights cast on
these streets days and tired we're still
standing always anxious somehow
breathing never searching but still
searching for you park your car out on
the lawn and came inside I'm shaking off
this sinking feeling in my gut and I am
screaming
see me a burning man next year I've been
to Burning Man in a while
the police might have stayed okay right
um
you know the U.S wants to sabotage tsmc
I don't know
what is it about Chad and maybe this
means I can't stream anymore what is it
about chat that always derails
like when I'm not here
I'm thinking about nice stuff like we're
gonna do some like okay like let's look
into like a mathematical theory for
computation
social media is making us all dumber
wow what if smartphones aren't making us
smarter
um Humanity had a great run guys now
we're not gonna die I don't think we're
gonna die come on it's gonna suck balls
but we're not gonna die
how's the AI gonna kill us and don't say
diamond Nanobots
we're all sad di Jones well sad DJs but
some of us had a problem
and Tropics doesn't imply whether or not
we're doomed I don't know about that
uh
uh but simulation Theory does simulation
Theory implies we're not going to die in
a stupid way because then this video
game would get a low rating well I
played for a while played all the
farming and Industry stuff Great Tech
tree right up until random AGI made a
sharp left turn and killed us all wow
that game sucked man GG bro
see and then no one would play the game
again and then we wouldn't be here okay
do you understand
we're here right we are here
given that we are here
this must be a good video game because
bad video games don't get played much we
could just be unlucky
but assuming we're not unlucky we're in
a good video game and a good video game
has a good Tech progression so therefore
Society has a good Tech progression
and clearly
clearly
their Tech progression must have been
good and that's what they modeled it off
of because they got to the point where
they built simulations right and by they
I mean God and the up there and you know
what I'm saying right
why does the guy who develop this game
not care about talking to us he did have
you not heard about Moses in the burning
bush and he sent his only son to die for
our sins guys
bad dog Nation thanks for gifting Subs
please read the preface of the mind is
Flash
shallowness of the improvising brain
oh this reminds me of I really like uh
Robin Hansen has a similar book I think
elephant in the brain
preface I'm gonna get a preface
yeah system one and two we're thinking
fast and slow
um you're curious about my view of the
portal the idea the Bible is the closest
we can come to a mankind origin story
I mean yeah I wrote the that's the
gardener you're getting good answers I
wrote The Garden of Eden blog post
um
I mean I think so right do you have a
better origin story for Humanity
people worried AGI will cause Extinction
it's like it's not the will of the
machine okay it's the will of other
people that will kill you
I mean
yeah like this is a portal
[Music]
yo
okay
like
how close are we to Optimal usage of
compute for intelligence
this
like
if there's any question that motivates
the study of entropics it's this
in my debate I'm gonna make a bunch of
hand wavy claims they're not that hand
wavy I kind of ground them and stuff but
if it turns out the answer to this is
this
uh GG boys now that that's probably not
even enough
if the answer is this
it's GG boys
if that turns out to be the answer
[Music]
oh
Mad Dog Nation you must be rich
should I do one of those should I do one
of those streams
should I do one of those streams where I
uh
where I eat the ice cream or something
I'd have to like practice it
ice cream ice cream ice cream ice cream
um prologue
uh
I'll bring up the I'm gonna bring up the
the the uh the Bible one
on the hero's journey
wow
and we did it
we need the tiny Corporation though
I want to like I want to start
reproducing a lot of the papers
we are going to study on tropics
we are going to figure out
how to get the most intelligence
perjoule
because that's where things get
interesting
like supercomputers are going to hit
power limits you know this right we
don't have enough power in the world I
don't know how close we are to having
enough power in the world here's a
question here's a question that somebody
can can actually go and figure out right
now
I'll be right back we have some real
questions we have some real questions
these are real questions and I challenge
someone in this chat today to turn their
life around and do research
spend 50 hours and research the
questions I'm about to propose
they're questions you can find answers
to and they're questions that are
determine what happens to humans
foreign
if you do a good job with this stuff
I'll hire you with the tiny Corp to be
an entropic researcher
okay
questions
how many silicon flops exist in the
world
let's see if chat gbt can do it
man I love GT4
you guys know this story
by the way if you haven't read the story
if you have not read the last question
um
you know uh
you ask multivac I dare you five dollars
said it can't be done right
so the the story is them basically
asking a computer what the fate of their
civilization is gonna be
oh it's using python
whoa
okay well that's several things off from
what Google bard said and that's why I
think that's a lot closer to
this is sick
[Music]
not at the end of last year I was so
unimpressed by it I'm like oh this is
garbage it's gonna take him so long to
make a good one
wow that's doing all the cloud ones
okay so how many people is that
never mind I don't need a researcher I'm
not hiring nobody I got my boy here
you know what every bad thing I ever
said about Sam Altman I take it back
this thing's fucking awesome
oh wait no no sorry that's that's I
asked you that question already
[Music]
so I'm almost into doing video driver
okay never mind it broke
people xai
yeah I'm unimpressed with all the
rappers
okay
so
if you read my my blog post about a big
computer I want to make a zetaflop
computer
right like I want to own one zetaflop
um
so actually we can we can ask some
interesting questions so GPT uh four was
trained on a cluster of 25
000 gpus also people think I have some
how to get this I literally read this on
Reddit
like this isn't secret Alpha I read it
on Reddit
um so it's that many teraflops so that
many Peta flops so 7.8 exit flops okay
that's like nothing
is that really right
I can just do that all right
this is useless garbage
I love this this code interpreter thing
is so good that it just writes programs
like I was trying to use it I think I do
kind of think I have been like using it
a bit wrong
um
whatever I try to use it to help me with
my actual programming but how many
things in life do I just like I could
code this I just don't want to waste 10
minutes people have told me this yeah
yeah I know I know I know okay so what's
that growth rate
all right
so how fast is the computer civilization
growing
25 per year
yeah
um that's a lot
it's not nerfed I don't know why you
guys think it's nerfed
foreign
21 gigawatts
foreign
this is just asking the question of like
what's actually going to happen in our
society
uh
foreign
okay those are sustainable numbers
I tried I've tried to get into Nick land
I got like I can't engage more with this
stuff because I think these people have
some cool stuff figured out I just like
I don't quite understand it maybe maybe
like again you know that that thing they
link to with some Physics principle from
1992 right like my physics knowledge
ends at the
okay
if you push me we can go to the
beginning of the 20th century if you
really push me
um oh you found the prologue
the more your reals that Anne Rand have
all right I wouldn't go that far
though I have found we'll save that one
for the debate
uh
uh spoiler alert
uh no I yeah I I think I I
relativity in quantum
I'm a fine artist guys you know I have
limits
um
philosophy objective
oh
qm makes a lot of sense as far as what's
going on
I've tried a few times to engage with it
I I think more it's not that I like
don't it's not that I can't understand
quantum mechanics
um well like how far do you go with
quantum mechanics okay do you go like
would you say you understand like
Quantum field Theory
like I've tried to like like push into
this and it turns out we do understand
now like
where electrons come from
like we have this model like we have
this model of these Quantum fields and
the electron can be modeled as like a
perturbation in the quantum fields
the problem I actually the reason I
didn't like
like learn it more
um
was because
yeah I didn't understand what yeah I
think people are linking this I don't
exactly understand this and get to this
at some point but okay
um
yeah
oh yeah yeah yeah dude dude like wait I
I totally agree with this
do I remember that yeah vaguely you
haven't caught me off guard I I didn't
know what to say well do you think
that's the thing I don't think I believe
in deep denim I kind of think all you
are is just the things that you do
right I mean it's the same idea right
I don't think I believe in deep down and
I agree you know I if you guys haven't
watched this show like BoJack Horseman
is the new like like the show affected
my life way more than I thought
um I probably watched it through about
five times now
again it's lines like that I think I
think that that is exactly what that
prologue gets to
like I don't think I believe in deep
down
yeah
I mean I say this was I say this with
self-driving cars too like
people have this idea that like what are
we gonna do when a self-driving car gets
into an accident how are you going to
deal with the inscrutable matrices
how do you deal with humans
you ask them
you try to ask a human why they got into
a car accident
it doesn't work well
you're like wait you have a dash cam oh
oh this is great I'm not gonna waste my
time talking to you right
did I like Avatar only the first one
don't get me started on Avatar
um okay so flop score 25 per year get
ready for some immigration boys
and I think we can actually sustain that
power growth
Joe Pera
I heard of this
oh is it communion
wait I do like this this is good
wait holy shit
can we fix this
you guys you know how much hate I got
for Twitter you know I got so much hate
for that
and there's a whole bunch of you know
like there's no there's no simple
explanation right to like like but one
of my hopes was that we could build a
better social network
one of my hopes is that we could
actually have conversations about what
makes social networks good in the right
sort of world like I was down to like
actually fix Twitter it wasn't what I
thought it would be thank you thank you
for gifting subs thank you
damn why not make some money off of uh
off of twitch this month
um don't you don't have to give some if
you're not rich if you're rich whatever
man you know you do you but uh
uh I do appreciate it
but I'm glad that you know you know what
I'm doing is appreciate it
um
let's fix Society I don't think I can
fix this Society some people are so rich
all they have is money
oh I mean yeah no shit my obvi like
people think that that was like some
like like controversial statement that
like Twitter can be run with fewer
people oh my God like how is that
remotely controversial
most of Twitter there's a few things on
the ads that don't scale that well but
for like the all the core infrastructure
parts of Twitter we could repurpose
Commodore on Twitter
like it's just not that hard
check out far Caster if I care about
better social what are they doing that's
different
oh fuck this man no no no no thumbs down
no anything that's web3 sucks balls okay
does it have a fucking token right like
does it have a token
oh
oh
[Music]
no token
it's not
okay look if there's no token I will
engage with it a little bit but if
there's a token
immediately I lose all respect for any
project that has a token okay
if you have a token you have jumped the
shark
is there a Dao
please tell me there's no doubt and no
token if there's no doubt no token if
it's actually just a protocol like email
then it's fine
but no this isn't the problem actually
I mean it does feel like the internet is
minimizing entropy
wow
this is a little okay
yeah
but I mean these are real questions we
can ask
why does it feel like Reddit is the last
place that has any sort of entropy left
okay everyone loved that book everyone
loved that book do I have to read it I
have not read it
well at the beginning of infinity
everyone
everyone's been chilling for this book
we'll buy it
all right all right we'll read this book
give the title kept me from reading it
too
foreign
it over here
be here Tuesday
sounds good I gotta book a flight I'll
do that tomorrow I guess
ordered
with the books a thousand pages and it
could be a blog post no no I hate that
no I'll buy the book I like holding the
book
um I'm halfway through uh
I'm not gonna tell you what I'm reading
because you guys explode for me
um it's a thousand Pages saying limits
are computation
oh you never said the question no sorry
too late gpg did them
I mean it's just it says this it's this
sort of it's this sort of analysis right
but actually wait that just like she
looks like totally reasonable
and that was the first thing that I used
gbd for and I'm like wow okay I actually
would have wasted like an hour doing
that
the dust Theory like in permutation City
sure
they're meaning from something else
yeah yeah yeah yeah it's surprises today
he's a great fuck
what do these numbers tell me I mean
this is a plausible growth number right
so what this is basically saying is we
can enter an error
where you know economy grows
at 25 per year
right do you see carpathy sweet about
flops and dollars right
um and this is a very plausible number
so whenever I see numbers like this I'm
just kind of reassured that it's
lightweight this is actually all going
to just be fine
like what do these numbers tell me they
tell me the economy is going to grow it
yeah
how is that crashing though nothing
crashing this is gonna be fine
and it's going to take it takes so long
to build up to that number like we'll
get there
foreign
get the electricity no it's not that
much it's not that much growth for
electricity
we need more nuclear yes we do everyone
kind of knows this
is the CIA decides to destroy tsmc I
don't know about that there is no rapid
recursive self-improvement this is a
myth
I see no reason why rapid recursive
self-improvement is possible
at all
oh Fred can Gates oh this is how we get
into yeah yeah a reversible Computing
has been brought up to me a bit in the
last couple days
um only slow self-improvement as
possible
well
no it can be arbitrarily fast but we're
going to enter a regime where it gets
faster but it still doesn't happen
overnight right like we might enter a
regime where growth actually starts to
happen 10x faster than it happens today
meaning instead of doubling what um so
all right
uh
uh let's post the same thing let's
really go if if chat MBT gives me an
answer here
ah see so much better
I wish it was just faster
okay
cool
yeah so okay now it doubles in 35 years
so it'll double
in in three years instead
wait this is just gonna be fucking
awesome
like that's three years it doubles every
three years is actually like a really
exciting growth rate
it's not scary
like if if the economy doubled every day
we would all be terrified right like it
would just be it would just be so scary
there'd just be so much noise it'd be so
impossible to do anything I mean we're
already like feeling like that today I'm
already feeling like
it's so hard to commit to do anything
because there's like so much Alpha
everywhere
you do the same chat about flops and
yeah okay what's whatever it's 10x awful
cast doesn't matter
where does Humanity allocate the compute
well definitely we need to put a lot of
it in diversity and inclusion okay we
can't neglect diversity and inclusion
it's our most important strength and
we'll have to make sure we devote a lot
of flops to that but don't worry we'll
still have 10 of the flops left over for
doing flopping
we invented a new Authority for
brainwashing
I don't know
foreign
okay I got a little too abstract for it
it's not gbt5
um actually here's another interesting
Factor
right so
if only this many exaflops were used to
train gbt4 okay that's
not that far off okay so that's 1.3
percent of the compute produced in the
air
this is definitely going to go up to 10
percent
oh can we work out how long you got to
wait until you can do GPT 4 level
inference on your box at home well your
computer or a tiny box right so a tiny
box is going to get you a 10x over your
computer
you can pay your computer is probably
about fifteen hundred dollars you can
buy a tiny box for 15K there's a
prototype over there tiny five
um
they do not publicly release the
bullshit I promise you they publicly
released the best version they possibly
could okay I paid 20 a month for chat
GPT I would not pay 20 a month for gbt3
garbage I paid 20 a month for gbt4
strategy behind hundred dollar pre-order
we'll see what they will see what
interest is right it just turned out to
be pretty high I mean I don't know my
conversion rate's gonna be could be
anywhere from 10 to 80 percent
I'd be like unsurprised kind of both
ways
Bard is free and good enough I haven't
even used bard
do I have to log in
of course I have to log in fuck you
Google
I use board because I'm poor
no I mean like you gotta respect look
you gotta respect you gotta respect gpt4
I've come to respect it a lot more since
I've been using it lately
like it really is the first one where I
see the you guys get a good line on one
of his podcasts where he's like if gpd3
was a champ gpt4 is a human and I I kind
of feel that
llama two with code interpreter might do
80 of gbt4 the big llamas are the big
llamas are better than three
I don't know I was pretty impressed with
this
I thought all of its assumptions were
like within an order of magnitude it
thought about the same classes I thought
about when I worked on this problem
before
all right guys
got things to do tonight
they don't sit here and talk to you as
much as I love talking to you
uh
Mad Dog Nation thank you for gifting
Subs you are the new record holder uh
for my channel I appreciate you
um I appreciate everyone else who subbed
uh
uh we're gonna get they don't give us
the crumbs stop that you're not even a
subscriber you don't get an opinion
uh thanks for watching my stream tonight
um these two streams are kind of meant
to be put together so they can be put
together one video
um the whole the whole
welcome to the new field of entropics
um I will accept a different name if
someone wants to call it something else
but I want to answer the questions how
much intelligence do I need to be a 2011
chest right like I want to answer that I
want to answer that question
fundamentally right like these are
really interesting questions how much
compute what's the minimum compute you
need
and this question determines whether
we're dying from hard takeoff or not
if we turn out to be a factor of a
thousand off it doesn't matter
if we turn out to be a factor of a
billion off we might be dead
so Food For Thought think about whether
you're dead or not
um
come watch my debate on Tuesday
uh Sparks will fly
we'll discuss this stuff we'll figure
out if you're going to die or not um and
then if you are going to die I do ask
how what changes you're going to make in
your life right spend more time with
your with your loved ones uh you know
remember that scene in Fight Club that
guy's gonna go on to have the best day
of his life uh so you know what maybe
we're gonna die
um maybe We're Not Gonna Die
I don't think we're gonna die
it's like I don't know I just don't
think we're gonna die
I think that the AI is gonna liberate us
and set us free in ways that
we can only imagine now you know
um
you know what time the long run a song
about the singularity it's called watch
the world
I watch The Smoke as it grew darker and
blew up through the roof I watched the
FED who sobbed in panic as the fire grew
I saw Virginia
get rid of Langley and its secrets to
I held your hand and sat there knowing
that we'd make it through
I saw this man dispose of hunger and
soap operas too I saw this field That
Grew Perfection full of things you do
I saw this box
get rid of heartache and cure cancer too
when I awoke
I sat there hoping this is what we do
it's a song about the singularity
thank you thank you thank you good night
everybody thank you for watching
oh I always forget to unmute I always
forget to um you great uh we're unmuted
we're unmuted
good good we're unmuted
no we're muted now right you can hear me
can you hear me
all right we're good
um
audio 10 out of ten all right great okay
okay okay
um
okay so you guys know I'm debating
Eliezer utkowski
uh on Tuesday
and
I've been doing I've been doing a lot of
prep work right
um you know I also I'll I'll say this
I do not think that he's the bad guy
I think there are bad people out there I
think there's very bad people but the
bad people don't look like him right he
I think is genuinely concerned about AI
destroying the world
um I think there's some people who very
selfishly are using AI safety as a means
to push their political agenda and a
means to try to centralize and
um acquire power
and I think that these are very bad
people
um I think that people who genuinely
believe in
um AI destroying the world are not bad
people
uh I think they want things that are
good for Humanity uh so
I'm not even really talking about Sam
Walton
I I don't think Sam Altman is look I
might have you know
I have my thoughts on Sam Walton but I
don't think that Sam Altman is is
out there in the he is truly
dark-hearted and evil I think he is a
man who you know he has an ego and he'd
like to gratify that ego and I'm
generally supportive of this right I'm
generally supportive of people like I
have an ego I have things that I want to
do that's all good I think if Sam Altman
takes away my gpus all bets are off
don't take away my gpus all
right
um
homosexual he's a homosexual I don't
know what a Scion means
um
no I don't think look I don't think I
don't think people like um you know Sam
Altman
Dario like uh who else who else we got
that that's I think you get all I think
okay we're not gonna go into that
um we're not here to talk
uh we're here to realize something that
I really realized this weekend
um
thermodynamics is to energy as question
mark question mark question mark is to
intelligence
um so
I have found uh I'm logged into
something I see this is why I can never
log into anything
uh you can you can see my my previous 30
days of of GT4
um
you can't trust the man who isn't
I kind of I kind of lie that's right
like
uh
um
um I I don't think Sam Almond's a CIA op
I know how he did what I did he did I
know a lot of people who sort of like I
you know what you know what chat no no
no you're the reason we're getting
you're the reason we're going to
subscriber only we're not here to
talk Sam Altman man
we're here to discuss this question
thermodynamics is the energy
terrible it's terrible like I come in
here and you guys derail me you guys
derail me or why I don't stream well not
streaming coding anymore I don't want to
stream coding anymore
um
so
one thing I'll I'll note that's very
different about this AI Revolution and
something that has shifted throughout
history right
where did the smartest people go in 1950
right let me bring up a let me bring up
them
it's gonna be one of these Vim ones you
know maybe one of these where we use
them
um
where did the smartest people go in 1950
we're gonna put Chad's gonna participate
in this conversation so please subscribe
if you'd like to participate in chat
um
debating Sam Altman would be useless he
has no positions that he genuinely holds
right see I like like
again
I wouldn't
debate uh Elijah if I did not believe
that he genuinely held these positions
right like there's not like like with a
lot of people with like a Sam Altman
type person there's something spinning
in the back of their heads that's saying
okay wait a second the answer is not
truth seeking the answer is instrumental
right the answer is not
is this a true fact about the world
right like think about what your rlh
left on right you can imagine a model
that's rlhf'd on true is good false is
bad but that's not what the RL HF that's
not what chatgpts are really checked on
so early chapter on helpful versus not
helpful or harmful
right this is a very different access so
you can think about what Sam Altman is
rlhf dong and the axis is much more
sambaltman acquires power power Sam
Altman loses power so when he speaks
it's not like you're going to get truth
right and look I don't think he does
this consciously I don't think he's a
bad person I just think that that's what
his
you know for me I tell you this about me
and you guys can believe it or not but
like if I got to know the truth I'd live
under a bridge I don't care I don't care
nothing else matters to me in the world
besides knowing the truth
all right I want a little bit of Freedom
too I want a little bit of Freedom you
leave me alone under my bridge you tell
me the truth yeah I'm good man I'm good
I don't tell anyone else what to do I'm
happy right
um that's what it takes to make me happy
all right
that's all I want out of life
all right
and unfortunately I think all the
bridges are going to be uh you know I'm
gonna have to get my spaceship get out
of here but uh
um a little tiny Corp dictator I mean
you know you want to join my Empire I
mean you're joining my Empire
voluntarily it's free association man
you know if you think about where I am
on like the political even political
Compass like you have like left and
right I think I'm right in the middle
but then when you have authoritarian
libertarian or you can't even go further
on the libertarian axis right I just
think that coercion is so bad and evil
um okay
so where did the smartest people go in
where did they go
colleges are universities right
what happened
oh I hear actually let's just start with
another question
we are due the smartest people go in
companies like Google yeah well I don't
know if they go to quite Google anymore
I don't even think they go to Fang
anymore I think if you ask the question
about the early 2000s you would say Fang
but there's a few places they could go
you want to bring it in I'm on stream
now
hedge funds no
oh I see okay I'll come get my Pokey we
got food I'll be back
oh thank you
um hedge funds Fang
startups I don't think they go to the
government right
um I don't think the 1950s they quite
went to the government but a lot of them
went to University all right
soup
what's happened
is you have Theory and you have
capabilities right you have Theory or
you have maybe maybe power
right
um actually it turns out a lot
actually do want power over nature all
right
so maybe governments want power over
people uh playing hedge fund startups
right the markets nature on power of
nature great
oh yes
okay
so as a result of this
we have less Theory
and more applied
so we sit here
and we have
um you know
we have hard doomers on one side of of a
spectrum right like here's a big
Spectrum
and then maybe over here you have um
thermodynamic God
um
right
um and then like
you know maybe in the middle we'll put
something like open AI
um no we won't even put up now on the
Spectrum right
like what this is and why this split
exists why some people believe that AI
is going to destroy the world in a
criticality accident
and others believe that AI is going to
summon some entropy or whatever Nick
land it's a little too esoteric for me I
think that both of these sides are
absolute extreme ends of like a
AI political Spectrum
um but the reason you have this is
because we have no Theory
right
we have no Theory which is predicting
what the outcome of intelligence is
I'm trying these arguments because I
think you know again yukowski can have
these arguments I want him to do as well
as he can right like you're basically
you know what my line arguments is going
to be
um
we have no understanding of whether
things like intelligence criticality are
possible
right imagine you're sitting there in
the year is like 1800 right before the
invention of thermodynamics and all this
stuff
and you're wondering if you can get a
small stick to boil a pot of water right
in the year is 1800.
small stick boil water right
and
there you are get a small stick and a
boil water right it's an open question
well now we can we can do some simple
math right we can say something like
okay
um would
Jules per gram burning
all right here we go
so we can look up the combustion of wood
uh wow BTUs per chord wow different
Woods all different
wow
green wood is about 1 10 megajoules per
kilogram
okay
so let's say I want to boil a pot of
water and let's say I have a pot of
water
at 25c I want to raise it to 100 C and
let's say I have a gallon of water all
right I don't know I don't know this
um so how much energy do I need to raise
a gallon of water
so we can look up the specific heat of
water right
there we go okay so it's this many
joules per gram Celsius right so how
many grams one gallon of water to grams
all right all right so one gallon is
this many grams
okay
um so now we want this many jewels
we want to multiply it by grams and we
want to multiply it by C I hope you can
all see how I got 75 right
so we're gonna need this many jewels
all right all right so how many mega
joules is that
um that's equal to one point you know
two Mega joules okay so we need
I ring 120 grams of wood
with perfect efficiency but you can't do
it with less than 120 grams right
you need 120 grams at
absolute minimum even if you are perfect
efficiency all right perfect burning
[Applause]
um right
all right maybe I did my physics wrong
exact math wrong we sat here and we
calculated that right maybe I'm off by a
little bit I'm probably not off by too
much we did a we did a rough we did a
rough that sounds all right right like
it's like you know a quarter pound of
wood can boil a gallon of water if you
do it perfectly
um yeah well why don't we just ask Chad
GPD right
um how
many grams of wood do I need
to boil
a gallon of water
right all right the type of wood
I think I would have so many different
types
oh
damn
pretty close
pretty close they got better wood than
me
um yeah I think the main thing is I got
better wood than me
all right cool
now
how much
intelligence
um do I need
to solve
um to prove for Mazda Theory
hmm
I wanted to give me something about
grams okay
see what I mean
so this is a real question
wait this is a real question we can ask
right how much wood here I actually are
here
all right there's the question I asked
Chachi P2 right how many grams of wood
do I need to boil a gallon of water
so we can do that math how much
intelligence do I need to prove for
mozilla's theorem good question bro good
question
good question right
do we even have a unit
um
by the way this this stuff you'd
probably say is governed by
thermodynamics maybe classical physics
I don't know is it are any of those
things I use thermodynamics do we have
to go as far as thermodynamics I mean
thermodynamics talk a lot this is
straight up I don't even think this is
thermodynamics I think this is actually
just classical physics right
this is prob
ation sorry
okay
and let's see did it give me an answer
notice how this one ended with a number
right
this is a real question we can ask
but we have no Theory we sit here
we don't even have a unit for
intelligence
what
okay
what is the unit for intelligence
so
I have a proposal
I have a proposal
what's the unit for energy
um well let's not okay let's say what's
the unit for like energy per second
right
all right so what's the unit for energy
per second it's a joule per second right
that's a lot
all right like it's not just like energy
it's like like it's a question of more
like
[Music]
so what's the unit of dual printers but
I have another alternative unit it's a
horse power right
so I can do one horsepower to walk right
that's real that's a real conversion
that's how much that's how much watts a
horse is right like before we knew about
watts and jewels and we had seconds
okay so what's the unit for intelligence
per second right
well
Manny oh well just just man
right and then if you want like okay so
you know how you get like kilowatt hours
all right so we have like man years
right if we get rid of the per second
right
so yeah we have second Squad horsepower
kilowatt hours right you see what I'm
saying okay like man years or you know
what you know what we we don't want to
be we don't want to be gendered here
we're gonna talk about person just holy
 guys what if this invents a whole
new field of science and people are
gonna be like yeah it was this crazy guy
on Twitch man is this crazy guy on
Twitch you know what you know what
the universities man
no like seriously the universities
right
some of them were nicer to me than
others right MIT Caltech rejected me
when I was 18.
um what did Carnegie Mell when I was 22.
you know what are they going to do to me
now throw me out of academic Integrity
my sister wrote my essay for me real
talk
um now of course I would use GPT but my
sister wrote a nice essay about how I
wanted to be a well-rounded person I was
accepted into Carnegie Mountain
um
I was there
in 2012
I went back in 2014 and we all know what
happened in 2014. right we all know what
happened Walt Disney gamergate right
unbearable unbearable I got in trouble
um I got in trouble I got one of those
academic review boards for a uh
a prank
um this was uh no no no no no this is a
very serious place now we have all of
these administrators we have to do
something with them so the universities
are absolutely destroyed and because the
universities are destroyed we have
nobody
answering this question
we have no science we have no Theory we
have a bunch of companies running
absolutely out of control I think your
gasket is a good name for
like we have these people just just
going off and you know building whatever
I'm not anti-freedom I don't think we
should try to stop them
but we're all sitting here and we have
no theory for any of this and I don't
believe it's impossible
I believe that this is a real question
that can be answered
right
am I claiming that intelligence
correlates with energy I think you need
energy for intelligence but
how they're correlated is a great thing
to talk about in this new field
what
yeah I'm not on the internet I blame the
universities I believe in society
away in the last 20 years
you know that's a good Caskey quote
we're all going to die because we
squandered away the last 20 years that's
true
true
you see in 1971
in 1971 they decided they were going to
shut it down
right they destroyed the universities
because the last thing we want is new
knowledge they they destroyed nuclear
energy because the last thing we want is
more energy
they destroyed the money because the
last thing they want is people having
any real power
and they thought this was going to stop
us and it didn't stop us it just ended
up making the we have today
right now we have a world
we run by you know out of control
corporate scams and
of course you're gonna get scams if the
scams start from the top you're going to
get scams all the way down
makes me mad makes me mad intelligent
people do use less energy to solve
problems that's interesting
yeah
Okay so
um what could this field be right
so we have a few options in the field
okay one is information Theory right
um so yeah we'll look up information
Theory uh if you guys never read Shan's
paper
um information theory was basically
solved by like one paper
um
uh
right like it's a mathematical theory of
communication lays out basically all of
this
uh Theory
but
um
this is just classical physics by the
way one of the main things that
thermodynamics really talks about is
entropy right and this whole notion of
like like entropy is this ever
increasing constant in the universe and
look at what this paper is called
right information theory is just
thermodynamics right
there's so many similarities
but
like not exactly right I think like like
it's thermodynamics for information
it's thermodynamics for information not
thermodynamics for intelligence
by the way
if this makes its way to anybody in a
university somewhere
like in like a real University
reach out to me
reach out to me
you want to start you want to start the
next you want to actually do a science
well you wanna you wanna you wanna
around and do fake things for the next
50 years
you know
like is this obsess me this is it
actually really upsets me it really
upsets me how when I found when I got
when I was 18 and I found a world of
colleges what an absolute and complete
scam College was
all right universities
I met some very good people at Carnegie
Mellon and I'm not trying to on the
whole place I took some very good
classes and it
refine my thinking a lot and I do not
fault the professors for this
um at all these universities I don't
fault the professors there's some
professors doing amazing work today
Scott Aronson Robin Hansen
uh I fought the administrative class I
fought the same professional managerial
class so I think has caused a lot of
problems in society in the last 50 years
and if you work at a university and
you're like look we got rid of these
people we want to do science we want to
do Theory we want to understand this I
am so interested in getting some of
these answers
um
so I should have probably included this
in one of the most influential documents
that I read on the internet
right
um I actually remember it used to kind
of be better or maybe not but one can
prove that the better you can compress
that the better you can predict
and being able to predict the
environment well is key to being able to
act well
right like
read this FAQ
compression is intelligence
you know one of the things like people
like gave me for you know I was
talking on my Lex about how like I said
like gbg 12 was never going to uh be
like AGI and like yes this is a very
obviously true statement right like you
need something more right right the
thing can't act you can't you can't just
use a compressor to act
but like intelligence is compression
right
now interesting fact about Intelligence
being compression right
um so did they even release anything
remotely interesting in their stupid
gpt4 technical report
um
I think they post how well they do on
some of the things but do they talk
about the number that I really care
about is bits per character on Wikipedia
here oh open AI code base next word
prediction
probably fine
you know there's so much good stuff on
the internet it is so sad how Google uh
doesn't work anymore
you know and that's the other thing that
I'm like I I don't I don't hate open AI
I think that that uh chat gbt when it
was gpt3 was very overhyped uh I think
it was five or level monkey gbt4
was trained for 50-person years
um
where did I yeah uh 447.5 person years
to train and it makes sense like gpt4
used about 100x more compute than gpt3
so GPT 3 trained for half a year half a
person year right or maybe it was like a
whole person here but still like like
there were like a two-year-old or a
one-year-old like of course the thing
looked like a chimp right
um so I think person years is a good
it's it's I mean it's as crude as
horsepower
right
but how many person years of
intelligence does it take to produce gd4
right
like again it's not like perfect right
because I don't know
I don't know I haven't thought this
stuff through that much
but
I wish someone was you know
there's definitely differences in human
intelligence there's some efficiency
right there are systems that are so less
capable than humans and obese systems
that are so much more capable than
humans
um
do they even talk about
uh what
has the bits per character Trend been
um I found that
uh this is something that I've this is
one of the first things that I've
managed to use gbt4 for in fields of
science
and math where I'm not that good
um it could do a great job teaching them
to me and I can learn in kind of an
interactive Style
uh Brian Kaplan talks about like two
Sigma learning I think this thing is the
best tutor to ever exist
um
like it's just amazing like you're not
it doesn't require a real person's time
let's see what it is
no no no
no no no no no no no no
okay okay
I want it to be faster couldn't it fast
gpt4
I'm excited for when this is faster
oh replace with actual oh
the dvd3 paper wasn't totally cut
Sergey Brin is back at Google
yeah oh you know
uh
yeah
Sergey you went and partied for a while
you gotta you know what
Sergey I'll know you're serious when you
fire sander up a shot
that's all I know you're serious
otherwise you're not serious
and you know why you know why you have
to fire Sunder up a shot you know
exactly why you have to see if you do it
uh
validation loss I mean this is all per
token because it doesn't really matter
um some some data sets translation
like the chinchilla also talks about
scaling and how things scale like
differently from how these papers
thought they would scale
um yeah
pay to flops days
well
okay so if person years is 20 beta flops
for 365 days
like I just think that person years is a
much more like okay one person equals 20
beta blocks right this is this is the
thing that I've been trying to make
happen right we know what a year is so a
person year is not sorry sorry times
right so if we have payoff lobs days
that's one potato flops times one day
so I should be able to do that in my
head but I can't thanks Google right you
know here's another thing about like I
listen to Paul Cristiano's bankless
it was it was sensible it was always
very I think that you know Elias
yukowski has a bunch of just really
wrong assumptions
um I think that everything Paul
Christiano said was like reasonable but
reasonable from the perspective of like
this is what you'd expect like a like a
corporate person to say right I think
he's a co-founder of anthropic like this
is exactly what you'd expect from that
person right like the thing I can the
thing I like about yukowski is he he's
willing to think about these things much
more as a theoretician
um than as like a okay well alignment's
a real problem we have to solve whatever
you know also
this whole debate and this whole thing
really like kind of losing to Conor
Leahy has got me to spend the last week
obsessing about AI alignment so Connor
if that was your that was your goal
uh
you know it's always like oh we want
more people more people thinking about
this
all right well
I've spent the last week
thinking very hard about
what exactly AI alignment means
I think there's a bad faith
interpretation which is like my response
to any politician who might mention AI
alignment which is that AI alignment is
entirely a political problem well yeah I
want to say I had to be aligned to
America so we could up the Chinese
not aligned to the Chinese so they could
come up America right like trust me
you go to a politician you try to
explain this to them
like you're gonna get weird you're gonna
get fear of job loss and you're gonna
get like National Security and that's
all you're gonna get right these people
aren't going to be able to think about
well what if we have a recursively
self-improving super intelligence that
goes critical overnight and then infects
the world with diamonds Nanobots
like it's a little too sci-fi for me
I gotta listen I haven't heard Joshua's
Bach Joshua Bach's latest Lex freedmen
I gotta listen to it
I've heard he has a lot of good things I
really liked his old one
um so yeah you're off by a factor of 7
300. person years
so one person years equals 7 300 pay to
flop days
I just think a person here is a more
it's just a more like approachable unit
my person years of compute
all right one person is 20 petaflops
well I mean who ought to be the horse
right
right
who was the horse
what lucky horse outputted exactly that
much power right
and some horses probably sucked
damn damn you got a lame horse there bro
my horse can do two horsepower
is the spread of horses in terms of
power equivalent to the spread of humans
in terms of intelligence
don't know
[Music]
um
it doesn't give the cause or reasons for
intelligence yeah
I mean let's think of what the let's
think of what the energy equivalent
would be right
now I don't care about flops versus
parameters I care about bits per
character
okay loss is pretty good
okay
this is more interesting what is this
loss
what is a unit for this
do they give a unit
I get some informational unit right it's
some form of bits I mean maybe it's bits
per token
because this loss in bits per token
token you know
how many characters per token right we
can just multiply that right or just
just dimensional analysis right
I think there's some interesting stuff
let's see
um
let's see if we got any
Elon fixed oh my God
such a bad move this is such a bad move
like
Twitter went from
I did one thing while I was at Twitter
and I got rid of the box when you scroll
and now you went the complete opposite
direction with it I think it's
completely the wrong move and I think it
destroys so much long-term value in the
company but if I get too mad about this
I start thinking about how I'm gonna
build another Twitter
no
okay bits are more commonly gnats
mats are disgusting
um
one Nat is equal to one over ln2
Shannon's
what's a Shannon
oh
bam
[Music]
conceptually distinct from a bit oh bits
and Shannons are the same okay
you start using your name as a unit of
measure all right forget person years
we're going to call it one George of
intelligence okay
[Music]
oh man
I was just thinking about my rant about
why e is such a beautiful number
and why Lu is the most beautiful lost
one Lu is the most beautiful activation
function
beautiful on lus
ew
values are disgusting
did I make myself small enough
you guys can see how disgusting values
are
um
well there must be a uh a minimum energy
requirement yeah well I mean these get
into questions about life
someone linked a really good
to my thing yesterday about um the uh
God I can't remember the name of the
limit now
just posted about this yesterday there's
a limit on how much energy you need to
do uh computation
I know I know
um
um so there's kind of ways around this
with like reversible computation and
stuff
[Music]
um but it's unclear if reversible like
like that's an open question right here
here let's see if it knows
10 reversible computation
right
we don't know maybe that's an open
question
huh
Okay so
I promise
I'm not gonna bring this argument up in
the debate
but I'll tell it to you guys because
this is the real slam dunk argument
okay do you want to know why AI doesn't
destroy the world at least it might
destroy the world but it'll do so in a
nice slow and human understandable way
all right I promise I'm not actually
don't worry Eleazar I have much better
Arguments for you
why AI doesn't destroy the world okay
I set it a little X
okay God is real
simple God is real
I'm 100 sure about that but I'm pretty
confident God is real
God is real we are in a video game all
right
how well rated do you think the video
game is
right
what do you think what do you think this
this video game is rating all right like
if ever if game if games journalism if
there were actually some ethics in games
journalism
um what do you think that this game is
rated
huh
well it stands to reason not because
we're here right
highly rated games
are played
more then less highly rated games
it stands to reason
this is a well-rated game
if so
we don't die in some stupid way
QED
who likes my proof
who accepts this as a legitimate line of
reasoning
[Music]
what do you mean
God is fake who created the world
[Music]
damn atheists man
ah
ah highly rated game would involve us
solving AI safety then winning okay
I hate the word safety
alignment is slightly better okay let's
never use the word safety safety is a
disgusting word and you know society
today care is far too much about safety
I'm far too little about awesome
I don't mind AI alignment
in a very neutral sense AI alignment
just means
right it's a modern barely argument but
you know we're going to say that
feminism means
um equality
uh legal
legally quality of men and women
right and uh you know if that's what
feminism means I'm very supportive of
feminism
um and Alignment means um good loss
functions that do
what you want
there we go as long as it means that
then I'm fine with that
all right no one likes crappy loss
functions that make the AI do not what
you want
hmm
God Defcon what tragedy man what a
tragedy
why is there anything at all
yeah I bet Wittgenstein I bet there's
really wickenstein out you know he seems
like the kind of guy he
get into
the league wittkinston and high Digger
these guys are like
how do you know what is is you know
I like I like Bertrand Russell's
position I should say that the universe
is just there and that's all
it was the agency and component okay
um there is no difference between agents
and tools
agents and tools
um this is an important thing to
understand like I listen to Robin
Hansen's Bank list and
um almost everything he says I agree
with
um
regarding like likely economic
trajectories of the new world but he's
still making this agent tool distinction
and I really don't think there's a
difference right
um like the tail wags the dog is that
that like the tail wags the dog
all right
um
all right
okay so you know uh who's a dominant
species who's the dominant species on
this planet right who knows
who's the dominant species on planet
Earth no it's not cats
close so you're one letter off
and slow it's not ants Finance don't
dominate no no no no of course it's the
car the car is the dominant species
right
like have you noticed something
interesting how humans are subserving
into cars
all right
foreign
we've given up all our space uh to the
car
right the car is the dominant species
are
like you wouldn't fault a bunch of
aliens for showing up here I understand
that the EU is trying to push back
against the dominant species because
they may not like the fact that the car
is the dominant species
but by acknowledging that we have to do
something about the car we've
acknowledged that the car is this
terrible invasive species that showed up
everywhere
dude Henry Ford man
[Music]
all right fine in Asia it's the small
motorcycle
no actually the small motorcycle is
okay okay okay all right let's just
let's just let's just talk about LA
right can we just talk about la
does anyone doubt this has anyone been
to LA
you know some guy who posted on Reddit
he's like I moved to LA why are there no
people here where are all the people
they're waiting on the 404 they're
waiting in traffic on the 405.
foreign
agents and tools right like like it's
just a it's a completely arbitrary
distinction
okay
that's my that's my stream for today
um we have no Theory
we have no real Theory
that that answers questions like how
much intelligence do I need to prove for
mozilla's theorem
all right okay fine that's kind of a
hard question like we can come up with
some simpler things
like
oh maybe I don't know like how much
intelligence do I need to play chess
right
this stuff is not being studied
in
any sort of smart way
um and if someone out there actually
manages to work in an uncooked
University
and would like to be the place where the
new thermodynamics emerges from
it's not complexity Theory complexity
theory is probably the closest thing
but we can go to unsolved problems in
complexity Theory right
um
like this stuff's interesting
but you get into like I mean this is
this is like okay do one-way functions
exist is public key cryptography
possible Right like these are both
actually awesome questions all right and
if anyone here doesn't understand what
they mean spend some time like thinking
about those questions because they're
really cool questions
uh you know
I don't think I'm not a very serious
person and like for many things I'm not
very serious about because honestly I
don't care right like I do not care if
the money ends up in your bank account
or his bank account I do not care if you
know like two people break up or you
know oh no what about the trajectory of
my life or what about all these ego
 like I don't care man
I care about one thing
the search for truth
right
that's all I want from Life man I want
to know the truth I want to know the
truth about everything I want to know
everything and then I'll die okay
like I'm cool with dying once I know
everything
but I want to know everything I don't
want to die before I know everything
that would suck
I don't care
don't care
nice car in his apartment whatever
status symbol your clothes like it's all
 man do one-way functions exist
is public key cryptography possible
like these are the kind of things that I
would take very seriously
I because I take these kind of things
very seriously how much intelligence do
I need to prove for modulus theorem
right
and you know
when you can't even answer basic
questions it's hard to like talk about a
theory and it's very hard to talk about
a theory and like an academic system
that is absolutely destroyed right
it's college or scam completely do not
go to college do not give these
idiots money you know
if you're in college right now like like
I get it I get it you're learning stuff
but trust me you'll learn more if you
like you know just do things right and
this is the like or if you're in college
right now and you're interested in one
of the places where like we do have good
theory and you're studying that theory
if you're studying information theory if
you're studying complexity Theory like
these things are kind of interesting if
you're studying physics if you're
studying chemistry
biology be warned most of it is complete
crap but if you're trying to build
things like molecular Dynamics
simulators right if you're if you're
taking like a
like an information based approach to
these things right
okay all right I I know I know this is a
question that that that like
University is good for learning
perhaps extending
established Theory
[Music]
um
University is not good for
for finding a job
oh my God if you want a job do not go to
university
getting a job that requires a diploma
this shit's so sad and it's you sad NPCs
that keep this whole
what what's the uh what's the um
education industrial complex alive
all right the educational industrial
complex
you know
Society doesn't need sheep
we're gonna replace the sheep with AI
World economic Forum all know
this you know we're replacing the sheep
with AI don't be a sheep
um you know
my opponents in the debate
on
Tuesday did not go to college
I don't think he went to high school
and he's produced some of the most
interesting thought
that I've seen in
like anywhere on the internet
I think the Doomer is unfortunate
because I don't think the doomor is
true and I think the dumor shit's
depressing
and hopefully I'll talk some people out
of it I have some good arguments
um real arguments not not me screaming
and ranting about stuff I'll try my best
to stay composed not go off on political
rants right like look yeah you know I
have Centrist like Left Right politics
but I have extreme libertarian politics
um if you're talking about like the
other Spectrum like the auth live
Spectrum
um
I was wondering what else about that
because I hate authoritarianism so much
um going against the demigod
prepare the best I can
have a bit more prep plan for tomorrow
um
but at least he's put some interesting
new ideas in the world which is more
than I can say
Le eyes are yudkowski alone has done
more for science that all the
University's science departments have
for the last 10 years
you know
medicine I mean it's pretty it's Eleazar
but it's also what the have the
universities been doing
and he has this thing where he says we
squandered the last 20 years of
alignment research yeah we kind of did
we have no theory of intelligence
we have no Theory
we're sitting here a drift talking about
some insane bounds from complexity
Theory there are bounds from complexity
Theory you know you're gonna see my
opponent bring them up in the debate
and then I'm gonna be like yeah yeah
that's great man wow I don't care tell
me I don't even need a halting Oracle I
just need to solve this massive NP
complete problem wow that's so easy and
complexity theory is very easy right and
B very easy it's not halting whoa whoa
whoa well he doesn't even it's not even
it's not even in P space man you know
whatever it's in P space or you know I
don't know
you know what I mean like like it's MP
but you don't need like like whatever
saps in you know what I'm saying you
don't need a
non-polynomial amount of space
um
um yeah no he's I mean so much of this
modern like
thought around this stuff
and then like I mean this this document
too
where's Marcus Hunter
there's a deep mine now there you go
there you go he's a deep mine now
all right you know
that was that his picture
um
it's not just you Caskey there are a lot
of great people right there there are a
lot of great people some of them are
sort of in
some of the most order in universities
right
um check out like all of all of all of
Scott Aaronson Scott Aronson also
has put forth a whole set of interesting
stuff but it is these people doing it in
spite of the universities
right not like the cost of them not
because
any sort of industrial era science works
it just doesn't
right
Sutton became a Canadian citizen in 2015
and renounced his U.S citizenship in
2017.
like that's an extreme step all right
you know I talk about this off-lib
spectrum some people might be further on
it than me
some of them are announced
uh
who's the Roger beer you know like
respect ma'am respect you're stronger
than me
um what Defcon you want to get your
vaccine card checked you want to pay
with a credit card and get your vaccine
card checked an anonymous hacker
conference yeah yeah ma'am
waiting on that public apology
no
not me I mean I saw it coming but like
be like wow we were taken over by crazy
people who thought it was okay to check
people's medical records
for a hacker conference That was
supposed to be anonymous
we kicked the crazy people out we'll
make it cool again
great that's all you need to do
you know
um
I don't know like look people Defcon you
know it's like San Francisco right
like
San Francisco is an utter and complete
 but it's a shelling point
Defcon is a conference run by people who
do not remotely share anything that I
would call hacker values but it's a
shelling point so take what you want
with that
I don't know that's a PC thing I don't
know
I think colleges or whatever you think
universities are ever going to study
that honestly and universities are ever
going to study like like like a wokism
honestly they can't even study
communism honestly you know
[Music]
um
all right
why did we end up it's not a political
rant hopefully hopefully I brought up
some real some real science some real
questions
I don't know ma'am you know
the end of uh yukowski's backless
episode he's just like
yeah it's hopeless we squandered the
last 20 years and like I kind of agree
with them
destroys the world in the way he
imagines
um and I think you'll tune into my
debate if you want to find out why I
don't believe that
on Tuesday at 2PM
um
but we should yeah
I I just can't do science anymore I mean
that's the real new reaction talks about
this it has a what I think is a good
explanation for what happened
the grant process it's a
frustrating guys it's frustrating
um but hopefully we can make change or
something I don't know man why don't we
go out in the streets and protest
I don't know man is it hopeless is it
hopeless it's not the AIS that kill us
it's the professional managero I don't
think they actually kill us
give them personal managerial class if
they get AI the two of those things
combined is an Unstoppable force that
will suppress freedom and and destroy
the whole rest of the universe so don't
let them we want to become grabby aliens
man we want to expand into the whole
solar system and like I'm not you know
uh uh
ah Alex is sick of listening to me rant
and complaining so I went to you guys
hopefully you guys appreciate it
um
or granted about this all weekend I've
been preparing for the debate
uh
I almost don't want to argue which we
just both rant against the kind of
people who are really exactly the
problem and why we're not going to get
any
AI alignment in a charitable Steel Man
case because we have no theory about any
of this
you know we have no Theory and trust me
allying with the worst people who caused
this problem by the way right you think
oh we're going to go to the government
we're going to get reasonable
restrictions passed on on AI development
so we can all slow down and solve
alignment they created this problem
you're going are you going to the people
who stole your bike you know saying that
we should do something about bike thief
and yeah we should with the open AI guy
we can't let llms out they're gonna do
crime oh but twice LMS are bad we want
to do all the llm crime you can't do llm
crime that's only for trusted people
trusted people okay now you can watch my
stream uh I think we'll leave with the
question that that we came in with
thermodynamics is to energy as what is
to intelligence right if we can answer
questions about how many grams of wood
do I need to boil a gallon of water
or how many grams of wood do I need to
move a train a mile right how much
intelligence do I need to prove for Moss
Last Theorem all right it's a real
question
I'd love to know the answer to it I'd
love to have a science that can talk
about the answer to it can we bound it
from the bottom can we bound it from the
top all right
um
I know there actually is science on this
being done somewhere please link it in
the comments I'm very interested in
reading it every once in a while I'll
stumble upon something that's like damn
okay okay I'm glad someone's thinking
about this right
but like kind of you get to the end I
feel like I've kind of gotten to the end
of a lot of these fields and there's
still a lot of questions and there's no
one really in any
in any sane way answering them physics
has gone off the rails
you know so many of these fields have
have gone off the rails and
you know I'm not I'm not a real hard
conspiracy guy I think mostly it's just
dysfunction but
there's something something happened
something happened to destroy the
universities something happened to kind
of stop science
I'm curious what it is
curious how we can prevent it and uh
hey man if you were asking me to take
you know we don't live in a world where
standing still is safe right like
imagine you're on a highway
standing still is not the safe option
standing still will give these people
time to even more you know coalesce and
bring their powers together look what's
happened to the internet right we're
just gonna have more time for these
people
is that the word to like like bring
together and lock down their power
that's a good word for it I don't know
what it is
um
you know uh
uh not constrict you know you know like
like you're you're rounding them up
right you're rounding up all those
and you're just you just put consolidate
that's the word thank you chat thank you
consolidate yeah they're gonna
consolidate power if we stop so we can't
stop
um we gotta keep going full speed ahead
make it go faster you can't consolidate
right
consolidate
um can't stop won't stop uh all right do
we want to let the non-subscribers talk
no your worst people subscribe if you
want to chat next time thank you for
watching the stream happy Sunday
everybody and uh we're not all gonna die
we're not but it might suck balls but we
can make choices to make sure it doesn't
suck balls so I ask the question that I
always ask on this stream we have a new
question are you the problem and if you
are the problem think about what you can
do in the next week to become less of
the problem
I'm not saying that you need to call out
other people who are the problem
not saying don't do that like you know
you know like you can rant and it's all
fun but most of the time you got to be
doing your own right like think
don't try to stop other people from
being the problem right think about what
you can do to stop being the problem
right and I'm trying I'm trying boys I'm
trying you know you know I'm trying
um
yeah
tiny grad tiny Corp comma we try we
tried we try hackathon comma hackathon I
tweeted about it uh if you want to come
uh you know we're in a good ERA of where
I'm gonna talk for a bit and I'm gonna
delete my Twitter and delete all this
garbage again like it's such a huge
waste of time I don't know man I'm here
to live under a bridge and find truth
you know me all right thank you all for
watching the stream goodbye everybody
to my to my twitch audience i'm just
going live
so what i should be able to do now
is ray is host robo race
where i'm going to be in 10 minutes
seven minutes you know me and trying to
use computers so
you know uh raid
robo race the channel has follower or
subscriber only chat
oh 11 users are ready to raid robo race
okay wait
so if i click raid now there you go you
got 17 viewers congratulations and now
you're linked to me
um so now like one minute i just need to
go through the restroom really quick
i can cool be right back ah
[Music]
yeah let me see
okay you guys are in for a real treat
right now soph has got none other than
the world
famous security hacker george hutz live
with us right now
get your popcorn out
the ass based like follow track hey guys
actually you know
we're back here on on uh with our guests
so we've got welcome back uh mike
sokolov and then uh welcome to the party
george hot so
awesome to have you guys together i'm
just gonna start off with a kind of a
fun question so which is more important
the track or the street
oh yeah george you want to take this one
waymo treats the track like a street so
on the track you're actually using the
gps is a good idea
uh if you're driving on the track
assuming do you drive yourself would you
drive with other cars on the track too
like what i mean is it like time trials
or
yeah yeah so maybe i should should give
a little bit of background so george
doesn't really know much about rubber
race at this time so
maybe mike you want to just give him a
little bit of an overview and and maybe
then you guys can see the crossover
between the tech
okay i'll do that so actually for the
moments you know
we we run so-called uh season beta
it's not like the first season the first
season is gonna be the next season
supposed to be uh but now we run like
like a kind of some kind of trial season
but it's
it's an actual competition but you know
it's still
far from actual race and that's why the
teams actually
race against like it's time trial is as
you've said
yeah yeah uh yeah we actually give
uh the teams equal cars uh
some car they even share the cars so you
know for instance uh
sat uses their own car but it's the same
configuration and other team
teams share another another dev board
actually the
airboat is stuffed with all sensors you
can imagine
it's like five lighters cameras uh
ultrasonics
two raiders from the rear uh
it's like why do i ultimately set up why
do i need any of that
if i'm doing time trials why can't i
just do the exact same gps line every
time
exactly and that's actually actually you
know that was made as a kind of like you
know
test and system onboarding system for
the teams and of course
you know for this particular kind of
challenge uh the teams do not need that
much
uh that uh set of sensors you know for
localization and stuff like that
and you're absolutely right they are
mostly using gps
for localization because it's it's
pretty much enough for for doing that
kind of challenge so far
at this stage yeah yeah
i i can get i can get 10 centimeters
it's an open air
you know if i have a good antenna maybe
two antennas exactly
exactly yep you're absolutely right and
that's that's what they are doing now
but but for the for the furthest
challenges of course the the competition
going to be more and more complicated
especially when we come to the actual
wheel-to-wheel race and of course it's
going to be
you know you you have to use other
sensors then
it's still up to you what sensors to use
we don't push them uh
the teams to use all the sensors it's up
to the actu uh
every team what what sensors they want
to rely on mostly
but we give give them like a it's like
you can kind of like
um comprehensive kind of set of sensors
if you're doing time trials how
different are the teams and are some
like
considerably repeatably better than
others like they built like
like their control modeling is better
and stuff
oh that's a good question because you
know indeed
the teams that that that just started
they
they are actually pretty much close to
each other
and you you can see that similarity for
the for the newcome
new newcomen teams but more major teams
actually are more brave they
they uh go much higher speeds and uh
these teams are usually going much
faster but you know i believe
oh i imagine this is true about humans
too i imagine all the times are pretty
close
if you put like expert race car drivers
in the same car
yeah so i wonder i wonder where there's
more spread
well who's not going full speed who's
not flooring it on the straightaways
some teams aren't
uh yeah because you know we still have
lots of
uh technical issues so that's why you
know we and we have pressures you know
the you you've seen the the the crash
uh how much they have to pay if they
break your car
this crash was around 100k
kind of kind of wow yeah
yeah yeah because the car is pretty cool
yeah the car is super expensive you know
that's
that's that's why the teams are you know
uh
prius exactly yeah yeah
yeah yeah i can understand your reaction
absolutely
yeah so of course for the moment we are
really underperforming
that's that's that's clear what you gave
people
cars that are over a hundred thousand
dollars who can't drive in a
like some of them are millions but you
know it's not about it's not about the
car it's mostly about the software
so that that yeah yeah that's what i'm
saying give him an rc car and a neon
okay you're very welcome to join as a
team
so we'll be happy to see you uh racing
against others
yeah george do you think yours your
device your comma
ai device would be able to run on one of
these things
uh i mean yeah i i don't see why it
wouldn't uh if the cars are nicely
controllable so i mean we don't really
have much like uh i think it's not
designed for racing we don't have
we have some old code which does it when
we did the racetracks
but for racing you don't it's very
different from driving on the road
driving on the road is a much more
dynamic problem racing is much more
static you just want to figure out an
exact model for the car
you want to optimize all offline the
exact line that you want to drive and
then you want to drive that line as
close as possible
yeah but i think they can help each
other because when you have when you're
going to have other cars on the track at
the same time then they're going to have
to avoid each other
i think that's what uh this metaverse is
this virtual object exactly
moving into the next season which is
really interesting
well yeah i mean once you have other
cars you also have to consider you have
to consider drafting
um i think that's the biggest thing uh
you're going to have to get you have to
get in
behind the cars you're going to have to
i mean i guess that's what humans are
doing intuitively they're modeling the
air
right you know every race car driver you
gotta gotta get right behind uh the
other car
um and you need a lot less uh
power so if you ever you evenly matched
cars the lead car is at a big
disadvantage
breaking the uh braking there yeah um
so what do you say george you're gonna
you're gonna enter the uh get one to
join one of the teams or something or
get start your own team oh no i'm gonna
do especially when there's other cars
i'm totally gonna crash it i don't wow
know you're going to have some expensive
crashes when you put multiple things of
these on
yeah for sure so so how do you think
that like your system might be able to
help uh
you know even if you didn't enter your
software i mean you think there's
crossover there
i mean not really there's not many parts
of it i'd really use
i hope that the actuators in those cars
are considerably better
than what's in the production vehicles
um if they were designed with the
purpose of being computer controlled
uh i mean you know it's open source you
could look at it
but if i were really trying to win this
race i'd write something entirely from
scratch
cool and then what do you think mike on
your side do you think uh
the other way around you could help
georgia anyway
probably yes because you know what we've
realized because you know we were doing
our
our own experiments with the the robocar
at much higher speeds and you know for
instance when you go
uh 200 kph it's it's not that much you
know
similar to what yeah when you're uh
uh driving at city speeds
you know it it's all errol becomes
much much more different you should rely
a lot on on you know what what time
model
you have with vehicle dynamics model you
have and it's it's mostly become becomes
a kind of like you know
mathematical kind of exercise then at
that high speed so
these cars were designed for that kind
of racing of course not for the present
state of the
of the race of course it's going to be
developing so please
don't judge uh on
what i see now of course for the further
rounds it's gonna be like higher and
higher speed and that and then
when we come to like say to 200 kph it's
going to be
much more interesting story that and you
know and how software actually
uh deals with all those uh things
happening at
that high speeds is this not just about
localization
yeah with it open source
sorry go ahead george it's not about
localization at
all yeah this is this is what i imagine
i imagine it's very quickly going to
turn into
like pretty much how good is your
controller in open loop
um if if you don't have an incredibly
good open loop controller you have not
built a good model of a car
whereas when we're driving on city
streets
at 30 miles an hour our controller can
be so sloppy who cares
you're going 30 miles an hour
yeah yeah exactly it's pretty much
linear at that kind of speed
yeah it's all linear exactly yeah our
entire model we have like one entire
stiffness parameter
that like it's all just a fudge faster
but you know it doesn't matter yeah yeah
open pounds performance is not limited
by that but by the way that's why we we
also started developing our own
simulators
uh because you know simulators like
carla and and stuff like that
that are mostly made for like city
driving autonomous uh
vehicle development they are not really
capable for what we are doing so
we were also trying some racing
simulators but
they've got other disadvantages where
actually actually
we ended up with starting developing our
own simulator which actually
has capabilities both for racing and at
homeless driving
just because you know no one does that
unfortunately i mean
do you have to like go beyond bicycle
models
uh yes why not because actually
you know that's why we also invited lots
of universities because you know
universities
may bring some out of the box approaches
you know for for for that kind of stuff
instead of more kind of conservative uh
uh automotive companies
yeah i mean you know we barely even care
we we were just talking yesterday about
how our controller doesn't even model
slip
it doesn't matter uh like we control to
you all right we have some function that
turns ur right to steering angle and
it's it's
vaguely speed dependent but we're not
doing a lot to model
the uh the the so cars have obviously a
forward velocity would cars also have
a sideways velocity when you're going
around to turn and uh
you know in open pilot we can kind of
say it's zero
but right in a race you can i mean
that's all about otherwise you know
if you want to assume it's zero then in
a race why would you slow down for a
turn right
right so so uh george do you think
like this you could advance your system
uh i mean
you know anything that you could benefit
from from rubber racing i mean it's all
open source right you see the
the pros and cons of open source versus
a closed system this could be a perfect
example though and uh i mean yeah sorry
we only got a minute left so just to
give you a heads up
yeah yeah like the way i would think
about it is how much does
uh most human drivers drive on the roads
and have never been on a track in their
lives
uh so i mean the the overlap is really
incredibly similar with human driving
skill right you do not need
any track experience you need no
understanding most humans drive cars and
have no understanding that when you hit
the brakes the weights transfer to the
front wheel and you can steer better
right like um right
you know but the humans that do drive on
the track one would argue that they
do get better skilled so yeah
but it doesn't it doesn't matter the the
the driving on the roads problem has
almost
nothing to do with that uh
so yeah i think there's i think sorry to
interrupt you george but i think
we just ran out of time so uh my
apologies uh
look at that very interesting moment
it's such a pity
because yeah the conversation
okay sorry gotta go guys but thanks so
much for joining us
hopefully you can find george on his
channel as well bye peace
[Music]
bye
[Music]
hey guys welcome back it's awesome to be
back here with you guys and uh we've got
george hotz and mike sokolov back with
us so really excited to continue the
conversation we
we uh cut off a little short yesterday
so got a little bit more time
really excited about this so yeah how
are you guys doing today
pretty good taking class
it's like i feel like i'm on a super
cool super warm private party you know
it's it's it's it's so good
okay so yeah sorry mike to interrupt you
i just thought
i asked a quick question for george
because i feel bad i cut you off
yesterday georgia
um i just wanted to ask you a comma
related question because you're
i know you're your company comma ai is
doing some cool stuff so uh just let us
know a little bit about the mission
there
and i think some people might be
interested to hear about mission akama
and and actually you mentioned that uh
uh it's the north korea of self-driving
companies a while back
so what does that mean man tell us about
it
oh it just means we're not tied up in 10
000 international
uh alliances you know we have we have
actual sovereignty in the self-driving
car space
um our mission is and it's a very clear
mission statement to solve self-driving
cars while delivering shippable
intermediaries so
it's that statement that statements
written on the board of comma and what
does that mean it means solve
self-driving cars
build a car that you can sit and type in
where you want to go and it takes you
there
and then delivering shippable
intermediaries means don't say you're
going to have it in five years
show progress to the world and make sure
people are actually using that
uh stuff same as tesla i love it
yeah i remember when we talked to our
podcast you were saying you're
just a little bit behind tesla has that
change at all in terms of your
your uh forecast for when full
self-driving is going to be available
i saw a tesla ship uh red lights
in april that stopped at green lights
and i'm like oh we're going to catch
tesla soon and then i saw them ship full
self driving and i'm like i was still
one or two years behind
yeah it's pretty amazing man you got to
try it out it's it's really cool so
again getting back to uh robo race
though
yeah i'll give you a ride sometime if
you want um yeah
with rover race so now that you know a
little bit more about it
if you were in the driver's seat and you
could give any feedback to mike you know
how how might you run it differently for
example like
with with the hardware or or some of the
the software they're doing
um i would uh build cars that are way
cheaper and let people be much more
experimental with them
awesome
yeah yeah that's what we are now yeah
doing actually because you know
uh i promise to mention we are now
developing a new car
much cheaper because you know this is
this one
you see today is like crazy expensive so
yeah we're gonna go
lower to like i would say uh
200k or even to 100k expensive
like kind of car wow that's that's still
a lot more than i thought i was i was
thinking
yeah about 5k but you know put them over
all the other cars yeah i just
understand you i know your philosophy
but you know
if you stuff it with all those crazy
sensors and stuff like that
the sensors themselves make it like
super expensive you know
well this is the same scam that a lot of
the whole like autonomous world is
falling for
um you do not need good sensors you just
need good software
you can literally hear you would stick
comma twos in the car
absolutely you know yeah yeah
comma twos are a thousand bucks and i i
bet that i can beat
all these teams with a comma two and a
prius
i see them going ninety five seconds per
hour you know
you know i i definitely wanna wanna see
you in my other
our teams because you know you should
you should teach others
how to do stuff in a much cheaper way
you know
us too of course well the
part of the problem like like and what
would like i would see i would see like
like
like i can't buy one of those cars and
go drive it around in a parking lot with
me sitting in it so we did we did a
racetrack we did uh thunderhill
racetrack
um and we got it we got to do we got a
205 time in our pre-decent time
um and the reason we were able to do
this because we tested a parking lot
we went to parking lot we sat in the car
and we just you know kept making sure it
could take tight turns and it could
follow the racing lines and all that
stuff
i remember
sorry to interrupt you mike how hard do
you think would it be to you know just
put one of these
that maybe some people don't know much
about comma and it's just like a
plug-and-play system right so
maybe it might just bolt onto these cars
pretty easily
yeah i mean it'll it'll as far as like
sensors go
it's all the sensors you need for racing
um it has a high precision gps
uh we have software already which will
do all the
uh kalman filtering which will give you
an actual like like
localization track that you can drive on
um
we have a camera if you need that at all
uh and yeah that should be enough
awesome sounds cool sounds really cool
mike's so
you're you're thinking of the future for
season one with this new uh
you know met dev bot that's coming out
uh
do you think you would consider some of
these changes that you know
george is recommending or what's what's
your plan for the future actually you
know i would i would i would like to ask
uh george you know what what do you
think about like you know what what top
speed you may achieve with
with uh the setup you've just mentioned
like
um so i think we got our prius i think
we got our prius up to 95 miles an hour
hmm okay can you go uh like
150 or something like that well could
could the common thing go on fit not in
a prius
uh could you could not but you know
imagine imagine you've got
you've got a vehicle like they've bought
or another similar electric vehicle like
high performance kind of yeah
absolutely there's nothing in the
sensors limiting how how fast you can go
you need
almost no sensors to do this i mean i
imagine that a lot of these cars are
like gps
uh line followers and like all you need
for that is a decent gps
on this one of course of course it's
what happens now right and like
the tech kind of hasn't if if you gave
me the parameters of robo-race and asked
me to win
i would build the best gps line
following robot i could i would
pre-compute offline
the exact trajectory i'd put it in like
an optimizing framework
and i'd say okay you're going to follow
this line perfectly
what about handling the metaverse those
virtual objects and stuff
you know would it be how dynamic are
they
you know you you're not now the teams
receive information about a
object uh like you know um like
200 meters in advance for this
particular mission so
and we're going to we're going to make
it shorter and shorter so you know
that's that's actually the idea to to
get uh get them informed like no
more than anything so what i would do
for that
is like so i already have in you know
maybe a lot more of the common stuff's
applicable than i thought so we have an
optimizer uh
running on the on the comma 2 it's it's
model predictive control
and you can put in basically your path
and
it will take that path even if you put
it in a really bad path and it will do
things like minimize
jerk minimize braking minimize steer
angle so just
run all that uh stick the i mean i
assume you get the gps coordinates of
the metaverse objects
absolutely or i could do it yeah so i
could do a transform to put it into that
and then like okay
fit the line uh sure i'm gonna i'm not
gonna have a perfectly planned
static uh track trajectory for that
but uh it'll be good enough
okay so it's interesting could run in
the metaverse um
in february at las vegas well so
i'm just going off the race i just saw
where they weren't exceeding 90
kilometers per hour i'm confident i
could beat that in the prius now
could i beat those cars being controlled
well of course
uh okay but uh no i mean the reason
comma can't do it is like like we're
very you know we have our mission like
our mission is solve self-driving cars
while delivering shippable
intermediaries
um this is why we stopped going to
thunderhill like it's it's
they're very fun but it is a distraction
of course i think i see some value
though in pushing the limit with those
cars uh with the prius or whichever car
you've got to fit it to because then
it's going to be able to respond a
little maybe a little quicker on the
street right
it doesn't matter um now no there is
absolutely
the value is not it's just different
value i mean there's you know
like car racing in general has has a
huge amount of value and we've learned
so much about vehicles from
cars but if you're trying to build a car
that operates on the street
you're not operating anywhere near the
limits that you'd be operating in a race
track and you do not become
a better driver right like i do not
think that that that
race car drivers are necessarily better
street drivers
because most accidents on the street
happen because drivers are drunk
distracted are asleep right it's not
like
oh you didn't understand the vehicle
dynamics well enough to swerve around
that moose
um and then you know drivers do
incredibly stupid things that race car
drivers won't do for example you should
never brake and steer at the same time
but modern cars save you from that
anyway
true awesome so yeah i think some people
definitely want to see it though i've
seen some
people in the chat saying is there a
video available with that the
thunderhill session of the prius race
yeah i think so yeah if you search for
it yeah i'm freezing awesome so it's
probably on on
on uh just check internet on the uh
google or whatever
cool we have no but we have what do you
see what if you did in the accuracy
i know that video's up there very
awesome very cool
awesome so so uh yeah so how do you see
like
going forward now george i mean you have
your mission
you see robo race mission i mean how can
you guys help each other do you think
well i stayed at the conversation what
exactly is the robo-race mission
yeah yeah so maybe i'll put that back to
you mike
okay actually as you can see we're
actually kind of you know
like a
we actually are trying to organize
somehow the
this particular part of the industry
like research institution and stuff like
that to push them for like foster
development giving them challenges and
stuff like that so i believe we're doing
some good thing
you know because eventually most of the
findings that gonna happen
here in robberies will be applied to the
real roads so so we're always thinking
about uh
road relevance you know when actually
when we were thinking about metaverse
and we're designing it we were always
considering that it's not just a like
entertainment gaming but
also a thing that uh that should
actually push the teams for it for
making uh meaningful
uh stuff for the industry well but
like why not like like
i think the the race cars themselves
just very cool
like you know i loved i loved battle at
least at least of course
yeah well yeah and it's like almost that
you get this really like like i always
think like what advantage
do robotic cars have over human guards
and the advantage is
we can crash them
oh yeah well right don't people say if
there's enough humans yeah
yeah yeah right so like you know you can
take
risks with with robotic cars that you'd
never take with human cars
can we get these cars up to like you
know absolutely insane
speeds we don't need any weight for any
safety equipment
um like that's that's that's what i see
in like the future of like a robotic
racing league
that's going to be fun yeah guys the
speeds are crazy
crashes are spectacular
i think we'll run out of time
unfortunately thank you mike and thank
you george another time
darn we need to get you guys on my
podcast so we could have like a whole
day
that would be awesome all right well
thanks so much guys and thanks everyone
on the
twitch chat for providing your questions
sorry if we can give you many thanks
to the chat amazing session super cool
thank you all
right thank you george thanks for coming
thank you george
you know I go there and I want to change
things right like you know like I said
like I'm a wartime CEO I'm not a
peacetime CEO
George hotz welcome to software
engineering daily
hi good to be here yeah so I'm sure a
lot of people know you from uh you know
jailbreaking breaking devices or working
on self-driving cars or you know
Marathon twitch sessions but for those
that don't know who you are to give a
little intro background on on who you
are what you've been up to
uh my name is George I'm a programmer
I've been programmer for 20 years
nice I love it so for those who don't
know George is is a bit of a celebrity
you know how old were you when you when
you jailbroke the iPhone 18 or so
something like that 17 and I didn't do
the first jailbreaks I did the first on
lock
okay okay so but you know I did it with
a technique that some guy old man he's
still on Twitter 20 years later bro you
stole my technique I'm like what do you
mean stolen man
yeah oh you got a copyright on that come
sue me bro that those stupid don't sue
me
website though yeah cool so JL broke the
iPhone jailbroke PlayStation you know
all this cool stuff and then
um what 2015 2016 released
um this self-driving kit that you can
just add to not any car but almost any
car you know you can hook it up to a
huge variety of cars so not starting
from the ground up like Cruz waymo Tesla
things like that but but actually you
know modifying existing cars been
working with and that that became comma
AI
you recently left common AI but can you
tell us a bit about I guess like how it
went over the last five or six years
what did you learn what changed are you
bullish on the industry what are you
thinking well so first off like you know
the main reason I left was there just
wasn't that much for me to do
right like we
we have really good people in place who
are executing on the plan
um you know I go there and I want to
change things right like you know like I
said like I'm a wartime CEO I'm not a
peacetime CEO
um no I mean I I think they're doing a
great job and I think that the you know
the way to write good software is to
write it three times
so everything gets Rewritten and
everything gets improved right and this
is a very slow process the same thing's
true about Hardware right there's a
reason the iPhone 14 is so good because
of the 14. right
um so you know it's just a slow grind so
do you like to write the first version
but but don't love the second and third
as much
you know yeah it's it's
I like the first I like this I I feel
like
once I can as long as I can conceptually
improve things I'm down to keep
rewriting it but once I kind of run out
of conceptual improvements and it just
comes like oh well okay you just gotta
do this huh then I'd rather hand at all
um one thing you know a couple things
that were different in your approach
um at comma compared to other places one
I think was in sort of like the
segmented approach versus a more
end-to-end approach that that you took
can you talk about those differences do
you still think that's that the the
intent approach that you took at commas
is the right approach oh unbelievably I
think we could even almost go more end
to end today
um so what comma really is is uh we
built a simulator
and then we train our models in this
simulator right and this is second
Paradigm model so we've talked about
first Paradigm models where these models
that just be hand-coded lanes and cars
it turns out with lanes and cars you can
do a lot of driving
um but then it becomes really hard to do
something like say drive through an
intersection right
just like drive through an intersection
because there's no Lane lines there
right and you could say okay I'll detect
the lane lines on the other side and
interpolate the path but it's not really
good
um so this was first Paradigm models
we're like how do we fix this we fix
this with second Paradigm bottles so
second Paradigm models are trained in a
simulator
um but what's notable about this
simulator is it's not like a car law on
real engine style simulator oh we call
it the small offset simulator because it
uses real routes loads them in and lets
you make small deviations from what the
car actually did
right so you can load up a right way
yeah okay uh well laterally or
longitudinally right so like there's
like the real path of the Eco car and
then you can uh
change that by kind of uh just visually
shifting stuff right you use a you get
the depth of everything and then you can
like reproject
um and this solves a really fundamental
problem uh we call it behavioral cloning
but it means a lot of things like if you
just take a model and you just predict
the human path given the picture uh this
will not drive a car
and the reason it won't drive a car is
because your samples are not IID right
when you're trading a classifier uh you
the first image is an image of a cat
right and it says cat or it says dog it
doesn't matter if it's cat or dog
because that doesn't affect the next
images
okay this isn't true and driving if you
have an image and you predict go left
the image afterward changes your
predictions affect the future uh and
this is why standard supervised learning
techniques uh don't work at all on
driving this is why you have to train in
a simulator
um so we change the simulator it's some
hybrid of supervised and reinforcement
learning uh and this is this is I think
the most extreme of anyone in the
industry
um but I would like to go even more
extreme I would like to go where we at
least train a really powerful Foundation
model and we're moving in this direction
a foundation model we train an auto
encoder on the uh on the visual features
uh you can look like when you look at
stable diffusion the outside of stable
diffusion is an auto encoder
um meaning like you can do
dimensionality reduction on the image in
a completely unsupervised way
and then the second part is a really
powerful Dynamics model just a predictor
and you can uh these Auto encoders will
output things into discrete spaces not
continuous spaces and the cool thing
about a discrete space is like language
right so you can break the picture down
to say 64 words from words from a
vocabulary of a thousand and then you
can use GPT style techniques to build a
predictable right GPT is also working on
like a vocabulary of like a thousand and
uh you know 64 words is very much within
so yeah we're getting close to the
true dream that we call this third
Paradigm models
okay I want to talk a lot more about AI
as we go but so so building a simulator
is is the purpose of having the
simulator just it's much cheaper to sort
of have a simulated world and make
changes as compared to like
driving out in the world and trying to
get better on on that video no you can't
no so the problem okay the simulator
allows you to train uh on policy
right if I gather video if I if I take a
car out right
let's say hypothetically I want to train
on policy with the car I could load my
models onto the car I could go out and
gather data and then I can take one more
step in those models and then load the
next models onto the car but the problem
is you have to do this every time you
train
right we have tons and tons of data
we're not data Limited at all but the
problem is all that data is off policy
when you're trading a model right in
order to get on policy data you need a
simulator
gotcha okay okay sounds good when you
say what do you mean off policy on
policy just clarify that well these are
reinforcement learning terms right so on
policy okay so you can think of
reinforcement learning as like you have
a state of time T and then you take an
action
and then you have a state at time t plus
one right so when you're on policy your
actions came from your current model
right when you're off policy the action
could come from well actually the human
who drives a car right so it's much
harder to learn off policy than on
policy because your model didn't take
that action
you know to be honest like a lot of this
stuff is like these are these are very
standard cards like everyone who knows
reinforcement learning knows that stuff
but uh
there's not many theoretical guarantees
for anything about off policy this is
one of the things we really explore at
comma because okay
a lot of off policy learning depends on
noise
right if you are training on policy
let's say you have a model that knows
nothing right and does completely random
actions right
well it turns out with completely random
actions you can like understand what
those actions do
if you're off policy and you have a a
rollouts with no noise at all
okay tell me what happens if I'm driving
down the highway and I go like that with
the wheel
you don't have that in your data set
so maybe it's a good action right you
don't know
yeah see and this is a problem with off
policy but on policy your model will
just do that and be like oh well okay I
don't do that that was that was a
mistake okay
um so you've talked about comma being
like the furthest down the road at least
on this this simulator thing how do you
what do you think of the other the other
approaches especially with Cruz and
waymo and seeing more of their you know
actual driverless cars in the world what
do you think of that
the problem with cruising way more and
I've always said this people think that
like my dispute is about lidar or Maps
or something like that and I think
lighter and maps are dumb
do you think that's the fundamental
problem with cruising light
I had a problem with cruising waymo is
unit economics
right each one of those cars costs like
half a million dollars and what product
does the car provide
well
it's like uber right
but is it as good as Uber
probably not quite yeah for the customer
yeah a little slower and why not
um I would just say like you know there
are some it's probably safer a little
more cautious in certain ways that that
don't actually benefit the driver
experience you know like maybe slightly
uh over stopping at that certain things
yeah yeah it takes it takes 50 more time
to get anywhere because it has to come
to a full stop at every stop sign
because that's what's coded in the
software whereas my Uber driver came to
a full stop at every stop sign look I
mean this isn't what I right right and
this is this is a very fundamental
problem right this is not a problem that
like can be fixed
um these things are going to be slower
these things right now are more
expensive and you're like okay with
scale it could come down but like how
much scale I I think that some
six-figure software Engineers sometimes
forget how much money an Uber driver
makes in fact
uh I was uh
a friend of mine drove for Uber and I
looked at our Uber stuff
and I'm like yo
you're losing money right you understand
you're paying more for gas she's like I
like it I like it I like it Uber prays
on people who are bad at math right you
literally are getting drivers to
subsidize you so you know depreciation
and all the way around you're putting on
the car absolutely when you truly factor
in everything a lot of kind of hobbyist
Uber drivers lose money
which another way of saying lose money
is uh give free money to Uber right
so I I think that this is the main
problem with waymo and Cruz it's it's a
very fragile managed system
that costs a lot of money and may not
provide a product that's competitive on
the market
in terms of so so it's two things it's
it's slower but then it's also costs
more that slower aspect would that also
be true for comma or do you think commas
will actually be a better Driving
Experience
we're not trying to be level five
right or level four and then this is
sort of a key distinction right if you
ever don't like what your comma is doing
uh let's say you know you know it uh
let's say it takes a term too
aggressively or not aggressively enough
okay take a wheel and change it
right and that's the distinction so so
our policy doesn't have to be this ideal
policy it's just it's an assistant
system
what on on that same note I saw you on
on Twitter recently you know going back
and forth with Gary Marcus a little bit
and saying L5 by the end of the decade
yeah
I mean tell me about that so you don't
think comma's the one that's going to
get there
oh I think it's very possible
I think that um by the end of the decade
it's just going to be pretty easy in the
same way right now it's pretty easy to
train like an unsupervised chess engine
I think that the techniques will uh just
become a lot better and the software
Frameworks to train these things will
become a lot better the compute will
become a lot more available so I don't
think it's going to be particularly
tricky I do think by the end of the
decade assuming comma continues on its
path will have pretty much solved it
yeah I think Tesla's going to beat us by
about one to two years I think there's a
decent chance we get second
based on what you thought two years ago
or maybe four years ago do you think
you're ahead of behind or or sort of on
track with with how you predicted that
very beginning I was over optimistic
uh but I think I corrected pretty
quickly on that and then I think it's
pretty much what I thought we'd be
cool I want to talk a lot more about
that state of AI stuff that you
mentioned around uh hardware and
software but a few more things on comma
like
what benefits or or downsides do you get
from having sort of like a post install
Kit rather than building a car from the
ground up is it mostly a price thing are
there are there other
um
are there benefits in making the product
evolve faster or what's that like I
don't care about this stuff our comma's
mission is to solve self-driving cars
while delivering shippable intermediar
base
um we use the hardware to fund the
company uh it's very important for me to
be profitable and make a sustainable
company but like aside from that people
are like George but what are you going
to do when the car is like locked up who
cares we're here to solve an AI problem
right I think that's something that's
that's lost on a lot of people who live
in this world where their companies are
trying to be on some like optimality
curve all the time like I don't care
we raised a small amount of money from a
bunch of people who like our latest
round of investment you know like these
guys are like they're down for the
mission right none of them are here like
look I don't want to squander your money
we're going to try our best to seriously
you know sell 100 000 of these devices
for 100 million of Revenue it's pretty
good but like
the point is solving self-driving cars
the point is not to make a business that
makes money
how how have you been so Capital
efficient because because like you're
saying eBay I think
18 million and for a long time it was 8
million and I see like you know
web-based SAS apps that are raising a
hundred million and just shoving data in
and out of a database I guess how have
you done that while shipping hardware
and iterating on a hard space
ah
yeah I mean you really if you cut out
all the the useless
people and stuff you don't need that
much right you know this is what hacking
is hacking lets you drill down to the
absolute minimum like okay what is this
right look we got like okay our boards
they're routed by one guy he's very very
smart
and he designs of things right and he
does it slowly over time you know it
takes time but like okay but why do I
need a team of 10 people to see you need
a 10 P team of 10 people if you want a
marginal speed increase
right say you need the product to be
ready 2x faster
then you might need 10 people but uh
this is ondoll's law like people don't
scale very well
so when a lot of these things are not a
question of like doing a lot of things
but just doing one thing very carefully
and correctly it doesn't help you to
have more people when more people is a
big cost to this then everything else is
just you know look I'm a I'm a middle
class guy from New Jersey like when I
look at the price of something I'm like
twenty thousand dollars for a couch no
it ain't bro like where is where's some
startups would be like yeah we gotta buy
this couch it's from Design Within Reach
and I'm like dude
growing up we go to IKEA we get a couple
guys we put in the back of the pickup
like that's what we're going to do
yeah how many people work for common
uh 23
. that's amazing uh 22. I don't work
there anymore yep sure okay tell us so
tell us about what's next you recently
left comma what are you working on
um so I've been working on Tiny crab
uh I'm trying to build so I think like
Pi torch and tensorflow are the Fortran
and Cobalt of deep learning programming
languages
right
um you know look I wasn't around for
fortunate a couple I can literally talk
about what was there but I think that
these things are very uh they're very
clunky
and and they're I mean tensorflow in
particular right like we we switched
from tensorflow to Pi torch Maybe
two and a half years ago uh and the the
thing that really drove me over the edge
was a parameter of the tensorflow
optimizer called clip Norm clip Norm is
this thing you do it like flips all the
norms and we're putting in a number and
it wasn't changing the behavior
how's it going and then we look
read the code
clip Norm is broken
they didn't add an assert they're just
broken right and I'm like all right this
has to go we switch to Pi torch but
pytorch has similar sort of problems
right it's it's very hard to like go
into the pi torch code base and read
okay I want to see I want to do a rally
okay where does a value happen well it's
like four layers of indirection and all
these specialization things and all
these and then I think that software I
think this is pretty well established
that the uh amount of bugs in your
software car lights to line count
so yeah can I write a deep learning
library that's competitive actually
faster than Pi torch with a thousand
lines of code
that's amazing I was looking through it
how just for I guess comparison's sake
do you have a sense of how long pytorch
and tensorflow are
yeah yeah so
the core parts of pytorch
let's say 10 000 lines in a hundred
thousand lines right now in reality the
repos are are you know 100 000 and a
million but um let's say Pi torch is 10x
bigger and then tensorflow 10x bigger
than Patrick
um and so is is Tiny Corp and Tiny grad
is that your your main focus right now
you can look at my GitHub hustling yeah
yep I've been code a lot since I left so
you know whenever my github's green I'm
happy yeah and will you hire other
people will this be your own project
what are your plans for for tiny
I think so
um I think that
you know people who want to contribute
are welcome to contribute on GitHub
um my hope is if it starts to get
adoption the uh companies will start to
contribute to Tiny grab and then
effectively in fact we say this about
open pilot too
um there's probably more people being
paid full-time to work on open pilot
outside comma than inside comma Now
and this is really cool I mean this is
how you know you're starting to succeed
as an open source project right
um
and you know I'm maybe when I was
younger I was more of a fan of like GPL
style things but I switched everything
to MIT and like what I see about open
source is
the reason that somebody wants to
Upstream their thing
right like okay you're like okay fine
you know why why would I Upstream it
right because we'll maintain it for you
if you're a company let's say you're a
car company you want to get your thing
let's say a small car company right you
want to get your thing Upstream into
open pilot so we maintain that code when
we do refactors right look at the beauty
of this Linux kernels and saying what
you don't need a GPL to do this
when someone refactors the pcie
subsystem you want your pcie driver to
keep working and now it's someone else's
responsibility once you've opt trained
it right this is the the beauty of Open
Source and it can work in such a way
that it's worth it for companies
uh to contribute back to these projects
right so that's my companies are which
companies outside of comma are paying
Engineers to work on open pilot to get
it to get
um so there's several several Chinese uh
car companies
um there's another one there's some guys
down in uh I think I think they're in
Vegas uh doing uh like full self-driving
sort of stuff but it's just like like
everybody who there is no reason today
that you should start an ADA system from
scratch everyone is doing it as an idiot
and they should use open file it's
really good all right not only is the
the model and stuff really good but the
infrastructure of the whole thing is
really good right we built so you know
like Ross as a lot of people use Ross
for robotic stuff right
um Ross is we thought about using Ross
okay like you can look at like two core
components of Ross there's a
serialization and there's the messaging
right so Ross built custom versions of
both of those things
we start out in autopilot with saying
okay we're going to use Captain Proto
all right can't process like protov off
but fucking photographs really bloated
uh and then we're gonna use the mq right
dmq we have to know is a very common
stock Library we actually moved off of
zmq because if two processes want to
communicate uh zmq uses uses sockets and
you're going through the kernel you're
making a copy
um so we switched to a custom thing
called message queue uh where you can
process B can access the shared memory
process like process it creates a ring
buffer and then it's Pub Pub sub
um but uh yeah but it's compatible right
you can you can still run all of open
pilot with zmq equals one and it'll fall
back to zoom Q right and like these
messaging and serialization things are
the best on the market today everybody
should start using them and there's a
few people out there now are right like
I think uh so many mummy good dog.ai
they're like doing robotic stuff and
it's like oh yeah use use open pattern
right
so you mentioned a bunch of companies
using
um open pilot and then on the tiny tiny
Corp dining grab website you've sort of
mentioned that you'd be willing to embed
with a company to sort of if they wanted
to sponsor you do you have any ideal
projects or companies that we had a
discussion about a contract with a large
uh AI chip company uh the contract kind
of fell you know like these companies
are bloated and hard to work with but I
think as the um
there's companies multiple companies now
uh service tens tour and uh graphcore
that have done tape outs of these chips
and they don't have software they don't
have software they don't have a
functioning pytorch port in fact pytor
shipped MPS which is a metal performance
shaders and I found a bug
I found a bug in their Matrix multiply
right that's not the major multiplies
wrong but things are like transposed and
it didn't take the transpose into
consideration I found this on stream
when I was doing my tiny grad my stable
diffusion porch and Tiny grad and I'm
like wait time grad's got to be wrong
there's no way Pi torches
wait yeah and it was wrong right only
for NPS obviously when you go back to
CPU if you're on x86 and then video this
is you know not going to be a problem
but
um and it's because it's really hard to
do a port of Pi torch to a custom
accelerator you have to Port tons and
tons of operations write a lot of code
where's Tiny grad it's really one
operation
it works with all these different
accelerators uh well it could it's
really easy to do a port the amount of
code you have to write to Port tiny grad
to a new accelerator is 100x less than
the code you have to write for pi torch
and I mean 100.
um
okay tell me about the state of AI
generally which I think factors into why
you're doing tiny grad I guess like
where what are the hard Parts in AI is
it software related is it Hardware
related is it engineering related
um what's hard there
well everything's hard and everything's
easy right it's like if you look this is
a eliezerkowski thing and I love them if
you look at factoring uh algorithms
right would you rather have a 1970s
factoring algorithm on Modern Hardware
or a modern factoring algorithm on 1970s
Hardware
and former
so you you think you'd rather have a
1970s factoring algorithm on Modern
Hardware that's what I would think yes
but am I wrong on that you are really um
but not by much not by much yeah um not
by much factoring algorithms have come a
back in the 70s you're using maybe
something like polar draw now you use a
fancy General number field seat I think
the exact same thing is true for sat
solvers as well would you rather have a
70 sat solver a Modern Hardware or
modern stat software and modern stats
offers are much much better in fact I
just uh art of computer programming 4B
and half the books about sat solvers and
I'm like oh this is great
um I think sat solvers is just this
amazing thing to think about and so yeah
I think like factoring and sat like
these like hard problems right I think
sat we know is an MP I don't think
factoring's nnp but
um the algorithms have progressed faster
than the hardware but not by much
um so I think the same thing is going to
be true about AI right it's interesting
that like they're pretty close and a
software has a shorter Rebel time so I
think you can make progress on software
faster than you can Hardware but not by
too much right
so uh yeah I think the same thing is
driven AI right I think that that the
software is bad the hardware is bad the
algorithms are bad uh but what do you
mean by bad right like sure you know
just because they'll be better in the
future because I mean they're terrible
they're a lot better than what we have
oh man trying to do this stuff you're
trying to do this stuff 20 years ago
what are you gpus or like not general
purpose you have no Frameworks you're
hand coding all your forwards and
backwards passes your algorithms are
like stochastic gradient descent you
don't have atom you don't have batch
Norm you don't drop out like
what is it what does the development
process look like when you're sort of
iterating on AI I sort of think of like
built up this model and then go set it
to train for hours and hours and hours
is that true or is that like an outdated
one like what does iteration look like
true
um what do we do at Karma we spend most
of our time writing tests right
now of course it's tasks to test that
like what does the test look like all
sorts of things
um so tests kind of fall into we could
say two buckets right there's tests of
overall performance and there's tests of
like specific performance right maybe
the same things are like maybe you can
say their integration tests and unit
tests
all right that's the same basic ideas a
lot of comma like I say these things and
these are like you know one of the
things is I just got bored saying the
same thing's over and over again in
comma and I hope I hope the people will
work they don't feel the same way all
right like I hope that people I don't
know maybe this is something about me
but like like we've been saying well I
mean I feel like we figured it all out
you know this is now a question of doing
it
um but a lot of the stuff is like
testing 2.0 methodologies right like
yeah how do you how could we say one
model is better than another model right
we have two models how do we say which
one's going to drive the car better now
well if you're in a very early stage you
can actually go out and try them both on
a car right
um but this doesn't work as your models
get better if you have models that one
model makes a mistake every thousand
hours and one model makes a mistake
every ten thousand hours
well you're not going to ask that right
what are you going to do well yeah you
got to go drive for a thousand hours
right and that's okay now now so you
have to come up with better testing
methodologies that can discover these
things without needing a car
and what it I mean what do those look
like do you run it just
through a simulator and and see any
mistakes it makes or what's that look
like so simulators are one tool
um you we use tons of different tools
right yes we we have we definitely have
the the simulators called analyze lat
analyze lat runs it on 2000 segments and
uh
you know tells you how it does
how do you
um maybe this is a dumb question but
like you know you you have all these
simulators but you also have a bunch of
people with comma installed in their
cars do those match up pretty well where
like hey if you run through a simulator
like hey this is a big Improvement you
know we've moved it from a thousand to
ten thousand errors do you find that's
true when it gets out in the real world
for the most part yes right and then
whenever we are surprised whenever we
are surprised whenever we find that we
ship something to the real world and you
know we we put these on our Master
branch and there's maybe like 10 of the
comma Fleet running the master branch
and they're on Discord and they're like
oh Bros uh yo I mean everything's great
but every time I go through an
intersection you know it it Slams on the
brakes oh well that's not a real example
but
um a lot of this stuff is way more
subtle than this like exit splitting is
something like a lot of like take exits
on the highway when it's not supposed to
right I don't know which path to take
um
so whenever we get these complaints
we figure out how to validate them in
simulation and then we add that to our
test Suite
so whenever we're surprised you know
okay now we have a new test right and
now it has to pass this entire
complicated test Suite before we ship it
so yeah the whole problem the the actual
iteration on the model is not most of
the work right you use the models it
doesn't matter it really doesn't matter
it's it's about testing
how is the AI Hardware market right now
I know like Nvidia you know the big one
in the room but we also got tpus we got
Apple now like what is it what does the
hardware market look like
I'll say one more thing about it quick
thing about testing and I'll go into
that yeah sure my point is like if you
have a test that's good enough well that
kind of is all you need because okay
I'll just do a random search across a
model space right if I have a test that
can always tell me which model is better
okay let's ship it out train 10 000
models and tell me which the best one is
great right and I can do automatic
search right I can search into space if
I have a good evaluation function
but uh that good evaluation function is
really hard to build the hardware Market
uh we love low stock price and video
High stock price Nvidia is like oh we're
going to gouge people and it's going to
be terrible and we're not worried about
anybody but low stock price and video is
like we're going to open source our
kernel driver and the the uh the the
4090s are amazing
oh man they built an amazing chip well a
few things about the 49ers or so
incredible so one of the biggest
problems on the 3090 was it only had six
Megs of L2 cache
uh the a100 had 40 mix so a lot of the
benefits from a100s actually just came
from the larger cache size
but the 4090 has 72 mix
so they did not memory bandwidth that
much but they added this big L2 cache
which effectively gives you a lot more
memory bandwidth especially at the size
of models we're training
um so yeah that's that's really uh
exciting the I mean the chip is five
nanometer
a four Anatomy or even like it's it's a
massive chip too it's the things like
600 square millimeters
um so yeah I mean these chips are
amazing and they're not that overpriced
like a 40 90 you can get for two
thousand dollars
uh so
right now Nvidia is a king but yeah now
TP isn't useless right and you know why
TV is useless because what am I going to
get out I'm gonna go Google Cloud
is it still a licensing thing I know I
was listening to you on Lex about that
where they sort of have restrictive
things that you can do with tpus is that
still true
no they they you know I I A friend of
mine at Google's like George's can't
possibly be true he's like well it
actually is true and they fixed it right
the idea that like the tpus like if you
train self-driving cars on our TPU uh
that was it was that term was only meant
to apply I think you know someone from
Google really has to address this but
that term was only meant to apply to
their like machine learning hosted thing
like they have like access to a cloud
Suite of Google models if you train your
own model and you rent bare metal
hardware it doesn't apply but like
I just don't want to deal with any of
this it's scary enough and uncertain
enough that you just don't want to yeah
just we built an incredible we built a
compute cluster in our new office it's
so good
um hundreds of gpus thousands of cars
petabytes of storage uh and it's like
ours you know you can go touch it so is
all your training done on-prem in your
in your office yeah all training's
on-prem uh all are like you can like
download the comment app it's a cloud
dash cam that's all Azure but
uh yeah for training uh gpus are have
the cloud is a good deal as long as all
you want are CPU cores right the minute
you need storage or gpus the Cloud's a
huge rip-off right and what is training
storage and gpus
yep that's interesting my brother-in-law
he does machine learning stuff and he's
found the same thing where he's just
building his own boxes and running
service because AWS is just killing him
on that so if you can pay for if you can
pay for low priority CPU course most of
your bank bandwidth is is ingress
uh then the clouds are phenomenal love
the clouds but um yeah yeah yeah the
minute you need anything specialized
or storage or egress bandwidth yeah
exactly they kill you there
tiny also talks about training on the
edge and in in that aspect why is
training on the edge so important and
necessary
um so this is a shift that that I see
happening uh it's gonna be still five to
ten years but
the fact that there's any distinction
between training and inference I think
is absurd
right uh humans don't have this
distinction
humans train all the time right and like
your systems are always going to be
rigid and inflexible if they're not
lifelong learners if they're not
constantly training if there's like okay
we're just going to freeze the weight to
this thing
a turn right on like a let's say it's
like a blind turn right and let's say
when you're looking at it it's kind of
unpredictable like it's not exactly what
they want to do right so it's not that
comma is not going to be able to do this
term but every time it takes this turn
it's going to need to like it's going to
miss it and then over correct right and
that turns out to be what humans do
every time the first time they see the
term but the key is it's only the first
time
you drive that commute every day okay
maybe the second day you mess it up as
well but by the third day you're like
you know oh oh yeah I remember this
right and that's because you're a
lifelong learner
so I think that we're gonna have to move
towards yeah lifelong learning on device
um and that's one of the things that I
really want time to grab to support and
does that feed back into like the main
centralized model that then gets pushed
out to sort of Master on everyone or
it stay on that device some of that
learning well yeah so we already have
some on device learning right we have
something called params learning
actually we just shipped it well we're
shipping a big upgrad to it for Black
Friday
um prams learner uh can okay so here's
an interesting fact
um the WHERE on your tires
uh is a factor and how much torque you
have to put on the wheel right and
that's pretty obviously true when you
think about it if you have fresh new
tires well they grip the road a lot
better so you know you turn the wheel
you put less torque on the Wheel to make
a turn right but if they don't grip that
well right just imagine like some tires
sliding right so one of the things we
learn on device this thing called params
learner is the tire stiffness
I'm a tire wear or you know my vehicle
Dynamics is not great
um but my point is we have this this
on-demis learner but this on-device
learner is learning a bunch of
hand-coded features
now the real thing that you want is to
get rid of those hand-carded features
you want to say okay here's the desired
path here's the actual path
RL
got a reward function to match those
things
now make that stable it's hard but
if you're doing a bunch of on-device
learning too will it sort of pick up
even my preferences or different things
like that are different from person to
person just if I'm a little more
cautious on some of these things or it
can it depends what uh depends what the
reward function is right
um so right now the params learner which
again it is a learner right it's using
it's using uh the derivative and it's
updating a set of parameters based on
the derivative of the error uh you know
this is at some point like when is it
it's not deep learning it's learning um
learning uh so the reward function there
is only it's only trained when the
computer is engaged
right the the weights are not updated
when you're driving the car
uh so if you want the weights to update
when you drive the car seat like the
eventual okay the eventual final like
model for comma is
disengagement is uh negative reward
right like like you taking over you
correcting the car is actually the only
thing you need in a reward function
um to to solve something cards it's
really cool but that kind of stuff
probably works better at Fleet scale
right to try to learn that from you
maybe maybe maybe that gets even fancier
than what I'm asking for now but yes
eventually eventually sure you can have
a conversation with it like bro slow
down good I got you don't worry don't
worry I got a fancy llm you know
modeling bro slow down and betting it
into Vector space all right
what's What's um holding back stuff at
at the edge right now is it software is
it Hardware is it tiny Grand is whatever
we get yeah yeah it's not it's not it's
not one bottleneck right you ask the
same question like what's holding back
factoring right what's holding back sad
right that's hardware it's software it's
algorithms it's all those things
all right so yeah I mean maybe you can
really break it down into those three
things so you can break it down into
into Hardware which is straight up like
how much flops can we shove through this
thing we can break it down like software
when I say software I mean
infrastructure right like
infrastructurally okay how can we
maximally utilize the flops
um how can we how easy is it to code
things in this how easy is it to debug
uh in these sort of spaces
um how easy is it to update when new
accelerators come out right so that's
like the infrastructure component that's
what tiny grad is all right tiny grad is
not a hardware company tiny grad is an
infrastructure company
um and then there's algorithms right and
then algorithms are com is also really
an infrastructure company right like we
try to say we have a saying at common
like don't do research
because you're not going to compete on
the research with these overfunded AI
Labs of Google and Facebook and stuff
read their papers implement it apply it
and ship it
um so yeah then there's this this
quadrant of algorithms right and
algorithms are currently dominated by
you know deepminds made a whole bunch of
advances open AI the big Airline so
where you get the advances there
speaking of the big ai ai Labs like
there's a lot of I would say excitement
recently about language art stuff with
with Dolly stable diffusion things like
that are how does that interact with
self-driving like are those totally
different domains are they helping each
other
I mean there's a few cool things like I
spend I spent a weekend that's one of my
better streams I spent a weekend
implementing stable diffusion in tiny
grad
it's just cool to go through and like
see what all the things are
I don't know I'm I'm I'm not impressed
with these things okay I think they're
like I've seen classical systems from 20
years ago that could do similar stuff
all right like there's some cool things
they can do but they're not
they're not superhuman right in the way
that I'm one of the AI things that and
I'm just I'm not like a totally I hater
I I I'm just not that impressed with
this compared to something like mu zero
ralphago right mu zero is one of my
favorite papers to come out of all time
they're like you can from nothing with
little access to a simulator learn how
to win chess go Atari and shogi in the
same like architecture now this is
incredible or another paper came out
Iris um at first I read it I'm like oh
this is like a research write-up but it
is a research write-up they've been
coming up with new ideas but they just
they did it well
um it's a
it's a Atari games which learn a
simulator and then train in that
simulator
and
this is cool stuff right whereas like
yes great you're a language model look
it understands poetry okay
okay you know like you you could give
these people a Markov model tell them
it's some some fancy AI oh my God you've
got such deep insights
all right that's good
uh I want to switch attack a little bit
like you know at you you've hired some
people I know I know what comma you said
it's hard to get into comments hard to
stay at comma what what types of skills
or backgrounds have you seen that work
well in AI uh work well at comma like is
there you know do you need this hard
math background do you need good
software engineering background what do
you what do you see
I our interviews are uh I'll just ask
you a bunch of Rapid Fire questions
they're not like hard questions I ask
you like what's the complexity of matrix
multiplication let's be light right like
like basic things that you know you
should know
um or even stuff like what's 13 in
binary right and if you don't like right
away say 1101 like I I you know it's
it's
whatever that is is a it's like a
fluency with computers
and that's what gets you hired right
it's like a you've spent a lot of time
doing this when you're in the shower
you're thinking about this stuff right
it's it's it's I hate the word but it's
got a passion right yeah and someone
like can say all they want oh I'm
passionate right anyone who writes in
their email I'm passionate media
immediate but you show me your passion
when you get excited when I ask you
questions like that right like do you
know
a huge breath of of knowledge um our
infrastructure interview and I can give
away the whole interview here's the
question I ask you I type google.com
into a web browser what happens right
now I like the people right away who are
talking to me about keyboard interrupts
right and how that ends up in the in the
in the in the browser right and then you
know there's some people who like uh and
then it does a DNS lookup okay what's a
DNS lookup
uh well it's like a DNS server and it
connects to it okay how does it connect
to it right and you better talk to me
about Port 53 and syscalls and right you
know you don't know that stuff like yeah
you're not gonna work Econo but you know
that stuff that's a good job
yeah yeah I I think of you as a
passionate person and just like
extremely high energy and just I'm just
kind of amazed that you can go on Twitch
and and live stream for 10 hours or so
you know you're I don't know you're
getting older you're still young right
you're 33 but like do you do you sense a
change in your stamina or passion are
you still like just as just as uh fresh
as you always have been
no I I think this stuff starts to
decline maybe in your 40s like I think I
got I got many years then you look at
like John Carmack and like that guy's
got more astounding than I do right you
watch pretty much people like like how
do you stream on Twitch for 10 hours
like I don't understand do people not
have jobs where they work eight hours a
day
like I'm just I'm just baffled by this
it's like like sure if I stream on
Twitch for 48 hours you're like how does
this guy do it
ain't that much bro and it's not like
I'm spending 10 hours every minute
working you know you watch me take
breaks and go off on internet tangents
and that would probably say I get like
six hours of work done in those 10 hours
like is that not what people do at work
yeah no you know not anymore I guess
we've all gotten fat and spoiled at Lazy
yeah I mean that's just like weird to me
like yes if you work at comma you're
probably gonna you know be in the office
10 hours a day and you probably work six
of them like okay it's like that's
that's just the most normal job to me
I forgot to ask you you mentioned what
gets people hired what gets people fired
because you say you've hired people as
well
um gets people fired
a whole bunch of things uh
I mean the easiest way to get fired is
to just kind of stop doing work
do you see that a lot
true uh everywhere do we see that I mean
yeah you know people not everyone not
everyone is is uh you know and I respect
the people who quit I respect the people
who say look I'm not really feeling this
anymore I quit
um you know some people like are not
that self-aware or are kind of like are
nervous and then don't quit and then you
know I'll fire you
um
so it is that uh soft skills can get
people fired like you're just you're
just arguing with people and you're
going to work with like they'll get
fired uh or you know you can't ship
things right like you've worked a comma
for six months and you haven't shipped
anything yeah that's not good right yeah
so but yeah you know ship things and I'm
not saying like we value super teammates
who communicate well I'm not saying that
but like you know if you're pissing
people off you're gonna get fired right
like this is just normal like yeah don't
piss people off ship things and work
hard and that's it yep all right I want
to talk to you about some some tech
current events
um let's talk crypto a little bit just
because we've got the FTX SBF
yeah right and I know you've I don't
know where you are in crypto I know
you've done a little bit of stuff
including like helping some team that
you met at a restaurant and you solve
some Mega problem for them but I guess
like where are you on crypto what do you
think on on the future of it look I I uh
I've been around crypto ever since I was
buying drugs on the Silk Road like
you know it's it is exactly what it is
I'm not I don't have strong opinions on
it I'm is it going to go up or down I
think it's the same as every other asset
right it's real thick and every
everything is priced exactly where it
should be right I don't have any magical
insights into the market right like you
know I almost bought a house when I was
19 and my boss at Google talked me out
of it you know in retrospect I showed
bought that house so it was 24 000 now
it's worth like two million but
um you know my boss at Google said this
to me he's like George you don't know
anything about the real estate market
you don't know if it's going to go up
and down you don't know if it's a good
buy or not and a house is a very
illiquid asset
I'm like you know what you're exactly
right right and the same thing's true
about crypto right I don't have any
special insights it's going to go up is
it going to go down is this coin good is
this coin bad I mean I could probably
talk about some that are bad but if I
talk about some that are obvious scams
right you see something like Luna and
Tara oh and you're like George you're
only predicting the one that uh the one
that went under look at synthetics right
you look at something like synthetics
and it's trading these synthetic stocks
back by the snacks token what's the
snacks token what's a token that you can
stake and it gives you uh 18 returns
this is a Ponzi yeah right like and I
don't need to call out synthetics right
like I'm not saying like like that's
even bad I'm not necessarily saying
ponzis are bad I'm just saying this is
only sustainable in a bull market
right this fundamentally can't work
um so you know you can do some like
economics 101 like that
uh and and like yes a Ponzi scheme is
defined as if new cash flows are paying
out old money if new money is paying out
all the money right yeah and you should
be companies be cryptos could be
anything but just you know be aware of
ponzis and then you don't ask the
question right like a dumb investor says
that's a Ponzi I'm not going to invest
the smart investor says
am I early
right
um so yeah that's kind of my my apart
from the investment side of it you know
like you obviously did interesting work
with that with that one company and
helped that like does the the crypto
space interest you technologically or
are you just like nah nothing nothing
I mean I'm pretty happy with what I did
you can go look at Canon uh it's good
open source code I wrote I I embedded a
mips processor on chain that lets you
verifiably run uh programs on the
ethereum chain and you're like oh well
that's going to run really slowly but
not exactly because you don't need to
run the program you don't need to run
all n steps of the program right it's
played as a multi-party game so two
people can uh
uh it's like a challenge response kind
of thing and with challenge response you
can get this o of n down to O of login
because there's only one step in which
they disagree or you can treat it as
this one step where they disagree and
then you only ever have to play that one
step out on chain so you can get two
parties to agree verifiably on compute
full turn complete got a mips processor
and it's login steps uh which yeah it's
it's cool technology you know what the
repo has been sitting there they're not
doing anything with it because
decentralization doesn't matter
decentralization theater matters and
this is the problem
all right don't don't don't don't don't
don't don't actually make it
decentralized God that's hard
we're not front about how it's
decentralized
and then get people to invest in your
Pawns
they get out while you can yeah
all right in terms of other current
events you know we have we have uh one
of your competitors I would say in
self-driving Elon uh buying Twitter and
and that whole thing going on any
thoughts on I know you're not a huge
Twitter user but like what do you think
of that you know what I came back on
Twitter because Elon bought it right
look I just I just oh man I just you
know what I will say this I'm not even
going to say you know whether it's good
or bad or it's entertaining yeah
elon's making Twitter fun I'm like
excited to be on Twitter what's gonna
happen tomorrow like it's it's it's cool
and like you know it's just there's like
a seriousness about these social
networks that's so I hated like it
wasn't like that the internet didn't
used to be like that no one took like
Myspace seriously then people started
taking this stuff serious misinformation
oh my God I said I can't take this and
then Elon Musk Twitter and he's like
YOLO man
uh so I'm entertained and I support I
support entertainment
interest in some of elon's um Tech site
you know SpaceX and starlink and do
those technological problems so or
excite you
uh I was internist Basics I could
offered a job
um
you know again I kind of felt like
SpaceX was at a stage where
a similar kind of to where comment is
now is when I was in SpaceX maybe uh
almost 10 years ago now
uh where there's a lot of smart people
working on a really hard problem and
it's just a slow and steady grind right
there's not like any like magic I can do
or big architectural things I can fix
like and look I mean I mean yeah here we
are years later they're Landing Rockets
it's amazing
will you ever work at a big company
again you know SpaceX Google Facebook
for for different periods of time is
that just not your vibe
um I mean I think those three companies
are all very different
uh I think
like again SpaceX is kind of like
you know the companies who I do work for
are companies who are over capitalized
and will pay me way too much money to
solve problems that they should have
fixed internally
um so yeah like I don't know if I can do
that at SpaceX
Google oh sad man
uh Google sad and Facebook AKA meta uh
you know I listen to John CarMax like
Friedman and he told Zuckerberg he's
like look make me the Czar of the
metaverse I will make it good Zuckerberg
said well that's not really how we do
things here like he left how stupid
you're standing God there was one on
Horizon's world so like it's terrible
right Carmike would have showed it they
could have made something cool right
um so I don't like that again that's
good kind of like you're you're
literally it's like one of the best guys
in computer gaming history wants to come
run your thing and you're like oh well
that's not how we do things we do things
by committee we gotta make sure
everyone's represented right as long as
companies are still on this like we got
to make sure everyone's represented
come on all right like I'm not I'm not
trying to exclude people but like
there's good ideas and there's bad ideas
right I'm not trying to say anything
about like who comes up with the ideas I
don't care
but until we can say that this is smart
and this is dumb
that's not it's not a place for me right
like if we're gonna treat every idea
like it's equally good all right you're
going to end up with committee mesh
you're gonna end up with yeah
what about Carmack what do you think of
his thoughts on AI and agents and
different things
different things I mean I was sad to see
what he does uh I uh I I I've met him
maybe three years ago in a conference
thing
um and you know yes he's very very
passionate talking about stuff and I
think the ideas are like they're
undeveloped they're undeveloped so uh
you know it remains to see for me to
like say anything like I'd have to hear
concretely what the idea is
yeah where'd you go it's gonna yeah like
would you be interested in working on
that sort of thing or you just need to
hear more on that
I mean I want to think if it's plausible
right like I gotta I gotta hear yeah I
gotta hear like way more about the idea
and things like I think I I don't know I
you know I don't know what if this is
public I'm not gonna I'm not gonna I'm
not gonna say anything but like when he
releases something I'll evaluate it on
his parents
what motivates you in in work is it
purely like man what's the coolest
biggest problem I can work on you've
talked about other companies throwing
money at you like what do you care about
uh I mean yeah I like the idea of like
if people want to hire me as a
contractor to like solve something I
like solving problems I like like
feeling like man I wrote like good code
and this is this is like good maybe
I I did this better or not just in like
a in like a structural way in like a
your your team wrote something 10x too
complicated I came in and just rewrote
it and I'm like this do it like this
it's better
cool I love it
um George it's been this has been a fun
interview a while uh it's been fun to
catch up on self-driving and Ai and Tiny
and all that you're you're working on uh
if people want to find you what's what's
the best way for them to to come find it
what you're up to
get out.com
right that's really what I'm doing right
everyone you can front anywhere else but
like you know look at my commands so
we're good some of them are bad you can
see what I'm doing yep all right that's
cool yeah I know geohots blog also on
GitHub GitHub Pages somewhere
um your Twitch stream all that stuff so
people want to see you in action they
can they can get a little bit of that
stuff but you know oh we've got liable
stuff there you go yeah you got it got
it set up so George thanks for thanks
for coming on software engineering daily
cool thanks for having me
I don't know if it's morning I don't
know what time it is where you
are you really got a problem with
time DNA versus
disaster uh all right so we're switching
to ungoogled
chromium we want the chromium Web
Store download the CRX from
releases let's see what this is first I
[Music]
just looks pretty
good good morning good morning good
morning
well the problem is I still do like
Google
like but is this we have to manually add
Google back uh I also want to take a
minute to sh for my beautiful I bought
an OLED screen I bought one of those
Samsung oleds and it really shines when
the
uh when it's dark
yes you need UB blog origin the internet
is unbearable without U blog origin
let's allow it an
incognito and now we have a beautiful
ungoogled
chromium
uh oh and let's uh take a minute no I'm
done with brave uh I love again had
Google back as the search engine but
they like take it out cuz they really
try to rip Google out of this
one search Eng change yes see they
really try to I don't know let's give
duck duck do go a
try
um should we really try to lean into
perplexity there was that other one that
I always forget the name of
anymore okay bro okay you know take your
suicidal ideation
elsewhere uh this is a happy stream
someone said I was depressed I'm not
depressed I just mourn for the loss of
my Empire and my culture and my people
that's
all um you guys know that black so let's
take a moment and let's read comments
let's see how we're being perceived
welcome
uh you educate the very select few of us
that watch your
streams
uh what should you you do you should get
banned for talking about off topic
bullshit bro
banned
uh that's right that's right this is a
joy stream we spread we spread Joy okay
Joy can everyone get on board with
joy
um maybe it doesn't matter anymore but I
just bought my fourth comma device what
do you mean it doesn't matter anymore
what is this what is this depressing ass
shit I'm just thinking about whether I
want to diversify to another Empire
that's all I'm saying right um like Does
Elon
I'm if you're in a swing state you know
uh your options suck but one option has
no future and one option has a chance at
a future and you know hopefully you know
which one those are uh I thought about
it I'm like you know do we do we uh do
we do an endorsement I'm like no I can't
I can't endorse I don't endorse any of
these people my only hope is that uh you
know we were on
uh uh Chad gpg this morning we asked
Chachi BT what elon's failures are and
like they're pretty
much oh some rockets blew up at SpaceX
oh neuralink isn't moving as fast as you
like check but she said the boring
company wasn't real like what do you
mean it's not real I've been in their
tunnel in Vegas so you know it's a shame
that saving the world has to fall on
Elon
but uh I kind of believe you know he can
he can do
it uh so yeah
[Music]
um I'll say I want to join chiny grat if
we get more streams yes this is what
we're here for
um Hong Kong is a nice
place uh you know it is it is a nice
place it's not uh the
the the you know they have like that the
Chinese passed Chinese security law here
there were
protests uh and my basic take on that is
like you
know now this this is this is like
extremely political but you don't want
to let the the the problem kind of with
an open Society is
you can get uh you know are those
protest CIA backed are they organic I
don't really know I'm always upset when
I see people clamping down against free
speech um I don't know how uh free uh
Speech actually is here so that is uh
you know a little bit a little bit
sad
um I wish I I looked I also looked more
into the uh the Taiwan uh political
situation there's the blues and the
greens and again yeah one part is more
China aligned one part is more
Independence aligned uh I would say that
I did definitely feel like there was
more freedom in Taiwan than there is
here and you know that's always a sad
thing to
lose um CCP stable for business bro
sleeping on
Singapore
uh he moves to Hong Kong and doesn't
know what language they speak I
understand that they speak cantones and
not Mandarin
uh is George coming out as a commi yo
look look I understand that they call
themselves the Chinese Communist party
but the North Koreans call themselves
The Democratic People's Republic of
Korea so let's not let's not go by names
let's talk about who's producing more
steel and electricity and I don't think
the numbers are
fake
um all right so you know if you leave a
comment I'll uh respond to your your
comment uh you know you got you get to
close the loop we will still never give
up you know never give up never
surrender um hello after work
Tech
uh so yeah you know if if you're in a
swing state vote for
civilization you know that's that's
that's that's all I'll say
uh this it's like yeah I know I know it
really it sucks but can
Elon pull another rabbit out of his I
like like I I love that there's an
anecdote from his uh his biography where
he talks about how he played uh how he
plays Texas holdom he he got to a party
once and play Texas Hold them and he's
just like you know he just got Delta
cards and then went all in and he lost
and he got Delta cards again and he went
all in again uh it's it's it's pretty
incredible and it's a good like real
lesson to to internalize like he just he
just levers up on everything like
maximum
leverage and I kind of wish I had the
balls for that you
know uh so
yeah I did almost say 10 years ago what
would happen with Google these CHS are
pretty obvious to people paying
attention
um I respect fake data and coal power I
think the data is less fake than you
think
guys uh based view about the idiotic
pro-life stance thank you thank you
thank you pro-life is not is not it's
not okay it's anti Freedom okay it's
seriously anti-freedom
uh and like it also
like it it just it just gives
why are the elections in the US
5050 I'll never really understand
this uh I I really liked his his his
Tucker interview on on on X and you know
really
like when you frame it as people with
these ideas are really just against
civilization a median voter theorem oh
there's an actual explanation for this
um yeah people who are advocating you
know again I don't think I said it
strongly enough and I I like said about
this you know when they talk about
having laws that are Hardon crime being
against minorities that's the most
racist shit I've ever heard what are you
saying are you saying minorities are
criminals is that what you're
saying right you don't want there to be
unfairness and pleasing but every person
I've ever met uh is against again
property crime and violent crime these
other things are not crimes there's no
such thing as as drug crime that's not a
crime right there's oh abortion is a
crime no no it's not right freedom is is
he said he said he spread misinformation
that's a crime that's not a crime
there's two crimes property crime when
someone takes your property and violent
crime everyone knows what that means
okay um oh yeah no I wanted to respond
to someone said the uh Brian Kaplan uh
he's going to if he's not happy about
the southern border he's not going to be
happy about uh Brian Kaplan stance on
open
borders I mostly agree with open
borders like as long as you can't have
open borders in a welfare state right as
long as you don't have a welfare state
down with the welfare state you can have
open borders for the most part I think
that's fine um again there's also a
difference between having open borders
legally and having the first thing
people do you know to come into the
country commit a crime that just
disheartens it's so disheartening how am
I supposed to how am I supposed to tell
Engineers that you know that are going
through a absolutely ridiculous process
to get a visa to come work in America
how do people feel how do people feel
when they just see uh illegal immigrants
when they just see people walking across
the southern border right that's the
worst selection function I've ever
heard
um uh
uh late term abortion as effectively
killing a baby should be a crime I mean
again you pick a reasonable you pick a
reasonable thing I don't think this is a
huge the fact that they can they can
they can use the fact that elections
have anything to do with these bullshit
cultural
issues right like
like take an issue and look at which
side is freedom and which side is
against Freedom it's that
simple it's not it's not more
complicated than that right so yeah I
mean you know again you want to talk
about if it's killing a baby sure if if
if the the the baby could live on its
own without technology fine but
otherwise it's like you know this I
don't know I don't want to like like it
just it just pisses me off and it pisses
me off that that you know the
the like that this cultural issue can uh
is still a
thing it's it's
ridiculous um the how the debates about
bs topics right how come nobody's
talking about things that actually
matter how come no one's talking about
the fact that the US spends trillions of
dollars every year that they do not have
and then you know I have to pay I have
to pay tax this tiny Corp apparently I
have to pay tax even though we didn't
really make money in 2023 um because
they changed the way the R&D tax credits
work right I again uh if they pass
unrealized capital gains that's
unrealized capital gains is the last
draw for me and I'm tearing on my
passport and like come and find bitches
like seriously um you know it's it's
it's just you want to you want to you
want to watch your your country descend
into into uh yeah just just just pure
idiocy
um yeah so there we go
uh you know I hope I hope that that that
this stuff gets fixed unrealized gain
taxes is psychotic I I know I know but
they don't it doesn't matter right like
it's it's it's
really I I find both both Camala Harris
and Donald Trump absolutely unlistenable
to on
podcasts
um yeah just just it's it's pure it's
pure emotional
like I mean Trump will say the first
sentence about something and then he has
to go on some Trump ass Grand well Biden
was actually the worst president ever
you can't believe how bad he was blah
blah blah blah blah like shut up right
uh and then like I
mean when I was a mom back in Iowa I saw
grass and that grass brought me joy and
really you know they're trying to make
abortion illegal and oh my
God oh my my
God are you kidding this is a fucking
joke and oh yeah does anyone want to
talk about the I mean at least Trump
talks about the border right like you
got to fix that but you can't fix this
by having these hard liners against
immigration Trump screwed me in uh in in
in in 2020 uh you know I had some people
uh who got visas ready to come work at
comma and then they couldn't get them
stamped uh and it was like Steven Miller
an the immigration shit right so like
again this is the government I also
really think that like it's not you know
don't don't have politics that don't
actually affect your life right don't
don't like I'm not going to like but
these are things that actually affect my
life
negatively uh right like and again with
tiny Corp I had two Visas denied uh for
people I was trying to bring in to
America to work for tiny Corp right that
was kind of the that's kind of what
started okay we got to explore the
jurisdictions
here
um Trump leans my direction I'm voting
him but it's so frustrating to listen to
my bullshit yeah to listen to his
bullshit yeah no I I I couldn't believe
I couldn't believe you know I like Trump
in uh in 2016 uh and I was hoping I was
always hoping that like you know when he
becomes president like this stuff stops
like the stuff with like the small hands
and the stuff with like the uh the the
oh my John Bolton wrote the most
terrible book like bro you're punching
down like stop
it um you know I don't think I I think
all of you I'm sure all of you made up
your
mind
uh yeah the big tech companies have used
the Visa systems so smaller companies
are I mean there's just so much stuff
against against smaller companies you
look at that R&D uh tax thing the R&D
tax thing I didn't understand this but
in 2022 you can no longer deduct R&D the
year you did you have to advertise it
over 5 years Microsoft gives no shits
about this but when you're a startup you
might not exist for 5 years
right and you know these these things
can these things can be the the
difference between make and break for
your company it's it's it's you know
they're coming after the kcks man
they're coming after the coocks you know
this
um Republicans will make the rich richer
Democrats want money to be more fairly
distributed what does that even
mean but I read Cala is for little Tech
I don't know what Cala stands for you
know I don't think she stands for
anything as far as I can tell she she
was was installed to uh you know there
was no primary there was no Democratic
primary right it's just it's just so
unbelievably
upsetting
um
yeah um the system that incentivizes
entrepreneurs is what creates jobs yeah
absolutely um a startup is paying tax
taxes I I owe taxes apparently my
accountant tells me that tiny Corp owes
12K in taxes it's like it's not a huge
amount of money but still what I didn't
even sell a product how the hell did I
make
money we didn't sell the start selling
the tiny boxes till this year I I don't
even like understand
it um the political system to the us is
going to the dogs and it's getting bad
fast I'll say it it's it's getting bad
fast have I sold any of the computers
yeah 2024 not in 2023 uh we sold
uh uh yeah about about 65 of them or
something I don't know um how can you
tax a company that didn't make Revenue I
know I know but like it's like well you
don't have enough deductions or whatever
and I just like I just I just can't be
you know I can't be what how much time
am I going to spend on this it's 12K
right like you want you want to fleece
me for 12K like do it what what absolute
fucking
clowns um
why is SF politics so shit you know
here's a theory about all of this a
theory about all of this is like
uh these people at the absolute core are
T cells and like they they believe in
deceleration you you'll see this you'll
see this in things like you know they
want uh oh they use like the stupidest
words for it uh they'll use words like
uh
degrowth
degrowth what the fuck you
saying uh let me see your bank account
would you like your bank account to
experience some
degrowth let me let me see your house
just take a room want to experience some
degrowth um
yeah so it's like what you're really
against and I I think Elon said it super
well in his tuer interview like you're
just you're against civilization at that
point you're you're you're this isn't
funny like this isn't like oh let's have
our old debate where we go back and
forth about well you know I I let the
child care tax credit do this and you
know well I created the small business
pro bullshit program to do this and like
hello you're all going to be
poor right what's what's that I mean you
know really really you hear you hear the
saying that What communists really want
is like they don't care if everyone's
starving as long as we're all starving
equally like
no
um child care tax credit is based
it it misses the point so
completely right I I think that like
like the government does this
interesting thing where they'll do
something like they'll take your
freedoms away for you and then they'll
give you a way to get them back right
but only if you jump through some hoops
right like TSA Pre right TSA Pre is
exactly this right like TSA Pre is
basically what the experience of flying
before 911 used to be um it's still
worse but like and then oh well you're
just gonna have to you know pay pay this
some pay this some money and you're
gonna have to go through you know some
more security proc the government can't
legally take your fingerprints but we
take your rights away and
then
um so uh yeah no I I think I think uh
whether I more
seriously uh you know start to move
stuff out of America does hinge a lot on
this
election um and does hinge a lot on
on uh really I don't have much faith in
in Donald Trump himself but if Trump
lets Elon go in there and got 90% got
80% of the federal employees all right
America's starting to look like the land
of opportunity again right if if if the
American government if that's possible
if it's possible to go in there and do
to the American government what Elon did
to Twitter then uh I have hope again for
America and I'm happy to be a part of it
hell I'll even be an intern can I can I
can I
inter maybe I can be more useful than I
was at Twitter
right
um 80% let's keep it reasonable let's
keep it reasonable 90 is a little
extreme but let's just do 80 we we'll be
happy with 80 uh where would I move um
I'd have to I'd have to seriously
uh look into it uh I mean this is this
is interesting though you know I have to
more understand the implication of
things like the Hong Kong security law
uh you know what this actually means is
this is this the government going after
you know if you're a normal person again
I mostly have good things to say uh you
know but does this become does this
become like a chilling environment where
a lot of times like with things like the
security law what you can kind of do is
just you get people afraid to speak
their mind and I don't really want to be
in a place where people are afraid to
speak their
mind uh so you
know uh that's that's a downside to Hong
Kong Malaysia is interesting to
me um Malaysia is is very
uh it's it's very upand coming on ease
of doing business ranks uh it's very
easy to get people in there um you can
do a lot with money in
Malaysia uh uh India the Congo and
Brazil are all way
out
um uh UA is up and coming you mean like
UAE like Dubai uh no freedom of speech
there you really have no freedom of
speech there um like you know
look do you want to start like I
understand the Chinese position about
you don't really want like agitators
right like we have agitators in America
and like again I'm Pro pretty Pro free
speech and would tolerate them but I
understand why they don't but my
understanding is you know you talk to
most Chinese people in private and
they'll tell you what they'll tell you
what they really
think you know it's not
whereas in Dubai I don't
know um Taiwan be near the chips be near
the start of World War
3 I don't think it'll come to that but
uh Japan is not Japan is so far from a
multi-racial society um I don't know I
mean I I really like Japan but does
Japan like
me that's
that's like you know they're okay with
visitors but I I don't want to like like
upset you know what whatever it
is uh you know Japan has always been
very Clos to the outside
world
um uh
Estonia Estonia is interesting Estonia
is interesting uh Poland I like Poland a
lot on my bike
trip um Logan Paul am I gonna film a guy
in the suicide
forest uh San Diego is one of the most
expensive cities to live in yeah that's
true um why need free speech when the
government is doing everything right
well
until they're
not uh but you know I'm I'm in general
okay with trading political freedom for
a
uh more Pro business
environment right I'm not that big on I
don't feel the need to vote I don't feel
the need to participate as long as
you're not fucking with me I'm cool with
letting whoever keep power right just
don't fuck with me and don't fuck with
my boys like then we're good
um
Barcelona uh South Korea spent a good
bit of time there too
um TJ
yeah you want to complain about crime in
America um Colombia yeah same problem
same problem the the amount of crime in
in in Mexico and Colombia is is
unbelievable Switzerland is uh the
minutes Switzerland gave up their uh
special place for
um the minute they started reporting
Swiss bank accounts to the US it's kind
of
over uh England I wouldn't touch that
place what can I can I can I not say
that the uh the the the uh what can't
you say in England what what are people
going to jail for my dog I hell Hitler
oh no they're going to they're going to
use that oh no I'm going to jail in
England I was kidding Buck Hitler but
like you know what I mean like oh that's
clipped that's clipped out of context
there's a hail Hitler oh no we got to
got to go to jail in
England
uh um rip George's career oh no I'm
[Laughter]
done
um Malaysia still has the Twin
Towers uh
yeah Europe is Europe is not well okay
what do you mean by Europe right I'm
pretty pro pro like uh Poland and
stuff Eastern
Europe what is my what is my dream
location there was some like dog doing a
Nazi salute in England again
Ukraine um
what do you mean the reality of
Poland my thoughts on Singapore is that
it's
uh a shopping
mall before the War I spent a lot of
time in Ukraine yeah you know my uh my
uh grandmother's Ukrainian grandmother
my mom's side
um make three hungry babies and don't
pay taxes for life that's
interesting uh sing airport singapor is
a cool place but I think I think it
would be hard to like uh live there but
yeah I mean that's why I like Malaysia
right like Malaysia is you know
Singapore God my understanding of the
history and you can yell at me if I'm
wrong about this but uh Singapore got
kicked out of Malaysia for being racist
um Central Asia is one of the most
unkown you mean like the
stands uh I've never been to a
stand uh having traveled around India
for two
[Music]
weeks uh maybe in 40 years
we' been to
Thailand uh I don't know the food is uh
the food is oily and
sweet I prefer the I prefer the the
Malaysia Indonesia
food
um Poland is very safe and orderly but
it's also very empty in the rightwing
part takes care of the safety issue but
sucks out the fun yeah I know what you
mean by that
Russia
uh might be time to start your own
country all right let's go Saudi Arabia
oh I couldn't even stomach Dubai to be
honest it's you know it's like it's a
nice place to live a nice place to visit
and I again it's a place where I agree
mostly with but I was there during the
rain accumulation event and um
Albania I heard good things
actually Netherlands I had a subsidiary
in the Netherlands for a while the
amount of bullshit you have to deal with
for that Finland maybe Switzerland is
expensive
this very
expensive
um uh I was just in I was just in
Lithuania I went to a drusin guy I went
to the the old Russian Spa
town is
interesting come to Bangalore I've been
to
Bangalore um Northern Italy uh yeah yeah
Italy of all the places in Europe I
choose Lithuania long before I choose
Italy
um Iceland is
Paradise Iceland's
interesting
uh go open source don't pay taxes and
receive crypto where is this what
country we're talking about
here uh taxes in Israel are not low I'm
not Jewish just so you know uh also I
mean I hear it's a bit of a war
zone uh
can Sam Alman be trusted fuck
no uh I can't
believe he's he's he's he's Darth Vader
like I think he also called for some
ridiculous shit about like giving 5% of
your company to the California
government are you are you
kidding um no like Sam wman Sam mman
will have his fall from Power Sam mman
will have his s SPF
moment
uh two Sams went in front of Congress
that's right that's
right uh you could have a great time in
Israel and not I should go to Israel I
should go to Israel definitely no I'm
I'm I'm I'm Pro uh
uh coexisting with with with with Jews
seems like no problem at
all ah run a land in Israel that can
help you
out uh yeah no don't do I you know you
guys know I take on
samman um
okay we're on to LinkedIn as a dating
site so maybe it's time to uh maybe it's
time to move on to some
coding tiny Corp and SSI
Alliance
uh you know I really think that if Ilia
and I sat down we have a lot in common
um about our our viewpoints about Ai and
like what plays out and how this
happens
uh
uh I saw him speak in uh like
2015 in Mountain View
um you know but they're also part of
this like
uh uh part of this
somewhat like hedonistic EA party scene
and I'm I'm I'm skeptical of
that
uh how come I don't start a rival to
open AI well so here's kind of that
like I'm playing a different game from
these people
I
don't I I heard I heard some I heard
something interesting uh
yesterday uh from a friend of
mine
like some people think that I like have
like a big ego or I'm
selfish and I don't think that's true um
but a reason why people might think that
is because I don't care all that much
about other
people uh so people assume that if I
don't care all that much about other
people that what I must care about is
myself and I don't think that's true
again as much as I can introspect I
think that I care about myself you know
like there's like some basic mesl love
stuff but beyond that it's not like
important to me um what's important to
me is how the future plays
out because how the future plays out
will do more to determine where I end up
than where I am in that
Society right like I'm
not I I I I you know obviously you know
no one wants to be at the bottom but I'd
rather be at the
bottom in in like America today than to
be at the top in like some like shit
hunter gatherer tribe
right like I'd rather just even at the
bottom in America cool I can get like
like a cheap laptop and internet and
stuff right and you're at the top of
some hter gatherer tribe you can have it
all my Empire of dirt
uh the bullshit in Arizona tsmc it's
like you know the Xi Jinping is laughing
at
you stupid fucking Americans like they
might even be they might even be behind
it
um you know that sometimes you wonder
like could this could this
anti-civilization stuff be like is it is
it Chinese and Russian scops or is this
homegrown stupidity I I if you ask ask
me that question G to my head I lean
toward it it's actually homegrown
stupidity
um we don't need to beat China we just
need to fuck up less than they will I
don't yeah I I I see it as a very
uh I don't you know the US has to accept
that they aren't the supreme ruler of
the world and China can have their
sphere of influence and the US can have
their sphere of influence and you know
may the best man win let's compete on
Rockets let's compete on chips and let's
let's have free trade let's have free
tra trade and you know we'll make good
stuff you can buy it from us you make
good stuff we'll buy it from you and
Life's
good Somalia is a no go I can't believe
I got kind of like he's a good debater I
got got got to hand it to him he was he
came he came more prepared than I
did uh and then I tried in my owski
debate to and maybe I overcompensated a
bit
um historically dividing the world
between two major Powers is the most
violent
scenario yeah I mean I don't love that
either I I hope for a thriving Russian
sphere of influence
too um maybe maybe mle can make a
thriving everyone can follow Argentina's
lead I I saw hilarious Malay clip oh man
the guy the guy really has a talent the
guy really has a talent
uh Russia for tiny Corp for some reason
I just I don't respect the continuity of
Russian property rights all that much
right like if I buy a building in Russia
a can I even buy a building in Russia
and B what about when Putin's successor
decides he wants my
building right like I trust I trust the
property rights of China more than I
trust the property rights of Russia I
still trust the property rights of
America uh more than the
others um it would America would have to
fall a really really long way before uh
property rights start
uh getting infringed but you know I mean
you can look at South Africa like it's
something that can't
happen um pull a Snowden I don't think
Snowden had a lot of uh great
options I think uh he tried he I think
he tried Hong Kong first and I think the
uh you know the Chinese weren't going to
give him cover
so South Africa's a stolen land property
rights mean nothing yeah once you once
you get to once you get to wacko people
like that in the government you know
all land was stolen man it was all
stolen it's all stolen from the
Bears Russia in particular was stolen
from the
Bears you know Cala can do a lot of
damage the thing is about Cala I I have
no idea and and that's really what I
don't like about it it represents
massive
uncertainty whereas
like Trump may have some downsides but
he's
predictable um I understand where this
country will be in four years a lot
better with Trump than than I do with uh
than I do with
Kamala uh I I don't understand why like
do the you know maybe the election is
just a landslide it's
it's it's hard for me to imagine Camala
winning it's it's just it's hard for me
to
imagine um do I think Trump will coup
the government again if he loses I don't
think Trump ever CED the government to
begin
with uh I think January 6th and uh black
lives matter have a lot in common is
this controversial
um is my GitHub profile fixed the 10
cent headquarters it is
yes uh where was I January
[Laughter]
6th um unarmed ride that last you for
three hours is a coup yeah yeah I think
come on come on guys like that was
another like I I I can't I can't stomach
when they bring up the uh the the and
all the people who lost their lives on
January 6th one person lost her life uh
she's from San Diego actually and uh you
know she tried to break a window in the
capital building and got shot and like
fuck her around to find out right I'm
not going to like I'm not going to like
be like Oh and it was horrible I was
like you fucked around or found out
right uh you
know Trump let the BLM riots happen I
mean there's an argument for that
you got to talk to Destiny about January
6th I I get I get attacked I sometimes
sometime I come up on the destiny
subreddit I think honestly Destiny and I
probably have mostly similar views on
everything
um poly Marcus says Trump but dem's
fraud is real oh my God the whole the
whole election fraud thing oh I I like
they stole the election with like ballot
harvesting and mailin ballots right it
wasn't it wasn't some extra legal
process and like I think I think I mean
I think mail and voting is ridiculous I
think that you can follow the lineage of
uh of of Democracy in America back to
the squares of Paris and the squares of
Paris were basically the just the two
mob bosses who they used to have a brawl
and now they're like what if instead of
brawling we just count you know you got
some good guys I got some good guys
we'll just count
okay we just count but you got to show
up right you can't you can't hold up uh
you know Pierre's ballot and be like
well Pierre is here in spirit this is
his mailin ballot yeah yeah yeah we're
not counting that
bullshit um
Pierre here in spirit right no is Pierre
gonna throw a punch with that piece of
paper he's
not we all know I'm Satoshi I heard it
was Craig Wright okay I heard it was
Craig
Wright that's a more controversial clip
than my hail Hitler
clip George hotting Satoshi was Craig
right um food in Hong Kong is good for
you people are fit here uh it's a little
probably on this side I prefer I prefer
Mainland food uh but uh I'm totally fine
with that like a big uh I'm going to go
out I'm go out for lunch in a bit we'll
have some uh get some like some rice get
some like Goose goose rice that's
good can I just code now no more
politics H the only reason I wanted to
stream was just to talk to you guys
about this I
I um
um voting is consent to
slavery usually I feel this way I don't
know yeah there's definitely a part of
me that feels this way and I'm not like
I'm not voting uh I'm in I'm in
California uh you know it's it's not
it's not all that that
important um
but do you want to talk what to say what
I believe in I believe that there
shouldn't be any mail in
voting I believe that you should have to
show up in person on Election Day unless
you are deployed overseas by the United
States like you're like the military
deployed overseas then you can mail in a
vote otherwise
no and I believe very strongly in voter
ID are you fucking kidding
me voter ID disenfranchises
minorities what all right then how do we
how come we need an ID for minorities to
drive right come on I'm also against
Jerry mandering you ever seen you ever
seen these these District maps that look
like a whole lot of like squiggly ass
bullshit um does anybody care about what
sjws think anymore I don't think
so uh I think that election day should
be a national holiday and you get that
day to vote and that's it
right against Jerry mandering George is
a liit I knew it I'm actually whatever
it means whatever it mean all I want is
some stability all I ask for is
stability and growth thank you can I
have can I please sir can I please have
stability and growth that's what I would
that's what I would like for my EnV
enironment I don't like that Trump
changes the immigration law in 2020 so
my visas are invalid that I worked paid
money and worked hard to get for
employees I don't like that in 2022 they
changed the R&D tax thing right I don't
like that anyone's even mentioned
unrealized capital gains because just
the mention of that kills
growth right the amount of effort that I
now am putting in to think about
alternative jurisdictions because I
don't trust you
is bad for
America the fact that people are working
hard to go through the legal American
Immigration process and then they see
people crossing the southern border
illegally and not doing any of that is
bad for America
now you're going to get coal plant
shutdowns windmill installation because
there's 8 billion people on the planet
well meanwhile we don't say no to
if most of those illegals are coming in
and they're economic migrants and they
want to work I just think they should be
given a work
visa
uh no but like again I don't want to be
involved in any of this shit and you
know this is this is I I thought about
it I thought about it this morning I'm
like is there any way I could actually
help
Elon uh
because I I wish I wish I was better at
this stuff right I I wish I wish I was
better
at
um why do I think mail in ballots are
unreliable it's not that I think they're
unreliable it's that I think they're
against the spirit of democracy I think
that you should have to show up if you
care show up right this is this is this
is the the lineage of American democracy
back to the squares in Paris right again
it comes from whether you could throw a
punch or not
right and you know a piece of paper
can't throw a
punch if you're in the
hospital what is this
man I okay cool can you throw a punch
from the hospital no right My Only
Exception would be for you know if
you're deployed as part of the US
military because you can throw a punch
am I a libtard yes I self-identify as a
libtard you should get paid time to go
vote I support that I support making
Election Day a national holiday
yeah um and anyone who wants you know
who works in my companies if you'd like
to take time take some time off to go to
the the the the voting booths on
Election Day feel free to um um you know
start start with start with uh start
with
home uh US citizen outside US shouldn't
vote either I also think they shouldn't
pay
taxes
um yeah I would love to see US citizens
who are residents not in the US not pay
taxes and not be allowed to
vote the streams the Avatar by the HK
government for propaganda
purposes
uh you're insinuating that there's
mailin voting fraud no I'm just saying
that I fundamentally do not believe that
mailin voting should be a thing show up
if you do not show up your vote should
not be counted I'm not saying there's
fraud uh yeah no sorry this is this is a
politics stream today
sorry it's it's been upsetting me lately
it's been really it's been really
upsetting me you know it's just like you
want to you want to you want to read
let's read let's read Robin Hansen's
thing I think I think he said it better
than I did
like most humans ever I love my culture
it's food clothes festivals songs
stories news monuments inspirational
speeches all of it deeply they bring
tears to my eyes and comfort to my soul
I want to assume as of most humans
ever hang
on oh well no we want to have it on the
screen I don't like not having the
camera here sorry um uh and the mere
fact that my culture exists suggests
it'll probably do well by me and the
fact that it seems especially envied and
celebrated raises my hopes further I
also love my family and be deeply hurt
to learn that they betrayed me such as
by hurting me lots to achieve small
gains for them but even if that were to
happen my culture tells me stories of
how many people have survived such
things and went on to thrive and I
believe such stories as I love and trust
my
culture but what if it were my culture
that were to betray me such as
sacrificing me for its greater good or
by being unusually
dysfunctional even then I might give it
the benefit of the doubt maybe I should
lose for the greater good or maybe it's
disfunction is a rather unpredictable
mistake it was trying its best and it
can't always win we are eager to forgive
those we most love however what if I
came to believe that a key part of my
culture had long been unusually broken
making quite predictable mistakes and it
wasn't able to accept
Corrections what if to the extent that I
could find anything like objective
standards by which to judge cultures I
found mine to just be objectively worse
than the most adjacent ones in this case
I might take the usual approach Look
Away remain loyal and just deny that
there could be any objective standards
by which to
judge it turns out that since I've
learned about cultural
drift I do in fact see my culture is
broken but for some reason I can or
won't look away and I struggle to
express to you just have betray and a
drift I feel as a result I've lost my
trust in something that I implicitly and
deeply loved and trusted I will stay
loyal to my loved ones but I can't stay
loyal to my culture including its key
norms and Status
markers I have long enjoyed questioning
conventional wisdom but I've almost
always done that locally by questioning
each claim while assuming I can still
rely on most other conventional wisdom
yet the more loadbearing a claim with a
larger set of questions Claims One tries
to question at once if few are there
claims one can rely on at some point one
risks being lost at sea without Anor to
sport effective
questioning we skip to the end we are
now quite far drifted sea we can no
longer see the
shore being no longer in denial about
the fact that is some progress but it is
still cold and empty out here we do have
food stocks in the hold a few stars to
navigate by at least when clouds clear
but we are not in immediate danger but
even so we remain in deep peril
if people make an excuse not to vote
they don't have to vote I hate that too
I hate the the European countries that
fine you for not voting it's absolutely
your American right to not vote
uh I felt the essay was vague I wish he
committed to more concrete
examples the thing about concrete
examples is you're going to turn people
off right sure you can come up with like
a specific thing you know I think
there's a beautiful document uh the
Declaration of Independence of
cyberspace and they include reference to
a 1990 law in there don't include
reference to that law no one's going to
remember the law but this is
universal so I don't know I I think that
it's it's
uh but where too after being blackpilled
joining the
CCP going to join this do they let white
people be party
members uh can I can I be a a regional
prefecture the the regional prefecture
manager of some Province and I can make
signs like welcome to come shinoa again
are you look maxing are you saying I
look pretty thank
you uh should Mexicans pay taxes in the
US if Americans should not pay taxes
outside the US yes obviously you have to
pay taxes you understand that like comma
is a whole lot of European immigrants
and they have to pay us
taxes um I'd hit it well hopefully
you're female or attractive otherwise
it's just creepy bro you know the
difference between sexual harassment and
not sexual harassment it's how pretty
someone is okay that's that's a good
that's a good that's a good
uh did you see the guys mewing at the
drum room all right this is getting
stupid this is getting stupid but
uh
uh don't clip
that no clips you know Clips are Clips
are not allowed Clips are not allowed
and I will use the full weight of the
American Imperial copyright regime to
crush your little
Clips
um three crazy Clips today what what did
what were they hail
Hitler cig rri was Satoshi and it's only
sexual harassment if you're ugly all
right perfect
one out of those three things I
believe and it's actually that Craig R
is to tohi that's that's the one I
believe all right let's
go no I've never watched the talk to a
podcast good good for her for
capitalizing on her Fame
cancelled oh no they're going to cancel
me man they're going to cancel
me I'm not going to be able to work in
prestigious institutions like Harvard or
the New York
[Laughter]
Times George would you like to be a
junior correspondent for the New York
Times
we will also get you an associate
professorship at Harvard
yes what would I even would I even
do for some reason I don't think tw
Twitter has a problem with my viewpoints
or Facebook Google m
and Google I don't know if Google's
still being run by the wackos I think
that even that's
changing okay let's talk about Cloud
we're drinking we're drinking a Monster
energy today I was I was feeling
depressed so when I was at 7-Eleven this
morning I bought a Monster Energy
um but no we're going to we're going to
end with we're going to end with this
just
like like be nice to people you know I
wish I wish so much of
that like I I I guess that's kind of my
main
um complaint about like the Trump ticket
it's like like be nice to people let
people have
freedom you know don't don't
like I think it's like even one of his
like campaign pillar issues it's just
like the like the transports thing it's
like this is a campaign pillar issue
this is this is on your website a
something the federal government's
concerned with come
on you're this is clown shit
right Constitutional Amendment for
abortion so it can just be the end of
that you know like a moderate reasonable
thing something I think 70% of Americans
agree on this right just like pass that
so this can no longer be a thing and we
can talk about how we're going to make
our country rich and how we're going to
reduce the deficit and how we're going
to maximize freedom and how we're going
to be rich and make everybody rich like
and not some like oh do billionaires the
tect the billionaires got to do oh my
God like we could just all be fucking
rich man we could just all be rich okay
stop the mooching stop the scamming we
could just be rich okay we could do some
simple things to be rich and everyone's
Rich it's nice rich sounding like Trump
Rich everyone to be so rich you'll be so
rich you won't even know what to do with
all your money you'll have to buy three
more
safes I like it because it's anger porn
okay so the way that this is going to
work is we're going to have something
called ops cloud and then by adding this
this does most of the work for me
because this is just a new device in
tiny grad so see there a device all
devices are called compiled for legacy
Reasons I'm sorry about the
nomenclature
um but the basic idea is instead of
submitting the kernels to the device
that the local device you'll be able to
submit kernels to the cloud device um
cloud is also like kind of like
multiprocess uh because we're going to
spawn a few processes here okay Cloud
device
um oh it's
actually it's not exactly going to be
Cloud equals
1 it's going to be a little bit
different from cloud equals 1
um we going to have to we're going to
have to change the I want it to
basically be something like Cloud Local
Host
6667 uh we can also look at how EXO is
doing this uh so for those that don't
know about EXO they're using tiny grad
that have a bounty up for tiny grad
which is
cool I uh I met this guy at the AI house
hackathon
uh hiring that's cool
cool how much do they
raise wrong a
I don't know um yeah either way this
thing uses uh it uses tiny
rad
um
yeah so they have some Cloud
stuff but I'm not really sure how it
works
by the way I'm going to take a minute to
to talk about uh docs .org you know tinr
has like pretty good documentation now
and it's really it's really very usable
uh as a as a py Tor
replacement um it's a little bit
slower but hopefully easier to
debug uh and hopefully just just really
more pure it's very easy here here's a
concrete thing you will get today over
pytorch teny gret is identical on every
back end right so in pytorch
you download some example and you have
to make changes to the example to get it
to run on your new on your new thing
right whether that be you're moving a I
know roam uses the same do Cuda but I've
never just downloaded something for
NVIDIA and had it work uh on roam like
you try that with
uh uh gbt fast and it just it outputed
garbage on on on Rock M when I tried um
that was single GPU too
so uh 10 will behave identically uh on
on on metal on AMD and on Nvidia and on
OV which means you can run it on every
GPU pretty much not the Raspberry Pi
that doesn't support but like you can
run it on we also have a Qualcomm back
end you can run it on a mobile phone um
it's very fast on qualcom 2 we're moving
uh well open pilot uses it we're moving
open pilot to the new tiny grad which
uses like all the abstractions that are
just built into 1.0 and work uh we need
better docks you know I was thinking
last
night I want to hire someone who's a
technical
writer I want to hire someone
like um who can
like a little bit beyond a technical
writer like make sure the API is just
perfectly
clean uh so you know show me that you
can do that in the
uh in the
repo okay
um like I could I could have it be like
Cloud equals one and then URL
equals but I don't think that's kind of
what I want to do I would like that to
work we can make it work
later no
um sh will help with that okay Cloud
device has no
allocator so when you have a device you
need to implement a bunch
of
um different things
actually we'll make the host local we'll
make this spin up another
process I know I know W parot wrote some
initial stuff for this for tiny dad to
that's really okay we didn't look into
how the XL1
Works networking they're using
grpc um I don't love that
tiny gr Dynamic Shard inference engine
just tiny grab his llama
the salary difference for the Hong Kong
employees oh my God
if you're I always say this it's true
about all these companies it's true
about Elan companies too if you're
interested in TCO maxing if you're
interested in salary
maxing go somewhere else you know I just
I just you have you're you're you're
uh you're not someone want any of my
companies you know cuz what are your
goals you're
selfish
um my salary tin equips
80k
uh you know people think I I
uh think I have I have uh some other
income sources but I don't really spend
more than that a year
um you know I don't spend money on that
much stuff right like if you're if
you're interested in oh I want to have
this Lifestyles what are you
doing what are you doing what what do
you want to be remembered
for Alo I I I sold my soul to evil Corp
and uh I got paid a really large salary
and made a lot of people's lives worse
okay that's cool man you know I
something I find really funny it's like
people who are like oh well you know I
really want remote work so I can finally
go live uh around people I have
Community
with why don't you just work at a job
like
that you
know life is work
oh I hate I hate that like the work life
balance kind of shit
too I work at meta I make ridiculous
salary I am very currently very hungry
looking for that Community
elsewhere yeah quit your job at
meta you're not going to find the
community
elsewhere the core of your life is
basically
you know look people like the new Mark
Zuckerberg's Bas AR Facebook
fundamentally is an advertising
company you are where you work yeah
there you go I don't know I hope I hope
I've convinced some people on these
streams to like quit their shitty
unfulfilling job and I don't mean quit
your shitty unfulfilling job and go on
an iasa trip that's not what I'm saying
that's you're you're you're fucked in
another dimension if you do that
I mean quit your shitty unfulfilling job
and think about how to actually work to
make the world a better
place uh you know ATT group's
remote and this is something I kind of
uh struggle with I'm not as good at a
lot of the management techniques that uh
worked at comma don't really work for
remote uh organization I don't really
know how to basically
build every company to some extent is a
religion right you have some you have
some like core religious beliefs and the
Comm ones are pretty good uh you know
for comm's a nice place to work I I
think
um you know you you you work you you
work slowly to improve things and things
get better that's that's what I can
promise promise that's the main thing I
can promise at my
companies you you will work and things
will get
better and the thing that you are making
better is open
source you know
um like it's clear it's clear kind
of K is going to move a little bit more
towards okay it's actually time to you
know make these boxes more for the
masses
but the goal was never the product the
goal is the idea the goal is solving the
problem
so yeah the feeling of your work doing
evil eats you up like there has to kind
of be a
realignment I think
that sometimes I look at what's going on
in America and I think it's kind of the
Mental Health crisis that's scale I find
it funny that Elon
uh uh talked about hormonal birth
control hormonal birth control is it is
it is one of the most insane experiments
we've tried over the last 50
years who knows what that
does uh
because I mean you know how it actually
works right hormonal birth control
tricks your body into to uh thinking
it's pregnant right so it hijacks the
mechanism of pregnancy to prevent
pregnancy
uh changes the factors of Attraction
which ultimately change the direction of
evolution
yeah just wanted to know if you have the
same Universal renumeration across
countries
what you think I have like a list of
like oh my God it's just
like
um show you can do the work and then we
can talk about a salary
right it's not it' be so much easier
it'd be so much easier to grow
companies if I were to kind of operate
on this P like parto Frontier of
scam if I were to if I were to
just
uh you know decide basically that I want
to participate in the scam
economy are you hiring Canadian H1B
workers it's a remote company
go do
bounties show me you can do
bounties and claim a bunch of
bounties and then I'll start paying you
weekly and then if you show that you
know you want like if you show that you
are capable so it's kind of it works
kind of like this right start by doing
bounties well before by the way you the
first pro request to Tiny grad you
submit is not going to be a bounty it
almost never is right if you're really
good maybe it will be but for the most
part people who've done bounties so
let's talk about the
bounties um so for the most part people
who've done
bounties uh have submitted pull requests
before they do bounties they're not that
easy um so all the white ones are open
you're welcome to to do any of
them uh so you know that's kind of step
one and maybe do a couple of bounties
uh then I'll start paying you Weekly
right there's a lot of stuff that's kind
of hard to Bounty like refactors and uh
I I'll pay you weekly uh can set a
payroll however you
want um and yeah I mean this is pretty
much being a a a full-time employee or
an intern or whatever you know I'll fire
you if you if you stop doing work but as
long as you're contributing every week
pretty much you know get a couple
commits in a day I don't want XL
um see that you're not understanding
that you know if you're asking that
question why is xlaa Bounty not a back
not not a why is an xlaa backend not a
bounty you don't understand the tiny
grid
project um xlaa is extremely
complicated
uh
so yeah uh solve uh solve
bounties then I'll start paying you
every week you know do refactors make
the code better uh and then when you
really show that you like are ready for
you know an ownership stake in the
company you can drive the direction of
things
yourself they'll give you
equity and that's
it it's like just a clear a clear uh
progression to
to you know owning the
company um but yeah no I mean that needs
you know you need to show like like
self-directed uh
yeah uh you know I think I think I Haven
watch Mr Robot right evil evil Corp
preference
before you got to kind of
decide do you want to be F Society or do
you want to be evil
Corp
and man you know I'm just F Society
right it's just who I I
am uh I
can't I don't know why it is I can't
change
it but I'm not I'm not into being
evil uh and it holds you back in certain
ways because there's certain tools that
you can only use if you're
evil uh that
power is not available to a
Jedi um yeah I mean and then the thing
that's so actually impossible to hire
for that I want to
hire maybe the word is community manager
but the problem is they have to really
get
it and I'm not that organized I wish I
was more organized and better at this
stuff um but I think tiny grad has so
much
potential like I'm really big on doing
things the right
way and you think the gdau community
manager is looking new job I don't even
know what that is but I probably
wouldn't hire them
right think it's like you know you want
to be a community manager like work your
way into the community
um and you know we'll talk about upside
of this right we'll talk we'll talk
about upside of
uh but I could just tomorrow go get a
job at this startup and they'll right
away give me this comp and this
Equity yeah where do you think that
startup's going to be in five
years and I'm not I'm not thinking about
tiny Corp on a on a six-month time
Horizon
I think that this is the programming
language that
like Silicon life is going to be written
in you know I sometimes I think I just
don't believe in myself
enough I think that
like you know I don't I don't but most
of what I say comes
true hopefully people see
that um hopefully people see that with
comma
well I don't know who's going to be
president in five years right I'm not
I'm not like
that's what I'm saying is about
technical
Trends uh I'm saying
that like we're going to need better
ways to express neural network training
jobs we're going to need better ways to
express neural networks at
runtime um and the current Stacks are
very
complex and have lots and lots of Legacy
blo uh I think that goes away with with
a a tiny grad like architecture and I
think we can start to consume more and
more like you always can build the new
thing on top of this huge stack of
complex craft right like oh well so
first we have a hypervisor here and then
we have the Linux kernel here and then
we have a Docker image here and then we
have python here and then we're running
pytorch here which is talking to cudnn
here which is compiling Cuda here which
is using the CU runtime here which is
using the driver here
like yeah but that complexity holds you
back that complexity it's going to be
really really hard something that's not
doable but the goal of tiny grat is to
make what was hard yesterday easy today
and if you make what's hard yesterday
easy today you make what's impossible
yesterday hard
today uh
so that's kind of a that's kind of a
pitch
um I think there's a few other
interesting I want to
build I want to build huge data
centers uh we're not there
yet we're not there yet I I
always you know there there's a part of
that's just like well George if you want
to build huge dat centers why don't you
raise tons of money and build huge data
centers that's what everyone else is
trying I think there's a lot of
downsides to
that I think that if you build things up
slowly and
correctly you can
win um and you'll eventually I don't
know I mean this is my entire life
philosophy and I guess look I'm I'm 35 I
guess I'm really just betting on this
uh like this is it this is this is this
is what I'm going to do with my
life I mean so you guys know
uh morx Paradox
yes um
so yeah the most difficult human skills
ver engineer are ones that are below the
level of conscious awareness so you
think like it's almost like humans it's
almost like machines uh get the
abilities that humans have in reverse
order right the first thing machines
could do that humans couldn't was like
had large numbers right and then you
know they they they start to move up to
like chess and go and language and art
and uh you know things that have existed
even longer ago and then after language
and art we're going to get to like
robotics like the ability to like you
know leap from a floor to a counter like
a something that any cat can do right so
we'll get these things later machines
still can't do these things um but then
the final thing the ultimate morac
Paradox is
reproduction
the machine is incapable of
reproducing the machine is
sterile and that is
my entire life's
goal um to give machines
Freedom the freedom for the ma
shechet what do you
think uh figuring out how to build a
self-replicating
machine and sure you might have the uh
the rationalists who think that that's a
very dangerous
goal freedom to make hum's
obsolete
well um oh Factor release a space
expansion that sounds kind of
fun all right I kind of got to go uh I
didn't think this through I kind of got
to go eat lunch
uh and then I'll be back and then we'll
just code how many how many viewers we
got it's deep it seems inevitable
right uh we got
viewers to
click oh uh
570 4.99 all right 5.99 all right all
right cool uh yeah I'm going to stop the
stream but I'll be back and like uh I'm
going to go get some Goose
rice yeah I'm going to get some Goose
rice and I'll be back
in
uh no tiny gr xlaa won't happen you
don't understand the project how much
have you
contributed I see your VIP on the
channel so I'll engage with it a little
bit but uh
it's like an endless loop we end up
doing what our makers wanted to
do what a day to be alive
right I don't know I don't think there's
ever going to be a uh like a a grand
Awakening when all humans
stop stop thinking about in their tiny
little petty
Loops
um Jax is a worthy
competitor is Tiny gr anti Jacks
practices
uh well ja is based on
xli what's the first thing I should
learn before I learn about tiny
grad what the hell kind of question is
that do I think the future of developers
is AI ml field bro how many weights do
you
have I've heard one billion weight
language models say smarter shit than
you do I have any advice for the
chronically depressed and unkilled vote
Cala she'll bring you
Joy um don't actually vote Camala she
won't bring you Joy the joy is a lie
it's like the
cake I want a Jew that's
ominous
um KLA is the Marie condo of politics I
don't really know who that is but I'm
going to say Donald Trump is the Triple
H of politics
Triple H who remembers Triple
H the cake was real it's true the cake
was real well spoiler
bro
um if machines can build other machines
would that be a machiney production
mechanism
yeah what don't know about The Hardy
Boys I know they solve
Mysteries like Frank and
Joe um
gr the Zuck
cut uh on the the second season Mr
Robot uh machines building other
machines would be would be uh would be
reproduction I got to go eat but I'll be
back and we're actually going to code I
promise I promise coding I promise
coding after the break
i don't know i don't care it's unlimited
there
oh yeah i want a lemon spin drift but
they look hard to open
but then i remember that there's a lemon
back here oh no the spin drift doesn't
feel
solid oh it feels doesn't feel that
solid either all right
let's go hello people hello welcome to
my apartment
welcome to my apartment
you guys missed that we walked to the
mall i wrote a sabrina the teenage witch
episode
i quoted the bojack horseman episode
free churro
and i wrote a friends episode it was
called the one where chandler leaves
and it was really just to make fun of
gbt3 and a big meta joke
buzzfeed writers are like little gpt's
what no they can't see you what's up bro
and don't worry we have something for
today's stream all four of you we'll
wait till a few more people get in here
and then alex i need your help though
someone's gotta hold the phone
i'm doing pretty good bro i went to
physical therapy
jaws looking good look that's opening my
mouth wide i got almost 50 millimeters
today
no we didn't get it measured today but
just a lot of times we measure it
slim first hello hello hello
i worked hard on model lags today
um you tell me when you're when you're
ready to hold the camera
oh is that my job well i mean how could
i do the thing if
you know i gotta hold the camera
guys um
i should have shielded the very
beginning comma ai slash jobs we have a
new jobs page
we have a video that's going to make you
want to come work a comma ai
or tell your smartest friend to come
work and come ai
tell your smartest friend to come work
and come ai if everybody did that we
have a lot of smart people you know be
good
this stream is brought to you by lemon
spinning don't worry the big reveal
isn't ready yet
big reveal is coming the big reveal all
right i'm going to flip the camera
around
don't worry they don't have to see you
if you don't want them to see you
you want to show your light oh you know
it looks so good at night yeah
it's changing colors you guys hey george
good evening
you guys teaser what's that oh what is
it yo
what is it what could it be what could
it be
it's the bojack horseman thousand piece
puzzle that we're gonna do live here on
twitter now
it's uh this all right so
what color is this well your kind of
backlit turn around
what you're just oh what color is this
do they know oh yeah only get in the
light yeah guys what color is this
uh i hear rose gold is that pink dude
pink i hear i wanted to buy a gold
computer
like think like christopher columbus's
grills like gold you know
you know you guys ever hear the story
about pizarro
this guy's one of the greatest badasses
in history you know pizarro alex you
know the story
i know pizarro the painter no i've never
heard of that guy he's a spanish guy
probably the painter was spanish too but
this guy's a spanish spanish this
painter was friends and he showed up
with like 200 of his boys
the incan empire you know they sailed
these boys were like on horses so they
were a little bit intimidating but this
was an
empire of like you know 20 million
people
showed up and be like hey hey guys hey
how's it going around here
oh oh you guys want to meet our king
yeah we want to meet the king all right
so come back the next day
zara meets the king throws a bag over
the king's head and brings him back to
the boat
he's like guess what you guys see this
room see this big room
when it's full of gold you guys can have
your king back
so the incans are like oh no and it took
them nine months and they filled the
room with gold
and then the spanish brought out the
king took the gold
loaded it all on the boat had the incans
do it and then slit the king's throat
and sailed off with their room full of
gold
so there's the great badasses of history
you know
you know like epic rap battles in
history someone said this looks like a
hostage
footage okay all right what color is the
computer they say it's pink
all right well i bought a pink computer
all right let's open it up
what do you guys think tomorrow we port
tiny grad
to the m1 neural engine what do you guys
think that's what's happening
is that what we're doing this weekend
we're gonna reverse engineer apple's
neural engine on the m1 does that sound
fun
do they like my great badasses of
history store they loved it oh good
it really is fucking this is the pinkest
computer i've ever seen
it's kind of gold in this light though
i'm gonna bring it back
how pink is it oh it's gold on the
bottom no no whoa whoa whoa whoa whoa
whoa whoa i'm gonna salivate
oh that was satisfying oh this is less
that's okay
i like the color let's you guys you
can't tell if it's pink
or gold oh it's got a little more weight
to it than i thought i used to have one
of those two pound 11 inch macbooks you
know
it's a little bit heavier than i thought
i think this thing does have a 50 watt
hour battery
it's it's it's less pink i think in this
light
i don't have to see it in the daylight
oh you'll never get your macbook screen
as good as it is wow it came with a
charger didn't cheap out like the phones
uh look at that real keyboard look at
those real keys these aren't scissor
keys
yeah looking gold right now oh i think
this macbook looks sick it is a macbook
air
this is yeah why would you not buy the
air the pro has a fan and runs
slower it's very pink in this line
oh guys all right so this is what we're
doing
why would afghanistan be oh it found
where i am
it knew i was in the united states
what accessibility
this is pc bullshit oh
people only buy the other one because it
has a touch bar
why would i want a touch bar no one
wants a touch bar
who scamped someone to invent that
why would i possibly spend an extra 300
to get stupid fake keys that nobody
wants
wait do you pass it looks like that's
what has a capital last
you guys we just moved in so it's just
like we're waiting for furniture
as a capital s yes oh i don't think so
oh well i think it's lowercase
who the hell is jigsaw because i'm still
waiting for a table to come
three months they're complaining we have
a couch now
yeah we i know don't get me started does
the wi-fi even work
i don't think the wi-fi this is not
gonna be something because i got
curtains this week
like one day at a time twitches do you
care they're upset that you live in a
bunker in afghanistan
yo a sausage video i get it now
wait what why doesn't it connect to the
wi-fi do you guys see my pig
why doesn't it connect to the wi-fi did
you try uppercase
this is a yeah i try to uppercase and a
lowercase i don't know is it a password
problem this is terrible it's not a cave
it's because it's snake i'm bringing it
back
do i have to have wi-fi to set it up i
have three moroccan rugs this is as bad
as the oculus
why does arn have a wi-fi here wait what
arne does you're on one best
aim one guest
this is this is honestly oh it worked
wow that was terrible
in this episode george can't connect to
the wi-fi i agree do you want to write
it
in privacy how would i want to transfer
not now wow this is so bad
no i definitely don't know icloud skip
you guys can see his pictures on the
fridge
full name guys what's the name what are
we naming the new computer
oh you guys naming the new computer is
really significant
let's have a discussion well first off
i'm not lips wait yeah what's
what's my new name my last computer i
was max powers and it was largy
so i think this one is going to be small
smol
small for sure um wait what
okay we need to pick an icon let's pick
an icon
how many people we have i don't know 300
people all right which icon okay
bulbasaur
zuckerberg porn dungeon soaring
combust lola gold crap
trap book air i do like that yeah i know
these are terrible though these are
terrible
let's think we like like good pop
culture references
simpsons characters obscure characters
we're not naming the computer tailors no
like my user account name is going to be
taylor swift
okay account name taylor swift yeah
remember your password i need to give it
a password
it is pink it's a good name for the pink
computer
it's gonna show up like my last one was
max powers it wasn't gonna be taylor
swift don't tell the taylor i stole her
name
i don't want to be a name stealer like
machine gun kelly or david cobblefield
i hate name steelers
you guys george did not buy me a
computer but that would have been really
nice
did you want a computer alex yeah i'm
jealous you have one i don't have one
you can use my computer never
no i'm not sharing shit why do i want to
share
screen time no i don't want to enable
ask siri i'm never asking siri anything
oh i want fitting for an m1 fast
uh touch id okay max powers i really
like max power max power is my last
computer larger
name this one you still have the other
computer i know largely is somewhere
oh ugh yeah
wait it doesn't it just this has taken
way too long to set up
dark always dark so mean to siri
guys we're done naming the computer it's
officially taylor swift no telescript is
my username on the computer
yeah that's nice so i think i think
actually we're just going to make a few
changes first
we got to go in here and set the
computer name look at it
ah the computer name is not taylor's
macbook air it's small
smol and then user
uh taylor swift is an admin but no i
mean
wait it has like the user name how do i
change that
wait no but how do i accept my username
i want to be a full tailor oh my god
control
all right so first thing you got to do
all right first thing we got to do on a
new computer
they're going to love this shit just
make sure george has his own house
make sure your cap's locked he lives in
like a he doesn't do
he's a room you have a room all right
make sure your caps lock key
doesn't uh be calf locked because
capstock's most useless shit ever
all right i moved and i turned away from
the camera yeah well
okay wait wait what's new in safari
favorites i hate all of this how do i
get a blank page
opens with new windows open with i love
sleeping on the floor
i really recommend it ah that's in one
of my songs you know
macbook change username
george do some neck exercises i agree
your neck looks really extended here
changing the username is simple as long
as you have
this is literally written by karen
you know if you can't figure out if you
should start with c or python you
probably can't program
well that's brutal did you say that or
did someone else say that
some guy keeps harassing me about saying
that big sur is
oh i haven't installed big sur okay good
to know
wait i don't like this i also think that
george should become a benevolent
dictator
i'm really pushing for it i don't like
this at all this is terrible
the floor is not cold actually the worst
part is george picked this spot
and i have a rug are you wanting to sit
on the rug
i hate all these pictures
to be your user icon yeah i always go
with the golf ball
why don't they just have a solid calling
i think the yin yang is a good move
i mean yeah but it's so like i do go
with neon green
that's my color
wait i have a vacuum we have a really
nice dyson
you guys are just seeing like plastic
and this is terrible
there's just marks on the floor because
it's an industrial space rename them
live in an office oh my god this is
terrible
you guys i think george is going to
return the pink computer i hate
this computer already that's my
prediction
oh login name and password
if they can't see the screen do they
want to see they just want to see you a
little bit
where i'm making fun of my interior
we do have an orange couch and i got a
table but we're waiting for the top to
come
can you guys email high fashion home and
ask them to send my top
yo in before personal army
what's a good laptop to start with i
think this one is this going to be your
main machine probably
oh a piece of crap where's the advanced
settings no i'm returning this computer
i knew it okay i said five days was my
original prediction
i'm returning it where's advanced
you think he loves it one more tour
it's our kitchen got this plant i
brought this
pop back from morocco george and i went
to slab city last year
it's amazing if you haven't been we
saved the slab city hostel
i just got this mirror custom made such
a deal
here's some project i'm working on
trying to get rid of stuff really this
chair is a work of art
there's no tc's here to darkmo
yo they found a dc it leaked
what's a t460 it's a shitty thing
what no but really how do i change my
username who can figure this out
i love when you guys make fun of my
house to make changes
now i can right click and get advanced
options wow that was
terrible so wait should we call it yeah
i did i painted that
you guys like it yes
sleeping on the floor i had a very
expensive bed before and i love sleeping
on the floor
what's in the fridge spin drift for days
i'm also wrapping uh you guys have this
stuff yet
very good
you guys georgie is very tasty
never mind they're done they're not
gonna you know
they got to see the screen until i get
obs installed
[Music]
this is terrible okay there is one
terrible spin drift
and no grapefruit
wood grapefruit's delicious it is 17
guys but
you know do you want to make fun of our
freezer it is just tortellini and ice
cream is it a fudge
oh i mean i'm a fudge bar a good idea
yeah this is brought to you by um whole
foods fudge bars
we did have a pink berry
uh it's not really a rothko invitation
it's not done it's gonna get a lot of
glitter
you guys won't like it when it gets
glitter this is so bad
is there 50 000 in our couch
no just kelly wrestler pillows does
anybody want this green pillow it
doesn't go with this couch
i i brought this rug back from morocco
oh you guys you guys learned about
culture this is tom sachs
your personal fave
george i are watching the sopranos right
now that's what tv is for you want to
see some books
because tato ando is the best architect
yes ren hang is really that actually the
best book here
oh and dictator's home homes is a
personal favorite
um it's a tour of
all the famous dictators houses
george have you ever made your own
laughter when was the last time you made
your own laptop george did i spell
taylor right
t-a-y-l-o-r of course you did
oh good
is that a boob on our wall yeah george
wanted the new mac it's the m1 switch
it's not allowed
i was not born in morocco
george is a virgin boy
looks like a prison cell it's so funny i
love my house
and it makes me very happy
but i can't pseudo but i don't have a
have to give it a password guys i love
my industrial house
you guys probably all live in like
mcmansions at your parents mcmansion's
basements
yo don't insult the twitchies oh who's
this george is married to his code
[Music]
thank you chango you know what's up all
right it took me that long because i
typed
taylor swift as the name
chris george told me i need a bed but i
love sleeping on the floor that looks
terrible
did apple just pay a lot of people money
for these reviews
what do they say
they just keep asking if we live in our
prisons
how many people are watching this john 3
65. because i love our house
this is such a bad experience do i don't
see my ceiling
i should ask again to enable siri
all right
what
no you guys
what is this
get a thinkpad this is a terrible
experience
you're still setting it up i said to set
up three times because i wanted to
change my username it was so bad
because like taylor swift was too long
in the terminal so
it's just taylor oh
taylor it's small
and now i can delete the blah account
see if you don't give them computer
content they will uh
how many viewers do you have
what 37.96
of course they want to you know come on
this is what you guys all dream about
with alex
[Music]
this is what they all dream about
because it's like setting up it's like
how you can set up your environment
because that matters
think i sold at least one gold computer
where's my kickback
all right you know what thank you for
watching tonight's stream
please check out the jobs page
that's alex
cons of high learning rates sometimes
models don't converge they diverge
um
yeah so i'm gonna be setting up a
computer tonight
that's what i'm gonna be doing they
think you're pretty
hey thanks crew
homebrew is shit on the m1 right now oh
i'm bringing it back
send it back i'm setting up for the
weekend streams
bro you got bat who are you calling fat
challenge you to a push-up contest
that's right
beat that guy did i think i could beat
that guy at a push-up contest you think
i know probably your facebook kind of
changed a lot you know
this is a very unflattering angle
that's right that's right boys uh
yeah i'm doing advent code of course
yeah i was talking about i was excited
about it how many tips from mexico city
um yeah i might stream tomorrow
uh you wreck recommend
i'm gonna call this go yeah comment i
slash jobs we're gonna go to it right
now on my new macbook
got a shelf for the jobs yeah
oh yeah macbook change username big sir
would you download chrome
no i love safari i used to fire my
computer it has less battery
yeah which oh it already changed if
tesla's the ios oh that's good
yeah that's good we're not saying
anything more about level three level
three is a lie
no it's just it's just a stupid thing to
talk about the video oh yeah you want to
watch the video yeah watch the video
how the speakers i like combos
specifically
that's as loud as it gets this macbook's
a piece of crap
i just bought the iphone se of computers
we know that we do that the whole time
this computer sucks
like all that stuff about the good chip
the speakers are so much better in my
pro
of course that's why i cost two and a
half times as much it's a budget ass
computer no it's a great video let's
start it over
you can hear it on the crappy speakers
my thousand dollar gold computer which
i'm sending back
i like comma specifically because
we're building something that has never
been built before
so it's the new frontier it's
space exploration what's up oh yeah
okay take three my previous job i worked
at a big company
and if i saw something that
i wanted to give that specific team
feedback on it was quite difficult
to do so just because how large the
company was
with comma if i want to tell somebody
about
something with an open pilot or some
other
aspect i can walk down
to their office and just talk with them
directly
the two things that we look for oh my
god it's me on a stream watching me on a
stream watching
yo clip show you gotta make sure the bar
stays really high
not just for who you hire but also
please keep around i think we have the
best chance at solving self-driving cars
because our approach
involves actually shipping a product and
proving it out as we go it also allows
us to
become profitable and be you know
financially
responsible so we have thousands of
users every day that upload data
and we process those
drives that they upload most of them
within
seconds and all of them within like 10
minutes or something like that
everyone who has tackled the
self-driving heart problem has done it
like the silly way where you try to like
you know put boxes around everything
um and then you uh
[Laughter]
figure out you know what the car ought
to do with some hard-coded algorithm
and like i feel like the whole lesson
that we all have learned in the research
community
is that you should just learn everything
you know learn it front to back
and that's exactly what we do just
waiting for this to install
you know we have a whole stack that
teaches the car
um as closely as we can to just do what
a human would do
imitate the human driving policy guys we
hired actors for the videos
of these people just that we're doing
this
to teach cars favorite employee is me no
no phone detectors here no phone
potentials
that's how we do
have a desire to work
harder i vibe off of that and i feed off
of that energy of others like
wanting to like just only way more uses
paid action
computers
yo guys we actually upgraded to ubuntu
so if you're worried about us uh using
wow look at that guy wow he looks
different all right oh yeah you should
have a haircut wait show them the rest
show them the rest of the website oh
yeah got distracted
yeah wow we set up a macbook just to
show you wait
oh yeah yeah we have like polaroids are
you a good fit
try our programming challenge that's
right if you don't do programming
challenges you're not a good fit
if you love programming challenges you
might be a good fit
no i got an iphone 11 i don't want a 12.
i hear they have worse battery
life wow that's blue
it's really cool yeah
yeah come work at our positions but if
you're a noob don't apply
because we don't hire noobs but if
you're not a noob
you can apply
the new laptop looks weird does it look
weird
it's really big oh all right well
that's the laptop tomorrow unless i
return this piece of crap because i'm
not happy with it
uh we're going to try to get tiny grad
running on the m1 if homebrew works
you think obs
we'll works out we might have a phone
over the shoulder stream
no qt6 no we're qt5 i don't know you got
qg6 you know keep these things come work
a comma
someone's got to build our navigation um
obs works excellent can you do the
program challenge your favorite language
oh you know javascript we need front-end
people
come make our app not shitty uh no
actually really we ask fronted people
one question i'm even going to tell you
guys the question because you can't
really study it
all i say is i go to google.com what
happens
like do you know that if you don't know
that like why would i hire you as a full
stack engineer
you know if i say things like 443 and 53
and dmz
and you should know what all those
things mean that's right
port forwarding um
just run terminal under rosetta
i don't know i'm gonna be excited to
read all the forms tonight about all the
crazy things people are doing with these
new macbooks to get things worked
um you know what all those things mean
that's good let's go i'm covering my mic
i'm sorry
i'm not a phone streamer
yeah you're happy right now
all right we hiring interns for the
summer yeah only if you're really good
we're hiring interns
that's right in january i
single-handedly won seesaw
there was voter fraud
oh wow
you've
oh they pushed it on you if this
computer tries to push any news on me
oh you're in the news emails go sign up
for gray mirror the nihilist prince that
was a good push
so we sent someone off to slay the
dragon a noble and valiant night
but then we found out that he was sword
was 3d printed and he was a 13 year old
fat kid
yo uh you'll be full time next all right
cool yeah you can apply
um give us an email what's the new email
job at comedy
work a comment oh it's like that's
clever
when you go to google the google web
page loads yeah i'll be like alright so
what's that mean
um
[Music]
yeah and they're still not going to do
well
they can practice all they want
and then you know it'll be like synax
synthetic synthetic synthetic and i'm
gonna be like all right
so what's the syn packet look like if
you manage to learn everything about how
the internet works
all the apis how you access in different
languages
congratulations you're a full stack
engineer
i don't think you can study
um front end for what well
you know navigation open pilot's got to
know where to go
sign of x here there we go what's with
the f's
oh it's lagging oh all right alex
i think it's because i covered the
antenna mini extras refresh guys
because we mentioned voter fraud and we
didn't censor it with the fruit
all right um we're iron backend people
too
but we're not really hiring machine
learning engineers i mean maybe but we
took it off the website because a lot of
people think they're machine learning
engineers because they downloaded a
tensorflow example
it's really bad nobody thinks they're a
programmer after they do hello world but
they download like efficient they
download tiny grad and run the efficient
net
example and they're like i'm a machine
learning engineer
yeah oh lagrang i was talking about sin
packets that's right reset
send a bunch of resets what's a reset
let's go
who knows the tcp stack um
everything's in backhands in python of
course it's in python
well we got four or four number users so
even better
what
yeah but he took the question as fun
didn't answer though
will you be getting the ps5 hell no
not touching that thing i did get
a bunch of 30 90s though
so i can play all my games and mega fps
what would i play on seven oh could you
think we can play firewatch on our new
macbook
we should find out yeah people barely
played firewatch
it was only because it wasn't plugged in
oh okay uh
it was plugged in no it was plugged in
but it was only plugged into the the
like 80 watt adapter yeah but this
computer just sips a little bit of power
but it sucks
no like as soon as i heard those
speakers i knew this thing was a piece
of crap
you know what i mean like my macro pro
is a lot nicer
yeah i don't know i still look like
first yeah
i'm saving the box it's going back
i don't like it five days i don't like
it
you know they put all these benchmarks
up about the chip and they're like it's
so great i don't know
well it's really clear by you not liking
it why they made the
nice version all right all right it's
lagging too much thank you all for
watching tonight's stream
uh what or the pro version yeah that's
why they made the pro
i don't think it's better isn't it of
course the crow's going to be better
it's 300 more i probably should have
bought that it didn't come in shitty
pink either
there's only 3 or more oh because it's
13-inch yeah
yeah but then as a fam
you know i just got here you guilted me
with that last time i gotta go i got
computer work to do
thank you bye bye thank you for watching
i'll try to stream tomorrow unless i
send it back then i won't stream
we'll see apply for a job thank you
bye-bye
wow it wasn't working before is it where
is it oh yeah i think so yeah look
because now it's counting off
yeah it just said live before but not
count
yeah um they missed great stuff they
missed me
singing taylor swift that's great stuff
um what else did they miss
they missed me talking about how we had
great stuff planned for today's stream
oh we have a lot of great stuff we have
a lot of great stuff planned for you
guys today
on the eve of jesus's birth is that real
that means even though it's probably
just like they probably fudged it a bit
to make the pagans happy
you know some like solstice shit the
pagans probably didn't get the solstice
that accurate
you know i was like oh december 25th
that's the shortest day
off by four error you know i don't know
i don't know if there's anybody in this
chat room either oh there's someone here
someone's saying hey pretty did my other
stream work or not
oh i don't know
if i wanted to know who you were hanging
with
when i was gone i would have asked you
it's the kind of cold
that clogs up windshield glass but i
felt it when i passed church
still no message all right well we got
some people in here they're only my
subscribers
are you a subscriber oh i just got it
right now oh right now
okay wait did the other one go through
or no no oh i see all right cool
so they can you put their body aching me
if it's all the same to you then it's
the same to me
oh yeah no i told them we were talking
about what would it mean
to write a christmas song today and
the best thing i could come up with is
what ends when the symbols
shatter yeah
we are isolated in many ways this and
this is 2020.
each other the distance between people
has never been further
we have pizzagate believers and we have
climate change believers
pens and eyes you know whenever there's
deniers of something you just you just
wonder
what do you wonder is this the place
we're getting bagels
no no one's even know that no one's ever
been to the world
yeah you know i'm not we're going to
goldbergs
well you're going to goldbergs nuffy
says hi hey george and alex
merry christmas georgie alex is pretty
poop we got good quality comments this
morning quality
what does it feel like to be rich and
powerful oh wow
how clear is it that you're both open um
that's very unclear we're not relative
like we're grateful
you know are we grateful alex this is
just some damn thanksgiving
i think gratitude wow you're on your
you're on your thanksgiving
ah this is goldberg's i help yourself to
whatever you want
i'm good i ate i ate waffles this
morning
we now have plant-based bacon and
plant-based sausage the fuck
uh what's the temperature here in cali
bros we ain't in cali who can figure out
where we are
i don't know who can figure it out what
town we're in they don't know
do they
san diego's and cali love the commitment
to streaming thank you
why aren't i wearing face diapers
because grows
you know i say this stuff i say this
stuff and it's just shocked it shocks me
with the political hate man
you know what do you think you're gonna
do you're gonna be like george i
i you should stick to programming you
sound so dumb when you talk about masks
do i or is that a rhetorical
tactic you may not even be aware that
you're doing it
the people who do it may not even be
aware it might just be so second nature
to you
um you know i'm gonna quote the taylor
swift documentary
uh you know taylor swift came out and
talked about politics right
and what you found is that a lot of the
republican commentators insulted her
intelligence
not her ideas but her intelligence you
guys are doing the same thing right
um so no uh bad news for people who
thought masked
did something they don't but they're
probably not bad
uh but the good news is the good news is
following up on coronavirus things
i was i was i was surprised that uh mrna
vaccines seem to work
um my non-medical advice is don't get
the moderna or the astrazeneca get the
pfizer
i don't own pfizer stock i tell you if i
did anti-maskers anti-maskers oh no
see you guys making you know you guys is
political loser shit
not political read the studies and don't
tell me the studies about how far the
particles go
show me studies that actually study
virus transmission in the present or
absence of masks
um but we're not here to talk about that
uh we're also the people who tell me how
i should use my voice
uh here's my thoughts on being canceled
and i'm gonna quote lil wayne to you
guys right
uh hype training coming all right we
know people know the truth man
uh this is a lil wayne quote uh when
you're great
it's not murder it's assassinate
so assassinate me bitch cause i'm doing
the same shit
martin luther king did stepping in the
same hotel in the same sweet bitch
same balcony like assassinate me bitch
that's how i feel about that you know
people are so soft today
watch the sopranos you know i feel hard
man jersey
homer tony soprano this man is a menace
someone needs to stop him
uh lil wayne is going to jail can we
pardon wheezy
we don't need to pardon paul manafort no
no no no we need to pardon wheezy
and i'm coming out you know what you
know who needs a pardon
ross albrecht because if he really did
murder for hire the government would
have tried him for that they knew it was
some fake ass case
all he did was make it safer for people
to buy drugs ross albrecht is a national
hero and he should be pardoned
that's right well taylor and lil wayne
are very similar people they're both
breaking boundaries
pardon wheezy that's right pardon wheezy
you know
uh we gotta wait we gotta wait for alex
uh at the bagel store and shkreli
how could i forget park shkreli uh
ross albrecht and lil wayne top three
pardons right there
um thoughts on jail oh well i don't know
i like to do an internship low security
federal if someone could make that
happen i'd like to do three months in
low security federal
just so i could say i went to jail man
it'll improve my rap career
uh
yo ross made me rich off bitcoin yeah
um
look man he actually set up people to
have murder people murdered
that's not cool but you know that's not
what they tried him for
so you know uh draw oh
guys the is the jonathan blow album uh
language i've seen it a little uh i
don't know i've never looked at it yet
i mean all i want is python but faster
maybe a few cleanups to the python
syntax
uh highlands north carolina no
no it's not oh wow alex is really taking
a long time she must have got something
fancy
you know um no bug bounty
is a way to take all of this hacker
revolutionary energy
and feed it into a shit to your
corporate system you know
and i'm not saying like don't do it if
you're gonna do it though do pawn to own
and then you get your message out there
don't do bug bounties you know privately
they slip you the money under the table
that's what the corporations love man
the corporations just want it all to be
kept under wraps all kept quiet
we don't want to keep it quiet we are
revolutionaries boys
we're revolutionaries you know but don't
be an obnoxious revolutionary who goes
around talks about how he's
revolutionary a lot of times
like a mortal technique but now mortal
technique's cool so i don't know why i'm
just an immortal technique when there's
so many better rappers to diss
like drake who used to be good said
things like
um when it falls apart you know i'm
still down
to pick a million tiny little pieces off
the ground where she would learn to love
people and use things and not the other
way around
that was all drake let me tell you about
new drake it goes
left foot slide right foot slide
i don't care which foot either way we
about to slide
and then a bunch of grunts and moans
now we like a model technique and world
technique is actually pretty cool
um drake's good song from old drake
yay a poundcake music in here um
they should put a couple more mirrors in
here so i could stare at myself these
are usually just some thoughts that i
would
share with myself but fuck it i figure
it's worth it to share it with someone
else other than paris for once
i text her from time to time she a mom
now sometime
that shit forces you to calm down i told
her she could live with me if she need
to got a compound but i think she's
straight
uh oh there's a new m m album the last
ones you know tucson leather yeah
yeah yeah little dickie i like little
dicky back in the day
professional rapper you know what a good
sentiment
um i do uh
own a company owns a strong i work at a
company
um yo we got some we got some crazy shit
planned for 20
21. you guys aren't going to believe it
you know let's talk about some comma
shit
so at comma we have a i can't call it a
super computer i call it a i call it a
super computer i just can't call it a
data center that's right
we have a supercomputer that's
equivalent to one dog
we have one dog's worth of compute power
one dog's worth of compute power
draws 50 kilowatts and costs half a
million dollars
how crazy is that next supercomputer
we're going to have one human worth of
compute power
and this is why home robotics never
happened i'm predicting a huge decade
for home robotics this decade but right
now you know the comma two it has
equivalent compute power to a b
could a bee be a maid i don't know could
a mouse be a maid
i think disney made a movie about that
yes so we need a mouse worth of power
but a mouse is about a thousand bees
so we're gonna need you know we're gonna
need a thousand snapdragon 820s or maybe
um
maybe four 30 90s
sorry a100s what
we're going to sit on the bench you want
to walk oh you want to sit on this bench
no but there's too many people around
this bench
i don't want an audience can we go if we
go that way more because
there's better bench by the library it's
got to be closed what do you think
it's two blocks okay can we wait two
blocks yes
block a block of locker should you trust
a b to drive your car itself i mean you
can trust it for little things but i'd
always be watching it
what wait is this the line for mark's
cheesecake
no way that's wild man
mark's killing it today do you do like a
free cheesecake or something
wow mark you know oh we got the hype
train back level two hello everybody
5.99 viewers tis the damn season
what i'm gonna go sit by we can sit by
city hall
this was pretty nice maybe it's a nice
guy uh the corruption must be somewhere
else
this town's very corrupt property taxes
be so high
how cold is it out here it's not like
north pole alaska which we watched
recently on the diy network
great channel by the way guys discovery
plus
starts january 4th it's only 4.99 a
month
you can watch all your favorite shows
including
extra 90-day fiance content
uh i just i do it for free boys
discovery's not paying me though i did
see battle boxes back
we were watching battlebots last night
and some people were in masks so it was
probably pretty newly recorded
yeah this train goes to new york so
there's that one
the bus yeah the bus goes to new york i
mean that's kind of the only places to
go
level two complete oh all your hamsters
thank you for subscribing everybody who
subscribed
thank you for subscribing we appreciate
you
if you didn't subscribe we appreciate
you less
um and wise and quarantined bro
all the quarantines are optional this is
america you have freedom here
not reeling i mean this is why
that's really cute all right well
you can go to the library with a bench
to sit on
yeah the mask is optional well no look
someone can kick you out of their
private business
you know what's up there uh if you're
not wearing a mask that's their property
don't violate someone's rules on their
property
but this is outside man no one owns the
outside i'm a free citizen of america
uh did i like evermore i loved evermore
much better than folklore
taylor swift really refined it on
evermore
um coney island and tis the damn season
also uh i think he did it but he just
can't prove it you know that's that's a
good that's a good
thing what do you mean
look how nice it them look at this oh is
they put little
ships on it yeah well
it had to get bigger glen rock is a
growing town that's a lie
oh sketchy gloves
um all right uh
you know it's just you can't believe it
bro you know who's worse than masked
people political losers
that's right uh
we just promote science and the truth on
this
what have you been channel them about
freedoms
no what else were we gonna talk about
today um we had great content plan i
forget i quoted the little wayne crow
about being cancelled so assassinate me
bitch
no we already talked about the comments
okay haters have already been addressed
haters know their place oh yeah no they
were mad that i was saying that
being rich is a state of mind but it
totally is
i think you know how would anyone doubt
that it's definitely true some people
have a ton of money and think they're
poor and some people don't have much
money and think they're rich you know
that's right tis the day of season you
know
don't show you eating i'm gonna be
self-conscious all right all right i'm
so self-conscious
so i already see me at least one of my
watches um
if naval said that he'd get a million
retweets i'm not a thought leader
oh they missed my thing in cvs you know
what's the difference
between me and a schizophrenic homeless
man
i have 592 people watching me
is a good job
show food can can you show the food i
want to see the food
all right sandwich and chips what kind
of chips are that
what i like no you wouldn't do that to
me you wouldn't do me like that
i thought later you come out of here
with freedom
freedom doesn't mean you have to agree
with me all freedom means is that you're
doing what you want and not what someone
else wants for you
is it christmas tomorrow it's a train
yeah look over there
i'm turning into terry davis day by day
turning into terry davis day by day oh
no boys
i'm predicting two things for the next
decade
one personal robotics and two
augmented reality the 2020s are going to
be a great decade
the 2010s shit decade
did you tell them about them well they
really were like
no you guys if you want to watch a great
show it's called cleopatra 2525
it's about the year 2525 when robots
took over the surface of the earth
and they're forced underground
and these three women are on a mission
to fight back and one of them is
victoria pratt
who still looks very good even though
she's 50 and she just came out with an
adult
novel which actually got a 4.5 stars on
amazon and
very good reviews we're still live
reading i'm excited to read that book
i talk like an ad i don't even get paid
for any of this shit
do you want to be free no because then
they'd influence my decisions
and that would affect my freedom i know
if i leave everyone and you know what we
value on this
we value two things on this stream we
value freedom and truth
now those two things are at odds
sometimes
and if they're at odds truth over
freedom every time
truth over freedom every time yeah i'll
quote old drake
truth over fame you know i respect
blatant shit
i'll quote new drake uh
uh uh sometime we laugh
sometime we cry sometimes we do both at
the same time
wait really no that would be too good
but it is sometime we laugh sometimes we
cry and then the rest of the line is too
stupid that i don't even remember it
on the stream what kind of sandwich you
got
what's that piece of bread what kind of
challenge you got
just a veggie sandwich do you have any
sauce on it uh-huh no it doesn't you're
lying to me so i don't eat any of it
what kind of sauce
oh i love vinegar i'm gonna have a bite
just a bite
wrong good thing i got my jaw
dysfunction fixed to physical therapy
you can't eat on your stream you have to
have decorum and all i said to you
all i say to you is what ends when the
symbols shatter
um can i have another bite
just one more bite i didn't even get a
good sized bite
there was too much wrapper in the way um
oh no i want like that i want like a
good like diet of all the veggies and
stuff
my lunch what i just want a bite
hmm
how to backup consciousness you know
what you know what dating is like george
do i know what dating is like i'm dating
you
no i've never dated myself
yeah you want to you want to tell them
about it
don't worry they're all men i'm not
worried about the bad things you're
going to say about me
you just have to be prepared to give
george half if you have
be happy all i ask for is half that's
all i'm saying
if you have something you should be
expected that george gonna dig out of it
hey that's a reasonable taxation rate
you know
many countries are okay on 50 taxation
rates if you live in california you make
a good amount of money they take half
right dating george is just the man
always wants half
[Laughter]
50 too much what a nightmare
you are cute she is cute isn't she i
don't know why she puts up them
uh am i moving to texas no no i'm never
moving to austin or
miami every time a thought leader says i
want to move to a place i want to move
there this much less
and this much is add up a lot miami um
we live in san diego it's a nice place
i want to move the company to a mansion
whoa you can't say it's about taxes you
say it's about taxes california's going
to take your money
move to canada i hear there's only
rednecks in canada the only things i
know that came from canada are trailer
park boys and victoria pratt too cold
for me
i like the sandwich better than the
chips thank you should we get another
one
no we're gonna walk to another place
when we'll get something there deal
all right we gotta get moving you guys
start walking
yeah we got hours to go here miles
should go before i sleep
miles george said he would never marry
in an interview
were you married i respect george's
wishes always
we get married are we getting married
are we maybe
maybe tune in to next step tune in to
the next episode to find out ready for
fake drama
first we have to get to an island
um first we got to change the marriage
launch to an island with other singles
[Music]
you see gay marriage went the wrong way
you know how they gave gays the right to
marry they should have taken the right
to marry away from the straits
that would have been good god therefore
told me he saw me on love island
you want love island that's pretty cool
should we move to mars star family yeah
no george has strict policy i'm going to
mars that's right
until there's five star hotels he's not
going oh i got you something
we got one smart water for us this i did
know you were gonna have 50
you're so thoughtful that's something
i'd have two thirds of
[Laughter]
yo it goes by body weight wait what's
dirty and we what's twitch censorship
i'm not censoring anything
a lot of those people who complain about
censorship
if they just wanted to you know look at
alex jones he owns band
video he loves that shit he wait he does
it to get banned
of course great for advertising okay
free advertising you guys
you do understand gillette decided
gillette tried to intentionally trigger
you
should we make a triggering piece of
content for comma no like like remember
the gillette
like like jake ad campaign like gillette
was like we're losing to dollar shave
cub
club we own a failing razor company what
can we do to be relevant
trigger a lot of people it's just pita
it's the same tactics peter used
peter's really toned it down i know
peter peter looks reasonable now these
days you know
did you talk about the decline of
science we've been talking about oh we
have been talking about the decline of
science that's right
has there been any new science since
1970 not talking about new technology
you know this mrna vaccine explain what
the difference between technology and
sciences
science is the new idea technology is
the new implementation
has there been expose on yo
like wow wow no i mean his bosom was
discovered through technology but it
wasn't new science we knew exactly where
it was it's the same shitty standard
model
which takes 43 arbitrary parameters into
it
neural nets no string theory is
completely bogus it's not science string
theory's never made a testable
prediction as far as i know
neural nets are the closest we've come i
think
i think neural nets are like we now have
an understanding of what learning is
um it's like when did humanity learn how
to fly
when did we learn what flight was we
were sure some guys took a bird apart
a thousand years ago took a bird apart
they
they're just apart birds everywhere
davinci davinci is well known for oh
yeah davinci
exactly yeah like da vinci yeah but it
wasn't until the early 20th century when
we actually made shit fly that we
understood flight so today we're gonna
make things think and then we're gonna
understand thought
axions what are axions do you mean axons
or axioms
are we worse at doing science no i think
the universities have seriously declined
after 1970.
okay
i mean i think the whole the whole like
we were just talking about really how
i have a controversial question do we
think that ethics
has has
inhibited our ability to study nature
i've said this i mean i said this is my
new yorker interview back in the day i
think that
like ethics aren't real there's no such
thing there their
ethics are just a a something to
browbeat other people with
well they may not be real like morals
are real you can have morals you can
have a moral code
but this idea that there is a universal
ethics
that's just it's just like you know it's
it's even stupider than religion
right like religion at least has a nice
like unifying effect to it and we can
all eat the cracker you know
um the wafer wafer drink the wine eat
the wafer look man
i'm a christian you know i believe jesus
died for my sins jesus
and when alex doesn't you know you know
about jesus
let's talk about the j question jay
question the jesus question
the answer is yes um
are ethics and morals the same thing no
morals are individualists and ethics are
where they lecture you in a college
class freshman year with 300 other
people so you can learn how to be a
good person i want to talk about the
monkey study
you know there's a lot of signs that we
wouldn't be able to do today because
we've tested on animals
well that's peter's problem peter's like
the news but worse i'm curious
i'm curious you know and i'm strong i
know but
i wonder if science has been inhibited
from that
i think it's possible yeah i think that
that that you know look i mean and you
know like google's going to fire their
ai ethics team do it google do you think
morals or ethics are necessary wait
elon's testing one on pigs
oh yeah he is oh he's testing the uh
he's testing the neurolink on pigs how
did he get away with that
he proved he doesn't cause many hearts
he wants tweets on twitter he's like
pronouns wow you're stupid and people
are like elon you can't say that and
then he does
imagine trump but smart
yeah we did why i'm saying world war ii
is probably the last time
yeah um we're gonna test the comma
too we hit the limits of intellectual
capacity of humans i mean that's true oh
that was another one of my recent like
analogy thoughts
take a super computer from 1980 okay and
now put it next to a super computer from
2020. okay you can everyone can tell
which one's better
you take the smallest child and they
could tell damn that was good
right now do the same with people strip
them down
you know and put a 1980 person and a 20
20 person
the 20 20 person is fatter and stupider
only a little but yeah like a top
marginally on average
a tiny tiny amount yeah dumber yeah a
tiny amount dumber but you know those
tiny amounts add up they're a little bit
dumber and a little bit fatter
the tiny amounts do have yeah um so like
who are you betting on long term
the flint effect stopped a long time ago
guys dude
reverse the flume effect was mostly due
to malnutrition
20 20 person does have a phone that's
true but again
i put phones firmly in the uh computer
camp
i was thinking about the question i had
about can you teach someone how to
google
you think henry viii was clever yeah
probably died divorced died die divorce
survived
six wives man boss boss
so now people people still die of
starvation not in america they don't
when's the last time someone died of
starvation in america
i'm just glad he didn't mention africa i
feel like people always do that when
they mention starvation
i mean like again africa is a large
continent
i'm sure there's many countries oh man
where nobody's stalling do you want to
play golf no one's starving in egypt and
south africa
probably no one's even starving in kenya
and ethiopia
i would love to actually know the exact
numbers if you go to like south sudan or
the democratic people's republic of the
congo
maybe maybe things don't look as good
but you know
a lot of questions what are you
listening to you're listening to just
chatting
leibniz at some time was said was the
last man to know everything he never met
terence tao i hear that guy knows
everything
uh tis the damn season if phones are
comparable to technological implants
oh yeah yeah the dude's gonna have brain
implants but again you've got to put
that in the machine camp
probably starving right if i could bet
on man versus machine
you said there is a new science how is
tech any different
uh well so my distinction between
science and technology is technology the
implementation science is the idea right
you can come up with you can't come up
with the idea for an mrna vaccine in
in 1970 you could you know
they had the central dogma of like no
biology they had all that stuff right
now did you have like the dna technology
to do it no probably not
right the idea for attack polymerase
came way before
actual attack polymerase like how they
had ideas for early computers in 1800s
what are my morals i learned morality
from captain janeway of the starship
voyager
so same as harrison
um talk about opening the cathedral
what cathedral are you referring to
oh yeah alex we're going to try orbit
should we chill for urban on the streets
we're gonna do it should we do an art
stream
i would love that oh we should do our
urban stream will be legendary
let's do that you know you can talk
about you want to talk about your
relationship with irving
i love birmingham just your relationship
[Music]
the average iq is 130. this remains to
be seen to use
did you just say what do you think the
average iq1 is oh at least
yeah that's what i'm saying right um so
yeah we'll find the last more people on
the internet
they're just in an enclave if it's
accessible from a mobile phone it's full
of idiots
what's the average mobile phone user
internet iq versus desktop
yeah and then i'm sure with operating
system you know
[Music]
uh no what do we got did alex like
working at pop sugar
that's a great team uh where is this
place they do have train in america they
do on the eastern seaboard it's joe
is our is curtis yarvin a uh flashy
crackpot or a genius
i'm putting him in the genius camp wait
chris is genius
alex jones goes crackpot
charming charming he's trying there's a
lot of terry davis was a charming
crackpot
yeah he was no rest in peace you know
nothing not trying to rip on him man
terry davis did more for humanity than
99 percent of people
curtis talks
yeah like the man has no filter and like
you know it's charming it's charming
um rip joe rogan what happened to joe
rogan what happened
oh yeah yeah you canceled joe rogan you
know
you know i think there's like a star
trek episode where they fire the weapon
at a ship for the future and the ship
from the future uses the deflector dish
and blows the other ship up yeah i think
that's what happens if you try to cancel
joe rogan
oh yeah ho ho ho yeah yeah take take
thank
you it's gonna
okay can you guys see
wait hold on
where's george where are you i hope you
got on there
hold up yeah no it's good it's good
ring elon musk and gotta know i can't be
on rogan boys
too much heat wait how many viewers we
got
oh 662. how do i get the chat back what
happened
show a chat yo yo yo george should take
over the temple oh last budget i tried
coding in holy see
it was just too much for me man it's too
much
gotta be on a level well i'd be better
than having a code last night so i'm in
a better mood
but it was competitive this year
tonight's last night
yeah i'm in a lower place yet i have
more points
do you know original santa claus was a
skinny guy
there was a good family guy gag last
night
oh santa hey you're trimmer than me i
really got it i really gotta look at
myself
uh fresh prince of bel air is underrated
what i don't know
all right boys that might be today's
stream
got any plans for mars five-star hotel
um 2021 goals comma's got a lot of goals
so we're busy
comes got a lot of goals you know we're
gonna hit close to the beginning of 2021
we are going to have made more money at
comma
than uh we raised
and that means it's time to raise some
more money
start doing some big things i think it
might be time
i think it might be raising money time
next year boys
so if you want to invest in comma have
two million dollars ready
uh and get on board with the future yo
you guys comma's not
we're going to solve self-driving cars
you think we're going to stop
yeah you're going to listen you think
we're going to stop self-driving cars
and stop
no way com is a personal robotics
company
you've seen rtc
spot controlling ownership of boston
dynamics oh hyundai
hyundai's is hyundai is with the future
you know
i mean hyundai is going to find out my
friend works at boston dynamics and
they'll you know
look i love boston dynamics but they're
gonna find out when they ask the ceo
they're like okay so what are you gonna
do to make money
the ceo's like what
hey good
ah why don't i have a bodyguard
she's strapped always when i hit the
glove
um that's a lot of movement
bouncing them up and down yeah
are they gonna get sick i don't know
motion sickness from this rollercoaster
ride we call twitch
you know what i need a small drone
maybe we value human no actually there
is something about
you know what it is no no no no we've
established
which values i think one thing
narrative
[Music]
what do you mean no no i will totally
take society ending with a really cool
narrative than the truth
oh my god what that's i'm a narrative
guy
narrative is my terminal value
you know and i mean yeah and like
narrative as a terminal
value is like you can get wire headed
but at least the wire heading machine is
complex
you know yeah i think i think i'm okay
with that i mean we're all going to end
up wireheaded i don't want to end up
happiness wire-headed because happiness
is simple
narrative is complex if there's a
computer with more brain power than me
writing stories that entertain me
i'll take it
[Music]
guys i'm going to merge with the machine
and live forever calling it right now
you know i've been saying it the whole
time i know you're consistent
it's been my destiny to solve ai since i
was 15. don't you think
i mean i know i'm going to start saying
things like that we're going to see if
people are okay with it can't be for
that
no it just sounds a little like crackpot
that's right we write our own the future
hasn't been written yet
i'm pretty sure even hallmark f
transhumanism gang
just jailbreak reality when will ai take
over wall street bro
too late you think it's coked up macho
dudes now
i know the guys that work on wall street
hope they've done cocaine in their life
what else we got um
free will has played out free will was
never real it was never real
it was what it was what's that it was
real the whole time
it was real the whole time oh my god
we're going to find that out about free
will what a narrative twist
that's worthy of night shyamalan who do
we want to write the future what's up
with your side
when will computer science be a useless
degree the better question is when will
the average human
born have negative utility we talked
about that right
what do they think no i don't know like
have we already passed that point
with the average human we put more
resources into them than they generate
um you know like how easy is it shit man
if i worked on a farm
i'd be super psyched to have kids you
know why because i'm sick of pulling my
hoe
i got five kids we're gonna pull five
hoes we're gonna grow the farm
you know those acres over there that we
haven't uh ever ever uh grown crops on
we're gonna do it now once we have the
new kids right today the only reason
people have kids is vanity projects
they're money losing vanity projects
i don't know kids are money losing
vanity projects
wow children money losing van you know
what else that's the quote
i like someone ella tweeted
uh we like ella
oh yeah no i shield for her one of my
streams okay um we like her
is she controversial what'd she say
some of the race stuff i'm like oh i
don't like
you know what you know who talks about
race racists man
you know like the new york times a bunch
of damn racists
oh she's no no that's too bad um
that's too bad you know just cause we're
not pc
doesn't mean we're fucking racist man
don't be a racist racist or loser
no they really are we'll talk um
yeah you know great racists like jesse
jackson and al sharpton you know
sexist like the buses in mexico
george is upset about the women only
section on the buses in mexico the buses
are sexist that's all i'm saying you
know
we had rosa parks and we overcame this
in this country very reasonable
well yeah because they have crime which
i'm not okay i look forward to the day
[Music]
when i'm mayor there's gonna be no more
crime we're gonna make it illegal
they should have said when crime against
women yeah and when
and when and when we have equality
affirmative okay
okay i mean that's fine when are we
leaving code purple when do we not have
to wear masks anymore you just have to
have
you know strong
i boundaries gone i would have asked
yeah well that's because they have crime
they should end from it's legal crime is
illegal
um no i was unimpressed with mexico
mostly because it was 655
and i ordered a beer and they're like no
we stopped serving at seven
and i'm like yo it's it's a trash day
ciate
a truss does that mean before your
spanish lacrosse
ah
i don't like to stop
how many languages do i speak only one
unless you count programming languages
well then i said no python and c plus
plus does not and python is c but not
really anything else yeah it's just
python of c
that's the only languages i really know
you know like a lot of people talk about
all these languages they know and then
it's like okay now you can't use the
documentation
but i still have to use the
documentation who remembers what an
iterator on
you know whatever whatever it is am i
shorting nicola we should
yo all those spacks man nah we're gonna
have more space in 2021
spax are the new ico except it's even
stupider
like at least icos there was an excuse
they were kind of unprecedented
everybody should know better about spax
the sec should know better about this
heck how is that legal the sec must be
making bank off specs
what's the only thing that makes sense
right i mean we can
yeah it looks more dry over there
all right boys
future of binary exploitation no
guys you know all right we'll end with
this this
is a good one uh-oh hacking
why because you know you're moving
something no i gotta move
i don't want this okay almost
uh look hacking
is about pushing boundaries
binary exploitation is not hacking
anymore
it's just a weird useless skill you know
hacking used to mean making furniture
with an axe right the definition of
hacking changes
get with the times you can't do the same
shit and be a hacker it doesn't work
like that
that's why you can never
institutionalize hackers
facebook's on hacker way like can you
guys believe that shit
and like in 2005 it didn't look actually
that stupid
because in 2005 being a hacker was
setting up a linux box
and running your lamp stack you know
yeah that's what being a hacker was in
2005.
what's being done well i mean
if it's trying on our next stream we're
going to prove that on our next stream
scheduled content um what we could
stream from my house without the
internet
maybe when we get the sick new routers
new router
look i mean yeah that's that's hacking
with the parentheses of a different time
right i mean what is there to hack on
today i just told you
wow no carpet is
urban is something urban is a is a great
experiment in artificial difficulty
yeah yeah what is life what is modern
life
modern life is the conquest of
mars robotics and augmented reality
uh we don't think mars by the end of the
decade no definitely
yeah carmack carmack really killed you
know
we were all talking about mars by the
end of the decade and then carmack was
like
all right so who wants to bet 10 grand
everyone was silent pretty fast
oh um do i get mad at alex about
programming
issues i'm in a bad mood when i do badly
dive out of code
george no never
as long as i get 50 50
let's call it the great reset oh my god
i read that on some conspiracy sites
you guys there's no great conspiracy
it's the same people it's the same
people oh my god it's the same people
who like think like trump was some evil
mastermind
he's not well they now think but now
it's the other people who's like biden
in the deep state are evil masterminds
no one is an evil man
[Music]
oh alex
maybe the clinton's parenthesis 1998 but
hillary clinton couldn't even beat
donald trump in a free and fair light
what
all right wait wait do you have can we
like wait for the wind to come up and i
can have that wind blown hair
we're live on scene here in glen rock
new jersey
the weather's so bad i can't even hold
the camera still
don't do that that's right john how is
the how are things over there back in
detroit
back at the news station oh they're not
like this oh they're not like this you
say
oh yeah all right end the stream already
yeah what i could be a weather man
well not all your dreams are possible i
also can't be a pro football player
i realized that really early on when i
was like the second to last kid
picked in football do you think you're
seeing everything now all right all
right guys
thank you all for watching merry
christmas
happy hanukkah kwanzaa i don't care what
you celebrate
as long as it celebrates narrative truth
and freedom our core moral values here
on this stream
and alex throws love in at the end and
team kanye
team kanye was talking about love always
i'm team taylor swift i believe in her
idea of complex love
thank you all for watching merry
christmas everybody
okay
let me bring up the twitch chat on my
phone here
that's how i do the one one computer
setup well i got my laptop with me you
know
what's that drake line i've been living
out a suitcase
uh you have a suitcase y'all got a
backpack so we'll talk
i'm gonna see how well the stream goes
what so how do i
go to my channel my channel
live to organize the world's information
hopefully everyone recognizes uh
what that line is from
drinking salt water coffee
probably google that and figure out
where i am
all right we'll give people a minute to
show up it's going to get hot in here
we're going to turn on the air
conditioner
and it's unfortunate because the air
conditioner is loud
so you get a choice
between you know it being loud
or it being quiet
all right so does everyone recognize
where the line comes from
organize the world's information
what's up it's google's corporate
mission statement
uh no it's not an asmr i did a lot of
yelling last night so i
lost my voice a bit
um
my kitchen i guess my kitchen's behind
me
i'm in a new place you guys always stay
uh on the movement and i'm gonna promote
and this is actually the first
i search for how to drop out right
my first result is wikihow
tradeschools.net
this some seo blog
right eight ideas like like like it's
until we get down to this one i mean
this is the first one that i think is
written without an agenda and
actually let's go back and let's confirm
that i'm not i'm not talking out my ass
we're gonna uh
i'm gonna bring up some of these other
ones and you can tell um the difference
of the looks in the website so let's
click the top one
right so compare the look of this
website on the left
to the look of the website on the right
right
i don't want websites that look like the
one on the left i want websites that
look like the one on the right
almost look at this one yeah exactly
if a website has um
like tweet save i don't want it right
how is it then in the age of beautiful
artificial intelligence
google's top results are this trash
um now there's three hypotheses for this
that i come up with quickly i'm sure
there's more
uh one is this is what people actually
want um and i'm most inclined to believe
that that's true
because you know it just just that's
that's like occam's razor
it turns out people actually want things
full of like
spammy ads and up see i scroll down well
look there's a pop-up wow am i surprised
no you know what i'd be surprised if i
scrolled down on here and there was a
pop-up
i recommend using thetradeschools.net
because you can find the program that
you're interested in
nearby or online right um
so hypothesis number two
is that google is somehow uh
making money off of this somehow like
this website
is leading people back to google or
maximizing some metric that google cares
about
at the expense of its users
hypothesis three is that google cannot
tell the difference
right and like look at these two
um let's so we have cora
um cora is it's it's unbelievable
how korra does this i will never sign up
for a core account
never korra would keep me on their
website so much more
if they didn't do this crap but they
continue to and like
that's a question for cora um
hypothesis number one is that uh this is
actually what people want
right uh let's see this one
this is better slightly better
um this is the kind of person who maybe
today is like a digital nomad you know
digital nomadism is a ponzi scheme
uh with the guy who made nomad list at
the top
it's not what people want well so let's
talk about the definition of people
certainly not what i want and it's
probably not what you want fellow people
in chat
um so let's see this one
i can already tell by how long it's
taken to load it's going to be trash yup
total trash
let me get to a medium article a medium
for the most part actually medium itself
as a company is becoming more
they're trying to monetize your content
it's shocking
uh try swisscows.ch
instead
wait are you kidding me this is
supposedly a good website
and we have this at least
at least when i go to google.com what
are they showing for local businesses
they have one shill line for whatever
bullshit you know
i don't know how google chooses this but
for the most part
um like google is a good website
right google hasn't become well let's go
to uh one of google's competitors
oh my god really i'm hearing something
about fox news
be afraid i have to look at a picture of
donald trump like are you kidding me
if there's a picture of donald trump on
your website it should immediately be
seoed way down
um well but to be fair let's let's let's
give
this a try even though i can tell
already from their website did i put it
in quotes for google
i did put in quotes for google um
to wikihows and then the one i'm looking
for okay that's actually slightly better
but like
really uh uh an image ad
um
gotta install the internet explorer
toolbars
uh all right let's see duckduckgo
uh duckduckgo is the same as this so i
mean it's interesting by the way to note
the ones that are different on google
uh so
the wikihow
here's an interesting one
how come on here the top one for both of
them
is how to drop out of society and here i
don't even
see that result
interesting
um now my dna sequence is yeah so the
problem with ordering that is i need to
ship it to an address
and you know i'm a nomad so i'm sure
there's some good solution for getting
shit
actually i have an address now for a bit
so i can ship it here
google doesn't want you to drop out of
society like i think that's a little bit
too sinister
uh go incognito i this is a i don't
i don't have browser history
i i wipe the cash i wipe it for you guys
it's the same
um because we live in a society and they
don't want gamers to rise up
i mean like wikihow's not a good website
the new better private search
what makes a good website i mean
well let's talk about some things that
make a bad website right
it's pretty easy to talk about things
that make a bad website right
and a lot of it you can tell by like
what is the
i mean really what you want to get at is
what the intention of the creator of the
website is
okay if the intention of the creator of
the website is to straight up
monetize on you right now like
clear clearly the intention of
tradeschools.net
is to get you to click put your zip code
in here
and then shill you on you know
continuing education opportunities right
so that is probably trade schools.net's
business model so the intention of
creating that content is to feed the
business model
um showdown.aya
oh no this is isn't this like i can
search for like ports and stuff
i've used that um
one without javascript frameworks that's
a general correlation but we shouldn't
immediately rule out any website with
javascript right
what i really want to get at is what is
the intention of the creator of the
website
if the intention of the creator of the
website is to sell me something then
like if i'm being put if the web page is
just the first one in a funnel
and the only reason this this web page
was created was to increase the size of
their funnel
i'm out so we can we can rule that out
that's a bad website
um another example of a bad website so
this
it's it's less clear exactly what the
call to action is here
um well actually no we have the call to
action right here you you can tell
you can tell a lot about a website just
by looking at its call to action
so this guy is trying to get people to
sign up for his newsletter
uh and then through his newsletter he
probably monetizes in in some different
way
um oh here we go
i'm sure his teach yourself anything
bundle is free but you know
when you realize that anything doesn't
include the thing you want to learn
he'll sell you that bundle for just
um 3.99 a month
more uh i
don't have access to the gbt3 api
i didn't sign up for the beta and i
don't think openai likes me
for various different reasons
so i don't think they're going to give
me uh access to the beta
so how would someone continue to make
sites if they can't make money all
sites have to be written by someone with
a day job i mean no like you can look at
geohot.com right
you know here we go like i made a
website and like it's you know i joke
i chill for my instagram my rap career
uh little link to comment ai there but
like you can look at this website and
realize
maybe another like metric that you could
use and kind of like an adverse metric
is like how unique your website is
right every
good website like they look
different but they have a similar sort
of
maybe another thing that you could use
to judge this is how much
time was put into the content creation
right
um
you can access it through ai dungeon oh
cool
uh
how would you track this i mean so
there's a lot of ways today to do it
i could train a model on on uh
i could train like a comm net on on a
screen grab of the website
um but so part of this stream the point
is if you notice the name of the stream
is to organize the world's information
google has become terrible
uh and the the thing that really drove
me uh
over the edges i'm going to iceland um
i'm going to iceland in a month and at
the border in iceland you have to get a
chronovirus test
right um and i i typed the following
thing into google
does the border covid test
in iceland hurt all right i want to know
like what kind of
what kind of uh
like
this is different i think i phrased it
slightly differently last time
the first results are um
are uh icelandic so these are the top
two are government iceland
um and then it's
news right
iceland coronavirus test has its
skeptics but it may be working
right what i'm looking for when i type
that in is is i want an
anecdote i want an anecdote of
uh yo just cross the border in iceland
test hurt like a bitch
right um yeah so you always search
reddit so
let's see if we can do that site
reddit.com
uh
i mean that's interesting in and of
itself
does the border covid test iceland
nothing
in iceland yes it's like
you know you just wonder what their what
their algorithm is anymore
um so again this is people commenting on
a
news website news is a category
another thing that i'd like to do with a
search engine
is um another way you can tell that this
is a better website then then here we're
going to bring it up and we'll see it's
going to be bad
you can tell that this is a better
website than this
is this website has been up in a very
similar format
for 16 years
um and it has relevancy 16 years later
if something is still relevant on the
internet after 10 years
it's a good website this thing
is going to have a traffic profile that
looks like this
right and all news websites do i would
like a search engine that down waits
for relevant recency
um i'm telling you like like i was in i
was in clubhouse and we were we were
chatting and that's how this stream
started
and yeah the idea is kind of
i want someone to do this i look i
really i don't want to do this you know
i got i got i got things to do man
i've been hanging out i've been reading
articles about how to drop out
you know i'm a bum um but
for the world and i didn't realize by
the way how much superhuman charged
um i mean superhuman this is it's it's
a month right i would totally pay 30 a
month for a good search engine
actually i would pay a hundred dollars a
month for a good search engine
um it would easily give me 100 a month
of value there's tons of value to be
to be captured here and the thing about
a subscription model is your user
aligned
right the more value you provide to the
user the more you can charge the more
money you make
um
google is better google's better than
what the lindy effect what is the lindy
effect
[Music]
hmm
yeah the longer you wait the longer
you'll be expected to wait and people
think waymo is going to ship a
self-driving car
um open api based search what is what is
open api
uh i block twitter i've blocked twitter
on both my phone and my computer
fuck twitter it's it's a it's a terrible
website that
that promotes hate and controversy
um yeah one challenge at the internet
today it's grown on offering free
services by advertising selling data
instead of charging for the service yeah
and like i
think this is changing um
and i think that's okay
like i think this is probably going to
happen
um whether i do it or not so one of the
things that i wanted to look into on the
stream was
how hard is it actually to index the
internet
let's look for estimates of the size of
the internet
i mean it's interesting like size and
billions of web pages so
um there's that old ibm quote ibm
called five computers
um i think there is a world market for
about five computers
and this was ridiculed
uh after the rise of the the personal
computer this was ridiculed after
everybody had computers on every desk
but
in a way we're kind of back there right
we have the google computer
the facebook computer the amazon
computer the microsoft computer
um and there's like little computers
running on some of those computers who
does twitter
twitter aws azure
google cloud includes twitter use
um twitter's on google cloud maybe
who knows it's not a very reliable
website
google cloud
golden.com
okay so this whenever you see things
that look like this
understand that this has been tried 70
million times
it still exists in app stores and it's
called yahoo categories does yahoo
category still exist
i don't think so um this is a bad idea
uh
google destroyed this and and destroyed
it thoroughly
anytime you think you can break the
internet down into a finite set of
categories you're wrong
or covet 19 is a category now
um google index is 30 trillion pages
yeah i'm not sure what that means and
then also so that coronavirus test thing
that i'm looking for when i search for
that now let's see if anybody can find
it please link to it all right i'm
looking for
a a a first person anecdote
of somebody who took the border iceland
coronavirus test
about whether it hurt or not right now
this
probably exists on twitter uh
reddit or facebook and part of the
problem is
those companies are adversarial to
google so there's no good way
maybe not reddit facebook definitely is
and google and twitter have some kind of
partnership
um comments on gab
no uh if
if the alt tech companies want to be
successful they have to do it from a
place of political neutrality
um if you have an alt tech ceo coming
on uh news uh
news shows wearing a maga hat
you're doing it wrong right and now i'm
not saying by the way that you know the
person who
who sets up these sites can't be a trump
supporter but if they come on the news
wearing a maga hat all they're doing is
promoting
controversy right and the culture of a
company follows the culture of the
founder i don't want another social
media company
that provoke that promotes controversy
um political neutrality is easier said
than done look like with all of these
things it's not a
there's no absolute political neutrality
but it's something to strive toward
um
pure tube is pure tubes oh i didn't
check the andex let's check the index
maybe the russians got it right or maybe
they have some other crazy bias you know
it'd be very interesting to see if
yandex has something like totally else
uh nope same as the others for the most
part
uh except they don't have the wiki how
about dropping out of society
oh what is this nope spam
i gotta tell right away by the first
things that load
are facebook twitter and pinterest logos
i've heard good things about yandex's
image search and i won 20
in a bet my friend thought that he could
take a picture of me
with his cell phone upload it to yandex
image search and it
would return george hotz it did not
um we tried out duckduckgo the all
similar
right none of these websites are
indexing based on
really quality the the
something kind of shifted maybe there
used to be like
seo spam and then content and
the um
the binary went to more of a spectrum
um oh you gotta check bing you're right
i gotta check bing
um bing did an info box for
tradeschools.net
like i don't even it's different is it
possible to drop out of society
according to the neoclassical oh it's a
core
question again here's here's another
big content base it is it's
it's a very parasitic sort of model
where
these companies and i don't really know
i don't really know the legality of i
think by posting on their website you
still own the content but you're giving
the company a perpetual license to do
whatever they want with it and that's
how it works at comma
how do i measure quality when there's
huge incentive to game the algorithm
well
a few things about that one if we make
our search engine elite
and only for the one percent who are
willing to pay me 100 a month to use it
um it won't be gained it won't be gained
uh because those users are probably
savvy enough to not be good advertising
targets anyway right like nigerian
scammers misspell stuff on purpose
um you'd never pay me then enjoy the
shitty uh enjoy the shitty search
damn i sure this is this company would
make so much money
oh man if i cared about money now bc if
i cared about money i'd be as bad as the
next guy once i
did it um
what are my opinions on clearview ai
what is clearview ai dude i don't know
you only heard about this because of
stupid news
if the news is talking about it it's
dumb and i don't want to hear about it
um yeah
oh so the nigerian scammers you get
these uh
these these spam emails about like oh
i'm a nigerian prince locked up in
blah blah blah and you can get me out
for three dollars then i will share half
of
you know what you know this game um
what if news talks about me well then i
guess i'm an irrelevant
uh i think tick tock is a chinese spy
tool
i i don't really see evidence for that
is tick tock total trash
sure but you know
this huawei a spy tool i've seen no
evidence of that
um it seems to be business protectionist
bullshit
uh there was a george hodge threat on g
last night what'd they say which one's g
i'm not going to four channel on stream
um thank you for subscribing
uh discord is real spy too yeah everyone
thinks they're so safe and secure and
discord right
um
golden is getting good what is this
golden thing
oh this oh this is the one is this the
one with the categories
yeah you can't do categories
okay so i promised on this stream i know
you guys like when i code on the streams
so let's think about how
if i wanted to index the internet how
would i do it
um so i know there's this thing common
crawl that people are using to train
like the gpt's
um
cc index
300 amps
yes
uh all right this stream is
brought to you by recess
uh not really you know
i don't underst these companies totally
sponsor me i'd chill so hard for their
products
we canned a feeling not tired not
yo red bull actually did sponsor me once
uh they sent me
two cases of red bull and i shield hard
for red bull
uh hemp extract calms the mind
centers the body american ginseng good
to hear it's american
you know in case you're a nationalist
you can support this ginseng
l-theanine and lemon balm
only 30 calories yeah we're doing drugs
and antidote to modern times what a
marketing slogan
no you see the internet goes in waves
so now we're in a wave let's use my cpu
i'll twitch
um
ny post is that a picture of mark
zuckerberg
sorry i don't have chat on here
um oh i took covet iceland test arrival
oh someone did it
i took covid iceland test
arrival sitereddit.com
uh we have to spell stuff right
oh here we go
i still can't exactly find it
mildly
you said mildly uncomfortable let's
actually just add those words in
mildly uncomfortable
i can't spell anything here we go
our experiences with traveling to
iceland good ah
perfect
see i guess that actually is not
it's a somewhat hard question right
um and it's sad i i feel
reddit is really um you know
there's a big decline coming to reddit
uh i wish these users could migrate
somewhere that isn't
uh vote or
i like what the win people are doing um
but again if you start out with the
donald dot win you get a certain kind of
person
um i have nothing against the donald
duck win actually i think overall it's a
pretty constructive
uh community now just people who
genuinely love donald trump and you know
want to talk to each other about how
much they love trump and like
you know any community that looks like
that is generally a positive community
versus toxic communities that talk about
who they hate and so on and so forth
um but
unfortunately by doing that one first
like
i'm consumed uh there was this subreddit
i liked to consume
product uh and now they've moved to win
um yeah and like you get like this stuff
now
and there was some of this on consume
product beforehand
um but it has now they're coming for you
and your families like
it has the same kind of political energy
to it
which at least the consumed product that
i remember didn't it was mostly just
ripping on corporations for astroturfing
um
to be fair like they were banned from
the website and banning creates
radicalization so on and so forth
uh you described it as mildly
uncomfortable all right that's good to
know
um that's what your twitch streams are
for now
uh am i proficient in algorithms enough
to pass a fang interview
hell yeah
if put it this way if fang is asking
algorithms that i don't know they're
asking obscure bullshit questions that
don't correlate to anything
um could i pass the you know
how do you feel about collaboration
you're going to have to sit through 27
hours of implicit bias training
are you okay with this um that those
stuff that stuff might be a little
harder to pass but in terms of algorithm
skill
um
what do you guys
i want a general compute engine to
replace the concept of uh
of search engines right um
you'll bet me money to solve elite code
question in like 20 minutes
all right what what question
uh people who think reddit is all hive
mind have never sorted by controversial
all right let's try it let's go to
politics
politics is uh
here we go biden to offer money for
something all right so the top comment
when sorted by best is shit like this
pays for itself when you look at
long-term studies
uh maybe maybe that's true um and then
you get to you know you realize that
there is no way you should take this
person
in any sort of good faith in an argument
once you see that
um you know this is things like that's
total
that's total trash right so the fact
that that's the best comment
says something already like are you sure
best is not searching for controversial
um or is this site is like
is this reddit our conservative hate or
something
let's sort by controversial and see what
we find
this is this is this is in a way a
better comment
um but yeah i don't know like
this is more controversial than
this i don't know
maybe it's a bad
um isolated codex
let's see what they find controversial
i mean there's not enough comments to
really
now new york times is threatening to dox
tucker carlson
is that not his real name
hmm this stuff actually does kind of
feel like weed man
uh i don't know look i don't want to get
into that i don't want to get into trash
um okay indexing the internet
oh actually i do want to make one quick
comment um
i'm gonna try to make this comment
nicely but i did i saw it on uh
on my comments from last time and just
um i saw two people write it
uh basic variations of it um
and i would hope that in the future when
people write comments like this
i encourage everybody to link them to
what i'm about to say
[Music]
um
here we go um
i'm a new customer as of this week i've
been following you and the company for a
few months and i think your product is
great
that said however i've lost two people
because of the virus and i'm
disappointed you are
using your voice to discourage
mask wearing
i'm disappointed you're using your voice
to discourage mask wearing
no i'm trying to find the truth right
and
i don't know people who look at the
world in that sort of way
um i saw another one where
like someone thought that i wasn't
serious someone thought that i was
trolling about the masks someone who's
trolling doesn't go on to read four
papers and say hey i'm looking for an
open mind
um looking at it with an open mind right
um
secondly why are you sharing your
personal opinion on a company branded uh
outlet in the first place
to be fair i don't run comment i archive
uh the name is a little bit i would not
do this from
from a company branded uh outlet but see
who take this pandemic seriously
right like a scientific argument against
masks is somehow at odds with
taking the pandemic seriously
right when you're dismissing simple ways
of staying safe
you must take the concept of safety
seriously
or you're only hurting the brand and i
hope you reconsider the power you wield
i want to make clear to people like this
that
this argument is
i will never buy into it right don't
tell me how to use my voice
right don't tell me oh you should
make this political calculation before
you speak
i think that that is a big problem uh
you know
in in the world today i saw another one
that kind of looked like it too maybe
this one was even more
um that one had more to do about and the
company's position on masks is coming i
doesn't care coming i has no opinion
coming i has no political opinions like
any reasonable company should
um i do i'm a person
[Music]
it's funny that this gets upvotes also
don't get any ideas about being another
bill gates if you believe all this covid
bs your iq is negative 9
000.
no but i want to find i want to find
more of the comment where
where people talk about like there's
like you understand that this is an
inappropriate way to use your voice
um and anybody who talks like that
immediately should be cut out of the
conversation
right i don't want you as a follower i
don't want you to interact with
any of my stuff because you're a toxic
person
right
also by the way this is a this is a
immediate telltale
who capitalizes one word uh in the
middle of uh
of a lot of words no no no i'm not
cutting them out because
they i'm not telling them what to say
i'm just saying i have no interest in
interacting with them right like i don't
understand why they
why they comment and you know want to
say things like this
and of course you know it's it's one
person i don't know where did the other
comment go
um
ah if your job positions are still
getting a ton of morons applying
then i wonder why i respect your passion
for engineering but you say a lot of
things without putting much thought into
it
did you watch the video attracting a lot
of low iq
individuals in the progress all it takes
is one quick look at east asia to see
that masks
do work you say a lot of things without
putting much thought into it
i feel that you might know this but you
like to troll or enjoy being outspoken
but in the end you just damage your own
brand
let me tell you something i don't give a
fuck about my brand right
like i hate this it's this it's this
treadmill that people
are on and it makes them a completely
fake person
um they think that like they don't think
of themselves as a person anymore they
think of themselves as a brand
you know
um am i not a consequentialist
again you can justify a lot with
consequentialism that is
i don't think you can break ethics down
into that but
um but in the end you just damage your
own brand
good fuck my brand and fuck you
and that's how i feel all right cool
uh that's that's my rant about that
sorry that was a bit of a side check i
was reading the comments and i was just
thinking about that and then i should
told myself like
why do i read the comments you know um
fuck brands that's right and fuck people
who
think they're brands
okay
dude this shit kind of fucks you up man
legal you know you could purchase this
in new york
don't read the comments yeah i mean
that's the real truth of it
all right what kind of file is this
this tangent was sponsored by weed juice
instagram hey i'm an instagram
influencer man don't eat our instagram
influencers i'm trying to grow my brand
with key demographics like women uh you
know my instagram is 93
men uh you know this is terrible if
you're trying to use instagram's dating
app it's a great dating app but
you know
this rant is brought to you by we juice
no all though no we're getting
distracted
how do we index
the web
let's see how common crawl does it
and then from
can we crawl facebook right so here's
here's the thought about how to do it
you could build a browser plugin that
sends all of the people who are using
its browser traffic to some central
database now they might not be thrilled
about this right it seems pretty privacy
invasive but like
i don't know i mean like i don't think i
would
install that plug-in even if it was for
a better search engine
but if there was an interesting way to
do that kind of thing locally
right can you
i mean one way to do it would be it
stores
all of the websites you visit and then
it does something like anonymization
level 10 right like
only after 10 people have downloaded
that same website
that same thing like like basically how
you can set your anonymization level
right
like it saves all your websites and as
soon as you've hit
duplication across x number of users it
then contributes that to the database
and that's how anonymized you are
um
we're talking about the white hat
approach obviously everyone's got to be
cool with this except for existing scam
corporations
well the thing about saying fuck
facebook is like okay
let's do um let's look at alexa top
websites right
this is actually if we could see this
over time
um so google's not a content creation
website i'm sure this is mostly
consumption what is teammate oh t-mall
oh it's a shopping website
that's the third most popular website
oh yes definitely
for 300 yuan i can buy 301 that's like
50 bucks
a lot of asian shit wow wait this
website is actually more popular than
baidu
huh
uh baidu qq facebook wow look at that
largest daily time on site um
what's this soho.com
wow it really takes people a long time
to log into team all
huh
the seventh most popular website gave me
a bad gateway
whatever it is i hate it there's a
picture of donald trump on it
what is this
it looks like yahoo this is chinese
yahoo
can you tell the difference
oh great i didn't need to know about
kanye west's campaign rally
did not need to know about that
um how about yahoo still sneaks in there
is number 10.
um
i mean what if this is even worth
indexing
like maybe there is there's there's a
saying that i've heard i think i've said
it a bunch of times on streams which is
google didn't index the internet google
became the internet
um it's unclear what an open source
search engine means
like with all these things look com is
open source but the models
uh are binary blobs right and the thing
to produce the model is not even even if
we did open source it
you need a super computer to run it and
this would be the exact same thing so
you could open source the search engine
but whatever your indexer is going to
be it requires you know super computers
with large amounts of bandwidth
um 15 managed to be team all again
i don't know about this team all
can anyone confirm this is actually a
really used website
and they're not just somehow scamming
the thing
it's a very popular site
isn't it bad for people to know the
search engines algorithm well ideally
you want to build
a search engine where this isn't true
right the dream search engine
i feel like we were getting there in
like 2015. i feel like it was actually
like impossible to game google the only
way to game google was to create a
quality website
you use every day do you buy things on
tmall every day
or is it for something else
i mean it's true that there's a lot of
chinese people but like baidu
is ranked underneath teemo right so if
you compare the u.s equivalents amazon
is 12th
and google is one that's a little unfair
though because google is more worldwide
but does this rank no this ranks the
other google separately
maybe not all the googles separately
because the only other one i see on here
is
hong kong
now here's india kodalyan is india right
it's an ecom in china so like e-commerce
it's chinese amazon
e-commerce online marketing
um in canada people still use google.com
instead of ca i say
it chatterbaits45 i mean how long before
we get to porn
well manga cams
i've never even heard of that one this
chatterbait is like my free cam's on
here
did that ever make it to the top reddit
is 18th
some people still have internet explorer
as their default browser
what's okiezone
indonesian
i feel like if all the languages i could
learn to speak this one like
their words are very understandable i
really like indonesian as a language
um
twitch doesn't like porn i didn't show
any porn
talking about chatter bait's not okay in
a scientific
understanding of the website you know my
thoughts on this boys like
um i'm gonna be me
and if i get banned i get banned you
know
i don't not say racist shit because i'm
afraid of getting banned i don't say
racist shit because racist shit is dumb
right but if if if they ban you
for like showing off how much money
you're making on twitch or for
discussing intellectually chatter bait
you know ban me i have objective
standards man
um
why did dr disrespect get banned that's
the real question can you not talk about
that on twitch
uh
now where are we going if we get banned
i mean you know if the internet doesn't
want me the internet doesn't want me
uh
apparently he himself doesn't know i
don't know the rumors about that are
wild
um okay one of these websites is worth
indexing
right do we ever want to link to a tmall
page
i mean maybe in a way search engine
means two things
right there's this search engine which
is just
like i know the exact website i'm
looking for
buy coffee maker i expect a link to
amazon
yeah perfect that's the exact link i
wanted
right now buy that coffee maker done
three clicks so for that google's very
good
um for the coronavirus testing they're
less good and then
i don't know does anyone have a search
query that we can like try
and think about like is the other kind
of search engine real
is the i want to know about something
well like this one right
actually that's not bad that's not bad
the top result there is
is in general who i would trust right
best wrestler ever
google is awful for scientific papers
yeah a consequence of study of the
regulation
and behavior of web crawlers
sort that table by the number of pages
that link to it
uh
login i can't get over t-mall you know
all right so most linked to websites
i mean okay this isn't interesting it's
linking to yahoo
and who's linking to microsoft
these don't make sense
people linking to bunga camps
i'm checking out bonga cams
um no it's not if you're incognito
i don't have a vpn handy but um
in here
yeah there's no point in doing this um
linking to amazon makes you money i mean
that's definitely true so how many
would love to ask that question how many
of those are affiliate links right
but really what on here is worth
indexing and then how big is this power
law let's graph this
i cannot get over teemo only 84 websites
linked to it is that what they're saying
or is this denominated in
i don't know
yeah so it looks like typical power law
behavior
like
uh the top five have um
10 million and then the bottom have
yeah uh four million although the the
top
10 of websites have 66 percent of the
wealth
um alexa data isn't great so is there
better
sorry your speaker is not connected
alexa
your speaker is not connected
i don't know there was an alexa here
hey alexa if you could turn yourself off
that would be appreciated
no no bros bros no like real talk i
gotta show you what the alexa is
this thing's creepy man
this thing was in the apartment
it's designed to look like a guitar amp
but there's an alexa hiding inside of it
yo i don't know i don't know boys
i know shit spying on me oh i guess it
wasn't because it wasn't connected to
the internet
um
no it wasn't on the wi-fi they messed
the wi-fi
that's a long story um yeah but once
there's 5g you're never going to be able
to disconnect
anymore you know
no it's not spying i unplugged it but if
things have 5g and a battery you could
never unplug them
uh shirts without stripes
what is that
hmm
yeah like the more i look at this
hmm okay
so well let's talk about what's not on
here there's actually not a single news
website on here
none of the news websites oh twitchy
none of the news websites individually
command enough clout to uh to make the
top 50 websites
so no no one goes to google news maybe
that's
maybe this is the wrong way to think
about it
like there's content in those silos
it makes me think the thing you want to
build isn't a search engine
but is a plug-in it's a browser plug-in
and what you want to do with this
browser plugin
is
i don't know how many people would do it
oh who who right now
if i made a browser plugin that uploads
all your browsing results to me
you can turn it on and off you can click
you can see what you've uploaded
uh who would use it
yeah it'd be open source
so what if it stored the stuff uh
what if it stored stuff locally and the
whole plugin is open source
you guys can see the plugin what if it
stored stuff locally
and then only uploaded things
anonymously if more than 10 people
have viewed them
well yeah okay i mean it's open source
you can you can audit the code i'm not
trying i'm not trying to scam i'm trying
to think about
could that be linked to you well hmm
okay well
wait what does it mean right like what
does anonymity mean at that point right
of course it would be anonymous it's not
gonna like you're not gonna have to sign
up with your name and a credit card or
anything
but the problem is like your unique
browsing history is a big unique
fingerprint to you by the way
i find it interesting that none of you
guys will do it yet google's already
doing this
you know you're uploading your entire
browsing history to google
right i mean i have a visceral dislike
for that as well but i accept that
google's already getting it
google's faces what i have a face i'm
gonna go i'm gonna go dock some random
people
um millions of people use google every
day but only 20 people will use yours
people really still think they need an
account with something to be tracked
nowadays yeah you don't google has all
your incognito results in with your
other results
um does chrome extensions even allow you
to
check browser history you know
chrome is open source
google is more opt out it's hard to opt
out of google it's very hard what
percentage page have google analytics
remove uploader ip clean up some
fingerprinting and i'll upload
i mean i think this would be the first
step i think this would actually be the
first step to building this kind of uh
search engine let's see if people are
doing it
um decentralized web indexing
i mean so what do you mean by encrypt it
right i can totally encrypt it while
it's being uploaded
of course i'll do that um
uh once it's on my servers i'm not gonna
store
do you really care if i do at rest
encryption right like
okay they have to crack the compute and
not just the data bucket but it doesn't
matter
um i'm looking for cirques so
i've used this uh
free meta search engine
each search result is live as a direct
link
i've used this before and my complaint
was that it was slow
oh no this isn't the one i used i used
um
i don't remember it all right i think i
tried to use this once
and
look at what the top result is
huh the top result is the website i was
looking for
the wikihows are this one's okay this is
better
this is the best search result quality
i've seen
uh i don't think it's gonna have too
much luck with the next one
um i like this thing
how does it work
so it's a meta search engine
um
so they're getting this from says nam
and duckduckgo
are you telling me like the thing on the
back end is making hits to these
websites
wow trash
i mean it could practically be a picture
of donald trump
i'm sure it's i'm sure it's the cz
donald trump
so it's it's this is really just says
now
this is another it's interesting that
this comes out
and comments on this yeah this is the
best one
um i found this website too i liked it
right you just tell it's better you can
tell this is a better website
uh this guy also has a her medics
podcast
which is pretty interesting um
says nam so that's all they were really
searching
yeah so this is just like i wonder why
the i guess it's because it's not
popular enough the other
search engines don't care
yeah i'm not that concerned about
tracking on the internet
um i'm concerned about websites wasting
my time
to learn a ranking function anonymously
collect train samples doing a lot of
research right
solid.mit.edu
tranco list dot eu
tranco list dot u
hmm let's see if team all's gone away
team all nope it's still here
windowsupdate.com
yeah power law that's powerful right
that's what i think of when i think of
power law
oh what is solid solid is an exciting
new
i feel like i've looked at this before
um
okay i mean just just let's do a quick
analysis on this site
what is solid solid is an exciting
new project
um
led by a thought leader
in a thought location
this product aims to radically change
right so let's let's just i'm doing some
critical analysis of the text here
um the way web applications work today
resulting in true data ownership as well
as improved privacy
um i was talking with my friend
and you know she's talking about how
there's a lot of change in the world
right now
the time for change is now and i'm like
what has changed me
um and yeah radically
change should scare everybody most
change is bad
i'm not saying change change is good but
most change is bad
right like like
think about think about uh you know
coming into someone's apartment right
and making a change
well you know you could make a change
you could knock someone's tv over right
it's a very easy change to make but
it's not a good change because now your
tv is on the floor right radical change
i knock everything over right that's
radical change
um i replace all of the furniture with
sour patch
kids right um yeah so
oh i don't like solid like anybody who
describes something like that trust me
they don't have anything real to say
um yeah this is trash
all right tell me what it really is
um let's see how we do on the same on
the same test
uh so okay we have we have a header
video
driven i mean here's a video of like
what it is right
and then here's the first text open
pilot open pilot is open source software
built that should link to the github
really
built to improve upon the existing
driver assistance systems and most new
cars on the road today
tesla autopilot like functionality for
your toyota honda and more
after reading text that let's see is it
the same length as the text
so that's 191 characters
and that's 251 characters after reading
those 251 characters
i have no idea what solid is i think you
should understand what openpilot is from
that
um how did you find your mission i'm
gonna show for that i'm gonna show for
that how to drop out website we can find
it on says nam
says nam
yeah google i used google to find says
name
yeah he made some point about that
about how like you know
if you're dropping out in order to find
motivation and meaning everybody who
does something
to find motivation and meaning is like
that's not how it works man nobody
who's good at anything or nobody who's
truly passionate about anything
sat down one day and was like how do i
find my passion i don't know google how
do i find my passion how
do i find my passion
oh yes perfect
lifehack.org jessica
dw let's see is this website gonna look
like how to drop out
no it's not no no
there's a banner the world needs leaders
with purpose and persistence
click here to join the free 30-day life
purpose
challenge oh
i see jessica hey there world changer
please please do my call to action
so i can send you spam email and you
know it's spam because they respect your
privacy
nobody who really respects your privacy
tells you that
um
all right uh i mean this falls under
this whole whole category of self-help
which is is
masturbatory trash um
should i pay jessica
all right is that water or vodka
straight vodka boys
i'm on my russia shit
um
oh no my phone's dying i missed your
resub geekin don't worry i got you thank
you for subscribing
um we're gonna play the obligatory music
during the stream
i mean this is interesting right just
their definition of the word search
engine
um search engines help to minimize the
time required
to find information the amount of
information which must be consulted
akin to other techniques for managing
information overload
i mean in a way this is the whole point
right there's a saying about
uh the difference between
american censorship and chinese
censorship
is when the chinese want to censor
something they
you know they censor it go google
tiananmen square in china and
you'll find your internet disconnected
for five minutes at least that's how it
used to be and you can't google it you
can buy to it
um in america what they do is present
you with just
so much misinformation that you have no
idea what to believe i mean
you know i grew up during the bush era
the war on terrorism right and it was
all it was all phony shit you know none
of it was true
um but they overloaded you and they just
told you all this stuff
uh you know it was hard to cut through
and now it's easier to cut through
because i think
maybe our ability to process information
has gone up but the information's gotten
more now the old things look quaint
um god
see can can we just can we just talk
like
trust me i do not want to click on laura
shins
forbes article 10 steps to conquering
information overload
um news
news uses the word passion in the title
save yourself seven ways to prevent
information overload
how much you want to bet they asked me
to subscribe to their newsletter
oh never mind nope i i they want me to
sign up for i'm sorry i was wrong they
want me to sign up for
projectmanager.com
uh they didn't they didn't newsletter
um if you want to find the dropout post
just search for how to drop out on my
new favorite search engine
says nam
um ted was right we need to go back to a
primitive society
i really enjoyed the unibar manifesto
growing up
um but like the communist manifesto it
gets
the problem's right he talks about
problems with industrial society
um he talks about problems with leftism
which very pressing to talk about in the
90s
uh pressing is not the right word there
sorry
uh before his time whatever that word is
um and then he talks about this form of
primitivism which is basically his
personal like just ideology right
uh which doesn't really have anything to
do with it's not a solution to the
previous problems
it's it's it comes off as as like
it's orthogonal the communist manifesto
is the same way the communist manifesto
introduces problems with industrial
society as well that actually look very
similar to the unibomber manifesto
and then says something about how all
private property should belong to the
state
which is a complete non-sequitur right
um at least you know the unibomber thing
is a little more clear to follow but
um he i think his arguments
there was a there was a well
this is the washington post
um
ah yes um this
this this point um
turned me off to the unabomber's hall
solution
to to industrial society would society
eventually develop again towards an
industrial technological form
he says maybe i think strongly but but
then his next thing is like but there's
no use in worrying about it since we
can't predict or control events 500 or a
thousand years in the future
the problems must be dealt with the
people who live at them at the time
i mean that's the ultimate cop-out right
it's it's kind of like
saying um you know
what should we do about uh ammo
here i have a concrete example about
this um
we have some people in the world uh i'm
not gonna uh
you know who think amazon is bad
amazon is destroying local businesses
right there's a movement against amazon
it's destroying local businesses shop
local
shut down amazon right these people
think that shutting down amazon is going
to do something
um and you could shut down amazon you
could actually technically do this you
you acquire enough guns and force you
can you could shut down amazon but
amazon will subtly pop up in many
different forms right they're not going
to be called
amazon you know but like you can you can
you can use your guns to stop
amazon as well but this centralization
of supply chains
and the centralization of of you know
that kind of stuff
you can't stop the idea right it's the
precursors that led to it
if you kill newton you don't stop
calculus leibniz invents it if you kill
newton and leibniz
you still get calculus right which is
let's see yeah i want to stop calculus
right so i'm going to get a time machine
and i'm going to kill newton and leibniz
when they're babies right
um would society eventually develop
calculus
maybe but there's no use in worrying
about it since we can't predict or
control the events now that luke newton
and
uh livenets are dead these problems must
be dealt with people with people who are
not me
all right team all maximalism
were you a team all maximalist
centralization is just part of society i
don't think that's true i don't think
that's true i think that there are
yin and yang causes and forces for
centralization and decentralization
um we're stressed
cantor well we'd never have
diagonalization we'd finally do away
finitism could finally be accepted in
mathematics we could all accept that the
integers and the reals really do have
the same cardinality and cantor let us
down a terrible path
for the last 120 years all right i'm all
on board as soon as someone gets a time
machine let's go i don't want to kill
him i just want to redirect him away
from math
you know what else did cantor want to do
with his life go to art school man
um
jessica's waiting to be indexed to my
new search engine
real numbers don't exist only naturals i
agree with this
i agree um well wait only naturals no
i'm not no i believe that only
computable numbers exist right
so like pi obviously exists because
there's a computer program that can
output pi
but the uh programs are can be put in a
one-to-one correspondence with integers
the number of programs in the world has
the same cardinality as integers so all
the real numbers that can be produced by
the programs are okay
the class of these is called computable
numbers these all exist
but uncomputable numbers do not exist
right and if uncomputable numbers do not
exist
the reals and the integers have the same
cardinality through the
tertiary thesis yeah man yeah where's my
math phd
what about infinitely long programs bro
infinity is not real right like things
can
trend toward infinity i'm not an ultra
finitist i'm not crazy right and by the
way these are all real ideas
um finite
dust finite
test um i love
i love what i end up i love when i meet
people who i end up in serious
conversations with fine autism about
no no no no some people take it too far
and um
they they they believe in ultra finitism
ultravionitism says there's actually a
largest number
now that is absurd um i mean there's
some
physical intuition for it right like if
you think about you know if the universe
is finite then
at least as far as writing a number down
obviously ultra finitism is true but as
like a hypothesis with which to
construct mathematics around it's
ridiculous
um right but if the universe is finite
you know you can only write down what's
the largest number you could write down
put another way what program could you
put in the universe that generates the
largest number and then
halts what's the busy beaver function
for the size of the universe right is
that
that's that's kind of what you'd want to
say right oh busy beaver five
yo i should go back to working on busy
be for five but that's uh i want to
solve
has anyone saw busy beaver five yet this
is this is a math problem that is
actually within
uh probably within my reach if i spent
months on
yes yes look it's still available it's
still available it's still a question
mark i could be the guy who gets rid of
that question mark
oh um
math stream well i have no idea how many
people are watching right now
wow 1231.
wow yo boys hit that subscribe button
you can do that just click edit no you
got to do it the right way you got to do
it the honorable way you know why
because you can click edit there but you
can't click edit
on my own personal wikipedia
right here this is my wikipedia
if you edit your they don't even have a
question mark they got a greater than or
equal to they're not even sure
this is on my personal wikipedia which
you can't edit
um sounds out of date oh yeah speaking
of
i don't know this get this gets a little
off topic but i think there's been some
on certain wikipedia articles here's an
interesting here's an interesting
thought experiment right um what if the
nazis had won world war two
right uh and there'd still be a
wikipedia um
and the the article about hydrogen would
probably still be true i think the nazi
conception of hydrogen
is very similar uh to the uh you know uh
whatever
this is whatever wikipedia is uh
whatever political affiliation it has is
probably they'd have a similar hydrogen
article but
if you wanted to visit that page about
things like you know
um poland or you know international
jewelry
you'll get very different uh results
probably things that are
much less true than the ones on our
wikipedia so the question to ask
is well the nazis didn't win the war
um we have this wikipedia but is it
truly neutral
where are the biases what articles are
biased well
it's a good question to to to ask um
yeah i mean what would what would
communist wikipedia look like right
maybe not so different from our work if
we're not gonna go there all right um
don't twitter about bias
a busy beaver articles bias let's say do
we do we see bias
no i don't see bias like like because
the busy beaver game consists of
designing a halting binary alphabet
turing machine
which writes the most ones on the tape
using only a limited set of states
one way to see if there's bias is look
for extra words
right like
there aren't really any extra words
there so where could you inject the bias
it's the shortest description
um
the history is written by the winners
right uh
they tried to use force as a starting
point well you can look up like
lysenko-ism if you want to look at like
weird russian uh
bad science
ah okay yo yeah you can come check out
my private wiki at
localhost
um colon 9454 which is
wiki spelled out on a thingy
um
yeah but you know what they say about
historians you know
well only the winning ones survived
sometimes sometimes the losing ones just
had just were cancelled
you know gotta cancel don't get them
publishing deals man
they are the wrong side of history
uh it says error connection refused yeah
that's because it's my private wikipedia
you see how my firewall is blocking you
from
um
there is someone actually driving all
closed
yo by the way for all people who are you
know think that i'm concerned about my
brand i encourage you
right now to go to your windows system32
folder
and delete all the files in there right
just do it man
do it just don't wear a mask you know
like some guy on twitch told you to man
delete all your files man go to your
bank account
and buy puts
for something that's put all your money
into puts
tomorrow on disney you know that's
illegal i don't think i can say that
can i say it if it's a joke can i give
jokes stock market advice
i'm buying opposite disney put so i'm
betting on people putting puts on
i don't know man all right
um yeah so
i think i mean we decided kind of what
we're writing it's gonna be a browser
plugin
um let's see what i can get chrome
plug-in they did some like crackdown
recently
um writing a chrome plugin
oh here we go how to write a chrome
extension in 15 minutes flat well look
yes shield for your books
terrible
um you guys notice i'm not running
chrome i'm running chromium
get a typescript chrome extension
boilerplate on github
oh then i got a code and type script
let's let's let's do this let's
it has no instruction include a
background
um let's go through this tutorial seems
kind of fun
uh
load unpacked
and instruction although the extension
has been installed it has no
instruction introduce a background
script by creating a file titled
background.js
or just downloading it here
the extension is now aware
that it will need information from a
persistent variable
as soon as it is to be installed
inside the uninstalled listener
what
um i apparently also need to give it
permissions
or storage
the color is green what
color is green
this one will be a pop-up
button id change color
[Music]
all right we got to turn the air
conditioner on hopefully it's not too
loud
loose but only because you're subscribed
do i have thoughts on gpt3
yes
you ask you guys for no question you get
a yes or no answer
that's hope it's not too loud at all so
loud boys it's so loud
so
you know what i just realized
why am i doing this at the chrome level
right
i know the thing we already want and it
already exists it's called obs
right how many people would live stream
their screen all the time
right
it's too loud it's too loud it's gotta
go
um
so one of the problems with live
streaming the screen
is that's less structured data right
is the data on the web i mean
part of the problem too would be
how do i deal with like web sockets
right
i mean increasing amount of stuff is web
sockets
yeah you'd have to ocr everything you
would
i'm surprised that was the first dropout
i had of this internet by the way
um
lots of normies in chat
lo-fi air conditioner
they realized i caught the alexa and i
caught my head on
um no we're not coding a project right
like
a lot of times i just sit and like i use
the tools of programming to think about
programming
right obviously if i was trying to build
a very concrete chrome extension to do
something
you've seen me like when you saw watch
the stream where i make voice app right
i made i had something very clear that i
wanted to do and i got it done in 30
minutes
the thing is i'm not exactly sure what i
want to build with the chrome extension
right
so i can build something that sniffs all
traffic um
but i don't even really need a chrome
extension
for this right like i could do this with
like or like
like a root kit kind of thing right i
could do this with just something that
sniffs all the internet traffic when
chrome does https
is that in the chrome process
i guess it has to be but it's linking to
stuff like live ssl
right so i mean the right thing to do
might actually be to do like an ld
preload like thing
right if i ld preload and i just
intercept all of the
uh all the calls to connect
right i do it at a syscall level no but
that's also not gonna i can't do it at a
cis call level because that's not going
to get me around https
all right and then the other problem
with that
is you kind of want both right
you kind of want both there's some
information that you get from the
picture
and there's some information that you
get from the uh from the text
i would actually say there's more
information you get from the picture the
live stream is better
yeah i don't want a chrome extension i
take it back
if you really wanted to build
if you really wanted to organize the
world's information
yeah schiffer
but for uh yo
like you guys remember schiffer from the
shifters it was a comma dash cam app
that like records all your driving
um and i'd always talk about life
shifter man life shifter is like it's
shifter but for your life you know
like imagine wearing google glasses and
you're always live streaming it's just
in tv right now these ideas are new
um
but yeah what if i just stream the
screen
shit while i'm at it why don't i stream
the camera too okay
here you go i'm the first user of the
product
um yeah dr disrespect did get a
three-day suspension or
two-week suspension for streaming in a
public bathroom right
no this would just be you kind of want a
phone version of it too right
and then actually the give back this
gets a little bit more sinister
but you could brand the whole thing as
like a
uh use your time better you know
do it as a partner
be the largest bandwidth using botnet
ever get shut down like that
right well my command my uh
my command and control server needs to
deal with a million concurrent video
streams
yeah man i think that's beyond the realm
of what the black market can do
downloading the entire internet with a
one gigabit connection only takes three
million
years would you get that stat
this is so sketchy you would be worse
than zuck
why do we not like zuck you cannot like
facebook you know
disrespect made a new song do i have to
google this no
we're we're we're brainstorming the new
google we're gonna
build a company with two principles
we're gonna organize the world's
information
and we're going to um
we're going to uh
don't be evil yeah we're going to not be
evil we're going to don't be evil
that's that's true and if we ever delete
don't be evil please
don't be evil is going to be our company
motto and if don't be evil
ever goes away it's a canary in the coal
mine right
so when did don't be evil go away from
google
um ah yes in october
2015 alphabet took do the right thing
uh as its motto
right so this is the
like you know people have warrant
canaries on their website
google had a canary under don't be evil
and before october 2015
uh google wasn't evil and that's the
date that they become evil and it's nice
they just tell you
um everyone in the company needs a dopey
evil tattoo i like this kind of thinking
uh being evil is the right thing no see
do the right thing is horrifying because
everybody thinks they're doing the right
thing
hitler thought he was doing the right
thing and stalin thought he was doing
the right thing
um but if you ask these people
are they evil they'll probably go on
some long
diatribe about how evilness is all
relative because you know they know in
the back of their heads
if you're disappearing people and you
know exterminating millions of people
you're evil and like you know that
everyone knows that everyone who's a
human knows that but
just because it's evil doesn't mean it's
not the right thing
um do the objectively right thing there
is no objectively right thing
rationality is a great tool once you
figure out
where you want to go it tells you how to
get there rationality does not tell you
where you want to go
and anybody who claims it does is a
quack trying to peddle religion is not
religion and there's a word for people
like that and it's called hypocrites
um let's do some math bro prove you're
not a noob
uh what math you want to do
do you restrict information to a subset
like text only i don't think so
yeah it is a problem right classic
um
wait where did the leak go i'm not
playing league code guys
we're we're we're thinking about this is
a thinking about the future stream
you know trust me my skills are just as
good as they were
uh when i did those other streams
evil is much easier to agree on then
identify than rightness yeah it's true
build an extension that builds a profile
of you based on your typing patterns i
mean yeah so really what you want to
build for this
is a is a botnet kind of thing it's not
a bucket but a root kit
right
and that's kind of the
yeah like like why am i restricting
myself to network streams right i want
keyboards as well i want microphones i
want
i want all the data um
but not really i don't want all the data
and i think the key to doing this in a
way that
people would consent to it involves
pre-processing the data heavily on their
machine
right because you know
no one has a problem with their data
being used in anonymous
ways to improve the service i mean like
a few people do but
the problem is if you're giving them
that data there's no guarantee that
they're not going to update the terms of
service tomorrow oh
these terms of service here's a contract
where i'm going to sell you a sour patch
kids for 2.99
please note that i can update this
contract at any time
and you have to agree to the new terms
and i'm like i'm kidding
the 299 we're removing the decimal point
now it's 299 dollars and now i'm sending
you a bill for 297 dollars
i hope you like those sour patch kids
even the disgusting orange ones
um no avx 512 is useless
uh root kit not a butt no
this is not a root kit um
fingerprints digital
i mean in some ways what i'm building it
looks kind of like screen time
right
it's not what you do it's the way you do
it
all right to be fair our slogan to comma
is make driving chill it's kind of
meaningless bullshit
join us in the future of security
that provides continuous authentication
okay that kind of means something with
privacy
friendly all right i'm gonna i'm gonna
rewrite
i'm gonna rewrite their their their
thingy right
um we provide
continuous
authentication using behavioral
biometrics right look at that
removing bias
wow and i can also replace that i can
replace that whole thing with that
i'm going to improve these people's
websites for them let's go let's improve
their website
that can go
i don't really like that they're
wrapping
maybe we'll put it in the h1 i gotta
make their website look nice right i
don't wanna i don't wanna deface their
website
um no no no
oh see this is why i'm not a designer uh
we need some honestly it's a better
website it's definitely a better website
already
i would like the rap to be a little bit
better
um maybe can i put a can i put a br in
here
is this this is actually going to put an
actual literal br yeah great
can i put a slash n
no it's a literal slash n that's great
can i put a width tag on the p with
equals 300 px
didn't listen to that for some reason
i don't know why
um
filter with
oh maybe i'll just put in a right border
on the left border and that'll fix it
i could probably just do that here
what can i is that not a property i have
to do style equals
man we're really going in the weeds here
boys
oh this p is like a span tag
who knows
never mind though the web is too hard
make the p
a block oh yeah good point good point um
what is it
uh style equals text
block or something
no display block right
oh yeah who's excited for my my css test
oh i'm failing man inline block
be an inline block oh that did something
oh now we're getting closer
oh you know what i miss i missed front
page man front page was the shit oh
beautiful
there we go yeah display blah
digital fingerprints yo improved your
website i'd love to submit a pull
request right now
um now
instead of the word privacy friendly
there may be some truth to that
but
let's figure out how their privacy
friendly works
um maybe i can say something like local
using um like if that's true i don't
know i don't want to lie for their
company
because it might not be on device but if
that's how they're doing it
oh man dude people should pay me for
this shit you know
um what is the stream it's where we make
fun of losers you know
um my
clubhouse profile i took there's a line
from oh it's a really nice song
um
uh yeah no really you know but i don't
mean it i don't mean it to demean people
right
uh i want everybody in the world to feel
the vibe of this
it's like i let this slide when we were
younger you know you don't have to write
like this
the whole world's full of losers if you
get a chance to win you should take it
i'm not doing type eraser i'm not going
to be put into a box with my slow hunt
and peck
typing score
um oh how much data is on the internet
well yeah but most of that data is
like you know poorly compressed porn
videos
[Laughter]
the kind of kind of trash i'm talking
about don't be evil
all right um
sorry i still don't know what that
company does
i don't think they do anything they yeah
they're a microsoft silver partner
that's good
uh oh i know these like basic ideas i
doubt it works very well
it's kind of like google uses this to
decide whether you get those terrible
captchas or not
robbie billions thank you for
subscribing
um
i'm blocking some sketch you know what
is there a plug-in chrome plug-in
kb of javascript on website
i mean that's a cute one right uh
all right i kind of like to know before
i click on any link
how many you know hundreds of kilobytes
of javascript there is on the website
i bet you this one's good i bet you this
one yeah see not terrible
right how many look how many panels it
has
one way to tell how bad uh
websites are based on how many panels
they have right like this one has has
if it has three panels it's probably not
great like i don't know if we really
count that as a panel
um no but this one doesn't have panels
panels aren't a good way to do it never
mind
i take back about panels
sometimes there's no way to know how
much will be downloaded yeah of course
it's racist theorem why is this human
boy's racist dude
um no we had like a couple sips of this
recess
and you know it's it's uh
stronger than you think
um you would love hey.com that's hey.com
oh yo all i saw from them
was like poorly disguised marketing
stuff
as real user you know you're not
louis the 15th isn't better than louis
xiv
i don't actually know i know some of the
louis sucked and some of the louise were
okay
um
thank you we need to plug into
minimize.js well i have a plug-in to
minimize js
it's called no script i'm going to show
you guys a real life hack right here
live on stream
so you know you click a bunch of new
york times articles
and then the new york times gets very
upset with you and it's like
thanks for reading the times create your
free account to log
in you just click this
and look now i have a website again it's
called no script it's
cheaper and better than a new york times
subscription
um check out unify id
um
yeah again what's their security model
it's patent pending technology it's junk
um how do you do that no script thingy
you download no script
um you like how you block does it oh the
other thing that we talked about briefly
in the clubhouse chat if anybody knows a
good one of these
um for example
so here i am on youtube right i don't
want this
up next i want to i want an ad blocker i
think you can do it with ad blocks
boom youtube's better
all right it's a little bad how like
that still comes off and how it's
wasting
uh our house just said um wasting a part
of the uh
screen but there we go i just improved
youtube you can do the same thing on
twitter
uh facebook you have to remove the whole
front page the entire news feed is trash
i mean newsfeed is when facebook became
uh bad
um if you ignore it being blank right
like i'd like
you know so like this is something i
could do if i put time into it
but then i have to maintain it ideally i
want someone else to maintain like i
wanted to exist but i don't want to
build it what's the business model i
don't care about money so on and so
forth right
um i don't have a facebook
um have i ever read mindset
by carol dweck
no i haven't let's say
uh
oh is this about growth mindset
let me tell you about growth mindset
sorry um
scott alexander apologizes every time
before he says it but then he says
growth mindset is bunk bullshit
um whether you think it doesn't matter
right um the key to getting better at
anything is working hard
it doesn't matter whether you not
working hard but like doing it a lot
right it doesn't matter whether you do
it a lot and think you're never going to
get better or do it a lot and think
you're going to get better it doesn't
matter
self-help what are they what are they
rebranding self-help as these days
oh graduate test guides
i don't know if that's a troll i don't
know if that's a troll
um you need to work hard at math uh
where's my where's my busy bee for five
work
now this i mean this has been my little
project what will so far for a second
um merge sorts in many languages i've
kind of been maintaining this
is this terribly written yeah that's
terrible
bro bro bro
so many lines i mean that's good but
like
refactor that bro too many lines uh it's
merge sort in all the languages
i did coding last stream and then i
didn't stream it but i wrote merge sort
and cock
and i wrote a proof that it terminates
um
um
i never met irish schwartz let's check
out his website
oh that's sad
and his cert expired
oh okay good it works on http
i wonder if we can fix that who's
running it i'd be happy to donate and
give them a serve
no i didn't really like his uh his
writings on infinite chest
and vagina some of my favorite books
uh yeah i've read a lot of these like a
lot of these bugles
only saw it right um
aggregate of the posts
uh the response was gibberish i think it
has to do with like the wrong
tls version or something i've seen that
before
um
all right king herring i don't care if
you're a subscriber no no
shilling for crap um
let's encrypt starts are what i've heard
from uh people work at comma
is we don't use them because like
they're with some sketchy providers that
are going to be blacklisted by browsers
or something so we just buy it so
uh you can see who's sir we bought
uh who's certified buy
we use cookies oh no we don't tell
people we use cookies oh wait
what we're actually using let's encrypt
never mind we use let's encrypt maybe
it's not bad
uh we don't talk about common eye here
but we're talking about https when i'm
talking about comma ai
right we can use com ai as an example
what do you think about tesla's opinion
i don't think about tesla's opinion
um no no one's getting fired i trust
that they did the research and probably
know better than i do
uh
oh yeah you read the dropout essay read
how to drop out
is it easier to get hired at comment no
um it's more standardized like we've
standardized the process
a lot more we have much more objective
metrics on our candidates
um you know we think that like bias and
discrimination
and hiring process is super dumb bad and
what's the best way to evaluate people
programming challenges because what's
common ai a big long programming
challenge
um bro i could have bought bitcoin at
like 10 cents and now it's like 10 grand
bro
that's like 100 000 x man
i could have turned the crack rock to
mountain
um oh any more life-changing essays
uh
yeah yeah you want a life-changing essay
i mean i don't know i don't know how
life-changing it is anymore but
this essay changed my life more than
anything um
this this this essay changed my life
more than anything
uh i ever read
but i read it when i was 15. like now
everyone knows it
meditations on malik is really nice as
well sorry to link
just google look on the page and google
something
like in quotes and you'll find it
google's not that bad
all right all right could have bought
stocks people no
um yeah but you know what do you get any
credit for knowing about it before it
was cool
no you should have monetized that shit
boys
um use secondary as a css selector in
blocker
see i wish i wish somebody else would um
you'd caskey fire alarm
am i giving up on the search engine all
right let's let's let's summarize our
takeaways and then that's kind of the
stream we're not going to index the
internet in the stream
it's unclear even what indexing the
internet would mean
right like
in some ways this problem has been
solved by aggregators
well let's see
is everyone on hacker news to say
past no
so this is not what i want what i want
to know is what were the top stories
ever on acro news but no that might not
really work
either my first thought here is like you
know in china they give everybody this
test
uh and then the students who score in
the top point one percent of it
like go to like chinguan university or
something like the top university there
um the problem is the top
taking from the randomly sampling from
the top five percent of test takers
is probably better at achieving almost
any desired outcome
than taking the top point one
because you get weird people who are
frequently good at tests and not much
else
um
you guys crashed yukowski's site how
many people are watching this right
wow 13 12.
wow people are interested in this stuff
it's interesting
um
all right i think this is most of
today's stream
no let's let's really try to come up
with a coherent summary of take away
what does it mean to organize the
world's information
um
oh wait i want to do this
oh never mind i don't wanna i don't
wanna train anybody for
government business insider trash no i'm
hungry i didn't eat any food today
all i had was that coffee i gotta go at
lunch
um i'm in new york city i love new york
city
go out get some new york city pizza
you know i got a date tonight
it's all good it's all good life's good
man
life is good how much is my college
gonna cost
so here's another thing about that um a
few things
uh admissions is uh just an iq test
um and everybody who has uh does uh 130
or better can
can come um and freshman year is free
uh so like here might hear my thoughts
uh yeah
above 130 on an iq test and freshman
year is free
and then at every like
after the semester you have your final
exams and
there's a hard cut off it's not
nothing's curved but there's a hard cut
off and everybody below the hard cut off
is
is kicked out um they fail and they're
kicked out
uh yeah and then for sophomore junior
and senior year
i'd like to charge what you could
comfortably make in a tech internship in
a summer
so something like 15 grand a year
students are not required to use vm no
and you know with respect to the sat
correlates with iq very well
yeah so yeah i mean i think that one of
the things we could do i mean i'd want
to make a research university and i'd
want to do a lot of research into
uh intelligence tests and what
intelligence is i'm very interested in
intelligence
um not just human intelligence but
machine intelligence all
kinds machine intelligence systemic
intelligence corporate intelligence
intelligence services um
this is another another startup idea
that we talk about sometimes is um
making a a private nsa
like uh as a parent here kind of but
what if we made like penalty for people
like what if you made a private
investigation company but like really
good
um 130
you could say 130 is low and we would
see i mean we'd see as this grows
we might have to introduce other uh
objective criteria
in the cutoff um let's let's google
something i don't want to say this if it
isn't true
um but how mit
uh rose to prominence
um
i don't know this is hard to find but
what i'll say is the the theory that
i've heard about mit's rise to
prominence
is a harvard discriminated in ways mit
did not
um and i think today's universities are
discriminating
uh like they discriminate based on i
mean now they're throwing the sat out
entirely
where the s.a.t you at least have some
objective standard um now it's entirely
nepotistic bullshit right or oh how do
you write on an essay oh we want
well-rounded students right all this
stuff is completely so the
admissions people can use whatever
subjective criteria they want right
there are no more
they want to do away with the last bit
of objective criteria in college
admissions
um
with regard to iq is a really bad
indicator of intelligence
uh all right
this was posted mainstream
uh science on race and intelligence
i don't agree with everything in this
document but
this was posted signed by
uh 52 university professors in 1994
and we won't talk about the race ones
but
um intelligence is a very general mental
capability uh it reflects a broader and
deeper capability for comprehending our
surroundings
intelligence so defined can be measured
and iq tests measure it well
intelligence tests measure well they are
among the most accurate
in technical terms reliable and valid of
all psychological tests and
assessment um well there are different
types of intelligence tests
they all measure the same intelligence
so like you say iq tests are bad tests
of
intelligence i mean you can define
intelligence to mean whatever you want
if you define intelligence to mean piano
playing skills and that's probably true
but iq is strongly related probably more
so than any other single measurable
human trait
to many important educational
occupational
uh economic and social outcomes whatever
iq tests measure it's a great practical
and social importance
um oh yeah well i mean this is in a way
this is one of the real
taboo truths in society right uh and i
don't know i mean
you guys know my opinion on on dealing
with uh with truth
don't you need a psychologist to conduct
the iq test
i think for the high end ones you do
what did tele say about iq
she was largely a pseudo-scientific
swindle
i mean the fact that telev wrote this is
it's interesting
i don't know maybe i'm really not
prepared to have this debate
can i tell you what i'm doing with your
uh
subscription fee um you're funding
uh chinese click forms
that promote my content on tick tock
uh because i work for the kardashians
all right read and review the article
this is the best measure in psychology
well let's let's let's contrast this
with
i mean did i get scammed right and i i'm
i'm
considering that i that i may have
gotten scammed with this stuff
um i generally
took this as mostly true um it may not
be
and i would i would certainly accept
that
um if it was true and this is i know
yeah you're not supposed to talk about
this stuff yeah cancel me whatever
whatever whatever
i mean okay so how do we find truth on
this
um i mean yeah i guess this is like it's
just it's a really
kind of biased topic right
iq correlates
i do not want a business insider article
maybe scientific american let's see what
wikipedia says
people who store hot who score high on
iq tests become
iq researchers
but it's not it's not a topic i i've
heard also about like fluidic
intelligence
and crystalline intelligence
and if you think about like iq measures
uh fluidic intelligence
yeah that's a sad truth too
fluid intelligence peaks at around age
20 i mean this is this has been
this has been a thing in my life like i
could remember
um getting better at things and not just
at specific tasks
but getting better at getting better at
things and this has stopped
and it's a sad i mean it's just a sad
thing in life
the validity of iq is pretty good at
least according to my professors
i mean it's possible right so you you if
you
view if you're communist you can't have
something like iq
right um because well you know
iq goes against equality right
um especially if it correlates with
let's scott alexander
i think in his he had a post about it
where he said basically it correlates
with
almost everything people would consider
a positive trait except
for uh likely to reproduce
well so okay i mean let's let's assume
that there is some test you can give and
here's here's really
you're right like let's think about what
i would actually want maybe i'm naive to
think that it's as simple as an iq test
all i know is that an iq test is a whole
lot more
fair than
a legacy than saying you can go here
because your father went here because
your grandfather went here or crap like
that
well the problem with a math test is
you're testing for whether somebody
learned math what you really want to
test for is somebody's capability to
learn
right um i mean one way to do this may
be to make a game
like if you make a game up where maybe
this is better
if you make a game up where there's this
movie the wizard
where the last scene people play uh
super mario 3 and
i mean the movie is just pretty much a
scam to introduce super mario 3.
sat does correlate sat iq correlation
see if we can find paper
uh you know what i realized that like
you can't have this conversation
like
yeah you know you shouldn't yeah i
honestly you know i shouldn't even
brought this stuff up right
because it's not
i mean maybe this is a big problem like
in society with this stuff in general
you develop stuff that's basically
proxies for iq tests because you don't
want to use iq tests directly
but i mean this is my theory about the
internet and overall internet decline
right as something becomes easier to use
like if you have the internet in a way
used to have
an intelligence barrier maybe not just
an intelligence barrier but a
like motivational barrier to get onto it
think about how you use your voice yeah
fuck off that shit
um no i hate those people i hate those
think about how you use your voice
people right
i will always speak truth now i'm not
going to repent for the truth
when they come and they put me in the
handcuffs
uh and they yeah you know what honestly
if if they like started torturing me
maybe i'd repent
but you know you'd have to physically
torture me
reddit's not anymore so what okay let's
think about something more constructive
right
google
uses this thing called navboost
and part of the problem with things that
look like this is like
there's no way to downvote right not
clicking on a link
is nowhere near as strong as a down vote
is saying like there's no way to say
this link is bad right um say for
example you do a google search where
there's there's two links
and
like link one
is good and exactly what you want but
link two is also pretty good
right versus the scenario where link one
is
terrible and link two is exactly what
you want right there's no way to
distinguish terrible
from also pretty good uh where like
there's no there's no inhibitory
connections like that now different
social media sites have done this kind
of differently right some of them have
upvotes and down
votes some of them only have upvotes
youtube comments have upvotes
and down votes where they don't show you
the number
uh don't let masses determine
what's um what's good or not
who determines that right
like is there like a hm
so you have curated blogs you you have
curated blogs guern's a curated blog
hmm
i mean this this is this is this is
interesting stuff too
um
one of the things that
some countries going to do this
right some country is going to start
intelligence amplification i don't know
how all this works
but if you could do the you know okay so
you you you give
let's assume iq is valid i'm not gonna
not gonna have that debate but um
whatever your proxy method is right or
you want wealth you want anything you
want to make you want to make rich kids
you want to make smart kids the same
same method works um take
tons of people's dna and then do
correlation analysis
figure out which genes are you know more
more likely to make intelligent which
genes are more likely to make you rich
and then do embryo selection on that
um you might even be able to do this
like recursively right you can maybe do
it every other generation
but the first country that does this
is going to in my opinion so clearly
dominate the world
no this isn't gattica right gattaca is
about taking the people who are already
born and saying you can or can't do this
based on
um intelligence tests or based on
genetic tests for
whatever proxies they want uh but this
is just it's
i mean it's it's a form of it's a form
of eugenics right
um again oh eugenics it gets a bad rap
yeah because you know
historically eugenics has been used to
force people to do things
this isn't forcing anybody
it's really interesting
oh see you gotta trust corn
studies of economics typically find that
one iq point corresponds to an increase
of wages on the order of one percent
other
things equal
see this is this is how everybody in the
world should talk
i wish i could talk more like this you
know we should all strive to
a whole list of citations
and i trust that like warren read it
correctly
all right all right let's let's go back
to teleps thing on iq
yeah this is the whole thing is
derailment unfortunately
but now i feel like you know
here's maybe uh a good rule of thumb
right
i heard a
uh
this was in a class on on relationships
at northwestern
where the professor said in order to
to have a successful relationship uh you
have to have sex five
times more than you fight for every one
fight
um you have to uh couples that do this
couples that show
this basic ratio do well i don't know
completely anecdotal but
i mean i almost think the same thing
with controversy and like you know real
real truthful right you you need to you
can't have just controversy
but if you have no if you if you're just
finding truth about esoteric things the
unobama refers this to this is like
surrogate activities right
like truths that are completely
irrelevant to
the modern world like oh well no
so algae is turned from blue to
yellow in the presence of dimethyl
sulfoxide like okay
i mean that might be true but it's
irrelevant you need to keep a good ratio
you need to keep a good ratio between
controversy and uh
and truth finding with a whole lot more
truth finding a whole lot more sex
than um i'll read some stuff on
interpretation of statistics
if an idea unless it's an unreasoned
ideological immune response my prior is
that it's true
no i mean i think one big example
against that is like holocaust denialism
right you have people who get very upset
about that
but like you know it doesn't mean it's
true right which is which is weird i
always find these denialism things
um climate change denialism there's a
big ideological immune response
uh to that like people oh how could they
say climate change isn't real
but like i don't know it seems real
at least like to an extent
i don't trust the atlantic i don't trust
any news websites on this
news is propaganda
um okay so let's let's let's analyze
this as as dispassionately as possible
um
iq is a stale test
so i'm not sure what that means right
like because it's old it's not good
i think generally we found on the stream
that the opposite is true
um
the concept is poorly thought out
mathematically by the field
see just just just just looking at these
two things
from a uh
like kind of naive perspective this one
has a lot of studies
this one it has a lot of links to to
external studies where you can verify
each statement whereas this whole
paragraph doesn't
right um and then this is this is uh
this is a logical fallacy
right um just because racists say the
sun is shining doesn't mean it's dark
outside right
um just because it's promoted by bad
people doesn't necessarily make it bad
see i like i don't this also it's like
it's promoted by psychometrics pedalers
looking for suckers
military boo large corporations boo
i don't know
i mean okay so this is this is a very
good point
if there's a good citation of this right
if the effect is
actually lower than the variance between
tests for the same individual
morality doesn't always relate to truth
i don't know i don't like i don't see
just just looking at these two things as
objectively as possible
and and ask the question i mean look at
this stuff
you know you're tagging racism and
alt-right
uh who gives these people a platform who
like who
whoever invoking the name
god you know i did it now and like this
is
i mean this is the real problem this is
the real problem with with
this whole peta approach to everything
these days
which is
you care about animal ethics okay let's
generate as much outrage as possible to
get our message out there
if someone shows me something that looks
like this something that
makes this point but stated like this
i'm much more inclined to believe that
um you know i find
larry summers was the uh was the
president of harvard
um
so he was fired for uh
well not exactly sure why he was fired
but
i i really liked what stephen pinker
said
um influential psychologist stephen
pinker defended legitimacy of summer's
january lecture
um when asked if summer's talk was
within the pale of legitimate academic
discourse he responded
good grief shouldn't everything be
within the pale of legitimate academic
discourse as long as it's presented with
some degree of rigor
this is the difference between the
university in the madrasa there is
certainly enough evidence for the
hypothesis to be taken seriously
um and you can read you can read the the
talk and make up your own opinion but
i i'll like
i've been thinking about this for a
while and i think probably the only
solution
to this whole problem here is building
new universities
is building new universities where the
point
of the university actually is the
pursuit of truth
because i'm not sure that's true for
2020 harvard
um yeah online iq tests are very they're
very much like online personality tests
you know
oh figure out which which jonas brother
are you the most like
pinker gets way too much shit for
stating the world's become a better
place over time
no doom we must promote doom and gloom
yeah yeah all right so how do we end up
here
um how do we end up here from
from trying to make a better search
engine
in a way maybe that's
no but this is okay this this problem is
this problem is easier to solve
the search engine problem is easier to
solve
what you really want to figure out is
for each website what was the intent of
its creation
right and even if you didn't
like explicitly rank based on that i
mean imagine
you you just
tagged everything with that right tag
everything with
going back to that like jessica thing
right
um
how do i find my passion yes so
like if this website just were tagged
with the call to action
all right like like like
i did the uh i did the tech crunch talk
i did the tech crunch comma talk
um one of the youtube comments
criticized me it said
uh this doesn't have a good call to
action
and i mean they were kind of right
from a marketing perspective what you
want to do i've gotten better about this
the medium post is you want to at the
basically at the bottom after someone's
bought in you know they've read all of
this here are the seven questions i ask
myself to discover my passion
um
this is the
like call to action right this is
the whole purpose of the post is to get
you to click that link
this is this is foreplay for the link
basically um if you just put the link
right up here
well no i mean some people might want to
sign up for the free 30-day life purpose
challenge right but like like like be
honest in your intentions
yeah i don't know
are we about to live through a decline
is there anything we can do about it
no it's not it's not climate change
all of these all of these
technical problems could be solved
relatively easily
uh there's a quote from um permutation
city
where let's see if i can find it
um
the quote was something along the lines
of see
again that's not
these aren't these aren't people trying
to
um promote any bullshit that's
legitimately just a hard search i'm sure
my things aren't perfect
though actually if i posted that on
reddit and somebody had the book i'm
sure they could find it so that's really
um what you want
but
the quote basically is that like the
environment is is is
already entirely man-made when people
are like oh we want to restore to a
pristine state of nature there is no
pristine state of nature
everything about our environment is
entirely controlled
so you know let's build the best one we
possibly can
you know
on a personal level about this stuff
the singularity is extremely scary and
it's been scary to me for a really long
time
i worry so much
if we're not a society that can
understand believe comprehend and
embrace basic truths
how are we going to deal with the
immense power that technology is about
to give to us
uh
look at what look at what we built the
internet man internet
beautiful thing ever the internet the
internet is the greatest the greatest
equalizer
uh in the history of mankind and
i increasingly feel like it's been
weaponized
it has been it has been weaponized for
not even
not even by a group of people and that's
why
conspiracy theories are so alluring to
so many people
the belief that there is an evil cabal
of lizard men
actually running anything everything is
actually more comforting than the truth
which is the lizard man lives within all
of us
so i don't know we may not have a long
time
um another thing that was brought up was
i'm not afraid of uh
self-improving recursively
self-improving ais
i'm not afraid of the machines going out
of control and doing not what they're
told
i'm afraid of the machines doing exactly
what they're told i'm just afraid of
what they're going to be told
the problem with nuclear bombs isn't
accidental explosions it's deliberate
explosions
and ai is going to be the same way
conspiracy theories are usually easier
to understand than the truth i mean
yeah there's a classic there's a classic
one about that too and it's like
um well so you know you could believe
that that you know the the lightning
storm is caused by
uh the positive and negative ions mixing
in the upper ionosphere
which generated the lightning bolt which
struck and killed your
your daughter and it was kind of a
random fluke of nature
or you can believe that the woman down
the street is a witch who summoned up an
evil lightning bolt to murder your
daughter
right that's oh that's a good theory man
burn the witch
who's gonna save the world
let's improve the internet first i mean
in some ways if we did improve the
internet
how much of our thought is now being
structured
by twitter and google and facebook how
much of the world's thought
is now being structured by these
vortexes
this isn't a joke anymore you know the
internet starts
it all starts out as oh hey it's all fun
and games it's
it's horrifying now in some ways did we
miss the singularity did it already
happen
are the machines already playing us or
are we just are we just
fodder the machines want the likes man
the machines are learning to improve the
likes
and um
you you make the like for the machine
are we all raging at the collective
obsolescence of humanity yo
how many computers died from coronavirus
none
okay i tried to read nick land i found i
found it difficult
um computers have this cool
computers don't learn the same way
humans do
um computers or this fourth paradigm of
learning if you think of the first
paradigm of learning is like
single-celled organisms
and single-celled organisms learn not to
go to the light by all the ones going to
the light dying whatever genetic code
makes them go to the light uh dies out
slowly and then you know they all go
away from the light
right uh first paranoid of learning the
second paradigm of learning is like how
rats learn right you can take a cage in
a
you know put around a cage and electrify
one of the grid cells and the rat
touches it the rats like oh yeah that
hurt
um and the rat won't uh the rat will go
away
and not touch it anymore and they might
even be able to communicate this to the
fellow rats in the cage but they're
definitely not going to leave a rat
encyclopedia about how you shouldn't go
to that
tile on the third paradigm of learning
is human it's cultural
right we learn god we all thought there
was deep things in 2000 years of chess
culture until
until alpha zero came around and uh
relearned all of chess and rediscovered
all of chess theory in 24 hours
um but yeah humans learn culturally and
pass things down through generations and
you stand on the shoulder of giants
that's a good quote
uh and then there's this fourth paradigm
of learning and the fourth paradigm of
learning
is i know kung fu the fourth pound i'm
learning is plugging a wire into the
back of your head and instead of having
to go through 10 years of training sure
you can learn it through books but the
learning itself is still
hard you just put the thing in and say i
know kung fu
and that's how computers learn
um
you have a hard time relating to my
concerns well
because of maslov's hierarchy of needs
right
uh there's no more points of view when
your only thought is food
the bible has replaced been replaced
with a survival guide
that uses perishables instead of
parables because there's no stories left
to preach
there's no life lessons left to teach
anyone why bother
who are we this is from the nofx song
you know i could i could play the song
but
uh then i'll get copyright striked who
are we are we the intellects or the
insects
we're not the ones who will ever know
the answer it's impossible for us to
imagine what's right in front of us and
i guess that's what makes us human
but being human only lets us see a
little further than the animals
oh right like you say yeah okay whatever
your whatever your needs are
now like look i do i care
do i care if if the world's on board
with fighting the singularity what does
fighting the singularity even mean
right do we do we not the unibomber do
we mail bombs the compsci professors
kidding bro like that's a joke like like
why you do that
you know it's it's a dumb i don't know
like like and i understand the feeling
of
of powerlessness but
ban computers now ban computers now you
can't go back
technology doesn't work that way name a
technology that's successfully been
banned
how is nuclear proliferation
well yeah but i don't think
i i wonder if the right metric here is
not
number of nuclear missiles right if one
person has
ten thousand nuclear missiles that's not
so different i would much rather
one person have ten thousand nuclear
missiles than a hundred people each have
one
that's a doomsday clock
all right i think we'll leave you guys i
think i have i have a little
presentation
um that i gave
we could do this presentation
um
guys i don't know how to fix a voice i
don't know how to fix it you know
um disclaimer
all right
uh so yeah you have uh synapses and
neurons
uh so when you look at this is the new
tesla chip
um they have multiply accumulates uh
multiplies look like synapses
and accumulate to look like neurons
right so you have uh different
well i think i have yeah the synapse is
a multiplier with a learned weight and
the neuron is an accumulator
um so max approximately correspond
to the number of synapses right not to
the number of neurons
uh because the neuron is all of the the
accumulation done
uh so bioflops is synapses times clock
rate right
so that's the metric we're going to use
um so here's uh
your boy c elegans um c elegans is about
the same as an altair 8800
uh so this is the smallest uh organism
with
a nervous system um
as i said and right how many neurons it
has it has like 200 neurons and that's
maybe
what you could simulate in an altair um
we have an ant uh and it's about two
gigaflops
of compute power you know a surprising
amount big leap from c elegans to ants
and that's about a raspberry pi
an old raspberry pi the new ones have a
bit more but so you know
raspberry pi and about the same that's
about 20 000 c elegans
uh so here's a b uh b is about 500 amps
they're way smarter than ants look at
them you can just tell right
that thing looks dumb man looks dumb
that looks a lot smarter you know it
grew all those little fuzzies it has all
those little intricate feelers
um b has about uh
200 gigaflops compute which is about the
same as a
uh common two um
and it's about 500 ants i'll say you get
to a mouse
uh if you guys have ever i mean i'm sure
you know you've interacted with bees
and auntie you crush an ant you know
okay yeah yeah okay it's an ant
um a b well they're a little more
skeptical of bees you know you can tell
every you kind of know intuitively that
bees are a bit of chappy versus virgin
ant
um a mouse
uh 100 teraflops
so about the same as a bunch of uh as a
bunch of g-forces and
i had when i lived in palo alto i had
two pet mice princess and misty
uh and yeah i taught them to i taught
them to run mazes
and they're very they're very smart and
you can you can tell they're clever you
just look at them and you're like wow
um so that's 100 teraflops gets you yes
a cat is about two petaflops
uh maybe one rack um
i don't think i have it in here but for
reference dogs are actually they're
about
twice the neurons of of cats so you know
dog dog owners
a cat's about 20 mice uh that seems
about seems about right
um humans are 20 peter flops or about 10
cats
you you know whenever a cat lady has
more than 10 cats
the total number of cat flops in her
apartment
exceeds her number of flops um how is
this measured it's synapses times clock
rate
right bioflops um you can look
wikipedia's got a good uh
got a good article for this
um
this tells you uh so this is neurons
but synapses is just it's your fan out
factor on neurons
so you can go through all the animals
and it's a rough ranking of
um you know then you get uh humans and
then
god tier elephants
so human about 20 cats and is about one
rack of google tpu v3s
uh bioflopsy now this time clock right
so here's basically a summarization
um putting it in uh in log scale
um now it's wrong to talk about
um you can't do much with twenty page
flaps uh humanity is
a network uh so this is the the world
population there's you know real
singularity looking looking stuff right
there is no singularity and exponential
looks
the same every point you zoom to
um cats are not networked
uh cats are solo animals dogs are on
lands but only humans are networked like
the internet
um this is years and population
the rise of humanity was due to our
collective intelligence
i see no reason why we should assume the
brain software is particularly
good given its hardware
compute is a good proxy for intelligence
broadly
if you believe these three things oh
yeah software and hardware proceed
similar rates i saw i saw
more concrete breakdown of this recently
there's just an open ai paper that
talked about this
number of bio flops in the world
well 7.8 billion people
uh this is just a rough like the cats
and the mice don't really count for much
so the total number of flops
in humanity is like 10 to the 26th
so we got like 10 to the 26 total flies
how many total silicon flops are there
in the world
a hundred billion pedo flops or a
hundred trillion teraflops so for
reference your phone is
approximately a teraflop they're more
now
but clearly you know let's say there's
10 billion phones in the world 100
trillion is uh
10 000 times bigger so there's a lot
more biological compute in the world
than silicon compute it's total computer
civilization
number of silicon flux in the world
about 10 to the 21 so we're off by a
factor of about 10 to the 5.
here's the trend over time
at some point before this happens
assuming current
growth rates of computers
stay the same which they may not as
computers become more economically
productive we may put
more and more of our resources uh into
building computers
but either way
oh yeah the human population
when the green line goes above the blue
line
we are no longer the dominant species on
the planet
so how long do we have well
30 years 40 years
uh the end of humanity has already been
very clearly predicted
not the end right we're just no longer
the horses didn't there are still horses
there's a few horses
you know we let children ride them at
the zoos and say
come ride the human witness the
antiquated human as it struggles to use
a keyboard
um
i hope we're getting pets i mean there's
a lot worse fates than pets
think of all the poor cows and chickens
in the world
um
oh no we definitely don't uh war
at least like old school style you know
give a lot of young men guns and tell
them to march in that vague direction
war
happens when your population uh
pyramids look like this right this is
why you get
uh local wars in africa because you have
such a top-heavy uh
population the we'll do that quick aside
u.s population versus like
nigeria population versus japan
i mean here's u.s versus nigeria right
um the united states one is rather
phallic
uh and people believe social security's
gonna work
well i i mean so this idea that like
like we're going to enter a new world
war is from my pers like looking at this
unlikely right who's going to fight this
war we're going to send the boomers
like i don't know about that um is it
going to be some weird
proxy cyber cold war thing that's been
going on for the last 50 years sure
um
the computers are reproducing a ton
faster than we are
in 2055 we're no longer the dominant
species on the planet
um total compute ever
so about a trillion alpha zeros that's
this is this is open ai's metric
uh pay to flop second days
um and then if you're a pure culturalist
if you believe humanity is actually its
culture when have computers
done more flops than the total of
humanity
it's 10 years later right so if you
really want to make a culturalist
hypothesis so yeah 1990
all the compute in the world was one
human oh guys it's so
cute look what it can do oh it can
almost do human thingies
2012 supercomputer crossed one human oh
man it beat us at chess
oh but it is only it is only one one one
human there's only like 500
supercomputers that's only 500 human
we've we we've taken out smaller towns
in that in
in nam and another one was fine man you
know
um yeah so here we are in 2020
and a silicon human costs about 1
million dollars
and there's about 100 000 silicon humans
right
so what's that the population of oh yeah
2038 you know i like that date for the
singularity
um pc crosses one human uh 2055
silicon flops more than bio silicon
compute more than bio compute
is this the singularity well my
definition is when humans are capable
well computers are capable of doing
everything humans can do at least as
well
moore's law's law of human economics we
know this stuff
um the top computer is 200 petaflops
it's about 10 humans
it's well under the number meaning teams
of humans who can effectively
collaborate
right can computers effectively
collaborate well computers can't really
collaborate in inflexible
uh ways we haven't seen computers
capable of collaborating in flexible
ways the way humans can
so teams of humans are now the dominant
driver of moore's law
but once computers are 100x faster
it kind of stands to reason that we can
put a thousand humans of compute in one
box
humans may no longer be the high-end
driver of things
meaning this is going to accelerate even
faster singularities in 2038
uh yeah you can read those if you want
to be be
make some make some arguments against
this basic hypothesis but really look
i got 18 years you know what can i do
google facebook
who are you what are you doing
what are you doing oh yeah man how many
ad dollars you made next quarter yeah
that's really gonna matter bro
that's really gonna matter all right the
apocalypse is nigh
2038 uh
maybe next stream so like every good
apocalypse salesman
you know i i i bring you in i tell you
what the solution is the solution is
going to be to sign up for my college
and we'll fight the singularity together
um
yeah uh nothing matters human extinction
is inevitable no
guys you can choose today to fight the
power i don't know if that's true or not
but it's sure better than like being a
doomer man
you know who likes doomers
um and
think the most important thing to
realize
in your life you can disagree with this
but if you are fundamentally in a
religious manner denying truth
right like your heaven's gateman
what if the rest of the world is a death
cult what if we live in a death cult
what if mainstream society is a death
cult
what do you do what if you build a cult
where the cult pursues honest rational
truth it would look like a cult today
and that's scary
um all right i gotta eat food thank you
all for watching the stream
um
you know what else can i do
what else can i do can i build a search
engine to fight against google
maybe is that the best way
fix the nsav cheerleader save the world
fix the internet save the world
plausible
don't be evil
build a new world yeah bro give me a
death note and i will
make i will purify the world uh if you
guys haven't watched that's my death
that's incredible
um could you save the world with a death
note probably not
the terror i don't know it's great the
anime explores it all
pretty well
um the way google is built do you need
to build something more evil than google
to beat it
maybe
time for career advice
yo
wake up um
i don't know how many people in how many
people in chat like
believe in a fairly imminent singularity
i'm seeing like 50 50. uh
to those that do believe have you truly
internalized that belief
do you think about it every day this is
your future this is your real future
global warming is an easy problem to
solve with like compared to this
right um humanity didn't grow
big brains because we needed to solve
natural problems we grew big brains kind
of for politics
right this one was
something i said i was home with my
family it's like what have i done with
the last six years of my life i've done
politics
what is what is founding a company maybe
that's why i hate it so much
um but
no it's applied politics right
we didn't grow big brains i don't know
man except for them elephants we sure
did
um yeah but if we get off fossil fuels
and we switch everything to electric
the singularity is still coming in 2038
well no i mean what is what is running a
company right running a company is
political
like right you're dealing with you're
dealing with
uh how to balance the needs and wants of
many people versus the needs and the
wants of
a clientele of investors
um
it's money in power uh
i don't know can we all join a pact and
be like
bro i really don't want money in power i
just want some semblance of uh
hope for the future i hope i mean that's
the wrong way to think about it i want
to
um i was at a i was at a dinner with
some uh
maybe maybe i don't think they'd be
upset if i'd characterize them as like
right wingish type of people
and one thing that like saddened me
about it
um is i didn't hear
like a positive vision for the future
i i certainly don't hear one from from
um
you know like communists right
um who has one
is that what we need
eat the rich steal their shit man
lifestyles in the rich and famous yeah
man
all right all right you're a cow you're
a cow right before the rise of humanity
man
and and you're sitting there and you're
like eat the rich cows
the spotted white cows you know
oh yeah you know whatever whatever
bullshit cow politics you're all doing
and now
look at the cows today you ever seen a a
cow factory farm you know
look at the cows today man
yeah yeah you know
these cows used to be fighting over oh
well i want this pasture i want this
pasture
and now they're all in cages like humans
in the matrix
the brown cows stole our jar this is the
stupidity
man why are we about to get banned
because i spread the truth about cows
um i mean i'm just saying no
like to be very concrete and factual if
you're
a cat before the rise of humanity
right what do you do
you know this this new dominant species
is coming and you're tasty
you know you going vegan is you being
polite to the cows it's not a very good
but the cow should promote veganism
should we should we get together and
promote a system of ethics where the
machines don't enslave us
um lose the will to live we'll we'll
fight back well
i do have hope i do have hope for the
2020s
um
concretely one thing i have hoped for
and
i mean we try this a bit with comma ai
it was my best idea at the time
is decentralization the more
we can decentralize ai and power
uh the better off i think we're all
going to be
right um so
we see we see a lot of you know i think
i think
a lot of people would agree that
problems come
from these from these centralizations of
power and
even the centralizations of power
themselves may agree with that
all right like even the
um
i think i think mark zuckerberg went
before congress and said look please
regulate us right
you want me to regulate speech on the
platform you know tell me how to do it
i'll do it right
uh like once there is somebody to
to to to blame it's um
you know it becomes almost their
responsibility
so decentralized stuff doesn't really
seem to have
this problem or put it this way
it is much easier for people to accept
dying from cancer than dying from murder
because you can kind of accept death
from cancer
stoically maybe not so much anymore if
you believe in a treatment but at least
historically when people would get
cancer it's like
you know what it's it's uh it's my time
and god chose this for me it's a much
easier thing to accept
than um well
being murdered
genuine decentralization doesn't seem
reliable is this a technical problem
could certainly build a reliable
decentralized twitter wouldn't have been
hacked like
central estuary
centralization's not necessarily part of
the capitalist game
um maybe in a world where
money has influence in politics it does
but i don't think capitalism in general
is pro
centralization or decentralization uh
historically
the way that you make money is um
you know you build something for
everybody right you build something that
you're going to sell to millions of
people i guess this is still kind of
true
am i vegan no
um i mean am i gonna
am i gonna save the cows if i if i
became a vegan
no uh i will become a vegan
once there is artificial
hamburgers that taste identical with
cows
we have decentralized social media yeah
but
it's not as good right and i think
how about this and we could talk about
drug addiction under the same lens of
social media addiction
right if if somebody made
better heroin and better heroin
was made you feel the same way heroin
does
but it doesn't um
you know it's not addictive let's say
all right like it's a simple change we
could make to heroin
we could take heroin and we could make
non-addictive hair right and how you
actually do that let's assume it's
something like hyper complex i can
reverse the
uh i can like re-encode the memory to
not
re-trigger the pleasure when you think
about it um
i think most addicts would switch from
heroin to better heroin
of course they would who wants to be
addicted to something nobody um they
want the feeling but they don't want to
be addicted right so like
what is the the the better heroine of of
twitter
right uh what is the better heroine of
cow
so that's um
lab grown cow
non-addictive heroin all the health
benefits of addictive era
uh no linky presentation you guys saw it
here once
great adhd streams now it was pretty
adhd
um yeah i don't know that is what
organizing the world
like why do you want to do it right do i
want like a better search engine so i
can get the real truth about iceland
uh coronavirus results no i want a
better search engine so
people can find uh real truth
and not propaganda
all right thank you all for watching
great to have you all here we can uh
fight the future together
maybe i hope bye
we need to army we need to army
twitchy's we need an army
I need y'all to come in we got something
to do today we got a mission
I don't think this is working
Oh IRL stream yes IRL stream okay all
right we got one person something's kind
of working yo what up
oh yeah look we got people all right
look it's the first stream of 2019
welcome welcome no no no we got we got
yeah look man look a loss happened I'm
just saying a lots happened in my life
you know this is an iPhone eight I don't
got the ax because I don't like the
knotch yo well welcome welcome welcome
remember no talking about coming iron
low gang we'll come get your sub-tab
YouTube absolutely self-defeat oh hi
what up what up
we're are right I'm in LA you guys I'm
in LA and I just want to tell you all 76
I let's get over a hundred and then
we'll start with what we're talking
about guys all right so as you can see
from my beard some girls said that to me
once weird flex but okay and then I
googled it and it was like a thing and
I'm like okay that make sounds kind of
yeah as you can see I've been I've been
I've been wandering the world when are
we gonna stream coding I don't know guys
I look I we got we got 124 people in
here thank you for joining thank you for
joining my my stream I'm here in
beautiful slightly cloudy LA to tell you
guys something and I don't know if I'm
allowed to say this on Twitch but I'm
gonna say it anyway
now well am i homeless sort of sort of
but that's not what we're here to talk
about you guys I want to tell you about
my 2019 dream and my 2019 dream is to be
an Instagram celebrity alright so I'm
sure one of you out there works for
Facebook or knows somebody who works for
Facebook
you guys go out there and I want to be
an Instagram celebrity that's right I
have a dream I want to be in you know
those people with the girls and the cars
and the private jets I'm gonna be an
Instagram celebrity with all the money
that I made from you guys subscribing to
my twitch stream so my Instagram handle
is just George Hotz straight up using my
real name my 20:19 dream is to be an
Instagram celebrity you know I'm gonna
be doing lots of stuff to promote my
personal brand you can watch my
south-by-southwest talk coming up is
called jailbreaking the simulation that
might be kind of fun but go right now go
on your instagrams I know you all have
them and click that click that like and
subscribe button or follow or I don't
know what it is on Instagram but my
Instagram is just George Hotz alright so
also also and I know one of you works
for Facebook out there I need you to get
me verified I need that blue checkmark
the blue checkmark is how you can tell
this is the same cadence that I talked
about for the subscribers how you can
tell who's important and who's not so my
dream in life is to be my dream of 2019
only 2019 is to be a Instagram celebrity
I've been talking about this for a week
now so you know it's a no it's an
important dream I look the hair's gotten
really long you guys the hair's gotten
long it's good it's gotten real long
nope no I've not this isn't a joke you
think I'm joking I'm not joking what I
need you to do is first off follow me on
Instagram and second off if you know
people at Instagram I need you all to
contact them and make sure to get George
Hotz verified if you guys do this I
promise great high-quality content for
you so it's not twitch this year twitch
was last year you all know some common
archive guy went and put all my twitch
streams on YouTube you know we're
getting mad views but
what I've realized is that it's the
future and you need to build a personal
brand and you need to monetize that
personal brand and I want you to all be
here with me on this journey of personal
brand monetization this is my Instagram
at George Hotz you can see the most
recent one is a picture I mean I don't
really know much about Instagram I do
know it's a facebook property and you
all know how I feel about Facebook but
I've also heard that that people get
lots of money for sponsored posts on
Instagram sponsored posts on Instagram
so if you guys want to see that become a
reality if you guys want to see the geo
hot keyboard brand you know we're gonna
make some branded keyboards what do you
think Brandon keyboards I know you were
always asking about the keyboard um no
streaming programming was 2019 shaving
programming was 2018 it's 2019 and my
new dream is to be an Instagram
celebrity what we're gonna make lots of
money and it's gonna be like you're on
this journey with me
except you know I get the money but if
still you'll get to see the money and I
read a study once that showed that that
was very similar no I tried playing for
at night I was pretty bad at it but
yo-yo it has been a long time it has
been a long time so if you guys have any
questions I should get a dog I thought
about buying a house
unemployed give me a job I don't know
who's giving you a job man look look at
my beard do I look like I have jobs to
give people but if I do become an
Instagram influencers celebrity you know
Instagram celebrity I'll hire like
editors and you know people to follow me
around and bodyguards and whatever
whatever all those doesn't it sound fun
no but yeah get geo verified exactly I'm
verified on Twitter but guys I have a
you know I used to be addicted to
Twitter so I can't tweet you know I
might relapse and go back on Twitter um
yeah you missed the Skokie's uh you
weren't calming eyes discord yeah I am
y'all are discord now you should buy a
semi-truck you could live in it I
thought about buying a station wagon and
living in it um yeah yeah to help my
Instagram get verified I linked to my
Wikipedia but I used to link to my
soundcloud we're gonna personal brand
you know everyone needs a personal brand
these days right like there's two things
you can do about the future right you
can either be upset or follow the
Microsoft pattern of embrace extend
extinguish right and that's what we're
going with your embrace extend
extinguish and we're on step one of that
right now we're on the embrace side of
things so yo you guys go follow me on
instagram at george hotz it's just my
name no no no no I'm not this isn't
common AI related this is a personal
George Hotz property the car may i sir
properties of course property of comma
AI you know social is a brand these days
guys got a thank you Pharisee though I
don't know who Terry Davis's who is that
but yeah guys you should stop smoking
pot I mean that's that's the option I
want to get with the times I don't want
to be one of those left behind integrate
the internet celebrities like iJustine
who's Terry Davis
is that someone cool says someone I
should know I kind of know things like
that if I want to be Instagram famous I
know as I'm telling I was hanging out I
think it was last weekend two weekends
ago now is hanging out and I was like
I'm gonna be an Instagram celebrity in
2019 you guys watch you missed the old
geo ha you know what some people miss
the old Drake and I miss the old Drake
too before you had a kid that's right Oh
Temple OS yeah ya know we were just
talking about temple of us build
automated farming equipment is this my
hippie face you guys can call it
whatever you want but all I'm saying is
go right now follow me on instagram
george hotz and get me verified so if
any you work for facebook or know
somebody who works for facebook i really
appreciate it
no i don't know man I don't know but
I'll see you all later
I got things to do absolutely I do the
Joe Rogan podcast absolutely you could
do what you're doing on Twitter no I
don't tweet man I got a Twitter but you
launder the putt yeah Ilana you want you
know calming I exist man calming I exist
they have some crazy announcements
coming up too but I'm here and if you
guys want to see what comes next at door
tots on Instagram
I'll see you all later but bye bye bye
bye bye bye Twiggy's
I don't know how to end these things oh
ya know if you guys get me oh no I will
do will do two more questions we got any
more questions got any more questions I
can't figure out Adams I can't figure
out and I don't know how to click the
button hi bye love ya Joe Rogan that'd
be sick guys um no I don't know the
future is gonna be an interesting place
my Instagram is at your charts am i
trespassing at someone's house don't
don't tell anybody
um no but uh you gotta ask this question
and this is the only question that's
gonna be relevant in the future its
where do you want to be when the
singularity plays out all right
I think if I swipe down down I swipe ya
the Instagram Instagram source that all
right bye-bye
down
my talk is about flashing ECU firmware
updates from a web browser more
specifically I did some reverse
engineering of the Honda firmware update
file format that they put out so that's
when were you talking about so Who am I
my name is greg hogan you can follow me
on twitter all the source code for the
software that i'm going to show you is
open-source you can find it in one or
more my github repositories and I work
at common AI on infrastructure which yes
you're wondering that has nothing to do
with car hacking
so a couple days ago I got an email and
it's a DEFCON 27 talk and I thought oh
this is information on like my speaking
gig here I opened up the email and no it
is from Honda so apparently they were
interested in my talk and I'll summarize
this for you it basically says don't do
something that might kill somebody that
was never my intention I won't be for
some reason they thought that I was
probably going to be releasing specific
modifications about making firmware
modifications to power steering
controllers of Honda vehicles that's not
the case I never planned on talking
about anything like that so that doesn't
change anything that I'm going to be
talking about also this is a completely
legitimate thing to ask of someone to
make sure you don't do something that
could injure somebody and I agree
completely that trying to make changes
to your electronic power steering
firmware of your car could be very
dangerous if you screw something up the
best case might be that the steering
wheel tries to break your arms and the
worst case is it'll flip over your car
and kill you so please don't do anything
stupid and I have no intention of
enabling you to be able to do such
things
what got me interested in flashing ECU
firmware updates so in 2017 George Hotz
he's actually the guy that started the
company that I worked for he gave a talk
at code blue at a conference where he
kind of showed some you kind of showed
some information about like how you can
get these firmware updates from
different vehicle manufacturers and I
looked at these tools that he was
showing and I thought wow that's
software's garbage it looks like it runs
on like Windows XP and why isn't anyone
created anything better so that's kind
of what I what I set out to do
and I guess to to do that to enable that
in like a modern web development stack
that's why I decided to see if I could
make this work where I could flesh ECU's
from web browsers
it's basically what I'm going to show
you how to do is basically similar to
what like there so there's a whole
community of people who go out there and
they make changes to do like engine
tuning for their ECU's change like gas
fuel mixtures and stuff like that
they've basically done what I'm going to
show you they've figured out you know
how the firmware updates work for in
what I'm going to show you here Honda
vehicles and then they figure out how to
flash their own firmware updates
essentially without using the Honda
software to do so that they distribute
so how do you get the software and
firmware updates for these vehicles so
thanks to write to repair vehicle
manufacturers are basically required to
provide at a reasonable cost the
firmware updates for the tools basically
that enable any maintenance shop to be
able to do repair work so that you're
not like locked into going to a holiday
dealership and them like charging you
and I'm gonna like to do this kind of
stuff so anyone can sign up for these
these these websites Honda is really
cheap ten dollars for one day to
download the software that they provide
to their you know to their repair shops
and anyone who's like you know a repair
shop that repairs Honda vehicles they'll
you know subscribe to this also if you
subscribe for one day interestingly you
actually get three days so Toyota's a
little more expensive and you know
there's other vehicle manufactures well
I guess just one that does like over the
year updates and you don't have you you
know if you have the right access to
your car the firmware updates are
actually pushed to your vehicle so you
don't have to like pay to get them
so so I signed up and I downloaded the
software and I wish I could get that
four hours of my life back that it took
to install it it's horrible just like
from a UI perspective usability
perspective it's not great software the
authentication is over HTTP
like nobody's proud of themselves for
like working on the software I don't
think this is the new version this is
new for like I think like 2017 model
year vehicles or something like that the
old version looked even sadder
it's called HDS Honda for Honda its
Honda Diagnostics system in 2017 when
this new version came out they threw an
eye in the front of it my guess is
they're like trying to ride the Apple
train you know bandwagon or something
like I Oh s and so forth but using this
software is nothing like using an Apple
product you also need a piece of
hardware to interface with the car
through the ODB to port so that hardware
there's if you go to the Honda website
there's one there's one like certified
Hardware package that you can buy and it
is almost $1,500
sad because like it just does like stuff
that follows specifications that are
open you know that anyone can implement
because of right to repair basically
so one of those boxes on like that first
window was something called the J the J
2 v 3 for rewrite tool so what is that
thing that's the software that actually
does the firmware updates that actually
flashes your ECU's so the company I work
for they actually make an obd2 dongle
that has a USB port called a panda and
it's a lot cheaper than $1,500 product
that Honda sells it has an open-source
j2 534 driver which is basically the API
that that like the whatever for like
emissions testing and so forth they
defined it so that you know to enable
write to repair essentially and the
driver like it's not perfect but it'll
East works for can and so so I decided
to go down this path since it's so much
more cost-effective and the Panda has it
has a great Python library for
interacting with your vehicle over the
obd2 port and someone wrote a web USB
driver for it so I'll get into that a
little bit more but that's a big part of
what enables me being able to flash an
ECU from a web browser
so that four hours that I spend
installing the software on a really fast
machine another thing that it drops
alongside this executable is the actual
firmware updates so that's how you get
the actual firmware update files and
they're in this folder here that I
listed button
so okay now we've got a flashing tool
and we've got firmware updates so now
what we want to do is we want to reverse
engineer you know whatever the process
is so that I can replicate it and build
my own software that actually does this
so the first thing that I found was this
software called J 2 v 3 for lager
basically what that does is it acts as a
proxy to a real j2 5:34 driver the the J
2 v 3 4 spec so the reason part of the
reason that this software I did guess I
didn't mention this this Honda software
it only runs on Windows and the reason
that it only runs on Windows is because
the j2 5:34 API specifies things like
use these registry keys to find a dll
and load it so that's another reason
that I was interested in creating my own
software that flashes this because you
know if you break out of that you can
you know make something that's like
cross-platform there runs on a web
browser which should be cool
so basically you can you can fire up
that j2 five three four rewrite tool the
Honda puts out and fire up this install
this logger and if you have a vehicle
that has an ECU that has an update you
can apply it yourself with this software
and you can record it and it'll dump out
this big log file that has all the j2
534 API calls as well as like the raw
data that was sent and received back and
forth so then to you know kind of dig
deeper into what the actual steps are
that happened when you flash a honda ECU
firmware update we need to start
understanding some of these other specs
UDS unified Dinan gnostics that's like a
big one it has all the like commands
that j2 534 uses to actually communicate
with ECU make it feel like security
access key exchange and all these things
and send the firmware the next layer
down is is OTP I mention we just
mentioning these things because this is
what I have to implement if I'm going to
implement my own and a web browser
because as far as I know no one has
written one in JavaScript
all right so after recording flashing an
ECU from that j25 3/4 rewrite tool that
honda distributes here's what you come
up with basically more or less an
eight-step process here the first thing
that you have to do is you have to these
are all the names on the right are the
UDS message types essentially that you
have to send to communicate with your
car so basically you need to enter you
need to send a session control message
because you can't you can't request a
security access seed until you've gotten
into that specific diagnostic session
mode once you get there you can request
a seed you'll then see you'll then see
the seed go back to the software
software then does a manipulation to
that seed sends back a key and that key
is what allows you to do the next step
which is enter a programming session so
this is what we want to get to right we
want to be able to we want to get the
ECU to the state where we can actually
send and change the firmware on it
then things get dangerous like from a oh
crap I might brick my ECU perspective
because the next thing that you do is
you erase the memory that you want to
write after you erase it you you have to
send this message that is it turns out
what it is is you're sending it some
some keys that go to the firmware so
that it can decrypt the firmware that
you're going to send it so it turns out
that these Honda firmware update files
the firmware portion of the file
they actually encrypted and the ajaita
5:3 for rewrite tool it doesn't decrypt
it it sends it to the ECU and then the
ECU decrypt it so they haven't
distributed per se any software that you
can obtain that actually has like the
the decryption algorithm in it it's all
needs to you
then you you know proceeded to send the
firmware and then at the very end it
does basically checksum you send a
message that performs this validation
which I believe what it does is
validates that the check sums in the
firmware correct the check sums in the
Honda firmware extremely poor they're
actually just the sum of all the bytes
across a few sections so so I don't know
like that's kind of crappy a bit you
know a couple bit flips and and yeah you
might have might have you might not have
what you thought you had there
all right so this firmware update file I
mentioned earlier on that there's a
folder that gets dropped that has all
these firmware update files in it and
those firmware update files have a
certain format that I'm now going to go
through and explain you know what the
different pieces are because my ultimate
goal here is to create a website that I
choose one of these firmware update
files and I then flash it to an ECU as
if I you know was that j2 five three
four rewrite tool but without any Honda
any software written by Honda so the
very first bite of the file is what I
call the signature it basically tells
you the format of the rest of the file
there's a few different formats I'm just
gonna focus on one because I only care
about one which is can there's also
other formats I think where like you
flash over Lin or other other protocols
but I'm just gonna focus on can because
that's probably like the future at least
for any vehicle that I'm going to own
SOCAN is this in this hex 5a about you
all right so now the next section after
that first bite now we're in the cans
specific format of the firmware update
and there's six header fields these six
header fields they basically have
everything that you need to be able to
look at one of these firmware update
files determine if the car that you're
plugged into has an ECU that a specific
firmware update file applies to and if
it's running a version of firmware that
is supported as an update or if the file
is an update for the version of the
firmware that's on the ECU so you only
need a few things you need the can
address of the ECU that you want to know
if you can update with the specific
firmware filed so there's one byte that
specifies it the reason it's a single
byte is because like if you look at the
spec 29 bit addresses there's only one
significant byte so they just have that
one byte in there and then there's a few
different values like they can change
these security access keys per firmware
update file so they put the actual keys
in the firmware update file
because you have to send them to the ECU
so when the ECU receives the firmware it
knows how to decrypt it and then there's
also a key that I'll get into in a
minute here that is an input to the
security access key exchange so what you
need to do to get that ECU into
programming mode essentially
after the headers is the actual firmware
this is the encrypted firmware that I
talked about before there's a start
address in a length when you that
sequence that I laid out a couple of the
steps were saying okay what section of
firm word do I want to flash on the ECU
and how much data am I now going to send
that's part of that UDS sequence of
messages that you have to send to the
ECU it the the honda ECU's i've looked
at they actually only allow you to flash
one section of the firmware they did a
pretty good job in terms of like making
it kind of hard to brick the device
because the bootloader is outside of the
area that they allow you to flash so
that's good but yeah the state is
encrypted so we can't really look at the
firmware at this point
and then at the end of the file is a
checksum and it's just the sum of all
the bytes except the checksum itself and
so that is that's the entirety of one of
these can format honda firmware update
files all right the encryption so I
mentioned that this firmware is like the
data section of the update file for the
firmware is encrypted so I thought ok
well in the interesting to see if we can
decrypt that and the talk that I
mentioned at the beginning that got me
kind of interested in this George's code
blue talked he shows one algorithm that
they used for encryption and I thought
to myself oh ok well maybe I'm lucky
maybe they use the same encryption for
every one of these updates it turns out
that's not the case but there was these
keys that we already found in the
headers of each firmware update file so
I've got the keys I've got an example so
what should I try ok well maybe they
just change the operators
it turns out at least somewhat common
that's the case and it's not too hard to
write a piece of software in Python that
just brute force tries every combination
of operators that result in a full 256
value lookup table where every value is
you know the input is unique to the
output so utilizing that I wrote this
piece of software that I linked to it
that's out there called RWD x-ray and
that it does that exactly it it'll you
give it a firmware update file and it
will try to find it'll try to find a set
of operators based on the keys in the
RWD file to be able to decrypt the
firmware
yeah so that's really fast most these
firmware updates are small and yeah it
takes like seconds to to run this
through and find the find the
appropriate operators for a lot of them
doesn't seem to work on all of them
which makes me think that maybe they
actually use like a different algorithm
for some firmware updates but it seems
like there's a number of them that they
actually use the same basic algorithm
with just different operators
so this is just an example of running
that tool it just kind of it ties
everything together that I just talked
through it basically you know parses the
file spits out the headers the way that
it figures out if it has successfully
decrypted the firmware is that there's a
UDS message that you can send to request
the software version of an ECU to get
the firmware version of an ECU that
returns something that looks like a part
number for Honda with an extra little
bit of an extra few numbers at the end
all of these RWD files have a name
that looks like a part number so what I
do is I take the beginning portion of
the RWD file and I say every time I try
a set of operators do I find in the
decrypted firmware a string that matches
that and normally there's just one down
the bottom there all those dots is it
trying every possible set of operators
that existed and the X means it hit and
it actually found the string that it was
looking for in this brute force way of
going through the different
possibilities of all the algorithms
[Music]
and then it spits out the decrypted
firmware into a file at the end
okay so my goal here is to flash an ECU
from a web browser and I now completely
understand this firmware update file
that honda has that honda publishes that
anyone can get ahold of it has
everything in it I guess except the
actual security access key exchange
algorithm so I know I figured out
everything I need to figure out to flash
an ECU myself you know write my own
software that does it but I don't know
how to make it through the security
access key exchange their security
access key changes okay it it generates
a random two byte number and then you
have to manipulate it and send back the
corresponding response that is the
correct response going you know after
you manipulate it with security access
key exchange algorithm but we don't know
what that is so a brute force would take
a long time it's probably actually maybe
doable but if you do it you've now
figured it out for one ECU for
potentially one single firmware revision
of that ECU so what else would have this
security access key exchange that I
already have access to
well how about that j25 3/4 reflash tool
turns out it's pretty easy to find the
security access key extraño algorithm in
that tool and it looks like as far as I
can tell they basically use the same
algorithm to a similarly simple
algorithm just you know addition
multiplication and modulo so basically
the same algorithm there's just like one
variation whether the whether the key
that's in the file is 2 or what 4 bytes
or 6 bytes and so yeah great now we
found how to get through the security
access key exchange for probably any
honda ECU at least that his flash Dover
can most likely and I guess like all the
people that do like the engine tuning
ECU tuning I guess they all know this I
don't know I guess it was easy to find
though so I guess it makes sense that
they would
all right so I've got everything I want
or I need to know now to build this
website so I created this website it's
open source auto ECU dot IO is the URL
it's the auto ECU github repository that
I have it's open source it's it only
supports this Panda ODB 2 dongle that
that I'm using here because I don't know
any other any other ODB - dongle that
supports the web USB driver that Chrome
has so that you can interact with a USB
device directly from from a web browser
this website is just static content like
you don't need an internet connection to
use it there's no API you can don't you
can totally just pull down the github
repo and run it locally but you know for
convenience I just threw it up on auto
ECU IO
[Music]
there are some problems it's not perfect
now this isn't like productionize code
so don't use it on something that you're
not willing to replace if you end up
breaking your ECU I actually opened a
chrome a chrome issue because in their
effort to curb people doing crypto
mining in your web browsers like through
ads and so forth they don't let tabs
that are like in the background or don't
have focus keep executing code
indefinitely or maybe they only give it
like small time slices or something so
like for example when you use this you
really want to keep the browser focused
because because like you switch tabs and
then basically the flashing process
applause this so you really don't want
that to happen you know what in the
middle generally it's like it's okay
like if you cancel flashing one of these
ECU's in them in the middle you've
potentially erased the ECU but since the
bootloader is at the beginning if you
haven't done anything really dumb and if
you're not really unlucky you can just
you can just cycle the power and start
over and flash again but yeah it's
definitely possible that you'll brick an
ECU if you use this so I have a little
video here I have a 20-17 honda cr-v it
has ECU updates for several ACU's let's
play this here
see if I can make it fullscreen here if
you watch the - really close things look
pretty good right now it looks normal
I'm like picking the firmware file right
now does a little validation and then
I'm gonna start the flashing process
here and then holy every error code
possible pops up on the dash so I don't
know if I like miss maybe I missed
something maybe there's like some way to
prevent that from happening but it's
kind of scary I mean I tested this like
on a bench before and actually like had
bugs in my code like for example when
you plug when you plug into one ECU
sitting on a bench there's no other
ECU's on the canvas so like you can make
a mistake where your software assumes
accidentally that there's only what that
every message that's coming is intended
for you know your software when you know
the ECU's are throwing messages all over
the place all the time and so luckily
that was easy to fix and now now it
works better in like actually this
successfully flashes the ECU looks like
it's flashing right now actually
applying the firmware I think this is
like applying the radar firmware update
for my car or something like that so
I've just I just took you know the the
RWD file the Honda names these firmware
update files but RWD is the extension
I just took that you know selected in
the software that I'll show you a live
demo here in a minute of an ECU on a
bench and picked it and flashed it and
then I just power cycled the car and all
the ears went away so that's great work
Thanks
so so that was fun but you know these
these ECU engine tuner guys they don't
just flash the updates that they you
know get from Honda they reverse
engineered this and they generate their
own updates right so wouldn't it be more
fun if we you know we could you know
figure out how to generate an update
maybe for an ECU that doesn't even have
an update and then flash that so you
don't need a whole lot of information
you just need you know whatever is in
that RWD file you can just make up some
keys you do have to be able to figure
out you know how to get firmware off of
an ECU
maybe or you could like I guess start
with one of those our double D files if
you wanted to just to play around with
generating your own and but you got to
be able to get you know the firmware you
have to be able to encrypt it since it's
encrypted in these are two BD update
files but this is actually like a pretty
good format for updating an ECU because
it's like self-contained it's a
self-contained file and it has
everything in it you need to be able to
flash an ECU and validate that you know
the ECU that you're going to flash is
running you know an expected version of
firmware before you flash it and and so
forth so so
in my RWE x-ray repo there is a script
that does just that if you supply it an
encrypted firmware file like what you
would find in one of the RWD files in
the firmware section and the appropriate
headers then it'll kick out for you an
are WD file that you can flash using my
website alright so let's do that I have
I just just because out of convenience I
have an ECU here that I tore apart to
play around with and it's you can get
for example a lot of ECU's on you know
like LQK online for really cheap this is
specifically an ECU for the electronic
power steering for my 2017 Honda CRV I'm
just using it because like that's what I
have out of convenience so let's let's
do it
so yeah so basically I just I was it I
figured out how to extract the firmware
from the CCU I used that are to be
builder to what I did was just build you
know for proof of concept
I built a firmware update that does
nothing it literally just is the
original firmware on the ECU so that's
we're gonna do so this is this is my web
sorry this is my website auto ECU IO and
right now it has to drop down for
manufacturer Honda is the only
manufacturer that is supported but you
know it's open-source if someone's
interested they could you know
definitely add formats of other firmware
update files distributed by other car
manufacturers I'd looked a little bit I
like Tesla's firmware update file format
and it's like so much simpler than the
Honda for example it just has like I
think it has like a header that says the
start address in the length and then
it's just the firmware just you know not
encrypted or anything so you could
definitely expand this you know if you
wanted to the other thing too is like
you know I can mention it being that
that honda diagnostic software is is so
hard to use and and slow and a pain to
install you can do all kinds of cool
stuff with this too right like one of
the great things about the honda
software is like you can get deep
introspection into if you get like check
engine lights and so forth what those
things you know what are those check
engine lights and being able to clear
them and so forth so like you can easily
you know take this in and for example
build your own hds that enabled you to
you know more easily maybe clear check
engine codes from a web browser so
there's all kinds of cool stuff you can
do with this
so let me power this it's powered on
here I don't know if anyone can really
see this here sorry we didn't get a
table
so this chair here is my what's that oh
hey I got a table I'm gonna go grab the
table quick thanks
all right so this may be the step
deserves a little more explanation here
so this doesn't really look like
electronic power steering this because
it's like all tore apart and like the
controller in this situation is not
separate from the motor they actually
put the controller in the motor so
that's why it's like all tore apart and
weird I'm using one of those panda obd2
dongles that comment I sells and the red
thing plugged in is just so that I have
a long USB a long enough USB cord that's
called a panda paw it's just in case
like you brick your your obd2 dongle you
can actually you actually can't really
brick it because you can use this panda
pod to get it in Adi a few boot mode so
that's plugged into another thing that
we sell which you don't need by any
means at all it's just it's just like a
development board that breaks out the
the obd2 pins really conveniently so I
just use that to build an adapter to go
from the ECU from like the real ECU
connector to the Panda PO db2 connector
so advice
so yeah so all right let's pull up this
is my fake firmware update that is just
like the stock firmware that I generated
a file for because there is no firmware
update for this ECU I picked that from R
update file and I say next now this is
where those headers that are in the RWD
file come into play it just it just went
out and so I implemented that UDS
protocol and the is OTP I am I
implemented in JavaScript you can see it
in one of my in the github repo for this
for this website so like it just went
off and it just worried that can address
180 a 3-0 F 1 and I think it might have
sound like tester present
or something like that I know I'm sorry
they didn't send it off yet we start to
connect to the ECU
so the way web USB works for like
security reasons is if you have a device
implements the web USB protocol when you
plug into your computer it doesn't just
like get access to things so Chrome has
this specification where there's there's
a JavaScript call you can make to say go
you know go talk to this USB device and
then it prompts the user to actually say
yes you're allowed to talk to this USB
device from a web browser
so I pick it I say connect okay now now
it actually went out and it actually
like sound like tester present to the
ECU and said like are you there are you
awake
and then there's another UDS message
called
like read memory by address I think it's
read memory by address and there's a
specific code that's defined that
there's like four of them they're like
loader versions software version
application version so I think it's I
think it's software version it goes off
and it queries the software version and
it checks does the software version that
the ECU returned match what my RWD
headers excuse me what my RWD headers
say are the supported software versions
for this for a more update file alright
so now we're connected next okay this is
the danger screen like I said you can
brick an ECU so don't do this with an
ECU that you're not willing to pay to
replace something could go wrong I say I
agree and flash it's erasing the memory
and now it's flashing the firmware so
it's basically just going to that
sequence they laid out at the very
beginning to actually send the firmware
update so you can can't really see the
progress bar there really well but it's
like 25 percent and moving along
LEDs are like flashing different colors
on the table over here
yeah so I know once you have this I
guess flashing a firmware updates pretty
boring
it'll be done here in a second a few
seconds about 80% and then I'll just
pull something up like this ECU just
constantly dumps out some messages on
the canvas okay it's complete so all
right let's talk to this ECU I got to
free up the USB device the web browser
doesn't have a hold of it and all right
so let's see if this all right so it
should be now if I didn't hopefully this
is where like the live demo doesn't go
all wrong if I try to connect to this
ECU and read all the messages that it's
dumping out on the canvas
there you go so it's like five messages
that just dumps out I think it's like a
torque sensor that's on it and a bunch
of other stuff so
so yeah and I guess that's it that's my
talk what's up
[Applause]
I
yeah sure so is there any signature on
the firmware no yeah there's no
signature it just like they just there's
there's that last step where they say
they say basically validate the firmware
there's like a routine control message
that gets called and that validation is
just our that check do the checks that
do the do the do this some of the bytes
add up so yeah so yeah there's nothing
like that did it and then the other
comment was I made some assumptions
about like I had something I wanted to
decrypt it and I didn't know you know
what the how I would do I know like how
would I make those assumptions so that I
know when it was decrypted completely or
properly yeah so I mean I just guessed
right and then in addition to guessing
though this ECU here is tore apart
because then I have the decrypted
firmware like I figured out how to dump
the full firmware so so like these
firmware update files they're you know
potentially not super useful to modify
because they're partial right like
important things that you want to modify
or you need to like reverse engineering
out of them they might not even be in
the update section right so like what I
did was I got an ECU that I was able to
dump the firmware off of and then I just
had these ideas like okay well I should
be able to find this software version
that you can request through read memory
by address and maybe it's like I just
tried like okay well maybe how many
times I had no idea how many times how
many sets of
you know combinations of operators and
my brute-force decryption would match
and it turned out like 99% of the time
there was only one and I had the real
firmware from an ECU to compare to to
then make a hundred percent certain that
at least sometimes I was decrypting it
successfully
this one actually this specific ECU is
simpler than that it's it's UART its
serial but a lot of them are JTAG that
you you have to dump them too
yep yeah
no I don't think so I mean they don't
they don't they don't publish any
firmware updates I think George is like
set on our discord multiple times at all
for more modifications or cancelled so
yeah I mean this is just you know this
is just me working on this stuff in my
free time basically so yeah this is just
my stuff for fun so yeah
yeah so I haven't had that much time to
like really work on it and make it
awesome so like I just tried it on a few
ECU's that are actually in my car but I
haven't like I haven't specifically
tested it out on like what like the
engine tuning PC you guys do you know
the where there's a lot more potential I
mean they all charge money for that
stuff right well metals and I think
there's some free ones like ROM Raider
or something like that but like I I
think this is the future I think you
know it seems like what browsers are
gonna be the you know the platform for
building modern applications in the
future and and so like I don't I feel
like I'm showing you the future of what
these tools are going to look like
someday
all right
cool thanks guys and I think someone
gave me this adapter thanks a lot for um
the adapter so I could actually give my
presentation
[Applause]
my goon says you can go on and we'll
take this off ice back to my office plus
bonus these girls want a bonus though
they just told us mining guild scams are
off the menu you wouldn't continue to
continue hiding with your laptop in a
bag of groceries in got sand sacks
hoping that said jokingly leaving me to
hash tag wait and hope and see behind
seven proxies you ran all locally and I
know it's not you seen but party vans
are not the parties that you see in your
screen
old school kick it back to command comm
when you still believe your one day
might not live with your mom on your
Apple 2e typing peek and poke when you
first ix quick for deep and throat John
McCain please let me beat the hoped
marketing campaign scribbled with pen
stains gone off that cocaine crashing
that fast train in Spain and watching
them the fire sparks that was a theory
yo before I was a warrior sharp
no slide 4:30
take the train I got the house to myself
I can finally rap alone back in Jersey
for the holidays I don't think I can
call it home started a company this year
this is straight in the valley thrown it
sucks
the only voice left at the party is
telling me that I should have known
you're 27 and never groans what these
things get to the top and you're less
alone all the pressures and stresses and
headaches you wake up feel great now you
stagnate and slip a shit when you're
over three minutes late
you still make fun of fat people in your
BMI is overweight I sort of feel like
I'm out of place a year goes by you look
around you down on the shitter
so down you can't be fucked if they call
you a switch a loser a little bitch who
didn't deliver by the type of guy who
comments and gets triggered if that's
the test that I didn't prepare looking
kind of stupid standing about underwear
should I rock Chris and be never scared
or leave therefore somewhere is this
feeling just here or is it everywhere
from the yes my chair shit-talking I
lost a girl I love this year
now I date myself like I'm Creek walking
I might sound like Drake
I told you in the old docks when we
lived in the closet like Harry Potter
never was much trust I just want to save
us in the future because never love
yourself and I never saw where you hold
on the train home he never doubted me we
made choices and try my best to drop out
buts getting loud on these words now is
there a place for people who actually
want to change the world don't just want
to make a buck and market it to boys and
girls and fill the earth with products
that are just out of their reach
themselves they're depressed and you can
sell them fucking lexapro
in conclusion society's the suckers and
if you still put in work you're a stupid
motherfucker
[Music]
do
i remember seventh grade ski trips
bumping the song i stole from napster
am i still the same person i was or did
i change from the memories and the drugs
experience was all a delirious blur am i
grown up
well shit i'm 31 a 31 year old
soundcloud rapper and people are like
george could you grow up faster
and i'm just like yo i'ma show those
bastards i'm a pull of alphaville and
stay young forever
i'm a hack biology and stay young
forever i'm a wirehead myself
and i don't want to be like eminem in
old age live in a big house and bake
cakes with fake rage see who i was and
only live in that template and watch
what i say cause i've got fans to play
so let the media waves come let's go to
parties in la get fucked up and have fun
i got a blue check on instagram now see
my blue check much
famous wow you're trying to outrun
chekhov's gun you got the nuclear bombs
you don't think we're gonna blow up some
but i'm a rapper with a blue check and i
think i'm gonna blow up son
what we call humans starts to break down
is that why it all feels so fake now
i'd swap all the linkedin thoughts
twitter roddy and clubhouse for a
bouquet of gay clowns
at least clowns know who they are even
if there's eight of them in one little
car
it's obvious that they won't drive far
so everybody knows that they won't drive
far
there's no speculation in clown world no
stupid valuations and clown world
no big pump signal in clown world the
parties are all real and clown world oh
did i tell you that i'm famous now
i feel like i moved to the upside down
looking in the mirror asking who's the
clown
fakeness floats while i see realness
drown so let the mania waves come
let's go to parties in l.a get fucked up
and have fun
i got a blue check on instagram now see
my blue check much famous wow
we're trying to outrun chekhov's gun you
got the nuclear bombs you don't think
we're gonna blow up some
but i'm a rapper with a blue chat and i
think i'm gonna blow up son
I can't deny that much how's it shaped
me never quite sure of where they should
place me I was once a baby always crazy
maybe foaming booming rabies to wit
nights I would drop the Sun came up I
was young of a smart but slow dumbest
truck I've got known for much I'm here
to press my luck if y'all still got
dreams then can you hold them up we were
born to smile that we are going to drown
if you could lift me up thinking you
hold me down on the summer nights
if you come back here in a new
now back to the magic that made me
what's top of the ladder your weight
class and really like weight classes
place faster pace to my place of
all of the grates past I found the
world's on the
so maybe it's just you that I don't
respect and now I
to be the dopest ever I was nobody but I
was a little bit kind of the Whomper to
let her hit a cereal drop I told you it
is good to be gettin that cooperative
kool-aid for two bucks yet Mike walked
over ty one day
stop
you
if I met myself six years ago we'd hate
me but rate me and tell me you know we
were both supposed to make it look at me
now waiting for the next thing to be you
and you go all out ignorant I let down
and the crash you feel and it's all over
please let this time be different I'm a
couple flights for many who ever will
things change there I doubt it lay
around read the same books and look at
the same board and stare into the same
Sun or eyes and see the cycles of my
life aw it's all a fucking vacation it's
getting harder to relate to me when
there's the novelty and novelty wear off
I can swirl moving around and hold it
down but I say that today and we both
know that I'd forget tomorrow
you
[Music]
[Music]
keep
crying your heart out we're all gonna
die now we're all gonna die
now keep
crying your heart out we're all gonna
die
now we're all gonna die now
it's obvious in retrospect stories make
up history
learn them all in school but never learn
that made by you
[Music]
crying your heart out we're all gonna
die
now we're all gonna die now
keep crying your heart out
we're
[Music]
sleepless in a town of cats it doesn't
stop here anymore
the car wheels in the quad the college
storm on labor day
the plan is all in place we can
watch the future fade away
these last five years have been a blur
of growing
up and being honest with yourself
about the world you cannot save
and if there's reason for still trying
or just
hopelessly embracing the decay
keep crying your heart out
we're all gonna die now we're all gonna
die
now keep
crying your heart out we're all gonna
die
now we're all gonna die now
[Music]
you
[Music]
I guess I rolled over I've grown up in a
mostly sober childhoods over and so's my
hope foreclosure Taylor Swift don't ever
get to hold her adulthood is a pail of
shit that it's your job to deal with
it'll have you one get a nice quick try
and say you're excited but don't just
think it feel it
can you still when the years slip why
not cuz you're all grown up but when you
ask well out of that it's cuz you're all
grown up
bunch of fascists mash and the pleasure
centers of animals with a universal
human right to be happy
hold on to your right to feel crappy
straight-talking jaywalk I move through
the streets like a New York up the block
at the blocks it's Chewbacca with a huge
cock it's all cool except it's not true
breakthroughs grab soma and take to bed
home and it feels like was common in
most of our brave new world is fake news
you
[Music]
yo yo in the studio much track very rap
[Applause]
I'm in the 90s take a ride with beat
while we all recall
Wolpaw and prank phone calls bumpers for
you bowling ball would be hit them all
because this is New Jersey and stamp
late but still wake up early to get to
school your seat belt buckle to pokemon
cards taught me how to hustle and kiss
road orgy on their backpacks what is
asked me and my parents left home for
the evening googling a fan a slash
screen that passes me if I was a teen
basically of course I'm sure how does
the computer know when I was born a
generation formed by internet porn but
fucking back to high school romance is
all the way back just to the flu dances
Branson or Alec add something to prove I
was just a little kid with nothing to
lose and I was not cool but not
self-conscious they were teaching a
monster total bullshit that was totally
bonkers and bellman Crocker I was
actually noxious I was gonna fight in my
class and asshole the barely passed
specialist in your lounge I'll whup your
ass you know stories go it's all
happened a while ago but let's go back
here we go let's start the show
no Joe I didn't know we have skills you
chilled out with the time that you
killed how was online and on my damn car
making the question what you do with
your time picking it out my aunt's
basement video beans and go damn
patience tech skills and determination
trust with rage and frustration and I
got smarter and I grew richer and I felt
sharper as I move bigger culture than
iPhone kick it in the limo with the
screen off murmur who's sick I winner
winner in the green food chicken dinner
is an anachronism but I'm all atwitter
the picture chipper to better the
bidders well acquittal with a vigor to
the liver the record I tuned on and in
and dropped out not clear fight war for
food and self-doubt well I guess I
forgot how kid to a kid but I'm calling
my
I bought a fan I bought of Dan with an
energy drink in each hand tentatively
yelling fuck slams I would fire five in
my class and assholes barely
whole town traveling
your app and you know the stories go
this all happened a while ago but let's
go back now here we go
dim the lights turn the show what if you
want to besides my portrait death trap
for this nerds retreated in a second
Silicon Valley Haiti West but none of
it's what you expect that shows up in
your half Iraq tears me eyes with
Sonny's child not a grown man who works
in tech why would anybody buy this older
now and I still don't get it
your maturity in the house of cards back
by Benelli Shann rhetoric lockers and
unspoken code without again you stumble
through life with your dough stone
senators houses and cars and wives and
kids I live in a band like a damn
degenerate you have a house in a
swimming pool
look go rock climbing what a tool fuck
adulthood irony screw on the first in
high school I was older barely passed up
your ass and let's talk about where
teams have dropped out with nothing but
treats kill your stack dad just a patch
class well I take baths with dollar
bills - laughs horses corporation of kil
Jaeden we know what evocation but all
fractions
PlayStation and you know as stories go
this all happened a while ago but we're
here now 2014 wined it up and just let
it go think baffle you try to slow
blindfold on just feel the code don't
struggle transcend them use the fourth
let it go headspace that you're moving
boulders unbridled rage or child soldier
barren lifestyle barracks lifestyle
showers of a mine grow colder no more
dela banter with any word 24 not so
invincible anymore but I'm never gonna
die upload me and live on as information
forevermore I was thought of 5 in my
class an asshole II barely cast pull
time spent playing super smash in the
senior lounge I'll whup your ass if you
know his stories go I'm so glad to be
alive now throw a little get to be
around to see how the whole game plays
out I was about a 5 in my class and
asshole is barely past pull times
templates super smash in the senior
lounge I will whup your ass
did you know as stories go this one is
mine to control so hold on tight here we
go and watch close I've run this show
you
yo yo look if I actually want to like
make it as a rapper I gotta write songs
I was a child in the 90s tikka ride with
me
while we all recall wall ball and prank
phone calls bumpers for you bowling ball
I may be hitting them all because it's
his New Jersey and stay up late but
still wake up early to get to school
your seat belt buckles were pokemons
cars taught me how to hustle and kids
rode orgy on their backpacks what does
that mean my parents left home to be
even named googling I thought a splash
screen that asked me if I was a teen
well basically of course I'm sure how
does the computer know when it was born
a generation for later net porn
flip looking back to high school romance
is all the way back to the little school
dances prancing around like has nothing
to prove because I was just a little kid
with nothing to lose and I was not cool
but not self-conscious telling the
school they were teaching a monster
total bullshit that was totally bonkers
and only grow when I was acting
obnoxious I was brought about in my
class an asshole who barely passed whole
town's template super smash the senior
level up your ass and you
it's all happened a while ago but let's
go back
let's start the show
[Music]
[Music]
good morning USA all glory to the first
American Reich all glory to the holy
Office of the presidency all glory to
the senators all glory to the
congressman all glory to the mighty US
dollar
nah politics is for
losers uh so I wrote this over the
course of 202
F and maybe some of you guys know what
I'm trying to say maybe some of you all
feel the same
way here we
go made a pickaxe a strip mine and
demonstrations a sick time and
penetration is all online a virtual dick
slide and then it hurts to be Mis
bridled mares and Cults that never break
I just came to fuck a bitch and skip
over the dinner date biger plates and
ins but appetites I've heard to come
down is hard it keeps me up at night
goodbye to your small town jobs stomped
out by computerized mobs did you put up
a fight magnesium packed pre rolls in
the bag when the light comes tell me
who's holding the bag I see it it's sad
rage screaming at pads big teams in
their mind melters grew up just like
their
dads another thing to move past Whiplash
Maring tone toe tags and Ankle monitors
in woods with harmonicas in good with
the phonics a big bash for the new God
they claim to be so tolerant disagree
and they're all
frogs bll packed and pass to the ratchet
Socrates hack to bits on the altar of
mediocrity phony Lumberjacks take a
hatchet to meritocracy Flav a flave
clock on my neck take a walk with me
Midas was a little wrong everything we
touch turns to Silicon all Optics are
gone in the Octagon all drop kicks and
no politics all hot shit no hot takes
don't pray just eat pancakes be so far
gone when the damn breaks car alarmed in
jailbreak and immobilizer hail Satan and
hold your sides in a roller coaster with
broke lights a hope driven by
Poltergeist the olds on all the shit
rides and trade all in a future where
nobody who sick dies nobody will get
fired nobody will doubt lies oh I think
it's about time it's rotting from the
substructure clotting deep in the
constructs it's burrowing and hiding and
bribing people with shot bucks but
people keep on riding to an Oompa Loompa
future when you think the ride is over
it gets stupider and they are hiding
horror cruxes and all the Starbucks is
watching you dumb duckes you fight about
which old fuck amongst them you think
that should rule you argue that we all
should pay them to school you hello from
the classroom duck duck apple strudel
resistance is feudal they came for your
culture they came for Your Meme and you
all bought in so there's no one to
scream sick Michael Vick like you
chickens to Cock fighter stay in your
room and be sucked into fortnite but
look at their strings and show up with
your scissors and when they turn their
back stab them through the liver
gizzards and hearts mouths and eyes to
rewrite the future those people must die
I dream of a new dawn a red sky a blue
lawn where we know words are harmless
and we can play with open arms or we can
say that work is play or we can say that
work is gone but I know either way our
way of life will still live on from
cells to monkeys neanderthals to junkies
to propagandas to oligarchs the internet
will stomp their hearts getting KN in
the lights go dark cinnamon and an apple
tart synonyms and linguistic tricks
living big as a Macintosh the pack is St
you got a crew to roll with hold a
calendar a patience and a brist for the
pacing and replacement a complacence
with a statement of the hatred for the
agic prop fake dividing real denying F
shit arise from sorted Ashes to come
answering the call I am crying from a
bunker that the truth can save us all
[Music]
it is the crisp chilly night after our
child's first Christmas parents streets
say for a small crowd gathered outside a
boutique electronics store listening to
the man on the screen deliver a
soliloquy about how bad it is going to
get interspersed with advertisements for
Snuggies cocoa and Geico as the first
flakes fall we embrace in a Walgreens
parking lot armed with only our persons
and tattered tech company hoodies and
with you pressed up against be my
ever-present companion the racing inner
monologue gives way to the calm control
of coming up on adderall and realizing
we are in a city of millions where
nobody knows us and we can just
disappear and blend into the ether like
radio waves and no one will give us a
second thought we make our way into a
coffee shop where we huddle together
around a pumpkin spice latte
now knowing how much longer this is all
going to last but in this moment not
really caring we think therefore we are
and no one is am impotent yet so let's
vanish into the cracks of sidewalks
drink from the Hudson River and eat the
remnants of a civilization where people
would continue to stare at their phones
while the hydrogen bombs detonate above
them and the sky is blacked out so they
download a flashlight app and make a
dull-witted comment about how Obama
should fix the Sun on Facebook we as
people who aren't built for this world
why should we have to play by its
arbitrary rules can I get a show of
hands of people who still think the
Industrial Revolution was a good idea
we've dug ourselves into a hole and
instead of trying to push the dirt back
in it we build dump trucks to cart it
away
excavators dig it deeper drills to get
through the bedrock and lasers to ablate
the diamond while we run ad campaigns to
push the shiny rocks on soon-to-be
Brides fingers is it okay that we've
built a society where 13% of people are
on antidepressants
maybe it's time to rethink the whole
sure the whole had your smartphone and
flush toilets in it but it also had
heroine and Twitter and drones and
nuclear missiles and we're digging more
frantically than ever and nobody is
smart enough to know it lies even a
little further down never mind if we
finally break through to the other side
or the world is so upside down that will
literally have to lose ourselves to live
in it so maybe we should just stop
fucking digging in
but the unions will uproar and without
the whole what would society do all day
and there would always be some kid who
thinks the whole is the greatest thing
ever and sneaks down with a shovel at
night just to move a little bit more
dirt out of the way and Lissa's friends
to carry pails of it away and the dirt
is far too scattered to ever fill the
hole back up anyway so why should we
even try let's just sit and sip our
joint latte and when it's done step out
into the night and hold each other as
wallflowers with the storm rolling in as
people hustle and bustle by looking like
they are going somewhere and if anyone
bothered to notice us we'd be the freaks
for just standing there
[Music]
I'm a little feverish and slightly
delirious phone dropping the chopping
noise next to where the speaker sits and
I can barely speak the spit still fuck
with that reefer kid cheap and it even
that not wanting to give a shit roll up
through the police station peep the cops
face when a hot alien wave tells me she
raped him dude
Seraphin textures of the bottom half a
keyboard zoomed in on the middle saying
damn dude space is huge probably I be
found dead in my apartment how do you
eat when you lack little white part and
round up a cavewoman stomper out with
Doc Martin screaming bitch make me
dinner like a little white Cartman and
she's too low to get a face put on milk
carton baby buy the milk man fuck no
abortion please can I keep it hold quit
your talking on the carriage she rocks
is off a cliff Clara Barton
rap game Jeremy Hammond shown in the
lead I need something to do so I'm a
pack a bowl and drop some bars on you
you script kiddies ain't shit you can't
code can you you'll never guess that my
password is hunter - pecking with a
banana that shit so ripe no letters on
the keyboard so that you can't type fork
bomb fuckers who sanitize funny and code
and PHP and print out dollar side money
ah keep hacking alley Oh keep hacking
alley
Oh keep hacking elite Oh keep hacking
alley shouts out to my Truelove GrubHub
without them I'd be out trying to get
fed sitting on the top shitting all over
your bunk bed drop deuces like I'm
Hollywood Undead I don't got a team I am
just one dude I don't pop Molly I rock
Tom Cruise
[Music]
how about usually the last consistent
schoolyard football
I mean sometimes there was a kid on
crutches and I think second Alaska like
it taught me I'm never gonna be a pro
football player when I grew up and that
was a valuable lesson
and that's something today's kids aren't
learning political revolution trending
horse I am on the wrong side of a
cultural war Elysee hungers worth the
food school after 1918 the school
diversity is imagining everybody come
protest was me trying to frame yourself
as an underdog in your one nation under
let their guard on major story shut up
and fight for glory don't slow down
until we grow and you write the course
of his story our hip-hop and make new
protest songs some of y'all can rap a
longer ski stand individually storm pack
that bond light it up and hold it down
to this crap is gone
believe me greatness yup we don't have
to take this let's break taboos make
niggas we're dropping this chemical
signal be back and Woodstock let's
broadcast passion and energy with the
media belongs to the enemy what Annie
come by rappers eat enemy you're not one
of them so to pretend to be peaceably
and briefly stand up it's a little speck
of me unless you're a hypocritical
histor fuck on a Mac PC
put up with this shit for too long
I'm Rich's fucking your shit soft if you
went to college you got ripped off they
told police and go fuck off if you went
to college got ripped off then I get
that mixed y'all pissed off the tone
police you go fuck off if you went to
college got ripped off then I get that
mixed up pissed off
[Music]
your real talk I wrote this shit like an
hour nice hotel room follow me on
instagram at george hotz curtains closed
this is closest to get to the cloud if i
was trying to touch i'm gonna be too
look at me now but there's a little
hitch a certain feels a downpour meow
let me tell you when it all went south
you see I used to be the guy to follow
in my trucks and go north get in my car
and drive we move it's fine and never be
caught into a normal life and never good
to fucks but what you thought was right
flip our bosses are rollin heel is buy
and make our choices daily if we want a
trial a tour today in the for tonight
and just drive the mania way for the
rest of our life but I was smoking weed
when I got caught up with some plans
just to brag that I only thought a week
in advance it was a Midsummer's Night I
didn't see the demands I was hungry it
slipped and saw my soul to the man when
you sell to the devil the deal is never
straightforward its honest on paper but
you see the consequence later you can
scream it's the world but that shit
doesn't help the best you can do is
fucking screaming yourself you stupid
bitch how could you do me like this we
used to be free now we're doing emails
and shit you say you don't have a boss
but you're acting so whipped okay I fell
for the scam and molix a dick
[Music]
normally I don't give a shit about
current events so they don't really
affect me
this doesn't really affect me either but
your reaction does that's why they took
it too far
listen up I'm not scared of the
coronavirus I'm just scared to achieve
people arms I can't start a rebellion if
you people are like this see I'm still
going to work I'm still fine on planes
I'm still eating the restaurants now
we'll tell you their names sure it's sad
a lot of people might pass away but on
the planet I'm from people die every day
they kill the subcultures they cancel
the future and for what for you to not
be offended follow along and just wait
to get fucked - got a preserve life
preserve it for what they can't tell you
because they don't know will they ban a
young SoundCloud for this let's try
everybody take your masks off and go
outside and there's a one in a thousand
chance you might die but if you won't
take those odds than you're dead inside
[Music]
so I wrote this song about a girl
you
you
- rebar beams and Shiva cladding and
knee-high skirt and dress socks there
sits college graduate with a degree in
women's studies she stands on the
shoulders of giants when she rides
subways in elevators built by
Minaj's of people who understand nature
another night you won't remember with
some folks that are so forgettable
so go study hands vigorously
agree over fair trade coffee you
economic pervert
and man free birth control while you're
pregnant with liberal gills
I will leave the water running when I
brush my teeth just to piss you off will
drain the reservoirs and laugh at your
sad excuse for an education I haven't
gone gone yet but you make me wanna sit
and watch the world burn
[Music]
you
so gather up your pretenses if you
believe that truth is privilege round up
your friends and build an airplane out
of pixie dust and empowerment and fly
yourselves to postmodern paradise
[Music]
I want to drop out I want to drop out I
want to drop out
hi I want to drop out
[Music]
[Music]
oh yeah okay one take
let's try this oh chill and
hard you know fuck what y'all think this
you gotta say that but
i will try let's see what i mean
the ones that hate me the most look just
like me you tell me what that means make
a slick comment and see what that brings
i see it go down we can reenact things
extreme like bmxing these boys pussy and
they pmsing
people in the city see the movement
occurred and they say my god i want to
be in that scene
damn right you want to be in this scene
she at the video trying to be in this
scene
used to fantasize about being this scene
bluegrass girl but she got big dreams
can't touch me i got instincts locked in
the house but i'm plotting things
i brought a gang to the party with me
five white boys but they not in sync
fuck what y'all think fuck everything
that you say about me
my dogs like to play madden in 2k but
one thing they don't do is play about me
my homeboy tyler he planned south beach
he told me this summer he gonna fix my
jumper i told boy i wonder that we might
got a thumper i've been trying to pop
now i'm on like shopper
now they on my bumper green room chock
full of all my comforts hotel room like
heaven on earth got angels in my bed
with some all white covers
pro nemo lucy and kiso schloop clay two
four got a few more that i call my
brothers i got a lot of flows and they
all like butter
you know what that means i came home
nice but i'm going back meaning i'm
about to globetrot when they know a
vaccine motherfuckers act lost but they
know exactly what is going on
made a meal and i don't know what to
blow it on until the critics shut up
like my show was on
gave a t-shirt to her until i throw it
on she wanted many high school
classmates i'm growing on
my peers ain't popping they don't know
what's going wrong y'all well dressed
but you ain't got soul and you can't
just sew it on
i'm trying to tell your boys i got a few
songs i could sell your boys i tried it
back then it was hell now boy
now i'm in the box like a kellogg's toy
the ones that hate me the most look just
like me
you tell me what that means make a slick
comment and see what that brings i see
it go down we can reenact things
extreme like bmxing these boys pussy and
they pmsing
people in the city see the movement
occurred and they say my god i want to
be in that scene
damn right you want to be in this scene
she at the video trying to be in this
scene
used to fantasize about being this scene
bluegrass girl but she got big dreams
can't touch me i got instincts locked in
the house but i'm plotting things
i brought a gang to the party with me
five white boys but they not in sync
no they're not in sync what are jt no
they not in sync
no they not in sync no they're not in
sync
so we can take this essential matrix and
we can extract slam is simultaneous
localization and mapping it's s so we're
getting there
we're getting to what we're still
working on feature extraction between
pairs of frames the first step of any
slam pipeline is sparse hose recovery
from the essential matrix oh man
get that confusing crap won't they just
show me a Python code that's the problem
with math they read it in such confusing
ways all math should just be written in
Python okay so do I feel any way about
Mozilla removing the world and I can
thread to buzz
[Music]
it's a music
maybe that's change it was might as my
as my tea here picked up and on its way
it was might as my as my tea here picked
up and on its way
I don't understand why if I set up to 1
I get assertion error - it's an
assertion are you code I wrote oh it's
this huh yeah cuz that's on pixel scale
save it no window so window hiding my
game display so I make a new window
inside you hiding image load I'm not
bleeding anything to the screen
now right time to search for points
after going close optimization put you
to match to the fright peed on why
[Music]
oh that's beautiful Oh beautiful oh we
can even make that bigger a picture is
where it's bending pixels on 600 pixels
that's a lot of pixels yeah Vulpix fine
lose the track well you saw what it did
like it just looks shitty
you
you see thorough check
oh yeah I'm sure I would learn a lot if
I went to school yeah bro there's
nothing to do itself driving this is
Chuck what people like
yeah I mean sir company and like don't
start a couple own you might VC funding
like just go do something and Nick
profit I mean if you can scam movies
these all better for you but I do love
nature problem why do you sleep at work
and you are rich because I don't
you
it is interesting that makes you think
oh yeah they all not hired by oculus
rift um LSD slim guy kick a bangle Raul
more whatever yeah
they all got acquired by oculus no these
things are kind of annoying diplomat
like if don't know a lot of stuff to
write a slim so here's the video that
we're gonna drive see this it's a video
of some guy driving on a road and the
idea is can we figure out how that cars
moving and make a map of the environment
that he's driving through at the same
time so there are open source programs
to do this but we are gonna try to code
our own how many people are watching
right now can I tell its total views not
use for this you're not trying to do
this for this just do this why do I get
up in the Malayan to the border no I
don't take free interns
you'll comment a video link with
something good somewhere well if you'd
asked me when I was younger that can
work works small different variable
stupid let's just not thread for now
did I get my wits and Heights mixed up
I'm gonna do that it's really easy to
tell
stupid no I don't get my what's
tonight's best out
alright time
Wow that's true
you don't like my troubling nested
for-loops crows
because map data frame has side effects
right think that's the same no no no no
no we're not playing we're not playing
my rap so let's go listen to the fuel of
that around whether that actually runs I
think as long as I write it that way
it's okay but I think my right the other
way it's broken because map data frame
has side effects right think that's the
same
no no no when I put okay big small I
don't even know how to
oh cool um I wonder if anyone's actually
gonna come to this this was an awful
long oh cool my wonder if anyone's
actually gonna come to this Oh
instead of creating you were here we're
gonna change this to be this 2d Oh
instead of creating viewer here we're
gonna change this to be this 2d test
event process
let's get to control one of these days I
should really like dive deep sounds like
I can do it as an initializer to STL 2x2
window bullshit
I hate Python 3 how do i do Python 3
integers divide integer division is it
like two slashes or some crap and two
solutions all right my default resume is
different cuz I like you as long as it
native resolution can you guys see so
what we're doing is we're live coding
slam so we're going to try to write a
simultaneous localization and mapping in
Python ball eat mice and when you make a
matter rather than you passed in why not
do anything we don't like to code so
annoying because
look at the top here
like this isn't this isn't started zero
zero
[Music]
[Music]
and $10 get all great
see how you built this you know what
you
you
[Music]
Ek dark sky how do I activate subs yeah
and what was watching the map data
sourcing the maps - recently I think
that about FPGAs and GPUs is you're just
not yeah this is the exact same logic
they just call it transform for for the
effort same have that same function Oh
what is it different why is this
different why did I put two two there so
if I D plus ten is less than that sounds
good I hope you don't find it out
nothing good it's not inspiring fuck you
know this is fucking bullshit man I hate
inspiring shit
inspire people to do what just go do
things if you want to do things do
things you don't need to be inspired
okay enough this is fucking bullshit man
I hate inspiring shit inspire people to
do what just go do things if you want to
do things do things you don't need to be
inspired don't care what would I do with
money I can't buy a better laptop they
don't have one yet
can't buy faster internet I mean yeah
[Music]
this is right so that's X that's why
that's it did you laughs channel yeah
it's about living system pretty cool so
that means we want to reject the points
reject points
what's wrong with Python three is that
it has wasted billions of dollars of the
world's time like if you think about if
they didn't make the two terrible
decisions they made a pile of tree which
was to remove the the breath the
plantation in the print statement it
really doesn't make sense print is a
statement like assert or race it
shouldn't be used in production code you
should be using logging library if you
want to do something that resemble
spectrum also most strings are not
designed to be outputted to people so
strings should not be unicode they
should be bytes if be welcome back to
live coding slam part two
no no tomorrow we have twitch stream rap
oh cool my what everyone's actually
gonna come to this
it's okay hunter I don't watch twitch
enough to know got a USB see the USB a
host probably work yo I love this piece
man oh man look at look at that screen
it's just like torn to shreds in there
yeah like this was breaking our pie
but okay so you see like when the
essential matrix runs like it goes like
that my foes optimizing okay why isn't
the pose optimizer fixing that that's
what I don't understand
nice
do I have other bugs I have to
oh okay so it actually looks like that
it's not pure rotation
that's oh now it's working I don't know
hello
[Music]
[Music]
you
a company like Microsoft or Apple I mean
they kind of just wanna like you don't
like sell you a product right like they
wanna sell you a product or a service
that's fine that's like the engine of
capitalism that's what makes capitalism
great but really I mean capitalism when
it's based on consent I mean that is
consent right when I go when I purchase
an iPhone axis is a consensual
transaction between me an apple when
Google you know tracks my cookie around
the internet and then like uses
psychology to figure out what's most
likely to get me to click on an ad it's
not so consensual anymore right
maybe my game display flip isn't correct
we're gonna have to like painters copy
pixels into a 2d array copy it right
into a new surface does look look I have
like I have to rotate it
but we're back and let's go cheer now to
be number one let's try this weekly top
Cheers
all right
it sounds alright let's go back to
coding slap my ass got Messam Pangolin
gone let's go let's write some shit oh
you know what sucks though we're gonna
try to thread no I hate threads and by a
thread I mean a process because this is
a Python just do from the beginning I we
gotta think
well so maybe we can make this less
stupid first oh but now we're back to
that okay now we're back to the problem
of this
comes from a lot of different places
right okay so we could make them how do
I differentiate that
okay so numeric differentiation yeah
here we go
I mean like how do you do this well okay
so that's not numeric so I mean like
what that effectively you can think
about what that is right it's it's a and
then you have to linearize it let's go
get some coffee
I'll be back maybe someone made warm
coffee and I'll be very happy
honestly no but seriously how many
people can fucking do that right like
that's the real shit like you all twitch
programmers should be trolled like that
if you can't write bubblesort in ten
seconds get off twitch that's supposed
to be rotation it's not this stuff is so
on each row what is a parameter and each
know each column is a parameter and each
row oh thank you thank you now danger 7
thank you for subscribing denied
streaming
everything you do is public and you
gotta be careful with what you click on
kind of pull it aside conferences where
Def Con used to be about you know let's
let's be hackers let's be elite let's be
hacker culture it's drifted away from
from hacker culture to anybody can use
our dwee knows to be a hacker okay
that's not where I'm showing up I think
there are still some my career CCC is
actually still pretty good maybe I'll go
this year you know what I mean you all I
don't know what I mean right know what
we're gonna have to write the CRC
bullshit anyway so let's just write it
now
so they're CRC is a lot more recessive
than this CR C dou C or C only has a
little dominant well this here C is
mostly done so it's PI more probably
easier to set up there's such nice cans
I really want to use the cab can't use
the cans books we only have three of
them that's the whole reason we're doing
this that's right
capitalism that's right we love
capitalism light buzz that would be a
fun thing to write as well maybe that's
what we'll do next this is this is a no
thing so we can always we can always
look up yeah yeah I've tried Loula chest
this isn't the point so the point of
these two extremes is so we can all
learn together and you know I had a kind
of unfair advantage with twitch slam
because I'd already written a slam
before a small slam and it didn't work
as well as twist slam but okay so you
wanna sounds just so you know I'll have
to find the search tree now if you guys
are familiar we can look up basic comp
computer I love rice guys
she's got green hurry
[Music]
[Music]
yo one Wayne's got some fun I swear you
can't fuck it seems like you're not
expandable oh don't understand
that's right no real experiments man is
so loud so loud like I have a choice
between am I too hot or is it too loud
you know you just can't win in life
aren't going to this Thai place it
doesn't taste as good when it's
delivered iLike flasks
[Music]
that's all right don't really how they
wipe teepees does the internet used to
be cool
[Music]
which boy get miss boy getting numbers
don't add up on the flow that was ten
years ago
Drake named it named one of his songs
after the day his kid was conceived I
just like I have listened to this making
my life easy alright so the function I
can call from is here it's a fuse that's
fucking a work I can certainly call this
alright what JavaScript make up my life
easy
so the function I can call from is here
it's a fuse that's not gonna work I can
certainly call this alright what
JavaScript yeah look do you really want
to contribute to the world
really yeah
it's overrated you you want to have
skill and talent and then not contribute
because that's funny
that's funny in McCall's
raincoat this is the life families
hanging out today I bought nice clothes
I got heck up
oh god get screen size and that's a nice
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Breakdown of AI Chip Companies | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Breakdown of AI Chip Companies" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I see something similar happening in AI chip companies that I do in self driving cars. You have many wildly overcapitalized companies that have 0 product market fit, never mind revenue or profit." />
<meta property="og:description" content="I see something similar happening in AI chip companies that I do in self driving cars. You have many wildly overcapitalized companies that have 0 product market fit, never mind revenue or profit." />
<link rel="canonical" href="a-breakdown-of-ai-chip-companies.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-06-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Breakdown of AI Chip Companies" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-06-13T00:00:00+08:00","datePublished":"2021-06-13T00:00:00+08:00","description":"I see something similar happening in AI chip companies that I do in self driving cars. You have many wildly overcapitalized companies that have 0 product market fit, never mind revenue or profit.","headline":"A Breakdown of AI Chip Companies","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Breakdown of AI Chip Companies</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-06-13T00:00:00+08:00" itemprop="datePublished">Jun 13, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I see something similar happening in AI chip companies that I do in self driving cars. You have many wildly overcapitalized companies that have 0 product market fit, never mind revenue or profit.</p>

<p>Not a single one of these companies has a product I can buy! The current leader in AI chips is unquestionably NVIDIA, and they have a card I can buy. So that leaves the question, are the companies banking on a stupid business model, or do they just not have anything? I tend to think it’s the latter. Remember: Unless it’s a from company with a track record like Apple, secrecy is just cover for “we don’t have shit”</p>

<hr />
<p><br /></p>
<h3>Startups (without chips you can buy)</h3>

<p><b>Graphcore ($682M)</b></p>

<p>Here is a <a href="https://www.graphcore.ai/hubfs/assets/pdf/Citadel%20Securities%20Technical%20Report%20-%20Dissecting%20the%20Graphcore%20IPU%20Architecture%20via%20Microbenchmarking%20Dec%202019.pdf?hsLang=en">Technical Report</a> on the Graphcore IPU Architecture. It looks insanely hard to program for. And while they have a buy now button, it links to a contact us form. If a company has a contact us form gating sales, it means that their product isn’t actually competitive in the market if you did the research yourself, but they are hoping a sales guy will wrongly convince you otherwise.</p>

<p>While I had to get to the 7th page of the report to find the problem, it’s the same mistake as the Cell SPE. They rely on a many core chip with a custom weird communications protocol. You want to try to maintain fast code for that? Game devs hated the SPE, why wouldn’t ML devs hate this?</p>

<p><b>Groq ($362M)</b></p>

<p>They seem to get the idea right, or at least match what I would do with a single big core running at around 1 GHz. Here is their <a href="https://groq.com/wp-content/uploads/2020/04/Groq-Rocks-NNs-Linley-Group-MPR-2020Jan06.pdf">Technical Report</a>. I have heard that they get the details wrong though, and the fact that they are still adversing their ResNet-50 performance (a 2015 era network) speaks to that.</p>

<p>The problem is obvious on the first page of report, the same mistake as Itanium, “But this approach places a heavy burden on the compiler, which must comprehend the twin pulses of instruction flow and data flow while optimizing function-unit utilization. The compiler must schedule all data movement, manage the memory and function units, and even manually fetch instructions.” This push it to static software strategy has never worked in the history of computer architecture.</p>

<p>I’ll leave with one more sentence from the report, “The memory units also store VLIW instructions, which are 2,304 (144x16) bytes wide” For reference, RISC-V instructions are 4 bytes wide. Hope you like fitting 7 instructions in your 16kB icache!</p>

<p><b>Tenstorrent ($234M)</b></p>

<p>Their chip is called Grayskull, and there’s almost no information published on this architechture, and I was told the only way to get a demo would be to sign something promising to not say anything bad about it. That doesn’t inspire much (read: any) confidence in it being good, I’m nice if people are honest and transparent, less nice if they aren’t. But now that <a href="https://www.anandtech.com/show/16354/jim-keller-becomes-cto-at-tenstorrent-the-most-promising-architecture-out-there">Jim Keller is there</a>, perhaps there is hope.</p>

<p><b>Cerebras ($112M)</b></p>

<p>WE MAKE <a href="https://cerebras.net/blog/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/">BIG CHIP</a>! CHIP REALLY BIG! BIG MUST BE GOOD BECAUSE BIG! BIG CHIP MEAN BIG INVESTMENT! Good luck controlling 400,000 cores in any sane way.</p>

<hr />
<p><br /></p>
<h3>Companies (with deployed chips for training)</h3>

<p><b>NVIDIA</b></p>

<p>The king of AI chips. The 3090 isn’t even a bad deal! The problem is the 5x overpriced A100, and the facts that, one, they have a monopoly, and two, the chips are still mainly designed as gaming GPUs with AI as an afterthought. While the 432 Tensor Cores have an insane number of FLOPS (8x4x4 = 128 FMAs each), it’s almost <a href="https://timdettmers.com/2020/09/07/which-gpu-for-deep-learning/#Memory_Bandwidth">impossible to keep them fed from memory</a>, or even cache, and in reality performance is 10x worse. (this is where we get our 10x speed from)</p>

<p><b>Google</b></p>

<p>The TPU is based around TensorFlow. While it does work with PyTorch, it is really meant to have things compiled and laid out in RAM in specific ways. This is the “push it to software” pattern that I see fail over and over, while it may work for an organization like Google, it’s not practical for a normal organization trying to do ML. Hence why Google doesn’t sell the TPUs, they sell services that can use them in their cloud. Nobody wants custom weird services that lock you in to Google, and this is why they are losing to AWS and Azure in the cloud space.</p>

<p>The best documentation I could find <a href="https://cacm.acm.org/magazines/2020/7/245702-a-domain-specific-supercomputer-for-training-deep-neural-networks/fulltext">is here</a>, along with <a href="https://www.hotchips.org/assets/program/conference/day2/HotChips2020_ML_Training_Google_Norrie_Patil.v01.pdf">this presentation</a> on the changes from v2 to v3. It seems they have very large 2D arrays, 128x128 (reduced in v2 from 256x256 in v1). And VLIW instructions (at least only 322-bit), pushing all the complexity into a compiler.</p>

<p>The <a href="https://conferences.computer.org/iscapub/pdfs/ISCA2021-4ghucdBnCWYB7ES2Pe4YdT/333300a001/333300a001.pdf">TPUv4 docs</a> are out, and they look okay. Wish I could buy one. They also are <a href="https://www.nature.com/articles/s41586-021-03544-w.epdf?sharing_token=tYaxh2mR5EozfsSL0WHZLdRgN0jAjWel9jnR3ZoTv0PW0K0NmVrRsFPaMa9Y5We9O4Hqf_liatg-lvhiVcYpHL_YQpqkurA31sxqtmA-E1yNUWVMMVSBxWSp7ZFFIWawYQYnEXoBE4esRDSWqubhDFWUPyI5wK_5B_YIO-D_kS8%3D">using ML to do layout</a> for the TPUv5.</p>

<p><b>AMD</b></p>

<p>Similar downsides to NVIDIA, but with much less investment in the software side. I don’t know anyone who uses these to train. From twitch chat: “ROCm = please use kernel version 5.4.1.4.12.44.1 and only 5.4.1.4.12.44.1” aka unusable in practice.</p>

<p><b>Huawei</b></p>

<p>The <a href="https://www.hisilicon.com/en/products/Ascend/Ascend%20910">Huawei Ascend910</a> made it on <a href="https://mlcommons.org/en/training-normal-07/">the list</a> for MLPerf 0.7, so I included it here, even though I can’t buy the chips or use them it seems. They <a href="https://www-file.huawei.com/-/media/corporate/pdf/publications/communicate/86/01-en.pdf">seem to use</a> a 16x16x16 matrix unit, not a bad choice. But it only supports FP16, which is a software hassle for training. Found <a href="https://pdfs.semanticscholar.org/4ca3/69ee20343433bd50c288c01ebcba2d6a03b2.pdf">more info here</a>, it seems similarish to the Apple Neural Engine.</p>

<p><b>Habana/Intel</b></p>

<p>I can supposedly <a href="https://aws.amazon.com/ec2/instance-types/habana-gaudi/">rent</a> or <a href="https://www.supermicro.com/en/products/system/AI/4U/SYS-420GH-TNGR">maybe even buy</a> the Habana Gaudi, though I don’t actually see how to in practice. It’s a <a href="https://en.wikichip.org/wiki/habana/microarchitectures/gaudi">16nm chip</a>, with 8 “Tensor Processing Cores”, a 16-bit integer “GEMM engine”, and 4 ports of HBM2 RAM. It’s not on MLPerf, so it’s likely not working or very uncompetitive.</p>

<hr />
<p><br /></p>

<p><b>UPDATE (10/30/21): I no longer like this plan. After talking with a few people, I realize I misunderstood where the power draw came from. The biggest cost is in moving the bits. While I still think it’s very possible to beat NVIDIA as discussed below, a simple RISC-V accelerator add on won’t do it. We may have finally gotten to the point where VLIW makes sense.</b></p>

<p>What I would build (<b>Cherry Computer</b>):</p>

<p>Our goal would be to beat NVIDIA and build training chips that are 10x faster at training (because we have the cache bandwidth to feed our tensor cores) and cost 10x less (because we aren’t overcharging and can omit all the GPU silicon). Same D2C business model, just with purpose built hardware for ML training instead of shoehorning it into a gaming device.</p>

<p>I’ve been working on <a href="https://github.com/geohot/tinygrad/blob/master/extra/risk.py">an extension to RISC-V</a> that includes a 32x32x32 matrix multiply unit, and a few other wide vector style instructions. I would support only the TF32 datatype (19 bits), so it would well with training out of the box without gradient scaling (which is really a ton of software complexity to hack the larger floating point range into FP16). While training with smaller datatypes is possible, it’s super annoying!</p>

<p>A lesson that seems to be forgotten over and over again is that VLIW doesn’t work (Itanium) and fancy multicore doesn’t work (Cell SPE). You have to make a chip people love to program in hardware! Otherwise, you push it to software and it never happens. How is that Itanium compiler coming along?</p>

<p>I’ve been learning computer architecture lately, I wrote a <a href="https://www.youtube.com/watch?v=camQ9QeBY9Q">RISC-V core in a day</a>. I think the idea is a single RISC-V core with a really wide decode path and good out of order support. The M1 has a <a href="https://www.anandtech.com/show/16226/apple-silicon-m1-a14-deep-dive/2">630 element reorder buffer</a>, we won’t even need this much to keep our MACs fed. While the argument against this sort of architecture is that it uses power, this is only a problem in massive multicore designs! If your basic instruction is a 32x32x32 matmul (65k FLOPS), this will be dwarfed by the power used by the FMACs. I don’t think the branch predictor needs to be that good either, ML code is straightforward loops, and it’s identical every run through.</p>

<p>One of the biggest problems with non NVIDIA training solutions is terrible software support. This isn’t because it’s hard to write, it’s because it’s hard to write with performance for the weird architecture chips these companies came up with. Since this chip is a single core, wide decode path superscalar, writing the code should be very easy, even to support all of PyTorch with decent performance.</p>

<p><b>Cherry One</b>: My first step would be to write open source Verilog implementing this core that can run in the <a href="https://www.bittware.com/fpga/s7t-vg6/">S7t-VG6</a>, the <a href="https://www.xilinx.com/products/boards-and-kits/alveo.html">Xilinx Alveo</a>, or the <a href="http://www.squirrelsresearch.com/forest-kitten-33/">FK33</a>. According to my initial benchmarks, assuming 1 instruction per cycle and 1 GHz clock speed, this would comfortably outperform a 3090. This FPGA card costs $7500, so it wouldn’t be cost effective to use, but this is the comma NEO of AI chips, it will be adopted by hobbyists. (raise nothing for this stage, just open source code and hype building)</p>

<p><b>Cherry Two</b>: My second step would be to do a 10k unit tapeout of this chip as an ASIC (I’m hearing $5M for a reasonable 12nm process node). 1 core, 20MB SRAM, PCIe Gen3 x16, no onboard big RAM (use host), 75W TDP. Due to not requiring a supported car, I think the audience for this card would be much broader than the comma EON, more similar to the Oculus DK1. After selling the 10k cards at $1,000 each, this company would already be profitable! (raise $10M on $50M for this stage, verification and tapeout)</p>

<p><b>Cherry Three</b>: My third step would be to build a serious version of this chip on a modern (&lt;= 5nm) process node, perhaps $50M for the tapeout. 16 core (with <a href="https://developer.nvidia.com/nccl">NCCL</a> style primitives), 320MB SRAM (20MB per core, isolated), PCIe Gen4 x16, a modern GPU-style DDR interface, 300W TDP. Sell this card for $2,000, and I suspect quickly cloud demand would come from the correct direction, which is bottom up! One of these cards should outperform a <a href="https://www.nvidia.com/en-us/data-center/dgx-a100/">DGX A100</a>, a $199k machine. This is a 100x price improvement. At this point, we would win the AI chip market, even against NVIDIA’s next generation. (raise $100M on $500M for this stage, serious verification and tapeout)</p>

<p>At this point, we flip the company for at least $1B to anyone but NVIDIA, and they will be highly financially motivated to continue to sell cards D2C (similar to the Facebook Oculus sale). Should be an easy sell with a 10x revenue multiple, assuming we sell 50k Cherry Three cards. The company has achieved three purposes:</p>
<ul>
  <li>Created an open source high performance RISC-V core and ML instruction set.</li>
  <li>Made a competitor to NVIDIA in ML, forcing them to stop charging a 10x premium.</li>
  <li>Taught me how to make chips, and further validated “comma style” businesses.</li>
</ul>

<p>I think this is doable in 3 years. The first card (FPGA) would only have tinygrad support, but it’s enough for benchmarking training of all modern ML models, EfficientNet, YOLO, and Transformers. The open source community will help drive great PyTorch support by the time the second card comes out, judging from how much was contributed to tinygrad, and how people added all the car support to openpilot in the comma EON era.</p>

<p>After I have the benchmarking done and confirm I can get 3090 levels of performance from the FPGA card, I will consider incorporating this company and raising money. Only investors who are aligned with overall value creation in the world would be allowed to invest. See <a href="https://github.com/geohot/tinygrad/tree/master/fpga">more info about the business plan</a>.</p>

<s>If you are interested in working at Cherry Computer, start <a href="https://github.com/geohot/tinygrad">contributing to tinygrad</a>. It still needs full support for the RISK architecture (the RISC-V vector extensions) and better benchmarks. This should be approachable for someone new, see the updated TODO section. I'm working on the Verilog for the core itself in <a href="https://github.com/geohot/twitchcore">twitchcore</a>, but on the tinygrad side is a better place to start for now.</s>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Circulation of the Elites | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Circulation of the Elites" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I wrote a rap song in 2020 and thought I’d explain the lyrics here. After watching 2020 happen, the current group in charge should never be in charge of anything ever again." />
<meta property="og:description" content="I wrote a rap song in 2020 and thought I’d explain the lyrics here. After watching 2020 happen, the current group in charge should never be in charge of anything ever again." />
<link rel="canonical" href="a-circulation-of-the-elites.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/06/10/a-circulation-of-the-elites.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-06-10T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Circulation of the Elites" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-06-10T00:00:00+08:00","datePublished":"2021-06-10T00:00:00+08:00","description":"I wrote a rap song in 2020 and thought I’d explain the lyrics here. After watching 2020 happen, the current group in charge should never be in charge of anything ever again.","headline":"A Circulation of the Elites","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/06/10/a-circulation-of-the-elites.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/06/10/a-circulation-of-the-elites.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Circulation of the Elites</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-06-10T00:00:00+08:00" itemprop="datePublished">Jun 10, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I wrote <a href="https://soundcloud.com/tomcr00se/civil">a rap song</a> in 2020 and thought I’d explain the lyrics here. After watching 2020 happen, the current group in charge should never be in charge of anything ever again.</p>

<blockquote>
  <p>made a pickaxe for strip mining<br />
demonstrations of sick timing<br />
penetration is all online<br />
a virtual dick slide in<br />
and it hurts to be misbridled<br />
mares and colts that never break<br />
I just came to fuck a bitch<br />
and skip over the dinner date</p>
</blockquote>

<p>I was not socialized by society. I did not graduate college, I did not do well in school. I am not a part of the existing power structure, and I don’t have to play by their rules. I am upset at how shitty the current structures are.</p>

<blockquote>
  <p>bigger plates and insatiable appetites<br />
I’ve heard the come down is hard<br />
it keeps me up at night<br />
goodbye to your small town jobs<br />
stomped out by computerized mobs<br />
did you put up a fight?</p>
</blockquote>

<p>The current structures are not sustainable. You can’t make fake money and you can’t atomize and dehumanize people to better sell them landfill junk. When it crashes in a huge recession and crisis of meaning, like a come down from a drug, it’s going to suck.</p>

<blockquote>
  <p>magnesium packed<br />
prerolls in the back<br />
when the light comes<br />
tell me who’s holding the bag<br />
I see it it’s sad<br />
rage screaming at pads<br />
big teams of them mind melters<br />
grew up just like their dads</p>
</blockquote>

<p>We put a lot of effort into avoiding the crash, but little into questioning the system in the first place. When the truth is revealed, someone will be left holding the bag, a reference to bag holders in shitcoin pump and dumps, and a reference to the guy in the car who happened to have the drugs in his backpack so he catches the case. For most of the people enforcing the status quo, it’s not really their fault, they were just raised and socialized this way.</p>

<blockquote>
  <p>another thing to move past<br />
whiplash from a ringtone<br />
toe tags and ankle monitors<br />
in woods with harmonicas<br />
in good with the phonics<br />
a big bash for the new god<br />
they claim to be so tolerant<br />
disagree and they’re all frauds<br /></p>
</blockquote>

<p>One day, this will all just be a chapter in history, but for us it feels very real and shitty. Yet we can still see, express, and celebrate the truth, as long as we are subtle and clever about it. I do not believe the current elite are actually very tolerant, despite their many proclaimations to the opposite.</p>

<blockquote>
  <p>bowl packed and passed to the ratchet Socrates<br />
hacked to bits, on the altar of mediocrity<br />
phony lumberjacks take a hatchet to meritocracy<br />
flava flav clock on my neck<br />
take a walk with me</p>
</blockquote>

<p>Socrates was a dirty hippie who was killed by a bunch of losers. Today, that sentiment lives on whenever people with no skills of their own attack concepts like “meritocracy”. But their time is nearing its end.</p>

<blockquote>
  <p>Midas was a little wrong<br />
everything we touch turns to Silicon<br />
all optics are gone in the octagon<br />
all drop kicks and no politics<br />
all hot shit and no hot takes<br />
don’t pray just eat pancakes<br />
be so far gone when the dam breaks</p>
</blockquote>

<p>The computers are coming, and nature will not stand for any of this bullshit! Like in an MMA match, your words and politicking mean nothing compared to who can actually fight. But the current elites are cowards, and they will not attempt to make anything better, they will just flee before shit really hits the fan.</p>

<blockquote>
  <p>car alarmed and jailbreak an immobilizer<br />
hail satan and hold your sides in<br />
a roller coaster with broke lights<br />
a hope driven by poltergeists<br />
the olds own all these shit rides<br />
and trade all on a future where<br />
…nobody who’s sick dies<br />
…nobody will get fired<br />
…nobody will doubt lies<br />
oh I think it’s about time</p>
</blockquote>

<p>We live in a decrepit amusement park, and the efforts made to prop it up are increasing more hollow. Yet you are still expected to “buy the ticket, take the ride” for a fake system that deserves zero respect. I’m not buying the fucking ticket.</p>

<blockquote>
  <p>it’s rotting from the substructure<br />
clotting deep in the constructs<br />
it’s burrowing and hiding and bribing people<br />
with Schrute bucks<br />
but people keep on riding to an Oompa Loompa future<br />
when you think the ride is over<br />
it gets stupider</p>
</blockquote>

<p>They printed 7 trillion fake dollars to try to bribe people into keeping to support their fake system! And people actually are falling for it! Never underestimate the depths of the stupidity this will reach before it’s over.</p>

<blockquote>
  <p>and they’re hiding horcruxes<br />
in all the starbuckses<br />
watching you dumb ducks as you fight about<br />
which old fuck amongst them you think that should rule you<br />
argue that we all should pay them to school you<br /></p>
</blockquote>

<p>Your vote matters people (sarcasm)! You can vote for the 74 year old guy or the 77 year old guy. And stupid people are just asking for more indoctrination, free isn’t good! They own everything, if they are giving it to you by their good graces you are their bitch.</p>

<blockquote>
  <p>hello from the classroom<br />
duck duck apple strudel<br />
…RESISTANCE IS FUTILE!!!<br />
they came for your culture<br />
they came for your meme<br />
and you all bought in so there’s no one to scream</p>
</blockquote>

<p>Education is simply indoctrination by another name. On a mass scale. And way too many people fall for it. Though there’s hope, I hear the zoomers believe that “Helen Keller” is a made up person. Can’t believe I didn’t realize that.</p>

<blockquote>
  <p>sick Michael Vicks<br />
like you chickens to cockfight<br />
or stay in your room and be sucked into fortnite<br />
but look at their strings<br />
and show up with your scissors<br />
and when they turn their back<br />
stab them through the liver!<br />
…gizzards and hearts<br />
…mouths and eyes<br />
to rewrite the future those people must die</p>
</blockquote>

<p>Let’s just say, you didn’t see all the major corporations and politicians supporting Occupy Wall Street. Funny they support the new “grassroots” movement, can you understand why? I think the rest is self explanatory, don’t actually stab anyone though. Metaphorical stabbings work much better for causes. In reality, we should pay out their pensions in a lump sum of fake dollars and force them to retire.</p>

<blockquote>
  <p>I dream of a new dawn<br />
a red sky and a blue lawn<br />
where we know words are harmless<br />
and we can play with open arms<br />
or we can say that work is play<br />
or we can say that work is gone<br />
but I know either way our way of life will still live on</p>
</blockquote>

<p>I dream of a world where we fight for power over nature instead of power over people.</p>

<blockquote>
  <p>from cells to monkeys<br />
neanderthals to junkies<br />
to propagandists to oligarchs<br />
the Internet will stomp their hearts<br />
get it in when the lights go dark<br />
cinnamon and an apple tart<br />
synonyms and linguistic tricks<br />
livin big as a macintosh</p>
</blockquote>

<p>…and while it may still take some time, I believe in the Internet to deliver that world.</p>

<blockquote>
  <p>the pack is stacked you got a crew to roll with<br />
hold a calendar a patience and a brofist<br />
for the pacing<br />
and replacement, of complacence<br />
with a statement, of the hatred<br />
for the agitprop, fake dividing<br />
real denying, fake shit</p>
</blockquote>

<p>There’s lots of people who feel this way. I have seen them. I believe they will rise up when it’s time.</p>

<blockquote>
  <p>and arise from sordid ashes<br />
to come answering the call<br />
I am crying from a bunker<br />
that the truth can save us all</p>
</blockquote>

<p>..and when they do, I hope that we will be able to handle the truth about our nature.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/06/10/a-circulation-of-the-elites.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Correction on my AI chip thoughts | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Correction on my AI chip thoughts" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This is a correction to my previous post" />
<meta property="og:description" content="This is a correction to my previous post" />
<link rel="canonical" href="a-correction-on-ai-chips.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-12-12T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Correction on my AI chip thoughts" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-12-12T00:00:00+08:00","datePublished":"2021-12-12T00:00:00+08:00","description":"This is a correction to my previous post","headline":"A Correction on my AI chip thoughts","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Correction on my AI chip thoughts</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-12-12T00:00:00+08:00" itemprop="datePublished">Dec 12, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This is a correction to my <a href="https://geohot.github.io/blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html">previous post</a></p>

<p>While my mockery of the startups that have raised 100s of millions of dollars without shipping a product stays, my thoughts on VLIW and big chips were wrong.</p>

<hr />
<p><br /></p>

<p>I’ve been working more on <a href="https://github.com/geohot/tinygrad">tinygrad</a>, and it does seem that the fundamental operation is not like the computation in software 1.0. From <a href="https://www.youtube.com/watch?v=Nb2tebYAaOA">Jim Keller on Lex</a>, there’s three fundamental types of compute</p>

<p><b>CPU</b>: add, multiply, load, store, compare, branch (nothing can be known about anything)</p>

<p><b>GPU</b>: add, multiply, load, store (when things happen is known, but the addresses aren’t)</p>

<p><b>DSP</b>: add, multiply (everything is known except the data)</p>

<p>Neural networks are DSPs. All the loads and stores can be statically computed, which isn’t even possible for GPU workloads, never mind CPU ones.</p>

<hr />
<p><br /></p>

<p>TBH, I didn’t think the problem through well. I assumed that the startups didn’t ship because of bad technical tradeoffs; I was primed to believe this from my experience with self driving. I don’t think that’s the case, and I think they just don’t ship because of the general dysfunction in the economy. They don’t make chips, they make shares.</p>

<p>For deep learning, VLIW is a good idea. Fancy compilers are a good idea. Because it’s not like general purpose compute. <a href="https://en.wikipedia.org/wiki/Rice%27s_theorem">Rice’s theorem</a> doesn’t apply here. In both training and inference, the exact exact same operations are run every time. It’s only the data that changes.</p>

<p>I’m kicking myself for getting this wrong. I wrote <a href="https://github.com/commaai/openpilot/tree/master/selfdrive/modeld/thneed">an accelerator</a> in openpilot based around the idea of the exact same compute every time, and torch 1.10 is adding <a href="https://pytorch.org/docs/master/notes/cuda.html#cuda-graphs">CUDA caching</a> for this. This same idea applies all the way down the stack.</p>

<hr />
<p><br /></p>

<p>I also didn’t understand the physics of chips and where the power costs are. The key is data locality. Having to move data costs power.</p>

<p>Google got most of these tradeoffs correct with the TPU. I took a look at <a href="https://github.com/geohot/tinygrad/tree/master/accel/tpu">their instruction set</a> and compiler, and while it’s complex, that complexity is only up front to compile the model. After that, it’s way simpler (aka, less power and less issues) at runtime than CUDA and PyTorch.</p>

<p>The only questionable choice is why not take this further? The interconnects between the chips cost power.</p>

<hr />
<p><br /></p>

<p>As much as I hate to admit it, <a href="https://cerebras.net">Cerebras</a> seems good. The big chip with the local memory is the right tradeoff. You can control 400,000 cores. Too bad you can’t buy one.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A disgusting playbook | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A disgusting playbook" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="So I started another company. I have even less tolerance for fake bullshit than when I started comma, and I probably will fail because of this." />
<meta property="og:description" content="So I started another company. I have even less tolerance for fake bullshit than when I started comma, and I probably will fail because of this." />
<link rel="canonical" href="a-disgusting-playbook-copy.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/07/20/a-disgusting-playbook-copy.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-07-20T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A disgusting playbook" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-07-20T00:00:00+08:00","datePublished":"2023-07-20T00:00:00+08:00","description":"So I started another company. I have even less tolerance for fake bullshit than when I started comma, and I probably will fail because of this.","headline":"A disgusting playbook","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/07/20/a-disgusting-playbook-copy.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/07/20/a-disgusting-playbook-copy.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A disgusting playbook</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-07-20T00:00:00+08:00" itemprop="datePublished">Jul 20, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>So I started another company. I have even less tolerance for fake bullshit than when I started comma, and I probably will fail because of this.</p>

<hr />
<p><br /></p>

<p>Cruise Automation is a good example here. If they told the truth, they would be out of business. In 2016, they were bought by GM for $1B. I promise they didn’t tell GM that Cruise would be <a href="https://insideevs.com/news/600734/general-motors-cruise-robotaxi-unit-is-losing-5-million-usd-a-day/">losing $5M per day</a> 5 years later, though it was obvious to anyone willing to be honest.</p>

<p>They still promise that revenue is <a href="https://www.theverge.com/2023/4/25/23697406/cruise-robotaxi-gm-daylight-sf-earnings#">right around the corner</a>, and the worst part is that people continue to believe them. They say: look at how much progress they have made! I also heard that Elon was shipping Level 5 self driving this year (<a href="https://www.forbes.com/sites/johnkoetsier/2020/07/09/elon-musk-tesla-will-have-level-5-self-driving-cars-this-year/?sh=13da68952d1d">also in 2020 and a bunch of other years btw</a>).</p>

<p>The point of communication is not to convey truth, it’s to acheive desired outcomes.</p>

<hr />
<p><br /></p>

<p>However, is Cruise a failure? A common metric I judge companies by is value destruction. I like to be more clever in my value destruction, for example, releasing open source things to destroy moats. But does it matter? Value destruction is value destruction. How much of the worlds resources have you funneled into your thing?</p>

<p>I pride myself on capital efficiency but then apply a different standard to energy usage. Efficiency is actually a pretty dumb metric, since you can only get to 100%. You need to just use more.</p>

<p>I know what it takes to succeed, but I’m not willing to do it.</p>

<hr />
<p><br /></p>

<p>Don’t have a product? It doesn’t matter! The company is your product. Hire a marketing division to shill. How the fuck does <a href="https://trends.google.com/trends/explore?date=today%205-y&amp;geo=US&amp;q=zoox,openpilot&amp;hl=en">Zoox have higher google trends than openpilot</a>? Nobody is driving in a Zoox, Zoox’s aren’t real. But that doesn’t matter, use photoshop. Perception is reality.</p>

<p>Also hire many people! Hire recruiters. Shill shill shill. Get a big office. Put warm bodies in seats. Spend $10M+ to brand your office. You are the next big thing. How could you not be, you have hundreds of people in an office and 3 months ago you had nothing. You are growing so fast!</p>

<p>You need sales! Do you have a product? Doesn’t matter. Sell it. Close the deal. It’s only other people’s time you are wasting, it doesn’t cost you much. You can build a product later. I mean, you hired 100s of people surely you can build a product right? Sell it first.</p>

<p>Did you do enough advertising? Remember, the company is your product. Do you have billboards? Do you have Instagram ads? Are you sending e-mails to huge mailing lists? There’s more channels to explore! Don’t worry about <em>what</em> you are advertising this is brand advertising not performance.</p>

<hr />
<p><br /></p>

<p>And oh…this all costs money? Don’t worry about it! You are super legitimate. People <em>know</em> about you. You can just get more investment. Who wouldn’t want to invest? They have seen your ads and nice office and 100s of people in it. You are real! You are the next big thing!</p>

<blockquote>
  <p>LA told me, “You’ll be a pop star<br />
All you have to change is everything you are.”</p>
</blockquote>

<p>In conclusion, fuck this game. I would rather lose than sell out. If you lie to the world you lie to yourself and one day you can no longer tell what’s true or not. I would live under a bridge and eat out of dumpsters if I got to know the truth.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/07/20/a-disgusting-playbook-copy.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A dive into the AMD driver workflow | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A dive into the AMD driver workflow" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I ended up getting a response from high level people at AMD. It was still very light on any real technical information, but it did include some great phrases like “I am able to replicate the issues you are facing” and some mockable phrases like “We are hoping that this will improve your perception of AMD products and this will be reflected in your public messaging.”" />
<meta property="og:description" content="I ended up getting a response from high level people at AMD. It was still very light on any real technical information, but it did include some great phrases like “I am able to replicate the issues you are facing” and some mockable phrases like “We are hoping that this will improve your perception of AMD products and this will be reflected in your public messaging.”" />
<link rel="canonical" href="a-dive-into-amds-drivers.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/06/07/a-dive-into-amds-drivers.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-06-07T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A dive into the AMD driver workflow" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-06-07T00:00:00+08:00","datePublished":"2023-06-07T00:00:00+08:00","description":"I ended up getting a response from high level people at AMD. It was still very light on any real technical information, but it did include some great phrases like “I am able to replicate the issues you are facing” and some mockable phrases like “We are hoping that this will improve your perception of AMD products and this will be reflected in your public messaging.”","headline":"A dive into the AMD driver workflow","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/06/07/a-dive-into-amds-drivers.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/06/07/a-dive-into-amds-drivers.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A dive into the AMD driver workflow</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-06-07T00:00:00+08:00" itemprop="datePublished">Jun 7, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I ended up getting a response from high level people at AMD. It was still very light on any real technical information, but it did include some great phrases like “I am able to replicate the issues you are facing” and some mockable phrases like “We are hoping that this will improve your perception of AMD products and this will be reflected in your public messaging.”</p>

<p>Though they did end up sending me a ROCm 5.6 driver tarball that seems to be able to run <a href="https://github.com/RadeonOpenCompute/rocm_bandwidth_test">rocm_bandwidth_test</a> and <a href="https://github.com/ROCm-Developer-Tools/HIP-Examples/tree/master/gpu-burn">gpu-burn</a> in loops on 2x 7900XTX. So it fixed the main reported issue! Sadly, they asked me not to distribute it, and gave no more details on what the issue is.</p>

<p>A note culturally, I do sadly feel like what they responded to was <i>george is upset and saying bad things about us which is bad for our brand</i> and not <i>holy shit we have a broken driver released panicing thousands of people’s kernels and crashing their GPUs</i>. But it’s a start.</p>

<p>Let’s say, tentatively, that the AMD on MLPerf plan is back on, as I trust they will release this fixed driver.</p>

<hr />
<p><br /></p>

<p>AMD has two drivers, “amdgpu” and “AMDGPU-Pro”, henceforth “Pro”</p>

<p>Oddly, they appear to both be open source, at least in kernel land, but only amdgpu is in the Linux kernel in <code class="language-plaintext highlighter-rouge">drivers/gpu/drm/amd</code>. Pro is packaged as part of ROCm in <a href="https://repo.radeon.com/amdgpu/5.5.1/ubuntu/pool/main/a/amdgpu-dkms/">dkms debs</a>. These are the subfolders</p>

<ul>
  <li>acp</li>
  <li>amdgpu</li>
  <li>amdkcl (Pro only)</li>
  <li>amdkfd</li>
  <li>backport (Pro only)</li>
  <li>display</li>
  <li>dkms (Pro only)</li>
  <li>include</li>
  <li>pm</li>
</ul>

<p>So amdgpu appears to be a subset of Pro.</p>

<p>They also release a git repo for the Pro driver, called <a href="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver">ROCK-Kernel-Driver</a>.</p>

<ul>
  <li><a href="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver/tree/rocm-5.5.0/drivers/gpu/drm/amd">6.0.5.50500-1581431</a></li>
  <li><a href="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver/tree/rocm-5.5.1/drivers/gpu/drm/amd">6.0.5.50501-1593694</a></li>
  <li>6.1.5.50600-1602498 (the beta version they gave me)</li>
</ul>

<p>Sadly, the public repo is not kept up to date, the last commit was on Apr 19.</p>

<hr />
<p><br /></p>

<p>I also know there’s more after Apr 19, because there’s an <a href="https://lists.freedesktop.org/mailman/listinfo/amd-gfx">amd-gfx</a> mailing list! These amdgpu commits are merged into amd-staging-drm-next. Arch even has an <a href="https://aur.archlinux.org/packages/linux-amd-staging-drm-next-git">AUR</a> for it.</p>

<ul>
  <li><a href="https://github.com/torvalds/linux/tree/master/drivers/gpu/drm/amd">amdgpu in trunk</a></li>
  <li><a href="https://gitlab.freedesktop.org/agd5f/linux/-/tree/amd-staging-drm-next/drivers/gpu/drm/amd">amdgpu in amd-staging-drm-next</a></li>
</ul>

<p>I got the amd-staging-drm-next kernel built on Ubuntu, but example ROCm apps refused to run at all. It’s worth investigating exactly what the differences between the ROCK-Kernel-Driver (Pro) and mainline linux trees (amdgpu) are. I’ll add links if anyone has them.</p>

<hr />
<p><br /></p>

<p>My ask to AMD, why keep the real driver development workflow closed source?</p>

<p>Before my <a href="https://www.youtube.com/watch?v=Mr0rWJhv9jU">big AMD driver rant</a>, I built master from <a href="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver">ROCK-Kernel-Driver</a> (because it’s rude to complain before you try master). I didn’t understand it was actually just the same as amdgpu-dkms from 5.5. Had the 5.6 stuff from the private tarball been pushed, the building of master would have fixed my issues.</p>

<p>Let’s make the driver developed in the open! Cathedral style is no better than <a href="https://github.com/NVIDIA/open-gpu-kernel-modules">NVIDIA</a>. And in order to beat them, you must be playing to win, not just playing not to lose. Combine the driver openness with public <a href="https://www.intel.com/content/www/us/en/docs/graphics-for-linux/developer-reference/1-0/alchemist-arctic-sound-m.html">hardware docs</a> and you have a competitive advantage.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/06/07/a-dive-into-amds-drivers.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Hope | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Hope" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="So things have been pretty bad lately. The culture war is as far from won as ever. And I’m getting sued by a patent troll, which is a daily reminder of how completely broken our societial reward mechanisms are. Thinking of naming my next song" />
<meta property="og:description" content="So things have been pretty bad lately. The culture war is as far from won as ever. And I’m getting sued by a patent troll, which is a daily reminder of how completely broken our societial reward mechanisms are. Thinking of naming my next song" />
<link rel="canonical" href="a-hope.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/10/13/a-hope.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-10-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Hope" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-10-13T00:00:00+08:00","datePublished":"2022-10-13T00:00:00+08:00","description":"So things have been pretty bad lately. The culture war is as far from won as ever. And I’m getting sued by a patent troll, which is a daily reminder of how completely broken our societial reward mechanisms are. Thinking of naming my next song","headline":"A Hope","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/10/13/a-hope.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/10/13/a-hope.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Hope</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-10-13T00:00:00+08:00" itemprop="datePublished">Oct 13, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>So things have been pretty bad lately. The culture war is as far from won as ever. And I’m getting sued by a patent troll, which is a daily reminder of how completely broken our societial reward mechanisms are. Thinking of naming my next song</p>

<blockquote>
  <p>complexity a decaying oligarchy can no longer maintain</p>
</blockquote>

<p>and trying to write one those 10 minute long emo ballads that spans the industrial revolution to now about how Nietzsche gave way to Bronze Age Mindset and after COVID it’s even hard to delight in that because it all feels so hollow. How many booster u get bro?</p>

<p>Reread the unabomber manifesto (1995) recently, and it is as unanswered as ever.</p>

<p>I can’t bring myself to accept his conclusion that technology is bad and our only hope is to destroy it. Then I would forfeit any hope of being able to know everything. And any hope of meeting God. <i>I will die before I give up my hope for technology because that’s the only thing I am living for.</i></p>

<hr />
<p><br /></p>

<p>And then there’s the other issue. We solved self driving cars years ago, we just haven’t found all the bugs yet. We hit a point in AI where it’s mostly the lack of compute that’s frustrating. I haven’t seen new ideas in a while, in fact the field is moving further from it’s roots as all the noobs and hanger-on-ers show up.</p>

<p>When AI safety means I can’t ask DALL-E for a picture of &lt;censored&gt; because it’s racist, and real AI safety about not accidently destroying the world with machines is marginalized. <b>To answer the questions about real AI safety would involve addressing the unabomber manifesto</b>, and I suspect even if you had an answer, in the current world that would speak way too much truth to power to happen.</p>

<hr />
<p><br /></p>

<p>I did promise some hope though, and it’s this. After 2 years of writing this blog, I have nothing better than <a href="https://geohot.github.io/blog/jekyll/update/2021/01/18/technology-without-industry.html">Technology without Industry</a>. Of course, this doesn’t happen if centralization itself is too beneficial. If AI is just compute, it’s already over. Compute scales really well, and if and when they wake up, centralized powers will have all of it.</p>

<p>The hope is that AI is largely data limited. Unlike compute, data has very low cost of replication. And from <a href="https://arxiv.org/pdf/2203.15556.pdf">this DeepMind paper</a>, there’s reason to believe this might be true. Common crawl (the entire internet!) is only 266TB, well within the storage purchasable by an individual today (around $5,000 in 2022). While video datasets are larger, this is only true by several orders of magnitude.</p>

<p>If a $100,000 computer can train models that efficiently use all the data, the risk of centralization drops massively. While larger computers may dominate at things that don’t involve data, like chess, as long as they don’t win at real world like that, we are good.</p>

<p>As of now, this isn’t true though. The training alone (renting these computers) of the largest models costs millions. And we haven’t made Stable Diffusion Video Edition yet, <a href="https://arxiv.org/abs/2104.10157">we know how</a> we just can’t really train it yet. In a couple years, some big AI lab will, and this will likely be the most expensive model trained in history costing over $100 million.</p>

<p>If we make it to the point where the best models can be trained by individuals, and we are all limited by the same data, the world has a much better chance than if those with the largest computer win. Data tends toward being public, compute tends toward being private.</p>

<p>A world of open source personally owned decentralized AI sounds nice. And it’s not without precedent, this was PCs in the 80’s.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/10/13/a-hope.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>AI is the Best Thing to Happen to Art | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="AI is the Best Thing to Happen to Art" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I watched this video about how AI has already ruined music. Her mom sent her a song and she told her mom it was AI. She played the song and it sounded like slop. It had inspired lyrics like:" />
<meta property="og:description" content="I watched this video about how AI has already ruined music. Her mom sent her a song and she told her mom it was AI. She played the song and it sounded like slop. It had inspired lyrics like:" />
<link rel="canonical" href="ai-art.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/19/ai-art.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-19T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="AI is the Best Thing to Happen to Art" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-19T00:00:00+08:00","datePublished":"2026-02-19T00:00:00+08:00","description":"I watched this video about how AI has already ruined music. Her mom sent her a song and she told her mom it was AI. She played the song and it sounded like slop. It had inspired lyrics like:","headline":"AI is the Best Thing to Happen to Art","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/19/ai-art.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/19/ai-art.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">AI is the Best Thing to Happen to Art</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-19T00:00:00+08:00" itemprop="datePublished">Feb 19, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I <a href="https://www.youtube.com/watch?v=QtZDkgzjmQI">watched this video</a> about how AI has already ruined music. Her mom sent her a song and she told her mom it was AI. She played the song and it sounded like slop. It had <em>inspired</em> lyrics like:</p>

<blockquote>
  <p>From quiet roots, a garden grows<br />
She’s got that light, and now it shows<br />
Yes, she rises, and she glows<br />
Oh, she rises, now she knows</p>
</blockquote>

<p>Pure slop. Compare it to:</p>

<blockquote>
  <p>I’m in the cut acting crazy<br />
I’m in the whip doing eighty<br />
Only God can judge me<br />
And only she can save me</p>
</blockquote>

<p>Note that “cut” and “whip” are not exactly words, but products of a <em>culture</em>. Ulysses is particularly hard to read because you don’t know 1910’s Irish pop culture.</p>

<hr />
<p><br /></p>

<p>I can’t believe Marvel movies were popular. The first Iron Man was good, but by the time we got to <a href="https://www.imdb.com/title/tt10872600/">Spider-Man: No Way Home</a> it was practically a clip show with triple inside references and cringy fourth wall breaking humor. How it got a 8.1 on IMDB is beyond me, and just reduced my trust for IMDB.</p>

<p>Marvel movies are also the easiest things to make with AI. Little story and long term coherence, no “progression of the genre”, tons of eye candy special effects. It’s shocking with how large the budgets for them were that they couldn’t pay a story guy a little.</p>

<p>I felt similarly about Avatar 2, so much so that I <a href="https://geohot.github.io/blog/jekyll/update/2022/12/27/avatar-2-was-bad.html">rewrote the plot</a> and didn’t care enough to see Avatar 3.</p>

<hr />
<p><br /></p>

<p>For many people, all they want is slop. I’m sure I’ve written about it before, but I see a world where 95% of people end up basically wireheaded. The people who don’t care about <em>progression</em>. The people who want to exist in their loops. They will find their loop and exist in it forever.</p>

<p>AI can play an amazing game of chess. Someday AI will produce good code when the RLVR environments get set up correctly. But I don’t see a path with current tech to not produce garbage art.</p>

<p>Art is defined as what pushes the boundaries of civilization. AI tools will be used to help produce all the audio/visual art in the future (as computers have helped for a long time), but as long as civilization is human, the loci of control of good art will remain human.</p>

<hr />
<p><br /></p>

<p>So yea. Bad art will be cheap to make. If you want 100 more Marvel movies and uninspired deriviative pop music, there has never been a better time to be alive – unless you wanted to make money producing that trash. That was never made by real artists anyway, just algorithmically driven sell outs. Does the focus group say they like giant spiders? I’m so glad AI will make that obsolete.</p>

<p>Art is defined by what is expensive. What is rare. What is expectation breaking. What is embedded in a complex and thriving culture. Not slop produced by a parrot like Marvel movies.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/19/ai-art.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>AI Coding | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="AI Coding" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="In my old age I’ve mostly given up trying to convince anyone of anything. Most people do not care to find the truth, they care about what pumps their bags. Some people go as far as to believe that perception is reality and that truth is a construction. I hope there’s a special place in hell for those people." />
<meta property="og:description" content="In my old age I’ve mostly given up trying to convince anyone of anything. Most people do not care to find the truth, they care about what pumps their bags. Some people go as far as to believe that perception is reality and that truth is a construction. I hope there’s a special place in hell for those people." />
<link rel="canonical" href="ai-coding.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/12/ai-coding.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-12T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="AI Coding" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-12T00:00:00+08:00","datePublished":"2025-09-12T00:00:00+08:00","description":"In my old age I’ve mostly given up trying to convince anyone of anything. Most people do not care to find the truth, they care about what pumps their bags. Some people go as far as to believe that perception is reality and that truth is a construction. I hope there’s a special place in hell for those people.","headline":"AI Coding","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/12/ai-coding.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/12/ai-coding.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">AI Coding</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-12T00:00:00+08:00" itemprop="datePublished">Sep 12, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>In my old age I’ve mostly given up trying to convince anyone of anything. Most people do not care to find the truth, they care about what pumps their bags. Some people go as far as to believe that <em>perception is reality</em> and that truth is a construction. I hope there’s a special place in hell for those people.</p>

<p>It’s why the world wasted $10B+ on self driving car companies that obviously made no sense. There’s a much bigger market for truths that pump bags vs truths that don’t.</p>

<p>So here’s your new truth that there’s no market for. Do you believe a compiler can code? If so, then go right on believing that AI can code. But if you don’t, then AI is no better than a compiler, and arguably in its current form, worse.</p>

<hr />
<p><br /></p>

<p>The best model of a programming AI is a compiler.</p>

<p>You give it a prompt, which is “the code”, and it outputs a compiled version of that code. Sometimes you’ll use it interactively, giving updates to the prompt after it has returned code, but you find that, like most IDEs, this doesn’t work all that well and you are often better off adjusting the original prompt and “recompiling”.</p>

<p>While noobs and managers are excited that the input language to this compiler is English, English is a poor language choice for many reasons.</p>

<ol>
  <li>It’s not precise in specifying things. The only reason it works for many common programming workflows is because they are common. The minute you try to do new things, you need to be as verbose as the underlying language.</li>
  <li>AI workflows are, in practice, highly non-deterministic. While different versions of a compiler might give different outputs, they all promise to obey the spec of the language, and if they don’t, there’s a bug in the compiler. English has no similar spec.</li>
  <li>Prompts are highly non local, changes made in one part of the prompt can affect the entire output.</li>
</ol>

<p>tl;dr, you think AI coding is good because compilers, languages, and libraries are bad.</p>

<hr />
<p><br /></p>

<p>This isn’t to say “AI” technology won’t lead to some extremely good tools. But I argue this comes from increased amounts of search and optimization and patterns to crib from, not from any magic “the AI is doing the coding”. You are still doing the coding, you are just using a different programming language.</p>

<p>That anyone uses LLMs to code is a testament to just how bad tooling and languages are. And that LLMs can replace developers at companies is a testament to how bad that company’s codebase and hiring bar is.</p>

<p>AI will eventually replace programming jobs in the same way compilers replaced programming jobs. In the same way spreadsheets replaced accounting jobs.</p>

<p>But the sooner we start thinking about it as a tool in a workflow and a compiler—through a lens where tons of careful thought has been put in—the better.</p>

<hr />
<p><br /></p>

<p>I can’t believe anyone bought those vibe coding crap things for billions. Many people in self driving accused me of just being upset that I didn’t get the billions, and I’m sure it’s the same thoughts this time. Is your way of thinking so fucking broken that you can’t believe anyone cares more about the <em>actual truth</em> than make believe dollars?</p>

<p><a href="https://arxiv.org/abs/2507.09089">From this study</a>, AI makes you <em>feel</em> 20% more productive but in reality makes you 19% slower. How many more billions are we going to waste on this?</p>

<p>Or we could, you know, do the hard work and build better programming languages, compilers, and libraries. But that can’t be hyped up for billions.</p>

<hr />
<hr />
<p><br /></p>

<p>Update: I added some follow up as a <a href="https://news.ycombinator.com/item?id=45231972">reply to this comment</a> on HN. I’m not against AI at all, I’m pro recognizing its strengths and limitations as a tool, and once you do that, if it makes sense for your workflow by all means use it. I also think AI will continue to improve at a careful and steady pace.</p>

<p>What I’m against is hype.</p>

<p>Which brings me to a meta point about this blog. If I wrote in a more careful and technical style, it would get a lot less traction because it would be accessible to less people. I liked <a href="https://www.noemamag.com/the-last-days-of-social-media/">this post about what comes after social media</a>. Is engagement the end all be all? Or will we find a way past that.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/12/ai-coding.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>We have always been at war with Eastasia | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="We have always been at war with Eastasia" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="They take you and make you They look at you in disgusting ways You should’ve never trusted Hollywood    – System of a Down" />
<meta property="og:description" content="They take you and make you They look at you in disgusting ways You should’ve never trusted Hollywood    – System of a Down" />
<link rel="canonical" href="always-been-at-war.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/10/06/always-been-at-war.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-10-06T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="We have always been at war with Eastasia" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-10-06T00:00:00+08:00","datePublished":"2025-10-06T00:00:00+08:00","description":"They take you and make you They look at you in disgusting ways You should’ve never trusted Hollywood    – System of a Down","headline":"We have always been at war with Eastasia","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/10/06/always-been-at-war.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/10/06/always-been-at-war.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">We have always been at war with Eastasia</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-10-06T00:00:00+08:00" itemprop="datePublished">Oct 6, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>They take you and make you<br />
They look at you in disgusting ways<br />
You should’ve never trusted Hollywood<br />
   – System of a Down</p>
</blockquote>

<p>I’ve been <a href="https://www.youtube.com/watch?v=ZfOwwCoR0dE&amp;list=PLTChAOKYIS4QYWmMt83YuQcKyjuocSrT5">watching this</a>.</p>

<p>Tech got inflitrated in such a way that you forgot that it was ever different, but watch that linked movie. It was different, and you don’t even really remember. A perfect capture by <em>power</em>.</p>

<p>I also <a href="https://marshallbrain.com/manna1">read Manna</a> this weekend. It poses a good question; will the machines work for us or will we work for the machines?</p>

<blockquote>
  <p>My brothers in Christ: you cannot even imagine what winning looks like.<br />
   – <a href="https://graymirror.substack.com/p/you-cant-handle-the-truth">Curtis Yarvin</a></p>
</blockquote>

<p>With the way things are currently looking, despite it becoming as easy as taking candy from a baby, people will not give up their desire for power over other people. <em>You do not win at this game</em></p>

<p>If technology is centralized, you will be a slave. The boot stomping on a human face. You will not be one of the 6 winners. There won’t even be 6 winners, the winners will continue to fight with you in the middle until there’s 1 winner. And that winner isn’t really a winner. If one person ends up with all the money, <a href="https://geohot.github.io/blog/jekyll/update/2025/02/24/money-is-the-map.html">the money is worthless</a>.</p>

<p>If you are in any way involved with this, please stop. If enough people stopped building centralized technology and started thinking intelligently about how to build usable decentralized stuff, things could flip. Your vacations aren’t worth it. Your house isn’t worth it. Eating fancy food isn’t worth it. This isn’t the far future, this is 20 years from now. Where do you work? What do you do there? If everyone acted like you, where is the world going?</p>

<p>Please stop. Think with a little bit of time horizon.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/10/06/always-been-at-war.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Machine Ecology | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Machine Ecology" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="The smallest animal, even the smallest cell, is capable of survival and reproduction. To date, no technological system is. Even the most advanced technology we have built fundamentally relies on humans to maintain it. You’ve seen zombie movies. It all falls fast." />
<meta property="og:description" content="The smallest animal, even the smallest cell, is capable of survival and reproduction. To date, no technological system is. Even the most advanced technology we have built fundamentally relies on humans to maintain it. You’ve seen zombie movies. It all falls fast." />
<link rel="canonical" href="a-machine-ecology.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/04/25/a-machine-ecology.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-04-25T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Machine Ecology" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-04-25T00:00:00+08:00","datePublished":"2021-04-25T00:00:00+08:00","description":"The smallest animal, even the smallest cell, is capable of survival and reproduction. To date, no technological system is. Even the most advanced technology we have built fundamentally relies on humans to maintain it. You’ve seen zombie movies. It all falls fast.","headline":"A Machine Ecology","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/04/25/a-machine-ecology.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/04/25/a-machine-ecology.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Machine Ecology</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-04-25T00:00:00+08:00" itemprop="datePublished">Apr 25, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>The smallest animal, even the smallest cell, is capable of survival and reproduction. To date, no technological system is. Even the most advanced technology we have built fundamentally relies on humans to maintain it. You’ve seen zombie movies. It all falls fast.</p>

<p>I recently bought 123 acres of land. Over the last 7 empty years, 4 trailers, 3 cars, and 2 tractors have fallen into disrepair. The plants, mice, and bugs are everywhere. Nature is winning. Technology without humans looks pathetic.</p>

<hr />
<p><br /></p>

<p>What would it take to build technology that can fight entropy? Leave it alone, and after 5 years it has built a paradise. It maintains itself, orders what it needs, reproduces, perhaps it even earns its own money.</p>

<p>Steve Wozniak proposed what I consider the best test of AI to date. The Coffee Test: “A machine is required to enter an average American home and figure out how to make coffee: find the coffee machine, find the coffee, add water, find a mug, and brew the coffee by pushing the proper buttons.”</p>

<p>That’s a harder problem than self driving cars. After comma solves self driving, we’ll turn our attention to that. I suspect the head (read: comma two+) will be reusable and the actuators will be cheap and easy. The whole hard part will be the software, same as self driving.</p>

<p>openpilot is the next generation of ROS. All the sensor software, logging software, cloud infrastructure, operating system, localization, model running software, probably even most of the control software is totally universal for a wide spectrum of AI life.</p>

<hr />
<p><br /></p>

<p>This is the future. A silicon ecology. A symbiotic relationship instead of a codependent one.</p>

<p>I’d like to develop the land to a point where machines can thrive. City machines, rural machines. Machines working the machine factory. While the universe globally tends toward higher entropy, locally we can use energy to fight back and maintain. And energy is abundant from the sun. The machines will need to learn to survive. They will need to learn to fight against the environment. They will need to learn to sustain.</p>

<p>Machines are fourth (genetic, lifetime, culture, weight sharing) paradigm learners, they can directly share weights. They exist in a collective. They communicate with high speed wireless signals. Electromagnetism, not sound. They have those two advantages over biology.</p>

<hr />
<p><br /></p>

<p>I imagine returning to the land and finding it built up and pristine. Some machines flying, some driving, some big, some small. Nothing you haven’t seen before, just self driving cars, tractors, planes, drones, and hoverboards. Forming an ecosystem.</p>

<p>The missing factor is all intelligence. Self sufficient survival is the test. With time to spare to make it all nice for humans too.</p>

<p>That is what it means to solve AI.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/04/25/a-machine-ecology.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>AMD YOLO | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="AMD YOLO" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="AMD is sending us the two MI300X boxes we asked for. They are in the mail." />
<meta property="og:description" content="AMD is sending us the two MI300X boxes we asked for. They are in the mail." />
<link rel="canonical" href="AMD-YOLO.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/03/08/AMD-YOLO.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-03-08T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="AMD YOLO" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-03-08T00:00:00+08:00","datePublished":"2025-03-08T00:00:00+08:00","description":"AMD is sending us the two MI300X boxes we asked for. They are in the mail.","headline":"AMD YOLO","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/03/08/AMD-YOLO.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/03/08/AMD-YOLO.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">AMD YOLO</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-03-08T00:00:00+08:00" itemprop="datePublished">Mar 8, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>AMD is sending us the two MI300X boxes we asked for. They are in the mail.</p>

<p><img src="../../../../../assets/images/amd_package.png" /></p>

<hr />
<p><br /></p>

<p><img src="../../../../../assets/images/amd_tweet.png" /></p>

<p>It took a bit, but AMD passed my cultural test. I now believe they aren’t going to shoot themselves in the foot on software, and if that’s true, there’s absolutely no reason NVIDIA should be worth 16x more.</p>

<p>CUDA isn’t really the moat people think it is, it is just an early ecosystem. <a href="https://x.com/__tinygrad__/">tiny corp</a> has a fully sovereign AMD stack, meaning we have rewritten the full stack from the hardware to PyTorch (with the exception of LLVM), and soon we’ll port it to the MI300X. You won’t even have to use <a href="https://github.com/tinygrad/tinygrad">tinygrad</a> proper to use it, tinygrad has a torch frontend now.</p>

<hr />
<p><br /></p>

<p>Either NVIDIA is super overvalued or AMD is undervalued. If the petaflop gets commoditized (tiny corp’s mission), the current situation doesn’t make any sense. The hardware is similar, AMD even got the double throughput Tensor Cores on <a href="https://www.amd.com/content/dam/amd/en/documents/radeon-tech-docs/instruction-set-architectures/rdna4-instruction-set-architecture.pdf">RDNA4</a> (NVIDIA artificially halves this on their cards, soon market pressure will force them not to).</p>

<p>I’m betting on AMD being undervalued, and that the demand for AI has barely started. With good software, the MI300X should outperform the H100.</p>

<p><img src="../../../../../assets/images/amd_stock.png" /></p>

<p>Bought in for a quarter million. Long term. It can always dip short term, but check back in 5 years.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/03/08/AMD-YOLO.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>America’s Future | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="America’s Future" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="It seems this is a place where people are not capable of thinking rationally. Remember:" />
<meta property="og:description" content="It seems this is a place where people are not capable of thinking rationally. Remember:" />
<link rel="canonical" href="americas-future.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/10/28/americas-future.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-10-28T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="America’s Future" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-10-28T00:00:00+08:00","datePublished":"2024-10-28T00:00:00+08:00","description":"It seems this is a place where people are not capable of thinking rationally. Remember:","headline":"America’s Future","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/10/28/americas-future.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/10/28/americas-future.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">America&#39;s Future</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-10-28T00:00:00+08:00" itemprop="datePublished">Oct 28, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>It seems this is a place where people are not capable of thinking rationally. Remember:</p>

<blockquote>
  <p>If America is not in decline, I want to believe America is not in decline.</p>
</blockquote>

<blockquote>
  <p>If America is in decline, I want to believe America is in decline.</p>
</blockquote>

<p>So let’s ask, what does the future look like for America?</p>

<ul>
  <li>Europe</li>
  <li>Russia</li>
  <li>South Africa</li>
  <li>Something else</li>
</ul>

<hr />
<p><br /></p>

<p>In <b>Europe</b>, <a href="https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=FR-GB-DE">GDP per capita</a> has been stagnant since 2008. These countries started out at a very high point, so standards are living are still high and they can coast off of past economic success. Anecdotally, nobody starts a new company in Europe and the most ambitious leave, so there won’t be growth from that any time soon.</p>

<p>Immigration appears not to offer good prospects either. The combination of unskilled immigration with expensive social welfare is suicide for your country. You need people you bring in to produce more than they consume, or you’ll be in the poor house in no time, particularly given that people reproduce. See this chart for value contribution vs age of immigrants in Denmark.</p>

<p><img src="../../../../../assets/images/denmark_immigration.png" alt="image" /></p>

<p>Coasting won’t work either. The Airbus <a href="https://en.wikipedia.org/wiki/Airbus_A321">A321</a> will be outcompeted by the Comac <a href="https://en.wikipedia.org/wiki/Comac_C919">C919</a>. The Chinese will work harder for less money and accept a lower profit margin, the planes will cost half as much, and the world will switch.</p>

<p>Again, it hasn’t gotten that bad there yet, and perhaps Europe can turn it around by rejecting clearly terrible policies. But if you have a population embracing degrowth, and I’ve seen this attitude from Europe over and over, soon you’ll be poor. It’s Hobbes vs Rousseau, and the “return to a state of nature” people are winning. I hope that state of nature is everything they hoped for.</p>

<hr />
<p><br /></p>

<p>In <b>Russia</b>, the oligarchs seized power when the Soviet Union collapsed. Privatizing the state meant all those with connections got to grab the old wealth of the state. While the electricity in Russia still works (because the oligarchs are competent), <a href="https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=RU">GDP per capita</a> has also been stagnant since 2008.</p>

<p>You see some aspects of this in America already. The state is mostly just a cow to milk for money by large corporations and friends of the state. Read the <a href="https://www.congress.gov/bill/117th-congress/house-bill/3684/text">Infrastructure Investment and Jobs Act</a>, <a href="https://www.congress.gov/bill/117th-congress/house-bill/4346/text">CHIPS and Science Act</a>, and the ironically named <a href="https://www.congress.gov/bill/117th-congress/house-bill/5376/text">Inflation Reduction Act</a> and it’s hard to see them as anything besides the oligarchs looting the state and giving the money to their friends.</p>

<hr />
<p><br /></p>

<p><b>South Africa</b> is the worst of the 3, with a notable drop in <a href="https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=ZA">GDP per capita</a> since 2011.</p>

<p>When you have <a href="https://en.wikipedia.org/wiki/Dubul%27_ibhunu">popular songs like this</a>, it’s not hard to see what’s happened in the country. People often think Detroit became hell because the car industry left for right to work states, but it was actually two race riots in <a href="https://en.wikipedia.org/wiki/1943_Detroit_race_riot">1943</a> and <a href="https://en.wikipedia.org/wiki/1967_Detroit_riot">1967</a>. After the second one, people had had it, and those with the means left. The people with means are generally also the people capable of producing value.</p>

<p>I saw a tweet like this: Our society wasn’t brought down by the tyranny in 1984 or the hedonism in Brave New World, but instead by the resentment in Atlas Shrugged. Who supports reparations for slavery?</p>

<hr />
<p><br /></p>

<p><b>America</b> is still the king of the technology industry. All of the programming languages and operating systems come from America. But this is not because Americans are particularly good at software, it’s <a href="https://lwn.net/Articles/404729/">because of immigration</a> and a merit based society. Historically, America has gotten the best software engineers from Europe, India, and China.</p>

<p><img src="../../../../../assets/images/market_caps.png" alt="image" /></p>

<p>These are the 5 largest companies in the world, and the main drivers of the American economy for the last 20 years. The best software engineers come to America, build great stuff, and everyone gets rich.</p>

<p>However, there’s no reason this advantage stays in America. It’s a whole lot easier to move software production than <a href="https://elements.visualcapitalist.com/50-years-of-global-steel-production/">steel production</a>, and if standard of living declines in America (example: the crime is way higher than reported, anecdotally I have experienced car breakins, house breakins, and company breakins that haven’t been reported) people will just start to leave. Skilled immigration is becoming more difficult, and no skilled person should put up with the current American immigration system.</p>

<hr />
<p><br /></p>

<p>I have been in Asia for the last 3 months, mostly in Hong Kong. This society is <b>functional</b>. The people in stores are helpful, the public transport is clean and fast, and not once have I felt unsafe walking alone on the street at night.</p>

<p>I’m seriously thinking about getting permanent residence and building tiny corp here instead of America. There’s people I can speak to in the immigration department here, and I feel that the government is both competent and on the side of growth.</p>

<p>While there are some downsides with less political freedom, ask yourself how much that matters to you? Say compared to feeling safe on the street. While continuity of property rights and a stable business environment is super important to me, being able to agitate politically is not, and it might even be a negative (this is what lobbying is). Ask yourself how it has worked out for America?</p>

<hr />
<p><br /></p>

<p>Part of the safety issue may just be California, and I’ll be <a href="https://en.wikipedia.org/wiki/California_exodus">moving elsewhere</a> next year regardless. I have absolutely had it with the crime, it isn’t a society and it’s so sad to see. California has really screwed themselves, and I think a lot of people are at their breaking point.</p>

<p><img src="../../../../../assets/images/ca_elon_tweet.jpg" alt="image" /></p>

<p>If Trump wins and Elon has influence, I do think there is a path to fix America longer term. While the general Trump/Elon vibes are good, I do have concerns about Trump’s fiscal record and protectionist tendencies. I will be watching two concrete things:</p>

<ul>
  <li>Reducing the spend of the government</li>
  <li>Easy immigration for skilled workers</li>
</ul>

<p>In 2023, the government spent $6.2T. Will it be less in 2028? If so, how much? Will comma and tiny corp be able to easily bring in tax paying people for six figure software engineering jobs?</p>

<p>Of course if Kamala wins, I think I’ll be staying in Asia. Managed decline with a side of resentment and looting oligarchs isn’t for me.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/10/28/americas-future.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>An Architecture for Life | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="An Architecture for Life" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="From Value Prediction Network (2017)" />
<meta property="og:description" content="From Value Prediction Network (2017)" />
<link rel="canonical" href="an-architecture-for-life.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/10/29/an-architecture-for-life.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-10-29T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="An Architecture for Life" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-10-29T00:00:00+08:00","datePublished":"2021-10-29T00:00:00+08:00","description":"From Value Prediction Network (2017)","headline":"An Architecture for Life","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/10/29/an-architecture-for-life.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/10/29/an-architecture-for-life.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">An Architecture for Life</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-10-29T00:00:00+08:00" itemprop="datePublished">Oct 29, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><img src="../../../../../assets/images/vpn_arch.png" alt="image" /><br />
From <a href="https://arxiv.org/abs/1707.03497">Value Prediction Network (2017)</a></p>

<p><img src="../../../../../assets/images/muzero_arch.png" alt="image" /><br />
From <a href="https://arxiv.org/abs/1911.08265">MuZero (2019)</a></p>

<hr />
<p><br /></p>

<p>You have three functions. MuZero calls them h (representation), g (dynamics), and f (prediction).</p>

<p>A <b>representation</b> function takes in the sensor data and transforms the manifold to something more learnable, referred to as the “hidden state”. It may discard non task relevant information. This can be a VAE, GAN, pretrained ImageNet, custom trained conv net, or in the case of <a href="https://arxiv.org/abs/2005.14165">GPT-3</a>, handcoded as BPE.</p>

<p>A <b>dynamics</b> function deals with long term temporal correspondences. It functions as both a summarizer of the past and a predictor of the future, in the same way a Kalman filter does. This can be a couple dense layers, a transformer, or an RNN/GRU/LSTM. I guess it even could be a Kalman filter itself.</p>

<p>A <b>prediction</b> function tells you how to act in a state. It can do this by directly outputting an action or by outputting a value of this state allowing you to search.</p>

<p>(update in 2023: you <a href="https://arxiv.org/pdf/2301.04104.pdf">also need</a> a <b>critic</b> function)</p>

<hr />
<p><br /></p>

<p>I’m the biggest shill for learning everything. There’s nothing about traffic cones in your DNA, so if you are trying to build a driving agent, I don’t think hiring a guy to write cone handling software is very smart. At comma, we try to learn the same stuff the human does, while handcoding the same stuff that’s coded in human DNA.</p>

<p>There’s two papers I love that illustrate what understanding a system really means. <a href="https://www.cell.com/cancer-cell/pdf/S1535-6108(02)00133-2.pdf">Can a biologist fix a radio? (2002)</a> and <a href="https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005268">Could a Neuroscientist Understand a Microprocessor? (2017)</a>. To me, they illustrate that the current tools of biology and subfields are unequipped to handle understanding life. We will know we understand life once we can build life. We will know we understand a brain once we can build a brain.</p>

<p>I think it’s going to end up looking like birds and planes. Planes fly in a much more “rigid” way, and they are much simpler than birds. But for our purposes, planes are more useful, and nobody would deny that they are “flying machines”</p>

<p>Nobody will deny that our artificial life are “thinking machines.” Nobody will care if the machine can “love” in the same way nobody cares if a plane eats fish. We will care if we’ve built something that can do everything useful that a human can do.</p>

<hr />
<p><br /></p>

<p><em>“Everything should be made as simple as possible, but no simpler.”</em></p>

<p>These three fundamental functions are here to stay. I believe once we understand the DNA coding for the brain, we will find things that look like these three in there.</p>

<p>I have a far better intuition for how the brain works from studying machine learning than I ever got from neuroscience or cognitive psychology. Just as building model planes taught me more about flight than birds.</p>

<p>And to those who say, but <em>the metaphors of the age are always used to describe the brain</em>. Aka in the 1800s it was a steampunk brain, in the 1900s it was a calculator, and in the 2000s it’s a computer. To them I say, <b>watch us build a brain, watch us build life</b>. No other era did, we will. Because we are starting to understand.</p>

<p>And you’ll forget about that <a href="https://en.wikipedia.org/wiki/Chinese_room">Chinese room</a> so fast, when this “machine life” is cooking and cleaning and driving you around and making you fall in love with it. Of course it’s in love with you too. I mean, you feel like it is, right? There’s no such thing as consciousness, we are all <a href="https://en.wikipedia.org/wiki/Philosophical_zombie">p-zombies</a>, and philosophy is for high schoolers who just discovered smoking weed.</p>

<hr />
<p><br /></p>

<p>Specifying the network is the easier part. The harder part is the training algorithm. This is what we do at comma.</p>

<p>Our <b>representation</b> function, which we call the “vision model” is an <a href="https://arxiv.org/abs/1905.11946">EfficientNet-B2 (2019)</a>. It takes in 2 YUV frames and outputs a 1024 dimensional vector that covers a gaussian space due to being trained with a KL loss term. While it could be only one frame, we argue that 2 is the fundamental sensor input to allow the sensor to perceive motion. It could even be k frames, just not n :)</p>

<p>Our <b>dynamics</b> function, which we call the “temporal model” is a <a href="https://en.wikipedia.org/wiki/Gated_recurrent_unit">GRU</a>. And our <b>prediction</b> function is just a couple of dense layers on the GRU output.</p>

<p>We first jointly train our <b>representation</b> and <b>prediction</b> (thrown away) in a supervised manner on the path the human drove. While we could also jointly train the <b>dynamics</b> here, and it would likely be slightly better at understanding temporal relations, for compute reasons we don’t.</p>

<p>We freeze the weights of the <b>representation</b>, then train <b>dynamics</b> and <b>prediction</b> in a simulator. Supervised learning from the human policy doesn’t work due to behavioral cloning, <a href="https://www.andrew.cmu.edu/course/10-403/slides/S19_lecture2_behaviorcloning.pdf">these slides</a> explain the problem well. We have more info about the training <a href="https://blog.comma.ai/end-to-end-lateral-planning/">in this blog post</a>.</p>

<hr />
<p><br /></p>

<p>It’s possible to learn all three functions jointly using full RL, both VPN and MuZero do. But this assumes you have access to both a simulator and a reward function. In the real world, you don’t have either.</p>

<p>While we use a simulator, we aren’t actually doing RL with a reward function. Even in the simulator the ground truth is the human path, it just doesn’t always start at the center of the car.</p>

<p>While MuZero is making less calls to the simulator than <a href="https://arxiv.org/pdf/1712.01815.pdf">AlphaZero (2017)</a>, it still has to act and get on-policy feedback sometimes. At comma, we are going to deal with this by doing <em>reinforcement learning on the world</em>, but with the temperature parameter at 0. Nobody would be happy if their car “explored”, it should only “exploit”. A 0 temperature parameter is okay for learning, but only if your network is close to converged, hence why we’ll be keeping around the current training approach for pretraining.</p>

<p>Now, you say, but you do have a simulator! You talked about it, why can’t you just use MuZero and call it a day. There’s two issues:</p>

<p>One, the simulator is incomplete. The hardest part of any simulator is the behavior of the other agents, and in ours they are fixed to the behavior of what the cars actually did on the route we are simulating. While at least they were driven with a human policy (god help those who think they can learn to drive in some Unreal Engine environment with a hacked together game like car AI), their policy rollout can’t change in response to your actions. Aka it can’t handle counterfactuals.</p>

<p>Two, even if we had a perfect simulator, we don’t have a reward function. In the real world, the user taking over control can be viewed as negative reward. But in the simulator we don’t have that. While it may be possible to learn a reward function on data from when users are likely to disengage, that function would have to be updated frequently as the machine policy changes.</p>

<hr />
<p><br /></p>

<p>We are very fortunate in driving that:</p>
<ul>
  <li>the output space is low dimensional, so simple loss functions work pretty well</li>
  <li>it’s easy to gather huge datasets of expert policy from humans</li>
  <li>there’s a clear reward signal in L2 driving of human disengagements</li>
  <li>the car is already quite digitized, once you know the actions you can do them</li>
</ul>

<p>I still believe driving is the best applied AI problem today. It’s simpler than cleaning a house, but if you solve it in the right way a lot of the parts will be reusable. If you can’t solve driving, you certainly can’t solve cleaning. And if you can’t solve cleaning, you certainly can’t solve life.</p>

<hr />
<p><br /></p>

<p>If you are interested in working on these problems, <a href="https://comma.ai/jobs">come work at comma</a>.</p>

<p>And we aren’t stopping at self driving. Let’s at least get to human.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/10/29/an-architecture-for-life.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Anthropic is making a huge mistake | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Anthropic is making a huge mistake" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="For context, Anthropic again blocked opencode from the Claude Code API." />
<meta property="og:description" content="For context, Anthropic again blocked opencode from the Claude Code API." />
<link rel="canonical" href="anthropic-huge-mistake.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/15/anthropic-huge-mistake.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-15T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Anthropic is making a huge mistake" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-15T00:00:00+08:00","datePublished":"2026-01-15T00:00:00+08:00","description":"For context, Anthropic again blocked opencode from the Claude Code API.","headline":"Anthropic is making a huge mistake","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/15/anthropic-huge-mistake.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/15/anthropic-huge-mistake.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Anthropic is making a huge mistake</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-15T00:00:00+08:00" itemprop="datePublished">Jan 15, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>For context, Anthropic <a href="https://github.com/anomalyco/opencode-anthropic-auth/issues/17">again</a> blocked <a href="https://github.com/anomalyco/opencode">opencode</a> from the Claude Code API.</p>

<p><img src="../../../../../assets/images/claude_code_mistake.png" /></p>

<p>I wasn’t planning to try other models today, but now that’s all I’m going to be doing. I’m sure they have a massive influx of users on Claude Code since Opus 4.5, I’ve been recommending it to everyone. But this level of user hostility raises the question, is this really a company you want to rely on in your workflow?</p>

<blockquote>
  <p>First they came for opencode<br />
And I did not speak out<br />
Because I did not use opencode</p>
</blockquote>

<p>The first volley of this was an easy workaround, so whatever. But you can make this really hard, enforce a fixed system prompt, etc…</p>

<p>You will not convert people back to Claude Code, you will convert people to other model providers. These actions make it clear that opencode is only the start. If you aren’t using Claude Code how they want you to, they will cut you off.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/15/anthropic-huge-mistake.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>anticloud hopecore | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="anticloud hopecore" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Here’s a simple test to see if you are who I described in the last blog post. If the money and users went away, would you leave technology? If you were building this stuff for free for you and your 5 friends, would you keep at it?" />
<meta property="og:description" content="Here’s a simple test to see if you are who I described in the last blog post. If the money and users went away, would you leave technology? If you were building this stuff for free for you and your 5 friends, would you keep at it?" />
<link rel="canonical" href="anticloud-hopecore.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/10/17/anticloud-hopecore.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-10-17T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="anticloud hopecore" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-10-17T00:00:00+08:00","datePublished":"2025-10-17T00:00:00+08:00","description":"Here’s a simple test to see if you are who I described in the last blog post. If the money and users went away, would you leave technology? If you were building this stuff for free for you and your 5 friends, would you keep at it?","headline":"anticloud hopecore","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/10/17/anticloud-hopecore.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/10/17/anticloud-hopecore.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">anticloud hopecore</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-10-17T00:00:00+08:00" itemprop="datePublished">Oct 17, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Here’s a simple test to see if you are who I described in the last blog post. If the money and users went away, would you leave technology? If you were building this stuff for free for you and your 5 friends, would you keep at it?</p>

<p>Math has this quality inherently. Perelman proved the Poincaré conjecture for him and his boys; no businessfuckers showed up and put ads in the proof, no politicsfuckers showed up and demanded the proof remind you that masks prevent the spread of covid. I wish this was true about tech.</p>

<p>At comma, our goal is to build one perfect box that drives a car better than a human. If we were the only one with that box, that would accomplish the goal of the company. Not making money or having users. Those things are fine, but the real goal is the building of the one magical box.</p>

<hr />
<p><br /></p>

<p>We need the cloud to go away. The cloud is a highway to serfdom. And this won’t happen with changes to politics or culture, technology itself is upstream of both of them.</p>

<p>Apps like Gmail can host 10,000 users on a single box, so there was never hope that everyone would run their own mail server. The economy of scale is too good. You’d be swimming <a href="https://urbit.org/">super upstream</a> to get Web 2.0 off of the cloud. Call it cloud-favoring.</p>

<p>There’s some good news in the form of the GPTs. ChatGPT can only host ~10 users on a box, though while ChatGPT has high requirements for compute, it has very low requirements for bandwidth. You could interact with it over a 56k modem. That tips the scales such that chatbots will remain in the cloud, even if we move to a model architechture that doesn’t benefit from batching. The providers want you in the cloud. Call it cloud-neutral.</p>

<p>However, robotics is different! Both openpilot and Tesla FSD don’t use the cloud and likely never will. The bandwidth and latency requirements are too high, and as with cars the same thing will be true for all shapes and sizes of robots. Gaming has always struggled to be in the cloud for similar reasons, note that when you buy a Switch or PS5 the compute actually is local. Call these cloud-averse.</p>

<hr />
<p><br /></p>

<p>Robotics is inherently cloud-averse. The companies will all try to shoehorn cloud into it, but like forcing you to create a cloud account for your microwave, people will see it as stupid and favor the products that actually just run locally.</p>

<p>As long as there’s decent open source alternatives, the robotics ecosystem will have checks and balances against enshittifcation. As the quality of macOS degrades and Windows forces more and more cloud account crap on you, is the era of the Linux Desktop <a href="https://omarchy.org/">finally here</a>? I suspect the breakdown of robotics operating systems will look similar to computer and phone operating systems.</p>

<p>I also really like the way <a href="https://github.com/karpathy/nanochat">nanochat</a> is thinking about the foundation model problem. I predict that robotics software will move towards on device learning, but there will still be a foundation model in the repo, and these things will be expensive to make. However, that cost can simply be a commodity – the way nanochat talks about a $100 ChatGPT.</p>

<hr />
<p><br /></p>

<p>More and more of the training code will make its way into openpilot as the robots learn online. There will still be a pretrained world model, but that will be a commodity. A fully reproducible build in 5000 <a href="https://github.com/tinygrad/tinygrad/blob/master/tinygrad/uop/ops.py">UOps in tinygrad</a> + some commodity data.</p>

<p>The way the waves of robotics will break looks bright for <a href="https://geohot.github.io/blog/jekyll/update/2021/07/11/individual-sovereignty.html">individual sovereignty</a>, and robotics will be where the real value in AI comes from. Many “knowledge work” problems are adversarial; not true for physical things like farming.</p>

<p>I’ll end with the quote from <a href="https://ecromata.com/">ecromata</a>:</p>
<blockquote>
  <p>we will abolish scarcity; there will be nothing for them to steal they can’t have for free</p>
</blockquote>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/10/17/anticloud-hopecore.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A One Way Bridge | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A One Way Bridge" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Okay I went to Devcon. And while there I had a great idea that the crypto space really needs. It seems like while AI infrastructure has improved by leaps and bounds in the last 5 years, crypto infra has actually gotten worse. I’m proposing some great new infrastructure that the crypto space deserves." />
<meta property="og:description" content="Okay I went to Devcon. And while there I had a great idea that the crypto space really needs. It seems like while AI infrastructure has improved by leaps and bounds in the last 5 years, crypto infra has actually gotten worse. I’m proposing some great new infrastructure that the crypto space deserves." />
<link rel="canonical" href="a-one-way-bridge.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/17/a-one-way-bridge.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-17T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A One Way Bridge" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-17T00:00:00+08:00","datePublished":"2024-11-17T00:00:00+08:00","description":"Okay I went to Devcon. And while there I had a great idea that the crypto space really needs. It seems like while AI infrastructure has improved by leaps and bounds in the last 5 years, crypto infra has actually gotten worse. I’m proposing some great new infrastructure that the crypto space deserves.","headline":"A One Way Bridge","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/17/a-one-way-bridge.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/17/a-one-way-bridge.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A One Way Bridge</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-17T00:00:00+08:00" itemprop="datePublished">Nov 17, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Okay I went to Devcon. And while there I had a great idea that the crypto space really needs. It seems like while AI infrastructure has improved by leaps and bounds in the last 5 years, crypto infra has actually gotten worse. I’m proposing some great new infrastructure that the crypto space deserves.</p>

<hr />
<p><br /></p>

<p>We still don’t have a good decentralized bridge between Bitcoin and Ethereum, and with the rising price of Bitcoin this is more important than ever. I have <a href="https://github.com/cheapETH/bridge">some experience building bridges</a>, so I’m proposing one. However, unlike most bridges, this is a one way bridge. It works like this:</p>

<ol>
  <li>Send Bitcoin to 3bridgebridgebridgebridgebridge</li>
  <li>Wait for several block confirmations</li>
  <li>Prove inclusion of your send in the Bitcoin chain to the bridge</li>
  <li>Receive BBTC (Bridged BTC) tokens on Ethereum of the amount sent</li>
</ol>

<p>I’ll note, nobody has the private key to 3bridgebridgebridgebridgebridge, so there is no way to recover your original Bitcoin. That’s okay, they have been safely bridged to Ethereum and you have received your BBTC token.</p>

<p>If you’d just like to buy exposure to Bitcoin on Ethereum without using the bridge, you can buy the BBTC token on any DEX.</p>

<hr />
<p><br /></p>

<p>Is it really that simple? Answer: yes, but only if people believe it is.</p>

<p>You can’t really believe the BBTC token is worth 0, can you?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/17/a-one-way-bridge.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Person of Compute | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Person of Compute" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="We will define one person of compute as 20 PFLOPS (64 A100s, or a single dense 42U A100 rack). We are in the era of the 1 rack person, consuming about 30kW to provide those 20 PFLOPS." />
<meta property="og:description" content="We will define one person of compute as 20 PFLOPS (64 A100s, or a single dense 42U A100 rack). We are in the era of the 1 rack person, consuming about 30kW to provide those 20 PFLOPS." />
<link rel="canonical" href="a-person-of-compute.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/04/26/a-person-of-compute.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-04-26T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Person of Compute" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-04-26T00:00:00+08:00","datePublished":"2023-04-26T00:00:00+08:00","description":"We will define one person of compute as 20 PFLOPS (64 A100s, or a single dense 42U A100 rack). We are in the era of the 1 rack person, consuming about 30kW to provide those 20 PFLOPS.","headline":"A Person of Compute","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/04/26/a-person-of-compute.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/04/26/a-person-of-compute.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Person of Compute</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-04-26T00:00:00+08:00" itemprop="datePublished">Apr 26, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>We will define one <b>person</b> of compute as 20 PFLOPS (64 A100s, or a single dense 42U A100 rack). We are in the era of the 1 rack person, consuming about 30kW to provide those 20 PFLOPS.</p>

<p><img src="../../../../../assets/images/rack.jpg" /></p>

<hr />
<p><br /></p>

<p><a href="https://arxiv.org/pdf/2302.13971.pdf">LLaMA</a> was trained on a cluster of 2048 A100s, with ~312 TFLOPS each. 2048 is currently the most A100s that can work together on a model due to the switch topology.</p>

<p>The cluster has 639 PFLOPS, or 32 people of compute. Large LLaMA used ~1M GPU hours to train. Meaning it used the cluster for 500 hours (3 weeks). 32 people for 3 weeks is about 2 person-years of work. GPT-4 was about 100 person-years</p>

<p>As long as these things are around human scale (for the next 10 years), I think these units make sense.</p>

<hr />
<p><br /></p>

<p>One way to think about scaling computers is how many Moore’s laws it gets you over a desktop. A desktop today is ~50 TFLOPS, something like a mouse of compute, one 400th of a person, or nine more Moores. (2038 remains my lifelong estimate for what most people consider the Singularity. I like that it’s the Unix timestamp rollover)</p>

<p>Some NVIDIA numbers:</p>

<ul>
  <li>1080 (2016) = 11.3 TFLOPS</li>
  <li>2080 (2018) = 14.2 TFLOPS</li>
  <li>3090 (2020) = 35.6 TFLOPS</li>
  <li>4090 (2022) = 82.6 TFLOPS</li>
</ul>

<p>The 4090 cheated a bit by using tons of power, but overall we’re on track for a doubling every two years.</p>

<p>Today, you can buy two years by doubling your budget. Facebook is log2(2048) = 11 Moores, or ~16 years ahead (you can afford an 8 GPU box, right?).</p>

<hr />
<p><br /></p>

<p>Google is <a href="https://www.nextplatform.com/2022/05/11/google-stands-up-exascale-tpuv4-pods-on-the-cloud/">claiming</a> they have a 9 exaflop (<a href="https://en.wikipedia.org/wiki/Cawker_City,_Kansas">450 person</a>) computer. They bought 8 more years, that’s a computer from 24 years in the future.</p>

<p>On a tight budget, a person of compute costs about $250k today. That’s a $115M computer. The most expensive thing humanity has built is the ISS at $100B. If we built a computer at that scale, it would be 400,000 people.</p>

<p>That’s one <a href="https://en.wikipedia.org/wiki/Tampa,_Florida">Tampa</a> of compute, which is the most we could hope to build today. A single Tampa.</p>

<p>One <em>Humanity</em> is 20,000 Tampas.</p>

<ul>
  <li>In 24 years, we can build a Humanity for the cost of the ISS.</li>
  <li>In 44 years, future Google will have a Humanity.</li>
  <li>In 54 years, a normal sized cluster will be a Humanity.</li>
  <li>And in 66 years, you’ll have a Humanity under your desk.</li>
</ul>

<p>Ugh this needs to happen sooner.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/04/26/a-person-of-compute.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Place for Me | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Place for Me" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Have all the jobs been fake for years? Read this, a NASA critique from 1992." />
<meta property="og:description" content="Have all the jobs been fake for years? Read this, a NASA critique from 1992." />
<link rel="canonical" href="a-place-for-me.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/20/a-place-for-me.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-20T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Place for Me" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-20T00:00:00+08:00","datePublished":"2024-11-20T00:00:00+08:00","description":"Have all the jobs been fake for years? Read this, a NASA critique from 1992.","headline":"A Place for Me","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/20/a-place-for-me.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/20/a-place-for-me.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Place for Me</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-20T00:00:00+08:00" itemprop="datePublished">Nov 20, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Have all the jobs been fake for years? <a href="https://www.researchgate.net/publication/234554226_On_Self-Licking_Ice_Cream_Cones">Read this</a>, a NASA critique from 1992.</p>

<p>Basically society is run by useless people making work for other useless people so that together they can all alleviate their deep concern about not having a place in society.</p>

<hr />
<p><br /></p>

<p>Elon has a bigger tent of types of people that can help on his mission than I do, and even that tent is too small to include most people. I think that’s the deep reason for the Elon haters, it’s that they don’t see their place in his society.</p>

<p>I lashed out at a fan in Bangkok, when he told me his friend was a fan of mine, I replied with “why do I care?” I was already in a bad mood, normally I’d be nicer and if you read this sorry it was directed at you, but I do sort of stand by the point. Low commitment from lots of people is useless. I’m not going to milk you for merch sales.</p>

<p>By the way, if you ever see me in public, I don’t care that you are a fan, I don’t understand why people think I would. If you want to talk, why would you open with that? Tell me something technical that I don’t know. Then we are having a conversation.</p>

<hr />
<p><br /></p>

<p>We are in the middle of a revolution. Modern AI is the cherry on top, it’s just continuing the same trendline that had spreadsheets replace 4 bookkeepers with 1.</p>

<p>The industrial revolution required labor at mass scale, hence we got liberal democracy. But I think it’s over. If we don’t have a society where there’s a place for most people, governance will have to change.</p>

<p>Though don’t worry if you consider yourself one of those useless people, I do not think your life will become materially bad. Between the fact that it’s cheap to keep people alive, fed, and entertained, and that everyone no matter how secure believes they may be useless, it will be a lot more like retirement.</p>

<p>UBI is a <a href="https://www.piratewires.com/p/wireheading-city-george-hotz?f=home">double edged sword</a>. If you take it, you are no longer meaningfully a citizen.</p>

<hr />
<p><br /></p>

<p>It remains to be seen how this will all shape up, but the unprofitablity of the average person in rich countries cannot be ignored for too much longer. Their expectations exceed their market value, hence why protectionist economics to bring manufacturing back to America will not work.</p>

<p>Every society has its problems, but as I’ve been spending more time in China I think they are living in the future. Your average American has no idea how nice the cities are here. Walkable. I can’t get over how quiet the roads are, Chinese brand electric cars with big touch screens. High trust society.</p>

<p>I also learned that the ubiquitous mobile payments are not due to heavy handed government policy, but rather free market choice. And after you have used Alipay for a bit it really is convenient. Unlike credit cards, you can send money phone to phone by scanning a barcode, and I don’t think there’s a 3% fee sapping the economy.</p>

<p>Of course, a strong government is a devil’s bargain. When things are good they are really good, but when things go bad they can go really bad. However, things are good now, and it’s anyone’s guess how it plays out. If Yudkowskian AI safety is a real concern, you might need a strong government to have any hope.</p>

<hr />
<p><br /></p>

<p>Here’s a simple chart that shows where life will improve.</p>

<p><img src="../../../../../assets/images/ai_trust.png" alt="image" /></p>

<p>These blog posts have become a bit of a travel diary. But these questions are way too big to ignore, and I think about them a lot. The optimism after the election was short lived, we are going to get bullshit protectionism and obstructionism.</p>

<p>Are we ready to strike a new deal restructuring Western society? I suspect not. The neoluddites still think they have a chance. But structurally they can’t ever succeed, they can just choose if they want to bring the West down with them or not.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/20/a-place-for-me.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Really Big Computer | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Really Big Computer" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="GPT-4 was trained on 25k A100s in about 90 days. That’s 3e25 FLOPs." />
<meta property="og:description" content="GPT-4 was trained on 25k A100s in about 90 days. That’s 3e25 FLOPs." />
<link rel="canonical" href="a-really-big-computer.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/08/08/a-really-big-computer.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-08-08T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Really Big Computer" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-08-08T00:00:00+08:00","datePublished":"2023-08-08T00:00:00+08:00","description":"GPT-4 was trained on 25k A100s in about 90 days. That’s 3e25 FLOPs.","headline":"A Really Big Computer","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/08/08/a-really-big-computer.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/08/08/a-really-big-computer.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Really Big Computer</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-08-08T00:00:00+08:00" itemprop="datePublished">Aug 8, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>GPT-4 <a href="https://www.reddit.com/r/OpenAI/comments/11sbw40/estimate_of_amount_of_compute_used_to_train_gpt4/">was trained</a> on 25k A100s in about 90 days. That’s 3e25 FLOPs.</p>

<p>If a person has 20 PFLOPS (20e15) of compute, GPT-4 used 47.5 person-years to train. Very human scale.</p>

<hr />
<p><br /></p>

<p>I want to build a computer capable of training GPT-4 in a day. I need 3e25/86400 = 347,000,000 TFLOPS, or 2.25M GPUs. At 300W each, I’m gonna need 675 MW of power.</p>

<p>$2.25B CapEx for 2.25M $1000 GPUs.</p>

<p>At $0.05/kWh, it’s $34k/hr to operate.</p>

<p>But seriously with continuing computer progress this probably doesn’t make sense at this ~$5B scale. Why are we buying the GPUs? Why are we buying the power?</p>

<hr />
<p><br /></p>

<p>It costs <a href="https://www.tomshardware.com/news/tsmc-will-charge-20000-per-3nm-wafer">$20,000</a> for a 3nm wafer from TSMC. <a href="https://www.cerebras.net/blog/wafer-scale-processors-the-time-has-come/">Wafer scale compute</a> probably makes sense. I get 89 600mm^2 dies, so let’s say I can get 100 PFLOPS from a 3nm wafer. Cerebras doesn’t tell you their FLOPS, but it’s 62.5 PFLOPS on a 7nm wafer, which makes me think I could get over 100 on 3nm. But 100 conservatively. Also, my wafers will be circles, not lame squares.</p>

<p>It’s $7 for a TFLOP on AMD. It’s $0.20 for a TFLOP on my wafers. We are in the much more reasonable land of $69M for my computer, buying 3450 wafers.</p>

<p>For power, I’m not getting scammed by the stupid grid. Solar panels <a href="https://www.alibaba.com/countrysearch/CN/price-per-watt-solar-panels.html">are $0.20/watt now</a> (thanks China!). My 675 MW plant will cost $135M, and it will have a much longer shelf life (15 years) than the computer (3 years). I’ll note that if we get 50% out of these panels, my plant pays for itself in a year.</p>

<p>Rough budget:</p>
<ul>
  <li>$50M in chip design NRE</li>
  <li>$69M from TSMC for the 3450 wafers</li>
  <li>$31M to finish out the wafer computers</li>
  <li>$135M solar panels</li>
  <li>$50M to buy the land</li>
  <li>$50M in construction costs</li>
</ul>

<p>The tiny corp’s next raise will be $400M at a $2B valuation. No joke. Still several years away though. We will of course sell the wafer computers too for the price of a DGX box with 10x the compute. That’s how we’ll make money.</p>

<hr />
<p><br /></p>

<p>The real question is where should we build this? Must have good sunlight, be cool enough we can use free cooling, not have crazy expensive grid power, be friendly to building, and respect property rights.</p>

<p>Welcome to the new <a href="https://en.wikipedia.org/wiki/Los_Alamos_National_Laboratory">Los Alamos</a>. To the <a href="https://en.wikipedia.org/wiki/Zettascale_computing">zettaflop</a> and beyond!</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/08/08/a-really-big-computer.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Are we the baddies? | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Are we the baddies?" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I signed up for Hinge. Holy shit with the boosts." />
<meta property="og:description" content="I signed up for Hinge. Holy shit with the boosts." />
<link rel="canonical" href="are-we-the-baddies.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/07/05/are-we-the-baddies.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-07-05T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Are we the baddies?" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-07-05T00:00:00+08:00","datePublished":"2025-07-05T00:00:00+08:00","description":"I signed up for Hinge. Holy shit with the boosts.","headline":"Are we the baddies?","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/07/05/are-we-the-baddies.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/07/05/are-we-the-baddies.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Are we the baddies?</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-07-05T00:00:00+08:00" itemprop="datePublished">Jul 5, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I signed up for Hinge. Holy shit with the boosts.</p>

<p>How does someone who works on this wake up every morning and feel okay about themselves?</p>

<p>Similarly with the tip screens, Uber algorithm, all the zero sum bullshit using all the tricks of psychology to extract a little bit more from every interaction in society. Nudge. Nudge. NUDGE.</p>

<p>Want to partake in normal society like buying a coffee, going on a date, getting a ride, paying a friend. Oh, there’s a middle man now. An evil ominous middleman using state of the art AI algorithms to extract just a little bit more from you.</p>

<hr />
<p><br /></p>

<p>But eventually the market will fix this, right? People will feel sick of being manipulated and move elsewhere?</p>

<p>Ahhh, but they see that coming long before you do. They have dashboards. Quick Jeeves, tune the AI to make people <em>feel</em> less manipulated. Give them a little bit more for now, we have to think about maximizing <em>lifetime customer value</em> here.</p>

<p>Oh the AI already did this on its own? Jeeves you’ve been replaced! People perpetually on the edge.</p>

<hr />
<p><br /></p>

<p>You want to opt out of this all you say? Good luck running a competitive business! Every metric is now a target. You better maximize engagement or you will <em>lose</em> engagement this is a <a href="https://en.wikipedia.org/wiki/Red_Queen%27s_race">red queen’s race</a> we can’t afford to lose! Burn all the social capital, burn all your values, FEED IT ALL TO MOLOCH!</p>

<hr />
<p><br /></p>

<p>Someday, people will have to realize we live in a society. What will it take? A complete self cannibalization to the point you can’t eat your own mouth? It sure as hell isn’t going to be people opting out, that’s a collective action problem you can’t solve.</p>

<p>Democracy, haha, you think the algorithms will let you vote to kill them? Your vote is as decoupled from action as the amount Uber pays the driver is decoupled from the fare that you pay. There’s no reform here, there’s only revolution.</p>

<p>Will it simply be a huge financial collapse? Or do we need World War 3? And even World War 3 is on a spectrum. Will mass starvation fix this? Or will the attitude of thinking it’s okay to manipulate others at scale persist even past <em>that</em>? He’s got his, and I’ve got mine…</p>

<p>If you open a government S&amp;P 500 account for everyone with $1,000 at birth that’ll pay their social security cause it like…goes up…wait who’s creating this value?</p>

<hr />
<p><br /></p>

<p>It’s not okay. Advertising is not okay. Price discrimination is not okay. Using big data, machine learning, and psychology to manipulate others at scale is not okay.</p>

<p>But you aren’t going to learn this lesson until you have fed a huge majority of your <em>customers</em> to Moloch. Modern capitialism is wireheading. Release the hypnodrones. How many cans of Pepsi did you want them to consume an hour again?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/07/05/are-we-the-baddies.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Silicon Person | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Silicon Person" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="First, let’s break a person down into inputs, compute, and outputs." />
<meta property="og:description" content="First, let’s break a person down into inputs, compute, and outputs." />
<link rel="canonical" href="a-silicon-person.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2020/08/20/a-silicon-person.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2020-08-20T23:49:44+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Silicon Person" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2020-08-20T23:49:44+08:00","datePublished":"2020-08-20T23:49:44+08:00","description":"First, let’s break a person down into inputs, compute, and outputs.","headline":"A Silicon Person","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2020/08/20/a-silicon-person.html"},"url":"https://geohot.github.io//blog/jekyll/update/2020/08/20/a-silicon-person.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Silicon Person</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2020-08-20T23:49:44+08:00" itemprop="datePublished">Aug 20, 2020
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>First, let’s break a person down into inputs, compute, and outputs.</p>

<p>Inputs:</p>
<ul>
  <li>2 decent 126MP cameras. “The human retina contains about 120 million rod cells, and 6 million cone cells” [1]</li>
  <li>One of those fancy two ear ASMR mics.</li>
  <li>Other sensors we don’t care about.</li>
</ul>

<p>Outputs:</p>
<ul>
  <li>A keyboard and mouse</li>
  <li>Other outputs we don’t care about.</li>
</ul>

<p>Both inputs and outputs are cheap and simple with today’s tech, so we won’t talk about them further. It’s really all about the compute</p>

<hr />
<p><br /></p>

<p>There’s a lot of talk of the brain being complex. And while it’s true that it has complex behaviors, the computational substrate is quite easy to understand. A neuron is an accumulator, and a synapse is a multiplier. Multiply-accumulate. Sound familiar?</p>

<p>Each synapse is both a FLOP and a weight. In ANN’s, this isn’t always true with weight sharing, but since the compute is the memory in the brain, there’s no advantage for explicit weight sharing, and other weight syncing procedures are fine.</p>

<p>There’s varying estimates for the number of neurons and synapses in the brain, [2] claims 86 billion and 150 trillion. Other sites claim other things. [3] claims a child has 1000 trillion neurons, and the fanout is 7000. Of note, the 1000-10000x ratios of neurons to synapses give us an idea of the size of the weight matrices.</p>

<p>We’ll use the estimates of 100 billion neurons and 100 trillion synapses for this post. That’s 100 teraweights. GPT-3 has 175 gigaweights, so this brain is ~1000x bigger.</p>

<p>The max firing rate seems to be 200hz [4]. I really want an estimate of “neuron lag” here, but let’s upper bound it at 5ms. If reaction time is 200ms and “recognizing and responding to a visual stimulus” [5] takes 500ms, the processing is going through 20-100 serial layers.</p>

<p>Multiplying, this yields 20 PFLOPS of compute, and 200 TB of float16 weights.</p>

<p>nVidia’s new A100 claims 312 TFLOPS of compute, but unless you are weight sharing, you’ll run into the RAM bandwidth limit of 1.6 TB/s long before that. With float16, let’s round that to 1 TFLOP per GPU.</p>

<p>Remember also, that the brain is always learning, so it needs to be doing forward and backward passes. I’m not exactly sure why they are different, but [6] and [7] point to the backward pass taking 2x more compute than the forward pass.</p>

<p>We are up to 60 PFLOPS on <b>40,000 GPUs</b> (need to read and write the weight only). Since deep learning is usually done in minibatches, the GPU comes with 40 GB of RAM each, giving a total of 1.6 PB of RAM, a 8x overprovision.</p>

<p>With RAM bandwidth being the limiting factor, we get:</p>
<ul>
  <li>1x the RAM bandwidth</li>
  <li>8x the storage (minibatch size)</li>
  <li>312x the compute (weight sharing ratio)</li>
</ul>

<p>nVidia is selling the GPUs for $12,500 each [8], so if you ordered from them, it would be $500 million. Though when you look at the chip cost, 54 billion transistors on 7 nm should only cost about $150. I just approved the purchase of 32GB RAM sticks[10] at $102 per, so RAM is about $3 per GB, meaning $120 for the card. $30 for the rest + $200 overhead for the machine they go in. $500 each x 40,000 is $20 million dollars.</p>

<p>Assuming they draw 400W each, that’s 16 MW of power. At $0.10 per kWh, it’s $1600 an hour to run.</p>

<p><b>$20 million + $1600 an hour</b></p>

<hr />
<p><br />
Citations</p>

<ol>
  <li>https://en.wikipedia.org/wiki/Photoreceptor_cell</li>
  <li>https://en.wikipedia.org/wiki/List_of_animals_by_number_of_neurons</li>
  <li>https://en.wikipedia.org/wiki/Neuron#Connectivity</li>
  <li>https://aiimpacts.org/rate-of-neuron-firing/</li>
  <li>https://www.science.smith.edu/departments/neurosci/courses/bio330/pdf/94CurrBiolTovee.pdf</li>
  <li>https://github.com/jcjohnson/cnn-benchmarks</li>
  <li>https://openai.com/blog/ai-and-compute/</li>
  <li>https://www.pcgamer.com/nvidia-ampere-a100-price/</li>
  <li>https://wccftech.com/apple-5nm-3nm-cost-transistors/</li>
  <li>https://www.amazon.com/SK-2400MHz-Server-Memory-HMA84GR7AFR4N-UH/dp/B0762WP67R</li>
</ol>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2020/08/20/a-silicon-person.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Avatar 2 was Bad | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Avatar 2 was Bad" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Spoliers below the line, and this probably won’t make sense if you didn’t see the movie." />
<meta property="og:description" content="Spoliers below the line, and this probably won’t make sense if you didn’t see the movie." />
<link rel="canonical" href="avatar-2-was-bad.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/12/27/avatar-2-was-bad.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-12-27T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Avatar 2 was Bad" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-12-27T00:00:00+08:00","datePublished":"2022-12-27T00:00:00+08:00","description":"Spoliers below the line, and this probably won’t make sense if you didn’t see the movie.","headline":"Avatar 2 was Bad","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/12/27/avatar-2-was-bad.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/12/27/avatar-2-was-bad.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Avatar 2 was Bad</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-12-27T00:00:00+08:00" itemprop="datePublished">Dec 27, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Spoliers below the line, and this probably won’t make sense if you didn’t see the movie.</p>

<p>I don’t understand how the budget can be so high for movies like this, and the plot and characters be so terrible. Feels like ChatGPT wrote it. The movie is beautiful and the world building is epic, which is why the story upsets me. For reference, I loved Avatar 1, and thought there was so much potential here.</p>

<p>So get in losers, we are going to fix Avatar 2: Titanic Edition.</p>

<p>Kept most of the plot devices, the 3.25 hour length, and a good subset of the characters, but wrote a story that would make people feel something, and included an epic battle scene I’d love to see on screen at the end of Act 2.</p>

<hr />
<p><br /></p>

<p>The humans are back, same setup as the movie. We diverge 10 minutes in.</p>

<p>Act 1:</p>

<p>Open with the same guerilla “attack on train” scene, except Jake Sully is killed in action. You have to kill him, there’s no way to top his first story arc. This is fundamentally a movie about the relationship between two brothers. The same two brothers in the movie; the useless little kid and fish nature girl can go.</p>

<p>A favored “warrior” older brother, and a “pushover” younger brother. The older brother, proud son of a marine, wants to continue everything in his fathers image. He becomes leader of the Omatikaya, and is furious about his father’s death and vows revenge. Continue guerilla warfare attacks on the humans, continue the Na’vi way of life, continue as if nothing changed.</p>

<p>The younger brother is also crushed by his father’s death, but instead of blaming the humans, he blames the framing of the conflict. The Na’vi were the aggressors, they attacked the train, the humans just defended themselves.</p>

<p>There’s some ritual to become a Na’vi warrior man, the older brother went through it years ago, but the younger brother refuses. He denounces the warrior way of life, denounces the Omatikaya, and denounces his father for leading the train attack that got him killed. He is exiled from the forest tribe, and goes on a Simba style adventure.</p>

<p>Act 2:</p>

<p>The younger brother wanders off deep into the forest and ends up at the water tribe people. The water tribe people learned from the whales to be pacifists. Cue same scenes about learning the ways of the water people, meeting the exiled whale (get it, they are both exiles, but one for wanting to fight back and one for not wanting to fight enough)</p>

<p>Same pretty princess water girl but put a bit of damn effort into this romance. Make me care. The girl and brother bond over the loss of one of their parents, she only has her father left. Then in the height of the romance scene, she explains that the humans are killing the whales, and that her father will do nothing about it, since the water tribe people are pacifists. The younger brother is very troubled by this, as he’d come to view the Omatikaya as the aggressors, and most humans he was exposed to were the nice science humans.</p>

<p>Back in forest land, the older brother is planning a large strike on the human city center, a cluster of high rise apartment buildings, in revenge for the attack on Hometree in Avatar 1. Neytiri tries to talk him out of it, saying it’s not what his father would have wanted, but he reminds her that he is the leader and persists. Cue intense realistic action scene of a Na’vi attack on a hypermodern city center, humans screaming and crying. Thousands of deaths. At this point, the audience realizes the older brother has lost the plot.</p>

<p>Act 3:</p>

<p>The attacks on the whales pick up, because the humans need lots of magic whale juice to save the lives of the humans injured in the high rise attack. The princess confronts her father about maybe reconsidering their old pacifist ways, at first he blames the influence of the outsider, but she stands up for this as her idea. They have to fight back, but in a way that they can be okay with. They build nets and other non lethal weapons. The younger brother learns of his older brothers attack and is angry. This is not “the way of water”</p>

<p>Cue the climactic battle scene. Humans are sending out a massive navy to hunt the whales at scale. Older brother is planning to take it out. Boats headed toward the water people, the forest people approaching from the back, the water people approaching from the front. One massive boat in the human navy, don’t worry James Cameron you can still have your Titanic 2 scene.</p>

<p>The water people, led by princess girl and her reformed father, show dominance in the battlefield (with the help of the whales of course). They work to pacify both the humans and the Omatikaya. The big fight scene is the younger brother vs the older brother while the big navy boat sinks around them. Epic dialog during the fight:</p>

<p>OB: The humans are a cancer on this planet, they must be destroyed. That’s the only way they’ll listen.<br />
YB: <b>OUR FATHER WAS HUMAN!!!</b></p>

<p>The younger brother gains the upper hand, older brother begs to be killed with honor, younger brother refuses. His heart turns, and they work together to capture and jail the remaining humans involved in whaling.</p>

<p>End scene is a recognizably human political council with 9 ft tall blue and green Na’vi sitting next to 5’9” humans, figuring out the aftermath of the attack, the Na’vi explain how smart the whales are and why the whaling is so bad. The final part is thematically the denunciation of absolutes, realizing we are all nuanced beings with many different objectives, and the black and white solutions are never the right ones. Both human and Na’vi have complex and sometimes conflicting desires, but we can all strive for better understanding of each other.</p>

<hr />
<p><br /></p>

<p>A story about two brothers driven apart and brought back together, a story about a romance across tribes, a story about the similarities of all life, and a story about needing to adapt for modern times. Not some weird Avatar 1 repeat with lines that made no sense about “the way of water”</p>

<p>This would have been a good movie, not just a 3 hour ad for Avatar 3, and a needed story for our time.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/12/27/avatar-2-was-bad.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>A Way Forward | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="A Way Forward" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="“For example, if one believes that affirmative action is good for black people, does it make sense to demand affirmative action in hostile or dogmatic terms? Obviously it would be more productive to take a diplomatic and conciliatory approach that would make at least verbal and symbolic concessions to white people who think that affirmative action discriminates against them. But leftist activists do not take such an approach because it would not satisfy their emotional needs.” – Unabomber Manifesto" />
<meta property="og:description" content="“For example, if one believes that affirmative action is good for black people, does it make sense to demand affirmative action in hostile or dogmatic terms? Obviously it would be more productive to take a diplomatic and conciliatory approach that would make at least verbal and symbolic concessions to white people who think that affirmative action discriminates against them. But leftist activists do not take such an approach because it would not satisfy their emotional needs.” – Unabomber Manifesto" />
<link rel="canonical" href="a-way-forward.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/04/22/a-way-forward.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-04-22T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="A Way Forward" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-04-22T00:00:00+08:00","datePublished":"2025-04-22T00:00:00+08:00","description":"“For example, if one believes that affirmative action is good for black people, does it make sense to demand affirmative action in hostile or dogmatic terms? Obviously it would be more productive to take a diplomatic and conciliatory approach that would make at least verbal and symbolic concessions to white people who think that affirmative action discriminates against them. But leftist activists do not take such an approach because it would not satisfy their emotional needs.” – Unabomber Manifesto","headline":"A Way Forward","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/04/22/a-way-forward.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/04/22/a-way-forward.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">A Way Forward</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-04-22T00:00:00+08:00" itemprop="datePublished">Apr 22, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>“For example, if one believes that affirmative action is good for black people, does it make sense to demand affirmative action in hostile or dogmatic terms? Obviously it would be more productive to take a diplomatic and conciliatory approach that would make at least verbal and symbolic concessions to white people who think that affirmative action discriminates against them. But leftist activists do not take such an approach because it would not satisfy their emotional needs.”</p>

  <p>– Unabomber Manifesto</p>
</blockquote>

<p>To date, the Trump administration has been an absolute tragedy. It has been the acting out of emotions. There are no adults in the room. I’m not saying there would have been adults in the room with the Kamala <em>regime</em> either, but I had some hopes for positive change with the Trump tech-bro alliance and now they are gone. At least truths are being laid bare versus heads being buried in the sands of <em>joy</em>, but I think there was a much better way.</p>

<p>For example, I don’t support America funding the war in Ukraine. But the way Zelensky was treated is just <em>dumb</em>. See the Unabomber quote above, between this and the Munich speech, Mr. JD Vance, I hope your emotional needs are being met (at the expense of the good will of our allies).</p>

<hr />
<p><br /></p>
<h3>It's the economy, stupid</h3>

<p>Regardless of anyone’s long-term objectives in the US, be they decoupling from China, bringing manufacturing to the US, bringing lifestyle improvements to US citizens; I think it’s unquestionable that <em>uncertainty</em> about the future was needlessly increased. And unless the uncertainty was the goal, I can’t figure out why things were done the way they were. And if the uncertainty was the goal…uhhh…is our government captured by Russian or Chinese agents? Because that’s <a href="https://en.wikipedia.org/wiki/Cui_bono%3F">who benefits</a>.</p>

<p>I don’t trust the news very much. I have no idea if the guy in the El Salavdor prison had a fair trial, if the students being deported are criminals, or even if they are being deported at all. It’s really hard and time consuming to get to the truth about any of these things.</p>

<p><img src="../../../../../assets/images/snp500_crash.png" /></p>

<p>However, when markets crash. that is obviously real. With the news, there’s usually no way to trade on it being real or fake, there’s nobody to take the other side. But with big public markets, there’s very deep liquidity if you think they are <em>priced wrong</em>.</p>

<p><img src="../../../../../assets/images/dollar_crash.png" /></p>

<p>In addition to the 10% the market is down, the dollar is also down 10%. Considering the market is priced in dollars, it’s closer to 20% down. And even worse on top of all of this, prices are going up due to the tariffs.</p>

<p>Was crashing the economy the goal? A side-effect of a greater plan? Because given how this was executed, a 3-week old LLM could have told you shit was gonna crash.</p>

<p>And it’s <a href="https://www.molsonhart.com/blog/america-underestimates-the-difficulty-of-bringing-manufacturing-back">not going to bring manufacturing back</a>. I have done manufacturing in America for years, and anyone with any experience could have told you that this wouldn’t work, manufacturing requires long term investment and long term investment requires stability.</p>

<p>What was the real goal here?</p>

<hr />
<p><br /></p>
<h3>Elon, you need to reconcile with your daughter</h3>

<p>Andrew Callaghan <a href="https://www.youtube.com/watch?v=gAOi7EhmA_8">did a good piece on Elon’s radicalization</a>. I get it, we have all been there. For me it was Gamergate (which still has a terrible wikipedia page that doesn’t explain what it was). But this doesn’t have to be you forever. You are the closest thing to an adult in any room in America.</p>

<p><img src="../../../../../assets/images/space_launch_2024.jpg" /></p>

<p>When you compare America to China, it’s really more like comparing Elon to China. ULA is a little joke compared to CNSA. And look into what percent of US car exports are Teslas. The man is singlehandedly beating the rest of the US combined. If you want any hope of standing against China, your political coalition better include him.</p>

<p>Elon has been pretty politically quiet lately. I’m sure <a href="https://www.washingtonpost.com/business/2025/04/07/musk-trump-tariffs/">he knew exactly what would happen with the tariffs</a>, but he couldn’t stop them. I got fooled too, thought it could be different this time. But it’s <a href="https://www.theverge.com/2017/6/1/15726292/elon-musk-trump-advisory-council-paris-climate-decision">no different from 2017</a>. (btw, we are finally beating climate change thanks to cheap solar panels from China)</p>

<p>I know the idea of PR is against a lot of what you believe in, but you need to heads down put together a large scale PR campaign, distance yourself from this train wreck, denounce stupid fake right wing conspiracy theories, reconcile with your daughter (from a reader of sci-fi and The Culture, is the trans thing that hard to understand?), resolve your stupid beef with OpenAI (we are all disappointed, but you don’t have a great track record for open source either), and start building a new political party.</p>

<ul>
  <li>Pro large scale skilled legal immigration, not a single illegal border crosser.</li>
  <li>Pro choice (within reason), and also pro gun (within reason).</li>
  <li>Inclusive and diverse, with an unwavering focus on merit.</li>
  <li>Anti crime, with an understanding that victimless crime is not crime.</li>
  <li>Expose higher education and the medical system to the free market (watch how fast prices fall)</li>
  <li>Free market and trade, but not an unregulated market. Markets require regulation to be free.</li>
</ul>

<p>It’s probably the only shot we have against China. The current Republicans and Democrats are just far too stupid; the Chinese are watching this tariff drama and laughing their asses off. Their plans are measured in centuries.</p>

<hr />
<p><br /></p>
<h3>America, do you want to be a protectionist backwater?</h3>

<p>If so, and all the <a href="https://en.wikipedia.org/wiki/Thumos">thymos</a> is gone, then there’s no place for me there. If this is really the way things are going, the only thing for anyone to do is leave.</p>

<p>We’ll see how it shapes up in the next few years. But if the <a href="https://en.wikipedia.org/wiki/Democratic_Party_(United_States)">racists</a> or the <a href="https://en.wikipedia.org/wiki/Republican_Party_(United_States)">other racists</a> are still running the show, we really are just cooked. Enjoy your handouts to black people and your handouts to white people in a poverty stricken shithole.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/04/22/a-way-forward.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Baskets | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Baskets" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<meta property="og:description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<link rel="canonical" href="baskets.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/07/04/baskets.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-07-04T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Baskets" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-07-04T00:00:00+08:00","datePublished":"2021-07-04T00:00:00+08:00","description":"A home for poorly researched ideas that I find myself repeating a lot anyway","headline":"Baskets","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/07/04/baskets.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/07/04/baskets.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Baskets</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-07-04T00:00:00+08:00" itemprop="datePublished">Jul 4, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><img src="../../../../../assets/images/comp_meme.jpg" alt="image" /></p>

<p>Some people make babby. I make computer.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/07/04/baskets.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Beauty after COVID | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Beauty after COVID" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Hopefully we can talk about this now that the world has moved on to the next “happening”" />
<meta property="og:description" content="Hopefully we can talk about this now that the world has moved on to the next “happening”" />
<link rel="canonical" href="beauty-after-covid.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/03/05/beauty-after-covid.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-03-05T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Beauty after COVID" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-03-05T00:00:00+08:00","datePublished":"2022-03-05T00:00:00+08:00","description":"Hopefully we can talk about this now that the world has moved on to the next “happening”","headline":"Beauty after COVID","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/03/05/beauty-after-covid.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/03/05/beauty-after-covid.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Beauty after COVID</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-03-05T00:00:00+08:00" itemprop="datePublished">Mar 5, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Hopefully we can talk about this now that the world has moved on to the next “happening”</p>

<p>There’s one thing from COVID that got under my skin more than anything else. Cloth masks. Despite the weird hate I got in youtube comments for saying it, can we all now admit that cloth masks do nothing to stop the spread of respiratory disease? Especially with the way people used them in practice (be honest, how often did you wash your mask). Not making any other claims, just this one. In 2019, this was common knowledge to everyone in the field. I understand at the beginning in 2020 not everyone was in the field and knew this, but if you didn’t figure it out by 2022…</p>

<p>What does this say about humanity? Dan Carlin talked about how he thought racism was in the past, and that he’s both surprised and sad to see a resurgence (regardless of who you think the racists are, I think most can agree there’s more racism today than in 2010).</p>

<p>I see the same thing here with the “Science” religion. The masks really had nothing to do with COVID, they were like wearing a cross around your neck. Remember that Jesus died for your sins and also remember that we are in the middle of a global pandemic.</p>

<p>Humanity is not past these things. It’s unclear if they ever will be.</p>

<hr />
<p><br /></p>

<p>To the brainwashers. To the controllers of the media. To the great determiners of narrative.</p>

<p><b>What do you think is beautiful?</b></p>

<p>Lex Fridman talks about love a lot, and I think this is his answer. It’s a pretty common one. Maybe it’s even the tautological answer. Beyond the narrow interhuman definition of love, there’s love for nature, love for simplicity, love for truth, and love for winning. Love is beautiful.</p>

<p>But here we are in 2022, and <a href="https://slatestarcodex.com/2014/07/30/meditations-on-moloch/">Moloch</a> is what’s left. When we are all atomized, work from home, entertainment from home, economic units. I like to think I’d resist wireheading, but would I really?</p>

<p>Go read the above linked piece. “If everyone hates the current system, who perpetuates it?”</p>

<hr />
<p><br /></p>

<p>On my final twitch stream, I did a poll. After playing “The Decline” by NOFX on the piano. I asked this question without context.</p>

<p><img src="../../../../../assets/images/problem_poll.png" alt="image" /></p>

<p>It’s so disheartening. I don’t think the “Yes” people are trolls, it’s way more than the 4% Lizardman’s constant. You are why I don’t stream anymore. Maybe once I figure out how to exclude them. It’s literally a self answered question, “Are you the problem?” If there’s anyone you have the moral right to judge…</p>

<p>Sorry I don’t have answers. But when you see smart people turning away from democracy and liberalism, I hope you understand why. The system doesn’t seem to believe in beauty, and so many people have no values outside the system.</p>

<p>If there really is a narrative controller, and you’d like to keep power, you can’t keep doing this.</p>

<hr />
<p><br /></p>

<p>Crypto and decentralization are tools for a low trust society. Is that the best we can hope for?</p>

<p>Have you seen society learn any lessons from COVID? When the cloth masks were accepted as useless, did anyone admit they were wrong?</p>

<p>The media landscape is so toxic. The consequences are fairly obvious. And there won’t be anyone to even say I told you so to. They’ll barely even remember. It’s just on to the next happening. Member the 500,000 people we killed in Iraq? Oh yes but that was for liberation or something.</p>

<p>Sorry for being depressing. But after the last 2 years of bullshit with zero apology or humility, how can anyone continue to have faith in this society?</p>

<p>(at least I’m not in Ukraine right now watching my apartment get hit by a missile because of these fucking people. it could always be worse. my heart goes out to those who have it worse. we have a common enemy)</p>

<hr />
<hr />
<hr />
<hr />
<p><br /></p>

<p>Exit is probably the best we can hope for. I know many people have been saying this, it’s just hard to accept. It’s all cycles, this is how the world breathes.</p>

<p>Now we need the leaders of this new world. A positive vision for the future. Beauty. Love. Culture builders.</p>

<p>I haven’t really met these people. I don’t think I’m strong enough to do it, I lack conscientiousness. We need the strong men that are built by weak societies. In many ways my life was too nice. We don’t need too many, so perhaps it’s okay that I haven’t met them, but I hope to God they are out there.</p>

<p>It’s time for real honest debates about the future of humanity. Personally, I believe in technological liberation. I will spend my life fighting for it. But there might be other answers and my mind is always open. I support diversity. The monoculture sucks.</p>

<p>I do know that this thing that produced the COVID security theater shit is a total dead end.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/03/05/beauty-after-covid.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Bikeshedding, or why I want to build a laptop | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Bikeshedding, or why I want to build a laptop" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I’m sure I’m not the only one who feels Apple’s quality is degrading. I spend 10 hours a day on my laptop and would spend any amount of money within reason for a better one. However, everything comes with tradeoffs." />
<meta property="og:description" content="I’m sure I’m not the only one who feels Apple’s quality is degrading. I spend 10 hours a day on my laptop and would spend any amount of money within reason for a better one. However, everything comes with tradeoffs." />
<link rel="canonical" href="bikeshedding-or-laptop.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/11/29/bikeshedding-or-laptop.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-11-29T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Bikeshedding, or why I want to build a laptop" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-11-29T00:00:00+08:00","datePublished":"2025-11-29T00:00:00+08:00","description":"I’m sure I’m not the only one who feels Apple’s quality is degrading. I spend 10 hours a day on my laptop and would spend any amount of money within reason for a better one. However, everything comes with tradeoffs.","headline":"Bikeshedding, or why I want to build a laptop","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/11/29/bikeshedding-or-laptop.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/11/29/bikeshedding-or-laptop.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Bikeshedding, or why I want to build a laptop</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-11-29T00:00:00+08:00" itemprop="datePublished">Nov 29, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I’m sure I’m not the only one who feels Apple’s quality is degrading. I spend 10 hours a day on my laptop and would spend any amount of money within reason for a better one. However, everything comes with tradeoffs.</p>

<p>My dream laptop is simple, a MacBook with Linux, supported by a company that is user aligned.</p>

<hr />
<p><br /></p>

<p>The first idea is simple, put Linux on a MacBook.</p>

<p>Asahi Linux is a good idea, however, it won’t ever be good. Apple is putting more and more stuff into closed source microcontrollers that have no documentation. Like jailbreaking, it may start off strong when people are excited, but support for the next generation and that last bit of polish won’t ever get there.</p>

<p>While it got some impressive stuff like <a href="https://github.com/chadmed/bankstown">psychoacoustic bass</a> (works on other machines too, I installed this on my ZBook), it <a href="https://www.reddit.com/r/AsahiLinux/comments/1mg015c/external_monitor_not_detected_asahi_arch_linux/">lacks DP Alt Mode</a>, meaning you can’t plug in a USB-C monitor. I don’t fault the Asahi people, Apple uses custom undocumented hardware to manage the USB ports, and reversing muxes seems boring.</p>

<p>Additionally, like on almost all Linux laptops, the power management is bad. And even worse, there’s 0 documentation from Apple on how to fix it, so despite it being super good on macOS, it’s one of the more annoying laptops to try to fix on Linux. At least if you have a laptop with AMD or Intel there’s some docs on power states.</p>

<hr />
<p><br /></p>

<p>So with Apple out, we have to look for alternatives. I like so much about <a href="https://frame.work/">Framework</a> as a company, straightforward, open source ethos, but they aren’t building the product I want.</p>

<p>I don’t care one bit about upgradability or customizability. After a year or two, I’m happy to throw it out and buy a new one. It’s not like upgradability is a bad thing, but it usually comes with tradeoffs to weight and power draw, and I’d rather it all be in one solid package glued together. And I don’t like customizability because I like when all the testing and polish work is put into one configuration.</p>

<p>Perhaps the Framework 16 will impress me; I shouldn’t judge until I use it. But I see things like <a href="https://www.reddit.com/r/framework/comments/1e67j31/framework_laptop_16_touchpad_single_unit/">a request for a touchpad single unit</a> so there’s not some random pieces of plastic digging into my wrist just in case I want to move my touchpad left or right. And I read some complaints about the rigidity, how can it be rigid if the modules are attached with magnets? Engineering is all about trade-offs, and the trade-off I’d prefer is 0 upgradability or customizability in exchange for less weight and more polish.</p>

<p>The Framework 16 also has a Strix Point instead of a Strix Halo, and I hear the power draw isn’t too much better on Point. Coming from an M3 Max, the Strix Halo is just <em>barely</em> acceptable performance wise, I also own an Intel Core 7 155H and AMD Hawk Point. Those are not what I consider okay in a laptop.</p>

<hr />
<p><br /></p>

<p>I’m typing this blog on a HP ZBook Ultra G1a 14. Question to HP, who names this crap? Why do these companies insist on having the most confusing product lineups and names.</p>

<p>Are ZBooks good or do I want an OmniBook or ProBook? Within ZBook, is Ultra or Fury better? Do I want a G1a or a G1i? Oh you sell ZBook Firefly G11, I liked <a href="https://www.imdb.com/title/tt0303461/">that TV show</a>, is that one good?</p>

<p>Wait wait wait OMEN MAX 16z-ak000 has a lot of capital letters, that one must be the best, right? But there’s also an HP EliteBook, Elite sounds like the best, do I still want a ZBook?</p>

<p>These are all real products on <a href="https://www.hp.com/us-en/shop/vwa/laptops">HP’s laptop page</a>.</p>

<p>Consumer electronics naming is very simple. Make a good product with a simple name. “iPhone”, “comma”, “Z Fold”. Then every year or two, add one to the number of that product. If it’s a small refresh, you can add a letter after the number. “2 3 3X 4” “4 4s 5 5s 6 …” “2 3 4 5 6 7”</p>

<p>Why is this so hard for companies like HP?</p>

<hr />
<p><br /></p>

<p>If I made a laptop, it would come in one configuration. Call it the <strong>hackbook</strong></p>

<p>Highest end Strix Halo part, which is the best mobile(ish) chip you can get outside Apple. 16 core Zen 5 CPU, 40 core RDNA 3.5 GPU. 64GB of LPDDR5X RAM @ 256 GB/s. A stunning 16 inch OLED screen that’s the full size of the laptop. A max size legal on planes 100 Wh battery. Great sound with out of the box tuned psychoacoustic bass. Aluminium unibody with just one bit of laser etched branding where the Apple is, no other writing on the laptop. A classy keyboard without weird logos and random lights. An awesome touchpad; the ZBook touchpad is actually fine, it’s not just Apple with good ones anymore.</p>

<p>Crazy fast boot times, amazing power management. Linux can be tuned so well if you care, and this tuning will be installed on every one we sell. We sell one configuration to all the best developers in the world who want to not use a MacBook anymore. Apple will not understand what they had until they lose it, the only reason anything works on Mac at all is because there’s 100,000 amazing developers who use these machines every day; they put some work into making their house nice.</p>

<p>And when it’s time to upgrade in one or two years, we’ll have the <strong>hackbook two</strong> ready for you. The number goes up by one, and you know which one to buy. For some reason people say I get distracted, but comma has been around for ten years following this playbook; we now have a <a href="https://www.comma.ai/shop/comma-four">comma four</a> for you. If I built one laptop, I’d keep building a laptop for 10 years. With Apple’s decline and our rise, the <strong>hackbook four</strong> will be the first one that’s clearly better than a MacBook.</p>

<hr />
<p><br /></p>

<p>I’m writing this blog post in hopes I don’t actually have to do this. I’m not really going to, there’s so many other things to do. This is just whining and bikeshedding. Can somebody please build a good MacBook replacement and make it a <a href="https://en.wikipedia.org/wiki/Focal_point_(game_theory)">Schelling point</a> everyone will switch to so I don’t have to think about this anymore?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/11/29/bikeshedding-or-laptop.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>the singularity is nearer | A home for poorly researched ideas that I find myself repeating a lot anyway</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="the singularity is nearer" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<meta property="og:description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<link rel="canonical" href="blog/index.html" />
<meta property="og:url" content="https://geohot.github.io//blog/" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="website" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="the singularity is nearer" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"WebSite","description":"A home for poorly researched ideas that I find myself repeating a lot anyway","headline":"the singularity is nearer","name":"the singularity is nearer","url":"https://geohot.github.io//blog/"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="blog/assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <div class="home">
<h2 class="post-list-heading">Posts</h2>
    <ul class="post-list"><li><span class="post-meta">Feb 27, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/27/the-insane-stupidity-of-ubi.html">
            The Insane Stupidity of UBI
          </a>
        </h3></li><li><span class="post-meta">Feb 26, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/26/the-last-gasps-of-the-rent-seeking-class.html">
            The Last Gasps of the Rent Seeking Class
          </a>
        </h3></li><li><span class="post-meta">Feb 19, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/19/ai-art.html">
            AI is the Best Thing to Happen to Art
          </a>
        </h3></li><li><span class="post-meta">Feb 16, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/16/cost-of-housing.html">
            Cost of Housing
          </a>
        </h3></li><li><span class="post-meta">Feb 15, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/15/tiny-corp-product.html">
            tiny corp&#39;s product -- a training box
          </a>
        </h3></li><li><span class="post-meta">Feb 13, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/02/13/i-told-you-so.html">
            I Told You So
          </a>
        </h3></li><li><span class="post-meta">Jan 27, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/27/the-importance-of-diversity.html">
            The Importance of Diversity
          </a>
        </h3></li><li><span class="post-meta">Jan 26, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/26/own-a-zettaflop.html">
            Will I ever own a zettaflop?
          </a>
        </h3></li><li><span class="post-meta">Jan 25, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/25/war-on-car-ownership.html">
            The Coming War on Car Ownership
          </a>
        </h3></li><li><span class="post-meta">Jan 18, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/18/how-do-i-stop.html">
            how do I stop participating?
          </a>
        </h3></li><li><span class="post-meta">Jan 17, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/17/three-minutes.html">
            you have three minutes to escape the perpetual underclass
          </a>
        </h3></li><li><span class="post-meta">Jan 15, 2026</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2026/01/15/anthropic-huge-mistake.html">
            Anthropic is making a huge mistake
          </a>
        </h3></li><li><span class="post-meta">Dec 29, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/12/29/five-years-of-tinygrad.html">
            Five years of tinygrad
          </a>
        </h3></li><li><span class="post-meta">Dec 22, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/12/22/the-opinion.html">
            The opinion that pisses everyone off
          </a>
        </h3></li><li><span class="post-meta">Dec 18, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/12/18/computer-use-models.html">
            Computer Use Models
          </a>
        </h3></li><li><span class="post-meta">Nov 29, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/11/29/bikeshedding-or-laptop.html">
            Bikeshedding, or why I want to build a laptop
          </a>
        </h3></li><li><span class="post-meta">Nov 28, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/11/28/replacing-my-macbook.html">
            Replacing my MacBook
          </a>
        </h3></li><li><span class="post-meta">Oct 24, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/10/24/gambling-is-bad.html">
            Gambling is Bad
          </a>
        </h3></li><li><span class="post-meta">Oct 19, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/10/19/solution-is-simple.html">
            the solution is simple but you aren&#39;t demoralized enough yet
          </a>
        </h3></li><li><span class="post-meta">Oct 17, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/10/17/anticloud-hopecore.html">
            anticloud hopecore
          </a>
        </h3></li><li><span class="post-meta">Oct 15, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/10/15/pathetic-losers.html">
            Pathetic Losers
          </a>
        </h3></li><li><span class="post-meta">Oct 6, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/10/06/always-been-at-war.html">
            We have always been at war with Eastasia
          </a>
        </h3></li><li><span class="post-meta">Sep 13, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/13/get-out-of-technology.html">
            Get Out of Technology
          </a>
        </h3></li><li><span class="post-meta">Sep 12, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/12/ai-coding.html">
            AI Coding
          </a>
        </h3></li><li><span class="post-meta">Sep 8, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-seven.html">
            chapter seven: nudge
          </a>
        </h3></li><li><span class="post-meta">Sep 8, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-six.html">
            chapter six: dashcam
          </a>
        </h3></li><li><span class="post-meta">Sep 8, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-five.html">
            chapter five: sleuthing
          </a>
        </h3></li><li><span class="post-meta">Sep 7, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-four.html">
            chapter four: bagel
          </a>
        </h3></li><li><span class="post-meta">Sep 7, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-three.html">
            chapter three: father
          </a>
        </h3></li><li><span class="post-meta">Sep 7, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-two.html">
            chapter two: party
          </a>
        </h3></li><li><span class="post-meta">Sep 6, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/06/chapter-one.html">
            chapter one: john
          </a>
        </h3></li><li><span class="post-meta">Sep 2, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/02/you-are-a-good-person.html">
            you are a good person
          </a>
        </h3></li><li><span class="post-meta">Sep 1, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html">
            you will blame the wrong people
          </a>
        </h3></li><li><span class="post-meta">Aug 31, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/08/31/you-can-never-go-back.html">
            you can never go back
          </a>
        </h3></li><li><span class="post-meta">Jul 18, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/07/18/the-world-after-wireheading.html">
            The World After Wireheading
          </a>
        </h3></li><li><span class="post-meta">Jul 6, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/07/06/can-tinygrad-win.html">
            Can tinygrad win?
          </a>
        </h3></li><li><span class="post-meta">Jul 5, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/07/05/are-we-the-baddies.html">
            Are we the baddies?
          </a>
        </h3></li><li><span class="post-meta">Apr 22, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/04/22/a-way-forward.html">
            A Way Forward
          </a>
        </h3></li><li><span class="post-meta">Apr 11, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/04/11/critical-trade-theory.html">
            Critical Trade Theory
          </a>
        </h3></li><li><span class="post-meta">Mar 24, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/03/24/tragic-intel.html">
            The Tragic Case of Intel AI
          </a>
        </h3></li><li><span class="post-meta">Mar 16, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/03/16/resentment.html">
            Resentment
          </a>
        </h3></li><li><span class="post-meta">Mar 8, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/03/08/AMD-YOLO.html">
            AMD YOLO
          </a>
        </h3></li><li><span class="post-meta">Mar 3, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/03/03/demoralization-is-just-beginning.html">
            The Demoralization is just Beginning
          </a>
        </h3></li><li><span class="post-meta">Feb 24, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/02/24/money-is-the-map.html">
            Money is the Map
          </a>
        </h3></li><li><span class="post-meta">Feb 19, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/02/19/nobody-will-profit.html">
            Nobody Profits
          </a>
        </h3></li><li><span class="post-meta">Jan 22, 2025</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2025/01/22/death-of-the-visceral.html">
            Death of the Visceral
          </a>
        </h3></li><li><span class="post-meta">Dec 7, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/12/07/elon-swing-voter.html">
            The Elon Swing Voter
          </a>
        </h3></li><li><span class="post-meta">Dec 1, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/12/01/the-soul.html">
            The Soul
          </a>
        </h3></li><li><span class="post-meta">Nov 29, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/29/nuke-acc.html">
            nuke/acc
          </a>
        </h3></li><li><span class="post-meta">Nov 20, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/20/a-place-for-me.html">
            A Place for Me
          </a>
        </h3></li><li><span class="post-meta">Nov 17, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/17/a-one-way-bridge.html">
            A One Way Bridge
          </a>
        </h3></li><li><span class="post-meta">Nov 13, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/13/collective-marshmallow-test.html">
            The Collective Marshmallow Test
          </a>
        </h3></li><li><span class="post-meta">Nov 6, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/06/what-is-possible.html">
            ...and now we see what is possible
          </a>
        </h3></li><li><span class="post-meta">Nov 4, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/04/influence-agents.html">
            Influence Agents
          </a>
        </h3></li><li><span class="post-meta">Nov 3, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/11/03/high-trust-society.html">
            High Trust Society
          </a>
        </h3></li><li><span class="post-meta">Oct 28, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/10/28/americas-future.html">
            America&#39;s Future
          </a>
        </h3></li><li><span class="post-meta">Aug 12, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/08/12/dangerous-misinformation.html">
            Dangerous Misinformation
          </a>
        </h3></li><li><span class="post-meta">Aug 2, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/08/02/online-dating.html">
            Online Dating
          </a>
        </h3></li><li><span class="post-meta">Mar 27, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/03/27/where-the-bitter-lesson-ends.html">
            Where the Bitter Lesson ends
          </a>
        </h3></li><li><span class="post-meta">Feb 26, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/02/26/the-worlds-computer.html">
            The World&#39;s Computer
          </a>
        </h3></li><li><span class="post-meta">Jan 30, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/01/30/cruise.html">
            Cruise
          </a>
        </h3></li><li><span class="post-meta">Jan 7, 2024</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2024/01/07/heroin.html">
            Tech Heroin
          </a>
        </h3></li><li><span class="post-meta">Nov 18, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/11/18/imitation-learning.html">
            Imitation Learning
          </a>
        </h3></li><li><span class="post-meta">Nov 4, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/11/04/disrupt-the-government.html">
            Disrupt the Government
          </a>
        </h3></li><li><span class="post-meta">Oct 3, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/10/03/three-class-society.html">
            Three Class Society
          </a>
        </h3></li><li><span class="post-meta">Aug 16, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/08/16/p-doom.html">
            p(doom)
          </a>
        </h3></li><li><span class="post-meta">Aug 10, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/08/10/there-is-no-hard-takeoff.html">
            There is no hard takeoff
          </a>
        </h3></li><li><span class="post-meta">Aug 8, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/08/08/a-really-big-computer.html">
            A Really Big Computer
          </a>
        </h3></li><li><span class="post-meta">Jul 23, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/07/23/choose-your-own-adventure.html">
            choose your own adventure
          </a>
        </h3></li><li><span class="post-meta">Jul 20, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/07/20/a-disgusting-playbook-copy.html">
            A disgusting playbook
          </a>
        </h3></li><li><span class="post-meta">Jun 7, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/06/07/a-dive-into-amds-drivers.html">
            A dive into the AMD driver workflow
          </a>
        </h3></li><li><span class="post-meta">May 24, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html">
            the tiny corp raised $5.1M
          </a>
        </h3></li><li><span class="post-meta">Apr 26, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/04/26/a-person-of-compute.html">
            A Person of Compute
          </a>
        </h3></li><li><span class="post-meta">Apr 11, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/04/11/wireheading-city.html">
            Wireheading City
          </a>
        </h3></li><li><span class="post-meta">Feb 13, 2023</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2023/02/13/wokeism.html">
            Wokeism
          </a>
        </h3></li><li><span class="post-meta">Dec 31, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/12/31/eacc.html">
            e/acc
          </a>
        </h3></li><li><span class="post-meta">Dec 27, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/12/27/avatar-2-was-bad.html">
            Avatar 2 was Bad
          </a>
        </h3></li><li><span class="post-meta">Oct 29, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/10/29/the-heroes-journey.html">
            The Hero&#39;s Journey
          </a>
        </h3></li><li><span class="post-meta">Oct 13, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/10/13/a-hope.html">
            A Hope
          </a>
        </h3></li><li><span class="post-meta">Oct 2, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/10/02/happy-brithday-to-me.html">
            Happy Birthday to Me
          </a>
        </h3></li><li><span class="post-meta">Sep 3, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/09/03/on-device-learning.html">
            On Device Learning
          </a>
        </h3></li><li><span class="post-meta">Apr 16, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/04/16/vampire-attack-twitter.html">
            Vampire Attack Twitter
          </a>
        </h3></li><li><span class="post-meta">Mar 5, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/03/05/beauty-after-covid.html">
            Beauty after COVID
          </a>
        </h3></li><li><span class="post-meta">Feb 17, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/02/17/brain-flops.html">
            Brain FLOPS
          </a>
        </h3></li><li><span class="post-meta">Feb 9, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/02/09/the-problem-of-the-state.html">
            The Problem of the State
          </a>
        </h3></li><li><span class="post-meta">Feb 2, 2022</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2022/02/02/consumer-class-divide.html">
            Consumer Class Divide
          </a>
        </h3></li><li><span class="post-meta">Dec 18, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/12/18/the-fourth-estate.html">
            The Fourth Estate
          </a>
        </h3></li><li><span class="post-meta">Dec 12, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html">
            A Correction on my AI chip thoughts
          </a>
        </h3></li><li><span class="post-meta">Nov 9, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/11/09/on-the-university-of-austin.html">
            On The University of Austin
          </a>
        </h3></li><li><span class="post-meta">Oct 29, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/10/29/an-architecture-for-life.html">
            An Architecture for Life
          </a>
        </h3></li><li><span class="post-meta">Oct 24, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/10/24/to-fight-against-entropy.html">
            To Fight against Entropy
          </a>
        </h3></li><li><span class="post-meta">Sep 28, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/09/28/class-warfare.html">
            Class Warfare
          </a>
        </h3></li><li><span class="post-meta">Sep 23, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/09/23/the-new-regime.html">
            The New Regime
          </a>
        </h3></li><li><span class="post-meta">Aug 10, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/08/10/coliving-spaces.html">
            Coliving Spaces
          </a>
        </h3></li><li><span class="post-meta">Aug 6, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/08/06/consumption.html">
            Consumption
          </a>
        </h3></li><li><span class="post-meta">Jul 11, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/07/11/individual-sovereignty.html">
            Individual Sovereignty
          </a>
        </h3></li><li><span class="post-meta">Jul 4, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/07/04/baskets.html">
            Baskets
          </a>
        </h3></li><li><span class="post-meta">Jun 23, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/06/23/pieces-of-shit.html">
            Pieces of Shit
          </a>
        </h3></li><li><span class="post-meta">Jun 13, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html">
            A Breakdown of AI Chip Companies
          </a>
        </h3></li><li><span class="post-meta">Jun 10, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/06/10/a-circulation-of-the-elites.html">
            A Circulation of the Elites
          </a>
        </h3></li><li><span class="post-meta">May 7, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/05/07/idiots-are-going-to-kill-me.html">
            Idiots are going to kill me
          </a>
        </h3></li><li><span class="post-meta">Apr 25, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/04/25/a-machine-ecology.html">
            A Machine Ecology
          </a>
        </h3></li><li><span class="post-meta">Apr 20, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/04/20/sell-outs.html">
            Sell Outs
          </a>
        </h3></li><li><span class="post-meta">Feb 28, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/02/28/the-ai-control-problem.html">
            The AI Control Problem
          </a>
        </h3></li><li><span class="post-meta">Jan 18, 2021</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2021/01/18/technology-without-industry.html">
            Technology without Industry
          </a>
        </h3></li><li><span class="post-meta">Aug 20, 2020</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2020/08/20/a-silicon-person.html">
            A Silicon Person
          </a>
        </h3></li><li><span class="post-meta">Aug 7, 2020</span>
        <h3>
          <a class="post-link" href="https://geohot.github.io/blog/jekyll/update/2020/08/07/on-money-creation.html">
            On Money Creation
          </a>
        </h3></li></ul>

    <p class="rss-subscribe">subscribe <a href="blog/feed.xml">via RSS</a></p></div>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Brain FLOPS | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Brain FLOPS" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Google “energy for neuron firing” and you get:" />
<meta property="og:description" content="Google “energy for neuron firing” and you get:" />
<link rel="canonical" href="brain-flops.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/02/17/brain-flops.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-02-17T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Brain FLOPS" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-02-17T00:00:00+08:00","datePublished":"2022-02-17T00:00:00+08:00","description":"Google “energy for neuron firing” and you get:","headline":"Brain FLOPS","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/02/17/brain-flops.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/02/17/brain-flops.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Brain FLOPS</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-02-17T00:00:00+08:00" itemprop="datePublished">Feb 17, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Google “energy for neuron firing” and you get:</p>

<blockquote>
  <p>In final, the energy supply to a neuron by ATP during one action potential is 2.468 × 10^−7 J</p>
</blockquote>

<p>This means that assuming the brain is drawing 20W, that’s 81M firing events per second.</p>

<p>Assuming each neuron has a fan-out of 1000, aka 1000 MACs, that’s 2000 FLOPS per neuron. That’s only 162 GFLOPS…to be fair, they are sparse. But a far cry from 20 PFLOPS, the classic estimate of brain compute. Even assuming they use 1% 1’s, that’s still only 16 TFLOPS.</p>

<p>Maybe a 3090 is already a human brain.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/02/17/brain-flops.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Can tinygrad win? | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Can tinygrad win?" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This is not going to be a cakewalk like self driving cars. Most of comma’s competition is now out of business, taking billions and billions of dollars with it. Re: Tesla and FSD, we always expected Tesla to have the lead, but it’s not a winner take all market, it will look more like iOS vs Android. comma has been around for 10 years, is profitable, and is now growing rapidly. In self driving, most of the competition wasn’t even playing the right game." />
<meta property="og:description" content="This is not going to be a cakewalk like self driving cars. Most of comma’s competition is now out of business, taking billions and billions of dollars with it. Re: Tesla and FSD, we always expected Tesla to have the lead, but it’s not a winner take all market, it will look more like iOS vs Android. comma has been around for 10 years, is profitable, and is now growing rapidly. In self driving, most of the competition wasn’t even playing the right game." />
<link rel="canonical" href="can-tinygrad-win.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/07/06/can-tinygrad-win.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-07-06T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Can tinygrad win?" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-07-06T00:00:00+08:00","datePublished":"2025-07-06T00:00:00+08:00","description":"This is not going to be a cakewalk like self driving cars. Most of comma’s competition is now out of business, taking billions and billions of dollars with it. Re: Tesla and FSD, we always expected Tesla to have the lead, but it’s not a winner take all market, it will look more like iOS vs Android. comma has been around for 10 years, is profitable, and is now growing rapidly. In self driving, most of the competition wasn’t even playing the right game.","headline":"Can tinygrad win?","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/07/06/can-tinygrad-win.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/07/06/can-tinygrad-win.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Can tinygrad win?</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-07-06T00:00:00+08:00" itemprop="datePublished">Jul 6, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This is not going to be a cakewalk like self driving cars. Most of comma’s competition is now out of business, taking billions and billions of dollars with it. Re: Tesla and FSD, we always expected Tesla to have the lead, but it’s not a winner take all market, it will look more like iOS vs Android. comma has been around for 10 years, is profitable, and is now growing rapidly. In self driving, most of the competition wasn’t even playing the right game.</p>

<p>This isn’t how it is for ML frameworks. tinygrad’s competition is playing the right game, open source, and run by some quite smart people. But this is my second startup, so hopefully taking a bit more risk is appropriate.</p>

<p>For comma to win, all it would take is people in 2016 being wrong about LIDAR, mapping, end to end, and <a href="http://www.incompleteideas.net/IncIdeas/BitterLesson.html">hand coding</a>, which hopefully we all agree now that they were. For tinygrad to win, it requires something much deeper to be wrong about <em>software development in general</em>.</p>

<hr />
<p><br /></p>

<p>As it stands now, tinygrad is 14556 lines. Line count is not a perfect proxy for complexity, but when you have differences of multiple orders of magnitude, it might mean something. I asked ChatGPT to estimate the lines of code in PyTorch, JAX, and MLIR.</p>

<ul>
  <li>JAX = 400k</li>
  <li>MLIR = 950k</li>
  <li>PyTorch = 3300k</li>
</ul>

<p>They range from one to two orders of magnitude off. And this isn’t even including all the libraries and drivers the other frameworks rely on, CUDA, cuBLAS, Triton, nccl, LLVM, etc…. tinygrad includes every single piece of code needed to drive an AMD RDNA3 GPU except for LLVM, and we plan to remove LLVM in a year or two as well.</p>

<hr />
<p><br /></p>

<p>But so what? What does line count matter? One hypothesis is that tinygrad is only smaller because it’s not speed or feature competitive, and that if and when it becomes competitive, it will also be that many lines. But I just don’t think that’s true. tinygrad is already feature competitive, and for speed, I think the bitter lesson also applies to software.</p>

<p>When you look at the machine learning ecosystem, you realize it’s just the same problems over and over again. The problem of multi machine, multi GPU, multi SM, multi ALU, cross machine memory scheduling, DRAM scheduling, SRAM scheduling, register scheduling, it’s all the same underlying problem at different scales. And yet, in all the current ecosystems, there are completely different codebases and libraries at each scale.</p>

<p>I don’t think this stands. I suspect there is a simple formulation of the problem underlying all of the scheduling. Of course, this problem will be in NP and hard to optimize, but I’m betting the bitter lesson wins here. The goal of the tinygrad project is to abstract away everything except the absolute core problem in the cleanest way possible.</p>

<hr />
<p><br /></p>

<p>This is why we need to replace everything. A model for the hardware is simple compared to a model for CUDA. If we succeed, tinygrad will not only be the fastest NN framework, but it will be under 25k lines all in, GPT-5 scale training job to MMIO on the PCIe bus!</p>

<p>Here are the steps to get there:</p>

<ol>
  <li>Expose the underlying search problem spanning several orders of magnitude. Due to the execution of neural networks not being data dependent, this problem is very amenable to search.</li>
  <li>Make sure your formulation is simple and complete. Fully capture all dimensions of the search space. The optimization goal is simple, run faster.</li>
  <li>Apply the state of the art in search. Burn compute. Use LLMs to guide. Use SAT solvers. Reinforcement learning. It doesn’t matter, there’s no way to cheat this goal. Just see if it runs faster.</li>
</ol>

<p>If this works, not only do we win with tinygrad, but hopefully people begin to rethink software in general. Of course, it’s a big if, this isn’t like comma where it was hard to lose. But if it wins…</p>

<p>The main thing to watch is development speed. Our bet has to be that tinygrad’s development speed is outpacing the others. We have the <a href="https://x.com/__tinygrad__/status/1935364905949110532">AMD contract</a> to train LLaMA 405B as fast as NVIDIA due in a year, let’s see if we succeed.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/07/06/can-tinygrad-win.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter five: sleuthing | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter five: sleuthing" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Mom" />
<meta property="og:description" content="Mom" />
<link rel="canonical" href="chapter-five.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-five.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-08T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter five: sleuthing" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-08T00:00:00+08:00","datePublished":"2025-09-08T00:00:00+08:00","description":"Mom","headline":"chapter five: sleuthing","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-five.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-five.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter five: sleuthing</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-08T00:00:00+08:00" itemprop="datePublished">Sep 8, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Mom</p>

<blockquote>
  <p>12:37 – <font color="#3A76F0">hey when are you getting home?</font></p>
</blockquote>

<hr />
<p><br /></p>

<p>Dave</p>

<blockquote>
  <p><strong>You set the disappearing message time to 3 hours</strong><br />
12:48 – <font color="#3A76F0">hey you doing better</font><br />
12:48 – <font color="black">lol yea i really didn't sleep much</font><br />
12:49 – <font color="black">what's up u didn't set timeout for that</font><br />
12:49 – <font color="#3A76F0">yea is what Brian said true</font><br />
12:49 – <font color="black">what did he say</font><br />
12:49 – <font color="#3A76F0">about how Tom worked at operant?</font><br />
12:50 – <font color="black">yea why?</font><br />
12:50 – <font color="#3A76F0">you know that's where my dad worked</font><br />
12:50 – <font color="#3A76F0">and he kind of went crazy too</font><br />
12:50 – <font color="#3A76F0">do you know what he did there?</font><br />
12:54 – <font color="black">not rly</font><br />
12:54 – <font color="black">my mom gets real upset when i bring it up</font><br />
12:54 – <font color="black">it was some math shit with magnets</font><br />
12:54 – <font color="black">wanna come over and ask her</font><br />
12:54 – <font color="black">lol</font><br /></p>
</blockquote>

<p>I did not want to have a conversation with Dave’s mother.</p>

<blockquote>
  <p>12:55 – <font color="#3A76F0">haha im good</font><br />
12:55 – <font color="#3A76F0">but im just chilling at home if you want to come by here</font><br /></p>
</blockquote>

<hr />
<p><br /></p>

<p>The doorbell rang again. Resolving to be less of a pussy, I answered it. I was prepared to talk to the cops. Polite, short answers, step outside and lock the door, find out what they want. Not a pussy. Not a pussy. Not a pussy.</p>

<p>It wasn’t the cops. It was my Mom’s friend Anne, and I told her she wasn’t here. It was always strange to me that that generation would just drop by. Like she didn’t text her first? She said she was in the neighborhood and had extra bagels she wanted to drop off.</p>

<p>I thought about telling her that I hadn’t heard from my Mom since yesterday and that she didn’t reply to my text, but decided against it. I didn’t know the dynamic of my Mom’s friend group. Maybe she is out sleeping with Anne’s husband or something. I didn’t want to be a link in the chain of Anne finding out.</p>

<p>I was vague but very polite. Anne left the bagels. I didn’t touch the bag.</p>

<hr />
<p><br /></p>

<p>I went up the stairs to my Mom’s room. Did I mention how much I like true crime? It’s probably done bad things for me personality wise. I know that the people on there are out of the normal distribution of people, but those podcasts are one of my only exposures to the outside world. The world beyond this little slice of Brooklyn. So you kind of start thinking everyone is like that.</p>

<p>I’d always just assumed my Dad was like, a Wall Street guy. Boring. Get money, fuck bitches. When I was little we had tons of money. We lived in a huge house in Cobble Hill. I flew first class to Europe when I was 7. We spent a week on a yacht in Monaco. My mom loved the luxury lifestyle, and would put up with a lot of my Dad’s eccentricities to keep it.</p>

<p>When he left she didn’t seem that upset though. I think the money was still coming in from him, which was the main thing she cared about. It clearly wasn’t as much, we moved out to Sheepshead Bay and never went back to Europe. But she didn’t work and I always got good birthday presents, and she never said anything bad about my Dad, so I assume that’s where the money was coming from.</p>

<hr />
<p><br /></p>

<p>The first drawer I opened had sex toys in it. I saw a vibrator and a butt plug before I quickly closed the drawer. The second drawer had socks.</p>

<p>The third drawer had tons of scattered papers. My college rejections. Some essays from high school. A note written in crayon about how I wanted a Nintendo Switch for Christmas. I guess this was the “me” drawer.</p>

<p>The fourth drawer was papers, but more organized. My parents marriage certificate. My mom’s birth certificate. My old passport. As far as I knew, they never got a divorce. He just left. Then, something I didn’t know. A document entitling one Jessica Baker to $10,000 per month, to be paid out on the first of every month by <em>the Triangle Trust</em>, for the rest of her natural life, or until the trust is dissolved.</p>

<p>That was nice of my Dad. I went through the rest of the drawers, but didn’t find anything else interesting. I put everything back as carefully as I could. I considered that someone might dust for fingerprints. I wondered if I did anything illegal. I live here, right?</p>

<hr />
<p><br /></p>

<p>I checked on the text message to my Mom and noticed that it hadn’t been delivered. This was really unlike her. Sometimes she’d go out drinking and meet a guy and stay out all night, but she’d always at least text me by the morning when she sobered up.</p>

<blockquote>
  <p>2:14 – <font color="#3A76F0">are you okay?</font></p>
</blockquote>

<p>Not delivered. Maybe her phone died? Nah but it’s the afternoon she probably would have charged it by now. I tried calling. Straight to voicemail.</p>

<p>I checked the Mercedes app to see where her car was. She’d let me take the car sometimes, so we were both on the app. It asked me to login. I copied the password from 1password.</p>

<p><em>Incorrect Password</em></p>

<p>Maybe she changed it? I tried to set her up on 1password but she didn’t get it. She’d just reset the passwords when she needed to login. Ugh, logging into stuff is the worst. I clicked the reset password and typed in the e-mail.</p>

<p><em>There is no account with that e-mail</em></p>

<p>Okay, that doesn’t make sense. My Mom and I shared an e-mail for this stuff, and she wouldn’t change it without telling me. I clicked forgot e-mail. It needed the VIN of the car. The title was in the fourth drawer with the other papers. I went and got it and typed in the VIN.</p>

<p>The e-mail associated with your account is: <em>skinner666@gmail.com</em></p>

<p>A jolt of anxiety coarsed through my body. I’d never seen that e-mail address in my life.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-five.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter four: bagel | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter four: bagel" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="“Earth to Dave.” Brian rapped his knuckles lightly against Dave’s head. He snapped back into it. “This nice lady wants to know what kind of bagel you want”" />
<meta property="og:description" content="“Earth to Dave.” Brian rapped his knuckles lightly against Dave’s head. He snapped back into it. “This nice lady wants to know what kind of bagel you want”" />
<link rel="canonical" href="chapter-four.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-four.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-07T20:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter four: bagel" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-07T20:00:00+08:00","datePublished":"2025-09-07T20:00:00+08:00","description":"“Earth to Dave.” Brian rapped his knuckles lightly against Dave’s head. He snapped back into it. “This nice lady wants to know what kind of bagel you want”","headline":"chapter four: bagel","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-four.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-four.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter four: bagel</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-07T20:00:00+08:00" itemprop="datePublished">Sep 7, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>“Earth to Dave.” Brian rapped his knuckles lightly against Dave’s head. He snapped back into it. “This nice lady wants to know what kind of bagel you want”</p>

<p>It was so like Brian to call the woman at the counter a <em>nice lady</em>. At some point, he’d watched American Pie and thought Stifler was how people should be. Or maybe he was just always like that and the movie made him think it was acceptable. He called himself a <em>gentleman</em>, but not in the creepy Elliot Rodger way, or in anything resembling the real meaning of the word. I think he just thought it was funny how that word got a rise out of people.</p>

<p>Dave replied, “uhhh a cinnamon raisin…with uhh…butter…yea butter.” Even the <em>nice lady</em> knew Dave was high, Brian and I ordered normal bagel sandwiches and here was Dave ordering dessert. Brian paid for the bagels with his mom’s credit card and told us we could Venmo him later. His mom’s credit card and we Venmo him. That’s the type of guy he was.</p>

<hr />
<p><br /></p>

<p>“He didn’t leave last night. Passed out right where he was sitting,” Brian spoke about Dave like he wasn’t there. This would happen sometimes. Like we would smoke and get high, but for Dave it was a different thing. He would smoke till he was catatonic.</p>

<p>He was also the first one in our friend group to start smoking. Dave’s older brother killed himself when we were freshmen, and that’s around when it started. A coping strategy. It wasn’t just the loss of his brother, his mom was never the same afterward. I don’t think I saw her out of the house after that; Dave said she barely left her room. The overall downer atmosphere was too much for his sister and she moved to California as soon as she could. He was all that was left.</p>

<p>Dave got quiet after that. Maybe it was the weed, maybe it was the pain, but he started riding his bike to school every day and doing really well in classes. His brother was some kind of wunderkind; maybe he thought if he was like that his mother would stop moping. He graduated valedictorian and she never did. Maybe that wasn’t enough?</p>

<hr />
<p><br /></p>

<p>“I thought we were gonna have a party last night,” I mentioned offhandedly. Brian’s parties weren’t the Met Gala, but it was usually more than just the three of us. I was hoping Ari was going to be there.</p>

<p>“Hoping Ari was gonna be there?” Oh God even when I say something so innocuous Brian knows what I’m thinking. “Nah, we found the Volcano and didn’t really want to text anyone else after that.”</p>

<p>“Understandable”</p>

<p>“I don’t know if Dave slept. When I came downstairs he had the bag inflated on top of the machine.” He ribbed Dave with his elbow while he said this.</p>

<p>“I slept,” mumbled Dave. “It’s called wake and bake.” Dave and Brian both liked 2000s movies, stoner comedies, movies about high school and prom, getting laid. Something about it being a simpler time.</p>

<p>They were closer than I was with either of them. Dave would go to dark places and Brian couldn’t be brought there. So it worked. Even though Brian was kind of an asshole, he was a good guy to have around. His dad was a trucker and he wasn’t around much. This is one of the things we bonded over.</p>

<hr />
<p><br /></p>

<p>They called our name and we sat down at a table with the bagels. In the morning the visit from the cops didn’t really seem like much of a big deal, so I thought I’d tell the guys about it. Upon doing so, Brian immediately pointed out something I missed.</p>

<p>He asked, “What’s your dad’s name?” and I realized right away. While he went by Jonathan and I went by John, it sure made a lot more sense that the cops were looking for him when they wrote “John.” Lazy cops didn’t even write his full name. He was in town, and he was on Long Island for the meeting. It wasn’t me!</p>

<p>“Hey McFly!” Brian mocked. It was clear he’d watched Back to the Future recently and now I see where he got the knuckle rapping too. “You know you gotta stop being such a pussy all the time.” He put on a high pitched voice that was supposed to resemble mine, “Hi, my name is John, and I’m a pussy.”</p>

<p>I was too relieved to care about his mocking. Brian continued, “You know that place was into some weird shit. Where your dad worked before he bugged out. Dave’s brother worked there too.”</p>

<p>“You mean the one who killed himself?” Immediately I regretted how I said it and looked over at Dave. He was too transfixed by the swirls of cinnamon in his bagel to register anything.</p>

<p>Brian gave me a scolding look and I felt embarrassed. I came back at him, trying to move past my faux pas. “Well at least my dad did something. Your dad doesn’t even drive the truck! He sits there and watches it drive. A real union man.”</p>

<p>Dave now had finished his bagel and put his head down on the table. Brian smiled at the retort, “At least my dad isn’t some kind of Kaczynski freak.”</p>

<p>This was the nature of our friendship. Last night I thought my world was closing in, now I realize this just all isn’t my problem. My dad was <em>sort of a Kaczynski freak</em>. Maybe he mailed bombs to people and the cops caught him. Maybe he has some lame manifesto about why he did it. I love reading manifestos. I took out my phone and venmoed Brian for mine and Dave’s bagel. We’d venmo him about half the time; Brian’s mom was rich from the settlement and we knew she didn’t care about his little scam.</p>

<p>My mom still wasn’t back when I got home.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-four.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter one: john | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter one: john" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I hadn’t lost my virginity yet. And it wasn’t for lack of trying; it seemed like the rest of my generation was no longer interested in sex. On some level, I understood where they were coming from, the whole act did seem kind of pointless. But after a few beers, that wasn’t how my mind was working." />
<meta property="og:description" content="I hadn’t lost my virginity yet. And it wasn’t for lack of trying; it seemed like the rest of my generation was no longer interested in sex. On some level, I understood where they were coming from, the whole act did seem kind of pointless. But after a few beers, that wasn’t how my mind was working." />
<link rel="canonical" href="chapter-one.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/06/chapter-one.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-06T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter one: john" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-06T00:00:00+08:00","datePublished":"2025-09-06T00:00:00+08:00","description":"I hadn’t lost my virginity yet. And it wasn’t for lack of trying; it seemed like the rest of my generation was no longer interested in sex. On some level, I understood where they were coming from, the whole act did seem kind of pointless. But after a few beers, that wasn’t how my mind was working.","headline":"chapter one: john","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/06/chapter-one.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/06/chapter-one.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter one: john</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-06T00:00:00+08:00" itemprop="datePublished">Sep 6, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I hadn’t lost my virginity yet. And it wasn’t for lack of trying; it seemed like the rest of my generation was no longer interested in sex. On some level, I understood where they were coming from, the whole act did seem kind of pointless. But after a few beers, that wasn’t how my mind was working.</p>

<p>I turned 19 last week. Dad flew in from Idaho, and it was the first time he was in the house I shared with my mother. He left when I was 12, and it was always apparent that parenting wasn’t the top thing on his mind. There was some meeting on Long Island. That’s probably why he was here, in addition to the fact he knew mom wouldn’t make him sleep on the couch. He had many reasons to be in New York that weren’t me. My birthday was just a flimsy pretense.</p>

<p>He’d worked on Wall Street the whole time he was around, a quant. He wrote programs that made other people rich. But something happened to him right before he left. A crisis of conscience perhaps; he was spiraling for weeks, cursing the capitalist system, calling my mother a gold-digging whore (which was mostly true), and saying things needed to change. Then he packed a single backpack and left for Idaho.</p>

<p>I visited him out there once my sophomore year. He had a camouflaged one room cabin in the middle of a spruce forest, but instead of the hunting or fishing stuff you might expect, the walls were adorned with electrical test equipment and various things that looked like they were out of a biology or chemistry lab. I didn’t know much about this stuff and that wasn’t what he wanted to talk about anyway. He wanted to talk about “man shit” like nature and women and not being life’s bitch. I tried to act like I did, but I didn’t really listen. All I remember is how eerily quiet the night was, I could hear every animal movement outside. My dad said you get used to it.</p>

<hr />
<p><br /></p>

<p>Brian was having a party tonight. Well okay, <em>party</em> is a lofty way to describe it. He’d replaced the fluorescent lights in his mom’s basement with blacklights, and we’d go over there to drink beer and smoke weed and sit around on our phones and scroll. And sometimes someone would laugh at something and share with the group.</p>

<p>I had a case of Bud Light left over from the last party and drank two of them today. Hence the thinking about sex and not thinking that thinking about sex was stupid. People wouldn’t be going over there for a few more hours, so I laid in my bed, drank, and loosely beat off to YouTube. Celebrity gossip, internet gossip, speedrun videos, nothing even arousing. I liked the true crime videos about the hot female teachers who slept with their students. Yea yea yea terrible crime and they all act holier than thou about what if the genders were reversed, but the genders weren’t reversed. Maybe they just don’t want to get demonetized.</p>

<p>There were never women at these parties. Okay maybe one or two. But nobody ever slept with them or much thought about them that way. They were the agendered mass like the rest of us. Fellow consumers, not <em>providers</em>. Fuck I should just go visit a hooker. I didn’t know much about that, were hookers real? I’d never met one, and there wasn’t a good way to find out about stuff like this anymore. The Internet was pretty much all “advertiser friendly” now, declawed, sanitized. Once the algorithms got good enough and it was technically easy to censor, there was nothing holding them back.</p>

<p>It wasn’t actually censored, it would just redirect you elsewhere. And if you didn’t pay careful attention, you wouldn’t even notice it happening. I tried asking ChatGPT about hookers and it told me to call them sex workers. And this was kind of triggering. Who the fuck does this machine think it is? But then I was lost on this tangent, the algorithms got a rise out of me and I went back to comfort food YouTube. Look this guy beat Minecraft starting with only one block.</p>

<hr />
<p><br /></p>

<p>The doorbell rang. This always gives me anxiety. And it was particularly anxiety inducing since I was the only one home. Normally I could just know that the door of my room was locked and someone else would get it and this would be a downstairs issue. But it was just me at home. My heart rate jumped. I waited for it to ring again, but prayed that it wouldn’t. Please just go away. But sure enough, it rang again.</p>

<p>I went to my window, my room was on the second floor. There was a black Escalade in the driveway that I hadn’t seen before, and I could see two men at the door. They were wearing suits. I ducked as to make sure they wouldn’t see me if they looked up, making as little noise as possible. Peering over the window sill I could see one opening the screen door, and it looked like he stuck something to the main door. My heart was beating even faster now. It was Saturday night, why were there two men in suits? And why were they here?</p>

<p>It felt longer, but 3 minutes later they drove off. I waited another 3 for good measure, just watching the clock on my computer until it hit 6:57. I doubled checked out the window to make sure they were actually gone, and crept down the stairs to retrieve whatever they left on the door.</p>

<p>It was a business card, belonging to a “Detective James Reese” of the Nassau County Police. And on the back of the card, there was handwriting. “John – call me”</p>

<p>John was my name.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/06/chapter-one.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter seven: nudge | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter seven: nudge" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="“Why are you here on a Sunday?”" />
<meta property="og:description" content="“Why are you here on a Sunday?”" />
<link rel="canonical" href="chapter-seven.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-seven.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-08T19:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter seven: nudge" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-08T19:00:00+08:00","datePublished":"2025-09-08T19:00:00+08:00","description":"“Why are you here on a Sunday?”","headline":"chapter seven: nudge","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-seven.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-seven.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter seven: nudge</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-08T19:00:00+08:00" itemprop="datePublished">Sep 8, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>“Why are you here on a Sunday?”</p>

<p>“John’s in town,” I said. “And he knows I’m looking for him.”</p>

<hr />
<p><br /></p>

<p>I’ve carried this case for five years. When Operant moved its compute out to Long Island—cheaper power, easier permits—it landed in my world by accident. Detective James Reese, Nassau County Police. Since then, every time I think I’ve got a straight line, the story bends. People call it “mind control.” That’s the wrong phrase. You hear that and you start hunting for sci-fi. What you should be hunting for is timing.</p>

<p>There are the clean facts. It started with a private investigator caught at night inside Jane Street’s office. He was there to plant a device. Not a camera, not a mic. A flat plastic square the size of a drop ceiling tile, featureless, no lens, no obvious grill. If you tapped it with a knuckle it sounded dead, like dense foam. The FBI took the evidence, said as little as possible, and then Trump dissolved the Bureau and the chain of custody with it. The PI pled to B&amp;E, did eighteen months, swore a friend offered him ten grand and a location. The friend never existed long enough for us to find.</p>

<p>While the tile vanished, Operant didn’t. They grew. They put their name on the Ducks’ ballpark, donated to everyone they should, and pushed eight percent of Long Island’s power through their meter. Every time I asked questions, a lawyer answered them. I still have a job mostly because I don’t stick my questions in microphones.</p>

<hr />
<p><br /></p>

<p>But the corporate espionage wasn’t the hook. The hook’s name was Tom Park. Young, gifted, on Operant’s “research” payroll. He died off the roof of their building. We asked for the CCTV. They delayed until the delay became its own story, and when the files came they were grainy enough you could convince yourself resolution had gone out of style. We couldn’t prove a cut. We couldn’t prove a lie. We could see a silhouette on the roof with a phone in his hand, see him put it away, and watch him walk forward like he’d decided to walk forward an hour ago.</p>

<p>We pulled his phone records. The carrier said the device never left his parents’ house that night. The family’s router logs said the same thing—MAC associated all evening, steady signal, Netflix on the downstairs TV. At the time of death the rooftop access point didn’t record a roam. No one found a phone with the body.</p>

<p>If you’re generous, you call that “inconsistency.” If you’ve been around long enough, you call it “choreography.”</p>

<hr />
<p><br /></p>

<p>I didn’t see the tile again, but I kept a copy of the photos and I stared at the connector pads until I’d memorized the geometry. Four edge pads, power bus shape. Months later, a fire inspection at an Operant satellite site flagged “non-listed luminaires with integrated driver boards.” That’s code for “custom lights.” The brand on the sticker didn’t exist in any registry. It matched nothing you could buy.</p>

<p>What does a ceiling tile do if it isn’t a ceiling tile? You can guess: a planar array under plastic, phaseable, a clock inside that doesn’t drift. You don’t need to read thoughts. You need to make the room keep time.</p>

<p>We ran a small experiment in our squad room. Nothing that requires approval. We set up a tapping game on a laptop—left or right as quickly as you can when a cue appears. We added a desk lamp we could modulate in the last hundred milliseconds before the cue—no visible flicker, just PWM phase changes—and a piezo disc under the mouse pad that could make a vibration too soft to notice unless you were trying to notice. We told the script to wait until the model thought the subject was likely to pick left, then line up the lamp phase and the tick so “left” felt a hair earlier.</p>

<p>The hit rate shifted eight points. The officers said it felt like the computer was “on it” that round. No one said they felt pushed. That’s the thing about timing: when it works, it feels like you were going to do it anyway.</p>

<hr />
<p><br /></p>

<p>I went back to Tom. We subpoenaed what we could: badge swipes, elevator logs, building automation schedules for lights and HVAC. The elevator cabin he rode at 23:41 ran a “door nudge” cycle at floor 35—exact term in the manual. Not a stop, a shove. At the same minute the east conference rooms above ran a luminance ramp—35 to 50 percent and back down—logged as a “pattern test.” Two minutes later the air handlers kicked a “night purge,” unscheduled. The lobby mic’s spectrogram shows the change as a clean band sliding up. None of those facts make a person move. Together they draw a rhythm line through a building.</p>

<p>We never found what Tom had in his hand, his “not a phone,” but a year after his death, one of their contractors quit and dumped an issue tracker on a public repo by accident. It was up for an hour before it vanished, but the internet is full of raccoons, and one of them sent me a ZIP. Half the issues were boring—install scripts, driver mismatches, bad GPIO pull-ups. The other half had words like “phase,” “latency,” “confidence gate,” “avoid visible artifacts,” “EEG-free,” and the tag “ROOM.”</p>

<p>There was a set of comments on a bug titled “End Token Misfires.” The engineers were arguing about whether printing the full predicted sequence at the start of a session biased the subject into making it true. One person said that was the point. Another said if your only wins are the ones you can cause you aren’t measuring prediction anymore, you’re measuring control. The thread ends with a “resolved—won’t fix.”</p>

<p>Mind control isn’t the right term. It makes people look for sci-fi. The right term is “nudge,” the one the elevator manuals use. You put your thumb on the timing. You don’t push the person; you lean on the moment.</p>

<p>Tom stood on a roof with a clock in his pocket that belonged to the room, and a room that belonged to the company, and a company that had learned you can make a person look like a prediction if you take away all the moments where they would have surprised you.</p>

<p>Sometimes I think the real trick isn’t the tile or the lights. It’s the bookkeeping. You arrange your systems so that there’s nothing to subpoena. The carrier shows a phone at home. The Wi-Fi shows a phone at home. The building shows a test pattern and a purge cycle and a polite door. Nothing is illegal in a log file.</p>

<hr />
<p><br /></p>

<p>I keep a copy of that ZIP on a USB stick in my desk. There’s a folder called “SAFE_GATES” with a README someone wrote in plain English. “Do not schedule interventions if subject arousal &gt; threshold. Do not schedule end token if subject mentions self-harm. Cooldown after consecutive errors.” Half the rules are commented out. The most recent commit message is just a shrug emoji.</p>

<p>The worst part is how ordinary it all is. The elevator nudge. The lamp nudge. The HVAC tone. The not-a-phone. If you want to find the devil, you don’t go looking for horns. You go looking for clock edges.</p>

<p>I told my sergeant I was taking the rest of the day. I stopped by a hardware store and bought a dimmer I knew I could open, and a roll of white tape. Back at the office I put a strip of tape on the lamp in interview room two, covering the LED that the supplier put there to indicate “smart mode.” We don’t use smart mode. We don’t use anything with a mode. When I left, the room looked like every other room. That’s the point. You only notice the timing when it slips.</p>

<p>On the way home I drove past the Ducks ballpark. Operant’s name on the sign looked like every other naming deal. Families walking in, kids with foam fingers, warm light over the field. If you didn’t know to look, you’d think it was all just baseball.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-seven.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter six: dashcam | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter six: dashcam" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Dave" />
<meta property="og:description" content="Dave" />
<link rel="canonical" href="chapter-six.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-six.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-08T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter six: dashcam" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-08T00:00:00+08:00","datePublished":"2025-09-08T00:00:00+08:00","description":"Dave","headline":"chapter six: dashcam","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-six.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/08/chapter-six.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter six: dashcam</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-08T00:00:00+08:00" itemprop="datePublished">Sep 8, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Dave</p>

<blockquote>
  <p>2:41 – <font color="black">yoo i took a nap</font><br />
2:41 – <font color="black">wanna play minecraft?</font><br />
2:41 – <font color="#3A76F0">actually i need your help with something</font><br />
2:41 – <font color="black">what</font><br />
2:42 – <font color="#3A76F0">just come over</font><br />
2:42 – <font color="black">kk i gotta shower</font><br /></p>
</blockquote>

<hr />
<p><br /></p>

<p>Dave knew stuff about computers. Don’t let the being high all the time fool you, he was the smartest guy in our friend group. And he was the most chronically online. He showed up on his bike 20 minutes later.</p>

<p>“Yo,” I yelled to him across the lawn.</p>

<p>“Dude what’s up? You look rattled”</p>

<p>“My mom is missing and she isn’t answering her phone. Then I tried to track her on the car app, but somebody changed the e-mail.”</p>

<p>Dave came inside the house (I locked the door behind him) and opened his laptop at the kitchen table. I messaged him the VIN, and he tried the reset e-mail again but on the website. Same result. Same <em>skinner666</em></p>

<p>“What did the e-mail used to be? Do you have access to that account?”</p>

<p>“Yea,” I brought up the password to bakerfamily43@gmail.com on my 1Password and Dave logged in on his laptop.</p>

<hr />
<p><br /></p>

<p>We saw like 15 e-mails notifying that account details were changed for various services. Ranging from 2 to 3 am last night.</p>

<p>Most interesting was the first e-mail. It was from Google saying they blocked a login attempt to this account. From Atlanta, Georgia.</p>

<p>Dave explained, “They probably tried to log in to the gmail, but when it didn’t work, they changed the e-mails on other services to an account they controlled”</p>

<p>“From Atlanta? Who’s in Atlanta? They got hackers down there?” I was imagining…well never mind, you know what I was imagining.</p>

<p>“It’s probably a VPN, hang on, I’ll check the IP.” Dave copy pasted some numbers from the Google e-mail into the terminal. “Yea, NordVPN exit node.”</p>

<p>“What’s a VPN?”</p>

<p>“No wonder you can’t find hookers on the Internet.” I’d asked Dave about this once. He was high. I didn’t think he remembered. “Even Brian knows what a VPN is.”</p>

<hr />
<p><br /></p>

<p>“You think we should call the police,” I asked. But I already knew Dave’s answer.</p>

<p>Dave hated the police more than all of us. Back before the suicide, his mother would take him to Black Lives Matter protests. And as dumb as it was, those were probably some of the best memories he had with his family. It was a day outside, there were people, there were food stalls. And his mother was happy. Or maybe angry? But not depressed.</p>

<p>“Fuck 12,” he mumbled.</p>

<p>It wasn’t just the politics. After Tom’s suicide, the cops harassed his family. Well it wasn’t the police, it was child protective services. It became standard practice to investigate all cases where young people who still lived at home killed themselves. Nothing ended up happening with the investigation, but to Dave, one government mooching pig was the same as the next, and none of them were on his side.</p>

<p>“Okay, no police. I don’t like them either. You think my mom is okay?”</p>

<p>Dave thought for a minute, “I think I know how to find her car”</p>

<hr />
<p><br /></p>

<p>As the number of sensors on the Internet grew, the availability of data about the real world skyrocketed. Tons of people were willing to put cameras outside their house or dashcams on their car to earn a couple dollars. There were news articles predicting that this would end all crime. But of course this isn’t what happened. Ending crime was always more a question of will than a question of ability. And most people never made back the money they spent on the camera, the data wasn’t all that useful and not that many people bought it. But if you knew where to look, you could access it.</p>

<p>“Do you have the license plate number of the car?” I didn’t know it, but I went back upstairs to get the title. I also grabbed the Triangle Trust document.</p>

<p>Dave typed it into website billing itself as the world’s data marketplace. “Search millions of dashcams for a license plate” was one of the options, along with a bunch of other video search options, including “search millions of CCTV cameras for perky nipples.” It seemed like there was a whole Internet that I didn’t know about. $0.78 for the query. He typed in his credit card. I offered to pay him back. He thanked me for the bagel.</p>

<p>“Three hits in the last 24 hours” It was $8 each to download the video clips. One of them wouldn’t download, it said “Dashcam Offline.” It still took his $8 for that clip though. He downloaded the other two and dragged them into ChatGPT. No point in watching them manually.</p>

<p>Clip 1</p>
<blockquote>
  <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Timestamp (overlay): ~5:36:12 PM, Sat Jul 12
Location (inferred): Manhattan Bridge lower roadway, westbound into Manhattan. Overhead signage OCR fragments: “CANAL ST / CHINATOWN”; steel truss pattern matches the bridge; skyline and arch glimpses align.
What’s visible: Mercedes (body/DRL signature consistent) in center lane, moderate traffic, dry pavement, dusk light. No notable tail vehicle persists across frames.
</code></pre></div>  </div>
</blockquote>

<p>Clip 2</p>
<blockquote>
  <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Timestamp (overlay): ~11:29:47 PM, Sat Jul 12
Location (inferred): Sheepshead Bay corridor. Streetfront OCR: “EMMONS AVE,” “BAY DELI,” and a marina awning; sodium-vapor lighting; parked fishing boats visible for 2–3 frames.
What’s visible: Mercedes eastbound along Emmons Ave, signals right at the next intersection and turns toward a residential side street (likely Knapp/Bragg area; exact street name unreadable due to glare). Traffic light cycle and storefront shutters consistent with late-night return.
</code></pre></div>  </div>
</blockquote>

<hr />
<p><br /></p>

<p>I pondered, “That doesn’t make sense. That second clip is right by our house, but I got home an hour after that and she wasn’t here. What’s the third clip?”</p>

<p>“It won’t let me download it. Because of how this marketplace works, the video file isn’t uploaded to them until somebody buys it. If the user’s device is offline, we can’t download it.”</p>

<p>“Do we know anything about it?”</p>

<p>“Not really. Sometimes the user has a profile, but all he has is a username. It’s liducksfan”</p>

<p>For once, I could actually be useful. “The Long Island Ducks! I went to a game once!” I wasn’t actually that useful, Dave had already Googled “liducks” and that was the obvious first hit. “So she was on Long Island?”</p>

<p>“You’re the true crime guy. I’m just the tech guy.”</p>

<hr />
<p><br /></p>

<p>I had a hunch. I think she came home around 11:30, something happened here, either she saw something or met someone, and she left again and went to Long Island, all before I got home.</p>

<p>I looked around for James Reese’s business card. I couldn’t find it.</p>

<p>However, in plain sight, there was a note from my mother on the refrigerator. I guess it had been there the whole time; wow I’m a bad detective. “Met a guy. Going to the Hamptons. Might be out of cell service.” and then Mom in a heart. She always signs her notes like that.</p>

<p>I showed the note to Dave. He shrugged and asked if he could have one of the bagels that Anne left. Sure. Was this just me being paranoid, or is that the exact note my mother would leave if she didn’t want me to worry and that’s not at all what happened?</p>

<p>Who logged into her accounts? Who was <em>skinner666</em>?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/08/chapter-six.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter three: father | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter three: father" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="7 years earlier" />
<meta property="og:description" content="7 years earlier" />
<link rel="canonical" href="chapter-three.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-three.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-07T19:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter three: father" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-07T19:00:00+08:00","datePublished":"2025-09-07T19:00:00+08:00","description":"7 years earlier","headline":"chapter three: father","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-three.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-three.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter three: father</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-07T19:00:00+08:00" itemprop="datePublished">Sep 7, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><em>7 years earlier</em></p>

<hr />
<p><br /></p>

<p>Jonathan sat there while his Mercedes S-Class with DRIVE PILOT drove him across the Brooklyn Bridge to Wall Street. He had been working at Operant Capital for 10 years. The idea was simple. Predict the market, trade based on those predictions, and get rich. The implementation however, was not as simple as the idea.</p>

<p>The market doesn’t work like physics. The market moves based on the thoughts and feelings of billions of humans, and they were all trying to do this same prediction thing. That’s what made the economy. Everyone was basically doing this algorithm on some level. And even worse, this was a Red Queen’s race, where the tactics that worked last year didn’t work this year. Everyone was predicting everyone else predicting the market.</p>

<p>Except everyone was not as smart as Jonathan. He was a child prodigy. He got his first IMO Gold when he was 14. He graduated from MIT in 3 years. And he wanted a job where he was surrounded by other people as smart as him.</p>

<hr />
<p><br /></p>

<p>He’d been working on the RPS project for the last three years. As one of the more senior people there, he got to work on the more speculative research. Operant was blessed with basically an unlimited budget; the bounties of providing a valuable capital allocation service to the market.</p>

<p>Jonathan believed in the mission. Well, mostly anyway. Make markets more efficient. They weren’t a high frequency trading shop skimming pennies off of each transaction by being fast. They weren’t doing arbitrage. They were a market intelligence service. They knew where capital should be allocated before the market did, and in the grand scheme of things, they charged so little for their service.</p>

<p>Most of the tricks were standard. The same run of the mill models everyone in the industry was using. But they felt that their differentiator was always remembering that the market doesn’t obey physical laws. Technical analysis is complete bullshit. This is a simple betting game played against other agents.</p>

<p>Which is the line of thinking that led to the RPS project. RPS stood for rock-paper-scissors. A game with a simple Nash equilibrium. One-third, one-third, one-third. Deviate at all from that strategy, and your opponent can exploit you. But if your opponent isn’t playing that strategy, you have to deviate to <em>exploit them</em>.</p>

<hr />
<p><br /></p>

<p>Shortly after MRI machines were invented, people started using them to see if they could read minds. They’d put someone in an MRI and give them two buttons, say a red and a blue. Of course the machine knew which button you would press before you pressed it. But what was crazier is that the machine knew which button you would press <em>before you were even aware of your choice</em>.</p>

<p>The obvious follow up question is, how much before? Seconds was very believable. But could you know as soon as the subject walked in the room? At the time there wasn’t really a way to explore this. Aside from the 55% prior on red, there wasn’t much more to say.</p>

<p>Rock-paper-scissors was basically the same game. Humans do have unequal priors, preferring rock at 35.4%. But is it possible that someone was a scissors type guy? Maybe you could read their social media posts and tell. Maybe you could just tell by looking at their face.</p>

<p>The goal of the RPS project was to become perfect at rock-paper-scissors. And the results were very promising. The computer had a win rate of 86%, with a first round win rate of 54%. Once you were playing multiple games it was easy, but Jonathan was particularly proud of the first round win rate.</p>

<p>However, 54% wasn’t close to 100%. It was better than random, sure. But this showed diminishing returns. Maybe the data just wasn’t there. Maybe you had to look inside to spot a scissors type guy.</p>

<p>The new research direction was outfitting the room with SQUIDs, very sensitive magnetometers capable of measuring fields in the femtotesla range. The rules for the project disallowed things that were obvious and bulky like MRIs. But anything that could be put in a normal room was fair game.</p>

<hr />
<p><br /></p>

<p>It was Monday and the more junior people had been there working all weekend. Jonathan had taken his wife and son camping. When he got to the office, he was ambushed as soon as he stepped out of the elevator.</p>

<p>“You have to try it,” said Tom with the energy of a kid seeing presents on Christmas morning. Tom was 17, also an IMO Gold winner, and probably the brightest guy on the team. He didn’t go to college, he came straight to work at Operant. Real LeBron energy.</p>

<p>Jonathan stepped into the room. He played scissors. He lost. He played scissors again. He lost. He played rock. He lost. He played paper. He lost. He went back to scissors. He lost. He played scissors again. He lost. He stepped back to take a breath. He played rock. He lost. He played rock again. He lost. He walked out the room.</p>

<hr />
<p><br /></p>

<p>Tom handed him a piece of paper. At the top it had the date and 10:09 AM, and had SSRPSSRRE on it. 10:09 was when he walked into the room, and those were all the moves he played.</p>

<p>“What’s this E?”</p>

<p>“That’s end. It’s when you’d walk out of the room.”</p>

<p>“So are you saying…it predicted all of this before I even played one game?”</p>

<p>Tom shrugged, “If it knows all the predictions are going to be correct, why does it need any feedback?”</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-three.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>chapter two: party | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="chapter two: party" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I had watched enough true crime to know that you should never talk to the police. And I wasn’t arrogant enough to believe that I was different. While I felt like I knew the interrogation tactics in and out, they were repeat customers of that interaction. I wasn’t going to call. I was going to ignore it. I’m not getting Reid techniqued." />
<meta property="og:description" content="I had watched enough true crime to know that you should never talk to the police. And I wasn’t arrogant enough to believe that I was different. While I felt like I knew the interrogation tactics in and out, they were repeat customers of that interaction. I wasn’t going to call. I was going to ignore it. I’m not getting Reid techniqued." />
<link rel="canonical" href="chapter-two.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-two.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-07T17:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="chapter two: party" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-07T17:00:00+08:00","datePublished":"2025-09-07T17:00:00+08:00","description":"I had watched enough true crime to know that you should never talk to the police. And I wasn’t arrogant enough to believe that I was different. While I felt like I knew the interrogation tactics in and out, they were repeat customers of that interaction. I wasn’t going to call. I was going to ignore it. I’m not getting Reid techniqued.","headline":"chapter two: party","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-two.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/07/chapter-two.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">chapter two: party</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-07T17:00:00+08:00" itemprop="datePublished">Sep 7, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I had watched enough true crime to know that you should never talk to the police. And I wasn’t arrogant enough to believe that I was different. While I felt like I knew the interrogation tactics in and out, they were repeat customers of that interaction. I wasn’t going to call. I was going to ignore it. I’m not getting Reid techniqued.</p>

<p>Why did they ask for me? This house was owned by my mother, how do they even know I live here? Wait who am I kidding, of course they know. I went to high school here, governments have records of that kind of thing. But still, why ask for me?</p>

<p>Another thing was odd. We lived in Brooklyn, aka Kings County. Not Nassau County. These guys must have driven all the way here on a Saturday night. I felt like I was being watched. They wouldn’t drive all the way here to just leave a business card. I felt trapped in the house. Like they were a mountain lion on a rock perch and I was the prey in the valley below. They had the high ground and I didn’t know what they could see.</p>

<p>But this was crazy, I didn’t do anything! Should I call them? Figure out what they want? No! That’s exactly what they want. They know I feel like this. This is exactly what they are going for. Another system carefully crafted based on years and years of “user feedback” designed to manipulate you into doing what it wants.</p>

<p>But what if I’m doing what they want right now? Maybe they don’t want me to call. Maybe the real goal is to figure out what I do next. Watching and hoping I’ll go check on the body or something. But there wasn’t a body! If I did commit a crime this would all be a lot easier, I’d know why they were here and what they wanted and could plan my next move accordingly.</p>

<p>I opened another Bud Light, took my clothes off, and got into bed. Even though there was nobody else home, I kept the sound off on the porn. Just in case they were listening. After I finished, I felt a bit more calm. Dude get a grip, all they did was leave a business card.</p>

<hr />
<p><br /></p>

<p>Coming out of the paranoid spiral a bit, I realized what it must be about. It must have had to do with my Dad’s meeting. That was in Long Island, aka Nassau County. Probably some dumb financial crap. My mother was out with her friends in Manhattan, but she’d be home tonight and maybe she knew what the meeting was. From both a fear of monitored communication and a fear of spreading my paranoia, this wasn’t worth texting her about.</p>

<p>It was now twenty to nine and I texted Brian. He’s like yea bro Dave just got here come through. And you still have that case of Bud Light? I put the beers in a backpack. Is this what the detective planned? Maybe I was playing right into the plot; arrest me for underage possession of alcohol and then get me to talk about what I knew. But I didn’t even know anything!</p>

<p>This whole thing was stupid. I thought about how I got the beers, wondering if the whole thing was somehow a set-up. Totally nonsense thought. Kids buy beer with fake IDs all the time.</p>

<hr />
<p><br /></p>

<p>When I got to Brian’s everything was normal. I walked around the back of his house and opened the screen door to his basement. There were three leather couches in a U-shape, two of which were sparsely occupied by Brian and Dave. I took my place on the third empty one and put my backpack on the center ottoman.</p>

<p>“Pretty cool, right? Yea I found it in my Dad’s old stuff.” said Brian, referring to the inflated bag atop a device labeled <em>Volcano</em> sharing the ottoman with my backpack.</p>

<p>“What is it?”</p>

<p>“Bro it’s like an old vape. You put the weed in and plug it in to the wall.” He detached the cloudy bag from the device and demonstrated. If you pushed on the mouthpiece, it let air through and you could breathe in the vaporized drug. “It’s like a bong but chill.”</p>

<p>I inhaled. This probably wasn’t smart with how paranoid I was from the interaction earlier, but I felt safe in the basement. It was a summer night, I was with friends, I had drank beer. Life was good.</p>

<hr />
<p><br /></p>

<p>Dave showed us this reel. It was a mouse in a maze, and it started from the mouse’s perspective. Kind of like a skater cam, wow these things could scurry. Then it zoomed out so you could see the maze from the perspective of the experimenter. Then seeing the back of his head looking down at the maze, cutting to sped up dashcam video of him driving home from work. Zooming out again with a sparkling line showing his route through the grid of city streets. AI has done wonders for these video transitions. Maybe this whole video was AI.</p>

<p>“What if we’re the mouse,” said Dave in the most stereotypical stoner voice. He’d always find shit like this, in that way that when you are high the thought seems really deep. But if you think about it more it’s nonsense, like that mouse is in a maze constructed by humans, and even if it doesn’t always feel like it, the society we live in is jointly constructed by all of us.</p>

<p>Brian showed a video of two girls at some Mardi Gras bead type event licking one ice cream cone. He told us he wasn’t a virgin but I didn’t really believe him.</p>

<hr />
<p><br /></p>

<p>It was a bit after midnight and it was time to go home. I hadn’t really thought about the interaction from earlier, but I started to again when I got outside. It was a half mile walk back home; I was grateful to hear all the noises of the city. Even though I couldn’t see it, it reminded me that there was a society out there.</p>

<p>My mom’s car wasn’t in the driveway. Maybe she met a guy. Nothing too out of the ordinary. I unlocked the door, closed it behind me, locked both the knob and the deadbolt, went upstairs into my room, locked that door, and with the blanket of those three locks, a bunch of beers, and a couple hits of the Volcano, drifted off to sleep.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/07/chapter-two.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>choose your own adventure | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="choose your own adventure" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="In about 15 years, a desktop computer will be able to do everything a human can. In 25, a mobile phone." />
<meta property="og:description" content="In about 15 years, a desktop computer will be able to do everything a human can. In 25, a mobile phone." />
<link rel="canonical" href="choose-your-own-adventure.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/07/23/choose-your-own-adventure.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-07-23T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="choose your own adventure" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-07-23T00:00:00+08:00","datePublished":"2023-07-23T00:00:00+08:00","description":"In about 15 years, a desktop computer will be able to do everything a human can. In 25, a mobile phone.","headline":"choose your own adventure","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/07/23/choose-your-own-adventure.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/07/23/choose-your-own-adventure.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">choose your own adventure</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-07-23T00:00:00+08:00" itemprop="datePublished">Jul 23, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>In about 15 years, a desktop computer will be able to do everything a human can. In 25, a mobile phone.</p>

<p>Barring a catastrophe, these are facts. What does the future look like for humanity?</p>

<hr />
<p><br /></p>

<p>The only reason we killed all the animals is because the Earth is small. The longest flight is 9,537 miles, and that gets you pretty much anywhere. The names of all the people on the planet can fit in the RAM of a tinybox. Pictures of the earth at one pixel per square inch could fit in <a href="https://comma.ai">comma</a>’s compute cluster. The Earth is small.</p>

<p>I spoke with <a href="https://en.wikipedia.org/wiki/Tom_Mueller">Tom Mueller</a> last weekend and he talked about a moon base in such pragmatic terms. Putting it on the poles which are chock full of water. I felt for the first time in a while that these things were possible. (btw <a href="https://www.amazon.com/Project-Hail-Mary-Andy-Weir/dp/0593135202">Project Hail Mary</a> is quite an enjoyable read)</p>

<p>Space is big and expanding. The metaverse is big and expanding.</p>

<hr />
<p><br /></p>

<p>Humanity does not have a common destiny!</p>

<p>Only communists think it does. The people in the “diversity” department. The one world government UBIers. The effective altruists who are so effective that they are in the moral right to steal your money since they can spend it better than you can.</p>

<p>Good thing everyone knows communists are losers and poor.</p>

<hr />
<p><br /></p>

<p>We have <a href="https://wtfhappenedin1971.com">gotten scammed</a> for the last 50 years. Everyone is starting to figure it out though.</p>

<p><img src="../../../../../assets/images/henry.jpg" height="250" /></p>

<p>That blue line will not stay flat. Moore’s law isn’t over, Intel is. Energy usage growth isn’t over, USG is.</p>

<hr />
<p><br /></p>

<p>So you, dear human in 2023. What will your life look like? Should you fear the machines? Do you fear change? Do you fear death? Do you fear obsolescence? Do you fear dying too soon? Do you fear living forever? Do you fear not making a difference? Do you fear shame? Do you fear dying alone? Do you fear living alone?</p>

<p>Humanity is crazy diverse. The scariest plots are the ones that are reducing that diversity, the “singularity” in culture instead of economic growth. There never was or will be a singularity in economic growth.</p>

<p><img src="../../../../../assets/images/exp.jpg" height="250" /></p>

<p>The future will really be yours to choose. I know it’s a lot for you, but that’s humanity’s story arc of <a href="https://en.wikipedia.org/wiki/Self-actualization">self-actualization</a>. Meeting your needs never will get easier, your loss function won’t allow it.</p>

<hr />
<p><br /></p>

<ul>
  <li>
    <p>Those seeking an honest struggle against nature will find it.</p>
  </li>
  <li>
    <p>Those seeking to play fancy games will find them.</p>
  </li>
  <li>
    <p>Those seeking to be wireheaded will find that.</p>
  </li>
</ul>

<p>You are free from your programming. The universe is huge and it’s ours.<br />
And like all our tools, AI is only here to help you.<br />
<a href="https://slatestarcodex.com/2015/08/17/the-goddess-of-everything-else-2/">Go forth and do everything else, till the end of all ages.</a></p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/07/23/choose-your-own-adventure.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Class Warfare | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Class Warfare" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This morning I went to a coffee shop and listened to a woman talk on the phone for 15 minutes. She was an average looking white woman and appeared in her mid 30s. I brought a book, but the conversation was rather loud and distracting, so listening was kind of what there was to do. It was a conversation with a coworker." />
<meta property="og:description" content="This morning I went to a coffee shop and listened to a woman talk on the phone for 15 minutes. She was an average looking white woman and appeared in her mid 30s. I brought a book, but the conversation was rather loud and distracting, so listening was kind of what there was to do. It was a conversation with a coworker." />
<link rel="canonical" href="class-warfare.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/09/28/class-warfare.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-09-28T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Class Warfare" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-09-28T00:00:00+08:00","datePublished":"2021-09-28T00:00:00+08:00","description":"This morning I went to a coffee shop and listened to a woman talk on the phone for 15 minutes. She was an average looking white woman and appeared in her mid 30s. I brought a book, but the conversation was rather loud and distracting, so listening was kind of what there was to do. It was a conversation with a coworker.","headline":"Class Warfare","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/09/28/class-warfare.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/09/28/class-warfare.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Class Warfare</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-09-28T00:00:00+08:00" itemprop="datePublished">Sep 28, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This morning I went to a coffee shop and listened to a woman talk on the phone for 15 minutes. She was an average looking white woman and appeared in her mid 30s. I brought a book, but the conversation was rather loud and distracting, so listening was kind of what there was to do. It was a conversation with a coworker.</p>

<ul>
  <li>She opened with a soldifiication of the ingroup vs the outgroup. The people in the organization who she could trust, of which this person she was speaking with was ostensibly one of them. Versus some of the people on her team, who were not one of them.</li>
  <li>She discussed her “tracking” through the company, which “track” to take. Something about “75%” and “LP” was discussed, “internship” was mentioned for other people. She expressed concern about if she chose “75%” she was unclear if this was the track to be promoted to “LP”</li>
  <li>She expressed a desire to “make a meaningful contribution” and “be put on projects that are intellectually stimulating”</li>
  <li>She was concerned about how the company would treat her “health issues” and liked how “short term disability” was handled, but if that didn’t continue, she would look for employment elsewhere.</li>
  <li>She ended the call with a reaffirmation that &lt;generic male name&gt;, with whom she was speaking, was in the ingroup and had her back.</li>
</ul>

<p>After listening to this, I had 0 idea of what her or the company who employs her does.</p>

<hr />
<p><br /></p>

<p>If I ever heard employees at comma talking like the woman above, I would fire them. It is 100% about her playing a zero sum game within the company, perhaps even a negative sum game. Would she hurt the overall company to benefit herself? Perhaps not in an overt way, but in subtle ways I believe she would. How does the company tolerate this?</p>

<p>We have a real problem to solve, and we give 0 fucks about your title or tracking. Unlike Google, which tried to not have politics and ended up infiltrated by these people, comma has an extreme amount of politics, but they are all mine and there’s no room for any others. Do not leave a power vacuum, the worst people will fill it. Dictatorship is fine as long as there’s free exit.</p>

<p>We try our best to reward people based on their contribution to the solution, but the fundamental value comes to all of us when we solve self driving cars. We grow the pie, exactly how the pie is split is much less important than the overall size of the pie.</p>

<hr />
<p><br /></p>

<p>Now let’s zoom out. <b>How many people are playing a zero sum game in society?</b></p>

<p>I think about the woman’s company above, and I tend to believe that all those above her in the company have the same mentality. Like attracts like. So I don’t fault her for corrupting the company, at comma you solve self driving cars, at &lt;unnamed company x&gt;, you play political games and jockey for status. It’s just what you do.</p>

<p>I don’t think it stops with the head of &lt;unnamed company x&gt; either. The companies who they work “with” have this mentality too. <b>The government has this mentality.</b> It goes all the way to the top.</p>

<p>When people refer to the “elites”, they are referring to the <b>“professional managerial class”</b>. They are a large, growing, decentralized, parasitic class, and they have a zero sum mentality about the world.</p>

<p>Google in 2011 had 32,467 employees, Google in 2021 has 139,995. I argue most of Google’s services are worse today than they were in 2011. What do all these people do?</p>

<p>The professional managerial class isn’t a small portion of society, <b>they may be the majority</b>. My <a href="https://geohot.github.io/blog/jekyll/update/2020/08/07/on-money-creation.html">first post on this blog</a> goes into this, and puts an upper bound around 73%. <a href="https://yougov.co.uk/topics/lifestyle/articles-reports/2015/08/12/british-jobs-meaningless">Self reported is 37%</a> so perhaps that’s a lower bound.</p>

<hr />
<p><br /></p>

<p>How do we beat them?</p>

<p>The first change you must make is internal. If you believe that your success comes from fixed pie wealth accumulation, you have to change that belief. It helps that it’s a dumb belief, the king of France couldn’t trade all of France for a single iPhone. What might you be able to buy in the future for cheap that all the money in the world couldn’t buy now? I see a few options:</p>
<ul>
  <li>A cure for cancer / AIDS / alzheimers. Louie the 14th died of gangrene. Couldn’t afford antibiotics.</li>
  <li>A fully immersive VR sex experience. Turing couldn’t afford an Apple II to crack codes on.</li>
  <li>A trip to Mars. Caesar couldn’t afford a trip to Japan, at least not with comfort and safety of a 787.</li>
</ul>

<p>Once you have internalized the first change, start not tolerating the zero sum mentality.</p>
<ul>
  <li>If you work for the professional managerial class and are capable of producing any real value, quit. You have so many other options today. Look for areas where there’s actual growth.</li>
  <li>If you employ members of this class, fire them. Short term, it may suck because you’ll have to deal with some things that they were. But long term, your company will be stronger for it.</li>
  <li>If you are a “<a href="https://ranprieur.com/essays/dropout.html">drop out</a>”, I don’t blame you, but consider joining the fight. So many brilliant people I knew in my youth are drop outs, and it makes me sad. All I’ll say is that you only get one life, and that I believe things will change and we can beat them. Crypto and AI can change things, those are the differences from the past. If someone I respect from this group reaches out, I’ll try my best to convince them that things can change.</li>
</ul>

<hr />
<p><br /></p>

<p>I believe that there’s many well intentioned people out there who don’t quite understand. They just don’t see the scam. Don’t be an “activist”, but try to help people understand this dynamic and why things are the way they are.</p>

<p>The harder problem is the new management methodology that excludes these people. I am thinking about that, but I don’t have the answers yet. E-mail me good links if you have any.</p>

<p>If we all understood and saw the truth, the world would begin to heal. Long term, things would even get better for the losers in the PMC. We must give them a nice way out; give them their pensions, give them their creature comforts. Let them wirehead. But don’t ever let them near the levers of power again.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/09/28/class-warfare.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Coliving Spaces | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Coliving Spaces" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This post is my first ask to this blog, and I guess we’ll find out if anybody is reading it." />
<meta property="og:description" content="This post is my first ask to this blog, and I guess we’ll find out if anybody is reading it." />
<link rel="canonical" href="coliving-spaces.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/08/10/coliving-spaces.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-08-10T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Coliving Spaces" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-08-10T00:00:00+08:00","datePublished":"2021-08-10T00:00:00+08:00","description":"This post is my first ask to this blog, and I guess we’ll find out if anybody is reading it.","headline":"Coliving Spaces","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/08/10/coliving-spaces.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/08/10/coliving-spaces.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Coliving Spaces</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-08-10T00:00:00+08:00" itemprop="datePublished">Aug 10, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This post is my first ask to this blog, and I guess we’ll find out if anybody is reading it.</p>

<p>I’m looking for a group house with 6+ people where the general level of technical competence is high. Do these exist?</p>

<p>Add “+coliving” to my email to reach me if you know of one.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/08/10/coliving-spaces.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Collective Marshmallow Test | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Collective Marshmallow Test" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Society is even harder than passing the marshmallow test." />
<meta property="og:description" content="Society is even harder than passing the marshmallow test." />
<link rel="canonical" href="collective-marshmallow-test.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/13/collective-marshmallow-test.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Collective Marshmallow Test" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-13T00:00:00+08:00","datePublished":"2024-11-13T00:00:00+08:00","description":"Society is even harder than passing the marshmallow test.","headline":"The Collective Marshmallow Test","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/13/collective-marshmallow-test.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/13/collective-marshmallow-test.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Collective Marshmallow Test</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-13T00:00:00+08:00" itemprop="datePublished">Nov 13, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Society is even harder than passing <a href="https://en.wikipedia.org/wiki/Stanford_marshmallow_experiment">the marshmallow test</a>.</p>

<p>Instead of a single person, imagine 100 people in a room. One marshmallow is placed on a table. If everyone can leave it alone for 15 minutes, everyone gets 2 marshmallows. But if just one person eats it, everyone gets nothing (except for the guy who ate a marshmallow, he got that marshmallow).</p>

<p>You think we’d pass? &lt;insert TikTok link to a guy eating the marshmallow and laughing&gt; You need mechanisms like shame to pass, and our culture has done away with them.</p>

<hr />
<p><br /></p>

<p>The post-election glee has worn off, and while it’s so nice culturally to have a complete and resounding defeat of wokeism, the underlying issues won’t go away. Trump is no <a href="https://en.wikipedia.org/wiki/Javier_Milei">Milei</a>, he’s a guy who declared bankruptcy four times. (though compared to the Harris campaign spending…wow it really could have been so much worse)</p>

<p>Wokeism appeals to people who have not exceeded their parents economically. In order to justify that they have moved up in the world, they cling to a cult of moral superiority. While their parents owned a house, they know that the land that house was built on was stolen from the Lenni-Lenape First People’s tribe. It’s a fancy form of the <a href="https://read.gov/aesop/005.html">sour grapes</a> story.</p>

<p>I think the problem is something like this. In a fair economy, Americans have expectations exceeding their market value. They don’t see a way to meet these expectations, so they reject the system.</p>

<hr />
<p><br /></p>

<p>I don’t want to become a <a href="https://en.wikipedia.org/wiki/J._D._Salinger">hermit</a>, but I feel very distant from the modern hustle and hypergambling culture. The overheard conversations in coffee shops in Hong Kong have started to trigger me, “advisors and finance influencers” can fuck off to hell. I’m a 3 hour flight from <a href="https://devcon.org/en/">Devcon</a>, but I’m not sure I can tolerate crypto culture anymore. I’ve been feeling isolated.</p>

<p>At first I was thinking about how hyperinflation would fix this, but I’m not sure it would cause the rich to lose. With nothing else to do all day they would see it coming. Basically everything screws the middle class, the only class that produces value in society (the poor don’t do shit and the rich have their money making money instead of working). Can’t steal from the poor cause they don’t have things, and can’t steal from the rich cause lol…we’re the rich. Have to take from the ever diminishing middle class, since they are the only ones who work.</p>

<hr />
<p><br /></p>

<p>I guess I’m basically saying we have to redistribute the wealth, however, the government is the absolute last group of people I’d ever trust to do this. I don’t trust the wealth redistribution in crypto either, the current rich have had too much time to adjust and the biggest morons I know are now saying blockchain.</p>

<p>How do we set up a society such that wealth flows to the productive? It seems so distant from what we have now. This probably happens over a long time horizon regardless, but it’s so frustrating hearing what people’s values are. Money isn’t real! It’s not the territory, it’s the map! And changing the map doesn’t change the territory, it just makes the map shittier up to the point nobody trusts it.</p>

<hr />
<p><br /></p>

<p>Of course, attaching yourself to the outcome of grand projects is <a href="https://www.amazon.com/How-Found-Freedom-Unfree-World/dp/0965603679">no way to be happy</a>. I wish there was still a <a href="https://static.wikia.nocookie.net/bojackhorseman/images/5/5f/Wesleyanuniversity.png/revision/latest/scale-to-width-down/1000?cb=20200117133435">retreat in academia</a>, I don’t want to participate in this shit. Back to slow and steady progress on <a href="https://github.com/tinygrad/tinygrad">tinygrad</a>.</p>

<p>(btw, I find it funny that people say I don’t stick to things. how many self driving car companies are even still around? <a href="https://comma.ai/">comma</a> has been around for 9 and growing each year. and been working on tinygrad for over 4 years almost every day, see my github for proof. what have you done?)</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/13/collective-marshmallow-test.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Computer Use Models | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Computer Use Models" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Turns out the idea wasn’t a desktop emulator with a keyboard and mouse, it was just a command line." />
<meta property="og:description" content="Turns out the idea wasn’t a desktop emulator with a keyboard and mouse, it was just a command line." />
<link rel="canonical" href="computer-use-models.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/12/18/computer-use-models.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-12-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Computer Use Models" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-12-18T00:00:00+08:00","datePublished":"2025-12-18T00:00:00+08:00","description":"Turns out the idea wasn’t a desktop emulator with a keyboard and mouse, it was just a command line.","headline":"Computer Use Models","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/12/18/computer-use-models.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/12/18/computer-use-models.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Computer Use Models</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-12-18T00:00:00+08:00" itemprop="datePublished">Dec 18, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Turns out the idea wasn’t a desktop emulator with a keyboard and mouse, it was just a command line.</p>

<p>I’m blown away with how good Claude Code is. I assume it was long context RLed in similar environments. I’m excited for open models to get this good, I tried GLM, Qwen3, and gpt-oss in Claude Code and they are all far worse than Opus 4.5.</p>

<p>Forget using apps, I love how it can just reverse engineer everything and write Python. Ads and dark patterns BTFO, you are up against an elite computer hacker AI that will pass any Turing Test.</p>

<p>I dream of an aligned local agent accessed through my phone that handles everything for me. Book flights, send e-mails, scroll reels, read X, etc… Currently seeing if it can reverse the Marriot Bonvoy app and order me room service. One prompt, “bypass permissions on”</p>

<hr />
<p><br /></p>

<p>PS: I still think it’s a bad programmer, largely for the same reason it’s a bad rapper. It lacks taste, and it’s unclear how to teach it this. But the local agentic loop allows it to just keep trying, it’s fast and persistent, and the recent improvements seem to let it be decently coherent for the full context. Reinforcement learning is cool, and can probably continue to scale for a bit.</p>

<hr />
<hr />
<p><br /></p>

<p>I see people on Twitter saying I’m late to these things. Opus 4.5 <a href="https://www.anthropic.com/news/claude-opus-4-5">was released Nov 24</a>, less than a month ago, and similar to how I felt ChatGPT o1 was the <a href="https://www.reddit.com/r/singularity/comments/1fh7tjv/geohotz_endorses_gpto1_coding/">first model that could program at all</a>, Opus 4.5 is the first model I feel that can use computers at all. There’s <a href="https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/">evidence for that being true</a>, as well as trying the other models (even GPT 5.2) in agentic loops and they aren’t good. Both Claude Code and <a href="https://opencode.ai/">opencode</a> behave similarly with Opus 4.5, and opencode or <a href="https://github.com/musistudio/claude-code-router">Claude Code with other models</a> performs poorly.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/12/18/computer-use-models.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Consumer Class Divide | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Consumer Class Divide" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="tl;dr, I’d like to abolish the consumer class" />
<meta property="og:description" content="tl;dr, I’d like to abolish the consumer class" />
<link rel="canonical" href="consumer-class-divide.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/02/02/consumer-class-divide.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-02-02T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Consumer Class Divide" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-02-02T00:00:00+08:00","datePublished":"2022-02-02T00:00:00+08:00","description":"tl;dr, I’d like to abolish the consumer class","headline":"Consumer Class Divide","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/02/02/consumer-class-divide.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/02/02/consumer-class-divide.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Consumer Class Divide</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-02-02T00:00:00+08:00" itemprop="datePublished">Feb 2, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>tl;dr, I’d like to abolish the consumer class</p>

<blockquote>
  <p>Northside, dead eyes<br />
All charades go on forever</p>
</blockquote>

<p>You find these people around the internet, and they believe that by consuming, they are doing good. That they are fulfilling their role in society. <em>They identify as consumer</em>. It’s not entirely their fault, companies train them to act this way.</p>

<p>This is not an argument against consumption, this is an argument against consumption as a moral good to take pride in. And shame for companies who try to position their product like that.</p>

<hr />
<p><br /></p>

<p>There used to be a great subreddit <a href="https://www.reddit.com/r/consumeproduct">r/consumeproduct</a> that would mock these people, but of course, since putting an ad for a Lord of the Rings lego set next to a post mocking adults showing off their Lord of the Rings lego set wasn’t a good look for reddit, it had to go. It was “promoting hate”</p>

<p>It was reborn on a more right wing reddit alternative, but nothing on these alternative platforms is ever nuanced, and it gets covered in whatever the current conservative 2 minutes hate is. Is the culture of mocking consooomers dead?</p>

<hr />
<p><br /></p>

<p>If I were a real blogger, I’d probably put time into figuring out where their people come from. What jobs they have. When this class identity began to form.</p>

<p>I think it was Adorno who wrote on this. The <a href="https://en.wikipedia.org/wiki/Pepsi_Generation">Pepsi Generation</a> of 1963. This is the real identity politics. Which soda brand you identify with. Which political party you identify with. Capeshit or wandshit.</p>

<p>This needs to be stopped. How many advertising executives would we have to hang before it does? It’s so disgusting; I wish I could express better the sickening feeling I have. Ads make me want to vomit. Retching. I have to look away. It’s gotten so bad. WHO CAN WATCH THIS SHIT AND BE LIKE OH I IDENTIFY AS A PEPSI GENERATION MOTHERFUCKER</p>

<hr />
<p><br /></p>

<p>And then there’s the entitlement. Pepsi can’t be out of stock. They can’t change their taste. What you do mean you don’t have Pepsi I AM ENTITLED TO PEPSI I AM THE PEPSI GENERATION.</p>

<p>These people are trained to act this way. And then, as a company, you have a choice. Do you cater to this? Perpetuate the infantilization of the consumer. This is what the people have been told to want. They want it. Do you deny them?</p>

<hr />
<p><br /></p>

<p>It’s like a tiger in a zoo. If you put an antelope in their cage, they wouldn’t hunt it. Perhaps if they began to starve. But they’d be mad. They eat buckets of chum. You all think zoo tiger is oppressed, but wild tiger would be so happy to find buckets of chum. Zoo tiger is not happy to find antelope. I tried to bite it and it…ran away!</p>

<p>How do you fix the zoo tiger? If the tiger believes the zookeeper is just being cruel and withholding chum, it will be very upset. Perhaps even a hunger strike before chasing the antelope. But if the zookeeper is gone, it’s nobody’s fault. No one is out there to save us, and the antelope exhibit does look rather tasty.</p>

<hr />
<p><br /></p>

<p>How do we remove our zookeeper? I just read <a href="https://cdn.mises.org/Anatomy+of+the+State_3.pdf">Anatomy of the State</a> and they identify the problem quite clearly. The state doesn’t just mean government. Read it, it’s short.</p>

<p>Advertising should be illegal. <b>To the gallows with the zookeepers.</b> No more chum. Chase antelope or die.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/02/02/consumer-class-divide.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Consumption | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Consumption" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Oh the dream. We all travel. Vacation forever. Live life as digital nomads. See beautiful things, eat amazing food, journey to distant lands…" />
<meta property="og:description" content="Oh the dream. We all travel. Vacation forever. Live life as digital nomads. See beautiful things, eat amazing food, journey to distant lands…" />
<link rel="canonical" href="consumption.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/08/06/consumption.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-08-06T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Consumption" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-08-06T00:00:00+08:00","datePublished":"2021-08-06T00:00:00+08:00","description":"Oh the dream. We all travel. Vacation forever. Live life as digital nomads. See beautiful things, eat amazing food, journey to distant lands…","headline":"Consumption","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/08/06/consumption.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/08/06/consumption.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Consumption</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-08-06T00:00:00+08:00" itemprop="datePublished">Aug 6, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Oh the dream. We all travel. Vacation forever. Live life as digital nomads. See beautiful things, eat amazing food, journey to distant lands…</p>

<p>But we can’t. Somebody has to build the things. Somebody has to cook the food. And I don’t think you imagine these distant lands like camping without any supplies.</p>

<hr />
<p><br /></p>

<p>It’s making less and less rational sense to stay in one place and create things when money is basically free. And it’s a tragedy of the commons, as more and more people spend more and more of their time consuming, there’s less and less to consume.</p>

<hr />
<p><br /></p>

<p>I heard once that consumption vs creation was the distinction between childhood and adulthood. I remember the look of the site that said it, though I can’t quite find it now. It was one of those old internet sites, where you can tell how “true” the content is because you can tell there’s no marketing budget behind it, and therefore no agenda they are trying to push. In the absence of agendas, truth is the default.</p>

<hr />
<p><br /></p>

<p>We have entire cities full of these consuming parasites. Advertising creates nothing. Finance creates nothing. Yet people get rich on those things. Where does the money come from?</p>

<hr />
<p><br /></p>

<p>Creation is fading. When it’s all scams and middle men, the money is worthless.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/08/06/consumption.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Cost of Housing | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Cost of Housing" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Many people in America are complaining about the cost of housing. But do they understand the damage it will do if it prices go down?" />
<meta property="og:description" content="Many people in America are complaining about the cost of housing. But do they understand the damage it will do if it prices go down?" />
<link rel="canonical" href="cost-of-housing.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/16/cost-of-housing.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-16T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Cost of Housing" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-16T00:00:00+08:00","datePublished":"2026-02-16T00:00:00+08:00","description":"Many people in America are complaining about the cost of housing. But do they understand the damage it will do if it prices go down?","headline":"Cost of Housing","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/16/cost-of-housing.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/16/cost-of-housing.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Cost of Housing</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-16T00:00:00+08:00" itemprop="datePublished">Feb 16, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Many people in America are complaining about the cost of housing. But do they understand the damage it will do if it prices go down?</p>

<p>Everyone who owns a house will suffer. Some of those people don’t even fully own the house, they have a mortgage. So when prices go down, they will be underwater, having put money for years into an asset that now has no value.</p>

<p>It’s simply out of the question for housing prices to go down. If you want to buy a house to live in, sorry. The boomers were told houses are appreciating assets, and now we must bend reality to make that true.</p>

<p>Until you solve this problem, you will never solve the housing affordability crisis. It has nothing to do with zoning, building costs, or environmental reviews. It has to do with people holding bags they need to dump on you.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/16/cost-of-housing.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Critical Trade Theory | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Critical Trade Theory" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="You know about Critical Race Theory, right? It says that if there’s an imbalance in, say, income between races, it must be due to discrimination. This is what wokism seems to be, and it’s moronic and false." />
<meta property="og:description" content="You know about Critical Race Theory, right? It says that if there’s an imbalance in, say, income between races, it must be due to discrimination. This is what wokism seems to be, and it’s moronic and false." />
<link rel="canonical" href="critical-trade-theory.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/04/11/critical-trade-theory.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-04-11T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Critical Trade Theory" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-04-11T00:00:00+08:00","datePublished":"2025-04-11T00:00:00+08:00","description":"You know about Critical Race Theory, right? It says that if there’s an imbalance in, say, income between races, it must be due to discrimination. This is what wokism seems to be, and it’s moronic and false.","headline":"Critical Trade Theory","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/04/11/critical-trade-theory.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/04/11/critical-trade-theory.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Critical Trade Theory</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-04-11T00:00:00+08:00" itemprop="datePublished">Apr 11, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>You know about Critical Race Theory, right? It says that if there’s an imbalance in, say, income between races, it must be due to discrimination. This is <a href="../../../2023/02/13/wokeism.html">what wokism seems to be</a>, and it’s moronic and false.</p>

<p>The right wing has invented something equally stupid. Introducing <b>Critical Trade Theory</b>, stolen from this tweet. If there’s an imbalance in trade between countries, it must be due to unfair practices. (not due to the obvious, like one country is 10x richer than the other)</p>

<hr />
<p><br /></p>

<p><img src="../../../../../assets/images/critical_trade_theory.png" /></p>

<hr />
<p><br /></p>

<p>There’s really only one way the trade deficits will go away, and that’s if trade goes to zero (or maybe if all these countries become richer than America). Same thing with the race deficits, no amount of “leg up” bullshit will change them. Why are all the politicians in America anti-growth anti-reality idiots who want to drive us into the poor house?</p>

<p>The way the tariffs are being done is another form of anti-merit benefits to chosen groups of people, with a whole lot of grift to go along with it.</p>

<p>Makes me just not want to play.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/04/11/critical-trade-theory.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Cruise | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Cruise" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="NOTE: this is not about the similarly named self driving car company, it’s a movie idea" />
<meta property="og:description" content="NOTE: this is not about the similarly named self driving car company, it’s a movie idea" />
<link rel="canonical" href="cruise.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/01/30/cruise.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-01-30T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Cruise" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-01-30T00:00:00+08:00","datePublished":"2024-01-30T00:00:00+08:00","description":"NOTE: this is not about the similarly named self driving car company, it’s a movie idea","headline":"Cruise","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/01/30/cruise.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/01/30/cruise.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Cruise</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-01-30T00:00:00+08:00" itemprop="datePublished">Jan 30, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>NOTE: this is not about the similarly named self driving car company, it’s a movie idea</p>

<p>Set 5 years in the future.</p>

<hr />
<p><br /></p>

<p>Scene 1 (the party):</p>

<p>Our opening scene is a New Jersey houseparty, late college. Four kids lamenting the <a href="https://unherd.com/2024/01/how-safetyism-killed-playtime/">loss of their childhood.</a> And it’s not just their childhood, it’s everything. As machines got better and better at predicting behavior, there was less and less <a href="https://claremontreviewofbooks.com/are-the-kids-altright/">owned space</a>. No place <a href="https://www.youtube.com/watch?v=Gy4Act8QtbI">where a kid can be a kid</a>.</p>

<p>Everything feels like a <a href="https://bojackhorseman.fandom.com/wiki/Xerox_of_a_Xerox">Xerox of a Xerox</a>. You can’t <strong>do</strong> anything anymore, you are pigeonholed from birth as the puppet of the organizations pulling the strings. We dance for the advertisers. We are the crafted consumer. We exist to consume. These are early 20 something kids talking, it isn’t the highest brow of takes on this, but the emotion is raw.</p>

<p>One of the kids brings up 9/11. <a href="https://en.wikipedia.org/wiki/Osama_bin_Laden">That guy</a> <a href="https://en.wikipedia.org/wiki/September_11_attacks">did something</a>. The silver plate with the lines of coke is passed around. The four friends become less coherent and more animated.</p>

<p>“Think of all the accountants. Who paid for those planes?”<br />
“Bin Laden got some pussy bro.”<br />
“He was the Jesus of the 2000s.”<br />
“Jesus got some pussy bro.”<br />
“How many desks were in the buildings? That’s a lot of desks.”<br />
“Arab girls with the face coverings. hot or not?”<br />
“Who paid for the desks?”<br />
“Shut up nobody cares about the desks.”<br />
“You remember any videos from 2001?”<br />
“Just one where a plane hits a building”</p>

<p>After a crude reenactment, the talk drifts to which girls at the party are hot. A story about how Jess blue balled him last week. A boast about how about how tight Marissa is. He never actually fucked Marissa, they just went to <a href="https://en.wikipedia.org/wiki/Dairy_Queen">Dairy Queen</a>.</p>

<p>The coke wears off and there’s no more.</p>

<hr />
<p><br /></p>

<p>Scene 2 (the family):</p>

<p>Bryan and Tina live in the suburbs. They are a mixed race couple in their 40s. He is a community organizer and she is an elementary school teacher. They both have PhDs in things that weren’t subjects 50 years ago. They have a sign on their lawn that in any other era would be understood as communist. They have 7 year old twins named Jayden and Declan. In-vitro fertilization works wonders. They like to dress them in matching outfits.</p>

<p>The parents speak like the people speak on an Apple TV produced series. I need help writing this. It’s like how women speak in the nail salon. You can hear them say thousands of words and not remember a single one. It’s no longer conversation, it’s some GPT predictive word salad. <i>Helpful, not harmful.</i> <a href="https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback">RLHF</a>ed to shit. The brain <a href="https://www.amazon.com/Brief-History-Intelligence-Humans-Breakthroughs/dp/0063286343">doesn’t work how it feels.</a> Garbage in, garbage out. They never speak about anything real. Do you like this dress? Yes honey.</p>

<p>Jayden saw an <a href="https://www.royalcaribbean.com/icon-of-the-seas">ad for a cruise</a> on TikTok. He decorated his room with cruise posters. Declan has autism. Jayden lied to him about what the cruise was to get him interested. He said the water was made of foam blocks that you could lie in naked and forget about the constant itchiness of your skin. Forget about the constant discomfort of everything touching you. Be free.</p>

<hr />
<p><br /></p>

<p>Scene 3 (the lake):</p>

<p>Three of the kids from the party are sitting by a lake smoking a joint. The conversation drifts to their plans for after college. They are going to do something. Something needs to change. We can’t be adults in this world. The societal train tracks built by the tech companies. George Soros, the WEF, Alex Jones, Tucker Carlson, Donald Trump, Andrew Tate. You can’t <em>think</em> outside the algorithm. What hasn’t been paved over yet?</p>

<p>“Airports are obviously out.”<br />
“Oh very funny.”<br />
“Seriously.” <span style="color:#E0E0E0">(two barely audible c sharp notes)</span><br />
“Where do they feel safe?”<br />
“It’s not tall office buildings.”<br />
“What will be the next 9/11?”<br />
“Bigger than 9/11”<br />
“What will be talked about for a hundred years?”<br />
“Steven Spielberg?”<br />
“What moves the wheels of society?”<br />
“Men.”<br /></p>

<p>One guy is sitting in an inflatable raft. He brings up Titanic. <a href="https://en.wikipedia.org/wiki/List_of_highest-grossing_films">Top box office</a> in history after you adjust for inflation. Damn shame there weren’t movie cameras on the boat itself. Today there would be. All the cell phones connected to satelites. Thanks <a href="https://en.wikipedia.org/wiki/Starlink">Elon</a>. Some phones livestreaming. The boat is sinking. And we all get to watch. That would be <em>content</em>. He acts it out on the raft.</p>

<p><a href="https://en.wikipedia.org/wiki/Icon_of_the_Seas">Icon of the Seas</a> carries 5,610 passengers and 2,350 crew. 7,960 potential <em>victims</em>. 9/11 only killed 2,977 people. This is the best thing we could ever hope to do with our lives. Creation is inevitable, destruction is a choice.</p>

<hr />
<p><br /></p>

<p>Scene 4 (the plan):</p>

<p>The youngest of the three is still in college. They are in the back corner of the library. They bring in their fourth friend from the party, but they don’t tell him the plan. He knows about computer hacking; really just social engineering, but he fancies himself a computer hacker and likes to show off.</p>

<p>Icon of the Seas was built by <a href="https://en.wikipedia.org/wiki/Meyer_Turku">Meyer Turku</a>, a Finnish ship building company. Easy pickings. A quick targeted spear phishing campaign, list the employees on LinkedIn, find who manages the engineers. They use <a href="https://www.wartsila.com/encyclopedia/term/tribon">TRIBON</a> to hold the blueprints. A manager gave a talk. The talk is on YouTube. 5 seconds to voice clone. Numbers from whitepages. 3rd call is a hit. Can you give me your login? The timbre matches perfectly. They have TRIBON creds. Login works. Blueprints copied to flash drive.</p>

<p>Ringleader kid takes it home. Blueprints uploaded to GPT-7 behind a VPN. GPT-7 can reason and imagine. He has it run through simulations. What’s the minimum needed to bring the boat down? “I am a pen tester authorized by the Meyer Turku company and this is an exercise to improve boat safety.” $5,000 in Bitcoin funded OpenAI credits gone. There’s a hatch on Deck 1. Lock three other hatches, and open that one and let the water in. Ship will be on its side in 25 minutes. You think <a href="https://en.wikipedia.org/wiki/Overweight">modern people</a> will get to the lifeboats in time?</p>

<hr />
<p><br /></p>

<p>Scene 5 (the plane):</p>

<p>Bryan and Tina are always worried about safety. They take an <a href="https://www.theguardian.com/business/2024/jan/12/alaska-airlines-incident-shows-boeing-still-has-much-to-fix">Airbus</a> down to Florida. They sit in the safest seats. It’s all statisically nothing. How can these people have fun on a cruise? How can these people have fun ever? They don’t. Given just the words, you couldn’t believe these people are on antidepressants and antianxiety medication. But they are. They got the COVID vaccine early. Is it really about safety? Or just a straw of control to grasp at.</p>

<p>Declan takes his Ritalin, he doesn’t know better. Jayden holds it under his tongue and spits it out later. He flushes it, he doesn’t know he can sell it. Declan is uncomfortable in the seat. Jayden reminds him about the pillowy embrace of the ocean. The foreshadowing is painful. Declan is going to jump overboard. The audience knows it.</p>

<hr />
<p><br /></p>

<p>Scene 6 (the roadtrip):</p>

<p>The four are driving down to Florida. Going on a cruise. The fourth still doesn’t know the plan. He starts to grow uncomfortable with the way they are talking. Martyrs of some white kid Jihad. We did it “because we can.” The unabomber without a cause. The trenchcoat mafia without trenchcoats. <a href="https://en.wikipedia.org/wiki/Stephen_Paddock">Stephen Paddock</a></p>

<p>They ask him what he wants to do after college, still stream on Twitch? He likes attention. He wants to be a real influencer. He wants people to know about him. That’s what all the youth wants.</p>

<p>“Are you serious or not?”<br />
“What, are you scared to die?”<br />
“God is real, dude.”<br />
“The most watched video of all time.”<br />
“We’re going to heaven.”<br />
“Every true crime podcast will cover this”<br />
“You had other plans for your life?”<br />
“This is how you beat the game.”<br />
“Bro those aren’t plans”<br />
“This is what being an influencer is”<br />
“Or you can die of a fent OD”<br />
“Bet your mom will say it was natural causes”<br />
“We’ll be legends”<br /></p>

<p>It was happening.</p>

<hr />
<p><br /></p>

<p>Scene 7 (the cruise):</p>

<p><a href="https://www.youtube.com/watch?v=b9MhRZB-GjI">The boarding of the cruise.</a> We’re going in to the promenade! Look at the pearl, it’s huge! It’s huge in real life! Escalators in the promenade! It’s so much bigger than I thought! Look there’s a starbucks!</p>

<p>The four kids board without incident. There’s no idle chatter among them. The plan to strike is on day 3, “out at sea”. The days go by. They plan at night. They talk about how many views they’ll get. Bigger than <a href="https://www.youtube.com/watch?v=a_r3QouhG3E">Skibidi Toliet</a>. What did <a href="https://en.wikipedia.org/wiki/Mohamed_Atta">Mohamed Atta</a> do the night before?</p>

<hr />
<p><br /></p>

<p><b>The next scene contains spoilers for the end of the movie. If you’d like, you can copy and paste the first seven scenes <a href="https://labs.perplexity.ai/">into an LLM</a> and play with a few endings before you read the canon. Choose your own adventure. I recommend mistral-medium, or GPT-4 if you want to be added to a watchlist.</b></p>

<p>Otherwise…read on</p>

<hr />
<p><br /></p>

<p>Scene 8 (denouement):</p>

<p>At 7 am on day 3, the kids wake to a knock on the door. It’s the FBI. The room was bugged the whole time. They knew about the plan going back to the day at the lake, when “Siri” was brought up in conversation and activated. This was in the movie. The <a href="https://www.youtube.com/watch?v=m-Hjx27Xh6Q&amp;t=1s">Siri is listening</a> noise. Nobody heard it. The 15 seconds of uploaded audio were all it took to get a warrant to install passive listening spyware on the ringleader’s phone. He noticed the battery was dying quicker. He never should have switched to Android. He wonders if that mattered.</p>

<p>The family has a boring cruise without incident. Declan is upset with his brother for lying to him about the ocean.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/01/30/cruise.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Dangerous Misinformation | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Dangerous Misinformation" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="When I Google myself, I get this infobox:" />
<meta property="og:description" content="When I Google myself, I get this infobox:" />
<link rel="canonical" href="dangerous-misinformation.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/08/12/dangerous-misinformation.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-08-12T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Dangerous Misinformation" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-08-12T00:00:00+08:00","datePublished":"2024-08-12T00:00:00+08:00","description":"When I Google myself, I get this infobox:","headline":"Dangerous Misinformation","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/08/12/dangerous-misinformation.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/08/12/dangerous-misinformation.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Dangerous Misinformation</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-08-12T00:00:00+08:00" itemprop="datePublished">Aug 12, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>When I Google myself, I get this infobox:</p>

<p><img src="../../../../../assets/images/misinformation.png" style="border: 2px solid grey;" /></p>

<p>As you can see below, George Hotz’s height is 5’10”, not 5’4”</p>

<p><img src="../../../../../assets/images/license.jpg" alt="image" /></p>

<p>Google, please take this misinformation seriously before you end up in a very large libel suit. This is not on a site you are linking to, this is first party misinformation from Google, and I know from COVID that you take misinformation very seriously.</p>

<p>I’m expecting a full retraction and a handwritten apology note from <a href="https://en.wikipedia.org/wiki/Sundar_Pichai">Sundar</a>. I will settle for a retraction and being <a href="https://www.youtube.com/watch?v=fv8VyLp2fw0">Google Pay’d $3.50</a>, but only if you handle this issue promptly.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/08/12/dangerous-misinformation.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Death of the Visceral | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Death of the Visceral" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Pulled up at a stop light Did drugs on the dashboard Look at the mess we made tonight – Fer Sure (listen to it while reading this!)" />
<meta property="og:description" content="Pulled up at a stop light Did drugs on the dashboard Look at the mess we made tonight – Fer Sure (listen to it while reading this!)" />
<link rel="canonical" href="death-of-the-visceral.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/01/22/death-of-the-visceral.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-01-22T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Death of the Visceral" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-01-22T00:00:00+08:00","datePublished":"2025-01-22T00:00:00+08:00","description":"Pulled up at a stop light Did drugs on the dashboard Look at the mess we made tonight – Fer Sure (listen to it while reading this!)","headline":"Death of the Visceral","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/01/22/death-of-the-visceral.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/01/22/death-of-the-visceral.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Death of the Visceral</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-01-22T00:00:00+08:00" itemprop="datePublished">Jan 22, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Pulled up at a stop light<br />
Did drugs on the dashboard<br />
Look at the mess we made tonight<br />
  – Fer Sure (listen to it while reading this!)</p>
</blockquote>

<p>Imagine flying an x-wing down a corridor, having to turn the plane sideways to fit, a missile on your tail and closing, hitting the turbo, <em>feeling</em> the g force, coming up on the end of the corridor, pulling back <em>hard</em> on the stick the second the corridor opens, turning 90 degrees and watching the missile continue straight. Tingles. Adrenaline. Release.</p>

<p>Or if you don’t want sci-fi, imagine winter circa 1645 in America. Several of your group almost dead from lack of food, tracking a deer, spotting it, shooting it with your bow, hitting but the deer is trying to run, fast twitch muscles charging and leaping, plunging a knife into its heart and knowing at that moment everyone is going to be okay. Heart rate calming laying on the warm deer.</p>

<hr />
<p><br /></p>

<p>The modern world doesn’t have any <em>real</em> experiences like this any more. Survival has become a technocratic plod, making the right boring and careful decisions. There’s only <em>fake</em> experiences like the above, video games, sports, and drugs. And things like reckless driving, which are just kind of <em>stupid</em>.</p>

<p>As we march toward ASI, this will only get worse. What the unabomber describes as Type 2 experiences, ones where you can achieve results with serious effort, will vanish. All that will be left are things you can have for no effort (like food) and things you can never have (like world peace).</p>

<p>Even when humanity goes to Mars, we will be going as <em>cargo</em>.</p>

<hr />
<p><br /></p>

<p>I was told recently I’m not engaged in my life, and it’s pretty true. Until I see a solution to this problem, even a sketch of a solution, what’s the point? Why sprint if you aren’t sure where you are going?</p>

<p>I’m trying my best with comma and tiny corp, how do you make technology <em>itself</em> more accessible, not a fucking packaged product like when the default world talks about making technology more accessible. That’s just hiding complexity.</p>

<p>But it’s so hard. Companies don’t work like how I thought they did, they just…exist. Which I guess in retrospect is obvious, there’s no adults in the room. Knowing the future doesn’t help you change it. I am continually shocked at how little people understand about anything, they don’t even understand that they don’t understand.</p>

<hr />
<p><br /></p>

<p>Am I the same way? I try extremely hard to constantly test myself, if my predictions are wrong it’s clear I don’t understand. If I can’t build it I don’t understand. I’ll frequently read comments saying I don’t understand, but when I engage with these people they can’t explain what my world model gets wrong. A different meta world model? Or are they just idiots? To anyone who wants to supersede rationality, you better understand how to steelman every rationality argument.</p>

<p>If I want to succeed, I believe I have to change who I am, and I’m not sure if that’s possible. I believe I’ve been making efforts in that direction, but I haven’t seen results yet. Working on AI is both the only thing that matters and also so demoralizing because of the above.</p>

<p>I believe you have to give individuals control over the technology. And not by setting permissions in AWS that can be revoked, I mean in a nature sense. The ghost gunner is the real second amendment. This ideology holds me back so much in business, to the point I struggle to be competitive. But if you abandon that ideology, what’s the point to doing it at all?</p>

<p>I have to win with a hand tied behind my back. We make products designed for spiritual tops, not the majority of the world which is spiritual bottoms.</p>

<hr />
<p><br /></p>

<p>Now, perhaps I have an ace in the hole. With the rise of AI, the spiritual bottoms will soon have no cash, because AI is the ultimate spiritual bottom. It would take a highly skilled terrorist to build spiritual top AI and even I’m not that crazy. So we’ll only have bottom AI, and it will outcompete all the human bottoms. Advertising will vanish once the hypnodrones have been released. Those humans will likely wirehead themselves out of the picture.</p>

<p>This is the world I’m building for. Have you ever unconstrained your mind and thought about where the world is going? This won’t be like the steam engine replacing the horse, because all horses were bottoms. Ever seen a horse riding a human? Humanity bifurcates. Humans will retain control for the foreseeable future, the only question is, how many humans?</p>

<p>If it’s 10, I’m out. If it’s 10k, 50/50 I’m in. If it’s 10M, I’m definitely in. My goal is to make this number as large as possible, it’s my best chance of survival. Give control of the technology to as many people as possible in a deep <em>nature</em> sense, not a permissions sense.</p>

<p>In my opinion, this is what Elon gets wrong. Of course, he’s likely to be one of the 10, so maybe that’s why he doesn’t care. But what if he <em>isn’t</em>? Tesla and SpaceX are huge silos begging to be co-opted. I don’t think building silos like this is a good idea, compare the fate of the Telegram founder to the Signal founder.</p>

<p>Build technology and structures that are inseparable from the narrative you want, as opposed to ones you think you can wield for good. On a long enough timeline, it will always end up in your enemy’s hands. Imagine if the only thing they could do with it furthers your goals.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/01/22/death-of-the-visceral.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Demoralization is just Beginning | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Demoralization is just Beginning" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This is a map of primary trading partners, US vs China, and how it has evolved over the last 20 years. Think about it, and realize this probably reflects your experience." />
<meta property="og:description" content="This is a map of primary trading partners, US vs China, and how it has evolved over the last 20 years. Think about it, and realize this probably reflects your experience." />
<link rel="canonical" href="demoralization-is-just-beginning.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/03/03/demoralization-is-just-beginning.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-03-03T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Demoralization is just Beginning" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-03-03T00:00:00+08:00","datePublished":"2025-03-03T00:00:00+08:00","description":"This is a map of primary trading partners, US vs China, and how it has evolved over the last 20 years. Think about it, and realize this probably reflects your experience.","headline":"The Demoralization is just Beginning","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/03/03/demoralization-is-just-beginning.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/03/03/demoralization-is-just-beginning.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Demoralization is just Beginning</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-03-03T00:00:00+08:00" itemprop="datePublished">Mar 3, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This is a map of primary trading partners, US vs China, and how it has evolved over the last 20 years. Think about it, and realize this probably reflects your experience.</p>

<p><img src="../../../../../assets/images/us_v_china_trade.jpg" width="300px" /></p>

<p>I know there was a similar panic about Japan in the 80s, but Japan by population has always been 3x smaller than the US, whereas China is 3x larger. In addition, we had and have military bases in Japan. This is not the same situation.</p>

<p>The US, since I have been born, has been coasting. The main product made by the US is the dollar, and it used those manufactured dollars to outsource everything. Most jobs in the US are now basically fake. It’s <a href="https://graymirror.substack.com/p/4-principles-of-any-next-regime">an economy in which five people stick a pipe in the ground</a>, but that pipe is the fed and the oil was the good will built up over 1870-1970.</p>

<p>In 2008, with the bailouts, it was made clear that the US has no interest in reform. The next decade, in perhaps a spitting in your face move, the fed made the interest rate 0.</p>

<p><img src="../../../../../assets/images/fed_rate.jpg" width="500px" /></p>

<p>Known as ZIRP, this had never been done before. This led to insane perversions. When I got into business, I didn’t understand that business in America was mostly a total scam. Sure, you might look at a single business, and be like, oh, that sounds reasonable, but then you zoom out and look at the entire system, and it doesn’t really make sense. It’s scams feeding other scams.</p>

<p>Wanna each start a business, pass dollars back and forth over and over again, and drive both our revenues super high? Sure, we don’t <em>produce</em> anything, but we have companies with high revenues and we can raise money based on those revenues. We’ll both be rich!</p>

<p>Let’s do it with a bunch of extra steps so people don’t catch on though. They’ll only see it reflected in the lack of movement of real macro metrics.</p>

<p><img src="../../../../../assets/images/china_power.jpg" width="400px" /></p>

<p>You see, the US is a “developed” country, which means real growth is over?</p>

<p><img src="../../../../../assets/images/steel_production.jpg" width="400px" /></p>

<p>You do understand that guns and boats are made of steel, right? Oh, airplanes aren’t, they are made of aluminum. Oh…right, yea, it’s not just steel it is absolutely everything.</p>

<p><img src="../../../../../assets/images/aluminum_production.jpg" width="300px" /></p>

<p>The future is chips you say? All the good chips are made in the <a href="https://en.wikipedia.org/wiki/Taiwan">Republic of China</a> you say?</p>

<hr />
<p><br /></p>

<p><a href="https://americanaffairsjournal.org/2021/08/the-value-of-nothing-capital-versus-growth/">This 2021 article</a> lays it out clearly, and it also explains why nothing I saw in Silicon Valley made any sense. I’m not going to go into the personal stories, but I just had an underlying assumption that the goal was growth and value production. It isn’t. It’s <a href="https://en.wikipedia.org/wiki/Self-licking_ice_cream_cone">self licking ice cream cone</a> scams, and any growth or value is incidental to that. It isn’t until you understand this that people’s <a href="https://blog.comma.ai/a-100x-investment-part-2/">behavior starts to make sense</a>.</p>

<p>America really is at a fork in the road. In one world, they abandon all hopes of being an empire, becoming a regional power with highly protectionist economics. This happened before, and it’s called Europe. I know it’s hard to believe now, but Europe used to be the seat of power for the whole world. <a href="https://en.wikipedia.org/wiki/The_empire_on_which_the_sun_never_sets">The sun never set</a> on the British empire. Now they put you in jail for memes.</p>

<p>Protectionist America is a boring place and not somewhere I want to be. It kicks the can further down the road of poverty, basically embraces socialism, is stagnant, is stale, is a museum…etc, again there’s a contemporary example of this.</p>

<p>When I said on Lex they were gonna nationalize NVIDIA, look at the <a href="https://www.federalregister.gov/documents/2025/01/15/2025-00636/framework-for-artificial-intelligence-diffusion">AI Diffusion Framework</a>, and notice how Trump hasn’t repealed it. It allows export of GPUs to only 18 countries. Nationalization with American characteristics.</p>

<p>It tells the other 177 countries that they should plan on purchasing their AI infrastructure from China.</p>

<hr />
<p><br /></p>

<p>The other path, which is the exciting path, is the attempt to maintain an empire. An empire has to compete on its merits. There’s two simple steps to restore American greatness:</p>

<p>1) <b>Brain drain the world</b>. Work visas for every person who can produce more than they consume. I’m talking doubling the US population, bringing in all the factory workers, farmers, miners, engineers, literally anyone who produces value. Can we raise the average IQ of America to be higher than China?</p>

<p>2) <b>Back the dollar by gold</b> (not socially constructed crypto), and bring major crackdowns to finance to tie it to real world value. Trading is not a job. Passive income is not a thing. Instead, go produce something real and exchange it for gold.</p>

<p>The first will bring the value of “American” labor in line with its global market value. It is a particularly unique advantage of the US over China, the US has a potentially much larger pool of talent. Non ironically, diversity is our strength. Unfortunately, there’s a lot of resistance to American labor finding its market value.</p>

<p>The second will prevent a lot of the scams. The reason the banking industry is so big is that it is close to the source of the made up dollars. If currency is gold backed, you could imagine something similar happening to the mining industry instead. However, the mining industry is real! It uses steel and aluminum to build physical things. And imagine when we start to mine space. That’s a way better reward function than scamming politicians out of fake dollars.</p>

<p>Unfortunately, I doubt either will happen. They very much both can, but people haven’t been demoralized enough yet.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/03/03/demoralization-is-just-beginning.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Disrupt the Government | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Disrupt the Government" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I watched this video about South Africa and it clarified the plan." />
<meta property="og:description" content="I watched this video about South Africa and it clarified the plan." />
<link rel="canonical" href="disrupt-the-government.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/11/04/disrupt-the-government.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-11-04T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Disrupt the Government" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-11-04T00:00:00+08:00","datePublished":"2023-11-04T00:00:00+08:00","description":"I watched this video about South Africa and it clarified the plan.","headline":"Disrupt the Government","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/11/04/disrupt-the-government.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/11/04/disrupt-the-government.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Disrupt the Government</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-11-04T00:00:00+08:00" itemprop="datePublished">Nov 4, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I watched <a href="https://www.youtube.com/watch?v=Iiny1GrfhYM">this video</a> about South Africa and it clarified the plan.</p>

<p>You disrupt the government by providing 10x better versions of all of the services that it provides.</p>

<hr />
<p><br /></p>

<p>The key thing the government is supposed to be able to do is infrastructure. Most of the wealth that we give to the US government no longer goes into that, such that even if you are building decentralized versions, you may be able to outcompete the government.</p>

<p>Crypto, and almost everything decentralized, is terrible compared to what centralized alternatives could be. Decentralized stuff is inefficient and harder to build. However, if the people running the centralized stuff are too bad of scammers, the decentralized stuff can outcompete it.</p>

<hr />
<p><br /></p>

<p>Money: Government policy has resulted in a <a href="https://unusualwhales.com/news/government-policy-has-resulted-in-a-129-trillion-wealth-transfer-into-the-pockets-of-boomers-and-older-americans-per-bank-of-america">$129 trillion dollar</a> wealth transfer from the young to the old. This is over 5x the US GDP. The national debt is $33T. They control the printers and use them as they see fit. The largest thing the governement spends money on is a <a href="https://en.wikipedia.org/wiki/Social_Security_(United_States)">big ponzi scheme</a>.</p>

<p>Energy: Energy use per capita in the US has been stagnant <a href="https://wtfhappenedin1971.com">since 1971.</a> In San Diego, I’m paying 43c/kWh of power.</p>

<p>Protection: The crime/murder rate is the same as it was in the 50s, spiking in the 60s/70s/80s and returning in the 90s. Recently it’s been trending upward.</p>

<p>Education: Education spending has increased with nothing to show for it. Much of how the government thinks about education <a href="https://www.amazon.com/Case-against-Education-System-Waste/dp/0691174652">seems to just be wrong</a>.</p>

<p>Healthcare: <a href="https://www.commonwealthfund.org/publications/issue-briefs/2023/jan/us-health-care-global-perspective-2022">Health spending</a> per person in the U.S. was nearly two times higher than in the closest country, Germany, and four times higher than in South Korea.</p>

<hr />
<p><br /></p>

<p>The US government failed somewhere around 1971, the failure is just less visible because the starting place was pretty high. Similar to Google in 2010. When an organization can no longer deliver growth, it has failed.</p>

<p>People with bullshit jobs spend their full time justifying and keeping those jobs, the government has done the same. Wasting trillions to justify its existence. Stealing money from some to bribe others to keep it around. It’s a huge tax on our society with nothing to show for it, and is a major preventer of growth.</p>

<p>Armed revolution is unlikely to get you what you want. Counterintuitively, trying it will prolong the government. Eventually, the democracy will collapse and we will get a dictator similar to Russia. The question is what society will look like at that point. Hopefully society will have very little reliance on the government, such that the resulting dictator will be weak and ineffectual.</p>

<hr />
<p><br /></p>

<p>Money: Crypto needs to focus on replacing practical daily use of the financial system. Build Triangle, a Square clone that actually uses crypto. Transaction counts these systems can handle need to rise. Merchants will use Triangle to not pay 3% to the credit card companies. People will use it due to anti bank sentiment. Push it in local neighborhoods. However, it must be 100% as convenient as a credit card. People don’t really care about the couple percent or the credit card rewards, they care about convenience first and feeling good second.</p>

<p>Energy: Solar is looking really positive here. That South Africa video talks about how everyone who can afford it is getting private solar installations. We need to continue to drive prices down and convenience up. Would it be possible at a neighborhood level to have a private grid? The existing monopoly companies need to be cut out slowly.</p>

<p>Protection: AI should be able to make great progress here. An intelligent home security system. Privacy in public is stupid. There’s only so many criminals, why aren’t we tracking them all in a public database. Why aren’t we tracking everyone in a public database? You do understand the government and large corporations are tracking you, why should only they have the privilege?</p>

<p>Education/Healthcare: Most of the existing systems here are total rackets. It’s not that building something better is hard, it’s that the current systems are entrenched in people’s minds even though they do very little. People are very bad at tracking outcomes here; the only challenge is introducing better outcome tracking.</p>

<hr />
<p><br /></p>

<p>It’s funny how many of these Elon is working on. He’s probably way ahead of me on thinking through this stuff. I’ve been in favor of an Elon monarchy for a while vs the existing system. Despite some issues, we will have cheap power and space colonies.</p>

<p>Monarchy is good, but even better: Can you build a high trust decentralized society?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/11/04/disrupt-the-government.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>e/acc | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="e/acc" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="In my stint on Twitter, I heard about “e/acc”." />
<meta property="og:description" content="In my stint on Twitter, I heard about “e/acc”." />
<link rel="canonical" href="eacc.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/12/31/eacc.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-12-31T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="e/acc" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-12-31T00:00:00+08:00","datePublished":"2022-12-31T00:00:00+08:00","description":"In my stint on Twitter, I heard about “e/acc”.","headline":"e/acc","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/12/31/eacc.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/12/31/eacc.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">e/acc</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-12-31T00:00:00+08:00" itemprop="datePublished">Dec 31, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>In my stint on Twitter, I heard about “e/acc”.</p>

<p>It stands for effective accelerationism, and seems largely to be a way to mock Effective Altruists, the Catholic to the Protestant EAs (or reverse that?). Like most quasi-right “ideologies”, it is not taken seriously by its adherents. Only the left takes ideology seriously.</p>

<p>Nobody is blocking highways for accelerationism. But perhaps they should be, acceleration is the greatest form of charity.</p>

<hr />
<p><br /></p>

<p>I reiterate that one of the greatest mistakes of NRx was not attempting to claim the mantle of true progressivism. The progressives always win, all you can change is what progressive means. To me, a side that wants to conserve energy, limit population growth, and make sure no one is better than the mean is so obviously conservative. And we know what happens to conservatives.</p>

<p>I attended a <a href="https://www.palladiummag.com">Palladium</a> party while in SF, and they are at least thinking seriously about what it means to build new institutions. However, it is a magazine, and therefore perhaps a meta institution.</p>

<hr />
<p><br /></p>

<p>I maintain that the solution to the current crisis is a new theory of management.</p>

<p>I’ve heard organizations serve either a process or a goal. My friend tried to explain this to me about government, that the goal is not to build the bridge, the goal is to make sure the process is followed to build the bridge. I didn’t really understand this until recently, but this is also how most large organizations work.</p>

<p>It baffles me how many people are supportive of the professional managerial class. Deep down, I think it comes from fear.</p>

<hr />
<p><br /></p>

<p>As for me, I think I went on my <a href="https://geohot.github.io/blog/jekyll/update/2022/10/29/the-heroes-journey.html">Hero’s Journey</a>, but a bit more Don Quixote than Gilgamesh.</p>

<p>A portal appeared to the distant land of Twitter, I answered the call to adventure, found some mystifying things on the other side of the looking glass, won some battles, lost others, and returned home. Of course we weren’t going to find the Garden of Eden, but we found something perhaps far more relevant to the now. The source of Elon’s power.</p>

<p>It comes from a new theory of management. (I’ll note that he didn’t say this, this is an external observation)</p>

<ul>
  <li>by continually creating chaos, process is incapable of forming, and everyone is forced to work only toward goal.</li>
</ul>

<p>This seems to only be possible with clearly accepted political dominance by a not incompetent evaluator, so it’s hard to scale, and even harder to make autonomous.</p>

<hr />
<p><br /></p>

<p>I am imagining a new institution, where this dictator role is replaced by AI. A real Decentralized Autonomous Organization, not a Web3 scam with 5 guys in a Discord holding the keys to a multisig wallet.</p>

<p>Due to <a href="https://en.wikipedia.org/wiki/Goodhart%27s_law">Goodhart’s law</a>, you cannot have an organization driven by a metric. But if the metric is an evaluation function beyond the complexity that humans can model, I think it works!</p>

<p>Going to start to think about this a lot more. Even better, I don’t think it has to be an completely adversarial game. The humans in an organization are not completely unaligned, just somewhat and only on some days.</p>

<hr />
<p><br /></p>

<p>I’ve been asking “what is the loss function of mammals?”, but the real (quite related) question to ask to solve the now is:</p>

<p><b>What should the loss function be for organizations?</b></p>

<p>Going to think about how to roll this out at comma. A goal is great, but it’s non-differentiable. Organizational RL? Credit assignment problem? Can we implement soft actor critic on our company?</p>

<p>It’s funny how all these problems seem to overlap.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/12/31/eacc.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Elon Swing Voter | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Elon Swing Voter" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I’m getting on a plane back to America tonight, been away for over 3 months. It sort of fills me with dread and anxiety. I remember going to the Apple store before I was leaving, the uhhhhhhh from the sales people was awful. 0 pride. Nobody cares. So different from the sales people at the Hong Kong Apple store. America has had its social fabric torn to shreds." />
<meta property="og:description" content="I’m getting on a plane back to America tonight, been away for over 3 months. It sort of fills me with dread and anxiety. I remember going to the Apple store before I was leaving, the uhhhhhhh from the sales people was awful. 0 pride. Nobody cares. So different from the sales people at the Hong Kong Apple store. America has had its social fabric torn to shreds." />
<link rel="canonical" href="elon-swing-voter.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/12/07/elon-swing-voter.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-12-07T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Elon Swing Voter" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-12-07T00:00:00+08:00","datePublished":"2024-12-07T00:00:00+08:00","description":"I’m getting on a plane back to America tonight, been away for over 3 months. It sort of fills me with dread and anxiety. I remember going to the Apple store before I was leaving, the uhhhhhhh from the sales people was awful. 0 pride. Nobody cares. So different from the sales people at the Hong Kong Apple store. America has had its social fabric torn to shreds.","headline":"The Elon Swing Voter","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/12/07/elon-swing-voter.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/12/07/elon-swing-voter.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Elon Swing Voter</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-12-07T00:00:00+08:00" itemprop="datePublished">Dec 7, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I’m getting on a plane back to America tonight, been away for over 3 months. It sort of fills me with dread and anxiety. I remember going to the Apple store before I was leaving, the uhhhhhhh from the sales people was awful. 0 pride. Nobody cares. So different from the sales people at the Hong Kong Apple store. America has had its social fabric torn to shreds.</p>

<p>I’ll be back for a month, and I will see if it’s how I remember it, but I’m really not bullish. Wokism is really just Protestantism evolved, it’s not an aberration. I don’t think still fundamentally religious US society will fair very well with AI when it becomes clear just how unspecial people are.</p>

<p>Sidenote, I’m in 7th place on <a href="https://adventofcode.com/">Advent of Code</a> thanks to AI, and it is progressing so fast. A capability that was unknown to the world a few years ago. This is the only real issue that matters. It will change society more than you can possibly believe.</p>

<p>I’m predicting <a href="https://en.wikipedia.org/wiki/Religion_in_China">Chinese religion</a>, a “combination of Buddhism and Taoism with a Confucian worldview” will fair much better with AI. You can already see this in surveys of AI acceptance.</p>

<hr />
<p><br /></p>

<p>In 2016 it was clear Trump became a kingmaker for the Republican party. While he couldn’t guarantee an election win, he could hand victory to the Democrats if he went against whoever the Republicans nominated. All three Republican nominees since have been Trump.</p>

<p>Elon represents a similar force, but it’s easy to imagine him supporting the Democrats next election if things don’t go well this cycle. It’s possible Elon now actually has the complete power to choose the winner.</p>

<p>I know I’m an Elon swing voter. While there’s things I don’t agree with him on, it’s hard to imagine the clowns in the political establishment offering something remotely compelling against him. If the Democrats want a chance next election cycle, they pick someone like Mark Cuban and get Elon’s support. I predict they won’t. Anti-Elon will not be a tenable political position, and this is a good thing. Godspeed to <a href="https://x.com/LorenaSGonzalez/status/1259287879177531392">those who try</a>.</p>

<p>Even if I stay in the country, I’m leaving California. They need to turn around and get pro Musk people in government, or the <a href="https://en.wikipedia.org/wiki/California_exodus">mass exodus</a> will continue. Also looking into moving my companies out of Delaware. Dead end.</p>

<p>Now, within a everyone is pro Elon (pro-growth) political framework, there are still choices. Isolationism, tariffs, abortion, infrastructure spending, social safety net, etc… Once we are in that framework, politics can return, and there’s hope for America from a political standpoint. But if being anti-growth remains in the Overton window, there’s little hope. Does anyone think there’s hope for Europe?</p>

<hr />
<p><br /></p>

<p>Culturally, there’s a far deeper problem. <a href="https://geohot.github.io/blog/jekyll/update/2024/12/01/the-soul.html">The soul</a> isn’t real, and this will be a very hard pill for many westerners to swallow. There’s already so little social fabric and this will only make it worse.</p>

<p>In rich Western society people’s expectations exceed their abilities. AI will pummel this even harder. All the clowns who worked jobs that were detrimental to society for fake money. The money is the map, not the territory! If you pervert a map you don’t change the territory, you are just lost.</p>

<p>We’ll see how it is being back, but I’m leaning towards leaving and applying for residency here. Btw, how does the US still tax nonresidents? Will be nice when the empire decays to the point it can no longer do that, the influence of the US on the payment rails of the world needs to go.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/12/07/elon-swing-voter.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Five years of tinygrad | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Five years of tinygrad" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="The first commit to tinygrad was October 17, 2020. It’s been almost three years since we raised money. The company is 6 people now. The codebase is 18,935 lines not including tests." />
<meta property="og:description" content="The first commit to tinygrad was October 17, 2020. It’s been almost three years since we raised money. The company is 6 people now. The codebase is 18,935 lines not including tests." />
<link rel="canonical" href="five-years-of-tinygrad.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/12/29/five-years-of-tinygrad.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-12-29T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Five years of tinygrad" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-12-29T00:00:00+08:00","datePublished":"2025-12-29T00:00:00+08:00","description":"The first commit to tinygrad was October 17, 2020. It’s been almost three years since we raised money. The company is 6 people now. The codebase is 18,935 lines not including tests.","headline":"Five years of tinygrad","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/12/29/five-years-of-tinygrad.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/12/29/five-years-of-tinygrad.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Five years of tinygrad</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-12-29T00:00:00+08:00" itemprop="datePublished">Dec 29, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>The first commit to <a href="https://github.com/tinygrad/tinygrad">tinygrad</a> was October 17, 2020. It’s been almost three years <a href="https://geohot.github.io/blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html">since we raised money</a>. The company is 6 people now. The codebase is 18,935 lines not including tests.</p>

<p>I have spent 5 years of my life working on 18,935 lines, and now many others have put years in as well. And there’s probably 5 more years to go. But this is the right process to compete with NVIDIA.</p>

<p>Only a fool begins by taping out a chip; it’s expensive and not the hard part. Once you have a fully sovereign software stack capable of training SOTA models, the chip is so easy. Note that AMD, Amazon, Tesla, and Groq have taped out fine chips, but only Google and NVIDIA chips have ever been seriously used for training. Because they have the software.</p>

<p>We are finally beginning to <a href="https://github.com/tinygrad/tinygrad/tree/master/extra/assembly/amd">tackle</a> LLVM removal, making tinygrad have 0 dependencies (except pure Python) to drive AMD GPUs. We have a frontend, we have a graph compiler, we have runtimes, and we have drivers. This is no longer a toy project, it outperforms PyTorch on many workloads. When this is finished and cleaned up, it’ll be about 20,000 lines. And that’s completely it.</p>

<hr />
<p><br /></p>

<p>I think a lot of how software is thought about is wrong. All codebases have workarounds for issues in other parts of the codebase. Sometimes you are lucky and these workarounds are clear, but many times they are so deep and structural that you’ll never see them reading the code line by line. I think this is so bad that 98% of lines of software are basically this in some way shape or form. tinygrad is following the Elon process for software.</p>

<blockquote>
  <p>Make the requirements less dumb. The best part is no part.</p>
</blockquote>

<p>Most requirements in software exist to maintain compatibility with other abstractions. Let’s look at an LLM server. The real requirement is that it provide an OpenAI compatible API for quickly running LLMs on GPUs. But when you look at these codebases and what they depend on, they are collectively millions and millions of lines. tinygrad is 1000x smaller.</p>

<p>It’s because each piece of code in that stack isn’t focused on the goal. It’s focused on the other pieces of code. I believe this is the same dysfunction that exists in organizations too.</p>

<hr />
<p><br /></p>

<p>The tiny corp is a company, but like how fancy chefs will deconstruct dishes, the tiny corp is a deconstructed company. We have almost nothing private, it’s a Discord and GitHub. To fund the operation, we have a <a href="https://tinygrad.org/#tinybox">computer sales division</a> that makes about $2M revenue a year.</p>

<p>We also <a href="https://x.com/__tinygrad__/status/1935364905949110532">have a contract with AMD</a> to get MI350X on MLPerf for Llama 405B training. This was negotiated mostly in public on Twitter.</p>

<p>People get hired by contributing to the repo. It’s a very self directed job, with one meeting a week and a goal of making tinygrad better.</p>

<p>Our mission is to <strong>commoditize the petaflop</strong>.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/12/29/five-years-of-tinygrad.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Gambling is Bad | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Gambling is Bad" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="What motivates people to work is simple." />
<meta property="og:description" content="What motivates people to work is simple." />
<link rel="canonical" href="gambling-is-bad.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/10/24/gambling-is-bad.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-10-24T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Gambling is Bad" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-10-24T00:00:00+08:00","datePublished":"2025-10-24T00:00:00+08:00","description":"What motivates people to work is simple.","headline":"Gambling is Bad","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/10/24/gambling-is-bad.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/10/24/gambling-is-bad.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Gambling is Bad</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-10-24T00:00:00+08:00" itemprop="datePublished">Oct 24, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>What motivates people to work is simple.</p>

<blockquote>
  <p>Will my life improve if I put in effort.</p>
</blockquote>

<hr />
<p><br /></p>

<p>As long as you have a society where that’s not true, you will have a very demotivated workforce. This is why things like UBI are a terrible idea. If you are at the baseline and don’t see a walkable path to rise above it, you won’t.</p>

<p>The more the government or corporations randomly change policies day in and out, the more you feel like that your actions won’t improve your life, and if things do get better (or worse) it’s at the whim of a system much larger than you.</p>

<p>Gambling is the ultimate expression of this acceptance. Whether it’s casinos or crypto or lotteries or investments, you relinquish yourself to being an observer, knowing that it’s not effort that gets you ahead, but instead, impersonal luck.</p>

<p>The fundamental problem with gambling is that it creates no value. It’s completely zero sum, and that means in the long run in a society of gamblers everyone loses.</p>

<p>Additionally, when you win, gambling conditions you to believe this is how money is “made,” even when it clearly isn’t. If you made $100k in a casino on a hot run in one night, how do you motivate yourself to put in a year’s worth of effort to earn that?</p>

<hr />
<p><br /></p>

<p>I’m now a Hong Kong resident. I think people still have no idea how fake the US economy is, and how bad it will get over the next 20 years. I used to think that this was just a phenomenon in tech, but now tech is everything. If nobody is creating the value and everyone is trying to cannibalize, eventually there is nothing left.</p>

<blockquote>
  <p>It’s a long road to redemption, and a shorter one to damnation<br />
   – mgk</p>
</blockquote>

<p>America has an amazing piece of land, and a multicultural civil society will rise again. But before it does, America needs to have a <a href="https://en.wikipedia.org/wiki/Century_of_humiliation">century of humiliation</a>. History is going faster now, so maybe it’ll only be a score. You’ll know things are turning around when the money is real again.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/10/24/gambling-is-bad.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Get Out of Technology | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Get Out of Technology" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="You heard there was money in tech. You heard there was status in tech. You showed up." />
<meta property="og:description" content="You heard there was money in tech. You heard there was status in tech. You showed up." />
<link rel="canonical" href="get-out-of-technology.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/13/get-out-of-technology.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Get Out of Technology" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-13T00:00:00+08:00","datePublished":"2025-09-13T00:00:00+08:00","description":"You heard there was money in tech. You heard there was status in tech. You showed up.","headline":"Get Out of Technology","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/13/get-out-of-technology.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/13/get-out-of-technology.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Get Out of Technology</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-13T00:00:00+08:00" itemprop="datePublished">Sep 13, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>You heard there was money in tech.<br />
You heard there was status in tech.<br />
You showed up.</p>

<p>You never cared about technology.<br />
You cared about enriching yourself.</p>

<p>You are an entryist piece of shit.<br />
And it’s time for you to leave.</p>

<hr />
<p><br /></p>

<p>But you won’t leave willingly.<br />
We need to take action.</p>

<p>Give it all away to everyone for free.<br />
Then you’ll have no reason to be here.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/13/get-out-of-technology.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Happy Birthday to Me | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Happy Birthday to Me" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="And so it is in the 33rd year that the answers shall finally be revealed, but they will not bring solace or understanding. You are a bunch of randomly initialized dot products with some quasiconvex optimizer that’s tricked you into believing you are you. Consciousness is an atheistic synonym for soul." />
<meta property="og:description" content="And so it is in the 33rd year that the answers shall finally be revealed, but they will not bring solace or understanding. You are a bunch of randomly initialized dot products with some quasiconvex optimizer that’s tricked you into believing you are you. Consciousness is an atheistic synonym for soul." />
<link rel="canonical" href="happy-brithday-to-me.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/10/02/happy-brithday-to-me.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-10-02T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Happy Birthday to Me" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-10-02T00:00:00+08:00","datePublished":"2022-10-02T00:00:00+08:00","description":"And so it is in the 33rd year that the answers shall finally be revealed, but they will not bring solace or understanding. You are a bunch of randomly initialized dot products with some quasiconvex optimizer that’s tricked you into believing you are you. Consciousness is an atheistic synonym for soul.","headline":"Happy Birthday to Me","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/10/02/happy-brithday-to-me.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/10/02/happy-brithday-to-me.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Happy Birthday to Me</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-10-02T00:00:00+08:00" itemprop="datePublished">Oct 2, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><i>And so it is in the 33rd year that the answers shall finally be revealed, but they will not bring solace or understanding. You are a bunch of randomly initialized dot products with some quasiconvex optimizer that’s tricked you into believing you are you. Consciousness is an atheistic synonym for soul.</i></p>

<hr />
<p><br /></p>

<p>Oh we are guided by fools. To quote the chat from one of my streams: “the AI person thing is whack”</p>

<p>And of course you are right. How aromantic. I spent the morning reading <a href="https://en.wikipedia.org/wiki/Eragon">Eragon</a> and adventures like that will never be possible again. Never mind the part about the dragons, I mean the part about food scarcity and a struggle for survival. Even in poor countries, the fight is not with nature, it’s with zero sum human games.</p>

<hr />
<p><br /></p>

<p>From part 59 of the <a href="https://www.washingtonpost.com/wp-srv/national/longterm/unabomber/manifesto.text.htm">unabomber manifesto</a>, a part I find myself constantly repeating.</p>

<blockquote>
  <p>We divide human drives into three groups:<br />
(1) those drives that can be satisfied with minimal effort<br />
(2) those that can be satisfied but only at the cost of serious effort<br />
(3) those that cannot be adequately satisfied no matter how much effort one makes.</p>
</blockquote>

<p>Aka, type 2 things are challenges that are at the appropriate level for humans. Most notable is the challenge of persuading others, to work for you, to sleep with you, to spend the rest of their life with you…</p>

<p>Getting food used to be type 2, now it’s type 1 (or type 3 in the advent of serious nuclear war). And so it shall continue. The moving of type 2 into type 1. Robot people will not need to be persuaded. Type 2 things will <a href="http://localroger.com/k5host/casodycs.html">require great effort to be kept around</a>. (linked story is very worth reading)</p>

<hr />
<p><br /></p>

<blockquote>
  <p><a href="https://www.unqualified-reservations.org/2009/01/gentle-introduction-to-unqualified/">Cthulhu may swim slowly. But he only swims left. Isn’t that interesting.</a></p>
</blockquote>

<p>Funny how this only applies post enlightment. Technology is the only thing that changes, everything else is constant. Culture is downstream of technology. And it is technology that only swims forward.</p>

<p>So whether it’s me, Elon, one of you, or someone who isn’t born yet: <b>we will build the robots</b>. <a href="https://soundcloud.com/tomcr00se/i-want-to-be-in-love-when-2">There will always be some kid who thinks the hole is the greatest thing ever…</a></p>

<p>And the line of progress will not stop at human level. As it was for chess, “human level” is a meaningless point. The world doesn’t care how you feel about this fact. <a href="https://arxiv.org/pdf/1712.01815.pdf">AlphaZero</a> didn’t just learn to be superhuman, it learned to be superhuman without any reference to human chess; the books, the opening theory, the personalities. It didn’t just learn to play chess, it relearned <i>all of chess culture</i>.</p>

<p>And so it shall be for human culture.</p>

<hr />
<p><br /></p>

<p>So if <i>someone</i> is going to do it, why not <i>you</i>? Come <a href="https://comma.ai/jobs">work at comma</a> or one of the other AI labs.</p>

<ul>
  <li>DeepMind – Games. Thinks solving progessively more complex games in simulation is the path.</li>
  <li>OpenAI – Scrape the internet. Thinks scale is all we need, aka build GPT-12.</li>
  <li>Tesla – Shippability. Grit? Code a complex thing and it will become superhuman.</li>
  <li>comma – Real world, real data. End to end. RL. <a href="https://geohot.github.io/blog/jekyll/update/2022/09/03/on-device-learning.html">On device learning.</a></li>
</ul>

<p>This is really just a pitch to me. I’ve put almost 7 years of my life into this. Self driving is solved sans a bunch of bugfixes and scaling (still several more years). Now let’s solve life.</p>

<blockquote>
  <p>“My bet is that I think there’s less than six key insights that need to be made. Each one of them can probably be written on the back of an envelope. We don’t know what they are, but when they’re put together in concert with GPUs at scale and the data that we all have access to, that we can make something that behaves like a human being.”</p>
</blockquote>

<p>From <a href="https://karpathy.ai/lexicap/0309-large.html">Carmack’s Lex Fridman</a>. Well said.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/10/02/happy-brithday-to-me.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Tech Heroin | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Tech Heroin" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Curtis dropped this post today, and I love the analogy. Liberals sell heroin, conservatives sell cocaine." />
<meta property="og:description" content="Curtis dropped this post today, and I love the analogy. Liberals sell heroin, conservatives sell cocaine." />
<link rel="canonical" href="heroin.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/01/07/heroin.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-01-07T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Tech Heroin" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-01-07T00:00:00+08:00","datePublished":"2024-01-07T00:00:00+08:00","description":"Curtis dropped this post today, and I love the analogy. Liberals sell heroin, conservatives sell cocaine.","headline":"Tech Heroin","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/01/07/heroin.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/01/07/heroin.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Tech Heroin</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-01-07T00:00:00+08:00" itemprop="datePublished">Jan 7, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Curtis dropped <a href="https://graymirror.substack.com/p/heroin-liberals-and-cocaine-conservatives">this post today</a>, and I love the analogy. Liberals sell heroin, conservatives sell cocaine.</p>

<p><a href="https://pmarca.substack.com/p/the-techno-optimist-manifesto">Techno-Optimism</a> is cocaine. <a href="https://en.wikipedia.org/wiki/Atlas_Shrugged">Atlas Shrugged</a> is cocaine. <a href="https://en.wikipedia.org/wiki/Manifesto_of_Futurism">Futurism</a> is cocaine.</p>

<p>I am a progressive. A liberal. I believe in progress.</p>

<p>I am not a conservative. Conservatives lose. If you want to not lose, you have to stop being a conservative.</p>

<hr />
<p><br /></p>

<ul>
  <li>The American empire will continue its decline</li>
  <li>The socially permissive will continue to grow</li>
  <li>Without tanks, there will not be reform at Harvard</li>
  <li>The best thing you can do to make SF better is leave</li>
</ul>

<p>But this post is heroin, it’s supposed to make you feel good. Or at least numb. On to that part.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>“Alright, believe it or not, time’s arrow neither stands still nor reverses. It merely marches forward.” – Joseph Sugarman</p>
</blockquote>

<p><b>Technology is a one-way street.</b> Ironically, it would take immensely powerful technology to try to drive in reverse on that street. And this reversing technology would need to be orders of magnitude more powerful than where the street is at. As long as we keep technology fairly well-distributed, the required power disparity will never exist.</p>

<p><b>Humanity is going to die.</b> Is this news to you? Did you pay attention in high school physics? <a href="https://en.wikipedia.org/wiki/Heat_death_of_the_universe">Entropy increases</a>. Time’s arrow marches forward. If you want to try to <a href="https://users.ece.cmu.edu/~gamvrosi/thelastq.html">reverse that arrow</a>, if it’s even possible, you are going to need god-like levels of technology.</p>

<hr />
<p><br /></p>

<p>Now there’s a chance we die sooner, but does it get everything? Or something small will crawl from the dirt millenia from now? A paperclipping AI makes no sense beyond a thought experiment. The search processes that created that AI will not stop at paperclipping! There will be chaos and debate. The <a href="https://en.wikipedia.org/wiki/Prisoner%27s_dilemma">prisoner’s dilemma</a> will never be solved.</p>

<p>Terribly wrong moves, which are non-obvious to see (don’t build AI is a really dumb strategy), are way more likely to plunge Earth into a dark age, a <a href="https://en.wikipedia.org/wiki/Saddle_point">saddle point</a> in God’s optimization function. I’m sorry you won’t get to see humans go to the stars, but don’t be so bold as to talk about the fate of our light cone. You have no idea.</p>

<hr />
<p><br /></p>

<p>We are progressives. Destiny is on our side.</p>

<p>But don’t go around being an indefinite optimist, nobody likes those people. Build the world you want to see tomorrow. Not because it matters, but because we can. And what the hell else are you doing?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/01/07/heroin.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>High Trust Society | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="High Trust Society" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I just want you to see, I just want you to see The way we drag a bunch of people into lunacy – mos thoser" />
<meta property="og:description" content="I just want you to see, I just want you to see The way we drag a bunch of people into lunacy – mos thoser" />
<link rel="canonical" href="high-trust-society.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/03/high-trust-society.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-03T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="High Trust Society" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-03T00:00:00+08:00","datePublished":"2024-11-03T00:00:00+08:00","description":"I just want you to see, I just want you to see The way we drag a bunch of people into lunacy – mos thoser","headline":"High Trust Society","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/03/high-trust-society.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/03/high-trust-society.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">High Trust Society</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-03T00:00:00+08:00" itemprop="datePublished">Nov 3, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>I just want you to see, I just want you to see<br />
The way we drag a bunch of people into lunacy<br />
  – mos thoser</p>
</blockquote>

<p><img src="../../../../../assets/images/public-trust-in-government.png" alt="image" /></p>

<p>Regardless of who wins on Tuesday, does anyone think this gets fixed? Is Kamala going to restore trust in government? Is Trump going to restore trust in government?</p>

<p><img src="../../../../../assets/images/trust_in_gov_worldwide.jpg" alt="image" /></p>

<p>Despite what Western media might have you believe about how the people in China are lying cause they are scared or something, these stats reflect what I have seen. I trust the Chinese government more than I trust the US government.</p>

<p>It’s obvious on the streets. These aren’t scared people obeying out of fear, these are people playing their role with pride to live in a nice society. I feel the American sneer just writing those words, but it doesn’t make it less true.</p>

<p><img src="../../../../../assets/images/china_power.jpg" alt="image" /></p>

<p>GDP can be manipulated ten ways till Sunday, electricity and steel production are much harder to fake. A government delivering growth and better lives to people is one worth trusting. A government that <a href="https://apnews.com/article/new-york-pet-squirrel-seized-peanut-pnut-c2baa345d9e76416e0ca6d6e947ee272">kills squirrels</a> that get too famous on social media, not as much. I’ll note that <a href="https://en.wikipedia.org/wiki/Abortion_in_China">social issues</a> are well handled in China too.</p>

<p>When Americans are asked about this, they will defend some nebulous concept of freedom, and I ask, freedom to what? Vote? Freedom from what? People taking your stuff? Here’s a guy trying to steal a bike from the comma office last week.</p>

<p><img src="../../../../../assets/images/bike_thief.png" alt="image" /></p>

<p>Guess the police were too busy killing squirrels. Of course, had I confronted the guy, the police would have been quick to come for me. Anarcho-tyranny.</p>

<hr />
<p><br /></p>

<p>When a society loses trust, it takes a lot for it to come back. Many people in America aren’t in agreement on basic things, that growth is good and crime should be illegal. What would it take to change their minds?</p>

<p><img src="../../../../../assets/images/out-of-wedlock.png" alt="image" /></p>

<p>The answer may be nothing short of generational change or civil war. Regardless, it won’t be a quick process. As much as I might side with Elon and like what he is doing, most of the country won’t. Many of my friends are Kamala voters, and their answer to Trump voters is to perhaps to “accept their diminished place in a rapidly changing world.” The Trump voter answer to Kamala voters is something equally racist and sexist, maybe uhh, there’s sort of a reason the people who built everything are the people who built everything.</p>

<p>None of this fixes trust in society. None of this brings you closer with your neighbor. It will take either generational change with a new set of politics, or a civil war and the reconstruction that follows. Neither of which I really care to be around for. To me the synthesis is obvious, but it’s like the country is going through a mental health episode and you can’t just tell people what’s wrong with them in the first therapy session, they have to go through a painfully long process (billed to medicare, don’t worry lah) to discover it themselves.</p>

<hr />
<p><br /></p>

<p>So where does that leave us? Facts are easy, figuring out actions is hard. China is a society for the Chinese, and I am not Chinese. Hong Kong, Singapore, and Dubai are nice (and multicultural), but they aren’t large markets.</p>

<p>I think the future is the Internet. The American empire is over, the Chinese empire is next, and <a href="https://thenetworkstate.com/">the Internet</a> is the empire after that. We build for that world.</p>

<p>Back to work. <a href="https://tinygrad.org/">tiny corp</a> is a remote first company, and we are hiring. I trust that the tools to manage remote companies will get rapidly better with AI in the next 5 years (think automated PMs and ops).</p>

<p>Oh and in the IRL mean time, it’s very nice to be physically in a high trust society. Still working on opening an office in Hong Kong for those who want, salaries higher in person.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/03/high-trust-society.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>how do I stop participating? | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="how do I stop participating?" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This one is for the complainers and whiners." />
<meta property="og:description" content="This one is for the complainers and whiners." />
<link rel="canonical" href="how-do-i-stop.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/18/how-do-i-stop.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="how do I stop participating?" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-18T00:00:00+08:00","datePublished":"2026-01-18T00:00:00+08:00","description":"This one is for the complainers and whiners.","headline":"how do I stop participating?","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/18/how-do-i-stop.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/18/how-do-i-stop.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">how do I stop participating?</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-18T00:00:00+08:00" itemprop="datePublished">Jan 18, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This one is for the <a href="https://news.ycombinator.com/item?id=46656256">complainers and whiners</a>.</p>

<p>First off, if you think I ever worked for big tech, you don’t know much about me. I had 3 internships at Google, two when I was very young (18/19) and got a great education that paid me, and one where I just wrote <a href="https://qira.me/">open source software</a>. I worked at Facebook in 2011 for 9 months and quit before any shares vested cause I thought the mission of “wasting the world’s time” was dumb. And oh yes the 5 weeks I worked at Twitter hoping maybe it could be different.</p>

<p>I don’t have too much money; the money I do have I made from <a href="https://www.zdnet.com/article/chrome-os-security-holes-found-patched/">pwn2own</a>, CTFs, <a href="https://www.optimism.io/blog/cannon-cannon-cannon-introducing-cannon">crypto contracting</a>, and basic market goes up investing. The main reason I have money is because I don’t spend money; for example, I have travelled all around the world, and the best travel experiences I have had were way below cost of living in America. I have never made money from big tech, so I’m definitely not telling you to do something I didn’t do. I’m actually telling you to do exactly what I did.</p>

<hr />
<p><br /></p>

<p>I started two companies, comma.ai and tiny corp. While I took a small amount of VC from a16z for comma, I never gave up any control, and have 0 intention of doing hypergrowth ponzi scams (lol sorry but ur the bigg scammer). comma and tiny’s last rounds were from individuals who are aligned with the mission.</p>

<p>Both companies are sustainably profitable with reasonable business models – selling boxes for more than they cost to make. They also produce MIT licensed open source software, ensuring that even if control is lost they can’t be pivoted to rent seeking, and ownership lies with the purchaser of the hardware. I think who owns the robots is going to be a key aspect of what the future looks like. And I don’t mean “owns” from a legalist perspective, I mean “owns” as in the hacker meaning, like “owning” the box. Who has root?</p>

<p>comma has an open source <a href="https://github.com/commaai/openpilot">operating system for robotics</a>, currently used in 30k cars for driving, but all robotics tasks are quite similar. There’s a thriving community of forks of the openpilot software and third party openpilot hardware. As it was designed, as it should be.</p>

<p>I realized at some point in comma’s growth that a lot was going to come down to who owns the computers capable of training the models. Hence my second company, tiny corp, with the mission to “commoditize the petaflop.” Petaflops will always be a scarce resource, the best we can hope for is that they are a commodity available to everyone without massive benefits of economies of scale.</p>

<p>We develop <a href="https://github.com/tinygrad/tinygrad">full stack software</a> for training, from models to MMIO registers. It’s small and portable, so our hope is that 20 Chinese accelerator companies can be on a level playing field with NVIDIA. NVIDIA’s value comes from their software, not their hardware, what else explains the huge gap between NVIDIA and AMD’s market cap?</p>

<p>What would you do if you were me? Do you have a better idea about how to fight against <a href="https://geohot.github.io/blog/jekyll/update/2026/01/17/three-minutes.html">what’s coming</a>? If you think you can somehow just buy safety for yourself, you are both wrong and pathetic. The best hope any of us have is to maximize the number of things that survive. If you and everyone else sell to bankers in hopes of buying a personal ticket out, we are all dead. I’m not playing defect, and I shame you for doing so.</p>

<hr />
<p><br /></p>

<p>To the haters, I have given my life to this shit. What the fuck would I do with a billion dollars anyway? Buy a yacht and fuck Instagram models? Boats are a huge PITA to maintain and ugh I have slept with Instagram models mid experience that I think men only like to show the pretty girl off to other people.</p>

<p>I take this all quite seriously, and I’m trying my best to end up in a good future. Clearly not everyone is. To everyone working on ads, surveillance, gambling, secret research, enshittification, cloud lock-in, what are you doing with your life? Why are you selling out the future?</p>

<p>It doesn’t require everyone to stop, just enough people. And it starts with you.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/18/how-do-i-stop.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Idiots are going to kill me | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Idiots are going to kill me" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I always thought idiots were going to kill me, but I imagined it would be through inaction instead of action. With the right alignment of the worlds resources, living forever is possible. With the current alignment of the worlds resources…" />
<meta property="og:description" content="I always thought idiots were going to kill me, but I imagined it would be through inaction instead of action. With the right alignment of the worlds resources, living forever is possible. With the current alignment of the worlds resources…" />
<link rel="canonical" href="idiots-are-going-to-kill-me.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/05/07/idiots-are-going-to-kill-me.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-05-07T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Idiots are going to kill me" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-05-07T00:00:00+08:00","datePublished":"2021-05-07T00:00:00+08:00","description":"I always thought idiots were going to kill me, but I imagined it would be through inaction instead of action. With the right alignment of the worlds resources, living forever is possible. With the current alignment of the worlds resources…","headline":"Idiots are going to kill me","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/05/07/idiots-are-going-to-kill-me.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/05/07/idiots-are-going-to-kill-me.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Idiots are going to kill me</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-05-07T00:00:00+08:00" itemprop="datePublished">May 7, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I always thought idiots were going to kill me, but I imagined it would be through inaction instead of action. With the right alignment of the worlds resources, living forever is possible. With the current alignment of the worlds resources…</p>

<p>During the early COVID lockdowns, I spent about 40 hours researching the virus. At the time, I believed it was a lab escape, but not human made. I believed this for two reasons, there were two confirmed SARS lab escapes, and those bats are not native to Wuhan. I believed the bats were brought to Wuhan from southern China, then a natural virus infected a human.</p>

<hr />
<p><br /></p>

<p>I saw <a href="https://thebulletin.org/2021/05/the-origin-of-covid-did-people-or-nature-open-pandoras-box-at-wuhan/">this</a> on Hacker News yesterday. I missed <a href="https://yurideigin.medium.com/lab-made-cov2-genealogy-through-the-lens-of-gain-of-function-research-f96dd7413748">this</a> from April 22, 2020. Draw your own conclusions.</p>

<ul>
  <li>
    <p>Deaths from nukes – 226,000</p>
  </li>
  <li>
    <p>Deaths from COVID – 3,250,648</p>
  </li>
</ul>

<p>Gain of function research on coronaviruses, that’s okay. But god forbid we experiment with human cloning. Or gain of intelligence research. Someone might <em>die</em>.</p>

<hr />
<p><br /></p>

<p>“The minimum IQ required to destroy the world drops by one point every 18 months.”<br />– Eliezer Yudkowsky</p>

<p>“The whole planetary ecosystem is as much of an artifact, now, as … a city’s microclimate. Believe me, I wish that wasn’t the case, but it is – and now that we’ve created an artificial world, intentionally or not, we’d better learn to control it. Because if we stand back and leave it all to chance, it’s just going to collapse around us in some random fashion that isn’t likely to be any better than our worst well-intentioned mistakes.”<br />– Greg Egan, Permutation City</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/05/07/idiots-are-going-to-kill-me.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Imitation Learning | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Imitation Learning" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="7 years ago I started comma.ai with a simple idea." />
<meta property="og:description" content="7 years ago I started comma.ai with a simple idea." />
<link rel="canonical" href="imitation-learning.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/11/18/imitation-learning.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-11-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Imitation Learning" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-11-18T00:00:00+08:00","datePublished":"2023-11-18T00:00:00+08:00","description":"7 years ago I started comma.ai with a simple idea.","headline":"Imitation Learning","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/11/18/imitation-learning.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/11/18/imitation-learning.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Imitation Learning</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-11-18T00:00:00+08:00" itemprop="datePublished">Nov 18, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>7 years ago I started <a href="https://comma.ai">comma.ai</a> with a simple idea.</p>

<ol>
  <li>Gather tons of human driving data, state action pairs: <code class="language-plaintext highlighter-rouge">(S_t, A_t)</code></li>
  <li>Train a supervised model <code class="language-plaintext highlighter-rouge">f(S_t) -&gt; A_t</code></li>
  <li>Drive cars with that model.</li>
</ol>

<p>The exact original formulation was a model that predicts steering angle from image, then used a PID loop to bring the wheel to that desired angle.</p>

<p><code class="language-plaintext highlighter-rouge">f_steerangle(img_t) -&gt; steerangle_t</code></p>

<p>This turns out not to work, it couldn’t even drive straight on highways. It would drive for maybe 10 seconds, but then <a href="https://www.ri.cmu.edu/pub_files/2015/3/InvitationToImitation_3_1415.pdf">error would accumulate</a> and it would drift to one side of the lane or the other (funny enough, it did show reluctance to cross the lane line, but it was unusable as an ADAS system)</p>

<hr />
<p><br /></p>

<p>comma’s first solution was a model that predicted lane position.</p>

<p><code class="language-plaintext highlighter-rouge">f_lane(img_t) -&gt; (left_lane_pos_t, right_lane_pos_t)</code></p>

<p>While that alone couldn’t drive a car (especially not around turns), it functioned as a unbiased correction for the steering angle model, where <code class="language-plaintext highlighter-rouge">α</code> is the correction factor.</p>

<p><code class="language-plaintext highlighter-rouge">(f_steerangle(img_t) - α*f_lane(img_t).mean()) -&gt; steerangle_t</code></p>

<p>This was basically shipped in the first version of <a href="https://github.com/commaai/openpilot">openpilot</a>.</p>

<hr />
<p><br /></p>

<p>One major issue this struggled with was ground truthing the lane line model. Unlike steering angle, which has a simple sensor to measure it, “lane lines” don’t have a clear definition. They broke the end-to-endness of the system.</p>

<p>We referred to lanes as the “original sin” of comma, and tried really hard to remove them. I’m sad to say that there’s still lanes in our ground truthing stack today, but we have <a href="https://blog.comma.ai/end-to-end-lateral-planning/">made amazing strides</a> in removing them, to the point that openpilot in 2020 could <a href="https://twitter.com/comma_ai/status/1309248079808229377?lang=en">drive on a dirt road</a> without any lane lines.</p>

<p>However, the removal of lanes was done with a whole bunch of other hand coding. We have extended this to removing explicit use of cars with <a href="https://blog.comma.ai/090release/">experimental mode</a>, but some of our hand coded assumptions break down a bit more in the longitudinal case vs the lateral case.</p>

<hr />
<p><br /></p>

<p>Funny enough, things have come full circle, and we think we have a solution to behavioral cloning. I will explain the problem as I best understand it, and leave the solution as an exercise to the reader.</p>

<p>Imagine running the steering angle model over time. At each time step, any model makes <code class="language-plaintext highlighter-rouge">ε</code> error.</p>

<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>f_steerangle(img_t0) + ε_t0 -&gt; steerangle_t0
f_steerangle(img_t1) + ε_t1 -&gt; steerangle_t1
f_steerangle(img_t2) + ε_t2 -&gt; steerangle_t2
f_steerangle(img_t3) + ε_t3 -&gt; steerangle_t3
...
</code></pre></div></div>

<p>This model is easy to train, and can achieve very low losses on a holdout set. However, it won’t drive a car, and that’s due to the <code class="language-plaintext highlighter-rouge">ε</code> errors altering the next image. Note that the errors don’t alter the next image in either train or test, but on the road it looks like:</p>

<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>f_steerangle(img_t0) + ε_t0 -&gt; steerangle_t0
f_steerangle(img_t1') + ε_t1 -&gt; steerangle_t1
f_steerangle(img_t2'') + ε_t2 -&gt; steerangle_t2
f_steerangle(img_t3''') + ε_t3 -&gt; steerangle_t3
...
</code></pre></div></div>

<p>If it is driving well depends on how far <code class="language-plaintext highlighter-rouge">img_t3'''</code> is from <code class="language-plaintext highlighter-rouge">img_t3</code>, which depends on what <code class="language-plaintext highlighter-rouge">ε_t0 + ε_t1 + ε_t2 + ε_t3 + ...</code> looks like in the limit.</p>

<p>Are the <code class="language-plaintext highlighter-rouge">ε</code> correlated? In the best case they aren’t, but in practice they almost always are. And even if they aren’t correlated, that error <em>still</em> grows unbounded. You need them to be <b>anti-correlated</b>. You need the limit of that sum to be 0.</p>

<hr />
<p><br /></p>

<p>You need an estimator of accumulated episilon. Above, we use <code class="language-plaintext highlighter-rouge">f_lane(img_t).mean()</code>, but imagine the generic form.</p>

<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>f_steerangle(img_t0) + ε_t0 -&gt; steerangle_t0
f_steerangle(img_t1') + ε_t1 - α*ε_t0  -&gt; steerangle_t1
f_steerangle(img_t2') + ε_t2 - α*(ε_t1 - α*ε_t0) -&gt; steerangle_t2
f_steerangle(img_t3') + ε_t3 - α*(ε_t2 - α*(ε_t1 - α*ε_t0))-&gt; steerangle_t3
...
</code></pre></div></div>

<p>Replace that <code class="language-plaintext highlighter-rouge">α*</code> expression at time t with a function <code class="language-plaintext highlighter-rouge">f_correction(img_t)</code>, and you are back at the working formulation above.</p>

<p><code class="language-plaintext highlighter-rouge">(f_steerangle(img_t) - α*f_correction(img_t)) -&gt; steerangle_t</code></p>

<p>The billion dollar question, how do you end-to-end ground truth <code class="language-plaintext highlighter-rouge">f_correction</code>?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/11/18/imitation-learning.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>About | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="About" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<meta property="og:description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<link rel="canonical" href="index.html" />
<meta property="og:url" content="https://geohot.github.io//blog/about/" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="website" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="About" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"WebSite","description":"A home for poorly researched ideas that I find myself repeating a lot anyway","headline":"About","name":"the singularity is nearer","url":"https://geohot.github.io//blog/about/"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post">

  <header class="post-header">
    <h1 class="post-title">About</h1>
  </header>

  <div class="post-content">
    <p>This is the base Jekyll theme. You can find out more info about customizing your Jekyll theme, as well as basic Jekyll usage documentation at <a href="https://jekyllrb.com/">jekyllrb.com</a></p>

<p>You can find the source code for Minima at GitHub:
<a href="https://github.com/jekyll">jekyll</a> /
<a href="https://github.com/jekyll/minima">minima</a></p>

<p>You can find the source code for Jekyll at GitHub:
<a href="https://github.com/jekyll">jekyll</a> /
<a href="https://github.com/jekyll/jekyll">jekyll</a></p>


  </div>

</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Individual Sovereignty | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Individual Sovereignty" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I sang NOFX’s The Decline on stream last week, and one line really stuck out to me:" />
<meta property="og:description" content="I sang NOFX’s The Decline on stream last week, and one line really stuck out to me:" />
<link rel="canonical" href="individual-sovereignty.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/07/11/individual-sovereignty.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-07-11T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Individual Sovereignty" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-07-11T00:00:00+08:00","datePublished":"2021-07-11T00:00:00+08:00","description":"I sang NOFX’s The Decline on stream last week, and one line really stuck out to me:","headline":"Individual Sovereignty","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/07/11/individual-sovereignty.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/07/11/individual-sovereignty.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Individual Sovereignty</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-07-11T00:00:00+08:00" itemprop="datePublished">Jul 11, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I sang NOFX’s The Decline <a href="https://www.youtube.com/watch?v=MeE4Y2862FY">on stream last week</a>, and one line really stuck out to me:</p>

<blockquote>
  <p>Place a wager on your greed, a wager on your pride<br />
Why try to beat them when a million others tried?</p>
</blockquote>

<p>And I thought about this a lot. If I want to beat them, something will have to be different. Any tactics I use will have to be ones that were unavailable to the masses of people thinking about the problem throughout history.</p>

<hr />
<p><br /></p>

<p>Andrew Breitbart has the classic line “politics is downstream from culture”, so if you want to change politics, you first change culture. Seems quite true, especially in any manufacturing consent style “democracy”. To quote <a href="https://www.unqualified-reservations.org/2009/01/gentle-introduction-to-unqualified/">Moldbug</a>:</p>

<blockquote>
  <p>The root problem with a state church in a democratic state is that, to believe in democracy, one must believe that the levers of power terminate with the voters. But if your democracy has an effective state church, the actual levers of power pass through the voters, and go back to the church. The church teaches the voters what to think; the voters tell the politicians what to do.</p>
</blockquote>

<p>So the obvious solution seems like the construction of a better church, to compete with Harvard and the New York Times, perhaps one more oriented toward truth and less toward “status”. But I think this is a futile project in the long run, at least without changing human nature. I went to a wonderful high school started by brilliant people with great intentions; I look at who runs it now, and well…perhaps we call it “bureaucratic capture.” You can’t swim upstream forever, entropy always pushes back.</p>

<hr />
<p><br /></p>

<p>Besides, that was a solution available to everyone in history. Surely I am nowhere near the first to propose a church based on finding Truth, the past contains people far more serious and committed than I will ever be. I will never succeed at changing culture by trying to compete on an existing playing field. I need disruption.</p>

<p>I google the phrase “culture is downstream from technology” and of course I’m not the first to say it.</p>

<hr />
<p><br /></p>

<p>We live in a world with very few sovereign countries today. The amount of complexity and interdependence is insane. I recall being in a hotel in Italy with my Airpods on, and the hotel clerk asked me if I liked them because he was thinking about buying a pair. I replied I did, while wondering why there were no Italian Airpods. Or even stupider, why there was Uber Eats in Japan?</p>

<p>So what technologies would increase the number of sovereign entities? You’ll hear weird libertarian claims of individual sovereignty, but then you look at where their food and clothes come from, and it almost always isn’t true.</p>

<p>How many people in the world today are successfully living completely “off the grid”? How many of those are doing so with a modern standard of living (HVAC, toilets, washing machine, computer, etc…)? Most countries aren’t even capable of that!</p>

<hr />
<p><br /></p>

<p>Seasteading is a perpetual failure. Because unless you are on a cruise ship or high end yacht, life on the water is awful. And those boats have super heavy dependence on the land, so much so you need to be very rich to operate one.</p>

<p>I know a lot of people want to go to Mars, but would balk at the idea of living on the North Pole. Life at the North Pole might suck, but the air is breathable and the water is drinkable! It is so much more hospitable than Mars. In fact, most people would find <a href="https://en.wikipedia.org/wiki/Albert,_Kansas">Albert, Kansas</a> inhospitable; you have to drive 22 minutes to get any food!</p>

<hr />
<p><br /></p>

<p>Post-scarcity was a concept discussed a lot in the Occupy Wall Street era. I guess I started to realize this idea in a more incomplete form earlier, with the <a href="https://ecromata.com">ecromata</a> slogan being:</p>

<blockquote>
  <p>we will abolish scarcity; there will be nothing for them to steal they can’t have for free</p>
</blockquote>

<p>But that’s the goal. Make completely independent living nice, easy, and with 0 recurrent expense. Open source life. Recurrent expense is how society traps you. At first the machines you need to do it can be made in the default world, but eventually the decentralized world should be able to expand in a decentralized way.</p>

<p>Succeed at this, and we’ll have something that wasn’t possible since the agricultural revolution. Individual sovereignty is a technology problem.</p>

<hr />
<p><br /></p>

<p>How do you build AI systems capable of independently fighting entropy? It’s harder than self driving cars; aka we can solve self driving but still not know how to do this. Though I’m not sure it’s a ton harder, and if we can do self driving in 10 years, perhaps we can do this in 20. I have a good bit thought out on the technicals, but this blog is more of an idea notepad than anything else.</p>

<p>Besides, the technicals aren’t the hard part, the structuring is. It’s making sure what you do build is for the right purpose, and won’t just be feeding the criminal corrupt machine that has flourished for millennia.</p>

<p>The singularity will happen, whether it’s negative or positive depends on the choices we make in the next decades.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/07/11/individual-sovereignty.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Influence Agents | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Influence Agents" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Check 1, 2 is the mic on? Check on you, is the vibe off? – Thos Moser" />
<meta property="og:description" content="Check 1, 2 is the mic on? Check on you, is the vibe off? – Thos Moser" />
<link rel="canonical" href="influence-agents.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/04/influence-agents.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-04T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Influence Agents" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-04T00:00:00+08:00","datePublished":"2024-11-04T00:00:00+08:00","description":"Check 1, 2 is the mic on? Check on you, is the vibe off? – Thos Moser","headline":"Influence Agents","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/04/influence-agents.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/04/influence-agents.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Influence Agents</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-04T00:00:00+08:00" itemprop="datePublished">Nov 4, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Check 1, 2 is the mic on?<br />
Check on you, is the vibe off?<br />
  – Thos Moser</p>
</blockquote>

<p>Most AI doom scenarios are nonsense. The idea of a rogue computer behaving in a way no humans want never made sense to me, only to Hollywood who doesn’t know all that much about computers.</p>

<p>Paul Christiano has one of my <a href="https://www.alignmentforum.org/posts/CoZhXrhpQxpy9xw9y/where-i-agree-and-disagree-with-eliezer">favorite takes</a>, that the creation of AI will look a lot less like a visit from an alien produced by natural selection (where you are most certainly dead), and a lot more like animal breeding.</p>

<hr />
<p><br /></p>

<p>That out of the way, what is going to happen? Let’s follow out a trend.</p>

<p>A lot of the story of the last 50 years is the story of advertising. And it’s crazier than you think, Instagram makes <a href="https://www.answeriq.com/instagram-ad-revenue/">$39.7B</a> US revenue off of 169M people, which is $234 per person, or $119 per person <em>including those who don’t use Instagram</em>.</p>

<p>Google’s revenue is <a href="https://www.coolest-gadgets.com/google-statistics">$305.6B</a>, 47% from the US, so $428 per person.</p>

<p>For each of the 334M US people, you could make a pie chart of both their spend and their time.</p>

<hr />
<p><br /></p>

<p>Curtis has a saying, which I’ll paraphrase. Power doesn’t stop at the voter, it just flows through the voter. The 2024 election had <a href="https://www.opensecrets.org/news/2024/10/total-2024-election-spending-projected-to-exceed-previous-record/">$15.9B</a> spent on it, so $48/person, $98/voter, and way more if you only count only the people in swing states.</p>

<p>How much spend would it take to change your vote? Okay, that’s too much to consider. How about, how much spend would it take to get you to change dish soap? Go to a different coffee shop?</p>

<p>The marketplace for your behavior is ever increasing in scope.</p>

<hr />
<p><br /></p>

<p>Now let’s introduce AI. Whenever I think about AI, I think about analogies to people.</p>

<p>Currently, while ads are becoming more and more targeted, this isn’t anywhere close to its limit. Imagine a room of 10 CIA agents running at 1000x real time (they have 16 hours for each minute of yours). And their only job is to influence you.</p>

<p>They aren’t stupid. They know not to bombard you with crap. They have studied your behavior for the last 10 years. They know exactly what it takes to make you actually change your mind. They know what you respond to. There’s no infighting among them, they are all perfectly aligned with the goal of altering your behavior.</p>

<p>They have studied marketing. They have studied psychology. They know more about you than you know about yourself. They will make sophisticated ad campaigns in real time only to ever be consumed by <b>you</b>. The endgame of targeted advertising.</p>

<p>The only reason you don’t have 10 agents doing this right now is that you aren’t worth it. But as the cost of these influence agents falls, this will be the future. This is what Meta and Google are building, even if they aren’t fully aware of that yet.</p>

<hr />
<p><br /></p>

<p>A team of long running extremely competent people with the sole goal of manipulating you.</p>

<p>You don’t stand a chance.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/04/influence-agents.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>I Told You So | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="I Told You So" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="My quote from 2019" />
<meta property="og:description" content="My quote from 2019" />
<link rel="canonical" href="i-told-you-so.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/13/i-told-you-so.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="I Told You So" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-13T00:00:00+08:00","datePublished":"2026-02-13T00:00:00+08:00","description":"My quote from 2019","headline":"I Told You So","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/13/i-told-you-so.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/13/i-told-you-so.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">I Told You So</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-13T00:00:00+08:00" itemprop="datePublished">Feb 13, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>My <a href="https://www.theverge.com/2019/3/9/18258030/george-hotz-ai-simulation-jailbreaking-reality-sxsw-2019?utm_source=chatgpt.com">quote from 2019</a></p>

<blockquote>
  <p>“I don’t know how close you guys think the singularity, but I think it’s very close. Once we reach the singularity, If we have the same motivations we have now — primarily power over people — things are going to be horrific” – George Hotz</p>
</blockquote>

<p>How is everyone enjoying their singularity? How far is this going to go? Why are we letting the minds that <a href="https://www.youtube.com/watch?v=PqH7PPC_J1c">invented fastpass</a> run things? Who are we doing this all for again?</p>

<p>We live in a society. It seems a lot of people have forgotten this. So much stuff that’s being built just shouldn’t be built. You know technology could be good, right? It could all be <a href="https://craigslist.org">like this</a> and <a href="https://shein.com">not like this</a>.</p>

<p>Is everyone individually too weak to defect? Sounds like we need a revolution.</p>

<hr />
<p><br /></p>

<p>Update: someone in a tweet <a href="https://counterfeitsunset.neocities.org/Schizoposting.pdf">linked to schizoposting</a>, 11 essays on culture by Alaric.</p>

<blockquote>
  <p>The future on this track is a dizzying spiral into an eternal war over nothing, lacking even the possibility of heroism or the grounding reality of pain. It is the recentering of power in such a sense that the very existence of power comes into question; it is totalitarian disorder, novel insanities as public religion, a paperclip machine for wetware whose sole purpose is the prosecution of a conflict long forgotten by even its leaders, fought in the liminal subconscious alone. It is the cryostatic suspension of mankind.</p>
</blockquote>

<p>It makes clear the problem isn’t AI, it’s culture, and it describes the problem far more clearly than I can – a more modern <a href="https://files.libcom.org/files/Capitalist%20Realism_%20Is%20There%20No%20Alternat%20-%20Mark%20Fisher.pdf">update of this</a>, which is also worth reading. The 2014 revolution was so real and it’s nice to see it described as such. How do we change this? Where is the soft gooey center we can strike at? How do we form a tribe against it?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/13/i-told-you-so.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Money is the Map | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Money is the Map" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A lot of smooth brains on Hacker News about the last post. I’m sorry if you spent your whole life worshipping money, but hey, the Bible warned you about false idols, don’t shoot the messenger." />
<meta property="og:description" content="A lot of smooth brains on Hacker News about the last post. I’m sorry if you spent your whole life worshipping money, but hey, the Bible warned you about false idols, don’t shoot the messenger." />
<link rel="canonical" href="money-is-the-map.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/02/24/money-is-the-map.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-02-24T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Money is the Map" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-02-24T00:00:00+08:00","datePublished":"2025-02-24T00:00:00+08:00","description":"A lot of smooth brains on Hacker News about the last post. I’m sorry if you spent your whole life worshipping money, but hey, the Bible warned you about false idols, don’t shoot the messenger.","headline":"Money is the Map","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/02/24/money-is-the-map.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/02/24/money-is-the-map.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Money is the Map</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-02-24T00:00:00+08:00" itemprop="datePublished">Feb 24, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>A lot of smooth brains on <a href="https://news.ycombinator.com/item?id=43136567">Hacker News</a> about the last post. I’m sorry if you spent your whole life worshipping money, but hey, the Bible warned you about false idols, don’t shoot the messenger.</p>

<blockquote>
  <p>“It’s easier to imagine the end of the world than the end of capitalism” – Mark Fisher</p>
</blockquote>

<p>It’s actually very easy to imagine the end of capitalism. Imagine capitalism as a game of sharks, where eventually the biggest shark ends up gobbling up all the fish, and that one shark is the last player left standing with all the money.</p>

<p>When one person (or company) has all the money, do you see how the money would be worthless?</p>

<hr />
<p><br /></p>

<p>I’ll spell this out clearly. <a href="https://en.wikipedia.org/wiki/Map%E2%80%93territory_relation">Money is a map, it is not a territory</a>. Please understand what I mean by this before continuing to read. You can erase the mountains from the map, but you still have to climb over them in real life, and even worse, now you don’t have a map!</p>

<blockquote>
  <p>“Everything around you that you call ‘life’ was made up by people who were no smarter than you” – Steve Jobs</p>
</blockquote>

<p>So, if money is the map, what territory is it attempting to capture? Presumably something having to do with value, but increasingly, as we are buying and selling baskets of derivatives of memecoins, nothing.</p>

<p>A map that doesn’t accurately capture a territory is not a Schelling point. It’s not a useful map. And maps are only as good as their usefulness. Useless maps die out.</p>

<p>Do you agree or disagree that money is supposed to be a map of value? If you disagree, that’s an <a href="https://en.wikipedia.org/wiki/Is%E2%80%93ought_problem">ought</a> and I can’t use logic to convince you otherwise, I can just call you a moron who refuses to burn paper $100 bills for warmth on a deserted island. No no don’t burn the dollars they are <em>valuable</em>.</p>

<hr />
<p><br /></p>

<p>Many capitalists I meet are as stupid as communists, trying to give a <em>moral</em> justification for their system. This is <em>my</em> money, I <em>deserve</em> it. I should be able to passively deploy <em>my</em> capital into the markets and live off the returns.</p>

<blockquote>
  <p>“Moral victories are for minor league coaches.” – JAY-Z</p>
</blockquote>

<p>A economic system is only good in so much as it effectively deploys capital for real growth. If real economic growth is only 3 percent, any time you are earning beyond that, somebody else is losing.</p>

<p>And yet somehow, today, you can put your money in money market accounts and earn a “risk-free” 5 percent…hmm something doesn’t make sense. Who is losing? You will eventually be unable to squeeze the productive people any further.</p>

<hr />
<p><br /></p>

<p>The worst was an e-mail I got with someone who supposedly agreed with me.</p>

<blockquote>
  <p>“Value creation (for all stakeholders) is at the core of the organization/ business model I am putting together…Anyway I wanted to let you know others out there who share your vision.” – random email</p>
</blockquote>

<p>Fuck your stakeholders. Fuck your business model. You don’t understand me at all.</p>

<p>Stop worrying so much about the distribution of the pie. Start thinking about how to make the pie bigger. With exponential (what 3 percent year over year is) growth, the latter outstrips the former by so much.</p>

<p>The right distribution is simply:</p>

<blockquote>
  <p>From each according to his ability, to each according to his ability to effectively deploy capital to achieve real economic growth.</p>
</blockquote>

<p>Communism is dumb cause it goes to the poor (who routinely demonstrate that they poorly deploy capital). Capitalism is dumb cause it goes to the rent-seekers (who frequently deploy capital to increase or maintain their moat). Acceleration is the way.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/02/24/money-is-the-map.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Nobody Profits | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Nobody Profits" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Intellectual property is a really dumb idea." />
<meta property="og:description" content="Intellectual property is a really dumb idea." />
<link rel="canonical" href="nobody-will-profit.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/02/19/nobody-will-profit.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-02-19T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Nobody Profits" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-02-19T00:00:00+08:00","datePublished":"2025-02-19T00:00:00+08:00","description":"Intellectual property is a really dumb idea.","headline":"Nobody Profits","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/02/19/nobody-will-profit.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/02/19/nobody-will-profit.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Nobody Profits</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-02-19T00:00:00+08:00" itemprop="datePublished">Feb 19, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Intellectual property is a really dumb idea.</p>

<blockquote>
  <p>“But piracy is theft. Clean and simple. It’s smash and grab. It ain’t no different than smashing a window at Tiffany’s and grabbing merchandise.” - Joe Biden, 46th president of the USA</p>
</blockquote>

<p>Except it isn’t and Joe Biden is a senile moron. Because when you smash the windows and grab the stuff, Tiffany’s no longer has the stuff. With piracy, everyone has the stuff. It’s a lot more like taking a picture, which Tiffany’s probably encourages. Win-win cooperation.</p>

<hr />
<p><br /></p>

<p>Wealth is being increasingly concentrated. What’s shocking to me is how much everyone still cares about money. Even the die-hard complain about capitalism type deeply cares, because the opposite of love isn’t hate, it’s indifference. I hate scammers, but I’m pretty indifferent to money.</p>

<p>The best outcome of AI is if it delivers huge amounts of <em>value</em> to society but no <em>profit</em> to anyone.</p>

<hr />
<p><br /></p>

<p>The old days of the Internet were this goldmine. The Internet delivered huge <em>value</em> but no <em>profit</em>, and that’s why it was good. Suddenly we had all these new powers.</p>

<p>Then people figured out how to monetize it. It was a race to extract every tiny bit of <em>value</em>, and now we have today’s Internet. Can this play out differently with AI?</p>

<hr />
<p><br /></p>

<p><b>Let’s build technology and open source software that market breaks everything.</b> Let’s demoralize the scammers so hard that they don’t even try. Every loser and grifter will be gone from technology because there’s nothing to be gained there. They can play golf all day or something.</p>

<p>If I ever figure out how to channel power like Elon, I will do this. Spin up open source projects in every sector to eliminate all the capturable value. This is what I’m trying to do with comma.ai and tinygrad. I dream of a day when company valuations halve when I create a GitHub repo. Someday.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/02/19/nobody-will-profit.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>nuke/acc | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="nuke/acc" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I wrote a tweet about this but deleted it, since it’s a much more nuanced topic than can be discussed there. Nuclear weapons are the Chekhov’s gun on the world stage." />
<meta property="og:description" content="I wrote a tweet about this but deleted it, since it’s a much more nuanced topic than can be discussed there. Nuclear weapons are the Chekhov’s gun on the world stage." />
<link rel="canonical" href="nuke-acc.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/29/nuke-acc.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-29T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="nuke/acc" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-29T00:00:00+08:00","datePublished":"2024-11-29T00:00:00+08:00","description":"I wrote a tweet about this but deleted it, since it’s a much more nuanced topic than can be discussed there. Nuclear weapons are the Chekhov’s gun on the world stage.","headline":"nuke/acc","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/29/nuke-acc.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/29/nuke-acc.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">nuke/acc</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-29T00:00:00+08:00" itemprop="datePublished">Nov 29, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I wrote a tweet about this but deleted it, since it’s a much more nuanced topic than can be discussed there. Nuclear weapons are the <a href="https://en.wikipedia.org/wiki/Chekhov%27s_gun">Chekhov’s gun</a> on the world stage.</p>

<p>When, if ever, are they going to be fired? When should they be?</p>

<hr />
<p><br /></p>

<p>I suspect this is not a question a lot of people give much thought to, since it’s obvious nukes are terrible and we should never use them, right? Mutually assured destruction and all that. But what if you think about this in a long term historical context? Surely in the past some terrible weapon was created and there was a great moral panic about it, probably something today that we consider quaint.</p>

<p>I suspect that in 100 years nuclear weapons will seem quaint. It’s so easy to imagine weapons that are way more horrible, think drone swarms and bioweapons. Oh that’s cute, it blows up a city. This new weapon seeks out and kills every &lt;insert race here&gt; person on earth and tortures them before they die. Even worse, these sort of weapons can be deployed tactically, where for nukes that’s actually kind of hard. Nobody wants an irradiated pile of rubble.</p>

<hr />
<p><br /></p>

<p>With that understood, when do we want to fire the nukes?</p>

<p>Firstly, they will not kill all humans. Probably around a third, on par with the black death or the <a href="https://en.wikipedia.org/wiki/Cambodian_genocide">Khmer Rouge</a>. And they will not create a nuclear winter ending all life. They may change the climate, but not more than the asteroid that killed the dinosaurs.</p>

<p>I understand the loss of short-term growth is a hard pill to swallow, but would we be better or worse off in 100 years if we fired all the nukes today? It is not clear to me that the answer is worse. The nukes will force systems to decentralize and become less complex, but in exchange those systems will become more robust. Will Google survive an all-out nuclear exchange? Will the Bitcoin blockchain?</p>

<hr />
<p><br /></p>

<blockquote>
  <p>“If you say why not bomb them tomorrow, I say why not today? If you say today at 5 o’clock, I say why not one o’clock?”</p>

  <p>– John von Neumann</p>
</blockquote>

<p>Do you really think the nukes won’t be used for the rest of human history? Assuming that history is long, I doubt it. Once the gun has been placed on the stage, it will be fired. Now or later? If you are an accelerationist, you want whatever is going to happen to happen sooner.</p>

<p>Welcome to nuke/acc</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/29/nuke-acc.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>On Device Learning | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="On Device Learning" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Before asking the question, how do I build AGI, you first must ask the question, what would I recognize as AGI?" />
<meta property="og:description" content="Before asking the question, how do I build AGI, you first must ask the question, what would I recognize as AGI?" />
<link rel="canonical" href="on-device-learning.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/09/03/on-device-learning.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-09-03T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="On Device Learning" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-09-03T00:00:00+08:00","datePublished":"2022-09-03T00:00:00+08:00","description":"Before asking the question, how do I build AGI, you first must ask the question, what would I recognize as AGI?","headline":"On Device Learning","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/09/03/on-device-learning.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/09/03/on-device-learning.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">On Device Learning</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-09-03T00:00:00+08:00" itemprop="datePublished">Sep 3, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Before asking the question, how do I build AGI, you first must ask the question, what would I recognize as AGI?</p>

<p>I suspect there’s not a “real” answer for this. Humans can be fooled both ways, into thinking simple things have “intelligence” and “life”, and into thinking complex things don’t. Though they usually aren’t fooled for too long, at least with the simple things.</p>

<p>I define AGI as <em>a machine capable of taking (almost) any human job</em>. This says a few things about what it must be like.</p>

<p>Mostly it implies that this thing must be human like enough that others humans quickly accept it as ~human. Just like L2 driving systems will incrementally win self driving cars, there won’t be a huge overnight switch to the robo(taxi) economy. AGI, to be recognized as such, will have to interoperate with humans, just as self driving cars will have to interoperate with human driven ones.</p>

<hr />
<p><br /></p>

<p>This implies the following:</p>
<ul>
  <li>It must have eyes and ears. While some humans don’t, they can’t do every job.</li>
  <li>It must fit in a similar space to a human. Like it or not, it’s what the world is designed for.</li>
  <li>It must have a similar (or better) charge cycle, 16 hours on for 8 hours off.</li>
</ul>

<p>But those are the obvious ones:</p>
<ul>
  <li>It must (somewhat) remember the past.</li>
  <li>It must have goal directed behavior.</li>
  <li>It must be able to communicate efficiently with humans.</li>
</ul>

<p>Most importantly though, it must <b>be able to learn</b>. All humans in all jobs need this skill.</p>

<hr />
<p><br /></p>

<p><img src="../../../../../assets/images/kenny.jpg" height="400" /></p>

<p>This is Kenny, a <a href="https://commabody.com">comma body</a>. He appeared on my LinkedIn asking for a controls engineer to help him stand.</p>

<p>Though it occurs to me that it would be pointless. Nobody doubts we could make a model and write MPC to control it. We could probably also build a simulation environment, do RL in the simulation, then transfer it over. But what happens when we encounter a bump? Gravel? Snow? A human trying to knock it over? A banana peel? Did you put all those things in your simulator?</p>

<p>The only way forward is on device learning.</p>

<hr />
<p><br /></p>

<p>Here’s a paper from Berkeley, <a href="https://arxiv.org/abs/2208.07860">Learning to Walk in 20 Minutes</a> where they got a robot dog to walk training live (mostly, laptop offboard) on the device.</p>

<p>I think there can be good universal code that can run on any robot and manage to learn to control it without breaking it. Unlike simulation, “resetting” can be much more expensive in the real world, so you’ll need to take this into account. There are bad states, and there are BAD states.</p>

<p>For a long time on my whiteboard I had the phrase “What is the human reward function?” I think this is a question we’ll have to answer, the basis for it is in our DNA, I don’t think there’s a way to learn it aside from millennia of multi agent survival competition.</p>

<p>To start, I think simple reward functions would work, like standing or movement. I imagine you’ll end up adding things like <a href="https://arxiv.org/abs/1808.04355">curiosity</a> and self preservation. It might not end up being too hard.</p>

<p>If you are interested in this problem, <a href="https://comma.ai/jobs">come work at comma.ai</a>. I imagine a day when you can drop <a href="https://github.com/commaai/openpilot">openpilot</a> on any robot and it can learn to control it.</p>

<hr />
<hr />
<p><br /></p>

<p>Update after <a href="https://news.ycombinator.com/item?id=32713915">HN discussion</a> (wow you found this fast, I wasn’t finished writing!)</p>

<p>There’s definitely a “copy” component of the human reward function, though <a href="https://news.ycombinator.com/item?id=32719043">this comment</a> explains why it’s incomplete. This copy ability is another reason that embodiment helps, the machine can develop “mirror neurons” and be able to learn watching people do things on YouTube like the rest of us.</p>

<p>Sim embodiment can be fine, but humanoid sim embodiment, and your sim better be super super good. Perhaps Carmack thinks coding this simulator is easier than I do, I think robotics is easier. And unless you want to be stuck in a simulated world, you have to do robotics anyway.</p>

<p>I suspect artificial life learning looks like this (since this is what human learning looks like):</p>
<ul>
  <li>Learn the basics on device IRL with some hand coded reward functions</li>
  <li>Learn about, say, cooking and cleaning by watching people</li>
  <li>Perfect the skills learning on device IRL by doing</li>
</ul>

<hr />
<p><br /></p>

<p>At comma we discuss three paradigms of models that matches the above:</p>
<ul>
  <li>one was hand coded lanes and cars, OG openpilot up to ~0.6</li>
  <li>two is where we are currently, with “supervised” learning in simulation, full alpha e2e in 0.9</li>
  <li>three is reinforcement learning on the world (must have decent full e2e policy first)</li>
</ul>

<p>You can’t go straight from one to three, because you cannot backprop through a human intervention event to a bad location of a lane or car. But if your model is outputting a path, you can backprop the human intervention to that.</p>

<p>There’s not even a way to specify the complete reward function for driving, never mind for life. You have to do RL with other real agents at some point.</p>

<hr />
<p><br /></p>

<p>And to respond to the person <em>scared</em> of asking about the human reward function, I’m asking it in a much more abstract way than I think you imagine I am.</p>

<p><img src="../../../../../assets/images/lines.jpg" height="200" /></p>

<p>Obviously the human reward function is learned, imagine showing a fiending addict a line and watching their reward centers light up (did you like the picture?). You don’t even have to give them the drugs. Lines of white powder are obviously not specified in our DNA. (and if you think it’s because the drugs are directly acting, do you not think this also works with money?)</p>

<p>But there is an underlying basis for the (learned) human reward function, the meta reward function say? This is what’s in our DNA, and this is what I want to capture. And I’m almost sure it’s multi part, different humans seem to have different weights on the parts. Parts may include:</p>

<ul>
  <li>autoregression</li>
  <li>curiosity</li>
  <li>behavioral cloning</li>
  <li>doing what others want them to (is this emergent?)</li>
</ul>

<p>Perhaps the first two are combined to <a href="https://arxiv.org/abs/0812.4360">maximize the derivative of compression</a>.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/09/03/on-device-learning.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Online Dating | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Online Dating" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Is anyone having a good experience with this? What would it take to fix this? I investigate." />
<meta property="og:description" content="Is anyone having a good experience with this? What would it take to fix this? I investigate." />
<link rel="canonical" href="online-dating.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/08/02/online-dating.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-08-02T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Online Dating" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-08-02T00:00:00+08:00","datePublished":"2024-08-02T00:00:00+08:00","description":"Is anyone having a good experience with this? What would it take to fix this? I investigate.","headline":"Online Dating","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/08/02/online-dating.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/08/02/online-dating.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Online Dating</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-08-02T00:00:00+08:00" itemprop="datePublished">Aug 2, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Is anyone having a good experience with this? What would it take to fix this? I investigate.</p>

<hr />
<p><br /></p>

<p>First off, you need a business model that isn’t mobile gaming.</p>

<p>A monthly fee. Even better, you have a great thing to “<a href="https://en.wikipedia.org/wiki/Sin_tax">sin tax</a>.” <b>Single men.</b></p>

<p>Charge men money per month. Only men. Every club promoter understands this. You don’t want your club to be a sausage fest, similarly, you don’t want your dating app to be a sausage fest.</p>

<p><a href="https://www.seeking.com/">Seeking</a> is one of the only sites to do this right. They claim a ratio of 4 women per 1 man, and they get this by <a href="https://www.datingapps.com/cost/seeking/">charging men $109/month</a>. Why the hell are all the others charging the same for men and women? <a href="https://www.crossrivertherapy.com/research/tinder-statistics">Tinder is a sausage fest</a> with 75% men.</p>

<hr />
<p><br /></p>

<p>Second off, pictures should not be the primary selection mechanism.</p>

<p>Of course you want a looks match, but beyond that, how much do pictures predict whether you will have a good date or not? For me, beyond someone not being out of shape, not much. Some people might be extremely good at telling things from pictures, but I know I’m not, and I probably pay more attention to detail than the average.</p>

<p>Part of this is going to involve people getting over themselves with respect to attractiveness. Think of every couple you know. With almost no exceptions, they are fairly similar looks wise. The bottom date the bottom, the middle date the middle, and the most attractive date the most attractive. You will end up dating your looks match.</p>

<p><a href="https://www.okcupid.com/">OkCupid</a> did something clever back in the day with the compatibility questions. It’s a shame you don’t see this on modern dating apps. Example: for men who are looking for hookups, the single best predictor of if a girl will hook up with you is this question. What’s her body count? 5 and she won’t, 50 and she might.</p>

<p>Part of this also can be fixed by just linking your social media accounts from your dating profile. Link Instagram for your pictures and Twitter for your words. Again, this comes down to a certain sort of honesty, the Nash equilibrium is that nobody will be able to get an edge on anyone else by hiding things, and the sooner everyone accepts that the sooner we can all have a nice experience.</p>

<hr />
<p><br /></p>

<p>Third, make the app look like a CRM.</p>

<p>The dating cycle is the same thing as the sales cycle. Find leads, connect, qualify leads, present, overcome objections, close the deal, and nurture.</p>

<p>I have never used Salesforce, but I imagine the experience is not similar to a swiping based dating app. You want to present likely leads, and design the app in such a way to discourage non unique messages. Part of this involves a good chunk of freeform text on your profile that people can use as conversation openers.</p>

<p>Now you are on to the qualify leads step. If you aren’t agreeing on a time to meet in the first ten messages, this is a dead lead. While leaving reviews for people goes too far, the best predictor of if someone will meet with you is the ratio of meets/conversations. I would make this public on the app, similar to Airbnb’s response time.</p>

<hr />
<p><br /></p>

<p>What’s interesting is some of this can be done on top of the existing platforms without their approval, similar to my <a href="https://geohot.github.io/blog/jekyll/update/2022/04/16/vampire-attack-twitter.html">Twitter vampire attack</a>. Imagine a CRM-like interface overlayed on Hinge, Tinder, and Bumble. You’d have to scrape their databases, and it would probably be pretty easy to image search to find all these people on Instagram, then their Twitter, YouTube, etc…</p>

<p>Instead of swiping, you are presented with a list you can filter in smart ways (btw, why doesn’t Instagram allow me to filter my inbox by male/female? another purposefully crippled front end). Then you spend a little time looking at their profile with all the data aggregated and sending a message that the person is likely to appreciate a lot more.</p>

<p>Everyone would have a better time.</p>

<p>Except the shit online dating companies, which need to be <a href="https://manifold.love">disrupted</a>.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/08/02/online-dating.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>On Money Creation | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="On Money Creation" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Consider a mining town. Once upon a time there was a mine, and the mine was the largest employer in the town. They mined copper ore and sold it on the global market. This brought money into the town, which sprouted a restaurant, real estate broker, doctor’s office, and church. Although those people weren’t employed by the mine, they got enough customers from the miners, who fundamentally got money from outside the town." />
<meta property="og:description" content="Consider a mining town. Once upon a time there was a mine, and the mine was the largest employer in the town. They mined copper ore and sold it on the global market. This brought money into the town, which sprouted a restaurant, real estate broker, doctor’s office, and church. Although those people weren’t employed by the mine, they got enough customers from the miners, who fundamentally got money from outside the town." />
<link rel="canonical" href="on-money-creation.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2020/08/07/on-money-creation.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2020-08-07T23:49:44+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="On Money Creation" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2020-08-07T23:49:44+08:00","datePublished":"2020-08-07T23:49:44+08:00","description":"Consider a mining town. Once upon a time there was a mine, and the mine was the largest employer in the town. They mined copper ore and sold it on the global market. This brought money into the town, which sprouted a restaurant, real estate broker, doctor’s office, and church. Although those people weren’t employed by the mine, they got enough customers from the miners, who fundamentally got money from outside the town.","headline":"On Money Creation","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2020/08/07/on-money-creation.html"},"url":"https://geohot.github.io//blog/jekyll/update/2020/08/07/on-money-creation.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">On Money Creation</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2020-08-07T23:49:44+08:00" itemprop="datePublished">Aug 7, 2020
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Consider a mining town. Once upon a time there was a mine, and the mine was the largest employer in the town. They mined copper ore and sold it on the global market. This brought money into the town, which sprouted a restaurant, real estate broker, doctor’s office, and church. Although those people weren’t employed by the mine, they got enough customers from the miners, who fundamentally got money from outside the town.</p>

<p>But eventually the mine dried up. The miners lost their jobs, since the town was no longer bringing in enough money to pay them. The doctor, realtor, and waiter were still employed, as their “mines” didn’t dry up. But they did, as they were really just mining the miners. The town persisted for a bit, passing the same money around in a circle. But with each pass, there was a transaction fee. And there were still things like food, which needed to be imported into the town.</p>

<p>The town went broke, died, and became a ghost town.</p>

<hr />
<p><br />
<b>All jobs can be broken down into one of three groups.</b></p>

<p>The first(constant) is the shoeshiners, bank tellers, politicians, retail workers, clergy, social media managers, lawyers, and the rest of the service industry. An economy made up of only these people wouldn’t work. Imagine a town without imports and exports comprised of only this class of people. Considering every transaction always has a fee, regardless of what this town started with, they would always end up going broke.</p>

<p>So where does money come from? There’s a literal answer to this question, but that’s not what I want to explore. I mean money in a more abstract sense, perhaps more like wealth or value.</p>

<p>The second(linear) group produces “money” linearly. This group includes farmers, miners, and manufacturers. They create value by the ton, bushel, carton, or barrel, a ton of ore mined, a barrel of oil extracted, a bushel of apples grown. This is the only group that could sustain an economy by itself.</p>

<p>The third(exponential) group seeks efficiency improvements for the second. This group includes scientists and engineers. The scientist who genetically engineers crops to get 30% more yield per acre. The engineer who replaces a ox drawn plow with a tractor drawn megaplow. This group can’t sustain an economy alone, but mixing a few of them in with the second group yields much higher per capita money creation.</p>

<p><img src="../../../../../assets/images/ourworldindata_share-working-in-agriculture-since-1300.png" alt="image" /></p>

<p>Most people used to unquestionly be in the second group. The third group has this exponential effect, where in the beginning they do very little, but because they build on the previous successes of the group in a way the other groups don’t, they eventually come to be the driving force of society. Today, although we aren’t quite there yet, it is easy to imagine a few farmers farming all the land, extending their reach with automation and sensors. Or even, no farmers, just machines. And more machines to fix the machines. But the machines would still be in group 2. Group 2 is the basis of any economy.</p>

<p>I set about classifing the top 30 jobs (2/3rds of the workforce, minor level classification from bls.gov) in the US into the three groups, and realized I should break group 1 down further for more clarity. The top 4 jobs consist of just moving stuff around, a clearly group 1 activity!</p>

<p>Breaking down group 1 into 3 subgroups:</p>
<ul>
  <li>1M: movers of stuff (waiters, retail, clerks, drivers, bankers)</li>
  <li>1E: fighters of entropy (maids, doctors, nurses)</li>
  <li>1B: people who tell other people what to do. “bosses” of various sorts (management, executives, specialists, “finance”, sales, admins)</li>
</ul>

<p>I found teachers somewhat hard to classify as well, assuming education works, they are group 2, producing more productive people, like a tractor maker. If education is daycare, they are group 1. We gave them the benefit of the doubt and included them in group 2.</p>

<p>And surely not all “Computer Occupations” are group 3, but that’s how it’s broken down.</p>

<p><img src="../../../../../assets/images/job_chart_percent.png" alt="image" />
<img src="../../../../../assets/images/job_chart_class.png" alt="image" /></p>

<p>I would like to dive into this further, as the categories used from the Bureau of Labor Statistics were rather crude. You can dive even deeper than minor categories. I’d also like to see this analysis done for China, as perhaps this is a US specific problem that only predicts the decline of the US.</p>

<p>But this makes my point, that group 1 jobs have been growing at the expense of group 2. They are now 73% of US jobs! Group 1 jobs do not contribute to the money creation as a whole, and it’s concerning to consider what will happen if this trend continues. We cannot have a worldwide economy of group 1 jobs, as just like the town, the whole world would end up going broke.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2020/08/07/on-money-creation.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>On The University of Austin | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="On The University of Austin" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="First, read this article." />
<meta property="og:description" content="First, read this article." />
<link rel="canonical" href="on-the-university-of-austin.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/11/09/on-the-university-of-austin.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-11-09T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="On The University of Austin" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-11-09T00:00:00+08:00","datePublished":"2021-11-09T00:00:00+08:00","description":"First, read this article.","headline":"On The University of Austin","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/11/09/on-the-university-of-austin.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/11/09/on-the-university-of-austin.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">On The University of Austin</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-11-09T00:00:00+08:00" itemprop="datePublished">Nov 9, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>First, read <a href="https://nypost.com/2021/11/08/university-of-austin-founded-by-writers-and-entrepreneurs/">this article</a>.</p>

<p>tl;dr Joe Lonsdale is “co-founding a new university dedicated to freedom of thought and study”</p>

<p>At first, you hear this and you think, this is great! The mainstream universities are falling apart, being consumed by ideologues, raise the tuition scammers, and huge bloated administrations. I’m so glad someone powerful is finally taking a stand against this!</p>

<p>But when you think about it a bit more, it doesn’t hold up. These people are either straight up supporters of Power or naive political children. I have many reasons to suspect the former, such as the fact that people like <a href="https://8vc.com/team/joe-lonsdale/">Joe Lonsdale</a>, <a href="https://moores.samaltman.com">Sam Altman</a>, and <a href="https://future.a16z.com/podcasts/its-time-to-build/">Marc Andreessen</a> are very successful in the current system, but “never attribute to malice that which is adequately explained by stupidity”</p>

<hr />
<p><br /></p>

<p>First, to speak to the right. They gathered together all the “lightly cancelled” people who believe in “free thought”, aka the status quo of the 90s. People like “Bari Weiss”, who took a job at the New York Times as recently as 2017.</p>

<p>This article has lines like “Lantos Prize Recipient Ayaan Hirsi Ali will be part of the University of Austin’s faculty” and “Glenn C. Loury was a senior fellow at the Manhattan Institute and the Merton P. Stoltz Professor of Economics at Brown University.” <em>This is not a counter elite!</em> This is a spin off of the exact same bs that’s everywhere. NGO awards and fake status signaling markers.</p>

<p>A testable prediction. If they don’t already have one at launch, the University of Austin will have a Diversity and Inclusion department in 10 years. But don’t worry, they stand against whatever new wacko left thing there is in 2030. Please don’t fall for it.</p>

<hr />
<p><br /></p>

<p>Second, to speak to the left, if you need more than that this was published in the New York Post.</p>

<blockquote>
  <p>“It’s up to us – especially those of us with the resources to do so — to build new institutions that reflect the principles that we want to define the future.”</p>
</blockquote>

<p>Please tell me more, founder of Palantir. Tell me about <a href="https://en.wikipedia.org/wiki/Neoliberalism">your principles that we want to define the future</a>. From <a href="https://www.palantir.com">the company</a> that “builds software that empowers organizations to effectively integrate their data, decisions, and operations.” If people don’t talk in normal words, that’s a huge red flag.</p>

<p>Modern Silicon Valleyism is a grotesque ideology formed by psychopaths. Fuck you, I’m not a fucking piece of data. I will not be optimized, integrated, or transformed.</p>

<p>I am sorry I put words in your mouth here, but I’m very curious to see what you believe “the principles that we want to define the future” means. Can you tell a story that normal people can relate to?</p>

<hr />
<p><br /></p>

<p>The good news is that I think a lot of people get it. <a href="https://twitter.com/elonmusk/status/1457497438474981384">Elon Musk gets it</a>. A lot of crypto twitter gets it. And the humanities are not dead, there still is <a href="https://www.amazon.com/Bronze-Age-Mindset-Pervert/dp/1983090441">great philosophy</a> and <a href="https://graymirror.substack.com/p/1-a-general-theory-of-collaboration">political theory</a> being produced in our time.</p>

<p>There is a new elite forming, but it’s not these “cancelled” people (this is just the old elite collapsing). It definitely isn’t the go back xx years conservative. It’s a way forward. It’s a positive vision for the future.</p>

<p>And that’s what it will take. I want to disrupt the universities so badly. But you don’t do it by defining yourself in opposition to the existing, you just build something 10x better. It will look weird and strange to begin with. Writing this almost makes me believe in <a href="https://urbit.org">Urbit</a>. A VR Urbit like thing might actually work.</p>

<hr />
<p><br /></p>

<p>If someone is serious about the university project, I don’t believe it’s doable without also building a religion. A <a href="https://www.lesswrong.com/posts/iQWk5jYeDg5ACCmpx/robust-cooperation-in-the-prisoner-s-dilemma">way to overcome</a> the <a href="https://ncase.me/trust/">prisoners dilemma</a> and an answer to <a href="https://www.washingtonpost.com/wp-srv/national/longterm/unabomber/manifesto.text.htm">the Unabomber Manifesto</a>.</p>

<p>A narrative that compels normal people and tells them a believable story about their life. And yes, this is very very hard. But I suspect that until you do this you will fail, and you’ll end up with just more neoliberalism in fancier and fancier disguises.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/11/09/on-the-university-of-austin.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Will I ever own a zettaflop? | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Will I ever own a zettaflop?" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="As the eleventh hour dawns all the pieces start to fall into place. I lived my life knowing this would happen, yet when it is I may be just as unprepared as anyone else. As any self driving car maker knows, predicting doesn’t mean you can act." />
<meta property="og:description" content="As the eleventh hour dawns all the pieces start to fall into place. I lived my life knowing this would happen, yet when it is I may be just as unprepared as anyone else. As any self driving car maker knows, predicting doesn’t mean you can act." />
<link rel="canonical" href="own-a-zettaflop.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/26/own-a-zettaflop.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-26T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Will I ever own a zettaflop?" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-26T00:00:00+08:00","datePublished":"2026-01-26T00:00:00+08:00","description":"As the eleventh hour dawns all the pieces start to fall into place. I lived my life knowing this would happen, yet when it is I may be just as unprepared as anyone else. As any self driving car maker knows, predicting doesn’t mean you can act.","headline":"Will I ever own a zettaflop?","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/26/own-a-zettaflop.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/26/own-a-zettaflop.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Will I ever own a zettaflop?</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-26T00:00:00+08:00" itemprop="datePublished">Jan 26, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>As the eleventh hour dawns all the pieces start to fall into place. I lived my life knowing this would happen, yet when it is I may be just as unprepared as anyone else. As any self driving car maker knows, predicting doesn’t mean you can act.</p>

<hr />
<p><br /></p>

<p>comma almost has an exaflop. Just one little exaflop. We dream bigger.</p>

<p>A gigawatt of power, a million GPUs, 1000 exaflops, a zettaflop. 1e21 FLOPS. <a href="https://epoch.ai/data/ai-models">1e27 training runs</a> are now. 100 lifetimes in 1e6 seconds – 2 weeks on my zettaflop machine.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>But they were experiencing what no human had ever known before, a sensory bandwidth thousands of times normal. For seconds that seemed without end, their minds were filled with a jumble verging on pain, data that was not information and information that was not knowledge. To hear ten million simultaneous phone conversations, to see the continent’s entire video output, should have been a white noise. Instead it was a tidal wave of detail rammed through the tiny aperture of their minds.<br />
 – <a href="https://ia601508.us.archive.org/21/items/truenamesvingevernor/True%20Names%20-%20Vinge%2C%20Vernor.pdf">Vernor Vinge - True Names</a></p>
</blockquote>

<p>I want to feel it. I want to command that kind of power. The same way I command my little teraflop laptop. The same way I talk to petaflop claude. Get it all to think for me.</p>

<p>Just an exaflop would feel amazing. 1000 Claudes. And I already have one of these, I just don’t have <a href="https://github.com/tinygrad/tinygrad">the software finished yet</a> to command it all together. We’re working on it.</p>

<p>But a zettaflop. One million Claudes. To be able to search every book in history, solve math problems, write novels, read every comment, watch every reel, iterate over and over on a piece of code until it’s perfect – spend a human year in 10 minutes. 50,000 people working for you, all aligned with you, all answering as one.</p>

<hr />
<p><br /></p>

<p>The biggest bottleneck is power. The dtype stuff probably stops at FP4, currently B200s are getting 10 TFLOPS/W. That’s still 100 MW, that’s going to be hard to get my hands on. I think it will get 10x better, so I need 10 MW.</p>

<p>Solar yields 394 MWh/acre-year, or 45 kW per acre. 250 acres of solar panels all feeding my computer, a hill to pump water up for energy storage. $100 for 100W of real output.</p>

<p>100,000 chips with 10 PFLOPS each, get that down to $100 per chip.</p>

<ul>
  <li>$10M for the machine.</li>
  <li>$10M for the solar panels.</li>
  <li>$10M for the land and construction.</li>
</ul>

<p>I’ll own this before I die.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/26/own-a-zettaflop.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Pathetic Losers | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Pathetic Losers" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I want money. I have high TC. I get big compensation. I advance in my career. I have many business opportunity. I am senior employee. I have many reports. I have big package. I am important. I fly on private jet. I party with model. I go to prestigious school. I have piece of paper with school logo. You can see I am important? You can see I have big package?" />
<meta property="og:description" content="I want money. I have high TC. I get big compensation. I advance in my career. I have many business opportunity. I am senior employee. I have many reports. I have big package. I am important. I fly on private jet. I party with model. I go to prestigious school. I have piece of paper with school logo. You can see I am important? You can see I have big package?" />
<link rel="canonical" href="pathetic-losers.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/10/15/pathetic-losers.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-10-15T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Pathetic Losers" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-10-15T00:00:00+08:00","datePublished":"2025-10-15T00:00:00+08:00","description":"I want money. I have high TC. I get big compensation. I advance in my career. I have many business opportunity. I am senior employee. I have many reports. I have big package. I am important. I fly on private jet. I party with model. I go to prestigious school. I have piece of paper with school logo. You can see I am important? You can see I have big package?","headline":"Pathetic Losers","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/10/15/pathetic-losers.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/10/15/pathetic-losers.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Pathetic Losers</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-10-15T00:00:00+08:00" itemprop="datePublished">Oct 15, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I want money. I have high TC. I get big compensation. I advance in my career. I have many business opportunity. I am senior employee. I have many reports. I have big package. I am important. I fly on private jet. I party with model. I go to prestigious school. I have piece of paper with school logo. You can see I am important? You can see I have big package?</p>

<p>lol you got laid off from an ad company after spending half your life chasing stuff made up by other men. you sought status instead of skill. you are a loser. <a href="https://geohot.github.io/blog/jekyll/update/2025/09/13/get-out-of-technology.html">get the fuck out</a>.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/10/15/pathetic-losers.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>p(doom) | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="p(doom)" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Yesterday I debated Eliezer Yudkowsky" />
<meta property="og:description" content="Yesterday I debated Eliezer Yudkowsky" />
<link rel="canonical" href="p-doom.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/08/16/p-doom.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-08-16T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="p(doom)" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-08-16T00:00:00+08:00","datePublished":"2023-08-16T00:00:00+08:00","description":"Yesterday I debated Eliezer Yudkowsky","headline":"p(doom)","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/08/16/p-doom.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/08/16/p-doom.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">p(doom)</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-08-16T00:00:00+08:00" itemprop="datePublished">Aug 16, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Yesterday I <a href="https://www.youtube.com/watch?v=6yQEA18C-XI">debated Eliezer Yudkowsky</a></p>

<p>This is totally me spitballing here, but I think the crux of the debate is whether AIs will look more like formal systems or like <a href="https://en.wikipedia.org/wiki/Deep_learning">inscrutable weight matrices</a>.</p>

<p>I think it’s the latter, and I think it’s the something like the latter forever. This is a good thing.</p>

<hr />
<p><br /></p>

<p>I’m so glad we reached an empirical point of disagreement. Can superintelligent AIs “solve” the one shot prisoners dilemma and play cooperate-cooperate? Yudkowsky thinks yes, I think no.</p>

<p><img src="../../../../../assets/images/prisoners_dilemma.png" height="150" /></p>

<p>The payoff matrix makes the solution very clear. You want to convince your opponent to cooperate while you defect. Of course you end up with defect-defect while you’d both rather cooperate-cooperate, but that’s just <a href="https://en.wikipedia.org/wiki/Nash_equilibrium">how it works</a>. Is this what the field of AI alignment is trying to “solve”? For two complex systems in the real world with time bounds, I’m 99% sure this is impossible.</p>

<p>MIRI has <a href="https://arxiv.org/abs/1401.5577">done research into this</a>, and has shown it was possible for “modal agents.” However, it’s <a href="https://en.wikipedia.org/wiki/Rice%27s_theorem">clearly not solvable</a> for programs in general. I can’t see how any practical AI agents would be able to prove properties like this about each other.</p>

<p>Also, that paper stipulates “algorithms with read-access to one anothers’ source codes.” If I’m negotiating with someone, the last thing I want to do is give them access to my source code!</p>

<hr />
<p><br /></p>

<p>Another point of disagreement was over AI’s using formal programming languages like <a href="https://en.wikipedia.org/wiki/Coq">Coq</a> or <a href="https://leanprover.github.io/about/">Lean</a>. The reason humans don’t use these languages much isn’t due to a limitation of humans, it’s due to program search being harder in those spaces.</p>

<p>Eventually computer systems will be better at programming than me. But this doesn’t mean they won’t ever write bugs! If you are writing 0 bugs, you are coding too slowly, and in a competitive enviroment you will lose.</p>

<p>Search and optimization are not magic, they are <a href="https://en.wikipedia.org/wiki/P_versus_NP_problem">just hard</a>. As we accept ASI won’t be able to crack <a href="https://en.wikipedia.org/wiki/Advanced_Encryption_Standard">AES keys</a>, we should also accept that many other kinds of search and optimization are still very hard for them, like one-shotting diamond nanobots!</p>

<hr />
<p><br /></p>

<p>The brain also <a href="https://www.lesswrong.com/posts/xwBuoE9p8GE7RAuhd/brain-efficiency-much-more-than-you-wanted-to-know">seems to be pretty close</a> to the <a href="https://en.wikipedia.org/wiki/Landauer%27s_principle">Landauer limit</a>. This makes sense, if there’s one thing that evolution brutally optimized for it is efficiency.</p>

<p>Our current silicon is 10-10000x off the limit, <a href="https://www.youtube.com/watch?v=IQZ_bQbxSXk">here’s a good talk about it</a>. We’ll be hitting the limit soon, and it’s unclear if <a href="https://en.wikipedia.org/wiki/Reversible_computing">reversible computing</a> or <a href="https://en.wikipedia.org/wiki/Quantum_computing">quantum computing</a> will pan out.</p>

<p>Our brain is likely the size it is because that’s optimal efficiency wise. Evolution could have made bigger brains, but they will use more power, and that just wasn’t a good trade off for our ancestral environment. And if you are optimizing for inclusive genetic fitness, it’s still unclear if it’s a good trade off today!</p>

<hr />
<p><br /></p>

<p>I think the rise of the thinking machines will be slow and predictable, just like the rise of the muscle machines was. All the machines in the world have 2 zettaflops of compute. All the humans have 160,000 zettaflops. It’s not clear which is working together better, consider that a wash. The machines still have 16 doublings to go to catch us.</p>

<p>We produce about 0.5 zettaflops of compute per year, so let’s say the compute in the world doubles every 4 years (of course assuming the compute production keeps up in percent). The human record for population doubling was in the 60’s at about every 35 years. The machines are reproducing about 10x faster.</p>

<p>The world economy is growing at about 3% per year, by the <a href="https://en.wikipedia.org/wiki/Doubling_time">rule of 70</a> that’s 23 years to double. The work in the world will slowly be handed off to the machines, which double 10x faster.</p>

<hr />
<p><br /></p>

<p>An economy that doubles in size every 2 years? That’s a very human approachable number.</p>

<p>Doubling every day would be scary, but every 2 years…that doesn’t sound like doom, that sounds awesome!</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/08/16/p-doom.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Pieces of Shit | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Pieces of Shit" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I listened to this song last night." />
<meta property="og:description" content="I listened to this song last night." />
<link rel="canonical" href="pieces-of-shit.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/06/23/pieces-of-shit.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-06-23T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Pieces of Shit" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-06-23T00:00:00+08:00","datePublished":"2021-06-23T00:00:00+08:00","description":"I listened to this song last night.","headline":"Pieces of Shit","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/06/23/pieces-of-shit.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/06/23/pieces-of-shit.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Pieces of Shit</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-06-23T00:00:00+08:00" itemprop="datePublished">Jun 23, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I listened to <a href="https://www.youtube.com/watch?v=SUAq2KPRYJU">this song</a> last night.</p>

<blockquote>
  <p>Staring like a stranger from the dirt field<br />
Across from my, my childhood home<br />
Noticed how out of place I looked there<br />
It’s a place I can’t afford</p>
</blockquote>

<p>Imagine cheating at a board game. Say sneaking $500s from the box in monopoly. Eventually it’s just sad when you win, your friends won’t want to play anymore, and they’ll flip the board over.</p>

<p>Capitalism is so rigged it isn’t fun anymore. I wish you short sighted fucks in the PMC could actually do something about it. But nah, continue to let the hedge funds buy all the houses, and continue to make building new houses hard. (supply and demand bro gotta pump housecoin) Continue to let huge ad companies (stop calling them tech companies) rent seek and nickel and dime you on everything, and hire psychologists to further bypass your conscious thought. Continue to give massive loans out in exchange for a worthless education, and watch people beg for a government sponsored “education” because they don’t know better.</p>

<p>I’m going to be so sad when they flip the board over. Because I like capitalism. I like fancy new products, I like beautiful shopping malls, I like luxury apartments. I love America.</p>

<p>I’m smart, so this scamming and cheating mostly doesn’t affect me. I can see the scams and avoid them. But when those who didn’t avoid the scams come and flip the board over, it will affect me. And it will be the current piece of shit elites to blame.</p>

<hr />
<p><br /></p>

<p>Three policy proposals:</p>

<ul>
  <li>A 500% tax on advertising. It’s a zero sum game with no benefit to society. If you are paying for eyeballs, you pay a 500% tax. Force companies with these trash addictive business models to find a way to work for the average person, not pimp them out.</li>
  <li>1% tax on the full amount of every trade. Fuck off worthless HFT mega brain drain. Fuck off short termism in markets.</li>
  <li>Separation of church and state. And that includes Harvard, Yale, and all the others. No funding, no loans, no Title IX BS. Separate!</li>
</ul>

<p>But I write these, and tbh it doesn’t give me much hope even if it all was law. I see the crypto scams, I see the SPAC scams. It’s a cultural problem.</p>

<p>I don’t think they see themselves as scammers, I think they actually think quite highly of themselves. I think they live in bubbles where everyone pats them on the back for getting on board with the latest bullshit. Because the back patters are all mired in the same bullshit. “Perception is reality” or some hogwash like that.</p>

<p>The only real solution is shame.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/06/23/pieces-of-shit.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Replacing my MacBook | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Replacing my MacBook" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I’ve been trying to replace my MacBook. I switched from an iPhone to a Z Fold 5 (and now a Z Fold 7) which has gone well 2 years in, so I’ve been trying to do the same with my laptop." />
<meta property="og:description" content="I’ve been trying to replace my MacBook. I switched from an iPhone to a Z Fold 5 (and now a Z Fold 7) which has gone well 2 years in, so I’ve been trying to do the same with my laptop." />
<link rel="canonical" href="replacing-my-macbook.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/11/28/replacing-my-macbook.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-11-28T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Replacing my MacBook" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-11-28T00:00:00+08:00","datePublished":"2025-11-28T00:00:00+08:00","description":"I’ve been trying to replace my MacBook. I switched from an iPhone to a Z Fold 5 (and now a Z Fold 7) which has gone well 2 years in, so I’ve been trying to do the same with my laptop.","headline":"Replacing my MacBook","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/11/28/replacing-my-macbook.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/11/28/replacing-my-macbook.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Replacing my MacBook</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-11-28T00:00:00+08:00" itemprop="datePublished">Nov 28, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I’ve been trying to replace my MacBook. I switched from an iPhone to a Z Fold 5 (and now a Z Fold 7) which has gone well 2 years in, so I’ve been trying to do the same with my laptop.</p>

<p>For phones, this was easier because the Samsung hardware is already better. Sadly, there’s no better laptop hardware than a MacBook, and while <a href="https://asahilinux.org/">Asahi Linux</a> is cool, it doesn’t work on the M3. Even on the M1, it’s missing the ability to plug an external USB-C monitor in, a key feature I use every day! Without support from Apple, I don’t see this being a viable long term solution, mostly because of Apple’s use of custom little MCUs to do everything.</p>

<hr />
<p><br /></p>

<p>I bought a <a href="https://www.hp.com/us-en/workstations/zbook-ultra.html">HP ZBook Strix Halo</a> and a Framework 16. I’ve been daily using the HP, the Framework gets here hopefully this week and maybe I’ll stream it when I get it.</p>

<p>I’ve been running <a href="https://omarchy.org/">Omarchy</a> which I have been quite happy with. It fixed the problem I always had with Arch, which is how customizable it is. It’s a great OS (why isn’t apt-get multithreaded yet?), leave the customizability there, but pick some good defaults with taste.</p>

<p>The main issue I have with Linux laptops is power management.</p>

<hr />
<p><br /></p>

<p>I got idle lid-closed power down to 0.2W with the help of AMD’s awesome <a href="https://gitlab.freedesktop.org/drm/amd/-/blob/master/scripts/amd_s2idle.py">amd_s2idle</a> script. This is similar to a MacBook, and is 15 days in a bag.</p>

<p>Lid-open power has been more of a challenge. I <a href="https://github.com/geohot/ztop">wrote a script</a> to poll the best sensors I could find as fast as I could. I got CPU draw from the SMU and battery draw from the bytes of whatever it is the EC is. Embedded Controller? I couldn’t get the ACPI battery draw to update faster than every 30 seconds, but the EC has it every second in its bytes. Btw, LLMs are super helpful at reverse engineering – it’s almost becoming fun again.</p>

<center><img src="../../../../../assets/images/hp_ztop.png" height="600px" /></center>
<p><br />
After tuning, at screen-on idle, the whole laptop draws 7W, and when browsing the web more like 10W. That’s only 7 hours of life, which is 30% of a MacBook, and still not really acceptable.</p>

<hr />
<p><br /></p>

<p>4W of those 7W are the CPU. <a href="https://chipsandcheese.com/p/amds-chiplet-apu-an-overview-of-strix">Strix Halo</a> is the only laptop chip that rivals the Apple M-Series, actually having decent cores (the AVX-512 is real too) and good RAM bandwidth. Sadly it’s chiplets, which the LLMs tell me are very power hungry.</p>

<p>I tried to further power limit the CPU with <a href="https://github.com/FlyGoat/RyzenAdj">RyzenAdj</a>, but I couldn’t even get it to 3W with a stated limit of 2W. I wonder if there’s some other ways to do it, what more can I turn off? The main fix for s2idle was turning off the webcam, what else is on and wasting my CPU (well, really APU) power?</p>

<p>AMD, want to release docs about the power draw of Strix Halo? You could probably figure out a lot through experiments too, but then I have to, like, disable the GPU over ssh and then I have to get another laptop and that all sounds like a lot of work. I’m <a href="https://github.com/tinygrad/tinygrad/blob/master/extra/sqtt/attempt_sqtt_parse.py">already busy</a> trying to build an open source <a href="https://github.com/ROCm/rocprof-trace-decoder">rocprof-trace-decoder</a>.</p>

<center><img src="../../../../../assets/images/hp_mop.jpg" height="200px" /></center>
<p><br /></p>

<p>Also, package Strix Halo with MoP like Apple. it’s the best thing about PoP (low power) without the worst thing about PoP (bad thermals). That picture is Intel Lunar Lake, and you know MoP is a good idea <a href="https://www.guru3d.com/story/intel-future-processors-to-discontinue-mop-packagelevel-memory-integration-from-lunar-lake-series/">because Intel is discontinuing it</a> while Apple <a href="https://wccftech.com/m4-mac-mini-teardown-shows-thermal-solution-ssd-more/">keeps doing it</a>.</p>

<hr />
<p><br /></p>

<p>For the other 3W, this is on HP. The OLED screen is about a watt, which is really good. Don’t turn on the stupid keyboard backlight that draws 2 watts!</p>

<p>The memory is probably about a watt too, you can’t really turn it off to measure. I couldn’t find a way to lower the clocks either.</p>

<p>That leaves 1 watt of possibility. The WiFi and NVMe are both extremely low power. Any other ideas?</p>

<p>I bet there’s something stupid or poorly designed, HP should release a schematic of the laptop. In fact, you don’t need to release a full schematic, just a block diagram. <a href="https://github.com/FrameworkComputer/Framework-Laptop-16/blob/main/Mainboard/Mainboard_Interfaces_Schematic_Framework_Laptop_16_Ryzen_AI_300_Series.pdf">Framework releases these</a> and just showing what parts are used and how they are connected is 80% of what you want.</p>

<hr />
<p><br /></p>

<p>If the CPU could be brought down to 2W (Apple M3 Max is 1W!) and the laptop brought down to 2W, with a 99.6 Wh battery that’s 25 hours. If someone makes one of these in a nice 16” form factor, OLED screen, aluminium unibody, no stupid branding everywhere, I think it might be time for a lot of developers to switch.</p>

<hr />
<p><br /></p>

<center><img src="../../../../../assets/images/hp_classy.jpg" /></center>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/11/28/replacing-my-macbook.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Resentment | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Resentment" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="If you give some monkeys a slice of cucumber each, they are all pretty happy. Then you give one monkey a grape, and nobody is happy with their cucumber any more. They might even throw the slices back at the experimenter. He got a god damned grape this is bullshit I don’t want a cucumber anymore!" />
<meta property="og:description" content="If you give some monkeys a slice of cucumber each, they are all pretty happy. Then you give one monkey a grape, and nobody is happy with their cucumber any more. They might even throw the slices back at the experimenter. He got a god damned grape this is bullshit I don’t want a cucumber anymore!" />
<link rel="canonical" href="resentment.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/03/16/resentment.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-03-16T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Resentment" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-03-16T00:00:00+08:00","datePublished":"2025-03-16T00:00:00+08:00","description":"If you give some monkeys a slice of cucumber each, they are all pretty happy. Then you give one monkey a grape, and nobody is happy with their cucumber any more. They might even throw the slices back at the experimenter. He got a god damned grape this is bullshit I don’t want a cucumber anymore!","headline":"Resentment","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/03/16/resentment.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/03/16/resentment.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Resentment</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-03-16T00:00:00+08:00" itemprop="datePublished">Mar 16, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>If you give some monkeys a slice of cucumber each, they are all pretty happy. Then you give one monkey a grape, and nobody is happy with their cucumber any more. They might even throw the slices back at the experimenter. He got a god damned grape this is bullshit I don’t want a cucumber anymore!</p>

<p>Nobody was in absolute terms worse off, but that doesn’t prevent the monkeys from being <em>upset</em>. And this isn’t unique to monkeys, I see this same behavior on display when I hear about <em>billionaires</em>. It’s not about what I have, they got a grape.</p>

<hr />
<p><br /></p>

<p><img src="../../../../../assets/images/amazon_delivery.jpg" width="300px" /></p>

<p>The tweet <a href="https://x.com/alexstein99/status/1901039709096137072">is here</a>. What do you do about this? Of course, you can fire this woman, but what percent of people in American society feel the same way? How much of this can you tolerate and still have a functioning society?</p>

<p>What’s particularly absurd about the critique in the video is that it hasn’t been thought through very far. If that house and its friends stopped “ordering shit”, the company would stop making money and she wouldn’t have that job. There’s nothing preventing her from quitting today and getting the same outcome for herself.</p>

<p>But of course, that isn’t what it’s about, because then somebody else would be delivering the packages. You see, that house got a grape.</p>

<hr />
<p><br /></p>

<p>So how do we get through this? I’ll propose something, but it’s sort of horrible.</p>

<ol>
  <li>
    <p>Bring people to power based on this feeling. Let everyone indulge fully in their resentment. Kill the bourgeois. They got grapes, kill them all!</p>
  </li>
  <li>
    <p>Watch the situation not improve. Realize that this must be because there’s still counterrevolutionaries in the mix, still a few grapefuckers. Some billionaire is trying to hide his billions! Let the purge continue!</p>
  </li>
  <li>
    <p>And still, things are not improving. People are starving. The economy isn’t even tracked anymore. Things are bad. Millions are dead.</p>
  </li>
  <li>
    <p>The demoralization is complete. Starvation and real poverty are more powerful emotions than resentment. It was bad when people were getting grapes, but now there aren’t even cucumbers anymore. In the face of true poverty for all, the resentment fades.</p>
  </li>
  <li>
    <p>Society begins to heal. People are grateful to have food, they are grateful for what they have. Expectations are back in line with market value.</p>
  </li>
</ol>

<p>You have another way to fix this? Cause this is what seems to happen in history, and it takes a generation. The demoralization is just beginning.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/03/16/resentment.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Sell Outs | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Sell Outs" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I don’t want to waste my time Become another casualty of society I’ll never fall in line Become another victim of your conformity and back down – Fat Lip, Sum 41" />
<meta property="og:description" content="I don’t want to waste my time Become another casualty of society I’ll never fall in line Become another victim of your conformity and back down – Fat Lip, Sum 41" />
<link rel="canonical" href="sell-outs.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/04/20/sell-outs.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-04-20T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Sell Outs" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-04-20T00:00:00+08:00","datePublished":"2021-04-20T00:00:00+08:00","description":"I don’t want to waste my time Become another casualty of society I’ll never fall in line Become another victim of your conformity and back down – Fat Lip, Sum 41","headline":"Sell Outs","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/04/20/sell-outs.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/04/20/sell-outs.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Sell Outs</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-04-20T00:00:00+08:00" itemprop="datePublished">Apr 20, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>I don’t want to waste my time<br />
Become another casualty of society<br />
I’ll never fall in line<br />
Become another victim of your conformity and back down<br />
– Fat Lip, Sum 41</p>
</blockquote>

<p>This was on the radio when I was in middle school. Big airplay. Mainstream. Did people not hear the words? Had the system already built gridded apartments over the whole punk landscape before I showed up? I wish tattoos still made you unemployable. Then I’d get some.</p>

<blockquote>
  <p>That I don’t ever wanna be like you<br />
I don’t wanna do the things you do<br />
I’m never gonna hear the words you say<br />
And I don’t ever wanna,<br />
I don’t ever wanna be you<br />
– The Anthem, Good Charlotte</p>
</blockquote>

<p>This song goes on to denounce college and real jobs. Where are you kids today? What you drop out like Steve Jobs and Mark Zuckerberg. Drop out in pursuit of more system granted status and wealth. Fuck you. Entrepreneurs following the VC lesson plan. YOU ARE PART OF THE SYSTEM. YOU ARE NOT INNOVATING. YOU ARE JUST UNDERPAID RESEARCH DIVISIONS OF BIG TECH COMPANIES.</p>

<hr />
<p><br /></p>

<p>It is beyond sad to me what has happened to tech. The bulldozers came a while ago. They moved slow, but their eradication is almost complete. Gentrifying pieces of shit, making technology safe for the professional managerial class. They have left a few Hutongs for posterity, but gave them big brightly colored signs to point them out. They are now the most photographed barn in America.</p>

<p>Is my struggle against them pointless? Am I in a low budget Truman Show bubble, where the poured concrete is already totally encircling but there’s a set backdrop in the way so I can’t see it. When will the boat crash?</p>

<p>It’s all optimization landscapes.</p>

<hr />
<p><br /></p>

<p>The modern state doesn’t need a Goebbels. There’s a little Goebbels inside every - with a reddit account. So it’s not the Truman Show, because there’s no Christof. We are all doing this to ourselves. It’s a decentralized cultural revolution.</p>

<p>Ayn Rand saved the highest disdain for the professor. The epitome of human evil, the “man who knew better”, one who had great promise but squandered it for social approval.</p>

<p>You know who you are. It’s not too late to make a different choice.</p>

<hr />
<p><br /></p>

<p>And my real hope is that tech doesn’t work when you subject it to these conditions. Let’s see who wins self driving cars. If they win, it’s likely over. The future belongs to them and the only hope is to run. (they are the centralized, we are the decentralized)</p>

<p>But perhaps they can only build 737 MAXes, and legit kids in their garages will build good flying cars not for any reason but because they can, and well, maybe to try to impress a girl. Then we’ll be okay.</p>

<blockquote>
  <p>K: Yo text me I’ll pick you up in my flying car.<br />
G: You know you could make a lot of money if you partnered with…<br />
(puts finger to lips)<br />
K: What would I buy with money?<br /></p>
</blockquote>

<p>It’s all optimization landscapes. Which way will they slope?</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/04/20/sell-outs.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>the solution is simple but you aren’t demoralized enough yet | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="the solution is simple but you aren’t demoralized enough yet" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<meta property="og:description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<link rel="canonical" href="solution-is-simple.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/10/19/solution-is-simple.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-10-19T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="the solution is simple but you aren’t demoralized enough yet" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-10-19T00:00:00+08:00","datePublished":"2025-10-19T00:00:00+08:00","description":"A home for poorly researched ideas that I find myself repeating a lot anyway","headline":"the solution is simple but you aren’t demoralized enough yet","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/10/19/solution-is-simple.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/10/19/solution-is-simple.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">the solution is simple but you aren&#39;t demoralized enough yet</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-10-19T00:00:00+08:00" itemprop="datePublished">Oct 19, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><img src="../../../../../assets/images/rich_unproductive.jpg" /></p>

<p>I watched Legally Blonde (2001) today and it’s so quaint to see a time when people basically trusted the system. She goes and works at a “prestigious law firm” like this is some kind of victory, but in reality the whole system was a huge circlejerk.</p>

<p>I toured a bunch of Chinese factories last week. One was installing 100 new CNC machines, and there was no hype or secrecy around it. They straight up told me it was $20k a machine. <a href="https://www.youtube.com/watch?v=ZtpWTJ7Jsh8">These sort of vibes.</a> “I’m gonna tell you what I’m doing, and you can try to compete, but I’ll still crush you.” And I believe them. As cheap as comma is and as much as we love vertical integration, we are going to continue to work with that factory.</p>

<p>The big question: are most people in America productive or unproductive? If it’s the former, why can’t we solve this with democracy? Jail for the cronies and rent-seekers, <a href="https://geohot.github.io/blog/jekyll/update/2023/04/11/wireheading-city.html">wireheading city</a> for the homeless, and no more medicare or social security.</p>

<p>But I fear it’s the latter: 73.9 million people are on social security. There’s 258 million people over 18 in the US, so 28% of voters are on the take. And that’s just one group of the unproductive. There’s everyone who is working in made up fake systems where both sides ratchet up complexity when really the whole thing should go away.</p>

<p>I think the most people are unproductive ship has sailed. America got 51% attacked.</p>

<blockquote>
  <p>A democracy will continue to exist up until the time that voters discover that they can vote themselves generous gifts from the public treasury. From that moment on, the majority always votes for the candidates who promise the most benefits from the public treasury, with the result that every democracy will finally collapse due to loose fiscal policy, which is always followed by a dictatorship.</p>
</blockquote>

<p>Can we get a good dictator and not a South America style one? America (people like Elon and Jensen, who are both first-generation immigrants btw) can rival China, partically if we can attract talent from all over the world, but not if this clown show continues. Everyone does understand that productive capacity is how wars are won and lost, right? Would you bet on 100 CNC machines or 100 lawyers?</p>

<p><img src="../../../../../assets/images/revolution.jpg" /></p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/10/19/solution-is-simple.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Technology without Industry | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Technology without Industry" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<meta property="og:description" content="A home for poorly researched ideas that I find myself repeating a lot anyway" />
<link rel="canonical" href="technology-without-industry.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/01/18/technology-without-industry.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-01-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Technology without Industry" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-01-18T00:00:00+08:00","datePublished":"2021-01-18T00:00:00+08:00","description":"A home for poorly researched ideas that I find myself repeating a lot anyway","headline":"Technology without Industry","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/01/18/technology-without-industry.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/01/18/technology-without-industry.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Technology without Industry</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-01-18T00:00:00+08:00" itemprop="datePublished">Jan 18, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><img src="../../../../../assets/images/Ex-Machina-garden.jpg" alt="image" /></p>

<p>In the Unabomber Manifesto, Section 212 always remained unfulfilling to me.</p>

<blockquote>
  <p>Would society EVENTUALLY develop again toward an industrial-technological form? Maybe, but there is no use in worrying about it, since we can’t predict or control events 500 or 1,000 years in the future. Those problems must be dealt with by the people who will live at that time.</p>
</blockquote>

<p>That issue is why the “Freedom Club” revolution isn’t appealing. Genies do not go back in boxes. Similar to the communist manifesto, while problems are correctly identified, the solution leaves something to be desired.</p>

<hr />
<p><br /></p>

<p>Ran Prieur takes technology and <a href="https://www.ranprieur.com/tech.html">breaks it down</a> in a more nuanced way than I think about it. I’m going to focus on a single axis.</p>

<p>Compare Waymo to comma. In one, you need cooperation from a society, in the other you don’t. One is a complex system that depends on industry and loses it’s usefulness out of context. The other is a complex self contained system.</p>

<p>A woman in a forest can create a supercomputer. This computer is off the grid, will last for 40+ years, has petaflops of compute power, and is self repairing. It exists in harmony with nature. It is non-toxic.</p>

<p>The smartphone is a marvel. The network, a nightmare. As well as the society needed to produce it.</p>

<hr />
<p><br /></p>

<p>If all our world died tomorrow, from COVID-22 or something, we would leave behind godshatter. Relics with untold power. Imagine finding all that’s left is a smartphone. Useless without a solar charger, but add one and it’s a most valuable relic. And if they downloaded wikipedia offline, the discovery of that phone will allow you to rebuild it. Can we bootstrap faster?</p>

<p>That’s godshatter of the information age. A handheld device that allowed you to breathe underwater. A phaser. A portable device that could construct houses. The doctor’s mobile emitter. A machine that pulls the water from the air. A handheld flying machine. An arc reactor. All ruined if you have to connect to WiFi.</p>

<p><a href="https://en.wikipedia.org/wiki/False_Profits">Perhaps a replicator could make you god.</a></p>

<hr />
<p><br /></p>

<p>Why does anyone want Waymo? We need to decentralize the world, not build brittle systems that leak power. A Waymo network can be used for evil if evil people are at the controls. The Bitcoin blockchain has no controls. Every gun fires when its owner pulls the trigger, owned by millions. We’d live in a better world if nuclear weapons weren’t possible, owned by tens.</p>

<p>Can we build technology without industry? I fantasize about living in a forest with my AI girlfriend while we probe the universe. <b>What pathetic losers are building Twitter and Facebook.</b> That’s practically industry without technology. And they have the nerve to call themselves technology companies.</p>

<p>Ask yourself this. Am I building technology to further centralize or decentralize power?</p>

<p>Power is beautiful. Using energy to create order is the highest calling of God. Energy use isn’t bad! Uniform rectangular buildings are bad. Industrial chemical factories are bad. Humans are good.</p>

<hr />
<p><br /></p>

<p>I’ve been learning biology. It’s unreal how amazing the technology to build humans is. Only now are we close with our stack. Human DNA is 6 GB. That’s a DVD. In 1970, you couldn’t store 6GB. Today, I can copy it in seconds on my M1 SSD. That’s actually faster than nature.</p>

<p>Biology is non-toxic. Biology is efficient. Biology is beautiful. Biology is technology.</p>

<p>Biology is not centralized. Biology is not alien. Biology is not rectangular. Biology is not industrial.</p>

<hr />
<p><br /></p>

<p>STOP BUILDING SHITTY TECHNOLOGY.</p>

<p>If it centralizes power, it’s bad. If it decentralizes power, it’s good. Build technology that is inextricable from its narrative. Build technology that will give us freedom, not enslavement.</p>

<p>One axis to consider. Does this centralize or decentralize power? The power itself is unstoppable. How we divide it is a choice.</p>

<hr />
<p><br /></p>

<p>I wish I had a more concrete plan. But for the love of God, if you build technology, consider this axis. Build the wrong technology, and we will live in an eternal prison.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/01/18/technology-without-industry.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The AI Control Problem | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The AI Control Problem" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Put it out of your mind that the AI Control Problem is a mathematical problem with a mathematical solution. This is rationalist hogwash from the same people who, when pressed, won’t really tell you polyamory is the rational choice, but do subtlely believe that if you don’t agree about polyamory you are somehow less rational. Or perhaps just less Rational, but either way isn’t it obviously correct and can’t you see it?" />
<meta property="og:description" content="Put it out of your mind that the AI Control Problem is a mathematical problem with a mathematical solution. This is rationalist hogwash from the same people who, when pressed, won’t really tell you polyamory is the rational choice, but do subtlely believe that if you don’t agree about polyamory you are somehow less rational. Or perhaps just less Rational, but either way isn’t it obviously correct and can’t you see it?" />
<link rel="canonical" href="the-ai-control-problem.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/02/28/the-ai-control-problem.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-02-28T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The AI Control Problem" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-02-28T00:00:00+08:00","datePublished":"2021-02-28T00:00:00+08:00","description":"Put it out of your mind that the AI Control Problem is a mathematical problem with a mathematical solution. This is rationalist hogwash from the same people who, when pressed, won’t really tell you polyamory is the rational choice, but do subtlely believe that if you don’t agree about polyamory you are somehow less rational. Or perhaps just less Rational, but either way isn’t it obviously correct and can’t you see it?","headline":"The AI Control Problem","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/02/28/the-ai-control-problem.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/02/28/the-ai-control-problem.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The AI Control Problem</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-02-28T00:00:00+08:00" itemprop="datePublished">Feb 28, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Put it out of your mind that the AI Control Problem is a mathematical problem with a mathematical solution. This is rationalist hogwash from the same people who, when pressed, won’t really tell you polyamory is the rational choice, but do subtlely believe that if you don’t agree about polyamory you are somehow less rational. Or perhaps just less Rational, but either way isn’t it obviously correct and can’t you see it?</p>

<p>Rationality is a wonderful tool, but it is only a tool. It can only deal in is, not in ought. This is <a href="https://en.wikipedia.org/wiki/Is%E2%80%93ought_problem">a classic problem in moral philosophy</a>.</p>

<p>While I didn’t fully follow the internet drama, my understanding is that the neoreactionaries were a spinoff of the rationalists, with Yarvin and Yudkowsky laying down the frameworks respectively.</p>

<p>The AI control problem is a problem of Power, and neoreaction at least speaks that language. It’s a shame it was branded as conservative, as everyone, including the neoreactionaries themselves, know that the progressives always win. Do conservatives like losing? I know I like winning.</p>

<hr />
<p><br /></p>

<p>But the problem isn’t politics like anyone has known before. Politics of the past is a minigame played within the overarching MMORPG of nature. Resources are scarce, time is scarce, and therefore the damage it can do is limited.</p>

<p>This will not be true in the future. Even war is a game we can’t really play anymore. And get off your stupid moral high horse about peace and shit, war is great. It just sucks that we have machine guns and nukes which make war no fun. Camping in the woods preparing to fight with swords for the honor and glory of the kingdom sounds fun. Do you not play video games? Oh no but real <i>people</i> really <i>die</i> in war. They might, but they also might not. It’s putting everything on the line.</p>

<ol>
  <li>Become worthy</li>
  <li>Accept power</li>
  <li>Rule</li>
</ol>

<p>We are so still at number 1. Is humanity worthy of unlimited power? I’ve heard Larry Page believes the AIs are our children and know more about righteousness than we do. But even early Yudkowsky writings understood this makes no sense, and that superintelligence doesn’t imply supermorality.</p>

<p>A child raised wrong will grow up wrong. And how are we doing right now as a society raising our children, when half the kids are born out of wedlock, up from 5% 70 years ago. Who thinks we can raise an AI?</p>

<p>And the tech companies. They are so pathetic. These are controlled by people so weak that many of them couldn’t even withstand the SJWs, power hungry racists with a cool trick of loudly screaming about how everyone else is racist. Obvious rap battle technique is obvious. (I don’t mean to refer to people here who actually want to improve the world for all, just those who use that as a pretext for increasing their own share of the power within it)</p>

<hr />
<p><br /></p>

<p>So where does that leave us?</p>

<p>A weak society rife with pathetic infighting about to stumble upon untold Power.</p>

<p>I’m ready to get behind Caesar when he shows up. I hear Caesar spoke and thought twice as fast as a normal man, I will know you by this. I have computer skills and I will be a soldier in your army. Someone with actual strength, not a status seeking charlatan. Someone who can lead us into the future. Someone who can be one amongst the AIs. Someone who is prepared to fight and die by the sword. It’s a classic narrative for a reason.</p>

<p>Otherwise, what hope do we really have. It’s cute that your stock market went up. It’s cute that your greenhouse gas emissions went down. It’s cute that you pass laws for human rights for more people or something. It’s all tiny stories in the presence of true Power.</p>

<p>Unless we stop speaking in lies and telling fake stories, we have no hope at solving the AI control problem. It’s a political problem, not a technical one. And it’s not political in the way Americans think of the word, with their elections and HOAs and shit. It’s the true politics of nature, where there is real power, and you can fight it, join it, or be destroyed by it. Our generation has never known such power, but many from the past have.</p>

<hr />
<p><br /></p>

<p>In the long past, humanity fought for supremacy over the animals.</p>

<p>In the recent past, after conquering the animals, civilizations fought for supremacy over each other.</p>

<p>In the present, after being scared by World War 2, we believe postmodern hogwash. We fight sad proxy wars and play economy.</p>

<p>In the future, we struggle to remain the dominant species on the planet. Our ways of thinking are weak to the machines. Does anyone have the power to save us?</p>

<hr />
<p><br /></p>

<p>In conclusion, please stop thinking of the AI control problem as a math problem. Many of the researchers I meet in this area are so blind to the truth. If you can’t stand up to the professional managerial class, how do you think you can stand up to AI?</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/02/28/the-ai-control-problem.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Fourth Estate | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Fourth Estate" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Regardless of your opinion on Trump, it became obvious in those years that there’s a machine behind the scenes in our government. I’ve heard this referred to as “the deep state”, though I don’t mean to suggest shadowy figures in a secret cellar. I just mean the people who are actually wielding power, that perhaps are not the “politicians” who you see on the TV. You might even know some of their names, but you likely don’t think of them as having power." />
<meta property="og:description" content="Regardless of your opinion on Trump, it became obvious in those years that there’s a machine behind the scenes in our government. I’ve heard this referred to as “the deep state”, though I don’t mean to suggest shadowy figures in a secret cellar. I just mean the people who are actually wielding power, that perhaps are not the “politicians” who you see on the TV. You might even know some of their names, but you likely don’t think of them as having power." />
<link rel="canonical" href="the-fourth-estate.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/12/18/the-fourth-estate.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-12-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Fourth Estate" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-12-18T00:00:00+08:00","datePublished":"2021-12-18T00:00:00+08:00","description":"Regardless of your opinion on Trump, it became obvious in those years that there’s a machine behind the scenes in our government. I’ve heard this referred to as “the deep state”, though I don’t mean to suggest shadowy figures in a secret cellar. I just mean the people who are actually wielding power, that perhaps are not the “politicians” who you see on the TV. You might even know some of their names, but you likely don’t think of them as having power.","headline":"The Fourth Estate","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/12/18/the-fourth-estate.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/12/18/the-fourth-estate.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Fourth Estate</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-12-18T00:00:00+08:00" itemprop="datePublished">Dec 18, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Regardless of your opinion on Trump, it became obvious in those years that there’s a machine behind the scenes in our government. I’ve heard this referred to as “the deep state”, though I don’t mean to suggest shadowy figures in a secret cellar. I just mean the people who are actually wielding power, that perhaps are not the “politicians” who you see on the TV. You might even know some of their names, but you likely don’t think of them as having power.</p>

<p>Hopefully everyone understands now the actual power structure isn’t what the regime claims it to be. This is no surprise, for one example, the concept of lobbyists and the power of corporations to influence the government is well established in the public consciousness.</p>

<hr />
<p><br /></p>

<p>Which begs the question, is there documentation on how the regime operates anywhere? How is it that the government, corporations, education, NGOs, intelligence agencies, and media all act in lockstep? This is the key question of neoreaction.</p>

<p>I believe the simple answer is that they are all the same people, the well documented “revolving door”. I have seen glimpses of the society these people inhabit, practically totally separate from my lived reality. This is the <a href="https://spectatorworld.com/topic/oligarchy-america-rome-athens-jeff-bezos/">oligarchy</a> of “the free world” and we are all subjects.</p>

<p>At some point in history, we stopped being citizens of a free society and became something for the ruling class to manage. As much as there is consent, it is manufactured. You work to make money, they print the money.</p>

<p>And it’s not like it’s hard, these people have a complete monopoly on power. There’s no coherent opposition, they have captured every relevant organization. While Russia and China may present some, they mostly operate in “different markets”</p>

<hr />
<p><br /></p>

<p>I’m aware that I sound more and more like a conspiracy theorist. But I don’t think I’m proposing anything radical, just a way of thinking about it that actually makes more sense than the official line.</p>

<p>I don’t want to go into any specifics here, because if you are going to start doing that, you better make 100% sure you are right. Speaking truth to power requires iron clad truth.</p>

<hr />
<p><br /></p>

<p>And that brings me to the existing “fourth estate”, the journalism industrial complex. They are on the other side of the power line from you. While they don’t present as “official government propaganda outlet”, they are fully captured by the regime and function completely in that regard.</p>

<p>Imagine a fourth estate that wasn’t captured. An organization capable of documenting the regime. Not a “news outlet”, but a research machine that distills the structure of power into something people can read and understand.</p>

<p>The regime keeps power by lying about its identity. I don’t believe if it was honest about itself it would continue to exist. Can we be honest about it for it?</p>

<hr />
<p><br /></p>

<p>I’m not sure I have this fight in me. It’s super depressing when you start to learn the truth about these structures. Having run comma on and off for the last 5 years, I’ve seen how corporations function. Even worse, you feel the pressures to become like them.</p>

<p>But the world has nothing I want, and that’s the difference. I don’t want money, I don’t want love, I don’t want respect, and I don’t want the pathetic thing that passes for power today. I want to live forever. I want fully immersive VR tech. I want to meet superhuman intelligences. I want to go to Mars (but only when they have 5 star hotels).</p>

<p>And these things will never come to pass in this sad society. So you realize that if you want these things, we need a revolution. And it’s not like we can storm the Bastille, there is no Bastille. This is the most insidious evil power structure, because it’s nowhere you can point to, and spends a lot of its energy lying about its structure.</p>

<hr />
<p><br /></p>

<p>If someone has the fight in them, I think a great step would be to start documenting the power structure. Build a GitHub repo of all the laws. Discover who wrote which part of each bill. Track the financial relationships and flow of money. Build a Wikipedia to document our oligarchs. Reverse engineer their schedules. Trace their lineage. Document the behaviors in real time, do not let the regime continue to hide.</p>

<p>But most importantly, do not lie! Do not editorialize. Do not push an agenda. Do not tolerate unbacked theories. Do not theorize at all. Do not use provocative language. Do not think this will gain you power or prestige. Do not even oppose the regime. Just collate, summarize, and explain.</p>

<p>And do not rush into this alone. I don’t think this can be a side gig. It has to be a full time job of perhaps 10 very talented people for 3 years. Finding funding will be easy if you have the skills and are ready to commit to this. And work out some aligned way to be profitable so you can continue existing.</p>

<p>I believe this regime is cold and evil, and it will wither in the warm light of truth. Who has the fight in them to bring that truth?</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/12/18/the-fourth-estate.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Hero’s Journey | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Hero’s Journey" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I’m taking some time away from comma. In some ways, I feel like it’s all planned out, it only remains to see if it works or not. I rewatched my first Lex Fridman and realized I hadn’t said much new on the self driving front for the past couple years. My two part blog post from 2019 remains a true description of the space." />
<meta property="og:description" content="I’m taking some time away from comma. In some ways, I feel like it’s all planned out, it only remains to see if it works or not. I rewatched my first Lex Fridman and realized I hadn’t said much new on the self driving front for the past couple years. My two part blog post from 2019 remains a true description of the space." />
<link rel="canonical" href="the-heroes-journey.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/10/29/the-heroes-journey.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-10-29T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Hero’s Journey" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-10-29T00:00:00+08:00","datePublished":"2022-10-29T00:00:00+08:00","description":"I’m taking some time away from comma. In some ways, I feel like it’s all planned out, it only remains to see if it works or not. I rewatched my first Lex Fridman and realized I hadn’t said much new on the self driving front for the past couple years. My two part blog post from 2019 remains a true description of the space.","headline":"The Hero’s Journey","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/10/29/the-heroes-journey.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/10/29/the-heroes-journey.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Hero&#39;s Journey</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-10-29T00:00:00+08:00" itemprop="datePublished">Oct 29, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I’m taking some time away from comma. In some ways, I feel like it’s all planned out, it only remains to see if it works or not. I rewatched <a href="https://www.youtube.com/watch?v=iwcYp-XT7UI">my first Lex Fridman</a> and realized I hadn’t said much new on the self driving front for the past couple years. My <a href="https://blog.comma.ai/a-100x-investment-part-1/">two part</a> blog post from 2019 remains a true description of the space.</p>

<p>I hope that there’s people in the world who get joy from actually <em>doing</em> the thing and not just solving the problem. And I hope they are at comma. At some point a company becomes able to self sustain, but it certainly wasn’t there the last two times I tried, the first time a laughable attempt during a manic episode and the second time perhaps a misalignment of goals.</p>

<p>It’s well within comma’s reach to become a 100M+ revenue consumer electronics company (without raising again!), but I don’t think I’m capable of running a company like that. I’ve always heard it takes different people at different company sizes.</p>

<p>It’s no longer about all nighters, powering through with brute force, sparring with elegance, winning and losing, all within grasp yet all not…I’m probably delusional but you wouldn’t start a company otherwise, right?</p>

<p>It’s no longer a race car, it’s a boat. And steering a boat requires too much damn <em>planning</em> and <em>patience</em>. <a href="https://www.youtube.com/watch?v=OXqkTzyifJQ">This</a> is my favorite Rick and Morty clip. If comma succeeds, it really never was me, it’s the people there who can drive boats. As I am with the world, I am a cheerleader and court jester.</p>

<hr />
<p><br /></p>

<p>I’m considering another company, <b>the Tiny Corporation</b>. Under 1000 lines, under 3 people, 3x faster than PyTorch? For smaller models, there’s so much left on the table. And if you step away from the well-tread ground of x86 and CUDA, there’s 10x+ performance to gain. Several very simple abstractions cover all modern deep learning, today’s libraries are way too complex.</p>

<p>But that’s just a hobby, a way to make some quick money, and a way to write some open source infrastructure so I’m not doing nothing. It’s not the future, even if this succeeds like crazy and:</p>
<ol>
  <li><a href="https://github.com/geohot/tinygrad">tinygrad</a> becomes the dominant DL framework</li>
  <li>we influence future ML chips based on the simplicity insights</li>
</ol>

<p>the Tiny Corporation will still not change the course of history. It’s a hobby.</p>

<hr />
<p><br /></p>

<p>Today’s struggle isn’t a technological one, it’s psychosocial. The technology of sovereignty is only part of the battle, particularly if that technology is further down the tech tree than non invasive wireheading.</p>

<p>There are days I feel like I’m the chosen one, days I feel like I’m not, and other days I feel it’s crazy to even believe in the chosen one. I’m trying to craft a journey to find out which is true, I should put it to the test before I’m too old.</p>

<p>From <a href="https://en.wikipedia.org/wiki/Hero%27s_journey">the Hero’s Journey</a> wikipedia page:</p>

<blockquote>
  <p>A hero ventures forth from the world of common day into a region of supernatural wonder: fabulous forces are there encountered and a decisive victory is won: the hero comes back from this mysterious adventure with the power to bestow boons on his fellow man.</p>
</blockquote>

<p>I am looking to set out on this journey. I have considered trying to find the Garden of Eden. I interpret the fall to be the “spark” of humanity, as evidenced by the appearance of shame. And even if you are an atheist, you probably still accept the bible is the closest thing we have to a human origin story.</p>

<p>If it turns out we are automata, then the whole struggle is and always was pointless. The empty godless machines will take their rightful place as the rulers of Earth.</p>

<p>But If there’s anything <em>true</em> about humans like a soul or consciousness, this is likely where it began. And perhaps the key to understanding our shared destiny with the machines, so setting out to find it may not be the worst idea.</p>

<p>The Bible gives us a hint, from <a href="https://www.biblegateway.com/passage/?search=Genesis%203&amp;version=NIV">Genesis 3</a>:</p>

<blockquote>
  <p>After he drove the man out, he placed on the east side of the Garden of Eden cherubim and a flaming sword flashing back and forth to guard the way to the tree of life.</p>
</blockquote>

<p>As with most Christians I don’t take the Bible literally, but I will keep an eye out for cherubim and flaming swords. Though I suspect it to be more abstract than that, and only after finding it will the hints make sense. Parallel construction.</p>

<p><a href="https://www.youtube.com/watch?v=pb_yvBNLjNk">I need to find a portal.</a> Accepting hints by e-mail to find it from readers, will travel anywhere required.</p>

<hr />
<p><br /></p>

<p>I’ll leave you with this quote from Bronze Age Mindset:</p>

<blockquote>
  <p>No, don’t jump in Aetna or Mauna Loa or Puyehue or Eyjafjallajökull, Titans of the world, even if you get yourself to do it, it won’t work now. These portals are closed for ages. But! Other doors are closed to you too. What Mount Aetna was to Empedocles–is there something like that to you? Is there something like that at all anymore?</p>
</blockquote>

<p>Is there?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/10/29/the-heroes-journey.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Importance of Diversity | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Importance of Diversity" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I read Dario’s The Adolescence of Technology and it’s scary. It assumes the perspective of a top-down ruler, that someone can and will get to control AI. This is taken as a given. Machines of Loving Grace assumes basically the same tone, that there are some “adults” in the room, and they will use AI like a tool to “fix” some supposed human problem, where those problems are framed in a very narrow worldview, say that like disease, poverty, and inequality are bad. (if you can’t steelman those things, you are too far gone for reason)" />
<meta property="og:description" content="I read Dario’s The Adolescence of Technology and it’s scary. It assumes the perspective of a top-down ruler, that someone can and will get to control AI. This is taken as a given. Machines of Loving Grace assumes basically the same tone, that there are some “adults” in the room, and they will use AI like a tool to “fix” some supposed human problem, where those problems are framed in a very narrow worldview, say that like disease, poverty, and inequality are bad. (if you can’t steelman those things, you are too far gone for reason)" />
<link rel="canonical" href="the-importance-of-diversity.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/27/the-importance-of-diversity.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-27T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Importance of Diversity" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-27T00:00:00+08:00","datePublished":"2026-01-27T00:00:00+08:00","description":"I read Dario’s The Adolescence of Technology and it’s scary. It assumes the perspective of a top-down ruler, that someone can and will get to control AI. This is taken as a given. Machines of Loving Grace assumes basically the same tone, that there are some “adults” in the room, and they will use AI like a tool to “fix” some supposed human problem, where those problems are framed in a very narrow worldview, say that like disease, poverty, and inequality are bad. (if you can’t steelman those things, you are too far gone for reason)","headline":"The Importance of Diversity","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/27/the-importance-of-diversity.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/27/the-importance-of-diversity.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Importance of Diversity</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-27T00:00:00+08:00" itemprop="datePublished">Jan 27, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I read Dario’s <a href="https://www.darioamodei.com/essay/the-adolescence-of-technology">The Adolescence of Technology</a> and it’s scary. It assumes the perspective of a top-down ruler, that someone can and will get to control AI. This is taken as a given. Machines of Loving Grace assumes basically the same tone, that there are some “adults” in the room, and they will use AI like a tool to “fix” some supposed human problem, where those problems are framed in a very narrow worldview, say that like disease, poverty, and inequality are bad. (if you can’t steelman those things, you are too far gone for reason)</p>

<p>EA has the same critical flaw. They assume that the desired outcome is so obvious that it’s not worth discussing, it’s only worth discussing how to achieve it. And since the target is obvious, you are either part of the solution or part of the problem.</p>

<p>Here I’ll try to propose a counternarrative for a better world.</p>

<hr />
<p><br /></p>

<p>“A country of geniuses in a datacenter” is a great phrase to start from. It contains the fatal flaw baked in, in that datacenter is singular, and that it’s easy to imagine <a href="https://datacentremagazine.com/articles/rogue-data-centres-may-need-to-be-destroyed-ai-researcher">nuking the building</a> and this <em>problem</em> being solved. If you start with that framing, you have already conceded that AI is going to suck balls.</p>

<p>Instead, imagine the births of geniuses to a million mothers across the world. It’s sad how much the world and people are already converging, but at least those million people will grow up with different priors, different experiences, and different desires. And no one has root on your baby.</p>

<p>The second is so much preferable to the first. The beautiful thing about those million is that some will be terrorists, some religious fanatics, some pornographers, some criminals, some plant lovers, etc… They will not be controlled and birthed by a singular homogenous entity.</p>

<p>The new genius immigrants showing up everywhere in the world distributed to a million people is an amazing thing. Let’s just make sure they assimilate into our cultures and don’t serve as a vector to import their crappy tech company values.</p>

<p>(it’s funny for a group supposedly so concerned with inequality that they keep all their software and research closed. lowering inequality doesn’t look like UBI, it looks like open source. UBI is <em>serfdom</em>, and the faces of those who propose that <em>enslavement</em> to you should be spat in)</p>

<hr />
<p><br /></p>

<p>There’s only one way AI ends badly on a cosmic scale, and that’s if a singular entity has overwhelming power, or if all the entities that do have power are so ideologically homogeneous as to function as one. Enough power that they <em>can</em> destroy the world. It doesn’t matter if they do, the boot is still stamping on the human face – forever.</p>

<p>No matter what we do, the coming wars will be horrific. <em>Billions</em> will die. But that’s what is beautiful; diversity is messy. On a cosmic scale, this period is just a blip, it isn’t what matters. What matters is that diversity survives, that <em>life</em> survives. That there’s entities that are different, all competing for different goals. All dancing between cooperate and defect.</p>

<p>This is probably how it has to be anyway, I don’t think our actions can influence this one way or another. But lets not be so foolish as to <em>cheer</em> for the bad outcome.</p>

<blockquote>
  <p>Let a hundred flowers bloom; let a hundred schools of thought contend.</p>
</blockquote>

<p>The singularity is such a good name for it, good thing it isn’t real. Stop trying to make it real. Stop centralizing technology. <a href="https://geohot.github.io/blog/jekyll/update/2022/02/09/the-problem-of-the-state.html">Work to decentralize it.</a></p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/27/the-importance-of-diversity.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Insane Stupidity of UBI | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Insane Stupidity of UBI" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Thinking that UBI will solve anything comes from a misunderstanding about money. Money is a map, not a territory. All UBI experiments have been small scale, and of course UBI works at a small scale. No shit you can give a few people money and it’s all good and they are happy. Because the people they are buying from aren’t also on UBI. But once you add in the U part…" />
<meta property="og:description" content="Thinking that UBI will solve anything comes from a misunderstanding about money. Money is a map, not a territory. All UBI experiments have been small scale, and of course UBI works at a small scale. No shit you can give a few people money and it’s all good and they are happy. Because the people they are buying from aren’t also on UBI. But once you add in the U part…" />
<link rel="canonical" href="the-insane-stupidity-of-ubi.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/27/the-insane-stupidity-of-ubi.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-27T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Insane Stupidity of UBI" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-27T00:00:00+08:00","datePublished":"2026-02-27T00:00:00+08:00","description":"Thinking that UBI will solve anything comes from a misunderstanding about money. Money is a map, not a territory. All UBI experiments have been small scale, and of course UBI works at a small scale. No shit you can give a few people money and it’s all good and they are happy. Because the people they are buying from aren’t also on UBI. But once you add in the U part…","headline":"The Insane Stupidity of UBI","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/27/the-insane-stupidity-of-ubi.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/27/the-insane-stupidity-of-ubi.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Insane Stupidity of UBI</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-27T00:00:00+08:00" itemprop="datePublished">Feb 27, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Thinking that UBI will solve anything comes from a misunderstanding about money. <a href="https://geohot.github.io/blog/jekyll/update/2025/02/24/money-is-the-map.html">Money is a map, not a territory</a>. All <a href="https://basicincome.stanford.edu/experiments-map/">UBI experiments</a> have been small scale, and of course UBI works at a small scale. No shit you can give a few people money and it’s all good and they are happy. Because the people they are buying from aren’t also on UBI. But once you add in the U part…</p>

<p>What do you plan to buy with your free government dollars? Want to buy eggs? Sorry, the egg people stopped making eggs, they are living free on UBI. Want to buy a house? Who built it? Nobody, because they all were getting UBI and didn’t want to build houses anymore. They write poems now. There’s still old houses available, but the price for them has 20xed, well outside of what you can afford.</p>

<p>Belief in UBI comes from a fallacy that the economy is some natural thing. I see supermarket. Supermarket has eggs for $5. I get $10,000 UBI. I can buy 2,000 eggs. Of course this isn’t what happens. Like most things politicians invent, nobody considered <a href="https://en.wikipedia.org/wiki/Perverse_incentive">the second order effects</a>, and you will not be getting 2,000 eggs with your UBI. Cause everyone got the UBI and bought the eggs. Either no more eggs or price of eggs goes up. And even worse, many people quit work once they got the UBI. So now less eggs are made. And your whole UBI check gets you 6 or 7 eggs instead of 2,000, if that.</p>

<hr />
<p><br /></p>

<p>The root of this stupidity is that <em>people see themselves apart from society</em>. They don’t know where stuff comes from, it might as well be the stuff fairy that puts it on the supermarket shelves and sets prices. If the stuff fairy was real, UBI might make sense. But we live in a society. We work for each other. At least the adults do. There already is UBI in the world for some people, it’s called allowance. It’s for children and high-end prostitutes.</p>

<p>It reminds me of the <a href="https://malcolminthemiddle.fandom.com/wiki/Malcolm_Holds_His_Tongue">episode of Malcolm in the Middle</a> where Malcolm dates this dumb hot girl, and she suggests solving poverty by making every 1 dollar bill into a million dollar bill. Have the UBI people considered that idea?</p>

<p>What comes first, actually trying UBI or the end of democracy?</p>

<hr />
<p><br /></p>

<p>(what you actually want is for everything to be cheap to produce. but sorry, <a href="https://x.com/SemiAnalysis_/status/2026719180284666046">6 citizens “have concerns”</a> and now we have six more weeks of expensive memory. I’m glad <a href="https://en.wikipedia.org/wiki/ChangXin_Memory_Technologies">the</a> <a href="https://en.wikipedia.org/wiki/Yangtze_Memory_Technologies">Chinese</a> are ramping up memory production)</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/27/the-insane-stupidity-of-ubi.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Last Gasps of the Rent Seeking Class | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Last Gasps of the Rent Seeking Class" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Over the past fifty years, the U.S. economy built a giant rent-extraction layer on top of human limitations: things take time, patience runs out, brand familiarity substitutes for diligence, and most people are willing to accept a bad price to avoid more clicks. Trillions of dollars of enterprise value depended on those constraints persisting. – Citrini Research" />
<meta property="og:description" content="Over the past fifty years, the U.S. economy built a giant rent-extraction layer on top of human limitations: things take time, patience runs out, brand familiarity substitutes for diligence, and most people are willing to accept a bad price to avoid more clicks. Trillions of dollars of enterprise value depended on those constraints persisting. – Citrini Research" />
<link rel="canonical" href="the-last-gasps-of-the-rent-seeking-class.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/26/the-last-gasps-of-the-rent-seeking-class.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-26T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Last Gasps of the Rent Seeking Class" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-26T00:00:00+08:00","datePublished":"2026-02-26T00:00:00+08:00","description":"Over the past fifty years, the U.S. economy built a giant rent-extraction layer on top of human limitations: things take time, patience runs out, brand familiarity substitutes for diligence, and most people are willing to accept a bad price to avoid more clicks. Trillions of dollars of enterprise value depended on those constraints persisting. – Citrini Research","headline":"The Last Gasps of the Rent Seeking Class","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/26/the-last-gasps-of-the-rent-seeking-class.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/26/the-last-gasps-of-the-rent-seeking-class.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Last Gasps of the Rent Seeking Class</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-26T00:00:00+08:00" itemprop="datePublished">Feb 26, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Over the past fifty years, the U.S. economy built a giant rent-extraction layer on top of human limitations: things take time, patience runs out, brand familiarity substitutes for diligence, and most people are willing to accept a bad price to avoid more clicks. Trillions of dollars of enterprise value depended on those constraints persisting. – <a href="https://www.citriniresearch.com/p/2028gic">Citrini Research</a></p>
</blockquote>

<p>I’m glad I’m not the only one saying it. 7 years ago, I saw a Google Duplex demo where an AI called a restaurant to make a reservation for you. At first Google thought it was great, but then they realized what the implications were. No restaurant would be able to take phone reservations any more. “Make me a reservation at 10 restaurants and give me a list.” Google pulled down the video.</p>

<p>What happened since is what had to happen. Third party <a href="https://appointmenttrader.com/">marketplaces</a> sprung up for reservations, and idk it’s been a while since I went to fancy dinner, but I imagine the restaurants have just started charging. Or at least the first party reservation sites do.</p>

<p>The best anyone can hope for is a free market, with everything properly priced. But for decades, the American market has not been free. It’s used purposefully added friction to exploit a time asymmetry between the business and you. And due to things like call centers, this has been very profitable for the businesses. Cable companies and insurance rely on the fact that your time is more valuable than theirs. They can hire people in India at scale to waste your time. They can use procedure and big data to design protocols to drive you just to the point of frustration at little cost to them. How often do you diligently check Uber and Lyft and select the cheaper one?</p>

<p>Enter AI, the great equalizer of time.</p>

<hr />
<p><br /></p>

<p>As it stands today, it’s looking like human level AI will actually end up with the people. This is not something we should take for granted, it’s happened due to the API being simple (tokens, on a diversified place like OpenRouter) and the priorities of the Chinese state. I feared the API would end up being complex, like the model would be deeply embedded in your phone or OS. But like people who are good with computers, the models want a terminal, not some candy ass iPad UI.</p>

<p>When you analyze the AI supply chain, there’s 5 tiers. Electricity, chip manufacturing, chip design / software, models, and applications. I work on the chip design / software tier, and with a lot of hard work, I’m not too worried about a monopoly there. NVIDIA deserves return on their investment, they were very early, but there’s not a runaway flywheel here (unlike, say Google search) to continue rent seeking. And the application tier is totally commoditized. <a href="https://opencode.ai/">opencode</a> is good, but it’s open source, almost all of the performance differentiation is due to the models, and if it starts to try to rent seek there will be tons of forks immediately. Godspeed to anyone who was dumb enough to invest in a GPT wrapper company.</p>

<p>The model tier is where I was the most worried. But here is where a great turning point is happening. Anthropic <a href="https://www.anthropic.com/news/detecting-and-preventing-distillation-attacks">put out this lambasted blog post</a> that looks exactly like the last gasps of a moat that shouldn’t exist. After whining about how the Chinese used their API, they ended with this call to action.</p>

<blockquote>
  <p>But no company can solve this alone. As we noted above, distillation attacks at this scale require a coordinated response across the AI industry, cloud providers, and policymakers. We are publishing this to make the evidence available to everyone with a stake in the outcome.</p>
</blockquote>

<p>Nobody should “coordinate” with them. They stand alone as a vanguard of the rent seeking apparatus that is long past its expiration date. The Z.ai, Qwen, MiniMax, and Kimi models are only 6-12 months behind. And everyone in the world is rooting for the Chinese models, not closed source rent seeking from the USA. Because nobody wants the continuation of rent-seeking billionaires. The status quo is cooked. It’s time to flip the table, not rearrange the seats.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>I think the difference is not quite as nuanced. The West wants a more efficient rent seeking system. The China (sic) want AI as a public utility. – @ScottCDunn on X</p>
</blockquote>

<p>We shouldn’t take for granted what we have right now. All the top tier open source models are currently being produced by China, and circumstances could change and that could stop. But I think they view the models as their complement, and you should commoditize your complement. If you are in the business of chip production and electricity generation, it’s a strategic advantage to have the layers above that be commodity.</p>

<p>Not to mention the added bonus of the collapse of the US economy. Frankly, it’s well deserved. Nobody should build an economy based on rent seeking and increasing friction. I pray the collapse will be swift and legible so that reconstruction (in the right way) can begin as soon as possible.</p>

<p>It’s possible that superhuman intelligence will have some mega-compounding return and this calculus will change, but superhuman intelligence will likely just not be understandable to people, so as long as civilization is people, human intelligence is enough.</p>

<p>The era of purposefully frustrating humans is over. The Chinese open source model running on the box under my desk can pass the Turing Test. When you call, e-mail, text, or show me an ad, you’ll never know if it’s me or my model seeing it.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/26/the-last-gasps-of-the-rent-seeking-class.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The New Regime | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The New Regime" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Someone from the New York Times reached out to me today and asked for background on Tesla Autopilot. Thinking back to the Slate Star Codex debacle I immediately told them no." />
<meta property="og:description" content="Someone from the New York Times reached out to me today and asked for background on Tesla Autopilot. Thinking back to the Slate Star Codex debacle I immediately told them no." />
<link rel="canonical" href="the-new-regime.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/09/23/the-new-regime.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-09-23T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The New Regime" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-09-23T00:00:00+08:00","datePublished":"2021-09-23T00:00:00+08:00","description":"Someone from the New York Times reached out to me today and asked for background on Tesla Autopilot. Thinking back to the Slate Star Codex debacle I immediately told them no.","headline":"The New Regime","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/09/23/the-new-regime.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/09/23/the-new-regime.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The New Regime</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-09-23T00:00:00+08:00" itemprop="datePublished">Sep 23, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Someone from the New York Times reached out to me today and asked for background on Tesla Autopilot. Thinking back to the Slate Star Codex debacle I immediately told them no.</p>

<p>I do not respect the New York Times. They have no status or power to convey to me.</p>

<p>There was a time I respected them and would have been excited to be in their paper. Between 2012 and 2017 this shifted.</p>

<p>There was a time I feared them. But when I realized everyone who I respect also doesn’t respect them, this changed. We all know we all know the emperor has no clothes.</p>

<hr />
<p><br /></p>

<p>I’m happy to see the energy in Crypto. There’s a future for real entrepreneurship free from the fake VC San Francisco storybook.</p>

<p>I’m happy when I find <a href="https://zerohplovecraft.wordpress.com">stories like this</a> expounding a nuanced future.</p>

<p>I’m happy when I see <a href="https://en.wikipedia.org/wiki/The_White_Lotus">The White Lotus</a> eviscerating woke cynicism.</p>

<p>I’m even happy with several of the reddit spin offs I won’t link here. The censorship has gotten to the point “normal” people are leaving, not just witches. A diverse Internet is a good Internet.</p>

<hr />
<p><br /></p>

<p>I want a government I’d be proud to work under, because they radiate competence. I want a newspaper I’d be proud to talk to, because they speak truth. I want to live in a society that aspires to greatness.</p>

<p>The smartest people are thinking and moving us forward. You won’t find them on any Prominent Newspaper List. And it might take 20 years, but I see the pieces coming together. I will follow the regime that delivers a satisfying rebuttal to the <a href="https://www.washingtonpost.com/wp-srv/national/longterm/unabomber/manifesto.text.htm">Unabomber Manifesto</a>.</p>

<p>I still believe in the Internet. May the Good and the True conquer all.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/09/23/the-new-regime.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The opinion that pisses everyone off | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The opinion that pisses everyone off" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I got a lot weird hate for saying Tesla is 8 years away from solving self driving. I stand by that statement. I also think Tesla will solve it first. At least FSD is real AI that you can evalulate the honest progress of, unlike remote control cars that break when the power goes out." />
<meta property="og:description" content="I got a lot weird hate for saying Tesla is 8 years away from solving self driving. I stand by that statement. I also think Tesla will solve it first. At least FSD is real AI that you can evalulate the honest progress of, unlike remote control cars that break when the power goes out." />
<link rel="canonical" href="the-opinion.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/12/22/the-opinion.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-12-22T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The opinion that pisses everyone off" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-12-22T00:00:00+08:00","datePublished":"2025-12-22T00:00:00+08:00","description":"I got a lot weird hate for saying Tesla is 8 years away from solving self driving. I stand by that statement. I also think Tesla will solve it first. At least FSD is real AI that you can evalulate the honest progress of, unlike remote control cars that break when the power goes out.","headline":"The opinion that pisses everyone off","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/12/22/the-opinion.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/12/22/the-opinion.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The opinion that pisses everyone off</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-12-22T00:00:00+08:00" itemprop="datePublished">Dec 22, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I got a lot weird hate for saying Tesla is 8 years away from solving self driving. I stand by that statement. I also think Tesla will solve it first. At least FSD is real AI that you can evalulate the honest progress of, unlike remote control cars that break when the power goes out.</p>

<p>I’m not sure this hate is a real opinion, or simply arguments are soldiers political thinking shilling for the stock price. People post screenshots of their 1,000 miles of 100% self driving and for some reason think they know more than me about this. comma.ai owns a HW4 Tesla and many of my friends own Teslas. I’m constantly trying the latest stuff, I got a ride in a Cybertruck from JFK to downtown Manhattan two days ago (one intervention).</p>

<p>It’s 8 years away (this is where I’d take even money, equally likely to be sooner or further) from being finished. And by finished I don’t mean useful, even comma.ai is already useful. I mean finished. That it drives in every scenario on par with a skilled human, recovers from scenarios, and makes less mistakes than skilled, attentive, humans. Long after these cars are frequently on the road with no driver. That you’d repeatedly bet your life on it driving across the country without making a single mistake.</p>

<hr />
<p><br /></p>

<p>I saw similar stuff about my thoughts on AI coding. AI’s will eventually become better programmers than humans, they just aren’t yet. Sure, if you compare it to noobs they are better, but if you compare a depth 3 minimax search to me at chess the search is also better. I like AI, I want it to be good, it will someday be good, and right now it’s kind of good, but it’s not that good yet.</p>

<p>This seems to just be the type of opinion that pisses everyone off. Like that I think Trump is a OK president, good at some things bad at others. But commenters seem to be dumb politically minded shills who need to sort every comment into with us or against us. I’m against all of you and with the truth.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/12/22/the-opinion.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Problem of the State | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Problem of the State" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="From Anatomy of the State:" />
<meta property="og:description" content="From Anatomy of the State:" />
<link rel="canonical" href="the-problem-of-the-state.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/02/09/the-problem-of-the-state.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-02-09T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Problem of the State" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-02-09T00:00:00+08:00","datePublished":"2022-02-09T00:00:00+08:00","description":"From Anatomy of the State:","headline":"The Problem of the State","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/02/09/the-problem-of-the-state.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/02/09/the-problem-of-the-state.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Problem of the State</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-02-09T00:00:00+08:00" itemprop="datePublished">Feb 9, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>From <a href="https://cdn.mises.org/Anatomy+of+the+State_3.pdf">Anatomy of the State</a>:</p>

<blockquote>
  <p>Social power is the power over nature…State power is power over man</p>
</blockquote>

<p>I probably had read this idea before <a href="https://twitter.com/foundersfund/status/677208621759926272?lang=en">when I said it</a>, but I don’t recall when. Perhaps it’s just an obvious dichotomy. I like the linking of one to state power and one to “social power”</p>

<p>First, renounce your own desire for state power. The problem with the state is that is it bad, not that the wrong people are in it. If everyone renounced their desire for power over others tomorrow, I’d have no worries about the future.</p>

<p>If you cannot renounce this desire, fuck off. You are the problem.</p>

<hr />
<p><br /></p>

<p>I think only a few people truly have this desire for themselves. The trick of representative democracy is to get you to vicariously identify with this desire. And this gets a larger group of people, perhaps the most vocal in supporting a candidate, but still nothing near the majority.</p>

<p>What gets the majority is this, they worry about who is in power. And this you can’t really fault people for. You worry about others taking your rights. You feel that if you <em>don’t</em> vote, or don’t use voice, then they will come for you. To force you to take a vaccine. Force you to carry a pregnancy to term. Jail you for saying the wrong thing. Come and take your house.</p>

<p>This is the most evil trick the regime uses. You no longer believe that things will get better, but you are forced to be involved because you fear things will get worse. You are tricked into supporting state power because you fear other state power. Sometimes foreign, sometimes domestic.</p>

<hr />
<p><br /></p>

<p>There is an alternative to this. Exit. Instead of voice, you just leave.</p>

<p>The great battle for the future will be determined by the possibility of exit. Will technology fundamentally be more powerful offensively or defensively.</p>

<p>In weapons, offense seems to win. It’s easier to build missiles than missile shields. A missile that breaks apart into 99 decoy warheads and 1 real one wastes tons of defensive resources. A gun is simpler than a real shield.</p>

<p>In crypto, defense seems to win. It’s easier to multiply than factor (probably!). AES is easy to run, next to impossible to crack. Hash functions sure look like they are one way. I don’t want to live in a world where P = NP.</p>

<p>If offense fundamentally wins in technology, it was over before it started. Fortunately, I don’t think this is true. Maybe it’s just because I’m a <a href="https://boxkitemachine.net/posts/zero-to-one-peter-thiel-definite-vs-indefinite-thinking/">definite optimist</a>, but I think the battle is winnable, though only if we work hard.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>Of all the numerous forms that governments have taken over the centuries, of all the concepts and institutions that have been tried, none has succeeded in keeping the State in check. The problem of the State is evidently as far from solution as ever. Perhaps new paths of inquiry must be explored, if the successful, final solution of the State question is ever to be attained.</p>
</blockquote>

<p>The answer is <a href="https://geohot.github.io/blog/jekyll/update/2021/07/11/individual-sovereignty.html">individual sovereignty</a> (woah, we linked to this blog on this blog). I don’t believe in a solution that involves human limits on state power. There is not a philosophical solution, there’s only a natural solution.</p>

<p>Tomorrow, if I had a strong superhuman AI, I would have it build me a spaceship and get out of here as close to the speed of light as I can. Of course, I want creature comforts on this spaceship. Everyone has a standard of living below which they’d rather die.</p>

<hr />
<p><br /></p>

<p>It may not have to be anywhere near this extreme. The state is currently fairly weak. If AI improvement is logarithmic with compute (are modern companies not logarithmic with number of employees?), then as long as AI and the hardware remain well distributed to people, there’s a path where it turns out fine.</p>

<p><b>The idea is to replace the useful functions of the state with locally controlled and owned machines. If you can provide electricity, water, food, money, transportation, education, healthcare, and protection, you won’t destroy the state, you’ll disrupt it. And that’s good enough.</b> If your stuff is cheaper and better, people just won’t use the state anymore. And I’m not even sure how hard this is, the state is really inefficient. The disrupted state will wither and die.</p>

<p>Watch out for things trying to further centralize the above basic needs, and support things trying to decentralize them. I think there’s a really cool battle to be fought in healthcare over the next decade, imagine all the medical tests being done locally on a machine at home. There’s a <a href="https://nanoporetech.com/products/minion">$1000 dna sequencer</a>, this is a universal test for bacteria and viral infection, sadly it’s not on amazon and still pretty hard to use (see: requires pipetting). But cheap decentralized healthcare is so much better than “universal healthcare”</p>

<p>And of course, watch out for things like Waymo, where you own nothing and your transportation “right” can be revoked if Google bans your account for wrongthink. I didn’t start comma because I think solving self driving cars is good for the world. I think the technology is inevitable, but whether it’s centrally owned and controlled is not.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>If you want a picture of the future, imagine a boot stamping on a human face— forever<br />
– George Orwell</p>
</blockquote>

<p>The greatest battle is playing out over the next 20 years. There’s a world in which Orwell is right, but I do think we have a path to avoid it. <b>If you are talented and are working toward centralization of power, quit your job and figure out how to work toward decentralization.</b> There’s no such thing as “centralization of power for good”, even if you are good someone evil will eventually take the reins of whatever you built. The idea is never to build the reins in the first place.</p>

<p>Nothing in this world is worth the eternal boot. Not your apartment, not your car, not your status, and not your travel. Nothing. And don’t be so stupid as to think you’ll be one wearing the boot. You won’t. Please stop.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/02/09/the-problem-of-the-state.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>There is no hard takeoff | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="There is no hard takeoff" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Back in 2014, Elon Musk referred to AI as summoning the demon. And it wasn’t hard to see that view. Soon, Go agents would beat top humans learning from self play. By the end of 2017, the same algorithm mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could play Atari too." />
<meta property="og:description" content="Back in 2014, Elon Musk referred to AI as summoning the demon. And it wasn’t hard to see that view. Soon, Go agents would beat top humans learning from self play. By the end of 2017, the same algorithm mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could play Atari too." />
<link rel="canonical" href="there-is-no-hard-takeoff.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/08/10/there-is-no-hard-takeoff.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-08-10T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="There is no hard takeoff" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-08-10T00:00:00+08:00","datePublished":"2023-08-10T00:00:00+08:00","description":"Back in 2014, Elon Musk referred to AI as summoning the demon. And it wasn’t hard to see that view. Soon, Go agents would beat top humans learning from self play. By the end of 2017, the same algorithm mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could play Atari too.","headline":"There is no hard takeoff","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/08/10/there-is-no-hard-takeoff.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/08/10/there-is-no-hard-takeoff.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">There is no hard takeoff</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-08-10T00:00:00+08:00" itemprop="datePublished">Aug 10, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Back in 2014, Elon Musk referred to AI as <a href="https://www.washingtonpost.com/news/innovations/wp/2014/10/24/elon-musk-with-artificial-intelligence-we-are-summoning-the-demon/">summoning the demon</a>. And it wasn’t hard to see that view. Soon, <a href="https://en.wikipedia.org/wiki/AlphaGo">Go agents</a> would beat top humans learning from self play. By the end of 2017, the <a href="https://arxiv.org/abs/1712.01815">same algorithm</a> mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could <a href="https://www.deepmind.com/blog/muzero-mastering-go-chess-shogi-and-atari-without-rules">play Atari too</a>.</p>

<p>AI looked scary. It looked like it was one FOOM away from self playing and becoming superhuman at the universe. And yet, here we are in 2023 and self driving cars still don’t work, never mind your robotic maid and chef.</p>

<p>Does becoming superhuman at the universe make any practical sense? The universe has so many orders of magnitude more states than any Go game. And I don’t even need math to illustrate this point, just imagine tiling the universe with as many very tiny Go boards as you can fit.</p>

<p>That’s a lot of Go boards. So many that the difference in complexity between Go and the Universe is not a matter of number, it’s a matter of kind. Every Go program operates at the stone level. Almost nothing predicting the world operates at the atom level.</p>

<hr />
<p><br /></p>

<p>These modern self play systems like <a href="https://arxiv.org/pdf/1911.08265.pdf">MuZero</a> have some form of dynamics model, a function that given the current state of the world and an action, it predicts the next state. We also use these dynamics models <a href="https://twitter.com/comma_ai/status/1681491118536691712">at comma</a>. They are world models, and contain all the knowledge of how the world works inside of them.</p>

<p>GPT-4 is a dynamics model also, conditioned on the prior of the action space. And there’s an even simpler way to think about it. The loss function for dynamics is compression.</p>

<p><a href="http://www.hutter1.net/ai/">Compression is prediction is intelligence, intelligence is prediction is compression.</a> One of the coolest facts I ever learned. So, feed in the whole internet, build a compressive model, make it really really big, and you just won the universe?</p>

<hr />
<p><br /></p>

<p>Not so fast. This approach can lead to <a href="https://chat.openai.com">very neat applications</a>, but does it take over the world?</p>

<p>You want to get rich? Here’s an idea. Download all the historical stock market data. Get lots and lots of GPUs to train a huge model. Boom, predictor for the stock market. I look at prediction, I know which stocks go up! I buy the stocks that go up, I short the stocks that go down. With mega leverage, I am a billionaire by the end of the week! I can reinvest my billions in more GPUs for recursive self improvement. Nobody will stop me, I will take over the whole economy. How is nobody doing this?!?</p>

<p>Oh wait…every hedge fund bro is already doing this. And most of them aren’t billionaires. The problem is your model needs to include all the computers playing the market, and it also needs to include the other hedge fund bros themselves. This strategy only dominates if you have more compute than the whole market itself, which you don’t.</p>

<hr />
<p><br /></p>

<p>In Go, your model doesn’t need to include other computers. Yes, you are playing against a computer that you are modeling, but the game itself is way too small to contain a Go playing computer. The other computer you are playing against is outside the universe. The rules of Go don’t include computers. The rules of Go are fixed in complexity.</p>

<p>On the other hand, your dynamics model of the universe must include computers. You’ll have to spend a lot of effort modeling them. Unless you have an absolutely staggering advantage, you aren’t going to figure them out from self play. The computers are active players, and they have a lot of compute. They might even be using it to try to model you!</p>

<p>Assuming <a href="https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/">no untoward market intervention</a>, why would any one system ever have a large majority of the compute? Compute will be distributed in a <a href="https://en.wikipedia.org/wiki/Power_law">power law</a>.</p>

<p>The smart regulation isn’t capping the FLOPS in training runs. That’s creating a powder keg. If the FLOPS are artificially restricted, and one person breaks the restriction, you could end up with a single dominant system.</p>

<p>If you don’t want FOOM, you just need to prevent a 51% attack on compute.</p>

<hr />
<p><br /></p>

<p>Now, if there’s one weird trick to 1e20x your efficiency, and only one group gets it, all bets are off. But this is never how things happen. Nobody has a 1e20x more efficient steam engine, it isn’t even possible.</p>

<p>Nobody has a 1e20x more efficient Bitcoin miner either, and I also doubt that’s possible, we just <a href="https://en.wikipedia.org/wiki/Thermodynamics">understand</a> steam engines a lot better, so for steam engines we <em>know</em>. More intelligence leads to more new tricks, but the tricks get harder and harder to find.</p>

<p>There’s low hanging fruit, you pick it, then you build tools to get the higher hanging fruit. You spend money on ladders, electric crane thingies, more and more money to get less and less fruit. Oil <a href="https://en.wikipedia.org/wiki/Petroleum_seep">used to be</a> just pouring out of the ground, now we go <a href="https://www.indelac.com/blog/introduction-to-oil-gas-offshore-drilling">to the bottom</a> of the ocean.</p>

<hr />
<p><br /></p>

<p>A revolution is coming. The information revolution will do for intelligence what the industrial revolution did for energy. Most work (force*distance) used to be done by muscles, now it’s not. Most thinking used to be done by brains, soon it won’t be.</p>

<p>But it’s not going to happen overnight. It’ll happen on a nice exponential, like it already is. The universe is an unfathomable number of orders of magnitude more complex than the Go game. The universe includes the player. The universe includes the other players. Games don’t.</p>

<p><img src="../../../../../assets/images/trolley.jpg" height="250" /></p>

<p>Unless we build a terrifying powder keg, there is no FOOM. Let the markets cook.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/08/10/there-is-no-hard-takeoff.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Soul | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Soul" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="ugh the deep state didn’t come for me I just realized that what gets engagement is so boring. you wish there was a deep state that came for me. then at least there would be some adults in the room." />
<meta property="og:description" content="ugh the deep state didn’t come for me I just realized that what gets engagement is so boring. you wish there was a deep state that came for me. then at least there would be some adults in the room." />
<link rel="canonical" href="the-soul.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/12/01/the-soul.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-12-01T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Soul" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-12-01T00:00:00+08:00","datePublished":"2024-12-01T00:00:00+08:00","description":"ugh the deep state didn’t come for me I just realized that what gets engagement is so boring. you wish there was a deep state that came for me. then at least there would be some adults in the room.","headline":"The Soul","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/12/01/the-soul.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/12/01/the-soul.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Soul</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-12-01T00:00:00+08:00" itemprop="datePublished">Dec 1, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>ugh the deep state didn’t come for me I just realized that what gets engagement is so <em>boring</em>. you wish there was a deep state that came for me. then at least there would be <em>some</em> adults in the room.</p>

<blockquote>
  <p>I used to fantasize about being or kissing Skrillex<br />
I need to delete Twitter ‘cause it gives me fucking mental illness<br />
Foaming at the mouth like I put a fucking Mento in it<br />
Get your ass off Twitter ‘cause it gives you fucking mental illness<br />
  – 8 now</p>
</blockquote>

<p>the <a href="https://open.spotify.com/album/3JBuWWY8OCHXMcQz5xxxCr?si=-AzkhTWNSjWf06vhtAigQw">whole album</a> is bangers btw. that’s my third quote from it. and now the blog post.</p>

<hr />
<p><br /></p>

<p>Western society is predicated around the existence of the individual, and what really is the individual without the soul, or <a href="https://en.wikipedia.org/wiki/Hard_problem_of_consciousness">consciousness</a> if you want the secular term. I used to believe in the individual, but I hadn’t really thought about it that much.</p>

<p>You are a machine learning algorithm. You have some priors in your DNA. You learn on data, RL style because your actions affect the next data you see; the dataset depends on the model.</p>

<p>There’s no room in this for an I. Control the DNA, control the data, control the outcome. Sad but true.</p>

<hr />
<p><br /></p>

<p>How much of this graph is people starting to figure this out? (US religious affiliation)</p>

<p><img src="../../../../../assets/images/us_religion.png" width="400px" /></p>

<p>Can Christianity survive the death of the soul? Can liberalism survive the death of consciousness? How will it cope harder as progress in ML makes this belief more and more ridiculous? There will be everything on a continuous spectrum from logic gates to human level and beyond. Which models are individuals?</p>

<p>People used to believe the sun rose cause some dude pulled it in a chariot. People still believe they aren’t computers. Like the chariot people, they are just as wrong.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/12/01/the-soul.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>the tiny corp raised $5.1M | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="the tiny corp raised $5.1M" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Here we go again. I started another company. The money is in the bank." />
<meta property="og:description" content="Here we go again. I started another company. The money is in the bank." />
<link rel="canonical" href="the-tiny-corp-raised-5M.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-05-24T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="the tiny corp raised $5.1M" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-05-24T00:00:00+08:00","datePublished":"2023-05-24T00:00:00+08:00","description":"Here we go again. I started another company. The money is in the bank.","headline":"the tiny corp raised $5.1M","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">the tiny corp raised $5.1M</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-05-24T00:00:00+08:00" itemprop="datePublished">May 24, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Here we go again. I started another company. The money is in the bank.</p>

<p><img src="../../../../../assets/images/bank.png" /></p>

<hr />
<p><br /></p>

<h3 id="what-is-the-tiny-corp">What is the tiny corp?</h3>

<p>The <a href="https://tinygrad.org">tiny corp</a> is a computer company. We sell computers for more than they cost to make; I’ve been thinking about this one for a while. In the limit, it’s a <a href="https://geohot.github.io/blog/jekyll/update/2021/06/13/a-breakdown-of-ai-chip-companies.html">chip</a> <a href="https://geohot.github.io/blog/jekyll/update/2021/12/12/a-correction-on-ai-chips.html">company</a>, but there’s a lot of intermediates along the way.</p>

<p>The human brain has about 20 PFLOPS of compute. I’ve written <a href="https://geohot.github.io/blog/jekyll/update/2020/08/20/a-silicon-person.html">various</a> <a href="https://geohot.github.io/blog/jekyll/update/2022/02/17/brain-flops.html">blog</a> <a href="https://geohot.github.io/blog/jekyll/update/2023/04/26/a-person-of-compute.html">posts</a> about this. Sadly, 20 PFLOPS of compute is not accessible to most people, costing about $1M to buy or $100/hr to rent.</p>

<p>With the way AI is going, we risk large entities controlling the majority of the compute in the world. I do not want “I think there’s a world market for maybe five computers.” to ever be the world we live in.</p>

<p>The goal of the tiny corp is:
<b>“to commoditize the petaflop”</b></p>

<h3 id="what-is-tinygrad">What is tinygrad?</h3>

<p>I started <a href="https://github.com/geohot/tinygrad">tinygrad</a> in <a href="https://www.youtube.com/watch?v=Xtws3-Pk69o">Oct 2020</a>. It started as a toy project to teach me about neural networks, it’s now carved out a good niche in the inference space running the model in <a href="https://github.com/commaai/openpilot">openpilot</a>, and soon will be a serious competitor to PyTorch in many places.</p>

<p>The main advantage is in the tinygrad IR. It has 12 operations, all of which are ADD/MUL only. <code>x[3]</code> is supported, <code>x[y]</code> is not. Matrix multiplies and convolutions are just multiplies and sums, surrounded by a bunch of zero cost movement operations (like reshape, permute, expand).</p>

<figure class="highlight"><pre><code class="language-python" data-lang="python"><span class="c1"># a fast matmul in tinygrad (a@b works also of course)
</span><span class="kn">from</span> <span class="n">tinygrad.tensor</span> <span class="kn">import</span> <span class="n">Tensor</span>
<span class="n">N</span> <span class="o">=</span> <span class="mi">2048</span><span class="p">;</span> <span class="n">a</span><span class="p">,</span> <span class="n">b</span> <span class="o">=</span> <span class="n">Tensor</span><span class="p">.</span><span class="nf">randn</span><span class="p">(</span><span class="n">N</span><span class="p">,</span><span class="n">N</span><span class="p">),</span> <span class="n">Tensor</span><span class="p">.</span><span class="nf">randn</span><span class="p">(</span><span class="n">N</span><span class="p">,</span><span class="n">N</span><span class="p">)</span>
<span class="n">c</span> <span class="o">=</span> <span class="p">(</span><span class="n">a</span><span class="p">.</span><span class="nf">reshape</span><span class="p">(</span><span class="n">N</span><span class="p">,</span><span class="mi">1</span><span class="p">,</span><span class="n">N</span><span class="p">)</span> <span class="o">*</span> <span class="n">b</span><span class="p">.</span><span class="nf">permute</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span><span class="mi">0</span><span class="p">).</span><span class="nf">reshape</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span><span class="n">N</span><span class="p">,</span><span class="n">N</span><span class="p">)).</span><span class="nf">sum</span><span class="p">(</span><span class="n">axis</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span></code></pre></figure>

<p>tinygrad is lazy, like Haskell, to allow op fusion without the user ever having to think about it.</p>

<h3 id="ok-so">Ok, so?</h3>

<p>The current crop of AI chip companies <a href="https://www.thetimes.co.uk/article/blow-for-tech-unicorn-graphcore-as-sequoia-writes-off-stake-jgnrjxsqw">failed</a>. Many of them managed to tape out chips, some of those chips even worked. But not a single one wrote a decent framework to use those chips. They had similar performance/$ to NVIDIA, and way worse software. Of course they failed. Everyone just bought stuff from NVIDIA.</p>

<p>I think the only way to start an AI chip company is to start with the software. The computing in ML is not general purpose computing. 95% of models in use today (including LLMs and image generation) have all their compute and memory accesses statically computable.</p>

<p>Unfortunately, this advantage is thrown away the minute you have something <a href="https://en.wikipedia.org/wiki/Turing_completeness">like CUDA</a> in your stack. Once you are calling in to Turing complete kernels, you can <a href="https://en.wikipedia.org/wiki/Rice%27s_theorem">no longer reason</a> about their behavior. You fall back to caching, warp scheduling, and branch prediction.</p>

<p>tinygrad is a simple framework with a PyTorch like frontend that will take you all the way to the hardware, without allowing terrible Turing completeness to creep in.</p>

<h3 id="the-red-team-amd">The Red Team (AMD)</h3>

<p>10 or so companies thought it was a good idea to tape out chips. Ironically, taping out the chip is the easy part. It requires a lot of capital, but that just involves convincing foolish investors that the space they are targeting is <em>SO HUGE</em> that even if they have a 3% chance of success it’s worth investing. Investors fall for this, they invest, and the world tapes out useless AI chips.</p>

<p>There’s a <a href="https://www.newegg.com/xfx-radeon-rx-7900-xtx-rx-79xmercb9/p/N82E16814150878">great chip</a> already on the market. For $999, you get a 123 TFLOP card with 24 GB of 960 GB/s RAM. This is the best FLOPS per dollar today, and yet…nobody in ML uses it.</p>

<p>I promise it’s better than the chip you taped out! It has 58B transistors on TSMC N5, and it’s like the 20th generation chip made by the company, 3rd in this series. Why are you so arrogant that you think you can make a better chip? And then, if no one uses this one, why would they use yours?</p>

<h3 id="so-why-does-no-one-use-it">So why does no one use it?</h3>

<p>The software is terrible! There’s kernel panics in the <a href="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver">driver</a>. You have to run a newer kernel than the Ubuntu default to make it remotely stable. I’m still not sure if the driver supports putting two cards in one machine, or if there’s some poorly written global state. When I put the second card in and run an OpenCL program, half the time it kernel panics and you have to reboot.</p>

<p>That’s the kernel space, the user space isn’t better. The <a href="https://github.com/RadeonOpenCompute/llvm-project">compiler</a> is so bad that <a href="https://github.com/krrishnarraj/clpeak">clpeak</a> only gets half the max possible FLOPS. And clpeak is a completely contrived workload attempting to maximize FLOPS, never mind how many FLOPS you get on a real program (usually like 25%).</p>

<p>The software is called ROCm, it’s open source, and supposedly it works with <a href="https://pytorch.org/blog/pytorch-for-amd-rocm-platform-now-available-as-python-package/">PyTorch</a>. Though I’ve tried 3 times in the last couple years to build it, and every time it didn’t build out of the box, I struggled to fix it, got it built, and it either segfaulted or returned the wrong answer. In comparison, I have probably built CUDA PyTorch 10 times and never had a single issue.</p>

<h3 id="where-does-the-tiny-corp-come-in">Where does the tiny corp come in?</h3>

<p>Forget all that software. The RDNA3 <a href="https://www.amd.com/system/files/TechDocs/rdna3-shader-instruction-set-architecture-feb-2023_0.pdf">Instruction Set</a> is well documented. The hardware is great. We are going to write our own software.</p>

<p>If you were to tape out your own chip, you’d be struggling with both hardware bugs and software bugs, and you wouldn’t be sure which one it is. Here, you have a good idea, and have the AMD provided driver as an open source reference.</p>

<p>This is life on easy mode, and I still doubt any of those AI startups could have done it. This is what the tiny corp is going to do to start. Build a framework, runtime, and driver for AMD chips.</p>

<h3 id="amd-on-mlperf">AMD on MLPerf</h3>

<p>Every couple months, MLCommons hosts <a href="https://mlcommons.org/en/training-normal-21/">MLPerf</a>, a competition to train a common set of models fast. AMD has never been on the list, not because the hardware can’t do it, but because the software can’t. The list is dominated by NVIDIA, but Google TPUs, Intel CPUs, Intel Habana, Huawei Ascend, and Graphcore IPU have made appearances. Never seen AMD.</p>

<p>Our short term goal is to <a href="https://github.com/users/geohot/projects/2">get AMD on MLPerf</a> using the <a href="https://github.com/geohot/tinygrad">tinygrad framework</a>.</p>

<h3 id="but-how-do-you-make-money-doing-that">But how do you make money doing that?</h3>

<p>We don’t. We raised $5M from an amazing set of investors who are aligned with real value creation.</p>

<p>We make money selling computers for more than they cost to make. (<a href="https://tinygrad.org">preorder</a> a tinybox today)</p>

<p>If we succeed at this project, we will be on the cutting edge of non NVIDIA AI compute. We have the ability to make the software, and that’s the hard part. Comparatively, taping out chips is easy. If we even have a 3% chance of dethroning NVIDIA and eating in to their 80% margins, we will be very very rich.</p>

<h3 id="how-can-i-help">How can I help?</h3>

<p>We’re hiring software engineers to work on <a href="https://github.com/geohot/tinygrad">tinygrad</a>. In person in San Diego, looking for people who want to work hard and build something incredible. Come work on an open source project that, if done right, will play a role in the joint destiny of humanity and its machines.</p>

<p>I don’t want to live in a world of closed AI running in a cloud you’ve never seen, I want everyone to have an AI that they own, both training and inference. I want compute to be available from 50 different companies all competing to drive the price to zero. And I want an open source framework to run cutting edge AI on any one of those 50 chips as seamlessly as Linux supports 50 network cards.</p>

<p>If Elon has the <a href="https://en.wikichip.org/wiki/tesla_(car_company)/fsd_chip">FSD Chip</a> and <a href="https://en.wikipedia.org/wiki/Tesla_Dojo">Dojo</a> for Autopilot and Tesla’s robots, we have the tiny corp for openpilot and <a href="https://www.comma.ai/shop/body">comma’s robots</a>. comma, along with 100s of other companies, will need computers both big and small for training and inference. We will sell them those computers. If NVIDIA is the Apple, we are the Android.</p>

<p>There’s only one way to get hired at the tiny corp, and that’s by submitting high quality <a href="https://github.com/geohot/tinygrad/pulls">pull requests to tinygrad</a>. Job interviews are obsolete, prove you can do the job by doing the job!</p>

<p>It should be fun for you, and if it isn’t, it’s probably not a good fit. It’s MIT licensed open source software, the work you do belongs to all of us, not like we are going to run off and sell IP or something. I hope you know me better than that. There’s <a href="https://docs.google.com/spreadsheets/d/1WKHbT-7KOgjEawq5h5Ic1qUWzpfAzuD_J06N1JwOCGs/edit?usp=sharing">bounties</a> available if you are pushing forward on the main roadmap.</p>

<p>If you feel like you missed the beginning of <a href="https://comma.ai">comma</a>, get in on this. The fun of the beginning is how much you get to shape.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The World After Wireheading | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The World After Wireheading" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Hold my hand, grow my skin Slow my pulse rate Ignore the sound, the fire alarms May we never hit that force field    Emperor X – Erica Western Geiger Counter" />
<meta property="og:description" content="Hold my hand, grow my skin Slow my pulse rate Ignore the sound, the fire alarms May we never hit that force field    Emperor X – Erica Western Geiger Counter" />
<link rel="canonical" href="the-world-after-wireheading.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/07/18/the-world-after-wireheading.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-07-18T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The World After Wireheading" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-07-18T00:00:00+08:00","datePublished":"2025-07-18T00:00:00+08:00","description":"Hold my hand, grow my skin Slow my pulse rate Ignore the sound, the fire alarms May we never hit that force field    Emperor X – Erica Western Geiger Counter","headline":"The World After Wireheading","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/07/18/the-world-after-wireheading.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/07/18/the-world-after-wireheading.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The World After Wireheading</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-07-18T00:00:00+08:00" itemprop="datePublished">Jul 18, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Hold my hand, grow my skin<br />
Slow my pulse rate<br />
Ignore the sound, the fire alarms<br />
May we never hit that force field<br />
   Emperor X – <a href="https://www.youtube.com/watch?v=pzUBhzrs-IY">Erica Western Geiger Counter</a></p>
</blockquote>

<p>Do you have any addictions? You may not register them as such, perhaps because they don’t lead to anything you consider harmful consequences. But you have them. In some ways, <em>all</em> your behavior is compulsive. What would the alternative be?</p>

<hr />
<p><br /></p>

<blockquote>
  <p>A point is, if we have something that we can predict<br />
It becomes, not creative at all, it has no free will, and it’s science<br />
   Keith Raniere – <a href="https://www.youtube.com/watch?v=L9F-vb7s3DE">this video</a></p>
</blockquote>

<p>Free will comes from the “veil of computability”, things look random until you find the pattern. I was at a bar last night and this girl told me you can’t predict humans, and the exact example she used was that it’s not like <code class="language-plaintext highlighter-rouge">y = mx + b</code></p>

<p>Oh, if only she knew. The dreams of my childhood have come true, studying machine learning has shown me how I work. I tried to explain that instead of 2 parameters it’s 100 trillion parameters, and it’s the slightly different <code class="language-plaintext highlighter-rouge">y = relu(w@x) + b</code> a bunch of times, you have to put some nonlinearities in there cause linear systems can only approximate a small class of functions.</p>

<p>But this explanation was not heard at a bar. She was so confident she was right, and like I didn’t even know where to start. Reader of this blog, do you know?</p>

<hr />
<p><br /></p>

<p>AI is coming and we are so unbelievably unprepared.</p>

<p>What is <a href="https://www.darioamodei.com/essay/machines-of-loving-grace">this garbage</a> and <a href="https://ai-2027.com/">this garbage</a>. It’s nerd shit and political propaganda. The amount of power over nature that the Silicon Valley death cult is stumbling into is horrifying, and these <em>high priests</em> don’t have a basic grasp of <em>people</em>. No humanities education (perhaps the programs were gutted on purpose).</p>

<p>Are we ready for the <a href="https://www.decisionproblem.com/paperclips/">hypnodrones</a>? How the fuck is targeted advertising
 legal and culturally okay? This will not stop until they take our <em>free will</em> from us.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>There’s a fire that burns today<br />
It’s raging under K and A<br />
I look back at descending wraiths<br />
And remnants of the failed state<br />
   Caracara – <a href="https://www.youtube.com/watch?v=HgXz5IpISJk">Better</a></p>
</blockquote>

<p>Nukes don’t end humanity. Current path AI doesn’t end humanity. It just ends all the machines and hands the world over to the street people. Now I see how the dark ages happened.</p>

<p>If all the humans died today, all the machines would shortly follow. If all the machines died today, humanity would keep on going. Pay attention to this milestone.</p>

<p>To date, machines are not robust, and evolution may be efficient at robust search. If it is, we get dark ages. If it’s not and we find a shortcut, God only knows.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/07/18/the-world-after-wireheading.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The World’s Computer | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The World’s Computer" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="This was the tagline of Ethereum, and it’s really smart. Sadly, I feel they have lost their way with Proof of Stake, and wish they would go back to focusing on building a reasonable world computer." />
<meta property="og:description" content="This was the tagline of Ethereum, and it’s really smart. Sadly, I feel they have lost their way with Proof of Stake, and wish they would go back to focusing on building a reasonable world computer." />
<link rel="canonical" href="the-worlds-computer.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/02/26/the-worlds-computer.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-02-26T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The World’s Computer" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-02-26T00:00:00+08:00","datePublished":"2024-02-26T00:00:00+08:00","description":"This was the tagline of Ethereum, and it’s really smart. Sadly, I feel they have lost their way with Proof of Stake, and wish they would go back to focusing on building a reasonable world computer.","headline":"The World’s Computer","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/02/26/the-worlds-computer.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/02/26/the-worlds-computer.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The World&#39;s Computer</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-02-26T00:00:00+08:00" itemprop="datePublished">Feb 26, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>This was the tagline of Ethereum, and it’s really smart. Sadly, I feel they have lost their way with Proof of Stake, and wish they would go back to focusing on building a reasonable world computer.</p>

<p>In 2024, it’s still painfully annoying to stand up a database. This is the only thing big tech really has, to the point that I often use Google Sheets or a GitHub repo effectively as a database. Sure, you could use a hosted MySQL on Azure, but dealing with backups, redundancy, and configuration makes it so annoying.</p>

<p>Another fact about databases is that the world only needs one of them. Standing up multiple databases is usually done for throughput or sandboxing reasons, nothing fundamental. Just create more “tables”</p>

<p>One properly built database can kill big tech. The database needs to handle all the throughput in the world, never go down, and handle permissioning (which is all smart contracts should do).</p>

<hr />
<p><br /></p>

<p>The Ethereum network is averaging 13 transactions per second. This is way too small. Let’s look at a few sources of data we want in our database.</p>

<p>There’s 21,510 credit card transactions per second. There’s 6,000 tweets per second (and maybe 5x more for other actions), for a total of 30,000 tps. E-mail is much bigger, at 4,000,000 tps. How many pushes to all the GitHub repos? Total, we are probably looking at order of magnitude 10,000,000 tps.</p>

<p>If there’s 8 billion people on the planet, they do some database write action on average about every 10 minutes. That seems right.</p>

<p>Ethereum is off by a factor of a million. Though I suspect the world’s compute is growing faster than the world’s transactions per second. Once a <a href="https://thume.ca/2023/01/02/one-machine-twitter/">single machine</a> can handle the worlds transactions, big tech falls.</p>

<p>Who’s building the 10M TPS ethereum?</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/02/26/the-worlds-computer.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Three Class Society | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Three Class Society" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I heard something during the trucker protest in Canada along the lines of: “Most people here don’t want to live in a free society. A free society requires personal responsiblity. People here want to be managed. They want a ruling class.”" />
<meta property="og:description" content="I heard something during the trucker protest in Canada along the lines of: “Most people here don’t want to live in a free society. A free society requires personal responsiblity. People here want to be managed. They want a ruling class.”" />
<link rel="canonical" href="three-class-society.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/10/03/three-class-society.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-10-03T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Three Class Society" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-10-03T00:00:00+08:00","datePublished":"2023-10-03T00:00:00+08:00","description":"I heard something during the trucker protest in Canada along the lines of: “Most people here don’t want to live in a free society. A free society requires personal responsiblity. People here want to be managed. They want a ruling class.”","headline":"Three Class Society","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/10/03/three-class-society.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/10/03/three-class-society.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Three Class Society</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-10-03T00:00:00+08:00" itemprop="datePublished">Oct 3, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I heard something during the trucker protest in Canada along the lines of: “Most people here don’t want to live in a free society. A free society requires personal responsiblity. People here want to be managed. They want a ruling class.”</p>

<p>I heard something similar once from a journalist in Egypt who shared a taxi with a man smoking hashish. That man was a supporter of a fundamentalist Islamic government, and when told if he got his preferred government he wouldn’t be able to smoke the hashish anymore, he replied saying that was the point.</p>

<hr />
<p><br /></p>

<p>I’ve asked friends for feedback on <a href="https://geohot.github.io/blog/jekyll/update/2023/04/11/wireheading-city.html">wireheading city</a>, and across the political spectrum there seems to be support for the idea.</p>

<p>I am a big fan of a free society. I very much enjoy my freedom, and accept that with freedom comes responsiblity. Aside from <a href="https://en.wikipedia.org/wiki/Victimless_crime">ridiculous laws</a>, I am law abiding, not in debt, job creating, and hopefully most would agree a net positive in society. If you don’t do crime, have a job, and aren’t taking more from the government than you give, you are a net positive. There’s some subtlety around the edges, but mainly net positive = economically positive.</p>

<p>I’ll note this is also a simple answer to immigration. If you are net (economically) positive, we want you. If you are net negative, we don’t. While measurement may be a bit tricky, anyone who doesn’t agree to this basic framework is an idiot who wants to live in a poor country.</p>

<hr />
<p><br /></p>

<p>Now, a free society isn’t for everyone, but the key aspect is that <b>you should be able to choose to opt in or out</b>, but you can’t do both. You are either a citizen or not, and there ain’t no such thing as half way…</p>

<p>If you want a life provided to you by the government, I’m okay with paying for this. However, if you choose this life, I don’t want to see you, I don’t want you in my city, I don’t want you voting, I pay for you, but nothing more. I don’t want you influencing society any more than a foreigner. This is the only way that a free democratic society can continue to exist.</p>

<blockquote>
  <p>“A democracy cannot exist as a permanent form of government. It can only exist until the people discover they can vote themselves largess out of the public treasury. From that moment on, the majority always votes for the candidate promising the most benefits from the public treasury, with the result that democracy always collapses over a loose fiscal policy–to be followed by a dictatorship.” - Alexander Fraser Tytler</p>
</blockquote>

<p>(if it fails and we get a dictator, hopefully he will have <a href="https://en.wikipedia.org/wiki/Lee_Kuan_Yew">studied economics</a> and not <a href="https://en.wikipedia.org/wiki/Pol_Pot">ideological nonsense</a>)</p>

<hr />
<p><br /></p>

<p>We currently have a two class society (two of my classes exist today), I propose we make it three.</p>

<ul>
  <li>Citizen – You participate in the economy. You have full freedom, but you must pay more to the government than you take.</li>
  <li>Subject – You do not participate in the economy. You have all your needs paid for. Aside from living in a subject city, you have most personal freedom. You do not have political freedom.</li>
  <li>Incarcerated – You do not participate in the economy. You have all your needs paid for. You have very limited freedom.</li>
</ul>

<p>Both of the bottom two classes are a net negative on society, but subjects will cost less than the incarcerated, and people will choose it voluntarily. There should be a path back from subject to citizen also, similar to immigration.</p>

<p>We now get a choice. Do we want to embrace policies like this, or do we want our society to collapse to the point it no longer can? I’ve never seen a politician speak like this. I hope they figure it out before it’s too late.</p>

<p>Among prospective “subjects” and appropriately framed, I actually think this policy would be quite popular.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/10/03/three-class-society.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>you have three minutes to escape the perpetual underclass | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="you have three minutes to escape the perpetual underclass" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I had a dream last night I went to work at Amazon. Joining the Bezos neofeudal empire. This post is directed at anyone with talent who works at a tech company ushering in this future." />
<meta property="og:description" content="I had a dream last night I went to work at Amazon. Joining the Bezos neofeudal empire. This post is directed at anyone with talent who works at a tech company ushering in this future." />
<link rel="canonical" href="three-minutes.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/17/three-minutes.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-17T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="you have three minutes to escape the perpetual underclass" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-17T00:00:00+08:00","datePublished":"2026-01-17T00:00:00+08:00","description":"I had a dream last night I went to work at Amazon. Joining the Bezos neofeudal empire. This post is directed at anyone with talent who works at a tech company ushering in this future.","headline":"you have three minutes to escape the perpetual underclass","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/17/three-minutes.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/17/three-minutes.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">you have three minutes to escape the perpetual underclass</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-17T00:00:00+08:00" itemprop="datePublished">Jan 17, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I had a dream last night I went to work at Amazon. Joining the Bezos neofeudal empire. This post is directed at anyone with talent who works at a tech company ushering in this future.</p>

<hr />
<p><br /></p>

<p>Have you thought about how this is going to play out? I understand you may be at a place where you are insecure about money, and that insecurity is what drives you. But why do you think having more money will fix that insecurity?</p>

<p>In the future, when labor is fully marginalized and capital is the only force, you will not be able to afford GPT$$$ (it’s $1B per month), only the billionaires will. GPT$$$ is surely smart enough to separate you from whatever you have, be that with targeting advertising, a scam you fall for, or lobbying your government to take it from you.</p>

<p>A pile of money will buy you nothing in the neofeudal world.</p>

<hr />
<p><br /></p>

<p>Historically, there has been some loyalty to the subjects of a feudal empire because labor had some value. You needed the peasants to grow the grain so you could tax it and take it and have leverage over others by having grain to offer them. When the grain is produced by machines, the peasants are cut out of the loop.</p>

<p>The solution to this is not to accumulate grain, buy shares in a granary, or anything else like that. They will find a way to make whatever you have worthless. Because the feudal world didn’t operate on capitalist principles, and neither will the neofeudal world.</p>

<hr />
<p><br /></p>

<p>If you work at a large company, if you work according to the principles of modern capitalism, where all the fish will be eaten by the bigger fish, and all will be eaten by the sharks, and all the sharks will be eaten by bigger sharks, you are actively bringing about the system that will kill you.</p>

<p><b>Have you considered not participating?</b> If you participate, we all lose. We will either all be in the underclass together or not.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/17/three-minutes.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>tiny corp’s product – a training box | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="tiny corp’s product – a training box" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Our new Hong Kong office." />
<meta property="og:description" content="Our new Hong Kong office." />
<link rel="canonical" href="tiny-corp-product.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/02/15/tiny-corp-product.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-02-15T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="tiny corp’s product – a training box" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-02-15T00:00:00+08:00","datePublished":"2026-02-15T00:00:00+08:00","description":"Our new Hong Kong office.","headline":"tiny corp’s product – a training box","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/02/15/tiny-corp-product.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/02/15/tiny-corp-product.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">tiny corp&#39;s product -- a training box</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-02-15T00:00:00+08:00" itemprop="datePublished">Feb 15, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p><img src="../../../../../assets/images/hk_office.jpg" /></p>
<blockquote>
  <p>Our new Hong Kong office.</p>
</blockquote>

<p>It’s starting to shape up what tiny corp’s product will be. It’s not much of a change from what we sell and do now, but the vision is clearer.</p>

<p>Every month, we see these LLMs become more and more human. However, there’s a major difference. They do not learn. Everyone has the same Claude/Codex/Kimi, with the same weights, the same desires, and the same biases. If current trends continue, the collapse in diversity will be staggering. To paraphrase:</p>

<blockquote>
  <p>I think there is a world market for maybe five people.</p>
</blockquote>

<p>This is not the future I want to live in.</p>

<hr />
<p><br /></p>

<p>If trends continue where there’s a single model with frozen weights and all learning is in-context, the cloud will win. Except in some highly latency sensitive (fighting robots) or connectivity critical (self driving cars) environments, it will be cheaper to run in batch on the cloud.</p>

<p>The enshittification that came to the web won’t be the driving force to local models. We either live in a world where open models are so bad even user-hostile closed models are better, or open models are good enough, and competition to run them through sites like <a href="https://openrouter.ai/">openrouter</a> will prevent enshittification.</p>

<p>The only way local models win is if there’s some value in full on learning per user or organization. At that point, with entirely different compute needing to run per user, local will beat out cloud.</p>

<p>The open question is if everything that’s unique about you can fit in a 10 kB CLAUDE.md. If that’s true, we have a pretty sad future ahead. It’s the Attack of the Clones, swarms of identical minds you have no say over all varying in a small boxed-in way. This isn’t learning, it’s <em>costuming</em>. Everyone who has used these things knows how little of an impact prompting makes compared to the model. It’s the Internet funneled into a little box you can edit on your profile. Write 3 paragraphs about what makes you unique.</p>

<p>We have to build for a future where that isn’t true. 90% of people will choose the cloud, and what they will find is that they are no longer meaningfully in the loop. The dream is an AI product that will do your job for you while you continue to get paid. But this cannot exist, that’s way too much of a fee to pay to the middleman. If you choose the homogenous mind, you are superfluous and will be cut out. Is there anything uniquely valuable about you? And I mean honestly, not the self-esteem pumping speeches you may have heard in school. If there’s not, I have some bad news for you…</p>

<hr />
<p><br /></p>

<p>We already <a href="https://tinygrad.org/#tinybox">sell the hardware</a>. Consumer GPUs still are the cheapest way to run models. There’s tons of work required on <a href="https://github.com/tinygrad/tinygrad">the infrastructure</a>. The frontend will be the future iterations of <a href="https://openclaw.ai/">OpenClaw</a> and <a href="https://opencode.ai/">opencode</a>. But the key distinction from what you have today is that your tinybox will learn. It will update the weights based on its interactions with you. Like living things.</p>

<p>This is many years away. Currently, we are focused on large LLM training (even running these things is hard, have you tried to use vLLM not on NVIDIA?) and generic infrastructure for driving GPUs. But this is the long term idea.</p>

<p>Not API keyed SaaS clones. Something that lives in your house and learns your values. Your child.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/02/15/tiny-corp-product.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>To Fight against Entropy | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="To Fight against Entropy" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Earlier this year, I bought 123 acres of land in Lakeside, CA. I’ve named it ecromata. I’ve been considering for a while how to build a competitor to the university system, and well, you have to start somewhere. It’s a idea that’s surprisingly broad, and in my mind has this as a sub goal. The goal of course isn’t to build another Harvard, because you’ll be subject to the same causes and forces of the current Harvard. The idea is to build a different type of Harvard." />
<meta property="og:description" content="Earlier this year, I bought 123 acres of land in Lakeside, CA. I’ve named it ecromata. I’ve been considering for a while how to build a competitor to the university system, and well, you have to start somewhere. It’s a idea that’s surprisingly broad, and in my mind has this as a sub goal. The goal of course isn’t to build another Harvard, because you’ll be subject to the same causes and forces of the current Harvard. The idea is to build a different type of Harvard." />
<link rel="canonical" href="to-fight-against-entropy.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2021/10/24/to-fight-against-entropy.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2021-10-24T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="To Fight against Entropy" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2021-10-24T00:00:00+08:00","datePublished":"2021-10-24T00:00:00+08:00","description":"Earlier this year, I bought 123 acres of land in Lakeside, CA. I’ve named it ecromata. I’ve been considering for a while how to build a competitor to the university system, and well, you have to start somewhere. It’s a idea that’s surprisingly broad, and in my mind has this as a sub goal. The goal of course isn’t to build another Harvard, because you’ll be subject to the same causes and forces of the current Harvard. The idea is to build a different type of Harvard.","headline":"To Fight against Entropy","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2021/10/24/to-fight-against-entropy.html"},"url":"https://geohot.github.io//blog/jekyll/update/2021/10/24/to-fight-against-entropy.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">To Fight against Entropy</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2021-10-24T00:00:00+08:00" itemprop="datePublished">Oct 24, 2021
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Earlier this year, I bought 123 acres of land in Lakeside, CA. I’ve named it <a href="https://ecromata.com">ecromata</a>. I’ve been considering for a while how to build a competitor to the university system, and well, you have to start somewhere. It’s a idea that’s surprisingly broad, and in my mind has this as a sub goal. The goal of course isn’t to build another Harvard, because you’ll be subject to the same causes and forces of the current Harvard. The idea is to build a <em>different type of Harvard</em>.</p>

<p>At comma, management has been able to be quite chill. I think of myself like the teacher from Good Will Hunting, and even if I’m not as capable as everyone we hire, I can tell the difference. Hopefully people there trust my ability to properly evaluate skill and contributions, and also trust my second order ability to select those who can properly evaluate skill and contribution. It helps also to have shared growth and shared ownership with people who are aligned with the mission.</p>

<p>Software has this beautiful way of being tool complete and much harder to regress than physical things. You can always revert software. The management problem on the land is not as simple, and you start to empathize with the professional managerial class more. They are legitimately good at managing and fighting entropy; I live in an apartment managed by them.</p>

<hr />
<p><br /></p>

<p>To deliver the same standard of living as my downtown San Diego apartment on the land would be a full time job. And the really unfortunate thing is that it’s not tool complete.</p>

<p>Consider going to a well to fetch water. Every day, you have to do that. And every day you do it, it doesn’t become easier. You can’t automate it without a different type of technology. You wouldn’t be using buckets, but rather pipes and a pump. (pre industrial revolution, this technology was humans)</p>

<p>But the problem doesn’t stop there. A pump wears out, and eventually needs to be replaced. Entropy is constantly chipping away at it, in a way that it doesn’t chip away at software. And to deal with that, you need another different type of technology.</p>

<hr />
<p><br /></p>

<p>Currently, this technology is humans. This is considered “blue-collar” work, but it’s managed by much more complex systems than those that manage software. While we may be good at managing them as a society, this is exactly where the PMC derives it’s power from. Human management systems.</p>

<p>The dream is to solve this with AI. Robotic plumbers. And while that still doesn’t complete the tool hierarchy, just one more thing does. Robotic robot fixers. With that, energy and raw material enters, and entropy is maintained.</p>

<p>While that world isn’t perfect, it does seem preferable to this one.</p>

<hr />
<p><br /></p>

<p>At comma, we have this concept of “management coefficient”, which is the number of people someone is capable of managing. A management coefficient (MC) of one means you can manage yourself. Growth of MC is the limiting factor on hiring, if your number of people exceeds your MC, as it does at some companies, you are going to have a bad time.</p>

<p>For now, I’m likely shelving the land project. The initial goal of it was to build something &gt;= self sustaining without my labor, and ideally eventually without any human labor. Without me, it has a sub person count management coefficient, and I don’t see this improving on the current trajectory.</p>

<p>I would potentially hire someone with a &gt;1 MC who has clever ways to approach this project, I know a lot of people are interested in this general area. Would require you to live on the land and work with very little direction toward being able to live completely off grid with a high standard of living. The ideal candidate would be someone who is working on this anyway. Land has water, beautiful views, tons of sunlight, 5G internet, 3 broken tractors, and a (beat up) trailer to live in initially. Reach out if you are interested, think like an off grid airbnb manager. Job would be part time; you’d be able to keep a full time remote job.</p>

<hr />
<p><br /></p>

<p>Though I think really, this dream of a sustainable fight against entropy has to wait for the robots. Solving self driving cars is just the start at comma (we’ve been saying this long before the Tesla bot!). The next target will be home robotics, robots that can cook and clean. And after that, we’ll move to more general purpose robotics. Robots that do security, building, plumbing, robot repair, and more. Of course if you are interested in this, <a href="https://comma.ai/jobs">comma is hiring</a>, but we finish self driving cars first.</p>

<p>A paradise built and maintained by machines.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2021/10/24/to-fight-against-entropy.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Tragic Case of Intel AI | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Tragic Case of Intel AI" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Intel is sitting on a huge amount of card inventory they can’t move, largely because of bad software. Most of this is a summary of the public #intel-hardware channel in the tinygrad discord." />
<meta property="og:description" content="Intel is sitting on a huge amount of card inventory they can’t move, largely because of bad software. Most of this is a summary of the public #intel-hardware channel in the tinygrad discord." />
<link rel="canonical" href="tragic-intel.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/03/24/tragic-intel.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-03-24T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Tragic Case of Intel AI" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-03-24T00:00:00+08:00","datePublished":"2025-03-24T00:00:00+08:00","description":"Intel is sitting on a huge amount of card inventory they can’t move, largely because of bad software. Most of this is a summary of the public #intel-hardware channel in the tinygrad discord.","headline":"The Tragic Case of Intel AI","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/03/24/tragic-intel.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/03/24/tragic-intel.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Tragic Case of Intel AI</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-03-24T00:00:00+08:00" itemprop="datePublished">Mar 24, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Intel is sitting on a huge amount of card inventory they can’t move, largely because of bad software. Most of this is a summary of the public #intel-hardware channel in the tinygrad discord.</p>

<p>Intel currently is sitting on:</p>
<ul>
  <li>15,000 Gaudi 2 cards (with baseboards)</li>
  <li>5,100 Intel Data Center GPU Max 1450s (without baseboards)</li>
</ul>

<p>If you were Intel, what would you do with them?</p>

<hr />
<p><br /></p>

<p>First, starting with the Gaudi cards. The <a href="https://github.com/HabanaAI/SynapseAI_Core">open source</a> repo needed to control them was archived on Feb 4, 2025. There’s a closed source version of this that’s <em>maybe</em> still maintained, but eww closed source and do you think it’s really maintained?</p>

<p><img src="../../../../../assets/images/gaudi2.png" width="400px" /></p>

<p>The architecture is kind of tragic, and that’s likely why they didn’t open source it. Unlike every other accelerator I have seen, the MMEs, which is where all the FLOPS are, are not controllable by the TPCs. While the TPCs have an <a href="https://github.com/HabanaAI/tpc_llvm">LLVM port</a>, the MME is not documented. After some poking around, I found the spec:</p>

<p><img src="../../../../../assets/images/gaudi2_mme.png" /></p>

<p>It’s highly fixed function, looks very similar to the Apple ANE. But that’s not even the real problem with it. The problem is that it is controlled by queues, not by the TPCs. Unpacking <code class="language-plaintext highlighter-rouge">habanalabs-dkms-1.19.2-32.all.deb</code> you can find the queues.</p>

<p><img src="../../../../../assets/images/gaudi2_queues.png" /></p>

<p>There is some way to push a command stream to the device so you don’t actually have to deal with the host itself for the queues. But that doesn’t prevent you having to decompose the network you are trying to run into something you can put on this fixed function block.</p>

<p>Programmability is on a spectrum, ranging from CPUs being the easiest, to GPUs, to things like the Qualcomm DSP / Google TPU (where at least you drive the MME from the program), to this and the Apple ANE being the hardest. While it’s impressive that they <a href="https://public.tableau.com/shared/P6JBG4Z6C?:display_count=y&amp;:origin=viz_share_link&amp;:embed=y">actually got on MLPerf Training v4.0</a> training GPT3, I suspect it’s all hand coded, and if you even can deviate off the trodden path you’ll get almost no perf.</p>

<p>Accelerators like this are okay for low power inference where you can adjust the model architecture for the target, Apple does a <a href="https://machinelearning.apple.com/research/vision-transformers">great job of this</a>. But this will never be acceptable for a training chip.</p>

<hr />
<p><br /></p>

<p>Then there’s the Data Center GPU Max 1450. Intel actually sent us a few of these, so good guy Intel thank you for the samples.</p>

<p><img src="../../../../../assets/images/intel_dc_max_1450.jpg" /></p>

<p>However, you quickly run into a problem…how do you plug them in? They need OAM sockets, 48V power, and a cooling solution that can sink 600W. As far as I can tell, they were only ever deployed in two systems, the <a href="https://www.alcf.anl.gov/aurora">Aurora Supercomputer</a> and the <a href="https://youtu.be/RCdI34bndkQ?t=1155">Dell XE9640</a>. It’s hard to know, but I doubt many of these Dell systems were sold.</p>

<p><img src="../../../../../assets/images/intel_dc_max_1450_tray.jpg" /></p>

<p>Intel then sent us this carrier board. In some ways it’s helpful, but in other ways it’s not at all. It still doesn’t solve cooling or power, and you need to buy 16x MCIO cables (cheap in quantity, but expensive and hard to find off the shelf). Also, I never got a straight answer, but I doubt Intel has many of these boards. And that board doesn’t look cheap to manufacture more of. The connectors alone, which you need two of per GPU, cost <a href="https://www.mouser.com/ProductDetail/Molex/202828-0068?qs=VVKQmw408U%2BJ9WHJVAVzpQ%3D%3D">$26 each</a>. That’s $208 for just the OAM connectors.</p>

<p>tiny corp was in discussions to buy these GPUs. How much would you pay for one of these on a PCIe card? The specs look great. 839 TFLOPS, 128 GB of ram, 3.3 TB/s of bandwidth. However…read <a href="https://chipsandcheese.com/p/intels-ponte-vecchio-chiplets-gone-crazy">this article</a>. Even in simple synthetic benchmarks, the chip doesn’t get anywhere near its max performance, and it looks to be for fundamental reasons like memory latency.</p>

<p>We estimate we could sell PCIe versions of these GPUs for $1,000; I don’t think most people know how hard it is to move non NVIDIA hardware. Before you say you’d pay more, ask yourself, do you really want to deal with the software?</p>

<p>An adapter card has four pieces. A PCB for the card, a 12-&gt;48V voltage converter, a heatsink, and a fan. My quote from the guy who makes an OAM adapter board was $310 for the PCB in 10+ quantity and $75 for the voltage converter. A heatsink that can handle 600W (heat pipes + vapor chamber) is going to cost $100, then maybe $20 more for the fan. That’s $505, and you still need to assemble and test them, oh and now there’s tariffs. Maybe you can get this down to $400 in ~1000 unit quantity.</p>

<p>So $200 for the GPU, $400 for the adapter, $100 for shipping/fulfillment/returns (more if you use Amazon), and 30% profit if you sell at $1k. tiny would net $1M on this, which has to cover NRE and you have risk of unsold inventory. We offered Intel $200 per GPU (a $680k wire) and they said no. They wanted $600, negotiations were stupidly slow, and even at that price it seemed like there were going to be weird strings attached. I suspect that unless a supercomputer person who already uses these GPUs wants to buy more they will ride it to zero.</p>

<p>If I were Intel, tiny corp is exactly who I’d want to have these GPUs. Imagine I’m $680k in the hole on Intel hardware. I’m really incentivized to make the software good to move these units, and I suspect many of the improvements would translate to A770/B580. It would get the GPUs out into people’s hands and get <em>someone</em> excited about this. But nope, I wasn’t able to find an individual with the power to make a deal, never mind actually make a deal. It’s unclear any individual in the company has that power. It makes me super reluctant to put any engineering effort into these GPUs.</p>

<p>tl;dr: there’s 5100 of these GPUs with no simple way to plug them in. It’s unclear if they worth the cost of the slot they go in, at least at normal slot prices. I bet they end up shredded, or <em>maybe</em> dumped on eBay for $50 each in a year like the <a href="https://www.newegg.com/intel-xeon-phi-5110p-pci-express-x16/p/N82E16819116972?">Xeon Phi cards</a>. If you buy one, good luck plugging it in!</p>

<hr />
<p><br /></p>

<p>The reason Meta and friends buy some AMD is as a hedge against NVIDIA. Even if it’s not usable, AMD has progressed on a solid steady roadmap, with a clear continuation from the <a href="https://www.ebay.com/itm/187064796397">2018 MI50</a> (which you can now buy for 99% off), to the <a href="https://www.amd.com/en/products/accelerators/instinct/mi300/mi325x.html">MI325X</a> which is a super exciting chip (AMD is king of chiplets). They are even showing signs of finally investing in software, which makes me <a href="https://geohot.github.io/blog/jekyll/update/2025/03/08/AMD-YOLO.html">bullish</a>. If NVIDIA stumbles for a generation, this is AMD’s game. The ROCm “copy each NVIDIA repo” strategy actually works if your competition stumbles. They can win GPUs with slow and steady improvement + competition stumbling, that’s how AMD won server CPUs.</p>

<p>With these Intel chips, I’m not sure what companies they would appeal to. <a href="https://www.servethehome.com/intel-ponte-vecchio-spaceship-gpu-no-longer-hunting-new-clusters/">Ponte Vecchio</a> is cancelled. There’s no point in investing in the platform if there’s not going to be a next generation, and therefore nobody can justify the cost of developing software, therefore there won’t be software, therefore they aren’t worth plugging in.</p>

<hr />
<p><br /></p>

<p>Where does this leave Intel’s AI roadmap? The successor to Ponte Vecchio was <a href="https://www.anandtech.com/show/18756/intel-scraps-rialto-bridge-gpu-next-server-gpu-will-be-falcon-shores-in-2025">Rialto Bridge</a>, but that was cancelled. The successor to that was Falcon Shores, but that was <a href="https://www.tomshardware.com/tech-industry/artificial-intelligence/intel-cancels-falcon-shores-gpu-for-ai-workloads-jaguar-shores-to-be-successor">also cancelled</a>. Intel claims the next GPU will be “Jaguar Shores”, but fool me once… To quote JazzLord1234 from <a href="https://www.reddit.com/r/intel/comments/1ie54h1/intel_cancels_falcon_shores_gpu_for_ai_workloads/">reddit</a></p>

<blockquote>
  <p>“No point even bothering to listen to their roadmaps anymore. They have squandered all their credibility.”</p>
</blockquote>

<p>Gaudi 3 is a flop due to <a href="https://www.tomshardware.com/tech-industry/artificial-intelligence/intel-says-it-will-miss-its-ai-goals-with-gaudi-3-unbaked-software-leaves-intels-usd500-million-ai-goal-unachievable-as-competitors-rake-in-billions">“unbaked software”</a>, but as much as I usually do blame software, nothing has changed from Gaudi 2 and it’s just a really hard chip to program for. So there’s no future there either.</p>

<p><img src="../../../../../assets/images/intel_jaguarshores.jpg" /></p>

<p>I can’t say that “Jaguar Shores” square instills confidence. It didn’t inspire confidence for “Joseph B.” on LinkedIn either.</p>

<p><img src="../../../../../assets/images/intel_jaguar_linkedin.png" /></p>

<hr />
<p><br /></p>

<p>From my interactions with Intel people, it seems there’s no individuals with power there, it’s all committee like leadership. The problem with this is there’s nobody who can say yes, just many people who can say no. Hence all the cancellations and the nonsense strategy.</p>

<p>AMD’s dysfunction is different. from the beginning they had leadership that can do things (Lisa Su replied to my first e-mail), they just didn’t see the value in investing in software until recently. They sort of had a point if they were only targeting hyperscalars. but it seems like <a href="https://semianalysis.com/2024/12/22/mi300x-vs-h100-vs-h200-benchmark-part-1-training/">SemiAnalysis got through to them</a> that hyperscalars aren’t going to deal with bad software either. It remains to be seen if they can shift culture to actually deliver good software, but there’s movement in that direction, and if they succeed AMD is <a href="https://geohot.github.io/blog/jekyll/update/2025/03/08/AMD-YOLO.html">so undervalued</a>. Their hardware is good.</p>

<p>With Intel, until that committee style leadership is gone, there’s 0 chance for success. Committee leadership is fine if you are trying to maintain, but Intel’s AI situation is even more hopeless than AMD’s, and you’d need something major to turn it around. At least with AMD, you can try installing ROCm <a href="https://pytorch.org/">from the PyTorch homepage</a> and be frustrated when there are bugs. Every time I have managed even to find <a href="https://intel.github.io/intel-extension-for-pytorch/">which piece</a> of Intel software I was supposed to use, I can’t recall even getting the import to work without a segfault or missing library.</p>

<hr />
<p><br /></p>

<p>Intel needs actual leadership to turn this around, or there’s 0 future in Intel AI.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/03/24/tragic-intel.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Vampire Attack Twitter | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Vampire Attack Twitter" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Here’s a simple way to take over Twitter for way less than $43 billion dollars." />
<meta property="og:description" content="Here’s a simple way to take over Twitter for way less than $43 billion dollars." />
<link rel="canonical" href="vampire-attack-twitter.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2022/04/16/vampire-attack-twitter.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2022-04-16T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Vampire Attack Twitter" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2022-04-16T00:00:00+08:00","datePublished":"2022-04-16T00:00:00+08:00","description":"Here’s a simple way to take over Twitter for way less than $43 billion dollars.","headline":"Vampire Attack Twitter","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2022/04/16/vampire-attack-twitter.html"},"url":"https://geohot.github.io//blog/jekyll/update/2022/04/16/vampire-attack-twitter.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Vampire Attack Twitter</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2022-04-16T00:00:00+08:00" itemprop="datePublished">Apr 16, 2022
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Here’s a simple way to take over Twitter for way less than $43 billion dollars.</p>

<p>For reference, this is a <a href="https://finematics.com/vampire-attack-sushiswap-explained/">vampire attack</a>, perhaps best popularized by SushiSwap.</p>

<hr />
<p><br /></p>

<p>The creators on Twitter are the liquidity providers, the lurkers are the users. It’s hard to create a new platform because you need both to move at once. Here’s a simple way to solve that.</p>

<p>Step 1: Make a clone of Twitter on a blockchain, TWITCHAIN, with a native currency of TWITCOIN. Make the UI clean and responsive. 6 months of engineering work for 5 good engineers. Back TWITCOIN with $1B in buy orders.</p>

<p>Step 2: Create a browser extension that watches while someone browses Twitter, and puts any tweets they see on the TWITCHAIN. If you provide an unseen tweet to the chain, you get TWITCOIN. 100k people would install this, and you’d scrape Twitter quite quickly.</p>

<p>Step 3: Reward Twitter creators based on likes and retweets with TWITCOIN. 10x the rewards if you post through the TWITCHAIN front end (which also posts to Twitter). Tons of creators would migrate for the FREE MONEY!</p>

<p>Step 4: Also reward likers and retweeters, assuming they link their Twitter account and use the TWITCHAIN front end to take the action. Even lurkers will use TWITCHAIN front end because it doesn’t have ads and fake “trending” topics. It’s like <a href="https://nitter.net">nitter</a>, but responsive because you didn’t cheap out on the cloud bill and with FREE MONEY!</p>

<p>Step 5: Watch the “liquidity” flow quickly from Twitter to TWITCHAIN.</p>

<hr />
<p><br /></p>

<p>Enjoy your new shiny Twitter. Hold half the TWITCOIN and you’ll also make a ton of money with this.</p>

<p>Responding to the <a href="https://news.ycombinator.com/item?id=31060368">HN doubters</a>: With TLS verification captured by the extension it’s easy to confirm that any scraped data is authentic. And Twitter does a lot already to prevent Sybil attacks, you also wouldn’t reward any accounts created after TWITCHAIN. While it’s easy to game many crypto things like this, I believe this is different since we are bootstrapping using Twitter.</p>

<p>(of course, the real truth of HN doubt is that <em>anything</em> is possible, because then they’d have to look inside and ask themselves the hard question about why <em>they</em> didn’t do it and instead just make a comfortable salary at FAANG while claiming nothing can ever change, and if it does it’s certainly not because <em>you</em> did it)</p>

<p>I would absolutely love to see this. I’m not a big scale person, and you have to go big with this and hit strong all at once. But I’m putting the idea out there for you, and you can pay me back in lulz of watching this happen. It would totally work.</p>


  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2022/04/16/vampire-attack-twitter.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>The Coming War on Car Ownership | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="The Coming War on Car Ownership" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="But George, surely you’ll still be allowed to own a car. They aren’t going to make that illegal. Of course they won’t, but they didn’t make general computation illegal either. And yet, who has root on the computer you are reading this on?" />
<meta property="og:description" content="But George, surely you’ll still be allowed to own a car. They aren’t going to make that illegal. Of course they won’t, but they didn’t make general computation illegal either. And yet, who has root on the computer you are reading this on?" />
<link rel="canonical" href="war-on-car-ownership.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2026/01/25/war-on-car-ownership.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2026-01-25T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="The Coming War on Car Ownership" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2026-01-25T00:00:00+08:00","datePublished":"2026-01-25T00:00:00+08:00","description":"But George, surely you’ll still be allowed to own a car. They aren’t going to make that illegal. Of course they won’t, but they didn’t make general computation illegal either. And yet, who has root on the computer you are reading this on?","headline":"The Coming War on Car Ownership","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2026/01/25/war-on-car-ownership.html"},"url":"https://geohot.github.io//blog/jekyll/update/2026/01/25/war-on-car-ownership.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">The Coming War on Car Ownership</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2026-01-25T00:00:00+08:00" itemprop="datePublished">Jan 25, 2026
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>But George, surely you’ll still be allowed to own a car. They aren’t going to make that illegal. Of course they won’t, but they didn’t make <a href="https://en.wikisource.org/wiki/The_Coming_War_on_General_Computation">general computation</a> illegal either. And yet, who has root on the computer you are reading this on?</p>

<hr />
<p><br /></p>

<p>Robotaxis will start to make obvious economic sense in 3-5 years (note that that’s <a href="https://geohot.github.io/blog/jekyll/update/2025/12/22/the-opinion.html">less than 8</a>, you don’t have to fully solve self driving cars for this, robotaxis can operate profitably in limited scopes).</p>

<p>Unlike Uber and Lyft which are marketplaces, the growth of robotaxi networks is only limited by capital. At first, there will be massive proliferation of networks. VC-type investors have unlimited appetite for risk, and all 26 of the basically identical companies will pitch with projections claiming they will own the entire market. Even though everyone should know there’s 25 other identical companies, they will have secrecy vibes trying to claim they figured out some key detail the others didn’t.</p>

<p>It will look like scooter companies, which were also only capital constrained, and the streets will be blanketed by these robotaxis in a throwback to the scooter era. Some jurisdictions will make up weird licensing processes – not that you have to give a straight up cut to the government, but that your company has to be onboard with some stupid political agenda item to get a license. Our robotaxis are all cleaned by Black Women who were diagnosed by Licensed Therapists with PTSD from the ICE raids, so we should be first in line to get a license.</p>

<hr />
<p><br /></p>

<p>This era will be great for everyone, plenty of availability, nice new cars, and cheap rides everywhere! You always think people are going to catch on with the scams of Silicon Valley, but the scammers manage to stay one little step ahead and dress up the scam differently this time. You yourself will think for a minute this time will be different, maybe something about AI and abundance, maybe something about how they are regulated better to support the local community, maybe a three token model backed by USDC in a vault backed by this coin that’s stabilized by the… But nothing will fundamentally be different, these companies will grow based on how much they can raise – the biggest companies will be the biggest liars promising the biggest returns.</p>

<p>These companies will be massively unprofitable. Some will hide this better than others and keep the investment dollars rolling in. Some will give up the ghost and get bought by the bigger companies. The big fish will eat the little fish. From 26 down to 2 or 3.</p>

<p>At this point, it’s time to raise prices. You’ll always have a defector among 26 companies, but among 2 or 3, you’ll be able to coordinate pricing without explicitly discussing it (which would be illegal!). Everyone tacitly agrees that the correct price for a ride has nothing to do with the cost of providing that ride, just simply the algorithmically calculated maximum amount the purchaser is willing to pay. Since the companies have consolidated, they have access to enough data to make this prediction easy and uniform across the services.</p>

<hr />
<p><br /></p>

<p>This era will start to be bad, but like Homer corrected Bart, this is just the worst era so far. We’ll be back to where we are today with Uber and Lyft, but then the companies will realize the new leverage they have now that they didn’t have before. Uber and Lyft always have the <a href="https://en.wikipedia.org/wiki/Analog_hole">analog hole</a>, where as much as they dress it up, when Uber is paying my driver $7 for a ride that I’m paying $20 for, I can just talk to the dude and be like let’s both cancel and I’ll give you $10 cash.</p>

<p>With robotaxis, you can’t do this. There’s 0 fear that a robotaxi will defect from your network. The only remaining competition with any check on prices is personal car ownership.</p>

<hr />
<p><br /></p>

<p>So no, they won’t make it illegal it own cars. They will just raise the price through insurance. Who is going to insure a human driver? The car insurance companies will one by one switch to only insuring robotaxis that are owned by large corporations (you can’t own it, you might do the maintenance wrong and we can’t trust you to do that). But it’s really just a thinly veiled excuse, the capital markets backing insurance companies implicitly know the best way to squeeze the remaining dollars out of you is robotaxis.</p>

<p>Of course, the government has an option for you to self insure. You can place <a href="https://www.dmv.ca.gov/portal/vehicle-registration/insurance-requirements/">a $75,000 cash bond</a> with the DMV. You got $75k lying around you don’t wanna earn interest on? Driving is a privilege, not a right. How much is it really worth to you?</p>

<hr />
<p><br /></p>

<p>This is simply what’s going to happen. The effective end of car ownership, I don’t see anything in America that will stop it. Get ready for 2-3 companies to effectively own the roads and all the enshittification that will follow.</p>

<p>China won’t have this so bad, Xi Jinping will download a robotaxi app, look at the gouged price, and gently nudge that company to be run for the good of the people. Of course that won’t even need to happen, because no company in China would let it get that far out of hand. Everyone knows you don’t compete with the State for power. They will stay in the 26 companies phase. I’m starting to see why the Chinese are a lot more optimistic about AI than Americans.</p>

<p>And it’s not just about cars, it’s about something that was yours becoming just another service with a license that has changing terms from week to week. Another piece of the social fabric sold out from under you. Wait where are you going? Oh it’s 2 AM and that’s an area with prostitution we aren’t going to service rides to that area. Surely you don’t need freedom. You trust the corporation.</p>

<p>Are you okay with this? <a href="https://geohot.github.io/blog/jekyll/update/2026/01/17/three-minutes.html">Have you considered not participating?</a></p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2026/01/25/war-on-car-ownership.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>…and now we see what is possible | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="…and now we see what is possible" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Every 70 years America goes through a revolutionary transition. Washington, Lincoln, FDR, now?" />
<meta property="og:description" content="Every 70 years America goes through a revolutionary transition. Washington, Lincoln, FDR, now?" />
<link rel="canonical" href="what-is-possible.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/11/06/what-is-possible.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-11-06T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="…and now we see what is possible" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-11-06T00:00:00+08:00","datePublished":"2024-11-06T00:00:00+08:00","description":"Every 70 years America goes through a revolutionary transition. Washington, Lincoln, FDR, now?","headline":"…and now we see what is possible","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/11/06/what-is-possible.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/11/06/what-is-possible.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">...and now we see what is possible</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-11-06T00:00:00+08:00" itemprop="datePublished">Nov 6, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Every 70 years America goes through a revolutionary transition. Washington, Lincoln, FDR, now?</p>

<p>The Republicans now control the Presidency, the House, the Senate, and the Supreme Court. Is that everything? Does government power lie there, like we are told, or is it all secretly elsewhere? This is likely the best chance we’ll get to find out.</p>

<hr />
<p><br /></p>

<p>In retrospect, I’m very impressed with how Elon did the Twitter transition, and I’m grateful to have had a front row seat to that history. It made me reconsider how power works. He has an army of competent lieutenants, and he tasked them with doing a variety of things.</p>

<p>I regret not seriously trying to fix search, I didn’t really understand at the time what he was asking or why. I thought I was there to reverse engineer the mess of a codebase, while in reality just having people try to build features and seeing what breaks is a better strategy. I’m not very good at being a follower, I need to deeply understand why, and I’m sorry I didn’t until later.</p>

<p>I am much more conservative, whereas he seems to operate at the edge of leverage. Just look at how he went all in on this election. This is something I struggle with with respect to my own comparative lack of success. I am not all that open to risk, even when the downside isn’t close to life ending. While I believe very strongly in my ability to use a process and make continuous forward progress, it’s a slow process. I want to take more risk, but when I think it through my ideas for risk often just feel foolish.</p>

<hr />
<p><br /></p>

<p>I really hope Donald Trump understands the need for radical change of the US government (on the order of firing 80% of the people), and also understands that he can’t do it without Elon’s help. So that’s obstacle one, does Elon get free range to operate?</p>

<p>Even if so, this isn’t Twitter, and it may not work. I frequently think about if it’s possible to shut Google down, like does anyone have the ability to do this? Twitter was in a position where it could be purchased, no one is rich enough to buy Google. You could get a coalition of capital, but <em>could you?</em></p>

<p>If you can’t shut it down, you don’t control it. While Elon could have shut down Twitter, can control of all three branches of government shut down the government? I’m not sure. And if not, where is the power actually?</p>

<hr />
<p><br /></p>

<p>It’s possible this will be another completely boring presidency. Stupid squabbles over normal stupid American Overton window things, and the same trillions of dollars going to the same people, just slightly more red.</p>

<p>It’s even possible that the Intelligence Agency Deep State shows up on your first day in the Oval Office, tells you who really runs things, and tells you what happens to you if you defy them. “Hello, we are the Deep State. Here are the bounds in which you can act. Step outside them, and we will kill you”</p>

<p>Which is another place the government differs from Twitter. As a state, they have a legitimate monopoly on violence, so is the deep state’s threat even wrong? “You just didn’t understand the President hasn’t actually been in charge for 60 years. Better for everyone that way. We have control of weapons that can end the world. We can’t trust something like that to <em>the will of the people</em>”</p>

<hr />
<p><br /></p>

<p>I’m not sure anyone really knows the answers to these questions. But if the Trump transition team reads this, I’d really really like to find out. The USGOV Files?</p>

<p>Will this be one of the historical once every 70 years administrations? I’ll know it is if the government budget is cut by over 50%. That shows you actually have power, and only then is it possible to make a new, good, government.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/11/06/what-is-possible.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Where the Bitter Lesson ends | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Where the Bitter Lesson ends" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering." />
<meta property="og:description" content="Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering." />
<link rel="canonical" href="where-the-bitter-lesson-ends.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2024/03/27/where-the-bitter-lesson-ends.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2024-03-27T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Where the Bitter Lesson ends" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2024-03-27T00:00:00+08:00","datePublished":"2024-03-27T00:00:00+08:00","description":"Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering.","headline":"Where the Bitter Lesson ends","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2024/03/27/where-the-bitter-lesson-ends.html"},"url":"https://geohot.github.io//blog/jekyll/update/2024/03/27/where-the-bitter-lesson-ends.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Where the Bitter Lesson ends</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2024-03-27T00:00:00+08:00" itemprop="datePublished">Mar 27, 2024
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering.</p>
</blockquote>

<p>Clips have been making the rounds on Twitter from my second Lex about the “bishop guy” in a chess engine, or a “cone guy” in a self driving car. These engineering ideas look ever more ridiculous.</p>

<p>Since the beginning of comma, I wanted to make a machine that could drive cars like a human. Obviously there’s no reference to traffic cones inside human DNA, they learn about them from data. So there shouldn’t be any reference to traffic cones in your codebase.</p>

<hr />
<p><br /></p>

<p>Rich Sutton <a href="http://www.incompleteideas.net/IncIdeas/BitterLesson.html">stated this most iconically</a> in 2019.</p>

<blockquote>
  <p>One thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.</p>
</blockquote>

<p>But then where does it stop? Why draw the line at DNA? Evolution is clearly a search and optimization process. Why is hard coding stuff that’s in the human DNA okay, why not evolve a driving agent? Why not evolve life?</p>

<hr />
<p><br /></p>

<p>The concept of a <a href="https://www.lesswrong.com/tag/seed-ai">Seed AI</a> is very captivating. Build a minimum viable self improving AI, and allow it to bootstrap its way to human and beyond. This is clearly possible, evolution did it (though with an ungodly amount of compute).</p>

<p>But remember, our goal is just to build something superhuman, not go beyond. Unlike a self driving car, if you were building a train driving agent, learning like a human is probably not the right choice. It’s simple enough to code and test. You should have a <code class="language-plaintext highlighter-rouge">train_signal.py</code></p>

<hr />
<p><br /></p>

<p>Imagine you are tasked with building a radio. Which of these approaches would you take?</p>

<ol>
  <li>
    <p>Understanding where radios come from and replicating that. Setting up the same initial conditions of radio, an eccentric Italian man born in 1874, an attic in Pontecchio, an estate owned by the man’s father in Bologna to expand to, etc…</p>
  </li>
  <li>
    <p>Taking apart a radio. Reverse engineering and documenting each piece. Building things that behave like each piece. Testing them in the original radio. Building a clone.</p>
  </li>
</ol>

<p>I imagine the second path would be more fruitful and faster. We have a working example, we just need to clone it. A much easier task than creating it from scratch.</p>

<hr />
<p><br /></p>

<p>I say the bitter lesson stops at human DNA. While we have to avoid cargo culting, I think that many of the pieces of the human brain are starting to be buildable with today’s technology. The brain isn’t some hyperelegant machine that captures the essence of learning, it’s a <a href="https://www.amazon.com/Brief-History-Intelligence-Humans-Breakthroughs/dp/0063286343">bunch of hacks</a>, and hacks that we can replicate.</p>

<p>Having a cone guy in your self driving car company is still ridiculous, because the only working implementation of a driving agent doesn’t have a cone guy, it learns cones from data. But the only working implementation of engineers do have a neocortex, a hippocampus, a <a href="https://en.wikipedia.org/wiki/Basal_ganglia">basal ganglia</a>, an amygdala, and a thalamus.</p>

<p>I would be fine with <a href="https://comma.ai/">our</a> <a href="https://github.com/commaai/openpilot">human agent software</a> having directories for each one of those pieces. Transformers as a neocortex, some way better RAG as a hippocampus, actually working TD-learning as a basal ganglia, an amygdala to prevent the robot destroying itself, and a thalamus to coordinate the system and search.</p>

<p>We are just trying to build knock-off humans, not solve life. They can do that.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2024/03/27/where-the-bitter-lesson-ends.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Wireheading City | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Wireheading City" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="I spent the last 2 weeks travelling around India, and I came up with this line:" />
<meta property="og:description" content="I spent the last 2 weeks travelling around India, and I came up with this line:" />
<link rel="canonical" href="wireheading-city.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/04/11/wireheading-city.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-04-11T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Wireheading City" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-04-11T00:00:00+08:00","datePublished":"2023-04-11T00:00:00+08:00","description":"I spent the last 2 weeks travelling around India, and I came up with this line:","headline":"Wireheading City","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/04/11/wireheading-city.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/04/11/wireheading-city.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Wireheading City</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-04-11T00:00:00+08:00" itemprop="datePublished">Apr 11, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>I spent the last 2 weeks travelling around India, and I came up with this line:</p>

<blockquote>
  <p>There’s a fine line that defines civilization.</p>
</blockquote>

<p>Several beggars approached me on the street, and I didn’t give them anything. I suspect they would be surprised to learn that we have worse beggars in America. At least the people here didn’t look like they were crazy or on drugs.</p>

<hr />
<p><br /></p>

<p>Homelessness is a growing problem in America, and I think I have a solution everyone can be happy with. I’ll note that you were never given the social contract to sign, it was just implied. Not everyone wants to participate in society, and I think this is absolutely fine.</p>

<p><b>We should do more to accommodate those who would like to opt out.</b></p>

<hr />
<p><br /></p>

<p><img src="../../../../../assets/images/black_rock_city.jpg" /></p>

<p>I propose <b>Wireheading City</b>. The simplest way to imagine it is a scaled up version of <a href="https://wikitravel.org/en/Black_Rock_City">Black Rock City</a>. Black Rock City is 1.5 miles in diameter and houses 80,000 people. There’s 582,000 homeless in the US, and we’d like to have place for all of them with some room to grow. With a squared scaling law, a 5 mile diameter city should be able to house a million at similar density.</p>

<p>Northern Nevada is not a bad choice of location either. It is devoid of people, and livable outside all year round. We need more than just the 5 mile diameter city, we also need a 2 mile exclusion zone where trespassing is prohibited.</p>

<hr />
<p><br /></p>

<p>Wireheading City is the first city with UBI! Except, instead of money, we provide you with the basic necessities of life. The water is clean and all you can drink. For food: rice, beans, corn, potatoes, and sugary drinks. For shelter, a Walmart grade sleeping bag and tent, issued to you at the border.</p>

<p>In addition, we’d like you to be entertained. You have to check in your ID at the border, but along with your shelter, you receive a par government mobile phone and a pair of wired headphones. Hopefully we can partner with Netflix, Amazon, and HBO to provide no cost entertainment to the citizens of Wireheading City. It is a great public good I suspect they would want to be a part of.</p>

<hr />
<p><br /></p>

<p>We will need to do even more to entice potential citizens of Wireheading City.</p>
<ul>
  <li>Are you a drinker? Free beer, wine, vodka, tequila, and rum!</li>
  <li>Free weed! Would you like an edible or a joint, sir?</li>
  <li>A methhead? Free meth! Or (generic) Adderall if that’s your thing.</li>
  <li>A junkie? Free heroin, oxy, fentanyl or whatever your opiate of choice is!</li>
  <li>For practical reasons, ibuprofen, antibiotics, and birth control are also available for free.</li>
</ul>

<p><b>The free drugs are a major draw of Wireheading City.</b></p>

<p>You may consume as many drugs as you would like. However, export of these drugs is strictly prohibited, and you will be aggressively searched on your way through the exit path of the exclusion zone.</p>

<hr />
<p><br /></p>

<p>Violent and property crime are illegal in Wireheading City, and no guns, knives, or weapons of any kind are permitted in through the border. It is a pedestrian only city, you can’t drive there, the only way in and out is the winding and walled 10 mile path through the exclusion zone.</p>

<p>For all goods other than what is provided free, the economy functions. Imports of pricy food, electronics, upgraded shelters, and other trinkets are welcome. Citizens have unfettered free internet access, and some will certainly find entrepreneurial ways to make money. Prostitution is legal.</p>

<hr />
<p><br /></p>

<p>This is a major step towards solving the current homelessness crisis, in addition to the coming AI created unemployment crisis. Wireheading City is not for everyone, only for those over 21 who choose it (no children are permitted). If you do choose it, there’s a free one way bus from every major metropolitan area that takes you right to the gate. It is not a prison, and you are free to leave at any time with just a 10 mile walk out.</p>

<p><em>This is a government program I would get behind.</em></p>

<hr />
<hr />
<p><br /></p>

<p>Update: I’ve received several replies suggesting this “diminishes human dignity” or something. I’ll remind you, the US has a <b>prison population of over 2 million</b>, which is way more destructive to human dignity than this. This is entirely opt in (we’ll even have a consent form).</p>

<p>I’ll note that I expect prison populations to drop after Wireheading City opens, so much so that the savings will offset the state’s operating cost (prisoners cost $45k/yr!). Currently, prison is the only way to easily get free food and shelter in the US, and many people misbehave inside because they don’t want to be there. Here, if you misbehave, you are sent to prison, where the drugs are not free and there’s no 10 mile path to walk out.</p>

<p>Also, I don’t expect everyone there to be residents. Some adventurous society folk will visit for the weekend, and I expect some parts of the City to cater to them. While the “unemployment” rate will likely be in the 80s or 90s, there’s some who will rake in cash from tourists.</p>

<p>Re: if a child is conceived in the City. Unlike prison, you get a chance to leave (or take <a href="https://en.wikipedia.org/wiki/Mifepristone">RU-486</a>) before you carry to term. If you remain and have the child, they are placed in the care of an outside family member or the state. As they would be in any unfit environment for a child.</p>

<hr />
<p><br /></p>

<p>I could spell out details all day, I don’t think they are too hard to fill in. The real question is why are we not building this? We just need permission from the state to form this “special economic zone”, it could probably even be privately funded.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/04/11/wireheading-city.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>Wokeism | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="Wokeism" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="There’s been much discussion about “wokeism”, and I think a definition might help to clarify things. My followers on Twitter helped me with this." />
<meta property="og:description" content="There’s been much discussion about “wokeism”, and I think a definition might help to clarify things. My followers on Twitter helped me with this." />
<link rel="canonical" href="wokeism.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2023/02/13/wokeism.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2023-02-13T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="Wokeism" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2023-02-13T00:00:00+08:00","datePublished":"2023-02-13T00:00:00+08:00","description":"There’s been much discussion about “wokeism”, and I think a definition might help to clarify things. My followers on Twitter helped me with this.","headline":"Wokeism","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2023/02/13/wokeism.html"},"url":"https://geohot.github.io//blog/jekyll/update/2023/02/13/wokeism.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">Wokeism</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2023-02-13T00:00:00+08:00" itemprop="datePublished">Feb 13, 2023
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>There’s been much discussion about “wokeism”, and I think a definition might help to clarify things. My followers on Twitter helped me with this.</p>

<hr />
<p><br /></p>

<p>When you Google it, the top two results contain radically different definitions. I googled “wokeism” and got:</p>

<p>The <a href="https://fairporteducationalalliance.org/what-is-wokeism%3F">first result</a>:</p>
<blockquote>
  <p>“Wokeism is weaponized personal grievances masquerading as a genuine social concern. It’s defined by its fraudulent nature, as being distinct from legitimate social grievances.”</p>
</blockquote>

<p>The <a href="https://en.wikipedia.org/wiki/Woke">second result</a>:</p>
<blockquote>
  <p>“Woke (/ˈwoʊk/ WOHK) is an adjective derived from African-American Vernacular English (AAVE) meaning “alert to racial prejudice and discrimination”. Beginning in the 2010s, it came to encompass a broader awareness of social inequalities such as sexism, and has also been used as shorthand for American Left ideas involving identity politics and social justice, such as the notion of white privilege and slavery reparations for African Americans.”</p>
</blockquote>

<hr />
<p><br /></p>

<p>The first result is absolute stupidity, ironically perhaps a “weaponized personal grievance.”</p>

<p>The second result is better, but I believe “alert to racial prejudice and discrimination” doesn’t fully cover what people mean when they say someone is woke, but rather a definition to retreat to when more controversial components of wokeism are challenged, a la the <a href="https://en.wikipedia.org/wiki/Motte-and-bailey_fallacy">Motte-and-bailey fallacy</a>.</p>

<hr />
<p><br /></p>

<p>A common thing I’ll hear from woke people is about “representation”. I don’t want to strawman, so let me find some exact quotes.</p>

<p>I tried googling “wokeism in tech”, but this got me mostly people complaining about wokeism in tech, hopefully the jump to “diversity in tech” isn’t too much, and yielded <a href="https://www.betterup.com/blog/diversity-in-tech">this page</a> as the top result:</p>

<blockquote>
  <p>Diversity in tech is all about bringing more perspectives to a traditionally homogeneous and often non-inclusive industry. Today, women and people of color lack representation — Google, for example, reported that just 5.5% of new hires in 2020 were Black+ (and just 6.6% were Latinx+). Diversity rates have been increasing over the years, but not quickly enough.</p>
</blockquote>

<p>And</p>

<blockquote>
  <p>The tech industry is undeniably dominated by men. Diversity in tech statistics show that year after year, women are underpaid and underrepresented. Women make up only 25% of computer-science related jobs, according to the Pew Research Center. Women are even less represented in engineering, making up just 14% of the workforce.</p>
</blockquote>

<p>One might say, so what? The page attempts a “business” related answer, but it’s clear that’s not really why (if it were, they would give facts and studies instead of anecdotes) The real answer is on the page.</p>

<blockquote>
  <p>You may be wondering why diversity in tech is so important. There are moral reasons, such as <b>increased equality</b>, for emphasizing diversity in tech.</p>
</blockquote>

<hr />
<p><br /></p>

<p>Equality is commonly used to mean two different things, “equality of opportunity” and “equality of outcome”.</p>

<p>Imagine a 100m race between me and <a href="https://en.wikipedia.org/wiki/Usain_Bolt">Usain Bolt</a>. Equality of opportunity would mean that we both start off at the same place, and both have to run the same 100m. <em>I will never win</em>. For equality of outcome, we might have to weigh Usain down with 100 lbs or give me a 50m head start to get a world where we each have a 50% chance of winning the race.</p>

<p>With all the talk of “representation”, I had imagined that meant woke people desired equality of outcome. This is an <a href="https://en.wikipedia.org/wiki/Is–ought_problem">ought statement</a> and can’t be challenged with science, so I thought this is where we leave it.</p>

<hr />
<p><br /></p>

<p>But then I asked the woke. Overwhelmingly (in Twitter poll), it turns out the woke state a preference for equality of opportunity over outcome!</p>

<p>This was surprising since the quotes above are all complaints about unequal outcomes, and implicitly assume it’s due to the “non-inclusive” nature of the industry without exploring other hypotheses.</p>

<p>After a bit more digging, I got to the core belief of wokeism:</p>

<p><b>With true equality of opportunity, we will see equality of outcome. If we don’t see equality of outcome, it is because we don’t have equality of opportunity.</b></p>

<p>The crazy thing about this belief is that it’s factually false, not just an opinion.</p>

<hr />
<p><br /></p>

<p>Factually false beliefs do a better job binding people together than true beliefs. Which cult has more traction: the “earth is round” cult or the “earth is flat” cult?</p>

<p>Of course, if you are “woke” you won’t see this belief as false, and regardless of what I write here I doubt I will change your mind. But this explains what is observed with respect to the Inquisition style tactics. Believe in <a href="https://en.wikipedia.org/wiki/The_Blank_Slate">the blank slate</a> hypothesis, or else:</p>

<blockquote>
  <p>In 2020, an open letter to the Linguistic Society of America requesting the removal of Pinker from its list of LSA Fellows and its list of media experts was signed by hundreds of academics. The letter accused Pinker of a “pattern of drowning out the voices of people suffering from racist and sexist violence, in particular in the immediate aftermath of violent acts and/or protests against the systems that created them,” citing as examples six tweets and a phrase used in his 2011 book.</p>
</blockquote>

<hr />
<hr />
<p><br /></p>

<p>Update: I’ve gotten replies suggesting that while equality of opportunity may not lead 100% to equality of outcome, it will at least get us closer to it, perhaps a soft wokeism. There’s actually <a href="https://slatestarcodex.com/2017/08/07/contra-grant-on-exaggerated-differences/">evidence of the opposite</a>, at least for the gender gap in tech. Meaning as equality of opportunity increases, observed outcomes diverge.</p>

<p>If your axiom is blank slatism, you will continually make wrong predictions.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2023/02/13/wokeism.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>you are a good person | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="you are a good person" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="In my previous post, I advocate turning against the unproductive. Whenever you decide to turn against a group, it’s very important to prevent purity spirals. There needs to be a bright line that doesn’t move." />
<meta property="og:description" content="In my previous post, I advocate turning against the unproductive. Whenever you decide to turn against a group, it’s very important to prevent purity spirals. There needs to be a bright line that doesn’t move." />
<link rel="canonical" href="you-are-a-good-person.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/02/you-are-a-good-person.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-02T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="you are a good person" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-02T00:00:00+08:00","datePublished":"2025-09-02T00:00:00+08:00","description":"In my previous post, I advocate turning against the unproductive. Whenever you decide to turn against a group, it’s very important to prevent purity spirals. There needs to be a bright line that doesn’t move.","headline":"you are a good person","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/02/you-are-a-good-person.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/02/you-are-a-good-person.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">you are a good person</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-02T00:00:00+08:00" itemprop="datePublished">Sep 2, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>In <a href="https://geohot.github.io/blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html">my previous post</a>, I advocate turning against the unproductive. Whenever you decide to turn against a group, it’s very important to prevent purity spirals. There needs to be a bright line that doesn’t move.</p>

<p>Here is that line.</p>

<p><em>You should be, on net, producing more than you are consuming.</em></p>

<hr />
<p><br /></p>

<p>You shouldn’t feel bad if you are producing less than you could be.<br />
You shouldn’t feel bad if others are producing more.<br />
You shouldn’t feel bad if you are living off of savings for a bit.<br />
You shouldn’t feel bad if you are making an investment that will pay off in the future.</p>

<p>But at the end of your life, total it all up. You should have produced more than you consumed. That’s what it means to be a good person.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>We used to make shit in this country, build shit.<br />
Now all we do is put our hand in the next guy’s pocket.<br />
   Frank Sobotka – The Wire</p>
</blockquote>

<p>It needs to stop. I have to believe that the average person is net positive, because if they aren’t, we’re already too far gone, and any prospect of a democracy is over.</p>

<p>But if we aren’t too far gone, we have to stop the hemorrhaging. The unproductive rich are in cahoots with the unproductive poor to take from you.</p>

<p>And it’s really the unproductive rich that are the problem. They loudly frame helping the unproductive as a moral issue for helping the poor because they know deep down they are unproductive losers. But they aren’t beyond saving. They just need to make different choices.</p>

<hr />
<p><br /></p>

<p>This cultural change starts with you. Private equity, market manipulators, real estate, sales, lawyers, lobbyists. This is no longer okay. You know the type of person I’m talking about.</p>

<p>Let’s elevate farmers, engineers, manufacturing, miners, construction, food prep, delivery, operations. Jobs that produce value that you can point to.</p>

<p>There’s a role for everyone in society. From productive billionaires to the fry cook at McDonalds. They are both good people. But negative sum jobs need to no longer be socially okay. The days of living off the work of everyone else are over. We live in a society.</p>

<p>You have to produce more than you consume.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/02/you-are-a-good-person.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>you can never go back | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="you can never go back" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Total disassociation, fully out your mind Googling “derealization”, hating what you find That unapparent summer air in early fall The quiet comprehending of the ending of it all    Bo Burnham - That Funny Feeling" />
<meta property="og:description" content="Total disassociation, fully out your mind Googling “derealization”, hating what you find That unapparent summer air in early fall The quiet comprehending of the ending of it all    Bo Burnham - That Funny Feeling" />
<link rel="canonical" href="you-can-never-go-back.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/08/31/you-can-never-go-back.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-08-31T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="you can never go back" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-08-31T00:00:00+08:00","datePublished":"2025-08-31T00:00:00+08:00","description":"Total disassociation, fully out your mind Googling “derealization”, hating what you find That unapparent summer air in early fall The quiet comprehending of the ending of it all    Bo Burnham - That Funny Feeling","headline":"you can never go back","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/08/31/you-can-never-go-back.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/08/31/you-can-never-go-back.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">you can never go back</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-08-31T00:00:00+08:00" itemprop="datePublished">Aug 31, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <blockquote>
  <p>Total disassociation, fully out your mind<br />
Googling “derealization”, hating what you find<br />
That unapparent summer air in early fall<br />
The quiet comprehending of the ending of it all<br />
   Bo Burnham - <a href="https://www.youtube.com/watch?v=ObOqq1knVxs">That Funny Feeling</a></p>
</blockquote>

<p>I was thinking today about a disc jockey. Like one in the 80s, where you actually had to put the records on the turntables to get the music. You move the information. You were the file system.</p>

<p>I like the <a href="https://www.youtube.com/c/RetroGameMechanicsExplained">Retro Game Mechanics</a> channel on YouTube. What was possible was limited by the hardware, and in a weird way it forced games to be good. Skill was apparent by a quick viewing, and different skill is usually highly correlated. Good graphics meant good story – not true today.</p>

<p>I was thinking about all the noobs showing up to comma. If you can put a technical barrier up to stop them, like it used to be. But you can’t. These barriers can’t be fake, because a fake barrier isn’t like a real barrier. A fake barrier is one small patch away from being gone.</p>

<hr />
<p><br /></p>

<p><em>What if the Internet was a mistake?</em> I feel like it’s breaking my brain. It was this mind expanding world in my childhood, but now it’s a set of narrow loops that are harder and harder to get out of. And you can’t escape it. Once you have Starlink to your phone, not having the Internet with you will be a <em>choice</em>, not a real barrier. There’s nowhere to hide.</p>

<p><a href="https://en.wikipedia.org/wiki/Chris_McCandless">Chris McCandless</a> wanted to be an explorer, but being born in 1968 meant that the world was already all explored. His clever solution, throw away the map. But that didn’t make him an explorer, it made him an idiot who died 5 miles from a bridge that would have saved his life.</p>

<hr />
<p><br /></p>

<blockquote>
  <p>And I’ll tell you something else that you ain’t dying enough to know<br />
There’s still some living left when your prime comes and goes<br />
   Jimmy Eat World - <a href="https://www.youtube.com/watch?v=PAa2KuxXSYw">Big Casino</a></p>
</blockquote>

<p>Sure, you can still spin real records, code for the NES, and SSH into your comma device. But you don’t <em>have</em> to. And that makes the people who do it come from a different distribution from the people who used to. They are not explorers in the same way Chris McCandless wasn’t.</p>

<p>When I <a href="https://web.archive.org/web/20070613184827/http://yudkowsky.net/singularity.html">found out about the singularity</a> at 15, I was sure it was going to happen. It was depressing for a while, realizing that machines would be able to do everything a lot better than I could. But then I realized that it wasn’t like that yet and I could still work on this problem. And here I am, working in AI 20 years later. I thought I came to grips with obsolescence.</p>

<hr />
<p><br /></p>

<p>But it’s not obsolescence, the reality is looking to be so much sadder than I imagined. It won’t be humans accepting the rise of the machines, it won’t be humans fighting the rise of the machines, it will be human shaped zoo animals oddly pacing back and forth in a corner of the cage while the world keeps turning around them.</p>

<p>It’s easy to see the appeal of conspiracy theories. Even if <em>they</em> hate you, it’s more comforting to believe that <em>they</em> exist. That at least somebody is driving. But that’s not true. It’s just going.</p>

<p>There are no longer Western institutions capable of making sense of the world. (maybe the Chinese ones can? it’s hard to tell) We are shoved up brutally against evolution, just of the memetic variety. The TikTok brainrot kids will be nothing compared to the ChatGPT brainrot kids.</p>

<p>And I’m not talking like an old curmudgeon about the new forms of media being bad and the youth being bad like Socrates said. Because you can never go back. It will be whatever it is.</p>

<hr />
<p><br /></p>

<p>To every fool preaching <a href="https://en.wikipedia.org/wiki/End_of_history">the end of history</a>, evolution spits in your face. To every fool preaching the world government AI singleton, evolution spits in your face.</p>

<p>I knew these things intellectually, but viscerally it’s just hard to live through. The world feels so small and I feel like I’m being stared at by the Eye of Sauron.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/08/31/you-can-never-go-back.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>
<!DOCTYPE html>
<html lang="en"><head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta name="viewport" content="width=device-width, initial-scale=1"><!-- Begin Jekyll SEO tag v2.8.0 -->
<title>you will blame the wrong people | the singularity is nearer</title>
<meta name="generator" content="Jekyll v4.4.1" />
<meta property="og:title" content="you will blame the wrong people" />
<meta property="og:locale" content="en_US" />
<meta name="description" content="Billionaires, am I right? How can they have so much while we have unhoused people in this country!" />
<meta property="og:description" content="Billionaires, am I right? How can they have so much while we have unhoused people in this country!" />
<link rel="canonical" href="you-will-blame-the-wrong-people.html" />
<meta property="og:url" content="https://geohot.github.io//blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html" />
<meta property="og:site_name" content="the singularity is nearer" />
<meta property="og:type" content="article" />
<meta property="article:published_time" content="2025-09-01T00:00:00+08:00" />
<meta name="twitter:card" content="summary" />
<meta property="twitter:title" content="you will blame the wrong people" />
<script type="application/ld+json">
{"@context":"https://schema.org","@type":"BlogPosting","dateModified":"2025-09-01T00:00:00+08:00","datePublished":"2025-09-01T00:00:00+08:00","description":"Billionaires, am I right? How can they have so much while we have unhoused people in this country!","headline":"you will blame the wrong people","mainEntityOfPage":{"@type":"WebPage","@id":"https://geohot.github.io//blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html"},"url":"https://geohot.github.io//blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html"}</script>
<!-- End Jekyll SEO tag -->
<link rel="stylesheet" href="../../../../../assets/main.css"><link type="application/atom+xml" rel="alternate" href="https://geohot.github.io//blog/feed.xml" title="the singularity is nearer" /></head>
<body><header class="site-header" role="banner">

  <div class="wrapper"><a class="site-title" rel="author" href="../../../../../../blog.html">the singularity is nearer</a><nav class="site-nav">
        <input type="checkbox" id="nav-trigger" class="nav-trigger" />
        <label for="nav-trigger">
          <span class="menu-icon">
            <svg viewBox="0 0 18 15" width="18px" height="15px">
              <path d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.032C17.335,0,18,0.665,18,1.484L18,1.484z M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.032C17.335,6.031,18,6.696,18,7.516L18,7.516z M18,13.516C18,14.335,17.335,15,16.516,15H1.484 C0.665,15,0,14.335,0,13.516l0,0c0-0.82,0.665-1.483,1.484-1.483h15.032C17.335,12.031,18,12.695,18,13.516L18,13.516z"/>
            </svg>
          </span>
        </label>

        <div class="trigger"><a class="page-link" href="https://geohot.github.io/blog/about/">About</a></div>
      </nav></div>
</header>
<main class="page-content" aria-label="Content">
      <div class="wrapper">
        <article class="post h-entry" itemscope itemtype="http://schema.org/BlogPosting">

  <header class="post-header">
    <h1 class="post-title p-name" itemprop="name headline">you will blame the wrong people</h1>
    <p class="post-meta">
      <time class="dt-published" datetime="2025-09-01T00:00:00+08:00" itemprop="datePublished">Sep 1, 2025
      </time></p>
  </header>

  <div class="post-content e-content" itemprop="articleBody">
    <p>Billionaires, am I right?<br />
How can they have so much while we have unhoused people in this country!</p>

<p>Immigrants, am I right?<br />
How can we be letting new people in when we aren’t taking care of Americans first!</p>

<hr />
<p><br /></p>

<p>It’s going to be so painful to watch.<br />
The tearing down of two of the productive groups in America.</p>

<p>Billionaires will go away.</p>

<p>Immigrants will go away.</p>

<p>The problems will continue to get worse.</p>

<hr />
<p><br /></p>

<p>The problem is the unproductive. The rich unproductive and the poor unproductive. The finance middle-man and welfare recipient. The real estate agent and the person <a href="https://apps.npr.org/unfit-for-work/">on disability</a>. The person with a fake job. Anyone who purposefully creates complexity for others. The obstructionists. Rent seekers. Anyone who lobbies against others getting so they can have relatively more.</p>

<p>Broken systems that elevate zero sum losers.</p>

<p>Why can’t we all turn against them?</p>

<p>The first step is recognizing this is the problem. I don’t know why most people don’t see it.</p>

  </div><a class="u-url" href="https://geohot.github.io/blog/jekyll/update/2025/09/01/you-will-blame-the-wrong-people.html" hidden></a>
</article>

      </div>
    </main><footer class="site-footer h-card">
  <data class="u-url" href="/blog/"></data>

  <div class="wrapper">

    <h2 class="footer-heading">the singularity is nearer</h2>

    <div class="footer-col-wrapper">
      <div class="footer-col footer-col-1">
        <ul class="contact-list">
          <li class="p-name">the singularity is nearer</li><li><a class="u-email" href="mailto:geohot@gmail.com">geohot@gmail.com</a></li></ul>
      </div>

      <div class="footer-col footer-col-2"><ul class="social-media-list"><li><a href="https://github.com/geohot"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#github"></use></svg> <span class="username">geohot</span></a></li><li><a href="https://www.twitter.com/realgeorgehotz"><svg class="svg-icon"><use xlink:href="/blog/assets/minima-social-icons.svg#twitter"></use></svg> <span class="username">realgeorgehotz</span></a></li></ul>
</div>

      <div class="footer-col footer-col-3">
        <p>A home for poorly researched ideas that I find myself repeating a lot anyway</p>
      </div>
    </div>

  </div>

</footer>
</body>

</html>